2024-09-17T05:31:59.721 INFO:root:teuthology version: 1.2.2.dev2+g3752d38 2024-09-17T05:31:59.743 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-17T05:31:59.836 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/pdonnell-2024-09-17_02:09:51-fs-wip-pdonnell-testing-20240916.200549-debug-distro-default-smithi/7908628 branch: wip-pdonnell-testing-20240916.200549-debug description: fs/volumes/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mgr mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/stock/{centos_9.stream k-stock} ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile pg_health} tasks/volumes/{overrides test/clone-progress}} email: pdonnell@redhat.com first_in_suite: false job_id: '7908628' kernel: client: sha1: distro kdb: 1 sha1: distro ktype: distro last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi name: pdonnell-2024-09-17_02:09:51-fs-wip-pdonnell-testing-20240916.200549-debug-distro-default-smithi no_nested_subset: false openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: centos os_version: 9.stream overrides: admin_socket: branch: wip-pdonnell-testing-20240916.200549-debug ceph: cluster-conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 rados mon op timeout: 900 rados osd op timeout: 900 mds: debug mds: 20 debug mds balancer: 20 debug ms: 2 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: client mount timeout: 30 debug client: 20 debug mgr: 20 debug ms: 1 mon warn on pool no app: false mon: mon op complaint time: 120 osd: osd op complaint time: 180 conf: client: pid file: '' global: ms die on skipped message: false mgr: debug client: 20 debug finisher: 20 debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon down mkfs grace: 300 osd: bdev async discard: true bdev enable discard: true bluestore allocator: bitmap bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug osd: 20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - FS_DEGRADED - fs.*is degraded - filesystem is degraded - FS_INLINE_DATA_DEPRECATED - FS_WITH_FAILED_MDS - MDS_ALL_DOWN - filesystem is offline - MDS_DAMAGE - MDS_DEGRADED - MDS_FAILED - MDS_INSUFFICIENT_STANDBY - insufficient standby MDS daemons available - MDS_UP_LESS_THAN_MAX - online, but wants - filesystem is online with fewer MDS than max_mds - POOL_APP_NOT_ENABLED - do not have an application enabled - overall HEALTH_ - Replacing daemon - deprecated feature inline_data - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - PG_AVAILABILITY - PG_DEGRADED - Reduced data availability - Degraded data redundancy - OSD full dropping all updates - OSD near full - pausewr flag - failsafe engaged, dropping updates - failsafe disengaged, no longer dropping - is full \(reached quota - POOL_FULL - POOL_BACKFILLFULL sha1: ce1b342bf8c6349a8c90cd607f83bff2443f21cf ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: ce1b342bf8c6349a8c90cd607f83bff2443f21cf kclient: syntax: v1 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-pdonnell-testing-20240916.200549-debug sha1: ce1b342bf8c6349a8c90cd607f83bff2443f21cf owner: scheduled_pdonnell@teuthology priority: 90 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - mgr.y - mds.a - mds.c - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - client.2 - - mon.b - mon.c - mgr.x - mds.b - mds.d - osd.4 - osd.5 - osd.6 - osd.7 - client.1 - client.3 seed: 476 sha1: ce1b342bf8c6349a8c90cd607f83bff2443f21cf sleep_before_teardown: 0 subset: 320/512 suite: fs suite_branch: wip-pdonnell-testing-20240916.200549-debug suite_path: /home/teuthworker/src/git.ceph.com_ceph-c_ce1b342bf8c6349a8c90cd607f83bff2443f21cf/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph-ci.git suite_sha1: ce1b342bf8c6349a8c90cd607f83bff2443f21cf syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi150.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLf+a6aYY3Ccvd8VlgnMr6rqEZfGpBxOHA6TYPZrA/3hgC4fKviw6oNEaaebHXaMX3yn9PRMJ00UhyQnw4xTBng= smithi176.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBEUuKpDph/hnadAMK44ypLVHDO8Zct36CM420JJMEAkWh+/ltdgQZpvegJojm5ZNkaNCm+DNLWJsdj/0d7ZnJVc= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - ceph: create_rbd_pool: false - kclient: null - cephfs_test_runner: fail_on_skip: false modules: - tasks.cephfs.test_volumes.TestCloneProgressReporter teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return yaml.ktype == 'upstream' end - local function is_kdistro() return yaml.ktype == 'distro' end - local function is_fuse() return false end - local function syntax_version() return yaml.overrides.kclient.syntax end teuthology_branch: main teuthology_sha1: 3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a timestamp: 2024-09-17_02:09:51 tube: smithi user: pdonnell verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.3401856 2024-09-17T05:31:59.836 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph-c_ce1b342bf8c6349a8c90cd607f83bff2443f21cf/qa; will attempt to use it 2024-09-17T05:31:59.837 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph-c_ce1b342bf8c6349a8c90cd607f83bff2443f21cf/qa/tasks 2024-09-17T05:31:59.837 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-09-17T05:31:59.839 INFO:teuthology.task.internal:Checking packages... 2024-09-17T05:31:59.859 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash 'ce1b342bf8c6349a8c90cd607f83bff2443f21cf' 2024-09-17T05:31:59.859 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-09-17T05:31:59.859 INFO:teuthology.packaging:ref: None 2024-09-17T05:31:59.859 INFO:teuthology.packaging:tag: None 2024-09-17T05:31:59.859 INFO:teuthology.packaging:branch: wip-pdonnell-testing-20240916.200549-debug 2024-09-17T05:31:59.859 INFO:teuthology.packaging:sha1: ce1b342bf8c6349a8c90cd607f83bff2443f21cf 2024-09-17T05:31:59.859 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=wip-pdonnell-testing-20240916.200549-debug 2024-09-17T05:31:59.999 INFO:teuthology.task.internal:Found packages for ceph version 19.3.0-4989.gce1b342b 2024-09-17T05:32:00.001 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-09-17T05:32:00.008 INFO:teuthology.task.internal:no buildpackages task found 2024-09-17T05:32:00.008 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-09-17T05:32:00.014 INFO:teuthology.task.internal:Saving configuration 2024-09-17T05:32:00.030 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-09-17T05:32:00.035 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-09-17T05:32:00.057 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi150.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/pdonnell-2024-09-17_02:09:51-fs-wip-pdonnell-testing-20240916.200549-debug-distro-default-smithi/7908628', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-17 05:26:51.190488', 'locked_by': 'scheduled_pdonnell@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLf+a6aYY3Ccvd8VlgnMr6rqEZfGpBxOHA6TYPZrA/3hgC4fKviw6oNEaaebHXaMX3yn9PRMJ00UhyQnw4xTBng='} 2024-09-17T05:32:00.078 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi176.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/pdonnell-2024-09-17_02:09:51-fs-wip-pdonnell-testing-20240916.200549-debug-distro-default-smithi/7908628', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-17 05:26:51.189000', 'locked_by': 'scheduled_pdonnell@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBEUuKpDph/hnadAMK44ypLVHDO8Zct36CM420JJMEAkWh+/ltdgQZpvegJojm5ZNkaNCm+DNLWJsdj/0d7ZnJVc='} 2024-09-17T05:32:00.078 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-09-17T05:32:00.083 INFO:teuthology.task.internal:roles: ubuntu@smithi150.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'] 2024-09-17T05:32:00.083 INFO:teuthology.task.internal:roles: ubuntu@smithi176.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3'] 2024-09-17T05:32:00.083 INFO:teuthology.run_tasks:Running task console_log... 2024-09-17T05:32:00.129 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7ff1e8ee3ac0>, signals=[15]) 2024-09-17T05:32:00.130 INFO:teuthology.run_tasks:Running task internal.connect... 2024-09-17T05:32:00.135 INFO:teuthology.task.internal:Opening connections... 2024-09-17T05:32:00.135 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi150.front.sepia.ceph.com 2024-09-17T05:32:00.137 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi150.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-17T05:32:00.210 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi176.front.sepia.ceph.com 2024-09-17T05:32:00.211 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi176.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-17T05:32:00.283 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-09-17T05:32:00.289 DEBUG:teuthology.orchestra.run.smithi150:> uname -m 2024-09-17T05:32:00.307 INFO:teuthology.orchestra.run.smithi150.stdout:x86_64 2024-09-17T05:32:00.307 DEBUG:teuthology.orchestra.run.smithi150:> cat /etc/os-release 2024-09-17T05:32:00.365 INFO:teuthology.orchestra.run.smithi150.stdout:NAME="CentOS Stream" 2024-09-17T05:32:00.365 INFO:teuthology.orchestra.run.smithi150.stdout:VERSION="9" 2024-09-17T05:32:00.365 INFO:teuthology.orchestra.run.smithi150.stdout:ID="centos" 2024-09-17T05:32:00.365 INFO:teuthology.orchestra.run.smithi150.stdout:ID_LIKE="rhel fedora" 2024-09-17T05:32:00.366 INFO:teuthology.orchestra.run.smithi150.stdout:VERSION_ID="9" 2024-09-17T05:32:00.366 INFO:teuthology.orchestra.run.smithi150.stdout:PLATFORM_ID="platform:el9" 2024-09-17T05:32:00.366 INFO:teuthology.orchestra.run.smithi150.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-17T05:32:00.366 INFO:teuthology.orchestra.run.smithi150.stdout:ANSI_COLOR="0;31" 2024-09-17T05:32:00.366 INFO:teuthology.orchestra.run.smithi150.stdout:LOGO="fedora-logo-icon" 2024-09-17T05:32:00.366 INFO:teuthology.orchestra.run.smithi150.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-17T05:32:00.366 INFO:teuthology.orchestra.run.smithi150.stdout:HOME_URL="https://centos.org/" 2024-09-17T05:32:00.366 INFO:teuthology.orchestra.run.smithi150.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-17T05:32:00.366 INFO:teuthology.orchestra.run.smithi150.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-17T05:32:00.366 INFO:teuthology.orchestra.run.smithi150.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-17T05:32:00.367 INFO:teuthology.lock.ops:Updating smithi150.front.sepia.ceph.com on lock server 2024-09-17T05:32:00.391 DEBUG:teuthology.orchestra.run.smithi176:> uname -m 2024-09-17T05:32:00.409 INFO:teuthology.orchestra.run.smithi176.stdout:x86_64 2024-09-17T05:32:00.409 DEBUG:teuthology.orchestra.run.smithi176:> cat /etc/os-release 2024-09-17T05:32:00.466 INFO:teuthology.orchestra.run.smithi176.stdout:NAME="CentOS Stream" 2024-09-17T05:32:00.466 INFO:teuthology.orchestra.run.smithi176.stdout:VERSION="9" 2024-09-17T05:32:00.466 INFO:teuthology.orchestra.run.smithi176.stdout:ID="centos" 2024-09-17T05:32:00.466 INFO:teuthology.orchestra.run.smithi176.stdout:ID_LIKE="rhel fedora" 2024-09-17T05:32:00.467 INFO:teuthology.orchestra.run.smithi176.stdout:VERSION_ID="9" 2024-09-17T05:32:00.467 INFO:teuthology.orchestra.run.smithi176.stdout:PLATFORM_ID="platform:el9" 2024-09-17T05:32:00.467 INFO:teuthology.orchestra.run.smithi176.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-17T05:32:00.467 INFO:teuthology.orchestra.run.smithi176.stdout:ANSI_COLOR="0;31" 2024-09-17T05:32:00.467 INFO:teuthology.orchestra.run.smithi176.stdout:LOGO="fedora-logo-icon" 2024-09-17T05:32:00.467 INFO:teuthology.orchestra.run.smithi176.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-17T05:32:00.467 INFO:teuthology.orchestra.run.smithi176.stdout:HOME_URL="https://centos.org/" 2024-09-17T05:32:00.467 INFO:teuthology.orchestra.run.smithi176.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-17T05:32:00.467 INFO:teuthology.orchestra.run.smithi176.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-17T05:32:00.467 INFO:teuthology.orchestra.run.smithi176.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-17T05:32:00.468 INFO:teuthology.lock.ops:Updating smithi176.front.sepia.ceph.com on lock server 2024-09-17T05:32:00.491 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-09-17T05:32:00.499 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-09-17T05:32:00.504 INFO:teuthology.task.internal:Checking for old test directory... 2024-09-17T05:32:00.504 DEBUG:teuthology.orchestra.run.smithi150:> test '!' -e /home/ubuntu/cephtest 2024-09-17T05:32:00.506 DEBUG:teuthology.orchestra.run.smithi176:> test '!' -e /home/ubuntu/cephtest 2024-09-17T05:32:00.522 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-09-17T05:32:00.528 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-09-17T05:32:00.528 DEBUG:teuthology.orchestra.run.smithi150:> test -z $(ls -A /var/lib/ceph) 2024-09-17T05:32:00.564 DEBUG:teuthology.orchestra.run.smithi176:> test -z $(ls -A /var/lib/ceph) 2024-09-17T05:32:00.800 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-09-17T05:32:00.854 INFO:teuthology.run_tasks:Running task kernel... 2024-09-17T05:32:00.868 INFO:teuthology.task.kernel:normalize config orig: {'client': {'sha1': 'distro'}, 'kdb': 1, 'sha1': 'distro'} 2024-09-17T05:32:00.868 INFO:teuthology.task.kernel:normalize config final: {'client.0': {'sha1': 'distro'}, 'client.2': {'sha1': 'distro'}, 'client.1': {'sha1': 'distro'}, 'client.3': {'sha1': 'distro'}} 2024-09-17T05:32:00.868 INFO:teuthology.task.kernel:config {'client.0': {'sha1': 'distro'}, 'client.1': {'sha1': 'distro'}}, timeout 300 2024-09-17T05:32:00.869 DEBUG:teuthology.orchestra.run.smithi150:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-17T05:32:00.869 DEBUG:teuthology.orchestra.run.smithi176:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-17T05:32:00.886 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-17T05:32:00.886 DEBUG:teuthology.orchestra.run.smithi150:> uname -r 2024-09-17T05:32:00.887 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-17T05:32:00.887 DEBUG:teuthology.orchestra.run.smithi176:> uname -r 2024-09-17T05:32:00.943 INFO:teuthology.orchestra.run.smithi150.stdout:5.14.0-503.el9.x86_64 2024-09-17T05:32:00.944 INFO:teuthology.task.kernel:Running kernel on smithi150: 5.14.0-503.el9.x86_64 2024-09-17T05:32:00.944 DEBUG:teuthology.orchestra.run.smithi150:> sudo yum install -y kernel 2024-09-17T05:32:00.945 INFO:teuthology.orchestra.run.smithi176.stdout:5.14.0-503.el9.x86_64 2024-09-17T05:32:00.945 INFO:teuthology.task.kernel:Running kernel on smithi176: 5.14.0-503.el9.x86_64 2024-09-17T05:32:00.945 DEBUG:teuthology.orchestra.run.smithi176:> sudo yum install -y kernel 2024-09-17T05:32:03.467 INFO:teuthology.orchestra.run.smithi176.stdout:CentOS Stream 9 - BaseOS 12 MB/s | 8.3 MB 00:00 2024-09-17T05:32:03.537 INFO:teuthology.orchestra.run.smithi150.stdout:CentOS Stream 9 - BaseOS 9.9 MB/s | 8.3 MB 00:00 2024-09-17T05:32:05.184 INFO:teuthology.orchestra.run.smithi176.stdout:CentOS Stream 9 - AppStream 30 MB/s | 20 MB 00:00 2024-09-17T05:32:05.863 INFO:teuthology.orchestra.run.smithi150.stdout:CentOS Stream 9 - AppStream 16 MB/s | 20 MB 00:01 2024-09-17T05:32:10.212 INFO:teuthology.orchestra.run.smithi176.stdout:CentOS Stream 9 - CRB 5.2 MB/s | 6.5 MB 00:01 2024-09-17T05:32:10.716 INFO:teuthology.orchestra.run.smithi150.stdout:CentOS Stream 9 - CRB 6.1 MB/s | 6.5 MB 00:01 2024-09-17T05:32:12.440 INFO:teuthology.orchestra.run.smithi150.stdout:CentOS Stream 9 - Extras packages 36 kB/s | 19 kB 00:00 2024-09-17T05:32:12.627 INFO:teuthology.orchestra.run.smithi176.stdout:CentOS Stream 9 - Extras packages 16 kB/s | 19 kB 00:01 2024-09-17T05:32:13.461 INFO:teuthology.orchestra.run.smithi150.stdout:Extra Packages for Enterprise Linux 25 MB/s | 23 MB 00:00 2024-09-17T05:32:13.740 INFO:teuthology.orchestra.run.smithi176.stdout:Extra Packages for Enterprise Linux 23 MB/s | 23 MB 00:00 2024-09-17T05:32:18.967 INFO:teuthology.orchestra.run.smithi150.stdout:lab-extras 34 kB/s | 1.7 kB 00:00 2024-09-17T05:32:19.112 INFO:teuthology.orchestra.run.smithi176.stdout:lab-extras 35 kB/s | 1.7 kB 00:00 2024-09-17T05:32:20.857 INFO:teuthology.orchestra.run.smithi150.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-09-17T05:32:20.857 INFO:teuthology.orchestra.run.smithi150.stdout:Package kernel-5.14.0-503.el9.x86_64 is already installed. 2024-09-17T05:32:20.947 INFO:teuthology.orchestra.run.smithi150.stdout:Dependencies resolved. 2024-09-17T05:32:20.954 INFO:teuthology.orchestra.run.smithi150.stdout:================================================================================ 2024-09-17T05:32:20.954 INFO:teuthology.orchestra.run.smithi150.stdout: Package Architecture Version Repository Size 2024-09-17T05:32:20.954 INFO:teuthology.orchestra.run.smithi150.stdout:================================================================================ 2024-09-17T05:32:20.955 INFO:teuthology.orchestra.run.smithi150.stdout:Installing: 2024-09-17T05:32:20.955 INFO:teuthology.orchestra.run.smithi150.stdout: kernel x86_64 5.14.0-508.el9 baseos 36 k 2024-09-17T05:32:20.955 INFO:teuthology.orchestra.run.smithi150.stdout:Installing dependencies: 2024-09-17T05:32:20.955 INFO:teuthology.orchestra.run.smithi150.stdout: kernel-core x86_64 5.14.0-508.el9 baseos 16 M 2024-09-17T05:32:20.955 INFO:teuthology.orchestra.run.smithi150.stdout: kernel-modules x86_64 5.14.0-508.el9 baseos 35 M 2024-09-17T05:32:20.955 INFO:teuthology.orchestra.run.smithi150.stdout: kernel-modules-core x86_64 5.14.0-508.el9 baseos 29 M 2024-09-17T05:32:20.955 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-09-17T05:32:20.955 INFO:teuthology.orchestra.run.smithi150.stdout:Transaction Summary 2024-09-17T05:32:20.955 INFO:teuthology.orchestra.run.smithi150.stdout:================================================================================ 2024-09-17T05:32:20.955 INFO:teuthology.orchestra.run.smithi150.stdout:Install 4 Packages 2024-09-17T05:32:20.955 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-09-17T05:32:20.956 INFO:teuthology.orchestra.run.smithi150.stdout:Total download size: 79 M 2024-09-17T05:32:20.956 INFO:teuthology.orchestra.run.smithi150.stdout:Installed size: 126 M 2024-09-17T05:32:20.956 INFO:teuthology.orchestra.run.smithi150.stdout:Downloading Packages: 2024-09-17T05:32:20.977 INFO:teuthology.orchestra.run.smithi176.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-09-17T05:32:20.977 INFO:teuthology.orchestra.run.smithi176.stdout:Package kernel-5.14.0-503.el9.x86_64 is already installed. 2024-09-17T05:32:21.057 INFO:teuthology.orchestra.run.smithi176.stdout:Dependencies resolved. 2024-09-17T05:32:21.072 INFO:teuthology.orchestra.run.smithi176.stdout:================================================================================ 2024-09-17T05:32:21.072 INFO:teuthology.orchestra.run.smithi176.stdout: Package Architecture Version Repository Size 2024-09-17T05:32:21.072 INFO:teuthology.orchestra.run.smithi176.stdout:================================================================================ 2024-09-17T05:32:21.072 INFO:teuthology.orchestra.run.smithi176.stdout:Installing: 2024-09-17T05:32:21.073 INFO:teuthology.orchestra.run.smithi176.stdout: kernel x86_64 5.14.0-508.el9 baseos 36 k 2024-09-17T05:32:21.073 INFO:teuthology.orchestra.run.smithi176.stdout:Installing dependencies: 2024-09-17T05:32:21.073 INFO:teuthology.orchestra.run.smithi176.stdout: kernel-core x86_64 5.14.0-508.el9 baseos 16 M 2024-09-17T05:32:21.073 INFO:teuthology.orchestra.run.smithi176.stdout: kernel-modules x86_64 5.14.0-508.el9 baseos 35 M 2024-09-17T05:32:21.073 INFO:teuthology.orchestra.run.smithi176.stdout: kernel-modules-core x86_64 5.14.0-508.el9 baseos 29 M 2024-09-17T05:32:21.073 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-09-17T05:32:21.073 INFO:teuthology.orchestra.run.smithi176.stdout:Transaction Summary 2024-09-17T05:32:21.073 INFO:teuthology.orchestra.run.smithi176.stdout:================================================================================ 2024-09-17T05:32:21.073 INFO:teuthology.orchestra.run.smithi176.stdout:Install 4 Packages 2024-09-17T05:32:21.073 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-09-17T05:32:21.074 INFO:teuthology.orchestra.run.smithi176.stdout:Total download size: 79 M 2024-09-17T05:32:21.074 INFO:teuthology.orchestra.run.smithi176.stdout:Installed size: 126 M 2024-09-17T05:32:21.074 INFO:teuthology.orchestra.run.smithi176.stdout:Downloading Packages: 2024-09-17T05:32:21.368 INFO:teuthology.orchestra.run.smithi150.stdout:(1/4): kernel-5.14.0-508.el9.x86_64.rpm 126 kB/s | 36 kB 00:00 2024-09-17T05:32:21.463 INFO:teuthology.orchestra.run.smithi176.stdout:(1/4): kernel-5.14.0-508.el9.x86_64.rpm 321 kB/s | 36 kB 00:00 2024-09-17T05:32:22.180 INFO:teuthology.orchestra.run.smithi176.stdout:(2/4): kernel-core-5.14.0-508.el9.x86_64.rpm 19 MB/s | 16 MB 00:00 2024-09-17T05:32:22.869 INFO:teuthology.orchestra.run.smithi150.stdout:(2/4): kernel-core-5.14.0-508.el9.x86_64.rpm 8.8 MB/s | 16 MB 00:01 2024-09-17T05:32:23.705 INFO:teuthology.orchestra.run.smithi176.stdout:(3/4): kernel-modules-5.14.0-508.el9.x86_64.rpm 15 MB/s | 35 MB 00:02 2024-09-17T05:32:23.985 INFO:teuthology.orchestra.run.smithi150.stdout:(3/4): kernel-modules-core-5.14.0-508.el9.x86_6 11 MB/s | 29 MB 00:02 2024-09-17T05:32:24.172 INFO:teuthology.orchestra.run.smithi176.stdout:(4/4): kernel-modules-core-5.14.0-508.el9.x86_6 11 MB/s | 29 MB 00:02 2024-09-17T05:32:24.176 INFO:teuthology.orchestra.run.smithi176.stdout:-------------------------------------------------------------------------------- 2024-09-17T05:32:24.176 INFO:teuthology.orchestra.run.smithi176.stdout:Total 25 MB/s | 79 MB 00:03 2024-09-17T05:32:24.861 INFO:teuthology.orchestra.run.smithi176.stdout:Running transaction check 2024-09-17T05:32:25.200 INFO:teuthology.orchestra.run.smithi176.stdout:Transaction check succeeded. 2024-09-17T05:32:25.200 INFO:teuthology.orchestra.run.smithi176.stdout:Running transaction test 2024-09-17T05:32:26.159 INFO:teuthology.orchestra.run.smithi176.stdout:Transaction test succeeded. 2024-09-17T05:32:26.159 INFO:teuthology.orchestra.run.smithi176.stdout:Running transaction 2024-09-17T05:32:28.551 INFO:teuthology.orchestra.run.smithi176.stdout: Preparing : 1/1 2024-09-17T05:32:29.248 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : kernel-modules-core-5.14.0-508.el9.x86_64 1/4 2024-09-17T05:32:29.347 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : kernel-core-5.14.0-508.el9.x86_64 2/4 2024-09-17T05:32:30.027 INFO:teuthology.orchestra.run.smithi150.stdout:(4/4): kernel-modules-5.14.0-508.el9.x86_64.rpm 3.9 MB/s | 35 MB 00:08 2024-09-17T05:32:30.027 INFO:teuthology.orchestra.run.smithi150.stdout:-------------------------------------------------------------------------------- 2024-09-17T05:32:30.027 INFO:teuthology.orchestra.run.smithi150.stdout:Total 8.7 MB/s | 79 MB 00:09 2024-09-17T05:32:30.711 INFO:teuthology.orchestra.run.smithi150.stdout:Running transaction check 2024-09-17T05:32:31.074 INFO:teuthology.orchestra.run.smithi150.stdout:Transaction check succeeded. 2024-09-17T05:32:31.074 INFO:teuthology.orchestra.run.smithi150.stdout:Running transaction test 2024-09-17T05:32:32.050 INFO:teuthology.orchestra.run.smithi150.stdout:Transaction test succeeded. 2024-09-17T05:32:32.050 INFO:teuthology.orchestra.run.smithi150.stdout:Running transaction 2024-09-17T05:32:32.121 INFO:teuthology.orchestra.run.smithi176.stdout: Running scriptlet: kernel-core-5.14.0-508.el9.x86_64 2/4 2024-09-17T05:32:32.258 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : kernel-modules-5.14.0-508.el9.x86_64 3/4 2024-09-17T05:32:34.487 INFO:teuthology.orchestra.run.smithi150.stdout: Preparing : 1/1 2024-09-17T05:32:35.163 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : kernel-modules-core-5.14.0-508.el9.x86_64 1/4 2024-09-17T05:32:35.236 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : kernel-core-5.14.0-508.el9.x86_64 2/4 2024-09-17T05:32:37.077 INFO:teuthology.orchestra.run.smithi176.stdout: Running scriptlet: kernel-modules-5.14.0-508.el9.x86_64 3/4 2024-09-17T05:32:37.116 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : kernel-5.14.0-508.el9.x86_64 4/4 2024-09-17T05:32:38.013 INFO:teuthology.orchestra.run.smithi150.stdout: Running scriptlet: kernel-core-5.14.0-508.el9.x86_64 2/4 2024-09-17T05:32:38.146 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : kernel-modules-5.14.0-508.el9.x86_64 3/4 2024-09-17T05:32:42.017 INFO:teuthology.orchestra.run.smithi176.stdout: Running scriptlet: kernel-modules-core-5.14.0-508.el9.x86_64 4/4 2024-09-17T05:32:42.982 INFO:teuthology.orchestra.run.smithi150.stdout: Running scriptlet: kernel-modules-5.14.0-508.el9.x86_64 3/4 2024-09-17T05:32:43.021 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : kernel-5.14.0-508.el9.x86_64 4/4 2024-09-17T05:32:47.864 INFO:teuthology.orchestra.run.smithi150.stdout: Running scriptlet: kernel-modules-core-5.14.0-508.el9.x86_64 4/4 2024-09-17T05:33:20.110 INFO:teuthology.orchestra.run.smithi176.stdout: Running scriptlet: kernel-core-5.14.0-508.el9.x86_64 4/4 2024-09-17T05:33:20.149 INFO:teuthology.orchestra.run.smithi176.stdout: Running scriptlet: kernel-modules-5.14.0-508.el9.x86_64 4/4 2024-09-17T05:33:20.528 INFO:teuthology.orchestra.run.smithi176.stdout: Running scriptlet: kernel-5.14.0-508.el9.x86_64 4/4 2024-09-17T05:33:20.528 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : kernel-5.14.0-508.el9.x86_64 1/4 2024-09-17T05:33:20.528 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : kernel-core-5.14.0-508.el9.x86_64 2/4 2024-09-17T05:33:20.528 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : kernel-modules-5.14.0-508.el9.x86_64 3/4 2024-09-17T05:33:21.389 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : kernel-modules-core-5.14.0-508.el9.x86_64 4/4 2024-09-17T05:33:21.389 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-09-17T05:33:21.389 INFO:teuthology.orchestra.run.smithi176.stdout:Installed: 2024-09-17T05:33:21.389 INFO:teuthology.orchestra.run.smithi176.stdout: kernel-5.14.0-508.el9.x86_64 2024-09-17T05:33:21.389 INFO:teuthology.orchestra.run.smithi176.stdout: kernel-core-5.14.0-508.el9.x86_64 2024-09-17T05:33:21.389 INFO:teuthology.orchestra.run.smithi176.stdout: kernel-modules-5.14.0-508.el9.x86_64 2024-09-17T05:33:21.389 INFO:teuthology.orchestra.run.smithi176.stdout: kernel-modules-core-5.14.0-508.el9.x86_64 2024-09-17T05:33:21.389 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-09-17T05:33:21.389 INFO:teuthology.orchestra.run.smithi176.stdout:Complete! 2024-09-17T05:33:21.746 DEBUG:teuthology.orchestra.run.smithi176:> rpm -q kernel | sort -rV | head -n 1 2024-09-17T05:33:21.835 INFO:teuthology.orchestra.run.smithi176.stdout:kernel-5.14.0-508.el9.x86_64 2024-09-17T05:33:21.835 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-508.el9.x86_64 2024-09-17T05:33:21.835 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-503.el9.x86_64 Expected: 5.14.0-508.el9.x86_64 2024-09-17T05:33:21.835 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-09-17T05:33:21.836 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-09-17T05:33:21.836 INFO:teuthology.task.kernel:Installing distro kernel on client.1... 2024-09-17T05:33:21.836 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi176.front.sepia.ceph.com, path=None, version=distro) 2024-09-17T05:33:21.836 DEBUG:teuthology.orchestra.run.smithi176:> rpm -q kernel | sort -rV | head -n 1 2024-09-17T05:33:21.895 INFO:teuthology.orchestra.run.smithi176.stdout:kernel-5.14.0-508.el9.x86_64 2024-09-17T05:33:21.895 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-508.el9.x86_64 2024-09-17T05:33:21.896 DEBUG:teuthology.orchestra.run.smithi176:> sudo rpm -qi grub2-tools 2024-09-17T05:33:21.927 INFO:teuthology.orchestra.run.smithi176.stdout:Name : grub2-tools 2024-09-17T05:33:21.927 INFO:teuthology.orchestra.run.smithi176.stdout:Epoch : 1 2024-09-17T05:33:21.927 INFO:teuthology.orchestra.run.smithi176.stdout:Version : 2.06 2024-09-17T05:33:21.928 INFO:teuthology.orchestra.run.smithi176.stdout:Release : 82.el9 2024-09-17T05:33:21.928 INFO:teuthology.orchestra.run.smithi176.stdout:Architecture: x86_64 2024-09-17T05:33:21.928 INFO:teuthology.orchestra.run.smithi176.stdout:Install Date: Wed 28 Aug 2024 09:06:27 PM UTC 2024-09-17T05:33:21.928 INFO:teuthology.orchestra.run.smithi176.stdout:Group : Unspecified 2024-09-17T05:33:21.928 INFO:teuthology.orchestra.run.smithi176.stdout:Size : 8274670 2024-09-17T05:33:21.928 INFO:teuthology.orchestra.run.smithi176.stdout:License : GPLv3+ 2024-09-17T05:33:21.928 INFO:teuthology.orchestra.run.smithi176.stdout:Signature : RSA/SHA256, Mon 01 Jul 2024 07:46:42 AM UTC, Key ID 05b555b38483c65d 2024-09-17T05:33:21.928 INFO:teuthology.orchestra.run.smithi176.stdout:Source RPM : grub2-2.06-82.el9.src.rpm 2024-09-17T05:33:21.928 INFO:teuthology.orchestra.run.smithi176.stdout:Build Date : Fri 28 Jun 2024 09:24:44 AM UTC 2024-09-17T05:33:21.928 INFO:teuthology.orchestra.run.smithi176.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-09-17T05:33:21.928 INFO:teuthology.orchestra.run.smithi176.stdout:Packager : builder@centos.org 2024-09-17T05:33:21.928 INFO:teuthology.orchestra.run.smithi176.stdout:Vendor : CentOS 2024-09-17T05:33:21.928 INFO:teuthology.orchestra.run.smithi176.stdout:URL : http://www.gnu.org/software/grub/ 2024-09-17T05:33:21.929 INFO:teuthology.orchestra.run.smithi176.stdout:Summary : Support tools for GRUB. 2024-09-17T05:33:21.929 INFO:teuthology.orchestra.run.smithi176.stdout:Description : 2024-09-17T05:33:21.929 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-09-17T05:33:21.929 INFO:teuthology.orchestra.run.smithi176.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-09-17T05:33:21.929 INFO:teuthology.orchestra.run.smithi176.stdout:customizable bootloader with modular architecture. It supports a rich 2024-09-17T05:33:21.929 INFO:teuthology.orchestra.run.smithi176.stdout:variety of kernel formats, file systems, computer architectures and 2024-09-17T05:33:21.929 INFO:teuthology.orchestra.run.smithi176.stdout:hardware devices. 2024-09-17T05:33:21.929 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-09-17T05:33:21.929 INFO:teuthology.orchestra.run.smithi176.stdout:This subpackage provides tools for support of all platforms. 2024-09-17T05:33:21.930 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-09-17T05:33:21.930 INFO:teuthology.task.kernel:Updating grub on smithi176 to boot 5.14.0-508.el9.x86_64 2024-09-17T05:33:21.930 DEBUG:teuthology.orchestra.run.smithi176:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-09-17T05:33:22.572 INFO:teuthology.orchestra.run.smithi176.stderr:Generating grub configuration file ... 2024-09-17T05:33:23.946 INFO:teuthology.orchestra.run.smithi176.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-09-17T05:33:23.988 INFO:teuthology.orchestra.run.smithi176.stderr:done 2024-09-17T05:33:23.991 DEBUG:teuthology.orchestra.run.smithi176:> mktemp 2024-09-17T05:33:24.006 INFO:teuthology.orchestra.run.smithi176.stdout:/tmp/tmp.CJFmlbIeNc 2024-09-17T05:33:24.006 DEBUG:teuthology.orchestra.run.smithi176:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.CJFmlbIeNc 2024-09-17T05:33:24.080 DEBUG:teuthology.orchestra.run.smithi176:> sudo chmod 0666 /tmp/tmp.CJFmlbIeNc 2024-09-17T05:33:24.221 DEBUG:teuthology.orchestra.remote:smithi176:/tmp/tmp.CJFmlbIeNc is 6KB 2024-09-17T05:33:24.269 DEBUG:teuthology.orchestra.run.smithi176:> rm -fr /tmp/tmp.CJFmlbIeNc 2024-09-17T05:33:24.284 DEBUG:teuthology.orchestra.run.smithi176:> sudo /bin/ls /boot/loader/entries || true 2024-09-17T05:33:24.346 INFO:teuthology.orchestra.run.smithi176.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-0-rescue.conf 2024-09-17T05:33:24.346 INFO:teuthology.orchestra.run.smithi176.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-239.el9.x86_64.conf 2024-09-17T05:33:24.346 INFO:teuthology.orchestra.run.smithi176.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-503.el9.x86_64.conf 2024-09-17T05:33:24.346 INFO:teuthology.orchestra.run.smithi176.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-508.el9.x86_64.conf 2024-09-17T05:33:24.348 DEBUG:teuthology.orchestra.run.smithi176:> sudo grub2-set-default fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-508.el9.x86_64 2024-09-17T05:33:24.499 DEBUG:teuthology.orchestra.run.smithi176:> sudo shutdown -r now 2024-09-17T05:33:26.359 INFO:teuthology.orchestra.run.smithi150.stdout: Running scriptlet: kernel-core-5.14.0-508.el9.x86_64 4/4 2024-09-17T05:33:26.399 INFO:teuthology.orchestra.run.smithi150.stdout: Running scriptlet: kernel-modules-5.14.0-508.el9.x86_64 4/4 2024-09-17T05:33:26.704 INFO:teuthology.orchestra.run.smithi150.stdout: Running scriptlet: kernel-5.14.0-508.el9.x86_64 4/4 2024-09-17T05:33:26.704 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : kernel-5.14.0-508.el9.x86_64 1/4 2024-09-17T05:33:26.704 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : kernel-core-5.14.0-508.el9.x86_64 2/4 2024-09-17T05:33:26.704 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : kernel-modules-5.14.0-508.el9.x86_64 3/4 2024-09-17T05:33:27.624 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : kernel-modules-core-5.14.0-508.el9.x86_64 4/4 2024-09-17T05:33:27.624 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-09-17T05:33:27.624 INFO:teuthology.orchestra.run.smithi150.stdout:Installed: 2024-09-17T05:33:27.624 INFO:teuthology.orchestra.run.smithi150.stdout: kernel-5.14.0-508.el9.x86_64 2024-09-17T05:33:27.624 INFO:teuthology.orchestra.run.smithi150.stdout: kernel-core-5.14.0-508.el9.x86_64 2024-09-17T05:33:27.624 INFO:teuthology.orchestra.run.smithi150.stdout: kernel-modules-5.14.0-508.el9.x86_64 2024-09-17T05:33:27.624 INFO:teuthology.orchestra.run.smithi150.stdout: kernel-modules-core-5.14.0-508.el9.x86_64 2024-09-17T05:33:27.624 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-09-17T05:33:27.624 INFO:teuthology.orchestra.run.smithi150.stdout:Complete! 2024-09-17T05:33:27.986 DEBUG:teuthology.orchestra.run.smithi150:> rpm -q kernel | sort -rV | head -n 1 2024-09-17T05:33:28.074 INFO:teuthology.orchestra.run.smithi150.stdout:kernel-5.14.0-508.el9.x86_64 2024-09-17T05:33:28.074 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-508.el9.x86_64 2024-09-17T05:33:28.074 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-503.el9.x86_64 Expected: 5.14.0-508.el9.x86_64 2024-09-17T05:33:28.074 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-09-17T05:33:28.074 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-09-17T05:33:28.075 INFO:teuthology.task.kernel:Installing distro kernel on client.0... 2024-09-17T05:33:28.075 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi150.front.sepia.ceph.com, path=None, version=distro) 2024-09-17T05:33:28.075 DEBUG:teuthology.orchestra.run.smithi150:> rpm -q kernel | sort -rV | head -n 1 2024-09-17T05:33:28.134 INFO:teuthology.orchestra.run.smithi150.stdout:kernel-5.14.0-508.el9.x86_64 2024-09-17T05:33:28.134 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-508.el9.x86_64 2024-09-17T05:33:28.134 DEBUG:teuthology.orchestra.run.smithi150:> sudo rpm -qi grub2-tools 2024-09-17T05:33:28.166 INFO:teuthology.orchestra.run.smithi150.stdout:Name : grub2-tools 2024-09-17T05:33:28.166 INFO:teuthology.orchestra.run.smithi150.stdout:Epoch : 1 2024-09-17T05:33:28.166 INFO:teuthology.orchestra.run.smithi150.stdout:Version : 2.06 2024-09-17T05:33:28.166 INFO:teuthology.orchestra.run.smithi150.stdout:Release : 82.el9 2024-09-17T05:33:28.166 INFO:teuthology.orchestra.run.smithi150.stdout:Architecture: x86_64 2024-09-17T05:33:28.166 INFO:teuthology.orchestra.run.smithi150.stdout:Install Date: Wed 28 Aug 2024 09:06:27 PM UTC 2024-09-17T05:33:28.166 INFO:teuthology.orchestra.run.smithi150.stdout:Group : Unspecified 2024-09-17T05:33:28.167 INFO:teuthology.orchestra.run.smithi150.stdout:Size : 8274670 2024-09-17T05:33:28.167 INFO:teuthology.orchestra.run.smithi150.stdout:License : GPLv3+ 2024-09-17T05:33:28.167 INFO:teuthology.orchestra.run.smithi150.stdout:Signature : RSA/SHA256, Mon 01 Jul 2024 07:46:42 AM UTC, Key ID 05b555b38483c65d 2024-09-17T05:33:28.167 INFO:teuthology.orchestra.run.smithi150.stdout:Source RPM : grub2-2.06-82.el9.src.rpm 2024-09-17T05:33:28.167 INFO:teuthology.orchestra.run.smithi150.stdout:Build Date : Fri 28 Jun 2024 09:24:44 AM UTC 2024-09-17T05:33:28.167 INFO:teuthology.orchestra.run.smithi150.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-09-17T05:33:28.167 INFO:teuthology.orchestra.run.smithi150.stdout:Packager : builder@centos.org 2024-09-17T05:33:28.167 INFO:teuthology.orchestra.run.smithi150.stdout:Vendor : CentOS 2024-09-17T05:33:28.167 INFO:teuthology.orchestra.run.smithi150.stdout:URL : http://www.gnu.org/software/grub/ 2024-09-17T05:33:28.167 INFO:teuthology.orchestra.run.smithi150.stdout:Summary : Support tools for GRUB. 2024-09-17T05:33:28.167 INFO:teuthology.orchestra.run.smithi150.stdout:Description : 2024-09-17T05:33:28.167 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-09-17T05:33:28.167 INFO:teuthology.orchestra.run.smithi150.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-09-17T05:33:28.168 INFO:teuthology.orchestra.run.smithi150.stdout:customizable bootloader with modular architecture. It supports a rich 2024-09-17T05:33:28.168 INFO:teuthology.orchestra.run.smithi150.stdout:variety of kernel formats, file systems, computer architectures and 2024-09-17T05:33:28.168 INFO:teuthology.orchestra.run.smithi150.stdout:hardware devices. 2024-09-17T05:33:28.168 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-09-17T05:33:28.168 INFO:teuthology.orchestra.run.smithi150.stdout:This subpackage provides tools for support of all platforms. 2024-09-17T05:33:28.169 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-09-17T05:33:28.169 INFO:teuthology.task.kernel:Updating grub on smithi150 to boot 5.14.0-508.el9.x86_64 2024-09-17T05:33:28.169 DEBUG:teuthology.orchestra.run.smithi150:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-09-17T05:33:28.889 INFO:teuthology.orchestra.run.smithi150.stderr:Generating grub configuration file ... 2024-09-17T05:33:30.238 INFO:teuthology.orchestra.run.smithi150.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-09-17T05:33:30.271 INFO:teuthology.orchestra.run.smithi150.stderr:done 2024-09-17T05:33:30.274 DEBUG:teuthology.orchestra.run.smithi150:> mktemp 2024-09-17T05:33:30.289 INFO:teuthology.orchestra.run.smithi150.stdout:/tmp/tmp.473Bd233wF 2024-09-17T05:33:30.290 DEBUG:teuthology.orchestra.run.smithi150:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.473Bd233wF 2024-09-17T05:33:30.356 DEBUG:teuthology.orchestra.run.smithi150:> sudo chmod 0666 /tmp/tmp.473Bd233wF 2024-09-17T05:33:30.492 DEBUG:teuthology.orchestra.remote:smithi150:/tmp/tmp.473Bd233wF is 6KB 2024-09-17T05:33:30.512 DEBUG:teuthology.orchestra.run.smithi150:> rm -fr /tmp/tmp.473Bd233wF 2024-09-17T05:33:30.527 DEBUG:teuthology.orchestra.run.smithi150:> sudo /bin/ls /boot/loader/entries || true 2024-09-17T05:33:30.591 INFO:teuthology.orchestra.run.smithi150.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-0-rescue.conf 2024-09-17T05:33:30.591 INFO:teuthology.orchestra.run.smithi150.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-239.el9.x86_64.conf 2024-09-17T05:33:30.591 INFO:teuthology.orchestra.run.smithi150.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-503.el9.x86_64.conf 2024-09-17T05:33:30.592 INFO:teuthology.orchestra.run.smithi150.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-508.el9.x86_64.conf 2024-09-17T05:33:30.593 DEBUG:teuthology.orchestra.run.smithi150:> sudo grub2-set-default fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-508.el9.x86_64 2024-09-17T05:33:30.742 DEBUG:teuthology.orchestra.run.smithi150:> sudo shutdown -r now 2024-09-17T05:33:54.521 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2024-09-17T05:33:54.522 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi176.front.sepia.ceph.com' 2024-09-17T05:33:54.523 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi176.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-17T05:34:00.749 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2024-09-17T05:34:00.749 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi150.front.sepia.ceph.com' 2024-09-17T05:34:00.750 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi150.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-17T05:34:29.181 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.176 2024-09-17T05:34:35.325 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.150 2024-09-17T05:34:38.182 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi176.front.sepia.ceph.com' 2024-09-17T05:34:38.183 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi176.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-17T05:34:44.331 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi150.front.sepia.ceph.com' 2024-09-17T05:34:44.332 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi150.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-17T05:34:56.573 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.176 2024-09-17T05:35:02.717 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.150 2024-09-17T05:35:08.580 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi176.front.sepia.ceph.com' 2024-09-17T05:35:08.581 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi176.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-17T05:35:08.928 DEBUG:teuthology.orchestra.run.smithi176:> true 2024-09-17T05:35:09.279 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi176.front.sepia.ceph.com' 2024-09-17T05:35:09.279 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "5.14.0-508.el9.x86_64"... 2024-09-17T05:35:09.279 DEBUG:teuthology.orchestra.run.smithi176:> uname -r 2024-09-17T05:35:09.294 INFO:teuthology.orchestra.run.smithi176.stdout:5.14.0-508.el9.x86_64 2024-09-17T05:35:09.294 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-508.el9.x86_64 vs 5.14.0-508.el9.x86_64 2024-09-17T05:35:09.294 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-17T05:35:09.294 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-09-17T05:35:10.296 DEBUG:teuthology.parallel:result is None 2024-09-17T05:35:14.718 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi150.front.sepia.ceph.com' 2024-09-17T05:35:14.718 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi150.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-17T05:35:15.300 DEBUG:teuthology.orchestra.run.smithi150:> true 2024-09-17T05:35:15.720 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi150.front.sepia.ceph.com' 2024-09-17T05:35:15.720 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "5.14.0-508.el9.x86_64"... 2024-09-17T05:35:15.720 DEBUG:teuthology.orchestra.run.smithi150:> uname -r 2024-09-17T05:35:15.777 INFO:teuthology.orchestra.run.smithi150.stdout:5.14.0-508.el9.x86_64 2024-09-17T05:35:15.777 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-508.el9.x86_64 vs 5.14.0-508.el9.x86_64 2024-09-17T05:35:15.777 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-17T05:35:15.777 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-09-17T05:35:16.779 DEBUG:teuthology.parallel:result is None 2024-09-17T05:35:16.779 INFO:teuthology.run_tasks:Running task internal.base... 2024-09-17T05:35:16.789 INFO:teuthology.task.internal:Creating test directory... 2024-09-17T05:35:16.789 DEBUG:teuthology.orchestra.run.smithi150:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-17T05:35:16.792 DEBUG:teuthology.orchestra.run.smithi176:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-17T05:35:16.813 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-09-17T05:35:16.821 INFO:teuthology.run_tasks:Running task internal.archive... 2024-09-17T05:35:16.829 INFO:teuthology.task.internal:Creating archive directory... 2024-09-17T05:35:16.830 DEBUG:teuthology.orchestra.run.smithi150:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-17T05:35:16.850 DEBUG:teuthology.orchestra.run.smithi176:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-17T05:35:16.941 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-09-17T05:35:16.948 INFO:teuthology.task.internal:Enabling coredump saving... 2024-09-17T05:35:16.948 DEBUG:teuthology.orchestra.run.smithi150:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-17T05:35:16.950 DEBUG:teuthology.orchestra.run.smithi176:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-17T05:35:17.034 INFO:teuthology.orchestra.run.smithi150.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-17T05:35:17.040 INFO:teuthology.orchestra.run.smithi176.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-17T05:35:17.074 INFO:teuthology.orchestra.run.smithi150.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-17T05:35:17.079 INFO:teuthology.orchestra.run.smithi176.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-17T05:35:17.081 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-09-17T05:35:17.088 INFO:teuthology.task.internal:Configuring sudo... 2024-09-17T05:35:17.088 DEBUG:teuthology.orchestra.run.smithi150:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-17T05:35:17.090 DEBUG:teuthology.orchestra.run.smithi176:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-17T05:35:17.120 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-09-17T05:35:17.129 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-09-17T05:35:17.129 DEBUG:teuthology.orchestra.run.smithi150:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-17T05:35:17.156 DEBUG:teuthology.orchestra.run.smithi176:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-17T05:35:17.177 DEBUG:teuthology.orchestra.run.smithi150:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-17T05:35:17.257 DEBUG:teuthology.orchestra.run.smithi150:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-17T05:35:17.300 DEBUG:teuthology.orchestra.run.smithi150:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-17T05:35:17.382 DEBUG:teuthology.orchestra.run.smithi150:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-17T05:35:17.423 DEBUG:teuthology.orchestra.run.smithi150:> set -ex 2024-09-17T05:35:17.423 DEBUG:teuthology.orchestra.run.smithi150:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-17T05:35:17.543 DEBUG:teuthology.orchestra.run.smithi176:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-17T05:35:17.584 DEBUG:teuthology.orchestra.run.smithi176:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-17T05:35:17.642 DEBUG:teuthology.orchestra.run.smithi176:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-17T05:35:17.726 DEBUG:teuthology.orchestra.run.smithi176:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-17T05:35:17.770 DEBUG:teuthology.orchestra.run.smithi176:> set -ex 2024-09-17T05:35:17.770 DEBUG:teuthology.orchestra.run.smithi176:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-17T05:35:17.837 DEBUG:teuthology.orchestra.run.smithi150:> sudo service rsyslog restart 2024-09-17T05:35:17.839 DEBUG:teuthology.orchestra.run.smithi176:> sudo service rsyslog restart 2024-09-17T05:35:17.900 INFO:teuthology.orchestra.run.smithi150.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-17T05:35:17.928 INFO:teuthology.orchestra.run.smithi176.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-17T05:35:18.350 INFO:teuthology.run_tasks:Running task internal.timer... 2024-09-17T05:35:18.358 INFO:teuthology.task.internal:Starting timer... 2024-09-17T05:35:18.358 INFO:teuthology.run_tasks:Running task pcp... 2024-09-17T05:35:18.369 INFO:teuthology.run_tasks:Running task selinux... 2024-09-17T05:35:18.380 DEBUG:teuthology.orchestra.run.smithi150:> sudo service auditd rotate 2024-09-17T05:35:18.429 INFO:teuthology.orchestra.run.smithi150.stdout:Rotating logs: 2024-09-17T05:35:18.431 DEBUG:teuthology.orchestra.run.smithi176:> sudo service auditd rotate 2024-09-17T05:35:18.492 INFO:teuthology.orchestra.run.smithi176.stdout:Rotating logs: 2024-09-17T05:35:18.494 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-09-17T05:35:18.494 DEBUG:teuthology.orchestra.run.smithi150:> /usr/sbin/getenforce 2024-09-17T05:35:18.526 INFO:teuthology.orchestra.run.smithi150.stdout:Permissive 2024-09-17T05:35:18.526 DEBUG:teuthology.orchestra.run.smithi176:> /usr/sbin/getenforce 2024-09-17T05:35:18.547 INFO:teuthology.orchestra.run.smithi176.stdout:Permissive 2024-09-17T05:35:18.547 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi150.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi176.front.sepia.ceph.com': 'permissive'} 2024-09-17T05:35:18.547 DEBUG:teuthology.orchestra.run.smithi150:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 2024-09-17T05:35:18.594 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-17T05:35:18.595 DEBUG:teuthology.orchestra.run.smithi176:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 2024-09-17T05:35:18.622 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-17T05:35:18.623 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-09-17T05:35:18.623 DEBUG:teuthology.orchestra.run.smithi150:> sudo /usr/sbin/setenforce permissive 2024-09-17T05:35:18.690 DEBUG:teuthology.orchestra.run.smithi176:> sudo /usr/sbin/setenforce permissive 2024-09-17T05:35:18.719 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-09-17T05:35:18.729 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-09-17T05:35:18.741 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-09-17T05:35:18.742 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi150.front.sepia.ceph.com,smithi176.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-09-17T05:39:03.633 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi150.front.sepia.ceph.com'), Remote(name='ubuntu@smithi176.front.sepia.ceph.com')] 2024-09-17T05:39:03.634 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi150.front.sepia.ceph.com' 2024-09-17T05:39:03.636 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi150.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-17T05:39:03.715 DEBUG:teuthology.orchestra.run.smithi150:> true 2024-09-17T05:39:03.792 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi150.front.sepia.ceph.com' 2024-09-17T05:39:03.792 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi176.front.sepia.ceph.com' 2024-09-17T05:39:03.793 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi176.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-17T05:39:03.871 DEBUG:teuthology.orchestra.run.smithi176:> true 2024-09-17T05:39:03.953 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi176.front.sepia.ceph.com' 2024-09-17T05:39:03.953 INFO:teuthology.run_tasks:Running task clock... 2024-09-17T05:39:03.966 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-09-17T05:39:03.966 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-17T05:39:03.967 DEBUG:teuthology.orchestra.run.smithi150:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-17T05:39:03.969 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-17T05:39:03.969 DEBUG:teuthology.orchestra.run.smithi176:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-17T05:39:03.995 INFO:teuthology.orchestra.run.smithi150.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-17T05:39:04.010 INFO:teuthology.orchestra.run.smithi150.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-17T05:39:04.024 INFO:teuthology.orchestra.run.smithi176.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-17T05:39:04.033 INFO:teuthology.orchestra.run.smithi150.stderr:sudo: ntpd: command not found 2024-09-17T05:39:04.039 INFO:teuthology.orchestra.run.smithi176.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-17T05:39:04.045 INFO:teuthology.orchestra.run.smithi150.stdout:506 Cannot talk to daemon 2024-09-17T05:39:04.059 INFO:teuthology.orchestra.run.smithi150.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-17T05:39:04.063 INFO:teuthology.orchestra.run.smithi176.stderr:sudo: ntpd: command not found 2024-09-17T05:39:04.074 INFO:teuthology.orchestra.run.smithi150.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-17T05:39:04.074 INFO:teuthology.orchestra.run.smithi176.stdout:506 Cannot talk to daemon 2024-09-17T05:39:04.088 INFO:teuthology.orchestra.run.smithi176.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-17T05:39:04.102 INFO:teuthology.orchestra.run.smithi176.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-17T05:39:04.129 INFO:teuthology.orchestra.run.smithi150.stderr:bash: line 1: ntpq: command not found 2024-09-17T05:39:04.132 INFO:teuthology.orchestra.run.smithi150.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-17T05:39:04.132 INFO:teuthology.orchestra.run.smithi150.stdout:=============================================================================== 2024-09-17T05:39:04.132 INFO:teuthology.orchestra.run.smithi150.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-17T05:39:04.133 INFO:teuthology.orchestra.run.smithi150.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-17T05:39:04.133 INFO:teuthology.orchestra.run.smithi150.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-17T05:39:04.133 INFO:teuthology.orchestra.run.smithi150.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-17T05:39:04.156 INFO:teuthology.orchestra.run.smithi176.stderr:bash: line 1: ntpq: command not found 2024-09-17T05:39:04.160 INFO:teuthology.orchestra.run.smithi176.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-17T05:39:04.160 INFO:teuthology.orchestra.run.smithi176.stdout:=============================================================================== 2024-09-17T05:39:04.160 INFO:teuthology.orchestra.run.smithi176.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-17T05:39:04.160 INFO:teuthology.orchestra.run.smithi176.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-17T05:39:04.160 INFO:teuthology.orchestra.run.smithi176.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-17T05:39:04.160 INFO:teuthology.orchestra.run.smithi176.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-17T05:39:04.161 INFO:teuthology.run_tasks:Running task install... 2024-09-17T05:39:04.169 DEBUG:teuthology.task.install:project ceph 2024-09-17T05:39:04.170 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': 'ce1b342bf8c6349a8c90cd607f83bff2443f21cf'}} 2024-09-17T05:39:04.170 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': 'ce1b342bf8c6349a8c90cd607f83bff2443f21cf'} 2024-09-17T05:39:04.170 INFO:teuthology.task.install:Using flavor: default 2024-09-17T05:39:04.176 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-09-17T05:39:04.176 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']} 2024-09-17T05:39:04.176 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'ce1b342bf8c6349a8c90cd607f83bff2443f21cf', 'tag': None, 'wait_for_package': False} 2024-09-17T05:39:04.177 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=ce1b342bf8c6349a8c90cd607f83bff2443f21cf 2024-09-17T05:39:04.179 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'ce1b342bf8c6349a8c90cd607f83bff2443f21cf', 'tag': None, 'wait_for_package': False} 2024-09-17T05:39:04.179 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=ce1b342bf8c6349a8c90cd607f83bff2443f21cf 2024-09-17T05:39:04.327 INFO:teuthology.task.install.rpm:Pulling from https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240916.200549-debug/ce1b342bf8c6349a8c90cd607f83bff2443f21cf/centos/9/flavors/default/ 2024-09-17T05:39:04.328 INFO:teuthology.task.install.rpm:Package version is 19.3.0-4989.gce1b342b 2024-09-17T05:39:04.334 INFO:teuthology.task.install.rpm:Pulling from https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240916.200549-debug/ce1b342bf8c6349a8c90cd607f83bff2443f21cf/centos/9/flavors/default/ 2024-09-17T05:39:04.334 INFO:teuthology.task.install.rpm:Package version is 19.3.0-4989.gce1b342b 2024-09-17T05:39:04.445 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240916.200549-debug/ce1b342bf8c6349a8c90cd607f83bff2443f21cf/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240916.200549-debug/ce1b342bf8c6349a8c90cd607f83bff2443f21cf/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240916.200549-debug/ce1b342bf8c6349a8c90cd607f83bff2443f21cf/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-17T05:39:04.446 DEBUG:teuthology.orchestra.run.smithi150:> set -ex 2024-09-17T05:39:04.446 DEBUG:teuthology.orchestra.run.smithi150:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-17T05:39:04.457 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240916.200549-debug/ce1b342bf8c6349a8c90cd607f83bff2443f21cf/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240916.200549-debug/ce1b342bf8c6349a8c90cd607f83bff2443f21cf/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240916.200549-debug/ce1b342bf8c6349a8c90cd607f83bff2443f21cf/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-17T05:39:04.457 DEBUG:teuthology.orchestra.run.smithi176:> set -ex 2024-09-17T05:39:04.457 DEBUG:teuthology.orchestra.run.smithi176:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-17T05:39:04.472 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-09-17T05:39:04.472 DEBUG:teuthology.orchestra.run.smithi150:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/ce1b342bf8c6349a8c90cd607f83bff2443f21cf/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-17T05:39:04.484 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-09-17T05:39:04.484 DEBUG:teuthology.orchestra.run.smithi176:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/ce1b342bf8c6349a8c90cd607f83bff2443f21cf/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-17T05:39:04.538 DEBUG:teuthology.orchestra.run.smithi150:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-17T05:39:04.550 DEBUG:teuthology.orchestra.run.smithi176:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-17T05:39:04.614 DEBUG:teuthology.orchestra.run.smithi150:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-17T05:39:04.625 DEBUG:teuthology.orchestra.run.smithi176:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-17T05:39:04.678 INFO:teuthology.orchestra.run.smithi150.stdout:check_obsoletes = 1 2024-09-17T05:39:04.680 DEBUG:teuthology.orchestra.run.smithi150:> sudo yum clean all 2024-09-17T05:39:04.689 INFO:teuthology.orchestra.run.smithi176.stdout:check_obsoletes = 1 2024-09-17T05:39:04.690 DEBUG:teuthology.orchestra.run.smithi176:> sudo yum clean all 2024-09-17T05:39:04.906 INFO:teuthology.orchestra.run.smithi150.stdout:45 files removed 2024-09-17T05:39:04.922 INFO:teuthology.orchestra.run.smithi176.stdout:45 files removed 2024-09-17T05:39:04.933 DEBUG:teuthology.orchestra.run.smithi150:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-09-17T05:39:04.950 DEBUG:teuthology.orchestra.run.smithi176:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-09-17T05:39:05.481 INFO:teuthology.orchestra.run.smithi150.stdout:ceph packages for x86_64 320 kB/s | 84 kB 00:00 2024-09-17T05:39:05.508 INFO:teuthology.orchestra.run.smithi176.stdout:ceph packages for x86_64 310 kB/s | 84 kB 00:00 2024-09-17T05:39:05.782 INFO:teuthology.orchestra.run.smithi150.stdout:ceph noarch packages 94 kB/s | 24 kB 00:00 2024-09-17T05:39:05.858 INFO:teuthology.orchestra.run.smithi176.stdout:ceph noarch packages 78 kB/s | 24 kB 00:00 2024-09-17T05:39:06.049 INFO:teuthology.orchestra.run.smithi150.stdout:ceph source packages 8.4 kB/s | 1.9 kB 00:00 2024-09-17T05:39:06.134 INFO:teuthology.orchestra.run.smithi176.stdout:ceph source packages 8.1 kB/s | 1.9 kB 00:00 2024-09-17T05:39:08.058 INFO:teuthology.orchestra.run.smithi150.stdout:CentOS Stream 9 - BaseOS 4.2 MB/s | 8.3 MB 00:01 2024-09-17T05:39:09.736 INFO:teuthology.orchestra.run.smithi150.stdout:CentOS Stream 9 - AppStream 34 MB/s | 20 MB 00:00 2024-09-17T05:39:10.967 INFO:teuthology.orchestra.run.smithi176.stdout:CentOS Stream 9 - BaseOS 1.7 MB/s | 8.3 MB 00:04 2024-09-17T05:39:16.637 INFO:teuthology.orchestra.run.smithi150.stdout:CentOS Stream 9 - CRB 2.1 MB/s | 6.5 MB 00:03 2024-09-17T05:39:18.271 INFO:teuthology.orchestra.run.smithi150.stdout:CentOS Stream 9 - Extras packages 73 kB/s | 19 kB 00:00 2024-09-17T05:39:19.575 INFO:teuthology.orchestra.run.smithi150.stdout:Extra Packages for Enterprise Linux 19 MB/s | 23 MB 00:01 2024-09-17T05:39:22.033 INFO:teuthology.orchestra.run.smithi176.stdout:CentOS Stream 9 - AppStream 2.0 MB/s | 20 MB 00:09 2024-09-17T05:39:25.015 INFO:teuthology.orchestra.run.smithi150.stdout:lab-extras 33 kB/s | 1.7 kB 00:00 2024-09-17T05:39:27.184 INFO:teuthology.orchestra.run.smithi150.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-17T05:39:27.185 INFO:teuthology.orchestra.run.smithi150.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-17T05:39:27.198 INFO:teuthology.orchestra.run.smithi150.stdout:Package NetworkManager-1:1.48.8-1.el9.x86_64 is already installed. 2024-09-17T05:39:27.199 INFO:teuthology.orchestra.run.smithi150.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-09-17T05:39:27.200 INFO:teuthology.orchestra.run.smithi150.stdout:Package util-linux-2.37.4-20.el9.x86_64 is already installed. 2024-09-17T05:39:27.201 INFO:teuthology.orchestra.run.smithi150.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-09-17T05:39:27.203 INFO:teuthology.orchestra.run.smithi150.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-09-17T05:39:27.206 INFO:teuthology.orchestra.run.smithi150.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-09-17T05:39:27.207 INFO:teuthology.orchestra.run.smithi150.stdout:Package xfsprogs-6.4.0-4.el9.x86_64 is already installed. 2024-09-17T05:39:27.270 INFO:teuthology.orchestra.run.smithi150.stdout:Dependencies resolved. 2024-09-17T05:39:27.296 INFO:teuthology.orchestra.run.smithi150.stdout:======================================================================================= 2024-09-17T05:39:27.296 INFO:teuthology.orchestra.run.smithi150.stdout: Package Arch Version Repository Size 2024-09-17T05:39:27.296 INFO:teuthology.orchestra.run.smithi150.stdout:======================================================================================= 2024-09-17T05:39:27.296 INFO:teuthology.orchestra.run.smithi150.stdout:Installing: 2024-09-17T05:39:27.296 INFO:teuthology.orchestra.run.smithi150.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-09-17T05:39:27.296 INFO:teuthology.orchestra.run.smithi150.stdout: ceph x86_64 2:19.3.0-4989.gce1b342b.el9 ceph 6.6 k 2024-09-17T05:39:27.296 INFO:teuthology.orchestra.run.smithi150.stdout: ceph-base x86_64 2:19.3.0-4989.gce1b342b.el9 ceph 5.5 M 2024-09-17T05:39:27.297 INFO:teuthology.orchestra.run.smithi150.stdout: ceph-fuse x86_64 2:19.3.0-4989.gce1b342b.el9 ceph 873 k 2024-09-17T05:39:27.297 INFO:teuthology.orchestra.run.smithi150.stdout: ceph-immutable-object-cache x86_64 2:19.3.0-4989.gce1b342b.el9 ceph 148 k 2024-09-17T05:39:27.297 INFO:teuthology.orchestra.run.smithi150.stdout: ceph-mgr x86_64 2:19.3.0-4989.gce1b342b.el9 ceph 1.5 M 2024-09-17T05:39:27.297 INFO:teuthology.orchestra.run.smithi150.stdout: ceph-mgr-cephadm noarch 2:19.3.0-4989.gce1b342b.el9 ceph-noarch 154 k 2024-09-17T05:39:27.297 INFO:teuthology.orchestra.run.smithi150.stdout: ceph-mgr-dashboard noarch 2:19.3.0-4989.gce1b342b.el9 ceph-noarch 14 M 2024-09-17T05:39:27.297 INFO:teuthology.orchestra.run.smithi150.stdout: ceph-mgr-diskprediction-local noarch 2:19.3.0-4989.gce1b342b.el9 ceph-noarch 7.4 M 2024-09-17T05:39:27.297 INFO:teuthology.orchestra.run.smithi150.stdout: ceph-mgr-rook noarch 2:19.3.0-4989.gce1b342b.el9 ceph-noarch 49 k 2024-09-17T05:39:27.297 INFO:teuthology.orchestra.run.smithi150.stdout: ceph-radosgw x86_64 2:19.3.0-4989.gce1b342b.el9 ceph 10 M 2024-09-17T05:39:27.297 INFO:teuthology.orchestra.run.smithi150.stdout: ceph-test x86_64 2:19.3.0-4989.gce1b342b.el9 ceph 40 M 2024-09-17T05:39:27.297 INFO:teuthology.orchestra.run.smithi150.stdout: ceph-volume noarch 2:19.3.0-4989.gce1b342b.el9 ceph-noarch 285 k 2024-09-17T05:39:27.297 INFO:teuthology.orchestra.run.smithi150.stdout: cephadm noarch 2:19.3.0-4989.gce1b342b.el9 ceph-noarch 784 k 2024-09-17T05:39:27.297 INFO:teuthology.orchestra.run.smithi150.stdout: cephfs-mirror x86_64 2:19.3.0-4989.gce1b342b.el9 ceph 225 k 2024-09-17T05:39:27.298 INFO:teuthology.orchestra.run.smithi150.stdout: cephfs-shell x86_64 2:19.3.0-4989.gce1b342b.el9 ceph 27 k 2024-09-17T05:39:27.298 INFO:teuthology.orchestra.run.smithi150.stdout: cephfs-top noarch 2:19.3.0-4989.gce1b342b.el9 ceph-noarch 18 k 2024-09-17T05:39:27.298 INFO:teuthology.orchestra.run.smithi150.stdout: elfutils-libelf-devel x86_64 0.191-4.el9 appstream 22 k 2024-09-17T05:39:27.298 INFO:teuthology.orchestra.run.smithi150.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-09-17T05:39:27.298 INFO:teuthology.orchestra.run.smithi150.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-09-17T05:39:27.298 INFO:teuthology.orchestra.run.smithi150.stdout: libcephfs-devel x86_64 2:19.3.0-4989.gce1b342b.el9 ceph 32 k 2024-09-17T05:39:27.298 INFO:teuthology.orchestra.run.smithi150.stdout: libcephfs2 x86_64 2:19.3.0-4989.gce1b342b.el9 ceph 766 k 2024-09-17T05:39:27.298 INFO:teuthology.orchestra.run.smithi150.stdout: librados-devel x86_64 2:19.3.0-4989.gce1b342b.el9 ceph 127 k 2024-09-17T05:39:27.298 INFO:teuthology.orchestra.run.smithi150.stdout: libtool x86_64 2.4.6-46.el9 appstream 581 k 2024-09-17T05:39:27.298 INFO:teuthology.orchestra.run.smithi150.stdout: libuuid-devel x86_64 2.37.4-20.el9 appstream 24 k 2024-09-17T05:39:27.298 INFO:teuthology.orchestra.run.smithi150.stdout: openssl-devel x86_64 1:3.2.2-6.el9 appstream 4.4 M 2024-09-17T05:39:27.299 INFO:teuthology.orchestra.run.smithi150.stdout: postgresql x86_64 13.16-1.el9 appstream 1.6 M 2024-09-17T05:39:27.299 INFO:teuthology.orchestra.run.smithi150.stdout: postgresql-contrib x86_64 13.16-1.el9 appstream 910 k 2024-09-17T05:39:27.299 INFO:teuthology.orchestra.run.smithi150.stdout: postgresql-server x86_64 13.16-1.el9 appstream 5.8 M 2024-09-17T05:39:27.299 INFO:teuthology.orchestra.run.smithi150.stdout: python3-cephfs x86_64 2:19.3.0-4989.gce1b342b.el9 ceph 162 k 2024-09-17T05:39:27.299 INFO:teuthology.orchestra.run.smithi150.stdout: python3-rados x86_64 2:19.3.0-4989.gce1b342b.el9 ceph 321 k 2024-09-17T05:39:27.299 INFO:teuthology.orchestra.run.smithi150.stdout: python3-rbd x86_64 2:19.3.0-4989.gce1b342b.el9 ceph 305 k 2024-09-17T05:39:27.299 INFO:teuthology.orchestra.run.smithi150.stdout: python3-rgw x86_64 2:19.3.0-4989.gce1b342b.el9 ceph 99 k 2024-09-17T05:39:27.299 INFO:teuthology.orchestra.run.smithi150.stdout: rbd-fuse x86_64 2:19.3.0-4989.gce1b342b.el9 ceph 86 k 2024-09-17T05:39:27.299 INFO:teuthology.orchestra.run.smithi150.stdout: rbd-mirror x86_64 2:19.3.0-4989.gce1b342b.el9 ceph 3.1 M 2024-09-17T05:39:27.299 INFO:teuthology.orchestra.run.smithi150.stdout: rbd-nbd x86_64 2:19.3.0-4989.gce1b342b.el9 ceph 170 k 2024-09-17T05:39:27.299 INFO:teuthology.orchestra.run.smithi150.stdout: xfsprogs-devel x86_64 6.4.0-4.el9 appstream 96 k 2024-09-17T05:39:27.300 INFO:teuthology.orchestra.run.smithi150.stdout:Upgrading: 2024-09-17T05:39:27.300 INFO:teuthology.orchestra.run.smithi150.stdout: NetworkManager x86_64 1:1.51.0-1.el9 baseos 2.3 M 2024-09-17T05:39:27.300 INFO:teuthology.orchestra.run.smithi150.stdout: NetworkManager-libnm x86_64 1:1.51.0-1.el9 baseos 1.8 M 2024-09-17T05:39:27.300 INFO:teuthology.orchestra.run.smithi150.stdout: NetworkManager-team x86_64 1:1.51.0-1.el9 baseos 41 k 2024-09-17T05:39:27.300 INFO:teuthology.orchestra.run.smithi150.stdout: NetworkManager-tui x86_64 1:1.51.0-1.el9 baseos 249 k 2024-09-17T05:39:27.300 INFO:teuthology.orchestra.run.smithi150.stdout: librados2 x86_64 2:19.3.0-4989.gce1b342b.el9 ceph 3.4 M 2024-09-17T05:39:27.300 INFO:teuthology.orchestra.run.smithi150.stdout: librbd1 x86_64 2:19.3.0-4989.gce1b342b.el9 ceph 3.2 M 2024-09-17T05:39:27.300 INFO:teuthology.orchestra.run.smithi150.stdout: openssl x86_64 1:3.2.2-6.el9 baseos 1.4 M 2024-09-17T05:39:27.300 INFO:teuthology.orchestra.run.smithi150.stdout: openssl-libs x86_64 1:3.2.2-6.el9 baseos 2.4 M 2024-09-17T05:39:27.300 INFO:teuthology.orchestra.run.smithi150.stdout:Installing dependencies: 2024-09-17T05:39:27.300 INFO:teuthology.orchestra.run.smithi150.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-09-17T05:39:27.300 INFO:teuthology.orchestra.run.smithi150.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-09-17T05:39:27.301 INFO:teuthology.orchestra.run.smithi150.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-09-17T05:39:27.301 INFO:teuthology.orchestra.run.smithi150.stdout: ceph-common x86_64 2:19.3.0-4989.gce1b342b.el9 ceph 20 M 2024-09-17T05:39:27.301 INFO:teuthology.orchestra.run.smithi150.stdout: ceph-grafana-dashboards noarch 2:19.3.0-4989.gce1b342b.el9 ceph-noarch 34 k 2024-09-17T05:39:27.301 INFO:teuthology.orchestra.run.smithi150.stdout: ceph-mds x86_64 2:19.3.0-4989.gce1b342b.el9 ceph 2.3 M 2024-09-17T05:39:27.301 INFO:teuthology.orchestra.run.smithi150.stdout: ceph-mgr-modules-core noarch 2:19.3.0-4989.gce1b342b.el9 ceph-noarch 291 k 2024-09-17T05:39:27.301 INFO:teuthology.orchestra.run.smithi150.stdout: ceph-mon x86_64 2:19.3.0-4989.gce1b342b.el9 ceph 5.0 M 2024-09-17T05:39:27.301 INFO:teuthology.orchestra.run.smithi150.stdout: ceph-osd x86_64 2:19.3.0-4989.gce1b342b.el9 ceph 18 M 2024-09-17T05:39:27.301 INFO:teuthology.orchestra.run.smithi150.stdout: ceph-prometheus-alerts noarch 2:19.3.0-4989.gce1b342b.el9 ceph-noarch 16 k 2024-09-17T05:39:27.301 INFO:teuthology.orchestra.run.smithi150.stdout: ceph-selinux x86_64 2:19.3.0-4989.gce1b342b.el9 ceph 25 k 2024-09-17T05:39:27.302 INFO:teuthology.orchestra.run.smithi150.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-17T05:39:27.302 INFO:teuthology.orchestra.run.smithi150.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-17T05:39:27.302 INFO:teuthology.orchestra.run.smithi150.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-17T05:39:27.302 INFO:teuthology.orchestra.run.smithi150.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-17T05:39:27.302 INFO:teuthology.orchestra.run.smithi150.stdout: gperftools-libs x86_64 2.9.1-3.el9 epel 308 k 2024-09-17T05:39:27.302 INFO:teuthology.orchestra.run.smithi150.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-09-17T05:39:27.302 INFO:teuthology.orchestra.run.smithi150.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-09-17T05:39:27.302 INFO:teuthology.orchestra.run.smithi150.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-09-17T05:39:27.302 INFO:teuthology.orchestra.run.smithi150.stdout: libcephsqlite x86_64 2:19.3.0-4989.gce1b342b.el9 ceph 159 k 2024-09-17T05:39:27.302 INFO:teuthology.orchestra.run.smithi150.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-17T05:39:27.302 INFO:teuthology.orchestra.run.smithi150.stdout: libnbd x86_64 1.20.2-2.el9 appstream 171 k 2024-09-17T05:39:27.302 INFO:teuthology.orchestra.run.smithi150.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-17T05:39:27.302 INFO:teuthology.orchestra.run.smithi150.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-17T05:39:27.303 INFO:teuthology.orchestra.run.smithi150.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-17T05:39:27.303 INFO:teuthology.orchestra.run.smithi150.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-17T05:39:27.303 INFO:teuthology.orchestra.run.smithi150.stdout: libradosstriper1 x86_64 2:19.3.0-4989.gce1b342b.el9 ceph 507 k 2024-09-17T05:39:27.303 INFO:teuthology.orchestra.run.smithi150.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-17T05:39:27.303 INFO:teuthology.orchestra.run.smithi150.stdout: librgw2 x86_64 2:19.3.0-4989.gce1b342b.el9 ceph 5.3 M 2024-09-17T05:39:27.303 INFO:teuthology.orchestra.run.smithi150.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-17T05:39:27.303 INFO:teuthology.orchestra.run.smithi150.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-09-17T05:39:27.303 INFO:teuthology.orchestra.run.smithi150.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-17T05:39:27.303 INFO:teuthology.orchestra.run.smithi150.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-09-17T05:39:27.303 INFO:teuthology.orchestra.run.smithi150.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-09-17T05:39:27.303 INFO:teuthology.orchestra.run.smithi150.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-09-17T05:39:27.304 INFO:teuthology.orchestra.run.smithi150.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-17T05:39:27.304 INFO:teuthology.orchestra.run.smithi150.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-17T05:39:27.304 INFO:teuthology.orchestra.run.smithi150.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-09-17T05:39:27.304 INFO:teuthology.orchestra.run.smithi150.stdout: postgresql-private-libs x86_64 13.16-1.el9 appstream 137 k 2024-09-17T05:39:27.304 INFO:teuthology.orchestra.run.smithi150.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-09-17T05:39:27.304 INFO:teuthology.orchestra.run.smithi150.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-09-17T05:39:27.304 INFO:teuthology.orchestra.run.smithi150.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-17T05:39:27.305 INFO:teuthology.orchestra.run.smithi150.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-09-17T05:39:27.305 INFO:teuthology.orchestra.run.smithi150.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-17T05:39:27.305 INFO:teuthology.orchestra.run.smithi150.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-17T05:39:27.305 INFO:teuthology.orchestra.run.smithi150.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-17T05:39:27.305 INFO:teuthology.orchestra.run.smithi150.stdout: python3-ceph-argparse x86_64 2:19.3.0-4989.gce1b342b.el9 ceph 45 k 2024-09-17T05:39:27.305 INFO:teuthology.orchestra.run.smithi150.stdout: python3-ceph-common x86_64 2:19.3.0-4989.gce1b342b.el9 ceph 143 k 2024-09-17T05:39:27.305 INFO:teuthology.orchestra.run.smithi150.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-17T05:39:27.305 INFO:teuthology.orchestra.run.smithi150.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-17T05:39:27.305 INFO:teuthology.orchestra.run.smithi150.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-17T05:39:27.305 INFO:teuthology.orchestra.run.smithi150.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-17T05:39:27.305 INFO:teuthology.orchestra.run.smithi150.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-09-17T05:39:27.305 INFO:teuthology.orchestra.run.smithi150.stdout: python3-colorama noarch 0.4.6-3.el9 appstream 61 k 2024-09-17T05:39:27.306 INFO:teuthology.orchestra.run.smithi150.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-17T05:39:27.306 INFO:teuthology.orchestra.run.smithi150.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-17T05:39:27.306 INFO:teuthology.orchestra.run.smithi150.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-17T05:39:27.306 INFO:teuthology.orchestra.run.smithi150.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-09-17T05:39:27.306 INFO:teuthology.orchestra.run.smithi150.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-09-17T05:39:27.306 INFO:teuthology.orchestra.run.smithi150.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-17T05:39:27.306 INFO:teuthology.orchestra.run.smithi150.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-17T05:39:27.306 INFO:teuthology.orchestra.run.smithi150.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-09-17T05:39:27.306 INFO:teuthology.orchestra.run.smithi150.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-17T05:39:27.306 INFO:teuthology.orchestra.run.smithi150.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-17T05:39:27.306 INFO:teuthology.orchestra.run.smithi150.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-17T05:39:27.306 INFO:teuthology.orchestra.run.smithi150.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-17T05:39:27.306 INFO:teuthology.orchestra.run.smithi150.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-17T05:39:27.307 INFO:teuthology.orchestra.run.smithi150.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-17T05:39:27.307 INFO:teuthology.orchestra.run.smithi150.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-17T05:39:27.307 INFO:teuthology.orchestra.run.smithi150.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-17T05:39:27.307 INFO:teuthology.orchestra.run.smithi150.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-17T05:39:27.307 INFO:teuthology.orchestra.run.smithi150.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-17T05:39:27.307 INFO:teuthology.orchestra.run.smithi150.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-17T05:39:27.307 INFO:teuthology.orchestra.run.smithi150.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-17T05:39:27.307 INFO:teuthology.orchestra.run.smithi150.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-17T05:39:27.307 INFO:teuthology.orchestra.run.smithi150.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-17T05:39:27.307 INFO:teuthology.orchestra.run.smithi150.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-09-17T05:39:27.307 INFO:teuthology.orchestra.run.smithi150.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-17T05:39:27.307 INFO:teuthology.orchestra.run.smithi150.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-17T05:39:27.308 INFO:teuthology.orchestra.run.smithi150.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-17T05:39:27.308 INFO:teuthology.orchestra.run.smithi150.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-17T05:39:27.308 INFO:teuthology.orchestra.run.smithi150.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-09-17T05:39:27.308 INFO:teuthology.orchestra.run.smithi150.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-17T05:39:27.308 INFO:teuthology.orchestra.run.smithi150.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-17T05:39:27.308 INFO:teuthology.orchestra.run.smithi150.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-17T05:39:27.308 INFO:teuthology.orchestra.run.smithi150.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-17T05:39:27.308 INFO:teuthology.orchestra.run.smithi150.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-09-17T05:39:27.308 INFO:teuthology.orchestra.run.smithi150.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-17T05:39:27.308 INFO:teuthology.orchestra.run.smithi150.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-17T05:39:27.308 INFO:teuthology.orchestra.run.smithi150.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-17T05:39:27.309 INFO:teuthology.orchestra.run.smithi150.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-17T05:39:27.309 INFO:teuthology.orchestra.run.smithi150.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-17T05:39:27.309 INFO:teuthology.orchestra.run.smithi150.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-17T05:39:27.309 INFO:teuthology.orchestra.run.smithi150.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-17T05:39:27.309 INFO:teuthology.orchestra.run.smithi150.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-17T05:39:27.309 INFO:teuthology.orchestra.run.smithi150.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-17T05:39:27.309 INFO:teuthology.orchestra.run.smithi150.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-17T05:39:27.309 INFO:teuthology.orchestra.run.smithi150.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-17T05:39:27.309 INFO:teuthology.orchestra.run.smithi150.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-09-17T05:39:27.309 INFO:teuthology.orchestra.run.smithi150.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-17T05:39:27.309 INFO:teuthology.orchestra.run.smithi150.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-17T05:39:27.309 INFO:teuthology.orchestra.run.smithi150.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-17T05:39:27.309 INFO:teuthology.orchestra.run.smithi150.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-17T05:39:27.310 INFO:teuthology.orchestra.run.smithi150.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-09-17T05:39:27.310 INFO:teuthology.orchestra.run.smithi150.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-09-17T05:39:27.310 INFO:teuthology.orchestra.run.smithi150.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-09-17T05:39:27.310 INFO:teuthology.orchestra.run.smithi150.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-17T05:39:27.310 INFO:teuthology.orchestra.run.smithi150.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-17T05:39:27.310 INFO:teuthology.orchestra.run.smithi150.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-09-17T05:39:27.310 INFO:teuthology.orchestra.run.smithi150.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-17T05:39:27.310 INFO:teuthology.orchestra.run.smithi150.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-09-17T05:39:27.310 INFO:teuthology.orchestra.run.smithi150.stdout:Installing weak dependencies: 2024-09-17T05:39:27.310 INFO:teuthology.orchestra.run.smithi150.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-09-17T05:39:27.310 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-09-17T05:39:27.310 INFO:teuthology.orchestra.run.smithi150.stdout:Transaction Summary 2024-09-17T05:39:27.310 INFO:teuthology.orchestra.run.smithi150.stdout:======================================================================================= 2024-09-17T05:39:27.311 INFO:teuthology.orchestra.run.smithi150.stdout:Install 149 Packages 2024-09-17T05:39:27.311 INFO:teuthology.orchestra.run.smithi150.stdout:Upgrade 8 Packages 2024-09-17T05:39:27.311 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-09-17T05:39:27.311 INFO:teuthology.orchestra.run.smithi150.stdout:Total download size: 228 M 2024-09-17T05:39:27.311 INFO:teuthology.orchestra.run.smithi150.stdout:Downloading Packages: 2024-09-17T05:39:27.969 INFO:teuthology.orchestra.run.smithi176.stdout:CentOS Stream 9 - CRB 3.1 MB/s | 6.5 MB 00:02 2024-09-17T05:39:28.432 INFO:teuthology.orchestra.run.smithi150.stdout:(1/157): ceph-19.3.0-4989.gce1b342b.el9.x86_64. 53 kB/s | 6.6 kB 00:00 2024-09-17T05:39:28.649 INFO:teuthology.orchestra.run.smithi150.stdout:(2/157): ceph-fuse-19.3.0-4989.gce1b342b.el9.x8 3.9 MB/s | 873 kB 00:00 2024-09-17T05:39:28.708 INFO:teuthology.orchestra.run.smithi150.stdout:(3/157): ceph-immutable-object-cache-19.3.0-498 2.5 MB/s | 148 kB 00:00 2024-09-17T05:39:29.042 INFO:teuthology.orchestra.run.smithi150.stdout:(4/157): ceph-base-19.3.0-4989.gce1b342b.el9.x8 7.5 MB/s | 5.5 MB 00:00 2024-09-17T05:39:29.092 INFO:teuthology.orchestra.run.smithi150.stdout:(5/157): ceph-mds-19.3.0-4989.gce1b342b.el9.x86 5.9 MB/s | 2.3 MB 00:00 2024-09-17T05:39:29.201 INFO:teuthology.orchestra.run.smithi150.stdout:(6/157): ceph-mgr-19.3.0-4989.gce1b342b.el9.x86 9.6 MB/s | 1.5 MB 00:00 2024-09-17T05:39:29.735 INFO:teuthology.orchestra.run.smithi176.stdout:CentOS Stream 9 - Extras packages 45 kB/s | 19 kB 00:00 2024-09-17T05:39:29.742 INFO:teuthology.orchestra.run.smithi150.stdout:(7/157): ceph-mon-19.3.0-4989.gce1b342b.el9.x86 7.6 MB/s | 5.0 MB 00:00 2024-09-17T05:39:30.318 INFO:teuthology.orchestra.run.smithi150.stdout:(8/157): ceph-common-19.3.0-4989.gce1b342b.el9. 9.9 MB/s | 20 MB 00:02 2024-09-17T05:39:30.376 INFO:teuthology.orchestra.run.smithi150.stdout:(9/157): ceph-selinux-19.3.0-4989.gce1b342b.el9 434 kB/s | 25 kB 00:00 2024-09-17T05:39:30.543 INFO:teuthology.orchestra.run.smithi150.stdout:(10/157): ceph-osd-19.3.0-4989.gce1b342b.el9.x8 13 MB/s | 18 MB 00:01 2024-09-17T05:39:30.610 INFO:teuthology.orchestra.run.smithi150.stdout:(11/157): cephfs-mirror-19.3.0-4989.gce1b342b.e 3.3 MB/s | 225 kB 00:00 2024-09-17T05:39:30.685 INFO:teuthology.orchestra.run.smithi150.stdout:(12/157): cephfs-shell-19.3.0-4989.gce1b342b.el 362 kB/s | 27 kB 00:00 2024-09-17T05:39:30.764 INFO:teuthology.orchestra.run.smithi176.stdout:Extra Packages for Enterprise Linux 25 MB/s | 23 MB 00:00 2024-09-17T05:39:30.777 INFO:teuthology.orchestra.run.smithi150.stdout:(13/157): libcephfs-devel-19.3.0-4989.gce1b342b 346 kB/s | 32 kB 00:00 2024-09-17T05:39:31.119 INFO:teuthology.orchestra.run.smithi150.stdout:(14/157): ceph-radosgw-19.3.0-4989.gce1b342b.el 7.6 MB/s | 10 MB 00:01 2024-09-17T05:39:31.203 INFO:teuthology.orchestra.run.smithi150.stdout:(15/157): libcephsqlite-19.3.0-4989.gce1b342b.e 1.9 MB/s | 159 kB 00:00 2024-09-17T05:39:31.303 INFO:teuthology.orchestra.run.smithi150.stdout:(16/157): librados-devel-19.3.0-4989.gce1b342b. 1.2 MB/s | 127 kB 00:00 2024-09-17T05:39:31.378 INFO:teuthology.orchestra.run.smithi150.stdout:(17/157): libcephfs2-19.3.0-4989.gce1b342b.el9. 1.2 MB/s | 766 kB 00:00 2024-09-17T05:39:31.403 INFO:teuthology.orchestra.run.smithi150.stdout:(18/157): libradosstriper1-19.3.0-4989.gce1b342 4.9 MB/s | 507 kB 00:00 2024-09-17T05:39:31.495 INFO:teuthology.orchestra.run.smithi150.stdout:(19/157): python3-ceph-argparse-19.3.0-4989.gce 491 kB/s | 45 kB 00:00 2024-09-17T05:39:31.579 INFO:teuthology.orchestra.run.smithi150.stdout:(20/157): python3-ceph-common-19.3.0-4989.gce1b 1.7 MB/s | 143 kB 00:00 2024-09-17T05:39:31.671 INFO:teuthology.orchestra.run.smithi150.stdout:(21/157): python3-cephfs-19.3.0-4989.gce1b342b. 1.7 MB/s | 162 kB 00:00 2024-09-17T05:39:31.830 INFO:teuthology.orchestra.run.smithi150.stdout:(22/157): librgw2-19.3.0-4989.gce1b342b.el9.x86 12 MB/s | 5.3 MB 00:00 2024-09-17T05:39:32.030 INFO:teuthology.orchestra.run.smithi150.stdout:(23/157): python3-rbd-19.3.0-4989.gce1b342b.el9 1.5 MB/s | 305 kB 00:00 2024-09-17T05:39:32.114 INFO:teuthology.orchestra.run.smithi150.stdout:(24/157): python3-rgw-19.3.0-4989.gce1b342b.el9 1.2 MB/s | 99 kB 00:00 2024-09-17T05:39:32.205 INFO:teuthology.orchestra.run.smithi150.stdout:(25/157): rbd-fuse-19.3.0-4989.gce1b342b.el9.x8 944 kB/s | 86 kB 00:00 2024-09-17T05:39:32.256 INFO:teuthology.orchestra.run.smithi150.stdout:(26/157): python3-rados-19.3.0-4989.gce1b342b.e 549 kB/s | 321 kB 00:00 2024-09-17T05:39:32.548 INFO:teuthology.orchestra.run.smithi150.stdout:(27/157): rbd-mirror-19.3.0-4989.gce1b342b.el9. 9.1 MB/s | 3.1 MB 00:00 2024-09-17T05:39:32.631 INFO:teuthology.orchestra.run.smithi150.stdout:(28/157): rbd-nbd-19.3.0-4989.gce1b342b.el9.x86 453 kB/s | 170 kB 00:00 2024-09-17T05:39:32.657 INFO:teuthology.orchestra.run.smithi150.stdout:(29/157): ceph-grafana-dashboards-19.3.0-4989.g 315 kB/s | 34 kB 00:00 2024-09-17T05:39:32.815 INFO:teuthology.orchestra.run.smithi150.stdout:(30/157): ceph-mgr-cephadm-19.3.0-4989.gce1b342 842 kB/s | 154 kB 00:00 2024-09-17T05:39:33.990 INFO:teuthology.orchestra.run.smithi150.stdout:(31/157): ceph-mgr-dashboard-19.3.0-4989.gce1b3 11 MB/s | 14 MB 00:01 2024-09-17T05:39:34.099 INFO:teuthology.orchestra.run.smithi150.stdout:(32/157): ceph-mgr-modules-core-19.3.0-4989.gce 2.6 MB/s | 291 kB 00:00 2024-09-17T05:39:34.183 INFO:teuthology.orchestra.run.smithi150.stdout:(33/157): ceph-mgr-rook-19.3.0-4989.gce1b342b.e 592 kB/s | 49 kB 00:00 2024-09-17T05:39:34.258 INFO:teuthology.orchestra.run.smithi150.stdout:(34/157): ceph-prometheus-alerts-19.3.0-4989.gc 220 kB/s | 16 kB 00:00 2024-09-17T05:39:34.342 INFO:teuthology.orchestra.run.smithi150.stdout:(35/157): ceph-volume-19.3.0-4989.gce1b342b.el9 3.3 MB/s | 285 kB 00:00 2024-09-17T05:39:34.717 INFO:teuthology.orchestra.run.smithi150.stdout:(36/157): ceph-test-19.3.0-4989.gce1b342b.el9.x 9.2 MB/s | 40 MB 00:04 2024-09-17T05:39:34.759 INFO:teuthology.orchestra.run.smithi150.stdout:(37/157): cephadm-19.3.0-4989.gce1b342b.el9.noa 1.8 MB/s | 784 kB 00:00 2024-09-17T05:39:34.793 INFO:teuthology.orchestra.run.smithi150.stdout:(38/157): cephfs-top-19.3.0-4989.gce1b342b.el9. 243 kB/s | 18 kB 00:00 2024-09-17T05:39:35.218 INFO:teuthology.orchestra.run.smithi150.stdout:(39/157): fuse-2.9.9-16.el9.x86_64.rpm 174 kB/s | 80 kB 00:00 2024-09-17T05:39:35.427 INFO:teuthology.orchestra.run.smithi150.stdout:(40/157): libquadmath-11.5.0-2.el9.x86_64.rpm 918 kB/s | 191 kB 00:00 2024-09-17T05:39:35.644 INFO:teuthology.orchestra.run.smithi150.stdout:(41/157): libgfortran-11.5.0-2.el9.x86_64.rpm 942 kB/s | 801 kB 00:00 2024-09-17T05:39:35.669 INFO:teuthology.orchestra.run.smithi150.stdout:(42/157): python3-cffi-1.14.5-5.el9.x86_64.rpm 1.0 MB/s | 253 kB 00:00 2024-09-17T05:39:35.786 INFO:teuthology.orchestra.run.smithi150.stdout:(43/157): python3-ply-3.11-14.el9.noarch.rpm 914 kB/s | 106 kB 00:00 2024-09-17T05:39:35.894 INFO:teuthology.orchestra.run.smithi150.stdout:(44/157): python3-pycparser-2.20-6.el9.noarch.r 1.2 MB/s | 135 kB 00:00 2024-09-17T05:39:35.945 INFO:teuthology.orchestra.run.smithi150.stdout:(45/157): python3-cryptography-36.0.1-4.el9.x86 4.1 MB/s | 1.2 MB 00:00 2024-09-17T05:39:36.003 INFO:teuthology.orchestra.run.smithi150.stdout:(46/157): python3-requests-2.25.1-8.el9.noarch. 1.1 MB/s | 125 kB 00:00 2024-09-17T05:39:36.062 INFO:teuthology.orchestra.run.smithi150.stdout:(47/157): python3-urllib3-1.26.5-6.el9.noarch.r 1.8 MB/s | 215 kB 00:00 2024-09-17T05:39:36.170 INFO:teuthology.orchestra.run.smithi150.stdout:(48/157): automake-1.16.2-8.el9.noarch.rpm 4.0 MB/s | 689 kB 00:00 2024-09-17T05:39:36.212 INFO:teuthology.orchestra.run.smithi150.stdout:(49/157): boost-program-options-1.75.0-8.el9.x8 2.5 MB/s | 107 kB 00:00 2024-09-17T05:39:36.220 INFO:teuthology.orchestra.run.smithi176.stdout:lab-extras 29 kB/s | 1.7 kB 00:00 2024-09-17T05:39:36.256 INFO:teuthology.orchestra.run.smithi150.stdout:(50/157): bison-3.7.4-5.el9.x86_64.rpm 4.8 MB/s | 943 kB 00:00 2024-09-17T05:39:36.279 INFO:teuthology.orchestra.run.smithi150.stdout:(51/157): elfutils-libelf-devel-0.191-4.el9.x86 325 kB/s | 22 kB 00:00 2024-09-17T05:39:36.305 INFO:teuthology.orchestra.run.smithi150.stdout:(52/157): flex-2.6.4-9.el9.x86_64.rpm 6.1 MB/s | 313 kB 00:00 2024-09-17T05:39:36.330 INFO:teuthology.orchestra.run.smithi150.stdout:(53/157): flexiblas-3.0.4-8.el9.x86_64.rpm 653 kB/s | 33 kB 00:00 2024-09-17T05:39:36.372 INFO:teuthology.orchestra.run.smithi150.stdout:(54/157): flexiblas-openblas-openmp-3.0.4-8.el9 438 kB/s | 18 kB 00:00 2024-09-17T05:39:36.430 INFO:teuthology.orchestra.run.smithi150.stdout:(55/157): flexiblas-netlib-3.0.4-8.el9.x86_64.r 24 MB/s | 3.0 MB 00:00 2024-09-17T05:39:36.456 INFO:teuthology.orchestra.run.smithi150.stdout:(56/157): libaio-devel-0.3.111-13.el9.x86_64.rp 133 kB/s | 11 kB 00:00 2024-09-17T05:39:36.481 INFO:teuthology.orchestra.run.smithi150.stdout:(57/157): libnbd-1.20.2-2.el9.x86_64.rpm 3.3 MB/s | 171 kB 00:00 2024-09-17T05:39:36.506 INFO:teuthology.orchestra.run.smithi150.stdout:(58/157): libpmemobj-1.12.1-1.el9.x86_64.rpm 3.1 MB/s | 160 kB 00:00 2024-09-17T05:39:36.532 INFO:teuthology.orchestra.run.smithi150.stdout:(59/157): librabbitmq-0.11.0-7.el9.x86_64.rpm 903 kB/s | 45 kB 00:00 2024-09-17T05:39:36.565 INFO:teuthology.orchestra.run.smithi150.stdout:(60/157): librdkafka-1.6.1-102.el9.x86_64.rpm 11 MB/s | 662 kB 00:00 2024-09-17T05:39:36.599 INFO:teuthology.orchestra.run.smithi150.stdout:(61/157): libtool-2.4.6-46.el9.x86_64.rpm 8.5 MB/s | 581 kB 00:00 2024-09-17T05:39:36.616 INFO:teuthology.orchestra.run.smithi150.stdout:(62/157): libuuid-devel-2.37.4-20.el9.x86_64.rp 485 kB/s | 24 kB 00:00 2024-09-17T05:39:36.633 INFO:teuthology.orchestra.run.smithi150.stdout:(63/157): libzstd-devel-1.5.1-2.el9.x86_64.rpm 1.4 MB/s | 47 kB 00:00 2024-09-17T05:39:36.659 INFO:teuthology.orchestra.run.smithi150.stdout:(64/157): lttng-ust-2.12.0-6.el9.x86_64.rpm 6.8 MB/s | 292 kB 00:00 2024-09-17T05:39:36.684 INFO:teuthology.orchestra.run.smithi150.stdout:(65/157): lua-5.4.4-4.el9.x86_64.rpm 3.7 MB/s | 188 kB 00:00 2024-09-17T05:39:36.709 INFO:teuthology.orchestra.run.smithi150.stdout:(66/157): openblas-0.3.26-2.el9.x86_64.rpm 770 kB/s | 38 kB 00:00 2024-09-17T05:39:36.801 INFO:teuthology.orchestra.run.smithi150.stdout:(67/157): ceph-mgr-diskprediction-local-19.3.0- 1.9 MB/s | 7.4 MB 00:03 2024-09-17T05:39:36.885 INFO:teuthology.orchestra.run.smithi150.stdout:(68/157): openssl-devel-3.2.2-6.el9.x86_64.rpm 25 MB/s | 4.4 MB 00:00 2024-09-17T05:39:36.952 INFO:teuthology.orchestra.run.smithi150.stdout:(69/157): openblas-openmp-0.3.26-2.el9.x86_64.r 18 MB/s | 4.9 MB 00:00 2024-09-17T05:39:36.993 INFO:teuthology.orchestra.run.smithi150.stdout:(70/157): postgresql-contrib-13.16-1.el9.x86_64 8.2 MB/s | 910 kB 00:00 2024-09-17T05:39:37.018 INFO:teuthology.orchestra.run.smithi150.stdout:(71/157): postgresql-private-libs-13.16-1.el9.x 2.0 MB/s | 137 kB 00:00 2024-09-17T05:39:37.094 INFO:teuthology.orchestra.run.smithi150.stdout:(72/157): protobuf-3.14.0-13.el9.x86_64.rpm 13 MB/s | 1.0 MB 00:00 2024-09-17T05:39:37.169 INFO:teuthology.orchestra.run.smithi150.stdout:(73/157): postgresql-server-13.16-1.el9.x86_64. 33 MB/s | 5.8 MB 00:00 2024-09-17T05:39:37.211 INFO:teuthology.orchestra.run.smithi150.stdout:(74/157): postgresql-13.16-1.el9.x86_64.rpm 3.9 MB/s | 1.6 MB 00:00 2024-09-17T05:39:37.236 INFO:teuthology.orchestra.run.smithi150.stdout:(75/157): python3-attrs-20.3.0-7.el9.noarch.rpm 615 kB/s | 87 kB 00:00 2024-09-17T05:39:37.262 INFO:teuthology.orchestra.run.smithi150.stdout:(76/157): python3-colorama-0.4.6-3.el9.noarch.r 1.2 MB/s | 61 kB 00:00 2024-09-17T05:39:37.287 INFO:teuthology.orchestra.run.smithi150.stdout:(77/157): python3-devel-3.9.19-8.el9.x86_64.rpm 4.8 MB/s | 245 kB 00:00 2024-09-17T05:39:37.321 INFO:teuthology.orchestra.run.smithi150.stdout:(78/157): python3-jinja2-2.11.3-6.el9.noarch.rp 4.1 MB/s | 248 kB 00:00 2024-09-17T05:39:37.346 INFO:teuthology.orchestra.run.smithi150.stdout:(79/157): python3-jsonpatch-1.21-16.el9.noarch. 438 kB/s | 26 kB 00:00 2024-09-17T05:39:37.371 INFO:teuthology.orchestra.run.smithi150.stdout:(80/157): python3-jsonpointer-2.0-4.el9.noarch. 380 kB/s | 19 kB 00:00 2024-09-17T05:39:37.397 INFO:teuthology.orchestra.run.smithi150.stdout:(81/157): python3-mako-1.1.4-6.el9.noarch.rpm 3.3 MB/s | 172 kB 00:00 2024-09-17T05:39:37.422 INFO:teuthology.orchestra.run.smithi150.stdout:(82/157): python3-markupsafe-1.1.1-12.el9.x86_6 695 kB/s | 35 kB 00:00 2024-09-17T05:39:37.464 INFO:teuthology.orchestra.run.smithi150.stdout:(83/157): python3-numpy-f2py-1.20.1-5.el9.x86_6 5.9 MB/s | 250 kB 00:00 2024-09-17T05:39:37.556 INFO:teuthology.orchestra.run.smithi150.stdout:(84/157): python3-babel-2.9.1-2.el9.noarch.rpm 15 MB/s | 6.0 MB 00:00 2024-09-17T05:39:37.589 INFO:teuthology.orchestra.run.smithi150.stdout:(85/157): python3-oauthlib-3.1.1-5.el9.noarch.r 1.7 MB/s | 222 kB 00:00 2024-09-17T05:39:37.614 INFO:teuthology.orchestra.run.smithi150.stdout:(86/157): python3-packaging-20.9-5.el9.noarch.r 1.3 MB/s | 77 kB 00:00 2024-09-17T05:39:37.640 INFO:teuthology.orchestra.run.smithi150.stdout:(87/157): python3-prettytable-0.7.2-27.el9.noar 840 kB/s | 42 kB 00:00 2024-09-17T05:39:37.665 INFO:teuthology.orchestra.run.smithi150.stdout:(88/157): python3-protobuf-3.14.0-13.el9.noarch 5.2 MB/s | 269 kB 00:00 2024-09-17T05:39:37.690 INFO:teuthology.orchestra.run.smithi150.stdout:(89/157): python3-pyasn1-0.4.8-6.el9.noarch.rpm 3.1 MB/s | 159 kB 00:00 2024-09-17T05:39:37.724 INFO:teuthology.orchestra.run.smithi150.stdout:(90/157): python3-pyasn1-modules-0.4.8-6.el9.no 4.6 MB/s | 279 kB 00:00 2024-09-17T05:39:37.749 INFO:teuthology.orchestra.run.smithi150.stdout:(91/157): python3-pytz-2021.1-5.el9.noarch.rpm 867 kB/s | 51 kB 00:00 2024-09-17T05:39:37.775 INFO:teuthology.orchestra.run.smithi150.stdout:(92/157): python3-requests-oauthlib-1.3.0-12.el 1.0 MB/s | 54 kB 00:00 2024-09-17T05:39:37.859 INFO:teuthology.orchestra.run.smithi150.stdout:(93/157): python3-numpy-1.20.1-5.el9.x86_64.rpm 11 MB/s | 5.1 MB 00:00 2024-09-17T05:39:37.884 INFO:teuthology.orchestra.run.smithi150.stdout:(94/157): python3-toml-0.10.2-6.el9.noarch.rpm 384 kB/s | 42 kB 00:00 2024-09-17T05:39:37.917 INFO:teuthology.orchestra.run.smithi150.stdout:(95/157): python3-wcwidth-0.2.5-8.el9.noarch.rp 760 kB/s | 44 kB 00:00 2024-09-17T05:39:37.943 INFO:teuthology.orchestra.run.smithi150.stdout:(96/157): qatlib-24.02.0-1.el9.x86_64.rpm 3.7 MB/s | 221 kB 00:00 2024-09-17T05:39:37.968 INFO:teuthology.orchestra.run.smithi150.stdout:(97/157): qatlib-service-24.02.0-1.el9.x86_64.r 714 kB/s | 36 kB 00:00 2024-09-17T05:39:37.993 INFO:teuthology.orchestra.run.smithi150.stdout:(98/157): qatzip-libs-1.2.0-1.el9.x86_64.rpm 943 kB/s | 47 kB 00:00 2024-09-17T05:39:38.018 INFO:teuthology.orchestra.run.smithi150.stdout:(99/157): socat-1.7.4.1-6.el9.x86_64.rpm 5.9 MB/s | 304 kB 00:00 2024-09-17T05:39:38.044 INFO:teuthology.orchestra.run.smithi150.stdout:(100/157): uuid-1.6.2-55.el9.x86_64.rpm 1.1 MB/s | 58 kB 00:00 2024-09-17T05:39:38.069 INFO:teuthology.orchestra.run.smithi150.stdout:(101/157): xfsprogs-devel-6.4.0-4.el9.x86_64.rp 1.9 MB/s | 96 kB 00:00 2024-09-17T05:39:38.094 INFO:teuthology.orchestra.run.smithi150.stdout:(102/157): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.2 MB/s | 64 kB 00:00 2024-09-17T05:39:38.119 INFO:teuthology.orchestra.run.smithi150.stdout:(103/157): zlib-devel-1.2.11-41.el9.x86_64.rpm 893 kB/s | 45 kB 00:00 2024-09-17T05:39:38.187 INFO:teuthology.orchestra.run.smithi150.stdout:(104/157): lua-devel-5.4.4-4.el9.x86_64.rpm 243 kB/s | 22 kB 00:00 2024-09-17T05:39:38.237 INFO:teuthology.orchestra.run.smithi150.stdout:(105/157): abseil-cpp-20211102.0-3.el9.x86_64.r 11 MB/s | 548 kB 00:00 2024-09-17T05:39:38.271 INFO:teuthology.orchestra.run.smithi150.stdout:(106/157): gperftools-libs-2.9.1-3.el9.x86_64.r 9.1 MB/s | 308 kB 00:00 2024-09-17T05:39:38.304 INFO:teuthology.orchestra.run.smithi150.stdout:(107/157): protobuf-compiler-3.14.0-13.el9.x86_ 4.6 MB/s | 863 kB 00:00 2024-09-17T05:39:38.321 INFO:teuthology.orchestra.run.smithi150.stdout:(108/157): grpc-data-1.46.7-10.el9.noarch.rpm 388 kB/s | 19 kB 00:00 2024-09-17T05:39:38.346 INFO:teuthology.orchestra.run.smithi150.stdout:(109/157): libarrow-doc-9.0.0-11.el9.noarch.rpm 1.4 MB/s | 26 kB 00:00 2024-09-17T05:39:38.372 INFO:teuthology.orchestra.run.smithi150.stdout:(110/157): liboath-2.6.7-2.el9.x86_64.rpm 2.0 MB/s | 49 kB 00:00 2024-09-17T05:39:38.397 INFO:teuthology.orchestra.run.smithi150.stdout:(111/157): libunwind-1.6.2-1.el9.x86_64.rpm 2.7 MB/s | 67 kB 00:00 2024-09-17T05:39:38.407 INFO:teuthology.orchestra.run.smithi176.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-17T05:39:38.408 INFO:teuthology.orchestra.run.smithi176.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-17T05:39:38.421 INFO:teuthology.orchestra.run.smithi176.stdout:Package NetworkManager-1:1.48.8-1.el9.x86_64 is already installed. 2024-09-17T05:39:38.422 INFO:teuthology.orchestra.run.smithi176.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-09-17T05:39:38.423 INFO:teuthology.orchestra.run.smithi176.stdout:Package util-linux-2.37.4-20.el9.x86_64 is already installed. 2024-09-17T05:39:38.424 INFO:teuthology.orchestra.run.smithi176.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-09-17T05:39:38.426 INFO:teuthology.orchestra.run.smithi176.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-09-17T05:39:38.429 INFO:teuthology.orchestra.run.smithi176.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-09-17T05:39:38.430 INFO:teuthology.orchestra.run.smithi176.stdout:Package xfsprogs-6.4.0-4.el9.x86_64 is already installed. 2024-09-17T05:39:38.493 INFO:teuthology.orchestra.run.smithi176.stdout:Dependencies resolved. 2024-09-17T05:39:38.512 INFO:teuthology.orchestra.run.smithi176.stdout:======================================================================================= 2024-09-17T05:39:38.512 INFO:teuthology.orchestra.run.smithi176.stdout: Package Arch Version Repository Size 2024-09-17T05:39:38.512 INFO:teuthology.orchestra.run.smithi176.stdout:======================================================================================= 2024-09-17T05:39:38.512 INFO:teuthology.orchestra.run.smithi176.stdout:Installing: 2024-09-17T05:39:38.512 INFO:teuthology.orchestra.run.smithi176.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-09-17T05:39:38.512 INFO:teuthology.orchestra.run.smithi176.stdout: ceph x86_64 2:19.3.0-4989.gce1b342b.el9 ceph 6.6 k 2024-09-17T05:39:38.512 INFO:teuthology.orchestra.run.smithi176.stdout: ceph-base x86_64 2:19.3.0-4989.gce1b342b.el9 ceph 5.5 M 2024-09-17T05:39:38.512 INFO:teuthology.orchestra.run.smithi176.stdout: ceph-fuse x86_64 2:19.3.0-4989.gce1b342b.el9 ceph 873 k 2024-09-17T05:39:38.513 INFO:teuthology.orchestra.run.smithi176.stdout: ceph-immutable-object-cache x86_64 2:19.3.0-4989.gce1b342b.el9 ceph 148 k 2024-09-17T05:39:38.513 INFO:teuthology.orchestra.run.smithi176.stdout: ceph-mgr x86_64 2:19.3.0-4989.gce1b342b.el9 ceph 1.5 M 2024-09-17T05:39:38.513 INFO:teuthology.orchestra.run.smithi176.stdout: ceph-mgr-cephadm noarch 2:19.3.0-4989.gce1b342b.el9 ceph-noarch 154 k 2024-09-17T05:39:38.513 INFO:teuthology.orchestra.run.smithi176.stdout: ceph-mgr-dashboard noarch 2:19.3.0-4989.gce1b342b.el9 ceph-noarch 14 M 2024-09-17T05:39:38.513 INFO:teuthology.orchestra.run.smithi176.stdout: ceph-mgr-diskprediction-local noarch 2:19.3.0-4989.gce1b342b.el9 ceph-noarch 7.4 M 2024-09-17T05:39:38.513 INFO:teuthology.orchestra.run.smithi176.stdout: ceph-mgr-rook noarch 2:19.3.0-4989.gce1b342b.el9 ceph-noarch 49 k 2024-09-17T05:39:38.513 INFO:teuthology.orchestra.run.smithi176.stdout: ceph-radosgw x86_64 2:19.3.0-4989.gce1b342b.el9 ceph 10 M 2024-09-17T05:39:38.513 INFO:teuthology.orchestra.run.smithi176.stdout: ceph-test x86_64 2:19.3.0-4989.gce1b342b.el9 ceph 40 M 2024-09-17T05:39:38.513 INFO:teuthology.orchestra.run.smithi176.stdout: ceph-volume noarch 2:19.3.0-4989.gce1b342b.el9 ceph-noarch 285 k 2024-09-17T05:39:38.513 INFO:teuthology.orchestra.run.smithi176.stdout: cephadm noarch 2:19.3.0-4989.gce1b342b.el9 ceph-noarch 784 k 2024-09-17T05:39:38.513 INFO:teuthology.orchestra.run.smithi176.stdout: cephfs-mirror x86_64 2:19.3.0-4989.gce1b342b.el9 ceph 225 k 2024-09-17T05:39:38.513 INFO:teuthology.orchestra.run.smithi176.stdout: cephfs-shell x86_64 2:19.3.0-4989.gce1b342b.el9 ceph 27 k 2024-09-17T05:39:38.514 INFO:teuthology.orchestra.run.smithi176.stdout: cephfs-top noarch 2:19.3.0-4989.gce1b342b.el9 ceph-noarch 18 k 2024-09-17T05:39:38.514 INFO:teuthology.orchestra.run.smithi176.stdout: elfutils-libelf-devel x86_64 0.191-4.el9 appstream 22 k 2024-09-17T05:39:38.514 INFO:teuthology.orchestra.run.smithi176.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-09-17T05:39:38.514 INFO:teuthology.orchestra.run.smithi176.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-09-17T05:39:38.514 INFO:teuthology.orchestra.run.smithi176.stdout: libcephfs-devel x86_64 2:19.3.0-4989.gce1b342b.el9 ceph 32 k 2024-09-17T05:39:38.514 INFO:teuthology.orchestra.run.smithi176.stdout: libcephfs2 x86_64 2:19.3.0-4989.gce1b342b.el9 ceph 766 k 2024-09-17T05:39:38.514 INFO:teuthology.orchestra.run.smithi176.stdout: librados-devel x86_64 2:19.3.0-4989.gce1b342b.el9 ceph 127 k 2024-09-17T05:39:38.514 INFO:teuthology.orchestra.run.smithi176.stdout: libtool x86_64 2.4.6-46.el9 appstream 581 k 2024-09-17T05:39:38.514 INFO:teuthology.orchestra.run.smithi176.stdout: libuuid-devel x86_64 2.37.4-20.el9 appstream 24 k 2024-09-17T05:39:38.514 INFO:teuthology.orchestra.run.smithi176.stdout: openssl-devel x86_64 1:3.2.2-6.el9 appstream 4.4 M 2024-09-17T05:39:38.514 INFO:teuthology.orchestra.run.smithi176.stdout: postgresql x86_64 13.16-1.el9 appstream 1.6 M 2024-09-17T05:39:38.514 INFO:teuthology.orchestra.run.smithi176.stdout: postgresql-contrib x86_64 13.16-1.el9 appstream 910 k 2024-09-17T05:39:38.515 INFO:teuthology.orchestra.run.smithi176.stdout: postgresql-server x86_64 13.16-1.el9 appstream 5.8 M 2024-09-17T05:39:38.515 INFO:teuthology.orchestra.run.smithi176.stdout: python3-cephfs x86_64 2:19.3.0-4989.gce1b342b.el9 ceph 162 k 2024-09-17T05:39:38.515 INFO:teuthology.orchestra.run.smithi176.stdout: python3-rados x86_64 2:19.3.0-4989.gce1b342b.el9 ceph 321 k 2024-09-17T05:39:38.515 INFO:teuthology.orchestra.run.smithi176.stdout: python3-rbd x86_64 2:19.3.0-4989.gce1b342b.el9 ceph 305 k 2024-09-17T05:39:38.515 INFO:teuthology.orchestra.run.smithi176.stdout: python3-rgw x86_64 2:19.3.0-4989.gce1b342b.el9 ceph 99 k 2024-09-17T05:39:38.515 INFO:teuthology.orchestra.run.smithi176.stdout: rbd-fuse x86_64 2:19.3.0-4989.gce1b342b.el9 ceph 86 k 2024-09-17T05:39:38.515 INFO:teuthology.orchestra.run.smithi176.stdout: rbd-mirror x86_64 2:19.3.0-4989.gce1b342b.el9 ceph 3.1 M 2024-09-17T05:39:38.515 INFO:teuthology.orchestra.run.smithi176.stdout: rbd-nbd x86_64 2:19.3.0-4989.gce1b342b.el9 ceph 170 k 2024-09-17T05:39:38.515 INFO:teuthology.orchestra.run.smithi176.stdout: xfsprogs-devel x86_64 6.4.0-4.el9 appstream 96 k 2024-09-17T05:39:38.515 INFO:teuthology.orchestra.run.smithi176.stdout:Upgrading: 2024-09-17T05:39:38.515 INFO:teuthology.orchestra.run.smithi176.stdout: NetworkManager x86_64 1:1.51.0-1.el9 baseos 2.3 M 2024-09-17T05:39:38.516 INFO:teuthology.orchestra.run.smithi176.stdout: NetworkManager-libnm x86_64 1:1.51.0-1.el9 baseos 1.8 M 2024-09-17T05:39:38.516 INFO:teuthology.orchestra.run.smithi176.stdout: NetworkManager-team x86_64 1:1.51.0-1.el9 baseos 41 k 2024-09-17T05:39:38.516 INFO:teuthology.orchestra.run.smithi176.stdout: NetworkManager-tui x86_64 1:1.51.0-1.el9 baseos 249 k 2024-09-17T05:39:38.516 INFO:teuthology.orchestra.run.smithi176.stdout: librados2 x86_64 2:19.3.0-4989.gce1b342b.el9 ceph 3.4 M 2024-09-17T05:39:38.516 INFO:teuthology.orchestra.run.smithi176.stdout: librbd1 x86_64 2:19.3.0-4989.gce1b342b.el9 ceph 3.2 M 2024-09-17T05:39:38.516 INFO:teuthology.orchestra.run.smithi176.stdout: openssl x86_64 1:3.2.2-6.el9 baseos 1.4 M 2024-09-17T05:39:38.516 INFO:teuthology.orchestra.run.smithi176.stdout: openssl-libs x86_64 1:3.2.2-6.el9 baseos 2.4 M 2024-09-17T05:39:38.516 INFO:teuthology.orchestra.run.smithi176.stdout:Installing dependencies: 2024-09-17T05:39:38.516 INFO:teuthology.orchestra.run.smithi176.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-09-17T05:39:38.516 INFO:teuthology.orchestra.run.smithi176.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-09-17T05:39:38.516 INFO:teuthology.orchestra.run.smithi176.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-09-17T05:39:38.516 INFO:teuthology.orchestra.run.smithi176.stdout: ceph-common x86_64 2:19.3.0-4989.gce1b342b.el9 ceph 20 M 2024-09-17T05:39:38.517 INFO:teuthology.orchestra.run.smithi176.stdout: ceph-grafana-dashboards noarch 2:19.3.0-4989.gce1b342b.el9 ceph-noarch 34 k 2024-09-17T05:39:38.517 INFO:teuthology.orchestra.run.smithi176.stdout: ceph-mds x86_64 2:19.3.0-4989.gce1b342b.el9 ceph 2.3 M 2024-09-17T05:39:38.517 INFO:teuthology.orchestra.run.smithi176.stdout: ceph-mgr-modules-core noarch 2:19.3.0-4989.gce1b342b.el9 ceph-noarch 291 k 2024-09-17T05:39:38.517 INFO:teuthology.orchestra.run.smithi176.stdout: ceph-mon x86_64 2:19.3.0-4989.gce1b342b.el9 ceph 5.0 M 2024-09-17T05:39:38.517 INFO:teuthology.orchestra.run.smithi176.stdout: ceph-osd x86_64 2:19.3.0-4989.gce1b342b.el9 ceph 18 M 2024-09-17T05:39:38.517 INFO:teuthology.orchestra.run.smithi176.stdout: ceph-prometheus-alerts noarch 2:19.3.0-4989.gce1b342b.el9 ceph-noarch 16 k 2024-09-17T05:39:38.517 INFO:teuthology.orchestra.run.smithi176.stdout: ceph-selinux x86_64 2:19.3.0-4989.gce1b342b.el9 ceph 25 k 2024-09-17T05:39:38.517 INFO:teuthology.orchestra.run.smithi176.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-17T05:39:38.517 INFO:teuthology.orchestra.run.smithi176.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-17T05:39:38.517 INFO:teuthology.orchestra.run.smithi176.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-17T05:39:38.517 INFO:teuthology.orchestra.run.smithi176.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-17T05:39:38.517 INFO:teuthology.orchestra.run.smithi176.stdout: gperftools-libs x86_64 2.9.1-3.el9 epel 308 k 2024-09-17T05:39:38.518 INFO:teuthology.orchestra.run.smithi176.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-09-17T05:39:38.518 INFO:teuthology.orchestra.run.smithi176.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-09-17T05:39:38.518 INFO:teuthology.orchestra.run.smithi176.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-09-17T05:39:38.518 INFO:teuthology.orchestra.run.smithi176.stdout: libcephsqlite x86_64 2:19.3.0-4989.gce1b342b.el9 ceph 159 k 2024-09-17T05:39:38.518 INFO:teuthology.orchestra.run.smithi176.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-17T05:39:38.518 INFO:teuthology.orchestra.run.smithi176.stdout: libnbd x86_64 1.20.2-2.el9 appstream 171 k 2024-09-17T05:39:38.518 INFO:teuthology.orchestra.run.smithi176.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-17T05:39:38.518 INFO:teuthology.orchestra.run.smithi176.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-17T05:39:38.518 INFO:teuthology.orchestra.run.smithi176.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-17T05:39:38.518 INFO:teuthology.orchestra.run.smithi176.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-17T05:39:38.518 INFO:teuthology.orchestra.run.smithi176.stdout: libradosstriper1 x86_64 2:19.3.0-4989.gce1b342b.el9 ceph 507 k 2024-09-17T05:39:38.518 INFO:teuthology.orchestra.run.smithi176.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-17T05:39:38.518 INFO:teuthology.orchestra.run.smithi176.stdout: librgw2 x86_64 2:19.3.0-4989.gce1b342b.el9 ceph 5.3 M 2024-09-17T05:39:38.519 INFO:teuthology.orchestra.run.smithi176.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-17T05:39:38.519 INFO:teuthology.orchestra.run.smithi176.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-09-17T05:39:38.519 INFO:teuthology.orchestra.run.smithi176.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-17T05:39:38.519 INFO:teuthology.orchestra.run.smithi176.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-09-17T05:39:38.519 INFO:teuthology.orchestra.run.smithi176.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-09-17T05:39:38.519 INFO:teuthology.orchestra.run.smithi176.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-09-17T05:39:38.519 INFO:teuthology.orchestra.run.smithi176.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-17T05:39:38.519 INFO:teuthology.orchestra.run.smithi176.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-17T05:39:38.519 INFO:teuthology.orchestra.run.smithi176.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-09-17T05:39:38.519 INFO:teuthology.orchestra.run.smithi176.stdout: postgresql-private-libs x86_64 13.16-1.el9 appstream 137 k 2024-09-17T05:39:38.519 INFO:teuthology.orchestra.run.smithi176.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-09-17T05:39:38.519 INFO:teuthology.orchestra.run.smithi176.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-09-17T05:39:38.520 INFO:teuthology.orchestra.run.smithi176.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-17T05:39:38.520 INFO:teuthology.orchestra.run.smithi176.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-09-17T05:39:38.520 INFO:teuthology.orchestra.run.smithi176.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-17T05:39:38.520 INFO:teuthology.orchestra.run.smithi176.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-17T05:39:38.520 INFO:teuthology.orchestra.run.smithi176.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-17T05:39:38.520 INFO:teuthology.orchestra.run.smithi176.stdout: python3-ceph-argparse x86_64 2:19.3.0-4989.gce1b342b.el9 ceph 45 k 2024-09-17T05:39:38.520 INFO:teuthology.orchestra.run.smithi176.stdout: python3-ceph-common x86_64 2:19.3.0-4989.gce1b342b.el9 ceph 143 k 2024-09-17T05:39:38.520 INFO:teuthology.orchestra.run.smithi176.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-17T05:39:38.520 INFO:teuthology.orchestra.run.smithi176.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-17T05:39:38.520 INFO:teuthology.orchestra.run.smithi176.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-17T05:39:38.520 INFO:teuthology.orchestra.run.smithi176.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-17T05:39:38.520 INFO:teuthology.orchestra.run.smithi176.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-09-17T05:39:38.521 INFO:teuthology.orchestra.run.smithi176.stdout: python3-colorama noarch 0.4.6-3.el9 appstream 61 k 2024-09-17T05:39:38.521 INFO:teuthology.orchestra.run.smithi176.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-17T05:39:38.521 INFO:teuthology.orchestra.run.smithi176.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-17T05:39:38.521 INFO:teuthology.orchestra.run.smithi176.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-17T05:39:38.521 INFO:teuthology.orchestra.run.smithi176.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-09-17T05:39:38.521 INFO:teuthology.orchestra.run.smithi176.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-09-17T05:39:38.521 INFO:teuthology.orchestra.run.smithi176.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-17T05:39:38.521 INFO:teuthology.orchestra.run.smithi176.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-17T05:39:38.521 INFO:teuthology.orchestra.run.smithi176.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-09-17T05:39:38.521 INFO:teuthology.orchestra.run.smithi176.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-17T05:39:38.521 INFO:teuthology.orchestra.run.smithi176.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-17T05:39:38.521 INFO:teuthology.orchestra.run.smithi176.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-17T05:39:38.521 INFO:teuthology.orchestra.run.smithi176.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-17T05:39:38.522 INFO:teuthology.orchestra.run.smithi176.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-17T05:39:38.522 INFO:teuthology.orchestra.run.smithi176.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-17T05:39:38.522 INFO:teuthology.orchestra.run.smithi176.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-17T05:39:38.522 INFO:teuthology.orchestra.run.smithi176.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-17T05:39:38.522 INFO:teuthology.orchestra.run.smithi176.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-17T05:39:38.522 INFO:teuthology.orchestra.run.smithi176.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-17T05:39:38.522 INFO:teuthology.orchestra.run.smithi176.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-17T05:39:38.522 INFO:teuthology.orchestra.run.smithi176.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-17T05:39:38.522 INFO:teuthology.orchestra.run.smithi176.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-17T05:39:38.522 INFO:teuthology.orchestra.run.smithi176.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-17T05:39:38.522 INFO:teuthology.orchestra.run.smithi176.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-09-17T05:39:38.522 INFO:teuthology.orchestra.run.smithi176.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-17T05:39:38.522 INFO:teuthology.orchestra.run.smithi176.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-17T05:39:38.523 INFO:teuthology.orchestra.run.smithi176.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-17T05:39:38.523 INFO:teuthology.orchestra.run.smithi176.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-17T05:39:38.523 INFO:teuthology.orchestra.run.smithi176.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-09-17T05:39:38.523 INFO:teuthology.orchestra.run.smithi176.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-17T05:39:38.523 INFO:teuthology.orchestra.run.smithi176.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-17T05:39:38.523 INFO:teuthology.orchestra.run.smithi176.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-17T05:39:38.523 INFO:teuthology.orchestra.run.smithi176.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-17T05:39:38.523 INFO:teuthology.orchestra.run.smithi176.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-09-17T05:39:38.523 INFO:teuthology.orchestra.run.smithi176.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-17T05:39:38.523 INFO:teuthology.orchestra.run.smithi176.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-17T05:39:38.523 INFO:teuthology.orchestra.run.smithi176.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-17T05:39:38.523 INFO:teuthology.orchestra.run.smithi176.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-17T05:39:38.523 INFO:teuthology.orchestra.run.smithi176.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-17T05:39:38.524 INFO:teuthology.orchestra.run.smithi176.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-17T05:39:38.524 INFO:teuthology.orchestra.run.smithi176.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-17T05:39:38.524 INFO:teuthology.orchestra.run.smithi176.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-17T05:39:38.524 INFO:teuthology.orchestra.run.smithi176.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-17T05:39:38.524 INFO:teuthology.orchestra.run.smithi176.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-17T05:39:38.524 INFO:teuthology.orchestra.run.smithi176.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-17T05:39:38.524 INFO:teuthology.orchestra.run.smithi176.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-09-17T05:39:38.524 INFO:teuthology.orchestra.run.smithi176.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-17T05:39:38.524 INFO:teuthology.orchestra.run.smithi176.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-17T05:39:38.524 INFO:teuthology.orchestra.run.smithi176.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-17T05:39:38.524 INFO:teuthology.orchestra.run.smithi176.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-17T05:39:38.524 INFO:teuthology.orchestra.run.smithi176.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-09-17T05:39:38.525 INFO:teuthology.orchestra.run.smithi176.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-09-17T05:39:38.525 INFO:teuthology.orchestra.run.smithi176.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-09-17T05:39:38.525 INFO:teuthology.orchestra.run.smithi176.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-17T05:39:38.525 INFO:teuthology.orchestra.run.smithi176.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-17T05:39:38.525 INFO:teuthology.orchestra.run.smithi176.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-09-17T05:39:38.525 INFO:teuthology.orchestra.run.smithi176.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-17T05:39:38.525 INFO:teuthology.orchestra.run.smithi176.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-09-17T05:39:38.525 INFO:teuthology.orchestra.run.smithi176.stdout:Installing weak dependencies: 2024-09-17T05:39:38.525 INFO:teuthology.orchestra.run.smithi176.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-09-17T05:39:38.525 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-09-17T05:39:38.525 INFO:teuthology.orchestra.run.smithi176.stdout:Transaction Summary 2024-09-17T05:39:38.525 INFO:teuthology.orchestra.run.smithi176.stdout:======================================================================================= 2024-09-17T05:39:38.525 INFO:teuthology.orchestra.run.smithi176.stdout:Install 149 Packages 2024-09-17T05:39:38.526 INFO:teuthology.orchestra.run.smithi176.stdout:Upgrade 8 Packages 2024-09-17T05:39:38.526 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-09-17T05:39:38.526 INFO:teuthology.orchestra.run.smithi176.stdout:Total download size: 228 M 2024-09-17T05:39:38.526 INFO:teuthology.orchestra.run.smithi176.stdout:Downloading Packages: 2024-09-17T05:39:38.555 INFO:teuthology.orchestra.run.smithi150.stdout:(112/157): python3-scipy-1.6.2-8.el9.x86_64.rpm 20 MB/s | 16 MB 00:00 2024-09-17T05:39:38.581 INFO:teuthology.orchestra.run.smithi150.stdout:(113/157): luarocks-3.9.2-5.el9.noarch.rpm 823 kB/s | 151 kB 00:00 2024-09-17T05:39:38.623 INFO:teuthology.orchestra.run.smithi150.stdout:(114/157): python3-asyncssh-2.13.2-5.el9.noarch 16 MB/s | 548 kB 00:00 2024-09-17T05:39:38.648 INFO:teuthology.orchestra.run.smithi150.stdout:(115/157): python3-bcrypt-3.2.2-1.el9.x86_64.rp 1.7 MB/s | 43 kB 00:00 2024-09-17T05:39:38.673 INFO:teuthology.orchestra.run.smithi150.stdout:(116/157): python3-cachetools-4.2.4-1.el9.noarc 1.3 MB/s | 32 kB 00:00 2024-09-17T05:39:38.715 INFO:teuthology.orchestra.run.smithi150.stdout:(117/157): parquet-libs-9.0.0-11.el9.x86_64.rpm 5.1 MB/s | 839 kB 00:00 2024-09-17T05:39:38.741 INFO:teuthology.orchestra.run.smithi150.stdout:(118/157): python3-certifi-2023.05.07-4.el9.noa 211 kB/s | 14 kB 00:00 2024-09-17T05:39:38.766 INFO:teuthology.orchestra.run.smithi150.stdout:(119/157): python3-cheroot-8.6.0-4.el9.noarch.r 3.3 MB/s | 172 kB 00:00 2024-09-17T05:39:38.771 INFO:teuthology.orchestra.run.smithi176.stdout:(1/157): ceph-19.3.0-4989.gce1b342b.el9.x86_64. 52 kB/s | 6.6 kB 00:00 2024-09-17T05:39:38.800 INFO:teuthology.orchestra.run.smithi150.stdout:(120/157): python3-cherrypy-18.6.1-2.el9.noarch 5.9 MB/s | 358 kB 00:00 2024-09-17T05:39:38.825 INFO:teuthology.orchestra.run.smithi150.stdout:(121/157): python3-cmd2-2.4.2-2.el9.noarch.rpm 5.0 MB/s | 303 kB 00:00 2024-09-17T05:39:38.851 INFO:teuthology.orchestra.run.smithi150.stdout:(122/157): python3-google-auth-2.34.0-1.el9.noa 4.3 MB/s | 220 kB 00:00 2024-09-17T05:39:38.884 INFO:teuthology.orchestra.run.smithi150.stdout:(123/157): python3-grpcio-tools-1.46.7-10.el9.x 4.3 MB/s | 144 kB 00:00 2024-09-17T05:39:38.951 INFO:teuthology.orchestra.run.smithi150.stdout:(124/157): libarrow-9.0.0-11.el9.x86_64.rpm 6.8 MB/s | 4.4 MB 00:00 2024-09-17T05:39:38.963 INFO:teuthology.orchestra.run.smithi176.stdout:(2/157): ceph-fuse-19.3.0-4989.gce1b342b.el9.x8 4.5 MB/s | 873 kB 00:00 2024-09-17T05:39:38.976 INFO:teuthology.orchestra.run.smithi150.stdout:(125/157): python3-jaraco-8.2.1-3.el9.noarch.rp 116 kB/s | 11 kB 00:00 2024-09-17T05:39:39.001 INFO:teuthology.orchestra.run.smithi150.stdout:(126/157): python3-jaraco-classes-3.2.1-5.el9.n 351 kB/s | 18 kB 00:00 2024-09-17T05:39:39.027 INFO:teuthology.orchestra.run.smithi150.stdout:(127/157): python3-jaraco-collections-3.0.0-8.e 461 kB/s | 23 kB 00:00 2024-09-17T05:39:39.038 INFO:teuthology.orchestra.run.smithi176.stdout:(3/157): ceph-immutable-object-cache-19.3.0-498 1.9 MB/s | 148 kB 00:00 2024-09-17T05:39:39.052 INFO:teuthology.orchestra.run.smithi150.stdout:(128/157): python3-jaraco-functools-3.5.0-2.el9 387 kB/s | 19 kB 00:00 2024-09-17T05:39:39.078 INFO:teuthology.orchestra.run.smithi150.stdout:(129/157): python3-jaraco-text-3.2.0-6.el9.noar 390 kB/s | 20 kB 00:00 2024-09-17T05:39:39.111 INFO:teuthology.orchestra.run.smithi150.stdout:(130/157): python3-logutils-0.3.5-21.el9.noarch 1.4 MB/s | 46 kB 00:00 2024-09-17T05:39:39.137 INFO:teuthology.orchestra.run.smithi150.stdout:(131/157): python3-more-itertools-8.12.0-2.el9. 3.1 MB/s | 79 kB 00:00 2024-09-17T05:39:39.162 INFO:teuthology.orchestra.run.smithi150.stdout:(132/157): python3-natsort-7.1.1-5.el9.noarch.r 2.3 MB/s | 58 kB 00:00 2024-09-17T05:39:39.195 INFO:teuthology.orchestra.run.smithi150.stdout:(133/157): python3-kubernetes-26.1.0-2.el9.noar 7.2 MB/s | 1.0 MB 00:00 2024-09-17T05:39:39.214 INFO:teuthology.orchestra.run.smithi176.stdout:(4/157): ceph-base-19.3.0-4989.gce1b342b.el9.x8 9.7 MB/s | 5.5 MB 00:00 2024-09-17T05:39:39.220 INFO:teuthology.orchestra.run.smithi150.stdout:(134/157): python3-pecan-1.4.2-3.el9.noarch.rpm 4.5 MB/s | 272 kB 00:00 2024-09-17T05:39:39.246 INFO:teuthology.orchestra.run.smithi150.stdout:(135/157): python3-portend-3.1.0-2.el9.noarch.r 325 kB/s | 16 kB 00:00 2024-09-17T05:39:39.288 INFO:teuthology.orchestra.run.smithi150.stdout:(136/157): python3-grpcio-1.46.7-10.el9.x86_64. 4.4 MB/s | 2.0 MB 00:00 2024-09-17T05:39:39.297 INFO:teuthology.orchestra.run.smithi176.stdout:(5/157): ceph-mds-19.3.0-4989.gce1b342b.el9.x86 8.8 MB/s | 2.3 MB 00:00 2024-09-17T05:39:39.313 INFO:teuthology.orchestra.run.smithi150.stdout:(137/157): python3-pyperclip-1.8.2-2.el9.noarch 423 kB/s | 28 kB 00:00 2024-09-17T05:39:39.338 INFO:teuthology.orchestra.run.smithi150.stdout:(138/157): python3-repoze-lru-0.7-16.el9.noarch 614 kB/s | 31 kB 00:00 2024-09-17T05:39:39.363 INFO:teuthology.orchestra.run.smithi150.stdout:(139/157): python3-pyOpenSSL-21.0.0-1.el9.noarc 631 kB/s | 90 kB 00:00 2024-09-17T05:39:39.373 INFO:teuthology.orchestra.run.smithi176.stdout:(6/157): ceph-mgr-19.3.0-4989.gce1b342b.el9.x86 9.6 MB/s | 1.5 MB 00:00 2024-09-17T05:39:39.389 INFO:teuthology.orchestra.run.smithi150.stdout:(140/157): python3-rsa-4.9-2.el9.noarch.rpm 1.1 MB/s | 59 kB 00:00 2024-09-17T05:39:39.414 INFO:teuthology.orchestra.run.smithi150.stdout:(141/157): python3-tempora-5.0.0-2.el9.noarch.r 711 kB/s | 36 kB 00:00 2024-09-17T05:39:39.439 INFO:teuthology.orchestra.run.smithi150.stdout:(142/157): python3-typing-extensions-4.12.2-2.e 1.5 MB/s | 74 kB 00:00 2024-09-17T05:39:39.465 INFO:teuthology.orchestra.run.smithi150.stdout:(143/157): python3-routes-2.5.1-5.el9.noarch.rp 1.2 MB/s | 188 kB 00:00 2024-09-17T05:39:39.490 INFO:teuthology.orchestra.run.smithi150.stdout:(144/157): python3-websocket-client-1.2.3-2.el9 1.7 MB/s | 90 kB 00:00 2024-09-17T05:39:39.515 INFO:teuthology.orchestra.run.smithi150.stdout:(145/157): python3-zc-lockfile-2.0-10.el9.noarc 802 kB/s | 20 kB 00:00 2024-09-17T05:39:39.540 INFO:teuthology.orchestra.run.smithi150.stdout:(146/157): python3-webob-1.8.8-2.el9.noarch.rpm 1.8 MB/s | 230 kB 00:00 2024-09-17T05:39:39.566 INFO:teuthology.orchestra.run.smithi150.stdout:(147/157): re2-20211101-20.el9.x86_64.rpm 3.7 MB/s | 191 kB 00:00 2024-09-17T05:39:39.617 INFO:teuthology.orchestra.run.smithi150.stdout:(148/157): python3-werkzeug-2.0.3-3.el9.1.noarc 2.8 MB/s | 427 kB 00:00 2024-09-17T05:39:39.667 INFO:teuthology.orchestra.run.smithi150.stdout:(149/157): thrift-0.15.0-2.el9.x86_64.rpm 13 MB/s | 1.6 MB 00:00 2024-09-17T05:39:39.781 INFO:teuthology.orchestra.run.smithi176.stdout:(7/157): ceph-mon-19.3.0-4989.gce1b342b.el9.x86 10 MB/s | 5.0 MB 00:00 2024-09-17T05:39:40.007 INFO:teuthology.orchestra.run.smithi176.stdout:(8/157): ceph-common-19.3.0-4989.gce1b342b.el9. 15 MB/s | 20 MB 00:01 2024-09-17T05:39:40.065 INFO:teuthology.orchestra.run.smithi176.stdout:(9/157): ceph-selinux-19.3.0-4989.gce1b342b.el9 434 kB/s | 25 kB 00:00 2024-09-17T05:39:40.367 INFO:teuthology.orchestra.run.smithi150.stdout:(150/157): librbd1-19.3.0-4989.gce1b342b.el9.x8 4.2 MB/s | 3.2 MB 00:00 2024-09-17T05:39:40.566 INFO:teuthology.orchestra.run.smithi176.stdout:(10/157): ceph-osd-19.3.0-4989.gce1b342b.el9.x8 15 MB/s | 18 MB 00:01 2024-09-17T05:39:40.691 INFO:teuthology.orchestra.run.smithi176.stdout:(11/157): ceph-radosgw-19.3.0-4989.gce1b342b.el 11 MB/s | 10 MB 00:00 2024-09-17T05:39:40.716 INFO:teuthology.orchestra.run.smithi176.stdout:(12/157): cephfs-mirror-19.3.0-4989.gce1b342b.e 1.5 MB/s | 225 kB 00:00 2024-09-17T05:39:40.741 INFO:teuthology.orchestra.run.smithi176.stdout:(13/157): cephfs-shell-19.3.0-4989.gce1b342b.el 542 kB/s | 27 kB 00:00 2024-09-17T05:39:40.766 INFO:teuthology.orchestra.run.smithi176.stdout:(14/157): libcephfs-devel-19.3.0-4989.gce1b342b 633 kB/s | 32 kB 00:00 2024-09-17T05:39:40.825 INFO:teuthology.orchestra.run.smithi176.stdout:(15/157): libcephfs2-19.3.0-4989.gce1b342b.el9. 9.0 MB/s | 766 kB 00:00 2024-09-17T05:39:40.825 INFO:teuthology.orchestra.run.smithi150.stdout:(151/157): librados2-19.3.0-4989.gce1b342b.el9. 2.7 MB/s | 3.4 MB 00:01 2024-09-17T05:39:40.850 INFO:teuthology.orchestra.run.smithi176.stdout:(16/157): libcephsqlite-19.3.0-4989.gce1b342b.e 1.9 MB/s | 159 kB 00:00 2024-09-17T05:39:40.876 INFO:teuthology.orchestra.run.smithi176.stdout:(17/157): librados-devel-19.3.0-4989.gce1b342b. 2.5 MB/s | 127 kB 00:00 2024-09-17T05:39:40.909 INFO:teuthology.orchestra.run.smithi176.stdout:(18/157): libradosstriper1-19.3.0-4989.gce1b342 8.5 MB/s | 507 kB 00:00 2024-09-17T05:39:40.968 INFO:teuthology.orchestra.run.smithi176.stdout:(19/157): python3-ceph-argparse-19.3.0-4989.gce 774 kB/s | 45 kB 00:00 2024-09-17T05:39:41.026 INFO:teuthology.orchestra.run.smithi176.stdout:(20/157): python3-ceph-common-19.3.0-4989.gce1b 2.4 MB/s | 143 kB 00:00 2024-09-17T05:39:41.179 INFO:teuthology.orchestra.run.smithi176.stdout:(21/157): librgw2-19.3.0-4989.gce1b342b.el9.x86 17 MB/s | 5.3 MB 00:00 2024-09-17T05:39:41.204 INFO:teuthology.orchestra.run.smithi176.stdout:(22/157): python3-cephfs-19.3.0-4989.gce1b342b. 913 kB/s | 162 kB 00:00 2024-09-17T05:39:41.229 INFO:teuthology.orchestra.run.smithi176.stdout:(23/157): python3-rados-19.3.0-4989.gce1b342b.e 6.3 MB/s | 321 kB 00:00 2024-09-17T05:39:41.263 INFO:teuthology.orchestra.run.smithi176.stdout:(24/157): python3-rbd-19.3.0-4989.gce1b342b.el9 5.1 MB/s | 305 kB 00:00 2024-09-17T05:39:41.288 INFO:teuthology.orchestra.run.smithi176.stdout:(25/157): python3-rgw-19.3.0-4989.gce1b342b.el9 1.7 MB/s | 99 kB 00:00 2024-09-17T05:39:41.322 INFO:teuthology.orchestra.run.smithi176.stdout:(26/157): rbd-fuse-19.3.0-4989.gce1b342b.el9.x8 1.4 MB/s | 86 kB 00:00 2024-09-17T05:39:41.326 INFO:teuthology.orchestra.run.smithi150.stdout:(152/157): NetworkManager-team-1.51.0-1.el9.x86 82 kB/s | 41 kB 00:00 2024-09-17T05:39:41.389 INFO:teuthology.orchestra.run.smithi176.stdout:(27/157): rbd-nbd-19.3.0-4989.gce1b342b.el9.x86 2.5 MB/s | 170 kB 00:00 2024-09-17T05:39:41.464 INFO:teuthology.orchestra.run.smithi176.stdout:(28/157): rbd-mirror-19.3.0-4989.gce1b342b.el9. 18 MB/s | 3.1 MB 00:00 2024-09-17T05:39:41.490 INFO:teuthology.orchestra.run.smithi176.stdout:(29/157): ceph-grafana-dashboards-19.3.0-4989.g 342 kB/s | 34 kB 00:00 2024-09-17T05:39:41.515 INFO:teuthology.orchestra.run.smithi176.stdout:(30/157): ceph-mgr-cephadm-19.3.0-4989.gce1b342 3.0 MB/s | 154 kB 00:00 2024-09-17T05:39:41.668 INFO:teuthology.orchestra.run.smithi150.stdout:(153/157): NetworkManager-libnm-1.51.0-1.el9.x8 1.4 MB/s | 1.8 MB 00:01 2024-09-17T05:39:41.693 INFO:teuthology.orchestra.run.smithi150.stdout:(154/157): NetworkManager-tui-1.51.0-1.el9.x86_ 678 kB/s | 249 kB 00:00 2024-09-17T05:39:41.818 INFO:teuthology.orchestra.run.smithi150.stdout:(155/157): openssl-3.2.2-6.el9.x86_64.rpm 9.0 MB/s | 1.4 MB 00:00 2024-09-17T05:39:42.007 INFO:teuthology.orchestra.run.smithi176.stdout:(31/157): ceph-mgr-diskprediction-local-19.3.0- 15 MB/s | 7.4 MB 00:00 2024-09-17T05:39:42.099 INFO:teuthology.orchestra.run.smithi176.stdout:(32/157): ceph-mgr-modules-core-19.3.0-4989.gce 3.1 MB/s | 291 kB 00:00 2024-09-17T05:39:42.282 INFO:teuthology.orchestra.run.smithi176.stdout:(33/157): ceph-mgr-dashboard-19.3.0-4989.gce1b3 18 MB/s | 14 MB 00:00 2024-09-17T05:39:42.308 INFO:teuthology.orchestra.run.smithi176.stdout:(34/157): ceph-mgr-rook-19.3.0-4989.gce1b342b.e 236 kB/s | 49 kB 00:00 2024-09-17T05:39:42.333 INFO:teuthology.orchestra.run.smithi176.stdout:(35/157): ceph-prometheus-alerts-19.3.0-4989.gc 329 kB/s | 16 kB 00:00 2024-09-17T05:39:42.358 INFO:teuthology.orchestra.run.smithi176.stdout:(36/157): ceph-volume-19.3.0-4989.gce1b342b.el9 5.5 MB/s | 285 kB 00:00 2024-09-17T05:39:42.392 INFO:teuthology.orchestra.run.smithi176.stdout:(37/157): cephadm-19.3.0-4989.gce1b342b.el9.noa 13 MB/s | 784 kB 00:00 2024-09-17T05:39:42.417 INFO:teuthology.orchestra.run.smithi176.stdout:(38/157): cephfs-top-19.3.0-4989.gce1b342b.el9. 311 kB/s | 18 kB 00:00 2024-09-17T05:39:42.576 INFO:teuthology.orchestra.run.smithi176.stdout:(39/157): fuse-2.9.9-16.el9.x86_64.rpm 435 kB/s | 80 kB 00:00 2024-09-17T05:39:42.619 INFO:teuthology.orchestra.run.smithi150.stdout:(156/157): openssl-libs-3.2.2-6.el9.x86_64.rpm 2.6 MB/s | 2.4 MB 00:00 2024-09-17T05:39:42.668 INFO:teuthology.orchestra.run.smithi176.stdout:(40/157): libquadmath-11.5.0-2.el9.x86_64.rpm 2.0 MB/s | 191 kB 00:00 2024-09-17T05:39:43.060 INFO:teuthology.orchestra.run.smithi176.stdout:(41/157): ceph-test-19.3.0-4989.gce1b342b.el9.x 13 MB/s | 40 MB 00:02 2024-09-17T05:39:43.102 INFO:teuthology.orchestra.run.smithi176.stdout:(42/157): libgfortran-11.5.0-2.el9.x86_64.rpm 1.1 MB/s | 801 kB 00:00 2024-09-17T05:39:43.127 INFO:teuthology.orchestra.run.smithi176.stdout:(43/157): python3-cffi-1.14.5-5.el9.x86_64.rpm 552 kB/s | 253 kB 00:00 2024-09-17T05:39:43.169 INFO:teuthology.orchestra.run.smithi176.stdout:(44/157): python3-ply-3.11-14.el9.noarch.rpm 1.6 MB/s | 106 kB 00:00 2024-09-17T05:39:43.194 INFO:teuthology.orchestra.run.smithi176.stdout:(45/157): python3-pycparser-2.20-6.el9.noarch.r 2.0 MB/s | 135 kB 00:00 2024-09-17T05:39:43.236 INFO:teuthology.orchestra.run.smithi176.stdout:(46/157): python3-requests-2.25.1-8.el9.noarch. 1.8 MB/s | 125 kB 00:00 2024-09-17T05:39:43.261 INFO:teuthology.orchestra.run.smithi176.stdout:(47/157): python3-urllib3-1.26.5-6.el9.noarch.r 3.1 MB/s | 215 kB 00:00 2024-09-17T05:39:43.386 INFO:teuthology.orchestra.run.smithi176.stdout:(48/157): automake-1.16.2-8.el9.noarch.rpm 4.5 MB/s | 689 kB 00:00 2024-09-17T05:39:43.445 INFO:teuthology.orchestra.run.smithi176.stdout:(49/157): python3-cryptography-36.0.1-4.el9.x86 3.2 MB/s | 1.2 MB 00:00 2024-09-17T05:39:43.479 INFO:teuthology.orchestra.run.smithi176.stdout:(50/157): boost-program-options-1.75.0-8.el9.x8 1.1 MB/s | 107 kB 00:00 2024-09-17T05:39:43.521 INFO:teuthology.orchestra.run.smithi176.stdout:(51/157): bison-3.7.4-5.el9.x86_64.rpm 3.6 MB/s | 943 kB 00:00 2024-09-17T05:39:43.546 INFO:teuthology.orchestra.run.smithi176.stdout:(52/157): flex-2.6.4-9.el9.x86_64.rpm 4.6 MB/s | 313 kB 00:00 2024-09-17T05:39:43.571 INFO:teuthology.orchestra.run.smithi176.stdout:(53/157): elfutils-libelf-devel-0.191-4.el9.x86 172 kB/s | 22 kB 00:00 2024-09-17T05:39:43.597 INFO:teuthology.orchestra.run.smithi176.stdout:(54/157): flexiblas-3.0.4-8.el9.x86_64.rpm 434 kB/s | 33 kB 00:00 2024-09-17T05:39:43.672 INFO:teuthology.orchestra.run.smithi176.stdout:(55/157): flexiblas-netlib-3.0.4-8.el9.x86_64.r 24 MB/s | 3.0 MB 00:00 2024-09-17T05:39:43.697 INFO:teuthology.orchestra.run.smithi176.stdout:(56/157): libaio-devel-0.3.111-13.el9.x86_64.rp 111 kB/s | 11 kB 00:00 2024-09-17T05:39:43.722 INFO:teuthology.orchestra.run.smithi176.stdout:(57/157): flexiblas-openblas-openmp-3.0.4-8.el9 121 kB/s | 18 kB 00:00 2024-09-17T05:39:43.747 INFO:teuthology.orchestra.run.smithi176.stdout:(58/157): libnbd-1.20.2-2.el9.x86_64.rpm 2.2 MB/s | 171 kB 00:00 2024-09-17T05:39:43.773 INFO:teuthology.orchestra.run.smithi176.stdout:(59/157): libpmemobj-1.12.1-1.el9.x86_64.rpm 2.1 MB/s | 160 kB 00:00 2024-09-17T05:39:43.799 INFO:teuthology.orchestra.run.smithi176.stdout:(60/157): librabbitmq-0.11.0-7.el9.x86_64.rpm 600 kB/s | 45 kB 00:00 2024-09-17T05:39:43.832 INFO:teuthology.orchestra.run.smithi176.stdout:(61/157): librdkafka-1.6.1-102.el9.x86_64.rpm 7.7 MB/s | 662 kB 00:00 2024-09-17T05:39:43.865 INFO:teuthology.orchestra.run.smithi176.stdout:(62/157): libuuid-devel-2.37.4-20.el9.x86_64.rp 366 kB/s | 24 kB 00:00 2024-09-17T05:39:43.899 INFO:teuthology.orchestra.run.smithi176.stdout:(63/157): libtool-2.4.6-46.el9.x86_64.rpm 4.5 MB/s | 581 kB 00:00 2024-09-17T05:39:43.924 INFO:teuthology.orchestra.run.smithi176.stdout:(64/157): libzstd-devel-1.5.1-2.el9.x86_64.rpm 515 kB/s | 47 kB 00:00 2024-09-17T05:39:43.949 INFO:teuthology.orchestra.run.smithi176.stdout:(65/157): lttng-ust-2.12.0-6.el9.x86_64.rpm 3.4 MB/s | 292 kB 00:00 2024-09-17T05:39:43.975 INFO:teuthology.orchestra.run.smithi176.stdout:(66/157): lua-5.4.4-4.el9.x86_64.rpm 2.4 MB/s | 188 kB 00:00 2024-09-17T05:39:44.000 INFO:teuthology.orchestra.run.smithi176.stdout:(67/157): openblas-0.3.26-2.el9.x86_64.rpm 511 kB/s | 38 kB 00:00 2024-09-17T05:39:44.075 INFO:teuthology.orchestra.run.smithi176.stdout:(68/157): postgresql-13.16-1.el9.x86_64.rpm 21 MB/s | 1.6 MB 00:00 2024-09-17T05:39:44.151 INFO:teuthology.orchestra.run.smithi176.stdout:(69/157): openblas-openmp-0.3.26-2.el9.x86_64.r 25 MB/s | 4.9 MB 00:00 2024-09-17T05:39:44.184 INFO:teuthology.orchestra.run.smithi176.stdout:(70/157): postgresql-contrib-13.16-1.el9.x86_64 8.2 MB/s | 910 kB 00:00 2024-09-17T05:39:44.251 INFO:teuthology.orchestra.run.smithi176.stdout:(71/157): openssl-devel-3.2.2-6.el9.x86_64.rpm 16 MB/s | 4.4 MB 00:00 2024-09-17T05:39:44.276 INFO:teuthology.orchestra.run.smithi176.stdout:(72/157): postgresql-private-libs-13.16-1.el9.x 1.1 MB/s | 137 kB 00:00 2024-09-17T05:39:44.343 INFO:teuthology.orchestra.run.smithi150.stdout:(157/157): NetworkManager-1.51.0-1.el9.x86_64.r 508 kB/s | 2.3 MB 00:04 2024-09-17T05:39:44.350 INFO:teuthology.orchestra.run.smithi150.stdout:-------------------------------------------------------------------------------- 2024-09-17T05:39:44.350 INFO:teuthology.orchestra.run.smithi150.stdout:Total 13 MB/s | 228 MB 00:17 2024-09-17T05:39:44.368 INFO:teuthology.orchestra.run.smithi176.stdout:(73/157): postgresql-server-13.16-1.el9.x86_64. 31 MB/s | 5.8 MB 00:00 2024-09-17T05:39:44.385 INFO:teuthology.orchestra.run.smithi176.stdout:(74/157): python3-attrs-20.3.0-7.el9.noarch.rpm 806 kB/s | 87 kB 00:00 2024-09-17T05:39:44.419 INFO:teuthology.orchestra.run.smithi176.stdout:(75/157): protobuf-3.14.0-13.el9.x86_64.rpm 6.0 MB/s | 1.0 MB 00:00 2024-09-17T05:39:44.452 INFO:teuthology.orchestra.run.smithi176.stdout:(76/157): python3-colorama-0.4.6-3.el9.noarch.r 917 kB/s | 61 kB 00:00 2024-09-17T05:39:44.536 INFO:teuthology.orchestra.run.smithi176.stdout:(77/157): python3-babel-2.9.1-2.el9.noarch.rpm 36 MB/s | 6.0 MB 00:00 2024-09-17T05:39:44.561 INFO:teuthology.orchestra.run.smithi176.stdout:(78/157): python3-devel-3.9.19-8.el9.x86_64.rpm 1.7 MB/s | 245 kB 00:00 2024-09-17T05:39:44.587 INFO:teuthology.orchestra.run.smithi176.stdout:(79/157): python3-jinja2-2.11.3-6.el9.noarch.rp 1.8 MB/s | 248 kB 00:00 2024-09-17T05:39:44.603 INFO:teuthology.orchestra.run.smithi176.stdout:(80/157): python3-jsonpatch-1.21-16.el9.noarch. 383 kB/s | 26 kB 00:00 2024-09-17T05:39:44.629 INFO:teuthology.orchestra.run.smithi176.stdout:(81/157): python3-jsonpointer-2.0-4.el9.noarch. 284 kB/s | 19 kB 00:00 2024-09-17T05:39:44.654 INFO:teuthology.orchestra.run.smithi176.stdout:(82/157): python3-mako-1.1.4-6.el9.noarch.rpm 2.5 MB/s | 172 kB 00:00 2024-09-17T05:39:44.679 INFO:teuthology.orchestra.run.smithi176.stdout:(83/157): python3-markupsafe-1.1.1-12.el9.x86_6 458 kB/s | 35 kB 00:00 2024-09-17T05:39:44.721 INFO:teuthology.orchestra.run.smithi176.stdout:(84/157): python3-numpy-f2py-1.20.1-5.el9.x86_6 3.7 MB/s | 250 kB 00:00 2024-09-17T05:39:44.747 INFO:teuthology.orchestra.run.smithi176.stdout:(85/157): python3-oauthlib-3.1.1-5.el9.noarch.r 3.2 MB/s | 222 kB 00:00 2024-09-17T05:39:44.789 INFO:teuthology.orchestra.run.smithi176.stdout:(86/157): python3-packaging-20.9-5.el9.noarch.r 1.1 MB/s | 77 kB 00:00 2024-09-17T05:39:44.814 INFO:teuthology.orchestra.run.smithi176.stdout:(87/157): python3-prettytable-0.7.2-27.el9.noar 632 kB/s | 42 kB 00:00 2024-09-17T05:39:44.889 INFO:teuthology.orchestra.run.smithi176.stdout:(88/157): python3-numpy-1.20.1-5.el9.x86_64.rpm 20 MB/s | 5.1 MB 00:00 2024-09-17T05:39:44.914 INFO:teuthology.orchestra.run.smithi176.stdout:(89/157): python3-pyasn1-0.4.8-6.el9.noarch.rpm 1.5 MB/s | 159 kB 00:00 2024-09-17T05:39:44.940 INFO:teuthology.orchestra.run.smithi176.stdout:(90/157): python3-protobuf-3.14.0-13.el9.noarch 1.7 MB/s | 269 kB 00:00 2024-09-17T05:39:44.965 INFO:teuthology.orchestra.run.smithi176.stdout:(91/157): python3-pytz-2021.1-5.el9.noarch.rpm 1.0 MB/s | 51 kB 00:00 2024-09-17T05:39:44.990 INFO:teuthology.orchestra.run.smithi176.stdout:(92/157): python3-pyasn1-modules-0.4.8-6.el9.no 2.7 MB/s | 279 kB 00:00 2024-09-17T05:39:45.015 INFO:teuthology.orchestra.run.smithi176.stdout:(93/157): python3-requests-oauthlib-1.3.0-12.el 711 kB/s | 54 kB 00:00 2024-09-17T05:39:45.066 INFO:teuthology.orchestra.run.smithi176.stdout:(94/157): python3-toml-0.10.2-6.el9.noarch.rpm 553 kB/s | 42 kB 00:00 2024-09-17T05:39:45.091 INFO:teuthology.orchestra.run.smithi176.stdout:(95/157): python3-wcwidth-0.2.5-8.el9.noarch.rp 587 kB/s | 44 kB 00:00 2024-09-17T05:39:45.141 INFO:teuthology.orchestra.run.smithi176.stdout:(96/157): qatlib-24.02.0-1.el9.x86_64.rpm 2.9 MB/s | 221 kB 00:00 2024-09-17T05:39:45.166 INFO:teuthology.orchestra.run.smithi176.stdout:(97/157): qatlib-service-24.02.0-1.el9.x86_64.r 477 kB/s | 36 kB 00:00 2024-09-17T05:39:45.333 INFO:teuthology.orchestra.run.smithi176.stdout:(98/157): python3-scipy-1.6.2-8.el9.x86_64.rpm 44 MB/s | 16 MB 00:00 2024-09-17T05:39:45.358 INFO:teuthology.orchestra.run.smithi176.stdout:(99/157): qatzip-libs-1.2.0-1.el9.x86_64.rpm 218 kB/s | 47 kB 00:00 2024-09-17T05:39:45.384 INFO:teuthology.orchestra.run.smithi176.stdout:(100/157): socat-1.7.4.1-6.el9.x86_64.rpm 1.4 MB/s | 304 kB 00:00 2024-09-17T05:39:45.409 INFO:teuthology.orchestra.run.smithi176.stdout:(101/157): uuid-1.6.2-55.el9.x86_64.rpm 769 kB/s | 58 kB 00:00 2024-09-17T05:39:45.434 INFO:teuthology.orchestra.run.smithi176.stdout:(102/157): xfsprogs-devel-6.4.0-4.el9.x86_64.rp 1.2 MB/s | 96 kB 00:00 2024-09-17T05:39:45.451 INFO:teuthology.orchestra.run.smithi176.stdout:(103/157): xmlstarlet-1.6.1-20.el9.x86_64.rpm 948 kB/s | 64 kB 00:00 2024-09-17T05:39:45.468 INFO:teuthology.orchestra.run.smithi176.stdout:(104/157): zlib-devel-1.2.11-41.el9.x86_64.rpm 763 kB/s | 45 kB 00:00 2024-09-17T05:39:45.560 INFO:teuthology.orchestra.run.smithi176.stdout:(105/157): abseil-cpp-20211102.0-3.el9.x86_64.r 5.9 MB/s | 548 kB 00:00 2024-09-17T05:39:45.568 INFO:teuthology.orchestra.run.smithi150.stdout:Running transaction check 2024-09-17T05:39:45.602 INFO:teuthology.orchestra.run.smithi176.stdout:(106/157): gperftools-libs-2.9.1-3.el9.x86_64.r 7.2 MB/s | 308 kB 00:00 2024-09-17T05:39:45.619 INFO:teuthology.orchestra.run.smithi176.stdout:(107/157): grpc-data-1.46.7-10.el9.noarch.rpm 1.1 MB/s | 19 kB 00:00 2024-09-17T05:39:45.721 INFO:teuthology.orchestra.run.smithi150.stdout:Transaction check succeeded. 2024-09-17T05:39:45.721 INFO:teuthology.orchestra.run.smithi150.stdout:Running transaction test 2024-09-17T05:39:45.761 INFO:teuthology.orchestra.run.smithi176.stdout:(108/157): lua-devel-5.4.4-4.el9.x86_64.rpm 68 kB/s | 22 kB 00:00 2024-09-17T05:39:45.811 INFO:teuthology.orchestra.run.smithi176.stdout:(109/157): libarrow-doc-9.0.0-11.el9.noarch.rpm 522 kB/s | 26 kB 00:00 2024-09-17T05:39:45.845 INFO:teuthology.orchestra.run.smithi176.stdout:(110/157): liboath-2.6.7-2.el9.x86_64.rpm 1.4 MB/s | 49 kB 00:00 2024-09-17T05:39:45.924 INFO:teuthology.orchestra.run.smithi176.stdout:(111/157): libarrow-9.0.0-11.el9.x86_64.rpm 14 MB/s | 4.4 MB 00:00 2024-09-17T05:39:45.954 INFO:teuthology.orchestra.run.smithi176.stdout:(112/157): libunwind-1.6.2-1.el9.x86_64.rpm 619 kB/s | 67 kB 00:00 2024-09-17T05:39:45.979 INFO:teuthology.orchestra.run.smithi176.stdout:(113/157): luarocks-3.9.2-5.el9.noarch.rpm 2.7 MB/s | 151 kB 00:00 2024-09-17T05:39:46.021 INFO:teuthology.orchestra.run.smithi176.stdout:(114/157): python3-asyncssh-2.13.2-5.el9.noarch 13 MB/s | 548 kB 00:00 2024-09-17T05:39:46.046 INFO:teuthology.orchestra.run.smithi176.stdout:(115/157): python3-bcrypt-3.2.2-1.el9.x86_64.rp 1.7 MB/s | 43 kB 00:00 2024-09-17T05:39:46.080 INFO:teuthology.orchestra.run.smithi176.stdout:(116/157): parquet-libs-9.0.0-11.el9.x86_64.rpm 6.5 MB/s | 839 kB 00:00 2024-09-17T05:39:46.105 INFO:teuthology.orchestra.run.smithi176.stdout:(117/157): python3-cachetools-4.2.4-1.el9.noarc 550 kB/s | 32 kB 00:00 2024-09-17T05:39:46.130 INFO:teuthology.orchestra.run.smithi176.stdout:(118/157): python3-certifi-2023.05.07-4.el9.noa 280 kB/s | 14 kB 00:00 2024-09-17T05:39:46.156 INFO:teuthology.orchestra.run.smithi176.stdout:(119/157): python3-cheroot-8.6.0-4.el9.noarch.r 3.3 MB/s | 172 kB 00:00 2024-09-17T05:39:46.239 INFO:teuthology.orchestra.run.smithi176.stdout:(120/157): python3-cherrypy-18.6.1-2.el9.noarch 3.2 MB/s | 358 kB 00:00 2024-09-17T05:39:46.265 INFO:teuthology.orchestra.run.smithi176.stdout:(121/157): python3-cmd2-2.4.2-2.el9.noarch.rpm 2.7 MB/s | 303 kB 00:00 2024-09-17T05:39:46.290 INFO:teuthology.orchestra.run.smithi176.stdout:(122/157): python3-google-auth-2.34.0-1.el9.noa 4.3 MB/s | 220 kB 00:00 2024-09-17T05:39:46.323 INFO:teuthology.orchestra.run.smithi176.stdout:(123/157): python3-grpcio-tools-1.46.7-10.el9.x 4.2 MB/s | 144 kB 00:00 2024-09-17T05:39:46.365 INFO:teuthology.orchestra.run.smithi176.stdout:(124/157): protobuf-compiler-3.14.0-13.el9.x86_ 945 kB/s | 863 kB 00:00 2024-09-17T05:39:46.391 INFO:teuthology.orchestra.run.smithi176.stdout:(125/157): python3-jaraco-8.2.1-3.el9.noarch.rp 160 kB/s | 11 kB 00:00 2024-09-17T05:39:46.424 INFO:teuthology.orchestra.run.smithi176.stdout:(126/157): python3-jaraco-collections-3.0.0-8.e 915 kB/s | 23 kB 00:00 2024-09-17T05:39:46.449 INFO:teuthology.orchestra.run.smithi176.stdout:(127/157): python3-jaraco-functools-3.5.0-2.el9 841 kB/s | 19 kB 00:00 2024-09-17T05:39:46.475 INFO:teuthology.orchestra.run.smithi176.stdout:(128/157): python3-jaraco-classes-3.2.1-5.el9.n 162 kB/s | 18 kB 00:00 2024-09-17T05:39:46.500 INFO:teuthology.orchestra.run.smithi176.stdout:(129/157): python3-jaraco-text-3.2.0-6.el9.noar 392 kB/s | 20 kB 00:00 2024-09-17T05:39:46.525 INFO:teuthology.orchestra.run.smithi176.stdout:(130/157): python3-logutils-0.3.5-21.el9.noarch 1.8 MB/s | 46 kB 00:00 2024-09-17T05:39:46.550 INFO:teuthology.orchestra.run.smithi176.stdout:(131/157): python3-more-itertools-8.12.0-2.el9. 3.1 MB/s | 79 kB 00:00 2024-09-17T05:39:46.576 INFO:teuthology.orchestra.run.smithi176.stdout:(132/157): python3-natsort-7.1.1-5.el9.noarch.r 2.3 MB/s | 58 kB 00:00 2024-09-17T05:39:46.609 INFO:teuthology.orchestra.run.smithi176.stdout:(133/157): python3-pecan-1.4.2-3.el9.noarch.rpm 8.0 MB/s | 272 kB 00:00 2024-09-17T05:39:46.635 INFO:teuthology.orchestra.run.smithi176.stdout:(134/157): python3-portend-3.1.0-2.el9.noarch.r 664 kB/s | 16 kB 00:00 2024-09-17T05:39:46.746 INFO:teuthology.orchestra.run.smithi176.stdout:(135/157): python3-grpcio-1.46.7-10.el9.x86_64. 4.2 MB/s | 2.0 MB 00:00 2024-09-17T05:39:46.769 INFO:teuthology.orchestra.run.smithi176.stdout:(136/157): python3-pyOpenSSL-21.0.0-1.el9.noarc 674 kB/s | 90 kB 00:00 2024-09-17T05:39:46.794 INFO:teuthology.orchestra.run.smithi176.stdout:(137/157): python3-pyperclip-1.8.2-2.el9.noarch 594 kB/s | 28 kB 00:00 2024-09-17T05:39:46.828 INFO:teuthology.orchestra.run.smithi176.stdout:(138/157): python3-kubernetes-26.1.0-2.el9.noar 2.9 MB/s | 1.0 MB 00:00 2024-09-17T05:39:46.853 INFO:teuthology.orchestra.run.smithi176.stdout:(139/157): python3-repoze-lru-0.7-16.el9.noarch 367 kB/s | 31 kB 00:00 2024-09-17T05:39:46.878 INFO:teuthology.orchestra.run.smithi176.stdout:(140/157): python3-rsa-4.9-2.el9.noarch.rpm 1.2 MB/s | 59 kB 00:00 2024-09-17T05:39:46.903 INFO:teuthology.orchestra.run.smithi176.stdout:(141/157): python3-tempora-5.0.0-2.el9.noarch.r 716 kB/s | 36 kB 00:00 2024-09-17T05:39:46.928 INFO:teuthology.orchestra.run.smithi176.stdout:(142/157): python3-typing-extensions-4.12.2-2.e 1.4 MB/s | 74 kB 00:00 2024-09-17T05:39:46.954 INFO:teuthology.orchestra.run.smithi176.stdout:(143/157): python3-routes-2.5.1-5.el9.noarch.rp 1.2 MB/s | 188 kB 00:00 2024-09-17T05:39:46.979 INFO:teuthology.orchestra.run.smithi176.stdout:(144/157): python3-websocket-client-1.2.3-2.el9 1.7 MB/s | 90 kB 00:00 2024-09-17T05:39:46.996 INFO:teuthology.orchestra.run.smithi176.stdout:(145/157): python3-zc-lockfile-2.0-10.el9.noarc 1.2 MB/s | 20 kB 00:00 2024-09-17T05:39:47.021 INFO:teuthology.orchestra.run.smithi176.stdout:(146/157): python3-webob-1.8.8-2.el9.noarch.rpm 1.9 MB/s | 230 kB 00:00 2024-09-17T05:39:47.046 INFO:teuthology.orchestra.run.smithi176.stdout:(147/157): re2-20211101-20.el9.x86_64.rpm 3.7 MB/s | 191 kB 00:00 2024-09-17T05:39:47.072 INFO:teuthology.orchestra.run.smithi176.stdout:(148/157): python3-werkzeug-2.0.3-3.el9.1.noarc 3.5 MB/s | 427 kB 00:00 2024-09-17T05:39:47.139 INFO:teuthology.orchestra.run.smithi176.stdout:(149/157): thrift-0.15.0-2.el9.x86_64.rpm 14 MB/s | 1.6 MB 00:00 2024-09-17T05:39:47.314 INFO:teuthology.orchestra.run.smithi176.stdout:(150/157): librados2-19.3.0-4989.gce1b342b.el9. 13 MB/s | 3.4 MB 00:00 2024-09-17T05:39:47.456 INFO:teuthology.orchestra.run.smithi176.stdout:(151/157): librbd1-19.3.0-4989.gce1b342b.el9.x8 8.2 MB/s | 3.2 MB 00:00 2024-09-17T05:39:47.606 INFO:teuthology.orchestra.run.smithi176.stdout:(152/157): NetworkManager-team-1.51.0-1.el9.x86 273 kB/s | 41 kB 00:00 2024-09-17T05:39:47.756 INFO:teuthology.orchestra.run.smithi176.stdout:(153/157): NetworkManager-tui-1.51.0-1.el9.x86_ 1.6 MB/s | 249 kB 00:00 2024-09-17T05:39:47.790 INFO:teuthology.orchestra.run.smithi176.stdout:(154/157): NetworkManager-libnm-1.51.0-1.el9.x8 3.8 MB/s | 1.8 MB 00:00 2024-09-17T05:39:47.924 INFO:teuthology.orchestra.run.smithi176.stdout:(155/157): NetworkManager-1.51.0-1.el9.x86_64.r 3.0 MB/s | 2.3 MB 00:00 2024-09-17T05:39:47.978 INFO:teuthology.orchestra.run.smithi150.stdout:Transaction test succeeded. 2024-09-17T05:39:47.979 INFO:teuthology.orchestra.run.smithi150.stdout:Running transaction 2024-09-17T05:39:48.507 INFO:teuthology.orchestra.run.smithi176.stdout:(156/157): openssl-libs-3.2.2-6.el9.x86_64.rpm 3.3 MB/s | 2.4 MB 00:00 2024-09-17T05:39:48.549 INFO:teuthology.orchestra.run.smithi176.stdout:(157/157): openssl-3.2.2-6.el9.x86_64.rpm 1.7 MB/s | 1.4 MB 00:00 2024-09-17T05:39:48.554 INFO:teuthology.orchestra.run.smithi176.stdout:-------------------------------------------------------------------------------- 2024-09-17T05:39:48.555 INFO:teuthology.orchestra.run.smithi176.stdout:Total 23 MB/s | 228 MB 00:10 2024-09-17T05:39:49.753 INFO:teuthology.orchestra.run.smithi176.stdout:Running transaction check 2024-09-17T05:39:49.905 INFO:teuthology.orchestra.run.smithi176.stdout:Transaction check succeeded. 2024-09-17T05:39:49.905 INFO:teuthology.orchestra.run.smithi176.stdout:Running transaction test 2024-09-17T05:39:52.134 INFO:teuthology.orchestra.run.smithi176.stdout:Transaction test succeeded. 2024-09-17T05:39:52.134 INFO:teuthology.orchestra.run.smithi176.stdout:Running transaction 2024-09-17T05:39:54.399 INFO:teuthology.orchestra.run.smithi150.stdout: Preparing : 1/1 2024-09-17T05:39:54.540 INFO:teuthology.orchestra.run.smithi150.stdout: Upgrading : openssl-libs-1:3.2.2-6.el9.x86_64 1/165 2024-09-17T05:39:54.578 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/165 2024-09-17T05:39:54.640 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/165 2024-09-17T05:39:54.673 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/165 2024-09-17T05:39:54.699 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/165 2024-09-17T05:39:54.746 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/165 2024-09-17T05:39:55.084 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/165 2024-09-17T05:39:55.208 INFO:teuthology.orchestra.run.smithi150.stdout: Upgrading : librados2-2:19.3.0-4989.gce1b342b.el9.x86_64 8/165 2024-09-17T05:39:55.317 INFO:teuthology.orchestra.run.smithi150.stdout: Running scriptlet: librados2-2:19.3.0-4989.gce1b342b.el9.x86_64 8/165 2024-09-17T05:39:55.351 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : libcephfs2-2:19.3.0-4989.gce1b342b.el9.x86_64 9/165 2024-09-17T05:39:55.443 INFO:teuthology.orchestra.run.smithi150.stdout: Running scriptlet: libcephfs2-2:19.3.0-4989.gce1b342b.el9.x86_64 9/165 2024-09-17T05:39:55.481 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-rados-2:19.3.0-4989.gce1b342b.el9.x86_64 10/165 2024-09-17T05:39:55.520 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : postgresql-private-libs-13.16-1.el9.x86_64 11/165 2024-09-17T05:39:55.690 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : libnbd-1.20.2-2.el9.x86_64 12/165 2024-09-17T05:39:55.745 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : postgresql-13.16-1.el9.x86_64 13/165 2024-09-17T05:39:55.781 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : libcephsqlite-2:19.3.0-4989.gce1b342b.el9.x86_64 14/165 2024-09-17T05:39:55.878 INFO:teuthology.orchestra.run.smithi150.stdout: Running scriptlet: libcephsqlite-2:19.3.0-4989.gce1b342b.el9.x86_64 14/165 2024-09-17T05:39:55.915 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : libradosstriper1-2:19.3.0-4989.gce1b342b.el9.x86 15/165 2024-09-17T05:39:55.967 INFO:teuthology.orchestra.run.smithi150.stdout: Running scriptlet: libradosstriper1-2:19.3.0-4989.gce1b342b.el9.x86 15/165 2024-09-17T05:39:56.000 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 16/165 2024-09-17T05:39:56.026 INFO:teuthology.orchestra.run.smithi150.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 16/165 2024-09-17T05:39:56.227 INFO:teuthology.orchestra.run.smithi150.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 17/165 2024-09-17T05:39:56.409 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 17/165 2024-09-17T05:39:56.539 INFO:teuthology.orchestra.run.smithi150.stdout: Upgrading : NetworkManager-libnm-1:1.51.0-1.el9.x86_64 18/165 2024-09-17T05:39:56.662 INFO:teuthology.orchestra.run.smithi150.stdout: Running scriptlet: NetworkManager-1:1.51.0-1.el9.x86_64 19/165 2024-09-17T05:39:56.732 INFO:teuthology.orchestra.run.smithi150.stdout: Upgrading : NetworkManager-1:1.51.0-1.el9.x86_64 19/165 2024-09-17T05:39:56.981 INFO:teuthology.orchestra.run.smithi150.stdout: Running scriptlet: NetworkManager-1:1.51.0-1.el9.x86_64 19/165 2024-09-17T05:39:57.089 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : re2-1:20211101-20.el9.x86_64 20/165 2024-09-17T05:39:57.120 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 21/165 2024-09-17T05:39:57.155 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : liboath-2.6.7-2.el9.x86_64 22/165 2024-09-17T05:39:57.228 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 23/165 2024-09-17T05:39:57.272 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 24/165 2024-09-17T05:39:57.305 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-packaging-20.9-5.el9.noarch 25/165 2024-09-17T05:39:57.347 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 26/165 2024-09-17T05:39:57.381 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 27/165 2024-09-17T05:39:57.417 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : lua-5.4.4-4.el9.x86_64 28/165 2024-09-17T05:39:57.484 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 29/165 2024-09-17T05:39:57.540 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 30/165 2024-09-17T05:39:57.571 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 31/165 2024-09-17T05:39:57.614 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 32/165 2024-09-17T05:39:57.700 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 33/165 2024-09-17T05:39:57.733 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-ceph-common-2:19.3.0-4989.gce1b342b.el9. 34/165 2024-09-17T05:39:57.777 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-ceph-argparse-2:19.3.0-4989.gce1b342b.el 35/165 2024-09-17T05:39:57.805 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-cephfs-2:19.3.0-4989.gce1b342b.el9.x86_6 36/165 2024-09-17T05:39:57.876 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 37/165 2024-09-17T05:39:57.929 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : luarocks-3.9.2-5.el9.noarch 38/165 2024-09-17T05:39:58.027 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 39/165 2024-09-17T05:39:58.164 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 40/165 2024-09-17T05:39:58.214 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 41/165 2024-09-17T05:39:58.511 INFO:teuthology.orchestra.run.smithi176.stdout: Preparing : 1/1 2024-09-17T05:39:58.645 INFO:teuthology.orchestra.run.smithi176.stdout: Upgrading : openssl-libs-1:3.2.2-6.el9.x86_64 1/165 2024-09-17T05:39:58.757 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-rsa-4.9-2.el9.noarch 42/165 2024-09-17T05:39:58.795 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/165 2024-09-17T05:39:58.842 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 43/165 2024-09-17T05:39:58.872 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 44/165 2024-09-17T05:39:58.915 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 45/165 2024-09-17T05:39:58.922 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/165 2024-09-17T05:39:58.953 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : librados-devel-2:19.3.0-4989.gce1b342b.el9.x86_6 46/165 2024-09-17T05:39:58.963 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/165 2024-09-17T05:39:58.987 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/165 2024-09-17T05:39:58.994 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 47/165 2024-09-17T05:39:59.042 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/165 2024-09-17T05:39:59.149 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 48/165 2024-09-17T05:39:59.198 INFO:teuthology.orchestra.run.smithi150.stdout: Upgrading : openssl-1:3.2.2-6.el9.x86_64 49/165 2024-09-17T05:39:59.298 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 50/165 2024-09-17T05:39:59.370 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 51/165 2024-09-17T05:39:59.384 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/165 2024-09-17T05:39:59.443 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 52/165 2024-09-17T05:39:59.475 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 53/165 2024-09-17T05:39:59.510 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 54/165 2024-09-17T05:39:59.513 INFO:teuthology.orchestra.run.smithi176.stdout: Upgrading : librados2-2:19.3.0-4989.gce1b342b.el9.x86_64 8/165 2024-09-17T05:39:59.625 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 55/165 2024-09-17T05:39:59.640 INFO:teuthology.orchestra.run.smithi176.stdout: Running scriptlet: librados2-2:19.3.0-4989.gce1b342b.el9.x86_64 8/165 2024-09-17T05:39:59.665 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : libcephfs2-2:19.3.0-4989.gce1b342b.el9.x86_64 9/165 2024-09-17T05:39:59.756 INFO:teuthology.orchestra.run.smithi176.stdout: Running scriptlet: libcephfs2-2:19.3.0-4989.gce1b342b.el9.x86_64 9/165 2024-09-17T05:39:59.794 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-rados-2:19.3.0-4989.gce1b342b.el9.x86_64 10/165 2024-09-17T05:39:59.825 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : postgresql-private-libs-13.16-1.el9.x86_64 11/165 2024-09-17T05:39:59.899 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 56/165 2024-09-17T05:39:59.937 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 57/165 2024-09-17T05:39:59.987 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 58/165 2024-09-17T05:40:00.005 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : libnbd-1.20.2-2.el9.x86_64 12/165 2024-09-17T05:40:00.058 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : postgresql-13.16-1.el9.x86_64 13/165 2024-09-17T05:40:00.095 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : libcephsqlite-2:19.3.0-4989.gce1b342b.el9.x86_64 14/165 2024-09-17T05:40:00.132 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 59/165 2024-09-17T05:40:00.192 INFO:teuthology.orchestra.run.smithi176.stdout: Running scriptlet: libcephsqlite-2:19.3.0-4989.gce1b342b.el9.x86_64 14/165 2024-09-17T05:40:00.221 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : libradosstriper1-2:19.3.0-4989.gce1b342b.el9.x86 15/165 2024-09-17T05:40:00.288 INFO:teuthology.orchestra.run.smithi176.stdout: Running scriptlet: libradosstriper1-2:19.3.0-4989.gce1b342b.el9.x86 15/165 2024-09-17T05:40:00.297 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 60/165 2024-09-17T05:40:00.314 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 16/165 2024-09-17T05:40:00.339 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 61/165 2024-09-17T05:40:00.350 INFO:teuthology.orchestra.run.smithi176.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 16/165 2024-09-17T05:40:00.443 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 62/165 2024-09-17T05:40:00.481 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 63/165 2024-09-17T05:40:00.522 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 64/165 2024-09-17T05:40:00.556 INFO:teuthology.orchestra.run.smithi176.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 17/165 2024-09-17T05:40:00.562 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : gperftools-libs-2.9.1-3.el9.x86_64 65/165 2024-09-17T05:40:00.591 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 66/165 2024-09-17T05:40:00.702 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 67/165 2024-09-17T05:40:00.725 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 17/165 2024-09-17T05:40:00.827 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 68/165 2024-09-17T05:40:00.865 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 69/165 2024-09-17T05:40:00.870 INFO:teuthology.orchestra.run.smithi176.stdout: Upgrading : NetworkManager-libnm-1:1.51.0-1.el9.x86_64 18/165 2024-09-17T05:40:00.901 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 70/165 2024-09-17T05:40:00.935 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 71/165 2024-09-17T05:40:00.974 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : uuid-1.6.2-55.el9.x86_64 72/165 2024-09-17T05:40:00.997 INFO:teuthology.orchestra.run.smithi176.stdout: Running scriptlet: NetworkManager-1:1.51.0-1.el9.x86_64 19/165 2024-09-17T05:40:01.006 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 73/165 2024-09-17T05:40:01.036 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 74/165 2024-09-17T05:40:01.070 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 75/165 2024-09-17T05:40:01.080 INFO:teuthology.orchestra.run.smithi176.stdout: Upgrading : NetworkManager-1:1.51.0-1.el9.x86_64 19/165 2024-09-17T05:40:01.104 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 76/165 2024-09-17T05:40:01.145 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 77/165 2024-09-17T05:40:01.188 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 78/165 2024-09-17T05:40:01.275 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 79/165 2024-09-17T05:40:01.311 INFO:teuthology.orchestra.run.smithi176.stdout: Running scriptlet: NetworkManager-1:1.51.0-1.el9.x86_64 19/165 2024-09-17T05:40:01.326 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 80/165 2024-09-17T05:40:01.358 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 81/165 2024-09-17T05:40:01.430 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : re2-1:20211101-20.el9.x86_64 20/165 2024-09-17T05:40:01.460 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 21/165 2024-09-17T05:40:01.461 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 82/165 2024-09-17T05:40:01.494 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : liboath-2.6.7-2.el9.x86_64 22/165 2024-09-17T05:40:01.517 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 83/165 2024-09-17T05:40:01.568 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 23/165 2024-09-17T05:40:01.612 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 24/165 2024-09-17T05:40:01.652 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-packaging-20.9-5.el9.noarch 25/165 2024-09-17T05:40:01.695 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 26/165 2024-09-17T05:40:01.729 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 27/165 2024-09-17T05:40:01.764 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : lua-5.4.4-4.el9.x86_64 28/165 2024-09-17T05:40:01.833 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 29/165 2024-09-17T05:40:01.887 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 30/165 2024-09-17T05:40:01.918 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 31/165 2024-09-17T05:40:01.961 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 32/165 2024-09-17T05:40:02.038 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 33/165 2024-09-17T05:40:02.071 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-ceph-common-2:19.3.0-4989.gce1b342b.el9. 34/165 2024-09-17T05:40:02.106 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-ceph-argparse-2:19.3.0-4989.gce1b342b.el 35/165 2024-09-17T05:40:02.135 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-cephfs-2:19.3.0-4989.gce1b342b.el9.x86_6 36/165 2024-09-17T05:40:02.204 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 37/165 2024-09-17T05:40:02.242 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 84/165 2024-09-17T05:40:02.249 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : luarocks-3.9.2-5.el9.noarch 38/165 2024-09-17T05:40:02.297 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 85/165 2024-09-17T05:40:02.324 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 39/165 2024-09-17T05:40:02.340 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 86/165 2024-09-17T05:40:02.440 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 87/165 2024-09-17T05:40:02.456 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 40/165 2024-09-17T05:40:02.495 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 88/165 2024-09-17T05:40:02.509 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 41/165 2024-09-17T05:40:02.540 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-colorama-0.4.6-3.el9.noarch 89/165 2024-09-17T05:40:02.627 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 90/165 2024-09-17T05:40:02.676 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 91/165 2024-09-17T05:40:02.861 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : openblas-0.3.26-2.el9.x86_64 92/165 2024-09-17T05:40:02.899 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 93/165 2024-09-17T05:40:02.976 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 94/165 2024-09-17T05:40:03.033 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-rsa-4.9-2.el9.noarch 42/165 2024-09-17T05:40:03.114 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 43/165 2024-09-17T05:40:03.143 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 44/165 2024-09-17T05:40:03.186 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 45/165 2024-09-17T05:40:03.224 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : librados-devel-2:19.3.0-4989.gce1b342b.el9.x86_6 46/165 2024-09-17T05:40:03.269 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 47/165 2024-09-17T05:40:03.434 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 48/165 2024-09-17T05:40:03.502 INFO:teuthology.orchestra.run.smithi176.stdout: Upgrading : openssl-1:3.2.2-6.el9.x86_64 49/165 2024-09-17T05:40:03.593 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 50/165 2024-09-17T05:40:03.624 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 95/165 2024-09-17T05:40:03.649 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 51/165 2024-09-17T05:40:03.722 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 52/165 2024-09-17T05:40:03.747 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 96/165 2024-09-17T05:40:03.754 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 53/165 2024-09-17T05:40:03.790 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 54/165 2024-09-17T05:40:03.836 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 55/165 2024-09-17T05:40:03.872 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 56/165 2024-09-17T05:40:03.916 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 57/165 2024-09-17T05:40:03.957 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 58/165 2024-09-17T05:40:04.094 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 59/165 2024-09-17T05:40:04.318 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 60/165 2024-09-17T05:40:04.360 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 61/165 2024-09-17T05:40:04.461 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 62/165 2024-09-17T05:40:04.493 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 63/165 2024-09-17T05:40:04.534 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 64/165 2024-09-17T05:40:04.558 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : gperftools-libs-2.9.1-3.el9.x86_64 65/165 2024-09-17T05:40:04.583 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 66/165 2024-09-17T05:40:04.679 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 67/165 2024-09-17T05:40:04.810 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 68/165 2024-09-17T05:40:04.844 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 69/165 2024-09-17T05:40:04.872 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 70/165 2024-09-17T05:40:04.906 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 71/165 2024-09-17T05:40:04.945 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : uuid-1.6.2-55.el9.x86_64 72/165 2024-09-17T05:40:04.977 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 73/165 2024-09-17T05:40:05.006 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 74/165 2024-09-17T05:40:05.009 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 97/165 2024-09-17T05:40:05.041 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 75/165 2024-09-17T05:40:05.074 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 76/165 2024-09-17T05:40:05.102 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 98/165 2024-09-17T05:40:05.115 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 77/165 2024-09-17T05:40:05.130 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 99/165 2024-09-17T05:40:05.158 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 78/165 2024-09-17T05:40:05.163 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : libuuid-devel-2.37.4-20.el9.x86_64 100/165 2024-09-17T05:40:05.244 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 79/165 2024-09-17T05:40:05.289 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 80/165 2024-09-17T05:40:05.328 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 81/165 2024-09-17T05:40:05.431 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 82/165 2024-09-17T05:40:05.479 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 83/165 2024-09-17T05:40:05.489 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 101/165 2024-09-17T05:40:05.543 INFO:teuthology.orchestra.run.smithi150.stdout: Upgrading : librbd1-2:19.3.0-4989.gce1b342b.el9.x86_64 102/165 2024-09-17T05:40:05.642 INFO:teuthology.orchestra.run.smithi150.stdout: Running scriptlet: librbd1-2:19.3.0-4989.gce1b342b.el9.x86_64 102/165 2024-09-17T05:40:05.673 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-rbd-2:19.3.0-4989.gce1b342b.el9.x86_64 103/165 2024-09-17T05:40:05.709 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 104/165 2024-09-17T05:40:06.187 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 84/165 2024-09-17T05:40:06.220 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 105/165 2024-09-17T05:40:06.234 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 85/165 2024-09-17T05:40:06.254 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : librgw2-2:19.3.0-4989.gce1b342b.el9.x86_64 106/165 2024-09-17T05:40:06.268 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 86/165 2024-09-17T05:40:06.309 INFO:teuthology.orchestra.run.smithi150.stdout: Running scriptlet: librgw2-2:19.3.0-4989.gce1b342b.el9.x86_64 106/165 2024-09-17T05:40:06.331 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-rgw-2:19.3.0-4989.gce1b342b.el9.x86_64 107/165 2024-09-17T05:40:06.366 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 87/165 2024-09-17T05:40:06.423 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 88/165 2024-09-17T05:40:06.468 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-colorama-0.4.6-3.el9.noarch 89/165 2024-09-17T05:40:06.558 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 90/165 2024-09-17T05:40:06.587 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 91/165 2024-09-17T05:40:06.772 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : openblas-0.3.26-2.el9.x86_64 92/165 2024-09-17T05:40:06.802 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 93/165 2024-09-17T05:40:06.879 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 94/165 2024-09-17T05:40:07.536 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 95/165 2024-09-17T05:40:07.651 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 96/165 2024-09-17T05:40:08.642 INFO:teuthology.orchestra.run.smithi150.stdout: Running scriptlet: ceph-common-2:19.3.0-4989.gce1b342b.el9.x86_64 108/165 2024-09-17T05:40:08.686 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : ceph-common-2:19.3.0-4989.gce1b342b.el9.x86_64 108/165 2024-09-17T05:40:08.908 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 97/165 2024-09-17T05:40:09.014 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 98/165 2024-09-17T05:40:09.042 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 99/165 2024-09-17T05:40:09.075 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : libuuid-devel-2.37.4-20.el9.x86_64 100/165 2024-09-17T05:40:09.268 INFO:teuthology.orchestra.run.smithi150.stdout: Running scriptlet: ceph-common-2:19.3.0-4989.gce1b342b.el9.x86_64 108/165 2024-09-17T05:40:09.314 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : ceph-base-2:19.3.0-4989.gce1b342b.el9.x86_64 109/165 2024-09-17T05:40:09.389 INFO:teuthology.orchestra.run.smithi150.stdout: Running scriptlet: ceph-base-2:19.3.0-4989.gce1b342b.el9.x86_64 109/165 2024-09-17T05:40:09.389 INFO:teuthology.orchestra.run.smithi150.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-17T05:40:09.389 INFO:teuthology.orchestra.run.smithi150.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-17T05:40:09.389 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-09-17T05:40:09.400 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 101/165 2024-09-17T05:40:09.423 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : ceph-selinux-2:19.3.0-4989.gce1b342b.el9.x86_64 110/165 2024-09-17T05:40:09.446 INFO:teuthology.orchestra.run.smithi176.stdout: Upgrading : librbd1-2:19.3.0-4989.gce1b342b.el9.x86_64 102/165 2024-09-17T05:40:09.537 INFO:teuthology.orchestra.run.smithi176.stdout: Running scriptlet: librbd1-2:19.3.0-4989.gce1b342b.el9.x86_64 102/165 2024-09-17T05:40:09.568 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-rbd-2:19.3.0-4989.gce1b342b.el9.x86_64 103/165 2024-09-17T05:40:09.612 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 104/165 2024-09-17T05:40:10.112 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 105/165 2024-09-17T05:40:10.141 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : librgw2-2:19.3.0-4989.gce1b342b.el9.x86_64 106/165 2024-09-17T05:40:10.195 INFO:teuthology.orchestra.run.smithi176.stdout: Running scriptlet: librgw2-2:19.3.0-4989.gce1b342b.el9.x86_64 106/165 2024-09-17T05:40:10.217 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-rgw-2:19.3.0-4989.gce1b342b.el9.x86_64 107/165 2024-09-17T05:40:12.518 INFO:teuthology.orchestra.run.smithi176.stdout: Running scriptlet: ceph-common-2:19.3.0-4989.gce1b342b.el9.x86_64 108/165 2024-09-17T05:40:12.547 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : ceph-common-2:19.3.0-4989.gce1b342b.el9.x86_64 108/165 2024-09-17T05:40:13.122 INFO:teuthology.orchestra.run.smithi176.stdout: Running scriptlet: ceph-common-2:19.3.0-4989.gce1b342b.el9.x86_64 108/165 2024-09-17T05:40:13.159 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : ceph-base-2:19.3.0-4989.gce1b342b.el9.x86_64 109/165 2024-09-17T05:40:13.245 INFO:teuthology.orchestra.run.smithi176.stdout: Running scriptlet: ceph-base-2:19.3.0-4989.gce1b342b.el9.x86_64 109/165 2024-09-17T05:40:13.246 INFO:teuthology.orchestra.run.smithi176.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-17T05:40:13.246 INFO:teuthology.orchestra.run.smithi176.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-17T05:40:13.246 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-09-17T05:40:13.285 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : ceph-selinux-2:19.3.0-4989.gce1b342b.el9.x86_64 110/165 2024-09-17T05:40:21.195 INFO:teuthology.orchestra.run.smithi150.stdout: Running scriptlet: ceph-selinux-2:19.3.0-4989.gce1b342b.el9.x86_64 110/165 2024-09-17T05:40:21.195 INFO:teuthology.orchestra.run.smithi150.stdout:skipping the directory /sys 2024-09-17T05:40:21.195 INFO:teuthology.orchestra.run.smithi150.stdout:skipping the directory /proc 2024-09-17T05:40:21.195 INFO:teuthology.orchestra.run.smithi150.stdout:skipping the directory /mnt 2024-09-17T05:40:21.195 INFO:teuthology.orchestra.run.smithi150.stdout:skipping the directory /var/tmp 2024-09-17T05:40:21.195 INFO:teuthology.orchestra.run.smithi150.stdout:skipping the directory /home 2024-09-17T05:40:21.196 INFO:teuthology.orchestra.run.smithi150.stdout:skipping the directory /root 2024-09-17T05:40:21.196 INFO:teuthology.orchestra.run.smithi150.stdout:skipping the directory /tmp 2024-09-17T05:40:21.196 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-09-17T05:40:21.378 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : ceph-volume-2:19.3.0-4989.gce1b342b.el9.noarch 111/165 2024-09-17T05:40:21.396 INFO:teuthology.orchestra.run.smithi150.stdout: Running scriptlet: ceph-volume-2:19.3.0-4989.gce1b342b.el9.noarch 111/165 2024-09-17T05:40:21.396 INFO:teuthology.orchestra.run.smithi150.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-17T05:40:21.396 INFO:teuthology.orchestra.run.smithi150.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-09-17T05:40:21.396 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-09-17T05:40:23.006 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : ceph-osd-2:19.3.0-4989.gce1b342b.el9.x86_64 112/165 2024-09-17T05:40:23.032 INFO:teuthology.orchestra.run.smithi150.stdout: Running scriptlet: ceph-osd-2:19.3.0-4989.gce1b342b.el9.x86_64 112/165 2024-09-17T05:40:23.033 INFO:teuthology.orchestra.run.smithi150.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-17T05:40:23.033 INFO:teuthology.orchestra.run.smithi150.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-17T05:40:23.033 INFO:teuthology.orchestra.run.smithi150.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-17T05:40:23.033 INFO:teuthology.orchestra.run.smithi150.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-17T05:40:23.033 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-09-17T05:40:23.265 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : ceph-mds-2:19.3.0-4989.gce1b342b.el9.x86_64 113/165 2024-09-17T05:40:23.288 INFO:teuthology.orchestra.run.smithi150.stdout: Running scriptlet: ceph-mds-2:19.3.0-4989.gce1b342b.el9.x86_64 113/165 2024-09-17T05:40:23.288 INFO:teuthology.orchestra.run.smithi150.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-17T05:40:23.288 INFO:teuthology.orchestra.run.smithi150.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-17T05:40:23.288 INFO:teuthology.orchestra.run.smithi150.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-17T05:40:23.288 INFO:teuthology.orchestra.run.smithi150.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-17T05:40:23.288 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-09-17T05:40:23.774 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : ceph-mon-2:19.3.0-4989.gce1b342b.el9.x86_64 114/165 2024-09-17T05:40:23.797 INFO:teuthology.orchestra.run.smithi150.stdout: Running scriptlet: ceph-mon-2:19.3.0-4989.gce1b342b.el9.x86_64 114/165 2024-09-17T05:40:23.797 INFO:teuthology.orchestra.run.smithi150.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-17T05:40:23.797 INFO:teuthology.orchestra.run.smithi150.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-17T05:40:23.797 INFO:teuthology.orchestra.run.smithi150.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-17T05:40:23.797 INFO:teuthology.orchestra.run.smithi150.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-17T05:40:23.797 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-09-17T05:40:23.912 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : automake-1.16.2-8.el9.noarch 115/165 2024-09-17T05:40:23.969 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-ply-3.11-14.el9.noarch 116/165 2024-09-17T05:40:24.024 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 117/165 2024-09-17T05:40:24.212 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 118/165 2024-09-17T05:40:24.266 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 119/165 2024-09-17T05:40:24.336 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 120/165 2024-09-17T05:40:24.424 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 121/165 2024-09-17T05:40:24.565 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 122/165 2024-09-17T05:40:24.600 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 123/165 2024-09-17T05:40:24.631 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 124/165 2024-09-17T05:40:24.659 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : fuse-2.9.9-16.el9.x86_64 125/165 2024-09-17T05:40:25.073 INFO:teuthology.orchestra.run.smithi150.stdout: Running scriptlet: cephadm-2:19.3.0-4989.gce1b342b.el9.noarch 126/165 2024-09-17T05:40:25.099 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : cephadm-2:19.3.0-4989.gce1b342b.el9.noarch 126/165 2024-09-17T05:40:25.123 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : ceph-prometheus-alerts-2:19.3.0-4989.gce1b342b.e 127/165 2024-09-17T05:40:25.181 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : ceph-grafana-dashboards-2:19.3.0-4989.gce1b342b. 128/165 2024-09-17T05:40:25.192 INFO:teuthology.orchestra.run.smithi176.stdout: Running scriptlet: ceph-selinux-2:19.3.0-4989.gce1b342b.el9.x86_64 110/165 2024-09-17T05:40:25.192 INFO:teuthology.orchestra.run.smithi176.stdout:skipping the directory /sys 2024-09-17T05:40:25.192 INFO:teuthology.orchestra.run.smithi176.stdout:skipping the directory /proc 2024-09-17T05:40:25.192 INFO:teuthology.orchestra.run.smithi176.stdout:skipping the directory /mnt 2024-09-17T05:40:25.192 INFO:teuthology.orchestra.run.smithi176.stdout:skipping the directory /var/tmp 2024-09-17T05:40:25.192 INFO:teuthology.orchestra.run.smithi176.stdout:skipping the directory /home 2024-09-17T05:40:25.193 INFO:teuthology.orchestra.run.smithi176.stdout:skipping the directory /root 2024-09-17T05:40:25.193 INFO:teuthology.orchestra.run.smithi176.stdout:skipping the directory /tmp 2024-09-17T05:40:25.193 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-09-17T05:40:25.205 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : ceph-mgr-cephadm-2:19.3.0-4989.gce1b342b.el9.noa 129/165 2024-09-17T05:40:25.365 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : ceph-volume-2:19.3.0-4989.gce1b342b.el9.noarch 111/165 2024-09-17T05:40:25.383 INFO:teuthology.orchestra.run.smithi176.stdout: Running scriptlet: ceph-volume-2:19.3.0-4989.gce1b342b.el9.noarch 111/165 2024-09-17T05:40:25.383 INFO:teuthology.orchestra.run.smithi176.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-17T05:40:25.383 INFO:teuthology.orchestra.run.smithi176.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-09-17T05:40:25.383 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-09-17T05:40:26.976 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : ceph-osd-2:19.3.0-4989.gce1b342b.el9.x86_64 112/165 2024-09-17T05:40:27.003 INFO:teuthology.orchestra.run.smithi176.stdout: Running scriptlet: ceph-osd-2:19.3.0-4989.gce1b342b.el9.x86_64 112/165 2024-09-17T05:40:27.003 INFO:teuthology.orchestra.run.smithi176.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-17T05:40:27.003 INFO:teuthology.orchestra.run.smithi176.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-17T05:40:27.003 INFO:teuthology.orchestra.run.smithi176.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-17T05:40:27.003 INFO:teuthology.orchestra.run.smithi176.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-17T05:40:27.003 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-09-17T05:40:27.243 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : ceph-mds-2:19.3.0-4989.gce1b342b.el9.x86_64 113/165 2024-09-17T05:40:27.267 INFO:teuthology.orchestra.run.smithi176.stdout: Running scriptlet: ceph-mds-2:19.3.0-4989.gce1b342b.el9.x86_64 113/165 2024-09-17T05:40:27.267 INFO:teuthology.orchestra.run.smithi176.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-17T05:40:27.267 INFO:teuthology.orchestra.run.smithi176.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-17T05:40:27.267 INFO:teuthology.orchestra.run.smithi176.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-17T05:40:27.267 INFO:teuthology.orchestra.run.smithi176.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-17T05:40:27.267 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-09-17T05:40:27.752 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : ceph-mon-2:19.3.0-4989.gce1b342b.el9.x86_64 114/165 2024-09-17T05:40:27.776 INFO:teuthology.orchestra.run.smithi176.stdout: Running scriptlet: ceph-mon-2:19.3.0-4989.gce1b342b.el9.x86_64 114/165 2024-09-17T05:40:27.776 INFO:teuthology.orchestra.run.smithi176.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-17T05:40:27.776 INFO:teuthology.orchestra.run.smithi176.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-17T05:40:27.776 INFO:teuthology.orchestra.run.smithi176.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-17T05:40:27.776 INFO:teuthology.orchestra.run.smithi176.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-17T05:40:27.776 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-09-17T05:40:27.874 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : automake-1.16.2-8.el9.noarch 115/165 2024-09-17T05:40:27.931 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-ply-3.11-14.el9.noarch 116/165 2024-09-17T05:40:27.987 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 117/165 2024-09-17T05:40:28.171 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 118/165 2024-09-17T05:40:28.220 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 119/165 2024-09-17T05:40:28.298 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 120/165 2024-09-17T05:40:28.387 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 121/165 2024-09-17T05:40:28.425 INFO:teuthology.orchestra.run.smithi150.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.3.0-4989.gce1b342b.el9.noa 129/165 2024-09-17T05:40:28.486 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : ceph-mgr-dashboard-2:19.3.0-4989.gce1b342b.el9.n 130/165 2024-09-17T05:40:28.525 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 122/165 2024-09-17T05:40:28.570 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 123/165 2024-09-17T05:40:28.602 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 124/165 2024-09-17T05:40:28.629 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : fuse-2.9.9-16.el9.x86_64 125/165 2024-09-17T05:40:29.009 INFO:teuthology.orchestra.run.smithi176.stdout: Running scriptlet: cephadm-2:19.3.0-4989.gce1b342b.el9.noarch 126/165 2024-09-17T05:40:29.036 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : cephadm-2:19.3.0-4989.gce1b342b.el9.noarch 126/165 2024-09-17T05:40:29.068 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : ceph-prometheus-alerts-2:19.3.0-4989.gce1b342b.e 127/165 2024-09-17T05:40:29.125 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : ceph-grafana-dashboards-2:19.3.0-4989.gce1b342b. 128/165 2024-09-17T05:40:29.151 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : ceph-mgr-cephadm-2:19.3.0-4989.gce1b342b.el9.noa 129/165 2024-09-17T05:40:29.461 INFO:teuthology.orchestra.run.smithi150.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.3.0-4989.gce1b342b.el9.n 130/165 2024-09-17T05:40:29.495 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : ceph-mgr-diskprediction-local-2:19.3.0-4989.gce1 131/165 2024-09-17T05:40:29.610 INFO:teuthology.orchestra.run.smithi150.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.3.0-4989.gce1 131/165 2024-09-17T05:40:29.779 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : ceph-mgr-modules-core-2:19.3.0-4989.gce1b342b.el 132/165 2024-09-17T05:40:29.805 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : ceph-mgr-2:19.3.0-4989.gce1b342b.el9.x86_64 133/165 2024-09-17T05:40:29.829 INFO:teuthology.orchestra.run.smithi150.stdout: Running scriptlet: ceph-mgr-2:19.3.0-4989.gce1b342b.el9.x86_64 133/165 2024-09-17T05:40:29.829 INFO:teuthology.orchestra.run.smithi150.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-17T05:40:29.830 INFO:teuthology.orchestra.run.smithi150.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-17T05:40:29.830 INFO:teuthology.orchestra.run.smithi150.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-17T05:40:29.830 INFO:teuthology.orchestra.run.smithi150.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-17T05:40:29.830 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-09-17T05:40:29.881 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : ceph-mgr-rook-2:19.3.0-4989.gce1b342b.el9.noarch 134/165 2024-09-17T05:40:29.893 INFO:teuthology.orchestra.run.smithi150.stdout: Running scriptlet: ceph-mgr-rook-2:19.3.0-4989.gce1b342b.el9.noarch 134/165 2024-09-17T05:40:29.985 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : ceph-2:19.3.0-4989.gce1b342b.el9.x86_64 135/165 2024-09-17T05:40:30.043 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : ceph-fuse-2:19.3.0-4989.gce1b342b.el9.x86_64 136/165 2024-09-17T05:40:31.017 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : libtool-2.4.6-46.el9.x86_64 137/165 2024-09-17T05:40:31.050 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : ceph-radosgw-2:19.3.0-4989.gce1b342b.el9.x86_64 138/165 2024-09-17T05:40:31.074 INFO:teuthology.orchestra.run.smithi150.stdout: Running scriptlet: ceph-radosgw-2:19.3.0-4989.gce1b342b.el9.x86_64 138/165 2024-09-17T05:40:31.075 INFO:teuthology.orchestra.run.smithi150.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-17T05:40:31.075 INFO:teuthology.orchestra.run.smithi150.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-17T05:40:31.075 INFO:teuthology.orchestra.run.smithi150.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-17T05:40:31.075 INFO:teuthology.orchestra.run.smithi150.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-17T05:40:31.075 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-09-17T05:40:31.118 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : ceph-immutable-object-cache-2:19.3.0-4989.gce1b3 139/165 2024-09-17T05:40:31.141 INFO:teuthology.orchestra.run.smithi150.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.3.0-4989.gce1b3 139/165 2024-09-17T05:40:31.141 INFO:teuthology.orchestra.run.smithi150.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-17T05:40:31.141 INFO:teuthology.orchestra.run.smithi150.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-17T05:40:31.141 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-09-17T05:40:31.193 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : cephfs-mirror-2:19.3.0-4989.gce1b342b.el9.x86_64 140/165 2024-09-17T05:40:31.216 INFO:teuthology.orchestra.run.smithi150.stdout: Running scriptlet: cephfs-mirror-2:19.3.0-4989.gce1b342b.el9.x86_64 140/165 2024-09-17T05:40:31.216 INFO:teuthology.orchestra.run.smithi150.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-17T05:40:31.217 INFO:teuthology.orchestra.run.smithi150.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-09-17T05:40:31.217 INFO:teuthology.orchestra.run.smithi150.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-17T05:40:31.217 INFO:teuthology.orchestra.run.smithi150.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-17T05:40:31.217 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-09-17T05:40:31.536 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : rbd-mirror-2:19.3.0-4989.gce1b342b.el9.x86_64 141/165 2024-09-17T05:40:31.559 INFO:teuthology.orchestra.run.smithi150.stdout: Running scriptlet: rbd-mirror-2:19.3.0-4989.gce1b342b.el9.x86_64 141/165 2024-09-17T05:40:31.559 INFO:teuthology.orchestra.run.smithi150.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-17T05:40:31.559 INFO:teuthology.orchestra.run.smithi150.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-17T05:40:31.559 INFO:teuthology.orchestra.run.smithi150.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-17T05:40:31.559 INFO:teuthology.orchestra.run.smithi150.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-17T05:40:31.560 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-09-17T05:40:32.347 INFO:teuthology.orchestra.run.smithi176.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.3.0-4989.gce1b342b.el9.noa 129/165 2024-09-17T05:40:32.407 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : ceph-mgr-dashboard-2:19.3.0-4989.gce1b342b.el9.n 130/165 2024-09-17T05:40:33.363 INFO:teuthology.orchestra.run.smithi176.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.3.0-4989.gce1b342b.el9.n 130/165 2024-09-17T05:40:33.390 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : ceph-mgr-diskprediction-local-2:19.3.0-4989.gce1 131/165 2024-09-17T05:40:33.504 INFO:teuthology.orchestra.run.smithi176.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.3.0-4989.gce1 131/165 2024-09-17T05:40:33.673 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : ceph-mgr-modules-core-2:19.3.0-4989.gce1b342b.el 132/165 2024-09-17T05:40:33.701 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : ceph-mgr-2:19.3.0-4989.gce1b342b.el9.x86_64 133/165 2024-09-17T05:40:33.725 INFO:teuthology.orchestra.run.smithi176.stdout: Running scriptlet: ceph-mgr-2:19.3.0-4989.gce1b342b.el9.x86_64 133/165 2024-09-17T05:40:33.725 INFO:teuthology.orchestra.run.smithi176.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-17T05:40:33.725 INFO:teuthology.orchestra.run.smithi176.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-17T05:40:33.725 INFO:teuthology.orchestra.run.smithi176.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-17T05:40:33.725 INFO:teuthology.orchestra.run.smithi176.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-17T05:40:33.725 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-09-17T05:40:33.776 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : ceph-mgr-rook-2:19.3.0-4989.gce1b342b.el9.noarch 134/165 2024-09-17T05:40:33.788 INFO:teuthology.orchestra.run.smithi176.stdout: Running scriptlet: ceph-mgr-rook-2:19.3.0-4989.gce1b342b.el9.noarch 134/165 2024-09-17T05:40:33.886 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : ceph-2:19.3.0-4989.gce1b342b.el9.x86_64 135/165 2024-09-17T05:40:33.939 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : ceph-fuse-2:19.3.0-4989.gce1b342b.el9.x86_64 136/165 2024-09-17T05:40:34.893 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : libtool-2.4.6-46.el9.x86_64 137/165 2024-09-17T05:40:34.921 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : ceph-radosgw-2:19.3.0-4989.gce1b342b.el9.x86_64 138/165 2024-09-17T05:40:34.944 INFO:teuthology.orchestra.run.smithi176.stdout: Running scriptlet: ceph-radosgw-2:19.3.0-4989.gce1b342b.el9.x86_64 138/165 2024-09-17T05:40:34.944 INFO:teuthology.orchestra.run.smithi176.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-17T05:40:34.944 INFO:teuthology.orchestra.run.smithi176.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-17T05:40:34.944 INFO:teuthology.orchestra.run.smithi176.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-17T05:40:34.944 INFO:teuthology.orchestra.run.smithi176.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-17T05:40:34.944 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-09-17T05:40:34.988 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : ceph-immutable-object-cache-2:19.3.0-4989.gce1b3 139/165 2024-09-17T05:40:35.010 INFO:teuthology.orchestra.run.smithi176.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.3.0-4989.gce1b3 139/165 2024-09-17T05:40:35.010 INFO:teuthology.orchestra.run.smithi176.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-17T05:40:35.010 INFO:teuthology.orchestra.run.smithi176.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-17T05:40:35.010 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-09-17T05:40:35.055 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : cephfs-mirror-2:19.3.0-4989.gce1b342b.el9.x86_64 140/165 2024-09-17T05:40:35.078 INFO:teuthology.orchestra.run.smithi176.stdout: Running scriptlet: cephfs-mirror-2:19.3.0-4989.gce1b342b.el9.x86_64 140/165 2024-09-17T05:40:35.078 INFO:teuthology.orchestra.run.smithi176.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-17T05:40:35.078 INFO:teuthology.orchestra.run.smithi176.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-09-17T05:40:35.078 INFO:teuthology.orchestra.run.smithi176.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-17T05:40:35.078 INFO:teuthology.orchestra.run.smithi176.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-17T05:40:35.079 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-09-17T05:40:35.406 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : rbd-mirror-2:19.3.0-4989.gce1b342b.el9.x86_64 141/165 2024-09-17T05:40:35.429 INFO:teuthology.orchestra.run.smithi176.stdout: Running scriptlet: rbd-mirror-2:19.3.0-4989.gce1b342b.el9.x86_64 141/165 2024-09-17T05:40:35.429 INFO:teuthology.orchestra.run.smithi176.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-17T05:40:35.429 INFO:teuthology.orchestra.run.smithi176.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-17T05:40:35.429 INFO:teuthology.orchestra.run.smithi176.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-17T05:40:35.429 INFO:teuthology.orchestra.run.smithi176.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-17T05:40:35.429 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-09-17T05:40:35.574 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : ceph-test-2:19.3.0-4989.gce1b342b.el9.x86_64 142/165 2024-09-17T05:40:35.615 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : rbd-fuse-2:19.3.0-4989.gce1b342b.el9.x86_64 143/165 2024-09-17T05:40:35.655 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : rbd-nbd-2:19.3.0-4989.gce1b342b.el9.x86_64 144/165 2024-09-17T05:40:35.687 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : xfsprogs-devel-6.4.0-4.el9.x86_64 145/165 2024-09-17T05:40:35.715 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : elfutils-libelf-devel-0.191-4.el9.x86_64 146/165 2024-09-17T05:40:35.900 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : cephfs-shell-2:19.3.0-4989.gce1b342b.el9.x86_64 147/165 2024-09-17T05:40:35.953 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : postgresql-contrib-13.16-1.el9.x86_64 148/165 2024-09-17T05:40:35.983 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : libcephfs-devel-2:19.3.0-4989.gce1b342b.el9.x86_ 149/165 2024-09-17T05:40:36.013 INFO:teuthology.orchestra.run.smithi150.stdout: Upgrading : NetworkManager-team-1:1.51.0-1.el9.x86_64 150/165 2024-09-17T05:40:36.068 INFO:teuthology.orchestra.run.smithi150.stdout: Upgrading : NetworkManager-tui-1:1.51.0-1.el9.x86_64 151/165 2024-09-17T05:40:36.617 INFO:teuthology.orchestra.run.smithi150.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 152/165 2024-09-17T05:40:36.657 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : postgresql-server-13.16-1.el9.x86_64 152/165 2024-09-17T05:40:36.677 INFO:teuthology.orchestra.run.smithi150.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 152/165 2024-09-17T05:40:37.523 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : cephfs-top-2:19.3.0-4989.gce1b342b.el9.noarch 153/165 2024-09-17T05:40:37.884 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : openssl-devel-1:3.2.2-6.el9.x86_64 154/165 2024-09-17T05:40:38.023 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 155/165 2024-09-17T05:40:38.111 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : flex-2.6.4-9.el9.x86_64 156/165 2024-09-17T05:40:38.139 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : bison-3.7.4-5.el9.x86_64 157/165 2024-09-17T05:40:38.165 INFO:teuthology.orchestra.run.smithi150.stdout: Cleanup : NetworkManager-tui-1:1.48.8-1.el9.x86_64 158/165 2024-09-17T05:40:38.199 INFO:teuthology.orchestra.run.smithi150.stdout: Cleanup : openssl-1:3.2.2-4.el9.x86_64 159/165 2024-09-17T05:40:38.199 INFO:teuthology.orchestra.run.smithi150.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 160/165 2024-09-17T05:40:38.283 INFO:teuthology.orchestra.run.smithi150.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 160/165 2024-09-17T05:40:38.283 INFO:teuthology.orchestra.run.smithi150.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 161/165 2024-09-17T05:40:38.367 INFO:teuthology.orchestra.run.smithi150.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 161/165 2024-09-17T05:40:38.392 INFO:teuthology.orchestra.run.smithi150.stdout: Cleanup : NetworkManager-team-1:1.48.8-1.el9.x86_64 162/165 2024-09-17T05:40:38.397 INFO:teuthology.orchestra.run.smithi150.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 163/165 2024-09-17T05:40:38.397 INFO:teuthology.orchestra.run.smithi150.stdout: Cleanup : NetworkManager-1:1.48.8-1.el9.x86_64 163/165 2024-09-17T05:40:38.577 INFO:teuthology.orchestra.run.smithi150.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 163/165 2024-09-17T05:40:38.577 INFO:teuthology.orchestra.run.smithi150.stdout: Cleanup : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 164/165 2024-09-17T05:40:38.670 INFO:teuthology.orchestra.run.smithi150.stdout: Running scriptlet: NetworkManager-libnm-1:1.48.8-1.el9.x86_64 164/165 2024-09-17T05:40:38.735 INFO:teuthology.orchestra.run.smithi150.stdout: Cleanup : openssl-libs-1:3.2.2-4.el9.x86_64 165/165 2024-09-17T05:40:39.419 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : ceph-test-2:19.3.0-4989.gce1b342b.el9.x86_64 142/165 2024-09-17T05:40:39.459 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : rbd-fuse-2:19.3.0-4989.gce1b342b.el9.x86_64 143/165 2024-09-17T05:40:39.500 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : rbd-nbd-2:19.3.0-4989.gce1b342b.el9.x86_64 144/165 2024-09-17T05:40:39.532 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : xfsprogs-devel-6.4.0-4.el9.x86_64 145/165 2024-09-17T05:40:39.559 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : elfutils-libelf-devel-0.191-4.el9.x86_64 146/165 2024-09-17T05:40:39.747 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : cephfs-shell-2:19.3.0-4989.gce1b342b.el9.x86_64 147/165 2024-09-17T05:40:39.814 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : postgresql-contrib-13.16-1.el9.x86_64 148/165 2024-09-17T05:40:39.844 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : libcephfs-devel-2:19.3.0-4989.gce1b342b.el9.x86_ 149/165 2024-09-17T05:40:39.874 INFO:teuthology.orchestra.run.smithi176.stdout: Upgrading : NetworkManager-team-1:1.51.0-1.el9.x86_64 150/165 2024-09-17T05:40:39.920 INFO:teuthology.orchestra.run.smithi176.stdout: Upgrading : NetworkManager-tui-1:1.51.0-1.el9.x86_64 151/165 2024-09-17T05:40:40.522 INFO:teuthology.orchestra.run.smithi176.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 152/165 2024-09-17T05:40:40.560 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : postgresql-server-13.16-1.el9.x86_64 152/165 2024-09-17T05:40:40.580 INFO:teuthology.orchestra.run.smithi176.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 152/165 2024-09-17T05:40:41.410 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : cephfs-top-2:19.3.0-4989.gce1b342b.el9.noarch 153/165 2024-09-17T05:40:41.489 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : openssl-devel-1:3.2.2-6.el9.x86_64 154/165 2024-09-17T05:40:41.539 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 155/165 2024-09-17T05:40:41.629 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : flex-2.6.4-9.el9.x86_64 156/165 2024-09-17T05:40:41.659 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : bison-3.7.4-5.el9.x86_64 157/165 2024-09-17T05:40:41.685 INFO:teuthology.orchestra.run.smithi176.stdout: Cleanup : NetworkManager-tui-1:1.48.8-1.el9.x86_64 158/165 2024-09-17T05:40:41.710 INFO:teuthology.orchestra.run.smithi176.stdout: Cleanup : openssl-1:3.2.2-4.el9.x86_64 159/165 2024-09-17T05:40:41.710 INFO:teuthology.orchestra.run.smithi176.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 160/165 2024-09-17T05:40:41.794 INFO:teuthology.orchestra.run.smithi176.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 160/165 2024-09-17T05:40:41.794 INFO:teuthology.orchestra.run.smithi176.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 161/165 2024-09-17T05:40:41.878 INFO:teuthology.orchestra.run.smithi176.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 161/165 2024-09-17T05:40:41.903 INFO:teuthology.orchestra.run.smithi176.stdout: Cleanup : NetworkManager-team-1:1.48.8-1.el9.x86_64 162/165 2024-09-17T05:40:41.908 INFO:teuthology.orchestra.run.smithi176.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 163/165 2024-09-17T05:40:41.908 INFO:teuthology.orchestra.run.smithi176.stdout: Cleanup : NetworkManager-1:1.48.8-1.el9.x86_64 163/165 2024-09-17T05:40:42.097 INFO:teuthology.orchestra.run.smithi176.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 163/165 2024-09-17T05:40:42.098 INFO:teuthology.orchestra.run.smithi176.stdout: Cleanup : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 164/165 2024-09-17T05:40:42.172 INFO:teuthology.orchestra.run.smithi176.stdout: Running scriptlet: NetworkManager-libnm-1:1.48.8-1.el9.x86_64 164/165 2024-09-17T05:40:42.237 INFO:teuthology.orchestra.run.smithi176.stdout: Cleanup : openssl-libs-1:3.2.2-4.el9.x86_64 165/165 2024-09-17T05:40:45.326 INFO:teuthology.orchestra.run.smithi150.stdout: Running scriptlet: openssl-libs-1:3.2.2-4.el9.x86_64 165/165 2024-09-17T05:40:45.326 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : ceph-2:19.3.0-4989.gce1b342b.el9.x86_64 1/165 2024-09-17T05:40:45.326 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : ceph-base-2:19.3.0-4989.gce1b342b.el9.x86_64 2/165 2024-09-17T05:40:45.326 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : ceph-common-2:19.3.0-4989.gce1b342b.el9.x86_64 3/165 2024-09-17T05:40:45.326 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : ceph-fuse-2:19.3.0-4989.gce1b342b.el9.x86_64 4/165 2024-09-17T05:40:45.326 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : ceph-immutable-object-cache-2:19.3.0-4989.gce1b3 5/165 2024-09-17T05:40:45.326 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : ceph-mds-2:19.3.0-4989.gce1b342b.el9.x86_64 6/165 2024-09-17T05:40:45.326 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : ceph-mgr-2:19.3.0-4989.gce1b342b.el9.x86_64 7/165 2024-09-17T05:40:45.326 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : ceph-mon-2:19.3.0-4989.gce1b342b.el9.x86_64 8/165 2024-09-17T05:40:45.326 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : ceph-osd-2:19.3.0-4989.gce1b342b.el9.x86_64 9/165 2024-09-17T05:40:45.327 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : ceph-radosgw-2:19.3.0-4989.gce1b342b.el9.x86_64 10/165 2024-09-17T05:40:45.327 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : ceph-selinux-2:19.3.0-4989.gce1b342b.el9.x86_64 11/165 2024-09-17T05:40:45.327 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : ceph-test-2:19.3.0-4989.gce1b342b.el9.x86_64 12/165 2024-09-17T05:40:45.327 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : cephfs-mirror-2:19.3.0-4989.gce1b342b.el9.x86_64 13/165 2024-09-17T05:40:45.327 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : cephfs-shell-2:19.3.0-4989.gce1b342b.el9.x86_64 14/165 2024-09-17T05:40:45.327 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : libcephfs-devel-2:19.3.0-4989.gce1b342b.el9.x86_ 15/165 2024-09-17T05:40:45.327 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : libcephfs2-2:19.3.0-4989.gce1b342b.el9.x86_64 16/165 2024-09-17T05:40:45.327 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : libcephsqlite-2:19.3.0-4989.gce1b342b.el9.x86_64 17/165 2024-09-17T05:40:45.328 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : librados-devel-2:19.3.0-4989.gce1b342b.el9.x86_6 18/165 2024-09-17T05:40:45.328 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : libradosstriper1-2:19.3.0-4989.gce1b342b.el9.x86 19/165 2024-09-17T05:40:45.328 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : librgw2-2:19.3.0-4989.gce1b342b.el9.x86_64 20/165 2024-09-17T05:40:45.328 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-ceph-argparse-2:19.3.0-4989.gce1b342b.el 21/165 2024-09-17T05:40:45.328 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-ceph-common-2:19.3.0-4989.gce1b342b.el9. 22/165 2024-09-17T05:40:45.328 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-cephfs-2:19.3.0-4989.gce1b342b.el9.x86_6 23/165 2024-09-17T05:40:45.328 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-rados-2:19.3.0-4989.gce1b342b.el9.x86_64 24/165 2024-09-17T05:40:45.328 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-rbd-2:19.3.0-4989.gce1b342b.el9.x86_64 25/165 2024-09-17T05:40:45.328 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-rgw-2:19.3.0-4989.gce1b342b.el9.x86_64 26/165 2024-09-17T05:40:45.328 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : rbd-fuse-2:19.3.0-4989.gce1b342b.el9.x86_64 27/165 2024-09-17T05:40:45.328 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : rbd-mirror-2:19.3.0-4989.gce1b342b.el9.x86_64 28/165 2024-09-17T05:40:45.328 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : rbd-nbd-2:19.3.0-4989.gce1b342b.el9.x86_64 29/165 2024-09-17T05:40:45.328 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : ceph-grafana-dashboards-2:19.3.0-4989.gce1b342b. 30/165 2024-09-17T05:40:45.340 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : ceph-mgr-cephadm-2:19.3.0-4989.gce1b342b.el9.noa 31/165 2024-09-17T05:40:45.340 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : ceph-mgr-dashboard-2:19.3.0-4989.gce1b342b.el9.n 32/165 2024-09-17T05:40:45.340 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.3.0-4989.gce1 33/165 2024-09-17T05:40:45.340 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : ceph-mgr-modules-core-2:19.3.0-4989.gce1b342b.el 34/165 2024-09-17T05:40:45.340 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : ceph-mgr-rook-2:19.3.0-4989.gce1b342b.el9.noarch 35/165 2024-09-17T05:40:45.340 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : ceph-prometheus-alerts-2:19.3.0-4989.gce1b342b.e 36/165 2024-09-17T05:40:45.340 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : ceph-volume-2:19.3.0-4989.gce1b342b.el9.noarch 37/165 2024-09-17T05:40:45.340 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : cephadm-2:19.3.0-4989.gce1b342b.el9.noarch 38/165 2024-09-17T05:40:45.340 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : cephfs-top-2:19.3.0-4989.gce1b342b.el9.noarch 39/165 2024-09-17T05:40:45.340 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 40/165 2024-09-17T05:40:45.340 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 41/165 2024-09-17T05:40:45.341 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 42/165 2024-09-17T05:40:45.341 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/165 2024-09-17T05:40:45.341 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 44/165 2024-09-17T05:40:45.341 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-ply-3.11-14.el9.noarch 45/165 2024-09-17T05:40:45.341 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 46/165 2024-09-17T05:40:45.341 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 47/165 2024-09-17T05:40:45.341 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 48/165 2024-09-17T05:40:45.341 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : automake-1.16.2-8.el9.noarch 49/165 2024-09-17T05:40:45.341 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : bison-3.7.4-5.el9.x86_64 50/165 2024-09-17T05:40:45.341 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 51/165 2024-09-17T05:40:45.341 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : elfutils-libelf-devel-0.191-4.el9.x86_64 52/165 2024-09-17T05:40:45.342 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : flex-2.6.4-9.el9.x86_64 53/165 2024-09-17T05:40:45.342 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 54/165 2024-09-17T05:40:45.342 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 55/165 2024-09-17T05:40:45.342 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 56/165 2024-09-17T05:40:45.342 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 57/165 2024-09-17T05:40:45.342 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : libnbd-1.20.2-2.el9.x86_64 58/165 2024-09-17T05:40:45.342 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 59/165 2024-09-17T05:40:45.342 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 60/165 2024-09-17T05:40:45.342 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 61/165 2024-09-17T05:40:45.342 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : libtool-2.4.6-46.el9.x86_64 62/165 2024-09-17T05:40:45.342 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : libuuid-devel-2.37.4-20.el9.x86_64 63/165 2024-09-17T05:40:45.342 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 64/165 2024-09-17T05:40:45.343 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 65/165 2024-09-17T05:40:45.343 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : lua-5.4.4-4.el9.x86_64 66/165 2024-09-17T05:40:45.343 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 67/165 2024-09-17T05:40:45.343 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 68/165 2024-09-17T05:40:45.343 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : openssl-devel-1:3.2.2-6.el9.x86_64 69/165 2024-09-17T05:40:45.343 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : postgresql-13.16-1.el9.x86_64 70/165 2024-09-17T05:40:45.343 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : postgresql-contrib-13.16-1.el9.x86_64 71/165 2024-09-17T05:40:45.343 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : postgresql-private-libs-13.16-1.el9.x86_64 72/165 2024-09-17T05:40:45.343 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : postgresql-server-13.16-1.el9.x86_64 73/165 2024-09-17T05:40:45.343 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 74/165 2024-09-17T05:40:45.343 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 75/165 2024-09-17T05:40:45.343 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 76/165 2024-09-17T05:40:45.344 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-colorama-0.4.6-3.el9.noarch 77/165 2024-09-17T05:40:45.344 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 78/165 2024-09-17T05:40:45.344 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 79/165 2024-09-17T05:40:45.344 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 80/165 2024-09-17T05:40:45.344 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 81/165 2024-09-17T05:40:45.344 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 82/165 2024-09-17T05:40:45.344 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 83/165 2024-09-17T05:40:45.344 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 84/165 2024-09-17T05:40:45.344 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 85/165 2024-09-17T05:40:45.344 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 86/165 2024-09-17T05:40:45.344 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 87/165 2024-09-17T05:40:45.344 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 88/165 2024-09-17T05:40:45.345 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 89/165 2024-09-17T05:40:45.345 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 90/165 2024-09-17T05:40:45.345 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 91/165 2024-09-17T05:40:45.345 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 92/165 2024-09-17T05:40:45.345 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 93/165 2024-09-17T05:40:45.345 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 94/165 2024-09-17T05:40:45.345 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 95/165 2024-09-17T05:40:45.345 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 96/165 2024-09-17T05:40:45.345 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 97/165 2024-09-17T05:40:45.345 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 98/165 2024-09-17T05:40:45.345 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 99/165 2024-09-17T05:40:45.346 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 100/165 2024-09-17T05:40:45.346 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 101/165 2024-09-17T05:40:45.346 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : xfsprogs-devel-6.4.0-4.el9.x86_64 102/165 2024-09-17T05:40:45.346 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 103/165 2024-09-17T05:40:45.346 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 104/165 2024-09-17T05:40:45.346 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 105/165 2024-09-17T05:40:45.346 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 106/165 2024-09-17T05:40:45.346 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 107/165 2024-09-17T05:40:45.346 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : gperftools-libs-2.9.1-3.el9.x86_64 108/165 2024-09-17T05:40:45.346 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 109/165 2024-09-17T05:40:45.347 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 110/165 2024-09-17T05:40:45.347 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 111/165 2024-09-17T05:40:45.347 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 112/165 2024-09-17T05:40:45.347 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 113/165 2024-09-17T05:40:45.347 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 114/165 2024-09-17T05:40:45.347 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 115/165 2024-09-17T05:40:45.347 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 116/165 2024-09-17T05:40:45.347 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 117/165 2024-09-17T05:40:45.347 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 118/165 2024-09-17T05:40:45.347 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 119/165 2024-09-17T05:40:45.347 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 120/165 2024-09-17T05:40:45.347 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 121/165 2024-09-17T05:40:45.347 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 122/165 2024-09-17T05:40:45.348 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 123/165 2024-09-17T05:40:45.348 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 124/165 2024-09-17T05:40:45.348 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 125/165 2024-09-17T05:40:45.348 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 126/165 2024-09-17T05:40:45.348 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 127/165 2024-09-17T05:40:45.348 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 128/165 2024-09-17T05:40:45.348 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 129/165 2024-09-17T05:40:45.348 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 130/165 2024-09-17T05:40:45.348 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 131/165 2024-09-17T05:40:45.348 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 132/165 2024-09-17T05:40:45.348 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 133/165 2024-09-17T05:40:45.348 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 134/165 2024-09-17T05:40:45.349 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 135/165 2024-09-17T05:40:45.349 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 136/165 2024-09-17T05:40:45.349 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 137/165 2024-09-17T05:40:45.349 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 138/165 2024-09-17T05:40:45.349 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 139/165 2024-09-17T05:40:45.349 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 140/165 2024-09-17T05:40:45.349 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 141/165 2024-09-17T05:40:45.349 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 142/165 2024-09-17T05:40:45.349 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 143/165 2024-09-17T05:40:45.349 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 144/165 2024-09-17T05:40:45.349 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 145/165 2024-09-17T05:40:45.349 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 146/165 2024-09-17T05:40:45.350 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 147/165 2024-09-17T05:40:45.350 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : re2-1:20211101-20.el9.x86_64 148/165 2024-09-17T05:40:45.350 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 149/165 2024-09-17T05:40:45.350 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : librados2-2:19.3.0-4989.gce1b342b.el9.x86_64 150/165 2024-09-17T05:40:45.350 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 151/165 2024-09-17T05:40:45.350 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : librbd1-2:19.3.0-4989.gce1b342b.el9.x86_64 152/165 2024-09-17T05:40:45.350 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 153/165 2024-09-17T05:40:45.350 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : NetworkManager-1:1.51.0-1.el9.x86_64 154/165 2024-09-17T05:40:45.350 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : NetworkManager-1:1.48.8-1.el9.x86_64 155/165 2024-09-17T05:40:45.350 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : NetworkManager-libnm-1:1.51.0-1.el9.x86_64 156/165 2024-09-17T05:40:45.350 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 157/165 2024-09-17T05:40:45.350 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : NetworkManager-team-1:1.51.0-1.el9.x86_64 158/165 2024-09-17T05:40:45.350 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : NetworkManager-team-1:1.48.8-1.el9.x86_64 159/165 2024-09-17T05:40:45.351 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : NetworkManager-tui-1:1.51.0-1.el9.x86_64 160/165 2024-09-17T05:40:45.351 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : NetworkManager-tui-1:1.48.8-1.el9.x86_64 161/165 2024-09-17T05:40:45.351 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : openssl-1:3.2.2-6.el9.x86_64 162/165 2024-09-17T05:40:45.351 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : openssl-1:3.2.2-4.el9.x86_64 163/165 2024-09-17T05:40:45.351 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : openssl-libs-1:3.2.2-6.el9.x86_64 164/165 2024-09-17T05:40:47.791 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : openssl-libs-1:3.2.2-4.el9.x86_64 165/165 2024-09-17T05:40:47.791 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-09-17T05:40:47.791 INFO:teuthology.orchestra.run.smithi150.stdout:Upgraded: 2024-09-17T05:40:47.791 INFO:teuthology.orchestra.run.smithi150.stdout: NetworkManager-1:1.51.0-1.el9.x86_64 2024-09-17T05:40:47.791 INFO:teuthology.orchestra.run.smithi150.stdout: NetworkManager-libnm-1:1.51.0-1.el9.x86_64 2024-09-17T05:40:47.791 INFO:teuthology.orchestra.run.smithi150.stdout: NetworkManager-team-1:1.51.0-1.el9.x86_64 2024-09-17T05:40:47.791 INFO:teuthology.orchestra.run.smithi150.stdout: NetworkManager-tui-1:1.51.0-1.el9.x86_64 2024-09-17T05:40:47.791 INFO:teuthology.orchestra.run.smithi150.stdout: librados2-2:19.3.0-4989.gce1b342b.el9.x86_64 2024-09-17T05:40:47.791 INFO:teuthology.orchestra.run.smithi150.stdout: librbd1-2:19.3.0-4989.gce1b342b.el9.x86_64 2024-09-17T05:40:47.792 INFO:teuthology.orchestra.run.smithi150.stdout: openssl-1:3.2.2-6.el9.x86_64 2024-09-17T05:40:47.792 INFO:teuthology.orchestra.run.smithi150.stdout: openssl-libs-1:3.2.2-6.el9.x86_64 2024-09-17T05:40:47.792 INFO:teuthology.orchestra.run.smithi150.stdout:Installed: 2024-09-17T05:40:47.792 INFO:teuthology.orchestra.run.smithi150.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-09-17T05:40:47.792 INFO:teuthology.orchestra.run.smithi150.stdout: automake-1.16.2-8.el9.noarch 2024-09-17T05:40:47.792 INFO:teuthology.orchestra.run.smithi150.stdout: bison-3.7.4-5.el9.x86_64 2024-09-17T05:40:47.792 INFO:teuthology.orchestra.run.smithi150.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-09-17T05:40:47.792 INFO:teuthology.orchestra.run.smithi150.stdout: ceph-2:19.3.0-4989.gce1b342b.el9.x86_64 2024-09-17T05:40:47.792 INFO:teuthology.orchestra.run.smithi150.stdout: ceph-base-2:19.3.0-4989.gce1b342b.el9.x86_64 2024-09-17T05:40:47.792 INFO:teuthology.orchestra.run.smithi150.stdout: ceph-common-2:19.3.0-4989.gce1b342b.el9.x86_64 2024-09-17T05:40:47.792 INFO:teuthology.orchestra.run.smithi150.stdout: ceph-fuse-2:19.3.0-4989.gce1b342b.el9.x86_64 2024-09-17T05:40:47.792 INFO:teuthology.orchestra.run.smithi150.stdout: ceph-grafana-dashboards-2:19.3.0-4989.gce1b342b.el9.noarch 2024-09-17T05:40:47.793 INFO:teuthology.orchestra.run.smithi150.stdout: ceph-immutable-object-cache-2:19.3.0-4989.gce1b342b.el9.x86_64 2024-09-17T05:40:47.793 INFO:teuthology.orchestra.run.smithi150.stdout: ceph-mds-2:19.3.0-4989.gce1b342b.el9.x86_64 2024-09-17T05:40:47.793 INFO:teuthology.orchestra.run.smithi150.stdout: ceph-mgr-2:19.3.0-4989.gce1b342b.el9.x86_64 2024-09-17T05:40:47.793 INFO:teuthology.orchestra.run.smithi150.stdout: ceph-mgr-cephadm-2:19.3.0-4989.gce1b342b.el9.noarch 2024-09-17T05:40:47.793 INFO:teuthology.orchestra.run.smithi150.stdout: ceph-mgr-dashboard-2:19.3.0-4989.gce1b342b.el9.noarch 2024-09-17T05:40:47.793 INFO:teuthology.orchestra.run.smithi150.stdout: ceph-mgr-diskprediction-local-2:19.3.0-4989.gce1b342b.el9.noarch 2024-09-17T05:40:47.793 INFO:teuthology.orchestra.run.smithi150.stdout: ceph-mgr-modules-core-2:19.3.0-4989.gce1b342b.el9.noarch 2024-09-17T05:40:47.793 INFO:teuthology.orchestra.run.smithi150.stdout: ceph-mgr-rook-2:19.3.0-4989.gce1b342b.el9.noarch 2024-09-17T05:40:47.793 INFO:teuthology.orchestra.run.smithi150.stdout: ceph-mon-2:19.3.0-4989.gce1b342b.el9.x86_64 2024-09-17T05:40:47.794 INFO:teuthology.orchestra.run.smithi150.stdout: ceph-osd-2:19.3.0-4989.gce1b342b.el9.x86_64 2024-09-17T05:40:47.794 INFO:teuthology.orchestra.run.smithi150.stdout: ceph-prometheus-alerts-2:19.3.0-4989.gce1b342b.el9.noarch 2024-09-17T05:40:47.794 INFO:teuthology.orchestra.run.smithi150.stdout: ceph-radosgw-2:19.3.0-4989.gce1b342b.el9.x86_64 2024-09-17T05:40:47.794 INFO:teuthology.orchestra.run.smithi150.stdout: ceph-selinux-2:19.3.0-4989.gce1b342b.el9.x86_64 2024-09-17T05:40:47.794 INFO:teuthology.orchestra.run.smithi150.stdout: ceph-test-2:19.3.0-4989.gce1b342b.el9.x86_64 2024-09-17T05:40:47.794 INFO:teuthology.orchestra.run.smithi150.stdout: ceph-volume-2:19.3.0-4989.gce1b342b.el9.noarch 2024-09-17T05:40:47.794 INFO:teuthology.orchestra.run.smithi150.stdout: cephadm-2:19.3.0-4989.gce1b342b.el9.noarch 2024-09-17T05:40:47.794 INFO:teuthology.orchestra.run.smithi150.stdout: cephfs-mirror-2:19.3.0-4989.gce1b342b.el9.x86_64 2024-09-17T05:40:47.794 INFO:teuthology.orchestra.run.smithi150.stdout: cephfs-shell-2:19.3.0-4989.gce1b342b.el9.x86_64 2024-09-17T05:40:47.794 INFO:teuthology.orchestra.run.smithi150.stdout: cephfs-top-2:19.3.0-4989.gce1b342b.el9.noarch 2024-09-17T05:40:47.794 INFO:teuthology.orchestra.run.smithi150.stdout: elfutils-libelf-devel-0.191-4.el9.x86_64 2024-09-17T05:40:47.794 INFO:teuthology.orchestra.run.smithi150.stdout: flex-2.6.4-9.el9.x86_64 2024-09-17T05:40:47.794 INFO:teuthology.orchestra.run.smithi150.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-17T05:40:47.795 INFO:teuthology.orchestra.run.smithi150.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-17T05:40:47.795 INFO:teuthology.orchestra.run.smithi150.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-17T05:40:47.795 INFO:teuthology.orchestra.run.smithi150.stdout: fuse-2.9.9-16.el9.x86_64 2024-09-17T05:40:47.795 INFO:teuthology.orchestra.run.smithi150.stdout: gperftools-libs-2.9.1-3.el9.x86_64 2024-09-17T05:40:47.795 INFO:teuthology.orchestra.run.smithi150.stdout: grpc-data-1.46.7-10.el9.noarch 2024-09-17T05:40:47.795 INFO:teuthology.orchestra.run.smithi150.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-09-17T05:40:47.795 INFO:teuthology.orchestra.run.smithi150.stdout: libarrow-9.0.0-11.el9.x86_64 2024-09-17T05:40:47.795 INFO:teuthology.orchestra.run.smithi150.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-09-17T05:40:47.795 INFO:teuthology.orchestra.run.smithi150.stdout: libcephfs-devel-2:19.3.0-4989.gce1b342b.el9.x86_64 2024-09-17T05:40:47.795 INFO:teuthology.orchestra.run.smithi150.stdout: libcephfs2-2:19.3.0-4989.gce1b342b.el9.x86_64 2024-09-17T05:40:47.795 INFO:teuthology.orchestra.run.smithi150.stdout: libcephsqlite-2:19.3.0-4989.gce1b342b.el9.x86_64 2024-09-17T05:40:47.795 INFO:teuthology.orchestra.run.smithi150.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-17T05:40:47.795 INFO:teuthology.orchestra.run.smithi150.stdout: libnbd-1.20.2-2.el9.x86_64 2024-09-17T05:40:47.796 INFO:teuthology.orchestra.run.smithi150.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-17T05:40:47.796 INFO:teuthology.orchestra.run.smithi150.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-17T05:40:47.796 INFO:teuthology.orchestra.run.smithi150.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-17T05:40:47.796 INFO:teuthology.orchestra.run.smithi150.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-17T05:40:47.796 INFO:teuthology.orchestra.run.smithi150.stdout: librados-devel-2:19.3.0-4989.gce1b342b.el9.x86_64 2024-09-17T05:40:47.796 INFO:teuthology.orchestra.run.smithi150.stdout: libradosstriper1-2:19.3.0-4989.gce1b342b.el9.x86_64 2024-09-17T05:40:47.796 INFO:teuthology.orchestra.run.smithi150.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-17T05:40:47.796 INFO:teuthology.orchestra.run.smithi150.stdout: librgw2-2:19.3.0-4989.gce1b342b.el9.x86_64 2024-09-17T05:40:47.796 INFO:teuthology.orchestra.run.smithi150.stdout: libtool-2.4.6-46.el9.x86_64 2024-09-17T05:40:47.796 INFO:teuthology.orchestra.run.smithi150.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-17T05:40:47.796 INFO:teuthology.orchestra.run.smithi150.stdout: libuuid-devel-2.37.4-20.el9.x86_64 2024-09-17T05:40:47.796 INFO:teuthology.orchestra.run.smithi150.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-09-17T05:40:47.796 INFO:teuthology.orchestra.run.smithi150.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-17T05:40:47.797 INFO:teuthology.orchestra.run.smithi150.stdout: lua-5.4.4-4.el9.x86_64 2024-09-17T05:40:47.797 INFO:teuthology.orchestra.run.smithi150.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-09-17T05:40:47.797 INFO:teuthology.orchestra.run.smithi150.stdout: luarocks-3.9.2-5.el9.noarch 2024-09-17T05:40:47.797 INFO:teuthology.orchestra.run.smithi150.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-17T05:40:47.797 INFO:teuthology.orchestra.run.smithi150.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-17T05:40:47.797 INFO:teuthology.orchestra.run.smithi150.stdout: openssl-devel-1:3.2.2-6.el9.x86_64 2024-09-17T05:40:47.797 INFO:teuthology.orchestra.run.smithi150.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-09-17T05:40:47.797 INFO:teuthology.orchestra.run.smithi150.stdout: postgresql-13.16-1.el9.x86_64 2024-09-17T05:40:47.797 INFO:teuthology.orchestra.run.smithi150.stdout: postgresql-contrib-13.16-1.el9.x86_64 2024-09-17T05:40:47.797 INFO:teuthology.orchestra.run.smithi150.stdout: postgresql-private-libs-13.16-1.el9.x86_64 2024-09-17T05:40:47.798 INFO:teuthology.orchestra.run.smithi150.stdout: postgresql-server-13.16-1.el9.x86_64 2024-09-17T05:40:47.798 INFO:teuthology.orchestra.run.smithi150.stdout: protobuf-3.14.0-13.el9.x86_64 2024-09-17T05:40:47.798 INFO:teuthology.orchestra.run.smithi150.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-09-17T05:40:47.798 INFO:teuthology.orchestra.run.smithi150.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-17T05:40:47.798 INFO:teuthology.orchestra.run.smithi150.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-09-17T05:40:47.798 INFO:teuthology.orchestra.run.smithi150.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-17T05:40:47.798 INFO:teuthology.orchestra.run.smithi150.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-17T05:40:47.798 INFO:teuthology.orchestra.run.smithi150.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-17T05:40:47.798 INFO:teuthology.orchestra.run.smithi150.stdout: python3-ceph-argparse-2:19.3.0-4989.gce1b342b.el9.x86_64 2024-09-17T05:40:47.798 INFO:teuthology.orchestra.run.smithi150.stdout: python3-ceph-common-2:19.3.0-4989.gce1b342b.el9.x86_64 2024-09-17T05:40:47.798 INFO:teuthology.orchestra.run.smithi150.stdout: python3-cephfs-2:19.3.0-4989.gce1b342b.el9.x86_64 2024-09-17T05:40:47.798 INFO:teuthology.orchestra.run.smithi150.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-17T05:40:47.798 INFO:teuthology.orchestra.run.smithi150.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-17T05:40:47.799 INFO:teuthology.orchestra.run.smithi150.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-17T05:40:47.799 INFO:teuthology.orchestra.run.smithi150.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-17T05:40:47.799 INFO:teuthology.orchestra.run.smithi150.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-09-17T05:40:47.799 INFO:teuthology.orchestra.run.smithi150.stdout: python3-colorama-0.4.6-3.el9.noarch 2024-09-17T05:40:47.799 INFO:teuthology.orchestra.run.smithi150.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-17T05:40:47.799 INFO:teuthology.orchestra.run.smithi150.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-17T05:40:47.800 INFO:teuthology.orchestra.run.smithi150.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-17T05:40:47.800 INFO:teuthology.orchestra.run.smithi150.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-09-17T05:40:47.800 INFO:teuthology.orchestra.run.smithi150.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-09-17T05:40:47.800 INFO:teuthology.orchestra.run.smithi150.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-17T05:40:47.800 INFO:teuthology.orchestra.run.smithi150.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-17T05:40:47.800 INFO:teuthology.orchestra.run.smithi150.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-17T05:40:47.800 INFO:teuthology.orchestra.run.smithi150.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-17T05:40:47.800 INFO:teuthology.orchestra.run.smithi150.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-17T05:40:47.800 INFO:teuthology.orchestra.run.smithi150.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-17T05:40:47.800 INFO:teuthology.orchestra.run.smithi150.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-17T05:40:47.800 INFO:teuthology.orchestra.run.smithi150.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-17T05:40:47.800 INFO:teuthology.orchestra.run.smithi150.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-17T05:40:47.800 INFO:teuthology.orchestra.run.smithi150.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-17T05:40:47.801 INFO:teuthology.orchestra.run.smithi150.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-17T05:40:47.801 INFO:teuthology.orchestra.run.smithi150.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-17T05:40:47.801 INFO:teuthology.orchestra.run.smithi150.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-17T05:40:47.801 INFO:teuthology.orchestra.run.smithi150.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-17T05:40:47.801 INFO:teuthology.orchestra.run.smithi150.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-17T05:40:47.801 INFO:teuthology.orchestra.run.smithi150.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-17T05:40:47.801 INFO:teuthology.orchestra.run.smithi150.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-17T05:40:47.801 INFO:teuthology.orchestra.run.smithi150.stdout: python3-packaging-20.9-5.el9.noarch 2024-09-17T05:40:47.801 INFO:teuthology.orchestra.run.smithi150.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-17T05:40:47.802 INFO:teuthology.orchestra.run.smithi150.stdout: python3-ply-3.11-14.el9.noarch 2024-09-17T05:40:47.802 INFO:teuthology.orchestra.run.smithi150.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-17T05:40:47.802 INFO:teuthology.orchestra.run.smithi150.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-17T05:40:47.802 INFO:teuthology.orchestra.run.smithi150.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-09-17T05:40:47.802 INFO:teuthology.orchestra.run.smithi150.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-17T05:40:47.802 INFO:teuthology.orchestra.run.smithi150.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-17T05:40:47.802 INFO:teuthology.orchestra.run.smithi150.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-17T05:40:47.802 INFO:teuthology.orchestra.run.smithi150.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-17T05:40:47.802 INFO:teuthology.orchestra.run.smithi150.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-09-17T05:40:47.802 INFO:teuthology.orchestra.run.smithi150.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-17T05:40:47.802 INFO:teuthology.orchestra.run.smithi150.stdout: python3-rados-2:19.3.0-4989.gce1b342b.el9.x86_64 2024-09-17T05:40:47.802 INFO:teuthology.orchestra.run.smithi150.stdout: python3-rbd-2:19.3.0-4989.gce1b342b.el9.x86_64 2024-09-17T05:40:47.802 INFO:teuthology.orchestra.run.smithi150.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-17T05:40:47.802 INFO:teuthology.orchestra.run.smithi150.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-17T05:40:47.803 INFO:teuthology.orchestra.run.smithi150.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-17T05:40:47.803 INFO:teuthology.orchestra.run.smithi150.stdout: python3-rgw-2:19.3.0-4989.gce1b342b.el9.x86_64 2024-09-17T05:40:47.803 INFO:teuthology.orchestra.run.smithi150.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-17T05:40:47.803 INFO:teuthology.orchestra.run.smithi150.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-17T05:40:47.803 INFO:teuthology.orchestra.run.smithi150.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-17T05:40:47.803 INFO:teuthology.orchestra.run.smithi150.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-17T05:40:47.803 INFO:teuthology.orchestra.run.smithi150.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-17T05:40:47.803 INFO:teuthology.orchestra.run.smithi150.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-17T05:40:47.803 INFO:teuthology.orchestra.run.smithi150.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-17T05:40:47.803 INFO:teuthology.orchestra.run.smithi150.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-09-17T05:40:47.803 INFO:teuthology.orchestra.run.smithi150.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-17T05:40:47.803 INFO:teuthology.orchestra.run.smithi150.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-17T05:40:47.803 INFO:teuthology.orchestra.run.smithi150.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-17T05:40:47.804 INFO:teuthology.orchestra.run.smithi150.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-17T05:40:47.804 INFO:teuthology.orchestra.run.smithi150.stdout: qatlib-24.02.0-1.el9.x86_64 2024-09-17T05:40:47.804 INFO:teuthology.orchestra.run.smithi150.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-09-17T05:40:47.804 INFO:teuthology.orchestra.run.smithi150.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-09-17T05:40:47.804 INFO:teuthology.orchestra.run.smithi150.stdout: rbd-fuse-2:19.3.0-4989.gce1b342b.el9.x86_64 2024-09-17T05:40:47.804 INFO:teuthology.orchestra.run.smithi150.stdout: rbd-mirror-2:19.3.0-4989.gce1b342b.el9.x86_64 2024-09-17T05:40:47.804 INFO:teuthology.orchestra.run.smithi150.stdout: rbd-nbd-2:19.3.0-4989.gce1b342b.el9.x86_64 2024-09-17T05:40:47.804 INFO:teuthology.orchestra.run.smithi150.stdout: re2-1:20211101-20.el9.x86_64 2024-09-17T05:40:47.804 INFO:teuthology.orchestra.run.smithi150.stdout: socat-1.7.4.1-6.el9.x86_64 2024-09-17T05:40:47.804 INFO:teuthology.orchestra.run.smithi150.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-17T05:40:47.804 INFO:teuthology.orchestra.run.smithi150.stdout: uuid-1.6.2-55.el9.x86_64 2024-09-17T05:40:47.804 INFO:teuthology.orchestra.run.smithi150.stdout: xfsprogs-devel-6.4.0-4.el9.x86_64 2024-09-17T05:40:47.804 INFO:teuthology.orchestra.run.smithi150.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-09-17T05:40:47.805 INFO:teuthology.orchestra.run.smithi150.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-09-17T05:40:47.805 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-09-17T05:40:47.805 INFO:teuthology.orchestra.run.smithi150.stdout:Complete! 2024-09-17T05:40:48.234 DEBUG:teuthology.parallel:result is None 2024-09-17T05:40:48.622 INFO:teuthology.orchestra.run.smithi176.stdout: Running scriptlet: openssl-libs-1:3.2.2-4.el9.x86_64 165/165 2024-09-17T05:40:48.622 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : ceph-2:19.3.0-4989.gce1b342b.el9.x86_64 1/165 2024-09-17T05:40:48.622 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : ceph-base-2:19.3.0-4989.gce1b342b.el9.x86_64 2/165 2024-09-17T05:40:48.622 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : ceph-common-2:19.3.0-4989.gce1b342b.el9.x86_64 3/165 2024-09-17T05:40:48.622 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : ceph-fuse-2:19.3.0-4989.gce1b342b.el9.x86_64 4/165 2024-09-17T05:40:48.623 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : ceph-immutable-object-cache-2:19.3.0-4989.gce1b3 5/165 2024-09-17T05:40:48.623 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : ceph-mds-2:19.3.0-4989.gce1b342b.el9.x86_64 6/165 2024-09-17T05:40:48.623 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : ceph-mgr-2:19.3.0-4989.gce1b342b.el9.x86_64 7/165 2024-09-17T05:40:48.623 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : ceph-mon-2:19.3.0-4989.gce1b342b.el9.x86_64 8/165 2024-09-17T05:40:48.623 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : ceph-osd-2:19.3.0-4989.gce1b342b.el9.x86_64 9/165 2024-09-17T05:40:48.623 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : ceph-radosgw-2:19.3.0-4989.gce1b342b.el9.x86_64 10/165 2024-09-17T05:40:48.623 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : ceph-selinux-2:19.3.0-4989.gce1b342b.el9.x86_64 11/165 2024-09-17T05:40:48.623 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : ceph-test-2:19.3.0-4989.gce1b342b.el9.x86_64 12/165 2024-09-17T05:40:48.623 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : cephfs-mirror-2:19.3.0-4989.gce1b342b.el9.x86_64 13/165 2024-09-17T05:40:48.623 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : cephfs-shell-2:19.3.0-4989.gce1b342b.el9.x86_64 14/165 2024-09-17T05:40:48.623 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : libcephfs-devel-2:19.3.0-4989.gce1b342b.el9.x86_ 15/165 2024-09-17T05:40:48.623 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : libcephfs2-2:19.3.0-4989.gce1b342b.el9.x86_64 16/165 2024-09-17T05:40:48.623 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : libcephsqlite-2:19.3.0-4989.gce1b342b.el9.x86_64 17/165 2024-09-17T05:40:48.624 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : librados-devel-2:19.3.0-4989.gce1b342b.el9.x86_6 18/165 2024-09-17T05:40:48.624 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : libradosstriper1-2:19.3.0-4989.gce1b342b.el9.x86 19/165 2024-09-17T05:40:48.624 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : librgw2-2:19.3.0-4989.gce1b342b.el9.x86_64 20/165 2024-09-17T05:40:48.624 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-ceph-argparse-2:19.3.0-4989.gce1b342b.el 21/165 2024-09-17T05:40:48.624 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-ceph-common-2:19.3.0-4989.gce1b342b.el9. 22/165 2024-09-17T05:40:48.624 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-cephfs-2:19.3.0-4989.gce1b342b.el9.x86_6 23/165 2024-09-17T05:40:48.624 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-rados-2:19.3.0-4989.gce1b342b.el9.x86_64 24/165 2024-09-17T05:40:48.624 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-rbd-2:19.3.0-4989.gce1b342b.el9.x86_64 25/165 2024-09-17T05:40:48.624 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-rgw-2:19.3.0-4989.gce1b342b.el9.x86_64 26/165 2024-09-17T05:40:48.624 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : rbd-fuse-2:19.3.0-4989.gce1b342b.el9.x86_64 27/165 2024-09-17T05:40:48.624 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : rbd-mirror-2:19.3.0-4989.gce1b342b.el9.x86_64 28/165 2024-09-17T05:40:48.624 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : rbd-nbd-2:19.3.0-4989.gce1b342b.el9.x86_64 29/165 2024-09-17T05:40:48.624 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : ceph-grafana-dashboards-2:19.3.0-4989.gce1b342b. 30/165 2024-09-17T05:40:48.625 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : ceph-mgr-cephadm-2:19.3.0-4989.gce1b342b.el9.noa 31/165 2024-09-17T05:40:48.625 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : ceph-mgr-dashboard-2:19.3.0-4989.gce1b342b.el9.n 32/165 2024-09-17T05:40:48.625 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.3.0-4989.gce1 33/165 2024-09-17T05:40:48.625 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : ceph-mgr-modules-core-2:19.3.0-4989.gce1b342b.el 34/165 2024-09-17T05:40:48.625 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : ceph-mgr-rook-2:19.3.0-4989.gce1b342b.el9.noarch 35/165 2024-09-17T05:40:48.625 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : ceph-prometheus-alerts-2:19.3.0-4989.gce1b342b.e 36/165 2024-09-17T05:40:48.625 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : ceph-volume-2:19.3.0-4989.gce1b342b.el9.noarch 37/165 2024-09-17T05:40:48.625 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : cephadm-2:19.3.0-4989.gce1b342b.el9.noarch 38/165 2024-09-17T05:40:48.625 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : cephfs-top-2:19.3.0-4989.gce1b342b.el9.noarch 39/165 2024-09-17T05:40:48.625 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 40/165 2024-09-17T05:40:48.625 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 41/165 2024-09-17T05:40:48.625 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 42/165 2024-09-17T05:40:48.626 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/165 2024-09-17T05:40:48.626 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 44/165 2024-09-17T05:40:48.626 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-ply-3.11-14.el9.noarch 45/165 2024-09-17T05:40:48.626 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 46/165 2024-09-17T05:40:48.626 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 47/165 2024-09-17T05:40:48.626 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 48/165 2024-09-17T05:40:48.626 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : automake-1.16.2-8.el9.noarch 49/165 2024-09-17T05:40:48.626 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : bison-3.7.4-5.el9.x86_64 50/165 2024-09-17T05:40:48.626 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 51/165 2024-09-17T05:40:48.626 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : elfutils-libelf-devel-0.191-4.el9.x86_64 52/165 2024-09-17T05:40:48.626 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : flex-2.6.4-9.el9.x86_64 53/165 2024-09-17T05:40:48.626 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 54/165 2024-09-17T05:40:48.626 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 55/165 2024-09-17T05:40:48.627 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 56/165 2024-09-17T05:40:48.627 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 57/165 2024-09-17T05:40:48.627 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : libnbd-1.20.2-2.el9.x86_64 58/165 2024-09-17T05:40:48.627 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 59/165 2024-09-17T05:40:48.627 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 60/165 2024-09-17T05:40:48.627 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 61/165 2024-09-17T05:40:48.627 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : libtool-2.4.6-46.el9.x86_64 62/165 2024-09-17T05:40:48.627 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : libuuid-devel-2.37.4-20.el9.x86_64 63/165 2024-09-17T05:40:48.627 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 64/165 2024-09-17T05:40:48.627 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 65/165 2024-09-17T05:40:48.627 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : lua-5.4.4-4.el9.x86_64 66/165 2024-09-17T05:40:48.627 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 67/165 2024-09-17T05:40:48.627 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 68/165 2024-09-17T05:40:48.627 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : openssl-devel-1:3.2.2-6.el9.x86_64 69/165 2024-09-17T05:40:48.628 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : postgresql-13.16-1.el9.x86_64 70/165 2024-09-17T05:40:48.628 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : postgresql-contrib-13.16-1.el9.x86_64 71/165 2024-09-17T05:40:48.628 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : postgresql-private-libs-13.16-1.el9.x86_64 72/165 2024-09-17T05:40:48.628 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : postgresql-server-13.16-1.el9.x86_64 73/165 2024-09-17T05:40:48.628 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 74/165 2024-09-17T05:40:48.628 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 75/165 2024-09-17T05:40:48.628 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 76/165 2024-09-17T05:40:48.628 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-colorama-0.4.6-3.el9.noarch 77/165 2024-09-17T05:40:48.628 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 78/165 2024-09-17T05:40:48.628 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 79/165 2024-09-17T05:40:48.628 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 80/165 2024-09-17T05:40:48.628 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 81/165 2024-09-17T05:40:48.628 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 82/165 2024-09-17T05:40:48.629 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 83/165 2024-09-17T05:40:48.629 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 84/165 2024-09-17T05:40:48.629 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 85/165 2024-09-17T05:40:48.629 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 86/165 2024-09-17T05:40:48.629 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 87/165 2024-09-17T05:40:48.629 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 88/165 2024-09-17T05:40:48.629 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 89/165 2024-09-17T05:40:48.629 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 90/165 2024-09-17T05:40:48.629 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 91/165 2024-09-17T05:40:48.629 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 92/165 2024-09-17T05:40:48.629 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 93/165 2024-09-17T05:40:48.629 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 94/165 2024-09-17T05:40:48.629 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 95/165 2024-09-17T05:40:48.629 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 96/165 2024-09-17T05:40:48.630 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 97/165 2024-09-17T05:40:48.630 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 98/165 2024-09-17T05:40:48.630 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 99/165 2024-09-17T05:40:48.630 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 100/165 2024-09-17T05:40:48.630 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 101/165 2024-09-17T05:40:48.630 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : xfsprogs-devel-6.4.0-4.el9.x86_64 102/165 2024-09-17T05:40:48.630 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 103/165 2024-09-17T05:40:48.630 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 104/165 2024-09-17T05:40:48.630 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 105/165 2024-09-17T05:40:48.630 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 106/165 2024-09-17T05:40:48.630 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 107/165 2024-09-17T05:40:48.630 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : gperftools-libs-2.9.1-3.el9.x86_64 108/165 2024-09-17T05:40:48.630 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 109/165 2024-09-17T05:40:48.631 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 110/165 2024-09-17T05:40:48.631 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 111/165 2024-09-17T05:40:48.631 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 112/165 2024-09-17T05:40:48.631 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 113/165 2024-09-17T05:40:48.631 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 114/165 2024-09-17T05:40:48.631 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 115/165 2024-09-17T05:40:48.631 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 116/165 2024-09-17T05:40:48.631 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 117/165 2024-09-17T05:40:48.631 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 118/165 2024-09-17T05:40:48.631 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 119/165 2024-09-17T05:40:48.631 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 120/165 2024-09-17T05:40:48.631 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 121/165 2024-09-17T05:40:48.631 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 122/165 2024-09-17T05:40:48.631 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 123/165 2024-09-17T05:40:48.632 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 124/165 2024-09-17T05:40:48.632 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 125/165 2024-09-17T05:40:48.632 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 126/165 2024-09-17T05:40:48.632 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 127/165 2024-09-17T05:40:48.632 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 128/165 2024-09-17T05:40:48.632 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 129/165 2024-09-17T05:40:48.632 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 130/165 2024-09-17T05:40:48.632 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 131/165 2024-09-17T05:40:48.632 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 132/165 2024-09-17T05:40:48.632 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 133/165 2024-09-17T05:40:48.632 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 134/165 2024-09-17T05:40:48.632 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 135/165 2024-09-17T05:40:48.632 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 136/165 2024-09-17T05:40:48.632 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 137/165 2024-09-17T05:40:48.633 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 138/165 2024-09-17T05:40:48.633 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 139/165 2024-09-17T05:40:48.633 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 140/165 2024-09-17T05:40:48.633 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 141/165 2024-09-17T05:40:48.633 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 142/165 2024-09-17T05:40:48.633 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 143/165 2024-09-17T05:40:48.633 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 144/165 2024-09-17T05:40:48.633 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 145/165 2024-09-17T05:40:48.633 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 146/165 2024-09-17T05:40:48.634 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 147/165 2024-09-17T05:40:48.634 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : re2-1:20211101-20.el9.x86_64 148/165 2024-09-17T05:40:48.634 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 149/165 2024-09-17T05:40:48.634 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : librados2-2:19.3.0-4989.gce1b342b.el9.x86_64 150/165 2024-09-17T05:40:48.634 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 151/165 2024-09-17T05:40:48.634 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : librbd1-2:19.3.0-4989.gce1b342b.el9.x86_64 152/165 2024-09-17T05:40:48.634 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 153/165 2024-09-17T05:40:48.634 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : NetworkManager-1:1.51.0-1.el9.x86_64 154/165 2024-09-17T05:40:48.634 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : NetworkManager-1:1.48.8-1.el9.x86_64 155/165 2024-09-17T05:40:48.634 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : NetworkManager-libnm-1:1.51.0-1.el9.x86_64 156/165 2024-09-17T05:40:48.635 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 157/165 2024-09-17T05:40:48.635 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : NetworkManager-team-1:1.51.0-1.el9.x86_64 158/165 2024-09-17T05:40:48.635 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : NetworkManager-team-1:1.48.8-1.el9.x86_64 159/165 2024-09-17T05:40:48.635 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : NetworkManager-tui-1:1.51.0-1.el9.x86_64 160/165 2024-09-17T05:40:48.635 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : NetworkManager-tui-1:1.48.8-1.el9.x86_64 161/165 2024-09-17T05:40:48.635 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : openssl-1:3.2.2-6.el9.x86_64 162/165 2024-09-17T05:40:48.635 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : openssl-1:3.2.2-4.el9.x86_64 163/165 2024-09-17T05:40:48.635 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : openssl-libs-1:3.2.2-6.el9.x86_64 164/165 2024-09-17T05:40:51.324 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : openssl-libs-1:3.2.2-4.el9.x86_64 165/165 2024-09-17T05:40:51.325 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-09-17T05:40:51.325 INFO:teuthology.orchestra.run.smithi176.stdout:Upgraded: 2024-09-17T05:40:51.325 INFO:teuthology.orchestra.run.smithi176.stdout: NetworkManager-1:1.51.0-1.el9.x86_64 2024-09-17T05:40:51.325 INFO:teuthology.orchestra.run.smithi176.stdout: NetworkManager-libnm-1:1.51.0-1.el9.x86_64 2024-09-17T05:40:51.325 INFO:teuthology.orchestra.run.smithi176.stdout: NetworkManager-team-1:1.51.0-1.el9.x86_64 2024-09-17T05:40:51.325 INFO:teuthology.orchestra.run.smithi176.stdout: NetworkManager-tui-1:1.51.0-1.el9.x86_64 2024-09-17T05:40:51.325 INFO:teuthology.orchestra.run.smithi176.stdout: librados2-2:19.3.0-4989.gce1b342b.el9.x86_64 2024-09-17T05:40:51.325 INFO:teuthology.orchestra.run.smithi176.stdout: librbd1-2:19.3.0-4989.gce1b342b.el9.x86_64 2024-09-17T05:40:51.325 INFO:teuthology.orchestra.run.smithi176.stdout: openssl-1:3.2.2-6.el9.x86_64 2024-09-17T05:40:51.325 INFO:teuthology.orchestra.run.smithi176.stdout: openssl-libs-1:3.2.2-6.el9.x86_64 2024-09-17T05:40:51.326 INFO:teuthology.orchestra.run.smithi176.stdout:Installed: 2024-09-17T05:40:51.326 INFO:teuthology.orchestra.run.smithi176.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-09-17T05:40:51.326 INFO:teuthology.orchestra.run.smithi176.stdout: automake-1.16.2-8.el9.noarch 2024-09-17T05:40:51.326 INFO:teuthology.orchestra.run.smithi176.stdout: bison-3.7.4-5.el9.x86_64 2024-09-17T05:40:51.326 INFO:teuthology.orchestra.run.smithi176.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-09-17T05:40:51.326 INFO:teuthology.orchestra.run.smithi176.stdout: ceph-2:19.3.0-4989.gce1b342b.el9.x86_64 2024-09-17T05:40:51.326 INFO:teuthology.orchestra.run.smithi176.stdout: ceph-base-2:19.3.0-4989.gce1b342b.el9.x86_64 2024-09-17T05:40:51.326 INFO:teuthology.orchestra.run.smithi176.stdout: ceph-common-2:19.3.0-4989.gce1b342b.el9.x86_64 2024-09-17T05:40:51.326 INFO:teuthology.orchestra.run.smithi176.stdout: ceph-fuse-2:19.3.0-4989.gce1b342b.el9.x86_64 2024-09-17T05:40:51.326 INFO:teuthology.orchestra.run.smithi176.stdout: ceph-grafana-dashboards-2:19.3.0-4989.gce1b342b.el9.noarch 2024-09-17T05:40:51.326 INFO:teuthology.orchestra.run.smithi176.stdout: ceph-immutable-object-cache-2:19.3.0-4989.gce1b342b.el9.x86_64 2024-09-17T05:40:51.326 INFO:teuthology.orchestra.run.smithi176.stdout: ceph-mds-2:19.3.0-4989.gce1b342b.el9.x86_64 2024-09-17T05:40:51.326 INFO:teuthology.orchestra.run.smithi176.stdout: ceph-mgr-2:19.3.0-4989.gce1b342b.el9.x86_64 2024-09-17T05:40:51.326 INFO:teuthology.orchestra.run.smithi176.stdout: ceph-mgr-cephadm-2:19.3.0-4989.gce1b342b.el9.noarch 2024-09-17T05:40:51.327 INFO:teuthology.orchestra.run.smithi176.stdout: ceph-mgr-dashboard-2:19.3.0-4989.gce1b342b.el9.noarch 2024-09-17T05:40:51.327 INFO:teuthology.orchestra.run.smithi176.stdout: ceph-mgr-diskprediction-local-2:19.3.0-4989.gce1b342b.el9.noarch 2024-09-17T05:40:51.327 INFO:teuthology.orchestra.run.smithi176.stdout: ceph-mgr-modules-core-2:19.3.0-4989.gce1b342b.el9.noarch 2024-09-17T05:40:51.327 INFO:teuthology.orchestra.run.smithi176.stdout: ceph-mgr-rook-2:19.3.0-4989.gce1b342b.el9.noarch 2024-09-17T05:40:51.327 INFO:teuthology.orchestra.run.smithi176.stdout: ceph-mon-2:19.3.0-4989.gce1b342b.el9.x86_64 2024-09-17T05:40:51.327 INFO:teuthology.orchestra.run.smithi176.stdout: ceph-osd-2:19.3.0-4989.gce1b342b.el9.x86_64 2024-09-17T05:40:51.327 INFO:teuthology.orchestra.run.smithi176.stdout: ceph-prometheus-alerts-2:19.3.0-4989.gce1b342b.el9.noarch 2024-09-17T05:40:51.327 INFO:teuthology.orchestra.run.smithi176.stdout: ceph-radosgw-2:19.3.0-4989.gce1b342b.el9.x86_64 2024-09-17T05:40:51.327 INFO:teuthology.orchestra.run.smithi176.stdout: ceph-selinux-2:19.3.0-4989.gce1b342b.el9.x86_64 2024-09-17T05:40:51.327 INFO:teuthology.orchestra.run.smithi176.stdout: ceph-test-2:19.3.0-4989.gce1b342b.el9.x86_64 2024-09-17T05:40:51.327 INFO:teuthology.orchestra.run.smithi176.stdout: ceph-volume-2:19.3.0-4989.gce1b342b.el9.noarch 2024-09-17T05:40:51.327 INFO:teuthology.orchestra.run.smithi176.stdout: cephadm-2:19.3.0-4989.gce1b342b.el9.noarch 2024-09-17T05:40:51.327 INFO:teuthology.orchestra.run.smithi176.stdout: cephfs-mirror-2:19.3.0-4989.gce1b342b.el9.x86_64 2024-09-17T05:40:51.328 INFO:teuthology.orchestra.run.smithi176.stdout: cephfs-shell-2:19.3.0-4989.gce1b342b.el9.x86_64 2024-09-17T05:40:51.328 INFO:teuthology.orchestra.run.smithi176.stdout: cephfs-top-2:19.3.0-4989.gce1b342b.el9.noarch 2024-09-17T05:40:51.328 INFO:teuthology.orchestra.run.smithi176.stdout: elfutils-libelf-devel-0.191-4.el9.x86_64 2024-09-17T05:40:51.328 INFO:teuthology.orchestra.run.smithi176.stdout: flex-2.6.4-9.el9.x86_64 2024-09-17T05:40:51.328 INFO:teuthology.orchestra.run.smithi176.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-17T05:40:51.328 INFO:teuthology.orchestra.run.smithi176.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-17T05:40:51.328 INFO:teuthology.orchestra.run.smithi176.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-17T05:40:51.328 INFO:teuthology.orchestra.run.smithi176.stdout: fuse-2.9.9-16.el9.x86_64 2024-09-17T05:40:51.328 INFO:teuthology.orchestra.run.smithi176.stdout: gperftools-libs-2.9.1-3.el9.x86_64 2024-09-17T05:40:51.328 INFO:teuthology.orchestra.run.smithi176.stdout: grpc-data-1.46.7-10.el9.noarch 2024-09-17T05:40:51.328 INFO:teuthology.orchestra.run.smithi176.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-09-17T05:40:51.328 INFO:teuthology.orchestra.run.smithi176.stdout: libarrow-9.0.0-11.el9.x86_64 2024-09-17T05:40:51.329 INFO:teuthology.orchestra.run.smithi176.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-09-17T05:40:51.329 INFO:teuthology.orchestra.run.smithi176.stdout: libcephfs-devel-2:19.3.0-4989.gce1b342b.el9.x86_64 2024-09-17T05:40:51.329 INFO:teuthology.orchestra.run.smithi176.stdout: libcephfs2-2:19.3.0-4989.gce1b342b.el9.x86_64 2024-09-17T05:40:51.329 INFO:teuthology.orchestra.run.smithi176.stdout: libcephsqlite-2:19.3.0-4989.gce1b342b.el9.x86_64 2024-09-17T05:40:51.329 INFO:teuthology.orchestra.run.smithi176.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-17T05:40:51.329 INFO:teuthology.orchestra.run.smithi176.stdout: libnbd-1.20.2-2.el9.x86_64 2024-09-17T05:40:51.329 INFO:teuthology.orchestra.run.smithi176.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-17T05:40:51.329 INFO:teuthology.orchestra.run.smithi176.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-17T05:40:51.329 INFO:teuthology.orchestra.run.smithi176.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-17T05:40:51.329 INFO:teuthology.orchestra.run.smithi176.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-17T05:40:51.329 INFO:teuthology.orchestra.run.smithi176.stdout: librados-devel-2:19.3.0-4989.gce1b342b.el9.x86_64 2024-09-17T05:40:51.329 INFO:teuthology.orchestra.run.smithi176.stdout: libradosstriper1-2:19.3.0-4989.gce1b342b.el9.x86_64 2024-09-17T05:40:51.329 INFO:teuthology.orchestra.run.smithi176.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-17T05:40:51.330 INFO:teuthology.orchestra.run.smithi176.stdout: librgw2-2:19.3.0-4989.gce1b342b.el9.x86_64 2024-09-17T05:40:51.330 INFO:teuthology.orchestra.run.smithi176.stdout: libtool-2.4.6-46.el9.x86_64 2024-09-17T05:40:51.330 INFO:teuthology.orchestra.run.smithi176.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-17T05:40:51.330 INFO:teuthology.orchestra.run.smithi176.stdout: libuuid-devel-2.37.4-20.el9.x86_64 2024-09-17T05:40:51.330 INFO:teuthology.orchestra.run.smithi176.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-09-17T05:40:51.330 INFO:teuthology.orchestra.run.smithi176.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-17T05:40:51.330 INFO:teuthology.orchestra.run.smithi176.stdout: lua-5.4.4-4.el9.x86_64 2024-09-17T05:40:51.330 INFO:teuthology.orchestra.run.smithi176.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-09-17T05:40:51.330 INFO:teuthology.orchestra.run.smithi176.stdout: luarocks-3.9.2-5.el9.noarch 2024-09-17T05:40:51.330 INFO:teuthology.orchestra.run.smithi176.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-17T05:40:51.330 INFO:teuthology.orchestra.run.smithi176.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-17T05:40:51.330 INFO:teuthology.orchestra.run.smithi176.stdout: openssl-devel-1:3.2.2-6.el9.x86_64 2024-09-17T05:40:51.330 INFO:teuthology.orchestra.run.smithi176.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-09-17T05:40:51.331 INFO:teuthology.orchestra.run.smithi176.stdout: postgresql-13.16-1.el9.x86_64 2024-09-17T05:40:51.331 INFO:teuthology.orchestra.run.smithi176.stdout: postgresql-contrib-13.16-1.el9.x86_64 2024-09-17T05:40:51.331 INFO:teuthology.orchestra.run.smithi176.stdout: postgresql-private-libs-13.16-1.el9.x86_64 2024-09-17T05:40:51.331 INFO:teuthology.orchestra.run.smithi176.stdout: postgresql-server-13.16-1.el9.x86_64 2024-09-17T05:40:51.331 INFO:teuthology.orchestra.run.smithi176.stdout: protobuf-3.14.0-13.el9.x86_64 2024-09-17T05:40:51.331 INFO:teuthology.orchestra.run.smithi176.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-09-17T05:40:51.331 INFO:teuthology.orchestra.run.smithi176.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-17T05:40:51.331 INFO:teuthology.orchestra.run.smithi176.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-09-17T05:40:51.331 INFO:teuthology.orchestra.run.smithi176.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-17T05:40:51.331 INFO:teuthology.orchestra.run.smithi176.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-17T05:40:51.331 INFO:teuthology.orchestra.run.smithi176.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-17T05:40:51.331 INFO:teuthology.orchestra.run.smithi176.stdout: python3-ceph-argparse-2:19.3.0-4989.gce1b342b.el9.x86_64 2024-09-17T05:40:51.331 INFO:teuthology.orchestra.run.smithi176.stdout: python3-ceph-common-2:19.3.0-4989.gce1b342b.el9.x86_64 2024-09-17T05:40:51.332 INFO:teuthology.orchestra.run.smithi176.stdout: python3-cephfs-2:19.3.0-4989.gce1b342b.el9.x86_64 2024-09-17T05:40:51.332 INFO:teuthology.orchestra.run.smithi176.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-17T05:40:51.332 INFO:teuthology.orchestra.run.smithi176.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-17T05:40:51.332 INFO:teuthology.orchestra.run.smithi176.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-17T05:40:51.332 INFO:teuthology.orchestra.run.smithi176.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-17T05:40:51.332 INFO:teuthology.orchestra.run.smithi176.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-09-17T05:40:51.332 INFO:teuthology.orchestra.run.smithi176.stdout: python3-colorama-0.4.6-3.el9.noarch 2024-09-17T05:40:51.332 INFO:teuthology.orchestra.run.smithi176.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-17T05:40:51.332 INFO:teuthology.orchestra.run.smithi176.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-17T05:40:51.332 INFO:teuthology.orchestra.run.smithi176.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-17T05:40:51.332 INFO:teuthology.orchestra.run.smithi176.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-09-17T05:40:51.332 INFO:teuthology.orchestra.run.smithi176.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-09-17T05:40:51.332 INFO:teuthology.orchestra.run.smithi176.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-17T05:40:51.333 INFO:teuthology.orchestra.run.smithi176.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-17T05:40:51.333 INFO:teuthology.orchestra.run.smithi176.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-17T05:40:51.333 INFO:teuthology.orchestra.run.smithi176.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-17T05:40:51.333 INFO:teuthology.orchestra.run.smithi176.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-17T05:40:51.333 INFO:teuthology.orchestra.run.smithi176.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-17T05:40:51.333 INFO:teuthology.orchestra.run.smithi176.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-17T05:40:51.333 INFO:teuthology.orchestra.run.smithi176.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-17T05:40:51.333 INFO:teuthology.orchestra.run.smithi176.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-17T05:40:51.333 INFO:teuthology.orchestra.run.smithi176.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-17T05:40:51.333 INFO:teuthology.orchestra.run.smithi176.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-17T05:40:51.333 INFO:teuthology.orchestra.run.smithi176.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-17T05:40:51.333 INFO:teuthology.orchestra.run.smithi176.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-17T05:40:51.334 INFO:teuthology.orchestra.run.smithi176.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-17T05:40:51.334 INFO:teuthology.orchestra.run.smithi176.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-17T05:40:51.334 INFO:teuthology.orchestra.run.smithi176.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-17T05:40:51.334 INFO:teuthology.orchestra.run.smithi176.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-17T05:40:51.334 INFO:teuthology.orchestra.run.smithi176.stdout: python3-packaging-20.9-5.el9.noarch 2024-09-17T05:40:51.334 INFO:teuthology.orchestra.run.smithi176.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-17T05:40:51.334 INFO:teuthology.orchestra.run.smithi176.stdout: python3-ply-3.11-14.el9.noarch 2024-09-17T05:40:51.334 INFO:teuthology.orchestra.run.smithi176.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-17T05:40:51.334 INFO:teuthology.orchestra.run.smithi176.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-17T05:40:51.334 INFO:teuthology.orchestra.run.smithi176.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-09-17T05:40:51.334 INFO:teuthology.orchestra.run.smithi176.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-17T05:40:51.335 INFO:teuthology.orchestra.run.smithi176.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-17T05:40:51.335 INFO:teuthology.orchestra.run.smithi176.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-17T05:40:51.335 INFO:teuthology.orchestra.run.smithi176.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-17T05:40:51.335 INFO:teuthology.orchestra.run.smithi176.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-09-17T05:40:51.335 INFO:teuthology.orchestra.run.smithi176.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-17T05:40:51.335 INFO:teuthology.orchestra.run.smithi176.stdout: python3-rados-2:19.3.0-4989.gce1b342b.el9.x86_64 2024-09-17T05:40:51.335 INFO:teuthology.orchestra.run.smithi176.stdout: python3-rbd-2:19.3.0-4989.gce1b342b.el9.x86_64 2024-09-17T05:40:51.335 INFO:teuthology.orchestra.run.smithi176.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-17T05:40:51.335 INFO:teuthology.orchestra.run.smithi176.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-17T05:40:51.335 INFO:teuthology.orchestra.run.smithi176.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-17T05:40:51.335 INFO:teuthology.orchestra.run.smithi176.stdout: python3-rgw-2:19.3.0-4989.gce1b342b.el9.x86_64 2024-09-17T05:40:51.335 INFO:teuthology.orchestra.run.smithi176.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-17T05:40:51.335 INFO:teuthology.orchestra.run.smithi176.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-17T05:40:51.335 INFO:teuthology.orchestra.run.smithi176.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-17T05:40:51.336 INFO:teuthology.orchestra.run.smithi176.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-17T05:40:51.336 INFO:teuthology.orchestra.run.smithi176.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-17T05:40:51.336 INFO:teuthology.orchestra.run.smithi176.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-17T05:40:51.336 INFO:teuthology.orchestra.run.smithi176.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-17T05:40:51.336 INFO:teuthology.orchestra.run.smithi176.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-09-17T05:40:51.336 INFO:teuthology.orchestra.run.smithi176.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-17T05:40:51.336 INFO:teuthology.orchestra.run.smithi176.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-17T05:40:51.336 INFO:teuthology.orchestra.run.smithi176.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-17T05:40:51.336 INFO:teuthology.orchestra.run.smithi176.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-17T05:40:51.336 INFO:teuthology.orchestra.run.smithi176.stdout: qatlib-24.02.0-1.el9.x86_64 2024-09-17T05:40:51.336 INFO:teuthology.orchestra.run.smithi176.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-09-17T05:40:51.336 INFO:teuthology.orchestra.run.smithi176.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-09-17T05:40:51.336 INFO:teuthology.orchestra.run.smithi176.stdout: rbd-fuse-2:19.3.0-4989.gce1b342b.el9.x86_64 2024-09-17T05:40:51.337 INFO:teuthology.orchestra.run.smithi176.stdout: rbd-mirror-2:19.3.0-4989.gce1b342b.el9.x86_64 2024-09-17T05:40:51.337 INFO:teuthology.orchestra.run.smithi176.stdout: rbd-nbd-2:19.3.0-4989.gce1b342b.el9.x86_64 2024-09-17T05:40:51.337 INFO:teuthology.orchestra.run.smithi176.stdout: re2-1:20211101-20.el9.x86_64 2024-09-17T05:40:51.337 INFO:teuthology.orchestra.run.smithi176.stdout: socat-1.7.4.1-6.el9.x86_64 2024-09-17T05:40:51.337 INFO:teuthology.orchestra.run.smithi176.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-17T05:40:51.337 INFO:teuthology.orchestra.run.smithi176.stdout: uuid-1.6.2-55.el9.x86_64 2024-09-17T05:40:51.337 INFO:teuthology.orchestra.run.smithi176.stdout: xfsprogs-devel-6.4.0-4.el9.x86_64 2024-09-17T05:40:51.337 INFO:teuthology.orchestra.run.smithi176.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-09-17T05:40:51.337 INFO:teuthology.orchestra.run.smithi176.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-09-17T05:40:51.337 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-09-17T05:40:51.337 INFO:teuthology.orchestra.run.smithi176.stdout:Complete! 2024-09-17T05:40:51.801 DEBUG:teuthology.parallel:result is None 2024-09-17T05:40:51.802 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=ce1b342bf8c6349a8c90cd607f83bff2443f21cf 2024-09-17T05:40:51.955 DEBUG:teuthology.orchestra.run.smithi150:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-17T05:40:51.982 INFO:teuthology.orchestra.run.smithi150.stdout:19.3.0-4989.gce1b342b.el9 2024-09-17T05:40:51.983 INFO:teuthology.packaging:The installed version of ceph is 19.3.0-4989.gce1b342b.el9 2024-09-17T05:40:51.983 INFO:teuthology.task.install:The correct ceph version 19.3.0-4989.gce1b342b is installed. 2024-09-17T05:40:51.985 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=ce1b342bf8c6349a8c90cd607f83bff2443f21cf 2024-09-17T05:40:52.129 DEBUG:teuthology.orchestra.run.smithi176:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-17T05:40:52.155 INFO:teuthology.orchestra.run.smithi176.stdout:19.3.0-4989.gce1b342b.el9 2024-09-17T05:40:52.156 INFO:teuthology.packaging:The installed version of ceph is 19.3.0-4989.gce1b342b.el9 2024-09-17T05:40:52.156 INFO:teuthology.task.install:The correct ceph version 19.3.0-4989.gce1b342b is installed. 2024-09-17T05:40:52.158 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-09-17T05:40:52.158 DEBUG:teuthology.orchestra.run.smithi150:> set -ex 2024-09-17T05:40:52.158 DEBUG:teuthology.orchestra.run.smithi150:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-17T05:40:52.191 DEBUG:teuthology.orchestra.run.smithi176:> set -ex 2024-09-17T05:40:52.191 DEBUG:teuthology.orchestra.run.smithi176:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-17T05:40:52.228 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-09-17T05:40:52.228 DEBUG:teuthology.orchestra.run.smithi150:> set -ex 2024-09-17T05:40:52.228 DEBUG:teuthology.orchestra.run.smithi150:> sudo dd of=/usr/bin/daemon-helper 2024-09-17T05:40:52.261 DEBUG:teuthology.orchestra.run.smithi150:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-17T05:40:52.330 DEBUG:teuthology.orchestra.run.smithi176:> set -ex 2024-09-17T05:40:52.330 DEBUG:teuthology.orchestra.run.smithi176:> sudo dd of=/usr/bin/daemon-helper 2024-09-17T05:40:52.359 DEBUG:teuthology.orchestra.run.smithi176:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-17T05:40:52.427 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-09-17T05:40:52.427 DEBUG:teuthology.orchestra.run.smithi150:> set -ex 2024-09-17T05:40:52.427 DEBUG:teuthology.orchestra.run.smithi150:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-17T05:40:52.456 DEBUG:teuthology.orchestra.run.smithi150:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-17T05:40:52.524 DEBUG:teuthology.orchestra.run.smithi176:> set -ex 2024-09-17T05:40:52.524 DEBUG:teuthology.orchestra.run.smithi176:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-17T05:40:52.551 DEBUG:teuthology.orchestra.run.smithi176:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-17T05:40:52.619 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-09-17T05:40:52.619 DEBUG:teuthology.orchestra.run.smithi150:> set -ex 2024-09-17T05:40:52.619 DEBUG:teuthology.orchestra.run.smithi150:> sudo dd of=/usr/bin/stdin-killer 2024-09-17T05:40:52.646 DEBUG:teuthology.orchestra.run.smithi150:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-17T05:40:52.714 DEBUG:teuthology.orchestra.run.smithi176:> set -ex 2024-09-17T05:40:52.714 DEBUG:teuthology.orchestra.run.smithi176:> sudo dd of=/usr/bin/stdin-killer 2024-09-17T05:40:52.741 DEBUG:teuthology.orchestra.run.smithi176:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-17T05:40:52.807 INFO:teuthology.run_tasks:Running task ceph... 2024-09-17T05:40:52.896 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2024-09-17T05:40:52.897 DEBUG:teuthology.orchestra.run.smithi150:> sudo chmod 777 /var/log/ceph 2024-09-17T05:40:52.899 DEBUG:teuthology.orchestra.run.smithi176:> sudo chmod 777 /var/log/ceph 2024-09-17T05:40:52.926 INFO:tasks.ceph:Disabling ceph logrotate... 2024-09-17T05:40:52.926 DEBUG:teuthology.orchestra.run.smithi150:> sudo rm -f -- /etc/logrotate.d/ceph 2024-09-17T05:40:52.968 DEBUG:teuthology.orchestra.run.smithi176:> sudo rm -f -- /etc/logrotate.d/ceph 2024-09-17T05:40:52.994 INFO:tasks.ceph:Creating extra log directories... 2024-09-17T05:40:52.995 DEBUG:teuthology.orchestra.run.smithi150:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-09-17T05:40:53.036 DEBUG:teuthology.orchestra.run.smithi176:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-09-17T05:40:53.067 INFO:tasks.ceph:Setting up log rotation with {'ceph-mds': '10G', 'ceph-osd': '10G'} 2024-09-17T05:40:53.068 INFO:tasks.ceph:writing logrotate stanza for ceph-mds 2024-09-17T05:40:53.068 INFO:tasks.ceph:writing logrotate stanza for ceph-osd 2024-09-17T05:40:53.068 DEBUG:teuthology.orchestra.run.smithi150:> set -ex 2024-09-17T05:40:53.068 DEBUG:teuthology.orchestra.run.smithi150:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2024-09-17T05:40:53.118 DEBUG:teuthology.orchestra.run.smithi150:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2024-09-17T05:40:53.231 DEBUG:teuthology.orchestra.run.smithi150:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2024-09-17T05:40:53.257 DEBUG:teuthology.orchestra.run.smithi176:> set -ex 2024-09-17T05:40:53.257 DEBUG:teuthology.orchestra.run.smithi176:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2024-09-17T05:40:53.274 DEBUG:teuthology.orchestra.run.smithi176:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2024-09-17T05:40:53.388 DEBUG:teuthology.orchestra.run.smithi176:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2024-09-17T05:40:53.419 INFO:tasks.ceph:Creating ceph cluster ceph... 2024-09-17T05:40:53.419 INFO:tasks.ceph:config {'conf': {'client': {'pid file': ''}, 'global': {'ms die on skipped message': False}, 'mgr': {'debug client': 20, 'debug finisher': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'fs.*is degraded', 'filesystem is degraded', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'filesystem is offline', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'insufficient standby MDS daemons available', 'MDS_UP_LESS_THAN_MAX', 'online, but wants', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'Degraded data redundancy', 'OSD full dropping all updates', 'OSD near full', 'pausewr flag', 'failsafe engaged, dropping updates', 'failsafe disengaged, no longer dropping', 'is full \\(reached quota', 'POOL_FULL', 'POOL_BACKFILLFULL'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2024-09-17T05:40:53.419 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/pdonnell-2024-09-17_02:09:51-fs-wip-pdonnell-testing-20240916.200549-debug-distro-default-smithi/7908628', 'branch': 'wip-pdonnell-testing-20240916.200549-debug', 'description': 'fs/volumes/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mgr mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/stock/{centos_9.stream k-stock} ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile pg_health} tasks/volumes/{overrides test/clone-progress}}', 'email': 'pdonnell@redhat.com', 'first_in_suite': False, 'job_id': '7908628', 'kernel': {'client': {'sha1': 'distro'}, 'kdb': 1, 'sha1': 'distro'}, 'ktype': 'distro', 'last_in_suite': False, 'log-rotate': {'ceph-mds': '10G', 'ceph-osd': '10G'}, 'machine_type': 'smithi', 'name': 'pdonnell-2024-09-17_02:09:51-fs-wip-pdonnell-testing-20240916.200549-debug-distro-default-smithi', 'no_nested_subset': False, 'openstack': [{'volumes': {'count': 4, 'size': 20}}, {'machine': {'disk': 200}}], 'os_type': 'centos', 'os_version': '9.stream', 'overrides': {'admin_socket': {'branch': 'wip-pdonnell-testing-20240916.200549-debug'}, 'ceph': {'cluster-conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 2, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'client mount timeout': 30, 'debug client': 20, 'debug mgr': 20, 'debug ms': 1, 'mon warn on pool no app': False}, 'mon': {'mon op complaint time': 120}, 'osd': {'osd op complaint time': 180}}, 'conf': {'client': {'pid file': ''}, 'global': {'ms die on skipped message': False}, 'mgr': {'debug client': 20, 'debug finisher': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'fs.*is degraded', 'filesystem is degraded', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'filesystem is offline', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'insufficient standby MDS daemons available', 'MDS_UP_LESS_THAN_MAX', 'online, but wants', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'Degraded data redundancy', 'OSD full dropping all updates', 'OSD near full', 'pausewr flag', 'failsafe engaged, dropping updates', 'failsafe disengaged, no longer dropping', 'is full \\(reached quota', 'POOL_FULL', 'POOL_BACKFILLFULL'], 'sha1': 'ce1b342bf8c6349a8c90cd607f83bff2443f21cf'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': 'ce1b342bf8c6349a8c90cd607f83bff2443f21cf'}}, 'kclient': {'syntax': 'v1'}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'wip-pdonnell-testing-20240916.200549-debug', 'sha1': 'ce1b342bf8c6349a8c90cd607f83bff2443f21cf'}}, 'owner': 'scheduled_pdonnell@teuthology', 'priority': 90, 'repo': 'https://git.ceph.com/ceph-ci.git', 'roles': [['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'], ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3']], 'seed': 476, 'sha1': 'ce1b342bf8c6349a8c90cd607f83bff2443f21cf', 'sleep_before_teardown': 0, 'subset': '320/512', 'suite': 'fs', 'suite_branch': 'wip-pdonnell-testing-20240916.200549-debug', 'suite_path': '/home/teuthworker/src/git.ceph.com_ceph-c_ce1b342bf8c6349a8c90cd607f83bff2443f21cf/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://git.ceph.com/ceph-ci.git', 'suite_sha1': 'ce1b342bf8c6349a8c90cd607f83bff2443f21cf', 'syslog': {'ignorelist': ['WARNING*.*check_session_state', 'WARNING*.*__ceph_remove_cap']}, 'targets': {'smithi150.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLf+a6aYY3Ccvd8VlgnMr6rqEZfGpBxOHA6TYPZrA/3hgC4fKviw6oNEaaebHXaMX3yn9PRMJ00UhyQnw4xTBng=', 'smithi176.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBEUuKpDph/hnadAMK44ypLVHDO8Zct36CM420JJMEAkWh+/ltdgQZpvegJojm5ZNkaNCm+DNLWJsdj/0d7ZnJVc='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'client': {'sha1': 'distro'}, 'kdb': 1, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': 'ce1b342bf8c6349a8c90cd607f83bff2443f21cf'}}, {'ceph': {'create_rbd_pool': False, 'cluster-conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 2, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'client mount timeout': 30, 'debug client': 20, 'debug mgr': 20, 'debug ms': 1, 'mon warn on pool no app': False}, 'mon': {'mon op complaint time': 120}, 'osd': {'osd op complaint time': 180}}, 'conf': {'client': {'pid file': ''}, 'global': {'ms die on skipped message': False}, 'mgr': {'debug client': 20, 'debug finisher': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'fs.*is degraded', 'filesystem is degraded', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'filesystem is offline', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'insufficient standby MDS daemons available', 'MDS_UP_LESS_THAN_MAX', 'online, but wants', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'Degraded data redundancy', 'OSD full dropping all updates', 'OSD near full', 'pausewr flag', 'failsafe engaged, dropping updates', 'failsafe disengaged, no longer dropping', 'is full \\(reached quota', 'POOL_FULL', 'POOL_BACKFILLFULL'], 'sha1': 'ce1b342bf8c6349a8c90cd607f83bff2443f21cf', 'cluster': 'ceph'}}, {'kclient': None}, {'cephfs_test_runner': {'fail_on_skip': False, 'modules': ['tasks.cephfs.test_volumes.TestCloneProgressReporter']}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': ["local function is_kupstream() return yaml.ktype == 'upstream' end", "local function is_kdistro() return yaml.ktype == 'distro' end", 'local function is_fuse() return false end', 'local function syntax_version() return yaml.overrides.kclient.syntax end']}, 'teuthology_branch': 'main', 'teuthology_sha1': '3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a', 'timestamp': '2024-09-17_02:09:51', 'tube': 'smithi', 'user': 'pdonnell', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.3401856'} 2024-09-17T05:40:53.420 DEBUG:teuthology.orchestra.run.smithi150:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-09-17T05:40:53.422 DEBUG:teuthology.orchestra.run.smithi176:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-09-17T05:40:53.470 DEBUG:teuthology.orchestra.run.smithi150:> sudo install -d -m0777 -- /var/run/ceph 2024-09-17T05:40:53.479 DEBUG:teuthology.orchestra.run.smithi176:> sudo install -d -m0777 -- /var/run/ceph 2024-09-17T05:40:53.537 DEBUG:teuthology.orchestra.run.smithi150:> set -ex 2024-09-17T05:40:53.537 DEBUG:teuthology.orchestra.run.smithi150:> dd if=/scratch_devs of=/dev/stdout 2024-09-17T05:40:53.558 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-17T05:40:53.559 DEBUG:teuthology.orchestra.run.smithi150:> stat /dev/vg_nvme/lv_1 2024-09-17T05:40:53.614 INFO:teuthology.orchestra.run.smithi150.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-17T05:40:53.614 INFO:teuthology.orchestra.run.smithi150.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-17T05:40:53.614 INFO:teuthology.orchestra.run.smithi150.stdout:Device: 5h/5d Inode: 667 Links: 1 2024-09-17T05:40:53.614 INFO:teuthology.orchestra.run.smithi150.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-17T05:40:53.614 INFO:teuthology.orchestra.run.smithi150.stdout:Context: system_u:object_r:device_t:s0 2024-09-17T05:40:53.614 INFO:teuthology.orchestra.run.smithi150.stdout:Access: 2024-09-17 05:40:39.091669602 +0000 2024-09-17T05:40:53.614 INFO:teuthology.orchestra.run.smithi150.stdout:Modify: 2024-09-17 05:38:44.296665406 +0000 2024-09-17T05:40:53.614 INFO:teuthology.orchestra.run.smithi150.stdout:Change: 2024-09-17 05:38:44.296665406 +0000 2024-09-17T05:40:53.614 INFO:teuthology.orchestra.run.smithi150.stdout: Birth: 2024-09-17 05:38:44.296665406 +0000 2024-09-17T05:40:53.615 DEBUG:teuthology.orchestra.run.smithi150:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-17T05:40:53.678 INFO:teuthology.orchestra.run.smithi150.stderr:1+0 records in 2024-09-17T05:40:53.678 INFO:teuthology.orchestra.run.smithi150.stderr:1+0 records out 2024-09-17T05:40:53.678 INFO:teuthology.orchestra.run.smithi150.stderr:512 bytes copied, 0.000247605 s, 2.1 MB/s 2024-09-17T05:40:53.679 DEBUG:teuthology.orchestra.run.smithi150:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-17T05:40:53.736 DEBUG:teuthology.orchestra.run.smithi150:> stat /dev/vg_nvme/lv_2 2024-09-17T05:40:53.791 INFO:teuthology.orchestra.run.smithi150.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-17T05:40:53.792 INFO:teuthology.orchestra.run.smithi150.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-17T05:40:53.792 INFO:teuthology.orchestra.run.smithi150.stdout:Device: 5h/5d Inode: 686 Links: 1 2024-09-17T05:40:53.792 INFO:teuthology.orchestra.run.smithi150.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-17T05:40:53.792 INFO:teuthology.orchestra.run.smithi150.stdout:Context: system_u:object_r:device_t:s0 2024-09-17T05:40:53.792 INFO:teuthology.orchestra.run.smithi150.stdout:Access: 2024-09-17 05:40:39.092669582 +0000 2024-09-17T05:40:53.792 INFO:teuthology.orchestra.run.smithi150.stdout:Modify: 2024-09-17 05:38:44.631658876 +0000 2024-09-17T05:40:53.792 INFO:teuthology.orchestra.run.smithi150.stdout:Change: 2024-09-17 05:38:44.631658876 +0000 2024-09-17T05:40:53.792 INFO:teuthology.orchestra.run.smithi150.stdout: Birth: 2024-09-17 05:38:44.631658876 +0000 2024-09-17T05:40:53.793 DEBUG:teuthology.orchestra.run.smithi150:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-17T05:40:53.855 INFO:teuthology.orchestra.run.smithi150.stderr:1+0 records in 2024-09-17T05:40:53.855 INFO:teuthology.orchestra.run.smithi150.stderr:1+0 records out 2024-09-17T05:40:53.855 INFO:teuthology.orchestra.run.smithi150.stderr:512 bytes copied, 0.000229422 s, 2.2 MB/s 2024-09-17T05:40:53.856 DEBUG:teuthology.orchestra.run.smithi150:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-17T05:40:53.912 DEBUG:teuthology.orchestra.run.smithi150:> stat /dev/vg_nvme/lv_3 2024-09-17T05:40:53.967 INFO:teuthology.orchestra.run.smithi150.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-17T05:40:53.967 INFO:teuthology.orchestra.run.smithi150.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-17T05:40:53.967 INFO:teuthology.orchestra.run.smithi150.stdout:Device: 5h/5d Inode: 706 Links: 1 2024-09-17T05:40:53.967 INFO:teuthology.orchestra.run.smithi150.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-17T05:40:53.967 INFO:teuthology.orchestra.run.smithi150.stdout:Context: system_u:object_r:device_t:s0 2024-09-17T05:40:53.968 INFO:teuthology.orchestra.run.smithi150.stdout:Access: 2024-09-17 05:40:39.092669582 +0000 2024-09-17T05:40:53.968 INFO:teuthology.orchestra.run.smithi150.stdout:Modify: 2024-09-17 05:38:44.960652463 +0000 2024-09-17T05:40:53.968 INFO:teuthology.orchestra.run.smithi150.stdout:Change: 2024-09-17 05:38:44.960652463 +0000 2024-09-17T05:40:53.968 INFO:teuthology.orchestra.run.smithi150.stdout: Birth: 2024-09-17 05:38:44.960652463 +0000 2024-09-17T05:40:53.968 DEBUG:teuthology.orchestra.run.smithi150:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-17T05:40:54.030 INFO:teuthology.orchestra.run.smithi150.stderr:1+0 records in 2024-09-17T05:40:54.030 INFO:teuthology.orchestra.run.smithi150.stderr:1+0 records out 2024-09-17T05:40:54.030 INFO:teuthology.orchestra.run.smithi150.stderr:512 bytes copied, 0.00018643 s, 2.7 MB/s 2024-09-17T05:40:54.031 DEBUG:teuthology.orchestra.run.smithi150:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-17T05:40:54.087 DEBUG:teuthology.orchestra.run.smithi150:> stat /dev/vg_nvme/lv_4 2024-09-17T05:40:54.142 INFO:teuthology.orchestra.run.smithi150.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-17T05:40:54.143 INFO:teuthology.orchestra.run.smithi150.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-17T05:40:54.143 INFO:teuthology.orchestra.run.smithi150.stdout:Device: 5h/5d Inode: 722 Links: 1 2024-09-17T05:40:54.143 INFO:teuthology.orchestra.run.smithi150.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-17T05:40:54.143 INFO:teuthology.orchestra.run.smithi150.stdout:Context: system_u:object_r:device_t:s0 2024-09-17T05:40:54.143 INFO:teuthology.orchestra.run.smithi150.stdout:Access: 2024-09-17 05:40:39.092669582 +0000 2024-09-17T05:40:54.143 INFO:teuthology.orchestra.run.smithi150.stdout:Modify: 2024-09-17 05:38:45.289646050 +0000 2024-09-17T05:40:54.143 INFO:teuthology.orchestra.run.smithi150.stdout:Change: 2024-09-17 05:38:45.289646050 +0000 2024-09-17T05:40:54.143 INFO:teuthology.orchestra.run.smithi150.stdout: Birth: 2024-09-17 05:38:45.289646050 +0000 2024-09-17T05:40:54.143 DEBUG:teuthology.orchestra.run.smithi150:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-17T05:40:54.206 INFO:teuthology.orchestra.run.smithi150.stderr:1+0 records in 2024-09-17T05:40:54.206 INFO:teuthology.orchestra.run.smithi150.stderr:1+0 records out 2024-09-17T05:40:54.207 INFO:teuthology.orchestra.run.smithi150.stderr:512 bytes copied, 0.000227087 s, 2.3 MB/s 2024-09-17T05:40:54.208 DEBUG:teuthology.orchestra.run.smithi150:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-17T05:40:54.264 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-17T05:40:54.264 DEBUG:teuthology.orchestra.run.smithi176:> set -ex 2024-09-17T05:40:54.265 DEBUG:teuthology.orchestra.run.smithi176:> dd if=/scratch_devs of=/dev/stdout 2024-09-17T05:40:54.284 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-17T05:40:54.284 DEBUG:teuthology.orchestra.run.smithi176:> stat /dev/vg_nvme/lv_1 2024-09-17T05:40:54.343 INFO:teuthology.orchestra.run.smithi176.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-17T05:40:54.343 INFO:teuthology.orchestra.run.smithi176.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-17T05:40:54.343 INFO:teuthology.orchestra.run.smithi176.stdout:Device: 5h/5d Inode: 666 Links: 1 2024-09-17T05:40:54.343 INFO:teuthology.orchestra.run.smithi176.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-17T05:40:54.343 INFO:teuthology.orchestra.run.smithi176.stdout:Context: system_u:object_r:device_t:s0 2024-09-17T05:40:54.343 INFO:teuthology.orchestra.run.smithi176.stdout:Access: 2024-09-17 05:40:42.605282327 +0000 2024-09-17T05:40:54.343 INFO:teuthology.orchestra.run.smithi176.stdout:Modify: 2024-09-17 05:38:42.828942071 +0000 2024-09-17T05:40:54.343 INFO:teuthology.orchestra.run.smithi176.stdout:Change: 2024-09-17 05:38:42.828942071 +0000 2024-09-17T05:40:54.343 INFO:teuthology.orchestra.run.smithi176.stdout: Birth: 2024-09-17 05:38:42.828942071 +0000 2024-09-17T05:40:54.344 DEBUG:teuthology.orchestra.run.smithi176:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-17T05:40:54.411 INFO:teuthology.orchestra.run.smithi176.stderr:1+0 records in 2024-09-17T05:40:54.411 INFO:teuthology.orchestra.run.smithi176.stderr:1+0 records out 2024-09-17T05:40:54.411 INFO:teuthology.orchestra.run.smithi176.stderr:512 bytes copied, 0.000221746 s, 2.3 MB/s 2024-09-17T05:40:54.413 DEBUG:teuthology.orchestra.run.smithi176:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-17T05:40:54.473 DEBUG:teuthology.orchestra.run.smithi176:> stat /dev/vg_nvme/lv_2 2024-09-17T05:40:54.530 INFO:teuthology.orchestra.run.smithi176.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-17T05:40:54.530 INFO:teuthology.orchestra.run.smithi176.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-17T05:40:54.530 INFO:teuthology.orchestra.run.smithi176.stdout:Device: 5h/5d Inode: 687 Links: 1 2024-09-17T05:40:54.530 INFO:teuthology.orchestra.run.smithi176.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-17T05:40:54.530 INFO:teuthology.orchestra.run.smithi176.stdout:Context: system_u:object_r:device_t:s0 2024-09-17T05:40:54.531 INFO:teuthology.orchestra.run.smithi176.stdout:Access: 2024-09-17 05:40:42.605282327 +0000 2024-09-17T05:40:54.531 INFO:teuthology.orchestra.run.smithi176.stdout:Modify: 2024-09-17 05:38:43.159938924 +0000 2024-09-17T05:40:54.531 INFO:teuthology.orchestra.run.smithi176.stdout:Change: 2024-09-17 05:38:43.159938924 +0000 2024-09-17T05:40:54.531 INFO:teuthology.orchestra.run.smithi176.stdout: Birth: 2024-09-17 05:38:43.159938924 +0000 2024-09-17T05:40:54.531 DEBUG:teuthology.orchestra.run.smithi176:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-17T05:40:54.597 INFO:teuthology.orchestra.run.smithi176.stderr:1+0 records in 2024-09-17T05:40:54.598 INFO:teuthology.orchestra.run.smithi176.stderr:1+0 records out 2024-09-17T05:40:54.598 INFO:teuthology.orchestra.run.smithi176.stderr:512 bytes copied, 0.000224636 s, 2.3 MB/s 2024-09-17T05:40:54.599 DEBUG:teuthology.orchestra.run.smithi176:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-17T05:40:54.657 DEBUG:teuthology.orchestra.run.smithi176:> stat /dev/vg_nvme/lv_3 2024-09-17T05:40:54.715 INFO:teuthology.orchestra.run.smithi176.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-17T05:40:54.715 INFO:teuthology.orchestra.run.smithi176.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-17T05:40:54.715 INFO:teuthology.orchestra.run.smithi176.stdout:Device: 5h/5d Inode: 704 Links: 1 2024-09-17T05:40:54.715 INFO:teuthology.orchestra.run.smithi176.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-17T05:40:54.715 INFO:teuthology.orchestra.run.smithi176.stdout:Context: system_u:object_r:device_t:s0 2024-09-17T05:40:54.715 INFO:teuthology.orchestra.run.smithi176.stdout:Access: 2024-09-17 05:40:42.606282317 +0000 2024-09-17T05:40:54.715 INFO:teuthology.orchestra.run.smithi176.stdout:Modify: 2024-09-17 05:38:43.483935845 +0000 2024-09-17T05:40:54.715 INFO:teuthology.orchestra.run.smithi176.stdout:Change: 2024-09-17 05:38:43.483935845 +0000 2024-09-17T05:40:54.715 INFO:teuthology.orchestra.run.smithi176.stdout: Birth: 2024-09-17 05:38:43.483935845 +0000 2024-09-17T05:40:54.716 DEBUG:teuthology.orchestra.run.smithi176:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-17T05:40:54.780 INFO:teuthology.orchestra.run.smithi176.stderr:1+0 records in 2024-09-17T05:40:54.780 INFO:teuthology.orchestra.run.smithi176.stderr:1+0 records out 2024-09-17T05:40:54.780 INFO:teuthology.orchestra.run.smithi176.stderr:512 bytes copied, 0.000269343 s, 1.9 MB/s 2024-09-17T05:40:54.781 DEBUG:teuthology.orchestra.run.smithi176:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-17T05:40:54.839 DEBUG:teuthology.orchestra.run.smithi176:> stat /dev/vg_nvme/lv_4 2024-09-17T05:40:54.896 INFO:teuthology.orchestra.run.smithi176.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-17T05:40:54.896 INFO:teuthology.orchestra.run.smithi176.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-17T05:40:54.896 INFO:teuthology.orchestra.run.smithi176.stdout:Device: 5h/5d Inode: 725 Links: 1 2024-09-17T05:40:54.896 INFO:teuthology.orchestra.run.smithi176.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-17T05:40:54.896 INFO:teuthology.orchestra.run.smithi176.stdout:Context: system_u:object_r:device_t:s0 2024-09-17T05:40:54.896 INFO:teuthology.orchestra.run.smithi176.stdout:Access: 2024-09-17 05:40:42.606282317 +0000 2024-09-17T05:40:54.897 INFO:teuthology.orchestra.run.smithi176.stdout:Modify: 2024-09-17 05:38:43.811932727 +0000 2024-09-17T05:40:54.897 INFO:teuthology.orchestra.run.smithi176.stdout:Change: 2024-09-17 05:38:43.811932727 +0000 2024-09-17T05:40:54.897 INFO:teuthology.orchestra.run.smithi176.stdout: Birth: 2024-09-17 05:38:43.811932727 +0000 2024-09-17T05:40:54.897 DEBUG:teuthology.orchestra.run.smithi176:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-17T05:40:54.960 INFO:teuthology.orchestra.run.smithi176.stderr:1+0 records in 2024-09-17T05:40:54.960 INFO:teuthology.orchestra.run.smithi176.stderr:1+0 records out 2024-09-17T05:40:54.960 INFO:teuthology.orchestra.run.smithi176.stderr:512 bytes copied, 0.000192362 s, 2.7 MB/s 2024-09-17T05:40:54.961 DEBUG:teuthology.orchestra.run.smithi176:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-17T05:40:55.018 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-17T05:40:55.019 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi150.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi176.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-09-17T05:40:55.019 INFO:tasks.ceph:Generating config... 2024-09-17T05:40:55.020 INFO:tasks.ceph:[client] pid file = 2024-09-17T05:40:55.020 INFO:tasks.ceph:[global] ms die on skipped message = False 2024-09-17T05:40:55.020 INFO:tasks.ceph:[mgr] debug client = 20 2024-09-17T05:40:55.020 INFO:tasks.ceph:[mgr] debug finisher = 20 2024-09-17T05:40:55.020 INFO:tasks.ceph:[mgr] debug mgr = 20 2024-09-17T05:40:55.020 INFO:tasks.ceph:[mgr] debug ms = 1 2024-09-17T05:40:55.021 INFO:tasks.ceph:[mon] debug mon = 20 2024-09-17T05:40:55.021 INFO:tasks.ceph:[mon] debug ms = 1 2024-09-17T05:40:55.021 INFO:tasks.ceph:[mon] debug paxos = 20 2024-09-17T05:40:55.021 INFO:tasks.ceph:[mon] mon down mkfs grace = 300 2024-09-17T05:40:55.021 INFO:tasks.ceph:[osd] bdev async discard = True 2024-09-17T05:40:55.021 INFO:tasks.ceph:[osd] bdev enable discard = True 2024-09-17T05:40:55.021 INFO:tasks.ceph:[osd] bluestore allocator = bitmap 2024-09-17T05:40:55.021 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2024-09-17T05:40:55.021 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2024-09-17T05:40:55.021 INFO:tasks.ceph:[osd] debug bluefs = 1/20 2024-09-17T05:40:55.021 INFO:tasks.ceph:[osd] debug bluestore = 1/20 2024-09-17T05:40:55.021 INFO:tasks.ceph:[osd] debug ms = 1 2024-09-17T05:40:55.021 INFO:tasks.ceph:[osd] debug osd = 20 2024-09-17T05:40:55.021 INFO:tasks.ceph:[osd] debug rocksdb = 4/10 2024-09-17T05:40:55.022 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2024-09-17T05:40:55.022 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2024-09-17T05:40:55.022 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2024-09-17T05:40:55.022 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2024-09-17T05:40:55.022 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2024-09-17T05:40:55.022 INFO:tasks.ceph:Setting up mon.a... 2024-09-17T05:40:55.022 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2024-09-17T05:40:55.083 INFO:teuthology.orchestra.run.smithi150.stdout:creating /etc/ceph/ceph.keyring 2024-09-17T05:40:55.086 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2024-09-17T05:40:55.142 DEBUG:teuthology.orchestra.run.smithi150:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-17T05:40:55.167 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.150'), ('mon.b', '172.21.15.176'), ('mon.c', '[v2:172.21.15.176:3301,v1:172.21.15.176:6790]')] 2024-09-17T05:40:55.168 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.150,172.21.15.176,[v2:172.21.15.176:3301,v1:172.21.15.176:6790]', 'ms die on skipped message': False}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd debug trim objects': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false', 'debug client': 20, 'debug finisher': 20}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon down mkfs grace': 300}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'pid file': ''}, 'mon.a': {}, 'mon.b': {}, 'mon.c': {}, 'mds.a': {}, 'mds.c': {}, 'mds.b': {}, 'mds.d': {}} 2024-09-17T05:40:55.169 DEBUG:teuthology.orchestra.run.smithi150:> set -ex 2024-09-17T05:40:55.169 DEBUG:teuthology.orchestra.run.smithi150:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2024-09-17T05:40:55.224 DEBUG:teuthology.orchestra.run.smithi150:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.150 --add b 172.21.15.176 --addv c '[v2:172.21.15.176:3301,v1:172.21.15.176:6790]' --print /home/ubuntu/cephtest/ceph.monmap 2024-09-17T05:40:55.321 INFO:teuthology.orchestra.run.smithi150.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2024-09-17T05:40:55.322 INFO:teuthology.orchestra.run.smithi150.stdout:monmaptool: generated fsid 9f2e05e9-d629-47b3-b26b-1360655b7d20 2024-09-17T05:40:55.322 INFO:teuthology.orchestra.run.smithi150.stdout:setting min_mon_release = quincy 2024-09-17T05:40:55.322 INFO:teuthology.orchestra.run.smithi150.stdout:epoch 0 2024-09-17T05:40:55.322 INFO:teuthology.orchestra.run.smithi150.stdout:fsid 9f2e05e9-d629-47b3-b26b-1360655b7d20 2024-09-17T05:40:55.322 INFO:teuthology.orchestra.run.smithi150.stdout:last_changed 2024-09-17T05:40:55.321912+0000 2024-09-17T05:40:55.322 INFO:teuthology.orchestra.run.smithi150.stdout:created 2024-09-17T05:40:55.321912+0000 2024-09-17T05:40:55.322 INFO:teuthology.orchestra.run.smithi150.stdout:min_mon_release 17 (quincy) 2024-09-17T05:40:55.322 INFO:teuthology.orchestra.run.smithi150.stdout:election_strategy: 1 2024-09-17T05:40:55.322 INFO:teuthology.orchestra.run.smithi150.stdout:0: [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] mon.a 2024-09-17T05:40:55.322 INFO:teuthology.orchestra.run.smithi150.stdout:1: [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] mon.b 2024-09-17T05:40:55.322 INFO:teuthology.orchestra.run.smithi150.stdout:2: [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] mon.c 2024-09-17T05:40:55.322 INFO:teuthology.orchestra.run.smithi150.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2024-09-17T05:40:55.324 DEBUG:teuthology.orchestra.run.smithi150:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2024-09-17T05:40:55.338 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID 9f2e05e9-d629-47b3-b26b-1360655b7d20... 2024-09-17T05:40:55.339 DEBUG:teuthology.orchestra.run.smithi150:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-09-17T05:40:55.381 DEBUG:teuthology.orchestra.run.smithi176:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-09-17T05:40:55.421 INFO:teuthology.orchestra.run.smithi150.stdout:[global] 2024-09-17T05:40:55.421 INFO:teuthology.orchestra.run.smithi150.stdout: chdir = "" 2024-09-17T05:40:55.421 INFO:teuthology.orchestra.run.smithi150.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-09-17T05:40:55.421 INFO:teuthology.orchestra.run.smithi150.stdout: auth supported = cephx 2024-09-17T05:40:55.421 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-09-17T05:40:55.421 INFO:teuthology.orchestra.run.smithi150.stdout: filestore xattr use omap = true 2024-09-17T05:40:55.422 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-09-17T05:40:55.422 INFO:teuthology.orchestra.run.smithi150.stdout: mon clock drift allowed = 1.000 2024-09-17T05:40:55.422 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-09-17T05:40:55.422 INFO:teuthology.orchestra.run.smithi150.stdout: osd crush chooseleaf type = 0 2024-09-17T05:40:55.422 INFO:teuthology.orchestra.run.smithi150.stdout: auth debug = true 2024-09-17T05:40:55.422 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-09-17T05:40:55.422 INFO:teuthology.orchestra.run.smithi150.stdout: ms die on old message = true 2024-09-17T05:40:55.422 INFO:teuthology.orchestra.run.smithi150.stdout: ms die on bug = true 2024-09-17T05:40:55.422 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-09-17T05:40:55.422 INFO:teuthology.orchestra.run.smithi150.stdout: mon max pg per osd = 10000 # >= luminous 2024-09-17T05:40:55.422 INFO:teuthology.orchestra.run.smithi150.stdout: mon pg warn max object skew = 0 2024-09-17T05:40:55.422 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-09-17T05:40:55.422 INFO:teuthology.orchestra.run.smithi150.stdout: # disable pg_autoscaler by default for new pools 2024-09-17T05:40:55.423 INFO:teuthology.orchestra.run.smithi150.stdout: osd_pool_default_pg_autoscale_mode = off 2024-09-17T05:40:55.423 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-09-17T05:40:55.423 INFO:teuthology.orchestra.run.smithi150.stdout: osd pool default size = 2 2024-09-17T05:40:55.423 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-09-17T05:40:55.423 INFO:teuthology.orchestra.run.smithi150.stdout: mon osd allow primary affinity = true 2024-09-17T05:40:55.423 INFO:teuthology.orchestra.run.smithi150.stdout: mon osd allow pg remap = true 2024-09-17T05:40:55.423 INFO:teuthology.orchestra.run.smithi150.stdout: mon warn on legacy crush tunables = false 2024-09-17T05:40:55.423 INFO:teuthology.orchestra.run.smithi150.stdout: mon warn on crush straw calc version zero = false 2024-09-17T05:40:55.423 INFO:teuthology.orchestra.run.smithi150.stdout: mon warn on no sortbitwise = false 2024-09-17T05:40:55.423 INFO:teuthology.orchestra.run.smithi150.stdout: mon warn on osd down out interval zero = false 2024-09-17T05:40:55.423 INFO:teuthology.orchestra.run.smithi150.stdout: mon warn on too few osds = false 2024-09-17T05:40:55.423 INFO:teuthology.orchestra.run.smithi150.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-09-17T05:40:55.423 INFO:teuthology.orchestra.run.smithi150.stdout: mon_warn_on_pool_no_redundancy = false 2024-09-17T05:40:55.423 INFO:teuthology.orchestra.run.smithi150.stdout: mon_allow_pool_size_one = true 2024-09-17T05:40:55.424 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-09-17T05:40:55.424 INFO:teuthology.orchestra.run.smithi150.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-09-17T05:40:55.424 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-09-17T05:40:55.424 INFO:teuthology.orchestra.run.smithi150.stdout: osd default data pool replay window = 5 2024-09-17T05:40:55.424 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-09-17T05:40:55.424 INFO:teuthology.orchestra.run.smithi150.stdout: mon allow pool delete = true 2024-09-17T05:40:55.424 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-09-17T05:40:55.424 INFO:teuthology.orchestra.run.smithi150.stdout: mon cluster log file level = debug 2024-09-17T05:40:55.424 INFO:teuthology.orchestra.run.smithi150.stdout: debug asserts on shutdown = true 2024-09-17T05:40:55.424 INFO:teuthology.orchestra.run.smithi150.stdout: mon health detail to clog = false 2024-09-17T05:40:55.424 INFO:teuthology.orchestra.run.smithi150.stdout: mon host = "172.21.15.150,172.21.15.176,[v2:172.21.15.176:3301,v1:172.21.15.176:6790]" 2024-09-17T05:40:55.424 INFO:teuthology.orchestra.run.smithi150.stdout: ms die on skipped message = False 2024-09-17T05:40:55.424 INFO:teuthology.orchestra.run.smithi150.stdout: fsid = 9f2e05e9-d629-47b3-b26b-1360655b7d20 2024-09-17T05:40:55.424 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-09-17T05:40:55.425 INFO:teuthology.orchestra.run.smithi150.stdout:[osd] 2024-09-17T05:40:55.425 INFO:teuthology.orchestra.run.smithi150.stdout: osd journal size = 100 2024-09-17T05:40:55.425 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-09-17T05:40:55.425 INFO:teuthology.orchestra.run.smithi150.stdout: osd scrub load threshold = 5.0 2024-09-17T05:40:55.425 INFO:teuthology.orchestra.run.smithi150.stdout: osd scrub max interval = 600 2024-09-17T05:40:55.425 INFO:teuthology.orchestra.run.smithi150.stdout: osd mclock profile = high_recovery_ops 2024-09-17T05:40:55.425 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-09-17T05:40:55.425 INFO:teuthology.orchestra.run.smithi150.stdout: osd recover clone overlap = true 2024-09-17T05:40:55.425 INFO:teuthology.orchestra.run.smithi150.stdout: osd recovery max chunk = 1048576 2024-09-17T05:40:55.425 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-09-17T05:40:55.425 INFO:teuthology.orchestra.run.smithi150.stdout: osd debug shutdown = true 2024-09-17T05:40:55.425 INFO:teuthology.orchestra.run.smithi150.stdout: osd debug op order = true 2024-09-17T05:40:55.425 INFO:teuthology.orchestra.run.smithi150.stdout: osd debug verify stray on activate = true 2024-09-17T05:40:55.425 INFO:teuthology.orchestra.run.smithi150.stdout: osd debug trim objects = true 2024-09-17T05:40:55.426 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-09-17T05:40:55.426 INFO:teuthology.orchestra.run.smithi150.stdout: osd open classes on start = true 2024-09-17T05:40:55.426 INFO:teuthology.orchestra.run.smithi150.stdout: osd debug pg log writeout = true 2024-09-17T05:40:55.426 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-09-17T05:40:55.426 INFO:teuthology.orchestra.run.smithi150.stdout: osd deep scrub update digest min age = 30 2024-09-17T05:40:55.426 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-09-17T05:40:55.426 INFO:teuthology.orchestra.run.smithi150.stdout: osd map max advance = 10 2024-09-17T05:40:55.426 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-09-17T05:40:55.426 INFO:teuthology.orchestra.run.smithi150.stdout: journal zero on create = true 2024-09-17T05:40:55.426 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-09-17T05:40:55.426 INFO:teuthology.orchestra.run.smithi150.stdout: filestore ondisk finisher threads = 3 2024-09-17T05:40:55.426 INFO:teuthology.orchestra.run.smithi150.stdout: filestore apply finisher threads = 3 2024-09-17T05:40:55.426 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-09-17T05:40:55.427 INFO:teuthology.orchestra.run.smithi150.stdout: bdev debug aio = true 2024-09-17T05:40:55.427 INFO:teuthology.orchestra.run.smithi150.stdout: osd debug misdirected ops = true 2024-09-17T05:40:55.427 INFO:teuthology.orchestra.run.smithi150.stdout: bdev async discard = True 2024-09-17T05:40:55.427 INFO:teuthology.orchestra.run.smithi150.stdout: bdev enable discard = True 2024-09-17T05:40:55.427 INFO:teuthology.orchestra.run.smithi150.stdout: bluestore allocator = bitmap 2024-09-17T05:40:55.427 INFO:teuthology.orchestra.run.smithi150.stdout: bluestore block size = 96636764160 2024-09-17T05:40:55.427 INFO:teuthology.orchestra.run.smithi150.stdout: bluestore fsck on mount = True 2024-09-17T05:40:55.427 INFO:teuthology.orchestra.run.smithi150.stdout: debug bluefs = 1/20 2024-09-17T05:40:55.427 INFO:teuthology.orchestra.run.smithi150.stdout: debug bluestore = 1/20 2024-09-17T05:40:55.427 INFO:teuthology.orchestra.run.smithi150.stdout: debug ms = 1 2024-09-17T05:40:55.427 INFO:teuthology.orchestra.run.smithi150.stdout: debug osd = 20 2024-09-17T05:40:55.427 INFO:teuthology.orchestra.run.smithi150.stdout: debug rocksdb = 4/10 2024-09-17T05:40:55.427 INFO:teuthology.orchestra.run.smithi150.stdout: mon osd backfillfull_ratio = 0.85 2024-09-17T05:40:55.427 INFO:teuthology.orchestra.run.smithi150.stdout: mon osd full ratio = 0.9 2024-09-17T05:40:55.428 INFO:teuthology.orchestra.run.smithi150.stdout: mon osd nearfull ratio = 0.8 2024-09-17T05:40:55.428 INFO:teuthology.orchestra.run.smithi150.stdout: osd failsafe full ratio = 0.95 2024-09-17T05:40:55.428 INFO:teuthology.orchestra.run.smithi150.stdout: osd objectstore = bluestore 2024-09-17T05:40:55.428 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-09-17T05:40:55.428 INFO:teuthology.orchestra.run.smithi150.stdout:[mgr] 2024-09-17T05:40:55.428 INFO:teuthology.orchestra.run.smithi150.stdout: debug ms = 1 2024-09-17T05:40:55.428 INFO:teuthology.orchestra.run.smithi150.stdout: debug mgr = 20 2024-09-17T05:40:55.428 INFO:teuthology.orchestra.run.smithi150.stdout: debug mon = 20 2024-09-17T05:40:55.428 INFO:teuthology.orchestra.run.smithi150.stdout: debug auth = 20 2024-09-17T05:40:55.428 INFO:teuthology.orchestra.run.smithi150.stdout: mon reweight min pgs per osd = 4 2024-09-17T05:40:55.428 INFO:teuthology.orchestra.run.smithi150.stdout: mon reweight min bytes per osd = 10 2024-09-17T05:40:55.428 INFO:teuthology.orchestra.run.smithi150.stdout: mgr/telemetry/nag = false 2024-09-17T05:40:55.428 INFO:teuthology.orchestra.run.smithi150.stdout: debug client = 20 2024-09-17T05:40:55.428 INFO:teuthology.orchestra.run.smithi150.stdout: debug finisher = 20 2024-09-17T05:40:55.429 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-09-17T05:40:55.429 INFO:teuthology.orchestra.run.smithi150.stdout:[mon] 2024-09-17T05:40:55.429 INFO:teuthology.orchestra.run.smithi150.stdout: debug ms = 1 2024-09-17T05:40:55.429 INFO:teuthology.orchestra.run.smithi150.stdout: debug mon = 20 2024-09-17T05:40:55.429 INFO:teuthology.orchestra.run.smithi150.stdout: debug paxos = 20 2024-09-17T05:40:55.429 INFO:teuthology.orchestra.run.smithi150.stdout: debug auth = 20 2024-09-17T05:40:55.429 INFO:teuthology.orchestra.run.smithi150.stdout: mon data avail warn = 5 2024-09-17T05:40:55.429 INFO:teuthology.orchestra.run.smithi150.stdout: mon mgr mkfs grace = 240 2024-09-17T05:40:55.429 INFO:teuthology.orchestra.run.smithi150.stdout: mon reweight min pgs per osd = 4 2024-09-17T05:40:55.429 INFO:teuthology.orchestra.run.smithi150.stdout: mon osd reporter subtree level = osd 2024-09-17T05:40:55.429 INFO:teuthology.orchestra.run.smithi150.stdout: mon osd prime pg temp = true 2024-09-17T05:40:55.429 INFO:teuthology.orchestra.run.smithi150.stdout: mon reweight min bytes per osd = 10 2024-09-17T05:40:55.429 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-09-17T05:40:55.430 INFO:teuthology.orchestra.run.smithi150.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-09-17T05:40:55.430 INFO:teuthology.orchestra.run.smithi150.stdout: auth mon ticket ttl = 660 # 11m 2024-09-17T05:40:55.430 INFO:teuthology.orchestra.run.smithi150.stdout: auth service ticket ttl = 240 # 4m 2024-09-17T05:40:55.430 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-09-17T05:40:55.430 INFO:teuthology.orchestra.run.smithi150.stdout: # don't complain about insecure global_id in the test suite 2024-09-17T05:40:55.430 INFO:teuthology.orchestra.run.smithi150.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-09-17T05:40:55.430 INFO:teuthology.orchestra.run.smithi150.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-09-17T05:40:55.430 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-09-17T05:40:55.430 INFO:teuthology.orchestra.run.smithi150.stdout: # 1m isn't quite enough 2024-09-17T05:40:55.430 INFO:teuthology.orchestra.run.smithi150.stdout: mon_down_mkfs_grace = 2m 2024-09-17T05:40:55.430 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-09-17T05:40:55.430 INFO:teuthology.orchestra.run.smithi150.stdout: mon_warn_on_filestore_osds = false 2024-09-17T05:40:55.430 INFO:teuthology.orchestra.run.smithi150.stdout: mon down mkfs grace = 300 2024-09-17T05:40:55.430 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-09-17T05:40:55.431 INFO:teuthology.orchestra.run.smithi150.stdout:[client] 2024-09-17T05:40:55.431 INFO:teuthology.orchestra.run.smithi150.stdout: rgw cache enabled = true 2024-09-17T05:40:55.431 INFO:teuthology.orchestra.run.smithi150.stdout: rgw enable ops log = true 2024-09-17T05:40:55.431 INFO:teuthology.orchestra.run.smithi150.stdout: rgw enable usage log = true 2024-09-17T05:40:55.431 INFO:teuthology.orchestra.run.smithi150.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-09-17T05:40:55.431 INFO:teuthology.orchestra.run.smithi150.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-09-17T05:40:55.431 INFO:teuthology.orchestra.run.smithi150.stdout: pid file = "" 2024-09-17T05:40:55.431 INFO:teuthology.orchestra.run.smithi150.stdout:[mon.a] 2024-09-17T05:40:55.431 INFO:teuthology.orchestra.run.smithi150.stdout:[mon.b] 2024-09-17T05:40:55.431 INFO:teuthology.orchestra.run.smithi150.stdout:[mon.c] 2024-09-17T05:40:55.431 INFO:teuthology.orchestra.run.smithi150.stdout:[mds.a] 2024-09-17T05:40:55.431 INFO:teuthology.orchestra.run.smithi150.stdout:[mds.c] 2024-09-17T05:40:55.431 INFO:teuthology.orchestra.run.smithi150.stdout:[mds.b] 2024-09-17T05:40:55.431 INFO:teuthology.orchestra.run.smithi150.stdout:[mds.d] 2024-09-17T05:40:55.432 INFO:teuthology.orchestra.run.smithi176.stdout:[global] 2024-09-17T05:40:55.432 INFO:teuthology.orchestra.run.smithi176.stdout: chdir = "" 2024-09-17T05:40:55.432 INFO:teuthology.orchestra.run.smithi176.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-09-17T05:40:55.432 INFO:teuthology.orchestra.run.smithi176.stdout: auth supported = cephx 2024-09-17T05:40:55.432 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-09-17T05:40:55.432 INFO:teuthology.orchestra.run.smithi176.stdout: filestore xattr use omap = true 2024-09-17T05:40:55.432 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-09-17T05:40:55.432 INFO:teuthology.orchestra.run.smithi176.stdout: mon clock drift allowed = 1.000 2024-09-17T05:40:55.432 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-09-17T05:40:55.432 INFO:teuthology.orchestra.run.smithi176.stdout: osd crush chooseleaf type = 0 2024-09-17T05:40:55.432 INFO:teuthology.orchestra.run.smithi176.stdout: auth debug = true 2024-09-17T05:40:55.433 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-09-17T05:40:55.433 INFO:teuthology.orchestra.run.smithi176.stdout: ms die on old message = true 2024-09-17T05:40:55.433 INFO:teuthology.orchestra.run.smithi176.stdout: ms die on bug = true 2024-09-17T05:40:55.433 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-09-17T05:40:55.433 INFO:teuthology.orchestra.run.smithi176.stdout: mon max pg per osd = 10000 # >= luminous 2024-09-17T05:40:55.433 INFO:teuthology.orchestra.run.smithi176.stdout: mon pg warn max object skew = 0 2024-09-17T05:40:55.433 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-09-17T05:40:55.433 INFO:teuthology.orchestra.run.smithi176.stdout: # disable pg_autoscaler by default for new pools 2024-09-17T05:40:55.433 INFO:teuthology.orchestra.run.smithi176.stdout: osd_pool_default_pg_autoscale_mode = off 2024-09-17T05:40:55.433 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-09-17T05:40:55.433 INFO:teuthology.orchestra.run.smithi176.stdout: osd pool default size = 2 2024-09-17T05:40:55.433 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-09-17T05:40:55.433 INFO:teuthology.orchestra.run.smithi176.stdout: mon osd allow primary affinity = true 2024-09-17T05:40:55.433 INFO:teuthology.orchestra.run.smithi176.stdout: mon osd allow pg remap = true 2024-09-17T05:40:55.434 INFO:teuthology.orchestra.run.smithi176.stdout: mon warn on legacy crush tunables = false 2024-09-17T05:40:55.434 INFO:teuthology.orchestra.run.smithi176.stdout: mon warn on crush straw calc version zero = false 2024-09-17T05:40:55.434 INFO:teuthology.orchestra.run.smithi176.stdout: mon warn on no sortbitwise = false 2024-09-17T05:40:55.434 INFO:teuthology.orchestra.run.smithi176.stdout: mon warn on osd down out interval zero = false 2024-09-17T05:40:55.434 INFO:teuthology.orchestra.run.smithi176.stdout: mon warn on too few osds = false 2024-09-17T05:40:55.434 INFO:teuthology.orchestra.run.smithi176.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-09-17T05:40:55.434 INFO:teuthology.orchestra.run.smithi176.stdout: mon_warn_on_pool_no_redundancy = false 2024-09-17T05:40:55.434 INFO:teuthology.orchestra.run.smithi176.stdout: mon_allow_pool_size_one = true 2024-09-17T05:40:55.434 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-09-17T05:40:55.434 INFO:teuthology.orchestra.run.smithi176.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-09-17T05:40:55.434 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-09-17T05:40:55.434 INFO:teuthology.orchestra.run.smithi176.stdout: osd default data pool replay window = 5 2024-09-17T05:40:55.434 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-09-17T05:40:55.434 INFO:teuthology.orchestra.run.smithi176.stdout: mon allow pool delete = true 2024-09-17T05:40:55.434 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-09-17T05:40:55.435 INFO:teuthology.orchestra.run.smithi176.stdout: mon cluster log file level = debug 2024-09-17T05:40:55.435 INFO:teuthology.orchestra.run.smithi176.stdout: debug asserts on shutdown = true 2024-09-17T05:40:55.435 INFO:teuthology.orchestra.run.smithi176.stdout: mon health detail to clog = false 2024-09-17T05:40:55.435 INFO:teuthology.orchestra.run.smithi176.stdout: mon host = "172.21.15.150,172.21.15.176,[v2:172.21.15.176:3301,v1:172.21.15.176:6790]" 2024-09-17T05:40:55.435 INFO:teuthology.orchestra.run.smithi176.stdout: ms die on skipped message = False 2024-09-17T05:40:55.435 INFO:teuthology.orchestra.run.smithi176.stdout: fsid = 9f2e05e9-d629-47b3-b26b-1360655b7d20 2024-09-17T05:40:55.435 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-09-17T05:40:55.435 INFO:teuthology.orchestra.run.smithi176.stdout:[osd] 2024-09-17T05:40:55.435 INFO:teuthology.orchestra.run.smithi176.stdout: osd journal size = 100 2024-09-17T05:40:55.435 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-09-17T05:40:55.435 INFO:teuthology.orchestra.run.smithi176.stdout: osd scrub load threshold = 5.0 2024-09-17T05:40:55.435 INFO:teuthology.orchestra.run.smithi176.stdout: osd scrub max interval = 600 2024-09-17T05:40:55.435 INFO:teuthology.orchestra.run.smithi176.stdout: osd mclock profile = high_recovery_ops 2024-09-17T05:40:55.435 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-09-17T05:40:55.435 INFO:teuthology.orchestra.run.smithi176.stdout: osd recover clone overlap = true 2024-09-17T05:40:55.435 INFO:teuthology.orchestra.run.smithi176.stdout: osd recovery max chunk = 1048576 2024-09-17T05:40:55.436 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-09-17T05:40:55.436 INFO:teuthology.orchestra.run.smithi176.stdout: osd debug shutdown = true 2024-09-17T05:40:55.436 INFO:teuthology.orchestra.run.smithi176.stdout: osd debug op order = true 2024-09-17T05:40:55.436 INFO:teuthology.orchestra.run.smithi176.stdout: osd debug verify stray on activate = true 2024-09-17T05:40:55.436 INFO:teuthology.orchestra.run.smithi176.stdout: osd debug trim objects = true 2024-09-17T05:40:55.436 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-09-17T05:40:55.436 INFO:teuthology.orchestra.run.smithi176.stdout: osd open classes on start = true 2024-09-17T05:40:55.436 INFO:teuthology.orchestra.run.smithi176.stdout: osd debug pg log writeout = true 2024-09-17T05:40:55.436 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-09-17T05:40:55.436 INFO:teuthology.orchestra.run.smithi176.stdout: osd deep scrub update digest min age = 30 2024-09-17T05:40:55.436 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-09-17T05:40:55.436 INFO:teuthology.orchestra.run.smithi176.stdout: osd map max advance = 10 2024-09-17T05:40:55.436 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-09-17T05:40:55.436 INFO:teuthology.orchestra.run.smithi176.stdout: journal zero on create = true 2024-09-17T05:40:55.437 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-09-17T05:40:55.437 INFO:teuthology.orchestra.run.smithi176.stdout: filestore ondisk finisher threads = 3 2024-09-17T05:40:55.437 INFO:teuthology.orchestra.run.smithi176.stdout: filestore apply finisher threads = 3 2024-09-17T05:40:55.437 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-09-17T05:40:55.437 INFO:teuthology.orchestra.run.smithi176.stdout: bdev debug aio = true 2024-09-17T05:40:55.437 INFO:teuthology.orchestra.run.smithi176.stdout: osd debug misdirected ops = true 2024-09-17T05:40:55.437 INFO:teuthology.orchestra.run.smithi176.stdout: bdev async discard = True 2024-09-17T05:40:55.437 INFO:teuthology.orchestra.run.smithi176.stdout: bdev enable discard = True 2024-09-17T05:40:55.437 INFO:teuthology.orchestra.run.smithi176.stdout: bluestore allocator = bitmap 2024-09-17T05:40:55.437 INFO:teuthology.orchestra.run.smithi176.stdout: bluestore block size = 96636764160 2024-09-17T05:40:55.437 INFO:teuthology.orchestra.run.smithi176.stdout: bluestore fsck on mount = True 2024-09-17T05:40:55.437 INFO:teuthology.orchestra.run.smithi176.stdout: debug bluefs = 1/20 2024-09-17T05:40:55.437 INFO:teuthology.orchestra.run.smithi176.stdout: debug bluestore = 1/20 2024-09-17T05:40:55.437 INFO:teuthology.orchestra.run.smithi176.stdout: debug ms = 1 2024-09-17T05:40:55.438 INFO:teuthology.orchestra.run.smithi176.stdout: debug osd = 20 2024-09-17T05:40:55.438 INFO:teuthology.orchestra.run.smithi176.stdout: debug rocksdb = 4/10 2024-09-17T05:40:55.438 INFO:teuthology.orchestra.run.smithi176.stdout: mon osd backfillfull_ratio = 0.85 2024-09-17T05:40:55.438 INFO:teuthology.orchestra.run.smithi176.stdout: mon osd full ratio = 0.9 2024-09-17T05:40:55.438 INFO:teuthology.orchestra.run.smithi176.stdout: mon osd nearfull ratio = 0.8 2024-09-17T05:40:55.438 INFO:teuthology.orchestra.run.smithi176.stdout: osd failsafe full ratio = 0.95 2024-09-17T05:40:55.438 INFO:teuthology.orchestra.run.smithi176.stdout: osd objectstore = bluestore 2024-09-17T05:40:55.438 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-09-17T05:40:55.438 INFO:teuthology.orchestra.run.smithi176.stdout:[mgr] 2024-09-17T05:40:55.438 INFO:teuthology.orchestra.run.smithi176.stdout: debug ms = 1 2024-09-17T05:40:55.438 INFO:teuthology.orchestra.run.smithi176.stdout: debug mgr = 20 2024-09-17T05:40:55.438 INFO:teuthology.orchestra.run.smithi176.stdout: debug mon = 20 2024-09-17T05:40:55.438 INFO:teuthology.orchestra.run.smithi176.stdout: debug auth = 20 2024-09-17T05:40:55.438 INFO:teuthology.orchestra.run.smithi176.stdout: mon reweight min pgs per osd = 4 2024-09-17T05:40:55.438 INFO:teuthology.orchestra.run.smithi176.stdout: mon reweight min bytes per osd = 10 2024-09-17T05:40:55.439 INFO:teuthology.orchestra.run.smithi176.stdout: mgr/telemetry/nag = false 2024-09-17T05:40:55.439 INFO:teuthology.orchestra.run.smithi176.stdout: debug client = 20 2024-09-17T05:40:55.439 INFO:teuthology.orchestra.run.smithi176.stdout: debug finisher = 20 2024-09-17T05:40:55.439 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-09-17T05:40:55.439 INFO:teuthology.orchestra.run.smithi176.stdout:[mon] 2024-09-17T05:40:55.439 INFO:teuthology.orchestra.run.smithi176.stdout: debug ms = 1 2024-09-17T05:40:55.439 INFO:teuthology.orchestra.run.smithi176.stdout: debug mon = 20 2024-09-17T05:40:55.439 INFO:teuthology.orchestra.run.smithi176.stdout: debug paxos = 20 2024-09-17T05:40:55.439 INFO:teuthology.orchestra.run.smithi176.stdout: debug auth = 20 2024-09-17T05:40:55.439 INFO:teuthology.orchestra.run.smithi176.stdout: mon data avail warn = 5 2024-09-17T05:40:55.439 INFO:teuthology.orchestra.run.smithi176.stdout: mon mgr mkfs grace = 240 2024-09-17T05:40:55.439 INFO:teuthology.orchestra.run.smithi176.stdout: mon reweight min pgs per osd = 4 2024-09-17T05:40:55.439 INFO:teuthology.orchestra.run.smithi176.stdout: mon osd reporter subtree level = osd 2024-09-17T05:40:55.439 INFO:teuthology.orchestra.run.smithi176.stdout: mon osd prime pg temp = true 2024-09-17T05:40:55.440 INFO:teuthology.orchestra.run.smithi176.stdout: mon reweight min bytes per osd = 10 2024-09-17T05:40:55.440 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-09-17T05:40:55.440 INFO:teuthology.orchestra.run.smithi176.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-09-17T05:40:55.440 INFO:teuthology.orchestra.run.smithi176.stdout: auth mon ticket ttl = 660 # 11m 2024-09-17T05:40:55.440 INFO:teuthology.orchestra.run.smithi176.stdout: auth service ticket ttl = 240 # 4m 2024-09-17T05:40:55.440 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-09-17T05:40:55.440 INFO:teuthology.orchestra.run.smithi176.stdout: # don't complain about insecure global_id in the test suite 2024-09-17T05:40:55.440 INFO:teuthology.orchestra.run.smithi176.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-09-17T05:40:55.440 INFO:teuthology.orchestra.run.smithi176.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-09-17T05:40:55.440 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-09-17T05:40:55.440 INFO:teuthology.orchestra.run.smithi176.stdout: # 1m isn't quite enough 2024-09-17T05:40:55.440 INFO:teuthology.orchestra.run.smithi176.stdout: mon_down_mkfs_grace = 2m 2024-09-17T05:40:55.440 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-09-17T05:40:55.440 INFO:teuthology.orchestra.run.smithi176.stdout: mon_warn_on_filestore_osds = false 2024-09-17T05:40:55.441 INFO:teuthology.orchestra.run.smithi176.stdout: mon down mkfs grace = 300 2024-09-17T05:40:55.441 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-09-17T05:40:55.441 INFO:teuthology.orchestra.run.smithi176.stdout:[client] 2024-09-17T05:40:55.441 INFO:teuthology.orchestra.run.smithi176.stdout: rgw cache enabled = true 2024-09-17T05:40:55.441 INFO:teuthology.orchestra.run.smithi176.stdout: rgw enable ops log = true 2024-09-17T05:40:55.441 INFO:teuthology.orchestra.run.smithi176.stdout: rgw enable usage log = true 2024-09-17T05:40:55.441 INFO:teuthology.orchestra.run.smithi176.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-09-17T05:40:55.441 INFO:teuthology.orchestra.run.smithi176.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-09-17T05:40:55.441 INFO:teuthology.orchestra.run.smithi176.stdout: pid file = "" 2024-09-17T05:40:55.441 INFO:teuthology.orchestra.run.smithi176.stdout:[mon.a] 2024-09-17T05:40:55.441 INFO:teuthology.orchestra.run.smithi176.stdout:[mon.b] 2024-09-17T05:40:55.441 INFO:teuthology.orchestra.run.smithi176.stdout:[mon.c] 2024-09-17T05:40:55.441 INFO:teuthology.orchestra.run.smithi176.stdout:[mds.a] 2024-09-17T05:40:55.441 INFO:teuthology.orchestra.run.smithi176.stdout:[mds.c] 2024-09-17T05:40:55.442 INFO:teuthology.orchestra.run.smithi176.stdout:[mds.b] 2024-09-17T05:40:55.442 INFO:teuthology.orchestra.run.smithi176.stdout:[mds.d] 2024-09-17T05:40:55.443 INFO:tasks.ceph:Creating admin key on mon.a... 2024-09-17T05:40:55.443 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2024-09-17T05:40:55.547 INFO:tasks.ceph:Copying monmap to all nodes... 2024-09-17T05:40:55.548 DEBUG:teuthology.orchestra.run.smithi150:> set -ex 2024-09-17T05:40:55.548 DEBUG:teuthology.orchestra.run.smithi150:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2024-09-17T05:40:55.563 DEBUG:teuthology.orchestra.run.smithi150:> set -ex 2024-09-17T05:40:55.563 DEBUG:teuthology.orchestra.run.smithi150:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2024-09-17T05:40:55.618 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi150.front.sepia.ceph.com 2024-09-17T05:40:55.618 DEBUG:teuthology.orchestra.run.smithi150:> set -ex 2024-09-17T05:40:55.618 DEBUG:teuthology.orchestra.run.smithi150:> sudo dd of=/etc/ceph/ceph.keyring 2024-09-17T05:40:55.618 DEBUG:teuthology.orchestra.run.smithi150:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-17T05:40:55.692 DEBUG:teuthology.orchestra.run.smithi150:> set -ex 2024-09-17T05:40:55.692 DEBUG:teuthology.orchestra.run.smithi150:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-09-17T05:40:55.747 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi176.front.sepia.ceph.com 2024-09-17T05:40:55.748 DEBUG:teuthology.orchestra.run.smithi176:> set -ex 2024-09-17T05:40:55.748 DEBUG:teuthology.orchestra.run.smithi176:> sudo dd of=/etc/ceph/ceph.keyring 2024-09-17T05:40:55.748 DEBUG:teuthology.orchestra.run.smithi176:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-17T05:40:55.786 DEBUG:teuthology.orchestra.run.smithi176:> set -ex 2024-09-17T05:40:55.786 DEBUG:teuthology.orchestra.run.smithi176:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-09-17T05:40:55.844 INFO:tasks.ceph:Setting up mon nodes... 2024-09-17T05:40:55.845 INFO:tasks.ceph:Setting up mgr nodes... 2024-09-17T05:40:55.845 DEBUG:teuthology.orchestra.run.smithi150:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2024-09-17T05:40:55.906 INFO:teuthology.orchestra.run.smithi150.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2024-09-17T05:40:55.909 DEBUG:teuthology.orchestra.run.smithi176:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2024-09-17T05:40:55.986 INFO:teuthology.orchestra.run.smithi176.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2024-09-17T05:40:55.989 INFO:tasks.ceph:Setting up mds nodes... 2024-09-17T05:40:55.990 DEBUG:teuthology.orchestra.run.smithi150:> sudo mkdir -p /var/lib/ceph/mds/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.a /var/lib/ceph/mds/ceph-a/keyring 2024-09-17T05:40:56.050 INFO:teuthology.orchestra.run.smithi150.stdout:creating /var/lib/ceph/mds/ceph-a/keyring 2024-09-17T05:40:56.053 DEBUG:teuthology.orchestra.run.smithi150:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-a 2024-09-17T05:40:56.078 DEBUG:teuthology.orchestra.run.smithi150:> sudo mkdir -p /var/lib/ceph/mds/ceph-c && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.c /var/lib/ceph/mds/ceph-c/keyring 2024-09-17T05:40:56.179 INFO:teuthology.orchestra.run.smithi150.stdout:creating /var/lib/ceph/mds/ceph-c/keyring 2024-09-17T05:40:56.181 DEBUG:teuthology.orchestra.run.smithi150:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-c 2024-09-17T05:40:56.207 DEBUG:teuthology.orchestra.run.smithi176:> sudo mkdir -p /var/lib/ceph/mds/ceph-b && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.b /var/lib/ceph/mds/ceph-b/keyring 2024-09-17T05:40:56.275 INFO:teuthology.orchestra.run.smithi176.stdout:creating /var/lib/ceph/mds/ceph-b/keyring 2024-09-17T05:40:56.278 DEBUG:teuthology.orchestra.run.smithi176:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-b 2024-09-17T05:40:56.304 DEBUG:teuthology.orchestra.run.smithi176:> sudo mkdir -p /var/lib/ceph/mds/ceph-d && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.d /var/lib/ceph/mds/ceph-d/keyring 2024-09-17T05:40:56.406 INFO:teuthology.orchestra.run.smithi176.stdout:creating /var/lib/ceph/mds/ceph-d/keyring 2024-09-17T05:40:56.409 DEBUG:teuthology.orchestra.run.smithi176:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-d 2024-09-17T05:40:56.433 INFO:tasks.ceph_client:Setting up client nodes... 2024-09-17T05:40:56.434 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-09-17T05:40:56.485 INFO:teuthology.orchestra.run.smithi150.stdout:creating /etc/ceph/ceph.client.0.keyring 2024-09-17T05:40:56.499 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.2 /etc/ceph/ceph.client.2.keyring && sudo chmod 0644 /etc/ceph/ceph.client.2.keyring 2024-09-17T05:40:56.549 INFO:teuthology.orchestra.run.smithi150.stdout:creating /etc/ceph/ceph.client.2.keyring 2024-09-17T05:40:56.562 DEBUG:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.1 /etc/ceph/ceph.client.1.keyring && sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2024-09-17T05:40:56.613 INFO:teuthology.orchestra.run.smithi176.stdout:creating /etc/ceph/ceph.client.1.keyring 2024-09-17T05:40:56.626 DEBUG:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.3 /etc/ceph/ceph.client.3.keyring && sudo chmod 0644 /etc/ceph/ceph.client.3.keyring 2024-09-17T05:40:56.676 INFO:teuthology.orchestra.run.smithi176.stdout:creating /etc/ceph/ceph.client.3.keyring 2024-09-17T05:40:56.689 INFO:tasks.ceph:Running mkfs on osd nodes... 2024-09-17T05:40:56.689 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi150.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi176.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-09-17T05:40:56.690 DEBUG:teuthology.orchestra.run.smithi150:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2024-09-17T05:40:56.714 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-17T05:40:56.715 INFO:tasks.ceph:role: osd.0 2024-09-17T05:40:56.715 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi150.front.sepia.ceph.com 2024-09-17T05:40:56.715 DEBUG:teuthology.orchestra.run.smithi150:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-09-17T05:40:56.787 INFO:teuthology.orchestra.run.smithi150.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-09-17T05:40:56.788 INFO:teuthology.orchestra.run.smithi150.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-17T05:40:56.788 INFO:teuthology.orchestra.run.smithi150.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-17T05:40:56.788 INFO:teuthology.orchestra.run.smithi150.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-17T05:40:56.788 INFO:teuthology.orchestra.run.smithi150.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-17T05:40:56.788 INFO:teuthology.orchestra.run.smithi150.stdout: = sunit=0 swidth=0 blks 2024-09-17T05:40:56.788 INFO:teuthology.orchestra.run.smithi150.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-17T05:40:56.788 INFO:teuthology.orchestra.run.smithi150.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-17T05:40:56.788 INFO:teuthology.orchestra.run.smithi150.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-17T05:40:56.788 INFO:teuthology.orchestra.run.smithi150.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-17T05:40:57.286 INFO:teuthology.orchestra.run.smithi150.stdout:Discarding blocks...Done. 2024-09-17T05:40:57.287 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi150.front.sepia.ceph.com -o noatime 2024-09-17T05:40:57.288 DEBUG:teuthology.orchestra.run.smithi150:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2024-09-17T05:40:57.401 DEBUG:teuthology.orchestra.run.smithi150:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2024-09-17T05:40:57.435 DEBUG:teuthology.orchestra.run.smithi150:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2024-09-17T05:40:57.501 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-17T05:40:57.501 INFO:tasks.ceph:role: osd.1 2024-09-17T05:40:57.501 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi150.front.sepia.ceph.com 2024-09-17T05:40:57.501 DEBUG:teuthology.orchestra.run.smithi150:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-09-17T05:40:57.574 INFO:teuthology.orchestra.run.smithi150.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-09-17T05:40:57.574 INFO:teuthology.orchestra.run.smithi150.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-17T05:40:57.574 INFO:teuthology.orchestra.run.smithi150.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-17T05:40:57.575 INFO:teuthology.orchestra.run.smithi150.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-17T05:40:57.575 INFO:teuthology.orchestra.run.smithi150.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-17T05:40:57.575 INFO:teuthology.orchestra.run.smithi150.stdout: = sunit=0 swidth=0 blks 2024-09-17T05:40:57.575 INFO:teuthology.orchestra.run.smithi150.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-17T05:40:57.575 INFO:teuthology.orchestra.run.smithi150.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-17T05:40:57.575 INFO:teuthology.orchestra.run.smithi150.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-17T05:40:57.575 INFO:teuthology.orchestra.run.smithi150.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-17T05:40:58.044 INFO:teuthology.orchestra.run.smithi150.stdout:Discarding blocks...Done. 2024-09-17T05:40:58.046 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi150.front.sepia.ceph.com -o noatime 2024-09-17T05:40:58.046 DEBUG:teuthology.orchestra.run.smithi150:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2024-09-17T05:40:58.137 DEBUG:teuthology.orchestra.run.smithi150:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2024-09-17T05:40:58.166 DEBUG:teuthology.orchestra.run.smithi150:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2024-09-17T05:40:58.231 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-17T05:40:58.231 INFO:tasks.ceph:role: osd.2 2024-09-17T05:40:58.231 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi150.front.sepia.ceph.com 2024-09-17T05:40:58.231 DEBUG:teuthology.orchestra.run.smithi150:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-09-17T05:40:58.303 INFO:teuthology.orchestra.run.smithi150.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-09-17T05:40:58.304 INFO:teuthology.orchestra.run.smithi150.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-17T05:40:58.304 INFO:teuthology.orchestra.run.smithi150.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-17T05:40:58.304 INFO:teuthology.orchestra.run.smithi150.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-17T05:40:58.304 INFO:teuthology.orchestra.run.smithi150.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-17T05:40:58.304 INFO:teuthology.orchestra.run.smithi150.stdout: = sunit=0 swidth=0 blks 2024-09-17T05:40:58.304 INFO:teuthology.orchestra.run.smithi150.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-17T05:40:58.304 INFO:teuthology.orchestra.run.smithi150.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-17T05:40:58.304 INFO:teuthology.orchestra.run.smithi150.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-17T05:40:58.304 INFO:teuthology.orchestra.run.smithi150.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-17T05:40:58.780 INFO:teuthology.orchestra.run.smithi150.stdout:Discarding blocks...Done. 2024-09-17T05:40:58.782 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi150.front.sepia.ceph.com -o noatime 2024-09-17T05:40:58.782 DEBUG:teuthology.orchestra.run.smithi150:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2024-09-17T05:40:58.913 DEBUG:teuthology.orchestra.run.smithi150:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2024-09-17T05:40:58.943 DEBUG:teuthology.orchestra.run.smithi150:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2024-09-17T05:40:59.008 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-17T05:40:59.008 INFO:tasks.ceph:role: osd.3 2024-09-17T05:40:59.008 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi150.front.sepia.ceph.com 2024-09-17T05:40:59.008 DEBUG:teuthology.orchestra.run.smithi150:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-09-17T05:40:59.081 INFO:teuthology.orchestra.run.smithi150.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-09-17T05:40:59.081 INFO:teuthology.orchestra.run.smithi150.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-17T05:40:59.081 INFO:teuthology.orchestra.run.smithi150.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-17T05:40:59.081 INFO:teuthology.orchestra.run.smithi150.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-17T05:40:59.081 INFO:teuthology.orchestra.run.smithi150.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-17T05:40:59.081 INFO:teuthology.orchestra.run.smithi150.stdout: = sunit=0 swidth=0 blks 2024-09-17T05:40:59.081 INFO:teuthology.orchestra.run.smithi150.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-17T05:40:59.081 INFO:teuthology.orchestra.run.smithi150.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-17T05:40:59.081 INFO:teuthology.orchestra.run.smithi150.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-17T05:40:59.081 INFO:teuthology.orchestra.run.smithi150.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-17T05:40:59.614 INFO:teuthology.orchestra.run.smithi150.stdout:Discarding blocks...Done. 2024-09-17T05:40:59.616 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi150.front.sepia.ceph.com -o noatime 2024-09-17T05:40:59.617 DEBUG:teuthology.orchestra.run.smithi150:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2024-09-17T05:40:59.755 DEBUG:teuthology.orchestra.run.smithi150:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2024-09-17T05:40:59.787 DEBUG:teuthology.orchestra.run.smithi150:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-17T05:40:59.893 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:40:59.892+0000 7f3e88f4f640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2024-09-17T05:40:59.893 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:40:59.892+0000 7f3e88f4f640 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2024-09-17T05:40:59.894 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:40:59.892+0000 7f3e88f4f640 -1 bdev(0x559234a1d900 /var/lib/ceph/osd/ceph-0/block) open stat got: (1) Operation not permitted 2024-09-17T05:40:59.894 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:40:59.892+0000 7f3e88f4f640 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2024-09-17T05:41:03.068 DEBUG:teuthology.orchestra.run.smithi150:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-09-17T05:41:03.098 DEBUG:teuthology.orchestra.run.smithi150:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-17T05:41:03.201 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:03.200+0000 7f5b9e3bb640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2024-09-17T05:41:03.201 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:03.200+0000 7f5b9e3bb640 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2024-09-17T05:41:03.201 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:03.200+0000 7f5b9e3bb640 -1 bdev(0x55e0182fb900 /var/lib/ceph/osd/ceph-1/block) open stat got: (1) Operation not permitted 2024-09-17T05:41:03.201 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:03.200+0000 7f5b9e3bb640 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2024-09-17T05:41:06.612 DEBUG:teuthology.orchestra.run.smithi150:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-09-17T05:41:06.642 DEBUG:teuthology.orchestra.run.smithi150:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-17T05:41:06.746 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:06.745+0000 7f3adba32640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2024-09-17T05:41:06.746 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:06.745+0000 7f3adba32640 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2024-09-17T05:41:06.746 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:06.745+0000 7f3adba32640 -1 bdev(0x555d165e5900 /var/lib/ceph/osd/ceph-2/block) open stat got: (1) Operation not permitted 2024-09-17T05:41:06.746 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:06.745+0000 7f3adba32640 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2024-09-17T05:41:09.916 DEBUG:teuthology.orchestra.run.smithi150:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-09-17T05:41:09.945 DEBUG:teuthology.orchestra.run.smithi150:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-17T05:41:10.048 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:10.047+0000 7fb668419640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2024-09-17T05:41:10.048 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:10.047+0000 7fb668419640 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2024-09-17T05:41:10.048 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:10.047+0000 7fb668419640 -1 bdev(0x558bc510b900 /var/lib/ceph/osd/ceph-3/block) open stat got: (1) Operation not permitted 2024-09-17T05:41:10.048 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:10.047+0000 7fb668419640 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2024-09-17T05:41:13.215 DEBUG:teuthology.orchestra.run.smithi150:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-09-17T05:41:13.243 DEBUG:teuthology.orchestra.run.smithi176:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2024-09-17T05:41:13.274 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-17T05:41:13.274 INFO:tasks.ceph:role: osd.4 2024-09-17T05:41:13.274 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi176.front.sepia.ceph.com 2024-09-17T05:41:13.274 DEBUG:teuthology.orchestra.run.smithi176:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-09-17T05:41:13.351 INFO:teuthology.orchestra.run.smithi176.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-09-17T05:41:13.351 INFO:teuthology.orchestra.run.smithi176.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-17T05:41:13.351 INFO:teuthology.orchestra.run.smithi176.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-17T05:41:13.351 INFO:teuthology.orchestra.run.smithi176.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-17T05:41:13.351 INFO:teuthology.orchestra.run.smithi176.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-17T05:41:13.351 INFO:teuthology.orchestra.run.smithi176.stdout: = sunit=0 swidth=0 blks 2024-09-17T05:41:13.351 INFO:teuthology.orchestra.run.smithi176.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-17T05:41:13.352 INFO:teuthology.orchestra.run.smithi176.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-17T05:41:13.352 INFO:teuthology.orchestra.run.smithi176.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-17T05:41:13.352 INFO:teuthology.orchestra.run.smithi176.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-17T05:41:13.865 INFO:teuthology.orchestra.run.smithi176.stdout:Discarding blocks...Done. 2024-09-17T05:41:13.867 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi176.front.sepia.ceph.com -o noatime 2024-09-17T05:41:13.867 DEBUG:teuthology.orchestra.run.smithi176:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2024-09-17T05:41:13.970 DEBUG:teuthology.orchestra.run.smithi176:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2024-09-17T05:41:14.001 DEBUG:teuthology.orchestra.run.smithi176:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2024-09-17T05:41:14.067 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-17T05:41:14.067 INFO:tasks.ceph:role: osd.5 2024-09-17T05:41:14.067 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi176.front.sepia.ceph.com 2024-09-17T05:41:14.068 DEBUG:teuthology.orchestra.run.smithi176:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-09-17T05:41:14.139 INFO:teuthology.orchestra.run.smithi176.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-09-17T05:41:14.139 INFO:teuthology.orchestra.run.smithi176.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-17T05:41:14.139 INFO:teuthology.orchestra.run.smithi176.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-17T05:41:14.140 INFO:teuthology.orchestra.run.smithi176.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-17T05:41:14.140 INFO:teuthology.orchestra.run.smithi176.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-17T05:41:14.140 INFO:teuthology.orchestra.run.smithi176.stdout: = sunit=0 swidth=0 blks 2024-09-17T05:41:14.140 INFO:teuthology.orchestra.run.smithi176.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-17T05:41:14.140 INFO:teuthology.orchestra.run.smithi176.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-17T05:41:14.140 INFO:teuthology.orchestra.run.smithi176.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-17T05:41:14.140 INFO:teuthology.orchestra.run.smithi176.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-17T05:41:14.591 INFO:teuthology.orchestra.run.smithi176.stdout:Discarding blocks...Done. 2024-09-17T05:41:14.593 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi176.front.sepia.ceph.com -o noatime 2024-09-17T05:41:14.593 DEBUG:teuthology.orchestra.run.smithi176:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2024-09-17T05:41:14.666 DEBUG:teuthology.orchestra.run.smithi176:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2024-09-17T05:41:14.737 DEBUG:teuthology.orchestra.run.smithi176:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2024-09-17T05:41:14.802 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-17T05:41:14.802 INFO:tasks.ceph:role: osd.6 2024-09-17T05:41:14.802 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi176.front.sepia.ceph.com 2024-09-17T05:41:14.802 DEBUG:teuthology.orchestra.run.smithi176:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-09-17T05:41:14.874 INFO:teuthology.orchestra.run.smithi176.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-09-17T05:41:14.874 INFO:teuthology.orchestra.run.smithi176.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-17T05:41:14.874 INFO:teuthology.orchestra.run.smithi176.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-17T05:41:14.874 INFO:teuthology.orchestra.run.smithi176.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-17T05:41:14.874 INFO:teuthology.orchestra.run.smithi176.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-17T05:41:14.875 INFO:teuthology.orchestra.run.smithi176.stdout: = sunit=0 swidth=0 blks 2024-09-17T05:41:14.875 INFO:teuthology.orchestra.run.smithi176.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-17T05:41:14.875 INFO:teuthology.orchestra.run.smithi176.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-17T05:41:14.875 INFO:teuthology.orchestra.run.smithi176.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-17T05:41:14.875 INFO:teuthology.orchestra.run.smithi176.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-17T05:41:15.363 INFO:teuthology.orchestra.run.smithi176.stdout:Discarding blocks...Done. 2024-09-17T05:41:15.365 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi176.front.sepia.ceph.com -o noatime 2024-09-17T05:41:15.365 DEBUG:teuthology.orchestra.run.smithi176:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2024-09-17T05:41:15.461 DEBUG:teuthology.orchestra.run.smithi176:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2024-09-17T05:41:15.491 DEBUG:teuthology.orchestra.run.smithi176:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2024-09-17T05:41:15.557 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-17T05:41:15.557 INFO:tasks.ceph:role: osd.7 2024-09-17T05:41:15.557 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi176.front.sepia.ceph.com 2024-09-17T05:41:15.557 DEBUG:teuthology.orchestra.run.smithi176:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-09-17T05:41:15.631 INFO:teuthology.orchestra.run.smithi176.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-09-17T05:41:15.631 INFO:teuthology.orchestra.run.smithi176.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-17T05:41:15.631 INFO:teuthology.orchestra.run.smithi176.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-17T05:41:15.631 INFO:teuthology.orchestra.run.smithi176.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-17T05:41:15.631 INFO:teuthology.orchestra.run.smithi176.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-17T05:41:15.631 INFO:teuthology.orchestra.run.smithi176.stdout: = sunit=0 swidth=0 blks 2024-09-17T05:41:15.631 INFO:teuthology.orchestra.run.smithi176.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-17T05:41:15.631 INFO:teuthology.orchestra.run.smithi176.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-17T05:41:15.631 INFO:teuthology.orchestra.run.smithi176.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-17T05:41:15.632 INFO:teuthology.orchestra.run.smithi176.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-17T05:41:16.133 INFO:teuthology.orchestra.run.smithi176.stdout:Discarding blocks...Done. 2024-09-17T05:41:16.135 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi176.front.sepia.ceph.com -o noatime 2024-09-17T05:41:16.135 DEBUG:teuthology.orchestra.run.smithi176:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2024-09-17T05:41:16.276 DEBUG:teuthology.orchestra.run.smithi176:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2024-09-17T05:41:16.309 DEBUG:teuthology.orchestra.run.smithi176:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-17T05:41:16.445 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T05:41:16.444+0000 7f6c34013640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2024-09-17T05:41:16.451 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T05:41:16.450+0000 7f6c34013640 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2024-09-17T05:41:16.452 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T05:41:16.450+0000 7f6c34013640 -1 bdev(0x5562b4e4f900 /var/lib/ceph/osd/ceph-4/block) open stat got: (1) Operation not permitted 2024-09-17T05:41:16.452 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T05:41:16.450+0000 7f6c34013640 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2024-09-17T05:41:19.364 DEBUG:teuthology.orchestra.run.smithi176:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-09-17T05:41:19.394 DEBUG:teuthology.orchestra.run.smithi176:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-17T05:41:19.497 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T05:41:19.496+0000 7f12a7c2f640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2024-09-17T05:41:19.497 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T05:41:19.496+0000 7f12a7c2f640 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2024-09-17T05:41:19.497 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T05:41:19.496+0000 7f12a7c2f640 -1 bdev(0x555f25871900 /var/lib/ceph/osd/ceph-5/block) open stat got: (1) Operation not permitted 2024-09-17T05:41:19.498 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T05:41:19.496+0000 7f12a7c2f640 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2024-09-17T05:41:22.413 DEBUG:teuthology.orchestra.run.smithi176:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-09-17T05:41:22.443 DEBUG:teuthology.orchestra.run.smithi176:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-17T05:41:22.544 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T05:41:22.543+0000 7f818d00f640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2024-09-17T05:41:22.545 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T05:41:22.543+0000 7f818d00f640 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2024-09-17T05:41:22.545 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T05:41:22.543+0000 7f818d00f640 -1 bdev(0x5597091cf900 /var/lib/ceph/osd/ceph-6/block) open stat got: (1) Operation not permitted 2024-09-17T05:41:22.545 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T05:41:22.543+0000 7f818d00f640 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2024-09-17T05:41:23.420 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-17T05:41:23.423 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-17T05:41:25.957 DEBUG:teuthology.orchestra.run.smithi176:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2024-09-17T05:41:25.986 DEBUG:teuthology.orchestra.run.smithi176:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-17T05:41:26.087 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T05:41:26.086+0000 7fb55ec39640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2024-09-17T05:41:26.088 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T05:41:26.086+0000 7fb55ec39640 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2024-09-17T05:41:26.088 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T05:41:26.086+0000 7fb55ec39640 -1 bdev(0x558294555900 /var/lib/ceph/osd/ceph-7/block) open stat got: (1) Operation not permitted 2024-09-17T05:41:26.088 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T05:41:26.086+0000 7fb55ec39640 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2024-09-17T05:41:29.255 DEBUG:teuthology.orchestra.run.smithi176:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2024-09-17T05:41:29.285 INFO:tasks.ceph:Reading keys from all nodes... 2024-09-17T05:41:29.286 DEBUG:teuthology.orchestra.run.smithi150:> set -ex 2024-09-17T05:41:29.286 DEBUG:teuthology.orchestra.run.smithi150:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2024-09-17T05:41:29.317 DEBUG:teuthology.orchestra.run.smithi150:> set -ex 2024-09-17T05:41:29.317 DEBUG:teuthology.orchestra.run.smithi150:> sudo dd if=/var/lib/ceph/mds/ceph-a/keyring of=/dev/stdout 2024-09-17T05:41:29.386 DEBUG:teuthology.orchestra.run.smithi150:> set -ex 2024-09-17T05:41:29.386 DEBUG:teuthology.orchestra.run.smithi150:> sudo dd if=/var/lib/ceph/mds/ceph-c/keyring of=/dev/stdout 2024-09-17T05:41:29.454 DEBUG:teuthology.orchestra.run.smithi150:> set -ex 2024-09-17T05:41:29.454 DEBUG:teuthology.orchestra.run.smithi150:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2024-09-17T05:41:29.521 DEBUG:teuthology.orchestra.run.smithi150:> set -ex 2024-09-17T05:41:29.521 DEBUG:teuthology.orchestra.run.smithi150:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2024-09-17T05:41:29.587 DEBUG:teuthology.orchestra.run.smithi150:> set -ex 2024-09-17T05:41:29.587 DEBUG:teuthology.orchestra.run.smithi150:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2024-09-17T05:41:29.653 DEBUG:teuthology.orchestra.run.smithi150:> set -ex 2024-09-17T05:41:29.653 DEBUG:teuthology.orchestra.run.smithi150:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2024-09-17T05:41:29.718 DEBUG:teuthology.orchestra.run.smithi176:> set -ex 2024-09-17T05:41:29.719 DEBUG:teuthology.orchestra.run.smithi176:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2024-09-17T05:41:29.749 DEBUG:teuthology.orchestra.run.smithi176:> set -ex 2024-09-17T05:41:29.749 DEBUG:teuthology.orchestra.run.smithi176:> sudo dd if=/var/lib/ceph/mds/ceph-b/keyring of=/dev/stdout 2024-09-17T05:41:29.820 DEBUG:teuthology.orchestra.run.smithi176:> set -ex 2024-09-17T05:41:29.820 DEBUG:teuthology.orchestra.run.smithi176:> sudo dd if=/var/lib/ceph/mds/ceph-d/keyring of=/dev/stdout 2024-09-17T05:41:29.888 DEBUG:teuthology.orchestra.run.smithi176:> set -ex 2024-09-17T05:41:29.888 DEBUG:teuthology.orchestra.run.smithi176:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2024-09-17T05:41:29.955 DEBUG:teuthology.orchestra.run.smithi176:> set -ex 2024-09-17T05:41:29.956 DEBUG:teuthology.orchestra.run.smithi176:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2024-09-17T05:41:30.022 DEBUG:teuthology.orchestra.run.smithi176:> set -ex 2024-09-17T05:41:30.022 DEBUG:teuthology.orchestra.run.smithi176:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2024-09-17T05:41:30.088 DEBUG:teuthology.orchestra.run.smithi176:> set -ex 2024-09-17T05:41:30.088 DEBUG:teuthology.orchestra.run.smithi176:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2024-09-17T05:41:30.153 DEBUG:teuthology.orchestra.run.smithi150:> set -ex 2024-09-17T05:41:30.153 DEBUG:teuthology.orchestra.run.smithi150:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2024-09-17T05:41:30.171 DEBUG:teuthology.orchestra.run.smithi150:> set -ex 2024-09-17T05:41:30.171 DEBUG:teuthology.orchestra.run.smithi150:> dd if=/etc/ceph/ceph.client.2.keyring of=/dev/stdout 2024-09-17T05:41:30.228 DEBUG:teuthology.orchestra.run.smithi176:> set -ex 2024-09-17T05:41:30.228 DEBUG:teuthology.orchestra.run.smithi176:> dd if=/etc/ceph/ceph.client.1.keyring of=/dev/stdout 2024-09-17T05:41:30.247 DEBUG:teuthology.orchestra.run.smithi176:> set -ex 2024-09-17T05:41:30.247 DEBUG:teuthology.orchestra.run.smithi176:> dd if=/etc/ceph/ceph.client.3.keyring of=/dev/stdout 2024-09-17T05:41:30.302 INFO:tasks.ceph:Adding keys to all mons... 2024-09-17T05:41:30.303 DEBUG:teuthology.orchestra.run.smithi150:> sudo tee -a /etc/ceph/ceph.keyring 2024-09-17T05:41:30.305 DEBUG:teuthology.orchestra.run.smithi176:> sudo tee -a /etc/ceph/ceph.keyring 2024-09-17T05:41:30.346 INFO:teuthology.orchestra.run.smithi150.stdout:[mgr.y] 2024-09-17T05:41:30.346 INFO:teuthology.orchestra.run.smithi150.stdout: key = AQBnFulm9IkENhAA4uf1vzhYOepmovspN5/v1w== 2024-09-17T05:41:30.346 INFO:teuthology.orchestra.run.smithi150.stdout:[mds.a] 2024-09-17T05:41:30.346 INFO:teuthology.orchestra.run.smithi150.stdout: key = AQBoFulmMHALAxAAEO+QBgzbd+BNfhyY2qPiqw== 2024-09-17T05:41:30.346 INFO:teuthology.orchestra.run.smithi150.stdout:[mds.c] 2024-09-17T05:41:30.347 INFO:teuthology.orchestra.run.smithi150.stdout: key = AQBoFulmHTKsChAA4/fUb2NC+fMhR+xIYIDjgQ== 2024-09-17T05:41:30.347 INFO:teuthology.orchestra.run.smithi150.stdout:[osd.0] 2024-09-17T05:41:30.347 INFO:teuthology.orchestra.run.smithi150.stdout: key = AQBrFulm9eU0NRAAqgc1CtMOz+jDCHBn8coaVw== 2024-09-17T05:41:30.347 INFO:teuthology.orchestra.run.smithi150.stdout:[osd.1] 2024-09-17T05:41:30.347 INFO:teuthology.orchestra.run.smithi150.stdout: key = AQBvFulmlFL6CxAA8ByBraZue2FLfyZeOIpj3A== 2024-09-17T05:41:30.347 INFO:teuthology.orchestra.run.smithi150.stdout:[osd.2] 2024-09-17T05:41:30.347 INFO:teuthology.orchestra.run.smithi150.stdout: key = AQByFulmMQF5LBAAB4rbdIL6Zd+l4I4LDC/r3Q== 2024-09-17T05:41:30.347 INFO:teuthology.orchestra.run.smithi150.stdout:[osd.3] 2024-09-17T05:41:30.347 INFO:teuthology.orchestra.run.smithi150.stdout: key = AQB2Fulm5fjaAhAASnkpgsW79Sr9IIiy4HMm4g== 2024-09-17T05:41:30.347 INFO:teuthology.orchestra.run.smithi150.stdout:[mgr.x] 2024-09-17T05:41:30.347 INFO:teuthology.orchestra.run.smithi150.stdout: key = AQBnFulmEjvROhAAn3GZxCEtqPYLWopR1AcSFA== 2024-09-17T05:41:30.347 INFO:teuthology.orchestra.run.smithi150.stdout:[mds.b] 2024-09-17T05:41:30.348 INFO:teuthology.orchestra.run.smithi150.stdout: key = AQBoFulmtutmEBAAhKJEJQm181pL1lPmSSdYRQ== 2024-09-17T05:41:30.348 INFO:teuthology.orchestra.run.smithi150.stdout:[mds.d] 2024-09-17T05:41:30.348 INFO:teuthology.orchestra.run.smithi150.stdout: key = AQBoFulmr2s3GBAAhXzLVtObF/LwTpDIrY8MIQ== 2024-09-17T05:41:30.348 INFO:teuthology.orchestra.run.smithi150.stdout:[osd.4] 2024-09-17T05:41:30.348 INFO:teuthology.orchestra.run.smithi150.stdout: key = AQB8Fulm9fWPGhAA9nNf+0znlS0Z7rqOvC47xQ== 2024-09-17T05:41:30.348 INFO:teuthology.orchestra.run.smithi150.stdout:[osd.5] 2024-09-17T05:41:30.348 INFO:teuthology.orchestra.run.smithi150.stdout: key = AQB/FulmeHakHRAASlnmKa0UTqVX+NSbmiHEBw== 2024-09-17T05:41:30.348 INFO:teuthology.orchestra.run.smithi150.stdout:[osd.6] 2024-09-17T05:41:30.348 INFO:teuthology.orchestra.run.smithi150.stdout: key = AQCCFulmEZF3IBAAhtpCanI6m8Kb3hyi+sRyyQ== 2024-09-17T05:41:30.348 INFO:teuthology.orchestra.run.smithi150.stdout:[osd.7] 2024-09-17T05:41:30.348 INFO:teuthology.orchestra.run.smithi150.stdout: key = AQCGFulmdcs7BRAAxsctes949cbkGkivdGpoYw== 2024-09-17T05:41:30.348 INFO:teuthology.orchestra.run.smithi150.stdout:[client.0] 2024-09-17T05:41:30.348 INFO:teuthology.orchestra.run.smithi150.stdout: key = AQBoFulmfF/1HBAAMezEjZDeoHTJ+uFfDXNWHQ== 2024-09-17T05:41:30.349 INFO:teuthology.orchestra.run.smithi150.stdout:[client.2] 2024-09-17T05:41:30.349 INFO:teuthology.orchestra.run.smithi150.stdout: key = AQBoFulm1O/BIBAA8kfQL3/13SmZO1+y2tOZvw== 2024-09-17T05:41:30.349 INFO:teuthology.orchestra.run.smithi150.stdout:[client.1] 2024-09-17T05:41:30.349 INFO:teuthology.orchestra.run.smithi150.stdout: key = AQBoFulmv3GQJBAANlgjLqiCwzNfmBh8uClJ9A== 2024-09-17T05:41:30.349 INFO:teuthology.orchestra.run.smithi150.stdout:[client.3] 2024-09-17T05:41:30.349 INFO:teuthology.orchestra.run.smithi150.stdout: key = AQBoFulmF4hVKBAAZ5FGapBLLLtez3t8kON9dg== 2024-09-17T05:41:30.366 INFO:teuthology.orchestra.run.smithi176.stdout:[mgr.y] 2024-09-17T05:41:30.366 INFO:teuthology.orchestra.run.smithi176.stdout: key = AQBnFulm9IkENhAA4uf1vzhYOepmovspN5/v1w== 2024-09-17T05:41:30.367 INFO:teuthology.orchestra.run.smithi176.stdout:[mds.a] 2024-09-17T05:41:30.367 INFO:teuthology.orchestra.run.smithi176.stdout: key = AQBoFulmMHALAxAAEO+QBgzbd+BNfhyY2qPiqw== 2024-09-17T05:41:30.367 INFO:teuthology.orchestra.run.smithi176.stdout:[mds.c] 2024-09-17T05:41:30.367 INFO:teuthology.orchestra.run.smithi176.stdout: key = AQBoFulmHTKsChAA4/fUb2NC+fMhR+xIYIDjgQ== 2024-09-17T05:41:30.367 INFO:teuthology.orchestra.run.smithi176.stdout:[osd.0] 2024-09-17T05:41:30.367 INFO:teuthology.orchestra.run.smithi176.stdout: key = AQBrFulm9eU0NRAAqgc1CtMOz+jDCHBn8coaVw== 2024-09-17T05:41:30.367 INFO:teuthology.orchestra.run.smithi176.stdout:[osd.1] 2024-09-17T05:41:30.367 INFO:teuthology.orchestra.run.smithi176.stdout: key = AQBvFulmlFL6CxAA8ByBraZue2FLfyZeOIpj3A== 2024-09-17T05:41:30.367 INFO:teuthology.orchestra.run.smithi176.stdout:[osd.2] 2024-09-17T05:41:30.367 INFO:teuthology.orchestra.run.smithi176.stdout: key = AQByFulmMQF5LBAAB4rbdIL6Zd+l4I4LDC/r3Q== 2024-09-17T05:41:30.367 INFO:teuthology.orchestra.run.smithi176.stdout:[osd.3] 2024-09-17T05:41:30.367 INFO:teuthology.orchestra.run.smithi176.stdout: key = AQB2Fulm5fjaAhAASnkpgsW79Sr9IIiy4HMm4g== 2024-09-17T05:41:30.367 INFO:teuthology.orchestra.run.smithi176.stdout:[mgr.x] 2024-09-17T05:41:30.368 INFO:teuthology.orchestra.run.smithi176.stdout: key = AQBnFulmEjvROhAAn3GZxCEtqPYLWopR1AcSFA== 2024-09-17T05:41:30.368 INFO:teuthology.orchestra.run.smithi176.stdout:[mds.b] 2024-09-17T05:41:30.368 INFO:teuthology.orchestra.run.smithi176.stdout: key = AQBoFulmtutmEBAAhKJEJQm181pL1lPmSSdYRQ== 2024-09-17T05:41:30.368 INFO:teuthology.orchestra.run.smithi176.stdout:[mds.d] 2024-09-17T05:41:30.368 INFO:teuthology.orchestra.run.smithi176.stdout: key = AQBoFulmr2s3GBAAhXzLVtObF/LwTpDIrY8MIQ== 2024-09-17T05:41:30.368 INFO:teuthology.orchestra.run.smithi176.stdout:[osd.4] 2024-09-17T05:41:30.368 INFO:teuthology.orchestra.run.smithi176.stdout: key = AQB8Fulm9fWPGhAA9nNf+0znlS0Z7rqOvC47xQ== 2024-09-17T05:41:30.368 INFO:teuthology.orchestra.run.smithi176.stdout:[osd.5] 2024-09-17T05:41:30.368 INFO:teuthology.orchestra.run.smithi176.stdout: key = AQB/FulmeHakHRAASlnmKa0UTqVX+NSbmiHEBw== 2024-09-17T05:41:30.368 INFO:teuthology.orchestra.run.smithi176.stdout:[osd.6] 2024-09-17T05:41:30.368 INFO:teuthology.orchestra.run.smithi176.stdout: key = AQCCFulmEZF3IBAAhtpCanI6m8Kb3hyi+sRyyQ== 2024-09-17T05:41:30.368 INFO:teuthology.orchestra.run.smithi176.stdout:[osd.7] 2024-09-17T05:41:30.368 INFO:teuthology.orchestra.run.smithi176.stdout: key = AQCGFulmdcs7BRAAxsctes949cbkGkivdGpoYw== 2024-09-17T05:41:30.368 INFO:teuthology.orchestra.run.smithi176.stdout:[client.0] 2024-09-17T05:41:30.369 INFO:teuthology.orchestra.run.smithi176.stdout: key = AQBoFulmfF/1HBAAMezEjZDeoHTJ+uFfDXNWHQ== 2024-09-17T05:41:30.369 INFO:teuthology.orchestra.run.smithi176.stdout:[client.2] 2024-09-17T05:41:30.369 INFO:teuthology.orchestra.run.smithi176.stdout: key = AQBoFulm1O/BIBAA8kfQL3/13SmZO1+y2tOZvw== 2024-09-17T05:41:30.369 INFO:teuthology.orchestra.run.smithi176.stdout:[client.1] 2024-09-17T05:41:30.369 INFO:teuthology.orchestra.run.smithi176.stdout: key = AQBoFulmv3GQJBAANlgjLqiCwzNfmBh8uClJ9A== 2024-09-17T05:41:30.369 INFO:teuthology.orchestra.run.smithi176.stdout:[client.3] 2024-09-17T05:41:30.369 INFO:teuthology.orchestra.run.smithi176.stdout: key = AQBoFulmF4hVKBAAZ5FGapBLLLtez3t8kON9dg== 2024-09-17T05:41:30.370 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-17T05:41:30.392 DEBUG:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-17T05:41:30.470 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-17T05:41:30.473 DEBUG:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-17T05:41:30.537 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-17T05:41:30.539 DEBUG:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-17T05:41:30.603 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-17T05:41:30.605 DEBUG:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-17T05:41:30.667 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-17T05:41:30.669 DEBUG:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-17T05:41:30.730 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-17T05:41:30.733 DEBUG:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-17T05:41:30.794 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-17T05:41:30.797 DEBUG:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-17T05:41:30.858 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-17T05:41:30.861 DEBUG:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-17T05:41:30.922 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-17T05:41:30.925 DEBUG:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-17T05:41:30.991 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-17T05:41:30.993 DEBUG:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-17T05:41:31.095 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-17T05:41:31.097 DEBUG:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-17T05:41:31.159 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-17T05:41:31.162 DEBUG:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-17T05:41:31.223 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-17T05:41:31.226 DEBUG:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-17T05:41:31.287 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-17T05:41:31.290 DEBUG:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-17T05:41:31.351 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-17T05:41:31.353 DEBUG:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-17T05:41:31.418 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-17T05:41:31.421 DEBUG:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-17T05:41:31.486 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-17T05:41:31.488 DEBUG:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-17T05:41:31.552 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-17T05:41:31.555 DEBUG:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-17T05:41:31.621 INFO:tasks.ceph:Running mkfs on mon nodes... 2024-09-17T05:41:31.621 DEBUG:teuthology.orchestra.run.smithi150:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2024-09-17T05:41:31.646 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-09-17T05:41:31.753 DEBUG:teuthology.orchestra.run.smithi150:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2024-09-17T05:41:31.778 DEBUG:teuthology.orchestra.run.smithi176:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2024-09-17T05:41:31.803 DEBUG:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-09-17T05:41:31.911 DEBUG:teuthology.orchestra.run.smithi176:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2024-09-17T05:41:31.936 DEBUG:teuthology.orchestra.run.smithi176:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2024-09-17T05:41:32.002 DEBUG:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-09-17T05:41:32.108 DEBUG:teuthology.orchestra.run.smithi176:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2024-09-17T05:41:32.133 DEBUG:teuthology.orchestra.run.smithi150:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-09-17T05:41:32.135 DEBUG:teuthology.orchestra.run.smithi176:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-09-17T05:41:32.188 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2024-09-17T05:41:32.188 INFO:tasks.ceph.mon.a:Restarting daemon 2024-09-17T05:41:32.188 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2024-09-17T05:41:32.190 INFO:tasks.ceph.mon.a:Started 2024-09-17T05:41:32.191 INFO:tasks.ceph.mon.b:Restarting daemon 2024-09-17T05:41:32.191 DEBUG:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2024-09-17T05:41:32.230 INFO:tasks.ceph.mon.b:Started 2024-09-17T05:41:32.230 INFO:tasks.ceph.mon.c:Restarting daemon 2024-09-17T05:41:32.231 DEBUG:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2024-09-17T05:41:32.233 INFO:tasks.ceph.mon.c:Started 2024-09-17T05:41:32.233 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2024-09-17T05:41:32.233 INFO:tasks.ceph.mgr.y:Restarting daemon 2024-09-17T05:41:32.233 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2024-09-17T05:41:32.235 INFO:tasks.ceph.mgr.y:Started 2024-09-17T05:41:32.235 INFO:tasks.ceph.mgr.x:Restarting daemon 2024-09-17T05:41:32.236 DEBUG:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2024-09-17T05:41:32.238 INFO:tasks.ceph.mgr.x:Started 2024-09-17T05:41:32.238 INFO:tasks.ceph:setting config [client] client_mount_timeout = 600 2024-09-17T05:41:32.238 DEBUG:teuthology.orchestra.run.smithi150:> sudo ceph --cluster ceph config set client client_mount_timeout 600 2024-09-17T05:41:32.240 INFO:tasks.ceph:setting config [client] debug_client = 20 2024-09-17T05:41:32.240 DEBUG:teuthology.orchestra.run.smithi150:> sudo ceph --cluster ceph config set client debug_client 20 2024-09-17T05:41:32.284 INFO:tasks.ceph:setting config [client] debug_ms = 1 2024-09-17T05:41:32.285 DEBUG:teuthology.orchestra.run.smithi150:> sudo ceph --cluster ceph config set client debug_ms 1 2024-09-17T05:41:32.329 INFO:tasks.ceph:setting config [client] rados_mon_op_timeout = 900 2024-09-17T05:41:32.329 DEBUG:teuthology.orchestra.run.smithi150:> sudo ceph --cluster ceph config set client rados_mon_op_timeout 900 2024-09-17T05:41:32.373 INFO:tasks.ceph:setting config [client] rados_osd_op_timeout = 900 2024-09-17T05:41:32.373 DEBUG:teuthology.orchestra.run.smithi150:> sudo ceph --cluster ceph config set client rados_osd_op_timeout 900 2024-09-17T05:41:32.416 INFO:tasks.ceph:setting config [mds] debug_mds = 20 2024-09-17T05:41:32.417 DEBUG:teuthology.orchestra.run.smithi150:> sudo ceph --cluster ceph config set mds debug_mds 20 2024-09-17T05:41:32.459 INFO:tasks.ceph:setting config [mds] debug_mds_balancer = 20 2024-09-17T05:41:32.459 DEBUG:teuthology.orchestra.run.smithi150:> sudo ceph --cluster ceph config set mds debug_mds_balancer 20 2024-09-17T05:41:32.503 INFO:tasks.ceph:setting config [mds] debug_ms = 2 2024-09-17T05:41:32.503 DEBUG:teuthology.orchestra.run.smithi150:> sudo ceph --cluster ceph config set mds debug_ms 2 2024-09-17T05:41:32.551 INFO:tasks.ceph:setting config [mds] mds_debug_frag = True 2024-09-17T05:41:32.551 DEBUG:teuthology.orchestra.run.smithi150:> sudo ceph --cluster ceph config set mds mds_debug_frag True 2024-09-17T05:41:32.598 INFO:tasks.ceph:setting config [mds] mds_debug_scatterstat = True 2024-09-17T05:41:32.598 DEBUG:teuthology.orchestra.run.smithi150:> sudo ceph --cluster ceph config set mds mds_debug_scatterstat True 2024-09-17T05:41:32.649 INFO:tasks.ceph:setting config [mds] mds_op_complaint_time = 180 2024-09-17T05:41:32.649 DEBUG:teuthology.orchestra.run.smithi150:> sudo ceph --cluster ceph config set mds mds_op_complaint_time 180 2024-09-17T05:41:32.693 INFO:tasks.ceph:setting config [mds] mds_verify_scatter = True 2024-09-17T05:41:32.693 DEBUG:teuthology.orchestra.run.smithi150:> sudo ceph --cluster ceph config set mds mds_verify_scatter True 2024-09-17T05:41:32.706 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:32.704+0000 7f9938494640 1 -- 172.21.15.150:0/977909197 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command([{prefix=config set, name=rados_mon_op_timeout}] v 0) -- 0x7f990c005100 con 0x7f9930153e20 2024-09-17T05:41:32.707 INFO:tasks.ceph:setting config [mds] osd_op_complaint_time = 180 2024-09-17T05:41:32.708 DEBUG:teuthology.orchestra.run.smithi150:> sudo ceph --cluster ceph config set mds osd_op_complaint_time 180 2024-09-17T05:41:32.717 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:32.714+0000 7f50057fa640 1 -- 172.21.15.150:0/605702855 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f50201e48f0 msgr2=0x7f50201f2930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:41:32.717 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:32.714+0000 7f50057fa640 1 --2- 172.21.15.150:0/605702855 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f50201e48f0 0x7f50201f2930 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f5014010860 tx=0x7f5014010c60 comp rx=0 tx=0).stop 2024-09-17T05:41:32.717 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:32.714+0000 7f50057fa640 1 -- 172.21.15.150:0/605702855 shutdown_connections 2024-09-17T05:41:32.717 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:32.714+0000 7f50057fa640 1 --2- 172.21.15.150:0/605702855 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f50201f2e70 0x7f502014e710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:41:32.717 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:32.714+0000 7f50057fa640 1 --2- 172.21.15.150:0/605702855 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f50201e48f0 0x7f50201f2930 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:41:32.717 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:32.714+0000 7f50057fa640 1 --2- 172.21.15.150:0/605702855 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f50200cd610 0x7f5020150090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:41:32.717 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:32.714+0000 7f50057fa640 1 -- 172.21.15.150:0/605702855 >> 172.21.15.150:0/605702855 conn(0x7f5020073890 msgr2=0x7f502006cda0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:41:32.718 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:32.714+0000 7f9926ffd640 1 -- 172.21.15.150:0/977909197 <== mon.0 v2:172.21.15.150:3300/0 10 ==== mon_command_ack([{prefix=config set, name=rados_mon_op_timeout}]=0 v5)=0 v5) ==== 123+0+0 (secure 0 0 0) 0x7f9930154770 con 0x7f9930153e20 2024-09-17T05:41:32.718 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:32.715+0000 7f50057fa640 1 -- 172.21.15.150:0/605702855 shutdown_connections 2024-09-17T05:41:32.718 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:32.715+0000 7f50057fa640 1 -- 172.21.15.150:0/605702855 wait complete. 2024-09-17T05:41:32.725 INFO:tasks.ceph:setting config [mds] rados_mon_op_timeout = 900 2024-09-17T05:41:32.726 DEBUG:teuthology.orchestra.run.smithi150:> sudo ceph --cluster ceph config set mds rados_mon_op_timeout 900 2024-09-17T05:41:32.726 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:32.717+0000 7f9926ffd640 1 -- 172.21.15.150:0/977909197 <== mon.0 v2:172.21.15.150:3300/0 11 ==== config(4 keys) ==== 110+0+0 (secure 0 0 0) 0x7f9928004570 con 0x7f9930153e20 2024-09-17T05:41:32.727 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:32.716+0000 7fb0e77fe640 1 -- 172.21.15.150:0/2549042321 <== mon.0 v2:172.21.15.150:3300/0 10 ==== config(4 keys) ==== 110+0+0 (secure 0 0 0) 0x7fb0f00054f0 con 0x7fb0f8006820 2024-09-17T05:41:32.727 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:32.716+0000 7f704f7fe640 1 -- 172.21.15.150:0/1904893145 <== mon.0 v2:172.21.15.150:3300/0 10 ==== config(4 keys) ==== 110+0+0 (secure 0 0 0) 0x7f7048034910 con 0x7f70440039b0 2024-09-17T05:41:32.728 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:32.727+0000 7f9938494640 1 -- 172.21.15.150:0/977909197 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9930153e20 msgr2=0x7f9930154230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:41:32.728 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:32.727+0000 7f9938494640 1 --2- 172.21.15.150:0/977909197 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9930153e20 0x7f9930154230 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f992802b1d0 tx=0x7f9928004ab0 comp rx=0 tx=0).stop 2024-09-17T05:41:32.738 INFO:tasks.ceph:setting config [mds] rados_osd_op_timeout = 900 2024-09-17T05:41:32.738 DEBUG:teuthology.orchestra.run.smithi150:> sudo ceph --cluster ceph config set mds rados_osd_op_timeout 900 2024-09-17T05:41:32.739 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:32.728+0000 7f4a942d5640 1 -- 172.21.15.150:0/398599822 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4a8c073a80 msgr2=0x7f4a8c0b44a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:41:32.739 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:32.728+0000 7f4a942d5640 1 --2- 172.21.15.150:0/398599822 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4a8c073a80 0x7f4a8c0b44a0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f4a8c0afc30 tx=0x7f4a7c03b470 comp rx=0 tx=0).stop 2024-09-17T05:41:32.739 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:32.728+0000 7f4a942d5640 1 -- 172.21.15.150:0/398599822 shutdown_connections 2024-09-17T05:41:32.739 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:32.728+0000 7f4a942d5640 1 --2- 172.21.15.150:0/398599822 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4a8c073a80 0x7f4a8c0b44a0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:41:32.739 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:32.728+0000 7f4a942d5640 1 --2- 172.21.15.150:0/398599822 >> v2:172.21.15.150:3300/0 conn(0x7f4a8c15d350 0x7f4a8c073540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:41:32.739 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:32.728+0000 7f4a942d5640 1 -- 172.21.15.150:0/398599822 >> 172.21.15.150:0/398599822 conn(0x7f4a8c06d1c0 msgr2=0x7f4a8c06d5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:41:32.740 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:32.731+0000 7f9938494640 1 -- 172.21.15.150:0/977909197 shutdown_connections 2024-09-17T05:41:32.740 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:32.731+0000 7f9938494640 1 --2- 172.21.15.150:0/977909197 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9930153e20 0x7f9930154230 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:41:32.740 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:32.731+0000 7f9938494640 1 --2- 172.21.15.150:0/977909197 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f99301f48b0 0x7f9930142670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:41:32.740 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:32.732+0000 7f9938494640 1 --2- 172.21.15.150:0/977909197 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f991c005270 0x7f993015a930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:41:32.740 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:32.732+0000 7f9938494640 1 -- 172.21.15.150:0/977909197 >> 172.21.15.150:0/977909197 conn(0x7f9930074890 msgr2=0x7f99300b0850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:41:32.740 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:32.731+0000 7f4a942d5640 1 -- 172.21.15.150:0/398599822 shutdown_connections 2024-09-17T05:41:32.741 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:32.732+0000 7f4a942d5640 1 -- 172.21.15.150:0/398599822 wait complete. 2024-09-17T05:41:32.741 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:32.735+0000 7f4a942d5640 1 Processor -- start 2024-09-17T05:41:32.741 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:32.735+0000 7f4a942d5640 1 -- start start 2024-09-17T05:41:32.741 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:32.737+0000 7f9938494640 1 -- 172.21.15.150:0/977909197 shutdown_connections 2024-09-17T05:41:32.741 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:32.737+0000 7f9938494640 1 -- 172.21.15.150:0/977909197 wait complete. 2024-09-17T05:41:32.742 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:32.737+0000 7f4a942d5640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4a8c06fde0 0x7f4a8c13ea70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:41:32.742 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:32.737+0000 7f4a942d5640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4a8c073a80 0x7f4a8c0b2280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:41:32.742 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:32.738+0000 7f4a92071640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4a8c06fde0 0x7f4a8c13ea70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:41:32.743 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:32.738+0000 7f4a92071640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4a8c06fde0 0x7f4a8c13ea70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3301/0 says I am v2:172.21.15.150:58866/0 (socket says 172.21.15.150:58866) 2024-09-17T05:41:32.753 INFO:tasks.ceph:setting config [mgr] client_mount_timeout = 30 2024-09-17T05:41:32.753 DEBUG:teuthology.orchestra.run.smithi150:> sudo ceph --cluster ceph config set mgr client_mount_timeout 30 2024-09-17T05:41:32.754 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:32.748+0000 7f4a91870640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4a8c073a80 0x7f4a8c0b2280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:41:32.754 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:32.748+0000 7f4a91870640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4a8c073a80 0x7f4a8c0b2280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:49746/0 (socket says 172.21.15.150:49746) 2024-09-17T05:41:32.754 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:32.748+0000 7f4a942d5640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4a8c15d350 0x7f4a8c0b27c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:41:32.754 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:32.748+0000 7f4a942d5640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f4a8c0b5500 con 0x7f4a8c073a80 2024-09-17T05:41:32.754 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:32.748+0000 7f4a942d5640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f4a8c0b49e0 con 0x7f4a8c15d350 2024-09-17T05:41:32.754 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:32.748+0000 7f4a942d5640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f4a8c0b4b60 con 0x7f4a8c06fde0 2024-09-17T05:41:32.754 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:32.749+0000 7f4a92872640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4a8c15d350 0x7f4a8c0b27c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:41:32.755 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:32.749+0000 7f4a92071640 1 -- 172.21.15.150:0/1414653385 learned_addr learned my addr 172.21.15.150:0/1414653385 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:41:32.755 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:32.749+0000 7f4a92872640 1 -- 172.21.15.150:0/1414653385 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4a8c06fde0 msgr2=0x7f4a8c13ea70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:41:32.755 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:32.749+0000 7f4a92872640 1 --2- 172.21.15.150:0/1414653385 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4a8c06fde0 0x7f4a8c13ea70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:41:32.755 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:32.749+0000 7f4a92872640 1 -- 172.21.15.150:0/1414653385 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4a8c073a80 msgr2=0x7f4a8c0b2280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:41:32.755 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:32.749+0000 7f4a92872640 1 --2- 172.21.15.150:0/1414653385 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4a8c073a80 0x7f4a8c0b2280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:41:32.755 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:32.749+0000 7f4a92872640 1 -- 172.21.15.150:0/1414653385 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4a8c152e10 con 0x7f4a8c15d350 2024-09-17T05:41:32.755 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:32.750+0000 7f4a92872640 1 --2- 172.21.15.150:0/1414653385 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4a8c15d350 0x7f4a8c0b27c0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f4a7c042000 tx=0x7f4a7c041650 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:41:32.755 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:32.750+0000 7f4a82ffd640 1 -- 172.21.15.150:0/1414653385 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a7c050020 con 0x7f4a8c15d350 2024-09-17T05:41:32.755 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:32.751+0000 7f4a82ffd640 1 -- 172.21.15.150:0/1414653385 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(4 keys) ==== 110+0+0 (secure 0 0 0) 0x7f4a7c004220 con 0x7f4a8c15d350 2024-09-17T05:41:32.755 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:32.751+0000 7f4a942d5640 1 -- 172.21.15.150:0/1414653385 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4a8c151210 con 0x7f4a8c15d350 2024-09-17T05:41:32.755 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:32.751+0000 7f4a942d5640 1 -- 172.21.15.150:0/1414653385 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4a8c1f2c40 con 0x7f4a8c15d350 2024-09-17T05:41:32.755 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:32.752+0000 7f4a82ffd640 1 -- 172.21.15.150:0/1414653385 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a7c048040 con 0x7f4a8c15d350 2024-09-17T05:41:32.765 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:32.764+0000 7f4a80ff9640 1 -- 172.21.15.150:0/1414653385 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4a74005290 con 0x7f4a8c15d350 2024-09-17T05:41:32.765 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:32.764+0000 7f4a82ffd640 1 -- 172.21.15.150:0/1414653385 <== mon.1 v2:172.21.15.176:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f4a7c041b50 con 0x7f4a8c15d350 2024-09-17T05:41:32.765 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:32.764+0000 7f4a82ffd640 1 -- 172.21.15.150:0/1414653385 <== mon.1 v2:172.21.15.176:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f4a7c055600 con 0x7f4a8c15d350 2024-09-17T05:41:32.769 INFO:tasks.ceph:setting config [mgr] debug_client = 20 2024-09-17T05:41:32.769 DEBUG:teuthology.orchestra.run.smithi150:> sudo ceph --cluster ceph config set mgr debug_client 20 2024-09-17T05:41:32.772 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:32.770+0000 7f4a82ffd640 1 -- 172.21.15.150:0/1414653385 <== mon.1 v2:172.21.15.176:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7f4a7c05a060 con 0x7f4a8c15d350 2024-09-17T05:41:32.775 INFO:tasks.ceph:setting config [mgr] debug_mgr = 20 2024-09-17T05:41:32.775 DEBUG:teuthology.orchestra.run.smithi150:> sudo ceph --cluster ceph config set mgr debug_mgr 20 2024-09-17T05:41:32.789 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:32.787+0000 7f6f4f59e640 1 -- 172.21.15.150:0/4007502870 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6f48055280 msgr2=0x7f6f48009010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:41:32.789 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:32.787+0000 7f6f4f59e640 1 --2- 172.21.15.150:0/4007502870 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6f48055280 0x7f6f48009010 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f6f5006ad00 tx=0x7f6f500a66a0 comp rx=0 tx=0).stop 2024-09-17T05:41:32.797 INFO:tasks.ceph:setting config [mgr] debug_ms = 1 2024-09-17T05:41:32.798 DEBUG:teuthology.orchestra.run.smithi150:> sudo ceph --cluster ceph config set mgr debug_ms 1 2024-09-17T05:41:32.798 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:32.790+0000 7fb0fffff640 1 -- 172.21.15.150:0/2549042321 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command([{prefix=config set, name=rados_osd_op_timeout}] v 0) -- 0x7fb0d8005310 con 0x7fb0f8006820 2024-09-17T05:41:32.798 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:32.790+0000 7f6f4f59e640 1 -- 172.21.15.150:0/4007502870 shutdown_connections 2024-09-17T05:41:32.799 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:32.790+0000 7f6f4f59e640 1 --2- 172.21.15.150:0/4007502870 >> v2:172.21.15.150:3300/0 conn(0x7f6f48036770 0x7f6f480557d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:41:32.799 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:32.790+0000 7f6f4f59e640 1 --2- 172.21.15.150:0/4007502870 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6f48055280 0x7f6f48009010 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:41:32.799 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:32.790+0000 7f6f4f59e640 1 -- 172.21.15.150:0/4007502870 >> 172.21.15.150:0/4007502870 conn(0x7f6f4801eae0 msgr2=0x7f6f4803a710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:41:32.799 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:32.797+0000 7f704f7fe640 1 -- 172.21.15.150:0/1904893145 <== mon.0 v2:172.21.15.150:3300/0 11 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f7048034c60 con 0x7f70440039b0 2024-09-17T05:41:32.799 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:32.797+0000 7fb0e77fe640 1 -- 172.21.15.150:0/2549042321 <== mon.0 v2:172.21.15.150:3300/0 11 ==== mon_command_ack([{prefix=config set, name=rados_osd_op_timeout}]=0 v6)=0 v6) ==== 123+0+0 (secure 0 0 0) 0x7fb0f0004c20 con 0x7fb0f8006820 2024-09-17T05:41:32.800 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:32.797+0000 7fb0e77fe640 1 -- 172.21.15.150:0/2549042321 <== mon.0 v2:172.21.15.150:3300/0 12 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb0f0052020 con 0x7fb0f8006820 2024-09-17T05:41:32.800 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:32.797+0000 7f4a82ffd640 1 -- 172.21.15.150:0/1414653385 <== mon.1 v2:172.21.15.176:3300/0 7 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f4a7c043440 con 0x7f4a8c15d350 2024-09-17T05:41:32.803 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:32.800+0000 7f6f4f59e640 1 -- 172.21.15.150:0/4007502870 shutdown_connections 2024-09-17T05:41:32.804 INFO:tasks.ceph:setting config [mgr] mon_warn_on_pool_no_app = False 2024-09-17T05:41:32.805 DEBUG:teuthology.orchestra.run.smithi150:> sudo ceph --cluster ceph config set mgr mon_warn_on_pool_no_app False 2024-09-17T05:41:32.805 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:32.803+0000 7f6f4f59e640 1 -- 172.21.15.150:0/4007502870 wait complete. 2024-09-17T05:41:32.808 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:32.806+0000 7f6f4f59e640 1 Processor -- start 2024-09-17T05:41:32.811 INFO:tasks.ceph:setting config [mon] mon_op_complaint_time = 120 2024-09-17T05:41:32.811 DEBUG:teuthology.orchestra.run.smithi150:> sudo ceph --cluster ceph config set mon mon_op_complaint_time 120 2024-09-17T05:41:32.812 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:32.811+0000 7f6f4f59e640 1 -- start start 2024-09-17T05:41:32.813 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:32.811+0000 7fb0fffff640 1 -- 172.21.15.150:0/2549042321 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb0f8006820 msgr2=0x7fb0f80dfc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:41:32.813 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:32.812+0000 7fb0fffff640 1 --2- 172.21.15.150:0/2549042321 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb0f8006820 0x7fb0f80dfc10 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fb0f000aa60 tx=0x7fb0f00046c0 comp rx=0 tx=0).stop 2024-09-17T05:41:32.813 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:32.812+0000 7fb0fffff640 1 -- 172.21.15.150:0/2549042321 shutdown_connections 2024-09-17T05:41:32.813 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:32.812+0000 7fb0fffff640 1 --2- 172.21.15.150:0/2549042321 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb0f80519a0 0x7fb0f80e26a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:41:32.814 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:32.812+0000 7fb0fffff640 1 --2- 172.21.15.150:0/2549042321 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb0f80df800 0x7fb0f8177c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:41:32.816 INFO:tasks.ceph:setting config [osd] osd_op_complaint_time = 180 2024-09-17T05:41:32.816 DEBUG:teuthology.orchestra.run.smithi150:> sudo ceph --cluster ceph config set osd osd_op_complaint_time 180 2024-09-17T05:41:32.817 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:32.812+0000 7fb0fffff640 1 --2- 172.21.15.150:0/2549042321 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb0f8006820 0x7fb0f80dfc10 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:41:32.817 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:32.812+0000 7fb0fffff640 1 -- 172.21.15.150:0/2549042321 >> 172.21.15.150:0/2549042321 conn(0x7fb0f801e260 msgr2=0x7fb0f8053610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:41:32.818 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:32.812+0000 7fb0fffff640 1 -- 172.21.15.150:0/2549042321 shutdown_connections 2024-09-17T05:41:32.818 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:32.812+0000 7fb0fffff640 1 -- 172.21.15.150:0/2549042321 wait complete. 2024-09-17T05:41:32.818 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:32.813+0000 7f6f4f59e640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6f48036770 0x7f6f48032ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:41:32.818 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:32.813+0000 7f6f4f59e640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6f48036cc0 0x7f6f480082b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:41:32.818 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:32.813+0000 7f6f4f59e640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6f48055280 0x7f6f4804c950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:41:32.818 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:32.813+0000 7f6f4f59e640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f6f4803b140 con 0x7f6f48036cc0 2024-09-17T05:41:32.818 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:32.813+0000 7f6f4f59e640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f6f48055d10 con 0x7f6f48055280 2024-09-17T05:41:32.818 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:32.813+0000 7f6f4f59e640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f6f48055e90 con 0x7f6f48036770 2024-09-17T05:41:32.823 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:32.813+0000 7f6f4e59c640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6f48036770 0x7f6f48032ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:41:32.823 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:32.813+0000 7f6f4e59c640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6f48036770 0x7f6f48032ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3301/0 says I am v2:172.21.15.150:58878/0 (socket says 172.21.15.150:58878) 2024-09-17T05:41:32.823 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:32.813+0000 7f6f4e59c640 1 -- 172.21.15.150:0/513308264 learned_addr learned my addr 172.21.15.150:0/513308264 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:41:32.825 DEBUG:tasks.ceph:set 22 configs 2024-09-17T05:41:32.826 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'client', 'client_mount_timeout', '600'], check_status=True, hostname='smithi150') 2024-09-17T05:41:32.826 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'client', 'debug_client', '20'], check_status=True, hostname='smithi150') 2024-09-17T05:41:32.826 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'client', 'debug_ms', '1'], check_status=True, hostname='smithi150') 2024-09-17T05:41:32.826 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'client', 'rados_mon_op_timeout', '900'], check_status=True, hostname='smithi150') 2024-09-17T05:41:32.826 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'client', 'rados_osd_op_timeout', '900'], check_status=True, hostname='smithi150') 2024-09-17T05:41:32.827 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:32.813+0000 7f6f4ed9d640 1 --2- 172.21.15.150:0/513308264 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6f48055280 0x7f6f4804c950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:41:32.827 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:32.814+0000 7f6f4e59c640 1 -- 172.21.15.150:0/513308264 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6f48055280 msgr2=0x7f6f4804c950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:41:32.827 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:32.814+0000 7f6f4e59c640 1 --2- 172.21.15.150:0/513308264 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6f48055280 0x7f6f4804c950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:41:32.827 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:32.814+0000 7f6f4e59c640 1 -- 172.21.15.150:0/513308264 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6f48036cc0 msgr2=0x7f6f480082b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:41:32.828 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:32.814+0000 7f6f4e59c640 1 --2- 172.21.15.150:0/513308264 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6f48036cc0 0x7f6f480082b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:41:32.828 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:32.814+0000 7f6f4e59c640 1 -- 172.21.15.150:0/513308264 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6f480d7b20 con 0x7f6f48036770 2024-09-17T05:41:32.828 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:32.816+0000 7f6f4e59c640 1 --2- 172.21.15.150:0/513308264 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6f48036770 0x7f6f48032ce0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f6f5006c380 tx=0x7f6f500a6bc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:41:32.828 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:32.818+0000 7f6f3effd640 1 -- 172.21.15.150:0/513308264 <== mon.2 v2:172.21.15.176:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f500bb070 con 0x7f6f48036770 2024-09-17T05:41:32.828 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:32.818+0000 7f6f3effd640 1 -- 172.21.15.150:0/513308264 <== mon.2 v2:172.21.15.176:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f6f500ac970 con 0x7f6f48036770 2024-09-17T05:41:32.828 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:32.818+0000 7f6f3effd640 1 -- 172.21.15.150:0/513308264 <== mon.2 v2:172.21.15.176:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f500acd40 con 0x7f6f48036770 2024-09-17T05:41:32.828 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:32.818+0000 7f6f4f59e640 1 -- 172.21.15.150:0/513308264 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6f48007bc0 con 0x7f6f48036770 2024-09-17T05:41:32.828 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:32.818+0000 7f6f4f59e640 1 -- 172.21.15.150:0/513308264 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f6f480087f0 con 0x7f6f48036770 2024-09-17T05:41:32.828 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:32.820+0000 7f6f3effd640 1 -- 172.21.15.150:0/513308264 <== mon.2 v2:172.21.15.176:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f6f500c0460 con 0x7f6f48036770 2024-09-17T05:41:32.828 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:32.820+0000 7f6f3effd640 1 -- 172.21.15.150:0/513308264 <== mon.2 v2:172.21.15.176:3301/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f6f500b76d0 con 0x7f6f48036770 2024-09-17T05:41:32.833 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:32.831+0000 7f6f3cff9640 1 -- 172.21.15.150:0/513308264 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6f34005290 con 0x7f6f48036770 2024-09-17T05:41:32.837 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:32.835+0000 7f6f3effd640 1 -- 172.21.15.150:0/513308264 <== mon.2 v2:172.21.15.176:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7f6f500ce020 con 0x7f6f48036770 2024-09-17T05:41:32.864 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mds', 'debug_mds', '20'], check_status=True, hostname='smithi150') 2024-09-17T05:41:32.890 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:32.888+0000 7f0cf949b640 1 -- 172.21.15.150:0/2104561028 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0cf406ddb0 msgr2=0x7f0cf406e1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:41:32.891 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:32.888+0000 7f0cf949b640 1 --2- 172.21.15.150:0/2104561028 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0cf406ddb0 0x7f0cf406e1c0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f0cf4074850 tx=0x7f0cec02aa30 comp rx=0 tx=0).stop 2024-09-17T05:41:32.891 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:32.889+0000 7f0cf949b640 1 -- 172.21.15.150:0/2104561028 shutdown_connections 2024-09-17T05:41:32.891 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:32.889+0000 7f0cf949b640 1 --2- 172.21.15.150:0/2104561028 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0cf406ddb0 0x7f0cf406e1c0 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:41:32.891 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:32.889+0000 7f0cf949b640 1 --2- 172.21.15.150:0/2104561028 >> v2:172.21.15.176:3300/0 conn(0x7f0cf415eae0 0x7f0cf415eef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:41:32.891 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:32.889+0000 7f0cf949b640 1 --2- 172.21.15.150:0/2104561028 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0cf415c130 0x7f0cf40b6380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:41:32.891 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:32.889+0000 7f0cf949b640 1 -- 172.21.15.150:0/2104561028 >> 172.21.15.150:0/2104561028 conn(0x7f0cf4073890 msgr2=0x7f0cf4073ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:41:32.903 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:32.899+0000 7f0cf949b640 1 -- 172.21.15.150:0/2104561028 shutdown_connections 2024-09-17T05:41:32.903 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:32.899+0000 7f0cf949b640 1 -- 172.21.15.150:0/2104561028 wait complete. 2024-09-17T05:41:32.904 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:32.902+0000 7f0cf949b640 1 Processor -- start 2024-09-17T05:41:32.904 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:32.902+0000 7f0cf949b640 1 -- start start 2024-09-17T05:41:32.906 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:32.905+0000 7f0cf949b640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0cf406ddb0 0x7f0cf4140790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:41:32.916 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:32.910+0000 7f0cf949b640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0cf415c130 0x7f0cf4155c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:41:32.916 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:32.910+0000 7f0cf949b640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0cf415eae0 0x7f0cf41f5110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:41:32.916 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:32.910+0000 7f0cf949b640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f0cf40b4450 con 0x7f0cf406ddb0 2024-09-17T05:41:32.916 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:32.910+0000 7f0cf949b640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f0cf40b42d0 con 0x7f0cf415eae0 2024-09-17T05:41:32.916 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:32.910+0000 7f0cf949b640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f0cf40b45d0 con 0x7f0cf415c130 2024-09-17T05:41:32.917 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:32.914+0000 7f0cf37fe640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0cf415eae0 0x7f0cf41f5110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:41:32.917 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:32.914+0000 7f0cf37fe640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0cf415eae0 0x7f0cf41f5110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3300/0 says I am v2:172.21.15.150:35914/0 (socket says 172.21.15.150:35914) 2024-09-17T05:41:32.917 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:32.914+0000 7f0cf37fe640 1 -- 172.21.15.150:0/2854847161 learned_addr learned my addr 172.21.15.150:0/2854847161 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:41:32.917 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:32.914+0000 7f0cf27fc640 1 --2- 172.21.15.150:0/2854847161 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0cf415c130 0x7f0cf4155c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:41:32.917 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:32.915+0000 7f0cf37fe640 1 -- 172.21.15.150:0/2854847161 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0cf415c130 msgr2=0x7f0cf4155c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:41:32.918 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:32.915+0000 7f0cf37fe640 1 --2- 172.21.15.150:0/2854847161 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0cf415c130 0x7f0cf4155c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:41:32.918 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:32.915+0000 7f0cf37fe640 1 -- 172.21.15.150:0/2854847161 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0cf406ddb0 msgr2=0x7f0cf4140790 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-17T05:41:32.928 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:32.927+0000 7f0cf2ffd640 1 --2- 172.21.15.150:0/2854847161 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0cf406ddb0 0x7f0cf4140790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:41:32.929 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:32.927+0000 7f0cf37fe640 1 --2- 172.21.15.150:0/2854847161 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0cf406ddb0 0x7f0cf4140790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:41:32.929 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:32.927+0000 7f0cf37fe640 1 -- 172.21.15.150:0/2854847161 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0cf41569d0 con 0x7f0cf415eae0 2024-09-17T05:41:32.929 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:32.927+0000 7f0cf2ffd640 1 --2- 172.21.15.150:0/2854847161 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0cf406ddb0 0x7f0cf4140790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T05:41:32.934 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:32.933+0000 7f0cf37fe640 1 --2- 172.21.15.150:0/2854847161 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0cf415eae0 0x7f0cf41f5110 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f0cec009d60 tx=0x7f0cec0045c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:41:32.938 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:32.937+0000 7f0ceb7fe640 1 -- 172.21.15.150:0/2854847161 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0cec047070 con 0x7f0cf415eae0 2024-09-17T05:41:32.938 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:32.937+0000 7f0ceb7fe640 1 -- 172.21.15.150:0/2854847161 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0cec003e20 con 0x7f0cf415eae0 2024-09-17T05:41:32.939 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:32.937+0000 7f0ceb7fe640 1 -- 172.21.15.150:0/2854847161 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0cec033070 con 0x7f0cf415eae0 2024-09-17T05:41:32.939 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:32.937+0000 7f0cf949b640 1 -- 172.21.15.150:0/2854847161 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0cf4156cb0 con 0x7f0cf415eae0 2024-09-17T05:41:32.939 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:32.937+0000 7f0cf949b640 1 -- 172.21.15.150:0/2854847161 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0cf4157270 con 0x7f0cf415eae0 2024-09-17T05:41:32.940 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:32.939+0000 7f0ce97fa640 1 -- 172.21.15.150:0/2854847161 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0cf40cf8c0 con 0x7f0cf415eae0 2024-09-17T05:41:32.941 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:32.940+0000 7f0ceb7fe640 1 -- 172.21.15.150:0/2854847161 <== mon.1 v2:172.21.15.176:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f0cec04a070 con 0x7f0cf415eae0 2024-09-17T05:41:32.943 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:32.942+0000 7f3b9da63640 1 -- 172.21.15.150:0/2467795321 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3b980b28f0 msgr2=0x7f3b980b3ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:41:32.944 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:32.942+0000 7f3b9da63640 1 --2- 172.21.15.150:0/2467795321 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3b980b28f0 0x7f3b980b3ae0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f3b88007380 tx=0x7f3b8802b0d0 comp rx=0 tx=0).stop 2024-09-17T05:41:32.944 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:32.942+0000 7f3b9da63640 1 -- 172.21.15.150:0/2467795321 shutdown_connections 2024-09-17T05:41:32.944 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:32.942+0000 7f3b9da63640 1 --2- 172.21.15.150:0/2467795321 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3b980b28f0 0x7f3b980b3ae0 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:41:32.944 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:32.942+0000 7f3b9da63640 1 -- 172.21.15.150:0/2467795321 >> 172.21.15.150:0/2467795321 conn(0x7f3b980b1dd0 msgr2=0x7f3b980b21e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:41:32.947 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:32.944+0000 7f0ceb7fe640 1 -- 172.21.15.150:0/2854847161 <== mon.1 v2:172.21.15.176:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f0cec000fb0 con 0x7f0cf415eae0 2024-09-17T05:41:32.947 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:32.944+0000 7f0ceb7fe640 1 -- 172.21.15.150:0/2854847161 <== mon.1 v2:172.21.15.176:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7f0cec051070 con 0x7f0cf415eae0 2024-09-17T05:41:32.951 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:32.942+0000 7f3b9da63640 1 -- 172.21.15.150:0/2467795321 shutdown_connections 2024-09-17T05:41:32.951 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:32.942+0000 7f3b9da63640 1 -- 172.21.15.150:0/2467795321 wait complete. 2024-09-17T05:41:32.957 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:32.945+0000 7f3b9da63640 1 Processor -- start 2024-09-17T05:41:32.957 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:32.945+0000 7f3b9da63640 1 -- start start 2024-09-17T05:41:32.957 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:32.948+0000 7f3b9da63640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3b980991b0 0x7f3b98205560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:41:32.957 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:32.948+0000 7f3b9da63640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3b9816b3e0 0x7f3b98093420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:41:32.957 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:32.948+0000 7f3b9da63640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3b98202790 0x7f3b98202ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:41:32.957 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:32.948+0000 7f3b9da63640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f3b9816bf00 con 0x7f3b980991b0 2024-09-17T05:41:32.957 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:32.948+0000 7f3b9da63640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f3b980b1680 con 0x7f3b98202790 2024-09-17T05:41:32.957 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:32.948+0000 7f3b9da63640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f3b9816c080 con 0x7f3b9816b3e0 2024-09-17T05:41:32.957 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:32.949+0000 7f3b96ffd640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3b9816b3e0 0x7f3b98093420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:41:32.957 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:32.949+0000 7f3b96ffd640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3b9816b3e0 0x7f3b98093420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3301/0 says I am v2:172.21.15.150:58924/0 (socket says 172.21.15.150:58924) 2024-09-17T05:41:32.958 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:32.949+0000 7f3b96ffd640 1 -- 172.21.15.150:0/2414608729 learned_addr learned my addr 172.21.15.150:0/2414608729 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:41:32.958 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:32.949+0000 7f3b977fe640 1 --2- 172.21.15.150:0/2414608729 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3b980991b0 0x7f3b98205560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:41:32.958 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:32.949+0000 7f3b96ffd640 1 -- 172.21.15.150:0/2414608729 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3b98202790 msgr2=0x7f3b98202ba0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-17T05:41:32.958 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:32.949+0000 7f3b96ffd640 1 --2- 172.21.15.150:0/2414608729 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3b98202790 0x7f3b98202ba0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:41:32.958 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:32.949+0000 7f3b96ffd640 1 -- 172.21.15.150:0/2414608729 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3b980991b0 msgr2=0x7f3b98205560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:41:32.958 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:32.949+0000 7f3b96ffd640 1 --2- 172.21.15.150:0/2414608729 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3b980991b0 0x7f3b98205560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:41:32.958 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:32.949+0000 7f3b96ffd640 1 -- 172.21.15.150:0/2414608729 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3b98094030 con 0x7f3b9816b3e0 2024-09-17T05:41:32.958 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:32.949+0000 7f3b977fe640 1 --2- 172.21.15.150:0/2414608729 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3b980991b0 0x7f3b98205560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:41:32.958 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:32.949+0000 7f3b96ffd640 1 --2- 172.21.15.150:0/2414608729 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3b9816b3e0 0x7f3b98093420 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f3b9000c9f0 tx=0x7f3b9000ceb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:41:32.958 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:32.954+0000 7f3b7ffff640 1 -- 172.21.15.150:0/2414608729 <== mon.2 v2:172.21.15.176:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b90003d80 con 0x7f3b9816b3e0 2024-09-17T05:41:32.958 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:32.954+0000 7f3b9da63640 1 -- 172.21.15.150:0/2414608729 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3b98094310 con 0x7f3b9816b3e0 2024-09-17T05:41:32.975 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:32.954+0000 7f3b9da63640 1 -- 172.21.15.150:0/2414608729 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f3b980948d0 con 0x7f3b9816b3e0 2024-09-17T05:41:32.976 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:32.974+0000 7f3b7dffb640 1 -- 172.21.15.150:0/2414608729 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3b78005290 con 0x7f3b9816b3e0 2024-09-17T05:41:32.976 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:32.974+0000 7f3b7ffff640 1 -- 172.21.15.150:0/2414608729 <== mon.2 v2:172.21.15.176:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f3b9000a700 con 0x7f3b9816b3e0 2024-09-17T05:41:32.976 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:32.974+0000 7f3b7ffff640 1 -- 172.21.15.150:0/2414608729 <== mon.2 v2:172.21.15.176:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b9000ab50 con 0x7f3b9816b3e0 2024-09-17T05:41:32.976 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:32.974+0000 7f3b7ffff640 1 -- 172.21.15.150:0/2414608729 <== mon.2 v2:172.21.15.176:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f3b90005070 con 0x7f3b9816b3e0 2024-09-17T05:41:32.976 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:32.974+0000 7f3b7ffff640 1 -- 172.21.15.150:0/2414608729 <== mon.2 v2:172.21.15.176:3301/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f3b9001bb00 con 0x7f3b9816b3e0 2024-09-17T05:41:32.984 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:32.979+0000 7f3b7ffff640 1 -- 172.21.15.150:0/2414608729 <== mon.2 v2:172.21.15.176:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7f3b9000acf0 con 0x7f3b9816b3e0 2024-09-17T05:41:32.993 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:32.988+0000 7f705d6de640 1 -- 172.21.15.150:0/1904893145 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command([{prefix=config set, name=debug_mds}] v 0) -- 0x7f70300052f0 con 0x7f70440039b0 2024-09-17T05:41:32.995 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:32.994+0000 7f704f7fe640 1 -- 172.21.15.150:0/1904893145 <== mon.0 v2:172.21.15.150:3300/0 12 ==== mon_command_ack([{prefix=config set, name=debug_mds}]=0 v7)=0 v7) ==== 108+0+0 (secure 0 0 0) 0x7f7058157fe0 con 0x7f70440039b0 2024-09-17T05:41:32.999 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:32.998+0000 7f705d6de640 1 -- 172.21.15.150:0/1904893145 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f70440039b0 msgr2=0x7f70580cf460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:41:33.000 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:32.998+0000 7f705d6de640 1 --2- 172.21.15.150:0/1904893145 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f70440039b0 0x7f70580cf460 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f704800c390 tx=0x7f7048000fe0 comp rx=0 tx=0).stop 2024-09-17T05:41:33.000 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:32.998+0000 7f705d6de640 1 -- 172.21.15.150:0/1904893145 shutdown_connections 2024-09-17T05:41:33.001 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:32.998+0000 7f705d6de640 1 --2- 172.21.15.150:0/1904893145 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7058151400 0x7f705809d9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:41:33.001 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:32.998+0000 7f705d6de640 1 --2- 172.21.15.150:0/1904893145 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7058157690 0x7f7058157aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:41:33.001 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:32.998+0000 7f705d6de640 1 --2- 172.21.15.150:0/1904893145 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f70440039b0 0x7f70580cf460 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:41:33.001 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:32.998+0000 7f705d6de640 1 -- 172.21.15.150:0/1904893145 >> 172.21.15.150:0/1904893145 conn(0x7f70580b1dd0 msgr2=0x7f7058160c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:41:33.001 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:32.999+0000 7f705d6de640 1 -- 172.21.15.150:0/1904893145 shutdown_connections 2024-09-17T05:41:33.001 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:32.999+0000 7f705d6de640 1 -- 172.21.15.150:0/1904893145 wait complete. 2024-09-17T05:41:33.060 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mds', 'debug_mds_balancer', '20'], check_status=True, hostname='smithi150') 2024-09-17T05:41:33.070 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:33.065+0000 7f4a80ff9640 1 -- 172.21.15.150:0/1414653385 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_command([{prefix=config set, name=debug_mds_balancer}] v 0) -- 0x7f4a74005850 con 0x7f4a8c15d350 2024-09-17T05:41:33.078 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:33.076+0000 7f4a82ffd640 1 -- 172.21.15.150:0/1414653385 <== mon.1 v2:172.21.15.176:3300/0 8 ==== mon_command_ack([{prefix=config set, name=debug_mds_balancer}]=0 v8)=0 v8) ==== 117+0+0 (secure 0 0 0) 0x7f4a7c055850 con 0x7f4a8c15d350 2024-09-17T05:41:33.082 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:33.080+0000 7f637ee1c640 1 -- 172.21.15.150:0/3124045428 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f63700df800 msgr2=0x7f6370007c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:41:33.082 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:33.080+0000 7f637ee1c640 1 --2- 172.21.15.150:0/3124045428 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f63700df800 0x7f6370007c60 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f636800b9c0 tx=0x7f636802c0f0 comp rx=0 tx=0).stop 2024-09-17T05:41:33.084 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:33.082+0000 7fd67d952640 1 -- 172.21.15.150:0/1575569793 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd6780b34e0 msgr2=0x7fd678074330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:41:33.084 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:33.082+0000 7fd67d952640 1 --2- 172.21.15.150:0/1575569793 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd6780b34e0 0x7fd678074330 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fd6640083e0 tx=0x7fd66402a210 comp rx=0 tx=0).stop 2024-09-17T05:41:33.084 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:33.082+0000 7fd67d952640 1 -- 172.21.15.150:0/1575569793 shutdown_connections 2024-09-17T05:41:33.084 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:33.082+0000 7fd67d952640 1 --2- 172.21.15.150:0/1575569793 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd6780b34e0 0x7fd678074330 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:41:33.084 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:33.082+0000 7fd67d952640 1 --2- 172.21.15.150:0/1575569793 >> v2:172.21.15.150:3300/0 conn(0x7fd678074870 0x7fd67815c430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:41:33.084 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:33.082+0000 7fd67d952640 1 -- 172.21.15.150:0/1575569793 >> 172.21.15.150:0/1575569793 conn(0x7fd6780b1dd0 msgr2=0x7fd6780b21e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:41:33.084 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:33.082+0000 7f637ee1c640 1 -- 172.21.15.150:0/3124045428 shutdown_connections 2024-09-17T05:41:33.085 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:33.082+0000 7f637ee1c640 1 --2- 172.21.15.150:0/3124045428 >> v2:172.21.15.176:3300/0 conn(0x7f6370053710 0x7f6370053b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:41:33.085 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:33.082+0000 7f637ee1c640 1 --2- 172.21.15.150:0/3124045428 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f63700df800 0x7f6370007c60 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:41:33.085 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:33.082+0000 7f637ee1c640 1 -- 172.21.15.150:0/3124045428 >> 172.21.15.150:0/3124045428 conn(0x7f637001e260 msgr2=0x7f6370039e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:41:33.085 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:33.083+0000 7fd67d952640 1 -- 172.21.15.150:0/1575569793 shutdown_connections 2024-09-17T05:41:33.085 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:33.083+0000 7fd67d952640 1 -- 172.21.15.150:0/1575569793 wait complete. 2024-09-17T05:41:33.087 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:33.086+0000 7fd67d952640 1 Processor -- start 2024-09-17T05:41:33.088 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:33.086+0000 7fd67d952640 1 -- start start 2024-09-17T05:41:33.090 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:33.089+0000 7f4a80ff9640 1 -- 172.21.15.150:0/1414653385 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4a8c15d350 msgr2=0x7f4a8c0b27c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:41:33.090 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:33.089+0000 7f4a80ff9640 1 --2- 172.21.15.150:0/1414653385 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4a8c15d350 0x7f4a8c0b27c0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f4a7c042000 tx=0x7f4a7c041650 comp rx=0 tx=0).stop 2024-09-17T05:41:33.091 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:33.089+0000 7f4a80ff9640 1 -- 172.21.15.150:0/1414653385 shutdown_connections 2024-09-17T05:41:33.091 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:33.089+0000 7f4a80ff9640 1 --2- 172.21.15.150:0/1414653385 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4a8c15d350 0x7f4a8c0b27c0 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:41:33.091 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:33.089+0000 7f4a80ff9640 1 --2- 172.21.15.150:0/1414653385 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4a8c073a80 0x7f4a8c0b2280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:41:33.091 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:33.089+0000 7f4a80ff9640 1 --2- 172.21.15.150:0/1414653385 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4a8c06fde0 0x7f4a8c13ea70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:41:33.091 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:33.089+0000 7f4a80ff9640 1 -- 172.21.15.150:0/1414653385 >> 172.21.15.150:0/1414653385 conn(0x7f4a8c06d1c0 msgr2=0x7f4a8c161450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:41:33.091 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:33.089+0000 7f4a80ff9640 1 -- 172.21.15.150:0/1414653385 shutdown_connections 2024-09-17T05:41:33.091 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:33.089+0000 7f4a80ff9640 1 -- 172.21.15.150:0/1414653385 wait complete. 2024-09-17T05:41:33.092 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:33.090+0000 7f637ee1c640 1 -- 172.21.15.150:0/3124045428 shutdown_connections 2024-09-17T05:41:33.094 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:33.093+0000 7f637ee1c640 1 -- 172.21.15.150:0/3124045428 wait complete. 2024-09-17T05:41:33.097 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:33.094+0000 7fd67d952640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd678074870 0x7fd6781547b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:41:33.097 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:33.096+0000 7fd67d952640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd6780b30d0 0x7fd6781f2df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:41:33.097 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:33.096+0000 7f637ee1c640 1 Processor -- start 2024-09-17T05:41:33.100 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:33.096+0000 7f637ee1c640 1 -- start start 2024-09-17T05:41:33.100 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:33.098+0000 7f637ee1c640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f63700519a0 0x7f63701756a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:41:33.100 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:33.099+0000 7f637ee1c640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6370053710 0x7f63700e23f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:41:33.100 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:33.099+0000 7f637ee1c640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f63700df800 0x7f6370006af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:41:33.101 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:33.099+0000 7f637de1a640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f63700519a0 0x7f63701756a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:41:33.101 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:33.099+0000 7f637de1a640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f63700519a0 0x7f63701756a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:49818/0 (socket says 172.21.15.150:49818) 2024-09-17T05:41:33.101 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:33.099+0000 7f637de1a640 1 -- 172.21.15.150:0/3955193823 learned_addr learned my addr 172.21.15.150:0/3955193823 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:41:33.101 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:33.099+0000 7f637ee1c640 1 -- 172.21.15.150:0/3955193823 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f6370006110 con 0x7f63700519a0 2024-09-17T05:41:33.101 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:33.099+0000 7f637ee1c640 1 -- 172.21.15.150:0/3955193823 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f6370005f90 con 0x7f6370053710 2024-09-17T05:41:33.101 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:33.099+0000 7f637ee1c640 1 -- 172.21.15.150:0/3955193823 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f6370006290 con 0x7f63700df800 2024-09-17T05:41:33.102 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:33.099+0000 7f637e61b640 1 --2- 172.21.15.150:0/3955193823 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f63700df800 0x7f6370006af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:41:33.102 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:33.100+0000 7f637de1a640 1 -- 172.21.15.150:0/3955193823 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f63700df800 msgr2=0x7f6370006af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:41:33.102 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:33.100+0000 7f637de1a640 1 --2- 172.21.15.150:0/3955193823 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f63700df800 0x7f6370006af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:41:33.102 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:33.100+0000 7f637de1a640 1 -- 172.21.15.150:0/3955193823 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6370053710 msgr2=0x7f63700e23f0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-17T05:41:33.102 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:33.100+0000 7f637de1a640 1 --2- 172.21.15.150:0/3955193823 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6370053710 0x7f63700e23f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:41:33.102 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:33.100+0000 7f637de1a640 1 -- 172.21.15.150:0/3955193823 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6370179730 con 0x7f63700519a0 2024-09-17T05:41:33.103 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:33.100+0000 7f637de1a640 1 --2- 172.21.15.150:0/3955193823 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f63700519a0 0x7f63701756a0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f636802c6e0 tx=0x7f6368003ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:41:33.115 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:33.103+0000 7f636e7fc640 1 -- 172.21.15.150:0/3955193823 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6368041020 con 0x7f63700519a0 2024-09-17T05:41:33.115 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:33.103+0000 7f636e7fc640 1 -- 172.21.15.150:0/3955193823 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f6368034530 con 0x7f63700519a0 2024-09-17T05:41:33.115 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:33.103+0000 7f636e7fc640 1 -- 172.21.15.150:0/3955193823 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6368039040 con 0x7f63700519a0 2024-09-17T05:41:33.115 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:33.114+0000 7f637ee1c640 1 -- 172.21.15.150:0/3955193823 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6370179a10 con 0x7f63700519a0 2024-09-17T05:41:33.116 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:33.114+0000 7f636e7fc640 1 -- 172.21.15.150:0/3955193823 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f6368034d10 con 0x7f63700519a0 2024-09-17T05:41:33.116 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:33.114+0000 7f637ee1c640 1 -- 172.21.15.150:0/3955193823 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6370179fd0 con 0x7f63700519a0 2024-09-17T05:41:33.116 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:33.115+0000 7f636e7fc640 1 -- 172.21.15.150:0/3955193823 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f6368005020 con 0x7f63700519a0 2024-09-17T05:41:33.117 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:33.102+0000 7fd676ffd640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd678074870 0x7fd6781547b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:41:33.117 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:33.102+0000 7fd676ffd640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd678074870 0x7fd6781547b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3300/0 says I am v2:172.21.15.150:35932/0 (socket says 172.21.15.150:35932) 2024-09-17T05:41:33.118 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:33.102+0000 7fd6767fc640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd6780b30d0 0x7fd6781f2df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:41:33.118 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:33.106+0000 7fd6767fc640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd6780b30d0 0x7fd6781f2df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3301/0 says I am v2:172.21.15.150:58958/0 (socket says 172.21.15.150:58958) 2024-09-17T05:41:33.118 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:33.115+0000 7fd67d952640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd6780b34e0 0x7fd6781f3330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:41:33.118 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:33.115+0000 7fd676ffd640 1 -- 172.21.15.150:0/1747430738 learned_addr learned my addr 172.21.15.150:0/1747430738 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:41:33.118 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:33.116+0000 7fd6777fe640 1 --2- 172.21.15.150:0/1747430738 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd6780b34e0 0x7fd6781f3330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:41:33.118 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:33.116+0000 7fd67d952640 1 -- 172.21.15.150:0/1747430738 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7fd67815caf0 con 0x7fd6780b34e0 2024-09-17T05:41:33.118 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:33.116+0000 7fd67d952640 1 -- 172.21.15.150:0/1747430738 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fd67815c970 con 0x7fd678074870 2024-09-17T05:41:33.118 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:33.116+0000 7fd67d952640 1 -- 172.21.15.150:0/1747430738 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fd67815cc70 con 0x7fd6780b30d0 2024-09-17T05:41:33.119 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:33.117+0000 7fd676ffd640 1 -- 172.21.15.150:0/1747430738 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd6780b30d0 msgr2=0x7fd6781f2df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:41:33.119 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:33.117+0000 7fd676ffd640 1 --2- 172.21.15.150:0/1747430738 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd6780b30d0 0x7fd6781f2df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:41:33.119 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:33.117+0000 7fd676ffd640 1 -- 172.21.15.150:0/1747430738 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd6780b34e0 msgr2=0x7fd6781f3330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:41:33.120 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:33.117+0000 7fd676ffd640 1 --2- 172.21.15.150:0/1747430738 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd6780b34e0 0x7fd6781f3330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:41:33.120 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:33.117+0000 7fd676ffd640 1 -- 172.21.15.150:0/1747430738 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd6781f2350 con 0x7fd678074870 2024-09-17T05:41:33.120 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:33.117+0000 7fd6767fc640 1 --2- 172.21.15.150:0/1747430738 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd6780b30d0 0x7fd6781f2df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T05:41:33.120 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:33.117+0000 7fd676ffd640 1 --2- 172.21.15.150:0/1747430738 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd678074870 0x7fd6781547b0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fd66800c4d0 tx=0x7fd66800c990 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:41:33.120 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:33.118+0000 7fd66ffff640 1 -- 172.21.15.150:0/1747430738 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd668016020 con 0x7fd678074870 2024-09-17T05:41:33.120 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:33.118+0000 7fd6777fe640 1 --2- 172.21.15.150:0/1747430738 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd6780b34e0 0x7fd6781f3330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T05:41:33.120 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:33.118+0000 7fd66ffff640 1 -- 172.21.15.150:0/1747430738 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd668012a00 con 0x7fd678074870 2024-09-17T05:41:33.120 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:33.118+0000 7fd67d952640 1 -- 172.21.15.150:0/1747430738 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd67809de50 con 0x7fd678074870 2024-09-17T05:41:33.120 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:33.118+0000 7f637ee1c640 1 -- 172.21.15.150:0/3955193823 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6370007c60 con 0x7f63700519a0 2024-09-17T05:41:33.121 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:33.118+0000 7fd67d952640 1 -- 172.21.15.150:0/1747430738 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd67809e130 con 0x7fd678074870 2024-09-17T05:41:33.121 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:33.118+0000 7fd66ffff640 1 -- 172.21.15.150:0/1747430738 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd668012e50 con 0x7fd678074870 2024-09-17T05:41:33.121 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:33.118+0000 7fd66ffff640 1 -- 172.21.15.150:0/1747430738 <== mon.1 v2:172.21.15.176:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fd668019020 con 0x7fd678074870 2024-09-17T05:41:33.121 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:33.118+0000 7fd66ffff640 1 -- 172.21.15.150:0/1747430738 <== mon.1 v2:172.21.15.176:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7fd66801aa80 con 0x7fd678074870 2024-09-17T05:41:33.126 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:33.122+0000 7f636e7fc640 1 -- 172.21.15.150:0/3955193823 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7f636804b070 con 0x7f63700519a0 2024-09-17T05:41:33.131 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:33.130+0000 7fd67d952640 1 -- 172.21.15.150:0/1747430738 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd67815c430 con 0x7fd678074870 2024-09-17T05:41:33.137 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:33.132+0000 7fd66ffff640 1 -- 172.21.15.150:0/1747430738 <== mon.1 v2:172.21.15.176:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7fd668020020 con 0x7fd678074870 2024-09-17T05:41:33.140 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mds', 'debug_ms', '2'], check_status=True, hostname='smithi150') 2024-09-17T05:41:33.143 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:33.142+0000 7f0ce97fa640 1 -- 172.21.15.150:0/2854847161 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_command([{prefix=config set, name=mds_debug_frag}] v 0) -- 0x7f0cf40cf5e0 con 0x7f0cf415eae0 2024-09-17T05:41:33.159 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:33.155+0000 7f39315e6640 1 -- 172.21.15.150:0/51916141 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f392c0b4490 msgr2=0x7f392c06f890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:41:33.159 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:33.155+0000 7f39315e6640 1 --2- 172.21.15.150:0/51916141 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f392c0b4490 0x7f392c06f890 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f39200096f0 tx=0x7f392002b780 comp rx=0 tx=0).stop 2024-09-17T05:41:33.159 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:33.155+0000 7f39315e6640 1 -- 172.21.15.150:0/51916141 shutdown_connections 2024-09-17T05:41:33.159 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:33.155+0000 7f39315e6640 1 --2- 172.21.15.150:0/51916141 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f392c0b4490 0x7f392c06f890 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:41:33.159 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:33.155+0000 7f39315e6640 1 --2- 172.21.15.150:0/51916141 >> v2:172.21.15.150:3300/0 conn(0x7f392c0705d0 0x7f392c073120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:41:33.160 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:33.155+0000 7f39315e6640 1 -- 172.21.15.150:0/51916141 >> 172.21.15.150:0/51916141 conn(0x7f392c06cda0 msgr2=0x7f392c06d1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:41:33.160 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:33.157+0000 7f0ceb7fe640 1 -- 172.21.15.150:0/2854847161 <== mon.1 v2:172.21.15.176:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_debug_frag}]=0 v9)=0 v9) ==== 115+0+0 (secure 0 0 0) 0x7f0cec038450 con 0x7f0cf415eae0 2024-09-17T05:41:33.163 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:33.161+0000 7fac6b7fe640 1 -- 172.21.15.150:0/3069960819 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac580012c0 con 0x7fac5c0039b0 2024-09-17T05:41:33.163 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:33.161+0000 7fac71961640 1 -- 172.21.15.150:0/3069960819 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fac5c0039b0 msgr2=0x7fac5c003e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:41:33.163 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:33.161+0000 7fac71961640 1 --2- 172.21.15.150:0/3069960819 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fac5c0039b0 0x7fac5c003e20 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fac58001670 tx=0x7fac5c005830 comp rx=0 tx=0).stop 2024-09-17T05:41:33.164 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:33.155+0000 7f39315e6640 1 -- 172.21.15.150:0/51916141 shutdown_connections 2024-09-17T05:41:33.164 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:33.155+0000 7f39315e6640 1 -- 172.21.15.150:0/51916141 wait complete. 2024-09-17T05:41:33.164 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:33.158+0000 7f39315e6640 1 Processor -- start 2024-09-17T05:41:33.164 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:33.159+0000 7f39315e6640 1 -- start start 2024-09-17T05:41:33.164 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:33.161+0000 7f39315e6640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f392c0705d0 0x7f392c1f6e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:41:33.164 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:33.161+0000 7f39315e6640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f392c073660 0x7f392c15c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:41:33.164 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:33.161+0000 7f39315e6640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f392c2055b0 0x7f392c2059c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:41:33.164 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:33.161+0000 7f39315e6640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f392c16b860 con 0x7f392c0705d0 2024-09-17T05:41:33.164 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:33.161+0000 7f39315e6640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f392c06ffe0 con 0x7f392c2055b0 2024-09-17T05:41:33.164 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:33.161+0000 7f39315e6640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f392c16b9e0 con 0x7f392c073660 2024-09-17T05:41:33.164 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:33.161+0000 7f392affd640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f392c0705d0 0x7f392c1f6e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:41:33.165 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:33.161+0000 7f392affd640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f392c0705d0 0x7f392c1f6e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:49862/0 (socket says 172.21.15.150:49862) 2024-09-17T05:41:33.165 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:33.161+0000 7f392affd640 1 -- 172.21.15.150:0/1437528058 learned_addr learned my addr 172.21.15.150:0/1437528058 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:41:33.165 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:33.162+0000 7f392affd640 1 -- 172.21.15.150:0/1437528058 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f392c073660 msgr2=0x7f392c15c920 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-17T05:41:33.165 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:33.162+0000 7f392affd640 1 --2- 172.21.15.150:0/1437528058 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f392c073660 0x7f392c15c920 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:41:33.165 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:33.162+0000 7f392affd640 1 -- 172.21.15.150:0/1437528058 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f392c2055b0 msgr2=0x7f392c2059c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-17T05:41:33.165 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:33.162+0000 7f392affd640 1 --2- 172.21.15.150:0/1437528058 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f392c2055b0 0x7f392c2059c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:41:33.165 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:33.162+0000 7f392affd640 1 -- 172.21.15.150:0/1437528058 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f392c205f00 con 0x7f392c0705d0 2024-09-17T05:41:33.165 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:33.162+0000 7f392affd640 1 --2- 172.21.15.150:0/1437528058 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f392c0705d0 0x7f392c1f6e10 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f391c00d950 tx=0x7f391c00de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:41:33.165 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:33.164+0000 7f39137fe640 1 -- 172.21.15.150:0/1437528058 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f391c017070 con 0x7f392c0705d0 2024-09-17T05:41:33.166 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:33.165+0000 7fac71961640 1 -- 172.21.15.150:0/3069960819 shutdown_connections 2024-09-17T05:41:33.166 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:33.165+0000 7fac71961640 1 --2- 172.21.15.150:0/3069960819 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fac5c0039b0 0x7fac5c003e20 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:41:33.166 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:33.165+0000 7fac71961640 1 -- 172.21.15.150:0/3069960819 >> 172.21.15.150:0/3069960819 conn(0x7fac6401e260 msgr2=0x7fac64039e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:41:33.167 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:33.164+0000 7f39315e6640 1 -- 172.21.15.150:0/1437528058 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f392c16cb20 con 0x7f392c0705d0 2024-09-17T05:41:33.167 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:33.164+0000 7f39315e6640 1 -- 172.21.15.150:0/1437528058 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f392c15eeb0 con 0x7f392c0705d0 2024-09-17T05:41:33.167 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:33.165+0000 7f39137fe640 1 -- 172.21.15.150:0/1437528058 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f391c009bd0 con 0x7f392c0705d0 2024-09-17T05:41:33.167 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:33.165+0000 7f0ce97fa640 1 -- 172.21.15.150:0/2854847161 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0cf415eae0 msgr2=0x7f0cf41f5110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:41:33.167 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:33.166+0000 7f0ce97fa640 1 --2- 172.21.15.150:0/2854847161 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0cf415eae0 0x7f0cf41f5110 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f0cec009d60 tx=0x7f0cec0045c0 comp rx=0 tx=0).stop 2024-09-17T05:41:33.168 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:33.166+0000 7f39137fe640 1 -- 172.21.15.150:0/1437528058 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f391c010460 con 0x7f392c0705d0 2024-09-17T05:41:33.168 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:33.166+0000 7f0ce97fa640 1 -- 172.21.15.150:0/2854847161 shutdown_connections 2024-09-17T05:41:33.168 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:33.166+0000 7f0ce97fa640 1 --2- 172.21.15.150:0/2854847161 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0cf415eae0 0x7f0cf41f5110 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:41:33.168 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:33.166+0000 7f0ce97fa640 1 --2- 172.21.15.150:0/2854847161 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0cf415c130 0x7f0cf4155c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:41:33.168 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:33.166+0000 7f0ce97fa640 1 --2- 172.21.15.150:0/2854847161 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0cf406ddb0 0x7f0cf4140790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:41:33.168 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:33.166+0000 7f0ce97fa640 1 -- 172.21.15.150:0/2854847161 >> 172.21.15.150:0/2854847161 conn(0x7f0cf4073890 msgr2=0x7f0cf40d00c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:41:33.169 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:33.167+0000 7f39315e6640 1 -- 172.21.15.150:0/1437528058 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f390c005290 con 0x7f392c0705d0 2024-09-17T05:41:33.170 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:33.165+0000 7fac71961640 1 -- 172.21.15.150:0/3069960819 shutdown_connections 2024-09-17T05:41:33.170 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:33.169+0000 7fac71961640 1 -- 172.21.15.150:0/3069960819 wait complete. 2024-09-17T05:41:33.175 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:33.174+0000 7f0ce97fa640 1 -- 172.21.15.150:0/2854847161 shutdown_connections 2024-09-17T05:41:33.175 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:33.174+0000 7f0ce97fa640 1 -- 172.21.15.150:0/2854847161 wait complete. 2024-09-17T05:41:33.175 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:33.172+0000 7fac71961640 1 Processor -- start 2024-09-17T05:41:33.175 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:33.172+0000 7fac71961640 1 -- start start 2024-09-17T05:41:33.176 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:33.174+0000 7fac71961640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fac5c0039b0 0x7fac64051cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:41:33.176 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:33.174+0000 7fac71961640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fac6404d240 0x7fac6404fe00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:41:33.176 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:33.174+0000 7fac71961640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fac6404d650 0x7fac64189f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:41:33.176 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:33.174+0000 7fac71961640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7fac640362d0 con 0x7fac6404d240 2024-09-17T05:41:33.176 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:33.174+0000 7fac71961640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fac64031fd0 con 0x7fac6404d650 2024-09-17T05:41:33.176 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:33.174+0000 7fac71961640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fac64036450 con 0x7fac5c0039b0 2024-09-17T05:41:33.176 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:33.175+0000 7fac7095f640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fac5c0039b0 0x7fac64051cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:41:33.177 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:33.175+0000 7fac7095f640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fac5c0039b0 0x7fac64051cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3301/0 says I am v2:172.21.15.150:59026/0 (socket says 172.21.15.150:59026) 2024-09-17T05:41:33.177 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:33.175+0000 7fac7095f640 1 -- 172.21.15.150:0/3172661921 learned_addr learned my addr 172.21.15.150:0/3172661921 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:41:33.179 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:33.177+0000 7fac7095f640 1 -- 172.21.15.150:0/3172661921 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fac6404d650 msgr2=0x7fac64189f80 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-17T05:41:33.179 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:33.177+0000 7fac7095f640 1 --2- 172.21.15.150:0/3172661921 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fac6404d650 0x7fac64189f80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:41:33.179 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:33.177+0000 7fac7095f640 1 -- 172.21.15.150:0/3172661921 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fac6404d240 msgr2=0x7fac6404fe00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:41:33.179 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:33.177+0000 7fac7095f640 1 --2- 172.21.15.150:0/3172661921 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fac6404d240 0x7fac6404fe00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:41:33.179 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:33.177+0000 7fac7095f640 1 -- 172.21.15.150:0/3172661921 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fac64050f00 con 0x7fac5c0039b0 2024-09-17T05:41:33.187 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:33.182+0000 7f39137fe640 1 -- 172.21.15.150:0/1437528058 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f391c01a070 con 0x7f392c0705d0 2024-09-17T05:41:33.187 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:33.182+0000 7f39137fe640 1 -- 172.21.15.150:0/1437528058 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f391c01ca60 con 0x7f392c0705d0 2024-09-17T05:41:33.187 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:33.182+0000 7f39137fe640 1 -- 172.21.15.150:0/1437528058 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7f392c205f00 con 0x7f392c0705d0 2024-09-17T05:41:33.194 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:33.193+0000 7fe409e94640 1 -- 172.21.15.150:0/2235248327 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe4040991b0 msgr2=0x7fe4040995c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:41:33.195 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:33.191+0000 7fac7095f640 1 --2- 172.21.15.150:0/3172661921 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fac5c0039b0 0x7fac64051cc0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fac58001790 tx=0x7fac58006320 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:41:33.195 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:33.192+0000 7fac697fa640 1 -- 172.21.15.150:0/3172661921 <== mon.2 v2:172.21.15.176:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac58041070 con 0x7fac5c0039b0 2024-09-17T05:41:33.195 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:33.193+0000 7fe409e94640 1 --2- 172.21.15.150:0/2235248327 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe4040991b0 0x7fe4040995c0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fe3fc005fd0 tx=0x7fe3fc02cc20 comp rx=0 tx=0).stop 2024-09-17T05:41:33.196 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:33.192+0000 7fac697fa640 1 -- 172.21.15.150:0/3172661921 <== mon.2 v2:172.21.15.176:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fac58003800 con 0x7fac5c0039b0 2024-09-17T05:41:33.196 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:33.192+0000 7fac697fa640 1 -- 172.21.15.150:0/3172661921 <== mon.2 v2:172.21.15.176:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac58003c30 con 0x7fac5c0039b0 2024-09-17T05:41:33.196 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:33.192+0000 7fac71961640 1 -- 172.21.15.150:0/3172661921 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fac640511e0 con 0x7fac5c0039b0 2024-09-17T05:41:33.196 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:33.192+0000 7fac71961640 1 -- 172.21.15.150:0/3172661921 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fac640517a0 con 0x7fac5c0039b0 2024-09-17T05:41:33.196 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:33.193+0000 7fac697fa640 1 -- 172.21.15.150:0/3172661921 <== mon.2 v2:172.21.15.176:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fac58030050 con 0x7fac5c0039b0 2024-09-17T05:41:33.196 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:33.193+0000 7fac697fa640 1 -- 172.21.15.150:0/3172661921 <== mon.2 v2:172.21.15.176:3301/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7fac58033760 con 0x7fac5c0039b0 2024-09-17T05:41:33.197 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:33.194+0000 7fe409e94640 1 -- 172.21.15.150:0/2235248327 shutdown_connections 2024-09-17T05:41:33.197 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:33.194+0000 7fe409e94640 1 --2- 172.21.15.150:0/2235248327 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe4040991b0 0x7fe4040995c0 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:41:33.197 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:33.194+0000 7fe409e94640 1 --2- 172.21.15.150:0/2235248327 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe4040b28f0 0x7fe4040b3ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:41:33.197 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:33.194+0000 7fe409e94640 1 -- 172.21.15.150:0/2235248327 >> 172.21.15.150:0/2235248327 conn(0x7fe4040b1dd0 msgr2=0x7fe4040b21e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:41:33.197 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:33.195+0000 7fac71961640 1 -- 172.21.15.150:0/3172661921 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fac64032150 con 0x7fac5c0039b0 2024-09-17T05:41:33.199 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:33.195+0000 7fe409e94640 1 -- 172.21.15.150:0/2235248327 shutdown_connections 2024-09-17T05:41:33.199 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:33.195+0000 7fe409e94640 1 -- 172.21.15.150:0/2235248327 wait complete. 2024-09-17T05:41:33.199 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:33.197+0000 7fe409e94640 1 Processor -- start 2024-09-17T05:41:33.204 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:33.202+0000 7f25219eb640 1 -- 172.21.15.150:0/2228373683 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f250c004ba0 msgr2=0x7f250c004fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:41:33.204 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:33.202+0000 7f25219eb640 1 --2- 172.21.15.150:0/2228373683 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f250c004ba0 0x7f250c004fd0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f2510009880 tx=0x7f250c005830 comp rx=0 tx=0).stop 2024-09-17T05:41:33.207 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:33.206+0000 7f25219eb640 1 -- 172.21.15.150:0/2228373683 shutdown_connections 2024-09-17T05:41:33.207 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:33.206+0000 7f25219eb640 1 --2- 172.21.15.150:0/2228373683 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f250c004ba0 0x7f250c004fd0 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:41:33.207 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:33.206+0000 7f25219eb640 1 -- 172.21.15.150:0/2228373683 >> 172.21.15.150:0/2228373683 conn(0x7f251401eae0 msgr2=0x7f251403a710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:41:33.209 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:33.207+0000 7f25219eb640 1 -- 172.21.15.150:0/2228373683 shutdown_connections 2024-09-17T05:41:33.210 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:33.207+0000 7f25219eb640 1 -- 172.21.15.150:0/2228373683 wait complete. 2024-09-17T05:41:33.215 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:33.208+0000 7fac697fa640 1 -- 172.21.15.150:0/3172661921 <== mon.2 v2:172.21.15.176:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7fac5804b070 con 0x7fac5c0039b0 2024-09-17T05:41:33.215 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:33.211+0000 7f25219eb640 1 Processor -- start 2024-09-17T05:41:33.215 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:33.211+0000 7f25219eb640 1 -- start start 2024-09-17T05:41:33.216 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:33.198+0000 7fe409e94640 1 -- start start 2024-09-17T05:41:33.216 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:33.200+0000 7fe409e94640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe404099b00 0x7fe404093240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:41:33.216 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:33.200+0000 7fe409e94640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe4040b28f0 0x7fe404094d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:41:33.216 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:33.200+0000 7fe402ffd640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe4040b28f0 0x7fe404094d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:41:33.216 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:33.200+0000 7fe402ffd640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe4040b28f0 0x7fe404094d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:49882/0 (socket says 172.21.15.150:49882) 2024-09-17T05:41:33.216 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:33.200+0000 7fe402ffd640 1 -- 172.21.15.150:0/1671366530 learned_addr learned my addr 172.21.15.150:0/1671366530 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:41:33.216 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:33.200+0000 7fe409e94640 1 --2- 172.21.15.150:0/1671366530 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe4040952d0 0x7fe404215ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:41:33.216 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:33.201+0000 7fe409e94640 1 -- 172.21.15.150:0/1671366530 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7fe40416fb60 con 0x7fe4040b28f0 2024-09-17T05:41:33.216 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:33.201+0000 7fe409e94640 1 -- 172.21.15.150:0/1671366530 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fe40416f9e0 con 0x7fe4040952d0 2024-09-17T05:41:33.216 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:33.201+0000 7fe409e94640 1 -- 172.21.15.150:0/1671366530 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fe40416fce0 con 0x7fe404099b00 2024-09-17T05:41:33.217 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:33.203+0000 7fe4037fe640 1 --2- 172.21.15.150:0/1671366530 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe404099b00 0x7fe404093240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:41:33.217 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:33.203+0000 7fe403fff640 1 --2- 172.21.15.150:0/1671366530 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe4040952d0 0x7fe404215ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:41:33.217 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:33.206+0000 7fe402ffd640 1 -- 172.21.15.150:0/1671366530 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe404099b00 msgr2=0x7fe404093240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:41:33.217 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:33.206+0000 7fe402ffd640 1 --2- 172.21.15.150:0/1671366530 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe404099b00 0x7fe404093240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:41:33.217 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:33.206+0000 7fe402ffd640 1 -- 172.21.15.150:0/1671366530 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe4040952d0 msgr2=0x7fe404215ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:41:33.217 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:33.206+0000 7fe402ffd640 1 --2- 172.21.15.150:0/1671366530 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe4040952d0 0x7fe404215ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:41:33.217 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:33.206+0000 7fe402ffd640 1 -- 172.21.15.150:0/1671366530 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe404213360 con 0x7fe4040b28f0 2024-09-17T05:41:33.217 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:33.206+0000 7fe402ffd640 1 --2- 172.21.15.150:0/1671366530 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe4040b28f0 0x7fe404094d90 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fe3fc000f80 tx=0x7fe3fc003ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:41:33.217 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:33.213+0000 7fe3ebfff640 1 -- 172.21.15.150:0/1671366530 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe3fc03a040 con 0x7fe4040b28f0 2024-09-17T05:41:33.218 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:33.213+0000 7fe409e94640 1 -- 172.21.15.150:0/1671366530 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe4042135d0 con 0x7fe4040b28f0 2024-09-17T05:41:33.218 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:33.213+0000 7fe409e94640 1 -- 172.21.15.150:0/1671366530 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe404213b90 con 0x7fe4040b28f0 2024-09-17T05:41:33.218 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:33.215+0000 7fe3ebfff640 1 -- 172.21.15.150:0/1671366530 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe3fc043070 con 0x7fe4040b28f0 2024-09-17T05:41:33.218 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:33.215+0000 7fe3ebfff640 1 -- 172.21.15.150:0/1671366530 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe3fc035a30 con 0x7fe4040b28f0 2024-09-17T05:41:33.218 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:33.217+0000 7fe3ebfff640 1 -- 172.21.15.150:0/1671366530 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fe3fc035c10 con 0x7fe4040b28f0 2024-09-17T05:41:33.218 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:33.217+0000 7fe3ebfff640 1 -- 172.21.15.150:0/1671366530 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7fe3fc0047b0 con 0x7fe4040b28f0 2024-09-17T05:41:33.219 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:33.217+0000 7fe3e9ffb640 1 -- 172.21.15.150:0/1671366530 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe3e4005290 con 0x7fe4040b28f0 2024-09-17T05:41:33.223 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:33.221+0000 7fbb8734b640 1 -- 172.21.15.150:0/2001885312 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fbb800d00b0 msgr2=0x7fbb801763b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:41:33.223 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:33.221+0000 7fbb8734b640 1 --2- 172.21.15.150:0/2001885312 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fbb800d00b0 0x7fbb801763b0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fbb70007380 tx=0x7fbb7002b1c0 comp rx=0 tx=0).stop 2024-09-17T05:41:33.223 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:33.221+0000 7fbb8734b640 1 -- 172.21.15.150:0/2001885312 shutdown_connections 2024-09-17T05:41:33.223 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:33.221+0000 7fbb8734b640 1 --2- 172.21.15.150:0/2001885312 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fbb800d00b0 0x7fbb801763b0 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:41:33.223 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:33.221+0000 7fbb8734b640 1 -- 172.21.15.150:0/2001885312 >> 172.21.15.150:0/2001885312 conn(0x7fbb800742a0 msgr2=0x7fbb800746b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:41:33.223 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:33.221+0000 7fe3ebfff640 1 -- 172.21.15.150:0/1671366530 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7fe3fc009870 con 0x7fe4040b28f0 2024-09-17T05:41:33.226 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:33.222+0000 7fbb8734b640 1 -- 172.21.15.150:0/2001885312 shutdown_connections 2024-09-17T05:41:33.226 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:33.222+0000 7fbb8734b640 1 -- 172.21.15.150:0/2001885312 wait complete. 2024-09-17T05:41:33.226 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:33.225+0000 7fbb8734b640 1 Processor -- start 2024-09-17T05:41:33.229 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:33.225+0000 7f6f3cff9640 1 -- 172.21.15.150:0/513308264 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_command([{prefix=config set, name=debug_ms}] v 0) -- 0x7f6f34005580 con 0x7f6f48036770 2024-09-17T05:41:33.229 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:33.225+0000 7fbb8734b640 1 -- start start 2024-09-17T05:41:33.229 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:33.227+0000 7fbb8734b640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbb80098c90 0x7fbb80095820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:41:33.229 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:33.227+0000 7fbb8734b640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fbb800ccb50 0x7fbb8009c030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:41:33.229 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:33.227+0000 7fbb8734b640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fbb8009c570 0x7fbb80216400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:41:33.229 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:33.227+0000 7fbb8734b640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7fbb80178d10 con 0x7fbb80098c90 2024-09-17T05:41:33.229 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:33.227+0000 7fbb8734b640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fbb80099bf0 con 0x7fbb8009c570 2024-09-17T05:41:33.229 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:33.227+0000 7fbb8734b640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fbb80178e90 con 0x7fbb800ccb50 2024-09-17T05:41:33.230 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:33.229+0000 7f25219eb640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f250c004ba0 0x7f25140da170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:41:33.230 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:33.229+0000 7f25219eb640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f25140d7cb0 0x7f2514172c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:41:33.231 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:33.227+0000 7fbb86b4a640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fbb8009c570 0x7fbb80216400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:41:33.231 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:33.228+0000 7fbb86b4a640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fbb8009c570 0x7fbb80216400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3300/0 says I am v2:172.21.15.150:35998/0 (socket says 172.21.15.150:35998) 2024-09-17T05:41:33.231 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:33.228+0000 7fbb86b4a640 1 -- 172.21.15.150:0/3516789411 learned_addr learned my addr 172.21.15.150:0/3516789411 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:41:33.231 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:33.228+0000 7fbb85b48640 1 --2- 172.21.15.150:0/3516789411 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fbb800ccb50 0x7fbb8009c030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:41:33.231 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:33.228+0000 7fbb86b4a640 1 -- 172.21.15.150:0/3516789411 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fbb800ccb50 msgr2=0x7fbb8009c030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:41:33.231 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:33.228+0000 7fbb86b4a640 1 --2- 172.21.15.150:0/3516789411 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fbb800ccb50 0x7fbb8009c030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:41:33.231 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:33.228+0000 7fbb86b4a640 1 -- 172.21.15.150:0/3516789411 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbb80098c90 msgr2=0x7fbb80095820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:41:33.231 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:33.228+0000 7fbb86b4a640 1 --2- 172.21.15.150:0/3516789411 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbb80098c90 0x7fbb80095820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:41:33.231 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:33.228+0000 7fbb86b4a640 1 -- 172.21.15.150:0/3516789411 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbb8009cd60 con 0x7fbb8009c570 2024-09-17T05:41:33.232 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:33.230+0000 7f2c98d69640 1 -- 172.21.15.150:0/3977707939 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2c940d0c20 msgr2=0x7f2c940b6c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:41:33.232 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:33.229+0000 7f25219eb640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2514178cf0 0x7f2514179100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:41:33.232 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:33.229+0000 7f25219eb640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f25140e0040 con 0x7f250c004ba0 2024-09-17T05:41:33.232 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:33.229+0000 7f25219eb640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f25140dfec0 con 0x7f25140d7cb0 2024-09-17T05:41:33.232 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:33.229+0000 7f25219eb640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f25140e01c0 con 0x7f2514178cf0 2024-09-17T05:41:33.232 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:33.229+0000 7f251bfff640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f25140d7cb0 0x7f2514172c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:41:33.233 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:33.229+0000 7f251bfff640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f25140d7cb0 0x7f2514172c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3300/0 says I am v2:172.21.15.150:36000/0 (socket says 172.21.15.150:36000) 2024-09-17T05:41:33.233 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:33.229+0000 7f251bfff640 1 -- 172.21.15.150:0/2963673486 learned_addr learned my addr 172.21.15.150:0/2963673486 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:41:33.233 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:33.229+0000 7f25211ea640 1 --2- 172.21.15.150:0/2963673486 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2514178cf0 0x7f2514179100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:41:33.233 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:33.231+0000 7f251bfff640 1 -- 172.21.15.150:0/2963673486 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2514178cf0 msgr2=0x7f2514179100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:41:33.233 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:33.231+0000 7f251bfff640 1 --2- 172.21.15.150:0/2963673486 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2514178cf0 0x7f2514179100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:41:33.233 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:33.231+0000 7f251bfff640 1 -- 172.21.15.150:0/2963673486 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f250c004ba0 msgr2=0x7f25140da170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:41:33.233 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:33.229+0000 7f25209e9640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f250c004ba0 0x7f25140da170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:41:33.233 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:33.231+0000 7f251bfff640 1 --2- 172.21.15.150:0/2963673486 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f250c004ba0 0x7f25140da170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:41:33.233 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:33.231+0000 7f251bfff640 1 -- 172.21.15.150:0/2963673486 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2514179640 con 0x7f25140d7cb0 2024-09-17T05:41:33.233 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:33.231+0000 7f25209e9640 1 --2- 172.21.15.150:0/2963673486 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f250c004ba0 0x7f25140da170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T05:41:33.234 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:33.231+0000 7f2c98d69640 1 --2- 172.21.15.150:0/3977707939 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2c940d0c20 0x7f2c940b6c20 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f2c88009830 tx=0x7f2c8802a560 comp rx=0 tx=0).stop 2024-09-17T05:41:33.234 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:33.231+0000 7f251bfff640 1 --2- 172.21.15.150:0/2963673486 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f25140d7cb0 0x7f2514172c20 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f250800c760 tx=0x7f250800cb60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:41:33.234 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:33.231+0000 7f6f3effd640 1 -- 172.21.15.150:0/513308264 <== mon.2 v2:172.21.15.176:3301/0 7 ==== mon_command_ack([{prefix=config set, name=debug_ms}]=0 v10)=0 v10) ==== 106+0+0 (secure 0 0 0) 0x7f6f500ad400 con 0x7f6f48036770 2024-09-17T05:41:33.235 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:33.231+0000 7f25197fa640 1 -- 172.21.15.150:0/2963673486 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2508017070 con 0x7f25140d7cb0 2024-09-17T05:41:33.235 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:33.231+0000 7f25197fa640 1 -- 172.21.15.150:0/2963673486 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f2508005270 con 0x7f25140d7cb0 2024-09-17T05:41:33.235 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:33.231+0000 7f25219eb640 1 -- 172.21.15.150:0/2963673486 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f25140d80c0 con 0x7f25140d7cb0 2024-09-17T05:41:33.235 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:33.232+0000 7f25219eb640 1 -- 172.21.15.150:0/2963673486 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f25140daaa0 con 0x7f25140d7cb0 2024-09-17T05:41:33.235 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:33.233+0000 7f25197fa640 1 -- 172.21.15.150:0/2963673486 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f250800a8a0 con 0x7f25140d7cb0 2024-09-17T05:41:33.235 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:33.233+0000 7f25197fa640 1 -- 172.21.15.150:0/2963673486 <== mon.1 v2:172.21.15.176:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f250801a070 con 0x7f25140d7cb0 2024-09-17T05:41:33.235 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:33.233+0000 7f25197fa640 1 -- 172.21.15.150:0/2963673486 <== mon.1 v2:172.21.15.176:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f250801c780 con 0x7f25140d7cb0 2024-09-17T05:41:33.235 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:33.233+0000 7fbb86b4a640 1 --2- 172.21.15.150:0/3516789411 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fbb8009c570 0x7fbb80216400 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fbb700074a0 tx=0x7fbb700045e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:41:33.236 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:33.232+0000 7f2c98d69640 1 -- 172.21.15.150:0/3977707939 shutdown_connections 2024-09-17T05:41:33.236 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:33.232+0000 7f2c98d69640 1 --2- 172.21.15.150:0/3977707939 >> v2:172.21.15.176:3300/0 conn(0x7f2c9406d7b0 0x7f2c940b1030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:41:33.236 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:33.232+0000 7f2c98d69640 1 --2- 172.21.15.150:0/3977707939 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2c940d0c20 0x7f2c940b6c20 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:41:33.236 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:33.232+0000 7f2c98d69640 1 -- 172.21.15.150:0/3977707939 >> 172.21.15.150:0/3977707939 conn(0x7f2c940b2ff0 msgr2=0x7f2c940b3400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:41:33.236 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:33.232+0000 7f2c98d69640 1 -- 172.21.15.150:0/3977707939 shutdown_connections 2024-09-17T05:41:33.236 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:33.232+0000 7f2c98d69640 1 -- 172.21.15.150:0/3977707939 wait complete. 2024-09-17T05:41:33.236 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:33.233+0000 7f2506ffd640 1 -- 172.21.15.150:0/2963673486 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2514055a50 con 0x7f25140d7cb0 2024-09-17T05:41:33.237 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:33.235+0000 7f6f3cff9640 1 -- 172.21.15.150:0/513308264 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6f48036770 msgr2=0x7f6f48032ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:41:33.237 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:33.235+0000 7f6f3cff9640 1 --2- 172.21.15.150:0/513308264 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6f48036770 0x7f6f48032ce0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f6f5006c380 tx=0x7f6f500a6bc0 comp rx=0 tx=0).stop 2024-09-17T05:41:33.237 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:33.235+0000 7f6f3cff9640 1 -- 172.21.15.150:0/513308264 shutdown_connections 2024-09-17T05:41:33.237 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:33.235+0000 7f6f3cff9640 1 --2- 172.21.15.150:0/513308264 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6f48055280 0x7f6f4804c950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:41:33.237 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:33.235+0000 7f6f3cff9640 1 --2- 172.21.15.150:0/513308264 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6f48036cc0 0x7f6f480082b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:41:33.237 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:33.235+0000 7f6f3cff9640 1 --2- 172.21.15.150:0/513308264 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6f48036770 0x7f6f48032ce0 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:41:33.237 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:33.235+0000 7f6f3cff9640 1 -- 172.21.15.150:0/513308264 >> 172.21.15.150:0/513308264 conn(0x7f6f4801eae0 msgr2=0x7f6f480e2c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:41:33.238 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:33.235+0000 7fbb76ffd640 1 -- 172.21.15.150:0/3516789411 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb7000a6e0 con 0x7fbb8009c570 2024-09-17T05:41:33.238 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:33.235+0000 7fbb76ffd640 1 -- 172.21.15.150:0/3516789411 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fbb7000a970 con 0x7fbb8009c570 2024-09-17T05:41:33.238 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:33.235+0000 7fbb76ffd640 1 -- 172.21.15.150:0/3516789411 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb70005280 con 0x7fbb8009c570 2024-09-17T05:41:33.238 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:33.236+0000 7f6f3cff9640 1 -- 172.21.15.150:0/513308264 shutdown_connections 2024-09-17T05:41:33.239 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:33.236+0000 7f25197fa640 1 -- 172.21.15.150:0/2963673486 <== mon.1 v2:172.21.15.176:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7f2514179640 con 0x7f25140d7cb0 2024-09-17T05:41:33.239 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:33.236+0000 7fbb8734b640 1 -- 172.21.15.150:0/3516789411 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbb8009d040 con 0x7fbb8009c570 2024-09-17T05:41:33.239 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:33.236+0000 7fbb8734b640 1 -- 172.21.15.150:0/3516789411 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbb8009d600 con 0x7fbb8009c570 2024-09-17T05:41:33.239 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:33.236+0000 7f2c98d69640 1 Processor -- start 2024-09-17T05:41:33.240 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:33.236+0000 7f6f3cff9640 1 -- 172.21.15.150:0/513308264 wait complete. 2024-09-17T05:41:33.240 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:33.237+0000 7fbb74ff9640 1 -- 172.21.15.150:0/3516789411 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbb5c005290 con 0x7fbb8009c570 2024-09-17T05:41:33.240 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:33.237+0000 7fbb76ffd640 1 -- 172.21.15.150:0/3516789411 <== mon.1 v2:172.21.15.176:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fbb70044020 con 0x7fbb8009c570 2024-09-17T05:41:33.240 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:33.237+0000 7fbb76ffd640 1 -- 172.21.15.150:0/3516789411 <== mon.1 v2:172.21.15.176:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7fbb70004d90 con 0x7fbb8009c570 2024-09-17T05:41:33.240 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:33.235+0000 7f3b7dffb640 1 -- 172.21.15.150:0/2414608729 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_command([{prefix=config set, name=mds_debug_scatterstat}] v 0) -- 0x7f3b78005580 con 0x7f3b9816b3e0 2024-09-17T05:41:33.241 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:33.236+0000 7f2c98d69640 1 -- start start 2024-09-17T05:41:33.241 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:33.238+0000 7f2c98d69640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2c9406d7b0 0x7f2c941fa0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:41:33.241 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:33.238+0000 7f2c98d69640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2c940cd7d0 0x7f2c940bb360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:41:33.241 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:33.238+0000 7f2c98d69640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2c940d0c20 0x7f2c941fd6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:41:33.241 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:33.238+0000 7f2c98d69640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f2c940b1900 con 0x7f2c9406d7b0 2024-09-17T05:41:33.241 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:33.238+0000 7f2c98d69640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f2c940b1780 con 0x7f2c940d0c20 2024-09-17T05:41:33.241 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:33.238+0000 7f2c98d69640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f2c940b1a80 con 0x7f2c940cd7d0 2024-09-17T05:41:33.249 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:33.239+0000 7f2c9259c640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2c9406d7b0 0x7f2c941fa0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:41:33.249 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:33.239+0000 7f2c9259c640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2c9406d7b0 0x7f2c941fa0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:49900/0 (socket says 172.21.15.150:49900) 2024-09-17T05:41:33.249 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:33.239+0000 7f2c9259c640 1 -- 172.21.15.150:0/3771306457 learned_addr learned my addr 172.21.15.150:0/3771306457 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:41:33.249 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:33.240+0000 7f2c9259c640 1 -- 172.21.15.150:0/3771306457 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2c940cd7d0 msgr2=0x7f2c940bb360 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-17T05:41:33.249 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:33.240+0000 7f2c9259c640 1 --2- 172.21.15.150:0/3771306457 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2c940cd7d0 0x7f2c940bb360 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:41:33.249 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:33.240+0000 7f2c9259c640 1 -- 172.21.15.150:0/3771306457 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2c940d0c20 msgr2=0x7f2c941fd6b0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-17T05:41:33.249 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:33.240+0000 7f2c9259c640 1 --2- 172.21.15.150:0/3771306457 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2c940d0c20 0x7f2c941fd6b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:41:33.250 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:33.240+0000 7f2c9259c640 1 -- 172.21.15.150:0/3771306457 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2c941faa60 con 0x7f2c9406d7b0 2024-09-17T05:41:33.250 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:33.241+0000 7f2c9259c640 1 --2- 172.21.15.150:0/3771306457 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2c9406d7b0 0x7f2c941fa0c0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f2c8400c760 tx=0x7f2c8400cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:41:33.250 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:33.248+0000 7f2c82ffd640 1 -- 172.21.15.150:0/3771306457 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c84016020 con 0x7f2c9406d7b0 2024-09-17T05:41:33.251 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:33.248+0000 7f2c98d69640 1 -- 172.21.15.150:0/3771306457 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2c941fad40 con 0x7f2c9406d7b0 2024-09-17T05:41:33.251 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:33.250+0000 7f93e7113640 1 -- 172.21.15.150:0/1726197688 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f93e00b3b90 msgr2=0x7f93e006fe30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:41:33.252 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:33.250+0000 7f93e7113640 1 --2- 172.21.15.150:0/1726197688 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f93e00b3b90 0x7f93e006fe30 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f93d0009830 tx=0x7f93d002a530 comp rx=0 tx=0).stop 2024-09-17T05:41:33.252 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:33.251+0000 7fbb76ffd640 1 -- 172.21.15.150:0/3516789411 <== mon.1 v2:172.21.15.176:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7fbb7000a0d0 con 0x7fbb8009c570 2024-09-17T05:41:33.254 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:33.252+0000 7f93e7113640 1 -- 172.21.15.150:0/1726197688 shutdown_connections 2024-09-17T05:41:33.254 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:33.252+0000 7f93e7113640 1 --2- 172.21.15.150:0/1726197688 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f93e00b3b90 0x7f93e006fe30 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:41:33.254 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:33.252+0000 7f93e7113640 1 -- 172.21.15.150:0/1726197688 >> 172.21.15.150:0/1726197688 conn(0x7f93e006cda0 msgr2=0x7f93e006d1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:41:33.255 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:33.248+0000 7f3b7ffff640 1 -- 172.21.15.150:0/2414608729 <== mon.2 v2:172.21.15.176:3301/0 7 ==== mon_command_ack([{prefix=config set, name=mds_debug_scatterstat}]=0 v11)=0 v11) ==== 122+0+0 (secure 0 0 0) 0x7f3b90005360 con 0x7f3b9816b3e0 2024-09-17T05:41:33.255 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:33.253+0000 7f3b7dffb640 1 -- 172.21.15.150:0/2414608729 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3b9816b3e0 msgr2=0x7f3b98093420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:41:33.255 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:33.253+0000 7f3b7dffb640 1 --2- 172.21.15.150:0/2414608729 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3b9816b3e0 0x7f3b98093420 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f3b9000c9f0 tx=0x7f3b9000ceb0 comp rx=0 tx=0).stop 2024-09-17T05:41:33.255 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:33.253+0000 7f3b7dffb640 1 -- 172.21.15.150:0/2414608729 shutdown_connections 2024-09-17T05:41:33.255 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:33.253+0000 7f3b7dffb640 1 --2- 172.21.15.150:0/2414608729 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3b98202790 0x7f3b98202ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:41:33.256 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:33.253+0000 7f3b7dffb640 1 --2- 172.21.15.150:0/2414608729 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3b9816b3e0 0x7f3b98093420 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:41:33.256 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:33.253+0000 7f3b7dffb640 1 --2- 172.21.15.150:0/2414608729 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3b980991b0 0x7f3b98205560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:41:33.256 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:33.253+0000 7f3b7dffb640 1 -- 172.21.15.150:0/2414608729 >> 172.21.15.150:0/2414608729 conn(0x7f3b980b1dd0 msgr2=0x7f3b9816cb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:41:33.256 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:33.253+0000 7f3b7dffb640 1 -- 172.21.15.150:0/2414608729 shutdown_connections 2024-09-17T05:41:33.256 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:33.253+0000 7f3b7dffb640 1 -- 172.21.15.150:0/2414608729 wait complete. 2024-09-17T05:41:33.260 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:33.257+0000 7f93e7113640 1 -- 172.21.15.150:0/1726197688 shutdown_connections 2024-09-17T05:41:33.260 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:33.248+0000 7f2c98d69640 1 -- 172.21.15.150:0/3771306457 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2c941603c0 con 0x7f2c9406d7b0 2024-09-17T05:41:33.260 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:33.250+0000 7f2c98d69640 1 -- 172.21.15.150:0/3771306457 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2c940b1030 con 0x7f2c9406d7b0 2024-09-17T05:41:33.261 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:33.257+0000 7f2c82ffd640 1 -- 172.21.15.150:0/3771306457 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f2c8400a930 con 0x7f2c9406d7b0 2024-09-17T05:41:33.261 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:33.257+0000 7f2c82ffd640 1 -- 172.21.15.150:0/3771306457 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c8400ad80 con 0x7f2c9406d7b0 2024-09-17T05:41:33.261 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:33.257+0000 7f2c82ffd640 1 -- 172.21.15.150:0/3771306457 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f2c84019020 con 0x7f2c9406d7b0 2024-09-17T05:41:33.261 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:33.257+0000 7f2c82ffd640 1 -- 172.21.15.150:0/3771306457 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f2c84012770 con 0x7f2c9406d7b0 2024-09-17T05:41:33.261 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:33.257+0000 7f2c82ffd640 1 -- 172.21.15.150:0/3771306457 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7f2c84020030 con 0x7f2c9406d7b0 2024-09-17T05:41:33.264 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:33.262+0000 7f8aa82fa640 1 -- 172.21.15.150:0/3641699966 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8a8c0099b0 msgr2=0x7f8a8c00bdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:41:33.264 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:33.262+0000 7f8aa82fa640 1 --2- 172.21.15.150:0/3641699966 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8a8c0099b0 0x7f8a8c00bdd0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f8a98002050 tx=0x7f8a8c005830 comp rx=0 tx=0).stop 2024-09-17T05:41:33.264 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:33.263+0000 7f8aa82fa640 1 -- 172.21.15.150:0/3641699966 shutdown_connections 2024-09-17T05:41:33.264 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:33.263+0000 7f8aa82fa640 1 --2- 172.21.15.150:0/3641699966 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8a8c0099b0 0x7f8a8c00bdd0 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:41:33.265 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:33.263+0000 7f8aa82fa640 1 -- 172.21.15.150:0/3641699966 >> 172.21.15.150:0/3641699966 conn(0x7f8aa006cda0 msgr2=0x7f8aa006d1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:41:33.266 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mds', 'mds_debug_frag', 'True'], check_status=True, hostname='smithi150') 2024-09-17T05:41:33.266 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mds', 'mds_debug_scatterstat', 'True'], check_status=True, hostname='smithi150') 2024-09-17T05:41:33.268 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:33.263+0000 7f93e7113640 1 -- 172.21.15.150:0/1726197688 wait complete. 2024-09-17T05:41:33.268 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:33.266+0000 7f8aa82fa640 1 -- 172.21.15.150:0/3641699966 shutdown_connections 2024-09-17T05:41:33.269 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:33.268+0000 7f7acd1b4640 1 -- 172.21.15.150:0/2625213195 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7ac0052360 msgr2=0x7f7ac00e6ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:41:33.269 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:33.268+0000 7f7acd1b4640 1 --2- 172.21.15.150:0/2625213195 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7ac0052360 0x7f7ac00e6ac0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f7ac0034920 tx=0x7f7ab402a5d0 comp rx=0 tx=0).stop 2024-09-17T05:41:33.270 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:33.268+0000 7f8aa82fa640 1 -- 172.21.15.150:0/3641699966 wait complete. 2024-09-17T05:41:33.273 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:33.266+0000 7f93e7113640 1 Processor -- start 2024-09-17T05:41:33.274 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:33.273+0000 7f8aa82fa640 1 Processor -- start 2024-09-17T05:41:33.278 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:33.270+0000 7f93e7113640 1 -- start start 2024-09-17T05:41:33.279 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:33.278+0000 7f93e7113640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f93e006fa20 0x7f93e015ec20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:41:33.279 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:33.278+0000 7f93e7113640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f93e00af980 0x7f93e015e2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:41:33.279 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:33.278+0000 7f3fc5961640 1 -- 172.21.15.150:0/3507744835 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3fc0074dc0 msgr2=0x7f3fc00996c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:41:33.280 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:33.278+0000 7f8aa82fa640 1 -- start start 2024-09-17T05:41:33.280 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:33.278+0000 7f93e7113640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f93e00b3b90 0x7f93e00ab470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:41:33.280 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:33.278+0000 7f3fc5961640 1 --2- 172.21.15.150:0/3507744835 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3fc0074dc0 0x7f3fc00996c0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f3fc0072680 tx=0x7f3fb002a600 comp rx=0 tx=0).stop 2024-09-17T05:41:33.281 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:33.278+0000 7f3fc5961640 1 -- 172.21.15.150:0/3507744835 shutdown_connections 2024-09-17T05:41:33.281 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:33.278+0000 7f3fc5961640 1 --2- 172.21.15.150:0/3507744835 >> v2:172.21.15.150:3300/0 conn(0x7f3fc00ccb50 0x7f3fc00ccf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:41:33.281 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:33.278+0000 7f3fc5961640 1 --2- 172.21.15.150:0/3507744835 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3fc0074dc0 0x7f3fc00996c0 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:41:33.281 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:33.278+0000 7f3fc5961640 1 -- 172.21.15.150:0/3507744835 >> 172.21.15.150:0/3507744835 conn(0x7f3fc00742a0 msgr2=0x7f3fc00746b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:41:33.282 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:33.278+0000 7f93e7113640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f93e0143620 con 0x7f93e00af980 2024-09-17T05:41:33.282 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:33.278+0000 7f93e7113640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f93e0070950 con 0x7f93e00b3b90 2024-09-17T05:41:33.282 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:33.278+0000 7f93e7113640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f93e01437a0 con 0x7f93e006fa20 2024-09-17T05:41:33.282 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:33.279+0000 7f93e56b0640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f93e00b3b90 0x7f93e00ab470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:41:33.282 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:33.279+0000 7f93e56b0640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f93e00b3b90 0x7f93e00ab470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3300/0 says I am v2:172.21.15.150:36040/0 (socket says 172.21.15.150:36040) 2024-09-17T05:41:33.282 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:33.279+0000 7f93e56b0640 1 -- 172.21.15.150:0/3559471805 learned_addr learned my addr 172.21.15.150:0/3559471805 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:41:33.282 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:33.279+0000 7f93e56b0640 1 -- 172.21.15.150:0/3559471805 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f93e006fa20 msgr2=0x7f93e015ec20 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-17T05:41:33.282 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:33.279+0000 7f93e56b0640 1 --2- 172.21.15.150:0/3559471805 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f93e006fa20 0x7f93e015ec20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:41:33.282 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:33.279+0000 7f93e56b0640 1 -- 172.21.15.150:0/3559471805 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f93e00af980 msgr2=0x7f93e015e2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:41:33.284 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:33.280+0000 7f8aa82fa640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8a8c0099b0 0x7f8aa015d670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:41:33.284 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:33.280+0000 7f8aa82fa640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8aa015dd00 0x7f8aa01fa0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:41:33.284 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:33.280+0000 7f8aa82fa640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8aa015e250 0x7f8aa01fa5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:41:33.284 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:33.280+0000 7f8aa6096640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8a8c0099b0 0x7f8aa015d670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:41:33.284 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:33.281+0000 7f8aa6096640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8a8c0099b0 0x7f8aa015d670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3301/0 says I am v2:172.21.15.150:59110/0 (socket says 172.21.15.150:59110) 2024-09-17T05:41:33.285 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:33.281+0000 7f8aa6096640 1 -- 172.21.15.150:0/2318869347 learned_addr learned my addr 172.21.15.150:0/2318869347 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:41:33.285 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:33.281+0000 7f8aa82fa640 1 -- 172.21.15.150:0/2318869347 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f8aa0073480 con 0x7f8aa015dd00 2024-09-17T05:41:33.285 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:33.281+0000 7f8aa6897640 1 --2- 172.21.15.150:0/2318869347 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8aa015e250 0x7f8aa01fa5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:41:33.285 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:33.281+0000 7f8aa82fa640 1 -- 172.21.15.150:0/2318869347 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f8aa0073300 con 0x7f8aa015e250 2024-09-17T05:41:33.285 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:33.281+0000 7f8aa82fa640 1 -- 172.21.15.150:0/2318869347 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f8aa0073600 con 0x7f8a8c0099b0 2024-09-17T05:41:33.285 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:33.281+0000 7f8aa5895640 1 --2- 172.21.15.150:0/2318869347 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8aa015dd00 0x7f8aa01fa0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:41:33.285 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:33.281+0000 7f8aa6897640 1 -- 172.21.15.150:0/2318869347 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8a8c0099b0 msgr2=0x7f8aa015d670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:41:33.285 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:33.281+0000 7f8aa6897640 1 --2- 172.21.15.150:0/2318869347 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8a8c0099b0 0x7f8aa015d670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:41:33.285 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:33.281+0000 7f8aa6897640 1 -- 172.21.15.150:0/2318869347 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8aa015dd00 msgr2=0x7f8aa01fa0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:41:33.285 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:33.281+0000 7f8aa6897640 1 --2- 172.21.15.150:0/2318869347 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8aa015dd00 0x7f8aa01fa0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:41:33.285 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:33.281+0000 7f8aa6897640 1 -- 172.21.15.150:0/2318869347 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8aa01fb200 con 0x7f8aa015e250 2024-09-17T05:41:33.286 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:33.281+0000 7f8aa5895640 1 --2- 172.21.15.150:0/2318869347 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8aa015dd00 0x7f8aa01fa0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T05:41:33.286 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:33.282+0000 7f8aa6897640 1 --2- 172.21.15.150:0/2318869347 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8aa015e250 0x7f8aa01fa5e0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f8aa00ae620 tx=0x7f8a98005bc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:41:33.287 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mds', 'mds_op_complaint_time', '180'], check_status=True, hostname='smithi150') 2024-09-17T05:41:33.287 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:33.278+0000 7f3fc5961640 1 -- 172.21.15.150:0/3507744835 shutdown_connections 2024-09-17T05:41:33.287 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:33.278+0000 7f3fc5961640 1 -- 172.21.15.150:0/3507744835 wait complete. 2024-09-17T05:41:33.287 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:33.284+0000 7f93dffff640 1 --2- 172.21.15.150:0/3559471805 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f93e00af980 0x7f93e015e2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:41:33.287 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:33.285+0000 7f93e56b0640 1 --2- 172.21.15.150:0/3559471805 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f93e00af980 0x7f93e015e2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:41:33.288 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:33.285+0000 7f93e56b0640 1 -- 172.21.15.150:0/3559471805 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f93e01407d0 con 0x7f93e00b3b90 2024-09-17T05:41:33.288 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:33.285+0000 7f93dffff640 1 --2- 172.21.15.150:0/3559471805 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f93e00af980 0x7f93e015e2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T05:41:33.288 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:33.285+0000 7f8a96ffd640 1 -- 172.21.15.150:0/2318869347 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a98035040 con 0x7f8aa015e250 2024-09-17T05:41:33.288 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:33.285+0000 7f8a96ffd640 1 -- 172.21.15.150:0/2318869347 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8a9803f070 con 0x7f8aa015e250 2024-09-17T05:41:33.289 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:33.285+0000 7f8aa82fa640 1 -- 172.21.15.150:0/2318869347 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8aa01faf20 con 0x7f8aa015e250 2024-09-17T05:41:33.289 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:33.285+0000 7f8aa82fa640 1 -- 172.21.15.150:0/2318869347 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8aa013f200 con 0x7f8aa015e250 2024-09-17T05:41:33.289 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:33.286+0000 7f7acd1b4640 1 -- 172.21.15.150:0/2625213195 shutdown_connections 2024-09-17T05:41:33.289 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:33.286+0000 7f7acd1b4640 1 --2- 172.21.15.150:0/2625213195 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7ac0052360 0x7f7ac00e6ac0 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:41:33.289 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:33.286+0000 7f7acd1b4640 1 -- 172.21.15.150:0/2625213195 >> 172.21.15.150:0/2625213195 conn(0x7f7ac001d9a0 msgr2=0x7f7ac0039660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:41:33.289 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:33.287+0000 7f8a96ffd640 1 -- 172.21.15.150:0/2318869347 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a98006d60 con 0x7f8aa015e250 2024-09-17T05:41:33.291 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:33.287+0000 7f8a96ffd640 1 -- 172.21.15.150:0/2318869347 <== mon.1 v2:172.21.15.176:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f8a98003c90 con 0x7f8aa015e250 2024-09-17T05:41:33.291 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:33.287+0000 7f8a94ff9640 1 -- 172.21.15.150:0/2318869347 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8aa013f440 con 0x7f8aa015e250 2024-09-17T05:41:33.292 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:33.287+0000 7f7acd1b4640 1 -- 172.21.15.150:0/2625213195 shutdown_connections 2024-09-17T05:41:33.292 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:33.287+0000 7f7acd1b4640 1 -- 172.21.15.150:0/2625213195 wait complete. 2024-09-17T05:41:33.293 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:33.292+0000 7f8a96ffd640 1 -- 172.21.15.150:0/2318869347 <== mon.1 v2:172.21.15.176:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f8a98044650 con 0x7f8aa015e250 2024-09-17T05:41:33.293 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:33.290+0000 7f7acd1b4640 1 Processor -- start 2024-09-17T05:41:33.293 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:33.290+0000 7f7acd1b4640 1 -- start start 2024-09-17T05:41:33.294 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:33.292+0000 7f8a96ffd640 1 -- 172.21.15.150:0/2318869347 <== mon.1 v2:172.21.15.176:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7f8aa013f440 con 0x7f8aa015e250 2024-09-17T05:41:33.294 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:33.292+0000 7f93e56b0640 1 --2- 172.21.15.150:0/3559471805 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f93e00b3b90 0x7f93e00ab470 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f93d0009780 tx=0x7f93d0003820 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:41:33.294 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:33.293+0000 7f7acd1b4640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7ac0052360 0x7f7ac00e37d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:41:33.295 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:33.293+0000 7f7acd1b4640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7ac00e7000 0x7f7ac0032b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:41:33.297 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:33.296+0000 7f93dd7fa640 1 -- 172.21.15.150:0/3559471805 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93d0003cd0 con 0x7f93e00b3b90 2024-09-17T05:41:33.297 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:33.281+0000 7f3fc5961640 1 Processor -- start 2024-09-17T05:41:33.298 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:33.281+0000 7f3fc5961640 1 -- start start 2024-09-17T05:41:33.298 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:33.284+0000 7f3fc5961640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3fc0074dc0 0x7f3fc016e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:41:33.298 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:33.284+0000 7f3fc495f640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3fc0074dc0 0x7f3fc016e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:41:33.298 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:33.284+0000 7f3fc495f640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3fc0074dc0 0x7f3fc016e7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:49978/0 (socket says 172.21.15.150:49978) 2024-09-17T05:41:33.298 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:33.284+0000 7f3fc5961640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3fc00af500 0x7f3fc0095430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:41:33.298 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:33.284+0000 7f3fc495f640 1 -- 172.21.15.150:0/2541109002 learned_addr learned my addr 172.21.15.150:0/2541109002 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:41:33.298 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:33.284+0000 7f3fc5961640 1 --2- 172.21.15.150:0/2541109002 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3fc00ccb50 0x7f3fc0095970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:41:33.298 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:33.284+0000 7f3fc5961640 1 -- 172.21.15.150:0/2541109002 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f3fc00b4a90 con 0x7f3fc0074dc0 2024-09-17T05:41:33.298 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:33.284+0000 7f3fc5961640 1 -- 172.21.15.150:0/2541109002 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f3fc00b4910 con 0x7f3fc00ccb50 2024-09-17T05:41:33.298 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:33.284+0000 7f3fc5961640 1 -- 172.21.15.150:0/2541109002 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f3fc00b4c10 con 0x7f3fc00af500 2024-09-17T05:41:33.299 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:33.296+0000 7f93e7113640 1 -- 172.21.15.150:0/3559471805 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f93e00ad430 con 0x7f93e00b3b90 2024-09-17T05:41:33.299 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:33.296+0000 7f93e7113640 1 -- 172.21.15.150:0/3559471805 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f93e00aa6a0 con 0x7f93e00b3b90 2024-09-17T05:41:33.299 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:33.284+0000 7f3fbffff640 1 --2- 172.21.15.150:0/2541109002 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3fc00af500 0x7f3fc0095430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:41:33.299 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:33.284+0000 7f3fc5160640 1 --2- 172.21.15.150:0/2541109002 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3fc00ccb50 0x7f3fc0095970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:41:33.300 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:33.293+0000 7f7acd1b4640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7ac00e7410 0x7f7ac00e58c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:41:33.300 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:33.293+0000 7f7acd1b4640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f7ac00f2a30 con 0x7f7ac00e7000 2024-09-17T05:41:33.300 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:33.293+0000 7f7acd1b4640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f7ac00f28b0 con 0x7f7ac0052360 2024-09-17T05:41:33.300 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:33.293+0000 7f7acd1b4640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f7ac00f2bb0 con 0x7f7ac00e7410 2024-09-17T05:41:33.301 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:33.296+0000 7f3fc5160640 1 -- 172.21.15.150:0/2541109002 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3fc00af500 msgr2=0x7f3fc0095430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:41:33.301 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:33.296+0000 7f3fc5160640 1 --2- 172.21.15.150:0/2541109002 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3fc00af500 0x7f3fc0095430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:41:33.301 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:33.296+0000 7f3fc5160640 1 -- 172.21.15.150:0/2541109002 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3fc0074dc0 msgr2=0x7f3fc016e7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:41:33.301 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:33.296+0000 7f3fc5160640 1 --2- 172.21.15.150:0/2541109002 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3fc0074dc0 0x7f3fc016e7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:41:33.301 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:33.296+0000 7f3fc5160640 1 -- 172.21.15.150:0/2541109002 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3fc009ded0 con 0x7f3fc00ccb50 2024-09-17T05:41:33.302 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:33.296+0000 7f7acc9b3640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7ac00e7410 0x7f7ac00e58c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:41:33.302 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:33.296+0000 7f7acc9b3640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7ac00e7410 0x7f7ac00e58c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3301/0 says I am v2:172.21.15.150:59136/0 (socket says 172.21.15.150:59136) 2024-09-17T05:41:33.302 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:33.296+0000 7f7acc9b3640 1 -- 172.21.15.150:0/1084469925 learned_addr learned my addr 172.21.15.150:0/1084469925 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:41:33.302 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:33.296+0000 7f7ac7fff640 1 --2- 172.21.15.150:0/1084469925 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7ac0052360 0x7f7ac00e37d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:41:33.303 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:33.296+0000 7f7ac77fe640 1 --2- 172.21.15.150:0/1084469925 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7ac00e7000 0x7f7ac0032b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:41:33.303 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:33.296+0000 7f7acc9b3640 1 -- 172.21.15.150:0/1084469925 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7ac0052360 msgr2=0x7f7ac00e37d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:41:33.303 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:33.296+0000 7f7acc9b3640 1 --2- 172.21.15.150:0/1084469925 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7ac0052360 0x7f7ac00e37d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:41:33.303 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:33.296+0000 7f7acc9b3640 1 -- 172.21.15.150:0/1084469925 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7ac00e7000 msgr2=0x7f7ac0032b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:41:33.303 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:33.296+0000 7f7acc9b3640 1 --2- 172.21.15.150:0/1084469925 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7ac00e7000 0x7f7ac0032b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:41:33.303 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:33.297+0000 7f93dd7fa640 1 -- 172.21.15.150:0/3559471805 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f93d0005020 con 0x7f93e00b3b90 2024-09-17T05:41:33.303 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:33.296+0000 7f7acc9b3640 1 -- 172.21.15.150:0/1084469925 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7ac00e40d0 con 0x7f7ac00e7410 2024-09-17T05:41:33.304 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:33.297+0000 7f93dd7fa640 1 -- 172.21.15.150:0/3559471805 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93d0005430 con 0x7f93e00b3b90 2024-09-17T05:41:33.305 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:33.296+0000 7f7ac77fe640 1 --2- 172.21.15.150:0/1084469925 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7ac00e7000 0x7f7ac0032b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T05:41:33.305 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:33.297+0000 7f7acc9b3640 1 --2- 172.21.15.150:0/1084469925 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7ac00e7410 0x7f7ac00e58c0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f7ac802ebd0 tx=0x7f7ac806a030 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:41:33.305 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:33.297+0000 7f7ac4ff9640 1 -- 172.21.15.150:0/1084469925 <== mon.2 v2:172.21.15.176:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ac80693d0 con 0x7f7ac00e7410 2024-09-17T05:41:33.305 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:33.297+0000 7f7ac4ff9640 1 -- 172.21.15.150:0/1084469925 <== mon.2 v2:172.21.15.176:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f7ac8069660 con 0x7f7ac00e7410 2024-09-17T05:41:33.305 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:33.298+0000 7f7ac4ff9640 1 -- 172.21.15.150:0/1084469925 <== mon.2 v2:172.21.15.176:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ac8082400 con 0x7f7ac00e7410 2024-09-17T05:41:33.305 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:33.298+0000 7f7acd1b4640 1 -- 172.21.15.150:0/1084469925 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7ac00e43b0 con 0x7f7ac00e7410 2024-09-17T05:41:33.305 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:33.298+0000 7f7acd1b4640 1 -- 172.21.15.150:0/1084469925 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f7ac00e4970 con 0x7f7ac00e7410 2024-09-17T05:41:33.306 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:33.298+0000 7f7ac4ff9640 1 -- 172.21.15.150:0/1084469925 <== mon.2 v2:172.21.15.176:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f7ac80825a0 con 0x7f7ac00e7410 2024-09-17T05:41:33.306 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:33.298+0000 7f7ac4ff9640 1 -- 172.21.15.150:0/1084469925 <== mon.2 v2:172.21.15.176:3301/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f7ac8081c10 con 0x7f7ac00e7410 2024-09-17T05:41:33.306 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:33.301+0000 7f93c6ffd640 1 -- 172.21.15.150:0/3559471805 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f93c0005290 con 0x7f93e00b3b90 2024-09-17T05:41:33.307 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:33.301+0000 7f3fc5160640 1 --2- 172.21.15.150:0/2541109002 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3fc00ccb50 0x7f3fc0095970 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f3fc00b6160 tx=0x7f3fb400c7a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:41:33.307 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:33.301+0000 7f3fbd7fa640 1 -- 172.21.15.150:0/2541109002 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3fb4017070 con 0x7f3fc00ccb50 2024-09-17T05:41:33.307 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:33.301+0000 7f3fc5961640 1 -- 172.21.15.150:0/2541109002 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3fc0094950 con 0x7f3fc00ccb50 2024-09-17T05:41:33.307 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:33.301+0000 7f3fc5961640 1 -- 172.21.15.150:0/2541109002 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3fc0094f10 con 0x7f3fc00ccb50 2024-09-17T05:41:33.307 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:33.303+0000 7f3fbd7fa640 1 -- 172.21.15.150:0/2541109002 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f3fb40053e0 con 0x7f3fc00ccb50 2024-09-17T05:41:33.307 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:33.303+0000 7f3fbd7fa640 1 -- 172.21.15.150:0/2541109002 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3fb4003850 con 0x7f3fc00ccb50 2024-09-17T05:41:33.307 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:33.303+0000 7f3fc5961640 1 -- 172.21.15.150:0/2541109002 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3fc009dc40 con 0x7f3fc00ccb50 2024-09-17T05:41:33.308 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:33.305+0000 7fd67d952640 1 -- 172.21.15.150:0/1747430738 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_command([{prefix=config set, name=rados_mon_op_timeout}] v 0) -- 0x7fd6780cc470 con 0x7fd678074870 2024-09-17T05:41:33.308 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:33.303+0000 7f93dd7fa640 1 -- 172.21.15.150:0/3559471805 <== mon.1 v2:172.21.15.176:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f93d0004b30 con 0x7f93e00b3b90 2024-09-17T05:41:33.308 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:33.303+0000 7f93dd7fa640 1 -- 172.21.15.150:0/3559471805 <== mon.1 v2:172.21.15.176:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f93d003b410 con 0x7f93e00b3b90 2024-09-17T05:41:33.308 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:33.307+0000 7f93dd7fa640 1 -- 172.21.15.150:0/3559471805 <== mon.1 v2:172.21.15.176:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7f93e01407d0 con 0x7f93e00b3b90 2024-09-17T05:41:33.309 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:33.307+0000 7f3fbd7fa640 1 -- 172.21.15.150:0/2541109002 <== mon.1 v2:172.21.15.176:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f3fb401a070 con 0x7f3fc00ccb50 2024-09-17T05:41:33.309 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:33.307+0000 7f3fbd7fa640 1 -- 172.21.15.150:0/2541109002 <== mon.1 v2:172.21.15.176:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f3fb401c440 con 0x7f3fc00ccb50 2024-09-17T05:41:33.309 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:33.307+0000 7f3fbd7fa640 1 -- 172.21.15.150:0/2541109002 <== mon.1 v2:172.21.15.176:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7f3fb4021020 con 0x7f3fc00ccb50 2024-09-17T05:41:33.313 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:33.312+0000 7f7acd1b4640 1 -- 172.21.15.150:0/1084469925 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7aa8005290 con 0x7f7ac00e7410 2024-09-17T05:41:33.314 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:33.313+0000 7fd66ffff640 1 -- 172.21.15.150:0/1747430738 <== mon.1 v2:172.21.15.176:3300/0 7 ==== mon_command_ack([{prefix=config set, name=rados_mon_op_timeout}]=0 v12)=0 v12) ==== 120+0+0 (secure 0 0 0) 0x7fd678074c80 con 0x7fd678074870 2024-09-17T05:41:33.316 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:33.314+0000 7fd66dffb640 1 -- 172.21.15.150:0/1747430738 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd678074870 msgr2=0x7fd6781547b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:41:33.316 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:33.314+0000 7fd66dffb640 1 --2- 172.21.15.150:0/1747430738 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd678074870 0x7fd6781547b0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fd66800c4d0 tx=0x7fd66800c990 comp rx=0 tx=0).stop 2024-09-17T05:41:33.316 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:33.315+0000 7fd66dffb640 1 -- 172.21.15.150:0/1747430738 shutdown_connections 2024-09-17T05:41:33.316 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:33.315+0000 7fd66dffb640 1 --2- 172.21.15.150:0/1747430738 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd6780b34e0 0x7fd6781f3330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:41:33.317 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:33.315+0000 7fd66dffb640 1 --2- 172.21.15.150:0/1747430738 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd6780b30d0 0x7fd6781f2df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:41:33.317 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:33.315+0000 7fd66dffb640 1 --2- 172.21.15.150:0/1747430738 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd678074870 0x7fd6781547b0 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:41:33.317 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:33.315+0000 7fd66dffb640 1 -- 172.21.15.150:0/1747430738 >> 172.21.15.150:0/1747430738 conn(0x7fd6780b1dd0 msgr2=0x7fd678158640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:41:33.317 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:33.315+0000 7fd66dffb640 1 -- 172.21.15.150:0/1747430738 shutdown_connections 2024-09-17T05:41:33.317 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:33.315+0000 7fd66dffb640 1 -- 172.21.15.150:0/1747430738 wait complete. 2024-09-17T05:41:33.322 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:33.317+0000 7f7ac4ff9640 1 -- 172.21.15.150:0/1084469925 <== mon.2 v2:172.21.15.176:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7f7ac807e030 con 0x7f7ac00e7410 2024-09-17T05:41:33.359 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:33.357+0000 7f637ee1c640 1 -- 172.21.15.150:0/3955193823 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command([{prefix=config set, name=osd_op_complaint_time}] v 0) -- 0x7f637000b190 con 0x7f63700519a0 2024-09-17T05:41:33.364 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:33.363+0000 7f636e7fc640 1 -- 172.21.15.150:0/3955193823 <== mon.0 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{prefix=config set, name=osd_op_complaint_time}]=0 v13)=0 v13) ==== 121+0+0 (secure 0 0 0) 0x7f636802ce00 con 0x7f63700519a0 2024-09-17T05:41:33.375 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:33.372+0000 7f637ee1c640 1 -- 172.21.15.150:0/3955193823 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f63700519a0 msgr2=0x7f63701756a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:41:33.375 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:33.372+0000 7f637ee1c640 1 --2- 172.21.15.150:0/3955193823 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f63700519a0 0x7f63701756a0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f636802c6e0 tx=0x7f6368003ee0 comp rx=0 tx=0).stop 2024-09-17T05:41:33.377 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:33.376+0000 7f637ee1c640 1 -- 172.21.15.150:0/3955193823 shutdown_connections 2024-09-17T05:41:33.377 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:33.376+0000 7f637ee1c640 1 --2- 172.21.15.150:0/3955193823 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6370053710 0x7f63700e23f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:41:33.377 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:33.376+0000 7f637ee1c640 1 --2- 172.21.15.150:0/3955193823 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f63700df800 0x7f6370006af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:41:33.378 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:33.376+0000 7f637ee1c640 1 --2- 172.21.15.150:0/3955193823 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f63700519a0 0x7f63701756a0 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:41:33.378 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:33.376+0000 7f637ee1c640 1 -- 172.21.15.150:0/3955193823 >> 172.21.15.150:0/3955193823 conn(0x7f637001e260 msgr2=0x7f63700dcd60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:41:33.381 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:33.380+0000 7f637ee1c640 1 -- 172.21.15.150:0/3955193823 shutdown_connections 2024-09-17T05:41:33.381 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:33.380+0000 7f637ee1c640 1 -- 172.21.15.150:0/3955193823 wait complete. 2024-09-17T05:41:33.397 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:33.396+0000 7f39315e6640 1 -- 172.21.15.150:0/1437528058 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command([{prefix=config set, name=rados_osd_op_timeout}] v 0) -- 0x7f390c005580 con 0x7f392c0705d0 2024-09-17T05:41:33.404 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:33.402+0000 7f39137fe640 1 -- 172.21.15.150:0/1437528058 <== mon.0 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{prefix=config set, name=rados_osd_op_timeout}]=0 v14)=0 v14) ==== 120+0+0 (secure 0 0 0) 0x7f391c010600 con 0x7f392c0705d0 2024-09-17T05:41:33.414 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:33.413+0000 7f39315e6640 1 -- 172.21.15.150:0/1437528058 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f392c0705d0 msgr2=0x7f392c1f6e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:41:33.414 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:33.413+0000 7f39315e6640 1 --2- 172.21.15.150:0/1437528058 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f392c0705d0 0x7f392c1f6e10 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f391c00d950 tx=0x7f391c00de10 comp rx=0 tx=0).stop 2024-09-17T05:41:33.421 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:33.420+0000 7f39315e6640 1 -- 172.21.15.150:0/1437528058 shutdown_connections 2024-09-17T05:41:33.421 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:33.420+0000 7f39315e6640 1 --2- 172.21.15.150:0/1437528058 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f392c2055b0 0x7f392c2059c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:41:33.421 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:33.420+0000 7f39315e6640 1 --2- 172.21.15.150:0/1437528058 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f392c073660 0x7f392c15c920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:41:33.421 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:33.420+0000 7f39315e6640 1 --2- 172.21.15.150:0/1437528058 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f392c0705d0 0x7f392c1f6e10 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:41:33.422 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:33.420+0000 7f39315e6640 1 -- 172.21.15.150:0/1437528058 >> 172.21.15.150:0/1437528058 conn(0x7f392c06cda0 msgr2=0x7f392c06f180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:41:33.422 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:33.420+0000 7f39315e6640 1 -- 172.21.15.150:0/1437528058 shutdown_connections 2024-09-17T05:41:33.422 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:33.420+0000 7f39315e6640 1 -- 172.21.15.150:0/1437528058 wait complete. 2024-09-17T05:41:33.422 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:33.421+0000 7fe3e9ffb640 1 -- 172.21.15.150:0/1671366530 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command([{prefix=config set, name=osd_op_complaint_time}] v 0) -- 0x7fe3e4005580 con 0x7fe4040b28f0 2024-09-17T05:41:33.433 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:33.432+0000 7fe3ebfff640 1 -- 172.21.15.150:0/1671366530 <== mon.0 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{prefix=config set, name=osd_op_complaint_time}]=0 v15)=0 v15) ==== 121+0+0 (secure 0 0 0) 0x7fe3fc004040 con 0x7fe4040b28f0 2024-09-17T05:41:33.443 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:33.442+0000 7f2506ffd640 1 -- 172.21.15.150:0/2963673486 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_command([{prefix=config set, name=mds_verify_scatter}] v 0) -- 0x7f2514056590 con 0x7f25140d7cb0 2024-09-17T05:41:33.445 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:33.444+0000 7fe3e9ffb640 1 -- 172.21.15.150:0/1671366530 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe4040b28f0 msgr2=0x7fe404094d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:41:33.445 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:33.444+0000 7fe3e9ffb640 1 --2- 172.21.15.150:0/1671366530 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe4040b28f0 0x7fe404094d90 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fe3fc000f80 tx=0x7fe3fc003ba0 comp rx=0 tx=0).stop 2024-09-17T05:41:33.447 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:33.445+0000 7fe3e9ffb640 1 -- 172.21.15.150:0/1671366530 shutdown_connections 2024-09-17T05:41:33.447 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:33.445+0000 7fe3e9ffb640 1 --2- 172.21.15.150:0/1671366530 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe4040952d0 0x7fe404215ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:41:33.447 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:33.445+0000 7fe3e9ffb640 1 --2- 172.21.15.150:0/1671366530 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe4040b28f0 0x7fe404094d90 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:41:33.447 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:33.445+0000 7fe3e9ffb640 1 --2- 172.21.15.150:0/1671366530 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe404099b00 0x7fe404093240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:41:33.447 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:33.445+0000 7fe3e9ffb640 1 -- 172.21.15.150:0/1671366530 >> 172.21.15.150:0/1671366530 conn(0x7fe4040b1dd0 msgr2=0x7fe40416d420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:41:33.447 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:33.445+0000 7fe3e9ffb640 1 -- 172.21.15.150:0/1671366530 shutdown_connections 2024-09-17T05:41:33.447 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:33.445+0000 7fe3e9ffb640 1 -- 172.21.15.150:0/1671366530 wait complete. 2024-09-17T05:41:33.454 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:33.452+0000 7fac71961640 1 -- 172.21.15.150:0/3172661921 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_command([{prefix=config set, name=client_mount_timeout}] v 0) -- 0x7fac64036d90 con 0x7fac5c0039b0 2024-09-17T05:41:33.455 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:33.451+0000 7f25197fa640 1 -- 172.21.15.150:0/2963673486 <== mon.1 v2:172.21.15.176:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_verify_scatter}]=0 v16)=0 v16) ==== 119+0+0 (secure 0 0 0) 0x7f2508003db0 con 0x7f25140d7cb0 2024-09-17T05:41:33.455 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:33.453+0000 7f25219eb640 1 -- 172.21.15.150:0/2963673486 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f25140d7cb0 msgr2=0x7f2514172c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:41:33.455 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:33.453+0000 7f25219eb640 1 --2- 172.21.15.150:0/2963673486 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f25140d7cb0 0x7f2514172c20 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f250800c760 tx=0x7f250800cb60 comp rx=0 tx=0).stop 2024-09-17T05:41:33.455 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:33.453+0000 7f25219eb640 1 -- 172.21.15.150:0/2963673486 shutdown_connections 2024-09-17T05:41:33.455 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:33.453+0000 7f25219eb640 1 --2- 172.21.15.150:0/2963673486 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f25140d7cb0 0x7f2514172c20 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:41:33.455 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:33.453+0000 7f25219eb640 1 --2- 172.21.15.150:0/2963673486 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2514178cf0 0x7f2514179100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:41:33.455 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:33.453+0000 7f25219eb640 1 --2- 172.21.15.150:0/2963673486 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f250c004ba0 0x7f25140da170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:41:33.456 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:33.453+0000 7f25219eb640 1 -- 172.21.15.150:0/2963673486 >> 172.21.15.150:0/2963673486 conn(0x7f251401eae0 msgr2=0x7f2514054800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:41:33.456 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:33.453+0000 7f25219eb640 1 -- 172.21.15.150:0/2963673486 shutdown_connections 2024-09-17T05:41:33.456 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:33.453+0000 7f25219eb640 1 -- 172.21.15.150:0/2963673486 wait complete. 2024-09-17T05:41:33.460 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:33.459+0000 7fac697fa640 1 -- 172.21.15.150:0/3172661921 <== mon.2 v2:172.21.15.176:3301/0 7 ==== mon_command_ack([{prefix=config set, name=client_mount_timeout}]=0 v17)=0 v17) ==== 119+0+0 (secure 0 0 0) 0x7fac58003dd0 con 0x7fac5c0039b0 2024-09-17T05:41:33.460 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:33.458+0000 7fbb74ff9640 1 -- 172.21.15.150:0/3516789411 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_command([{prefix=config set, name=debug_ms}] v 0) -- 0x7fbb5c005850 con 0x7fbb8009c570 2024-09-17T05:41:33.463 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:33.462+0000 7f2c98d69640 1 -- 172.21.15.150:0/3771306457 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command([{prefix=config set, name=mon_op_complaint_time}] v 0) -- 0x7f2c78005180 con 0x7f2c9406d7b0 2024-09-17T05:41:33.464 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:33.462+0000 7fac71961640 1 -- 172.21.15.150:0/3172661921 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fac5c0039b0 msgr2=0x7fac64051cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:41:33.464 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:33.462+0000 7fac71961640 1 --2- 172.21.15.150:0/3172661921 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fac5c0039b0 0x7fac64051cc0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fac58001790 tx=0x7fac58006320 comp rx=0 tx=0).stop 2024-09-17T05:41:33.465 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:33.463+0000 7fac71961640 1 -- 172.21.15.150:0/3172661921 shutdown_connections 2024-09-17T05:41:33.465 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:33.463+0000 7fac71961640 1 --2- 172.21.15.150:0/3172661921 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fac6404d650 0x7fac64189f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:41:33.465 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:33.463+0000 7fac71961640 1 --2- 172.21.15.150:0/3172661921 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fac6404d240 0x7fac6404fe00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:41:33.465 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:33.463+0000 7fac71961640 1 --2- 172.21.15.150:0/3172661921 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fac5c0039b0 0x7fac64051cc0 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:41:33.465 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:33.463+0000 7fac71961640 1 -- 172.21.15.150:0/3172661921 >> 172.21.15.150:0/3172661921 conn(0x7fac6401e260 msgr2=0x7fac6416c200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:41:33.465 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:33.463+0000 7fac71961640 1 -- 172.21.15.150:0/3172661921 shutdown_connections 2024-09-17T05:41:33.465 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:33.463+0000 7fac71961640 1 -- 172.21.15.150:0/3172661921 wait complete. 2024-09-17T05:41:33.474 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:33.473+0000 7fbb76ffd640 1 -- 172.21.15.150:0/3516789411 <== mon.1 v2:172.21.15.176:3300/0 7 ==== mon_command_ack([{prefix=config set, name=debug_ms}]=0 v18)=0 v18) ==== 106+0+0 (secure 0 0 0) 0x7fbb7000ad70 con 0x7fbb8009c570 2024-09-17T05:41:33.477 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:33.475+0000 7fbb74ff9640 1 -- 172.21.15.150:0/3516789411 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fbb8009c570 msgr2=0x7fbb80216400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:41:33.477 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:33.475+0000 7fbb74ff9640 1 --2- 172.21.15.150:0/3516789411 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fbb8009c570 0x7fbb80216400 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fbb700074a0 tx=0x7fbb700045e0 comp rx=0 tx=0).stop 2024-09-17T05:41:33.477 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:33.475+0000 7fbb74ff9640 1 -- 172.21.15.150:0/3516789411 shutdown_connections 2024-09-17T05:41:33.477 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:33.475+0000 7fbb74ff9640 1 --2- 172.21.15.150:0/3516789411 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fbb8009c570 0x7fbb80216400 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:41:33.478 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:33.475+0000 7fbb74ff9640 1 --2- 172.21.15.150:0/3516789411 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fbb800ccb50 0x7fbb8009c030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:41:33.478 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:33.475+0000 7fbb74ff9640 1 --2- 172.21.15.150:0/3516789411 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbb80098c90 0x7fbb80095820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:41:33.478 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:33.475+0000 7fbb74ff9640 1 -- 172.21.15.150:0/3516789411 >> 172.21.15.150:0/3516789411 conn(0x7fbb800742a0 msgr2=0x7fbb80070540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:41:33.479 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:33.478+0000 7fbb74ff9640 1 -- 172.21.15.150:0/3516789411 shutdown_connections 2024-09-17T05:41:33.479 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:33.478+0000 7fbb74ff9640 1 -- 172.21.15.150:0/3516789411 wait complete. 2024-09-17T05:41:33.480 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:33.479+0000 7f7acd1b4640 1 -- 172.21.15.150:0/1084469925 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_command([{prefix=config set, name=mon_warn_on_pool_no_app}] v 0) -- 0x7f7aa8005580 con 0x7f7ac00e7410 2024-09-17T05:41:33.482 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:33.481+0000 7f2c82ffd640 1 -- 172.21.15.150:0/3771306457 <== mon.0 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_op_complaint_time}]=0 v19)=0 v19) ==== 121+0+0 (secure 0 0 0) 0x7f2c84012b30 con 0x7f2c9406d7b0 2024-09-17T05:41:33.484 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:33.482+0000 7f2c98d69640 1 -- 172.21.15.150:0/3771306457 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2c9406d7b0 msgr2=0x7f2c941fa0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:41:33.484 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:33.482+0000 7f2c98d69640 1 --2- 172.21.15.150:0/3771306457 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2c9406d7b0 0x7f2c941fa0c0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f2c8400c760 tx=0x7f2c8400cc20 comp rx=0 tx=0).stop 2024-09-17T05:41:33.484 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:33.482+0000 7f2c98d69640 1 -- 172.21.15.150:0/3771306457 shutdown_connections 2024-09-17T05:41:33.484 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:33.482+0000 7f2c98d69640 1 --2- 172.21.15.150:0/3771306457 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2c940d0c20 0x7f2c941fd6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:41:33.484 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:33.482+0000 7f2c98d69640 1 --2- 172.21.15.150:0/3771306457 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2c940cd7d0 0x7f2c940bb360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:41:33.484 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:33.482+0000 7f2c98d69640 1 --2- 172.21.15.150:0/3771306457 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2c9406d7b0 0x7f2c941fa0c0 secure :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f2c8400c760 tx=0x7f2c8400cc20 comp rx=0 tx=0).stop 2024-09-17T05:41:33.484 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:33.482+0000 7f2c98d69640 1 -- 172.21.15.150:0/3771306457 >> 172.21.15.150:0/3771306457 conn(0x7f2c940b2ff0 msgr2=0x7f2c940b69f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:41:33.484 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:33.482+0000 7f2c98d69640 1 -- 172.21.15.150:0/3771306457 shutdown_connections 2024-09-17T05:41:33.484 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:33.482+0000 7f2c98d69640 1 -- 172.21.15.150:0/3771306457 wait complete. 2024-09-17T05:41:33.489 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:33.488+0000 7f7ac4ff9640 1 -- 172.21.15.150:0/1084469925 <== mon.2 v2:172.21.15.176:3301/0 7 ==== mon_command_ack([{prefix=config set, name=mon_warn_on_pool_no_app}]=0 v20)=0 v20) ==== 125+0+0 (secure 0 0 0) 0x7f7ac8081e10 con 0x7f7ac00e7410 2024-09-17T05:41:33.491 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:33.490+0000 7f7acd1b4640 1 -- 172.21.15.150:0/1084469925 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7ac00e7410 msgr2=0x7f7ac00e58c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:41:33.491 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:33.490+0000 7f7acd1b4640 1 --2- 172.21.15.150:0/1084469925 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7ac00e7410 0x7f7ac00e58c0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f7ac802ebd0 tx=0x7f7ac806a030 comp rx=0 tx=0).stop 2024-09-17T05:41:33.491 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:33.490+0000 7f7acd1b4640 1 -- 172.21.15.150:0/1084469925 shutdown_connections 2024-09-17T05:41:33.492 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:33.490+0000 7f7acd1b4640 1 --2- 172.21.15.150:0/1084469925 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7ac00e7410 0x7f7ac00e58c0 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:41:33.492 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:33.490+0000 7f7acd1b4640 1 --2- 172.21.15.150:0/1084469925 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7ac00e7000 0x7f7ac0032b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:41:33.492 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:33.490+0000 7f7acd1b4640 1 --2- 172.21.15.150:0/1084469925 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7ac0052360 0x7f7ac00e37d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:41:33.492 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:33.490+0000 7f7acd1b4640 1 -- 172.21.15.150:0/1084469925 >> 172.21.15.150:0/1084469925 conn(0x7f7ac001d9a0 msgr2=0x7f7ac0051a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:41:33.493 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:33.491+0000 7f7acd1b4640 1 -- 172.21.15.150:0/1084469925 shutdown_connections 2024-09-17T05:41:33.493 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:33.491+0000 7f7acd1b4640 1 -- 172.21.15.150:0/1084469925 wait complete. 2024-09-17T05:41:33.503 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:33.501+0000 7f93c6ffd640 1 -- 172.21.15.150:0/3559471805 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_command([{prefix=config set, name=debug_mgr}] v 0) -- 0x7f93c0005850 con 0x7f93e00b3b90 2024-09-17T05:41:33.505 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:33.502+0000 7f8a94ff9640 1 -- 172.21.15.150:0/2318869347 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_command([{prefix=config set, name=debug_client}] v 0) -- 0x7f8aa00b3b30 con 0x7f8aa015e250 2024-09-17T05:41:33.508 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:33.506+0000 7f93dd7fa640 1 -- 172.21.15.150:0/3559471805 <== mon.1 v2:172.21.15.176:3300/0 7 ==== mon_command_ack([{prefix=config set, name=debug_mgr}]=0 v21)=0 v21) ==== 108+0+0 (secure 0 0 0) 0x7f93d003f030 con 0x7f93e00b3b90 2024-09-17T05:41:33.509 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:33.507+0000 7f93c6ffd640 1 -- 172.21.15.150:0/3559471805 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f93e00b3b90 msgr2=0x7f93e00ab470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:41:33.509 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:33.507+0000 7f93c6ffd640 1 --2- 172.21.15.150:0/3559471805 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f93e00b3b90 0x7f93e00ab470 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f93d0009780 tx=0x7f93d0003820 comp rx=0 tx=0).stop 2024-09-17T05:41:33.509 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:33.507+0000 7f93c6ffd640 1 -- 172.21.15.150:0/3559471805 shutdown_connections 2024-09-17T05:41:33.510 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:33.507+0000 7f93c6ffd640 1 --2- 172.21.15.150:0/3559471805 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f93e00b3b90 0x7f93e00ab470 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:41:33.510 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:33.507+0000 7f93c6ffd640 1 --2- 172.21.15.150:0/3559471805 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f93e00af980 0x7f93e015e2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:41:33.510 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:33.507+0000 7f93c6ffd640 1 --2- 172.21.15.150:0/3559471805 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f93e006fa20 0x7f93e015ec20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:41:33.510 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:33.507+0000 7f93c6ffd640 1 -- 172.21.15.150:0/3559471805 >> 172.21.15.150:0/3559471805 conn(0x7f93e006cda0 msgr2=0x7f93e01632e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:41:33.510 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:33.507+0000 7f93c6ffd640 1 -- 172.21.15.150:0/3559471805 shutdown_connections 2024-09-17T05:41:33.510 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:33.507+0000 7f93c6ffd640 1 -- 172.21.15.150:0/3559471805 wait complete. 2024-09-17T05:41:33.511 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:33.509+0000 7f8a96ffd640 1 -- 172.21.15.150:0/2318869347 <== mon.1 v2:172.21.15.176:3300/0 7 ==== mon_command_ack([{prefix=config set, name=debug_client}]=0 v22)=0 v22) ==== 111+0+0 (secure 0 0 0) 0x7f8a9802d070 con 0x7f8aa015e250 2024-09-17T05:41:33.512 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:33.510+0000 7f8a94ff9640 1 -- 172.21.15.150:0/2318869347 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8aa015e250 msgr2=0x7f8aa01fa5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:41:33.513 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:33.510+0000 7f8a94ff9640 1 --2- 172.21.15.150:0/2318869347 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8aa015e250 0x7f8aa01fa5e0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f8aa00ae620 tx=0x7f8a98005bc0 comp rx=0 tx=0).stop 2024-09-17T05:41:33.513 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:33.510+0000 7f8a94ff9640 1 -- 172.21.15.150:0/2318869347 shutdown_connections 2024-09-17T05:41:33.513 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:33.510+0000 7f8a94ff9640 1 --2- 172.21.15.150:0/2318869347 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8aa015e250 0x7f8aa01fa5e0 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:41:33.513 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:33.510+0000 7f8a94ff9640 1 --2- 172.21.15.150:0/2318869347 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8aa015dd00 0x7f8aa01fa0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:41:33.513 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:33.510+0000 7f8a94ff9640 1 --2- 172.21.15.150:0/2318869347 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8a8c0099b0 0x7f8aa015d670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:41:33.513 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:33.510+0000 7f8a94ff9640 1 -- 172.21.15.150:0/2318869347 >> 172.21.15.150:0/2318869347 conn(0x7f8aa006cda0 msgr2=0x7f8aa0146d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:41:33.513 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:33.511+0000 7f8a94ff9640 1 -- 172.21.15.150:0/2318869347 shutdown_connections 2024-09-17T05:41:33.513 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:33.511+0000 7f8a94ff9640 1 -- 172.21.15.150:0/2318869347 wait complete. 2024-09-17T05:41:33.513 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:33.511+0000 7f3fc5961640 1 -- 172.21.15.150:0/2541109002 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_command([{prefix=config set, name=mds_op_complaint_time}] v 0) -- 0x7f3fc006f0c0 con 0x7f3fc00ccb50 2024-09-17T05:41:33.517 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:33.516+0000 7f3fbd7fa640 1 -- 172.21.15.150:0/2541109002 <== mon.1 v2:172.21.15.176:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_op_complaint_time}]=0 v23)=0 v23) ==== 121+0+0 (secure 0 0 0) 0x7f3fc006f0c0 con 0x7f3fc00ccb50 2024-09-17T05:41:33.519 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:33.517+0000 7f3fc5961640 1 -- 172.21.15.150:0/2541109002 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3fc00ccb50 msgr2=0x7f3fc0095970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:41:33.519 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:33.517+0000 7f3fc5961640 1 --2- 172.21.15.150:0/2541109002 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3fc00ccb50 0x7f3fc0095970 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f3fc00b6160 tx=0x7f3fb400c7a0 comp rx=0 tx=0).stop 2024-09-17T05:41:33.519 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:33.517+0000 7f3fc5961640 1 -- 172.21.15.150:0/2541109002 shutdown_connections 2024-09-17T05:41:33.519 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:33.517+0000 7f3fc5961640 1 --2- 172.21.15.150:0/2541109002 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3fc00ccb50 0x7f3fc0095970 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:41:33.519 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:33.517+0000 7f3fc5961640 1 --2- 172.21.15.150:0/2541109002 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3fc00af500 0x7f3fc0095430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:41:33.519 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:33.517+0000 7f3fc5961640 1 --2- 172.21.15.150:0/2541109002 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3fc0074dc0 0x7f3fc016e7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:41:33.519 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:33.517+0000 7f3fc5961640 1 -- 172.21.15.150:0/2541109002 >> 172.21.15.150:0/2541109002 conn(0x7f3fc00742a0 msgr2=0x7f3fc006f2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:41:33.520 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:33.517+0000 7f3fc5961640 1 -- 172.21.15.150:0/2541109002 shutdown_connections 2024-09-17T05:41:33.520 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:33.517+0000 7f3fc5961640 1 -- 172.21.15.150:0/2541109002 wait complete. 2024-09-17T05:41:33.532 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mds', 'mds_verify_scatter', 'True'], check_status=True, hostname='smithi150') 2024-09-17T05:41:33.532 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mds', 'osd_op_complaint_time', '180'], check_status=True, hostname='smithi150') 2024-09-17T05:41:33.532 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mds', 'rados_mon_op_timeout', '900'], check_status=True, hostname='smithi150') 2024-09-17T05:41:33.533 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mds', 'rados_osd_op_timeout', '900'], check_status=True, hostname='smithi150') 2024-09-17T05:41:33.533 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mgr', 'client_mount_timeout', '30'], check_status=True, hostname='smithi150') 2024-09-17T05:41:33.533 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mgr', 'debug_client', '20'], check_status=True, hostname='smithi150') 2024-09-17T05:41:33.533 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mgr', 'debug_mgr', '20'], check_status=True, hostname='smithi150') 2024-09-17T05:41:33.533 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mgr', 'debug_ms', '1'], check_status=True, hostname='smithi150') 2024-09-17T05:41:33.533 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mgr', 'mon_warn_on_pool_no_app', 'False'], check_status=True, hostname='smithi150') 2024-09-17T05:41:33.533 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mon', 'mon_op_complaint_time', '120'], check_status=True, hostname='smithi150') 2024-09-17T05:41:33.533 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'osd', 'osd_op_complaint_time', '180'], check_status=True, hostname='smithi150') 2024-09-17T05:41:33.533 DEBUG:teuthology.orchestra.run.smithi150:> sudo ceph --cluster ceph config dump 2024-09-17T05:41:33.685 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:33.683+0000 7f171a55e640 1 -- 172.21.15.150:0/4184398432 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f17140d00e0 msgr2=0x7f171415ed90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:41:33.685 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:33.683+0000 7f171a55e640 1 --2- 172.21.15.150:0/4184398432 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f17140d00e0 0x7f171415ed90 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f1704009830 tx=0x7f170402a540 comp rx=0 tx=0).stop 2024-09-17T05:41:33.685 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:33.683+0000 7f171a55e640 1 -- 172.21.15.150:0/4184398432 shutdown_connections 2024-09-17T05:41:33.686 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:33.683+0000 7f171a55e640 1 --2- 172.21.15.150:0/4184398432 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f17140d00e0 0x7f171415ed90 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:41:33.686 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:33.683+0000 7f171a55e640 1 -- 172.21.15.150:0/4184398432 >> 172.21.15.150:0/4184398432 conn(0x7f17140b2f60 msgr2=0x7f17140b3370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:41:33.686 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:33.683+0000 7f171a55e640 1 -- 172.21.15.150:0/4184398432 shutdown_connections 2024-09-17T05:41:33.686 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:33.683+0000 7f171a55e640 1 -- 172.21.15.150:0/4184398432 wait complete. 2024-09-17T05:41:33.686 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:33.685+0000 7f171a55e640 1 Processor -- start 2024-09-17T05:41:33.687 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:33.685+0000 7f171a55e640 1 -- start start 2024-09-17T05:41:33.690 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:33.687+0000 7f171a55e640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f17140b27a0 0x7f17141f7480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:41:33.690 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:33.687+0000 7f171a55e640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f17140b52c0 0x7f17141f0900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:41:33.690 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:33.687+0000 7f171a55e640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f17140ce030 0x7f17140ce440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:41:33.690 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:33.687+0000 7f171a55e640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f17140b6390 con 0x7f17140b27a0 2024-09-17T05:41:33.690 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:33.687+0000 7f171a55e640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f17140b6210 con 0x7f17140b52c0 2024-09-17T05:41:33.690 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:33.687+0000 7f171a55e640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f17140b6510 con 0x7f17140ce030 2024-09-17T05:41:33.691 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:33.687+0000 7f1713fff640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f17140b27a0 0x7f17141f7480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:41:33.691 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:33.687+0000 7f1713fff640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f17140b27a0 0x7f17141f7480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:50000/0 (socket says 172.21.15.150:50000) 2024-09-17T05:41:33.691 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:33.687+0000 7f1713fff640 1 -- 172.21.15.150:0/2535756580 learned_addr learned my addr 172.21.15.150:0/2535756580 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:41:33.691 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:33.687+0000 7f17137fe640 1 --2- 172.21.15.150:0/2535756580 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f17140b52c0 0x7f17141f0900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:41:33.691 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:33.687+0000 7f1718afb640 1 --2- 172.21.15.150:0/2535756580 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f17140ce030 0x7f17140ce440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:41:33.691 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:33.687+0000 7f1713fff640 1 -- 172.21.15.150:0/2535756580 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f17140ce030 msgr2=0x7f17140ce440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:41:33.691 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:33.687+0000 7f1713fff640 1 --2- 172.21.15.150:0/2535756580 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f17140ce030 0x7f17140ce440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:41:33.691 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:33.687+0000 7f1713fff640 1 -- 172.21.15.150:0/2535756580 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f17140b52c0 msgr2=0x7f17141f0900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:41:33.691 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:33.687+0000 7f1713fff640 1 --2- 172.21.15.150:0/2535756580 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f17140b52c0 0x7f17141f0900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:41:33.691 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:33.687+0000 7f1713fff640 1 -- 172.21.15.150:0/2535756580 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f17141f0e40 con 0x7f17140b27a0 2024-09-17T05:41:33.691 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:33.687+0000 7f1713fff640 1 --2- 172.21.15.150:0/2535756580 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f17140b27a0 0x7f17141f7480 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f16fc00c430 tx=0x7f16fc00c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:41:33.691 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:33.687+0000 7f1710ff9640 1 -- 172.21.15.150:0/2535756580 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16fc017070 con 0x7f17140b27a0 2024-09-17T05:41:33.691 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:33.688+0000 7f1710ff9640 1 -- 172.21.15.150:0/2535756580 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f16fc0053c0 con 0x7f17140b27a0 2024-09-17T05:41:33.692 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:33.688+0000 7f171a55e640 1 -- 172.21.15.150:0/2535756580 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f17140ce980 con 0x7f17140b27a0 2024-09-17T05:41:33.692 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:33.688+0000 7f1710ff9640 1 -- 172.21.15.150:0/2535756580 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16fc0038a0 con 0x7f17140b27a0 2024-09-17T05:41:33.692 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:33.688+0000 7f171a55e640 1 -- 172.21.15.150:0/2535756580 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1714148450 con 0x7f17140b27a0 2024-09-17T05:41:33.692 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:33.688+0000 7f1710ff9640 1 -- 172.21.15.150:0/2535756580 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f16fc01a070 con 0x7f17140b27a0 2024-09-17T05:41:33.692 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:33.688+0000 7f1710ff9640 1 -- 172.21.15.150:0/2535756580 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f16fc01c780 con 0x7f17140b27a0 2024-09-17T05:41:33.692 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:33.689+0000 7f171a55e640 1 -- 172.21.15.150:0/2535756580 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1714154ba0 con 0x7f17140b27a0 2024-09-17T05:41:33.692 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:33.691+0000 7f1710ff9640 1 -- 172.21.15.150:0/2535756580 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7f16fc021020 con 0x7f17140b27a0 2024-09-17T05:41:33.753 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:33.751+0000 7f171a55e640 1 -- 172.21.15.150:0/2535756580 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "config dump"} v 0) -- 0x7f171415ed90 con 0x7f17140b27a0 2024-09-17T05:41:33.753 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:33.752+0000 7f1710ff9640 1 -- 172.21.15.150:0/2535756580 <== mon.0 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "config dump"}]=0 v23) ==== 59+0+1472 (secure 0 0 0) 0x7f17140ce980 con 0x7f17140b27a0 2024-09-17T05:41:33.753 INFO:teuthology.orchestra.run.smithi150.stdout:WHO MASK LEVEL OPTION VALUE RO 2024-09-17T05:41:33.753 INFO:teuthology.orchestra.run.smithi150.stdout:mon advanced mon_op_complaint_time 120 2024-09-17T05:41:33.754 INFO:teuthology.orchestra.run.smithi150.stdout:mgr advanced client_mount_timeout 30 2024-09-17T05:41:33.754 INFO:teuthology.orchestra.run.smithi150.stdout:mgr advanced debug_client 20/20 2024-09-17T05:41:33.754 INFO:teuthology.orchestra.run.smithi150.stdout:mgr advanced debug_mgr 20/20 2024-09-17T05:41:33.754 INFO:teuthology.orchestra.run.smithi150.stdout:mgr advanced debug_ms 1/1 2024-09-17T05:41:33.754 INFO:teuthology.orchestra.run.smithi150.stdout:mgr dev mon_warn_on_pool_no_app false 2024-09-17T05:41:33.754 INFO:teuthology.orchestra.run.smithi150.stdout:osd advanced osd_op_complaint_time 180.000000 2024-09-17T05:41:33.754 INFO:teuthology.orchestra.run.smithi150.stdout:mds advanced debug_mds 20/20 2024-09-17T05:41:33.754 INFO:teuthology.orchestra.run.smithi150.stdout:mds advanced debug_mds_balancer 20/20 2024-09-17T05:41:33.754 INFO:teuthology.orchestra.run.smithi150.stdout:mds advanced debug_ms 2/2 2024-09-17T05:41:33.754 INFO:teuthology.orchestra.run.smithi150.stdout:mds dev mds_debug_frag true 2024-09-17T05:41:33.754 INFO:teuthology.orchestra.run.smithi150.stdout:mds dev mds_debug_scatterstat true 2024-09-17T05:41:33.754 INFO:teuthology.orchestra.run.smithi150.stdout:mds advanced mds_op_complaint_time 180.000000 2024-09-17T05:41:33.754 INFO:teuthology.orchestra.run.smithi150.stdout:mds dev mds_verify_scatter true 2024-09-17T05:41:33.755 INFO:teuthology.orchestra.run.smithi150.stdout:mds advanced osd_op_complaint_time 180.000000 2024-09-17T05:41:33.755 INFO:teuthology.orchestra.run.smithi150.stdout:mds advanced rados_mon_op_timeout 900 2024-09-17T05:41:33.755 INFO:teuthology.orchestra.run.smithi150.stdout:mds advanced rados_osd_op_timeout 900 2024-09-17T05:41:33.755 INFO:teuthology.orchestra.run.smithi150.stdout:client advanced client_mount_timeout 600 2024-09-17T05:41:33.755 INFO:teuthology.orchestra.run.smithi150.stdout:client advanced debug_client 20/20 2024-09-17T05:41:33.755 INFO:teuthology.orchestra.run.smithi150.stdout:client advanced debug_ms 1/1 2024-09-17T05:41:33.755 INFO:teuthology.orchestra.run.smithi150.stdout:client advanced rados_mon_op_timeout 900 2024-09-17T05:41:33.755 INFO:teuthology.orchestra.run.smithi150.stdout:client advanced rados_osd_op_timeout 900 2024-09-17T05:41:33.756 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:33.753+0000 7f171a55e640 1 -- 172.21.15.150:0/2535756580 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f17140b27a0 msgr2=0x7f17141f7480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:41:33.756 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:33.753+0000 7f171a55e640 1 --2- 172.21.15.150:0/2535756580 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f17140b27a0 0x7f17141f7480 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f16fc00c430 tx=0x7f16fc00c8f0 comp rx=0 tx=0).stop 2024-09-17T05:41:33.756 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:33.753+0000 7f171a55e640 1 -- 172.21.15.150:0/2535756580 shutdown_connections 2024-09-17T05:41:33.756 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:33.753+0000 7f171a55e640 1 --2- 172.21.15.150:0/2535756580 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f17140b52c0 0x7f17141f0900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:41:33.756 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:33.753+0000 7f171a55e640 1 --2- 172.21.15.150:0/2535756580 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f17140ce030 0x7f17140ce440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:41:33.756 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:33.753+0000 7f171a55e640 1 --2- 172.21.15.150:0/2535756580 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f17140b27a0 0x7f17141f7480 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:41:33.756 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:33.753+0000 7f171a55e640 1 -- 172.21.15.150:0/2535756580 >> 172.21.15.150:0/2535756580 conn(0x7f17140b2f60 msgr2=0x7f17140b56d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:41:33.756 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:33.753+0000 7f171a55e640 1 -- 172.21.15.150:0/2535756580 shutdown_connections 2024-09-17T05:41:33.757 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:33.753+0000 7f171a55e640 1 -- 172.21.15.150:0/2535756580 wait complete. 2024-09-17T05:41:33.765 INFO:tasks.ceph:Setting crush tunables to default 2024-09-17T05:41:33.766 DEBUG:teuthology.orchestra.run.smithi150:> sudo ceph --cluster ceph osd crush tunables default 2024-09-17T05:41:33.878 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:33.876+0000 7f0e85958640 1 -- 172.21.15.150:0/4096660471 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0e800d0730 msgr2=0x7f0e800b6160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:41:33.878 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:33.876+0000 7f0e85958640 1 --2- 172.21.15.150:0/4096660471 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0e800d0730 0x7f0e800b6160 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f0e78009ca0 tx=0x7f0e7802aac0 comp rx=0 tx=0).stop 2024-09-17T05:41:33.879 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:33.876+0000 7f0e85958640 1 -- 172.21.15.150:0/4096660471 shutdown_connections 2024-09-17T05:41:33.879 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:33.876+0000 7f0e85958640 1 --2- 172.21.15.150:0/4096660471 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0e800d0730 0x7f0e800b6160 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:41:33.879 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:33.876+0000 7f0e85958640 1 --2- 172.21.15.150:0/4096660471 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0e800d5150 0x7f0e800b9b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:41:33.879 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:33.876+0000 7f0e85958640 1 -- 172.21.15.150:0/4096660471 >> 172.21.15.150:0/4096660471 conn(0x7f0e8008bfe0 msgr2=0x7f0e800d46e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:41:33.879 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:33.876+0000 7f0e85958640 1 -- 172.21.15.150:0/4096660471 shutdown_connections 2024-09-17T05:41:33.879 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:33.876+0000 7f0e85958640 1 -- 172.21.15.150:0/4096660471 wait complete. 2024-09-17T05:41:33.879 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:33.878+0000 7f0e85958640 1 Processor -- start 2024-09-17T05:41:33.880 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:33.878+0000 7f0e85958640 1 -- start start 2024-09-17T05:41:33.883 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:33.880+0000 7f0e85958640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0e8006dea0 0x7f0e8015fcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:41:33.883 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:33.880+0000 7f0e85958640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0e800d0730 0x7f0e8015cfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:41:33.883 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:33.880+0000 7f0e85958640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0e800d5150 0x7f0e800b1fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:41:33.883 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:33.880+0000 7f0e85958640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f0e8006e2b0 con 0x7f0e800d5150 2024-09-17T05:41:33.883 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:33.880+0000 7f0e85958640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f0e800d31e0 con 0x7f0e8006dea0 2024-09-17T05:41:33.883 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:33.880+0000 7f0e85958640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f0e8006e430 con 0x7f0e800d0730 2024-09-17T05:41:33.883 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:33.880+0000 7f0e7f7fe640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0e800d5150 0x7f0e800b1fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:41:33.883 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:33.880+0000 7f0e7f7fe640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0e800d5150 0x7f0e800b1fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:50012/0 (socket says 172.21.15.150:50012) 2024-09-17T05:41:33.883 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:33.880+0000 7f0e7f7fe640 1 -- 172.21.15.150:0/99530947 learned_addr learned my addr 172.21.15.150:0/99530947 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:41:33.884 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:33.880+0000 7f0e7effd640 1 --2- 172.21.15.150:0/99530947 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0e8006dea0 0x7f0e8015fcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:41:33.884 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:33.880+0000 7f0e7e7fc640 1 --2- 172.21.15.150:0/99530947 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0e800d0730 0x7f0e8015cfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:41:33.884 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:33.880+0000 7f0e7f7fe640 1 -- 172.21.15.150:0/99530947 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0e800d0730 msgr2=0x7f0e8015cfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:41:33.884 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:33.880+0000 7f0e7f7fe640 1 --2- 172.21.15.150:0/99530947 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0e800d0730 0x7f0e8015cfc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:41:33.884 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:33.880+0000 7f0e7f7fe640 1 -- 172.21.15.150:0/99530947 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0e8006dea0 msgr2=0x7f0e8015fcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:41:33.884 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:33.880+0000 7f0e7f7fe640 1 --2- 172.21.15.150:0/99530947 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0e8006dea0 0x7f0e8015fcd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:41:33.884 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:33.880+0000 7f0e7f7fe640 1 -- 172.21.15.150:0/99530947 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0e801f6930 con 0x7f0e800d5150 2024-09-17T05:41:33.884 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:33.880+0000 7f0e7f7fe640 1 --2- 172.21.15.150:0/99530947 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0e800d5150 0x7f0e800b1fe0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f0e78006010 tx=0x7f0e78003ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:41:33.884 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:33.880+0000 7f0e77fff640 1 -- 172.21.15.150:0/99530947 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e78044070 con 0x7f0e800d5150 2024-09-17T05:41:33.885 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:33.881+0000 7f0e77fff640 1 -- 172.21.15.150:0/99530947 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0e78004040 con 0x7f0e800d5150 2024-09-17T05:41:33.885 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:33.881+0000 7f0e85958640 1 -- 172.21.15.150:0/99530947 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0e800c8ec0 con 0x7f0e800d5150 2024-09-17T05:41:33.885 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:33.881+0000 7f0e77fff640 1 -- 172.21.15.150:0/99530947 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e78004430 con 0x7f0e800d5150 2024-09-17T05:41:33.885 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:33.881+0000 7f0e85958640 1 -- 172.21.15.150:0/99530947 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0e800c83e0 con 0x7f0e800d5150 2024-09-17T05:41:33.885 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:33.881+0000 7f0e77fff640 1 -- 172.21.15.150:0/99530947 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f0e780045d0 con 0x7f0e800d5150 2024-09-17T05:41:33.885 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:33.881+0000 7f0e77fff640 1 -- 172.21.15.150:0/99530947 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f0e7803fd90 con 0x7f0e800d5150 2024-09-17T05:41:33.885 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:33.881+0000 7f0e85958640 1 -- 172.21.15.150:0/99530947 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0e801f66a0 con 0x7f0e800d5150 2024-09-17T05:41:33.885 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:33.884+0000 7f0e77fff640 1 -- 172.21.15.150:0/99530947 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7f0e7804d070 con 0x7f0e800d5150 2024-09-17T05:41:33.980 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:33.978+0000 7f0e85958640 1 -- 172.21.15.150:0/99530947 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) -- 0x7f0e800b6810 con 0x7f0e800d5150 2024-09-17T05:41:33.981 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:33.980+0000 7f0e77fff640 1 -- 172.21.15.150:0/99530947 <== mon.0 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) ==== 124+0+0 (secure 0 0 0) 0x7f0e78032030 con 0x7f0e800d5150 2024-09-17T05:41:33.981 INFO:teuthology.orchestra.run.smithi150.stderr:adjusted tunables profile to default 2024-09-17T05:41:33.982 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:33.981+0000 7f0e85958640 1 -- 172.21.15.150:0/99530947 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0e800d5150 msgr2=0x7f0e800b1fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:41:33.983 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:33.981+0000 7f0e85958640 1 --2- 172.21.15.150:0/99530947 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0e800d5150 0x7f0e800b1fe0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f0e78006010 tx=0x7f0e78003ce0 comp rx=0 tx=0).stop 2024-09-17T05:41:33.983 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:33.981+0000 7f0e85958640 1 -- 172.21.15.150:0/99530947 shutdown_connections 2024-09-17T05:41:33.983 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:33.981+0000 7f0e85958640 1 --2- 172.21.15.150:0/99530947 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0e800d5150 0x7f0e800b1fe0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:41:33.983 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:33.981+0000 7f0e85958640 1 --2- 172.21.15.150:0/99530947 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0e800d0730 0x7f0e8015cfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:41:33.983 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:33.981+0000 7f0e85958640 1 --2- 172.21.15.150:0/99530947 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0e8006dea0 0x7f0e8015fcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:41:33.983 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:33.981+0000 7f0e85958640 1 -- 172.21.15.150:0/99530947 >> 172.21.15.150:0/99530947 conn(0x7f0e8008bfe0 msgr2=0x7f0e800d0d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:41:33.983 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:33.981+0000 7f0e85958640 1 -- 172.21.15.150:0/99530947 shutdown_connections 2024-09-17T05:41:33.983 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:33.981+0000 7f0e85958640 1 -- 172.21.15.150:0/99530947 wait complete. 2024-09-17T05:41:33.993 INFO:tasks.ceph:check_enable_crimson: False 2024-09-17T05:41:33.993 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2024-09-17T05:41:33.994 DEBUG:teuthology.orchestra.run.smithi150:> set -ex 2024-09-17T05:41:33.994 DEBUG:teuthology.orchestra.run.smithi150:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2024-09-17T05:41:34.019 DEBUG:teuthology.orchestra.run.smithi150:> set -ex 2024-09-17T05:41:34.019 DEBUG:teuthology.orchestra.run.smithi150:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2024-09-17T05:41:34.084 DEBUG:teuthology.orchestra.run.smithi150:> set -ex 2024-09-17T05:41:34.085 DEBUG:teuthology.orchestra.run.smithi150:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2024-09-17T05:41:34.149 DEBUG:teuthology.orchestra.run.smithi150:> set -ex 2024-09-17T05:41:34.150 DEBUG:teuthology.orchestra.run.smithi150:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2024-09-17T05:41:34.216 DEBUG:teuthology.orchestra.run.smithi176:> set -ex 2024-09-17T05:41:34.216 DEBUG:teuthology.orchestra.run.smithi176:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2024-09-17T05:41:34.242 DEBUG:teuthology.orchestra.run.smithi176:> set -ex 2024-09-17T05:41:34.242 DEBUG:teuthology.orchestra.run.smithi176:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2024-09-17T05:41:34.306 DEBUG:teuthology.orchestra.run.smithi176:> set -ex 2024-09-17T05:41:34.307 DEBUG:teuthology.orchestra.run.smithi176:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2024-09-17T05:41:34.373 DEBUG:teuthology.orchestra.run.smithi176:> set -ex 2024-09-17T05:41:34.373 DEBUG:teuthology.orchestra.run.smithi176:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2024-09-17T05:41:34.437 DEBUG:teuthology.orchestra.run.smithi176:> sudo ceph --cluster ceph osd new 4f31c018-c8a4-4d6d-b0c2-a597c47aae4a 0 2024-09-17T05:41:34.592 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T05:41:34.590+0000 7f033d101640 1 -- 172.21.15.176:0/3777182479 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f03380b6300 msgr2=0x7f03380b6710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:41:34.592 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T05:41:34.590+0000 7f033d101640 1 --2- 172.21.15.176:0/3777182479 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f03380b6300 0x7f03380b6710 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f03380cda00 tx=0x7f032802a670 comp rx=0 tx=0).stop 2024-09-17T05:41:34.592 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T05:41:34.590+0000 7f033d101640 1 -- 172.21.15.176:0/3777182479 shutdown_connections 2024-09-17T05:41:34.592 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T05:41:34.590+0000 7f033d101640 1 --2- 172.21.15.176:0/3777182479 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f03380b6300 0x7f03380b6710 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:41:34.592 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T05:41:34.590+0000 7f033d101640 1 -- 172.21.15.176:0/3777182479 >> 172.21.15.176:0/3777182479 conn(0x7f03380b2ff0 msgr2=0x7f03380b3400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:41:34.592 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T05:41:34.590+0000 7f033d101640 1 -- 172.21.15.176:0/3777182479 shutdown_connections 2024-09-17T05:41:34.592 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T05:41:34.590+0000 7f033d101640 1 -- 172.21.15.176:0/3777182479 wait complete. 2024-09-17T05:41:34.594 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T05:41:34.594+0000 7f033d101640 1 Processor -- start 2024-09-17T05:41:34.595 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T05:41:34.594+0000 7f033d101640 1 -- start start 2024-09-17T05:41:34.599 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T05:41:34.596+0000 7f033d101640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f03380b6300 0x7f0338149130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:41:34.599 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T05:41:34.596+0000 7f033d101640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f03380cbcc0 0x7f033814bb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:41:34.599 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T05:41:34.596+0000 7f033d101640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f03380cc7e0 0x7f033806cdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:41:34.599 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T05:41:34.596+0000 7f033d101640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f03380b4f80 con 0x7f03380cc7e0 2024-09-17T05:41:34.599 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T05:41:34.596+0000 7f033d101640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f03380b4e00 con 0x7f03380cbcc0 2024-09-17T05:41:34.599 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T05:41:34.596+0000 7f033d101640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f03380b5100 con 0x7f03380b6300 2024-09-17T05:41:34.600 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T05:41:34.596+0000 7f0336d9d640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f03380b6300 0x7f0338149130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:41:34.600 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T05:41:34.596+0000 7f033659c640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f03380cbcc0 0x7f033814bb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:41:34.600 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T05:41:34.596+0000 7f0336d9d640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f03380b6300 0x7f0338149130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3301/0 says I am v2:172.21.15.176:34890/0 (socket says 172.21.15.176:34890) 2024-09-17T05:41:34.600 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T05:41:34.596+0000 7f033659c640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f03380cbcc0 0x7f033814bb30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3300/0 says I am v2:172.21.15.176:52530/0 (socket says 172.21.15.176:52530) 2024-09-17T05:41:34.600 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T05:41:34.596+0000 7f0336d9d640 1 -- 172.21.15.176:0/3651043239 learned_addr learned my addr 172.21.15.176:0/3651043239 (peer_addr_for_me v2:172.21.15.176:0/0) 2024-09-17T05:41:34.600 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T05:41:34.596+0000 7f033759e640 1 --2- 172.21.15.176:0/3651043239 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f03380cc7e0 0x7f033806cdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:41:34.600 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T05:41:34.596+0000 7f033659c640 1 -- 172.21.15.176:0/3651043239 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f03380b6300 msgr2=0x7f0338149130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:41:34.600 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T05:41:34.596+0000 7f033659c640 1 --2- 172.21.15.176:0/3651043239 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f03380b6300 0x7f0338149130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:41:34.600 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T05:41:34.596+0000 7f033659c640 1 -- 172.21.15.176:0/3651043239 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f03380cc7e0 msgr2=0x7f033806cdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:41:34.600 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T05:41:34.596+0000 7f033659c640 1 --2- 172.21.15.176:0/3651043239 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f03380cc7e0 0x7f033806cdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:41:34.600 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T05:41:34.596+0000 7f033659c640 1 -- 172.21.15.176:0/3651043239 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f033814c820 con 0x7f03380cbcc0 2024-09-17T05:41:34.600 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T05:41:34.596+0000 7f0336d9d640 1 --2- 172.21.15.176:0/3651043239 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f03380b6300 0x7f0338149130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T05:41:34.601 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T05:41:34.597+0000 7f033659c640 1 --2- 172.21.15.176:0/3651043239 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f03380cbcc0 0x7f033814bb30 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f0338074090 tx=0x7f032c00c820 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:41:34.601 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T05:41:34.597+0000 7f031f7fe640 1 -- 172.21.15.176:0/3651043239 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f032c017070 con 0x7f03380cbcc0 2024-09-17T05:41:34.601 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T05:41:34.597+0000 7f031f7fe640 1 -- 172.21.15.176:0/3651043239 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f032c0035f0 con 0x7f03380cbcc0 2024-09-17T05:41:34.601 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T05:41:34.597+0000 7f033d101640 1 -- 172.21.15.176:0/3651043239 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f03381f7340 con 0x7f03380cbcc0 2024-09-17T05:41:34.601 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T05:41:34.597+0000 7f031f7fe640 1 -- 172.21.15.176:0/3651043239 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f032c003a40 con 0x7f03380cbcc0 2024-09-17T05:41:34.601 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T05:41:34.597+0000 7f033d101640 1 -- 172.21.15.176:0/3651043239 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f033815c640 con 0x7f03380cbcc0 2024-09-17T05:41:34.601 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T05:41:34.597+0000 7f031f7fe640 1 -- 172.21.15.176:0/3651043239 <== mon.1 v2:172.21.15.176:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f032c01a070 con 0x7f03380cbcc0 2024-09-17T05:41:34.601 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T05:41:34.597+0000 7f031f7fe640 1 -- 172.21.15.176:0/3651043239 <== mon.1 v2:172.21.15.176:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 725+0+0 (secure 0 0 0) 0x7f032c012400 con 0x7f03380cbcc0 2024-09-17T05:41:34.601 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T05:41:34.598+0000 7f033d101640 1 -- 172.21.15.176:0/3651043239 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f033814c590 con 0x7f03380cbcc0 2024-09-17T05:41:34.602 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T05:41:34.602+0000 7f031f7fe640 1 -- 172.21.15.176:0/3651043239 <== mon.1 v2:172.21.15.176:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7f032c021070 con 0x7f03380cbcc0 2024-09-17T05:41:34.672 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T05:41:34.671+0000 7f033d101640 1 -- 172.21.15.176:0/3651043239 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_command({"prefix": "osd new", "uuid": "4f31c018-c8a4-4d6d-b0c2-a597c47aae4a", "id": 0} v 0) -- 0x7f03380b5610 con 0x7f03380cbcc0 2024-09-17T05:41:34.676 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T05:41:34.675+0000 7f031f7fe640 1 -- 172.21.15.176:0/3651043239 <== mon.1 v2:172.21.15.176:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "4f31c018-c8a4-4d6d-b0c2-a597c47aae4a", "id": 0}]=0 v3) ==== 112+0+2 (secure 0 0 0) 0x7f032c003cb0 con 0x7f03380cbcc0 2024-09-17T05:41:34.677 INFO:teuthology.orchestra.run.smithi176.stdout:0 2024-09-17T05:41:34.678 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T05:41:34.676+0000 7f033d101640 1 -- 172.21.15.176:0/3651043239 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f03380cbcc0 msgr2=0x7f033814bb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:41:34.678 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T05:41:34.676+0000 7f033d101640 1 --2- 172.21.15.176:0/3651043239 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f03380cbcc0 0x7f033814bb30 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f0338074090 tx=0x7f032c00c820 comp rx=0 tx=0).stop 2024-09-17T05:41:34.678 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T05:41:34.676+0000 7f033d101640 1 -- 172.21.15.176:0/3651043239 shutdown_connections 2024-09-17T05:41:34.678 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T05:41:34.676+0000 7f033d101640 1 --2- 172.21.15.176:0/3651043239 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f03380cbcc0 0x7f033814bb30 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:41:34.678 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T05:41:34.676+0000 7f033d101640 1 --2- 172.21.15.176:0/3651043239 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f03380cc7e0 0x7f033806cdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:41:34.678 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T05:41:34.676+0000 7f033d101640 1 --2- 172.21.15.176:0/3651043239 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f03380b6300 0x7f0338149130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:41:34.678 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T05:41:34.676+0000 7f033d101640 1 -- 172.21.15.176:0/3651043239 >> 172.21.15.176:0/3651043239 conn(0x7f03380b2ff0 msgr2=0x7f033809b3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:41:34.678 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T05:41:34.676+0000 7f033d101640 1 -- 172.21.15.176:0/3651043239 shutdown_connections 2024-09-17T05:41:34.678 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T05:41:34.676+0000 7f033d101640 1 -- 172.21.15.176:0/3651043239 wait complete. 2024-09-17T05:41:34.688 DEBUG:teuthology.orchestra.run.smithi176:> sudo ceph --cluster ceph osd new 6ff4a573-500b-4e04-9de3-39265ead78b1 1 2024-09-17T05:41:34.802 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T05:41:34.800+0000 7faec48de640 1 -- 172.21.15.176:0/3652691466 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7faec015d3f0 msgr2=0x7faec006ddb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:41:34.802 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T05:41:34.800+0000 7faec48de640 1 --2- 172.21.15.176:0/3652691466 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7faec015d3f0 0x7faec006ddb0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7faeb8005fd0 tx=0x7faeb802a820 comp rx=0 tx=0).stop 2024-09-17T05:41:34.802 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T05:41:34.800+0000 7faec48de640 1 -- 172.21.15.176:0/3652691466 shutdown_connections 2024-09-17T05:41:34.802 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T05:41:34.800+0000 7faec48de640 1 --2- 172.21.15.176:0/3652691466 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7faec015d3f0 0x7faec006ddb0 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:41:34.802 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T05:41:34.800+0000 7faec48de640 1 --2- 172.21.15.176:0/3652691466 >> v2:172.21.15.150:3300/0 conn(0x7faec00cd380 0x7faec015ceb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:41:34.802 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T05:41:34.800+0000 7faec48de640 1 -- 172.21.15.176:0/3652691466 >> 172.21.15.176:0/3652691466 conn(0x7faec0073890 msgr2=0x7faec0073ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:41:34.802 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T05:41:34.800+0000 7faec48de640 1 -- 172.21.15.176:0/3652691466 shutdown_connections 2024-09-17T05:41:34.802 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T05:41:34.800+0000 7faec48de640 1 -- 172.21.15.176:0/3652691466 wait complete. 2024-09-17T05:41:34.803 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T05:41:34.802+0000 7faec48de640 1 Processor -- start 2024-09-17T05:41:34.804 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T05:41:34.802+0000 7faec48de640 1 -- start start 2024-09-17T05:41:34.809 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T05:41:34.803+0000 7faec48de640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7faec00cd380 0x7faec0158f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:41:34.809 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T05:41:34.804+0000 7faec48de640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7faec015c820 0x7faec00b5690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:41:34.809 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T05:41:34.804+0000 7faec48de640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7faec015d3f0 0x7faec01421f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:41:34.810 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T05:41:34.804+0000 7faec48de640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7faec00cf8e0 con 0x7faec015c820 2024-09-17T05:41:34.810 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T05:41:34.804+0000 7faec48de640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7faec00cf760 con 0x7faec015d3f0 2024-09-17T05:41:34.810 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T05:41:34.804+0000 7faec48de640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7faec00cfa60 con 0x7faec00cd380 2024-09-17T05:41:34.810 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T05:41:34.804+0000 7faebe59c640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7faec00cd380 0x7faec0158f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:41:34.810 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T05:41:34.804+0000 7faebe59c640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7faec00cd380 0x7faec0158f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3301/0 says I am v2:172.21.15.176:34898/0 (socket says 172.21.15.176:34898) 2024-09-17T05:41:34.810 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T05:41:34.804+0000 7faebe59c640 1 -- 172.21.15.176:0/50588213 learned_addr learned my addr 172.21.15.176:0/50588213 (peer_addr_for_me v2:172.21.15.176:0/0) 2024-09-17T05:41:34.810 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T05:41:34.804+0000 7faebed9d640 1 --2- 172.21.15.176:0/50588213 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7faec015d3f0 0x7faec01421f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:41:34.810 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T05:41:34.804+0000 7faebdd9b640 1 --2- 172.21.15.176:0/50588213 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7faec015c820 0x7faec00b5690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:41:34.810 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T05:41:34.804+0000 7faebe59c640 1 -- 172.21.15.176:0/50588213 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7faec015d3f0 msgr2=0x7faec01421f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:41:34.811 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T05:41:34.804+0000 7faebe59c640 1 --2- 172.21.15.176:0/50588213 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7faec015d3f0 0x7faec01421f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:41:34.811 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T05:41:34.804+0000 7faebe59c640 1 -- 172.21.15.176:0/50588213 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7faec015c820 msgr2=0x7faec00b5690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:41:34.811 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T05:41:34.804+0000 7faebe59c640 1 --2- 172.21.15.176:0/50588213 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7faec015c820 0x7faec00b5690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:41:34.811 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T05:41:34.804+0000 7faebe59c640 1 -- 172.21.15.176:0/50588213 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faec01575d0 con 0x7faec00cd380 2024-09-17T05:41:34.811 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T05:41:34.804+0000 7faebed9d640 1 --2- 172.21.15.176:0/50588213 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7faec015d3f0 0x7faec01421f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T05:41:34.811 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T05:41:34.804+0000 7faebe59c640 1 --2- 172.21.15.176:0/50588213 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7faec00cd380 0x7faec0158f80 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7faeb000c430 tx=0x7faeb000c8f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:41:34.811 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T05:41:34.804+0000 7faeaeffd640 1 -- 172.21.15.176:0/50588213 <== mon.2 v2:172.21.15.176:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faeb0011790 con 0x7faec00cd380 2024-09-17T05:41:34.811 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T05:41:34.804+0000 7faeaeffd640 1 -- 172.21.15.176:0/50588213 <== mon.2 v2:172.21.15.176:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7faeb0017070 con 0x7faec00cd380 2024-09-17T05:41:34.811 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T05:41:34.804+0000 7faec48de640 1 -- 172.21.15.176:0/50588213 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faec01578b0 con 0x7faec00cd380 2024-09-17T05:41:34.811 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T05:41:34.804+0000 7faeaeffd640 1 -- 172.21.15.176:0/50588213 <== mon.2 v2:172.21.15.176:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faeb0011ce0 con 0x7faec00cd380 2024-09-17T05:41:34.811 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T05:41:34.804+0000 7faec48de640 1 -- 172.21.15.176:0/50588213 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7faec0157e70 con 0x7faec00cd380 2024-09-17T05:41:34.812 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T05:41:34.805+0000 7faeaeffd640 1 -- 172.21.15.176:0/50588213 <== mon.2 v2:172.21.15.176:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7faeb001c460 con 0x7faec00cd380 2024-09-17T05:41:34.812 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T05:41:34.805+0000 7faeaeffd640 1 -- 172.21.15.176:0/50588213 <== mon.2 v2:172.21.15.176:3301/0 5 ==== osd_map(3..3 src has 1..3) ==== 840+0+0 (secure 0 0 0) 0x7faeb0012820 con 0x7faec00cd380 2024-09-17T05:41:34.812 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T05:41:34.805+0000 7faec48de640 1 -- 172.21.15.176:0/50588213 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faec00cff80 con 0x7faec00cd380 2024-09-17T05:41:34.812 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T05:41:34.807+0000 7faeaeffd640 1 -- 172.21.15.176:0/50588213 <== mon.2 v2:172.21.15.176:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7faeb0012a70 con 0x7faec00cd380 2024-09-17T05:41:34.881 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T05:41:34.878+0000 7faec48de640 1 -- 172.21.15.176:0/50588213 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_command({"prefix": "osd new", "uuid": "6ff4a573-500b-4e04-9de3-39265ead78b1", "id": 1} v 0) -- 0x7faec014eeb0 con 0x7faec00cd380 2024-09-17T05:41:34.883 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T05:41:34.882+0000 7faeaeffd640 1 -- 172.21.15.176:0/50588213 <== mon.2 v2:172.21.15.176:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "6ff4a573-500b-4e04-9de3-39265ead78b1", "id": 1}]=0 v4) ==== 112+0+2 (secure 0 0 0) 0x7faeb0012c50 con 0x7faec00cd380 2024-09-17T05:41:34.883 INFO:teuthology.orchestra.run.smithi176.stdout:1 2024-09-17T05:41:34.884 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T05:41:34.883+0000 7faec48de640 1 -- 172.21.15.176:0/50588213 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7faec00cd380 msgr2=0x7faec0158f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:41:34.884 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T05:41:34.883+0000 7faec48de640 1 --2- 172.21.15.176:0/50588213 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7faec00cd380 0x7faec0158f80 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7faeb000c430 tx=0x7faeb000c8f0 comp rx=0 tx=0).stop 2024-09-17T05:41:34.884 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T05:41:34.883+0000 7faec48de640 1 -- 172.21.15.176:0/50588213 shutdown_connections 2024-09-17T05:41:34.885 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T05:41:34.883+0000 7faec48de640 1 --2- 172.21.15.176:0/50588213 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7faec015d3f0 0x7faec01421f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:41:34.885 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T05:41:34.883+0000 7faec48de640 1 --2- 172.21.15.176:0/50588213 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7faec015c820 0x7faec00b5690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:41:34.885 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T05:41:34.883+0000 7faec48de640 1 --2- 172.21.15.176:0/50588213 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7faec00cd380 0x7faec0158f80 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:41:34.885 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T05:41:34.883+0000 7faec48de640 1 -- 172.21.15.176:0/50588213 >> 172.21.15.176:0/50588213 conn(0x7faec0073890 msgr2=0x7faec00b20f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:41:34.885 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T05:41:34.883+0000 7faec48de640 1 -- 172.21.15.176:0/50588213 shutdown_connections 2024-09-17T05:41:34.885 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T05:41:34.883+0000 7faec48de640 1 -- 172.21.15.176:0/50588213 wait complete. 2024-09-17T05:41:34.895 DEBUG:teuthology.orchestra.run.smithi176:> sudo ceph --cluster ceph osd new bffea6f9-2465-4182-b205-00436c41ac1c 2 2024-09-17T05:41:35.009 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T05:41:35.007+0000 7f2fb121d640 1 -- 172.21.15.176:0/3884078974 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2fac0d0f00 msgr2=0x7f2fac0cd010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:41:35.009 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T05:41:35.007+0000 7f2fb121d640 1 --2- 172.21.15.176:0/3884078974 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2fac0d0f00 0x7f2fac0cd010 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f2fac0b1c20 tx=0x7f2fa402aa30 comp rx=0 tx=0).stop 2024-09-17T05:41:35.009 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T05:41:35.007+0000 7f2fb121d640 1 -- 172.21.15.176:0/3884078974 shutdown_connections 2024-09-17T05:41:35.009 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T05:41:35.007+0000 7f2fb121d640 1 --2- 172.21.15.176:0/3884078974 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2fac0d0f00 0x7f2fac0cd010 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:41:35.009 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T05:41:35.007+0000 7f2fb121d640 1 --2- 172.21.15.176:0/3884078974 >> v2:172.21.15.150:3300/0 conn(0x7f2fac0af5e0 0x7f2fac0d09c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:41:35.009 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T05:41:35.007+0000 7f2fb121d640 1 -- 172.21.15.176:0/3884078974 >> 172.21.15.176:0/3884078974 conn(0x7f2fac0cef80 msgr2=0x7f2fac0cf390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:41:35.009 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T05:41:35.007+0000 7f2fb121d640 1 -- 172.21.15.176:0/3884078974 shutdown_connections 2024-09-17T05:41:35.009 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T05:41:35.007+0000 7f2fb121d640 1 -- 172.21.15.176:0/3884078974 wait complete. 2024-09-17T05:41:35.010 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T05:41:35.009+0000 7f2fb121d640 1 Processor -- start 2024-09-17T05:41:35.010 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T05:41:35.009+0000 7f2fb121d640 1 -- start start 2024-09-17T05:41:35.012 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T05:41:35.010+0000 7f2fb121d640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2fac0af1d0 0x7f2fac14a030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:41:35.013 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T05:41:35.010+0000 7f2fb121d640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2fac0af5e0 0x7f2fac15d5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:41:35.013 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T05:41:35.010+0000 7f2fb121d640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2fac0d0f00 0x7f2fac15a300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:41:35.013 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T05:41:35.010+0000 7f2fb121d640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f2fac0d1490 con 0x7f2fac0af5e0 2024-09-17T05:41:35.013 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T05:41:35.010+0000 7f2fb121d640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f2fac0d1310 con 0x7f2fac0d0f00 2024-09-17T05:41:35.013 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T05:41:35.010+0000 7f2fb121d640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f2fac0b1860 con 0x7f2fac0af1d0 2024-09-17T05:41:35.013 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T05:41:35.010+0000 7f2fab59e640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2fac0d0f00 0x7f2fac15a300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:41:35.013 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T05:41:35.010+0000 7f2faad9d640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2fac0af1d0 0x7f2fac14a030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:41:35.013 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T05:41:35.010+0000 7f2fab59e640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2fac0d0f00 0x7f2fac15a300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3300/0 says I am v2:172.21.15.176:52548/0 (socket says 172.21.15.176:52548) 2024-09-17T05:41:35.013 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T05:41:35.010+0000 7f2faad9d640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2fac0af1d0 0x7f2fac14a030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3301/0 says I am v2:172.21.15.176:34902/0 (socket says 172.21.15.176:34902) 2024-09-17T05:41:35.013 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T05:41:35.010+0000 7f2fab59e640 1 -- 172.21.15.176:0/2728100811 learned_addr learned my addr 172.21.15.176:0/2728100811 (peer_addr_for_me v2:172.21.15.176:0/0) 2024-09-17T05:41:35.013 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T05:41:35.010+0000 7f2faa59c640 1 --2- 172.21.15.176:0/2728100811 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2fac0af5e0 0x7f2fac15d5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:41:35.014 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T05:41:35.011+0000 7f2fab59e640 1 -- 172.21.15.176:0/2728100811 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2fac0af1d0 msgr2=0x7f2fac14a030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:41:35.014 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T05:41:35.011+0000 7f2fab59e640 1 --2- 172.21.15.176:0/2728100811 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2fac0af1d0 0x7f2fac14a030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:41:35.014 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T05:41:35.011+0000 7f2fab59e640 1 -- 172.21.15.176:0/2728100811 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2fac0af5e0 msgr2=0x7f2fac15d5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:41:35.014 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T05:41:35.011+0000 7f2fab59e640 1 --2- 172.21.15.176:0/2728100811 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2fac0af5e0 0x7f2fac15d5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:41:35.014 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T05:41:35.011+0000 7f2fab59e640 1 -- 172.21.15.176:0/2728100811 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2fac15e210 con 0x7f2fac0d0f00 2024-09-17T05:41:35.014 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T05:41:35.011+0000 7f2faad9d640 1 --2- 172.21.15.176:0/2728100811 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2fac0af1d0 0x7f2fac14a030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T05:41:35.014 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T05:41:35.011+0000 7f2fab59e640 1 --2- 172.21.15.176:0/2728100811 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2fac0d0f00 0x7f2fac15a300 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f2fa4009d60 tx=0x7f2fa4003f10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:41:35.014 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T05:41:35.011+0000 7f2f937fe640 1 -- 172.21.15.176:0/2728100811 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2fa4033050 con 0x7f2fac0d0f00 2024-09-17T05:41:35.014 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T05:41:35.011+0000 7f2f937fe640 1 -- 172.21.15.176:0/2728100811 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f2fa4004450 con 0x7f2fac0d0f00 2024-09-17T05:41:35.015 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T05:41:35.011+0000 7f2f937fe640 1 -- 172.21.15.176:0/2728100811 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2fa4004860 con 0x7f2fac0d0f00 2024-09-17T05:41:35.015 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T05:41:35.011+0000 7f2fb121d640 1 -- 172.21.15.176:0/2728100811 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2fac14c9e0 con 0x7f2fac0d0f00 2024-09-17T05:41:35.015 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T05:41:35.011+0000 7f2fb121d640 1 -- 172.21.15.176:0/2728100811 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2fac15db00 con 0x7f2fac0d0f00 2024-09-17T05:41:35.015 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T05:41:35.011+0000 7f2f937fe640 1 -- 172.21.15.176:0/2728100811 <== mon.1 v2:172.21.15.176:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f2fa4036070 con 0x7f2fac0d0f00 2024-09-17T05:41:35.015 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T05:41:35.011+0000 7f2f937fe640 1 -- 172.21.15.176:0/2728100811 <== mon.1 v2:172.21.15.176:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 955+0+0 (secure 0 0 0) 0x7f2fa4042860 con 0x7f2fac0d0f00 2024-09-17T05:41:35.015 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T05:41:35.012+0000 7f2fb121d640 1 -- 172.21.15.176:0/2728100811 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2fac15dd30 con 0x7f2fac0d0f00 2024-09-17T05:41:35.016 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T05:41:35.014+0000 7f2f937fe640 1 -- 172.21.15.176:0/2728100811 <== mon.1 v2:172.21.15.176:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7f2fa4062860 con 0x7f2fac0d0f00 2024-09-17T05:41:35.085 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T05:41:35.084+0000 7f2fb121d640 1 -- 172.21.15.176:0/2728100811 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_command({"prefix": "osd new", "uuid": "bffea6f9-2465-4182-b205-00436c41ac1c", "id": 2} v 0) -- 0x7f2fac0d09c0 con 0x7f2fac0d0f00 2024-09-17T05:41:35.089 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T05:41:35.088+0000 7f2f937fe640 1 -- 172.21.15.176:0/2728100811 <== mon.1 v2:172.21.15.176:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "bffea6f9-2465-4182-b205-00436c41ac1c", "id": 2}]=0 v5) ==== 112+0+2 (secure 0 0 0) 0x7f2fa4050030 con 0x7f2fac0d0f00 2024-09-17T05:41:35.089 INFO:teuthology.orchestra.run.smithi176.stdout:2 2024-09-17T05:41:35.090 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T05:41:35.089+0000 7f2fb121d640 1 -- 172.21.15.176:0/2728100811 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2fac0d0f00 msgr2=0x7f2fac15a300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:41:35.090 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T05:41:35.089+0000 7f2fb121d640 1 --2- 172.21.15.176:0/2728100811 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2fac0d0f00 0x7f2fac15a300 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f2fa4009d60 tx=0x7f2fa4003f10 comp rx=0 tx=0).stop 2024-09-17T05:41:35.090 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T05:41:35.089+0000 7f2fb121d640 1 -- 172.21.15.176:0/2728100811 shutdown_connections 2024-09-17T05:41:35.090 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T05:41:35.089+0000 7f2fb121d640 1 --2- 172.21.15.176:0/2728100811 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2fac0d0f00 0x7f2fac15a300 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:41:35.091 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T05:41:35.089+0000 7f2fb121d640 1 --2- 172.21.15.176:0/2728100811 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2fac0af5e0 0x7f2fac15d5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:41:35.091 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T05:41:35.089+0000 7f2fb121d640 1 --2- 172.21.15.176:0/2728100811 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2fac0af1d0 0x7f2fac14a030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:41:35.091 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T05:41:35.089+0000 7f2fb121d640 1 -- 172.21.15.176:0/2728100811 >> 172.21.15.176:0/2728100811 conn(0x7f2fac0cef80 msgr2=0x7f2fac15cd80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:41:35.091 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T05:41:35.089+0000 7f2fb121d640 1 -- 172.21.15.176:0/2728100811 shutdown_connections 2024-09-17T05:41:35.091 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T05:41:35.089+0000 7f2fb121d640 1 -- 172.21.15.176:0/2728100811 wait complete. 2024-09-17T05:41:35.101 DEBUG:teuthology.orchestra.run.smithi176:> sudo ceph --cluster ceph osd new cda70430-d1e1-427e-b04e-56db4031d078 3 2024-09-17T05:41:35.214 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T05:41:35.212+0000 7f5b3fb7b640 1 -- 172.21.15.176:0/2842249997 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5b380b6300 msgr2=0x7f5b380b6710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:41:35.214 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T05:41:35.212+0000 7f5b3fb7b640 1 --2- 172.21.15.176:0/2842249997 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5b380b6300 0x7f5b380b6710 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f5b34009830 tx=0x7f5b3402a510 comp rx=0 tx=0).stop 2024-09-17T05:41:35.214 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T05:41:35.212+0000 7f5b3fb7b640 1 -- 172.21.15.176:0/2842249997 shutdown_connections 2024-09-17T05:41:35.214 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T05:41:35.212+0000 7f5b3fb7b640 1 --2- 172.21.15.176:0/2842249997 >> v2:172.21.15.150:3300/0 conn(0x7f5b380cc7e0 0x7f5b380b43d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:41:35.214 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T05:41:35.212+0000 7f5b3fb7b640 1 --2- 172.21.15.176:0/2842249997 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5b380b6300 0x7f5b380b6710 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:41:35.214 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T05:41:35.212+0000 7f5b3fb7b640 1 -- 172.21.15.176:0/2842249997 >> 172.21.15.176:0/2842249997 conn(0x7f5b380b2ff0 msgr2=0x7f5b380b3400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:41:35.214 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T05:41:35.213+0000 7f5b3fb7b640 1 -- 172.21.15.176:0/2842249997 shutdown_connections 2024-09-17T05:41:35.214 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T05:41:35.213+0000 7f5b3fb7b640 1 -- 172.21.15.176:0/2842249997 wait complete. 2024-09-17T05:41:35.215 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T05:41:35.214+0000 7f5b3fb7b640 1 Processor -- start 2024-09-17T05:41:35.216 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T05:41:35.214+0000 7f5b3fb7b640 1 -- start start 2024-09-17T05:41:35.218 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T05:41:35.216+0000 7f5b3fb7b640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5b380b6300 0x7f5b3814ce50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:41:35.218 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T05:41:35.216+0000 7f5b3fb7b640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5b380cbcc0 0x7f5b3814adc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:41:35.218 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T05:41:35.216+0000 7f5b3fb7b640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5b380cc7e0 0x7f5b381e84b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:41:35.219 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T05:41:35.216+0000 7f5b3fb7b640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f5b380b4db0 con 0x7f5b380cbcc0 2024-09-17T05:41:35.219 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T05:41:35.216+0000 7f5b3fb7b640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f5b380b4c30 con 0x7f5b380cc7e0 2024-09-17T05:41:35.219 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T05:41:35.216+0000 7f5b3fb7b640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f5b380b4f30 con 0x7f5b380b6300 2024-09-17T05:41:35.219 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T05:41:35.216+0000 7f5b3d917640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5b380b6300 0x7f5b3814ce50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:41:35.219 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T05:41:35.216+0000 7f5b3d917640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5b380b6300 0x7f5b3814ce50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3301/0 says I am v2:172.21.15.176:34932/0 (socket says 172.21.15.176:34932) 2024-09-17T05:41:35.219 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T05:41:35.216+0000 7f5b3d917640 1 -- 172.21.15.176:0/3071671881 learned_addr learned my addr 172.21.15.176:0/3071671881 (peer_addr_for_me v2:172.21.15.176:0/0) 2024-09-17T05:41:35.219 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T05:41:35.216+0000 7f5b3e118640 1 --2- 172.21.15.176:0/3071671881 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5b380cc7e0 0x7f5b381e84b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:41:35.219 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T05:41:35.216+0000 7f5b3d116640 1 --2- 172.21.15.176:0/3071671881 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5b380cbcc0 0x7f5b3814adc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:41:35.219 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T05:41:35.216+0000 7f5b3d917640 1 -- 172.21.15.176:0/3071671881 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5b380cc7e0 msgr2=0x7f5b381e84b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:41:35.219 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T05:41:35.216+0000 7f5b3d917640 1 --2- 172.21.15.176:0/3071671881 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5b380cc7e0 0x7f5b381e84b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:41:35.219 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T05:41:35.216+0000 7f5b3d917640 1 -- 172.21.15.176:0/3071671881 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5b380cbcc0 msgr2=0x7f5b3814adc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:41:35.219 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T05:41:35.216+0000 7f5b3d917640 1 --2- 172.21.15.176:0/3071671881 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5b380cbcc0 0x7f5b3814adc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:41:35.219 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T05:41:35.216+0000 7f5b3d917640 1 -- 172.21.15.176:0/3071671881 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5b381f8eb0 con 0x7f5b380b6300 2024-09-17T05:41:35.220 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T05:41:35.216+0000 7f5b3d917640 1 --2- 172.21.15.176:0/3071671881 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5b380b6300 0x7f5b3814ce50 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f5b34000c00 tx=0x7f5b34033c20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:41:35.220 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T05:41:35.216+0000 7f5b2e7fc640 1 -- 172.21.15.176:0/3071671881 <== mon.2 v2:172.21.15.176:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b34005c90 con 0x7f5b380b6300 2024-09-17T05:41:35.220 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T05:41:35.217+0000 7f5b2e7fc640 1 -- 172.21.15.176:0/3071671881 <== mon.2 v2:172.21.15.176:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f5b34031e50 con 0x7f5b380b6300 2024-09-17T05:41:35.220 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T05:41:35.217+0000 7f5b3fb7b640 1 -- 172.21.15.176:0/3071671881 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5b3814d6a0 con 0x7f5b380b6300 2024-09-17T05:41:35.220 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T05:41:35.217+0000 7f5b2e7fc640 1 -- 172.21.15.176:0/3071671881 <== mon.2 v2:172.21.15.176:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b340332f0 con 0x7f5b380b6300 2024-09-17T05:41:35.220 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T05:41:35.217+0000 7f5b3fb7b640 1 -- 172.21.15.176:0/3071671881 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f5b3814dc60 con 0x7f5b380b6300 2024-09-17T05:41:35.220 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T05:41:35.217+0000 7f5b2e7fc640 1 -- 172.21.15.176:0/3071671881 <== mon.2 v2:172.21.15.176:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f5b34033490 con 0x7f5b380b6300 2024-09-17T05:41:35.220 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T05:41:35.217+0000 7f5b2e7fc640 1 -- 172.21.15.176:0/3071671881 <== mon.2 v2:172.21.15.176:3301/0 5 ==== osd_map(5..5 src has 1..5) ==== 1070+0+0 (secure 0 0 0) 0x7f5b34003be0 con 0x7f5b380b6300 2024-09-17T05:41:35.221 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T05:41:35.218+0000 7f5b3fb7b640 1 -- 172.21.15.176:0/3071671881 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5b380b53e0 con 0x7f5b380b6300 2024-09-17T05:41:35.221 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T05:41:35.220+0000 7f5b2e7fc640 1 -- 172.21.15.176:0/3071671881 <== mon.2 v2:172.21.15.176:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7f5b3403f030 con 0x7f5b380b6300 2024-09-17T05:41:35.290 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T05:41:35.289+0000 7f5b3fb7b640 1 -- 172.21.15.176:0/3071671881 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_command({"prefix": "osd new", "uuid": "cda70430-d1e1-427e-b04e-56db4031d078", "id": 3} v 0) -- 0x7f5b380c4af0 con 0x7f5b380b6300 2024-09-17T05:41:35.294 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T05:41:35.293+0000 7f5b2e7fc640 1 -- 172.21.15.176:0/3071671881 <== mon.2 v2:172.21.15.176:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "cda70430-d1e1-427e-b04e-56db4031d078", "id": 3}]=0 v6) ==== 112+0+2 (secure 0 0 0) 0x7f5b340035f0 con 0x7f5b380b6300 2024-09-17T05:41:35.294 INFO:teuthology.orchestra.run.smithi176.stdout:3 2024-09-17T05:41:35.295 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T05:41:35.294+0000 7f5b3fb7b640 1 -- 172.21.15.176:0/3071671881 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5b380b6300 msgr2=0x7f5b3814ce50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:41:35.295 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T05:41:35.294+0000 7f5b3fb7b640 1 --2- 172.21.15.176:0/3071671881 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5b380b6300 0x7f5b3814ce50 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f5b34000c00 tx=0x7f5b34033c20 comp rx=0 tx=0).stop 2024-09-17T05:41:35.296 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T05:41:35.294+0000 7f5b3fb7b640 1 -- 172.21.15.176:0/3071671881 shutdown_connections 2024-09-17T05:41:35.296 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T05:41:35.294+0000 7f5b3fb7b640 1 --2- 172.21.15.176:0/3071671881 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5b380cc7e0 0x7f5b381e84b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:41:35.296 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T05:41:35.294+0000 7f5b3fb7b640 1 --2- 172.21.15.176:0/3071671881 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5b380cbcc0 0x7f5b3814adc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:41:35.296 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T05:41:35.294+0000 7f5b3fb7b640 1 --2- 172.21.15.176:0/3071671881 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5b380b6300 0x7f5b3814ce50 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:41:35.296 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T05:41:35.294+0000 7f5b3fb7b640 1 -- 172.21.15.176:0/3071671881 >> 172.21.15.176:0/3071671881 conn(0x7f5b380b2ff0 msgr2=0x7f5b3809c240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:41:35.296 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T05:41:35.294+0000 7f5b3fb7b640 1 -- 172.21.15.176:0/3071671881 shutdown_connections 2024-09-17T05:41:35.296 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T05:41:35.294+0000 7f5b3fb7b640 1 -- 172.21.15.176:0/3071671881 wait complete. 2024-09-17T05:41:35.305 DEBUG:teuthology.orchestra.run.smithi176:> sudo ceph --cluster ceph osd new 3a0277fb-5e1e-4f68-bb2d-9a8a0152f64a 4 2024-09-17T05:41:35.420 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T05:41:35.418+0000 7f666da07640 1 -- 172.21.15.176:0/2195526522 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f66680b9d80 msgr2=0x7f666806f000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:41:35.420 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T05:41:35.418+0000 7f666da07640 1 --2- 172.21.15.176:0/2195526522 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f66680b9d80 0x7f666806f000 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f666808e6b0 tx=0x7f665002a4a0 comp rx=0 tx=0).stop 2024-09-17T05:41:35.420 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T05:41:35.419+0000 7f666da07640 1 -- 172.21.15.176:0/2195526522 shutdown_connections 2024-09-17T05:41:35.420 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T05:41:35.419+0000 7f666da07640 1 --2- 172.21.15.176:0/2195526522 >> v2:172.21.15.150:3300/0 conn(0x7f6668162160 0x7f666806f540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:41:35.420 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T05:41:35.419+0000 7f666da07640 1 --2- 172.21.15.176:0/2195526522 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f66680b9d80 0x7f666806f000 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:41:35.421 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T05:41:35.419+0000 7f666da07640 1 -- 172.21.15.176:0/2195526522 >> 172.21.15.176:0/2195526522 conn(0x7f66680d46c0 msgr2=0x7f66680d4ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:41:35.421 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T05:41:35.419+0000 7f666da07640 1 -- 172.21.15.176:0/2195526522 shutdown_connections 2024-09-17T05:41:35.421 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T05:41:35.419+0000 7f666da07640 1 -- 172.21.15.176:0/2195526522 wait complete. 2024-09-17T05:41:35.421 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T05:41:35.420+0000 7f666da07640 1 Processor -- start 2024-09-17T05:41:35.421 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T05:41:35.421+0000 7f666da07640 1 -- start start 2024-09-17T05:41:35.424 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T05:41:35.422+0000 7f666da07640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f66680b9d80 0x7f66680a1e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:41:35.424 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T05:41:35.422+0000 7f666da07640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6668162160 0x7f6668153b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:41:35.424 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T05:41:35.422+0000 7f666da07640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f66681f53f0 0x7f66680b61e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:41:35.424 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T05:41:35.422+0000 7f666da07640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f66680b8c00 con 0x7f66681f53f0 2024-09-17T05:41:35.425 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T05:41:35.422+0000 7f666da07640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f66680b8a80 con 0x7f66680b9d80 2024-09-17T05:41:35.425 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T05:41:35.422+0000 7f666da07640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f66680b8d80 con 0x7f6668162160 2024-09-17T05:41:35.425 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T05:41:35.422+0000 7f6666ffd640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f66680b9d80 0x7f66680a1e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:41:35.425 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T05:41:35.422+0000 7f6666ffd640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f66680b9d80 0x7f66680a1e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3300/0 says I am v2:172.21.15.176:52576/0 (socket says 172.21.15.176:52576) 2024-09-17T05:41:35.425 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T05:41:35.422+0000 7f6666ffd640 1 -- 172.21.15.176:0/3290675241 learned_addr learned my addr 172.21.15.176:0/3290675241 (peer_addr_for_me v2:172.21.15.176:0/0) 2024-09-17T05:41:35.425 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T05:41:35.422+0000 7f66667fc640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6668162160 0x7f6668153b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:41:35.425 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T05:41:35.422+0000 7f66677fe640 1 --2- 172.21.15.176:0/3290675241 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f66681f53f0 0x7f66680b61e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:41:35.425 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T05:41:35.422+0000 7f6666ffd640 1 -- 172.21.15.176:0/3290675241 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6668162160 msgr2=0x7f6668153b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:41:35.425 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T05:41:35.422+0000 7f6666ffd640 1 --2- 172.21.15.176:0/3290675241 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6668162160 0x7f6668153b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:41:35.425 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T05:41:35.422+0000 7f6666ffd640 1 -- 172.21.15.176:0/3290675241 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f66681f53f0 msgr2=0x7f66680b61e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:41:35.425 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T05:41:35.422+0000 7f6666ffd640 1 --2- 172.21.15.176:0/3290675241 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f66681f53f0 0x7f66680b61e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:41:35.425 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T05:41:35.422+0000 7f6666ffd640 1 -- 172.21.15.176:0/3290675241 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f66681f5b40 con 0x7f66680b9d80 2024-09-17T05:41:35.425 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T05:41:35.422+0000 7f6666ffd640 1 --2- 172.21.15.176:0/3290675241 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f66680b9d80 0x7f66680a1e70 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f665800c3c0 tx=0x7f6658001e70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:41:35.426 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T05:41:35.423+0000 7f665ffff640 1 -- 172.21.15.176:0/3290675241 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6658017070 con 0x7f66680b9d80 2024-09-17T05:41:35.426 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T05:41:35.423+0000 7f665ffff640 1 -- 172.21.15.176:0/3290675241 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f66580035f0 con 0x7f66680b9d80 2024-09-17T05:41:35.426 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T05:41:35.423+0000 7f666da07640 1 -- 172.21.15.176:0/3290675241 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f66681f5e20 con 0x7f66680b9d80 2024-09-17T05:41:35.426 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T05:41:35.423+0000 7f665ffff640 1 -- 172.21.15.176:0/3290675241 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6658003ac0 con 0x7f66680b9d80 2024-09-17T05:41:35.426 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T05:41:35.423+0000 7f666da07640 1 -- 172.21.15.176:0/3290675241 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f666809e5c0 con 0x7f66680b9d80 2024-09-17T05:41:35.426 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T05:41:35.423+0000 7f665ffff640 1 -- 172.21.15.176:0/3290675241 <== mon.1 v2:172.21.15.176:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f665801a070 con 0x7f66680b9d80 2024-09-17T05:41:35.426 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T05:41:35.423+0000 7f665ffff640 1 -- 172.21.15.176:0/3290675241 <== mon.1 v2:172.21.15.176:3300/0 5 ==== osd_map(6..6 src has 1..6) ==== 1185+0+0 (secure 0 0 0) 0x7f6658012910 con 0x7f66680b9d80 2024-09-17T05:41:35.426 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T05:41:35.424+0000 7f666da07640 1 -- 172.21.15.176:0/3290675241 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f666815d150 con 0x7f66680b9d80 2024-09-17T05:41:35.426 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T05:41:35.426+0000 7f665ffff640 1 -- 172.21.15.176:0/3290675241 <== mon.1 v2:172.21.15.176:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7f6658021070 con 0x7f66680b9d80 2024-09-17T05:41:35.496 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T05:41:35.495+0000 7f666da07640 1 -- 172.21.15.176:0/3290675241 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_command({"prefix": "osd new", "uuid": "3a0277fb-5e1e-4f68-bb2d-9a8a0152f64a", "id": 4} v 0) -- 0x7f66680b92a0 con 0x7f66680b9d80 2024-09-17T05:41:35.500 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T05:41:35.499+0000 7f665ffff640 1 -- 172.21.15.176:0/3290675241 <== mon.1 v2:172.21.15.176:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "3a0277fb-5e1e-4f68-bb2d-9a8a0152f64a", "id": 4}]=0 v7) ==== 112+0+2 (secure 0 0 0) 0x7f6658003d90 con 0x7f66680b9d80 2024-09-17T05:41:35.500 INFO:teuthology.orchestra.run.smithi176.stdout:4 2024-09-17T05:41:35.501 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T05:41:35.500+0000 7f666da07640 1 -- 172.21.15.176:0/3290675241 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f66680b9d80 msgr2=0x7f66680a1e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:41:35.502 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T05:41:35.500+0000 7f666da07640 1 --2- 172.21.15.176:0/3290675241 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f66680b9d80 0x7f66680a1e70 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f665800c3c0 tx=0x7f6658001e70 comp rx=0 tx=0).stop 2024-09-17T05:41:35.502 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T05:41:35.500+0000 7f666da07640 1 -- 172.21.15.176:0/3290675241 shutdown_connections 2024-09-17T05:41:35.502 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T05:41:35.500+0000 7f666da07640 1 --2- 172.21.15.176:0/3290675241 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f66681f53f0 0x7f66680b61e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:41:35.502 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T05:41:35.500+0000 7f666da07640 1 --2- 172.21.15.176:0/3290675241 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6668162160 0x7f6668153b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:41:35.502 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T05:41:35.500+0000 7f666da07640 1 --2- 172.21.15.176:0/3290675241 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f66680b9d80 0x7f66680a1e70 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:41:35.502 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T05:41:35.500+0000 7f666da07640 1 -- 172.21.15.176:0/3290675241 >> 172.21.15.176:0/3290675241 conn(0x7f66680d46c0 msgr2=0x7f666815ee40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:41:35.502 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T05:41:35.500+0000 7f666da07640 1 -- 172.21.15.176:0/3290675241 shutdown_connections 2024-09-17T05:41:35.502 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T05:41:35.500+0000 7f666da07640 1 -- 172.21.15.176:0/3290675241 wait complete. 2024-09-17T05:41:35.512 DEBUG:teuthology.orchestra.run.smithi176:> sudo ceph --cluster ceph osd new 33aebee6-0315-40b7-a11c-6702f0be494d 5 2024-09-17T05:41:35.626 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T05:41:35.624+0000 7f973d7da640 1 -- 172.21.15.176:0/3671662282 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9720003c30 msgr2=0x7f97200040a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:41:35.626 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T05:41:35.624+0000 7f973d7da640 1 --2- 172.21.15.176:0/3671662282 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9720003c30 0x7f97200040a0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f972c009b40 tx=0x7f9720005830 comp rx=0 tx=0).stop 2024-09-17T05:41:35.626 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T05:41:35.624+0000 7f973d7da640 1 -- 172.21.15.176:0/3671662282 shutdown_connections 2024-09-17T05:41:35.626 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T05:41:35.624+0000 7f973d7da640 1 --2- 172.21.15.176:0/3671662282 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9720003c30 0x7f97200040a0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:41:35.626 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T05:41:35.624+0000 7f973d7da640 1 -- 172.21.15.176:0/3671662282 >> 172.21.15.176:0/3671662282 conn(0x7f973808bfe0 msgr2=0x7f97380d46e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:41:35.626 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T05:41:35.624+0000 7f973d7da640 1 -- 172.21.15.176:0/3671662282 shutdown_connections 2024-09-17T05:41:35.626 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T05:41:35.624+0000 7f973d7da640 1 -- 172.21.15.176:0/3671662282 wait complete. 2024-09-17T05:41:35.627 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T05:41:35.626+0000 7f973d7da640 1 Processor -- start 2024-09-17T05:41:35.627 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T05:41:35.626+0000 7f973d7da640 1 -- start start 2024-09-17T05:41:35.630 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T05:41:35.627+0000 7f973d7da640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9720003c30 0x7f97380c9fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:41:35.630 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T05:41:35.627+0000 7f973d7da640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9738152680 0x7f97380ca520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:41:35.630 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T05:41:35.627+0000 7f973d7da640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f97380ccf20 0x7f97380b4b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:41:35.630 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T05:41:35.627+0000 7f973d7da640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f973806e430 con 0x7f9720003c30 2024-09-17T05:41:35.630 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T05:41:35.627+0000 7f973d7da640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f973806e2b0 con 0x7f9738152680 2024-09-17T05:41:35.631 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T05:41:35.627+0000 7f973d7da640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f973806e5b0 con 0x7f97380ccf20 2024-09-17T05:41:35.631 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T05:41:35.627+0000 7f97377fe640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f97380ccf20 0x7f97380b4b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:41:35.631 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T05:41:35.627+0000 7f97367fc640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9738152680 0x7f97380ca520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:41:35.631 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T05:41:35.628+0000 7f97377fe640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f97380ccf20 0x7f97380b4b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3301/0 says I am v2:172.21.15.176:34954/0 (socket says 172.21.15.176:34954) 2024-09-17T05:41:35.631 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T05:41:35.628+0000 7f97377fe640 1 -- 172.21.15.176:0/2679804299 learned_addr learned my addr 172.21.15.176:0/2679804299 (peer_addr_for_me v2:172.21.15.176:0/0) 2024-09-17T05:41:35.631 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T05:41:35.628+0000 7f9736ffd640 1 --2- 172.21.15.176:0/2679804299 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9720003c30 0x7f97380c9fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:41:35.631 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T05:41:35.628+0000 7f97377fe640 1 -- 172.21.15.176:0/2679804299 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9738152680 msgr2=0x7f97380ca520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:41:35.631 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T05:41:35.628+0000 7f97377fe640 1 --2- 172.21.15.176:0/2679804299 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9738152680 0x7f97380ca520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:41:35.631 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T05:41:35.628+0000 7f97377fe640 1 -- 172.21.15.176:0/2679804299 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9720003c30 msgr2=0x7f97380c9fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:41:35.631 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T05:41:35.628+0000 7f97377fe640 1 --2- 172.21.15.176:0/2679804299 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9720003c30 0x7f97380c9fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:41:35.631 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T05:41:35.628+0000 7f97377fe640 1 -- 172.21.15.176:0/2679804299 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f97380b3da0 con 0x7f97380ccf20 2024-09-17T05:41:35.631 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T05:41:35.628+0000 7f97367fc640 1 --2- 172.21.15.176:0/2679804299 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9738152680 0x7f97380ca520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T05:41:35.632 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T05:41:35.628+0000 7f97377fe640 1 --2- 172.21.15.176:0/2679804299 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f97380ccf20 0x7f97380b4b60 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f9738076bf0 tx=0x7f9730006430 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:41:35.632 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T05:41:35.628+0000 7f971f7fe640 1 -- 172.21.15.176:0/2679804299 <== mon.2 v2:172.21.15.176:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9730011900 con 0x7f97380ccf20 2024-09-17T05:41:35.632 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T05:41:35.628+0000 7f971f7fe640 1 -- 172.21.15.176:0/2679804299 <== mon.2 v2:172.21.15.176:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9730018070 con 0x7f97380ccf20 2024-09-17T05:41:35.632 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T05:41:35.628+0000 7f973d7da640 1 -- 172.21.15.176:0/2679804299 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f97380b4080 con 0x7f97380ccf20 2024-09-17T05:41:35.632 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T05:41:35.628+0000 7f971f7fe640 1 -- 172.21.15.176:0/2679804299 <== mon.2 v2:172.21.15.176:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9730011d40 con 0x7f97380ccf20 2024-09-17T05:41:35.632 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T05:41:35.628+0000 7f973d7da640 1 -- 172.21.15.176:0/2679804299 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f97380b4640 con 0x7f97380ccf20 2024-09-17T05:41:35.632 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T05:41:35.628+0000 7f971f7fe640 1 -- 172.21.15.176:0/2679804299 <== mon.2 v2:172.21.15.176:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f973001d460 con 0x7f97380ccf20 2024-09-17T05:41:35.632 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T05:41:35.628+0000 7f971f7fe640 1 -- 172.21.15.176:0/2679804299 <== mon.2 v2:172.21.15.176:3301/0 5 ==== osd_map(7..7 src has 1..7) ==== 1300+0+0 (secure 0 0 0) 0x7f9730010d10 con 0x7f97380ccf20 2024-09-17T05:41:35.632 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T05:41:35.629+0000 7f973d7da640 1 -- 172.21.15.176:0/2679804299 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f97380d02e0 con 0x7f97380ccf20 2024-09-17T05:41:35.632 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T05:41:35.631+0000 7f971f7fe640 1 -- 172.21.15.176:0/2679804299 <== mon.2 v2:172.21.15.176:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7f9730010790 con 0x7f97380ccf20 2024-09-17T05:41:35.703 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T05:41:35.702+0000 7f973d7da640 1 -- 172.21.15.176:0/2679804299 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_command({"prefix": "osd new", "uuid": "33aebee6-0315-40b7-a11c-6702f0be494d", "id": 5} v 0) -- 0x7f97380cd690 con 0x7f97380ccf20 2024-09-17T05:41:35.707 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T05:41:35.705+0000 7f971f7fe640 1 -- 172.21.15.176:0/2679804299 <== mon.2 v2:172.21.15.176:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "33aebee6-0315-40b7-a11c-6702f0be494d", "id": 5}]=0 v8) ==== 112+0+2 (secure 0 0 0) 0x7f9730010970 con 0x7f97380ccf20 2024-09-17T05:41:35.707 INFO:teuthology.orchestra.run.smithi176.stdout:5 2024-09-17T05:41:35.708 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T05:41:35.706+0000 7f973d7da640 1 -- 172.21.15.176:0/2679804299 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f97380ccf20 msgr2=0x7f97380b4b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:41:35.708 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T05:41:35.706+0000 7f973d7da640 1 --2- 172.21.15.176:0/2679804299 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f97380ccf20 0x7f97380b4b60 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f9738076bf0 tx=0x7f9730006430 comp rx=0 tx=0).stop 2024-09-17T05:41:35.708 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T05:41:35.706+0000 7f973d7da640 1 -- 172.21.15.176:0/2679804299 shutdown_connections 2024-09-17T05:41:35.708 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T05:41:35.707+0000 7f973d7da640 1 --2- 172.21.15.176:0/2679804299 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9738152680 0x7f97380ca520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:41:35.708 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T05:41:35.707+0000 7f973d7da640 1 --2- 172.21.15.176:0/2679804299 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f97380ccf20 0x7f97380b4b60 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:41:35.708 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T05:41:35.707+0000 7f973d7da640 1 --2- 172.21.15.176:0/2679804299 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9720003c30 0x7f97380c9fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:41:35.708 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T05:41:35.707+0000 7f973d7da640 1 -- 172.21.15.176:0/2679804299 >> 172.21.15.176:0/2679804299 conn(0x7f973808bfe0 msgr2=0x7f97380b1860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:41:35.709 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T05:41:35.707+0000 7f973d7da640 1 -- 172.21.15.176:0/2679804299 shutdown_connections 2024-09-17T05:41:35.709 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T05:41:35.707+0000 7f973d7da640 1 -- 172.21.15.176:0/2679804299 wait complete. 2024-09-17T05:41:35.718 DEBUG:teuthology.orchestra.run.smithi176:> sudo ceph --cluster ceph osd new 4d24f360-6751-4263-841b-d77793d33540 6 2024-09-17T05:41:35.832 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T05:41:35.830+0000 7f602e9ba640 1 -- 172.21.15.176:0/3515792061 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f60280719e0 msgr2=0x7f60281665f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:41:35.832 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T05:41:35.830+0000 7f602e9ba640 1 --2- 172.21.15.176:0/3515792061 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f60280719e0 0x7f60281665f0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f6020009ca0 tx=0x7f602002ab10 comp rx=0 tx=0).stop 2024-09-17T05:41:35.832 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T05:41:35.830+0000 7f602e9ba640 1 -- 172.21.15.176:0/3515792061 shutdown_connections 2024-09-17T05:41:35.832 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T05:41:35.830+0000 7f602e9ba640 1 --2- 172.21.15.176:0/3515792061 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f60280719e0 0x7f60281665f0 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:41:35.832 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T05:41:35.830+0000 7f602e9ba640 1 -- 172.21.15.176:0/3515792061 >> 172.21.15.176:0/3515792061 conn(0x7f60280b2f60 msgr2=0x7f60280b3370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:41:35.832 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T05:41:35.830+0000 7f602e9ba640 1 -- 172.21.15.176:0/3515792061 shutdown_connections 2024-09-17T05:41:35.832 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T05:41:35.830+0000 7f602e9ba640 1 -- 172.21.15.176:0/3515792061 wait complete. 2024-09-17T05:41:35.834 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T05:41:35.833+0000 7f602e9ba640 1 Processor -- start 2024-09-17T05:41:35.834 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T05:41:35.834+0000 7f602e9ba640 1 -- start start 2024-09-17T05:41:35.838 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T05:41:35.836+0000 7f602e9ba640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f60280b0820 0x7f602815eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:41:35.839 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T05:41:35.836+0000 7f602e9ba640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f60280b3a80 0x7f60280cb1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:41:35.839 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T05:41:35.836+0000 7f602e9ba640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f60280ccdf0 0x7f60280cd200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:41:35.839 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T05:41:35.836+0000 7f602e9ba640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f6028166cb0 con 0x7f60280b0820 2024-09-17T05:41:35.839 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T05:41:35.836+0000 7f602e9ba640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f6028166b30 con 0x7f60280b3a80 2024-09-17T05:41:35.839 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T05:41:35.836+0000 7f602e9ba640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f6028166e30 con 0x7f60280ccdf0 2024-09-17T05:41:35.839 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T05:41:35.836+0000 7f60277fe640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f60280b3a80 0x7f60280cb1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:41:35.839 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T05:41:35.836+0000 7f602cf57640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f60280ccdf0 0x7f60280cd200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:41:35.839 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T05:41:35.836+0000 7f60277fe640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f60280b3a80 0x7f60280cb1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3300/0 says I am v2:172.21.15.176:52590/0 (socket says 172.21.15.176:52590) 2024-09-17T05:41:35.839 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T05:41:35.836+0000 7f60277fe640 1 -- 172.21.15.176:0/4199148830 learned_addr learned my addr 172.21.15.176:0/4199148830 (peer_addr_for_me v2:172.21.15.176:0/0) 2024-09-17T05:41:35.840 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T05:41:35.836+0000 7f6027fff640 1 --2- 172.21.15.176:0/4199148830 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f60280b0820 0x7f602815eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:41:35.840 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T05:41:35.836+0000 7f60277fe640 1 -- 172.21.15.176:0/4199148830 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f60280ccdf0 msgr2=0x7f60280cd200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:41:35.840 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T05:41:35.836+0000 7f60277fe640 1 --2- 172.21.15.176:0/4199148830 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f60280ccdf0 0x7f60280cd200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:41:35.840 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T05:41:35.836+0000 7f60277fe640 1 -- 172.21.15.176:0/4199148830 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f60280b0820 msgr2=0x7f602815eb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:41:35.840 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T05:41:35.836+0000 7f60277fe640 1 --2- 172.21.15.176:0/4199148830 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f60280b0820 0x7f602815eb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:41:35.840 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T05:41:35.836+0000 7f60277fe640 1 -- 172.21.15.176:0/4199148830 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f602815b990 con 0x7f60280b3a80 2024-09-17T05:41:35.840 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T05:41:35.836+0000 7f602cf57640 1 --2- 172.21.15.176:0/4199148830 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f60280ccdf0 0x7f60280cd200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T05:41:35.840 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T05:41:35.836+0000 7f60277fe640 1 --2- 172.21.15.176:0/4199148830 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f60280b3a80 0x7f60280cb1f0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f601c00c3c0 tx=0x7f601c00c880 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:41:35.840 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T05:41:35.837+0000 7f6024ff9640 1 -- 172.21.15.176:0/4199148830 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f601c017070 con 0x7f60280b3a80 2024-09-17T05:41:35.840 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T05:41:35.837+0000 7f6024ff9640 1 -- 172.21.15.176:0/4199148830 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f601c0053e0 con 0x7f60280b3a80 2024-09-17T05:41:35.840 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T05:41:35.837+0000 7f6024ff9640 1 -- 172.21.15.176:0/4199148830 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f601c003850 con 0x7f60280b3a80 2024-09-17T05:41:35.840 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T05:41:35.837+0000 7f602e9ba640 1 -- 172.21.15.176:0/4199148830 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f60281f5a10 con 0x7f60280b3a80 2024-09-17T05:41:35.841 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T05:41:35.837+0000 7f602e9ba640 1 -- 172.21.15.176:0/4199148830 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6028155180 con 0x7f60280b3a80 2024-09-17T05:41:35.841 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T05:41:35.837+0000 7f6024ff9640 1 -- 172.21.15.176:0/4199148830 <== mon.1 v2:172.21.15.176:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f601c01a070 con 0x7f60280b3a80 2024-09-17T05:41:35.841 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T05:41:35.837+0000 7f6024ff9640 1 -- 172.21.15.176:0/4199148830 <== mon.1 v2:172.21.15.176:3300/0 5 ==== osd_map(8..8 src has 1..8) ==== 1415+0+0 (secure 0 0 0) 0x7f601c011c20 con 0x7f60280b3a80 2024-09-17T05:41:35.841 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T05:41:35.838+0000 7f602e9ba640 1 -- 172.21.15.176:0/4199148830 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f60280cd740 con 0x7f60280b3a80 2024-09-17T05:41:35.841 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T05:41:35.840+0000 7f6024ff9640 1 -- 172.21.15.176:0/4199148830 <== mon.1 v2:172.21.15.176:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7f60280cd740 con 0x7f60280b3a80 2024-09-17T05:41:35.911 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T05:41:35.910+0000 7f602e9ba640 1 -- 172.21.15.176:0/4199148830 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_command({"prefix": "osd new", "uuid": "4d24f360-6751-4263-841b-d77793d33540", "id": 6} v 0) -- 0x7f60280cf470 con 0x7f60280b3a80 2024-09-17T05:41:35.914 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T05:41:35.914+0000 7f6024ff9640 1 -- 172.21.15.176:0/4199148830 <== mon.1 v2:172.21.15.176:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "4d24f360-6751-4263-841b-d77793d33540", "id": 6}]=0 v9) ==== 112+0+2 (secure 0 0 0) 0x7f601c021080 con 0x7f60280b3a80 2024-09-17T05:41:35.915 INFO:teuthology.orchestra.run.smithi176.stdout:6 2024-09-17T05:41:35.916 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T05:41:35.915+0000 7f602e9ba640 1 -- 172.21.15.176:0/4199148830 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f60280b3a80 msgr2=0x7f60280cb1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:41:35.916 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T05:41:35.915+0000 7f602e9ba640 1 --2- 172.21.15.176:0/4199148830 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f60280b3a80 0x7f60280cb1f0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f601c00c3c0 tx=0x7f601c00c880 comp rx=0 tx=0).stop 2024-09-17T05:41:35.916 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T05:41:35.915+0000 7f602e9ba640 1 -- 172.21.15.176:0/4199148830 shutdown_connections 2024-09-17T05:41:35.916 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T05:41:35.915+0000 7f602e9ba640 1 --2- 172.21.15.176:0/4199148830 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f60280b3a80 0x7f60280cb1f0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:41:35.916 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T05:41:35.915+0000 7f602e9ba640 1 --2- 172.21.15.176:0/4199148830 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f60280ccdf0 0x7f60280cd200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:41:35.916 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T05:41:35.915+0000 7f602e9ba640 1 --2- 172.21.15.176:0/4199148830 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f60280b0820 0x7f602815eb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:41:35.916 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T05:41:35.915+0000 7f602e9ba640 1 -- 172.21.15.176:0/4199148830 >> 172.21.15.176:0/4199148830 conn(0x7f60280b2f60 msgr2=0x7f6028070910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:41:35.917 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T05:41:35.915+0000 7f602e9ba640 1 -- 172.21.15.176:0/4199148830 shutdown_connections 2024-09-17T05:41:35.917 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T05:41:35.915+0000 7f602e9ba640 1 -- 172.21.15.176:0/4199148830 wait complete. 2024-09-17T05:41:35.927 DEBUG:teuthology.orchestra.run.smithi176:> sudo ceph --cluster ceph osd new c8594fda-c74a-4ba9-8277-caf101d58ca1 7 2024-09-17T05:41:36.041 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T05:41:36.039+0000 7f774f6bd640 1 -- 172.21.15.176:0/2442477657 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f77480cc910 msgr2=0x7f77480b43d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:41:36.041 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T05:41:36.039+0000 7f774f6bd640 1 --2- 172.21.15.176:0/2442477657 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f77480cc910 0x7f77480b43d0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f7740005fd0 tx=0x7f774002aa90 comp rx=0 tx=0).stop 2024-09-17T05:41:36.041 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T05:41:36.039+0000 7f774f6bd640 1 -- 172.21.15.176:0/2442477657 shutdown_connections 2024-09-17T05:41:36.041 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T05:41:36.039+0000 7f774f6bd640 1 --2- 172.21.15.176:0/2442477657 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f77480cc910 0x7f77480b43d0 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:41:36.041 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T05:41:36.039+0000 7f774f6bd640 1 --2- 172.21.15.176:0/2442477657 >> v2:172.21.15.150:3300/0 conn(0x7f77480b6710 0x7f77480cc3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:41:36.041 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T05:41:36.039+0000 7f774f6bd640 1 -- 172.21.15.176:0/2442477657 >> 172.21.15.176:0/2442477657 conn(0x7f77480b2ff0 msgr2=0x7f77480b3400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:41:36.041 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T05:41:36.039+0000 7f774f6bd640 1 -- 172.21.15.176:0/2442477657 shutdown_connections 2024-09-17T05:41:36.041 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T05:41:36.039+0000 7f774f6bd640 1 -- 172.21.15.176:0/2442477657 wait complete. 2024-09-17T05:41:36.042 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T05:41:36.041+0000 7f774f6bd640 1 Processor -- start 2024-09-17T05:41:36.042 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T05:41:36.041+0000 7f774f6bd640 1 -- start start 2024-09-17T05:41:36.045 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T05:41:36.042+0000 7f774f6bd640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f77480b6300 0x7f77480ae2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:41:36.045 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T05:41:36.042+0000 7f774f6bd640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f77480b6710 0x7f77480c9410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:41:36.045 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T05:41:36.042+0000 7f774f6bd640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f77480cc910 0x7f7748159ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:41:36.045 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T05:41:36.042+0000 7f774f6bd640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f77480b4dc0 con 0x7f77480cc910 2024-09-17T05:41:36.045 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T05:41:36.042+0000 7f774f6bd640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f77480b4c40 con 0x7f77480b6300 2024-09-17T05:41:36.045 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T05:41:36.042+0000 7f774f6bd640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f77480b4f40 con 0x7f77480b6710 2024-09-17T05:41:36.046 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T05:41:36.042+0000 7f774cc58640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f77480b6710 0x7f77480c9410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:41:36.046 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T05:41:36.042+0000 7f774d459640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f77480b6300 0x7f77480ae2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:41:36.046 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T05:41:36.042+0000 7f774cc58640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f77480b6710 0x7f77480c9410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3301/0 says I am v2:172.21.15.176:34970/0 (socket says 172.21.15.176:34970) 2024-09-17T05:41:36.046 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T05:41:36.042+0000 7f774d459640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f77480b6300 0x7f77480ae2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3300/0 says I am v2:172.21.15.176:52604/0 (socket says 172.21.15.176:52604) 2024-09-17T05:41:36.046 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T05:41:36.042+0000 7f774cc58640 1 -- 172.21.15.176:0/3136280067 learned_addr learned my addr 172.21.15.176:0/3136280067 (peer_addr_for_me v2:172.21.15.176:0/0) 2024-09-17T05:41:36.046 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T05:41:36.043+0000 7f774dc5a640 1 --2- 172.21.15.176:0/3136280067 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f77480cc910 0x7f7748159ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:41:36.046 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T05:41:36.043+0000 7f774d459640 1 -- 172.21.15.176:0/3136280067 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f77480b6710 msgr2=0x7f77480c9410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:41:36.046 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T05:41:36.043+0000 7f774d459640 1 --2- 172.21.15.176:0/3136280067 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f77480b6710 0x7f77480c9410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:41:36.046 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T05:41:36.043+0000 7f774d459640 1 -- 172.21.15.176:0/3136280067 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f77480cc910 msgr2=0x7f7748159ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:41:36.046 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T05:41:36.043+0000 7f774d459640 1 --2- 172.21.15.176:0/3136280067 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f77480cc910 0x7f7748159ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:41:36.046 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T05:41:36.043+0000 7f774d459640 1 -- 172.21.15.176:0/3136280067 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f774815a220 con 0x7f77480b6300 2024-09-17T05:41:36.046 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T05:41:36.043+0000 7f774cc58640 1 --2- 172.21.15.176:0/3136280067 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f77480b6710 0x7f77480c9410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T05:41:36.046 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T05:41:36.043+0000 7f774d459640 1 --2- 172.21.15.176:0/3136280067 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f77480b6300 0x7f77480ae2d0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f773800c3c0 tx=0x7f773800c880 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:41:36.047 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T05:41:36.043+0000 7f773dffb640 1 -- 172.21.15.176:0/3136280067 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7738017070 con 0x7f77480b6300 2024-09-17T05:41:36.047 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T05:41:36.043+0000 7f773dffb640 1 -- 172.21.15.176:0/3136280067 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f77380053e0 con 0x7f77480b6300 2024-09-17T05:41:36.047 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T05:41:36.043+0000 7f774f6bd640 1 -- 172.21.15.176:0/3136280067 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f77481f9c30 con 0x7f77480b6300 2024-09-17T05:41:36.047 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T05:41:36.043+0000 7f773dffb640 1 -- 172.21.15.176:0/3136280067 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7738003850 con 0x7f77480b6300 2024-09-17T05:41:36.047 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T05:41:36.043+0000 7f774f6bd640 1 -- 172.21.15.176:0/3136280067 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f77480c9e60 con 0x7f77480b6300 2024-09-17T05:41:36.047 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T05:41:36.043+0000 7f773dffb640 1 -- 172.21.15.176:0/3136280067 <== mon.1 v2:172.21.15.176:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f773801a070 con 0x7f77480b6300 2024-09-17T05:41:36.047 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T05:41:36.044+0000 7f773dffb640 1 -- 172.21.15.176:0/3136280067 <== mon.1 v2:172.21.15.176:3300/0 5 ==== osd_map(9..9 src has 1..9) ==== 1530+0+0 (secure 0 0 0) 0x7f7738011dd0 con 0x7f77480b6300 2024-09-17T05:41:36.047 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T05:41:36.045+0000 7f774f6bd640 1 -- 172.21.15.176:0/3136280067 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f77480ca0c0 con 0x7f77480b6300 2024-09-17T05:41:36.048 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T05:41:36.047+0000 7f773dffb640 1 -- 172.21.15.176:0/3136280067 <== mon.1 v2:172.21.15.176:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7f7738011590 con 0x7f77480b6300 2024-09-17T05:41:36.119 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T05:41:36.118+0000 7f774f6bd640 1 -- 172.21.15.176:0/3136280067 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_command({"prefix": "osd new", "uuid": "c8594fda-c74a-4ba9-8277-caf101d58ca1", "id": 7} v 0) -- 0x7f77480b5450 con 0x7f77480b6300 2024-09-17T05:41:36.123 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T05:41:36.122+0000 7f773dffb640 1 -- 172.21.15.176:0/3136280067 <== mon.1 v2:172.21.15.176:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "c8594fda-c74a-4ba9-8277-caf101d58ca1", "id": 7}]=0 v10) ==== 112+0+2 (secure 0 0 0) 0x7f7738011770 con 0x7f77480b6300 2024-09-17T05:41:36.123 INFO:teuthology.orchestra.run.smithi176.stdout:7 2024-09-17T05:41:36.124 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T05:41:36.123+0000 7f774f6bd640 1 -- 172.21.15.176:0/3136280067 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f77480b6300 msgr2=0x7f77480ae2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:41:36.124 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T05:41:36.123+0000 7f774f6bd640 1 --2- 172.21.15.176:0/3136280067 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f77480b6300 0x7f77480ae2d0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f773800c3c0 tx=0x7f773800c880 comp rx=0 tx=0).stop 2024-09-17T05:41:36.124 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T05:41:36.123+0000 7f774f6bd640 1 -- 172.21.15.176:0/3136280067 shutdown_connections 2024-09-17T05:41:36.124 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T05:41:36.123+0000 7f774f6bd640 1 --2- 172.21.15.176:0/3136280067 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f77480cc910 0x7f7748159ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:41:36.124 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T05:41:36.123+0000 7f774f6bd640 1 --2- 172.21.15.176:0/3136280067 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f77480b6710 0x7f77480c9410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:41:36.124 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T05:41:36.123+0000 7f774f6bd640 1 --2- 172.21.15.176:0/3136280067 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f77480b6300 0x7f77480ae2d0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:41:36.125 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T05:41:36.123+0000 7f774f6bd640 1 -- 172.21.15.176:0/3136280067 >> 172.21.15.176:0/3136280067 conn(0x7f77480b2ff0 msgr2=0x7f77480d1420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:41:36.125 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T05:41:36.123+0000 7f774f6bd640 1 -- 172.21.15.176:0/3136280067 shutdown_connections 2024-09-17T05:41:36.125 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T05:41:36.123+0000 7f774f6bd640 1 -- 172.21.15.176:0/3136280067 wait complete. 2024-09-17T05:41:36.135 INFO:tasks.ceph.osd.0:Restarting daemon 2024-09-17T05:41:36.135 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2024-09-17T05:41:36.137 INFO:tasks.ceph.osd.0:Started 2024-09-17T05:41:36.137 INFO:tasks.ceph.osd.1:Restarting daemon 2024-09-17T05:41:36.138 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2024-09-17T05:41:36.140 INFO:tasks.ceph.osd.1:Started 2024-09-17T05:41:36.140 INFO:tasks.ceph.osd.2:Restarting daemon 2024-09-17T05:41:36.140 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2024-09-17T05:41:36.142 INFO:tasks.ceph.osd.2:Started 2024-09-17T05:41:36.142 INFO:tasks.ceph.osd.3:Restarting daemon 2024-09-17T05:41:36.142 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2024-09-17T05:41:36.144 INFO:tasks.ceph.osd.3:Started 2024-09-17T05:41:36.144 INFO:tasks.ceph.osd.4:Restarting daemon 2024-09-17T05:41:36.145 DEBUG:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2024-09-17T05:41:36.147 INFO:tasks.ceph.osd.4:Started 2024-09-17T05:41:36.147 INFO:tasks.ceph.osd.5:Restarting daemon 2024-09-17T05:41:36.147 DEBUG:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2024-09-17T05:41:36.149 INFO:tasks.ceph.osd.5:Started 2024-09-17T05:41:36.149 INFO:tasks.ceph.osd.6:Restarting daemon 2024-09-17T05:41:36.149 DEBUG:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2024-09-17T05:41:36.151 INFO:tasks.ceph.osd.6:Started 2024-09-17T05:41:36.152 INFO:tasks.ceph.osd.7:Restarting daemon 2024-09-17T05:41:36.152 DEBUG:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2024-09-17T05:41:36.154 INFO:tasks.ceph.osd.7:Started 2024-09-17T05:41:36.154 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T05:41:36.298 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:36.298+0000 7f81103da640 1 -- 172.21.15.150:0/3433373306 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f81080b1fd0 msgr2=0x7f8108167d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:41:36.299 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:36.298+0000 7f81103da640 1 --2- 172.21.15.150:0/3433373306 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f81080b1fd0 0x7f8108167d50 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f8100005fd0 tx=0x7f810002a9d0 comp rx=0 tx=0).stop 2024-09-17T05:41:36.299 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:36.298+0000 7f81103da640 1 -- 172.21.15.150:0/3433373306 shutdown_connections 2024-09-17T05:41:36.299 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:36.298+0000 7f81103da640 1 --2- 172.21.15.150:0/3433373306 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f81080b1fd0 0x7f8108167d50 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:41:36.299 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:36.298+0000 7f81103da640 1 -- 172.21.15.150:0/3433373306 >> 172.21.15.150:0/3433373306 conn(0x7f81080b3fc0 msgr2=0x7f81080b43d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:41:36.299 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:36.298+0000 7f81103da640 1 -- 172.21.15.150:0/3433373306 shutdown_connections 2024-09-17T05:41:36.299 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:36.298+0000 7f81103da640 1 -- 172.21.15.150:0/3433373306 wait complete. 2024-09-17T05:41:36.300 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:36.299+0000 7f81103da640 1 Processor -- start 2024-09-17T05:41:36.300 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:36.300+0000 7f81103da640 1 -- start start 2024-09-17T05:41:36.303 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:36.301+0000 7f81103da640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f81080b1fd0 0x7f81080c85b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:41:36.303 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:36.301+0000 7f81103da640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f81080d0c50 0x7f8108153b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:41:36.303 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:36.301+0000 7f81103da640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f81080d1060 0x7f81080cae80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:41:36.303 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:36.301+0000 7f81103da640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f81080ceb70 con 0x7f81080d1060 2024-09-17T05:41:36.303 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:36.301+0000 7f81103da640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f8108070a80 con 0x7f81080b1fd0 2024-09-17T05:41:36.304 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:36.301+0000 7f81103da640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f81080cecf0 con 0x7f81080d0c50 2024-09-17T05:41:36.304 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:36.301+0000 7f810e977640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f81080d1060 0x7f81080cae80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:41:36.304 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:36.301+0000 7f810e977640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f81080d1060 0x7f81080cae80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:50066/0 (socket says 172.21.15.150:50066) 2024-09-17T05:41:36.304 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:36.301+0000 7f810e977640 1 -- 172.21.15.150:0/1101520956 learned_addr learned my addr 172.21.15.150:0/1101520956 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:41:36.304 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:36.301+0000 7f810e176640 1 --2- 172.21.15.150:0/1101520956 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f81080b1fd0 0x7f81080c85b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:41:36.304 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:36.301+0000 7f810d975640 1 --2- 172.21.15.150:0/1101520956 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f81080d0c50 0x7f8108153b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:41:36.304 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:36.301+0000 7f810e977640 1 -- 172.21.15.150:0/1101520956 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f81080d0c50 msgr2=0x7f8108153b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:41:36.304 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:36.301+0000 7f810e977640 1 --2- 172.21.15.150:0/1101520956 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f81080d0c50 0x7f8108153b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:41:36.304 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:36.301+0000 7f810e977640 1 -- 172.21.15.150:0/1101520956 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f81080b1fd0 msgr2=0x7f81080c85b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:41:36.304 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:36.301+0000 7f810e977640 1 --2- 172.21.15.150:0/1101520956 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f81080b1fd0 0x7f81080c85b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:41:36.304 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:36.301+0000 7f810e977640 1 -- 172.21.15.150:0/1101520956 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f81080c8af0 con 0x7f81080d1060 2024-09-17T05:41:36.304 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:36.301+0000 7f810e977640 1 --2- 172.21.15.150:0/1101520956 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f81080d1060 0x7f81080cae80 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f8100009cd0 tx=0x7f8100031df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:41:36.304 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:36.302+0000 7f80feffd640 1 -- 172.21.15.150:0/1101520956 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8100045070 con 0x7f81080d1060 2024-09-17T05:41:36.305 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:36.302+0000 7f80feffd640 1 -- 172.21.15.150:0/1101520956 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f810002fc70 con 0x7f81080d1060 2024-09-17T05:41:36.305 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:36.302+0000 7f80feffd640 1 -- 172.21.15.150:0/1101520956 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8100003bd0 con 0x7f81080d1060 2024-09-17T05:41:36.305 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:36.302+0000 7f81103da640 1 -- 172.21.15.150:0/1101520956 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f81081f3b10 con 0x7f81080d1060 2024-09-17T05:41:36.305 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:36.302+0000 7f81103da640 1 -- 172.21.15.150:0/1101520956 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f81081f40d0 con 0x7f81080d1060 2024-09-17T05:41:36.305 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:36.302+0000 7f80feffd640 1 -- 172.21.15.150:0/1101520956 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f8100048070 con 0x7f81080d1060 2024-09-17T05:41:36.305 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:36.302+0000 7f80feffd640 1 -- 172.21.15.150:0/1101520956 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(10..10 src has 1..10) ==== 1645+0+0 (secure 0 0 0) 0x7f8100004710 con 0x7f81080d1060 2024-09-17T05:41:36.305 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:36.303+0000 7f81103da640 1 -- 172.21.15.150:0/1101520956 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f81080b18c0 con 0x7f81080d1060 2024-09-17T05:41:36.307 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:36.307+0000 7f80feffd640 1 -- 172.21.15.150:0/1101520956 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7f810004f080 con 0x7f81080d1060 2024-09-17T05:41:36.368 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:36.367+0000 7f81103da640 1 -- 172.21.15.150:0/1101520956 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f81080cdb50 con 0x7f81080d1060 2024-09-17T05:41:36.368 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:36.368+0000 7f80feffd640 1 -- 172.21.15.150:0/1101520956 <== mon.0 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) ==== 74+0+7058 (secure 0 0 0) 0x7f8100033020 con 0x7f81080d1060 2024-09-17T05:41:36.369 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-09-17T05:41:36.369 INFO:teuthology.orchestra.run.smithi150.stdout:{"epoch":10,"fsid":"9f2e05e9-d629-47b3-b26b-1360655b7d20","created":"2024-09-17T05:41:32.502979+0000","modified":"2024-09-17T05:41:36.120274+0000","last_up_change":"0.000000","last_in_change":"2024-09-17T05:41:36.120274+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"4f31c018-c8a4-4d6d-b0c2-a597c47aae4a","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"6ff4a573-500b-4e04-9de3-39265ead78b1","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"bffea6f9-2465-4182-b205-00436c41ac1c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"cda70430-d1e1-427e-b04e-56db4031d078","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"3a0277fb-5e1e-4f68-bb2d-9a8a0152f64a","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"33aebee6-0315-40b7-a11c-6702f0be494d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"4d24f360-6751-4263-841b-d77793d33540","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"c8594fda-c74a-4ba9-8277-caf101d58ca1","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T05:41:36.370 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:36.369+0000 7f81103da640 1 -- 172.21.15.150:0/1101520956 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f81080d1060 msgr2=0x7f81080cae80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:41:36.370 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:36.369+0000 7f81103da640 1 --2- 172.21.15.150:0/1101520956 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f81080d1060 0x7f81080cae80 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f8100009cd0 tx=0x7f8100031df0 comp rx=0 tx=0).stop 2024-09-17T05:41:36.370 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:36.369+0000 7f81103da640 1 -- 172.21.15.150:0/1101520956 shutdown_connections 2024-09-17T05:41:36.370 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:36.369+0000 7f81103da640 1 --2- 172.21.15.150:0/1101520956 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f81080d1060 0x7f81080cae80 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:41:36.370 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:36.369+0000 7f81103da640 1 --2- 172.21.15.150:0/1101520956 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f81080d0c50 0x7f8108153b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:41:36.370 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:36.369+0000 7f81103da640 1 --2- 172.21.15.150:0/1101520956 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f81080b1fd0 0x7f81080c85b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:41:36.370 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:36.369+0000 7f81103da640 1 -- 172.21.15.150:0/1101520956 >> 172.21.15.150:0/1101520956 conn(0x7f81080b3fc0 msgr2=0x7f81080ce350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:41:36.370 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:36.369+0000 7f81103da640 1 -- 172.21.15.150:0/1101520956 shutdown_connections 2024-09-17T05:41:36.370 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:36.369+0000 7f81103da640 1 -- 172.21.15.150:0/1101520956 wait complete. 2024-09-17T05:41:36.380 INFO:tasks.ceph.ceph_manager.ceph:[] 2024-09-17T05:41:36.380 INFO:tasks.ceph:Waiting for OSDs to come up 2024-09-17T05:41:37.131 INFO:tasks.ceph.osd.0.smithi150.stderr:2024-09-17T05:41:37.130+0000 7fca8ebb0640 -1 Falling back to public interface 2024-09-17T05:41:37.187 DEBUG:teuthology.orchestra.run.smithi150:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-09-17T05:41:37.293 INFO:teuthology.misc.health.smithi150.stderr:2024-09-17T05:41:37.292+0000 7f09203a1640 1 -- 172.21.15.150:0/1572281440 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f09180734f0 msgr2=0x7f09180b4910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:41:37.294 INFO:teuthology.misc.health.smithi150.stderr:2024-09-17T05:41:37.293+0000 7f09203a1640 1 --2- 172.21.15.150:0/1572281440 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f09180734f0 0x7f09180b4910 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f0908009830 tx=0x7f090802a480 comp rx=0 tx=0).stop 2024-09-17T05:41:37.294 INFO:teuthology.misc.health.smithi150.stderr:2024-09-17T05:41:37.293+0000 7f09203a1640 1 -- 172.21.15.150:0/1572281440 shutdown_connections 2024-09-17T05:41:37.294 INFO:teuthology.misc.health.smithi150.stderr:2024-09-17T05:41:37.293+0000 7f09203a1640 1 --2- 172.21.15.150:0/1572281440 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f09180734f0 0x7f09180b4910 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:41:37.294 INFO:teuthology.misc.health.smithi150.stderr:2024-09-17T05:41:37.293+0000 7f09203a1640 1 --2- 172.21.15.150:0/1572281440 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f09180b55d0 0x7f091815b720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:41:37.294 INFO:teuthology.misc.health.smithi150.stderr:2024-09-17T05:41:37.293+0000 7f09203a1640 1 -- 172.21.15.150:0/1572281440 >> 172.21.15.150:0/1572281440 conn(0x7f09180b2400 msgr2=0x7f09180b2810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:41:37.294 INFO:teuthology.misc.health.smithi150.stderr:2024-09-17T05:41:37.293+0000 7f09203a1640 1 -- 172.21.15.150:0/1572281440 shutdown_connections 2024-09-17T05:41:37.294 INFO:teuthology.misc.health.smithi150.stderr:2024-09-17T05:41:37.293+0000 7f09203a1640 1 -- 172.21.15.150:0/1572281440 wait complete. 2024-09-17T05:41:37.295 INFO:teuthology.misc.health.smithi150.stderr:2024-09-17T05:41:37.294+0000 7f09203a1640 1 Processor -- start 2024-09-17T05:41:37.295 INFO:teuthology.misc.health.smithi150.stderr:2024-09-17T05:41:37.294+0000 7f09203a1640 1 -- start start 2024-09-17T05:41:37.298 INFO:teuthology.misc.health.smithi150.stderr:2024-09-17T05:41:37.296+0000 7f09203a1640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f09180734f0 0x7f09180aed90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:41:37.298 INFO:teuthology.misc.health.smithi150.stderr:2024-09-17T05:41:37.296+0000 7f09203a1640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f09180b4e50 0x7f09181f6300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:41:37.298 INFO:teuthology.misc.health.smithi150.stderr:2024-09-17T05:41:37.296+0000 7f09203a1640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f09180b55d0 0x7f09181f6840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:41:37.298 INFO:teuthology.misc.health.smithi150.stderr:2024-09-17T05:41:37.296+0000 7f09203a1640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f091815f9d0 con 0x7f09180b4e50 2024-09-17T05:41:37.298 INFO:teuthology.misc.health.smithi150.stderr:2024-09-17T05:41:37.296+0000 7f09203a1640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f09180ce910 con 0x7f09180b55d0 2024-09-17T05:41:37.298 INFO:teuthology.misc.health.smithi150.stderr:2024-09-17T05:41:37.296+0000 7f09203a1640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f091815fb50 con 0x7f09180734f0 2024-09-17T05:41:37.298 INFO:teuthology.misc.health.smithi150.stderr:2024-09-17T05:41:37.296+0000 7f091d93c640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f09180b4e50 0x7f09181f6300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:41:37.298 INFO:teuthology.misc.health.smithi150.stderr:2024-09-17T05:41:37.296+0000 7f091d93c640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f09180b4e50 0x7f09181f6300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:50076/0 (socket says 172.21.15.150:50076) 2024-09-17T05:41:37.298 INFO:teuthology.misc.health.smithi150.stderr:2024-09-17T05:41:37.296+0000 7f091d93c640 1 -- 172.21.15.150:0/3738365866 learned_addr learned my addr 172.21.15.150:0/3738365866 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:41:37.299 INFO:teuthology.misc.health.smithi150.stderr:2024-09-17T05:41:37.296+0000 7f091e93e640 1 --2- 172.21.15.150:0/3738365866 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f09180b55d0 0x7f09181f6840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:41:37.299 INFO:teuthology.misc.health.smithi150.stderr:2024-09-17T05:41:37.296+0000 7f091e13d640 1 --2- 172.21.15.150:0/3738365866 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f09180734f0 0x7f09180aed90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:41:37.299 INFO:teuthology.misc.health.smithi150.stderr:2024-09-17T05:41:37.296+0000 7f091d93c640 1 -- 172.21.15.150:0/3738365866 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f09180734f0 msgr2=0x7f09180aed90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:41:37.299 INFO:teuthology.misc.health.smithi150.stderr:2024-09-17T05:41:37.296+0000 7f091d93c640 1 --2- 172.21.15.150:0/3738365866 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f09180734f0 0x7f09180aed90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:41:37.299 INFO:teuthology.misc.health.smithi150.stderr:2024-09-17T05:41:37.296+0000 7f091d93c640 1 -- 172.21.15.150:0/3738365866 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f09180b55d0 msgr2=0x7f09181f6840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:41:37.299 INFO:teuthology.misc.health.smithi150.stderr:2024-09-17T05:41:37.296+0000 7f091d93c640 1 --2- 172.21.15.150:0/3738365866 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f09180b55d0 0x7f09181f6840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:41:37.299 INFO:teuthology.misc.health.smithi150.stderr:2024-09-17T05:41:37.296+0000 7f091d93c640 1 -- 172.21.15.150:0/3738365866 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0918151fa0 con 0x7f09180b4e50 2024-09-17T05:41:37.299 INFO:teuthology.misc.health.smithi150.stderr:2024-09-17T05:41:37.296+0000 7f091e93e640 1 --2- 172.21.15.150:0/3738365866 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f09180b55d0 0x7f09181f6840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T05:41:37.299 INFO:teuthology.misc.health.smithi150.stderr:2024-09-17T05:41:37.296+0000 7f091d93c640 1 --2- 172.21.15.150:0/3738365866 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f09180b4e50 0x7f09181f6300 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f090802aa70 tx=0x7f0908030650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:41:37.299 INFO:teuthology.misc.health.smithi150.stderr:2024-09-17T05:41:37.297+0000 7f090effd640 1 -- 172.21.15.150:0/3738365866 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0908030c50 con 0x7f09180b4e50 2024-09-17T05:41:37.299 INFO:teuthology.misc.health.smithi150.stderr:2024-09-17T05:41:37.297+0000 7f09203a1640 1 -- 172.21.15.150:0/3738365866 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f09180af2d0 con 0x7f09180b4e50 2024-09-17T05:41:37.299 INFO:teuthology.misc.health.smithi150.stderr:2024-09-17T05:41:37.297+0000 7f090effd640 1 -- 172.21.15.150:0/3738365866 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f090803b410 con 0x7f09180b4e50 2024-09-17T05:41:37.299 INFO:teuthology.misc.health.smithi150.stderr:2024-09-17T05:41:37.297+0000 7f090effd640 1 -- 172.21.15.150:0/3738365866 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f090803b860 con 0x7f09180b4e50 2024-09-17T05:41:37.300 INFO:teuthology.misc.health.smithi150.stderr:2024-09-17T05:41:37.297+0000 7f09203a1640 1 -- 172.21.15.150:0/3738365866 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f09181524f0 con 0x7f09180b4e50 2024-09-17T05:41:37.300 INFO:teuthology.misc.health.smithi150.stderr:2024-09-17T05:41:37.298+0000 7f090effd640 1 -- 172.21.15.150:0/3738365866 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 2) ==== 50742+0+0 (secure 0 0 0) 0x7f090803ba00 con 0x7f09180b4e50 2024-09-17T05:41:37.300 INFO:teuthology.misc.health.smithi150.stderr:2024-09-17T05:41:37.298+0000 7f090effd640 1 -- 172.21.15.150:0/3738365866 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(10..10 src has 1..10) ==== 1645+0+0 (secure 0 0 0) 0x7f09080737f0 con 0x7f09180b4e50 2024-09-17T05:41:37.300 INFO:teuthology.misc.health.smithi150.stderr:2024-09-17T05:41:37.298+0000 7f09203a1640 1 -- 172.21.15.150:0/3738365866 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f091815fff0 con 0x7f09180b4e50 2024-09-17T05:41:37.300 INFO:teuthology.misc.health.smithi150.stderr:2024-09-17T05:41:37.300+0000 7f090effd640 1 -- 172.21.15.150:0/3738365866 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7f090803f030 con 0x7f09180b4e50 2024-09-17T05:41:37.361 INFO:teuthology.misc.health.smithi150.stderr:2024-09-17T05:41:37.361+0000 7f09203a1640 1 -- 172.21.15.150:0/3738365866 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f09180cce50 con 0x7f09180b4e50 2024-09-17T05:41:37.362 INFO:teuthology.misc.health.smithi150.stderr:2024-09-17T05:41:37.362+0000 7f090effd640 1 -- 172.21.15.150:0/3738365866 <== mon.0 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) ==== 74+0+7058 (secure 0 0 0) 0x7f0908066070 con 0x7f09180b4e50 2024-09-17T05:41:37.362 INFO:teuthology.misc.health.smithi150.stdout: 2024-09-17T05:41:37.363 INFO:teuthology.misc.health.smithi150.stdout:{"epoch":10,"fsid":"9f2e05e9-d629-47b3-b26b-1360655b7d20","created":"2024-09-17T05:41:32.502979+0000","modified":"2024-09-17T05:41:36.120274+0000","last_up_change":"0.000000","last_in_change":"2024-09-17T05:41:36.120274+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"4f31c018-c8a4-4d6d-b0c2-a597c47aae4a","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"6ff4a573-500b-4e04-9de3-39265ead78b1","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"bffea6f9-2465-4182-b205-00436c41ac1c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"cda70430-d1e1-427e-b04e-56db4031d078","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"3a0277fb-5e1e-4f68-bb2d-9a8a0152f64a","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"33aebee6-0315-40b7-a11c-6702f0be494d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"4d24f360-6751-4263-841b-d77793d33540","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"c8594fda-c74a-4ba9-8277-caf101d58ca1","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T05:41:37.364 INFO:teuthology.misc.health.smithi150.stderr:2024-09-17T05:41:37.362+0000 7f09203a1640 1 -- 172.21.15.150:0/3738365866 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f09180b4e50 msgr2=0x7f09181f6300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:41:37.364 INFO:teuthology.misc.health.smithi150.stderr:2024-09-17T05:41:37.362+0000 7f09203a1640 1 --2- 172.21.15.150:0/3738365866 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f09180b4e50 0x7f09181f6300 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f090802aa70 tx=0x7f0908030650 comp rx=0 tx=0).stop 2024-09-17T05:41:37.364 INFO:teuthology.misc.health.smithi150.stderr:2024-09-17T05:41:37.363+0000 7f09203a1640 1 -- 172.21.15.150:0/3738365866 shutdown_connections 2024-09-17T05:41:37.364 INFO:teuthology.misc.health.smithi150.stderr:2024-09-17T05:41:37.363+0000 7f09203a1640 1 --2- 172.21.15.150:0/3738365866 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f09180b55d0 0x7f09181f6840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:41:37.364 INFO:teuthology.misc.health.smithi150.stderr:2024-09-17T05:41:37.363+0000 7f09203a1640 1 --2- 172.21.15.150:0/3738365866 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f09180b4e50 0x7f09181f6300 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:41:37.364 INFO:teuthology.misc.health.smithi150.stderr:2024-09-17T05:41:37.363+0000 7f09203a1640 1 --2- 172.21.15.150:0/3738365866 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f09180734f0 0x7f09180aed90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:41:37.364 INFO:teuthology.misc.health.smithi150.stderr:2024-09-17T05:41:37.363+0000 7f09203a1640 1 -- 172.21.15.150:0/3738365866 >> 172.21.15.150:0/3738365866 conn(0x7f09180b2400 msgr2=0x7f09180b2810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:41:37.364 INFO:teuthology.misc.health.smithi150.stderr:2024-09-17T05:41:37.363+0000 7f09203a1640 1 -- 172.21.15.150:0/3738365866 shutdown_connections 2024-09-17T05:41:37.364 INFO:teuthology.misc.health.smithi150.stderr:2024-09-17T05:41:37.363+0000 7f09203a1640 1 -- 172.21.15.150:0/3738365866 wait complete. 2024-09-17T05:41:37.374 DEBUG:teuthology.misc:0 of 8 OSDs are up 2024-09-17T05:41:37.596 INFO:tasks.ceph.osd.7.smithi176.stderr:2024-09-17T05:41:37.595+0000 7fe68100d640 -1 Falling back to public interface 2024-09-17T05:41:37.616 INFO:tasks.ceph.osd.3.smithi150.stderr:2024-09-17T05:41:37.616+0000 7fb782c18640 -1 Falling back to public interface 2024-09-17T05:41:37.620 INFO:tasks.ceph.osd.2.smithi150.stderr:2024-09-17T05:41:37.619+0000 7ff2f9f45640 -1 Falling back to public interface 2024-09-17T05:41:37.634 INFO:tasks.ceph.osd.4.smithi176.stderr:2024-09-17T05:41:37.632+0000 7f5d1a20d640 -1 Falling back to public interface 2024-09-17T05:41:37.849 INFO:tasks.ceph.mgr.x.smithi176.stderr:2024-09-17T05:41:37.848+0000 7f33f97de640 -1 mgr.server handle_report got status from non-daemon mon.c 2024-09-17T05:41:37.852 INFO:tasks.ceph.mgr.x.smithi176.stderr:2024-09-17T05:41:37.851+0000 7f33f97de640 -1 mgr.server handle_report got status from non-daemon mon.b 2024-09-17T05:41:37.896 INFO:tasks.ceph.osd.5.smithi176.stderr:2024-09-17T05:41:37.895+0000 7f9767818640 -1 Falling back to public interface 2024-09-17T05:41:37.898 INFO:tasks.ceph.osd.1.smithi150.stderr:2024-09-17T05:41:37.898+0000 7f2395758640 -1 Falling back to public interface 2024-09-17T05:41:38.122 INFO:tasks.ceph.osd.6.smithi176.stderr:2024-09-17T05:41:38.121+0000 7f3a96ab6640 -1 Falling back to public interface 2024-09-17T05:41:40.933 INFO:tasks.ceph.osd.0.smithi150.stderr:2024-09-17T05:41:40.933+0000 7fca8ebb0640 -1 osd.0 0 log_to_monitors true 2024-09-17T05:41:41.390 INFO:tasks.ceph.osd.7.smithi176.stderr:2024-09-17T05:41:41.388+0000 7fe68100d640 -1 osd.7 0 log_to_monitors true 2024-09-17T05:41:41.433 INFO:tasks.ceph.osd.2.smithi150.stderr:2024-09-17T05:41:41.432+0000 7ff2f9f45640 -1 osd.2 0 log_to_monitors true 2024-09-17T05:41:41.469 INFO:tasks.ceph.osd.3.smithi150.stderr:2024-09-17T05:41:41.468+0000 7fb782c18640 -1 osd.3 0 log_to_monitors true 2024-09-17T05:41:41.709 INFO:tasks.ceph.osd.4.smithi176.stderr:2024-09-17T05:41:41.708+0000 7f5d1a20d640 -1 osd.4 0 log_to_monitors true 2024-09-17T05:41:41.716 INFO:tasks.ceph.osd.1.smithi150.stderr:2024-09-17T05:41:41.716+0000 7f2395758640 -1 osd.1 0 log_to_monitors true 2024-09-17T05:41:41.733 INFO:tasks.ceph.osd.5.smithi176.stderr:2024-09-17T05:41:41.732+0000 7f9767818640 -1 osd.5 0 log_to_monitors true 2024-09-17T05:41:42.124 INFO:tasks.ceph.osd.6.smithi176.stderr:2024-09-17T05:41:42.123+0000 7f3a96ab6640 -1 osd.6 0 log_to_monitors true 2024-09-17T05:41:42.951 INFO:tasks.ceph.osd.0.smithi150.stderr:2024-09-17T05:41:42.950+0000 7fca8ab3e640 -1 osd.0 0 waiting for initial osdmap 2024-09-17T05:41:42.969 INFO:tasks.ceph.osd.0.smithi150.stderr:2024-09-17T05:41:42.969+0000 7fca82934640 -1 osd.0 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-17T05:41:44.181 DEBUG:teuthology.orchestra.run.smithi150:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-09-17T05:41:44.329 INFO:teuthology.misc.health.smithi150.stderr:2024-09-17T05:41:44.328+0000 7f3c9c96a640 1 -- 172.21.15.150:0/3182535506 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3c9815f6d0 msgr2=0x7f3c9815fae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:41:44.329 INFO:teuthology.misc.health.smithi150.stderr:2024-09-17T05:41:44.328+0000 7f3c9c96a640 1 --2- 172.21.15.150:0/3182535506 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3c9815f6d0 0x7f3c9815fae0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f3c8c005fd0 tx=0x7f3c8c02a4b0 comp rx=0 tx=0).stop 2024-09-17T05:41:44.329 INFO:teuthology.misc.health.smithi150.stderr:2024-09-17T05:41:44.328+0000 7f3c9c96a640 1 -- 172.21.15.150:0/3182535506 shutdown_connections 2024-09-17T05:41:44.330 INFO:teuthology.misc.health.smithi150.stderr:2024-09-17T05:41:44.328+0000 7f3c9c96a640 1 --2- 172.21.15.150:0/3182535506 >> v2:172.21.15.176:3300/0 conn(0x7f3c98160020 0x7f3c980b46b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:41:44.330 INFO:teuthology.misc.health.smithi150.stderr:2024-09-17T05:41:44.328+0000 7f3c9c96a640 1 --2- 172.21.15.150:0/3182535506 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3c9815f6d0 0x7f3c9815fae0 secure :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f3c8c005fd0 tx=0x7f3c8c02a4b0 comp rx=0 tx=0).stop 2024-09-17T05:41:44.330 INFO:teuthology.misc.health.smithi150.stderr:2024-09-17T05:41:44.328+0000 7f3c9c96a640 1 -- 172.21.15.150:0/3182535506 >> 172.21.15.150:0/3182535506 conn(0x7f3c980b2ff0 msgr2=0x7f3c980b3400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:41:44.330 INFO:teuthology.misc.health.smithi150.stderr:2024-09-17T05:41:44.329+0000 7f3c9c96a640 1 -- 172.21.15.150:0/3182535506 shutdown_connections 2024-09-17T05:41:44.330 INFO:teuthology.misc.health.smithi150.stderr:2024-09-17T05:41:44.329+0000 7f3c9c96a640 1 -- 172.21.15.150:0/3182535506 wait complete. 2024-09-17T05:41:44.333 INFO:teuthology.misc.health.smithi150.stderr:2024-09-17T05:41:44.332+0000 7f3c9c96a640 1 Processor -- start 2024-09-17T05:41:44.333 INFO:teuthology.misc.health.smithi150.stderr:2024-09-17T05:41:44.332+0000 7f3c9c96a640 1 -- start start 2024-09-17T05:41:44.335 INFO:teuthology.misc.health.smithi150.stderr:2024-09-17T05:41:44.335+0000 7f3c9c96a640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3c980b3bf0 0x7f3c9814f880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:41:44.335 INFO:teuthology.misc.health.smithi150.stderr:2024-09-17T05:41:44.335+0000 7f3c9c96a640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3c98160020 0x7f3c981577c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:41:44.337 INFO:teuthology.misc.health.smithi150.stderr:2024-09-17T05:41:44.335+0000 7f3c95d9b640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3c98160020 0x7f3c981577c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:41:44.337 INFO:teuthology.misc.health.smithi150.stderr:2024-09-17T05:41:44.335+0000 7f3c9659c640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3c980b3bf0 0x7f3c9814f880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:41:44.337 INFO:teuthology.misc.health.smithi150.stderr:2024-09-17T05:41:44.335+0000 7f3c9659c640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3c980b3bf0 0x7f3c9814f880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3301/0 says I am v2:172.21.15.150:55566/0 (socket says 172.21.15.150:55566) 2024-09-17T05:41:44.337 INFO:teuthology.misc.health.smithi150.stderr:2024-09-17T05:41:44.335+0000 7f3c95d9b640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3c98160020 0x7f3c981577c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:47652/0 (socket says 172.21.15.150:47652) 2024-09-17T05:41:44.337 INFO:teuthology.misc.health.smithi150.stderr:2024-09-17T05:41:44.335+0000 7f3c9659c640 1 -- 172.21.15.150:0/3977590441 learned_addr learned my addr 172.21.15.150:0/3977590441 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:41:44.337 INFO:teuthology.misc.health.smithi150.stderr:2024-09-17T05:41:44.336+0000 7f3c9c96a640 1 --2- 172.21.15.150:0/3977590441 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3c9815b940 0x7f3c98157d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:41:44.337 INFO:teuthology.misc.health.smithi150.stderr:2024-09-17T05:41:44.336+0000 7f3c9c96a640 1 -- 172.21.15.150:0/3977590441 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f3c980b5030 con 0x7f3c98160020 2024-09-17T05:41:44.337 INFO:teuthology.misc.health.smithi150.stderr:2024-09-17T05:41:44.336+0000 7f3c9c96a640 1 -- 172.21.15.150:0/3977590441 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f3c980b4eb0 con 0x7f3c9815b940 2024-09-17T05:41:44.337 INFO:teuthology.misc.health.smithi150.stderr:2024-09-17T05:41:44.336+0000 7f3c9c96a640 1 -- 172.21.15.150:0/3977590441 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f3c980b51b0 con 0x7f3c980b3bf0 2024-09-17T05:41:44.337 INFO:teuthology.misc.health.smithi150.stderr:2024-09-17T05:41:44.336+0000 7f3c96d9d640 1 --2- 172.21.15.150:0/3977590441 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3c9815b940 0x7f3c98157d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:41:44.337 INFO:teuthology.misc.health.smithi150.stderr:2024-09-17T05:41:44.336+0000 7f3c9659c640 1 -- 172.21.15.150:0/3977590441 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3c9815b940 msgr2=0x7f3c98157d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:41:44.338 INFO:teuthology.misc.health.smithi150.stderr:2024-09-17T05:41:44.336+0000 7f3c9659c640 1 --2- 172.21.15.150:0/3977590441 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3c9815b940 0x7f3c98157d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:41:44.338 INFO:teuthology.misc.health.smithi150.stderr:2024-09-17T05:41:44.336+0000 7f3c9659c640 1 -- 172.21.15.150:0/3977590441 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3c98160020 msgr2=0x7f3c981577c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:41:44.338 INFO:teuthology.misc.health.smithi150.stderr:2024-09-17T05:41:44.336+0000 7f3c9659c640 1 --2- 172.21.15.150:0/3977590441 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3c98160020 0x7f3c981577c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:41:44.338 INFO:teuthology.misc.health.smithi150.stderr:2024-09-17T05:41:44.336+0000 7f3c9659c640 1 -- 172.21.15.150:0/3977590441 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3c9815c130 con 0x7f3c980b3bf0 2024-09-17T05:41:44.338 INFO:teuthology.misc.health.smithi150.stderr:2024-09-17T05:41:44.336+0000 7f3c9659c640 1 --2- 172.21.15.150:0/3977590441 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3c980b3bf0 0x7f3c9814f880 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f3c88001eb0 tx=0x7f3c8800c890 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:41:44.339 INFO:teuthology.misc.health.smithi150.stderr:2024-09-17T05:41:44.337+0000 7f3c86ffd640 1 -- 172.21.15.150:0/3977590441 <== mon.2 v2:172.21.15.176:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c88017070 con 0x7f3c980b3bf0 2024-09-17T05:41:44.339 INFO:teuthology.misc.health.smithi150.stderr:2024-09-17T05:41:44.337+0000 7f3c86ffd640 1 -- 172.21.15.150:0/3977590441 <== mon.2 v2:172.21.15.176:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f3c880053c0 con 0x7f3c980b3bf0 2024-09-17T05:41:44.339 INFO:teuthology.misc.health.smithi150.stderr:2024-09-17T05:41:44.337+0000 7f3c9c96a640 1 -- 172.21.15.150:0/3977590441 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3c9815a220 con 0x7f3c980b3bf0 2024-09-17T05:41:44.339 INFO:teuthology.misc.health.smithi150.stderr:2024-09-17T05:41:44.337+0000 7f3c9c96a640 1 -- 172.21.15.150:0/3977590441 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f3c9815a7e0 con 0x7f3c980b3bf0 2024-09-17T05:41:44.339 INFO:teuthology.misc.health.smithi150.stderr:2024-09-17T05:41:44.337+0000 7f3c86ffd640 1 -- 172.21.15.150:0/3977590441 <== mon.2 v2:172.21.15.176:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c88003830 con 0x7f3c980b3bf0 2024-09-17T05:41:44.339 INFO:teuthology.misc.health.smithi150.stderr:2024-09-17T05:41:44.338+0000 7f3c9c96a640 1 -- 172.21.15.150:0/3977590441 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3c980b5740 con 0x7f3c980b3bf0 2024-09-17T05:41:44.339 INFO:teuthology.misc.health.smithi150.stderr:2024-09-17T05:41:44.338+0000 7f3c86ffd640 1 -- 172.21.15.150:0/3977590441 <== mon.2 v2:172.21.15.176:3301/0 4 ==== mgrmap(e 4) ==== 101385+0+0 (secure 0 0 0) 0x7f3c8801a070 con 0x7f3c980b3bf0 2024-09-17T05:41:44.340 INFO:teuthology.misc.health.smithi150.stderr:2024-09-17T05:41:44.339+0000 7f3c86ffd640 1 --2- 172.21.15.150:0/3977590441 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f3c78078b30 0x7f3c7807b040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:41:44.340 INFO:teuthology.misc.health.smithi150.stderr:2024-09-17T05:41:44.339+0000 7f3c86ffd640 1 -- 172.21.15.150:0/3977590441 <== mon.2 v2:172.21.15.176:3301/0 5 ==== osd_map(14..14 src has 1..14) ==== 2511+0+0 (secure 0 0 0) 0x7f3c88099280 con 0x7f3c980b3bf0 2024-09-17T05:41:44.340 INFO:teuthology.misc.health.smithi150.stderr:2024-09-17T05:41:44.339+0000 7f3c95d9b640 1 --2- 172.21.15.150:0/3977590441 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f3c78078b30 0x7f3c7807b040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:41:44.340 INFO:teuthology.misc.health.smithi150.stderr:2024-09-17T05:41:44.340+0000 7f3c95d9b640 1 --2- 172.21.15.150:0/3977590441 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f3c78078b30 0x7f3c7807b040 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f3c8c033000 tx=0x7f3c8c004730 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:41:44.346 INFO:teuthology.misc.health.smithi150.stderr:2024-09-17T05:41:44.346+0000 7f3c86ffd640 1 -- 172.21.15.150:0/3977590441 <== mon.2 v2:172.21.15.176:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f3c88061dd0 con 0x7f3c980b3bf0 2024-09-17T05:41:44.652 INFO:teuthology.misc.health.smithi150.stderr:2024-09-17T05:41:44.652+0000 7f3c9c96a640 1 -- 172.21.15.150:0/3977590441 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f3c98074990 con 0x7f3c980b3bf0 2024-09-17T05:41:44.653 INFO:teuthology.misc.health.smithi150.stderr:2024-09-17T05:41:44.653+0000 7f3c86ffd640 1 -- 172.21.15.150:0/3977590441 <== mon.2 v2:172.21.15.176:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v14) ==== 74+0+7555 (secure 0 0 0) 0x7f3c88066800 con 0x7f3c980b3bf0 2024-09-17T05:41:44.653 INFO:teuthology.misc.health.smithi150.stdout: 2024-09-17T05:41:44.653 INFO:teuthology.misc.health.smithi150.stdout:{"epoch":14,"fsid":"9f2e05e9-d629-47b3-b26b-1360655b7d20","created":"2024-09-17T05:41:32.502979+0000","modified":"2024-09-17T05:41:43.991335+0000","last_up_change":"2024-09-17T05:41:42.989875+0000","last_in_change":"2024-09-17T05:41:36.120274+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"4f31c018-c8a4-4d6d-b0c2-a597c47aae4a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6800","nonce":479374392},{"type":"v1","addr":"172.21.15.150:6801","nonce":479374392}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6802","nonce":479374392},{"type":"v1","addr":"172.21.15.150:6803","nonce":479374392}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6806","nonce":479374392},{"type":"v1","addr":"172.21.15.150:6807","nonce":479374392}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6804","nonce":479374392},{"type":"v1","addr":"172.21.15.150:6805","nonce":479374392}]},"public_addr":"172.21.15.150:6801/479374392","cluster_addr":"172.21.15.150:6803/479374392","heartbeat_back_addr":"172.21.15.150:6807/479374392","heartbeat_front_addr":"172.21.15.150:6805/479374392","state":["exists","up"]},{"osd":1,"uuid":"6ff4a573-500b-4e04-9de3-39265ead78b1","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"bffea6f9-2465-4182-b205-00436c41ac1c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"cda70430-d1e1-427e-b04e-56db4031d078","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"3a0277fb-5e1e-4f68-bb2d-9a8a0152f64a","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"33aebee6-0315-40b7-a11c-6702f0be494d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"4d24f360-6751-4263-841b-d77793d33540","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"c8594fda-c74a-4ba9-8277-caf101d58ca1","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T05:41:44.656 INFO:teuthology.misc.health.smithi150.stderr:2024-09-17T05:41:44.656+0000 7f3c9c96a640 1 -- 172.21.15.150:0/3977590441 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f3c78078b30 msgr2=0x7f3c7807b040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:41:44.657 INFO:teuthology.misc.health.smithi150.stderr:2024-09-17T05:41:44.656+0000 7f3c9c96a640 1 --2- 172.21.15.150:0/3977590441 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f3c78078b30 0x7f3c7807b040 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f3c8c033000 tx=0x7f3c8c004730 comp rx=0 tx=0).stop 2024-09-17T05:41:44.657 INFO:teuthology.misc.health.smithi150.stderr:2024-09-17T05:41:44.656+0000 7f3c9c96a640 1 -- 172.21.15.150:0/3977590441 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3c980b3bf0 msgr2=0x7f3c9814f880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:41:44.657 INFO:teuthology.misc.health.smithi150.stderr:2024-09-17T05:41:44.656+0000 7f3c9c96a640 1 --2- 172.21.15.150:0/3977590441 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3c980b3bf0 0x7f3c9814f880 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f3c88001eb0 tx=0x7f3c8800c890 comp rx=0 tx=0).stop 2024-09-17T05:41:44.657 INFO:teuthology.misc.health.smithi150.stderr:2024-09-17T05:41:44.656+0000 7f3c9c96a640 1 -- 172.21.15.150:0/3977590441 shutdown_connections 2024-09-17T05:41:44.657 INFO:teuthology.misc.health.smithi150.stderr:2024-09-17T05:41:44.656+0000 7f3c9c96a640 1 --2- 172.21.15.150:0/3977590441 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3c9815b940 0x7f3c98157d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:41:44.657 INFO:teuthology.misc.health.smithi150.stderr:2024-09-17T05:41:44.656+0000 7f3c9c96a640 1 --2- 172.21.15.150:0/3977590441 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f3c78078b30 0x7f3c7807b040 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:41:44.657 INFO:teuthology.misc.health.smithi150.stderr:2024-09-17T05:41:44.656+0000 7f3c9c96a640 1 --2- 172.21.15.150:0/3977590441 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3c98160020 0x7f3c981577c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:41:44.657 INFO:teuthology.misc.health.smithi150.stderr:2024-09-17T05:41:44.656+0000 7f3c9c96a640 1 --2- 172.21.15.150:0/3977590441 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3c980b3bf0 0x7f3c9814f880 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:41:44.657 INFO:teuthology.misc.health.smithi150.stderr:2024-09-17T05:41:44.656+0000 7f3c9c96a640 1 -- 172.21.15.150:0/3977590441 >> 172.21.15.150:0/3977590441 conn(0x7f3c980b2ff0 msgr2=0x7f3c9815d030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:41:44.657 INFO:teuthology.misc.health.smithi150.stderr:2024-09-17T05:41:44.656+0000 7f3c9c96a640 1 -- 172.21.15.150:0/3977590441 shutdown_connections 2024-09-17T05:41:44.657 INFO:teuthology.misc.health.smithi150.stderr:2024-09-17T05:41:44.656+0000 7f3c9c96a640 1 -- 172.21.15.150:0/3977590441 wait complete. 2024-09-17T05:41:44.669 DEBUG:teuthology.misc:1 of 8 OSDs are up 2024-09-17T05:41:44.741 INFO:tasks.ceph.osd.2.smithi150.stderr:2024-09-17T05:41:44.740+0000 7ff2f5ed3640 -1 osd.2 0 waiting for initial osdmap 2024-09-17T05:41:44.750 INFO:tasks.ceph.osd.2.smithi150.stderr:2024-09-17T05:41:44.750+0000 7ff2edcc9640 -1 osd.2 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-17T05:41:44.788 INFO:tasks.ceph.osd.1.smithi150.stderr:2024-09-17T05:41:44.788+0000 7f23916e6640 -1 osd.1 0 waiting for initial osdmap 2024-09-17T05:41:44.806 INFO:tasks.ceph.osd.1.smithi150.stderr:2024-09-17T05:41:44.806+0000 7f23894dc640 -1 osd.1 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-17T05:41:44.809 INFO:tasks.ceph.osd.3.smithi150.stderr:2024-09-17T05:41:44.808+0000 7fb77e49e640 -1 osd.3 0 waiting for initial osdmap 2024-09-17T05:41:44.822 INFO:tasks.ceph.osd.3.smithi150.stderr:2024-09-17T05:41:44.822+0000 7fb776294640 -1 osd.3 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-17T05:41:44.838 INFO:tasks.ceph.osd.4.smithi176.stderr:2024-09-17T05:41:44.837+0000 7f5d15aec640 -1 osd.4 0 waiting for initial osdmap 2024-09-17T05:41:44.851 INFO:tasks.ceph.osd.4.smithi176.stderr:2024-09-17T05:41:44.850+0000 7f5d0d8e2640 -1 osd.4 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-17T05:41:44.879 INFO:tasks.ceph.osd.5.smithi176.stderr:2024-09-17T05:41:44.878+0000 7f9763199640 -1 osd.5 0 waiting for initial osdmap 2024-09-17T05:41:44.888 INFO:tasks.ceph.osd.7.smithi176.stderr:2024-09-17T05:41:44.887+0000 7fe67ca30640 -1 osd.7 0 waiting for initial osdmap 2024-09-17T05:41:44.889 INFO:tasks.ceph.osd.5.smithi176.stderr:2024-09-17T05:41:44.888+0000 7f975af8f640 -1 osd.5 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-17T05:41:44.903 INFO:tasks.ceph.osd.7.smithi176.stderr:2024-09-17T05:41:44.902+0000 7fe674826640 -1 osd.7 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-17T05:41:45.148 INFO:tasks.ceph.osd.6.smithi176.stderr:2024-09-17T05:41:45.147+0000 7f3a93259640 -1 osd.6 0 waiting for initial osdmap 2024-09-17T05:41:45.161 INFO:tasks.ceph.osd.6.smithi176.stderr:2024-09-17T05:41:45.160+0000 7f3a8a83a640 -1 osd.6 15 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-17T05:41:51.477 DEBUG:teuthology.orchestra.run.smithi150:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-09-17T05:41:51.594 INFO:teuthology.misc.health.smithi150.stderr:2024-09-17T05:41:51.593+0000 7f9b816a9640 1 -- 172.21.15.150:0/664063561 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9b68003a00 msgr2=0x7f9b68003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:41:51.594 INFO:teuthology.misc.health.smithi150.stderr:2024-09-17T05:41:51.593+0000 7f9b816a9640 1 --2- 172.21.15.150:0/664063561 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9b68003a00 0x7f9b68003e70 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f9b7c073630 tx=0x7f9b68005830 comp rx=0 tx=0).stop 2024-09-17T05:41:51.594 INFO:teuthology.misc.health.smithi150.stderr:2024-09-17T05:41:51.593+0000 7f9b7b7fe640 1 -- 172.21.15.150:0/664063561 reap_dead start 2024-09-17T05:41:51.594 INFO:teuthology.misc.health.smithi150.stderr:2024-09-17T05:41:51.593+0000 7f9b816a9640 1 -- 172.21.15.150:0/664063561 shutdown_connections 2024-09-17T05:41:51.594 INFO:teuthology.misc.health.smithi150.stderr:2024-09-17T05:41:51.593+0000 7f9b816a9640 1 -- 172.21.15.150:0/664063561 >> 172.21.15.150:0/664063561 conn(0x7f9b7c0b6810 msgr2=0x7f9b7c0b2ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:41:51.594 INFO:teuthology.misc.health.smithi150.stderr:2024-09-17T05:41:51.593+0000 7f9b816a9640 1 -- 172.21.15.150:0/664063561 shutdown_connections 2024-09-17T05:41:51.594 INFO:teuthology.misc.health.smithi150.stderr:2024-09-17T05:41:51.593+0000 7f9b816a9640 1 -- 172.21.15.150:0/664063561 wait complete. 2024-09-17T05:41:51.595 INFO:teuthology.misc.health.smithi150.stderr:2024-09-17T05:41:51.595+0000 7f9b816a9640 1 Processor -- start 2024-09-17T05:41:51.595 INFO:teuthology.misc.health.smithi150.stderr:2024-09-17T05:41:51.595+0000 7f9b816a9640 1 -- start start 2024-09-17T05:41:51.598 INFO:teuthology.misc.health.smithi150.stderr:2024-09-17T05:41:51.596+0000 7f9b816a9640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9b68003a00 0x7f9b7c15dbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:41:51.598 INFO:teuthology.misc.health.smithi150.stderr:2024-09-17T05:41:51.596+0000 7f9b816a9640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9b7c15e110 0x7f9b7c1f6ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:41:51.598 INFO:teuthology.misc.health.smithi150.stderr:2024-09-17T05:41:51.596+0000 7f9b816a9640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9b7c1f7220 0x7f9b7c1f7630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:41:51.598 INFO:teuthology.misc.health.smithi150.stderr:2024-09-17T05:41:51.596+0000 7f9b816a9640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f9b7c0ceae0 con 0x7f9b7c1f7220 2024-09-17T05:41:51.598 INFO:teuthology.misc.health.smithi150.stderr:2024-09-17T05:41:51.596+0000 7f9b816a9640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f9b7c0b4e50 con 0x7f9b68003a00 2024-09-17T05:41:51.598 INFO:teuthology.misc.health.smithi150.stderr:2024-09-17T05:41:51.596+0000 7f9b816a9640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f9b7c0cec60 con 0x7f9b7c15e110 2024-09-17T05:41:51.598 INFO:teuthology.misc.health.smithi150.stderr:2024-09-17T05:41:51.596+0000 7f9b7b7fe640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9b7c1f7220 0x7f9b7c1f7630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:41:51.598 INFO:teuthology.misc.health.smithi150.stderr:2024-09-17T05:41:51.596+0000 7f9b7b7fe640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9b7c1f7220 0x7f9b7c1f7630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:44450/0 (socket says 172.21.15.150:44450) 2024-09-17T05:41:51.599 INFO:teuthology.misc.health.smithi150.stderr:2024-09-17T05:41:51.597+0000 7f9b7b7fe640 1 -- 172.21.15.150:0/861819977 learned_addr learned my addr 172.21.15.150:0/861819977 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:41:51.599 INFO:teuthology.misc.health.smithi150.stderr:2024-09-17T05:41:51.597+0000 7f9b7affd640 1 --2- 172.21.15.150:0/861819977 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9b68003a00 0x7f9b7c15dbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:41:51.599 INFO:teuthology.misc.health.smithi150.stderr:2024-09-17T05:41:51.597+0000 7f9b727fc640 1 --2- 172.21.15.150:0/861819977 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9b7c15e110 0x7f9b7c1f6ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:41:51.599 INFO:teuthology.misc.health.smithi150.stderr:2024-09-17T05:41:51.597+0000 7f9b7b7fe640 1 -- 172.21.15.150:0/861819977 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9b7c15e110 msgr2=0x7f9b7c1f6ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:41:51.599 INFO:teuthology.misc.health.smithi150.stderr:2024-09-17T05:41:51.597+0000 7f9b7b7fe640 1 --2- 172.21.15.150:0/861819977 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9b7c15e110 0x7f9b7c1f6ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:41:51.599 INFO:teuthology.misc.health.smithi150.stderr:2024-09-17T05:41:51.597+0000 7f9b7b7fe640 1 -- 172.21.15.150:0/861819977 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9b68003a00 msgr2=0x7f9b7c15dbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:41:51.599 INFO:teuthology.misc.health.smithi150.stderr:2024-09-17T05:41:51.597+0000 7f9b7b7fe640 1 --2- 172.21.15.150:0/861819977 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9b68003a00 0x7f9b7c15dbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:41:51.599 INFO:teuthology.misc.health.smithi150.stderr:2024-09-17T05:41:51.597+0000 7f9b7b7fe640 1 -- 172.21.15.150:0/861819977 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9b7c13ed20 con 0x7f9b7c1f7220 2024-09-17T05:41:51.599 INFO:teuthology.misc.health.smithi150.stderr:2024-09-17T05:41:51.597+0000 7f9b7b7fe640 1 --2- 172.21.15.150:0/861819977 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9b7c1f7220 0x7f9b7c1f7630 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f9b7c1605d0 tx=0x7f9b74006660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:41:51.599 INFO:teuthology.misc.health.smithi150.stderr:2024-09-17T05:41:51.597+0000 7f9b73fff640 1 -- 172.21.15.150:0/861819977 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b7400fa20 con 0x7f9b7c1f7220 2024-09-17T05:41:51.599 INFO:teuthology.misc.health.smithi150.stderr:2024-09-17T05:41:51.597+0000 7f9b73fff640 1 -- 172.21.15.150:0/861819977 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9b74018070 con 0x7f9b7c1f7220 2024-09-17T05:41:51.599 INFO:teuthology.misc.health.smithi150.stderr:2024-09-17T05:41:51.597+0000 7f9b816a9640 1 -- 172.21.15.150:0/861819977 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9b7c15eac0 con 0x7f9b7c1f7220 2024-09-17T05:41:51.599 INFO:teuthology.misc.health.smithi150.stderr:2024-09-17T05:41:51.597+0000 7f9b73fff640 1 -- 172.21.15.150:0/861819977 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b7400fea0 con 0x7f9b7c1f7220 2024-09-17T05:41:51.600 INFO:teuthology.misc.health.smithi150.stderr:2024-09-17T05:41:51.597+0000 7f9b816a9640 1 -- 172.21.15.150:0/861819977 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9b7c15f080 con 0x7f9b7c1f7220 2024-09-17T05:41:51.601 INFO:teuthology.misc.health.smithi150.stderr:2024-09-17T05:41:51.598+0000 7f9b816a9640 1 -- 172.21.15.150:0/861819977 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9b7c0d09a0 con 0x7f9b7c1f7220 2024-09-17T05:41:51.601 INFO:teuthology.misc.health.smithi150.stderr:2024-09-17T05:41:51.599+0000 7f9b73fff640 1 -- 172.21.15.150:0/861819977 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f9b7401d460 con 0x7f9b7c1f7220 2024-09-17T05:41:51.601 INFO:teuthology.misc.health.smithi150.stderr:2024-09-17T05:41:51.599+0000 7f9b73fff640 1 --2- 172.21.15.150:0/861819977 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f9b5c078b90 0x7f9b5c07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:41:51.601 INFO:teuthology.misc.health.smithi150.stderr:2024-09-17T05:41:51.600+0000 7f9b73fff640 1 -- 172.21.15.150:0/861819977 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(19..19 src has 1..19) ==== 4857+0+0 (secure 0 0 0) 0x7f9b7409b150 con 0x7f9b7c1f7220 2024-09-17T05:41:51.601 INFO:teuthology.misc.health.smithi150.stderr:2024-09-17T05:41:51.600+0000 7f9b7affd640 1 --2- 172.21.15.150:0/861819977 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f9b5c078b90 0x7f9b5c07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:41:51.601 INFO:teuthology.misc.health.smithi150.stderr:2024-09-17T05:41:51.600+0000 7f9b7affd640 1 --2- 172.21.15.150:0/861819977 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f9b5c078b90 0x7f9b5c07b0a0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f9b6c035000 tx=0x7f9b6c02d040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:41:51.605 INFO:teuthology.misc.health.smithi150.stderr:2024-09-17T05:41:51.605+0000 7f9b73fff640 1 -- 172.21.15.150:0/861819977 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f9b7c0d09a0 con 0x7f9b7c1f7220 2024-09-17T05:41:51.786 INFO:teuthology.misc.health.smithi150.stderr:2024-09-17T05:41:51.785+0000 7f9b816a9640 1 -- 172.21.15.150:0/861819977 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f9b7c15e850 con 0x7f9b7c1f7220 2024-09-17T05:41:51.786 INFO:teuthology.misc.health.smithi150.stderr:2024-09-17T05:41:51.786+0000 7f9b73fff640 1 -- 172.21.15.150:0/861819977 <== mon.0 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v19) ==== 74+0+12932 (secure 0 0 0) 0x7f9b74063290 con 0x7f9b7c1f7220 2024-09-17T05:41:51.787 INFO:teuthology.misc.health.smithi150.stdout: 2024-09-17T05:41:51.787 INFO:teuthology.misc.health.smithi150.stdout:{"epoch":19,"fsid":"9f2e05e9-d629-47b3-b26b-1360655b7d20","created":"2024-09-17T05:41:32.502979+0000","modified":"2024-09-17T05:41:49.164159+0000","last_up_change":"2024-09-17T05:41:46.150225+0000","last_in_change":"2024-09-17T05:41:36.120274+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T05:41:46.860779+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"4f31c018-c8a4-4d6d-b0c2-a597c47aae4a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6800","nonce":479374392},{"type":"v1","addr":"172.21.15.150:6801","nonce":479374392}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6802","nonce":479374392},{"type":"v1","addr":"172.21.15.150:6803","nonce":479374392}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6806","nonce":479374392},{"type":"v1","addr":"172.21.15.150:6807","nonce":479374392}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6804","nonce":479374392},{"type":"v1","addr":"172.21.15.150:6805","nonce":479374392}]},"public_addr":"172.21.15.150:6801/479374392","cluster_addr":"172.21.15.150:6803/479374392","heartbeat_back_addr":"172.21.15.150:6807/479374392","heartbeat_front_addr":"172.21.15.150:6805/479374392","state":["exists","up"]},{"osd":1,"uuid":"6ff4a573-500b-4e04-9de3-39265ead78b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6824","nonce":913899800},{"type":"v1","addr":"172.21.15.150:6825","nonce":913899800}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6826","nonce":913899800},{"type":"v1","addr":"172.21.15.150:6827","nonce":913899800}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6830","nonce":913899800},{"type":"v1","addr":"172.21.15.150:6831","nonce":913899800}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6828","nonce":913899800},{"type":"v1","addr":"172.21.15.150:6829","nonce":913899800}]},"public_addr":"172.21.15.150:6825/913899800","cluster_addr":"172.21.15.150:6827/913899800","heartbeat_back_addr":"172.21.15.150:6831/913899800","heartbeat_front_addr":"172.21.15.150:6829/913899800","state":["exists","up"]},{"osd":2,"uuid":"bffea6f9-2465-4182-b205-00436c41ac1c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6816","nonce":363718461},{"type":"v1","addr":"172.21.15.150:6817","nonce":363718461}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6818","nonce":363718461},{"type":"v1","addr":"172.21.15.150:6819","nonce":363718461}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6822","nonce":363718461},{"type":"v1","addr":"172.21.15.150:6823","nonce":363718461}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6820","nonce":363718461},{"type":"v1","addr":"172.21.15.150:6821","nonce":363718461}]},"public_addr":"172.21.15.150:6817/363718461","cluster_addr":"172.21.15.150:6819/363718461","heartbeat_back_addr":"172.21.15.150:6823/363718461","heartbeat_front_addr":"172.21.15.150:6821/363718461","state":["exists","up"]},{"osd":3,"uuid":"cda70430-d1e1-427e-b04e-56db4031d078","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6808","nonce":3550994626},{"type":"v1","addr":"172.21.15.150:6809","nonce":3550994626}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6810","nonce":3550994626},{"type":"v1","addr":"172.21.15.150:6811","nonce":3550994626}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6814","nonce":3550994626},{"type":"v1","addr":"172.21.15.150:6815","nonce":3550994626}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6812","nonce":3550994626},{"type":"v1","addr":"172.21.15.150:6813","nonce":3550994626}]},"public_addr":"172.21.15.150:6809/3550994626","cluster_addr":"172.21.15.150:6811/3550994626","heartbeat_back_addr":"172.21.15.150:6815/3550994626","heartbeat_front_addr":"172.21.15.150:6813/3550994626","state":["exists","up"]},{"osd":4,"uuid":"3a0277fb-5e1e-4f68-bb2d-9a8a0152f64a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6810","nonce":2718261497},{"type":"v1","addr":"172.21.15.176:6811","nonce":2718261497}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6812","nonce":2718261497},{"type":"v1","addr":"172.21.15.176:6813","nonce":2718261497}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6816","nonce":2718261497},{"type":"v1","addr":"172.21.15.176:6817","nonce":2718261497}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6814","nonce":2718261497},{"type":"v1","addr":"172.21.15.176:6815","nonce":2718261497}]},"public_addr":"172.21.15.176:6811/2718261497","cluster_addr":"172.21.15.176:6813/2718261497","heartbeat_back_addr":"172.21.15.176:6817/2718261497","heartbeat_front_addr":"172.21.15.176:6815/2718261497","state":["exists","up"]},{"osd":5,"uuid":"33aebee6-0315-40b7-a11c-6702f0be494d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6818","nonce":2049295774},{"type":"v1","addr":"172.21.15.176:6819","nonce":2049295774}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6820","nonce":2049295774},{"type":"v1","addr":"172.21.15.176:6821","nonce":2049295774}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6824","nonce":2049295774},{"type":"v1","addr":"172.21.15.176:6825","nonce":2049295774}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6822","nonce":2049295774},{"type":"v1","addr":"172.21.15.176:6823","nonce":2049295774}]},"public_addr":"172.21.15.176:6819/2049295774","cluster_addr":"172.21.15.176:6821/2049295774","heartbeat_back_addr":"172.21.15.176:6825/2049295774","heartbeat_front_addr":"172.21.15.176:6823/2049295774","state":["exists","up"]},{"osd":6,"uuid":"4d24f360-6751-4263-841b-d77793d33540","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6826","nonce":2164458476},{"type":"v1","addr":"172.21.15.176:6827","nonce":2164458476}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6828","nonce":2164458476},{"type":"v1","addr":"172.21.15.176:6829","nonce":2164458476}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6832","nonce":2164458476},{"type":"v1","addr":"172.21.15.176:6833","nonce":2164458476}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6830","nonce":2164458476},{"type":"v1","addr":"172.21.15.176:6831","nonce":2164458476}]},"public_addr":"172.21.15.176:6827/2164458476","cluster_addr":"172.21.15.176:6829/2164458476","heartbeat_back_addr":"172.21.15.176:6833/2164458476","heartbeat_front_addr":"172.21.15.176:6831/2164458476","state":["exists","up"]},{"osd":7,"uuid":"c8594fda-c74a-4ba9-8277-caf101d58ca1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6802","nonce":3239587708},{"type":"v1","addr":"172.21.15.176:6803","nonce":3239587708}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6804","nonce":3239587708},{"type":"v1","addr":"172.21.15.176:6805","nonce":3239587708}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6808","nonce":3239587708},{"type":"v1","addr":"172.21.15.176:6809","nonce":3239587708}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6806","nonce":3239587708},{"type":"v1","addr":"172.21.15.176:6807","nonce":3239587708}]},"public_addr":"172.21.15.176:6803/3239587708","cluster_addr":"172.21.15.176:6805/3239587708","heartbeat_back_addr":"172.21.15.176:6809/3239587708","heartbeat_front_addr":"172.21.15.176:6807/3239587708","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:41:41.905151+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:41:42.705679+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:41:42.459673+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:41:42.440819+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:41:42.668428+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:41:42.694972+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:41:43.078535+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:41:42.363539+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T05:41:51.789 INFO:teuthology.misc.health.smithi150.stderr:2024-09-17T05:41:51.788+0000 7f9b816a9640 1 -- 172.21.15.150:0/861819977 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f9b5c078b90 msgr2=0x7f9b5c07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:41:51.789 INFO:teuthology.misc.health.smithi150.stderr:2024-09-17T05:41:51.788+0000 7f9b816a9640 1 --2- 172.21.15.150:0/861819977 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f9b5c078b90 0x7f9b5c07b0a0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f9b6c035000 tx=0x7f9b6c02d040 comp rx=0 tx=0).stop 2024-09-17T05:41:51.789 INFO:teuthology.misc.health.smithi150.stderr:2024-09-17T05:41:51.788+0000 7f9b816a9640 1 -- 172.21.15.150:0/861819977 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9b7c1f7220 msgr2=0x7f9b7c1f7630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:41:51.789 INFO:teuthology.misc.health.smithi150.stderr:2024-09-17T05:41:51.788+0000 7f9b816a9640 1 --2- 172.21.15.150:0/861819977 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9b7c1f7220 0x7f9b7c1f7630 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f9b7c1605d0 tx=0x7f9b74006660 comp rx=0 tx=0).stop 2024-09-17T05:41:51.789 INFO:teuthology.misc.health.smithi150.stderr:2024-09-17T05:41:51.788+0000 7f9b816a9640 1 -- 172.21.15.150:0/861819977 shutdown_connections 2024-09-17T05:41:51.789 INFO:teuthology.misc.health.smithi150.stderr:2024-09-17T05:41:51.788+0000 7f9b816a9640 1 --2- 172.21.15.150:0/861819977 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f9b5c078b90 0x7f9b5c07b0a0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:41:51.789 INFO:teuthology.misc.health.smithi150.stderr:2024-09-17T05:41:51.788+0000 7f9b816a9640 1 --2- 172.21.15.150:0/861819977 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9b7c1f7220 0x7f9b7c1f7630 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:41:51.790 INFO:teuthology.misc.health.smithi150.stderr:2024-09-17T05:41:51.788+0000 7f9b816a9640 1 --2- 172.21.15.150:0/861819977 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9b7c15e110 0x7f9b7c1f6ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:41:51.790 INFO:teuthology.misc.health.smithi150.stderr:2024-09-17T05:41:51.788+0000 7f9b816a9640 1 --2- 172.21.15.150:0/861819977 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9b68003a00 0x7f9b7c15dbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:41:51.790 INFO:teuthology.misc.health.smithi150.stderr:2024-09-17T05:41:51.788+0000 7f9b816a9640 1 -- 172.21.15.150:0/861819977 >> 172.21.15.150:0/861819977 conn(0x7f9b7c0b6810 msgr2=0x7f9b7c0b1740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:41:51.790 INFO:teuthology.misc.health.smithi150.stderr:2024-09-17T05:41:51.788+0000 7f9b816a9640 1 -- 172.21.15.150:0/861819977 shutdown_connections 2024-09-17T05:41:51.790 INFO:teuthology.misc.health.smithi150.stderr:2024-09-17T05:41:51.788+0000 7f9b816a9640 1 -- 172.21.15.150:0/861819977 wait complete. 2024-09-17T05:41:51.799 DEBUG:teuthology.misc:8 of 8 OSDs are up 2024-09-17T05:41:51.799 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2024-09-17T05:41:51.799 INFO:tasks.ceph.mds.a:Restarting daemon 2024-09-17T05:41:51.800 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-09-17T05:41:51.802 INFO:tasks.ceph.mds.a:Started 2024-09-17T05:41:51.802 INFO:tasks.ceph.mds.c:Restarting daemon 2024-09-17T05:41:51.802 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-09-17T05:41:51.804 INFO:tasks.ceph.mds.c:Started 2024-09-17T05:41:51.804 INFO:tasks.ceph.mds.b:Restarting daemon 2024-09-17T05:41:51.804 DEBUG:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-09-17T05:41:51.807 INFO:tasks.ceph.mds.b:Started 2024-09-17T05:41:51.808 INFO:tasks.ceph.mds.d:Restarting daemon 2024-09-17T05:41:51.808 DEBUG:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-09-17T05:41:51.810 INFO:tasks.ceph.mds.d:Started 2024-09-17T05:41:51.810 INFO:tasks.ceph:Setting up CephFS filesystem(s)... 2024-09-17T05:41:51.810 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T05:41:51.888 INFO:tasks.ceph.mds.a.smithi150.stdout:starting mds.a at 2024-09-17T05:41:51.889 INFO:tasks.ceph.mds.c.smithi150.stdout:starting mds.c at 2024-09-17T05:41:51.906 INFO:tasks.ceph.mds.b.smithi176.stdout:starting mds.b at 2024-09-17T05:41:51.907 INFO:tasks.ceph.mds.d.smithi176.stdout:starting mds.d at 2024-09-17T05:41:51.931 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:51.930+0000 7f6feb88b640 1 -- 172.21.15.150:0/4091521281 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6fe415c930 msgr2=0x7f6fe4159260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:41:51.931 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:51.930+0000 7f6feb88b640 1 --2- 172.21.15.150:0/4091521281 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6fe415c930 0x7f6fe4159260 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f6fe0009830 tx=0x7f6fe002a5c0 comp rx=0 tx=0).stop 2024-09-17T05:41:51.931 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:51.930+0000 7f6fdbfff640 1 -- 172.21.15.150:0/4091521281 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6fe0031b90 con 0x7f6fe415c930 2024-09-17T05:41:51.932 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:51.930+0000 7f6feb88b640 1 -- 172.21.15.150:0/4091521281 shutdown_connections 2024-09-17T05:41:51.932 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:51.931+0000 7f6feb88b640 1 --2- 172.21.15.150:0/4091521281 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6fe415c930 0x7f6fe4159260 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:41:51.932 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:51.931+0000 7f6feb88b640 1 -- 172.21.15.150:0/4091521281 >> 172.21.15.150:0/4091521281 conn(0x7f6fe4073890 msgr2=0x7f6fe4073ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:41:51.932 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:51.931+0000 7f6feb88b640 1 -- 172.21.15.150:0/4091521281 shutdown_connections 2024-09-17T05:41:51.932 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:51.931+0000 7f6feb88b640 1 -- 172.21.15.150:0/4091521281 wait complete. 2024-09-17T05:41:51.933 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:51.932+0000 7f6feb88b640 1 Processor -- start 2024-09-17T05:41:51.933 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:51.932+0000 7f6feb88b640 1 -- start start 2024-09-17T05:41:51.935 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:51.934+0000 7f6feb88b640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6fe406ddb0 0x7f6fe41f79a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:41:51.935 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:51.934+0000 7f6feb88b640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6fe40d03d0 0x7f6fe41425b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:41:51.935 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:51.934+0000 7f6feb88b640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6fe415c930 0x7f6fe406f8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:41:51.935 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:51.934+0000 7f6feb88b640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f6fe40cf170 con 0x7f6fe415c930 2024-09-17T05:41:51.936 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:51.934+0000 7f6feb88b640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f6fe40ceff0 con 0x7f6fe406ddb0 2024-09-17T05:41:51.936 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:51.934+0000 7f6feb88b640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f6fe40cf2f0 con 0x7f6fe40d03d0 2024-09-17T05:41:51.936 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:51.934+0000 7f6fe9e28640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6fe415c930 0x7f6fe406f8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:41:51.936 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:51.934+0000 7f6fe9e28640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6fe415c930 0x7f6fe406f8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:44506/0 (socket says 172.21.15.150:44506) 2024-09-17T05:41:51.936 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:51.934+0000 7f6fe9e28640 1 -- 172.21.15.150:0/3812682839 learned_addr learned my addr 172.21.15.150:0/3812682839 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:41:51.936 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:51.934+0000 7f6fe9627640 1 --2- 172.21.15.150:0/3812682839 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6fe406ddb0 0x7f6fe41f79a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:41:51.936 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:51.934+0000 7f6fe8e26640 1 --2- 172.21.15.150:0/3812682839 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6fe40d03d0 0x7f6fe41425b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:41:51.936 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:51.934+0000 7f6fe9e28640 1 -- 172.21.15.150:0/3812682839 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6fe40d03d0 msgr2=0x7f6fe41425b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:41:51.936 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:51.934+0000 7f6fe9e28640 1 --2- 172.21.15.150:0/3812682839 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6fe40d03d0 0x7f6fe41425b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:41:51.936 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:51.934+0000 7f6fe9e28640 1 -- 172.21.15.150:0/3812682839 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6fe406ddb0 msgr2=0x7f6fe41f79a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:41:51.936 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:51.934+0000 7f6fe9e28640 1 --2- 172.21.15.150:0/3812682839 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6fe406ddb0 0x7f6fe41f79a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:41:51.936 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:51.934+0000 7f6fe9e28640 1 -- 172.21.15.150:0/3812682839 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6fe4152a10 con 0x7f6fe415c930 2024-09-17T05:41:51.937 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:51.934+0000 7f6fe9e28640 1 --2- 172.21.15.150:0/3812682839 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6fe415c930 0x7f6fe406f8b0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f6fdc00ca70 tx=0x7f6fdc00cf30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:41:51.937 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:51.934+0000 7f6fd9ffb640 1 -- 172.21.15.150:0/3812682839 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6fdc016020 con 0x7f6fe415c930 2024-09-17T05:41:51.937 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:51.934+0000 7f6fd9ffb640 1 -- 172.21.15.150:0/3812682839 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f6fdc00ac60 con 0x7f6fe415c930 2024-09-17T05:41:51.937 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:51.934+0000 7f6feb88b640 1 -- 172.21.15.150:0/3812682839 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6fe4142af0 con 0x7f6fe415c930 2024-09-17T05:41:51.937 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:51.934+0000 7f6fd9ffb640 1 -- 172.21.15.150:0/3812682839 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6fdc012680 con 0x7f6fe415c930 2024-09-17T05:41:51.937 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:51.935+0000 7f6feb88b640 1 -- 172.21.15.150:0/3812682839 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6fe415fe30 con 0x7f6fe415c930 2024-09-17T05:41:51.938 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:51.936+0000 7f6feb88b640 1 -- 172.21.15.150:0/3812682839 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6fe40b2710 con 0x7f6fe415c930 2024-09-17T05:41:51.938 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:51.936+0000 7f6fd9ffb640 1 -- 172.21.15.150:0/3812682839 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f6fdc019020 con 0x7f6fe415c930 2024-09-17T05:41:51.938 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:51.937+0000 7f6fd9ffb640 1 --2- 172.21.15.150:0/3812682839 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f6fc8078b90 0x7f6fc807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:41:51.938 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:51.937+0000 7f6fd9ffb640 1 -- 172.21.15.150:0/3812682839 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(19..19 src has 1..19) ==== 4857+0+0 (secure 0 0 0) 0x7f6fdc09af10 con 0x7f6fe415c930 2024-09-17T05:41:51.938 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:51.937+0000 7f6fe9627640 1 --2- 172.21.15.150:0/3812682839 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f6fc8078b90 0x7f6fc807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:41:51.938 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:51.937+0000 7f6fe9627640 1 --2- 172.21.15.150:0/3812682839 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f6fc8078b90 0x7f6fc807b0a0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f6fe0034000 tx=0x7f6fe0004730 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:41:51.942 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:51.942+0000 7f6fd9ffb640 1 -- 172.21.15.150:0/3812682839 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f6fe40b2710 con 0x7f6fe415c930 2024-09-17T05:41:52.154 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:52.153+0000 7f6feb88b640 1 -- 172.21.15.150:0/3812682839 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f6fe4159260 con 0x7f6fe415c930 2024-09-17T05:41:52.154 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:52.154+0000 7f6fd9ffb640 1 -- 172.21.15.150:0/3812682839 <== mon.0 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 2 v2) ==== 93+0+1437 (secure 0 0 0) 0x7f6fdc020020 con 0x7f6fe415c930 2024-09-17T05:41:52.154 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-09-17T05:41:52.155 INFO:teuthology.orchestra.run.smithi150.stdout:{"epoch":2,"btime":"2024-09-17T05:41:51:893553+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4377,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6834/2757381484","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6832","nonce":2757381484},{"type":"v1","addr":"172.21.15.150:6834","nonce":2757381484}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[]} 2024-09-17T05:41:52.155 INFO:teuthology.orchestra.run.smithi150.stderr:dumped fsmap epoch 2 2024-09-17T05:41:52.157 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:52.156+0000 7f6feb88b640 1 -- 172.21.15.150:0/3812682839 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f6fc8078b90 msgr2=0x7f6fc807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:41:52.157 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:52.156+0000 7f6feb88b640 1 --2- 172.21.15.150:0/3812682839 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f6fc8078b90 0x7f6fc807b0a0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f6fe0034000 tx=0x7f6fe0004730 comp rx=0 tx=0).stop 2024-09-17T05:41:52.157 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:52.156+0000 7f6feb88b640 1 -- 172.21.15.150:0/3812682839 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6fe415c930 msgr2=0x7f6fe406f8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:41:52.157 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:52.156+0000 7f6feb88b640 1 --2- 172.21.15.150:0/3812682839 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6fe415c930 0x7f6fe406f8b0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f6fdc00ca70 tx=0x7f6fdc00cf30 comp rx=0 tx=0).stop 2024-09-17T05:41:52.157 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:52.156+0000 7f6feb88b640 1 -- 172.21.15.150:0/3812682839 shutdown_connections 2024-09-17T05:41:52.157 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:52.156+0000 7f6feb88b640 1 --2- 172.21.15.150:0/3812682839 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f6fc8078b90 0x7f6fc807b0a0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:41:52.157 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:52.156+0000 7f6feb88b640 1 --2- 172.21.15.150:0/3812682839 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6fe415c930 0x7f6fe406f8b0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:41:52.158 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:52.156+0000 7f6feb88b640 1 --2- 172.21.15.150:0/3812682839 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6fe40d03d0 0x7f6fe41425b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:41:52.158 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:52.156+0000 7f6feb88b640 1 --2- 172.21.15.150:0/3812682839 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6fe406ddb0 0x7f6fe41f79a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:41:52.158 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:52.156+0000 7f6feb88b640 1 -- 172.21.15.150:0/3812682839 >> 172.21.15.150:0/3812682839 conn(0x7f6fe4073890 msgr2=0x7f6fe4073ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:41:52.158 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:52.156+0000 7f6feb88b640 1 -- 172.21.15.150:0/3812682839 shutdown_connections 2024-09-17T05:41:52.158 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:52.156+0000 7f6feb88b640 1 -- 172.21.15.150:0/3812682839 wait complete. 2024-09-17T05:41:53.746 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-17T05:41:53.749 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-17T05:41:54.168 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T05:41:54.296 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:54.295+0000 7f652fb33640 1 -- 172.21.15.150:0/2648863441 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f652815f910 msgr2=0x7f65280b3750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:41:54.296 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:54.295+0000 7f652fb33640 1 --2- 172.21.15.150:0/2648863441 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f652815f910 0x7f65280b3750 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f6520005fd0 tx=0x7f652002a490 comp rx=0 tx=0).stop 2024-09-17T05:41:54.296 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:54.295+0000 7f652fb33640 1 -- 172.21.15.150:0/2648863441 shutdown_connections 2024-09-17T05:41:54.296 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:54.295+0000 7f652fb33640 1 --2- 172.21.15.150:0/2648863441 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f652815f910 0x7f65280b3750 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:41:54.296 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:54.295+0000 7f652fb33640 1 --2- 172.21.15.150:0/2648863441 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6528152920 0x7f652815f3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:41:54.296 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:54.295+0000 7f652fb33640 1 -- 172.21.15.150:0/2648863441 >> 172.21.15.150:0/2648863441 conn(0x7f652806d730 msgr2=0x7f65280b1e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:41:54.296 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:54.295+0000 7f652fb33640 1 -- 172.21.15.150:0/2648863441 shutdown_connections 2024-09-17T05:41:54.296 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:54.295+0000 7f652fb33640 1 -- 172.21.15.150:0/2648863441 wait complete. 2024-09-17T05:41:54.297 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:54.297+0000 7f652fb33640 1 Processor -- start 2024-09-17T05:41:54.297 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:54.297+0000 7f652fb33640 1 -- start start 2024-09-17T05:41:54.300 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:54.298+0000 7f652fb33640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f65280aebc0 0x7f65281591a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:41:54.300 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:54.298+0000 7f652fb33640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6528152920 0x7f6528156d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:41:54.300 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:54.298+0000 7f652fb33640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f652815f910 0x7f6528073040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:41:54.300 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:54.298+0000 7f652fb33640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f65280b41e0 con 0x7f65280aebc0 2024-09-17T05:41:54.300 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:54.298+0000 7f652fb33640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f65280b4060 con 0x7f652815f910 2024-09-17T05:41:54.300 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:54.298+0000 7f652fb33640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f65280b4360 con 0x7f6528152920 2024-09-17T05:41:54.300 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:54.298+0000 7f652d8cf640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f65280aebc0 0x7f65281591a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:41:54.301 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:54.298+0000 7f652d8cf640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f65280aebc0 0x7f65281591a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:44528/0 (socket says 172.21.15.150:44528) 2024-09-17T05:41:54.301 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:54.298+0000 7f652d8cf640 1 -- 172.21.15.150:0/973603713 learned_addr learned my addr 172.21.15.150:0/973603713 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:41:54.301 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:54.298+0000 7f652e0d0640 1 --2- 172.21.15.150:0/973603713 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f652815f910 0x7f6528073040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:41:54.301 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:54.298+0000 7f652d0ce640 1 --2- 172.21.15.150:0/973603713 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6528152920 0x7f6528156d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:41:54.301 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:54.298+0000 7f652d8cf640 1 -- 172.21.15.150:0/973603713 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6528152920 msgr2=0x7f6528156d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:41:54.301 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:54.298+0000 7f652d8cf640 1 --2- 172.21.15.150:0/973603713 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6528152920 0x7f6528156d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:41:54.301 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:54.298+0000 7f652d8cf640 1 -- 172.21.15.150:0/973603713 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f652815f910 msgr2=0x7f6528073040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:41:54.301 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:54.298+0000 7f652d8cf640 1 --2- 172.21.15.150:0/973603713 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f652815f910 0x7f6528073040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:41:54.301 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:54.298+0000 7f652d8cf640 1 -- 172.21.15.150:0/973603713 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f65281596e0 con 0x7f65280aebc0 2024-09-17T05:41:54.301 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:54.298+0000 7f652d8cf640 1 --2- 172.21.15.150:0/973603713 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f65280aebc0 0x7f65281591a0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f651800ba80 tx=0x7f651800bf40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:41:54.301 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:54.299+0000 7f65267fc640 1 -- 172.21.15.150:0/973603713 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f651800cc00 con 0x7f65280aebc0 2024-09-17T05:41:54.301 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:54.299+0000 7f65267fc640 1 -- 172.21.15.150:0/973603713 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f6518003970 con 0x7f65280aebc0 2024-09-17T05:41:54.301 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:54.299+0000 7f652fb33640 1 -- 172.21.15.150:0/973603713 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f65281f6da0 con 0x7f65280aebc0 2024-09-17T05:41:54.302 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:54.299+0000 7f65267fc640 1 -- 172.21.15.150:0/973603713 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6518003e00 con 0x7f65280aebc0 2024-09-17T05:41:54.302 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:54.299+0000 7f652fb33640 1 -- 172.21.15.150:0/973603713 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f65281f7360 con 0x7f65280aebc0 2024-09-17T05:41:54.302 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:54.300+0000 7f652fb33640 1 -- 172.21.15.150:0/973603713 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f65280b4910 con 0x7f65280aebc0 2024-09-17T05:41:54.302 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:54.301+0000 7f65267fc640 1 -- 172.21.15.150:0/973603713 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f6518004000 con 0x7f65280aebc0 2024-09-17T05:41:54.303 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:54.301+0000 7f65267fc640 1 --2- 172.21.15.150:0/973603713 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f6514078b90 0x7f651407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:41:54.303 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:54.301+0000 7f65267fc640 1 -- 172.21.15.150:0/973603713 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(19..19 src has 1..19) ==== 4857+0+0 (secure 0 0 0) 0x7f651809b050 con 0x7f65280aebc0 2024-09-17T05:41:54.303 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:54.301+0000 7f652d0ce640 1 --2- 172.21.15.150:0/973603713 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f6514078b90 0x7f651407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:41:54.303 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:54.302+0000 7f652d0ce640 1 --2- 172.21.15.150:0/973603713 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f6514078b90 0x7f651407b0a0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f651c005fd0 tx=0x7f651c005d80 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:41:54.305 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:54.305+0000 7f65267fc640 1 -- 172.21.15.150:0/973603713 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f6518063270 con 0x7f65280aebc0 2024-09-17T05:41:54.517 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:54.516+0000 7f652fb33640 1 -- 172.21.15.150:0/973603713 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f65280b21c0 con 0x7f65280aebc0 2024-09-17T05:41:54.517 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:54.517+0000 7f65267fc640 1 -- 172.21.15.150:0/973603713 <== mon.0 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) ==== 93+0+3915 (secure 0 0 0) 0x7f6518067ca0 con 0x7f65280aebc0 2024-09-17T05:41:54.518 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-09-17T05:41:54.518 INFO:teuthology.orchestra.run.smithi150.stdout:{"epoch":3,"btime":"2024-09-17T05:41:52:894597+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4316,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6835/357154046","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6833","nonce":357154046},{"type":"v1","addr":"172.21.15.150:6835","nonce":357154046}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4377,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6834/2757381484","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6832","nonce":2757381484},{"type":"v1","addr":"172.21.15.150:6834","nonce":2757381484}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4411,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6835/3751002674","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6834","nonce":3751002674},{"type":"v1","addr":"172.21.15.176:6835","nonce":3751002674}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4414,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6837/1714683410","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6836","nonce":1714683410},{"type":"v1","addr":"172.21.15.176:6837","nonce":1714683410}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[]} 2024-09-17T05:41:54.518 INFO:teuthology.orchestra.run.smithi150.stderr:dumped fsmap epoch 3 2024-09-17T05:41:54.520 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:54.519+0000 7f652fb33640 1 -- 172.21.15.150:0/973603713 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f6514078b90 msgr2=0x7f651407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:41:54.520 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:54.519+0000 7f652fb33640 1 --2- 172.21.15.150:0/973603713 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f6514078b90 0x7f651407b0a0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f651c005fd0 tx=0x7f651c005d80 comp rx=0 tx=0).stop 2024-09-17T05:41:54.520 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:54.519+0000 7f652fb33640 1 -- 172.21.15.150:0/973603713 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f65280aebc0 msgr2=0x7f65281591a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:41:54.520 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:54.519+0000 7f652fb33640 1 --2- 172.21.15.150:0/973603713 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f65280aebc0 0x7f65281591a0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f651800ba80 tx=0x7f651800bf40 comp rx=0 tx=0).stop 2024-09-17T05:41:54.520 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:54.519+0000 7f652fb33640 1 -- 172.21.15.150:0/973603713 shutdown_connections 2024-09-17T05:41:54.520 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:54.519+0000 7f652fb33640 1 --2- 172.21.15.150:0/973603713 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f652815f910 0x7f6528073040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:41:54.520 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:54.519+0000 7f652fb33640 1 --2- 172.21.15.150:0/973603713 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f6514078b90 0x7f651407b0a0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:41:54.520 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:54.519+0000 7f652fb33640 1 --2- 172.21.15.150:0/973603713 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6528152920 0x7f6528156d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:41:54.520 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:54.519+0000 7f652fb33640 1 --2- 172.21.15.150:0/973603713 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f65280aebc0 0x7f65281591a0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:41:54.520 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:54.519+0000 7f652fb33640 1 -- 172.21.15.150:0/973603713 >> 172.21.15.150:0/973603713 conn(0x7f652806d730 msgr2=0x7f652815e240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:41:54.520 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:54.519+0000 7f652fb33640 1 -- 172.21.15.150:0/973603713 shutdown_connections 2024-09-17T05:41:54.521 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:54.519+0000 7f652fb33640 1 -- 172.21.15.150:0/973603713 wait complete. 2024-09-17T05:41:54.531 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-09-17T05:41:54.643 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:54.642+0000 7f376a494640 1 -- 172.21.15.150:0/1671056727 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f37640b5ff0 msgr2=0x7f37640b67a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:41:54.643 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:54.642+0000 7f376a494640 1 --2- 172.21.15.150:0/1671056727 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f37640b5ff0 0x7f37640b67a0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f3754009830 tx=0x7f375402a510 comp rx=0 tx=0).stop 2024-09-17T05:41:54.644 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:54.642+0000 7f376a494640 1 -- 172.21.15.150:0/1671056727 shutdown_connections 2024-09-17T05:41:54.644 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:54.642+0000 7f376a494640 1 --2- 172.21.15.150:0/1671056727 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f37640cda20 0x7f37640cde30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:41:54.644 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:54.642+0000 7f376a494640 1 --2- 172.21.15.150:0/1671056727 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f37640b5ff0 0x7f37640b67a0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:41:54.644 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:54.642+0000 7f376a494640 1 -- 172.21.15.150:0/1671056727 >> 172.21.15.150:0/1671056727 conn(0x7f37640b2e80 msgr2=0x7f37640b3290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:41:54.644 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:54.642+0000 7f376a494640 1 -- 172.21.15.150:0/1671056727 shutdown_connections 2024-09-17T05:41:54.644 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:54.642+0000 7f376a494640 1 -- 172.21.15.150:0/1671056727 wait complete. 2024-09-17T05:41:54.644 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:54.644+0000 7f376a494640 1 Processor -- start 2024-09-17T05:41:54.645 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:54.644+0000 7f376a494640 1 -- start start 2024-09-17T05:41:54.648 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:54.646+0000 7f376a494640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f37640b5ff0 0x7f37641529e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:41:54.648 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:54.646+0000 7f376a494640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f37640cda20 0x7f37641f5ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:41:54.648 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:54.646+0000 7f376a494640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f37640ce370 0x7f37641f6420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:41:54.648 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:54.646+0000 7f376a494640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f37640cc340 con 0x7f37640ce370 2024-09-17T05:41:54.648 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:54.646+0000 7f376a494640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f37640b5740 con 0x7f37640b5ff0 2024-09-17T05:41:54.648 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:54.646+0000 7f376a494640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f37640cc4c0 con 0x7f37640cda20 2024-09-17T05:41:54.648 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:54.646+0000 7f3768a31640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f37640ce370 0x7f37641f6420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:41:54.648 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:54.646+0000 7f3768a31640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f37640ce370 0x7f37641f6420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:44534/0 (socket says 172.21.15.150:44534) 2024-09-17T05:41:54.648 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:54.646+0000 7f3768a31640 1 -- 172.21.15.150:0/2838491121 learned_addr learned my addr 172.21.15.150:0/2838491121 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:41:54.648 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:54.646+0000 7f37637fe640 1 --2- 172.21.15.150:0/2838491121 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f37640cda20 0x7f37641f5ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:41:54.648 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:54.646+0000 7f3763fff640 1 --2- 172.21.15.150:0/2838491121 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f37640b5ff0 0x7f37641529e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:41:54.649 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:54.646+0000 7f3768a31640 1 -- 172.21.15.150:0/2838491121 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f37640cda20 msgr2=0x7f37641f5ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:41:54.649 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:54.646+0000 7f3768a31640 1 --2- 172.21.15.150:0/2838491121 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f37640cda20 0x7f37641f5ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:41:54.649 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:54.646+0000 7f3768a31640 1 -- 172.21.15.150:0/2838491121 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f37640b5ff0 msgr2=0x7f37641529e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:41:54.649 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:54.646+0000 7f3768a31640 1 --2- 172.21.15.150:0/2838491121 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f37640b5ff0 0x7f37641529e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:41:54.649 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:54.646+0000 7f3768a31640 1 -- 172.21.15.150:0/2838491121 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f37640cb6f0 con 0x7f37640ce370 2024-09-17T05:41:54.649 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:54.646+0000 7f37637fe640 1 --2- 172.21.15.150:0/2838491121 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f37640cda20 0x7f37641f5ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:41:54.649 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:54.646+0000 7f3763fff640 1 --2- 172.21.15.150:0/2838491121 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f37640b5ff0 0x7f37641529e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:41:54.649 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:54.646+0000 7f3768a31640 1 --2- 172.21.15.150:0/2838491121 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f37640ce370 0x7f37641f6420 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f375c00ed80 tx=0x7f375c00c640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:41:54.649 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:54.646+0000 7f3760ff9640 1 -- 172.21.15.150:0/2838491121 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f375c011670 con 0x7f37640ce370 2024-09-17T05:41:54.649 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:54.646+0000 7f3760ff9640 1 -- 172.21.15.150:0/2838491121 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f375c011900 con 0x7f37640ce370 2024-09-17T05:41:54.649 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:54.646+0000 7f376a494640 1 -- 172.21.15.150:0/2838491121 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f37640cb130 con 0x7f37640ce370 2024-09-17T05:41:54.649 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:54.646+0000 7f3760ff9640 1 -- 172.21.15.150:0/2838491121 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f375c011d30 con 0x7f37640ce370 2024-09-17T05:41:54.649 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:54.647+0000 7f376a494640 1 -- 172.21.15.150:0/2838491121 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f37640c8490 con 0x7f37640ce370 2024-09-17T05:41:54.650 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:54.647+0000 7f376a494640 1 -- 172.21.15.150:0/2838491121 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f37640cc970 con 0x7f37640ce370 2024-09-17T05:41:54.650 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:54.648+0000 7f3760ff9640 1 -- 172.21.15.150:0/2838491121 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f375c0233f0 con 0x7f37640ce370 2024-09-17T05:41:54.650 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:54.649+0000 7f3760ff9640 1 --2- 172.21.15.150:0/2838491121 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f3750078bc0 0x7f375007b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:41:54.650 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:54.649+0000 7f3760ff9640 1 -- 172.21.15.150:0/2838491121 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(19..19 src has 1..19) ==== 4857+0+0 (secure 0 0 0) 0x7f375c09d7e0 con 0x7f37640ce370 2024-09-17T05:41:54.651 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:54.649+0000 7f3763fff640 1 --2- 172.21.15.150:0/2838491121 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f3750078bc0 0x7f375007b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:41:54.651 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:54.649+0000 7f3763fff640 1 --2- 172.21.15.150:0/2838491121 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f3750078bc0 0x7f375007b0d0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f3754034000 tx=0x7f3754004730 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:41:54.653 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:54.653+0000 7f3760ff9640 1 -- 172.21.15.150:0/2838491121 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f375c016030 con 0x7f37640ce370 2024-09-17T05:41:54.832 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:54.831+0000 7f376a494640 1 -- 172.21.15.150:0/2838491121 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7f37640cbf70 con 0x7f37640ce370 2024-09-17T05:41:54.832 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:54.832+0000 7f3760ff9640 1 -- 172.21.15.150:0/2838491121 <== mon.0 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v19) ==== 84+0+65 (secure 0 0 0) 0x7f375c065f70 con 0x7f37640ce370 2024-09-17T05:41:54.833 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-09-17T05:41:54.833 INFO:teuthology.orchestra.run.smithi150.stdout:[ 2024-09-17T05:41:54.833 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-09-17T05:41:54.833 INFO:teuthology.orchestra.run.smithi150.stdout: "poolnum": 1, 2024-09-17T05:41:54.833 INFO:teuthology.orchestra.run.smithi150.stdout: "poolname": ".mgr" 2024-09-17T05:41:54.833 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-09-17T05:41:54.833 INFO:teuthology.orchestra.run.smithi150.stdout:] 2024-09-17T05:41:54.835 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:54.834+0000 7f376a494640 1 -- 172.21.15.150:0/2838491121 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f3750078bc0 msgr2=0x7f375007b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:41:54.835 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:54.834+0000 7f376a494640 1 --2- 172.21.15.150:0/2838491121 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f3750078bc0 0x7f375007b0d0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f3754034000 tx=0x7f3754004730 comp rx=0 tx=0).stop 2024-09-17T05:41:54.835 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:54.834+0000 7f376a494640 1 -- 172.21.15.150:0/2838491121 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f37640ce370 msgr2=0x7f37641f6420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:41:54.835 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:54.834+0000 7f376a494640 1 --2- 172.21.15.150:0/2838491121 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f37640ce370 0x7f37641f6420 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f375c00ed80 tx=0x7f375c00c640 comp rx=0 tx=0).stop 2024-09-17T05:41:54.835 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:54.834+0000 7f376a494640 1 -- 172.21.15.150:0/2838491121 shutdown_connections 2024-09-17T05:41:54.835 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:54.834+0000 7f376a494640 1 --2- 172.21.15.150:0/2838491121 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f3750078bc0 0x7f375007b0d0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:41:54.835 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:54.834+0000 7f376a494640 1 --2- 172.21.15.150:0/2838491121 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f37640ce370 0x7f37641f6420 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:41:54.835 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:54.834+0000 7f376a494640 1 --2- 172.21.15.150:0/2838491121 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f37640cda20 0x7f37641f5ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:41:54.835 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:54.834+0000 7f376a494640 1 --2- 172.21.15.150:0/2838491121 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f37640b5ff0 0x7f37641529e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:41:54.836 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:54.834+0000 7f376a494640 1 -- 172.21.15.150:0/2838491121 >> 172.21.15.150:0/2838491121 conn(0x7f37640b2e80 msgr2=0x7f37640cf0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:41:54.836 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:54.834+0000 7f376a494640 1 -- 172.21.15.150:0/2838491121 shutdown_connections 2024-09-17T05:41:54.836 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:54.834+0000 7f376a494640 1 -- 172.21.15.150:0/2838491121 wait complete. 2024-09-17T05:41:54.846 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-09-17T05:41:54.846 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-09-17T05:41:54.966 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:54.965+0000 7f19f4af2640 1 -- 172.21.15.150:0/733163256 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f19d8005150 msgr2=0x7f19d800b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:41:54.966 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:54.965+0000 7f19f4af2640 1 --2- 172.21.15.150:0/733163256 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f19d8005150 0x7f19d800b9c0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f19e8005fd0 tx=0x7f19d8005830 comp rx=0 tx=0).stop 2024-09-17T05:41:54.966 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:54.965+0000 7f19eed9d640 1 -- 172.21.15.150:0/733163256 reap_dead start 2024-09-17T05:41:54.966 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:54.965+0000 7f19f4af2640 1 -- 172.21.15.150:0/733163256 shutdown_connections 2024-09-17T05:41:54.966 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:54.965+0000 7f19f4af2640 1 -- 172.21.15.150:0/733163256 >> 172.21.15.150:0/733163256 conn(0x7f19f009aa50 msgr2=0x7f19f00b2ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:41:54.966 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:54.965+0000 7f19f4af2640 1 -- 172.21.15.150:0/733163256 shutdown_connections 2024-09-17T05:41:54.967 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:54.965+0000 7f19f4af2640 1 -- 172.21.15.150:0/733163256 wait complete. 2024-09-17T05:41:54.968 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:54.967+0000 7f19f4af2640 1 Processor -- start 2024-09-17T05:41:54.968 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:54.967+0000 7f19f4af2640 1 -- start start 2024-09-17T05:41:54.970 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:54.969+0000 7f19f4af2640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f19d8005150 0x7f19f0144aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:41:54.970 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:54.969+0000 7f19f4af2640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f19f009b350 0x7f19f009b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:41:54.970 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:54.969+0000 7f19f4af2640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f19f0145480 0x7f19f0145890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:41:54.971 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:54.969+0000 7f19f4af2640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f19f015c010 con 0x7f19f0145480 2024-09-17T05:41:54.971 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:54.969+0000 7f19f4af2640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f19f015be90 con 0x7f19d8005150 2024-09-17T05:41:54.971 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:54.969+0000 7f19f4af2640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f19f015c190 con 0x7f19f009b350 2024-09-17T05:41:54.971 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:54.969+0000 7f19eed9d640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f19f0145480 0x7f19f0145890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:41:54.971 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:54.969+0000 7f19eed9d640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f19f0145480 0x7f19f0145890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:44554/0 (socket says 172.21.15.150:44554) 2024-09-17T05:41:54.971 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:54.969+0000 7f19eed9d640 1 -- 172.21.15.150:0/1584429974 learned_addr learned my addr 172.21.15.150:0/1584429974 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:41:54.971 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:54.969+0000 7f19ee59c640 1 --2- 172.21.15.150:0/1584429974 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f19d8005150 0x7f19f0144aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:41:54.971 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:54.969+0000 7f19edd9b640 1 --2- 172.21.15.150:0/1584429974 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f19f009b350 0x7f19f009b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:41:54.971 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:54.969+0000 7f19eed9d640 1 -- 172.21.15.150:0/1584429974 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f19f009b350 msgr2=0x7f19f009b760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:41:54.971 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:54.969+0000 7f19eed9d640 1 --2- 172.21.15.150:0/1584429974 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f19f009b350 0x7f19f009b760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:41:54.971 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:54.969+0000 7f19eed9d640 1 -- 172.21.15.150:0/1584429974 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f19d8005150 msgr2=0x7f19f0144aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:41:54.971 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:54.969+0000 7f19eed9d640 1 --2- 172.21.15.150:0/1584429974 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f19d8005150 0x7f19f0144aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:41:54.972 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:54.969+0000 7f19eed9d640 1 -- 172.21.15.150:0/1584429974 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f19f009bca0 con 0x7f19f0145480 2024-09-17T05:41:54.972 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:54.969+0000 7f19eed9d640 1 --2- 172.21.15.150:0/1584429974 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f19f0145480 0x7f19f0145890 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f19e8002230 tx=0x7f19e8034bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:41:54.972 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:54.969+0000 7f19deffd640 1 -- 172.21.15.150:0/1584429974 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19e8038040 con 0x7f19f0145480 2024-09-17T05:41:54.972 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:54.969+0000 7f19deffd640 1 -- 172.21.15.150:0/1584429974 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f19e802bc10 con 0x7f19f0145480 2024-09-17T05:41:54.972 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:54.969+0000 7f19deffd640 1 -- 172.21.15.150:0/1584429974 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19e8009200 con 0x7f19f0145480 2024-09-17T05:41:54.972 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:54.969+0000 7f19f4af2640 1 -- 172.21.15.150:0/1584429974 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f19f01f3370 con 0x7f19f0145480 2024-09-17T05:41:54.972 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:54.970+0000 7f19f4af2640 1 -- 172.21.15.150:0/1584429974 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f19f01f3930 con 0x7f19f0145480 2024-09-17T05:41:54.973 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:54.970+0000 7f19f4af2640 1 -- 172.21.15.150:0/1584429974 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f19f01482c0 con 0x7f19f0145480 2024-09-17T05:41:54.973 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:54.971+0000 7f19deffd640 1 -- 172.21.15.150:0/1584429974 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f19e8044020 con 0x7f19f0145480 2024-09-17T05:41:54.973 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:54.972+0000 7f19deffd640 1 --2- 172.21.15.150:0/1584429974 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f19d0078b90 0x7f19d007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:41:54.973 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:54.972+0000 7f19deffd640 1 -- 172.21.15.150:0/1584429974 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(19..19 src has 1..19) ==== 4857+0+0 (secure 0 0 0) 0x7f19e80baac0 con 0x7f19f0145480 2024-09-17T05:41:54.973 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:54.972+0000 7f19ee59c640 1 --2- 172.21.15.150:0/1584429974 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f19d0078b90 0x7f19d007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:41:54.973 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:54.972+0000 7f19ee59c640 1 --2- 172.21.15.150:0/1584429974 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f19d0078b90 0x7f19d007b0a0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f19e0009c50 tx=0x7f19e0005f90 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:41:54.977 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:54.976+0000 7f19deffd640 1 -- 172.21.15.150:0/1584429974 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f19e804b020 con 0x7f19f0145480 2024-09-17T05:41:55.152 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:55.151+0000 7f19f4af2640 1 -- 172.21.15.150:0/1584429974 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7f19f015cfc0 con 0x7f19f0145480 2024-09-17T05:41:55.913 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:55.913+0000 7f19deffd640 1 -- 172.21.15.150:0/1584429974 <== mon.0 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v20) ==== 138+0+0 (secure 0 0 0) 0x7f19f009bca0 con 0x7f19f0145480 2024-09-17T05:41:55.914 INFO:teuthology.orchestra.run.smithi150.stderr:pool 'cephfs_metadata' created 2024-09-17T05:41:55.918 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:55.917+0000 7f19f4af2640 1 -- 172.21.15.150:0/1584429974 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f19d0078b90 msgr2=0x7f19d007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:41:55.918 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:55.917+0000 7f19f4af2640 1 --2- 172.21.15.150:0/1584429974 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f19d0078b90 0x7f19d007b0a0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f19e0009c50 tx=0x7f19e0005f90 comp rx=0 tx=0).stop 2024-09-17T05:41:55.918 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:55.917+0000 7f19f4af2640 1 -- 172.21.15.150:0/1584429974 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f19f0145480 msgr2=0x7f19f0145890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:41:55.918 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:55.917+0000 7f19f4af2640 1 --2- 172.21.15.150:0/1584429974 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f19f0145480 0x7f19f0145890 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f19e8002230 tx=0x7f19e8034bb0 comp rx=0 tx=0).stop 2024-09-17T05:41:55.918 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:55.917+0000 7f19f4af2640 1 -- 172.21.15.150:0/1584429974 shutdown_connections 2024-09-17T05:41:55.918 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:55.917+0000 7f19f4af2640 1 --2- 172.21.15.150:0/1584429974 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f19d0078b90 0x7f19d007b0a0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:41:55.918 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:55.917+0000 7f19f4af2640 1 --2- 172.21.15.150:0/1584429974 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f19f0145480 0x7f19f0145890 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:41:55.918 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:55.917+0000 7f19f4af2640 1 --2- 172.21.15.150:0/1584429974 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f19f009b350 0x7f19f009b760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:41:55.918 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:55.917+0000 7f19f4af2640 1 --2- 172.21.15.150:0/1584429974 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f19d8005150 0x7f19f0144aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:41:55.919 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:55.917+0000 7f19f4af2640 1 -- 172.21.15.150:0/1584429974 >> 172.21.15.150:0/1584429974 conn(0x7f19f009aa50 msgr2=0x7f19f015dcb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:41:55.919 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:55.917+0000 7f19f4af2640 1 -- 172.21.15.150:0/1584429974 shutdown_connections 2024-09-17T05:41:55.919 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:55.917+0000 7f19f4af2640 1 -- 172.21.15.150:0/1584429974 wait complete. 2024-09-17T05:41:55.935 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-09-17T05:41:56.060 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:56.059+0000 7f39dae3f640 1 -- 172.21.15.150:0/3758136455 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f39bc004020 msgr2=0x7f39bc004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:41:56.060 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:56.059+0000 7f39dae3f640 1 --2- 172.21.15.150:0/3758136455 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f39bc004020 0x7f39bc004800 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f39d408ee90 tx=0x7f39bc005830 comp rx=0 tx=0).stop 2024-09-17T05:41:56.061 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:56.059+0000 7f39d93dc640 1 -- 172.21.15.150:0/3758136455 reap_dead start 2024-09-17T05:41:56.061 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:56.060+0000 7f39dae3f640 1 -- 172.21.15.150:0/3758136455 shutdown_connections 2024-09-17T05:41:56.061 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:56.060+0000 7f39dae3f640 1 -- 172.21.15.150:0/3758136455 >> 172.21.15.150:0/3758136455 conn(0x7f39d40d4680 msgr2=0x7f39d40d4a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:41:56.061 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:56.060+0000 7f39dae3f640 1 -- 172.21.15.150:0/3758136455 shutdown_connections 2024-09-17T05:41:56.061 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:56.060+0000 7f39dae3f640 1 -- 172.21.15.150:0/3758136455 wait complete. 2024-09-17T05:41:56.062 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:56.061+0000 7f39dae3f640 1 Processor -- start 2024-09-17T05:41:56.062 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:56.061+0000 7f39dae3f640 1 -- start start 2024-09-17T05:41:56.064 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:56.063+0000 7f39dae3f640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f39bc004020 0x7f39d415e540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:41:56.065 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:56.063+0000 7f39dae3f640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f39d415ea80 0x7f39d40ca020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:41:56.065 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:56.063+0000 7f39dae3f640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f39d415d5c0 0x7f39d40ca560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:41:56.065 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:56.063+0000 7f39dae3f640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f39d4163360 con 0x7f39bc004020 2024-09-17T05:41:56.065 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:56.063+0000 7f39dae3f640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f39d41631e0 con 0x7f39d415d5c0 2024-09-17T05:41:56.065 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:56.063+0000 7f39dae3f640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f39d41634e0 con 0x7f39d415ea80 2024-09-17T05:41:56.065 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:56.063+0000 7f39d8bdb640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f39bc004020 0x7f39d415e540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:41:56.065 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:56.063+0000 7f39d8bdb640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f39bc004020 0x7f39d415e540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:44578/0 (socket says 172.21.15.150:44578) 2024-09-17T05:41:56.065 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:56.063+0000 7f39d8bdb640 1 -- 172.21.15.150:0/1076909725 learned_addr learned my addr 172.21.15.150:0/1076909725 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:41:56.065 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:56.063+0000 7f39d93dc640 1 --2- 172.21.15.150:0/1076909725 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f39d415d5c0 0x7f39d40ca560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:41:56.065 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:56.063+0000 7f39d3fff640 1 --2- 172.21.15.150:0/1076909725 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f39d415ea80 0x7f39d40ca020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:41:56.065 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:56.063+0000 7f39d8bdb640 1 -- 172.21.15.150:0/1076909725 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f39d415ea80 msgr2=0x7f39d40ca020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:41:56.066 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:56.063+0000 7f39d8bdb640 1 --2- 172.21.15.150:0/1076909725 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f39d415ea80 0x7f39d40ca020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:41:56.066 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:56.063+0000 7f39d8bdb640 1 -- 172.21.15.150:0/1076909725 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f39d415d5c0 msgr2=0x7f39d40ca560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:41:56.066 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:56.063+0000 7f39d8bdb640 1 --2- 172.21.15.150:0/1076909725 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f39d415d5c0 0x7f39d40ca560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:41:56.066 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:56.063+0000 7f39d8bdb640 1 -- 172.21.15.150:0/1076909725 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f39d4161100 con 0x7f39bc004020 2024-09-17T05:41:56.066 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:56.063+0000 7f39d93dc640 1 --2- 172.21.15.150:0/1076909725 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f39d415d5c0 0x7f39d40ca560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:41:56.066 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:56.063+0000 7f39d8bdb640 1 --2- 172.21.15.150:0/1076909725 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f39bc004020 0x7f39d415e540 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f39c40068a0 tx=0x7f39c4001620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:41:56.066 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:56.063+0000 7f39d17fa640 1 -- 172.21.15.150:0/1076909725 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39c4015020 con 0x7f39bc004020 2024-09-17T05:41:56.066 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:56.064+0000 7f39d17fa640 1 -- 172.21.15.150:0/1076909725 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f39c4011960 con 0x7f39bc004020 2024-09-17T05:41:56.066 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:56.064+0000 7f39d17fa640 1 -- 172.21.15.150:0/1076909725 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39c4011d30 con 0x7f39bc004020 2024-09-17T05:41:56.066 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:56.064+0000 7f39dae3f640 1 -- 172.21.15.150:0/1076909725 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f39d40c9540 con 0x7f39bc004020 2024-09-17T05:41:56.066 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:56.064+0000 7f39dae3f640 1 -- 172.21.15.150:0/1076909725 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f39d415db10 con 0x7f39bc004020 2024-09-17T05:41:56.067 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:56.065+0000 7f39dae3f640 1 -- 172.21.15.150:0/1076909725 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f39d408d090 con 0x7f39bc004020 2024-09-17T05:41:56.067 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:56.066+0000 7f39d17fa640 1 -- 172.21.15.150:0/1076909725 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f39c4018020 con 0x7f39bc004020 2024-09-17T05:41:56.067 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:56.067+0000 7f39d17fa640 1 --2- 172.21.15.150:0/1076909725 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f39c0078b90 0x7f39c007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:41:56.067 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:56.067+0000 7f39d17fa640 1 -- 172.21.15.150:0/1076909725 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5227+0+0 (secure 0 0 0) 0x7f39c409b6c0 con 0x7f39bc004020 2024-09-17T05:41:56.067 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:56.067+0000 7f39d3fff640 1 --2- 172.21.15.150:0/1076909725 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f39c0078b90 0x7f39c007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:41:56.068 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:56.067+0000 7f39d3fff640 1 --2- 172.21.15.150:0/1076909725 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f39c0078b90 0x7f39c007b0a0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f39c8035000 tx=0x7f39c80046c0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:41:56.071 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:56.071+0000 7f39d17fa640 1 -- 172.21.15.150:0/1076909725 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f39d408d090 con 0x7f39bc004020 2024-09-17T05:41:56.247 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:56.247+0000 7f39dae3f640 1 -- 172.21.15.150:0/1076909725 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7f39d41628c0 con 0x7f39bc004020 2024-09-17T05:41:56.923 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:56.922+0000 7f39d17fa640 1 -- 172.21.15.150:0/1076909725 <== mon.0 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v21) ==== 170+0+0 (secure 0 0 0) 0x7f39c401f030 con 0x7f39bc004020 2024-09-17T05:41:56.923 INFO:teuthology.orchestra.run.smithi150.stderr:pool 'cephfs_data' created 2024-09-17T05:41:56.927 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:56.926+0000 7f39dae3f640 1 -- 172.21.15.150:0/1076909725 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f39c0078b90 msgr2=0x7f39c007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:41:56.927 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:56.926+0000 7f39dae3f640 1 --2- 172.21.15.150:0/1076909725 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f39c0078b90 0x7f39c007b0a0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f39c8035000 tx=0x7f39c80046c0 comp rx=0 tx=0).stop 2024-09-17T05:41:56.927 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:56.926+0000 7f39dae3f640 1 -- 172.21.15.150:0/1076909725 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f39bc004020 msgr2=0x7f39d415e540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:41:56.927 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:56.926+0000 7f39dae3f640 1 --2- 172.21.15.150:0/1076909725 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f39bc004020 0x7f39d415e540 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f39c40068a0 tx=0x7f39c4001620 comp rx=0 tx=0).stop 2024-09-17T05:41:56.927 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:56.926+0000 7f39dae3f640 1 -- 172.21.15.150:0/1076909725 shutdown_connections 2024-09-17T05:41:56.927 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:56.926+0000 7f39dae3f640 1 --2- 172.21.15.150:0/1076909725 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f39d415d5c0 0x7f39d40ca560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:41:56.927 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:56.926+0000 7f39dae3f640 1 --2- 172.21.15.150:0/1076909725 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f39c0078b90 0x7f39c007b0a0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:41:56.927 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:56.926+0000 7f39dae3f640 1 --2- 172.21.15.150:0/1076909725 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f39d415ea80 0x7f39d40ca020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:41:56.927 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:56.926+0000 7f39dae3f640 1 --2- 172.21.15.150:0/1076909725 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f39bc004020 0x7f39d415e540 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:41:56.927 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:56.926+0000 7f39dae3f640 1 -- 172.21.15.150:0/1076909725 >> 172.21.15.150:0/1076909725 conn(0x7f39d40d4680 msgr2=0x7f39d406df80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:41:56.927 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:56.926+0000 7f39dae3f640 1 -- 172.21.15.150:0/1076909725 shutdown_connections 2024-09-17T05:41:56.928 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:56.926+0000 7f39dae3f640 1 -- 172.21.15.150:0/1076909725 wait complete. 2024-09-17T05:41:56.950 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-09-17T05:41:57.069 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:57.068+0000 7f6d9febe640 1 -- 172.21.15.150:0/1982837491 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6d84003cb0 msgr2=0x7f6d84004120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:41:57.070 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:57.068+0000 7f6d9febe640 1 --2- 172.21.15.150:0/1982837491 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6d84003cb0 0x7f6d84004120 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f6d9400c670 tx=0x7f6d84005830 comp rx=0 tx=0).stop 2024-09-17T05:41:57.070 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:57.068+0000 7f6d9e45b640 1 -- 172.21.15.150:0/1982837491 reap_dead start 2024-09-17T05:41:57.070 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:57.068+0000 7f6d9febe640 1 -- 172.21.15.150:0/1982837491 shutdown_connections 2024-09-17T05:41:57.070 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:57.068+0000 7f6d9febe640 1 -- 172.21.15.150:0/1982837491 >> 172.21.15.150:0/1982837491 conn(0x7f6d980d4680 msgr2=0x7f6d980d4a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:41:57.070 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:57.069+0000 7f6d9febe640 1 -- 172.21.15.150:0/1982837491 shutdown_connections 2024-09-17T05:41:57.070 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:57.069+0000 7f6d9febe640 1 -- 172.21.15.150:0/1982837491 wait complete. 2024-09-17T05:41:57.071 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:57.070+0000 7f6d9febe640 1 Processor -- start 2024-09-17T05:41:57.071 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:57.070+0000 7f6d9febe640 1 -- start start 2024-09-17T05:41:57.073 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:57.072+0000 7f6d9febe640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6d84003cb0 0x7f6d98150420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:41:57.073 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:57.072+0000 7f6d9febe640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6d9815c510 0x7f6d9806f180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:41:57.074 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:57.072+0000 7f6d9febe640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6d9815c920 0x7f6d9806f6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:41:57.074 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:57.072+0000 7f6d9febe640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f6d98168180 con 0x7f6d84003cb0 2024-09-17T05:41:57.074 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:57.072+0000 7f6d9febe640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f6d98168000 con 0x7f6d9815c510 2024-09-17T05:41:57.074 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:57.072+0000 7f6d9febe640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f6d98168300 con 0x7f6d9815c920 2024-09-17T05:41:57.074 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:57.072+0000 7f6d9dc5a640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6d84003cb0 0x7f6d98150420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:41:57.074 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:57.072+0000 7f6d9dc5a640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6d84003cb0 0x7f6d98150420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:44594/0 (socket says 172.21.15.150:44594) 2024-09-17T05:41:57.074 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:57.072+0000 7f6d9dc5a640 1 -- 172.21.15.150:0/4157072550 learned_addr learned my addr 172.21.15.150:0/4157072550 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:41:57.074 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:57.072+0000 7f6d9d459640 1 --2- 172.21.15.150:0/4157072550 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6d9815c510 0x7f6d9806f180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:41:57.074 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:57.072+0000 7f6d9e45b640 1 --2- 172.21.15.150:0/4157072550 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6d9815c920 0x7f6d9806f6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:41:57.074 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:57.072+0000 7f6d9dc5a640 1 -- 172.21.15.150:0/4157072550 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6d9815c920 msgr2=0x7f6d9806f6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:41:57.074 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:57.072+0000 7f6d9dc5a640 1 --2- 172.21.15.150:0/4157072550 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6d9815c920 0x7f6d9806f6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:41:57.074 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:57.072+0000 7f6d9dc5a640 1 -- 172.21.15.150:0/4157072550 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6d9815c510 msgr2=0x7f6d9806f180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:41:57.074 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:57.072+0000 7f6d9dc5a640 1 --2- 172.21.15.150:0/4157072550 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6d9815c510 0x7f6d9806f180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:41:57.075 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:57.072+0000 7f6d9dc5a640 1 -- 172.21.15.150:0/4157072550 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6d9815fed0 con 0x7f6d84003cb0 2024-09-17T05:41:57.075 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:57.072+0000 7f6d9e45b640 1 --2- 172.21.15.150:0/4157072550 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6d9815c920 0x7f6d9806f6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T05:41:57.075 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:57.072+0000 7f6d9dc5a640 1 --2- 172.21.15.150:0/4157072550 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6d84003cb0 0x7f6d98150420 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f6d9402b3a0 tx=0x7f6d94003f30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:41:57.075 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:57.072+0000 7f6d8e7fc640 1 -- 172.21.15.150:0/4157072550 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d940012a0 con 0x7f6d84003cb0 2024-09-17T05:41:57.075 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:57.072+0000 7f6d8e7fc640 1 -- 172.21.15.150:0/4157072550 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f6d9402b6b0 con 0x7f6d84003cb0 2024-09-17T05:41:57.075 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:57.072+0000 7f6d9febe640 1 -- 172.21.15.150:0/4157072550 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6d9815b0f0 con 0x7f6d84003cb0 2024-09-17T05:41:57.075 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:57.072+0000 7f6d8e7fc640 1 -- 172.21.15.150:0/4157072550 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d9402bae0 con 0x7f6d84003cb0 2024-09-17T05:41:57.075 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:57.072+0000 7f6d9febe640 1 -- 172.21.15.150:0/4157072550 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6d9815b6b0 con 0x7f6d84003cb0 2024-09-17T05:41:57.076 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:57.073+0000 7f6d9febe640 1 -- 172.21.15.150:0/4157072550 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6d9808d090 con 0x7f6d84003cb0 2024-09-17T05:41:57.076 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:57.074+0000 7f6d8e7fc640 1 -- 172.21.15.150:0/4157072550 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f6d9402bc80 con 0x7f6d84003cb0 2024-09-17T05:41:57.076 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:57.075+0000 7f6d8e7fc640 1 --2- 172.21.15.150:0/4157072550 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f6d7c078bc0 0x7f6d7c07b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:41:57.076 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:57.075+0000 7f6d8e7fc640 1 -- 172.21.15.150:0/4157072550 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5609+0+0 (secure 0 0 0) 0x7f6d940bb170 con 0x7f6d84003cb0 2024-09-17T05:41:57.076 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:57.075+0000 7f6d9d459640 1 --2- 172.21.15.150:0/4157072550 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f6d7c078bc0 0x7f6d7c07b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:41:57.076 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:57.076+0000 7f6d9d459640 1 --2- 172.21.15.150:0/4157072550 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f6d7c078bc0 0x7f6d7c07b0d0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f6d9815c230 tx=0x7f6d88006b10 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:41:57.080 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:57.080+0000 7f6d8e7fc640 1 -- 172.21.15.150:0/4157072550 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f6d9808d090 con 0x7f6d84003cb0 2024-09-17T05:41:57.292 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:57.291+0000 7f6d9febe640 1 -- 172.21.15.150:0/4157072550 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7f6d981628c0 con 0x7f6d84003cb0 2024-09-17T05:41:57.925 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:57.924+0000 7f6d8e7fc640 1 -- 172.21.15.150:0/4157072550 <== mon.0 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 2 and data pool 3 v4) ==== 172+0+0 (secure 0 0 0) 0x7f6d94047060 con 0x7f6d84003cb0 2024-09-17T05:41:57.925 INFO:teuthology.orchestra.run.smithi150.stderr:new fs with metadata pool 2 and data pool 3 2024-09-17T05:41:57.929 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:57.928+0000 7f6d9febe640 1 -- 172.21.15.150:0/4157072550 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f6d7c078bc0 msgr2=0x7f6d7c07b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:41:57.929 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:57.928+0000 7f6d9febe640 1 --2- 172.21.15.150:0/4157072550 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f6d7c078bc0 0x7f6d7c07b0d0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f6d9815c230 tx=0x7f6d88006b10 comp rx=0 tx=0).stop 2024-09-17T05:41:57.929 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:57.928+0000 7f6d9febe640 1 -- 172.21.15.150:0/4157072550 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6d84003cb0 msgr2=0x7f6d98150420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:41:57.930 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:57.928+0000 7f6d9febe640 1 --2- 172.21.15.150:0/4157072550 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6d84003cb0 0x7f6d98150420 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f6d9402b3a0 tx=0x7f6d94003f30 comp rx=0 tx=0).stop 2024-09-17T05:41:57.930 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:57.928+0000 7f6d9febe640 1 -- 172.21.15.150:0/4157072550 shutdown_connections 2024-09-17T05:41:57.930 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:57.928+0000 7f6d9febe640 1 --2- 172.21.15.150:0/4157072550 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6d9815c510 0x7f6d9806f180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:41:57.930 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:57.928+0000 7f6d9febe640 1 --2- 172.21.15.150:0/4157072550 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f6d7c078bc0 0x7f6d7c07b0d0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:41:57.930 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:57.928+0000 7f6d9febe640 1 --2- 172.21.15.150:0/4157072550 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6d9815c920 0x7f6d9806f6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:41:57.930 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:57.928+0000 7f6d9febe640 1 --2- 172.21.15.150:0/4157072550 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6d84003cb0 0x7f6d98150420 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:41:57.930 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:57.928+0000 7f6d9febe640 1 -- 172.21.15.150:0/4157072550 >> 172.21.15.150:0/4157072550 conn(0x7f6d980d4680 msgr2=0x7f6d9815e900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:41:57.930 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:57.928+0000 7f6d9febe640 1 -- 172.21.15.150:0/4157072550 shutdown_connections 2024-09-17T05:41:57.930 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:57.928+0000 7f6d9febe640 1 -- 172.21.15.150:0/4157072550 wait complete. 2024-09-17T05:41:57.961 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T05:41:58.077 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:58.076+0000 7f0c87a63640 1 -- 172.21.15.150:0/145413813 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0c800b5300 msgr2=0x7f0c800b5710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:41:58.078 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:58.076+0000 7f0c87a63640 1 --2- 172.21.15.150:0/145413813 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0c800b5300 0x7f0c800b5710 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f0c70005fd0 tx=0x7f0c7002a5d0 comp rx=0 tx=0).stop 2024-09-17T05:41:58.078 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:58.077+0000 7f0c87a63640 1 -- 172.21.15.150:0/145413813 shutdown_connections 2024-09-17T05:41:58.078 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:58.077+0000 7f0c87a63640 1 --2- 172.21.15.150:0/145413813 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0c800b5c50 0x7f0c80167180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:41:58.078 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:58.077+0000 7f0c87a63640 1 --2- 172.21.15.150:0/145413813 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0c800b5300 0x7f0c800b5710 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:41:58.078 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:58.077+0000 7f0c87a63640 1 -- 172.21.15.150:0/145413813 >> 172.21.15.150:0/145413813 conn(0x7f0c800cef30 msgr2=0x7f0c800cf340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:41:58.078 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:58.077+0000 7f0c87a63640 1 -- 172.21.15.150:0/145413813 shutdown_connections 2024-09-17T05:41:58.078 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:58.077+0000 7f0c87a63640 1 -- 172.21.15.150:0/145413813 wait complete. 2024-09-17T05:41:58.079 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:58.079+0000 7f0c87a63640 1 Processor -- start 2024-09-17T05:41:58.079 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:58.079+0000 7f0c87a63640 1 -- start start 2024-09-17T05:41:58.082 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:58.080+0000 7f0c87a63640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0c800b5300 0x7f0c801e01e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:41:58.082 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:58.080+0000 7f0c87a63640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0c800b5c50 0x7f0c801e0720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:41:58.082 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:58.080+0000 7f0c87a63640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0c800b7490 0x7f0c801e65f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:41:58.082 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:58.080+0000 7f0c87a63640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f0c800d15e0 con 0x7f0c800b5300 2024-09-17T05:41:58.082 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:58.080+0000 7f0c87a63640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f0c800d1460 con 0x7f0c800b5c50 2024-09-17T05:41:58.082 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:58.080+0000 7f0c87a63640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f0c800ceb70 con 0x7f0c800b7490 2024-09-17T05:41:58.083 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:58.080+0000 7f0c857ff640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0c800b5300 0x7f0c801e01e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:41:58.083 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:58.080+0000 7f0c857ff640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0c800b5300 0x7f0c801e01e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:44610/0 (socket says 172.21.15.150:44610) 2024-09-17T05:41:58.083 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:58.080+0000 7f0c857ff640 1 -- 172.21.15.150:0/367873443 learned_addr learned my addr 172.21.15.150:0/367873443 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:41:58.083 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:58.080+0000 7f0c84ffe640 1 --2- 172.21.15.150:0/367873443 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0c800b5c50 0x7f0c801e0720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:41:58.083 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:58.080+0000 7f0c86000640 1 --2- 172.21.15.150:0/367873443 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0c800b7490 0x7f0c801e65f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:41:58.083 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:58.080+0000 7f0c857ff640 1 -- 172.21.15.150:0/367873443 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0c800b7490 msgr2=0x7f0c801e65f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:41:58.083 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:58.080+0000 7f0c857ff640 1 --2- 172.21.15.150:0/367873443 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0c800b7490 0x7f0c801e65f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:41:58.083 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:58.080+0000 7f0c857ff640 1 -- 172.21.15.150:0/367873443 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0c800b5c50 msgr2=0x7f0c801e0720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:41:58.083 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:58.080+0000 7f0c857ff640 1 --2- 172.21.15.150:0/367873443 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0c800b5c50 0x7f0c801e0720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:41:58.083 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:58.080+0000 7f0c857ff640 1 -- 172.21.15.150:0/367873443 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0c800afde0 con 0x7f0c800b5300 2024-09-17T05:41:58.083 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:58.080+0000 7f0c86000640 1 --2- 172.21.15.150:0/367873443 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0c800b7490 0x7f0c801e65f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:41:58.083 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:58.080+0000 7f0c857ff640 1 --2- 172.21.15.150:0/367873443 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0c800b5300 0x7f0c801e01e0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f0c7c001eb0 tx=0x7f0c7c00c820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:41:58.083 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:58.081+0000 7f0c75ffb640 1 -- 172.21.15.150:0/367873443 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c7c017070 con 0x7f0c800b5300 2024-09-17T05:41:58.084 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:58.081+0000 7f0c75ffb640 1 -- 172.21.15.150:0/367873443 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0c7c0035f0 con 0x7f0c800b5300 2024-09-17T05:41:58.084 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:58.081+0000 7f0c75ffb640 1 -- 172.21.15.150:0/367873443 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c7c003a40 con 0x7f0c800b5300 2024-09-17T05:41:58.084 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:58.081+0000 7f0c87a63640 1 -- 172.21.15.150:0/367873443 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0c800b00c0 con 0x7f0c800b5300 2024-09-17T05:41:58.084 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:58.081+0000 7f0c87a63640 1 -- 172.21.15.150:0/367873443 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0c800b29d0 con 0x7f0c800b5300 2024-09-17T05:41:58.085 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:58.082+0000 7f0c87a63640 1 -- 172.21.15.150:0/367873443 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0c800b0300 con 0x7f0c800b5300 2024-09-17T05:41:58.085 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:58.083+0000 7f0c75ffb640 1 -- 172.21.15.150:0/367873443 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f0c7c01a070 con 0x7f0c800b5300 2024-09-17T05:41:58.085 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:58.083+0000 7f0c75ffb640 1 --2- 172.21.15.150:0/367873443 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f0c64078bc0 0x7f0c6407b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:41:58.085 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:58.083+0000 7f0c75ffb640 1 -- 172.21.15.150:0/367873443 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7f0c7c099e60 con 0x7f0c800b5300 2024-09-17T05:41:58.085 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:58.083+0000 7f0c84ffe640 1 --2- 172.21.15.150:0/367873443 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f0c64078bc0 0x7f0c6407b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:41:58.085 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:58.084+0000 7f0c84ffe640 1 --2- 172.21.15.150:0/367873443 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f0c64078bc0 0x7f0c6407b0d0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f0c70033000 tx=0x7f0c70004730 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:41:58.088 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:58.088+0000 7f0c75ffb640 1 -- 172.21.15.150:0/367873443 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f0c7c061ce0 con 0x7f0c800b5300 2024-09-17T05:41:58.264 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:58.264+0000 7f0c87a63640 1 -- 172.21.15.150:0/367873443 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f0c800b61d0 con 0x7f0c800b5300 2024-09-17T05:41:58.265 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:58.265+0000 7f0c75ffb640 1 -- 172.21.15.150:0/367873443 <== mon.0 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) ==== 74+0+16714 (secure 0 0 0) 0x7f0c7c066710 con 0x7f0c800b5300 2024-09-17T05:41:58.265 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-09-17T05:41:58.266 INFO:teuthology.orchestra.run.smithi150.stdout:{"epoch":22,"fsid":"9f2e05e9-d629-47b3-b26b-1360655b7d20","created":"2024-09-17T05:41:32.502979+0000","modified":"2024-09-17T05:41:57.292852+0000","last_up_change":"2024-09-17T05:41:46.150225+0000","last_in_change":"2024-09-17T05:41:36.120274+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T05:41:46.860779+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-17T05:41:55.155732+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-17T05:41:56.250888+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"4f31c018-c8a4-4d6d-b0c2-a597c47aae4a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6800","nonce":479374392},{"type":"v1","addr":"172.21.15.150:6801","nonce":479374392}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6802","nonce":479374392},{"type":"v1","addr":"172.21.15.150:6803","nonce":479374392}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6806","nonce":479374392},{"type":"v1","addr":"172.21.15.150:6807","nonce":479374392}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6804","nonce":479374392},{"type":"v1","addr":"172.21.15.150:6805","nonce":479374392}]},"public_addr":"172.21.15.150:6801/479374392","cluster_addr":"172.21.15.150:6803/479374392","heartbeat_back_addr":"172.21.15.150:6807/479374392","heartbeat_front_addr":"172.21.15.150:6805/479374392","state":["exists","up"]},{"osd":1,"uuid":"6ff4a573-500b-4e04-9de3-39265ead78b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6824","nonce":913899800},{"type":"v1","addr":"172.21.15.150:6825","nonce":913899800}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6826","nonce":913899800},{"type":"v1","addr":"172.21.15.150:6827","nonce":913899800}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6830","nonce":913899800},{"type":"v1","addr":"172.21.15.150:6831","nonce":913899800}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6828","nonce":913899800},{"type":"v1","addr":"172.21.15.150:6829","nonce":913899800}]},"public_addr":"172.21.15.150:6825/913899800","cluster_addr":"172.21.15.150:6827/913899800","heartbeat_back_addr":"172.21.15.150:6831/913899800","heartbeat_front_addr":"172.21.15.150:6829/913899800","state":["exists","up"]},{"osd":2,"uuid":"bffea6f9-2465-4182-b205-00436c41ac1c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6816","nonce":363718461},{"type":"v1","addr":"172.21.15.150:6817","nonce":363718461}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6818","nonce":363718461},{"type":"v1","addr":"172.21.15.150:6819","nonce":363718461}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6822","nonce":363718461},{"type":"v1","addr":"172.21.15.150:6823","nonce":363718461}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6820","nonce":363718461},{"type":"v1","addr":"172.21.15.150:6821","nonce":363718461}]},"public_addr":"172.21.15.150:6817/363718461","cluster_addr":"172.21.15.150:6819/363718461","heartbeat_back_addr":"172.21.15.150:6823/363718461","heartbeat_front_addr":"172.21.15.150:6821/363718461","state":["exists","up"]},{"osd":3,"uuid":"cda70430-d1e1-427e-b04e-56db4031d078","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6808","nonce":3550994626},{"type":"v1","addr":"172.21.15.150:6809","nonce":3550994626}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6810","nonce":3550994626},{"type":"v1","addr":"172.21.15.150:6811","nonce":3550994626}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6814","nonce":3550994626},{"type":"v1","addr":"172.21.15.150:6815","nonce":3550994626}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6812","nonce":3550994626},{"type":"v1","addr":"172.21.15.150:6813","nonce":3550994626}]},"public_addr":"172.21.15.150:6809/3550994626","cluster_addr":"172.21.15.150:6811/3550994626","heartbeat_back_addr":"172.21.15.150:6815/3550994626","heartbeat_front_addr":"172.21.15.150:6813/3550994626","state":["exists","up"]},{"osd":4,"uuid":"3a0277fb-5e1e-4f68-bb2d-9a8a0152f64a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6810","nonce":2718261497},{"type":"v1","addr":"172.21.15.176:6811","nonce":2718261497}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6812","nonce":2718261497},{"type":"v1","addr":"172.21.15.176:6813","nonce":2718261497}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6816","nonce":2718261497},{"type":"v1","addr":"172.21.15.176:6817","nonce":2718261497}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6814","nonce":2718261497},{"type":"v1","addr":"172.21.15.176:6815","nonce":2718261497}]},"public_addr":"172.21.15.176:6811/2718261497","cluster_addr":"172.21.15.176:6813/2718261497","heartbeat_back_addr":"172.21.15.176:6817/2718261497","heartbeat_front_addr":"172.21.15.176:6815/2718261497","state":["exists","up"]},{"osd":5,"uuid":"33aebee6-0315-40b7-a11c-6702f0be494d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6818","nonce":2049295774},{"type":"v1","addr":"172.21.15.176:6819","nonce":2049295774}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6820","nonce":2049295774},{"type":"v1","addr":"172.21.15.176:6821","nonce":2049295774}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6824","nonce":2049295774},{"type":"v1","addr":"172.21.15.176:6825","nonce":2049295774}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6822","nonce":2049295774},{"type":"v1","addr":"172.21.15.176:6823","nonce":2049295774}]},"public_addr":"172.21.15.176:6819/2049295774","cluster_addr":"172.21.15.176:6821/2049295774","heartbeat_back_addr":"172.21.15.176:6825/2049295774","heartbeat_front_addr":"172.21.15.176:6823/2049295774","state":["exists","up"]},{"osd":6,"uuid":"4d24f360-6751-4263-841b-d77793d33540","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6826","nonce":2164458476},{"type":"v1","addr":"172.21.15.176:6827","nonce":2164458476}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6828","nonce":2164458476},{"type":"v1","addr":"172.21.15.176:6829","nonce":2164458476}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6832","nonce":2164458476},{"type":"v1","addr":"172.21.15.176:6833","nonce":2164458476}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6830","nonce":2164458476},{"type":"v1","addr":"172.21.15.176:6831","nonce":2164458476}]},"public_addr":"172.21.15.176:6827/2164458476","cluster_addr":"172.21.15.176:6829/2164458476","heartbeat_back_addr":"172.21.15.176:6833/2164458476","heartbeat_front_addr":"172.21.15.176:6831/2164458476","state":["exists","up"]},{"osd":7,"uuid":"c8594fda-c74a-4ba9-8277-caf101d58ca1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6802","nonce":3239587708},{"type":"v1","addr":"172.21.15.176:6803","nonce":3239587708}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6804","nonce":3239587708},{"type":"v1","addr":"172.21.15.176:6805","nonce":3239587708}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6808","nonce":3239587708},{"type":"v1","addr":"172.21.15.176:6809","nonce":3239587708}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6806","nonce":3239587708},{"type":"v1","addr":"172.21.15.176:6807","nonce":3239587708}]},"public_addr":"172.21.15.176:6803/3239587708","cluster_addr":"172.21.15.176:6805/3239587708","heartbeat_back_addr":"172.21.15.176:6809/3239587708","heartbeat_front_addr":"172.21.15.176:6807/3239587708","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:41:41.905151+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:41:42.705679+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:41:42.459673+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:41:42.440819+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:41:42.668428+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:41:42.694972+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:41:43.078535+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:41:42.363539+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T05:41:58.268 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:58.267+0000 7f0c87a63640 1 -- 172.21.15.150:0/367873443 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f0c64078bc0 msgr2=0x7f0c6407b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:41:58.268 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:58.267+0000 7f0c87a63640 1 --2- 172.21.15.150:0/367873443 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f0c64078bc0 0x7f0c6407b0d0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f0c70033000 tx=0x7f0c70004730 comp rx=0 tx=0).stop 2024-09-17T05:41:58.268 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:58.267+0000 7f0c87a63640 1 -- 172.21.15.150:0/367873443 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0c800b5300 msgr2=0x7f0c801e01e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:41:58.268 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:58.267+0000 7f0c87a63640 1 --2- 172.21.15.150:0/367873443 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0c800b5300 0x7f0c801e01e0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f0c7c001eb0 tx=0x7f0c7c00c820 comp rx=0 tx=0).stop 2024-09-17T05:41:58.268 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:58.267+0000 7f0c87a63640 1 -- 172.21.15.150:0/367873443 shutdown_connections 2024-09-17T05:41:58.268 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:58.267+0000 7f0c87a63640 1 --2- 172.21.15.150:0/367873443 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0c800b5c50 0x7f0c801e0720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:41:58.268 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:58.267+0000 7f0c87a63640 1 --2- 172.21.15.150:0/367873443 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f0c64078bc0 0x7f0c6407b0d0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:41:58.269 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:58.267+0000 7f0c87a63640 1 --2- 172.21.15.150:0/367873443 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0c800b7490 0x7f0c801e65f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:41:58.269 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:58.267+0000 7f0c87a63640 1 --2- 172.21.15.150:0/367873443 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0c800b5300 0x7f0c801e01e0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:41:58.269 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:58.267+0000 7f0c87a63640 1 -- 172.21.15.150:0/367873443 >> 172.21.15.150:0/367873443 conn(0x7f0c800cef30 msgr2=0x7f0c801e4ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:41:58.269 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:58.267+0000 7f0c87a63640 1 -- 172.21.15.150:0/367873443 shutdown_connections 2024-09-17T05:41:58.269 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:58.267+0000 7f0c87a63640 1 -- 172.21.15.150:0/367873443 wait complete. 2024-09-17T05:41:58.279 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T05:41:58.392 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:58.392+0000 7fb4e5294640 1 -- 172.21.15.150:0/1986411232 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb4e00d4f90 msgr2=0x7fb4e00d0400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:41:58.393 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:58.392+0000 7fb4e5294640 1 --2- 172.21.15.150:0/1986411232 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb4e00d4f90 0x7fb4e00d0400 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fb4d8005fd0 tx=0x7fb4d802aa90 comp rx=0 tx=0).stop 2024-09-17T05:41:58.393 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:58.392+0000 7fb4e5294640 1 -- 172.21.15.150:0/1986411232 shutdown_connections 2024-09-17T05:41:58.393 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:58.392+0000 7fb4e5294640 1 --2- 172.21.15.150:0/1986411232 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb4e00d4f90 0x7fb4e00d0400 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:41:58.393 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:58.392+0000 7fb4e5294640 1 --2- 172.21.15.150:0/1986411232 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb4e00d1790 0x7fb4e00d2780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:41:58.393 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:58.392+0000 7fb4e5294640 1 -- 172.21.15.150:0/1986411232 >> 172.21.15.150:0/1986411232 conn(0x7fb4e008bfe0 msgr2=0x7fb4e00d4670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:41:58.393 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:58.392+0000 7fb4e5294640 1 -- 172.21.15.150:0/1986411232 shutdown_connections 2024-09-17T05:41:58.393 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:58.392+0000 7fb4e5294640 1 -- 172.21.15.150:0/1986411232 wait complete. 2024-09-17T05:41:58.394 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:58.393+0000 7fb4e5294640 1 Processor -- start 2024-09-17T05:41:58.394 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:58.394+0000 7fb4e5294640 1 -- start start 2024-09-17T05:41:58.397 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:58.395+0000 7fb4e5294640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb4e00b5d50 0x7fb4e0154270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:41:58.397 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:58.395+0000 7fb4e5294640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb4e00d4f90 0x7fb4e0158100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:41:58.397 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:58.395+0000 7fb4e5294640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb4e01555c0 0x7fb4e015a560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:41:58.397 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:58.395+0000 7fb4e5294640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7fb4e00b7af0 con 0x7fb4e00b5d50 2024-09-17T05:41:58.397 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:58.395+0000 7fb4e5294640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fb4e00b7970 con 0x7fb4e01555c0 2024-09-17T05:41:58.397 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:58.395+0000 7fb4e5294640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fb4e00b7c70 con 0x7fb4e00d4f90 2024-09-17T05:41:58.397 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:58.395+0000 7fb4deffd640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb4e00b5d50 0x7fb4e0154270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:41:58.397 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:58.395+0000 7fb4deffd640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb4e00b5d50 0x7fb4e0154270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:44618/0 (socket says 172.21.15.150:44618) 2024-09-17T05:41:58.397 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:58.395+0000 7fb4deffd640 1 -- 172.21.15.150:0/882915744 learned_addr learned my addr 172.21.15.150:0/882915744 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:41:58.397 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:58.395+0000 7fb4df7fe640 1 --2- 172.21.15.150:0/882915744 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb4e01555c0 0x7fb4e015a560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:41:58.397 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:58.395+0000 7fb4d67fc640 1 --2- 172.21.15.150:0/882915744 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb4e00d4f90 0x7fb4e0158100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:41:58.398 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:58.395+0000 7fb4deffd640 1 -- 172.21.15.150:0/882915744 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb4e00d4f90 msgr2=0x7fb4e0158100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:41:58.398 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:58.395+0000 7fb4deffd640 1 --2- 172.21.15.150:0/882915744 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb4e00d4f90 0x7fb4e0158100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:41:58.398 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:58.395+0000 7fb4deffd640 1 -- 172.21.15.150:0/882915744 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb4e01555c0 msgr2=0x7fb4e015a560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:41:58.398 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:58.395+0000 7fb4deffd640 1 --2- 172.21.15.150:0/882915744 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb4e01555c0 0x7fb4e015a560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:41:58.398 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:58.395+0000 7fb4deffd640 1 -- 172.21.15.150:0/882915744 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb4e01f9720 con 0x7fb4e00b5d50 2024-09-17T05:41:58.398 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:58.396+0000 7fb4deffd640 1 --2- 172.21.15.150:0/882915744 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb4e00b5d50 0x7fb4e0154270 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fb4d000c3d0 tx=0x7fb4d000c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:41:58.398 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:58.396+0000 7fb4d7fff640 1 -- 172.21.15.150:0/882915744 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb4d0017070 con 0x7fb4e00b5d50 2024-09-17T05:41:58.398 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:58.396+0000 7fb4d7fff640 1 -- 172.21.15.150:0/882915744 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb4d00053c0 con 0x7fb4e00b5d50 2024-09-17T05:41:58.398 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:58.396+0000 7fb4e5294640 1 -- 172.21.15.150:0/882915744 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb4e01f9a00 con 0x7fb4e00b5d50 2024-09-17T05:41:58.398 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:58.396+0000 7fb4d7fff640 1 -- 172.21.15.150:0/882915744 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb4d0003850 con 0x7fb4e00b5d50 2024-09-17T05:41:58.398 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:58.396+0000 7fb4e5294640 1 -- 172.21.15.150:0/882915744 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb4e01f9fc0 con 0x7fb4e00b5d50 2024-09-17T05:41:58.399 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:58.397+0000 7fb4e5294640 1 -- 172.21.15.150:0/882915744 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb4e00d2780 con 0x7fb4e00b5d50 2024-09-17T05:41:58.399 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:58.398+0000 7fb4d7fff640 1 -- 172.21.15.150:0/882915744 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fb4d001a070 con 0x7fb4e00b5d50 2024-09-17T05:41:58.399 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:58.398+0000 7fb4d7fff640 1 --2- 172.21.15.150:0/882915744 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fb4c0078b90 0x7fb4c007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:41:58.399 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:58.398+0000 7fb4d7fff640 1 -- 172.21.15.150:0/882915744 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7fb4d009a030 con 0x7fb4e00b5d50 2024-09-17T05:41:58.399 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:58.398+0000 7fb4d67fc640 1 --2- 172.21.15.150:0/882915744 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fb4c0078b90 0x7fb4c007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:41:58.400 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:58.399+0000 7fb4d67fc640 1 --2- 172.21.15.150:0/882915744 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fb4c0078b90 0x7fb4c007b0a0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fb4e0159dd0 tx=0x7fb4c8005f90 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:41:58.403 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:58.403+0000 7fb4d7fff640 1 -- 172.21.15.150:0/882915744 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fb4d0061e30 con 0x7fb4e00b5d50 2024-09-17T05:41:58.579 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:58.578+0000 7fb4e5294640 1 -- 172.21.15.150:0/882915744 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fb4e00a2230 con 0x7fb4e00b5d50 2024-09-17T05:41:58.580 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:58.579+0000 7fb4d7fff640 1 -- 172.21.15.150:0/882915744 <== mon.0 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) ==== 74+0+16714 (secure 0 0 0) 0x7fb4d0066860 con 0x7fb4e00b5d50 2024-09-17T05:41:58.580 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-09-17T05:41:58.580 INFO:teuthology.orchestra.run.smithi150.stdout:{"epoch":22,"fsid":"9f2e05e9-d629-47b3-b26b-1360655b7d20","created":"2024-09-17T05:41:32.502979+0000","modified":"2024-09-17T05:41:57.292852+0000","last_up_change":"2024-09-17T05:41:46.150225+0000","last_in_change":"2024-09-17T05:41:36.120274+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T05:41:46.860779+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-17T05:41:55.155732+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-17T05:41:56.250888+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"4f31c018-c8a4-4d6d-b0c2-a597c47aae4a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6800","nonce":479374392},{"type":"v1","addr":"172.21.15.150:6801","nonce":479374392}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6802","nonce":479374392},{"type":"v1","addr":"172.21.15.150:6803","nonce":479374392}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6806","nonce":479374392},{"type":"v1","addr":"172.21.15.150:6807","nonce":479374392}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6804","nonce":479374392},{"type":"v1","addr":"172.21.15.150:6805","nonce":479374392}]},"public_addr":"172.21.15.150:6801/479374392","cluster_addr":"172.21.15.150:6803/479374392","heartbeat_back_addr":"172.21.15.150:6807/479374392","heartbeat_front_addr":"172.21.15.150:6805/479374392","state":["exists","up"]},{"osd":1,"uuid":"6ff4a573-500b-4e04-9de3-39265ead78b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6824","nonce":913899800},{"type":"v1","addr":"172.21.15.150:6825","nonce":913899800}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6826","nonce":913899800},{"type":"v1","addr":"172.21.15.150:6827","nonce":913899800}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6830","nonce":913899800},{"type":"v1","addr":"172.21.15.150:6831","nonce":913899800}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6828","nonce":913899800},{"type":"v1","addr":"172.21.15.150:6829","nonce":913899800}]},"public_addr":"172.21.15.150:6825/913899800","cluster_addr":"172.21.15.150:6827/913899800","heartbeat_back_addr":"172.21.15.150:6831/913899800","heartbeat_front_addr":"172.21.15.150:6829/913899800","state":["exists","up"]},{"osd":2,"uuid":"bffea6f9-2465-4182-b205-00436c41ac1c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6816","nonce":363718461},{"type":"v1","addr":"172.21.15.150:6817","nonce":363718461}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6818","nonce":363718461},{"type":"v1","addr":"172.21.15.150:6819","nonce":363718461}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6822","nonce":363718461},{"type":"v1","addr":"172.21.15.150:6823","nonce":363718461}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6820","nonce":363718461},{"type":"v1","addr":"172.21.15.150:6821","nonce":363718461}]},"public_addr":"172.21.15.150:6817/363718461","cluster_addr":"172.21.15.150:6819/363718461","heartbeat_back_addr":"172.21.15.150:6823/363718461","heartbeat_front_addr":"172.21.15.150:6821/363718461","state":["exists","up"]},{"osd":3,"uuid":"cda70430-d1e1-427e-b04e-56db4031d078","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6808","nonce":3550994626},{"type":"v1","addr":"172.21.15.150:6809","nonce":3550994626}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6810","nonce":3550994626},{"type":"v1","addr":"172.21.15.150:6811","nonce":3550994626}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6814","nonce":3550994626},{"type":"v1","addr":"172.21.15.150:6815","nonce":3550994626}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6812","nonce":3550994626},{"type":"v1","addr":"172.21.15.150:6813","nonce":3550994626}]},"public_addr":"172.21.15.150:6809/3550994626","cluster_addr":"172.21.15.150:6811/3550994626","heartbeat_back_addr":"172.21.15.150:6815/3550994626","heartbeat_front_addr":"172.21.15.150:6813/3550994626","state":["exists","up"]},{"osd":4,"uuid":"3a0277fb-5e1e-4f68-bb2d-9a8a0152f64a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6810","nonce":2718261497},{"type":"v1","addr":"172.21.15.176:6811","nonce":2718261497}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6812","nonce":2718261497},{"type":"v1","addr":"172.21.15.176:6813","nonce":2718261497}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6816","nonce":2718261497},{"type":"v1","addr":"172.21.15.176:6817","nonce":2718261497}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6814","nonce":2718261497},{"type":"v1","addr":"172.21.15.176:6815","nonce":2718261497}]},"public_addr":"172.21.15.176:6811/2718261497","cluster_addr":"172.21.15.176:6813/2718261497","heartbeat_back_addr":"172.21.15.176:6817/2718261497","heartbeat_front_addr":"172.21.15.176:6815/2718261497","state":["exists","up"]},{"osd":5,"uuid":"33aebee6-0315-40b7-a11c-6702f0be494d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6818","nonce":2049295774},{"type":"v1","addr":"172.21.15.176:6819","nonce":2049295774}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6820","nonce":2049295774},{"type":"v1","addr":"172.21.15.176:6821","nonce":2049295774}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6824","nonce":2049295774},{"type":"v1","addr":"172.21.15.176:6825","nonce":2049295774}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6822","nonce":2049295774},{"type":"v1","addr":"172.21.15.176:6823","nonce":2049295774}]},"public_addr":"172.21.15.176:6819/2049295774","cluster_addr":"172.21.15.176:6821/2049295774","heartbeat_back_addr":"172.21.15.176:6825/2049295774","heartbeat_front_addr":"172.21.15.176:6823/2049295774","state":["exists","up"]},{"osd":6,"uuid":"4d24f360-6751-4263-841b-d77793d33540","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6826","nonce":2164458476},{"type":"v1","addr":"172.21.15.176:6827","nonce":2164458476}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6828","nonce":2164458476},{"type":"v1","addr":"172.21.15.176:6829","nonce":2164458476}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6832","nonce":2164458476},{"type":"v1","addr":"172.21.15.176:6833","nonce":2164458476}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6830","nonce":2164458476},{"type":"v1","addr":"172.21.15.176:6831","nonce":2164458476}]},"public_addr":"172.21.15.176:6827/2164458476","cluster_addr":"172.21.15.176:6829/2164458476","heartbeat_back_addr":"172.21.15.176:6833/2164458476","heartbeat_front_addr":"172.21.15.176:6831/2164458476","state":["exists","up"]},{"osd":7,"uuid":"c8594fda-c74a-4ba9-8277-caf101d58ca1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6802","nonce":3239587708},{"type":"v1","addr":"172.21.15.176:6803","nonce":3239587708}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6804","nonce":3239587708},{"type":"v1","addr":"172.21.15.176:6805","nonce":3239587708}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6808","nonce":3239587708},{"type":"v1","addr":"172.21.15.176:6809","nonce":3239587708}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6806","nonce":3239587708},{"type":"v1","addr":"172.21.15.176:6807","nonce":3239587708}]},"public_addr":"172.21.15.176:6803/3239587708","cluster_addr":"172.21.15.176:6805/3239587708","heartbeat_back_addr":"172.21.15.176:6809/3239587708","heartbeat_front_addr":"172.21.15.176:6807/3239587708","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:41:41.905151+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:41:42.705679+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:41:42.459673+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:41:42.440819+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:41:42.668428+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:41:42.694972+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:41:43.078535+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:41:42.363539+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T05:41:58.582 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:58.581+0000 7fb4e5294640 1 -- 172.21.15.150:0/882915744 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fb4c0078b90 msgr2=0x7fb4c007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:41:58.582 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:58.581+0000 7fb4e5294640 1 --2- 172.21.15.150:0/882915744 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fb4c0078b90 0x7fb4c007b0a0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fb4e0159dd0 tx=0x7fb4c8005f90 comp rx=0 tx=0).stop 2024-09-17T05:41:58.582 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:58.581+0000 7fb4e5294640 1 -- 172.21.15.150:0/882915744 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb4e00b5d50 msgr2=0x7fb4e0154270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:41:58.582 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:58.581+0000 7fb4e5294640 1 --2- 172.21.15.150:0/882915744 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb4e00b5d50 0x7fb4e0154270 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fb4d000c3d0 tx=0x7fb4d000c890 comp rx=0 tx=0).stop 2024-09-17T05:41:58.582 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:58.581+0000 7fb4e5294640 1 -- 172.21.15.150:0/882915744 shutdown_connections 2024-09-17T05:41:58.582 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:58.581+0000 7fb4e5294640 1 --2- 172.21.15.150:0/882915744 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb4e01555c0 0x7fb4e015a560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:41:58.582 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:58.581+0000 7fb4e5294640 1 --2- 172.21.15.150:0/882915744 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fb4c0078b90 0x7fb4c007b0a0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:41:58.583 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:58.582+0000 7fb4e5294640 1 --2- 172.21.15.150:0/882915744 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb4e00d4f90 0x7fb4e0158100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:41:58.583 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:58.582+0000 7fb4e5294640 1 --2- 172.21.15.150:0/882915744 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb4e00b5d50 0x7fb4e0154270 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:41:58.583 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:58.582+0000 7fb4e5294640 1 -- 172.21.15.150:0/882915744 >> 172.21.15.150:0/882915744 conn(0x7fb4e008bfe0 msgr2=0x7fb4e00d1080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:41:58.583 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:58.582+0000 7fb4e5294640 1 -- 172.21.15.150:0/882915744 shutdown_connections 2024-09-17T05:41:58.583 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:58.582+0000 7fb4e5294640 1 -- 172.21.15.150:0/882915744 wait complete. 2024-09-17T05:41:58.593 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-09-17T05:41:58.710 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:58.709+0000 7faf8c607640 1 -- 172.21.15.150:0/1367379928 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7faf84166be0 msgr2=0x7faf84169000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:41:58.710 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:58.709+0000 7faf8c607640 1 --2- 172.21.15.150:0/1367379928 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7faf84166be0 0x7faf84169000 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7faf7c005fd0 tx=0x7faf7c02aa90 comp rx=0 tx=0).stop 2024-09-17T05:41:58.710 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:58.709+0000 7faf8c607640 1 -- 172.21.15.150:0/1367379928 shutdown_connections 2024-09-17T05:41:58.710 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:58.709+0000 7faf8c607640 1 --2- 172.21.15.150:0/1367379928 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7faf84166be0 0x7faf84169000 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:41:58.711 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:58.709+0000 7faf8c607640 1 --2- 172.21.15.150:0/1367379928 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7faf840d2370 0x7faf84162fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:41:58.711 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:58.709+0000 7faf8c607640 1 -- 172.21.15.150:0/1367379928 >> 172.21.15.150:0/1367379928 conn(0x7faf840d4680 msgr2=0x7faf840d4a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:41:58.711 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:58.709+0000 7faf8c607640 1 -- 172.21.15.150:0/1367379928 shutdown_connections 2024-09-17T05:41:58.711 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:58.709+0000 7faf8c607640 1 -- 172.21.15.150:0/1367379928 wait complete. 2024-09-17T05:41:58.711 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:58.711+0000 7faf8c607640 1 Processor -- start 2024-09-17T05:41:58.712 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:58.711+0000 7faf8c607640 1 -- start start 2024-09-17T05:41:58.714 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:58.712+0000 7faf8c607640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7faf840b3ae0 0x7faf8415eaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:41:58.714 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:58.712+0000 7faf8c607640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7faf840d2370 0x7faf84156c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:41:58.714 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:58.712+0000 7faf8c607640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7faf84166be0 0x7faf84157170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:41:58.714 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:58.712+0000 7faf8c607640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7faf840d2bf0 con 0x7faf840d2370 2024-09-17T05:41:58.714 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:58.712+0000 7faf8c607640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7faf84163720 con 0x7faf840b3ae0 2024-09-17T05:41:58.715 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:58.712+0000 7faf8c607640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7faf84169540 con 0x7faf84166be0 2024-09-17T05:41:58.715 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:58.713+0000 7faf89ba2640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7faf840d2370 0x7faf84156c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:41:58.715 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:58.713+0000 7faf89ba2640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7faf840d2370 0x7faf84156c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:44622/0 (socket says 172.21.15.150:44622) 2024-09-17T05:41:58.715 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:58.713+0000 7faf89ba2640 1 -- 172.21.15.150:0/3705228574 learned_addr learned my addr 172.21.15.150:0/3705228574 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:41:58.715 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:58.713+0000 7faf8a3a3640 1 --2- 172.21.15.150:0/3705228574 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7faf840b3ae0 0x7faf8415eaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:41:58.715 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:58.713+0000 7faf8aba4640 1 --2- 172.21.15.150:0/3705228574 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7faf84166be0 0x7faf84157170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:41:58.715 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:58.713+0000 7faf89ba2640 1 -- 172.21.15.150:0/3705228574 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7faf84166be0 msgr2=0x7faf84157170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:41:58.715 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:58.713+0000 7faf89ba2640 1 --2- 172.21.15.150:0/3705228574 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7faf84166be0 0x7faf84157170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:41:58.715 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:58.713+0000 7faf89ba2640 1 -- 172.21.15.150:0/3705228574 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7faf840b3ae0 msgr2=0x7faf8415eaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:41:58.715 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:58.713+0000 7faf89ba2640 1 --2- 172.21.15.150:0/3705228574 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7faf840b3ae0 0x7faf8415eaf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:41:58.715 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:58.713+0000 7faf89ba2640 1 -- 172.21.15.150:0/3705228574 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faf840b2040 con 0x7faf840d2370 2024-09-17T05:41:58.715 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:58.713+0000 7faf89ba2640 1 --2- 172.21.15.150:0/3705228574 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7faf840d2370 0x7faf84156c30 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7faf7400e6d0 tx=0x7faf7400eb90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:41:58.715 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:58.713+0000 7faf7affd640 1 -- 172.21.15.150:0/3705228574 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf7400cab0 con 0x7faf840d2370 2024-09-17T05:41:58.716 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:58.713+0000 7faf7affd640 1 -- 172.21.15.150:0/3705228574 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7faf7400cd40 con 0x7faf840d2370 2024-09-17T05:41:58.716 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:58.713+0000 7faf8c607640 1 -- 172.21.15.150:0/3705228574 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faf840b2320 con 0x7faf840d2370 2024-09-17T05:41:58.716 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:58.713+0000 7faf7affd640 1 -- 172.21.15.150:0/3705228574 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf74010690 con 0x7faf840d2370 2024-09-17T05:41:58.716 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:58.713+0000 7faf8c607640 1 -- 172.21.15.150:0/3705228574 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faf84167090 con 0x7faf840d2370 2024-09-17T05:41:58.717 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:58.714+0000 7faf8c607640 1 -- 172.21.15.150:0/3705228574 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faf8408d090 con 0x7faf840d2370 2024-09-17T05:41:58.717 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:58.715+0000 7faf7affd640 1 -- 172.21.15.150:0/3705228574 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7faf74010830 con 0x7faf840d2370 2024-09-17T05:41:58.717 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:58.716+0000 7faf7affd640 1 --2- 172.21.15.150:0/3705228574 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7faf68078b90 0x7faf6807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:41:58.717 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:58.716+0000 7faf7affd640 1 -- 172.21.15.150:0/3705228574 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7faf7409b5c0 con 0x7faf840d2370 2024-09-17T05:41:58.717 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:58.716+0000 7faf8a3a3640 1 --2- 172.21.15.150:0/3705228574 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7faf68078b90 0x7faf6807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:41:58.717 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:58.717+0000 7faf8a3a3640 1 --2- 172.21.15.150:0/3705228574 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7faf68078b90 0x7faf6807b0a0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7faf80007fd0 tx=0x7faf80009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:41:58.720 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:58.720+0000 7faf7affd640 1 -- 172.21.15.150:0/3705228574 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7faf8408d090 con 0x7faf840d2370 2024-09-17T05:41:58.931 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:58.931+0000 7faf8c607640 1 -- 172.21.15.150:0/3705228574 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7faf841628c0 con 0x7faf840d2370 2024-09-17T05:41:58.939 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:58.939+0000 7faf7affd640 1 -- 172.21.15.150:0/3705228574 <== mon.0 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v5) ==== 118+0+0 (secure 0 0 0) 0x7faf740633c0 con 0x7faf840d2370 2024-09-17T05:41:58.943 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:58.942+0000 7faf8c607640 1 -- 172.21.15.150:0/3705228574 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7faf68078b90 msgr2=0x7faf6807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:41:58.943 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:58.942+0000 7faf8c607640 1 --2- 172.21.15.150:0/3705228574 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7faf68078b90 0x7faf6807b0a0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7faf80007fd0 tx=0x7faf80009040 comp rx=0 tx=0).stop 2024-09-17T05:41:58.943 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:58.942+0000 7faf8c607640 1 -- 172.21.15.150:0/3705228574 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7faf840d2370 msgr2=0x7faf84156c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:41:58.943 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:58.942+0000 7faf8c607640 1 --2- 172.21.15.150:0/3705228574 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7faf840d2370 0x7faf84156c30 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7faf7400e6d0 tx=0x7faf7400eb90 comp rx=0 tx=0).stop 2024-09-17T05:41:58.943 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:58.942+0000 7faf8c607640 1 -- 172.21.15.150:0/3705228574 shutdown_connections 2024-09-17T05:41:58.943 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:58.942+0000 7faf8c607640 1 --2- 172.21.15.150:0/3705228574 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7faf68078b90 0x7faf6807b0a0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:41:58.944 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:58.942+0000 7faf8c607640 1 --2- 172.21.15.150:0/3705228574 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7faf84166be0 0x7faf84157170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:41:58.944 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:58.942+0000 7faf8c607640 1 --2- 172.21.15.150:0/3705228574 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7faf840d2370 0x7faf84156c30 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:41:58.944 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:58.942+0000 7faf8c607640 1 --2- 172.21.15.150:0/3705228574 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7faf840b3ae0 0x7faf8415eaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:41:58.944 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:58.942+0000 7faf8c607640 1 -- 172.21.15.150:0/3705228574 >> 172.21.15.150:0/3705228574 conn(0x7faf840d4680 msgr2=0x7faf8406df80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:41:58.944 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:58.942+0000 7faf8c607640 1 -- 172.21.15.150:0/3705228574 shutdown_connections 2024-09-17T05:41:58.944 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:58.942+0000 7faf8c607640 1 -- 172.21.15.150:0/3705228574 wait complete. 2024-09-17T05:41:58.954 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-09-17T05:41:58.954 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-09-17T05:41:59.071 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:59.071+0000 7fc145598640 1 -- 172.21.15.150:0/4056064503 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc128005150 msgr2=0x7fc12800b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:41:59.072 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:59.071+0000 7fc145598640 1 --2- 172.21.15.150:0/4056064503 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc128005150 0x7fc12800b9c0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fc13800c2e0 tx=0x7fc128005830 comp rx=0 tx=0).stop 2024-09-17T05:41:59.072 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:59.071+0000 7fc13f7fe640 1 -- 172.21.15.150:0/4056064503 reap_dead start 2024-09-17T05:41:59.072 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:59.071+0000 7fc145598640 1 -- 172.21.15.150:0/4056064503 shutdown_connections 2024-09-17T05:41:59.072 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:59.071+0000 7fc145598640 1 -- 172.21.15.150:0/4056064503 >> 172.21.15.150:0/4056064503 conn(0x7fc1400b2ff0 msgr2=0x7fc1400b3400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:41:59.072 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:59.071+0000 7fc145598640 1 -- 172.21.15.150:0/4056064503 shutdown_connections 2024-09-17T05:41:59.072 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:59.071+0000 7fc145598640 1 -- 172.21.15.150:0/4056064503 wait complete. 2024-09-17T05:41:59.073 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:59.073+0000 7fc145598640 1 Processor -- start 2024-09-17T05:41:59.073 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:59.073+0000 7fc145598640 1 -- start start 2024-09-17T05:41:59.076 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:59.074+0000 7fc145598640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc128005150 0x7fc1400c6400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:41:59.076 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:59.074+0000 7fc145598640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc14014fb80 0x7fc1400c73b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:41:59.076 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:59.074+0000 7fc145598640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc14014db50 0x7fc1401f76c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:41:59.076 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:59.074+0000 7fc145598640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7fc14015cb00 con 0x7fc14014fb80 2024-09-17T05:41:59.076 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:59.074+0000 7fc145598640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fc1400ce0f0 con 0x7fc128005150 2024-09-17T05:41:59.076 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:59.074+0000 7fc145598640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fc14015cc80 con 0x7fc14014db50 2024-09-17T05:41:59.076 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:59.074+0000 7fc13e7fc640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc14014fb80 0x7fc1400c73b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:41:59.077 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:59.074+0000 7fc13e7fc640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc14014fb80 0x7fc1400c73b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:44642/0 (socket says 172.21.15.150:44642) 2024-09-17T05:41:59.077 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:59.074+0000 7fc13e7fc640 1 -- 172.21.15.150:0/2934184977 learned_addr learned my addr 172.21.15.150:0/2934184977 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:41:59.077 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:59.074+0000 7fc13effd640 1 --2- 172.21.15.150:0/2934184977 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc128005150 0x7fc1400c6400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:41:59.077 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:59.074+0000 7fc13f7fe640 1 --2- 172.21.15.150:0/2934184977 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc14014db50 0x7fc1401f76c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:41:59.077 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:59.074+0000 7fc13e7fc640 1 -- 172.21.15.150:0/2934184977 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc14014db50 msgr2=0x7fc1401f76c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:41:59.077 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:59.074+0000 7fc13e7fc640 1 --2- 172.21.15.150:0/2934184977 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc14014db50 0x7fc1401f76c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:41:59.077 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:59.074+0000 7fc13e7fc640 1 -- 172.21.15.150:0/2934184977 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc128005150 msgr2=0x7fc1400c6400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:41:59.077 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:59.074+0000 7fc13e7fc640 1 --2- 172.21.15.150:0/2934184977 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc128005150 0x7fc1400c6400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:41:59.077 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:59.074+0000 7fc13e7fc640 1 -- 172.21.15.150:0/2934184977 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc1401f6f00 con 0x7fc14014fb80 2024-09-17T05:41:59.077 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:59.074+0000 7fc13effd640 1 --2- 172.21.15.150:0/2934184977 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc128005150 0x7fc1400c6400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T05:41:59.077 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:59.074+0000 7fc13f7fe640 1 --2- 172.21.15.150:0/2934184977 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc14014db50 0x7fc1401f76c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T05:41:59.077 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:59.074+0000 7fc13e7fc640 1 --2- 172.21.15.150:0/2934184977 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc14014fb80 0x7fc1400c73b0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fc134011ae0 tx=0x7fc134009e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:41:59.077 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:59.075+0000 7fc1277fe640 1 -- 172.21.15.150:0/2934184977 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc13401e070 con 0x7fc14014fb80 2024-09-17T05:41:59.078 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:59.075+0000 7fc1277fe640 1 -- 172.21.15.150:0/2934184977 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc13400fe70 con 0x7fc14014fb80 2024-09-17T05:41:59.078 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:59.075+0000 7fc1277fe640 1 -- 172.21.15.150:0/2934184977 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1340042b0 con 0x7fc14014fb80 2024-09-17T05:41:59.078 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:59.075+0000 7fc145598640 1 -- 172.21.15.150:0/2934184977 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc1401f44d0 con 0x7fc14014fb80 2024-09-17T05:41:59.078 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:59.075+0000 7fc145598640 1 -- 172.21.15.150:0/2934184977 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc1401f47b0 con 0x7fc14014fb80 2024-09-17T05:41:59.078 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:59.076+0000 7fc145598640 1 -- 172.21.15.150:0/2934184977 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc14015d000 con 0x7fc14014fb80 2024-09-17T05:41:59.078 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:59.077+0000 7fc1277fe640 1 -- 172.21.15.150:0/2934184977 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fc134021070 con 0x7fc14014fb80 2024-09-17T05:41:59.079 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:59.077+0000 7fc1277fe640 1 --2- 172.21.15.150:0/2934184977 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fc12c078bc0 0x7fc12c07b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:41:59.079 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:59.077+0000 7fc1277fe640 1 -- 172.21.15.150:0/2934184977 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7fc13409b680 con 0x7fc14014fb80 2024-09-17T05:41:59.079 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:59.077+0000 7fc13effd640 1 --2- 172.21.15.150:0/2934184977 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fc12c078bc0 0x7fc12c07b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:41:59.079 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:59.078+0000 7fc13effd640 1 --2- 172.21.15.150:0/2934184977 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fc12c078bc0 0x7fc12c07b0d0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fc1400ceeb0 tx=0x7fc130003a00 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:41:59.082 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:59.082+0000 7fc1277fe640 1 -- 172.21.15.150:0/2934184977 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fc134063590 con 0x7fc14014fb80 2024-09-17T05:41:59.294 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:59.293+0000 7fc145598640 1 -- 172.21.15.150:0/2934184977 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7fc1400b2070 con 0x7fc14014fb80 2024-09-17T05:41:59.945 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:59.944+0000 7fc1277fe640 1 -- 172.21.15.150:0/2934184977 <== mon.0 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v6) ==== 122+0+0 (secure 0 0 0) 0x7fc134067fc0 con 0x7fc14014fb80 2024-09-17T05:41:59.948 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:59.947+0000 7fc145598640 1 -- 172.21.15.150:0/2934184977 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fc12c078bc0 msgr2=0x7fc12c07b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:41:59.948 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:59.947+0000 7fc145598640 1 --2- 172.21.15.150:0/2934184977 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fc12c078bc0 0x7fc12c07b0d0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fc1400ceeb0 tx=0x7fc130003a00 comp rx=0 tx=0).stop 2024-09-17T05:41:59.948 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:59.947+0000 7fc145598640 1 -- 172.21.15.150:0/2934184977 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc14014fb80 msgr2=0x7fc1400c73b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:41:59.948 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:59.947+0000 7fc145598640 1 --2- 172.21.15.150:0/2934184977 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc14014fb80 0x7fc1400c73b0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fc134011ae0 tx=0x7fc134009e80 comp rx=0 tx=0).stop 2024-09-17T05:41:59.948 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:59.947+0000 7fc145598640 1 -- 172.21.15.150:0/2934184977 shutdown_connections 2024-09-17T05:41:59.948 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:59.947+0000 7fc145598640 1 --2- 172.21.15.150:0/2934184977 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fc12c078bc0 0x7fc12c07b0d0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:41:59.948 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:59.947+0000 7fc145598640 1 --2- 172.21.15.150:0/2934184977 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc14014db50 0x7fc1401f76c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:41:59.948 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:59.947+0000 7fc145598640 1 --2- 172.21.15.150:0/2934184977 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc14014fb80 0x7fc1400c73b0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:41:59.948 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:59.947+0000 7fc145598640 1 --2- 172.21.15.150:0/2934184977 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc128005150 0x7fc1400c6400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:41:59.948 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:59.947+0000 7fc145598640 1 -- 172.21.15.150:0/2934184977 >> 172.21.15.150:0/2934184977 conn(0x7fc1400b2ff0 msgr2=0x7fc1400b2480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:41:59.948 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:59.947+0000 7fc145598640 1 -- 172.21.15.150:0/2934184977 shutdown_connections 2024-09-17T05:41:59.948 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:41:59.947+0000 7fc145598640 1 -- 172.21.15.150:0/2934184977 wait complete. 2024-09-17T05:41:59.959 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-09-17T05:41:59.959 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T05:42:00.074 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:00.073+0000 7f87a9b89640 1 -- 172.21.15.150:0/2333888639 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f878c0040d0 msgr2=0x7f878c004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:00.074 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:00.073+0000 7f87a9b89640 1 --2- 172.21.15.150:0/2333888639 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f878c0040d0 0x7f878c004800 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f879800bb20 tx=0x7f878c005830 comp rx=0 tx=0).stop 2024-09-17T05:42:00.074 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:00.073+0000 7f87a3fff640 1 -- 172.21.15.150:0/2333888639 reap_dead start 2024-09-17T05:42:00.075 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:00.073+0000 7f87a9b89640 1 -- 172.21.15.150:0/2333888639 shutdown_connections 2024-09-17T05:42:00.075 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:00.073+0000 7f87a9b89640 1 -- 172.21.15.150:0/2333888639 >> 172.21.15.150:0/2333888639 conn(0x7f87a40d0b50 msgr2=0x7f87a40d0f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:42:00.075 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:00.073+0000 7f87a9b89640 1 -- 172.21.15.150:0/2333888639 shutdown_connections 2024-09-17T05:42:00.075 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:00.073+0000 7f87a9b89640 1 -- 172.21.15.150:0/2333888639 wait complete. 2024-09-17T05:42:00.076 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:00.075+0000 7f87a9b89640 1 Processor -- start 2024-09-17T05:42:00.076 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:00.075+0000 7f87a9b89640 1 -- start start 2024-09-17T05:42:00.078 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:00.077+0000 7f87a9b89640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f878c0040d0 0x7f87a4151560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:42:00.078 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:00.077+0000 7f87a9b89640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f87a406cda0 0x7f87a406d1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:42:00.079 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:00.077+0000 7f87a9b89640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f87a4158590 0x7f87a41589a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:42:00.079 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:00.077+0000 7f87a9b89640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f87a4160040 con 0x7f87a4158590 2024-09-17T05:42:00.079 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:00.077+0000 7f87a9b89640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f87a415fec0 con 0x7f878c0040d0 2024-09-17T05:42:00.079 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:00.077+0000 7f87a9b89640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f87a41601c0 con 0x7f87a406cda0 2024-09-17T05:42:00.079 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:00.077+0000 7f87a3fff640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f87a4158590 0x7f87a41589a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:42:00.079 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:00.077+0000 7f87a3fff640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f87a4158590 0x7f87a41589a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:44664/0 (socket says 172.21.15.150:44664) 2024-09-17T05:42:00.079 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:00.077+0000 7f87a3fff640 1 -- 172.21.15.150:0/1085103435 learned_addr learned my addr 172.21.15.150:0/1085103435 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:42:00.079 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:00.077+0000 7f87a2ffd640 1 --2- 172.21.15.150:0/1085103435 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f87a406cda0 0x7f87a406d1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:42:00.079 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:00.077+0000 7f87a37fe640 1 --2- 172.21.15.150:0/1085103435 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f878c0040d0 0x7f87a4151560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:42:00.079 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:00.077+0000 7f87a3fff640 1 -- 172.21.15.150:0/1085103435 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f87a406cda0 msgr2=0x7f87a406d1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:00.079 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:00.077+0000 7f87a3fff640 1 --2- 172.21.15.150:0/1085103435 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f87a406cda0 0x7f87a406d1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:00.079 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:00.077+0000 7f87a3fff640 1 -- 172.21.15.150:0/1085103435 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f878c0040d0 msgr2=0x7f87a4151560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:00.079 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:00.077+0000 7f87a3fff640 1 --2- 172.21.15.150:0/1085103435 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f878c0040d0 0x7f87a4151560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:00.080 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:00.077+0000 7f87a3fff640 1 -- 172.21.15.150:0/1085103435 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f87a406d6f0 con 0x7f87a4158590 2024-09-17T05:42:00.080 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:00.077+0000 7f87a37fe640 1 --2- 172.21.15.150:0/1085103435 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f878c0040d0 0x7f87a4151560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T05:42:00.080 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:00.077+0000 7f87a3fff640 1 --2- 172.21.15.150:0/1085103435 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f87a4158590 0x7f87a41589a0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f879c0013d0 tx=0x7f879c006720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:42:00.080 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:00.077+0000 7f878bfff640 1 -- 172.21.15.150:0/1085103435 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f879c00fa80 con 0x7f87a4158590 2024-09-17T05:42:00.080 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:00.077+0000 7f878bfff640 1 -- 172.21.15.150:0/1085103435 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f879c00fc40 con 0x7f87a4158590 2024-09-17T05:42:00.080 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:00.077+0000 7f878bfff640 1 -- 172.21.15.150:0/1085103435 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f879c011430 con 0x7f87a4158590 2024-09-17T05:42:00.080 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:00.077+0000 7f87a9b89640 1 -- 172.21.15.150:0/1085103435 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f87a4158ee0 con 0x7f87a4158590 2024-09-17T05:42:00.080 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:00.078+0000 7f87a9b89640 1 -- 172.21.15.150:0/1085103435 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f87a41f91c0 con 0x7f87a4158590 2024-09-17T05:42:00.081 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:00.079+0000 7f87a9b89640 1 -- 172.21.15.150:0/1085103435 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f87a4071c70 con 0x7f87a4158590 2024-09-17T05:42:00.081 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:00.079+0000 7f878bfff640 1 -- 172.21.15.150:0/1085103435 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f879c0115d0 con 0x7f87a4158590 2024-09-17T05:42:00.081 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:00.080+0000 7f878bfff640 1 --2- 172.21.15.150:0/1085103435 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f8790078bc0 0x7f879007b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:42:00.081 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:00.080+0000 7f878bfff640 1 -- 172.21.15.150:0/1085103435 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f879c09b710 con 0x7f87a4158590 2024-09-17T05:42:00.081 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:00.080+0000 7f87a37fe640 1 --2- 172.21.15.150:0/1085103435 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f8790078bc0 0x7f879007b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:42:00.081 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:00.081+0000 7f87a37fe640 1 --2- 172.21.15.150:0/1085103435 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f8790078bc0 0x7f879007b0d0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f8794000c00 tx=0x7f8794006b70 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:42:00.085 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:00.084+0000 7f878bfff640 1 -- 172.21.15.150:0/1085103435 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f87a406d6f0 con 0x7f87a4158590 2024-09-17T05:42:00.295 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:00.294+0000 7f87a9b89640 1 -- 172.21.15.150:0/1085103435 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f87a4075d20 con 0x7f87a4158590 2024-09-17T05:42:00.295 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:00.295+0000 7f878bfff640 1 -- 172.21.15.150:0/1085103435 <== mon.0 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) ==== 93+0+5226 (secure 0 0 0) 0x7f879c063b50 con 0x7f87a4158590 2024-09-17T05:42:00.296 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-09-17T05:42:00.296 INFO:teuthology.orchestra.run.smithi150.stdout:{"epoch":6,"btime":"2024-09-17T05:41:59:940454+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4316,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6835/357154046","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6833","nonce":357154046},{"type":"v1","addr":"172.21.15.150:6835","nonce":357154046}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4377,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6834/2757381484","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6832","nonce":2757381484},{"type":"v1","addr":"172.21.15.150:6834","nonce":2757381484}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4411,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6835/3751002674","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6834","nonce":3751002674},{"type":"v1","addr":"172.21.15.176:6835","nonce":3751002674}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T05:41:57.292807+0000","modified":"2024-09-17T05:41:59.294767+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4414},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4414":{"gid":4414,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.176:6837/1714683410","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6836","nonce":1714683410},{"type":"v1","addr":"172.21.15.176:6837","nonce":1714683410}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4414,"qdb_cluster":[4414]},"id":1}]} 2024-09-17T05:42:00.296 INFO:teuthology.orchestra.run.smithi150.stderr:dumped fsmap epoch 6 2024-09-17T05:42:00.298 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:00.297+0000 7f87a9b89640 1 -- 172.21.15.150:0/1085103435 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f8790078bc0 msgr2=0x7f879007b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:00.298 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:00.297+0000 7f87a9b89640 1 --2- 172.21.15.150:0/1085103435 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f8790078bc0 0x7f879007b0d0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f8794000c00 tx=0x7f8794006b70 comp rx=0 tx=0).stop 2024-09-17T05:42:00.298 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:00.297+0000 7f87a9b89640 1 -- 172.21.15.150:0/1085103435 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f87a4158590 msgr2=0x7f87a41589a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:00.298 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:00.297+0000 7f87a9b89640 1 --2- 172.21.15.150:0/1085103435 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f87a4158590 0x7f87a41589a0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f879c0013d0 tx=0x7f879c006720 comp rx=0 tx=0).stop 2024-09-17T05:42:00.298 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:00.297+0000 7f87a9b89640 1 -- 172.21.15.150:0/1085103435 shutdown_connections 2024-09-17T05:42:00.299 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:00.297+0000 7f87a9b89640 1 --2- 172.21.15.150:0/1085103435 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f8790078bc0 0x7f879007b0d0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:00.299 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:00.297+0000 7f87a9b89640 1 --2- 172.21.15.150:0/1085103435 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f87a4158590 0x7f87a41589a0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:00.299 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:00.297+0000 7f87a9b89640 1 --2- 172.21.15.150:0/1085103435 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f87a406cda0 0x7f87a406d1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:00.299 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:00.297+0000 7f87a9b89640 1 --2- 172.21.15.150:0/1085103435 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f878c0040d0 0x7f87a4151560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:00.299 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:00.297+0000 7f87a9b89640 1 -- 172.21.15.150:0/1085103435 >> 172.21.15.150:0/1085103435 conn(0x7f87a40d0b50 msgr2=0x7f87a40b0a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:42:00.299 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:00.298+0000 7f87a9b89640 1 -- 172.21.15.150:0/1085103435 shutdown_connections 2024-09-17T05:42:00.299 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:00.298+0000 7f87a9b89640 1 -- 172.21.15.150:0/1085103435 wait complete. 2024-09-17T05:42:00.309 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T05:42:00.422 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:00.422+0000 7f253de8b640 1 -- 172.21.15.150:0/95624507 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f25380d50c0 msgr2=0x7f25380d0240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:00.422 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:00.422+0000 7f253de8b640 1 --2- 172.21.15.150:0/95624507 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f25380d50c0 0x7f25380d0240 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f253808d340 tx=0x7f252c02a4a0 comp rx=0 tx=0).stop 2024-09-17T05:42:00.423 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:00.422+0000 7f253de8b640 1 -- 172.21.15.150:0/95624507 shutdown_connections 2024-09-17T05:42:00.423 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:00.422+0000 7f253de8b640 1 --2- 172.21.15.150:0/95624507 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f25380d50c0 0x7f25380d0240 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:00.423 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:00.422+0000 7f253de8b640 1 --2- 172.21.15.150:0/95624507 >> v2:172.21.15.176:3300/0 conn(0x7f25380b9d10 0x7f25380d2f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:00.423 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:00.422+0000 7f253de8b640 1 -- 172.21.15.150:0/95624507 >> 172.21.15.150:0/95624507 conn(0x7f253808bfe0 msgr2=0x7f25380d4650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:42:00.423 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:00.422+0000 7f253de8b640 1 -- 172.21.15.150:0/95624507 shutdown_connections 2024-09-17T05:42:00.423 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:00.422+0000 7f253de8b640 1 -- 172.21.15.150:0/95624507 wait complete. 2024-09-17T05:42:00.423 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:00.423+0000 7f253de8b640 1 Processor -- start 2024-09-17T05:42:00.424 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:00.424+0000 7f253de8b640 1 -- start start 2024-09-17T05:42:00.426 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:00.425+0000 7f253de8b640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f25380b9d10 0x7f253809f1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:42:00.427 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:00.425+0000 7f253de8b640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f25380d1020 0x7f25380c9740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:42:00.427 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:00.425+0000 7f253de8b640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f25380d50c0 0x7f25380c8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:42:00.427 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:00.425+0000 7f253de8b640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f25380b4300 con 0x7f25380d50c0 2024-09-17T05:42:00.427 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:00.425+0000 7f253de8b640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f25380b4180 con 0x7f25380b9d10 2024-09-17T05:42:00.427 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:00.425+0000 7f253de8b640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f25380b4480 con 0x7f25380d1020 2024-09-17T05:42:00.427 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:00.425+0000 7f2537fff640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f25380d50c0 0x7f25380c8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:42:00.427 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:00.425+0000 7f2537fff640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f25380d50c0 0x7f25380c8b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:54322/0 (socket says 172.21.15.150:54322) 2024-09-17T05:42:00.427 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:00.425+0000 7f2537fff640 1 -- 172.21.15.150:0/1381797502 learned_addr learned my addr 172.21.15.150:0/1381797502 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:42:00.427 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:00.425+0000 7f25377fe640 1 --2- 172.21.15.150:0/1381797502 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f25380b9d10 0x7f253809f1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:42:00.427 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:00.425+0000 7f2536ffd640 1 --2- 172.21.15.150:0/1381797502 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f25380d1020 0x7f25380c9740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:42:00.427 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:00.425+0000 7f2537fff640 1 -- 172.21.15.150:0/1381797502 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f25380d1020 msgr2=0x7f25380c9740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:00.427 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:00.425+0000 7f2537fff640 1 --2- 172.21.15.150:0/1381797502 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f25380d1020 0x7f25380c9740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:00.428 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:00.425+0000 7f2537fff640 1 -- 172.21.15.150:0/1381797502 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f25380b9d10 msgr2=0x7f253809f1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:00.428 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:00.425+0000 7f2537fff640 1 --2- 172.21.15.150:0/1381797502 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f25380b9d10 0x7f253809f1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:00.428 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:00.425+0000 7f2537fff640 1 -- 172.21.15.150:0/1381797502 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f253809f710 con 0x7f25380d50c0 2024-09-17T05:42:00.428 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:00.425+0000 7f25377fe640 1 --2- 172.21.15.150:0/1381797502 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f25380b9d10 0x7f253809f1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:42:00.428 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:00.425+0000 7f2537fff640 1 --2- 172.21.15.150:0/1381797502 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f25380d50c0 0x7f25380c8b90 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f253000ca80 tx=0x7f253000cf40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:42:00.428 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:00.426+0000 7f251ffff640 1 -- 172.21.15.150:0/1381797502 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2530016020 con 0x7f25380d50c0 2024-09-17T05:42:00.428 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:00.426+0000 7f251ffff640 1 -- 172.21.15.150:0/1381797502 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f253000ad20 con 0x7f25380d50c0 2024-09-17T05:42:00.428 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:00.426+0000 7f253de8b640 1 -- 172.21.15.150:0/1381797502 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f25380c9c80 con 0x7f25380d50c0 2024-09-17T05:42:00.428 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:00.426+0000 7f251ffff640 1 -- 172.21.15.150:0/1381797502 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2530012680 con 0x7f25380d50c0 2024-09-17T05:42:00.428 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:00.426+0000 7f253de8b640 1 -- 172.21.15.150:0/1381797502 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f25381f6580 con 0x7f25380d50c0 2024-09-17T05:42:00.429 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:00.427+0000 7f253de8b640 1 -- 172.21.15.150:0/1381797502 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f25380b4950 con 0x7f25380d50c0 2024-09-17T05:42:00.429 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:00.427+0000 7f251ffff640 1 -- 172.21.15.150:0/1381797502 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f2530019020 con 0x7f25380d50c0 2024-09-17T05:42:00.429 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:00.428+0000 7f251ffff640 1 --2- 172.21.15.150:0/1381797502 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f2524078b90 0x7f252407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:42:00.429 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:00.428+0000 7f251ffff640 1 -- 172.21.15.150:0/1381797502 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f253009b350 con 0x7f25380d50c0 2024-09-17T05:42:00.429 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:00.428+0000 7f25377fe640 1 --2- 172.21.15.150:0/1381797502 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f2524078b90 0x7f252407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:42:00.430 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:00.429+0000 7f25377fe640 1 --2- 172.21.15.150:0/1381797502 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f2524078b90 0x7f252407b0a0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f2528005fd0 tx=0x7f252800f360 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:42:00.433 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:00.432+0000 7f251ffff640 1 -- 172.21.15.150:0/1381797502 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f2530020020 con 0x7f25380d50c0 2024-09-17T05:42:00.607 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:00.607+0000 7f253de8b640 1 -- 172.21.15.150:0/1381797502 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f25380d1db0 con 0x7f25380d50c0 2024-09-17T05:42:00.608 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:00.608+0000 7f251ffff640 1 -- 172.21.15.150:0/1381797502 <== mon.0 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) ==== 74+0+16701 (secure 0 0 0) 0x7f253809f710 con 0x7f25380d50c0 2024-09-17T05:42:00.609 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-09-17T05:42:00.609 INFO:teuthology.orchestra.run.smithi150.stdout:{"epoch":23,"fsid":"9f2e05e9-d629-47b3-b26b-1360655b7d20","created":"2024-09-17T05:41:32.502979+0000","modified":"2024-09-17T05:41:58.934156+0000","last_up_change":"2024-09-17T05:41:46.150225+0000","last_in_change":"2024-09-17T05:41:36.120274+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T05:41:46.860779+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-17T05:41:55.155732+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-17T05:41:56.250888+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"4f31c018-c8a4-4d6d-b0c2-a597c47aae4a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6800","nonce":479374392},{"type":"v1","addr":"172.21.15.150:6801","nonce":479374392}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6802","nonce":479374392},{"type":"v1","addr":"172.21.15.150:6803","nonce":479374392}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6806","nonce":479374392},{"type":"v1","addr":"172.21.15.150:6807","nonce":479374392}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6804","nonce":479374392},{"type":"v1","addr":"172.21.15.150:6805","nonce":479374392}]},"public_addr":"172.21.15.150:6801/479374392","cluster_addr":"172.21.15.150:6803/479374392","heartbeat_back_addr":"172.21.15.150:6807/479374392","heartbeat_front_addr":"172.21.15.150:6805/479374392","state":["exists","up"]},{"osd":1,"uuid":"6ff4a573-500b-4e04-9de3-39265ead78b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6824","nonce":913899800},{"type":"v1","addr":"172.21.15.150:6825","nonce":913899800}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6826","nonce":913899800},{"type":"v1","addr":"172.21.15.150:6827","nonce":913899800}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6830","nonce":913899800},{"type":"v1","addr":"172.21.15.150:6831","nonce":913899800}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6828","nonce":913899800},{"type":"v1","addr":"172.21.15.150:6829","nonce":913899800}]},"public_addr":"172.21.15.150:6825/913899800","cluster_addr":"172.21.15.150:6827/913899800","heartbeat_back_addr":"172.21.15.150:6831/913899800","heartbeat_front_addr":"172.21.15.150:6829/913899800","state":["exists","up"]},{"osd":2,"uuid":"bffea6f9-2465-4182-b205-00436c41ac1c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6816","nonce":363718461},{"type":"v1","addr":"172.21.15.150:6817","nonce":363718461}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6818","nonce":363718461},{"type":"v1","addr":"172.21.15.150:6819","nonce":363718461}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6822","nonce":363718461},{"type":"v1","addr":"172.21.15.150:6823","nonce":363718461}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6820","nonce":363718461},{"type":"v1","addr":"172.21.15.150:6821","nonce":363718461}]},"public_addr":"172.21.15.150:6817/363718461","cluster_addr":"172.21.15.150:6819/363718461","heartbeat_back_addr":"172.21.15.150:6823/363718461","heartbeat_front_addr":"172.21.15.150:6821/363718461","state":["exists","up"]},{"osd":3,"uuid":"cda70430-d1e1-427e-b04e-56db4031d078","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6808","nonce":3550994626},{"type":"v1","addr":"172.21.15.150:6809","nonce":3550994626}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6810","nonce":3550994626},{"type":"v1","addr":"172.21.15.150:6811","nonce":3550994626}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6814","nonce":3550994626},{"type":"v1","addr":"172.21.15.150:6815","nonce":3550994626}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6812","nonce":3550994626},{"type":"v1","addr":"172.21.15.150:6813","nonce":3550994626}]},"public_addr":"172.21.15.150:6809/3550994626","cluster_addr":"172.21.15.150:6811/3550994626","heartbeat_back_addr":"172.21.15.150:6815/3550994626","heartbeat_front_addr":"172.21.15.150:6813/3550994626","state":["exists","up"]},{"osd":4,"uuid":"3a0277fb-5e1e-4f68-bb2d-9a8a0152f64a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6810","nonce":2718261497},{"type":"v1","addr":"172.21.15.176:6811","nonce":2718261497}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6812","nonce":2718261497},{"type":"v1","addr":"172.21.15.176:6813","nonce":2718261497}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6816","nonce":2718261497},{"type":"v1","addr":"172.21.15.176:6817","nonce":2718261497}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6814","nonce":2718261497},{"type":"v1","addr":"172.21.15.176:6815","nonce":2718261497}]},"public_addr":"172.21.15.176:6811/2718261497","cluster_addr":"172.21.15.176:6813/2718261497","heartbeat_back_addr":"172.21.15.176:6817/2718261497","heartbeat_front_addr":"172.21.15.176:6815/2718261497","state":["exists","up"]},{"osd":5,"uuid":"33aebee6-0315-40b7-a11c-6702f0be494d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6818","nonce":2049295774},{"type":"v1","addr":"172.21.15.176:6819","nonce":2049295774}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6820","nonce":2049295774},{"type":"v1","addr":"172.21.15.176:6821","nonce":2049295774}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6824","nonce":2049295774},{"type":"v1","addr":"172.21.15.176:6825","nonce":2049295774}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6822","nonce":2049295774},{"type":"v1","addr":"172.21.15.176:6823","nonce":2049295774}]},"public_addr":"172.21.15.176:6819/2049295774","cluster_addr":"172.21.15.176:6821/2049295774","heartbeat_back_addr":"172.21.15.176:6825/2049295774","heartbeat_front_addr":"172.21.15.176:6823/2049295774","state":["exists","up"]},{"osd":6,"uuid":"4d24f360-6751-4263-841b-d77793d33540","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6826","nonce":2164458476},{"type":"v1","addr":"172.21.15.176:6827","nonce":2164458476}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6828","nonce":2164458476},{"type":"v1","addr":"172.21.15.176:6829","nonce":2164458476}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6832","nonce":2164458476},{"type":"v1","addr":"172.21.15.176:6833","nonce":2164458476}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6830","nonce":2164458476},{"type":"v1","addr":"172.21.15.176:6831","nonce":2164458476}]},"public_addr":"172.21.15.176:6827/2164458476","cluster_addr":"172.21.15.176:6829/2164458476","heartbeat_back_addr":"172.21.15.176:6833/2164458476","heartbeat_front_addr":"172.21.15.176:6831/2164458476","state":["exists","up"]},{"osd":7,"uuid":"c8594fda-c74a-4ba9-8277-caf101d58ca1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6802","nonce":3239587708},{"type":"v1","addr":"172.21.15.176:6803","nonce":3239587708}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6804","nonce":3239587708},{"type":"v1","addr":"172.21.15.176:6805","nonce":3239587708}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6808","nonce":3239587708},{"type":"v1","addr":"172.21.15.176:6809","nonce":3239587708}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6806","nonce":3239587708},{"type":"v1","addr":"172.21.15.176:6807","nonce":3239587708}]},"public_addr":"172.21.15.176:6803/3239587708","cluster_addr":"172.21.15.176:6805/3239587708","heartbeat_back_addr":"172.21.15.176:6809/3239587708","heartbeat_front_addr":"172.21.15.176:6807/3239587708","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:41:41.905151+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:41:42.705679+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:41:42.459673+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:41:42.440819+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:41:42.668428+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:41:42.694972+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:41:43.078535+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:41:42.363539+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T05:42:00.611 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:00.610+0000 7f253de8b640 1 -- 172.21.15.150:0/1381797502 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f2524078b90 msgr2=0x7f252407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:00.611 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:00.610+0000 7f253de8b640 1 --2- 172.21.15.150:0/1381797502 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f2524078b90 0x7f252407b0a0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f2528005fd0 tx=0x7f252800f360 comp rx=0 tx=0).stop 2024-09-17T05:42:00.611 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:00.610+0000 7f253de8b640 1 -- 172.21.15.150:0/1381797502 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f25380d50c0 msgr2=0x7f25380c8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:00.612 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:00.610+0000 7f253de8b640 1 --2- 172.21.15.150:0/1381797502 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f25380d50c0 0x7f25380c8b90 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f253000ca80 tx=0x7f253000cf40 comp rx=0 tx=0).stop 2024-09-17T05:42:00.612 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:00.610+0000 7f253de8b640 1 -- 172.21.15.150:0/1381797502 shutdown_connections 2024-09-17T05:42:00.612 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:00.610+0000 7f253de8b640 1 --2- 172.21.15.150:0/1381797502 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f2524078b90 0x7f252407b0a0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:00.612 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:00.611+0000 7f253de8b640 1 --2- 172.21.15.150:0/1381797502 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f25380d50c0 0x7f25380c8b90 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:00.612 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:00.611+0000 7f253de8b640 1 --2- 172.21.15.150:0/1381797502 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f25380d1020 0x7f25380c9740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:00.612 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:00.611+0000 7f253de8b640 1 --2- 172.21.15.150:0/1381797502 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f25380b9d10 0x7f253809f1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:00.612 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:00.611+0000 7f253de8b640 1 -- 172.21.15.150:0/1381797502 >> 172.21.15.150:0/1381797502 conn(0x7f253808bfe0 msgr2=0x7f25380d2cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:42:00.612 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:00.611+0000 7f253de8b640 1 -- 172.21.15.150:0/1381797502 shutdown_connections 2024-09-17T05:42:00.612 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:00.611+0000 7f253de8b640 1 -- 172.21.15.150:0/1381797502 wait complete. 2024-09-17T05:42:00.623 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-17T05:42:00.623 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-17T05:42:00.736 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:00.735+0000 7f3180c4a640 1 -- 172.21.15.150:0/214247114 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f317c0b3720 msgr2=0x7f317c0d1090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:00.736 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:00.735+0000 7f3180c4a640 1 --2- 172.21.15.150:0/214247114 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f317c0b3720 0x7f317c0d1090 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f3170009830 tx=0x7f317002a530 comp rx=0 tx=0).stop 2024-09-17T05:42:00.736 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:00.735+0000 7f3180c4a640 1 -- 172.21.15.150:0/214247114 shutdown_connections 2024-09-17T05:42:00.736 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:00.735+0000 7f3180c4a640 1 --2- 172.21.15.150:0/214247114 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f317c0b3720 0x7f317c0d1090 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:00.736 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:00.735+0000 7f3180c4a640 1 -- 172.21.15.150:0/214247114 >> 172.21.15.150:0/214247114 conn(0x7f317c0d4680 msgr2=0x7f317c0d4a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:42:00.736 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:00.735+0000 7f3180c4a640 1 -- 172.21.15.150:0/214247114 shutdown_connections 2024-09-17T05:42:00.736 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:00.735+0000 7f3180c4a640 1 -- 172.21.15.150:0/214247114 wait complete. 2024-09-17T05:42:00.737 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:00.737+0000 7f3180c4a640 1 Processor -- start 2024-09-17T05:42:00.737 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:00.737+0000 7f3180c4a640 1 -- start start 2024-09-17T05:42:00.740 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:00.738+0000 7f3180c4a640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f317c0b3720 0x7f317c0ce120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:42:00.740 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:00.738+0000 7f3180c4a640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f317c0b9780 0x7f317c1f9810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:42:00.740 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:00.738+0000 7f3180c4a640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f317c0d15d0 0x7f317c1f9d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:42:00.740 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:00.738+0000 7f3180c4a640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f317c0cffc0 con 0x7f317c0b3720 2024-09-17T05:42:00.740 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:00.738+0000 7f3180c4a640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f317c0cfe40 con 0x7f317c0d15d0 2024-09-17T05:42:00.740 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:00.738+0000 7f3180c4a640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f317c0d0140 con 0x7f317c0b9780 2024-09-17T05:42:00.741 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:00.738+0000 7f317a59c640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f317c0b3720 0x7f317c0ce120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:42:00.741 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:00.738+0000 7f317a59c640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f317c0b3720 0x7f317c0ce120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:54332/0 (socket says 172.21.15.150:54332) 2024-09-17T05:42:00.741 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:00.738+0000 7f317a59c640 1 -- 172.21.15.150:0/3256750970 learned_addr learned my addr 172.21.15.150:0/3256750970 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:42:00.741 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:00.739+0000 7f3179d9b640 1 --2- 172.21.15.150:0/3256750970 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f317c0b9780 0x7f317c1f9810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:42:00.741 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:00.738+0000 7f317ad9d640 1 --2- 172.21.15.150:0/3256750970 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f317c0d15d0 0x7f317c1f9d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:42:00.741 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:00.739+0000 7f317a59c640 1 -- 172.21.15.150:0/3256750970 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f317c0b9780 msgr2=0x7f317c1f9810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:00.741 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:00.739+0000 7f317a59c640 1 --2- 172.21.15.150:0/3256750970 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f317c0b9780 0x7f317c1f9810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:00.741 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:00.739+0000 7f317a59c640 1 -- 172.21.15.150:0/3256750970 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f317c0d15d0 msgr2=0x7f317c1f9d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:00.741 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:00.739+0000 7f317a59c640 1 --2- 172.21.15.150:0/3256750970 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f317c0d15d0 0x7f317c1f9d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:00.741 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:00.739+0000 7f317a59c640 1 -- 172.21.15.150:0/3256750970 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f317c0b5600 con 0x7f317c0b3720 2024-09-17T05:42:00.741 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:00.739+0000 7f317a59c640 1 --2- 172.21.15.150:0/3256750970 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f317c0b3720 0x7f317c0ce120 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f316c00c400 tx=0x7f316c00c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:42:00.741 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:00.739+0000 7f316affd640 1 -- 172.21.15.150:0/3256750970 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f316c017070 con 0x7f317c0b3720 2024-09-17T05:42:00.741 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:00.739+0000 7f316affd640 1 -- 172.21.15.150:0/3256750970 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f316c0053c0 con 0x7f317c0b3720 2024-09-17T05:42:00.742 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:00.739+0000 7f3180c4a640 1 -- 172.21.15.150:0/3256750970 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f317c0b58e0 con 0x7f317c0b3720 2024-09-17T05:42:00.742 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:00.739+0000 7f316affd640 1 -- 172.21.15.150:0/3256750970 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f316c0038a0 con 0x7f317c0b3720 2024-09-17T05:42:00.742 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:00.739+0000 7f3180c4a640 1 -- 172.21.15.150:0/3256750970 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f317c155830 con 0x7f317c0b3720 2024-09-17T05:42:00.744 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:00.740+0000 7f3180c4a640 1 -- 172.21.15.150:0/3256750970 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f317c08d100 con 0x7f317c0b3720 2024-09-17T05:42:00.744 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:00.741+0000 7f316affd640 1 -- 172.21.15.150:0/3256750970 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f316c01a070 con 0x7f317c0b3720 2024-09-17T05:42:00.744 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:00.741+0000 7f316affd640 1 --2- 172.21.15.150:0/3256750970 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f315c078b90 0x7f315c07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:42:00.744 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:00.741+0000 7f316affd640 1 -- 172.21.15.150:0/3256750970 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f316c09a0b0 con 0x7f317c0b3720 2024-09-17T05:42:00.744 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:00.742+0000 7f3179d9b640 1 --2- 172.21.15.150:0/3256750970 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f315c078b90 0x7f315c07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:42:00.745 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:00.742+0000 7f3179d9b640 1 --2- 172.21.15.150:0/3256750970 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f315c078b90 0x7f315c07b0a0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f3170034000 tx=0x7f3170004730 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:42:00.746 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:00.746+0000 7f316affd640 1 -- 172.21.15.150:0/3256750970 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f317c08d100 con 0x7f317c0b3720 2024-09-17T05:42:00.917 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:00.916+0000 7f3180c4a640 1 -- 172.21.15.150:0/3256750970 --> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f317c0d0660 con 0x7f315c078b90 2024-09-17T05:42:00.922 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:00.922+0000 7f316affd640 1 -- 172.21.15.150:0/3256750970 <== mgr.4108 v2:172.21.15.176:6800/3631216395 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+242492 (secure 0 0 0) 0x7f317c0d0660 con 0x7f315c078b90 2024-09-17T05:42:00.925 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-09-17T05:42:00.926 INFO:teuthology.orchestra.run.smithi150.stderr:dumped all 2024-09-17T05:42:00.928 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:00.925+0000 7f3180c4a640 1 -- 172.21.15.150:0/3256750970 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f315c078b90 msgr2=0x7f315c07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:00.928 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:00.925+0000 7f3180c4a640 1 --2- 172.21.15.150:0/3256750970 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f315c078b90 0x7f315c07b0a0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f3170034000 tx=0x7f3170004730 comp rx=0 tx=0).stop 2024-09-17T05:42:00.928 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:00.925+0000 7f3180c4a640 1 -- 172.21.15.150:0/3256750970 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f317c0b3720 msgr2=0x7f317c0ce120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:00.928 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:00.925+0000 7f3180c4a640 1 --2- 172.21.15.150:0/3256750970 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f317c0b3720 0x7f317c0ce120 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f316c00c400 tx=0x7f316c00c8c0 comp rx=0 tx=0).stop 2024-09-17T05:42:00.928 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:00.925+0000 7f3180c4a640 1 -- 172.21.15.150:0/3256750970 shutdown_connections 2024-09-17T05:42:00.928 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:00.925+0000 7f3180c4a640 1 --2- 172.21.15.150:0/3256750970 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f317c0d15d0 0x7f317c1f9d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:00.928 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:00.925+0000 7f3180c4a640 1 --2- 172.21.15.150:0/3256750970 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f315c078b90 0x7f315c07b0a0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:00.928 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:00.925+0000 7f3180c4a640 1 --2- 172.21.15.150:0/3256750970 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f317c0b9780 0x7f317c1f9810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:00.928 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:00.925+0000 7f3180c4a640 1 --2- 172.21.15.150:0/3256750970 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f317c0b3720 0x7f317c0ce120 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:00.929 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:00.925+0000 7f3180c4a640 1 -- 172.21.15.150:0/3256750970 >> 172.21.15.150:0/3256750970 conn(0x7f317c0d4680 msgr2=0x7f317c06df20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:42:00.929 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:00.925+0000 7f3180c4a640 1 -- 172.21.15.150:0/3256750970 shutdown_connections 2024-09-17T05:42:00.929 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:00.925+0000 7f3180c4a640 1 -- 172.21.15.150:0/3256750970 wait complete. 2024-09-17T05:42:00.936 INFO:teuthology.orchestra.run.smithi150.stdout:{"pg_ready":true,"pg_map":{"version":25,"stamp":"2024-09-17T05:42:00.844629+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590984,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":108,"num_write_kb":1636,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":78,"ondisk_log_size":78,"up":100,"acting":100,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":22,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219140,"kb_used_data":2652,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755580,"statfs":{"total":773094113280,"available":772869713920,"internally_reserved":0,"allocated":2715648,"data_stored":1658722,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":14,"apply_latency_ms":14,"commit_latency_ns":14000000,"apply_latency_ns":14000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":616,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.925201"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:41:56.913963+0000","last_change":"2024-09-17T05:41:56.913963+0000","last_active":"2024-09-17T05:41:56.913963+0000","last_peered":"2024-09-17T05:41:56.913963+0000","last_clean":"2024-09-17T05:41:56.913963+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:41:56.913963+0000","last_undegraded":"2024-09-17T05:41:56.913963+0000","last_fullsized":"2024-09-17T05:41:56.913963+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_clean_scrub_stamp":"2024-09-17T05:41:56.913963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:41:56.913963+0000","last_change":"2024-09-17T05:41:56.913963+0000","last_active":"2024-09-17T05:41:56.913963+0000","last_peered":"2024-09-17T05:41:56.913963+0000","last_clean":"2024-09-17T05:41:56.913963+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:41:56.913963+0000","last_undegraded":"2024-09-17T05:41:56.913963+0000","last_fullsized":"2024-09-17T05:41:56.913963+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_clean_scrub_stamp":"2024-09-17T05:41:56.913963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T05:41:57.946892+0000","last_change":"2024-09-17T05:41:57.935841+0000","last_active":"2024-09-17T05:41:57.946892+0000","last_peered":"2024-09-17T05:41:57.946892+0000","last_clean":"2024-09-17T05:41:57.946892+0000","last_became_active":"2024-09-17T05:41:57.935502+0000","last_became_peered":"2024-09-17T05:41:57.935502+0000","last_unstale":"2024-09-17T05:41:57.946892+0000","last_undegraded":"2024-09-17T05:41:57.946892+0000","last_fullsized":"2024-09-17T05:41:57.946892+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_clean_scrub_stamp":"2024-09-17T05:41:56.913963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:18:37.706664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:41:56.913963+0000","last_change":"2024-09-17T05:41:56.913963+0000","last_active":"2024-09-17T05:41:56.913963+0000","last_peered":"2024-09-17T05:41:56.913963+0000","last_clean":"2024-09-17T05:41:56.913963+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:41:56.913963+0000","last_undegraded":"2024-09-17T05:41:56.913963+0000","last_fullsized":"2024-09-17T05:41:56.913963+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_clean_scrub_stamp":"2024-09-17T05:41:56.913963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:41:56.913963+0000","last_change":"2024-09-17T05:41:56.913963+0000","last_active":"2024-09-17T05:41:56.913963+0000","last_peered":"2024-09-17T05:41:56.913963+0000","last_clean":"2024-09-17T05:41:56.913963+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:41:56.913963+0000","last_undegraded":"2024-09-17T05:41:56.913963+0000","last_fullsized":"2024-09-17T05:41:56.913963+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_clean_scrub_stamp":"2024-09-17T05:41:56.913963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:41:56.913963+0000","last_change":"2024-09-17T05:41:56.913963+0000","last_active":"2024-09-17T05:41:56.913963+0000","last_peered":"2024-09-17T05:41:56.913963+0000","last_clean":"2024-09-17T05:41:56.913963+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:41:56.913963+0000","last_undegraded":"2024-09-17T05:41:56.913963+0000","last_fullsized":"2024-09-17T05:41:56.913963+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_clean_scrub_stamp":"2024-09-17T05:41:56.913963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:41:56.913963+0000","last_change":"2024-09-17T05:41:56.913963+0000","last_active":"2024-09-17T05:41:56.913963+0000","last_peered":"2024-09-17T05:41:56.913963+0000","last_clean":"2024-09-17T05:41:56.913963+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:41:56.913963+0000","last_undegraded":"2024-09-17T05:41:56.913963+0000","last_fullsized":"2024-09-17T05:41:56.913963+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_clean_scrub_stamp":"2024-09-17T05:41:56.913963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:41:56.913963+0000","last_change":"2024-09-17T05:41:56.913963+0000","last_active":"2024-09-17T05:41:56.913963+0000","last_peered":"2024-09-17T05:41:56.913963+0000","last_clean":"2024-09-17T05:41:56.913963+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:41:56.913963+0000","last_undegraded":"2024-09-17T05:41:56.913963+0000","last_fullsized":"2024-09-17T05:41:56.913963+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_clean_scrub_stamp":"2024-09-17T05:41:56.913963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:41:56.913963+0000","last_change":"2024-09-17T05:41:56.913963+0000","last_active":"2024-09-17T05:41:56.913963+0000","last_peered":"2024-09-17T05:41:56.913963+0000","last_clean":"2024-09-17T05:41:56.913963+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:41:56.913963+0000","last_undegraded":"2024-09-17T05:41:56.913963+0000","last_fullsized":"2024-09-17T05:41:56.913963+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_clean_scrub_stamp":"2024-09-17T05:41:56.913963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-17T05:41:56.938399+0000","last_change":"2024-09-17T05:41:56.938399+0000","last_active":"2024-09-17T05:41:56.913963+0000","last_peered":"2024-09-17T05:41:56.913963+0000","last_clean":"2024-09-17T05:41:56.913963+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:41:56.938399+0000","last_undegraded":"2024-09-17T05:41:56.938399+0000","last_fullsized":"2024-09-17T05:41:56.938399+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_clean_scrub_stamp":"2024-09-17T05:41:56.913963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-17T05:41:56.935343+0000","last_change":"2024-09-17T05:41:56.935343+0000","last_active":"2024-09-17T05:41:56.913963+0000","last_peered":"2024-09-17T05:41:56.913963+0000","last_clean":"2024-09-17T05:41:56.913963+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:41:56.935343+0000","last_undegraded":"2024-09-17T05:41:56.935343+0000","last_fullsized":"2024-09-17T05:41:56.935343+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_clean_scrub_stamp":"2024-09-17T05:41:56.913963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:41:56.913963+0000","last_change":"2024-09-17T05:41:56.913963+0000","last_active":"2024-09-17T05:41:56.913963+0000","last_peered":"2024-09-17T05:41:56.913963+0000","last_clean":"2024-09-17T05:41:56.913963+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:41:56.913963+0000","last_undegraded":"2024-09-17T05:41:56.913963+0000","last_fullsized":"2024-09-17T05:41:56.913963+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_clean_scrub_stamp":"2024-09-17T05:41:56.913963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:41:56.913963+0000","last_change":"2024-09-17T05:41:56.913963+0000","last_active":"2024-09-17T05:41:56.913963+0000","last_peered":"2024-09-17T05:41:56.913963+0000","last_clean":"2024-09-17T05:41:56.913963+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:41:56.913963+0000","last_undegraded":"2024-09-17T05:41:56.913963+0000","last_fullsized":"2024-09-17T05:41:56.913963+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_clean_scrub_stamp":"2024-09-17T05:41:56.913963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T05:41:57.958581+0000","last_change":"2024-09-17T05:41:57.950142+0000","last_active":"2024-09-17T05:41:57.958581+0000","last_peered":"2024-09-17T05:41:57.958581+0000","last_clean":"2024-09-17T05:41:57.958581+0000","last_became_active":"2024-09-17T05:41:57.949825+0000","last_became_peered":"2024-09-17T05:41:57.949825+0000","last_unstale":"2024-09-17T05:41:57.958581+0000","last_undegraded":"2024-09-17T05:41:57.958581+0000","last_fullsized":"2024-09-17T05:41:57.958581+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_clean_scrub_stamp":"2024-09-17T05:41:56.913963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:03:45.612206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:41:56.913963+0000","last_change":"2024-09-17T05:41:56.913963+0000","last_active":"2024-09-17T05:41:56.913963+0000","last_peered":"2024-09-17T05:41:56.913963+0000","last_clean":"2024-09-17T05:41:56.913963+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:41:56.913963+0000","last_undegraded":"2024-09-17T05:41:56.913963+0000","last_fullsized":"2024-09-17T05:41:56.913963+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_clean_scrub_stamp":"2024-09-17T05:41:56.913963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:41:56.913963+0000","last_change":"2024-09-17T05:41:56.913963+0000","last_active":"2024-09-17T05:41:56.913963+0000","last_peered":"2024-09-17T05:41:56.913963+0000","last_clean":"2024-09-17T05:41:56.913963+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:41:56.913963+0000","last_undegraded":"2024-09-17T05:41:56.913963+0000","last_fullsized":"2024-09-17T05:41:56.913963+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_clean_scrub_stamp":"2024-09-17T05:41:56.913963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:41:56.913963+0000","last_change":"2024-09-17T05:41:56.913963+0000","last_active":"2024-09-17T05:41:56.913963+0000","last_peered":"2024-09-17T05:41:56.913963+0000","last_clean":"2024-09-17T05:41:56.913963+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:41:56.913963+0000","last_undegraded":"2024-09-17T05:41:56.913963+0000","last_fullsized":"2024-09-17T05:41:56.913963+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_clean_scrub_stamp":"2024-09-17T05:41:56.913963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:41:56.913963+0000","last_change":"2024-09-17T05:41:56.913963+0000","last_active":"2024-09-17T05:41:56.913963+0000","last_peered":"2024-09-17T05:41:56.913963+0000","last_clean":"2024-09-17T05:41:56.913963+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:41:56.913963+0000","last_undegraded":"2024-09-17T05:41:56.913963+0000","last_fullsized":"2024-09-17T05:41:56.913963+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_clean_scrub_stamp":"2024-09-17T05:41:56.913963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:41:56.913963+0000","last_change":"2024-09-17T05:41:56.913963+0000","last_active":"2024-09-17T05:41:56.913963+0000","last_peered":"2024-09-17T05:41:56.913963+0000","last_clean":"2024-09-17T05:41:56.913963+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:41:56.913963+0000","last_undegraded":"2024-09-17T05:41:56.913963+0000","last_fullsized":"2024-09-17T05:41:56.913963+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_clean_scrub_stamp":"2024-09-17T05:41:56.913963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-17T05:41:56.933458+0000","last_change":"2024-09-17T05:41:56.933458+0000","last_active":"2024-09-17T05:41:56.913963+0000","last_peered":"2024-09-17T05:41:56.913963+0000","last_clean":"2024-09-17T05:41:56.913963+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:41:56.933458+0000","last_undegraded":"2024-09-17T05:41:56.933458+0000","last_fullsized":"2024-09-17T05:41:56.933458+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_clean_scrub_stamp":"2024-09-17T05:41:56.913963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T05:41:57.960003+0000","last_change":"2024-09-17T05:41:57.952830+0000","last_active":"2024-09-17T05:41:57.960003+0000","last_peered":"2024-09-17T05:41:57.960003+0000","last_clean":"2024-09-17T05:41:57.960003+0000","last_became_active":"2024-09-17T05:41:57.952504+0000","last_became_peered":"2024-09-17T05:41:57.952504+0000","last_unstale":"2024-09-17T05:41:57.960003+0000","last_undegraded":"2024-09-17T05:41:57.960003+0000","last_fullsized":"2024-09-17T05:41:57.960003+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_clean_scrub_stamp":"2024-09-17T05:41:56.913963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:54:59.834514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:41:56.913963+0000","last_change":"2024-09-17T05:41:56.913963+0000","last_active":"2024-09-17T05:41:56.913963+0000","last_peered":"2024-09-17T05:41:56.913963+0000","last_clean":"2024-09-17T05:41:56.913963+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:41:56.913963+0000","last_undegraded":"2024-09-17T05:41:56.913963+0000","last_fullsized":"2024-09-17T05:41:56.913963+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_clean_scrub_stamp":"2024-09-17T05:41:56.913963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:41:56.913963+0000","last_change":"2024-09-17T05:41:56.913963+0000","last_active":"2024-09-17T05:41:56.913963+0000","last_peered":"2024-09-17T05:41:56.913963+0000","last_clean":"2024-09-17T05:41:56.913963+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:41:56.913963+0000","last_undegraded":"2024-09-17T05:41:56.913963+0000","last_fullsized":"2024-09-17T05:41:56.913963+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_clean_scrub_stamp":"2024-09-17T05:41:56.913963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:41:56.913963+0000","last_change":"2024-09-17T05:41:56.913963+0000","last_active":"2024-09-17T05:41:56.913963+0000","last_peered":"2024-09-17T05:41:56.913963+0000","last_clean":"2024-09-17T05:41:56.913963+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:41:56.913963+0000","last_undegraded":"2024-09-17T05:41:56.913963+0000","last_fullsized":"2024-09-17T05:41:56.913963+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_clean_scrub_stamp":"2024-09-17T05:41:56.913963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:41:56.913963+0000","last_change":"2024-09-17T05:41:56.913963+0000","last_active":"2024-09-17T05:41:56.913963+0000","last_peered":"2024-09-17T05:41:56.913963+0000","last_clean":"2024-09-17T05:41:56.913963+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:41:56.913963+0000","last_undegraded":"2024-09-17T05:41:56.913963+0000","last_fullsized":"2024-09-17T05:41:56.913963+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_clean_scrub_stamp":"2024-09-17T05:41:56.913963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-17T05:41:56.936595+0000","last_change":"2024-09-17T05:41:56.936595+0000","last_active":"2024-09-17T05:41:56.913963+0000","last_peered":"2024-09-17T05:41:56.913963+0000","last_clean":"2024-09-17T05:41:56.913963+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:41:56.936595+0000","last_undegraded":"2024-09-17T05:41:56.936595+0000","last_fullsized":"2024-09-17T05:41:56.936595+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_clean_scrub_stamp":"2024-09-17T05:41:56.913963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:41:56.913963+0000","last_change":"2024-09-17T05:41:56.913963+0000","last_active":"2024-09-17T05:41:56.913963+0000","last_peered":"2024-09-17T05:41:56.913963+0000","last_clean":"2024-09-17T05:41:56.913963+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:41:56.913963+0000","last_undegraded":"2024-09-17T05:41:56.913963+0000","last_fullsized":"2024-09-17T05:41:56.913963+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_clean_scrub_stamp":"2024-09-17T05:41:56.913963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:41:56.913963+0000","last_change":"2024-09-17T05:41:56.913963+0000","last_active":"2024-09-17T05:41:56.913963+0000","last_peered":"2024-09-17T05:41:56.913963+0000","last_clean":"2024-09-17T05:41:56.913963+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:41:56.913963+0000","last_undegraded":"2024-09-17T05:41:56.913963+0000","last_fullsized":"2024-09-17T05:41:56.913963+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_clean_scrub_stamp":"2024-09-17T05:41:56.913963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T05:41:57.958478+0000","last_change":"2024-09-17T05:41:57.948114+0000","last_active":"2024-09-17T05:41:57.958478+0000","last_peered":"2024-09-17T05:41:57.958478+0000","last_clean":"2024-09-17T05:41:57.958478+0000","last_became_active":"2024-09-17T05:41:57.947671+0000","last_became_peered":"2024-09-17T05:41:57.947671+0000","last_unstale":"2024-09-17T05:41:57.958478+0000","last_undegraded":"2024-09-17T05:41:57.958478+0000","last_fullsized":"2024-09-17T05:41:57.958478+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_clean_scrub_stamp":"2024-09-17T05:41:56.913963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:04:06.812125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:41:56.913963+0000","last_change":"2024-09-17T05:41:56.913963+0000","last_active":"2024-09-17T05:41:56.913963+0000","last_peered":"2024-09-17T05:41:56.913963+0000","last_clean":"2024-09-17T05:41:56.913963+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:41:56.913963+0000","last_undegraded":"2024-09-17T05:41:56.913963+0000","last_fullsized":"2024-09-17T05:41:56.913963+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_clean_scrub_stamp":"2024-09-17T05:41:56.913963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:41:56.913963+0000","last_change":"2024-09-17T05:41:56.913963+0000","last_active":"2024-09-17T05:41:56.913963+0000","last_peered":"2024-09-17T05:41:56.913963+0000","last_clean":"2024-09-17T05:41:56.913963+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:41:56.913963+0000","last_undegraded":"2024-09-17T05:41:56.913963+0000","last_fullsized":"2024-09-17T05:41:56.913963+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_clean_scrub_stamp":"2024-09-17T05:41:56.913963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-17T05:41:56.933616+0000","last_change":"2024-09-17T05:41:56.933616+0000","last_active":"2024-09-17T05:41:56.913963+0000","last_peered":"2024-09-17T05:41:56.913963+0000","last_clean":"2024-09-17T05:41:56.913963+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:41:56.933616+0000","last_undegraded":"2024-09-17T05:41:56.933616+0000","last_fullsized":"2024-09-17T05:41:56.933616+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_clean_scrub_stamp":"2024-09-17T05:41:56.913963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:41:56.913963+0000","last_change":"2024-09-17T05:41:56.913963+0000","last_active":"2024-09-17T05:41:56.913963+0000","last_peered":"2024-09-17T05:41:56.913963+0000","last_clean":"2024-09-17T05:41:56.913963+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:41:56.913963+0000","last_undegraded":"2024-09-17T05:41:56.913963+0000","last_fullsized":"2024-09-17T05:41:56.913963+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_clean_scrub_stamp":"2024-09-17T05:41:56.913963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1b","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-09-17T05:41:55.922157+0000","last_change":"2024-09-17T05:41:55.922157+0000","last_active":"2024-09-17T05:41:55.904533+0000","last_peered":"2024-09-17T05:41:55.904533+0000","last_clean":"2024-09-17T05:41:55.904533+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:41:55.922157+0000","last_undegraded":"2024-09-17T05:41:55.922157+0000","last_fullsized":"2024-09-17T05:41:55.922157+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:55.904533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:55.904533+0000","last_clean_scrub_stamp":"2024-09-17T05:41:55.904533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T05:41:57.947971+0000","last_change":"2024-09-17T05:41:57.943603+0000","last_active":"2024-09-17T05:41:57.947971+0000","last_peered":"2024-09-17T05:41:57.947971+0000","last_clean":"2024-09-17T05:41:57.947971+0000","last_became_active":"2024-09-17T05:41:57.942873+0000","last_became_peered":"2024-09-17T05:41:57.942873+0000","last_unstale":"2024-09-17T05:41:57.947971+0000","last_undegraded":"2024-09-17T05:41:57.947971+0000","last_fullsized":"2024-09-17T05:41:57.947971+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_clean_scrub_stamp":"2024-09-17T05:41:56.913963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:05:08.948164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:41:56.945810+0000","last_change":"2024-09-17T05:41:56.940706+0000","last_active":"2024-09-17T05:41:56.945810+0000","last_peered":"2024-09-17T05:41:56.945810+0000","last_clean":"2024-09-17T05:41:56.945810+0000","last_became_active":"2024-09-17T05:41:56.940324+0000","last_became_peered":"2024-09-17T05:41:56.940324+0000","last_unstale":"2024-09-17T05:41:56.945810+0000","last_undegraded":"2024-09-17T05:41:56.945810+0000","last_fullsized":"2024-09-17T05:41:56.945810+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:55.904533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:55.904533+0000","last_clean_scrub_stamp":"2024-09-17T05:41:55.904533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:39:10.329477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-09-17T05:41:55.922588+0000","last_change":"2024-09-17T05:41:55.922588+0000","last_active":"2024-09-17T05:41:55.904533+0000","last_peered":"2024-09-17T05:41:55.904533+0000","last_clean":"2024-09-17T05:41:55.904533+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:41:55.922588+0000","last_undegraded":"2024-09-17T05:41:55.922588+0000","last_fullsized":"2024-09-17T05:41:55.922588+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:55.904533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:55.904533+0000","last_clean_scrub_stamp":"2024-09-17T05:41:55.904533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:41:56.913963+0000","last_change":"2024-09-17T05:41:56.913963+0000","last_active":"2024-09-17T05:41:56.913963+0000","last_peered":"2024-09-17T05:41:56.913963+0000","last_clean":"2024-09-17T05:41:56.913963+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:41:56.913963+0000","last_undegraded":"2024-09-17T05:41:56.913963+0000","last_fullsized":"2024-09-17T05:41:56.913963+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_clean_scrub_stamp":"2024-09-17T05:41:56.913963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-09-17T05:41:55.922741+0000","last_change":"2024-09-17T05:41:55.922741+0000","last_active":"2024-09-17T05:41:55.904533+0000","last_peered":"2024-09-17T05:41:55.904533+0000","last_clean":"2024-09-17T05:41:55.904533+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:41:55.922741+0000","last_undegraded":"2024-09-17T05:41:55.922741+0000","last_fullsized":"2024-09-17T05:41:55.922741+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:55.904533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:55.904533+0000","last_clean_scrub_stamp":"2024-09-17T05:41:55.904533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:41:56.913963+0000","last_change":"2024-09-17T05:41:56.913963+0000","last_active":"2024-09-17T05:41:56.913963+0000","last_peered":"2024-09-17T05:41:56.913963+0000","last_clean":"2024-09-17T05:41:56.913963+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:41:56.913963+0000","last_undegraded":"2024-09-17T05:41:56.913963+0000","last_fullsized":"2024-09-17T05:41:56.913963+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_clean_scrub_stamp":"2024-09-17T05:41:56.913963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:41:56.954501+0000","last_change":"2024-09-17T05:41:56.949682+0000","last_active":"2024-09-17T05:41:56.954501+0000","last_peered":"2024-09-17T05:41:56.954501+0000","last_clean":"2024-09-17T05:41:56.954501+0000","last_became_active":"2024-09-17T05:41:56.949271+0000","last_became_peered":"2024-09-17T05:41:56.949271+0000","last_unstale":"2024-09-17T05:41:56.954501+0000","last_undegraded":"2024-09-17T05:41:56.954501+0000","last_fullsized":"2024-09-17T05:41:56.954501+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:55.904533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:55.904533+0000","last_clean_scrub_stamp":"2024-09-17T05:41:55.904533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:09:34.572426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:41:56.913963+0000","last_change":"2024-09-17T05:41:56.913963+0000","last_active":"2024-09-17T05:41:56.913963+0000","last_peered":"2024-09-17T05:41:56.913963+0000","last_clean":"2024-09-17T05:41:56.913963+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:41:56.913963+0000","last_undegraded":"2024-09-17T05:41:56.913963+0000","last_fullsized":"2024-09-17T05:41:56.913963+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_clean_scrub_stamp":"2024-09-17T05:41:56.913963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-09-17T05:41:55.924578+0000","last_change":"2024-09-17T05:41:55.924578+0000","last_active":"2024-09-17T05:41:55.904533+0000","last_peered":"2024-09-17T05:41:55.904533+0000","last_clean":"2024-09-17T05:41:55.904533+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:41:55.924578+0000","last_undegraded":"2024-09-17T05:41:55.924578+0000","last_fullsized":"2024-09-17T05:41:55.924578+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:55.904533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:55.904533+0000","last_clean_scrub_stamp":"2024-09-17T05:41:55.904533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T05:41:57.958506+0000","last_change":"2024-09-17T05:41:57.948150+0000","last_active":"2024-09-17T05:41:57.958506+0000","last_peered":"2024-09-17T05:41:57.958506+0000","last_clean":"2024-09-17T05:41:57.958506+0000","last_became_active":"2024-09-17T05:41:57.947204+0000","last_became_peered":"2024-09-17T05:41:57.947204+0000","last_unstale":"2024-09-17T05:41:57.958506+0000","last_undegraded":"2024-09-17T05:41:57.958506+0000","last_fullsized":"2024-09-17T05:41:57.958506+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_clean_scrub_stamp":"2024-09-17T05:41:56.913963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:06:52.563709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-09-17T05:41:55.919928+0000","last_change":"2024-09-17T05:41:55.919928+0000","last_active":"2024-09-17T05:41:55.904533+0000","last_peered":"2024-09-17T05:41:55.904533+0000","last_clean":"2024-09-17T05:41:55.904533+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:41:55.919928+0000","last_undegraded":"2024-09-17T05:41:55.919928+0000","last_fullsized":"2024-09-17T05:41:55.919928+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:55.904533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:55.904533+0000","last_clean_scrub_stamp":"2024-09-17T05:41:55.904533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:41:56.913963+0000","last_change":"2024-09-17T05:41:56.913963+0000","last_active":"2024-09-17T05:41:56.913963+0000","last_peered":"2024-09-17T05:41:56.913963+0000","last_clean":"2024-09-17T05:41:56.913963+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:41:56.913963+0000","last_undegraded":"2024-09-17T05:41:56.913963+0000","last_fullsized":"2024-09-17T05:41:56.913963+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_clean_scrub_stamp":"2024-09-17T05:41:56.913963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.14","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:41:56.954521+0000","last_change":"2024-09-17T05:41:56.951074+0000","last_active":"2024-09-17T05:41:56.954521+0000","last_peered":"2024-09-17T05:41:56.954521+0000","last_clean":"2024-09-17T05:41:56.954521+0000","last_became_active":"2024-09-17T05:41:56.950549+0000","last_became_peered":"2024-09-17T05:41:56.950549+0000","last_unstale":"2024-09-17T05:41:56.954521+0000","last_undegraded":"2024-09-17T05:41:56.954521+0000","last_fullsized":"2024-09-17T05:41:56.954521+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:55.904533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:55.904533+0000","last_clean_scrub_stamp":"2024-09-17T05:41:55.904533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:21:08.994692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:41:56.913963+0000","last_change":"2024-09-17T05:41:56.913963+0000","last_active":"2024-09-17T05:41:56.913963+0000","last_peered":"2024-09-17T05:41:56.913963+0000","last_clean":"2024-09-17T05:41:56.913963+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:41:56.913963+0000","last_undegraded":"2024-09-17T05:41:56.913963+0000","last_fullsized":"2024-09-17T05:41:56.913963+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_clean_scrub_stamp":"2024-09-17T05:41:56.913963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.13","version":"22'2","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T05:41:57.963820+0000","last_change":"2024-09-17T05:41:56.939288+0000","last_active":"2024-09-17T05:41:57.963820+0000","last_peered":"2024-09-17T05:41:57.963820+0000","last_clean":"2024-09-17T05:41:57.963820+0000","last_became_active":"2024-09-17T05:41:56.938951+0000","last_became_peered":"2024-09-17T05:41:56.938951+0000","last_unstale":"2024-09-17T05:41:57.963820+0000","last_undegraded":"2024-09-17T05:41:57.963820+0000","last_fullsized":"2024-09-17T05:41:57.963820+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:55.904533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:55.904533+0000","last_clean_scrub_stamp":"2024-09-17T05:41:55.904533+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:41:47.665206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T05:41:57.960149+0000","last_change":"2024-09-17T05:41:57.953556+0000","last_active":"2024-09-17T05:41:57.960149+0000","last_peered":"2024-09-17T05:41:57.960149+0000","last_clean":"2024-09-17T05:41:57.960149+0000","last_became_active":"2024-09-17T05:41:57.953229+0000","last_became_peered":"2024-09-17T05:41:57.953229+0000","last_unstale":"2024-09-17T05:41:57.960149+0000","last_undegraded":"2024-09-17T05:41:57.960149+0000","last_fullsized":"2024-09-17T05:41:57.960149+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_clean_scrub_stamp":"2024-09-17T05:41:56.913963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:31:05.269290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-09-17T05:41:55.925889+0000","last_change":"2024-09-17T05:41:55.925889+0000","last_active":"2024-09-17T05:41:55.904533+0000","last_peered":"2024-09-17T05:41:55.904533+0000","last_clean":"2024-09-17T05:41:55.904533+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:41:55.925889+0000","last_undegraded":"2024-09-17T05:41:55.925889+0000","last_fullsized":"2024-09-17T05:41:55.925889+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:55.904533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:55.904533+0000","last_clean_scrub_stamp":"2024-09-17T05:41:55.904533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:41:56.913963+0000","last_change":"2024-09-17T05:41:56.913963+0000","last_active":"2024-09-17T05:41:56.913963+0000","last_peered":"2024-09-17T05:41:56.913963+0000","last_clean":"2024-09-17T05:41:56.913963+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:41:56.913963+0000","last_undegraded":"2024-09-17T05:41:56.913963+0000","last_fullsized":"2024-09-17T05:41:56.913963+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_clean_scrub_stamp":"2024-09-17T05:41:56.913963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:41:56.951770+0000","last_change":"2024-09-17T05:41:56.946833+0000","last_active":"2024-09-17T05:41:56.951770+0000","last_peered":"2024-09-17T05:41:56.951770+0000","last_clean":"2024-09-17T05:41:56.951770+0000","last_became_active":"2024-09-17T05:41:56.946545+0000","last_became_peered":"2024-09-17T05:41:56.946545+0000","last_unstale":"2024-09-17T05:41:56.951770+0000","last_undegraded":"2024-09-17T05:41:56.951770+0000","last_fullsized":"2024-09-17T05:41:56.951770+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:55.904533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:55.904533+0000","last_clean_scrub_stamp":"2024-09-17T05:41:55.904533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:08:59.697169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-17T05:41:56.932989+0000","last_change":"2024-09-17T05:41:56.932989+0000","last_active":"2024-09-17T05:41:56.913963+0000","last_peered":"2024-09-17T05:41:56.913963+0000","last_clean":"2024-09-17T05:41:56.913963+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:41:56.932989+0000","last_undegraded":"2024-09-17T05:41:56.932989+0000","last_fullsized":"2024-09-17T05:41:56.932989+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_clean_scrub_stamp":"2024-09-17T05:41:56.913963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-09-17T05:41:55.921502+0000","last_change":"2024-09-17T05:41:55.921502+0000","last_active":"2024-09-17T05:41:55.904533+0000","last_peered":"2024-09-17T05:41:55.904533+0000","last_clean":"2024-09-17T05:41:55.904533+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:41:55.921502+0000","last_undegraded":"2024-09-17T05:41:55.921502+0000","last_fullsized":"2024-09-17T05:41:55.921502+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:55.904533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:55.904533+0000","last_clean_scrub_stamp":"2024-09-17T05:41:55.904533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:41:56.913963+0000","last_change":"2024-09-17T05:41:56.913963+0000","last_active":"2024-09-17T05:41:56.913963+0000","last_peered":"2024-09-17T05:41:56.913963+0000","last_clean":"2024-09-17T05:41:56.913963+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:41:56.913963+0000","last_undegraded":"2024-09-17T05:41:56.913963+0000","last_fullsized":"2024-09-17T05:41:56.913963+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_clean_scrub_stamp":"2024-09-17T05:41:56.913963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.f","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-09-17T05:41:55.923232+0000","last_change":"2024-09-17T05:41:55.923232+0000","last_active":"2024-09-17T05:41:55.904533+0000","last_peered":"2024-09-17T05:41:55.904533+0000","last_clean":"2024-09-17T05:41:55.904533+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:41:55.923232+0000","last_undegraded":"2024-09-17T05:41:55.923232+0000","last_fullsized":"2024-09-17T05:41:55.923232+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:55.904533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:55.904533+0000","last_clean_scrub_stamp":"2024-09-17T05:41:55.904533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:41:56.913963+0000","last_change":"2024-09-17T05:41:56.913963+0000","last_active":"2024-09-17T05:41:56.913963+0000","last_peered":"2024-09-17T05:41:56.913963+0000","last_clean":"2024-09-17T05:41:56.913963+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:41:56.913963+0000","last_undegraded":"2024-09-17T05:41:56.913963+0000","last_fullsized":"2024-09-17T05:41:56.913963+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_clean_scrub_stamp":"2024-09-17T05:41:56.913963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.e","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-09-17T05:41:55.921184+0000","last_change":"2024-09-17T05:41:55.921184+0000","last_active":"2024-09-17T05:41:55.904533+0000","last_peered":"2024-09-17T05:41:55.904533+0000","last_clean":"2024-09-17T05:41:55.904533+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:41:55.921184+0000","last_undegraded":"2024-09-17T05:41:55.921184+0000","last_fullsized":"2024-09-17T05:41:55.921184+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:55.904533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:55.904533+0000","last_clean_scrub_stamp":"2024-09-17T05:41:55.904533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:41:56.913963+0000","last_change":"2024-09-17T05:41:56.913963+0000","last_active":"2024-09-17T05:41:56.913963+0000","last_peered":"2024-09-17T05:41:56.913963+0000","last_clean":"2024-09-17T05:41:56.913963+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:41:56.913963+0000","last_undegraded":"2024-09-17T05:41:56.913963+0000","last_fullsized":"2024-09-17T05:41:56.913963+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_clean_scrub_stamp":"2024-09-17T05:41:56.913963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.d","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-09-17T05:41:55.918638+0000","last_change":"2024-09-17T05:41:55.918638+0000","last_active":"2024-09-17T05:41:55.904533+0000","last_peered":"2024-09-17T05:41:55.904533+0000","last_clean":"2024-09-17T05:41:55.904533+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:41:55.918638+0000","last_undegraded":"2024-09-17T05:41:55.918638+0000","last_fullsized":"2024-09-17T05:41:55.918638+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:55.904533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:55.904533+0000","last_clean_scrub_stamp":"2024-09-17T05:41:55.904533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:41:56.913963+0000","last_change":"2024-09-17T05:41:56.913963+0000","last_active":"2024-09-17T05:41:56.913963+0000","last_peered":"2024-09-17T05:41:56.913963+0000","last_clean":"2024-09-17T05:41:56.913963+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:41:56.913963+0000","last_undegraded":"2024-09-17T05:41:56.913963+0000","last_fullsized":"2024-09-17T05:41:56.913963+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_clean_scrub_stamp":"2024-09-17T05:41:56.913963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-09-17T05:41:55.922017+0000","last_change":"2024-09-17T05:41:55.922017+0000","last_active":"2024-09-17T05:41:55.904533+0000","last_peered":"2024-09-17T05:41:55.904533+0000","last_clean":"2024-09-17T05:41:55.904533+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:41:55.922017+0000","last_undegraded":"2024-09-17T05:41:55.922017+0000","last_fullsized":"2024-09-17T05:41:55.922017+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:55.904533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:55.904533+0000","last_clean_scrub_stamp":"2024-09-17T05:41:55.904533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:41:56.913963+0000","last_change":"2024-09-17T05:41:56.913963+0000","last_active":"2024-09-17T05:41:56.913963+0000","last_peered":"2024-09-17T05:41:56.913963+0000","last_clean":"2024-09-17T05:41:56.913963+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:41:56.913963+0000","last_undegraded":"2024-09-17T05:41:56.913963+0000","last_fullsized":"2024-09-17T05:41:56.913963+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_clean_scrub_stamp":"2024-09-17T05:41:56.913963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"19'72","reported_seq":105,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T05:41:55.926749+0000","last_change":"2024-09-17T05:41:48.539830+0000","last_active":"2024-09-17T05:41:55.926749+0000","last_peered":"2024-09-17T05:41:55.926749+0000","last_clean":"2024-09-17T05:41:55.926749+0000","last_became_active":"2024-09-17T05:41:48.538743+0000","last_became_peered":"2024-09-17T05:41:48.538743+0000","last_unstale":"2024-09-17T05:41:55.926749+0000","last_undegraded":"2024-09-17T05:41:55.926749+0000","last_fullsized":"2024-09-17T05:41:55.926749+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:47.152539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:47.152539+0000","last_clean_scrub_stamp":"2024-09-17T05:41:47.152539+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:08:02.952016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-09-17T05:41:55.923951+0000","last_change":"2024-09-17T05:41:55.923951+0000","last_active":"2024-09-17T05:41:55.904533+0000","last_peered":"2024-09-17T05:41:55.904533+0000","last_clean":"2024-09-17T05:41:55.904533+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:41:55.923951+0000","last_undegraded":"2024-09-17T05:41:55.923951+0000","last_fullsized":"2024-09-17T05:41:55.923951+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:55.904533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:55.904533+0000","last_clean_scrub_stamp":"2024-09-17T05:41:55.904533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:41:56.913963+0000","last_change":"2024-09-17T05:41:56.913963+0000","last_active":"2024-09-17T05:41:56.913963+0000","last_peered":"2024-09-17T05:41:56.913963+0000","last_clean":"2024-09-17T05:41:56.913963+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:41:56.913963+0000","last_undegraded":"2024-09-17T05:41:56.913963+0000","last_fullsized":"2024-09-17T05:41:56.913963+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_clean_scrub_stamp":"2024-09-17T05:41:56.913963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-09-17T05:41:55.925470+0000","last_change":"2024-09-17T05:41:55.925470+0000","last_active":"2024-09-17T05:41:55.904533+0000","last_peered":"2024-09-17T05:41:55.904533+0000","last_clean":"2024-09-17T05:41:55.904533+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:41:55.925470+0000","last_undegraded":"2024-09-17T05:41:55.925470+0000","last_fullsized":"2024-09-17T05:41:55.925470+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:55.904533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:55.904533+0000","last_clean_scrub_stamp":"2024-09-17T05:41:55.904533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T05:41:57.947280+0000","last_change":"2024-09-17T05:41:57.943470+0000","last_active":"2024-09-17T05:41:57.947280+0000","last_peered":"2024-09-17T05:41:57.947280+0000","last_clean":"2024-09-17T05:41:57.947280+0000","last_became_active":"2024-09-17T05:41:57.943015+0000","last_became_peered":"2024-09-17T05:41:57.943015+0000","last_unstale":"2024-09-17T05:41:57.947280+0000","last_undegraded":"2024-09-17T05:41:57.947280+0000","last_fullsized":"2024-09-17T05:41:57.947280+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_clean_scrub_stamp":"2024-09-17T05:41:56.913963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:54:20.645536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-09-17T05:41:55.921169+0000","last_change":"2024-09-17T05:41:55.921169+0000","last_active":"2024-09-17T05:41:55.904533+0000","last_peered":"2024-09-17T05:41:55.904533+0000","last_clean":"2024-09-17T05:41:55.904533+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:41:55.921169+0000","last_undegraded":"2024-09-17T05:41:55.921169+0000","last_fullsized":"2024-09-17T05:41:55.921169+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:55.904533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:55.904533+0000","last_clean_scrub_stamp":"2024-09-17T05:41:55.904533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:41:56.913963+0000","last_change":"2024-09-17T05:41:56.913963+0000","last_active":"2024-09-17T05:41:56.913963+0000","last_peered":"2024-09-17T05:41:56.913963+0000","last_clean":"2024-09-17T05:41:56.913963+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:41:56.913963+0000","last_undegraded":"2024-09-17T05:41:56.913963+0000","last_fullsized":"2024-09-17T05:41:56.913963+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_clean_scrub_stamp":"2024-09-17T05:41:56.913963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-09-17T05:41:55.924760+0000","last_change":"2024-09-17T05:41:55.924760+0000","last_active":"2024-09-17T05:41:55.904533+0000","last_peered":"2024-09-17T05:41:55.904533+0000","last_clean":"2024-09-17T05:41:55.904533+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:41:55.924760+0000","last_undegraded":"2024-09-17T05:41:55.924760+0000","last_fullsized":"2024-09-17T05:41:55.924760+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:55.904533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:55.904533+0000","last_clean_scrub_stamp":"2024-09-17T05:41:55.904533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:41:56.913963+0000","last_change":"2024-09-17T05:41:56.913963+0000","last_active":"2024-09-17T05:41:56.913963+0000","last_peered":"2024-09-17T05:41:56.913963+0000","last_clean":"2024-09-17T05:41:56.913963+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:41:56.913963+0000","last_undegraded":"2024-09-17T05:41:56.913963+0000","last_fullsized":"2024-09-17T05:41:56.913963+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_clean_scrub_stamp":"2024-09-17T05:41:56.913963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-09-17T05:41:55.918640+0000","last_change":"2024-09-17T05:41:55.918640+0000","last_active":"2024-09-17T05:41:55.904533+0000","last_peered":"2024-09-17T05:41:55.904533+0000","last_clean":"2024-09-17T05:41:55.904533+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:41:55.918640+0000","last_undegraded":"2024-09-17T05:41:55.918640+0000","last_fullsized":"2024-09-17T05:41:55.918640+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:55.904533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:55.904533+0000","last_clean_scrub_stamp":"2024-09-17T05:41:55.904533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:41:56.913963+0000","last_change":"2024-09-17T05:41:56.913963+0000","last_active":"2024-09-17T05:41:56.913963+0000","last_peered":"2024-09-17T05:41:56.913963+0000","last_clean":"2024-09-17T05:41:56.913963+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:41:56.913963+0000","last_undegraded":"2024-09-17T05:41:56.913963+0000","last_fullsized":"2024-09-17T05:41:56.913963+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_clean_scrub_stamp":"2024-09-17T05:41:56.913963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-09-17T05:41:55.923012+0000","last_change":"2024-09-17T05:41:55.923012+0000","last_active":"2024-09-17T05:41:55.904533+0000","last_peered":"2024-09-17T05:41:55.904533+0000","last_clean":"2024-09-17T05:41:55.904533+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:41:55.923012+0000","last_undegraded":"2024-09-17T05:41:55.923012+0000","last_fullsized":"2024-09-17T05:41:55.923012+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:55.904533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:55.904533+0000","last_clean_scrub_stamp":"2024-09-17T05:41:55.904533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:41:56.913963+0000","last_change":"2024-09-17T05:41:56.913963+0000","last_active":"2024-09-17T05:41:56.913963+0000","last_peered":"2024-09-17T05:41:56.913963+0000","last_clean":"2024-09-17T05:41:56.913963+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:41:56.913963+0000","last_undegraded":"2024-09-17T05:41:56.913963+0000","last_fullsized":"2024-09-17T05:41:56.913963+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_clean_scrub_stamp":"2024-09-17T05:41:56.913963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-09-17T05:41:55.918651+0000","last_change":"2024-09-17T05:41:55.918651+0000","last_active":"2024-09-17T05:41:55.904533+0000","last_peered":"2024-09-17T05:41:55.904533+0000","last_clean":"2024-09-17T05:41:55.904533+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:41:55.918651+0000","last_undegraded":"2024-09-17T05:41:55.918651+0000","last_fullsized":"2024-09-17T05:41:55.918651+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:55.904533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:55.904533+0000","last_clean_scrub_stamp":"2024-09-17T05:41:55.904533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:41:56.913963+0000","last_change":"2024-09-17T05:41:56.913963+0000","last_active":"2024-09-17T05:41:56.913963+0000","last_peered":"2024-09-17T05:41:56.913963+0000","last_clean":"2024-09-17T05:41:56.913963+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:41:56.913963+0000","last_undegraded":"2024-09-17T05:41:56.913963+0000","last_fullsized":"2024-09-17T05:41:56.913963+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_clean_scrub_stamp":"2024-09-17T05:41:56.913963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:41:56.951831+0000","last_change":"2024-09-17T05:41:56.947816+0000","last_active":"2024-09-17T05:41:56.951831+0000","last_peered":"2024-09-17T05:41:56.951831+0000","last_clean":"2024-09-17T05:41:56.951831+0000","last_became_active":"2024-09-17T05:41:56.947483+0000","last_became_peered":"2024-09-17T05:41:56.947483+0000","last_unstale":"2024-09-17T05:41:56.951831+0000","last_undegraded":"2024-09-17T05:41:56.951831+0000","last_fullsized":"2024-09-17T05:41:56.951831+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:55.904533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:55.904533+0000","last_clean_scrub_stamp":"2024-09-17T05:41:55.904533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:10:33.368816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T05:41:57.958467+0000","last_change":"2024-09-17T05:41:57.950209+0000","last_active":"2024-09-17T05:41:57.958467+0000","last_peered":"2024-09-17T05:41:57.958467+0000","last_clean":"2024-09-17T05:41:57.958467+0000","last_became_active":"2024-09-17T05:41:57.949869+0000","last_became_peered":"2024-09-17T05:41:57.949869+0000","last_unstale":"2024-09-17T05:41:57.958467+0000","last_undegraded":"2024-09-17T05:41:57.958467+0000","last_fullsized":"2024-09-17T05:41:57.958467+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_clean_scrub_stamp":"2024-09-17T05:41:56.913963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:57:20.773447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-09-17T05:41:55.926244+0000","last_change":"2024-09-17T05:41:55.926244+0000","last_active":"2024-09-17T05:41:55.904533+0000","last_peered":"2024-09-17T05:41:55.904533+0000","last_clean":"2024-09-17T05:41:55.904533+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:41:55.926244+0000","last_undegraded":"2024-09-17T05:41:55.926244+0000","last_fullsized":"2024-09-17T05:41:55.926244+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:55.904533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:55.904533+0000","last_clean_scrub_stamp":"2024-09-17T05:41:55.904533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:41:56.913963+0000","last_change":"2024-09-17T05:41:56.913963+0000","last_active":"2024-09-17T05:41:56.913963+0000","last_peered":"2024-09-17T05:41:56.913963+0000","last_clean":"2024-09-17T05:41:56.913963+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:41:56.913963+0000","last_undegraded":"2024-09-17T05:41:56.913963+0000","last_fullsized":"2024-09-17T05:41:56.913963+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_clean_scrub_stamp":"2024-09-17T05:41:56.913963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-09-17T05:41:55.918653+0000","last_change":"2024-09-17T05:41:55.918653+0000","last_active":"2024-09-17T05:41:55.904533+0000","last_peered":"2024-09-17T05:41:55.904533+0000","last_clean":"2024-09-17T05:41:55.904533+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:41:55.918653+0000","last_undegraded":"2024-09-17T05:41:55.918653+0000","last_fullsized":"2024-09-17T05:41:55.918653+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:55.904533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:55.904533+0000","last_clean_scrub_stamp":"2024-09-17T05:41:55.904533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:41:56.913963+0000","last_change":"2024-09-17T05:41:56.913963+0000","last_active":"2024-09-17T05:41:56.913963+0000","last_peered":"2024-09-17T05:41:56.913963+0000","last_clean":"2024-09-17T05:41:56.913963+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:41:56.913963+0000","last_undegraded":"2024-09-17T05:41:56.913963+0000","last_fullsized":"2024-09-17T05:41:56.913963+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_clean_scrub_stamp":"2024-09-17T05:41:56.913963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-09-17T05:41:55.918638+0000","last_change":"2024-09-17T05:41:55.918638+0000","last_active":"2024-09-17T05:41:55.904533+0000","last_peered":"2024-09-17T05:41:55.904533+0000","last_clean":"2024-09-17T05:41:55.904533+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:41:55.918638+0000","last_undegraded":"2024-09-17T05:41:55.918638+0000","last_fullsized":"2024-09-17T05:41:55.918638+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:55.904533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:55.904533+0000","last_clean_scrub_stamp":"2024-09-17T05:41:55.904533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:41:56.913963+0000","last_change":"2024-09-17T05:41:56.913963+0000","last_active":"2024-09-17T05:41:56.913963+0000","last_peered":"2024-09-17T05:41:56.913963+0000","last_clean":"2024-09-17T05:41:56.913963+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:41:56.913963+0000","last_undegraded":"2024-09-17T05:41:56.913963+0000","last_fullsized":"2024-09-17T05:41:56.913963+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_clean_scrub_stamp":"2024-09-17T05:41:56.913963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.b","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-09-17T05:41:55.922289+0000","last_change":"2024-09-17T05:41:55.922289+0000","last_active":"2024-09-17T05:41:55.904533+0000","last_peered":"2024-09-17T05:41:55.904533+0000","last_clean":"2024-09-17T05:41:55.904533+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:41:55.922289+0000","last_undegraded":"2024-09-17T05:41:55.922289+0000","last_fullsized":"2024-09-17T05:41:55.922289+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:55.904533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:55.904533+0000","last_clean_scrub_stamp":"2024-09-17T05:41:55.904533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-17T05:41:56.934139+0000","last_change":"2024-09-17T05:41:56.934139+0000","last_active":"2024-09-17T05:41:56.913963+0000","last_peered":"2024-09-17T05:41:56.913963+0000","last_clean":"2024-09-17T05:41:56.913963+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:41:56.934139+0000","last_undegraded":"2024-09-17T05:41:56.934139+0000","last_fullsized":"2024-09-17T05:41:56.934139+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_clean_scrub_stamp":"2024-09-17T05:41:56.913963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:41:56.913963+0000","last_change":"2024-09-17T05:41:56.913963+0000","last_active":"2024-09-17T05:41:56.913963+0000","last_peered":"2024-09-17T05:41:56.913963+0000","last_clean":"2024-09-17T05:41:56.913963+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:41:56.913963+0000","last_undegraded":"2024-09-17T05:41:56.913963+0000","last_fullsized":"2024-09-17T05:41:56.913963+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_clean_scrub_stamp":"2024-09-17T05:41:56.913963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1c","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-09-17T05:41:55.922276+0000","last_change":"2024-09-17T05:41:55.922276+0000","last_active":"2024-09-17T05:41:55.904533+0000","last_peered":"2024-09-17T05:41:55.904533+0000","last_clean":"2024-09-17T05:41:55.904533+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:41:55.922276+0000","last_undegraded":"2024-09-17T05:41:55.922276+0000","last_fullsized":"2024-09-17T05:41:55.922276+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:55.904533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:55.904533+0000","last_clean_scrub_stamp":"2024-09-17T05:41:55.904533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:41:56.913963+0000","last_change":"2024-09-17T05:41:56.913963+0000","last_active":"2024-09-17T05:41:56.913963+0000","last_peered":"2024-09-17T05:41:56.913963+0000","last_clean":"2024-09-17T05:41:56.913963+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:41:56.913963+0000","last_undegraded":"2024-09-17T05:41:56.913963+0000","last_fullsized":"2024-09-17T05:41:56.913963+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_clean_scrub_stamp":"2024-09-17T05:41:56.913963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1d","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-09-17T05:41:55.923615+0000","last_change":"2024-09-17T05:41:55.923615+0000","last_active":"2024-09-17T05:41:55.904533+0000","last_peered":"2024-09-17T05:41:55.904533+0000","last_clean":"2024-09-17T05:41:55.904533+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:41:55.923615+0000","last_undegraded":"2024-09-17T05:41:55.923615+0000","last_fullsized":"2024-09-17T05:41:55.923615+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:55.904533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:55.904533+0000","last_clean_scrub_stamp":"2024-09-17T05:41:55.904533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T05:41:57.958452+0000","last_change":"2024-09-17T05:41:57.947899+0000","last_active":"2024-09-17T05:41:57.958452+0000","last_peered":"2024-09-17T05:41:57.958452+0000","last_clean":"2024-09-17T05:41:57.958452+0000","last_became_active":"2024-09-17T05:41:57.947556+0000","last_became_peered":"2024-09-17T05:41:57.947556+0000","last_unstale":"2024-09-17T05:41:57.958452+0000","last_undegraded":"2024-09-17T05:41:57.958452+0000","last_fullsized":"2024-09-17T05:41:57.958452+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_clean_scrub_stamp":"2024-09-17T05:41:56.913963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:19:11.730293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-09-17T05:41:55.921410+0000","last_change":"2024-09-17T05:41:55.921410+0000","last_active":"2024-09-17T05:41:55.904533+0000","last_peered":"2024-09-17T05:41:55.904533+0000","last_clean":"2024-09-17T05:41:55.904533+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:41:55.921410+0000","last_undegraded":"2024-09-17T05:41:55.921410+0000","last_fullsized":"2024-09-17T05:41:55.921410+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:55.904533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:55.904533+0000","last_clean_scrub_stamp":"2024-09-17T05:41:55.904533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:41:56.913963+0000","last_change":"2024-09-17T05:41:56.913963+0000","last_active":"2024-09-17T05:41:56.913963+0000","last_peered":"2024-09-17T05:41:56.913963+0000","last_clean":"2024-09-17T05:41:56.913963+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:41:56.913963+0000","last_undegraded":"2024-09-17T05:41:56.913963+0000","last_fullsized":"2024-09-17T05:41:56.913963+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_clean_scrub_stamp":"2024-09-17T05:41:56.913963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1f","version":"22'4","reported_seq":17,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T05:41:57.964113+0000","last_change":"2024-09-17T05:41:56.946707+0000","last_active":"2024-09-17T05:41:57.964113+0000","last_peered":"2024-09-17T05:41:57.964113+0000","last_clean":"2024-09-17T05:41:57.964113+0000","last_became_active":"2024-09-17T05:41:56.946448+0000","last_became_peered":"2024-09-17T05:41:56.946448+0000","last_unstale":"2024-09-17T05:41:57.964113+0000","last_undegraded":"2024-09-17T05:41:57.964113+0000","last_fullsized":"2024-09-17T05:41:57.964113+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:55.904533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:55.904533+0000","last_clean_scrub_stamp":"2024-09-17T05:41:55.904533+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:55:32.730864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":34,"acting":34,"num_store_stats":2},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":616,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6,"ondisk_log_size":6,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":16,"seq":68719476742,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27220,"kb_used_data":192,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344620,"statfs":{"total":96636764160,"available":96608890880,"internally_reserved":0,"allocated":196608,"data_stored":62477,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":7,"up_from":15,"seq":64424509446,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28032,"kb_used_data":760,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343808,"statfs":{"total":96636764160,"available":96608059392,"internally_reserved":0,"allocated":778240,"data_stored":647028,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509445,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27216,"kb_used_data":180,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344624,"statfs":{"total":96636764160,"available":96608894976,"internally_reserved":0,"allocated":184320,"data_stored":56660,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509445,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27216,"kb_used_data":180,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344624,"statfs":{"total":96636764160,"available":96608894976,"internally_reserved":0,"allocated":184320,"data_stored":56660,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509445,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27208,"kb_used_data":180,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344632,"statfs":{"total":96636764160,"available":96608903168,"internally_reserved":0,"allocated":184320,"data_stored":56660,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509445,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27208,"kb_used_data":180,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344632,"statfs":{"total":96636764160,"available":96608903168,"internally_reserved":0,"allocated":184320,"data_stored":56660,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509445,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27208,"kb_used_data":180,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344632,"statfs":{"total":96636764160,"available":96608903168,"internally_reserved":0,"allocated":184320,"data_stored":56660,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574853,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27832,"kb_used_data":800,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344008,"statfs":{"total":96636764160,"available":96608264192,"internally_reserved":0,"allocated":819200,"data_stored":665917,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-17T05:42:00.940 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-17T05:42:01.089 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:01.088+0000 7fe6d5830640 1 -- 172.21.15.150:0/30265857 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe6d00cf7c0 msgr2=0x7fe6d00cfbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:01.089 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:01.088+0000 7fe6d5830640 1 --2- 172.21.15.150:0/30265857 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe6d00cf7c0 0x7fe6d00cfbd0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fe6d00cef60 tx=0x7fe6b802a560 comp rx=0 tx=0).stop 2024-09-17T05:42:01.089 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:01.088+0000 7fe6d5830640 1 -- 172.21.15.150:0/30265857 shutdown_connections 2024-09-17T05:42:01.089 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:01.088+0000 7fe6d5830640 1 --2- 172.21.15.150:0/30265857 >> v2:172.21.15.176:3300/0 conn(0x7fe6d00b0e20 0x7fe6d00b1230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:01.089 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:01.088+0000 7fe6d5830640 1 --2- 172.21.15.150:0/30265857 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe6d00cf7c0 0x7fe6d00cfbd0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:01.089 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:01.088+0000 7fe6d5830640 1 --2- 172.21.15.150:0/30265857 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe6d015ee30 0x7fe6d00b2840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:01.089 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:01.088+0000 7fe6d5830640 1 -- 172.21.15.150:0/30265857 >> 172.21.15.150:0/30265857 conn(0x7fe6d00b2fd0 msgr2=0x7fe6d00b33e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:42:01.089 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:01.088+0000 7fe6d5830640 1 -- 172.21.15.150:0/30265857 shutdown_connections 2024-09-17T05:42:01.089 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:01.088+0000 7fe6d5830640 1 -- 172.21.15.150:0/30265857 wait complete. 2024-09-17T05:42:01.090 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:01.090+0000 7fe6d5830640 1 Processor -- start 2024-09-17T05:42:01.090 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:01.090+0000 7fe6d5830640 1 -- start start 2024-09-17T05:42:01.092 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:01.091+0000 7fe6d5830640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe6d00b0e20 0x7fe6d015bb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:42:01.092 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:01.091+0000 7fe6d5830640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe6d00cf7c0 0x7fe6d0150270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:42:01.093 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:01.091+0000 7fe6d5830640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe6d015ee30 0x7fe6d0150ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:42:01.093 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:01.091+0000 7fe6d5830640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7fe6d00b18f0 con 0x7fe6d015ee30 2024-09-17T05:42:01.093 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:01.091+0000 7fe6d5830640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fe6d00b1770 con 0x7fe6d00b0e20 2024-09-17T05:42:01.093 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:01.091+0000 7fe6d5830640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fe6d00b1a70 con 0x7fe6d00cf7c0 2024-09-17T05:42:01.093 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:01.091+0000 7fe6cf7fe640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe6d015ee30 0x7fe6d0150ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:42:01.093 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:01.091+0000 7fe6cf7fe640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe6d015ee30 0x7fe6d0150ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:54350/0 (socket says 172.21.15.150:54350) 2024-09-17T05:42:01.093 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:01.091+0000 7fe6cf7fe640 1 -- 172.21.15.150:0/2306269836 learned_addr learned my addr 172.21.15.150:0/2306269836 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:42:01.093 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:01.091+0000 7fe6ce7fc640 1 --2- 172.21.15.150:0/2306269836 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe6d00cf7c0 0x7fe6d0150270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:42:01.093 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:01.091+0000 7fe6ceffd640 1 --2- 172.21.15.150:0/2306269836 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe6d00b0e20 0x7fe6d015bb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:42:01.093 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:01.091+0000 7fe6cf7fe640 1 -- 172.21.15.150:0/2306269836 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe6d00cf7c0 msgr2=0x7fe6d0150270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:01.093 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:01.091+0000 7fe6cf7fe640 1 --2- 172.21.15.150:0/2306269836 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe6d00cf7c0 0x7fe6d0150270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:01.093 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:01.091+0000 7fe6cf7fe640 1 -- 172.21.15.150:0/2306269836 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe6d00b0e20 msgr2=0x7fe6d015bb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:01.093 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:01.091+0000 7fe6cf7fe640 1 --2- 172.21.15.150:0/2306269836 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe6d00b0e20 0x7fe6d015bb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:01.094 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:01.091+0000 7fe6cf7fe640 1 -- 172.21.15.150:0/2306269836 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe6d015ab30 con 0x7fe6d015ee30 2024-09-17T05:42:01.094 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:01.092+0000 7fe6cf7fe640 1 --2- 172.21.15.150:0/2306269836 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe6d015ee30 0x7fe6d0150ac0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fe6c800c8f0 tx=0x7fe6c800cdb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:42:01.094 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:01.092+0000 7fe6c7fff640 1 -- 172.21.15.150:0/2306269836 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6c800ae60 con 0x7fe6d015ee30 2024-09-17T05:42:01.094 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:01.092+0000 7fe6c7fff640 1 -- 172.21.15.150:0/2306269836 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe6c8007cc0 con 0x7fe6d015ee30 2024-09-17T05:42:01.094 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:01.092+0000 7fe6d5830640 1 -- 172.21.15.150:0/2306269836 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe6d015c0d0 con 0x7fe6d015ee30 2024-09-17T05:42:01.094 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:01.092+0000 7fe6c7fff640 1 -- 172.21.15.150:0/2306269836 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6c800f6b0 con 0x7fe6d015ee30 2024-09-17T05:42:01.094 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:01.092+0000 7fe6d5830640 1 -- 172.21.15.150:0/2306269836 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe6d015b0b0 con 0x7fe6d015ee30 2024-09-17T05:42:01.095 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:01.093+0000 7fe6d5830640 1 -- 172.21.15.150:0/2306269836 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe6d00b34e0 con 0x7fe6d015ee30 2024-09-17T05:42:01.095 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:01.094+0000 7fe6c7fff640 1 -- 172.21.15.150:0/2306269836 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fe6c800f850 con 0x7fe6d015ee30 2024-09-17T05:42:01.095 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:01.094+0000 7fe6c7fff640 1 --2- 172.21.15.150:0/2306269836 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fe6b0078bc0 0x7fe6b007b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:42:01.095 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:01.094+0000 7fe6c7fff640 1 -- 172.21.15.150:0/2306269836 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7fe6c809b420 con 0x7fe6d015ee30 2024-09-17T05:42:01.095 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:01.094+0000 7fe6ceffd640 1 --2- 172.21.15.150:0/2306269836 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fe6b0078bc0 0x7fe6b007b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:42:01.095 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:01.095+0000 7fe6ceffd640 1 --2- 172.21.15.150:0/2306269836 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fe6b0078bc0 0x7fe6b007b0d0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fe6d00d0de0 tx=0x7fe6c0008230 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:42:01.099 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:01.099+0000 7fe6c7fff640 1 -- 172.21.15.150:0/2306269836 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fe6d00b34e0 con 0x7fe6d015ee30 2024-09-17T05:42:01.271 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:01.271+0000 7fe6d5830640 1 -- 172.21.15.150:0/2306269836 --> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fe6d00af0c0 con 0x7fe6b0078bc0 2024-09-17T05:42:01.275 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:01.275+0000 7fe6c7fff640 1 -- 172.21.15.150:0/2306269836 <== mgr.4108 v2:172.21.15.176:6800/3631216395 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+242492 (secure 0 0 0) 0x7fe6d00af0c0 con 0x7fe6b0078bc0 2024-09-17T05:42:01.278 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-09-17T05:42:01.279 INFO:teuthology.orchestra.run.smithi150.stderr:dumped all 2024-09-17T05:42:01.281 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:01.278+0000 7fe6d5830640 1 -- 172.21.15.150:0/2306269836 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fe6b0078bc0 msgr2=0x7fe6b007b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:01.281 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:01.278+0000 7fe6d5830640 1 --2- 172.21.15.150:0/2306269836 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fe6b0078bc0 0x7fe6b007b0d0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fe6d00d0de0 tx=0x7fe6c0008230 comp rx=0 tx=0).stop 2024-09-17T05:42:01.281 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:01.278+0000 7fe6d5830640 1 -- 172.21.15.150:0/2306269836 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe6d015ee30 msgr2=0x7fe6d0150ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:01.281 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:01.278+0000 7fe6d5830640 1 --2- 172.21.15.150:0/2306269836 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe6d015ee30 0x7fe6d0150ac0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fe6c800c8f0 tx=0x7fe6c800cdb0 comp rx=0 tx=0).stop 2024-09-17T05:42:01.281 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:01.278+0000 7fe6d5830640 1 -- 172.21.15.150:0/2306269836 shutdown_connections 2024-09-17T05:42:01.281 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:01.278+0000 7fe6d5830640 1 --2- 172.21.15.150:0/2306269836 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fe6b0078bc0 0x7fe6b007b0d0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:01.281 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:01.278+0000 7fe6d5830640 1 --2- 172.21.15.150:0/2306269836 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe6d015ee30 0x7fe6d0150ac0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:01.281 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:01.278+0000 7fe6d5830640 1 --2- 172.21.15.150:0/2306269836 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe6d00cf7c0 0x7fe6d0150270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:01.282 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:01.278+0000 7fe6d5830640 1 --2- 172.21.15.150:0/2306269836 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe6d00b0e20 0x7fe6d015bb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:01.282 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:01.278+0000 7fe6d5830640 1 -- 172.21.15.150:0/2306269836 >> 172.21.15.150:0/2306269836 conn(0x7fe6d00b2fd0 msgr2=0x7fe6d00b5380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:42:01.282 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:01.278+0000 7fe6d5830640 1 -- 172.21.15.150:0/2306269836 shutdown_connections 2024-09-17T05:42:01.282 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:01.278+0000 7fe6d5830640 1 -- 172.21.15.150:0/2306269836 wait complete. 2024-09-17T05:42:01.290 INFO:teuthology.orchestra.run.smithi150.stdout:{"pg_ready":true,"pg_map":{"version":25,"stamp":"2024-09-17T05:42:00.844629+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590984,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":108,"num_write_kb":1636,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":78,"ondisk_log_size":78,"up":100,"acting":100,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":22,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219140,"kb_used_data":2652,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755580,"statfs":{"total":773094113280,"available":772869713920,"internally_reserved":0,"allocated":2715648,"data_stored":1658722,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":14,"apply_latency_ms":14,"commit_latency_ns":14000000,"apply_latency_ns":14000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":616,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.925201"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:41:56.913963+0000","last_change":"2024-09-17T05:41:56.913963+0000","last_active":"2024-09-17T05:41:56.913963+0000","last_peered":"2024-09-17T05:41:56.913963+0000","last_clean":"2024-09-17T05:41:56.913963+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:41:56.913963+0000","last_undegraded":"2024-09-17T05:41:56.913963+0000","last_fullsized":"2024-09-17T05:41:56.913963+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_clean_scrub_stamp":"2024-09-17T05:41:56.913963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:41:56.913963+0000","last_change":"2024-09-17T05:41:56.913963+0000","last_active":"2024-09-17T05:41:56.913963+0000","last_peered":"2024-09-17T05:41:56.913963+0000","last_clean":"2024-09-17T05:41:56.913963+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:41:56.913963+0000","last_undegraded":"2024-09-17T05:41:56.913963+0000","last_fullsized":"2024-09-17T05:41:56.913963+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_clean_scrub_stamp":"2024-09-17T05:41:56.913963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T05:41:57.946892+0000","last_change":"2024-09-17T05:41:57.935841+0000","last_active":"2024-09-17T05:41:57.946892+0000","last_peered":"2024-09-17T05:41:57.946892+0000","last_clean":"2024-09-17T05:41:57.946892+0000","last_became_active":"2024-09-17T05:41:57.935502+0000","last_became_peered":"2024-09-17T05:41:57.935502+0000","last_unstale":"2024-09-17T05:41:57.946892+0000","last_undegraded":"2024-09-17T05:41:57.946892+0000","last_fullsized":"2024-09-17T05:41:57.946892+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_clean_scrub_stamp":"2024-09-17T05:41:56.913963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:18:37.706664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:41:56.913963+0000","last_change":"2024-09-17T05:41:56.913963+0000","last_active":"2024-09-17T05:41:56.913963+0000","last_peered":"2024-09-17T05:41:56.913963+0000","last_clean":"2024-09-17T05:41:56.913963+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:41:56.913963+0000","last_undegraded":"2024-09-17T05:41:56.913963+0000","last_fullsized":"2024-09-17T05:41:56.913963+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_clean_scrub_stamp":"2024-09-17T05:41:56.913963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:41:56.913963+0000","last_change":"2024-09-17T05:41:56.913963+0000","last_active":"2024-09-17T05:41:56.913963+0000","last_peered":"2024-09-17T05:41:56.913963+0000","last_clean":"2024-09-17T05:41:56.913963+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:41:56.913963+0000","last_undegraded":"2024-09-17T05:41:56.913963+0000","last_fullsized":"2024-09-17T05:41:56.913963+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_clean_scrub_stamp":"2024-09-17T05:41:56.913963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:41:56.913963+0000","last_change":"2024-09-17T05:41:56.913963+0000","last_active":"2024-09-17T05:41:56.913963+0000","last_peered":"2024-09-17T05:41:56.913963+0000","last_clean":"2024-09-17T05:41:56.913963+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:41:56.913963+0000","last_undegraded":"2024-09-17T05:41:56.913963+0000","last_fullsized":"2024-09-17T05:41:56.913963+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_clean_scrub_stamp":"2024-09-17T05:41:56.913963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:41:56.913963+0000","last_change":"2024-09-17T05:41:56.913963+0000","last_active":"2024-09-17T05:41:56.913963+0000","last_peered":"2024-09-17T05:41:56.913963+0000","last_clean":"2024-09-17T05:41:56.913963+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:41:56.913963+0000","last_undegraded":"2024-09-17T05:41:56.913963+0000","last_fullsized":"2024-09-17T05:41:56.913963+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_clean_scrub_stamp":"2024-09-17T05:41:56.913963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:41:56.913963+0000","last_change":"2024-09-17T05:41:56.913963+0000","last_active":"2024-09-17T05:41:56.913963+0000","last_peered":"2024-09-17T05:41:56.913963+0000","last_clean":"2024-09-17T05:41:56.913963+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:41:56.913963+0000","last_undegraded":"2024-09-17T05:41:56.913963+0000","last_fullsized":"2024-09-17T05:41:56.913963+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_clean_scrub_stamp":"2024-09-17T05:41:56.913963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:41:56.913963+0000","last_change":"2024-09-17T05:41:56.913963+0000","last_active":"2024-09-17T05:41:56.913963+0000","last_peered":"2024-09-17T05:41:56.913963+0000","last_clean":"2024-09-17T05:41:56.913963+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:41:56.913963+0000","last_undegraded":"2024-09-17T05:41:56.913963+0000","last_fullsized":"2024-09-17T05:41:56.913963+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_clean_scrub_stamp":"2024-09-17T05:41:56.913963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-17T05:41:56.938399+0000","last_change":"2024-09-17T05:41:56.938399+0000","last_active":"2024-09-17T05:41:56.913963+0000","last_peered":"2024-09-17T05:41:56.913963+0000","last_clean":"2024-09-17T05:41:56.913963+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:41:56.938399+0000","last_undegraded":"2024-09-17T05:41:56.938399+0000","last_fullsized":"2024-09-17T05:41:56.938399+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_clean_scrub_stamp":"2024-09-17T05:41:56.913963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-17T05:41:56.935343+0000","last_change":"2024-09-17T05:41:56.935343+0000","last_active":"2024-09-17T05:41:56.913963+0000","last_peered":"2024-09-17T05:41:56.913963+0000","last_clean":"2024-09-17T05:41:56.913963+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:41:56.935343+0000","last_undegraded":"2024-09-17T05:41:56.935343+0000","last_fullsized":"2024-09-17T05:41:56.935343+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_clean_scrub_stamp":"2024-09-17T05:41:56.913963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:41:56.913963+0000","last_change":"2024-09-17T05:41:56.913963+0000","last_active":"2024-09-17T05:41:56.913963+0000","last_peered":"2024-09-17T05:41:56.913963+0000","last_clean":"2024-09-17T05:41:56.913963+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:41:56.913963+0000","last_undegraded":"2024-09-17T05:41:56.913963+0000","last_fullsized":"2024-09-17T05:41:56.913963+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_clean_scrub_stamp":"2024-09-17T05:41:56.913963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:41:56.913963+0000","last_change":"2024-09-17T05:41:56.913963+0000","last_active":"2024-09-17T05:41:56.913963+0000","last_peered":"2024-09-17T05:41:56.913963+0000","last_clean":"2024-09-17T05:41:56.913963+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:41:56.913963+0000","last_undegraded":"2024-09-17T05:41:56.913963+0000","last_fullsized":"2024-09-17T05:41:56.913963+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_clean_scrub_stamp":"2024-09-17T05:41:56.913963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T05:41:57.958581+0000","last_change":"2024-09-17T05:41:57.950142+0000","last_active":"2024-09-17T05:41:57.958581+0000","last_peered":"2024-09-17T05:41:57.958581+0000","last_clean":"2024-09-17T05:41:57.958581+0000","last_became_active":"2024-09-17T05:41:57.949825+0000","last_became_peered":"2024-09-17T05:41:57.949825+0000","last_unstale":"2024-09-17T05:41:57.958581+0000","last_undegraded":"2024-09-17T05:41:57.958581+0000","last_fullsized":"2024-09-17T05:41:57.958581+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_clean_scrub_stamp":"2024-09-17T05:41:56.913963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:03:45.612206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:41:56.913963+0000","last_change":"2024-09-17T05:41:56.913963+0000","last_active":"2024-09-17T05:41:56.913963+0000","last_peered":"2024-09-17T05:41:56.913963+0000","last_clean":"2024-09-17T05:41:56.913963+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:41:56.913963+0000","last_undegraded":"2024-09-17T05:41:56.913963+0000","last_fullsized":"2024-09-17T05:41:56.913963+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_clean_scrub_stamp":"2024-09-17T05:41:56.913963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:41:56.913963+0000","last_change":"2024-09-17T05:41:56.913963+0000","last_active":"2024-09-17T05:41:56.913963+0000","last_peered":"2024-09-17T05:41:56.913963+0000","last_clean":"2024-09-17T05:41:56.913963+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:41:56.913963+0000","last_undegraded":"2024-09-17T05:41:56.913963+0000","last_fullsized":"2024-09-17T05:41:56.913963+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_clean_scrub_stamp":"2024-09-17T05:41:56.913963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:41:56.913963+0000","last_change":"2024-09-17T05:41:56.913963+0000","last_active":"2024-09-17T05:41:56.913963+0000","last_peered":"2024-09-17T05:41:56.913963+0000","last_clean":"2024-09-17T05:41:56.913963+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:41:56.913963+0000","last_undegraded":"2024-09-17T05:41:56.913963+0000","last_fullsized":"2024-09-17T05:41:56.913963+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_clean_scrub_stamp":"2024-09-17T05:41:56.913963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:41:56.913963+0000","last_change":"2024-09-17T05:41:56.913963+0000","last_active":"2024-09-17T05:41:56.913963+0000","last_peered":"2024-09-17T05:41:56.913963+0000","last_clean":"2024-09-17T05:41:56.913963+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:41:56.913963+0000","last_undegraded":"2024-09-17T05:41:56.913963+0000","last_fullsized":"2024-09-17T05:41:56.913963+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_clean_scrub_stamp":"2024-09-17T05:41:56.913963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:41:56.913963+0000","last_change":"2024-09-17T05:41:56.913963+0000","last_active":"2024-09-17T05:41:56.913963+0000","last_peered":"2024-09-17T05:41:56.913963+0000","last_clean":"2024-09-17T05:41:56.913963+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:41:56.913963+0000","last_undegraded":"2024-09-17T05:41:56.913963+0000","last_fullsized":"2024-09-17T05:41:56.913963+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_clean_scrub_stamp":"2024-09-17T05:41:56.913963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-17T05:41:56.933458+0000","last_change":"2024-09-17T05:41:56.933458+0000","last_active":"2024-09-17T05:41:56.913963+0000","last_peered":"2024-09-17T05:41:56.913963+0000","last_clean":"2024-09-17T05:41:56.913963+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:41:56.933458+0000","last_undegraded":"2024-09-17T05:41:56.933458+0000","last_fullsized":"2024-09-17T05:41:56.933458+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_clean_scrub_stamp":"2024-09-17T05:41:56.913963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T05:41:57.960003+0000","last_change":"2024-09-17T05:41:57.952830+0000","last_active":"2024-09-17T05:41:57.960003+0000","last_peered":"2024-09-17T05:41:57.960003+0000","last_clean":"2024-09-17T05:41:57.960003+0000","last_became_active":"2024-09-17T05:41:57.952504+0000","last_became_peered":"2024-09-17T05:41:57.952504+0000","last_unstale":"2024-09-17T05:41:57.960003+0000","last_undegraded":"2024-09-17T05:41:57.960003+0000","last_fullsized":"2024-09-17T05:41:57.960003+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_clean_scrub_stamp":"2024-09-17T05:41:56.913963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:54:59.834514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:41:56.913963+0000","last_change":"2024-09-17T05:41:56.913963+0000","last_active":"2024-09-17T05:41:56.913963+0000","last_peered":"2024-09-17T05:41:56.913963+0000","last_clean":"2024-09-17T05:41:56.913963+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:41:56.913963+0000","last_undegraded":"2024-09-17T05:41:56.913963+0000","last_fullsized":"2024-09-17T05:41:56.913963+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_clean_scrub_stamp":"2024-09-17T05:41:56.913963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:41:56.913963+0000","last_change":"2024-09-17T05:41:56.913963+0000","last_active":"2024-09-17T05:41:56.913963+0000","last_peered":"2024-09-17T05:41:56.913963+0000","last_clean":"2024-09-17T05:41:56.913963+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:41:56.913963+0000","last_undegraded":"2024-09-17T05:41:56.913963+0000","last_fullsized":"2024-09-17T05:41:56.913963+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_clean_scrub_stamp":"2024-09-17T05:41:56.913963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:41:56.913963+0000","last_change":"2024-09-17T05:41:56.913963+0000","last_active":"2024-09-17T05:41:56.913963+0000","last_peered":"2024-09-17T05:41:56.913963+0000","last_clean":"2024-09-17T05:41:56.913963+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:41:56.913963+0000","last_undegraded":"2024-09-17T05:41:56.913963+0000","last_fullsized":"2024-09-17T05:41:56.913963+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_clean_scrub_stamp":"2024-09-17T05:41:56.913963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:41:56.913963+0000","last_change":"2024-09-17T05:41:56.913963+0000","last_active":"2024-09-17T05:41:56.913963+0000","last_peered":"2024-09-17T05:41:56.913963+0000","last_clean":"2024-09-17T05:41:56.913963+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:41:56.913963+0000","last_undegraded":"2024-09-17T05:41:56.913963+0000","last_fullsized":"2024-09-17T05:41:56.913963+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_clean_scrub_stamp":"2024-09-17T05:41:56.913963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-17T05:41:56.936595+0000","last_change":"2024-09-17T05:41:56.936595+0000","last_active":"2024-09-17T05:41:56.913963+0000","last_peered":"2024-09-17T05:41:56.913963+0000","last_clean":"2024-09-17T05:41:56.913963+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:41:56.936595+0000","last_undegraded":"2024-09-17T05:41:56.936595+0000","last_fullsized":"2024-09-17T05:41:56.936595+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_clean_scrub_stamp":"2024-09-17T05:41:56.913963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:41:56.913963+0000","last_change":"2024-09-17T05:41:56.913963+0000","last_active":"2024-09-17T05:41:56.913963+0000","last_peered":"2024-09-17T05:41:56.913963+0000","last_clean":"2024-09-17T05:41:56.913963+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:41:56.913963+0000","last_undegraded":"2024-09-17T05:41:56.913963+0000","last_fullsized":"2024-09-17T05:41:56.913963+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_clean_scrub_stamp":"2024-09-17T05:41:56.913963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:41:56.913963+0000","last_change":"2024-09-17T05:41:56.913963+0000","last_active":"2024-09-17T05:41:56.913963+0000","last_peered":"2024-09-17T05:41:56.913963+0000","last_clean":"2024-09-17T05:41:56.913963+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:41:56.913963+0000","last_undegraded":"2024-09-17T05:41:56.913963+0000","last_fullsized":"2024-09-17T05:41:56.913963+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_clean_scrub_stamp":"2024-09-17T05:41:56.913963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T05:41:57.958478+0000","last_change":"2024-09-17T05:41:57.948114+0000","last_active":"2024-09-17T05:41:57.958478+0000","last_peered":"2024-09-17T05:41:57.958478+0000","last_clean":"2024-09-17T05:41:57.958478+0000","last_became_active":"2024-09-17T05:41:57.947671+0000","last_became_peered":"2024-09-17T05:41:57.947671+0000","last_unstale":"2024-09-17T05:41:57.958478+0000","last_undegraded":"2024-09-17T05:41:57.958478+0000","last_fullsized":"2024-09-17T05:41:57.958478+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_clean_scrub_stamp":"2024-09-17T05:41:56.913963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:04:06.812125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:41:56.913963+0000","last_change":"2024-09-17T05:41:56.913963+0000","last_active":"2024-09-17T05:41:56.913963+0000","last_peered":"2024-09-17T05:41:56.913963+0000","last_clean":"2024-09-17T05:41:56.913963+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:41:56.913963+0000","last_undegraded":"2024-09-17T05:41:56.913963+0000","last_fullsized":"2024-09-17T05:41:56.913963+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_clean_scrub_stamp":"2024-09-17T05:41:56.913963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:41:56.913963+0000","last_change":"2024-09-17T05:41:56.913963+0000","last_active":"2024-09-17T05:41:56.913963+0000","last_peered":"2024-09-17T05:41:56.913963+0000","last_clean":"2024-09-17T05:41:56.913963+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:41:56.913963+0000","last_undegraded":"2024-09-17T05:41:56.913963+0000","last_fullsized":"2024-09-17T05:41:56.913963+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_clean_scrub_stamp":"2024-09-17T05:41:56.913963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-17T05:41:56.933616+0000","last_change":"2024-09-17T05:41:56.933616+0000","last_active":"2024-09-17T05:41:56.913963+0000","last_peered":"2024-09-17T05:41:56.913963+0000","last_clean":"2024-09-17T05:41:56.913963+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:41:56.933616+0000","last_undegraded":"2024-09-17T05:41:56.933616+0000","last_fullsized":"2024-09-17T05:41:56.933616+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_clean_scrub_stamp":"2024-09-17T05:41:56.913963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:41:56.913963+0000","last_change":"2024-09-17T05:41:56.913963+0000","last_active":"2024-09-17T05:41:56.913963+0000","last_peered":"2024-09-17T05:41:56.913963+0000","last_clean":"2024-09-17T05:41:56.913963+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:41:56.913963+0000","last_undegraded":"2024-09-17T05:41:56.913963+0000","last_fullsized":"2024-09-17T05:41:56.913963+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_clean_scrub_stamp":"2024-09-17T05:41:56.913963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1b","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-09-17T05:41:55.922157+0000","last_change":"2024-09-17T05:41:55.922157+0000","last_active":"2024-09-17T05:41:55.904533+0000","last_peered":"2024-09-17T05:41:55.904533+0000","last_clean":"2024-09-17T05:41:55.904533+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:41:55.922157+0000","last_undegraded":"2024-09-17T05:41:55.922157+0000","last_fullsized":"2024-09-17T05:41:55.922157+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:55.904533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:55.904533+0000","last_clean_scrub_stamp":"2024-09-17T05:41:55.904533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T05:41:57.947971+0000","last_change":"2024-09-17T05:41:57.943603+0000","last_active":"2024-09-17T05:41:57.947971+0000","last_peered":"2024-09-17T05:41:57.947971+0000","last_clean":"2024-09-17T05:41:57.947971+0000","last_became_active":"2024-09-17T05:41:57.942873+0000","last_became_peered":"2024-09-17T05:41:57.942873+0000","last_unstale":"2024-09-17T05:41:57.947971+0000","last_undegraded":"2024-09-17T05:41:57.947971+0000","last_fullsized":"2024-09-17T05:41:57.947971+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_clean_scrub_stamp":"2024-09-17T05:41:56.913963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:05:08.948164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:41:56.945810+0000","last_change":"2024-09-17T05:41:56.940706+0000","last_active":"2024-09-17T05:41:56.945810+0000","last_peered":"2024-09-17T05:41:56.945810+0000","last_clean":"2024-09-17T05:41:56.945810+0000","last_became_active":"2024-09-17T05:41:56.940324+0000","last_became_peered":"2024-09-17T05:41:56.940324+0000","last_unstale":"2024-09-17T05:41:56.945810+0000","last_undegraded":"2024-09-17T05:41:56.945810+0000","last_fullsized":"2024-09-17T05:41:56.945810+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:55.904533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:55.904533+0000","last_clean_scrub_stamp":"2024-09-17T05:41:55.904533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:39:10.329477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-09-17T05:41:55.922588+0000","last_change":"2024-09-17T05:41:55.922588+0000","last_active":"2024-09-17T05:41:55.904533+0000","last_peered":"2024-09-17T05:41:55.904533+0000","last_clean":"2024-09-17T05:41:55.904533+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:41:55.922588+0000","last_undegraded":"2024-09-17T05:41:55.922588+0000","last_fullsized":"2024-09-17T05:41:55.922588+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:55.904533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:55.904533+0000","last_clean_scrub_stamp":"2024-09-17T05:41:55.904533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:41:56.913963+0000","last_change":"2024-09-17T05:41:56.913963+0000","last_active":"2024-09-17T05:41:56.913963+0000","last_peered":"2024-09-17T05:41:56.913963+0000","last_clean":"2024-09-17T05:41:56.913963+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:41:56.913963+0000","last_undegraded":"2024-09-17T05:41:56.913963+0000","last_fullsized":"2024-09-17T05:41:56.913963+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_clean_scrub_stamp":"2024-09-17T05:41:56.913963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-09-17T05:41:55.922741+0000","last_change":"2024-09-17T05:41:55.922741+0000","last_active":"2024-09-17T05:41:55.904533+0000","last_peered":"2024-09-17T05:41:55.904533+0000","last_clean":"2024-09-17T05:41:55.904533+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:41:55.922741+0000","last_undegraded":"2024-09-17T05:41:55.922741+0000","last_fullsized":"2024-09-17T05:41:55.922741+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:55.904533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:55.904533+0000","last_clean_scrub_stamp":"2024-09-17T05:41:55.904533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:41:56.913963+0000","last_change":"2024-09-17T05:41:56.913963+0000","last_active":"2024-09-17T05:41:56.913963+0000","last_peered":"2024-09-17T05:41:56.913963+0000","last_clean":"2024-09-17T05:41:56.913963+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:41:56.913963+0000","last_undegraded":"2024-09-17T05:41:56.913963+0000","last_fullsized":"2024-09-17T05:41:56.913963+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_clean_scrub_stamp":"2024-09-17T05:41:56.913963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:41:56.954501+0000","last_change":"2024-09-17T05:41:56.949682+0000","last_active":"2024-09-17T05:41:56.954501+0000","last_peered":"2024-09-17T05:41:56.954501+0000","last_clean":"2024-09-17T05:41:56.954501+0000","last_became_active":"2024-09-17T05:41:56.949271+0000","last_became_peered":"2024-09-17T05:41:56.949271+0000","last_unstale":"2024-09-17T05:41:56.954501+0000","last_undegraded":"2024-09-17T05:41:56.954501+0000","last_fullsized":"2024-09-17T05:41:56.954501+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:55.904533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:55.904533+0000","last_clean_scrub_stamp":"2024-09-17T05:41:55.904533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:09:34.572426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:41:56.913963+0000","last_change":"2024-09-17T05:41:56.913963+0000","last_active":"2024-09-17T05:41:56.913963+0000","last_peered":"2024-09-17T05:41:56.913963+0000","last_clean":"2024-09-17T05:41:56.913963+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:41:56.913963+0000","last_undegraded":"2024-09-17T05:41:56.913963+0000","last_fullsized":"2024-09-17T05:41:56.913963+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_clean_scrub_stamp":"2024-09-17T05:41:56.913963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-09-17T05:41:55.924578+0000","last_change":"2024-09-17T05:41:55.924578+0000","last_active":"2024-09-17T05:41:55.904533+0000","last_peered":"2024-09-17T05:41:55.904533+0000","last_clean":"2024-09-17T05:41:55.904533+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:41:55.924578+0000","last_undegraded":"2024-09-17T05:41:55.924578+0000","last_fullsized":"2024-09-17T05:41:55.924578+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:55.904533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:55.904533+0000","last_clean_scrub_stamp":"2024-09-17T05:41:55.904533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T05:41:57.958506+0000","last_change":"2024-09-17T05:41:57.948150+0000","last_active":"2024-09-17T05:41:57.958506+0000","last_peered":"2024-09-17T05:41:57.958506+0000","last_clean":"2024-09-17T05:41:57.958506+0000","last_became_active":"2024-09-17T05:41:57.947204+0000","last_became_peered":"2024-09-17T05:41:57.947204+0000","last_unstale":"2024-09-17T05:41:57.958506+0000","last_undegraded":"2024-09-17T05:41:57.958506+0000","last_fullsized":"2024-09-17T05:41:57.958506+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_clean_scrub_stamp":"2024-09-17T05:41:56.913963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:06:52.563709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-09-17T05:41:55.919928+0000","last_change":"2024-09-17T05:41:55.919928+0000","last_active":"2024-09-17T05:41:55.904533+0000","last_peered":"2024-09-17T05:41:55.904533+0000","last_clean":"2024-09-17T05:41:55.904533+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:41:55.919928+0000","last_undegraded":"2024-09-17T05:41:55.919928+0000","last_fullsized":"2024-09-17T05:41:55.919928+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:55.904533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:55.904533+0000","last_clean_scrub_stamp":"2024-09-17T05:41:55.904533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:41:56.913963+0000","last_change":"2024-09-17T05:41:56.913963+0000","last_active":"2024-09-17T05:41:56.913963+0000","last_peered":"2024-09-17T05:41:56.913963+0000","last_clean":"2024-09-17T05:41:56.913963+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:41:56.913963+0000","last_undegraded":"2024-09-17T05:41:56.913963+0000","last_fullsized":"2024-09-17T05:41:56.913963+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_clean_scrub_stamp":"2024-09-17T05:41:56.913963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.14","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:41:56.954521+0000","last_change":"2024-09-17T05:41:56.951074+0000","last_active":"2024-09-17T05:41:56.954521+0000","last_peered":"2024-09-17T05:41:56.954521+0000","last_clean":"2024-09-17T05:41:56.954521+0000","last_became_active":"2024-09-17T05:41:56.950549+0000","last_became_peered":"2024-09-17T05:41:56.950549+0000","last_unstale":"2024-09-17T05:41:56.954521+0000","last_undegraded":"2024-09-17T05:41:56.954521+0000","last_fullsized":"2024-09-17T05:41:56.954521+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:55.904533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:55.904533+0000","last_clean_scrub_stamp":"2024-09-17T05:41:55.904533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:21:08.994692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:41:56.913963+0000","last_change":"2024-09-17T05:41:56.913963+0000","last_active":"2024-09-17T05:41:56.913963+0000","last_peered":"2024-09-17T05:41:56.913963+0000","last_clean":"2024-09-17T05:41:56.913963+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:41:56.913963+0000","last_undegraded":"2024-09-17T05:41:56.913963+0000","last_fullsized":"2024-09-17T05:41:56.913963+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_clean_scrub_stamp":"2024-09-17T05:41:56.913963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.13","version":"22'2","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T05:41:57.963820+0000","last_change":"2024-09-17T05:41:56.939288+0000","last_active":"2024-09-17T05:41:57.963820+0000","last_peered":"2024-09-17T05:41:57.963820+0000","last_clean":"2024-09-17T05:41:57.963820+0000","last_became_active":"2024-09-17T05:41:56.938951+0000","last_became_peered":"2024-09-17T05:41:56.938951+0000","last_unstale":"2024-09-17T05:41:57.963820+0000","last_undegraded":"2024-09-17T05:41:57.963820+0000","last_fullsized":"2024-09-17T05:41:57.963820+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:55.904533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:55.904533+0000","last_clean_scrub_stamp":"2024-09-17T05:41:55.904533+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:41:47.665206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T05:41:57.960149+0000","last_change":"2024-09-17T05:41:57.953556+0000","last_active":"2024-09-17T05:41:57.960149+0000","last_peered":"2024-09-17T05:41:57.960149+0000","last_clean":"2024-09-17T05:41:57.960149+0000","last_became_active":"2024-09-17T05:41:57.953229+0000","last_became_peered":"2024-09-17T05:41:57.953229+0000","last_unstale":"2024-09-17T05:41:57.960149+0000","last_undegraded":"2024-09-17T05:41:57.960149+0000","last_fullsized":"2024-09-17T05:41:57.960149+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_clean_scrub_stamp":"2024-09-17T05:41:56.913963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:31:05.269290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-09-17T05:41:55.925889+0000","last_change":"2024-09-17T05:41:55.925889+0000","last_active":"2024-09-17T05:41:55.904533+0000","last_peered":"2024-09-17T05:41:55.904533+0000","last_clean":"2024-09-17T05:41:55.904533+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:41:55.925889+0000","last_undegraded":"2024-09-17T05:41:55.925889+0000","last_fullsized":"2024-09-17T05:41:55.925889+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:55.904533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:55.904533+0000","last_clean_scrub_stamp":"2024-09-17T05:41:55.904533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:41:56.913963+0000","last_change":"2024-09-17T05:41:56.913963+0000","last_active":"2024-09-17T05:41:56.913963+0000","last_peered":"2024-09-17T05:41:56.913963+0000","last_clean":"2024-09-17T05:41:56.913963+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:41:56.913963+0000","last_undegraded":"2024-09-17T05:41:56.913963+0000","last_fullsized":"2024-09-17T05:41:56.913963+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_clean_scrub_stamp":"2024-09-17T05:41:56.913963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:41:56.951770+0000","last_change":"2024-09-17T05:41:56.946833+0000","last_active":"2024-09-17T05:41:56.951770+0000","last_peered":"2024-09-17T05:41:56.951770+0000","last_clean":"2024-09-17T05:41:56.951770+0000","last_became_active":"2024-09-17T05:41:56.946545+0000","last_became_peered":"2024-09-17T05:41:56.946545+0000","last_unstale":"2024-09-17T05:41:56.951770+0000","last_undegraded":"2024-09-17T05:41:56.951770+0000","last_fullsized":"2024-09-17T05:41:56.951770+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:55.904533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:55.904533+0000","last_clean_scrub_stamp":"2024-09-17T05:41:55.904533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:08:59.697169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-17T05:41:56.932989+0000","last_change":"2024-09-17T05:41:56.932989+0000","last_active":"2024-09-17T05:41:56.913963+0000","last_peered":"2024-09-17T05:41:56.913963+0000","last_clean":"2024-09-17T05:41:56.913963+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:41:56.932989+0000","last_undegraded":"2024-09-17T05:41:56.932989+0000","last_fullsized":"2024-09-17T05:41:56.932989+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_clean_scrub_stamp":"2024-09-17T05:41:56.913963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-09-17T05:41:55.921502+0000","last_change":"2024-09-17T05:41:55.921502+0000","last_active":"2024-09-17T05:41:55.904533+0000","last_peered":"2024-09-17T05:41:55.904533+0000","last_clean":"2024-09-17T05:41:55.904533+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:41:55.921502+0000","last_undegraded":"2024-09-17T05:41:55.921502+0000","last_fullsized":"2024-09-17T05:41:55.921502+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:55.904533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:55.904533+0000","last_clean_scrub_stamp":"2024-09-17T05:41:55.904533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:41:56.913963+0000","last_change":"2024-09-17T05:41:56.913963+0000","last_active":"2024-09-17T05:41:56.913963+0000","last_peered":"2024-09-17T05:41:56.913963+0000","last_clean":"2024-09-17T05:41:56.913963+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:41:56.913963+0000","last_undegraded":"2024-09-17T05:41:56.913963+0000","last_fullsized":"2024-09-17T05:41:56.913963+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_clean_scrub_stamp":"2024-09-17T05:41:56.913963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.f","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-09-17T05:41:55.923232+0000","last_change":"2024-09-17T05:41:55.923232+0000","last_active":"2024-09-17T05:41:55.904533+0000","last_peered":"2024-09-17T05:41:55.904533+0000","last_clean":"2024-09-17T05:41:55.904533+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:41:55.923232+0000","last_undegraded":"2024-09-17T05:41:55.923232+0000","last_fullsized":"2024-09-17T05:41:55.923232+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:55.904533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:55.904533+0000","last_clean_scrub_stamp":"2024-09-17T05:41:55.904533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:41:56.913963+0000","last_change":"2024-09-17T05:41:56.913963+0000","last_active":"2024-09-17T05:41:56.913963+0000","last_peered":"2024-09-17T05:41:56.913963+0000","last_clean":"2024-09-17T05:41:56.913963+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:41:56.913963+0000","last_undegraded":"2024-09-17T05:41:56.913963+0000","last_fullsized":"2024-09-17T05:41:56.913963+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_clean_scrub_stamp":"2024-09-17T05:41:56.913963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.e","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-09-17T05:41:55.921184+0000","last_change":"2024-09-17T05:41:55.921184+0000","last_active":"2024-09-17T05:41:55.904533+0000","last_peered":"2024-09-17T05:41:55.904533+0000","last_clean":"2024-09-17T05:41:55.904533+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:41:55.921184+0000","last_undegraded":"2024-09-17T05:41:55.921184+0000","last_fullsized":"2024-09-17T05:41:55.921184+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:55.904533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:55.904533+0000","last_clean_scrub_stamp":"2024-09-17T05:41:55.904533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:41:56.913963+0000","last_change":"2024-09-17T05:41:56.913963+0000","last_active":"2024-09-17T05:41:56.913963+0000","last_peered":"2024-09-17T05:41:56.913963+0000","last_clean":"2024-09-17T05:41:56.913963+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:41:56.913963+0000","last_undegraded":"2024-09-17T05:41:56.913963+0000","last_fullsized":"2024-09-17T05:41:56.913963+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_clean_scrub_stamp":"2024-09-17T05:41:56.913963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.d","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-09-17T05:41:55.918638+0000","last_change":"2024-09-17T05:41:55.918638+0000","last_active":"2024-09-17T05:41:55.904533+0000","last_peered":"2024-09-17T05:41:55.904533+0000","last_clean":"2024-09-17T05:41:55.904533+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:41:55.918638+0000","last_undegraded":"2024-09-17T05:41:55.918638+0000","last_fullsized":"2024-09-17T05:41:55.918638+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:55.904533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:55.904533+0000","last_clean_scrub_stamp":"2024-09-17T05:41:55.904533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:41:56.913963+0000","last_change":"2024-09-17T05:41:56.913963+0000","last_active":"2024-09-17T05:41:56.913963+0000","last_peered":"2024-09-17T05:41:56.913963+0000","last_clean":"2024-09-17T05:41:56.913963+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:41:56.913963+0000","last_undegraded":"2024-09-17T05:41:56.913963+0000","last_fullsized":"2024-09-17T05:41:56.913963+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_clean_scrub_stamp":"2024-09-17T05:41:56.913963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-09-17T05:41:55.922017+0000","last_change":"2024-09-17T05:41:55.922017+0000","last_active":"2024-09-17T05:41:55.904533+0000","last_peered":"2024-09-17T05:41:55.904533+0000","last_clean":"2024-09-17T05:41:55.904533+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:41:55.922017+0000","last_undegraded":"2024-09-17T05:41:55.922017+0000","last_fullsized":"2024-09-17T05:41:55.922017+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:55.904533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:55.904533+0000","last_clean_scrub_stamp":"2024-09-17T05:41:55.904533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:41:56.913963+0000","last_change":"2024-09-17T05:41:56.913963+0000","last_active":"2024-09-17T05:41:56.913963+0000","last_peered":"2024-09-17T05:41:56.913963+0000","last_clean":"2024-09-17T05:41:56.913963+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:41:56.913963+0000","last_undegraded":"2024-09-17T05:41:56.913963+0000","last_fullsized":"2024-09-17T05:41:56.913963+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_clean_scrub_stamp":"2024-09-17T05:41:56.913963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"19'72","reported_seq":105,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T05:41:55.926749+0000","last_change":"2024-09-17T05:41:48.539830+0000","last_active":"2024-09-17T05:41:55.926749+0000","last_peered":"2024-09-17T05:41:55.926749+0000","last_clean":"2024-09-17T05:41:55.926749+0000","last_became_active":"2024-09-17T05:41:48.538743+0000","last_became_peered":"2024-09-17T05:41:48.538743+0000","last_unstale":"2024-09-17T05:41:55.926749+0000","last_undegraded":"2024-09-17T05:41:55.926749+0000","last_fullsized":"2024-09-17T05:41:55.926749+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:47.152539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:47.152539+0000","last_clean_scrub_stamp":"2024-09-17T05:41:47.152539+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:08:02.952016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-09-17T05:41:55.923951+0000","last_change":"2024-09-17T05:41:55.923951+0000","last_active":"2024-09-17T05:41:55.904533+0000","last_peered":"2024-09-17T05:41:55.904533+0000","last_clean":"2024-09-17T05:41:55.904533+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:41:55.923951+0000","last_undegraded":"2024-09-17T05:41:55.923951+0000","last_fullsized":"2024-09-17T05:41:55.923951+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:55.904533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:55.904533+0000","last_clean_scrub_stamp":"2024-09-17T05:41:55.904533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:41:56.913963+0000","last_change":"2024-09-17T05:41:56.913963+0000","last_active":"2024-09-17T05:41:56.913963+0000","last_peered":"2024-09-17T05:41:56.913963+0000","last_clean":"2024-09-17T05:41:56.913963+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:41:56.913963+0000","last_undegraded":"2024-09-17T05:41:56.913963+0000","last_fullsized":"2024-09-17T05:41:56.913963+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_clean_scrub_stamp":"2024-09-17T05:41:56.913963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-09-17T05:41:55.925470+0000","last_change":"2024-09-17T05:41:55.925470+0000","last_active":"2024-09-17T05:41:55.904533+0000","last_peered":"2024-09-17T05:41:55.904533+0000","last_clean":"2024-09-17T05:41:55.904533+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:41:55.925470+0000","last_undegraded":"2024-09-17T05:41:55.925470+0000","last_fullsized":"2024-09-17T05:41:55.925470+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:55.904533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:55.904533+0000","last_clean_scrub_stamp":"2024-09-17T05:41:55.904533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T05:41:57.947280+0000","last_change":"2024-09-17T05:41:57.943470+0000","last_active":"2024-09-17T05:41:57.947280+0000","last_peered":"2024-09-17T05:41:57.947280+0000","last_clean":"2024-09-17T05:41:57.947280+0000","last_became_active":"2024-09-17T05:41:57.943015+0000","last_became_peered":"2024-09-17T05:41:57.943015+0000","last_unstale":"2024-09-17T05:41:57.947280+0000","last_undegraded":"2024-09-17T05:41:57.947280+0000","last_fullsized":"2024-09-17T05:41:57.947280+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_clean_scrub_stamp":"2024-09-17T05:41:56.913963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:54:20.645536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-09-17T05:41:55.921169+0000","last_change":"2024-09-17T05:41:55.921169+0000","last_active":"2024-09-17T05:41:55.904533+0000","last_peered":"2024-09-17T05:41:55.904533+0000","last_clean":"2024-09-17T05:41:55.904533+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:41:55.921169+0000","last_undegraded":"2024-09-17T05:41:55.921169+0000","last_fullsized":"2024-09-17T05:41:55.921169+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:55.904533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:55.904533+0000","last_clean_scrub_stamp":"2024-09-17T05:41:55.904533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:41:56.913963+0000","last_change":"2024-09-17T05:41:56.913963+0000","last_active":"2024-09-17T05:41:56.913963+0000","last_peered":"2024-09-17T05:41:56.913963+0000","last_clean":"2024-09-17T05:41:56.913963+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:41:56.913963+0000","last_undegraded":"2024-09-17T05:41:56.913963+0000","last_fullsized":"2024-09-17T05:41:56.913963+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_clean_scrub_stamp":"2024-09-17T05:41:56.913963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-09-17T05:41:55.924760+0000","last_change":"2024-09-17T05:41:55.924760+0000","last_active":"2024-09-17T05:41:55.904533+0000","last_peered":"2024-09-17T05:41:55.904533+0000","last_clean":"2024-09-17T05:41:55.904533+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:41:55.924760+0000","last_undegraded":"2024-09-17T05:41:55.924760+0000","last_fullsized":"2024-09-17T05:41:55.924760+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:55.904533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:55.904533+0000","last_clean_scrub_stamp":"2024-09-17T05:41:55.904533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:41:56.913963+0000","last_change":"2024-09-17T05:41:56.913963+0000","last_active":"2024-09-17T05:41:56.913963+0000","last_peered":"2024-09-17T05:41:56.913963+0000","last_clean":"2024-09-17T05:41:56.913963+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:41:56.913963+0000","last_undegraded":"2024-09-17T05:41:56.913963+0000","last_fullsized":"2024-09-17T05:41:56.913963+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_clean_scrub_stamp":"2024-09-17T05:41:56.913963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-09-17T05:41:55.918640+0000","last_change":"2024-09-17T05:41:55.918640+0000","last_active":"2024-09-17T05:41:55.904533+0000","last_peered":"2024-09-17T05:41:55.904533+0000","last_clean":"2024-09-17T05:41:55.904533+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:41:55.918640+0000","last_undegraded":"2024-09-17T05:41:55.918640+0000","last_fullsized":"2024-09-17T05:41:55.918640+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:55.904533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:55.904533+0000","last_clean_scrub_stamp":"2024-09-17T05:41:55.904533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:41:56.913963+0000","last_change":"2024-09-17T05:41:56.913963+0000","last_active":"2024-09-17T05:41:56.913963+0000","last_peered":"2024-09-17T05:41:56.913963+0000","last_clean":"2024-09-17T05:41:56.913963+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:41:56.913963+0000","last_undegraded":"2024-09-17T05:41:56.913963+0000","last_fullsized":"2024-09-17T05:41:56.913963+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_clean_scrub_stamp":"2024-09-17T05:41:56.913963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-09-17T05:41:55.923012+0000","last_change":"2024-09-17T05:41:55.923012+0000","last_active":"2024-09-17T05:41:55.904533+0000","last_peered":"2024-09-17T05:41:55.904533+0000","last_clean":"2024-09-17T05:41:55.904533+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:41:55.923012+0000","last_undegraded":"2024-09-17T05:41:55.923012+0000","last_fullsized":"2024-09-17T05:41:55.923012+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:55.904533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:55.904533+0000","last_clean_scrub_stamp":"2024-09-17T05:41:55.904533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:41:56.913963+0000","last_change":"2024-09-17T05:41:56.913963+0000","last_active":"2024-09-17T05:41:56.913963+0000","last_peered":"2024-09-17T05:41:56.913963+0000","last_clean":"2024-09-17T05:41:56.913963+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:41:56.913963+0000","last_undegraded":"2024-09-17T05:41:56.913963+0000","last_fullsized":"2024-09-17T05:41:56.913963+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_clean_scrub_stamp":"2024-09-17T05:41:56.913963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-09-17T05:41:55.918651+0000","last_change":"2024-09-17T05:41:55.918651+0000","last_active":"2024-09-17T05:41:55.904533+0000","last_peered":"2024-09-17T05:41:55.904533+0000","last_clean":"2024-09-17T05:41:55.904533+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:41:55.918651+0000","last_undegraded":"2024-09-17T05:41:55.918651+0000","last_fullsized":"2024-09-17T05:41:55.918651+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:55.904533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:55.904533+0000","last_clean_scrub_stamp":"2024-09-17T05:41:55.904533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:41:56.913963+0000","last_change":"2024-09-17T05:41:56.913963+0000","last_active":"2024-09-17T05:41:56.913963+0000","last_peered":"2024-09-17T05:41:56.913963+0000","last_clean":"2024-09-17T05:41:56.913963+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:41:56.913963+0000","last_undegraded":"2024-09-17T05:41:56.913963+0000","last_fullsized":"2024-09-17T05:41:56.913963+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_clean_scrub_stamp":"2024-09-17T05:41:56.913963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:41:56.951831+0000","last_change":"2024-09-17T05:41:56.947816+0000","last_active":"2024-09-17T05:41:56.951831+0000","last_peered":"2024-09-17T05:41:56.951831+0000","last_clean":"2024-09-17T05:41:56.951831+0000","last_became_active":"2024-09-17T05:41:56.947483+0000","last_became_peered":"2024-09-17T05:41:56.947483+0000","last_unstale":"2024-09-17T05:41:56.951831+0000","last_undegraded":"2024-09-17T05:41:56.951831+0000","last_fullsized":"2024-09-17T05:41:56.951831+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:55.904533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:55.904533+0000","last_clean_scrub_stamp":"2024-09-17T05:41:55.904533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:10:33.368816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T05:41:57.958467+0000","last_change":"2024-09-17T05:41:57.950209+0000","last_active":"2024-09-17T05:41:57.958467+0000","last_peered":"2024-09-17T05:41:57.958467+0000","last_clean":"2024-09-17T05:41:57.958467+0000","last_became_active":"2024-09-17T05:41:57.949869+0000","last_became_peered":"2024-09-17T05:41:57.949869+0000","last_unstale":"2024-09-17T05:41:57.958467+0000","last_undegraded":"2024-09-17T05:41:57.958467+0000","last_fullsized":"2024-09-17T05:41:57.958467+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_clean_scrub_stamp":"2024-09-17T05:41:56.913963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:57:20.773447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-09-17T05:41:55.926244+0000","last_change":"2024-09-17T05:41:55.926244+0000","last_active":"2024-09-17T05:41:55.904533+0000","last_peered":"2024-09-17T05:41:55.904533+0000","last_clean":"2024-09-17T05:41:55.904533+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:41:55.926244+0000","last_undegraded":"2024-09-17T05:41:55.926244+0000","last_fullsized":"2024-09-17T05:41:55.926244+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:55.904533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:55.904533+0000","last_clean_scrub_stamp":"2024-09-17T05:41:55.904533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:41:56.913963+0000","last_change":"2024-09-17T05:41:56.913963+0000","last_active":"2024-09-17T05:41:56.913963+0000","last_peered":"2024-09-17T05:41:56.913963+0000","last_clean":"2024-09-17T05:41:56.913963+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:41:56.913963+0000","last_undegraded":"2024-09-17T05:41:56.913963+0000","last_fullsized":"2024-09-17T05:41:56.913963+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_clean_scrub_stamp":"2024-09-17T05:41:56.913963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-09-17T05:41:55.918653+0000","last_change":"2024-09-17T05:41:55.918653+0000","last_active":"2024-09-17T05:41:55.904533+0000","last_peered":"2024-09-17T05:41:55.904533+0000","last_clean":"2024-09-17T05:41:55.904533+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:41:55.918653+0000","last_undegraded":"2024-09-17T05:41:55.918653+0000","last_fullsized":"2024-09-17T05:41:55.918653+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:55.904533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:55.904533+0000","last_clean_scrub_stamp":"2024-09-17T05:41:55.904533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:41:56.913963+0000","last_change":"2024-09-17T05:41:56.913963+0000","last_active":"2024-09-17T05:41:56.913963+0000","last_peered":"2024-09-17T05:41:56.913963+0000","last_clean":"2024-09-17T05:41:56.913963+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:41:56.913963+0000","last_undegraded":"2024-09-17T05:41:56.913963+0000","last_fullsized":"2024-09-17T05:41:56.913963+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_clean_scrub_stamp":"2024-09-17T05:41:56.913963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-09-17T05:41:55.918638+0000","last_change":"2024-09-17T05:41:55.918638+0000","last_active":"2024-09-17T05:41:55.904533+0000","last_peered":"2024-09-17T05:41:55.904533+0000","last_clean":"2024-09-17T05:41:55.904533+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:41:55.918638+0000","last_undegraded":"2024-09-17T05:41:55.918638+0000","last_fullsized":"2024-09-17T05:41:55.918638+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:55.904533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:55.904533+0000","last_clean_scrub_stamp":"2024-09-17T05:41:55.904533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:41:56.913963+0000","last_change":"2024-09-17T05:41:56.913963+0000","last_active":"2024-09-17T05:41:56.913963+0000","last_peered":"2024-09-17T05:41:56.913963+0000","last_clean":"2024-09-17T05:41:56.913963+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:41:56.913963+0000","last_undegraded":"2024-09-17T05:41:56.913963+0000","last_fullsized":"2024-09-17T05:41:56.913963+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_clean_scrub_stamp":"2024-09-17T05:41:56.913963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.b","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-09-17T05:41:55.922289+0000","last_change":"2024-09-17T05:41:55.922289+0000","last_active":"2024-09-17T05:41:55.904533+0000","last_peered":"2024-09-17T05:41:55.904533+0000","last_clean":"2024-09-17T05:41:55.904533+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:41:55.922289+0000","last_undegraded":"2024-09-17T05:41:55.922289+0000","last_fullsized":"2024-09-17T05:41:55.922289+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:55.904533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:55.904533+0000","last_clean_scrub_stamp":"2024-09-17T05:41:55.904533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-17T05:41:56.934139+0000","last_change":"2024-09-17T05:41:56.934139+0000","last_active":"2024-09-17T05:41:56.913963+0000","last_peered":"2024-09-17T05:41:56.913963+0000","last_clean":"2024-09-17T05:41:56.913963+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:41:56.934139+0000","last_undegraded":"2024-09-17T05:41:56.934139+0000","last_fullsized":"2024-09-17T05:41:56.934139+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_clean_scrub_stamp":"2024-09-17T05:41:56.913963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:41:56.913963+0000","last_change":"2024-09-17T05:41:56.913963+0000","last_active":"2024-09-17T05:41:56.913963+0000","last_peered":"2024-09-17T05:41:56.913963+0000","last_clean":"2024-09-17T05:41:56.913963+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:41:56.913963+0000","last_undegraded":"2024-09-17T05:41:56.913963+0000","last_fullsized":"2024-09-17T05:41:56.913963+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_clean_scrub_stamp":"2024-09-17T05:41:56.913963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1c","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-09-17T05:41:55.922276+0000","last_change":"2024-09-17T05:41:55.922276+0000","last_active":"2024-09-17T05:41:55.904533+0000","last_peered":"2024-09-17T05:41:55.904533+0000","last_clean":"2024-09-17T05:41:55.904533+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:41:55.922276+0000","last_undegraded":"2024-09-17T05:41:55.922276+0000","last_fullsized":"2024-09-17T05:41:55.922276+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:55.904533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:55.904533+0000","last_clean_scrub_stamp":"2024-09-17T05:41:55.904533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:41:56.913963+0000","last_change":"2024-09-17T05:41:56.913963+0000","last_active":"2024-09-17T05:41:56.913963+0000","last_peered":"2024-09-17T05:41:56.913963+0000","last_clean":"2024-09-17T05:41:56.913963+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:41:56.913963+0000","last_undegraded":"2024-09-17T05:41:56.913963+0000","last_fullsized":"2024-09-17T05:41:56.913963+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_clean_scrub_stamp":"2024-09-17T05:41:56.913963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1d","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-09-17T05:41:55.923615+0000","last_change":"2024-09-17T05:41:55.923615+0000","last_active":"2024-09-17T05:41:55.904533+0000","last_peered":"2024-09-17T05:41:55.904533+0000","last_clean":"2024-09-17T05:41:55.904533+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:41:55.923615+0000","last_undegraded":"2024-09-17T05:41:55.923615+0000","last_fullsized":"2024-09-17T05:41:55.923615+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:55.904533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:55.904533+0000","last_clean_scrub_stamp":"2024-09-17T05:41:55.904533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T05:41:57.958452+0000","last_change":"2024-09-17T05:41:57.947899+0000","last_active":"2024-09-17T05:41:57.958452+0000","last_peered":"2024-09-17T05:41:57.958452+0000","last_clean":"2024-09-17T05:41:57.958452+0000","last_became_active":"2024-09-17T05:41:57.947556+0000","last_became_peered":"2024-09-17T05:41:57.947556+0000","last_unstale":"2024-09-17T05:41:57.958452+0000","last_undegraded":"2024-09-17T05:41:57.958452+0000","last_fullsized":"2024-09-17T05:41:57.958452+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_clean_scrub_stamp":"2024-09-17T05:41:56.913963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:19:11.730293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-09-17T05:41:55.921410+0000","last_change":"2024-09-17T05:41:55.921410+0000","last_active":"2024-09-17T05:41:55.904533+0000","last_peered":"2024-09-17T05:41:55.904533+0000","last_clean":"2024-09-17T05:41:55.904533+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:41:55.921410+0000","last_undegraded":"2024-09-17T05:41:55.921410+0000","last_fullsized":"2024-09-17T05:41:55.921410+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:55.904533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:55.904533+0000","last_clean_scrub_stamp":"2024-09-17T05:41:55.904533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:41:56.913963+0000","last_change":"2024-09-17T05:41:56.913963+0000","last_active":"2024-09-17T05:41:56.913963+0000","last_peered":"2024-09-17T05:41:56.913963+0000","last_clean":"2024-09-17T05:41:56.913963+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:41:56.913963+0000","last_undegraded":"2024-09-17T05:41:56.913963+0000","last_fullsized":"2024-09-17T05:41:56.913963+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_clean_scrub_stamp":"2024-09-17T05:41:56.913963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1f","version":"22'4","reported_seq":17,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T05:41:57.964113+0000","last_change":"2024-09-17T05:41:56.946707+0000","last_active":"2024-09-17T05:41:57.964113+0000","last_peered":"2024-09-17T05:41:57.964113+0000","last_clean":"2024-09-17T05:41:57.964113+0000","last_became_active":"2024-09-17T05:41:56.946448+0000","last_became_peered":"2024-09-17T05:41:56.946448+0000","last_unstale":"2024-09-17T05:41:57.964113+0000","last_undegraded":"2024-09-17T05:41:57.964113+0000","last_fullsized":"2024-09-17T05:41:57.964113+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:55.904533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:55.904533+0000","last_clean_scrub_stamp":"2024-09-17T05:41:55.904533+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:55:32.730864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":34,"acting":34,"num_store_stats":2},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":616,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6,"ondisk_log_size":6,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":16,"seq":68719476742,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27220,"kb_used_data":192,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344620,"statfs":{"total":96636764160,"available":96608890880,"internally_reserved":0,"allocated":196608,"data_stored":62477,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":7,"up_from":15,"seq":64424509446,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28032,"kb_used_data":760,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343808,"statfs":{"total":96636764160,"available":96608059392,"internally_reserved":0,"allocated":778240,"data_stored":647028,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509445,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27216,"kb_used_data":180,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344624,"statfs":{"total":96636764160,"available":96608894976,"internally_reserved":0,"allocated":184320,"data_stored":56660,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509445,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27216,"kb_used_data":180,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344624,"statfs":{"total":96636764160,"available":96608894976,"internally_reserved":0,"allocated":184320,"data_stored":56660,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509445,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27208,"kb_used_data":180,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344632,"statfs":{"total":96636764160,"available":96608903168,"internally_reserved":0,"allocated":184320,"data_stored":56660,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509445,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27208,"kb_used_data":180,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344632,"statfs":{"total":96636764160,"available":96608903168,"internally_reserved":0,"allocated":184320,"data_stored":56660,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509445,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27208,"kb_used_data":180,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344632,"statfs":{"total":96636764160,"available":96608903168,"internally_reserved":0,"allocated":184320,"data_stored":56660,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574853,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27832,"kb_used_data":800,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344008,"statfs":{"total":96636764160,"available":96608264192,"internally_reserved":0,"allocated":819200,"data_stored":665917,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-17T05:42:01.294 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-17T05:42:01.445 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:01.444+0000 7f4c20a40640 1 -- 172.21.15.150:0/2206470399 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4c1c0b5470 msgr2=0x7f4c1c166580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:01.445 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:01.444+0000 7f4c20a40640 1 --2- 172.21.15.150:0/2206470399 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4c1c0b5470 0x7f4c1c166580 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f4c14005fd0 tx=0x7f4c1402a940 comp rx=0 tx=0).stop 2024-09-17T05:42:01.445 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:01.444+0000 7f4c20a40640 1 -- 172.21.15.150:0/2206470399 shutdown_connections 2024-09-17T05:42:01.445 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:01.444+0000 7f4c20a40640 1 --2- 172.21.15.150:0/2206470399 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4c1c0b5470 0x7f4c1c166580 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:01.445 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:01.444+0000 7f4c20a40640 1 -- 172.21.15.150:0/2206470399 >> 172.21.15.150:0/2206470399 conn(0x7f4c1c0b2e80 msgr2=0x7f4c1c0b3290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:42:01.445 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:01.444+0000 7f4c20a40640 1 -- 172.21.15.150:0/2206470399 shutdown_connections 2024-09-17T05:42:01.445 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:01.444+0000 7f4c20a40640 1 -- 172.21.15.150:0/2206470399 wait complete. 2024-09-17T05:42:01.446 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:01.446+0000 7f4c20a40640 1 Processor -- start 2024-09-17T05:42:01.446 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:01.446+0000 7f4c20a40640 1 -- start start 2024-09-17T05:42:01.449 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:01.447+0000 7f4c20a40640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4c1c0b5470 0x7f4c1c09ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:42:01.449 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:01.447+0000 7f4c20a40640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4c1c0b5ff0 0x7f4c1c155b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:42:01.449 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:01.447+0000 7f4c20a40640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4c1c0cda20 0x7f4c1c0b1d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:42:01.449 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:01.447+0000 7f4c20a40640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f4c1c166cd0 con 0x7f4c1c0b5470 2024-09-17T05:42:01.449 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:01.447+0000 7f4c20a40640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f4c1c0b6590 con 0x7f4c1c0b5ff0 2024-09-17T05:42:01.449 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:01.447+0000 7f4c20a40640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f4c1c166e50 con 0x7f4c1c0cda20 2024-09-17T05:42:01.449 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:01.447+0000 7f4c1a59c640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4c1c0b5470 0x7f4c1c09ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:42:01.449 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:01.447+0000 7f4c1a59c640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4c1c0b5470 0x7f4c1c09ef60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:54364/0 (socket says 172.21.15.150:54364) 2024-09-17T05:42:01.449 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:01.447+0000 7f4c1a59c640 1 -- 172.21.15.150:0/3041091726 learned_addr learned my addr 172.21.15.150:0/3041091726 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:42:01.449 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:01.447+0000 7f4c19d9b640 1 --2- 172.21.15.150:0/3041091726 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4c1c0b5ff0 0x7f4c1c155b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:42:01.450 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:01.447+0000 7f4c1ad9d640 1 --2- 172.21.15.150:0/3041091726 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4c1c0cda20 0x7f4c1c0b1d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:42:01.450 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:01.448+0000 7f4c1a59c640 1 -- 172.21.15.150:0/3041091726 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4c1c0cda20 msgr2=0x7f4c1c0b1d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:01.450 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:01.448+0000 7f4c1a59c640 1 --2- 172.21.15.150:0/3041091726 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4c1c0cda20 0x7f4c1c0b1d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:01.450 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:01.448+0000 7f4c1a59c640 1 -- 172.21.15.150:0/3041091726 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4c1c0b5ff0 msgr2=0x7f4c1c155b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:01.450 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:01.448+0000 7f4c1a59c640 1 --2- 172.21.15.150:0/3041091726 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4c1c0b5ff0 0x7f4c1c155b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:01.450 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:01.448+0000 7f4c1a59c640 1 -- 172.21.15.150:0/3041091726 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4c1c0b22c0 con 0x7f4c1c0b5470 2024-09-17T05:42:01.450 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:01.448+0000 7f4c1a59c640 1 --2- 172.21.15.150:0/3041091726 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4c1c0b5470 0x7f4c1c09ef60 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f4c0c00c3f0 tx=0x7f4c0c00c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:42:01.450 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:01.448+0000 7f4c12ffd640 1 -- 172.21.15.150:0/3041091726 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c0c017070 con 0x7f4c1c0b5470 2024-09-17T05:42:01.450 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:01.448+0000 7f4c12ffd640 1 -- 172.21.15.150:0/3041091726 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f4c0c0053e0 con 0x7f4c1c0b5470 2024-09-17T05:42:01.450 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:01.448+0000 7f4c20a40640 1 -- 172.21.15.150:0/3041091726 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4c1c156280 con 0x7f4c1c0b5470 2024-09-17T05:42:01.450 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:01.448+0000 7f4c12ffd640 1 -- 172.21.15.150:0/3041091726 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c0c003870 con 0x7f4c1c0b5470 2024-09-17T05:42:01.451 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:01.448+0000 7f4c20a40640 1 -- 172.21.15.150:0/3041091726 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4c1c09cab0 con 0x7f4c1c0b5470 2024-09-17T05:42:01.451 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:01.449+0000 7f4c20a40640 1 -- 172.21.15.150:0/3041091726 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4c1c09c5c0 con 0x7f4c1c0b5470 2024-09-17T05:42:01.451 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:01.450+0000 7f4c12ffd640 1 -- 172.21.15.150:0/3041091726 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f4c0c01a070 con 0x7f4c1c0b5470 2024-09-17T05:42:01.451 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:01.450+0000 7f4c12ffd640 1 --2- 172.21.15.150:0/3041091726 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f4bfc078bc0 0x7f4bfc07b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:42:01.452 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:01.450+0000 7f4c12ffd640 1 -- 172.21.15.150:0/3041091726 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f4c0c09a040 con 0x7f4c1c0b5470 2024-09-17T05:42:01.452 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:01.450+0000 7f4c19d9b640 1 --2- 172.21.15.150:0/3041091726 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f4bfc078bc0 0x7f4bfc07b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:42:01.452 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:01.451+0000 7f4c19d9b640 1 --2- 172.21.15.150:0/3041091726 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f4bfc078bc0 0x7f4bfc07b0d0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f4c04000f60 tx=0x7f4c04009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:42:01.455 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:01.454+0000 7f4c12ffd640 1 -- 172.21.15.150:0/3041091726 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f4c0c061e30 con 0x7f4c1c0b5470 2024-09-17T05:42:01.625 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:01.625+0000 7f4c20a40640 1 -- 172.21.15.150:0/3041091726 --> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f4c1c0b67a0 con 0x7f4bfc078bc0 2024-09-17T05:42:01.629 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:01.629+0000 7f4c12ffd640 1 -- 172.21.15.150:0/3041091726 <== mgr.4108 v2:172.21.15.176:6800/3631216395 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+242492 (secure 0 0 0) 0x7f4c1c0b67a0 con 0x7f4bfc078bc0 2024-09-17T05:42:01.632 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-09-17T05:42:01.633 INFO:teuthology.orchestra.run.smithi150.stderr:dumped all 2024-09-17T05:42:01.634 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:01.632+0000 7f4c20a40640 1 -- 172.21.15.150:0/3041091726 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f4bfc078bc0 msgr2=0x7f4bfc07b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:01.635 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:01.632+0000 7f4c20a40640 1 --2- 172.21.15.150:0/3041091726 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f4bfc078bc0 0x7f4bfc07b0d0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f4c04000f60 tx=0x7f4c04009040 comp rx=0 tx=0).stop 2024-09-17T05:42:01.635 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:01.632+0000 7f4c20a40640 1 -- 172.21.15.150:0/3041091726 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4c1c0b5470 msgr2=0x7f4c1c09ef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:01.635 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:01.632+0000 7f4c20a40640 1 --2- 172.21.15.150:0/3041091726 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4c1c0b5470 0x7f4c1c09ef60 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f4c0c00c3f0 tx=0x7f4c0c00c8b0 comp rx=0 tx=0).stop 2024-09-17T05:42:01.635 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:01.632+0000 7f4c20a40640 1 -- 172.21.15.150:0/3041091726 shutdown_connections 2024-09-17T05:42:01.635 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:01.632+0000 7f4c20a40640 1 --2- 172.21.15.150:0/3041091726 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4c1c0b5ff0 0x7f4c1c155b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:01.635 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:01.632+0000 7f4c20a40640 1 --2- 172.21.15.150:0/3041091726 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f4bfc078bc0 0x7f4bfc07b0d0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:01.635 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:01.632+0000 7f4c20a40640 1 --2- 172.21.15.150:0/3041091726 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4c1c0cda20 0x7f4c1c0b1d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:01.635 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:01.632+0000 7f4c20a40640 1 --2- 172.21.15.150:0/3041091726 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4c1c0b5470 0x7f4c1c09ef60 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:01.635 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:01.632+0000 7f4c20a40640 1 -- 172.21.15.150:0/3041091726 >> 172.21.15.150:0/3041091726 conn(0x7f4c1c0b2e80 msgr2=0x7f4c1c071800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:42:01.635 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:01.632+0000 7f4c20a40640 1 -- 172.21.15.150:0/3041091726 shutdown_connections 2024-09-17T05:42:01.635 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:01.632+0000 7f4c20a40640 1 -- 172.21.15.150:0/3041091726 wait complete. 2024-09-17T05:42:01.644 INFO:teuthology.orchestra.run.smithi150.stdout:{"pg_ready":true,"pg_map":{"version":25,"stamp":"2024-09-17T05:42:00.844629+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590984,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":108,"num_write_kb":1636,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":78,"ondisk_log_size":78,"up":100,"acting":100,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":22,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219140,"kb_used_data":2652,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755580,"statfs":{"total":773094113280,"available":772869713920,"internally_reserved":0,"allocated":2715648,"data_stored":1658722,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":14,"apply_latency_ms":14,"commit_latency_ns":14000000,"apply_latency_ns":14000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":616,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.925201"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:41:56.913963+0000","last_change":"2024-09-17T05:41:56.913963+0000","last_active":"2024-09-17T05:41:56.913963+0000","last_peered":"2024-09-17T05:41:56.913963+0000","last_clean":"2024-09-17T05:41:56.913963+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:41:56.913963+0000","last_undegraded":"2024-09-17T05:41:56.913963+0000","last_fullsized":"2024-09-17T05:41:56.913963+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_clean_scrub_stamp":"2024-09-17T05:41:56.913963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:41:56.913963+0000","last_change":"2024-09-17T05:41:56.913963+0000","last_active":"2024-09-17T05:41:56.913963+0000","last_peered":"2024-09-17T05:41:56.913963+0000","last_clean":"2024-09-17T05:41:56.913963+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:41:56.913963+0000","last_undegraded":"2024-09-17T05:41:56.913963+0000","last_fullsized":"2024-09-17T05:41:56.913963+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_clean_scrub_stamp":"2024-09-17T05:41:56.913963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T05:41:57.946892+0000","last_change":"2024-09-17T05:41:57.935841+0000","last_active":"2024-09-17T05:41:57.946892+0000","last_peered":"2024-09-17T05:41:57.946892+0000","last_clean":"2024-09-17T05:41:57.946892+0000","last_became_active":"2024-09-17T05:41:57.935502+0000","last_became_peered":"2024-09-17T05:41:57.935502+0000","last_unstale":"2024-09-17T05:41:57.946892+0000","last_undegraded":"2024-09-17T05:41:57.946892+0000","last_fullsized":"2024-09-17T05:41:57.946892+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_clean_scrub_stamp":"2024-09-17T05:41:56.913963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:18:37.706664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:41:56.913963+0000","last_change":"2024-09-17T05:41:56.913963+0000","last_active":"2024-09-17T05:41:56.913963+0000","last_peered":"2024-09-17T05:41:56.913963+0000","last_clean":"2024-09-17T05:41:56.913963+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:41:56.913963+0000","last_undegraded":"2024-09-17T05:41:56.913963+0000","last_fullsized":"2024-09-17T05:41:56.913963+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_clean_scrub_stamp":"2024-09-17T05:41:56.913963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:41:56.913963+0000","last_change":"2024-09-17T05:41:56.913963+0000","last_active":"2024-09-17T05:41:56.913963+0000","last_peered":"2024-09-17T05:41:56.913963+0000","last_clean":"2024-09-17T05:41:56.913963+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:41:56.913963+0000","last_undegraded":"2024-09-17T05:41:56.913963+0000","last_fullsized":"2024-09-17T05:41:56.913963+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_clean_scrub_stamp":"2024-09-17T05:41:56.913963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:41:56.913963+0000","last_change":"2024-09-17T05:41:56.913963+0000","last_active":"2024-09-17T05:41:56.913963+0000","last_peered":"2024-09-17T05:41:56.913963+0000","last_clean":"2024-09-17T05:41:56.913963+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:41:56.913963+0000","last_undegraded":"2024-09-17T05:41:56.913963+0000","last_fullsized":"2024-09-17T05:41:56.913963+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_clean_scrub_stamp":"2024-09-17T05:41:56.913963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:41:56.913963+0000","last_change":"2024-09-17T05:41:56.913963+0000","last_active":"2024-09-17T05:41:56.913963+0000","last_peered":"2024-09-17T05:41:56.913963+0000","last_clean":"2024-09-17T05:41:56.913963+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:41:56.913963+0000","last_undegraded":"2024-09-17T05:41:56.913963+0000","last_fullsized":"2024-09-17T05:41:56.913963+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_clean_scrub_stamp":"2024-09-17T05:41:56.913963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:41:56.913963+0000","last_change":"2024-09-17T05:41:56.913963+0000","last_active":"2024-09-17T05:41:56.913963+0000","last_peered":"2024-09-17T05:41:56.913963+0000","last_clean":"2024-09-17T05:41:56.913963+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:41:56.913963+0000","last_undegraded":"2024-09-17T05:41:56.913963+0000","last_fullsized":"2024-09-17T05:41:56.913963+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_clean_scrub_stamp":"2024-09-17T05:41:56.913963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:41:56.913963+0000","last_change":"2024-09-17T05:41:56.913963+0000","last_active":"2024-09-17T05:41:56.913963+0000","last_peered":"2024-09-17T05:41:56.913963+0000","last_clean":"2024-09-17T05:41:56.913963+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:41:56.913963+0000","last_undegraded":"2024-09-17T05:41:56.913963+0000","last_fullsized":"2024-09-17T05:41:56.913963+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_clean_scrub_stamp":"2024-09-17T05:41:56.913963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-17T05:41:56.938399+0000","last_change":"2024-09-17T05:41:56.938399+0000","last_active":"2024-09-17T05:41:56.913963+0000","last_peered":"2024-09-17T05:41:56.913963+0000","last_clean":"2024-09-17T05:41:56.913963+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:41:56.938399+0000","last_undegraded":"2024-09-17T05:41:56.938399+0000","last_fullsized":"2024-09-17T05:41:56.938399+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_clean_scrub_stamp":"2024-09-17T05:41:56.913963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-17T05:41:56.935343+0000","last_change":"2024-09-17T05:41:56.935343+0000","last_active":"2024-09-17T05:41:56.913963+0000","last_peered":"2024-09-17T05:41:56.913963+0000","last_clean":"2024-09-17T05:41:56.913963+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:41:56.935343+0000","last_undegraded":"2024-09-17T05:41:56.935343+0000","last_fullsized":"2024-09-17T05:41:56.935343+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_clean_scrub_stamp":"2024-09-17T05:41:56.913963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:41:56.913963+0000","last_change":"2024-09-17T05:41:56.913963+0000","last_active":"2024-09-17T05:41:56.913963+0000","last_peered":"2024-09-17T05:41:56.913963+0000","last_clean":"2024-09-17T05:41:56.913963+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:41:56.913963+0000","last_undegraded":"2024-09-17T05:41:56.913963+0000","last_fullsized":"2024-09-17T05:41:56.913963+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_clean_scrub_stamp":"2024-09-17T05:41:56.913963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:41:56.913963+0000","last_change":"2024-09-17T05:41:56.913963+0000","last_active":"2024-09-17T05:41:56.913963+0000","last_peered":"2024-09-17T05:41:56.913963+0000","last_clean":"2024-09-17T05:41:56.913963+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:41:56.913963+0000","last_undegraded":"2024-09-17T05:41:56.913963+0000","last_fullsized":"2024-09-17T05:41:56.913963+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_clean_scrub_stamp":"2024-09-17T05:41:56.913963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T05:41:57.958581+0000","last_change":"2024-09-17T05:41:57.950142+0000","last_active":"2024-09-17T05:41:57.958581+0000","last_peered":"2024-09-17T05:41:57.958581+0000","last_clean":"2024-09-17T05:41:57.958581+0000","last_became_active":"2024-09-17T05:41:57.949825+0000","last_became_peered":"2024-09-17T05:41:57.949825+0000","last_unstale":"2024-09-17T05:41:57.958581+0000","last_undegraded":"2024-09-17T05:41:57.958581+0000","last_fullsized":"2024-09-17T05:41:57.958581+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_clean_scrub_stamp":"2024-09-17T05:41:56.913963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:03:45.612206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:41:56.913963+0000","last_change":"2024-09-17T05:41:56.913963+0000","last_active":"2024-09-17T05:41:56.913963+0000","last_peered":"2024-09-17T05:41:56.913963+0000","last_clean":"2024-09-17T05:41:56.913963+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:41:56.913963+0000","last_undegraded":"2024-09-17T05:41:56.913963+0000","last_fullsized":"2024-09-17T05:41:56.913963+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_clean_scrub_stamp":"2024-09-17T05:41:56.913963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:41:56.913963+0000","last_change":"2024-09-17T05:41:56.913963+0000","last_active":"2024-09-17T05:41:56.913963+0000","last_peered":"2024-09-17T05:41:56.913963+0000","last_clean":"2024-09-17T05:41:56.913963+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:41:56.913963+0000","last_undegraded":"2024-09-17T05:41:56.913963+0000","last_fullsized":"2024-09-17T05:41:56.913963+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_clean_scrub_stamp":"2024-09-17T05:41:56.913963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:41:56.913963+0000","last_change":"2024-09-17T05:41:56.913963+0000","last_active":"2024-09-17T05:41:56.913963+0000","last_peered":"2024-09-17T05:41:56.913963+0000","last_clean":"2024-09-17T05:41:56.913963+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:41:56.913963+0000","last_undegraded":"2024-09-17T05:41:56.913963+0000","last_fullsized":"2024-09-17T05:41:56.913963+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_clean_scrub_stamp":"2024-09-17T05:41:56.913963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:41:56.913963+0000","last_change":"2024-09-17T05:41:56.913963+0000","last_active":"2024-09-17T05:41:56.913963+0000","last_peered":"2024-09-17T05:41:56.913963+0000","last_clean":"2024-09-17T05:41:56.913963+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:41:56.913963+0000","last_undegraded":"2024-09-17T05:41:56.913963+0000","last_fullsized":"2024-09-17T05:41:56.913963+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_clean_scrub_stamp":"2024-09-17T05:41:56.913963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:41:56.913963+0000","last_change":"2024-09-17T05:41:56.913963+0000","last_active":"2024-09-17T05:41:56.913963+0000","last_peered":"2024-09-17T05:41:56.913963+0000","last_clean":"2024-09-17T05:41:56.913963+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:41:56.913963+0000","last_undegraded":"2024-09-17T05:41:56.913963+0000","last_fullsized":"2024-09-17T05:41:56.913963+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_clean_scrub_stamp":"2024-09-17T05:41:56.913963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-17T05:41:56.933458+0000","last_change":"2024-09-17T05:41:56.933458+0000","last_active":"2024-09-17T05:41:56.913963+0000","last_peered":"2024-09-17T05:41:56.913963+0000","last_clean":"2024-09-17T05:41:56.913963+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:41:56.933458+0000","last_undegraded":"2024-09-17T05:41:56.933458+0000","last_fullsized":"2024-09-17T05:41:56.933458+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_clean_scrub_stamp":"2024-09-17T05:41:56.913963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T05:41:57.960003+0000","last_change":"2024-09-17T05:41:57.952830+0000","last_active":"2024-09-17T05:41:57.960003+0000","last_peered":"2024-09-17T05:41:57.960003+0000","last_clean":"2024-09-17T05:41:57.960003+0000","last_became_active":"2024-09-17T05:41:57.952504+0000","last_became_peered":"2024-09-17T05:41:57.952504+0000","last_unstale":"2024-09-17T05:41:57.960003+0000","last_undegraded":"2024-09-17T05:41:57.960003+0000","last_fullsized":"2024-09-17T05:41:57.960003+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_clean_scrub_stamp":"2024-09-17T05:41:56.913963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:54:59.834514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:41:56.913963+0000","last_change":"2024-09-17T05:41:56.913963+0000","last_active":"2024-09-17T05:41:56.913963+0000","last_peered":"2024-09-17T05:41:56.913963+0000","last_clean":"2024-09-17T05:41:56.913963+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:41:56.913963+0000","last_undegraded":"2024-09-17T05:41:56.913963+0000","last_fullsized":"2024-09-17T05:41:56.913963+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_clean_scrub_stamp":"2024-09-17T05:41:56.913963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:41:56.913963+0000","last_change":"2024-09-17T05:41:56.913963+0000","last_active":"2024-09-17T05:41:56.913963+0000","last_peered":"2024-09-17T05:41:56.913963+0000","last_clean":"2024-09-17T05:41:56.913963+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:41:56.913963+0000","last_undegraded":"2024-09-17T05:41:56.913963+0000","last_fullsized":"2024-09-17T05:41:56.913963+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_clean_scrub_stamp":"2024-09-17T05:41:56.913963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:41:56.913963+0000","last_change":"2024-09-17T05:41:56.913963+0000","last_active":"2024-09-17T05:41:56.913963+0000","last_peered":"2024-09-17T05:41:56.913963+0000","last_clean":"2024-09-17T05:41:56.913963+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:41:56.913963+0000","last_undegraded":"2024-09-17T05:41:56.913963+0000","last_fullsized":"2024-09-17T05:41:56.913963+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_clean_scrub_stamp":"2024-09-17T05:41:56.913963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:41:56.913963+0000","last_change":"2024-09-17T05:41:56.913963+0000","last_active":"2024-09-17T05:41:56.913963+0000","last_peered":"2024-09-17T05:41:56.913963+0000","last_clean":"2024-09-17T05:41:56.913963+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:41:56.913963+0000","last_undegraded":"2024-09-17T05:41:56.913963+0000","last_fullsized":"2024-09-17T05:41:56.913963+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_clean_scrub_stamp":"2024-09-17T05:41:56.913963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-17T05:41:56.936595+0000","last_change":"2024-09-17T05:41:56.936595+0000","last_active":"2024-09-17T05:41:56.913963+0000","last_peered":"2024-09-17T05:41:56.913963+0000","last_clean":"2024-09-17T05:41:56.913963+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:41:56.936595+0000","last_undegraded":"2024-09-17T05:41:56.936595+0000","last_fullsized":"2024-09-17T05:41:56.936595+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_clean_scrub_stamp":"2024-09-17T05:41:56.913963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:41:56.913963+0000","last_change":"2024-09-17T05:41:56.913963+0000","last_active":"2024-09-17T05:41:56.913963+0000","last_peered":"2024-09-17T05:41:56.913963+0000","last_clean":"2024-09-17T05:41:56.913963+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:41:56.913963+0000","last_undegraded":"2024-09-17T05:41:56.913963+0000","last_fullsized":"2024-09-17T05:41:56.913963+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_clean_scrub_stamp":"2024-09-17T05:41:56.913963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:41:56.913963+0000","last_change":"2024-09-17T05:41:56.913963+0000","last_active":"2024-09-17T05:41:56.913963+0000","last_peered":"2024-09-17T05:41:56.913963+0000","last_clean":"2024-09-17T05:41:56.913963+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:41:56.913963+0000","last_undegraded":"2024-09-17T05:41:56.913963+0000","last_fullsized":"2024-09-17T05:41:56.913963+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_clean_scrub_stamp":"2024-09-17T05:41:56.913963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T05:41:57.958478+0000","last_change":"2024-09-17T05:41:57.948114+0000","last_active":"2024-09-17T05:41:57.958478+0000","last_peered":"2024-09-17T05:41:57.958478+0000","last_clean":"2024-09-17T05:41:57.958478+0000","last_became_active":"2024-09-17T05:41:57.947671+0000","last_became_peered":"2024-09-17T05:41:57.947671+0000","last_unstale":"2024-09-17T05:41:57.958478+0000","last_undegraded":"2024-09-17T05:41:57.958478+0000","last_fullsized":"2024-09-17T05:41:57.958478+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_clean_scrub_stamp":"2024-09-17T05:41:56.913963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:04:06.812125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:41:56.913963+0000","last_change":"2024-09-17T05:41:56.913963+0000","last_active":"2024-09-17T05:41:56.913963+0000","last_peered":"2024-09-17T05:41:56.913963+0000","last_clean":"2024-09-17T05:41:56.913963+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:41:56.913963+0000","last_undegraded":"2024-09-17T05:41:56.913963+0000","last_fullsized":"2024-09-17T05:41:56.913963+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_clean_scrub_stamp":"2024-09-17T05:41:56.913963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:41:56.913963+0000","last_change":"2024-09-17T05:41:56.913963+0000","last_active":"2024-09-17T05:41:56.913963+0000","last_peered":"2024-09-17T05:41:56.913963+0000","last_clean":"2024-09-17T05:41:56.913963+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:41:56.913963+0000","last_undegraded":"2024-09-17T05:41:56.913963+0000","last_fullsized":"2024-09-17T05:41:56.913963+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_clean_scrub_stamp":"2024-09-17T05:41:56.913963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-17T05:41:56.933616+0000","last_change":"2024-09-17T05:41:56.933616+0000","last_active":"2024-09-17T05:41:56.913963+0000","last_peered":"2024-09-17T05:41:56.913963+0000","last_clean":"2024-09-17T05:41:56.913963+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:41:56.933616+0000","last_undegraded":"2024-09-17T05:41:56.933616+0000","last_fullsized":"2024-09-17T05:41:56.933616+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_clean_scrub_stamp":"2024-09-17T05:41:56.913963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:41:56.913963+0000","last_change":"2024-09-17T05:41:56.913963+0000","last_active":"2024-09-17T05:41:56.913963+0000","last_peered":"2024-09-17T05:41:56.913963+0000","last_clean":"2024-09-17T05:41:56.913963+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:41:56.913963+0000","last_undegraded":"2024-09-17T05:41:56.913963+0000","last_fullsized":"2024-09-17T05:41:56.913963+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_clean_scrub_stamp":"2024-09-17T05:41:56.913963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1b","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-09-17T05:41:55.922157+0000","last_change":"2024-09-17T05:41:55.922157+0000","last_active":"2024-09-17T05:41:55.904533+0000","last_peered":"2024-09-17T05:41:55.904533+0000","last_clean":"2024-09-17T05:41:55.904533+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:41:55.922157+0000","last_undegraded":"2024-09-17T05:41:55.922157+0000","last_fullsized":"2024-09-17T05:41:55.922157+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:55.904533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:55.904533+0000","last_clean_scrub_stamp":"2024-09-17T05:41:55.904533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T05:41:57.947971+0000","last_change":"2024-09-17T05:41:57.943603+0000","last_active":"2024-09-17T05:41:57.947971+0000","last_peered":"2024-09-17T05:41:57.947971+0000","last_clean":"2024-09-17T05:41:57.947971+0000","last_became_active":"2024-09-17T05:41:57.942873+0000","last_became_peered":"2024-09-17T05:41:57.942873+0000","last_unstale":"2024-09-17T05:41:57.947971+0000","last_undegraded":"2024-09-17T05:41:57.947971+0000","last_fullsized":"2024-09-17T05:41:57.947971+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_clean_scrub_stamp":"2024-09-17T05:41:56.913963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:05:08.948164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:41:56.945810+0000","last_change":"2024-09-17T05:41:56.940706+0000","last_active":"2024-09-17T05:41:56.945810+0000","last_peered":"2024-09-17T05:41:56.945810+0000","last_clean":"2024-09-17T05:41:56.945810+0000","last_became_active":"2024-09-17T05:41:56.940324+0000","last_became_peered":"2024-09-17T05:41:56.940324+0000","last_unstale":"2024-09-17T05:41:56.945810+0000","last_undegraded":"2024-09-17T05:41:56.945810+0000","last_fullsized":"2024-09-17T05:41:56.945810+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:55.904533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:55.904533+0000","last_clean_scrub_stamp":"2024-09-17T05:41:55.904533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:39:10.329477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-09-17T05:41:55.922588+0000","last_change":"2024-09-17T05:41:55.922588+0000","last_active":"2024-09-17T05:41:55.904533+0000","last_peered":"2024-09-17T05:41:55.904533+0000","last_clean":"2024-09-17T05:41:55.904533+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:41:55.922588+0000","last_undegraded":"2024-09-17T05:41:55.922588+0000","last_fullsized":"2024-09-17T05:41:55.922588+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:55.904533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:55.904533+0000","last_clean_scrub_stamp":"2024-09-17T05:41:55.904533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:41:56.913963+0000","last_change":"2024-09-17T05:41:56.913963+0000","last_active":"2024-09-17T05:41:56.913963+0000","last_peered":"2024-09-17T05:41:56.913963+0000","last_clean":"2024-09-17T05:41:56.913963+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:41:56.913963+0000","last_undegraded":"2024-09-17T05:41:56.913963+0000","last_fullsized":"2024-09-17T05:41:56.913963+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_clean_scrub_stamp":"2024-09-17T05:41:56.913963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-09-17T05:41:55.922741+0000","last_change":"2024-09-17T05:41:55.922741+0000","last_active":"2024-09-17T05:41:55.904533+0000","last_peered":"2024-09-17T05:41:55.904533+0000","last_clean":"2024-09-17T05:41:55.904533+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:41:55.922741+0000","last_undegraded":"2024-09-17T05:41:55.922741+0000","last_fullsized":"2024-09-17T05:41:55.922741+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:55.904533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:55.904533+0000","last_clean_scrub_stamp":"2024-09-17T05:41:55.904533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:41:56.913963+0000","last_change":"2024-09-17T05:41:56.913963+0000","last_active":"2024-09-17T05:41:56.913963+0000","last_peered":"2024-09-17T05:41:56.913963+0000","last_clean":"2024-09-17T05:41:56.913963+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:41:56.913963+0000","last_undegraded":"2024-09-17T05:41:56.913963+0000","last_fullsized":"2024-09-17T05:41:56.913963+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_clean_scrub_stamp":"2024-09-17T05:41:56.913963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:41:56.954501+0000","last_change":"2024-09-17T05:41:56.949682+0000","last_active":"2024-09-17T05:41:56.954501+0000","last_peered":"2024-09-17T05:41:56.954501+0000","last_clean":"2024-09-17T05:41:56.954501+0000","last_became_active":"2024-09-17T05:41:56.949271+0000","last_became_peered":"2024-09-17T05:41:56.949271+0000","last_unstale":"2024-09-17T05:41:56.954501+0000","last_undegraded":"2024-09-17T05:41:56.954501+0000","last_fullsized":"2024-09-17T05:41:56.954501+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:55.904533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:55.904533+0000","last_clean_scrub_stamp":"2024-09-17T05:41:55.904533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:09:34.572426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:41:56.913963+0000","last_change":"2024-09-17T05:41:56.913963+0000","last_active":"2024-09-17T05:41:56.913963+0000","last_peered":"2024-09-17T05:41:56.913963+0000","last_clean":"2024-09-17T05:41:56.913963+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:41:56.913963+0000","last_undegraded":"2024-09-17T05:41:56.913963+0000","last_fullsized":"2024-09-17T05:41:56.913963+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_clean_scrub_stamp":"2024-09-17T05:41:56.913963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-09-17T05:41:55.924578+0000","last_change":"2024-09-17T05:41:55.924578+0000","last_active":"2024-09-17T05:41:55.904533+0000","last_peered":"2024-09-17T05:41:55.904533+0000","last_clean":"2024-09-17T05:41:55.904533+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:41:55.924578+0000","last_undegraded":"2024-09-17T05:41:55.924578+0000","last_fullsized":"2024-09-17T05:41:55.924578+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:55.904533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:55.904533+0000","last_clean_scrub_stamp":"2024-09-17T05:41:55.904533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T05:41:57.958506+0000","last_change":"2024-09-17T05:41:57.948150+0000","last_active":"2024-09-17T05:41:57.958506+0000","last_peered":"2024-09-17T05:41:57.958506+0000","last_clean":"2024-09-17T05:41:57.958506+0000","last_became_active":"2024-09-17T05:41:57.947204+0000","last_became_peered":"2024-09-17T05:41:57.947204+0000","last_unstale":"2024-09-17T05:41:57.958506+0000","last_undegraded":"2024-09-17T05:41:57.958506+0000","last_fullsized":"2024-09-17T05:41:57.958506+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_clean_scrub_stamp":"2024-09-17T05:41:56.913963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:06:52.563709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-09-17T05:41:55.919928+0000","last_change":"2024-09-17T05:41:55.919928+0000","last_active":"2024-09-17T05:41:55.904533+0000","last_peered":"2024-09-17T05:41:55.904533+0000","last_clean":"2024-09-17T05:41:55.904533+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:41:55.919928+0000","last_undegraded":"2024-09-17T05:41:55.919928+0000","last_fullsized":"2024-09-17T05:41:55.919928+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:55.904533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:55.904533+0000","last_clean_scrub_stamp":"2024-09-17T05:41:55.904533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:41:56.913963+0000","last_change":"2024-09-17T05:41:56.913963+0000","last_active":"2024-09-17T05:41:56.913963+0000","last_peered":"2024-09-17T05:41:56.913963+0000","last_clean":"2024-09-17T05:41:56.913963+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:41:56.913963+0000","last_undegraded":"2024-09-17T05:41:56.913963+0000","last_fullsized":"2024-09-17T05:41:56.913963+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_clean_scrub_stamp":"2024-09-17T05:41:56.913963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.14","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:41:56.954521+0000","last_change":"2024-09-17T05:41:56.951074+0000","last_active":"2024-09-17T05:41:56.954521+0000","last_peered":"2024-09-17T05:41:56.954521+0000","last_clean":"2024-09-17T05:41:56.954521+0000","last_became_active":"2024-09-17T05:41:56.950549+0000","last_became_peered":"2024-09-17T05:41:56.950549+0000","last_unstale":"2024-09-17T05:41:56.954521+0000","last_undegraded":"2024-09-17T05:41:56.954521+0000","last_fullsized":"2024-09-17T05:41:56.954521+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:55.904533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:55.904533+0000","last_clean_scrub_stamp":"2024-09-17T05:41:55.904533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:21:08.994692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:41:56.913963+0000","last_change":"2024-09-17T05:41:56.913963+0000","last_active":"2024-09-17T05:41:56.913963+0000","last_peered":"2024-09-17T05:41:56.913963+0000","last_clean":"2024-09-17T05:41:56.913963+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:41:56.913963+0000","last_undegraded":"2024-09-17T05:41:56.913963+0000","last_fullsized":"2024-09-17T05:41:56.913963+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_clean_scrub_stamp":"2024-09-17T05:41:56.913963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.13","version":"22'2","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T05:41:57.963820+0000","last_change":"2024-09-17T05:41:56.939288+0000","last_active":"2024-09-17T05:41:57.963820+0000","last_peered":"2024-09-17T05:41:57.963820+0000","last_clean":"2024-09-17T05:41:57.963820+0000","last_became_active":"2024-09-17T05:41:56.938951+0000","last_became_peered":"2024-09-17T05:41:56.938951+0000","last_unstale":"2024-09-17T05:41:57.963820+0000","last_undegraded":"2024-09-17T05:41:57.963820+0000","last_fullsized":"2024-09-17T05:41:57.963820+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:55.904533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:55.904533+0000","last_clean_scrub_stamp":"2024-09-17T05:41:55.904533+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:41:47.665206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T05:41:57.960149+0000","last_change":"2024-09-17T05:41:57.953556+0000","last_active":"2024-09-17T05:41:57.960149+0000","last_peered":"2024-09-17T05:41:57.960149+0000","last_clean":"2024-09-17T05:41:57.960149+0000","last_became_active":"2024-09-17T05:41:57.953229+0000","last_became_peered":"2024-09-17T05:41:57.953229+0000","last_unstale":"2024-09-17T05:41:57.960149+0000","last_undegraded":"2024-09-17T05:41:57.960149+0000","last_fullsized":"2024-09-17T05:41:57.960149+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_clean_scrub_stamp":"2024-09-17T05:41:56.913963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:31:05.269290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-09-17T05:41:55.925889+0000","last_change":"2024-09-17T05:41:55.925889+0000","last_active":"2024-09-17T05:41:55.904533+0000","last_peered":"2024-09-17T05:41:55.904533+0000","last_clean":"2024-09-17T05:41:55.904533+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:41:55.925889+0000","last_undegraded":"2024-09-17T05:41:55.925889+0000","last_fullsized":"2024-09-17T05:41:55.925889+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:55.904533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:55.904533+0000","last_clean_scrub_stamp":"2024-09-17T05:41:55.904533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:41:56.913963+0000","last_change":"2024-09-17T05:41:56.913963+0000","last_active":"2024-09-17T05:41:56.913963+0000","last_peered":"2024-09-17T05:41:56.913963+0000","last_clean":"2024-09-17T05:41:56.913963+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:41:56.913963+0000","last_undegraded":"2024-09-17T05:41:56.913963+0000","last_fullsized":"2024-09-17T05:41:56.913963+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_clean_scrub_stamp":"2024-09-17T05:41:56.913963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:41:56.951770+0000","last_change":"2024-09-17T05:41:56.946833+0000","last_active":"2024-09-17T05:41:56.951770+0000","last_peered":"2024-09-17T05:41:56.951770+0000","last_clean":"2024-09-17T05:41:56.951770+0000","last_became_active":"2024-09-17T05:41:56.946545+0000","last_became_peered":"2024-09-17T05:41:56.946545+0000","last_unstale":"2024-09-17T05:41:56.951770+0000","last_undegraded":"2024-09-17T05:41:56.951770+0000","last_fullsized":"2024-09-17T05:41:56.951770+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:55.904533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:55.904533+0000","last_clean_scrub_stamp":"2024-09-17T05:41:55.904533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:08:59.697169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-17T05:41:56.932989+0000","last_change":"2024-09-17T05:41:56.932989+0000","last_active":"2024-09-17T05:41:56.913963+0000","last_peered":"2024-09-17T05:41:56.913963+0000","last_clean":"2024-09-17T05:41:56.913963+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:41:56.932989+0000","last_undegraded":"2024-09-17T05:41:56.932989+0000","last_fullsized":"2024-09-17T05:41:56.932989+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_clean_scrub_stamp":"2024-09-17T05:41:56.913963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-09-17T05:41:55.921502+0000","last_change":"2024-09-17T05:41:55.921502+0000","last_active":"2024-09-17T05:41:55.904533+0000","last_peered":"2024-09-17T05:41:55.904533+0000","last_clean":"2024-09-17T05:41:55.904533+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:41:55.921502+0000","last_undegraded":"2024-09-17T05:41:55.921502+0000","last_fullsized":"2024-09-17T05:41:55.921502+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:55.904533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:55.904533+0000","last_clean_scrub_stamp":"2024-09-17T05:41:55.904533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:41:56.913963+0000","last_change":"2024-09-17T05:41:56.913963+0000","last_active":"2024-09-17T05:41:56.913963+0000","last_peered":"2024-09-17T05:41:56.913963+0000","last_clean":"2024-09-17T05:41:56.913963+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:41:56.913963+0000","last_undegraded":"2024-09-17T05:41:56.913963+0000","last_fullsized":"2024-09-17T05:41:56.913963+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_clean_scrub_stamp":"2024-09-17T05:41:56.913963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.f","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-09-17T05:41:55.923232+0000","last_change":"2024-09-17T05:41:55.923232+0000","last_active":"2024-09-17T05:41:55.904533+0000","last_peered":"2024-09-17T05:41:55.904533+0000","last_clean":"2024-09-17T05:41:55.904533+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:41:55.923232+0000","last_undegraded":"2024-09-17T05:41:55.923232+0000","last_fullsized":"2024-09-17T05:41:55.923232+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:55.904533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:55.904533+0000","last_clean_scrub_stamp":"2024-09-17T05:41:55.904533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:41:56.913963+0000","last_change":"2024-09-17T05:41:56.913963+0000","last_active":"2024-09-17T05:41:56.913963+0000","last_peered":"2024-09-17T05:41:56.913963+0000","last_clean":"2024-09-17T05:41:56.913963+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:41:56.913963+0000","last_undegraded":"2024-09-17T05:41:56.913963+0000","last_fullsized":"2024-09-17T05:41:56.913963+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_clean_scrub_stamp":"2024-09-17T05:41:56.913963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.e","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-09-17T05:41:55.921184+0000","last_change":"2024-09-17T05:41:55.921184+0000","last_active":"2024-09-17T05:41:55.904533+0000","last_peered":"2024-09-17T05:41:55.904533+0000","last_clean":"2024-09-17T05:41:55.904533+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:41:55.921184+0000","last_undegraded":"2024-09-17T05:41:55.921184+0000","last_fullsized":"2024-09-17T05:41:55.921184+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:55.904533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:55.904533+0000","last_clean_scrub_stamp":"2024-09-17T05:41:55.904533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:41:56.913963+0000","last_change":"2024-09-17T05:41:56.913963+0000","last_active":"2024-09-17T05:41:56.913963+0000","last_peered":"2024-09-17T05:41:56.913963+0000","last_clean":"2024-09-17T05:41:56.913963+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:41:56.913963+0000","last_undegraded":"2024-09-17T05:41:56.913963+0000","last_fullsized":"2024-09-17T05:41:56.913963+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_clean_scrub_stamp":"2024-09-17T05:41:56.913963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.d","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-09-17T05:41:55.918638+0000","last_change":"2024-09-17T05:41:55.918638+0000","last_active":"2024-09-17T05:41:55.904533+0000","last_peered":"2024-09-17T05:41:55.904533+0000","last_clean":"2024-09-17T05:41:55.904533+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:41:55.918638+0000","last_undegraded":"2024-09-17T05:41:55.918638+0000","last_fullsized":"2024-09-17T05:41:55.918638+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:55.904533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:55.904533+0000","last_clean_scrub_stamp":"2024-09-17T05:41:55.904533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:41:56.913963+0000","last_change":"2024-09-17T05:41:56.913963+0000","last_active":"2024-09-17T05:41:56.913963+0000","last_peered":"2024-09-17T05:41:56.913963+0000","last_clean":"2024-09-17T05:41:56.913963+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:41:56.913963+0000","last_undegraded":"2024-09-17T05:41:56.913963+0000","last_fullsized":"2024-09-17T05:41:56.913963+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_clean_scrub_stamp":"2024-09-17T05:41:56.913963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-09-17T05:41:55.922017+0000","last_change":"2024-09-17T05:41:55.922017+0000","last_active":"2024-09-17T05:41:55.904533+0000","last_peered":"2024-09-17T05:41:55.904533+0000","last_clean":"2024-09-17T05:41:55.904533+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:41:55.922017+0000","last_undegraded":"2024-09-17T05:41:55.922017+0000","last_fullsized":"2024-09-17T05:41:55.922017+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:55.904533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:55.904533+0000","last_clean_scrub_stamp":"2024-09-17T05:41:55.904533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:41:56.913963+0000","last_change":"2024-09-17T05:41:56.913963+0000","last_active":"2024-09-17T05:41:56.913963+0000","last_peered":"2024-09-17T05:41:56.913963+0000","last_clean":"2024-09-17T05:41:56.913963+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:41:56.913963+0000","last_undegraded":"2024-09-17T05:41:56.913963+0000","last_fullsized":"2024-09-17T05:41:56.913963+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_clean_scrub_stamp":"2024-09-17T05:41:56.913963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"19'72","reported_seq":105,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T05:41:55.926749+0000","last_change":"2024-09-17T05:41:48.539830+0000","last_active":"2024-09-17T05:41:55.926749+0000","last_peered":"2024-09-17T05:41:55.926749+0000","last_clean":"2024-09-17T05:41:55.926749+0000","last_became_active":"2024-09-17T05:41:48.538743+0000","last_became_peered":"2024-09-17T05:41:48.538743+0000","last_unstale":"2024-09-17T05:41:55.926749+0000","last_undegraded":"2024-09-17T05:41:55.926749+0000","last_fullsized":"2024-09-17T05:41:55.926749+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:47.152539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:47.152539+0000","last_clean_scrub_stamp":"2024-09-17T05:41:47.152539+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:08:02.952016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-09-17T05:41:55.923951+0000","last_change":"2024-09-17T05:41:55.923951+0000","last_active":"2024-09-17T05:41:55.904533+0000","last_peered":"2024-09-17T05:41:55.904533+0000","last_clean":"2024-09-17T05:41:55.904533+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:41:55.923951+0000","last_undegraded":"2024-09-17T05:41:55.923951+0000","last_fullsized":"2024-09-17T05:41:55.923951+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:55.904533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:55.904533+0000","last_clean_scrub_stamp":"2024-09-17T05:41:55.904533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:41:56.913963+0000","last_change":"2024-09-17T05:41:56.913963+0000","last_active":"2024-09-17T05:41:56.913963+0000","last_peered":"2024-09-17T05:41:56.913963+0000","last_clean":"2024-09-17T05:41:56.913963+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:41:56.913963+0000","last_undegraded":"2024-09-17T05:41:56.913963+0000","last_fullsized":"2024-09-17T05:41:56.913963+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_clean_scrub_stamp":"2024-09-17T05:41:56.913963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-09-17T05:41:55.925470+0000","last_change":"2024-09-17T05:41:55.925470+0000","last_active":"2024-09-17T05:41:55.904533+0000","last_peered":"2024-09-17T05:41:55.904533+0000","last_clean":"2024-09-17T05:41:55.904533+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:41:55.925470+0000","last_undegraded":"2024-09-17T05:41:55.925470+0000","last_fullsized":"2024-09-17T05:41:55.925470+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:55.904533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:55.904533+0000","last_clean_scrub_stamp":"2024-09-17T05:41:55.904533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T05:41:57.947280+0000","last_change":"2024-09-17T05:41:57.943470+0000","last_active":"2024-09-17T05:41:57.947280+0000","last_peered":"2024-09-17T05:41:57.947280+0000","last_clean":"2024-09-17T05:41:57.947280+0000","last_became_active":"2024-09-17T05:41:57.943015+0000","last_became_peered":"2024-09-17T05:41:57.943015+0000","last_unstale":"2024-09-17T05:41:57.947280+0000","last_undegraded":"2024-09-17T05:41:57.947280+0000","last_fullsized":"2024-09-17T05:41:57.947280+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_clean_scrub_stamp":"2024-09-17T05:41:56.913963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:54:20.645536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-09-17T05:41:55.921169+0000","last_change":"2024-09-17T05:41:55.921169+0000","last_active":"2024-09-17T05:41:55.904533+0000","last_peered":"2024-09-17T05:41:55.904533+0000","last_clean":"2024-09-17T05:41:55.904533+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:41:55.921169+0000","last_undegraded":"2024-09-17T05:41:55.921169+0000","last_fullsized":"2024-09-17T05:41:55.921169+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:55.904533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:55.904533+0000","last_clean_scrub_stamp":"2024-09-17T05:41:55.904533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:41:56.913963+0000","last_change":"2024-09-17T05:41:56.913963+0000","last_active":"2024-09-17T05:41:56.913963+0000","last_peered":"2024-09-17T05:41:56.913963+0000","last_clean":"2024-09-17T05:41:56.913963+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:41:56.913963+0000","last_undegraded":"2024-09-17T05:41:56.913963+0000","last_fullsized":"2024-09-17T05:41:56.913963+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_clean_scrub_stamp":"2024-09-17T05:41:56.913963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-09-17T05:41:55.924760+0000","last_change":"2024-09-17T05:41:55.924760+0000","last_active":"2024-09-17T05:41:55.904533+0000","last_peered":"2024-09-17T05:41:55.904533+0000","last_clean":"2024-09-17T05:41:55.904533+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:41:55.924760+0000","last_undegraded":"2024-09-17T05:41:55.924760+0000","last_fullsized":"2024-09-17T05:41:55.924760+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:55.904533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:55.904533+0000","last_clean_scrub_stamp":"2024-09-17T05:41:55.904533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:41:56.913963+0000","last_change":"2024-09-17T05:41:56.913963+0000","last_active":"2024-09-17T05:41:56.913963+0000","last_peered":"2024-09-17T05:41:56.913963+0000","last_clean":"2024-09-17T05:41:56.913963+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:41:56.913963+0000","last_undegraded":"2024-09-17T05:41:56.913963+0000","last_fullsized":"2024-09-17T05:41:56.913963+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_clean_scrub_stamp":"2024-09-17T05:41:56.913963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-09-17T05:41:55.918640+0000","last_change":"2024-09-17T05:41:55.918640+0000","last_active":"2024-09-17T05:41:55.904533+0000","last_peered":"2024-09-17T05:41:55.904533+0000","last_clean":"2024-09-17T05:41:55.904533+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:41:55.918640+0000","last_undegraded":"2024-09-17T05:41:55.918640+0000","last_fullsized":"2024-09-17T05:41:55.918640+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:55.904533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:55.904533+0000","last_clean_scrub_stamp":"2024-09-17T05:41:55.904533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:41:56.913963+0000","last_change":"2024-09-17T05:41:56.913963+0000","last_active":"2024-09-17T05:41:56.913963+0000","last_peered":"2024-09-17T05:41:56.913963+0000","last_clean":"2024-09-17T05:41:56.913963+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:41:56.913963+0000","last_undegraded":"2024-09-17T05:41:56.913963+0000","last_fullsized":"2024-09-17T05:41:56.913963+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_clean_scrub_stamp":"2024-09-17T05:41:56.913963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-09-17T05:41:55.923012+0000","last_change":"2024-09-17T05:41:55.923012+0000","last_active":"2024-09-17T05:41:55.904533+0000","last_peered":"2024-09-17T05:41:55.904533+0000","last_clean":"2024-09-17T05:41:55.904533+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:41:55.923012+0000","last_undegraded":"2024-09-17T05:41:55.923012+0000","last_fullsized":"2024-09-17T05:41:55.923012+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:55.904533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:55.904533+0000","last_clean_scrub_stamp":"2024-09-17T05:41:55.904533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:41:56.913963+0000","last_change":"2024-09-17T05:41:56.913963+0000","last_active":"2024-09-17T05:41:56.913963+0000","last_peered":"2024-09-17T05:41:56.913963+0000","last_clean":"2024-09-17T05:41:56.913963+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:41:56.913963+0000","last_undegraded":"2024-09-17T05:41:56.913963+0000","last_fullsized":"2024-09-17T05:41:56.913963+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_clean_scrub_stamp":"2024-09-17T05:41:56.913963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-09-17T05:41:55.918651+0000","last_change":"2024-09-17T05:41:55.918651+0000","last_active":"2024-09-17T05:41:55.904533+0000","last_peered":"2024-09-17T05:41:55.904533+0000","last_clean":"2024-09-17T05:41:55.904533+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:41:55.918651+0000","last_undegraded":"2024-09-17T05:41:55.918651+0000","last_fullsized":"2024-09-17T05:41:55.918651+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:55.904533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:55.904533+0000","last_clean_scrub_stamp":"2024-09-17T05:41:55.904533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:41:56.913963+0000","last_change":"2024-09-17T05:41:56.913963+0000","last_active":"2024-09-17T05:41:56.913963+0000","last_peered":"2024-09-17T05:41:56.913963+0000","last_clean":"2024-09-17T05:41:56.913963+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:41:56.913963+0000","last_undegraded":"2024-09-17T05:41:56.913963+0000","last_fullsized":"2024-09-17T05:41:56.913963+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_clean_scrub_stamp":"2024-09-17T05:41:56.913963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:41:56.951831+0000","last_change":"2024-09-17T05:41:56.947816+0000","last_active":"2024-09-17T05:41:56.951831+0000","last_peered":"2024-09-17T05:41:56.951831+0000","last_clean":"2024-09-17T05:41:56.951831+0000","last_became_active":"2024-09-17T05:41:56.947483+0000","last_became_peered":"2024-09-17T05:41:56.947483+0000","last_unstale":"2024-09-17T05:41:56.951831+0000","last_undegraded":"2024-09-17T05:41:56.951831+0000","last_fullsized":"2024-09-17T05:41:56.951831+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:55.904533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:55.904533+0000","last_clean_scrub_stamp":"2024-09-17T05:41:55.904533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:10:33.368816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T05:41:57.958467+0000","last_change":"2024-09-17T05:41:57.950209+0000","last_active":"2024-09-17T05:41:57.958467+0000","last_peered":"2024-09-17T05:41:57.958467+0000","last_clean":"2024-09-17T05:41:57.958467+0000","last_became_active":"2024-09-17T05:41:57.949869+0000","last_became_peered":"2024-09-17T05:41:57.949869+0000","last_unstale":"2024-09-17T05:41:57.958467+0000","last_undegraded":"2024-09-17T05:41:57.958467+0000","last_fullsized":"2024-09-17T05:41:57.958467+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_clean_scrub_stamp":"2024-09-17T05:41:56.913963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:57:20.773447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-09-17T05:41:55.926244+0000","last_change":"2024-09-17T05:41:55.926244+0000","last_active":"2024-09-17T05:41:55.904533+0000","last_peered":"2024-09-17T05:41:55.904533+0000","last_clean":"2024-09-17T05:41:55.904533+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:41:55.926244+0000","last_undegraded":"2024-09-17T05:41:55.926244+0000","last_fullsized":"2024-09-17T05:41:55.926244+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:55.904533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:55.904533+0000","last_clean_scrub_stamp":"2024-09-17T05:41:55.904533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:41:56.913963+0000","last_change":"2024-09-17T05:41:56.913963+0000","last_active":"2024-09-17T05:41:56.913963+0000","last_peered":"2024-09-17T05:41:56.913963+0000","last_clean":"2024-09-17T05:41:56.913963+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:41:56.913963+0000","last_undegraded":"2024-09-17T05:41:56.913963+0000","last_fullsized":"2024-09-17T05:41:56.913963+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_clean_scrub_stamp":"2024-09-17T05:41:56.913963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-09-17T05:41:55.918653+0000","last_change":"2024-09-17T05:41:55.918653+0000","last_active":"2024-09-17T05:41:55.904533+0000","last_peered":"2024-09-17T05:41:55.904533+0000","last_clean":"2024-09-17T05:41:55.904533+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:41:55.918653+0000","last_undegraded":"2024-09-17T05:41:55.918653+0000","last_fullsized":"2024-09-17T05:41:55.918653+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:55.904533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:55.904533+0000","last_clean_scrub_stamp":"2024-09-17T05:41:55.904533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:41:56.913963+0000","last_change":"2024-09-17T05:41:56.913963+0000","last_active":"2024-09-17T05:41:56.913963+0000","last_peered":"2024-09-17T05:41:56.913963+0000","last_clean":"2024-09-17T05:41:56.913963+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:41:56.913963+0000","last_undegraded":"2024-09-17T05:41:56.913963+0000","last_fullsized":"2024-09-17T05:41:56.913963+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_clean_scrub_stamp":"2024-09-17T05:41:56.913963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-09-17T05:41:55.918638+0000","last_change":"2024-09-17T05:41:55.918638+0000","last_active":"2024-09-17T05:41:55.904533+0000","last_peered":"2024-09-17T05:41:55.904533+0000","last_clean":"2024-09-17T05:41:55.904533+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:41:55.918638+0000","last_undegraded":"2024-09-17T05:41:55.918638+0000","last_fullsized":"2024-09-17T05:41:55.918638+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:55.904533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:55.904533+0000","last_clean_scrub_stamp":"2024-09-17T05:41:55.904533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:41:56.913963+0000","last_change":"2024-09-17T05:41:56.913963+0000","last_active":"2024-09-17T05:41:56.913963+0000","last_peered":"2024-09-17T05:41:56.913963+0000","last_clean":"2024-09-17T05:41:56.913963+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:41:56.913963+0000","last_undegraded":"2024-09-17T05:41:56.913963+0000","last_fullsized":"2024-09-17T05:41:56.913963+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_clean_scrub_stamp":"2024-09-17T05:41:56.913963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.b","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-09-17T05:41:55.922289+0000","last_change":"2024-09-17T05:41:55.922289+0000","last_active":"2024-09-17T05:41:55.904533+0000","last_peered":"2024-09-17T05:41:55.904533+0000","last_clean":"2024-09-17T05:41:55.904533+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:41:55.922289+0000","last_undegraded":"2024-09-17T05:41:55.922289+0000","last_fullsized":"2024-09-17T05:41:55.922289+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:55.904533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:55.904533+0000","last_clean_scrub_stamp":"2024-09-17T05:41:55.904533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-17T05:41:56.934139+0000","last_change":"2024-09-17T05:41:56.934139+0000","last_active":"2024-09-17T05:41:56.913963+0000","last_peered":"2024-09-17T05:41:56.913963+0000","last_clean":"2024-09-17T05:41:56.913963+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:41:56.934139+0000","last_undegraded":"2024-09-17T05:41:56.934139+0000","last_fullsized":"2024-09-17T05:41:56.934139+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_clean_scrub_stamp":"2024-09-17T05:41:56.913963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:41:56.913963+0000","last_change":"2024-09-17T05:41:56.913963+0000","last_active":"2024-09-17T05:41:56.913963+0000","last_peered":"2024-09-17T05:41:56.913963+0000","last_clean":"2024-09-17T05:41:56.913963+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:41:56.913963+0000","last_undegraded":"2024-09-17T05:41:56.913963+0000","last_fullsized":"2024-09-17T05:41:56.913963+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_clean_scrub_stamp":"2024-09-17T05:41:56.913963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1c","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-09-17T05:41:55.922276+0000","last_change":"2024-09-17T05:41:55.922276+0000","last_active":"2024-09-17T05:41:55.904533+0000","last_peered":"2024-09-17T05:41:55.904533+0000","last_clean":"2024-09-17T05:41:55.904533+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:41:55.922276+0000","last_undegraded":"2024-09-17T05:41:55.922276+0000","last_fullsized":"2024-09-17T05:41:55.922276+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:55.904533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:55.904533+0000","last_clean_scrub_stamp":"2024-09-17T05:41:55.904533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:41:56.913963+0000","last_change":"2024-09-17T05:41:56.913963+0000","last_active":"2024-09-17T05:41:56.913963+0000","last_peered":"2024-09-17T05:41:56.913963+0000","last_clean":"2024-09-17T05:41:56.913963+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:41:56.913963+0000","last_undegraded":"2024-09-17T05:41:56.913963+0000","last_fullsized":"2024-09-17T05:41:56.913963+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_clean_scrub_stamp":"2024-09-17T05:41:56.913963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1d","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-09-17T05:41:55.923615+0000","last_change":"2024-09-17T05:41:55.923615+0000","last_active":"2024-09-17T05:41:55.904533+0000","last_peered":"2024-09-17T05:41:55.904533+0000","last_clean":"2024-09-17T05:41:55.904533+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:41:55.923615+0000","last_undegraded":"2024-09-17T05:41:55.923615+0000","last_fullsized":"2024-09-17T05:41:55.923615+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:55.904533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:55.904533+0000","last_clean_scrub_stamp":"2024-09-17T05:41:55.904533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T05:41:57.958452+0000","last_change":"2024-09-17T05:41:57.947899+0000","last_active":"2024-09-17T05:41:57.958452+0000","last_peered":"2024-09-17T05:41:57.958452+0000","last_clean":"2024-09-17T05:41:57.958452+0000","last_became_active":"2024-09-17T05:41:57.947556+0000","last_became_peered":"2024-09-17T05:41:57.947556+0000","last_unstale":"2024-09-17T05:41:57.958452+0000","last_undegraded":"2024-09-17T05:41:57.958452+0000","last_fullsized":"2024-09-17T05:41:57.958452+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_clean_scrub_stamp":"2024-09-17T05:41:56.913963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:19:11.730293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-09-17T05:41:55.921410+0000","last_change":"2024-09-17T05:41:55.921410+0000","last_active":"2024-09-17T05:41:55.904533+0000","last_peered":"2024-09-17T05:41:55.904533+0000","last_clean":"2024-09-17T05:41:55.904533+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:41:55.921410+0000","last_undegraded":"2024-09-17T05:41:55.921410+0000","last_fullsized":"2024-09-17T05:41:55.921410+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:55.904533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:55.904533+0000","last_clean_scrub_stamp":"2024-09-17T05:41:55.904533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:41:56.913963+0000","last_change":"2024-09-17T05:41:56.913963+0000","last_active":"2024-09-17T05:41:56.913963+0000","last_peered":"2024-09-17T05:41:56.913963+0000","last_clean":"2024-09-17T05:41:56.913963+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:41:56.913963+0000","last_undegraded":"2024-09-17T05:41:56.913963+0000","last_fullsized":"2024-09-17T05:41:56.913963+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_clean_scrub_stamp":"2024-09-17T05:41:56.913963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1f","version":"22'4","reported_seq":17,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T05:41:57.964113+0000","last_change":"2024-09-17T05:41:56.946707+0000","last_active":"2024-09-17T05:41:57.964113+0000","last_peered":"2024-09-17T05:41:57.964113+0000","last_clean":"2024-09-17T05:41:57.964113+0000","last_became_active":"2024-09-17T05:41:56.946448+0000","last_became_peered":"2024-09-17T05:41:56.946448+0000","last_unstale":"2024-09-17T05:41:57.964113+0000","last_undegraded":"2024-09-17T05:41:57.964113+0000","last_fullsized":"2024-09-17T05:41:57.964113+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:55.904533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:55.904533+0000","last_clean_scrub_stamp":"2024-09-17T05:41:55.904533+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:55:32.730864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":34,"acting":34,"num_store_stats":2},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":616,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6,"ondisk_log_size":6,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":16,"seq":68719476742,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27220,"kb_used_data":192,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344620,"statfs":{"total":96636764160,"available":96608890880,"internally_reserved":0,"allocated":196608,"data_stored":62477,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":7,"up_from":15,"seq":64424509446,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28032,"kb_used_data":760,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343808,"statfs":{"total":96636764160,"available":96608059392,"internally_reserved":0,"allocated":778240,"data_stored":647028,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509445,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27216,"kb_used_data":180,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344624,"statfs":{"total":96636764160,"available":96608894976,"internally_reserved":0,"allocated":184320,"data_stored":56660,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509445,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27216,"kb_used_data":180,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344624,"statfs":{"total":96636764160,"available":96608894976,"internally_reserved":0,"allocated":184320,"data_stored":56660,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509445,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27208,"kb_used_data":180,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344632,"statfs":{"total":96636764160,"available":96608903168,"internally_reserved":0,"allocated":184320,"data_stored":56660,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509445,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27208,"kb_used_data":180,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344632,"statfs":{"total":96636764160,"available":96608903168,"internally_reserved":0,"allocated":184320,"data_stored":56660,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509445,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27208,"kb_used_data":180,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344632,"statfs":{"total":96636764160,"available":96608903168,"internally_reserved":0,"allocated":184320,"data_stored":56660,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574853,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27832,"kb_used_data":800,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344008,"statfs":{"total":96636764160,"available":96608264192,"internally_reserved":0,"allocated":819200,"data_stored":665917,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-17T05:42:01.648 INFO:tasks.ceph.ceph_manager.ceph:PG 3.3f is not active+clean 2024-09-17T05:42:01.648 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.3f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T05:41:56.913963+0000', 'last_change': '2024-09-17T05:41:56.913963+0000', 'last_active': '2024-09-17T05:41:56.913963+0000', 'last_peered': '2024-09-17T05:41:56.913963+0000', 'last_clean': '2024-09-17T05:41:56.913963+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:41:56.913963+0000', 'last_undegraded': '2024-09-17T05:41:56.913963+0000', 'last_fullsized': '2024-09-17T05:41:56.913963+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:41:56.913963+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:41:56.913963+0000', 'last_clean_scrub_stamp': '2024-09-17T05:41:56.913963+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T05:42:01.648 INFO:tasks.ceph.ceph_manager.ceph:PG 3.3e is not active+clean 2024-09-17T05:42:01.648 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.3e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T05:41:56.913963+0000', 'last_change': '2024-09-17T05:41:56.913963+0000', 'last_active': '2024-09-17T05:41:56.913963+0000', 'last_peered': '2024-09-17T05:41:56.913963+0000', 'last_clean': '2024-09-17T05:41:56.913963+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:41:56.913963+0000', 'last_undegraded': '2024-09-17T05:41:56.913963+0000', 'last_fullsized': '2024-09-17T05:41:56.913963+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:41:56.913963+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:41:56.913963+0000', 'last_clean_scrub_stamp': '2024-09-17T05:41:56.913963+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T05:42:01.648 INFO:tasks.ceph.ceph_manager.ceph:PG 3.3c is not active+clean 2024-09-17T05:42:01.648 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.3c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T05:41:56.913963+0000', 'last_change': '2024-09-17T05:41:56.913963+0000', 'last_active': '2024-09-17T05:41:56.913963+0000', 'last_peered': '2024-09-17T05:41:56.913963+0000', 'last_clean': '2024-09-17T05:41:56.913963+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:41:56.913963+0000', 'last_undegraded': '2024-09-17T05:41:56.913963+0000', 'last_fullsized': '2024-09-17T05:41:56.913963+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:41:56.913963+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:41:56.913963+0000', 'last_clean_scrub_stamp': '2024-09-17T05:41:56.913963+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T05:42:01.648 INFO:tasks.ceph.ceph_manager.ceph:PG 3.3b is not active+clean 2024-09-17T05:42:01.648 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.3b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T05:41:56.913963+0000', 'last_change': '2024-09-17T05:41:56.913963+0000', 'last_active': '2024-09-17T05:41:56.913963+0000', 'last_peered': '2024-09-17T05:41:56.913963+0000', 'last_clean': '2024-09-17T05:41:56.913963+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:41:56.913963+0000', 'last_undegraded': '2024-09-17T05:41:56.913963+0000', 'last_fullsized': '2024-09-17T05:41:56.913963+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:41:56.913963+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:41:56.913963+0000', 'last_clean_scrub_stamp': '2024-09-17T05:41:56.913963+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T05:42:01.649 INFO:tasks.ceph.ceph_manager.ceph:PG 3.3a is not active+clean 2024-09-17T05:42:01.649 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.3a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T05:41:56.913963+0000', 'last_change': '2024-09-17T05:41:56.913963+0000', 'last_active': '2024-09-17T05:41:56.913963+0000', 'last_peered': '2024-09-17T05:41:56.913963+0000', 'last_clean': '2024-09-17T05:41:56.913963+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:41:56.913963+0000', 'last_undegraded': '2024-09-17T05:41:56.913963+0000', 'last_fullsized': '2024-09-17T05:41:56.913963+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:41:56.913963+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:41:56.913963+0000', 'last_clean_scrub_stamp': '2024-09-17T05:41:56.913963+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T05:42:01.649 INFO:tasks.ceph.ceph_manager.ceph:PG 3.39 is not active+clean 2024-09-17T05:42:01.649 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.39', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T05:41:56.913963+0000', 'last_change': '2024-09-17T05:41:56.913963+0000', 'last_active': '2024-09-17T05:41:56.913963+0000', 'last_peered': '2024-09-17T05:41:56.913963+0000', 'last_clean': '2024-09-17T05:41:56.913963+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:41:56.913963+0000', 'last_undegraded': '2024-09-17T05:41:56.913963+0000', 'last_fullsized': '2024-09-17T05:41:56.913963+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:41:56.913963+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:41:56.913963+0000', 'last_clean_scrub_stamp': '2024-09-17T05:41:56.913963+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T05:42:01.649 INFO:tasks.ceph.ceph_manager.ceph:PG 3.38 is not active+clean 2024-09-17T05:42:01.649 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.38', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T05:41:56.913963+0000', 'last_change': '2024-09-17T05:41:56.913963+0000', 'last_active': '2024-09-17T05:41:56.913963+0000', 'last_peered': '2024-09-17T05:41:56.913963+0000', 'last_clean': '2024-09-17T05:41:56.913963+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:41:56.913963+0000', 'last_undegraded': '2024-09-17T05:41:56.913963+0000', 'last_fullsized': '2024-09-17T05:41:56.913963+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:41:56.913963+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:41:56.913963+0000', 'last_clean_scrub_stamp': '2024-09-17T05:41:56.913963+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T05:42:01.649 INFO:tasks.ceph.ceph_manager.ceph:PG 3.37 is not active+clean 2024-09-17T05:42:01.649 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.37', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T05:41:56.913963+0000', 'last_change': '2024-09-17T05:41:56.913963+0000', 'last_active': '2024-09-17T05:41:56.913963+0000', 'last_peered': '2024-09-17T05:41:56.913963+0000', 'last_clean': '2024-09-17T05:41:56.913963+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:41:56.913963+0000', 'last_undegraded': '2024-09-17T05:41:56.913963+0000', 'last_fullsized': '2024-09-17T05:41:56.913963+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:41:56.913963+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:41:56.913963+0000', 'last_clean_scrub_stamp': '2024-09-17T05:41:56.913963+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T05:42:01.649 INFO:tasks.ceph.ceph_manager.ceph:PG 3.36 is not active+clean 2024-09-17T05:42:01.649 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.36', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 21, 'state': 'creating+peering', 'last_fresh': '2024-09-17T05:41:56.938399+0000', 'last_change': '2024-09-17T05:41:56.938399+0000', 'last_active': '2024-09-17T05:41:56.913963+0000', 'last_peered': '2024-09-17T05:41:56.913963+0000', 'last_clean': '2024-09-17T05:41:56.913963+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:41:56.938399+0000', 'last_undegraded': '2024-09-17T05:41:56.938399+0000', 'last_fullsized': '2024-09-17T05:41:56.938399+0000', 'mapping_epoch': 21, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 21, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:41:56.913963+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:41:56.913963+0000', 'last_clean_scrub_stamp': '2024-09-17T05:41:56.913963+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 5], 'acting': [6, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-17T05:42:01.649 INFO:tasks.ceph.ceph_manager.ceph:PG 3.35 is not active+clean 2024-09-17T05:42:01.650 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.35', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 21, 'state': 'creating+peering', 'last_fresh': '2024-09-17T05:41:56.935343+0000', 'last_change': '2024-09-17T05:41:56.935343+0000', 'last_active': '2024-09-17T05:41:56.913963+0000', 'last_peered': '2024-09-17T05:41:56.913963+0000', 'last_clean': '2024-09-17T05:41:56.913963+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:41:56.935343+0000', 'last_undegraded': '2024-09-17T05:41:56.935343+0000', 'last_fullsized': '2024-09-17T05:41:56.935343+0000', 'mapping_epoch': 21, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 21, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:41:56.913963+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:41:56.913963+0000', 'last_clean_scrub_stamp': '2024-09-17T05:41:56.913963+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 5], 'acting': [6, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-17T05:42:01.650 INFO:tasks.ceph.ceph_manager.ceph:PG 3.34 is not active+clean 2024-09-17T05:42:01.650 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.34', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T05:41:56.913963+0000', 'last_change': '2024-09-17T05:41:56.913963+0000', 'last_active': '2024-09-17T05:41:56.913963+0000', 'last_peered': '2024-09-17T05:41:56.913963+0000', 'last_clean': '2024-09-17T05:41:56.913963+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:41:56.913963+0000', 'last_undegraded': '2024-09-17T05:41:56.913963+0000', 'last_fullsized': '2024-09-17T05:41:56.913963+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:41:56.913963+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:41:56.913963+0000', 'last_clean_scrub_stamp': '2024-09-17T05:41:56.913963+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T05:42:01.650 INFO:tasks.ceph.ceph_manager.ceph:PG 3.33 is not active+clean 2024-09-17T05:42:01.650 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.33', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T05:41:56.913963+0000', 'last_change': '2024-09-17T05:41:56.913963+0000', 'last_active': '2024-09-17T05:41:56.913963+0000', 'last_peered': '2024-09-17T05:41:56.913963+0000', 'last_clean': '2024-09-17T05:41:56.913963+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:41:56.913963+0000', 'last_undegraded': '2024-09-17T05:41:56.913963+0000', 'last_fullsized': '2024-09-17T05:41:56.913963+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:41:56.913963+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:41:56.913963+0000', 'last_clean_scrub_stamp': '2024-09-17T05:41:56.913963+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T05:42:01.650 INFO:tasks.ceph.ceph_manager.ceph:PG 3.31 is not active+clean 2024-09-17T05:42:01.650 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.31', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T05:41:56.913963+0000', 'last_change': '2024-09-17T05:41:56.913963+0000', 'last_active': '2024-09-17T05:41:56.913963+0000', 'last_peered': '2024-09-17T05:41:56.913963+0000', 'last_clean': '2024-09-17T05:41:56.913963+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:41:56.913963+0000', 'last_undegraded': '2024-09-17T05:41:56.913963+0000', 'last_fullsized': '2024-09-17T05:41:56.913963+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:41:56.913963+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:41:56.913963+0000', 'last_clean_scrub_stamp': '2024-09-17T05:41:56.913963+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T05:42:01.650 INFO:tasks.ceph.ceph_manager.ceph:PG 3.30 is not active+clean 2024-09-17T05:42:01.650 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.30', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T05:41:56.913963+0000', 'last_change': '2024-09-17T05:41:56.913963+0000', 'last_active': '2024-09-17T05:41:56.913963+0000', 'last_peered': '2024-09-17T05:41:56.913963+0000', 'last_clean': '2024-09-17T05:41:56.913963+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:41:56.913963+0000', 'last_undegraded': '2024-09-17T05:41:56.913963+0000', 'last_fullsized': '2024-09-17T05:41:56.913963+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:41:56.913963+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:41:56.913963+0000', 'last_clean_scrub_stamp': '2024-09-17T05:41:56.913963+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T05:42:01.650 INFO:tasks.ceph.ceph_manager.ceph:PG 3.2f is not active+clean 2024-09-17T05:42:01.650 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.2f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T05:41:56.913963+0000', 'last_change': '2024-09-17T05:41:56.913963+0000', 'last_active': '2024-09-17T05:41:56.913963+0000', 'last_peered': '2024-09-17T05:41:56.913963+0000', 'last_clean': '2024-09-17T05:41:56.913963+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:41:56.913963+0000', 'last_undegraded': '2024-09-17T05:41:56.913963+0000', 'last_fullsized': '2024-09-17T05:41:56.913963+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:41:56.913963+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:41:56.913963+0000', 'last_clean_scrub_stamp': '2024-09-17T05:41:56.913963+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T05:42:01.651 INFO:tasks.ceph.ceph_manager.ceph:PG 3.2e is not active+clean 2024-09-17T05:42:01.651 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.2e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T05:41:56.913963+0000', 'last_change': '2024-09-17T05:41:56.913963+0000', 'last_active': '2024-09-17T05:41:56.913963+0000', 'last_peered': '2024-09-17T05:41:56.913963+0000', 'last_clean': '2024-09-17T05:41:56.913963+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:41:56.913963+0000', 'last_undegraded': '2024-09-17T05:41:56.913963+0000', 'last_fullsized': '2024-09-17T05:41:56.913963+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:41:56.913963+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:41:56.913963+0000', 'last_clean_scrub_stamp': '2024-09-17T05:41:56.913963+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T05:42:01.651 INFO:tasks.ceph.ceph_manager.ceph:PG 3.2d is not active+clean 2024-09-17T05:42:01.651 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.2d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T05:41:56.913963+0000', 'last_change': '2024-09-17T05:41:56.913963+0000', 'last_active': '2024-09-17T05:41:56.913963+0000', 'last_peered': '2024-09-17T05:41:56.913963+0000', 'last_clean': '2024-09-17T05:41:56.913963+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:41:56.913963+0000', 'last_undegraded': '2024-09-17T05:41:56.913963+0000', 'last_fullsized': '2024-09-17T05:41:56.913963+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:41:56.913963+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:41:56.913963+0000', 'last_clean_scrub_stamp': '2024-09-17T05:41:56.913963+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T05:42:01.651 INFO:tasks.ceph.ceph_manager.ceph:PG 3.2c is not active+clean 2024-09-17T05:42:01.651 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.2c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 21, 'state': 'creating+peering', 'last_fresh': '2024-09-17T05:41:56.933458+0000', 'last_change': '2024-09-17T05:41:56.933458+0000', 'last_active': '2024-09-17T05:41:56.913963+0000', 'last_peered': '2024-09-17T05:41:56.913963+0000', 'last_clean': '2024-09-17T05:41:56.913963+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:41:56.933458+0000', 'last_undegraded': '2024-09-17T05:41:56.933458+0000', 'last_fullsized': '2024-09-17T05:41:56.933458+0000', 'mapping_epoch': 21, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 21, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:41:56.913963+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:41:56.913963+0000', 'last_clean_scrub_stamp': '2024-09-17T05:41:56.913963+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 4], 'acting': [6, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-17T05:42:01.651 INFO:tasks.ceph.ceph_manager.ceph:PG 3.2a is not active+clean 2024-09-17T05:42:01.651 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.2a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T05:41:56.913963+0000', 'last_change': '2024-09-17T05:41:56.913963+0000', 'last_active': '2024-09-17T05:41:56.913963+0000', 'last_peered': '2024-09-17T05:41:56.913963+0000', 'last_clean': '2024-09-17T05:41:56.913963+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:41:56.913963+0000', 'last_undegraded': '2024-09-17T05:41:56.913963+0000', 'last_fullsized': '2024-09-17T05:41:56.913963+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:41:56.913963+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:41:56.913963+0000', 'last_clean_scrub_stamp': '2024-09-17T05:41:56.913963+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T05:42:01.651 INFO:tasks.ceph.ceph_manager.ceph:PG 3.29 is not active+clean 2024-09-17T05:42:01.651 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.29', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T05:41:56.913963+0000', 'last_change': '2024-09-17T05:41:56.913963+0000', 'last_active': '2024-09-17T05:41:56.913963+0000', 'last_peered': '2024-09-17T05:41:56.913963+0000', 'last_clean': '2024-09-17T05:41:56.913963+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:41:56.913963+0000', 'last_undegraded': '2024-09-17T05:41:56.913963+0000', 'last_fullsized': '2024-09-17T05:41:56.913963+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:41:56.913963+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:41:56.913963+0000', 'last_clean_scrub_stamp': '2024-09-17T05:41:56.913963+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T05:42:01.651 INFO:tasks.ceph.ceph_manager.ceph:PG 3.28 is not active+clean 2024-09-17T05:42:01.651 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.28', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T05:41:56.913963+0000', 'last_change': '2024-09-17T05:41:56.913963+0000', 'last_active': '2024-09-17T05:41:56.913963+0000', 'last_peered': '2024-09-17T05:41:56.913963+0000', 'last_clean': '2024-09-17T05:41:56.913963+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:41:56.913963+0000', 'last_undegraded': '2024-09-17T05:41:56.913963+0000', 'last_fullsized': '2024-09-17T05:41:56.913963+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:41:56.913963+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:41:56.913963+0000', 'last_clean_scrub_stamp': '2024-09-17T05:41:56.913963+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T05:42:01.652 INFO:tasks.ceph.ceph_manager.ceph:PG 3.27 is not active+clean 2024-09-17T05:42:01.652 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.27', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T05:41:56.913963+0000', 'last_change': '2024-09-17T05:41:56.913963+0000', 'last_active': '2024-09-17T05:41:56.913963+0000', 'last_peered': '2024-09-17T05:41:56.913963+0000', 'last_clean': '2024-09-17T05:41:56.913963+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:41:56.913963+0000', 'last_undegraded': '2024-09-17T05:41:56.913963+0000', 'last_fullsized': '2024-09-17T05:41:56.913963+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:41:56.913963+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:41:56.913963+0000', 'last_clean_scrub_stamp': '2024-09-17T05:41:56.913963+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T05:42:01.652 INFO:tasks.ceph.ceph_manager.ceph:PG 3.26 is not active+clean 2024-09-17T05:42:01.652 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.26', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 21, 'state': 'creating+peering', 'last_fresh': '2024-09-17T05:41:56.936595+0000', 'last_change': '2024-09-17T05:41:56.936595+0000', 'last_active': '2024-09-17T05:41:56.913963+0000', 'last_peered': '2024-09-17T05:41:56.913963+0000', 'last_clean': '2024-09-17T05:41:56.913963+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:41:56.936595+0000', 'last_undegraded': '2024-09-17T05:41:56.936595+0000', 'last_fullsized': '2024-09-17T05:41:56.936595+0000', 'mapping_epoch': 21, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 21, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:41:56.913963+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:41:56.913963+0000', 'last_clean_scrub_stamp': '2024-09-17T05:41:56.913963+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 7], 'acting': [6, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-17T05:42:01.652 INFO:tasks.ceph.ceph_manager.ceph:PG 3.25 is not active+clean 2024-09-17T05:42:01.652 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.25', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T05:41:56.913963+0000', 'last_change': '2024-09-17T05:41:56.913963+0000', 'last_active': '2024-09-17T05:41:56.913963+0000', 'last_peered': '2024-09-17T05:41:56.913963+0000', 'last_clean': '2024-09-17T05:41:56.913963+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:41:56.913963+0000', 'last_undegraded': '2024-09-17T05:41:56.913963+0000', 'last_fullsized': '2024-09-17T05:41:56.913963+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:41:56.913963+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:41:56.913963+0000', 'last_clean_scrub_stamp': '2024-09-17T05:41:56.913963+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T05:42:01.652 INFO:tasks.ceph.ceph_manager.ceph:PG 3.24 is not active+clean 2024-09-17T05:42:01.652 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.24', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T05:41:56.913963+0000', 'last_change': '2024-09-17T05:41:56.913963+0000', 'last_active': '2024-09-17T05:41:56.913963+0000', 'last_peered': '2024-09-17T05:41:56.913963+0000', 'last_clean': '2024-09-17T05:41:56.913963+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:41:56.913963+0000', 'last_undegraded': '2024-09-17T05:41:56.913963+0000', 'last_fullsized': '2024-09-17T05:41:56.913963+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:41:56.913963+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:41:56.913963+0000', 'last_clean_scrub_stamp': '2024-09-17T05:41:56.913963+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T05:42:01.652 INFO:tasks.ceph.ceph_manager.ceph:PG 3.22 is not active+clean 2024-09-17T05:42:01.652 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.22', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T05:41:56.913963+0000', 'last_change': '2024-09-17T05:41:56.913963+0000', 'last_active': '2024-09-17T05:41:56.913963+0000', 'last_peered': '2024-09-17T05:41:56.913963+0000', 'last_clean': '2024-09-17T05:41:56.913963+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:41:56.913963+0000', 'last_undegraded': '2024-09-17T05:41:56.913963+0000', 'last_fullsized': '2024-09-17T05:41:56.913963+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:41:56.913963+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:41:56.913963+0000', 'last_clean_scrub_stamp': '2024-09-17T05:41:56.913963+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T05:42:01.652 INFO:tasks.ceph.ceph_manager.ceph:PG 3.21 is not active+clean 2024-09-17T05:42:01.652 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.21', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T05:41:56.913963+0000', 'last_change': '2024-09-17T05:41:56.913963+0000', 'last_active': '2024-09-17T05:41:56.913963+0000', 'last_peered': '2024-09-17T05:41:56.913963+0000', 'last_clean': '2024-09-17T05:41:56.913963+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:41:56.913963+0000', 'last_undegraded': '2024-09-17T05:41:56.913963+0000', 'last_fullsized': '2024-09-17T05:41:56.913963+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:41:56.913963+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:41:56.913963+0000', 'last_clean_scrub_stamp': '2024-09-17T05:41:56.913963+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T05:42:01.653 INFO:tasks.ceph.ceph_manager.ceph:PG 3.20 is not active+clean 2024-09-17T05:42:01.653 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.20', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 21, 'state': 'creating+peering', 'last_fresh': '2024-09-17T05:41:56.933616+0000', 'last_change': '2024-09-17T05:41:56.933616+0000', 'last_active': '2024-09-17T05:41:56.913963+0000', 'last_peered': '2024-09-17T05:41:56.913963+0000', 'last_clean': '2024-09-17T05:41:56.913963+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:41:56.933616+0000', 'last_undegraded': '2024-09-17T05:41:56.933616+0000', 'last_fullsized': '2024-09-17T05:41:56.933616+0000', 'mapping_epoch': 21, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 21, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:41:56.913963+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:41:56.913963+0000', 'last_clean_scrub_stamp': '2024-09-17T05:41:56.913963+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 0], 'acting': [6, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-17T05:42:01.653 INFO:tasks.ceph.ceph_manager.ceph:PG 3.1a is not active+clean 2024-09-17T05:42:01.653 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.1a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T05:41:56.913963+0000', 'last_change': '2024-09-17T05:41:56.913963+0000', 'last_active': '2024-09-17T05:41:56.913963+0000', 'last_peered': '2024-09-17T05:41:56.913963+0000', 'last_clean': '2024-09-17T05:41:56.913963+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:41:56.913963+0000', 'last_undegraded': '2024-09-17T05:41:56.913963+0000', 'last_fullsized': '2024-09-17T05:41:56.913963+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:41:56.913963+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:41:56.913963+0000', 'last_clean_scrub_stamp': '2024-09-17T05:41:56.913963+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T05:42:01.653 INFO:tasks.ceph.ceph_manager.ceph:PG 2.1b is not active+clean 2024-09-17T05:42:01.653 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '2.1b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 20, 'state': 'creating+peering', 'last_fresh': '2024-09-17T05:41:55.922157+0000', 'last_change': '2024-09-17T05:41:55.922157+0000', 'last_active': '2024-09-17T05:41:55.904533+0000', 'last_peered': '2024-09-17T05:41:55.904533+0000', 'last_clean': '2024-09-17T05:41:55.904533+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:41:55.922157+0000', 'last_undegraded': '2024-09-17T05:41:55.922157+0000', 'last_fullsized': '2024-09-17T05:41:55.922157+0000', 'mapping_epoch': 20, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 20, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:41:55.904533+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:41:55.904533+0000', 'last_clean_scrub_stamp': '2024-09-17T05:41:55.904533+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 7], 'acting': [3, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-17T05:42:01.653 INFO:tasks.ceph.ceph_manager.ceph:PG 2.19 is not active+clean 2024-09-17T05:42:01.653 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '2.19', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 20, 'state': 'creating+peering', 'last_fresh': '2024-09-17T05:41:55.922588+0000', 'last_change': '2024-09-17T05:41:55.922588+0000', 'last_active': '2024-09-17T05:41:55.904533+0000', 'last_peered': '2024-09-17T05:41:55.904533+0000', 'last_clean': '2024-09-17T05:41:55.904533+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:41:55.922588+0000', 'last_undegraded': '2024-09-17T05:41:55.922588+0000', 'last_fullsized': '2024-09-17T05:41:55.922588+0000', 'mapping_epoch': 20, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 20, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:41:55.904533+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:41:55.904533+0000', 'last_clean_scrub_stamp': '2024-09-17T05:41:55.904533+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 6], 'acting': [3, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-17T05:42:01.653 INFO:tasks.ceph.ceph_manager.ceph:PG 3.18 is not active+clean 2024-09-17T05:42:01.653 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.18', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T05:41:56.913963+0000', 'last_change': '2024-09-17T05:41:56.913963+0000', 'last_active': '2024-09-17T05:41:56.913963+0000', 'last_peered': '2024-09-17T05:41:56.913963+0000', 'last_clean': '2024-09-17T05:41:56.913963+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:41:56.913963+0000', 'last_undegraded': '2024-09-17T05:41:56.913963+0000', 'last_fullsized': '2024-09-17T05:41:56.913963+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:41:56.913963+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:41:56.913963+0000', 'last_clean_scrub_stamp': '2024-09-17T05:41:56.913963+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T05:42:01.653 INFO:tasks.ceph.ceph_manager.ceph:PG 2.18 is not active+clean 2024-09-17T05:42:01.653 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '2.18', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 20, 'state': 'creating+peering', 'last_fresh': '2024-09-17T05:41:55.922741+0000', 'last_change': '2024-09-17T05:41:55.922741+0000', 'last_active': '2024-09-17T05:41:55.904533+0000', 'last_peered': '2024-09-17T05:41:55.904533+0000', 'last_clean': '2024-09-17T05:41:55.904533+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:41:55.922741+0000', 'last_undegraded': '2024-09-17T05:41:55.922741+0000', 'last_fullsized': '2024-09-17T05:41:55.922741+0000', 'mapping_epoch': 20, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 20, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:41:55.904533+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:41:55.904533+0000', 'last_clean_scrub_stamp': '2024-09-17T05:41:55.904533+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 4], 'acting': [5, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-17T05:42:01.654 INFO:tasks.ceph.ceph_manager.ceph:PG 3.19 is not active+clean 2024-09-17T05:42:01.654 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.19', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T05:41:56.913963+0000', 'last_change': '2024-09-17T05:41:56.913963+0000', 'last_active': '2024-09-17T05:41:56.913963+0000', 'last_peered': '2024-09-17T05:41:56.913963+0000', 'last_clean': '2024-09-17T05:41:56.913963+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:41:56.913963+0000', 'last_undegraded': '2024-09-17T05:41:56.913963+0000', 'last_fullsized': '2024-09-17T05:41:56.913963+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:41:56.913963+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:41:56.913963+0000', 'last_clean_scrub_stamp': '2024-09-17T05:41:56.913963+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T05:42:01.654 INFO:tasks.ceph.ceph_manager.ceph:PG 3.16 is not active+clean 2024-09-17T05:42:01.654 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.16', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T05:41:56.913963+0000', 'last_change': '2024-09-17T05:41:56.913963+0000', 'last_active': '2024-09-17T05:41:56.913963+0000', 'last_peered': '2024-09-17T05:41:56.913963+0000', 'last_clean': '2024-09-17T05:41:56.913963+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:41:56.913963+0000', 'last_undegraded': '2024-09-17T05:41:56.913963+0000', 'last_fullsized': '2024-09-17T05:41:56.913963+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:41:56.913963+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:41:56.913963+0000', 'last_clean_scrub_stamp': '2024-09-17T05:41:56.913963+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T05:42:01.654 INFO:tasks.ceph.ceph_manager.ceph:PG 2.16 is not active+clean 2024-09-17T05:42:01.654 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '2.16', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 20, 'state': 'creating+peering', 'last_fresh': '2024-09-17T05:41:55.924578+0000', 'last_change': '2024-09-17T05:41:55.924578+0000', 'last_active': '2024-09-17T05:41:55.904533+0000', 'last_peered': '2024-09-17T05:41:55.904533+0000', 'last_clean': '2024-09-17T05:41:55.904533+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:41:55.924578+0000', 'last_undegraded': '2024-09-17T05:41:55.924578+0000', 'last_fullsized': '2024-09-17T05:41:55.924578+0000', 'mapping_epoch': 20, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 20, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:41:55.904533+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:41:55.904533+0000', 'last_clean_scrub_stamp': '2024-09-17T05:41:55.904533+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 6], 'acting': [5, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-17T05:42:01.654 INFO:tasks.ceph.ceph_manager.ceph:PG 2.15 is not active+clean 2024-09-17T05:42:01.654 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '2.15', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 20, 'state': 'creating+peering', 'last_fresh': '2024-09-17T05:41:55.919928+0000', 'last_change': '2024-09-17T05:41:55.919928+0000', 'last_active': '2024-09-17T05:41:55.904533+0000', 'last_peered': '2024-09-17T05:41:55.904533+0000', 'last_clean': '2024-09-17T05:41:55.904533+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:41:55.919928+0000', 'last_undegraded': '2024-09-17T05:41:55.919928+0000', 'last_fullsized': '2024-09-17T05:41:55.919928+0000', 'mapping_epoch': 20, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 20, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:41:55.904533+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:41:55.904533+0000', 'last_clean_scrub_stamp': '2024-09-17T05:41:55.904533+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 5], 'acting': [1, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-17T05:42:01.654 INFO:tasks.ceph.ceph_manager.ceph:PG 3.14 is not active+clean 2024-09-17T05:42:01.654 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.14', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T05:41:56.913963+0000', 'last_change': '2024-09-17T05:41:56.913963+0000', 'last_active': '2024-09-17T05:41:56.913963+0000', 'last_peered': '2024-09-17T05:41:56.913963+0000', 'last_clean': '2024-09-17T05:41:56.913963+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:41:56.913963+0000', 'last_undegraded': '2024-09-17T05:41:56.913963+0000', 'last_fullsized': '2024-09-17T05:41:56.913963+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:41:56.913963+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:41:56.913963+0000', 'last_clean_scrub_stamp': '2024-09-17T05:41:56.913963+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T05:42:01.655 INFO:tasks.ceph.ceph_manager.ceph:PG 3.15 is not active+clean 2024-09-17T05:42:01.655 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.15', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T05:41:56.913963+0000', 'last_change': '2024-09-17T05:41:56.913963+0000', 'last_active': '2024-09-17T05:41:56.913963+0000', 'last_peered': '2024-09-17T05:41:56.913963+0000', 'last_clean': '2024-09-17T05:41:56.913963+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:41:56.913963+0000', 'last_undegraded': '2024-09-17T05:41:56.913963+0000', 'last_fullsized': '2024-09-17T05:41:56.913963+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:41:56.913963+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:41:56.913963+0000', 'last_clean_scrub_stamp': '2024-09-17T05:41:56.913963+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T05:42:01.655 INFO:tasks.ceph.ceph_manager.ceph:PG 2.12 is not active+clean 2024-09-17T05:42:01.655 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '2.12', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 20, 'state': 'creating+peering', 'last_fresh': '2024-09-17T05:41:55.925889+0000', 'last_change': '2024-09-17T05:41:55.925889+0000', 'last_active': '2024-09-17T05:41:55.904533+0000', 'last_peered': '2024-09-17T05:41:55.904533+0000', 'last_clean': '2024-09-17T05:41:55.904533+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:41:55.925889+0000', 'last_undegraded': '2024-09-17T05:41:55.925889+0000', 'last_fullsized': '2024-09-17T05:41:55.925889+0000', 'mapping_epoch': 20, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 20, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:41:55.904533+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:41:55.904533+0000', 'last_clean_scrub_stamp': '2024-09-17T05:41:55.904533+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 3], 'acting': [5, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-17T05:42:01.655 INFO:tasks.ceph.ceph_manager.ceph:PG 3.13 is not active+clean 2024-09-17T05:42:01.655 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.13', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T05:41:56.913963+0000', 'last_change': '2024-09-17T05:41:56.913963+0000', 'last_active': '2024-09-17T05:41:56.913963+0000', 'last_peered': '2024-09-17T05:41:56.913963+0000', 'last_clean': '2024-09-17T05:41:56.913963+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:41:56.913963+0000', 'last_undegraded': '2024-09-17T05:41:56.913963+0000', 'last_fullsized': '2024-09-17T05:41:56.913963+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:41:56.913963+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:41:56.913963+0000', 'last_clean_scrub_stamp': '2024-09-17T05:41:56.913963+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T05:42:01.655 INFO:tasks.ceph.ceph_manager.ceph:PG 3.10 is not active+clean 2024-09-17T05:42:01.655 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.10', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 21, 'state': 'creating+peering', 'last_fresh': '2024-09-17T05:41:56.932989+0000', 'last_change': '2024-09-17T05:41:56.932989+0000', 'last_active': '2024-09-17T05:41:56.913963+0000', 'last_peered': '2024-09-17T05:41:56.913963+0000', 'last_clean': '2024-09-17T05:41:56.913963+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:41:56.932989+0000', 'last_undegraded': '2024-09-17T05:41:56.932989+0000', 'last_fullsized': '2024-09-17T05:41:56.932989+0000', 'mapping_epoch': 21, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 21, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:41:56.913963+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:41:56.913963+0000', 'last_clean_scrub_stamp': '2024-09-17T05:41:56.913963+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 0], 'acting': [6, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-17T05:42:01.655 INFO:tasks.ceph.ceph_manager.ceph:PG 2.10 is not active+clean 2024-09-17T05:42:01.655 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '2.10', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 20, 'state': 'creating+peering', 'last_fresh': '2024-09-17T05:41:55.921502+0000', 'last_change': '2024-09-17T05:41:55.921502+0000', 'last_active': '2024-09-17T05:41:55.904533+0000', 'last_peered': '2024-09-17T05:41:55.904533+0000', 'last_clean': '2024-09-17T05:41:55.904533+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:41:55.921502+0000', 'last_undegraded': '2024-09-17T05:41:55.921502+0000', 'last_fullsized': '2024-09-17T05:41:55.921502+0000', 'mapping_epoch': 20, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 20, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:41:55.904533+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:41:55.904533+0000', 'last_clean_scrub_stamp': '2024-09-17T05:41:55.904533+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 1], 'acting': [2, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-17T05:42:01.655 INFO:tasks.ceph.ceph_manager.ceph:PG 3.11 is not active+clean 2024-09-17T05:42:01.655 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.11', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T05:41:56.913963+0000', 'last_change': '2024-09-17T05:41:56.913963+0000', 'last_active': '2024-09-17T05:41:56.913963+0000', 'last_peered': '2024-09-17T05:41:56.913963+0000', 'last_clean': '2024-09-17T05:41:56.913963+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:41:56.913963+0000', 'last_undegraded': '2024-09-17T05:41:56.913963+0000', 'last_fullsized': '2024-09-17T05:41:56.913963+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:41:56.913963+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:41:56.913963+0000', 'last_clean_scrub_stamp': '2024-09-17T05:41:56.913963+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T05:42:01.656 INFO:tasks.ceph.ceph_manager.ceph:PG 2.f is not active+clean 2024-09-17T05:42:01.656 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '2.f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 20, 'state': 'creating+peering', 'last_fresh': '2024-09-17T05:41:55.923232+0000', 'last_change': '2024-09-17T05:41:55.923232+0000', 'last_active': '2024-09-17T05:41:55.904533+0000', 'last_peered': '2024-09-17T05:41:55.904533+0000', 'last_clean': '2024-09-17T05:41:55.904533+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:41:55.923232+0000', 'last_undegraded': '2024-09-17T05:41:55.923232+0000', 'last_fullsized': '2024-09-17T05:41:55.923232+0000', 'mapping_epoch': 20, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 20, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:41:55.904533+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:41:55.904533+0000', 'last_clean_scrub_stamp': '2024-09-17T05:41:55.904533+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 0], 'acting': [4, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-17T05:42:01.656 INFO:tasks.ceph.ceph_manager.ceph:PG 3.e is not active+clean 2024-09-17T05:42:01.656 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T05:41:56.913963+0000', 'last_change': '2024-09-17T05:41:56.913963+0000', 'last_active': '2024-09-17T05:41:56.913963+0000', 'last_peered': '2024-09-17T05:41:56.913963+0000', 'last_clean': '2024-09-17T05:41:56.913963+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:41:56.913963+0000', 'last_undegraded': '2024-09-17T05:41:56.913963+0000', 'last_fullsized': '2024-09-17T05:41:56.913963+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:41:56.913963+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:41:56.913963+0000', 'last_clean_scrub_stamp': '2024-09-17T05:41:56.913963+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T05:42:01.656 INFO:tasks.ceph.ceph_manager.ceph:PG 2.e is not active+clean 2024-09-17T05:42:01.656 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '2.e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 20, 'state': 'creating+peering', 'last_fresh': '2024-09-17T05:41:55.921184+0000', 'last_change': '2024-09-17T05:41:55.921184+0000', 'last_active': '2024-09-17T05:41:55.904533+0000', 'last_peered': '2024-09-17T05:41:55.904533+0000', 'last_clean': '2024-09-17T05:41:55.904533+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:41:55.921184+0000', 'last_undegraded': '2024-09-17T05:41:55.921184+0000', 'last_fullsized': '2024-09-17T05:41:55.921184+0000', 'mapping_epoch': 20, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 20, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:41:55.904533+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:41:55.904533+0000', 'last_clean_scrub_stamp': '2024-09-17T05:41:55.904533+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 3], 'acting': [2, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-17T05:42:01.656 INFO:tasks.ceph.ceph_manager.ceph:PG 3.f is not active+clean 2024-09-17T05:42:01.656 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T05:41:56.913963+0000', 'last_change': '2024-09-17T05:41:56.913963+0000', 'last_active': '2024-09-17T05:41:56.913963+0000', 'last_peered': '2024-09-17T05:41:56.913963+0000', 'last_clean': '2024-09-17T05:41:56.913963+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:41:56.913963+0000', 'last_undegraded': '2024-09-17T05:41:56.913963+0000', 'last_fullsized': '2024-09-17T05:41:56.913963+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:41:56.913963+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:41:56.913963+0000', 'last_clean_scrub_stamp': '2024-09-17T05:41:56.913963+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T05:42:01.656 INFO:tasks.ceph.ceph_manager.ceph:PG 2.d is not active+clean 2024-09-17T05:42:01.656 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '2.d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 20, 'state': 'creating+peering', 'last_fresh': '2024-09-17T05:41:55.918638+0000', 'last_change': '2024-09-17T05:41:55.918638+0000', 'last_active': '2024-09-17T05:41:55.904533+0000', 'last_peered': '2024-09-17T05:41:55.904533+0000', 'last_clean': '2024-09-17T05:41:55.904533+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:41:55.918638+0000', 'last_undegraded': '2024-09-17T05:41:55.918638+0000', 'last_fullsized': '2024-09-17T05:41:55.918638+0000', 'mapping_epoch': 20, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 20, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:41:55.904533+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:41:55.904533+0000', 'last_clean_scrub_stamp': '2024-09-17T05:41:55.904533+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 4], 'acting': [1, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-17T05:42:01.656 INFO:tasks.ceph.ceph_manager.ceph:PG 3.c is not active+clean 2024-09-17T05:42:01.656 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T05:41:56.913963+0000', 'last_change': '2024-09-17T05:41:56.913963+0000', 'last_active': '2024-09-17T05:41:56.913963+0000', 'last_peered': '2024-09-17T05:41:56.913963+0000', 'last_clean': '2024-09-17T05:41:56.913963+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:41:56.913963+0000', 'last_undegraded': '2024-09-17T05:41:56.913963+0000', 'last_fullsized': '2024-09-17T05:41:56.913963+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:41:56.913963+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:41:56.913963+0000', 'last_clean_scrub_stamp': '2024-09-17T05:41:56.913963+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T05:42:01.657 INFO:tasks.ceph.ceph_manager.ceph:PG 2.c is not active+clean 2024-09-17T05:42:01.657 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '2.c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 20, 'state': 'creating+peering', 'last_fresh': '2024-09-17T05:41:55.922017+0000', 'last_change': '2024-09-17T05:41:55.922017+0000', 'last_active': '2024-09-17T05:41:55.904533+0000', 'last_peered': '2024-09-17T05:41:55.904533+0000', 'last_clean': '2024-09-17T05:41:55.904533+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:41:55.922017+0000', 'last_undegraded': '2024-09-17T05:41:55.922017+0000', 'last_fullsized': '2024-09-17T05:41:55.922017+0000', 'mapping_epoch': 20, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 20, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:41:55.904533+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:41:55.904533+0000', 'last_clean_scrub_stamp': '2024-09-17T05:41:55.904533+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 5], 'acting': [2, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-17T05:42:01.657 INFO:tasks.ceph.ceph_manager.ceph:PG 3.d is not active+clean 2024-09-17T05:42:01.657 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T05:41:56.913963+0000', 'last_change': '2024-09-17T05:41:56.913963+0000', 'last_active': '2024-09-17T05:41:56.913963+0000', 'last_peered': '2024-09-17T05:41:56.913963+0000', 'last_clean': '2024-09-17T05:41:56.913963+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:41:56.913963+0000', 'last_undegraded': '2024-09-17T05:41:56.913963+0000', 'last_fullsized': '2024-09-17T05:41:56.913963+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:41:56.913963+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:41:56.913963+0000', 'last_clean_scrub_stamp': '2024-09-17T05:41:56.913963+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T05:42:01.657 INFO:tasks.ceph.ceph_manager.ceph:PG 2.3 is not active+clean 2024-09-17T05:42:01.657 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '2.3', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 20, 'state': 'creating+peering', 'last_fresh': '2024-09-17T05:41:55.923951+0000', 'last_change': '2024-09-17T05:41:55.923951+0000', 'last_active': '2024-09-17T05:41:55.904533+0000', 'last_peered': '2024-09-17T05:41:55.904533+0000', 'last_clean': '2024-09-17T05:41:55.904533+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:41:55.923951+0000', 'last_undegraded': '2024-09-17T05:41:55.923951+0000', 'last_fullsized': '2024-09-17T05:41:55.923951+0000', 'mapping_epoch': 20, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 20, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:41:55.904533+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:41:55.904533+0000', 'last_clean_scrub_stamp': '2024-09-17T05:41:55.904533+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 2], 'acting': [5, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-17T05:42:01.657 INFO:tasks.ceph.ceph_manager.ceph:PG 3.2 is not active+clean 2024-09-17T05:42:01.657 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.2', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T05:41:56.913963+0000', 'last_change': '2024-09-17T05:41:56.913963+0000', 'last_active': '2024-09-17T05:41:56.913963+0000', 'last_peered': '2024-09-17T05:41:56.913963+0000', 'last_clean': '2024-09-17T05:41:56.913963+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:41:56.913963+0000', 'last_undegraded': '2024-09-17T05:41:56.913963+0000', 'last_fullsized': '2024-09-17T05:41:56.913963+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:41:56.913963+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:41:56.913963+0000', 'last_clean_scrub_stamp': '2024-09-17T05:41:56.913963+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T05:42:01.657 INFO:tasks.ceph.ceph_manager.ceph:PG 2.0 is not active+clean 2024-09-17T05:42:01.657 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '2.0', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 20, 'state': 'creating+peering', 'last_fresh': '2024-09-17T05:41:55.925470+0000', 'last_change': '2024-09-17T05:41:55.925470+0000', 'last_active': '2024-09-17T05:41:55.904533+0000', 'last_peered': '2024-09-17T05:41:55.904533+0000', 'last_clean': '2024-09-17T05:41:55.904533+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:41:55.925470+0000', 'last_undegraded': '2024-09-17T05:41:55.925470+0000', 'last_fullsized': '2024-09-17T05:41:55.925470+0000', 'mapping_epoch': 20, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 20, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:41:55.904533+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:41:55.904533+0000', 'last_clean_scrub_stamp': '2024-09-17T05:41:55.904533+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 1], 'acting': [7, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-17T05:42:01.657 INFO:tasks.ceph.ceph_manager.ceph:PG 2.1 is not active+clean 2024-09-17T05:42:01.657 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '2.1', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 20, 'state': 'creating+peering', 'last_fresh': '2024-09-17T05:41:55.921169+0000', 'last_change': '2024-09-17T05:41:55.921169+0000', 'last_active': '2024-09-17T05:41:55.904533+0000', 'last_peered': '2024-09-17T05:41:55.904533+0000', 'last_clean': '2024-09-17T05:41:55.904533+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:41:55.921169+0000', 'last_undegraded': '2024-09-17T05:41:55.921169+0000', 'last_fullsized': '2024-09-17T05:41:55.921169+0000', 'mapping_epoch': 20, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 20, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:41:55.904533+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:41:55.904533+0000', 'last_clean_scrub_stamp': '2024-09-17T05:41:55.904533+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 3], 'acting': [2, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-17T05:42:01.658 INFO:tasks.ceph.ceph_manager.ceph:PG 3.0 is not active+clean 2024-09-17T05:42:01.658 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.0', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T05:41:56.913963+0000', 'last_change': '2024-09-17T05:41:56.913963+0000', 'last_active': '2024-09-17T05:41:56.913963+0000', 'last_peered': '2024-09-17T05:41:56.913963+0000', 'last_clean': '2024-09-17T05:41:56.913963+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:41:56.913963+0000', 'last_undegraded': '2024-09-17T05:41:56.913963+0000', 'last_fullsized': '2024-09-17T05:41:56.913963+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:41:56.913963+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:41:56.913963+0000', 'last_clean_scrub_stamp': '2024-09-17T05:41:56.913963+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T05:42:01.658 INFO:tasks.ceph.ceph_manager.ceph:PG 2.2 is not active+clean 2024-09-17T05:42:01.658 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '2.2', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 20, 'state': 'creating+peering', 'last_fresh': '2024-09-17T05:41:55.924760+0000', 'last_change': '2024-09-17T05:41:55.924760+0000', 'last_active': '2024-09-17T05:41:55.904533+0000', 'last_peered': '2024-09-17T05:41:55.904533+0000', 'last_clean': '2024-09-17T05:41:55.904533+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:41:55.924760+0000', 'last_undegraded': '2024-09-17T05:41:55.924760+0000', 'last_fullsized': '2024-09-17T05:41:55.924760+0000', 'mapping_epoch': 20, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 20, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:41:55.904533+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:41:55.904533+0000', 'last_clean_scrub_stamp': '2024-09-17T05:41:55.904533+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 1], 'acting': [5, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-17T05:42:01.658 INFO:tasks.ceph.ceph_manager.ceph:PG 3.3 is not active+clean 2024-09-17T05:42:01.658 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.3', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T05:41:56.913963+0000', 'last_change': '2024-09-17T05:41:56.913963+0000', 'last_active': '2024-09-17T05:41:56.913963+0000', 'last_peered': '2024-09-17T05:41:56.913963+0000', 'last_clean': '2024-09-17T05:41:56.913963+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:41:56.913963+0000', 'last_undegraded': '2024-09-17T05:41:56.913963+0000', 'last_fullsized': '2024-09-17T05:41:56.913963+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:41:56.913963+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:41:56.913963+0000', 'last_clean_scrub_stamp': '2024-09-17T05:41:56.913963+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T05:42:01.658 INFO:tasks.ceph.ceph_manager.ceph:PG 2.4 is not active+clean 2024-09-17T05:42:01.658 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '2.4', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 20, 'state': 'creating+peering', 'last_fresh': '2024-09-17T05:41:55.918640+0000', 'last_change': '2024-09-17T05:41:55.918640+0000', 'last_active': '2024-09-17T05:41:55.904533+0000', 'last_peered': '2024-09-17T05:41:55.904533+0000', 'last_clean': '2024-09-17T05:41:55.904533+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:41:55.918640+0000', 'last_undegraded': '2024-09-17T05:41:55.918640+0000', 'last_fullsized': '2024-09-17T05:41:55.918640+0000', 'mapping_epoch': 20, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 20, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:41:55.904533+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:41:55.904533+0000', 'last_clean_scrub_stamp': '2024-09-17T05:41:55.904533+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 0], 'acting': [1, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-17T05:42:01.658 INFO:tasks.ceph.ceph_manager.ceph:PG 3.5 is not active+clean 2024-09-17T05:42:01.658 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.5', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T05:41:56.913963+0000', 'last_change': '2024-09-17T05:41:56.913963+0000', 'last_active': '2024-09-17T05:41:56.913963+0000', 'last_peered': '2024-09-17T05:41:56.913963+0000', 'last_clean': '2024-09-17T05:41:56.913963+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:41:56.913963+0000', 'last_undegraded': '2024-09-17T05:41:56.913963+0000', 'last_fullsized': '2024-09-17T05:41:56.913963+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:41:56.913963+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:41:56.913963+0000', 'last_clean_scrub_stamp': '2024-09-17T05:41:56.913963+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T05:42:01.658 INFO:tasks.ceph.ceph_manager.ceph:PG 2.5 is not active+clean 2024-09-17T05:42:01.658 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '2.5', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 20, 'state': 'creating+peering', 'last_fresh': '2024-09-17T05:41:55.923012+0000', 'last_change': '2024-09-17T05:41:55.923012+0000', 'last_active': '2024-09-17T05:41:55.904533+0000', 'last_peered': '2024-09-17T05:41:55.904533+0000', 'last_clean': '2024-09-17T05:41:55.904533+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:41:55.923012+0000', 'last_undegraded': '2024-09-17T05:41:55.923012+0000', 'last_fullsized': '2024-09-17T05:41:55.923012+0000', 'mapping_epoch': 20, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 20, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:41:55.904533+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:41:55.904533+0000', 'last_clean_scrub_stamp': '2024-09-17T05:41:55.904533+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 0], 'acting': [7, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-17T05:42:01.659 INFO:tasks.ceph.ceph_manager.ceph:PG 3.4 is not active+clean 2024-09-17T05:42:01.659 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.4', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T05:41:56.913963+0000', 'last_change': '2024-09-17T05:41:56.913963+0000', 'last_active': '2024-09-17T05:41:56.913963+0000', 'last_peered': '2024-09-17T05:41:56.913963+0000', 'last_clean': '2024-09-17T05:41:56.913963+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:41:56.913963+0000', 'last_undegraded': '2024-09-17T05:41:56.913963+0000', 'last_fullsized': '2024-09-17T05:41:56.913963+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:41:56.913963+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:41:56.913963+0000', 'last_clean_scrub_stamp': '2024-09-17T05:41:56.913963+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T05:42:01.659 INFO:tasks.ceph.ceph_manager.ceph:PG 2.6 is not active+clean 2024-09-17T05:42:01.659 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '2.6', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 20, 'state': 'creating+peering', 'last_fresh': '2024-09-17T05:41:55.918651+0000', 'last_change': '2024-09-17T05:41:55.918651+0000', 'last_active': '2024-09-17T05:41:55.904533+0000', 'last_peered': '2024-09-17T05:41:55.904533+0000', 'last_clean': '2024-09-17T05:41:55.904533+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:41:55.918651+0000', 'last_undegraded': '2024-09-17T05:41:55.918651+0000', 'last_fullsized': '2024-09-17T05:41:55.918651+0000', 'mapping_epoch': 20, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 20, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:41:55.904533+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:41:55.904533+0000', 'last_clean_scrub_stamp': '2024-09-17T05:41:55.904533+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 6], 'acting': [1, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-17T05:42:01.659 INFO:tasks.ceph.ceph_manager.ceph:PG 3.7 is not active+clean 2024-09-17T05:42:01.659 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.7', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T05:41:56.913963+0000', 'last_change': '2024-09-17T05:41:56.913963+0000', 'last_active': '2024-09-17T05:41:56.913963+0000', 'last_peered': '2024-09-17T05:41:56.913963+0000', 'last_clean': '2024-09-17T05:41:56.913963+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:41:56.913963+0000', 'last_undegraded': '2024-09-17T05:41:56.913963+0000', 'last_fullsized': '2024-09-17T05:41:56.913963+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:41:56.913963+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:41:56.913963+0000', 'last_clean_scrub_stamp': '2024-09-17T05:41:56.913963+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T05:42:01.659 INFO:tasks.ceph.ceph_manager.ceph:PG 2.8 is not active+clean 2024-09-17T05:42:01.659 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '2.8', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 20, 'state': 'creating+peering', 'last_fresh': '2024-09-17T05:41:55.926244+0000', 'last_change': '2024-09-17T05:41:55.926244+0000', 'last_active': '2024-09-17T05:41:55.904533+0000', 'last_peered': '2024-09-17T05:41:55.904533+0000', 'last_clean': '2024-09-17T05:41:55.904533+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:41:55.926244+0000', 'last_undegraded': '2024-09-17T05:41:55.926244+0000', 'last_fullsized': '2024-09-17T05:41:55.926244+0000', 'mapping_epoch': 20, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 20, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:41:55.904533+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:41:55.904533+0000', 'last_clean_scrub_stamp': '2024-09-17T05:41:55.904533+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 0], 'acting': [7, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-17T05:42:01.659 INFO:tasks.ceph.ceph_manager.ceph:PG 3.9 is not active+clean 2024-09-17T05:42:01.659 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.9', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T05:41:56.913963+0000', 'last_change': '2024-09-17T05:41:56.913963+0000', 'last_active': '2024-09-17T05:41:56.913963+0000', 'last_peered': '2024-09-17T05:41:56.913963+0000', 'last_clean': '2024-09-17T05:41:56.913963+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:41:56.913963+0000', 'last_undegraded': '2024-09-17T05:41:56.913963+0000', 'last_fullsized': '2024-09-17T05:41:56.913963+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:41:56.913963+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:41:56.913963+0000', 'last_clean_scrub_stamp': '2024-09-17T05:41:56.913963+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T05:42:01.659 INFO:tasks.ceph.ceph_manager.ceph:PG 2.9 is not active+clean 2024-09-17T05:42:01.659 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '2.9', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 20, 'state': 'creating+peering', 'last_fresh': '2024-09-17T05:41:55.918653+0000', 'last_change': '2024-09-17T05:41:55.918653+0000', 'last_active': '2024-09-17T05:41:55.904533+0000', 'last_peered': '2024-09-17T05:41:55.904533+0000', 'last_clean': '2024-09-17T05:41:55.904533+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:41:55.918653+0000', 'last_undegraded': '2024-09-17T05:41:55.918653+0000', 'last_fullsized': '2024-09-17T05:41:55.918653+0000', 'mapping_epoch': 20, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 20, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:41:55.904533+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:41:55.904533+0000', 'last_clean_scrub_stamp': '2024-09-17T05:41:55.904533+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 7], 'acting': [1, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-17T05:42:01.660 INFO:tasks.ceph.ceph_manager.ceph:PG 3.8 is not active+clean 2024-09-17T05:42:01.660 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.8', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T05:41:56.913963+0000', 'last_change': '2024-09-17T05:41:56.913963+0000', 'last_active': '2024-09-17T05:41:56.913963+0000', 'last_peered': '2024-09-17T05:41:56.913963+0000', 'last_clean': '2024-09-17T05:41:56.913963+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:41:56.913963+0000', 'last_undegraded': '2024-09-17T05:41:56.913963+0000', 'last_fullsized': '2024-09-17T05:41:56.913963+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:41:56.913963+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:41:56.913963+0000', 'last_clean_scrub_stamp': '2024-09-17T05:41:56.913963+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T05:42:01.660 INFO:tasks.ceph.ceph_manager.ceph:PG 2.a is not active+clean 2024-09-17T05:42:01.660 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '2.a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 20, 'state': 'creating+peering', 'last_fresh': '2024-09-17T05:41:55.918638+0000', 'last_change': '2024-09-17T05:41:55.918638+0000', 'last_active': '2024-09-17T05:41:55.904533+0000', 'last_peered': '2024-09-17T05:41:55.904533+0000', 'last_clean': '2024-09-17T05:41:55.904533+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:41:55.918638+0000', 'last_undegraded': '2024-09-17T05:41:55.918638+0000', 'last_fullsized': '2024-09-17T05:41:55.918638+0000', 'mapping_epoch': 20, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 20, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:41:55.904533+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:41:55.904533+0000', 'last_clean_scrub_stamp': '2024-09-17T05:41:55.904533+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 3], 'acting': [1, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-17T05:42:01.660 INFO:tasks.ceph.ceph_manager.ceph:PG 3.b is not active+clean 2024-09-17T05:42:01.660 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T05:41:56.913963+0000', 'last_change': '2024-09-17T05:41:56.913963+0000', 'last_active': '2024-09-17T05:41:56.913963+0000', 'last_peered': '2024-09-17T05:41:56.913963+0000', 'last_clean': '2024-09-17T05:41:56.913963+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:41:56.913963+0000', 'last_undegraded': '2024-09-17T05:41:56.913963+0000', 'last_fullsized': '2024-09-17T05:41:56.913963+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:41:56.913963+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:41:56.913963+0000', 'last_clean_scrub_stamp': '2024-09-17T05:41:56.913963+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T05:42:01.660 INFO:tasks.ceph.ceph_manager.ceph:PG 2.b is not active+clean 2024-09-17T05:42:01.660 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '2.b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 20, 'state': 'creating+peering', 'last_fresh': '2024-09-17T05:41:55.922289+0000', 'last_change': '2024-09-17T05:41:55.922289+0000', 'last_active': '2024-09-17T05:41:55.904533+0000', 'last_peered': '2024-09-17T05:41:55.904533+0000', 'last_clean': '2024-09-17T05:41:55.904533+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:41:55.922289+0000', 'last_undegraded': '2024-09-17T05:41:55.922289+0000', 'last_fullsized': '2024-09-17T05:41:55.922289+0000', 'mapping_epoch': 20, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 20, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:41:55.904533+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:41:55.904533+0000', 'last_clean_scrub_stamp': '2024-09-17T05:41:55.904533+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 4], 'acting': [7, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-17T05:42:01.660 INFO:tasks.ceph.ceph_manager.ceph:PG 3.a is not active+clean 2024-09-17T05:42:01.660 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 21, 'state': 'creating+peering', 'last_fresh': '2024-09-17T05:41:56.934139+0000', 'last_change': '2024-09-17T05:41:56.934139+0000', 'last_active': '2024-09-17T05:41:56.913963+0000', 'last_peered': '2024-09-17T05:41:56.913963+0000', 'last_clean': '2024-09-17T05:41:56.913963+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:41:56.934139+0000', 'last_undegraded': '2024-09-17T05:41:56.934139+0000', 'last_fullsized': '2024-09-17T05:41:56.934139+0000', 'mapping_epoch': 21, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 21, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:41:56.913963+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:41:56.913963+0000', 'last_clean_scrub_stamp': '2024-09-17T05:41:56.913963+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 4], 'acting': [6, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-17T05:42:01.660 INFO:tasks.ceph.ceph_manager.ceph:PG 3.1d is not active+clean 2024-09-17T05:42:01.660 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.1d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T05:41:56.913963+0000', 'last_change': '2024-09-17T05:41:56.913963+0000', 'last_active': '2024-09-17T05:41:56.913963+0000', 'last_peered': '2024-09-17T05:41:56.913963+0000', 'last_clean': '2024-09-17T05:41:56.913963+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:41:56.913963+0000', 'last_undegraded': '2024-09-17T05:41:56.913963+0000', 'last_fullsized': '2024-09-17T05:41:56.913963+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:41:56.913963+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:41:56.913963+0000', 'last_clean_scrub_stamp': '2024-09-17T05:41:56.913963+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T05:42:01.661 INFO:tasks.ceph.ceph_manager.ceph:PG 2.1c is not active+clean 2024-09-17T05:42:01.661 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '2.1c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 20, 'state': 'creating+peering', 'last_fresh': '2024-09-17T05:41:55.922276+0000', 'last_change': '2024-09-17T05:41:55.922276+0000', 'last_active': '2024-09-17T05:41:55.904533+0000', 'last_peered': '2024-09-17T05:41:55.904533+0000', 'last_clean': '2024-09-17T05:41:55.904533+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:41:55.922276+0000', 'last_undegraded': '2024-09-17T05:41:55.922276+0000', 'last_fullsized': '2024-09-17T05:41:55.922276+0000', 'mapping_epoch': 20, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 20, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:41:55.904533+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:41:55.904533+0000', 'last_clean_scrub_stamp': '2024-09-17T05:41:55.904533+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 5], 'acting': [7, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-17T05:42:01.661 INFO:tasks.ceph.ceph_manager.ceph:PG 3.1c is not active+clean 2024-09-17T05:42:01.661 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.1c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T05:41:56.913963+0000', 'last_change': '2024-09-17T05:41:56.913963+0000', 'last_active': '2024-09-17T05:41:56.913963+0000', 'last_peered': '2024-09-17T05:41:56.913963+0000', 'last_clean': '2024-09-17T05:41:56.913963+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:41:56.913963+0000', 'last_undegraded': '2024-09-17T05:41:56.913963+0000', 'last_fullsized': '2024-09-17T05:41:56.913963+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:41:56.913963+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:41:56.913963+0000', 'last_clean_scrub_stamp': '2024-09-17T05:41:56.913963+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T05:42:01.661 INFO:tasks.ceph.ceph_manager.ceph:PG 2.1d is not active+clean 2024-09-17T05:42:01.661 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '2.1d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 20, 'state': 'creating+peering', 'last_fresh': '2024-09-17T05:41:55.923615+0000', 'last_change': '2024-09-17T05:41:55.923615+0000', 'last_active': '2024-09-17T05:41:55.904533+0000', 'last_peered': '2024-09-17T05:41:55.904533+0000', 'last_clean': '2024-09-17T05:41:55.904533+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:41:55.923615+0000', 'last_undegraded': '2024-09-17T05:41:55.923615+0000', 'last_fullsized': '2024-09-17T05:41:55.923615+0000', 'mapping_epoch': 20, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 20, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:41:55.904533+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:41:55.904533+0000', 'last_clean_scrub_stamp': '2024-09-17T05:41:55.904533+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 6], 'acting': [7, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-17T05:42:01.661 INFO:tasks.ceph.ceph_manager.ceph:PG 2.1e is not active+clean 2024-09-17T05:42:01.661 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '2.1e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 20, 'state': 'creating+peering', 'last_fresh': '2024-09-17T05:41:55.921410+0000', 'last_change': '2024-09-17T05:41:55.921410+0000', 'last_active': '2024-09-17T05:41:55.904533+0000', 'last_peered': '2024-09-17T05:41:55.904533+0000', 'last_clean': '2024-09-17T05:41:55.904533+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:41:55.921410+0000', 'last_undegraded': '2024-09-17T05:41:55.921410+0000', 'last_fullsized': '2024-09-17T05:41:55.921410+0000', 'mapping_epoch': 20, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 20, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:41:55.904533+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:41:55.904533+0000', 'last_clean_scrub_stamp': '2024-09-17T05:41:55.904533+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 0], 'acting': [3, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-17T05:42:01.661 INFO:tasks.ceph.ceph_manager.ceph:PG 3.1e is not active+clean 2024-09-17T05:42:01.661 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.1e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T05:41:56.913963+0000', 'last_change': '2024-09-17T05:41:56.913963+0000', 'last_active': '2024-09-17T05:41:56.913963+0000', 'last_peered': '2024-09-17T05:41:56.913963+0000', 'last_clean': '2024-09-17T05:41:56.913963+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:41:56.913963+0000', 'last_undegraded': '2024-09-17T05:41:56.913963+0000', 'last_fullsized': '2024-09-17T05:41:56.913963+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:41:56.913963+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:41:56.913963+0000', 'last_clean_scrub_stamp': '2024-09-17T05:41:56.913963+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T05:42:01.662 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-09-17T05:42:01.797 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:01.796+0000 7f63203c6640 1 -- 172.21.15.150:0/1043342078 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f631809ba60 msgr2=0x7f63180b7330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:01.797 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:01.796+0000 7f63203c6640 1 --2- 172.21.15.150:0/1043342078 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f631809ba60 0x7f63180b7330 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f6314009bb0 tx=0x7f631402a8b0 comp rx=0 tx=0).stop 2024-09-17T05:42:01.797 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:01.796+0000 7f63203c6640 1 -- 172.21.15.150:0/1043342078 shutdown_connections 2024-09-17T05:42:01.797 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:01.796+0000 7f63203c6640 1 --2- 172.21.15.150:0/1043342078 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f63180cd850 0x7f63180d06f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:01.798 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:01.796+0000 7f63203c6640 1 --2- 172.21.15.150:0/1043342078 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f631809ba60 0x7f63180b7330 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:01.798 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:01.796+0000 7f63203c6640 1 -- 172.21.15.150:0/1043342078 >> 172.21.15.150:0/1043342078 conn(0x7f63180cee90 msgr2=0x7f63180cf2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:42:01.798 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:01.796+0000 7f63203c6640 1 -- 172.21.15.150:0/1043342078 shutdown_connections 2024-09-17T05:42:01.798 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:01.796+0000 7f63203c6640 1 -- 172.21.15.150:0/1043342078 wait complete. 2024-09-17T05:42:01.798 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:01.798+0000 7f63203c6640 1 Processor -- start 2024-09-17T05:42:01.799 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:01.798+0000 7f63203c6640 1 -- start start 2024-09-17T05:42:01.801 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:01.799+0000 7f63203c6640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f631809ba60 0x7f63181592a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:42:01.801 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:01.799+0000 7f63203c6640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f63180cd440 0x7f6318164e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:42:01.801 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:01.799+0000 7f63203c6640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f63180cd850 0x7f631809f7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:42:01.801 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:01.799+0000 7f63203c6640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f63180d0db0 con 0x7f63180cd850 2024-09-17T05:42:01.801 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:01.799+0000 7f63203c6640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f63180d0c30 con 0x7f631809ba60 2024-09-17T05:42:01.802 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:01.799+0000 7f63203c6640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f63180d0f30 con 0x7f63180cd440 2024-09-17T05:42:01.802 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:01.800+0000 7f631e963640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f63180cd850 0x7f631809f7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:42:01.802 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:01.800+0000 7f631e963640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f63180cd850 0x7f631809f7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:54380/0 (socket says 172.21.15.150:54380) 2024-09-17T05:42:01.802 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:01.800+0000 7f631e963640 1 -- 172.21.15.150:0/2107346804 learned_addr learned my addr 172.21.15.150:0/2107346804 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:42:01.802 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:01.800+0000 7f631e162640 1 --2- 172.21.15.150:0/2107346804 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f631809ba60 0x7f63181592a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:42:01.802 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:01.800+0000 7f631d961640 1 --2- 172.21.15.150:0/2107346804 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f63180cd440 0x7f6318164e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:42:01.802 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:01.800+0000 7f631e963640 1 -- 172.21.15.150:0/2107346804 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f63180cd440 msgr2=0x7f6318164e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:01.802 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:01.800+0000 7f631e963640 1 --2- 172.21.15.150:0/2107346804 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f63180cd440 0x7f6318164e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:01.802 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:01.800+0000 7f631e963640 1 -- 172.21.15.150:0/2107346804 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f631809ba60 msgr2=0x7f63181592a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:01.802 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:01.800+0000 7f631e963640 1 --2- 172.21.15.150:0/2107346804 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f631809ba60 0x7f63181592a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:01.802 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:01.800+0000 7f631e963640 1 -- 172.21.15.150:0/2107346804 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6318158650 con 0x7f63180cd850 2024-09-17T05:42:01.802 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:01.800+0000 7f631e963640 1 --2- 172.21.15.150:0/2107346804 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f63180cd850 0x7f631809f7f0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f631000d600 tx=0x7f631000dac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:42:01.803 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:01.800+0000 7f630effd640 1 -- 172.21.15.150:0/2107346804 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6310017070 con 0x7f63180cd850 2024-09-17T05:42:01.803 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:01.800+0000 7f630effd640 1 -- 172.21.15.150:0/2107346804 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f6310004310 con 0x7f63180cd850 2024-09-17T05:42:01.803 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:01.800+0000 7f63203c6640 1 -- 172.21.15.150:0/2107346804 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6318159af0 con 0x7f63180cd850 2024-09-17T05:42:01.803 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:01.800+0000 7f630effd640 1 -- 172.21.15.150:0/2107346804 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6310009980 con 0x7f63180cd850 2024-09-17T05:42:01.803 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:01.800+0000 7f63203c6640 1 -- 172.21.15.150:0/2107346804 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f631815a3b0 con 0x7f63180cd850 2024-09-17T05:42:01.804 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:01.801+0000 7f63203c6640 1 -- 172.21.15.150:0/2107346804 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f63180b7330 con 0x7f63180cd850 2024-09-17T05:42:01.804 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:01.802+0000 7f630effd640 1 -- 172.21.15.150:0/2107346804 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f6310009b20 con 0x7f63180cd850 2024-09-17T05:42:01.804 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:01.803+0000 7f630effd640 1 --2- 172.21.15.150:0/2107346804 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f62fc078b90 0x7f62fc07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:42:01.804 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:01.803+0000 7f630effd640 1 -- 172.21.15.150:0/2107346804 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f631009acd0 con 0x7f63180cd850 2024-09-17T05:42:01.804 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:01.803+0000 7f631e162640 1 --2- 172.21.15.150:0/2107346804 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f62fc078b90 0x7f62fc07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:42:01.804 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:01.803+0000 7f631e162640 1 --2- 172.21.15.150:0/2107346804 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f62fc078b90 0x7f62fc07b0a0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f63180cc9c0 tx=0x7f6314004ab0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:42:01.807 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:01.807+0000 7f630effd640 1 -- 172.21.15.150:0/2107346804 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f6310062ac0 con 0x7f63180cd850 2024-09-17T05:42:02.053 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:02.053+0000 7f63203c6640 1 -- 172.21.15.150:0/2107346804 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) -- 0x7f63180b3660 con 0x7f63180cd850 2024-09-17T05:42:02.054 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:02.053+0000 7f630effd640 1 -- 172.21.15.150:0/2107346804 <== mon.0 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) ==== 72+0+1214 (secure 0 0 0) 0x7f63100674f0 con 0x7f63180cd850 2024-09-17T05:42:02.054 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-09-17T05:42:02.054 INFO:teuthology.orchestra.run.smithi150.stdout:{"fsid":"9f2e05e9-d629-47b3-b26b-1360655b7d20","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":29,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":23,"num_osds":8,"num_up_osds":8,"osd_up_since":1726551706,"num_in_osds":8,"osd_in_since":1726551696,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"unknown","count":47},{"state_name":"creating+peering","count":32},{"state_name":"active+clean","count":18}],"num_pgs":97,"num_pools":3,"num_objects":6,"data_bytes":590984,"bytes_used":224399360,"bytes_avail":772869713920,"bytes_total":773094113280,"unknown_pgs_ratio":0.48453608155250549,"inactive_pgs_ratio":0.32989689707756042,"write_bytes_sec":1663,"read_op_per_sec":0,"write_op_per_sec":1},"fsmap":{"epoch":6,"btime":"2024-09-17T05:41:59:940454+0000","id":1,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":1,"rank":0,"name":"d","status":"up:active","gid":4414}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":1,"modified":"2024-09-17T05:41:32.506150+0000","services":{}},"progress_events":{}} 2024-09-17T05:42:02.056 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:02.055+0000 7f63203c6640 1 -- 172.21.15.150:0/2107346804 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f62fc078b90 msgr2=0x7f62fc07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:02.056 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:02.055+0000 7f63203c6640 1 --2- 172.21.15.150:0/2107346804 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f62fc078b90 0x7f62fc07b0a0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f63180cc9c0 tx=0x7f6314004ab0 comp rx=0 tx=0).stop 2024-09-17T05:42:02.056 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:02.055+0000 7f63203c6640 1 -- 172.21.15.150:0/2107346804 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f63180cd850 msgr2=0x7f631809f7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:02.056 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:02.055+0000 7f63203c6640 1 --2- 172.21.15.150:0/2107346804 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f63180cd850 0x7f631809f7f0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f631000d600 tx=0x7f631000dac0 comp rx=0 tx=0).stop 2024-09-17T05:42:02.056 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:02.055+0000 7f63203c6640 1 -- 172.21.15.150:0/2107346804 shutdown_connections 2024-09-17T05:42:02.057 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:02.055+0000 7f63203c6640 1 --2- 172.21.15.150:0/2107346804 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f62fc078b90 0x7f62fc07b0a0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:02.057 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:02.055+0000 7f63203c6640 1 --2- 172.21.15.150:0/2107346804 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f63180cd850 0x7f631809f7f0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:02.057 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:02.055+0000 7f63203c6640 1 --2- 172.21.15.150:0/2107346804 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f63180cd440 0x7f6318164e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:02.057 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:02.055+0000 7f63203c6640 1 --2- 172.21.15.150:0/2107346804 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f631809ba60 0x7f63181592a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:02.057 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:02.055+0000 7f63203c6640 1 -- 172.21.15.150:0/2107346804 >> 172.21.15.150:0/2107346804 conn(0x7f63180cee90 msgr2=0x7f631815d650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:42:02.057 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:02.055+0000 7f63203c6640 1 -- 172.21.15.150:0/2107346804 shutdown_connections 2024-09-17T05:42:02.057 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:02.055+0000 7f63203c6640 1 -- 172.21.15.150:0/2107346804 wait complete. 2024-09-17T05:42:02.067 INFO:tasks.ceph.ceph_manager.ceph:no progress seen, keeping timeout for now 2024-09-17T05:42:02.067 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-17T05:42:02.181 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:02.180+0000 7f02a8f57640 1 -- 172.21.15.150:0/3817300854 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0290004df0 msgr2=0x7f02900052c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:02.181 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:02.180+0000 7f02a8f57640 1 --2- 172.21.15.150:0/3817300854 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0290004df0 0x7f02900052c0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f02a409be60 tx=0x7f0290005830 comp rx=0 tx=0).stop 2024-09-17T05:42:02.181 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:02.180+0000 7f02a2d9d640 1 -- 172.21.15.150:0/3817300854 reap_dead start 2024-09-17T05:42:02.181 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:02.180+0000 7f02a8f57640 1 -- 172.21.15.150:0/3817300854 shutdown_connections 2024-09-17T05:42:02.181 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:02.180+0000 7f02a8f57640 1 -- 172.21.15.150:0/3817300854 >> 172.21.15.150:0/3817300854 conn(0x7f02a40cef10 msgr2=0x7f02a40cf320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:42:02.181 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:02.180+0000 7f02a8f57640 1 -- 172.21.15.150:0/3817300854 shutdown_connections 2024-09-17T05:42:02.181 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:02.180+0000 7f02a8f57640 1 -- 172.21.15.150:0/3817300854 wait complete. 2024-09-17T05:42:02.182 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:02.182+0000 7f02a8f57640 1 Processor -- start 2024-09-17T05:42:02.182 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:02.182+0000 7f02a8f57640 1 -- start start 2024-09-17T05:42:02.185 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:02.183+0000 7f02a8f57640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0290004df0 0x7f02a40b0910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:42:02.185 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:02.183+0000 7f02a8f57640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f02a40af160 0x7f02a40af570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:42:02.185 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:02.183+0000 7f02a8f57640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f02a40afab0 0x7f02a41e8a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:42:02.186 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:02.183+0000 7f02a8f57640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f02a40d2270 con 0x7f02a40afab0 2024-09-17T05:42:02.186 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:02.183+0000 7f02a8f57640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f02a40d20f0 con 0x7f02a40af160 2024-09-17T05:42:02.186 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:02.183+0000 7f02a8f57640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f02a40d0240 con 0x7f0290004df0 2024-09-17T05:42:02.186 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:02.183+0000 7f02a2d9d640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f02a40afab0 0x7f02a41e8a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:42:02.186 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:02.183+0000 7f02a2d9d640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f02a40afab0 0x7f02a41e8a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:54388/0 (socket says 172.21.15.150:54388) 2024-09-17T05:42:02.186 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:02.183+0000 7f02a2d9d640 1 -- 172.21.15.150:0/3510666812 learned_addr learned my addr 172.21.15.150:0/3510666812 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:42:02.186 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:02.183+0000 7f0299d9b640 1 --2- 172.21.15.150:0/3510666812 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f02a40af160 0x7f02a40af570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:42:02.186 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:02.183+0000 7f02a259c640 1 --2- 172.21.15.150:0/3510666812 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0290004df0 0x7f02a40b0910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:42:02.186 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:02.184+0000 7f02a2d9d640 1 -- 172.21.15.150:0/3510666812 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0290004df0 msgr2=0x7f02a40b0910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:02.186 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:02.184+0000 7f02a2d9d640 1 --2- 172.21.15.150:0/3510666812 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0290004df0 0x7f02a40b0910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:02.186 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:02.184+0000 7f02a2d9d640 1 -- 172.21.15.150:0/3510666812 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f02a40af160 msgr2=0x7f02a40af570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:02.186 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:02.184+0000 7f02a2d9d640 1 --2- 172.21.15.150:0/3510666812 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f02a40af160 0x7f02a40af570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:02.187 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:02.184+0000 7f02a2d9d640 1 -- 172.21.15.150:0/3510666812 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f02a41f46a0 con 0x7f02a40afab0 2024-09-17T05:42:02.187 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:02.184+0000 7f02a2d9d640 1 --2- 172.21.15.150:0/3510666812 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f02a40afab0 0x7f02a41e8a80 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f029c00c2f0 tx=0x7f029c004a10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:42:02.187 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:02.184+0000 7f029b7fe640 1 -- 172.21.15.150:0/3510666812 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f029c00c360 con 0x7f02a40afab0 2024-09-17T05:42:02.187 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:02.184+0000 7f029b7fe640 1 -- 172.21.15.150:0/3510666812 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f029c02b8e0 con 0x7f02a40afab0 2024-09-17T05:42:02.187 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:02.184+0000 7f02a8f57640 1 -- 172.21.15.150:0/3510666812 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f02a40ca320 con 0x7f02a40afab0 2024-09-17T05:42:02.187 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:02.184+0000 7f029b7fe640 1 -- 172.21.15.150:0/3510666812 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f029c02bd30 con 0x7f02a40afab0 2024-09-17T05:42:02.187 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:02.184+0000 7f02a8f57640 1 -- 172.21.15.150:0/3510666812 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f02a40c9840 con 0x7f02a40afab0 2024-09-17T05:42:02.187 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:02.185+0000 7f02a8f57640 1 -- 172.21.15.150:0/3510666812 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f02a40cd010 con 0x7f02a40afab0 2024-09-17T05:42:02.188 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:02.186+0000 7f029b7fe640 1 -- 172.21.15.150:0/3510666812 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f029c006030 con 0x7f02a40afab0 2024-09-17T05:42:02.188 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:02.186+0000 7f029b7fe640 1 --2- 172.21.15.150:0/3510666812 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f0284078b90 0x7f028407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:42:02.188 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:02.186+0000 7f029b7fe640 1 -- 172.21.15.150:0/3510666812 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f029c03d020 con 0x7f02a40afab0 2024-09-17T05:42:02.188 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:02.187+0000 7f02a259c640 1 --2- 172.21.15.150:0/3510666812 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f0284078b90 0x7f028407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:42:02.188 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:02.187+0000 7f02a259c640 1 --2- 172.21.15.150:0/3510666812 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f0284078b90 0x7f028407b0a0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f0294009c50 tx=0x7f0294005f90 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:42:02.191 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:02.191+0000 7f029b7fe640 1 -- 172.21.15.150:0/3510666812 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f029c0bce20 con 0x7f02a40afab0 2024-09-17T05:42:02.362 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:02.361+0000 7f02a8f57640 1 -- 172.21.15.150:0/3510666812 --> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f02a41f41e0 con 0x7f0284078b90 2024-09-17T05:42:02.366 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:02.366+0000 7f029b7fe640 1 -- 172.21.15.150:0/3510666812 <== mgr.4108 v2:172.21.15.176:6800/3631216395 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+242492 (secure 0 0 0) 0x7f029405c350 con 0x7f0284078b90 2024-09-17T05:42:02.369 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-09-17T05:42:02.370 INFO:teuthology.orchestra.run.smithi150.stderr:dumped all 2024-09-17T05:42:02.372 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:02.369+0000 7f02a8f57640 1 -- 172.21.15.150:0/3510666812 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f0284078b90 msgr2=0x7f028407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:02.372 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:02.369+0000 7f02a8f57640 1 --2- 172.21.15.150:0/3510666812 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f0284078b90 0x7f028407b0a0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f0294009c50 tx=0x7f0294005f90 comp rx=0 tx=0).stop 2024-09-17T05:42:02.372 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:02.369+0000 7f02a8f57640 1 -- 172.21.15.150:0/3510666812 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f02a40afab0 msgr2=0x7f02a41e8a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:02.372 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:02.369+0000 7f02a8f57640 1 --2- 172.21.15.150:0/3510666812 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f02a40afab0 0x7f02a41e8a80 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f029c00c2f0 tx=0x7f029c004a10 comp rx=0 tx=0).stop 2024-09-17T05:42:02.372 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:02.369+0000 7f02a8f57640 1 -- 172.21.15.150:0/3510666812 shutdown_connections 2024-09-17T05:42:02.372 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:02.369+0000 7f02a8f57640 1 --2- 172.21.15.150:0/3510666812 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f02a40af160 0x7f02a40af570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:02.373 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:02.369+0000 7f02a8f57640 1 --2- 172.21.15.150:0/3510666812 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f0284078b90 0x7f028407b0a0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:02.373 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:02.369+0000 7f02a8f57640 1 --2- 172.21.15.150:0/3510666812 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f02a40afab0 0x7f02a41e8a80 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:02.373 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:02.369+0000 7f02a8f57640 1 --2- 172.21.15.150:0/3510666812 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0290004df0 0x7f02a40b0910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:02.373 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:02.369+0000 7f02a8f57640 1 -- 172.21.15.150:0/3510666812 >> 172.21.15.150:0/3510666812 conn(0x7f02a40cef10 msgr2=0x7f02a4068e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:42:02.373 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:02.369+0000 7f02a8f57640 1 -- 172.21.15.150:0/3510666812 shutdown_connections 2024-09-17T05:42:02.373 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:02.369+0000 7f02a8f57640 1 -- 172.21.15.150:0/3510666812 wait complete. 2024-09-17T05:42:02.381 INFO:teuthology.orchestra.run.smithi150.stdout:{"pg_ready":true,"pg_map":{"version":25,"stamp":"2024-09-17T05:42:00.844629+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590984,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":108,"num_write_kb":1636,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":78,"ondisk_log_size":78,"up":100,"acting":100,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":22,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219140,"kb_used_data":2652,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755580,"statfs":{"total":773094113280,"available":772869713920,"internally_reserved":0,"allocated":2715648,"data_stored":1658722,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":14,"apply_latency_ms":14,"commit_latency_ns":14000000,"apply_latency_ns":14000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":616,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.925201"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:41:56.913963+0000","last_change":"2024-09-17T05:41:56.913963+0000","last_active":"2024-09-17T05:41:56.913963+0000","last_peered":"2024-09-17T05:41:56.913963+0000","last_clean":"2024-09-17T05:41:56.913963+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:41:56.913963+0000","last_undegraded":"2024-09-17T05:41:56.913963+0000","last_fullsized":"2024-09-17T05:41:56.913963+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_clean_scrub_stamp":"2024-09-17T05:41:56.913963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:41:56.913963+0000","last_change":"2024-09-17T05:41:56.913963+0000","last_active":"2024-09-17T05:41:56.913963+0000","last_peered":"2024-09-17T05:41:56.913963+0000","last_clean":"2024-09-17T05:41:56.913963+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:41:56.913963+0000","last_undegraded":"2024-09-17T05:41:56.913963+0000","last_fullsized":"2024-09-17T05:41:56.913963+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_clean_scrub_stamp":"2024-09-17T05:41:56.913963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T05:41:57.946892+0000","last_change":"2024-09-17T05:41:57.935841+0000","last_active":"2024-09-17T05:41:57.946892+0000","last_peered":"2024-09-17T05:41:57.946892+0000","last_clean":"2024-09-17T05:41:57.946892+0000","last_became_active":"2024-09-17T05:41:57.935502+0000","last_became_peered":"2024-09-17T05:41:57.935502+0000","last_unstale":"2024-09-17T05:41:57.946892+0000","last_undegraded":"2024-09-17T05:41:57.946892+0000","last_fullsized":"2024-09-17T05:41:57.946892+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_clean_scrub_stamp":"2024-09-17T05:41:56.913963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:18:37.706664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:41:56.913963+0000","last_change":"2024-09-17T05:41:56.913963+0000","last_active":"2024-09-17T05:41:56.913963+0000","last_peered":"2024-09-17T05:41:56.913963+0000","last_clean":"2024-09-17T05:41:56.913963+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:41:56.913963+0000","last_undegraded":"2024-09-17T05:41:56.913963+0000","last_fullsized":"2024-09-17T05:41:56.913963+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_clean_scrub_stamp":"2024-09-17T05:41:56.913963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:41:56.913963+0000","last_change":"2024-09-17T05:41:56.913963+0000","last_active":"2024-09-17T05:41:56.913963+0000","last_peered":"2024-09-17T05:41:56.913963+0000","last_clean":"2024-09-17T05:41:56.913963+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:41:56.913963+0000","last_undegraded":"2024-09-17T05:41:56.913963+0000","last_fullsized":"2024-09-17T05:41:56.913963+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_clean_scrub_stamp":"2024-09-17T05:41:56.913963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:41:56.913963+0000","last_change":"2024-09-17T05:41:56.913963+0000","last_active":"2024-09-17T05:41:56.913963+0000","last_peered":"2024-09-17T05:41:56.913963+0000","last_clean":"2024-09-17T05:41:56.913963+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:41:56.913963+0000","last_undegraded":"2024-09-17T05:41:56.913963+0000","last_fullsized":"2024-09-17T05:41:56.913963+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_clean_scrub_stamp":"2024-09-17T05:41:56.913963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:41:56.913963+0000","last_change":"2024-09-17T05:41:56.913963+0000","last_active":"2024-09-17T05:41:56.913963+0000","last_peered":"2024-09-17T05:41:56.913963+0000","last_clean":"2024-09-17T05:41:56.913963+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:41:56.913963+0000","last_undegraded":"2024-09-17T05:41:56.913963+0000","last_fullsized":"2024-09-17T05:41:56.913963+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_clean_scrub_stamp":"2024-09-17T05:41:56.913963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:41:56.913963+0000","last_change":"2024-09-17T05:41:56.913963+0000","last_active":"2024-09-17T05:41:56.913963+0000","last_peered":"2024-09-17T05:41:56.913963+0000","last_clean":"2024-09-17T05:41:56.913963+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:41:56.913963+0000","last_undegraded":"2024-09-17T05:41:56.913963+0000","last_fullsized":"2024-09-17T05:41:56.913963+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_clean_scrub_stamp":"2024-09-17T05:41:56.913963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:41:56.913963+0000","last_change":"2024-09-17T05:41:56.913963+0000","last_active":"2024-09-17T05:41:56.913963+0000","last_peered":"2024-09-17T05:41:56.913963+0000","last_clean":"2024-09-17T05:41:56.913963+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:41:56.913963+0000","last_undegraded":"2024-09-17T05:41:56.913963+0000","last_fullsized":"2024-09-17T05:41:56.913963+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_clean_scrub_stamp":"2024-09-17T05:41:56.913963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-17T05:41:56.938399+0000","last_change":"2024-09-17T05:41:56.938399+0000","last_active":"2024-09-17T05:41:56.913963+0000","last_peered":"2024-09-17T05:41:56.913963+0000","last_clean":"2024-09-17T05:41:56.913963+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:41:56.938399+0000","last_undegraded":"2024-09-17T05:41:56.938399+0000","last_fullsized":"2024-09-17T05:41:56.938399+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_clean_scrub_stamp":"2024-09-17T05:41:56.913963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-17T05:41:56.935343+0000","last_change":"2024-09-17T05:41:56.935343+0000","last_active":"2024-09-17T05:41:56.913963+0000","last_peered":"2024-09-17T05:41:56.913963+0000","last_clean":"2024-09-17T05:41:56.913963+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:41:56.935343+0000","last_undegraded":"2024-09-17T05:41:56.935343+0000","last_fullsized":"2024-09-17T05:41:56.935343+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_clean_scrub_stamp":"2024-09-17T05:41:56.913963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:41:56.913963+0000","last_change":"2024-09-17T05:41:56.913963+0000","last_active":"2024-09-17T05:41:56.913963+0000","last_peered":"2024-09-17T05:41:56.913963+0000","last_clean":"2024-09-17T05:41:56.913963+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:41:56.913963+0000","last_undegraded":"2024-09-17T05:41:56.913963+0000","last_fullsized":"2024-09-17T05:41:56.913963+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_clean_scrub_stamp":"2024-09-17T05:41:56.913963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:41:56.913963+0000","last_change":"2024-09-17T05:41:56.913963+0000","last_active":"2024-09-17T05:41:56.913963+0000","last_peered":"2024-09-17T05:41:56.913963+0000","last_clean":"2024-09-17T05:41:56.913963+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:41:56.913963+0000","last_undegraded":"2024-09-17T05:41:56.913963+0000","last_fullsized":"2024-09-17T05:41:56.913963+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_clean_scrub_stamp":"2024-09-17T05:41:56.913963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T05:41:57.958581+0000","last_change":"2024-09-17T05:41:57.950142+0000","last_active":"2024-09-17T05:41:57.958581+0000","last_peered":"2024-09-17T05:41:57.958581+0000","last_clean":"2024-09-17T05:41:57.958581+0000","last_became_active":"2024-09-17T05:41:57.949825+0000","last_became_peered":"2024-09-17T05:41:57.949825+0000","last_unstale":"2024-09-17T05:41:57.958581+0000","last_undegraded":"2024-09-17T05:41:57.958581+0000","last_fullsized":"2024-09-17T05:41:57.958581+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_clean_scrub_stamp":"2024-09-17T05:41:56.913963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:03:45.612206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:41:56.913963+0000","last_change":"2024-09-17T05:41:56.913963+0000","last_active":"2024-09-17T05:41:56.913963+0000","last_peered":"2024-09-17T05:41:56.913963+0000","last_clean":"2024-09-17T05:41:56.913963+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:41:56.913963+0000","last_undegraded":"2024-09-17T05:41:56.913963+0000","last_fullsized":"2024-09-17T05:41:56.913963+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_clean_scrub_stamp":"2024-09-17T05:41:56.913963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:41:56.913963+0000","last_change":"2024-09-17T05:41:56.913963+0000","last_active":"2024-09-17T05:41:56.913963+0000","last_peered":"2024-09-17T05:41:56.913963+0000","last_clean":"2024-09-17T05:41:56.913963+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:41:56.913963+0000","last_undegraded":"2024-09-17T05:41:56.913963+0000","last_fullsized":"2024-09-17T05:41:56.913963+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_clean_scrub_stamp":"2024-09-17T05:41:56.913963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:41:56.913963+0000","last_change":"2024-09-17T05:41:56.913963+0000","last_active":"2024-09-17T05:41:56.913963+0000","last_peered":"2024-09-17T05:41:56.913963+0000","last_clean":"2024-09-17T05:41:56.913963+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:41:56.913963+0000","last_undegraded":"2024-09-17T05:41:56.913963+0000","last_fullsized":"2024-09-17T05:41:56.913963+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_clean_scrub_stamp":"2024-09-17T05:41:56.913963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:41:56.913963+0000","last_change":"2024-09-17T05:41:56.913963+0000","last_active":"2024-09-17T05:41:56.913963+0000","last_peered":"2024-09-17T05:41:56.913963+0000","last_clean":"2024-09-17T05:41:56.913963+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:41:56.913963+0000","last_undegraded":"2024-09-17T05:41:56.913963+0000","last_fullsized":"2024-09-17T05:41:56.913963+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_clean_scrub_stamp":"2024-09-17T05:41:56.913963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:41:56.913963+0000","last_change":"2024-09-17T05:41:56.913963+0000","last_active":"2024-09-17T05:41:56.913963+0000","last_peered":"2024-09-17T05:41:56.913963+0000","last_clean":"2024-09-17T05:41:56.913963+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:41:56.913963+0000","last_undegraded":"2024-09-17T05:41:56.913963+0000","last_fullsized":"2024-09-17T05:41:56.913963+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_clean_scrub_stamp":"2024-09-17T05:41:56.913963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-17T05:41:56.933458+0000","last_change":"2024-09-17T05:41:56.933458+0000","last_active":"2024-09-17T05:41:56.913963+0000","last_peered":"2024-09-17T05:41:56.913963+0000","last_clean":"2024-09-17T05:41:56.913963+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:41:56.933458+0000","last_undegraded":"2024-09-17T05:41:56.933458+0000","last_fullsized":"2024-09-17T05:41:56.933458+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_clean_scrub_stamp":"2024-09-17T05:41:56.913963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T05:41:57.960003+0000","last_change":"2024-09-17T05:41:57.952830+0000","last_active":"2024-09-17T05:41:57.960003+0000","last_peered":"2024-09-17T05:41:57.960003+0000","last_clean":"2024-09-17T05:41:57.960003+0000","last_became_active":"2024-09-17T05:41:57.952504+0000","last_became_peered":"2024-09-17T05:41:57.952504+0000","last_unstale":"2024-09-17T05:41:57.960003+0000","last_undegraded":"2024-09-17T05:41:57.960003+0000","last_fullsized":"2024-09-17T05:41:57.960003+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_clean_scrub_stamp":"2024-09-17T05:41:56.913963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:54:59.834514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:41:56.913963+0000","last_change":"2024-09-17T05:41:56.913963+0000","last_active":"2024-09-17T05:41:56.913963+0000","last_peered":"2024-09-17T05:41:56.913963+0000","last_clean":"2024-09-17T05:41:56.913963+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:41:56.913963+0000","last_undegraded":"2024-09-17T05:41:56.913963+0000","last_fullsized":"2024-09-17T05:41:56.913963+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_clean_scrub_stamp":"2024-09-17T05:41:56.913963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:41:56.913963+0000","last_change":"2024-09-17T05:41:56.913963+0000","last_active":"2024-09-17T05:41:56.913963+0000","last_peered":"2024-09-17T05:41:56.913963+0000","last_clean":"2024-09-17T05:41:56.913963+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:41:56.913963+0000","last_undegraded":"2024-09-17T05:41:56.913963+0000","last_fullsized":"2024-09-17T05:41:56.913963+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_clean_scrub_stamp":"2024-09-17T05:41:56.913963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:41:56.913963+0000","last_change":"2024-09-17T05:41:56.913963+0000","last_active":"2024-09-17T05:41:56.913963+0000","last_peered":"2024-09-17T05:41:56.913963+0000","last_clean":"2024-09-17T05:41:56.913963+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:41:56.913963+0000","last_undegraded":"2024-09-17T05:41:56.913963+0000","last_fullsized":"2024-09-17T05:41:56.913963+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_clean_scrub_stamp":"2024-09-17T05:41:56.913963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:41:56.913963+0000","last_change":"2024-09-17T05:41:56.913963+0000","last_active":"2024-09-17T05:41:56.913963+0000","last_peered":"2024-09-17T05:41:56.913963+0000","last_clean":"2024-09-17T05:41:56.913963+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:41:56.913963+0000","last_undegraded":"2024-09-17T05:41:56.913963+0000","last_fullsized":"2024-09-17T05:41:56.913963+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_clean_scrub_stamp":"2024-09-17T05:41:56.913963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-17T05:41:56.936595+0000","last_change":"2024-09-17T05:41:56.936595+0000","last_active":"2024-09-17T05:41:56.913963+0000","last_peered":"2024-09-17T05:41:56.913963+0000","last_clean":"2024-09-17T05:41:56.913963+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:41:56.936595+0000","last_undegraded":"2024-09-17T05:41:56.936595+0000","last_fullsized":"2024-09-17T05:41:56.936595+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_clean_scrub_stamp":"2024-09-17T05:41:56.913963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:41:56.913963+0000","last_change":"2024-09-17T05:41:56.913963+0000","last_active":"2024-09-17T05:41:56.913963+0000","last_peered":"2024-09-17T05:41:56.913963+0000","last_clean":"2024-09-17T05:41:56.913963+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:41:56.913963+0000","last_undegraded":"2024-09-17T05:41:56.913963+0000","last_fullsized":"2024-09-17T05:41:56.913963+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_clean_scrub_stamp":"2024-09-17T05:41:56.913963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:41:56.913963+0000","last_change":"2024-09-17T05:41:56.913963+0000","last_active":"2024-09-17T05:41:56.913963+0000","last_peered":"2024-09-17T05:41:56.913963+0000","last_clean":"2024-09-17T05:41:56.913963+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:41:56.913963+0000","last_undegraded":"2024-09-17T05:41:56.913963+0000","last_fullsized":"2024-09-17T05:41:56.913963+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_clean_scrub_stamp":"2024-09-17T05:41:56.913963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T05:41:57.958478+0000","last_change":"2024-09-17T05:41:57.948114+0000","last_active":"2024-09-17T05:41:57.958478+0000","last_peered":"2024-09-17T05:41:57.958478+0000","last_clean":"2024-09-17T05:41:57.958478+0000","last_became_active":"2024-09-17T05:41:57.947671+0000","last_became_peered":"2024-09-17T05:41:57.947671+0000","last_unstale":"2024-09-17T05:41:57.958478+0000","last_undegraded":"2024-09-17T05:41:57.958478+0000","last_fullsized":"2024-09-17T05:41:57.958478+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_clean_scrub_stamp":"2024-09-17T05:41:56.913963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:04:06.812125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:41:56.913963+0000","last_change":"2024-09-17T05:41:56.913963+0000","last_active":"2024-09-17T05:41:56.913963+0000","last_peered":"2024-09-17T05:41:56.913963+0000","last_clean":"2024-09-17T05:41:56.913963+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:41:56.913963+0000","last_undegraded":"2024-09-17T05:41:56.913963+0000","last_fullsized":"2024-09-17T05:41:56.913963+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_clean_scrub_stamp":"2024-09-17T05:41:56.913963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:41:56.913963+0000","last_change":"2024-09-17T05:41:56.913963+0000","last_active":"2024-09-17T05:41:56.913963+0000","last_peered":"2024-09-17T05:41:56.913963+0000","last_clean":"2024-09-17T05:41:56.913963+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:41:56.913963+0000","last_undegraded":"2024-09-17T05:41:56.913963+0000","last_fullsized":"2024-09-17T05:41:56.913963+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_clean_scrub_stamp":"2024-09-17T05:41:56.913963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-17T05:41:56.933616+0000","last_change":"2024-09-17T05:41:56.933616+0000","last_active":"2024-09-17T05:41:56.913963+0000","last_peered":"2024-09-17T05:41:56.913963+0000","last_clean":"2024-09-17T05:41:56.913963+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:41:56.933616+0000","last_undegraded":"2024-09-17T05:41:56.933616+0000","last_fullsized":"2024-09-17T05:41:56.933616+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_clean_scrub_stamp":"2024-09-17T05:41:56.913963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:41:56.913963+0000","last_change":"2024-09-17T05:41:56.913963+0000","last_active":"2024-09-17T05:41:56.913963+0000","last_peered":"2024-09-17T05:41:56.913963+0000","last_clean":"2024-09-17T05:41:56.913963+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:41:56.913963+0000","last_undegraded":"2024-09-17T05:41:56.913963+0000","last_fullsized":"2024-09-17T05:41:56.913963+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_clean_scrub_stamp":"2024-09-17T05:41:56.913963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1b","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-09-17T05:41:55.922157+0000","last_change":"2024-09-17T05:41:55.922157+0000","last_active":"2024-09-17T05:41:55.904533+0000","last_peered":"2024-09-17T05:41:55.904533+0000","last_clean":"2024-09-17T05:41:55.904533+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:41:55.922157+0000","last_undegraded":"2024-09-17T05:41:55.922157+0000","last_fullsized":"2024-09-17T05:41:55.922157+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:55.904533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:55.904533+0000","last_clean_scrub_stamp":"2024-09-17T05:41:55.904533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T05:41:57.947971+0000","last_change":"2024-09-17T05:41:57.943603+0000","last_active":"2024-09-17T05:41:57.947971+0000","last_peered":"2024-09-17T05:41:57.947971+0000","last_clean":"2024-09-17T05:41:57.947971+0000","last_became_active":"2024-09-17T05:41:57.942873+0000","last_became_peered":"2024-09-17T05:41:57.942873+0000","last_unstale":"2024-09-17T05:41:57.947971+0000","last_undegraded":"2024-09-17T05:41:57.947971+0000","last_fullsized":"2024-09-17T05:41:57.947971+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_clean_scrub_stamp":"2024-09-17T05:41:56.913963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:05:08.948164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:41:56.945810+0000","last_change":"2024-09-17T05:41:56.940706+0000","last_active":"2024-09-17T05:41:56.945810+0000","last_peered":"2024-09-17T05:41:56.945810+0000","last_clean":"2024-09-17T05:41:56.945810+0000","last_became_active":"2024-09-17T05:41:56.940324+0000","last_became_peered":"2024-09-17T05:41:56.940324+0000","last_unstale":"2024-09-17T05:41:56.945810+0000","last_undegraded":"2024-09-17T05:41:56.945810+0000","last_fullsized":"2024-09-17T05:41:56.945810+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:55.904533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:55.904533+0000","last_clean_scrub_stamp":"2024-09-17T05:41:55.904533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:39:10.329477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-09-17T05:41:55.922588+0000","last_change":"2024-09-17T05:41:55.922588+0000","last_active":"2024-09-17T05:41:55.904533+0000","last_peered":"2024-09-17T05:41:55.904533+0000","last_clean":"2024-09-17T05:41:55.904533+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:41:55.922588+0000","last_undegraded":"2024-09-17T05:41:55.922588+0000","last_fullsized":"2024-09-17T05:41:55.922588+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:55.904533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:55.904533+0000","last_clean_scrub_stamp":"2024-09-17T05:41:55.904533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:41:56.913963+0000","last_change":"2024-09-17T05:41:56.913963+0000","last_active":"2024-09-17T05:41:56.913963+0000","last_peered":"2024-09-17T05:41:56.913963+0000","last_clean":"2024-09-17T05:41:56.913963+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:41:56.913963+0000","last_undegraded":"2024-09-17T05:41:56.913963+0000","last_fullsized":"2024-09-17T05:41:56.913963+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_clean_scrub_stamp":"2024-09-17T05:41:56.913963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-09-17T05:41:55.922741+0000","last_change":"2024-09-17T05:41:55.922741+0000","last_active":"2024-09-17T05:41:55.904533+0000","last_peered":"2024-09-17T05:41:55.904533+0000","last_clean":"2024-09-17T05:41:55.904533+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:41:55.922741+0000","last_undegraded":"2024-09-17T05:41:55.922741+0000","last_fullsized":"2024-09-17T05:41:55.922741+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:55.904533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:55.904533+0000","last_clean_scrub_stamp":"2024-09-17T05:41:55.904533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:41:56.913963+0000","last_change":"2024-09-17T05:41:56.913963+0000","last_active":"2024-09-17T05:41:56.913963+0000","last_peered":"2024-09-17T05:41:56.913963+0000","last_clean":"2024-09-17T05:41:56.913963+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:41:56.913963+0000","last_undegraded":"2024-09-17T05:41:56.913963+0000","last_fullsized":"2024-09-17T05:41:56.913963+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_clean_scrub_stamp":"2024-09-17T05:41:56.913963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:41:56.954501+0000","last_change":"2024-09-17T05:41:56.949682+0000","last_active":"2024-09-17T05:41:56.954501+0000","last_peered":"2024-09-17T05:41:56.954501+0000","last_clean":"2024-09-17T05:41:56.954501+0000","last_became_active":"2024-09-17T05:41:56.949271+0000","last_became_peered":"2024-09-17T05:41:56.949271+0000","last_unstale":"2024-09-17T05:41:56.954501+0000","last_undegraded":"2024-09-17T05:41:56.954501+0000","last_fullsized":"2024-09-17T05:41:56.954501+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:55.904533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:55.904533+0000","last_clean_scrub_stamp":"2024-09-17T05:41:55.904533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:09:34.572426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:41:56.913963+0000","last_change":"2024-09-17T05:41:56.913963+0000","last_active":"2024-09-17T05:41:56.913963+0000","last_peered":"2024-09-17T05:41:56.913963+0000","last_clean":"2024-09-17T05:41:56.913963+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:41:56.913963+0000","last_undegraded":"2024-09-17T05:41:56.913963+0000","last_fullsized":"2024-09-17T05:41:56.913963+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_clean_scrub_stamp":"2024-09-17T05:41:56.913963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-09-17T05:41:55.924578+0000","last_change":"2024-09-17T05:41:55.924578+0000","last_active":"2024-09-17T05:41:55.904533+0000","last_peered":"2024-09-17T05:41:55.904533+0000","last_clean":"2024-09-17T05:41:55.904533+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:41:55.924578+0000","last_undegraded":"2024-09-17T05:41:55.924578+0000","last_fullsized":"2024-09-17T05:41:55.924578+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:55.904533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:55.904533+0000","last_clean_scrub_stamp":"2024-09-17T05:41:55.904533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T05:41:57.958506+0000","last_change":"2024-09-17T05:41:57.948150+0000","last_active":"2024-09-17T05:41:57.958506+0000","last_peered":"2024-09-17T05:41:57.958506+0000","last_clean":"2024-09-17T05:41:57.958506+0000","last_became_active":"2024-09-17T05:41:57.947204+0000","last_became_peered":"2024-09-17T05:41:57.947204+0000","last_unstale":"2024-09-17T05:41:57.958506+0000","last_undegraded":"2024-09-17T05:41:57.958506+0000","last_fullsized":"2024-09-17T05:41:57.958506+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_clean_scrub_stamp":"2024-09-17T05:41:56.913963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:06:52.563709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-09-17T05:41:55.919928+0000","last_change":"2024-09-17T05:41:55.919928+0000","last_active":"2024-09-17T05:41:55.904533+0000","last_peered":"2024-09-17T05:41:55.904533+0000","last_clean":"2024-09-17T05:41:55.904533+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:41:55.919928+0000","last_undegraded":"2024-09-17T05:41:55.919928+0000","last_fullsized":"2024-09-17T05:41:55.919928+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:55.904533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:55.904533+0000","last_clean_scrub_stamp":"2024-09-17T05:41:55.904533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:41:56.913963+0000","last_change":"2024-09-17T05:41:56.913963+0000","last_active":"2024-09-17T05:41:56.913963+0000","last_peered":"2024-09-17T05:41:56.913963+0000","last_clean":"2024-09-17T05:41:56.913963+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:41:56.913963+0000","last_undegraded":"2024-09-17T05:41:56.913963+0000","last_fullsized":"2024-09-17T05:41:56.913963+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_clean_scrub_stamp":"2024-09-17T05:41:56.913963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.14","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:41:56.954521+0000","last_change":"2024-09-17T05:41:56.951074+0000","last_active":"2024-09-17T05:41:56.954521+0000","last_peered":"2024-09-17T05:41:56.954521+0000","last_clean":"2024-09-17T05:41:56.954521+0000","last_became_active":"2024-09-17T05:41:56.950549+0000","last_became_peered":"2024-09-17T05:41:56.950549+0000","last_unstale":"2024-09-17T05:41:56.954521+0000","last_undegraded":"2024-09-17T05:41:56.954521+0000","last_fullsized":"2024-09-17T05:41:56.954521+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:55.904533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:55.904533+0000","last_clean_scrub_stamp":"2024-09-17T05:41:55.904533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:21:08.994692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:41:56.913963+0000","last_change":"2024-09-17T05:41:56.913963+0000","last_active":"2024-09-17T05:41:56.913963+0000","last_peered":"2024-09-17T05:41:56.913963+0000","last_clean":"2024-09-17T05:41:56.913963+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:41:56.913963+0000","last_undegraded":"2024-09-17T05:41:56.913963+0000","last_fullsized":"2024-09-17T05:41:56.913963+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_clean_scrub_stamp":"2024-09-17T05:41:56.913963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.13","version":"22'2","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T05:41:57.963820+0000","last_change":"2024-09-17T05:41:56.939288+0000","last_active":"2024-09-17T05:41:57.963820+0000","last_peered":"2024-09-17T05:41:57.963820+0000","last_clean":"2024-09-17T05:41:57.963820+0000","last_became_active":"2024-09-17T05:41:56.938951+0000","last_became_peered":"2024-09-17T05:41:56.938951+0000","last_unstale":"2024-09-17T05:41:57.963820+0000","last_undegraded":"2024-09-17T05:41:57.963820+0000","last_fullsized":"2024-09-17T05:41:57.963820+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:55.904533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:55.904533+0000","last_clean_scrub_stamp":"2024-09-17T05:41:55.904533+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:41:47.665206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T05:41:57.960149+0000","last_change":"2024-09-17T05:41:57.953556+0000","last_active":"2024-09-17T05:41:57.960149+0000","last_peered":"2024-09-17T05:41:57.960149+0000","last_clean":"2024-09-17T05:41:57.960149+0000","last_became_active":"2024-09-17T05:41:57.953229+0000","last_became_peered":"2024-09-17T05:41:57.953229+0000","last_unstale":"2024-09-17T05:41:57.960149+0000","last_undegraded":"2024-09-17T05:41:57.960149+0000","last_fullsized":"2024-09-17T05:41:57.960149+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_clean_scrub_stamp":"2024-09-17T05:41:56.913963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:31:05.269290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-09-17T05:41:55.925889+0000","last_change":"2024-09-17T05:41:55.925889+0000","last_active":"2024-09-17T05:41:55.904533+0000","last_peered":"2024-09-17T05:41:55.904533+0000","last_clean":"2024-09-17T05:41:55.904533+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:41:55.925889+0000","last_undegraded":"2024-09-17T05:41:55.925889+0000","last_fullsized":"2024-09-17T05:41:55.925889+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:55.904533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:55.904533+0000","last_clean_scrub_stamp":"2024-09-17T05:41:55.904533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:41:56.913963+0000","last_change":"2024-09-17T05:41:56.913963+0000","last_active":"2024-09-17T05:41:56.913963+0000","last_peered":"2024-09-17T05:41:56.913963+0000","last_clean":"2024-09-17T05:41:56.913963+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:41:56.913963+0000","last_undegraded":"2024-09-17T05:41:56.913963+0000","last_fullsized":"2024-09-17T05:41:56.913963+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_clean_scrub_stamp":"2024-09-17T05:41:56.913963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:41:56.951770+0000","last_change":"2024-09-17T05:41:56.946833+0000","last_active":"2024-09-17T05:41:56.951770+0000","last_peered":"2024-09-17T05:41:56.951770+0000","last_clean":"2024-09-17T05:41:56.951770+0000","last_became_active":"2024-09-17T05:41:56.946545+0000","last_became_peered":"2024-09-17T05:41:56.946545+0000","last_unstale":"2024-09-17T05:41:56.951770+0000","last_undegraded":"2024-09-17T05:41:56.951770+0000","last_fullsized":"2024-09-17T05:41:56.951770+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:55.904533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:55.904533+0000","last_clean_scrub_stamp":"2024-09-17T05:41:55.904533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:08:59.697169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-17T05:41:56.932989+0000","last_change":"2024-09-17T05:41:56.932989+0000","last_active":"2024-09-17T05:41:56.913963+0000","last_peered":"2024-09-17T05:41:56.913963+0000","last_clean":"2024-09-17T05:41:56.913963+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:41:56.932989+0000","last_undegraded":"2024-09-17T05:41:56.932989+0000","last_fullsized":"2024-09-17T05:41:56.932989+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_clean_scrub_stamp":"2024-09-17T05:41:56.913963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-09-17T05:41:55.921502+0000","last_change":"2024-09-17T05:41:55.921502+0000","last_active":"2024-09-17T05:41:55.904533+0000","last_peered":"2024-09-17T05:41:55.904533+0000","last_clean":"2024-09-17T05:41:55.904533+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:41:55.921502+0000","last_undegraded":"2024-09-17T05:41:55.921502+0000","last_fullsized":"2024-09-17T05:41:55.921502+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:55.904533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:55.904533+0000","last_clean_scrub_stamp":"2024-09-17T05:41:55.904533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:41:56.913963+0000","last_change":"2024-09-17T05:41:56.913963+0000","last_active":"2024-09-17T05:41:56.913963+0000","last_peered":"2024-09-17T05:41:56.913963+0000","last_clean":"2024-09-17T05:41:56.913963+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:41:56.913963+0000","last_undegraded":"2024-09-17T05:41:56.913963+0000","last_fullsized":"2024-09-17T05:41:56.913963+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_clean_scrub_stamp":"2024-09-17T05:41:56.913963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.f","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-09-17T05:41:55.923232+0000","last_change":"2024-09-17T05:41:55.923232+0000","last_active":"2024-09-17T05:41:55.904533+0000","last_peered":"2024-09-17T05:41:55.904533+0000","last_clean":"2024-09-17T05:41:55.904533+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:41:55.923232+0000","last_undegraded":"2024-09-17T05:41:55.923232+0000","last_fullsized":"2024-09-17T05:41:55.923232+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:55.904533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:55.904533+0000","last_clean_scrub_stamp":"2024-09-17T05:41:55.904533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:41:56.913963+0000","last_change":"2024-09-17T05:41:56.913963+0000","last_active":"2024-09-17T05:41:56.913963+0000","last_peered":"2024-09-17T05:41:56.913963+0000","last_clean":"2024-09-17T05:41:56.913963+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:41:56.913963+0000","last_undegraded":"2024-09-17T05:41:56.913963+0000","last_fullsized":"2024-09-17T05:41:56.913963+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_clean_scrub_stamp":"2024-09-17T05:41:56.913963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.e","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-09-17T05:41:55.921184+0000","last_change":"2024-09-17T05:41:55.921184+0000","last_active":"2024-09-17T05:41:55.904533+0000","last_peered":"2024-09-17T05:41:55.904533+0000","last_clean":"2024-09-17T05:41:55.904533+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:41:55.921184+0000","last_undegraded":"2024-09-17T05:41:55.921184+0000","last_fullsized":"2024-09-17T05:41:55.921184+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:55.904533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:55.904533+0000","last_clean_scrub_stamp":"2024-09-17T05:41:55.904533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:41:56.913963+0000","last_change":"2024-09-17T05:41:56.913963+0000","last_active":"2024-09-17T05:41:56.913963+0000","last_peered":"2024-09-17T05:41:56.913963+0000","last_clean":"2024-09-17T05:41:56.913963+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:41:56.913963+0000","last_undegraded":"2024-09-17T05:41:56.913963+0000","last_fullsized":"2024-09-17T05:41:56.913963+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_clean_scrub_stamp":"2024-09-17T05:41:56.913963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.d","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-09-17T05:41:55.918638+0000","last_change":"2024-09-17T05:41:55.918638+0000","last_active":"2024-09-17T05:41:55.904533+0000","last_peered":"2024-09-17T05:41:55.904533+0000","last_clean":"2024-09-17T05:41:55.904533+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:41:55.918638+0000","last_undegraded":"2024-09-17T05:41:55.918638+0000","last_fullsized":"2024-09-17T05:41:55.918638+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:55.904533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:55.904533+0000","last_clean_scrub_stamp":"2024-09-17T05:41:55.904533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:41:56.913963+0000","last_change":"2024-09-17T05:41:56.913963+0000","last_active":"2024-09-17T05:41:56.913963+0000","last_peered":"2024-09-17T05:41:56.913963+0000","last_clean":"2024-09-17T05:41:56.913963+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:41:56.913963+0000","last_undegraded":"2024-09-17T05:41:56.913963+0000","last_fullsized":"2024-09-17T05:41:56.913963+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_clean_scrub_stamp":"2024-09-17T05:41:56.913963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-09-17T05:41:55.922017+0000","last_change":"2024-09-17T05:41:55.922017+0000","last_active":"2024-09-17T05:41:55.904533+0000","last_peered":"2024-09-17T05:41:55.904533+0000","last_clean":"2024-09-17T05:41:55.904533+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:41:55.922017+0000","last_undegraded":"2024-09-17T05:41:55.922017+0000","last_fullsized":"2024-09-17T05:41:55.922017+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:55.904533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:55.904533+0000","last_clean_scrub_stamp":"2024-09-17T05:41:55.904533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:41:56.913963+0000","last_change":"2024-09-17T05:41:56.913963+0000","last_active":"2024-09-17T05:41:56.913963+0000","last_peered":"2024-09-17T05:41:56.913963+0000","last_clean":"2024-09-17T05:41:56.913963+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:41:56.913963+0000","last_undegraded":"2024-09-17T05:41:56.913963+0000","last_fullsized":"2024-09-17T05:41:56.913963+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_clean_scrub_stamp":"2024-09-17T05:41:56.913963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"19'72","reported_seq":105,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T05:41:55.926749+0000","last_change":"2024-09-17T05:41:48.539830+0000","last_active":"2024-09-17T05:41:55.926749+0000","last_peered":"2024-09-17T05:41:55.926749+0000","last_clean":"2024-09-17T05:41:55.926749+0000","last_became_active":"2024-09-17T05:41:48.538743+0000","last_became_peered":"2024-09-17T05:41:48.538743+0000","last_unstale":"2024-09-17T05:41:55.926749+0000","last_undegraded":"2024-09-17T05:41:55.926749+0000","last_fullsized":"2024-09-17T05:41:55.926749+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:47.152539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:47.152539+0000","last_clean_scrub_stamp":"2024-09-17T05:41:47.152539+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:08:02.952016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-09-17T05:41:55.923951+0000","last_change":"2024-09-17T05:41:55.923951+0000","last_active":"2024-09-17T05:41:55.904533+0000","last_peered":"2024-09-17T05:41:55.904533+0000","last_clean":"2024-09-17T05:41:55.904533+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:41:55.923951+0000","last_undegraded":"2024-09-17T05:41:55.923951+0000","last_fullsized":"2024-09-17T05:41:55.923951+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:55.904533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:55.904533+0000","last_clean_scrub_stamp":"2024-09-17T05:41:55.904533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:41:56.913963+0000","last_change":"2024-09-17T05:41:56.913963+0000","last_active":"2024-09-17T05:41:56.913963+0000","last_peered":"2024-09-17T05:41:56.913963+0000","last_clean":"2024-09-17T05:41:56.913963+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:41:56.913963+0000","last_undegraded":"2024-09-17T05:41:56.913963+0000","last_fullsized":"2024-09-17T05:41:56.913963+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_clean_scrub_stamp":"2024-09-17T05:41:56.913963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-09-17T05:41:55.925470+0000","last_change":"2024-09-17T05:41:55.925470+0000","last_active":"2024-09-17T05:41:55.904533+0000","last_peered":"2024-09-17T05:41:55.904533+0000","last_clean":"2024-09-17T05:41:55.904533+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:41:55.925470+0000","last_undegraded":"2024-09-17T05:41:55.925470+0000","last_fullsized":"2024-09-17T05:41:55.925470+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:55.904533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:55.904533+0000","last_clean_scrub_stamp":"2024-09-17T05:41:55.904533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T05:41:57.947280+0000","last_change":"2024-09-17T05:41:57.943470+0000","last_active":"2024-09-17T05:41:57.947280+0000","last_peered":"2024-09-17T05:41:57.947280+0000","last_clean":"2024-09-17T05:41:57.947280+0000","last_became_active":"2024-09-17T05:41:57.943015+0000","last_became_peered":"2024-09-17T05:41:57.943015+0000","last_unstale":"2024-09-17T05:41:57.947280+0000","last_undegraded":"2024-09-17T05:41:57.947280+0000","last_fullsized":"2024-09-17T05:41:57.947280+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_clean_scrub_stamp":"2024-09-17T05:41:56.913963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:54:20.645536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-09-17T05:41:55.921169+0000","last_change":"2024-09-17T05:41:55.921169+0000","last_active":"2024-09-17T05:41:55.904533+0000","last_peered":"2024-09-17T05:41:55.904533+0000","last_clean":"2024-09-17T05:41:55.904533+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:41:55.921169+0000","last_undegraded":"2024-09-17T05:41:55.921169+0000","last_fullsized":"2024-09-17T05:41:55.921169+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:55.904533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:55.904533+0000","last_clean_scrub_stamp":"2024-09-17T05:41:55.904533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:41:56.913963+0000","last_change":"2024-09-17T05:41:56.913963+0000","last_active":"2024-09-17T05:41:56.913963+0000","last_peered":"2024-09-17T05:41:56.913963+0000","last_clean":"2024-09-17T05:41:56.913963+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:41:56.913963+0000","last_undegraded":"2024-09-17T05:41:56.913963+0000","last_fullsized":"2024-09-17T05:41:56.913963+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_clean_scrub_stamp":"2024-09-17T05:41:56.913963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-09-17T05:41:55.924760+0000","last_change":"2024-09-17T05:41:55.924760+0000","last_active":"2024-09-17T05:41:55.904533+0000","last_peered":"2024-09-17T05:41:55.904533+0000","last_clean":"2024-09-17T05:41:55.904533+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:41:55.924760+0000","last_undegraded":"2024-09-17T05:41:55.924760+0000","last_fullsized":"2024-09-17T05:41:55.924760+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:55.904533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:55.904533+0000","last_clean_scrub_stamp":"2024-09-17T05:41:55.904533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:41:56.913963+0000","last_change":"2024-09-17T05:41:56.913963+0000","last_active":"2024-09-17T05:41:56.913963+0000","last_peered":"2024-09-17T05:41:56.913963+0000","last_clean":"2024-09-17T05:41:56.913963+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:41:56.913963+0000","last_undegraded":"2024-09-17T05:41:56.913963+0000","last_fullsized":"2024-09-17T05:41:56.913963+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_clean_scrub_stamp":"2024-09-17T05:41:56.913963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-09-17T05:41:55.918640+0000","last_change":"2024-09-17T05:41:55.918640+0000","last_active":"2024-09-17T05:41:55.904533+0000","last_peered":"2024-09-17T05:41:55.904533+0000","last_clean":"2024-09-17T05:41:55.904533+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:41:55.918640+0000","last_undegraded":"2024-09-17T05:41:55.918640+0000","last_fullsized":"2024-09-17T05:41:55.918640+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:55.904533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:55.904533+0000","last_clean_scrub_stamp":"2024-09-17T05:41:55.904533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:41:56.913963+0000","last_change":"2024-09-17T05:41:56.913963+0000","last_active":"2024-09-17T05:41:56.913963+0000","last_peered":"2024-09-17T05:41:56.913963+0000","last_clean":"2024-09-17T05:41:56.913963+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:41:56.913963+0000","last_undegraded":"2024-09-17T05:41:56.913963+0000","last_fullsized":"2024-09-17T05:41:56.913963+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_clean_scrub_stamp":"2024-09-17T05:41:56.913963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-09-17T05:41:55.923012+0000","last_change":"2024-09-17T05:41:55.923012+0000","last_active":"2024-09-17T05:41:55.904533+0000","last_peered":"2024-09-17T05:41:55.904533+0000","last_clean":"2024-09-17T05:41:55.904533+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:41:55.923012+0000","last_undegraded":"2024-09-17T05:41:55.923012+0000","last_fullsized":"2024-09-17T05:41:55.923012+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:55.904533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:55.904533+0000","last_clean_scrub_stamp":"2024-09-17T05:41:55.904533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:41:56.913963+0000","last_change":"2024-09-17T05:41:56.913963+0000","last_active":"2024-09-17T05:41:56.913963+0000","last_peered":"2024-09-17T05:41:56.913963+0000","last_clean":"2024-09-17T05:41:56.913963+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:41:56.913963+0000","last_undegraded":"2024-09-17T05:41:56.913963+0000","last_fullsized":"2024-09-17T05:41:56.913963+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_clean_scrub_stamp":"2024-09-17T05:41:56.913963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-09-17T05:41:55.918651+0000","last_change":"2024-09-17T05:41:55.918651+0000","last_active":"2024-09-17T05:41:55.904533+0000","last_peered":"2024-09-17T05:41:55.904533+0000","last_clean":"2024-09-17T05:41:55.904533+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:41:55.918651+0000","last_undegraded":"2024-09-17T05:41:55.918651+0000","last_fullsized":"2024-09-17T05:41:55.918651+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:55.904533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:55.904533+0000","last_clean_scrub_stamp":"2024-09-17T05:41:55.904533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:41:56.913963+0000","last_change":"2024-09-17T05:41:56.913963+0000","last_active":"2024-09-17T05:41:56.913963+0000","last_peered":"2024-09-17T05:41:56.913963+0000","last_clean":"2024-09-17T05:41:56.913963+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:41:56.913963+0000","last_undegraded":"2024-09-17T05:41:56.913963+0000","last_fullsized":"2024-09-17T05:41:56.913963+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_clean_scrub_stamp":"2024-09-17T05:41:56.913963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:41:56.951831+0000","last_change":"2024-09-17T05:41:56.947816+0000","last_active":"2024-09-17T05:41:56.951831+0000","last_peered":"2024-09-17T05:41:56.951831+0000","last_clean":"2024-09-17T05:41:56.951831+0000","last_became_active":"2024-09-17T05:41:56.947483+0000","last_became_peered":"2024-09-17T05:41:56.947483+0000","last_unstale":"2024-09-17T05:41:56.951831+0000","last_undegraded":"2024-09-17T05:41:56.951831+0000","last_fullsized":"2024-09-17T05:41:56.951831+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:55.904533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:55.904533+0000","last_clean_scrub_stamp":"2024-09-17T05:41:55.904533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:10:33.368816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T05:41:57.958467+0000","last_change":"2024-09-17T05:41:57.950209+0000","last_active":"2024-09-17T05:41:57.958467+0000","last_peered":"2024-09-17T05:41:57.958467+0000","last_clean":"2024-09-17T05:41:57.958467+0000","last_became_active":"2024-09-17T05:41:57.949869+0000","last_became_peered":"2024-09-17T05:41:57.949869+0000","last_unstale":"2024-09-17T05:41:57.958467+0000","last_undegraded":"2024-09-17T05:41:57.958467+0000","last_fullsized":"2024-09-17T05:41:57.958467+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_clean_scrub_stamp":"2024-09-17T05:41:56.913963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:57:20.773447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-09-17T05:41:55.926244+0000","last_change":"2024-09-17T05:41:55.926244+0000","last_active":"2024-09-17T05:41:55.904533+0000","last_peered":"2024-09-17T05:41:55.904533+0000","last_clean":"2024-09-17T05:41:55.904533+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:41:55.926244+0000","last_undegraded":"2024-09-17T05:41:55.926244+0000","last_fullsized":"2024-09-17T05:41:55.926244+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:55.904533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:55.904533+0000","last_clean_scrub_stamp":"2024-09-17T05:41:55.904533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:41:56.913963+0000","last_change":"2024-09-17T05:41:56.913963+0000","last_active":"2024-09-17T05:41:56.913963+0000","last_peered":"2024-09-17T05:41:56.913963+0000","last_clean":"2024-09-17T05:41:56.913963+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:41:56.913963+0000","last_undegraded":"2024-09-17T05:41:56.913963+0000","last_fullsized":"2024-09-17T05:41:56.913963+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_clean_scrub_stamp":"2024-09-17T05:41:56.913963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-09-17T05:41:55.918653+0000","last_change":"2024-09-17T05:41:55.918653+0000","last_active":"2024-09-17T05:41:55.904533+0000","last_peered":"2024-09-17T05:41:55.904533+0000","last_clean":"2024-09-17T05:41:55.904533+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:41:55.918653+0000","last_undegraded":"2024-09-17T05:41:55.918653+0000","last_fullsized":"2024-09-17T05:41:55.918653+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:55.904533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:55.904533+0000","last_clean_scrub_stamp":"2024-09-17T05:41:55.904533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:41:56.913963+0000","last_change":"2024-09-17T05:41:56.913963+0000","last_active":"2024-09-17T05:41:56.913963+0000","last_peered":"2024-09-17T05:41:56.913963+0000","last_clean":"2024-09-17T05:41:56.913963+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:41:56.913963+0000","last_undegraded":"2024-09-17T05:41:56.913963+0000","last_fullsized":"2024-09-17T05:41:56.913963+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_clean_scrub_stamp":"2024-09-17T05:41:56.913963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-09-17T05:41:55.918638+0000","last_change":"2024-09-17T05:41:55.918638+0000","last_active":"2024-09-17T05:41:55.904533+0000","last_peered":"2024-09-17T05:41:55.904533+0000","last_clean":"2024-09-17T05:41:55.904533+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:41:55.918638+0000","last_undegraded":"2024-09-17T05:41:55.918638+0000","last_fullsized":"2024-09-17T05:41:55.918638+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:55.904533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:55.904533+0000","last_clean_scrub_stamp":"2024-09-17T05:41:55.904533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:41:56.913963+0000","last_change":"2024-09-17T05:41:56.913963+0000","last_active":"2024-09-17T05:41:56.913963+0000","last_peered":"2024-09-17T05:41:56.913963+0000","last_clean":"2024-09-17T05:41:56.913963+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:41:56.913963+0000","last_undegraded":"2024-09-17T05:41:56.913963+0000","last_fullsized":"2024-09-17T05:41:56.913963+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_clean_scrub_stamp":"2024-09-17T05:41:56.913963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.b","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-09-17T05:41:55.922289+0000","last_change":"2024-09-17T05:41:55.922289+0000","last_active":"2024-09-17T05:41:55.904533+0000","last_peered":"2024-09-17T05:41:55.904533+0000","last_clean":"2024-09-17T05:41:55.904533+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:41:55.922289+0000","last_undegraded":"2024-09-17T05:41:55.922289+0000","last_fullsized":"2024-09-17T05:41:55.922289+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:55.904533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:55.904533+0000","last_clean_scrub_stamp":"2024-09-17T05:41:55.904533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-17T05:41:56.934139+0000","last_change":"2024-09-17T05:41:56.934139+0000","last_active":"2024-09-17T05:41:56.913963+0000","last_peered":"2024-09-17T05:41:56.913963+0000","last_clean":"2024-09-17T05:41:56.913963+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:41:56.934139+0000","last_undegraded":"2024-09-17T05:41:56.934139+0000","last_fullsized":"2024-09-17T05:41:56.934139+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_clean_scrub_stamp":"2024-09-17T05:41:56.913963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:41:56.913963+0000","last_change":"2024-09-17T05:41:56.913963+0000","last_active":"2024-09-17T05:41:56.913963+0000","last_peered":"2024-09-17T05:41:56.913963+0000","last_clean":"2024-09-17T05:41:56.913963+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:41:56.913963+0000","last_undegraded":"2024-09-17T05:41:56.913963+0000","last_fullsized":"2024-09-17T05:41:56.913963+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_clean_scrub_stamp":"2024-09-17T05:41:56.913963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1c","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-09-17T05:41:55.922276+0000","last_change":"2024-09-17T05:41:55.922276+0000","last_active":"2024-09-17T05:41:55.904533+0000","last_peered":"2024-09-17T05:41:55.904533+0000","last_clean":"2024-09-17T05:41:55.904533+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:41:55.922276+0000","last_undegraded":"2024-09-17T05:41:55.922276+0000","last_fullsized":"2024-09-17T05:41:55.922276+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:55.904533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:55.904533+0000","last_clean_scrub_stamp":"2024-09-17T05:41:55.904533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:41:56.913963+0000","last_change":"2024-09-17T05:41:56.913963+0000","last_active":"2024-09-17T05:41:56.913963+0000","last_peered":"2024-09-17T05:41:56.913963+0000","last_clean":"2024-09-17T05:41:56.913963+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:41:56.913963+0000","last_undegraded":"2024-09-17T05:41:56.913963+0000","last_fullsized":"2024-09-17T05:41:56.913963+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_clean_scrub_stamp":"2024-09-17T05:41:56.913963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1d","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-09-17T05:41:55.923615+0000","last_change":"2024-09-17T05:41:55.923615+0000","last_active":"2024-09-17T05:41:55.904533+0000","last_peered":"2024-09-17T05:41:55.904533+0000","last_clean":"2024-09-17T05:41:55.904533+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:41:55.923615+0000","last_undegraded":"2024-09-17T05:41:55.923615+0000","last_fullsized":"2024-09-17T05:41:55.923615+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:55.904533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:55.904533+0000","last_clean_scrub_stamp":"2024-09-17T05:41:55.904533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T05:41:57.958452+0000","last_change":"2024-09-17T05:41:57.947899+0000","last_active":"2024-09-17T05:41:57.958452+0000","last_peered":"2024-09-17T05:41:57.958452+0000","last_clean":"2024-09-17T05:41:57.958452+0000","last_became_active":"2024-09-17T05:41:57.947556+0000","last_became_peered":"2024-09-17T05:41:57.947556+0000","last_unstale":"2024-09-17T05:41:57.958452+0000","last_undegraded":"2024-09-17T05:41:57.958452+0000","last_fullsized":"2024-09-17T05:41:57.958452+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_clean_scrub_stamp":"2024-09-17T05:41:56.913963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:19:11.730293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-09-17T05:41:55.921410+0000","last_change":"2024-09-17T05:41:55.921410+0000","last_active":"2024-09-17T05:41:55.904533+0000","last_peered":"2024-09-17T05:41:55.904533+0000","last_clean":"2024-09-17T05:41:55.904533+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:41:55.921410+0000","last_undegraded":"2024-09-17T05:41:55.921410+0000","last_fullsized":"2024-09-17T05:41:55.921410+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:55.904533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:55.904533+0000","last_clean_scrub_stamp":"2024-09-17T05:41:55.904533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:41:56.913963+0000","last_change":"2024-09-17T05:41:56.913963+0000","last_active":"2024-09-17T05:41:56.913963+0000","last_peered":"2024-09-17T05:41:56.913963+0000","last_clean":"2024-09-17T05:41:56.913963+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:41:56.913963+0000","last_undegraded":"2024-09-17T05:41:56.913963+0000","last_fullsized":"2024-09-17T05:41:56.913963+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_clean_scrub_stamp":"2024-09-17T05:41:56.913963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1f","version":"22'4","reported_seq":17,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T05:41:57.964113+0000","last_change":"2024-09-17T05:41:56.946707+0000","last_active":"2024-09-17T05:41:57.964113+0000","last_peered":"2024-09-17T05:41:57.964113+0000","last_clean":"2024-09-17T05:41:57.964113+0000","last_became_active":"2024-09-17T05:41:56.946448+0000","last_became_peered":"2024-09-17T05:41:56.946448+0000","last_unstale":"2024-09-17T05:41:57.964113+0000","last_undegraded":"2024-09-17T05:41:57.964113+0000","last_fullsized":"2024-09-17T05:41:57.964113+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:55.904533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:55.904533+0000","last_clean_scrub_stamp":"2024-09-17T05:41:55.904533+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:55:32.730864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":34,"acting":34,"num_store_stats":2},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":616,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6,"ondisk_log_size":6,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":16,"seq":68719476742,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27220,"kb_used_data":192,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344620,"statfs":{"total":96636764160,"available":96608890880,"internally_reserved":0,"allocated":196608,"data_stored":62477,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":7,"up_from":15,"seq":64424509446,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28032,"kb_used_data":760,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343808,"statfs":{"total":96636764160,"available":96608059392,"internally_reserved":0,"allocated":778240,"data_stored":647028,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509445,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27216,"kb_used_data":180,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344624,"statfs":{"total":96636764160,"available":96608894976,"internally_reserved":0,"allocated":184320,"data_stored":56660,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509445,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27216,"kb_used_data":180,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344624,"statfs":{"total":96636764160,"available":96608894976,"internally_reserved":0,"allocated":184320,"data_stored":56660,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509445,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27208,"kb_used_data":180,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344632,"statfs":{"total":96636764160,"available":96608903168,"internally_reserved":0,"allocated":184320,"data_stored":56660,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509445,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27208,"kb_used_data":180,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344632,"statfs":{"total":96636764160,"available":96608903168,"internally_reserved":0,"allocated":184320,"data_stored":56660,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509445,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27208,"kb_used_data":180,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344632,"statfs":{"total":96636764160,"available":96608903168,"internally_reserved":0,"allocated":184320,"data_stored":56660,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574853,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27832,"kb_used_data":800,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344008,"statfs":{"total":96636764160,"available":96608264192,"internally_reserved":0,"allocated":819200,"data_stored":665917,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-17T05:42:02.905 INFO:tasks.ceph.mds.d.smithi176.stderr:2024-09-17T05:42:02.904+0000 7effdb916640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-17T05:42:05.386 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-17T05:42:05.514 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:05.512+0000 7f8b787df640 1 -- 172.21.15.150:0/3917016451 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8b700d17a0 msgr2=0x7f8b700cf470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:05.514 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:05.512+0000 7f8b787df640 1 --2- 172.21.15.150:0/3917016451 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8b700d17a0 0x7f8b700cf470 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f8b700ba730 tx=0x7f8b6802a980 comp rx=0 tx=0).stop 2024-09-17T05:42:05.515 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:05.512+0000 7f8b787df640 1 -- 172.21.15.150:0/3917016451 shutdown_connections 2024-09-17T05:42:05.515 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:05.512+0000 7f8b787df640 1 --2- 172.21.15.150:0/3917016451 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8b700d17a0 0x7f8b700cf470 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:05.515 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:05.512+0000 7f8b787df640 1 --2- 172.21.15.150:0/3917016451 >> v2:172.21.15.176:3300/0 conn(0x7f8b700b9780 0x7f8b700b3720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:05.515 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:05.512+0000 7f8b787df640 1 -- 172.21.15.150:0/3917016451 >> 172.21.15.150:0/3917016451 conn(0x7f8b700d4680 msgr2=0x7f8b700d4a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:42:05.515 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:05.513+0000 7f8b787df640 1 -- 172.21.15.150:0/3917016451 shutdown_connections 2024-09-17T05:42:05.515 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:05.513+0000 7f8b787df640 1 -- 172.21.15.150:0/3917016451 wait complete. 2024-09-17T05:42:05.516 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:05.514+0000 7f8b787df640 1 Processor -- start 2024-09-17T05:42:05.516 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:05.514+0000 7f8b787df640 1 -- start start 2024-09-17T05:42:05.518 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:05.516+0000 7f8b787df640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8b700b9780 0x7f8b700b65e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:42:05.518 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:05.516+0000 7f8b787df640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8b7015ee50 0x7f8b7009ee60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:42:05.518 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:05.516+0000 7f8b787df640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8b701f8db0 0x7f8b701f91c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:42:05.518 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:05.516+0000 7f8b787df640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f8b700cfd40 con 0x7f8b701f8db0 2024-09-17T05:42:05.518 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:05.516+0000 7f8b787df640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f8b700cfbc0 con 0x7f8b700b9780 2024-09-17T05:42:05.519 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:05.516+0000 7f8b787df640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f8b700cfec0 con 0x7f8b7015ee50 2024-09-17T05:42:05.519 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:05.516+0000 7f8b76d7c640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8b701f8db0 0x7f8b701f91c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:42:05.519 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:05.516+0000 7f8b76d7c640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8b701f8db0 0x7f8b701f91c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:54408/0 (socket says 172.21.15.150:54408) 2024-09-17T05:42:05.519 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:05.516+0000 7f8b76d7c640 1 -- 172.21.15.150:0/2506157975 learned_addr learned my addr 172.21.15.150:0/2506157975 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:42:05.519 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:05.516+0000 7f8b7657b640 1 --2- 172.21.15.150:0/2506157975 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8b700b9780 0x7f8b700b65e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:42:05.519 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:05.516+0000 7f8b75d7a640 1 --2- 172.21.15.150:0/2506157975 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8b7015ee50 0x7f8b7009ee60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:42:05.519 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:05.516+0000 7f8b76d7c640 1 -- 172.21.15.150:0/2506157975 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8b7015ee50 msgr2=0x7f8b7009ee60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:05.519 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:05.516+0000 7f8b76d7c640 1 --2- 172.21.15.150:0/2506157975 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8b7015ee50 0x7f8b7009ee60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:05.519 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:05.516+0000 7f8b76d7c640 1 -- 172.21.15.150:0/2506157975 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8b700b9780 msgr2=0x7f8b700b65e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:05.519 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:05.516+0000 7f8b76d7c640 1 --2- 172.21.15.150:0/2506157975 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8b700b9780 0x7f8b700b65e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:05.519 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:05.516+0000 7f8b76d7c640 1 -- 172.21.15.150:0/2506157975 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8b701f9700 con 0x7f8b701f8db0 2024-09-17T05:42:05.519 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:05.516+0000 7f8b76d7c640 1 --2- 172.21.15.150:0/2506157975 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8b701f8db0 0x7f8b701f91c0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f8b68009d60 tx=0x7f8b68003f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:42:05.519 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:05.516+0000 7f8b66ffd640 1 -- 172.21.15.150:0/2506157975 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b68034040 con 0x7f8b701f8db0 2024-09-17T05:42:05.519 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:05.516+0000 7f8b66ffd640 1 -- 172.21.15.150:0/2506157975 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8b68004540 con 0x7f8b701f8db0 2024-09-17T05:42:05.519 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:05.516+0000 7f8b787df640 1 -- 172.21.15.150:0/2506157975 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8b701f9c30 con 0x7f8b701f8db0 2024-09-17T05:42:05.520 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:05.516+0000 7f8b66ffd640 1 -- 172.21.15.150:0/2506157975 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b68045480 con 0x7f8b701f8db0 2024-09-17T05:42:05.520 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:05.516+0000 7f8b787df640 1 -- 172.21.15.150:0/2506157975 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8b700a1a80 con 0x7f8b701f8db0 2024-09-17T05:42:05.520 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:05.517+0000 7f8b787df640 1 -- 172.21.15.150:0/2506157975 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8b7008d100 con 0x7f8b701f8db0 2024-09-17T05:42:05.521 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:05.518+0000 7f8b66ffd640 1 -- 172.21.15.150:0/2506157975 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f8b68037020 con 0x7f8b701f8db0 2024-09-17T05:42:05.521 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:05.518+0000 7f8b66ffd640 1 --2- 172.21.15.150:0/2506157975 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f8b54078b90 0x7f8b5407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:42:05.521 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:05.519+0000 7f8b66ffd640 1 -- 172.21.15.150:0/2506157975 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f8b680bc630 con 0x7f8b701f8db0 2024-09-17T05:42:05.521 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:05.519+0000 7f8b7657b640 1 --2- 172.21.15.150:0/2506157975 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f8b54078b90 0x7f8b5407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:42:05.521 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:05.519+0000 7f8b7657b640 1 --2- 172.21.15.150:0/2506157975 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f8b54078b90 0x7f8b5407b0a0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f8b6c005fd0 tx=0x7f8b6c005dc0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:42:05.524 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:05.523+0000 7f8b66ffd640 1 -- 172.21.15.150:0/2506157975 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f8b7008d100 con 0x7f8b701f8db0 2024-09-17T05:42:05.697 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:05.695+0000 7f8b787df640 1 -- 172.21.15.150:0/2506157975 --> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f8b700b3720 con 0x7f8b54078b90 2024-09-17T05:42:05.701 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:05.700+0000 7f8b66ffd640 1 -- 172.21.15.150:0/2506157975 <== mgr.4108 v2:172.21.15.176:6800/3631216395 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251924 (secure 0 0 0) 0x7f8b700b3720 con 0x7f8b54078b90 2024-09-17T05:42:05.704 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-09-17T05:42:05.705 INFO:teuthology.orchestra.run.smithi150.stderr:dumped all 2024-09-17T05:42:05.707 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:05.703+0000 7f8b787df640 1 -- 172.21.15.150:0/2506157975 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f8b54078b90 msgr2=0x7f8b5407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:05.707 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:05.703+0000 7f8b787df640 1 --2- 172.21.15.150:0/2506157975 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f8b54078b90 0x7f8b5407b0a0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f8b6c005fd0 tx=0x7f8b6c005dc0 comp rx=0 tx=0).stop 2024-09-17T05:42:05.707 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:05.703+0000 7f8b787df640 1 -- 172.21.15.150:0/2506157975 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8b701f8db0 msgr2=0x7f8b701f91c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:05.707 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:05.703+0000 7f8b787df640 1 --2- 172.21.15.150:0/2506157975 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8b701f8db0 0x7f8b701f91c0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f8b68009d60 tx=0x7f8b68003f90 comp rx=0 tx=0).stop 2024-09-17T05:42:05.707 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:05.703+0000 7f8b787df640 1 -- 172.21.15.150:0/2506157975 shutdown_connections 2024-09-17T05:42:05.708 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:05.703+0000 7f8b787df640 1 --2- 172.21.15.150:0/2506157975 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f8b54078b90 0x7f8b5407b0a0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:05.708 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:05.703+0000 7f8b787df640 1 --2- 172.21.15.150:0/2506157975 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8b701f8db0 0x7f8b701f91c0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:05.708 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:05.703+0000 7f8b787df640 1 --2- 172.21.15.150:0/2506157975 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8b7015ee50 0x7f8b7009ee60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:05.708 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:05.703+0000 7f8b787df640 1 --2- 172.21.15.150:0/2506157975 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8b700b9780 0x7f8b700b65e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:05.708 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:05.703+0000 7f8b787df640 1 -- 172.21.15.150:0/2506157975 >> 172.21.15.150:0/2506157975 conn(0x7f8b700d4680 msgr2=0x7f8b700b85f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:42:05.708 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:05.703+0000 7f8b787df640 1 -- 172.21.15.150:0/2506157975 shutdown_connections 2024-09-17T05:42:05.708 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:05.703+0000 7f8b787df640 1 -- 172.21.15.150:0/2506157975 wait complete. 2024-09-17T05:42:05.716 INFO:teuthology.orchestra.run.smithi150.stdout:{"pg_ready":true,"pg_map":{"version":27,"stamp":"2024-09-17T05:42:04.845533+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":146,"num_write_kb":1642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":111,"ondisk_log_size":111,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":171,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219284,"kb_used_data":3048,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755436,"statfs":{"total":773094113280,"available":772869566464,"internally_reserved":0,"allocated":3121152,"data_stored":1840172,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":28,"apply_latency_ms":28,"commit_latency_ns":28000000,"apply_latency_ns":28000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"7.921196"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T05:41:59.475666+0000","last_change":"2024-09-17T05:41:57.959035+0000","last_active":"2024-09-17T05:41:59.475666+0000","last_peered":"2024-09-17T05:41:59.475666+0000","last_clean":"2024-09-17T05:41:59.475666+0000","last_became_active":"2024-09-17T05:41:57.958686+0000","last_became_peered":"2024-09-17T05:41:57.958686+0000","last_unstale":"2024-09-17T05:41:59.475666+0000","last_undegraded":"2024-09-17T05:41:59.475666+0000","last_fullsized":"2024-09-17T05:41:59.475666+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_clean_scrub_stamp":"2024-09-17T05:41:56.913963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:20:54.930864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T05:41:59.474653+0000","last_change":"2024-09-17T05:41:57.949203+0000","last_active":"2024-09-17T05:41:59.474653+0000","last_peered":"2024-09-17T05:41:59.474653+0000","last_clean":"2024-09-17T05:41:59.474653+0000","last_became_active":"2024-09-17T05:41:57.948887+0000","last_became_peered":"2024-09-17T05:41:57.948887+0000","last_unstale":"2024-09-17T05:41:59.474653+0000","last_undegraded":"2024-09-17T05:41:59.474653+0000","last_fullsized":"2024-09-17T05:41:59.474653+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_clean_scrub_stamp":"2024-09-17T05:41:56.913963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:58:14.523021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T05:41:59.474467+0000","last_change":"2024-09-17T05:41:57.935841+0000","last_active":"2024-09-17T05:41:59.474467+0000","last_peered":"2024-09-17T05:41:59.474467+0000","last_clean":"2024-09-17T05:41:59.474467+0000","last_became_active":"2024-09-17T05:41:57.935502+0000","last_became_peered":"2024-09-17T05:41:57.935502+0000","last_unstale":"2024-09-17T05:41:59.474467+0000","last_undegraded":"2024-09-17T05:41:59.474467+0000","last_fullsized":"2024-09-17T05:41:59.474467+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_clean_scrub_stamp":"2024-09-17T05:41:56.913963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:52:29.444374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T05:41:58.944866+0000","last_change":"2024-09-17T05:41:57.961231+0000","last_active":"2024-09-17T05:41:58.944866+0000","last_peered":"2024-09-17T05:41:58.944866+0000","last_clean":"2024-09-17T05:41:58.944866+0000","last_became_active":"2024-09-17T05:41:57.959741+0000","last_became_peered":"2024-09-17T05:41:57.959741+0000","last_unstale":"2024-09-17T05:41:58.944866+0000","last_undegraded":"2024-09-17T05:41:58.944866+0000","last_fullsized":"2024-09-17T05:41:58.944866+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_clean_scrub_stamp":"2024-09-17T05:41:56.913963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:52:28.863641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T05:41:59.475026+0000","last_change":"2024-09-17T05:41:57.948142+0000","last_active":"2024-09-17T05:41:59.475026+0000","last_peered":"2024-09-17T05:41:59.475026+0000","last_clean":"2024-09-17T05:41:59.475026+0000","last_became_active":"2024-09-17T05:41:57.947736+0000","last_became_peered":"2024-09-17T05:41:57.947736+0000","last_unstale":"2024-09-17T05:41:59.475026+0000","last_undegraded":"2024-09-17T05:41:59.475026+0000","last_fullsized":"2024-09-17T05:41:59.475026+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_clean_scrub_stamp":"2024-09-17T05:41:56.913963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:25:08.628947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T05:41:58.944771+0000","last_change":"2024-09-17T05:41:57.962298+0000","last_active":"2024-09-17T05:41:58.944771+0000","last_peered":"2024-09-17T05:41:58.944771+0000","last_clean":"2024-09-17T05:41:58.944771+0000","last_became_active":"2024-09-17T05:41:57.961827+0000","last_became_peered":"2024-09-17T05:41:57.961827+0000","last_unstale":"2024-09-17T05:41:58.944771+0000","last_undegraded":"2024-09-17T05:41:58.944771+0000","last_fullsized":"2024-09-17T05:41:58.944771+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_clean_scrub_stamp":"2024-09-17T05:41:56.913963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:05:25.111036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T05:41:59.474925+0000","last_change":"2024-09-17T05:41:57.962591+0000","last_active":"2024-09-17T05:41:59.474925+0000","last_peered":"2024-09-17T05:41:59.474925+0000","last_clean":"2024-09-17T05:41:59.474925+0000","last_became_active":"2024-09-17T05:41:57.962277+0000","last_became_peered":"2024-09-17T05:41:57.962277+0000","last_unstale":"2024-09-17T05:41:59.474925+0000","last_undegraded":"2024-09-17T05:41:59.474925+0000","last_fullsized":"2024-09-17T05:41:59.474925+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_clean_scrub_stamp":"2024-09-17T05:41:56.913963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:52:28.863641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T05:41:58.942251+0000","last_change":"2024-09-17T05:41:57.952162+0000","last_active":"2024-09-17T05:41:58.942251+0000","last_peered":"2024-09-17T05:41:58.942251+0000","last_clean":"2024-09-17T05:41:58.942251+0000","last_became_active":"2024-09-17T05:41:57.951848+0000","last_became_peered":"2024-09-17T05:41:57.951848+0000","last_unstale":"2024-09-17T05:41:58.942251+0000","last_undegraded":"2024-09-17T05:41:58.942251+0000","last_fullsized":"2024-09-17T05:41:58.942251+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_clean_scrub_stamp":"2024-09-17T05:41:56.913963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:32:07.051277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T05:41:59.475711+0000","last_change":"2024-09-17T05:41:57.957295+0000","last_active":"2024-09-17T05:41:59.475711+0000","last_peered":"2024-09-17T05:41:59.475711+0000","last_clean":"2024-09-17T05:41:59.475711+0000","last_became_active":"2024-09-17T05:41:57.956917+0000","last_became_peered":"2024-09-17T05:41:57.956917+0000","last_unstale":"2024-09-17T05:41:59.475711+0000","last_undegraded":"2024-09-17T05:41:59.475711+0000","last_fullsized":"2024-09-17T05:41:59.475711+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_clean_scrub_stamp":"2024-09-17T05:41:56.913963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:18:41.669507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T05:41:58.944176+0000","last_change":"2024-09-17T05:41:57.956487+0000","last_active":"2024-09-17T05:41:58.944176+0000","last_peered":"2024-09-17T05:41:58.944176+0000","last_clean":"2024-09-17T05:41:58.944176+0000","last_became_active":"2024-09-17T05:41:57.956139+0000","last_became_peered":"2024-09-17T05:41:57.956139+0000","last_unstale":"2024-09-17T05:41:58.944176+0000","last_undegraded":"2024-09-17T05:41:58.944176+0000","last_fullsized":"2024-09-17T05:41:58.944176+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_clean_scrub_stamp":"2024-09-17T05:41:56.913963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:11:06.285537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T05:41:58.943506+0000","last_change":"2024-09-17T05:41:57.953158+0000","last_active":"2024-09-17T05:41:58.943506+0000","last_peered":"2024-09-17T05:41:58.943506+0000","last_clean":"2024-09-17T05:41:58.943506+0000","last_became_active":"2024-09-17T05:41:57.952871+0000","last_became_peered":"2024-09-17T05:41:57.952871+0000","last_unstale":"2024-09-17T05:41:58.943506+0000","last_undegraded":"2024-09-17T05:41:58.943506+0000","last_fullsized":"2024-09-17T05:41:58.943506+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_clean_scrub_stamp":"2024-09-17T05:41:56.913963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:52:02.839445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T05:41:59.016408+0000","last_change":"2024-09-17T05:41:57.956110+0000","last_active":"2024-09-17T05:41:59.016408+0000","last_peered":"2024-09-17T05:41:59.016408+0000","last_clean":"2024-09-17T05:41:59.016408+0000","last_became_active":"2024-09-17T05:41:57.955123+0000","last_became_peered":"2024-09-17T05:41:57.955123+0000","last_unstale":"2024-09-17T05:41:59.016408+0000","last_undegraded":"2024-09-17T05:41:59.016408+0000","last_fullsized":"2024-09-17T05:41:59.016408+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_clean_scrub_stamp":"2024-09-17T05:41:56.913963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:10:39.584426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T05:41:58.942679+0000","last_change":"2024-09-17T05:41:57.946022+0000","last_active":"2024-09-17T05:41:58.942679+0000","last_peered":"2024-09-17T05:41:58.942679+0000","last_clean":"2024-09-17T05:41:58.942679+0000","last_became_active":"2024-09-17T05:41:57.945669+0000","last_became_peered":"2024-09-17T05:41:57.945669+0000","last_unstale":"2024-09-17T05:41:58.942679+0000","last_undegraded":"2024-09-17T05:41:58.942679+0000","last_fullsized":"2024-09-17T05:41:58.942679+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_clean_scrub_stamp":"2024-09-17T05:41:56.913963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:38:43.072798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T05:41:59.474646+0000","last_change":"2024-09-17T05:41:57.950142+0000","last_active":"2024-09-17T05:41:59.474646+0000","last_peered":"2024-09-17T05:41:59.474646+0000","last_clean":"2024-09-17T05:41:59.474646+0000","last_became_active":"2024-09-17T05:41:57.949825+0000","last_became_peered":"2024-09-17T05:41:57.949825+0000","last_unstale":"2024-09-17T05:41:59.474646+0000","last_undegraded":"2024-09-17T05:41:59.474646+0000","last_fullsized":"2024-09-17T05:41:59.474646+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_clean_scrub_stamp":"2024-09-17T05:41:56.913963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:50:10.770545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T05:41:59.474168+0000","last_change":"2024-09-17T05:41:57.952716+0000","last_active":"2024-09-17T05:41:59.474168+0000","last_peered":"2024-09-17T05:41:59.474168+0000","last_clean":"2024-09-17T05:41:59.474168+0000","last_became_active":"2024-09-17T05:41:57.952394+0000","last_became_peered":"2024-09-17T05:41:57.952394+0000","last_unstale":"2024-09-17T05:41:59.474168+0000","last_undegraded":"2024-09-17T05:41:59.474168+0000","last_fullsized":"2024-09-17T05:41:59.474168+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_clean_scrub_stamp":"2024-09-17T05:41:56.913963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:29:37.607962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T05:41:58.944411+0000","last_change":"2024-09-17T05:41:57.960244+0000","last_active":"2024-09-17T05:41:58.944411+0000","last_peered":"2024-09-17T05:41:58.944411+0000","last_clean":"2024-09-17T05:41:58.944411+0000","last_became_active":"2024-09-17T05:41:57.959886+0000","last_became_peered":"2024-09-17T05:41:57.959886+0000","last_unstale":"2024-09-17T05:41:58.944411+0000","last_undegraded":"2024-09-17T05:41:58.944411+0000","last_fullsized":"2024-09-17T05:41:58.944411+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_clean_scrub_stamp":"2024-09-17T05:41:56.913963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:28:48.325328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T05:41:58.945844+0000","last_change":"2024-09-17T05:41:57.949489+0000","last_active":"2024-09-17T05:41:58.945844+0000","last_peered":"2024-09-17T05:41:58.945844+0000","last_clean":"2024-09-17T05:41:58.945844+0000","last_became_active":"2024-09-17T05:41:57.949140+0000","last_became_peered":"2024-09-17T05:41:57.949140+0000","last_unstale":"2024-09-17T05:41:58.945844+0000","last_undegraded":"2024-09-17T05:41:58.945844+0000","last_fullsized":"2024-09-17T05:41:58.945844+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_clean_scrub_stamp":"2024-09-17T05:41:56.913963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:51:10.975005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T05:41:59.439183+0000","last_change":"2024-09-17T05:41:57.958252+0000","last_active":"2024-09-17T05:41:59.439183+0000","last_peered":"2024-09-17T05:41:59.439183+0000","last_clean":"2024-09-17T05:41:59.439183+0000","last_became_active":"2024-09-17T05:41:57.957880+0000","last_became_peered":"2024-09-17T05:41:57.957880+0000","last_unstale":"2024-09-17T05:41:59.439183+0000","last_undegraded":"2024-09-17T05:41:59.439183+0000","last_fullsized":"2024-09-17T05:41:59.439183+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_clean_scrub_stamp":"2024-09-17T05:41:56.913963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:47:33.448576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T05:41:59.475674+0000","last_change":"2024-09-17T05:41:57.953128+0000","last_active":"2024-09-17T05:41:59.475674+0000","last_peered":"2024-09-17T05:41:59.475674+0000","last_clean":"2024-09-17T05:41:59.475674+0000","last_became_active":"2024-09-17T05:41:57.952806+0000","last_became_peered":"2024-09-17T05:41:57.952806+0000","last_unstale":"2024-09-17T05:41:59.475674+0000","last_undegraded":"2024-09-17T05:41:59.475674+0000","last_fullsized":"2024-09-17T05:41:59.475674+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_clean_scrub_stamp":"2024-09-17T05:41:56.913963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:51:10.975005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T05:41:58.943895+0000","last_change":"2024-09-17T05:41:57.960997+0000","last_active":"2024-09-17T05:41:58.943895+0000","last_peered":"2024-09-17T05:41:58.943895+0000","last_clean":"2024-09-17T05:41:58.943895+0000","last_became_active":"2024-09-17T05:41:57.960632+0000","last_became_peered":"2024-09-17T05:41:57.960632+0000","last_unstale":"2024-09-17T05:41:58.943895+0000","last_undegraded":"2024-09-17T05:41:58.943895+0000","last_fullsized":"2024-09-17T05:41:58.943895+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_clean_scrub_stamp":"2024-09-17T05:41:56.913963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:08:48.763013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T05:41:59.474890+0000","last_change":"2024-09-17T05:41:57.952830+0000","last_active":"2024-09-17T05:41:59.474890+0000","last_peered":"2024-09-17T05:41:59.474890+0000","last_clean":"2024-09-17T05:41:59.474890+0000","last_became_active":"2024-09-17T05:41:57.952504+0000","last_became_peered":"2024-09-17T05:41:57.952504+0000","last_unstale":"2024-09-17T05:41:59.474890+0000","last_undegraded":"2024-09-17T05:41:59.474890+0000","last_fullsized":"2024-09-17T05:41:59.474890+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_clean_scrub_stamp":"2024-09-17T05:41:56.913963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:31:01.180867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T05:41:58.944890+0000","last_change":"2024-09-17T05:41:57.959379+0000","last_active":"2024-09-17T05:41:58.944890+0000","last_peered":"2024-09-17T05:41:58.944890+0000","last_clean":"2024-09-17T05:41:58.944890+0000","last_became_active":"2024-09-17T05:41:57.956766+0000","last_became_peered":"2024-09-17T05:41:57.956766+0000","last_unstale":"2024-09-17T05:41:58.944890+0000","last_undegraded":"2024-09-17T05:41:58.944890+0000","last_fullsized":"2024-09-17T05:41:58.944890+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_clean_scrub_stamp":"2024-09-17T05:41:56.913963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:19:32.094334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T05:41:58.942336+0000","last_change":"2024-09-17T05:41:57.933829+0000","last_active":"2024-09-17T05:41:58.942336+0000","last_peered":"2024-09-17T05:41:58.942336+0000","last_clean":"2024-09-17T05:41:58.942336+0000","last_became_active":"2024-09-17T05:41:57.933493+0000","last_became_peered":"2024-09-17T05:41:57.933493+0000","last_unstale":"2024-09-17T05:41:58.942336+0000","last_undegraded":"2024-09-17T05:41:58.942336+0000","last_fullsized":"2024-09-17T05:41:58.942336+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_clean_scrub_stamp":"2024-09-17T05:41:56.913963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:47:26.590424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T05:41:58.944662+0000","last_change":"2024-09-17T05:41:57.956168+0000","last_active":"2024-09-17T05:41:58.944662+0000","last_peered":"2024-09-17T05:41:58.944662+0000","last_clean":"2024-09-17T05:41:58.944662+0000","last_became_active":"2024-09-17T05:41:57.955795+0000","last_became_peered":"2024-09-17T05:41:57.955795+0000","last_unstale":"2024-09-17T05:41:58.944662+0000","last_undegraded":"2024-09-17T05:41:58.944662+0000","last_fullsized":"2024-09-17T05:41:58.944662+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_clean_scrub_stamp":"2024-09-17T05:41:56.913963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:58:14.523021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T05:41:58.942694+0000","last_change":"2024-09-17T05:41:57.935453+0000","last_active":"2024-09-17T05:41:58.942694+0000","last_peered":"2024-09-17T05:41:58.942694+0000","last_clean":"2024-09-17T05:41:58.942694+0000","last_became_active":"2024-09-17T05:41:57.935059+0000","last_became_peered":"2024-09-17T05:41:57.935059+0000","last_unstale":"2024-09-17T05:41:58.942694+0000","last_undegraded":"2024-09-17T05:41:58.942694+0000","last_fullsized":"2024-09-17T05:41:58.942694+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_clean_scrub_stamp":"2024-09-17T05:41:56.913963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:28:48.325328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T05:41:58.943835+0000","last_change":"2024-09-17T05:41:57.953726+0000","last_active":"2024-09-17T05:41:58.943835+0000","last_peered":"2024-09-17T05:41:58.943835+0000","last_clean":"2024-09-17T05:41:58.943835+0000","last_became_active":"2024-09-17T05:41:57.953078+0000","last_became_peered":"2024-09-17T05:41:57.953078+0000","last_unstale":"2024-09-17T05:41:58.943835+0000","last_undegraded":"2024-09-17T05:41:58.943835+0000","last_fullsized":"2024-09-17T05:41:58.943835+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_clean_scrub_stamp":"2024-09-17T05:41:56.913963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:25:59.519887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T05:41:59.474493+0000","last_change":"2024-09-17T05:41:57.957328+0000","last_active":"2024-09-17T05:41:59.474493+0000","last_peered":"2024-09-17T05:41:59.474493+0000","last_clean":"2024-09-17T05:41:59.474493+0000","last_became_active":"2024-09-17T05:41:57.956969+0000","last_became_peered":"2024-09-17T05:41:57.956969+0000","last_unstale":"2024-09-17T05:41:59.474493+0000","last_undegraded":"2024-09-17T05:41:59.474493+0000","last_fullsized":"2024-09-17T05:41:59.474493+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_clean_scrub_stamp":"2024-09-17T05:41:56.913963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:28:48.325328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T05:41:58.943020+0000","last_change":"2024-09-17T05:41:57.934895+0000","last_active":"2024-09-17T05:41:58.943020+0000","last_peered":"2024-09-17T05:41:58.943020+0000","last_clean":"2024-09-17T05:41:58.943020+0000","last_became_active":"2024-09-17T05:41:57.934411+0000","last_became_peered":"2024-09-17T05:41:57.934411+0000","last_unstale":"2024-09-17T05:41:58.943020+0000","last_undegraded":"2024-09-17T05:41:58.943020+0000","last_fullsized":"2024-09-17T05:41:58.943020+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_clean_scrub_stamp":"2024-09-17T05:41:56.913963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:25:08.628947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T05:41:59.474943+0000","last_change":"2024-09-17T05:41:57.948114+0000","last_active":"2024-09-17T05:41:59.474943+0000","last_peered":"2024-09-17T05:41:59.474943+0000","last_clean":"2024-09-17T05:41:59.474943+0000","last_became_active":"2024-09-17T05:41:57.947671+0000","last_became_peered":"2024-09-17T05:41:57.947671+0000","last_unstale":"2024-09-17T05:41:59.474943+0000","last_undegraded":"2024-09-17T05:41:59.474943+0000","last_fullsized":"2024-09-17T05:41:59.474943+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_clean_scrub_stamp":"2024-09-17T05:41:56.913963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:39:02.325349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T05:41:58.945079+0000","last_change":"2024-09-17T05:41:57.960551+0000","last_active":"2024-09-17T05:41:58.945079+0000","last_peered":"2024-09-17T05:41:58.945079+0000","last_clean":"2024-09-17T05:41:58.945079+0000","last_became_active":"2024-09-17T05:41:57.959025+0000","last_became_peered":"2024-09-17T05:41:57.959025+0000","last_unstale":"2024-09-17T05:41:58.945079+0000","last_undegraded":"2024-09-17T05:41:58.945079+0000","last_fullsized":"2024-09-17T05:41:58.945079+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_clean_scrub_stamp":"2024-09-17T05:41:56.913963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:25:08.628947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T05:41:59.439140+0000","last_change":"2024-09-17T05:41:57.944300+0000","last_active":"2024-09-17T05:41:59.439140+0000","last_peered":"2024-09-17T05:41:59.439140+0000","last_clean":"2024-09-17T05:41:59.439140+0000","last_became_active":"2024-09-17T05:41:57.943968+0000","last_became_peered":"2024-09-17T05:41:57.943968+0000","last_unstale":"2024-09-17T05:41:59.439140+0000","last_undegraded":"2024-09-17T05:41:59.439140+0000","last_fullsized":"2024-09-17T05:41:59.439140+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_clean_scrub_stamp":"2024-09-17T05:41:56.913963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:10:39.584426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T05:41:58.943325+0000","last_change":"2024-09-17T05:41:57.961208+0000","last_active":"2024-09-17T05:41:58.943325+0000","last_peered":"2024-09-17T05:41:58.943325+0000","last_clean":"2024-09-17T05:41:58.943325+0000","last_became_active":"2024-09-17T05:41:57.960878+0000","last_became_peered":"2024-09-17T05:41:57.960878+0000","last_unstale":"2024-09-17T05:41:58.943325+0000","last_undegraded":"2024-09-17T05:41:58.943325+0000","last_fullsized":"2024-09-17T05:41:58.943325+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_clean_scrub_stamp":"2024-09-17T05:41:56.913963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:12:19.292703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T05:41:59.016320+0000","last_change":"2024-09-17T05:41:57.941348+0000","last_active":"2024-09-17T05:41:59.016320+0000","last_peered":"2024-09-17T05:41:59.016320+0000","last_clean":"2024-09-17T05:41:59.016320+0000","last_became_active":"2024-09-17T05:41:57.940996+0000","last_became_peered":"2024-09-17T05:41:57.940996+0000","last_unstale":"2024-09-17T05:41:59.016320+0000","last_undegraded":"2024-09-17T05:41:59.016320+0000","last_fullsized":"2024-09-17T05:41:59.016320+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_clean_scrub_stamp":"2024-09-17T05:41:56.913963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:16:33.582921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"22'1","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T05:41:58.942753+0000","last_change":"2024-09-17T05:41:56.942225+0000","last_active":"2024-09-17T05:41:58.942753+0000","last_peered":"2024-09-17T05:41:58.942753+0000","last_clean":"2024-09-17T05:41:58.942753+0000","last_became_active":"2024-09-17T05:41:56.941896+0000","last_became_peered":"2024-09-17T05:41:56.941896+0000","last_unstale":"2024-09-17T05:41:58.942753+0000","last_undegraded":"2024-09-17T05:41:58.942753+0000","last_fullsized":"2024-09-17T05:41:58.942753+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:55.904533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:55.904533+0000","last_clean_scrub_stamp":"2024-09-17T05:41:55.904533+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:52:11.112857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T05:41:59.475111+0000","last_change":"2024-09-17T05:41:57.943603+0000","last_active":"2024-09-17T05:41:59.475111+0000","last_peered":"2024-09-17T05:41:59.475111+0000","last_clean":"2024-09-17T05:41:59.475111+0000","last_became_active":"2024-09-17T05:41:57.942873+0000","last_became_peered":"2024-09-17T05:41:57.942873+0000","last_unstale":"2024-09-17T05:41:59.475111+0000","last_undegraded":"2024-09-17T05:41:59.475111+0000","last_fullsized":"2024-09-17T05:41:59.475111+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_clean_scrub_stamp":"2024-09-17T05:41:56.913963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:09:10.790006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"22'1","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T05:41:58.943600+0000","last_change":"2024-09-17T05:41:56.940706+0000","last_active":"2024-09-17T05:41:58.943600+0000","last_peered":"2024-09-17T05:41:58.943600+0000","last_clean":"2024-09-17T05:41:58.943600+0000","last_became_active":"2024-09-17T05:41:56.940324+0000","last_became_peered":"2024-09-17T05:41:56.940324+0000","last_unstale":"2024-09-17T05:41:58.943600+0000","last_undegraded":"2024-09-17T05:41:58.943600+0000","last_fullsized":"2024-09-17T05:41:58.943600+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:55.904533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:55.904533+0000","last_clean_scrub_stamp":"2024-09-17T05:41:55.904533+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:58:41.828120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T05:41:58.942401+0000","last_change":"2024-09-17T05:41:56.941270+0000","last_active":"2024-09-17T05:41:58.942401+0000","last_peered":"2024-09-17T05:41:58.942401+0000","last_clean":"2024-09-17T05:41:58.942401+0000","last_became_active":"2024-09-17T05:41:56.940963+0000","last_became_peered":"2024-09-17T05:41:56.940963+0000","last_unstale":"2024-09-17T05:41:58.942401+0000","last_undegraded":"2024-09-17T05:41:58.942401+0000","last_fullsized":"2024-09-17T05:41:58.942401+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:55.904533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:55.904533+0000","last_clean_scrub_stamp":"2024-09-17T05:41:55.904533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:05:42.524613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T05:41:58.942321+0000","last_change":"2024-09-17T05:41:57.945651+0000","last_active":"2024-09-17T05:41:58.942321+0000","last_peered":"2024-09-17T05:41:58.942321+0000","last_clean":"2024-09-17T05:41:58.942321+0000","last_became_active":"2024-09-17T05:41:57.945322+0000","last_became_peered":"2024-09-17T05:41:57.945322+0000","last_unstale":"2024-09-17T05:41:58.942321+0000","last_undegraded":"2024-09-17T05:41:58.942321+0000","last_fullsized":"2024-09-17T05:41:58.942321+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_clean_scrub_stamp":"2024-09-17T05:41:56.913963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:29:37.607962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T05:41:58.944500+0000","last_change":"2024-09-17T05:41:56.937560+0000","last_active":"2024-09-17T05:41:58.944500+0000","last_peered":"2024-09-17T05:41:58.944500+0000","last_clean":"2024-09-17T05:41:58.944500+0000","last_became_active":"2024-09-17T05:41:56.937222+0000","last_became_peered":"2024-09-17T05:41:56.937222+0000","last_unstale":"2024-09-17T05:41:58.944500+0000","last_undegraded":"2024-09-17T05:41:58.944500+0000","last_fullsized":"2024-09-17T05:41:58.944500+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:55.904533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:55.904533+0000","last_clean_scrub_stamp":"2024-09-17T05:41:55.904533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:44:48.206421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T05:41:59.474386+0000","last_change":"2024-09-17T05:41:57.956574+0000","last_active":"2024-09-17T05:41:59.474386+0000","last_peered":"2024-09-17T05:41:59.474386+0000","last_clean":"2024-09-17T05:41:59.474386+0000","last_became_active":"2024-09-17T05:41:57.956273+0000","last_became_peered":"2024-09-17T05:41:57.956273+0000","last_unstale":"2024-09-17T05:41:59.474386+0000","last_undegraded":"2024-09-17T05:41:59.474386+0000","last_fullsized":"2024-09-17T05:41:59.474386+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_clean_scrub_stamp":"2024-09-17T05:41:56.913963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:38:43.072798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T05:41:58.943638+0000","last_change":"2024-09-17T05:41:56.949682+0000","last_active":"2024-09-17T05:41:58.943638+0000","last_peered":"2024-09-17T05:41:58.943638+0000","last_clean":"2024-09-17T05:41:58.943638+0000","last_became_active":"2024-09-17T05:41:56.949271+0000","last_became_peered":"2024-09-17T05:41:56.949271+0000","last_unstale":"2024-09-17T05:41:58.943638+0000","last_undegraded":"2024-09-17T05:41:58.943638+0000","last_fullsized":"2024-09-17T05:41:58.943638+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:55.904533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:55.904533+0000","last_clean_scrub_stamp":"2024-09-17T05:41:55.904533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:54:22.588557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T05:41:58.945643+0000","last_change":"2024-09-17T05:41:57.950606+0000","last_active":"2024-09-17T05:41:58.945643+0000","last_peered":"2024-09-17T05:41:58.945643+0000","last_clean":"2024-09-17T05:41:58.945643+0000","last_became_active":"2024-09-17T05:41:57.950284+0000","last_became_peered":"2024-09-17T05:41:57.950284+0000","last_unstale":"2024-09-17T05:41:58.945643+0000","last_undegraded":"2024-09-17T05:41:58.945643+0000","last_fullsized":"2024-09-17T05:41:58.945643+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_clean_scrub_stamp":"2024-09-17T05:41:56.913963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:20:54.930864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T05:41:58.945336+0000","last_change":"2024-09-17T05:41:56.946865+0000","last_active":"2024-09-17T05:41:58.945336+0000","last_peered":"2024-09-17T05:41:58.945336+0000","last_clean":"2024-09-17T05:41:58.945336+0000","last_became_active":"2024-09-17T05:41:56.946178+0000","last_became_peered":"2024-09-17T05:41:56.946178+0000","last_unstale":"2024-09-17T05:41:58.945336+0000","last_undegraded":"2024-09-17T05:41:58.945336+0000","last_fullsized":"2024-09-17T05:41:58.945336+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:55.904533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:55.904533+0000","last_clean_scrub_stamp":"2024-09-17T05:41:55.904533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:13:02.431112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T05:41:59.475067+0000","last_change":"2024-09-17T05:41:57.948150+0000","last_active":"2024-09-17T05:41:59.475067+0000","last_peered":"2024-09-17T05:41:59.475067+0000","last_clean":"2024-09-17T05:41:59.475067+0000","last_became_active":"2024-09-17T05:41:57.947204+0000","last_became_peered":"2024-09-17T05:41:57.947204+0000","last_unstale":"2024-09-17T05:41:59.475067+0000","last_undegraded":"2024-09-17T05:41:59.475067+0000","last_fullsized":"2024-09-17T05:41:59.475067+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_clean_scrub_stamp":"2024-09-17T05:41:56.913963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:54:14.610066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"22'3","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T05:41:59.474459+0000","last_change":"2024-09-17T05:41:56.944839+0000","last_active":"2024-09-17T05:41:59.474459+0000","last_peered":"2024-09-17T05:41:59.474459+0000","last_clean":"2024-09-17T05:41:59.474459+0000","last_became_active":"2024-09-17T05:41:56.944471+0000","last_became_peered":"2024-09-17T05:41:56.944471+0000","last_unstale":"2024-09-17T05:41:59.474459+0000","last_undegraded":"2024-09-17T05:41:59.474459+0000","last_fullsized":"2024-09-17T05:41:59.474459+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:55.904533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:55.904533+0000","last_clean_scrub_stamp":"2024-09-17T05:41:55.904533+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:56:02.887851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T05:41:59.016465+0000","last_change":"2024-09-17T05:41:57.949459+0000","last_active":"2024-09-17T05:41:59.016465+0000","last_peered":"2024-09-17T05:41:59.016465+0000","last_clean":"2024-09-17T05:41:59.016465+0000","last_became_active":"2024-09-17T05:41:57.949148+0000","last_became_peered":"2024-09-17T05:41:57.949148+0000","last_unstale":"2024-09-17T05:41:59.016465+0000","last_undegraded":"2024-09-17T05:41:59.016465+0000","last_fullsized":"2024-09-17T05:41:59.016465+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_clean_scrub_stamp":"2024-09-17T05:41:56.913963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:47:33.448576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"22'6","reported_seq":21,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T05:41:58.943864+0000","last_change":"2024-09-17T05:41:56.951074+0000","last_active":"2024-09-17T05:41:58.943864+0000","last_peered":"2024-09-17T05:41:58.943864+0000","last_clean":"2024-09-17T05:41:58.943864+0000","last_became_active":"2024-09-17T05:41:56.950549+0000","last_became_peered":"2024-09-17T05:41:56.950549+0000","last_unstale":"2024-09-17T05:41:58.943864+0000","last_undegraded":"2024-09-17T05:41:58.943864+0000","last_fullsized":"2024-09-17T05:41:58.943864+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:55.904533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:55.904533+0000","last_clean_scrub_stamp":"2024-09-17T05:41:55.904533+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:07:52.122462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T05:41:59.475337+0000","last_change":"2024-09-17T05:41:57.951740+0000","last_active":"2024-09-17T05:41:59.475337+0000","last_peered":"2024-09-17T05:41:59.475337+0000","last_clean":"2024-09-17T05:41:59.475337+0000","last_became_active":"2024-09-17T05:41:57.949411+0000","last_became_peered":"2024-09-17T05:41:57.949411+0000","last_unstale":"2024-09-17T05:41:59.475337+0000","last_undegraded":"2024-09-17T05:41:59.475337+0000","last_fullsized":"2024-09-17T05:41:59.475337+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_clean_scrub_stamp":"2024-09-17T05:41:56.913963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:46:38.117672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"22'2","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T05:41:59.475117+0000","last_change":"2024-09-17T05:41:56.939288+0000","last_active":"2024-09-17T05:41:59.475117+0000","last_peered":"2024-09-17T05:41:59.475117+0000","last_clean":"2024-09-17T05:41:59.475117+0000","last_became_active":"2024-09-17T05:41:56.938951+0000","last_became_peered":"2024-09-17T05:41:56.938951+0000","last_unstale":"2024-09-17T05:41:59.475117+0000","last_undegraded":"2024-09-17T05:41:59.475117+0000","last_fullsized":"2024-09-17T05:41:59.475117+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:55.904533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:55.904533+0000","last_clean_scrub_stamp":"2024-09-17T05:41:55.904533+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:41:47.665206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T05:41:59.474748+0000","last_change":"2024-09-17T05:41:57.953556+0000","last_active":"2024-09-17T05:41:59.474748+0000","last_peered":"2024-09-17T05:41:59.474748+0000","last_clean":"2024-09-17T05:41:59.474748+0000","last_became_active":"2024-09-17T05:41:57.953229+0000","last_became_peered":"2024-09-17T05:41:57.953229+0000","last_unstale":"2024-09-17T05:41:59.474748+0000","last_undegraded":"2024-09-17T05:41:59.474748+0000","last_fullsized":"2024-09-17T05:41:59.474748+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_clean_scrub_stamp":"2024-09-17T05:41:56.913963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:57:29.940550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T05:41:58.944960+0000","last_change":"2024-09-17T05:41:56.951172+0000","last_active":"2024-09-17T05:41:58.944960+0000","last_peered":"2024-09-17T05:41:58.944960+0000","last_clean":"2024-09-17T05:41:58.944960+0000","last_became_active":"2024-09-17T05:41:56.950572+0000","last_became_peered":"2024-09-17T05:41:56.950572+0000","last_unstale":"2024-09-17T05:41:58.944960+0000","last_undegraded":"2024-09-17T05:41:58.944960+0000","last_fullsized":"2024-09-17T05:41:58.944960+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:55.904533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:55.904533+0000","last_clean_scrub_stamp":"2024-09-17T05:41:55.904533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:48:08.016947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T05:41:59.475097+0000","last_change":"2024-09-17T05:41:57.948898+0000","last_active":"2024-09-17T05:41:59.475097+0000","last_peered":"2024-09-17T05:41:59.475097+0000","last_clean":"2024-09-17T05:41:59.475097+0000","last_became_active":"2024-09-17T05:41:57.948128+0000","last_became_peered":"2024-09-17T05:41:57.948128+0000","last_unstale":"2024-09-17T05:41:59.475097+0000","last_undegraded":"2024-09-17T05:41:59.475097+0000","last_fullsized":"2024-09-17T05:41:59.475097+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_clean_scrub_stamp":"2024-09-17T05:41:56.913963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:48:25.095548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T05:41:58.943359+0000","last_change":"2024-09-17T05:41:56.946833+0000","last_active":"2024-09-17T05:41:58.943359+0000","last_peered":"2024-09-17T05:41:58.943359+0000","last_clean":"2024-09-17T05:41:58.943359+0000","last_became_active":"2024-09-17T05:41:56.946545+0000","last_became_peered":"2024-09-17T05:41:56.946545+0000","last_unstale":"2024-09-17T05:41:58.943359+0000","last_undegraded":"2024-09-17T05:41:58.943359+0000","last_fullsized":"2024-09-17T05:41:58.943359+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:55.904533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:55.904533+0000","last_clean_scrub_stamp":"2024-09-17T05:41:55.904533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:09:48.472258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T05:41:58.943449+0000","last_change":"2024-09-17T05:41:57.959487+0000","last_active":"2024-09-17T05:41:58.943449+0000","last_peered":"2024-09-17T05:41:58.943449+0000","last_clean":"2024-09-17T05:41:58.943449+0000","last_became_active":"2024-09-17T05:41:57.959140+0000","last_became_peered":"2024-09-17T05:41:57.959140+0000","last_unstale":"2024-09-17T05:41:58.943449+0000","last_undegraded":"2024-09-17T05:41:58.943449+0000","last_fullsized":"2024-09-17T05:41:58.943449+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_clean_scrub_stamp":"2024-09-17T05:41:56.913963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:34:29.009088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"22'8","reported_seq":23,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T05:41:59.438858+0000","last_change":"2024-09-17T05:41:56.936984+0000","last_active":"2024-09-17T05:41:59.438858+0000","last_peered":"2024-09-17T05:41:59.438858+0000","last_clean":"2024-09-17T05:41:59.438858+0000","last_became_active":"2024-09-17T05:41:56.936527+0000","last_became_peered":"2024-09-17T05:41:56.936527+0000","last_unstale":"2024-09-17T05:41:59.438858+0000","last_undegraded":"2024-09-17T05:41:59.438858+0000","last_fullsized":"2024-09-17T05:41:59.438858+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:55.904533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:55.904533+0000","last_clean_scrub_stamp":"2024-09-17T05:41:55.904533+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:52:11.112857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T05:41:59.474947+0000","last_change":"2024-09-17T05:41:57.952945+0000","last_active":"2024-09-17T05:41:59.474947+0000","last_peered":"2024-09-17T05:41:59.474947+0000","last_clean":"2024-09-17T05:41:59.474947+0000","last_became_active":"2024-09-17T05:41:57.952616+0000","last_became_peered":"2024-09-17T05:41:57.952616+0000","last_unstale":"2024-09-17T05:41:59.474947+0000","last_undegraded":"2024-09-17T05:41:59.474947+0000","last_fullsized":"2024-09-17T05:41:59.474947+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_clean_scrub_stamp":"2024-09-17T05:41:56.913963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:01:33.862442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"22'1","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T05:41:59.016349+0000","last_change":"2024-09-17T05:41:56.940794+0000","last_active":"2024-09-17T05:41:59.016349+0000","last_peered":"2024-09-17T05:41:59.016349+0000","last_clean":"2024-09-17T05:41:59.016349+0000","last_became_active":"2024-09-17T05:41:56.940422+0000","last_became_peered":"2024-09-17T05:41:56.940422+0000","last_unstale":"2024-09-17T05:41:59.016349+0000","last_undegraded":"2024-09-17T05:41:59.016349+0000","last_fullsized":"2024-09-17T05:41:59.016349+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:55.904533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:55.904533+0000","last_clean_scrub_stamp":"2024-09-17T05:41:55.904533+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:54:47.244836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T05:41:59.475443+0000","last_change":"2024-09-17T05:41:57.947961+0000","last_active":"2024-09-17T05:41:59.475443+0000","last_peered":"2024-09-17T05:41:59.475443+0000","last_clean":"2024-09-17T05:41:59.475443+0000","last_became_active":"2024-09-17T05:41:57.947614+0000","last_became_peered":"2024-09-17T05:41:57.947614+0000","last_unstale":"2024-09-17T05:41:59.475443+0000","last_undegraded":"2024-09-17T05:41:59.475443+0000","last_fullsized":"2024-09-17T05:41:59.475443+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_clean_scrub_stamp":"2024-09-17T05:41:56.913963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:43:21.632222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"22'2","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T05:41:59.439083+0000","last_change":"2024-09-17T05:41:56.945839+0000","last_active":"2024-09-17T05:41:59.439083+0000","last_peered":"2024-09-17T05:41:59.439083+0000","last_clean":"2024-09-17T05:41:59.439083+0000","last_became_active":"2024-09-17T05:41:56.945482+0000","last_became_peered":"2024-09-17T05:41:56.945482+0000","last_unstale":"2024-09-17T05:41:59.439083+0000","last_undegraded":"2024-09-17T05:41:59.439083+0000","last_fullsized":"2024-09-17T05:41:59.439083+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:55.904533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:55.904533+0000","last_clean_scrub_stamp":"2024-09-17T05:41:55.904533+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:29:45.382484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T05:41:59.475905+0000","last_change":"2024-09-17T05:41:57.951359+0000","last_active":"2024-09-17T05:41:59.475905+0000","last_peered":"2024-09-17T05:41:59.475905+0000","last_clean":"2024-09-17T05:41:59.475905+0000","last_became_active":"2024-09-17T05:41:57.951044+0000","last_became_peered":"2024-09-17T05:41:57.951044+0000","last_unstale":"2024-09-17T05:41:59.475905+0000","last_undegraded":"2024-09-17T05:41:59.475905+0000","last_fullsized":"2024-09-17T05:41:59.475905+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_clean_scrub_stamp":"2024-09-17T05:41:56.913963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:02:29.481829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"22'1","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T05:41:59.474576+0000","last_change":"2024-09-17T05:41:56.933514+0000","last_active":"2024-09-17T05:41:59.474576+0000","last_peered":"2024-09-17T05:41:59.474576+0000","last_clean":"2024-09-17T05:41:59.474576+0000","last_became_active":"2024-09-17T05:41:56.932986+0000","last_became_peered":"2024-09-17T05:41:56.932986+0000","last_unstale":"2024-09-17T05:41:59.474576+0000","last_undegraded":"2024-09-17T05:41:59.474576+0000","last_fullsized":"2024-09-17T05:41:59.474576+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:55.904533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:55.904533+0000","last_clean_scrub_stamp":"2024-09-17T05:41:55.904533+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:28:05.866271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T05:41:58.945138+0000","last_change":"2024-09-17T05:41:57.946536+0000","last_active":"2024-09-17T05:41:58.945138+0000","last_peered":"2024-09-17T05:41:58.945138+0000","last_clean":"2024-09-17T05:41:58.945138+0000","last_became_active":"2024-09-17T05:41:57.946168+0000","last_became_peered":"2024-09-17T05:41:57.946168+0000","last_unstale":"2024-09-17T05:41:58.945138+0000","last_undegraded":"2024-09-17T05:41:58.945138+0000","last_fullsized":"2024-09-17T05:41:58.945138+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_clean_scrub_stamp":"2024-09-17T05:41:56.913963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:48:25.095548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T05:41:59.438980+0000","last_change":"2024-09-17T05:41:56.944626+0000","last_active":"2024-09-17T05:41:59.438980+0000","last_peered":"2024-09-17T05:41:59.438980+0000","last_clean":"2024-09-17T05:41:59.438980+0000","last_became_active":"2024-09-17T05:41:56.944259+0000","last_became_peered":"2024-09-17T05:41:56.944259+0000","last_unstale":"2024-09-17T05:41:59.438980+0000","last_undegraded":"2024-09-17T05:41:59.438980+0000","last_fullsized":"2024-09-17T05:41:59.438980+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:55.904533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:55.904533+0000","last_clean_scrub_stamp":"2024-09-17T05:41:55.904533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:48:09.067501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T05:41:59.475567+0000","last_change":"2024-09-17T05:41:57.958128+0000","last_active":"2024-09-17T05:41:59.475567+0000","last_peered":"2024-09-17T05:41:59.475567+0000","last_clean":"2024-09-17T05:41:59.475567+0000","last_became_active":"2024-09-17T05:41:57.957831+0000","last_became_peered":"2024-09-17T05:41:57.957831+0000","last_unstale":"2024-09-17T05:41:59.475567+0000","last_undegraded":"2024-09-17T05:41:59.475567+0000","last_fullsized":"2024-09-17T05:41:59.475567+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_clean_scrub_stamp":"2024-09-17T05:41:56.913963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:14:34.774799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"19'72","reported_seq":111,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T05:41:59.474999+0000","last_change":"2024-09-17T05:41:48.539830+0000","last_active":"2024-09-17T05:41:59.474999+0000","last_peered":"2024-09-17T05:41:59.474999+0000","last_clean":"2024-09-17T05:41:59.474999+0000","last_became_active":"2024-09-17T05:41:48.538743+0000","last_became_peered":"2024-09-17T05:41:48.538743+0000","last_unstale":"2024-09-17T05:41:59.474999+0000","last_undegraded":"2024-09-17T05:41:59.474999+0000","last_fullsized":"2024-09-17T05:41:59.474999+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:47.152539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:47.152539+0000","last_clean_scrub_stamp":"2024-09-17T05:41:47.152539+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:08:02.952016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T05:41:58.944539+0000","last_change":"2024-09-17T05:41:56.939827+0000","last_active":"2024-09-17T05:41:58.944539+0000","last_peered":"2024-09-17T05:41:58.944539+0000","last_clean":"2024-09-17T05:41:58.944539+0000","last_became_active":"2024-09-17T05:41:56.939471+0000","last_became_peered":"2024-09-17T05:41:56.939471+0000","last_unstale":"2024-09-17T05:41:58.944539+0000","last_undegraded":"2024-09-17T05:41:58.944539+0000","last_fullsized":"2024-09-17T05:41:58.944539+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:55.904533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:55.904533+0000","last_clean_scrub_stamp":"2024-09-17T05:41:55.904533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:50:15.165851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T05:41:58.942493+0000","last_change":"2024-09-17T05:41:57.957954+0000","last_active":"2024-09-17T05:41:58.942493+0000","last_peered":"2024-09-17T05:41:58.942493+0000","last_clean":"2024-09-17T05:41:58.942493+0000","last_became_active":"2024-09-17T05:41:57.957629+0000","last_became_peered":"2024-09-17T05:41:57.957629+0000","last_unstale":"2024-09-17T05:41:58.942493+0000","last_undegraded":"2024-09-17T05:41:58.942493+0000","last_fullsized":"2024-09-17T05:41:58.942493+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_clean_scrub_stamp":"2024-09-17T05:41:56.913963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:04:12.932656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T05:41:59.474681+0000","last_change":"2024-09-17T05:41:56.952027+0000","last_active":"2024-09-17T05:41:59.474681+0000","last_peered":"2024-09-17T05:41:59.474681+0000","last_clean":"2024-09-17T05:41:59.474681+0000","last_became_active":"2024-09-17T05:41:56.951679+0000","last_became_peered":"2024-09-17T05:41:56.951679+0000","last_unstale":"2024-09-17T05:41:59.474681+0000","last_undegraded":"2024-09-17T05:41:59.474681+0000","last_fullsized":"2024-09-17T05:41:59.474681+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:55.904533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:55.904533+0000","last_clean_scrub_stamp":"2024-09-17T05:41:55.904533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:12:33.222805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T05:41:59.474246+0000","last_change":"2024-09-17T05:41:57.943470+0000","last_active":"2024-09-17T05:41:59.474246+0000","last_peered":"2024-09-17T05:41:59.474246+0000","last_clean":"2024-09-17T05:41:59.474246+0000","last_became_active":"2024-09-17T05:41:57.943015+0000","last_became_peered":"2024-09-17T05:41:57.943015+0000","last_unstale":"2024-09-17T05:41:59.474246+0000","last_undegraded":"2024-09-17T05:41:59.474246+0000","last_fullsized":"2024-09-17T05:41:59.474246+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_clean_scrub_stamp":"2024-09-17T05:41:56.913963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:42:36.013480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T05:41:59.438944+0000","last_change":"2024-09-17T05:41:56.939919+0000","last_active":"2024-09-17T05:41:59.438944+0000","last_peered":"2024-09-17T05:41:59.438944+0000","last_clean":"2024-09-17T05:41:59.438944+0000","last_became_active":"2024-09-17T05:41:56.939608+0000","last_became_peered":"2024-09-17T05:41:56.939608+0000","last_unstale":"2024-09-17T05:41:59.438944+0000","last_undegraded":"2024-09-17T05:41:59.438944+0000","last_fullsized":"2024-09-17T05:41:59.438944+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:55.904533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:55.904533+0000","last_clean_scrub_stamp":"2024-09-17T05:41:55.904533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:27:37.482839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T05:41:59.474317+0000","last_change":"2024-09-17T05:41:57.947137+0000","last_active":"2024-09-17T05:41:59.474317+0000","last_peered":"2024-09-17T05:41:59.474317+0000","last_clean":"2024-09-17T05:41:59.474317+0000","last_became_active":"2024-09-17T05:41:57.946767+0000","last_became_peered":"2024-09-17T05:41:57.946767+0000","last_unstale":"2024-09-17T05:41:59.474317+0000","last_undegraded":"2024-09-17T05:41:59.474317+0000","last_fullsized":"2024-09-17T05:41:59.474317+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_clean_scrub_stamp":"2024-09-17T05:41:56.913963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:04:12.932656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T05:41:58.945106+0000","last_change":"2024-09-17T05:41:56.938012+0000","last_active":"2024-09-17T05:41:58.945106+0000","last_peered":"2024-09-17T05:41:58.945106+0000","last_clean":"2024-09-17T05:41:58.945106+0000","last_became_active":"2024-09-17T05:41:56.937706+0000","last_became_peered":"2024-09-17T05:41:56.937706+0000","last_unstale":"2024-09-17T05:41:58.945106+0000","last_undegraded":"2024-09-17T05:41:58.945106+0000","last_fullsized":"2024-09-17T05:41:58.945106+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:55.904533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:55.904533+0000","last_clean_scrub_stamp":"2024-09-17T05:41:55.904533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:22:56.364485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T05:41:59.016310+0000","last_change":"2024-09-17T05:41:57.942237+0000","last_active":"2024-09-17T05:41:59.016310+0000","last_peered":"2024-09-17T05:41:59.016310+0000","last_clean":"2024-09-17T05:41:59.016310+0000","last_became_active":"2024-09-17T05:41:57.941725+0000","last_became_peered":"2024-09-17T05:41:57.941725+0000","last_unstale":"2024-09-17T05:41:59.016310+0000","last_undegraded":"2024-09-17T05:41:59.016310+0000","last_fullsized":"2024-09-17T05:41:59.016310+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_clean_scrub_stamp":"2024-09-17T05:41:56.913963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:22:57.373916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T05:41:59.474242+0000","last_change":"2024-09-17T05:41:56.939274+0000","last_active":"2024-09-17T05:41:59.474242+0000","last_peered":"2024-09-17T05:41:59.474242+0000","last_clean":"2024-09-17T05:41:59.474242+0000","last_became_active":"2024-09-17T05:41:56.938944+0000","last_became_peered":"2024-09-17T05:41:56.938944+0000","last_unstale":"2024-09-17T05:41:59.474242+0000","last_undegraded":"2024-09-17T05:41:59.474242+0000","last_fullsized":"2024-09-17T05:41:59.474242+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:55.904533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:55.904533+0000","last_clean_scrub_stamp":"2024-09-17T05:41:55.904533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:29:45.382484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T05:41:58.945559+0000","last_change":"2024-09-17T05:41:57.943883+0000","last_active":"2024-09-17T05:41:58.945559+0000","last_peered":"2024-09-17T05:41:58.945559+0000","last_clean":"2024-09-17T05:41:58.945559+0000","last_became_active":"2024-09-17T05:41:57.943565+0000","last_became_peered":"2024-09-17T05:41:57.943565+0000","last_unstale":"2024-09-17T05:41:58.945559+0000","last_undegraded":"2024-09-17T05:41:58.945559+0000","last_fullsized":"2024-09-17T05:41:58.945559+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_clean_scrub_stamp":"2024-09-17T05:41:56.913963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:14:34.774799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T05:41:59.475657+0000","last_change":"2024-09-17T05:41:56.950966+0000","last_active":"2024-09-17T05:41:59.475657+0000","last_peered":"2024-09-17T05:41:59.475657+0000","last_clean":"2024-09-17T05:41:59.475657+0000","last_became_active":"2024-09-17T05:41:56.950558+0000","last_became_peered":"2024-09-17T05:41:56.950558+0000","last_unstale":"2024-09-17T05:41:59.475657+0000","last_undegraded":"2024-09-17T05:41:59.475657+0000","last_fullsized":"2024-09-17T05:41:59.475657+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:55.904533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:55.904533+0000","last_clean_scrub_stamp":"2024-09-17T05:41:55.904533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:23:55.121185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T05:41:59.474260+0000","last_change":"2024-09-17T05:41:57.946228+0000","last_active":"2024-09-17T05:41:59.474260+0000","last_peered":"2024-09-17T05:41:59.474260+0000","last_clean":"2024-09-17T05:41:59.474260+0000","last_became_active":"2024-09-17T05:41:57.945883+0000","last_became_peered":"2024-09-17T05:41:57.945883+0000","last_unstale":"2024-09-17T05:41:59.474260+0000","last_undegraded":"2024-09-17T05:41:59.474260+0000","last_fullsized":"2024-09-17T05:41:59.474260+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_clean_scrub_stamp":"2024-09-17T05:41:56.913963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:47:26.590424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"23'1","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T05:41:59.474737+0000","last_change":"2024-09-17T05:41:56.944059+0000","last_active":"2024-09-17T05:41:59.474737+0000","last_peered":"2024-09-17T05:41:59.474737+0000","last_clean":"2024-09-17T05:41:59.474737+0000","last_became_active":"2024-09-17T05:41:56.943687+0000","last_became_peered":"2024-09-17T05:41:56.943687+0000","last_unstale":"2024-09-17T05:41:59.474737+0000","last_undegraded":"2024-09-17T05:41:59.474737+0000","last_fullsized":"2024-09-17T05:41:59.474737+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:55.904533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:55.904533+0000","last_clean_scrub_stamp":"2024-09-17T05:41:55.904533+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:45:41.328997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T05:41:58.942699+0000","last_change":"2024-09-17T05:41:57.952421+0000","last_active":"2024-09-17T05:41:58.942699+0000","last_peered":"2024-09-17T05:41:58.942699+0000","last_clean":"2024-09-17T05:41:58.942699+0000","last_became_active":"2024-09-17T05:41:57.952090+0000","last_became_peered":"2024-09-17T05:41:57.952090+0000","last_unstale":"2024-09-17T05:41:58.942699+0000","last_undegraded":"2024-09-17T05:41:58.942699+0000","last_fullsized":"2024-09-17T05:41:58.942699+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_clean_scrub_stamp":"2024-09-17T05:41:56.913963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:24:24.651104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"22'2","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T05:41:58.943750+0000","last_change":"2024-09-17T05:41:56.947816+0000","last_active":"2024-09-17T05:41:58.943750+0000","last_peered":"2024-09-17T05:41:58.943750+0000","last_clean":"2024-09-17T05:41:58.943750+0000","last_became_active":"2024-09-17T05:41:56.947483+0000","last_became_peered":"2024-09-17T05:41:56.947483+0000","last_unstale":"2024-09-17T05:41:58.943750+0000","last_undegraded":"2024-09-17T05:41:58.943750+0000","last_fullsized":"2024-09-17T05:41:58.943750+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:55.904533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:55.904533+0000","last_clean_scrub_stamp":"2024-09-17T05:41:55.904533+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:02:05.360497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T05:41:59.474648+0000","last_change":"2024-09-17T05:41:57.950209+0000","last_active":"2024-09-17T05:41:59.474648+0000","last_peered":"2024-09-17T05:41:59.474648+0000","last_clean":"2024-09-17T05:41:59.474648+0000","last_became_active":"2024-09-17T05:41:57.949869+0000","last_became_peered":"2024-09-17T05:41:57.949869+0000","last_unstale":"2024-09-17T05:41:59.474648+0000","last_undegraded":"2024-09-17T05:41:59.474648+0000","last_fullsized":"2024-09-17T05:41:59.474648+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_clean_scrub_stamp":"2024-09-17T05:41:56.913963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:04:39.620332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T05:41:59.474670+0000","last_change":"2024-09-17T05:41:56.950895+0000","last_active":"2024-09-17T05:41:59.474670+0000","last_peered":"2024-09-17T05:41:59.474670+0000","last_clean":"2024-09-17T05:41:59.474670+0000","last_became_active":"2024-09-17T05:41:56.950518+0000","last_became_peered":"2024-09-17T05:41:56.950518+0000","last_unstale":"2024-09-17T05:41:59.474670+0000","last_undegraded":"2024-09-17T05:41:59.474670+0000","last_fullsized":"2024-09-17T05:41:59.474670+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:55.904533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:55.904533+0000","last_clean_scrub_stamp":"2024-09-17T05:41:55.904533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:28:05.866271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T05:41:59.016224+0000","last_change":"2024-09-17T05:41:57.937269+0000","last_active":"2024-09-17T05:41:59.016224+0000","last_peered":"2024-09-17T05:41:59.016224+0000","last_clean":"2024-09-17T05:41:59.016224+0000","last_became_active":"2024-09-17T05:41:57.936899+0000","last_became_peered":"2024-09-17T05:41:57.936899+0000","last_unstale":"2024-09-17T05:41:59.016224+0000","last_undegraded":"2024-09-17T05:41:59.016224+0000","last_fullsized":"2024-09-17T05:41:59.016224+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_clean_scrub_stamp":"2024-09-17T05:41:56.913963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:48:09.026377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T05:41:59.474242+0000","last_change":"2024-09-17T05:41:56.942310+0000","last_active":"2024-09-17T05:41:59.474242+0000","last_peered":"2024-09-17T05:41:59.474242+0000","last_clean":"2024-09-17T05:41:59.474242+0000","last_became_active":"2024-09-17T05:41:56.941965+0000","last_became_peered":"2024-09-17T05:41:56.941965+0000","last_unstale":"2024-09-17T05:41:59.474242+0000","last_undegraded":"2024-09-17T05:41:59.474242+0000","last_fullsized":"2024-09-17T05:41:59.474242+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:55.904533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:55.904533+0000","last_clean_scrub_stamp":"2024-09-17T05:41:55.904533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:16:32.573490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T05:41:58.942903+0000","last_change":"2024-09-17T05:41:57.954269+0000","last_active":"2024-09-17T05:41:58.942903+0000","last_peered":"2024-09-17T05:41:58.942903+0000","last_clean":"2024-09-17T05:41:58.942903+0000","last_became_active":"2024-09-17T05:41:57.953932+0000","last_became_peered":"2024-09-17T05:41:57.953932+0000","last_unstale":"2024-09-17T05:41:58.942903+0000","last_undegraded":"2024-09-17T05:41:58.942903+0000","last_fullsized":"2024-09-17T05:41:58.942903+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_clean_scrub_stamp":"2024-09-17T05:41:56.913963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:01:33.862442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T05:41:59.474364+0000","last_change":"2024-09-17T05:41:56.940176+0000","last_active":"2024-09-17T05:41:59.474364+0000","last_peered":"2024-09-17T05:41:59.474364+0000","last_clean":"2024-09-17T05:41:59.474364+0000","last_became_active":"2024-09-17T05:41:56.939850+0000","last_became_peered":"2024-09-17T05:41:56.939850+0000","last_unstale":"2024-09-17T05:41:59.474364+0000","last_undegraded":"2024-09-17T05:41:59.474364+0000","last_fullsized":"2024-09-17T05:41:59.474364+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:55.904533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:55.904533+0000","last_clean_scrub_stamp":"2024-09-17T05:41:55.904533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:13:02.431112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T05:41:58.942709+0000","last_change":"2024-09-17T05:41:57.945639+0000","last_active":"2024-09-17T05:41:58.942709+0000","last_peered":"2024-09-17T05:41:58.942709+0000","last_clean":"2024-09-17T05:41:58.942709+0000","last_became_active":"2024-09-17T05:41:57.945277+0000","last_became_peered":"2024-09-17T05:41:57.945277+0000","last_unstale":"2024-09-17T05:41:58.942709+0000","last_undegraded":"2024-09-17T05:41:58.942709+0000","last_fullsized":"2024-09-17T05:41:58.942709+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_clean_scrub_stamp":"2024-09-17T05:41:56.913963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:05:25.111036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"22'2","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T05:41:59.475181+0000","last_change":"2024-09-17T05:41:56.948113+0000","last_active":"2024-09-17T05:41:59.475181+0000","last_peered":"2024-09-17T05:41:59.475181+0000","last_clean":"2024-09-17T05:41:59.475181+0000","last_became_active":"2024-09-17T05:41:56.947582+0000","last_became_peered":"2024-09-17T05:41:56.947582+0000","last_unstale":"2024-09-17T05:41:59.475181+0000","last_undegraded":"2024-09-17T05:41:59.475181+0000","last_fullsized":"2024-09-17T05:41:59.475181+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:55.904533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:55.904533+0000","last_clean_scrub_stamp":"2024-09-17T05:41:55.904533+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:16:32.573490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T05:41:58.943406+0000","last_change":"2024-09-17T05:41:57.956713+0000","last_active":"2024-09-17T05:41:58.943406+0000","last_peered":"2024-09-17T05:41:58.943406+0000","last_clean":"2024-09-17T05:41:58.943406+0000","last_became_active":"2024-09-17T05:41:57.956322+0000","last_became_peered":"2024-09-17T05:41:57.956322+0000","last_unstale":"2024-09-17T05:41:58.943406+0000","last_undegraded":"2024-09-17T05:41:58.943406+0000","last_fullsized":"2024-09-17T05:41:58.943406+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_clean_scrub_stamp":"2024-09-17T05:41:56.913963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:06:04.948499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T05:41:58.945377+0000","last_change":"2024-09-17T05:41:57.951802+0000","last_active":"2024-09-17T05:41:58.945377+0000","last_peered":"2024-09-17T05:41:58.945377+0000","last_clean":"2024-09-17T05:41:58.945377+0000","last_became_active":"2024-09-17T05:41:57.951316+0000","last_became_peered":"2024-09-17T05:41:57.951316+0000","last_unstale":"2024-09-17T05:41:58.945377+0000","last_undegraded":"2024-09-17T05:41:58.945377+0000","last_fullsized":"2024-09-17T05:41:58.945377+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_clean_scrub_stamp":"2024-09-17T05:41:56.913963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:46:38.117672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"22'2","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T05:41:59.474972+0000","last_change":"2024-09-17T05:41:56.949729+0000","last_active":"2024-09-17T05:41:59.474972+0000","last_peered":"2024-09-17T05:41:59.474972+0000","last_clean":"2024-09-17T05:41:59.474972+0000","last_became_active":"2024-09-17T05:41:56.949384+0000","last_became_peered":"2024-09-17T05:41:56.949384+0000","last_unstale":"2024-09-17T05:41:59.474972+0000","last_undegraded":"2024-09-17T05:41:59.474972+0000","last_fullsized":"2024-09-17T05:41:59.474972+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:55.904533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:55.904533+0000","last_clean_scrub_stamp":"2024-09-17T05:41:55.904533+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:45:41.328997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T05:41:58.945780+0000","last_change":"2024-09-17T05:41:57.951733+0000","last_active":"2024-09-17T05:41:58.945780+0000","last_peered":"2024-09-17T05:41:58.945780+0000","last_clean":"2024-09-17T05:41:58.945780+0000","last_became_active":"2024-09-17T05:41:57.951330+0000","last_became_peered":"2024-09-17T05:41:57.951330+0000","last_unstale":"2024-09-17T05:41:58.945780+0000","last_undegraded":"2024-09-17T05:41:58.945780+0000","last_fullsized":"2024-09-17T05:41:58.945780+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_clean_scrub_stamp":"2024-09-17T05:41:56.913963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:43:21.632222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"22'2","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T05:41:59.475418+0000","last_change":"2024-09-17T05:41:56.952616+0000","last_active":"2024-09-17T05:41:59.475418+0000","last_peered":"2024-09-17T05:41:59.475418+0000","last_clean":"2024-09-17T05:41:59.475418+0000","last_became_active":"2024-09-17T05:41:56.952230+0000","last_became_peered":"2024-09-17T05:41:56.952230+0000","last_unstale":"2024-09-17T05:41:59.475418+0000","last_undegraded":"2024-09-17T05:41:59.475418+0000","last_fullsized":"2024-09-17T05:41:59.475418+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:55.904533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:55.904533+0000","last_clean_scrub_stamp":"2024-09-17T05:41:55.904533+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:56:02.887851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T05:41:59.474952+0000","last_change":"2024-09-17T05:41:57.947899+0000","last_active":"2024-09-17T05:41:59.474952+0000","last_peered":"2024-09-17T05:41:59.474952+0000","last_clean":"2024-09-17T05:41:59.474952+0000","last_became_active":"2024-09-17T05:41:57.947556+0000","last_became_peered":"2024-09-17T05:41:57.947556+0000","last_unstale":"2024-09-17T05:41:59.474952+0000","last_undegraded":"2024-09-17T05:41:59.474952+0000","last_fullsized":"2024-09-17T05:41:59.474952+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_clean_scrub_stamp":"2024-09-17T05:41:56.913963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:54:13.215048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"22'1","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T05:41:58.942704+0000","last_change":"2024-09-17T05:41:56.940731+0000","last_active":"2024-09-17T05:41:58.942704+0000","last_peered":"2024-09-17T05:41:58.942704+0000","last_clean":"2024-09-17T05:41:58.942704+0000","last_became_active":"2024-09-17T05:41:56.939978+0000","last_became_peered":"2024-09-17T05:41:56.939978+0000","last_unstale":"2024-09-17T05:41:58.942704+0000","last_undegraded":"2024-09-17T05:41:58.942704+0000","last_fullsized":"2024-09-17T05:41:58.942704+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:55.904533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:55.904533+0000","last_clean_scrub_stamp":"2024-09-17T05:41:55.904533+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:48:09.067501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T05:41:58.942846+0000","last_change":"2024-09-17T05:41:57.956639+0000","last_active":"2024-09-17T05:41:58.942846+0000","last_peered":"2024-09-17T05:41:58.942846+0000","last_clean":"2024-09-17T05:41:58.942846+0000","last_became_active":"2024-09-17T05:41:57.956338+0000","last_became_peered":"2024-09-17T05:41:57.956338+0000","last_unstale":"2024-09-17T05:41:58.942846+0000","last_undegraded":"2024-09-17T05:41:58.942846+0000","last_fullsized":"2024-09-17T05:41:58.942846+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_clean_scrub_stamp":"2024-09-17T05:41:56.913963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:52:28.863641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"22'4","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T05:41:59.475203+0000","last_change":"2024-09-17T05:41:56.946707+0000","last_active":"2024-09-17T05:41:59.475203+0000","last_peered":"2024-09-17T05:41:59.475203+0000","last_clean":"2024-09-17T05:41:59.475203+0000","last_became_active":"2024-09-17T05:41:56.946448+0000","last_became_peered":"2024-09-17T05:41:56.946448+0000","last_unstale":"2024-09-17T05:41:59.475203+0000","last_undegraded":"2024-09-17T05:41:59.475203+0000","last_fullsized":"2024-09-17T05:41:59.475203+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:55.904533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:55.904533+0000","last_clean_scrub_stamp":"2024-09-17T05:41:55.904533+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:55:32.730864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":16,"seq":68719476743,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27272,"kb_used_data":240,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344568,"statfs":{"total":96636764160,"available":96608837632,"internally_reserved":0,"allocated":245760,"data_stored":83439,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":7,"up_from":15,"seq":64424509447,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27840,"kb_used_data":812,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344000,"statfs":{"total":96636764160,"available":96608256000,"internally_reserved":0,"allocated":831488,"data_stored":672777,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509446,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27260,"kb_used_data":232,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344580,"statfs":{"total":96636764160,"available":96608849920,"internally_reserved":0,"allocated":237568,"data_stored":81917,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509446,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27268,"kb_used_data":240,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344572,"statfs":{"total":96636764160,"available":96608841728,"internally_reserved":0,"allocated":245760,"data_stored":81953,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509446,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27268,"kb_used_data":240,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344572,"statfs":{"total":96636764160,"available":96608841728,"internally_reserved":0,"allocated":245760,"data_stored":83439,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509446,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27264,"kb_used_data":228,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344576,"statfs":{"total":96636764160,"available":96608845824,"internally_reserved":0,"allocated":233472,"data_stored":81827,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509446,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27264,"kb_used_data":236,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344576,"statfs":{"total":96636764160,"available":96608845824,"internally_reserved":0,"allocated":241664,"data_stored":81987,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574854,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27848,"kb_used_data":820,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343992,"statfs":{"total":96636764160,"available":96608247808,"internally_reserved":0,"allocated":839680,"data_stored":672833,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-17T05:42:05.720 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-17T05:42:05.721 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config log 1 --format=json 2024-09-17T05:42:05.721 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2024-09-17T05:42:05.871 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:05.869+0000 7f148e152640 1 -- 172.21.15.150:0/4284572536 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1470003a50 msgr2=0x7f1470003ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:05.871 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:05.869+0000 7f148e152640 1 --2- 172.21.15.150:0/4284572536 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1470003a50 0x7f1470003ec0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f14780016c0 tx=0x7f1470005830 comp rx=0 tx=0).stop 2024-09-17T05:42:05.871 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:05.869+0000 7f148e152640 1 -- 172.21.15.150:0/4284572536 shutdown_connections 2024-09-17T05:42:05.871 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:05.869+0000 7f148e152640 1 --2- 172.21.15.150:0/4284572536 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1470003a50 0x7f1470003ec0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:05.871 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:05.869+0000 7f148e152640 1 -- 172.21.15.150:0/4284572536 >> 172.21.15.150:0/4284572536 conn(0x7f14880b6880 msgr2=0x7f14880b3060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:42:05.872 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:05.869+0000 7f148e152640 1 -- 172.21.15.150:0/4284572536 shutdown_connections 2024-09-17T05:42:05.872 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:05.869+0000 7f148e152640 1 -- 172.21.15.150:0/4284572536 wait complete. 2024-09-17T05:42:05.872 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:05.871+0000 7f148e152640 1 Processor -- start 2024-09-17T05:42:05.872 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:05.871+0000 7f148e152640 1 -- start start 2024-09-17T05:42:05.875 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:05.872+0000 7f148e152640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1470003a50 0x7f14881f3130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:42:05.875 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:05.872+0000 7f148e152640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f148809b450 0x7f1488146c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:42:05.875 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:05.872+0000 7f148e152640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f148814f190 0x7f148814f5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:42:05.875 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:05.872+0000 7f148e152640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f14880ae4c0 con 0x7f148814f190 2024-09-17T05:42:05.875 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:05.872+0000 7f148e152640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f14880ae340 con 0x7f1470003a50 2024-09-17T05:42:05.875 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:05.872+0000 7f148e152640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f14880ae640 con 0x7f148809b450 2024-09-17T05:42:05.875 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:05.872+0000 7f1487fff640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f148814f190 0x7f148814f5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:42:05.875 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:05.872+0000 7f1487fff640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f148814f190 0x7f148814f5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:54424/0 (socket says 172.21.15.150:54424) 2024-09-17T05:42:05.875 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:05.872+0000 7f1487fff640 1 -- 172.21.15.150:0/1094893073 learned_addr learned my addr 172.21.15.150:0/1094893073 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:42:05.875 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:05.872+0000 7f14877fe640 1 --2- 172.21.15.150:0/1094893073 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1470003a50 0x7f14881f3130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:42:05.876 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:05.873+0000 7f1486ffd640 1 --2- 172.21.15.150:0/1094893073 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f148809b450 0x7f1488146c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:42:05.876 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:05.873+0000 7f1487fff640 1 -- 172.21.15.150:0/1094893073 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f148809b450 msgr2=0x7f1488146c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:05.876 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:05.873+0000 7f1487fff640 1 --2- 172.21.15.150:0/1094893073 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f148809b450 0x7f1488146c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:05.876 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:05.873+0000 7f1487fff640 1 -- 172.21.15.150:0/1094893073 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1470003a50 msgr2=0x7f14881f3130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:05.876 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:05.873+0000 7f1487fff640 1 --2- 172.21.15.150:0/1094893073 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1470003a50 0x7f14881f3130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:05.876 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:05.873+0000 7f1487fff640 1 -- 172.21.15.150:0/1094893073 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f148814fae0 con 0x7f148814f190 2024-09-17T05:42:05.876 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:05.873+0000 7f1487fff640 1 --2- 172.21.15.150:0/1094893073 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f148814f190 0x7f148814f5a0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f1488074100 tx=0x7f1480004f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:42:05.876 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:05.873+0000 7f146ffff640 1 -- 172.21.15.150:0/1094893073 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1480010950 con 0x7f148814f190 2024-09-17T05:42:05.876 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:05.873+0000 7f146ffff640 1 -- 172.21.15.150:0/1094893073 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f1480017070 con 0x7f148814f190 2024-09-17T05:42:05.876 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:05.873+0000 7f148e152640 1 -- 172.21.15.150:0/1094893073 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1488152700 con 0x7f148814f190 2024-09-17T05:42:05.876 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:05.873+0000 7f146ffff640 1 -- 172.21.15.150:0/1094893073 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1480011460 con 0x7f148814f190 2024-09-17T05:42:05.877 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:05.873+0000 7f148e152640 1 -- 172.21.15.150:0/1094893073 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1488152cc0 con 0x7f148814f190 2024-09-17T05:42:05.877 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:05.874+0000 7f148e152640 1 -- 172.21.15.150:0/1094893073 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f14880762d0 con 0x7f148814f190 2024-09-17T05:42:05.878 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:05.875+0000 7f146ffff640 1 -- 172.21.15.150:0/1094893073 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f1480011600 con 0x7f148814f190 2024-09-17T05:42:05.878 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:05.875+0000 7f146ffff640 1 --2- 172.21.15.150:0/1094893073 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f1474078b90 0x7f147407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:42:05.878 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:05.875+0000 7f146ffff640 1 -- 172.21.15.150:0/1094893073 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f148009b570 con 0x7f148814f190 2024-09-17T05:42:05.878 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:05.875+0000 7f14877fe640 1 --2- 172.21.15.150:0/1094893073 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f1474078b90 0x7f147407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:42:05.878 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:05.876+0000 7f14877fe640 1 --2- 172.21.15.150:0/1094893073 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f1474078b90 0x7f147407b0a0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f1478032000 tx=0x7f147802c040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:42:05.881 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:05.880+0000 7f146ffff640 1 -- 172.21.15.150:0/1094893073 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f14880762d0 con 0x7f148814f190 2024-09-17T05:42:06.064 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:06.062+0000 7f148e152640 1 -- 172.21.15.150:0/1094893073 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "config log", "num": 1, "format": "json"} v 0) -- 0x7f148809b8c0 con 0x7f148814f190 2024-09-17T05:42:06.064 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:06.062+0000 7f146ffff640 1 -- 172.21.15.150:0/1094893073 <== mon.0 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "config log", "num": 1, "format": "json"}]=0 v31) ==== 86+0+160 (secure 0 0 0) 0x7f148814fae0 con 0x7f148814f190 2024-09-17T05:42:06.064 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-09-17T05:42:06.066 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:06.064+0000 7f148e152640 1 -- 172.21.15.150:0/1094893073 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f1474078b90 msgr2=0x7f147407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:06.066 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:06.064+0000 7f148e152640 1 --2- 172.21.15.150:0/1094893073 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f1474078b90 0x7f147407b0a0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f1478032000 tx=0x7f147802c040 comp rx=0 tx=0).stop 2024-09-17T05:42:06.067 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:06.064+0000 7f148e152640 1 -- 172.21.15.150:0/1094893073 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f148814f190 msgr2=0x7f148814f5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:06.067 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:06.064+0000 7f148e152640 1 --2- 172.21.15.150:0/1094893073 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f148814f190 0x7f148814f5a0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f1488074100 tx=0x7f1480004f90 comp rx=0 tx=0).stop 2024-09-17T05:42:06.067 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:06.064+0000 7f148e152640 1 -- 172.21.15.150:0/1094893073 shutdown_connections 2024-09-17T05:42:06.067 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:06.064+0000 7f148e152640 1 --2- 172.21.15.150:0/1094893073 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f1474078b90 0x7f147407b0a0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:06.067 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:06.064+0000 7f148e152640 1 --2- 172.21.15.150:0/1094893073 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f148814f190 0x7f148814f5a0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:06.067 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:06.064+0000 7f148e152640 1 --2- 172.21.15.150:0/1094893073 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f148809b450 0x7f1488146c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:06.067 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:06.064+0000 7f148e152640 1 --2- 172.21.15.150:0/1094893073 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1470003a50 0x7f14881f3130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:06.067 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:06.065+0000 7f148e152640 1 -- 172.21.15.150:0/1094893073 >> 172.21.15.150:0/1094893073 conn(0x7f14880b6880 msgr2=0x7f14880b3060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:42:06.067 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:06.065+0000 7f148e152640 1 -- 172.21.15.150:0/1094893073 shutdown_connections 2024-09-17T05:42:06.067 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:06.065+0000 7f148e152640 1 -- 172.21.15.150:0/1094893073 wait complete. 2024-09-17T05:42:06.077 INFO:teuthology.orchestra.run.smithi150.stdout:[{"version":31,"timestamp":"2024-09-17T05:41:45.149037+0000","name":"","changes":[{"name":"osd.6/osd_mclock_max_capacity_iops_ssd","new_value":"6380.664158"}]}] 2024-09-17T05:42:06.078 INFO:tasks.ceph_manager:config epoch is 31 2024-09-17T05:42:06.078 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-09-17T05:42:06.078 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2024-09-17T05:42:06.078 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2024-09-17T05:42:06.191 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:06.189+0000 7fdb12e8b640 1 -- 172.21.15.150:0/2928114187 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fdaf4004800 msgr2=0x7fdaf4004c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:06.191 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:06.189+0000 7fdb12e8b640 1 --2- 172.21.15.150:0/2928114187 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fdaf4004800 0x7fdaf4004c10 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fdb0c0af0e0 tx=0x7fdaf4005830 comp rx=0 tx=0).stop 2024-09-17T05:42:06.192 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:06.189+0000 7fdb11428640 1 -- 172.21.15.150:0/2928114187 reap_dead start 2024-09-17T05:42:06.192 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:06.189+0000 7fdb12e8b640 1 -- 172.21.15.150:0/2928114187 shutdown_connections 2024-09-17T05:42:06.192 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:06.189+0000 7fdb12e8b640 1 -- 172.21.15.150:0/2928114187 >> 172.21.15.150:0/2928114187 conn(0x7fdb0c06d730 msgr2=0x7fdb0c0b1e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:42:06.192 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:06.189+0000 7fdb12e8b640 1 -- 172.21.15.150:0/2928114187 shutdown_connections 2024-09-17T05:42:06.192 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:06.189+0000 7fdb12e8b640 1 -- 172.21.15.150:0/2928114187 wait complete. 2024-09-17T05:42:06.192 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:06.191+0000 7fdb12e8b640 1 Processor -- start 2024-09-17T05:42:06.193 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:06.191+0000 7fdb12e8b640 1 -- start start 2024-09-17T05:42:06.195 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:06.193+0000 7fdb12e8b640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fdaf4004800 0x7fdb0c1f7770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:42:06.195 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:06.193+0000 7fdb12e8b640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fdb0c151d80 0x7fdb0c0ae6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:42:06.195 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:06.193+0000 7fdb12e8b640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fdb0c0aec20 0x7fdb0c0cf150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:42:06.196 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:06.193+0000 7fdb12e8b640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7fdb0c158d10 con 0x7fdaf4004800 2024-09-17T05:42:06.196 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:06.193+0000 7fdb12e8b640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fdb0c158b90 con 0x7fdb0c151d80 2024-09-17T05:42:06.196 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:06.193+0000 7fdb12e8b640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fdb0c158e90 con 0x7fdb0c0aec20 2024-09-17T05:42:06.196 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:06.193+0000 7fdb10c27640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fdaf4004800 0x7fdb0c1f7770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:42:06.196 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:06.193+0000 7fdb10c27640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fdaf4004800 0x7fdb0c1f7770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:54442/0 (socket says 172.21.15.150:54442) 2024-09-17T05:42:06.196 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:06.193+0000 7fdb10c27640 1 -- 172.21.15.150:0/364718729 learned_addr learned my addr 172.21.15.150:0/364718729 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:42:06.196 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:06.193+0000 7fdb0bfff640 1 --2- 172.21.15.150:0/364718729 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fdb0c151d80 0x7fdb0c0ae6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:42:06.196 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:06.193+0000 7fdb10c27640 1 -- 172.21.15.150:0/364718729 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fdb0c0aec20 msgr2=0x7fdb0c0cf150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:06.196 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:06.193+0000 7fdb10c27640 1 --2- 172.21.15.150:0/364718729 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fdb0c0aec20 0x7fdb0c0cf150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:06.196 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:06.193+0000 7fdb10c27640 1 -- 172.21.15.150:0/364718729 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fdb0c151d80 msgr2=0x7fdb0c0ae6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:06.196 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:06.193+0000 7fdb10c27640 1 --2- 172.21.15.150:0/364718729 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fdb0c151d80 0x7fdb0c0ae6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:06.196 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:06.193+0000 7fdb10c27640 1 -- 172.21.15.150:0/364718729 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdb0c1415c0 con 0x7fdaf4004800 2024-09-17T05:42:06.197 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:06.193+0000 7fdb10c27640 1 --2- 172.21.15.150:0/364718729 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fdaf4004800 0x7fdb0c1f7770 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fdafc00ea40 tx=0x7fdafc00ef00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:42:06.197 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:06.193+0000 7fdb097fa640 1 -- 172.21.15.150:0/364718729 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdafc01d070 con 0x7fdaf4004800 2024-09-17T05:42:06.197 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:06.193+0000 7fdb097fa640 1 -- 172.21.15.150:0/364718729 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fdafc00dd50 con 0x7fdaf4004800 2024-09-17T05:42:06.197 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:06.193+0000 7fdb12e8b640 1 -- 172.21.15.150:0/364718729 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdb0c1418a0 con 0x7fdaf4004800 2024-09-17T05:42:06.197 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:06.193+0000 7fdb097fa640 1 -- 172.21.15.150:0/364718729 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdafc018670 con 0x7fdaf4004800 2024-09-17T05:42:06.197 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:06.193+0000 7fdb12e8b640 1 -- 172.21.15.150:0/364718729 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdb0c141e60 con 0x7fdaf4004800 2024-09-17T05:42:06.198 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:06.194+0000 7fdb12e8b640 1 -- 172.21.15.150:0/364718729 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdb0c15ea50 con 0x7fdaf4004800 2024-09-17T05:42:06.198 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:06.195+0000 7fdb097fa640 1 -- 172.21.15.150:0/364718729 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fdafc020070 con 0x7fdaf4004800 2024-09-17T05:42:06.198 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:06.196+0000 7fdb097fa640 1 --2- 172.21.15.150:0/364718729 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fdaf8078b90 0x7fdaf807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:42:06.198 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:06.196+0000 7fdb097fa640 1 -- 172.21.15.150:0/364718729 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7fdafc09b1c0 con 0x7fdaf4004800 2024-09-17T05:42:06.198 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:06.196+0000 7fdb0bfff640 1 --2- 172.21.15.150:0/364718729 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fdaf8078b90 0x7fdaf807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:42:06.199 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:06.196+0000 7fdb0bfff640 1 --2- 172.21.15.150:0/364718729 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fdaf8078b90 0x7fdaf807b0a0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fdb00032000 tx=0x7fdb00035040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:42:06.201 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:06.200+0000 7fdb097fa640 1 -- 172.21.15.150:0/364718729 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fdafc063040 con 0x7fdaf4004800 2024-09-17T05:42:06.424 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:06.422+0000 7fdb12e8b640 1 -- 172.21.15.150:0/364718729 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) -- 0x7fdb0c0709e0 con 0x7fdaf4004800 2024-09-17T05:42:06.426 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:06.425+0000 7fdb097fa640 1 -- 172.21.15.150:0/364718729 <== mon.0 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v5) ==== 74+0+194722 (secure 0 0 0) 0x7fdafc067a70 con 0x7fdaf4004800 2024-09-17T05:42:06.429 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-09-17T05:42:06.431 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:06.428+0000 7fdb12e8b640 1 -- 172.21.15.150:0/364718729 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fdaf8078b90 msgr2=0x7fdaf807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:06.431 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:06.428+0000 7fdb12e8b640 1 --2- 172.21.15.150:0/364718729 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fdaf8078b90 0x7fdaf807b0a0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fdb00032000 tx=0x7fdb00035040 comp rx=0 tx=0).stop 2024-09-17T05:42:06.431 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:06.428+0000 7fdb12e8b640 1 -- 172.21.15.150:0/364718729 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fdaf4004800 msgr2=0x7fdb0c1f7770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:06.431 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:06.428+0000 7fdb12e8b640 1 --2- 172.21.15.150:0/364718729 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fdaf4004800 0x7fdb0c1f7770 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fdafc00ea40 tx=0x7fdafc00ef00 comp rx=0 tx=0).stop 2024-09-17T05:42:06.431 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:06.428+0000 7fdb12e8b640 1 -- 172.21.15.150:0/364718729 shutdown_connections 2024-09-17T05:42:06.431 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:06.428+0000 7fdb12e8b640 1 --2- 172.21.15.150:0/364718729 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fdb0c151d80 0x7fdb0c0ae6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:06.431 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:06.428+0000 7fdb12e8b640 1 --2- 172.21.15.150:0/364718729 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fdaf8078b90 0x7fdaf807b0a0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:06.431 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:06.428+0000 7fdb12e8b640 1 --2- 172.21.15.150:0/364718729 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fdb0c0aec20 0x7fdb0c0cf150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:06.431 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:06.428+0000 7fdb12e8b640 1 --2- 172.21.15.150:0/364718729 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fdaf4004800 0x7fdb0c1f7770 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:06.431 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:06.428+0000 7fdb12e8b640 1 -- 172.21.15.150:0/364718729 >> 172.21.15.150:0/364718729 conn(0x7fdb0c06d730 msgr2=0x7fdb0c156550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:42:06.431 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:06.429+0000 7fdb12e8b640 1 -- 172.21.15.150:0/364718729 shutdown_connections 2024-09-17T05:42:06.432 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:06.429+0000 7fdb12e8b640 1 -- 172.21.15.150:0/364718729 wait complete. 2024-09-17T05:42:06.441 INFO:teuthology.orchestra.run.smithi150.stdout:{"epoch":5,"flags":0,"active_gid":4108,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6800","nonce":3631216395},{"type":"v1","addr":"172.21.15.176:6801","nonce":3631216395}]},"active_addr":"172.21.15.176:6801/3631216395","active_change":"2024-09-17T05:41:36.834907+0000","active_mgr_features":4540719139924082687,"available":true,"standbys":[{"gid":4109,"name":"y","mgr_features":4540719139924082687,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to, use commas to separate multiple","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.27.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:10.4.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_nginx":{"name":"container_image_nginx","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nginx:sclorg-nginx-126","min":"","max":"","enum_allowed":[],"desc":"Nginx container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.7.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.17","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_oauth2_proxy":{"name":"container_image_oauth2_proxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/oauth2-proxy/oauth2-proxy:v7.6.0","min":"","max":"","enum_allowed":[],"desc":"oauth2-proxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.51.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba_metrics":{"name":"container_image_samba_metrics","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-metrics:latest","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB metrics exporter container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_count_max":{"name":"ssh_keepalive_count_max","type":"int","level":"advanced","flags":0,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"How many times ssh connections can fail liveness checks before the host is marked offline","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_interval":{"name":"ssh_keepalive_interval","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"How often ssh connections are checked for liveness","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sso_oauth2":{"name":"sso_oauth2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_requests":{"name":"max_requests","type":"int","level":"advanced","flags":0,"default_value":"500","min":"","max":"","enum_allowed":[],"desc":"Maximum number of requests to keep in memory. When new request comes in, the oldest request will be removed if the number of requests exceeds the max request number.if un-finished request is removed, error message will be logged in the ceph-mgr log.","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"smb","can_run":true,"error_string":"","module_options":{"internal_store_backend":{"name":"internal_store_backend","type":"str","level":"dev","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"set internal store backend. for develoment and testing only","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"update_orchestration":{"name":"update_orchestration","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically update orchestration when smb resources are changed","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to, use commas to separate multiple","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.27.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:10.4.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_nginx":{"name":"container_image_nginx","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nginx:sclorg-nginx-126","min":"","max":"","enum_allowed":[],"desc":"Nginx container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.7.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.17","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_oauth2_proxy":{"name":"container_image_oauth2_proxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/oauth2-proxy/oauth2-proxy:v7.6.0","min":"","max":"","enum_allowed":[],"desc":"oauth2-proxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.51.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba_metrics":{"name":"container_image_samba_metrics","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-metrics:latest","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB metrics exporter container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_count_max":{"name":"ssh_keepalive_count_max","type":"int","level":"advanced","flags":0,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"How many times ssh connections can fail liveness checks before the host is marked offline","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_interval":{"name":"ssh_keepalive_interval","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"How often ssh connections are checked for liveness","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sso_oauth2":{"name":"sso_oauth2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_requests":{"name":"max_requests","type":"int","level":"advanced","flags":0,"default_value":"500","min":"","max":"","enum_allowed":[],"desc":"Maximum number of requests to keep in memory. When new request comes in, the oldest request will be removed if the number of requests exceeds the max request number.if un-finished request is removed, error message will be logged in the ceph-mgr log.","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"smb","can_run":true,"error_string":"","module_options":{"internal_store_backend":{"name":"internal_store_backend","type":"str","level":"dev","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"set internal store backend. for develoment and testing only","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"update_orchestration":{"name":"update_orchestration","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically update orchestration when smb resources are changed","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.176:0","nonce":1411599417}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.176:0","nonce":1968526115}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.176:0","nonce":2898324337}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.176:0","nonce":2909475413}]}]} 2024-09-17T05:42:06.445 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2024-09-17T05:42:06.446 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2024-09-17T05:42:06.446 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T05:42:06.560 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:06.558+0000 7fc736b72640 1 -- 172.21.15.150:0/306765819 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc718003fd0 msgr2=0x7fc718004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:06.560 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:06.558+0000 7fc736b72640 1 --2- 172.21.15.150:0/306765819 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc718003fd0 0x7fc718004800 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fc720009b20 tx=0x7fc718005830 comp rx=0 tx=0).stop 2024-09-17T05:42:06.560 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:06.558+0000 7fc73510f640 1 -- 172.21.15.150:0/306765819 reap_dead start 2024-09-17T05:42:06.560 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:06.558+0000 7fc736b72640 1 -- 172.21.15.150:0/306765819 shutdown_connections 2024-09-17T05:42:06.560 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:06.558+0000 7fc736b72640 1 -- 172.21.15.150:0/306765819 >> 172.21.15.150:0/306765819 conn(0x7fc7300d4680 msgr2=0x7fc7300d4a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:42:06.560 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:06.558+0000 7fc736b72640 1 -- 172.21.15.150:0/306765819 shutdown_connections 2024-09-17T05:42:06.561 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:06.558+0000 7fc736b72640 1 -- 172.21.15.150:0/306765819 wait complete. 2024-09-17T05:42:06.561 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:06.560+0000 7fc736b72640 1 Processor -- start 2024-09-17T05:42:06.561 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:06.560+0000 7fc736b72640 1 -- start start 2024-09-17T05:42:06.564 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:06.561+0000 7fc736b72640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc718003fd0 0x7fc7300b6210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:42:06.564 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:06.561+0000 7fc736b72640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc73015ee50 0x7fc7300b6750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:42:06.564 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:06.561+0000 7fc736b72640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc7301f9330 0x7fc7301f9740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:42:06.565 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:06.561+0000 7fc736b72640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7fc7300cf800 con 0x7fc73015ee50 2024-09-17T05:42:06.565 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:06.561+0000 7fc736b72640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fc7300cf680 con 0x7fc7301f9330 2024-09-17T05:42:06.565 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:06.561+0000 7fc736b72640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fc7300cf980 con 0x7fc718003fd0 2024-09-17T05:42:06.565 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:06.562+0000 7fc727fff640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc73015ee50 0x7fc7300b6750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:42:06.565 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:06.562+0000 7fc727fff640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc73015ee50 0x7fc7300b6750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:54454/0 (socket says 172.21.15.150:54454) 2024-09-17T05:42:06.565 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:06.562+0000 7fc727fff640 1 -- 172.21.15.150:0/3140416110 learned_addr learned my addr 172.21.15.150:0/3140416110 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:42:06.565 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:06.562+0000 7fc73490e640 1 --2- 172.21.15.150:0/3140416110 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc718003fd0 0x7fc7300b6210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:42:06.565 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:06.562+0000 7fc73510f640 1 --2- 172.21.15.150:0/3140416110 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc7301f9330 0x7fc7301f9740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:42:06.565 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:06.562+0000 7fc727fff640 1 -- 172.21.15.150:0/3140416110 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc718003fd0 msgr2=0x7fc7300b6210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:06.565 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:06.562+0000 7fc727fff640 1 --2- 172.21.15.150:0/3140416110 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc718003fd0 0x7fc7300b6210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:06.565 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:06.562+0000 7fc727fff640 1 -- 172.21.15.150:0/3140416110 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc7301f9330 msgr2=0x7fc7301f9740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:06.566 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:06.562+0000 7fc727fff640 1 --2- 172.21.15.150:0/3140416110 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc7301f9330 0x7fc7301f9740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:06.566 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:06.562+0000 7fc727fff640 1 -- 172.21.15.150:0/3140416110 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc7300a1f80 con 0x7fc73015ee50 2024-09-17T05:42:06.566 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:06.562+0000 7fc73490e640 1 --2- 172.21.15.150:0/3140416110 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc718003fd0 0x7fc7300b6210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T05:42:06.566 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:06.562+0000 7fc73510f640 1 --2- 172.21.15.150:0/3140416110 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc7301f9330 0x7fc7301f9740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T05:42:06.566 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:06.562+0000 7fc727fff640 1 --2- 172.21.15.150:0/3140416110 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc73015ee50 0x7fc7300b6750 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fc720009a70 tx=0x7fc720033670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:42:06.566 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:06.562+0000 7fc7257fa640 1 -- 172.21.15.150:0/3140416110 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc720038040 con 0x7fc73015ee50 2024-09-17T05:42:06.566 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:06.562+0000 7fc7257fa640 1 -- 172.21.15.150:0/3140416110 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc720033860 con 0x7fc73015ee50 2024-09-17T05:42:06.566 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:06.562+0000 7fc736b72640 1 -- 172.21.15.150:0/3140416110 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc7301f5e90 con 0x7fc73015ee50 2024-09-17T05:42:06.566 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:06.562+0000 7fc7257fa640 1 -- 172.21.15.150:0/3140416110 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc720033cb0 con 0x7fc73015ee50 2024-09-17T05:42:06.566 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:06.562+0000 7fc736b72640 1 -- 172.21.15.150:0/3140416110 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc7301f6450 con 0x7fc73015ee50 2024-09-17T05:42:06.567 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:06.564+0000 7fc736b72640 1 -- 172.21.15.150:0/3140416110 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc7301f9fd0 con 0x7fc73015ee50 2024-09-17T05:42:06.567 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:06.564+0000 7fc7257fa640 1 -- 172.21.15.150:0/3140416110 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fc720043020 con 0x7fc73015ee50 2024-09-17T05:42:06.567 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:06.564+0000 7fc7257fa640 1 --2- 172.21.15.150:0/3140416110 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fc71c078bf0 0x7fc71c07b100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:42:06.567 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:06.564+0000 7fc7257fa640 1 -- 172.21.15.150:0/3140416110 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7fc7200bb190 con 0x7fc73015ee50 2024-09-17T05:42:06.567 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:06.565+0000 7fc73490e640 1 --2- 172.21.15.150:0/3140416110 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fc71c078bf0 0x7fc71c07b100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:42:06.567 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:06.565+0000 7fc73490e640 1 --2- 172.21.15.150:0/3140416110 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fc71c078bf0 0x7fc71c07b100 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fc72c0067e0 tx=0x7fc72c0066f0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:42:06.570 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:06.569+0000 7fc7257fa640 1 -- 172.21.15.150:0/3140416110 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fc7200835d0 con 0x7fc73015ee50 2024-09-17T05:42:06.748 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:06.746+0000 7fc736b72640 1 -- 172.21.15.150:0/3140416110 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fc73008d100 con 0x7fc73015ee50 2024-09-17T05:42:06.749 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:06.747+0000 7fc7257fa640 1 -- 172.21.15.150:0/3140416110 <== mon.0 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) ==== 74+0+16701 (secure 0 0 0) 0x7fc73008d100 con 0x7fc73015ee50 2024-09-17T05:42:06.749 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-09-17T05:42:06.749 INFO:teuthology.orchestra.run.smithi150.stdout:{"epoch":23,"fsid":"9f2e05e9-d629-47b3-b26b-1360655b7d20","created":"2024-09-17T05:41:32.502979+0000","modified":"2024-09-17T05:41:58.934156+0000","last_up_change":"2024-09-17T05:41:46.150225+0000","last_in_change":"2024-09-17T05:41:36.120274+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T05:41:46.860779+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-17T05:41:55.155732+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-17T05:41:56.250888+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"4f31c018-c8a4-4d6d-b0c2-a597c47aae4a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6800","nonce":479374392},{"type":"v1","addr":"172.21.15.150:6801","nonce":479374392}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6802","nonce":479374392},{"type":"v1","addr":"172.21.15.150:6803","nonce":479374392}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6806","nonce":479374392},{"type":"v1","addr":"172.21.15.150:6807","nonce":479374392}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6804","nonce":479374392},{"type":"v1","addr":"172.21.15.150:6805","nonce":479374392}]},"public_addr":"172.21.15.150:6801/479374392","cluster_addr":"172.21.15.150:6803/479374392","heartbeat_back_addr":"172.21.15.150:6807/479374392","heartbeat_front_addr":"172.21.15.150:6805/479374392","state":["exists","up"]},{"osd":1,"uuid":"6ff4a573-500b-4e04-9de3-39265ead78b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6824","nonce":913899800},{"type":"v1","addr":"172.21.15.150:6825","nonce":913899800}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6826","nonce":913899800},{"type":"v1","addr":"172.21.15.150:6827","nonce":913899800}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6830","nonce":913899800},{"type":"v1","addr":"172.21.15.150:6831","nonce":913899800}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6828","nonce":913899800},{"type":"v1","addr":"172.21.15.150:6829","nonce":913899800}]},"public_addr":"172.21.15.150:6825/913899800","cluster_addr":"172.21.15.150:6827/913899800","heartbeat_back_addr":"172.21.15.150:6831/913899800","heartbeat_front_addr":"172.21.15.150:6829/913899800","state":["exists","up"]},{"osd":2,"uuid":"bffea6f9-2465-4182-b205-00436c41ac1c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6816","nonce":363718461},{"type":"v1","addr":"172.21.15.150:6817","nonce":363718461}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6818","nonce":363718461},{"type":"v1","addr":"172.21.15.150:6819","nonce":363718461}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6822","nonce":363718461},{"type":"v1","addr":"172.21.15.150:6823","nonce":363718461}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6820","nonce":363718461},{"type":"v1","addr":"172.21.15.150:6821","nonce":363718461}]},"public_addr":"172.21.15.150:6817/363718461","cluster_addr":"172.21.15.150:6819/363718461","heartbeat_back_addr":"172.21.15.150:6823/363718461","heartbeat_front_addr":"172.21.15.150:6821/363718461","state":["exists","up"]},{"osd":3,"uuid":"cda70430-d1e1-427e-b04e-56db4031d078","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6808","nonce":3550994626},{"type":"v1","addr":"172.21.15.150:6809","nonce":3550994626}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6810","nonce":3550994626},{"type":"v1","addr":"172.21.15.150:6811","nonce":3550994626}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6814","nonce":3550994626},{"type":"v1","addr":"172.21.15.150:6815","nonce":3550994626}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6812","nonce":3550994626},{"type":"v1","addr":"172.21.15.150:6813","nonce":3550994626}]},"public_addr":"172.21.15.150:6809/3550994626","cluster_addr":"172.21.15.150:6811/3550994626","heartbeat_back_addr":"172.21.15.150:6815/3550994626","heartbeat_front_addr":"172.21.15.150:6813/3550994626","state":["exists","up"]},{"osd":4,"uuid":"3a0277fb-5e1e-4f68-bb2d-9a8a0152f64a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6810","nonce":2718261497},{"type":"v1","addr":"172.21.15.176:6811","nonce":2718261497}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6812","nonce":2718261497},{"type":"v1","addr":"172.21.15.176:6813","nonce":2718261497}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6816","nonce":2718261497},{"type":"v1","addr":"172.21.15.176:6817","nonce":2718261497}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6814","nonce":2718261497},{"type":"v1","addr":"172.21.15.176:6815","nonce":2718261497}]},"public_addr":"172.21.15.176:6811/2718261497","cluster_addr":"172.21.15.176:6813/2718261497","heartbeat_back_addr":"172.21.15.176:6817/2718261497","heartbeat_front_addr":"172.21.15.176:6815/2718261497","state":["exists","up"]},{"osd":5,"uuid":"33aebee6-0315-40b7-a11c-6702f0be494d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6818","nonce":2049295774},{"type":"v1","addr":"172.21.15.176:6819","nonce":2049295774}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6820","nonce":2049295774},{"type":"v1","addr":"172.21.15.176:6821","nonce":2049295774}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6824","nonce":2049295774},{"type":"v1","addr":"172.21.15.176:6825","nonce":2049295774}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6822","nonce":2049295774},{"type":"v1","addr":"172.21.15.176:6823","nonce":2049295774}]},"public_addr":"172.21.15.176:6819/2049295774","cluster_addr":"172.21.15.176:6821/2049295774","heartbeat_back_addr":"172.21.15.176:6825/2049295774","heartbeat_front_addr":"172.21.15.176:6823/2049295774","state":["exists","up"]},{"osd":6,"uuid":"4d24f360-6751-4263-841b-d77793d33540","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6826","nonce":2164458476},{"type":"v1","addr":"172.21.15.176:6827","nonce":2164458476}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6828","nonce":2164458476},{"type":"v1","addr":"172.21.15.176:6829","nonce":2164458476}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6832","nonce":2164458476},{"type":"v1","addr":"172.21.15.176:6833","nonce":2164458476}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6830","nonce":2164458476},{"type":"v1","addr":"172.21.15.176:6831","nonce":2164458476}]},"public_addr":"172.21.15.176:6827/2164458476","cluster_addr":"172.21.15.176:6829/2164458476","heartbeat_back_addr":"172.21.15.176:6833/2164458476","heartbeat_front_addr":"172.21.15.176:6831/2164458476","state":["exists","up"]},{"osd":7,"uuid":"c8594fda-c74a-4ba9-8277-caf101d58ca1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6802","nonce":3239587708},{"type":"v1","addr":"172.21.15.176:6803","nonce":3239587708}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6804","nonce":3239587708},{"type":"v1","addr":"172.21.15.176:6805","nonce":3239587708}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6808","nonce":3239587708},{"type":"v1","addr":"172.21.15.176:6809","nonce":3239587708}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6806","nonce":3239587708},{"type":"v1","addr":"172.21.15.176:6807","nonce":3239587708}]},"public_addr":"172.21.15.176:6803/3239587708","cluster_addr":"172.21.15.176:6805/3239587708","heartbeat_back_addr":"172.21.15.176:6809/3239587708","heartbeat_front_addr":"172.21.15.176:6807/3239587708","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:41:41.905151+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:41:42.705679+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:41:42.459673+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:41:42.440819+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:41:42.668428+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:41:42.694972+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:41:43.078535+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:41:42.363539+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T05:42:06.752 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:06.750+0000 7fc736b72640 1 -- 172.21.15.150:0/3140416110 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fc71c078bf0 msgr2=0x7fc71c07b100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:06.752 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:06.750+0000 7fc736b72640 1 --2- 172.21.15.150:0/3140416110 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fc71c078bf0 0x7fc71c07b100 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fc72c0067e0 tx=0x7fc72c0066f0 comp rx=0 tx=0).stop 2024-09-17T05:42:06.752 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:06.750+0000 7fc736b72640 1 -- 172.21.15.150:0/3140416110 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc73015ee50 msgr2=0x7fc7300b6750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:06.752 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:06.750+0000 7fc736b72640 1 --2- 172.21.15.150:0/3140416110 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc73015ee50 0x7fc7300b6750 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fc720009a70 tx=0x7fc720033670 comp rx=0 tx=0).stop 2024-09-17T05:42:06.752 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:06.750+0000 7fc736b72640 1 -- 172.21.15.150:0/3140416110 shutdown_connections 2024-09-17T05:42:06.752 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:06.750+0000 7fc736b72640 1 --2- 172.21.15.150:0/3140416110 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc7301f9330 0x7fc7301f9740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:06.752 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:06.750+0000 7fc736b72640 1 --2- 172.21.15.150:0/3140416110 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fc71c078bf0 0x7fc71c07b100 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:06.752 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:06.750+0000 7fc736b72640 1 --2- 172.21.15.150:0/3140416110 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc73015ee50 0x7fc7300b6750 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:06.752 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:06.750+0000 7fc736b72640 1 --2- 172.21.15.150:0/3140416110 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc718003fd0 0x7fc7300b6210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:06.752 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:06.750+0000 7fc736b72640 1 -- 172.21.15.150:0/3140416110 >> 172.21.15.150:0/3140416110 conn(0x7fc7300d4680 msgr2=0x7fc730068e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:42:06.752 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:06.750+0000 7fc736b72640 1 -- 172.21.15.150:0/3140416110 shutdown_connections 2024-09-17T05:42:06.752 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:06.750+0000 7fc736b72640 1 -- 172.21.15.150:0/3140416110 wait complete. 2024-09-17T05:42:06.763 INFO:tasks.ceph.ceph_manager.ceph:all up! 2024-09-17T05:42:06.763 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T05:42:06.876 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:06.874+0000 7fbfdb8cc640 1 -- 172.21.15.150:0/3341230135 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbfd40d15d0 msgr2=0x7fbfd4162a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:06.876 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:06.874+0000 7fbfdb8cc640 1 --2- 172.21.15.150:0/3341230135 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbfd40d15d0 0x7fbfd4162a60 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fbfd40b7270 tx=0x7fbfcc02a980 comp rx=0 tx=0).stop 2024-09-17T05:42:06.876 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:06.874+0000 7fbfdb8cc640 1 -- 172.21.15.150:0/3341230135 shutdown_connections 2024-09-17T05:42:06.876 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:06.874+0000 7fbfdb8cc640 1 --2- 172.21.15.150:0/3341230135 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbfd40d15d0 0x7fbfd4162a60 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:06.876 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:06.874+0000 7fbfdb8cc640 1 --2- 172.21.15.150:0/3341230135 >> v2:172.21.15.176:3300/0 conn(0x7fbfd415ee50 0x7fbfd40d1090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:06.876 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:06.874+0000 7fbfdb8cc640 1 --2- 172.21.15.150:0/3341230135 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fbfd40b9780 0x7fbfd40b3720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:06.876 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:06.874+0000 7fbfdb8cc640 1 -- 172.21.15.150:0/3341230135 >> 172.21.15.150:0/3341230135 conn(0x7fbfd40d4680 msgr2=0x7fbfd40d4a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:42:06.876 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:06.874+0000 7fbfdb8cc640 1 -- 172.21.15.150:0/3341230135 shutdown_connections 2024-09-17T05:42:06.877 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:06.874+0000 7fbfdb8cc640 1 -- 172.21.15.150:0/3341230135 wait complete. 2024-09-17T05:42:06.877 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:06.876+0000 7fbfdb8cc640 1 Processor -- start 2024-09-17T05:42:06.877 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:06.876+0000 7fbfdb8cc640 1 -- start start 2024-09-17T05:42:06.880 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:06.877+0000 7fbfdb8cc640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbfd40b9780 0x7fbfd40cd740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:42:06.880 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:06.877+0000 7fbfdb8cc640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fbfd40d15d0 0x7fbfd415d780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:42:06.880 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:06.877+0000 7fbfdb8cc640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fbfd415ee50 0x7fbfd415dcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:42:06.880 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:06.877+0000 7fbfdb8cc640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7fbfd4163330 con 0x7fbfd40b9780 2024-09-17T05:42:06.880 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:06.877+0000 7fbfdb8cc640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fbfd41631b0 con 0x7fbfd40d15d0 2024-09-17T05:42:06.880 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:06.877+0000 7fbfdb8cc640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fbfd41634b0 con 0x7fbfd415ee50 2024-09-17T05:42:06.880 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:06.877+0000 7fbfd9668640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbfd40b9780 0x7fbfd40cd740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:42:06.880 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:06.877+0000 7fbfd9668640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbfd40b9780 0x7fbfd40cd740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:54482/0 (socket says 172.21.15.150:54482) 2024-09-17T05:42:06.880 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:06.877+0000 7fbfd9668640 1 -- 172.21.15.150:0/1373502182 learned_addr learned my addr 172.21.15.150:0/1373502182 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:42:06.880 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:06.877+0000 7fbfd9668640 1 -- 172.21.15.150:0/1373502182 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fbfd415ee50 msgr2=0x7fbfd415dcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:06.880 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:06.877+0000 7fbfd8e67640 1 --2- 172.21.15.150:0/1373502182 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fbfd40d15d0 0x7fbfd415d780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:42:06.881 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:06.877+0000 7fbfd9668640 1 --2- 172.21.15.150:0/1373502182 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fbfd415ee50 0x7fbfd415dcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:06.881 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:06.877+0000 7fbfd9668640 1 -- 172.21.15.150:0/1373502182 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fbfd40d15d0 msgr2=0x7fbfd415d780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:06.881 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:06.877+0000 7fbfd9668640 1 --2- 172.21.15.150:0/1373502182 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fbfd40d15d0 0x7fbfd415d780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:06.881 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:06.877+0000 7fbfd9668640 1 -- 172.21.15.150:0/1373502182 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbfd41fa360 con 0x7fbfd40b9780 2024-09-17T05:42:06.881 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:06.877+0000 7fbfd8e67640 1 --2- 172.21.15.150:0/1373502182 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fbfd40d15d0 0x7fbfd415d780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T05:42:06.881 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:06.878+0000 7fbfd9668640 1 --2- 172.21.15.150:0/1373502182 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbfd40b9780 0x7fbfd40cd740 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fbfc400e7f0 tx=0x7fbfc400ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:42:06.881 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:06.878+0000 7fbfd1ffb640 1 -- 172.21.15.150:0/1373502182 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbfc400ccc0 con 0x7fbfd40b9780 2024-09-17T05:42:06.881 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:06.878+0000 7fbfd1ffb640 1 -- 172.21.15.150:0/1373502182 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fbfc4010430 con 0x7fbfd40b9780 2024-09-17T05:42:06.881 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:06.878+0000 7fbfd1ffb640 1 -- 172.21.15.150:0/1373502182 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbfc4010880 con 0x7fbfd40b9780 2024-09-17T05:42:06.881 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:06.878+0000 7fbfdb8cc640 1 -- 172.21.15.150:0/1373502182 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbfd40b6480 con 0x7fbfd40b9780 2024-09-17T05:42:06.881 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:06.878+0000 7fbfdb8cc640 1 -- 172.21.15.150:0/1373502182 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbfd41f9880 con 0x7fbfd40b9780 2024-09-17T05:42:06.882 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:06.879+0000 7fbfdb8cc640 1 -- 172.21.15.150:0/1373502182 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbfd40d4340 con 0x7fbfd40b9780 2024-09-17T05:42:06.882 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:06.880+0000 7fbfd1ffb640 1 -- 172.21.15.150:0/1373502182 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fbfc4010a20 con 0x7fbfd40b9780 2024-09-17T05:42:06.882 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:06.880+0000 7fbfd1ffb640 1 --2- 172.21.15.150:0/1373502182 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fbfc0078bc0 0x7fbfc007b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:42:06.882 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:06.880+0000 7fbfd1ffb640 1 -- 172.21.15.150:0/1373502182 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7fbfc409bfb0 con 0x7fbfd40b9780 2024-09-17T05:42:06.883 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:06.881+0000 7fbfd8e67640 1 --2- 172.21.15.150:0/1373502182 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fbfc0078bc0 0x7fbfc007b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:42:06.883 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:06.881+0000 7fbfd8e67640 1 --2- 172.21.15.150:0/1373502182 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fbfc0078bc0 0x7fbfc007b0d0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fbfd40b3a00 tx=0x7fbfc8005f90 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:42:06.886 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:06.884+0000 7fbfd1ffb640 1 -- 172.21.15.150:0/1373502182 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fbfd40d4340 con 0x7fbfd40b9780 2024-09-17T05:42:07.065 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.063+0000 7fbfdb8cc640 1 -- 172.21.15.150:0/1373502182 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fbfd4162a60 con 0x7fbfd40b9780 2024-09-17T05:42:07.066 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.064+0000 7fbfd1ffb640 1 -- 172.21.15.150:0/1373502182 <== mon.0 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) ==== 74+0+16701 (secure 0 0 0) 0x7fbfc4064560 con 0x7fbfd40b9780 2024-09-17T05:42:07.066 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-09-17T05:42:07.066 INFO:teuthology.orchestra.run.smithi150.stdout:{"epoch":23,"fsid":"9f2e05e9-d629-47b3-b26b-1360655b7d20","created":"2024-09-17T05:41:32.502979+0000","modified":"2024-09-17T05:41:58.934156+0000","last_up_change":"2024-09-17T05:41:46.150225+0000","last_in_change":"2024-09-17T05:41:36.120274+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T05:41:46.860779+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-17T05:41:55.155732+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-17T05:41:56.250888+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"4f31c018-c8a4-4d6d-b0c2-a597c47aae4a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6800","nonce":479374392},{"type":"v1","addr":"172.21.15.150:6801","nonce":479374392}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6802","nonce":479374392},{"type":"v1","addr":"172.21.15.150:6803","nonce":479374392}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6806","nonce":479374392},{"type":"v1","addr":"172.21.15.150:6807","nonce":479374392}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6804","nonce":479374392},{"type":"v1","addr":"172.21.15.150:6805","nonce":479374392}]},"public_addr":"172.21.15.150:6801/479374392","cluster_addr":"172.21.15.150:6803/479374392","heartbeat_back_addr":"172.21.15.150:6807/479374392","heartbeat_front_addr":"172.21.15.150:6805/479374392","state":["exists","up"]},{"osd":1,"uuid":"6ff4a573-500b-4e04-9de3-39265ead78b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6824","nonce":913899800},{"type":"v1","addr":"172.21.15.150:6825","nonce":913899800}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6826","nonce":913899800},{"type":"v1","addr":"172.21.15.150:6827","nonce":913899800}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6830","nonce":913899800},{"type":"v1","addr":"172.21.15.150:6831","nonce":913899800}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6828","nonce":913899800},{"type":"v1","addr":"172.21.15.150:6829","nonce":913899800}]},"public_addr":"172.21.15.150:6825/913899800","cluster_addr":"172.21.15.150:6827/913899800","heartbeat_back_addr":"172.21.15.150:6831/913899800","heartbeat_front_addr":"172.21.15.150:6829/913899800","state":["exists","up"]},{"osd":2,"uuid":"bffea6f9-2465-4182-b205-00436c41ac1c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6816","nonce":363718461},{"type":"v1","addr":"172.21.15.150:6817","nonce":363718461}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6818","nonce":363718461},{"type":"v1","addr":"172.21.15.150:6819","nonce":363718461}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6822","nonce":363718461},{"type":"v1","addr":"172.21.15.150:6823","nonce":363718461}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6820","nonce":363718461},{"type":"v1","addr":"172.21.15.150:6821","nonce":363718461}]},"public_addr":"172.21.15.150:6817/363718461","cluster_addr":"172.21.15.150:6819/363718461","heartbeat_back_addr":"172.21.15.150:6823/363718461","heartbeat_front_addr":"172.21.15.150:6821/363718461","state":["exists","up"]},{"osd":3,"uuid":"cda70430-d1e1-427e-b04e-56db4031d078","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6808","nonce":3550994626},{"type":"v1","addr":"172.21.15.150:6809","nonce":3550994626}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6810","nonce":3550994626},{"type":"v1","addr":"172.21.15.150:6811","nonce":3550994626}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6814","nonce":3550994626},{"type":"v1","addr":"172.21.15.150:6815","nonce":3550994626}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6812","nonce":3550994626},{"type":"v1","addr":"172.21.15.150:6813","nonce":3550994626}]},"public_addr":"172.21.15.150:6809/3550994626","cluster_addr":"172.21.15.150:6811/3550994626","heartbeat_back_addr":"172.21.15.150:6815/3550994626","heartbeat_front_addr":"172.21.15.150:6813/3550994626","state":["exists","up"]},{"osd":4,"uuid":"3a0277fb-5e1e-4f68-bb2d-9a8a0152f64a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6810","nonce":2718261497},{"type":"v1","addr":"172.21.15.176:6811","nonce":2718261497}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6812","nonce":2718261497},{"type":"v1","addr":"172.21.15.176:6813","nonce":2718261497}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6816","nonce":2718261497},{"type":"v1","addr":"172.21.15.176:6817","nonce":2718261497}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6814","nonce":2718261497},{"type":"v1","addr":"172.21.15.176:6815","nonce":2718261497}]},"public_addr":"172.21.15.176:6811/2718261497","cluster_addr":"172.21.15.176:6813/2718261497","heartbeat_back_addr":"172.21.15.176:6817/2718261497","heartbeat_front_addr":"172.21.15.176:6815/2718261497","state":["exists","up"]},{"osd":5,"uuid":"33aebee6-0315-40b7-a11c-6702f0be494d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6818","nonce":2049295774},{"type":"v1","addr":"172.21.15.176:6819","nonce":2049295774}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6820","nonce":2049295774},{"type":"v1","addr":"172.21.15.176:6821","nonce":2049295774}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6824","nonce":2049295774},{"type":"v1","addr":"172.21.15.176:6825","nonce":2049295774}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6822","nonce":2049295774},{"type":"v1","addr":"172.21.15.176:6823","nonce":2049295774}]},"public_addr":"172.21.15.176:6819/2049295774","cluster_addr":"172.21.15.176:6821/2049295774","heartbeat_back_addr":"172.21.15.176:6825/2049295774","heartbeat_front_addr":"172.21.15.176:6823/2049295774","state":["exists","up"]},{"osd":6,"uuid":"4d24f360-6751-4263-841b-d77793d33540","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6826","nonce":2164458476},{"type":"v1","addr":"172.21.15.176:6827","nonce":2164458476}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6828","nonce":2164458476},{"type":"v1","addr":"172.21.15.176:6829","nonce":2164458476}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6832","nonce":2164458476},{"type":"v1","addr":"172.21.15.176:6833","nonce":2164458476}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6830","nonce":2164458476},{"type":"v1","addr":"172.21.15.176:6831","nonce":2164458476}]},"public_addr":"172.21.15.176:6827/2164458476","cluster_addr":"172.21.15.176:6829/2164458476","heartbeat_back_addr":"172.21.15.176:6833/2164458476","heartbeat_front_addr":"172.21.15.176:6831/2164458476","state":["exists","up"]},{"osd":7,"uuid":"c8594fda-c74a-4ba9-8277-caf101d58ca1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6802","nonce":3239587708},{"type":"v1","addr":"172.21.15.176:6803","nonce":3239587708}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6804","nonce":3239587708},{"type":"v1","addr":"172.21.15.176:6805","nonce":3239587708}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6808","nonce":3239587708},{"type":"v1","addr":"172.21.15.176:6809","nonce":3239587708}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6806","nonce":3239587708},{"type":"v1","addr":"172.21.15.176:6807","nonce":3239587708}]},"public_addr":"172.21.15.176:6803/3239587708","cluster_addr":"172.21.15.176:6805/3239587708","heartbeat_back_addr":"172.21.15.176:6809/3239587708","heartbeat_front_addr":"172.21.15.176:6807/3239587708","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:41:41.905151+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:41:42.705679+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:41:42.459673+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:41:42.440819+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:41:42.668428+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:41:42.694972+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:41:43.078535+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:41:42.363539+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T05:42:07.068 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.066+0000 7fbfdb8cc640 1 -- 172.21.15.150:0/1373502182 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fbfc0078bc0 msgr2=0x7fbfc007b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:07.068 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.066+0000 7fbfdb8cc640 1 --2- 172.21.15.150:0/1373502182 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fbfc0078bc0 0x7fbfc007b0d0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fbfd40b3a00 tx=0x7fbfc8005f90 comp rx=0 tx=0).stop 2024-09-17T05:42:07.068 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.066+0000 7fbfdb8cc640 1 -- 172.21.15.150:0/1373502182 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbfd40b9780 msgr2=0x7fbfd40cd740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:07.068 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.066+0000 7fbfdb8cc640 1 --2- 172.21.15.150:0/1373502182 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbfd40b9780 0x7fbfd40cd740 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fbfc400e7f0 tx=0x7fbfc400ecb0 comp rx=0 tx=0).stop 2024-09-17T05:42:07.068 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.067+0000 7fbfdb8cc640 1 -- 172.21.15.150:0/1373502182 shutdown_connections 2024-09-17T05:42:07.069 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.067+0000 7fbfdb8cc640 1 --2- 172.21.15.150:0/1373502182 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fbfd40d15d0 0x7fbfd415d780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:07.069 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.067+0000 7fbfdb8cc640 1 --2- 172.21.15.150:0/1373502182 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fbfc0078bc0 0x7fbfc007b0d0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:07.069 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.067+0000 7fbfdb8cc640 1 --2- 172.21.15.150:0/1373502182 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fbfd415ee50 0x7fbfd415dcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:07.069 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.067+0000 7fbfdb8cc640 1 --2- 172.21.15.150:0/1373502182 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbfd40b9780 0x7fbfd40cd740 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:07.069 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.067+0000 7fbfdb8cc640 1 -- 172.21.15.150:0/1373502182 >> 172.21.15.150:0/1373502182 conn(0x7fbfd40d4680 msgr2=0x7fbfd40b7fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:42:07.069 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.067+0000 7fbfdb8cc640 1 -- 172.21.15.150:0/1373502182 shutdown_connections 2024-09-17T05:42:07.069 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.067+0000 7fbfdb8cc640 1 -- 172.21.15.150:0/1373502182 wait complete. 2024-09-17T05:42:07.080 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2024-09-17T05:42:07.080 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2024-09-17T05:42:07.081 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2024-09-17T05:42:07.081 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2024-09-17T05:42:07.082 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2024-09-17T05:42:07.082 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2024-09-17T05:42:07.082 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2024-09-17T05:42:07.083 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2024-09-17T05:42:07.312 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.311+0000 7f5acf0b1640 1 -- 172.21.15.150:0/4264675288 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5ac8073e30 msgr2=0x7f5ac8074240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:07.313 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.311+0000 7f993deec640 1 -- 172.21.15.150:0/3667555664 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f993815f6d0 msgr2=0x7f993806ddb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:07.313 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.311+0000 7f2848c5c640 1 -- 172.21.15.150:0/2808895709 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f28440b3d60 msgr2=0x7f28440af510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:07.313 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.311+0000 7f2848c5c640 1 --2- 172.21.15.150:0/2808895709 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f28440b3d60 0x7f28440af510 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f2838005fd0 tx=0x7f283802b700 comp rx=0 tx=0).stop 2024-09-17T05:42:07.313 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.311+0000 7f993deec640 1 --2- 172.21.15.150:0/3667555664 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f993815f6d0 0x7f993806ddb0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f992c009830 tx=0x7f992c02a480 comp rx=0 tx=0).stop 2024-09-17T05:42:07.313 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.311+0000 7f993deec640 1 -- 172.21.15.150:0/3667555664 shutdown_connections 2024-09-17T05:42:07.314 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.311+0000 7f5acf0b1640 1 --2- 172.21.15.150:0/4264675288 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5ac8073e30 0x7f5ac8074240 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f5ac0009be0 tx=0x7f5ac002a940 comp rx=0 tx=0).stop 2024-09-17T05:42:07.314 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.311+0000 7f5acf0b1640 1 -- 172.21.15.150:0/4264675288 shutdown_connections 2024-09-17T05:42:07.314 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.311+0000 7f5acf0b1640 1 --2- 172.21.15.150:0/4264675288 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5ac8073e30 0x7f5ac8074240 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:07.314 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.311+0000 7f5acf0b1640 1 -- 172.21.15.150:0/4264675288 >> 172.21.15.150:0/4264675288 conn(0x7f5ac80cdcb0 msgr2=0x7f5ac80ce0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:42:07.315 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.311+0000 7f993deec640 1 --2- 172.21.15.150:0/3667555664 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f993815f6d0 0x7f993806ddb0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:07.315 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.312+0000 7f993deec640 1 --2- 172.21.15.150:0/3667555664 >> v2:172.21.15.176:3300/0 conn(0x7f9938144c20 0x7f993815f190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:07.315 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.312+0000 7f993deec640 1 -- 172.21.15.150:0/3667555664 >> 172.21.15.150:0/3667555664 conn(0x7f99380738b0 msgr2=0x7f9938073cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:42:07.315 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.312+0000 7f2848c5c640 1 -- 172.21.15.150:0/2808895709 shutdown_connections 2024-09-17T05:42:07.315 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.312+0000 7f2848c5c640 1 --2- 172.21.15.150:0/2808895709 >> v2:172.21.15.150:3300/0 conn(0x7f28440cd410 0x7f284406f0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:07.315 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.312+0000 7f2848c5c640 1 --2- 172.21.15.150:0/2808895709 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f28440b3d60 0x7f28440af510 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:07.315 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.312+0000 7f2848c5c640 1 -- 172.21.15.150:0/2808895709 >> 172.21.15.150:0/2808895709 conn(0x7f284406d3d0 msgr2=0x7f28440b1ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:42:07.315 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.312+0000 7f5acf0b1640 1 -- 172.21.15.150:0/4264675288 shutdown_connections 2024-09-17T05:42:07.316 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.312+0000 7f2848c5c640 1 -- 172.21.15.150:0/2808895709 shutdown_connections 2024-09-17T05:42:07.316 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.312+0000 7f5acf0b1640 1 -- 172.21.15.150:0/4264675288 wait complete. 2024-09-17T05:42:07.317 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.312+0000 7ff1b99eb640 1 -- 172.21.15.150:0/143177560 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff1b40b3520 msgr2=0x7ff1b40b3930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:07.317 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.312+0000 7ff1b99eb640 1 --2- 172.21.15.150:0/143177560 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff1b40b3520 0x7ff1b40b3930 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7ff1a4005fd0 tx=0x7ff1a402a540 comp rx=0 tx=0).stop 2024-09-17T05:42:07.317 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.312+0000 7ff1b99eb640 1 -- 172.21.15.150:0/143177560 shutdown_connections 2024-09-17T05:42:07.317 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.312+0000 7ff1b99eb640 1 --2- 172.21.15.150:0/143177560 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff1b40b3520 0x7ff1b40b3930 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:07.317 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.312+0000 7ff1b99eb640 1 --2- 172.21.15.150:0/143177560 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff1b41518d0 0x7ff1b406f9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:07.317 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.312+0000 7ff1b99eb640 1 -- 172.21.15.150:0/143177560 >> 172.21.15.150:0/143177560 conn(0x7ff1b40b1e40 msgr2=0x7ff1b40b2250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:42:07.318 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.313+0000 7f993deec640 1 -- 172.21.15.150:0/3667555664 shutdown_connections 2024-09-17T05:42:07.318 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.313+0000 7ff1b99eb640 1 -- 172.21.15.150:0/143177560 shutdown_connections 2024-09-17T05:42:07.318 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.313+0000 7ff1b99eb640 1 -- 172.21.15.150:0/143177560 wait complete. 2024-09-17T05:42:07.318 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.312+0000 7f2848c5c640 1 -- 172.21.15.150:0/2808895709 wait complete. 2024-09-17T05:42:07.319 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.313+0000 7f993deec640 1 -- 172.21.15.150:0/3667555664 wait complete. 2024-09-17T05:42:07.319 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.314+0000 7f498e5a5640 1 -- 172.21.15.150:0/3621878605 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4980056da0 msgr2=0x7f49800e7160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:07.320 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.314+0000 7f498e5a5640 1 --2- 172.21.15.150:0/3621878605 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4980056da0 0x7f49800e7160 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f49880524b0 tx=0x7f49880a6590 comp rx=0 tx=0).stop 2024-09-17T05:42:07.320 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.314+0000 7f498e5a5640 1 -- 172.21.15.150:0/3621878605 shutdown_connections 2024-09-17T05:42:07.320 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.314+0000 7f498e5a5640 1 --2- 172.21.15.150:0/3621878605 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4980056da0 0x7f49800e7160 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:07.320 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.314+0000 7f498e5a5640 1 --2- 172.21.15.150:0/3621878605 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f498003c1f0 0x7f4980053eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:07.320 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.314+0000 7f498e5a5640 1 -- 172.21.15.150:0/3621878605 >> 172.21.15.150:0/3621878605 conn(0x7f498003a5f0 msgr2=0x7f498003aa00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:42:07.320 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.314+0000 7f498e5a5640 1 -- 172.21.15.150:0/3621878605 shutdown_connections 2024-09-17T05:42:07.320 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.314+0000 7f498e5a5640 1 -- 172.21.15.150:0/3621878605 wait complete. 2024-09-17T05:42:07.321 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.314+0000 7fcf392da640 1 -- 172.21.15.150:0/1260132417 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fcf340cff60 msgr2=0x7fcf340d0370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:07.321 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.314+0000 7fcf392da640 1 --2- 172.21.15.150:0/1260132417 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fcf340cff60 0x7fcf340d0370 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fcf28009860 tx=0x7fcf2802a470 comp rx=0 tx=0).stop 2024-09-17T05:42:07.321 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.315+0000 7f5acf0b1640 1 Processor -- start 2024-09-17T05:42:07.321 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.315+0000 7f5acf0b1640 1 -- start start 2024-09-17T05:42:07.322 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.315+0000 7fcf392da640 1 -- 172.21.15.150:0/1260132417 shutdown_connections 2024-09-17T05:42:07.322 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.315+0000 7fcf392da640 1 --2- 172.21.15.150:0/1260132417 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fcf340cff60 0x7fcf340d0370 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:07.322 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.315+0000 7fcf392da640 1 -- 172.21.15.150:0/1260132417 >> 172.21.15.150:0/1260132417 conn(0x7fcf34074780 msgr2=0x7fcf3406cda0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:42:07.322 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.315+0000 7fcf392da640 1 -- 172.21.15.150:0/1260132417 shutdown_connections 2024-09-17T05:42:07.322 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.315+0000 7f3a05128640 1 -- 172.21.15.150:0/2868051624 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f39f8032680 msgr2=0x7f39f80e0e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:07.322 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.315+0000 7f3a05128640 1 --2- 172.21.15.150:0/2868051624 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f39f8032680 0x7f39f80e0e80 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f3a0006ad00 tx=0x7f3a000a6670 comp rx=0 tx=0).stop 2024-09-17T05:42:07.323 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.315+0000 7f2848c5c640 1 Processor -- start 2024-09-17T05:42:07.323 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.315+0000 7f3a05128640 1 -- 172.21.15.150:0/2868051624 shutdown_connections 2024-09-17T05:42:07.323 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.315+0000 7f2848c5c640 1 -- start start 2024-09-17T05:42:07.324 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.315+0000 7f3a05128640 1 --2- 172.21.15.150:0/2868051624 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f39f8032680 0x7f39f80e0e80 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:07.324 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.315+0000 7f3a05128640 1 -- 172.21.15.150:0/2868051624 >> 172.21.15.150:0/2868051624 conn(0x7f39f801d9a0 msgr2=0x7f39f8039660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:42:07.324 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.315+0000 7f3a05128640 1 -- 172.21.15.150:0/2868051624 shutdown_connections 2024-09-17T05:42:07.324 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.316+0000 7f993deec640 1 Processor -- start 2024-09-17T05:42:07.324 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.316+0000 7f993deec640 1 -- start start 2024-09-17T05:42:07.325 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.316+0000 7ff1b99eb640 1 Processor -- start 2024-09-17T05:42:07.325 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.316+0000 7ff1b99eb640 1 -- start start 2024-09-17T05:42:07.325 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.317+0000 7f498e5a5640 1 Processor -- start 2024-09-17T05:42:07.325 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.317+0000 7f3e41d61640 1 -- 172.21.15.150:0/2908148839 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3e3403ae90 msgr2=0x7f3e340dfe80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:07.326 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.316+0000 7f3a05128640 1 -- 172.21.15.150:0/2868051624 wait complete. 2024-09-17T05:42:07.326 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.317+0000 7f3e41d61640 1 --2- 172.21.15.150:0/2908148839 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3e3403ae90 0x7f3e340dfe80 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f3e300108b0 tx=0x7f3e3002e340 comp rx=0 tx=0).stop 2024-09-17T05:42:07.326 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.317+0000 7f3e41d61640 1 -- 172.21.15.150:0/2908148839 shutdown_connections 2024-09-17T05:42:07.327 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.317+0000 7f3e41d61640 1 --2- 172.21.15.150:0/2908148839 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3e34008fa0 0x7f3e340557d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:07.327 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.317+0000 7f498e5a5640 1 -- start start 2024-09-17T05:42:07.327 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.317+0000 7f3e41d61640 1 --2- 172.21.15.150:0/2908148839 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3e3403ae90 0x7f3e340dfe80 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:07.327 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.317+0000 7f3e41d61640 1 -- 172.21.15.150:0/2908148839 >> 172.21.15.150:0/2908148839 conn(0x7f3e3401eae0 msgr2=0x7f3e3403a710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:42:07.328 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.317+0000 7f5acf0b1640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5ac8073e30 0x7f5ac81fa8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:42:07.328 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.317+0000 7f5acf0b1640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5ac8074ce0 0x7f5ac80b6c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:42:07.328 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.315+0000 7fcf392da640 1 -- 172.21.15.150:0/1260132417 wait complete. 2024-09-17T05:42:07.328 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.317+0000 7f5acf0b1640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5ac815c5f0 0x7f5ac81f4610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:42:07.329 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.318+0000 7f3e41d61640 1 -- 172.21.15.150:0/2908148839 shutdown_connections 2024-09-17T05:42:07.329 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.318+0000 7f2848c5c640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f28440b3d60 0x7f28441522b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:42:07.329 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.318+0000 7f2848c5c640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f28440cd000 0x7f28441f5300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:42:07.330 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.318+0000 7f3e41d61640 1 -- 172.21.15.150:0/2908148839 wait complete. 2024-09-17T05:42:07.331 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.317+0000 7f5ace0af640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5ac8073e30 0x7f5ac81fa8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:42:07.331 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.318+0000 7f5ace0af640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5ac8073e30 0x7f5ac81fa8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3300/0 says I am v2:172.21.15.150:53576/0 (socket says 172.21.15.150:53576) 2024-09-17T05:42:07.331 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.318+0000 7f5acd8ae640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5ac8074ce0 0x7f5ac80b6c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:42:07.331 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.318+0000 7f5acd8ae640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5ac8074ce0 0x7f5ac80b6c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3301/0 says I am v2:172.21.15.150:53148/0 (socket says 172.21.15.150:53148) 2024-09-17T05:42:07.331 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.318+0000 7f5ace8b0640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5ac815c5f0 0x7f5ac81f4610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:42:07.332 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.318+0000 7f5ace8b0640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5ac815c5f0 0x7f5ac81f4610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:54514/0 (socket says 172.21.15.150:54514) 2024-09-17T05:42:07.332 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.318+0000 7f284259c640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f28440b3d60 0x7f28441522b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:42:07.333 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.318+0000 7f5ace0af640 1 -- 172.21.15.150:0/1972112596 learned_addr learned my addr 172.21.15.150:0/1972112596 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:42:07.333 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.318+0000 7f5acf0b1640 1 -- 172.21.15.150:0/1972112596 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f5ac80cce60 con 0x7f5ac815c5f0 2024-09-17T05:42:07.334 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.318+0000 7f284259c640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f28440b3d60 0x7f28441522b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3301/0 says I am v2:172.21.15.150:53154/0 (socket says 172.21.15.150:53154) 2024-09-17T05:42:07.334 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.318+0000 7f284259c640 1 -- 172.21.15.150:0/997559154 learned_addr learned my addr 172.21.15.150:0/997559154 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:42:07.334 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.318+0000 7f993deec640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f993806e2f0 0x7f99381f9750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:42:07.335 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.318+0000 7f2841d9b640 1 --2- 172.21.15.150:0/997559154 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f28440cd000 0x7f28441f5300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:42:07.335 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.318+0000 7f993deec640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9938144c20 0x7f993806cda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:42:07.336 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.318+0000 7f2848c5c640 1 --2- 172.21.15.150:0/997559154 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f28440cd410 0x7f28441f5840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:42:07.336 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.318+0000 7f99377fe640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f993806e2f0 0x7f99381f9750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:42:07.337 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.318+0000 7fcf392da640 1 Processor -- start 2024-09-17T05:42:07.337 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.318+0000 7f99377fe640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f993806e2f0 0x7f99381f9750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3301/0 says I am v2:172.21.15.150:53160/0 (socket says 172.21.15.150:53160) 2024-09-17T05:42:07.337 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.318+0000 7f99377fe640 1 -- 172.21.15.150:0/1403871010 learned_addr learned my addr 172.21.15.150:0/1403871010 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:42:07.337 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.318+0000 7f993deec640 1 --2- 172.21.15.150:0/1403871010 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f993815f6d0 0x7f993806d2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:42:07.338 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.318+0000 7f993deec640 1 -- 172.21.15.150:0/1403871010 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f9938070e80 con 0x7f9938144c20 2024-09-17T05:42:07.338 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.318+0000 7f993deec640 1 -- 172.21.15.150:0/1403871010 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f9938070d00 con 0x7f993815f6d0 2024-09-17T05:42:07.338 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.318+0000 7fcf392da640 1 -- start start 2024-09-17T05:42:07.339 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.318+0000 7f993deec640 1 -- 172.21.15.150:0/1403871010 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f99380b4200 con 0x7f993806e2f0 2024-09-17T05:42:07.339 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.318+0000 7f9936ffd640 1 --2- 172.21.15.150:0/1403871010 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9938144c20 0x7f993806cda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:42:07.339 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.318+0000 7f9937fff640 1 --2- 172.21.15.150:0/1403871010 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f993815f6d0 0x7f993806d2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:42:07.339 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.319+0000 7f2842d9d640 1 --2- 172.21.15.150:0/997559154 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f28440cd410 0x7f28441f5840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:42:07.339 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.319+0000 7f2848c5c640 1 -- 172.21.15.150:0/997559154 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f28440711c0 con 0x7f28440cd410 2024-09-17T05:42:07.340 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.318+0000 7f5acf0b1640 1 -- 172.21.15.150:0/1972112596 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f5ac80ccce0 con 0x7f5ac8073e30 2024-09-17T05:42:07.340 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.319+0000 7f5acf0b1640 1 -- 172.21.15.150:0/1972112596 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f5ac80ccfe0 con 0x7f5ac8074ce0 2024-09-17T05:42:07.340 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.319+0000 7f2848c5c640 1 -- 172.21.15.150:0/997559154 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f28440b4380 con 0x7f28440cd000 2024-09-17T05:42:07.340 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.319+0000 7f2848c5c640 1 -- 172.21.15.150:0/997559154 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f2844071340 con 0x7f28440b3d60 2024-09-17T05:42:07.342 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.319+0000 7f99377fe640 1 -- 172.21.15.150:0/1403871010 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f993815f6d0 msgr2=0x7f993806d2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:07.342 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.319+0000 7f99377fe640 1 --2- 172.21.15.150:0/1403871010 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f993815f6d0 0x7f993806d2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:07.342 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.319+0000 7f99377fe640 1 -- 172.21.15.150:0/1403871010 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9938144c20 msgr2=0x7f993806cda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:07.342 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.319+0000 7f99377fe640 1 --2- 172.21.15.150:0/1403871010 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9938144c20 0x7f993806cda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:07.342 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.319+0000 7f99377fe640 1 -- 172.21.15.150:0/1403871010 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f99380af830 con 0x7f993806e2f0 2024-09-17T05:42:07.342 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.319+0000 7f9936ffd640 1 --2- 172.21.15.150:0/1403871010 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9938144c20 0x7f993806cda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T05:42:07.343 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.319+0000 7f99377fe640 1 --2- 172.21.15.150:0/1403871010 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f993806e2f0 0x7f99381f9750 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f992800d750 tx=0x7f992800dc10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:42:07.343 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.319+0000 7f3a05128640 1 Processor -- start 2024-09-17T05:42:07.343 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.319+0000 7f498e5a5640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f498003c1f0 0x7f49800d4bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:42:07.344 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.319+0000 7f2842d9d640 1 -- 172.21.15.150:0/997559154 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f28440b3d60 msgr2=0x7f28441522b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:07.344 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.319+0000 7f2842d9d640 1 --2- 172.21.15.150:0/997559154 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f28440b3d60 0x7f28441522b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:07.344 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.319+0000 7f498e5a5640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f49800537b0 0x7f498000a880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:42:07.345 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.319+0000 7f2842d9d640 1 -- 172.21.15.150:0/997559154 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f28440cd000 msgr2=0x7f28441f5300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:07.345 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.319+0000 7f3a05128640 1 -- start start 2024-09-17T05:42:07.346 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.319+0000 7f2842d9d640 1 --2- 172.21.15.150:0/997559154 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f28440cd000 0x7f28441f5300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:07.346 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.320+0000 7f2842d9d640 1 -- 172.21.15.150:0/997559154 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f28440c7b00 con 0x7f28440cd410 2024-09-17T05:42:07.347 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.320+0000 7f498e5a5640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4980056da0 0x7f4980181520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:42:07.348 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.320+0000 7f991ffff640 1 -- 172.21.15.150:0/1403871010 <== mon.2 v2:172.21.15.176:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9928017070 con 0x7f993806e2f0 2024-09-17T05:42:07.348 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.320+0000 7f991ffff640 1 -- 172.21.15.150:0/1403871010 <== mon.2 v2:172.21.15.176:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9928009d20 con 0x7f993806e2f0 2024-09-17T05:42:07.348 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.320+0000 7f498d5a3640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f498003c1f0 0x7f49800d4bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:42:07.349 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.320+0000 7f498cda2640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f49800537b0 0x7f498000a880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:42:07.349 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.320+0000 7f498d5a3640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f498003c1f0 0x7f49800d4bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:54552/0 (socket says 172.21.15.150:54552) 2024-09-17T05:42:07.350 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.320+0000 7f498cda2640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f49800537b0 0x7f498000a880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3301/0 says I am v2:172.21.15.150:53168/0 (socket says 172.21.15.150:53168) 2024-09-17T05:42:07.350 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.320+0000 7f284259c640 1 --2- 172.21.15.150:0/997559154 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f28440b3d60 0x7f28441522b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T05:42:07.350 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.320+0000 7f498d5a3640 1 -- 172.21.15.150:0/2657467871 learned_addr learned my addr 172.21.15.150:0/2657467871 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:42:07.351 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.320+0000 7f498e5a5640 1 -- 172.21.15.150:0/2657467871 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f4980006920 con 0x7f498003c1f0 2024-09-17T05:42:07.351 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.320+0000 7f498e5a5640 1 -- 172.21.15.150:0/2657467871 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f49800e78b0 con 0x7f4980056da0 2024-09-17T05:42:07.351 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.320+0000 7f498e5a5640 1 -- 172.21.15.150:0/2657467871 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f4980006aa0 con 0x7f49800537b0 2024-09-17T05:42:07.351 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.320+0000 7f498dda4640 1 --2- 172.21.15.150:0/2657467871 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4980056da0 0x7f4980181520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:42:07.351 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.320+0000 7f991ffff640 1 -- 172.21.15.150:0/1403871010 <== mon.2 v2:172.21.15.176:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99280106c0 con 0x7f993806e2f0 2024-09-17T05:42:07.352 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.320+0000 7f5ace0af640 1 -- 172.21.15.150:0/1972112596 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5ac8074ce0 msgr2=0x7f5ac80b6c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:07.352 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.320+0000 7f5ace0af640 1 --2- 172.21.15.150:0/1972112596 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5ac8074ce0 0x7f5ac80b6c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:07.352 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.320+0000 7f5ace0af640 1 -- 172.21.15.150:0/1972112596 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5ac815c5f0 msgr2=0x7f5ac81f4610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:07.353 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.320+0000 7f2842d9d640 1 --2- 172.21.15.150:0/997559154 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f28440cd410 0x7f28441f5840 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f283c005fd0 tx=0x7f283c00c640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:42:07.353 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.320+0000 7f993deec640 1 -- 172.21.15.150:0/1403871010 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f993815b500 con 0x7f993806e2f0 2024-09-17T05:42:07.354 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.320+0000 7f993deec640 1 -- 172.21.15.150:0/1403871010 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f99380afdf0 con 0x7f993806e2f0 2024-09-17T05:42:07.354 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.320+0000 7f5ace0af640 1 --2- 172.21.15.150:0/1972112596 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5ac815c5f0 0x7f5ac81f4610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:07.354 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.320+0000 7f5ace0af640 1 -- 172.21.15.150:0/1972112596 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5ac80c8270 con 0x7f5ac8073e30 2024-09-17T05:42:07.354 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.320+0000 7f5ace8b0640 1 --2- 172.21.15.150:0/1972112596 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5ac815c5f0 0x7f5ac81f4610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T05:42:07.355 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.320+0000 7f2832ffd640 1 -- 172.21.15.150:0/997559154 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f283c00ed90 con 0x7f28440cd410 2024-09-17T05:42:07.355 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.321+0000 7fcf392da640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fcf340cff60 0x7fcf34205c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:42:07.355 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.321+0000 7f3e41d61640 1 Processor -- start 2024-09-17T05:42:07.356 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.321+0000 7f3e41d61640 1 -- start start 2024-09-17T05:42:07.357 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.321+0000 7fcf392da640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fcf34140d00 0x7fcf340afa70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:42:07.357 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.321+0000 7fcf32ffd640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fcf340cff60 0x7fcf34205c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:42:07.357 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.321+0000 7fcf32ffd640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fcf340cff60 0x7fcf34205c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3300/0 says I am v2:172.21.15.150:53610/0 (socket says 172.21.15.150:53610) 2024-09-17T05:42:07.357 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.321+0000 7fcf32ffd640 1 -- 172.21.15.150:0/3626831450 learned_addr learned my addr 172.21.15.150:0/3626831450 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:42:07.358 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.321+0000 7fcf392da640 1 --2- 172.21.15.150:0/3626831450 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fcf3415e7e0 0x7fcf340affb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:42:07.358 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.322+0000 7fcf392da640 1 -- 172.21.15.150:0/3626831450 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7fcf340cdf20 con 0x7fcf34140d00 2024-09-17T05:42:07.358 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.322+0000 7fcf392da640 1 -- 172.21.15.150:0/3626831450 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fcf340cdda0 con 0x7fcf340cff60 2024-09-17T05:42:07.358 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.322+0000 7fcf392da640 1 -- 172.21.15.150:0/3626831450 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fcf34075d20 con 0x7fcf3415e7e0 2024-09-17T05:42:07.358 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.322+0000 7f993deec640 1 -- 172.21.15.150:0/1403871010 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f99380afff0 con 0x7f993806e2f0 2024-09-17T05:42:07.358 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.322+0000 7ff1b99eb640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff1b40735c0 0x7ff1b4157b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:42:07.359 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.321+0000 7f2832ffd640 1 -- 172.21.15.150:0/997559154 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f283c004b20 con 0x7f28440cd410 2024-09-17T05:42:07.359 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.321+0000 7f498d5a3640 1 -- 172.21.15.150:0/2657467871 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f49800537b0 msgr2=0x7f498000a880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:07.360 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.321+0000 7f498d5a3640 1 --2- 172.21.15.150:0/2657467871 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f49800537b0 0x7f498000a880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:07.360 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.321+0000 7f498d5a3640 1 -- 172.21.15.150:0/2657467871 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4980056da0 msgr2=0x7f4980181520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:07.360 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.321+0000 7f498d5a3640 1 --2- 172.21.15.150:0/2657467871 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4980056da0 0x7f4980181520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:07.360 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.321+0000 7f498d5a3640 1 -- 172.21.15.150:0/2657467871 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f498000c890 con 0x7f498003c1f0 2024-09-17T05:42:07.361 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.321+0000 7f498d5a3640 1 --2- 172.21.15.150:0/2657467871 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f498003c1f0 0x7f49800d4bf0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f498400e790 tx=0x7f498400ec50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:42:07.361 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.321+0000 7f497dffb640 1 -- 172.21.15.150:0/2657467871 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f498400eea0 con 0x7f498003c1f0 2024-09-17T05:42:07.361 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.321+0000 7f497dffb640 1 -- 172.21.15.150:0/2657467871 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f498400ccc0 con 0x7f498003c1f0 2024-09-17T05:42:07.361 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.321+0000 7f497dffb640 1 -- 172.21.15.150:0/2657467871 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4984005280 con 0x7f498003c1f0 2024-09-17T05:42:07.361 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.322+0000 7f498e5a5640 1 -- 172.21.15.150:0/2657467871 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f498000cb50 con 0x7f498003c1f0 2024-09-17T05:42:07.361 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.322+0000 7f2832ffd640 1 -- 172.21.15.150:0/997559154 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f283c00ed90 con 0x7f28440cd410 2024-09-17T05:42:07.362 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.322+0000 7fcf327fc640 1 --2- 172.21.15.150:0/3626831450 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fcf34140d00 0x7fcf340afa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:42:07.362 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.322+0000 7f2848c5c640 1 -- 172.21.15.150:0/997559154 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f28440c7540 con 0x7f28440cd410 2024-09-17T05:42:07.362 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.322+0000 7f3a05128640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f39f80072e0 0x7f39f80e1ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:42:07.362 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.322+0000 7fcf32ffd640 1 -- 172.21.15.150:0/3626831450 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fcf3415e7e0 msgr2=0x7fcf340affb0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-17T05:42:07.363 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.322+0000 7fcf32ffd640 1 --2- 172.21.15.150:0/3626831450 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fcf3415e7e0 0x7fcf340affb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:07.363 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.322+0000 7fcf32ffd640 1 -- 172.21.15.150:0/3626831450 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fcf34140d00 msgr2=0x7fcf340afa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:07.363 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.322+0000 7f3a05128640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f39f8032680 0x7f39f80ccc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:42:07.363 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.322+0000 7f2848c5c640 1 -- 172.21.15.150:0/997559154 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f28440ca170 con 0x7f28440cd410 2024-09-17T05:42:07.364 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.322+0000 7ff1b89e9640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff1b40735c0 0x7ff1b4157b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:42:07.364 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.322+0000 7ff1b89e9640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff1b40735c0 0x7ff1b4157b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:54572/0 (socket says 172.21.15.150:54572) 2024-09-17T05:42:07.364 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.322+0000 7f3a05128640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f39f8035cd0 0x7f39f800ac30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:42:07.364 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.322+0000 7fcf32ffd640 1 --2- 172.21.15.150:0/3626831450 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fcf34140d00 0x7fcf340afa70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:07.365 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.323+0000 7f3a05128640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f39f8052bd0 con 0x7f39f8032680 2024-09-17T05:42:07.365 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.322+0000 7fcf32ffd640 1 -- 172.21.15.150:0/3626831450 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcf342069e0 con 0x7fcf340cff60 2024-09-17T05:42:07.365 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.323+0000 7fcf327fc640 1 --2- 172.21.15.150:0/3626831450 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fcf34140d00 0x7fcf340afa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T05:42:07.366 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.323+0000 7f3a05128640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f39f8052a50 con 0x7f39f8035cd0 2024-09-17T05:42:07.366 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.323+0000 7f3a05128640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f39f8052d50 con 0x7f39f80072e0 2024-09-17T05:42:07.366 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.323+0000 7f5ace0af640 1 --2- 172.21.15.150:0/1972112596 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5ac8073e30 0x7f5ac81fa8c0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f5ab800c400 tx=0x7f5ab800c8c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:42:07.366 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.323+0000 7f5abeffd640 1 -- 172.21.15.150:0/1972112596 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ab8017070 con 0x7f5ac8073e30 2024-09-17T05:42:07.366 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.323+0000 7f5abeffd640 1 -- 172.21.15.150:0/1972112596 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f5ab80053c0 con 0x7f5ac8073e30 2024-09-17T05:42:07.366 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.323+0000 7f5abeffd640 1 -- 172.21.15.150:0/1972112596 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ab8003850 con 0x7f5ac8073e30 2024-09-17T05:42:07.367 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.323+0000 7f5acf0b1640 1 -- 172.21.15.150:0/1972112596 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5ac81fb110 con 0x7f5ac8073e30 2024-09-17T05:42:07.367 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.323+0000 7f39ff7fe640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f39f8032680 0x7f39f80ccc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:42:07.367 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.323+0000 7f5acf0b1640 1 -- 172.21.15.150:0/1972112596 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5ac81fb6d0 con 0x7f5ac8073e30 2024-09-17T05:42:07.367 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.323+0000 7f39ff7fe640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f39f8032680 0x7f39f80ccc20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:54582/0 (socket says 172.21.15.150:54582) 2024-09-17T05:42:07.367 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.323+0000 7f39ff7fe640 1 -- 172.21.15.150:0/194193650 learned_addr learned my addr 172.21.15.150:0/194193650 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:42:07.368 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.324+0000 7f2848c5c640 1 -- 172.21.15.150:0/997559154 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f28441527f0 con 0x7f28440cd410 2024-09-17T05:42:07.369 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.323+0000 7f498e5a5640 1 -- 172.21.15.150:0/2657467871 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f498000d110 con 0x7f498003c1f0 2024-09-17T05:42:07.369 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.324+0000 7f3e41d61640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3e34008fa0 0x7f3e340c9c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:42:07.369 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.322+0000 7ff1b89e9640 1 -- 172.21.15.150:0/1667358266 learned_addr learned my addr 172.21.15.150:0/1667358266 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:42:07.370 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.324+0000 7ff1b99eb640 1 --2- 172.21.15.150:0/1667358266 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff1b40b3520 0x7ff1b4147930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:42:07.370 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.324+0000 7f3e41d61640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3e3403ae90 0x7f3e340e26b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:42:07.370 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.323+0000 7f991ffff640 1 -- 172.21.15.150:0/1403871010 <== mon.2 v2:172.21.15.176:3301/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f992801a070 con 0x7f993806e2f0 2024-09-17T05:42:07.371 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.324+0000 7ff1b99eb640 1 --2- 172.21.15.150:0/1667358266 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff1b41518d0 0x7ff1b41f3b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:42:07.371 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.324+0000 7f39ff7fe640 1 -- 172.21.15.150:0/194193650 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f39f80072e0 msgr2=0x7f39f80e1ec0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-17T05:42:07.371 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.324+0000 7f39ff7fe640 1 --2- 172.21.15.150:0/194193650 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f39f80072e0 0x7f39f80e1ec0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:07.371 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.324+0000 7f39ff7fe640 1 -- 172.21.15.150:0/194193650 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f39f8035cd0 msgr2=0x7f39f800ac30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:07.372 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.324+0000 7ff1b99eb640 1 -- 172.21.15.150:0/1667358266 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7ff1b4070130 con 0x7ff1b40735c0 2024-09-17T05:42:07.372 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.324+0000 7f496b7fe640 1 -- 172.21.15.150:0/2657467871 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f498000c630 con 0x7f498003c1f0 2024-09-17T05:42:07.372 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.324+0000 7ff1b91ea640 1 --2- 172.21.15.150:0/1667358266 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff1b41518d0 0x7ff1b41f3b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:42:07.373 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.324+0000 7f3a04927640 1 --2- 172.21.15.150:0/194193650 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f39f8035cd0 0x7f39f800ac30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:42:07.373 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.324+0000 7ff1b99eb640 1 -- 172.21.15.150:0/1667358266 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7ff1b4071160 con 0x7ff1b40b3520 2024-09-17T05:42:07.373 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.324+0000 7f39ff7fe640 1 --2- 172.21.15.150:0/194193650 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f39f8035cd0 0x7f39f800ac30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:07.374 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.324+0000 7ff1b99eb640 1 -- 172.21.15.150:0/1667358266 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7ff1b40b3e70 con 0x7ff1b41518d0 2024-09-17T05:42:07.374 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.324+0000 7f39ff7fe640 1 -- 172.21.15.150:0/194193650 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f39f8179120 con 0x7f39f8032680 2024-09-17T05:42:07.374 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.324+0000 7f3e40d5f640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3e34008fa0 0x7f3e340c9c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:42:07.374 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.324+0000 7f3e40d5f640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3e34008fa0 0x7f3e340c9c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3301/0 says I am v2:172.21.15.150:53190/0 (socket says 172.21.15.150:53190) 2024-09-17T05:42:07.375 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.324+0000 7f3a04927640 1 --2- 172.21.15.150:0/194193650 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f39f8035cd0 0x7f39f800ac30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T05:42:07.375 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.324+0000 7f991ffff640 1 --2- 172.21.15.150:0/1403871010 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f9924078c10 0x7f992407b120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:42:07.375 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.324+0000 7f3e3bfff640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3e3403ae90 0x7f3e340e26b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:42:07.375 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.324+0000 7f991ffff640 1 -- 172.21.15.150:0/1403871010 <== mon.2 v2:172.21.15.176:3301/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f992809b120 con 0x7f993806e2f0 2024-09-17T05:42:07.376 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.324+0000 7ff1b3fff640 1 --2- 172.21.15.150:0/1667358266 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff1b40b3520 0x7ff1b4147930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:42:07.376 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.324+0000 7f3e3bfff640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3e3403ae90 0x7f3e340e26b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:54594/0 (socket says 172.21.15.150:54594) 2024-09-17T05:42:07.376 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.325+0000 7f3e40d5f640 1 -- 172.21.15.150:0/2993638721 learned_addr learned my addr 172.21.15.150:0/2993638721 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:42:07.377 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.325+0000 7f991ffff640 1 --2- 172.21.15.150:0/1403871010 >> [v2:172.21.15.150:6816/363718461,v1:172.21.15.150:6817/363718461] conn(0x7f9924080e80 0x7f99240832d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:42:07.377 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.325+0000 7f3e41d61640 1 --2- 172.21.15.150:0/2993638721 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3e34055d10 0x7f3e340e2bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:42:07.377 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.325+0000 7f991ffff640 1 -- 172.21.15.150:0/1403871010 --> [v2:172.21.15.150:6816/363718461,v1:172.21.15.150:6817/363718461] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f992803fe50 con 0x7f9924080e80 2024-09-17T05:42:07.377 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.325+0000 7f39ff7fe640 1 --2- 172.21.15.150:0/194193650 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f39f8032680 0x7f39f80ccc20 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f39f000b3c0 tx=0x7f39f000b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:42:07.378 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.325+0000 7f991ffff640 1 -- 172.21.15.150:0/1403871010 <== mon.2 v2:172.21.15.176:3301/0 6 ==== mon_get_version_reply(handle=1 version=23) ==== 24+0+0 (secure 0 0 0) 0x7f992809b600 con 0x7f993806e2f0 2024-09-17T05:42:07.378 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.325+0000 7f3e41d61640 1 -- 172.21.15.150:0/2993638721 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f3e34052dc0 con 0x7f3e3403ae90 2024-09-17T05:42:07.378 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.324+0000 7f5acf0b1640 1 -- 172.21.15.150:0/1972112596 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f5ac80739f0 con 0x7f5ac8073e30 2024-09-17T05:42:07.379 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.325+0000 7f3e41d61640 1 -- 172.21.15.150:0/2993638721 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f3e34052c40 con 0x7f3e34055d10 2024-09-17T05:42:07.379 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.325+0000 7f3e41d61640 1 -- 172.21.15.150:0/2993638721 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f3e34008040 con 0x7f3e34008fa0 2024-09-17T05:42:07.379 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.325+0000 7f9937fff640 1 --2- 172.21.15.150:0/1403871010 >> [v2:172.21.15.150:6816/363718461,v1:172.21.15.150:6817/363718461] conn(0x7f9924080e80 0x7f99240832d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:42:07.379 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.325+0000 7f3e41560640 1 --2- 172.21.15.150:0/2993638721 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3e34055d10 0x7f3e340e2bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:42:07.380 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.325+0000 7fcf32ffd640 1 --2- 172.21.15.150:0/3626831450 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fcf340cff60 0x7fcf34205c70 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fcf2400c6c0 tx=0x7fcf2400cb80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:42:07.380 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.325+0000 7ff1b91ea640 1 -- 172.21.15.150:0/1667358266 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff1b40b3520 msgr2=0x7ff1b4147930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:07.380 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.325+0000 7ff1b91ea640 1 --2- 172.21.15.150:0/1667358266 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff1b40b3520 0x7ff1b4147930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:07.380 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.325+0000 7ff1b91ea640 1 -- 172.21.15.150:0/1667358266 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff1b40735c0 msgr2=0x7ff1b4157b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:07.380 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.325+0000 7ff1b91ea640 1 --2- 172.21.15.150:0/1667358266 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff1b40735c0 0x7ff1b4157b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:07.381 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.325+0000 7ff1b91ea640 1 -- 172.21.15.150:0/1667358266 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff1b41565e0 con 0x7ff1b41518d0 2024-09-17T05:42:07.381 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.325+0000 7f9936ffd640 1 --2- 172.21.15.150:0/1403871010 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f9924078c10 0x7f992407b120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:42:07.381 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.325+0000 7f39fcff9640 1 -- 172.21.15.150:0/194193650 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39f0011830 con 0x7f39f8032680 2024-09-17T05:42:07.381 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.325+0000 7f39fcff9640 1 -- 172.21.15.150:0/194193650 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f39f0016070 con 0x7f39f8032680 2024-09-17T05:42:07.382 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.325+0000 7f39fcff9640 1 -- 172.21.15.150:0/194193650 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39f0011830 con 0x7f39f8032680 2024-09-17T05:42:07.382 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.325+0000 7fcf1b7fe640 1 -- 172.21.15.150:0/3626831450 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf24003b70 con 0x7fcf340cff60 2024-09-17T05:42:07.382 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.326+0000 7fcf1b7fe640 1 -- 172.21.15.150:0/3626831450 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fcf24003d10 con 0x7fcf340cff60 2024-09-17T05:42:07.382 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.326+0000 7f3a05128640 1 -- 172.21.15.150:0/194193650 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f39f8179620 con 0x7f39f8032680 2024-09-17T05:42:07.382 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.326+0000 7f3e3bfff640 1 -- 172.21.15.150:0/2993638721 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3e34008fa0 msgr2=0x7f3e340c9c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:07.383 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.326+0000 7f3a05128640 1 -- 172.21.15.150:0/194193650 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f39f8179900 con 0x7f39f8032680 2024-09-17T05:42:07.383 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.326+0000 7f3e3bfff640 1 --2- 172.21.15.150:0/2993638721 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3e34008fa0 0x7f3e340c9c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:07.383 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.326+0000 7fcf1b7fe640 1 -- 172.21.15.150:0/3626831450 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf240052d0 con 0x7fcf340cff60 2024-09-17T05:42:07.383 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.326+0000 7fcf392da640 1 -- 172.21.15.150:0/3626831450 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcf342028d0 con 0x7fcf340cff60 2024-09-17T05:42:07.384 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.326+0000 7f5abeffd640 1 -- 172.21.15.150:0/1972112596 <== mon.1 v2:172.21.15.176:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f5ab801a070 con 0x7f5ac8073e30 2024-09-17T05:42:07.384 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.326+0000 7f497dffb640 1 -- 172.21.15.150:0/2657467871 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f4984005420 con 0x7f498003c1f0 2024-09-17T05:42:07.384 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.326+0000 7f2832ffd640 1 -- 172.21.15.150:0/997559154 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f283c01a400 con 0x7f28440cd410 2024-09-17T05:42:07.385 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.327+0000 7f2832ffd640 1 --2- 172.21.15.150:0/997559154 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f282407b1a0 0x7f282407d6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:42:07.385 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.327+0000 7f5abeffd640 1 --2- 172.21.15.150:0/1972112596 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f5aac078b90 0x7f5aac07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:42:07.385 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.327+0000 7f3a05128640 1 -- 172.21.15.150:0/194193650 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f39f8004c60 con 0x7f39f8032680 2024-09-17T05:42:07.385 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.327+0000 7f497dffb640 1 --2- 172.21.15.150:0/2657467871 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f496c078b90 0x7f496c07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:42:07.386 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.327+0000 7f5abeffd640 1 -- 172.21.15.150:0/1972112596 <== mon.1 v2:172.21.15.176:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f5ab809a0a0 con 0x7f5ac8073e30 2024-09-17T05:42:07.386 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.327+0000 7f5abeffd640 1 --2- 172.21.15.150:0/1972112596 >> [v2:172.21.15.176:6818/2049295774,v1:172.21.15.176:6819/2049295774] conn(0x7f5aac080de0 0x7f5aac083230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:42:07.386 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.327+0000 7f5abeffd640 1 -- 172.21.15.150:0/1972112596 --> [v2:172.21.15.176:6818/2049295774,v1:172.21.15.176:6819/2049295774] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f5ab8016ec0 con 0x7f5aac080de0 2024-09-17T05:42:07.387 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.326+0000 7ff1b91ea640 1 --2- 172.21.15.150:0/1667358266 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff1b41518d0 0x7ff1b41f3b90 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7ff1a4031000 tx=0x7ff1a4003b90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:42:07.387 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.327+0000 7ff1b17fa640 1 -- 172.21.15.150:0/1667358266 <== mon.2 v2:172.21.15.176:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1a403e030 con 0x7ff1b41518d0 2024-09-17T05:42:07.387 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.327+0000 7ff1b17fa640 1 -- 172.21.15.150:0/1667358266 <== mon.2 v2:172.21.15.176:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff1a40047a0 con 0x7ff1b41518d0 2024-09-17T05:42:07.387 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.327+0000 7ff1b17fa640 1 -- 172.21.15.150:0/1667358266 <== mon.2 v2:172.21.15.176:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1a4035040 con 0x7ff1b41518d0 2024-09-17T05:42:07.387 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.327+0000 7f9937fff640 1 --2- 172.21.15.150:0/1403871010 >> [v2:172.21.15.150:6816/363718461,v1:172.21.15.150:6817/363718461] conn(0x7f9924080e80 0x7f99240832d0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:42:07.387 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.327+0000 7f498cda2640 1 --2- 172.21.15.150:0/2657467871 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f496c078b90 0x7f496c07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:42:07.388 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.327+0000 7f284259c640 1 --2- 172.21.15.150:0/997559154 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f282407b1a0 0x7f282407d6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:42:07.388 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.327+0000 7f5abeffd640 1 -- 172.21.15.150:0/1972112596 <== mon.1 v2:172.21.15.176:3300/0 6 ==== mon_get_version_reply(handle=1 version=23) ==== 24+0+0 (secure 0 0 0) 0x7f5ab80a1050 con 0x7f5ac8073e30 2024-09-17T05:42:07.388 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.328+0000 7fcf392da640 1 -- 172.21.15.150:0/3626831450 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcf34202e90 con 0x7fcf340cff60 2024-09-17T05:42:07.389 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.328+0000 7ff1b99eb640 1 -- 172.21.15.150:0/1667358266 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff1b41f2dd0 con 0x7ff1b41518d0 2024-09-17T05:42:07.389 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.327+0000 7f2832ffd640 1 -- 172.21.15.150:0/997559154 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f283c00cd50 con 0x7f28440cd410 2024-09-17T05:42:07.389 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.328+0000 7ff1b99eb640 1 -- 172.21.15.150:0/1667358266 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7ff1b41f3390 con 0x7ff1b41518d0 2024-09-17T05:42:07.389 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.328+0000 7f5acd8ae640 1 --2- 172.21.15.150:0/1972112596 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f5aac078b90 0x7f5aac07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:42:07.390 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.328+0000 7f5ace8b0640 1 --2- 172.21.15.150:0/1972112596 >> [v2:172.21.15.176:6818/2049295774,v1:172.21.15.176:6819/2049295774] conn(0x7f5aac080de0 0x7f5aac083230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:42:07.390 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.328+0000 7f498cda2640 1 --2- 172.21.15.150:0/2657467871 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f496c078b90 0x7f496c07b0a0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f4978000f60 tx=0x7f4978009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:42:07.390 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.328+0000 7f2832ffd640 1 --2- 172.21.15.150:0/997559154 >> [v2:172.21.15.150:6800/479374392,v1:172.21.15.150:6801/479374392] conn(0x7f2824083f10 0x7f2824086400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:42:07.391 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.326+0000 7f3e3bfff640 1 -- 172.21.15.150:0/2993638721 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3e34055d10 msgr2=0x7f3e340e2bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:07.391 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.326+0000 7f3e3bfff640 1 --2- 172.21.15.150:0/2993638721 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3e34055d10 0x7f3e340e2bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:07.391 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.326+0000 7f3e3bfff640 1 -- 172.21.15.150:0/2993638721 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3e340d3c60 con 0x7f3e3403ae90 2024-09-17T05:42:07.391 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.327+0000 7f3e3bfff640 1 --2- 172.21.15.150:0/2993638721 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3e3403ae90 0x7f3e340e26b0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f3e2800d660 tx=0x7f3e2800da60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:42:07.391 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.328+0000 7f3e397fa640 1 -- 172.21.15.150:0/2993638721 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e28017070 con 0x7f3e3403ae90 2024-09-17T05:42:07.391 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.328+0000 7f3e397fa640 1 -- 172.21.15.150:0/2993638721 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f3e280098f0 con 0x7f3e3403ae90 2024-09-17T05:42:07.391 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.328+0000 7f2832ffd640 1 -- 172.21.15.150:0/997559154 --> [v2:172.21.15.150:6800/479374392,v1:172.21.15.150:6801/479374392] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f2824086ad0 con 0x7f2824083f10 2024-09-17T05:42:07.392 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.328+0000 7f2841d9b640 1 --2- 172.21.15.150:0/997559154 >> [v2:172.21.15.150:6800/479374392,v1:172.21.15.150:6801/479374392] conn(0x7f2824083f10 0x7f2824086400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:42:07.392 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.328+0000 7f497dffb640 1 -- 172.21.15.150:0/2657467871 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f4984099410 con 0x7f498003c1f0 2024-09-17T05:42:07.392 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.328+0000 7f497dffb640 1 --2- 172.21.15.150:0/2657467871 >> [v2:172.21.15.150:6824/913899800,v1:172.21.15.150:6825/913899800] conn(0x7f496c080de0 0x7f496c083230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:42:07.392 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.328+0000 7f497dffb640 1 -- 172.21.15.150:0/2657467871 --> [v2:172.21.15.150:6824/913899800,v1:172.21.15.150:6825/913899800] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f496c083900 con 0x7f496c080de0 2024-09-17T05:42:07.392 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.328+0000 7f497dffb640 1 -- 172.21.15.150:0/2657467871 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_get_version_reply(handle=1 version=23) ==== 24+0+0 (secure 0 0 0) 0x7f49840a0060 con 0x7f498003c1f0 2024-09-17T05:42:07.392 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.328+0000 7f5acd8ae640 1 --2- 172.21.15.150:0/1972112596 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f5aac078b90 0x7f5aac07b0a0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f5ac4007fd0 tx=0x7f5ac4007b00 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:42:07.393 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.329+0000 7f2832ffd640 1 -- 172.21.15.150:0/997559154 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_get_version_reply(handle=1 version=23) ==== 24+0+0 (secure 0 0 0) 0x7f283c05f6e0 con 0x7f28440cd410 2024-09-17T05:42:07.393 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.326+0000 7f9936ffd640 1 --2- 172.21.15.150:0/1403871010 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f9924078c10 0x7f992407b120 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f992c034000 tx=0x7f992c0046c0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:42:07.393 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.328+0000 7f3e397fa640 1 -- 172.21.15.150:0/2993638721 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e28009d20 con 0x7f3e3403ae90 2024-09-17T05:42:07.393 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.329+0000 7f3e41d61640 1 -- 172.21.15.150:0/2993638721 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3e340d4db0 con 0x7f3e3403ae90 2024-09-17T05:42:07.394 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.329+0000 7f39fcff9640 1 -- 172.21.15.150:0/194193650 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f39f0011b00 con 0x7f39f8032680 2024-09-17T05:42:07.394 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.329+0000 7fcf197fa640 1 -- 172.21.15.150:0/3626831450 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fcf340d0370 con 0x7fcf340cff60 2024-09-17T05:42:07.395 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.329+0000 7f498dda4640 1 --2- 172.21.15.150:0/2657467871 >> [v2:172.21.15.150:6824/913899800,v1:172.21.15.150:6825/913899800] conn(0x7f496c080de0 0x7f496c083230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:42:07.395 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.329+0000 7f3e41d61640 1 -- 172.21.15.150:0/2993638721 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3e340d5370 con 0x7f3e3403ae90 2024-09-17T05:42:07.395 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.329+0000 7f5ace8b0640 1 --2- 172.21.15.150:0/1972112596 >> [v2:172.21.15.176:6818/2049295774,v1:172.21.15.176:6819/2049295774] conn(0x7f5aac080de0 0x7f5aac083230 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:42:07.395 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.329+0000 7f39fcff9640 1 --2- 172.21.15.150:0/194193650 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f39ec078f90 0x7f39ec07b4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:42:07.396 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.329+0000 7f498dda4640 1 --2- 172.21.15.150:0/2657467871 >> [v2:172.21.15.150:6824/913899800,v1:172.21.15.150:6825/913899800] conn(0x7f496c080de0 0x7f496c083230 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:42:07.396 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.329+0000 7f991ffff640 1 -- 172.21.15.150:0/1403871010 <== osd.2 v2:172.21.15.150:6816/363718461 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f992803fe50 con 0x7f9924080e80 2024-09-17T05:42:07.396 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.330+0000 7f39fcff9640 1 -- 172.21.15.150:0/194193650 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f39f0011630 con 0x7f39f8032680 2024-09-17T05:42:07.397 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.330+0000 7f2841d9b640 1 --2- 172.21.15.150:0/997559154 >> [v2:172.21.15.150:6800/479374392,v1:172.21.15.150:6801/479374392] conn(0x7f2824083f10 0x7f2824086400 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:42:07.397 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.330+0000 7f39fffff640 1 --2- 172.21.15.150:0/194193650 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f39ec078f90 0x7f39ec07b4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:42:07.398 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.330+0000 7f39fcff9640 1 --2- 172.21.15.150:0/194193650 >> [v2:172.21.15.176:6826/2164458476,v1:172.21.15.176:6827/2164458476] conn(0x7f39ec0811e0 0x7f39ec083630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:42:07.398 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.330+0000 7f39fcff9640 1 -- 172.21.15.150:0/194193650 --> [v2:172.21.15.176:6826/2164458476,v1:172.21.15.176:6827/2164458476] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f39ec083d00 con 0x7f39ec0811e0 2024-09-17T05:42:07.398 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.330+0000 7f39fcff9640 1 -- 172.21.15.150:0/194193650 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_get_version_reply(handle=1 version=23) ==== 24+0+0 (secure 0 0 0) 0x7f39f009b0e0 con 0x7f39f8032680 2024-09-17T05:42:07.398 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.330+0000 7f3a04927640 1 --2- 172.21.15.150:0/194193650 >> [v2:172.21.15.176:6826/2164458476,v1:172.21.15.176:6827/2164458476] conn(0x7f39ec0811e0 0x7f39ec083630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:42:07.398 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.330+0000 7ff1b99eb640 1 -- 172.21.15.150:0/1667358266 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_get_version(what=osdmap handle=1) -- 0x7ff1b41547b0 con 0x7ff1b41518d0 2024-09-17T05:42:07.398 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.330+0000 7f3e41d61640 1 -- 172.21.15.150:0/2993638721 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f3e3400a7f0 con 0x7f3e3403ae90 2024-09-17T05:42:07.399 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.330+0000 7f39fffff640 1 --2- 172.21.15.150:0/194193650 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f39ec078f90 0x7f39ec07b4a0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f39f4003a70 tx=0x7f39f4003a00 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:42:07.399 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.330+0000 7ff1b17fa640 1 -- 172.21.15.150:0/1667358266 <== mon.2 v2:172.21.15.176:3301/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7ff1a4041030 con 0x7ff1b41518d0 2024-09-17T05:42:07.399 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.330+0000 7fcf1b7fe640 1 -- 172.21.15.150:0/3626831450 <== mon.1 v2:172.21.15.176:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fcf24005470 con 0x7fcf340cff60 2024-09-17T05:42:07.400 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.331+0000 7f284259c640 1 --2- 172.21.15.150:0/997559154 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f282407b1a0 0x7f282407d6b0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f2838009230 tx=0x7f2838004730 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:42:07.400 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.331+0000 7f5abeffd640 1 -- 172.21.15.150:0/1972112596 <== osd.5 v2:172.21.15.176:6818/2049295774 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f5ab8016ec0 con 0x7f5aac080de0 2024-09-17T05:42:07.400 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.331+0000 7f497dffb640 1 -- 172.21.15.150:0/2657467871 <== osd.1 v2:172.21.15.150:6824/913899800 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f496c083900 con 0x7f496c080de0 2024-09-17T05:42:07.400 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.331+0000 7f3a04927640 1 --2- 172.21.15.150:0/194193650 >> [v2:172.21.15.176:6826/2164458476,v1:172.21.15.176:6827/2164458476] conn(0x7f39ec0811e0 0x7f39ec083630 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:42:07.401 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.331+0000 7ff1b17fa640 1 --2- 172.21.15.150:0/1667358266 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7ff1a0078c10 0x7ff1a007b120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:42:07.401 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.331+0000 7fcf1b7fe640 1 --2- 172.21.15.150:0/3626831450 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fcf20078be0 0x7fcf2007b0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:42:07.401 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.331+0000 7ff1b89e9640 1 --2- 172.21.15.150:0/1667358266 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7ff1a0078c10 0x7ff1a007b120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:42:07.402 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.331+0000 7ff1b17fa640 1 -- 172.21.15.150:0/1667358266 <== mon.2 v2:172.21.15.176:3301/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7ff1a40bb3a0 con 0x7ff1b41518d0 2024-09-17T05:42:07.402 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.331+0000 7fcf327fc640 1 --2- 172.21.15.150:0/3626831450 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fcf20078be0 0x7fcf2007b0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:42:07.402 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.331+0000 7fcf1b7fe640 1 -- 172.21.15.150:0/3626831450 <== mon.1 v2:172.21.15.176:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7fcf2409ab60 con 0x7fcf340cff60 2024-09-17T05:42:07.402 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.332+0000 7ff1b17fa640 1 --2- 172.21.15.150:0/1667358266 >> [v2:172.21.15.176:6810/2718261497,v1:172.21.15.176:6811/2718261497] conn(0x7ff1a0080e80 0x7ff1a00832d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:42:07.403 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.332+0000 7fcf1b7fe640 1 --2- 172.21.15.150:0/3626831450 >> [v2:172.21.15.176:6802/3239587708,v1:172.21.15.176:6803/3239587708] conn(0x7fcf20080e50 0x7fcf200832a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:42:07.403 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.332+0000 7fcf1b7fe640 1 -- 172.21.15.150:0/3626831450 --> [v2:172.21.15.176:6802/3239587708,v1:172.21.15.176:6803/3239587708] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fcf2401ae50 con 0x7fcf20080e50 2024-09-17T05:42:07.403 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.332+0000 7fcf1b7fe640 1 -- 172.21.15.150:0/3626831450 <== mon.1 v2:172.21.15.176:3300/0 6 ==== mon_get_version_reply(handle=1 version=23) ==== 24+0+0 (secure 0 0 0) 0x7fcf2409af10 con 0x7fcf340cff60 2024-09-17T05:42:07.403 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.332+0000 7ff1b17fa640 1 -- 172.21.15.150:0/1667358266 --> [v2:172.21.15.176:6810/2718261497,v1:172.21.15.176:6811/2718261497] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7ff1a402ce50 con 0x7ff1a0080e80 2024-09-17T05:42:07.404 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.332+0000 7ff1b17fa640 1 -- 172.21.15.150:0/1667358266 <== mon.2 v2:172.21.15.176:3301/0 6 ==== mon_get_version_reply(handle=1 version=23) ==== 24+0+0 (secure 0 0 0) 0x7ff1a40c2050 con 0x7ff1b41518d0 2024-09-17T05:42:07.404 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.332+0000 7ff1b89e9640 1 --2- 172.21.15.150:0/1667358266 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7ff1a0078c10 0x7ff1a007b120 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7ff1ac009e90 tx=0x7ff1ac009420 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:42:07.404 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.332+0000 7fcf327fc640 1 --2- 172.21.15.150:0/3626831450 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fcf20078be0 0x7fcf2007b0f0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fcf2c000f60 tx=0x7fcf2c009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:42:07.404 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.332+0000 7ff1b3fff640 1 --2- 172.21.15.150:0/1667358266 >> [v2:172.21.15.176:6810/2718261497,v1:172.21.15.176:6811/2718261497] conn(0x7ff1a0080e80 0x7ff1a00832d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:42:07.405 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.332+0000 7f2832ffd640 1 -- 172.21.15.150:0/997559154 <== osd.0 v2:172.21.15.150:6800/479374392 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f2824086ad0 con 0x7f2824083f10 2024-09-17T05:42:07.405 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.332+0000 7fcf337fe640 1 --2- 172.21.15.150:0/3626831450 >> [v2:172.21.15.176:6802/3239587708,v1:172.21.15.176:6803/3239587708] conn(0x7fcf20080e50 0x7fcf200832a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:42:07.405 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.333+0000 7f3e397fa640 1 -- 172.21.15.150:0/2993638721 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f3e2801a070 con 0x7f3e3403ae90 2024-09-17T05:42:07.405 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.332+0000 7f39fcff9640 1 -- 172.21.15.150:0/194193650 <== osd.6 v2:172.21.15.176:6826/2164458476 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f39ec083d00 con 0x7f39ec0811e0 2024-09-17T05:42:07.406 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.333+0000 7ff1b3fff640 1 --2- 172.21.15.150:0/1667358266 >> [v2:172.21.15.176:6810/2718261497,v1:172.21.15.176:6811/2718261497] conn(0x7ff1a0080e80 0x7ff1a00832d0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:42:07.406 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.333+0000 7f3e397fa640 1 --2- 172.21.15.150:0/2993638721 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f3e20078be0 0x7f3e2007b0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:42:07.406 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.333+0000 7ff1b17fa640 1 -- 172.21.15.150:0/1667358266 <== osd.4 v2:172.21.15.176:6810/2718261497 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7ff1a402ce50 con 0x7ff1a0080e80 2024-09-17T05:42:07.407 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.333+0000 7f3e40d5f640 1 --2- 172.21.15.150:0/2993638721 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f3e20078be0 0x7f3e2007b0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:42:07.407 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.334+0000 7f3e397fa640 1 -- 172.21.15.150:0/2993638721 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f3e2809aff0 con 0x7f3e3403ae90 2024-09-17T05:42:07.407 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.334+0000 7f3e40d5f640 1 --2- 172.21.15.150:0/2993638721 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f3e20078be0 0x7f3e2007b0f0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f3e300108b0 tx=0x7f3e300046c0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:42:07.408 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.334+0000 7f3e397fa640 1 --2- 172.21.15.150:0/2993638721 >> [v2:172.21.15.150:6808/3550994626,v1:172.21.15.150:6809/3550994626] conn(0x7f3e20080eb0 0x7f3e20083300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:42:07.408 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.334+0000 7f3e397fa640 1 -- 172.21.15.150:0/2993638721 --> [v2:172.21.15.150:6808/3550994626,v1:172.21.15.150:6809/3550994626] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f3e200839d0 con 0x7f3e20080eb0 2024-09-17T05:42:07.408 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.334+0000 7f3e397fa640 1 -- 172.21.15.150:0/2993638721 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_get_version_reply(handle=1 version=23) ==== 24+0+0 (secure 0 0 0) 0x7f3e2809b420 con 0x7f3e3403ae90 2024-09-17T05:42:07.408 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.335+0000 7f3e41560640 1 --2- 172.21.15.150:0/2993638721 >> [v2:172.21.15.150:6808/3550994626,v1:172.21.15.150:6809/3550994626] conn(0x7f3e20080eb0 0x7f3e20083300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:42:07.408 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.335+0000 7fcf337fe640 1 --2- 172.21.15.150:0/3626831450 >> [v2:172.21.15.176:6802/3239587708,v1:172.21.15.176:6803/3239587708] conn(0x7fcf20080e50 0x7fcf200832a0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:42:07.409 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.335+0000 7f3e41560640 1 --2- 172.21.15.150:0/2993638721 >> [v2:172.21.15.150:6808/3550994626,v1:172.21.15.150:6809/3550994626] conn(0x7f3e20080eb0 0x7f3e20083300 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:42:07.409 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.336+0000 7f3e397fa640 1 -- 172.21.15.150:0/2993638721 <== osd.3 v2:172.21.15.150:6808/3550994626 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f3e200839d0 con 0x7f3e20080eb0 2024-09-17T05:42:07.409 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.338+0000 7fcf1b7fe640 1 -- 172.21.15.150:0/3626831450 <== osd.7 v2:172.21.15.176:6802/3239587708 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fcf2401ae50 con 0x7fcf20080e50 2024-09-17T05:42:07.409 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.348+0000 7f3a05128640 1 -- 172.21.15.150:0/194193650 --> [v2:172.21.15.176:6826/2164458476,v1:172.21.15.176:6827/2164458476] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f39f80066c0 con 0x7f39ec0811e0 2024-09-17T05:42:07.409 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.348+0000 7f39fcff9640 1 -- 172.21.15.150:0/194193650 <== osd.6 v2:172.21.15.176:6826/2164458476 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f39f80066c0 con 0x7f39ec0811e0 2024-09-17T05:42:07.411 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.349+0000 7f3a05128640 1 -- 172.21.15.150:0/194193650 >> [v2:172.21.15.176:6826/2164458476,v1:172.21.15.176:6827/2164458476] conn(0x7f39ec0811e0 msgr2=0x7f39ec083630 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:07.411 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.349+0000 7f3a05128640 1 --2- 172.21.15.150:0/194193650 >> [v2:172.21.15.176:6826/2164458476,v1:172.21.15.176:6827/2164458476] conn(0x7f39ec0811e0 0x7f39ec083630 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:07.411 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.349+0000 7f3a05128640 1 -- 172.21.15.150:0/194193650 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f39ec078f90 msgr2=0x7f39ec07b4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:07.411 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.349+0000 7f3a05128640 1 --2- 172.21.15.150:0/194193650 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f39ec078f90 0x7f39ec07b4a0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f39f4003a70 tx=0x7f39f4003a00 comp rx=0 tx=0).stop 2024-09-17T05:42:07.411 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.350+0000 7f3a05128640 1 -- 172.21.15.150:0/194193650 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f39f8032680 msgr2=0x7f39f80ccc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:07.411 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.350+0000 7f3a05128640 1 --2- 172.21.15.150:0/194193650 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f39f8032680 0x7f39f80ccc20 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f39f000b3c0 tx=0x7f39f000b880 comp rx=0 tx=0).stop 2024-09-17T05:42:07.411 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.350+0000 7f3a04927640 1 -- 172.21.15.150:0/194193650 reap_dead start 2024-09-17T05:42:07.411 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.350+0000 7f3a05128640 1 -- 172.21.15.150:0/194193650 shutdown_connections 2024-09-17T05:42:07.411 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.350+0000 7f3a05128640 1 -- 172.21.15.150:0/194193650 >> 172.21.15.150:0/194193650 conn(0x7f39f801d9a0 msgr2=0x7f39f80546b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:42:07.412 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.350+0000 7f3a05128640 1 -- 172.21.15.150:0/194193650 shutdown_connections 2024-09-17T05:42:07.412 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.351+0000 7f3a05128640 1 -- 172.21.15.150:0/194193650 wait complete. 2024-09-17T05:42:07.412 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.355+0000 7f993deec640 1 -- 172.21.15.150:0/1403871010 --> [v2:172.21.15.150:6816/363718461,v1:172.21.15.150:6817/363718461] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f99380d0900 con 0x7f9924080e80 2024-09-17T05:42:07.412 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.355+0000 7f991ffff640 1 -- 172.21.15.150:0/1403871010 <== osd.2 v2:172.21.15.150:6816/363718461 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f99380d0900 con 0x7f9924080e80 2024-09-17T05:42:07.414 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.356+0000 7f991dffb640 1 -- 172.21.15.150:0/1403871010 >> [v2:172.21.15.150:6816/363718461,v1:172.21.15.150:6817/363718461] conn(0x7f9924080e80 msgr2=0x7f99240832d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:07.414 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.356+0000 7f991dffb640 1 --2- 172.21.15.150:0/1403871010 >> [v2:172.21.15.150:6816/363718461,v1:172.21.15.150:6817/363718461] conn(0x7f9924080e80 0x7f99240832d0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:07.414 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.357+0000 7f991dffb640 1 -- 172.21.15.150:0/1403871010 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f9924078c10 msgr2=0x7f992407b120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:07.414 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.357+0000 7f991dffb640 1 --2- 172.21.15.150:0/1403871010 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f9924078c10 0x7f992407b120 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f992c034000 tx=0x7f992c0046c0 comp rx=0 tx=0).stop 2024-09-17T05:42:07.414 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.357+0000 7f991dffb640 1 -- 172.21.15.150:0/1403871010 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f993806e2f0 msgr2=0x7f99381f9750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:07.414 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.357+0000 7f991dffb640 1 --2- 172.21.15.150:0/1403871010 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f993806e2f0 0x7f99381f9750 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f992800d750 tx=0x7f992800dc10 comp rx=0 tx=0).stop 2024-09-17T05:42:07.414 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.357+0000 7f9937fff640 1 -- 172.21.15.150:0/1403871010 reap_dead start 2024-09-17T05:42:07.414 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.357+0000 7f991dffb640 1 -- 172.21.15.150:0/1403871010 shutdown_connections 2024-09-17T05:42:07.414 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.357+0000 7f991dffb640 1 -- 172.21.15.150:0/1403871010 >> 172.21.15.150:0/1403871010 conn(0x7f99380738b0 msgr2=0x7f99381614b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:42:07.414 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.358+0000 7f991dffb640 1 -- 172.21.15.150:0/1403871010 shutdown_connections 2024-09-17T05:42:07.415 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.358+0000 7f991dffb640 1 -- 172.21.15.150:0/1403871010 wait complete. 2024-09-17T05:42:07.415 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.361+0000 7f496b7fe640 1 -- 172.21.15.150:0/2657467871 --> [v2:172.21.15.150:6824/913899800,v1:172.21.15.150:6825/913899800] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f49800db960 con 0x7f496c080de0 2024-09-17T05:42:07.415 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.361+0000 7f497dffb640 1 -- 172.21.15.150:0/2657467871 <== osd.1 v2:172.21.15.150:6824/913899800 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f49800db960 con 0x7f496c080de0 2024-09-17T05:42:07.415 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.361+0000 7f2848c5c640 1 -- 172.21.15.150:0/997559154 --> [v2:172.21.15.150:6800/479374392,v1:172.21.15.150:6801/479374392] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f28440ca450 con 0x7f2824083f10 2024-09-17T05:42:07.416 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.362+0000 7f2832ffd640 1 -- 172.21.15.150:0/997559154 <== osd.0 v2:172.21.15.150:6800/479374392 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f28440ca450 con 0x7f2824083f10 2024-09-17T05:42:07.416 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.362+0000 7f2848c5c640 1 -- 172.21.15.150:0/997559154 >> [v2:172.21.15.150:6800/479374392,v1:172.21.15.150:6801/479374392] conn(0x7f2824083f10 msgr2=0x7f2824086400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:07.417 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.362+0000 7f2848c5c640 1 --2- 172.21.15.150:0/997559154 >> [v2:172.21.15.150:6800/479374392,v1:172.21.15.150:6801/479374392] conn(0x7f2824083f10 0x7f2824086400 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:07.417 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.362+0000 7f498e5a5640 1 -- 172.21.15.150:0/2657467871 >> [v2:172.21.15.150:6824/913899800,v1:172.21.15.150:6825/913899800] conn(0x7f496c080de0 msgr2=0x7f496c083230 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:07.417 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.362+0000 7f498e5a5640 1 --2- 172.21.15.150:0/2657467871 >> [v2:172.21.15.150:6824/913899800,v1:172.21.15.150:6825/913899800] conn(0x7f496c080de0 0x7f496c083230 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:07.418 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.363+0000 7f2848c5c640 1 -- 172.21.15.150:0/997559154 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f282407b1a0 msgr2=0x7f282407d6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:07.418 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.363+0000 7f2848c5c640 1 --2- 172.21.15.150:0/997559154 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f282407b1a0 0x7f282407d6b0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f2838009230 tx=0x7f2838004730 comp rx=0 tx=0).stop 2024-09-17T05:42:07.418 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.363+0000 7f2848c5c640 1 -- 172.21.15.150:0/997559154 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f28440cd410 msgr2=0x7f28441f5840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:07.418 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.363+0000 7f2848c5c640 1 --2- 172.21.15.150:0/997559154 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f28440cd410 0x7f28441f5840 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f283c005fd0 tx=0x7f283c00c640 comp rx=0 tx=0).stop 2024-09-17T05:42:07.418 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.363+0000 7f2842d9d640 1 -- 172.21.15.150:0/997559154 reap_dead start 2024-09-17T05:42:07.418 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.363+0000 7f498e5a5640 1 -- 172.21.15.150:0/2657467871 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f496c078b90 msgr2=0x7f496c07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:07.419 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.363+0000 7f498e5a5640 1 --2- 172.21.15.150:0/2657467871 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f496c078b90 0x7f496c07b0a0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f4978000f60 tx=0x7f4978009040 comp rx=0 tx=0).stop 2024-09-17T05:42:07.419 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.363+0000 7f498e5a5640 1 -- 172.21.15.150:0/2657467871 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f498003c1f0 msgr2=0x7f49800d4bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:07.419 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.363+0000 7f498e5a5640 1 --2- 172.21.15.150:0/2657467871 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f498003c1f0 0x7f49800d4bf0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f498400e790 tx=0x7f498400ec50 comp rx=0 tx=0).stop 2024-09-17T05:42:07.419 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.363+0000 7f498dda4640 1 -- 172.21.15.150:0/2657467871 reap_dead start 2024-09-17T05:42:07.419 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.363+0000 7f2848c5c640 1 -- 172.21.15.150:0/997559154 shutdown_connections 2024-09-17T05:42:07.419 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.363+0000 7f2848c5c640 1 -- 172.21.15.150:0/997559154 >> 172.21.15.150:0/997559154 conn(0x7f284406d3d0 msgr2=0x7f28440ad6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:42:07.420 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.364+0000 7f498e5a5640 1 -- 172.21.15.150:0/2657467871 shutdown_connections 2024-09-17T05:42:07.420 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.364+0000 7f498e5a5640 1 -- 172.21.15.150:0/2657467871 >> 172.21.15.150:0/2657467871 conn(0x7f498003a5f0 msgr2=0x7f49800d2dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:42:07.420 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.364+0000 7f2848c5c640 1 -- 172.21.15.150:0/997559154 shutdown_connections 2024-09-17T05:42:07.420 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.364+0000 7ff1b99eb640 1 -- 172.21.15.150:0/1667358266 --> [v2:172.21.15.176:6810/2718261497,v1:172.21.15.176:6811/2718261497] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7ff1b4156390 con 0x7ff1a0080e80 2024-09-17T05:42:07.421 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.364+0000 7f498e5a5640 1 -- 172.21.15.150:0/2657467871 shutdown_connections 2024-09-17T05:42:07.421 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.364+0000 7f498e5a5640 1 -- 172.21.15.150:0/2657467871 wait complete. 2024-09-17T05:42:07.421 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.364+0000 7f2848c5c640 1 -- 172.21.15.150:0/997559154 wait complete. 2024-09-17T05:42:07.421 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.364+0000 7ff1b17fa640 1 -- 172.21.15.150:0/1667358266 <== osd.4 v2:172.21.15.176:6810/2718261497 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7ff1b4156390 con 0x7ff1a0080e80 2024-09-17T05:42:07.422 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.365+0000 7ff1b99eb640 1 -- 172.21.15.150:0/1667358266 >> [v2:172.21.15.176:6810/2718261497,v1:172.21.15.176:6811/2718261497] conn(0x7ff1a0080e80 msgr2=0x7ff1a00832d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:07.422 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.365+0000 7ff1b99eb640 1 --2- 172.21.15.150:0/1667358266 >> [v2:172.21.15.176:6810/2718261497,v1:172.21.15.176:6811/2718261497] conn(0x7ff1a0080e80 0x7ff1a00832d0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:07.422 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.365+0000 7f3e41d61640 1 -- 172.21.15.150:0/2993638721 --> [v2:172.21.15.150:6808/3550994626,v1:172.21.15.150:6809/3550994626] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f3e3400a7f0 con 0x7f3e20080eb0 2024-09-17T05:42:07.423 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.365+0000 7ff1b99eb640 1 -- 172.21.15.150:0/1667358266 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7ff1a0078c10 msgr2=0x7ff1a007b120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:07.423 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.365+0000 7ff1b99eb640 1 --2- 172.21.15.150:0/1667358266 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7ff1a0078c10 0x7ff1a007b120 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7ff1ac009e90 tx=0x7ff1ac009420 comp rx=0 tx=0).stop 2024-09-17T05:42:07.423 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.365+0000 7ff1b99eb640 1 -- 172.21.15.150:0/1667358266 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff1b41518d0 msgr2=0x7ff1b41f3b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:07.423 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.365+0000 7ff1b99eb640 1 --2- 172.21.15.150:0/1667358266 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff1b41518d0 0x7ff1b41f3b90 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7ff1a4031000 tx=0x7ff1a4003b90 comp rx=0 tx=0).stop 2024-09-17T05:42:07.423 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.365+0000 7ff1b91ea640 1 -- 172.21.15.150:0/1667358266 reap_dead start 2024-09-17T05:42:07.423 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.366+0000 7ff1b99eb640 1 -- 172.21.15.150:0/1667358266 shutdown_connections 2024-09-17T05:42:07.424 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.366+0000 7ff1b99eb640 1 -- 172.21.15.150:0/1667358266 >> 172.21.15.150:0/1667358266 conn(0x7ff1b40b1e40 msgr2=0x7ff1b4153370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:42:07.424 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.366+0000 7f3e397fa640 1 -- 172.21.15.150:0/2993638721 <== osd.3 v2:172.21.15.150:6808/3550994626 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f3e3400a7f0 con 0x7f3e20080eb0 2024-09-17T05:42:07.424 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.366+0000 7f3e41d61640 1 -- 172.21.15.150:0/2993638721 >> [v2:172.21.15.150:6808/3550994626,v1:172.21.15.150:6809/3550994626] conn(0x7f3e20080eb0 msgr2=0x7f3e20083300 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:07.424 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.366+0000 7f3e41d61640 1 --2- 172.21.15.150:0/2993638721 >> [v2:172.21.15.150:6808/3550994626,v1:172.21.15.150:6809/3550994626] conn(0x7f3e20080eb0 0x7f3e20083300 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:07.425 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.367+0000 7f3e41d61640 1 -- 172.21.15.150:0/2993638721 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f3e20078be0 msgr2=0x7f3e2007b0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:07.425 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.367+0000 7f3e41d61640 1 --2- 172.21.15.150:0/2993638721 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f3e20078be0 0x7f3e2007b0f0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f3e300108b0 tx=0x7f3e300046c0 comp rx=0 tx=0).stop 2024-09-17T05:42:07.425 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.367+0000 7f3e41d61640 1 -- 172.21.15.150:0/2993638721 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3e3403ae90 msgr2=0x7f3e340e26b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:07.425 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.367+0000 7f3e41d61640 1 --2- 172.21.15.150:0/2993638721 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3e3403ae90 0x7f3e340e26b0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f3e2800d660 tx=0x7f3e2800da60 comp rx=0 tx=0).stop 2024-09-17T05:42:07.426 INFO:teuthology.orchestra.run.smithi150.stdout:68719476745 2024-09-17T05:42:07.426 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-09-17T05:42:07.426 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.367+0000 7f3e41560640 1 -- 172.21.15.150:0/2993638721 reap_dead start 2024-09-17T05:42:07.427 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.367+0000 7ff1b99eb640 1 -- 172.21.15.150:0/1667358266 shutdown_connections 2024-09-17T05:42:07.427 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.367+0000 7ff1b99eb640 1 -- 172.21.15.150:0/1667358266 wait complete. 2024-09-17T05:42:07.427 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.368+0000 7f3e41d61640 1 -- 172.21.15.150:0/2993638721 shutdown_connections 2024-09-17T05:42:07.427 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.368+0000 7f5acf0b1640 1 -- 172.21.15.150:0/1972112596 --> [v2:172.21.15.176:6818/2049295774,v1:172.21.15.176:6819/2049295774] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f5ac80cc180 con 0x7f5aac080de0 2024-09-17T05:42:07.428 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.368+0000 7f3e41d61640 1 -- 172.21.15.150:0/2993638721 >> 172.21.15.150:0/2993638721 conn(0x7f3e3401eae0 msgr2=0x7f3e340376a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:42:07.428 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.368+0000 7f3e41d61640 1 -- 172.21.15.150:0/2993638721 shutdown_connections 2024-09-17T05:42:07.428 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.368+0000 7f3e41d61640 1 -- 172.21.15.150:0/2993638721 wait complete. 2024-09-17T05:42:07.428 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.369+0000 7f5abeffd640 1 -- 172.21.15.150:0/1972112596 <== osd.5 v2:172.21.15.176:6818/2049295774 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f5ac80cc180 con 0x7f5aac080de0 2024-09-17T05:42:07.429 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.369+0000 7fcf197fa640 1 -- 172.21.15.150:0/3626831450 --> [v2:172.21.15.176:6802/3239587708,v1:172.21.15.176:6803/3239587708] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fcf340761a0 con 0x7fcf20080e50 2024-09-17T05:42:07.429 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.370+0000 7f5acf0b1640 1 -- 172.21.15.150:0/1972112596 >> [v2:172.21.15.176:6818/2049295774,v1:172.21.15.176:6819/2049295774] conn(0x7f5aac080de0 msgr2=0x7f5aac083230 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:07.429 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.370+0000 7f5acf0b1640 1 --2- 172.21.15.150:0/1972112596 >> [v2:172.21.15.176:6818/2049295774,v1:172.21.15.176:6819/2049295774] conn(0x7f5aac080de0 0x7f5aac083230 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:07.430 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.370+0000 7fcf1b7fe640 1 -- 172.21.15.150:0/3626831450 <== osd.7 v2:172.21.15.176:6802/3239587708 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fcf340761a0 con 0x7fcf20080e50 2024-09-17T05:42:07.430 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.370+0000 7f5acf0b1640 1 -- 172.21.15.150:0/1972112596 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f5aac078b90 msgr2=0x7f5aac07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:07.430 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.370+0000 7f5acf0b1640 1 --2- 172.21.15.150:0/1972112596 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f5aac078b90 0x7f5aac07b0a0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f5ac4007fd0 tx=0x7f5ac4007b00 comp rx=0 tx=0).stop 2024-09-17T05:42:07.430 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.370+0000 7f5acf0b1640 1 -- 172.21.15.150:0/1972112596 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5ac8073e30 msgr2=0x7f5ac81fa8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:07.431 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.370+0000 7f5acf0b1640 1 --2- 172.21.15.150:0/1972112596 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5ac8073e30 0x7f5ac81fa8c0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f5ab800c400 tx=0x7f5ab800c8c0 comp rx=0 tx=0).stop 2024-09-17T05:42:07.431 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.370+0000 7f5ace8b0640 1 -- 172.21.15.150:0/1972112596 reap_dead start 2024-09-17T05:42:07.431 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.370+0000 7f5acf0b1640 1 -- 172.21.15.150:0/1972112596 shutdown_connections 2024-09-17T05:42:07.431 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.370+0000 7f5acf0b1640 1 -- 172.21.15.150:0/1972112596 >> 172.21.15.150:0/1972112596 conn(0x7f5ac80cdcb0 msgr2=0x7f5ac815ec30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:42:07.431 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.370+0000 7f5acf0b1640 1 -- 172.21.15.150:0/1972112596 shutdown_connections 2024-09-17T05:42:07.431 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.370+0000 7f5acf0b1640 1 -- 172.21.15.150:0/1972112596 wait complete. 2024-09-17T05:42:07.432 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.370+0000 7fcf197fa640 1 -- 172.21.15.150:0/3626831450 >> [v2:172.21.15.176:6802/3239587708,v1:172.21.15.176:6803/3239587708] conn(0x7fcf20080e50 msgr2=0x7fcf200832a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:07.432 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.370+0000 7fcf197fa640 1 --2- 172.21.15.150:0/3626831450 >> [v2:172.21.15.176:6802/3239587708,v1:172.21.15.176:6803/3239587708] conn(0x7fcf20080e50 0x7fcf200832a0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:07.432 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.371+0000 7fcf197fa640 1 -- 172.21.15.150:0/3626831450 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fcf20078be0 msgr2=0x7fcf2007b0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:07.432 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.371+0000 7fcf197fa640 1 --2- 172.21.15.150:0/3626831450 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fcf20078be0 0x7fcf2007b0f0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fcf2c000f60 tx=0x7fcf2c009040 comp rx=0 tx=0).stop 2024-09-17T05:42:07.433 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.371+0000 7fcf197fa640 1 -- 172.21.15.150:0/3626831450 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fcf340cff60 msgr2=0x7fcf34205c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:07.433 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.371+0000 7fcf197fa640 1 --2- 172.21.15.150:0/3626831450 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fcf340cff60 0x7fcf34205c70 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fcf2400c6c0 tx=0x7fcf2400cb80 comp rx=0 tx=0).stop 2024-09-17T05:42:07.433 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.371+0000 7fcf337fe640 1 -- 172.21.15.150:0/3626831450 reap_dead start 2024-09-17T05:42:07.433 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.371+0000 7fcf197fa640 1 -- 172.21.15.150:0/3626831450 shutdown_connections 2024-09-17T05:42:07.433 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.371+0000 7fcf197fa640 1 -- 172.21.15.150:0/3626831450 >> 172.21.15.150:0/3626831450 conn(0x7fcf34074780 msgr2=0x7fcf3406d760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:42:07.433 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.371+0000 7fcf197fa640 1 -- 172.21.15.150:0/3626831450 shutdown_connections 2024-09-17T05:42:07.433 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.371+0000 7fcf197fa640 1 -- 172.21.15.150:0/3626831450 wait complete. 2024-09-17T05:42:07.434 INFO:teuthology.orchestra.run.smithi150.stdout:64424509448 2024-09-17T05:42:07.434 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-09-17T05:42:07.435 INFO:teuthology.orchestra.run.smithi150.stdout:55834574855 2024-09-17T05:42:07.435 INFO:teuthology.orchestra.run.smithi150.stdout:64424509448 2024-09-17T05:42:07.436 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-09-17T05:42:07.436 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-09-17T05:42:07.437 INFO:teuthology.orchestra.run.smithi150.stdout:64424509448 2024-09-17T05:42:07.437 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-09-17T05:42:07.438 INFO:teuthology.orchestra.run.smithi150.stdout:64424509448 2024-09-17T05:42:07.438 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-09-17T05:42:07.439 INFO:teuthology.orchestra.run.smithi150.stdout:64424509448 2024-09-17T05:42:07.439 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-09-17T05:42:07.440 INFO:teuthology.orchestra.run.smithi150.stdout:64424509449 2024-09-17T05:42:07.441 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-09-17T05:42:07.701 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.699+0000 7ff075ffb640 1 -- 172.21.15.150:0/122743777 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff068032890 con 0x7ff070052390 2024-09-17T05:42:07.701 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.699+0000 7ff07d45c640 1 -- 172.21.15.150:0/122743777 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff070052390 msgr2=0x7ff0700e72b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:07.701 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.699+0000 7ff07d45c640 1 --2- 172.21.15.150:0/122743777 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff070052390 0x7ff0700e72b0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7ff070055890 tx=0x7ff06802a360 comp rx=0 tx=0).stop 2024-09-17T05:42:07.701 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.699+0000 7ff07d45c640 1 -- 172.21.15.150:0/122743777 shutdown_connections 2024-09-17T05:42:07.701 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.699+0000 7ff07d45c640 1 --2- 172.21.15.150:0/122743777 >> v2:172.21.15.176:3300/0 conn(0x7ff070054750 0x7ff070054b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:07.701 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.699+0000 7ff07d45c640 1 --2- 172.21.15.150:0/122743777 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff070052390 0x7ff0700e72b0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:07.702 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.699+0000 7ff07d45c640 1 -- 172.21.15.150:0/122743777 >> 172.21.15.150:0/122743777 conn(0x7ff07001d9d0 msgr2=0x7ff070039690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:42:07.702 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.700+0000 7ff07d45c640 1 -- 172.21.15.150:0/122743777 shutdown_connections 2024-09-17T05:42:07.702 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.700+0000 7fedff894640 1 -- 172.21.15.150:0/3456031619 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fedf80aff10 msgr2=0x7fedf80b0320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:07.702 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.700+0000 7fedff894640 1 --2- 172.21.15.150:0/3456031619 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fedf80aff10 0x7fedf80b0320 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fedf80cfd90 tx=0x7fedf402a370 comp rx=0 tx=0).stop 2024-09-17T05:42:07.703 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.700+0000 7ff07d45c640 1 -- 172.21.15.150:0/122743777 wait complete. 2024-09-17T05:42:07.703 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.700+0000 7fedff894640 1 -- 172.21.15.150:0/3456031619 shutdown_connections 2024-09-17T05:42:07.703 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.700+0000 7fedff894640 1 --2- 172.21.15.150:0/3456031619 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fedf80b31e0 0x7fedf80b35f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:07.703 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.700+0000 7fedff894640 1 --2- 172.21.15.150:0/3456031619 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fedf80aff10 0x7fedf80b0320 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:07.703 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.700+0000 7fedff894640 1 -- 172.21.15.150:0/3456031619 >> 172.21.15.150:0/3456031619 conn(0x7fedf80d02f0 msgr2=0x7fedf80d0700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:42:07.704 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.702+0000 7faf8b59e640 1 -- 172.21.15.150:0/1466391354 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7faf8c06fe10 msgr2=0x7faf8c070220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:07.704 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.702+0000 7faf8b59e640 1 --2- 172.21.15.150:0/1466391354 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7faf8c06fe10 0x7faf8c070220 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7faf8c073900 tx=0x7faf8402aa30 comp rx=0 tx=0).stop 2024-09-17T05:42:07.704 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.702+0000 7fedff894640 1 -- 172.21.15.150:0/3456031619 shutdown_connections 2024-09-17T05:42:07.705 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.702+0000 7faf8b59e640 1 -- 172.21.15.150:0/1466391354 shutdown_connections 2024-09-17T05:42:07.705 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.702+0000 7faf8b59e640 1 --2- 172.21.15.150:0/1466391354 >> v2:172.21.15.150:3300/0 conn(0x7faf8c15f150 0x7faf8c15f560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:07.705 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.702+0000 7faf8b59e640 1 --2- 172.21.15.150:0/1466391354 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7faf8c06fe10 0x7faf8c070220 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:07.705 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.702+0000 7faf8b59e640 1 --2- 172.21.15.150:0/1466391354 >> v2:172.21.15.176:3300/0 conn(0x7faf8c0ce200 0x7faf8c074be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:07.705 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.702+0000 7faf8b59e640 1 -- 172.21.15.150:0/1466391354 >> 172.21.15.150:0/1466391354 conn(0x7faf8c0b2e30 msgr2=0x7faf8c0b3240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:42:07.705 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.702+0000 7faf8b59e640 1 -- 172.21.15.150:0/1466391354 shutdown_connections 2024-09-17T05:42:07.705 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.702+0000 7faf8b59e640 1 -- 172.21.15.150:0/1466391354 wait complete. 2024-09-17T05:42:07.706 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.702+0000 7fedff894640 1 -- 172.21.15.150:0/3456031619 wait complete. 2024-09-17T05:42:07.706 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.703+0000 7ff07d45c640 1 Processor -- start 2024-09-17T05:42:07.706 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.703+0000 7ff07d45c640 1 -- start start 2024-09-17T05:42:07.707 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.703+0000 7ff90d4b6640 1 -- 172.21.15.150:0/3184065704 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff908075d20 msgr2=0x7ff90806ddb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:07.707 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.703+0000 7ff90d4b6640 1 --2- 172.21.15.150:0/3184065704 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff908075d20 0x7ff90806ddb0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7ff900009830 tx=0x7ff90002a560 comp rx=0 tx=0).stop 2024-09-17T05:42:07.707 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.704+0000 7ff90d4b6640 1 -- 172.21.15.150:0/3184065704 shutdown_connections 2024-09-17T05:42:07.707 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.704+0000 7ff90d4b6640 1 --2- 172.21.15.150:0/3184065704 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff908075d20 0x7ff90806ddb0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:07.707 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.704+0000 7ff90d4b6640 1 --2- 172.21.15.150:0/3184065704 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff9080ce450 0x7ff9080b3af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:07.707 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.704+0000 7ff90d4b6640 1 -- 172.21.15.150:0/3184065704 >> 172.21.15.150:0/3184065704 conn(0x7ff9080738b0 msgr2=0x7ff908073cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:42:07.707 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.704+0000 7ff1c159a640 1 -- 172.21.15.150:0/535717533 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1c4064810 con 0x7ff1ac0037a0 2024-09-17T05:42:07.708 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.704+0000 7ff1c359e640 1 -- 172.21.15.150:0/535717533 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff1ac0037a0 msgr2=0x7ff1ac003bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:07.708 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.704+0000 7ff90d4b6640 1 -- 172.21.15.150:0/3184065704 shutdown_connections 2024-09-17T05:42:07.708 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.704+0000 7ff1c359e640 1 --2- 172.21.15.150:0/535717533 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff1ac0037a0 0x7ff1ac003bb0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7ff1c4000b60 tx=0x7ff1ac005830 comp rx=0 tx=0).stop 2024-09-17T05:42:07.708 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.704+0000 7ff90d4b6640 1 -- 172.21.15.150:0/3184065704 wait complete. 2024-09-17T05:42:07.709 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.704+0000 7ff1c359e640 1 -- 172.21.15.150:0/535717533 shutdown_connections 2024-09-17T05:42:07.709 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.704+0000 7ff1c359e640 1 --2- 172.21.15.150:0/535717533 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff1ac0037a0 0x7ff1ac003bb0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:07.709 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.704+0000 7ff1c359e640 1 -- 172.21.15.150:0/535717533 >> 172.21.15.150:0/535717533 conn(0x7ff1bc051420 msgr2=0x7ff1bc051860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:42:07.712 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.704+0000 7f0ea37fe640 1 -- 172.21.15.150:0/1424905593 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e900047a0 con 0x7f0e9c037300 2024-09-17T05:42:07.712 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.704+0000 7ff1c359e640 1 -- 172.21.15.150:0/535717533 shutdown_connections 2024-09-17T05:42:07.713 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.705+0000 7faf8b59e640 1 Processor -- start 2024-09-17T05:42:07.713 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.704+0000 7ff1c359e640 1 -- 172.21.15.150:0/535717533 wait complete. 2024-09-17T05:42:07.713 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.705+0000 7f0eaafcc640 1 -- 172.21.15.150:0/1424905593 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0e9c037300 msgr2=0x7f0e9c054840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:07.714 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.705+0000 7f0eaafcc640 1 --2- 172.21.15.150:0/1424905593 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0e9c037300 0x7f0e9c054840 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f0e90005fd0 tx=0x7f0e9002a4b0 comp rx=0 tx=0).stop 2024-09-17T05:42:07.714 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.705+0000 7ff07d45c640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff070051660 0x7ff07017e9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:42:07.714 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.705+0000 7f0eaafcc640 1 -- 172.21.15.150:0/1424905593 shutdown_connections 2024-09-17T05:42:07.714 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.705+0000 7f0eaafcc640 1 --2- 172.21.15.150:0/1424905593 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0e9c037300 0x7f0e9c054840 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:07.715 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.705+0000 7f0eaafcc640 1 --2- 172.21.15.150:0/1424905593 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0e9c036ef0 0x7f0e9c038690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:07.715 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.705+0000 7f0eaafcc640 1 -- 172.21.15.150:0/1424905593 >> 172.21.15.150:0/1424905593 conn(0x7f0e9c01fc10 msgr2=0x7f0e9c056970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:42:07.715 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.705+0000 7f830720e640 1 -- 172.21.15.150:0/3563701842 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f82f800be10 msgr2=0x7f82f80e0250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:07.715 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.705+0000 7f830720e640 1 --2- 172.21.15.150:0/3563701842 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f82f800be10 0x7f82f80e0250 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f82f80538c0 tx=0x7f82f402a530 comp rx=0 tx=0).stop 2024-09-17T05:42:07.715 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.706+0000 7f830720e640 1 -- 172.21.15.150:0/3563701842 shutdown_connections 2024-09-17T05:42:07.715 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.706+0000 7f830720e640 1 --2- 172.21.15.150:0/3563701842 >> v2:172.21.15.150:3300/0 conn(0x7f82f8007490 0x7f82f8052540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:07.715 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.706+0000 7f830720e640 1 --2- 172.21.15.150:0/3563701842 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f82f800be10 0x7f82f80e0250 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:07.716 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.706+0000 7f830720e640 1 -- 172.21.15.150:0/3563701842 >> 172.21.15.150:0/3563701842 conn(0x7f82f8054970 msgr2=0x7f82f8054d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:42:07.716 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.704+0000 7fedff894640 1 Processor -- start 2024-09-17T05:42:07.716 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.706+0000 7ff076ffd640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff070051660 0x7ff07017e9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:42:07.716 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.705+0000 7fedff894640 1 -- start start 2024-09-17T05:42:07.717 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.706+0000 7ff076ffd640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff070051660 0x7ff07017e9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:54654/0 (socket says 172.21.15.150:54654) 2024-09-17T05:42:07.717 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.706+0000 7ff076ffd640 1 -- 172.21.15.150:0/3032064356 learned_addr learned my addr 172.21.15.150:0/3032064356 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:42:07.717 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.706+0000 7ff07d45c640 1 --2- 172.21.15.150:0/3032064356 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff070052390 0x7ff07004cd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:42:07.717 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.706+0000 7ff07d45c640 1 --2- 172.21.15.150:0/3032064356 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff070054750 0x7ff070032700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:42:07.718 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.706+0000 7f0eaafcc640 1 -- 172.21.15.150:0/1424905593 shutdown_connections 2024-09-17T05:42:07.718 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.706+0000 7fbbea6cc640 1 -- 172.21.15.150:0/2749155747 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fbbd4003a50 msgr2=0x7fbbd4003ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:07.718 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.706+0000 7fbbea6cc640 1 --2- 172.21.15.150:0/2749155747 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fbbd4003a50 0x7fbbd4003ec0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fbbd8009b40 tx=0x7fbbd4005830 comp rx=0 tx=0).stop 2024-09-17T05:42:07.719 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.706+0000 7ff0767fc640 1 --2- 172.21.15.150:0/3032064356 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff070052390 0x7ff07004cd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:42:07.719 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.706+0000 7fbbe8c69640 1 -- 172.21.15.150:0/2749155747 reap_dead start 2024-09-17T05:42:07.719 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.706+0000 7fbbea6cc640 1 -- 172.21.15.150:0/2749155747 shutdown_connections 2024-09-17T05:42:07.719 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.706+0000 7fbbea6cc640 1 -- 172.21.15.150:0/2749155747 >> 172.21.15.150:0/2749155747 conn(0x7fbbdc051420 msgr2=0x7fbbdc051860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:42:07.720 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.706+0000 7f0eaafcc640 1 -- 172.21.15.150:0/1424905593 wait complete. 2024-09-17T05:42:07.720 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.706+0000 7ff07d45c640 1 -- 172.21.15.150:0/3032064356 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7ff0700527a0 con 0x7ff070051660 2024-09-17T05:42:07.720 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.706+0000 7ff0777fe640 1 --2- 172.21.15.150:0/3032064356 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff070054750 0x7ff070032700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:42:07.720 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.706+0000 7ff07d45c640 1 -- 172.21.15.150:0/3032064356 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7ff070033ef0 con 0x7ff070054750 2024-09-17T05:42:07.720 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.706+0000 7fedff894640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fedf80aff10 0x7fedf8155330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:42:07.721 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.707+0000 7ff07d45c640 1 -- 172.21.15.150:0/3032064356 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7ff070052920 con 0x7ff070052390 2024-09-17T05:42:07.721 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.707+0000 7fbbea6cc640 1 -- 172.21.15.150:0/2749155747 shutdown_connections 2024-09-17T05:42:07.721 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.707+0000 7fbbea6cc640 1 -- 172.21.15.150:0/2749155747 wait complete. 2024-09-17T05:42:07.722 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.707+0000 7fedff894640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fedf80b31e0 0x7fedf81f9180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:42:07.722 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.707+0000 7fedff894640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fedf80b3b30 0x7fedf81f96c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:42:07.722 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.707+0000 7fedff894640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7fedf80d11a0 con 0x7fedf80b3b30 2024-09-17T05:42:07.722 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.707+0000 7fedff894640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fedf80d1020 con 0x7fedf80b31e0 2024-09-17T05:42:07.722 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.707+0000 7fedff894640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fedf80b1390 con 0x7fedf80aff10 2024-09-17T05:42:07.723 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.707+0000 7fedfd630640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fedf80aff10 0x7fedf8155330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:42:07.723 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.707+0000 7fedfd630640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fedf80aff10 0x7fedf8155330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3301/0 says I am v2:172.21.15.150:53294/0 (socket says 172.21.15.150:53294) 2024-09-17T05:42:07.723 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.707+0000 7fedfd630640 1 -- 172.21.15.150:0/2079399898 learned_addr learned my addr 172.21.15.150:0/2079399898 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:42:07.723 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.707+0000 7fedfde31640 1 --2- 172.21.15.150:0/2079399898 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fedf80b3b30 0x7fedf81f96c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:42:07.723 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.707+0000 7fedfce2f640 1 --2- 172.21.15.150:0/2079399898 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fedf80b31e0 0x7fedf81f9180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:42:07.723 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.705+0000 7faf8b59e640 1 -- start start 2024-09-17T05:42:07.723 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.707+0000 7faf8b59e640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7faf8c06fe10 0x7faf8c15a1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:42:07.723 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.707+0000 7faf8b59e640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7faf8c0ce200 0x7faf8c155340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:42:07.724 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.707+0000 7ff90d4b6640 1 Processor -- start 2024-09-17T05:42:07.724 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.707+0000 7faf8a59c640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7faf8c06fe10 0x7faf8c15a1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:42:07.724 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.707+0000 7ff0777fe640 1 -- 172.21.15.150:0/3032064356 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff070052390 msgr2=0x7ff07004cd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:07.724 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.707+0000 7ff0777fe640 1 --2- 172.21.15.150:0/3032064356 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff070052390 0x7ff07004cd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:07.724 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.707+0000 7ff0777fe640 1 -- 172.21.15.150:0/3032064356 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff070051660 msgr2=0x7ff07017e9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:07.725 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.707+0000 7ff90d4b6640 1 -- start start 2024-09-17T05:42:07.725 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.707+0000 7fedfde31640 1 -- 172.21.15.150:0/2079399898 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fedf80aff10 msgr2=0x7fedf8155330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:07.725 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.708+0000 7faf8b59e640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7faf8c15f150 0x7faf8c0cb010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:42:07.725 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.708+0000 7ff1c359e640 1 Processor -- start 2024-09-17T05:42:07.726 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.707+0000 7ff0777fe640 1 --2- 172.21.15.150:0/3032064356 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff070051660 0x7ff07017e9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:07.726 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.708+0000 7ff1c359e640 1 -- start start 2024-09-17T05:42:07.726 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.707+0000 7fedfde31640 1 --2- 172.21.15.150:0/2079399898 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fedf80aff10 0x7fedf8155330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:07.726 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.708+0000 7fedfde31640 1 -- 172.21.15.150:0/2079399898 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fedf80b31e0 msgr2=0x7fedf81f9180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:07.727 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.708+0000 7faf8b59e640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7faf8c0cc990 con 0x7faf8c15f150 2024-09-17T05:42:07.727 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.708+0000 7fedfde31640 1 --2- 172.21.15.150:0/2079399898 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fedf80b31e0 0x7fedf81f9180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:07.727 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.708+0000 7fedfde31640 1 -- 172.21.15.150:0/2079399898 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fedf8155de0 con 0x7fedf80b3b30 2024-09-17T05:42:07.727 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.708+0000 7fedfce2f640 1 --2- 172.21.15.150:0/2079399898 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fedf80b31e0 0x7fedf81f9180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T05:42:07.727 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.708+0000 7faf8b59e640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7faf8c074310 con 0x7faf8c06fe10 2024-09-17T05:42:07.727 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.708+0000 7faf8b59e640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7faf8c0ccb10 con 0x7faf8c0ce200 2024-09-17T05:42:07.728 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.708+0000 7fedfde31640 1 --2- 172.21.15.150:0/2079399898 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fedf80b3b30 0x7fedf81f96c0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fedf000c7d0 tx=0x7fedf000cc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:42:07.728 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.708+0000 7f830720e640 1 -- 172.21.15.150:0/3563701842 shutdown_connections 2024-09-17T05:42:07.728 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.708+0000 7f830720e640 1 -- 172.21.15.150:0/3563701842 wait complete. 2024-09-17T05:42:07.728 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.708+0000 7faf8ad9d640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7faf8c15f150 0x7faf8c0cb010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:42:07.728 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.708+0000 7faf8ad9d640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7faf8c15f150 0x7faf8c0cb010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:54678/0 (socket says 172.21.15.150:54678) 2024-09-17T05:42:07.729 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.708+0000 7faf8ad9d640 1 -- 172.21.15.150:0/2606924403 learned_addr learned my addr 172.21.15.150:0/2606924403 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:42:07.729 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.708+0000 7fededffb640 1 -- 172.21.15.150:0/2079399898 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fedf0017070 con 0x7fedf80b3b30 2024-09-17T05:42:07.729 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.708+0000 7fedff894640 1 -- 172.21.15.150:0/2079399898 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fedf8156050 con 0x7fedf80b3b30 2024-09-17T05:42:07.729 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.708+0000 7fededffb640 1 -- 172.21.15.150:0/2079399898 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fedf0005070 con 0x7fedf80b3b30 2024-09-17T05:42:07.730 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.708+0000 7faf8ad9d640 1 -- 172.21.15.150:0/2606924403 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7faf8c0ce200 msgr2=0x7faf8c155340 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-17T05:42:07.730 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.708+0000 7faf8ad9d640 1 --2- 172.21.15.150:0/2606924403 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7faf8c0ce200 0x7faf8c155340 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:07.730 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.708+0000 7faf8ad9d640 1 -- 172.21.15.150:0/2606924403 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7faf8c06fe10 msgr2=0x7faf8c15a1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:07.730 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.708+0000 7faf8ad9d640 1 --2- 172.21.15.150:0/2606924403 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7faf8c06fe10 0x7faf8c15a1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:07.730 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.708+0000 7faf8ad9d640 1 -- 172.21.15.150:0/2606924403 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faf8c1583b0 con 0x7faf8c15f150 2024-09-17T05:42:07.730 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.709+0000 7fedff894640 1 -- 172.21.15.150:0/2079399898 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fedf8157f80 con 0x7fedf80b3b30 2024-09-17T05:42:07.730 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.709+0000 7faf8ad9d640 1 --2- 172.21.15.150:0/2606924403 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7faf8c15f150 0x7faf8c0cb010 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7faf7c00e940 tx=0x7faf7c00ee00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:42:07.731 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.708+0000 7ff0777fe640 1 -- 172.21.15.150:0/3032064356 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff07017aaf0 con 0x7ff070054750 2024-09-17T05:42:07.731 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.709+0000 7f0eaafcc640 1 Processor -- start 2024-09-17T05:42:07.731 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.709+0000 7ff0777fe640 1 --2- 172.21.15.150:0/3032064356 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff070054750 0x7ff070032700 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7ff06c00d5e0 tx=0x7ff06c00bf90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:42:07.732 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.709+0000 7ff076ffd640 1 --2- 172.21.15.150:0/3032064356 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff070051660 0x7ff07017e9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T05:42:07.732 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.710+0000 7ff05f7fe640 1 -- 172.21.15.150:0/3032064356 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff06c017070 con 0x7ff070054750 2024-09-17T05:42:07.732 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.710+0000 7f0eaafcc640 1 -- start start 2024-09-17T05:42:07.732 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.710+0000 7ff05f7fe640 1 -- 172.21.15.150:0/3032064356 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff06c005220 con 0x7ff070054750 2024-09-17T05:42:07.733 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.710+0000 7ff90d4b6640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff908075d20 0x7ff90813c190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:42:07.733 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.710+0000 7fbbea6cc640 1 Processor -- start 2024-09-17T05:42:07.733 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.710+0000 7ff07d45c640 1 -- 172.21.15.150:0/3032064356 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff0700e5650 con 0x7ff070054750 2024-09-17T05:42:07.733 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.710+0000 7ff07d45c640 1 -- 172.21.15.150:0/3032064356 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff07017b070 con 0x7ff070054750 2024-09-17T05:42:07.734 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.710+0000 7ff90d4b6640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff9080ce450 0x7ff908156a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:42:07.734 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.710+0000 7ff1c359e640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff1ac0037a0 0x7ff1bc01f8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:42:07.734 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.710+0000 7faf7affd640 1 -- 172.21.15.150:0/2606924403 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf7c00cd80 con 0x7faf8c15f150 2024-09-17T05:42:07.734 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.710+0000 7faf8b59e640 1 -- 172.21.15.150:0/2606924403 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faf8c1588b0 con 0x7faf8c15f150 2024-09-17T05:42:07.734 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.711+0000 7faf8b59e640 1 -- 172.21.15.150:0/2606924403 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faf8c1565f0 con 0x7faf8c15f150 2024-09-17T05:42:07.734 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.711+0000 7faf7affd640 1 -- 172.21.15.150:0/2606924403 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7faf7c004020 con 0x7faf8c15f150 2024-09-17T05:42:07.735 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.710+0000 7ff05f7fe640 1 -- 172.21.15.150:0/3032064356 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff06c0047a0 con 0x7ff070054750 2024-09-17T05:42:07.735 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.710+0000 7ff90d4b6640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff908143af0 0x7ff9080b18e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:42:07.735 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.710+0000 7ff90d4b6640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7ff90806e6b0 con 0x7ff9080ce450 2024-09-17T05:42:07.735 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.710+0000 7ff90d4b6640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7ff90806e530 con 0x7ff908075d20 2024-09-17T05:42:07.735 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.710+0000 7ff90d4b6640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7ff90806fe50 con 0x7ff908143af0 2024-09-17T05:42:07.735 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.711+0000 7ff906ffd640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff908075d20 0x7ff90813c190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:42:07.735 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.711+0000 7ff906ffd640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff908075d20 0x7ff90813c190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3300/0 says I am v2:172.21.15.150:53736/0 (socket says 172.21.15.150:53736) 2024-09-17T05:42:07.735 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.711+0000 7ff906ffd640 1 -- 172.21.15.150:0/1824108591 learned_addr learned my addr 172.21.15.150:0/1824108591 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:42:07.736 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.710+0000 7fede37fe640 1 -- 172.21.15.150:0/2079399898 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fedf81581d0 con 0x7fedf80b3b30 2024-09-17T05:42:07.736 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.710+0000 7fededffb640 1 -- 172.21.15.150:0/2079399898 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fedf00054c0 con 0x7fedf80b3b30 2024-09-17T05:42:07.736 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.711+0000 7ff9067fc640 1 --2- 172.21.15.150:0/1824108591 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff9080ce450 0x7ff908156a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:42:07.736 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.711+0000 7f830720e640 1 Processor -- start 2024-09-17T05:42:07.736 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.711+0000 7f830720e640 1 -- start start 2024-09-17T05:42:07.737 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.711+0000 7fededffb640 1 -- 172.21.15.150:0/2079399898 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fedf001a070 con 0x7fedf80b3b30 2024-09-17T05:42:07.737 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.712+0000 7faf7affd640 1 -- 172.21.15.150:0/2606924403 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf7c004430 con 0x7faf8c15f150 2024-09-17T05:42:07.737 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.712+0000 7f0eaafcc640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0e9c036ef0 0x7f0e9c16c440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:42:07.738 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.712+0000 7ff1c359e640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff1bc0d4950 0x7ff1bc0ce4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:42:07.738 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.712+0000 7ff9067fc640 1 -- 172.21.15.150:0/1824108591 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff908143af0 msgr2=0x7ff9080b18e0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-17T05:42:07.738 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.712+0000 7ff9067fc640 1 --2- 172.21.15.150:0/1824108591 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff908143af0 0x7ff9080b18e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:07.738 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.712+0000 7ff9067fc640 1 -- 172.21.15.150:0/1824108591 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff908075d20 msgr2=0x7ff90813c190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:07.738 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.712+0000 7ff9067fc640 1 --2- 172.21.15.150:0/1824108591 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff908075d20 0x7ff90813c190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:07.738 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.712+0000 7ff9067fc640 1 -- 172.21.15.150:0/1824108591 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff908155950 con 0x7ff9080ce450 2024-09-17T05:42:07.738 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.712+0000 7ff1c359e640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff1bc0d4390 0x7ff1bc174e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:42:07.739 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.712+0000 7ff1c359e640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7ff1bc005de0 con 0x7ff1ac0037a0 2024-09-17T05:42:07.739 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.712+0000 7ff1c359e640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7ff1bc005c60 con 0x7ff1bc0d4390 2024-09-17T05:42:07.739 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.712+0000 7ff1c359e640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7ff1bc005f60 con 0x7ff1bc0d4950 2024-09-17T05:42:07.739 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.712+0000 7ff9067fc640 1 --2- 172.21.15.150:0/1824108591 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff9080ce450 0x7ff908156a90 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7ff8fc001e40 tx=0x7ff8fc001e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:42:07.739 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.710+0000 7fbbea6cc640 1 -- start start 2024-09-17T05:42:07.740 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.713+0000 7f0eaafcc640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0e9c037300 0x7f0e9c0e4400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:42:07.740 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.713+0000 7f0eaafcc640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0e9c054d80 0x7f0e9c0e4940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:42:07.740 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.713+0000 7f0eaafcc640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f0e9c057710 con 0x7f0e9c037300 2024-09-17T05:42:07.740 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.713+0000 7f0eaafcc640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f0e9c057590 con 0x7f0e9c036ef0 2024-09-17T05:42:07.740 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.713+0000 7f0eaafcc640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f0e9c055190 con 0x7f0e9c054d80 2024-09-17T05:42:07.740 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.713+0000 7ff1c2d9d640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff1bc0d4390 0x7ff1bc174e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:42:07.740 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.713+0000 7ff1c1d9b640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff1bc0d4950 0x7ff1bc0ce4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:42:07.740 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.713+0000 7ff1c2d9d640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff1bc0d4390 0x7ff1bc174e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3300/0 says I am v2:172.21.15.150:53752/0 (socket says 172.21.15.150:53752) 2024-09-17T05:42:07.740 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.713+0000 7ff1c2d9d640 1 -- 172.21.15.150:0/51836236 learned_addr learned my addr 172.21.15.150:0/51836236 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:42:07.741 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.712+0000 7fededffb640 1 --2- 172.21.15.150:0/2079399898 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7feddc078b90 0x7feddc07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:42:07.741 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.712+0000 7fededffb640 1 -- 172.21.15.150:0/2079399898 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7fedf009a3b0 con 0x7fedf80b3b30 2024-09-17T05:42:07.741 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.713+0000 7fedfd630640 1 --2- 172.21.15.150:0/2079399898 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7feddc078b90 0x7feddc07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:42:07.741 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.713+0000 7f0ea3fff640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0e9c037300 0x7f0e9c0e4400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:42:07.741 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.713+0000 7f0ea3fff640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0e9c037300 0x7f0e9c0e4400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:54704/0 (socket says 172.21.15.150:54704) 2024-09-17T05:42:07.742 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.713+0000 7f830720e640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f82f8007490 0x7f82f817f5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:42:07.742 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.713+0000 7f0ea3fff640 1 -- 172.21.15.150:0/397411688 learned_addr learned my addr 172.21.15.150:0/397411688 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:42:07.742 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.714+0000 7f0ea9569640 1 --2- 172.21.15.150:0/397411688 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0e9c054d80 0x7f0e9c0e4940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:42:07.742 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.713+0000 7fbbea6cc640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbbd4003a50 0x7fbbdc020770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:42:07.742 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.713+0000 7fbbea6cc640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fbbdc0d8ef0 0x7fbbdc0215a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:42:07.742 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.713+0000 7fbbea6cc640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fbbdc01ee20 0x7fbbdc0dbdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:42:07.743 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.714+0000 7fbbea6cc640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7fbbdc006070 con 0x7fbbd4003a50 2024-09-17T05:42:07.743 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.714+0000 7fbbea6cc640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fbbdc005ef0 con 0x7fbbdc0d8ef0 2024-09-17T05:42:07.743 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.713+0000 7ff1c259c640 1 --2- 172.21.15.150:0/51836236 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff1ac0037a0 0x7ff1bc01f8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:42:07.743 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.713+0000 7ff1c1d9b640 1 -- 172.21.15.150:0/51836236 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff1bc0d4390 msgr2=0x7ff1bc174e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:07.743 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.713+0000 7ff1c1d9b640 1 --2- 172.21.15.150:0/51836236 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff1bc0d4390 0x7ff1bc174e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:07.743 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.713+0000 7ff1c1d9b640 1 -- 172.21.15.150:0/51836236 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff1ac0037a0 msgr2=0x7ff1bc01f8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:07.743 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.713+0000 7ff1c1d9b640 1 --2- 172.21.15.150:0/51836236 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff1ac0037a0 0x7ff1bc01f8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:07.743 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.714+0000 7fbbea6cc640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fbbdc006660 con 0x7fbbdc01ee20 2024-09-17T05:42:07.744 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.713+0000 7ff1c1d9b640 1 -- 172.21.15.150:0/51836236 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff1bc0e20f0 con 0x7ff1bc0d4950 2024-09-17T05:42:07.744 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.714+0000 7fbbe8c69640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fbbdc01ee20 0x7fbbdc0dbdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:42:07.744 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.714+0000 7ff05f7fe640 1 -- 172.21.15.150:0/3032064356 <== mon.1 v2:172.21.15.176:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7ff06c004940 con 0x7ff070054750 2024-09-17T05:42:07.745 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.714+0000 7ff1c1d9b640 1 --2- 172.21.15.150:0/51836236 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff1bc0d4950 0x7ff1bc0ce4c0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7ff1c4051d10 tx=0x7ff1c40514c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:42:07.745 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.714+0000 7fbbe8c69640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fbbdc01ee20 0x7fbbdc0dbdb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3301/0 says I am v2:172.21.15.150:53316/0 (socket says 172.21.15.150:53316) 2024-09-17T05:42:07.745 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.713+0000 7ff07d45c640 1 -- 172.21.15.150:0/3032064356 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff058005290 con 0x7ff070054750 2024-09-17T05:42:07.745 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.714+0000 7fbbe8c69640 1 -- 172.21.15.150:0/3671007954 learned_addr learned my addr 172.21.15.150:0/3671007954 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:42:07.746 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.714+0000 7fbbe37fe640 1 --2- 172.21.15.150:0/3671007954 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fbbdc0d8ef0 0x7fbbdc0215a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:42:07.746 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.714+0000 7f830720e640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f82f800be10 0x7f82f8024a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:42:07.746 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.714+0000 7f0ea8d68640 1 --2- 172.21.15.150:0/397411688 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0e9c036ef0 0x7f0e9c16c440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:42:07.746 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.714+0000 7faf8b59e640 1 -- 172.21.15.150:0/2606924403 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faf70005290 con 0x7faf8c15f150 2024-09-17T05:42:07.747 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.714+0000 7f830720e640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f82f8052a80 0x7f82f8024fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:42:07.747 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.714+0000 7fbbe3fff640 1 --2- 172.21.15.150:0/3671007954 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbbd4003a50 0x7fbbdc020770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:42:07.747 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.714+0000 7fbbe8c69640 1 -- 172.21.15.150:0/3671007954 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fbbdc0d8ef0 msgr2=0x7fbbdc0215a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:07.747 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.714+0000 7fbbe8c69640 1 --2- 172.21.15.150:0/3671007954 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fbbdc0d8ef0 0x7fbbdc0215a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:07.747 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.714+0000 7fbbe8c69640 1 -- 172.21.15.150:0/3671007954 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbbd4003a50 msgr2=0x7fbbdc020770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:07.747 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.714+0000 7fbbe8c69640 1 --2- 172.21.15.150:0/3671007954 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbbd4003a50 0x7fbbdc020770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:07.748 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.714+0000 7fbbe8c69640 1 -- 172.21.15.150:0/3671007954 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbbdc0de050 con 0x7fbbdc01ee20 2024-09-17T05:42:07.748 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.714+0000 7f82fffff640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f82f800be10 0x7f82f8024a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:42:07.748 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.714+0000 7f8304faa640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f82f8007490 0x7f82f817f5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:42:07.748 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.714+0000 7f82fffff640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f82f800be10 0x7f82f8024a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3301/0 says I am v2:172.21.15.150:53324/0 (socket says 172.21.15.150:53324) 2024-09-17T05:42:07.748 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.714+0000 7f8305fac640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f82f8052a80 0x7f82f8024fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:42:07.748 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.714+0000 7f8304faa640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f82f8007490 0x7f82f817f5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3300/0 says I am v2:172.21.15.150:53796/0 (socket says 172.21.15.150:53796) 2024-09-17T05:42:07.748 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.714+0000 7f8305fac640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f82f8052a80 0x7f82f8024fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:54710/0 (socket says 172.21.15.150:54710) 2024-09-17T05:42:07.748 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.714+0000 7f82fffff640 1 -- 172.21.15.150:0/2046485097 learned_addr learned my addr 172.21.15.150:0/2046485097 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:42:07.749 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.714+0000 7f0ea3fff640 1 -- 172.21.15.150:0/397411688 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0e9c054d80 msgr2=0x7f0e9c0e4940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:07.749 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.714+0000 7f0ea3fff640 1 --2- 172.21.15.150:0/397411688 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0e9c054d80 0x7f0e9c0e4940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:07.749 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.714+0000 7f0ea3fff640 1 -- 172.21.15.150:0/397411688 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0e9c036ef0 msgr2=0x7f0e9c16c440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:07.749 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.714+0000 7f0ea3fff640 1 --2- 172.21.15.150:0/397411688 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0e9c036ef0 0x7f0e9c16c440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:07.749 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.714+0000 7f0ea3fff640 1 -- 172.21.15.150:0/397411688 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0e9c16c980 con 0x7f0e9c037300 2024-09-17T05:42:07.749 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.714+0000 7ff1b2ffd640 1 -- 172.21.15.150:0/51836236 <== mon.2 v2:172.21.15.176:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1c40bd020 con 0x7ff1bc0d4950 2024-09-17T05:42:07.749 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.715+0000 7ff1b2ffd640 1 -- 172.21.15.150:0/51836236 <== mon.2 v2:172.21.15.176:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff1c40b5040 con 0x7ff1bc0d4950 2024-09-17T05:42:07.750 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.714+0000 7fedfd630640 1 --2- 172.21.15.150:0/2079399898 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7feddc078b90 0x7feddc07b0a0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fedf40095f0 tx=0x7fedf4004730 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:42:07.750 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.714+0000 7fbbe3fff640 1 --2- 172.21.15.150:0/3671007954 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbbd4003a50 0x7fbbdc020770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T05:42:07.750 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.714+0000 7fbbe8c69640 1 --2- 172.21.15.150:0/3671007954 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fbbdc01ee20 0x7fbbdc0dbdb0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fbbe40521d0 tx=0x7fbbe4064940 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:42:07.750 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.715+0000 7f0ea3fff640 1 --2- 172.21.15.150:0/397411688 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0e9c037300 0x7f0e9c0e4400 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f0e90034040 tx=0x7f0e90003960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:42:07.750 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.715+0000 7ff1c359e640 1 -- 172.21.15.150:0/51836236 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff1bc0e23d0 con 0x7ff1bc0d4950 2024-09-17T05:42:07.751 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.715+0000 7ff1b2ffd640 1 -- 172.21.15.150:0/51836236 <== mon.2 v2:172.21.15.176:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1c40b4070 con 0x7ff1bc0d4950 2024-09-17T05:42:07.751 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.714+0000 7f830720e640 1 -- 172.21.15.150:0/2046485097 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f82f801c790 con 0x7f82f8052a80 2024-09-17T05:42:07.751 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.715+0000 7f830720e640 1 -- 172.21.15.150:0/2046485097 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f82f801c910 con 0x7f82f8007490 2024-09-17T05:42:07.751 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.715+0000 7f830720e640 1 -- 172.21.15.150:0/2046485097 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f82f801ca90 con 0x7f82f800be10 2024-09-17T05:42:07.751 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.715+0000 7faf7affd640 1 -- 172.21.15.150:0/2606924403 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7faf7c0035f0 con 0x7faf8c15f150 2024-09-17T05:42:07.751 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.715+0000 7ff05f7fe640 1 --2- 172.21.15.150:0/3032064356 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7ff064078c90 0x7ff06407b1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:42:07.752 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.715+0000 7ff05f7fe640 1 -- 172.21.15.150:0/3032064356 <== mon.1 v2:172.21.15.176:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7ff06c09a990 con 0x7ff070054750 2024-09-17T05:42:07.752 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.715+0000 7ff076ffd640 1 --2- 172.21.15.150:0/3032064356 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7ff064078c90 0x7ff06407b1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:42:07.752 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.715+0000 7ff1c359e640 1 -- 172.21.15.150:0/51836236 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7ff1bc175870 con 0x7ff1bc0d4950 2024-09-17T05:42:07.752 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.715+0000 7fbbe0ff9640 1 -- 172.21.15.150:0/3671007954 <== mon.2 v2:172.21.15.176:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbbe409a070 con 0x7fbbdc01ee20 2024-09-17T05:42:07.752 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.715+0000 7fbbe0ff9640 1 -- 172.21.15.150:0/3671007954 <== mon.2 v2:172.21.15.176:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fbbe4075340 con 0x7fbbdc01ee20 2024-09-17T05:42:07.753 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.715+0000 7fbbe0ff9640 1 -- 172.21.15.150:0/3671007954 <== mon.2 v2:172.21.15.176:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbbe40749a0 con 0x7fbbdc01ee20 2024-09-17T05:42:07.753 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.715+0000 7fbbea6cc640 1 -- 172.21.15.150:0/3671007954 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbbdc0db5b0 con 0x7fbbdc01ee20 2024-09-17T05:42:07.753 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.715+0000 7fbbea6cc640 1 -- 172.21.15.150:0/3671007954 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fbbdc020d40 con 0x7fbbdc01ee20 2024-09-17T05:42:07.753 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.715+0000 7f82fffff640 1 -- 172.21.15.150:0/2046485097 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f82f8007490 msgr2=0x7f82f817f5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:07.753 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.715+0000 7f82fffff640 1 --2- 172.21.15.150:0/2046485097 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f82f8007490 0x7f82f817f5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:07.753 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.715+0000 7f82fffff640 1 -- 172.21.15.150:0/2046485097 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f82f8052a80 msgr2=0x7f82f8024fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:07.754 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.716+0000 7ff076ffd640 1 --2- 172.21.15.150:0/3032064356 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7ff064078c90 0x7ff06407b1a0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7ff068009660 tx=0x7ff068004730 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:42:07.754 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.715+0000 7f82fffff640 1 --2- 172.21.15.150:0/2046485097 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f82f8052a80 0x7f82f8024fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:07.754 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.715+0000 7f82fffff640 1 -- 172.21.15.150:0/2046485097 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f82f817faf0 con 0x7f82f800be10 2024-09-17T05:42:07.754 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.716+0000 7faf7affd640 1 --2- 172.21.15.150:0/2606924403 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7faf6c078be0 0x7faf6c07b0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:42:07.754 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.716+0000 7faf8a59c640 1 --2- 172.21.15.150:0/2606924403 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7faf6c078be0 0x7faf6c07b0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:42:07.755 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.716+0000 7f82fffff640 1 --2- 172.21.15.150:0/2046485097 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f82f800be10 0x7f82f8024a70 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f82ec00e790 tx=0x7f82ec00eb90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:42:07.755 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.716+0000 7ff1c359e640 1 -- 172.21.15.150:0/51836236 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff1bc00a3f0 con 0x7ff1bc0d4950 2024-09-17T05:42:07.755 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.716+0000 7f82fd7fa640 1 -- 172.21.15.150:0/2046485097 <== mon.2 v2:172.21.15.176:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82ec00cab0 con 0x7f82f800be10 2024-09-17T05:42:07.755 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.716+0000 7f82fd7fa640 1 -- 172.21.15.150:0/2046485097 <== mon.2 v2:172.21.15.176:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f82ec00cc50 con 0x7f82f800be10 2024-09-17T05:42:07.756 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.716+0000 7f82fd7fa640 1 -- 172.21.15.150:0/2046485097 <== mon.2 v2:172.21.15.176:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82ec010690 con 0x7f82f800be10 2024-09-17T05:42:07.756 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.716+0000 7fbbea6cc640 1 -- 172.21.15.150:0/3671007954 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbbdc0df180 con 0x7fbbdc01ee20 2024-09-17T05:42:07.756 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.717+0000 7faf8a59c640 1 --2- 172.21.15.150:0/2606924403 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7faf6c078be0 0x7faf6c07b0f0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7faf8c0cbca0 tx=0x7faf80005c70 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:42:07.756 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.717+0000 7ff1b2ffd640 1 -- 172.21.15.150:0/51836236 <== mon.2 v2:172.21.15.176:3301/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7ff1c4064250 con 0x7ff1bc0d4950 2024-09-17T05:42:07.757 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.717+0000 7f830720e640 1 -- 172.21.15.150:0/2046485097 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f82f8022d80 con 0x7f82f800be10 2024-09-17T05:42:07.757 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.717+0000 7f830720e640 1 -- 172.21.15.150:0/2046485097 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f82f8023340 con 0x7f82f800be10 2024-09-17T05:42:07.757 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.718+0000 7ff1b2ffd640 1 --2- 172.21.15.150:0/51836236 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7ff1a4078c10 0x7ff1a407b120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:42:07.757 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.718+0000 7ff1b2ffd640 1 -- 172.21.15.150:0/51836236 <== mon.2 v2:172.21.15.176:3301/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7ff1c4136820 con 0x7ff1bc0d4950 2024-09-17T05:42:07.757 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.718+0000 7ff1c259c640 1 --2- 172.21.15.150:0/51836236 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7ff1a4078c10 0x7ff1a407b120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:42:07.758 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.718+0000 7fbbe0ff9640 1 -- 172.21.15.150:0/3671007954 <== mon.2 v2:172.21.15.176:3301/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fbbe409d070 con 0x7fbbdc01ee20 2024-09-17T05:42:07.758 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.718+0000 7f830720e640 1 -- 172.21.15.150:0/2046485097 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f82f80557e0 con 0x7f82f800be10 2024-09-17T05:42:07.758 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.718+0000 7ff1c259c640 1 --2- 172.21.15.150:0/51836236 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7ff1a4078c10 0x7ff1a407b120 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7ff1bc003ec0 tx=0x7ff1b4006070 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:42:07.759 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.718+0000 7fbbe0ff9640 1 --2- 172.21.15.150:0/3671007954 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fbbc8078be0 0x7fbbc807b0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:42:07.759 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.719+0000 7fbbe0ff9640 1 -- 172.21.15.150:0/3671007954 <== mon.2 v2:172.21.15.176:3301/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7fbbe41169b0 con 0x7fbbdc01ee20 2024-09-17T05:42:07.759 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.719+0000 7fbbe3fff640 1 --2- 172.21.15.150:0/3671007954 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fbbc8078be0 0x7fbbc807b0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:42:07.759 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.719+0000 7fbbe3fff640 1 --2- 172.21.15.150:0/3671007954 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fbbc8078be0 0x7fbbc807b0f0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fbbd8035000 tx=0x7fbbd802d040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:42:07.759 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.720+0000 7faf7affd640 1 -- 172.21.15.150:0/2606924403 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7faf7c009410 con 0x7faf8c15f150 2024-09-17T05:42:07.759 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.720+0000 7f0ea17fa640 1 -- 172.21.15.150:0/397411688 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e9003e030 con 0x7f0e9c037300 2024-09-17T05:42:07.760 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.720+0000 7ff8ef7fe640 1 -- 172.21.15.150:0/1824108591 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8fc011a30 con 0x7ff9080ce450 2024-09-17T05:42:07.760 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.720+0000 7fededffb640 1 -- 172.21.15.150:0/2079399898 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fedf00621a0 con 0x7fedf80b3b30 2024-09-17T05:42:07.760 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.720+0000 7f0eaafcc640 1 -- 172.21.15.150:0/397411688 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0e9c0e2980 con 0x7f0e9c037300 2024-09-17T05:42:07.760 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.720+0000 7ff90d4b6640 1 -- 172.21.15.150:0/1824108591 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff908155c30 con 0x7ff9080ce450 2024-09-17T05:42:07.761 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.721+0000 7f0eaafcc640 1 -- 172.21.15.150:0/397411688 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0e9c0e2f40 con 0x7f0e9c037300 2024-09-17T05:42:07.761 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.721+0000 7ff90d4b6640 1 -- 172.21.15.150:0/1824108591 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff9081561f0 con 0x7ff9080ce450 2024-09-17T05:42:07.761 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.721+0000 7f0eaafcc640 1 -- 172.21.15.150:0/397411688 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0e9c038690 con 0x7f0e9c037300 2024-09-17T05:42:07.762 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.722+0000 7ff90d4b6640 1 -- 172.21.15.150:0/1824108591 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff908071220 con 0x7ff9080ce450 2024-09-17T05:42:07.762 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.725+0000 7f0ea17fa640 1 -- 172.21.15.150:0/397411688 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0e90005310 con 0x7f0e9c037300 2024-09-17T05:42:07.762 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.725+0000 7f0ea17fa640 1 -- 172.21.15.150:0/397411688 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e90048060 con 0x7f0e9c037300 2024-09-17T05:42:07.762 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.725+0000 7ff8ef7fe640 1 -- 172.21.15.150:0/1824108591 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff8fc011cc0 con 0x7ff9080ce450 2024-09-17T05:42:07.762 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.725+0000 7faf7affd640 1 -- 172.21.15.150:0/2606924403 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7faf7c063bf0 con 0x7faf8c15f150 2024-09-17T05:42:07.763 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.725+0000 7ff8ef7fe640 1 -- 172.21.15.150:0/1824108591 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8fc027060 con 0x7ff9080ce450 2024-09-17T05:42:07.763 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.726+0000 7ff05f7fe640 1 -- 172.21.15.150:0/3032064356 <== mon.1 v2:172.21.15.176:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7ff06c0627f0 con 0x7ff070054750 2024-09-17T05:42:07.763 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.727+0000 7fbbe0ff9640 1 -- 172.21.15.150:0/3671007954 <== mon.2 v2:172.21.15.176:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fbbe40de890 con 0x7fbbdc01ee20 2024-09-17T05:42:07.764 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.727+0000 7ff8ef7fe640 1 -- 172.21.15.150:0/1824108591 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7ff8fc005280 con 0x7ff9080ce450 2024-09-17T05:42:07.764 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.728+0000 7ff8ef7fe640 1 --2- 172.21.15.150:0/1824108591 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7ff8f4078b90 0x7ff8f407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:42:07.764 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.728+0000 7ff8ef7fe640 1 -- 172.21.15.150:0/1824108591 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7ff8fc09eab0 con 0x7ff9080ce450 2024-09-17T05:42:07.764 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.728+0000 7ff906ffd640 1 --2- 172.21.15.150:0/1824108591 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7ff8f4078b90 0x7ff8f407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:42:07.764 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.728+0000 7f0ea17fa640 1 -- 172.21.15.150:0/397411688 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f0e90041030 con 0x7f0e9c037300 2024-09-17T05:42:07.764 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.729+0000 7ff906ffd640 1 --2- 172.21.15.150:0/1824108591 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7ff8f4078b90 0x7ff8f407b0a0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7ff8f8009f80 tx=0x7ff8f8009500 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:42:07.765 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.729+0000 7f0ea17fa640 1 --2- 172.21.15.150:0/397411688 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f0e88078b90 0x7f0e8807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:42:07.765 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.729+0000 7f0ea17fa640 1 -- 172.21.15.150:0/397411688 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f0e900bb980 con 0x7f0e9c037300 2024-09-17T05:42:07.765 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.729+0000 7f0ea8d68640 1 --2- 172.21.15.150:0/397411688 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f0e88078b90 0x7f0e8807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:42:07.765 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.730+0000 7f0ea8d68640 1 --2- 172.21.15.150:0/397411688 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f0e88078b90 0x7f0e8807b0a0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f0e980058c0 tx=0x7f0e98005850 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:42:07.766 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.732+0000 7ff1b2ffd640 1 -- 172.21.15.150:0/51836236 <== mon.2 v2:172.21.15.176:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7ff1c40c7060 con 0x7ff1bc0d4950 2024-09-17T05:42:07.766 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.733+0000 7ff8ef7fe640 1 -- 172.21.15.150:0/1824108591 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7ff908071220 con 0x7ff9080ce450 2024-09-17T05:42:07.767 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.735+0000 7f82fd7fa640 1 -- 172.21.15.150:0/2046485097 <== mon.2 v2:172.21.15.176:3301/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f82ec010830 con 0x7f82f800be10 2024-09-17T05:42:07.767 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.736+0000 7f82fd7fa640 1 --2- 172.21.15.150:0/2046485097 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f82e4078b90 0x7f82e407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:42:07.767 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.736+0000 7f82fd7fa640 1 -- 172.21.15.150:0/2046485097 <== mon.2 v2:172.21.15.176:3301/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f82ec09bdd0 con 0x7f82f800be10 2024-09-17T05:42:07.767 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.736+0000 7f8304faa640 1 --2- 172.21.15.150:0/2046485097 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f82e4078b90 0x7f82e407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:42:07.767 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.737+0000 7f82fd7fa640 1 -- 172.21.15.150:0/2046485097 <== mon.2 v2:172.21.15.176:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f82ec00ce20 con 0x7f82f800be10 2024-09-17T05:42:07.767 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.737+0000 7f8304faa640 1 --2- 172.21.15.150:0/2046485097 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f82e4078b90 0x7f82e407b0a0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f82f4034000 tx=0x7f82f4004730 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:42:07.767 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:07.742+0000 7f0ea17fa640 1 -- 172.21.15.150:0/397411688 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f0e9c16c980 con 0x7f0e9c037300 2024-09-17T05:42:08.139 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:08.138+0000 7fede37fe640 1 -- 172.21.15.150:0/2079399898 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) -- 0x7fedf81539f0 con 0x7fedf80b3b30 2024-09-17T05:42:08.140 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:08.139+0000 7fededffb640 1 -- 172.21.15.150:0/2079399898 <== mon.0 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fedf0066bd0 con 0x7fedf80b3b30 2024-09-17T05:42:08.140 INFO:teuthology.orchestra.run.smithi150.stdout:64424509447 2024-09-17T05:42:08.144 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:08.142+0000 7fedff894640 1 -- 172.21.15.150:0/2079399898 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7feddc078b90 msgr2=0x7feddc07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:08.144 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:08.142+0000 7fedff894640 1 --2- 172.21.15.150:0/2079399898 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7feddc078b90 0x7feddc07b0a0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fedf40095f0 tx=0x7fedf4004730 comp rx=0 tx=0).stop 2024-09-17T05:42:08.144 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:08.142+0000 7fedff894640 1 -- 172.21.15.150:0/2079399898 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fedf80b3b30 msgr2=0x7fedf81f96c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:08.144 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:08.142+0000 7fedff894640 1 --2- 172.21.15.150:0/2079399898 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fedf80b3b30 0x7fedf81f96c0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fedf000c7d0 tx=0x7fedf000cc90 comp rx=0 tx=0).stop 2024-09-17T05:42:08.145 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:08.143+0000 7fedff894640 1 -- 172.21.15.150:0/2079399898 shutdown_connections 2024-09-17T05:42:08.145 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:08.143+0000 7fedff894640 1 --2- 172.21.15.150:0/2079399898 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fedf80b31e0 0x7fedf81f9180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:08.145 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:08.143+0000 7fedff894640 1 --2- 172.21.15.150:0/2079399898 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7feddc078b90 0x7feddc07b0a0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:08.145 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:08.143+0000 7fedff894640 1 --2- 172.21.15.150:0/2079399898 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fedf80b3b30 0x7fedf81f96c0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:08.145 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:08.143+0000 7fedff894640 1 --2- 172.21.15.150:0/2079399898 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fedf80aff10 0x7fedf8155330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:08.145 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:08.143+0000 7fedff894640 1 -- 172.21.15.150:0/2079399898 >> 172.21.15.150:0/2079399898 conn(0x7fedf80d02f0 msgr2=0x7fedf80744c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:42:08.145 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:08.143+0000 7fedff894640 1 -- 172.21.15.150:0/2079399898 shutdown_connections 2024-09-17T05:42:08.146 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:08.143+0000 7fedff894640 1 -- 172.21.15.150:0/2079399898 wait complete. 2024-09-17T05:42:08.150 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:08.149+0000 7ff07d45c640 1 -- 172.21.15.150:0/3032064356 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7ff058005580 con 0x7ff070054750 2024-09-17T05:42:08.151 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:08.149+0000 7ff05f7fe640 1 -- 172.21.15.150:0/3032064356 <== mon.1 v2:172.21.15.176:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7ff06c067220 con 0x7ff070054750 2024-09-17T05:42:08.151 INFO:teuthology.orchestra.run.smithi150.stdout:64424509447 2024-09-17T05:42:08.152 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:08.151+0000 7faf8b59e640 1 -- 172.21.15.150:0/2606924403 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) -- 0x7faf70005580 con 0x7faf8c15f150 2024-09-17T05:42:08.153 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:08.151+0000 7ff90d4b6640 1 -- 172.21.15.150:0/1824108591 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) -- 0x7ff90806ddb0 con 0x7ff9080ce450 2024-09-17T05:42:08.153 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:08.152+0000 7faf7affd640 1 -- 172.21.15.150:0/2606924403 <== mon.0 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7faf7c0634f0 con 0x7faf8c15f150 2024-09-17T05:42:08.153 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:08.152+0000 7ff8ef7fe640 1 -- 172.21.15.150:0/1824108591 <== mon.0 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7ff8fc066a90 con 0x7ff9080ce450 2024-09-17T05:42:08.154 INFO:teuthology.orchestra.run.smithi150.stdout:64424509447 2024-09-17T05:42:08.154 INFO:teuthology.orchestra.run.smithi150.stdout:68719476743 2024-09-17T05:42:08.154 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:08.152+0000 7fbbea6cc640 1 -- 172.21.15.150:0/3671007954 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) -- 0x7fbbdc054ee0 con 0x7fbbdc01ee20 2024-09-17T05:42:08.155 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:08.153+0000 7fbbe0ff9640 1 -- 172.21.15.150:0/3671007954 <== mon.2 v2:172.21.15.176:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fbbe40e32c0 con 0x7fbbdc01ee20 2024-09-17T05:42:08.155 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:08.153+0000 7ff07d45c640 1 -- 172.21.15.150:0/3032064356 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7ff064078c90 msgr2=0x7ff06407b1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:08.155 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:08.153+0000 7ff07d45c640 1 --2- 172.21.15.150:0/3032064356 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7ff064078c90 0x7ff06407b1a0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7ff068009660 tx=0x7ff068004730 comp rx=0 tx=0).stop 2024-09-17T05:42:08.155 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:08.153+0000 7ff07d45c640 1 -- 172.21.15.150:0/3032064356 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff070054750 msgr2=0x7ff070032700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:08.155 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:08.153+0000 7ff07d45c640 1 --2- 172.21.15.150:0/3032064356 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff070054750 0x7ff070032700 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7ff06c00d5e0 tx=0x7ff06c00bf90 comp rx=0 tx=0).stop 2024-09-17T05:42:08.155 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:08.153+0000 7ff07d45c640 1 -- 172.21.15.150:0/3032064356 shutdown_connections 2024-09-17T05:42:08.156 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:08.153+0000 7ff07d45c640 1 --2- 172.21.15.150:0/3032064356 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff070054750 0x7ff070032700 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:08.156 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:08.153+0000 7ff07d45c640 1 --2- 172.21.15.150:0/3032064356 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7ff064078c90 0x7ff06407b1a0 secure :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7ff068009660 tx=0x7ff068004730 comp rx=0 tx=0).stop 2024-09-17T05:42:08.156 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:08.153+0000 7ff07d45c640 1 --2- 172.21.15.150:0/3032064356 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff070052390 0x7ff07004cd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:08.156 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:08.153+0000 7ff07d45c640 1 --2- 172.21.15.150:0/3032064356 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff070051660 0x7ff07017e9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:08.156 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:08.153+0000 7ff07d45c640 1 -- 172.21.15.150:0/3032064356 >> 172.21.15.150:0/3032064356 conn(0x7ff07001d9d0 msgr2=0x7ff070053540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:42:08.156 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:08.154+0000 7ff07d45c640 1 -- 172.21.15.150:0/3032064356 shutdown_connections 2024-09-17T05:42:08.156 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:08.154+0000 7ff07d45c640 1 -- 172.21.15.150:0/3032064356 wait complete. 2024-09-17T05:42:08.156 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:08.153+0000 7ff1c359e640 1 -- 172.21.15.150:0/51836236 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7ff1bc0386d0 con 0x7ff1bc0d4950 2024-09-17T05:42:08.157 INFO:teuthology.orchestra.run.smithi150.stdout:64424509448 2024-09-17T05:42:08.157 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:08.154+0000 7ff1b2ffd640 1 -- 172.21.15.150:0/51836236 <== mon.2 v2:172.21.15.176:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7ff1c40fe810 con 0x7ff1bc0d4950 2024-09-17T05:42:08.157 INFO:teuthology.orchestra.run.smithi150.stdout:64424509447 2024-09-17T05:42:08.158 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:08.156+0000 7ff90d4b6640 1 -- 172.21.15.150:0/1824108591 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7ff8f4078b90 msgr2=0x7ff8f407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:08.158 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:08.156+0000 7ff90d4b6640 1 --2- 172.21.15.150:0/1824108591 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7ff8f4078b90 0x7ff8f407b0a0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7ff8f8009f80 tx=0x7ff8f8009500 comp rx=0 tx=0).stop 2024-09-17T05:42:08.158 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:08.157+0000 7ff90d4b6640 1 -- 172.21.15.150:0/1824108591 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff9080ce450 msgr2=0x7ff908156a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:08.158 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:08.157+0000 7ff90d4b6640 1 --2- 172.21.15.150:0/1824108591 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff9080ce450 0x7ff908156a90 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7ff8fc001e40 tx=0x7ff8fc001e70 comp rx=0 tx=0).stop 2024-09-17T05:42:08.158 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:08.157+0000 7ff90d4b6640 1 -- 172.21.15.150:0/1824108591 shutdown_connections 2024-09-17T05:42:08.159 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:08.157+0000 7ff90d4b6640 1 --2- 172.21.15.150:0/1824108591 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7ff8f4078b90 0x7ff8f407b0a0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:08.159 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:08.157+0000 7faf8b59e640 1 -- 172.21.15.150:0/2606924403 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7faf6c078be0 msgr2=0x7faf6c07b0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:08.159 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:08.157+0000 7faf8b59e640 1 --2- 172.21.15.150:0/2606924403 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7faf6c078be0 0x7faf6c07b0f0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7faf8c0cbca0 tx=0x7faf80005c70 comp rx=0 tx=0).stop 2024-09-17T05:42:08.159 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:08.157+0000 7ff90d4b6640 1 --2- 172.21.15.150:0/1824108591 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff908143af0 0x7ff9080b18e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:08.160 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:08.157+0000 7faf8b59e640 1 -- 172.21.15.150:0/2606924403 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7faf8c15f150 msgr2=0x7faf8c0cb010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:08.160 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:08.157+0000 7faf8b59e640 1 --2- 172.21.15.150:0/2606924403 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7faf8c15f150 0x7faf8c0cb010 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7faf7c00e940 tx=0x7faf7c00ee00 comp rx=0 tx=0).stop 2024-09-17T05:42:08.160 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:08.157+0000 7fbbea6cc640 1 -- 172.21.15.150:0/3671007954 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fbbc8078be0 msgr2=0x7fbbc807b0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:08.160 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:08.157+0000 7fbbea6cc640 1 --2- 172.21.15.150:0/3671007954 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fbbc8078be0 0x7fbbc807b0f0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fbbd8035000 tx=0x7fbbd802d040 comp rx=0 tx=0).stop 2024-09-17T05:42:08.160 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:08.157+0000 7fbbea6cc640 1 -- 172.21.15.150:0/3671007954 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fbbdc01ee20 msgr2=0x7fbbdc0dbdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:08.160 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:08.157+0000 7fbbea6cc640 1 --2- 172.21.15.150:0/3671007954 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fbbdc01ee20 0x7fbbdc0dbdb0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fbbe40521d0 tx=0x7fbbe4064940 comp rx=0 tx=0).stop 2024-09-17T05:42:08.161 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:08.157+0000 7ff90d4b6640 1 --2- 172.21.15.150:0/1824108591 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff9080ce450 0x7ff908156a90 secure :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7ff8fc001e40 tx=0x7ff8fc001e70 comp rx=0 tx=0).stop 2024-09-17T05:42:08.161 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:08.157+0000 7fbbea6cc640 1 -- 172.21.15.150:0/3671007954 shutdown_connections 2024-09-17T05:42:08.161 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:08.157+0000 7fbbea6cc640 1 --2- 172.21.15.150:0/3671007954 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fbbdc0d8ef0 0x7fbbdc0215a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:08.161 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:08.157+0000 7fbbea6cc640 1 --2- 172.21.15.150:0/3671007954 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fbbc8078be0 0x7fbbc807b0f0 secure :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fbbd8035000 tx=0x7fbbd802d040 comp rx=0 tx=0).stop 2024-09-17T05:42:08.161 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:08.157+0000 7fbbea6cc640 1 --2- 172.21.15.150:0/3671007954 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fbbdc01ee20 0x7fbbdc0dbdb0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:08.161 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:08.157+0000 7fbbea6cc640 1 --2- 172.21.15.150:0/3671007954 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbbd4003a50 0x7fbbdc020770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:08.161 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:08.157+0000 7fbbea6cc640 1 -- 172.21.15.150:0/3671007954 >> 172.21.15.150:0/3671007954 conn(0x7fbbdc051420 msgr2=0x7fbbdc052d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:42:08.162 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:08.157+0000 7ff90d4b6640 1 --2- 172.21.15.150:0/1824108591 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff908075d20 0x7ff90813c190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:08.162 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:08.157+0000 7ff90d4b6640 1 -- 172.21.15.150:0/1824108591 >> 172.21.15.150:0/1824108591 conn(0x7ff9080738b0 msgr2=0x7ff9080704e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:42:08.162 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:08.158+0000 7faf8b59e640 1 -- 172.21.15.150:0/2606924403 shutdown_connections 2024-09-17T05:42:08.162 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:08.158+0000 7faf8b59e640 1 --2- 172.21.15.150:0/2606924403 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7faf6c078be0 0x7faf6c07b0f0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:08.163 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:08.158+0000 7faf8b59e640 1 --2- 172.21.15.150:0/2606924403 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7faf8c15f150 0x7faf8c0cb010 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:08.163 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:08.158+0000 7faf8b59e640 1 --2- 172.21.15.150:0/2606924403 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7faf8c0ce200 0x7faf8c155340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:08.163 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:08.158+0000 7faf8b59e640 1 --2- 172.21.15.150:0/2606924403 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7faf8c06fe10 0x7faf8c15a1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:08.163 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:08.158+0000 7faf8b59e640 1 -- 172.21.15.150:0/2606924403 >> 172.21.15.150:0/2606924403 conn(0x7faf8c0b2e30 msgr2=0x7faf8c15cd50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:42:08.163 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:08.158+0000 7fbbea6cc640 1 -- 172.21.15.150:0/3671007954 shutdown_connections 2024-09-17T05:42:08.163 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:08.158+0000 7fbbea6cc640 1 -- 172.21.15.150:0/3671007954 wait complete. 2024-09-17T05:42:08.164 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:08.158+0000 7faf8b59e640 1 -- 172.21.15.150:0/2606924403 shutdown_connections 2024-09-17T05:42:08.164 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:08.158+0000 7faf8b59e640 1 -- 172.21.15.150:0/2606924403 wait complete. 2024-09-17T05:42:08.164 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:08.158+0000 7ff90d4b6640 1 -- 172.21.15.150:0/1824108591 shutdown_connections 2024-09-17T05:42:08.164 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:08.158+0000 7ff90d4b6640 1 -- 172.21.15.150:0/1824108591 wait complete. 2024-09-17T05:42:08.165 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:08.158+0000 7ff1c359e640 1 -- 172.21.15.150:0/51836236 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7ff1a4078c10 msgr2=0x7ff1a407b120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:08.165 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:08.158+0000 7ff1c359e640 1 --2- 172.21.15.150:0/51836236 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7ff1a4078c10 0x7ff1a407b120 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7ff1bc003ec0 tx=0x7ff1b4006070 comp rx=0 tx=0).stop 2024-09-17T05:42:08.165 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:08.158+0000 7ff1c359e640 1 -- 172.21.15.150:0/51836236 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff1bc0d4950 msgr2=0x7ff1bc0ce4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:08.165 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:08.158+0000 7ff1c359e640 1 --2- 172.21.15.150:0/51836236 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff1bc0d4950 0x7ff1bc0ce4c0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7ff1c4051d10 tx=0x7ff1c40514c0 comp rx=0 tx=0).stop 2024-09-17T05:42:08.165 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:08.159+0000 7ff1c359e640 1 -- 172.21.15.150:0/51836236 shutdown_connections 2024-09-17T05:42:08.165 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:08.159+0000 7ff1c359e640 1 --2- 172.21.15.150:0/51836236 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff1bc0d4390 0x7ff1bc174e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:08.165 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:08.159+0000 7ff1c359e640 1 --2- 172.21.15.150:0/51836236 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7ff1a4078c10 0x7ff1a407b120 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:08.165 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:08.159+0000 7ff1c359e640 1 --2- 172.21.15.150:0/51836236 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff1bc0d4950 0x7ff1bc0ce4c0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:08.166 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:08.159+0000 7ff1c359e640 1 --2- 172.21.15.150:0/51836236 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff1ac0037a0 0x7ff1bc01f8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:08.166 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:08.159+0000 7ff1c359e640 1 -- 172.21.15.150:0/51836236 >> 172.21.15.150:0/51836236 conn(0x7ff1bc051420 msgr2=0x7ff1bc02a940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:42:08.166 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:08.159+0000 7ff1c359e640 1 -- 172.21.15.150:0/51836236 shutdown_connections 2024-09-17T05:42:08.166 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:08.159+0000 7ff1c359e640 1 -- 172.21.15.150:0/51836236 wait complete. 2024-09-17T05:42:08.166 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:08.162+0000 7f830720e640 1 -- 172.21.15.150:0/2046485097 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7f82f80534a0 con 0x7f82f800be10 2024-09-17T05:42:08.166 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:08.163+0000 7f82fd7fa640 1 -- 172.21.15.150:0/2046485097 <== mon.2 v2:172.21.15.176:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f82ec063bb0 con 0x7f82f800be10 2024-09-17T05:42:08.166 INFO:teuthology.orchestra.run.smithi150.stdout:64424509447 2024-09-17T05:42:08.167 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509448 got 64424509447 for osd.4 2024-09-17T05:42:08.168 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:08.165+0000 7f0eaafcc640 1 -- 172.21.15.150:0/397411688 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7f0e9c00cf40 con 0x7f0e9c037300 2024-09-17T05:42:08.168 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:08.166+0000 7f0ea17fa640 1 -- 172.21.15.150:0/397411688 <== mon.0 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f0e90083da0 con 0x7f0e9c037300 2024-09-17T05:42:08.168 INFO:teuthology.orchestra.run.smithi150.stdout:55834574854 2024-09-17T05:42:08.169 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:08.167+0000 7f830720e640 1 -- 172.21.15.150:0/2046485097 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f82e4078b90 msgr2=0x7f82e407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:08.169 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:08.167+0000 7f830720e640 1 --2- 172.21.15.150:0/2046485097 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f82e4078b90 0x7f82e407b0a0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f82f4034000 tx=0x7f82f4004730 comp rx=0 tx=0).stop 2024-09-17T05:42:08.169 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:08.167+0000 7f830720e640 1 -- 172.21.15.150:0/2046485097 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f82f800be10 msgr2=0x7f82f8024a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:08.169 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:08.167+0000 7f830720e640 1 --2- 172.21.15.150:0/2046485097 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f82f800be10 0x7f82f8024a70 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f82ec00e790 tx=0x7f82ec00eb90 comp rx=0 tx=0).stop 2024-09-17T05:42:08.169 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:08.167+0000 7f830720e640 1 -- 172.21.15.150:0/2046485097 shutdown_connections 2024-09-17T05:42:08.170 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:08.167+0000 7f830720e640 1 --2- 172.21.15.150:0/2046485097 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f82e4078b90 0x7f82e407b0a0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:08.170 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:08.167+0000 7f830720e640 1 --2- 172.21.15.150:0/2046485097 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f82f8052a80 0x7f82f8024fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:08.170 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:08.167+0000 7f830720e640 1 --2- 172.21.15.150:0/2046485097 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f82f800be10 0x7f82f8024a70 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:08.170 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:08.167+0000 7f830720e640 1 --2- 172.21.15.150:0/2046485097 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f82f8007490 0x7f82f817f5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:08.170 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:08.167+0000 7f830720e640 1 -- 172.21.15.150:0/2046485097 >> 172.21.15.150:0/2046485097 conn(0x7f82f8054970 msgr2=0x7f82f80dc6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:42:08.170 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:08.167+0000 7f830720e640 1 -- 172.21.15.150:0/2046485097 shutdown_connections 2024-09-17T05:42:08.170 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:08.167+0000 7f830720e640 1 -- 172.21.15.150:0/2046485097 wait complete. 2024-09-17T05:42:08.171 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:08.169+0000 7f0eaafcc640 1 -- 172.21.15.150:0/397411688 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f0e88078b90 msgr2=0x7f0e8807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:08.171 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:08.169+0000 7f0eaafcc640 1 --2- 172.21.15.150:0/397411688 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f0e88078b90 0x7f0e8807b0a0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f0e980058c0 tx=0x7f0e98005850 comp rx=0 tx=0).stop 2024-09-17T05:42:08.171 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:08.169+0000 7f0eaafcc640 1 -- 172.21.15.150:0/397411688 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0e9c037300 msgr2=0x7f0e9c0e4400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:08.171 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:08.169+0000 7f0eaafcc640 1 --2- 172.21.15.150:0/397411688 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0e9c037300 0x7f0e9c0e4400 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f0e90034040 tx=0x7f0e90003960 comp rx=0 tx=0).stop 2024-09-17T05:42:08.172 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:08.170+0000 7f0eaafcc640 1 -- 172.21.15.150:0/397411688 shutdown_connections 2024-09-17T05:42:08.172 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:08.170+0000 7f0eaafcc640 1 --2- 172.21.15.150:0/397411688 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f0e88078b90 0x7f0e8807b0a0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:08.172 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:08.170+0000 7f0eaafcc640 1 --2- 172.21.15.150:0/397411688 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0e9c054d80 0x7f0e9c0e4940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:08.172 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:08.170+0000 7f0eaafcc640 1 --2- 172.21.15.150:0/397411688 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0e9c037300 0x7f0e9c0e4400 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:08.172 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:08.170+0000 7f0eaafcc640 1 --2- 172.21.15.150:0/397411688 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0e9c036ef0 0x7f0e9c16c440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:08.173 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:08.170+0000 7f0eaafcc640 1 -- 172.21.15.150:0/397411688 >> 172.21.15.150:0/397411688 conn(0x7f0e9c01fc10 msgr2=0x7f0e9c00d460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:42:08.173 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:08.170+0000 7f0eaafcc640 1 -- 172.21.15.150:0/397411688 shutdown_connections 2024-09-17T05:42:08.173 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:08.170+0000 7f0eaafcc640 1 -- 172.21.15.150:0/397411688 wait complete. 2024-09-17T05:42:08.181 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509449 got 64424509448 for osd.7 2024-09-17T05:42:08.182 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509448 got 64424509447 for osd.3 2024-09-17T05:42:08.183 INFO:tasks.ceph.ceph_manager.ceph:need seq 68719476745 got 68719476743 for osd.6 2024-09-17T05:42:08.185 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509448 got 64424509447 for osd.5 2024-09-17T05:42:08.186 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509448 got 64424509447 for osd.1 2024-09-17T05:42:08.192 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509448 got 64424509447 for osd.2 2024-09-17T05:42:08.193 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574854 for osd.0 2024-09-17T05:42:09.168 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-09-17T05:42:09.182 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-09-17T05:42:09.182 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-09-17T05:42:09.184 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-09-17T05:42:09.186 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-09-17T05:42:09.186 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-09-17T05:42:09.193 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-09-17T05:42:09.193 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-09-17T05:42:09.377 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:09.375+0000 7f69c3401640 1 -- 172.21.15.150:0/2718731136 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f69a40053c0 msgr2=0x7f69a400baf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:09.377 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:09.375+0000 7f69c3401640 1 --2- 172.21.15.150:0/2718731136 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f69a40053c0 0x7f69a400baf0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f69b4001e00 tx=0x7f69a4005830 comp rx=0 tx=0).stop 2024-09-17T05:42:09.377 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:09.375+0000 7f69c3401640 1 -- 172.21.15.150:0/2718731136 shutdown_connections 2024-09-17T05:42:09.377 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:09.375+0000 7f69c3401640 1 --2- 172.21.15.150:0/2718731136 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f69a40053c0 0x7f69a400baf0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:09.377 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:09.375+0000 7f69c3401640 1 -- 172.21.15.150:0/2718731136 >> 172.21.15.150:0/2718731136 conn(0x7f69bc0b1c60 msgr2=0x7f69bc0b2070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:42:09.377 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:09.375+0000 7f69c3401640 1 -- 172.21.15.150:0/2718731136 shutdown_connections 2024-09-17T05:42:09.380 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:09.375+0000 7f69c3401640 1 -- 172.21.15.150:0/2718731136 wait complete. 2024-09-17T05:42:09.380 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:09.379+0000 7f69c3401640 1 Processor -- start 2024-09-17T05:42:09.380 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:09.379+0000 7f69c3401640 1 -- start start 2024-09-17T05:42:09.383 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:09.381+0000 7f69c3401640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f69bc156ea0 0x7f69bc203030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:42:09.383 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:09.382+0000 7f69c3401640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f69bc152190 0x7f69bc1525a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:42:09.383 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:09.382+0000 7f69c3401640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f69bc0ae460 0x7f69bc0ae870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:42:09.385 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:09.382+0000 7f69c23ff640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f69bc156ea0 0x7f69bc203030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:42:09.385 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:09.382+0000 7f69c23ff640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f69bc156ea0 0x7f69bc203030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3301/0 says I am v2:172.21.15.150:53342/0 (socket says 172.21.15.150:53342) 2024-09-17T05:42:09.385 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:09.382+0000 7f69c2c00640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f69bc0ae460 0x7f69bc0ae870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:42:09.386 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:09.382+0000 7f69c2c00640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f69bc0ae460 0x7f69bc0ae870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:54726/0 (socket says 172.21.15.150:54726) 2024-09-17T05:42:09.386 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:09.382+0000 7f69c23ff640 1 -- 172.21.15.150:0/3580478359 learned_addr learned my addr 172.21.15.150:0/3580478359 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:42:09.386 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:09.382+0000 7f69c3401640 1 -- 172.21.15.150:0/3580478359 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f69bc15edb0 con 0x7f69bc0ae460 2024-09-17T05:42:09.386 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:09.383+0000 7f69c3401640 1 -- 172.21.15.150:0/3580478359 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f69bc162c10 con 0x7f69bc152190 2024-09-17T05:42:09.386 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:09.383+0000 7f69c3401640 1 -- 172.21.15.150:0/3580478359 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f69bc15ef30 con 0x7f69bc156ea0 2024-09-17T05:42:09.386 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:09.383+0000 7f69c1bfe640 1 --2- 172.21.15.150:0/3580478359 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f69bc152190 0x7f69bc1525a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:42:09.386 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:09.383+0000 7f69c23ff640 1 -- 172.21.15.150:0/3580478359 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f69bc152190 msgr2=0x7f69bc1525a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:09.386 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:09.383+0000 7f69c23ff640 1 --2- 172.21.15.150:0/3580478359 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f69bc152190 0x7f69bc1525a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:09.386 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:09.383+0000 7f69c23ff640 1 -- 172.21.15.150:0/3580478359 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f69bc0ae460 msgr2=0x7f69bc0ae870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:09.386 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:09.383+0000 7f69c23ff640 1 --2- 172.21.15.150:0/3580478359 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f69bc0ae460 0x7f69bc0ae870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:09.386 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:09.383+0000 7f69c23ff640 1 -- 172.21.15.150:0/3580478359 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f69bc0ad3c0 con 0x7f69bc156ea0 2024-09-17T05:42:09.387 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:09.384+0000 7f69c23ff640 1 --2- 172.21.15.150:0/3580478359 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f69bc156ea0 0x7f69bc203030 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f69ac00c760 tx=0x7f69ac00cc20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:42:09.387 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:09.384+0000 7f69c2c00640 1 --2- 172.21.15.150:0/3580478359 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f69bc0ae460 0x7f69bc0ae870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T05:42:09.387 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:09.384+0000 7f69c1bfe640 1 --2- 172.21.15.150:0/3580478359 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f69bc152190 0x7f69bc1525a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T05:42:09.388 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:09.384+0000 7f69baffd640 1 -- 172.21.15.150:0/3580478359 <== mon.2 v2:172.21.15.176:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69ac017070 con 0x7f69bc156ea0 2024-09-17T05:42:09.388 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:09.385+0000 7f69c3401640 1 -- 172.21.15.150:0/3580478359 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f69bc0ad6a0 con 0x7f69bc156ea0 2024-09-17T05:42:09.388 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:09.385+0000 7f69c3401640 1 -- 172.21.15.150:0/3580478359 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f69bc0adc60 con 0x7f69bc156ea0 2024-09-17T05:42:09.388 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:09.385+0000 7f69baffd640 1 -- 172.21.15.150:0/3580478359 <== mon.2 v2:172.21.15.176:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f69ac005360 con 0x7f69bc156ea0 2024-09-17T05:42:09.388 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:09.385+0000 7f69baffd640 1 -- 172.21.15.150:0/3580478359 <== mon.2 v2:172.21.15.176:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69ac00a8a0 con 0x7f69bc156ea0 2024-09-17T05:42:09.389 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:09.388+0000 7f69c3401640 1 -- 172.21.15.150:0/3580478359 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f69bc06ee00 con 0x7f69bc156ea0 2024-09-17T05:42:09.392 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:09.390+0000 7f69baffd640 1 -- 172.21.15.150:0/3580478359 <== mon.2 v2:172.21.15.176:3301/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f69ac01a070 con 0x7f69bc156ea0 2024-09-17T05:42:09.393 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:09.390+0000 7f69baffd640 1 --2- 172.21.15.150:0/3580478359 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f69a8078c60 0x7f69a807b170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:42:09.393 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:09.391+0000 7f69baffd640 1 -- 172.21.15.150:0/3580478359 <== mon.2 v2:172.21.15.176:3301/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f69ac09a0c0 con 0x7f69bc156ea0 2024-09-17T05:42:09.393 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:09.391+0000 7f69c1bfe640 1 --2- 172.21.15.150:0/3580478359 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f69a8078c60 0x7f69a807b170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:42:09.393 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:09.392+0000 7f69c1bfe640 1 --2- 172.21.15.150:0/3580478359 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f69a8078c60 0x7f69a807b170 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f69bc073d10 tx=0x7f69b0005f90 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:42:09.395 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:09.394+0000 7f69baffd640 1 -- 172.21.15.150:0/3580478359 <== mon.2 v2:172.21.15.176:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f69ac061fb0 con 0x7f69bc156ea0 2024-09-17T05:42:09.439 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:09.438+0000 7f14b501d640 1 -- 172.21.15.150:0/1151582178 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f14b006f210 msgr2=0x7f14b0155370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:09.440 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:09.438+0000 7f14b501d640 1 --2- 172.21.15.150:0/1151582178 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f14b006f210 0x7f14b0155370 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f14b0072630 tx=0x7f14a802a980 comp rx=0 tx=0).stop 2024-09-17T05:42:09.440 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:09.438+0000 7f14b501d640 1 -- 172.21.15.150:0/1151582178 shutdown_connections 2024-09-17T05:42:09.440 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:09.438+0000 7f14b501d640 1 --2- 172.21.15.150:0/1151582178 >> v2:172.21.15.150:3300/0 conn(0x7f14b01558b0 0x7f14b015edb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:09.440 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:09.438+0000 7f14b501d640 1 --2- 172.21.15.150:0/1151582178 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f14b006f210 0x7f14b0155370 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:09.440 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:09.438+0000 7f14b501d640 1 --2- 172.21.15.150:0/1151582178 >> v2:172.21.15.176:3300/0 conn(0x7f14b006ee00 0x7f14b0162640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:09.440 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:09.438+0000 7f14b501d640 1 -- 172.21.15.150:0/1151582178 >> 172.21.15.150:0/1151582178 conn(0x7f14b00b1c60 msgr2=0x7f14b00b2070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:42:09.440 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:09.439+0000 7faac8dbb640 1 -- 172.21.15.150:0/1765775448 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7faac40af0e0 msgr2=0x7faac40af4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:09.441 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:09.439+0000 7faac8dbb640 1 --2- 172.21.15.150:0/1765775448 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7faac40af0e0 0x7faac40af4f0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7faab8009830 tx=0x7faab802a420 comp rx=0 tx=0).stop 2024-09-17T05:42:09.441 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:09.438+0000 7f14b501d640 1 -- 172.21.15.150:0/1151582178 shutdown_connections 2024-09-17T05:42:09.441 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:09.438+0000 7f14b501d640 1 -- 172.21.15.150:0/1151582178 wait complete. 2024-09-17T05:42:09.441 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:09.439+0000 7faac8dbb640 1 -- 172.21.15.150:0/1765775448 shutdown_connections 2024-09-17T05:42:09.442 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:09.439+0000 7faac8dbb640 1 --2- 172.21.15.150:0/1765775448 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7faac40af0e0 0x7faac40af4f0 secure :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7faab8009830 tx=0x7faab802a420 comp rx=0 tx=0).stop 2024-09-17T05:42:09.442 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:09.439+0000 7faac8dbb640 1 -- 172.21.15.150:0/1765775448 >> 172.21.15.150:0/1765775448 conn(0x7faac40b1c60 msgr2=0x7faac40b2070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:42:09.442 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:09.439+0000 7faac8dbb640 1 -- 172.21.15.150:0/1765775448 shutdown_connections 2024-09-17T05:42:09.443 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:09.439+0000 7faac8dbb640 1 -- 172.21.15.150:0/1765775448 wait complete. 2024-09-17T05:42:09.443 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:09.441+0000 7f14b501d640 1 Processor -- start 2024-09-17T05:42:09.443 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:09.441+0000 7f14b501d640 1 -- start start 2024-09-17T05:42:09.444 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:09.442+0000 7faac8dbb640 1 Processor -- start 2024-09-17T05:42:09.444 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:09.443+0000 7faac8dbb640 1 -- start start 2024-09-17T05:42:09.445 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:09.443+0000 7f9c4d3bf640 1 -- 172.21.15.150:0/2356048100 <== mon.2 v2:172.21.15.176:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c44031bf0 con 0x7f9c480d0d30 2024-09-17T05:42:09.445 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:09.444+0000 7f9c50625640 1 -- 172.21.15.150:0/2356048100 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9c480d0d30 msgr2=0x7f9c480d1140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:09.445 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:09.444+0000 7f9c50625640 1 --2- 172.21.15.150:0/2356048100 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9c480d0d30 0x7f9c480d1140 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f9c44009830 tx=0x7f9c4402a520 comp rx=0 tx=0).stop 2024-09-17T05:42:09.445 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:09.444+0000 7ff0bcb07640 1 -- 172.21.15.150:0/125206927 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff0b00371d0 msgr2=0x7ff0b0053460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:09.446 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:09.444+0000 7ff0bcb07640 1 --2- 172.21.15.150:0/125206927 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff0b00371d0 0x7ff0b0053460 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7ff0b8068dc0 tx=0x7ff0b80a6670 comp rx=0 tx=0).stop 2024-09-17T05:42:09.446 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:09.444+0000 7f14b501d640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f14b006ee00 0x7f14b01f3ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:42:09.447 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:09.444+0000 7f14b501d640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f14b006f210 0x7f14b01fad90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:42:09.447 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:09.444+0000 7ff0bcb07640 1 -- 172.21.15.150:0/125206927 shutdown_connections 2024-09-17T05:42:09.447 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:09.444+0000 7ff0bcb07640 1 --2- 172.21.15.150:0/125206927 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff0b00371d0 0x7ff0b0053460 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:09.447 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:09.444+0000 7ff0bcb07640 1 --2- 172.21.15.150:0/125206927 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff0b0035610 0x7ff0b0050f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:09.448 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:09.444+0000 7f9c50625640 1 -- 172.21.15.150:0/2356048100 shutdown_connections 2024-09-17T05:42:09.448 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:09.444+0000 7ff0bcb07640 1 -- 172.21.15.150:0/125206927 >> 172.21.15.150:0/125206927 conn(0x7ff0b001fbe0 msgr2=0x7ff0b0056940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:42:09.448 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:09.444+0000 7f9c50625640 1 --2- 172.21.15.150:0/2356048100 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9c480d0d30 0x7f9c480d1140 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:09.448 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:09.444+0000 7f9c50625640 1 --2- 172.21.15.150:0/2356048100 >> v2:172.21.15.150:3300/0 conn(0x7f9c480b9db0 0x7f9c480b6b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:09.449 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:09.444+0000 7f9c50625640 1 -- 172.21.15.150:0/2356048100 >> 172.21.15.150:0/2356048100 conn(0x7f9c4808dc80 msgr2=0x7f9c4808bfe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:42:09.449 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:09.444+0000 7f14b501d640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f14b01558b0 0x7f14b01fa4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:42:09.449 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:09.444+0000 7f14b501d640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f14b015f870 con 0x7f14b006f210 2024-09-17T05:42:09.449 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:09.444+0000 7f14b501d640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f14b015f6f0 con 0x7f14b006ee00 2024-09-17T05:42:09.449 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:09.444+0000 7f14b501d640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f14b015f9f0 con 0x7f14b01558b0 2024-09-17T05:42:09.450 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:09.444+0000 7f14affff640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f14b006ee00 0x7f14b01f3ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:42:09.450 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:09.444+0000 7f14affff640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f14b006ee00 0x7f14b01f3ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3300/0 says I am v2:172.21.15.150:53848/0 (socket says 172.21.15.150:53848) 2024-09-17T05:42:09.450 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:09.444+0000 7f14affff640 1 -- 172.21.15.150:0/2952644285 learned_addr learned my addr 172.21.15.150:0/2952644285 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:42:09.450 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:09.444+0000 7f14af7fe640 1 --2- 172.21.15.150:0/2952644285 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f14b006f210 0x7f14b01fad90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:42:09.450 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:09.444+0000 7f9c50625640 1 -- 172.21.15.150:0/2356048100 shutdown_connections 2024-09-17T05:42:09.450 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:09.444+0000 7f9c50625640 1 -- 172.21.15.150:0/2356048100 wait complete. 2024-09-17T05:42:09.451 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:09.445+0000 7f14b481c640 1 --2- 172.21.15.150:0/2952644285 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f14b01558b0 0x7f14b01fa4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:42:09.451 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:09.445+0000 7f14af7fe640 1 -- 172.21.15.150:0/2952644285 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f14b01558b0 msgr2=0x7f14b01fa4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:09.451 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:09.445+0000 7f14af7fe640 1 --2- 172.21.15.150:0/2952644285 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f14b01558b0 0x7f14b01fa4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:09.451 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:09.445+0000 7f14af7fe640 1 -- 172.21.15.150:0/2952644285 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f14b006ee00 msgr2=0x7f14b01f3ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:09.451 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:09.445+0000 7f14af7fe640 1 --2- 172.21.15.150:0/2952644285 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f14b006ee00 0x7f14b01f3ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:09.451 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:09.445+0000 7f14af7fe640 1 -- 172.21.15.150:0/2952644285 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f14b015ddc0 con 0x7f14b006f210 2024-09-17T05:42:09.451 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:09.445+0000 7f14b481c640 1 --2- 172.21.15.150:0/2952644285 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f14b01558b0 0x7f14b01fa4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:42:09.452 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:09.445+0000 7f7478a27640 1 -- 172.21.15.150:0/2644059696 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f745c004800 msgr2=0x7f745c004c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:09.452 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:09.445+0000 7f7478a27640 1 --2- 172.21.15.150:0/2644059696 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f745c004800 0x7f745c004c10 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f747408c7a0 tx=0x7f745c005830 comp rx=0 tx=0).stop 2024-09-17T05:42:09.452 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:09.445+0000 7f7472d9d640 1 -- 172.21.15.150:0/2644059696 reap_dead start 2024-09-17T05:42:09.452 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:09.445+0000 7f14af7fe640 1 --2- 172.21.15.150:0/2952644285 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f14b006f210 0x7f14b01fad90 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f14a8032000 tx=0x7f14a8003f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:42:09.452 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:09.445+0000 7f7478a27640 1 -- 172.21.15.150:0/2644059696 shutdown_connections 2024-09-17T05:42:09.452 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:09.445+0000 7f7478a27640 1 -- 172.21.15.150:0/2644059696 >> 172.21.15.150:0/2644059696 conn(0x7f747408bfe0 msgr2=0x7f74740d4650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:42:09.453 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:09.445+0000 7faac8dbb640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7faac40745d0 0x7faac414c0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:42:09.453 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:09.445+0000 7fe959ffb640 1 -- 172.21.15.150:0/1377068759 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9500047a0 con 0x7fe95c0b3900 2024-09-17T05:42:09.454 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:09.445+0000 7faac8dbb640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7faac415b300 0x7faac414b320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:42:09.454 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:09.445+0000 7faac37fe640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7faac40745d0 0x7faac414c0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:42:09.454 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:09.445+0000 7faac37fe640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7faac40745d0 0x7faac414c0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3300/0 says I am v2:172.21.15.150:53860/0 (socket says 172.21.15.150:53860) 2024-09-17T05:42:09.454 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:09.445+0000 7ff0bcb07640 1 -- 172.21.15.150:0/125206927 shutdown_connections 2024-09-17T05:42:09.455 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:09.445+0000 7f14acff9640 1 -- 172.21.15.150:0/2952644285 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f14a8034040 con 0x7f14b006f210 2024-09-17T05:42:09.455 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:09.446+0000 7f14acff9640 1 -- 172.21.15.150:0/2952644285 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f14a8004600 con 0x7f14b006f210 2024-09-17T05:42:09.455 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:09.446+0000 7f7478a27640 1 -- 172.21.15.150:0/2644059696 shutdown_connections 2024-09-17T05:42:09.455 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:09.446+0000 7f14acff9640 1 -- 172.21.15.150:0/2952644285 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f14a8045480 con 0x7f14b006f210 2024-09-17T05:42:09.456 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:09.446+0000 7fd59ed21640 1 -- 172.21.15.150:0/2717025172 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd5900e2f40 msgr2=0x7fd59003c1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:09.456 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:09.446+0000 7fd59ed21640 1 --2- 172.21.15.150:0/2717025172 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd5900e2f40 0x7fd59003c1f0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fd588009830 tx=0x7fd58802a340 comp rx=0 tx=0).stop 2024-09-17T05:42:09.456 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:09.446+0000 7f7478a27640 1 -- 172.21.15.150:0/2644059696 wait complete. 2024-09-17T05:42:09.457 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:09.446+0000 7fd59ed21640 1 -- 172.21.15.150:0/2717025172 shutdown_connections 2024-09-17T05:42:09.457 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:09.446+0000 7fd59ed21640 1 --2- 172.21.15.150:0/2717025172 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd5900e2f40 0x7fd59003c1f0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:09.457 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:09.446+0000 7fd59ed21640 1 --2- 172.21.15.150:0/2717025172 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd590056da0 0x7fd590057c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:09.457 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:09.446+0000 7fd59ed21640 1 -- 172.21.15.150:0/2717025172 >> 172.21.15.150:0/2717025172 conn(0x7fd59003a5f0 msgr2=0x7fd59003aa00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:42:09.457 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:09.445+0000 7faac2ffd640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7faac415b300 0x7faac414b320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:42:09.457 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:09.445+0000 7faac2ffd640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7faac415b300 0x7faac414b320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:54812/0 (socket says 172.21.15.150:54812) 2024-09-17T05:42:09.457 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:09.446+0000 7faac8dbb640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7faac409b9f0 0x7faac416a080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:42:09.457 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:09.446+0000 7faac8dbb640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7faac415f5f0 con 0x7faac415b300 2024-09-17T05:42:09.457 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:09.446+0000 7faac8dbb640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7faac415f470 con 0x7faac40745d0 2024-09-17T05:42:09.458 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:09.446+0000 7faac8dbb640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7faac415f770 con 0x7faac409b9f0 2024-09-17T05:42:09.458 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:09.446+0000 7fe9616ec640 1 -- 172.21.15.150:0/1377068759 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe95c0b3900 msgr2=0x7fe95c155a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:09.458 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:09.446+0000 7fe9616ec640 1 --2- 172.21.15.150:0/1377068759 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe95c0b3900 0x7fe95c155a20 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fe950005fd0 tx=0x7fe95002a560 comp rx=0 tx=0).stop 2024-09-17T05:42:09.458 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:09.446+0000 7ff0bcb07640 1 -- 172.21.15.150:0/125206927 wait complete. 2024-09-17T05:42:09.458 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:09.446+0000 7faac37fe640 1 -- 172.21.15.150:0/1571194878 learned_addr learned my addr 172.21.15.150:0/1571194878 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:42:09.459 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:09.446+0000 7fd59ed21640 1 -- 172.21.15.150:0/2717025172 shutdown_connections 2024-09-17T05:42:09.459 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:09.446+0000 7faac3fff640 1 --2- 172.21.15.150:0/1571194878 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7faac409b9f0 0x7faac416a080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:42:09.459 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:09.447+0000 7f14b501d640 1 -- 172.21.15.150:0/2952644285 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f14b015e0a0 con 0x7f14b006f210 2024-09-17T05:42:09.459 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:09.447+0000 7f14b501d640 1 -- 172.21.15.150:0/2952644285 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f14b01f9ce0 con 0x7f14b006f210 2024-09-17T05:42:09.460 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:09.447+0000 7fd59ed21640 1 -- 172.21.15.150:0/2717025172 wait complete. 2024-09-17T05:42:09.460 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:09.447+0000 7faac2ffd640 1 -- 172.21.15.150:0/1571194878 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7faac409b9f0 msgr2=0x7faac416a080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:09.460 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:09.447+0000 7faac2ffd640 1 --2- 172.21.15.150:0/1571194878 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7faac409b9f0 0x7faac416a080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:09.460 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:09.447+0000 7faac2ffd640 1 -- 172.21.15.150:0/1571194878 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7faac40745d0 msgr2=0x7faac414c0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:09.460 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:09.447+0000 7faac2ffd640 1 --2- 172.21.15.150:0/1571194878 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7faac40745d0 0x7faac414c0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:09.460 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:09.447+0000 7faac2ffd640 1 -- 172.21.15.150:0/1571194878 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faac4169ba0 con 0x7faac415b300 2024-09-17T05:42:09.460 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:09.447+0000 7faac37fe640 1 --2- 172.21.15.150:0/1571194878 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7faac40745d0 0x7faac414c0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T05:42:09.461 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:09.447+0000 7f9c50625640 1 Processor -- start 2024-09-17T05:42:09.461 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:09.447+0000 7faac2ffd640 1 --2- 172.21.15.150:0/1571194878 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7faac415b300 0x7faac414b320 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7faac4075240 tx=0x7faab8033830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:42:09.461 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:09.448+0000 7f9c50625640 1 -- start start 2024-09-17T05:42:09.461 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:09.447+0000 7fe9616ec640 1 -- 172.21.15.150:0/1377068759 shutdown_connections 2024-09-17T05:42:09.462 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:09.447+0000 7fe9616ec640 1 --2- 172.21.15.150:0/1377068759 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe95c0b3900 0x7fe95c155a20 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:09.462 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:09.447+0000 7fe9616ec640 1 --2- 172.21.15.150:0/1377068759 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe95c15fa60 0x7fe95c1554e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:09.462 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:09.447+0000 7fe9616ec640 1 -- 172.21.15.150:0/1377068759 >> 172.21.15.150:0/1377068759 conn(0x7fe95c0b6640 msgr2=0x7fe95c0b2de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:42:09.462 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:09.448+0000 7f14b501d640 1 -- 172.21.15.150:0/2952644285 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f14b0155370 con 0x7f14b006f210 2024-09-17T05:42:09.462 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:09.448+0000 7fe9616ec640 1 -- 172.21.15.150:0/1377068759 shutdown_connections 2024-09-17T05:42:09.462 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:09.448+0000 7fe9616ec640 1 -- 172.21.15.150:0/1377068759 wait complete. 2024-09-17T05:42:09.463 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:09.449+0000 7ff0bcb07640 1 Processor -- start 2024-09-17T05:42:09.463 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:09.449+0000 7f7478a27640 1 Processor -- start 2024-09-17T05:42:09.463 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:09.449+0000 7f7478a27640 1 -- start start 2024-09-17T05:42:09.463 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:09.449+0000 7fd59ed21640 1 Processor -- start 2024-09-17T05:42:09.464 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:09.450+0000 7faaabfff640 1 -- 172.21.15.150:0/1571194878 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faab8040030 con 0x7faac415b300 2024-09-17T05:42:09.464 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:09.450+0000 7faac8dbb640 1 -- 172.21.15.150:0/1571194878 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faac409d7f0 con 0x7faac415b300 2024-09-17T05:42:09.464 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:09.450+0000 7faac8dbb640 1 -- 172.21.15.150:0/1571194878 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faac4157f40 con 0x7faac415b300 2024-09-17T05:42:09.464 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:09.451+0000 7faaabfff640 1 -- 172.21.15.150:0/1571194878 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7faab8033cc0 con 0x7faac415b300 2024-09-17T05:42:09.464 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:09.451+0000 7faaabfff640 1 -- 172.21.15.150:0/1571194878 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faab8037040 con 0x7faac415b300 2024-09-17T05:42:09.465 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:09.450+0000 7f9c50625640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9c480b3350 0x7f9c48155550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:42:09.465 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:09.450+0000 7fd59ed21640 1 -- start start 2024-09-17T05:42:09.466 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:09.450+0000 7f9c50625640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9c480b9db0 0x7f9c480c8a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:42:09.466 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:09.450+0000 7f9c50625640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9c480d0d30 0x7f9c4815fcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:42:09.466 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:09.450+0000 7f9c50625640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f9c480cf580 con 0x7f9c480d0d30 2024-09-17T05:42:09.466 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:09.450+0000 7f9c50625640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f9c480cf400 con 0x7f9c480b9db0 2024-09-17T05:42:09.466 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:09.449+0000 7ff0bcb07640 1 -- start start 2024-09-17T05:42:09.466 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:09.450+0000 7f9c50625640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f9c480cf700 con 0x7f9c480b3350 2024-09-17T05:42:09.467 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:09.451+0000 7f7478a27640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f745c004800 0x7f747415de60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:42:09.467 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:09.451+0000 7f7478a27640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f74741f16c0 0x7f74740ce2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:42:09.467 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:09.451+0000 7ff0bcb07640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff0b00371d0 0x7ff0b017ab60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:42:09.467 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:09.451+0000 7f9c4e3c1640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9c480b3350 0x7f9c48155550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:42:09.468 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:09.451+0000 7ff0bcb07640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff0b0057560 0x7ff0b00e0e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:42:09.468 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:09.451+0000 7f9c4e3c1640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9c480b3350 0x7f9c48155550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3301/0 says I am v2:172.21.15.150:53394/0 (socket says 172.21.15.150:53394) 2024-09-17T05:42:09.468 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:09.451+0000 7f9c4e3c1640 1 -- 172.21.15.150:0/2569002953 learned_addr learned my addr 172.21.15.150:0/2569002953 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:42:09.469 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:09.452+0000 7f747259c640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f745c004800 0x7f747415de60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:42:09.469 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:09.452+0000 7f747259c640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f745c004800 0x7f747415de60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3301/0 says I am v2:172.21.15.150:53402/0 (socket says 172.21.15.150:53402) 2024-09-17T05:42:09.469 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:09.452+0000 7f747259c640 1 -- 172.21.15.150:0/1976773939 learned_addr learned my addr 172.21.15.150:0/1976773939 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:42:09.469 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:09.452+0000 7f7478a27640 1 --2- 172.21.15.150:0/1976773939 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f74741f1ad0 0x7f747415f050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:42:09.469 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:09.452+0000 7f7471d9b640 1 --2- 172.21.15.150:0/1976773939 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f74741f16c0 0x7f74740ce2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:42:09.469 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:09.452+0000 7ff0b77fe640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff0b00371d0 0x7ff0b017ab60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:42:09.470 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:09.452+0000 7ff0b77fe640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff0b00371d0 0x7ff0b017ab60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3301/0 says I am v2:172.21.15.150:53408/0 (socket says 172.21.15.150:53408) 2024-09-17T05:42:09.470 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:09.452+0000 7f14acff9640 1 -- 172.21.15.150:0/2952644285 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f14a8037020 con 0x7f14b006f210 2024-09-17T05:42:09.470 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:09.452+0000 7f7472d9d640 1 --2- 172.21.15.150:0/1976773939 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f74741f1ad0 0x7f747415f050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:42:09.470 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:09.452+0000 7faac8dbb640 1 -- 172.21.15.150:0/1571194878 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faaa4005290 con 0x7faac415b300 2024-09-17T05:42:09.471 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:09.452+0000 7f7478a27640 1 -- 172.21.15.150:0/1976773939 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f74740d33e0 con 0x7f74741f1ad0 2024-09-17T05:42:09.471 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:09.452+0000 7f7478a27640 1 -- 172.21.15.150:0/1976773939 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f74740d3260 con 0x7f74741f16c0 2024-09-17T05:42:09.471 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:09.452+0000 7f7478a27640 1 -- 172.21.15.150:0/1976773939 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f74740b3f70 con 0x7f745c004800 2024-09-17T05:42:09.471 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:09.452+0000 7f9c4e3c1640 1 -- 172.21.15.150:0/2569002953 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9c480b9db0 msgr2=0x7f9c480c8a50 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-17T05:42:09.471 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:09.452+0000 7f9c4e3c1640 1 --2- 172.21.15.150:0/2569002953 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9c480b9db0 0x7f9c480c8a50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:09.472 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:09.452+0000 7f9c4e3c1640 1 -- 172.21.15.150:0/2569002953 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9c480d0d30 msgr2=0x7f9c4815fcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:09.472 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:09.452+0000 7f9c4e3c1640 1 --2- 172.21.15.150:0/2569002953 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9c480d0d30 0x7f9c4815fcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:09.472 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:09.452+0000 7f9c4e3c1640 1 -- 172.21.15.150:0/2569002953 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9c480cba90 con 0x7f9c480b3350 2024-09-17T05:42:09.472 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:09.452+0000 7ff0b6ffd640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff0b0057560 0x7ff0b00e0e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:42:09.472 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:09.452+0000 7ff0b6ffd640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff0b0057560 0x7ff0b00e0e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:54838/0 (socket says 172.21.15.150:54838) 2024-09-17T05:42:09.472 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:09.452+0000 7ff0b77fe640 1 -- 172.21.15.150:0/1800472836 learned_addr learned my addr 172.21.15.150:0/1800472836 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:42:09.473 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:09.452+0000 7fd59ed21640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd590053c50 0x7fd590179c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:42:09.473 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:09.452+0000 7fd59ed21640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd590056da0 0x7fd59017a160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:42:09.473 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:09.452+0000 7fd59ed21640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd5900cf900 0x7fd5900db7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:42:09.473 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:09.452+0000 7fd59ed21640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7fd590007110 con 0x7fd590053c50 2024-09-17T05:42:09.473 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:09.452+0000 7fd59ed21640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fd590006f90 con 0x7fd590056da0 2024-09-17T05:42:09.473 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:09.452+0000 7fd59ed21640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fd590007290 con 0x7fd5900cf900 2024-09-17T05:42:09.473 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:09.452+0000 7fd59dd1f640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd590053c50 0x7fd590179c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:42:09.474 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:09.452+0000 7fd59dd1f640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd590053c50 0x7fd590179c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:54844/0 (socket says 172.21.15.150:54844) 2024-09-17T05:42:09.474 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:09.452+0000 7fd59dd1f640 1 -- 172.21.15.150:0/454919334 learned_addr learned my addr 172.21.15.150:0/454919334 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:42:09.474 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:09.452+0000 7ff0bcb07640 1 --2- 172.21.15.150:0/1800472836 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff0b004ffb0 0x7ff0b00503c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:42:09.474 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:09.453+0000 7f9c4e3c1640 1 --2- 172.21.15.150:0/2569002953 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9c480b3350 0x7f9c48155550 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f9c4000c7a0 tx=0x7f9c4000cc60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:42:09.474 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:09.452+0000 7fd59e520640 1 --2- 172.21.15.150:0/454919334 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd5900cf900 0x7fd5900db7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:42:09.475 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:09.453+0000 7fd59d51e640 1 --2- 172.21.15.150:0/454919334 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd590056da0 0x7fd59017a160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:42:09.475 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:09.453+0000 7f14acff9640 1 --2- 172.21.15.150:0/2952644285 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f149c078b80 0x7f149c07b090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:42:09.475 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:09.453+0000 7f747259c640 1 -- 172.21.15.150:0/1976773939 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f74741f16c0 msgr2=0x7f74740ce2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:09.475 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:09.453+0000 7f747259c640 1 --2- 172.21.15.150:0/1976773939 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f74741f16c0 0x7f74740ce2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:09.475 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:09.453+0000 7f747259c640 1 -- 172.21.15.150:0/1976773939 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f74741f1ad0 msgr2=0x7f747415f050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:09.476 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:09.453+0000 7ff0bcb07640 1 -- 172.21.15.150:0/1800472836 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7ff0b0053f20 con 0x7ff0b0057560 2024-09-17T05:42:09.476 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:09.453+0000 7f747259c640 1 --2- 172.21.15.150:0/1976773939 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f74741f1ad0 0x7f747415f050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:09.476 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:09.453+0000 7ff0bcb07640 1 -- 172.21.15.150:0/1800472836 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7ff0b0053da0 con 0x7ff0b004ffb0 2024-09-17T05:42:09.476 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:09.453+0000 7ff0bcb07640 1 -- 172.21.15.150:0/1800472836 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7ff0b00e72f0 con 0x7ff0b00371d0 2024-09-17T05:42:09.476 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:09.453+0000 7ff0b7fff640 1 --2- 172.21.15.150:0/1800472836 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff0b004ffb0 0x7ff0b00503c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:42:09.477 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:09.453+0000 7fd59dd1f640 1 -- 172.21.15.150:0/454919334 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd5900cf900 msgr2=0x7fd5900db7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:09.477 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:09.453+0000 7fd59dd1f640 1 --2- 172.21.15.150:0/454919334 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd5900cf900 0x7fd5900db7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:09.477 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:09.453+0000 7fd59dd1f640 1 -- 172.21.15.150:0/454919334 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd590056da0 msgr2=0x7fd59017a160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:09.477 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:09.453+0000 7fd59dd1f640 1 --2- 172.21.15.150:0/454919334 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd590056da0 0x7fd59017a160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:09.477 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:09.453+0000 7fd59dd1f640 1 -- 172.21.15.150:0/454919334 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd5900deba0 con 0x7fd590053c50 2024-09-17T05:42:09.477 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:09.453+0000 7f747259c640 1 -- 172.21.15.150:0/1976773939 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f747415f950 con 0x7f745c004800 2024-09-17T05:42:09.478 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:09.453+0000 7f14acff9640 1 -- 172.21.15.150:0/2952644285 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f14a80bc7d0 con 0x7f14b006f210 2024-09-17T05:42:09.478 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:09.453+0000 7fe9616ec640 1 Processor -- start 2024-09-17T05:42:09.478 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:09.453+0000 7f7472d9d640 1 --2- 172.21.15.150:0/1976773939 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f74741f1ad0 0x7f747415f050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T05:42:09.479 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:09.453+0000 7f9c3effd640 1 -- 172.21.15.150:0/2569002953 <== mon.2 v2:172.21.15.176:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c40016020 con 0x7f9c480b3350 2024-09-17T05:42:09.479 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:09.453+0000 7f9c50625640 1 -- 172.21.15.150:0/2569002953 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9c480cbd70 con 0x7f9c480b3350 2024-09-17T05:42:09.479 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:09.453+0000 7f747259c640 1 --2- 172.21.15.150:0/1976773939 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f745c004800 0x7f747415de60 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f746400e6b0 tx=0x7f746400eb70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:42:09.480 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:09.453+0000 7fd59dd1f640 1 --2- 172.21.15.150:0/454919334 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd590053c50 0x7fd590179c20 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fd594009fd0 tx=0x7fd59400eb60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:42:09.480 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:09.453+0000 7f9c50625640 1 -- 172.21.15.150:0/2569002953 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f9c480cc330 con 0x7f9c480b3350 2024-09-17T05:42:09.480 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:09.453+0000 7f9c3effd640 1 -- 172.21.15.150:0/2569002953 <== mon.2 v2:172.21.15.176:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9c4000ab40 con 0x7f9c480b3350 2024-09-17T05:42:09.480 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:09.453+0000 7f9c3effd640 1 -- 172.21.15.150:0/2569002953 <== mon.2 v2:172.21.15.176:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c40012420 con 0x7f9c480b3350 2024-09-17T05:42:09.480 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:09.454+0000 7fe9616ec640 1 -- start start 2024-09-17T05:42:09.481 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:09.453+0000 7ff0b7fff640 1 -- 172.21.15.150:0/1800472836 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff0b00371d0 msgr2=0x7ff0b017ab60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:09.481 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:09.453+0000 7ff0b7fff640 1 --2- 172.21.15.150:0/1800472836 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff0b00371d0 0x7ff0b017ab60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:09.482 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:09.453+0000 7ff0b7fff640 1 -- 172.21.15.150:0/1800472836 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff0b0057560 msgr2=0x7ff0b00e0e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:09.482 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:09.454+0000 7ff0b7fff640 1 --2- 172.21.15.150:0/1800472836 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff0b0057560 0x7ff0b00e0e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:09.482 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:09.454+0000 7ff0b7fff640 1 -- 172.21.15.150:0/1800472836 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff0b004de10 con 0x7ff0b004ffb0 2024-09-17T05:42:09.482 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:09.454+0000 7ff0b7fff640 1 --2- 172.21.15.150:0/1800472836 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff0b004ffb0 0x7ff0b00503c0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7ff0b8051d10 tx=0x7ff0b806b6c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:42:09.482 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:09.454+0000 7ff0a3fff640 1 -- 172.21.15.150:0/1800472836 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0b80bb070 con 0x7ff0b004ffb0 2024-09-17T05:42:09.482 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:09.454+0000 7ff0a3fff640 1 -- 172.21.15.150:0/1800472836 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff0b80b79d0 con 0x7ff0b004ffb0 2024-09-17T05:42:09.482 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:09.453+0000 7f14affff640 1 --2- 172.21.15.150:0/2952644285 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f149c078b80 0x7f149c07b090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:42:09.482 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:09.454+0000 7f14affff640 1 --2- 172.21.15.150:0/2952644285 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f149c078b80 0x7f149c07b090 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f14a0009c30 tx=0x7f14a0005f90 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:42:09.483 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:09.454+0000 7f7462ffd640 1 -- 172.21.15.150:0/1976773939 <== mon.2 v2:172.21.15.176:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f746400baa0 con 0x7f745c004800 2024-09-17T05:42:09.483 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:09.454+0000 7f7462ffd640 1 -- 172.21.15.150:0/1976773939 <== mon.2 v2:172.21.15.176:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f746400bc40 con 0x7f745c004800 2024-09-17T05:42:09.483 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:09.454+0000 7f7462ffd640 1 -- 172.21.15.150:0/1976773939 <== mon.2 v2:172.21.15.176:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7464010430 con 0x7f745c004800 2024-09-17T05:42:09.483 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:09.455+0000 7ff0a3fff640 1 -- 172.21.15.150:0/1800472836 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0b80b7dc0 con 0x7ff0b004ffb0 2024-09-17T05:42:09.484 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:09.455+0000 7ff0bcb07640 1 -- 172.21.15.150:0/1800472836 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff0b004e530 con 0x7ff0b004ffb0 2024-09-17T05:42:09.484 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:09.455+0000 7ff0bcb07640 1 -- 172.21.15.150:0/1800472836 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff0b0056120 con 0x7ff0b004ffb0 2024-09-17T05:42:09.484 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:09.455+0000 7f7478a27640 1 -- 172.21.15.150:0/1976773939 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f74741619d0 con 0x7f745c004800 2024-09-17T05:42:09.484 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:09.455+0000 7f7478a27640 1 -- 172.21.15.150:0/1976773939 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f74740cd500 con 0x7f745c004800 2024-09-17T05:42:09.484 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:09.455+0000 7f9c50625640 1 -- 172.21.15.150:0/2569002953 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9c30005290 con 0x7f9c480b3350 2024-09-17T05:42:09.485 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:09.456+0000 7fe9616ec640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe95c0b34f0 0x7fe95c14fe30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:42:09.485 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:09.456+0000 7fe9616ec640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe95c0b3900 0x7fe95c150370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:42:09.485 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:09.456+0000 7fe9616ec640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe95c14f830 0x7fe95c151050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:42:09.485 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:09.456+0000 7fe9616ec640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7fe95c1560e0 con 0x7fe95c14f830 2024-09-17T05:42:09.485 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:09.456+0000 7fe9616ec640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fe95c155f60 con 0x7fe95c0b3900 2024-09-17T05:42:09.485 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:09.456+0000 7fe9616ec640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fe95c156260 con 0x7fe95c0b34f0 2024-09-17T05:42:09.486 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:09.456+0000 7ff0bcb07640 1 -- 172.21.15.150:0/1800472836 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff0b004ea50 con 0x7ff0b004ffb0 2024-09-17T05:42:09.486 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:09.456+0000 7f7478a27640 1 -- 172.21.15.150:0/1976773939 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f74740d1430 con 0x7f745c004800 2024-09-17T05:42:09.486 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:09.456+0000 7fe95b7fe640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe95c14f830 0x7fe95c151050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:42:09.487 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:09.456+0000 7fe95b7fe640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe95c14f830 0x7fe95c151050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:54846/0 (socket says 172.21.15.150:54846) 2024-09-17T05:42:09.487 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:09.456+0000 7fe95b7fe640 1 -- 172.21.15.150:0/2992517968 learned_addr learned my addr 172.21.15.150:0/2992517968 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:42:09.487 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:09.456+0000 7fe95a7fc640 1 --2- 172.21.15.150:0/2992517968 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe95c0b3900 0x7fe95c150370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:42:09.487 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:09.457+0000 7f9c3effd640 1 -- 172.21.15.150:0/2569002953 <== mon.2 v2:172.21.15.176:3301/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f9c40019020 con 0x7f9c480b3350 2024-09-17T05:42:09.488 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:09.457+0000 7fe95b7fe640 1 -- 172.21.15.150:0/2992517968 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe95c0b34f0 msgr2=0x7fe95c14fe30 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-17T05:42:09.488 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:09.457+0000 7fe95b7fe640 1 --2- 172.21.15.150:0/2992517968 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe95c0b34f0 0x7fe95c14fe30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:09.488 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:09.457+0000 7fe95b7fe640 1 -- 172.21.15.150:0/2992517968 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe95c0b3900 msgr2=0x7fe95c150370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:09.488 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:09.457+0000 7fe95b7fe640 1 --2- 172.21.15.150:0/2992517968 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe95c0b3900 0x7fe95c150370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:09.488 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:09.457+0000 7fe95b7fe640 1 -- 172.21.15.150:0/2992517968 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe95c153290 con 0x7fe95c14f830 2024-09-17T05:42:09.488 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:09.457+0000 7ff0a3fff640 1 -- 172.21.15.150:0/1800472836 <== mon.1 v2:172.21.15.176:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7ff0b80c0460 con 0x7ff0b004ffb0 2024-09-17T05:42:09.489 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:09.457+0000 7fe95b7fe640 1 --2- 172.21.15.150:0/2992517968 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe95c14f830 0x7fe95c151050 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fe950006010 tx=0x7fe950003b90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:42:09.489 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:09.458+0000 7f9c3effd640 1 --2- 172.21.15.150:0/2569002953 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f9c2c078bc0 0x7f9c2c07b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:42:09.489 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:09.458+0000 7f9c3effd640 1 -- 172.21.15.150:0/2569002953 <== mon.2 v2:172.21.15.176:3301/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f9c4009ae70 con 0x7f9c480b3350 2024-09-17T05:42:09.489 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:09.458+0000 7f7462ffd640 1 -- 172.21.15.150:0/1976773939 <== mon.2 v2:172.21.15.176:3301/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f746401f020 con 0x7f745c004800 2024-09-17T05:42:09.490 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:09.458+0000 7f9c4dbc0640 1 --2- 172.21.15.150:0/2569002953 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f9c2c078bc0 0x7f9c2c07b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:42:09.490 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:09.458+0000 7ff0a3fff640 1 --2- 172.21.15.150:0/1800472836 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7ff09c078bc0 0x7ff09c07b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:42:09.490 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:09.458+0000 7f7462ffd640 1 --2- 172.21.15.150:0/1976773939 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f7454078c60 0x7f745407b170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:42:09.490 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:09.458+0000 7ff0b77fe640 1 --2- 172.21.15.150:0/1800472836 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7ff09c078bc0 0x7ff09c07b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:42:09.491 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:09.458+0000 7f9c4dbc0640 1 --2- 172.21.15.150:0/2569002953 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f9c2c078bc0 0x7f9c2c07b0d0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f9c480c8280 tx=0x7f9c38005f90 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:42:09.491 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:09.458+0000 7ff0a3fff640 1 -- 172.21.15.150:0/1800472836 <== mon.1 v2:172.21.15.176:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7ff0b8137ae0 con 0x7ff0b004ffb0 2024-09-17T05:42:09.491 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:09.458+0000 7f7462ffd640 1 -- 172.21.15.150:0/1976773939 <== mon.2 v2:172.21.15.176:3301/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f746409b280 con 0x7f745c004800 2024-09-17T05:42:09.491 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:09.458+0000 7f7471d9b640 1 --2- 172.21.15.150:0/1976773939 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f7454078c60 0x7f745407b170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:42:09.492 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:09.459+0000 7ff0b77fe640 1 --2- 172.21.15.150:0/1800472836 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7ff09c078bc0 0x7ff09c07b0d0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7ff0ac0099f0 tx=0x7ff0ac0090e0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:42:09.492 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:09.459+0000 7f7471d9b640 1 --2- 172.21.15.150:0/1976773939 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f7454078c60 0x7f745407b170 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f7468033000 tx=0x7f7468036040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:42:09.492 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:09.459+0000 7f14acff9640 1 -- 172.21.15.150:0/2952644285 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f14a8084c90 con 0x7f14b006f210 2024-09-17T05:42:09.493 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:09.459+0000 7fd58e7fc640 1 -- 172.21.15.150:0/454919334 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd594004220 con 0x7fd590053c50 2024-09-17T05:42:09.493 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:09.460+0000 7fd59ed21640 1 -- 172.21.15.150:0/454919334 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd59017a6a0 con 0x7fd590053c50 2024-09-17T05:42:09.493 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:09.460+0000 7fd59ed21640 1 -- 172.21.15.150:0/454919334 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd5900df120 con 0x7fd590053c50 2024-09-17T05:42:09.493 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:09.460+0000 7fd58e7fc640 1 -- 172.21.15.150:0/454919334 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd5940043c0 con 0x7fd590053c50 2024-09-17T05:42:09.493 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:09.461+0000 7fe9437fe640 1 -- 172.21.15.150:0/2992517968 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe95003e030 con 0x7fe95c14f830 2024-09-17T05:42:09.493 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:09.461+0000 7fe9616ec640 1 -- 172.21.15.150:0/2992517968 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe95c152a50 con 0x7fe95c14f830 2024-09-17T05:42:09.494 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:09.461+0000 7fe9616ec640 1 -- 172.21.15.150:0/2992517968 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe95c14cb20 con 0x7fe95c14f830 2024-09-17T05:42:09.494 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:09.461+0000 7f9c3effd640 1 -- 172.21.15.150:0/2569002953 <== mon.2 v2:172.21.15.176:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f9c40020020 con 0x7f9c480b3350 2024-09-17T05:42:09.494 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:09.461+0000 7fd58e7fc640 1 -- 172.21.15.150:0/454919334 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd59400cab0 con 0x7fd590053c50 2024-09-17T05:42:09.494 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:09.461+0000 7faaabfff640 1 -- 172.21.15.150:0/1571194878 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7faab8043070 con 0x7faac415b300 2024-09-17T05:42:09.494 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:09.462+0000 7faaabfff640 1 --2- 172.21.15.150:0/1571194878 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7faab0078c60 0x7faab007b170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:42:09.495 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:09.462+0000 7fe9437fe640 1 -- 172.21.15.150:0/2992517968 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe950005310 con 0x7fe95c14f830 2024-09-17T05:42:09.495 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:09.462+0000 7fd59ed21640 1 -- 172.21.15.150:0/454919334 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd580005290 con 0x7fd590053c50 2024-09-17T05:42:09.495 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:09.462+0000 7faaabfff640 1 -- 172.21.15.150:0/1571194878 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7faab80bae50 con 0x7faac415b300 2024-09-17T05:42:09.495 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:09.462+0000 7faac37fe640 1 --2- 172.21.15.150:0/1571194878 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7faab0078c60 0x7faab007b170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:42:09.496 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:09.462+0000 7fe9437fe640 1 -- 172.21.15.150:0/2992517968 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe950048060 con 0x7fe95c14f830 2024-09-17T05:42:09.496 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:09.463+0000 7faac37fe640 1 --2- 172.21.15.150:0/1571194878 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7faab0078c60 0x7faab007b170 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7faab4001220 tx=0x7faab40011b0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:42:09.496 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:09.463+0000 7fe9616ec640 1 -- 172.21.15.150:0/2992517968 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe93c005290 con 0x7fe95c14f830 2024-09-17T05:42:09.497 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:09.463+0000 7ff0a3fff640 1 -- 172.21.15.150:0/1800472836 <== mon.1 v2:172.21.15.176:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7ff0b004ea50 con 0x7ff0b004ffb0 2024-09-17T05:42:09.497 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:09.467+0000 7f7462ffd640 1 -- 172.21.15.150:0/1976773939 <== mon.2 v2:172.21.15.176:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f7464063730 con 0x7f745c004800 2024-09-17T05:42:09.497 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:09.472+0000 7fd58e7fc640 1 -- 172.21.15.150:0/454919334 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fd59400cc50 con 0x7fd590053c50 2024-09-17T05:42:09.497 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:09.471+0000 7faaabfff640 1 -- 172.21.15.150:0/1571194878 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7faab804a020 con 0x7faac415b300 2024-09-17T05:42:09.498 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:09.473+0000 7fd58e7fc640 1 --2- 172.21.15.150:0/454919334 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fd57c078bc0 0x7fd57c07b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:42:09.498 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:09.473+0000 7fd58e7fc640 1 -- 172.21.15.150:0/454919334 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7fd59409b7e0 con 0x7fd590053c50 2024-09-17T05:42:09.498 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:09.473+0000 7fd59d51e640 1 --2- 172.21.15.150:0/454919334 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fd57c078bc0 0x7fd57c07b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:42:09.498 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:09.475+0000 7fe9437fe640 1 -- 172.21.15.150:0/2992517968 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fe950041030 con 0x7fe95c14f830 2024-09-17T05:42:09.499 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:09.476+0000 7fe9437fe640 1 --2- 172.21.15.150:0/2992517968 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fe948078b90 0x7fe94807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:42:09.499 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:09.476+0000 7fe95affd640 1 --2- 172.21.15.150:0/2992517968 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fe948078b90 0x7fe94807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:42:09.499 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:09.477+0000 7fd59d51e640 1 --2- 172.21.15.150:0/454919334 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fd57c078bc0 0x7fd57c07b0d0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fd588034000 tx=0x7fd588004730 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:42:09.499 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:09.477+0000 7fe9437fe640 1 -- 172.21.15.150:0/2992517968 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7fe95007f8a0 con 0x7fe95c14f830 2024-09-17T05:42:09.500 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:09.482+0000 7fd58e7fc640 1 -- 172.21.15.150:0/454919334 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fd594063c10 con 0x7fd590053c50 2024-09-17T05:42:09.500 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:09.483+0000 7fe95affd640 1 --2- 172.21.15.150:0/2992517968 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fe948078b90 0x7fe94807b0a0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fe94c0095d0 tx=0x7fe94c006b30 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:42:09.500 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:09.491+0000 7fe9437fe640 1 -- 172.21.15.150:0/2992517968 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fe95c153290 con 0x7fe95c14f830 2024-09-17T05:42:09.775 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:09.774+0000 7f69c3401640 1 -- 172.21.15.150:0/3580478359 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) -- 0x7f69bc070d00 con 0x7f69bc156ea0 2024-09-17T05:42:09.776 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:09.775+0000 7f69baffd640 1 -- 172.21.15.150:0/3580478359 <== mon.2 v2:172.21.15.176:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f69ac0669e0 con 0x7f69bc156ea0 2024-09-17T05:42:09.776 INFO:teuthology.orchestra.run.smithi150.stdout:64424509448 2024-09-17T05:42:09.781 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:09.778+0000 7f69b8ff9640 1 -- 172.21.15.150:0/3580478359 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f69a8078c60 msgr2=0x7f69a807b170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:09.781 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:09.778+0000 7f69b8ff9640 1 --2- 172.21.15.150:0/3580478359 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f69a8078c60 0x7f69a807b170 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f69bc073d10 tx=0x7f69b0005f90 comp rx=0 tx=0).stop 2024-09-17T05:42:09.781 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:09.778+0000 7f69b8ff9640 1 -- 172.21.15.150:0/3580478359 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f69bc156ea0 msgr2=0x7f69bc203030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:09.781 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:09.779+0000 7f69b8ff9640 1 --2- 172.21.15.150:0/3580478359 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f69bc156ea0 0x7f69bc203030 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f69ac00c760 tx=0x7f69ac00cc20 comp rx=0 tx=0).stop 2024-09-17T05:42:09.781 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:09.779+0000 7f69b8ff9640 1 -- 172.21.15.150:0/3580478359 shutdown_connections 2024-09-17T05:42:09.781 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:09.779+0000 7f69b8ff9640 1 --2- 172.21.15.150:0/3580478359 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f69bc152190 0x7f69bc1525a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:09.781 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:09.779+0000 7f69b8ff9640 1 --2- 172.21.15.150:0/3580478359 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f69a8078c60 0x7f69a807b170 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:09.781 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:09.779+0000 7f69b8ff9640 1 --2- 172.21.15.150:0/3580478359 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f69bc0ae460 0x7f69bc0ae870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:09.781 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:09.779+0000 7f69b8ff9640 1 --2- 172.21.15.150:0/3580478359 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f69bc156ea0 0x7f69bc203030 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:09.781 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:09.779+0000 7f69b8ff9640 1 -- 172.21.15.150:0/3580478359 >> 172.21.15.150:0/3580478359 conn(0x7f69bc0b1c60 msgr2=0x7f69bc1586f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:42:09.781 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:09.779+0000 7f69b8ff9640 1 -- 172.21.15.150:0/3580478359 shutdown_connections 2024-09-17T05:42:09.782 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:09.779+0000 7f69b8ff9640 1 -- 172.21.15.150:0/3580478359 wait complete. 2024-09-17T05:42:09.798 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509448 got 64424509448 for osd.4 2024-09-17T05:42:09.798 DEBUG:teuthology.parallel:result is None 2024-09-17T05:42:09.839 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:09.838+0000 7fd59ed21640 1 -- 172.21.15.150:0/454919334 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) -- 0x7fd580005850 con 0x7fd590053c50 2024-09-17T05:42:09.840 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:09.838+0000 7fd58e7fc640 1 -- 172.21.15.150:0/454919334 <== mon.0 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fd594063510 con 0x7fd590053c50 2024-09-17T05:42:09.840 INFO:teuthology.orchestra.run.smithi150.stdout:64424509448 2024-09-17T05:42:09.843 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:09.840+0000 7fd59ed21640 1 -- 172.21.15.150:0/454919334 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fd57c078bc0 msgr2=0x7fd57c07b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:09.843 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:09.840+0000 7fd59ed21640 1 --2- 172.21.15.150:0/454919334 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fd57c078bc0 0x7fd57c07b0d0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fd588034000 tx=0x7fd588004730 comp rx=0 tx=0).stop 2024-09-17T05:42:09.843 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:09.840+0000 7fd59ed21640 1 -- 172.21.15.150:0/454919334 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd590053c50 msgr2=0x7fd590179c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:09.843 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:09.840+0000 7fd59ed21640 1 --2- 172.21.15.150:0/454919334 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd590053c50 0x7fd590179c20 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fd594009fd0 tx=0x7fd59400eb60 comp rx=0 tx=0).stop 2024-09-17T05:42:09.843 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:09.841+0000 7fd59ed21640 1 -- 172.21.15.150:0/454919334 shutdown_connections 2024-09-17T05:42:09.843 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:09.841+0000 7fd59ed21640 1 --2- 172.21.15.150:0/454919334 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd590056da0 0x7fd59017a160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:09.843 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:09.841+0000 7fd59ed21640 1 --2- 172.21.15.150:0/454919334 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fd57c078bc0 0x7fd57c07b0d0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:09.843 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:09.841+0000 7fd59ed21640 1 --2- 172.21.15.150:0/454919334 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd5900cf900 0x7fd5900db7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:09.843 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:09.841+0000 7fd59ed21640 1 --2- 172.21.15.150:0/454919334 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd590053c50 0x7fd590179c20 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:09.843 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:09.841+0000 7fd59ed21640 1 -- 172.21.15.150:0/454919334 >> 172.21.15.150:0/454919334 conn(0x7fd59003a5f0 msgr2=0x7fd5900388d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:42:09.844 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:09.841+0000 7fd59ed21640 1 -- 172.21.15.150:0/454919334 shutdown_connections 2024-09-17T05:42:09.844 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:09.841+0000 7fd59ed21640 1 -- 172.21.15.150:0/454919334 wait complete. 2024-09-17T05:42:09.854 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509448 got 64424509448 for osd.5 2024-09-17T05:42:09.854 DEBUG:teuthology.parallel:result is None 2024-09-17T05:42:09.877 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:09.875+0000 7f14b501d640 1 -- 172.21.15.150:0/2952644285 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7f14b00b4bf0 con 0x7f14b006f210 2024-09-17T05:42:09.877 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:09.876+0000 7f14acff9640 1 -- 172.21.15.150:0/2952644285 <== mon.0 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f14a8084590 con 0x7f14b006f210 2024-09-17T05:42:09.877 INFO:teuthology.orchestra.run.smithi150.stdout:64424509448 2024-09-17T05:42:09.880 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:09.878+0000 7f14b501d640 1 -- 172.21.15.150:0/2952644285 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f149c078b80 msgr2=0x7f149c07b090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:09.880 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:09.878+0000 7f14b501d640 1 --2- 172.21.15.150:0/2952644285 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f149c078b80 0x7f149c07b090 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f14a0009c30 tx=0x7f14a0005f90 comp rx=0 tx=0).stop 2024-09-17T05:42:09.880 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:09.878+0000 7ff0bcb07640 1 -- 172.21.15.150:0/1800472836 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) -- 0x7ff0b0052090 con 0x7ff0b004ffb0 2024-09-17T05:42:09.881 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:09.878+0000 7f14b501d640 1 -- 172.21.15.150:0/2952644285 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f14b006f210 msgr2=0x7f14b01fad90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:09.881 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:09.878+0000 7f14b501d640 1 --2- 172.21.15.150:0/2952644285 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f14b006f210 0x7f14b01fad90 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f14a8032000 tx=0x7f14a8003f10 comp rx=0 tx=0).stop 2024-09-17T05:42:09.881 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:09.878+0000 7f14b501d640 1 -- 172.21.15.150:0/2952644285 shutdown_connections 2024-09-17T05:42:09.881 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:09.878+0000 7f14b501d640 1 --2- 172.21.15.150:0/2952644285 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f149c078b80 0x7f149c07b090 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:09.881 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:09.878+0000 7f14b501d640 1 --2- 172.21.15.150:0/2952644285 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f14b01558b0 0x7f14b01fa4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:09.881 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:09.878+0000 7f14b501d640 1 --2- 172.21.15.150:0/2952644285 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f14b006f210 0x7f14b01fad90 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:09.881 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:09.878+0000 7f14b501d640 1 --2- 172.21.15.150:0/2952644285 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f14b006ee00 0x7f14b01f3ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:09.881 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:09.878+0000 7f14b501d640 1 -- 172.21.15.150:0/2952644285 >> 172.21.15.150:0/2952644285 conn(0x7f14b00b1c60 msgr2=0x7f14b00b2070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:42:09.881 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:09.879+0000 7f14b501d640 1 -- 172.21.15.150:0/2952644285 shutdown_connections 2024-09-17T05:42:09.881 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:09.879+0000 7f14b501d640 1 -- 172.21.15.150:0/2952644285 wait complete. 2024-09-17T05:42:09.882 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:09.879+0000 7ff0a3fff640 1 -- 172.21.15.150:0/1800472836 <== mon.1 v2:172.21.15.176:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7ff0b0052090 con 0x7ff0b004ffb0 2024-09-17T05:42:09.882 INFO:teuthology.orchestra.run.smithi150.stdout:64424509449 2024-09-17T05:42:09.883 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:09.881+0000 7f9c50625640 1 -- 172.21.15.150:0/2569002953 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7f9c30005850 con 0x7f9c480b3350 2024-09-17T05:42:09.883 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:09.882+0000 7f9c3effd640 1 -- 172.21.15.150:0/2569002953 <== mon.2 v2:172.21.15.176:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f9c480d1680 con 0x7f9c480b3350 2024-09-17T05:42:09.884 INFO:teuthology.orchestra.run.smithi150.stdout:64424509448 2024-09-17T05:42:09.885 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:09.883+0000 7ff0bcb07640 1 -- 172.21.15.150:0/1800472836 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7ff09c078bc0 msgr2=0x7ff09c07b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:09.885 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:09.883+0000 7ff0bcb07640 1 --2- 172.21.15.150:0/1800472836 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7ff09c078bc0 0x7ff09c07b0d0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7ff0ac0099f0 tx=0x7ff0ac0090e0 comp rx=0 tx=0).stop 2024-09-17T05:42:09.885 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:09.883+0000 7ff0bcb07640 1 -- 172.21.15.150:0/1800472836 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff0b004ffb0 msgr2=0x7ff0b00503c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:09.885 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:09.883+0000 7ff0bcb07640 1 --2- 172.21.15.150:0/1800472836 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff0b004ffb0 0x7ff0b00503c0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7ff0b8051d10 tx=0x7ff0b806b6c0 comp rx=0 tx=0).stop 2024-09-17T05:42:09.885 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:09.883+0000 7ff0bcb07640 1 -- 172.21.15.150:0/1800472836 shutdown_connections 2024-09-17T05:42:09.885 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:09.883+0000 7ff0bcb07640 1 --2- 172.21.15.150:0/1800472836 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff0b004ffb0 0x7ff0b00503c0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:09.885 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:09.883+0000 7ff0bcb07640 1 --2- 172.21.15.150:0/1800472836 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7ff09c078bc0 0x7ff09c07b0d0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:09.885 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:09.883+0000 7ff0bcb07640 1 --2- 172.21.15.150:0/1800472836 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff0b0057560 0x7ff0b00e0e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:09.885 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:09.883+0000 7ff0bcb07640 1 --2- 172.21.15.150:0/1800472836 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff0b00371d0 0x7ff0b017ab60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:09.885 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:09.883+0000 7ff0bcb07640 1 -- 172.21.15.150:0/1800472836 >> 172.21.15.150:0/1800472836 conn(0x7ff0b001fbe0 msgr2=0x7ff0b0051980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:42:09.885 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:09.883+0000 7ff0bcb07640 1 -- 172.21.15.150:0/1800472836 shutdown_connections 2024-09-17T05:42:09.885 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:09.883+0000 7ff0bcb07640 1 -- 172.21.15.150:0/1800472836 wait complete. 2024-09-17T05:42:09.886 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:09.884+0000 7f7478a27640 1 -- 172.21.15.150:0/1976773939 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) -- 0x7f74740d1db0 con 0x7f745c004800 2024-09-17T05:42:09.886 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:09.884+0000 7f7462ffd640 1 -- 172.21.15.150:0/1976773939 <== mon.2 v2:172.21.15.176:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f7464063030 con 0x7f745c004800 2024-09-17T05:42:09.886 INFO:teuthology.orchestra.run.smithi150.stdout:68719476745 2024-09-17T05:42:09.887 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:09.886+0000 7f9c50625640 1 -- 172.21.15.150:0/2569002953 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f9c2c078bc0 msgr2=0x7f9c2c07b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:09.888 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:09.886+0000 7f9c50625640 1 --2- 172.21.15.150:0/2569002953 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f9c2c078bc0 0x7f9c2c07b0d0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f9c480c8280 tx=0x7f9c38005f90 comp rx=0 tx=0).stop 2024-09-17T05:42:09.888 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:09.886+0000 7f9c50625640 1 -- 172.21.15.150:0/2569002953 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9c480b3350 msgr2=0x7f9c48155550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:09.888 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:09.886+0000 7f9c50625640 1 --2- 172.21.15.150:0/2569002953 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9c480b3350 0x7f9c48155550 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f9c4000c7a0 tx=0x7f9c4000cc60 comp rx=0 tx=0).stop 2024-09-17T05:42:09.889 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:09.887+0000 7f9c50625640 1 -- 172.21.15.150:0/2569002953 shutdown_connections 2024-09-17T05:42:09.889 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:09.887+0000 7f9c50625640 1 --2- 172.21.15.150:0/2569002953 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9c480b9db0 0x7f9c480c8a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:09.889 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:09.887+0000 7f9c50625640 1 --2- 172.21.15.150:0/2569002953 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f9c2c078bc0 0x7f9c2c07b0d0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:09.889 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:09.887+0000 7f9c50625640 1 --2- 172.21.15.150:0/2569002953 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9c480d0d30 0x7f9c4815fcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:09.889 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:09.887+0000 7f9c50625640 1 --2- 172.21.15.150:0/2569002953 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9c480b3350 0x7f9c48155550 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:09.889 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:09.887+0000 7f9c50625640 1 -- 172.21.15.150:0/2569002953 >> 172.21.15.150:0/2569002953 conn(0x7f9c4808dc80 msgr2=0x7f9c481626e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:42:09.889 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:09.887+0000 7f9c50625640 1 -- 172.21.15.150:0/2569002953 shutdown_connections 2024-09-17T05:42:09.889 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:09.887+0000 7f9c50625640 1 -- 172.21.15.150:0/2569002953 wait complete. 2024-09-17T05:42:09.890 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:09.887+0000 7f7478a27640 1 -- 172.21.15.150:0/1976773939 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f7454078c60 msgr2=0x7f745407b170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:09.890 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:09.887+0000 7f7478a27640 1 --2- 172.21.15.150:0/1976773939 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f7454078c60 0x7f745407b170 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f7468033000 tx=0x7f7468036040 comp rx=0 tx=0).stop 2024-09-17T05:42:09.890 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:09.887+0000 7f7478a27640 1 -- 172.21.15.150:0/1976773939 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f745c004800 msgr2=0x7f747415de60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:09.890 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:09.887+0000 7f7478a27640 1 --2- 172.21.15.150:0/1976773939 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f745c004800 0x7f747415de60 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f746400e6b0 tx=0x7f746400eb70 comp rx=0 tx=0).stop 2024-09-17T05:42:09.890 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:09.887+0000 7f7478a27640 1 -- 172.21.15.150:0/1976773939 shutdown_connections 2024-09-17T05:42:09.891 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:09.887+0000 7f7478a27640 1 --2- 172.21.15.150:0/1976773939 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f74741f16c0 0x7f74740ce2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:09.891 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:09.887+0000 7f7478a27640 1 --2- 172.21.15.150:0/1976773939 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f7454078c60 0x7f745407b170 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:09.891 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:09.887+0000 7f7478a27640 1 --2- 172.21.15.150:0/1976773939 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f74741f1ad0 0x7f747415f050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:09.891 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:09.887+0000 7f7478a27640 1 --2- 172.21.15.150:0/1976773939 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f745c004800 0x7f747415de60 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:09.891 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:09.888+0000 7f7478a27640 1 -- 172.21.15.150:0/1976773939 >> 172.21.15.150:0/1976773939 conn(0x7f747408bfe0 msgr2=0x7f74740b4450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:42:09.891 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:09.888+0000 7f7478a27640 1 -- 172.21.15.150:0/1976773939 shutdown_connections 2024-09-17T05:42:09.891 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:09.888+0000 7f7478a27640 1 -- 172.21.15.150:0/1976773939 wait complete. 2024-09-17T05:42:09.896 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509448 got 64424509448 for osd.3 2024-09-17T05:42:09.896 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:09.894+0000 7faac8dbb640 1 -- 172.21.15.150:0/1571194878 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7faaa4005850 con 0x7faac415b300 2024-09-17T05:42:09.896 DEBUG:teuthology.parallel:result is None 2024-09-17T05:42:09.896 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:09.895+0000 7faaabfff640 1 -- 172.21.15.150:0/1571194878 <== mon.0 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7faab8082cb0 con 0x7faac415b300 2024-09-17T05:42:09.897 INFO:teuthology.orchestra.run.smithi150.stdout:64424509448 2024-09-17T05:42:09.901 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:09.899+0000 7faac8dbb640 1 -- 172.21.15.150:0/1571194878 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7faab0078c60 msgr2=0x7faab007b170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:09.901 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:09.899+0000 7faac8dbb640 1 --2- 172.21.15.150:0/1571194878 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7faab0078c60 0x7faab007b170 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7faab4001220 tx=0x7faab40011b0 comp rx=0 tx=0).stop 2024-09-17T05:42:09.901 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:09.899+0000 7faac8dbb640 1 -- 172.21.15.150:0/1571194878 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7faac415b300 msgr2=0x7faac414b320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:09.901 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:09.899+0000 7faac8dbb640 1 --2- 172.21.15.150:0/1571194878 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7faac415b300 0x7faac414b320 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7faac4075240 tx=0x7faab8033830 comp rx=0 tx=0).stop 2024-09-17T05:42:09.901 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:09.899+0000 7faac8dbb640 1 -- 172.21.15.150:0/1571194878 shutdown_connections 2024-09-17T05:42:09.901 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:09.899+0000 7faac8dbb640 1 --2- 172.21.15.150:0/1571194878 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7faab0078c60 0x7faab007b170 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:09.901 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:09.899+0000 7faac8dbb640 1 --2- 172.21.15.150:0/1571194878 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7faac409b9f0 0x7faac416a080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:09.901 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:09.899+0000 7faac8dbb640 1 --2- 172.21.15.150:0/1571194878 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7faac415b300 0x7faac414b320 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:09.901 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:09.899+0000 7faac8dbb640 1 --2- 172.21.15.150:0/1571194878 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7faac40745d0 0x7faac414c0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:09.902 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:09.899+0000 7faac8dbb640 1 -- 172.21.15.150:0/1571194878 >> 172.21.15.150:0/1571194878 conn(0x7faac40b1c60 msgr2=0x7faac4072ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:42:09.902 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:09.899+0000 7faac8dbb640 1 -- 172.21.15.150:0/1571194878 shutdown_connections 2024-09-17T05:42:09.902 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:09.899+0000 7faac8dbb640 1 -- 172.21.15.150:0/1571194878 wait complete. 2024-09-17T05:42:09.905 INFO:tasks.ceph.ceph_manager.ceph:need seq 68719476745 got 68719476745 for osd.6 2024-09-17T05:42:09.905 DEBUG:teuthology.parallel:result is None 2024-09-17T05:42:09.906 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509449 got 64424509449 for osd.7 2024-09-17T05:42:09.906 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:09.903+0000 7fe9616ec640 1 -- 172.21.15.150:0/2992517968 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7fe93c005850 con 0x7fe95c14f830 2024-09-17T05:42:09.906 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:09.904+0000 7fe9437fe640 1 -- 172.21.15.150:0/2992517968 <== mon.0 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fe950083630 con 0x7fe95c14f830 2024-09-17T05:42:09.906 DEBUG:teuthology.parallel:result is None 2024-09-17T05:42:09.906 INFO:teuthology.orchestra.run.smithi150.stdout:55834574856 2024-09-17T05:42:09.908 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509448 got 64424509448 for osd.1 2024-09-17T05:42:09.908 DEBUG:teuthology.parallel:result is None 2024-09-17T05:42:09.909 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:09.906+0000 7fe9616ec640 1 -- 172.21.15.150:0/2992517968 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fe948078b90 msgr2=0x7fe94807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:09.909 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:09.906+0000 7fe9616ec640 1 --2- 172.21.15.150:0/2992517968 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fe948078b90 0x7fe94807b0a0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fe94c0095d0 tx=0x7fe94c006b30 comp rx=0 tx=0).stop 2024-09-17T05:42:09.909 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:09.906+0000 7fe9616ec640 1 -- 172.21.15.150:0/2992517968 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe95c14f830 msgr2=0x7fe95c151050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:09.909 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:09.906+0000 7fe9616ec640 1 --2- 172.21.15.150:0/2992517968 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe95c14f830 0x7fe95c151050 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fe950006010 tx=0x7fe950003b90 comp rx=0 tx=0).stop 2024-09-17T05:42:09.909 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:09.906+0000 7fe9616ec640 1 -- 172.21.15.150:0/2992517968 shutdown_connections 2024-09-17T05:42:09.909 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:09.906+0000 7fe9616ec640 1 --2- 172.21.15.150:0/2992517968 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe95c0b3900 0x7fe95c150370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:09.909 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:09.906+0000 7fe9616ec640 1 --2- 172.21.15.150:0/2992517968 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fe948078b90 0x7fe94807b0a0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:09.909 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:09.906+0000 7fe9616ec640 1 --2- 172.21.15.150:0/2992517968 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe95c14f830 0x7fe95c151050 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:09.909 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:09.906+0000 7fe9616ec640 1 --2- 172.21.15.150:0/2992517968 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe95c0b34f0 0x7fe95c14fe30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:09.909 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:09.906+0000 7fe9616ec640 1 -- 172.21.15.150:0/2992517968 >> 172.21.15.150:0/2992517968 conn(0x7fe95c0b6640 msgr2=0x7fe95c0d1270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:42:09.909 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:09.906+0000 7fe9616ec640 1 -- 172.21.15.150:0/2992517968 shutdown_connections 2024-09-17T05:42:09.909 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:09.906+0000 7fe9616ec640 1 -- 172.21.15.150:0/2992517968 wait complete. 2024-09-17T05:42:09.915 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509448 got 64424509448 for osd.2 2024-09-17T05:42:09.915 DEBUG:teuthology.parallel:result is None 2024-09-17T05:42:09.919 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574856 for osd.0 2024-09-17T05:42:09.919 DEBUG:teuthology.parallel:result is None 2024-09-17T05:42:09.919 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-17T05:42:09.920 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-17T05:42:10.072 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:10.070+0000 7f4900c7e640 1 -- 172.21.15.150:0/2301505783 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f48fc0b4110 msgr2=0x7f48fc06fe70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:10.072 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:10.070+0000 7f4900c7e640 1 --2- 172.21.15.150:0/2301505783 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f48fc0b4110 0x7f48fc06fe70 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f48fc06dd20 tx=0x7f48f402a4a0 comp rx=0 tx=0).stop 2024-09-17T05:42:10.072 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:10.070+0000 7f4900c7e640 1 -- 172.21.15.150:0/2301505783 shutdown_connections 2024-09-17T05:42:10.072 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:10.070+0000 7f4900c7e640 1 --2- 172.21.15.150:0/2301505783 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f48fc0b4110 0x7f48fc06fe70 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:10.072 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:10.070+0000 7f4900c7e640 1 --2- 172.21.15.150:0/2301505783 >> v2:172.21.15.176:3300/0 conn(0x7f48fc0707b0 0x7f48fc06f930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:10.072 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:10.070+0000 7f4900c7e640 1 -- 172.21.15.150:0/2301505783 >> 172.21.15.150:0/2301505783 conn(0x7f48fc06d730 msgr2=0x7f48fc0b1e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:42:10.073 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:10.070+0000 7f4900c7e640 1 -- 172.21.15.150:0/2301505783 shutdown_connections 2024-09-17T05:42:10.073 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:10.070+0000 7f4900c7e640 1 -- 172.21.15.150:0/2301505783 wait complete. 2024-09-17T05:42:10.073 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:10.072+0000 7f4900c7e640 1 Processor -- start 2024-09-17T05:42:10.073 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:10.072+0000 7f4900c7e640 1 -- start start 2024-09-17T05:42:10.077 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:10.073+0000 7f4900c7e640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f48fc0707b0 0x7f48fc145670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:42:10.077 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:10.073+0000 7f4900c7e640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f48fc0730b0 0x7f48fc157720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:42:10.077 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:10.073+0000 7f4900c7e640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f48fc0b4110 0x7f48fc1f9970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:42:10.077 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:10.073+0000 7f4900c7e640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f48fc15f130 con 0x7f48fc0730b0 2024-09-17T05:42:10.077 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:10.073+0000 7f4900c7e640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f48fc15b2b0 con 0x7f48fc0b4110 2024-09-17T05:42:10.077 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:10.073+0000 7f4900c7e640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f48fc15f2b0 con 0x7f48fc0707b0 2024-09-17T05:42:10.077 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:10.073+0000 7f48f9d9b640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f48fc0730b0 0x7f48fc157720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:42:10.077 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:10.073+0000 7f48f9d9b640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f48fc0730b0 0x7f48fc157720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:54854/0 (socket says 172.21.15.150:54854) 2024-09-17T05:42:10.077 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:10.073+0000 7f48f9d9b640 1 -- 172.21.15.150:0/924773591 learned_addr learned my addr 172.21.15.150:0/924773591 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:42:10.077 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:10.073+0000 7f48fad9d640 1 --2- 172.21.15.150:0/924773591 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f48fc0b4110 0x7f48fc1f9970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:42:10.078 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:10.074+0000 7f48fa59c640 1 --2- 172.21.15.150:0/924773591 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f48fc0707b0 0x7f48fc145670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:42:10.078 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:10.074+0000 7f48f9d9b640 1 -- 172.21.15.150:0/924773591 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f48fc0707b0 msgr2=0x7f48fc145670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:10.078 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:10.074+0000 7f48f9d9b640 1 --2- 172.21.15.150:0/924773591 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f48fc0707b0 0x7f48fc145670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:10.078 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:10.074+0000 7f48f9d9b640 1 -- 172.21.15.150:0/924773591 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f48fc0b4110 msgr2=0x7f48fc1f9970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:10.078 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:10.074+0000 7f48f9d9b640 1 --2- 172.21.15.150:0/924773591 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f48fc0b4110 0x7f48fc1f9970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:10.078 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:10.074+0000 7f48f9d9b640 1 -- 172.21.15.150:0/924773591 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f48fc0cf640 con 0x7f48fc0730b0 2024-09-17T05:42:10.078 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:10.074+0000 7f48f9d9b640 1 --2- 172.21.15.150:0/924773591 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f48fc0730b0 0x7f48fc157720 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f48e400c3f0 tx=0x7f48e400c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:42:10.078 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:10.074+0000 7f48f2ffd640 1 -- 172.21.15.150:0/924773591 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48e4017070 con 0x7f48fc0730b0 2024-09-17T05:42:10.078 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:10.074+0000 7f48f2ffd640 1 -- 172.21.15.150:0/924773591 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f48e40035f0 con 0x7f48fc0730b0 2024-09-17T05:42:10.078 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:10.074+0000 7f48f2ffd640 1 -- 172.21.15.150:0/924773591 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48e4003a40 con 0x7f48fc0730b0 2024-09-17T05:42:10.078 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:10.074+0000 7f4900c7e640 1 -- 172.21.15.150:0/924773591 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f48fc0cfde0 con 0x7f48fc0730b0 2024-09-17T05:42:10.078 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:10.074+0000 7f4900c7e640 1 -- 172.21.15.150:0/924773591 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f48fc14dc50 con 0x7f48fc0730b0 2024-09-17T05:42:10.078 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:10.075+0000 7f4900c7e640 1 -- 172.21.15.150:0/924773591 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f48fc0cfb70 con 0x7f48fc0730b0 2024-09-17T05:42:10.079 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:10.076+0000 7f48f2ffd640 1 -- 172.21.15.150:0/924773591 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f48e401a070 con 0x7f48fc0730b0 2024-09-17T05:42:10.079 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:10.076+0000 7f48f2ffd640 1 --2- 172.21.15.150:0/924773591 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f48dc078bc0 0x7f48dc07b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:42:10.080 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:10.077+0000 7f48f2ffd640 1 -- 172.21.15.150:0/924773591 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f48e4099e90 con 0x7f48fc0730b0 2024-09-17T05:42:10.080 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:10.077+0000 7f48fa59c640 1 --2- 172.21.15.150:0/924773591 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f48dc078bc0 0x7f48dc07b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:42:10.080 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:10.078+0000 7f48fa59c640 1 --2- 172.21.15.150:0/924773591 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f48dc078bc0 0x7f48dc07b0d0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f48fc0b4630 tx=0x7f48ec0095d0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:42:10.082 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:10.081+0000 7f48f2ffd640 1 -- 172.21.15.150:0/924773591 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f48e4061dd0 con 0x7f48fc0730b0 2024-09-17T05:42:10.252 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:10.251+0000 7f4900c7e640 1 -- 172.21.15.150:0/924773591 --> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f48fc0cf810 con 0x7f48dc078bc0 2024-09-17T05:42:10.257 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:10.255+0000 7f48f2ffd640 1 -- 172.21.15.150:0/924773591 <== mgr.4108 v2:172.21.15.176:6800/3631216395 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251825 (secure 0 0 0) 0x7f48fc0cf810 con 0x7f48dc078bc0 2024-09-17T05:42:10.260 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-09-17T05:42:10.261 INFO:teuthology.orchestra.run.smithi150.stderr:dumped all 2024-09-17T05:42:10.262 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:10.259+0000 7f4900c7e640 1 -- 172.21.15.150:0/924773591 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f48dc078bc0 msgr2=0x7f48dc07b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:10.263 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:10.259+0000 7f4900c7e640 1 --2- 172.21.15.150:0/924773591 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f48dc078bc0 0x7f48dc07b0d0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f48fc0b4630 tx=0x7f48ec0095d0 comp rx=0 tx=0).stop 2024-09-17T05:42:10.263 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:10.259+0000 7f4900c7e640 1 -- 172.21.15.150:0/924773591 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f48fc0730b0 msgr2=0x7f48fc157720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:10.263 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:10.259+0000 7f4900c7e640 1 --2- 172.21.15.150:0/924773591 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f48fc0730b0 0x7f48fc157720 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f48e400c3f0 tx=0x7f48e400c8b0 comp rx=0 tx=0).stop 2024-09-17T05:42:10.263 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:10.259+0000 7f4900c7e640 1 -- 172.21.15.150:0/924773591 shutdown_connections 2024-09-17T05:42:10.263 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:10.259+0000 7f4900c7e640 1 --2- 172.21.15.150:0/924773591 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f48fc0b4110 0x7f48fc1f9970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:10.263 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:10.259+0000 7f4900c7e640 1 --2- 172.21.15.150:0/924773591 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f48dc078bc0 0x7f48dc07b0d0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:10.263 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:10.259+0000 7f4900c7e640 1 --2- 172.21.15.150:0/924773591 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f48fc0730b0 0x7f48fc157720 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:10.263 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:10.259+0000 7f4900c7e640 1 --2- 172.21.15.150:0/924773591 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f48fc0707b0 0x7f48fc145670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:10.263 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:10.259+0000 7f4900c7e640 1 -- 172.21.15.150:0/924773591 >> 172.21.15.150:0/924773591 conn(0x7f48fc06d730 msgr2=0x7f48fc0af3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:42:10.263 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:10.259+0000 7f4900c7e640 1 -- 172.21.15.150:0/924773591 shutdown_connections 2024-09-17T05:42:10.263 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:10.259+0000 7f4900c7e640 1 -- 172.21.15.150:0/924773591 wait complete. 2024-09-17T05:42:10.271 INFO:teuthology.orchestra.run.smithi150.stdout:{"pg_ready":true,"pg_map":{"version":29,"stamp":"2024-09-17T05:42:08.846722+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":146,"num_write_kb":1642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":111,"ondisk_log_size":111,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219284,"kb_used_data":3048,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755436,"statfs":{"total":773094113280,"available":772869566464,"internally_reserved":0,"allocated":3121152,"data_stored":1840172,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":1794,"num_objects":18,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":38,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":12,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"10.002543"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T05:41:59.475666+0000","last_change":"2024-09-17T05:41:57.959035+0000","last_active":"2024-09-17T05:41:59.475666+0000","last_peered":"2024-09-17T05:41:59.475666+0000","last_clean":"2024-09-17T05:41:59.475666+0000","last_became_active":"2024-09-17T05:41:57.958686+0000","last_became_peered":"2024-09-17T05:41:57.958686+0000","last_unstale":"2024-09-17T05:41:59.475666+0000","last_undegraded":"2024-09-17T05:41:59.475666+0000","last_fullsized":"2024-09-17T05:41:59.475666+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_clean_scrub_stamp":"2024-09-17T05:41:56.913963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:20:54.930864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T05:41:59.474653+0000","last_change":"2024-09-17T05:41:57.949203+0000","last_active":"2024-09-17T05:41:59.474653+0000","last_peered":"2024-09-17T05:41:59.474653+0000","last_clean":"2024-09-17T05:41:59.474653+0000","last_became_active":"2024-09-17T05:41:57.948887+0000","last_became_peered":"2024-09-17T05:41:57.948887+0000","last_unstale":"2024-09-17T05:41:59.474653+0000","last_undegraded":"2024-09-17T05:41:59.474653+0000","last_fullsized":"2024-09-17T05:41:59.474653+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_clean_scrub_stamp":"2024-09-17T05:41:56.913963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:58:14.523021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T05:41:59.474467+0000","last_change":"2024-09-17T05:41:57.935841+0000","last_active":"2024-09-17T05:41:59.474467+0000","last_peered":"2024-09-17T05:41:59.474467+0000","last_clean":"2024-09-17T05:41:59.474467+0000","last_became_active":"2024-09-17T05:41:57.935502+0000","last_became_peered":"2024-09-17T05:41:57.935502+0000","last_unstale":"2024-09-17T05:41:59.474467+0000","last_undegraded":"2024-09-17T05:41:59.474467+0000","last_fullsized":"2024-09-17T05:41:59.474467+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_clean_scrub_stamp":"2024-09-17T05:41:56.913963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:52:29.444374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T05:41:58.944866+0000","last_change":"2024-09-17T05:41:57.961231+0000","last_active":"2024-09-17T05:41:58.944866+0000","last_peered":"2024-09-17T05:41:58.944866+0000","last_clean":"2024-09-17T05:41:58.944866+0000","last_became_active":"2024-09-17T05:41:57.959741+0000","last_became_peered":"2024-09-17T05:41:57.959741+0000","last_unstale":"2024-09-17T05:41:58.944866+0000","last_undegraded":"2024-09-17T05:41:58.944866+0000","last_fullsized":"2024-09-17T05:41:58.944866+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_clean_scrub_stamp":"2024-09-17T05:41:56.913963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:52:28.863641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T05:41:59.475026+0000","last_change":"2024-09-17T05:41:57.948142+0000","last_active":"2024-09-17T05:41:59.475026+0000","last_peered":"2024-09-17T05:41:59.475026+0000","last_clean":"2024-09-17T05:41:59.475026+0000","last_became_active":"2024-09-17T05:41:57.947736+0000","last_became_peered":"2024-09-17T05:41:57.947736+0000","last_unstale":"2024-09-17T05:41:59.475026+0000","last_undegraded":"2024-09-17T05:41:59.475026+0000","last_fullsized":"2024-09-17T05:41:59.475026+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_clean_scrub_stamp":"2024-09-17T05:41:56.913963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:25:08.628947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T05:41:58.944771+0000","last_change":"2024-09-17T05:41:57.962298+0000","last_active":"2024-09-17T05:41:58.944771+0000","last_peered":"2024-09-17T05:41:58.944771+0000","last_clean":"2024-09-17T05:41:58.944771+0000","last_became_active":"2024-09-17T05:41:57.961827+0000","last_became_peered":"2024-09-17T05:41:57.961827+0000","last_unstale":"2024-09-17T05:41:58.944771+0000","last_undegraded":"2024-09-17T05:41:58.944771+0000","last_fullsized":"2024-09-17T05:41:58.944771+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_clean_scrub_stamp":"2024-09-17T05:41:56.913963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:05:25.111036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T05:41:59.474925+0000","last_change":"2024-09-17T05:41:57.962591+0000","last_active":"2024-09-17T05:41:59.474925+0000","last_peered":"2024-09-17T05:41:59.474925+0000","last_clean":"2024-09-17T05:41:59.474925+0000","last_became_active":"2024-09-17T05:41:57.962277+0000","last_became_peered":"2024-09-17T05:41:57.962277+0000","last_unstale":"2024-09-17T05:41:59.474925+0000","last_undegraded":"2024-09-17T05:41:59.474925+0000","last_fullsized":"2024-09-17T05:41:59.474925+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_clean_scrub_stamp":"2024-09-17T05:41:56.913963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:52:28.863641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T05:41:58.942251+0000","last_change":"2024-09-17T05:41:57.952162+0000","last_active":"2024-09-17T05:41:58.942251+0000","last_peered":"2024-09-17T05:41:58.942251+0000","last_clean":"2024-09-17T05:41:58.942251+0000","last_became_active":"2024-09-17T05:41:57.951848+0000","last_became_peered":"2024-09-17T05:41:57.951848+0000","last_unstale":"2024-09-17T05:41:58.942251+0000","last_undegraded":"2024-09-17T05:41:58.942251+0000","last_fullsized":"2024-09-17T05:41:58.942251+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_clean_scrub_stamp":"2024-09-17T05:41:56.913963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:32:07.051277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T05:41:59.475711+0000","last_change":"2024-09-17T05:41:57.957295+0000","last_active":"2024-09-17T05:41:59.475711+0000","last_peered":"2024-09-17T05:41:59.475711+0000","last_clean":"2024-09-17T05:41:59.475711+0000","last_became_active":"2024-09-17T05:41:57.956917+0000","last_became_peered":"2024-09-17T05:41:57.956917+0000","last_unstale":"2024-09-17T05:41:59.475711+0000","last_undegraded":"2024-09-17T05:41:59.475711+0000","last_fullsized":"2024-09-17T05:41:59.475711+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_clean_scrub_stamp":"2024-09-17T05:41:56.913963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:18:41.669507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T05:41:58.944176+0000","last_change":"2024-09-17T05:41:57.956487+0000","last_active":"2024-09-17T05:41:58.944176+0000","last_peered":"2024-09-17T05:41:58.944176+0000","last_clean":"2024-09-17T05:41:58.944176+0000","last_became_active":"2024-09-17T05:41:57.956139+0000","last_became_peered":"2024-09-17T05:41:57.956139+0000","last_unstale":"2024-09-17T05:41:58.944176+0000","last_undegraded":"2024-09-17T05:41:58.944176+0000","last_fullsized":"2024-09-17T05:41:58.944176+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_clean_scrub_stamp":"2024-09-17T05:41:56.913963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:11:06.285537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T05:41:58.943506+0000","last_change":"2024-09-17T05:41:57.953158+0000","last_active":"2024-09-17T05:41:58.943506+0000","last_peered":"2024-09-17T05:41:58.943506+0000","last_clean":"2024-09-17T05:41:58.943506+0000","last_became_active":"2024-09-17T05:41:57.952871+0000","last_became_peered":"2024-09-17T05:41:57.952871+0000","last_unstale":"2024-09-17T05:41:58.943506+0000","last_undegraded":"2024-09-17T05:41:58.943506+0000","last_fullsized":"2024-09-17T05:41:58.943506+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_clean_scrub_stamp":"2024-09-17T05:41:56.913963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:52:02.839445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T05:41:59.016408+0000","last_change":"2024-09-17T05:41:57.956110+0000","last_active":"2024-09-17T05:41:59.016408+0000","last_peered":"2024-09-17T05:41:59.016408+0000","last_clean":"2024-09-17T05:41:59.016408+0000","last_became_active":"2024-09-17T05:41:57.955123+0000","last_became_peered":"2024-09-17T05:41:57.955123+0000","last_unstale":"2024-09-17T05:41:59.016408+0000","last_undegraded":"2024-09-17T05:41:59.016408+0000","last_fullsized":"2024-09-17T05:41:59.016408+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_clean_scrub_stamp":"2024-09-17T05:41:56.913963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:10:39.584426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T05:41:58.942679+0000","last_change":"2024-09-17T05:41:57.946022+0000","last_active":"2024-09-17T05:41:58.942679+0000","last_peered":"2024-09-17T05:41:58.942679+0000","last_clean":"2024-09-17T05:41:58.942679+0000","last_became_active":"2024-09-17T05:41:57.945669+0000","last_became_peered":"2024-09-17T05:41:57.945669+0000","last_unstale":"2024-09-17T05:41:58.942679+0000","last_undegraded":"2024-09-17T05:41:58.942679+0000","last_fullsized":"2024-09-17T05:41:58.942679+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_clean_scrub_stamp":"2024-09-17T05:41:56.913963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:38:43.072798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T05:41:59.474646+0000","last_change":"2024-09-17T05:41:57.950142+0000","last_active":"2024-09-17T05:41:59.474646+0000","last_peered":"2024-09-17T05:41:59.474646+0000","last_clean":"2024-09-17T05:41:59.474646+0000","last_became_active":"2024-09-17T05:41:57.949825+0000","last_became_peered":"2024-09-17T05:41:57.949825+0000","last_unstale":"2024-09-17T05:41:59.474646+0000","last_undegraded":"2024-09-17T05:41:59.474646+0000","last_fullsized":"2024-09-17T05:41:59.474646+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_clean_scrub_stamp":"2024-09-17T05:41:56.913963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:50:10.770545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T05:41:59.474168+0000","last_change":"2024-09-17T05:41:57.952716+0000","last_active":"2024-09-17T05:41:59.474168+0000","last_peered":"2024-09-17T05:41:59.474168+0000","last_clean":"2024-09-17T05:41:59.474168+0000","last_became_active":"2024-09-17T05:41:57.952394+0000","last_became_peered":"2024-09-17T05:41:57.952394+0000","last_unstale":"2024-09-17T05:41:59.474168+0000","last_undegraded":"2024-09-17T05:41:59.474168+0000","last_fullsized":"2024-09-17T05:41:59.474168+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_clean_scrub_stamp":"2024-09-17T05:41:56.913963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:29:37.607962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T05:41:58.944411+0000","last_change":"2024-09-17T05:41:57.960244+0000","last_active":"2024-09-17T05:41:58.944411+0000","last_peered":"2024-09-17T05:41:58.944411+0000","last_clean":"2024-09-17T05:41:58.944411+0000","last_became_active":"2024-09-17T05:41:57.959886+0000","last_became_peered":"2024-09-17T05:41:57.959886+0000","last_unstale":"2024-09-17T05:41:58.944411+0000","last_undegraded":"2024-09-17T05:41:58.944411+0000","last_fullsized":"2024-09-17T05:41:58.944411+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_clean_scrub_stamp":"2024-09-17T05:41:56.913963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:28:48.325328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T05:41:58.945844+0000","last_change":"2024-09-17T05:41:57.949489+0000","last_active":"2024-09-17T05:41:58.945844+0000","last_peered":"2024-09-17T05:41:58.945844+0000","last_clean":"2024-09-17T05:41:58.945844+0000","last_became_active":"2024-09-17T05:41:57.949140+0000","last_became_peered":"2024-09-17T05:41:57.949140+0000","last_unstale":"2024-09-17T05:41:58.945844+0000","last_undegraded":"2024-09-17T05:41:58.945844+0000","last_fullsized":"2024-09-17T05:41:58.945844+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_clean_scrub_stamp":"2024-09-17T05:41:56.913963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:51:10.975005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T05:41:59.439183+0000","last_change":"2024-09-17T05:41:57.958252+0000","last_active":"2024-09-17T05:41:59.439183+0000","last_peered":"2024-09-17T05:41:59.439183+0000","last_clean":"2024-09-17T05:41:59.439183+0000","last_became_active":"2024-09-17T05:41:57.957880+0000","last_became_peered":"2024-09-17T05:41:57.957880+0000","last_unstale":"2024-09-17T05:41:59.439183+0000","last_undegraded":"2024-09-17T05:41:59.439183+0000","last_fullsized":"2024-09-17T05:41:59.439183+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_clean_scrub_stamp":"2024-09-17T05:41:56.913963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:47:33.448576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T05:41:59.475674+0000","last_change":"2024-09-17T05:41:57.953128+0000","last_active":"2024-09-17T05:41:59.475674+0000","last_peered":"2024-09-17T05:41:59.475674+0000","last_clean":"2024-09-17T05:41:59.475674+0000","last_became_active":"2024-09-17T05:41:57.952806+0000","last_became_peered":"2024-09-17T05:41:57.952806+0000","last_unstale":"2024-09-17T05:41:59.475674+0000","last_undegraded":"2024-09-17T05:41:59.475674+0000","last_fullsized":"2024-09-17T05:41:59.475674+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_clean_scrub_stamp":"2024-09-17T05:41:56.913963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:51:10.975005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T05:41:58.943895+0000","last_change":"2024-09-17T05:41:57.960997+0000","last_active":"2024-09-17T05:41:58.943895+0000","last_peered":"2024-09-17T05:41:58.943895+0000","last_clean":"2024-09-17T05:41:58.943895+0000","last_became_active":"2024-09-17T05:41:57.960632+0000","last_became_peered":"2024-09-17T05:41:57.960632+0000","last_unstale":"2024-09-17T05:41:58.943895+0000","last_undegraded":"2024-09-17T05:41:58.943895+0000","last_fullsized":"2024-09-17T05:41:58.943895+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_clean_scrub_stamp":"2024-09-17T05:41:56.913963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:08:48.763013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T05:41:59.474890+0000","last_change":"2024-09-17T05:41:57.952830+0000","last_active":"2024-09-17T05:41:59.474890+0000","last_peered":"2024-09-17T05:41:59.474890+0000","last_clean":"2024-09-17T05:41:59.474890+0000","last_became_active":"2024-09-17T05:41:57.952504+0000","last_became_peered":"2024-09-17T05:41:57.952504+0000","last_unstale":"2024-09-17T05:41:59.474890+0000","last_undegraded":"2024-09-17T05:41:59.474890+0000","last_fullsized":"2024-09-17T05:41:59.474890+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_clean_scrub_stamp":"2024-09-17T05:41:56.913963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:31:01.180867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T05:41:58.944890+0000","last_change":"2024-09-17T05:41:57.959379+0000","last_active":"2024-09-17T05:41:58.944890+0000","last_peered":"2024-09-17T05:41:58.944890+0000","last_clean":"2024-09-17T05:41:58.944890+0000","last_became_active":"2024-09-17T05:41:57.956766+0000","last_became_peered":"2024-09-17T05:41:57.956766+0000","last_unstale":"2024-09-17T05:41:58.944890+0000","last_undegraded":"2024-09-17T05:41:58.944890+0000","last_fullsized":"2024-09-17T05:41:58.944890+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_clean_scrub_stamp":"2024-09-17T05:41:56.913963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:19:32.094334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T05:41:58.942336+0000","last_change":"2024-09-17T05:41:57.933829+0000","last_active":"2024-09-17T05:41:58.942336+0000","last_peered":"2024-09-17T05:41:58.942336+0000","last_clean":"2024-09-17T05:41:58.942336+0000","last_became_active":"2024-09-17T05:41:57.933493+0000","last_became_peered":"2024-09-17T05:41:57.933493+0000","last_unstale":"2024-09-17T05:41:58.942336+0000","last_undegraded":"2024-09-17T05:41:58.942336+0000","last_fullsized":"2024-09-17T05:41:58.942336+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_clean_scrub_stamp":"2024-09-17T05:41:56.913963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:47:26.590424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T05:41:58.944662+0000","last_change":"2024-09-17T05:41:57.956168+0000","last_active":"2024-09-17T05:41:58.944662+0000","last_peered":"2024-09-17T05:41:58.944662+0000","last_clean":"2024-09-17T05:41:58.944662+0000","last_became_active":"2024-09-17T05:41:57.955795+0000","last_became_peered":"2024-09-17T05:41:57.955795+0000","last_unstale":"2024-09-17T05:41:58.944662+0000","last_undegraded":"2024-09-17T05:41:58.944662+0000","last_fullsized":"2024-09-17T05:41:58.944662+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_clean_scrub_stamp":"2024-09-17T05:41:56.913963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:58:14.523021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T05:41:58.942694+0000","last_change":"2024-09-17T05:41:57.935453+0000","last_active":"2024-09-17T05:41:58.942694+0000","last_peered":"2024-09-17T05:41:58.942694+0000","last_clean":"2024-09-17T05:41:58.942694+0000","last_became_active":"2024-09-17T05:41:57.935059+0000","last_became_peered":"2024-09-17T05:41:57.935059+0000","last_unstale":"2024-09-17T05:41:58.942694+0000","last_undegraded":"2024-09-17T05:41:58.942694+0000","last_fullsized":"2024-09-17T05:41:58.942694+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_clean_scrub_stamp":"2024-09-17T05:41:56.913963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:28:48.325328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T05:41:58.943835+0000","last_change":"2024-09-17T05:41:57.953726+0000","last_active":"2024-09-17T05:41:58.943835+0000","last_peered":"2024-09-17T05:41:58.943835+0000","last_clean":"2024-09-17T05:41:58.943835+0000","last_became_active":"2024-09-17T05:41:57.953078+0000","last_became_peered":"2024-09-17T05:41:57.953078+0000","last_unstale":"2024-09-17T05:41:58.943835+0000","last_undegraded":"2024-09-17T05:41:58.943835+0000","last_fullsized":"2024-09-17T05:41:58.943835+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_clean_scrub_stamp":"2024-09-17T05:41:56.913963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:25:59.519887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T05:41:59.474493+0000","last_change":"2024-09-17T05:41:57.957328+0000","last_active":"2024-09-17T05:41:59.474493+0000","last_peered":"2024-09-17T05:41:59.474493+0000","last_clean":"2024-09-17T05:41:59.474493+0000","last_became_active":"2024-09-17T05:41:57.956969+0000","last_became_peered":"2024-09-17T05:41:57.956969+0000","last_unstale":"2024-09-17T05:41:59.474493+0000","last_undegraded":"2024-09-17T05:41:59.474493+0000","last_fullsized":"2024-09-17T05:41:59.474493+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_clean_scrub_stamp":"2024-09-17T05:41:56.913963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:28:48.325328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T05:41:58.943020+0000","last_change":"2024-09-17T05:41:57.934895+0000","last_active":"2024-09-17T05:41:58.943020+0000","last_peered":"2024-09-17T05:41:58.943020+0000","last_clean":"2024-09-17T05:41:58.943020+0000","last_became_active":"2024-09-17T05:41:57.934411+0000","last_became_peered":"2024-09-17T05:41:57.934411+0000","last_unstale":"2024-09-17T05:41:58.943020+0000","last_undegraded":"2024-09-17T05:41:58.943020+0000","last_fullsized":"2024-09-17T05:41:58.943020+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_clean_scrub_stamp":"2024-09-17T05:41:56.913963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:25:08.628947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T05:41:59.474943+0000","last_change":"2024-09-17T05:41:57.948114+0000","last_active":"2024-09-17T05:41:59.474943+0000","last_peered":"2024-09-17T05:41:59.474943+0000","last_clean":"2024-09-17T05:41:59.474943+0000","last_became_active":"2024-09-17T05:41:57.947671+0000","last_became_peered":"2024-09-17T05:41:57.947671+0000","last_unstale":"2024-09-17T05:41:59.474943+0000","last_undegraded":"2024-09-17T05:41:59.474943+0000","last_fullsized":"2024-09-17T05:41:59.474943+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_clean_scrub_stamp":"2024-09-17T05:41:56.913963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:39:02.325349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T05:41:58.945079+0000","last_change":"2024-09-17T05:41:57.960551+0000","last_active":"2024-09-17T05:41:58.945079+0000","last_peered":"2024-09-17T05:41:58.945079+0000","last_clean":"2024-09-17T05:41:58.945079+0000","last_became_active":"2024-09-17T05:41:57.959025+0000","last_became_peered":"2024-09-17T05:41:57.959025+0000","last_unstale":"2024-09-17T05:41:58.945079+0000","last_undegraded":"2024-09-17T05:41:58.945079+0000","last_fullsized":"2024-09-17T05:41:58.945079+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_clean_scrub_stamp":"2024-09-17T05:41:56.913963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:25:08.628947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T05:41:59.439140+0000","last_change":"2024-09-17T05:41:57.944300+0000","last_active":"2024-09-17T05:41:59.439140+0000","last_peered":"2024-09-17T05:41:59.439140+0000","last_clean":"2024-09-17T05:41:59.439140+0000","last_became_active":"2024-09-17T05:41:57.943968+0000","last_became_peered":"2024-09-17T05:41:57.943968+0000","last_unstale":"2024-09-17T05:41:59.439140+0000","last_undegraded":"2024-09-17T05:41:59.439140+0000","last_fullsized":"2024-09-17T05:41:59.439140+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_clean_scrub_stamp":"2024-09-17T05:41:56.913963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:10:39.584426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T05:41:58.943325+0000","last_change":"2024-09-17T05:41:57.961208+0000","last_active":"2024-09-17T05:41:58.943325+0000","last_peered":"2024-09-17T05:41:58.943325+0000","last_clean":"2024-09-17T05:41:58.943325+0000","last_became_active":"2024-09-17T05:41:57.960878+0000","last_became_peered":"2024-09-17T05:41:57.960878+0000","last_unstale":"2024-09-17T05:41:58.943325+0000","last_undegraded":"2024-09-17T05:41:58.943325+0000","last_fullsized":"2024-09-17T05:41:58.943325+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_clean_scrub_stamp":"2024-09-17T05:41:56.913963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:12:19.292703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T05:41:59.016320+0000","last_change":"2024-09-17T05:41:57.941348+0000","last_active":"2024-09-17T05:41:59.016320+0000","last_peered":"2024-09-17T05:41:59.016320+0000","last_clean":"2024-09-17T05:41:59.016320+0000","last_became_active":"2024-09-17T05:41:57.940996+0000","last_became_peered":"2024-09-17T05:41:57.940996+0000","last_unstale":"2024-09-17T05:41:59.016320+0000","last_undegraded":"2024-09-17T05:41:59.016320+0000","last_fullsized":"2024-09-17T05:41:59.016320+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_clean_scrub_stamp":"2024-09-17T05:41:56.913963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:16:33.582921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"22'1","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T05:41:58.942753+0000","last_change":"2024-09-17T05:41:56.942225+0000","last_active":"2024-09-17T05:41:58.942753+0000","last_peered":"2024-09-17T05:41:58.942753+0000","last_clean":"2024-09-17T05:41:58.942753+0000","last_became_active":"2024-09-17T05:41:56.941896+0000","last_became_peered":"2024-09-17T05:41:56.941896+0000","last_unstale":"2024-09-17T05:41:58.942753+0000","last_undegraded":"2024-09-17T05:41:58.942753+0000","last_fullsized":"2024-09-17T05:41:58.942753+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:55.904533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:55.904533+0000","last_clean_scrub_stamp":"2024-09-17T05:41:55.904533+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:52:11.112857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T05:41:59.475111+0000","last_change":"2024-09-17T05:41:57.943603+0000","last_active":"2024-09-17T05:41:59.475111+0000","last_peered":"2024-09-17T05:41:59.475111+0000","last_clean":"2024-09-17T05:41:59.475111+0000","last_became_active":"2024-09-17T05:41:57.942873+0000","last_became_peered":"2024-09-17T05:41:57.942873+0000","last_unstale":"2024-09-17T05:41:59.475111+0000","last_undegraded":"2024-09-17T05:41:59.475111+0000","last_fullsized":"2024-09-17T05:41:59.475111+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_clean_scrub_stamp":"2024-09-17T05:41:56.913963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:09:10.790006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"22'1","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T05:41:58.943600+0000","last_change":"2024-09-17T05:41:56.940706+0000","last_active":"2024-09-17T05:41:58.943600+0000","last_peered":"2024-09-17T05:41:58.943600+0000","last_clean":"2024-09-17T05:41:58.943600+0000","last_became_active":"2024-09-17T05:41:56.940324+0000","last_became_peered":"2024-09-17T05:41:56.940324+0000","last_unstale":"2024-09-17T05:41:58.943600+0000","last_undegraded":"2024-09-17T05:41:58.943600+0000","last_fullsized":"2024-09-17T05:41:58.943600+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:55.904533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:55.904533+0000","last_clean_scrub_stamp":"2024-09-17T05:41:55.904533+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:58:41.828120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T05:41:58.942401+0000","last_change":"2024-09-17T05:41:56.941270+0000","last_active":"2024-09-17T05:41:58.942401+0000","last_peered":"2024-09-17T05:41:58.942401+0000","last_clean":"2024-09-17T05:41:58.942401+0000","last_became_active":"2024-09-17T05:41:56.940963+0000","last_became_peered":"2024-09-17T05:41:56.940963+0000","last_unstale":"2024-09-17T05:41:58.942401+0000","last_undegraded":"2024-09-17T05:41:58.942401+0000","last_fullsized":"2024-09-17T05:41:58.942401+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:55.904533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:55.904533+0000","last_clean_scrub_stamp":"2024-09-17T05:41:55.904533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:05:42.524613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T05:41:58.942321+0000","last_change":"2024-09-17T05:41:57.945651+0000","last_active":"2024-09-17T05:41:58.942321+0000","last_peered":"2024-09-17T05:41:58.942321+0000","last_clean":"2024-09-17T05:41:58.942321+0000","last_became_active":"2024-09-17T05:41:57.945322+0000","last_became_peered":"2024-09-17T05:41:57.945322+0000","last_unstale":"2024-09-17T05:41:58.942321+0000","last_undegraded":"2024-09-17T05:41:58.942321+0000","last_fullsized":"2024-09-17T05:41:58.942321+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_clean_scrub_stamp":"2024-09-17T05:41:56.913963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:29:37.607962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T05:41:58.944500+0000","last_change":"2024-09-17T05:41:56.937560+0000","last_active":"2024-09-17T05:41:58.944500+0000","last_peered":"2024-09-17T05:41:58.944500+0000","last_clean":"2024-09-17T05:41:58.944500+0000","last_became_active":"2024-09-17T05:41:56.937222+0000","last_became_peered":"2024-09-17T05:41:56.937222+0000","last_unstale":"2024-09-17T05:41:58.944500+0000","last_undegraded":"2024-09-17T05:41:58.944500+0000","last_fullsized":"2024-09-17T05:41:58.944500+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:55.904533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:55.904533+0000","last_clean_scrub_stamp":"2024-09-17T05:41:55.904533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:44:48.206421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T05:41:59.474386+0000","last_change":"2024-09-17T05:41:57.956574+0000","last_active":"2024-09-17T05:41:59.474386+0000","last_peered":"2024-09-17T05:41:59.474386+0000","last_clean":"2024-09-17T05:41:59.474386+0000","last_became_active":"2024-09-17T05:41:57.956273+0000","last_became_peered":"2024-09-17T05:41:57.956273+0000","last_unstale":"2024-09-17T05:41:59.474386+0000","last_undegraded":"2024-09-17T05:41:59.474386+0000","last_fullsized":"2024-09-17T05:41:59.474386+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_clean_scrub_stamp":"2024-09-17T05:41:56.913963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:38:43.072798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T05:41:58.943638+0000","last_change":"2024-09-17T05:41:56.949682+0000","last_active":"2024-09-17T05:41:58.943638+0000","last_peered":"2024-09-17T05:41:58.943638+0000","last_clean":"2024-09-17T05:41:58.943638+0000","last_became_active":"2024-09-17T05:41:56.949271+0000","last_became_peered":"2024-09-17T05:41:56.949271+0000","last_unstale":"2024-09-17T05:41:58.943638+0000","last_undegraded":"2024-09-17T05:41:58.943638+0000","last_fullsized":"2024-09-17T05:41:58.943638+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:55.904533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:55.904533+0000","last_clean_scrub_stamp":"2024-09-17T05:41:55.904533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:54:22.588557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T05:41:58.945643+0000","last_change":"2024-09-17T05:41:57.950606+0000","last_active":"2024-09-17T05:41:58.945643+0000","last_peered":"2024-09-17T05:41:58.945643+0000","last_clean":"2024-09-17T05:41:58.945643+0000","last_became_active":"2024-09-17T05:41:57.950284+0000","last_became_peered":"2024-09-17T05:41:57.950284+0000","last_unstale":"2024-09-17T05:41:58.945643+0000","last_undegraded":"2024-09-17T05:41:58.945643+0000","last_fullsized":"2024-09-17T05:41:58.945643+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_clean_scrub_stamp":"2024-09-17T05:41:56.913963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:20:54.930864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T05:41:58.945336+0000","last_change":"2024-09-17T05:41:56.946865+0000","last_active":"2024-09-17T05:41:58.945336+0000","last_peered":"2024-09-17T05:41:58.945336+0000","last_clean":"2024-09-17T05:41:58.945336+0000","last_became_active":"2024-09-17T05:41:56.946178+0000","last_became_peered":"2024-09-17T05:41:56.946178+0000","last_unstale":"2024-09-17T05:41:58.945336+0000","last_undegraded":"2024-09-17T05:41:58.945336+0000","last_fullsized":"2024-09-17T05:41:58.945336+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:55.904533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:55.904533+0000","last_clean_scrub_stamp":"2024-09-17T05:41:55.904533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:13:02.431112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T05:41:59.475067+0000","last_change":"2024-09-17T05:41:57.948150+0000","last_active":"2024-09-17T05:41:59.475067+0000","last_peered":"2024-09-17T05:41:59.475067+0000","last_clean":"2024-09-17T05:41:59.475067+0000","last_became_active":"2024-09-17T05:41:57.947204+0000","last_became_peered":"2024-09-17T05:41:57.947204+0000","last_unstale":"2024-09-17T05:41:59.475067+0000","last_undegraded":"2024-09-17T05:41:59.475067+0000","last_fullsized":"2024-09-17T05:41:59.475067+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_clean_scrub_stamp":"2024-09-17T05:41:56.913963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:54:14.610066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"22'3","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T05:41:59.474459+0000","last_change":"2024-09-17T05:41:56.944839+0000","last_active":"2024-09-17T05:41:59.474459+0000","last_peered":"2024-09-17T05:41:59.474459+0000","last_clean":"2024-09-17T05:41:59.474459+0000","last_became_active":"2024-09-17T05:41:56.944471+0000","last_became_peered":"2024-09-17T05:41:56.944471+0000","last_unstale":"2024-09-17T05:41:59.474459+0000","last_undegraded":"2024-09-17T05:41:59.474459+0000","last_fullsized":"2024-09-17T05:41:59.474459+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:55.904533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:55.904533+0000","last_clean_scrub_stamp":"2024-09-17T05:41:55.904533+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:56:02.887851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T05:41:59.016465+0000","last_change":"2024-09-17T05:41:57.949459+0000","last_active":"2024-09-17T05:41:59.016465+0000","last_peered":"2024-09-17T05:41:59.016465+0000","last_clean":"2024-09-17T05:41:59.016465+0000","last_became_active":"2024-09-17T05:41:57.949148+0000","last_became_peered":"2024-09-17T05:41:57.949148+0000","last_unstale":"2024-09-17T05:41:59.016465+0000","last_undegraded":"2024-09-17T05:41:59.016465+0000","last_fullsized":"2024-09-17T05:41:59.016465+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_clean_scrub_stamp":"2024-09-17T05:41:56.913963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:47:33.448576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"22'6","reported_seq":21,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T05:41:58.943864+0000","last_change":"2024-09-17T05:41:56.951074+0000","last_active":"2024-09-17T05:41:58.943864+0000","last_peered":"2024-09-17T05:41:58.943864+0000","last_clean":"2024-09-17T05:41:58.943864+0000","last_became_active":"2024-09-17T05:41:56.950549+0000","last_became_peered":"2024-09-17T05:41:56.950549+0000","last_unstale":"2024-09-17T05:41:58.943864+0000","last_undegraded":"2024-09-17T05:41:58.943864+0000","last_fullsized":"2024-09-17T05:41:58.943864+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:55.904533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:55.904533+0000","last_clean_scrub_stamp":"2024-09-17T05:41:55.904533+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:07:52.122462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T05:41:59.475337+0000","last_change":"2024-09-17T05:41:57.951740+0000","last_active":"2024-09-17T05:41:59.475337+0000","last_peered":"2024-09-17T05:41:59.475337+0000","last_clean":"2024-09-17T05:41:59.475337+0000","last_became_active":"2024-09-17T05:41:57.949411+0000","last_became_peered":"2024-09-17T05:41:57.949411+0000","last_unstale":"2024-09-17T05:41:59.475337+0000","last_undegraded":"2024-09-17T05:41:59.475337+0000","last_fullsized":"2024-09-17T05:41:59.475337+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_clean_scrub_stamp":"2024-09-17T05:41:56.913963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:46:38.117672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"22'2","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T05:41:59.475117+0000","last_change":"2024-09-17T05:41:56.939288+0000","last_active":"2024-09-17T05:41:59.475117+0000","last_peered":"2024-09-17T05:41:59.475117+0000","last_clean":"2024-09-17T05:41:59.475117+0000","last_became_active":"2024-09-17T05:41:56.938951+0000","last_became_peered":"2024-09-17T05:41:56.938951+0000","last_unstale":"2024-09-17T05:41:59.475117+0000","last_undegraded":"2024-09-17T05:41:59.475117+0000","last_fullsized":"2024-09-17T05:41:59.475117+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:55.904533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:55.904533+0000","last_clean_scrub_stamp":"2024-09-17T05:41:55.904533+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:41:47.665206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T05:41:59.474748+0000","last_change":"2024-09-17T05:41:57.953556+0000","last_active":"2024-09-17T05:41:59.474748+0000","last_peered":"2024-09-17T05:41:59.474748+0000","last_clean":"2024-09-17T05:41:59.474748+0000","last_became_active":"2024-09-17T05:41:57.953229+0000","last_became_peered":"2024-09-17T05:41:57.953229+0000","last_unstale":"2024-09-17T05:41:59.474748+0000","last_undegraded":"2024-09-17T05:41:59.474748+0000","last_fullsized":"2024-09-17T05:41:59.474748+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_clean_scrub_stamp":"2024-09-17T05:41:56.913963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:57:29.940550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T05:41:58.944960+0000","last_change":"2024-09-17T05:41:56.951172+0000","last_active":"2024-09-17T05:41:58.944960+0000","last_peered":"2024-09-17T05:41:58.944960+0000","last_clean":"2024-09-17T05:41:58.944960+0000","last_became_active":"2024-09-17T05:41:56.950572+0000","last_became_peered":"2024-09-17T05:41:56.950572+0000","last_unstale":"2024-09-17T05:41:58.944960+0000","last_undegraded":"2024-09-17T05:41:58.944960+0000","last_fullsized":"2024-09-17T05:41:58.944960+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:55.904533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:55.904533+0000","last_clean_scrub_stamp":"2024-09-17T05:41:55.904533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:48:08.016947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T05:41:59.475097+0000","last_change":"2024-09-17T05:41:57.948898+0000","last_active":"2024-09-17T05:41:59.475097+0000","last_peered":"2024-09-17T05:41:59.475097+0000","last_clean":"2024-09-17T05:41:59.475097+0000","last_became_active":"2024-09-17T05:41:57.948128+0000","last_became_peered":"2024-09-17T05:41:57.948128+0000","last_unstale":"2024-09-17T05:41:59.475097+0000","last_undegraded":"2024-09-17T05:41:59.475097+0000","last_fullsized":"2024-09-17T05:41:59.475097+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_clean_scrub_stamp":"2024-09-17T05:41:56.913963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:48:25.095548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T05:41:58.943359+0000","last_change":"2024-09-17T05:41:56.946833+0000","last_active":"2024-09-17T05:41:58.943359+0000","last_peered":"2024-09-17T05:41:58.943359+0000","last_clean":"2024-09-17T05:41:58.943359+0000","last_became_active":"2024-09-17T05:41:56.946545+0000","last_became_peered":"2024-09-17T05:41:56.946545+0000","last_unstale":"2024-09-17T05:41:58.943359+0000","last_undegraded":"2024-09-17T05:41:58.943359+0000","last_fullsized":"2024-09-17T05:41:58.943359+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:55.904533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:55.904533+0000","last_clean_scrub_stamp":"2024-09-17T05:41:55.904533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:09:48.472258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T05:41:58.943449+0000","last_change":"2024-09-17T05:41:57.959487+0000","last_active":"2024-09-17T05:41:58.943449+0000","last_peered":"2024-09-17T05:41:58.943449+0000","last_clean":"2024-09-17T05:41:58.943449+0000","last_became_active":"2024-09-17T05:41:57.959140+0000","last_became_peered":"2024-09-17T05:41:57.959140+0000","last_unstale":"2024-09-17T05:41:58.943449+0000","last_undegraded":"2024-09-17T05:41:58.943449+0000","last_fullsized":"2024-09-17T05:41:58.943449+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_clean_scrub_stamp":"2024-09-17T05:41:56.913963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:34:29.009088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"22'8","reported_seq":23,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T05:41:59.438858+0000","last_change":"2024-09-17T05:41:56.936984+0000","last_active":"2024-09-17T05:41:59.438858+0000","last_peered":"2024-09-17T05:41:59.438858+0000","last_clean":"2024-09-17T05:41:59.438858+0000","last_became_active":"2024-09-17T05:41:56.936527+0000","last_became_peered":"2024-09-17T05:41:56.936527+0000","last_unstale":"2024-09-17T05:41:59.438858+0000","last_undegraded":"2024-09-17T05:41:59.438858+0000","last_fullsized":"2024-09-17T05:41:59.438858+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:55.904533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:55.904533+0000","last_clean_scrub_stamp":"2024-09-17T05:41:55.904533+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:52:11.112857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T05:41:59.474947+0000","last_change":"2024-09-17T05:41:57.952945+0000","last_active":"2024-09-17T05:41:59.474947+0000","last_peered":"2024-09-17T05:41:59.474947+0000","last_clean":"2024-09-17T05:41:59.474947+0000","last_became_active":"2024-09-17T05:41:57.952616+0000","last_became_peered":"2024-09-17T05:41:57.952616+0000","last_unstale":"2024-09-17T05:41:59.474947+0000","last_undegraded":"2024-09-17T05:41:59.474947+0000","last_fullsized":"2024-09-17T05:41:59.474947+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_clean_scrub_stamp":"2024-09-17T05:41:56.913963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:01:33.862442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"22'1","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T05:41:59.016349+0000","last_change":"2024-09-17T05:41:56.940794+0000","last_active":"2024-09-17T05:41:59.016349+0000","last_peered":"2024-09-17T05:41:59.016349+0000","last_clean":"2024-09-17T05:41:59.016349+0000","last_became_active":"2024-09-17T05:41:56.940422+0000","last_became_peered":"2024-09-17T05:41:56.940422+0000","last_unstale":"2024-09-17T05:41:59.016349+0000","last_undegraded":"2024-09-17T05:41:59.016349+0000","last_fullsized":"2024-09-17T05:41:59.016349+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:55.904533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:55.904533+0000","last_clean_scrub_stamp":"2024-09-17T05:41:55.904533+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:54:47.244836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T05:41:59.475443+0000","last_change":"2024-09-17T05:41:57.947961+0000","last_active":"2024-09-17T05:41:59.475443+0000","last_peered":"2024-09-17T05:41:59.475443+0000","last_clean":"2024-09-17T05:41:59.475443+0000","last_became_active":"2024-09-17T05:41:57.947614+0000","last_became_peered":"2024-09-17T05:41:57.947614+0000","last_unstale":"2024-09-17T05:41:59.475443+0000","last_undegraded":"2024-09-17T05:41:59.475443+0000","last_fullsized":"2024-09-17T05:41:59.475443+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_clean_scrub_stamp":"2024-09-17T05:41:56.913963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:43:21.632222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"22'2","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T05:41:59.439083+0000","last_change":"2024-09-17T05:41:56.945839+0000","last_active":"2024-09-17T05:41:59.439083+0000","last_peered":"2024-09-17T05:41:59.439083+0000","last_clean":"2024-09-17T05:41:59.439083+0000","last_became_active":"2024-09-17T05:41:56.945482+0000","last_became_peered":"2024-09-17T05:41:56.945482+0000","last_unstale":"2024-09-17T05:41:59.439083+0000","last_undegraded":"2024-09-17T05:41:59.439083+0000","last_fullsized":"2024-09-17T05:41:59.439083+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:55.904533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:55.904533+0000","last_clean_scrub_stamp":"2024-09-17T05:41:55.904533+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:29:45.382484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T05:41:59.475905+0000","last_change":"2024-09-17T05:41:57.951359+0000","last_active":"2024-09-17T05:41:59.475905+0000","last_peered":"2024-09-17T05:41:59.475905+0000","last_clean":"2024-09-17T05:41:59.475905+0000","last_became_active":"2024-09-17T05:41:57.951044+0000","last_became_peered":"2024-09-17T05:41:57.951044+0000","last_unstale":"2024-09-17T05:41:59.475905+0000","last_undegraded":"2024-09-17T05:41:59.475905+0000","last_fullsized":"2024-09-17T05:41:59.475905+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_clean_scrub_stamp":"2024-09-17T05:41:56.913963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:02:29.481829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"22'1","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T05:41:59.474576+0000","last_change":"2024-09-17T05:41:56.933514+0000","last_active":"2024-09-17T05:41:59.474576+0000","last_peered":"2024-09-17T05:41:59.474576+0000","last_clean":"2024-09-17T05:41:59.474576+0000","last_became_active":"2024-09-17T05:41:56.932986+0000","last_became_peered":"2024-09-17T05:41:56.932986+0000","last_unstale":"2024-09-17T05:41:59.474576+0000","last_undegraded":"2024-09-17T05:41:59.474576+0000","last_fullsized":"2024-09-17T05:41:59.474576+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:55.904533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:55.904533+0000","last_clean_scrub_stamp":"2024-09-17T05:41:55.904533+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:28:05.866271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T05:41:58.945138+0000","last_change":"2024-09-17T05:41:57.946536+0000","last_active":"2024-09-17T05:41:58.945138+0000","last_peered":"2024-09-17T05:41:58.945138+0000","last_clean":"2024-09-17T05:41:58.945138+0000","last_became_active":"2024-09-17T05:41:57.946168+0000","last_became_peered":"2024-09-17T05:41:57.946168+0000","last_unstale":"2024-09-17T05:41:58.945138+0000","last_undegraded":"2024-09-17T05:41:58.945138+0000","last_fullsized":"2024-09-17T05:41:58.945138+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_clean_scrub_stamp":"2024-09-17T05:41:56.913963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:48:25.095548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T05:41:59.438980+0000","last_change":"2024-09-17T05:41:56.944626+0000","last_active":"2024-09-17T05:41:59.438980+0000","last_peered":"2024-09-17T05:41:59.438980+0000","last_clean":"2024-09-17T05:41:59.438980+0000","last_became_active":"2024-09-17T05:41:56.944259+0000","last_became_peered":"2024-09-17T05:41:56.944259+0000","last_unstale":"2024-09-17T05:41:59.438980+0000","last_undegraded":"2024-09-17T05:41:59.438980+0000","last_fullsized":"2024-09-17T05:41:59.438980+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:55.904533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:55.904533+0000","last_clean_scrub_stamp":"2024-09-17T05:41:55.904533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:48:09.067501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T05:41:59.475567+0000","last_change":"2024-09-17T05:41:57.958128+0000","last_active":"2024-09-17T05:41:59.475567+0000","last_peered":"2024-09-17T05:41:59.475567+0000","last_clean":"2024-09-17T05:41:59.475567+0000","last_became_active":"2024-09-17T05:41:57.957831+0000","last_became_peered":"2024-09-17T05:41:57.957831+0000","last_unstale":"2024-09-17T05:41:59.475567+0000","last_undegraded":"2024-09-17T05:41:59.475567+0000","last_fullsized":"2024-09-17T05:41:59.475567+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_clean_scrub_stamp":"2024-09-17T05:41:56.913963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:14:34.774799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"19'72","reported_seq":111,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T05:41:59.474999+0000","last_change":"2024-09-17T05:41:48.539830+0000","last_active":"2024-09-17T05:41:59.474999+0000","last_peered":"2024-09-17T05:41:59.474999+0000","last_clean":"2024-09-17T05:41:59.474999+0000","last_became_active":"2024-09-17T05:41:48.538743+0000","last_became_peered":"2024-09-17T05:41:48.538743+0000","last_unstale":"2024-09-17T05:41:59.474999+0000","last_undegraded":"2024-09-17T05:41:59.474999+0000","last_fullsized":"2024-09-17T05:41:59.474999+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:47.152539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:47.152539+0000","last_clean_scrub_stamp":"2024-09-17T05:41:47.152539+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:08:02.952016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T05:41:58.944539+0000","last_change":"2024-09-17T05:41:56.939827+0000","last_active":"2024-09-17T05:41:58.944539+0000","last_peered":"2024-09-17T05:41:58.944539+0000","last_clean":"2024-09-17T05:41:58.944539+0000","last_became_active":"2024-09-17T05:41:56.939471+0000","last_became_peered":"2024-09-17T05:41:56.939471+0000","last_unstale":"2024-09-17T05:41:58.944539+0000","last_undegraded":"2024-09-17T05:41:58.944539+0000","last_fullsized":"2024-09-17T05:41:58.944539+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:55.904533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:55.904533+0000","last_clean_scrub_stamp":"2024-09-17T05:41:55.904533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:50:15.165851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T05:41:58.942493+0000","last_change":"2024-09-17T05:41:57.957954+0000","last_active":"2024-09-17T05:41:58.942493+0000","last_peered":"2024-09-17T05:41:58.942493+0000","last_clean":"2024-09-17T05:41:58.942493+0000","last_became_active":"2024-09-17T05:41:57.957629+0000","last_became_peered":"2024-09-17T05:41:57.957629+0000","last_unstale":"2024-09-17T05:41:58.942493+0000","last_undegraded":"2024-09-17T05:41:58.942493+0000","last_fullsized":"2024-09-17T05:41:58.942493+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_clean_scrub_stamp":"2024-09-17T05:41:56.913963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:04:12.932656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T05:41:59.474681+0000","last_change":"2024-09-17T05:41:56.952027+0000","last_active":"2024-09-17T05:41:59.474681+0000","last_peered":"2024-09-17T05:41:59.474681+0000","last_clean":"2024-09-17T05:41:59.474681+0000","last_became_active":"2024-09-17T05:41:56.951679+0000","last_became_peered":"2024-09-17T05:41:56.951679+0000","last_unstale":"2024-09-17T05:41:59.474681+0000","last_undegraded":"2024-09-17T05:41:59.474681+0000","last_fullsized":"2024-09-17T05:41:59.474681+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:55.904533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:55.904533+0000","last_clean_scrub_stamp":"2024-09-17T05:41:55.904533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:12:33.222805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T05:41:59.474246+0000","last_change":"2024-09-17T05:41:57.943470+0000","last_active":"2024-09-17T05:41:59.474246+0000","last_peered":"2024-09-17T05:41:59.474246+0000","last_clean":"2024-09-17T05:41:59.474246+0000","last_became_active":"2024-09-17T05:41:57.943015+0000","last_became_peered":"2024-09-17T05:41:57.943015+0000","last_unstale":"2024-09-17T05:41:59.474246+0000","last_undegraded":"2024-09-17T05:41:59.474246+0000","last_fullsized":"2024-09-17T05:41:59.474246+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_clean_scrub_stamp":"2024-09-17T05:41:56.913963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:42:36.013480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T05:41:59.438944+0000","last_change":"2024-09-17T05:41:56.939919+0000","last_active":"2024-09-17T05:41:59.438944+0000","last_peered":"2024-09-17T05:41:59.438944+0000","last_clean":"2024-09-17T05:41:59.438944+0000","last_became_active":"2024-09-17T05:41:56.939608+0000","last_became_peered":"2024-09-17T05:41:56.939608+0000","last_unstale":"2024-09-17T05:41:59.438944+0000","last_undegraded":"2024-09-17T05:41:59.438944+0000","last_fullsized":"2024-09-17T05:41:59.438944+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:55.904533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:55.904533+0000","last_clean_scrub_stamp":"2024-09-17T05:41:55.904533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:27:37.482839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T05:41:59.474317+0000","last_change":"2024-09-17T05:41:57.947137+0000","last_active":"2024-09-17T05:41:59.474317+0000","last_peered":"2024-09-17T05:41:59.474317+0000","last_clean":"2024-09-17T05:41:59.474317+0000","last_became_active":"2024-09-17T05:41:57.946767+0000","last_became_peered":"2024-09-17T05:41:57.946767+0000","last_unstale":"2024-09-17T05:41:59.474317+0000","last_undegraded":"2024-09-17T05:41:59.474317+0000","last_fullsized":"2024-09-17T05:41:59.474317+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_clean_scrub_stamp":"2024-09-17T05:41:56.913963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:04:12.932656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T05:41:58.945106+0000","last_change":"2024-09-17T05:41:56.938012+0000","last_active":"2024-09-17T05:41:58.945106+0000","last_peered":"2024-09-17T05:41:58.945106+0000","last_clean":"2024-09-17T05:41:58.945106+0000","last_became_active":"2024-09-17T05:41:56.937706+0000","last_became_peered":"2024-09-17T05:41:56.937706+0000","last_unstale":"2024-09-17T05:41:58.945106+0000","last_undegraded":"2024-09-17T05:41:58.945106+0000","last_fullsized":"2024-09-17T05:41:58.945106+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:55.904533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:55.904533+0000","last_clean_scrub_stamp":"2024-09-17T05:41:55.904533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:22:56.364485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T05:41:59.016310+0000","last_change":"2024-09-17T05:41:57.942237+0000","last_active":"2024-09-17T05:41:59.016310+0000","last_peered":"2024-09-17T05:41:59.016310+0000","last_clean":"2024-09-17T05:41:59.016310+0000","last_became_active":"2024-09-17T05:41:57.941725+0000","last_became_peered":"2024-09-17T05:41:57.941725+0000","last_unstale":"2024-09-17T05:41:59.016310+0000","last_undegraded":"2024-09-17T05:41:59.016310+0000","last_fullsized":"2024-09-17T05:41:59.016310+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_clean_scrub_stamp":"2024-09-17T05:41:56.913963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:22:57.373916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T05:41:59.474242+0000","last_change":"2024-09-17T05:41:56.939274+0000","last_active":"2024-09-17T05:41:59.474242+0000","last_peered":"2024-09-17T05:41:59.474242+0000","last_clean":"2024-09-17T05:41:59.474242+0000","last_became_active":"2024-09-17T05:41:56.938944+0000","last_became_peered":"2024-09-17T05:41:56.938944+0000","last_unstale":"2024-09-17T05:41:59.474242+0000","last_undegraded":"2024-09-17T05:41:59.474242+0000","last_fullsized":"2024-09-17T05:41:59.474242+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:55.904533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:55.904533+0000","last_clean_scrub_stamp":"2024-09-17T05:41:55.904533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:29:45.382484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T05:41:58.945559+0000","last_change":"2024-09-17T05:41:57.943883+0000","last_active":"2024-09-17T05:41:58.945559+0000","last_peered":"2024-09-17T05:41:58.945559+0000","last_clean":"2024-09-17T05:41:58.945559+0000","last_became_active":"2024-09-17T05:41:57.943565+0000","last_became_peered":"2024-09-17T05:41:57.943565+0000","last_unstale":"2024-09-17T05:41:58.945559+0000","last_undegraded":"2024-09-17T05:41:58.945559+0000","last_fullsized":"2024-09-17T05:41:58.945559+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_clean_scrub_stamp":"2024-09-17T05:41:56.913963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:14:34.774799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T05:41:59.475657+0000","last_change":"2024-09-17T05:41:56.950966+0000","last_active":"2024-09-17T05:41:59.475657+0000","last_peered":"2024-09-17T05:41:59.475657+0000","last_clean":"2024-09-17T05:41:59.475657+0000","last_became_active":"2024-09-17T05:41:56.950558+0000","last_became_peered":"2024-09-17T05:41:56.950558+0000","last_unstale":"2024-09-17T05:41:59.475657+0000","last_undegraded":"2024-09-17T05:41:59.475657+0000","last_fullsized":"2024-09-17T05:41:59.475657+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:55.904533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:55.904533+0000","last_clean_scrub_stamp":"2024-09-17T05:41:55.904533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:23:55.121185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T05:41:59.474260+0000","last_change":"2024-09-17T05:41:57.946228+0000","last_active":"2024-09-17T05:41:59.474260+0000","last_peered":"2024-09-17T05:41:59.474260+0000","last_clean":"2024-09-17T05:41:59.474260+0000","last_became_active":"2024-09-17T05:41:57.945883+0000","last_became_peered":"2024-09-17T05:41:57.945883+0000","last_unstale":"2024-09-17T05:41:59.474260+0000","last_undegraded":"2024-09-17T05:41:59.474260+0000","last_fullsized":"2024-09-17T05:41:59.474260+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_clean_scrub_stamp":"2024-09-17T05:41:56.913963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:47:26.590424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"23'1","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T05:41:59.474737+0000","last_change":"2024-09-17T05:41:56.944059+0000","last_active":"2024-09-17T05:41:59.474737+0000","last_peered":"2024-09-17T05:41:59.474737+0000","last_clean":"2024-09-17T05:41:59.474737+0000","last_became_active":"2024-09-17T05:41:56.943687+0000","last_became_peered":"2024-09-17T05:41:56.943687+0000","last_unstale":"2024-09-17T05:41:59.474737+0000","last_undegraded":"2024-09-17T05:41:59.474737+0000","last_fullsized":"2024-09-17T05:41:59.474737+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:55.904533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:55.904533+0000","last_clean_scrub_stamp":"2024-09-17T05:41:55.904533+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:45:41.328997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T05:41:58.942699+0000","last_change":"2024-09-17T05:41:57.952421+0000","last_active":"2024-09-17T05:41:58.942699+0000","last_peered":"2024-09-17T05:41:58.942699+0000","last_clean":"2024-09-17T05:41:58.942699+0000","last_became_active":"2024-09-17T05:41:57.952090+0000","last_became_peered":"2024-09-17T05:41:57.952090+0000","last_unstale":"2024-09-17T05:41:58.942699+0000","last_undegraded":"2024-09-17T05:41:58.942699+0000","last_fullsized":"2024-09-17T05:41:58.942699+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_clean_scrub_stamp":"2024-09-17T05:41:56.913963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:24:24.651104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"22'2","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T05:41:58.943750+0000","last_change":"2024-09-17T05:41:56.947816+0000","last_active":"2024-09-17T05:41:58.943750+0000","last_peered":"2024-09-17T05:41:58.943750+0000","last_clean":"2024-09-17T05:41:58.943750+0000","last_became_active":"2024-09-17T05:41:56.947483+0000","last_became_peered":"2024-09-17T05:41:56.947483+0000","last_unstale":"2024-09-17T05:41:58.943750+0000","last_undegraded":"2024-09-17T05:41:58.943750+0000","last_fullsized":"2024-09-17T05:41:58.943750+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:55.904533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:55.904533+0000","last_clean_scrub_stamp":"2024-09-17T05:41:55.904533+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:02:05.360497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T05:41:59.474648+0000","last_change":"2024-09-17T05:41:57.950209+0000","last_active":"2024-09-17T05:41:59.474648+0000","last_peered":"2024-09-17T05:41:59.474648+0000","last_clean":"2024-09-17T05:41:59.474648+0000","last_became_active":"2024-09-17T05:41:57.949869+0000","last_became_peered":"2024-09-17T05:41:57.949869+0000","last_unstale":"2024-09-17T05:41:59.474648+0000","last_undegraded":"2024-09-17T05:41:59.474648+0000","last_fullsized":"2024-09-17T05:41:59.474648+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_clean_scrub_stamp":"2024-09-17T05:41:56.913963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:04:39.620332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T05:41:59.474670+0000","last_change":"2024-09-17T05:41:56.950895+0000","last_active":"2024-09-17T05:41:59.474670+0000","last_peered":"2024-09-17T05:41:59.474670+0000","last_clean":"2024-09-17T05:41:59.474670+0000","last_became_active":"2024-09-17T05:41:56.950518+0000","last_became_peered":"2024-09-17T05:41:56.950518+0000","last_unstale":"2024-09-17T05:41:59.474670+0000","last_undegraded":"2024-09-17T05:41:59.474670+0000","last_fullsized":"2024-09-17T05:41:59.474670+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:55.904533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:55.904533+0000","last_clean_scrub_stamp":"2024-09-17T05:41:55.904533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:28:05.866271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T05:41:59.016224+0000","last_change":"2024-09-17T05:41:57.937269+0000","last_active":"2024-09-17T05:41:59.016224+0000","last_peered":"2024-09-17T05:41:59.016224+0000","last_clean":"2024-09-17T05:41:59.016224+0000","last_became_active":"2024-09-17T05:41:57.936899+0000","last_became_peered":"2024-09-17T05:41:57.936899+0000","last_unstale":"2024-09-17T05:41:59.016224+0000","last_undegraded":"2024-09-17T05:41:59.016224+0000","last_fullsized":"2024-09-17T05:41:59.016224+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_clean_scrub_stamp":"2024-09-17T05:41:56.913963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:48:09.026377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T05:41:59.474242+0000","last_change":"2024-09-17T05:41:56.942310+0000","last_active":"2024-09-17T05:41:59.474242+0000","last_peered":"2024-09-17T05:41:59.474242+0000","last_clean":"2024-09-17T05:41:59.474242+0000","last_became_active":"2024-09-17T05:41:56.941965+0000","last_became_peered":"2024-09-17T05:41:56.941965+0000","last_unstale":"2024-09-17T05:41:59.474242+0000","last_undegraded":"2024-09-17T05:41:59.474242+0000","last_fullsized":"2024-09-17T05:41:59.474242+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:55.904533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:55.904533+0000","last_clean_scrub_stamp":"2024-09-17T05:41:55.904533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:16:32.573490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T05:41:58.942903+0000","last_change":"2024-09-17T05:41:57.954269+0000","last_active":"2024-09-17T05:41:58.942903+0000","last_peered":"2024-09-17T05:41:58.942903+0000","last_clean":"2024-09-17T05:41:58.942903+0000","last_became_active":"2024-09-17T05:41:57.953932+0000","last_became_peered":"2024-09-17T05:41:57.953932+0000","last_unstale":"2024-09-17T05:41:58.942903+0000","last_undegraded":"2024-09-17T05:41:58.942903+0000","last_fullsized":"2024-09-17T05:41:58.942903+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_clean_scrub_stamp":"2024-09-17T05:41:56.913963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:01:33.862442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T05:41:59.474364+0000","last_change":"2024-09-17T05:41:56.940176+0000","last_active":"2024-09-17T05:41:59.474364+0000","last_peered":"2024-09-17T05:41:59.474364+0000","last_clean":"2024-09-17T05:41:59.474364+0000","last_became_active":"2024-09-17T05:41:56.939850+0000","last_became_peered":"2024-09-17T05:41:56.939850+0000","last_unstale":"2024-09-17T05:41:59.474364+0000","last_undegraded":"2024-09-17T05:41:59.474364+0000","last_fullsized":"2024-09-17T05:41:59.474364+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:55.904533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:55.904533+0000","last_clean_scrub_stamp":"2024-09-17T05:41:55.904533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:13:02.431112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T05:41:58.942709+0000","last_change":"2024-09-17T05:41:57.945639+0000","last_active":"2024-09-17T05:41:58.942709+0000","last_peered":"2024-09-17T05:41:58.942709+0000","last_clean":"2024-09-17T05:41:58.942709+0000","last_became_active":"2024-09-17T05:41:57.945277+0000","last_became_peered":"2024-09-17T05:41:57.945277+0000","last_unstale":"2024-09-17T05:41:58.942709+0000","last_undegraded":"2024-09-17T05:41:58.942709+0000","last_fullsized":"2024-09-17T05:41:58.942709+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_clean_scrub_stamp":"2024-09-17T05:41:56.913963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:05:25.111036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"22'2","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T05:41:59.475181+0000","last_change":"2024-09-17T05:41:56.948113+0000","last_active":"2024-09-17T05:41:59.475181+0000","last_peered":"2024-09-17T05:41:59.475181+0000","last_clean":"2024-09-17T05:41:59.475181+0000","last_became_active":"2024-09-17T05:41:56.947582+0000","last_became_peered":"2024-09-17T05:41:56.947582+0000","last_unstale":"2024-09-17T05:41:59.475181+0000","last_undegraded":"2024-09-17T05:41:59.475181+0000","last_fullsized":"2024-09-17T05:41:59.475181+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:55.904533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:55.904533+0000","last_clean_scrub_stamp":"2024-09-17T05:41:55.904533+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:16:32.573490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T05:41:58.943406+0000","last_change":"2024-09-17T05:41:57.956713+0000","last_active":"2024-09-17T05:41:58.943406+0000","last_peered":"2024-09-17T05:41:58.943406+0000","last_clean":"2024-09-17T05:41:58.943406+0000","last_became_active":"2024-09-17T05:41:57.956322+0000","last_became_peered":"2024-09-17T05:41:57.956322+0000","last_unstale":"2024-09-17T05:41:58.943406+0000","last_undegraded":"2024-09-17T05:41:58.943406+0000","last_fullsized":"2024-09-17T05:41:58.943406+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_clean_scrub_stamp":"2024-09-17T05:41:56.913963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:06:04.948499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T05:41:58.945377+0000","last_change":"2024-09-17T05:41:57.951802+0000","last_active":"2024-09-17T05:41:58.945377+0000","last_peered":"2024-09-17T05:41:58.945377+0000","last_clean":"2024-09-17T05:41:58.945377+0000","last_became_active":"2024-09-17T05:41:57.951316+0000","last_became_peered":"2024-09-17T05:41:57.951316+0000","last_unstale":"2024-09-17T05:41:58.945377+0000","last_undegraded":"2024-09-17T05:41:58.945377+0000","last_fullsized":"2024-09-17T05:41:58.945377+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_clean_scrub_stamp":"2024-09-17T05:41:56.913963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:46:38.117672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"22'2","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T05:41:59.474972+0000","last_change":"2024-09-17T05:41:56.949729+0000","last_active":"2024-09-17T05:41:59.474972+0000","last_peered":"2024-09-17T05:41:59.474972+0000","last_clean":"2024-09-17T05:41:59.474972+0000","last_became_active":"2024-09-17T05:41:56.949384+0000","last_became_peered":"2024-09-17T05:41:56.949384+0000","last_unstale":"2024-09-17T05:41:59.474972+0000","last_undegraded":"2024-09-17T05:41:59.474972+0000","last_fullsized":"2024-09-17T05:41:59.474972+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:55.904533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:55.904533+0000","last_clean_scrub_stamp":"2024-09-17T05:41:55.904533+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:45:41.328997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T05:41:58.945780+0000","last_change":"2024-09-17T05:41:57.951733+0000","last_active":"2024-09-17T05:41:58.945780+0000","last_peered":"2024-09-17T05:41:58.945780+0000","last_clean":"2024-09-17T05:41:58.945780+0000","last_became_active":"2024-09-17T05:41:57.951330+0000","last_became_peered":"2024-09-17T05:41:57.951330+0000","last_unstale":"2024-09-17T05:41:58.945780+0000","last_undegraded":"2024-09-17T05:41:58.945780+0000","last_fullsized":"2024-09-17T05:41:58.945780+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_clean_scrub_stamp":"2024-09-17T05:41:56.913963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:43:21.632222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"22'2","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T05:41:59.475418+0000","last_change":"2024-09-17T05:41:56.952616+0000","last_active":"2024-09-17T05:41:59.475418+0000","last_peered":"2024-09-17T05:41:59.475418+0000","last_clean":"2024-09-17T05:41:59.475418+0000","last_became_active":"2024-09-17T05:41:56.952230+0000","last_became_peered":"2024-09-17T05:41:56.952230+0000","last_unstale":"2024-09-17T05:41:59.475418+0000","last_undegraded":"2024-09-17T05:41:59.475418+0000","last_fullsized":"2024-09-17T05:41:59.475418+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:55.904533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:55.904533+0000","last_clean_scrub_stamp":"2024-09-17T05:41:55.904533+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:56:02.887851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T05:41:59.474952+0000","last_change":"2024-09-17T05:41:57.947899+0000","last_active":"2024-09-17T05:41:59.474952+0000","last_peered":"2024-09-17T05:41:59.474952+0000","last_clean":"2024-09-17T05:41:59.474952+0000","last_became_active":"2024-09-17T05:41:57.947556+0000","last_became_peered":"2024-09-17T05:41:57.947556+0000","last_unstale":"2024-09-17T05:41:59.474952+0000","last_undegraded":"2024-09-17T05:41:59.474952+0000","last_fullsized":"2024-09-17T05:41:59.474952+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_clean_scrub_stamp":"2024-09-17T05:41:56.913963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:54:13.215048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"22'1","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T05:41:58.942704+0000","last_change":"2024-09-17T05:41:56.940731+0000","last_active":"2024-09-17T05:41:58.942704+0000","last_peered":"2024-09-17T05:41:58.942704+0000","last_clean":"2024-09-17T05:41:58.942704+0000","last_became_active":"2024-09-17T05:41:56.939978+0000","last_became_peered":"2024-09-17T05:41:56.939978+0000","last_unstale":"2024-09-17T05:41:58.942704+0000","last_undegraded":"2024-09-17T05:41:58.942704+0000","last_fullsized":"2024-09-17T05:41:58.942704+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:55.904533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:55.904533+0000","last_clean_scrub_stamp":"2024-09-17T05:41:55.904533+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:48:09.067501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T05:41:58.942846+0000","last_change":"2024-09-17T05:41:57.956639+0000","last_active":"2024-09-17T05:41:58.942846+0000","last_peered":"2024-09-17T05:41:58.942846+0000","last_clean":"2024-09-17T05:41:58.942846+0000","last_became_active":"2024-09-17T05:41:57.956338+0000","last_became_peered":"2024-09-17T05:41:57.956338+0000","last_unstale":"2024-09-17T05:41:58.942846+0000","last_undegraded":"2024-09-17T05:41:58.942846+0000","last_fullsized":"2024-09-17T05:41:58.942846+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_clean_scrub_stamp":"2024-09-17T05:41:56.913963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:52:28.863641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"22'4","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T05:41:59.475203+0000","last_change":"2024-09-17T05:41:56.946707+0000","last_active":"2024-09-17T05:41:59.475203+0000","last_peered":"2024-09-17T05:41:59.475203+0000","last_clean":"2024-09-17T05:41:59.475203+0000","last_became_active":"2024-09-17T05:41:56.946448+0000","last_became_peered":"2024-09-17T05:41:56.946448+0000","last_unstale":"2024-09-17T05:41:59.475203+0000","last_undegraded":"2024-09-17T05:41:59.475203+0000","last_fullsized":"2024-09-17T05:41:59.475203+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:55.904533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:55.904533+0000","last_clean_scrub_stamp":"2024-09-17T05:41:55.904533+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:55:32.730864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":16,"seq":68719476745,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27272,"kb_used_data":240,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344568,"statfs":{"total":96636764160,"available":96608837632,"internally_reserved":0,"allocated":245760,"data_stored":83439,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":15,"seq":64424509449,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27840,"kb_used_data":812,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344000,"statfs":{"total":96636764160,"available":96608256000,"internally_reserved":0,"allocated":831488,"data_stored":672777,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509448,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27260,"kb_used_data":232,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344580,"statfs":{"total":96636764160,"available":96608849920,"internally_reserved":0,"allocated":237568,"data_stored":81917,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509448,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27268,"kb_used_data":240,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344572,"statfs":{"total":96636764160,"available":96608841728,"internally_reserved":0,"allocated":245760,"data_stored":81953,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509448,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27268,"kb_used_data":240,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344572,"statfs":{"total":96636764160,"available":96608841728,"internally_reserved":0,"allocated":245760,"data_stored":83439,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509448,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27264,"kb_used_data":228,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344576,"statfs":{"total":96636764160,"available":96608845824,"internally_reserved":0,"allocated":233472,"data_stored":81827,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509448,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27264,"kb_used_data":236,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344576,"statfs":{"total":96636764160,"available":96608845824,"internally_reserved":0,"allocated":241664,"data_stored":81987,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574856,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27848,"kb_used_data":820,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343992,"statfs":{"total":96636764160,"available":96608247808,"internally_reserved":0,"allocated":839680,"data_stored":672833,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-17T05:42:10.276 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-17T05:42:10.426 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:10.424+0000 7f40b72cc640 1 -- 172.21.15.150:0/1551561569 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f40b00d0c50 msgr2=0x7f40b00d0010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:10.426 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:10.424+0000 7f40b72cc640 1 --2- 172.21.15.150:0/1551561569 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f40b00d0c50 0x7f40b00d0010 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f40b00d0960 tx=0x7f40ac02a5d0 comp rx=0 tx=0).stop 2024-09-17T05:42:10.426 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:10.424+0000 7f40b72cc640 1 -- 172.21.15.150:0/1551561569 shutdown_connections 2024-09-17T05:42:10.426 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:10.424+0000 7f40b72cc640 1 --2- 172.21.15.150:0/1551561569 >> v2:172.21.15.176:3300/0 conn(0x7f40b00d1060 0x7f40b00b1fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:10.427 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:10.424+0000 7f40b72cc640 1 --2- 172.21.15.150:0/1551561569 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f40b00d0c50 0x7f40b00d0010 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:10.427 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:10.424+0000 7f40b72cc640 1 -- 172.21.15.150:0/1551561569 >> 172.21.15.150:0/1551561569 conn(0x7f40b00b3fc0 msgr2=0x7f40b00b43d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:42:10.427 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:10.424+0000 7f40b72cc640 1 -- 172.21.15.150:0/1551561569 shutdown_connections 2024-09-17T05:42:10.427 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:10.424+0000 7f40b72cc640 1 -- 172.21.15.150:0/1551561569 wait complete. 2024-09-17T05:42:10.427 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:10.426+0000 7f40b72cc640 1 Processor -- start 2024-09-17T05:42:10.428 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:10.426+0000 7f40b72cc640 1 -- start start 2024-09-17T05:42:10.430 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:10.427+0000 7f40b72cc640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f40b00d0550 0x7f40b00c6b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:42:10.430 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:10.427+0000 7f40b72cc640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f40b00d0c50 0x7f40b00c5220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:42:10.430 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:10.427+0000 7f40b72cc640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f40b00d1060 0x7f40b01f5ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:42:10.430 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:10.427+0000 7f40b72cc640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f40b00ced30 con 0x7f40b00d0c50 2024-09-17T05:42:10.430 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:10.427+0000 7f40b72cc640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f40b00cebb0 con 0x7f40b00d0550 2024-09-17T05:42:10.430 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:10.427+0000 7f40b72cc640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f40b00cd130 con 0x7f40b00d1060 2024-09-17T05:42:10.431 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:10.428+0000 7f40b4867640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f40b00d0c50 0x7f40b00c5220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:42:10.431 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:10.428+0000 7f40b4867640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f40b00d0c50 0x7f40b00c5220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:60214/0 (socket says 172.21.15.150:60214) 2024-09-17T05:42:10.431 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:10.428+0000 7f40b4867640 1 -- 172.21.15.150:0/2014377754 learned_addr learned my addr 172.21.15.150:0/2014377754 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:42:10.431 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:10.428+0000 7f40b4867640 1 -- 172.21.15.150:0/2014377754 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f40b00d1060 msgr2=0x7f40b01f5ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:10.431 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:10.428+0000 7f40b4867640 1 --2- 172.21.15.150:0/2014377754 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f40b00d1060 0x7f40b01f5ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:10.431 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:10.428+0000 7f40b5068640 1 --2- 172.21.15.150:0/2014377754 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f40b00d0550 0x7f40b00c6b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:42:10.431 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:10.428+0000 7f40b4867640 1 -- 172.21.15.150:0/2014377754 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f40b00d0550 msgr2=0x7f40b00c6b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:10.431 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:10.428+0000 7f40b4867640 1 --2- 172.21.15.150:0/2014377754 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f40b00d0550 0x7f40b00c6b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:10.431 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:10.428+0000 7f40b4867640 1 -- 172.21.15.150:0/2014377754 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f40b006fed0 con 0x7f40b00d0c50 2024-09-17T05:42:10.431 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:10.428+0000 7f40b4867640 1 --2- 172.21.15.150:0/2014377754 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f40b00d0c50 0x7f40b00c5220 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f40a000c340 tx=0x7f40a000c800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:42:10.431 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:10.428+0000 7f40a5ffb640 1 -- 172.21.15.150:0/2014377754 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40a0011790 con 0x7f40b00d0c50 2024-09-17T05:42:10.432 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:10.428+0000 7f40a5ffb640 1 -- 172.21.15.150:0/2014377754 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f40a0017070 con 0x7f40b00d0c50 2024-09-17T05:42:10.432 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:10.428+0000 7f40b72cc640 1 -- 172.21.15.150:0/2014377754 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f40b01f67d0 con 0x7f40b00d0c50 2024-09-17T05:42:10.432 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:10.428+0000 7f40a5ffb640 1 -- 172.21.15.150:0/2014377754 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40a0011cc0 con 0x7f40b00d0c50 2024-09-17T05:42:10.432 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:10.428+0000 7f40b72cc640 1 -- 172.21.15.150:0/2014377754 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f40b00c6380 con 0x7f40b00d0c50 2024-09-17T05:42:10.433 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:10.429+0000 7f40b72cc640 1 -- 172.21.15.150:0/2014377754 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f40b00d0010 con 0x7f40b00d0c50 2024-09-17T05:42:10.433 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:10.430+0000 7f40a5ffb640 1 -- 172.21.15.150:0/2014377754 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f40a001c460 con 0x7f40b00d0c50 2024-09-17T05:42:10.433 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:10.431+0000 7f40a5ffb640 1 --2- 172.21.15.150:0/2014377754 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f4094078bc0 0x7f409407b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:42:10.433 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:10.431+0000 7f40a5ffb640 1 -- 172.21.15.150:0/2014377754 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f40a009a980 con 0x7f40b00d0c50 2024-09-17T05:42:10.433 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:10.431+0000 7f40b5068640 1 --2- 172.21.15.150:0/2014377754 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f4094078bc0 0x7f409407b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:42:10.433 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:10.432+0000 7f40b5068640 1 --2- 172.21.15.150:0/2014377754 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f4094078bc0 0x7f409407b0d0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f40ac034000 tx=0x7f40ac004730 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:42:10.436 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:10.435+0000 7f40a5ffb640 1 -- 172.21.15.150:0/2014377754 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f40a0062e50 con 0x7f40b00d0c50 2024-09-17T05:42:10.608 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:10.607+0000 7f40b72cc640 1 -- 172.21.15.150:0/2014377754 --> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f40b01f6ab0 con 0x7f4094078bc0 2024-09-17T05:42:10.613 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:10.612+0000 7f40a5ffb640 1 -- 172.21.15.150:0/2014377754 <== mgr.4108 v2:172.21.15.176:6800/3631216395 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251825 (secure 0 0 0) 0x7f40b01f6ab0 con 0x7f4094078bc0 2024-09-17T05:42:10.616 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-09-17T05:42:10.617 INFO:teuthology.orchestra.run.smithi150.stderr:dumped all 2024-09-17T05:42:10.618 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:10.615+0000 7f40b72cc640 1 -- 172.21.15.150:0/2014377754 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f4094078bc0 msgr2=0x7f409407b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:10.619 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:10.615+0000 7f40b72cc640 1 --2- 172.21.15.150:0/2014377754 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f4094078bc0 0x7f409407b0d0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f40ac034000 tx=0x7f40ac004730 comp rx=0 tx=0).stop 2024-09-17T05:42:10.619 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:10.615+0000 7f40b72cc640 1 -- 172.21.15.150:0/2014377754 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f40b00d0c50 msgr2=0x7f40b00c5220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:10.619 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:10.615+0000 7f40b72cc640 1 --2- 172.21.15.150:0/2014377754 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f40b00d0c50 0x7f40b00c5220 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f40a000c340 tx=0x7f40a000c800 comp rx=0 tx=0).stop 2024-09-17T05:42:10.619 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:10.615+0000 7f40b72cc640 1 -- 172.21.15.150:0/2014377754 shutdown_connections 2024-09-17T05:42:10.619 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:10.615+0000 7f40b72cc640 1 --2- 172.21.15.150:0/2014377754 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f4094078bc0 0x7f409407b0d0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:10.619 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:10.615+0000 7f40b72cc640 1 --2- 172.21.15.150:0/2014377754 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f40b00d1060 0x7f40b01f5ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:10.619 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:10.615+0000 7f40b72cc640 1 --2- 172.21.15.150:0/2014377754 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f40b00d0c50 0x7f40b00c5220 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:10.619 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:10.615+0000 7f40b72cc640 1 --2- 172.21.15.150:0/2014377754 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f40b00d0550 0x7f40b00c6b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:10.619 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:10.615+0000 7f40b72cc640 1 -- 172.21.15.150:0/2014377754 >> 172.21.15.150:0/2014377754 conn(0x7f40b00b3fc0 msgr2=0x7f40b015d9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:42:10.619 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:10.615+0000 7f40b72cc640 1 -- 172.21.15.150:0/2014377754 shutdown_connections 2024-09-17T05:42:10.620 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:10.615+0000 7f40b72cc640 1 -- 172.21.15.150:0/2014377754 wait complete. 2024-09-17T05:42:10.627 INFO:teuthology.orchestra.run.smithi150.stdout:{"pg_ready":true,"pg_map":{"version":29,"stamp":"2024-09-17T05:42:08.846722+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":146,"num_write_kb":1642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":111,"ondisk_log_size":111,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219284,"kb_used_data":3048,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755436,"statfs":{"total":773094113280,"available":772869566464,"internally_reserved":0,"allocated":3121152,"data_stored":1840172,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":1794,"num_objects":18,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":38,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":12,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"10.002543"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T05:41:59.475666+0000","last_change":"2024-09-17T05:41:57.959035+0000","last_active":"2024-09-17T05:41:59.475666+0000","last_peered":"2024-09-17T05:41:59.475666+0000","last_clean":"2024-09-17T05:41:59.475666+0000","last_became_active":"2024-09-17T05:41:57.958686+0000","last_became_peered":"2024-09-17T05:41:57.958686+0000","last_unstale":"2024-09-17T05:41:59.475666+0000","last_undegraded":"2024-09-17T05:41:59.475666+0000","last_fullsized":"2024-09-17T05:41:59.475666+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_clean_scrub_stamp":"2024-09-17T05:41:56.913963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:20:54.930864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T05:41:59.474653+0000","last_change":"2024-09-17T05:41:57.949203+0000","last_active":"2024-09-17T05:41:59.474653+0000","last_peered":"2024-09-17T05:41:59.474653+0000","last_clean":"2024-09-17T05:41:59.474653+0000","last_became_active":"2024-09-17T05:41:57.948887+0000","last_became_peered":"2024-09-17T05:41:57.948887+0000","last_unstale":"2024-09-17T05:41:59.474653+0000","last_undegraded":"2024-09-17T05:41:59.474653+0000","last_fullsized":"2024-09-17T05:41:59.474653+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_clean_scrub_stamp":"2024-09-17T05:41:56.913963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:58:14.523021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T05:41:59.474467+0000","last_change":"2024-09-17T05:41:57.935841+0000","last_active":"2024-09-17T05:41:59.474467+0000","last_peered":"2024-09-17T05:41:59.474467+0000","last_clean":"2024-09-17T05:41:59.474467+0000","last_became_active":"2024-09-17T05:41:57.935502+0000","last_became_peered":"2024-09-17T05:41:57.935502+0000","last_unstale":"2024-09-17T05:41:59.474467+0000","last_undegraded":"2024-09-17T05:41:59.474467+0000","last_fullsized":"2024-09-17T05:41:59.474467+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_clean_scrub_stamp":"2024-09-17T05:41:56.913963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:52:29.444374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T05:41:58.944866+0000","last_change":"2024-09-17T05:41:57.961231+0000","last_active":"2024-09-17T05:41:58.944866+0000","last_peered":"2024-09-17T05:41:58.944866+0000","last_clean":"2024-09-17T05:41:58.944866+0000","last_became_active":"2024-09-17T05:41:57.959741+0000","last_became_peered":"2024-09-17T05:41:57.959741+0000","last_unstale":"2024-09-17T05:41:58.944866+0000","last_undegraded":"2024-09-17T05:41:58.944866+0000","last_fullsized":"2024-09-17T05:41:58.944866+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_clean_scrub_stamp":"2024-09-17T05:41:56.913963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:52:28.863641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T05:41:59.475026+0000","last_change":"2024-09-17T05:41:57.948142+0000","last_active":"2024-09-17T05:41:59.475026+0000","last_peered":"2024-09-17T05:41:59.475026+0000","last_clean":"2024-09-17T05:41:59.475026+0000","last_became_active":"2024-09-17T05:41:57.947736+0000","last_became_peered":"2024-09-17T05:41:57.947736+0000","last_unstale":"2024-09-17T05:41:59.475026+0000","last_undegraded":"2024-09-17T05:41:59.475026+0000","last_fullsized":"2024-09-17T05:41:59.475026+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_clean_scrub_stamp":"2024-09-17T05:41:56.913963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:25:08.628947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T05:41:58.944771+0000","last_change":"2024-09-17T05:41:57.962298+0000","last_active":"2024-09-17T05:41:58.944771+0000","last_peered":"2024-09-17T05:41:58.944771+0000","last_clean":"2024-09-17T05:41:58.944771+0000","last_became_active":"2024-09-17T05:41:57.961827+0000","last_became_peered":"2024-09-17T05:41:57.961827+0000","last_unstale":"2024-09-17T05:41:58.944771+0000","last_undegraded":"2024-09-17T05:41:58.944771+0000","last_fullsized":"2024-09-17T05:41:58.944771+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_clean_scrub_stamp":"2024-09-17T05:41:56.913963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:05:25.111036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T05:41:59.474925+0000","last_change":"2024-09-17T05:41:57.962591+0000","last_active":"2024-09-17T05:41:59.474925+0000","last_peered":"2024-09-17T05:41:59.474925+0000","last_clean":"2024-09-17T05:41:59.474925+0000","last_became_active":"2024-09-17T05:41:57.962277+0000","last_became_peered":"2024-09-17T05:41:57.962277+0000","last_unstale":"2024-09-17T05:41:59.474925+0000","last_undegraded":"2024-09-17T05:41:59.474925+0000","last_fullsized":"2024-09-17T05:41:59.474925+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_clean_scrub_stamp":"2024-09-17T05:41:56.913963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:52:28.863641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T05:41:58.942251+0000","last_change":"2024-09-17T05:41:57.952162+0000","last_active":"2024-09-17T05:41:58.942251+0000","last_peered":"2024-09-17T05:41:58.942251+0000","last_clean":"2024-09-17T05:41:58.942251+0000","last_became_active":"2024-09-17T05:41:57.951848+0000","last_became_peered":"2024-09-17T05:41:57.951848+0000","last_unstale":"2024-09-17T05:41:58.942251+0000","last_undegraded":"2024-09-17T05:41:58.942251+0000","last_fullsized":"2024-09-17T05:41:58.942251+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_clean_scrub_stamp":"2024-09-17T05:41:56.913963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:32:07.051277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T05:41:59.475711+0000","last_change":"2024-09-17T05:41:57.957295+0000","last_active":"2024-09-17T05:41:59.475711+0000","last_peered":"2024-09-17T05:41:59.475711+0000","last_clean":"2024-09-17T05:41:59.475711+0000","last_became_active":"2024-09-17T05:41:57.956917+0000","last_became_peered":"2024-09-17T05:41:57.956917+0000","last_unstale":"2024-09-17T05:41:59.475711+0000","last_undegraded":"2024-09-17T05:41:59.475711+0000","last_fullsized":"2024-09-17T05:41:59.475711+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_clean_scrub_stamp":"2024-09-17T05:41:56.913963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:18:41.669507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T05:41:58.944176+0000","last_change":"2024-09-17T05:41:57.956487+0000","last_active":"2024-09-17T05:41:58.944176+0000","last_peered":"2024-09-17T05:41:58.944176+0000","last_clean":"2024-09-17T05:41:58.944176+0000","last_became_active":"2024-09-17T05:41:57.956139+0000","last_became_peered":"2024-09-17T05:41:57.956139+0000","last_unstale":"2024-09-17T05:41:58.944176+0000","last_undegraded":"2024-09-17T05:41:58.944176+0000","last_fullsized":"2024-09-17T05:41:58.944176+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_clean_scrub_stamp":"2024-09-17T05:41:56.913963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:11:06.285537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T05:41:58.943506+0000","last_change":"2024-09-17T05:41:57.953158+0000","last_active":"2024-09-17T05:41:58.943506+0000","last_peered":"2024-09-17T05:41:58.943506+0000","last_clean":"2024-09-17T05:41:58.943506+0000","last_became_active":"2024-09-17T05:41:57.952871+0000","last_became_peered":"2024-09-17T05:41:57.952871+0000","last_unstale":"2024-09-17T05:41:58.943506+0000","last_undegraded":"2024-09-17T05:41:58.943506+0000","last_fullsized":"2024-09-17T05:41:58.943506+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_clean_scrub_stamp":"2024-09-17T05:41:56.913963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:52:02.839445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T05:41:59.016408+0000","last_change":"2024-09-17T05:41:57.956110+0000","last_active":"2024-09-17T05:41:59.016408+0000","last_peered":"2024-09-17T05:41:59.016408+0000","last_clean":"2024-09-17T05:41:59.016408+0000","last_became_active":"2024-09-17T05:41:57.955123+0000","last_became_peered":"2024-09-17T05:41:57.955123+0000","last_unstale":"2024-09-17T05:41:59.016408+0000","last_undegraded":"2024-09-17T05:41:59.016408+0000","last_fullsized":"2024-09-17T05:41:59.016408+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_clean_scrub_stamp":"2024-09-17T05:41:56.913963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:10:39.584426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T05:41:58.942679+0000","last_change":"2024-09-17T05:41:57.946022+0000","last_active":"2024-09-17T05:41:58.942679+0000","last_peered":"2024-09-17T05:41:58.942679+0000","last_clean":"2024-09-17T05:41:58.942679+0000","last_became_active":"2024-09-17T05:41:57.945669+0000","last_became_peered":"2024-09-17T05:41:57.945669+0000","last_unstale":"2024-09-17T05:41:58.942679+0000","last_undegraded":"2024-09-17T05:41:58.942679+0000","last_fullsized":"2024-09-17T05:41:58.942679+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_clean_scrub_stamp":"2024-09-17T05:41:56.913963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:38:43.072798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T05:41:59.474646+0000","last_change":"2024-09-17T05:41:57.950142+0000","last_active":"2024-09-17T05:41:59.474646+0000","last_peered":"2024-09-17T05:41:59.474646+0000","last_clean":"2024-09-17T05:41:59.474646+0000","last_became_active":"2024-09-17T05:41:57.949825+0000","last_became_peered":"2024-09-17T05:41:57.949825+0000","last_unstale":"2024-09-17T05:41:59.474646+0000","last_undegraded":"2024-09-17T05:41:59.474646+0000","last_fullsized":"2024-09-17T05:41:59.474646+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_clean_scrub_stamp":"2024-09-17T05:41:56.913963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:50:10.770545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T05:41:59.474168+0000","last_change":"2024-09-17T05:41:57.952716+0000","last_active":"2024-09-17T05:41:59.474168+0000","last_peered":"2024-09-17T05:41:59.474168+0000","last_clean":"2024-09-17T05:41:59.474168+0000","last_became_active":"2024-09-17T05:41:57.952394+0000","last_became_peered":"2024-09-17T05:41:57.952394+0000","last_unstale":"2024-09-17T05:41:59.474168+0000","last_undegraded":"2024-09-17T05:41:59.474168+0000","last_fullsized":"2024-09-17T05:41:59.474168+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_clean_scrub_stamp":"2024-09-17T05:41:56.913963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:29:37.607962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T05:41:58.944411+0000","last_change":"2024-09-17T05:41:57.960244+0000","last_active":"2024-09-17T05:41:58.944411+0000","last_peered":"2024-09-17T05:41:58.944411+0000","last_clean":"2024-09-17T05:41:58.944411+0000","last_became_active":"2024-09-17T05:41:57.959886+0000","last_became_peered":"2024-09-17T05:41:57.959886+0000","last_unstale":"2024-09-17T05:41:58.944411+0000","last_undegraded":"2024-09-17T05:41:58.944411+0000","last_fullsized":"2024-09-17T05:41:58.944411+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_clean_scrub_stamp":"2024-09-17T05:41:56.913963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:28:48.325328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T05:41:58.945844+0000","last_change":"2024-09-17T05:41:57.949489+0000","last_active":"2024-09-17T05:41:58.945844+0000","last_peered":"2024-09-17T05:41:58.945844+0000","last_clean":"2024-09-17T05:41:58.945844+0000","last_became_active":"2024-09-17T05:41:57.949140+0000","last_became_peered":"2024-09-17T05:41:57.949140+0000","last_unstale":"2024-09-17T05:41:58.945844+0000","last_undegraded":"2024-09-17T05:41:58.945844+0000","last_fullsized":"2024-09-17T05:41:58.945844+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_clean_scrub_stamp":"2024-09-17T05:41:56.913963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:51:10.975005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T05:41:59.439183+0000","last_change":"2024-09-17T05:41:57.958252+0000","last_active":"2024-09-17T05:41:59.439183+0000","last_peered":"2024-09-17T05:41:59.439183+0000","last_clean":"2024-09-17T05:41:59.439183+0000","last_became_active":"2024-09-17T05:41:57.957880+0000","last_became_peered":"2024-09-17T05:41:57.957880+0000","last_unstale":"2024-09-17T05:41:59.439183+0000","last_undegraded":"2024-09-17T05:41:59.439183+0000","last_fullsized":"2024-09-17T05:41:59.439183+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_clean_scrub_stamp":"2024-09-17T05:41:56.913963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:47:33.448576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T05:41:59.475674+0000","last_change":"2024-09-17T05:41:57.953128+0000","last_active":"2024-09-17T05:41:59.475674+0000","last_peered":"2024-09-17T05:41:59.475674+0000","last_clean":"2024-09-17T05:41:59.475674+0000","last_became_active":"2024-09-17T05:41:57.952806+0000","last_became_peered":"2024-09-17T05:41:57.952806+0000","last_unstale":"2024-09-17T05:41:59.475674+0000","last_undegraded":"2024-09-17T05:41:59.475674+0000","last_fullsized":"2024-09-17T05:41:59.475674+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_clean_scrub_stamp":"2024-09-17T05:41:56.913963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:51:10.975005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T05:41:58.943895+0000","last_change":"2024-09-17T05:41:57.960997+0000","last_active":"2024-09-17T05:41:58.943895+0000","last_peered":"2024-09-17T05:41:58.943895+0000","last_clean":"2024-09-17T05:41:58.943895+0000","last_became_active":"2024-09-17T05:41:57.960632+0000","last_became_peered":"2024-09-17T05:41:57.960632+0000","last_unstale":"2024-09-17T05:41:58.943895+0000","last_undegraded":"2024-09-17T05:41:58.943895+0000","last_fullsized":"2024-09-17T05:41:58.943895+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_clean_scrub_stamp":"2024-09-17T05:41:56.913963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:08:48.763013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T05:41:59.474890+0000","last_change":"2024-09-17T05:41:57.952830+0000","last_active":"2024-09-17T05:41:59.474890+0000","last_peered":"2024-09-17T05:41:59.474890+0000","last_clean":"2024-09-17T05:41:59.474890+0000","last_became_active":"2024-09-17T05:41:57.952504+0000","last_became_peered":"2024-09-17T05:41:57.952504+0000","last_unstale":"2024-09-17T05:41:59.474890+0000","last_undegraded":"2024-09-17T05:41:59.474890+0000","last_fullsized":"2024-09-17T05:41:59.474890+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_clean_scrub_stamp":"2024-09-17T05:41:56.913963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:31:01.180867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T05:41:58.944890+0000","last_change":"2024-09-17T05:41:57.959379+0000","last_active":"2024-09-17T05:41:58.944890+0000","last_peered":"2024-09-17T05:41:58.944890+0000","last_clean":"2024-09-17T05:41:58.944890+0000","last_became_active":"2024-09-17T05:41:57.956766+0000","last_became_peered":"2024-09-17T05:41:57.956766+0000","last_unstale":"2024-09-17T05:41:58.944890+0000","last_undegraded":"2024-09-17T05:41:58.944890+0000","last_fullsized":"2024-09-17T05:41:58.944890+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_clean_scrub_stamp":"2024-09-17T05:41:56.913963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:19:32.094334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T05:41:58.942336+0000","last_change":"2024-09-17T05:41:57.933829+0000","last_active":"2024-09-17T05:41:58.942336+0000","last_peered":"2024-09-17T05:41:58.942336+0000","last_clean":"2024-09-17T05:41:58.942336+0000","last_became_active":"2024-09-17T05:41:57.933493+0000","last_became_peered":"2024-09-17T05:41:57.933493+0000","last_unstale":"2024-09-17T05:41:58.942336+0000","last_undegraded":"2024-09-17T05:41:58.942336+0000","last_fullsized":"2024-09-17T05:41:58.942336+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_clean_scrub_stamp":"2024-09-17T05:41:56.913963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:47:26.590424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T05:41:58.944662+0000","last_change":"2024-09-17T05:41:57.956168+0000","last_active":"2024-09-17T05:41:58.944662+0000","last_peered":"2024-09-17T05:41:58.944662+0000","last_clean":"2024-09-17T05:41:58.944662+0000","last_became_active":"2024-09-17T05:41:57.955795+0000","last_became_peered":"2024-09-17T05:41:57.955795+0000","last_unstale":"2024-09-17T05:41:58.944662+0000","last_undegraded":"2024-09-17T05:41:58.944662+0000","last_fullsized":"2024-09-17T05:41:58.944662+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_clean_scrub_stamp":"2024-09-17T05:41:56.913963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:58:14.523021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T05:41:58.942694+0000","last_change":"2024-09-17T05:41:57.935453+0000","last_active":"2024-09-17T05:41:58.942694+0000","last_peered":"2024-09-17T05:41:58.942694+0000","last_clean":"2024-09-17T05:41:58.942694+0000","last_became_active":"2024-09-17T05:41:57.935059+0000","last_became_peered":"2024-09-17T05:41:57.935059+0000","last_unstale":"2024-09-17T05:41:58.942694+0000","last_undegraded":"2024-09-17T05:41:58.942694+0000","last_fullsized":"2024-09-17T05:41:58.942694+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_clean_scrub_stamp":"2024-09-17T05:41:56.913963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:28:48.325328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T05:41:58.943835+0000","last_change":"2024-09-17T05:41:57.953726+0000","last_active":"2024-09-17T05:41:58.943835+0000","last_peered":"2024-09-17T05:41:58.943835+0000","last_clean":"2024-09-17T05:41:58.943835+0000","last_became_active":"2024-09-17T05:41:57.953078+0000","last_became_peered":"2024-09-17T05:41:57.953078+0000","last_unstale":"2024-09-17T05:41:58.943835+0000","last_undegraded":"2024-09-17T05:41:58.943835+0000","last_fullsized":"2024-09-17T05:41:58.943835+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_clean_scrub_stamp":"2024-09-17T05:41:56.913963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:25:59.519887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T05:41:59.474493+0000","last_change":"2024-09-17T05:41:57.957328+0000","last_active":"2024-09-17T05:41:59.474493+0000","last_peered":"2024-09-17T05:41:59.474493+0000","last_clean":"2024-09-17T05:41:59.474493+0000","last_became_active":"2024-09-17T05:41:57.956969+0000","last_became_peered":"2024-09-17T05:41:57.956969+0000","last_unstale":"2024-09-17T05:41:59.474493+0000","last_undegraded":"2024-09-17T05:41:59.474493+0000","last_fullsized":"2024-09-17T05:41:59.474493+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_clean_scrub_stamp":"2024-09-17T05:41:56.913963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:28:48.325328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T05:41:58.943020+0000","last_change":"2024-09-17T05:41:57.934895+0000","last_active":"2024-09-17T05:41:58.943020+0000","last_peered":"2024-09-17T05:41:58.943020+0000","last_clean":"2024-09-17T05:41:58.943020+0000","last_became_active":"2024-09-17T05:41:57.934411+0000","last_became_peered":"2024-09-17T05:41:57.934411+0000","last_unstale":"2024-09-17T05:41:58.943020+0000","last_undegraded":"2024-09-17T05:41:58.943020+0000","last_fullsized":"2024-09-17T05:41:58.943020+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_clean_scrub_stamp":"2024-09-17T05:41:56.913963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:25:08.628947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T05:41:59.474943+0000","last_change":"2024-09-17T05:41:57.948114+0000","last_active":"2024-09-17T05:41:59.474943+0000","last_peered":"2024-09-17T05:41:59.474943+0000","last_clean":"2024-09-17T05:41:59.474943+0000","last_became_active":"2024-09-17T05:41:57.947671+0000","last_became_peered":"2024-09-17T05:41:57.947671+0000","last_unstale":"2024-09-17T05:41:59.474943+0000","last_undegraded":"2024-09-17T05:41:59.474943+0000","last_fullsized":"2024-09-17T05:41:59.474943+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_clean_scrub_stamp":"2024-09-17T05:41:56.913963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:39:02.325349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T05:41:58.945079+0000","last_change":"2024-09-17T05:41:57.960551+0000","last_active":"2024-09-17T05:41:58.945079+0000","last_peered":"2024-09-17T05:41:58.945079+0000","last_clean":"2024-09-17T05:41:58.945079+0000","last_became_active":"2024-09-17T05:41:57.959025+0000","last_became_peered":"2024-09-17T05:41:57.959025+0000","last_unstale":"2024-09-17T05:41:58.945079+0000","last_undegraded":"2024-09-17T05:41:58.945079+0000","last_fullsized":"2024-09-17T05:41:58.945079+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_clean_scrub_stamp":"2024-09-17T05:41:56.913963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:25:08.628947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T05:41:59.439140+0000","last_change":"2024-09-17T05:41:57.944300+0000","last_active":"2024-09-17T05:41:59.439140+0000","last_peered":"2024-09-17T05:41:59.439140+0000","last_clean":"2024-09-17T05:41:59.439140+0000","last_became_active":"2024-09-17T05:41:57.943968+0000","last_became_peered":"2024-09-17T05:41:57.943968+0000","last_unstale":"2024-09-17T05:41:59.439140+0000","last_undegraded":"2024-09-17T05:41:59.439140+0000","last_fullsized":"2024-09-17T05:41:59.439140+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_clean_scrub_stamp":"2024-09-17T05:41:56.913963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:10:39.584426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T05:41:58.943325+0000","last_change":"2024-09-17T05:41:57.961208+0000","last_active":"2024-09-17T05:41:58.943325+0000","last_peered":"2024-09-17T05:41:58.943325+0000","last_clean":"2024-09-17T05:41:58.943325+0000","last_became_active":"2024-09-17T05:41:57.960878+0000","last_became_peered":"2024-09-17T05:41:57.960878+0000","last_unstale":"2024-09-17T05:41:58.943325+0000","last_undegraded":"2024-09-17T05:41:58.943325+0000","last_fullsized":"2024-09-17T05:41:58.943325+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_clean_scrub_stamp":"2024-09-17T05:41:56.913963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:12:19.292703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T05:41:59.016320+0000","last_change":"2024-09-17T05:41:57.941348+0000","last_active":"2024-09-17T05:41:59.016320+0000","last_peered":"2024-09-17T05:41:59.016320+0000","last_clean":"2024-09-17T05:41:59.016320+0000","last_became_active":"2024-09-17T05:41:57.940996+0000","last_became_peered":"2024-09-17T05:41:57.940996+0000","last_unstale":"2024-09-17T05:41:59.016320+0000","last_undegraded":"2024-09-17T05:41:59.016320+0000","last_fullsized":"2024-09-17T05:41:59.016320+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_clean_scrub_stamp":"2024-09-17T05:41:56.913963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:16:33.582921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"22'1","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T05:41:58.942753+0000","last_change":"2024-09-17T05:41:56.942225+0000","last_active":"2024-09-17T05:41:58.942753+0000","last_peered":"2024-09-17T05:41:58.942753+0000","last_clean":"2024-09-17T05:41:58.942753+0000","last_became_active":"2024-09-17T05:41:56.941896+0000","last_became_peered":"2024-09-17T05:41:56.941896+0000","last_unstale":"2024-09-17T05:41:58.942753+0000","last_undegraded":"2024-09-17T05:41:58.942753+0000","last_fullsized":"2024-09-17T05:41:58.942753+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:55.904533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:55.904533+0000","last_clean_scrub_stamp":"2024-09-17T05:41:55.904533+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:52:11.112857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T05:41:59.475111+0000","last_change":"2024-09-17T05:41:57.943603+0000","last_active":"2024-09-17T05:41:59.475111+0000","last_peered":"2024-09-17T05:41:59.475111+0000","last_clean":"2024-09-17T05:41:59.475111+0000","last_became_active":"2024-09-17T05:41:57.942873+0000","last_became_peered":"2024-09-17T05:41:57.942873+0000","last_unstale":"2024-09-17T05:41:59.475111+0000","last_undegraded":"2024-09-17T05:41:59.475111+0000","last_fullsized":"2024-09-17T05:41:59.475111+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_clean_scrub_stamp":"2024-09-17T05:41:56.913963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:09:10.790006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"22'1","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T05:41:58.943600+0000","last_change":"2024-09-17T05:41:56.940706+0000","last_active":"2024-09-17T05:41:58.943600+0000","last_peered":"2024-09-17T05:41:58.943600+0000","last_clean":"2024-09-17T05:41:58.943600+0000","last_became_active":"2024-09-17T05:41:56.940324+0000","last_became_peered":"2024-09-17T05:41:56.940324+0000","last_unstale":"2024-09-17T05:41:58.943600+0000","last_undegraded":"2024-09-17T05:41:58.943600+0000","last_fullsized":"2024-09-17T05:41:58.943600+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:55.904533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:55.904533+0000","last_clean_scrub_stamp":"2024-09-17T05:41:55.904533+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:58:41.828120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T05:41:58.942401+0000","last_change":"2024-09-17T05:41:56.941270+0000","last_active":"2024-09-17T05:41:58.942401+0000","last_peered":"2024-09-17T05:41:58.942401+0000","last_clean":"2024-09-17T05:41:58.942401+0000","last_became_active":"2024-09-17T05:41:56.940963+0000","last_became_peered":"2024-09-17T05:41:56.940963+0000","last_unstale":"2024-09-17T05:41:58.942401+0000","last_undegraded":"2024-09-17T05:41:58.942401+0000","last_fullsized":"2024-09-17T05:41:58.942401+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:55.904533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:55.904533+0000","last_clean_scrub_stamp":"2024-09-17T05:41:55.904533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:05:42.524613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T05:41:58.942321+0000","last_change":"2024-09-17T05:41:57.945651+0000","last_active":"2024-09-17T05:41:58.942321+0000","last_peered":"2024-09-17T05:41:58.942321+0000","last_clean":"2024-09-17T05:41:58.942321+0000","last_became_active":"2024-09-17T05:41:57.945322+0000","last_became_peered":"2024-09-17T05:41:57.945322+0000","last_unstale":"2024-09-17T05:41:58.942321+0000","last_undegraded":"2024-09-17T05:41:58.942321+0000","last_fullsized":"2024-09-17T05:41:58.942321+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_clean_scrub_stamp":"2024-09-17T05:41:56.913963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:29:37.607962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T05:41:58.944500+0000","last_change":"2024-09-17T05:41:56.937560+0000","last_active":"2024-09-17T05:41:58.944500+0000","last_peered":"2024-09-17T05:41:58.944500+0000","last_clean":"2024-09-17T05:41:58.944500+0000","last_became_active":"2024-09-17T05:41:56.937222+0000","last_became_peered":"2024-09-17T05:41:56.937222+0000","last_unstale":"2024-09-17T05:41:58.944500+0000","last_undegraded":"2024-09-17T05:41:58.944500+0000","last_fullsized":"2024-09-17T05:41:58.944500+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:55.904533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:55.904533+0000","last_clean_scrub_stamp":"2024-09-17T05:41:55.904533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:44:48.206421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T05:41:59.474386+0000","last_change":"2024-09-17T05:41:57.956574+0000","last_active":"2024-09-17T05:41:59.474386+0000","last_peered":"2024-09-17T05:41:59.474386+0000","last_clean":"2024-09-17T05:41:59.474386+0000","last_became_active":"2024-09-17T05:41:57.956273+0000","last_became_peered":"2024-09-17T05:41:57.956273+0000","last_unstale":"2024-09-17T05:41:59.474386+0000","last_undegraded":"2024-09-17T05:41:59.474386+0000","last_fullsized":"2024-09-17T05:41:59.474386+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_clean_scrub_stamp":"2024-09-17T05:41:56.913963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:38:43.072798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T05:41:58.943638+0000","last_change":"2024-09-17T05:41:56.949682+0000","last_active":"2024-09-17T05:41:58.943638+0000","last_peered":"2024-09-17T05:41:58.943638+0000","last_clean":"2024-09-17T05:41:58.943638+0000","last_became_active":"2024-09-17T05:41:56.949271+0000","last_became_peered":"2024-09-17T05:41:56.949271+0000","last_unstale":"2024-09-17T05:41:58.943638+0000","last_undegraded":"2024-09-17T05:41:58.943638+0000","last_fullsized":"2024-09-17T05:41:58.943638+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:55.904533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:55.904533+0000","last_clean_scrub_stamp":"2024-09-17T05:41:55.904533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:54:22.588557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T05:41:58.945643+0000","last_change":"2024-09-17T05:41:57.950606+0000","last_active":"2024-09-17T05:41:58.945643+0000","last_peered":"2024-09-17T05:41:58.945643+0000","last_clean":"2024-09-17T05:41:58.945643+0000","last_became_active":"2024-09-17T05:41:57.950284+0000","last_became_peered":"2024-09-17T05:41:57.950284+0000","last_unstale":"2024-09-17T05:41:58.945643+0000","last_undegraded":"2024-09-17T05:41:58.945643+0000","last_fullsized":"2024-09-17T05:41:58.945643+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_clean_scrub_stamp":"2024-09-17T05:41:56.913963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:20:54.930864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T05:41:58.945336+0000","last_change":"2024-09-17T05:41:56.946865+0000","last_active":"2024-09-17T05:41:58.945336+0000","last_peered":"2024-09-17T05:41:58.945336+0000","last_clean":"2024-09-17T05:41:58.945336+0000","last_became_active":"2024-09-17T05:41:56.946178+0000","last_became_peered":"2024-09-17T05:41:56.946178+0000","last_unstale":"2024-09-17T05:41:58.945336+0000","last_undegraded":"2024-09-17T05:41:58.945336+0000","last_fullsized":"2024-09-17T05:41:58.945336+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:55.904533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:55.904533+0000","last_clean_scrub_stamp":"2024-09-17T05:41:55.904533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:13:02.431112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T05:41:59.475067+0000","last_change":"2024-09-17T05:41:57.948150+0000","last_active":"2024-09-17T05:41:59.475067+0000","last_peered":"2024-09-17T05:41:59.475067+0000","last_clean":"2024-09-17T05:41:59.475067+0000","last_became_active":"2024-09-17T05:41:57.947204+0000","last_became_peered":"2024-09-17T05:41:57.947204+0000","last_unstale":"2024-09-17T05:41:59.475067+0000","last_undegraded":"2024-09-17T05:41:59.475067+0000","last_fullsized":"2024-09-17T05:41:59.475067+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_clean_scrub_stamp":"2024-09-17T05:41:56.913963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:54:14.610066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"22'3","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T05:41:59.474459+0000","last_change":"2024-09-17T05:41:56.944839+0000","last_active":"2024-09-17T05:41:59.474459+0000","last_peered":"2024-09-17T05:41:59.474459+0000","last_clean":"2024-09-17T05:41:59.474459+0000","last_became_active":"2024-09-17T05:41:56.944471+0000","last_became_peered":"2024-09-17T05:41:56.944471+0000","last_unstale":"2024-09-17T05:41:59.474459+0000","last_undegraded":"2024-09-17T05:41:59.474459+0000","last_fullsized":"2024-09-17T05:41:59.474459+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:55.904533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:55.904533+0000","last_clean_scrub_stamp":"2024-09-17T05:41:55.904533+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:56:02.887851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T05:41:59.016465+0000","last_change":"2024-09-17T05:41:57.949459+0000","last_active":"2024-09-17T05:41:59.016465+0000","last_peered":"2024-09-17T05:41:59.016465+0000","last_clean":"2024-09-17T05:41:59.016465+0000","last_became_active":"2024-09-17T05:41:57.949148+0000","last_became_peered":"2024-09-17T05:41:57.949148+0000","last_unstale":"2024-09-17T05:41:59.016465+0000","last_undegraded":"2024-09-17T05:41:59.016465+0000","last_fullsized":"2024-09-17T05:41:59.016465+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_clean_scrub_stamp":"2024-09-17T05:41:56.913963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:47:33.448576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"22'6","reported_seq":21,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T05:41:58.943864+0000","last_change":"2024-09-17T05:41:56.951074+0000","last_active":"2024-09-17T05:41:58.943864+0000","last_peered":"2024-09-17T05:41:58.943864+0000","last_clean":"2024-09-17T05:41:58.943864+0000","last_became_active":"2024-09-17T05:41:56.950549+0000","last_became_peered":"2024-09-17T05:41:56.950549+0000","last_unstale":"2024-09-17T05:41:58.943864+0000","last_undegraded":"2024-09-17T05:41:58.943864+0000","last_fullsized":"2024-09-17T05:41:58.943864+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:55.904533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:55.904533+0000","last_clean_scrub_stamp":"2024-09-17T05:41:55.904533+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:07:52.122462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T05:41:59.475337+0000","last_change":"2024-09-17T05:41:57.951740+0000","last_active":"2024-09-17T05:41:59.475337+0000","last_peered":"2024-09-17T05:41:59.475337+0000","last_clean":"2024-09-17T05:41:59.475337+0000","last_became_active":"2024-09-17T05:41:57.949411+0000","last_became_peered":"2024-09-17T05:41:57.949411+0000","last_unstale":"2024-09-17T05:41:59.475337+0000","last_undegraded":"2024-09-17T05:41:59.475337+0000","last_fullsized":"2024-09-17T05:41:59.475337+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_clean_scrub_stamp":"2024-09-17T05:41:56.913963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:46:38.117672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"22'2","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T05:41:59.475117+0000","last_change":"2024-09-17T05:41:56.939288+0000","last_active":"2024-09-17T05:41:59.475117+0000","last_peered":"2024-09-17T05:41:59.475117+0000","last_clean":"2024-09-17T05:41:59.475117+0000","last_became_active":"2024-09-17T05:41:56.938951+0000","last_became_peered":"2024-09-17T05:41:56.938951+0000","last_unstale":"2024-09-17T05:41:59.475117+0000","last_undegraded":"2024-09-17T05:41:59.475117+0000","last_fullsized":"2024-09-17T05:41:59.475117+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:55.904533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:55.904533+0000","last_clean_scrub_stamp":"2024-09-17T05:41:55.904533+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:41:47.665206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T05:41:59.474748+0000","last_change":"2024-09-17T05:41:57.953556+0000","last_active":"2024-09-17T05:41:59.474748+0000","last_peered":"2024-09-17T05:41:59.474748+0000","last_clean":"2024-09-17T05:41:59.474748+0000","last_became_active":"2024-09-17T05:41:57.953229+0000","last_became_peered":"2024-09-17T05:41:57.953229+0000","last_unstale":"2024-09-17T05:41:59.474748+0000","last_undegraded":"2024-09-17T05:41:59.474748+0000","last_fullsized":"2024-09-17T05:41:59.474748+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_clean_scrub_stamp":"2024-09-17T05:41:56.913963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:57:29.940550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T05:41:58.944960+0000","last_change":"2024-09-17T05:41:56.951172+0000","last_active":"2024-09-17T05:41:58.944960+0000","last_peered":"2024-09-17T05:41:58.944960+0000","last_clean":"2024-09-17T05:41:58.944960+0000","last_became_active":"2024-09-17T05:41:56.950572+0000","last_became_peered":"2024-09-17T05:41:56.950572+0000","last_unstale":"2024-09-17T05:41:58.944960+0000","last_undegraded":"2024-09-17T05:41:58.944960+0000","last_fullsized":"2024-09-17T05:41:58.944960+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:55.904533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:55.904533+0000","last_clean_scrub_stamp":"2024-09-17T05:41:55.904533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:48:08.016947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T05:41:59.475097+0000","last_change":"2024-09-17T05:41:57.948898+0000","last_active":"2024-09-17T05:41:59.475097+0000","last_peered":"2024-09-17T05:41:59.475097+0000","last_clean":"2024-09-17T05:41:59.475097+0000","last_became_active":"2024-09-17T05:41:57.948128+0000","last_became_peered":"2024-09-17T05:41:57.948128+0000","last_unstale":"2024-09-17T05:41:59.475097+0000","last_undegraded":"2024-09-17T05:41:59.475097+0000","last_fullsized":"2024-09-17T05:41:59.475097+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_clean_scrub_stamp":"2024-09-17T05:41:56.913963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:48:25.095548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T05:41:58.943359+0000","last_change":"2024-09-17T05:41:56.946833+0000","last_active":"2024-09-17T05:41:58.943359+0000","last_peered":"2024-09-17T05:41:58.943359+0000","last_clean":"2024-09-17T05:41:58.943359+0000","last_became_active":"2024-09-17T05:41:56.946545+0000","last_became_peered":"2024-09-17T05:41:56.946545+0000","last_unstale":"2024-09-17T05:41:58.943359+0000","last_undegraded":"2024-09-17T05:41:58.943359+0000","last_fullsized":"2024-09-17T05:41:58.943359+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:55.904533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:55.904533+0000","last_clean_scrub_stamp":"2024-09-17T05:41:55.904533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:09:48.472258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T05:41:58.943449+0000","last_change":"2024-09-17T05:41:57.959487+0000","last_active":"2024-09-17T05:41:58.943449+0000","last_peered":"2024-09-17T05:41:58.943449+0000","last_clean":"2024-09-17T05:41:58.943449+0000","last_became_active":"2024-09-17T05:41:57.959140+0000","last_became_peered":"2024-09-17T05:41:57.959140+0000","last_unstale":"2024-09-17T05:41:58.943449+0000","last_undegraded":"2024-09-17T05:41:58.943449+0000","last_fullsized":"2024-09-17T05:41:58.943449+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_clean_scrub_stamp":"2024-09-17T05:41:56.913963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:34:29.009088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"22'8","reported_seq":23,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T05:41:59.438858+0000","last_change":"2024-09-17T05:41:56.936984+0000","last_active":"2024-09-17T05:41:59.438858+0000","last_peered":"2024-09-17T05:41:59.438858+0000","last_clean":"2024-09-17T05:41:59.438858+0000","last_became_active":"2024-09-17T05:41:56.936527+0000","last_became_peered":"2024-09-17T05:41:56.936527+0000","last_unstale":"2024-09-17T05:41:59.438858+0000","last_undegraded":"2024-09-17T05:41:59.438858+0000","last_fullsized":"2024-09-17T05:41:59.438858+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:55.904533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:55.904533+0000","last_clean_scrub_stamp":"2024-09-17T05:41:55.904533+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:52:11.112857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T05:41:59.474947+0000","last_change":"2024-09-17T05:41:57.952945+0000","last_active":"2024-09-17T05:41:59.474947+0000","last_peered":"2024-09-17T05:41:59.474947+0000","last_clean":"2024-09-17T05:41:59.474947+0000","last_became_active":"2024-09-17T05:41:57.952616+0000","last_became_peered":"2024-09-17T05:41:57.952616+0000","last_unstale":"2024-09-17T05:41:59.474947+0000","last_undegraded":"2024-09-17T05:41:59.474947+0000","last_fullsized":"2024-09-17T05:41:59.474947+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_clean_scrub_stamp":"2024-09-17T05:41:56.913963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:01:33.862442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"22'1","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T05:41:59.016349+0000","last_change":"2024-09-17T05:41:56.940794+0000","last_active":"2024-09-17T05:41:59.016349+0000","last_peered":"2024-09-17T05:41:59.016349+0000","last_clean":"2024-09-17T05:41:59.016349+0000","last_became_active":"2024-09-17T05:41:56.940422+0000","last_became_peered":"2024-09-17T05:41:56.940422+0000","last_unstale":"2024-09-17T05:41:59.016349+0000","last_undegraded":"2024-09-17T05:41:59.016349+0000","last_fullsized":"2024-09-17T05:41:59.016349+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:55.904533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:55.904533+0000","last_clean_scrub_stamp":"2024-09-17T05:41:55.904533+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:54:47.244836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T05:41:59.475443+0000","last_change":"2024-09-17T05:41:57.947961+0000","last_active":"2024-09-17T05:41:59.475443+0000","last_peered":"2024-09-17T05:41:59.475443+0000","last_clean":"2024-09-17T05:41:59.475443+0000","last_became_active":"2024-09-17T05:41:57.947614+0000","last_became_peered":"2024-09-17T05:41:57.947614+0000","last_unstale":"2024-09-17T05:41:59.475443+0000","last_undegraded":"2024-09-17T05:41:59.475443+0000","last_fullsized":"2024-09-17T05:41:59.475443+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_clean_scrub_stamp":"2024-09-17T05:41:56.913963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:43:21.632222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"22'2","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T05:41:59.439083+0000","last_change":"2024-09-17T05:41:56.945839+0000","last_active":"2024-09-17T05:41:59.439083+0000","last_peered":"2024-09-17T05:41:59.439083+0000","last_clean":"2024-09-17T05:41:59.439083+0000","last_became_active":"2024-09-17T05:41:56.945482+0000","last_became_peered":"2024-09-17T05:41:56.945482+0000","last_unstale":"2024-09-17T05:41:59.439083+0000","last_undegraded":"2024-09-17T05:41:59.439083+0000","last_fullsized":"2024-09-17T05:41:59.439083+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:55.904533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:55.904533+0000","last_clean_scrub_stamp":"2024-09-17T05:41:55.904533+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:29:45.382484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T05:41:59.475905+0000","last_change":"2024-09-17T05:41:57.951359+0000","last_active":"2024-09-17T05:41:59.475905+0000","last_peered":"2024-09-17T05:41:59.475905+0000","last_clean":"2024-09-17T05:41:59.475905+0000","last_became_active":"2024-09-17T05:41:57.951044+0000","last_became_peered":"2024-09-17T05:41:57.951044+0000","last_unstale":"2024-09-17T05:41:59.475905+0000","last_undegraded":"2024-09-17T05:41:59.475905+0000","last_fullsized":"2024-09-17T05:41:59.475905+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_clean_scrub_stamp":"2024-09-17T05:41:56.913963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:02:29.481829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"22'1","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T05:41:59.474576+0000","last_change":"2024-09-17T05:41:56.933514+0000","last_active":"2024-09-17T05:41:59.474576+0000","last_peered":"2024-09-17T05:41:59.474576+0000","last_clean":"2024-09-17T05:41:59.474576+0000","last_became_active":"2024-09-17T05:41:56.932986+0000","last_became_peered":"2024-09-17T05:41:56.932986+0000","last_unstale":"2024-09-17T05:41:59.474576+0000","last_undegraded":"2024-09-17T05:41:59.474576+0000","last_fullsized":"2024-09-17T05:41:59.474576+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:55.904533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:55.904533+0000","last_clean_scrub_stamp":"2024-09-17T05:41:55.904533+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:28:05.866271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T05:41:58.945138+0000","last_change":"2024-09-17T05:41:57.946536+0000","last_active":"2024-09-17T05:41:58.945138+0000","last_peered":"2024-09-17T05:41:58.945138+0000","last_clean":"2024-09-17T05:41:58.945138+0000","last_became_active":"2024-09-17T05:41:57.946168+0000","last_became_peered":"2024-09-17T05:41:57.946168+0000","last_unstale":"2024-09-17T05:41:58.945138+0000","last_undegraded":"2024-09-17T05:41:58.945138+0000","last_fullsized":"2024-09-17T05:41:58.945138+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_clean_scrub_stamp":"2024-09-17T05:41:56.913963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:48:25.095548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T05:41:59.438980+0000","last_change":"2024-09-17T05:41:56.944626+0000","last_active":"2024-09-17T05:41:59.438980+0000","last_peered":"2024-09-17T05:41:59.438980+0000","last_clean":"2024-09-17T05:41:59.438980+0000","last_became_active":"2024-09-17T05:41:56.944259+0000","last_became_peered":"2024-09-17T05:41:56.944259+0000","last_unstale":"2024-09-17T05:41:59.438980+0000","last_undegraded":"2024-09-17T05:41:59.438980+0000","last_fullsized":"2024-09-17T05:41:59.438980+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:55.904533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:55.904533+0000","last_clean_scrub_stamp":"2024-09-17T05:41:55.904533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:48:09.067501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T05:41:59.475567+0000","last_change":"2024-09-17T05:41:57.958128+0000","last_active":"2024-09-17T05:41:59.475567+0000","last_peered":"2024-09-17T05:41:59.475567+0000","last_clean":"2024-09-17T05:41:59.475567+0000","last_became_active":"2024-09-17T05:41:57.957831+0000","last_became_peered":"2024-09-17T05:41:57.957831+0000","last_unstale":"2024-09-17T05:41:59.475567+0000","last_undegraded":"2024-09-17T05:41:59.475567+0000","last_fullsized":"2024-09-17T05:41:59.475567+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_clean_scrub_stamp":"2024-09-17T05:41:56.913963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:14:34.774799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"19'72","reported_seq":111,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T05:41:59.474999+0000","last_change":"2024-09-17T05:41:48.539830+0000","last_active":"2024-09-17T05:41:59.474999+0000","last_peered":"2024-09-17T05:41:59.474999+0000","last_clean":"2024-09-17T05:41:59.474999+0000","last_became_active":"2024-09-17T05:41:48.538743+0000","last_became_peered":"2024-09-17T05:41:48.538743+0000","last_unstale":"2024-09-17T05:41:59.474999+0000","last_undegraded":"2024-09-17T05:41:59.474999+0000","last_fullsized":"2024-09-17T05:41:59.474999+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:47.152539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:47.152539+0000","last_clean_scrub_stamp":"2024-09-17T05:41:47.152539+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:08:02.952016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T05:41:58.944539+0000","last_change":"2024-09-17T05:41:56.939827+0000","last_active":"2024-09-17T05:41:58.944539+0000","last_peered":"2024-09-17T05:41:58.944539+0000","last_clean":"2024-09-17T05:41:58.944539+0000","last_became_active":"2024-09-17T05:41:56.939471+0000","last_became_peered":"2024-09-17T05:41:56.939471+0000","last_unstale":"2024-09-17T05:41:58.944539+0000","last_undegraded":"2024-09-17T05:41:58.944539+0000","last_fullsized":"2024-09-17T05:41:58.944539+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:55.904533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:55.904533+0000","last_clean_scrub_stamp":"2024-09-17T05:41:55.904533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:50:15.165851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T05:41:58.942493+0000","last_change":"2024-09-17T05:41:57.957954+0000","last_active":"2024-09-17T05:41:58.942493+0000","last_peered":"2024-09-17T05:41:58.942493+0000","last_clean":"2024-09-17T05:41:58.942493+0000","last_became_active":"2024-09-17T05:41:57.957629+0000","last_became_peered":"2024-09-17T05:41:57.957629+0000","last_unstale":"2024-09-17T05:41:58.942493+0000","last_undegraded":"2024-09-17T05:41:58.942493+0000","last_fullsized":"2024-09-17T05:41:58.942493+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_clean_scrub_stamp":"2024-09-17T05:41:56.913963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:04:12.932656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T05:41:59.474681+0000","last_change":"2024-09-17T05:41:56.952027+0000","last_active":"2024-09-17T05:41:59.474681+0000","last_peered":"2024-09-17T05:41:59.474681+0000","last_clean":"2024-09-17T05:41:59.474681+0000","last_became_active":"2024-09-17T05:41:56.951679+0000","last_became_peered":"2024-09-17T05:41:56.951679+0000","last_unstale":"2024-09-17T05:41:59.474681+0000","last_undegraded":"2024-09-17T05:41:59.474681+0000","last_fullsized":"2024-09-17T05:41:59.474681+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:55.904533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:55.904533+0000","last_clean_scrub_stamp":"2024-09-17T05:41:55.904533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:12:33.222805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T05:41:59.474246+0000","last_change":"2024-09-17T05:41:57.943470+0000","last_active":"2024-09-17T05:41:59.474246+0000","last_peered":"2024-09-17T05:41:59.474246+0000","last_clean":"2024-09-17T05:41:59.474246+0000","last_became_active":"2024-09-17T05:41:57.943015+0000","last_became_peered":"2024-09-17T05:41:57.943015+0000","last_unstale":"2024-09-17T05:41:59.474246+0000","last_undegraded":"2024-09-17T05:41:59.474246+0000","last_fullsized":"2024-09-17T05:41:59.474246+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_clean_scrub_stamp":"2024-09-17T05:41:56.913963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:42:36.013480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T05:41:59.438944+0000","last_change":"2024-09-17T05:41:56.939919+0000","last_active":"2024-09-17T05:41:59.438944+0000","last_peered":"2024-09-17T05:41:59.438944+0000","last_clean":"2024-09-17T05:41:59.438944+0000","last_became_active":"2024-09-17T05:41:56.939608+0000","last_became_peered":"2024-09-17T05:41:56.939608+0000","last_unstale":"2024-09-17T05:41:59.438944+0000","last_undegraded":"2024-09-17T05:41:59.438944+0000","last_fullsized":"2024-09-17T05:41:59.438944+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:55.904533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:55.904533+0000","last_clean_scrub_stamp":"2024-09-17T05:41:55.904533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:27:37.482839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T05:41:59.474317+0000","last_change":"2024-09-17T05:41:57.947137+0000","last_active":"2024-09-17T05:41:59.474317+0000","last_peered":"2024-09-17T05:41:59.474317+0000","last_clean":"2024-09-17T05:41:59.474317+0000","last_became_active":"2024-09-17T05:41:57.946767+0000","last_became_peered":"2024-09-17T05:41:57.946767+0000","last_unstale":"2024-09-17T05:41:59.474317+0000","last_undegraded":"2024-09-17T05:41:59.474317+0000","last_fullsized":"2024-09-17T05:41:59.474317+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_clean_scrub_stamp":"2024-09-17T05:41:56.913963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:04:12.932656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T05:41:58.945106+0000","last_change":"2024-09-17T05:41:56.938012+0000","last_active":"2024-09-17T05:41:58.945106+0000","last_peered":"2024-09-17T05:41:58.945106+0000","last_clean":"2024-09-17T05:41:58.945106+0000","last_became_active":"2024-09-17T05:41:56.937706+0000","last_became_peered":"2024-09-17T05:41:56.937706+0000","last_unstale":"2024-09-17T05:41:58.945106+0000","last_undegraded":"2024-09-17T05:41:58.945106+0000","last_fullsized":"2024-09-17T05:41:58.945106+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:55.904533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:55.904533+0000","last_clean_scrub_stamp":"2024-09-17T05:41:55.904533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:22:56.364485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T05:41:59.016310+0000","last_change":"2024-09-17T05:41:57.942237+0000","last_active":"2024-09-17T05:41:59.016310+0000","last_peered":"2024-09-17T05:41:59.016310+0000","last_clean":"2024-09-17T05:41:59.016310+0000","last_became_active":"2024-09-17T05:41:57.941725+0000","last_became_peered":"2024-09-17T05:41:57.941725+0000","last_unstale":"2024-09-17T05:41:59.016310+0000","last_undegraded":"2024-09-17T05:41:59.016310+0000","last_fullsized":"2024-09-17T05:41:59.016310+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_clean_scrub_stamp":"2024-09-17T05:41:56.913963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:22:57.373916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T05:41:59.474242+0000","last_change":"2024-09-17T05:41:56.939274+0000","last_active":"2024-09-17T05:41:59.474242+0000","last_peered":"2024-09-17T05:41:59.474242+0000","last_clean":"2024-09-17T05:41:59.474242+0000","last_became_active":"2024-09-17T05:41:56.938944+0000","last_became_peered":"2024-09-17T05:41:56.938944+0000","last_unstale":"2024-09-17T05:41:59.474242+0000","last_undegraded":"2024-09-17T05:41:59.474242+0000","last_fullsized":"2024-09-17T05:41:59.474242+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:55.904533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:55.904533+0000","last_clean_scrub_stamp":"2024-09-17T05:41:55.904533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:29:45.382484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T05:41:58.945559+0000","last_change":"2024-09-17T05:41:57.943883+0000","last_active":"2024-09-17T05:41:58.945559+0000","last_peered":"2024-09-17T05:41:58.945559+0000","last_clean":"2024-09-17T05:41:58.945559+0000","last_became_active":"2024-09-17T05:41:57.943565+0000","last_became_peered":"2024-09-17T05:41:57.943565+0000","last_unstale":"2024-09-17T05:41:58.945559+0000","last_undegraded":"2024-09-17T05:41:58.945559+0000","last_fullsized":"2024-09-17T05:41:58.945559+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_clean_scrub_stamp":"2024-09-17T05:41:56.913963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:14:34.774799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T05:41:59.475657+0000","last_change":"2024-09-17T05:41:56.950966+0000","last_active":"2024-09-17T05:41:59.475657+0000","last_peered":"2024-09-17T05:41:59.475657+0000","last_clean":"2024-09-17T05:41:59.475657+0000","last_became_active":"2024-09-17T05:41:56.950558+0000","last_became_peered":"2024-09-17T05:41:56.950558+0000","last_unstale":"2024-09-17T05:41:59.475657+0000","last_undegraded":"2024-09-17T05:41:59.475657+0000","last_fullsized":"2024-09-17T05:41:59.475657+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:55.904533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:55.904533+0000","last_clean_scrub_stamp":"2024-09-17T05:41:55.904533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:23:55.121185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T05:41:59.474260+0000","last_change":"2024-09-17T05:41:57.946228+0000","last_active":"2024-09-17T05:41:59.474260+0000","last_peered":"2024-09-17T05:41:59.474260+0000","last_clean":"2024-09-17T05:41:59.474260+0000","last_became_active":"2024-09-17T05:41:57.945883+0000","last_became_peered":"2024-09-17T05:41:57.945883+0000","last_unstale":"2024-09-17T05:41:59.474260+0000","last_undegraded":"2024-09-17T05:41:59.474260+0000","last_fullsized":"2024-09-17T05:41:59.474260+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_clean_scrub_stamp":"2024-09-17T05:41:56.913963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:47:26.590424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"23'1","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T05:41:59.474737+0000","last_change":"2024-09-17T05:41:56.944059+0000","last_active":"2024-09-17T05:41:59.474737+0000","last_peered":"2024-09-17T05:41:59.474737+0000","last_clean":"2024-09-17T05:41:59.474737+0000","last_became_active":"2024-09-17T05:41:56.943687+0000","last_became_peered":"2024-09-17T05:41:56.943687+0000","last_unstale":"2024-09-17T05:41:59.474737+0000","last_undegraded":"2024-09-17T05:41:59.474737+0000","last_fullsized":"2024-09-17T05:41:59.474737+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:55.904533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:55.904533+0000","last_clean_scrub_stamp":"2024-09-17T05:41:55.904533+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:45:41.328997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T05:41:58.942699+0000","last_change":"2024-09-17T05:41:57.952421+0000","last_active":"2024-09-17T05:41:58.942699+0000","last_peered":"2024-09-17T05:41:58.942699+0000","last_clean":"2024-09-17T05:41:58.942699+0000","last_became_active":"2024-09-17T05:41:57.952090+0000","last_became_peered":"2024-09-17T05:41:57.952090+0000","last_unstale":"2024-09-17T05:41:58.942699+0000","last_undegraded":"2024-09-17T05:41:58.942699+0000","last_fullsized":"2024-09-17T05:41:58.942699+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_clean_scrub_stamp":"2024-09-17T05:41:56.913963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:24:24.651104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"22'2","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T05:41:58.943750+0000","last_change":"2024-09-17T05:41:56.947816+0000","last_active":"2024-09-17T05:41:58.943750+0000","last_peered":"2024-09-17T05:41:58.943750+0000","last_clean":"2024-09-17T05:41:58.943750+0000","last_became_active":"2024-09-17T05:41:56.947483+0000","last_became_peered":"2024-09-17T05:41:56.947483+0000","last_unstale":"2024-09-17T05:41:58.943750+0000","last_undegraded":"2024-09-17T05:41:58.943750+0000","last_fullsized":"2024-09-17T05:41:58.943750+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:55.904533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:55.904533+0000","last_clean_scrub_stamp":"2024-09-17T05:41:55.904533+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:02:05.360497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T05:41:59.474648+0000","last_change":"2024-09-17T05:41:57.950209+0000","last_active":"2024-09-17T05:41:59.474648+0000","last_peered":"2024-09-17T05:41:59.474648+0000","last_clean":"2024-09-17T05:41:59.474648+0000","last_became_active":"2024-09-17T05:41:57.949869+0000","last_became_peered":"2024-09-17T05:41:57.949869+0000","last_unstale":"2024-09-17T05:41:59.474648+0000","last_undegraded":"2024-09-17T05:41:59.474648+0000","last_fullsized":"2024-09-17T05:41:59.474648+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_clean_scrub_stamp":"2024-09-17T05:41:56.913963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:04:39.620332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T05:41:59.474670+0000","last_change":"2024-09-17T05:41:56.950895+0000","last_active":"2024-09-17T05:41:59.474670+0000","last_peered":"2024-09-17T05:41:59.474670+0000","last_clean":"2024-09-17T05:41:59.474670+0000","last_became_active":"2024-09-17T05:41:56.950518+0000","last_became_peered":"2024-09-17T05:41:56.950518+0000","last_unstale":"2024-09-17T05:41:59.474670+0000","last_undegraded":"2024-09-17T05:41:59.474670+0000","last_fullsized":"2024-09-17T05:41:59.474670+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:55.904533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:55.904533+0000","last_clean_scrub_stamp":"2024-09-17T05:41:55.904533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:28:05.866271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T05:41:59.016224+0000","last_change":"2024-09-17T05:41:57.937269+0000","last_active":"2024-09-17T05:41:59.016224+0000","last_peered":"2024-09-17T05:41:59.016224+0000","last_clean":"2024-09-17T05:41:59.016224+0000","last_became_active":"2024-09-17T05:41:57.936899+0000","last_became_peered":"2024-09-17T05:41:57.936899+0000","last_unstale":"2024-09-17T05:41:59.016224+0000","last_undegraded":"2024-09-17T05:41:59.016224+0000","last_fullsized":"2024-09-17T05:41:59.016224+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_clean_scrub_stamp":"2024-09-17T05:41:56.913963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:48:09.026377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T05:41:59.474242+0000","last_change":"2024-09-17T05:41:56.942310+0000","last_active":"2024-09-17T05:41:59.474242+0000","last_peered":"2024-09-17T05:41:59.474242+0000","last_clean":"2024-09-17T05:41:59.474242+0000","last_became_active":"2024-09-17T05:41:56.941965+0000","last_became_peered":"2024-09-17T05:41:56.941965+0000","last_unstale":"2024-09-17T05:41:59.474242+0000","last_undegraded":"2024-09-17T05:41:59.474242+0000","last_fullsized":"2024-09-17T05:41:59.474242+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:55.904533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:55.904533+0000","last_clean_scrub_stamp":"2024-09-17T05:41:55.904533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:16:32.573490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T05:41:58.942903+0000","last_change":"2024-09-17T05:41:57.954269+0000","last_active":"2024-09-17T05:41:58.942903+0000","last_peered":"2024-09-17T05:41:58.942903+0000","last_clean":"2024-09-17T05:41:58.942903+0000","last_became_active":"2024-09-17T05:41:57.953932+0000","last_became_peered":"2024-09-17T05:41:57.953932+0000","last_unstale":"2024-09-17T05:41:58.942903+0000","last_undegraded":"2024-09-17T05:41:58.942903+0000","last_fullsized":"2024-09-17T05:41:58.942903+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_clean_scrub_stamp":"2024-09-17T05:41:56.913963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:01:33.862442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T05:41:59.474364+0000","last_change":"2024-09-17T05:41:56.940176+0000","last_active":"2024-09-17T05:41:59.474364+0000","last_peered":"2024-09-17T05:41:59.474364+0000","last_clean":"2024-09-17T05:41:59.474364+0000","last_became_active":"2024-09-17T05:41:56.939850+0000","last_became_peered":"2024-09-17T05:41:56.939850+0000","last_unstale":"2024-09-17T05:41:59.474364+0000","last_undegraded":"2024-09-17T05:41:59.474364+0000","last_fullsized":"2024-09-17T05:41:59.474364+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:55.904533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:55.904533+0000","last_clean_scrub_stamp":"2024-09-17T05:41:55.904533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:13:02.431112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T05:41:58.942709+0000","last_change":"2024-09-17T05:41:57.945639+0000","last_active":"2024-09-17T05:41:58.942709+0000","last_peered":"2024-09-17T05:41:58.942709+0000","last_clean":"2024-09-17T05:41:58.942709+0000","last_became_active":"2024-09-17T05:41:57.945277+0000","last_became_peered":"2024-09-17T05:41:57.945277+0000","last_unstale":"2024-09-17T05:41:58.942709+0000","last_undegraded":"2024-09-17T05:41:58.942709+0000","last_fullsized":"2024-09-17T05:41:58.942709+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_clean_scrub_stamp":"2024-09-17T05:41:56.913963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:05:25.111036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"22'2","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T05:41:59.475181+0000","last_change":"2024-09-17T05:41:56.948113+0000","last_active":"2024-09-17T05:41:59.475181+0000","last_peered":"2024-09-17T05:41:59.475181+0000","last_clean":"2024-09-17T05:41:59.475181+0000","last_became_active":"2024-09-17T05:41:56.947582+0000","last_became_peered":"2024-09-17T05:41:56.947582+0000","last_unstale":"2024-09-17T05:41:59.475181+0000","last_undegraded":"2024-09-17T05:41:59.475181+0000","last_fullsized":"2024-09-17T05:41:59.475181+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:55.904533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:55.904533+0000","last_clean_scrub_stamp":"2024-09-17T05:41:55.904533+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:16:32.573490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T05:41:58.943406+0000","last_change":"2024-09-17T05:41:57.956713+0000","last_active":"2024-09-17T05:41:58.943406+0000","last_peered":"2024-09-17T05:41:58.943406+0000","last_clean":"2024-09-17T05:41:58.943406+0000","last_became_active":"2024-09-17T05:41:57.956322+0000","last_became_peered":"2024-09-17T05:41:57.956322+0000","last_unstale":"2024-09-17T05:41:58.943406+0000","last_undegraded":"2024-09-17T05:41:58.943406+0000","last_fullsized":"2024-09-17T05:41:58.943406+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_clean_scrub_stamp":"2024-09-17T05:41:56.913963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:06:04.948499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T05:41:58.945377+0000","last_change":"2024-09-17T05:41:57.951802+0000","last_active":"2024-09-17T05:41:58.945377+0000","last_peered":"2024-09-17T05:41:58.945377+0000","last_clean":"2024-09-17T05:41:58.945377+0000","last_became_active":"2024-09-17T05:41:57.951316+0000","last_became_peered":"2024-09-17T05:41:57.951316+0000","last_unstale":"2024-09-17T05:41:58.945377+0000","last_undegraded":"2024-09-17T05:41:58.945377+0000","last_fullsized":"2024-09-17T05:41:58.945377+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_clean_scrub_stamp":"2024-09-17T05:41:56.913963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:46:38.117672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"22'2","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T05:41:59.474972+0000","last_change":"2024-09-17T05:41:56.949729+0000","last_active":"2024-09-17T05:41:59.474972+0000","last_peered":"2024-09-17T05:41:59.474972+0000","last_clean":"2024-09-17T05:41:59.474972+0000","last_became_active":"2024-09-17T05:41:56.949384+0000","last_became_peered":"2024-09-17T05:41:56.949384+0000","last_unstale":"2024-09-17T05:41:59.474972+0000","last_undegraded":"2024-09-17T05:41:59.474972+0000","last_fullsized":"2024-09-17T05:41:59.474972+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:55.904533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:55.904533+0000","last_clean_scrub_stamp":"2024-09-17T05:41:55.904533+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:45:41.328997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T05:41:58.945780+0000","last_change":"2024-09-17T05:41:57.951733+0000","last_active":"2024-09-17T05:41:58.945780+0000","last_peered":"2024-09-17T05:41:58.945780+0000","last_clean":"2024-09-17T05:41:58.945780+0000","last_became_active":"2024-09-17T05:41:57.951330+0000","last_became_peered":"2024-09-17T05:41:57.951330+0000","last_unstale":"2024-09-17T05:41:58.945780+0000","last_undegraded":"2024-09-17T05:41:58.945780+0000","last_fullsized":"2024-09-17T05:41:58.945780+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_clean_scrub_stamp":"2024-09-17T05:41:56.913963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:43:21.632222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"22'2","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T05:41:59.475418+0000","last_change":"2024-09-17T05:41:56.952616+0000","last_active":"2024-09-17T05:41:59.475418+0000","last_peered":"2024-09-17T05:41:59.475418+0000","last_clean":"2024-09-17T05:41:59.475418+0000","last_became_active":"2024-09-17T05:41:56.952230+0000","last_became_peered":"2024-09-17T05:41:56.952230+0000","last_unstale":"2024-09-17T05:41:59.475418+0000","last_undegraded":"2024-09-17T05:41:59.475418+0000","last_fullsized":"2024-09-17T05:41:59.475418+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:55.904533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:55.904533+0000","last_clean_scrub_stamp":"2024-09-17T05:41:55.904533+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:56:02.887851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T05:41:59.474952+0000","last_change":"2024-09-17T05:41:57.947899+0000","last_active":"2024-09-17T05:41:59.474952+0000","last_peered":"2024-09-17T05:41:59.474952+0000","last_clean":"2024-09-17T05:41:59.474952+0000","last_became_active":"2024-09-17T05:41:57.947556+0000","last_became_peered":"2024-09-17T05:41:57.947556+0000","last_unstale":"2024-09-17T05:41:59.474952+0000","last_undegraded":"2024-09-17T05:41:59.474952+0000","last_fullsized":"2024-09-17T05:41:59.474952+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_clean_scrub_stamp":"2024-09-17T05:41:56.913963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:54:13.215048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"22'1","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T05:41:58.942704+0000","last_change":"2024-09-17T05:41:56.940731+0000","last_active":"2024-09-17T05:41:58.942704+0000","last_peered":"2024-09-17T05:41:58.942704+0000","last_clean":"2024-09-17T05:41:58.942704+0000","last_became_active":"2024-09-17T05:41:56.939978+0000","last_became_peered":"2024-09-17T05:41:56.939978+0000","last_unstale":"2024-09-17T05:41:58.942704+0000","last_undegraded":"2024-09-17T05:41:58.942704+0000","last_fullsized":"2024-09-17T05:41:58.942704+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:55.904533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:55.904533+0000","last_clean_scrub_stamp":"2024-09-17T05:41:55.904533+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:48:09.067501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T05:41:58.942846+0000","last_change":"2024-09-17T05:41:57.956639+0000","last_active":"2024-09-17T05:41:58.942846+0000","last_peered":"2024-09-17T05:41:58.942846+0000","last_clean":"2024-09-17T05:41:58.942846+0000","last_became_active":"2024-09-17T05:41:57.956338+0000","last_became_peered":"2024-09-17T05:41:57.956338+0000","last_unstale":"2024-09-17T05:41:58.942846+0000","last_undegraded":"2024-09-17T05:41:58.942846+0000","last_fullsized":"2024-09-17T05:41:58.942846+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:56.913963+0000","last_clean_scrub_stamp":"2024-09-17T05:41:56.913963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:52:28.863641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"22'4","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T05:41:59.475203+0000","last_change":"2024-09-17T05:41:56.946707+0000","last_active":"2024-09-17T05:41:59.475203+0000","last_peered":"2024-09-17T05:41:59.475203+0000","last_clean":"2024-09-17T05:41:59.475203+0000","last_became_active":"2024-09-17T05:41:56.946448+0000","last_became_peered":"2024-09-17T05:41:56.946448+0000","last_unstale":"2024-09-17T05:41:59.475203+0000","last_undegraded":"2024-09-17T05:41:59.475203+0000","last_fullsized":"2024-09-17T05:41:59.475203+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:55.904533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:55.904533+0000","last_clean_scrub_stamp":"2024-09-17T05:41:55.904533+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:55:32.730864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":16,"seq":68719476745,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27272,"kb_used_data":240,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344568,"statfs":{"total":96636764160,"available":96608837632,"internally_reserved":0,"allocated":245760,"data_stored":83439,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":15,"seq":64424509449,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27840,"kb_used_data":812,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344000,"statfs":{"total":96636764160,"available":96608256000,"internally_reserved":0,"allocated":831488,"data_stored":672777,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509448,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27260,"kb_used_data":232,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344580,"statfs":{"total":96636764160,"available":96608849920,"internally_reserved":0,"allocated":237568,"data_stored":81917,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509448,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27268,"kb_used_data":240,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344572,"statfs":{"total":96636764160,"available":96608841728,"internally_reserved":0,"allocated":245760,"data_stored":81953,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509448,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27268,"kb_used_data":240,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344572,"statfs":{"total":96636764160,"available":96608841728,"internally_reserved":0,"allocated":245760,"data_stored":83439,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509448,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27264,"kb_used_data":228,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344576,"statfs":{"total":96636764160,"available":96608845824,"internally_reserved":0,"allocated":233472,"data_stored":81827,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509448,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27264,"kb_used_data":236,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344576,"statfs":{"total":96636764160,"available":96608845824,"internally_reserved":0,"allocated":241664,"data_stored":81987,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574856,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27848,"kb_used_data":820,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343992,"statfs":{"total":96636764160,"available":96608247808,"internally_reserved":0,"allocated":839680,"data_stored":672833,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-17T05:42:10.631 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-17T05:42:10.631 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-09-17T05:42:10.632 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2024-09-17T05:42:10.632 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-09-17T05:42:10.781 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:10.779+0000 7f41da00e640 1 -- 172.21.15.150:0/1586336724 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f41d406d8b0 msgr2=0x7f41d40cddd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:10.781 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:10.779+0000 7f41da00e640 1 --2- 172.21.15.150:0/1586336724 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f41d406d8b0 0x7f41d40cddd0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f41cc005fd0 tx=0x7f41cc02ab40 comp rx=0 tx=0).stop 2024-09-17T05:42:10.782 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:10.779+0000 7f41da00e640 1 -- 172.21.15.150:0/1586336724 shutdown_connections 2024-09-17T05:42:10.782 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:10.779+0000 7f41da00e640 1 --2- 172.21.15.150:0/1586336724 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f41d406d8b0 0x7f41d40cddd0 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:10.782 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:10.779+0000 7f41da00e640 1 -- 172.21.15.150:0/1586336724 >> 172.21.15.150:0/1586336724 conn(0x7f41d40b2e80 msgr2=0x7f41d40b3290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:42:10.782 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:10.779+0000 7f41da00e640 1 -- 172.21.15.150:0/1586336724 shutdown_connections 2024-09-17T05:42:10.782 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:10.779+0000 7f41da00e640 1 -- 172.21.15.150:0/1586336724 wait complete. 2024-09-17T05:42:10.782 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:10.781+0000 7f41da00e640 1 Processor -- start 2024-09-17T05:42:10.783 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:10.781+0000 7f41da00e640 1 -- start start 2024-09-17T05:42:10.786 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:10.783+0000 7f41da00e640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f41d406d8b0 0x7f41d415b150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:42:10.786 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:10.783+0000 7f41da00e640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f41d40b6bd0 0x7f41d40ca670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:42:10.786 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:10.783+0000 7f41da00e640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f41d40c4a00 0x7f41d40ae160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:42:10.786 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:10.783+0000 7f41da00e640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f41d40ce6a0 con 0x7f41d40c4a00 2024-09-17T05:42:10.786 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:10.783+0000 7f41da00e640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f41d40ce520 con 0x7f41d406d8b0 2024-09-17T05:42:10.786 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:10.783+0000 7f41da00e640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f41d40ce820 con 0x7f41d40b6bd0 2024-09-17T05:42:10.786 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:10.783+0000 7f41d3fff640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f41d40c4a00 0x7f41d40ae160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:42:10.786 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:10.783+0000 7f41d3fff640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f41d40c4a00 0x7f41d40ae160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:60224/0 (socket says 172.21.15.150:60224) 2024-09-17T05:42:10.786 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:10.783+0000 7f41d3fff640 1 -- 172.21.15.150:0/3419243741 learned_addr learned my addr 172.21.15.150:0/3419243741 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:42:10.787 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:10.783+0000 7f41d2ffd640 1 --2- 172.21.15.150:0/3419243741 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f41d40b6bd0 0x7f41d40ca670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:42:10.787 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:10.783+0000 7f41d37fe640 1 --2- 172.21.15.150:0/3419243741 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f41d406d8b0 0x7f41d415b150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:42:10.787 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:10.783+0000 7f41d3fff640 1 -- 172.21.15.150:0/3419243741 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f41d40b6bd0 msgr2=0x7f41d40ca670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:10.787 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:10.783+0000 7f41d3fff640 1 --2- 172.21.15.150:0/3419243741 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f41d40b6bd0 0x7f41d40ca670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:10.787 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:10.783+0000 7f41d3fff640 1 -- 172.21.15.150:0/3419243741 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f41d406d8b0 msgr2=0x7f41d415b150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:10.787 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:10.783+0000 7f41d3fff640 1 --2- 172.21.15.150:0/3419243741 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f41d406d8b0 0x7f41d415b150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:10.787 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:10.783+0000 7f41d3fff640 1 -- 172.21.15.150:0/3419243741 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f41d415d860 con 0x7f41d40c4a00 2024-09-17T05:42:10.787 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:10.783+0000 7f41d37fe640 1 --2- 172.21.15.150:0/3419243741 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f41d406d8b0 0x7f41d415b150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T05:42:10.787 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:10.783+0000 7f41d3fff640 1 --2- 172.21.15.150:0/3419243741 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f41d40c4a00 0x7f41d40ae160 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f41cc009bf0 tx=0x7f41cc02c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:42:10.787 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:10.783+0000 7f41bbfff640 1 -- 172.21.15.150:0/3419243741 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41cc044070 con 0x7f41d40c4a00 2024-09-17T05:42:10.787 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:10.783+0000 7f41bbfff640 1 -- 172.21.15.150:0/3419243741 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f41cc004250 con 0x7f41d40c4a00 2024-09-17T05:42:10.787 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:10.783+0000 7f41da00e640 1 -- 172.21.15.150:0/3419243741 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f41d415db00 con 0x7f41d40c4a00 2024-09-17T05:42:10.787 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:10.783+0000 7f41bbfff640 1 -- 172.21.15.150:0/3419243741 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41cc004680 con 0x7f41d40c4a00 2024-09-17T05:42:10.788 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:10.783+0000 7f41da00e640 1 -- 172.21.15.150:0/3419243741 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f41d415e0c0 con 0x7f41d40c4a00 2024-09-17T05:42:10.788 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:10.784+0000 7f41da00e640 1 -- 172.21.15.150:0/3419243741 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f41d406d1a0 con 0x7f41d40c4a00 2024-09-17T05:42:10.788 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:10.785+0000 7f41bbfff640 1 -- 172.21.15.150:0/3419243741 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f41cc036400 con 0x7f41d40c4a00 2024-09-17T05:42:10.788 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:10.785+0000 7f41bbfff640 1 --2- 172.21.15.150:0/3419243741 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f41c0078bc0 0x7f41c007b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:42:10.789 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:10.786+0000 7f41bbfff640 1 -- 172.21.15.150:0/3419243741 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f41cc0bb7b0 con 0x7f41d40c4a00 2024-09-17T05:42:10.789 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:10.786+0000 7f41d37fe640 1 --2- 172.21.15.150:0/3419243741 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f41c0078bc0 0x7f41c007b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:42:10.789 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:10.786+0000 7f41d37fe640 1 --2- 172.21.15.150:0/3419243741 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f41c0078bc0 0x7f41c007b0d0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f41c4000f60 tx=0x7f41c4009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:42:10.791 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:10.790+0000 7f41bbfff640 1 -- 172.21.15.150:0/3419243741 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f41cc032030 con 0x7f41d40c4a00 2024-09-17T05:42:11.009 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:11.008+0000 7f41da00e640 1 -- 172.21.15.150:0/3419243741 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f41d40b42d0 con 0x7f41d40c4a00 2024-09-17T05:42:11.009 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:11.008+0000 7f41bbfff640 1 -- 172.21.15.150:0/3419243741 <== mon.0 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+46 (secure 0 0 0) 0x7f41cc004820 con 0x7f41d40c4a00 2024-09-17T05:42:11.010 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-09-17T05:42:11.010 INFO:teuthology.orchestra.run.smithi150.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-09-17T05:42:11.012 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:11.010+0000 7f41da00e640 1 -- 172.21.15.150:0/3419243741 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f41c0078bc0 msgr2=0x7f41c007b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:11.012 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:11.010+0000 7f41da00e640 1 --2- 172.21.15.150:0/3419243741 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f41c0078bc0 0x7f41c007b0d0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f41c4000f60 tx=0x7f41c4009040 comp rx=0 tx=0).stop 2024-09-17T05:42:11.012 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:11.010+0000 7f41da00e640 1 -- 172.21.15.150:0/3419243741 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f41d40c4a00 msgr2=0x7f41d40ae160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:11.012 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:11.010+0000 7f41da00e640 1 --2- 172.21.15.150:0/3419243741 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f41d40c4a00 0x7f41d40ae160 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f41cc009bf0 tx=0x7f41cc02c8b0 comp rx=0 tx=0).stop 2024-09-17T05:42:11.012 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:11.010+0000 7f41da00e640 1 -- 172.21.15.150:0/3419243741 shutdown_connections 2024-09-17T05:42:11.013 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:11.010+0000 7f41da00e640 1 --2- 172.21.15.150:0/3419243741 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f41c0078bc0 0x7f41c007b0d0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:11.013 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:11.010+0000 7f41da00e640 1 --2- 172.21.15.150:0/3419243741 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f41d40c4a00 0x7f41d40ae160 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:11.013 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:11.010+0000 7f41da00e640 1 --2- 172.21.15.150:0/3419243741 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f41d40b6bd0 0x7f41d40ca670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:11.013 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:11.010+0000 7f41da00e640 1 --2- 172.21.15.150:0/3419243741 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f41d406d8b0 0x7f41d415b150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:11.013 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:11.010+0000 7f41da00e640 1 -- 172.21.15.150:0/3419243741 >> 172.21.15.150:0/3419243741 conn(0x7f41d40b2e80 msgr2=0x7f41d40b5820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:42:11.013 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:11.010+0000 7f41da00e640 1 -- 172.21.15.150:0/3419243741 shutdown_connections 2024-09-17T05:42:11.013 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:11.010+0000 7f41da00e640 1 -- 172.21.15.150:0/3419243741 wait complete. 2024-09-17T05:42:11.023 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2024-09-17T05:42:11.024 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T05:42:11.137 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:11.135+0000 7fa367825640 1 -- 172.21.15.150:0/810330843 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa3600705b0 msgr2=0x7fa3600709c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:11.137 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:11.135+0000 7fa367825640 1 --2- 172.21.15.150:0/810330843 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa3600705b0 0x7fa3600709c0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fa358005fd0 tx=0x7fa35802a8b0 comp rx=0 tx=0).stop 2024-09-17T05:42:11.138 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:11.136+0000 7fa367825640 1 -- 172.21.15.150:0/810330843 shutdown_connections 2024-09-17T05:42:11.138 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:11.136+0000 7fa367825640 1 --2- 172.21.15.150:0/810330843 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa3600705b0 0x7fa3600709c0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:11.138 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:11.136+0000 7fa367825640 1 --2- 172.21.15.150:0/810330843 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa3601528b0 0x7fa36015fa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:11.138 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:11.136+0000 7fa367825640 1 -- 172.21.15.150:0/810330843 >> 172.21.15.150:0/810330843 conn(0x7fa3600d0b50 msgr2=0x7fa3600d0f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:42:11.138 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:11.136+0000 7fa367825640 1 -- 172.21.15.150:0/810330843 shutdown_connections 2024-09-17T05:42:11.138 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:11.136+0000 7fa367825640 1 -- 172.21.15.150:0/810330843 wait complete. 2024-09-17T05:42:11.139 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:11.137+0000 7fa367825640 1 Processor -- start 2024-09-17T05:42:11.139 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:11.137+0000 7fa367825640 1 -- start start 2024-09-17T05:42:11.141 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:11.139+0000 7fa367825640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa3600705b0 0x7fa36014ffc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:42:11.141 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:11.139+0000 7fa367825640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa3600cd040 0x7fa360159050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:42:11.142 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:11.139+0000 7fa367825640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa3601528b0 0x7fa360156e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:42:11.142 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:11.139+0000 7fa367825640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7fa360071290 con 0x7fa3600cd040 2024-09-17T05:42:11.142 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:11.139+0000 7fa367825640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fa360071110 con 0x7fa3601528b0 2024-09-17T05:42:11.142 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:11.139+0000 7fa367825640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fa360071410 con 0x7fa3600705b0 2024-09-17T05:42:11.142 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:11.139+0000 7fa364dc0640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa3600cd040 0x7fa360159050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:42:11.142 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:11.139+0000 7fa364dc0640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa3600cd040 0x7fa360159050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:60238/0 (socket says 172.21.15.150:60238) 2024-09-17T05:42:11.142 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:11.139+0000 7fa364dc0640 1 -- 172.21.15.150:0/3002030407 learned_addr learned my addr 172.21.15.150:0/3002030407 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:42:11.142 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:11.139+0000 7fa365dc2640 1 --2- 172.21.15.150:0/3002030407 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa3601528b0 0x7fa360156e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:42:11.142 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:11.139+0000 7fa3655c1640 1 --2- 172.21.15.150:0/3002030407 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa3600705b0 0x7fa36014ffc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:42:11.142 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:11.139+0000 7fa364dc0640 1 -- 172.21.15.150:0/3002030407 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa3600705b0 msgr2=0x7fa36014ffc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:11.142 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:11.139+0000 7fa364dc0640 1 --2- 172.21.15.150:0/3002030407 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa3600705b0 0x7fa36014ffc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:11.142 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:11.139+0000 7fa364dc0640 1 -- 172.21.15.150:0/3002030407 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa3601528b0 msgr2=0x7fa360156e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:11.142 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:11.139+0000 7fa364dc0640 1 --2- 172.21.15.150:0/3002030407 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa3601528b0 0x7fa360156e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:11.143 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:11.139+0000 7fa364dc0640 1 -- 172.21.15.150:0/3002030407 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa3601f7b90 con 0x7fa3600cd040 2024-09-17T05:42:11.143 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:11.139+0000 7fa364dc0640 1 --2- 172.21.15.150:0/3002030407 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa3600cd040 0x7fa360159050 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fa35000e9f0 tx=0x7fa35000eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:42:11.143 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:11.139+0000 7fa355ffb640 1 -- 172.21.15.150:0/3002030407 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa35000cd80 con 0x7fa3600cd040 2024-09-17T05:42:11.143 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:11.140+0000 7fa355ffb640 1 -- 172.21.15.150:0/3002030407 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa350004020 con 0x7fa3600cd040 2024-09-17T05:42:11.143 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:11.140+0000 7fa367825640 1 -- 172.21.15.150:0/3002030407 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa3601f7010 con 0x7fa3600cd040 2024-09-17T05:42:11.143 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:11.140+0000 7fa355ffb640 1 -- 172.21.15.150:0/3002030407 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa350004470 con 0x7fa3600cd040 2024-09-17T05:42:11.143 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:11.140+0000 7fa367825640 1 -- 172.21.15.150:0/3002030407 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa3601f75d0 con 0x7fa3600cd040 2024-09-17T05:42:11.144 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:11.141+0000 7fa367825640 1 -- 172.21.15.150:0/3002030407 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa3601f6d80 con 0x7fa3600cd040 2024-09-17T05:42:11.144 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:11.141+0000 7fa355ffb640 1 -- 172.21.15.150:0/3002030407 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fa3500035f0 con 0x7fa3600cd040 2024-09-17T05:42:11.144 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:11.142+0000 7fa355ffb640 1 --2- 172.21.15.150:0/3002030407 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fa344078b90 0x7fa34407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:42:11.144 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:11.142+0000 7fa355ffb640 1 -- 172.21.15.150:0/3002030407 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7fa35009b590 con 0x7fa3600cd040 2024-09-17T05:42:11.144 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:11.142+0000 7fa3655c1640 1 --2- 172.21.15.150:0/3002030407 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fa344078b90 0x7fa34407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:42:11.144 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:11.143+0000 7fa3655c1640 1 --2- 172.21.15.150:0/3002030407 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fa344078b90 0x7fa34407b0a0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fa35c007fd0 tx=0x7fa35c001370 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:42:11.148 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:11.146+0000 7fa355ffb640 1 -- 172.21.15.150:0/3002030407 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fa350063380 con 0x7fa3600cd040 2024-09-17T05:42:11.359 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:11.358+0000 7fa367825640 1 -- 172.21.15.150:0/3002030407 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fa3601f3640 con 0x7fa3600cd040 2024-09-17T05:42:11.359 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:11.358+0000 7fa355ffb640 1 -- 172.21.15.150:0/3002030407 <== mon.0 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) ==== 93+0+5226 (secure 0 0 0) 0x7fa350067db0 con 0x7fa3600cd040 2024-09-17T05:42:11.360 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-09-17T05:42:11.360 INFO:teuthology.orchestra.run.smithi150.stdout:{"epoch":6,"btime":"2024-09-17T05:41:59:940454+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4316,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6835/357154046","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6833","nonce":357154046},{"type":"v1","addr":"172.21.15.150:6835","nonce":357154046}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4377,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6834/2757381484","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6832","nonce":2757381484},{"type":"v1","addr":"172.21.15.150:6834","nonce":2757381484}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4411,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6835/3751002674","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6834","nonce":3751002674},{"type":"v1","addr":"172.21.15.176:6835","nonce":3751002674}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T05:41:57.292807+0000","modified":"2024-09-17T05:41:59.294767+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4414},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4414":{"gid":4414,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.176:6837/1714683410","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6836","nonce":1714683410},{"type":"v1","addr":"172.21.15.176:6837","nonce":1714683410}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4414,"qdb_cluster":[4414]},"id":1}]} 2024-09-17T05:42:11.360 INFO:teuthology.orchestra.run.smithi150.stderr:dumped fsmap epoch 6 2024-09-17T05:42:11.362 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:11.360+0000 7fa367825640 1 -- 172.21.15.150:0/3002030407 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fa344078b90 msgr2=0x7fa34407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:11.362 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:11.360+0000 7fa367825640 1 --2- 172.21.15.150:0/3002030407 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fa344078b90 0x7fa34407b0a0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fa35c007fd0 tx=0x7fa35c001370 comp rx=0 tx=0).stop 2024-09-17T05:42:11.362 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:11.360+0000 7fa367825640 1 -- 172.21.15.150:0/3002030407 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa3600cd040 msgr2=0x7fa360159050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:11.362 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:11.360+0000 7fa367825640 1 --2- 172.21.15.150:0/3002030407 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa3600cd040 0x7fa360159050 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fa35000e9f0 tx=0x7fa35000eeb0 comp rx=0 tx=0).stop 2024-09-17T05:42:11.362 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:11.360+0000 7fa367825640 1 -- 172.21.15.150:0/3002030407 shutdown_connections 2024-09-17T05:42:11.362 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:11.360+0000 7fa367825640 1 --2- 172.21.15.150:0/3002030407 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa3601528b0 0x7fa360156e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:11.362 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:11.360+0000 7fa367825640 1 --2- 172.21.15.150:0/3002030407 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fa344078b90 0x7fa34407b0a0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:11.362 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:11.360+0000 7fa367825640 1 --2- 172.21.15.150:0/3002030407 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa3600cd040 0x7fa360159050 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:11.363 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:11.360+0000 7fa367825640 1 --2- 172.21.15.150:0/3002030407 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa3600705b0 0x7fa36014ffc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:11.363 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:11.360+0000 7fa367825640 1 -- 172.21.15.150:0/3002030407 >> 172.21.15.150:0/3002030407 conn(0x7fa3600d0b50 msgr2=0x7fa3600b1150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:42:11.363 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:11.360+0000 7fa367825640 1 -- 172.21.15.150:0/3002030407 shutdown_connections 2024-09-17T05:42:11.363 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:11.360+0000 7fa367825640 1 -- 172.21.15.150:0/3002030407 wait complete. 2024-09-17T05:42:11.373 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T05:42:11.487 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:11.485+0000 7ff1ab507640 1 -- 172.21.15.150:0/859776808 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff1a40b5300 msgr2=0x7ff1a40b5710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:11.487 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:11.485+0000 7ff1ab507640 1 --2- 172.21.15.150:0/859776808 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff1a40b5300 0x7ff1a40b5710 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7ff194009830 tx=0x7ff19402a510 comp rx=0 tx=0).stop 2024-09-17T05:42:11.487 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:11.485+0000 7ff1ab507640 1 -- 172.21.15.150:0/859776808 shutdown_connections 2024-09-17T05:42:11.487 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:11.485+0000 7ff1ab507640 1 --2- 172.21.15.150:0/859776808 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff1a40b5c50 0x7ff1a4167180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:11.487 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:11.485+0000 7ff1ab507640 1 --2- 172.21.15.150:0/859776808 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff1a40b5300 0x7ff1a40b5710 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:11.487 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:11.485+0000 7ff1ab507640 1 -- 172.21.15.150:0/859776808 >> 172.21.15.150:0/859776808 conn(0x7ff1a40cef30 msgr2=0x7ff1a40cf340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:42:11.487 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:11.485+0000 7ff1ab507640 1 -- 172.21.15.150:0/859776808 shutdown_connections 2024-09-17T05:42:11.488 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:11.485+0000 7ff1ab507640 1 -- 172.21.15.150:0/859776808 wait complete. 2024-09-17T05:42:11.488 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:11.487+0000 7ff1ab507640 1 Processor -- start 2024-09-17T05:42:11.488 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:11.487+0000 7ff1ab507640 1 -- start start 2024-09-17T05:42:11.491 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:11.488+0000 7ff1ab507640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff1a40b5300 0x7ff1a41d0ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:42:11.491 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:11.488+0000 7ff1ab507640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff1a40b5c50 0x7ff1a41f72a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:42:11.491 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:11.488+0000 7ff1ab507640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff1a40b7490 0x7ff1a41e3f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:42:11.491 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:11.488+0000 7ff1ab507640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7ff1a40d15e0 con 0x7ff1a40b5c50 2024-09-17T05:42:11.491 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:11.488+0000 7ff1ab507640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7ff1a40d1460 con 0x7ff1a40b5300 2024-09-17T05:42:11.491 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:11.488+0000 7ff1ab507640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7ff1a40ceb70 con 0x7ff1a40b7490 2024-09-17T05:42:11.491 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:11.488+0000 7ff1a8aa2640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff1a40b5c50 0x7ff1a41f72a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:42:11.492 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:11.488+0000 7ff1a8aa2640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff1a40b5c50 0x7ff1a41f72a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:60250/0 (socket says 172.21.15.150:60250) 2024-09-17T05:42:11.492 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:11.488+0000 7ff1a8aa2640 1 -- 172.21.15.150:0/433336515 learned_addr learned my addr 172.21.15.150:0/433336515 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:42:11.492 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:11.488+0000 7ff1a92a3640 1 --2- 172.21.15.150:0/433336515 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff1a40b5300 0x7ff1a41d0ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:42:11.492 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:11.488+0000 7ff1a9aa4640 1 --2- 172.21.15.150:0/433336515 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff1a40b7490 0x7ff1a41e3f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:42:11.492 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:11.489+0000 7ff1a8aa2640 1 -- 172.21.15.150:0/433336515 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff1a40b7490 msgr2=0x7ff1a41e3f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:11.492 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:11.489+0000 7ff1a8aa2640 1 --2- 172.21.15.150:0/433336515 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff1a40b7490 0x7ff1a41e3f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:11.492 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:11.489+0000 7ff1a8aa2640 1 -- 172.21.15.150:0/433336515 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff1a40b5300 msgr2=0x7ff1a41d0ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:11.492 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:11.489+0000 7ff1a8aa2640 1 --2- 172.21.15.150:0/433336515 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff1a40b5300 0x7ff1a41d0ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:11.492 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:11.489+0000 7ff1a8aa2640 1 -- 172.21.15.150:0/433336515 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff1a409f710 con 0x7ff1a40b5c50 2024-09-17T05:42:11.492 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:11.489+0000 7ff1a8aa2640 1 --2- 172.21.15.150:0/433336515 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff1a40b5c50 0x7ff1a41f72a0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7ff194009950 tx=0x7ff194033c90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:42:11.492 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:11.489+0000 7ff199ffb640 1 -- 172.21.15.150:0/433336515 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff194005c90 con 0x7ff1a40b5c50 2024-09-17T05:42:11.492 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:11.489+0000 7ff199ffb640 1 -- 172.21.15.150:0/433336515 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff194031e50 con 0x7ff1a40b5c50 2024-09-17T05:42:11.493 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:11.489+0000 7ff1ab507640 1 -- 172.21.15.150:0/433336515 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff1a41f77e0 con 0x7ff1a40b5c50 2024-09-17T05:42:11.493 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:11.489+0000 7ff199ffb640 1 -- 172.21.15.150:0/433336515 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff194033290 con 0x7ff1a40b5c50 2024-09-17T05:42:11.493 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:11.489+0000 7ff1ab507640 1 -- 172.21.15.150:0/433336515 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff1a409e950 con 0x7ff1a40b5c50 2024-09-17T05:42:11.494 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:11.490+0000 7ff1ab507640 1 -- 172.21.15.150:0/433336515 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff1a40b6180 con 0x7ff1a40b5c50 2024-09-17T05:42:11.494 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:11.491+0000 7ff199ffb640 1 -- 172.21.15.150:0/433336515 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7ff194033430 con 0x7ff1a40b5c50 2024-09-17T05:42:11.494 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:11.491+0000 7ff199ffb640 1 --2- 172.21.15.150:0/433336515 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7ff188078b90 0x7ff18807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:42:11.494 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:11.492+0000 7ff199ffb640 1 -- 172.21.15.150:0/433336515 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7ff1940bc180 con 0x7ff1a40b5c50 2024-09-17T05:42:11.494 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:11.492+0000 7ff1a92a3640 1 --2- 172.21.15.150:0/433336515 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7ff188078b90 0x7ff18807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:42:11.494 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:11.492+0000 7ff1a92a3640 1 --2- 172.21.15.150:0/433336515 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7ff188078b90 0x7ff18807b0a0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7ff1a00016f0 tx=0x7ff1a0009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:42:11.497 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:11.496+0000 7ff199ffb640 1 -- 172.21.15.150:0/433336515 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7ff19403f030 con 0x7ff1a40b5c50 2024-09-17T05:42:11.709 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:11.707+0000 7ff1ab507640 1 -- 172.21.15.150:0/433336515 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7ff1a4070250 con 0x7ff1a40b5c50 2024-09-17T05:42:11.709 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:11.707+0000 7ff199ffb640 1 -- 172.21.15.150:0/433336515 <== mon.0 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) ==== 93+0+5226 (secure 0 0 0) 0x7ff194083f70 con 0x7ff1a40b5c50 2024-09-17T05:42:11.709 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-09-17T05:42:11.709 INFO:teuthology.orchestra.run.smithi150.stdout:{"epoch":6,"btime":"2024-09-17T05:41:59:940454+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4316,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6835/357154046","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6833","nonce":357154046},{"type":"v1","addr":"172.21.15.150:6835","nonce":357154046}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4377,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6834/2757381484","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6832","nonce":2757381484},{"type":"v1","addr":"172.21.15.150:6834","nonce":2757381484}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4411,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6835/3751002674","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6834","nonce":3751002674},{"type":"v1","addr":"172.21.15.176:6835","nonce":3751002674}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T05:41:57.292807+0000","modified":"2024-09-17T05:41:59.294767+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4414},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4414":{"gid":4414,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.176:6837/1714683410","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6836","nonce":1714683410},{"type":"v1","addr":"172.21.15.176:6837","nonce":1714683410}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4414,"qdb_cluster":[4414]},"id":1}]} 2024-09-17T05:42:11.709 INFO:teuthology.orchestra.run.smithi150.stderr:dumped fsmap epoch 6 2024-09-17T05:42:11.711 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:11.709+0000 7ff1ab507640 1 -- 172.21.15.150:0/433336515 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7ff188078b90 msgr2=0x7ff18807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:11.711 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:11.709+0000 7ff1ab507640 1 --2- 172.21.15.150:0/433336515 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7ff188078b90 0x7ff18807b0a0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7ff1a00016f0 tx=0x7ff1a0009040 comp rx=0 tx=0).stop 2024-09-17T05:42:11.711 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:11.709+0000 7ff1ab507640 1 -- 172.21.15.150:0/433336515 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff1a40b5c50 msgr2=0x7ff1a41f72a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:11.712 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:11.709+0000 7ff1ab507640 1 --2- 172.21.15.150:0/433336515 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff1a40b5c50 0x7ff1a41f72a0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7ff194009950 tx=0x7ff194033c90 comp rx=0 tx=0).stop 2024-09-17T05:42:11.712 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:11.709+0000 7ff1ab507640 1 -- 172.21.15.150:0/433336515 shutdown_connections 2024-09-17T05:42:11.712 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:11.709+0000 7ff1ab507640 1 --2- 172.21.15.150:0/433336515 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7ff188078b90 0x7ff18807b0a0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:11.712 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:11.709+0000 7ff1ab507640 1 --2- 172.21.15.150:0/433336515 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff1a40b7490 0x7ff1a41e3f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:11.712 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:11.709+0000 7ff1ab507640 1 --2- 172.21.15.150:0/433336515 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff1a40b5c50 0x7ff1a41f72a0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:11.712 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:11.709+0000 7ff1ab507640 1 --2- 172.21.15.150:0/433336515 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff1a40b5300 0x7ff1a41d0ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:11.712 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:11.710+0000 7ff1ab507640 1 -- 172.21.15.150:0/433336515 >> 172.21.15.150:0/433336515 conn(0x7ff1a40cef30 msgr2=0x7ff1a4071310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:42:11.712 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:11.710+0000 7ff1ab507640 1 -- 172.21.15.150:0/433336515 shutdown_connections 2024-09-17T05:42:11.712 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:11.710+0000 7ff1ab507640 1 -- 172.21.15.150:0/433336515 wait complete. 2024-09-17T05:42:11.722 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T05:42:11.835 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:11.833+0000 7fb2a880a640 1 -- 172.21.15.150:0/3754854686 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb2a415ee30 msgr2=0x7fb2a40b2840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:11.835 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:11.833+0000 7fb2a880a640 1 --2- 172.21.15.150:0/3754854686 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb2a415ee30 0x7fb2a40b2840 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fb294009830 tx=0x7fb29402a510 comp rx=0 tx=0).stop 2024-09-17T05:42:11.835 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:11.833+0000 7fb2a880a640 1 -- 172.21.15.150:0/3754854686 shutdown_connections 2024-09-17T05:42:11.835 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:11.833+0000 7fb2a880a640 1 --2- 172.21.15.150:0/3754854686 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb2a40b5410 0x7fb2a40b5820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:11.835 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:11.833+0000 7fb2a880a640 1 --2- 172.21.15.150:0/3754854686 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb2a415ee30 0x7fb2a40b2840 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:11.836 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:11.833+0000 7fb2a880a640 1 -- 172.21.15.150:0/3754854686 >> 172.21.15.150:0/3754854686 conn(0x7fb2a40b2fd0 msgr2=0x7fb2a40b33e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:42:11.836 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:11.833+0000 7fb2a880a640 1 -- 172.21.15.150:0/3754854686 shutdown_connections 2024-09-17T05:42:11.836 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:11.833+0000 7fb2a880a640 1 -- 172.21.15.150:0/3754854686 wait complete. 2024-09-17T05:42:11.836 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:11.835+0000 7fb2a880a640 1 Processor -- start 2024-09-17T05:42:11.836 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:11.835+0000 7fb2a880a640 1 -- start start 2024-09-17T05:42:11.839 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:11.836+0000 7fb2a880a640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb2a40b5410 0x7fb2a4151370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:42:11.839 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:11.836+0000 7fb2a880a640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb2a40cf7c0 0x7fb2a409e960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:42:11.839 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:11.836+0000 7fb2a880a640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb2a415ee30 0x7fb2a4150800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:42:11.839 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:11.836+0000 7fb2a880a640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7fb2a40b6150 con 0x7fb2a40b5410 2024-09-17T05:42:11.839 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:11.836+0000 7fb2a880a640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fb2a40b5fd0 con 0x7fb2a40cf7c0 2024-09-17T05:42:11.840 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:11.836+0000 7fb2a880a640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fb2a40b62d0 con 0x7fb2a415ee30 2024-09-17T05:42:11.840 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:11.836+0000 7fb2a259c640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb2a40b5410 0x7fb2a4151370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:42:11.840 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:11.837+0000 7fb2a259c640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb2a40b5410 0x7fb2a4151370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:60278/0 (socket says 172.21.15.150:60278) 2024-09-17T05:42:11.840 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:11.837+0000 7fb2a259c640 1 -- 172.21.15.150:0/1183588333 learned_addr learned my addr 172.21.15.150:0/1183588333 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:42:11.840 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:11.837+0000 7fb2a2d9d640 1 --2- 172.21.15.150:0/1183588333 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb2a415ee30 0x7fb2a4150800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:42:11.840 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:11.837+0000 7fb2a1d9b640 1 --2- 172.21.15.150:0/1183588333 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb2a40cf7c0 0x7fb2a409e960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:42:11.840 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:11.837+0000 7fb2a259c640 1 -- 172.21.15.150:0/1183588333 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb2a415ee30 msgr2=0x7fb2a4150800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:11.840 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:11.837+0000 7fb2a259c640 1 --2- 172.21.15.150:0/1183588333 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb2a415ee30 0x7fb2a4150800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:11.840 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:11.837+0000 7fb2a259c640 1 -- 172.21.15.150:0/1183588333 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb2a40cf7c0 msgr2=0x7fb2a409e960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:11.840 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:11.837+0000 7fb2a259c640 1 --2- 172.21.15.150:0/1183588333 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb2a40cf7c0 0x7fb2a409e960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:11.841 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:11.837+0000 7fb2a259c640 1 -- 172.21.15.150:0/1183588333 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb2a409e550 con 0x7fb2a40b5410 2024-09-17T05:42:11.841 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:11.837+0000 7fb2a259c640 1 --2- 172.21.15.150:0/1183588333 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb2a40b5410 0x7fb2a4151370 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fb294000c00 tx=0x7fb294033c90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:42:11.841 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:11.837+0000 7fb292ffd640 1 -- 172.21.15.150:0/1183588333 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb294005c90 con 0x7fb2a40b5410 2024-09-17T05:42:11.841 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:11.837+0000 7fb292ffd640 1 -- 172.21.15.150:0/1183588333 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb294031e50 con 0x7fb2a40b5410 2024-09-17T05:42:11.841 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:11.837+0000 7fb292ffd640 1 -- 172.21.15.150:0/1183588333 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2940332f0 con 0x7fb2a40b5410 2024-09-17T05:42:11.841 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:11.837+0000 7fb2a880a640 1 -- 172.21.15.150:0/1183588333 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb2a40c5a70 con 0x7fb2a40b5410 2024-09-17T05:42:11.841 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:11.837+0000 7fb2a880a640 1 -- 172.21.15.150:0/1183588333 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb2a40c6030 con 0x7fb2a40b5410 2024-09-17T05:42:11.842 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:11.838+0000 7fb2a880a640 1 -- 172.21.15.150:0/1183588333 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb2a40b67e0 con 0x7fb2a40b5410 2024-09-17T05:42:11.842 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:11.839+0000 7fb292ffd640 1 -- 172.21.15.150:0/1183588333 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fb294033490 con 0x7fb2a40b5410 2024-09-17T05:42:11.842 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:11.840+0000 7fb292ffd640 1 --2- 172.21.15.150:0/1183588333 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fb284078bc0 0x7fb28407b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:42:11.842 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:11.840+0000 7fb292ffd640 1 -- 172.21.15.150:0/1183588333 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7fb2940bc000 con 0x7fb2a40b5410 2024-09-17T05:42:11.842 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:11.840+0000 7fb2a1d9b640 1 --2- 172.21.15.150:0/1183588333 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fb284078bc0 0x7fb28407b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:42:11.843 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:11.840+0000 7fb2a1d9b640 1 --2- 172.21.15.150:0/1183588333 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fb284078bc0 0x7fb28407b0d0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fb298000f60 tx=0x7fb298009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:42:11.845 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:11.844+0000 7fb292ffd640 1 -- 172.21.15.150:0/1183588333 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fb29403f030 con 0x7fb2a40b5410 2024-09-17T05:42:12.024 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:12.023+0000 7fb2a880a640 1 -- 172.21.15.150:0/1183588333 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fb2a40ce210 con 0x7fb2a40b5410 2024-09-17T05:42:12.025 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:12.024+0000 7fb292ffd640 1 -- 172.21.15.150:0/1183588333 <== mon.0 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) ==== 74+0+16701 (secure 0 0 0) 0x7fb294083e80 con 0x7fb2a40b5410 2024-09-17T05:42:12.025 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-09-17T05:42:12.026 INFO:teuthology.orchestra.run.smithi150.stdout:{"epoch":23,"fsid":"9f2e05e9-d629-47b3-b26b-1360655b7d20","created":"2024-09-17T05:41:32.502979+0000","modified":"2024-09-17T05:41:58.934156+0000","last_up_change":"2024-09-17T05:41:46.150225+0000","last_in_change":"2024-09-17T05:41:36.120274+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T05:41:46.860779+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-17T05:41:55.155732+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-17T05:41:56.250888+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"4f31c018-c8a4-4d6d-b0c2-a597c47aae4a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6800","nonce":479374392},{"type":"v1","addr":"172.21.15.150:6801","nonce":479374392}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6802","nonce":479374392},{"type":"v1","addr":"172.21.15.150:6803","nonce":479374392}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6806","nonce":479374392},{"type":"v1","addr":"172.21.15.150:6807","nonce":479374392}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6804","nonce":479374392},{"type":"v1","addr":"172.21.15.150:6805","nonce":479374392}]},"public_addr":"172.21.15.150:6801/479374392","cluster_addr":"172.21.15.150:6803/479374392","heartbeat_back_addr":"172.21.15.150:6807/479374392","heartbeat_front_addr":"172.21.15.150:6805/479374392","state":["exists","up"]},{"osd":1,"uuid":"6ff4a573-500b-4e04-9de3-39265ead78b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6824","nonce":913899800},{"type":"v1","addr":"172.21.15.150:6825","nonce":913899800}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6826","nonce":913899800},{"type":"v1","addr":"172.21.15.150:6827","nonce":913899800}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6830","nonce":913899800},{"type":"v1","addr":"172.21.15.150:6831","nonce":913899800}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6828","nonce":913899800},{"type":"v1","addr":"172.21.15.150:6829","nonce":913899800}]},"public_addr":"172.21.15.150:6825/913899800","cluster_addr":"172.21.15.150:6827/913899800","heartbeat_back_addr":"172.21.15.150:6831/913899800","heartbeat_front_addr":"172.21.15.150:6829/913899800","state":["exists","up"]},{"osd":2,"uuid":"bffea6f9-2465-4182-b205-00436c41ac1c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6816","nonce":363718461},{"type":"v1","addr":"172.21.15.150:6817","nonce":363718461}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6818","nonce":363718461},{"type":"v1","addr":"172.21.15.150:6819","nonce":363718461}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6822","nonce":363718461},{"type":"v1","addr":"172.21.15.150:6823","nonce":363718461}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6820","nonce":363718461},{"type":"v1","addr":"172.21.15.150:6821","nonce":363718461}]},"public_addr":"172.21.15.150:6817/363718461","cluster_addr":"172.21.15.150:6819/363718461","heartbeat_back_addr":"172.21.15.150:6823/363718461","heartbeat_front_addr":"172.21.15.150:6821/363718461","state":["exists","up"]},{"osd":3,"uuid":"cda70430-d1e1-427e-b04e-56db4031d078","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6808","nonce":3550994626},{"type":"v1","addr":"172.21.15.150:6809","nonce":3550994626}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6810","nonce":3550994626},{"type":"v1","addr":"172.21.15.150:6811","nonce":3550994626}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6814","nonce":3550994626},{"type":"v1","addr":"172.21.15.150:6815","nonce":3550994626}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6812","nonce":3550994626},{"type":"v1","addr":"172.21.15.150:6813","nonce":3550994626}]},"public_addr":"172.21.15.150:6809/3550994626","cluster_addr":"172.21.15.150:6811/3550994626","heartbeat_back_addr":"172.21.15.150:6815/3550994626","heartbeat_front_addr":"172.21.15.150:6813/3550994626","state":["exists","up"]},{"osd":4,"uuid":"3a0277fb-5e1e-4f68-bb2d-9a8a0152f64a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6810","nonce":2718261497},{"type":"v1","addr":"172.21.15.176:6811","nonce":2718261497}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6812","nonce":2718261497},{"type":"v1","addr":"172.21.15.176:6813","nonce":2718261497}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6816","nonce":2718261497},{"type":"v1","addr":"172.21.15.176:6817","nonce":2718261497}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6814","nonce":2718261497},{"type":"v1","addr":"172.21.15.176:6815","nonce":2718261497}]},"public_addr":"172.21.15.176:6811/2718261497","cluster_addr":"172.21.15.176:6813/2718261497","heartbeat_back_addr":"172.21.15.176:6817/2718261497","heartbeat_front_addr":"172.21.15.176:6815/2718261497","state":["exists","up"]},{"osd":5,"uuid":"33aebee6-0315-40b7-a11c-6702f0be494d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6818","nonce":2049295774},{"type":"v1","addr":"172.21.15.176:6819","nonce":2049295774}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6820","nonce":2049295774},{"type":"v1","addr":"172.21.15.176:6821","nonce":2049295774}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6824","nonce":2049295774},{"type":"v1","addr":"172.21.15.176:6825","nonce":2049295774}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6822","nonce":2049295774},{"type":"v1","addr":"172.21.15.176:6823","nonce":2049295774}]},"public_addr":"172.21.15.176:6819/2049295774","cluster_addr":"172.21.15.176:6821/2049295774","heartbeat_back_addr":"172.21.15.176:6825/2049295774","heartbeat_front_addr":"172.21.15.176:6823/2049295774","state":["exists","up"]},{"osd":6,"uuid":"4d24f360-6751-4263-841b-d77793d33540","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6826","nonce":2164458476},{"type":"v1","addr":"172.21.15.176:6827","nonce":2164458476}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6828","nonce":2164458476},{"type":"v1","addr":"172.21.15.176:6829","nonce":2164458476}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6832","nonce":2164458476},{"type":"v1","addr":"172.21.15.176:6833","nonce":2164458476}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6830","nonce":2164458476},{"type":"v1","addr":"172.21.15.176:6831","nonce":2164458476}]},"public_addr":"172.21.15.176:6827/2164458476","cluster_addr":"172.21.15.176:6829/2164458476","heartbeat_back_addr":"172.21.15.176:6833/2164458476","heartbeat_front_addr":"172.21.15.176:6831/2164458476","state":["exists","up"]},{"osd":7,"uuid":"c8594fda-c74a-4ba9-8277-caf101d58ca1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6802","nonce":3239587708},{"type":"v1","addr":"172.21.15.176:6803","nonce":3239587708}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6804","nonce":3239587708},{"type":"v1","addr":"172.21.15.176:6805","nonce":3239587708}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6808","nonce":3239587708},{"type":"v1","addr":"172.21.15.176:6809","nonce":3239587708}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6806","nonce":3239587708},{"type":"v1","addr":"172.21.15.176:6807","nonce":3239587708}]},"public_addr":"172.21.15.176:6803/3239587708","cluster_addr":"172.21.15.176:6805/3239587708","heartbeat_back_addr":"172.21.15.176:6809/3239587708","heartbeat_front_addr":"172.21.15.176:6807/3239587708","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:41:41.905151+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:41:42.705679+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:41:42.459673+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:41:42.440819+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:41:42.668428+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:41:42.694972+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:41:43.078535+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:41:42.363539+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T05:42:12.028 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:12.026+0000 7fb2a880a640 1 -- 172.21.15.150:0/1183588333 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fb284078bc0 msgr2=0x7fb28407b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:12.028 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:12.026+0000 7fb2a880a640 1 --2- 172.21.15.150:0/1183588333 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fb284078bc0 0x7fb28407b0d0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fb298000f60 tx=0x7fb298009040 comp rx=0 tx=0).stop 2024-09-17T05:42:12.028 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:12.026+0000 7fb2a880a640 1 -- 172.21.15.150:0/1183588333 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb2a40b5410 msgr2=0x7fb2a4151370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:12.028 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:12.026+0000 7fb2a880a640 1 --2- 172.21.15.150:0/1183588333 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb2a40b5410 0x7fb2a4151370 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fb294000c00 tx=0x7fb294033c90 comp rx=0 tx=0).stop 2024-09-17T05:42:12.028 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:12.026+0000 7fb2a880a640 1 -- 172.21.15.150:0/1183588333 shutdown_connections 2024-09-17T05:42:12.028 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:12.026+0000 7fb2a880a640 1 --2- 172.21.15.150:0/1183588333 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb2a40cf7c0 0x7fb2a409e960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:12.028 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:12.026+0000 7fb2a880a640 1 --2- 172.21.15.150:0/1183588333 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fb284078bc0 0x7fb28407b0d0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:12.029 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:12.026+0000 7fb2a880a640 1 --2- 172.21.15.150:0/1183588333 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb2a415ee30 0x7fb2a4150800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:12.029 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:12.026+0000 7fb2a880a640 1 --2- 172.21.15.150:0/1183588333 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb2a40b5410 0x7fb2a4151370 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:12.029 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:12.026+0000 7fb2a880a640 1 -- 172.21.15.150:0/1183588333 >> 172.21.15.150:0/1183588333 conn(0x7fb2a40b2fd0 msgr2=0x7fb2a40ce730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:42:12.029 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:12.026+0000 7fb2a880a640 1 -- 172.21.15.150:0/1183588333 shutdown_connections 2024-09-17T05:42:12.029 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:12.026+0000 7fb2a880a640 1 -- 172.21.15.150:0/1183588333 wait complete. 2024-09-17T05:42:12.039 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T05:42:12.152 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:12.151+0000 7f0df71e4640 1 -- 172.21.15.150:0/2816642902 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0dd8003fb0 msgr2=0x7f0dd8004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:12.153 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:12.151+0000 7f0df71e4640 1 --2- 172.21.15.150:0/2816642902 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0dd8003fb0 0x7f0dd8004800 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f0df009bfb0 tx=0x7f0dd8005830 comp rx=0 tx=0).stop 2024-09-17T05:42:12.153 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:12.151+0000 7f0df5781640 1 -- 172.21.15.150:0/2816642902 reap_dead start 2024-09-17T05:42:12.153 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:12.151+0000 7f0df71e4640 1 -- 172.21.15.150:0/2816642902 shutdown_connections 2024-09-17T05:42:12.153 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:12.151+0000 7f0df71e4640 1 -- 172.21.15.150:0/2816642902 >> 172.21.15.150:0/2816642902 conn(0x7f0df00cef30 msgr2=0x7f0df00cf340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:42:12.153 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:12.151+0000 7f0df71e4640 1 -- 172.21.15.150:0/2816642902 shutdown_connections 2024-09-17T05:42:12.153 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:12.151+0000 7f0df71e4640 1 -- 172.21.15.150:0/2816642902 wait complete. 2024-09-17T05:42:12.154 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:12.152+0000 7f0df71e4640 1 Processor -- start 2024-09-17T05:42:12.154 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:12.153+0000 7f0df71e4640 1 -- start start 2024-09-17T05:42:12.157 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:12.154+0000 7f0df71e4640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0dd8003fb0 0x7f0df00af930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:42:12.157 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:12.154+0000 7f0df71e4640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0df01f9b70 0x7f0df00cbbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:42:12.157 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:12.154+0000 7f0df71e4640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0df01f8fb0 0x7f0df01f93c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:42:12.157 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:12.154+0000 7f0df71e4640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f0df00d15e0 con 0x7f0df01f8fb0 2024-09-17T05:42:12.157 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:12.154+0000 7f0df71e4640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f0df00d1460 con 0x7f0df01f9b70 2024-09-17T05:42:12.157 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:12.154+0000 7f0df71e4640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f0df00ceb70 con 0x7f0dd8003fb0 2024-09-17T05:42:12.157 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:12.154+0000 7f0df5781640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0df01f8fb0 0x7f0df01f93c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:42:12.157 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:12.154+0000 7f0df5781640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0df01f8fb0 0x7f0df01f93c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:60292/0 (socket says 172.21.15.150:60292) 2024-09-17T05:42:12.157 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:12.154+0000 7f0df5781640 1 -- 172.21.15.150:0/348761771 learned_addr learned my addr 172.21.15.150:0/348761771 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:42:12.157 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:12.154+0000 7f0de7fff640 1 --2- 172.21.15.150:0/348761771 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0df01f9b70 0x7f0df00cbbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:42:12.158 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:12.154+0000 7f0df4f80640 1 --2- 172.21.15.150:0/348761771 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0dd8003fb0 0x7f0df00af930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:42:12.158 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:12.154+0000 7f0df5781640 1 -- 172.21.15.150:0/348761771 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0dd8003fb0 msgr2=0x7f0df00af930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:12.158 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:12.154+0000 7f0df5781640 1 --2- 172.21.15.150:0/348761771 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0dd8003fb0 0x7f0df00af930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:12.158 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:12.154+0000 7f0df5781640 1 -- 172.21.15.150:0/348761771 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0df01f9b70 msgr2=0x7f0df00cbbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:12.158 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:12.154+0000 7f0df5781640 1 --2- 172.21.15.150:0/348761771 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0df01f9b70 0x7f0df00cbbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:12.158 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:12.154+0000 7f0df5781640 1 -- 172.21.15.150:0/348761771 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0df01f9900 con 0x7f0df01f8fb0 2024-09-17T05:42:12.158 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:12.154+0000 7f0df4f80640 1 --2- 172.21.15.150:0/348761771 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0dd8003fb0 0x7f0df00af930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:42:12.158 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:12.154+0000 7f0de7fff640 1 --2- 172.21.15.150:0/348761771 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0df01f9b70 0x7f0df00cbbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:42:12.158 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:12.154+0000 7f0df5781640 1 --2- 172.21.15.150:0/348761771 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0df01f8fb0 0x7f0df01f93c0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f0df00c5d80 tx=0x7f0de800f790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:42:12.158 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:12.155+0000 7f0de57fa640 1 -- 172.21.15.150:0/348761771 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0de8004d20 con 0x7f0df01f8fb0 2024-09-17T05:42:12.158 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:12.155+0000 7f0de57fa640 1 -- 172.21.15.150:0/348761771 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0de8003970 con 0x7f0df01f8fb0 2024-09-17T05:42:12.158 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:12.155+0000 7f0df71e4640 1 -- 172.21.15.150:0/348761771 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0df00cc130 con 0x7f0df01f8fb0 2024-09-17T05:42:12.159 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:12.155+0000 7f0de57fa640 1 -- 172.21.15.150:0/348761771 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0de8003dc0 con 0x7f0df01f8fb0 2024-09-17T05:42:12.159 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:12.155+0000 7f0df71e4640 1 -- 172.21.15.150:0/348761771 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0df006edf0 con 0x7f0df01f8fb0 2024-09-17T05:42:12.160 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:12.156+0000 7f0df71e4640 1 -- 172.21.15.150:0/348761771 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0df00cde10 con 0x7f0df01f8fb0 2024-09-17T05:42:12.160 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:12.157+0000 7f0de57fa640 1 -- 172.21.15.150:0/348761771 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f0de8004030 con 0x7f0df01f8fb0 2024-09-17T05:42:12.160 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:12.157+0000 7f0de57fa640 1 --2- 172.21.15.150:0/348761771 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f0ddc078b90 0x7f0ddc07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:42:12.160 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:12.157+0000 7f0de57fa640 1 -- 172.21.15.150:0/348761771 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f0de809baf0 con 0x7f0df01f8fb0 2024-09-17T05:42:12.160 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:12.157+0000 7f0df4f80640 1 --2- 172.21.15.150:0/348761771 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f0ddc078b90 0x7f0ddc07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:42:12.160 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:12.158+0000 7f0df4f80640 1 --2- 172.21.15.150:0/348761771 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f0ddc078b90 0x7f0ddc07b0a0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f0dec009590 tx=0x7f0dec005f30 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:42:12.163 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:12.162+0000 7f0de57fa640 1 -- 172.21.15.150:0/348761771 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f0de801f060 con 0x7f0df01f8fb0 2024-09-17T05:42:12.374 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:12.373+0000 7f0df71e4640 1 -- 172.21.15.150:0/348761771 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f0df00b71d0 con 0x7f0df01f8fb0 2024-09-17T05:42:12.375 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:12.373+0000 7f0de57fa640 1 -- 172.21.15.150:0/348761771 <== mon.0 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) ==== 93+0+5226 (secure 0 0 0) 0x7f0df01f9900 con 0x7f0df01f8fb0 2024-09-17T05:42:12.375 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-09-17T05:42:12.375 INFO:teuthology.orchestra.run.smithi150.stdout:{"epoch":6,"btime":"2024-09-17T05:41:59:940454+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4316,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6835/357154046","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6833","nonce":357154046},{"type":"v1","addr":"172.21.15.150:6835","nonce":357154046}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4377,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6834/2757381484","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6832","nonce":2757381484},{"type":"v1","addr":"172.21.15.150:6834","nonce":2757381484}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4411,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6835/3751002674","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6834","nonce":3751002674},{"type":"v1","addr":"172.21.15.176:6835","nonce":3751002674}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T05:41:57.292807+0000","modified":"2024-09-17T05:41:59.294767+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4414},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4414":{"gid":4414,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.176:6837/1714683410","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6836","nonce":1714683410},{"type":"v1","addr":"172.21.15.176:6837","nonce":1714683410}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4414,"qdb_cluster":[4414]},"id":1}]} 2024-09-17T05:42:12.375 INFO:teuthology.orchestra.run.smithi150.stderr:dumped fsmap epoch 6 2024-09-17T05:42:12.377 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:12.375+0000 7f0df71e4640 1 -- 172.21.15.150:0/348761771 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f0ddc078b90 msgr2=0x7f0ddc07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:12.377 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:12.375+0000 7f0df71e4640 1 --2- 172.21.15.150:0/348761771 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f0ddc078b90 0x7f0ddc07b0a0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f0dec009590 tx=0x7f0dec005f30 comp rx=0 tx=0).stop 2024-09-17T05:42:12.377 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:12.375+0000 7f0df71e4640 1 -- 172.21.15.150:0/348761771 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0df01f8fb0 msgr2=0x7f0df01f93c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:12.378 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:12.375+0000 7f0df71e4640 1 --2- 172.21.15.150:0/348761771 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0df01f8fb0 0x7f0df01f93c0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f0df00c5d80 tx=0x7f0de800f790 comp rx=0 tx=0).stop 2024-09-17T05:42:12.378 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:12.375+0000 7f0df71e4640 1 -- 172.21.15.150:0/348761771 shutdown_connections 2024-09-17T05:42:12.378 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:12.375+0000 7f0df71e4640 1 --2- 172.21.15.150:0/348761771 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0df01f9b70 0x7f0df00cbbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:12.378 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:12.375+0000 7f0df71e4640 1 --2- 172.21.15.150:0/348761771 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f0ddc078b90 0x7f0ddc07b0a0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:12.378 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:12.375+0000 7f0df71e4640 1 --2- 172.21.15.150:0/348761771 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0df01f8fb0 0x7f0df01f93c0 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:12.378 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:12.375+0000 7f0df71e4640 1 --2- 172.21.15.150:0/348761771 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0dd8003fb0 0x7f0df00af930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:12.378 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:12.375+0000 7f0df71e4640 1 -- 172.21.15.150:0/348761771 >> 172.21.15.150:0/348761771 conn(0x7f0df00cef30 msgr2=0x7f0df01e5390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:42:12.378 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:12.376+0000 7f0df71e4640 1 -- 172.21.15.150:0/348761771 shutdown_connections 2024-09-17T05:42:12.378 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:12.376+0000 7f0df71e4640 1 -- 172.21.15.150:0/348761771 wait complete. 2024-09-17T05:42:12.792 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 6, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-17T05:41:57.292807+0000', 'modified': '2024-09-17T05:41:59.294767+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4414}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4414': {'gid': 4414, 'name': 'd', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.176:6837/1714683410', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.176:6836', 'nonce': 1714683410}, {'type': 'v1', 'addr': '172.21.15.176:6837', 'nonce': 1714683410}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 4414, 'qdb_cluster': [4414]} 2024-09-17T05:42:12.792 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-17T05:42:12.792 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.d status 2024-09-17T05:42:12.908 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:12.906+0000 7f1c6f932640 1 -- 172.21.15.150:0/1863223922 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1c680b2850 msgr2=0x7f1c680b0b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:12.909 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:12.906+0000 7f1c6f932640 1 --2- 172.21.15.150:0/1863223922 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1c680b2850 0x7f1c680b0b10 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f1c60005fd0 tx=0x7f1c6002a7a0 comp rx=0 tx=0).stop 2024-09-17T05:42:12.909 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:12.907+0000 7f1c6f932640 1 -- 172.21.15.150:0/1863223922 shutdown_connections 2024-09-17T05:42:12.909 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:12.907+0000 7f1c6f932640 1 --2- 172.21.15.150:0/1863223922 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1c680b2850 0x7f1c680b0b10 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:12.909 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:12.907+0000 7f1c6f932640 1 --2- 172.21.15.150:0/1863223922 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1c6806d7b0 0x7f1c680b2310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:12.909 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:12.907+0000 7f1c6f932640 1 -- 172.21.15.150:0/1863223922 >> 172.21.15.150:0/1863223922 conn(0x7f1c680b2ef0 msgr2=0x7f1c680b3300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:42:12.909 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:12.907+0000 7f1c6f932640 1 -- 172.21.15.150:0/1863223922 shutdown_connections 2024-09-17T05:42:12.909 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:12.907+0000 7f1c6f932640 1 -- 172.21.15.150:0/1863223922 wait complete. 2024-09-17T05:42:12.910 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:12.908+0000 7f1c6f932640 1 Processor -- start 2024-09-17T05:42:12.910 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:12.908+0000 7f1c6f932640 1 -- start start 2024-09-17T05:42:12.913 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:12.910+0000 7f1c6f932640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1c6806d7b0 0x7f1c681f9290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:42:12.913 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:12.910+0000 7f1c6f932640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1c680b2850 0x7f1c681f89b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:42:12.913 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:12.910+0000 7f1c6f932640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1c680ccf70 0x7f1c6809b2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:42:12.913 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:12.910+0000 7f1c6f932640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f1c680b6dc0 con 0x7f1c6806d7b0 2024-09-17T05:42:12.913 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:12.910+0000 7f1c6f932640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f1c680b6c40 con 0x7f1c680b2850 2024-09-17T05:42:12.913 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:12.910+0000 7f1c6f932640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f1c680b1050 con 0x7f1c680ccf70 2024-09-17T05:42:12.913 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:12.910+0000 7f1c6d6ce640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1c6806d7b0 0x7f1c681f9290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:42:12.913 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:12.910+0000 7f1c6d6ce640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1c6806d7b0 0x7f1c681f9290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:60308/0 (socket says 172.21.15.150:60308) 2024-09-17T05:42:12.913 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:12.910+0000 7f1c6d6ce640 1 -- 172.21.15.150:0/747861697 learned_addr learned my addr 172.21.15.150:0/747861697 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:42:12.913 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:12.910+0000 7f1c6cecd640 1 --2- 172.21.15.150:0/747861697 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1c680b2850 0x7f1c681f89b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:42:12.914 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:12.910+0000 7f1c6decf640 1 --2- 172.21.15.150:0/747861697 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1c680ccf70 0x7f1c6809b2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:42:12.914 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:12.910+0000 7f1c6d6ce640 1 -- 172.21.15.150:0/747861697 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1c680ccf70 msgr2=0x7f1c6809b2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:12.914 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:12.910+0000 7f1c6d6ce640 1 --2- 172.21.15.150:0/747861697 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1c680ccf70 0x7f1c6809b2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:12.914 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:12.910+0000 7f1c6d6ce640 1 -- 172.21.15.150:0/747861697 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1c680b2850 msgr2=0x7f1c681f89b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:12.914 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:12.910+0000 7f1c6d6ce640 1 --2- 172.21.15.150:0/747861697 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1c680b2850 0x7f1c681f89b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:12.914 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:12.910+0000 7f1c6d6ce640 1 -- 172.21.15.150:0/747861697 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1c681fa1a0 con 0x7f1c6806d7b0 2024-09-17T05:42:12.914 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:12.910+0000 7f1c6decf640 1 --2- 172.21.15.150:0/747861697 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1c680ccf70 0x7f1c6809b2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T05:42:12.914 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:12.910+0000 7f1c6d6ce640 1 --2- 172.21.15.150:0/747861697 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1c6806d7b0 0x7f1c681f9290 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f1c6400c500 tx=0x7f1c6400c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:42:12.914 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:12.910+0000 7f1c5dffb640 1 -- 172.21.15.150:0/747861697 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c64016020 con 0x7f1c6806d7b0 2024-09-17T05:42:12.914 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:12.910+0000 7f1c5dffb640 1 -- 172.21.15.150:0/747861697 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f1c64012940 con 0x7f1c6806d7b0 2024-09-17T05:42:12.914 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:12.910+0000 7f1c6f932640 1 -- 172.21.15.150:0/747861697 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1c681f9be0 con 0x7f1c6806d7b0 2024-09-17T05:42:12.914 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:12.910+0000 7f1c5dffb640 1 -- 172.21.15.150:0/747861697 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c64012d90 con 0x7f1c6806d7b0 2024-09-17T05:42:12.915 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:12.911+0000 7f1c6f932640 1 -- 172.21.15.150:0/747861697 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1c6809df10 con 0x7f1c6806d7b0 2024-09-17T05:42:12.915 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:12.912+0000 7f1c5dffb640 1 -- 172.21.15.150:0/747861697 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f1c64019020 con 0x7f1c6806d7b0 2024-09-17T05:42:12.916 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:12.913+0000 7f1c5dffb640 1 --2- 172.21.15.150:0/747861697 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f1c4c078b90 0x7f1c4c07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:42:12.916 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:12.913+0000 7f1c5dffb640 1 -- 172.21.15.150:0/747861697 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f1c6409abd0 con 0x7f1c6806d7b0 2024-09-17T05:42:12.916 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:12.913+0000 7f1c6cecd640 1 --2- 172.21.15.150:0/747861697 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f1c4c078b90 0x7f1c4c07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:42:12.916 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:12.914+0000 7f1c768a0740 1 Processor -- start 2024-09-17T05:42:12.916 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:12.914+0000 7f1c768a0740 1 -- start start 2024-09-17T05:42:12.916 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:12.914+0000 7f1c6cecd640 1 --2- 172.21.15.150:0/747861697 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f1c4c078b90 0x7f1c4c07b0a0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f1c6815d4c0 tx=0x7f1c58005f90 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:42:12.919 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:12.915+0000 7f1c768a0740 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55fdcc6f6270 0x55fdccac7fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:42:12.919 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:12.915+0000 7f1c768a0740 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55fdcc6cd3b0 0x55fdccac84e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:42:12.919 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:12.915+0000 7f1c768a0740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55fdcc6d5590 0x55fdccae53e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:42:12.919 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:12.915+0000 7f1c768a0740 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x55fdcca10820 con 0x55fdcc6f6270 2024-09-17T05:42:12.919 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:12.915+0000 7f1c768a0740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x55fdcc9ffc50 con 0x55fdcc6d5590 2024-09-17T05:42:12.919 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:12.915+0000 7f1c768a0740 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x55fdcca03a60 con 0x55fdcc6cd3b0 2024-09-17T05:42:12.919 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:12.915+0000 7f1c6d6ce640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55fdcc6f6270 0x55fdccac7fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:42:12.919 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:12.915+0000 7f1c6d6ce640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55fdcc6f6270 0x55fdccac7fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:60318/0 (socket says 172.21.15.150:60318) 2024-09-17T05:42:12.919 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:12.915+0000 7f1c6d6ce640 1 -- 172.21.15.150:0/2568087140 learned_addr learned my addr 172.21.15.150:0/2568087140 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:42:12.919 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:12.915+0000 7f1c6decf640 1 --2- 172.21.15.150:0/2568087140 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55fdcc6d5590 0x55fdccae53e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:42:12.919 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:12.915+0000 7f1c6cecd640 1 --2- 172.21.15.150:0/2568087140 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55fdcc6cd3b0 0x55fdccac84e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:42:12.920 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:12.915+0000 7f1c6d6ce640 1 -- 172.21.15.150:0/2568087140 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55fdcc6cd3b0 msgr2=0x55fdccac84e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:42:12.920 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:12.915+0000 7f1c6d6ce640 1 --2- 172.21.15.150:0/2568087140 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55fdcc6cd3b0 0x55fdccac84e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:12.920 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:12.915+0000 7f1c6d6ce640 1 -- 172.21.15.150:0/2568087140 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55fdcc6d5590 msgr2=0x55fdccae53e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:42:12.920 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:12.915+0000 7f1c6d6ce640 1 --2- 172.21.15.150:0/2568087140 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55fdcc6d5590 0x55fdccae53e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:12.920 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:12.915+0000 7f1c6d6ce640 1 -- 172.21.15.150:0/2568087140 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fdcc761850 con 0x55fdcc6f6270 2024-09-17T05:42:12.920 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:12.915+0000 7f1c6cecd640 1 --2- 172.21.15.150:0/2568087140 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55fdcc6cd3b0 0x55fdccac84e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:42:12.920 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:12.915+0000 7f1c6d6ce640 1 --2- 172.21.15.150:0/2568087140 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55fdcc6f6270 0x55fdccac7fa0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f1c64062930 tx=0x7f1c64062570 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5c27898dded2d22c server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:42:12.920 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:12.916+0000 7f1c52ffd640 1 -- 172.21.15.150:0/2568087140 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c64067480 con 0x55fdcc6f6270 2024-09-17T05:42:12.920 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:12.916+0000 7f1c52ffd640 1 -- 172.21.15.150:0/2568087140 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f1c6406c330 con 0x55fdcc6f6270 2024-09-17T05:42:12.920 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:12.916+0000 7f1c52ffd640 1 -- 172.21.15.150:0/2568087140 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c64067230 con 0x55fdcc6f6270 2024-09-17T05:42:12.920 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:12.916+0000 7f1c768a0740 1 -- 172.21.15.150:0/2568087140 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55fdcc6f6270 msgr2=0x55fdccac7fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:12.920 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:12.916+0000 7f1c768a0740 1 --2- 172.21.15.150:0/2568087140 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55fdcc6f6270 0x55fdccac7fa0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f1c64062930 tx=0x7f1c64062570 comp rx=0 tx=0).stop 2024-09-17T05:42:12.920 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:12.916+0000 7f1c768a0740 1 -- 172.21.15.150:0/2568087140 shutdown_connections 2024-09-17T05:42:12.921 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:12.916+0000 7f1c768a0740 1 --2- 172.21.15.150:0/2568087140 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55fdcc6d5590 0x55fdccae53e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:12.921 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:12.916+0000 7f1c768a0740 1 --2- 172.21.15.150:0/2568087140 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55fdcc6cd3b0 0x55fdccac84e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:12.921 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:12.916+0000 7f1c768a0740 1 --2- 172.21.15.150:0/2568087140 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55fdcc6f6270 0x55fdccac7fa0 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:12.921 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:12.916+0000 7f1c768a0740 1 -- 172.21.15.150:0/2568087140 >> 172.21.15.150:0/2568087140 conn(0x55fdcc6ea3c0 msgr2=0x55fdcca9e260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:42:12.921 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:12.916+0000 7f1c768a0740 1 -- 172.21.15.150:0/2568087140 shutdown_connections 2024-09-17T05:42:12.921 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:12.916+0000 7f1c768a0740 1 -- 172.21.15.150:0/2568087140 wait complete. 2024-09-17T05:42:12.921 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:12.917+0000 7f1c768a0740 1 -- start start 2024-09-17T05:42:12.921 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:12.917+0000 7f1c768a0740 1 Processor -- start 2024-09-17T05:42:12.925 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:12.919+0000 7f1c768a0740 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55fdcc6cd3b0 0x55fdccab5b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:42:12.925 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:12.919+0000 7f1c768a0740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55fdcc6d5590 0x55fdccab7d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:42:12.925 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:12.919+0000 7f1c768a0740 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55fdcc6f6270 0x55fdccab8280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:42:12.925 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:12.919+0000 7f1c768a0740 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x55fdcc770620 con 0x55fdcc6f6270 2024-09-17T05:42:12.925 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:12.919+0000 7f1c768a0740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x55fdcc9a55f0 con 0x55fdcc6d5590 2024-09-17T05:42:12.925 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:12.919+0000 7f1c768a0740 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x55fdccac8a20 con 0x55fdcc6cd3b0 2024-09-17T05:42:12.925 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:12.919+0000 7f1c768a0740 10 client.0 _ll_register_callbacks cb 0x55fdcc9a90a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T05:42:12.925 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:12.919+0000 7f1c6decf640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55fdcc6f6270 0x55fdccab8280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:42:12.925 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:12.919+0000 7f1c6decf640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55fdcc6f6270 0x55fdccab8280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:60320/0 (socket says 172.21.15.150:60320) 2024-09-17T05:42:12.926 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:12.919+0000 7f1c6decf640 1 -- 172.21.15.150:0/605908210 learned_addr learned my addr 172.21.15.150:0/605908210 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:42:12.926 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:12.919+0000 7f1c6cecd640 1 --2- 172.21.15.150:0/605908210 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55fdcc6d5590 0x55fdccab7d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:42:12.926 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:12.919+0000 7f1c6d6ce640 1 --2- 172.21.15.150:0/605908210 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55fdcc6cd3b0 0x55fdccab5b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:42:12.926 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:12.919+0000 7f1c6decf640 1 -- 172.21.15.150:0/605908210 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55fdcc6cd3b0 msgr2=0x55fdccab5b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:42:12.926 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:12.919+0000 7f1c6decf640 1 --2- 172.21.15.150:0/605908210 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55fdcc6cd3b0 0x55fdccab5b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:12.926 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:12.919+0000 7f1c6decf640 1 -- 172.21.15.150:0/605908210 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55fdcc6d5590 msgr2=0x55fdccab7d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:42:12.926 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:12.919+0000 7f1c6decf640 1 --2- 172.21.15.150:0/605908210 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55fdcc6d5590 0x55fdccab7d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:12.926 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:12.919+0000 7f1c6decf640 1 -- 172.21.15.150:0/605908210 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fdcc7d86b0 con 0x55fdcc6f6270 2024-09-17T05:42:12.926 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:12.919+0000 7f1c6cecd640 1 --2- 172.21.15.150:0/605908210 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55fdcc6d5590 0x55fdccab7d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:42:12.926 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:12.919+0000 7f1c6decf640 1 --2- 172.21.15.150:0/605908210 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55fdcc6f6270 0x55fdccab8280 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f1c60009cd0 tx=0x7f1c60009360 comp rx=0 tx=0).ready entity=mon.0 client_cookie=23f4a25513c913c0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:42:12.926 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:12.919+0000 7f1c47fff640 10 client.0 ms_handle_connect on v2:172.21.15.150:3300/0 2024-09-17T05:42:12.926 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:12.920+0000 7f1c47fff640 1 -- 172.21.15.150:0/605908210 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c60042030 con 0x55fdcc6f6270 2024-09-17T05:42:12.926 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:12.920+0000 7f1c47fff640 1 -- 172.21.15.150:0/605908210 <== mon.0 v2:172.21.15.150:3300/0 2 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f1c60004250 con 0x55fdcc6f6270 2024-09-17T05:42:12.927 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:12.920+0000 7f1c768a0740 1 -- 172.21.15.150:0/605908210 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1c6406c330 con 0x55fdcc6f6270 2024-09-17T05:42:12.927 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:12.920+0000 7f1c47fff640 1 -- 172.21.15.150:0/605908210 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_get_version_reply(handle=1 version=6) ==== 24+0+0 (secure 0 0 0) 0x7f1c6004e050 con 0x55fdcc6f6270 2024-09-17T05:42:12.927 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:12.920+0000 7f1c768a0740 10 client.4749 fetch_fsmap learned FSMap version 6 2024-09-17T05:42:12.927 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:12.920+0000 7f1c768a0740 1 -- 172.21.15.150:0/605908210 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,fsmap=6,monmap=2+}) -- 0x55fdccade4b0 con 0x55fdcc6f6270 2024-09-17T05:42:12.927 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:12.920+0000 7f1c47fff640 1 -- 172.21.15.150:0/605908210 <== mon.0 v2:172.21.15.150:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f1c6406c330 con 0x55fdcc6f6270 2024-09-17T05:42:12.927 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:12.920+0000 7f1c47fff640 1 -- 172.21.15.150:0/605908210 <== mon.0 v2:172.21.15.150:3300/0 5 ==== fsmap(e 6) ==== 3502+0+0 (secure 0 0 0) 0x7f1c60051020 con 0x55fdcc6f6270 2024-09-17T05:42:12.927 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:12.920+0000 7f1c768a0740 10 client.4749 fetch_fsmap finished waiting for FSMap version 6 2024-09-17T05:42:12.927 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:12.920+0000 7f1c768a0740 10 client.4749 resolve_mds: resolved name 'd' to daemon mds.d 2024-09-17T05:42:12.927 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:12.920+0000 7f1c768a0740 20 client.4749 populate_metadata read hostname 'smithi150' 2024-09-17T05:42:12.927 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:12.920+0000 7f1c768a0740 1 --2- 172.21.15.150:0/605908210 >> [v2:172.21.15.176:6836/1714683410,v1:172.21.15.176:6837/1714683410] conn(0x55fdcc6b4e40 0x55fdccadd540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:42:12.927 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:12.920+0000 7f1c768a0740 4 client.4749 mds_command: new command op to 4414 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-17T05:42:12.927 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:12.920+0000 7f1c768a0740 1 -- 172.21.15.150:0/605908210 --> [v2:172.21.15.176:6836/1714683410,v1:172.21.15.176:6837/1714683410] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55fdcca12770 con 0x55fdcc6b4e40 2024-09-17T05:42:12.927 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:12.920+0000 7f1c6d6ce640 1 --2- 172.21.15.150:0/605908210 >> [v2:172.21.15.176:6836/1714683410,v1:172.21.15.176:6837/1714683410] conn(0x55fdcc6b4e40 0x55fdccadd540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:42:12.928 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:12.921+0000 7f1c47fff640 10 client.4749 ms_handle_connect on v2:172.21.15.176:6836/1714683410 2024-09-17T05:42:12.928 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:12.921+0000 7f1c6d6ce640 1 --2- 172.21.15.150:0/605908210 >> [v2:172.21.15.176:6836/1714683410,v1:172.21.15.176:6837/1714683410] conn(0x55fdcc6b4e40 0x55fdccadd540 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9823f33e5fe2c70 server_cookie=4dd03adb0c506ab8 in_seq=0 out_seq=0 2024-09-17T05:42:12.928 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:12.922+0000 7f1c47fff640 1 -- 172.21.15.150:0/605908210 <== mds.0 v2:172.21.15.176:6836/1714683410 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55fdcca12770 con 0x55fdcc6b4e40 2024-09-17T05:42:12.928 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:12.922+0000 7f1c47fff640 10 client.4749 handle_command_reply: tid=0 2024-09-17T05:42:12.928 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:12.922+0000 7f1c768a0740 1 client.4749 shutdown 2024-09-17T05:42:12.928 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:12.922+0000 7f1c768a0740 1 -- 172.21.15.150:0/605908210 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55fdcc6f6270 msgr2=0x55fdccab8280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:12.928 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:12.922+0000 7f1c768a0740 1 --2- 172.21.15.150:0/605908210 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55fdcc6f6270 0x55fdccab8280 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f1c60009cd0 tx=0x7f1c60009360 comp rx=0 tx=0).stop 2024-09-17T05:42:12.928 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:12.922+0000 7f1c768a0740 1 -- 172.21.15.150:0/605908210 shutdown_connections 2024-09-17T05:42:12.928 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:12.922+0000 7f1c768a0740 1 --2- 172.21.15.150:0/605908210 >> [v2:172.21.15.176:6836/1714683410,v1:172.21.15.176:6837/1714683410] conn(0x55fdcc6b4e40 0x55fdccadd540 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:12.928 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:12.922+0000 7f1c768a0740 1 --2- 172.21.15.150:0/605908210 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55fdcc6d5590 0x55fdccab7d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:12.928 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:12.922+0000 7f1c768a0740 1 --2- 172.21.15.150:0/605908210 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55fdcc6f6270 0x55fdccab8280 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:12.928 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:12.922+0000 7f1c47fff640 0 client.4749 ms_handle_reset on v2:172.21.15.176:6836/1714683410 2024-09-17T05:42:12.929 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:12.922+0000 7f1c768a0740 1 --2- 172.21.15.150:0/605908210 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55fdcc6cd3b0 0x55fdccab5b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:12.929 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:12.922+0000 7f1c768a0740 1 -- 172.21.15.150:0/605908210 >> 172.21.15.150:0/605908210 conn(0x55fdcc6ea3c0 msgr2=0x55fdcca988f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:42:12.929 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:12.922+0000 7f1c768a0740 1 -- 172.21.15.150:0/605908210 shutdown_connections 2024-09-17T05:42:12.929 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:12.922+0000 7f1c768a0740 1 -- 172.21.15.150:0/605908210 wait complete. 2024-09-17T05:42:12.929 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:12.922+0000 7f1c768a0740 20 client.4749 trim_cache size 0 max 16384 2024-09-17T05:42:12.943 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:12.942+0000 7f1c768a0740 1 Processor -- start 2024-09-17T05:42:12.943 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:12.942+0000 7f1c768a0740 1 -- start start 2024-09-17T05:42:12.946 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:12.943+0000 7f1c768a0740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55fdcc6b4e40 0x55fdccb065d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:42:12.946 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:12.943+0000 7f1c768a0740 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55fdcc6cd3b0 0x55fdccac7c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:42:12.946 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:12.943+0000 7f1c768a0740 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55fdcc6d5590 0x55fdccac8180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:42:12.946 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:12.943+0000 7f1c768a0740 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f1c68152c90 con 0x55fdcc6cd3b0 2024-09-17T05:42:12.946 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:12.943+0000 7f1c768a0740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f1c68151ff0 con 0x55fdcc6b4e40 2024-09-17T05:42:12.946 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:12.943+0000 7f1c768a0740 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f1c68152640 con 0x55fdcc6d5590 2024-09-17T05:42:12.946 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:12.943+0000 7f1c6cecd640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55fdcc6cd3b0 0x55fdccac7c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:42:12.946 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:12.943+0000 7f1c6cecd640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55fdcc6cd3b0 0x55fdccac7c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:60328/0 (socket says 172.21.15.150:60328) 2024-09-17T05:42:12.946 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:12.943+0000 7f1c6cecd640 1 -- 172.21.15.150:0/3086402056 learned_addr learned my addr 172.21.15.150:0/3086402056 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:42:12.946 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:12.943+0000 7f1c6d6ce640 1 --2- 172.21.15.150:0/3086402056 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55fdcc6b4e40 0x55fdccb065d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:42:12.946 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:12.943+0000 7f1c6decf640 1 --2- 172.21.15.150:0/3086402056 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55fdcc6d5590 0x55fdccac8180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:42:12.946 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:12.943+0000 7f1c6cecd640 1 -- 172.21.15.150:0/3086402056 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55fdcc6d5590 msgr2=0x55fdccac8180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:42:12.947 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:12.943+0000 7f1c6cecd640 1 --2- 172.21.15.150:0/3086402056 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55fdcc6d5590 0x55fdccac8180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:12.947 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:12.943+0000 7f1c6cecd640 1 -- 172.21.15.150:0/3086402056 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55fdcc6b4e40 msgr2=0x55fdccb065d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:42:12.947 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:12.943+0000 7f1c6cecd640 1 --2- 172.21.15.150:0/3086402056 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55fdcc6b4e40 0x55fdccb065d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:12.947 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:12.943+0000 7f1c6cecd640 1 -- 172.21.15.150:0/3086402056 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fdccada1e0 con 0x55fdcc6cd3b0 2024-09-17T05:42:12.947 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:12.944+0000 7f1c6cecd640 1 --2- 172.21.15.150:0/3086402056 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55fdcc6cd3b0 0x55fdccac7c40 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f1c58011fa0 tx=0x7f1c58014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7f9f2ed2d8fb4d25 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:42:12.947 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:12.944+0000 7f1c527fc640 1 -- 172.21.15.150:0/3086402056 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c58005220 con 0x55fdcc6cd3b0 2024-09-17T05:42:12.947 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:12.944+0000 7f1c527fc640 1 -- 172.21.15.150:0/3086402056 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f1c580053c0 con 0x55fdcc6cd3b0 2024-09-17T05:42:12.947 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:12.944+0000 7f1c527fc640 1 -- 172.21.15.150:0/3086402056 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c580047a0 con 0x55fdcc6cd3b0 2024-09-17T05:42:12.952 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:12.945+0000 7f1c768a0740 1 -- 172.21.15.150:0/3086402056 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55fdcc6cd3b0 msgr2=0x55fdccac7c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:12.952 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:12.945+0000 7f1c768a0740 1 --2- 172.21.15.150:0/3086402056 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55fdcc6cd3b0 0x55fdccac7c40 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f1c58011fa0 tx=0x7f1c58014000 comp rx=0 tx=0).stop 2024-09-17T05:42:12.952 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:12.945+0000 7f1c768a0740 1 -- 172.21.15.150:0/3086402056 shutdown_connections 2024-09-17T05:42:12.952 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:12.945+0000 7f1c768a0740 1 --2- 172.21.15.150:0/3086402056 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55fdcc6d5590 0x55fdccac8180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:12.952 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:12.945+0000 7f1c768a0740 1 --2- 172.21.15.150:0/3086402056 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55fdcc6cd3b0 0x55fdccac7c40 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:12.952 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:12.945+0000 7f1c768a0740 1 --2- 172.21.15.150:0/3086402056 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55fdcc6b4e40 0x55fdccb065d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:12.952 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:12.945+0000 7f1c768a0740 1 -- 172.21.15.150:0/3086402056 >> 172.21.15.150:0/3086402056 conn(0x55fdcc6ea3c0 msgr2=0x55fdccadc690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:42:12.953 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:12.945+0000 7f1c768a0740 1 -- 172.21.15.150:0/3086402056 shutdown_connections 2024-09-17T05:42:12.953 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:12.945+0000 7f1c768a0740 1 -- 172.21.15.150:0/3086402056 wait complete. 2024-09-17T05:42:12.953 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:12.946+0000 7f1c768a0740 1 -- start start 2024-09-17T05:42:12.953 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:12.946+0000 7f1c768a0740 1 Processor -- start 2024-09-17T05:42:12.953 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:12.947+0000 7f1c768a0740 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55fdcc6b4e40 0x55fdccb4bae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:42:12.953 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:12.947+0000 7f1c768a0740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55fdcc6cd3b0 0x55fdccb62860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:42:12.953 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:12.947+0000 7f1c768a0740 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55fdcc6d5590 0x55fdccb66640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:42:12.953 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:12.947+0000 7f1c768a0740 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x55fdccab63a0 con 0x55fdcc6b4e40 2024-09-17T05:42:12.953 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:12.947+0000 7f1c768a0740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x55fdccab6130 con 0x55fdcc6cd3b0 2024-09-17T05:42:12.953 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:12.947+0000 7f1c768a0740 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x55fdccad9f90 con 0x55fdcc6d5590 2024-09-17T05:42:12.953 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:12.947+0000 7f1c768a0740 10 client.0 _ll_register_callbacks cb 0x7f1c540036f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T05:42:12.953 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:12.947+0000 7f1c6d6ce640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55fdcc6b4e40 0x55fdccb4bae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:42:12.953 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:12.947+0000 7f1c6d6ce640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55fdcc6b4e40 0x55fdccb4bae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:60338/0 (socket says 172.21.15.150:60338) 2024-09-17T05:42:12.954 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:12.947+0000 7f1c6d6ce640 1 -- 172.21.15.150:0/3608796928 learned_addr learned my addr 172.21.15.150:0/3608796928 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:42:12.954 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:12.947+0000 7f1c6cecd640 1 --2- 172.21.15.150:0/3608796928 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55fdcc6cd3b0 0x55fdccb62860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:42:12.954 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:12.947+0000 7f1c6decf640 1 --2- 172.21.15.150:0/3608796928 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55fdcc6d5590 0x55fdccb66640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:42:12.954 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:12.948+0000 7f1c6d6ce640 1 -- 172.21.15.150:0/3608796928 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55fdcc6d5590 msgr2=0x55fdccb66640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:42:12.954 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:12.948+0000 7f1c6d6ce640 1 --2- 172.21.15.150:0/3608796928 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55fdcc6d5590 0x55fdccb66640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:12.954 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:12.948+0000 7f1c6d6ce640 1 -- 172.21.15.150:0/3608796928 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55fdcc6cd3b0 msgr2=0x55fdccb62860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:42:12.954 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:12.948+0000 7f1c6d6ce640 1 --2- 172.21.15.150:0/3608796928 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55fdcc6cd3b0 0x55fdccb62860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:12.954 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:12.948+0000 7f1c6d6ce640 1 -- 172.21.15.150:0/3608796928 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fdccb65e80 con 0x55fdcc6b4e40 2024-09-17T05:42:12.954 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:12.948+0000 7f1c6d6ce640 1 --2- 172.21.15.150:0/3608796928 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55fdcc6b4e40 0x55fdccb4bae0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f1c640628e0 tx=0x7f1c64098fd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=96a5880b40799be5 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:42:12.954 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:12.948+0000 7f1c47fff640 10 client.0 ms_handle_connect on v2:172.21.15.150:3300/0 2024-09-17T05:42:12.954 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:12.948+0000 7f1c47fff640 1 -- 172.21.15.150:0/3608796928 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c6405eff0 con 0x55fdcc6b4e40 2024-09-17T05:42:12.954 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:12.948+0000 7f1c47fff640 1 -- 172.21.15.150:0/3608796928 <== mon.0 v2:172.21.15.150:3300/0 2 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f1c64061c00 con 0x55fdcc6b4e40 2024-09-17T05:42:12.954 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:12.948+0000 7f1c768a0740 1 -- 172.21.15.150:0/3608796928 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1c580053c0 con 0x55fdcc6b4e40 2024-09-17T05:42:12.954 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:12.948+0000 7f1c47fff640 1 -- 172.21.15.150:0/3608796928 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_get_version_reply(handle=1 version=6) ==== 24+0+0 (secure 0 0 0) 0x7f1c6406c330 con 0x55fdcc6b4e40 2024-09-17T05:42:12.955 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:12.948+0000 7f1c768a0740 10 client.4755 fetch_fsmap learned FSMap version 6 2024-09-17T05:42:12.955 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:12.948+0000 7f1c768a0740 1 -- 172.21.15.150:0/3608796928 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,fsmap=6,monmap=2+}) -- 0x55fdccb62da0 con 0x55fdcc6b4e40 2024-09-17T05:42:12.955 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:12.948+0000 7f1c47fff640 1 -- 172.21.15.150:0/3608796928 <== mon.0 v2:172.21.15.150:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f1c580053c0 con 0x55fdcc6b4e40 2024-09-17T05:42:12.955 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:12.948+0000 7f1c47fff640 1 -- 172.21.15.150:0/3608796928 <== mon.0 v2:172.21.15.150:3300/0 5 ==== fsmap(e 6) ==== 3502+0+0 (secure 0 0 0) 0x7f1c64065ce0 con 0x55fdcc6b4e40 2024-09-17T05:42:12.955 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:12.948+0000 7f1c768a0740 10 client.4755 fetch_fsmap finished waiting for FSMap version 6 2024-09-17T05:42:12.955 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:12.948+0000 7f1c768a0740 10 client.4755 resolve_mds: resolved name 'd' to daemon mds.d 2024-09-17T05:42:12.955 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:12.948+0000 7f1c768a0740 20 client.4755 populate_metadata read hostname 'smithi150' 2024-09-17T05:42:12.955 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:12.948+0000 7f1c768a0740 1 --2- 172.21.15.150:0/3608796928 >> [v2:172.21.15.176:6836/1714683410,v1:172.21.15.176:6837/1714683410] conn(0x55fdcc68a280 0x55fdccac7e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:42:12.955 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:12.948+0000 7f1c768a0740 4 client.4755 mds_command: new command op to 4414 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-17T05:42:12.955 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:12.948+0000 7f1c768a0740 1 -- 172.21.15.150:0/3608796928 --> [v2:172.21.15.176:6836/1714683410,v1:172.21.15.176:6837/1714683410] -- command(tid 0: {"prefix": "status"}) -- 0x55fdcca0e220 con 0x55fdcc68a280 2024-09-17T05:42:12.955 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:12.948+0000 7f1c6cecd640 1 --2- 172.21.15.150:0/3608796928 >> [v2:172.21.15.176:6836/1714683410,v1:172.21.15.176:6837/1714683410] conn(0x55fdcc68a280 0x55fdccac7e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:42:12.955 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:12.949+0000 7f1c47fff640 10 client.4755 ms_handle_connect on v2:172.21.15.176:6836/1714683410 2024-09-17T05:42:12.955 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:12.949+0000 7f1c6cecd640 1 --2- 172.21.15.150:0/3608796928 >> [v2:172.21.15.176:6836/1714683410,v1:172.21.15.176:6837/1714683410] conn(0x55fdcc68a280 0x55fdccac7e20 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=11310da31228ad67 server_cookie=bf93b7bf77bced8e in_seq=0 out_seq=0 2024-09-17T05:42:12.956 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:12.949+0000 7f1c47fff640 1 -- 172.21.15.150:0/3608796928 <== mds.0 v2:172.21.15.176:6836/1714683410 1 ==== command_reply(tid 0: 0 ) ==== 8+0+318 (crc 0 0 0) 0x55fdcca0e220 con 0x55fdcc68a280 2024-09-17T05:42:12.956 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:12.949+0000 7f1c47fff640 10 client.4755 handle_command_reply: tid=0 2024-09-17T05:42:12.956 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:12.949+0000 7f1c768a0740 1 client.4755 shutdown 2024-09-17T05:42:12.956 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:12.949+0000 7f1c768a0740 1 -- 172.21.15.150:0/3608796928 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55fdcc6b4e40 msgr2=0x55fdccb4bae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:12.956 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:12.949+0000 7f1c768a0740 1 --2- 172.21.15.150:0/3608796928 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55fdcc6b4e40 0x55fdccb4bae0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f1c640628e0 tx=0x7f1c64098fd0 comp rx=0 tx=0).stop 2024-09-17T05:42:12.956 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:12.950+0000 7f1c768a0740 1 -- 172.21.15.150:0/3608796928 shutdown_connections 2024-09-17T05:42:12.956 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:12.950+0000 7f1c768a0740 1 --2- 172.21.15.150:0/3608796928 >> [v2:172.21.15.176:6836/1714683410,v1:172.21.15.176:6837/1714683410] conn(0x55fdcc68a280 0x55fdccac7e20 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:12.956 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:12.950+0000 7f1c768a0740 1 --2- 172.21.15.150:0/3608796928 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55fdcc6cd3b0 0x55fdccb62860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:12.956 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:12.950+0000 7f1c768a0740 1 --2- 172.21.15.150:0/3608796928 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55fdcc6d5590 0x55fdccb66640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:12.956 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:12.950+0000 7f1c768a0740 1 --2- 172.21.15.150:0/3608796928 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55fdcc6b4e40 0x55fdccb4bae0 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:12.956 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:12.950+0000 7f1c47fff640 0 client.4755 ms_handle_reset on v2:172.21.15.176:6836/1714683410 2024-09-17T05:42:12.956 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:12.950+0000 7f1c768a0740 1 -- 172.21.15.150:0/3608796928 >> 172.21.15.150:0/3608796928 conn(0x55fdcc6ea3c0 msgr2=0x55fdccb065d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:42:12.956 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:12.950+0000 7f1c768a0740 1 -- 172.21.15.150:0/3608796928 shutdown_connections 2024-09-17T05:42:12.957 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:12.950+0000 7f1c768a0740 1 -- 172.21.15.150:0/3608796928 wait complete. 2024-09-17T05:42:12.957 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:12.950+0000 7f1c768a0740 20 client.4755 trim_cache size 0 max 16384 2024-09-17T05:42:12.957 INFO:teuthology.orchestra.run.smithi150.stdout:{ 2024-09-17T05:42:12.957 INFO:teuthology.orchestra.run.smithi150.stdout: "cluster_fsid": "9f2e05e9-d629-47b3-b26b-1360655b7d20", 2024-09-17T05:42:12.957 INFO:teuthology.orchestra.run.smithi150.stdout: "whoami": 0, 2024-09-17T05:42:12.957 INFO:teuthology.orchestra.run.smithi150.stdout: "id": 4414, 2024-09-17T05:42:12.957 INFO:teuthology.orchestra.run.smithi150.stdout: "want_state": "up:active", 2024-09-17T05:42:12.957 INFO:teuthology.orchestra.run.smithi150.stdout: "state": "up:active", 2024-09-17T05:42:12.957 INFO:teuthology.orchestra.run.smithi150.stdout: "fs_name": "cephfs", 2024-09-17T05:42:12.957 INFO:teuthology.orchestra.run.smithi150.stdout: "rank_uptime": 15.025253443, 2024-09-17T05:42:12.958 INFO:teuthology.orchestra.run.smithi150.stdout: "mdsmap_epoch": 6, 2024-09-17T05:42:12.958 INFO:teuthology.orchestra.run.smithi150.stdout: "osdmap_epoch": 23, 2024-09-17T05:42:12.958 INFO:teuthology.orchestra.run.smithi150.stdout: "osdmap_epoch_barrier": 23, 2024-09-17T05:42:12.958 INFO:teuthology.orchestra.run.smithi150.stdout: "uptime": 21.041502932 2024-09-17T05:42:12.958 INFO:teuthology.orchestra.run.smithi150.stdout:} 2024-09-17T05:42:12.959 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:12.950+0000 7f1c6f932640 1 -- 172.21.15.150:0/747861697 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f1c4c078b90 msgr2=0x7f1c4c07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:12.959 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:12.950+0000 7f1c6f932640 1 --2- 172.21.15.150:0/747861697 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f1c4c078b90 0x7f1c4c07b0a0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f1c6815d4c0 tx=0x7f1c58005f90 comp rx=0 tx=0).stop 2024-09-17T05:42:12.959 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:12.950+0000 7f1c6f932640 1 -- 172.21.15.150:0/747861697 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1c6806d7b0 msgr2=0x7f1c681f9290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:12.959 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:12.950+0000 7f1c6f932640 1 --2- 172.21.15.150:0/747861697 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1c6806d7b0 0x7f1c681f9290 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f1c6400c500 tx=0x7f1c6400c9c0 comp rx=0 tx=0).stop 2024-09-17T05:42:12.959 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:12.950+0000 7f1c6f932640 1 -- 172.21.15.150:0/747861697 shutdown_connections 2024-09-17T05:42:12.959 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:12.950+0000 7f1c6f932640 1 --2- 172.21.15.150:0/747861697 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1c680b2850 0x7f1c681f89b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:12.959 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:12.950+0000 7f1c6f932640 1 --2- 172.21.15.150:0/747861697 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f1c4c078b90 0x7f1c4c07b0a0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:12.959 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:12.950+0000 7f1c6f932640 1 --2- 172.21.15.150:0/747861697 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1c680ccf70 0x7f1c6809b2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:12.959 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:12.950+0000 7f1c6f932640 1 --2- 172.21.15.150:0/747861697 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1c6806d7b0 0x7f1c681f9290 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:12.959 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:12.950+0000 7f1c6f932640 1 -- 172.21.15.150:0/747861697 >> 172.21.15.150:0/747861697 conn(0x7f1c680b2ef0 msgr2=0x7f1c680cb2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:42:12.960 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:12.950+0000 7f1c6f932640 1 -- 172.21.15.150:0/747861697 shutdown_connections 2024-09-17T05:42:12.960 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:12.951+0000 7f1c6f932640 1 -- 172.21.15.150:0/747861697 wait complete. 2024-09-17T05:42:12.963 INFO:teuthology.run_tasks:Running task kclient... 2024-09-17T05:42:12.992 INFO:tasks.kclient:Mounting kernel clients... 2024-09-17T05:42:12.993 INFO:tasks.kclient:config is {'client.0': {}, 'client.2': {}, 'client.1': {}, 'client.3': {}} 2024-09-17T05:42:12.993 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:42:12.993 DEBUG:teuthology.orchestra.run.smithi150:> ip netns list 2024-09-17T05:42:13.009 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:42:13.009 DEBUG:teuthology.orchestra.run.smithi150:> sudo ip link delete ceph-brx 2024-09-17T05:42:13.076 INFO:teuthology.orchestra.run.smithi150.stderr:Cannot find device "ceph-brx" 2024-09-17T05:42:13.077 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-17T05:42:13.077 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:42:13.077 DEBUG:teuthology.orchestra.run.smithi150:> ip netns list 2024-09-17T05:42:13.132 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:42:13.132 DEBUG:teuthology.orchestra.run.smithi150:> sudo ip link delete ceph-brx 2024-09-17T05:42:13.198 INFO:teuthology.orchestra.run.smithi150.stderr:Cannot find device "ceph-brx" 2024-09-17T05:42:13.199 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-17T05:42:13.200 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:42:13.200 DEBUG:teuthology.orchestra.run.smithi176:> ip netns list 2024-09-17T05:42:13.219 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:42:13.219 DEBUG:teuthology.orchestra.run.smithi176:> sudo ip link delete ceph-brx 2024-09-17T05:42:13.291 INFO:teuthology.orchestra.run.smithi176.stderr:Cannot find device "ceph-brx" 2024-09-17T05:42:13.293 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-17T05:42:13.293 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:42:13.293 DEBUG:teuthology.orchestra.run.smithi176:> ip netns list 2024-09-17T05:42:13.351 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:42:13.351 DEBUG:teuthology.orchestra.run.smithi176:> sudo ip link delete ceph-brx 2024-09-17T05:42:13.420 INFO:teuthology.orchestra.run.smithi176.stderr:Cannot find device "ceph-brx" 2024-09-17T05:42:13.421 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-17T05:42:13.421 INFO:tasks.kclient:client.0 config is {'syntax': 'v1'} 2024-09-17T05:42:13.421 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-09-17T05:42:13.422 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-17T05:42:13.422 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-17T05:42:13.536 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:13.534+0000 7fd49085c640 1 -- 172.21.15.150:0/1132500313 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd48c15fae0 msgr2=0x7fd48c166550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:13.536 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:13.534+0000 7fd49085c640 1 --2- 172.21.15.150:0/1132500313 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd48c15fae0 0x7fd48c166550 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fd484009830 tx=0x7fd48402a480 comp rx=0 tx=0).stop 2024-09-17T05:42:13.536 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:13.534+0000 7fd49085c640 1 -- 172.21.15.150:0/1132500313 shutdown_connections 2024-09-17T05:42:13.537 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:13.534+0000 7fd49085c640 1 --2- 172.21.15.150:0/1132500313 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd48c15fae0 0x7fd48c166550 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:13.537 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:13.534+0000 7fd49085c640 1 -- 172.21.15.150:0/1132500313 >> 172.21.15.150:0/1132500313 conn(0x7fd48c06d730 msgr2=0x7fd48c0b1e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:42:13.537 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:13.534+0000 7fd49085c640 1 -- 172.21.15.150:0/1132500313 shutdown_connections 2024-09-17T05:42:13.537 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:13.534+0000 7fd49085c640 1 -- 172.21.15.150:0/1132500313 wait complete. 2024-09-17T05:42:13.537 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:13.536+0000 7fd49085c640 1 Processor -- start 2024-09-17T05:42:13.537 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:13.536+0000 7fd49085c640 1 -- start start 2024-09-17T05:42:13.540 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:13.537+0000 7fd49085c640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd48c0aebc0 0x7fd48c14e280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:42:13.540 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:13.537+0000 7fd49085c640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd48c152920 0x7fd48c150de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:42:13.541 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:13.537+0000 7fd49085c640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd48c151320 0x7fd48c153ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:42:13.541 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:13.537+0000 7fd49085c640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7fd48c166e20 con 0x7fd48c151320 2024-09-17T05:42:13.541 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:13.537+0000 7fd49085c640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fd48c166ca0 con 0x7fd48c0aebc0 2024-09-17T05:42:13.541 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:13.537+0000 7fd49085c640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fd48c166fa0 con 0x7fd48c152920 2024-09-17T05:42:13.541 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:13.537+0000 7fd48ad9d640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd48c151320 0x7fd48c153ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:42:13.541 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:13.538+0000 7fd48ad9d640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd48c151320 0x7fd48c153ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:60358/0 (socket says 172.21.15.150:60358) 2024-09-17T05:42:13.541 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:13.538+0000 7fd48ad9d640 1 -- 172.21.15.150:0/193043914 learned_addr learned my addr 172.21.15.150:0/193043914 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:42:13.541 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:13.538+0000 7fd48a59c640 1 --2- 172.21.15.150:0/193043914 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd48c0aebc0 0x7fd48c14e280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:42:13.541 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:13.538+0000 7fd489d9b640 1 --2- 172.21.15.150:0/193043914 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd48c152920 0x7fd48c150de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:42:13.541 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:13.538+0000 7fd48ad9d640 1 -- 172.21.15.150:0/193043914 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd48c152920 msgr2=0x7fd48c150de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:13.541 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:13.538+0000 7fd48ad9d640 1 --2- 172.21.15.150:0/193043914 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd48c152920 0x7fd48c150de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:13.541 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:13.538+0000 7fd48ad9d640 1 -- 172.21.15.150:0/193043914 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd48c0aebc0 msgr2=0x7fd48c14e280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:13.541 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:13.538+0000 7fd48ad9d640 1 --2- 172.21.15.150:0/193043914 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd48c0aebc0 0x7fd48c14e280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:13.542 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:13.538+0000 7fd48ad9d640 1 -- 172.21.15.150:0/193043914 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd48c151730 con 0x7fd48c151320 2024-09-17T05:42:13.542 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:13.538+0000 7fd489d9b640 1 --2- 172.21.15.150:0/193043914 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd48c152920 0x7fd48c150de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:42:13.542 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:13.538+0000 7fd48ad9d640 1 --2- 172.21.15.150:0/193043914 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd48c151320 0x7fd48c153ed0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fd484009950 tx=0x7fd4840045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:42:13.542 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:13.538+0000 7fd482ffd640 1 -- 172.21.15.150:0/193043914 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd484003b00 con 0x7fd48c151320 2024-09-17T05:42:13.542 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:13.538+0000 7fd482ffd640 1 -- 172.21.15.150:0/193043914 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd484003d90 con 0x7fd48c151320 2024-09-17T05:42:13.542 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:13.538+0000 7fd49085c640 1 -- 172.21.15.150:0/193043914 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd48c14c630 con 0x7fd48c151320 2024-09-17T05:42:13.542 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:13.538+0000 7fd482ffd640 1 -- 172.21.15.150:0/193043914 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd484005280 con 0x7fd48c151320 2024-09-17T05:42:13.542 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:13.538+0000 7fd49085c640 1 -- 172.21.15.150:0/193043914 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd48c1533f0 con 0x7fd48c151320 2024-09-17T05:42:13.542 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:13.539+0000 7fd49085c640 1 -- 172.21.15.150:0/193043914 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd48c0b1470 con 0x7fd48c151320 2024-09-17T05:42:13.543 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:13.540+0000 7fd482ffd640 1 -- 172.21.15.150:0/193043914 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fd484005420 con 0x7fd48c151320 2024-09-17T05:42:13.543 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:13.540+0000 7fd482ffd640 1 --2- 172.21.15.150:0/193043914 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fd46c078b90 0x7fd46c07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:42:13.543 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:13.540+0000 7fd482ffd640 1 -- 172.21.15.150:0/193043914 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7fd4840beb30 con 0x7fd48c151320 2024-09-17T05:42:13.543 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:13.541+0000 7fd48a59c640 1 --2- 172.21.15.150:0/193043914 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fd46c078b90 0x7fd46c07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:42:13.543 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:13.541+0000 7fd48a59c640 1 --2- 172.21.15.150:0/193043914 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fd46c078b90 0x7fd46c07b0a0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fd47c00b450 tx=0x7fd47c00d040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:42:13.546 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:13.545+0000 7fd482ffd640 1 -- 172.21.15.150:0/193043914 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fd48c151730 con 0x7fd48c151320 2024-09-17T05:42:13.754 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:13.753+0000 7fd49085c640 1 -- 172.21.15.150:0/193043914 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7fd48c0b2750 con 0x7fd48c151320 2024-09-17T05:42:13.755 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:13.753+0000 7fd482ffd640 1 -- 172.21.15.150:0/193043914 <== mon.0 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v6) ==== 53+0+73 (secure 0 0 0) 0x7fd484041030 con 0x7fd48c151320 2024-09-17T05:42:13.755 INFO:teuthology.orchestra.run.smithi150.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-17T05:42:13.757 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:13.755+0000 7fd49085c640 1 -- 172.21.15.150:0/193043914 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fd46c078b90 msgr2=0x7fd46c07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:13.757 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:13.755+0000 7fd49085c640 1 --2- 172.21.15.150:0/193043914 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fd46c078b90 0x7fd46c07b0a0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fd47c00b450 tx=0x7fd47c00d040 comp rx=0 tx=0).stop 2024-09-17T05:42:13.757 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:13.755+0000 7fd49085c640 1 -- 172.21.15.150:0/193043914 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd48c151320 msgr2=0x7fd48c153ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:13.757 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:13.755+0000 7fd49085c640 1 --2- 172.21.15.150:0/193043914 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd48c151320 0x7fd48c153ed0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fd484009950 tx=0x7fd4840045e0 comp rx=0 tx=0).stop 2024-09-17T05:42:13.757 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:13.755+0000 7fd49085c640 1 -- 172.21.15.150:0/193043914 shutdown_connections 2024-09-17T05:42:13.758 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:13.755+0000 7fd49085c640 1 --2- 172.21.15.150:0/193043914 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fd46c078b90 0x7fd46c07b0a0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:13.758 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:13.755+0000 7fd49085c640 1 --2- 172.21.15.150:0/193043914 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd48c151320 0x7fd48c153ed0 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:13.758 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:13.755+0000 7fd49085c640 1 --2- 172.21.15.150:0/193043914 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd48c152920 0x7fd48c150de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:13.758 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:13.755+0000 7fd49085c640 1 --2- 172.21.15.150:0/193043914 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd48c0aebc0 0x7fd48c14e280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:13.758 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:13.756+0000 7fd49085c640 1 -- 172.21.15.150:0/193043914 >> 172.21.15.150:0/193043914 conn(0x7fd48c06d730 msgr2=0x7fd48c074ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:42:13.758 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:13.756+0000 7fd49085c640 1 -- 172.21.15.150:0/193043914 shutdown_connections 2024-09-17T05:42:13.758 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:13.756+0000 7fd49085c640 1 -- 172.21.15.150:0/193043914 wait complete. 2024-09-17T05:42:13.768 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-09-17T05:42:13.768 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-17T05:42:13.769 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi150.front.sepia.ceph.com 2024-09-17T05:42:13.769 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-17T05:42:13.769 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-17T05:42:13.769 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-09-17T05:42:13.769 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-17T05:42:13.769 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-17T05:42:13.769 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-17T05:42:13.769 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:42:13.769 DEBUG:teuthology.orchestra.run.smithi150:> ip addr 2024-09-17T05:42:13.785 INFO:teuthology.orchestra.run.smithi150.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-17T05:42:13.785 INFO:teuthology.orchestra.run.smithi150.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-17T05:42:13.785 INFO:teuthology.orchestra.run.smithi150.stdout: inet 127.0.0.1/8 scope host lo 2024-09-17T05:42:13.785 INFO:teuthology.orchestra.run.smithi150.stdout: valid_lft forever preferred_lft forever 2024-09-17T05:42:13.785 INFO:teuthology.orchestra.run.smithi150.stdout: inet6 ::1/128 scope host 2024-09-17T05:42:13.785 INFO:teuthology.orchestra.run.smithi150.stdout: valid_lft forever preferred_lft forever 2024-09-17T05:42:13.785 INFO:teuthology.orchestra.run.smithi150.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-17T05:42:13.785 INFO:teuthology.orchestra.run.smithi150.stdout: link/ether 0c:c4:7a:d9:da:bc brd ff:ff:ff:ff:ff:ff 2024-09-17T05:42:13.785 INFO:teuthology.orchestra.run.smithi150.stdout: altname enp7s0f0 2024-09-17T05:42:13.785 INFO:teuthology.orchestra.run.smithi150.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-17T05:42:13.786 INFO:teuthology.orchestra.run.smithi150.stdout: link/ether 0c:c4:7a:d9:da:bd brd ff:ff:ff:ff:ff:ff 2024-09-17T05:42:13.786 INFO:teuthology.orchestra.run.smithi150.stdout: altname enp7s0f1 2024-09-17T05:42:13.786 INFO:teuthology.orchestra.run.smithi150.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-17T05:42:13.786 INFO:teuthology.orchestra.run.smithi150.stdout: link/ether 0c:c4:7a:88:6e:34 brd ff:ff:ff:ff:ff:ff 2024-09-17T05:42:13.786 INFO:teuthology.orchestra.run.smithi150.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-17T05:42:13.786 INFO:teuthology.orchestra.run.smithi150.stdout: link/ether 0c:c4:7a:88:6e:35 brd ff:ff:ff:ff:ff:ff 2024-09-17T05:42:13.786 INFO:teuthology.orchestra.run.smithi150.stdout: inet 172.21.15.150/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-09-17T05:42:13.786 INFO:teuthology.orchestra.run.smithi150.stdout: valid_lft 42781sec preferred_lft 42781sec 2024-09-17T05:42:13.786 INFO:teuthology.orchestra.run.smithi150.stdout: inet6 fe80::ec4:7aff:fe88:6e35/64 scope link noprefixroute 2024-09-17T05:42:13.786 INFO:teuthology.orchestra.run.smithi150.stdout: valid_lft forever preferred_lft forever 2024-09-17T05:42:13.787 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-09-17T05:42:13.787 DEBUG:teuthology.orchestra.run.smithi150:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-17T05:42:13.787 DEBUG:teuthology.orchestra.run.smithi150:> set -e 2024-09-17T05:42:13.787 DEBUG:teuthology.orchestra.run.smithi150:> sudo ip link add name ceph-brx type bridge 2024-09-17T05:42:13.787 DEBUG:teuthology.orchestra.run.smithi150:> sudo ip addr flush dev ceph-brx 2024-09-17T05:42:13.787 DEBUG:teuthology.orchestra.run.smithi150:> sudo ip link set ceph-brx up 2024-09-17T05:42:13.787 DEBUG:teuthology.orchestra.run.smithi150:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-09-17T05:42:13.787 DEBUG:teuthology.orchestra.run.smithi150:> ') 2024-09-17T05:42:13.873 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:13 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-17T05:42:13.996 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:13 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T05:42:14.002 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:42:14.003 DEBUG:teuthology.orchestra.run.smithi150:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-17T05:42:14.027 INFO:teuthology.orchestra.run.smithi150.stdout:1 2024-09-17T05:42:14.029 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:42:14.029 DEBUG:teuthology.orchestra.run.smithi150:> route 2024-09-17T05:42:14.112 INFO:teuthology.orchestra.run.smithi150.stdout:Kernel IP routing table 2024-09-17T05:42:14.112 INFO:teuthology.orchestra.run.smithi150.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-17T05:42:14.112 INFO:teuthology.orchestra.run.smithi150.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-17T05:42:14.112 INFO:teuthology.orchestra.run.smithi150.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-17T05:42:14.112 INFO:teuthology.orchestra.run.smithi150.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-17T05:42:14.113 DEBUG:teuthology.orchestra.run.smithi150:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-17T05:42:14.113 DEBUG:teuthology.orchestra.run.smithi150:> set -e 2024-09-17T05:42:14.113 DEBUG:teuthology.orchestra.run.smithi150:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-17T05:42:14.113 DEBUG:teuthology.orchestra.run.smithi150:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-17T05:42:14.113 DEBUG:teuthology.orchestra.run.smithi150:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-17T05:42:14.113 DEBUG:teuthology.orchestra.run.smithi150:> ') 2024-09-17T05:42:14.201 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:14 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-17T05:42:14.415 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:14 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T05:42:14.421 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:42:14.421 DEBUG:teuthology.orchestra.run.smithi150:> ip netns list 2024-09-17T05:42:14.437 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:42:14.437 DEBUG:teuthology.orchestra.run.smithi150:> ip netns list-id 2024-09-17T05:42:14.493 DEBUG:teuthology.orchestra.run.smithi150:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-17T05:42:14.493 DEBUG:teuthology.orchestra.run.smithi150:> set -e 2024-09-17T05:42:14.494 DEBUG:teuthology.orchestra.run.smithi150:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-17T05:42:14.494 DEBUG:teuthology.orchestra.run.smithi150:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2024-09-17T05:42:14.494 DEBUG:teuthology.orchestra.run.smithi150:> ') 2024-09-17T05:42:14.583 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:14 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-17T05:42:14.608 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:14 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T05:42:14.616 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2024-09-17T05:42:14.618 DEBUG:teuthology.orchestra.run.smithi150:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-17T05:42:14.619 DEBUG:teuthology.orchestra.run.smithi150:> set -e 2024-09-17T05:42:14.620 DEBUG:teuthology.orchestra.run.smithi150:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2024-09-17T05:42:14.621 DEBUG:teuthology.orchestra.run.smithi150:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-09-17T05:42:14.621 DEBUG:teuthology.orchestra.run.smithi150:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2024-09-17T05:42:14.621 DEBUG:teuthology.orchestra.run.smithi150:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2024-09-17T05:42:14.621 DEBUG:teuthology.orchestra.run.smithi150:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2024-09-17T05:42:14.622 DEBUG:teuthology.orchestra.run.smithi150:> ') 2024-09-17T05:42:14.671 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:14 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-17T05:42:14.745 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:14 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T05:42:14.751 DEBUG:teuthology.orchestra.run.smithi150:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-17T05:42:14.751 DEBUG:teuthology.orchestra.run.smithi150:> set -e 2024-09-17T05:42:14.752 DEBUG:teuthology.orchestra.run.smithi150:> sudo ip link set brx.0 up 2024-09-17T05:42:14.752 DEBUG:teuthology.orchestra.run.smithi150:> sudo ip link set dev brx.0 master ceph-brx 2024-09-17T05:42:14.752 DEBUG:teuthology.orchestra.run.smithi150:> ') 2024-09-17T05:42:14.800 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:14 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-17T05:42:14.823 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:14 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T05:42:14.830 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-17T05:42:14.830 DEBUG:teuthology.orchestra.run.smithi150:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-17T05:42:14.845 INFO:teuthology.orchestra.run.smithi150.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-17T05:42:14.845 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-17T05:42:14.845 DEBUG:teuthology.orchestra.run.smithi150:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-17T05:42:14.900 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-09-17T05:42:14.900 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:42:14.900 DEBUG:teuthology.orchestra.run.smithi150:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-17T05:42:15.007 INFO:teuthology.orchestra.run.smithi150.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-17T05:42:15.008 INFO:teuthology.orchestra.run.smithi150.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-17T05:42:15.008 INFO:teuthology.orchestra.run.smithi150.stdout:invalid new device string format 2024-09-17T05:42:15.135 INFO:teuthology.orchestra.run.smithi150.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-17T05:42:15.135 INFO:teuthology.orchestra.run.smithi150.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-17T05:42:15.135 INFO:teuthology.orchestra.run.smithi150.stdout:invalid new device string format 2024-09-17T05:42:15.136 INFO:teuthology.orchestra.run.smithi150.stdout:mount.ceph: resolved to: "172.21.15.150:3300,172.21.15.176:3300,172.21.15.176:3301" 2024-09-17T05:42:15.136 INFO:teuthology.orchestra.run.smithi150.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-17T05:42:15.142 INFO:teuthology.orchestra.run.smithi150.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-17T05:42:15.142 INFO:teuthology.orchestra.run.smithi150.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-17T05:42:15.143 INFO:teuthology.orchestra.run.smithi150.stdout:invalid new device string format 2024-09-17T05:42:15.143 INFO:teuthology.orchestra.run.smithi150.stdout:mount.ceph: resolved to: "172.21.15.150:3300,172.21.15.176:3300,172.21.15.176:3301" 2024-09-17T05:42:15.143 INFO:teuthology.orchestra.run.smithi150.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-17T05:42:15.143 INFO:teuthology.orchestra.run.smithi150.stdout:mount.ceph: resolved to: "172.21.15.150:6789,172.21.15.176:6789,172.21.15.176:6790" 2024-09-17T05:42:15.143 INFO:teuthology.orchestra.run.smithi150.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.150:6789,172.21.15.176:6789,172.21.15.176:6790:/ 2024-09-17T05:42:15.143 INFO:teuthology.orchestra.run.smithi150.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=9f2e05e9-d629-47b3-b26b-1360655b7d20" will pass to kernel 2024-09-17T05:42:15.144 INFO:teuthology.orchestra.run.smithi150.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-09-17T05:42:15.144 INFO:teuthology.orchestra.run.smithi150.stdout: You just mounted a file system that supports labels which does not 2024-09-17T05:42:15.144 INFO:teuthology.orchestra.run.smithi150.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-09-17T05:42:15.144 INFO:teuthology.orchestra.run.smithi150.stdout: applications will generate AVC messages and not be allowed access to 2024-09-17T05:42:15.144 INFO:teuthology.orchestra.run.smithi150.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-09-17T05:42:15.146 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-17T05:42:15.146 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:42:15.146 DEBUG:teuthology.orchestra.run.smithi150:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-17T05:42:15.171 DEBUG:teuthology.orchestra.run.smithi150:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-17T05:42:15.261 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:15 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-17T05:42:15.268 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:15 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T05:42:15.274 INFO:teuthology.orchestra.run.smithi150.stdout:client4767 2024-09-17T05:42:15.274 DEBUG:teuthology.orchestra.run.smithi150:> set -ex 2024-09-17T05:42:15.274 DEBUG:teuthology.orchestra.run.smithi150:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T05:42:15.290 DEBUG:teuthology.orchestra.run.smithi150:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-17T05:42:15.381 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:15 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-17T05:42:15.387 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:15 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T05:42:15.393 INFO:teuthology.orchestra.run.smithi150.stdout:client4767 2024-09-17T05:42:15.393 DEBUG:teuthology.orchestra.run.smithi150:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-17T05:42:15.443 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:15 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-17T05:42:15.449 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:15 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T05:42:15.455 INFO:teuthology.orchestra.run.smithi150.stdout:client4767 2024-09-17T05:42:15.456 DEBUG:teuthology.orchestra.run.smithi150:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=300 -- bash -c 'sudo dd if=/sys/kernel/debug/ceph/9f2e05e9-d629-47b3-b26b-1360655b7d20.client4767/status') 2024-09-17T05:42:15.507 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:15 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-17T05:42:15.521 INFO:teuthology.orchestra.run.smithi150.stdout:instance: client.4767 (3)192.168.0.1:0/666763243 2024-09-17T05:42:15.521 INFO:teuthology.orchestra.run.smithi150.stdout:blocklisted: false 2024-09-17T05:42:15.521 INFO:teuthology.orchestra.run.smithi150.stderr:0+1 records in 2024-09-17T05:42:15.521 INFO:teuthology.orchestra.run.smithi150.stderr:0+1 records out 2024-09-17T05:42:15.521 INFO:teuthology.orchestra.run.smithi150.stderr:68 bytes copied, 2.2531e-05 s, 3.0 MB/s 2024-09-17T05:42:15.522 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:15 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T05:42:15.528 INFO:tasks.kclient:client.2 config is {'syntax': 'v1'} 2024-09-17T05:42:15.528 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-09-17T05:42:15.528 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.2 2024-09-17T05:42:15.528 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-17T05:42:15.642 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:15.640+0000 7f458c20e640 1 -- 172.21.15.150:0/3707169027 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f45840b6420 msgr2=0x7f45841665a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:15.642 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:15.640+0000 7f458c20e640 1 --2- 172.21.15.150:0/3707169027 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f45840b6420 0x7f45841665a0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f457c005fd0 tx=0x7f457c02ab40 comp rx=0 tx=0).stop 2024-09-17T05:42:15.642 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:15.640+0000 7f458c20e640 1 -- 172.21.15.150:0/3707169027 shutdown_connections 2024-09-17T05:42:15.642 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:15.640+0000 7f458c20e640 1 --2- 172.21.15.150:0/3707169027 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f45840b6420 0x7f45841665a0 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:15.642 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:15.640+0000 7f458c20e640 1 -- 172.21.15.150:0/3707169027 >> 172.21.15.150:0/3707169027 conn(0x7f45840b2fd0 msgr2=0x7f45840b33e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:42:15.642 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:15.640+0000 7f458c20e640 1 -- 172.21.15.150:0/3707169027 shutdown_connections 2024-09-17T05:42:15.642 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:15.640+0000 7f458c20e640 1 -- 172.21.15.150:0/3707169027 wait complete. 2024-09-17T05:42:15.643 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:15.642+0000 7f458c20e640 1 Processor -- start 2024-09-17T05:42:15.643 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:15.642+0000 7f458c20e640 1 -- start start 2024-09-17T05:42:15.646 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:15.643+0000 7f458c20e640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f45840b6420 0x7f458414f960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:42:15.646 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:15.643+0000 7f458c20e640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f45840cf7c0 0x7f45841501a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:42:15.646 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:15.643+0000 7f458c20e640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f458415ee30 0x7f45841506e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:42:15.647 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:15.643+0000 7f458c20e640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f4584166cf0 con 0x7f45840b6420 2024-09-17T05:42:15.647 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:15.643+0000 7f458c20e640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f45840b6b30 con 0x7f45840cf7c0 2024-09-17T05:42:15.647 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:15.643+0000 7f458c20e640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f4584166e70 con 0x7f458415ee30 2024-09-17T05:42:15.647 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:15.643+0000 7f4589faa640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f45840b6420 0x7f458414f960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:42:15.647 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:15.643+0000 7f4589faa640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f45840b6420 0x7f458414f960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:60378/0 (socket says 172.21.15.150:60378) 2024-09-17T05:42:15.647 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:15.643+0000 7f4589faa640 1 -- 172.21.15.150:0/1310982012 learned_addr learned my addr 172.21.15.150:0/1310982012 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:42:15.647 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:15.643+0000 7f45897a9640 1 --2- 172.21.15.150:0/1310982012 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f45840cf7c0 0x7f45841501a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:42:15.647 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:15.643+0000 7f458a7ab640 1 --2- 172.21.15.150:0/1310982012 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f458415ee30 0x7f45841506e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:42:15.647 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:15.643+0000 7f4589faa640 1 -- 172.21.15.150:0/1310982012 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f458415ee30 msgr2=0x7f45841506e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:15.647 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:15.643+0000 7f4589faa640 1 --2- 172.21.15.150:0/1310982012 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f458415ee30 0x7f45841506e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:15.648 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:15.644+0000 7f4589faa640 1 -- 172.21.15.150:0/1310982012 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f45840cf7c0 msgr2=0x7f45841501a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:15.648 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:15.644+0000 7f4589faa640 1 --2- 172.21.15.150:0/1310982012 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f45840cf7c0 0x7f45841501a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:15.648 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:15.644+0000 7f4589faa640 1 -- 172.21.15.150:0/1310982012 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4584159a50 con 0x7f45840b6420 2024-09-17T05:42:15.648 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:15.644+0000 7f4589faa640 1 --2- 172.21.15.150:0/1310982012 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f45840b6420 0x7f458414f960 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f4580001eb0 tx=0x7f458000c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:42:15.648 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:15.644+0000 7f457a7fc640 1 -- 172.21.15.150:0/1310982012 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4580017070 con 0x7f45840b6420 2024-09-17T05:42:15.648 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:15.644+0000 7f457a7fc640 1 -- 172.21.15.150:0/1310982012 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f45800053c0 con 0x7f45840b6420 2024-09-17T05:42:15.648 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:15.644+0000 7f458c20e640 1 -- 172.21.15.150:0/1310982012 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f45841518a0 con 0x7f45840b6420 2024-09-17T05:42:15.648 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:15.644+0000 7f457a7fc640 1 -- 172.21.15.150:0/1310982012 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4580003830 con 0x7f45840b6420 2024-09-17T05:42:15.648 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:15.644+0000 7f458c20e640 1 -- 172.21.15.150:0/1310982012 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4584151de0 con 0x7f45840b6420 2024-09-17T05:42:15.648 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:15.645+0000 7f458c20e640 1 -- 172.21.15.150:0/1310982012 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f45840b2840 con 0x7f45840b6420 2024-09-17T05:42:15.649 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:15.646+0000 7f457a7fc640 1 -- 172.21.15.150:0/1310982012 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f458001a070 con 0x7f45840b6420 2024-09-17T05:42:15.649 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:15.646+0000 7f457a7fc640 1 --2- 172.21.15.150:0/1310982012 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f4568078b90 0x7f456807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:42:15.649 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:15.646+0000 7f457a7fc640 1 -- 172.21.15.150:0/1310982012 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f458009a0c0 con 0x7f45840b6420 2024-09-17T05:42:15.649 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:15.646+0000 7f45897a9640 1 --2- 172.21.15.150:0/1310982012 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f4568078b90 0x7f456807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:42:15.649 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:15.647+0000 7f45897a9640 1 --2- 172.21.15.150:0/1310982012 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f4568078b90 0x7f456807b0a0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f4584155650 tx=0x7f4574009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:42:15.652 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:15.650+0000 7f457a7fc640 1 -- 172.21.15.150:0/1310982012 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f4580062590 con 0x7f45840b6420 2024-09-17T05:42:15.864 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:15.862+0000 7f458c20e640 1 -- 172.21.15.150:0/1310982012 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f4584070280 con 0x7f45840b6420 2024-09-17T05:42:15.864 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:15.863+0000 7f457a7fc640 1 -- 172.21.15.150:0/1310982012 <== mon.0 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v6) ==== 53+0+73 (secure 0 0 0) 0x7f4580061e90 con 0x7f45840b6420 2024-09-17T05:42:15.865 INFO:teuthology.orchestra.run.smithi150.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-17T05:42:15.867 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:15.865+0000 7f458c20e640 1 -- 172.21.15.150:0/1310982012 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f4568078b90 msgr2=0x7f456807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:15.867 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:15.865+0000 7f458c20e640 1 --2- 172.21.15.150:0/1310982012 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f4568078b90 0x7f456807b0a0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f4584155650 tx=0x7f4574009040 comp rx=0 tx=0).stop 2024-09-17T05:42:15.867 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:15.865+0000 7f458c20e640 1 -- 172.21.15.150:0/1310982012 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f45840b6420 msgr2=0x7f458414f960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:15.867 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:15.865+0000 7f458c20e640 1 --2- 172.21.15.150:0/1310982012 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f45840b6420 0x7f458414f960 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f4580001eb0 tx=0x7f458000c890 comp rx=0 tx=0).stop 2024-09-17T05:42:15.867 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:15.865+0000 7f458c20e640 1 -- 172.21.15.150:0/1310982012 shutdown_connections 2024-09-17T05:42:15.867 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:15.865+0000 7f458c20e640 1 --2- 172.21.15.150:0/1310982012 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f45840cf7c0 0x7f45841501a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:15.867 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:15.865+0000 7f458c20e640 1 --2- 172.21.15.150:0/1310982012 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f4568078b90 0x7f456807b0a0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:15.868 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:15.865+0000 7f458c20e640 1 --2- 172.21.15.150:0/1310982012 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f458415ee30 0x7f45841506e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:15.868 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:15.865+0000 7f458c20e640 1 --2- 172.21.15.150:0/1310982012 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f45840b6420 0x7f458414f960 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:15.868 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:15.865+0000 7f458c20e640 1 -- 172.21.15.150:0/1310982012 >> 172.21.15.150:0/1310982012 conn(0x7f45840b2fd0 msgr2=0x7f45840b0d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:42:15.868 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:15.865+0000 7f458c20e640 1 -- 172.21.15.150:0/1310982012 shutdown_connections 2024-09-17T05:42:15.868 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:15.865+0000 7f458c20e640 1 -- 172.21.15.150:0/1310982012 wait complete. 2024-09-17T05:42:15.878 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-09-17T05:42:15.878 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-17T05:42:15.878 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi150.front.sepia.ceph.com 2024-09-17T05:42:15.878 INFO:tasks.cephfs.mount:self.client.name = client.2 2024-09-17T05:42:15.878 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.2 2024-09-17T05:42:15.878 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-09-17T05:42:15.879 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-17T05:42:15.879 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-17T05:42:15.879 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.2' 2024-09-17T05:42:15.879 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:42:15.879 DEBUG:teuthology.orchestra.run.smithi150:> ip addr 2024-09-17T05:42:15.894 INFO:teuthology.orchestra.run.smithi150.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-17T05:42:15.895 INFO:teuthology.orchestra.run.smithi150.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-17T05:42:15.895 INFO:teuthology.orchestra.run.smithi150.stdout: inet 127.0.0.1/8 scope host lo 2024-09-17T05:42:15.895 INFO:teuthology.orchestra.run.smithi150.stdout: valid_lft forever preferred_lft forever 2024-09-17T05:42:15.895 INFO:teuthology.orchestra.run.smithi150.stdout: inet6 ::1/128 scope host 2024-09-17T05:42:15.895 INFO:teuthology.orchestra.run.smithi150.stdout: valid_lft forever preferred_lft forever 2024-09-17T05:42:15.895 INFO:teuthology.orchestra.run.smithi150.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-17T05:42:15.895 INFO:teuthology.orchestra.run.smithi150.stdout: link/ether 0c:c4:7a:d9:da:bc brd ff:ff:ff:ff:ff:ff 2024-09-17T05:42:15.895 INFO:teuthology.orchestra.run.smithi150.stdout: altname enp7s0f0 2024-09-17T05:42:15.895 INFO:teuthology.orchestra.run.smithi150.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-17T05:42:15.895 INFO:teuthology.orchestra.run.smithi150.stdout: link/ether 0c:c4:7a:d9:da:bd brd ff:ff:ff:ff:ff:ff 2024-09-17T05:42:15.895 INFO:teuthology.orchestra.run.smithi150.stdout: altname enp7s0f1 2024-09-17T05:42:15.895 INFO:teuthology.orchestra.run.smithi150.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-17T05:42:15.896 INFO:teuthology.orchestra.run.smithi150.stdout: link/ether 0c:c4:7a:88:6e:34 brd ff:ff:ff:ff:ff:ff 2024-09-17T05:42:15.896 INFO:teuthology.orchestra.run.smithi150.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-17T05:42:15.896 INFO:teuthology.orchestra.run.smithi150.stdout: link/ether 0c:c4:7a:88:6e:35 brd ff:ff:ff:ff:ff:ff 2024-09-17T05:42:15.896 INFO:teuthology.orchestra.run.smithi150.stdout: inet 172.21.15.150/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-09-17T05:42:15.896 INFO:teuthology.orchestra.run.smithi150.stdout: valid_lft 42779sec preferred_lft 42779sec 2024-09-17T05:42:15.896 INFO:teuthology.orchestra.run.smithi150.stdout: inet6 fe80::ec4:7aff:fe88:6e35/64 scope link noprefixroute 2024-09-17T05:42:15.896 INFO:teuthology.orchestra.run.smithi150.stdout: valid_lft forever preferred_lft forever 2024-09-17T05:42:15.896 INFO:teuthology.orchestra.run.smithi150.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-17T05:42:15.896 INFO:teuthology.orchestra.run.smithi150.stdout: link/ether 32:e1:8b:37:8c:b3 brd ff:ff:ff:ff:ff:ff 2024-09-17T05:42:15.896 INFO:teuthology.orchestra.run.smithi150.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-17T05:42:15.896 INFO:teuthology.orchestra.run.smithi150.stdout: valid_lft forever preferred_lft forever 2024-09-17T05:42:15.896 INFO:teuthology.orchestra.run.smithi150.stdout: inet6 fe80::70b6:c6ff:fe60:62a2/64 scope link tentative 2024-09-17T05:42:15.897 INFO:teuthology.orchestra.run.smithi150.stdout: valid_lft forever preferred_lft forever 2024-09-17T05:42:15.897 INFO:teuthology.orchestra.run.smithi150.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-17T05:42:15.897 INFO:teuthology.orchestra.run.smithi150.stdout: link/ether 32:e1:8b:37:8c:b3 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-17T05:42:15.897 INFO:teuthology.orchestra.run.smithi150.stdout: inet6 fe80::30e1:8bff:fe37:8cb3/64 scope link tentative 2024-09-17T05:42:15.897 INFO:teuthology.orchestra.run.smithi150.stdout: valid_lft forever preferred_lft forever 2024-09-17T05:42:15.897 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:42:15.897 DEBUG:teuthology.orchestra.run.smithi150:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-17T05:42:15.958 INFO:teuthology.orchestra.run.smithi150.stdout:1 2024-09-17T05:42:15.960 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:42:15.960 DEBUG:teuthology.orchestra.run.smithi150:> route 2024-09-17T05:42:16.017 INFO:teuthology.orchestra.run.smithi150.stdout:Kernel IP routing table 2024-09-17T05:42:16.017 INFO:teuthology.orchestra.run.smithi150.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-17T05:42:16.017 INFO:teuthology.orchestra.run.smithi150.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-17T05:42:16.017 INFO:teuthology.orchestra.run.smithi150.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-17T05:42:16.017 INFO:teuthology.orchestra.run.smithi150.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-17T05:42:16.017 DEBUG:teuthology.orchestra.run.smithi150:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-17T05:42:16.017 DEBUG:teuthology.orchestra.run.smithi150:> set -e 2024-09-17T05:42:16.017 DEBUG:teuthology.orchestra.run.smithi150:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-17T05:42:16.017 DEBUG:teuthology.orchestra.run.smithi150:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-17T05:42:16.017 DEBUG:teuthology.orchestra.run.smithi150:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-17T05:42:16.018 DEBUG:teuthology.orchestra.run.smithi150:> ') 2024-09-17T05:42:16.106 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:16 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-17T05:42:16.139 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:16 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T05:42:16.145 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:42:16.145 DEBUG:teuthology.orchestra.run.smithi150:> ip netns list 2024-09-17T05:42:16.160 INFO:teuthology.orchestra.run.smithi150.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-17T05:42:16.161 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:42:16.161 DEBUG:teuthology.orchestra.run.smithi150:> ip netns list-id 2024-09-17T05:42:16.215 INFO:teuthology.orchestra.run.smithi150.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.0) 2024-09-17T05:42:16.215 DEBUG:teuthology.orchestra.run.smithi150:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-17T05:42:16.216 DEBUG:teuthology.orchestra.run.smithi150:> set -e 2024-09-17T05:42:16.216 DEBUG:teuthology.orchestra.run.smithi150:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-17T05:42:16.216 DEBUG:teuthology.orchestra.run.smithi150:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.2 1 2024-09-17T05:42:16.216 DEBUG:teuthology.orchestra.run.smithi150:> ') 2024-09-17T05:42:16.304 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:16 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-17T05:42:16.326 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:16 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T05:42:16.332 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:42:16.333 DEBUG:teuthology.orchestra.run.smithi150:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2024-09-17T05:42:16.357 INFO:teuthology.orchestra.run.smithi150.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-17T05:42:16.357 INFO:teuthology.orchestra.run.smithi150.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-17T05:42:16.357 INFO:teuthology.orchestra.run.smithi150.stdout: inet 127.0.0.1/8 scope host lo 2024-09-17T05:42:16.357 INFO:teuthology.orchestra.run.smithi150.stdout: valid_lft forever preferred_lft forever 2024-09-17T05:42:16.357 INFO:teuthology.orchestra.run.smithi150.stdout: inet6 ::1/128 scope host 2024-09-17T05:42:16.357 INFO:teuthology.orchestra.run.smithi150.stdout: valid_lft forever preferred_lft forever 2024-09-17T05:42:16.357 INFO:teuthology.orchestra.run.smithi150.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-17T05:42:16.357 INFO:teuthology.orchestra.run.smithi150.stdout: link/ether 72:80:72:3c:1a:80 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-09-17T05:42:16.358 INFO:teuthology.orchestra.run.smithi150.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-09-17T05:42:16.358 INFO:teuthology.orchestra.run.smithi150.stdout: valid_lft forever preferred_lft forever 2024-09-17T05:42:16.358 INFO:teuthology.orchestra.run.smithi150.stdout: inet6 fe80::7080:72ff:fe3c:1a80/64 scope link tentative 2024-09-17T05:42:16.358 INFO:teuthology.orchestra.run.smithi150.stdout: valid_lft forever preferred_lft forever 2024-09-17T05:42:16.359 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:42:16.360 DEBUG:teuthology.orchestra.run.smithi150:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2024-09-17T05:42:16.423 INFO:teuthology.orchestra.run.smithi150.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-17T05:42:16.424 INFO:teuthology.orchestra.run.smithi150.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-17T05:42:16.424 INFO:teuthology.orchestra.run.smithi150.stdout: inet 127.0.0.1/8 scope host lo 2024-09-17T05:42:16.424 INFO:teuthology.orchestra.run.smithi150.stdout: valid_lft forever preferred_lft forever 2024-09-17T05:42:16.424 INFO:teuthology.orchestra.run.smithi150.stdout: inet6 ::1/128 scope host 2024-09-17T05:42:16.424 INFO:teuthology.orchestra.run.smithi150.stdout: valid_lft forever preferred_lft forever 2024-09-17T05:42:16.424 INFO:teuthology.orchestra.run.smithi150.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-17T05:42:16.424 INFO:teuthology.orchestra.run.smithi150.stdout: link/ether 72:80:72:3c:1a:80 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-09-17T05:42:16.424 INFO:teuthology.orchestra.run.smithi150.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-09-17T05:42:16.424 INFO:teuthology.orchestra.run.smithi150.stdout: valid_lft forever preferred_lft forever 2024-09-17T05:42:16.424 INFO:teuthology.orchestra.run.smithi150.stdout: inet6 fe80::7080:72ff:fe3c:1a80/64 scope link tentative 2024-09-17T05:42:16.424 INFO:teuthology.orchestra.run.smithi150.stdout: valid_lft forever preferred_lft forever 2024-09-17T05:42:16.426 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.2' with 192.168.0.2/16 2024-09-17T05:42:16.426 DEBUG:teuthology.orchestra.run.smithi150:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-17T05:42:16.426 DEBUG:teuthology.orchestra.run.smithi150:> set -e 2024-09-17T05:42:16.426 DEBUG:teuthology.orchestra.run.smithi150:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.2 type veth peer name brx.1 2024-09-17T05:42:16.426 DEBUG:teuthology.orchestra.run.smithi150:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2024-09-17T05:42:16.426 DEBUG:teuthology.orchestra.run.smithi150:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set veth0 up 2024-09-17T05:42:16.426 DEBUG:teuthology.orchestra.run.smithi150:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set lo up 2024-09-17T05:42:16.426 DEBUG:teuthology.orchestra.run.smithi150:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip route add default via 192.168.255.254 2024-09-17T05:42:16.426 DEBUG:teuthology.orchestra.run.smithi150:> ') 2024-09-17T05:42:16.514 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:16 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-17T05:42:16.572 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:16 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T05:42:16.578 DEBUG:teuthology.orchestra.run.smithi150:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-17T05:42:16.578 DEBUG:teuthology.orchestra.run.smithi150:> set -e 2024-09-17T05:42:16.578 DEBUG:teuthology.orchestra.run.smithi150:> sudo ip link set brx.1 up 2024-09-17T05:42:16.578 DEBUG:teuthology.orchestra.run.smithi150:> sudo ip link set dev brx.1 master ceph-brx 2024-09-17T05:42:16.578 DEBUG:teuthology.orchestra.run.smithi150:> ') 2024-09-17T05:42:16.626 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:16 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-17T05:42:16.648 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:16 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T05:42:16.654 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-17T05:42:16.654 DEBUG:teuthology.orchestra.run.smithi150:> mkdir -p -v /home/ubuntu/cephtest/mnt.2 2024-09-17T05:42:16.681 INFO:teuthology.orchestra.run.smithi150.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.2' 2024-09-17T05:42:16.682 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-17T05:42:16.682 DEBUG:teuthology.orchestra.run.smithi150:> chmod 0000 /home/ubuntu/cephtest/mnt.2 2024-09-17T05:42:16.737 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-09-17T05:42:16.737 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:42:16.738 DEBUG:teuthology.orchestra.run.smithi150:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.2 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=2,mds_namespace=cephfs 2024-09-17T05:42:16.832 INFO:teuthology.orchestra.run.smithi150.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=2,mds_namespace=cephfs 2024-09-17T05:42:16.832 INFO:teuthology.orchestra.run.smithi150.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=2,mds_namespace=cephfs". 2024-09-17T05:42:16.832 INFO:teuthology.orchestra.run.smithi150.stdout:invalid new device string format 2024-09-17T05:42:16.842 INFO:teuthology.orchestra.run.smithi150.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=2,mds_namespace=cephfs 2024-09-17T05:42:16.843 INFO:teuthology.orchestra.run.smithi150.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=2,mds_namespace=cephfs". 2024-09-17T05:42:16.843 INFO:teuthology.orchestra.run.smithi150.stdout:invalid new device string format 2024-09-17T05:42:16.843 INFO:teuthology.orchestra.run.smithi150.stdout:mount.ceph: resolved to: "172.21.15.150:3300,172.21.15.176:3300,172.21.15.176:3301" 2024-09-17T05:42:16.843 INFO:teuthology.orchestra.run.smithi150.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-17T05:42:16.850 INFO:teuthology.orchestra.run.smithi150.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=2,mds_namespace=cephfs 2024-09-17T05:42:16.851 INFO:teuthology.orchestra.run.smithi150.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=2,mds_namespace=cephfs". 2024-09-17T05:42:16.851 INFO:teuthology.orchestra.run.smithi150.stdout:invalid new device string format 2024-09-17T05:42:16.851 INFO:teuthology.orchestra.run.smithi150.stdout:mount.ceph: resolved to: "172.21.15.150:3300,172.21.15.176:3300,172.21.15.176:3301" 2024-09-17T05:42:16.851 INFO:teuthology.orchestra.run.smithi150.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-17T05:42:16.851 INFO:teuthology.orchestra.run.smithi150.stdout:mount.ceph: resolved to: "172.21.15.150:6789,172.21.15.176:6789,172.21.15.176:6790" 2024-09-17T05:42:16.851 INFO:teuthology.orchestra.run.smithi150.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.150:6789,172.21.15.176:6789,172.21.15.176:6790:/ 2024-09-17T05:42:16.851 INFO:teuthology.orchestra.run.smithi150.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=2,mds_namespace=cephfs,key=2,fsid=9f2e05e9-d629-47b3-b26b-1360655b7d20" will pass to kernel 2024-09-17T05:42:16.851 INFO:teuthology.orchestra.run.smithi150.stdout:mount: /home/ubuntu/cephtest/mnt.2 does not contain SELinux labels. 2024-09-17T05:42:16.851 INFO:teuthology.orchestra.run.smithi150.stdout: You just mounted a file system that supports labels which does not 2024-09-17T05:42:16.851 INFO:teuthology.orchestra.run.smithi150.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-09-17T05:42:16.851 INFO:teuthology.orchestra.run.smithi150.stdout: applications will generate AVC messages and not be allowed access to 2024-09-17T05:42:16.851 INFO:teuthology.orchestra.run.smithi150.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-09-17T05:42:16.852 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-17T05:42:16.852 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:42:16.853 DEBUG:teuthology.orchestra.run.smithi150:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.2 2024-09-17T05:42:16.877 DEBUG:teuthology.orchestra.run.smithi150:> (cd /home/ubuntu/cephtest/mnt.2 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-17T05:42:16.965 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:16 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-17T05:42:16.967 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:16 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T05:42:16.973 INFO:teuthology.orchestra.run.smithi150.stdout:client4696 2024-09-17T05:42:16.973 DEBUG:teuthology.orchestra.run.smithi150:> set -ex 2024-09-17T05:42:16.973 DEBUG:teuthology.orchestra.run.smithi150:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T05:42:16.989 DEBUG:teuthology.orchestra.run.smithi150:> (cd /home/ubuntu/cephtest/mnt.2 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-17T05:42:17.078 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:17 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-17T05:42:17.079 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:17 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T05:42:17.085 INFO:teuthology.orchestra.run.smithi150.stdout:client4696 2024-09-17T05:42:17.086 DEBUG:teuthology.orchestra.run.smithi150:> (cd /home/ubuntu/cephtest/mnt.2 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-17T05:42:17.134 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:17 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-17T05:42:17.136 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:17 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T05:42:17.141 INFO:teuthology.orchestra.run.smithi150.stdout:client4696 2024-09-17T05:42:17.142 DEBUG:teuthology.orchestra.run.smithi150:> (cd /home/ubuntu/cephtest/mnt.2 && exec stdin-killer --timeout=300 -- bash -c 'sudo dd if=/sys/kernel/debug/ceph/9f2e05e9-d629-47b3-b26b-1360655b7d20.client4696/status') 2024-09-17T05:42:17.190 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:17 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-17T05:42:17.200 INFO:teuthology.orchestra.run.smithi150.stdout:instance: client.4696 (3)172.21.15.150:0/3010084432 2024-09-17T05:42:17.200 INFO:teuthology.orchestra.run.smithi150.stdout:blocklisted: false 2024-09-17T05:42:17.200 INFO:teuthology.orchestra.run.smithi150.stderr:0+1 records in 2024-09-17T05:42:17.201 INFO:teuthology.orchestra.run.smithi150.stderr:0+1 records out 2024-09-17T05:42:17.201 INFO:teuthology.orchestra.run.smithi150.stderr:71 bytes copied, 2.2372e-05 s, 3.2 MB/s 2024-09-17T05:42:17.201 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:17 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T05:42:17.207 INFO:tasks.kclient:client.1 config is {'syntax': 'v1'} 2024-09-17T05:42:17.207 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-09-17T05:42:17.208 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-09-17T05:42:17.208 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-17T05:42:17.320 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:17.318+0000 7f013949b640 1 -- 172.21.15.150:0/2636676155 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f01341601c0 msgr2=0x7f01340cf390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:17.320 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:17.318+0000 7f013949b640 1 --2- 172.21.15.150:0/2636676155 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f01341601c0 0x7f01340cf390 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f012c005fd0 tx=0x7f012c02aa90 comp rx=0 tx=0).stop 2024-09-17T05:42:17.320 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:17.318+0000 7f013949b640 1 -- 172.21.15.150:0/2636676155 shutdown_connections 2024-09-17T05:42:17.320 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:17.318+0000 7f013949b640 1 --2- 172.21.15.150:0/2636676155 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f01341601c0 0x7f01340cf390 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:17.320 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:17.318+0000 7f013949b640 1 --2- 172.21.15.150:0/2636676155 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f01340b6910 0x7f013415fc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:17.320 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:17.318+0000 7f013949b640 1 -- 172.21.15.150:0/2636676155 >> 172.21.15.150:0/2636676155 conn(0x7f01340b2ff0 msgr2=0x7f01340b3400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:42:17.321 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:17.318+0000 7f013949b640 1 -- 172.21.15.150:0/2636676155 shutdown_connections 2024-09-17T05:42:17.321 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:17.318+0000 7f013949b640 1 -- 172.21.15.150:0/2636676155 wait complete. 2024-09-17T05:42:17.321 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:17.320+0000 7f013949b640 1 Processor -- start 2024-09-17T05:42:17.321 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:17.320+0000 7f013949b640 1 -- start start 2024-09-17T05:42:17.324 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:17.321+0000 7f013949b640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f01340b42f0 0x7f01341f4250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:42:17.324 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:17.321+0000 7f013949b640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f01340b6910 0x7f0134152f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:42:17.324 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:17.321+0000 7f013949b640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f01341601c0 0x7f01341f7660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:42:17.324 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:17.321+0000 7f013949b640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f01340cfd10 con 0x7f01340b42f0 2024-09-17T05:42:17.324 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:17.321+0000 7f013949b640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f01340cfb90 con 0x7f01341601c0 2024-09-17T05:42:17.324 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:17.321+0000 7f013949b640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f01340cfe90 con 0x7f01340b6910 2024-09-17T05:42:17.324 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:17.322+0000 7f0132ffd640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f01340b42f0 0x7f01341f4250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:42:17.324 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:17.322+0000 7f0132ffd640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f01340b42f0 0x7f01341f4250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:60404/0 (socket says 172.21.15.150:60404) 2024-09-17T05:42:17.325 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:17.322+0000 7f0132ffd640 1 -- 172.21.15.150:0/2911816899 learned_addr learned my addr 172.21.15.150:0/2911816899 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:42:17.325 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:17.322+0000 7f012a7fc640 1 --2- 172.21.15.150:0/2911816899 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f01340b6910 0x7f0134152f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:42:17.325 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:17.322+0000 7f01337fe640 1 --2- 172.21.15.150:0/2911816899 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f01341601c0 0x7f01341f7660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:42:17.325 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:17.322+0000 7f0132ffd640 1 -- 172.21.15.150:0/2911816899 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f01340b6910 msgr2=0x7f0134152f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:17.325 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:17.322+0000 7f0132ffd640 1 --2- 172.21.15.150:0/2911816899 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f01340b6910 0x7f0134152f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:17.325 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:17.322+0000 7f0132ffd640 1 -- 172.21.15.150:0/2911816899 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f01341601c0 msgr2=0x7f01341f7660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:17.325 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:17.322+0000 7f0132ffd640 1 --2- 172.21.15.150:0/2911816899 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f01341601c0 0x7f01341f7660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:17.325 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:17.322+0000 7f0132ffd640 1 -- 172.21.15.150:0/2911816899 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f01341f7ba0 con 0x7f01340b42f0 2024-09-17T05:42:17.325 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:17.322+0000 7f0132ffd640 1 --2- 172.21.15.150:0/2911816899 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f01340b42f0 0x7f01341f4250 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f012400c3a0 tx=0x7f012400c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:42:17.326 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:17.322+0000 7f012bfff640 1 -- 172.21.15.150:0/2911816899 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0124017070 con 0x7f01340b42f0 2024-09-17T05:42:17.326 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:17.322+0000 7f012bfff640 1 -- 172.21.15.150:0/2911816899 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f01240053c0 con 0x7f01340b42f0 2024-09-17T05:42:17.326 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:17.322+0000 7f013949b640 1 -- 172.21.15.150:0/2911816899 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0134157e40 con 0x7f01340b42f0 2024-09-17T05:42:17.326 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:17.322+0000 7f012bfff640 1 -- 172.21.15.150:0/2911816899 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0124003850 con 0x7f01340b42f0 2024-09-17T05:42:17.326 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:17.322+0000 7f013949b640 1 -- 172.21.15.150:0/2911816899 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f01341f3a50 con 0x7f01340b42f0 2024-09-17T05:42:17.327 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:17.323+0000 7f013949b640 1 -- 172.21.15.150:0/2911816899 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f013415fc80 con 0x7f01340b42f0 2024-09-17T05:42:17.327 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:17.324+0000 7f012bfff640 1 -- 172.21.15.150:0/2911816899 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f012401a070 con 0x7f01340b42f0 2024-09-17T05:42:17.327 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:17.325+0000 7f012bfff640 1 --2- 172.21.15.150:0/2911816899 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f0114078b90 0x7f011407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:42:17.327 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:17.325+0000 7f012bfff640 1 -- 172.21.15.150:0/2911816899 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f0124099fc0 con 0x7f01340b42f0 2024-09-17T05:42:17.327 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:17.325+0000 7f012a7fc640 1 --2- 172.21.15.150:0/2911816899 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f0114078b90 0x7f011407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:42:17.327 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:17.326+0000 7f012a7fc640 1 --2- 172.21.15.150:0/2911816899 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f0114078b90 0x7f011407b0a0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f01340b1560 tx=0x7f011c00b2e0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:42:17.331 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:17.329+0000 7f012bfff640 1 -- 172.21.15.150:0/2911816899 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f01341f7ba0 con 0x7f01340b42f0 2024-09-17T05:42:17.545 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:17.543+0000 7f013949b640 1 -- 172.21.15.150:0/2911816899 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f01341e64b0 con 0x7f01340b42f0 2024-09-17T05:42:17.545 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:17.543+0000 7f012bfff640 1 -- 172.21.15.150:0/2911816899 <== mon.0 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v6) ==== 53+0+73 (secure 0 0 0) 0x7f0124061e40 con 0x7f01340b42f0 2024-09-17T05:42:17.545 INFO:teuthology.orchestra.run.smithi150.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-17T05:42:17.548 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:17.546+0000 7f013949b640 1 -- 172.21.15.150:0/2911816899 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f0114078b90 msgr2=0x7f011407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:17.548 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:17.546+0000 7f013949b640 1 --2- 172.21.15.150:0/2911816899 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f0114078b90 0x7f011407b0a0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f01340b1560 tx=0x7f011c00b2e0 comp rx=0 tx=0).stop 2024-09-17T05:42:17.548 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:17.546+0000 7f013949b640 1 -- 172.21.15.150:0/2911816899 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f01340b42f0 msgr2=0x7f01341f4250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:17.548 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:17.546+0000 7f013949b640 1 --2- 172.21.15.150:0/2911816899 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f01340b42f0 0x7f01341f4250 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f012400c3a0 tx=0x7f012400c860 comp rx=0 tx=0).stop 2024-09-17T05:42:17.548 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:17.546+0000 7f013949b640 1 -- 172.21.15.150:0/2911816899 shutdown_connections 2024-09-17T05:42:17.548 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:17.546+0000 7f013949b640 1 --2- 172.21.15.150:0/2911816899 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f01341601c0 0x7f01341f7660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:17.548 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:17.546+0000 7f013949b640 1 --2- 172.21.15.150:0/2911816899 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f0114078b90 0x7f011407b0a0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:17.548 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:17.546+0000 7f013949b640 1 --2- 172.21.15.150:0/2911816899 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f01340b6910 0x7f0134152f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:17.548 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:17.546+0000 7f013949b640 1 --2- 172.21.15.150:0/2911816899 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f01340b42f0 0x7f01341f4250 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:17.549 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:17.546+0000 7f013949b640 1 -- 172.21.15.150:0/2911816899 >> 172.21.15.150:0/2911816899 conn(0x7f01340b2ff0 msgr2=0x7f0134154d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:42:17.549 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:17.546+0000 7f013949b640 1 -- 172.21.15.150:0/2911816899 shutdown_connections 2024-09-17T05:42:17.549 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:17.546+0000 7f013949b640 1 -- 172.21.15.150:0/2911816899 wait complete. 2024-09-17T05:42:17.558 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-09-17T05:42:17.559 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-17T05:42:17.559 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi176.front.sepia.ceph.com 2024-09-17T05:42:17.559 INFO:tasks.cephfs.mount:self.client.name = client.1 2024-09-17T05:42:17.559 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-09-17T05:42:17.559 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-09-17T05:42:17.559 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-17T05:42:17.559 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-17T05:42:17.559 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.1' 2024-09-17T05:42:17.559 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:42:17.559 DEBUG:teuthology.orchestra.run.smithi176:> ip addr 2024-09-17T05:42:17.579 INFO:teuthology.orchestra.run.smithi176.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-17T05:42:17.579 INFO:teuthology.orchestra.run.smithi176.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-17T05:42:17.579 INFO:teuthology.orchestra.run.smithi176.stdout: inet 127.0.0.1/8 scope host lo 2024-09-17T05:42:17.579 INFO:teuthology.orchestra.run.smithi176.stdout: valid_lft forever preferred_lft forever 2024-09-17T05:42:17.579 INFO:teuthology.orchestra.run.smithi176.stdout: inet6 ::1/128 scope host 2024-09-17T05:42:17.579 INFO:teuthology.orchestra.run.smithi176.stdout: valid_lft forever preferred_lft forever 2024-09-17T05:42:17.579 INFO:teuthology.orchestra.run.smithi176.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-17T05:42:17.579 INFO:teuthology.orchestra.run.smithi176.stdout: link/ether 0c:c4:7a:d9:36:80 brd ff:ff:ff:ff:ff:ff 2024-09-17T05:42:17.579 INFO:teuthology.orchestra.run.smithi176.stdout: altname enp7s0f0 2024-09-17T05:42:17.580 INFO:teuthology.orchestra.run.smithi176.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-17T05:42:17.580 INFO:teuthology.orchestra.run.smithi176.stdout: link/ether 0c:c4:7a:d9:36:81 brd ff:ff:ff:ff:ff:ff 2024-09-17T05:42:17.580 INFO:teuthology.orchestra.run.smithi176.stdout: altname enp7s0f1 2024-09-17T05:42:17.580 INFO:teuthology.orchestra.run.smithi176.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-17T05:42:17.580 INFO:teuthology.orchestra.run.smithi176.stdout: link/ether 0c:c4:7a:88:6f:60 brd ff:ff:ff:ff:ff:ff 2024-09-17T05:42:17.580 INFO:teuthology.orchestra.run.smithi176.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-17T05:42:17.580 INFO:teuthology.orchestra.run.smithi176.stdout: link/ether 0c:c4:7a:88:6f:61 brd ff:ff:ff:ff:ff:ff 2024-09-17T05:42:17.580 INFO:teuthology.orchestra.run.smithi176.stdout: inet 172.21.15.176/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-09-17T05:42:17.580 INFO:teuthology.orchestra.run.smithi176.stdout: valid_lft 42766sec preferred_lft 42766sec 2024-09-17T05:42:17.580 INFO:teuthology.orchestra.run.smithi176.stdout: inet6 fe80::ec4:7aff:fe88:6f61/64 scope link noprefixroute 2024-09-17T05:42:17.581 INFO:teuthology.orchestra.run.smithi176.stdout: valid_lft forever preferred_lft forever 2024-09-17T05:42:17.581 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-09-17T05:42:17.581 DEBUG:teuthology.orchestra.run.smithi176:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-17T05:42:17.581 DEBUG:teuthology.orchestra.run.smithi176:> set -e 2024-09-17T05:42:17.581 DEBUG:teuthology.orchestra.run.smithi176:> sudo ip link add name ceph-brx type bridge 2024-09-17T05:42:17.581 DEBUG:teuthology.orchestra.run.smithi176:> sudo ip addr flush dev ceph-brx 2024-09-17T05:42:17.581 DEBUG:teuthology.orchestra.run.smithi176:> sudo ip link set ceph-brx up 2024-09-17T05:42:17.581 DEBUG:teuthology.orchestra.run.smithi176:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-09-17T05:42:17.581 DEBUG:teuthology.orchestra.run.smithi176:> ') 2024-09-17T05:42:17.674 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T05:42:17 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-17T05:42:18.040 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T05:42:18 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T05:42:18.047 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:42:18.047 DEBUG:teuthology.orchestra.run.smithi176:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-17T05:42:18.072 INFO:teuthology.orchestra.run.smithi176.stdout:1 2024-09-17T05:42:18.073 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:42:18.074 DEBUG:teuthology.orchestra.run.smithi176:> route 2024-09-17T05:42:18.157 INFO:teuthology.orchestra.run.smithi176.stdout:Kernel IP routing table 2024-09-17T05:42:18.157 INFO:teuthology.orchestra.run.smithi176.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-17T05:42:18.157 INFO:teuthology.orchestra.run.smithi176.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-17T05:42:18.157 INFO:teuthology.orchestra.run.smithi176.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-17T05:42:18.157 INFO:teuthology.orchestra.run.smithi176.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-17T05:42:18.158 DEBUG:teuthology.orchestra.run.smithi176:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-17T05:42:18.158 DEBUG:teuthology.orchestra.run.smithi176:> set -e 2024-09-17T05:42:18.158 DEBUG:teuthology.orchestra.run.smithi176:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-17T05:42:18.158 DEBUG:teuthology.orchestra.run.smithi176:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-17T05:42:18.158 DEBUG:teuthology.orchestra.run.smithi176:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-17T05:42:18.158 DEBUG:teuthology.orchestra.run.smithi176:> ') 2024-09-17T05:42:18.245 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T05:42:18 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-17T05:42:18.427 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T05:42:18 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T05:42:18.433 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:42:18.433 DEBUG:teuthology.orchestra.run.smithi176:> ip netns list 2024-09-17T05:42:18.449 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:42:18.449 DEBUG:teuthology.orchestra.run.smithi176:> ip netns list-id 2024-09-17T05:42:18.504 DEBUG:teuthology.orchestra.run.smithi176:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-17T05:42:18.504 DEBUG:teuthology.orchestra.run.smithi176:> set -e 2024-09-17T05:42:18.504 DEBUG:teuthology.orchestra.run.smithi176:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-17T05:42:18.504 DEBUG:teuthology.orchestra.run.smithi176:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.1 0 2024-09-17T05:42:18.504 DEBUG:teuthology.orchestra.run.smithi176:> ') 2024-09-17T05:42:18.592 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T05:42:18 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-17T05:42:18.615 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T05:42:18 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T05:42:18.622 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.1' with 192.168.0.1/16 2024-09-17T05:42:18.622 DEBUG:teuthology.orchestra.run.smithi176:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-17T05:42:18.622 DEBUG:teuthology.orchestra.run.smithi176:> set -e 2024-09-17T05:42:18.622 DEBUG:teuthology.orchestra.run.smithi176:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.1 type veth peer name brx.0 2024-09-17T05:42:18.622 DEBUG:teuthology.orchestra.run.smithi176:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-09-17T05:42:18.622 DEBUG:teuthology.orchestra.run.smithi176:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set veth0 up 2024-09-17T05:42:18.622 DEBUG:teuthology.orchestra.run.smithi176:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set lo up 2024-09-17T05:42:18.622 DEBUG:teuthology.orchestra.run.smithi176:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip route add default via 192.168.255.254 2024-09-17T05:42:18.622 DEBUG:teuthology.orchestra.run.smithi176:> ') 2024-09-17T05:42:18.670 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T05:42:18 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-17T05:42:18.786 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T05:42:18 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T05:42:18.792 DEBUG:teuthology.orchestra.run.smithi176:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-17T05:42:18.792 DEBUG:teuthology.orchestra.run.smithi176:> set -e 2024-09-17T05:42:18.792 DEBUG:teuthology.orchestra.run.smithi176:> sudo ip link set brx.0 up 2024-09-17T05:42:18.792 DEBUG:teuthology.orchestra.run.smithi176:> sudo ip link set dev brx.0 master ceph-brx 2024-09-17T05:42:18.792 DEBUG:teuthology.orchestra.run.smithi176:> ') 2024-09-17T05:42:18.840 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T05:42:18 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-17T05:42:18.862 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T05:42:18 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T05:42:18.869 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-17T05:42:18.869 DEBUG:teuthology.orchestra.run.smithi176:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2024-09-17T05:42:18.884 INFO:teuthology.orchestra.run.smithi176.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2024-09-17T05:42:18.884 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-17T05:42:18.884 DEBUG:teuthology.orchestra.run.smithi176:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2024-09-17T05:42:18.945 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-09-17T05:42:18.993 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:42:18.993 DEBUG:teuthology.orchestra.run.smithi176:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-09-17T05:42:19.058 INFO:teuthology.orchestra.run.smithi176.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-09-17T05:42:19.058 INFO:teuthology.orchestra.run.smithi176.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2024-09-17T05:42:19.058 INFO:teuthology.orchestra.run.smithi176.stdout:invalid new device string format 2024-09-17T05:42:19.184 INFO:teuthology.orchestra.run.smithi176.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-09-17T05:42:19.184 INFO:teuthology.orchestra.run.smithi176.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2024-09-17T05:42:19.184 INFO:teuthology.orchestra.run.smithi176.stdout:invalid new device string format 2024-09-17T05:42:19.184 INFO:teuthology.orchestra.run.smithi176.stdout:mount.ceph: resolved to: "172.21.15.150:3300,172.21.15.176:3300,172.21.15.176:3301" 2024-09-17T05:42:19.185 INFO:teuthology.orchestra.run.smithi176.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-17T05:42:19.189 INFO:teuthology.orchestra.run.smithi176.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-09-17T05:42:19.189 INFO:teuthology.orchestra.run.smithi176.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2024-09-17T05:42:19.189 INFO:teuthology.orchestra.run.smithi176.stdout:invalid new device string format 2024-09-17T05:42:19.189 INFO:teuthology.orchestra.run.smithi176.stdout:mount.ceph: resolved to: "172.21.15.150:3300,172.21.15.176:3300,172.21.15.176:3301" 2024-09-17T05:42:19.189 INFO:teuthology.orchestra.run.smithi176.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-17T05:42:19.189 INFO:teuthology.orchestra.run.smithi176.stdout:mount.ceph: resolved to: "172.21.15.150:6789,172.21.15.176:6789,172.21.15.176:6790" 2024-09-17T05:42:19.190 INFO:teuthology.orchestra.run.smithi176.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.150:6789,172.21.15.176:6789,172.21.15.176:6790:/ 2024-09-17T05:42:19.190 INFO:teuthology.orchestra.run.smithi176.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs,key=1,fsid=9f2e05e9-d629-47b3-b26b-1360655b7d20" will pass to kernel 2024-09-17T05:42:19.190 INFO:teuthology.orchestra.run.smithi176.stdout:mount: /home/ubuntu/cephtest/mnt.1 does not contain SELinux labels. 2024-09-17T05:42:19.190 INFO:teuthology.orchestra.run.smithi176.stdout: You just mounted a file system that supports labels which does not 2024-09-17T05:42:19.190 INFO:teuthology.orchestra.run.smithi176.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-09-17T05:42:19.190 INFO:teuthology.orchestra.run.smithi176.stdout: applications will generate AVC messages and not be allowed access to 2024-09-17T05:42:19.190 INFO:teuthology.orchestra.run.smithi176.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-09-17T05:42:19.192 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-17T05:42:19.192 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:42:19.192 DEBUG:teuthology.orchestra.run.smithi176:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2024-09-17T05:42:19.220 DEBUG:teuthology.orchestra.run.smithi176:> (cd /home/ubuntu/cephtest/mnt.1 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-17T05:42:19.309 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T05:42:19 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-17T05:42:19.310 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T05:42:19 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T05:42:19.316 INFO:teuthology.orchestra.run.smithi176.stdout:client4702 2024-09-17T05:42:19.317 DEBUG:teuthology.orchestra.run.smithi176:> set -ex 2024-09-17T05:42:19.317 DEBUG:teuthology.orchestra.run.smithi176:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T05:42:19.333 DEBUG:teuthology.orchestra.run.smithi176:> (cd /home/ubuntu/cephtest/mnt.1 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-17T05:42:19.422 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T05:42:19 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-17T05:42:19.423 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T05:42:19 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T05:42:19.429 INFO:teuthology.orchestra.run.smithi176.stdout:client4702 2024-09-17T05:42:19.430 DEBUG:teuthology.orchestra.run.smithi176:> (cd /home/ubuntu/cephtest/mnt.1 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-17T05:42:19.479 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T05:42:19 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-17T05:42:19.481 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T05:42:19 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T05:42:19.486 INFO:teuthology.orchestra.run.smithi176.stdout:client4702 2024-09-17T05:42:19.487 DEBUG:teuthology.orchestra.run.smithi176:> (cd /home/ubuntu/cephtest/mnt.1 && exec stdin-killer --timeout=300 -- bash -c 'sudo dd if=/sys/kernel/debug/ceph/9f2e05e9-d629-47b3-b26b-1360655b7d20.client4702/status') 2024-09-17T05:42:19.535 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T05:42:19 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-17T05:42:19.545 INFO:teuthology.orchestra.run.smithi176.stdout:instance: client.4702 (3)192.168.0.1:0/42990270 2024-09-17T05:42:19.545 INFO:teuthology.orchestra.run.smithi176.stdout:blocklisted: false 2024-09-17T05:42:19.546 INFO:teuthology.orchestra.run.smithi176.stderr:0+1 records in 2024-09-17T05:42:19.546 INFO:teuthology.orchestra.run.smithi176.stderr:0+1 records out 2024-09-17T05:42:19.546 INFO:teuthology.orchestra.run.smithi176.stderr:67 bytes copied, 2.2429e-05 s, 3.0 MB/s 2024-09-17T05:42:19.546 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T05:42:19 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T05:42:19.553 INFO:tasks.kclient:client.3 config is {'syntax': 'v1'} 2024-09-17T05:42:19.553 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-09-17T05:42:19.553 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.3 2024-09-17T05:42:19.553 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-17T05:42:19.680 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:19.678+0000 7fbf7db62640 1 -- 172.21.15.150:0/4271285738 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fbf780cd440 msgr2=0x7fbf780cd850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:19.680 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:19.678+0000 7fbf7db62640 1 --2- 172.21.15.150:0/4271285738 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fbf780cd440 0x7fbf780cd850 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fbf6c009830 tx=0x7fbf6c02a510 comp rx=0 tx=0).stop 2024-09-17T05:42:19.681 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:19.678+0000 7fbf7db62640 1 -- 172.21.15.150:0/4271285738 shutdown_connections 2024-09-17T05:42:19.681 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:19.678+0000 7fbf7db62640 1 --2- 172.21.15.150:0/4271285738 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fbf780cd440 0x7fbf780cd850 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:19.681 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:19.678+0000 7fbf7db62640 1 --2- 172.21.15.150:0/4271285738 >> v2:172.21.15.176:3300/0 conn(0x7fbf7809ba60 0x7fbf780b7330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:19.681 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:19.678+0000 7fbf7db62640 1 -- 172.21.15.150:0/4271285738 >> 172.21.15.150:0/4271285738 conn(0x7fbf780cee90 msgr2=0x7fbf780cf2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:42:19.681 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:19.678+0000 7fbf7db62640 1 -- 172.21.15.150:0/4271285738 shutdown_connections 2024-09-17T05:42:19.681 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:19.678+0000 7fbf7db62640 1 -- 172.21.15.150:0/4271285738 wait complete. 2024-09-17T05:42:19.682 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:19.680+0000 7fbf7db62640 1 Processor -- start 2024-09-17T05:42:19.682 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:19.680+0000 7fbf7db62640 1 -- start start 2024-09-17T05:42:19.684 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:19.682+0000 7fbf7db62640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbf7809ba60 0x7fbf7814b680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:42:19.685 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:19.682+0000 7fbf7db62640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fbf780cd440 0x7fbf7814de60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:42:19.685 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:19.682+0000 7fbf7db62640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fbf780cffe0 0x7fbf7815f730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:42:19.685 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:19.682+0000 7fbf7db62640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7fbf780d0e90 con 0x7fbf7809ba60 2024-09-17T05:42:19.685 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:19.682+0000 7fbf7db62640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fbf780d0d10 con 0x7fbf780cffe0 2024-09-17T05:42:19.685 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:19.682+0000 7fbf7db62640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fbf781670e0 con 0x7fbf780cd440 2024-09-17T05:42:19.685 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:19.682+0000 7fbf777fe640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbf7809ba60 0x7fbf7814b680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:42:19.685 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:19.682+0000 7fbf777fe640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbf7809ba60 0x7fbf7814b680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:60416/0 (socket says 172.21.15.150:60416) 2024-09-17T05:42:19.685 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:19.682+0000 7fbf777fe640 1 -- 172.21.15.150:0/4111272510 learned_addr learned my addr 172.21.15.150:0/4111272510 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:42:19.685 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:19.682+0000 7fbf76ffd640 1 --2- 172.21.15.150:0/4111272510 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fbf780cd440 0x7fbf7814de60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:42:19.685 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:19.682+0000 7fbf77fff640 1 --2- 172.21.15.150:0/4111272510 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fbf780cffe0 0x7fbf7815f730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:42:19.686 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:19.682+0000 7fbf777fe640 1 -- 172.21.15.150:0/4111272510 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fbf780cd440 msgr2=0x7fbf7814de60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:19.686 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:19.682+0000 7fbf777fe640 1 --2- 172.21.15.150:0/4111272510 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fbf780cd440 0x7fbf7814de60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:19.686 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:19.682+0000 7fbf777fe640 1 -- 172.21.15.150:0/4111272510 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fbf780cffe0 msgr2=0x7fbf7815f730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:19.686 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:19.682+0000 7fbf777fe640 1 --2- 172.21.15.150:0/4111272510 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fbf780cffe0 0x7fbf7815f730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:19.686 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:19.682+0000 7fbf777fe640 1 -- 172.21.15.150:0/4111272510 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbf7814e920 con 0x7fbf7809ba60 2024-09-17T05:42:19.686 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:19.682+0000 7fbf777fe640 1 --2- 172.21.15.150:0/4111272510 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbf7809ba60 0x7fbf7814b680 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fbf6800ed00 tx=0x7fbf6800c6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:42:19.686 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:19.682+0000 7fbf5ffff640 1 -- 172.21.15.150:0/4111272510 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf68004d40 con 0x7fbf7809ba60 2024-09-17T05:42:19.686 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:19.682+0000 7fbf5ffff640 1 -- 172.21.15.150:0/4111272510 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fbf68003970 con 0x7fbf7809ba60 2024-09-17T05:42:19.686 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:19.683+0000 7fbf7db62640 1 -- 172.21.15.150:0/4111272510 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbf7814ec00 con 0x7fbf7809ba60 2024-09-17T05:42:19.686 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:19.683+0000 7fbf5ffff640 1 -- 172.21.15.150:0/4111272510 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf68003da0 con 0x7fbf7809ba60 2024-09-17T05:42:19.686 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:19.683+0000 7fbf7db62640 1 -- 172.21.15.150:0/4111272510 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbf7814c2c0 con 0x7fbf7809ba60 2024-09-17T05:42:19.687 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:19.684+0000 7fbf7db62640 1 -- 172.21.15.150:0/4111272510 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbf7814bdd0 con 0x7fbf7809ba60 2024-09-17T05:42:19.687 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:19.684+0000 7fbf5ffff640 1 -- 172.21.15.150:0/4111272510 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fbf68004020 con 0x7fbf7809ba60 2024-09-17T05:42:19.688 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:19.685+0000 7fbf5ffff640 1 --2- 172.21.15.150:0/4111272510 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fbf64078b90 0x7fbf6407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:42:19.688 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:19.685+0000 7fbf5ffff640 1 -- 172.21.15.150:0/4111272510 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7fbf6809b930 con 0x7fbf7809ba60 2024-09-17T05:42:19.688 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:19.685+0000 7fbf76ffd640 1 --2- 172.21.15.150:0/4111272510 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fbf64078b90 0x7fbf6407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:42:19.688 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:19.685+0000 7fbf76ffd640 1 --2- 172.21.15.150:0/4111272510 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fbf64078b90 0x7fbf6407b0a0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fbf6c034000 tx=0x7fbf6c004730 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:42:19.690 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:19.689+0000 7fbf5ffff640 1 -- 172.21.15.150:0/4111272510 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fbf68063720 con 0x7fbf7809ba60 2024-09-17T05:42:19.900 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:19.899+0000 7fbf7db62640 1 -- 172.21.15.150:0/4111272510 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7fbf780b7330 con 0x7fbf7809ba60 2024-09-17T05:42:19.900 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:19.899+0000 7fbf5ffff640 1 -- 172.21.15.150:0/4111272510 <== mon.0 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v6) ==== 53+0+73 (secure 0 0 0) 0x7fbf68068150 con 0x7fbf7809ba60 2024-09-17T05:42:19.901 INFO:teuthology.orchestra.run.smithi150.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-17T05:42:19.903 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:19.901+0000 7fbf7db62640 1 -- 172.21.15.150:0/4111272510 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fbf64078b90 msgr2=0x7fbf6407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:19.903 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:19.901+0000 7fbf7db62640 1 --2- 172.21.15.150:0/4111272510 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fbf64078b90 0x7fbf6407b0a0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fbf6c034000 tx=0x7fbf6c004730 comp rx=0 tx=0).stop 2024-09-17T05:42:19.903 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:19.901+0000 7fbf7db62640 1 -- 172.21.15.150:0/4111272510 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbf7809ba60 msgr2=0x7fbf7814b680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:19.903 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:19.901+0000 7fbf7db62640 1 --2- 172.21.15.150:0/4111272510 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbf7809ba60 0x7fbf7814b680 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fbf6800ed00 tx=0x7fbf6800c6a0 comp rx=0 tx=0).stop 2024-09-17T05:42:19.903 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:19.901+0000 7fbf7db62640 1 -- 172.21.15.150:0/4111272510 shutdown_connections 2024-09-17T05:42:19.904 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:19.901+0000 7fbf7db62640 1 --2- 172.21.15.150:0/4111272510 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fbf780cffe0 0x7fbf7815f730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:19.904 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:19.901+0000 7fbf7db62640 1 --2- 172.21.15.150:0/4111272510 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fbf64078b90 0x7fbf6407b0a0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:19.904 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:19.901+0000 7fbf7db62640 1 --2- 172.21.15.150:0/4111272510 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fbf780cd440 0x7fbf7814de60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:19.904 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:19.901+0000 7fbf7db62640 1 --2- 172.21.15.150:0/4111272510 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbf7809ba60 0x7fbf7814b680 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:19.904 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:19.901+0000 7fbf7db62640 1 -- 172.21.15.150:0/4111272510 >> 172.21.15.150:0/4111272510 conn(0x7fbf780cee90 msgr2=0x7fbf780d03f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:42:19.904 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:19.901+0000 7fbf7db62640 1 -- 172.21.15.150:0/4111272510 shutdown_connections 2024-09-17T05:42:19.904 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:19.901+0000 7fbf7db62640 1 -- 172.21.15.150:0/4111272510 wait complete. 2024-09-17T05:42:19.914 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-09-17T05:42:19.914 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-17T05:42:19.914 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi176.front.sepia.ceph.com 2024-09-17T05:42:19.914 INFO:tasks.cephfs.mount:self.client.name = client.3 2024-09-17T05:42:19.914 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.3 2024-09-17T05:42:19.914 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-09-17T05:42:19.914 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-17T05:42:19.914 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-17T05:42:19.914 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.3' 2024-09-17T05:42:19.915 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:42:19.915 DEBUG:teuthology.orchestra.run.smithi176:> ip addr 2024-09-17T05:42:19.931 INFO:teuthology.orchestra.run.smithi176.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-17T05:42:19.931 INFO:teuthology.orchestra.run.smithi176.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-17T05:42:19.932 INFO:teuthology.orchestra.run.smithi176.stdout: inet 127.0.0.1/8 scope host lo 2024-09-17T05:42:19.932 INFO:teuthology.orchestra.run.smithi176.stdout: valid_lft forever preferred_lft forever 2024-09-17T05:42:19.932 INFO:teuthology.orchestra.run.smithi176.stdout: inet6 ::1/128 scope host 2024-09-17T05:42:19.932 INFO:teuthology.orchestra.run.smithi176.stdout: valid_lft forever preferred_lft forever 2024-09-17T05:42:19.932 INFO:teuthology.orchestra.run.smithi176.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-17T05:42:19.932 INFO:teuthology.orchestra.run.smithi176.stdout: link/ether 0c:c4:7a:d9:36:80 brd ff:ff:ff:ff:ff:ff 2024-09-17T05:42:19.932 INFO:teuthology.orchestra.run.smithi176.stdout: altname enp7s0f0 2024-09-17T05:42:19.932 INFO:teuthology.orchestra.run.smithi176.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-17T05:42:19.932 INFO:teuthology.orchestra.run.smithi176.stdout: link/ether 0c:c4:7a:d9:36:81 brd ff:ff:ff:ff:ff:ff 2024-09-17T05:42:19.932 INFO:teuthology.orchestra.run.smithi176.stdout: altname enp7s0f1 2024-09-17T05:42:19.932 INFO:teuthology.orchestra.run.smithi176.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-17T05:42:19.933 INFO:teuthology.orchestra.run.smithi176.stdout: link/ether 0c:c4:7a:88:6f:60 brd ff:ff:ff:ff:ff:ff 2024-09-17T05:42:19.933 INFO:teuthology.orchestra.run.smithi176.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-17T05:42:19.933 INFO:teuthology.orchestra.run.smithi176.stdout: link/ether 0c:c4:7a:88:6f:61 brd ff:ff:ff:ff:ff:ff 2024-09-17T05:42:19.933 INFO:teuthology.orchestra.run.smithi176.stdout: inet 172.21.15.176/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-09-17T05:42:19.933 INFO:teuthology.orchestra.run.smithi176.stdout: valid_lft 42764sec preferred_lft 42764sec 2024-09-17T05:42:19.933 INFO:teuthology.orchestra.run.smithi176.stdout: inet6 fe80::ec4:7aff:fe88:6f61/64 scope link noprefixroute 2024-09-17T05:42:19.933 INFO:teuthology.orchestra.run.smithi176.stdout: valid_lft forever preferred_lft forever 2024-09-17T05:42:19.933 INFO:teuthology.orchestra.run.smithi176.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-17T05:42:19.933 INFO:teuthology.orchestra.run.smithi176.stdout: link/ether 46:08:82:dd:03:e2 brd ff:ff:ff:ff:ff:ff 2024-09-17T05:42:19.933 INFO:teuthology.orchestra.run.smithi176.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-17T05:42:19.934 INFO:teuthology.orchestra.run.smithi176.stdout: valid_lft forever preferred_lft forever 2024-09-17T05:42:19.934 INFO:teuthology.orchestra.run.smithi176.stdout: inet6 fe80::c411:66ff:fefa:818b/64 scope link tentative 2024-09-17T05:42:19.934 INFO:teuthology.orchestra.run.smithi176.stdout: valid_lft forever preferred_lft forever 2024-09-17T05:42:19.934 INFO:teuthology.orchestra.run.smithi176.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-17T05:42:19.934 INFO:teuthology.orchestra.run.smithi176.stdout: link/ether 46:08:82:dd:03:e2 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-17T05:42:19.934 INFO:teuthology.orchestra.run.smithi176.stdout: inet6 fe80::4408:82ff:fedd:3e2/64 scope link tentative 2024-09-17T05:42:19.934 INFO:teuthology.orchestra.run.smithi176.stdout: valid_lft forever preferred_lft forever 2024-09-17T05:42:19.934 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:42:19.934 DEBUG:teuthology.orchestra.run.smithi176:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-17T05:42:19.995 INFO:teuthology.orchestra.run.smithi176.stdout:1 2024-09-17T05:42:19.997 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:42:19.997 DEBUG:teuthology.orchestra.run.smithi176:> route 2024-09-17T05:42:20.054 INFO:teuthology.orchestra.run.smithi176.stdout:Kernel IP routing table 2024-09-17T05:42:20.054 INFO:teuthology.orchestra.run.smithi176.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-17T05:42:20.054 INFO:teuthology.orchestra.run.smithi176.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-17T05:42:20.054 INFO:teuthology.orchestra.run.smithi176.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-17T05:42:20.054 INFO:teuthology.orchestra.run.smithi176.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-17T05:42:20.054 DEBUG:teuthology.orchestra.run.smithi176:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-17T05:42:20.055 DEBUG:teuthology.orchestra.run.smithi176:> set -e 2024-09-17T05:42:20.055 DEBUG:teuthology.orchestra.run.smithi176:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-17T05:42:20.055 DEBUG:teuthology.orchestra.run.smithi176:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-17T05:42:20.055 DEBUG:teuthology.orchestra.run.smithi176:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-17T05:42:20.055 DEBUG:teuthology.orchestra.run.smithi176:> ') 2024-09-17T05:42:20.141 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T05:42:20 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-17T05:42:20.174 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T05:42:20 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T05:42:20.180 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:42:20.180 DEBUG:teuthology.orchestra.run.smithi176:> ip netns list 2024-09-17T05:42:20.195 INFO:teuthology.orchestra.run.smithi176.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-09-17T05:42:20.195 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:42:20.196 DEBUG:teuthology.orchestra.run.smithi176:> ip netns list-id 2024-09-17T05:42:20.251 INFO:teuthology.orchestra.run.smithi176.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.1) 2024-09-17T05:42:20.251 DEBUG:teuthology.orchestra.run.smithi176:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-17T05:42:20.251 DEBUG:teuthology.orchestra.run.smithi176:> set -e 2024-09-17T05:42:20.251 DEBUG:teuthology.orchestra.run.smithi176:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.3 2024-09-17T05:42:20.251 DEBUG:teuthology.orchestra.run.smithi176:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.3 1 2024-09-17T05:42:20.251 DEBUG:teuthology.orchestra.run.smithi176:> ') 2024-09-17T05:42:20.338 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T05:42:20 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-17T05:42:20.361 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T05:42:20 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T05:42:20.367 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:42:20.367 DEBUG:teuthology.orchestra.run.smithi176:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2024-09-17T05:42:20.392 INFO:teuthology.orchestra.run.smithi176.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-17T05:42:20.392 INFO:teuthology.orchestra.run.smithi176.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-17T05:42:20.392 INFO:teuthology.orchestra.run.smithi176.stdout: inet 127.0.0.1/8 scope host lo 2024-09-17T05:42:20.392 INFO:teuthology.orchestra.run.smithi176.stdout: valid_lft forever preferred_lft forever 2024-09-17T05:42:20.392 INFO:teuthology.orchestra.run.smithi176.stdout: inet6 ::1/128 scope host 2024-09-17T05:42:20.392 INFO:teuthology.orchestra.run.smithi176.stdout: valid_lft forever preferred_lft forever 2024-09-17T05:42:20.392 INFO:teuthology.orchestra.run.smithi176.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-17T05:42:20.392 INFO:teuthology.orchestra.run.smithi176.stdout: link/ether 92:02:95:e3:26:b9 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-09-17T05:42:20.393 INFO:teuthology.orchestra.run.smithi176.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-09-17T05:42:20.393 INFO:teuthology.orchestra.run.smithi176.stdout: valid_lft forever preferred_lft forever 2024-09-17T05:42:20.393 INFO:teuthology.orchestra.run.smithi176.stdout: inet6 fe80::9002:95ff:fee3:26b9/64 scope link 2024-09-17T05:42:20.393 INFO:teuthology.orchestra.run.smithi176.stdout: valid_lft forever preferred_lft forever 2024-09-17T05:42:20.394 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:42:20.394 DEBUG:teuthology.orchestra.run.smithi176:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2024-09-17T05:42:20.458 INFO:teuthology.orchestra.run.smithi176.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-17T05:42:20.458 INFO:teuthology.orchestra.run.smithi176.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-17T05:42:20.459 INFO:teuthology.orchestra.run.smithi176.stdout: inet 127.0.0.1/8 scope host lo 2024-09-17T05:42:20.459 INFO:teuthology.orchestra.run.smithi176.stdout: valid_lft forever preferred_lft forever 2024-09-17T05:42:20.459 INFO:teuthology.orchestra.run.smithi176.stdout: inet6 ::1/128 scope host 2024-09-17T05:42:20.459 INFO:teuthology.orchestra.run.smithi176.stdout: valid_lft forever preferred_lft forever 2024-09-17T05:42:20.459 INFO:teuthology.orchestra.run.smithi176.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-17T05:42:20.459 INFO:teuthology.orchestra.run.smithi176.stdout: link/ether 92:02:95:e3:26:b9 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-09-17T05:42:20.459 INFO:teuthology.orchestra.run.smithi176.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-09-17T05:42:20.459 INFO:teuthology.orchestra.run.smithi176.stdout: valid_lft forever preferred_lft forever 2024-09-17T05:42:20.459 INFO:teuthology.orchestra.run.smithi176.stdout: inet6 fe80::9002:95ff:fee3:26b9/64 scope link 2024-09-17T05:42:20.459 INFO:teuthology.orchestra.run.smithi176.stdout: valid_lft forever preferred_lft forever 2024-09-17T05:42:20.460 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.3' with 192.168.0.2/16 2024-09-17T05:42:20.460 DEBUG:teuthology.orchestra.run.smithi176:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-17T05:42:20.460 DEBUG:teuthology.orchestra.run.smithi176:> set -e 2024-09-17T05:42:20.460 DEBUG:teuthology.orchestra.run.smithi176:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.3 type veth peer name brx.1 2024-09-17T05:42:20.461 DEBUG:teuthology.orchestra.run.smithi176:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2024-09-17T05:42:20.461 DEBUG:teuthology.orchestra.run.smithi176:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set veth0 up 2024-09-17T05:42:20.461 DEBUG:teuthology.orchestra.run.smithi176:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set lo up 2024-09-17T05:42:20.461 DEBUG:teuthology.orchestra.run.smithi176:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip route add default via 192.168.255.254 2024-09-17T05:42:20.461 DEBUG:teuthology.orchestra.run.smithi176:> ') 2024-09-17T05:42:20.549 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T05:42:20 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-17T05:42:20.606 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T05:42:20 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T05:42:20.613 DEBUG:teuthology.orchestra.run.smithi176:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-17T05:42:20.613 DEBUG:teuthology.orchestra.run.smithi176:> set -e 2024-09-17T05:42:20.613 DEBUG:teuthology.orchestra.run.smithi176:> sudo ip link set brx.1 up 2024-09-17T05:42:20.613 DEBUG:teuthology.orchestra.run.smithi176:> sudo ip link set dev brx.1 master ceph-brx 2024-09-17T05:42:20.613 DEBUG:teuthology.orchestra.run.smithi176:> ') 2024-09-17T05:42:20.660 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T05:42:20 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-17T05:42:20.683 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T05:42:20 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T05:42:20.689 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-17T05:42:20.689 DEBUG:teuthology.orchestra.run.smithi176:> mkdir -p -v /home/ubuntu/cephtest/mnt.3 2024-09-17T05:42:20.705 INFO:teuthology.orchestra.run.smithi176.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.3' 2024-09-17T05:42:20.705 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-17T05:42:20.705 DEBUG:teuthology.orchestra.run.smithi176:> chmod 0000 /home/ubuntu/cephtest/mnt.3 2024-09-17T05:42:20.760 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-09-17T05:42:20.760 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:42:20.760 DEBUG:teuthology.orchestra.run.smithi176:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.3 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=3,mds_namespace=cephfs 2024-09-17T05:42:20.854 INFO:teuthology.orchestra.run.smithi176.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=3,mds_namespace=cephfs 2024-09-17T05:42:20.855 INFO:teuthology.orchestra.run.smithi176.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=3,mds_namespace=cephfs". 2024-09-17T05:42:20.855 INFO:teuthology.orchestra.run.smithi176.stdout:invalid new device string format 2024-09-17T05:42:20.866 INFO:teuthology.orchestra.run.smithi176.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=3,mds_namespace=cephfs 2024-09-17T05:42:20.866 INFO:teuthology.orchestra.run.smithi176.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=3,mds_namespace=cephfs". 2024-09-17T05:42:20.866 INFO:teuthology.orchestra.run.smithi176.stdout:invalid new device string format 2024-09-17T05:42:20.866 INFO:teuthology.orchestra.run.smithi176.stdout:mount.ceph: resolved to: "172.21.15.150:3300,172.21.15.176:3300,172.21.15.176:3301" 2024-09-17T05:42:20.866 INFO:teuthology.orchestra.run.smithi176.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-17T05:42:20.872 INFO:teuthology.orchestra.run.smithi176.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=3,mds_namespace=cephfs 2024-09-17T05:42:20.872 INFO:teuthology.orchestra.run.smithi176.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=3,mds_namespace=cephfs". 2024-09-17T05:42:20.872 INFO:teuthology.orchestra.run.smithi176.stdout:invalid new device string format 2024-09-17T05:42:20.872 INFO:teuthology.orchestra.run.smithi176.stdout:mount.ceph: resolved to: "172.21.15.150:3300,172.21.15.176:3300,172.21.15.176:3301" 2024-09-17T05:42:20.872 INFO:teuthology.orchestra.run.smithi176.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-17T05:42:20.872 INFO:teuthology.orchestra.run.smithi176.stdout:mount.ceph: resolved to: "172.21.15.150:6789,172.21.15.176:6789,172.21.15.176:6790" 2024-09-17T05:42:20.872 INFO:teuthology.orchestra.run.smithi176.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.150:6789,172.21.15.176:6789,172.21.15.176:6790:/ 2024-09-17T05:42:20.872 INFO:teuthology.orchestra.run.smithi176.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=3,mds_namespace=cephfs,key=3,fsid=9f2e05e9-d629-47b3-b26b-1360655b7d20" will pass to kernel 2024-09-17T05:42:20.873 INFO:teuthology.orchestra.run.smithi176.stdout:mount: /home/ubuntu/cephtest/mnt.3 does not contain SELinux labels. 2024-09-17T05:42:20.873 INFO:teuthology.orchestra.run.smithi176.stdout: You just mounted a file system that supports labels which does not 2024-09-17T05:42:20.873 INFO:teuthology.orchestra.run.smithi176.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-09-17T05:42:20.873 INFO:teuthology.orchestra.run.smithi176.stdout: applications will generate AVC messages and not be allowed access to 2024-09-17T05:42:20.873 INFO:teuthology.orchestra.run.smithi176.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-09-17T05:42:20.874 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-17T05:42:20.874 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:42:20.874 DEBUG:teuthology.orchestra.run.smithi176:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.3 2024-09-17T05:42:20.899 DEBUG:teuthology.orchestra.run.smithi176:> (cd /home/ubuntu/cephtest/mnt.3 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-17T05:42:20.987 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T05:42:20 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-17T05:42:20.989 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T05:42:20 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T05:42:20.994 INFO:teuthology.orchestra.run.smithi176.stdout:client4574 2024-09-17T05:42:20.995 DEBUG:teuthology.orchestra.run.smithi176:> set -ex 2024-09-17T05:42:20.995 DEBUG:teuthology.orchestra.run.smithi176:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T05:42:21.012 DEBUG:teuthology.orchestra.run.smithi176:> (cd /home/ubuntu/cephtest/mnt.3 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-17T05:42:21.100 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T05:42:21 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-17T05:42:21.101 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T05:42:21 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T05:42:21.107 INFO:teuthology.orchestra.run.smithi176.stdout:client4574 2024-09-17T05:42:21.108 DEBUG:teuthology.orchestra.run.smithi176:> (cd /home/ubuntu/cephtest/mnt.3 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-17T05:42:21.156 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T05:42:21 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-17T05:42:21.157 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T05:42:21 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T05:42:21.163 INFO:teuthology.orchestra.run.smithi176.stdout:client4574 2024-09-17T05:42:21.163 DEBUG:teuthology.orchestra.run.smithi176:> (cd /home/ubuntu/cephtest/mnt.3 && exec stdin-killer --timeout=300 -- bash -c 'sudo dd if=/sys/kernel/debug/ceph/9f2e05e9-d629-47b3-b26b-1360655b7d20.client4574/status') 2024-09-17T05:42:21.211 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T05:42:21 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-17T05:42:21.222 INFO:teuthology.orchestra.run.smithi176.stdout:instance: client.4574 (3)192.168.0.2:0/3923631737 2024-09-17T05:42:21.222 INFO:teuthology.orchestra.run.smithi176.stdout:blocklisted: false 2024-09-17T05:42:21.222 INFO:teuthology.orchestra.run.smithi176.stderr:0+1 records in 2024-09-17T05:42:21.222 INFO:teuthology.orchestra.run.smithi176.stderr:0+1 records out 2024-09-17T05:42:21.222 INFO:teuthology.orchestra.run.smithi176.stderr:69 bytes copied, 2.2399e-05 s, 3.1 MB/s 2024-09-17T05:42:21.223 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T05:42:21 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T05:42:21.229 INFO:teuthology.run_tasks:Running task cephfs_test_runner... 2024-09-17T05:42:21.329 INFO:tasks.cephfs_test_runner:Starting test: test_clone_to_diff_group_and_less_than_cloner_threads (tasks.cephfs.test_volumes.TestCloneProgressReporter) Initiate cloning where clone subvolume and source subvolume are located 2024-09-17T05:42:21.329 INFO:tasks.cephfs_test_runner:test_clone_to_diff_group_and_less_than_cloner_threads (tasks.cephfs.test_volumes.TestCloneProgressReporter) 2024-09-17T05:42:21.329 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T05:42:21.457 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:21.455+0000 7f3571d89640 1 -- 172.21.15.150:0/2452061787 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f356c0b5970 msgr2=0x7f356c0b5d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:21.457 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:21.455+0000 7f3571d89640 1 --2- 172.21.15.150:0/2452061787 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f356c0b5970 0x7f356c0b5d80 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f3564005fd0 tx=0x7f356402a940 comp rx=0 tx=0).stop 2024-09-17T05:42:21.457 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:21.455+0000 7f3571d89640 1 -- 172.21.15.150:0/2452061787 shutdown_connections 2024-09-17T05:42:21.457 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:21.455+0000 7f3571d89640 1 --2- 172.21.15.150:0/2452061787 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f356c0b5970 0x7f356c0b5d80 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:21.457 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:21.455+0000 7f3571d89640 1 -- 172.21.15.150:0/2452061787 >> 172.21.15.150:0/2452061787 conn(0x7f356c0cee90 msgr2=0x7f356c0cf2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:42:21.457 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:21.455+0000 7f3571d89640 1 -- 172.21.15.150:0/2452061787 shutdown_connections 2024-09-17T05:42:21.457 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:21.455+0000 7f3571d89640 1 -- 172.21.15.150:0/2452061787 wait complete. 2024-09-17T05:42:21.458 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:21.457+0000 7f3571d89640 1 Processor -- start 2024-09-17T05:42:21.458 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:21.457+0000 7f3571d89640 1 -- start start 2024-09-17T05:42:21.461 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:21.458+0000 7f3571d89640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f356c09ba60 0x7f356c15a910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:42:21.461 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:21.458+0000 7f3571d89640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f356c0b5970 0x7f356c1672c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:42:21.461 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:21.458+0000 7f3571d89640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f356c0b7330 0x7f356c0b2b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:42:21.461 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:21.458+0000 7f3571d89640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f356c1680f0 con 0x7f356c0b5970 2024-09-17T05:42:21.461 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:21.458+0000 7f3571d89640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f356c0c5c10 con 0x7f356c0b7330 2024-09-17T05:42:21.462 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:21.458+0000 7f3571d89640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f356c168270 con 0x7f356c09ba60 2024-09-17T05:42:21.462 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:21.458+0000 7f356affd640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f356c0b5970 0x7f356c1672c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:42:21.462 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:21.458+0000 7f356affd640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f356c0b5970 0x7f356c1672c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:35508/0 (socket says 172.21.15.150:35508) 2024-09-17T05:42:21.462 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:21.458+0000 7f356affd640 1 -- 172.21.15.150:0/2487650303 learned_addr learned my addr 172.21.15.150:0/2487650303 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:42:21.462 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:21.458+0000 7f356b7fe640 1 --2- 172.21.15.150:0/2487650303 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f356c09ba60 0x7f356c15a910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:42:21.462 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:21.458+0000 7f356bfff640 1 --2- 172.21.15.150:0/2487650303 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f356c0b7330 0x7f356c0b2b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:42:21.462 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:21.459+0000 7f356affd640 1 -- 172.21.15.150:0/2487650303 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f356c09ba60 msgr2=0x7f356c15a910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:21.462 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:21.459+0000 7f356affd640 1 --2- 172.21.15.150:0/2487650303 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f356c09ba60 0x7f356c15a910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:21.462 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:21.459+0000 7f356affd640 1 -- 172.21.15.150:0/2487650303 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f356c0b7330 msgr2=0x7f356c0b2b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:21.462 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:21.459+0000 7f356affd640 1 --2- 172.21.15.150:0/2487650303 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f356c0b7330 0x7f356c0b2b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:21.462 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:21.459+0000 7f356affd640 1 -- 172.21.15.150:0/2487650303 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f356c1f4d60 con 0x7f356c0b5970 2024-09-17T05:42:21.462 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:21.459+0000 7f356affd640 1 --2- 172.21.15.150:0/2487650303 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f356c0b5970 0x7f356c1672c0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f356000c400 tx=0x7f356000c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:42:21.463 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:21.459+0000 7f3553fff640 1 -- 172.21.15.150:0/2487650303 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3560017070 con 0x7f356c0b5970 2024-09-17T05:42:21.463 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:21.459+0000 7f3571d89640 1 -- 172.21.15.150:0/2487650303 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f356c1f3fa0 con 0x7f356c0b5970 2024-09-17T05:42:21.463 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:21.459+0000 7f3553fff640 1 -- 172.21.15.150:0/2487650303 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f35600053c0 con 0x7f356c0b5970 2024-09-17T05:42:21.463 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:21.459+0000 7f3553fff640 1 -- 172.21.15.150:0/2487650303 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3560003850 con 0x7f356c0b5970 2024-09-17T05:42:21.463 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:21.459+0000 7f3571d89640 1 -- 172.21.15.150:0/2487650303 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f356c1f4560 con 0x7f356c0b5970 2024-09-17T05:42:21.464 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:21.460+0000 7f3571d89640 1 -- 172.21.15.150:0/2487650303 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f356c167d60 con 0x7f356c0b5970 2024-09-17T05:42:21.464 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:21.461+0000 7f3553fff640 1 -- 172.21.15.150:0/2487650303 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f356001a070 con 0x7f356c0b5970 2024-09-17T05:42:21.464 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:21.461+0000 7f3553fff640 1 --2- 172.21.15.150:0/2487650303 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f3558078bc0 0x7f355807b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:42:21.464 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:21.462+0000 7f3553fff640 1 -- 172.21.15.150:0/2487650303 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f356009a010 con 0x7f356c0b5970 2024-09-17T05:42:21.464 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:21.462+0000 7f356b7fe640 1 --2- 172.21.15.150:0/2487650303 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f3558078bc0 0x7f355807b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:42:21.464 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:21.462+0000 7f356b7fe640 1 --2- 172.21.15.150:0/2487650303 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f3558078bc0 0x7f355807b0d0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f355c001090 tx=0x7f355c009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:42:21.467 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:21.466+0000 7f3553fff640 1 -- 172.21.15.150:0/2487650303 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f3560061e10 con 0x7f356c0b5970 2024-09-17T05:42:21.643 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:21.641+0000 7f3571d89640 1 -- 172.21.15.150:0/2487650303 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f356c0b5240 con 0x7f356c0b5970 2024-09-17T05:42:21.644 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:21.642+0000 7f3553fff640 1 -- 172.21.15.150:0/2487650303 <== mon.0 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) ==== 74+0+16701 (secure 0 0 0) 0x7f356c0b5240 con 0x7f356c0b5970 2024-09-17T05:42:21.645 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-09-17T05:42:21.645 INFO:teuthology.orchestra.run.smithi150.stdout:{"epoch":23,"fsid":"9f2e05e9-d629-47b3-b26b-1360655b7d20","created":"2024-09-17T05:41:32.502979+0000","modified":"2024-09-17T05:41:58.934156+0000","last_up_change":"2024-09-17T05:41:46.150225+0000","last_in_change":"2024-09-17T05:41:36.120274+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T05:41:46.860779+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-17T05:41:55.155732+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-17T05:41:56.250888+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"4f31c018-c8a4-4d6d-b0c2-a597c47aae4a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6800","nonce":479374392},{"type":"v1","addr":"172.21.15.150:6801","nonce":479374392}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6802","nonce":479374392},{"type":"v1","addr":"172.21.15.150:6803","nonce":479374392}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6806","nonce":479374392},{"type":"v1","addr":"172.21.15.150:6807","nonce":479374392}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6804","nonce":479374392},{"type":"v1","addr":"172.21.15.150:6805","nonce":479374392}]},"public_addr":"172.21.15.150:6801/479374392","cluster_addr":"172.21.15.150:6803/479374392","heartbeat_back_addr":"172.21.15.150:6807/479374392","heartbeat_front_addr":"172.21.15.150:6805/479374392","state":["exists","up"]},{"osd":1,"uuid":"6ff4a573-500b-4e04-9de3-39265ead78b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6824","nonce":913899800},{"type":"v1","addr":"172.21.15.150:6825","nonce":913899800}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6826","nonce":913899800},{"type":"v1","addr":"172.21.15.150:6827","nonce":913899800}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6830","nonce":913899800},{"type":"v1","addr":"172.21.15.150:6831","nonce":913899800}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6828","nonce":913899800},{"type":"v1","addr":"172.21.15.150:6829","nonce":913899800}]},"public_addr":"172.21.15.150:6825/913899800","cluster_addr":"172.21.15.150:6827/913899800","heartbeat_back_addr":"172.21.15.150:6831/913899800","heartbeat_front_addr":"172.21.15.150:6829/913899800","state":["exists","up"]},{"osd":2,"uuid":"bffea6f9-2465-4182-b205-00436c41ac1c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6816","nonce":363718461},{"type":"v1","addr":"172.21.15.150:6817","nonce":363718461}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6818","nonce":363718461},{"type":"v1","addr":"172.21.15.150:6819","nonce":363718461}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6822","nonce":363718461},{"type":"v1","addr":"172.21.15.150:6823","nonce":363718461}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6820","nonce":363718461},{"type":"v1","addr":"172.21.15.150:6821","nonce":363718461}]},"public_addr":"172.21.15.150:6817/363718461","cluster_addr":"172.21.15.150:6819/363718461","heartbeat_back_addr":"172.21.15.150:6823/363718461","heartbeat_front_addr":"172.21.15.150:6821/363718461","state":["exists","up"]},{"osd":3,"uuid":"cda70430-d1e1-427e-b04e-56db4031d078","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6808","nonce":3550994626},{"type":"v1","addr":"172.21.15.150:6809","nonce":3550994626}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6810","nonce":3550994626},{"type":"v1","addr":"172.21.15.150:6811","nonce":3550994626}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6814","nonce":3550994626},{"type":"v1","addr":"172.21.15.150:6815","nonce":3550994626}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6812","nonce":3550994626},{"type":"v1","addr":"172.21.15.150:6813","nonce":3550994626}]},"public_addr":"172.21.15.150:6809/3550994626","cluster_addr":"172.21.15.150:6811/3550994626","heartbeat_back_addr":"172.21.15.150:6815/3550994626","heartbeat_front_addr":"172.21.15.150:6813/3550994626","state":["exists","up"]},{"osd":4,"uuid":"3a0277fb-5e1e-4f68-bb2d-9a8a0152f64a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6810","nonce":2718261497},{"type":"v1","addr":"172.21.15.176:6811","nonce":2718261497}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6812","nonce":2718261497},{"type":"v1","addr":"172.21.15.176:6813","nonce":2718261497}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6816","nonce":2718261497},{"type":"v1","addr":"172.21.15.176:6817","nonce":2718261497}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6814","nonce":2718261497},{"type":"v1","addr":"172.21.15.176:6815","nonce":2718261497}]},"public_addr":"172.21.15.176:6811/2718261497","cluster_addr":"172.21.15.176:6813/2718261497","heartbeat_back_addr":"172.21.15.176:6817/2718261497","heartbeat_front_addr":"172.21.15.176:6815/2718261497","state":["exists","up"]},{"osd":5,"uuid":"33aebee6-0315-40b7-a11c-6702f0be494d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6818","nonce":2049295774},{"type":"v1","addr":"172.21.15.176:6819","nonce":2049295774}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6820","nonce":2049295774},{"type":"v1","addr":"172.21.15.176:6821","nonce":2049295774}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6824","nonce":2049295774},{"type":"v1","addr":"172.21.15.176:6825","nonce":2049295774}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6822","nonce":2049295774},{"type":"v1","addr":"172.21.15.176:6823","nonce":2049295774}]},"public_addr":"172.21.15.176:6819/2049295774","cluster_addr":"172.21.15.176:6821/2049295774","heartbeat_back_addr":"172.21.15.176:6825/2049295774","heartbeat_front_addr":"172.21.15.176:6823/2049295774","state":["exists","up"]},{"osd":6,"uuid":"4d24f360-6751-4263-841b-d77793d33540","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6826","nonce":2164458476},{"type":"v1","addr":"172.21.15.176:6827","nonce":2164458476}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6828","nonce":2164458476},{"type":"v1","addr":"172.21.15.176:6829","nonce":2164458476}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6832","nonce":2164458476},{"type":"v1","addr":"172.21.15.176:6833","nonce":2164458476}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6830","nonce":2164458476},{"type":"v1","addr":"172.21.15.176:6831","nonce":2164458476}]},"public_addr":"172.21.15.176:6827/2164458476","cluster_addr":"172.21.15.176:6829/2164458476","heartbeat_back_addr":"172.21.15.176:6833/2164458476","heartbeat_front_addr":"172.21.15.176:6831/2164458476","state":["exists","up"]},{"osd":7,"uuid":"c8594fda-c74a-4ba9-8277-caf101d58ca1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6802","nonce":3239587708},{"type":"v1","addr":"172.21.15.176:6803","nonce":3239587708}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6804","nonce":3239587708},{"type":"v1","addr":"172.21.15.176:6805","nonce":3239587708}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6808","nonce":3239587708},{"type":"v1","addr":"172.21.15.176:6809","nonce":3239587708}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6806","nonce":3239587708},{"type":"v1","addr":"172.21.15.176:6807","nonce":3239587708}]},"public_addr":"172.21.15.176:6803/3239587708","cluster_addr":"172.21.15.176:6805/3239587708","heartbeat_back_addr":"172.21.15.176:6809/3239587708","heartbeat_front_addr":"172.21.15.176:6807/3239587708","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:41:41.905151+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:41:42.705679+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:41:42.459673+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:41:42.440819+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:41:42.668428+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:41:42.694972+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:41:43.078535+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:41:42.363539+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T05:42:21.647 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:21.644+0000 7f3571d89640 1 -- 172.21.15.150:0/2487650303 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f3558078bc0 msgr2=0x7f355807b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:21.647 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:21.644+0000 7f3571d89640 1 --2- 172.21.15.150:0/2487650303 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f3558078bc0 0x7f355807b0d0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f355c001090 tx=0x7f355c009040 comp rx=0 tx=0).stop 2024-09-17T05:42:21.647 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:21.644+0000 7f3571d89640 1 -- 172.21.15.150:0/2487650303 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f356c0b5970 msgr2=0x7f356c1672c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:21.647 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:21.644+0000 7f3571d89640 1 --2- 172.21.15.150:0/2487650303 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f356c0b5970 0x7f356c1672c0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f356000c400 tx=0x7f356000c8c0 comp rx=0 tx=0).stop 2024-09-17T05:42:21.647 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:21.644+0000 7f3571d89640 1 -- 172.21.15.150:0/2487650303 shutdown_connections 2024-09-17T05:42:21.647 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:21.645+0000 7f3571d89640 1 --2- 172.21.15.150:0/2487650303 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f356c0b7330 0x7f356c0b2b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:21.648 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:21.645+0000 7f3571d89640 1 --2- 172.21.15.150:0/2487650303 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f3558078bc0 0x7f355807b0d0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:21.648 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:21.645+0000 7f3571d89640 1 --2- 172.21.15.150:0/2487650303 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f356c0b5970 0x7f356c1672c0 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:21.648 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:21.645+0000 7f3571d89640 1 --2- 172.21.15.150:0/2487650303 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f356c09ba60 0x7f356c15a910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:21.648 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:21.645+0000 7f3571d89640 1 -- 172.21.15.150:0/2487650303 >> 172.21.15.150:0/2487650303 conn(0x7f356c0cee90 msgr2=0x7f356c0723e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:42:21.648 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:21.645+0000 7f3571d89640 1 -- 172.21.15.150:0/2487650303 shutdown_connections 2024-09-17T05:42:21.648 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:21.645+0000 7f3571d89640 1 -- 172.21.15.150:0/2487650303 wait complete. 2024-09-17T05:42:21.658 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-17T05:41:46.860779+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-17T05:41:55.155732+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-09-17T05:41:56.250888+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-17T05:42:21.659 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-17T05:42:21.776 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:21.774+0000 7fa4f12bd640 1 -- 172.21.15.150:0/4280918548 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa4d8003c30 msgr2=0x7fa4d80040a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:21.776 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:21.774+0000 7fa4f12bd640 1 --2- 172.21.15.150:0/4280918548 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa4d8003c30 0x7fa4d80040a0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fa4dc009cf0 tx=0x7fa4d8005830 comp rx=0 tx=0).stop 2024-09-17T05:42:21.776 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:21.774+0000 7fa4f12bd640 1 -- 172.21.15.150:0/4280918548 shutdown_connections 2024-09-17T05:42:21.776 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:21.774+0000 7fa4f12bd640 1 --2- 172.21.15.150:0/4280918548 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa4d8003c30 0x7fa4d80040a0 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:21.777 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:21.774+0000 7fa4f12bd640 1 -- 172.21.15.150:0/4280918548 >> 172.21.15.150:0/4280918548 conn(0x7fa4ec08bfe0 msgr2=0x7fa4ec0d46e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:42:21.777 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:21.774+0000 7fa4f12bd640 1 -- 172.21.15.150:0/4280918548 shutdown_connections 2024-09-17T05:42:21.777 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:21.774+0000 7fa4f12bd640 1 -- 172.21.15.150:0/4280918548 wait complete. 2024-09-17T05:42:21.777 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:21.776+0000 7fa4f12bd640 1 Processor -- start 2024-09-17T05:42:21.777 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:21.776+0000 7fa4f12bd640 1 -- start start 2024-09-17T05:42:21.780 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:21.777+0000 7fa4f12bd640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa4d8003c30 0x7fa4ec148470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:42:21.780 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:21.777+0000 7fa4f12bd640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa4ec0b5050 0x7fa4ec0c7fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:42:21.780 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:21.777+0000 7fa4f12bd640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa4ec0c8510 0x7fa4ec1f9070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:42:21.780 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:21.777+0000 7fa4f12bd640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7fa4ec06e430 con 0x7fa4ec0c8510 2024-09-17T05:42:21.780 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:21.777+0000 7fa4f12bd640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fa4ec06e2b0 con 0x7fa4ec0b5050 2024-09-17T05:42:21.780 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:21.777+0000 7fa4f12bd640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fa4ec06e5b0 con 0x7fa4d8003c30 2024-09-17T05:42:21.780 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:21.778+0000 7fa4eb7fe640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa4ec0c8510 0x7fa4ec1f9070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:42:21.780 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:21.778+0000 7fa4eb7fe640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa4ec0c8510 0x7fa4ec1f9070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:35534/0 (socket says 172.21.15.150:35534) 2024-09-17T05:42:21.781 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:21.778+0000 7fa4eb7fe640 1 -- 172.21.15.150:0/3093611849 learned_addr learned my addr 172.21.15.150:0/3093611849 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:42:21.781 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:21.778+0000 7fa4eaffd640 1 --2- 172.21.15.150:0/3093611849 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa4d8003c30 0x7fa4ec148470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:42:21.781 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:21.778+0000 7fa4e27fc640 1 --2- 172.21.15.150:0/3093611849 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa4ec0b5050 0x7fa4ec0c7fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:42:21.781 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:21.778+0000 7fa4eb7fe640 1 -- 172.21.15.150:0/3093611849 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa4d8003c30 msgr2=0x7fa4ec148470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:21.781 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:21.778+0000 7fa4eb7fe640 1 --2- 172.21.15.150:0/3093611849 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa4d8003c30 0x7fa4ec148470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:21.781 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:21.778+0000 7fa4eb7fe640 1 -- 172.21.15.150:0/3093611849 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa4ec0b5050 msgr2=0x7fa4ec0c7fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:21.781 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:21.778+0000 7fa4eb7fe640 1 --2- 172.21.15.150:0/3093611849 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa4ec0b5050 0x7fa4ec0c7fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:21.781 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:21.778+0000 7fa4eb7fe640 1 -- 172.21.15.150:0/3093611849 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa4ec147a00 con 0x7fa4ec0c8510 2024-09-17T05:42:21.781 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:21.778+0000 7fa4e27fc640 1 --2- 172.21.15.150:0/3093611849 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa4ec0b5050 0x7fa4ec0c7fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T05:42:21.781 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:21.778+0000 7fa4eb7fe640 1 --2- 172.21.15.150:0/3093611849 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa4ec0c8510 0x7fa4ec1f9070 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fa4ec08cac0 tx=0x7fa4e40064f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:42:21.781 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:21.778+0000 7fa4e3fff640 1 -- 172.21.15.150:0/3093611849 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4e40119c0 con 0x7fa4ec0c8510 2024-09-17T05:42:21.781 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:21.778+0000 7fa4e3fff640 1 -- 172.21.15.150:0/3093611849 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa4e4018070 con 0x7fa4ec0c8510 2024-09-17T05:42:21.782 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:21.778+0000 7fa4e3fff640 1 -- 172.21.15.150:0/3093611849 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4e4011e20 con 0x7fa4ec0c8510 2024-09-17T05:42:21.782 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:21.778+0000 7fa4f12bd640 1 -- 172.21.15.150:0/3093611849 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa4ec1f9bf0 con 0x7fa4ec0c8510 2024-09-17T05:42:21.782 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:21.778+0000 7fa4f12bd640 1 -- 172.21.15.150:0/3093611849 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa4ec147f50 con 0x7fa4ec0c8510 2024-09-17T05:42:21.782 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:21.779+0000 7fa4f12bd640 1 -- 172.21.15.150:0/3093611849 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa4ec06a610 con 0x7fa4ec0c8510 2024-09-17T05:42:21.783 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:21.780+0000 7fa4e3fff640 1 -- 172.21.15.150:0/3093611849 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fa4e401d460 con 0x7fa4ec0c8510 2024-09-17T05:42:21.783 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:21.781+0000 7fa4e3fff640 1 --2- 172.21.15.150:0/3093611849 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fa4cc078bc0 0x7fa4cc07b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:42:21.783 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:21.781+0000 7fa4e3fff640 1 -- 172.21.15.150:0/3093611849 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7fa4e409b300 con 0x7fa4ec0c8510 2024-09-17T05:42:21.783 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:21.781+0000 7fa4eaffd640 1 --2- 172.21.15.150:0/3093611849 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fa4cc078bc0 0x7fa4cc07b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:42:21.783 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:21.781+0000 7fa4eaffd640 1 --2- 172.21.15.150:0/3093611849 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fa4cc078bc0 0x7fa4cc07b0d0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fa4dc035000 tx=0x7fa4dc0046c0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:42:21.787 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:21.785+0000 7fa4e3fff640 1 -- 172.21.15.150:0/3093611849 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fa4ec06a610 con 0x7fa4ec0c8510 2024-09-17T05:42:21.965 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:21.963+0000 7fa4f12bd640 1 -- 172.21.15.150:0/3093611849 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fa4ec0d02e0 con 0x7fa4ec0c8510 2024-09-17T05:42:21.965 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:21.963+0000 7fa4e3fff640 1 -- 172.21.15.150:0/3093611849 <== mon.0 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v23) ==== 93+0+10 (secure 0 0 0) 0x7fa4e40637d0 con 0x7fa4ec0c8510 2024-09-17T05:42:21.965 INFO:teuthology.orchestra.run.smithi150.stdout:pg_num: 1 2024-09-17T05:42:21.967 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:21.966+0000 7fa4f12bd640 1 -- 172.21.15.150:0/3093611849 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fa4cc078bc0 msgr2=0x7fa4cc07b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:21.967 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:21.966+0000 7fa4f12bd640 1 --2- 172.21.15.150:0/3093611849 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fa4cc078bc0 0x7fa4cc07b0d0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fa4dc035000 tx=0x7fa4dc0046c0 comp rx=0 tx=0).stop 2024-09-17T05:42:21.968 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:21.966+0000 7fa4f12bd640 1 -- 172.21.15.150:0/3093611849 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa4ec0c8510 msgr2=0x7fa4ec1f9070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:21.968 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:21.966+0000 7fa4f12bd640 1 --2- 172.21.15.150:0/3093611849 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa4ec0c8510 0x7fa4ec1f9070 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fa4ec08cac0 tx=0x7fa4e40064f0 comp rx=0 tx=0).stop 2024-09-17T05:42:21.968 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:21.966+0000 7fa4f12bd640 1 -- 172.21.15.150:0/3093611849 shutdown_connections 2024-09-17T05:42:21.968 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:21.966+0000 7fa4f12bd640 1 --2- 172.21.15.150:0/3093611849 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa4ec0b5050 0x7fa4ec0c7fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:21.968 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:21.966+0000 7fa4f12bd640 1 --2- 172.21.15.150:0/3093611849 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fa4cc078bc0 0x7fa4cc07b0d0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:21.968 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:21.966+0000 7fa4f12bd640 1 --2- 172.21.15.150:0/3093611849 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa4ec0c8510 0x7fa4ec1f9070 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:21.968 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:21.966+0000 7fa4f12bd640 1 --2- 172.21.15.150:0/3093611849 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa4d8003c30 0x7fa4ec148470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:21.968 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:21.966+0000 7fa4f12bd640 1 -- 172.21.15.150:0/3093611849 >> 172.21.15.150:0/3093611849 conn(0x7fa4ec08bfe0 msgr2=0x7fa4ec0b12c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:42:21.968 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:21.966+0000 7fa4f12bd640 1 -- 172.21.15.150:0/3093611849 shutdown_connections 2024-09-17T05:42:21.968 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:21.966+0000 7fa4f12bd640 1 -- 172.21.15.150:0/3093611849 wait complete. 2024-09-17T05:42:21.979 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-09-17T05:42:22.096 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:22.094+0000 7ff191558640 1 -- 172.21.15.150:0/750531918 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff18c0d2370 msgr2=0x7ff18c162fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:22.096 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:22.094+0000 7ff191558640 1 --2- 172.21.15.150:0/750531918 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff18c0d2370 0x7ff18c162fd0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7ff174009830 tx=0x7ff17402a5c0 comp rx=0 tx=0).stop 2024-09-17T05:42:22.096 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:22.094+0000 7ff191558640 1 -- 172.21.15.150:0/750531918 shutdown_connections 2024-09-17T05:42:22.096 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:22.094+0000 7ff191558640 1 --2- 172.21.15.150:0/750531918 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff18c0d2370 0x7ff18c162fd0 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:22.096 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:22.094+0000 7ff191558640 1 -- 172.21.15.150:0/750531918 >> 172.21.15.150:0/750531918 conn(0x7ff18c0d4680 msgr2=0x7ff18c0d4a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:42:22.097 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:22.094+0000 7ff191558640 1 -- 172.21.15.150:0/750531918 shutdown_connections 2024-09-17T05:42:22.097 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:22.094+0000 7ff191558640 1 -- 172.21.15.150:0/750531918 wait complete. 2024-09-17T05:42:22.097 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:22.096+0000 7ff191558640 1 Processor -- start 2024-09-17T05:42:22.097 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:22.096+0000 7ff191558640 1 -- start start 2024-09-17T05:42:22.100 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:22.097+0000 7ff191558640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff18c0b3ae0 0x7ff18c1527d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:42:22.101 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:22.097+0000 7ff191558640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff18c0d2370 0x7ff18c1659e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:42:22.101 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:22.097+0000 7ff191558640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff18c166be0 0x7ff18c165f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:42:22.101 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:22.097+0000 7ff191558640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7ff18c163690 con 0x7ff18c166be0 2024-09-17T05:42:22.101 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:22.097+0000 7ff191558640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7ff18c163510 con 0x7ff18c0b3ae0 2024-09-17T05:42:22.101 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:22.097+0000 7ff191558640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7ff18c16a720 con 0x7ff18c0d2370 2024-09-17T05:42:22.101 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:22.097+0000 7ff18b7fe640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff18c166be0 0x7ff18c165f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:42:22.101 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:22.098+0000 7ff18b7fe640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff18c166be0 0x7ff18c165f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:35548/0 (socket says 172.21.15.150:35548) 2024-09-17T05:42:22.101 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:22.098+0000 7ff18b7fe640 1 -- 172.21.15.150:0/4166160474 learned_addr learned my addr 172.21.15.150:0/4166160474 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:42:22.101 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:22.098+0000 7ff1827fc640 1 --2- 172.21.15.150:0/4166160474 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff18c0d2370 0x7ff18c1659e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:42:22.101 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:22.098+0000 7ff18affd640 1 --2- 172.21.15.150:0/4166160474 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff18c0b3ae0 0x7ff18c1527d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:42:22.101 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:22.098+0000 7ff18b7fe640 1 -- 172.21.15.150:0/4166160474 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff18c0d2370 msgr2=0x7ff18c1659e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:22.101 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:22.098+0000 7ff18b7fe640 1 --2- 172.21.15.150:0/4166160474 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff18c0d2370 0x7ff18c1659e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:22.102 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:22.098+0000 7ff18b7fe640 1 -- 172.21.15.150:0/4166160474 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff18c0b3ae0 msgr2=0x7ff18c1527d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:22.102 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:22.098+0000 7ff18b7fe640 1 --2- 172.21.15.150:0/4166160474 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff18c0b3ae0 0x7ff18c1527d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:22.102 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:22.098+0000 7ff18b7fe640 1 -- 172.21.15.150:0/4166160474 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff18c166760 con 0x7ff18c166be0 2024-09-17T05:42:22.102 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:22.098+0000 7ff18b7fe640 1 --2- 172.21.15.150:0/4166160474 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff18c166be0 0x7ff18c165f20 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7ff18400c6b0 tx=0x7ff18400cb70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:42:22.102 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:22.098+0000 7ff183fff640 1 -- 172.21.15.150:0/4166160474 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff184003b70 con 0x7ff18c166be0 2024-09-17T05:42:22.102 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:22.098+0000 7ff183fff640 1 -- 172.21.15.150:0/4166160474 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff184003d10 con 0x7ff18c166be0 2024-09-17T05:42:22.102 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:22.098+0000 7ff191558640 1 -- 172.21.15.150:0/4166160474 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff18c169a70 con 0x7ff18c166be0 2024-09-17T05:42:22.102 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:22.098+0000 7ff183fff640 1 -- 172.21.15.150:0/4166160474 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff184005330 con 0x7ff18c166be0 2024-09-17T05:42:22.102 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:22.098+0000 7ff191558640 1 -- 172.21.15.150:0/4166160474 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff18c166460 con 0x7ff18c166be0 2024-09-17T05:42:22.102 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:22.099+0000 7ff191558640 1 -- 172.21.15.150:0/4166160474 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff18c069840 con 0x7ff18c166be0 2024-09-17T05:42:22.103 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:22.100+0000 7ff183fff640 1 -- 172.21.15.150:0/4166160474 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7ff1840054d0 con 0x7ff18c166be0 2024-09-17T05:42:22.103 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:22.100+0000 7ff183fff640 1 --2- 172.21.15.150:0/4166160474 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7ff16c078b90 0x7ff16c07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:42:22.103 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:22.101+0000 7ff183fff640 1 -- 172.21.15.150:0/4166160474 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7ff18409aa00 con 0x7ff18c166be0 2024-09-17T05:42:22.103 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:22.101+0000 7ff18affd640 1 --2- 172.21.15.150:0/4166160474 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7ff16c078b90 0x7ff16c07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:42:22.103 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:22.101+0000 7ff18affd640 1 --2- 172.21.15.150:0/4166160474 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7ff16c078b90 0x7ff16c07b0a0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7ff17c001090 tx=0x7ff17c009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:42:22.106 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:22.105+0000 7ff183fff640 1 -- 172.21.15.150:0/4166160474 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7ff18c069840 con 0x7ff18c166be0 2024-09-17T05:42:22.285 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:22.283+0000 7ff191558640 1 -- 172.21.15.150:0/4166160474 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7ff18c154880 con 0x7ff18c166be0 2024-09-17T05:42:22.285 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:22.284+0000 7ff183fff640 1 -- 172.21.15.150:0/4166160474 <== mon.0 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v23) ==== 104+0+11 (secure 0 0 0) 0x7ff184062800 con 0x7ff18c166be0 2024-09-17T05:42:22.285 INFO:teuthology.orchestra.run.smithi150.stdout:pg_num: 32 2024-09-17T05:42:22.288 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:22.286+0000 7ff191558640 1 -- 172.21.15.150:0/4166160474 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7ff16c078b90 msgr2=0x7ff16c07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:22.288 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:22.286+0000 7ff191558640 1 --2- 172.21.15.150:0/4166160474 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7ff16c078b90 0x7ff16c07b0a0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7ff17c001090 tx=0x7ff17c009040 comp rx=0 tx=0).stop 2024-09-17T05:42:22.288 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:22.286+0000 7ff191558640 1 -- 172.21.15.150:0/4166160474 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff18c166be0 msgr2=0x7ff18c165f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:22.288 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:22.286+0000 7ff191558640 1 --2- 172.21.15.150:0/4166160474 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff18c166be0 0x7ff18c165f20 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7ff18400c6b0 tx=0x7ff18400cb70 comp rx=0 tx=0).stop 2024-09-17T05:42:22.288 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:22.286+0000 7ff191558640 1 -- 172.21.15.150:0/4166160474 shutdown_connections 2024-09-17T05:42:22.288 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:22.286+0000 7ff191558640 1 --2- 172.21.15.150:0/4166160474 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7ff16c078b90 0x7ff16c07b0a0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:22.288 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:22.286+0000 7ff191558640 1 --2- 172.21.15.150:0/4166160474 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff18c166be0 0x7ff18c165f20 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:22.288 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:22.286+0000 7ff191558640 1 --2- 172.21.15.150:0/4166160474 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff18c0d2370 0x7ff18c1659e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:22.288 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:22.286+0000 7ff191558640 1 --2- 172.21.15.150:0/4166160474 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff18c0b3ae0 0x7ff18c1527d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:22.289 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:22.286+0000 7ff191558640 1 -- 172.21.15.150:0/4166160474 >> 172.21.15.150:0/4166160474 conn(0x7ff18c0d4680 msgr2=0x7ff18c0b8dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:42:22.289 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:22.286+0000 7ff191558640 1 -- 172.21.15.150:0/4166160474 shutdown_connections 2024-09-17T05:42:22.289 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:22.286+0000 7ff191558640 1 -- 172.21.15.150:0/4166160474 wait complete. 2024-09-17T05:42:22.299 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-09-17T05:42:22.416 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:22.415+0000 7fabbc4d5640 1 -- 172.21.15.150:0/1705986594 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fab9c003a50 msgr2=0x7fab9c003ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:22.417 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:22.415+0000 7fabbc4d5640 1 --2- 172.21.15.150:0/1705986594 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fab9c003a50 0x7fab9c003ec0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7faba4005fd0 tx=0x7fab9c005830 comp rx=0 tx=0).stop 2024-09-17T05:42:22.417 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:22.415+0000 7fabbaa72640 1 -- 172.21.15.150:0/1705986594 reap_dead start 2024-09-17T05:42:22.417 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:22.415+0000 7fabbc4d5640 1 -- 172.21.15.150:0/1705986594 shutdown_connections 2024-09-17T05:42:22.417 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:22.415+0000 7fabbc4d5640 1 -- 172.21.15.150:0/1705986594 >> 172.21.15.150:0/1705986594 conn(0x7fabb40cef20 msgr2=0x7fabb40cf330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:42:22.417 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:22.415+0000 7fabbc4d5640 1 -- 172.21.15.150:0/1705986594 shutdown_connections 2024-09-17T05:42:22.417 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:22.415+0000 7fabbc4d5640 1 -- 172.21.15.150:0/1705986594 wait complete. 2024-09-17T05:42:22.418 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:22.416+0000 7fabbc4d5640 1 Processor -- start 2024-09-17T05:42:22.418 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:22.416+0000 7fabbc4d5640 1 -- start start 2024-09-17T05:42:22.420 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:22.418+0000 7fabbc4d5640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fab9c003a50 0x7fabb41f70e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:42:22.420 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:22.418+0000 7fabbc4d5640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fabb40cc370 0x7fabb415eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:42:22.420 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:22.418+0000 7fabbc4d5640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fabb4154010 0x7fabb415f770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:42:22.420 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:22.418+0000 7fabbc4d5640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7fabb40ced10 con 0x7fabb4154010 2024-09-17T05:42:22.421 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:22.418+0000 7fabbc4d5640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fabb40ceb90 con 0x7fab9c003a50 2024-09-17T05:42:22.421 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:22.418+0000 7fabbc4d5640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fabb40af1f0 con 0x7fabb40cc370 2024-09-17T05:42:22.421 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:22.418+0000 7fabbaa72640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fabb4154010 0x7fabb415f770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:42:22.421 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:22.418+0000 7fabbaa72640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fabb4154010 0x7fabb415f770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:35576/0 (socket says 172.21.15.150:35576) 2024-09-17T05:42:22.421 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:22.418+0000 7fabbaa72640 1 -- 172.21.15.150:0/1568822890 learned_addr learned my addr 172.21.15.150:0/1568822890 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:42:22.421 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:22.418+0000 7fabba271640 1 --2- 172.21.15.150:0/1568822890 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fab9c003a50 0x7fabb41f70e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:42:22.421 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:22.418+0000 7fabb9a70640 1 --2- 172.21.15.150:0/1568822890 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fabb40cc370 0x7fabb415eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:42:22.421 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:22.418+0000 7fabbaa72640 1 -- 172.21.15.150:0/1568822890 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fabb40cc370 msgr2=0x7fabb415eb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:22.421 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:22.418+0000 7fabbaa72640 1 --2- 172.21.15.150:0/1568822890 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fabb40cc370 0x7fabb415eb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:22.421 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:22.418+0000 7fabbaa72640 1 -- 172.21.15.150:0/1568822890 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fab9c003a50 msgr2=0x7fabb41f70e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:22.421 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:22.418+0000 7fabbaa72640 1 --2- 172.21.15.150:0/1568822890 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fab9c003a50 0x7fabb41f70e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:22.421 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:22.418+0000 7fabbaa72640 1 -- 172.21.15.150:0/1568822890 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fabb41f7620 con 0x7fabb4154010 2024-09-17T05:42:22.422 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:22.418+0000 7fabbaa72640 1 --2- 172.21.15.150:0/1568822890 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fabb4154010 0x7fabb415f770 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fabb40cfdb0 tx=0x7fabac0039c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:42:22.422 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:22.418+0000 7fabb2ffd640 1 -- 172.21.15.150:0/1568822890 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fabac011840 con 0x7fabb4154010 2024-09-17T05:42:22.422 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:22.418+0000 7fabb2ffd640 1 -- 172.21.15.150:0/1568822890 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fabac018070 con 0x7fabb4154010 2024-09-17T05:42:22.422 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:22.418+0000 7fabb2ffd640 1 -- 172.21.15.150:0/1568822890 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fabac011c80 con 0x7fabb4154010 2024-09-17T05:42:22.422 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:22.419+0000 7fabbc4d5640 1 -- 172.21.15.150:0/1568822890 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fabb415da90 con 0x7fabb4154010 2024-09-17T05:42:22.422 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:22.419+0000 7fabbc4d5640 1 -- 172.21.15.150:0/1568822890 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fabb415e050 con 0x7fabb4154010 2024-09-17T05:42:22.423 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:22.420+0000 7fabbc4d5640 1 -- 172.21.15.150:0/1568822890 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fabb40d0a80 con 0x7fabb4154010 2024-09-17T05:42:22.423 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:22.420+0000 7fabb2ffd640 1 -- 172.21.15.150:0/1568822890 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fabac01d460 con 0x7fabb4154010 2024-09-17T05:42:22.423 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:22.421+0000 7fabb2ffd640 1 --2- 172.21.15.150:0/1568822890 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7faba0078b90 0x7faba007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:42:22.423 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:22.421+0000 7fabb2ffd640 1 -- 172.21.15.150:0/1568822890 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7fabac09b280 con 0x7fabb4154010 2024-09-17T05:42:22.423 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:22.421+0000 7fabba271640 1 --2- 172.21.15.150:0/1568822890 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7faba0078b90 0x7faba007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:42:22.423 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:22.422+0000 7fabba271640 1 --2- 172.21.15.150:0/1568822890 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7faba0078b90 0x7faba007b0a0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7faba4036000 tx=0x7faba4004a40 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:42:22.427 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:22.426+0000 7fabb2ffd640 1 -- 172.21.15.150:0/1568822890 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fabb41f7620 con 0x7fabb4154010 2024-09-17T05:42:22.602 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:22.601+0000 7fabbc4d5640 1 -- 172.21.15.150:0/1568822890 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7fabb415d820 con 0x7fabb4154010 2024-09-17T05:42:22.603 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:22.601+0000 7fabb2ffd640 1 -- 172.21.15.150:0/1568822890 <== mon.0 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v23) ==== 100+0+11 (secure 0 0 0) 0x7fabac011e20 con 0x7fabb4154010 2024-09-17T05:42:22.603 INFO:teuthology.orchestra.run.smithi150.stdout:pg_num: 64 2024-09-17T05:42:22.605 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:22.603+0000 7fabbc4d5640 1 -- 172.21.15.150:0/1568822890 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7faba0078b90 msgr2=0x7faba007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:22.605 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:22.603+0000 7fabbc4d5640 1 --2- 172.21.15.150:0/1568822890 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7faba0078b90 0x7faba007b0a0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7faba4036000 tx=0x7faba4004a40 comp rx=0 tx=0).stop 2024-09-17T05:42:22.605 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:22.603+0000 7fabbc4d5640 1 -- 172.21.15.150:0/1568822890 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fabb4154010 msgr2=0x7fabb415f770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:22.605 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:22.603+0000 7fabbc4d5640 1 --2- 172.21.15.150:0/1568822890 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fabb4154010 0x7fabb415f770 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fabb40cfdb0 tx=0x7fabac0039c0 comp rx=0 tx=0).stop 2024-09-17T05:42:22.606 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:22.604+0000 7fabbc4d5640 1 -- 172.21.15.150:0/1568822890 shutdown_connections 2024-09-17T05:42:22.606 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:22.604+0000 7fabbc4d5640 1 --2- 172.21.15.150:0/1568822890 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7faba0078b90 0x7faba007b0a0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:22.606 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:22.604+0000 7fabbc4d5640 1 --2- 172.21.15.150:0/1568822890 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fabb4154010 0x7fabb415f770 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:22.606 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:22.604+0000 7fabbc4d5640 1 --2- 172.21.15.150:0/1568822890 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fabb40cc370 0x7fabb415eb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:22.606 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:22.604+0000 7fabbc4d5640 1 --2- 172.21.15.150:0/1568822890 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fab9c003a50 0x7fabb41f70e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:22.606 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:22.604+0000 7fabbc4d5640 1 -- 172.21.15.150:0/1568822890 >> 172.21.15.150:0/1568822890 conn(0x7fabb40cef20 msgr2=0x7fabb40b1c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:42:22.606 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:22.604+0000 7fabbc4d5640 1 -- 172.21.15.150:0/1568822890 shutdown_connections 2024-09-17T05:42:22.606 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:22.604+0000 7fabbc4d5640 1 -- 172.21.15.150:0/1568822890 wait complete. 2024-09-17T05:42:22.617 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_volumes.TestCloneProgressReporter.test_clone_to_diff_group_and_less_than_cloner_threads' 2024-09-17T05:42:22.731 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:22.729+0000 7f84bc152640 1 -- 172.21.15.150:0/1988042049 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f84b41528b0 msgr2=0x7f84b415fa40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:22.731 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:22.729+0000 7f84bc152640 1 --2- 172.21.15.150:0/1988042049 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f84b41528b0 0x7f84b415fa40 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f84b40b07c0 tx=0x7f84a402a5f0 comp rx=0 tx=0).stop 2024-09-17T05:42:22.731 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:22.729+0000 7f84bc152640 1 -- 172.21.15.150:0/1988042049 shutdown_connections 2024-09-17T05:42:22.731 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:22.729+0000 7f84bc152640 1 --2- 172.21.15.150:0/1988042049 >> v2:172.21.15.176:3300/0 conn(0x7f84b40705b0 0x7f84b40709c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:22.731 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:22.729+0000 7f84bc152640 1 --2- 172.21.15.150:0/1988042049 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f84b41528b0 0x7f84b415fa40 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:22.731 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:22.729+0000 7f84bc152640 1 -- 172.21.15.150:0/1988042049 >> 172.21.15.150:0/1988042049 conn(0x7f84b40d0b50 msgr2=0x7f84b40d0f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:42:22.731 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:22.729+0000 7f84bc152640 1 -- 172.21.15.150:0/1988042049 shutdown_connections 2024-09-17T05:42:22.731 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:22.729+0000 7f84bc152640 1 -- 172.21.15.150:0/1988042049 wait complete. 2024-09-17T05:42:22.732 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:22.731+0000 7f84bc152640 1 Processor -- start 2024-09-17T05:42:22.732 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:22.731+0000 7f84bc152640 1 -- start start 2024-09-17T05:42:22.735 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:22.732+0000 7f84bc152640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f84b40705b0 0x7f84b4138610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:42:22.735 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:22.732+0000 7f84bc152640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f84b40cd040 0x7f84b4151cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:42:22.735 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:22.732+0000 7f84bc152640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f84b41528b0 0x7f84b4145550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:42:22.735 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:22.732+0000 7f84bc152640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f84b4071290 con 0x7f84b40705b0 2024-09-17T05:42:22.735 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:22.732+0000 7f84bc152640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f84b4071110 con 0x7f84b41528b0 2024-09-17T05:42:22.735 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:22.732+0000 7f84bc152640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f84b4071410 con 0x7f84b40cd040 2024-09-17T05:42:22.735 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:22.732+0000 7f84b9eee640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f84b40705b0 0x7f84b4138610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:42:22.735 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:22.732+0000 7f84b9eee640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f84b40705b0 0x7f84b4138610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:35598/0 (socket says 172.21.15.150:35598) 2024-09-17T05:42:22.736 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:22.732+0000 7f84b9eee640 1 -- 172.21.15.150:0/2661642524 learned_addr learned my addr 172.21.15.150:0/2661642524 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:42:22.736 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:22.733+0000 7f84ba6ef640 1 --2- 172.21.15.150:0/2661642524 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f84b41528b0 0x7f84b4145550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:42:22.736 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:22.733+0000 7f84b96ed640 1 --2- 172.21.15.150:0/2661642524 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f84b40cd040 0x7f84b4151cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:42:22.736 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:22.733+0000 7f84b9eee640 1 -- 172.21.15.150:0/2661642524 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f84b40cd040 msgr2=0x7f84b4151cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:22.736 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:22.733+0000 7f84b9eee640 1 --2- 172.21.15.150:0/2661642524 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f84b40cd040 0x7f84b4151cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:22.736 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:22.733+0000 7f84b9eee640 1 -- 172.21.15.150:0/2661642524 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f84b41528b0 msgr2=0x7f84b4145550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:22.736 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:22.733+0000 7f84b9eee640 1 --2- 172.21.15.150:0/2661642524 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f84b41528b0 0x7f84b4145550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:22.736 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:22.733+0000 7f84b9eee640 1 -- 172.21.15.150:0/2661642524 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f84b4147190 con 0x7f84b40705b0 2024-09-17T05:42:22.736 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:22.733+0000 7f84b96ed640 1 --2- 172.21.15.150:0/2661642524 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f84b40cd040 0x7f84b4151cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:42:22.736 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:22.733+0000 7f84ba6ef640 1 --2- 172.21.15.150:0/2661642524 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f84b41528b0 0x7f84b4145550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:42:22.736 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:22.733+0000 7f84b9eee640 1 --2- 172.21.15.150:0/2661642524 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f84b40705b0 0x7f84b4138610 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f84b000c7a0 tx=0x7f84b000cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:42:22.736 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:22.733+0000 7f84aa7fc640 1 -- 172.21.15.150:0/2661642524 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84b0016020 con 0x7f84b40705b0 2024-09-17T05:42:22.736 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:22.733+0000 7f84aa7fc640 1 -- 172.21.15.150:0/2661642524 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f84b0006e40 con 0x7f84b40705b0 2024-09-17T05:42:22.737 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:22.733+0000 7f84bc152640 1 -- 172.21.15.150:0/2661642524 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f84b4138e60 con 0x7f84b40705b0 2024-09-17T05:42:22.737 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:22.733+0000 7f84aa7fc640 1 -- 172.21.15.150:0/2661642524 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84b0003bd0 con 0x7f84b40705b0 2024-09-17T05:42:22.737 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:22.733+0000 7f84bc152640 1 -- 172.21.15.150:0/2661642524 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f84b4139420 con 0x7f84b40705b0 2024-09-17T05:42:22.738 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:22.734+0000 7f84bc152640 1 -- 172.21.15.150:0/2661642524 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f84b4071930 con 0x7f84b40705b0 2024-09-17T05:42:22.738 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:22.735+0000 7f84aa7fc640 1 -- 172.21.15.150:0/2661642524 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f84b000a850 con 0x7f84b40705b0 2024-09-17T05:42:22.738 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:22.735+0000 7f84aa7fc640 1 --2- 172.21.15.150:0/2661642524 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f8498078bc0 0x7f849807b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:42:22.738 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:22.735+0000 7f84aa7fc640 1 -- 172.21.15.150:0/2661642524 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f84b009aa30 con 0x7f84b40705b0 2024-09-17T05:42:22.738 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:22.736+0000 7f84b96ed640 1 --2- 172.21.15.150:0/2661642524 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f8498078bc0 0x7f849807b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:42:22.738 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:22.736+0000 7f84b96ed640 1 --2- 172.21.15.150:0/2661642524 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f8498078bc0 0x7f849807b0d0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f84a4033000 tx=0x7f84a4004730 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:42:22.741 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:22.740+0000 7f84aa7fc640 1 -- 172.21.15.150:0/2661642524 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f84b0020020 con 0x7f84b40705b0 2024-09-17T05:42:22.985 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:22.983+0000 7f84bc152640 1 -- 172.21.15.150:0/2661642524 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_volumes.TestCloneProgressReporter.test_clone_to_diff_group_and_less_than_cloner_threads"]} v 0) -- 0x7f84b4075d20 con 0x7f84b40705b0 2024-09-17T05:42:23.007 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:23.006+0000 7f84aa7fc640 1 -- 172.21.15.150:0/2661642524 <== mon.0 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_volumes.TestCloneProgressReporter.test_clone_to_diff_group_and_less_than_cloner_threads"]}]=0 v45) ==== 187+0+0 (secure 0 0 0) 0x7f84b0003d70 con 0x7f84b40705b0 2024-09-17T05:42:23.010 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:23.008+0000 7f84bc152640 1 -- 172.21.15.150:0/2661642524 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f8498078bc0 msgr2=0x7f849807b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:23.010 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:23.008+0000 7f84bc152640 1 --2- 172.21.15.150:0/2661642524 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f8498078bc0 0x7f849807b0d0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f84a4033000 tx=0x7f84a4004730 comp rx=0 tx=0).stop 2024-09-17T05:42:23.010 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:23.008+0000 7f84bc152640 1 -- 172.21.15.150:0/2661642524 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f84b40705b0 msgr2=0x7f84b4138610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:23.010 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:23.008+0000 7f84bc152640 1 --2- 172.21.15.150:0/2661642524 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f84b40705b0 0x7f84b4138610 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f84b000c7a0 tx=0x7f84b000cc60 comp rx=0 tx=0).stop 2024-09-17T05:42:23.010 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:23.008+0000 7f84bc152640 1 -- 172.21.15.150:0/2661642524 shutdown_connections 2024-09-17T05:42:23.010 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:23.008+0000 7f84bc152640 1 --2- 172.21.15.150:0/2661642524 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f84b41528b0 0x7f84b4145550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:23.010 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:23.008+0000 7f84bc152640 1 --2- 172.21.15.150:0/2661642524 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f8498078bc0 0x7f849807b0d0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:23.010 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:23.008+0000 7f84bc152640 1 --2- 172.21.15.150:0/2661642524 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f84b40cd040 0x7f84b4151cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:23.010 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:23.008+0000 7f84bc152640 1 --2- 172.21.15.150:0/2661642524 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f84b40705b0 0x7f84b4138610 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:23.011 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:23.008+0000 7f84bc152640 1 -- 172.21.15.150:0/2661642524 >> 172.21.15.150:0/2661642524 conn(0x7f84b40d0b50 msgr2=0x7f84b415c610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:42:23.011 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:23.008+0000 7f84bc152640 1 -- 172.21.15.150:0/2661642524 shutdown_connections 2024-09-17T05:42:23.011 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:23.008+0000 7f84bc152640 1 -- 172.21.15.150:0/2661642524 wait complete. 2024-09-17T05:42:23.021 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config dump 2024-09-17T05:42:23.135 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:23.134+0000 7f8db4b9d640 1 -- 172.21.15.150:0/1784202726 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8db00b3160 msgr2=0x7f8db00d24a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:23.136 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:23.134+0000 7f8db4b9d640 1 --2- 172.21.15.150:0/1784202726 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8db00b3160 0x7f8db00d24a0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f8da4005fd0 tx=0x7f8da402a4a0 comp rx=0 tx=0).stop 2024-09-17T05:42:23.136 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:23.134+0000 7f8db4b9d640 1 -- 172.21.15.150:0/1784202726 shutdown_connections 2024-09-17T05:42:23.137 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:23.134+0000 7f8db4b9d640 1 --2- 172.21.15.150:0/1784202726 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8db00d29e0 0x7f8db00d1580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:23.137 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:23.134+0000 7f8db4b9d640 1 --2- 172.21.15.150:0/1784202726 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8db00b3160 0x7f8db00d24a0 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:23.137 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:23.134+0000 7f8db4b9d640 1 -- 172.21.15.150:0/1784202726 >> 172.21.15.150:0/1784202726 conn(0x7f8db008bfe0 msgr2=0x7f8db009d7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:42:23.137 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:23.134+0000 7f8db4b9d640 1 -- 172.21.15.150:0/1784202726 shutdown_connections 2024-09-17T05:42:23.137 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:23.134+0000 7f8db4b9d640 1 -- 172.21.15.150:0/1784202726 wait complete. 2024-09-17T05:42:23.137 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:23.135+0000 7f8db4b9d640 1 Processor -- start 2024-09-17T05:42:23.137 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:23.136+0000 7f8db4b9d640 1 -- start start 2024-09-17T05:42:23.140 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:23.137+0000 7f8db4b9d640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8db00b3160 0x7f8db01f9890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:42:23.140 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:23.137+0000 7f8db4b9d640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8db00b9e00 0x7f8db01f51e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:42:23.140 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:23.137+0000 7f8db4b9d640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8db00d29e0 0x7f8db01607b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:42:23.140 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:23.137+0000 7f8db4b9d640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f8db00d44b0 con 0x7f8db00d29e0 2024-09-17T05:42:23.140 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:23.137+0000 7f8db4b9d640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f8db00d4330 con 0x7f8db00b9e00 2024-09-17T05:42:23.140 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:23.137+0000 7f8db4b9d640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f8db00d4630 con 0x7f8db00b3160 2024-09-17T05:42:23.140 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:23.137+0000 7f8daffff640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8db00d29e0 0x7f8db01607b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:42:23.140 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:23.137+0000 7f8daffff640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8db00d29e0 0x7f8db01607b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:35620/0 (socket says 172.21.15.150:35620) 2024-09-17T05:42:23.141 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:23.137+0000 7f8daffff640 1 -- 172.21.15.150:0/2376952280 learned_addr learned my addr 172.21.15.150:0/2376952280 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:42:23.141 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:23.137+0000 7f8daf7fe640 1 --2- 172.21.15.150:0/2376952280 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8db00b3160 0x7f8db01f9890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:42:23.141 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:23.137+0000 7f8daeffd640 1 --2- 172.21.15.150:0/2376952280 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8db00b9e00 0x7f8db01f51e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:42:23.141 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:23.137+0000 7f8daffff640 1 -- 172.21.15.150:0/2376952280 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8db00b3160 msgr2=0x7f8db01f9890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:23.141 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:23.137+0000 7f8daffff640 1 --2- 172.21.15.150:0/2376952280 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8db00b3160 0x7f8db01f9890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:23.141 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:23.137+0000 7f8daffff640 1 -- 172.21.15.150:0/2376952280 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8db00b9e00 msgr2=0x7f8db01f51e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:23.141 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:23.137+0000 7f8daffff640 1 --2- 172.21.15.150:0/2376952280 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8db00b9e00 0x7f8db01f51e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:23.141 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:23.137+0000 7f8daffff640 1 -- 172.21.15.150:0/2376952280 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8db01e9320 con 0x7f8db00d29e0 2024-09-17T05:42:23.141 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:23.137+0000 7f8daeffd640 1 --2- 172.21.15.150:0/2376952280 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8db00b9e00 0x7f8db01f51e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:42:23.141 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:23.138+0000 7f8daffff640 1 --2- 172.21.15.150:0/2376952280 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8db00d29e0 0x7f8db01607b0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f8da800cae0 tx=0x7f8da80071c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:42:23.141 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:23.138+0000 7f8d97fff640 1 -- 172.21.15.150:0/2376952280 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8da8007da0 con 0x7f8db00d29e0 2024-09-17T05:42:23.141 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:23.138+0000 7f8d97fff640 1 -- 172.21.15.150:0/2376952280 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8da8003990 con 0x7f8db00d29e0 2024-09-17T05:42:23.141 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:23.138+0000 7f8db4b9d640 1 -- 172.21.15.150:0/2376952280 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8db01f5b30 con 0x7f8db00d29e0 2024-09-17T05:42:23.142 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:23.138+0000 7f8d97fff640 1 -- 172.21.15.150:0/2376952280 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8da8003e00 con 0x7f8db00d29e0 2024-09-17T05:42:23.142 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:23.138+0000 7f8db4b9d640 1 -- 172.21.15.150:0/2376952280 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8db01f60f0 con 0x7f8db00d29e0 2024-09-17T05:42:23.142 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:23.139+0000 7f8db4b9d640 1 -- 172.21.15.150:0/2376952280 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8db014d990 con 0x7f8db00d29e0 2024-09-17T05:42:23.142 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:23.140+0000 7f8d97fff640 1 -- 172.21.15.150:0/2376952280 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f8da8004030 con 0x7f8db00d29e0 2024-09-17T05:42:23.143 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:23.140+0000 7f8d97fff640 1 --2- 172.21.15.150:0/2376952280 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f8d9c078b90 0x7f8d9c07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:42:23.143 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:23.140+0000 7f8d97fff640 1 -- 172.21.15.150:0/2376952280 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f8da809b320 con 0x7f8db00d29e0 2024-09-17T05:42:23.143 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:23.141+0000 7f8daf7fe640 1 --2- 172.21.15.150:0/2376952280 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f8d9c078b90 0x7f8d9c07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:42:23.143 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:23.141+0000 7f8daf7fe640 1 --2- 172.21.15.150:0/2376952280 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f8d9c078b90 0x7f8d9c07b0a0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f8da0006fd0 tx=0x7f8da0009060 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:42:23.146 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:23.145+0000 7f8d97fff640 1 -- 172.21.15.150:0/2376952280 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f8da8014070 con 0x7f8db00d29e0 2024-09-17T05:42:23.319 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:23.318+0000 7f8db4b9d640 1 -- 172.21.15.150:0/2376952280 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "config dump"} v 0) -- 0x7f8db00d4b20 con 0x7f8db00d29e0 2024-09-17T05:42:23.320 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:23.318+0000 7f8d97fff640 1 -- 172.21.15.150:0/2376952280 <== mon.0 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "config dump"}]=0 v31) ==== 59+0+2294 (secure 0 0 0) 0x7f8da8063230 con 0x7f8db00d29e0 2024-09-17T05:42:23.320 INFO:teuthology.orchestra.run.smithi150.stdout:WHO MASK LEVEL OPTION VALUE RO 2024-09-17T05:42:23.320 INFO:teuthology.orchestra.run.smithi150.stdout:mon advanced mon_op_complaint_time 120 2024-09-17T05:42:23.320 INFO:teuthology.orchestra.run.smithi150.stdout:mgr advanced client_mount_timeout 30 2024-09-17T05:42:23.320 INFO:teuthology.orchestra.run.smithi150.stdout:mgr advanced debug_client 20/20 2024-09-17T05:42:23.320 INFO:teuthology.orchestra.run.smithi150.stdout:mgr advanced debug_mgr 20/20 2024-09-17T05:42:23.320 INFO:teuthology.orchestra.run.smithi150.stdout:mgr advanced debug_ms 1/1 2024-09-17T05:42:23.320 INFO:teuthology.orchestra.run.smithi150.stdout:mgr dev mon_warn_on_pool_no_app false 2024-09-17T05:42:23.321 INFO:teuthology.orchestra.run.smithi150.stdout:osd advanced osd_op_complaint_time 180.000000 2024-09-17T05:42:23.321 INFO:teuthology.orchestra.run.smithi150.stdout:osd.0 basic osd_mclock_max_capacity_iops_ssd 6764.239331 2024-09-17T05:42:23.321 INFO:teuthology.orchestra.run.smithi150.stdout:osd.1 basic osd_mclock_max_capacity_iops_ssd 4956.769289 2024-09-17T05:42:23.321 INFO:teuthology.orchestra.run.smithi150.stdout:osd.2 basic osd_mclock_max_capacity_iops_ssd 5099.704467 2024-09-17T05:42:23.321 INFO:teuthology.orchestra.run.smithi150.stdout:osd.3 basic osd_mclock_max_capacity_iops_ssd 4681.616196 2024-09-17T05:42:23.321 INFO:teuthology.orchestra.run.smithi150.stdout:osd.4 basic osd_mclock_max_capacity_iops_ssd 4723.364425 2024-09-17T05:42:23.321 INFO:teuthology.orchestra.run.smithi150.stdout:osd.5 basic osd_mclock_max_capacity_iops_ssd 4509.722124 2024-09-17T05:42:23.321 INFO:teuthology.orchestra.run.smithi150.stdout:osd.6 basic osd_mclock_max_capacity_iops_ssd 6380.664158 2024-09-17T05:42:23.321 INFO:teuthology.orchestra.run.smithi150.stdout:osd.7 basic osd_mclock_max_capacity_iops_ssd 4303.333825 2024-09-17T05:42:23.321 INFO:teuthology.orchestra.run.smithi150.stdout:mds advanced debug_mds 20/20 2024-09-17T05:42:23.321 INFO:teuthology.orchestra.run.smithi150.stdout:mds advanced debug_mds_balancer 20/20 2024-09-17T05:42:23.321 INFO:teuthology.orchestra.run.smithi150.stdout:mds advanced debug_ms 2/2 2024-09-17T05:42:23.322 INFO:teuthology.orchestra.run.smithi150.stdout:mds dev mds_debug_frag true 2024-09-17T05:42:23.322 INFO:teuthology.orchestra.run.smithi150.stdout:mds dev mds_debug_scatterstat true 2024-09-17T05:42:23.322 INFO:teuthology.orchestra.run.smithi150.stdout:mds advanced mds_op_complaint_time 180.000000 2024-09-17T05:42:23.322 INFO:teuthology.orchestra.run.smithi150.stdout:mds dev mds_verify_scatter true 2024-09-17T05:42:23.322 INFO:teuthology.orchestra.run.smithi150.stdout:mds advanced osd_op_complaint_time 180.000000 2024-09-17T05:42:23.322 INFO:teuthology.orchestra.run.smithi150.stdout:mds advanced rados_mon_op_timeout 900 2024-09-17T05:42:23.322 INFO:teuthology.orchestra.run.smithi150.stdout:mds advanced rados_osd_op_timeout 900 2024-09-17T05:42:23.322 INFO:teuthology.orchestra.run.smithi150.stdout:client advanced client_mount_timeout 600 2024-09-17T05:42:23.322 INFO:teuthology.orchestra.run.smithi150.stdout:client advanced debug_client 20/20 2024-09-17T05:42:23.322 INFO:teuthology.orchestra.run.smithi150.stdout:client advanced debug_ms 1/1 2024-09-17T05:42:23.322 INFO:teuthology.orchestra.run.smithi150.stdout:client advanced rados_mon_op_timeout 900 2024-09-17T05:42:23.322 INFO:teuthology.orchestra.run.smithi150.stdout:client advanced rados_osd_op_timeout 900 2024-09-17T05:42:23.323 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:23.320+0000 7f8db4b9d640 1 -- 172.21.15.150:0/2376952280 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f8d9c078b90 msgr2=0x7f8d9c07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:23.323 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:23.320+0000 7f8db4b9d640 1 --2- 172.21.15.150:0/2376952280 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f8d9c078b90 0x7f8d9c07b0a0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f8da0006fd0 tx=0x7f8da0009060 comp rx=0 tx=0).stop 2024-09-17T05:42:23.323 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:23.320+0000 7f8db4b9d640 1 -- 172.21.15.150:0/2376952280 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8db00d29e0 msgr2=0x7f8db01607b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:23.323 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:23.320+0000 7f8db4b9d640 1 --2- 172.21.15.150:0/2376952280 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8db00d29e0 0x7f8db01607b0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f8da800cae0 tx=0x7f8da80071c0 comp rx=0 tx=0).stop 2024-09-17T05:42:23.324 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:23.320+0000 7f8db4b9d640 1 -- 172.21.15.150:0/2376952280 shutdown_connections 2024-09-17T05:42:23.324 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:23.320+0000 7f8db4b9d640 1 --2- 172.21.15.150:0/2376952280 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8db00b9e00 0x7f8db01f51e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:23.324 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:23.320+0000 7f8db4b9d640 1 --2- 172.21.15.150:0/2376952280 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f8d9c078b90 0x7f8d9c07b0a0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:23.324 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:23.320+0000 7f8db4b9d640 1 --2- 172.21.15.150:0/2376952280 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8db00d29e0 0x7f8db01607b0 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:23.324 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:23.320+0000 7f8db4b9d640 1 --2- 172.21.15.150:0/2376952280 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8db00b3160 0x7f8db01f9890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:23.324 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:23.320+0000 7f8db4b9d640 1 -- 172.21.15.150:0/2376952280 >> 172.21.15.150:0/2376952280 conn(0x7f8db008bfe0 msgr2=0x7f8db00cf2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:42:23.324 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:23.320+0000 7f8db4b9d640 1 -- 172.21.15.150:0/2376952280 shutdown_connections 2024-09-17T05:42:23.324 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:23.320+0000 7f8db4b9d640 1 -- 172.21.15.150:0/2376952280 wait complete. 2024-09-17T05:42:23.333 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-09-17T05:42:23.451 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:23.449+0000 7fec1db13640 1 -- 172.21.15.150:0/1442844938 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fec00003a50 msgr2=0x7fec00003ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:23.451 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:23.449+0000 7fec1db13640 1 --2- 172.21.15.150:0/1442844938 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fec00003a50 0x7fec00003ec0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fec08001dc0 tx=0x7fec00005830 comp rx=0 tx=0).stop 2024-09-17T05:42:23.452 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:23.449+0000 7fec1db13640 1 -- 172.21.15.150:0/1442844938 shutdown_connections 2024-09-17T05:42:23.452 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:23.449+0000 7fec1db13640 1 --2- 172.21.15.150:0/1442844938 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fec00003a50 0x7fec00003ec0 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:23.452 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:23.449+0000 7fec1db13640 1 -- 172.21.15.150:0/1442844938 >> 172.21.15.150:0/1442844938 conn(0x7fec18073920 msgr2=0x7fec18073d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:42:23.452 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:23.450+0000 7fec1db13640 1 -- 172.21.15.150:0/1442844938 shutdown_connections 2024-09-17T05:42:23.452 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:23.450+0000 7fec1db13640 1 -- 172.21.15.150:0/1442844938 wait complete. 2024-09-17T05:42:23.452 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:23.451+0000 7fec1db13640 1 Processor -- start 2024-09-17T05:42:23.453 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:23.451+0000 7fec1db13640 1 -- start start 2024-09-17T05:42:23.455 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:23.453+0000 7fec1db13640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fec00003a50 0x7fec18145ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:42:23.455 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:23.453+0000 7fec1db13640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fec1814fea0 0x7fec1814ec00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:42:23.455 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:23.453+0000 7fec1db13640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fec18146100 0x7fec1814f140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:42:23.455 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:23.453+0000 7fec1db13640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7fec180ce0a0 con 0x7fec00003a50 2024-09-17T05:42:23.456 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:23.453+0000 7fec1db13640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fec180cdf20 con 0x7fec1814fea0 2024-09-17T05:42:23.456 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:23.453+0000 7fec1db13640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fec180ce220 con 0x7fec18146100 2024-09-17T05:42:23.456 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:23.453+0000 7fec177fe640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fec00003a50 0x7fec18145ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:42:23.456 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:23.453+0000 7fec177fe640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fec00003a50 0x7fec18145ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:35624/0 (socket says 172.21.15.150:35624) 2024-09-17T05:42:23.456 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:23.453+0000 7fec177fe640 1 -- 172.21.15.150:0/2025730343 learned_addr learned my addr 172.21.15.150:0/2025730343 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:42:23.456 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:23.453+0000 7fec16ffd640 1 --2- 172.21.15.150:0/2025730343 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fec1814fea0 0x7fec1814ec00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:42:23.456 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:23.453+0000 7fec17fff640 1 --2- 172.21.15.150:0/2025730343 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fec18146100 0x7fec1814f140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:42:23.456 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:23.453+0000 7fec177fe640 1 -- 172.21.15.150:0/2025730343 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fec18146100 msgr2=0x7fec1814f140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:23.456 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:23.453+0000 7fec177fe640 1 --2- 172.21.15.150:0/2025730343 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fec18146100 0x7fec1814f140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:23.456 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:23.453+0000 7fec177fe640 1 -- 172.21.15.150:0/2025730343 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fec1814fea0 msgr2=0x7fec1814ec00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:23.456 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:23.453+0000 7fec177fe640 1 --2- 172.21.15.150:0/2025730343 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fec1814fea0 0x7fec1814ec00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:23.456 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:23.453+0000 7fec177fe640 1 -- 172.21.15.150:0/2025730343 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fec18150580 con 0x7fec00003a50 2024-09-17T05:42:23.457 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:23.453+0000 7fec177fe640 1 --2- 172.21.15.150:0/2025730343 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fec00003a50 0x7fec18145ba0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fec08001ee0 tx=0x7fec08003aa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:42:23.457 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:23.453+0000 7febfffff640 1 -- 172.21.15.150:0/2025730343 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec08006440 con 0x7fec00003a50 2024-09-17T05:42:23.457 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:23.454+0000 7febfffff640 1 -- 172.21.15.150:0/2025730343 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fec080065e0 con 0x7fec00003a50 2024-09-17T05:42:23.457 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:23.454+0000 7fec1db13640 1 -- 172.21.15.150:0/2025730343 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fec18150860 con 0x7fec00003a50 2024-09-17T05:42:23.457 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:23.454+0000 7febfffff640 1 -- 172.21.15.150:0/2025730343 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec08003e40 con 0x7fec00003a50 2024-09-17T05:42:23.457 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:23.454+0000 7fec1db13640 1 -- 172.21.15.150:0/2025730343 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fec18150e20 con 0x7fec00003a50 2024-09-17T05:42:23.458 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:23.455+0000 7fec1db13640 1 -- 172.21.15.150:0/2025730343 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fec1806df20 con 0x7fec00003a50 2024-09-17T05:42:23.458 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:23.455+0000 7febfffff640 1 -- 172.21.15.150:0/2025730343 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fec08033480 con 0x7fec00003a50 2024-09-17T05:42:23.458 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:23.456+0000 7febfffff640 1 --2- 172.21.15.150:0/2025730343 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fec04078b90 0x7fec0407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:42:23.458 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:23.456+0000 7febfffff640 1 -- 172.21.15.150:0/2025730343 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7fec080bafd0 con 0x7fec00003a50 2024-09-17T05:42:23.458 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:23.456+0000 7fec16ffd640 1 --2- 172.21.15.150:0/2025730343 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fec04078b90 0x7fec0407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:42:23.458 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:23.457+0000 7fec16ffd640 1 --2- 172.21.15.150:0/2025730343 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fec04078b90 0x7fec0407b0a0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fec181519b0 tx=0x7fec0c006040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:42:23.461 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:23.460+0000 7febfffff640 1 -- 172.21.15.150:0/2025730343 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fec08083560 con 0x7fec00003a50 2024-09-17T05:42:23.636 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:23.635+0000 7fec1db13640 1 -- 172.21.15.150:0/2025730343 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) -- 0x7fec18153160 con 0x7fec00003a50 2024-09-17T05:42:23.640 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:23.639+0000 7febfffff640 1 -- 172.21.15.150:0/2025730343 <== mon.0 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v32)=0 v32) ==== 122+0+0 (secure 0 0 0) 0x7fec08082e60 con 0x7fec00003a50 2024-09-17T05:42:23.643 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:23.641+0000 7fec1db13640 1 -- 172.21.15.150:0/2025730343 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fec04078b90 msgr2=0x7fec0407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:23.643 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:23.641+0000 7fec1db13640 1 --2- 172.21.15.150:0/2025730343 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fec04078b90 0x7fec0407b0a0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fec181519b0 tx=0x7fec0c006040 comp rx=0 tx=0).stop 2024-09-17T05:42:23.643 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:23.641+0000 7fec1db13640 1 -- 172.21.15.150:0/2025730343 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fec00003a50 msgr2=0x7fec18145ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:23.643 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:23.641+0000 7fec1db13640 1 --2- 172.21.15.150:0/2025730343 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fec00003a50 0x7fec18145ba0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fec08001ee0 tx=0x7fec08003aa0 comp rx=0 tx=0).stop 2024-09-17T05:42:23.643 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:23.641+0000 7fec1db13640 1 -- 172.21.15.150:0/2025730343 shutdown_connections 2024-09-17T05:42:23.643 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:23.641+0000 7fec1db13640 1 --2- 172.21.15.150:0/2025730343 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fec1814fea0 0x7fec1814ec00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:23.643 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:23.641+0000 7fec1db13640 1 --2- 172.21.15.150:0/2025730343 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fec04078b90 0x7fec0407b0a0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:23.643 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:23.641+0000 7fec1db13640 1 --2- 172.21.15.150:0/2025730343 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fec18146100 0x7fec1814f140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:23.643 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:23.641+0000 7fec1db13640 1 --2- 172.21.15.150:0/2025730343 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fec00003a50 0x7fec18145ba0 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:23.643 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:23.641+0000 7fec1db13640 1 -- 172.21.15.150:0/2025730343 >> 172.21.15.150:0/2025730343 conn(0x7fec18073920 msgr2=0x7fec18070a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:42:23.643 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:23.641+0000 7fec1db13640 1 -- 172.21.15.150:0/2025730343 shutdown_connections 2024-09-17T05:42:23.644 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:23.641+0000 7fec1db13640 1 -- 172.21.15.150:0/2025730343 wait complete. 2024-09-17T05:42:23.654 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-17T05:42:23.654 DEBUG:teuthology.orchestra.run.smithi150:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-17T05:42:23.693 DEBUG:teuthology.orchestra.run.smithi176:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-17T05:42:23.742 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-17T05:42:23.742 DEBUG:teuthology.orchestra.run.smithi150:> set -ex 2024-09-17T05:42:23.742 DEBUG:teuthology.orchestra.run.smithi150:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T05:42:23.757 DEBUG:teuthology.orchestra.run.smithi150:> set -ex 2024-09-17T05:42:23.758 DEBUG:teuthology.orchestra.run.smithi150:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T05:42:23.814 DEBUG:teuthology.orchestra.run.smithi150:> set -ex 2024-09-17T05:42:23.814 DEBUG:teuthology.orchestra.run.smithi150:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T05:42:23.869 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-17T05:42:23.906 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-17T05:42:23.913 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-17T05:42:24.026 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:24.024+0000 7f2d40cec640 1 -- 172.21.15.150:0/2593911824 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2d3c0cea50 msgr2=0x7f2d3c0d0270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:24.026 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:24.024+0000 7f2d40cec640 1 --2- 172.21.15.150:0/2593911824 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2d3c0cea50 0x7f2d3c0d0270 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f2d3c071280 tx=0x7f2d2c02a540 comp rx=0 tx=0).stop 2024-09-17T05:42:24.026 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:24.024+0000 7f2d40cec640 1 -- 172.21.15.150:0/2593911824 shutdown_connections 2024-09-17T05:42:24.026 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:24.024+0000 7f2d40cec640 1 --2- 172.21.15.150:0/2593911824 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2d3c160d90 0x7f2d3c1611a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:24.026 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:24.024+0000 7f2d40cec640 1 --2- 172.21.15.150:0/2593911824 >> v2:172.21.15.176:3300/0 conn(0x7f2d3c0c5a90 0x7f2d3c160850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:24.026 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:24.024+0000 7f2d40cec640 1 --2- 172.21.15.150:0/2593911824 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2d3c0cea50 0x7f2d3c0d0270 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:24.026 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:24.024+0000 7f2d40cec640 1 -- 172.21.15.150:0/2593911824 >> 172.21.15.150:0/2593911824 conn(0x7f2d3c0cee80 msgr2=0x7f2d3c0cf290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:42:24.026 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:24.024+0000 7f2d40cec640 1 -- 172.21.15.150:0/2593911824 shutdown_connections 2024-09-17T05:42:24.027 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:24.024+0000 7f2d40cec640 1 -- 172.21.15.150:0/2593911824 wait complete. 2024-09-17T05:42:24.027 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:24.026+0000 7f2d40cec640 1 Processor -- start 2024-09-17T05:42:24.027 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:24.026+0000 7f2d40cec640 1 -- start start 2024-09-17T05:42:24.030 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:24.027+0000 7f2d40cec640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2d3c0c5a90 0x7f2d3c1547c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:42:24.031 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:24.027+0000 7f2d40cec640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2d3c0cea50 0x7f2d3c0b19c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:42:24.031 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:24.027+0000 7f2d40cec640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2d3c160d90 0x7f2d3c0b1f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:42:24.031 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:24.027+0000 7f2d40cec640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f2d3c0b5250 con 0x7f2d3c0cea50 2024-09-17T05:42:24.031 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:24.027+0000 7f2d40cec640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f2d3c09bc70 con 0x7f2d3c160d90 2024-09-17T05:42:24.031 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:24.027+0000 7f2d40cec640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f2d3c0b53d0 con 0x7f2d3c0c5a90 2024-09-17T05:42:24.031 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:24.027+0000 7f2d39d9b640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2d3c0cea50 0x7f2d3c0b19c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:42:24.031 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:24.027+0000 7f2d39d9b640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2d3c0cea50 0x7f2d3c0b19c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:35644/0 (socket says 172.21.15.150:35644) 2024-09-17T05:42:24.031 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:24.027+0000 7f2d39d9b640 1 -- 172.21.15.150:0/2640951912 learned_addr learned my addr 172.21.15.150:0/2640951912 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:42:24.031 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:24.027+0000 7f2d3a59c640 1 --2- 172.21.15.150:0/2640951912 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2d3c0c5a90 0x7f2d3c1547c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:42:24.031 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:24.027+0000 7f2d3ad9d640 1 --2- 172.21.15.150:0/2640951912 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2d3c160d90 0x7f2d3c0b1f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:42:24.031 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:24.028+0000 7f2d39d9b640 1 -- 172.21.15.150:0/2640951912 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2d3c0c5a90 msgr2=0x7f2d3c1547c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:24.031 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:24.028+0000 7f2d39d9b640 1 --2- 172.21.15.150:0/2640951912 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2d3c0c5a90 0x7f2d3c1547c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:24.032 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:24.028+0000 7f2d39d9b640 1 -- 172.21.15.150:0/2640951912 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2d3c160d90 msgr2=0x7f2d3c0b1f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:24.032 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:24.028+0000 7f2d39d9b640 1 --2- 172.21.15.150:0/2640951912 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2d3c160d90 0x7f2d3c0b1f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:24.032 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:24.028+0000 7f2d39d9b640 1 -- 172.21.15.150:0/2640951912 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2d3c0b0270 con 0x7f2d3c0cea50 2024-09-17T05:42:24.032 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:24.028+0000 7f2d39d9b640 1 --2- 172.21.15.150:0/2640951912 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2d3c0cea50 0x7f2d3c0b19c0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f2d3000c970 tx=0x7f2d3000ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:42:24.032 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:24.028+0000 7f2d2affd640 1 -- 172.21.15.150:0/2640951912 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d30004230 con 0x7f2d3c0cea50 2024-09-17T05:42:24.032 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:24.028+0000 7f2d40cec640 1 -- 172.21.15.150:0/2640951912 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2d3c0b0550 con 0x7f2d3c0cea50 2024-09-17T05:42:24.032 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:24.028+0000 7f2d2affd640 1 -- 172.21.15.150:0/2640951912 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f2d300079b0 con 0x7f2d3c0cea50 2024-09-17T05:42:24.032 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:24.028+0000 7f2d2affd640 1 -- 172.21.15.150:0/2640951912 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d300044c0 con 0x7f2d3c0cea50 2024-09-17T05:42:24.032 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:24.028+0000 7f2d40cec640 1 -- 172.21.15.150:0/2640951912 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2d3c0b0b10 con 0x7f2d3c0cea50 2024-09-17T05:42:24.032 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:24.029+0000 7f2d40cec640 1 -- 172.21.15.150:0/2640951912 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2d3c0d0270 con 0x7f2d3c0cea50 2024-09-17T05:42:24.033 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:24.030+0000 7f2d2affd640 1 -- 172.21.15.150:0/2640951912 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f2d300035f0 con 0x7f2d3c0cea50 2024-09-17T05:42:24.033 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:24.030+0000 7f2d2affd640 1 --2- 172.21.15.150:0/2640951912 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f2d1c078b90 0x7f2d1c07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:42:24.033 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:24.030+0000 7f2d2affd640 1 -- 172.21.15.150:0/2640951912 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f2d3009b100 con 0x7f2d3c0cea50 2024-09-17T05:42:24.033 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:24.031+0000 7f2d3a59c640 1 --2- 172.21.15.150:0/2640951912 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f2d1c078b90 0x7f2d1c07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:42:24.033 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:24.031+0000 7f2d3a59c640 1 --2- 172.21.15.150:0/2640951912 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f2d1c078b90 0x7f2d1c07b0a0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f2d2c034000 tx=0x7f2d2c004730 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:42:24.037 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:24.035+0000 7f2d2affd640 1 -- 172.21.15.150:0/2640951912 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f2d30014070 con 0x7f2d3c0cea50 2024-09-17T05:42:24.223 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:24.222+0000 7f2d40cec640 1 -- 172.21.15.150:0/2640951912 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f2d3c0b24a0 con 0x7f2d3c0cea50 2024-09-17T05:42:24.224 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:24.223+0000 7f2d2affd640 1 -- 172.21.15.150:0/2640951912 <== mon.0 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v23) ==== 80+0+0 (secure 0 0 0) 0x7f2d30062f00 con 0x7f2d3c0cea50 2024-09-17T05:42:24.224 INFO:teuthology.orchestra.run.smithi150.stderr:listed 0 entries 2024-09-17T05:42:24.226 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:24.225+0000 7f2d40cec640 1 -- 172.21.15.150:0/2640951912 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f2d1c078b90 msgr2=0x7f2d1c07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:24.226 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:24.225+0000 7f2d40cec640 1 --2- 172.21.15.150:0/2640951912 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f2d1c078b90 0x7f2d1c07b0a0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f2d2c034000 tx=0x7f2d2c004730 comp rx=0 tx=0).stop 2024-09-17T05:42:24.226 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:24.225+0000 7f2d40cec640 1 -- 172.21.15.150:0/2640951912 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2d3c0cea50 msgr2=0x7f2d3c0b19c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:24.227 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:24.225+0000 7f2d40cec640 1 --2- 172.21.15.150:0/2640951912 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2d3c0cea50 0x7f2d3c0b19c0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f2d3000c970 tx=0x7f2d3000ce30 comp rx=0 tx=0).stop 2024-09-17T05:42:24.227 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:24.225+0000 7f2d40cec640 1 -- 172.21.15.150:0/2640951912 shutdown_connections 2024-09-17T05:42:24.227 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:24.225+0000 7f2d40cec640 1 --2- 172.21.15.150:0/2640951912 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2d3c160d90 0x7f2d3c0b1f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:24.227 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:24.225+0000 7f2d40cec640 1 --2- 172.21.15.150:0/2640951912 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f2d1c078b90 0x7f2d1c07b0a0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:24.227 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:24.225+0000 7f2d40cec640 1 --2- 172.21.15.150:0/2640951912 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2d3c0cea50 0x7f2d3c0b19c0 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:24.227 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:24.225+0000 7f2d40cec640 1 --2- 172.21.15.150:0/2640951912 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2d3c0c5a90 0x7f2d3c1547c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:24.227 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:24.225+0000 7f2d40cec640 1 -- 172.21.15.150:0/2640951912 >> 172.21.15.150:0/2640951912 conn(0x7f2d3c0cee80 msgr2=0x7f2d3c15c960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:42:24.227 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:24.225+0000 7f2d40cec640 1 -- 172.21.15.150:0/2640951912 shutdown_connections 2024-09-17T05:42:24.227 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:24.225+0000 7f2d40cec640 1 -- 172.21.15.150:0/2640951912 wait complete. 2024-09-17T05:42:24.238 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-09-17T05:42:24.238 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:42:24.238 DEBUG:teuthology.orchestra.run.smithi150:> sudo umount /home/ubuntu/cephtest/mnt.0 -f 2024-09-17T05:42:24.264 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi150.front.sepia.ceph.com 2024-09-17T05:42:24.264 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:42:24.264 DEBUG:teuthology.orchestra.run.smithi150:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-17T05:42:24.329 DEBUG:teuthology.orchestra.run.smithi176:> set -ex 2024-09-17T05:42:24.329 DEBUG:teuthology.orchestra.run.smithi176:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T05:42:24.348 DEBUG:teuthology.orchestra.run.smithi176:> set -ex 2024-09-17T05:42:24.349 DEBUG:teuthology.orchestra.run.smithi176:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T05:42:24.408 DEBUG:teuthology.orchestra.run.smithi176:> set -ex 2024-09-17T05:42:24.408 DEBUG:teuthology.orchestra.run.smithi176:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T05:42:24.471 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-17T05:42:24.591 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:24.590+0000 7f7e52038640 1 -- 172.21.15.150:0/1417759692 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7e4c0d15d0 msgr2=0x7f7e4c162a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:24.591 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:24.590+0000 7f7e52038640 1 --2- 172.21.15.150:0/1417759692 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7e4c0d15d0 0x7f7e4c162a60 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f7e4c0b7270 tx=0x7f7e4402a980 comp rx=0 tx=0).stop 2024-09-17T05:42:24.592 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:24.590+0000 7f7e52038640 1 -- 172.21.15.150:0/1417759692 shutdown_connections 2024-09-17T05:42:24.592 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:24.590+0000 7f7e52038640 1 --2- 172.21.15.150:0/1417759692 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7e4c0d15d0 0x7f7e4c162a60 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:24.592 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:24.590+0000 7f7e52038640 1 --2- 172.21.15.150:0/1417759692 >> v2:172.21.15.176:3300/0 conn(0x7f7e4c15ee50 0x7f7e4c0d1090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:24.592 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:24.590+0000 7f7e52038640 1 --2- 172.21.15.150:0/1417759692 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7e4c0b9780 0x7f7e4c0b3720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:24.592 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:24.590+0000 7f7e52038640 1 -- 172.21.15.150:0/1417759692 >> 172.21.15.150:0/1417759692 conn(0x7f7e4c0d4680 msgr2=0x7f7e4c0d4a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:42:24.592 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:24.590+0000 7f7e52038640 1 -- 172.21.15.150:0/1417759692 shutdown_connections 2024-09-17T05:42:24.592 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:24.590+0000 7f7e52038640 1 -- 172.21.15.150:0/1417759692 wait complete. 2024-09-17T05:42:24.592 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:24.591+0000 7f7e52038640 1 Processor -- start 2024-09-17T05:42:24.593 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:24.592+0000 7f7e52038640 1 -- start start 2024-09-17T05:42:24.595 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:24.593+0000 7f7e52038640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7e4c0b9780 0x7f7e4c15fd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:42:24.595 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:24.593+0000 7f7e52038640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7e4c0d15d0 0x7f7e4c0ce350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:42:24.595 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:24.593+0000 7f7e52038640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7e4c15ee50 0x7f7e4c0b62b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:42:24.595 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:24.593+0000 7f7e52038640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f7e4c163330 con 0x7f7e4c0b9780 2024-09-17T05:42:24.595 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:24.593+0000 7f7e52038640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f7e4c1631b0 con 0x7f7e4c15ee50 2024-09-17T05:42:24.596 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:24.593+0000 7f7e52038640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f7e4c1634b0 con 0x7f7e4c0d15d0 2024-09-17T05:42:24.596 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:24.593+0000 7f7e4b7fe640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7e4c0b9780 0x7f7e4c15fd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:42:24.596 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:24.593+0000 7f7e4b7fe640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7e4c0b9780 0x7f7e4c15fd60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:35658/0 (socket says 172.21.15.150:35658) 2024-09-17T05:42:24.596 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:24.593+0000 7f7e4b7fe640 1 -- 172.21.15.150:0/2819083077 learned_addr learned my addr 172.21.15.150:0/2819083077 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:42:24.596 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:24.593+0000 7f7e4bfff640 1 --2- 172.21.15.150:0/2819083077 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7e4c15ee50 0x7f7e4c0b62b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:42:24.596 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:24.593+0000 7f7e4affd640 1 --2- 172.21.15.150:0/2819083077 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7e4c0d15d0 0x7f7e4c0ce350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:42:24.596 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:24.593+0000 7f7e4b7fe640 1 -- 172.21.15.150:0/2819083077 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7e4c0d15d0 msgr2=0x7f7e4c0ce350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:24.596 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:24.593+0000 7f7e4b7fe640 1 --2- 172.21.15.150:0/2819083077 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7e4c0d15d0 0x7f7e4c0ce350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:24.596 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:24.593+0000 7f7e4b7fe640 1 -- 172.21.15.150:0/2819083077 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7e4c15ee50 msgr2=0x7f7e4c0b62b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:24.596 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:24.593+0000 7f7e4b7fe640 1 --2- 172.21.15.150:0/2819083077 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7e4c15ee50 0x7f7e4c0b62b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:24.596 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:24.593+0000 7f7e4b7fe640 1 -- 172.21.15.150:0/2819083077 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7e4c1602a0 con 0x7f7e4c0b9780 2024-09-17T05:42:24.596 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:24.593+0000 7f7e4bfff640 1 --2- 172.21.15.150:0/2819083077 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7e4c15ee50 0x7f7e4c0b62b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:42:24.597 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:24.594+0000 7f7e4b7fe640 1 --2- 172.21.15.150:0/2819083077 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7e4c0b9780 0x7f7e4c15fd60 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f7e3c0058e0 tx=0x7f7e3c00cdd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:42:24.597 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:24.594+0000 7f7e33fff640 1 -- 172.21.15.150:0/2819083077 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e3c007bb0 con 0x7f7e4c0b9780 2024-09-17T05:42:24.597 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:24.594+0000 7f7e33fff640 1 -- 172.21.15.150:0/2819083077 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f7e3c007e40 con 0x7f7e4c0b9780 2024-09-17T05:42:24.597 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:24.594+0000 7f7e52038640 1 -- 172.21.15.150:0/2819083077 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7e4c160cc0 con 0x7f7e4c0b9780 2024-09-17T05:42:24.597 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:24.594+0000 7f7e33fff640 1 -- 172.21.15.150:0/2819083077 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e3c005290 con 0x7f7e4c0b9780 2024-09-17T05:42:24.597 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:24.594+0000 7f7e52038640 1 -- 172.21.15.150:0/2819083077 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7e4c1609e0 con 0x7f7e4c0b9780 2024-09-17T05:42:24.598 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:24.595+0000 7f7e52038640 1 -- 172.21.15.150:0/2819083077 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7e4c08d100 con 0x7f7e4c0b9780 2024-09-17T05:42:24.598 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:24.596+0000 7f7e33fff640 1 -- 172.21.15.150:0/2819083077 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f7e3c005430 con 0x7f7e4c0b9780 2024-09-17T05:42:24.598 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:24.596+0000 7f7e33fff640 1 --2- 172.21.15.150:0/2819083077 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f7e38078bc0 0x7f7e3807b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:42:24.598 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:24.596+0000 7f7e33fff640 1 -- 172.21.15.150:0/2819083077 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f7e3c09b180 con 0x7f7e4c0b9780 2024-09-17T05:42:24.598 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:24.596+0000 7f7e4affd640 1 --2- 172.21.15.150:0/2819083077 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f7e38078bc0 0x7f7e3807b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:42:24.598 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:24.597+0000 7f7e4affd640 1 --2- 172.21.15.150:0/2819083077 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f7e38078bc0 0x7f7e3807b0d0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f7e40005fd0 tx=0x7f7e40005850 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:42:24.602 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:24.601+0000 7f7e33fff640 1 -- 172.21.15.150:0/2819083077 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f7e4c08d100 con 0x7f7e4c0b9780 2024-09-17T05:42:24.789 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:24.787+0000 7f7e52038640 1 -- 172.21.15.150:0/2819083077 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f7e4c162a60 con 0x7f7e4c0b9780 2024-09-17T05:42:24.789 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:24.787+0000 7f7e33fff640 1 -- 172.21.15.150:0/2819083077 <== mon.0 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v23) ==== 80+0+0 (secure 0 0 0) 0x7f7e3c014070 con 0x7f7e4c0b9780 2024-09-17T05:42:24.789 INFO:teuthology.orchestra.run.smithi150.stderr:listed 0 entries 2024-09-17T05:42:24.791 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:24.790+0000 7f7e52038640 1 -- 172.21.15.150:0/2819083077 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f7e38078bc0 msgr2=0x7f7e3807b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:24.792 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:24.790+0000 7f7e52038640 1 --2- 172.21.15.150:0/2819083077 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f7e38078bc0 0x7f7e3807b0d0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f7e40005fd0 tx=0x7f7e40005850 comp rx=0 tx=0).stop 2024-09-17T05:42:24.792 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:24.790+0000 7f7e52038640 1 -- 172.21.15.150:0/2819083077 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7e4c0b9780 msgr2=0x7f7e4c15fd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:24.792 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:24.790+0000 7f7e52038640 1 --2- 172.21.15.150:0/2819083077 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7e4c0b9780 0x7f7e4c15fd60 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f7e3c0058e0 tx=0x7f7e3c00cdd0 comp rx=0 tx=0).stop 2024-09-17T05:42:24.792 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:24.790+0000 7f7e52038640 1 -- 172.21.15.150:0/2819083077 shutdown_connections 2024-09-17T05:42:24.792 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:24.790+0000 7f7e52038640 1 --2- 172.21.15.150:0/2819083077 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7e4c15ee50 0x7f7e4c0b62b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:24.792 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:24.790+0000 7f7e52038640 1 --2- 172.21.15.150:0/2819083077 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f7e38078bc0 0x7f7e3807b0d0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:24.792 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:24.790+0000 7f7e52038640 1 --2- 172.21.15.150:0/2819083077 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7e4c0d15d0 0x7f7e4c0ce350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:24.792 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:24.790+0000 7f7e52038640 1 --2- 172.21.15.150:0/2819083077 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7e4c0b9780 0x7f7e4c15fd60 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:24.792 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:24.790+0000 7f7e52038640 1 -- 172.21.15.150:0/2819083077 >> 172.21.15.150:0/2819083077 conn(0x7f7e4c0d4680 msgr2=0x7f7e4c15aa70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:42:24.792 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:24.790+0000 7f7e52038640 1 -- 172.21.15.150:0/2819083077 shutdown_connections 2024-09-17T05:42:24.792 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:24.790+0000 7f7e52038640 1 -- 172.21.15.150:0/2819083077 wait complete. 2024-09-17T05:42:24.803 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2024-09-17T05:42:24.804 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:42:24.804 DEBUG:teuthology.orchestra.run.smithi176:> sudo umount /home/ubuntu/cephtest/mnt.1 -f 2024-09-17T05:42:24.836 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi176.front.sepia.ceph.com 2024-09-17T05:42:24.836 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:42:24.837 DEBUG:teuthology.orchestra.run.smithi176:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2024-09-17T05:42:24.906 DEBUG:teuthology.orchestra.run.smithi150:> set -ex 2024-09-17T05:42:24.906 DEBUG:teuthology.orchestra.run.smithi150:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T05:42:24.922 DEBUG:teuthology.orchestra.run.smithi150:> set -ex 2024-09-17T05:42:24.922 DEBUG:teuthology.orchestra.run.smithi150:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T05:42:24.979 DEBUG:teuthology.orchestra.run.smithi150:> set -ex 2024-09-17T05:42:24.979 DEBUG:teuthology.orchestra.run.smithi150:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T05:42:25.034 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-17T05:42:25.189 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:25.187+0000 7fd0ace27640 1 -- 172.21.15.150:0/95326421 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd090004800 msgr2=0x7fd090004c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:25.189 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:25.187+0000 7fd0ace27640 1 --2- 172.21.15.150:0/95326421 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd090004800 0x7fd090004c10 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fd09c009b50 tx=0x7fd090005830 comp rx=0 tx=0).stop 2024-09-17T05:42:25.189 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:25.187+0000 7fd0ace27640 1 -- 172.21.15.150:0/95326421 shutdown_connections 2024-09-17T05:42:25.190 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:25.187+0000 7fd0ace27640 1 --2- 172.21.15.150:0/95326421 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd090004800 0x7fd090004c10 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:25.190 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:25.187+0000 7fd0ace27640 1 -- 172.21.15.150:0/95326421 >> 172.21.15.150:0/95326421 conn(0x7fd0a80d4680 msgr2=0x7fd0a80d4a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:42:25.190 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:25.187+0000 7fd0ace27640 1 -- 172.21.15.150:0/95326421 shutdown_connections 2024-09-17T05:42:25.190 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:25.187+0000 7fd0ace27640 1 -- 172.21.15.150:0/95326421 wait complete. 2024-09-17T05:42:25.191 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:25.189+0000 7fd0ace27640 1 Processor -- start 2024-09-17T05:42:25.191 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:25.189+0000 7fd0ace27640 1 -- start start 2024-09-17T05:42:25.194 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:25.191+0000 7fd0ace27640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd090004800 0x7fd0a8149c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:42:25.194 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:25.191+0000 7fd0ace27640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd0a8152870 0x7fd0a80b40e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:42:25.194 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:25.191+0000 7fd0ace27640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd0a815ff90 0x7fd0a81603a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:42:25.195 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:25.191+0000 7fd0ace27640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7fd0a815ee50 con 0x7fd090004800 2024-09-17T05:42:25.195 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:25.191+0000 7fd0ace27640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fd0a80d12f0 con 0x7fd0a8152870 2024-09-17T05:42:25.195 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:25.191+0000 7fd0ace27640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fd0a815efd0 con 0x7fd0a815ff90 2024-09-17T05:42:25.195 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:25.191+0000 7fd0a659c640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd090004800 0x7fd0a8149c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:42:25.195 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:25.191+0000 7fd0a659c640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd090004800 0x7fd0a8149c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:35672/0 (socket says 172.21.15.150:35672) 2024-09-17T05:42:25.195 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:25.191+0000 7fd0a659c640 1 -- 172.21.15.150:0/2690703562 learned_addr learned my addr 172.21.15.150:0/2690703562 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:42:25.195 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:25.191+0000 7fd0a659c640 1 -- 172.21.15.150:0/2690703562 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd0a815ff90 msgr2=0x7fd0a81603a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:25.195 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:25.191+0000 7fd0a659c640 1 --2- 172.21.15.150:0/2690703562 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd0a815ff90 0x7fd0a81603a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:25.195 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:25.191+0000 7fd0a659c640 1 -- 172.21.15.150:0/2690703562 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd0a8152870 msgr2=0x7fd0a80b40e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:25.195 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:25.191+0000 7fd0a659c640 1 --2- 172.21.15.150:0/2690703562 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd0a8152870 0x7fd0a80b40e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:25.195 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:25.191+0000 7fd0a659c640 1 -- 172.21.15.150:0/2690703562 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd0a815c750 con 0x7fd090004800 2024-09-17T05:42:25.195 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:25.191+0000 7fd0a659c640 1 --2- 172.21.15.150:0/2690703562 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd090004800 0x7fd0a8149c00 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fd098001aa0 tx=0x7fd0980039c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:42:25.195 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:25.191+0000 7fd096ffd640 1 -- 172.21.15.150:0/2690703562 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd098015070 con 0x7fd090004800 2024-09-17T05:42:25.196 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:25.191+0000 7fd096ffd640 1 -- 172.21.15.150:0/2690703562 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd098011840 con 0x7fd090004800 2024-09-17T05:42:25.196 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:25.191+0000 7fd0ace27640 1 -- 172.21.15.150:0/2690703562 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd0a815ca30 con 0x7fd090004800 2024-09-17T05:42:25.196 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:25.191+0000 7fd096ffd640 1 -- 172.21.15.150:0/2690703562 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd098011c70 con 0x7fd090004800 2024-09-17T05:42:25.196 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:25.192+0000 7fd0ace27640 1 -- 172.21.15.150:0/2690703562 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd0a815cff0 con 0x7fd090004800 2024-09-17T05:42:25.196 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:25.192+0000 7fd0ace27640 1 -- 172.21.15.150:0/2690703562 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd0a808d100 con 0x7fd090004800 2024-09-17T05:42:25.197 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:25.193+0000 7fd096ffd640 1 -- 172.21.15.150:0/2690703562 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fd098018070 con 0x7fd090004800 2024-09-17T05:42:25.197 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:25.194+0000 7fd096ffd640 1 --2- 172.21.15.150:0/2690703562 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fd088078bc0 0x7fd08807b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:42:25.197 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:25.194+0000 7fd096ffd640 1 -- 172.21.15.150:0/2690703562 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7fd09809b900 con 0x7fd090004800 2024-09-17T05:42:25.197 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:25.194+0000 7fd0a5d9b640 1 --2- 172.21.15.150:0/2690703562 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fd088078bc0 0x7fd08807b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:42:25.197 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:25.195+0000 7fd0a5d9b640 1 --2- 172.21.15.150:0/2690703562 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fd088078bc0 0x7fd08807b0d0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fd09c035000 tx=0x7fd09c004730 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:42:25.200 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:25.199+0000 7fd096ffd640 1 -- 172.21.15.150:0/2690703562 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fd0a808d100 con 0x7fd090004800 2024-09-17T05:42:25.390 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:25.388+0000 7fd0ace27640 1 -- 172.21.15.150:0/2690703562 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7fd0a8162a60 con 0x7fd090004800 2024-09-17T05:42:25.390 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:25.388+0000 7fd096ffd640 1 -- 172.21.15.150:0/2690703562 <== mon.0 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v23) ==== 80+0+0 (secure 0 0 0) 0x7fd0a80d19e0 con 0x7fd090004800 2024-09-17T05:42:25.390 INFO:teuthology.orchestra.run.smithi150.stderr:listed 0 entries 2024-09-17T05:42:25.392 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:25.390+0000 7fd0ace27640 1 -- 172.21.15.150:0/2690703562 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fd088078bc0 msgr2=0x7fd08807b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:25.392 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:25.390+0000 7fd0ace27640 1 --2- 172.21.15.150:0/2690703562 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fd088078bc0 0x7fd08807b0d0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fd09c035000 tx=0x7fd09c004730 comp rx=0 tx=0).stop 2024-09-17T05:42:25.393 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:25.390+0000 7fd0ace27640 1 -- 172.21.15.150:0/2690703562 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd090004800 msgr2=0x7fd0a8149c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:25.393 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:25.391+0000 7fd0ace27640 1 --2- 172.21.15.150:0/2690703562 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd090004800 0x7fd0a8149c00 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fd098001aa0 tx=0x7fd0980039c0 comp rx=0 tx=0).stop 2024-09-17T05:42:25.393 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:25.391+0000 7fd0ace27640 1 -- 172.21.15.150:0/2690703562 shutdown_connections 2024-09-17T05:42:25.393 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:25.391+0000 7fd0ace27640 1 --2- 172.21.15.150:0/2690703562 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd0a8152870 0x7fd0a80b40e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:25.393 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:25.391+0000 7fd0ace27640 1 --2- 172.21.15.150:0/2690703562 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fd088078bc0 0x7fd08807b0d0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:25.393 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:25.391+0000 7fd0ace27640 1 --2- 172.21.15.150:0/2690703562 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd0a815ff90 0x7fd0a81603a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:25.393 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:25.391+0000 7fd0ace27640 1 --2- 172.21.15.150:0/2690703562 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd090004800 0x7fd0a8149c00 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:25.393 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:25.391+0000 7fd0ace27640 1 -- 172.21.15.150:0/2690703562 >> 172.21.15.150:0/2690703562 conn(0x7fd0a80d4680 msgr2=0x7fd0a80b3010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:42:25.393 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:25.391+0000 7fd0ace27640 1 -- 172.21.15.150:0/2690703562 shutdown_connections 2024-09-17T05:42:25.393 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:25.391+0000 7fd0ace27640 1 -- 172.21.15.150:0/2690703562 wait complete. 2024-09-17T05:42:25.404 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.2... 2024-09-17T05:42:25.404 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:42:25.404 DEBUG:teuthology.orchestra.run.smithi150:> sudo umount /home/ubuntu/cephtest/mnt.2 -f 2024-09-17T05:42:25.429 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi150.front.sepia.ceph.com 2024-09-17T05:42:25.429 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:42:25.430 DEBUG:teuthology.orchestra.run.smithi150:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2024-09-17T05:42:25.485 DEBUG:teuthology.orchestra.run.smithi176:> set -ex 2024-09-17T05:42:25.485 DEBUG:teuthology.orchestra.run.smithi176:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T05:42:25.505 DEBUG:teuthology.orchestra.run.smithi176:> set -ex 2024-09-17T05:42:25.505 DEBUG:teuthology.orchestra.run.smithi176:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T05:42:25.563 DEBUG:teuthology.orchestra.run.smithi176:> set -ex 2024-09-17T05:42:25.563 DEBUG:teuthology.orchestra.run.smithi176:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T05:42:25.621 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-17T05:42:25.735 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:25.734+0000 7fdb555ad640 1 -- 172.21.15.150:0/36308844 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fdb500d2e50 msgr2=0x7fdb500d3260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:25.736 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:25.734+0000 7fdb555ad640 1 --2- 172.21.15.150:0/36308844 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fdb500d2e50 0x7fdb500d3260 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fdb44005fd0 tx=0x7fdb4402a4a0 comp rx=0 tx=0).stop 2024-09-17T05:42:25.736 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:25.734+0000 7fdb555ad640 1 -- 172.21.15.150:0/36308844 shutdown_connections 2024-09-17T05:42:25.736 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:25.734+0000 7fdb555ad640 1 --2- 172.21.15.150:0/36308844 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fdb500d2e50 0x7fdb500d3260 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:25.736 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:25.734+0000 7fdb555ad640 1 --2- 172.21.15.150:0/36308844 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fdb500b74b0 0x7fdb500b78c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:25.736 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:25.734+0000 7fdb555ad640 1 -- 172.21.15.150:0/36308844 >> 172.21.15.150:0/36308844 conn(0x7fdb5008bfe0 msgr2=0x7fdb500d4660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:42:25.736 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:25.734+0000 7fdb555ad640 1 -- 172.21.15.150:0/36308844 shutdown_connections 2024-09-17T05:42:25.736 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:25.734+0000 7fdb555ad640 1 -- 172.21.15.150:0/36308844 wait complete. 2024-09-17T05:42:25.737 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:25.736+0000 7fdb555ad640 1 Processor -- start 2024-09-17T05:42:25.737 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:25.736+0000 7fdb555ad640 1 -- start start 2024-09-17T05:42:25.743 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:25.738+0000 7fdb555ad640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fdb500b6320 0x7fdb50157a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:42:25.743 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:25.738+0000 7fdb555ad640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fdb500b74b0 0x7fdb501f97b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:42:25.743 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:25.738+0000 7fdb555ad640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fdb500d2e50 0x7fdb501f9cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:42:25.743 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:25.738+0000 7fdb555ad640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7fdb500d0900 con 0x7fdb500d2e50 2024-09-17T05:42:25.743 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:25.738+0000 7fdb555ad640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fdb500d0780 con 0x7fdb500b74b0 2024-09-17T05:42:25.743 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:25.738+0000 7fdb555ad640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fdb50169330 con 0x7fdb500b6320 2024-09-17T05:42:25.743 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:25.738+0000 7fdb4f7fe640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fdb500d2e50 0x7fdb501f9cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:42:25.743 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:25.738+0000 7fdb4f7fe640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fdb500d2e50 0x7fdb501f9cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:35700/0 (socket says 172.21.15.150:35700) 2024-09-17T05:42:25.743 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:25.738+0000 7fdb4f7fe640 1 -- 172.21.15.150:0/4179604503 learned_addr learned my addr 172.21.15.150:0/4179604503 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:42:25.744 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:25.738+0000 7fdb4e7fc640 1 --2- 172.21.15.150:0/4179604503 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fdb500b74b0 0x7fdb501f97b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:42:25.744 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:25.738+0000 7fdb4effd640 1 --2- 172.21.15.150:0/4179604503 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fdb500b6320 0x7fdb50157a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:42:25.744 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:25.738+0000 7fdb4f7fe640 1 -- 172.21.15.150:0/4179604503 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fdb500b6320 msgr2=0x7fdb50157a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:25.744 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:25.738+0000 7fdb4f7fe640 1 --2- 172.21.15.150:0/4179604503 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fdb500b6320 0x7fdb50157a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:25.744 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:25.738+0000 7fdb4f7fe640 1 -- 172.21.15.150:0/4179604503 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fdb500b74b0 msgr2=0x7fdb501f97b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:25.744 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:25.738+0000 7fdb4f7fe640 1 --2- 172.21.15.150:0/4179604503 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fdb500b74b0 0x7fdb501f97b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:25.744 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:25.738+0000 7fdb4f7fe640 1 -- 172.21.15.150:0/4179604503 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdb501fa230 con 0x7fdb500d2e50 2024-09-17T05:42:25.744 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:25.738+0000 7fdb4e7fc640 1 --2- 172.21.15.150:0/4179604503 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fdb500b74b0 0x7fdb501f97b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T05:42:25.744 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:25.738+0000 7fdb4f7fe640 1 --2- 172.21.15.150:0/4179604503 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fdb500d2e50 0x7fdb501f9cf0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fdb4800ba10 tx=0x7fdb4800bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:42:25.744 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:25.738+0000 7fdb377fe640 1 -- 172.21.15.150:0/4179604503 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb48019070 con 0x7fdb500d2e50 2024-09-17T05:42:25.744 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:25.738+0000 7fdb377fe640 1 -- 172.21.15.150:0/4179604503 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fdb4800cc30 con 0x7fdb500d2e50 2024-09-17T05:42:25.744 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:25.738+0000 7fdb377fe640 1 -- 172.21.15.150:0/4179604503 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb480146a0 con 0x7fdb500d2e50 2024-09-17T05:42:25.744 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:25.738+0000 7fdb555ad640 1 -- 172.21.15.150:0/4179604503 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdb501fa4c0 con 0x7fdb500d2e50 2024-09-17T05:42:25.745 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:25.738+0000 7fdb555ad640 1 -- 172.21.15.150:0/4179604503 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdb500cb3e0 con 0x7fdb500d2e50 2024-09-17T05:42:25.745 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:25.739+0000 7fdb555ad640 1 -- 172.21.15.150:0/4179604503 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdb500caf20 con 0x7fdb500d2e50 2024-09-17T05:42:25.745 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:25.740+0000 7fdb377fe640 1 -- 172.21.15.150:0/4179604503 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fdb4801c070 con 0x7fdb500d2e50 2024-09-17T05:42:25.745 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:25.740+0000 7fdb377fe640 1 --2- 172.21.15.150:0/4179604503 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fdb3c078b90 0x7fdb3c07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:42:25.745 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:25.740+0000 7fdb377fe640 1 -- 172.21.15.150:0/4179604503 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7fdb4809a880 con 0x7fdb500d2e50 2024-09-17T05:42:25.745 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:25.740+0000 7fdb4effd640 1 --2- 172.21.15.150:0/4179604503 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fdb3c078b90 0x7fdb3c07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:42:25.745 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:25.741+0000 7fdb4effd640 1 --2- 172.21.15.150:0/4179604503 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fdb3c078b90 0x7fdb3c07b0a0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fdb40006fd0 tx=0x7fdb40008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:42:25.746 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:25.745+0000 7fdb377fe640 1 -- 172.21.15.150:0/4179604503 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fdb500caf20 con 0x7fdb500d2e50 2024-09-17T05:42:25.930 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:25.929+0000 7fdb555ad640 1 -- 172.21.15.150:0/4179604503 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7fdb5008caf0 con 0x7fdb500d2e50 2024-09-17T05:42:25.931 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:25.929+0000 7fdb377fe640 1 -- 172.21.15.150:0/4179604503 <== mon.0 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v23) ==== 80+0+0 (secure 0 0 0) 0x7fdb5008caf0 con 0x7fdb500d2e50 2024-09-17T05:42:25.931 INFO:teuthology.orchestra.run.smithi150.stderr:listed 0 entries 2024-09-17T05:42:25.933 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:25.932+0000 7fdb555ad640 1 -- 172.21.15.150:0/4179604503 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fdb3c078b90 msgr2=0x7fdb3c07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:25.933 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:25.932+0000 7fdb555ad640 1 --2- 172.21.15.150:0/4179604503 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fdb3c078b90 0x7fdb3c07b0a0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fdb40006fd0 tx=0x7fdb40008040 comp rx=0 tx=0).stop 2024-09-17T05:42:25.934 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:25.932+0000 7fdb555ad640 1 -- 172.21.15.150:0/4179604503 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fdb500d2e50 msgr2=0x7fdb501f9cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:25.934 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:25.932+0000 7fdb555ad640 1 --2- 172.21.15.150:0/4179604503 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fdb500d2e50 0x7fdb501f9cf0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fdb4800ba10 tx=0x7fdb4800bed0 comp rx=0 tx=0).stop 2024-09-17T05:42:25.934 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:25.932+0000 7fdb555ad640 1 -- 172.21.15.150:0/4179604503 shutdown_connections 2024-09-17T05:42:25.934 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:25.932+0000 7fdb555ad640 1 --2- 172.21.15.150:0/4179604503 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fdb500b74b0 0x7fdb501f97b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:25.934 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:25.932+0000 7fdb555ad640 1 --2- 172.21.15.150:0/4179604503 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fdb3c078b90 0x7fdb3c07b0a0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:25.934 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:25.932+0000 7fdb555ad640 1 --2- 172.21.15.150:0/4179604503 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fdb500d2e50 0x7fdb501f9cf0 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:25.934 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:25.932+0000 7fdb555ad640 1 --2- 172.21.15.150:0/4179604503 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fdb500b6320 0x7fdb50157a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:25.934 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:25.932+0000 7fdb555ad640 1 -- 172.21.15.150:0/4179604503 >> 172.21.15.150:0/4179604503 conn(0x7fdb5008bfe0 msgr2=0x7fdb500b8f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:42:25.934 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:25.932+0000 7fdb555ad640 1 -- 172.21.15.150:0/4179604503 shutdown_connections 2024-09-17T05:42:25.934 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:25.932+0000 7fdb555ad640 1 -- 172.21.15.150:0/4179604503 wait complete. 2024-09-17T05:42:25.945 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.3... 2024-09-17T05:42:25.945 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:42:25.945 DEBUG:teuthology.orchestra.run.smithi176:> sudo umount /home/ubuntu/cephtest/mnt.3 -f 2024-09-17T05:42:25.976 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi176.front.sepia.ceph.com 2024-09-17T05:42:25.976 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:42:25.977 DEBUG:teuthology.orchestra.run.smithi176:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2024-09-17T05:42:26.036 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-09-17T05:42:26.036 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T05:42:26.154 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:26.148+0000 7f70a8d12640 1 -- 172.21.15.150:0/593834379 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f70a40cf7c0 msgr2=0x7f70a40cfbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:26.155 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:26.148+0000 7f70a8d12640 1 --2- 172.21.15.150:0/593834379 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f70a40cf7c0 0x7f70a40cfbd0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f7098009830 tx=0x7f709802a5c0 comp rx=0 tx=0).stop 2024-09-17T05:42:26.155 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:26.148+0000 7f70a8d12640 1 -- 172.21.15.150:0/593834379 shutdown_connections 2024-09-17T05:42:26.155 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:26.148+0000 7f70a8d12640 1 --2- 172.21.15.150:0/593834379 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f70a40cf7c0 0x7f70a40cfbd0 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:26.155 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:26.148+0000 7f70a8d12640 1 -- 172.21.15.150:0/593834379 >> 172.21.15.150:0/593834379 conn(0x7f70a40b2fd0 msgr2=0x7f70a40b33e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:42:26.155 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:26.148+0000 7f70a8d12640 1 -- 172.21.15.150:0/593834379 shutdown_connections 2024-09-17T05:42:26.155 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:26.148+0000 7f70a8d12640 1 -- 172.21.15.150:0/593834379 wait complete. 2024-09-17T05:42:26.155 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:26.150+0000 7f70a8d12640 1 Processor -- start 2024-09-17T05:42:26.155 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:26.150+0000 7f70a8d12640 1 -- start start 2024-09-17T05:42:26.155 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:26.151+0000 7f70a8d12640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f70a40b5410 0x7f70a41f7390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:42:26.155 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:26.151+0000 7f70a8d12640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f70a40cf7c0 0x7f70a40caf20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:42:26.155 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:26.151+0000 7f70a8d12640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f70a415ee30 0x7f70a40cb460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:42:26.155 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:26.151+0000 7f70a8d12640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f70a40b6380 con 0x7f70a40cf7c0 2024-09-17T05:42:26.156 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:26.151+0000 7f70a8d12640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f70a40b6200 con 0x7f70a40b5410 2024-09-17T05:42:26.156 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:26.151+0000 7f70a8d12640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f70a40b6500 con 0x7f70a415ee30 2024-09-17T05:42:26.156 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:26.151+0000 7f70a1d9b640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f70a40cf7c0 0x7f70a40caf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:42:26.156 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:26.151+0000 7f70a1d9b640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f70a40cf7c0 0x7f70a40caf20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:35720/0 (socket says 172.21.15.150:35720) 2024-09-17T05:42:26.156 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:26.151+0000 7f70a1d9b640 1 -- 172.21.15.150:0/1827144408 learned_addr learned my addr 172.21.15.150:0/1827144408 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:42:26.156 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:26.151+0000 7f70a259c640 1 --2- 172.21.15.150:0/1827144408 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f70a40b5410 0x7f70a41f7390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:42:26.156 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:26.151+0000 7f70a2d9d640 1 --2- 172.21.15.150:0/1827144408 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f70a415ee30 0x7f70a40cb460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:42:26.156 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:26.151+0000 7f70a1d9b640 1 -- 172.21.15.150:0/1827144408 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f70a415ee30 msgr2=0x7f70a40cb460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:26.156 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:26.151+0000 7f70a1d9b640 1 --2- 172.21.15.150:0/1827144408 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f70a415ee30 0x7f70a40cb460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:26.156 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:26.151+0000 7f70a1d9b640 1 -- 172.21.15.150:0/1827144408 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f70a40b5410 msgr2=0x7f70a41f7390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:26.156 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:26.151+0000 7f70a1d9b640 1 --2- 172.21.15.150:0/1827144408 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f70a40b5410 0x7f70a41f7390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:26.156 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:26.151+0000 7f70a1d9b640 1 -- 172.21.15.150:0/1827144408 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f70a41f78d0 con 0x7f70a40cf7c0 2024-09-17T05:42:26.157 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:26.152+0000 7f70a1d9b640 1 --2- 172.21.15.150:0/1827144408 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f70a40cf7c0 0x7f70a40caf20 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f7098000c00 tx=0x7f7098033d60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:42:26.157 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:26.152+0000 7f7092ffd640 1 -- 172.21.15.150:0/1827144408 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7098031d60 con 0x7f70a40cf7c0 2024-09-17T05:42:26.157 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:26.152+0000 7f7092ffd640 1 -- 172.21.15.150:0/1827144408 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f70980330d0 con 0x7f70a40cf7c0 2024-09-17T05:42:26.157 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:26.152+0000 7f70a8d12640 1 -- 172.21.15.150:0/1827144408 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f70a4148610 con 0x7f70a40cf7c0 2024-09-17T05:42:26.157 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:26.152+0000 7f7092ffd640 1 -- 172.21.15.150:0/1827144408 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7098033520 con 0x7f70a40cf7c0 2024-09-17T05:42:26.157 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:26.152+0000 7f70a8d12640 1 -- 172.21.15.150:0/1827144408 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f70a4148bd0 con 0x7f70a40cf7c0 2024-09-17T05:42:26.157 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:26.153+0000 7f70a8d12640 1 -- 172.21.15.150:0/1827144408 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f70a40b69b0 con 0x7f70a40cf7c0 2024-09-17T05:42:26.158 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:26.154+0000 7f7092ffd640 1 -- 172.21.15.150:0/1827144408 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f70980035f0 con 0x7f70a40cf7c0 2024-09-17T05:42:26.158 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:26.154+0000 7f7092ffd640 1 --2- 172.21.15.150:0/1827144408 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f7084078b90 0x7f708407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:42:26.158 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:26.155+0000 7f7092ffd640 1 -- 172.21.15.150:0/1827144408 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f70980bc320 con 0x7f70a40cf7c0 2024-09-17T05:42:26.158 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:26.155+0000 7f70a259c640 1 --2- 172.21.15.150:0/1827144408 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f7084078b90 0x7f708407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:42:26.158 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:26.155+0000 7f70a259c640 1 --2- 172.21.15.150:0/1827144408 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f7084078b90 0x7f708407b0a0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f70a40d0de0 tx=0x7f7094009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:42:26.160 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:26.160+0000 7f7092ffd640 1 -- 172.21.15.150:0/1827144408 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f70a41f78d0 con 0x7f70a40cf7c0 2024-09-17T05:42:26.369 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:26.368+0000 7f70a8d12640 1 -- 172.21.15.150:0/1827144408 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f70a406f1e0 con 0x7f70a40cf7c0 2024-09-17T05:42:26.370 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:26.369+0000 7f7092ffd640 1 -- 172.21.15.150:0/1827144408 <== mon.0 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) ==== 93+0+5226 (secure 0 0 0) 0x7f709803f030 con 0x7f70a40cf7c0 2024-09-17T05:42:26.370 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-09-17T05:42:26.370 INFO:teuthology.orchestra.run.smithi150.stdout:{"epoch":6,"btime":"2024-09-17T05:41:59:940454+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4316,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6835/357154046","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6833","nonce":357154046},{"type":"v1","addr":"172.21.15.150:6835","nonce":357154046}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4377,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6834/2757381484","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6832","nonce":2757381484},{"type":"v1","addr":"172.21.15.150:6834","nonce":2757381484}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4411,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6835/3751002674","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6834","nonce":3751002674},{"type":"v1","addr":"172.21.15.176:6835","nonce":3751002674}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T05:41:57.292807+0000","modified":"2024-09-17T05:41:59.294767+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4414},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4414":{"gid":4414,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.176:6837/1714683410","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6836","nonce":1714683410},{"type":"v1","addr":"172.21.15.176:6837","nonce":1714683410}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4414,"qdb_cluster":[4414]},"id":1}]} 2024-09-17T05:42:26.371 INFO:teuthology.orchestra.run.smithi150.stderr:dumped fsmap epoch 6 2024-09-17T05:42:26.373 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:26.372+0000 7f70a8d12640 1 -- 172.21.15.150:0/1827144408 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f7084078b90 msgr2=0x7f708407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:26.373 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:26.372+0000 7f70a8d12640 1 --2- 172.21.15.150:0/1827144408 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f7084078b90 0x7f708407b0a0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f70a40d0de0 tx=0x7f7094009040 comp rx=0 tx=0).stop 2024-09-17T05:42:26.373 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:26.372+0000 7f70a8d12640 1 -- 172.21.15.150:0/1827144408 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f70a40cf7c0 msgr2=0x7f70a40caf20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:26.373 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:26.372+0000 7f70a8d12640 1 --2- 172.21.15.150:0/1827144408 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f70a40cf7c0 0x7f70a40caf20 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f7098000c00 tx=0x7f7098033d60 comp rx=0 tx=0).stop 2024-09-17T05:42:26.373 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:26.372+0000 7f70a8d12640 1 -- 172.21.15.150:0/1827144408 shutdown_connections 2024-09-17T05:42:26.373 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:26.372+0000 7f70a8d12640 1 --2- 172.21.15.150:0/1827144408 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f7084078b90 0x7f708407b0a0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:26.373 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:26.372+0000 7f70a8d12640 1 --2- 172.21.15.150:0/1827144408 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f70a415ee30 0x7f70a40cb460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:26.373 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:26.372+0000 7f70a8d12640 1 --2- 172.21.15.150:0/1827144408 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f70a40cf7c0 0x7f70a40caf20 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:26.373 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:26.372+0000 7f70a8d12640 1 --2- 172.21.15.150:0/1827144408 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f70a40b5410 0x7f70a41f7390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:26.374 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:26.372+0000 7f70a8d12640 1 -- 172.21.15.150:0/1827144408 >> 172.21.15.150:0/1827144408 conn(0x7f70a40b2fd0 msgr2=0x7f70a40b5820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:42:26.374 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:26.372+0000 7f70a8d12640 1 -- 172.21.15.150:0/1827144408 shutdown_connections 2024-09-17T05:42:26.374 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:26.372+0000 7f70a8d12640 1 -- 172.21.15.150:0/1827144408 wait complete. 2024-09-17T05:42:26.384 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T05:42:26.498 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:26.497+0000 7f0d0deb2640 1 -- 172.21.15.150:0/220331459 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0d080cd850 msgr2=0x7f0d080d06f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:26.499 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:26.497+0000 7f0d0deb2640 1 --2- 172.21.15.150:0/220331459 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0d080cd850 0x7f0d080d06f0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f0d080b84c0 tx=0x7f0d0002a8b0 comp rx=0 tx=0).stop 2024-09-17T05:42:26.499 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:26.497+0000 7f0d0deb2640 1 -- 172.21.15.150:0/220331459 shutdown_connections 2024-09-17T05:42:26.499 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:26.497+0000 7f0d0deb2640 1 --2- 172.21.15.150:0/220331459 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0d080cd850 0x7f0d080d06f0 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:26.499 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:26.497+0000 7f0d0deb2640 1 --2- 172.21.15.150:0/220331459 >> v2:172.21.15.176:3300/0 conn(0x7f0d0809ba60 0x7f0d080b7330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:26.499 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:26.497+0000 7f0d0deb2640 1 -- 172.21.15.150:0/220331459 >> 172.21.15.150:0/220331459 conn(0x7f0d080cee90 msgr2=0x7f0d080cf2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:42:26.499 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:26.497+0000 7f0d0deb2640 1 -- 172.21.15.150:0/220331459 shutdown_connections 2024-09-17T05:42:26.499 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:26.497+0000 7f0d0deb2640 1 -- 172.21.15.150:0/220331459 wait complete. 2024-09-17T05:42:26.500 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:26.498+0000 7f0d0deb2640 1 Processor -- start 2024-09-17T05:42:26.500 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:26.499+0000 7f0d0deb2640 1 -- start start 2024-09-17T05:42:26.503 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:26.500+0000 7f0d0deb2640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0d0809ba60 0x7f0d08166820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:42:26.503 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:26.500+0000 7f0d0deb2640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0d080cd440 0x7f0d0809fdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:42:26.503 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:26.500+0000 7f0d0deb2640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0d080cd850 0x7f0d0809cce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:42:26.503 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:26.500+0000 7f0d0deb2640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f0d080d0db0 con 0x7f0d0809ba60 2024-09-17T05:42:26.503 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:26.500+0000 7f0d0deb2640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f0d080d0c30 con 0x7f0d080cd850 2024-09-17T05:42:26.503 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:26.500+0000 7f0d0deb2640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f0d080d0f30 con 0x7f0d080cd440 2024-09-17T05:42:26.503 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:26.500+0000 7f0d077fe640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0d0809ba60 0x7f0d08166820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:42:26.503 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:26.500+0000 7f0d077fe640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0d0809ba60 0x7f0d08166820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:35746/0 (socket says 172.21.15.150:35746) 2024-09-17T05:42:26.503 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:26.500+0000 7f0d077fe640 1 -- 172.21.15.150:0/2672602608 learned_addr learned my addr 172.21.15.150:0/2672602608 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:42:26.503 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:26.500+0000 7f0d07fff640 1 --2- 172.21.15.150:0/2672602608 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0d080cd850 0x7f0d0809cce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:42:26.503 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:26.500+0000 7f0d06ffd640 1 --2- 172.21.15.150:0/2672602608 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0d080cd440 0x7f0d0809fdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:42:26.504 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:26.500+0000 7f0d077fe640 1 -- 172.21.15.150:0/2672602608 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0d080cd440 msgr2=0x7f0d0809fdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:26.504 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:26.500+0000 7f0d077fe640 1 --2- 172.21.15.150:0/2672602608 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0d080cd440 0x7f0d0809fdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:26.504 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:26.500+0000 7f0d077fe640 1 -- 172.21.15.150:0/2672602608 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0d080cd850 msgr2=0x7f0d0809cce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:26.504 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:26.500+0000 7f0d077fe640 1 --2- 172.21.15.150:0/2672602608 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0d080cd850 0x7f0d0809cce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:26.504 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:26.500+0000 7f0d077fe640 1 -- 172.21.15.150:0/2672602608 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0d0815b350 con 0x7f0d0809ba60 2024-09-17T05:42:26.504 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:26.501+0000 7f0d077fe640 1 --2- 172.21.15.150:0/2672602608 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0d0809ba60 0x7f0d08166820 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f0cf800d730 tx=0x7f0cf800dbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:42:26.504 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:26.501+0000 7f0ceffff640 1 -- 172.21.15.150:0/2672602608 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0cf8017070 con 0x7f0d0809ba60 2024-09-17T05:42:26.504 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:26.501+0000 7f0ceffff640 1 -- 172.21.15.150:0/2672602608 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0cf8009a30 con 0x7f0d0809ba60 2024-09-17T05:42:26.504 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:26.501+0000 7f0ceffff640 1 -- 172.21.15.150:0/2672602608 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0cf8010460 con 0x7f0d0809ba60 2024-09-17T05:42:26.504 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:26.501+0000 7f0d0deb2640 1 -- 172.21.15.150:0/2672602608 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0d0815b850 con 0x7f0d0809ba60 2024-09-17T05:42:26.504 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:26.501+0000 7f0d0deb2640 1 -- 172.21.15.150:0/2672602608 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0d08164e60 con 0x7f0d0809ba60 2024-09-17T05:42:26.505 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:26.502+0000 7f0d0deb2640 1 -- 172.21.15.150:0/2672602608 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0d080b7330 con 0x7f0d0809ba60 2024-09-17T05:42:26.505 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:26.503+0000 7f0ceffff640 1 -- 172.21.15.150:0/2672602608 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f0cf801a070 con 0x7f0d0809ba60 2024-09-17T05:42:26.505 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:26.503+0000 7f0ceffff640 1 --2- 172.21.15.150:0/2672602608 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f0cf4078bc0 0x7f0cf407b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:42:26.506 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:26.503+0000 7f0ceffff640 1 -- 172.21.15.150:0/2672602608 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f0cf809add0 con 0x7f0d0809ba60 2024-09-17T05:42:26.506 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:26.503+0000 7f0d06ffd640 1 --2- 172.21.15.150:0/2672602608 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f0cf4078bc0 0x7f0cf407b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:42:26.506 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:26.504+0000 7f0d06ffd640 1 --2- 172.21.15.150:0/2672602608 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f0cf4078bc0 0x7f0cf407b0d0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f0d081670b0 tx=0x7f0cfc009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:42:26.509 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:26.508+0000 7f0ceffff640 1 -- 172.21.15.150:0/2672602608 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f0cf8062bc0 con 0x7f0d0809ba60 2024-09-17T05:42:26.719 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:26.718+0000 7f0d0deb2640 1 -- 172.21.15.150:0/2672602608 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f0d08072a60 con 0x7f0d0809ba60 2024-09-17T05:42:26.719 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:26.719+0000 7f0ceffff640 1 -- 172.21.15.150:0/2672602608 <== mon.0 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) ==== 93+0+5226 (secure 0 0 0) 0x7f0cf809c090 con 0x7f0d0809ba60 2024-09-17T05:42:26.720 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-09-17T05:42:26.720 INFO:teuthology.orchestra.run.smithi150.stdout:{"epoch":6,"btime":"2024-09-17T05:41:59:940454+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4316,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6835/357154046","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6833","nonce":357154046},{"type":"v1","addr":"172.21.15.150:6835","nonce":357154046}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4377,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6834/2757381484","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6832","nonce":2757381484},{"type":"v1","addr":"172.21.15.150:6834","nonce":2757381484}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4411,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6835/3751002674","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6834","nonce":3751002674},{"type":"v1","addr":"172.21.15.176:6835","nonce":3751002674}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T05:41:57.292807+0000","modified":"2024-09-17T05:41:59.294767+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4414},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4414":{"gid":4414,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.176:6837/1714683410","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6836","nonce":1714683410},{"type":"v1","addr":"172.21.15.176:6837","nonce":1714683410}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4414,"qdb_cluster":[4414]},"id":1}]} 2024-09-17T05:42:26.720 INFO:teuthology.orchestra.run.smithi150.stderr:dumped fsmap epoch 6 2024-09-17T05:42:26.722 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:26.721+0000 7f0d0deb2640 1 -- 172.21.15.150:0/2672602608 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f0cf4078bc0 msgr2=0x7f0cf407b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:26.722 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:26.721+0000 7f0d0deb2640 1 --2- 172.21.15.150:0/2672602608 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f0cf4078bc0 0x7f0cf407b0d0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f0d081670b0 tx=0x7f0cfc009040 comp rx=0 tx=0).stop 2024-09-17T05:42:26.722 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:26.721+0000 7f0d0deb2640 1 -- 172.21.15.150:0/2672602608 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0d0809ba60 msgr2=0x7f0d08166820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:26.722 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:26.721+0000 7f0d0deb2640 1 --2- 172.21.15.150:0/2672602608 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0d0809ba60 0x7f0d08166820 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f0cf800d730 tx=0x7f0cf800dbf0 comp rx=0 tx=0).stop 2024-09-17T05:42:26.722 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:26.721+0000 7f0d0deb2640 1 -- 172.21.15.150:0/2672602608 shutdown_connections 2024-09-17T05:42:26.722 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:26.721+0000 7f0d0deb2640 1 --2- 172.21.15.150:0/2672602608 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0d080cd850 0x7f0d0809cce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:26.722 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:26.721+0000 7f0d0deb2640 1 --2- 172.21.15.150:0/2672602608 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f0cf4078bc0 0x7f0cf407b0d0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:26.723 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:26.721+0000 7f0d0deb2640 1 --2- 172.21.15.150:0/2672602608 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0d080cd440 0x7f0d0809fdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:26.723 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:26.721+0000 7f0d0deb2640 1 --2- 172.21.15.150:0/2672602608 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0d0809ba60 0x7f0d08166820 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:26.723 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:26.721+0000 7f0d0deb2640 1 -- 172.21.15.150:0/2672602608 >> 172.21.15.150:0/2672602608 conn(0x7f0d080cee90 msgr2=0x7f0d08160560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:42:26.723 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:26.721+0000 7f0d0deb2640 1 -- 172.21.15.150:0/2672602608 shutdown_connections 2024-09-17T05:42:26.723 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:26.721+0000 7f0d0deb2640 1 -- 172.21.15.150:0/2672602608 wait complete. 2024-09-17T05:42:26.733 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T05:42:26.848 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:26.847+0000 7fc7f69ad640 1 -- 172.21.15.150:0/1819481792 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc7d80041e0 msgr2=0x7fc7d8004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:26.848 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:26.847+0000 7fc7f69ad640 1 --2- 172.21.15.150:0/1819481792 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc7d80041e0 0x7fc7d8004800 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fc7f0077250 tx=0x7fc7d8005830 comp rx=0 tx=0).stop 2024-09-17T05:42:26.848 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:26.847+0000 7fc7f4f4a640 1 -- 172.21.15.150:0/1819481792 reap_dead start 2024-09-17T05:42:26.848 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:26.847+0000 7fc7f69ad640 1 -- 172.21.15.150:0/1819481792 shutdown_connections 2024-09-17T05:42:26.848 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:26.847+0000 7fc7f69ad640 1 -- 172.21.15.150:0/1819481792 >> 172.21.15.150:0/1819481792 conn(0x7fc7f00b3fc0 msgr2=0x7fc7f00b43d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:42:26.848 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:26.847+0000 7fc7f69ad640 1 -- 172.21.15.150:0/1819481792 shutdown_connections 2024-09-17T05:42:26.848 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:26.847+0000 7fc7f69ad640 1 -- 172.21.15.150:0/1819481792 wait complete. 2024-09-17T05:42:26.849 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:26.849+0000 7fc7f69ad640 1 Processor -- start 2024-09-17T05:42:26.849 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:26.849+0000 7fc7f69ad640 1 -- start start 2024-09-17T05:42:26.852 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:26.850+0000 7fc7f69ad640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc7d80041e0 0x7fc7f00ca890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:42:26.852 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:26.850+0000 7fc7f69ad640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc7f009f9b0 0x7fc7f00cbaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:42:26.852 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:26.850+0000 7fc7f69ad640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc7f009fdc0 0x7fc7f00c5f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:42:26.852 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:26.850+0000 7fc7f69ad640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7fc7f00b2390 con 0x7fc7d80041e0 2024-09-17T05:42:26.853 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:26.850+0000 7fc7f69ad640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fc7f00b2210 con 0x7fc7f009f9b0 2024-09-17T05:42:26.853 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:26.850+0000 7fc7f69ad640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fc7f00ceb70 con 0x7fc7f009fdc0 2024-09-17T05:42:26.853 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:26.850+0000 7fc7effff640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc7d80041e0 0x7fc7f00ca890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:42:26.853 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:26.850+0000 7fc7effff640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc7d80041e0 0x7fc7f00ca890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:35760/0 (socket says 172.21.15.150:35760) 2024-09-17T05:42:26.853 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:26.850+0000 7fc7effff640 1 -- 172.21.15.150:0/297479097 learned_addr learned my addr 172.21.15.150:0/297479097 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:42:26.853 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:26.850+0000 7fc7ef7fe640 1 --2- 172.21.15.150:0/297479097 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc7f009f9b0 0x7fc7f00cbaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:42:26.853 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:26.850+0000 7fc7f4f4a640 1 --2- 172.21.15.150:0/297479097 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc7f009fdc0 0x7fc7f00c5f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:42:26.853 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:26.851+0000 7fc7effff640 1 -- 172.21.15.150:0/297479097 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc7f009fdc0 msgr2=0x7fc7f00c5f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:26.853 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:26.851+0000 7fc7effff640 1 --2- 172.21.15.150:0/297479097 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc7f009fdc0 0x7fc7f00c5f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:26.853 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:26.851+0000 7fc7effff640 1 -- 172.21.15.150:0/297479097 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc7f009f9b0 msgr2=0x7fc7f00cbaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:26.853 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:26.851+0000 7fc7effff640 1 --2- 172.21.15.150:0/297479097 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc7f009f9b0 0x7fc7f00cbaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:26.853 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:26.851+0000 7fc7effff640 1 -- 172.21.15.150:0/297479097 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc7f00c97f0 con 0x7fc7d80041e0 2024-09-17T05:42:26.854 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:26.851+0000 7fc7effff640 1 --2- 172.21.15.150:0/297479097 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc7d80041e0 0x7fc7f00ca890 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fc7e0006630 tx=0x7fc7e00039c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:42:26.854 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:26.851+0000 7fc7ecff9640 1 -- 172.21.15.150:0/297479097 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7e0015070 con 0x7fc7d80041e0 2024-09-17T05:42:26.854 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:26.851+0000 7fc7ecff9640 1 -- 172.21.15.150:0/297479097 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc7e0011920 con 0x7fc7d80041e0 2024-09-17T05:42:26.854 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:26.851+0000 7fc7f69ad640 1 -- 172.21.15.150:0/297479097 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc7f00c9ad0 con 0x7fc7d80041e0 2024-09-17T05:42:26.854 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:26.851+0000 7fc7ecff9640 1 -- 172.21.15.150:0/297479097 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7e0011d70 con 0x7fc7d80041e0 2024-09-17T05:42:26.854 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:26.851+0000 7fc7f69ad640 1 -- 172.21.15.150:0/297479097 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc7f00ca090 con 0x7fc7d80041e0 2024-09-17T05:42:26.854 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:26.852+0000 7fc7f69ad640 1 -- 172.21.15.150:0/297479097 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc7f00b1960 con 0x7fc7d80041e0 2024-09-17T05:42:26.855 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:26.853+0000 7fc7ecff9640 1 -- 172.21.15.150:0/297479097 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fc7e0018070 con 0x7fc7d80041e0 2024-09-17T05:42:26.855 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:26.853+0000 7fc7ecff9640 1 --2- 172.21.15.150:0/297479097 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fc7dc078b90 0x7fc7dc07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:42:26.855 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:26.853+0000 7fc7ecff9640 1 -- 172.21.15.150:0/297479097 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7fc7e009bad0 con 0x7fc7d80041e0 2024-09-17T05:42:26.855 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:26.854+0000 7fc7ef7fe640 1 --2- 172.21.15.150:0/297479097 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fc7dc078b90 0x7fc7dc07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:42:26.855 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:26.854+0000 7fc7ef7fe640 1 --2- 172.21.15.150:0/297479097 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fc7dc078b90 0x7fc7dc07b0a0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fc7e4035000 tx=0x7fc7e40046c0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:42:26.858 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:26.858+0000 7fc7ecff9640 1 -- 172.21.15.150:0/297479097 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fc7e00638d0 con 0x7fc7d80041e0 2024-09-17T05:42:27.034 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:27.034+0000 7fc7f69ad640 1 -- 172.21.15.150:0/297479097 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fc7f00716e0 con 0x7fc7d80041e0 2024-09-17T05:42:27.035 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:27.035+0000 7fc7ecff9640 1 -- 172.21.15.150:0/297479097 <== mon.0 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) ==== 74+0+16701 (secure 0 0 0) 0x7fc7e0068300 con 0x7fc7d80041e0 2024-09-17T05:42:27.036 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-09-17T05:42:27.036 INFO:teuthology.orchestra.run.smithi150.stdout:{"epoch":23,"fsid":"9f2e05e9-d629-47b3-b26b-1360655b7d20","created":"2024-09-17T05:41:32.502979+0000","modified":"2024-09-17T05:41:58.934156+0000","last_up_change":"2024-09-17T05:41:46.150225+0000","last_in_change":"2024-09-17T05:41:36.120274+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T05:41:46.860779+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-17T05:41:55.155732+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-17T05:41:56.250888+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"4f31c018-c8a4-4d6d-b0c2-a597c47aae4a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6800","nonce":479374392},{"type":"v1","addr":"172.21.15.150:6801","nonce":479374392}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6802","nonce":479374392},{"type":"v1","addr":"172.21.15.150:6803","nonce":479374392}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6806","nonce":479374392},{"type":"v1","addr":"172.21.15.150:6807","nonce":479374392}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6804","nonce":479374392},{"type":"v1","addr":"172.21.15.150:6805","nonce":479374392}]},"public_addr":"172.21.15.150:6801/479374392","cluster_addr":"172.21.15.150:6803/479374392","heartbeat_back_addr":"172.21.15.150:6807/479374392","heartbeat_front_addr":"172.21.15.150:6805/479374392","state":["exists","up"]},{"osd":1,"uuid":"6ff4a573-500b-4e04-9de3-39265ead78b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6824","nonce":913899800},{"type":"v1","addr":"172.21.15.150:6825","nonce":913899800}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6826","nonce":913899800},{"type":"v1","addr":"172.21.15.150:6827","nonce":913899800}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6830","nonce":913899800},{"type":"v1","addr":"172.21.15.150:6831","nonce":913899800}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6828","nonce":913899800},{"type":"v1","addr":"172.21.15.150:6829","nonce":913899800}]},"public_addr":"172.21.15.150:6825/913899800","cluster_addr":"172.21.15.150:6827/913899800","heartbeat_back_addr":"172.21.15.150:6831/913899800","heartbeat_front_addr":"172.21.15.150:6829/913899800","state":["exists","up"]},{"osd":2,"uuid":"bffea6f9-2465-4182-b205-00436c41ac1c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6816","nonce":363718461},{"type":"v1","addr":"172.21.15.150:6817","nonce":363718461}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6818","nonce":363718461},{"type":"v1","addr":"172.21.15.150:6819","nonce":363718461}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6822","nonce":363718461},{"type":"v1","addr":"172.21.15.150:6823","nonce":363718461}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6820","nonce":363718461},{"type":"v1","addr":"172.21.15.150:6821","nonce":363718461}]},"public_addr":"172.21.15.150:6817/363718461","cluster_addr":"172.21.15.150:6819/363718461","heartbeat_back_addr":"172.21.15.150:6823/363718461","heartbeat_front_addr":"172.21.15.150:6821/363718461","state":["exists","up"]},{"osd":3,"uuid":"cda70430-d1e1-427e-b04e-56db4031d078","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6808","nonce":3550994626},{"type":"v1","addr":"172.21.15.150:6809","nonce":3550994626}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6810","nonce":3550994626},{"type":"v1","addr":"172.21.15.150:6811","nonce":3550994626}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6814","nonce":3550994626},{"type":"v1","addr":"172.21.15.150:6815","nonce":3550994626}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6812","nonce":3550994626},{"type":"v1","addr":"172.21.15.150:6813","nonce":3550994626}]},"public_addr":"172.21.15.150:6809/3550994626","cluster_addr":"172.21.15.150:6811/3550994626","heartbeat_back_addr":"172.21.15.150:6815/3550994626","heartbeat_front_addr":"172.21.15.150:6813/3550994626","state":["exists","up"]},{"osd":4,"uuid":"3a0277fb-5e1e-4f68-bb2d-9a8a0152f64a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6810","nonce":2718261497},{"type":"v1","addr":"172.21.15.176:6811","nonce":2718261497}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6812","nonce":2718261497},{"type":"v1","addr":"172.21.15.176:6813","nonce":2718261497}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6816","nonce":2718261497},{"type":"v1","addr":"172.21.15.176:6817","nonce":2718261497}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6814","nonce":2718261497},{"type":"v1","addr":"172.21.15.176:6815","nonce":2718261497}]},"public_addr":"172.21.15.176:6811/2718261497","cluster_addr":"172.21.15.176:6813/2718261497","heartbeat_back_addr":"172.21.15.176:6817/2718261497","heartbeat_front_addr":"172.21.15.176:6815/2718261497","state":["exists","up"]},{"osd":5,"uuid":"33aebee6-0315-40b7-a11c-6702f0be494d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6818","nonce":2049295774},{"type":"v1","addr":"172.21.15.176:6819","nonce":2049295774}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6820","nonce":2049295774},{"type":"v1","addr":"172.21.15.176:6821","nonce":2049295774}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6824","nonce":2049295774},{"type":"v1","addr":"172.21.15.176:6825","nonce":2049295774}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6822","nonce":2049295774},{"type":"v1","addr":"172.21.15.176:6823","nonce":2049295774}]},"public_addr":"172.21.15.176:6819/2049295774","cluster_addr":"172.21.15.176:6821/2049295774","heartbeat_back_addr":"172.21.15.176:6825/2049295774","heartbeat_front_addr":"172.21.15.176:6823/2049295774","state":["exists","up"]},{"osd":6,"uuid":"4d24f360-6751-4263-841b-d77793d33540","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6826","nonce":2164458476},{"type":"v1","addr":"172.21.15.176:6827","nonce":2164458476}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6828","nonce":2164458476},{"type":"v1","addr":"172.21.15.176:6829","nonce":2164458476}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6832","nonce":2164458476},{"type":"v1","addr":"172.21.15.176:6833","nonce":2164458476}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6830","nonce":2164458476},{"type":"v1","addr":"172.21.15.176:6831","nonce":2164458476}]},"public_addr":"172.21.15.176:6827/2164458476","cluster_addr":"172.21.15.176:6829/2164458476","heartbeat_back_addr":"172.21.15.176:6833/2164458476","heartbeat_front_addr":"172.21.15.176:6831/2164458476","state":["exists","up"]},{"osd":7,"uuid":"c8594fda-c74a-4ba9-8277-caf101d58ca1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6802","nonce":3239587708},{"type":"v1","addr":"172.21.15.176:6803","nonce":3239587708}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6804","nonce":3239587708},{"type":"v1","addr":"172.21.15.176:6805","nonce":3239587708}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6808","nonce":3239587708},{"type":"v1","addr":"172.21.15.176:6809","nonce":3239587708}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6806","nonce":3239587708},{"type":"v1","addr":"172.21.15.176:6807","nonce":3239587708}]},"public_addr":"172.21.15.176:6803/3239587708","cluster_addr":"172.21.15.176:6805/3239587708","heartbeat_back_addr":"172.21.15.176:6809/3239587708","heartbeat_front_addr":"172.21.15.176:6807/3239587708","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:41:41.905151+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:41:42.705679+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:41:42.459673+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:41:42.440819+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:41:42.668428+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:41:42.694972+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:41:43.078535+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:41:42.363539+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T05:42:27.038 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:27.037+0000 7fc7f69ad640 1 -- 172.21.15.150:0/297479097 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fc7dc078b90 msgr2=0x7fc7dc07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:27.038 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:27.037+0000 7fc7f69ad640 1 --2- 172.21.15.150:0/297479097 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fc7dc078b90 0x7fc7dc07b0a0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fc7e4035000 tx=0x7fc7e40046c0 comp rx=0 tx=0).stop 2024-09-17T05:42:27.038 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:27.037+0000 7fc7f69ad640 1 -- 172.21.15.150:0/297479097 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc7d80041e0 msgr2=0x7fc7f00ca890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:27.038 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:27.037+0000 7fc7f69ad640 1 --2- 172.21.15.150:0/297479097 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc7d80041e0 0x7fc7f00ca890 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fc7e0006630 tx=0x7fc7e00039c0 comp rx=0 tx=0).stop 2024-09-17T05:42:27.038 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:27.037+0000 7fc7f69ad640 1 -- 172.21.15.150:0/297479097 shutdown_connections 2024-09-17T05:42:27.038 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:27.037+0000 7fc7f69ad640 1 --2- 172.21.15.150:0/297479097 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc7f009f9b0 0x7fc7f00cbaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:27.039 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:27.037+0000 7fc7f69ad640 1 --2- 172.21.15.150:0/297479097 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fc7dc078b90 0x7fc7dc07b0a0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:27.039 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:27.037+0000 7fc7f69ad640 1 --2- 172.21.15.150:0/297479097 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc7f009fdc0 0x7fc7f00c5f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:27.039 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:27.037+0000 7fc7f69ad640 1 --2- 172.21.15.150:0/297479097 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc7d80041e0 0x7fc7f00ca890 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:27.039 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:27.037+0000 7fc7f69ad640 1 -- 172.21.15.150:0/297479097 >> 172.21.15.150:0/297479097 conn(0x7fc7f00b3fc0 msgr2=0x7fc7f015d610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:42:27.039 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:27.038+0000 7fc7f69ad640 1 -- 172.21.15.150:0/297479097 shutdown_connections 2024-09-17T05:42:27.039 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:27.038+0000 7fc7f69ad640 1 -- 172.21.15.150:0/297479097 wait complete. 2024-09-17T05:42:27.050 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-09-17T05:42:27.050 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T05:42:27.164 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:27.163+0000 7f78a7769640 1 -- 172.21.15.150:0/1682494045 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f788c004800 msgr2=0x7f788c004c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:27.164 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:27.163+0000 7f78a7769640 1 --2- 172.21.15.150:0/1682494045 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f788c004800 0x7f788c004c10 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f7890006fa0 tx=0x7f788c005830 comp rx=0 tx=0).stop 2024-09-17T05:42:27.164 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:27.163+0000 7f78a7769640 1 -- 172.21.15.150:0/1682494045 shutdown_connections 2024-09-17T05:42:27.164 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:27.163+0000 7f78a7769640 1 --2- 172.21.15.150:0/1682494045 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f788c004800 0x7f788c004c10 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:27.165 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:27.163+0000 7f78a7769640 1 -- 172.21.15.150:0/1682494045 >> 172.21.15.150:0/1682494045 conn(0x7f78a006d730 msgr2=0x7f78a00b1e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:42:27.165 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:27.163+0000 7f78a7769640 1 -- 172.21.15.150:0/1682494045 shutdown_connections 2024-09-17T05:42:27.165 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:27.163+0000 7f78a7769640 1 -- 172.21.15.150:0/1682494045 wait complete. 2024-09-17T05:42:27.165 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:27.165+0000 7f78a7769640 1 Processor -- start 2024-09-17T05:42:27.165 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:27.165+0000 7f78a7769640 1 -- start start 2024-09-17T05:42:27.168 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:27.166+0000 7f78a7769640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f788c004800 0x7f78a00aee00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:42:27.168 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:27.166+0000 7f78a7769640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f78a0147170 0x7f78a015ce90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:42:27.168 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:27.166+0000 7f78a7769640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f78a015d3d0 0x7f78a0148e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:42:27.168 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:27.166+0000 7f78a7769640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f78a0070a20 con 0x7f788c004800 2024-09-17T05:42:27.168 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:27.166+0000 7f78a7769640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f78a0071340 con 0x7f78a0147170 2024-09-17T05:42:27.168 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:27.166+0000 7f78a7769640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f78a0073040 con 0x7f78a015d3d0 2024-09-17T05:42:27.168 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:27.167+0000 7f78a5505640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f788c004800 0x7f78a00aee00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:42:27.169 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:27.167+0000 7f78a5505640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f788c004800 0x7f78a00aee00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:35778/0 (socket says 172.21.15.150:35778) 2024-09-17T05:42:27.169 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:27.167+0000 7f78a5505640 1 -- 172.21.15.150:0/1496009633 learned_addr learned my addr 172.21.15.150:0/1496009633 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:42:27.169 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:27.167+0000 7f78a5d06640 1 --2- 172.21.15.150:0/1496009633 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f78a015d3d0 0x7f78a0148e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:42:27.169 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:27.167+0000 7f78a4d04640 1 --2- 172.21.15.150:0/1496009633 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f78a0147170 0x7f78a015ce90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:42:27.169 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:27.167+0000 7f78a5505640 1 -- 172.21.15.150:0/1496009633 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f78a015d3d0 msgr2=0x7f78a0148e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:27.169 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:27.167+0000 7f78a5505640 1 --2- 172.21.15.150:0/1496009633 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f78a015d3d0 0x7f78a0148e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:27.169 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:27.167+0000 7f78a5505640 1 -- 172.21.15.150:0/1496009633 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f78a0147170 msgr2=0x7f78a015ce90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:27.169 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:27.167+0000 7f78a5505640 1 --2- 172.21.15.150:0/1496009633 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f78a0147170 0x7f78a015ce90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:27.169 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:27.167+0000 7f78a5505640 1 -- 172.21.15.150:0/1496009633 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f78a014b2e0 con 0x7f788c004800 2024-09-17T05:42:27.169 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:27.167+0000 7f78a5505640 1 --2- 172.21.15.150:0/1496009633 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f788c004800 0x7f78a00aee00 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f789c003ed0 tx=0x7f789c001630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:42:27.169 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:27.167+0000 7f7895ffb640 1 -- 172.21.15.150:0/1496009633 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f789c015070 con 0x7f788c004800 2024-09-17T05:42:27.169 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:27.167+0000 7f7895ffb640 1 -- 172.21.15.150:0/1496009633 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f789c011840 con 0x7f788c004800 2024-09-17T05:42:27.169 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:27.167+0000 7f78a7769640 1 -- 172.21.15.150:0/1496009633 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f78a015d7e0 con 0x7f788c004800 2024-09-17T05:42:27.170 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:27.167+0000 7f7895ffb640 1 -- 172.21.15.150:0/1496009633 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f789c011c90 con 0x7f788c004800 2024-09-17T05:42:27.170 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:27.167+0000 7f78a7769640 1 -- 172.21.15.150:0/1496009633 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f78a015bd00 con 0x7f788c004800 2024-09-17T05:42:27.170 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:27.168+0000 7f78a7769640 1 -- 172.21.15.150:0/1496009633 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f78a00735a0 con 0x7f788c004800 2024-09-17T05:42:27.171 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:27.169+0000 7f7895ffb640 1 -- 172.21.15.150:0/1496009633 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f789c018070 con 0x7f788c004800 2024-09-17T05:42:27.171 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:27.169+0000 7f7895ffb640 1 --2- 172.21.15.150:0/1496009633 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f7884078b90 0x7f788407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:42:27.171 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:27.170+0000 7f7895ffb640 1 -- 172.21.15.150:0/1496009633 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f789c09b8e0 con 0x7f788c004800 2024-09-17T05:42:27.171 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:27.170+0000 7f78a4d04640 1 --2- 172.21.15.150:0/1496009633 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f7884078b90 0x7f788407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:42:27.171 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:27.170+0000 7f78a4d04640 1 --2- 172.21.15.150:0/1496009633 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f7884078b90 0x7f788407b0a0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f7890034000 tx=0x7f78a006f5e0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:42:27.174 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:27.174+0000 7f7895ffb640 1 -- 172.21.15.150:0/1496009633 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f78a015d7e0 con 0x7f788c004800 2024-09-17T05:42:27.384 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:27.383+0000 7f78a7769640 1 -- 172.21.15.150:0/1496009633 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f78a015e420 con 0x7f788c004800 2024-09-17T05:42:27.384 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:27.384+0000 7f7895ffb640 1 -- 172.21.15.150:0/1496009633 <== mon.0 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) ==== 93+0+5226 (secure 0 0 0) 0x7f789c063760 con 0x7f788c004800 2024-09-17T05:42:27.385 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-09-17T05:42:27.385 INFO:teuthology.orchestra.run.smithi150.stdout:{"epoch":6,"btime":"2024-09-17T05:41:59:940454+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4316,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6835/357154046","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6833","nonce":357154046},{"type":"v1","addr":"172.21.15.150:6835","nonce":357154046}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4377,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6834/2757381484","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6832","nonce":2757381484},{"type":"v1","addr":"172.21.15.150:6834","nonce":2757381484}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4411,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6835/3751002674","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6834","nonce":3751002674},{"type":"v1","addr":"172.21.15.176:6835","nonce":3751002674}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T05:41:57.292807+0000","modified":"2024-09-17T05:41:59.294767+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4414},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4414":{"gid":4414,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.176:6837/1714683410","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6836","nonce":1714683410},{"type":"v1","addr":"172.21.15.176:6837","nonce":1714683410}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4414,"qdb_cluster":[4414]},"id":1}]} 2024-09-17T05:42:27.385 INFO:teuthology.orchestra.run.smithi150.stderr:dumped fsmap epoch 6 2024-09-17T05:42:27.387 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:27.386+0000 7f78a7769640 1 -- 172.21.15.150:0/1496009633 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f7884078b90 msgr2=0x7f788407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:27.387 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:27.386+0000 7f78a7769640 1 --2- 172.21.15.150:0/1496009633 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f7884078b90 0x7f788407b0a0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f7890034000 tx=0x7f78a006f5e0 comp rx=0 tx=0).stop 2024-09-17T05:42:27.387 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:27.386+0000 7f78a7769640 1 -- 172.21.15.150:0/1496009633 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f788c004800 msgr2=0x7f78a00aee00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:27.387 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:27.386+0000 7f78a7769640 1 --2- 172.21.15.150:0/1496009633 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f788c004800 0x7f78a00aee00 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f789c003ed0 tx=0x7f789c001630 comp rx=0 tx=0).stop 2024-09-17T05:42:27.387 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:27.386+0000 7f78a7769640 1 -- 172.21.15.150:0/1496009633 shutdown_connections 2024-09-17T05:42:27.387 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:27.386+0000 7f78a7769640 1 --2- 172.21.15.150:0/1496009633 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f78a0147170 0x7f78a015ce90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:27.387 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:27.386+0000 7f78a7769640 1 --2- 172.21.15.150:0/1496009633 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f7884078b90 0x7f788407b0a0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:27.387 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:27.386+0000 7f78a7769640 1 --2- 172.21.15.150:0/1496009633 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f78a015d3d0 0x7f78a0148e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:27.387 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:27.386+0000 7f78a7769640 1 --2- 172.21.15.150:0/1496009633 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f788c004800 0x7f78a00aee00 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:27.387 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:27.386+0000 7f78a7769640 1 -- 172.21.15.150:0/1496009633 >> 172.21.15.150:0/1496009633 conn(0x7f78a006d730 msgr2=0x7f78a0099670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:42:27.388 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:27.386+0000 7f78a7769640 1 -- 172.21.15.150:0/1496009633 shutdown_connections 2024-09-17T05:42:27.388 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:27.386+0000 7f78a7769640 1 -- 172.21.15.150:0/1496009633 wait complete. 2024-09-17T05:42:27.398 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T05:42:27.512 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:27.511+0000 7f2e1448b640 1 -- 172.21.15.150:0/3556042552 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2e0c09ba60 msgr2=0x7f2e0c0b7330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:27.512 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:27.511+0000 7f2e1448b640 1 --2- 172.21.15.150:0/3556042552 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2e0c09ba60 0x7f2e0c0b7330 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f2e0c0cc9c0 tx=0x7f2dfc02a980 comp rx=0 tx=0).stop 2024-09-17T05:42:27.512 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:27.511+0000 7f2e1448b640 1 -- 172.21.15.150:0/3556042552 shutdown_connections 2024-09-17T05:42:27.512 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:27.511+0000 7f2e1448b640 1 --2- 172.21.15.150:0/3556042552 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2e0c0cffe0 0x7f2e0c0d03f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:27.512 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:27.511+0000 7f2e1448b640 1 --2- 172.21.15.150:0/3556042552 >> v2:172.21.15.176:3300/0 conn(0x7f2e0c0cd440 0x7f2e0c0cd850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:27.512 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:27.511+0000 7f2e1448b640 1 --2- 172.21.15.150:0/3556042552 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2e0c09ba60 0x7f2e0c0b7330 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:27.513 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:27.511+0000 7f2e1448b640 1 -- 172.21.15.150:0/3556042552 >> 172.21.15.150:0/3556042552 conn(0x7f2e0c0cee90 msgr2=0x7f2e0c0cf2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:42:27.513 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:27.511+0000 7f2e1448b640 1 -- 172.21.15.150:0/3556042552 shutdown_connections 2024-09-17T05:42:27.513 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:27.511+0000 7f2e1448b640 1 -- 172.21.15.150:0/3556042552 wait complete. 2024-09-17T05:42:27.513 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:27.513+0000 7f2e1448b640 1 Processor -- start 2024-09-17T05:42:27.513 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:27.513+0000 7f2e1448b640 1 -- start start 2024-09-17T05:42:27.516 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:27.514+0000 7f2e1448b640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2e0c09ba60 0x7f2e0c0af0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:42:27.517 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:27.514+0000 7f2e1448b640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2e0c0cd440 0x7f2e0c0afc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:42:27.517 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:27.514+0000 7f2e1448b640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2e0c0cffe0 0x7f2e0c1d81c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:42:27.517 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:27.514+0000 7f2e1448b640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f2e0c0d0cc0 con 0x7f2e0c0cffe0 2024-09-17T05:42:27.517 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:27.514+0000 7f2e1448b640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f2e0c0d0b40 con 0x7f2e0c09ba60 2024-09-17T05:42:27.517 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:27.514+0000 7f2e1448b640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f2e0c0d0e40 con 0x7f2e0c0cd440 2024-09-17T05:42:27.517 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:27.514+0000 7f2e12a28640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2e0c0cffe0 0x7f2e0c1d81c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:42:27.517 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:27.514+0000 7f2e12a28640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2e0c0cffe0 0x7f2e0c1d81c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:35800/0 (socket says 172.21.15.150:35800) 2024-09-17T05:42:27.517 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:27.514+0000 7f2e12a28640 1 -- 172.21.15.150:0/4099821949 learned_addr learned my addr 172.21.15.150:0/4099821949 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:42:27.517 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:27.515+0000 7f2e12227640 1 --2- 172.21.15.150:0/4099821949 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2e0c09ba60 0x7f2e0c0af0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:42:27.517 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:27.515+0000 7f2e11a26640 1 --2- 172.21.15.150:0/4099821949 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2e0c0cd440 0x7f2e0c0afc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:42:27.517 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:27.515+0000 7f2e12a28640 1 -- 172.21.15.150:0/4099821949 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2e0c0cd440 msgr2=0x7f2e0c0afc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:27.517 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:27.515+0000 7f2e12a28640 1 --2- 172.21.15.150:0/4099821949 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2e0c0cd440 0x7f2e0c0afc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:27.518 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:27.515+0000 7f2e12a28640 1 -- 172.21.15.150:0/4099821949 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2e0c09ba60 msgr2=0x7f2e0c0af0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:27.518 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:27.515+0000 7f2e12a28640 1 --2- 172.21.15.150:0/4099821949 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2e0c09ba60 0x7f2e0c0af0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:27.518 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:27.515+0000 7f2e12a28640 1 -- 172.21.15.150:0/4099821949 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2e0c0b2970 con 0x7f2e0c0cffe0 2024-09-17T05:42:27.518 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:27.515+0000 7f2e11a26640 1 --2- 172.21.15.150:0/4099821949 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2e0c0cd440 0x7f2e0c0afc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:42:27.518 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:27.515+0000 7f2e12a28640 1 --2- 172.21.15.150:0/4099821949 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2e0c0cffe0 0x7f2e0c1d81c0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f2e0400e6a0 tx=0x7f2e0400eb60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:42:27.518 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:27.515+0000 7f2e0affd640 1 -- 172.21.15.150:0/4099821949 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e0400cab0 con 0x7f2e0c0cffe0 2024-09-17T05:42:27.518 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:27.515+0000 7f2e0affd640 1 -- 172.21.15.150:0/4099821949 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f2e0400cc50 con 0x7f2e0c0cffe0 2024-09-17T05:42:27.518 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:27.515+0000 7f2e1448b640 1 -- 172.21.15.150:0/4099821949 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2e0c0b2c50 con 0x7f2e0c0cffe0 2024-09-17T05:42:27.518 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:27.515+0000 7f2e0affd640 1 -- 172.21.15.150:0/4099821949 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e04005280 con 0x7f2e0c0cffe0 2024-09-17T05:42:27.519 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:27.515+0000 7f2e1448b640 1 -- 172.21.15.150:0/4099821949 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2e0c0ca660 con 0x7f2e0c0cffe0 2024-09-17T05:42:27.519 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:27.516+0000 7f2e1448b640 1 -- 172.21.15.150:0/4099821949 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2e0c0b26e0 con 0x7f2e0c0cffe0 2024-09-17T05:42:27.520 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:27.517+0000 7f2e0affd640 1 -- 172.21.15.150:0/4099821949 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f2e04005420 con 0x7f2e0c0cffe0 2024-09-17T05:42:27.520 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:27.517+0000 7f2e0affd640 1 --2- 172.21.15.150:0/4099821949 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f2df8078b90 0x7f2df807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:42:27.520 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:27.517+0000 7f2e0affd640 1 -- 172.21.15.150:0/4099821949 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f2e0409b550 con 0x7f2e0c0cffe0 2024-09-17T05:42:27.520 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:27.517+0000 7f2e12227640 1 --2- 172.21.15.150:0/4099821949 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f2df8078b90 0x7f2df807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:42:27.520 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:27.518+0000 7f2e12227640 1 --2- 172.21.15.150:0/4099821949 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f2df8078b90 0x7f2df807b0a0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f2dfc035000 tx=0x7f2dfc004ab0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:42:27.522 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:27.522+0000 7f2e0affd640 1 -- 172.21.15.150:0/4099821949 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f2e0400ce20 con 0x7f2e0c0cffe0 2024-09-17T05:42:27.731 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:27.730+0000 7f2e1448b640 1 -- 172.21.15.150:0/4099821949 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f2e0c06e240 con 0x7f2e0c0cffe0 2024-09-17T05:42:27.731 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:27.731+0000 7f2e0affd640 1 -- 172.21.15.150:0/4099821949 <== mon.0 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) ==== 93+0+5226 (secure 0 0 0) 0x7f2e04063a20 con 0x7f2e0c0cffe0 2024-09-17T05:42:27.732 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-09-17T05:42:27.732 INFO:teuthology.orchestra.run.smithi150.stdout:{"epoch":6,"btime":"2024-09-17T05:41:59:940454+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4316,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6835/357154046","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6833","nonce":357154046},{"type":"v1","addr":"172.21.15.150:6835","nonce":357154046}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4377,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6834/2757381484","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6832","nonce":2757381484},{"type":"v1","addr":"172.21.15.150:6834","nonce":2757381484}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4411,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6835/3751002674","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6834","nonce":3751002674},{"type":"v1","addr":"172.21.15.176:6835","nonce":3751002674}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T05:41:57.292807+0000","modified":"2024-09-17T05:41:59.294767+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4414},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4414":{"gid":4414,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.176:6837/1714683410","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6836","nonce":1714683410},{"type":"v1","addr":"172.21.15.176:6837","nonce":1714683410}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4414,"qdb_cluster":[4414]},"id":1}]} 2024-09-17T05:42:27.732 INFO:teuthology.orchestra.run.smithi150.stderr:dumped fsmap epoch 6 2024-09-17T05:42:27.734 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:27.733+0000 7f2e1448b640 1 -- 172.21.15.150:0/4099821949 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f2df8078b90 msgr2=0x7f2df807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:27.734 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:27.733+0000 7f2e1448b640 1 --2- 172.21.15.150:0/4099821949 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f2df8078b90 0x7f2df807b0a0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f2dfc035000 tx=0x7f2dfc004ab0 comp rx=0 tx=0).stop 2024-09-17T05:42:27.734 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:27.733+0000 7f2e1448b640 1 -- 172.21.15.150:0/4099821949 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2e0c0cffe0 msgr2=0x7f2e0c1d81c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:27.734 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:27.733+0000 7f2e1448b640 1 --2- 172.21.15.150:0/4099821949 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2e0c0cffe0 0x7f2e0c1d81c0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f2e0400e6a0 tx=0x7f2e0400eb60 comp rx=0 tx=0).stop 2024-09-17T05:42:27.734 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:27.733+0000 7f2e1448b640 1 -- 172.21.15.150:0/4099821949 shutdown_connections 2024-09-17T05:42:27.734 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:27.733+0000 7f2e1448b640 1 --2- 172.21.15.150:0/4099821949 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f2df8078b90 0x7f2df807b0a0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:27.734 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:27.733+0000 7f2e1448b640 1 --2- 172.21.15.150:0/4099821949 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2e0c0cffe0 0x7f2e0c1d81c0 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:27.735 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:27.733+0000 7f2e1448b640 1 --2- 172.21.15.150:0/4099821949 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2e0c0cd440 0x7f2e0c0afc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:27.735 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:27.733+0000 7f2e1448b640 1 --2- 172.21.15.150:0/4099821949 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2e0c09ba60 0x7f2e0c0af0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:27.735 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:27.733+0000 7f2e1448b640 1 -- 172.21.15.150:0/4099821949 >> 172.21.15.150:0/4099821949 conn(0x7f2e0c0cee90 msgr2=0x7f2e0c09c400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:42:27.735 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:27.733+0000 7f2e1448b640 1 -- 172.21.15.150:0/4099821949 shutdown_connections 2024-09-17T05:42:27.735 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:27.733+0000 7f2e1448b640 1 -- 172.21.15.150:0/4099821949 wait complete. 2024-09-17T05:42:27.745 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T05:42:27.859 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:27.858+0000 7f9044bda640 1 -- 172.21.15.150:0/620166696 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f90400b5ff0 msgr2=0x7f90400b67a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:27.860 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:27.858+0000 7f9044bda640 1 --2- 172.21.15.150:0/620166696 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f90400b5ff0 0x7f90400b67a0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f90400cbb80 tx=0x7f903002a560 comp rx=0 tx=0).stop 2024-09-17T05:42:27.860 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:27.858+0000 7f9044bda640 1 -- 172.21.15.150:0/620166696 shutdown_connections 2024-09-17T05:42:27.860 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:27.858+0000 7f9044bda640 1 --2- 172.21.15.150:0/620166696 >> v2:172.21.15.176:3300/0 conn(0x7f90400ce370 0x7f90400cbc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:27.860 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:27.858+0000 7f9044bda640 1 --2- 172.21.15.150:0/620166696 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f90400cda20 0x7f90400cde30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:27.860 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:27.858+0000 7f9044bda640 1 --2- 172.21.15.150:0/620166696 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f90400b5ff0 0x7f90400b67a0 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:27.860 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:27.858+0000 7f9044bda640 1 -- 172.21.15.150:0/620166696 >> 172.21.15.150:0/620166696 conn(0x7f90400b2e80 msgr2=0x7f90400b3290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:42:27.860 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:27.858+0000 7f9044bda640 1 -- 172.21.15.150:0/620166696 shutdown_connections 2024-09-17T05:42:27.860 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:27.858+0000 7f9044bda640 1 -- 172.21.15.150:0/620166696 wait complete. 2024-09-17T05:42:27.861 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:27.860+0000 7f9044bda640 1 Processor -- start 2024-09-17T05:42:27.861 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:27.860+0000 7f9044bda640 1 -- start start 2024-09-17T05:42:27.864 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:27.862+0000 7f9044bda640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f90400b5ff0 0x7f90400c7170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:42:27.864 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:27.862+0000 7f9044bda640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f90400cda20 0x7f90400ae160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:42:27.864 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:27.862+0000 7f9044bda640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f90400ce370 0x7f90400ae6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:42:27.864 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:27.862+0000 7f9044bda640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f90400cc5c0 con 0x7f90400ce370 2024-09-17T05:42:27.864 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:27.862+0000 7f9044bda640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f90400cc440 con 0x7f90400cda20 2024-09-17T05:42:27.864 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:27.862+0000 7f9044bda640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f90400cc740 con 0x7f90400b5ff0 2024-09-17T05:42:27.864 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:27.862+0000 7f903ed9d640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f90400ce370 0x7f90400ae6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:42:27.865 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:27.862+0000 7f903ed9d640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f90400ce370 0x7f90400ae6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:35812/0 (socket says 172.21.15.150:35812) 2024-09-17T05:42:27.865 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:27.862+0000 7f903ed9d640 1 -- 172.21.15.150:0/3930293096 learned_addr learned my addr 172.21.15.150:0/3930293096 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:42:27.865 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:27.862+0000 7f903dd9b640 1 --2- 172.21.15.150:0/3930293096 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f90400cda20 0x7f90400ae160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:42:27.865 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:27.862+0000 7f903e59c640 1 --2- 172.21.15.150:0/3930293096 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f90400b5ff0 0x7f90400c7170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:42:27.865 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:27.862+0000 7f903ed9d640 1 -- 172.21.15.150:0/3930293096 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f90400b5ff0 msgr2=0x7f90400c7170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:27.865 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:27.862+0000 7f903ed9d640 1 --2- 172.21.15.150:0/3930293096 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f90400b5ff0 0x7f90400c7170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:27.865 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:27.862+0000 7f903ed9d640 1 -- 172.21.15.150:0/3930293096 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f90400cda20 msgr2=0x7f90400ae160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:27.865 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:27.862+0000 7f903ed9d640 1 --2- 172.21.15.150:0/3930293096 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f90400cda20 0x7f90400ae160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:27.865 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:27.862+0000 7f903ed9d640 1 -- 172.21.15.150:0/3930293096 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f90400afa10 con 0x7f90400ce370 2024-09-17T05:42:27.865 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:27.862+0000 7f903ed9d640 1 --2- 172.21.15.150:0/3930293096 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f90400ce370 0x7f90400ae6a0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f903800ea70 tx=0x7f903800ef30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:42:27.866 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:27.862+0000 7f902effd640 1 -- 172.21.15.150:0/3930293096 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f903800ce40 con 0x7f90400ce370 2024-09-17T05:42:27.866 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:27.863+0000 7f902effd640 1 -- 172.21.15.150:0/3930293096 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9038004c10 con 0x7f90400ce370 2024-09-17T05:42:27.866 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:27.863+0000 7f9044bda640 1 -- 172.21.15.150:0/3930293096 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f90400cb2b0 con 0x7f90400ce370 2024-09-17T05:42:27.866 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:27.863+0000 7f902effd640 1 -- 172.21.15.150:0/3930293096 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9038005020 con 0x7f90400ce370 2024-09-17T05:42:27.866 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:27.863+0000 7f9044bda640 1 -- 172.21.15.150:0/3930293096 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f90400af210 con 0x7f90400ce370 2024-09-17T05:42:27.866 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:27.863+0000 7f9044bda640 1 -- 172.21.15.150:0/3930293096 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f90400cde30 con 0x7f90400ce370 2024-09-17T05:42:27.867 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:27.864+0000 7f902effd640 1 -- 172.21.15.150:0/3930293096 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f90380051c0 con 0x7f90400ce370 2024-09-17T05:42:27.867 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:27.865+0000 7f902effd640 1 --2- 172.21.15.150:0/3930293096 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f9020078b90 0x7f902007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:42:27.867 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:27.865+0000 7f902effd640 1 -- 172.21.15.150:0/3930293096 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f903809b9a0 con 0x7f90400ce370 2024-09-17T05:42:27.867 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:27.865+0000 7f903e59c640 1 --2- 172.21.15.150:0/3930293096 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f9020078b90 0x7f902007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:42:27.867 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:27.866+0000 7f903e59c640 1 --2- 172.21.15.150:0/3930293096 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f9020078b90 0x7f902007b0a0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f9030033000 tx=0x7f9030004730 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:42:27.870 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:27.869+0000 7f902effd640 1 -- 172.21.15.150:0/3930293096 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f90380637a0 con 0x7f90400ce370 2024-09-17T05:42:28.046 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:28.046+0000 7f9044bda640 1 -- 172.21.15.150:0/3930293096 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f904015a310 con 0x7f90400ce370 2024-09-17T05:42:28.047 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:28.047+0000 7f902effd640 1 -- 172.21.15.150:0/3930293096 <== mon.0 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) ==== 74+0+16701 (secure 0 0 0) 0x7f90380681d0 con 0x7f90400ce370 2024-09-17T05:42:28.048 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-09-17T05:42:28.048 INFO:teuthology.orchestra.run.smithi150.stdout:{"epoch":23,"fsid":"9f2e05e9-d629-47b3-b26b-1360655b7d20","created":"2024-09-17T05:41:32.502979+0000","modified":"2024-09-17T05:41:58.934156+0000","last_up_change":"2024-09-17T05:41:46.150225+0000","last_in_change":"2024-09-17T05:41:36.120274+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T05:41:46.860779+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-17T05:41:55.155732+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-17T05:41:56.250888+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"4f31c018-c8a4-4d6d-b0c2-a597c47aae4a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6800","nonce":479374392},{"type":"v1","addr":"172.21.15.150:6801","nonce":479374392}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6802","nonce":479374392},{"type":"v1","addr":"172.21.15.150:6803","nonce":479374392}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6806","nonce":479374392},{"type":"v1","addr":"172.21.15.150:6807","nonce":479374392}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6804","nonce":479374392},{"type":"v1","addr":"172.21.15.150:6805","nonce":479374392}]},"public_addr":"172.21.15.150:6801/479374392","cluster_addr":"172.21.15.150:6803/479374392","heartbeat_back_addr":"172.21.15.150:6807/479374392","heartbeat_front_addr":"172.21.15.150:6805/479374392","state":["exists","up"]},{"osd":1,"uuid":"6ff4a573-500b-4e04-9de3-39265ead78b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6824","nonce":913899800},{"type":"v1","addr":"172.21.15.150:6825","nonce":913899800}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6826","nonce":913899800},{"type":"v1","addr":"172.21.15.150:6827","nonce":913899800}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6830","nonce":913899800},{"type":"v1","addr":"172.21.15.150:6831","nonce":913899800}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6828","nonce":913899800},{"type":"v1","addr":"172.21.15.150:6829","nonce":913899800}]},"public_addr":"172.21.15.150:6825/913899800","cluster_addr":"172.21.15.150:6827/913899800","heartbeat_back_addr":"172.21.15.150:6831/913899800","heartbeat_front_addr":"172.21.15.150:6829/913899800","state":["exists","up"]},{"osd":2,"uuid":"bffea6f9-2465-4182-b205-00436c41ac1c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6816","nonce":363718461},{"type":"v1","addr":"172.21.15.150:6817","nonce":363718461}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6818","nonce":363718461},{"type":"v1","addr":"172.21.15.150:6819","nonce":363718461}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6822","nonce":363718461},{"type":"v1","addr":"172.21.15.150:6823","nonce":363718461}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6820","nonce":363718461},{"type":"v1","addr":"172.21.15.150:6821","nonce":363718461}]},"public_addr":"172.21.15.150:6817/363718461","cluster_addr":"172.21.15.150:6819/363718461","heartbeat_back_addr":"172.21.15.150:6823/363718461","heartbeat_front_addr":"172.21.15.150:6821/363718461","state":["exists","up"]},{"osd":3,"uuid":"cda70430-d1e1-427e-b04e-56db4031d078","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6808","nonce":3550994626},{"type":"v1","addr":"172.21.15.150:6809","nonce":3550994626}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6810","nonce":3550994626},{"type":"v1","addr":"172.21.15.150:6811","nonce":3550994626}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6814","nonce":3550994626},{"type":"v1","addr":"172.21.15.150:6815","nonce":3550994626}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6812","nonce":3550994626},{"type":"v1","addr":"172.21.15.150:6813","nonce":3550994626}]},"public_addr":"172.21.15.150:6809/3550994626","cluster_addr":"172.21.15.150:6811/3550994626","heartbeat_back_addr":"172.21.15.150:6815/3550994626","heartbeat_front_addr":"172.21.15.150:6813/3550994626","state":["exists","up"]},{"osd":4,"uuid":"3a0277fb-5e1e-4f68-bb2d-9a8a0152f64a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6810","nonce":2718261497},{"type":"v1","addr":"172.21.15.176:6811","nonce":2718261497}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6812","nonce":2718261497},{"type":"v1","addr":"172.21.15.176:6813","nonce":2718261497}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6816","nonce":2718261497},{"type":"v1","addr":"172.21.15.176:6817","nonce":2718261497}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6814","nonce":2718261497},{"type":"v1","addr":"172.21.15.176:6815","nonce":2718261497}]},"public_addr":"172.21.15.176:6811/2718261497","cluster_addr":"172.21.15.176:6813/2718261497","heartbeat_back_addr":"172.21.15.176:6817/2718261497","heartbeat_front_addr":"172.21.15.176:6815/2718261497","state":["exists","up"]},{"osd":5,"uuid":"33aebee6-0315-40b7-a11c-6702f0be494d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6818","nonce":2049295774},{"type":"v1","addr":"172.21.15.176:6819","nonce":2049295774}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6820","nonce":2049295774},{"type":"v1","addr":"172.21.15.176:6821","nonce":2049295774}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6824","nonce":2049295774},{"type":"v1","addr":"172.21.15.176:6825","nonce":2049295774}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6822","nonce":2049295774},{"type":"v1","addr":"172.21.15.176:6823","nonce":2049295774}]},"public_addr":"172.21.15.176:6819/2049295774","cluster_addr":"172.21.15.176:6821/2049295774","heartbeat_back_addr":"172.21.15.176:6825/2049295774","heartbeat_front_addr":"172.21.15.176:6823/2049295774","state":["exists","up"]},{"osd":6,"uuid":"4d24f360-6751-4263-841b-d77793d33540","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6826","nonce":2164458476},{"type":"v1","addr":"172.21.15.176:6827","nonce":2164458476}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6828","nonce":2164458476},{"type":"v1","addr":"172.21.15.176:6829","nonce":2164458476}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6832","nonce":2164458476},{"type":"v1","addr":"172.21.15.176:6833","nonce":2164458476}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6830","nonce":2164458476},{"type":"v1","addr":"172.21.15.176:6831","nonce":2164458476}]},"public_addr":"172.21.15.176:6827/2164458476","cluster_addr":"172.21.15.176:6829/2164458476","heartbeat_back_addr":"172.21.15.176:6833/2164458476","heartbeat_front_addr":"172.21.15.176:6831/2164458476","state":["exists","up"]},{"osd":7,"uuid":"c8594fda-c74a-4ba9-8277-caf101d58ca1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6802","nonce":3239587708},{"type":"v1","addr":"172.21.15.176:6803","nonce":3239587708}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6804","nonce":3239587708},{"type":"v1","addr":"172.21.15.176:6805","nonce":3239587708}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6808","nonce":3239587708},{"type":"v1","addr":"172.21.15.176:6809","nonce":3239587708}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6806","nonce":3239587708},{"type":"v1","addr":"172.21.15.176:6807","nonce":3239587708}]},"public_addr":"172.21.15.176:6803/3239587708","cluster_addr":"172.21.15.176:6805/3239587708","heartbeat_back_addr":"172.21.15.176:6809/3239587708","heartbeat_front_addr":"172.21.15.176:6807/3239587708","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:41:41.905151+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:41:42.705679+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:41:42.459673+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:41:42.440819+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:41:42.668428+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:41:42.694972+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:41:43.078535+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:41:42.363539+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T05:42:28.050 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:28.049+0000 7f9044bda640 1 -- 172.21.15.150:0/3930293096 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f9020078b90 msgr2=0x7f902007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:28.050 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:28.049+0000 7f9044bda640 1 --2- 172.21.15.150:0/3930293096 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f9020078b90 0x7f902007b0a0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f9030033000 tx=0x7f9030004730 comp rx=0 tx=0).stop 2024-09-17T05:42:28.050 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:28.049+0000 7f9044bda640 1 -- 172.21.15.150:0/3930293096 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f90400ce370 msgr2=0x7f90400ae6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:28.050 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:28.049+0000 7f9044bda640 1 --2- 172.21.15.150:0/3930293096 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f90400ce370 0x7f90400ae6a0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f903800ea70 tx=0x7f903800ef30 comp rx=0 tx=0).stop 2024-09-17T05:42:28.050 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:28.049+0000 7f9044bda640 1 -- 172.21.15.150:0/3930293096 shutdown_connections 2024-09-17T05:42:28.051 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:28.049+0000 7f9044bda640 1 --2- 172.21.15.150:0/3930293096 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f90400cda20 0x7f90400ae160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:28.051 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:28.049+0000 7f9044bda640 1 --2- 172.21.15.150:0/3930293096 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f9020078b90 0x7f902007b0a0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:28.051 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:28.049+0000 7f9044bda640 1 --2- 172.21.15.150:0/3930293096 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f90400ce370 0x7f90400ae6a0 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:28.051 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:28.049+0000 7f9044bda640 1 --2- 172.21.15.150:0/3930293096 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f90400b5ff0 0x7f90400c7170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:28.051 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:28.049+0000 7f9044bda640 1 -- 172.21.15.150:0/3930293096 >> 172.21.15.150:0/3930293096 conn(0x7f90400b2e80 msgr2=0x7f90400714e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:42:28.051 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:28.049+0000 7f9044bda640 1 -- 172.21.15.150:0/3930293096 shutdown_connections 2024-09-17T05:42:28.051 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:28.049+0000 7f9044bda640 1 -- 172.21.15.150:0/3930293096 wait complete. 2024-09-17T05:42:28.062 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-09-17T05:42:28.177 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:28.176+0000 7fc85ef8b640 1 -- 172.21.15.150:0/2862837032 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc85815ee50 msgr2=0x7fc8580d1090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:28.177 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:28.176+0000 7fc85ef8b640 1 --2- 172.21.15.150:0/2862837032 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc85815ee50 0x7fc8580d1090 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fc85808e630 tx=0x7fc84c02a4d0 comp rx=0 tx=0).stop 2024-09-17T05:42:28.177 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:28.176+0000 7fc85ef8b640 1 -- 172.21.15.150:0/2862837032 shutdown_connections 2024-09-17T05:42:28.177 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:28.176+0000 7fc85ef8b640 1 --2- 172.21.15.150:0/2862837032 >> v2:172.21.15.176:3300/0 conn(0x7fc8580d15d0 0x7fc858162a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:28.177 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:28.176+0000 7fc85ef8b640 1 --2- 172.21.15.150:0/2862837032 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc85815ee50 0x7fc8580d1090 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:28.177 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:28.176+0000 7fc85ef8b640 1 --2- 172.21.15.150:0/2862837032 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc8580b9780 0x7fc8580b3720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:28.177 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:28.176+0000 7fc85ef8b640 1 -- 172.21.15.150:0/2862837032 >> 172.21.15.150:0/2862837032 conn(0x7fc8580d4680 msgr2=0x7fc8580d4a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:42:28.178 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:28.176+0000 7fc85ef8b640 1 -- 172.21.15.150:0/2862837032 shutdown_connections 2024-09-17T05:42:28.178 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:28.176+0000 7fc85ef8b640 1 -- 172.21.15.150:0/2862837032 wait complete. 2024-09-17T05:42:28.178 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:28.178+0000 7fc85ef8b640 1 Processor -- start 2024-09-17T05:42:28.178 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:28.178+0000 7fc85ef8b640 1 -- start start 2024-09-17T05:42:28.181 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:28.179+0000 7fc85ef8b640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc8580b9780 0x7fc85815ad40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:42:28.182 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:28.179+0000 7fc85ef8b640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc8580d15d0 0x7fc858151190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:42:28.182 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:28.179+0000 7fc85ef8b640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc85815ee50 0x7fc8581516d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:42:28.182 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:28.179+0000 7fc85ef8b640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7fc858163330 con 0x7fc8580b9780 2024-09-17T05:42:28.182 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:28.179+0000 7fc85ef8b640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fc8581631b0 con 0x7fc85815ee50 2024-09-17T05:42:28.182 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:28.179+0000 7fc85ef8b640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fc8581634b0 con 0x7fc8580d15d0 2024-09-17T05:42:28.182 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:28.179+0000 7fc85cd27640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc8580b9780 0x7fc85815ad40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:42:28.182 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:28.179+0000 7fc85cd27640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc8580b9780 0x7fc85815ad40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:35834/0 (socket says 172.21.15.150:35834) 2024-09-17T05:42:28.182 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:28.179+0000 7fc85cd27640 1 -- 172.21.15.150:0/907528136 learned_addr learned my addr 172.21.15.150:0/907528136 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:42:28.182 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:28.179+0000 7fc857fff640 1 --2- 172.21.15.150:0/907528136 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc8580d15d0 0x7fc858151190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:42:28.182 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:28.179+0000 7fc85d528640 1 --2- 172.21.15.150:0/907528136 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc85815ee50 0x7fc8581516d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:42:28.182 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:28.180+0000 7fc85cd27640 1 -- 172.21.15.150:0/907528136 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc8580d15d0 msgr2=0x7fc858151190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:28.182 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:28.180+0000 7fc85cd27640 1 --2- 172.21.15.150:0/907528136 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc8580d15d0 0x7fc858151190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:28.183 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:28.180+0000 7fc85cd27640 1 -- 172.21.15.150:0/907528136 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc85815ee50 msgr2=0x7fc8581516d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:28.183 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:28.180+0000 7fc85cd27640 1 --2- 172.21.15.150:0/907528136 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc85815ee50 0x7fc8581516d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:28.183 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:28.180+0000 7fc85cd27640 1 -- 172.21.15.150:0/907528136 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc8580b5bf0 con 0x7fc8580b9780 2024-09-17T05:42:28.183 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:28.180+0000 7fc85cd27640 1 --2- 172.21.15.150:0/907528136 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc8580b9780 0x7fc85815ad40 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fc84800d660 tx=0x7fc84800db20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:42:28.183 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:28.180+0000 7fc8557fa640 1 -- 172.21.15.150:0/907528136 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc848017070 con 0x7fc8580b9780 2024-09-17T05:42:28.183 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:28.180+0000 7fc8557fa640 1 -- 172.21.15.150:0/907528136 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc848009b10 con 0x7fc8580b9780 2024-09-17T05:42:28.183 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:28.180+0000 7fc85ef8b640 1 -- 172.21.15.150:0/907528136 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc8580b5ed0 con 0x7fc8580b9780 2024-09-17T05:42:28.183 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:28.180+0000 7fc8557fa640 1 -- 172.21.15.150:0/907528136 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc848010460 con 0x7fc8580b9780 2024-09-17T05:42:28.183 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:28.180+0000 7fc85ef8b640 1 -- 172.21.15.150:0/907528136 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc8580b6490 con 0x7fc8580b9780 2024-09-17T05:42:28.183 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:28.181+0000 7fc85ef8b640 1 -- 172.21.15.150:0/907528136 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc85808d100 con 0x7fc8580b9780 2024-09-17T05:42:28.184 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:28.182+0000 7fc8557fa640 1 -- 172.21.15.150:0/907528136 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fc84801a070 con 0x7fc8580b9780 2024-09-17T05:42:28.184 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:28.182+0000 7fc8557fa640 1 --2- 172.21.15.150:0/907528136 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fc844078b90 0x7fc84407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:42:28.184 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:28.182+0000 7fc8557fa640 1 -- 172.21.15.150:0/907528136 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7fc84809ac40 con 0x7fc8580b9780 2024-09-17T05:42:28.184 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:28.182+0000 7fc857fff640 1 --2- 172.21.15.150:0/907528136 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fc844078b90 0x7fc84407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:42:28.185 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:28.183+0000 7fc857fff640 1 --2- 172.21.15.150:0/907528136 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fc844078b90 0x7fc84407b0a0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fc84c033000 tx=0x7fc84c004730 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:42:28.187 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:28.187+0000 7fc8557fa640 1 -- 172.21.15.150:0/907528136 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fc85808d100 con 0x7fc8580b9780 2024-09-17T05:42:28.398 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:28.397+0000 7fc85ef8b640 1 -- 172.21.15.150:0/907528136 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7fc8580d1e90 con 0x7fc8580b9780 2024-09-17T05:42:28.399 INFO:tasks.ceph.mon.a.smithi150.stderr:2024-09-17T05:42:28.398+0000 7f73931ae640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-17T05:42:28.402 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:28.401+0000 7fc8557fa640 1 -- 172.21.15.150:0/907528136 <== mon.0 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v7) ==== 161+0+0 (secure 0 0 0) 0x7fc848062b50 con 0x7fc8580b9780 2024-09-17T05:42:28.402 INFO:teuthology.orchestra.run.smithi150.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-09-17T05:42:28.406 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:28.405+0000 7fc85ef8b640 1 -- 172.21.15.150:0/907528136 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fc844078b90 msgr2=0x7fc84407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:28.406 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:28.405+0000 7fc85ef8b640 1 --2- 172.21.15.150:0/907528136 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fc844078b90 0x7fc84407b0a0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fc84c033000 tx=0x7fc84c004730 comp rx=0 tx=0).stop 2024-09-17T05:42:28.406 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:28.405+0000 7fc85ef8b640 1 -- 172.21.15.150:0/907528136 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc8580b9780 msgr2=0x7fc85815ad40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:28.406 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:28.405+0000 7fc85ef8b640 1 --2- 172.21.15.150:0/907528136 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc8580b9780 0x7fc85815ad40 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fc84800d660 tx=0x7fc84800db20 comp rx=0 tx=0).stop 2024-09-17T05:42:28.406 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:28.405+0000 7fc85ef8b640 1 -- 172.21.15.150:0/907528136 shutdown_connections 2024-09-17T05:42:28.406 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:28.405+0000 7fc85ef8b640 1 --2- 172.21.15.150:0/907528136 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc85815ee50 0x7fc8581516d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:28.406 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:28.405+0000 7fc85ef8b640 1 --2- 172.21.15.150:0/907528136 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fc844078b90 0x7fc84407b0a0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:28.406 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:28.405+0000 7fc85ef8b640 1 --2- 172.21.15.150:0/907528136 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc8580d15d0 0x7fc858151190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:28.406 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:28.405+0000 7fc85ef8b640 1 --2- 172.21.15.150:0/907528136 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc8580b9780 0x7fc85815ad40 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:28.406 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:28.405+0000 7fc85ef8b640 1 -- 172.21.15.150:0/907528136 >> 172.21.15.150:0/907528136 conn(0x7fc8580d4680 msgr2=0x7fc85806edb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:42:28.406 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:28.405+0000 7fc85ef8b640 1 -- 172.21.15.150:0/907528136 shutdown_connections 2024-09-17T05:42:28.406 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:28.405+0000 7fc85ef8b640 1 -- 172.21.15.150:0/907528136 wait complete. 2024-09-17T05:42:28.410 INFO:tasks.ceph.mds.d.smithi176.stderr: -6856> 2024-09-17T05:42:02.904+0000 7effdb916640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-17T05:42:28.417 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-09-17T05:42:28.469 INFO:tasks.ceph.mds.d.smithi176.stdout:starting mds.d at 2024-09-17T05:42:28.534 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:28.533+0000 7fe95f319640 1 -- 172.21.15.150:0/1398950762 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe9580b7d70 msgr2=0x7fe9580d0a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:28.534 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:28.533+0000 7fe95f319640 1 --2- 172.21.15.150:0/1398950762 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe9580b7d70 0x7fe9580d0a80 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fe948009860 tx=0x7fe94802a410 comp rx=0 tx=0).stop 2024-09-17T05:42:28.534 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:28.533+0000 7fe95f319640 1 -- 172.21.15.150:0/1398950762 shutdown_connections 2024-09-17T05:42:28.534 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:28.533+0000 7fe95f319640 1 --2- 172.21.15.150:0/1398950762 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe9580b7d70 0x7fe9580d0a80 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:28.534 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:28.533+0000 7fe95f319640 1 -- 172.21.15.150:0/1398950762 >> 172.21.15.150:0/1398950762 conn(0x7fe9580cef20 msgr2=0x7fe9580cf330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:42:28.534 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:28.533+0000 7fe95f319640 1 -- 172.21.15.150:0/1398950762 shutdown_connections 2024-09-17T05:42:28.534 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:28.533+0000 7fe95f319640 1 -- 172.21.15.150:0/1398950762 wait complete. 2024-09-17T05:42:28.535 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:28.535+0000 7fe95f319640 1 Processor -- start 2024-09-17T05:42:28.535 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:28.535+0000 7fe95f319640 1 -- start start 2024-09-17T05:42:28.538 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:28.536+0000 7fe95f319640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe9580b7960 0x7fe9581f6600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:42:28.538 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:28.536+0000 7fe95f319640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe9580b7d70 0x7fe958159a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:42:28.538 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:28.536+0000 7fe95f319640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe9580d0fc0 0x7fe958156030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:42:28.538 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:28.536+0000 7fe95f319640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7fe9580af900 con 0x7fe9580b7d70 2024-09-17T05:42:28.538 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:28.536+0000 7fe95f319640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fe9580ceb90 con 0x7fe9580b7960 2024-09-17T05:42:28.538 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:28.536+0000 7fe95f319640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fe9580b5540 con 0x7fe9580d0fc0 2024-09-17T05:42:28.538 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:28.536+0000 7fe95c8b4640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe9580b7d70 0x7fe958159a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:42:28.539 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:28.536+0000 7fe95c8b4640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe9580b7d70 0x7fe958159a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:35842/0 (socket says 172.21.15.150:35842) 2024-09-17T05:42:28.539 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:28.536+0000 7fe95c8b4640 1 -- 172.21.15.150:0/1462124058 learned_addr learned my addr 172.21.15.150:0/1462124058 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:42:28.539 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:28.537+0000 7fe95d8b6640 1 --2- 172.21.15.150:0/1462124058 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe9580d0fc0 0x7fe958156030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:42:28.539 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:28.537+0000 7fe95d0b5640 1 --2- 172.21.15.150:0/1462124058 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe9580b7960 0x7fe9581f6600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:42:28.539 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:28.537+0000 7fe95c8b4640 1 -- 172.21.15.150:0/1462124058 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe9580d0fc0 msgr2=0x7fe958156030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:28.539 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:28.537+0000 7fe95c8b4640 1 --2- 172.21.15.150:0/1462124058 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe9580d0fc0 0x7fe958156030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:28.539 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:28.537+0000 7fe95c8b4640 1 -- 172.21.15.150:0/1462124058 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe9580b7960 msgr2=0x7fe9581f6600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:28.539 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:28.537+0000 7fe95c8b4640 1 --2- 172.21.15.150:0/1462124058 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe9580b7960 0x7fe9581f6600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:28.539 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:28.537+0000 7fe95c8b4640 1 -- 172.21.15.150:0/1462124058 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe9581580d0 con 0x7fe9580b7d70 2024-09-17T05:42:28.539 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:28.537+0000 7fe95c8b4640 1 --2- 172.21.15.150:0/1462124058 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe9580b7d70 0x7fe958159a80 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fe948009950 tx=0x7fe948003ae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:42:28.539 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:28.537+0000 7fe94dffb640 1 -- 172.21.15.150:0/1462124058 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe94803f030 con 0x7fe9580b7d70 2024-09-17T05:42:28.539 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:28.537+0000 7fe94dffb640 1 -- 172.21.15.150:0/1462124058 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe948003d00 con 0x7fe9580b7d70 2024-09-17T05:42:28.539 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:28.537+0000 7fe94dffb640 1 -- 172.21.15.150:0/1462124058 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe948037040 con 0x7fe9580b7d70 2024-09-17T05:42:28.540 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:28.537+0000 7fe95f319640 1 -- 172.21.15.150:0/1462124058 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe95806e100 con 0x7fe9580b7d70 2024-09-17T05:42:28.540 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:28.537+0000 7fe95f319640 1 -- 172.21.15.150:0/1462124058 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe9580b59f0 con 0x7fe9580b7d70 2024-09-17T05:42:28.540 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:28.538+0000 7fe95f319640 1 -- 172.21.15.150:0/1462124058 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe9580d0a80 con 0x7fe9580b7d70 2024-09-17T05:42:28.540 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:28.539+0000 7fe94dffb640 1 -- 172.21.15.150:0/1462124058 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fe948042070 con 0x7fe9580b7d70 2024-09-17T05:42:28.541 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:28.540+0000 7fe94dffb640 1 --2- 172.21.15.150:0/1462124058 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fe93c078bf0 0x7fe93c07b100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:42:28.541 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:28.540+0000 7fe94dffb640 1 -- 172.21.15.150:0/1462124058 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 5795+0+0 (secure 0 0 0) 0x7fe9480baca0 con 0x7fe9580b7d70 2024-09-17T05:42:28.541 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:28.540+0000 7fe95d0b5640 1 --2- 172.21.15.150:0/1462124058 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fe93c078bf0 0x7fe93c07b100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:42:28.541 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:28.541+0000 7fe95d0b5640 1 --2- 172.21.15.150:0/1462124058 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fe93c078bf0 0x7fe93c07b100 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fe954001370 tx=0x7fe954009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:42:28.545 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:28.545+0000 7fe94dffb640 1 -- 172.21.15.150:0/1462124058 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fe948083090 con 0x7fe9580b7d70 2024-09-17T05:42:28.754 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:28.754+0000 7fe95f319640 1 -- 172.21.15.150:0/1462124058 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7fe9580728a0 con 0x7fe9580b7d70 2024-09-17T05:42:29.408 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:29.408+0000 7fe94dffb640 1 -- 172.21.15.150:0/1462124058 <== mon.0 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v8) ==== 104+0+0 (secure 0 0 0) 0x7fe948082990 con 0x7fe9580b7d70 2024-09-17T05:42:29.411 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:29.410+0000 7fe95f319640 1 -- 172.21.15.150:0/1462124058 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fe93c078bf0 msgr2=0x7fe93c07b100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:29.411 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:29.410+0000 7fe95f319640 1 --2- 172.21.15.150:0/1462124058 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fe93c078bf0 0x7fe93c07b100 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fe954001370 tx=0x7fe954009040 comp rx=0 tx=0).stop 2024-09-17T05:42:29.411 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:29.410+0000 7fe95f319640 1 -- 172.21.15.150:0/1462124058 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe9580b7d70 msgr2=0x7fe958159a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:29.411 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:29.410+0000 7fe95f319640 1 --2- 172.21.15.150:0/1462124058 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe9580b7d70 0x7fe958159a80 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fe948009950 tx=0x7fe948003ae0 comp rx=0 tx=0).stop 2024-09-17T05:42:29.411 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:29.410+0000 7fe95f319640 1 -- 172.21.15.150:0/1462124058 shutdown_connections 2024-09-17T05:42:29.411 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:29.410+0000 7fe95f319640 1 --2- 172.21.15.150:0/1462124058 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fe93c078bf0 0x7fe93c07b100 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:29.411 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:29.410+0000 7fe95f319640 1 --2- 172.21.15.150:0/1462124058 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe9580d0fc0 0x7fe958156030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:29.411 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:29.410+0000 7fe95f319640 1 --2- 172.21.15.150:0/1462124058 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe9580b7d70 0x7fe958159a80 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:29.412 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:29.410+0000 7fe95f319640 1 --2- 172.21.15.150:0/1462124058 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe9580b7960 0x7fe9581f6600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:29.412 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:29.410+0000 7fe95f319640 1 -- 172.21.15.150:0/1462124058 >> 172.21.15.150:0/1462124058 conn(0x7fe9580cef20 msgr2=0x7fe9580b09b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:42:29.412 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:29.410+0000 7fe95f319640 1 -- 172.21.15.150:0/1462124058 shutdown_connections 2024-09-17T05:42:29.412 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:29.410+0000 7fe95f319640 1 -- 172.21.15.150:0/1462124058 wait complete. 2024-09-17T05:42:29.425 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-09-17T05:42:29.544 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:29.543+0000 7fa8810bd640 1 -- 172.21.15.150:0/3355690108 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa868003a50 msgr2=0x7fa868003ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:29.545 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:29.543+0000 7fa8810bd640 1 --2- 172.21.15.150:0/3355690108 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa868003a50 0x7fa868003ec0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fa86c001690 tx=0x7fa868005830 comp rx=0 tx=0).stop 2024-09-17T05:42:29.545 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:29.543+0000 7fa8810bd640 1 -- 172.21.15.150:0/3355690108 shutdown_connections 2024-09-17T05:42:29.545 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:29.543+0000 7fa8810bd640 1 --2- 172.21.15.150:0/3355690108 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa868003a50 0x7fa868003ec0 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:29.545 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:29.543+0000 7fa8810bd640 1 -- 172.21.15.150:0/3355690108 >> 172.21.15.150:0/3355690108 conn(0x7fa87c09aa50 msgr2=0x7fa87c0b2ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:42:29.545 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:29.543+0000 7fa8810bd640 1 -- 172.21.15.150:0/3355690108 shutdown_connections 2024-09-17T05:42:29.545 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:29.544+0000 7fa8810bd640 1 -- 172.21.15.150:0/3355690108 wait complete. 2024-09-17T05:42:29.546 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:29.545+0000 7fa8810bd640 1 Processor -- start 2024-09-17T05:42:29.546 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:29.546+0000 7fa8810bd640 1 -- start start 2024-09-17T05:42:29.549 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:29.547+0000 7fa8810bd640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa868003a50 0x7fa87c0cfb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:42:29.549 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:29.547+0000 7fa8810bd640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa87c1f41b0 0x7fa87c0d00b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:42:29.549 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:29.547+0000 7fa8810bd640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa87c1490c0 0x7fa87c0ce710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:42:29.549 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:29.547+0000 7fa8810bd640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7fa87c0ae660 con 0x7fa868003a50 2024-09-17T05:42:29.549 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:29.547+0000 7fa8810bd640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fa87c0ae4e0 con 0x7fa87c1490c0 2024-09-17T05:42:29.549 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:29.547+0000 7fa8810bd640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fa87c0ae7e0 con 0x7fa87c1f41b0 2024-09-17T05:42:29.549 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:29.547+0000 7fa87ad9d640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa868003a50 0x7fa87c0cfb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:42:29.550 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:29.547+0000 7fa87ad9d640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa868003a50 0x7fa87c0cfb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:35862/0 (socket says 172.21.15.150:35862) 2024-09-17T05:42:29.550 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:29.547+0000 7fa87ad9d640 1 -- 172.21.15.150:0/1949799224 learned_addr learned my addr 172.21.15.150:0/1949799224 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:42:29.550 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:29.547+0000 7fa87259c640 1 --2- 172.21.15.150:0/1949799224 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa87c1f41b0 0x7fa87c0d00b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:42:29.550 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:29.547+0000 7fa87b59e640 1 --2- 172.21.15.150:0/1949799224 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa87c1490c0 0x7fa87c0ce710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:42:29.550 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:29.547+0000 7fa87ad9d640 1 -- 172.21.15.150:0/1949799224 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa87c1f41b0 msgr2=0x7fa87c0d00b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:29.550 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:29.547+0000 7fa87ad9d640 1 --2- 172.21.15.150:0/1949799224 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa87c1f41b0 0x7fa87c0d00b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:29.550 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:29.547+0000 7fa87ad9d640 1 -- 172.21.15.150:0/1949799224 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa87c1490c0 msgr2=0x7fa87c0ce710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:29.550 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:29.547+0000 7fa87ad9d640 1 --2- 172.21.15.150:0/1949799224 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa87c1490c0 0x7fa87c0ce710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:29.550 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:29.547+0000 7fa87ad9d640 1 -- 172.21.15.150:0/1949799224 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa87c09c4a0 con 0x7fa868003a50 2024-09-17T05:42:29.550 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:29.548+0000 7fa87ad9d640 1 --2- 172.21.15.150:0/1949799224 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa868003a50 0x7fa87c0cfb70 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fa86c0017b0 tx=0x7fa86c0063a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:42:29.550 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:29.548+0000 7fa873fff640 1 -- 172.21.15.150:0/1949799224 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa86c042070 con 0x7fa868003a50 2024-09-17T05:42:29.550 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:29.548+0000 7fa873fff640 1 -- 172.21.15.150:0/1949799224 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa86c039070 con 0x7fa868003a50 2024-09-17T05:42:29.550 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:29.548+0000 7fa873fff640 1 -- 172.21.15.150:0/1949799224 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa86c003d90 con 0x7fa868003a50 2024-09-17T05:42:29.551 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:29.548+0000 7fa8810bd640 1 -- 172.21.15.150:0/1949799224 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa87c1f46e0 con 0x7fa868003a50 2024-09-17T05:42:29.551 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:29.548+0000 7fa8810bd640 1 -- 172.21.15.150:0/1949799224 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa87c09f280 con 0x7fa868003a50 2024-09-17T05:42:29.551 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:29.549+0000 7fa8810bd640 1 -- 172.21.15.150:0/1949799224 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa87c06cf60 con 0x7fa868003a50 2024-09-17T05:42:29.551 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:29.550+0000 7fa873fff640 1 -- 172.21.15.150:0/1949799224 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fa86c03b070 con 0x7fa868003a50 2024-09-17T05:42:29.552 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:29.550+0000 7fa873fff640 1 --2- 172.21.15.150:0/1949799224 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fa85c078b90 0x7fa85c07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:42:29.552 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:29.550+0000 7fa873fff640 1 -- 172.21.15.150:0/1949799224 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 5795+0+0 (secure 0 0 0) 0x7fa86c0ba210 con 0x7fa868003a50 2024-09-17T05:42:29.552 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:29.550+0000 7fa87259c640 1 --2- 172.21.15.150:0/1949799224 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fa85c078b90 0x7fa85c07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:42:29.552 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:29.551+0000 7fa87259c640 1 --2- 172.21.15.150:0/1949799224 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fa85c078b90 0x7fa85c07b0a0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fa87c152e50 tx=0x7fa86400b260 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:42:29.555 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:29.554+0000 7fa873fff640 1 -- 172.21.15.150:0/1949799224 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fa86c0820c0 con 0x7fa868003a50 2024-09-17T05:42:29.728 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:29.728+0000 7fa8810bd640 1 -- 172.21.15.150:0/1949799224 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7fa87c06ff80 con 0x7fa868003a50 2024-09-17T05:42:30.410 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:30.410+0000 7fa873fff640 1 -- 172.21.15.150:0/1949799224 <== mon.0 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v25) ==== 181+0+0 (secure 0 0 0) 0x7fa86c086af0 con 0x7fa868003a50 2024-09-17T05:42:30.411 INFO:teuthology.orchestra.run.smithi150.stderr:pool 'cephfs_metadata' removed 2024-09-17T05:42:30.414 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:30.414+0000 7fa8810bd640 1 -- 172.21.15.150:0/1949799224 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fa85c078b90 msgr2=0x7fa85c07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:30.415 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:30.414+0000 7fa8810bd640 1 --2- 172.21.15.150:0/1949799224 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fa85c078b90 0x7fa85c07b0a0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fa87c152e50 tx=0x7fa86400b260 comp rx=0 tx=0).stop 2024-09-17T05:42:30.415 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:30.414+0000 7fa8810bd640 1 -- 172.21.15.150:0/1949799224 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa868003a50 msgr2=0x7fa87c0cfb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:30.415 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:30.414+0000 7fa8810bd640 1 --2- 172.21.15.150:0/1949799224 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa868003a50 0x7fa87c0cfb70 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fa86c0017b0 tx=0x7fa86c0063a0 comp rx=0 tx=0).stop 2024-09-17T05:42:30.415 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:30.414+0000 7fa8810bd640 1 -- 172.21.15.150:0/1949799224 shutdown_connections 2024-09-17T05:42:30.415 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:30.414+0000 7fa8810bd640 1 --2- 172.21.15.150:0/1949799224 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa87c1490c0 0x7fa87c0ce710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:30.415 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:30.414+0000 7fa8810bd640 1 --2- 172.21.15.150:0/1949799224 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fa85c078b90 0x7fa85c07b0a0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:30.415 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:30.414+0000 7fa8810bd640 1 --2- 172.21.15.150:0/1949799224 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa87c1f41b0 0x7fa87c0d00b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:30.415 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:30.414+0000 7fa8810bd640 1 --2- 172.21.15.150:0/1949799224 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa868003a50 0x7fa87c0cfb70 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:30.415 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:30.414+0000 7fa8810bd640 1 -- 172.21.15.150:0/1949799224 >> 172.21.15.150:0/1949799224 conn(0x7fa87c09aa50 msgr2=0x7fa87c0b1f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:42:30.415 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:30.414+0000 7fa8810bd640 1 -- 172.21.15.150:0/1949799224 shutdown_connections 2024-09-17T05:42:30.415 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:30.414+0000 7fa8810bd640 1 -- 172.21.15.150:0/1949799224 wait complete. 2024-09-17T05:42:30.428 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-09-17T05:42:30.548 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:30.547+0000 7fd52dbc3640 1 -- 172.21.15.150:0/1309023830 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd5280b5250 msgr2=0x7fd5280b5660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:30.548 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:30.547+0000 7fd52dbc3640 1 --2- 172.21.15.150:0/1309023830 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd5280b5250 0x7fd5280b5660 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fd51c005fd0 tx=0x7fd51c02a530 comp rx=0 tx=0).stop 2024-09-17T05:42:30.548 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:30.547+0000 7fd52dbc3640 1 -- 172.21.15.150:0/1309023830 shutdown_connections 2024-09-17T05:42:30.548 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:30.547+0000 7fd52dbc3640 1 --2- 172.21.15.150:0/1309023830 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd5280b5250 0x7fd5280b5660 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:30.548 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:30.547+0000 7fd52dbc3640 1 --2- 172.21.15.150:0/1309023830 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd5280d01b0 0x7fd5280d05c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:30.548 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:30.547+0000 7fd52dbc3640 1 -- 172.21.15.150:0/1309023830 >> 172.21.15.150:0/1309023830 conn(0x7fd5280cee80 msgr2=0x7fd5280cf290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:42:30.549 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:30.547+0000 7fd52dbc3640 1 -- 172.21.15.150:0/1309023830 shutdown_connections 2024-09-17T05:42:30.549 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:30.547+0000 7fd52dbc3640 1 -- 172.21.15.150:0/1309023830 wait complete. 2024-09-17T05:42:30.549 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:30.549+0000 7fd52dbc3640 1 Processor -- start 2024-09-17T05:42:30.549 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:30.549+0000 7fd52dbc3640 1 -- start start 2024-09-17T05:42:30.552 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:30.550+0000 7fd52dbc3640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd5280b5250 0x7fd5280c94b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:42:30.552 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:30.550+0000 7fd52dbc3640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd5280d01b0 0x7fd52809fa10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:42:30.552 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:30.550+0000 7fd52dbc3640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd5280d0ee0 0x7fd52815b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:42:30.552 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:30.550+0000 7fd52dbc3640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7fd5280d12f0 con 0x7fd5280b5250 2024-09-17T05:42:30.552 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:30.550+0000 7fd52dbc3640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fd52809bd00 con 0x7fd5280d01b0 2024-09-17T05:42:30.552 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:30.550+0000 7fd52dbc3640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fd5280d1470 con 0x7fd5280d0ee0 2024-09-17T05:42:30.552 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:30.550+0000 7fd5277fe640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd5280b5250 0x7fd5280c94b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:42:30.553 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:30.550+0000 7fd5277fe640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd5280b5250 0x7fd5280c94b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:57964/0 (socket says 172.21.15.150:57964) 2024-09-17T05:42:30.553 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:30.550+0000 7fd5277fe640 1 -- 172.21.15.150:0/536123364 learned_addr learned my addr 172.21.15.150:0/536123364 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:42:30.553 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:30.550+0000 7fd526ffd640 1 --2- 172.21.15.150:0/536123364 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd5280d01b0 0x7fd52809fa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:42:30.553 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:30.550+0000 7fd527fff640 1 --2- 172.21.15.150:0/536123364 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd5280d0ee0 0x7fd52815b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:42:30.553 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:30.551+0000 7fd5277fe640 1 -- 172.21.15.150:0/536123364 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd5280d0ee0 msgr2=0x7fd52815b9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:30.553 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:30.551+0000 7fd5277fe640 1 --2- 172.21.15.150:0/536123364 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd5280d0ee0 0x7fd52815b9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:30.554 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:30.551+0000 7fd5277fe640 1 -- 172.21.15.150:0/536123364 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd5280d01b0 msgr2=0x7fd52809fa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:30.554 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:30.551+0000 7fd5277fe640 1 --2- 172.21.15.150:0/536123364 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd5280d01b0 0x7fd52809fa10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:30.554 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:30.551+0000 7fd5277fe640 1 -- 172.21.15.150:0/536123364 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd5281f7e90 con 0x7fd5280b5250 2024-09-17T05:42:30.554 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:30.551+0000 7fd5277fe640 1 --2- 172.21.15.150:0/536123364 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd5280b5250 0x7fd5280c94b0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fd51800c940 tx=0x7fd51800ce00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:42:30.554 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:30.551+0000 7fd50ffff640 1 -- 172.21.15.150:0/536123364 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd518004220 con 0x7fd5280b5250 2024-09-17T05:42:30.554 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:30.551+0000 7fd50ffff640 1 -- 172.21.15.150:0/536123364 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd5180079b0 con 0x7fd5280b5250 2024-09-17T05:42:30.554 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:30.551+0000 7fd52dbc3640 1 -- 172.21.15.150:0/536123364 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd5281f75f0 con 0x7fd5280b5250 2024-09-17T05:42:30.554 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:30.551+0000 7fd50ffff640 1 -- 172.21.15.150:0/536123364 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd518007e00 con 0x7fd5280b5250 2024-09-17T05:42:30.554 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:30.551+0000 7fd52dbc3640 1 -- 172.21.15.150:0/536123364 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd5281f7bb0 con 0x7fd5280b5250 2024-09-17T05:42:30.555 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:30.552+0000 7fd52dbc3640 1 -- 172.21.15.150:0/536123364 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd5280b5660 con 0x7fd5280b5250 2024-09-17T05:42:30.555 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:30.553+0000 7fd50ffff640 1 -- 172.21.15.150:0/536123364 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fd518005030 con 0x7fd5280b5250 2024-09-17T05:42:30.555 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:30.553+0000 7fd50ffff640 1 --2- 172.21.15.150:0/536123364 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fd514078b90 0x7fd51407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:42:30.555 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:30.553+0000 7fd50ffff640 1 -- 172.21.15.150:0/536123364 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5357+0+0 (secure 0 0 0) 0x7fd51809afb0 con 0x7fd5280b5250 2024-09-17T05:42:30.555 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:30.554+0000 7fd526ffd640 1 --2- 172.21.15.150:0/536123364 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fd514078b90 0x7fd51407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:42:30.555 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:30.554+0000 7fd526ffd640 1 --2- 172.21.15.150:0/536123364 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fd514078b90 0x7fd51407b0a0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fd51c033000 tx=0x7fd51c004730 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:42:30.558 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:30.558+0000 7fd50ffff640 1 -- 172.21.15.150:0/536123364 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fd518014070 con 0x7fd5280b5250 2024-09-17T05:42:30.732 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:30.732+0000 7fd52dbc3640 1 -- 172.21.15.150:0/536123364 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7fd52809d930 con 0x7fd5280b5250 2024-09-17T05:42:31.418 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:31.417+0000 7fd50ffff640 1 -- 172.21.15.150:0/536123364 <== mon.0 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v26) ==== 169+0+0 (secure 0 0 0) 0x7fd518062f10 con 0x7fd5280b5250 2024-09-17T05:42:31.418 INFO:teuthology.orchestra.run.smithi150.stderr:pool 'cephfs_data' removed 2024-09-17T05:42:31.421 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:31.420+0000 7fd52dbc3640 1 -- 172.21.15.150:0/536123364 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fd514078b90 msgr2=0x7fd51407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:31.422 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:31.420+0000 7fd52dbc3640 1 --2- 172.21.15.150:0/536123364 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fd514078b90 0x7fd51407b0a0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fd51c033000 tx=0x7fd51c004730 comp rx=0 tx=0).stop 2024-09-17T05:42:31.422 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:31.420+0000 7fd52dbc3640 1 -- 172.21.15.150:0/536123364 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd5280b5250 msgr2=0x7fd5280c94b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:31.422 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:31.420+0000 7fd52dbc3640 1 --2- 172.21.15.150:0/536123364 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd5280b5250 0x7fd5280c94b0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fd51800c940 tx=0x7fd51800ce00 comp rx=0 tx=0).stop 2024-09-17T05:42:31.422 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:31.420+0000 7fd52dbc3640 1 -- 172.21.15.150:0/536123364 shutdown_connections 2024-09-17T05:42:31.422 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:31.420+0000 7fd52dbc3640 1 --2- 172.21.15.150:0/536123364 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd5280d01b0 0x7fd52809fa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:31.422 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:31.420+0000 7fd52dbc3640 1 --2- 172.21.15.150:0/536123364 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fd514078b90 0x7fd51407b0a0 secure :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fd51c033000 tx=0x7fd51c004730 comp rx=0 tx=0).stop 2024-09-17T05:42:31.422 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:31.420+0000 7fd52dbc3640 1 --2- 172.21.15.150:0/536123364 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd5280d0ee0 0x7fd52815b9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:31.422 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:31.420+0000 7fd52dbc3640 1 --2- 172.21.15.150:0/536123364 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd5280b5250 0x7fd5280c94b0 secure :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fd51800c940 tx=0x7fd51800ce00 comp rx=0 tx=0).stop 2024-09-17T05:42:31.422 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:31.420+0000 7fd52dbc3640 1 -- 172.21.15.150:0/536123364 >> 172.21.15.150:0/536123364 conn(0x7fd5280cee80 msgr2=0x7fd52809b1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:42:31.423 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:31.422+0000 7fd52dbc3640 1 -- 172.21.15.150:0/536123364 shutdown_connections 2024-09-17T05:42:31.423 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:31.422+0000 7fd52dbc3640 1 -- 172.21.15.150:0/536123364 wait complete. 2024-09-17T05:42:31.436 INFO:tasks.ceph.mds.a:Restarting daemon 2024-09-17T05:42:31.436 INFO:tasks.ceph.mds.a:Stopping old one... 2024-09-17T05:42:31.437 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-09-17T05:42:31.437 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T05:42:31.437 INFO:tasks.ceph.mds.c:Restarting daemon 2024-09-17T05:42:31.437 INFO:tasks.ceph.mds.c:Stopping old one... 2024-09-17T05:42:31.437 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-09-17T05:42:31.437 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T05:42:31.438 INFO:tasks.ceph.mds.b:Restarting daemon 2024-09-17T05:42:31.438 INFO:tasks.ceph.mds.b:Stopping old one... 2024-09-17T05:42:31.438 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-09-17T05:42:31.438 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T05:42:31.438 INFO:tasks.ceph.mds.d:Restarting daemon 2024-09-17T05:42:31.438 INFO:tasks.ceph.mds.d:Stopping old one... 2024-09-17T05:42:31.439 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-09-17T05:42:31.439 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T05:42:31.449 INFO:tasks.ceph.mds.a:Stopped 2024-09-17T05:42:31.450 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-09-17T05:42:31.450 INFO:tasks.ceph.mds.c:Stopped 2024-09-17T05:42:31.451 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-09-17T05:42:31.452 INFO:tasks.ceph.mds.b:Stopped 2024-09-17T05:42:31.452 DEBUG:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-09-17T05:42:31.455 INFO:tasks.ceph.mds.d:Stopped 2024-09-17T05:42:31.455 DEBUG:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-09-17T05:42:31.491 INFO:tasks.ceph.mds.a:Started 2024-09-17T05:42:31.492 DEBUG:teuthology.parallel:result is None 2024-09-17T05:42:31.492 INFO:tasks.ceph.mds.c:Started 2024-09-17T05:42:31.492 DEBUG:teuthology.parallel:result is None 2024-09-17T05:42:31.497 INFO:tasks.ceph.mds.b:Started 2024-09-17T05:42:31.497 DEBUG:teuthology.parallel:result is None 2024-09-17T05:42:31.498 INFO:tasks.ceph.mds.d:Started 2024-09-17T05:42:31.498 DEBUG:teuthology.parallel:result is None 2024-09-17T05:42:31.499 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-09-17T05:42:31.580 INFO:tasks.ceph.mds.a.smithi150.stdout:starting mds.a at 2024-09-17T05:42:31.581 INFO:tasks.ceph.mds.c.smithi150.stdout:starting mds.c at 2024-09-17T05:42:31.589 INFO:tasks.ceph.mds.d.smithi176.stdout:starting mds.d at 2024-09-17T05:42:31.589 INFO:tasks.ceph.mds.b.smithi176.stdout:starting mds.b at 2024-09-17T05:42:31.622 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:31.621+0000 7f8b568b6640 1 -- 172.21.15.150:0/1587983115 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8b500b74b0 msgr2=0x7f8b500b78c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:31.622 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:31.621+0000 7f8b568b6640 1 --2- 172.21.15.150:0/1587983115 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8b500b74b0 0x7f8b500b78c0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f8b40009850 tx=0x7f8b4002a4f0 comp rx=0 tx=0).stop 2024-09-17T05:42:31.622 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:31.621+0000 7f8b568b6640 1 -- 172.21.15.150:0/1587983115 shutdown_connections 2024-09-17T05:42:31.622 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:31.621+0000 7f8b568b6640 1 --2- 172.21.15.150:0/1587983115 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8b500b74b0 0x7f8b500b78c0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:31.622 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:31.621+0000 7f8b568b6640 1 -- 172.21.15.150:0/1587983115 >> 172.21.15.150:0/1587983115 conn(0x7f8b5008bfe0 msgr2=0x7f8b500d4660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:42:31.622 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:31.622+0000 7f8b568b6640 1 -- 172.21.15.150:0/1587983115 shutdown_connections 2024-09-17T05:42:31.623 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:31.622+0000 7f8b568b6640 1 -- 172.21.15.150:0/1587983115 wait complete. 2024-09-17T05:42:31.623 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:31.623+0000 7f8b568b6640 1 Processor -- start 2024-09-17T05:42:31.624 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:31.623+0000 7f8b568b6640 1 -- start start 2024-09-17T05:42:31.626 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:31.625+0000 7f8b568b6640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8b500b6a30 0x7f8b500d1350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:42:31.626 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:31.625+0000 7f8b568b6640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8b500b74b0 0x7f8b500d1890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:42:31.627 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:31.625+0000 7f8b568b6640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8b500d2e50 0x7f8b501f99b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:42:31.627 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:31.625+0000 7f8b568b6640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f8b5016a340 con 0x7f8b500b6a30 2024-09-17T05:42:31.627 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:31.625+0000 7f8b568b6640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f8b500d35e0 con 0x7f8b500b74b0 2024-09-17T05:42:31.627 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:31.625+0000 7f8b568b6640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f8b5016a4c0 con 0x7f8b500d2e50 2024-09-17T05:42:31.627 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:31.625+0000 7f8b4ffff640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8b500b6a30 0x7f8b500d1350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:42:31.627 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:31.625+0000 7f8b4ffff640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8b500b6a30 0x7f8b500d1350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:57988/0 (socket says 172.21.15.150:57988) 2024-09-17T05:42:31.627 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:31.625+0000 7f8b4ffff640 1 -- 172.21.15.150:0/2671925919 learned_addr learned my addr 172.21.15.150:0/2671925919 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:42:31.627 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:31.625+0000 7f8b54e53640 1 --2- 172.21.15.150:0/2671925919 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8b500d2e50 0x7f8b501f99b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:42:31.627 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:31.625+0000 7f8b4f7fe640 1 --2- 172.21.15.150:0/2671925919 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8b500b74b0 0x7f8b500d1890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:42:31.627 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:31.625+0000 7f8b4ffff640 1 -- 172.21.15.150:0/2671925919 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8b500d2e50 msgr2=0x7f8b501f99b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:31.627 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:31.625+0000 7f8b4ffff640 1 --2- 172.21.15.150:0/2671925919 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8b500d2e50 0x7f8b501f99b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:31.627 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:31.625+0000 7f8b4ffff640 1 -- 172.21.15.150:0/2671925919 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8b500b74b0 msgr2=0x7f8b500d1890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:31.627 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:31.625+0000 7f8b4ffff640 1 --2- 172.21.15.150:0/2671925919 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8b500b74b0 0x7f8b500d1890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:31.628 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:31.625+0000 7f8b4ffff640 1 -- 172.21.15.150:0/2671925919 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8b500b1f80 con 0x7f8b500b6a30 2024-09-17T05:42:31.628 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:31.625+0000 7f8b4ffff640 1 --2- 172.21.15.150:0/2671925919 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8b500b6a30 0x7f8b500d1350 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f8b4002aae0 tx=0x7f8b40005270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:42:31.628 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:31.625+0000 7f8b4cff9640 1 -- 172.21.15.150:0/2671925919 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b4003f070 con 0x7f8b500b6a30 2024-09-17T05:42:31.628 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:31.625+0000 7f8b4cff9640 1 -- 172.21.15.150:0/2671925919 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8b40004340 con 0x7f8b500b6a30 2024-09-17T05:42:31.628 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:31.625+0000 7f8b568b6640 1 -- 172.21.15.150:0/2671925919 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8b500b2260 con 0x7f8b500b6a30 2024-09-17T05:42:31.628 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:31.625+0000 7f8b4cff9640 1 -- 172.21.15.150:0/2671925919 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b40033e60 con 0x7f8b500b6a30 2024-09-17T05:42:31.628 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:31.626+0000 7f8b568b6640 1 -- 172.21.15.150:0/2671925919 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8b500b2820 con 0x7f8b500b6a30 2024-09-17T05:42:31.629 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:31.627+0000 7f8b568b6640 1 -- 172.21.15.150:0/2671925919 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8b5008caf0 con 0x7f8b500b6a30 2024-09-17T05:42:31.629 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:31.627+0000 7f8b4cff9640 1 -- 172.21.15.150:0/2671925919 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f8b40042070 con 0x7f8b500b6a30 2024-09-17T05:42:31.629 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:31.628+0000 7f8b4cff9640 1 --2- 172.21.15.150:0/2671925919 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f8b3c078b90 0x7f8b3c07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:42:31.629 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:31.628+0000 7f8b4cff9640 1 -- 172.21.15.150:0/2671925919 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 4943+0+0 (secure 0 0 0) 0x7f8b400bb930 con 0x7f8b500b6a30 2024-09-17T05:42:31.629 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:31.628+0000 7f8b4f7fe640 1 --2- 172.21.15.150:0/2671925919 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f8b3c078b90 0x7f8b3c07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:42:31.629 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:31.628+0000 7f8b4f7fe640 1 --2- 172.21.15.150:0/2671925919 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f8b3c078b90 0x7f8b3c07b0a0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f8b501658c0 tx=0x7f8b44009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:42:31.633 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:31.632+0000 7f8b4cff9640 1 -- 172.21.15.150:0/2671925919 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f8b5008caf0 con 0x7f8b500b6a30 2024-09-17T05:42:31.817 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:31.817+0000 7f8b568b6640 1 -- 172.21.15.150:0/2671925919 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) -- 0x7f8b500b78c0 con 0x7f8b500b6a30 2024-09-17T05:42:32.437 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:32.436+0000 7f8b4cff9640 1 -- 172.21.15.150:0/2671925919 <== mon.0 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v28) ==== 97+0+0 (secure 0 0 0) 0x7f8b40005670 con 0x7f8b500b6a30 2024-09-17T05:42:32.437 INFO:teuthology.orchestra.run.smithi150.stderr: removed all blocklist entries 2024-09-17T05:42:32.439 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:32.439+0000 7f8b568b6640 1 -- 172.21.15.150:0/2671925919 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f8b3c078b90 msgr2=0x7f8b3c07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:32.440 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:32.439+0000 7f8b568b6640 1 --2- 172.21.15.150:0/2671925919 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f8b3c078b90 0x7f8b3c07b0a0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f8b501658c0 tx=0x7f8b44009040 comp rx=0 tx=0).stop 2024-09-17T05:42:32.440 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:32.439+0000 7f8b568b6640 1 -- 172.21.15.150:0/2671925919 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8b500b6a30 msgr2=0x7f8b500d1350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:32.440 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:32.439+0000 7f8b568b6640 1 --2- 172.21.15.150:0/2671925919 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8b500b6a30 0x7f8b500d1350 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f8b4002aae0 tx=0x7f8b40005270 comp rx=0 tx=0).stop 2024-09-17T05:42:32.440 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:32.439+0000 7f8b568b6640 1 -- 172.21.15.150:0/2671925919 shutdown_connections 2024-09-17T05:42:32.440 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:32.439+0000 7f8b568b6640 1 --2- 172.21.15.150:0/2671925919 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8b500b74b0 0x7f8b500d1890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:32.440 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:32.439+0000 7f8b568b6640 1 --2- 172.21.15.150:0/2671925919 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f8b3c078b90 0x7f8b3c07b0a0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:32.440 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:32.439+0000 7f8b568b6640 1 --2- 172.21.15.150:0/2671925919 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8b500d2e50 0x7f8b501f99b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:32.440 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:32.439+0000 7f8b568b6640 1 --2- 172.21.15.150:0/2671925919 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8b500b6a30 0x7f8b500d1350 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:32.440 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:32.439+0000 7f8b568b6640 1 -- 172.21.15.150:0/2671925919 >> 172.21.15.150:0/2671925919 conn(0x7f8b5008bfe0 msgr2=0x7f8b500b7c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:42:32.440 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:32.439+0000 7f8b568b6640 1 -- 172.21.15.150:0/2671925919 shutdown_connections 2024-09-17T05:42:32.440 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:32.439+0000 7f8b568b6640 1 -- 172.21.15.150:0/2671925919 wait complete. 2024-09-17T05:42:32.452 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-09-17T05:42:32.567 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:32.566+0000 7f199478a640 1 -- 172.21.15.150:0/2222450036 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1978004800 msgr2=0x7f1978004c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:32.567 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:32.566+0000 7f199478a640 1 --2- 172.21.15.150:0/2222450036 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1978004800 0x7f1978004c10 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f198c1629c0 tx=0x7f1978005830 comp rx=0 tx=0).stop 2024-09-17T05:42:32.567 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:32.566+0000 7f1992d27640 1 -- 172.21.15.150:0/2222450036 reap_dead start 2024-09-17T05:42:32.568 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:32.566+0000 7f199478a640 1 -- 172.21.15.150:0/2222450036 shutdown_connections 2024-09-17T05:42:32.568 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:32.566+0000 7f199478a640 1 -- 172.21.15.150:0/2222450036 >> 172.21.15.150:0/2222450036 conn(0x7f198c0d4680 msgr2=0x7f198c0d4a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:42:32.568 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:32.566+0000 7f199478a640 1 -- 172.21.15.150:0/2222450036 shutdown_connections 2024-09-17T05:42:32.568 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:32.566+0000 7f199478a640 1 -- 172.21.15.150:0/2222450036 wait complete. 2024-09-17T05:42:32.568 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:32.568+0000 7f199478a640 1 Processor -- start 2024-09-17T05:42:32.569 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:32.568+0000 7f199478a640 1 -- start start 2024-09-17T05:42:32.571 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:32.569+0000 7f199478a640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1978004800 0x7f198c1f9130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:42:32.571 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:32.570+0000 7f199478a640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f198c159790 0x7f198c1f9670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:42:32.572 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:32.570+0000 7f199478a640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f198c158c10 0x7f198c159020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:42:32.572 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:32.570+0000 7f199478a640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f198c0d1420 con 0x7f198c159790 2024-09-17T05:42:32.572 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:32.570+0000 7f199478a640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f198c0d12a0 con 0x7f198c158c10 2024-09-17T05:42:32.572 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:32.570+0000 7f199478a640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f198c0cf9b0 con 0x7f1978004800 2024-09-17T05:42:32.572 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:32.570+0000 7f1991d25640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f198c159790 0x7f198c1f9670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:42:32.572 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:32.570+0000 7f1991d25640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f198c159790 0x7f198c1f9670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:58000/0 (socket says 172.21.15.150:58000) 2024-09-17T05:42:32.572 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:32.570+0000 7f1991d25640 1 -- 172.21.15.150:0/6297617 learned_addr learned my addr 172.21.15.150:0/6297617 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:42:32.572 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:32.570+0000 7f1992d27640 1 --2- 172.21.15.150:0/6297617 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f198c158c10 0x7f198c159020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:42:32.572 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:32.570+0000 7f1992526640 1 --2- 172.21.15.150:0/6297617 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1978004800 0x7f198c1f9130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:42:32.572 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:32.570+0000 7f1991d25640 1 -- 172.21.15.150:0/6297617 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1978004800 msgr2=0x7f198c1f9130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:32.572 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:32.570+0000 7f1991d25640 1 --2- 172.21.15.150:0/6297617 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1978004800 0x7f198c1f9130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:32.572 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:32.570+0000 7f1991d25640 1 -- 172.21.15.150:0/6297617 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f198c158c10 msgr2=0x7f198c159020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:32.573 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:32.570+0000 7f1991d25640 1 --2- 172.21.15.150:0/6297617 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f198c158c10 0x7f198c159020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:32.573 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:32.570+0000 7f1991d25640 1 -- 172.21.15.150:0/6297617 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f198c09f3b0 con 0x7f198c159790 2024-09-17T05:42:32.573 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:32.570+0000 7f1991d25640 1 --2- 172.21.15.150:0/6297617 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f198c159790 0x7f198c1f9670 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f197c009a70 tx=0x7f197c033670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:42:32.573 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:32.570+0000 7f1982ffd640 1 -- 172.21.15.150:0/6297617 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f197c038040 con 0x7f198c159790 2024-09-17T05:42:32.573 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:32.570+0000 7f1982ffd640 1 -- 172.21.15.150:0/6297617 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f197c004020 con 0x7f198c159790 2024-09-17T05:42:32.573 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:32.570+0000 7f199478a640 1 -- 172.21.15.150:0/6297617 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f198c159560 con 0x7f198c159790 2024-09-17T05:42:32.573 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:32.570+0000 7f1982ffd640 1 -- 172.21.15.150:0/6297617 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f197c004470 con 0x7f198c159790 2024-09-17T05:42:32.573 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:32.570+0000 7f199478a640 1 -- 172.21.15.150:0/6297617 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f198c0b6670 con 0x7f198c159790 2024-09-17T05:42:32.573 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:32.571+0000 7f199478a640 1 -- 172.21.15.150:0/6297617 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f198c08d100 con 0x7f198c159790 2024-09-17T05:42:32.574 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:32.572+0000 7f1982ffd640 1 -- 172.21.15.150:0/6297617 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f197c045020 con 0x7f198c159790 2024-09-17T05:42:32.574 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:32.572+0000 7f1982ffd640 1 --2- 172.21.15.150:0/6297617 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f1970078b90 0x7f197007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:42:32.574 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:32.573+0000 7f1982ffd640 1 -- 172.21.15.150:0/6297617 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 4857+0+0 (secure 0 0 0) 0x7f197c0bb1e0 con 0x7f198c159790 2024-09-17T05:42:32.574 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:32.573+0000 7f1992526640 1 --2- 172.21.15.150:0/6297617 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f1970078b90 0x7f197007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:42:32.574 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:32.573+0000 7f1992526640 1 --2- 172.21.15.150:0/6297617 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f1970078b90 0x7f197007b0a0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f1988001460 tx=0x7f1988006740 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:42:32.577 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:32.577+0000 7f1982ffd640 1 -- 172.21.15.150:0/6297617 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f198c08d100 con 0x7f198c159790 2024-09-17T05:42:32.825 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:32.824+0000 7f199478a640 1 -- 172.21.15.150:0/6297617 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) -- 0x7f198c1f9d10 con 0x7f198c159790 2024-09-17T05:42:32.826 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:32.825+0000 7f1982ffd640 1 -- 172.21.15.150:0/6297617 <== mon.0 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v4) ==== 80+0+6645 (secure 0 0 0) 0x7f197c0833b0 con 0x7f198c159790 2024-09-17T05:42:32.826 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-09-17T05:42:32.826 INFO:teuthology.orchestra.run.smithi150.stdout:{ 2024-09-17T05:42:32.826 INFO:teuthology.orchestra.run.smithi150.stdout: "auth_dump": [ 2024-09-17T05:42:32.826 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-09-17T05:42:32.826 INFO:teuthology.orchestra.run.smithi150.stdout: "entity": "mds.a", 2024-09-17T05:42:32.826 INFO:teuthology.orchestra.run.smithi150.stdout: "key": "AQBoFulmMHALAxAAEO+QBgzbd+BNfhyY2qPiqw==", 2024-09-17T05:42:32.826 INFO:teuthology.orchestra.run.smithi150.stdout: "caps": { 2024-09-17T05:42:32.826 INFO:teuthology.orchestra.run.smithi150.stdout: "mds": "allow", 2024-09-17T05:42:32.827 INFO:teuthology.orchestra.run.smithi150.stdout: "mgr": "allow *", 2024-09-17T05:42:32.827 INFO:teuthology.orchestra.run.smithi150.stdout: "mon": "allow *", 2024-09-17T05:42:32.827 INFO:teuthology.orchestra.run.smithi150.stdout: "osd": "allow *" 2024-09-17T05:42:32.827 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-09-17T05:42:32.827 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-17T05:42:32.827 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-09-17T05:42:32.827 INFO:teuthology.orchestra.run.smithi150.stdout: "entity": "mds.b", 2024-09-17T05:42:32.827 INFO:teuthology.orchestra.run.smithi150.stdout: "key": "AQBoFulmtutmEBAAhKJEJQm181pL1lPmSSdYRQ==", 2024-09-17T05:42:32.827 INFO:teuthology.orchestra.run.smithi150.stdout: "caps": { 2024-09-17T05:42:32.827 INFO:teuthology.orchestra.run.smithi150.stdout: "mds": "allow", 2024-09-17T05:42:32.827 INFO:teuthology.orchestra.run.smithi150.stdout: "mgr": "allow *", 2024-09-17T05:42:32.827 INFO:teuthology.orchestra.run.smithi150.stdout: "mon": "allow *", 2024-09-17T05:42:32.827 INFO:teuthology.orchestra.run.smithi150.stdout: "osd": "allow *" 2024-09-17T05:42:32.827 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-09-17T05:42:32.828 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-17T05:42:32.828 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-09-17T05:42:32.828 INFO:teuthology.orchestra.run.smithi150.stdout: "entity": "mds.c", 2024-09-17T05:42:32.828 INFO:teuthology.orchestra.run.smithi150.stdout: "key": "AQBoFulmHTKsChAA4/fUb2NC+fMhR+xIYIDjgQ==", 2024-09-17T05:42:32.828 INFO:teuthology.orchestra.run.smithi150.stdout: "caps": { 2024-09-17T05:42:32.828 INFO:teuthology.orchestra.run.smithi150.stdout: "mds": "allow", 2024-09-17T05:42:32.828 INFO:teuthology.orchestra.run.smithi150.stdout: "mgr": "allow *", 2024-09-17T05:42:32.828 INFO:teuthology.orchestra.run.smithi150.stdout: "mon": "allow *", 2024-09-17T05:42:32.828 INFO:teuthology.orchestra.run.smithi150.stdout: "osd": "allow *" 2024-09-17T05:42:32.828 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-09-17T05:42:32.828 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-17T05:42:32.828 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-09-17T05:42:32.828 INFO:teuthology.orchestra.run.smithi150.stdout: "entity": "mds.d", 2024-09-17T05:42:32.829 INFO:teuthology.orchestra.run.smithi150.stdout: "key": "AQBoFulmr2s3GBAAhXzLVtObF/LwTpDIrY8MIQ==", 2024-09-17T05:42:32.829 INFO:teuthology.orchestra.run.smithi150.stdout: "caps": { 2024-09-17T05:42:32.829 INFO:teuthology.orchestra.run.smithi150.stdout: "mds": "allow", 2024-09-17T05:42:32.829 INFO:teuthology.orchestra.run.smithi150.stdout: "mgr": "allow *", 2024-09-17T05:42:32.829 INFO:teuthology.orchestra.run.smithi150.stdout: "mon": "allow *", 2024-09-17T05:42:32.829 INFO:teuthology.orchestra.run.smithi150.stdout: "osd": "allow *" 2024-09-17T05:42:32.829 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-09-17T05:42:32.829 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-17T05:42:32.829 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-09-17T05:42:32.829 INFO:teuthology.orchestra.run.smithi150.stdout: "entity": "osd.0", 2024-09-17T05:42:32.829 INFO:teuthology.orchestra.run.smithi150.stdout: "key": "AQBrFulm9eU0NRAAqgc1CtMOz+jDCHBn8coaVw==", 2024-09-17T05:42:32.829 INFO:teuthology.orchestra.run.smithi150.stdout: "caps": { 2024-09-17T05:42:32.829 INFO:teuthology.orchestra.run.smithi150.stdout: "mgr": "allow profile osd", 2024-09-17T05:42:32.829 INFO:teuthology.orchestra.run.smithi150.stdout: "mon": "allow profile osd", 2024-09-17T05:42:32.830 INFO:teuthology.orchestra.run.smithi150.stdout: "osd": "allow *" 2024-09-17T05:42:32.830 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-09-17T05:42:32.830 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-17T05:42:32.830 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-09-17T05:42:32.830 INFO:teuthology.orchestra.run.smithi150.stdout: "entity": "osd.1", 2024-09-17T05:42:32.830 INFO:teuthology.orchestra.run.smithi150.stdout: "key": "AQBvFulmlFL6CxAA8ByBraZue2FLfyZeOIpj3A==", 2024-09-17T05:42:32.830 INFO:teuthology.orchestra.run.smithi150.stdout: "caps": { 2024-09-17T05:42:32.830 INFO:teuthology.orchestra.run.smithi150.stdout: "mgr": "allow profile osd", 2024-09-17T05:42:32.830 INFO:teuthology.orchestra.run.smithi150.stdout: "mon": "allow profile osd", 2024-09-17T05:42:32.830 INFO:teuthology.orchestra.run.smithi150.stdout: "osd": "allow *" 2024-09-17T05:42:32.830 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-09-17T05:42:32.830 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-17T05:42:32.830 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-09-17T05:42:32.831 INFO:teuthology.orchestra.run.smithi150.stdout: "entity": "osd.2", 2024-09-17T05:42:32.831 INFO:teuthology.orchestra.run.smithi150.stdout: "key": "AQByFulmMQF5LBAAB4rbdIL6Zd+l4I4LDC/r3Q==", 2024-09-17T05:42:32.831 INFO:teuthology.orchestra.run.smithi150.stdout: "caps": { 2024-09-17T05:42:32.831 INFO:teuthology.orchestra.run.smithi150.stdout: "mgr": "allow profile osd", 2024-09-17T05:42:32.831 INFO:teuthology.orchestra.run.smithi150.stdout: "mon": "allow profile osd", 2024-09-17T05:42:32.831 INFO:teuthology.orchestra.run.smithi150.stdout: "osd": "allow *" 2024-09-17T05:42:32.831 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-09-17T05:42:32.831 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-17T05:42:32.831 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-09-17T05:42:32.831 INFO:teuthology.orchestra.run.smithi150.stdout: "entity": "osd.3", 2024-09-17T05:42:32.831 INFO:teuthology.orchestra.run.smithi150.stdout: "key": "AQB2Fulm5fjaAhAASnkpgsW79Sr9IIiy4HMm4g==", 2024-09-17T05:42:32.831 INFO:teuthology.orchestra.run.smithi150.stdout: "caps": { 2024-09-17T05:42:32.831 INFO:teuthology.orchestra.run.smithi150.stdout: "mgr": "allow profile osd", 2024-09-17T05:42:32.831 INFO:teuthology.orchestra.run.smithi150.stdout: "mon": "allow profile osd", 2024-09-17T05:42:32.832 INFO:teuthology.orchestra.run.smithi150.stdout: "osd": "allow *" 2024-09-17T05:42:32.832 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-09-17T05:42:32.832 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-17T05:42:32.832 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-09-17T05:42:32.832 INFO:teuthology.orchestra.run.smithi150.stdout: "entity": "osd.4", 2024-09-17T05:42:32.832 INFO:teuthology.orchestra.run.smithi150.stdout: "key": "AQB8Fulm9fWPGhAA9nNf+0znlS0Z7rqOvC47xQ==", 2024-09-17T05:42:32.832 INFO:teuthology.orchestra.run.smithi150.stdout: "caps": { 2024-09-17T05:42:32.832 INFO:teuthology.orchestra.run.smithi150.stdout: "mgr": "allow profile osd", 2024-09-17T05:42:32.832 INFO:teuthology.orchestra.run.smithi150.stdout: "mon": "allow profile osd", 2024-09-17T05:42:32.832 INFO:teuthology.orchestra.run.smithi150.stdout: "osd": "allow *" 2024-09-17T05:42:32.832 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-09-17T05:42:32.832 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-17T05:42:32.832 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-09-17T05:42:32.833 INFO:teuthology.orchestra.run.smithi150.stdout: "entity": "osd.5", 2024-09-17T05:42:32.833 INFO:teuthology.orchestra.run.smithi150.stdout: "key": "AQB/FulmeHakHRAASlnmKa0UTqVX+NSbmiHEBw==", 2024-09-17T05:42:32.833 INFO:teuthology.orchestra.run.smithi150.stdout: "caps": { 2024-09-17T05:42:32.833 INFO:teuthology.orchestra.run.smithi150.stdout: "mgr": "allow profile osd", 2024-09-17T05:42:32.833 INFO:teuthology.orchestra.run.smithi150.stdout: "mon": "allow profile osd", 2024-09-17T05:42:32.833 INFO:teuthology.orchestra.run.smithi150.stdout: "osd": "allow *" 2024-09-17T05:42:32.833 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-09-17T05:42:32.833 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-17T05:42:32.833 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-09-17T05:42:32.833 INFO:teuthology.orchestra.run.smithi150.stdout: "entity": "osd.6", 2024-09-17T05:42:32.833 INFO:teuthology.orchestra.run.smithi150.stdout: "key": "AQCCFulmEZF3IBAAhtpCanI6m8Kb3hyi+sRyyQ==", 2024-09-17T05:42:32.833 INFO:teuthology.orchestra.run.smithi150.stdout: "caps": { 2024-09-17T05:42:32.833 INFO:teuthology.orchestra.run.smithi150.stdout: "mgr": "allow profile osd", 2024-09-17T05:42:32.833 INFO:teuthology.orchestra.run.smithi150.stdout: "mon": "allow profile osd", 2024-09-17T05:42:32.834 INFO:teuthology.orchestra.run.smithi150.stdout: "osd": "allow *" 2024-09-17T05:42:32.834 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-09-17T05:42:32.834 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-17T05:42:32.834 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-09-17T05:42:32.834 INFO:teuthology.orchestra.run.smithi150.stdout: "entity": "osd.7", 2024-09-17T05:42:32.834 INFO:teuthology.orchestra.run.smithi150.stdout: "key": "AQCGFulmdcs7BRAAxsctes949cbkGkivdGpoYw==", 2024-09-17T05:42:32.834 INFO:teuthology.orchestra.run.smithi150.stdout: "caps": { 2024-09-17T05:42:32.834 INFO:teuthology.orchestra.run.smithi150.stdout: "mgr": "allow profile osd", 2024-09-17T05:42:32.834 INFO:teuthology.orchestra.run.smithi150.stdout: "mon": "allow profile osd", 2024-09-17T05:42:32.834 INFO:teuthology.orchestra.run.smithi150.stdout: "osd": "allow *" 2024-09-17T05:42:32.834 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-09-17T05:42:32.834 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-17T05:42:32.834 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-09-17T05:42:32.834 INFO:teuthology.orchestra.run.smithi150.stdout: "entity": "client.0", 2024-09-17T05:42:32.834 INFO:teuthology.orchestra.run.smithi150.stdout: "key": "AQBoFulmfF/1HBAAMezEjZDeoHTJ+uFfDXNWHQ==", 2024-09-17T05:42:32.835 INFO:teuthology.orchestra.run.smithi150.stdout: "caps": { 2024-09-17T05:42:32.835 INFO:teuthology.orchestra.run.smithi150.stdout: "mds": "allow", 2024-09-17T05:42:32.835 INFO:teuthology.orchestra.run.smithi150.stdout: "mgr": "allow r", 2024-09-17T05:42:32.835 INFO:teuthology.orchestra.run.smithi150.stdout: "mon": "allow rw", 2024-09-17T05:42:32.835 INFO:teuthology.orchestra.run.smithi150.stdout: "osd": "allow rwx" 2024-09-17T05:42:32.835 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-09-17T05:42:32.835 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-17T05:42:32.835 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-09-17T05:42:32.835 INFO:teuthology.orchestra.run.smithi150.stdout: "entity": "client.1", 2024-09-17T05:42:32.835 INFO:teuthology.orchestra.run.smithi150.stdout: "key": "AQBoFulmv3GQJBAANlgjLqiCwzNfmBh8uClJ9A==", 2024-09-17T05:42:32.835 INFO:teuthology.orchestra.run.smithi150.stdout: "caps": { 2024-09-17T05:42:32.835 INFO:teuthology.orchestra.run.smithi150.stdout: "mds": "allow", 2024-09-17T05:42:32.835 INFO:teuthology.orchestra.run.smithi150.stdout: "mgr": "allow r", 2024-09-17T05:42:32.835 INFO:teuthology.orchestra.run.smithi150.stdout: "mon": "allow rw", 2024-09-17T05:42:32.836 INFO:teuthology.orchestra.run.smithi150.stdout: "osd": "allow rwx" 2024-09-17T05:42:32.836 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-09-17T05:42:32.836 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-17T05:42:32.836 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-09-17T05:42:32.836 INFO:teuthology.orchestra.run.smithi150.stdout: "entity": "client.2", 2024-09-17T05:42:32.836 INFO:teuthology.orchestra.run.smithi150.stdout: "key": "AQBoFulm1O/BIBAA8kfQL3/13SmZO1+y2tOZvw==", 2024-09-17T05:42:32.836 INFO:teuthology.orchestra.run.smithi150.stdout: "caps": { 2024-09-17T05:42:32.836 INFO:teuthology.orchestra.run.smithi150.stdout: "mds": "allow", 2024-09-17T05:42:32.836 INFO:teuthology.orchestra.run.smithi150.stdout: "mgr": "allow r", 2024-09-17T05:42:32.836 INFO:teuthology.orchestra.run.smithi150.stdout: "mon": "allow rw", 2024-09-17T05:42:32.836 INFO:teuthology.orchestra.run.smithi150.stdout: "osd": "allow rwx" 2024-09-17T05:42:32.836 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-09-17T05:42:32.836 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-17T05:42:32.837 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-09-17T05:42:32.837 INFO:teuthology.orchestra.run.smithi150.stdout: "entity": "client.3", 2024-09-17T05:42:32.837 INFO:teuthology.orchestra.run.smithi150.stdout: "key": "AQBoFulmF4hVKBAAZ5FGapBLLLtez3t8kON9dg==", 2024-09-17T05:42:32.837 INFO:teuthology.orchestra.run.smithi150.stdout: "caps": { 2024-09-17T05:42:32.837 INFO:teuthology.orchestra.run.smithi150.stdout: "mds": "allow", 2024-09-17T05:42:32.837 INFO:teuthology.orchestra.run.smithi150.stdout: "mgr": "allow r", 2024-09-17T05:42:32.837 INFO:teuthology.orchestra.run.smithi150.stdout: "mon": "allow rw", 2024-09-17T05:42:32.837 INFO:teuthology.orchestra.run.smithi150.stdout: "osd": "allow rwx" 2024-09-17T05:42:32.837 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-09-17T05:42:32.837 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-17T05:42:32.837 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-09-17T05:42:32.837 INFO:teuthology.orchestra.run.smithi150.stdout: "entity": "client.admin", 2024-09-17T05:42:32.837 INFO:teuthology.orchestra.run.smithi150.stdout: "key": "AQBnFulmaU9+IBAA7ZmXWZ44s0IpQ+C+Zw2V1g==", 2024-09-17T05:42:32.837 INFO:teuthology.orchestra.run.smithi150.stdout: "caps": { 2024-09-17T05:42:32.837 INFO:teuthology.orchestra.run.smithi150.stdout: "mds": "allow *", 2024-09-17T05:42:32.838 INFO:teuthology.orchestra.run.smithi150.stdout: "mgr": "allow *", 2024-09-17T05:42:32.838 INFO:teuthology.orchestra.run.smithi150.stdout: "mon": "allow *", 2024-09-17T05:42:32.838 INFO:teuthology.orchestra.run.smithi150.stdout: "osd": "allow *" 2024-09-17T05:42:32.838 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-09-17T05:42:32.838 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-17T05:42:32.838 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-09-17T05:42:32.838 INFO:teuthology.orchestra.run.smithi150.stdout: "entity": "client.bootstrap-mds", 2024-09-17T05:42:32.838 INFO:teuthology.orchestra.run.smithi150.stdout: "key": "AQCMFulmGPsOHhAAC39e8CxHlCQlr018WFxrQw==", 2024-09-17T05:42:32.838 INFO:teuthology.orchestra.run.smithi150.stdout: "caps": { 2024-09-17T05:42:32.838 INFO:teuthology.orchestra.run.smithi150.stdout: "mon": "allow profile bootstrap-mds" 2024-09-17T05:42:32.838 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-09-17T05:42:32.838 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-17T05:42:32.838 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-09-17T05:42:32.839 INFO:teuthology.orchestra.run.smithi150.stdout: "entity": "client.bootstrap-mgr", 2024-09-17T05:42:32.839 INFO:teuthology.orchestra.run.smithi150.stdout: "key": "AQCMFulmDgsPHhAAGCGe2bFNFAY65w/+xUHbig==", 2024-09-17T05:42:32.839 INFO:teuthology.orchestra.run.smithi150.stdout: "caps": { 2024-09-17T05:42:32.839 INFO:teuthology.orchestra.run.smithi150.stdout: "mon": "allow profile bootstrap-mgr" 2024-09-17T05:42:32.839 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-09-17T05:42:32.839 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-17T05:42:32.839 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-09-17T05:42:32.839 INFO:teuthology.orchestra.run.smithi150.stdout: "entity": "client.bootstrap-osd", 2024-09-17T05:42:32.839 INFO:teuthology.orchestra.run.smithi150.stdout: "key": "AQCMFulmnRcPHhAALgAexhNs30AaYKSbmJfZxQ==", 2024-09-17T05:42:32.840 INFO:teuthology.orchestra.run.smithi150.stdout: "caps": { 2024-09-17T05:42:32.840 INFO:teuthology.orchestra.run.smithi150.stdout: "mon": "allow profile bootstrap-osd" 2024-09-17T05:42:32.840 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-09-17T05:42:32.840 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-17T05:42:32.840 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-09-17T05:42:32.840 INFO:teuthology.orchestra.run.smithi150.stdout: "entity": "client.bootstrap-rbd", 2024-09-17T05:42:32.840 INFO:teuthology.orchestra.run.smithi150.stdout: "key": "AQCMFulmzSMPHhAAwkIYk0p+kWow3ZrpSpiulQ==", 2024-09-17T05:42:32.840 INFO:teuthology.orchestra.run.smithi150.stdout: "caps": { 2024-09-17T05:42:32.840 INFO:teuthology.orchestra.run.smithi150.stdout: "mon": "allow profile bootstrap-rbd" 2024-09-17T05:42:32.840 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-09-17T05:42:32.840 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-17T05:42:32.840 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-09-17T05:42:32.840 INFO:teuthology.orchestra.run.smithi150.stdout: "entity": "client.bootstrap-rbd-mirror", 2024-09-17T05:42:32.841 INFO:teuthology.orchestra.run.smithi150.stdout: "key": "AQCMFulmDDAPHhAAZiI6mHTkq5Edf6vzvJQwrw==", 2024-09-17T05:42:32.841 INFO:teuthology.orchestra.run.smithi150.stdout: "caps": { 2024-09-17T05:42:32.841 INFO:teuthology.orchestra.run.smithi150.stdout: "mon": "allow profile bootstrap-rbd-mirror" 2024-09-17T05:42:32.841 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-09-17T05:42:32.841 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-17T05:42:32.841 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-09-17T05:42:32.841 INFO:teuthology.orchestra.run.smithi150.stdout: "entity": "client.bootstrap-rgw", 2024-09-17T05:42:32.841 INFO:teuthology.orchestra.run.smithi150.stdout: "key": "AQCMFulmLD0PHhAAn55n9SyvThC0/VbDAC2Ptg==", 2024-09-17T05:42:32.841 INFO:teuthology.orchestra.run.smithi150.stdout: "caps": { 2024-09-17T05:42:32.841 INFO:teuthology.orchestra.run.smithi150.stdout: "mon": "allow profile bootstrap-rgw" 2024-09-17T05:42:32.841 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-09-17T05:42:32.841 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-17T05:42:32.841 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-09-17T05:42:32.842 INFO:teuthology.orchestra.run.smithi150.stdout: "entity": "mgr.x", 2024-09-17T05:42:32.842 INFO:teuthology.orchestra.run.smithi150.stdout: "key": "AQBnFulmEjvROhAAn3GZxCEtqPYLWopR1AcSFA==", 2024-09-17T05:42:32.842 INFO:teuthology.orchestra.run.smithi150.stdout: "caps": { 2024-09-17T05:42:32.842 INFO:teuthology.orchestra.run.smithi150.stdout: "mds": "allow *", 2024-09-17T05:42:32.842 INFO:teuthology.orchestra.run.smithi150.stdout: "mon": "allow profile mgr", 2024-09-17T05:42:32.842 INFO:teuthology.orchestra.run.smithi150.stdout: "osd": "allow *" 2024-09-17T05:42:32.842 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-09-17T05:42:32.842 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-17T05:42:32.842 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-09-17T05:42:32.842 INFO:teuthology.orchestra.run.smithi150.stdout: "entity": "mgr.y", 2024-09-17T05:42:32.842 INFO:teuthology.orchestra.run.smithi150.stdout: "key": "AQBnFulm9IkENhAA4uf1vzhYOepmovspN5/v1w==", 2024-09-17T05:42:32.842 INFO:teuthology.orchestra.run.smithi150.stdout: "caps": { 2024-09-17T05:42:32.842 INFO:teuthology.orchestra.run.smithi150.stdout: "mds": "allow *", 2024-09-17T05:42:32.842 INFO:teuthology.orchestra.run.smithi150.stdout: "mon": "allow profile mgr", 2024-09-17T05:42:32.843 INFO:teuthology.orchestra.run.smithi150.stdout: "osd": "allow *" 2024-09-17T05:42:32.843 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-09-17T05:42:32.843 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-09-17T05:42:32.843 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2024-09-17T05:42:32.843 INFO:teuthology.orchestra.run.smithi150.stdout:} 2024-09-17T05:42:32.844 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:32.827+0000 7f199478a640 1 -- 172.21.15.150:0/6297617 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f1970078b90 msgr2=0x7f197007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:32.844 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:32.827+0000 7f199478a640 1 --2- 172.21.15.150:0/6297617 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f1970078b90 0x7f197007b0a0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f1988001460 tx=0x7f1988006740 comp rx=0 tx=0).stop 2024-09-17T05:42:32.845 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:32.827+0000 7f199478a640 1 -- 172.21.15.150:0/6297617 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f198c159790 msgr2=0x7f198c1f9670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:32.845 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:32.827+0000 7f199478a640 1 --2- 172.21.15.150:0/6297617 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f198c159790 0x7f198c1f9670 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f197c009a70 tx=0x7f197c033670 comp rx=0 tx=0).stop 2024-09-17T05:42:32.845 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:32.827+0000 7f199478a640 1 -- 172.21.15.150:0/6297617 shutdown_connections 2024-09-17T05:42:32.845 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:32.827+0000 7f199478a640 1 --2- 172.21.15.150:0/6297617 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f198c158c10 0x7f198c159020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:32.845 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:32.827+0000 7f199478a640 1 --2- 172.21.15.150:0/6297617 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f1970078b90 0x7f197007b0a0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:32.845 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:32.827+0000 7f199478a640 1 --2- 172.21.15.150:0/6297617 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f198c159790 0x7f198c1f9670 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:32.845 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:32.827+0000 7f199478a640 1 --2- 172.21.15.150:0/6297617 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1978004800 0x7f198c1f9130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:32.845 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:32.827+0000 7f199478a640 1 -- 172.21.15.150:0/6297617 >> 172.21.15.150:0/6297617 conn(0x7f198c0d4680 msgr2=0x7f198c068e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:42:32.845 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:32.827+0000 7f199478a640 1 -- 172.21.15.150:0/6297617 shutdown_connections 2024-09-17T05:42:32.845 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:32.828+0000 7f199478a640 1 -- 172.21.15.150:0/6297617 wait complete. 2024-09-17T05:42:32.846 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mds 2024-09-17T05:42:32.960 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:32.960+0000 7f86cda0a640 1 -- 172.21.15.150:0/1437290182 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f86c80b74b0 msgr2=0x7f86c80b78c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:32.961 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:32.960+0000 7f86cda0a640 1 --2- 172.21.15.150:0/1437290182 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f86c80b74b0 0x7f86c80b78c0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f86b80098e0 tx=0x7f86b802a530 comp rx=0 tx=0).stop 2024-09-17T05:42:32.961 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:32.960+0000 7f86cda0a640 1 -- 172.21.15.150:0/1437290182 shutdown_connections 2024-09-17T05:42:32.961 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:32.960+0000 7f86cda0a640 1 --2- 172.21.15.150:0/1437290182 >> v2:172.21.15.176:3300/0 conn(0x7f86c80d2e50 0x7f86c80d3260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:32.961 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:32.960+0000 7f86cda0a640 1 --2- 172.21.15.150:0/1437290182 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f86c80b74b0 0x7f86c80b78c0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:32.961 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:32.960+0000 7f86cda0a640 1 -- 172.21.15.150:0/1437290182 >> 172.21.15.150:0/1437290182 conn(0x7f86c808bfe0 msgr2=0x7f86c80d4660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:42:32.961 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:32.960+0000 7f86cda0a640 1 -- 172.21.15.150:0/1437290182 shutdown_connections 2024-09-17T05:42:32.961 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:32.960+0000 7f86cda0a640 1 -- 172.21.15.150:0/1437290182 wait complete. 2024-09-17T05:42:32.962 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:32.961+0000 7f86cda0a640 1 Processor -- start 2024-09-17T05:42:32.962 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:32.962+0000 7f86cda0a640 1 -- start start 2024-09-17T05:42:32.965 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:32.963+0000 7f86cda0a640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f86c80b6320 0x7f86c8167970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:42:32.965 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:32.963+0000 7f86cda0a640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f86c80b74b0 0x7f86c8157650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:42:32.965 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:32.963+0000 7f86cda0a640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f86c80d2e50 0x7f86c80b11f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:42:32.965 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:32.963+0000 7f86cda0a640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f86c80d08e0 con 0x7f86c80b6320 2024-09-17T05:42:32.965 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:32.963+0000 7f86cda0a640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f86c80d0760 con 0x7f86c80b74b0 2024-09-17T05:42:32.965 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:32.963+0000 7f86cda0a640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f86c8169330 con 0x7f86c80d2e50 2024-09-17T05:42:32.965 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:32.963+0000 7f86c6ffd640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f86c80b6320 0x7f86c8167970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:42:32.965 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:32.963+0000 7f86c6ffd640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f86c80b6320 0x7f86c8167970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:58014/0 (socket says 172.21.15.150:58014) 2024-09-17T05:42:32.966 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:32.963+0000 7f86c6ffd640 1 -- 172.21.15.150:0/1077638924 learned_addr learned my addr 172.21.15.150:0/1077638924 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:42:32.966 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:32.963+0000 7f86be7fc640 1 --2- 172.21.15.150:0/1077638924 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f86c80b74b0 0x7f86c8157650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:42:32.966 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:32.963+0000 7f86c77fe640 1 --2- 172.21.15.150:0/1077638924 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f86c80d2e50 0x7f86c80b11f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:42:32.966 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:32.963+0000 7f86c6ffd640 1 -- 172.21.15.150:0/1077638924 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f86c80d2e50 msgr2=0x7f86c80b11f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:32.966 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:32.963+0000 7f86c6ffd640 1 --2- 172.21.15.150:0/1077638924 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f86c80d2e50 0x7f86c80b11f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:32.966 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:32.963+0000 7f86c6ffd640 1 -- 172.21.15.150:0/1077638924 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f86c80b74b0 msgr2=0x7f86c8157650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:32.966 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:32.963+0000 7f86c6ffd640 1 --2- 172.21.15.150:0/1077638924 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f86c80b74b0 0x7f86c8157650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:32.966 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:32.963+0000 7f86c6ffd640 1 -- 172.21.15.150:0/1077638924 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f86c8157fc0 con 0x7f86c80b6320 2024-09-17T05:42:32.966 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:32.963+0000 7f86be7fc640 1 --2- 172.21.15.150:0/1077638924 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f86c80b74b0 0x7f86c8157650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:42:32.966 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:32.964+0000 7f86c6ffd640 1 --2- 172.21.15.150:0/1077638924 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f86c80b6320 0x7f86c8167970 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f86b8009a00 tx=0x7f86b80049d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:42:32.966 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:32.964+0000 7f86c4ff9640 1 -- 172.21.15.150:0/1077638924 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86b8031950 con 0x7f86c80b6320 2024-09-17T05:42:32.967 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:32.964+0000 7f86c4ff9640 1 -- 172.21.15.150:0/1077638924 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f86b8031c00 con 0x7f86c80b6320 2024-09-17T05:42:32.967 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:32.964+0000 7f86cda0a640 1 -- 172.21.15.150:0/1077638924 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f86c81582a0 con 0x7f86c80b6320 2024-09-17T05:42:32.967 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:32.964+0000 7f86c4ff9640 1 -- 172.21.15.150:0/1077638924 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86b80330d0 con 0x7f86c80b6320 2024-09-17T05:42:32.967 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:32.964+0000 7f86cda0a640 1 -- 172.21.15.150:0/1077638924 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f86c8158860 con 0x7f86c80b6320 2024-09-17T05:42:32.967 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:32.965+0000 7f86cda0a640 1 -- 172.21.15.150:0/1077638924 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f86c808caf0 con 0x7f86c80b6320 2024-09-17T05:42:32.968 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:32.965+0000 7f86c4ff9640 1 -- 172.21.15.150:0/1077638924 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f86b8033270 con 0x7f86c80b6320 2024-09-17T05:42:32.968 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:32.966+0000 7f86c4ff9640 1 --2- 172.21.15.150:0/1077638924 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f86a8078bb0 0x7f86a807b0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:42:32.968 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:32.966+0000 7f86c4ff9640 1 -- 172.21.15.150:0/1077638924 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 4857+0+0 (secure 0 0 0) 0x7f86b80bbc00 con 0x7f86c80b6320 2024-09-17T05:42:32.968 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:32.966+0000 7f86be7fc640 1 --2- 172.21.15.150:0/1077638924 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f86a8078bb0 0x7f86a807b0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:42:32.968 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:32.967+0000 7f86be7fc640 1 --2- 172.21.15.150:0/1077638924 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f86a8078bb0 0x7f86a807b0c0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f86c806ead0 tx=0x7f86b0005f90 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:42:32.971 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:32.971+0000 7f86c4ff9640 1 -- 172.21.15.150:0/1077638924 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f86c808caf0 con 0x7f86c80b6320 2024-09-17T05:42:33.214 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:33.214+0000 7f86cda0a640 1 -- 172.21.15.150:0/1077638924 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mds"} v 0) -- 0x7f86c80b78c0 con 0x7f86c80b6320 2024-09-17T05:42:33.217 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:33.216+0000 7f86c4ff9640 1 -- 172.21.15.150:0/1077638924 <== mon.0 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mds"}]=0 v5) ==== 90+0+0 (secure 0 0 0) 0x7f86b80c2080 con 0x7f86c80b6320 2024-09-17T05:42:33.220 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:33.219+0000 7f86cda0a640 1 -- 172.21.15.150:0/1077638924 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f86a8078bb0 msgr2=0x7f86a807b0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:33.220 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:33.219+0000 7f86cda0a640 1 --2- 172.21.15.150:0/1077638924 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f86a8078bb0 0x7f86a807b0c0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f86c806ead0 tx=0x7f86b0005f90 comp rx=0 tx=0).stop 2024-09-17T05:42:33.220 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:33.219+0000 7f86cda0a640 1 -- 172.21.15.150:0/1077638924 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f86c80b6320 msgr2=0x7f86c8167970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:33.220 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:33.219+0000 7f86cda0a640 1 --2- 172.21.15.150:0/1077638924 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f86c80b6320 0x7f86c8167970 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f86b8009a00 tx=0x7f86b80049d0 comp rx=0 tx=0).stop 2024-09-17T05:42:33.220 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:33.219+0000 7f86cda0a640 1 -- 172.21.15.150:0/1077638924 shutdown_connections 2024-09-17T05:42:33.220 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:33.219+0000 7f86cda0a640 1 --2- 172.21.15.150:0/1077638924 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f86c80b74b0 0x7f86c8157650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:33.220 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:33.219+0000 7f86cda0a640 1 --2- 172.21.15.150:0/1077638924 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f86a8078bb0 0x7f86a807b0c0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:33.220 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:33.219+0000 7f86cda0a640 1 --2- 172.21.15.150:0/1077638924 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f86c80d2e50 0x7f86c80b11f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:33.220 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:33.219+0000 7f86cda0a640 1 --2- 172.21.15.150:0/1077638924 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f86c80b6320 0x7f86c8167970 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:33.220 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:33.219+0000 7f86cda0a640 1 -- 172.21.15.150:0/1077638924 >> 172.21.15.150:0/1077638924 conn(0x7f86c808bfe0 msgr2=0x7f86c80d2060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:42:33.220 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:33.219+0000 7f86cda0a640 1 -- 172.21.15.150:0/1077638924 shutdown_connections 2024-09-17T05:42:33.221 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:33.219+0000 7f86cda0a640 1 -- 172.21.15.150:0/1077638924 wait complete. 2024-09-17T05:42:33.231 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mgr 2024-09-17T05:42:33.345 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:33.344+0000 7fa1103c3640 1 -- 172.21.15.150:0/2337943784 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa1080b74f0 msgr2=0x7fa10815ec50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:33.345 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:33.344+0000 7fa1103c3640 1 --2- 172.21.15.150:0/2337943784 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa1080b74f0 0x7fa10815ec50 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fa104009820 tx=0x7fa10402a510 comp rx=0 tx=0).stop 2024-09-17T05:42:33.346 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:33.344+0000 7fa1103c3640 1 -- 172.21.15.150:0/2337943784 shutdown_connections 2024-09-17T05:42:33.346 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:33.344+0000 7fa1103c3640 1 --2- 172.21.15.150:0/2337943784 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa1080b74f0 0x7fa10815ec50 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:33.346 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:33.344+0000 7fa1103c3640 1 -- 172.21.15.150:0/2337943784 >> 172.21.15.150:0/2337943784 conn(0x7fa10808bfe0 msgr2=0x7fa1080d46a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:42:33.346 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:33.344+0000 7fa1103c3640 1 -- 172.21.15.150:0/2337943784 shutdown_connections 2024-09-17T05:42:33.346 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:33.344+0000 7fa1103c3640 1 -- 172.21.15.150:0/2337943784 wait complete. 2024-09-17T05:42:33.346 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:33.346+0000 7fa1103c3640 1 Processor -- start 2024-09-17T05:42:33.346 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:33.346+0000 7fa1103c3640 1 -- start start 2024-09-17T05:42:33.349 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:33.347+0000 7fa1103c3640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa1080b74f0 0x7fa1080cb6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:42:33.349 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:33.347+0000 7fa1103c3640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa1080d0270 0x7fa10815b860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:42:33.350 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:33.347+0000 7fa1103c3640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa1080d2510 0x7fa1080b4840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:42:33.350 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:33.348+0000 7fa1103c3640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7fa1080d0800 con 0x7fa1080d2510 2024-09-17T05:42:33.350 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:33.348+0000 7fa1103c3640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fa1080d0680 con 0x7fa1080d0270 2024-09-17T05:42:33.350 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:33.348+0000 7fa1103c3640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fa1080b2f00 con 0x7fa1080b74f0 2024-09-17T05:42:33.350 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:33.348+0000 7fa10e960640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa1080d2510 0x7fa1080b4840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:42:33.350 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:33.348+0000 7fa10e960640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa1080d2510 0x7fa1080b4840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:58030/0 (socket says 172.21.15.150:58030) 2024-09-17T05:42:33.350 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:33.348+0000 7fa10e960640 1 -- 172.21.15.150:0/1871610656 learned_addr learned my addr 172.21.15.150:0/1871610656 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:42:33.350 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:33.348+0000 7fa10d95e640 1 --2- 172.21.15.150:0/1871610656 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa1080d0270 0x7fa10815b860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:42:33.350 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:33.348+0000 7fa10e15f640 1 --2- 172.21.15.150:0/1871610656 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa1080b74f0 0x7fa1080cb6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:42:33.350 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:33.348+0000 7fa10e960640 1 -- 172.21.15.150:0/1871610656 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa1080b74f0 msgr2=0x7fa1080cb6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:33.350 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:33.348+0000 7fa10e960640 1 --2- 172.21.15.150:0/1871610656 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa1080b74f0 0x7fa1080cb6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:33.350 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:33.348+0000 7fa10e960640 1 -- 172.21.15.150:0/1871610656 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa1080d0270 msgr2=0x7fa10815b860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:33.351 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:33.348+0000 7fa10e960640 1 --2- 172.21.15.150:0/1871610656 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa1080d0270 0x7fa10815b860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:33.351 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:33.348+0000 7fa10e960640 1 -- 172.21.15.150:0/1871610656 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa1080cbc20 con 0x7fa1080d2510 2024-09-17T05:42:33.351 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:33.348+0000 7fa10e15f640 1 --2- 172.21.15.150:0/1871610656 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa1080b74f0 0x7fa1080cb6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:42:33.351 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:33.348+0000 7fa10e960640 1 --2- 172.21.15.150:0/1871610656 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa1080d2510 0x7fa1080b4840 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fa10000c6e0 tx=0x7fa10000cba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:42:33.351 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:33.348+0000 7fa0feffd640 1 -- 172.21.15.150:0/1871610656 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa100003b70 con 0x7fa1080d2510 2024-09-17T05:42:33.351 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:33.348+0000 7fa0feffd640 1 -- 172.21.15.150:0/1871610656 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa100003d10 con 0x7fa1080d2510 2024-09-17T05:42:33.351 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:33.348+0000 7fa1103c3640 1 -- 172.21.15.150:0/1871610656 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa10815bda0 con 0x7fa1080d2510 2024-09-17T05:42:33.351 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:33.348+0000 7fa0feffd640 1 -- 172.21.15.150:0/1871610656 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa100005330 con 0x7fa1080d2510 2024-09-17T05:42:33.351 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:33.348+0000 7fa1103c3640 1 -- 172.21.15.150:0/1871610656 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa1080b3d60 con 0x7fa1080d2510 2024-09-17T05:42:33.351 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:33.349+0000 7fa1103c3640 1 -- 172.21.15.150:0/1871610656 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa1080b3360 con 0x7fa1080d2510 2024-09-17T05:42:33.352 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:33.350+0000 7fa0feffd640 1 -- 172.21.15.150:0/1871610656 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fa1000054d0 con 0x7fa1080d2510 2024-09-17T05:42:33.352 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:33.350+0000 7fa0feffd640 1 --2- 172.21.15.150:0/1871610656 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fa0ec078b90 0x7fa0ec07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:42:33.352 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:33.351+0000 7fa0feffd640 1 -- 172.21.15.150:0/1871610656 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 4857+0+0 (secure 0 0 0) 0x7fa10009a6b0 con 0x7fa1080d2510 2024-09-17T05:42:33.352 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:33.351+0000 7fa10e15f640 1 --2- 172.21.15.150:0/1871610656 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fa0ec078b90 0x7fa0ec07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:42:33.352 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:33.351+0000 7fa10e15f640 1 --2- 172.21.15.150:0/1871610656 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fa0ec078b90 0x7fa0ec07b0a0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fa104034000 tx=0x7fa104004730 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:42:33.355 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:33.355+0000 7fa0feffd640 1 -- 172.21.15.150:0/1871610656 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fa100062ee0 con 0x7fa1080d2510 2024-09-17T05:42:33.605 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:33.604+0000 7fa1103c3640 1 -- 172.21.15.150:0/1871610656 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mgr"} v 0) -- 0x7fa1080b9a10 con 0x7fa1080d2510 2024-09-17T05:42:33.607 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:33.607+0000 7fa0feffd640 1 -- 172.21.15.150:0/1871610656 <== mon.0 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mgr"}]=0 v6) ==== 90+0+0 (secure 0 0 0) 0x7fa1000627e0 con 0x7fa1080d2510 2024-09-17T05:42:33.610 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:33.609+0000 7fa1103c3640 1 -- 172.21.15.150:0/1871610656 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fa0ec078b90 msgr2=0x7fa0ec07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:33.610 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:33.609+0000 7fa1103c3640 1 --2- 172.21.15.150:0/1871610656 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fa0ec078b90 0x7fa0ec07b0a0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fa104034000 tx=0x7fa104004730 comp rx=0 tx=0).stop 2024-09-17T05:42:33.610 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:33.609+0000 7fa1103c3640 1 -- 172.21.15.150:0/1871610656 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa1080d2510 msgr2=0x7fa1080b4840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:33.610 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:33.609+0000 7fa1103c3640 1 --2- 172.21.15.150:0/1871610656 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa1080d2510 0x7fa1080b4840 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fa10000c6e0 tx=0x7fa10000cba0 comp rx=0 tx=0).stop 2024-09-17T05:42:33.610 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:33.609+0000 7fa1103c3640 1 -- 172.21.15.150:0/1871610656 shutdown_connections 2024-09-17T05:42:33.610 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:33.609+0000 7fa1103c3640 1 --2- 172.21.15.150:0/1871610656 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa1080d0270 0x7fa10815b860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:33.610 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:33.609+0000 7fa1103c3640 1 --2- 172.21.15.150:0/1871610656 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fa0ec078b90 0x7fa0ec07b0a0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:33.610 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:33.609+0000 7fa1103c3640 1 --2- 172.21.15.150:0/1871610656 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa1080d2510 0x7fa1080b4840 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:33.611 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:33.609+0000 7fa1103c3640 1 --2- 172.21.15.150:0/1871610656 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa1080b74f0 0x7fa1080cb6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:33.611 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:33.609+0000 7fa1103c3640 1 -- 172.21.15.150:0/1871610656 >> 172.21.15.150:0/1871610656 conn(0x7fa10808bfe0 msgr2=0x7fa10815d330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:42:33.611 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:33.609+0000 7fa1103c3640 1 -- 172.21.15.150:0/1871610656 shutdown_connections 2024-09-17T05:42:33.611 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:33.609+0000 7fa1103c3640 1 -- 172.21.15.150:0/1871610656 wait complete. 2024-09-17T05:42:33.621 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-osd 2024-09-17T05:42:33.735 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:33.735+0000 7faf7f425640 1 -- 172.21.15.150:0/1888025916 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7faf60003a00 msgr2=0x7faf60003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:33.736 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:33.735+0000 7faf7f425640 1 --2- 172.21.15.150:0/1888025916 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7faf60003a00 0x7faf60003e70 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7faf68009ed0 tx=0x7faf60005830 comp rx=0 tx=0).stop 2024-09-17T05:42:33.736 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:33.735+0000 7faf7d9c2640 1 -- 172.21.15.150:0/1888025916 reap_dead start 2024-09-17T05:42:33.736 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:33.735+0000 7faf7f425640 1 -- 172.21.15.150:0/1888025916 shutdown_connections 2024-09-17T05:42:33.736 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:33.735+0000 7faf7f425640 1 -- 172.21.15.150:0/1888025916 >> 172.21.15.150:0/1888025916 conn(0x7faf780b6880 msgr2=0x7faf780b3060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:42:33.736 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:33.735+0000 7faf7f425640 1 -- 172.21.15.150:0/1888025916 shutdown_connections 2024-09-17T05:42:33.736 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:33.735+0000 7faf7f425640 1 -- 172.21.15.150:0/1888025916 wait complete. 2024-09-17T05:42:33.737 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:33.737+0000 7faf7f425640 1 Processor -- start 2024-09-17T05:42:33.737 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:33.737+0000 7faf7f425640 1 -- start start 2024-09-17T05:42:33.740 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:33.738+0000 7faf7f425640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7faf60003a00 0x7faf7815b430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:42:33.740 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:33.738+0000 7faf7f425640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7faf781f4810 0x7faf781f4c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:42:33.740 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:33.738+0000 7faf7f425640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7faf781f5160 0x7faf781441a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:42:33.740 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:33.738+0000 7faf7f425640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7faf780d0e50 con 0x7faf60003a00 2024-09-17T05:42:33.740 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:33.738+0000 7faf7f425640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7faf780d0cd0 con 0x7faf781f5160 2024-09-17T05:42:33.740 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:33.738+0000 7faf7f425640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7faf780d0fd0 con 0x7faf781f4810 2024-09-17T05:42:33.740 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:33.738+0000 7faf7d1c1640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7faf60003a00 0x7faf7815b430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:42:33.740 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:33.738+0000 7faf7d1c1640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7faf60003a00 0x7faf7815b430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:58050/0 (socket says 172.21.15.150:58050) 2024-09-17T05:42:33.740 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:33.738+0000 7faf7d1c1640 1 -- 172.21.15.150:0/33714467 learned_addr learned my addr 172.21.15.150:0/33714467 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:42:33.740 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:33.738+0000 7faf7d9c2640 1 --2- 172.21.15.150:0/33714467 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7faf781f5160 0x7faf781441a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:42:33.741 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:33.738+0000 7faf7c9c0640 1 --2- 172.21.15.150:0/33714467 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7faf781f4810 0x7faf781f4c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:42:33.741 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:33.738+0000 7faf7d1c1640 1 -- 172.21.15.150:0/33714467 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7faf781f4810 msgr2=0x7faf781f4c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:33.741 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:33.738+0000 7faf7d1c1640 1 --2- 172.21.15.150:0/33714467 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7faf781f4810 0x7faf781f4c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:33.741 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:33.738+0000 7faf7d1c1640 1 -- 172.21.15.150:0/33714467 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7faf781f5160 msgr2=0x7faf781441a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:33.741 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:33.738+0000 7faf7d1c1640 1 --2- 172.21.15.150:0/33714467 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7faf781f5160 0x7faf781441a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:33.741 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:33.738+0000 7faf7d1c1640 1 -- 172.21.15.150:0/33714467 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faf78154680 con 0x7faf60003a00 2024-09-17T05:42:33.741 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:33.738+0000 7faf7d9c2640 1 --2- 172.21.15.150:0/33714467 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7faf781f5160 0x7faf781441a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:42:33.741 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:33.738+0000 7faf7d1c1640 1 --2- 172.21.15.150:0/33714467 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7faf60003a00 0x7faf7815b430 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7faf68036040 tx=0x7faf68033bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:42:33.741 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:33.739+0000 7faf75ffb640 1 -- 172.21.15.150:0/33714467 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf68043070 con 0x7faf60003a00 2024-09-17T05:42:33.741 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:33.739+0000 7faf75ffb640 1 -- 172.21.15.150:0/33714467 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7faf68033db0 con 0x7faf60003a00 2024-09-17T05:42:33.741 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:33.739+0000 7faf75ffb640 1 -- 172.21.15.150:0/33714467 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf68038040 con 0x7faf60003a00 2024-09-17T05:42:33.741 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:33.739+0000 7faf7f425640 1 -- 172.21.15.150:0/33714467 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faf78154960 con 0x7faf60003a00 2024-09-17T05:42:33.741 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:33.739+0000 7faf7f425640 1 -- 172.21.15.150:0/33714467 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faf78154f20 con 0x7faf60003a00 2024-09-17T05:42:33.743 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:33.740+0000 7faf7f425640 1 -- 172.21.15.150:0/33714467 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faf780ae340 con 0x7faf60003a00 2024-09-17T05:42:33.743 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:33.741+0000 7faf75ffb640 1 -- 172.21.15.150:0/33714467 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7faf68046070 con 0x7faf60003a00 2024-09-17T05:42:33.743 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:33.741+0000 7faf75ffb640 1 --2- 172.21.15.150:0/33714467 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7faf64078bc0 0x7faf6407b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:42:33.743 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:33.742+0000 7faf75ffb640 1 -- 172.21.15.150:0/33714467 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 4857+0+0 (secure 0 0 0) 0x7faf680bb390 con 0x7faf60003a00 2024-09-17T05:42:33.743 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:33.742+0000 7faf7c9c0640 1 --2- 172.21.15.150:0/33714467 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7faf64078bc0 0x7faf6407b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:42:33.743 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:33.742+0000 7faf7c9c0640 1 --2- 172.21.15.150:0/33714467 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7faf64078bc0 0x7faf6407b0d0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7faf6c001330 tx=0x7faf6c006950 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:42:33.746 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:33.746+0000 7faf75ffb640 1 -- 172.21.15.150:0/33714467 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7faf680834d0 con 0x7faf60003a00 2024-09-17T05:42:33.990 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:33.989+0000 7faf7f425640 1 -- 172.21.15.150:0/33714467 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-osd"} v 0) -- 0x7faf78069770 con 0x7faf60003a00 2024-09-17T05:42:33.992 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:33.992+0000 7faf75ffb640 1 -- 172.21.15.150:0/33714467 <== mon.0 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-osd"}]=0 v7) ==== 90+0+0 (secure 0 0 0) 0x7faf68087f00 con 0x7faf60003a00 2024-09-17T05:42:33.995 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:33.994+0000 7faf7f425640 1 -- 172.21.15.150:0/33714467 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7faf64078bc0 msgr2=0x7faf6407b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:33.995 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:33.994+0000 7faf7f425640 1 --2- 172.21.15.150:0/33714467 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7faf64078bc0 0x7faf6407b0d0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7faf6c001330 tx=0x7faf6c006950 comp rx=0 tx=0).stop 2024-09-17T05:42:33.995 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:33.994+0000 7faf7f425640 1 -- 172.21.15.150:0/33714467 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7faf60003a00 msgr2=0x7faf7815b430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:33.995 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:33.994+0000 7faf7f425640 1 --2- 172.21.15.150:0/33714467 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7faf60003a00 0x7faf7815b430 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7faf68036040 tx=0x7faf68033bc0 comp rx=0 tx=0).stop 2024-09-17T05:42:33.995 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:33.994+0000 7faf7f425640 1 -- 172.21.15.150:0/33714467 shutdown_connections 2024-09-17T05:42:33.996 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:33.994+0000 7faf7f425640 1 --2- 172.21.15.150:0/33714467 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7faf781f5160 0x7faf781441a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:33.996 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:33.994+0000 7faf7f425640 1 --2- 172.21.15.150:0/33714467 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7faf64078bc0 0x7faf6407b0d0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:33.996 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:33.994+0000 7faf7f425640 1 --2- 172.21.15.150:0/33714467 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7faf781f4810 0x7faf781f4c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:33.996 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:33.994+0000 7faf7f425640 1 --2- 172.21.15.150:0/33714467 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7faf60003a00 0x7faf7815b430 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:33.996 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:33.994+0000 7faf7f425640 1 -- 172.21.15.150:0/33714467 >> 172.21.15.150:0/33714467 conn(0x7faf780b6880 msgr2=0x7faf780b3060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:42:33.996 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:33.994+0000 7faf7f425640 1 -- 172.21.15.150:0/33714467 shutdown_connections 2024-09-17T05:42:33.996 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:33.994+0000 7faf7f425640 1 -- 172.21.15.150:0/33714467 wait complete. 2024-09-17T05:42:34.006 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd 2024-09-17T05:42:34.121 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:34.120+0000 7f96f82c5640 1 -- 172.21.15.150:0/4104681628 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f96f00ce490 msgr2=0x7f96f00ce8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:34.122 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:34.120+0000 7f96f82c5640 1 --2- 172.21.15.150:0/4104681628 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f96f00ce490 0x7f96f00ce8a0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f96f006dd40 tx=0x7f96e002a440 comp rx=0 tx=0).stop 2024-09-17T05:42:34.122 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:34.121+0000 7f96f82c5640 1 -- 172.21.15.150:0/4104681628 shutdown_connections 2024-09-17T05:42:34.122 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:34.121+0000 7f96f82c5640 1 --2- 172.21.15.150:0/4104681628 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f96f00ad1c0 0x7f96f00ad5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:34.122 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:34.121+0000 7f96f82c5640 1 --2- 172.21.15.150:0/4104681628 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f96f00ce490 0x7f96f00ce8a0 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:34.122 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:34.121+0000 7f96f82c5640 1 --2- 172.21.15.150:0/4104681628 >> v2:172.21.15.176:3300/0 conn(0x7f96f0070660 0x7f96f00af6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:34.122 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:34.121+0000 7f96f82c5640 1 -- 172.21.15.150:0/4104681628 >> 172.21.15.150:0/4104681628 conn(0x7f96f006d3d0 msgr2=0x7f96f00b1ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:42:34.122 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:34.121+0000 7f96f82c5640 1 -- 172.21.15.150:0/4104681628 shutdown_connections 2024-09-17T05:42:34.122 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:34.121+0000 7f96f82c5640 1 -- 172.21.15.150:0/4104681628 wait complete. 2024-09-17T05:42:34.123 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:34.122+0000 7f96f82c5640 1 Processor -- start 2024-09-17T05:42:34.123 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:34.122+0000 7f96f82c5640 1 -- start start 2024-09-17T05:42:34.129 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:34.124+0000 7f96f82c5640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f96f0070660 0x7f96f0155590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:42:34.129 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:34.124+0000 7f96f82c5640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f96f00ad1c0 0x7f96f00ccd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:42:34.130 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:34.124+0000 7f96f82c5640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f96f00ce490 0x7f96f00cd2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:42:34.130 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:34.124+0000 7f96f82c5640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f96f00adea0 con 0x7f96f00ce490 2024-09-17T05:42:34.130 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:34.124+0000 7f96f82c5640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f96f00add20 con 0x7f96f00ad1c0 2024-09-17T05:42:34.130 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:34.124+0000 7f96f82c5640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f96f00ca940 con 0x7f96f0070660 2024-09-17T05:42:34.130 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:34.124+0000 7f96f6862640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f96f00ce490 0x7f96f00cd2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:42:34.130 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:34.124+0000 7f96f6862640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f96f00ce490 0x7f96f00cd2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:58058/0 (socket says 172.21.15.150:58058) 2024-09-17T05:42:34.130 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:34.124+0000 7f96f6862640 1 -- 172.21.15.150:0/1500862775 learned_addr learned my addr 172.21.15.150:0/1500862775 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:42:34.130 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:34.124+0000 7f96f6061640 1 --2- 172.21.15.150:0/1500862775 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f96f0070660 0x7f96f0155590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:42:34.130 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:34.124+0000 7f96f5860640 1 --2- 172.21.15.150:0/1500862775 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f96f00ad1c0 0x7f96f00ccd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:42:34.130 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:34.124+0000 7f96f6862640 1 -- 172.21.15.150:0/1500862775 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f96f0070660 msgr2=0x7f96f0155590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:34.130 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:34.124+0000 7f96f6862640 1 --2- 172.21.15.150:0/1500862775 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f96f0070660 0x7f96f0155590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:34.130 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:34.124+0000 7f96f6862640 1 -- 172.21.15.150:0/1500862775 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f96f00ad1c0 msgr2=0x7f96f00ccd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:34.130 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:34.124+0000 7f96f6862640 1 --2- 172.21.15.150:0/1500862775 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f96f00ad1c0 0x7f96f00ccd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:34.131 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:34.124+0000 7f96f6862640 1 -- 172.21.15.150:0/1500862775 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f96f00ae8d0 con 0x7f96f00ce490 2024-09-17T05:42:34.131 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:34.124+0000 7f96f6061640 1 --2- 172.21.15.150:0/1500862775 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f96f0070660 0x7f96f0155590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:42:34.131 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:34.124+0000 7f96f6862640 1 --2- 172.21.15.150:0/1500862775 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f96f00ce490 0x7f96f00cd2b0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f96e800e960 tx=0x7f96e800ee20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:42:34.131 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:34.125+0000 7f96e6ffd640 1 -- 172.21.15.150:0/1500862775 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96e8004d20 con 0x7f96f00ce490 2024-09-17T05:42:34.131 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:34.125+0000 7f96e6ffd640 1 -- 172.21.15.150:0/1500862775 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f96e800cac0 con 0x7f96f00ce490 2024-09-17T05:42:34.131 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:34.125+0000 7f96f82c5640 1 -- 172.21.15.150:0/1500862775 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f96f01f99e0 con 0x7f96f00ce490 2024-09-17T05:42:34.131 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:34.125+0000 7f96e6ffd640 1 -- 172.21.15.150:0/1500862775 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96e8005020 con 0x7f96f00ce490 2024-09-17T05:42:34.131 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:34.125+0000 7f96f82c5640 1 -- 172.21.15.150:0/1500862775 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f96f00cdab0 con 0x7f96f00ce490 2024-09-17T05:42:34.131 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:34.126+0000 7f96f82c5640 1 -- 172.21.15.150:0/1500862775 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f96f00ad5d0 con 0x7f96f00ce490 2024-09-17T05:42:34.131 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:34.126+0000 7f96e6ffd640 1 -- 172.21.15.150:0/1500862775 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f96e80051c0 con 0x7f96f00ce490 2024-09-17T05:42:34.131 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:34.127+0000 7f96e6ffd640 1 --2- 172.21.15.150:0/1500862775 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f96d4078bc0 0x7f96d407b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:42:34.132 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:34.127+0000 7f96e6ffd640 1 -- 172.21.15.150:0/1500862775 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 4857+0+0 (secure 0 0 0) 0x7f96e809b140 con 0x7f96f00ce490 2024-09-17T05:42:34.132 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:34.127+0000 7f96f6061640 1 --2- 172.21.15.150:0/1500862775 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f96d4078bc0 0x7f96d407b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:42:34.132 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:34.128+0000 7f96f6061640 1 --2- 172.21.15.150:0/1500862775 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f96d4078bc0 0x7f96d407b0d0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f96ec005fd0 tx=0x7f96ec00b530 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:42:34.132 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:34.132+0000 7f96e6ffd640 1 -- 172.21.15.150:0/1500862775 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f96e8016030 con 0x7f96f00ce490 2024-09-17T05:42:34.376 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:34.376+0000 7f96f82c5640 1 -- 172.21.15.150:0/1500862775 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd"} v 0) -- 0x7f96f00c3da0 con 0x7f96f00ce490 2024-09-17T05:42:34.379 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:34.378+0000 7f96e6ffd640 1 -- 172.21.15.150:0/1500862775 <== mon.0 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd"}]=0 v8) ==== 90+0+0 (secure 0 0 0) 0x7f96e8063320 con 0x7f96f00ce490 2024-09-17T05:42:34.381 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:34.381+0000 7f96f82c5640 1 -- 172.21.15.150:0/1500862775 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f96d4078bc0 msgr2=0x7f96d407b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:34.382 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:34.381+0000 7f96f82c5640 1 --2- 172.21.15.150:0/1500862775 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f96d4078bc0 0x7f96d407b0d0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f96ec005fd0 tx=0x7f96ec00b530 comp rx=0 tx=0).stop 2024-09-17T05:42:34.382 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:34.381+0000 7f96f82c5640 1 -- 172.21.15.150:0/1500862775 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f96f00ce490 msgr2=0x7f96f00cd2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:34.382 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:34.381+0000 7f96f82c5640 1 --2- 172.21.15.150:0/1500862775 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f96f00ce490 0x7f96f00cd2b0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f96e800e960 tx=0x7f96e800ee20 comp rx=0 tx=0).stop 2024-09-17T05:42:34.382 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:34.381+0000 7f96f82c5640 1 -- 172.21.15.150:0/1500862775 shutdown_connections 2024-09-17T05:42:34.382 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:34.381+0000 7f96f82c5640 1 --2- 172.21.15.150:0/1500862775 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f96f00ad1c0 0x7f96f00ccd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:34.382 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:34.381+0000 7f96f82c5640 1 --2- 172.21.15.150:0/1500862775 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f96d4078bc0 0x7f96d407b0d0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:34.382 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:34.381+0000 7f96f82c5640 1 --2- 172.21.15.150:0/1500862775 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f96f00ce490 0x7f96f00cd2b0 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:34.382 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:34.381+0000 7f96f82c5640 1 --2- 172.21.15.150:0/1500862775 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f96f0070660 0x7f96f0155590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:34.382 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:34.381+0000 7f96f82c5640 1 -- 172.21.15.150:0/1500862775 >> 172.21.15.150:0/1500862775 conn(0x7f96f006d3d0 msgr2=0x7f96f015a440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:42:34.382 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:34.381+0000 7f96f82c5640 1 -- 172.21.15.150:0/1500862775 shutdown_connections 2024-09-17T05:42:34.382 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:34.381+0000 7f96f82c5640 1 -- 172.21.15.150:0/1500862775 wait complete. 2024-09-17T05:42:34.393 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd-mirror 2024-09-17T05:42:34.508 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:34.507+0000 7fa8408ec640 1 -- 172.21.15.150:0/3212031783 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa824005250 msgr2=0x7fa82400b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:34.509 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:34.507+0000 7fa8408ec640 1 --2- 172.21.15.150:0/3212031783 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa824005250 0x7fa82400b9c0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fa834006fc0 tx=0x7fa824005830 comp rx=0 tx=0).stop 2024-09-17T05:42:34.509 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:34.507+0000 7fa8408ec640 1 -- 172.21.15.150:0/3212031783 shutdown_connections 2024-09-17T05:42:34.509 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:34.507+0000 7fa8408ec640 1 --2- 172.21.15.150:0/3212031783 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa824005250 0x7fa82400b9c0 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:34.509 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:34.507+0000 7fa8408ec640 1 -- 172.21.15.150:0/3212031783 >> 172.21.15.150:0/3212031783 conn(0x7fa83c0cee80 msgr2=0x7fa83c0cf290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:42:34.509 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:34.507+0000 7fa8408ec640 1 -- 172.21.15.150:0/3212031783 shutdown_connections 2024-09-17T05:42:34.509 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:34.508+0000 7fa8408ec640 1 -- 172.21.15.150:0/3212031783 wait complete. 2024-09-17T05:42:34.510 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:34.509+0000 7fa8408ec640 1 Processor -- start 2024-09-17T05:42:34.510 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:34.509+0000 7fa8408ec640 1 -- start start 2024-09-17T05:42:34.513 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:34.511+0000 7fa8408ec640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa824005250 0x7fa83c09fda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:42:34.513 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:34.511+0000 7fa8408ec640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa83c1f7690 0x7fa83c1e8740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:42:34.513 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:34.511+0000 7fa8408ec640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa83c1e8c80 0x7fa83c09e5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:42:34.513 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:34.511+0000 7fa8408ec640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7fa83c0b55e0 con 0x7fa824005250 2024-09-17T05:42:34.513 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:34.511+0000 7fa8408ec640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fa83c0b5460 con 0x7fa83c1e8c80 2024-09-17T05:42:34.513 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:34.511+0000 7fa8408ec640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fa83c09f4a0 con 0x7fa83c1f7690 2024-09-17T05:42:34.514 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:34.511+0000 7fa83a59c640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa824005250 0x7fa83c09fda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:42:34.514 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:34.511+0000 7fa83a59c640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa824005250 0x7fa83c09fda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:58074/0 (socket says 172.21.15.150:58074) 2024-09-17T05:42:34.514 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:34.511+0000 7fa83a59c640 1 -- 172.21.15.150:0/11091314 learned_addr learned my addr 172.21.15.150:0/11091314 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:42:34.514 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:34.511+0000 7fa83ad9d640 1 --2- 172.21.15.150:0/11091314 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa83c1e8c80 0x7fa83c09e5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:42:34.514 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:34.511+0000 7fa839d9b640 1 --2- 172.21.15.150:0/11091314 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa83c1f7690 0x7fa83c1e8740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:42:34.514 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:34.511+0000 7fa83a59c640 1 -- 172.21.15.150:0/11091314 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa83c1f7690 msgr2=0x7fa83c1e8740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:34.514 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:34.511+0000 7fa83a59c640 1 --2- 172.21.15.150:0/11091314 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa83c1f7690 0x7fa83c1e8740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:34.514 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:34.511+0000 7fa83a59c640 1 -- 172.21.15.150:0/11091314 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa83c1e8c80 msgr2=0x7fa83c09e5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:34.514 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:34.511+0000 7fa83a59c640 1 --2- 172.21.15.150:0/11091314 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa83c1e8c80 0x7fa83c09e5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:34.514 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:34.511+0000 7fa83a59c640 1 -- 172.21.15.150:0/11091314 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa83c1f6bf0 con 0x7fa824005250 2024-09-17T05:42:34.514 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:34.511+0000 7fa83a59c640 1 --2- 172.21.15.150:0/11091314 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa824005250 0x7fa83c09fda0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7fa82c0018b0 tx=0x7fa82c001d70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:42:34.514 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:34.512+0000 7fa82affd640 1 -- 172.21.15.150:0/11091314 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa82c015070 con 0x7fa824005250 2024-09-17T05:42:34.515 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:34.512+0000 7fa82affd640 1 -- 172.21.15.150:0/11091314 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa82c00ea30 con 0x7fa824005250 2024-09-17T05:42:34.515 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:34.512+0000 7fa8408ec640 1 -- 172.21.15.150:0/11091314 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa83c09cd60 con 0x7fa824005250 2024-09-17T05:42:34.515 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:34.512+0000 7fa82affd640 1 -- 172.21.15.150:0/11091314 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa82c00ee60 con 0x7fa824005250 2024-09-17T05:42:34.515 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:34.512+0000 7fa8408ec640 1 -- 172.21.15.150:0/11091314 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa83c1f7170 con 0x7fa824005250 2024-09-17T05:42:34.515 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:34.513+0000 7fa8408ec640 1 -- 172.21.15.150:0/11091314 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa83c0b5f80 con 0x7fa824005250 2024-09-17T05:42:34.516 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:34.513+0000 7fa82affd640 1 -- 172.21.15.150:0/11091314 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fa82c018070 con 0x7fa824005250 2024-09-17T05:42:34.516 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:34.514+0000 7fa82affd640 1 --2- 172.21.15.150:0/11091314 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fa81c078b90 0x7fa81c07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:42:34.516 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:34.514+0000 7fa82affd640 1 -- 172.21.15.150:0/11091314 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 4857+0+0 (secure 0 0 0) 0x7fa82c09b2b0 con 0x7fa824005250 2024-09-17T05:42:34.516 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:34.514+0000 7fa839d9b640 1 --2- 172.21.15.150:0/11091314 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fa81c078b90 0x7fa81c07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:42:34.516 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:34.515+0000 7fa839d9b640 1 --2- 172.21.15.150:0/11091314 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fa81c078b90 0x7fa81c07b0a0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fa83c0b0d20 tx=0x7fa830005f90 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:42:34.519 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:34.518+0000 7fa82affd640 1 -- 172.21.15.150:0/11091314 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fa82c0633f0 con 0x7fa824005250 2024-09-17T05:42:34.766 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:34.766+0000 7fa8408ec640 1 -- 172.21.15.150:0/11091314 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"} v 0) -- 0x7fa83c072860 con 0x7fa824005250 2024-09-17T05:42:34.768 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:34.768+0000 7fa82affd640 1 -- 172.21.15.150:0/11091314 <== mon.0 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"}]=0 v9) ==== 97+0+0 (secure 0 0 0) 0x7fa82c09b0d0 con 0x7fa824005250 2024-09-17T05:42:34.771 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:34.771+0000 7fa8408ec640 1 -- 172.21.15.150:0/11091314 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fa81c078b90 msgr2=0x7fa81c07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:34.771 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:34.771+0000 7fa8408ec640 1 --2- 172.21.15.150:0/11091314 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fa81c078b90 0x7fa81c07b0a0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fa83c0b0d20 tx=0x7fa830005f90 comp rx=0 tx=0).stop 2024-09-17T05:42:34.772 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:34.771+0000 7fa8408ec640 1 -- 172.21.15.150:0/11091314 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa824005250 msgr2=0x7fa83c09fda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:34.772 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:34.771+0000 7fa8408ec640 1 --2- 172.21.15.150:0/11091314 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa824005250 0x7fa83c09fda0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7fa82c0018b0 tx=0x7fa82c001d70 comp rx=0 tx=0).stop 2024-09-17T05:42:34.772 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:34.771+0000 7fa8408ec640 1 -- 172.21.15.150:0/11091314 shutdown_connections 2024-09-17T05:42:34.772 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:34.771+0000 7fa8408ec640 1 --2- 172.21.15.150:0/11091314 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa83c1e8c80 0x7fa83c09e5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:34.772 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:34.771+0000 7fa8408ec640 1 --2- 172.21.15.150:0/11091314 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fa81c078b90 0x7fa81c07b0a0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:34.772 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:34.771+0000 7fa8408ec640 1 --2- 172.21.15.150:0/11091314 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa83c1f7690 0x7fa83c1e8740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:34.772 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:34.771+0000 7fa8408ec640 1 --2- 172.21.15.150:0/11091314 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa824005250 0x7fa83c09fda0 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:34.772 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:34.771+0000 7fa8408ec640 1 -- 172.21.15.150:0/11091314 >> 172.21.15.150:0/11091314 conn(0x7fa83c0cee80 msgr2=0x7fa83c15ff00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:42:34.772 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:34.771+0000 7fa8408ec640 1 -- 172.21.15.150:0/11091314 shutdown_connections 2024-09-17T05:42:34.772 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:34.771+0000 7fa8408ec640 1 -- 172.21.15.150:0/11091314 wait complete. 2024-09-17T05:42:34.783 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rgw 2024-09-17T05:42:34.898 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:34.897+0000 7f353deb4640 1 -- 172.21.15.150:0/352911568 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f35380cea50 msgr2=0x7f35380d0270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:34.898 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:34.897+0000 7f353deb4640 1 --2- 172.21.15.150:0/352911568 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f35380cea50 0x7f35380d0270 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f3528005fd0 tx=0x7f352802aa10 comp rx=0 tx=0).stop 2024-09-17T05:42:34.898 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:34.897+0000 7f353deb4640 1 -- 172.21.15.150:0/352911568 shutdown_connections 2024-09-17T05:42:34.898 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:34.897+0000 7f353deb4640 1 --2- 172.21.15.150:0/352911568 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f35380c5a90 0x7f3538160850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:34.898 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:34.897+0000 7f353deb4640 1 --2- 172.21.15.150:0/352911568 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f35380cea50 0x7f35380d0270 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:34.898 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:34.897+0000 7f353deb4640 1 -- 172.21.15.150:0/352911568 >> 172.21.15.150:0/352911568 conn(0x7f35380cee80 msgr2=0x7f35380cf290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:42:34.898 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:34.897+0000 7f353deb4640 1 -- 172.21.15.150:0/352911568 shutdown_connections 2024-09-17T05:42:34.898 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:34.897+0000 7f353deb4640 1 -- 172.21.15.150:0/352911568 wait complete. 2024-09-17T05:42:34.899 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:34.898+0000 7f353deb4640 1 Processor -- start 2024-09-17T05:42:34.899 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:34.899+0000 7f353deb4640 1 -- start start 2024-09-17T05:42:34.902 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:34.900+0000 7f353deb4640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f35380c5a90 0x7f35381f3e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:42:34.902 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:34.900+0000 7f353deb4640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f35380cea50 0x7f353814d830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:42:34.902 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:34.900+0000 7f353deb4640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3538160d90 0x7f353815e6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:42:34.902 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:34.900+0000 7f353deb4640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f3538161320 con 0x7f35380c5a90 2024-09-17T05:42:34.902 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:34.900+0000 7f353deb4640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f35381611a0 con 0x7f35380cea50 2024-09-17T05:42:34.902 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:34.900+0000 7f353deb4640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f35381614a0 con 0x7f3538160d90 2024-09-17T05:42:34.902 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:34.900+0000 7f35377fe640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f35380c5a90 0x7f35381f3e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:42:34.902 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:34.900+0000 7f35377fe640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f35380c5a90 0x7f35381f3e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:58100/0 (socket says 172.21.15.150:58100) 2024-09-17T05:42:34.902 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:34.900+0000 7f35377fe640 1 -- 172.21.15.150:0/1001843796 learned_addr learned my addr 172.21.15.150:0/1001843796 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:42:34.902 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:34.900+0000 7f3536ffd640 1 --2- 172.21.15.150:0/1001843796 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f35380cea50 0x7f353814d830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:42:34.903 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:34.900+0000 7f3537fff640 1 --2- 172.21.15.150:0/1001843796 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3538160d90 0x7f353815e6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:42:34.903 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:34.900+0000 7f35377fe640 1 -- 172.21.15.150:0/1001843796 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3538160d90 msgr2=0x7f353815e6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:34.903 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:34.900+0000 7f35377fe640 1 --2- 172.21.15.150:0/1001843796 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3538160d90 0x7f353815e6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:34.903 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:34.900+0000 7f35377fe640 1 -- 172.21.15.150:0/1001843796 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f35380cea50 msgr2=0x7f353814d830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:34.903 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:34.900+0000 7f35377fe640 1 --2- 172.21.15.150:0/1001843796 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f35380cea50 0x7f353814d830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:34.903 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:34.900+0000 7f35377fe640 1 -- 172.21.15.150:0/1001843796 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f35381f4380 con 0x7f35380c5a90 2024-09-17T05:42:34.903 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:34.901+0000 7f35377fe640 1 --2- 172.21.15.150:0/1001843796 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f35380c5a90 0x7f35381f3e40 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f3528000f80 tx=0x7f3528003f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:42:34.903 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:34.901+0000 7f351ffff640 1 -- 172.21.15.150:0/1001843796 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3528033070 con 0x7f35380c5a90 2024-09-17T05:42:34.903 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:34.901+0000 7f351ffff640 1 -- 172.21.15.150:0/1001843796 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f3528004e30 con 0x7f35380c5a90 2024-09-17T05:42:34.903 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:34.901+0000 7f353deb4640 1 -- 172.21.15.150:0/1001843796 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f353814dd70 con 0x7f35380c5a90 2024-09-17T05:42:34.903 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:34.901+0000 7f351ffff640 1 -- 172.21.15.150:0/1001843796 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3528004490 con 0x7f35380c5a90 2024-09-17T05:42:34.903 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:34.901+0000 7f353deb4640 1 -- 172.21.15.150:0/1001843796 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f353815d8f0 con 0x7f35380c5a90 2024-09-17T05:42:34.904 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:34.902+0000 7f353deb4640 1 -- 172.21.15.150:0/1001843796 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3538160850 con 0x7f35380c5a90 2024-09-17T05:42:34.904 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:34.903+0000 7f351ffff640 1 -- 172.21.15.150:0/1001843796 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f3528036070 con 0x7f35380c5a90 2024-09-17T05:42:34.905 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:34.903+0000 7f351ffff640 1 --2- 172.21.15.150:0/1001843796 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f3524078b90 0x7f352407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:42:34.905 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:34.903+0000 7f351ffff640 1 -- 172.21.15.150:0/1001843796 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 4857+0+0 (secure 0 0 0) 0x7f35280bba90 con 0x7f35380c5a90 2024-09-17T05:42:34.905 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:34.903+0000 7f3536ffd640 1 --2- 172.21.15.150:0/1001843796 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f3524078b90 0x7f352407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:42:34.905 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:34.904+0000 7f3536ffd640 1 --2- 172.21.15.150:0/1001843796 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f3524078b90 0x7f352407b0a0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f3538160620 tx=0x7f352c00b2e0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:42:34.908 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:34.908+0000 7f351ffff640 1 -- 172.21.15.150:0/1001843796 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f352803e070 con 0x7f35380c5a90 2024-09-17T05:42:35.149 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:35.149+0000 7f353deb4640 1 -- 172.21.15.150:0/1001843796 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rgw"} v 0) -- 0x7f35380b6290 con 0x7f35380c5a90 2024-09-17T05:42:35.152 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:35.152+0000 7f351ffff640 1 -- 172.21.15.150:0/1001843796 <== mon.0 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rgw"}]=0 v10) ==== 90+0+0 (secure 0 0 0) 0x7f3528083bd0 con 0x7f35380c5a90 2024-09-17T05:42:35.157 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:35.154+0000 7f353deb4640 1 -- 172.21.15.150:0/1001843796 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f3524078b90 msgr2=0x7f352407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:35.157 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:35.154+0000 7f353deb4640 1 --2- 172.21.15.150:0/1001843796 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f3524078b90 0x7f352407b0a0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f3538160620 tx=0x7f352c00b2e0 comp rx=0 tx=0).stop 2024-09-17T05:42:35.157 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:35.154+0000 7f353deb4640 1 -- 172.21.15.150:0/1001843796 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f35380c5a90 msgr2=0x7f35381f3e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:35.158 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:35.154+0000 7f353deb4640 1 --2- 172.21.15.150:0/1001843796 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f35380c5a90 0x7f35381f3e40 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f3528000f80 tx=0x7f3528003f90 comp rx=0 tx=0).stop 2024-09-17T05:42:35.158 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:35.154+0000 7f353deb4640 1 -- 172.21.15.150:0/1001843796 shutdown_connections 2024-09-17T05:42:35.158 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:35.154+0000 7f353deb4640 1 --2- 172.21.15.150:0/1001843796 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f35380cea50 0x7f353814d830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:35.158 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:35.154+0000 7f353deb4640 1 --2- 172.21.15.150:0/1001843796 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f3524078b90 0x7f352407b0a0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:35.158 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:35.154+0000 7f353deb4640 1 --2- 172.21.15.150:0/1001843796 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3538160d90 0x7f353815e6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:35.158 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:35.154+0000 7f353deb4640 1 --2- 172.21.15.150:0/1001843796 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f35380c5a90 0x7f35381f3e40 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:35.158 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:35.154+0000 7f353deb4640 1 -- 172.21.15.150:0/1001843796 >> 172.21.15.150:0/1001843796 conn(0x7f35380cee80 msgr2=0x7f35381e87d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:42:35.158 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:35.154+0000 7f353deb4640 1 -- 172.21.15.150:0/1001843796 shutdown_connections 2024-09-17T05:42:35.158 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:35.154+0000 7f353deb4640 1 -- 172.21.15.150:0/1001843796 wait complete. 2024-09-17T05:42:35.166 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-09-17T05:42:35.282 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:35.282+0000 7f229a64d640 1 -- 172.21.15.150:0/2161833865 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f229415b850 msgr2=0x7f22940cddb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:35.283 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:35.282+0000 7f229a64d640 1 --2- 172.21.15.150:0/2161833865 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f229415b850 0x7f22940cddb0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f22940b6cf0 tx=0x7f228402a410 comp rx=0 tx=0).stop 2024-09-17T05:42:35.283 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:35.282+0000 7f229a64d640 1 -- 172.21.15.150:0/2161833865 shutdown_connections 2024-09-17T05:42:35.283 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:35.282+0000 7f229a64d640 1 --2- 172.21.15.150:0/2161833865 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f229415b850 0x7f22940cddb0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:35.283 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:35.282+0000 7f229a64d640 1 --2- 172.21.15.150:0/2161833865 >> v2:172.21.15.150:3300/0 conn(0x7f22940b6880 0x7f22940b3b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:35.283 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:35.282+0000 7f229a64d640 1 -- 172.21.15.150:0/2161833865 >> 172.21.15.150:0/2161833865 conn(0x7f22940b2ff0 msgr2=0x7f22940b3400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:42:35.283 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:35.282+0000 7f229a64d640 1 -- 172.21.15.150:0/2161833865 shutdown_connections 2024-09-17T05:42:35.283 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:35.282+0000 7f229a64d640 1 -- 172.21.15.150:0/2161833865 wait complete. 2024-09-17T05:42:35.284 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:35.284+0000 7f229a64d640 1 Processor -- start 2024-09-17T05:42:35.284 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:35.284+0000 7f229a64d640 1 -- start start 2024-09-17T05:42:35.287 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:35.285+0000 7f229a64d640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f22940b6880 0x7f22940b5aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:42:35.287 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:35.285+0000 7f229a64d640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f22940ce2f0 0x7f229415e1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:42:35.287 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:35.285+0000 7f229a64d640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f229415b850 0x7f229415e6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:42:35.287 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:35.285+0000 7f229a64d640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f22940cfaa0 con 0x7f22940b6880 2024-09-17T05:42:35.287 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:35.285+0000 7f229a64d640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f22940ce910 con 0x7f229415b850 2024-09-17T05:42:35.287 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:35.285+0000 7f229a64d640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f22940cfc20 con 0x7f22940ce2f0 2024-09-17T05:42:35.287 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:35.285+0000 7f2293fff640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f22940b6880 0x7f22940b5aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:42:35.287 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:35.285+0000 7f2293fff640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f22940b6880 0x7f22940b5aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:58122/0 (socket says 172.21.15.150:58122) 2024-09-17T05:42:35.288 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:35.285+0000 7f2293fff640 1 -- 172.21.15.150:0/1206514374 learned_addr learned my addr 172.21.15.150:0/1206514374 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:42:35.288 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:35.285+0000 7f2298bea640 1 --2- 172.21.15.150:0/1206514374 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f229415b850 0x7f229415e6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:42:35.288 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:35.285+0000 7f22937fe640 1 --2- 172.21.15.150:0/1206514374 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f22940ce2f0 0x7f229415e1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:42:35.288 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:35.285+0000 7f2293fff640 1 -- 172.21.15.150:0/1206514374 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f22940ce2f0 msgr2=0x7f229415e1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:35.288 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:35.285+0000 7f2293fff640 1 --2- 172.21.15.150:0/1206514374 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f22940ce2f0 0x7f229415e1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:35.288 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:35.285+0000 7f2293fff640 1 -- 172.21.15.150:0/1206514374 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f229415b850 msgr2=0x7f229415e6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:35.288 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:35.285+0000 7f2293fff640 1 --2- 172.21.15.150:0/1206514374 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f229415b850 0x7f229415e6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:35.288 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:35.285+0000 7f2293fff640 1 -- 172.21.15.150:0/1206514374 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f229409b730 con 0x7f22940b6880 2024-09-17T05:42:35.288 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:35.285+0000 7f2298bea640 1 --2- 172.21.15.150:0/1206514374 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f229415b850 0x7f229415e6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:42:35.288 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:35.286+0000 7f2293fff640 1 --2- 172.21.15.150:0/1206514374 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f22940b6880 0x7f22940b5aa0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f227c00e9f0 tx=0x7f227c00eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:42:35.288 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:35.286+0000 7f2290ff9640 1 -- 172.21.15.150:0/1206514374 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f227c00cd80 con 0x7f22940b6880 2024-09-17T05:42:35.288 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:35.286+0000 7f229a64d640 1 -- 172.21.15.150:0/1206514374 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f229409ba10 con 0x7f22940b6880 2024-09-17T05:42:35.289 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:35.286+0000 7f2290ff9640 1 -- 172.21.15.150:0/1206514374 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f227c004020 con 0x7f22940b6880 2024-09-17T05:42:35.289 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:35.286+0000 7f2290ff9640 1 -- 172.21.15.150:0/1206514374 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f227c004470 con 0x7f22940b6880 2024-09-17T05:42:35.289 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:35.286+0000 7f229a64d640 1 -- 172.21.15.150:0/1206514374 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f229409bfd0 con 0x7f22940b6880 2024-09-17T05:42:35.289 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:35.287+0000 7f229a64d640 1 -- 172.21.15.150:0/1206514374 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f22940d0080 con 0x7f22940b6880 2024-09-17T05:42:35.289 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:35.288+0000 7f2290ff9640 1 -- 172.21.15.150:0/1206514374 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f227c0035f0 con 0x7f22940b6880 2024-09-17T05:42:35.290 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:35.288+0000 7f2290ff9640 1 --2- 172.21.15.150:0/1206514374 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f2274078bc0 0x7f227407b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:42:35.290 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:35.288+0000 7f2290ff9640 1 -- 172.21.15.150:0/1206514374 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 4857+0+0 (secure 0 0 0) 0x7f227c09b480 con 0x7f22940b6880 2024-09-17T05:42:35.290 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:35.288+0000 7f22937fe640 1 --2- 172.21.15.150:0/1206514374 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f2274078bc0 0x7f227407b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:42:35.290 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:35.289+0000 7f22937fe640 1 --2- 172.21.15.150:0/1206514374 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f2274078bc0 0x7f227407b0d0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f2284034000 tx=0x7f2284004730 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:42:35.297 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:35.297+0000 7f2290ff9640 1 -- 172.21.15.150:0/1206514374 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f227c063cb0 con 0x7f22940b6880 2024-09-17T05:42:35.481 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:35.480+0000 7f229a64d640 1 -- 172.21.15.150:0/1206514374 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7f22940b2dd0 con 0x7f22940b6880 2024-09-17T05:42:35.481 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:35.481+0000 7f2290ff9640 1 -- 172.21.15.150:0/1206514374 <== mon.0 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v30) ==== 84+0+65 (secure 0 0 0) 0x7f227c0635b0 con 0x7f22940b6880 2024-09-17T05:42:35.481 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-09-17T05:42:35.482 INFO:teuthology.orchestra.run.smithi150.stdout:[ 2024-09-17T05:42:35.482 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-09-17T05:42:35.482 INFO:teuthology.orchestra.run.smithi150.stdout: "poolnum": 1, 2024-09-17T05:42:35.482 INFO:teuthology.orchestra.run.smithi150.stdout: "poolname": ".mgr" 2024-09-17T05:42:35.482 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-09-17T05:42:35.482 INFO:teuthology.orchestra.run.smithi150.stdout:] 2024-09-17T05:42:35.484 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:35.483+0000 7f229a64d640 1 -- 172.21.15.150:0/1206514374 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f2274078bc0 msgr2=0x7f227407b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:35.484 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:35.483+0000 7f229a64d640 1 --2- 172.21.15.150:0/1206514374 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f2274078bc0 0x7f227407b0d0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f2284034000 tx=0x7f2284004730 comp rx=0 tx=0).stop 2024-09-17T05:42:35.484 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:35.483+0000 7f229a64d640 1 -- 172.21.15.150:0/1206514374 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f22940b6880 msgr2=0x7f22940b5aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:35.484 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:35.483+0000 7f229a64d640 1 --2- 172.21.15.150:0/1206514374 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f22940b6880 0x7f22940b5aa0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f227c00e9f0 tx=0x7f227c00eeb0 comp rx=0 tx=0).stop 2024-09-17T05:42:35.484 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:35.483+0000 7f229a64d640 1 -- 172.21.15.150:0/1206514374 shutdown_connections 2024-09-17T05:42:35.484 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:35.483+0000 7f229a64d640 1 --2- 172.21.15.150:0/1206514374 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f229415b850 0x7f229415e6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:35.484 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:35.483+0000 7f229a64d640 1 --2- 172.21.15.150:0/1206514374 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f2274078bc0 0x7f227407b0d0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:35.485 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:35.483+0000 7f229a64d640 1 --2- 172.21.15.150:0/1206514374 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f22940ce2f0 0x7f229415e1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:35.485 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:35.483+0000 7f229a64d640 1 --2- 172.21.15.150:0/1206514374 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f22940b6880 0x7f22940b5aa0 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:35.485 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:35.483+0000 7f229a64d640 1 -- 172.21.15.150:0/1206514374 >> 172.21.15.150:0/1206514374 conn(0x7f22940b2ff0 msgr2=0x7f2294070cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:42:35.485 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:35.483+0000 7f229a64d640 1 -- 172.21.15.150:0/1206514374 shutdown_connections 2024-09-17T05:42:35.485 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:35.483+0000 7f229a64d640 1 -- 172.21.15.150:0/1206514374 wait complete. 2024-09-17T05:42:35.495 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-09-17T05:42:35.495 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-09-17T05:42:35.616 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:35.615+0000 7efe32b12640 1 -- 172.21.15.150:0/3524055522 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7efe2c06f3a0 msgr2=0x7efe2c0cf300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:35.616 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:35.615+0000 7efe32b12640 1 --2- 172.21.15.150:0/3524055522 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7efe2c06f3a0 0x7efe2c0cf300 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7efe18009820 tx=0x7efe1802a5a0 comp rx=0 tx=0).stop 2024-09-17T05:42:35.617 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:35.615+0000 7efe32b12640 1 -- 172.21.15.150:0/3524055522 shutdown_connections 2024-09-17T05:42:35.617 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:35.615+0000 7efe32b12640 1 --2- 172.21.15.150:0/3524055522 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7efe2c06f3a0 0x7efe2c0cf300 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:35.617 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:35.615+0000 7efe32b12640 1 -- 172.21.15.150:0/3524055522 >> 172.21.15.150:0/3524055522 conn(0x7efe2c0d46f0 msgr2=0x7efe2c0d4b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:42:35.617 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:35.615+0000 7efe32b12640 1 -- 172.21.15.150:0/3524055522 shutdown_connections 2024-09-17T05:42:35.617 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:35.615+0000 7efe32b12640 1 -- 172.21.15.150:0/3524055522 wait complete. 2024-09-17T05:42:35.618 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:35.618+0000 7efe32b12640 1 Processor -- start 2024-09-17T05:42:35.618 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:35.618+0000 7efe32b12640 1 -- start start 2024-09-17T05:42:35.621 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:35.619+0000 7efe32b12640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7efe2c06f3a0 0x7efe2c14ee20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:42:35.621 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:35.619+0000 7efe32b12640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7efe2c0cf840 0x7efe2c1f6770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:42:35.621 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:35.619+0000 7efe32b12640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7efe2c0d0d20 0x7efe2c14e4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:42:35.621 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:35.619+0000 7efe32b12640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7efe2c0d19c0 con 0x7efe2c06f3a0 2024-09-17T05:42:35.621 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:35.619+0000 7efe32b12640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7efe2c0d1840 con 0x7efe2c0cf840 2024-09-17T05:42:35.621 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:35.619+0000 7efe32b12640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7efe2c0d0360 con 0x7efe2c0d0d20 2024-09-17T05:42:35.621 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:35.619+0000 7efe308ae640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7efe2c06f3a0 0x7efe2c14ee20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:42:35.622 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:35.620+0000 7efe308ae640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7efe2c06f3a0 0x7efe2c14ee20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:58132/0 (socket says 172.21.15.150:58132) 2024-09-17T05:42:35.622 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:35.620+0000 7efe308ae640 1 -- 172.21.15.150:0/2290789834 learned_addr learned my addr 172.21.15.150:0/2290789834 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:42:35.622 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:35.620+0000 7efe310af640 1 --2- 172.21.15.150:0/2290789834 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7efe2c0d0d20 0x7efe2c14e4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:42:35.622 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:35.620+0000 7efe2bfff640 1 --2- 172.21.15.150:0/2290789834 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7efe2c0cf840 0x7efe2c1f6770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:42:35.622 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:35.620+0000 7efe308ae640 1 -- 172.21.15.150:0/2290789834 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7efe2c0d0d20 msgr2=0x7efe2c14e4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:35.622 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:35.620+0000 7efe308ae640 1 --2- 172.21.15.150:0/2290789834 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7efe2c0d0d20 0x7efe2c14e4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:35.622 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:35.620+0000 7efe308ae640 1 -- 172.21.15.150:0/2290789834 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7efe2c0cf840 msgr2=0x7efe2c1f6770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:35.622 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:35.620+0000 7efe308ae640 1 --2- 172.21.15.150:0/2290789834 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7efe2c0cf840 0x7efe2c1f6770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:35.622 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:35.620+0000 7efe308ae640 1 -- 172.21.15.150:0/2290789834 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efe2c1e87c0 con 0x7efe2c06f3a0 2024-09-17T05:42:35.622 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:35.620+0000 7efe308ae640 1 --2- 172.21.15.150:0/2290789834 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7efe2c06f3a0 0x7efe2c14ee20 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7efe2000c460 tx=0x7efe2000c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:42:35.622 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:35.620+0000 7efe297fa640 1 -- 172.21.15.150:0/2290789834 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe200052d0 con 0x7efe2c06f3a0 2024-09-17T05:42:35.622 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:35.620+0000 7efe32b12640 1 -- 172.21.15.150:0/2290789834 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efe2c1e8aa0 con 0x7efe2c06f3a0 2024-09-17T05:42:35.622 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:35.620+0000 7efe297fa640 1 -- 172.21.15.150:0/2290789834 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7efe20005490 con 0x7efe2c06f3a0 2024-09-17T05:42:35.623 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:35.620+0000 7efe297fa640 1 -- 172.21.15.150:0/2290789834 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe20012870 con 0x7efe2c06f3a0 2024-09-17T05:42:35.623 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:35.620+0000 7efe32b12640 1 -- 172.21.15.150:0/2290789834 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efe2c1e9060 con 0x7efe2c06f3a0 2024-09-17T05:42:35.623 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:35.621+0000 7efe32b12640 1 -- 172.21.15.150:0/2290789834 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efe2c0cf300 con 0x7efe2c06f3a0 2024-09-17T05:42:35.623 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:35.622+0000 7efe297fa640 1 -- 172.21.15.150:0/2290789834 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7efe20012a10 con 0x7efe2c06f3a0 2024-09-17T05:42:35.624 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:35.623+0000 7efe297fa640 1 --2- 172.21.15.150:0/2290789834 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7efe10078b90 0x7efe1007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:42:35.624 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:35.623+0000 7efe297fa640 1 -- 172.21.15.150:0/2290789834 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 4857+0+0 (secure 0 0 0) 0x7efe2009a400 con 0x7efe2c06f3a0 2024-09-17T05:42:35.624 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:35.623+0000 7efe2bfff640 1 --2- 172.21.15.150:0/2290789834 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7efe10078b90 0x7efe1007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:42:35.624 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:35.624+0000 7efe2bfff640 1 --2- 172.21.15.150:0/2290789834 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7efe10078b90 0x7efe1007b0a0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7efe18034000 tx=0x7efe18004730 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:42:35.628 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:35.628+0000 7efe297fa640 1 -- 172.21.15.150:0/2290789834 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7efe20062550 con 0x7efe2c06f3a0 2024-09-17T05:42:35.812 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:35.811+0000 7efe32b12640 1 -- 172.21.15.150:0/2290789834 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7efe2c0d1410 con 0x7efe2c06f3a0 2024-09-17T05:42:36.772 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:36.771+0000 7efe297fa640 1 -- 172.21.15.150:0/2290789834 <== mon.0 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v31) ==== 138+0+0 (secure 0 0 0) 0x7efe20066f80 con 0x7efe2c06f3a0 2024-09-17T05:42:36.772 INFO:teuthology.orchestra.run.smithi150.stderr:pool 'cephfs_metadata' created 2024-09-17T05:42:36.774 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:36.774+0000 7efe32b12640 1 -- 172.21.15.150:0/2290789834 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7efe10078b90 msgr2=0x7efe1007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:36.775 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:36.774+0000 7efe32b12640 1 --2- 172.21.15.150:0/2290789834 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7efe10078b90 0x7efe1007b0a0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7efe18034000 tx=0x7efe18004730 comp rx=0 tx=0).stop 2024-09-17T05:42:36.775 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:36.774+0000 7efe32b12640 1 -- 172.21.15.150:0/2290789834 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7efe2c06f3a0 msgr2=0x7efe2c14ee20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:36.775 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:36.774+0000 7efe32b12640 1 --2- 172.21.15.150:0/2290789834 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7efe2c06f3a0 0x7efe2c14ee20 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7efe2000c460 tx=0x7efe2000c920 comp rx=0 tx=0).stop 2024-09-17T05:42:36.775 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:36.774+0000 7efe32b12640 1 -- 172.21.15.150:0/2290789834 shutdown_connections 2024-09-17T05:42:36.775 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:36.774+0000 7efe32b12640 1 --2- 172.21.15.150:0/2290789834 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7efe2c0cf840 0x7efe2c1f6770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:36.775 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:36.774+0000 7efe32b12640 1 --2- 172.21.15.150:0/2290789834 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7efe10078b90 0x7efe1007b0a0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:36.775 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:36.774+0000 7efe32b12640 1 --2- 172.21.15.150:0/2290789834 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7efe2c0d0d20 0x7efe2c14e4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:36.775 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:36.774+0000 7efe32b12640 1 --2- 172.21.15.150:0/2290789834 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7efe2c06f3a0 0x7efe2c14ee20 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:36.775 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:36.774+0000 7efe32b12640 1 -- 172.21.15.150:0/2290789834 >> 172.21.15.150:0/2290789834 conn(0x7efe2c0d46f0 msgr2=0x7efe2c0b8740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:42:36.775 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:36.774+0000 7efe32b12640 1 -- 172.21.15.150:0/2290789834 shutdown_connections 2024-09-17T05:42:36.775 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:36.774+0000 7efe32b12640 1 -- 172.21.15.150:0/2290789834 wait complete. 2024-09-17T05:42:36.790 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-09-17T05:42:36.910 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:36.909+0000 7f5684c06640 1 -- 172.21.15.150:0/3833970807 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f56800cd610 msgr2=0x7f56800cda20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:36.910 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:36.909+0000 7f5684c06640 1 --2- 172.21.15.150:0/3833970807 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f56800cd610 0x7f56800cda20 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f5680072bd0 tx=0x7f567802a8b0 comp rx=0 tx=0).stop 2024-09-17T05:42:36.910 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:36.909+0000 7f5684c06640 1 -- 172.21.15.150:0/3833970807 shutdown_connections 2024-09-17T05:42:36.910 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:36.909+0000 7f5684c06640 1 --2- 172.21.15.150:0/3833970807 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f56800cd610 0x7f56800cda20 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:36.911 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:36.909+0000 7f5684c06640 1 --2- 172.21.15.150:0/3833970807 >> v2:172.21.15.176:3300/0 conn(0x7f5680145450 0x7f568006f180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:36.911 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:36.909+0000 7f5684c06640 1 -- 172.21.15.150:0/3833970807 >> 172.21.15.150:0/3833970807 conn(0x7f568006d1c0 msgr2=0x7f568006d5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:42:36.911 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:36.909+0000 7f5684c06640 1 -- 172.21.15.150:0/3833970807 shutdown_connections 2024-09-17T05:42:36.911 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:36.909+0000 7f5684c06640 1 -- 172.21.15.150:0/3833970807 wait complete. 2024-09-17T05:42:36.912 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:36.911+0000 7f5684c06640 1 Processor -- start 2024-09-17T05:42:36.912 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:36.912+0000 7f5684c06640 1 -- start start 2024-09-17T05:42:36.914 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:36.913+0000 7f5684c06640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f56800735e0 0x7f56801f3b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:42:36.915 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:36.913+0000 7f5684c06640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f56800cd610 0x7f568013d070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:42:36.915 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:36.913+0000 7f5684c06640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5680145450 0x7f56800ab560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:42:36.915 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:36.913+0000 7f5684c06640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f56800ce2f0 con 0x7f56800cd610 2024-09-17T05:42:36.915 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:36.913+0000 7f5684c06640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f56800ce170 con 0x7f56800735e0 2024-09-17T05:42:36.915 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:36.913+0000 7f5684c06640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f56800ce470 con 0x7f5680145450 2024-09-17T05:42:36.915 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:36.913+0000 7f5675d9b640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f56800cd610 0x7f568013d070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:42:36.915 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:36.913+0000 7f5675d9b640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f56800cd610 0x7f568013d070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:58152/0 (socket says 172.21.15.150:58152) 2024-09-17T05:42:36.915 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:36.913+0000 7f5675d9b640 1 -- 172.21.15.150:0/4004507206 learned_addr learned my addr 172.21.15.150:0/4004507206 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:42:36.915 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:36.913+0000 7f567e59c640 1 --2- 172.21.15.150:0/4004507206 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f56800735e0 0x7f56801f3b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:42:36.915 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:36.913+0000 7f567ed9d640 1 --2- 172.21.15.150:0/4004507206 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5680145450 0x7f56800ab560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:42:36.915 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:36.913+0000 7f5675d9b640 1 -- 172.21.15.150:0/4004507206 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5680145450 msgr2=0x7f56800ab560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:36.915 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:36.913+0000 7f5675d9b640 1 --2- 172.21.15.150:0/4004507206 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5680145450 0x7f56800ab560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:36.916 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:36.913+0000 7f5675d9b640 1 -- 172.21.15.150:0/4004507206 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f56800735e0 msgr2=0x7f56801f3b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:36.916 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:36.913+0000 7f5675d9b640 1 --2- 172.21.15.150:0/4004507206 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f56800735e0 0x7f56801f3b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:36.916 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:36.913+0000 7f5675d9b640 1 -- 172.21.15.150:0/4004507206 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f56800a9ac0 con 0x7f56800cd610 2024-09-17T05:42:36.916 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:36.913+0000 7f567e59c640 1 --2- 172.21.15.150:0/4004507206 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f56800735e0 0x7f56801f3b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:42:36.916 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:36.913+0000 7f567ed9d640 1 --2- 172.21.15.150:0/4004507206 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5680145450 0x7f56800ab560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:42:36.916 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:36.913+0000 7f5675d9b640 1 --2- 172.21.15.150:0/4004507206 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f56800cd610 0x7f568013d070 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f566800c370 tx=0x7f566800c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:42:36.916 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:36.914+0000 7f56777fe640 1 -- 172.21.15.150:0/4004507206 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5668017070 con 0x7f56800cd610 2024-09-17T05:42:36.916 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:36.914+0000 7f56777fe640 1 -- 172.21.15.150:0/4004507206 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f56680035f0 con 0x7f56800cd610 2024-09-17T05:42:36.916 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:36.914+0000 7f5684c06640 1 -- 172.21.15.150:0/4004507206 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f56800a9da0 con 0x7f56800cd610 2024-09-17T05:42:36.916 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:36.914+0000 7f56777fe640 1 -- 172.21.15.150:0/4004507206 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5668003a40 con 0x7f56800cd610 2024-09-17T05:42:36.916 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:36.914+0000 7f5684c06640 1 -- 172.21.15.150:0/4004507206 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f56800aa360 con 0x7f56800cd610 2024-09-17T05:42:36.917 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:36.915+0000 7f5684c06640 1 -- 172.21.15.150:0/4004507206 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f56800a9830 con 0x7f56800cd610 2024-09-17T05:42:36.917 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:36.916+0000 7f56777fe640 1 -- 172.21.15.150:0/4004507206 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f566801a070 con 0x7f56800cd610 2024-09-17T05:42:36.917 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:36.916+0000 7f56777fe640 1 --2- 172.21.15.150:0/4004507206 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f5660078b90 0x7f566007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:42:36.917 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:36.916+0000 7f56777fe640 1 -- 172.21.15.150:0/4004507206 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5227+0+0 (secure 0 0 0) 0x7f5668099e10 con 0x7f56800cd610 2024-09-17T05:42:36.917 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:36.916+0000 7f567e59c640 1 --2- 172.21.15.150:0/4004507206 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f5660078b90 0x7f566007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:42:36.918 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:36.917+0000 7f567e59c640 1 --2- 172.21.15.150:0/4004507206 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f5660078b90 0x7f566007b0a0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f5670009b80 tx=0x7f5670005f90 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:42:36.921 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:36.921+0000 7f56777fe640 1 -- 172.21.15.150:0/4004507206 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f5668062430 con 0x7f56800cd610 2024-09-17T05:42:37.097 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:37.097+0000 7f5684c06640 1 -- 172.21.15.150:0/4004507206 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7f56800cda20 con 0x7f56800cd610 2024-09-17T05:42:37.780 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:37.780+0000 7f56777fe640 1 -- 172.21.15.150:0/4004507206 <== mon.0 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v32) ==== 170+0+0 (secure 0 0 0) 0x7f5668061d30 con 0x7f56800cd610 2024-09-17T05:42:37.781 INFO:teuthology.orchestra.run.smithi150.stderr:pool 'cephfs_data' created 2024-09-17T05:42:37.784 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:37.783+0000 7f5684c06640 1 -- 172.21.15.150:0/4004507206 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f5660078b90 msgr2=0x7f566007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:37.785 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:37.783+0000 7f5684c06640 1 --2- 172.21.15.150:0/4004507206 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f5660078b90 0x7f566007b0a0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f5670009b80 tx=0x7f5670005f90 comp rx=0 tx=0).stop 2024-09-17T05:42:37.785 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:37.783+0000 7f5684c06640 1 -- 172.21.15.150:0/4004507206 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f56800cd610 msgr2=0x7f568013d070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:37.785 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:37.783+0000 7f5684c06640 1 --2- 172.21.15.150:0/4004507206 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f56800cd610 0x7f568013d070 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f566800c370 tx=0x7f566800c830 comp rx=0 tx=0).stop 2024-09-17T05:42:37.785 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:37.783+0000 7f5684c06640 1 -- 172.21.15.150:0/4004507206 shutdown_connections 2024-09-17T05:42:37.785 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:37.783+0000 7f5684c06640 1 --2- 172.21.15.150:0/4004507206 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f5660078b90 0x7f566007b0a0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:37.785 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:37.783+0000 7f5684c06640 1 --2- 172.21.15.150:0/4004507206 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5680145450 0x7f56800ab560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:37.785 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:37.783+0000 7f5684c06640 1 --2- 172.21.15.150:0/4004507206 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f56800cd610 0x7f568013d070 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:37.785 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:37.783+0000 7f5684c06640 1 --2- 172.21.15.150:0/4004507206 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f56800735e0 0x7f56801f3b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:37.785 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:37.783+0000 7f5684c06640 1 -- 172.21.15.150:0/4004507206 >> 172.21.15.150:0/4004507206 conn(0x7f568006d1c0 msgr2=0x7f56801602b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:42:37.785 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:37.784+0000 7f5684c06640 1 -- 172.21.15.150:0/4004507206 shutdown_connections 2024-09-17T05:42:37.785 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:37.784+0000 7f5684c06640 1 -- 172.21.15.150:0/4004507206 wait complete. 2024-09-17T05:42:37.808 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-09-17T05:42:37.930 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:37.929+0000 7fb39f28b640 1 -- 172.21.15.150:0/1844045315 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb398073b70 msgr2=0x7fb39815f170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:37.930 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:37.929+0000 7fb39f28b640 1 --2- 172.21.15.150:0/1844045315 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb398073b70 0x7fb39815f170 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fb398072bd0 tx=0x7fb39002a980 comp rx=0 tx=0).stop 2024-09-17T05:42:37.930 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:37.929+0000 7fb39f28b640 1 -- 172.21.15.150:0/1844045315 shutdown_connections 2024-09-17T05:42:37.931 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:37.929+0000 7fb39f28b640 1 --2- 172.21.15.150:0/1844045315 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb398073b70 0x7fb39815f170 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:37.931 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:37.929+0000 7fb39f28b640 1 --2- 172.21.15.150:0/1844045315 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb3980cfab0 0x7fb398073630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:37.931 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:37.929+0000 7fb39f28b640 1 --2- 172.21.15.150:0/1844045315 >> v2:172.21.15.176:3300/0 conn(0x7fb3980ccc50 0x7fb3980cf570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:37.931 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:37.929+0000 7fb39f28b640 1 -- 172.21.15.150:0/1844045315 >> 172.21.15.150:0/1844045315 conn(0x7fb39806d1c0 msgr2=0x7fb39806d5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:42:37.931 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:37.929+0000 7fb39f28b640 1 -- 172.21.15.150:0/1844045315 shutdown_connections 2024-09-17T05:42:37.931 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:37.929+0000 7fb39f28b640 1 -- 172.21.15.150:0/1844045315 wait complete. 2024-09-17T05:42:37.931 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:37.931+0000 7fb39f28b640 1 Processor -- start 2024-09-17T05:42:37.932 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:37.931+0000 7fb39f28b640 1 -- start start 2024-09-17T05:42:37.935 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:37.932+0000 7fb39f28b640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb398073b70 0x7fb39813c530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:42:37.935 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:37.932+0000 7fb39f28b640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb3980ccc50 0x7fb39813ca70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:42:37.935 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:37.932+0000 7fb39f28b640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb3980cfab0 0x7fb39813cfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:42:37.935 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:37.933+0000 7fb39f28b640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7fb39815fac0 con 0x7fb398073b70 2024-09-17T05:42:37.935 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:37.933+0000 7fb39f28b640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fb39815f940 con 0x7fb3980ccc50 2024-09-17T05:42:37.935 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:37.933+0000 7fb39f28b640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fb39815fc40 con 0x7fb3980cfab0 2024-09-17T05:42:37.935 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:37.933+0000 7fb39d027640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb398073b70 0x7fb39813c530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:42:37.935 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:37.933+0000 7fb39d027640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb398073b70 0x7fb39813c530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:58170/0 (socket says 172.21.15.150:58170) 2024-09-17T05:42:37.935 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:37.933+0000 7fb39d027640 1 -- 172.21.15.150:0/1775460706 learned_addr learned my addr 172.21.15.150:0/1775460706 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:42:37.935 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:37.933+0000 7fb39d828640 1 --2- 172.21.15.150:0/1775460706 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb3980cfab0 0x7fb39813cfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:42:37.936 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:37.933+0000 7fb39c826640 1 --2- 172.21.15.150:0/1775460706 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb3980ccc50 0x7fb39813ca70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:42:37.936 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:37.933+0000 7fb39d027640 1 -- 172.21.15.150:0/1775460706 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb3980cfab0 msgr2=0x7fb39813cfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:37.936 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:37.933+0000 7fb39d027640 1 --2- 172.21.15.150:0/1775460706 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb3980cfab0 0x7fb39813cfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:37.936 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:37.933+0000 7fb39d027640 1 -- 172.21.15.150:0/1775460706 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb3980ccc50 msgr2=0x7fb39813ca70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:37.936 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:37.933+0000 7fb39d027640 1 --2- 172.21.15.150:0/1775460706 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb3980ccc50 0x7fb39813ca70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:37.936 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:37.933+0000 7fb39d027640 1 -- 172.21.15.150:0/1775460706 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb39813ba90 con 0x7fb398073b70 2024-09-17T05:42:37.936 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:37.933+0000 7fb39d828640 1 --2- 172.21.15.150:0/1775460706 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb3980cfab0 0x7fb39813cfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:42:37.936 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:37.933+0000 7fb39c826640 1 --2- 172.21.15.150:0/1775460706 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb3980ccc50 0x7fb39813ca70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:42:37.936 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:37.933+0000 7fb39d027640 1 --2- 172.21.15.150:0/1775460706 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb398073b70 0x7fb39813c530 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7fb38800c940 tx=0x7fb38800ce00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:42:37.936 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:37.933+0000 7fb38dffb640 1 -- 172.21.15.150:0/1775460706 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb388004220 con 0x7fb398073b70 2024-09-17T05:42:37.936 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:37.933+0000 7fb38dffb640 1 -- 172.21.15.150:0/1775460706 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb3880079b0 con 0x7fb398073b70 2024-09-17T05:42:37.936 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:37.933+0000 7fb38dffb640 1 -- 172.21.15.150:0/1775460706 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb388007de0 con 0x7fb398073b70 2024-09-17T05:42:37.936 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:37.933+0000 7fb39f28b640 1 -- 172.21.15.150:0/1775460706 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb398151cb0 con 0x7fb398073b70 2024-09-17T05:42:37.937 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:37.934+0000 7fb39f28b640 1 -- 172.21.15.150:0/1775460706 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb398151f90 con 0x7fb398073b70 2024-09-17T05:42:37.937 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:37.935+0000 7fb39f28b640 1 -- 172.21.15.150:0/1775460706 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb39813c220 con 0x7fb398073b70 2024-09-17T05:42:37.937 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:37.935+0000 7fb38dffb640 1 -- 172.21.15.150:0/1775460706 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fb388005020 con 0x7fb398073b70 2024-09-17T05:42:37.938 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:37.936+0000 7fb38dffb640 1 --2- 172.21.15.150:0/1775460706 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fb37c078b90 0x7fb37c07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:42:37.938 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:37.936+0000 7fb38dffb640 1 -- 172.21.15.150:0/1775460706 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5609+0+0 (secure 0 0 0) 0x7fb38809b0b0 con 0x7fb398073b70 2024-09-17T05:42:37.938 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:37.936+0000 7fb39c826640 1 --2- 172.21.15.150:0/1775460706 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fb37c078b90 0x7fb37c07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:42:37.938 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:37.937+0000 7fb39c826640 1 --2- 172.21.15.150:0/1775460706 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fb37c078b90 0x7fb37c07b0a0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fb394005fd0 tx=0x7fb394005e00 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:42:37.941 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:37.941+0000 7fb38dffb640 1 -- 172.21.15.150:0/1775460706 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fb388014030 con 0x7fb398073b70 2024-09-17T05:42:38.152 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:38.151+0000 7fb39f28b640 1 -- 172.21.15.150:0/1775460706 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7fb3980cf570 con 0x7fb398073b70 2024-09-17T05:42:38.783 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:38.782+0000 7fb38dffb640 1 -- 172.21.15.150:0/1775460706 <== mon.0 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 4 and data pool 5 v11) ==== 172+0+0 (secure 0 0 0) 0x7fb388063550 con 0x7fb398073b70 2024-09-17T05:42:38.783 INFO:teuthology.orchestra.run.smithi150.stderr:new fs with metadata pool 4 and data pool 5 2024-09-17T05:42:38.787 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:38.787+0000 7fb39f28b640 1 -- 172.21.15.150:0/1775460706 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fb37c078b90 msgr2=0x7fb37c07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:38.787 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:38.787+0000 7fb39f28b640 1 --2- 172.21.15.150:0/1775460706 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fb37c078b90 0x7fb37c07b0a0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fb394005fd0 tx=0x7fb394005e00 comp rx=0 tx=0).stop 2024-09-17T05:42:38.787 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:38.787+0000 7fb39f28b640 1 -- 172.21.15.150:0/1775460706 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb398073b70 msgr2=0x7fb39813c530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:38.788 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:38.787+0000 7fb39f28b640 1 --2- 172.21.15.150:0/1775460706 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb398073b70 0x7fb39813c530 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7fb38800c940 tx=0x7fb38800ce00 comp rx=0 tx=0).stop 2024-09-17T05:42:38.789 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:38.789+0000 7fb39f28b640 1 -- 172.21.15.150:0/1775460706 shutdown_connections 2024-09-17T05:42:38.789 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:38.789+0000 7fb39f28b640 1 --2- 172.21.15.150:0/1775460706 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb3980ccc50 0x7fb39813ca70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:38.789 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:38.789+0000 7fb39f28b640 1 --2- 172.21.15.150:0/1775460706 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fb37c078b90 0x7fb37c07b0a0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:38.790 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:38.789+0000 7fb39f28b640 1 --2- 172.21.15.150:0/1775460706 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb3980cfab0 0x7fb39813cfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:38.790 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:38.789+0000 7fb39f28b640 1 --2- 172.21.15.150:0/1775460706 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb398073b70 0x7fb39813c530 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:38.790 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:38.789+0000 7fb39f28b640 1 -- 172.21.15.150:0/1775460706 >> 172.21.15.150:0/1775460706 conn(0x7fb39806d1c0 msgr2=0x7fb39815ecb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:42:38.793 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:38.793+0000 7fb39f28b640 1 -- 172.21.15.150:0/1775460706 shutdown_connections 2024-09-17T05:42:38.794 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:38.794+0000 7fb39f28b640 1 -- 172.21.15.150:0/1775460706 wait complete. 2024-09-17T05:42:38.825 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T05:42:38.942 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:38.942+0000 7f3745e7f640 1 -- 172.21.15.150:0/590469867 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3728005280 msgr2=0x7f372800b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:38.943 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:38.942+0000 7f3745e7f640 1 --2- 172.21.15.150:0/590469867 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3728005280 0x7f372800b9c0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f3740073d80 tx=0x7f3728005830 comp rx=0 tx=0).stop 2024-09-17T05:42:38.943 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:38.942+0000 7f3745e7f640 1 -- 172.21.15.150:0/590469867 shutdown_connections 2024-09-17T05:42:38.943 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:38.942+0000 7f3745e7f640 1 --2- 172.21.15.150:0/590469867 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3728005280 0x7f372800b9c0 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:38.943 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:38.942+0000 7f3745e7f640 1 -- 172.21.15.150:0/590469867 >> 172.21.15.150:0/590469867 conn(0x7f37400cee90 msgr2=0x7f37400cf2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:42:38.943 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:38.942+0000 7f3745e7f640 1 -- 172.21.15.150:0/590469867 shutdown_connections 2024-09-17T05:42:38.943 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:38.942+0000 7f3745e7f640 1 -- 172.21.15.150:0/590469867 wait complete. 2024-09-17T05:42:38.944 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:38.944+0000 7f3745e7f640 1 Processor -- start 2024-09-17T05:42:38.944 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:38.944+0000 7f3745e7f640 1 -- start start 2024-09-17T05:42:38.947 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:38.945+0000 7f3745e7f640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3728005280 0x7f37401f73e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:42:38.948 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:38.945+0000 7f3745e7f640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f37401f7920 0x7f37401f6340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:42:38.948 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:38.945+0000 7f3745e7f640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f37401f6880 0x7f374009f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:42:38.948 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:38.945+0000 7f3745e7f640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f37400b76c0 con 0x7f37401f7920 2024-09-17T05:42:38.948 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:38.945+0000 7f3745e7f640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f37400b7540 con 0x7f3728005280 2024-09-17T05:42:38.948 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:38.945+0000 7f3745e7f640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f37400d1590 con 0x7f37401f6880 2024-09-17T05:42:38.948 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:38.945+0000 7f373effd640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f37401f7920 0x7f37401f6340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:42:38.948 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:38.945+0000 7f373effd640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f37401f7920 0x7f37401f6340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:58196/0 (socket says 172.21.15.150:58196) 2024-09-17T05:42:38.948 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:38.945+0000 7f373effd640 1 -- 172.21.15.150:0/3365883164 learned_addr learned my addr 172.21.15.150:0/3365883164 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:42:38.948 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:38.945+0000 7f373ffff640 1 --2- 172.21.15.150:0/3365883164 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f37401f6880 0x7f374009f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:42:38.948 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:38.945+0000 7f373f7fe640 1 --2- 172.21.15.150:0/3365883164 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3728005280 0x7f37401f73e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:42:38.948 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:38.945+0000 7f373effd640 1 -- 172.21.15.150:0/3365883164 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f37401f6880 msgr2=0x7f374009f110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:38.949 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:38.945+0000 7f373effd640 1 --2- 172.21.15.150:0/3365883164 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f37401f6880 0x7f374009f110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:38.949 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:38.945+0000 7f373effd640 1 -- 172.21.15.150:0/3365883164 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3728005280 msgr2=0x7f37401f73e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:38.949 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:38.945+0000 7f373effd640 1 --2- 172.21.15.150:0/3365883164 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3728005280 0x7f37401f73e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:38.949 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:38.945+0000 7f373effd640 1 -- 172.21.15.150:0/3365883164 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f37401e3ae0 con 0x7f37401f7920 2024-09-17T05:42:38.949 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:38.945+0000 7f373ffff640 1 --2- 172.21.15.150:0/3365883164 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f37401f6880 0x7f374009f110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T05:42:38.949 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:38.945+0000 7f373f7fe640 1 --2- 172.21.15.150:0/3365883164 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3728005280 0x7f37401f73e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T05:42:38.949 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:38.946+0000 7f373effd640 1 --2- 172.21.15.150:0/3365883164 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f37401f7920 0x7f37401f6340 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f3734006650 tx=0x7f3734001800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:42:38.949 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:38.946+0000 7f3727fff640 1 -- 172.21.15.150:0/3365883164 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3734011700 con 0x7f37401f7920 2024-09-17T05:42:38.949 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:38.946+0000 7f3727fff640 1 -- 172.21.15.150:0/3365883164 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f3734016020 con 0x7f37401f7920 2024-09-17T05:42:38.949 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:38.946+0000 7f3745e7f640 1 -- 172.21.15.150:0/3365883164 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f374009e630 con 0x7f37401f7920 2024-09-17T05:42:38.949 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:38.946+0000 7f3727fff640 1 -- 172.21.15.150:0/3365883164 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3734011b00 con 0x7f37401f7920 2024-09-17T05:42:38.949 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:38.946+0000 7f3745e7f640 1 -- 172.21.15.150:0/3365883164 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f37401e3570 con 0x7f37401f7920 2024-09-17T05:42:38.950 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:38.947+0000 7f3745e7f640 1 -- 172.21.15.150:0/3365883164 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f37400d03c0 con 0x7f37401f7920 2024-09-17T05:42:38.950 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:38.948+0000 7f3727fff640 1 -- 172.21.15.150:0/3365883164 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f3734011ca0 con 0x7f37401f7920 2024-09-17T05:42:38.950 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:38.948+0000 7f3727fff640 1 --2- 172.21.15.150:0/3365883164 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f372c078b90 0x7f372c07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:42:38.950 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:38.948+0000 7f3727fff640 1 -- 172.21.15.150:0/3365883164 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5709+0+0 (secure 0 0 0) 0x7f373409ba00 con 0x7f37401f7920 2024-09-17T05:42:38.951 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:38.948+0000 7f373f7fe640 1 --2- 172.21.15.150:0/3365883164 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f372c078b90 0x7f372c07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:42:38.951 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:38.949+0000 7f373f7fe640 1 --2- 172.21.15.150:0/3365883164 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f372c078b90 0x7f372c07b0a0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f3730009ac0 tx=0x7f3730005f30 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:42:38.953 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:38.953+0000 7f3727fff640 1 -- 172.21.15.150:0/3365883164 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f3734020020 con 0x7f37401f7920 2024-09-17T05:42:39.129 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:39.128+0000 7f3745e7f640 1 -- 172.21.15.150:0/3365883164 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f37401e3870 con 0x7f37401f7920 2024-09-17T05:42:39.130 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:39.129+0000 7f3727fff640 1 -- 172.21.15.150:0/3365883164 <== mon.0 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v33) ==== 74+0+16778 (secure 0 0 0) 0x7f3734063ed0 con 0x7f37401f7920 2024-09-17T05:42:39.130 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-09-17T05:42:39.130 INFO:teuthology.orchestra.run.smithi150.stdout:{"epoch":33,"fsid":"9f2e05e9-d629-47b3-b26b-1360655b7d20","created":"2024-09-17T05:41:32.502979+0000","modified":"2024-09-17T05:42:38.152733+0000","last_up_change":"2024-09-17T05:41:46.150225+0000","last_in_change":"2024-09-17T05:41:36.120274+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T05:41:46.860779+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-09-17T05:42:35.815685+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-09-17T05:42:37.101233+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"4f31c018-c8a4-4d6d-b0c2-a597c47aae4a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6800","nonce":479374392},{"type":"v1","addr":"172.21.15.150:6801","nonce":479374392}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6802","nonce":479374392},{"type":"v1","addr":"172.21.15.150:6803","nonce":479374392}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6806","nonce":479374392},{"type":"v1","addr":"172.21.15.150:6807","nonce":479374392}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6804","nonce":479374392},{"type":"v1","addr":"172.21.15.150:6805","nonce":479374392}]},"public_addr":"172.21.15.150:6801/479374392","cluster_addr":"172.21.15.150:6803/479374392","heartbeat_back_addr":"172.21.15.150:6807/479374392","heartbeat_front_addr":"172.21.15.150:6805/479374392","state":["exists","up"]},{"osd":1,"uuid":"6ff4a573-500b-4e04-9de3-39265ead78b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6824","nonce":913899800},{"type":"v1","addr":"172.21.15.150:6825","nonce":913899800}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6826","nonce":913899800},{"type":"v1","addr":"172.21.15.150:6827","nonce":913899800}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6830","nonce":913899800},{"type":"v1","addr":"172.21.15.150:6831","nonce":913899800}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6828","nonce":913899800},{"type":"v1","addr":"172.21.15.150:6829","nonce":913899800}]},"public_addr":"172.21.15.150:6825/913899800","cluster_addr":"172.21.15.150:6827/913899800","heartbeat_back_addr":"172.21.15.150:6831/913899800","heartbeat_front_addr":"172.21.15.150:6829/913899800","state":["exists","up"]},{"osd":2,"uuid":"bffea6f9-2465-4182-b205-00436c41ac1c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6816","nonce":363718461},{"type":"v1","addr":"172.21.15.150:6817","nonce":363718461}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6818","nonce":363718461},{"type":"v1","addr":"172.21.15.150:6819","nonce":363718461}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6822","nonce":363718461},{"type":"v1","addr":"172.21.15.150:6823","nonce":363718461}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6820","nonce":363718461},{"type":"v1","addr":"172.21.15.150:6821","nonce":363718461}]},"public_addr":"172.21.15.150:6817/363718461","cluster_addr":"172.21.15.150:6819/363718461","heartbeat_back_addr":"172.21.15.150:6823/363718461","heartbeat_front_addr":"172.21.15.150:6821/363718461","state":["exists","up"]},{"osd":3,"uuid":"cda70430-d1e1-427e-b04e-56db4031d078","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6808","nonce":3550994626},{"type":"v1","addr":"172.21.15.150:6809","nonce":3550994626}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6810","nonce":3550994626},{"type":"v1","addr":"172.21.15.150:6811","nonce":3550994626}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6814","nonce":3550994626},{"type":"v1","addr":"172.21.15.150:6815","nonce":3550994626}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6812","nonce":3550994626},{"type":"v1","addr":"172.21.15.150:6813","nonce":3550994626}]},"public_addr":"172.21.15.150:6809/3550994626","cluster_addr":"172.21.15.150:6811/3550994626","heartbeat_back_addr":"172.21.15.150:6815/3550994626","heartbeat_front_addr":"172.21.15.150:6813/3550994626","state":["exists","up"]},{"osd":4,"uuid":"3a0277fb-5e1e-4f68-bb2d-9a8a0152f64a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6810","nonce":2718261497},{"type":"v1","addr":"172.21.15.176:6811","nonce":2718261497}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6812","nonce":2718261497},{"type":"v1","addr":"172.21.15.176:6813","nonce":2718261497}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6816","nonce":2718261497},{"type":"v1","addr":"172.21.15.176:6817","nonce":2718261497}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6814","nonce":2718261497},{"type":"v1","addr":"172.21.15.176:6815","nonce":2718261497}]},"public_addr":"172.21.15.176:6811/2718261497","cluster_addr":"172.21.15.176:6813/2718261497","heartbeat_back_addr":"172.21.15.176:6817/2718261497","heartbeat_front_addr":"172.21.15.176:6815/2718261497","state":["exists","up"]},{"osd":5,"uuid":"33aebee6-0315-40b7-a11c-6702f0be494d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6818","nonce":2049295774},{"type":"v1","addr":"172.21.15.176:6819","nonce":2049295774}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6820","nonce":2049295774},{"type":"v1","addr":"172.21.15.176:6821","nonce":2049295774}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6824","nonce":2049295774},{"type":"v1","addr":"172.21.15.176:6825","nonce":2049295774}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6822","nonce":2049295774},{"type":"v1","addr":"172.21.15.176:6823","nonce":2049295774}]},"public_addr":"172.21.15.176:6819/2049295774","cluster_addr":"172.21.15.176:6821/2049295774","heartbeat_back_addr":"172.21.15.176:6825/2049295774","heartbeat_front_addr":"172.21.15.176:6823/2049295774","state":["exists","up"]},{"osd":6,"uuid":"4d24f360-6751-4263-841b-d77793d33540","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6826","nonce":2164458476},{"type":"v1","addr":"172.21.15.176:6827","nonce":2164458476}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6828","nonce":2164458476},{"type":"v1","addr":"172.21.15.176:6829","nonce":2164458476}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6832","nonce":2164458476},{"type":"v1","addr":"172.21.15.176:6833","nonce":2164458476}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6830","nonce":2164458476},{"type":"v1","addr":"172.21.15.176:6831","nonce":2164458476}]},"public_addr":"172.21.15.176:6827/2164458476","cluster_addr":"172.21.15.176:6829/2164458476","heartbeat_back_addr":"172.21.15.176:6833/2164458476","heartbeat_front_addr":"172.21.15.176:6831/2164458476","state":["exists","up"]},{"osd":7,"uuid":"c8594fda-c74a-4ba9-8277-caf101d58ca1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6802","nonce":3239587708},{"type":"v1","addr":"172.21.15.176:6803","nonce":3239587708}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6804","nonce":3239587708},{"type":"v1","addr":"172.21.15.176:6805","nonce":3239587708}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6808","nonce":3239587708},{"type":"v1","addr":"172.21.15.176:6809","nonce":3239587708}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6806","nonce":3239587708},{"type":"v1","addr":"172.21.15.176:6807","nonce":3239587708}]},"public_addr":"172.21.15.176:6803/3239587708","cluster_addr":"172.21.15.176:6805/3239587708","heartbeat_back_addr":"172.21.15.176:6809/3239587708","heartbeat_front_addr":"172.21.15.176:6807/3239587708","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:41:41.905151+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:41:42.705679+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:41:42.459673+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:41:42.440819+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:41:42.668428+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:41:42.694972+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:41:43.078535+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:41:42.363539+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T05:42:39.132 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:39.132+0000 7f3745e7f640 1 -- 172.21.15.150:0/3365883164 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f372c078b90 msgr2=0x7f372c07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:39.132 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:39.132+0000 7f3745e7f640 1 --2- 172.21.15.150:0/3365883164 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f372c078b90 0x7f372c07b0a0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f3730009ac0 tx=0x7f3730005f30 comp rx=0 tx=0).stop 2024-09-17T05:42:39.133 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:39.132+0000 7f3745e7f640 1 -- 172.21.15.150:0/3365883164 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f37401f7920 msgr2=0x7f37401f6340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:39.133 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:39.132+0000 7f3745e7f640 1 --2- 172.21.15.150:0/3365883164 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f37401f7920 0x7f37401f6340 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f3734006650 tx=0x7f3734001800 comp rx=0 tx=0).stop 2024-09-17T05:42:39.133 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:39.132+0000 7f3745e7f640 1 -- 172.21.15.150:0/3365883164 shutdown_connections 2024-09-17T05:42:39.133 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:39.132+0000 7f3745e7f640 1 --2- 172.21.15.150:0/3365883164 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f372c078b90 0x7f372c07b0a0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:39.133 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:39.132+0000 7f3745e7f640 1 --2- 172.21.15.150:0/3365883164 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f37401f6880 0x7f374009f110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:39.133 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:39.132+0000 7f3745e7f640 1 --2- 172.21.15.150:0/3365883164 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f37401f7920 0x7f37401f6340 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:39.133 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:39.132+0000 7f3745e7f640 1 --2- 172.21.15.150:0/3365883164 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3728005280 0x7f37401f73e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:39.133 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:39.132+0000 7f3745e7f640 1 -- 172.21.15.150:0/3365883164 >> 172.21.15.150:0/3365883164 conn(0x7f37400cee90 msgr2=0x7f37400b61a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:42:39.133 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:39.132+0000 7f3745e7f640 1 -- 172.21.15.150:0/3365883164 shutdown_connections 2024-09-17T05:42:39.133 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:39.132+0000 7f3745e7f640 1 -- 172.21.15.150:0/3365883164 wait complete. 2024-09-17T05:42:39.144 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T05:42:39.257 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:39.256+0000 7fc0d717b640 1 -- 172.21.15.150:0/1895708563 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc0d00d1060 msgr2=0x7fc0d00b1e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:39.257 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:39.256+0000 7fc0d717b640 1 --2- 172.21.15.150:0/1895708563 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc0d00d1060 0x7fc0d00b1e00 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fc0d00711a0 tx=0x7fc0c802aac0 comp rx=0 tx=0).stop 2024-09-17T05:42:39.257 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:39.256+0000 7fc0d717b640 1 -- 172.21.15.150:0/1895708563 shutdown_connections 2024-09-17T05:42:39.258 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:39.256+0000 7fc0d717b640 1 --2- 172.21.15.150:0/1895708563 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc0d00d1060 0x7fc0d00b1e00 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:39.258 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:39.256+0000 7fc0d717b640 1 --2- 172.21.15.150:0/1895708563 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc0d00d0550 0x7fc0d00b18c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:39.258 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:39.256+0000 7fc0d717b640 1 --2- 172.21.15.150:0/1895708563 >> v2:172.21.15.176:3300/0 conn(0x7fc0d00d0c50 0x7fc0d00d0010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:39.258 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:39.256+0000 7fc0d717b640 1 -- 172.21.15.150:0/1895708563 >> 172.21.15.150:0/1895708563 conn(0x7fc0d00b3fc0 msgr2=0x7fc0d00b43d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:42:39.258 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:39.256+0000 7fc0d717b640 1 -- 172.21.15.150:0/1895708563 shutdown_connections 2024-09-17T05:42:39.258 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:39.256+0000 7fc0d717b640 1 -- 172.21.15.150:0/1895708563 wait complete. 2024-09-17T05:42:39.258 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:39.258+0000 7fc0d717b640 1 Processor -- start 2024-09-17T05:42:39.259 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:39.258+0000 7fc0d717b640 1 -- start start 2024-09-17T05:42:39.262 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:39.260+0000 7fc0d717b640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc0d00d0550 0x7fc0d01f4000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:42:39.262 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:39.260+0000 7fc0d717b640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc0d00d0c50 0x7fc0d014e810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:42:39.262 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:39.260+0000 7fc0d717b640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc0d00d1060 0x7fc0d01f6990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:42:39.262 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:39.260+0000 7fc0d717b640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7fc0d00cecf0 con 0x7fc0d00d0c50 2024-09-17T05:42:39.262 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:39.260+0000 7fc0d717b640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fc0d00ceb70 con 0x7fc0d00d0550 2024-09-17T05:42:39.262 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:39.260+0000 7fc0d717b640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fc0d0160a90 con 0x7fc0d00d1060 2024-09-17T05:42:39.262 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:39.260+0000 7fc0cffff640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc0d00d0c50 0x7fc0d014e810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:42:39.263 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:39.260+0000 7fc0cffff640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc0d00d0c50 0x7fc0d014e810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:58220/0 (socket says 172.21.15.150:58220) 2024-09-17T05:42:39.263 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:39.260+0000 7fc0cffff640 1 -- 172.21.15.150:0/403004398 learned_addr learned my addr 172.21.15.150:0/403004398 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:42:39.263 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:39.260+0000 7fc0d5718640 1 --2- 172.21.15.150:0/403004398 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc0d00d1060 0x7fc0d01f6990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:42:39.263 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:39.260+0000 7fc0d4f17640 1 --2- 172.21.15.150:0/403004398 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc0d00d0550 0x7fc0d01f4000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:42:39.263 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:39.260+0000 7fc0cffff640 1 -- 172.21.15.150:0/403004398 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc0d00d1060 msgr2=0x7fc0d01f6990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:39.263 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:39.260+0000 7fc0cffff640 1 --2- 172.21.15.150:0/403004398 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc0d00d1060 0x7fc0d01f6990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:39.263 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:39.260+0000 7fc0cffff640 1 -- 172.21.15.150:0/403004398 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc0d00d0550 msgr2=0x7fc0d01f4000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:39.263 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:39.260+0000 7fc0cffff640 1 --2- 172.21.15.150:0/403004398 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc0d00d0550 0x7fc0d01f4000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:39.263 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:39.260+0000 7fc0cffff640 1 -- 172.21.15.150:0/403004398 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc0d01f78f0 con 0x7fc0d00d0c50 2024-09-17T05:42:39.263 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:39.260+0000 7fc0cffff640 1 --2- 172.21.15.150:0/403004398 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc0d00d0c50 0x7fc0d014e810 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7fc0bc00d650 tx=0x7fc0bc00db10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:42:39.263 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:39.260+0000 7fc0cd7fa640 1 -- 172.21.15.150:0/403004398 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0bc017070 con 0x7fc0d00d0c50 2024-09-17T05:42:39.263 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:39.260+0000 7fc0cd7fa640 1 -- 172.21.15.150:0/403004398 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc0bc009b10 con 0x7fc0d00d0c50 2024-09-17T05:42:39.263 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:39.260+0000 7fc0cd7fa640 1 -- 172.21.15.150:0/403004398 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0bc010460 con 0x7fc0d00d0c50 2024-09-17T05:42:39.264 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:39.261+0000 7fc0d717b640 1 -- 172.21.15.150:0/403004398 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc0d01f7610 con 0x7fc0d00d0c50 2024-09-17T05:42:39.264 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:39.261+0000 7fc0d717b640 1 -- 172.21.15.150:0/403004398 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc0d01f3800 con 0x7fc0d00d0c50 2024-09-17T05:42:39.264 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:39.261+0000 7fc0d717b640 1 -- 172.21.15.150:0/403004398 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc0d01f7380 con 0x7fc0d00d0c50 2024-09-17T05:42:39.265 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:39.262+0000 7fc0cd7fa640 1 -- 172.21.15.150:0/403004398 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fc0bc01a070 con 0x7fc0d00d0c50 2024-09-17T05:42:39.265 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:39.263+0000 7fc0cd7fa640 1 --2- 172.21.15.150:0/403004398 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fc0b4078b90 0x7fc0b407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:42:39.265 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:39.263+0000 7fc0cd7fa640 1 -- 172.21.15.150:0/403004398 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5709+0+0 (secure 0 0 0) 0x7fc0bc09ad60 con 0x7fc0d00d0c50 2024-09-17T05:42:39.265 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:39.263+0000 7fc0d4f17640 1 --2- 172.21.15.150:0/403004398 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fc0b4078b90 0x7fc0b407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:42:39.265 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:39.263+0000 7fc0d4f17640 1 --2- 172.21.15.150:0/403004398 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fc0b4078b90 0x7fc0b407b0a0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fc0c400bb50 tx=0x7fc0c400b2e0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:42:39.267 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:39.267+0000 7fc0cd7fa640 1 -- 172.21.15.150:0/403004398 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fc0bc062b50 con 0x7fc0d00d0c50 2024-09-17T05:42:39.446 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:39.445+0000 7fc0d717b640 1 -- 172.21.15.150:0/403004398 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fc0d00d0010 con 0x7fc0d00d0c50 2024-09-17T05:42:39.447 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:39.446+0000 7fc0cd7fa640 1 -- 172.21.15.150:0/403004398 <== mon.0 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v33) ==== 74+0+16778 (secure 0 0 0) 0x7fc0bc067580 con 0x7fc0d00d0c50 2024-09-17T05:42:39.447 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-09-17T05:42:39.447 INFO:teuthology.orchestra.run.smithi150.stdout:{"epoch":33,"fsid":"9f2e05e9-d629-47b3-b26b-1360655b7d20","created":"2024-09-17T05:41:32.502979+0000","modified":"2024-09-17T05:42:38.152733+0000","last_up_change":"2024-09-17T05:41:46.150225+0000","last_in_change":"2024-09-17T05:41:36.120274+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T05:41:46.860779+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-09-17T05:42:35.815685+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-09-17T05:42:37.101233+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"4f31c018-c8a4-4d6d-b0c2-a597c47aae4a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6800","nonce":479374392},{"type":"v1","addr":"172.21.15.150:6801","nonce":479374392}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6802","nonce":479374392},{"type":"v1","addr":"172.21.15.150:6803","nonce":479374392}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6806","nonce":479374392},{"type":"v1","addr":"172.21.15.150:6807","nonce":479374392}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6804","nonce":479374392},{"type":"v1","addr":"172.21.15.150:6805","nonce":479374392}]},"public_addr":"172.21.15.150:6801/479374392","cluster_addr":"172.21.15.150:6803/479374392","heartbeat_back_addr":"172.21.15.150:6807/479374392","heartbeat_front_addr":"172.21.15.150:6805/479374392","state":["exists","up"]},{"osd":1,"uuid":"6ff4a573-500b-4e04-9de3-39265ead78b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6824","nonce":913899800},{"type":"v1","addr":"172.21.15.150:6825","nonce":913899800}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6826","nonce":913899800},{"type":"v1","addr":"172.21.15.150:6827","nonce":913899800}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6830","nonce":913899800},{"type":"v1","addr":"172.21.15.150:6831","nonce":913899800}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6828","nonce":913899800},{"type":"v1","addr":"172.21.15.150:6829","nonce":913899800}]},"public_addr":"172.21.15.150:6825/913899800","cluster_addr":"172.21.15.150:6827/913899800","heartbeat_back_addr":"172.21.15.150:6831/913899800","heartbeat_front_addr":"172.21.15.150:6829/913899800","state":["exists","up"]},{"osd":2,"uuid":"bffea6f9-2465-4182-b205-00436c41ac1c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6816","nonce":363718461},{"type":"v1","addr":"172.21.15.150:6817","nonce":363718461}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6818","nonce":363718461},{"type":"v1","addr":"172.21.15.150:6819","nonce":363718461}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6822","nonce":363718461},{"type":"v1","addr":"172.21.15.150:6823","nonce":363718461}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6820","nonce":363718461},{"type":"v1","addr":"172.21.15.150:6821","nonce":363718461}]},"public_addr":"172.21.15.150:6817/363718461","cluster_addr":"172.21.15.150:6819/363718461","heartbeat_back_addr":"172.21.15.150:6823/363718461","heartbeat_front_addr":"172.21.15.150:6821/363718461","state":["exists","up"]},{"osd":3,"uuid":"cda70430-d1e1-427e-b04e-56db4031d078","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6808","nonce":3550994626},{"type":"v1","addr":"172.21.15.150:6809","nonce":3550994626}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6810","nonce":3550994626},{"type":"v1","addr":"172.21.15.150:6811","nonce":3550994626}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6814","nonce":3550994626},{"type":"v1","addr":"172.21.15.150:6815","nonce":3550994626}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6812","nonce":3550994626},{"type":"v1","addr":"172.21.15.150:6813","nonce":3550994626}]},"public_addr":"172.21.15.150:6809/3550994626","cluster_addr":"172.21.15.150:6811/3550994626","heartbeat_back_addr":"172.21.15.150:6815/3550994626","heartbeat_front_addr":"172.21.15.150:6813/3550994626","state":["exists","up"]},{"osd":4,"uuid":"3a0277fb-5e1e-4f68-bb2d-9a8a0152f64a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6810","nonce":2718261497},{"type":"v1","addr":"172.21.15.176:6811","nonce":2718261497}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6812","nonce":2718261497},{"type":"v1","addr":"172.21.15.176:6813","nonce":2718261497}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6816","nonce":2718261497},{"type":"v1","addr":"172.21.15.176:6817","nonce":2718261497}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6814","nonce":2718261497},{"type":"v1","addr":"172.21.15.176:6815","nonce":2718261497}]},"public_addr":"172.21.15.176:6811/2718261497","cluster_addr":"172.21.15.176:6813/2718261497","heartbeat_back_addr":"172.21.15.176:6817/2718261497","heartbeat_front_addr":"172.21.15.176:6815/2718261497","state":["exists","up"]},{"osd":5,"uuid":"33aebee6-0315-40b7-a11c-6702f0be494d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6818","nonce":2049295774},{"type":"v1","addr":"172.21.15.176:6819","nonce":2049295774}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6820","nonce":2049295774},{"type":"v1","addr":"172.21.15.176:6821","nonce":2049295774}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6824","nonce":2049295774},{"type":"v1","addr":"172.21.15.176:6825","nonce":2049295774}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6822","nonce":2049295774},{"type":"v1","addr":"172.21.15.176:6823","nonce":2049295774}]},"public_addr":"172.21.15.176:6819/2049295774","cluster_addr":"172.21.15.176:6821/2049295774","heartbeat_back_addr":"172.21.15.176:6825/2049295774","heartbeat_front_addr":"172.21.15.176:6823/2049295774","state":["exists","up"]},{"osd":6,"uuid":"4d24f360-6751-4263-841b-d77793d33540","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6826","nonce":2164458476},{"type":"v1","addr":"172.21.15.176:6827","nonce":2164458476}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6828","nonce":2164458476},{"type":"v1","addr":"172.21.15.176:6829","nonce":2164458476}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6832","nonce":2164458476},{"type":"v1","addr":"172.21.15.176:6833","nonce":2164458476}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6830","nonce":2164458476},{"type":"v1","addr":"172.21.15.176:6831","nonce":2164458476}]},"public_addr":"172.21.15.176:6827/2164458476","cluster_addr":"172.21.15.176:6829/2164458476","heartbeat_back_addr":"172.21.15.176:6833/2164458476","heartbeat_front_addr":"172.21.15.176:6831/2164458476","state":["exists","up"]},{"osd":7,"uuid":"c8594fda-c74a-4ba9-8277-caf101d58ca1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6802","nonce":3239587708},{"type":"v1","addr":"172.21.15.176:6803","nonce":3239587708}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6804","nonce":3239587708},{"type":"v1","addr":"172.21.15.176:6805","nonce":3239587708}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6808","nonce":3239587708},{"type":"v1","addr":"172.21.15.176:6809","nonce":3239587708}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6806","nonce":3239587708},{"type":"v1","addr":"172.21.15.176:6807","nonce":3239587708}]},"public_addr":"172.21.15.176:6803/3239587708","cluster_addr":"172.21.15.176:6805/3239587708","heartbeat_back_addr":"172.21.15.176:6809/3239587708","heartbeat_front_addr":"172.21.15.176:6807/3239587708","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:41:41.905151+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:41:42.705679+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:41:42.459673+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:41:42.440819+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:41:42.668428+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:41:42.694972+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:41:43.078535+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:41:42.363539+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T05:42:39.449 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:39.449+0000 7fc0d717b640 1 -- 172.21.15.150:0/403004398 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fc0b4078b90 msgr2=0x7fc0b407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:39.450 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:39.449+0000 7fc0d717b640 1 --2- 172.21.15.150:0/403004398 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fc0b4078b90 0x7fc0b407b0a0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fc0c400bb50 tx=0x7fc0c400b2e0 comp rx=0 tx=0).stop 2024-09-17T05:42:39.450 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:39.449+0000 7fc0d717b640 1 -- 172.21.15.150:0/403004398 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc0d00d0c50 msgr2=0x7fc0d014e810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:39.450 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:39.449+0000 7fc0d717b640 1 --2- 172.21.15.150:0/403004398 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc0d00d0c50 0x7fc0d014e810 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7fc0bc00d650 tx=0x7fc0bc00db10 comp rx=0 tx=0).stop 2024-09-17T05:42:39.450 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:39.449+0000 7fc0d717b640 1 -- 172.21.15.150:0/403004398 shutdown_connections 2024-09-17T05:42:39.450 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:39.449+0000 7fc0d717b640 1 --2- 172.21.15.150:0/403004398 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fc0b4078b90 0x7fc0b407b0a0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:39.450 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:39.449+0000 7fc0d717b640 1 --2- 172.21.15.150:0/403004398 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc0d00d1060 0x7fc0d01f6990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:39.450 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:39.449+0000 7fc0d717b640 1 --2- 172.21.15.150:0/403004398 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc0d00d0c50 0x7fc0d014e810 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:39.450 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:39.449+0000 7fc0d717b640 1 --2- 172.21.15.150:0/403004398 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc0d00d0550 0x7fc0d01f4000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:39.450 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:39.449+0000 7fc0d717b640 1 -- 172.21.15.150:0/403004398 >> 172.21.15.150:0/403004398 conn(0x7fc0d00b3fc0 msgr2=0x7fc0d00af3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:42:39.450 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:39.449+0000 7fc0d717b640 1 -- 172.21.15.150:0/403004398 shutdown_connections 2024-09-17T05:42:39.450 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:39.449+0000 7fc0d717b640 1 -- 172.21.15.150:0/403004398 wait complete. 2024-09-17T05:42:39.461 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-09-17T05:42:39.577 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:39.577+0000 7f44bd68b640 1 -- 172.21.15.150:0/398453827 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f44b806dea0 msgr2=0x7f44b80d0020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:39.577 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:39.577+0000 7f44bd68b640 1 --2- 172.21.15.150:0/398453827 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f44b806dea0 0x7f44b80d0020 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f44b80cfd10 tx=0x7f44ac02a5c0 comp rx=0 tx=0).stop 2024-09-17T05:42:39.578 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:39.577+0000 7f44bd68b640 1 -- 172.21.15.150:0/398453827 shutdown_connections 2024-09-17T05:42:39.578 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:39.577+0000 7f44bd68b640 1 --2- 172.21.15.150:0/398453827 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f44b806dea0 0x7f44b80d0020 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:39.578 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:39.577+0000 7f44bd68b640 1 -- 172.21.15.150:0/398453827 >> 172.21.15.150:0/398453827 conn(0x7f44b808bfe0 msgr2=0x7f44b80d46e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:42:39.578 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:39.577+0000 7f44bd68b640 1 -- 172.21.15.150:0/398453827 shutdown_connections 2024-09-17T05:42:39.578 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:39.577+0000 7f44bd68b640 1 -- 172.21.15.150:0/398453827 wait complete. 2024-09-17T05:42:39.579 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:39.579+0000 7f44bd68b640 1 Processor -- start 2024-09-17T05:42:39.579 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:39.579+0000 7f44bd68b640 1 -- start start 2024-09-17T05:42:39.582 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:39.580+0000 7f44bd68b640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f44b806dea0 0x7f44b815d4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:42:39.582 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:39.580+0000 7f44bd68b640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f44b806e2b0 0x7f44b80cdab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:42:39.582 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:39.580+0000 7f44bd68b640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f44b80d5150 0x7f44b8158850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:42:39.582 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:39.580+0000 7f44bd68b640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f44b80b6870 con 0x7f44b80d5150 2024-09-17T05:42:39.582 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:39.580+0000 7f44bd68b640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f44b80d31e0 con 0x7f44b806dea0 2024-09-17T05:42:39.582 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:39.580+0000 7f44bd68b640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f44b80b69f0 con 0x7f44b806e2b0 2024-09-17T05:42:39.582 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:39.580+0000 7f44b77fe640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f44b80d5150 0x7f44b8158850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:42:39.582 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:39.580+0000 7f44b77fe640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f44b80d5150 0x7f44b8158850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:58244/0 (socket says 172.21.15.150:58244) 2024-09-17T05:42:39.582 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:39.580+0000 7f44b77fe640 1 -- 172.21.15.150:0/39772454 learned_addr learned my addr 172.21.15.150:0/39772454 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:42:39.582 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:39.580+0000 7f44b6ffd640 1 --2- 172.21.15.150:0/39772454 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f44b806dea0 0x7f44b815d4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:42:39.582 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:39.580+0000 7f44b67fc640 1 --2- 172.21.15.150:0/39772454 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f44b806e2b0 0x7f44b80cdab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:42:39.583 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:39.580+0000 7f44b77fe640 1 -- 172.21.15.150:0/39772454 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f44b806e2b0 msgr2=0x7f44b80cdab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:39.583 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:39.580+0000 7f44b77fe640 1 --2- 172.21.15.150:0/39772454 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f44b806e2b0 0x7f44b80cdab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:39.583 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:39.580+0000 7f44b77fe640 1 -- 172.21.15.150:0/39772454 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f44b806dea0 msgr2=0x7f44b815d4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:39.583 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:39.580+0000 7f44b77fe640 1 --2- 172.21.15.150:0/39772454 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f44b806dea0 0x7f44b815d4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:39.583 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:39.580+0000 7f44b77fe640 1 -- 172.21.15.150:0/39772454 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f44b8158d90 con 0x7f44b80d5150 2024-09-17T05:42:39.583 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:39.580+0000 7f44b77fe640 1 --2- 172.21.15.150:0/39772454 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f44b80d5150 0x7f44b8158850 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f44b000c6e0 tx=0x7f44b000cba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:42:39.583 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:39.581+0000 7f449f7fe640 1 -- 172.21.15.150:0/39772454 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f44b0003b70 con 0x7f44b80d5150 2024-09-17T05:42:39.583 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:39.581+0000 7f449f7fe640 1 -- 172.21.15.150:0/39772454 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f44b0003d30 con 0x7f44b80d5150 2024-09-17T05:42:39.583 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:39.581+0000 7f44bd68b640 1 -- 172.21.15.150:0/39772454 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f44b815a940 con 0x7f44b80d5150 2024-09-17T05:42:39.583 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:39.581+0000 7f449f7fe640 1 -- 172.21.15.150:0/39772454 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f44b0005330 con 0x7f44b80d5150 2024-09-17T05:42:39.583 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:39.581+0000 7f44bd68b640 1 -- 172.21.15.150:0/39772454 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f44b815af00 con 0x7f44b80d5150 2024-09-17T05:42:39.584 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:39.582+0000 7f44bd68b640 1 -- 172.21.15.150:0/39772454 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f44b80d0770 con 0x7f44b80d5150 2024-09-17T05:42:39.584 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:39.582+0000 7f449f7fe640 1 -- 172.21.15.150:0/39772454 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f44b00054d0 con 0x7f44b80d5150 2024-09-17T05:42:39.584 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:39.583+0000 7f449f7fe640 1 --2- 172.21.15.150:0/39772454 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f44a4078b90 0x7f44a407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:42:39.584 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:39.583+0000 7f449f7fe640 1 -- 172.21.15.150:0/39772454 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5709+0+0 (secure 0 0 0) 0x7f44b009ab00 con 0x7f44b80d5150 2024-09-17T05:42:39.585 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:39.583+0000 7f44b6ffd640 1 --2- 172.21.15.150:0/39772454 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f44a4078b90 0x7f44a407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:42:39.585 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:39.584+0000 7f44b6ffd640 1 --2- 172.21.15.150:0/39772454 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f44a4078b90 0x7f44a407b0a0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f44a8001090 tx=0x7f44a8009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:42:39.588 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:39.587+0000 7f449f7fe640 1 -- 172.21.15.150:0/39772454 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f44b8158d90 con 0x7f44b80d5150 2024-09-17T05:42:39.803 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:39.803+0000 7f44bd68b640 1 -- 172.21.15.150:0/39772454 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7f44b80b1a20 con 0x7f44b80d5150 2024-09-17T05:42:40.810 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:40.809+0000 7f449f7fe640 1 -- 172.21.15.150:0/39772454 <== mon.0 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v14) ==== 118+0+0 (secure 0 0 0) 0x7f44b0062f40 con 0x7f44b80d5150 2024-09-17T05:42:40.813 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:40.812+0000 7f44bd68b640 1 -- 172.21.15.150:0/39772454 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f44a4078b90 msgr2=0x7f44a407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:40.813 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:40.812+0000 7f44bd68b640 1 --2- 172.21.15.150:0/39772454 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f44a4078b90 0x7f44a407b0a0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f44a8001090 tx=0x7f44a8009040 comp rx=0 tx=0).stop 2024-09-17T05:42:40.813 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:40.812+0000 7f44bd68b640 1 -- 172.21.15.150:0/39772454 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f44b80d5150 msgr2=0x7f44b8158850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:40.813 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:40.812+0000 7f44bd68b640 1 --2- 172.21.15.150:0/39772454 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f44b80d5150 0x7f44b8158850 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f44b000c6e0 tx=0x7f44b000cba0 comp rx=0 tx=0).stop 2024-09-17T05:42:40.813 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:40.812+0000 7f44bd68b640 1 -- 172.21.15.150:0/39772454 shutdown_connections 2024-09-17T05:42:40.813 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:40.812+0000 7f44bd68b640 1 --2- 172.21.15.150:0/39772454 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f44a4078b90 0x7f44a407b0a0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:40.814 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:40.812+0000 7f44bd68b640 1 --2- 172.21.15.150:0/39772454 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f44b80d5150 0x7f44b8158850 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:40.814 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:40.812+0000 7f44bd68b640 1 --2- 172.21.15.150:0/39772454 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f44b806e2b0 0x7f44b80cdab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:40.814 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:40.812+0000 7f44bd68b640 1 --2- 172.21.15.150:0/39772454 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f44b806dea0 0x7f44b815d4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:40.814 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:40.812+0000 7f44bd68b640 1 -- 172.21.15.150:0/39772454 >> 172.21.15.150:0/39772454 conn(0x7f44b808bfe0 msgr2=0x7f44b80b1310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:42:40.814 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:40.812+0000 7f44bd68b640 1 -- 172.21.15.150:0/39772454 shutdown_connections 2024-09-17T05:42:40.814 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:40.812+0000 7f44bd68b640 1 -- 172.21.15.150:0/39772454 wait complete. 2024-09-17T05:42:40.826 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-09-17T05:42:40.826 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-09-17T05:42:40.950 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:40.950+0000 7f30e9162640 1 -- 172.21.15.150:0/849744282 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f30d0004d40 msgr2=0x7f30d00051f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:40.951 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:40.950+0000 7f30e9162640 1 --2- 172.21.15.150:0/849744282 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f30d0004d40 0x7f30d00051f0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f30dc009b20 tx=0x7f30d0005830 comp rx=0 tx=0).stop 2024-09-17T05:42:40.951 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:40.950+0000 7f30e359e640 1 -- 172.21.15.150:0/849744282 reap_dead start 2024-09-17T05:42:40.951 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:40.950+0000 7f30e9162640 1 -- 172.21.15.150:0/849744282 shutdown_connections 2024-09-17T05:42:40.951 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:40.950+0000 7f30e9162640 1 -- 172.21.15.150:0/849744282 >> 172.21.15.150:0/849744282 conn(0x7f30e40b2e80 msgr2=0x7f30e40b3290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:42:40.951 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:40.950+0000 7f30e9162640 1 -- 172.21.15.150:0/849744282 shutdown_connections 2024-09-17T05:42:40.951 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:40.950+0000 7f30e9162640 1 -- 172.21.15.150:0/849744282 wait complete. 2024-09-17T05:42:40.952 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:40.952+0000 7f30e9162640 1 Processor -- start 2024-09-17T05:42:40.952 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:40.952+0000 7f30e9162640 1 -- start start 2024-09-17T05:42:40.955 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:40.953+0000 7f30e9162640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f30d0004d40 0x7f30e409e9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:42:40.955 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:40.953+0000 7f30e9162640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f30e4158930 0x7f30e40c6f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:42:40.955 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:40.953+0000 7f30e9162640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f30e40c7480 0x7f30e40c9900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:42:40.955 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:40.953+0000 7f30e9162640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f30e40b14b0 con 0x7f30d0004d40 2024-09-17T05:42:40.956 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:40.953+0000 7f30e9162640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f30e40b3dc0 con 0x7f30e40c7480 2024-09-17T05:42:40.956 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:40.953+0000 7f30e9162640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f30e40b1630 con 0x7f30e4158930 2024-09-17T05:42:40.956 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:40.953+0000 7f30e2d9d640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f30d0004d40 0x7f30e409e9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:42:40.956 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:40.953+0000 7f30e2d9d640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f30d0004d40 0x7f30e409e9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:59670/0 (socket says 172.21.15.150:59670) 2024-09-17T05:42:40.956 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:40.953+0000 7f30e2d9d640 1 -- 172.21.15.150:0/1395686863 learned_addr learned my addr 172.21.15.150:0/1395686863 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:42:40.956 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:40.953+0000 7f30e259c640 1 --2- 172.21.15.150:0/1395686863 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f30e4158930 0x7f30e40c6f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:42:40.956 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:40.953+0000 7f30e359e640 1 --2- 172.21.15.150:0/1395686863 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f30e40c7480 0x7f30e40c9900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:42:40.956 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:40.954+0000 7f30e2d9d640 1 -- 172.21.15.150:0/1395686863 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f30e4158930 msgr2=0x7f30e40c6f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:40.956 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:40.954+0000 7f30e2d9d640 1 --2- 172.21.15.150:0/1395686863 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f30e4158930 0x7f30e40c6f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:40.956 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:40.954+0000 7f30e2d9d640 1 -- 172.21.15.150:0/1395686863 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f30e40c7480 msgr2=0x7f30e40c9900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:40.956 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:40.954+0000 7f30e2d9d640 1 --2- 172.21.15.150:0/1395686863 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f30e40c7480 0x7f30e40c9900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:40.957 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:40.954+0000 7f30e2d9d640 1 -- 172.21.15.150:0/1395686863 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f30e409f350 con 0x7f30d0004d40 2024-09-17T05:42:40.957 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:40.954+0000 7f30e2d9d640 1 --2- 172.21.15.150:0/1395686863 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f30d0004d40 0x7f30e409e9e0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f30d4006090 tx=0x7f30d4006550 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:42:40.957 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:40.954+0000 7f30db7fe640 1 -- 172.21.15.150:0/1395686863 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30d4012b00 con 0x7f30d0004d40 2024-09-17T05:42:40.957 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:40.954+0000 7f30db7fe640 1 -- 172.21.15.150:0/1395686863 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f30d4016030 con 0x7f30d0004d40 2024-09-17T05:42:40.957 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:40.954+0000 7f30e9162640 1 -- 172.21.15.150:0/1395686863 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f30e41f5940 con 0x7f30d0004d40 2024-09-17T05:42:40.957 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:40.954+0000 7f30db7fe640 1 -- 172.21.15.150:0/1395686863 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30d400f560 con 0x7f30d0004d40 2024-09-17T05:42:40.957 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:40.954+0000 7f30e9162640 1 -- 172.21.15.150:0/1395686863 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f30e41f5f00 con 0x7f30d0004d40 2024-09-17T05:42:40.957 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:40.955+0000 7f30e9162640 1 -- 172.21.15.150:0/1395686863 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f30e40aef10 con 0x7f30d0004d40 2024-09-17T05:42:40.958 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:40.956+0000 7f30db7fe640 1 -- 172.21.15.150:0/1395686863 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f30d400f700 con 0x7f30d0004d40 2024-09-17T05:42:40.958 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:40.956+0000 7f30db7fe640 1 --2- 172.21.15.150:0/1395686863 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f30c4078bc0 0x7f30c407b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:42:40.958 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:40.956+0000 7f30db7fe640 1 -- 172.21.15.150:0/1395686863 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7f30d409d760 con 0x7f30d0004d40 2024-09-17T05:42:40.958 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:40.956+0000 7f30e259c640 1 --2- 172.21.15.150:0/1395686863 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f30c4078bc0 0x7f30c407b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:42:40.958 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:40.957+0000 7f30e259c640 1 --2- 172.21.15.150:0/1395686863 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f30c4078bc0 0x7f30c407b0d0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f30e4158da0 tx=0x7f30cc0067a0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:42:40.961 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:40.961+0000 7f30db7fe640 1 -- 172.21.15.150:0/1395686863 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f30e40aef10 con 0x7f30d0004d40 2024-09-17T05:42:41.171 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:41.170+0000 7f30e9162640 1 -- 172.21.15.150:0/1395686863 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7f30e40b0da0 con 0x7f30d0004d40 2024-09-17T05:42:41.817 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:41.817+0000 7f30db7fe640 1 -- 172.21.15.150:0/1395686863 <== mon.0 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v15) ==== 122+0+0 (secure 0 0 0) 0x7f30d4065670 con 0x7f30d0004d40 2024-09-17T05:42:41.820 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:41.819+0000 7f30e9162640 1 -- 172.21.15.150:0/1395686863 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f30c4078bc0 msgr2=0x7f30c407b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:41.820 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:41.819+0000 7f30e9162640 1 --2- 172.21.15.150:0/1395686863 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f30c4078bc0 0x7f30c407b0d0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f30e4158da0 tx=0x7f30cc0067a0 comp rx=0 tx=0).stop 2024-09-17T05:42:41.820 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:41.819+0000 7f30e9162640 1 -- 172.21.15.150:0/1395686863 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f30d0004d40 msgr2=0x7f30e409e9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:41.820 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:41.819+0000 7f30e9162640 1 --2- 172.21.15.150:0/1395686863 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f30d0004d40 0x7f30e409e9e0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f30d4006090 tx=0x7f30d4006550 comp rx=0 tx=0).stop 2024-09-17T05:42:41.821 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:41.819+0000 7f30e9162640 1 -- 172.21.15.150:0/1395686863 shutdown_connections 2024-09-17T05:42:41.821 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:41.819+0000 7f30e9162640 1 --2- 172.21.15.150:0/1395686863 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f30e40c7480 0x7f30e40c9900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:41.821 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:41.819+0000 7f30e9162640 1 --2- 172.21.15.150:0/1395686863 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f30c4078bc0 0x7f30c407b0d0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:41.821 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:41.819+0000 7f30e9162640 1 --2- 172.21.15.150:0/1395686863 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f30e4158930 0x7f30e40c6f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:41.821 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:41.819+0000 7f30e9162640 1 --2- 172.21.15.150:0/1395686863 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f30d0004d40 0x7f30e409e9e0 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:41.821 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:41.819+0000 7f30e9162640 1 -- 172.21.15.150:0/1395686863 >> 172.21.15.150:0/1395686863 conn(0x7f30e40b2e80 msgr2=0x7f30e40ae720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:42:41.821 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:41.820+0000 7f30e9162640 1 -- 172.21.15.150:0/1395686863 shutdown_connections 2024-09-17T05:42:41.821 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:41.820+0000 7f30e9162640 1 -- 172.21.15.150:0/1395686863 wait complete. 2024-09-17T05:42:41.832 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-09-17T05:42:41.832 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T05:42:41.947 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:41.946+0000 7f858940e640 1 -- 172.21.15.150:0/4160462537 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f85840b9d10 msgr2=0x7f85840d2f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:41.947 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:41.946+0000 7f858940e640 1 --2- 172.21.15.150:0/4160462537 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f85840b9d10 0x7f85840d2f60 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f85840d1d80 tx=0x7f857402a4a0 comp rx=0 tx=0).stop 2024-09-17T05:42:41.947 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:41.946+0000 7f858940e640 1 -- 172.21.15.150:0/4160462537 shutdown_connections 2024-09-17T05:42:41.947 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:41.946+0000 7f858940e640 1 --2- 172.21.15.150:0/4160462537 >> v2:172.21.15.176:3300/0 conn(0x7f85840d50c0 0x7f85840d0240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:41.947 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:41.946+0000 7f858940e640 1 --2- 172.21.15.150:0/4160462537 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f85840b9d10 0x7f85840d2f60 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:41.947 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:41.946+0000 7f858940e640 1 -- 172.21.15.150:0/4160462537 >> 172.21.15.150:0/4160462537 conn(0x7f858408bfe0 msgr2=0x7f85840d4650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:42:41.947 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:41.946+0000 7f858940e640 1 -- 172.21.15.150:0/4160462537 shutdown_connections 2024-09-17T05:42:41.948 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:41.946+0000 7f858940e640 1 -- 172.21.15.150:0/4160462537 wait complete. 2024-09-17T05:42:41.948 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:41.948+0000 7f858940e640 1 Processor -- start 2024-09-17T05:42:41.948 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:41.948+0000 7f858940e640 1 -- start start 2024-09-17T05:42:41.951 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:41.949+0000 7f858940e640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f85840b9d10 0x7f858415af60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:42:41.951 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:41.949+0000 7f858940e640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f85840d1020 0x7f85840cc730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:42:41.951 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:41.949+0000 7f858940e640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f85840d50c0 0x7f85840ccc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:42:41.951 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:41.949+0000 7f858940e640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f85840b4300 con 0x7f85840d50c0 2024-09-17T05:42:41.951 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:41.949+0000 7f858940e640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f85840b4180 con 0x7f85840d1020 2024-09-17T05:42:41.951 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:41.949+0000 7f858940e640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f85840b4480 con 0x7f85840b9d10 2024-09-17T05:42:41.951 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:41.949+0000 7f85837fe640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f85840d50c0 0x7f85840ccc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:42:41.951 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:41.949+0000 7f85837fe640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f85840d50c0 0x7f85840ccc70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:59692/0 (socket says 172.21.15.150:59692) 2024-09-17T05:42:41.952 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:41.949+0000 7f85837fe640 1 -- 172.21.15.150:0/3041203027 learned_addr learned my addr 172.21.15.150:0/3041203027 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:42:41.952 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:41.949+0000 7f8582ffd640 1 --2- 172.21.15.150:0/3041203027 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f85840b9d10 0x7f858415af60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:42:41.952 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:41.949+0000 7f85827fc640 1 --2- 172.21.15.150:0/3041203027 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f85840d1020 0x7f85840cc730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:42:41.952 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:41.950+0000 7f85837fe640 1 -- 172.21.15.150:0/3041203027 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f85840b9d10 msgr2=0x7f858415af60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:41.952 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:41.950+0000 7f85837fe640 1 --2- 172.21.15.150:0/3041203027 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f85840b9d10 0x7f858415af60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:41.952 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:41.950+0000 7f85837fe640 1 -- 172.21.15.150:0/3041203027 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f85840d1020 msgr2=0x7f85840cc730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:41.952 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:41.950+0000 7f85837fe640 1 --2- 172.21.15.150:0/3041203027 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f85840d1020 0x7f85840cc730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:41.952 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:41.950+0000 7f85837fe640 1 -- 172.21.15.150:0/3041203027 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f85840cb180 con 0x7f85840d50c0 2024-09-17T05:42:41.952 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:41.950+0000 7f85827fc640 1 --2- 172.21.15.150:0/3041203027 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f85840d1020 0x7f85840cc730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T05:42:41.952 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:41.950+0000 7f85837fe640 1 --2- 172.21.15.150:0/3041203027 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f85840d50c0 0x7f85840ccc70 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f857c00c730 tx=0x7f857c00cb30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:42:41.952 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:41.950+0000 7f856b7fe640 1 -- 172.21.15.150:0/3041203027 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f857c003b70 con 0x7f85840d50c0 2024-09-17T05:42:41.952 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:41.950+0000 7f856b7fe640 1 -- 172.21.15.150:0/3041203027 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f857c003d10 con 0x7f85840d50c0 2024-09-17T05:42:41.952 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:41.950+0000 7f858940e640 1 -- 172.21.15.150:0/3041203027 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f858415b7b0 con 0x7f85840d50c0 2024-09-17T05:42:41.953 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:41.950+0000 7f856b7fe640 1 -- 172.21.15.150:0/3041203027 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f857c0052d0 con 0x7f85840d50c0 2024-09-17T05:42:41.953 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:41.950+0000 7f858940e640 1 -- 172.21.15.150:0/3041203027 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f858415bd70 con 0x7f85840d50c0 2024-09-17T05:42:41.953 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:41.951+0000 7f858940e640 1 -- 172.21.15.150:0/3041203027 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f85840caef0 con 0x7f85840d50c0 2024-09-17T05:42:41.953 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:41.952+0000 7f856b7fe640 1 -- 172.21.15.150:0/3041203027 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f857c005470 con 0x7f85840d50c0 2024-09-17T05:42:41.954 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:41.952+0000 7f856b7fe640 1 --2- 172.21.15.150:0/3041203027 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f8570078b90 0x7f857007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:42:41.954 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:41.952+0000 7f856b7fe640 1 -- 172.21.15.150:0/3041203027 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7f857c09aab0 con 0x7f85840d50c0 2024-09-17T05:42:41.954 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:41.952+0000 7f8582ffd640 1 --2- 172.21.15.150:0/3041203027 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f8570078b90 0x7f857007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:42:41.954 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:41.953+0000 7f8582ffd640 1 --2- 172.21.15.150:0/3041203027 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f8570078b90 0x7f857007b0a0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f8574034000 tx=0x7f8574004730 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:42:41.957 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:41.957+0000 7f856b7fe640 1 -- 172.21.15.150:0/3041203027 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f857c062f80 con 0x7f85840d50c0 2024-09-17T05:42:42.166 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:42.166+0000 7f858940e640 1 -- 172.21.15.150:0/3041203027 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f85840b4950 con 0x7f85840d50c0 2024-09-17T05:42:42.167 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:42.166+0000 7f856b7fe640 1 -- 172.21.15.150:0/3041203027 <== mon.0 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 15 v15) ==== 94+0+5232 (secure 0 0 0) 0x7f857c062880 con 0x7f85840d50c0 2024-09-17T05:42:42.167 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-09-17T05:42:42.167 INFO:teuthology.orchestra.run.smithi150.stdout:{"epoch":15,"btime":"2024-09-17T05:42:41:810497+0000","default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4664,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6835/392464003","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6833","nonce":392464003},{"type":"v1","addr":"172.21.15.150:6835","nonce":392464003}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":4673,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6837/3232718608","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6835","nonce":3232718608},{"type":"v1","addr":"172.21.15.176:6837","nonce":3232718608}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":4867,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6836/2911955319","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6834","nonce":2911955319},{"type":"v1","addr":"172.21.15.176:6836","nonce":2911955319}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10}],"filesystems":[{"mdsmap":{"epoch":15,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T05:42:38.152690+0000","modified":"2024-09-17T05:42:41.171759+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4938},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4938":{"gid":4938,"name":"a","rank":0,"incarnation":11,"state":"up:active","state_seq":3,"addr":"172.21.15.150:6834/2837553407","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6832","nonce":2837553407},{"type":"v1","addr":"172.21.15.150:6834","nonce":2837553407}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4938,"qdb_cluster":[4938]},"id":2}]} 2024-09-17T05:42:42.167 INFO:teuthology.orchestra.run.smithi150.stderr:dumped fsmap epoch 15 2024-09-17T05:42:42.170 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:42.169+0000 7f858940e640 1 -- 172.21.15.150:0/3041203027 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f8570078b90 msgr2=0x7f857007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:42.170 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:42.169+0000 7f858940e640 1 --2- 172.21.15.150:0/3041203027 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f8570078b90 0x7f857007b0a0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f8574034000 tx=0x7f8574004730 comp rx=0 tx=0).stop 2024-09-17T05:42:42.170 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:42.169+0000 7f858940e640 1 -- 172.21.15.150:0/3041203027 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f85840d50c0 msgr2=0x7f85840ccc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:42.170 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:42.169+0000 7f858940e640 1 --2- 172.21.15.150:0/3041203027 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f85840d50c0 0x7f85840ccc70 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f857c00c730 tx=0x7f857c00cb30 comp rx=0 tx=0).stop 2024-09-17T05:42:42.170 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:42.169+0000 7f858940e640 1 -- 172.21.15.150:0/3041203027 shutdown_connections 2024-09-17T05:42:42.170 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:42.169+0000 7f858940e640 1 --2- 172.21.15.150:0/3041203027 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f85840d1020 0x7f85840cc730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:42.170 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:42.169+0000 7f858940e640 1 --2- 172.21.15.150:0/3041203027 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f8570078b90 0x7f857007b0a0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:42.170 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:42.169+0000 7f858940e640 1 --2- 172.21.15.150:0/3041203027 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f85840d50c0 0x7f85840ccc70 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:42.170 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:42.169+0000 7f858940e640 1 --2- 172.21.15.150:0/3041203027 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f85840b9d10 0x7f858415af60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:42.171 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:42.169+0000 7f858940e640 1 -- 172.21.15.150:0/3041203027 >> 172.21.15.150:0/3041203027 conn(0x7f858408bfe0 msgr2=0x7f8584160ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:42:42.171 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:42.169+0000 7f858940e640 1 -- 172.21.15.150:0/3041203027 shutdown_connections 2024-09-17T05:42:42.171 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:42.169+0000 7f858940e640 1 -- 172.21.15.150:0/3041203027 wait complete. 2024-09-17T05:42:42.181 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T05:42:42.295 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:42.295+0000 7f121ff20640 1 -- 172.21.15.150:0/2451005502 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1204004800 msgr2=0x7f1204004c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:42.296 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:42.295+0000 7f121ff20640 1 --2- 172.21.15.150:0/2451005502 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1204004800 0x7f1204004c10 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f1208009b50 tx=0x7f1204005830 comp rx=0 tx=0).stop 2024-09-17T05:42:42.296 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:42.295+0000 7f121e4bd640 1 -- 172.21.15.150:0/2451005502 reap_dead start 2024-09-17T05:42:42.296 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:42.295+0000 7f121ff20640 1 -- 172.21.15.150:0/2451005502 shutdown_connections 2024-09-17T05:42:42.296 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:42.295+0000 7f121ff20640 1 -- 172.21.15.150:0/2451005502 >> 172.21.15.150:0/2451005502 conn(0x7f12180b2fd0 msgr2=0x7f12180b33e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:42:42.296 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:42.295+0000 7f121ff20640 1 -- 172.21.15.150:0/2451005502 shutdown_connections 2024-09-17T05:42:42.296 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:42.295+0000 7f121ff20640 1 -- 172.21.15.150:0/2451005502 wait complete. 2024-09-17T05:42:42.297 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:42.296+0000 7f121ff20640 1 Processor -- start 2024-09-17T05:42:42.297 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:42.297+0000 7f121ff20640 1 -- start start 2024-09-17T05:42:42.300 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:42.298+0000 7f121ff20640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1204004800 0x7f12181f7360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:42:42.300 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:42.298+0000 7f121ff20640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f12181f3eb0 0x7f121814d550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:42:42.300 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:42.298+0000 7f121ff20640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f121814da90 0x7f12180b21f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:42:42.300 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:42.298+0000 7f121ff20640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f12180b5f30 con 0x7f121814da90 2024-09-17T05:42:42.300 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:42.298+0000 7f121ff20640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f12180cfe60 con 0x7f1204004800 2024-09-17T05:42:42.300 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:42.298+0000 7f121ff20640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f12180b60b0 con 0x7f12181f3eb0 2024-09-17T05:42:42.300 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:42.298+0000 7f121e4bd640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f121814da90 0x7f12180b21f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:42:42.301 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:42.298+0000 7f121e4bd640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f121814da90 0x7f12180b21f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:59708/0 (socket says 172.21.15.150:59708) 2024-09-17T05:42:42.301 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:42.298+0000 7f121e4bd640 1 -- 172.21.15.150:0/3284143555 learned_addr learned my addr 172.21.15.150:0/3284143555 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:42:42.301 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:42.298+0000 7f121e4bd640 1 -- 172.21.15.150:0/3284143555 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f12181f3eb0 msgr2=0x7f121814d550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:42.301 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:42.298+0000 7f121d4bb640 1 --2- 172.21.15.150:0/3284143555 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f12181f3eb0 0x7f121814d550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:42:42.301 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:42.298+0000 7f121e4bd640 1 --2- 172.21.15.150:0/3284143555 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f12181f3eb0 0x7f121814d550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:42.301 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:42.298+0000 7f121dcbc640 1 --2- 172.21.15.150:0/3284143555 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1204004800 0x7f12181f7360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:42:42.301 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:42.298+0000 7f121e4bd640 1 -- 172.21.15.150:0/3284143555 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1204004800 msgr2=0x7f12181f7360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:42.301 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:42.298+0000 7f121e4bd640 1 --2- 172.21.15.150:0/3284143555 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1204004800 0x7f12181f7360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:42.301 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:42.298+0000 7f121e4bd640 1 -- 172.21.15.150:0/3284143555 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f121814e1f0 con 0x7f121814da90 2024-09-17T05:42:42.301 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:42.298+0000 7f121e4bd640 1 --2- 172.21.15.150:0/3284143555 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f121814da90 0x7f12180b21f0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f12180d0820 tx=0x7f1210006700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:42:42.301 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:42.298+0000 7f120e7fc640 1 -- 172.21.15.150:0/3284143555 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f121000fa80 con 0x7f121814da90 2024-09-17T05:42:42.301 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:42.299+0000 7f120e7fc640 1 -- 172.21.15.150:0/3284143555 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f1210018070 con 0x7f121814da90 2024-09-17T05:42:42.302 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:42.299+0000 7f120e7fc640 1 -- 172.21.15.150:0/3284143555 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f121000fe60 con 0x7f121814da90 2024-09-17T05:42:42.302 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:42.299+0000 7f121ff20640 1 -- 172.21.15.150:0/3284143555 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f12181f33d0 con 0x7f121814da90 2024-09-17T05:42:42.302 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:42.299+0000 7f121ff20640 1 -- 172.21.15.150:0/3284143555 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f12180b2730 con 0x7f121814da90 2024-09-17T05:42:42.302 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:42.300+0000 7f121ff20640 1 -- 172.21.15.150:0/3284143555 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f121809f610 con 0x7f121814da90 2024-09-17T05:42:42.302 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:42.300+0000 7f120e7fc640 1 -- 172.21.15.150:0/3284143555 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f121001d460 con 0x7f121814da90 2024-09-17T05:42:42.303 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:42.301+0000 7f120e7fc640 1 --2- 172.21.15.150:0/3284143555 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f11fc078b90 0x7f11fc07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:42:42.303 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:42.301+0000 7f120e7fc640 1 -- 172.21.15.150:0/3284143555 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7f121009b4d0 con 0x7f121814da90 2024-09-17T05:42:42.303 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:42.301+0000 7f121dcbc640 1 --2- 172.21.15.150:0/3284143555 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f11fc078b90 0x7f11fc07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:42:42.303 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:42.302+0000 7f121dcbc640 1 --2- 172.21.15.150:0/3284143555 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f11fc078b90 0x7f11fc07b0a0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f1214001050 tx=0x7f12140068a0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:42:42.309 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:42.305+0000 7f120e7fc640 1 -- 172.21.15.150:0/3284143555 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f121809f610 con 0x7f121814da90 2024-09-17T05:42:42.430 INFO:tasks.ceph.mds.a.smithi150.stderr:2024-09-17T05:42:42.429+0000 7f3412ccd640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-17T05:42:42.482 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:42.482+0000 7f121ff20640 1 -- 172.21.15.150:0/3284143555 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f12180b6640 con 0x7f121814da90 2024-09-17T05:42:42.483 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:42.483+0000 7f120e7fc640 1 -- 172.21.15.150:0/3284143555 <== mon.0 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v34) ==== 74+0+16765 (secure 0 0 0) 0x7f1210099e20 con 0x7f121814da90 2024-09-17T05:42:42.484 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-09-17T05:42:42.484 INFO:teuthology.orchestra.run.smithi150.stdout:{"epoch":34,"fsid":"9f2e05e9-d629-47b3-b26b-1360655b7d20","created":"2024-09-17T05:41:32.502979+0000","modified":"2024-09-17T05:42:39.782812+0000","last_up_change":"2024-09-17T05:41:46.150225+0000","last_in_change":"2024-09-17T05:41:36.120274+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T05:41:46.860779+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-09-17T05:42:35.815685+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-09-17T05:42:37.101233+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"4f31c018-c8a4-4d6d-b0c2-a597c47aae4a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6800","nonce":479374392},{"type":"v1","addr":"172.21.15.150:6801","nonce":479374392}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6802","nonce":479374392},{"type":"v1","addr":"172.21.15.150:6803","nonce":479374392}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6806","nonce":479374392},{"type":"v1","addr":"172.21.15.150:6807","nonce":479374392}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6804","nonce":479374392},{"type":"v1","addr":"172.21.15.150:6805","nonce":479374392}]},"public_addr":"172.21.15.150:6801/479374392","cluster_addr":"172.21.15.150:6803/479374392","heartbeat_back_addr":"172.21.15.150:6807/479374392","heartbeat_front_addr":"172.21.15.150:6805/479374392","state":["exists","up"]},{"osd":1,"uuid":"6ff4a573-500b-4e04-9de3-39265ead78b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6824","nonce":913899800},{"type":"v1","addr":"172.21.15.150:6825","nonce":913899800}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6826","nonce":913899800},{"type":"v1","addr":"172.21.15.150:6827","nonce":913899800}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6830","nonce":913899800},{"type":"v1","addr":"172.21.15.150:6831","nonce":913899800}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6828","nonce":913899800},{"type":"v1","addr":"172.21.15.150:6829","nonce":913899800}]},"public_addr":"172.21.15.150:6825/913899800","cluster_addr":"172.21.15.150:6827/913899800","heartbeat_back_addr":"172.21.15.150:6831/913899800","heartbeat_front_addr":"172.21.15.150:6829/913899800","state":["exists","up"]},{"osd":2,"uuid":"bffea6f9-2465-4182-b205-00436c41ac1c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6816","nonce":363718461},{"type":"v1","addr":"172.21.15.150:6817","nonce":363718461}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6818","nonce":363718461},{"type":"v1","addr":"172.21.15.150:6819","nonce":363718461}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6822","nonce":363718461},{"type":"v1","addr":"172.21.15.150:6823","nonce":363718461}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6820","nonce":363718461},{"type":"v1","addr":"172.21.15.150:6821","nonce":363718461}]},"public_addr":"172.21.15.150:6817/363718461","cluster_addr":"172.21.15.150:6819/363718461","heartbeat_back_addr":"172.21.15.150:6823/363718461","heartbeat_front_addr":"172.21.15.150:6821/363718461","state":["exists","up"]},{"osd":3,"uuid":"cda70430-d1e1-427e-b04e-56db4031d078","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6808","nonce":3550994626},{"type":"v1","addr":"172.21.15.150:6809","nonce":3550994626}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6810","nonce":3550994626},{"type":"v1","addr":"172.21.15.150:6811","nonce":3550994626}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6814","nonce":3550994626},{"type":"v1","addr":"172.21.15.150:6815","nonce":3550994626}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6812","nonce":3550994626},{"type":"v1","addr":"172.21.15.150:6813","nonce":3550994626}]},"public_addr":"172.21.15.150:6809/3550994626","cluster_addr":"172.21.15.150:6811/3550994626","heartbeat_back_addr":"172.21.15.150:6815/3550994626","heartbeat_front_addr":"172.21.15.150:6813/3550994626","state":["exists","up"]},{"osd":4,"uuid":"3a0277fb-5e1e-4f68-bb2d-9a8a0152f64a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6810","nonce":2718261497},{"type":"v1","addr":"172.21.15.176:6811","nonce":2718261497}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6812","nonce":2718261497},{"type":"v1","addr":"172.21.15.176:6813","nonce":2718261497}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6816","nonce":2718261497},{"type":"v1","addr":"172.21.15.176:6817","nonce":2718261497}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6814","nonce":2718261497},{"type":"v1","addr":"172.21.15.176:6815","nonce":2718261497}]},"public_addr":"172.21.15.176:6811/2718261497","cluster_addr":"172.21.15.176:6813/2718261497","heartbeat_back_addr":"172.21.15.176:6817/2718261497","heartbeat_front_addr":"172.21.15.176:6815/2718261497","state":["exists","up"]},{"osd":5,"uuid":"33aebee6-0315-40b7-a11c-6702f0be494d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6818","nonce":2049295774},{"type":"v1","addr":"172.21.15.176:6819","nonce":2049295774}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6820","nonce":2049295774},{"type":"v1","addr":"172.21.15.176:6821","nonce":2049295774}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6824","nonce":2049295774},{"type":"v1","addr":"172.21.15.176:6825","nonce":2049295774}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6822","nonce":2049295774},{"type":"v1","addr":"172.21.15.176:6823","nonce":2049295774}]},"public_addr":"172.21.15.176:6819/2049295774","cluster_addr":"172.21.15.176:6821/2049295774","heartbeat_back_addr":"172.21.15.176:6825/2049295774","heartbeat_front_addr":"172.21.15.176:6823/2049295774","state":["exists","up"]},{"osd":6,"uuid":"4d24f360-6751-4263-841b-d77793d33540","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6826","nonce":2164458476},{"type":"v1","addr":"172.21.15.176:6827","nonce":2164458476}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6828","nonce":2164458476},{"type":"v1","addr":"172.21.15.176:6829","nonce":2164458476}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6832","nonce":2164458476},{"type":"v1","addr":"172.21.15.176:6833","nonce":2164458476}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6830","nonce":2164458476},{"type":"v1","addr":"172.21.15.176:6831","nonce":2164458476}]},"public_addr":"172.21.15.176:6827/2164458476","cluster_addr":"172.21.15.176:6829/2164458476","heartbeat_back_addr":"172.21.15.176:6833/2164458476","heartbeat_front_addr":"172.21.15.176:6831/2164458476","state":["exists","up"]},{"osd":7,"uuid":"c8594fda-c74a-4ba9-8277-caf101d58ca1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6802","nonce":3239587708},{"type":"v1","addr":"172.21.15.176:6803","nonce":3239587708}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6804","nonce":3239587708},{"type":"v1","addr":"172.21.15.176:6805","nonce":3239587708}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6808","nonce":3239587708},{"type":"v1","addr":"172.21.15.176:6809","nonce":3239587708}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6806","nonce":3239587708},{"type":"v1","addr":"172.21.15.176:6807","nonce":3239587708}]},"public_addr":"172.21.15.176:6803/3239587708","cluster_addr":"172.21.15.176:6805/3239587708","heartbeat_back_addr":"172.21.15.176:6809/3239587708","heartbeat_front_addr":"172.21.15.176:6807/3239587708","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:41:41.905151+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:41:42.705679+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:41:42.459673+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:41:42.440819+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:41:42.668428+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:41:42.694972+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:41:43.078535+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:41:42.363539+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T05:42:42.486 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:42.485+0000 7f121ff20640 1 -- 172.21.15.150:0/3284143555 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f11fc078b90 msgr2=0x7f11fc07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:42.486 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:42.485+0000 7f121ff20640 1 --2- 172.21.15.150:0/3284143555 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f11fc078b90 0x7f11fc07b0a0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f1214001050 tx=0x7f12140068a0 comp rx=0 tx=0).stop 2024-09-17T05:42:42.486 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:42.485+0000 7f121ff20640 1 -- 172.21.15.150:0/3284143555 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f121814da90 msgr2=0x7f12180b21f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:42.486 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:42.485+0000 7f121ff20640 1 --2- 172.21.15.150:0/3284143555 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f121814da90 0x7f12180b21f0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f12180d0820 tx=0x7f1210006700 comp rx=0 tx=0).stop 2024-09-17T05:42:42.486 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:42.485+0000 7f121ff20640 1 -- 172.21.15.150:0/3284143555 shutdown_connections 2024-09-17T05:42:42.486 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:42.485+0000 7f121ff20640 1 --2- 172.21.15.150:0/3284143555 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f11fc078b90 0x7f11fc07b0a0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:42.486 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:42.485+0000 7f121ff20640 1 --2- 172.21.15.150:0/3284143555 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f121814da90 0x7f12180b21f0 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:42.486 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:42.485+0000 7f121ff20640 1 --2- 172.21.15.150:0/3284143555 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f12181f3eb0 0x7f121814d550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:42.486 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:42.485+0000 7f121ff20640 1 --2- 172.21.15.150:0/3284143555 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1204004800 0x7f12181f7360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:42.487 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:42.485+0000 7f121ff20640 1 -- 172.21.15.150:0/3284143555 >> 172.21.15.150:0/3284143555 conn(0x7f12180b2fd0 msgr2=0x7f121815bc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:42:42.487 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:42.485+0000 7f121ff20640 1 -- 172.21.15.150:0/3284143555 shutdown_connections 2024-09-17T05:42:42.487 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:42.485+0000 7f121ff20640 1 -- 172.21.15.150:0/3284143555 wait complete. 2024-09-17T05:42:42.498 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-17T05:42:42.498 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-17T05:42:42.612 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:42.611+0000 7fd067230640 1 -- 172.21.15.150:0/1411695612 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd0600cd850 msgr2=0x7fd0600d06f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:42.612 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:42.611+0000 7fd067230640 1 --2- 172.21.15.150:0/1411695612 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd0600cd850 0x7fd0600d06f0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7fd0600b84c0 tx=0x7fd05802aa30 comp rx=0 tx=0).stop 2024-09-17T05:42:42.612 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:42.611+0000 7fd067230640 1 -- 172.21.15.150:0/1411695612 shutdown_connections 2024-09-17T05:42:42.612 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:42.611+0000 7fd067230640 1 --2- 172.21.15.150:0/1411695612 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd0600cd850 0x7fd0600d06f0 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:42.612 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:42.611+0000 7fd067230640 1 --2- 172.21.15.150:0/1411695612 >> v2:172.21.15.176:3300/0 conn(0x7fd06009ba60 0x7fd0600b7330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:42.613 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:42.611+0000 7fd067230640 1 -- 172.21.15.150:0/1411695612 >> 172.21.15.150:0/1411695612 conn(0x7fd0600cee90 msgr2=0x7fd0600cf2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:42:42.613 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:42.611+0000 7fd067230640 1 -- 172.21.15.150:0/1411695612 shutdown_connections 2024-09-17T05:42:42.613 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:42.611+0000 7fd067230640 1 -- 172.21.15.150:0/1411695612 wait complete. 2024-09-17T05:42:42.613 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:42.613+0000 7fd067230640 1 Processor -- start 2024-09-17T05:42:42.613 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:42.613+0000 7fd067230640 1 -- start start 2024-09-17T05:42:42.616 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:42.614+0000 7fd067230640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd06009ba60 0x7fd06014d8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:42:42.616 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:42.614+0000 7fd067230640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd0600cd440 0x7fd06015fc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:42:42.616 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:42.614+0000 7fd067230640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd0600cd850 0x7fd060160160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:42:42.616 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:42.614+0000 7fd067230640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7fd0600d0db0 con 0x7fd06009ba60 2024-09-17T05:42:42.616 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:42.614+0000 7fd067230640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fd0600d0c30 con 0x7fd0600cd440 2024-09-17T05:42:42.616 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:42.614+0000 7fd067230640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fd0600d0f30 con 0x7fd0600cd850 2024-09-17T05:42:42.617 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:42.614+0000 7fd064fcc640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd06009ba60 0x7fd06014d8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:42:42.617 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:42.614+0000 7fd064fcc640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd06009ba60 0x7fd06014d8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:59732/0 (socket says 172.21.15.150:59732) 2024-09-17T05:42:42.617 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:42.614+0000 7fd064fcc640 1 -- 172.21.15.150:0/2652923940 learned_addr learned my addr 172.21.15.150:0/2652923940 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:42:42.617 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:42.615+0000 7fd05ffff640 1 --2- 172.21.15.150:0/2652923940 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd0600cd440 0x7fd06015fc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:42:42.617 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:42.615+0000 7fd0657cd640 1 --2- 172.21.15.150:0/2652923940 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd0600cd850 0x7fd060160160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:42:42.617 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:42.615+0000 7fd064fcc640 1 -- 172.21.15.150:0/2652923940 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd0600cd850 msgr2=0x7fd060160160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:42.617 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:42.615+0000 7fd064fcc640 1 --2- 172.21.15.150:0/2652923940 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd0600cd850 0x7fd060160160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:42.617 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:42.615+0000 7fd064fcc640 1 -- 172.21.15.150:0/2652923940 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd0600cd440 msgr2=0x7fd06015fc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:42.617 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:42.615+0000 7fd064fcc640 1 --2- 172.21.15.150:0/2652923940 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd0600cd440 0x7fd06015fc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:42.618 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:42.615+0000 7fd064fcc640 1 -- 172.21.15.150:0/2652923940 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd06015b9f0 con 0x7fd06009ba60 2024-09-17T05:42:42.618 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:42.615+0000 7fd0657cd640 1 --2- 172.21.15.150:0/2652923940 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd0600cd850 0x7fd060160160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:42:42.618 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:42.615+0000 7fd064fcc640 1 --2- 172.21.15.150:0/2652923940 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd06009ba60 0x7fd06014d8d0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7fd05000c9a0 tx=0x7fd05000ce60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:42:42.618 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:42.615+0000 7fd05d7fa640 1 -- 172.21.15.150:0/2652923940 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd050007bb0 con 0x7fd06009ba60 2024-09-17T05:42:42.618 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:42.615+0000 7fd05d7fa640 1 -- 172.21.15.150:0/2652923940 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd050007e40 con 0x7fd06009ba60 2024-09-17T05:42:42.618 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:42.615+0000 7fd067230640 1 -- 172.21.15.150:0/2652923940 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd0601f81a0 con 0x7fd06009ba60 2024-09-17T05:42:42.618 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:42.615+0000 7fd05d7fa640 1 -- 172.21.15.150:0/2652923940 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd050005290 con 0x7fd06009ba60 2024-09-17T05:42:42.618 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:42.615+0000 7fd067230640 1 -- 172.21.15.150:0/2652923940 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd06015c3d0 con 0x7fd06009ba60 2024-09-17T05:42:42.619 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:42.616+0000 7fd067230640 1 -- 172.21.15.150:0/2652923940 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd0601f83e0 con 0x7fd06009ba60 2024-09-17T05:42:42.619 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:42.617+0000 7fd05d7fa640 1 -- 172.21.15.150:0/2652923940 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fd050005430 con 0x7fd06009ba60 2024-09-17T05:42:42.619 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:42.617+0000 7fd05d7fa640 1 --2- 172.21.15.150:0/2652923940 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fd04c078b90 0x7fd04c07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:42:42.619 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:42.617+0000 7fd05d7fa640 1 -- 172.21.15.150:0/2652923940 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7fd05009b4e0 con 0x7fd06009ba60 2024-09-17T05:42:42.619 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:42.618+0000 7fd05ffff640 1 --2- 172.21.15.150:0/2652923940 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fd04c078b90 0x7fd04c07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:42:42.619 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:42.618+0000 7fd05ffff640 1 --2- 172.21.15.150:0/2652923940 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fd04c078b90 0x7fd04c07b0a0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fd0600b28f0 tx=0x7fd054009060 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:42:42.622 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:42.622+0000 7fd05d7fa640 1 -- 172.21.15.150:0/2652923940 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fd0601f83e0 con 0x7fd06009ba60 2024-09-17T05:42:42.793 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:42.793+0000 7fd067230640 1 -- 172.21.15.150:0/2652923940 --> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fd0600b7330 con 0x7fd04c078b90 2024-09-17T05:42:42.798 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:42.798+0000 7fd05d7fa640 1 -- 172.21.15.150:0/2652923940 <== mgr.4108 v2:172.21.15.176:6800/3631216395 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+238673 (secure 0 0 0) 0x7fd0600b7330 con 0x7fd04c078b90 2024-09-17T05:42:42.801 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-09-17T05:42:42.802 INFO:teuthology.orchestra.run.smithi150.stderr:dumped all 2024-09-17T05:42:42.804 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:42.801+0000 7fd067230640 1 -- 172.21.15.150:0/2652923940 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fd04c078b90 msgr2=0x7fd04c07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:42.804 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:42.801+0000 7fd067230640 1 --2- 172.21.15.150:0/2652923940 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fd04c078b90 0x7fd04c07b0a0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fd0600b28f0 tx=0x7fd054009060 comp rx=0 tx=0).stop 2024-09-17T05:42:42.804 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:42.801+0000 7fd067230640 1 -- 172.21.15.150:0/2652923940 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd06009ba60 msgr2=0x7fd06014d8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:42.804 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:42.801+0000 7fd067230640 1 --2- 172.21.15.150:0/2652923940 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd06009ba60 0x7fd06014d8d0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7fd05000c9a0 tx=0x7fd05000ce60 comp rx=0 tx=0).stop 2024-09-17T05:42:42.804 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:42.801+0000 7fd067230640 1 -- 172.21.15.150:0/2652923940 shutdown_connections 2024-09-17T05:42:42.804 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:42.801+0000 7fd067230640 1 --2- 172.21.15.150:0/2652923940 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd0600cd440 0x7fd06015fc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:42.804 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:42.801+0000 7fd067230640 1 --2- 172.21.15.150:0/2652923940 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fd04c078b90 0x7fd04c07b0a0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:42.804 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:42.801+0000 7fd067230640 1 --2- 172.21.15.150:0/2652923940 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd0600cd850 0x7fd060160160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:42.804 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:42.801+0000 7fd067230640 1 --2- 172.21.15.150:0/2652923940 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd06009ba60 0x7fd06014d8d0 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:42.805 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:42.801+0000 7fd067230640 1 -- 172.21.15.150:0/2652923940 >> 172.21.15.150:0/2652923940 conn(0x7fd0600cee90 msgr2=0x7fd06015db10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:42:42.805 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:42.801+0000 7fd067230640 1 -- 172.21.15.150:0/2652923940 shutdown_connections 2024-09-17T05:42:42.805 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:42.801+0000 7fd067230640 1 -- 172.21.15.150:0/2652923940 wait complete. 2024-09-17T05:42:42.813 INFO:teuthology.orchestra.run.smithi150.stdout:{"pg_ready":true,"pg_map":{"version":56,"stamp":"2024-09-17T05:42:40.853538+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":26,"acting":26,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":46,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":3,"kb":754974720,"kb_used":219988,"kb_used_data":3732,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754754732,"statfs":{"total":773094113280,"available":772868845568,"internally_reserved":0,"allocated":3821568,"data_stored":2145433,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":16,"apply_latency_ms":16,"commit_latency_ns":16000000,"apply_latency_ns":16000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.078589"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:42:37.772628+0000","last_change":"2024-09-17T05:42:37.772628+0000","last_active":"2024-09-17T05:42:37.772628+0000","last_peered":"2024-09-17T05:42:37.772628+0000","last_clean":"2024-09-17T05:42:37.772628+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:42:37.772628+0000","last_undegraded":"2024-09-17T05:42:37.772628+0000","last_fullsized":"2024-09-17T05:42:37.772628+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:42:37.772628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:42:37.772628+0000","last_clean_scrub_stamp":"2024-09-17T05:42:37.772628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:42:37.772628+0000","last_change":"2024-09-17T05:42:37.772628+0000","last_active":"2024-09-17T05:42:37.772628+0000","last_peered":"2024-09-17T05:42:37.772628+0000","last_clean":"2024-09-17T05:42:37.772628+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:42:37.772628+0000","last_undegraded":"2024-09-17T05:42:37.772628+0000","last_fullsized":"2024-09-17T05:42:37.772628+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:42:37.772628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:42:37.772628+0000","last_clean_scrub_stamp":"2024-09-17T05:42:37.772628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:42:37.772628+0000","last_change":"2024-09-17T05:42:37.772628+0000","last_active":"2024-09-17T05:42:37.772628+0000","last_peered":"2024-09-17T05:42:37.772628+0000","last_clean":"2024-09-17T05:42:37.772628+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:42:37.772628+0000","last_undegraded":"2024-09-17T05:42:37.772628+0000","last_fullsized":"2024-09-17T05:42:37.772628+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:42:37.772628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:42:37.772628+0000","last_clean_scrub_stamp":"2024-09-17T05:42:37.772628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:42:37.772628+0000","last_change":"2024-09-17T05:42:37.772628+0000","last_active":"2024-09-17T05:42:37.772628+0000","last_peered":"2024-09-17T05:42:37.772628+0000","last_clean":"2024-09-17T05:42:37.772628+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:42:37.772628+0000","last_undegraded":"2024-09-17T05:42:37.772628+0000","last_fullsized":"2024-09-17T05:42:37.772628+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:42:37.772628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:42:37.772628+0000","last_clean_scrub_stamp":"2024-09-17T05:42:37.772628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:42:37.772628+0000","last_change":"2024-09-17T05:42:37.772628+0000","last_active":"2024-09-17T05:42:37.772628+0000","last_peered":"2024-09-17T05:42:37.772628+0000","last_clean":"2024-09-17T05:42:37.772628+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:42:37.772628+0000","last_undegraded":"2024-09-17T05:42:37.772628+0000","last_fullsized":"2024-09-17T05:42:37.772628+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:42:37.772628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:42:37.772628+0000","last_clean_scrub_stamp":"2024-09-17T05:42:37.772628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:42:37.772628+0000","last_change":"2024-09-17T05:42:37.772628+0000","last_active":"2024-09-17T05:42:37.772628+0000","last_peered":"2024-09-17T05:42:37.772628+0000","last_clean":"2024-09-17T05:42:37.772628+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:42:37.772628+0000","last_undegraded":"2024-09-17T05:42:37.772628+0000","last_fullsized":"2024-09-17T05:42:37.772628+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:42:37.772628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:42:37.772628+0000","last_clean_scrub_stamp":"2024-09-17T05:42:37.772628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:42:37.772628+0000","last_change":"2024-09-17T05:42:37.772628+0000","last_active":"2024-09-17T05:42:37.772628+0000","last_peered":"2024-09-17T05:42:37.772628+0000","last_clean":"2024-09-17T05:42:37.772628+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:42:37.772628+0000","last_undegraded":"2024-09-17T05:42:37.772628+0000","last_fullsized":"2024-09-17T05:42:37.772628+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:42:37.772628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:42:37.772628+0000","last_clean_scrub_stamp":"2024-09-17T05:42:37.772628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:42:37.772628+0000","last_change":"2024-09-17T05:42:37.772628+0000","last_active":"2024-09-17T05:42:37.772628+0000","last_peered":"2024-09-17T05:42:37.772628+0000","last_clean":"2024-09-17T05:42:37.772628+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:42:37.772628+0000","last_undegraded":"2024-09-17T05:42:37.772628+0000","last_fullsized":"2024-09-17T05:42:37.772628+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:42:37.772628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:42:37.772628+0000","last_clean_scrub_stamp":"2024-09-17T05:42:37.772628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:42:37.772628+0000","last_change":"2024-09-17T05:42:37.772628+0000","last_active":"2024-09-17T05:42:37.772628+0000","last_peered":"2024-09-17T05:42:37.772628+0000","last_clean":"2024-09-17T05:42:37.772628+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:42:37.772628+0000","last_undegraded":"2024-09-17T05:42:37.772628+0000","last_fullsized":"2024-09-17T05:42:37.772628+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:42:37.772628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:42:37.772628+0000","last_clean_scrub_stamp":"2024-09-17T05:42:37.772628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:42:37.772628+0000","last_change":"2024-09-17T05:42:37.772628+0000","last_active":"2024-09-17T05:42:37.772628+0000","last_peered":"2024-09-17T05:42:37.772628+0000","last_clean":"2024-09-17T05:42:37.772628+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:42:37.772628+0000","last_undegraded":"2024-09-17T05:42:37.772628+0000","last_fullsized":"2024-09-17T05:42:37.772628+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:42:37.772628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:42:37.772628+0000","last_clean_scrub_stamp":"2024-09-17T05:42:37.772628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:42:37.772628+0000","last_change":"2024-09-17T05:42:37.772628+0000","last_active":"2024-09-17T05:42:37.772628+0000","last_peered":"2024-09-17T05:42:37.772628+0000","last_clean":"2024-09-17T05:42:37.772628+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:42:37.772628+0000","last_undegraded":"2024-09-17T05:42:37.772628+0000","last_fullsized":"2024-09-17T05:42:37.772628+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:42:37.772628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:42:37.772628+0000","last_clean_scrub_stamp":"2024-09-17T05:42:37.772628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:42:37.772628+0000","last_change":"2024-09-17T05:42:37.772628+0000","last_active":"2024-09-17T05:42:37.772628+0000","last_peered":"2024-09-17T05:42:37.772628+0000","last_clean":"2024-09-17T05:42:37.772628+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:42:37.772628+0000","last_undegraded":"2024-09-17T05:42:37.772628+0000","last_fullsized":"2024-09-17T05:42:37.772628+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:42:37.772628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:42:37.772628+0000","last_clean_scrub_stamp":"2024-09-17T05:42:37.772628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:42:37.772628+0000","last_change":"2024-09-17T05:42:37.772628+0000","last_active":"2024-09-17T05:42:37.772628+0000","last_peered":"2024-09-17T05:42:37.772628+0000","last_clean":"2024-09-17T05:42:37.772628+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:42:37.772628+0000","last_undegraded":"2024-09-17T05:42:37.772628+0000","last_fullsized":"2024-09-17T05:42:37.772628+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:42:37.772628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:42:37.772628+0000","last_clean_scrub_stamp":"2024-09-17T05:42:37.772628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:42:37.772628+0000","last_change":"2024-09-17T05:42:37.772628+0000","last_active":"2024-09-17T05:42:37.772628+0000","last_peered":"2024-09-17T05:42:37.772628+0000","last_clean":"2024-09-17T05:42:37.772628+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:42:37.772628+0000","last_undegraded":"2024-09-17T05:42:37.772628+0000","last_fullsized":"2024-09-17T05:42:37.772628+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:42:37.772628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:42:37.772628+0000","last_clean_scrub_stamp":"2024-09-17T05:42:37.772628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:42:37.772628+0000","last_change":"2024-09-17T05:42:37.772628+0000","last_active":"2024-09-17T05:42:37.772628+0000","last_peered":"2024-09-17T05:42:37.772628+0000","last_clean":"2024-09-17T05:42:37.772628+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:42:37.772628+0000","last_undegraded":"2024-09-17T05:42:37.772628+0000","last_fullsized":"2024-09-17T05:42:37.772628+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:42:37.772628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:42:37.772628+0000","last_clean_scrub_stamp":"2024-09-17T05:42:37.772628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:42:37.772628+0000","last_change":"2024-09-17T05:42:37.772628+0000","last_active":"2024-09-17T05:42:37.772628+0000","last_peered":"2024-09-17T05:42:37.772628+0000","last_clean":"2024-09-17T05:42:37.772628+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:42:37.772628+0000","last_undegraded":"2024-09-17T05:42:37.772628+0000","last_fullsized":"2024-09-17T05:42:37.772628+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:42:37.772628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:42:37.772628+0000","last_clean_scrub_stamp":"2024-09-17T05:42:37.772628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:42:37.772628+0000","last_change":"2024-09-17T05:42:37.772628+0000","last_active":"2024-09-17T05:42:37.772628+0000","last_peered":"2024-09-17T05:42:37.772628+0000","last_clean":"2024-09-17T05:42:37.772628+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:42:37.772628+0000","last_undegraded":"2024-09-17T05:42:37.772628+0000","last_fullsized":"2024-09-17T05:42:37.772628+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:42:37.772628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:42:37.772628+0000","last_clean_scrub_stamp":"2024-09-17T05:42:37.772628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:42:37.772628+0000","last_change":"2024-09-17T05:42:37.772628+0000","last_active":"2024-09-17T05:42:37.772628+0000","last_peered":"2024-09-17T05:42:37.772628+0000","last_clean":"2024-09-17T05:42:37.772628+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:42:37.772628+0000","last_undegraded":"2024-09-17T05:42:37.772628+0000","last_fullsized":"2024-09-17T05:42:37.772628+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:42:37.772628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:42:37.772628+0000","last_clean_scrub_stamp":"2024-09-17T05:42:37.772628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:42:37.772628+0000","last_change":"2024-09-17T05:42:37.772628+0000","last_active":"2024-09-17T05:42:37.772628+0000","last_peered":"2024-09-17T05:42:37.772628+0000","last_clean":"2024-09-17T05:42:37.772628+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:42:37.772628+0000","last_undegraded":"2024-09-17T05:42:37.772628+0000","last_fullsized":"2024-09-17T05:42:37.772628+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:42:37.772628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:42:37.772628+0000","last_clean_scrub_stamp":"2024-09-17T05:42:37.772628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:42:37.772628+0000","last_change":"2024-09-17T05:42:37.772628+0000","last_active":"2024-09-17T05:42:37.772628+0000","last_peered":"2024-09-17T05:42:37.772628+0000","last_clean":"2024-09-17T05:42:37.772628+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:42:37.772628+0000","last_undegraded":"2024-09-17T05:42:37.772628+0000","last_fullsized":"2024-09-17T05:42:37.772628+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:42:37.772628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:42:37.772628+0000","last_clean_scrub_stamp":"2024-09-17T05:42:37.772628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:42:37.772628+0000","last_change":"2024-09-17T05:42:37.772628+0000","last_active":"2024-09-17T05:42:37.772628+0000","last_peered":"2024-09-17T05:42:37.772628+0000","last_clean":"2024-09-17T05:42:37.772628+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:42:37.772628+0000","last_undegraded":"2024-09-17T05:42:37.772628+0000","last_fullsized":"2024-09-17T05:42:37.772628+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:42:37.772628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:42:37.772628+0000","last_clean_scrub_stamp":"2024-09-17T05:42:37.772628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:42:37.772628+0000","last_change":"2024-09-17T05:42:37.772628+0000","last_active":"2024-09-17T05:42:37.772628+0000","last_peered":"2024-09-17T05:42:37.772628+0000","last_clean":"2024-09-17T05:42:37.772628+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:42:37.772628+0000","last_undegraded":"2024-09-17T05:42:37.772628+0000","last_fullsized":"2024-09-17T05:42:37.772628+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:42:37.772628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:42:37.772628+0000","last_clean_scrub_stamp":"2024-09-17T05:42:37.772628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-09-17T05:42:37.787939+0000","last_change":"2024-09-17T05:42:37.787939+0000","last_active":"2024-09-17T05:42:37.772628+0000","last_peered":"2024-09-17T05:42:37.772628+0000","last_clean":"2024-09-17T05:42:37.772628+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:42:37.787939+0000","last_undegraded":"2024-09-17T05:42:37.787939+0000","last_fullsized":"2024-09-17T05:42:37.787939+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:42:37.772628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:42:37.772628+0000","last_clean_scrub_stamp":"2024-09-17T05:42:37.772628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:42:37.772628+0000","last_change":"2024-09-17T05:42:37.772628+0000","last_active":"2024-09-17T05:42:37.772628+0000","last_peered":"2024-09-17T05:42:37.772628+0000","last_clean":"2024-09-17T05:42:37.772628+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:42:37.772628+0000","last_undegraded":"2024-09-17T05:42:37.772628+0000","last_fullsized":"2024-09-17T05:42:37.772628+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:42:37.772628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:42:37.772628+0000","last_clean_scrub_stamp":"2024-09-17T05:42:37.772628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:42:37.772628+0000","last_change":"2024-09-17T05:42:37.772628+0000","last_active":"2024-09-17T05:42:37.772628+0000","last_peered":"2024-09-17T05:42:37.772628+0000","last_clean":"2024-09-17T05:42:37.772628+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:42:37.772628+0000","last_undegraded":"2024-09-17T05:42:37.772628+0000","last_fullsized":"2024-09-17T05:42:37.772628+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:42:37.772628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:42:37.772628+0000","last_clean_scrub_stamp":"2024-09-17T05:42:37.772628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:42:37.772628+0000","last_change":"2024-09-17T05:42:37.772628+0000","last_active":"2024-09-17T05:42:37.772628+0000","last_peered":"2024-09-17T05:42:37.772628+0000","last_clean":"2024-09-17T05:42:37.772628+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:42:37.772628+0000","last_undegraded":"2024-09-17T05:42:37.772628+0000","last_fullsized":"2024-09-17T05:42:37.772628+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:42:37.772628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:42:37.772628+0000","last_clean_scrub_stamp":"2024-09-17T05:42:37.772628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:42:37.772628+0000","last_change":"2024-09-17T05:42:37.772628+0000","last_active":"2024-09-17T05:42:37.772628+0000","last_peered":"2024-09-17T05:42:37.772628+0000","last_clean":"2024-09-17T05:42:37.772628+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:42:37.772628+0000","last_undegraded":"2024-09-17T05:42:37.772628+0000","last_fullsized":"2024-09-17T05:42:37.772628+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:42:37.772628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:42:37.772628+0000","last_clean_scrub_stamp":"2024-09-17T05:42:37.772628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:42:37.772628+0000","last_change":"2024-09-17T05:42:37.772628+0000","last_active":"2024-09-17T05:42:37.772628+0000","last_peered":"2024-09-17T05:42:37.772628+0000","last_clean":"2024-09-17T05:42:37.772628+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:42:37.772628+0000","last_undegraded":"2024-09-17T05:42:37.772628+0000","last_fullsized":"2024-09-17T05:42:37.772628+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:42:37.772628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:42:37.772628+0000","last_clean_scrub_stamp":"2024-09-17T05:42:37.772628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:42:37.772628+0000","last_change":"2024-09-17T05:42:37.772628+0000","last_active":"2024-09-17T05:42:37.772628+0000","last_peered":"2024-09-17T05:42:37.772628+0000","last_clean":"2024-09-17T05:42:37.772628+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:42:37.772628+0000","last_undegraded":"2024-09-17T05:42:37.772628+0000","last_fullsized":"2024-09-17T05:42:37.772628+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:42:37.772628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:42:37.772628+0000","last_clean_scrub_stamp":"2024-09-17T05:42:37.772628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:42:37.772628+0000","last_change":"2024-09-17T05:42:37.772628+0000","last_active":"2024-09-17T05:42:37.772628+0000","last_peered":"2024-09-17T05:42:37.772628+0000","last_clean":"2024-09-17T05:42:37.772628+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:42:37.772628+0000","last_undegraded":"2024-09-17T05:42:37.772628+0000","last_fullsized":"2024-09-17T05:42:37.772628+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:42:37.772628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:42:37.772628+0000","last_clean_scrub_stamp":"2024-09-17T05:42:37.772628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:42:37.772628+0000","last_change":"2024-09-17T05:42:37.772628+0000","last_active":"2024-09-17T05:42:37.772628+0000","last_peered":"2024-09-17T05:42:37.772628+0000","last_clean":"2024-09-17T05:42:37.772628+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:42:37.772628+0000","last_undegraded":"2024-09-17T05:42:37.772628+0000","last_fullsized":"2024-09-17T05:42:37.772628+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:42:37.772628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:42:37.772628+0000","last_clean_scrub_stamp":"2024-09-17T05:42:37.772628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:42:37.772628+0000","last_change":"2024-09-17T05:42:37.772628+0000","last_active":"2024-09-17T05:42:37.772628+0000","last_peered":"2024-09-17T05:42:37.772628+0000","last_clean":"2024-09-17T05:42:37.772628+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:42:37.772628+0000","last_undegraded":"2024-09-17T05:42:37.772628+0000","last_fullsized":"2024-09-17T05:42:37.772628+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:42:37.772628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:42:37.772628+0000","last_clean_scrub_stamp":"2024-09-17T05:42:37.772628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-09-17T05:42:37.793868+0000","last_change":"2024-09-17T05:42:37.793868+0000","last_active":"2024-09-17T05:42:37.772628+0000","last_peered":"2024-09-17T05:42:37.772628+0000","last_clean":"2024-09-17T05:42:37.772628+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:42:37.793868+0000","last_undegraded":"2024-09-17T05:42:37.793868+0000","last_fullsized":"2024-09-17T05:42:37.793868+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:42:37.772628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:42:37.772628+0000","last_clean_scrub_stamp":"2024-09-17T05:42:37.772628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-17T05:42:36.780045+0000","last_change":"2024-09-17T05:42:36.780045+0000","last_active":"2024-09-17T05:42:36.770435+0000","last_peered":"2024-09-17T05:42:36.770435+0000","last_clean":"2024-09-17T05:42:36.770435+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:42:36.780045+0000","last_undegraded":"2024-09-17T05:42:36.780045+0000","last_fullsized":"2024-09-17T05:42:36.780045+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:42:36.770435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:42:36.770435+0000","last_clean_scrub_stamp":"2024-09-17T05:42:36.770435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:42:37.772628+0000","last_change":"2024-09-17T05:42:37.772628+0000","last_active":"2024-09-17T05:42:37.772628+0000","last_peered":"2024-09-17T05:42:37.772628+0000","last_clean":"2024-09-17T05:42:37.772628+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:42:37.772628+0000","last_undegraded":"2024-09-17T05:42:37.772628+0000","last_fullsized":"2024-09-17T05:42:37.772628+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:42:37.772628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:42:37.772628+0000","last_clean_scrub_stamp":"2024-09-17T05:42:37.772628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":10,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T05:42:37.805843+0000","last_change":"2024-09-17T05:42:37.802980+0000","last_active":"2024-09-17T05:42:37.805843+0000","last_peered":"2024-09-17T05:42:37.805843+0000","last_clean":"2024-09-17T05:42:37.805843+0000","last_became_active":"2024-09-17T05:42:37.802617+0000","last_became_peered":"2024-09-17T05:42:37.802617+0000","last_unstale":"2024-09-17T05:42:37.805843+0000","last_undegraded":"2024-09-17T05:42:37.805843+0000","last_fullsized":"2024-09-17T05:42:37.805843+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:42:36.770435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:42:36.770435+0000","last_clean_scrub_stamp":"2024-09-17T05:42:36.770435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:53:27.876127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:42:37.772628+0000","last_change":"2024-09-17T05:42:37.772628+0000","last_active":"2024-09-17T05:42:37.772628+0000","last_peered":"2024-09-17T05:42:37.772628+0000","last_clean":"2024-09-17T05:42:37.772628+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:42:37.772628+0000","last_undegraded":"2024-09-17T05:42:37.772628+0000","last_fullsized":"2024-09-17T05:42:37.772628+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:42:37.772628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:42:37.772628+0000","last_clean_scrub_stamp":"2024-09-17T05:42:37.772628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:42:36.770435+0000","last_change":"2024-09-17T05:42:36.770435+0000","last_active":"2024-09-17T05:42:36.770435+0000","last_peered":"2024-09-17T05:42:36.770435+0000","last_clean":"2024-09-17T05:42:36.770435+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:42:36.770435+0000","last_undegraded":"2024-09-17T05:42:36.770435+0000","last_fullsized":"2024-09-17T05:42:36.770435+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:42:36.770435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:42:36.770435+0000","last_clean_scrub_stamp":"2024-09-17T05:42:36.770435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:42:37.772628+0000","last_change":"2024-09-17T05:42:37.772628+0000","last_active":"2024-09-17T05:42:37.772628+0000","last_peered":"2024-09-17T05:42:37.772628+0000","last_clean":"2024-09-17T05:42:37.772628+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:42:37.772628+0000","last_undegraded":"2024-09-17T05:42:37.772628+0000","last_fullsized":"2024-09-17T05:42:37.772628+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:42:37.772628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:42:37.772628+0000","last_clean_scrub_stamp":"2024-09-17T05:42:37.772628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:42:36.770435+0000","last_change":"2024-09-17T05:42:36.770435+0000","last_active":"2024-09-17T05:42:36.770435+0000","last_peered":"2024-09-17T05:42:36.770435+0000","last_clean":"2024-09-17T05:42:36.770435+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:42:36.770435+0000","last_undegraded":"2024-09-17T05:42:36.770435+0000","last_fullsized":"2024-09-17T05:42:36.770435+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:42:36.770435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:42:36.770435+0000","last_clean_scrub_stamp":"2024-09-17T05:42:36.770435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:42:37.772628+0000","last_change":"2024-09-17T05:42:37.772628+0000","last_active":"2024-09-17T05:42:37.772628+0000","last_peered":"2024-09-17T05:42:37.772628+0000","last_clean":"2024-09-17T05:42:37.772628+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:42:37.772628+0000","last_undegraded":"2024-09-17T05:42:37.772628+0000","last_fullsized":"2024-09-17T05:42:37.772628+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:42:37.772628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:42:37.772628+0000","last_clean_scrub_stamp":"2024-09-17T05:42:37.772628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:42:36.770435+0000","last_change":"2024-09-17T05:42:36.770435+0000","last_active":"2024-09-17T05:42:36.770435+0000","last_peered":"2024-09-17T05:42:36.770435+0000","last_clean":"2024-09-17T05:42:36.770435+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:42:36.770435+0000","last_undegraded":"2024-09-17T05:42:36.770435+0000","last_fullsized":"2024-09-17T05:42:36.770435+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:42:36.770435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:42:36.770435+0000","last_clean_scrub_stamp":"2024-09-17T05:42:36.770435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:42:37.772628+0000","last_change":"2024-09-17T05:42:37.772628+0000","last_active":"2024-09-17T05:42:37.772628+0000","last_peered":"2024-09-17T05:42:37.772628+0000","last_clean":"2024-09-17T05:42:37.772628+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:42:37.772628+0000","last_undegraded":"2024-09-17T05:42:37.772628+0000","last_fullsized":"2024-09-17T05:42:37.772628+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:42:37.772628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:42:37.772628+0000","last_clean_scrub_stamp":"2024-09-17T05:42:37.772628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:42:36.770435+0000","last_change":"2024-09-17T05:42:36.770435+0000","last_active":"2024-09-17T05:42:36.770435+0000","last_peered":"2024-09-17T05:42:36.770435+0000","last_clean":"2024-09-17T05:42:36.770435+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:42:36.770435+0000","last_undegraded":"2024-09-17T05:42:36.770435+0000","last_fullsized":"2024-09-17T05:42:36.770435+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:42:36.770435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:42:36.770435+0000","last_clean_scrub_stamp":"2024-09-17T05:42:36.770435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:42:37.772628+0000","last_change":"2024-09-17T05:42:37.772628+0000","last_active":"2024-09-17T05:42:37.772628+0000","last_peered":"2024-09-17T05:42:37.772628+0000","last_clean":"2024-09-17T05:42:37.772628+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:42:37.772628+0000","last_undegraded":"2024-09-17T05:42:37.772628+0000","last_fullsized":"2024-09-17T05:42:37.772628+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:42:37.772628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:42:37.772628+0000","last_clean_scrub_stamp":"2024-09-17T05:42:37.772628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:42:36.770435+0000","last_change":"2024-09-17T05:42:36.770435+0000","last_active":"2024-09-17T05:42:36.770435+0000","last_peered":"2024-09-17T05:42:36.770435+0000","last_clean":"2024-09-17T05:42:36.770435+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:42:36.770435+0000","last_undegraded":"2024-09-17T05:42:36.770435+0000","last_fullsized":"2024-09-17T05:42:36.770435+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:42:36.770435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:42:36.770435+0000","last_clean_scrub_stamp":"2024-09-17T05:42:36.770435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:42:37.772628+0000","last_change":"2024-09-17T05:42:37.772628+0000","last_active":"2024-09-17T05:42:37.772628+0000","last_peered":"2024-09-17T05:42:37.772628+0000","last_clean":"2024-09-17T05:42:37.772628+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:42:37.772628+0000","last_undegraded":"2024-09-17T05:42:37.772628+0000","last_fullsized":"2024-09-17T05:42:37.772628+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:42:37.772628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:42:37.772628+0000","last_clean_scrub_stamp":"2024-09-17T05:42:37.772628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:42:36.770435+0000","last_change":"2024-09-17T05:42:36.770435+0000","last_active":"2024-09-17T05:42:36.770435+0000","last_peered":"2024-09-17T05:42:36.770435+0000","last_clean":"2024-09-17T05:42:36.770435+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:42:36.770435+0000","last_undegraded":"2024-09-17T05:42:36.770435+0000","last_fullsized":"2024-09-17T05:42:36.770435+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:42:36.770435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:42:36.770435+0000","last_clean_scrub_stamp":"2024-09-17T05:42:36.770435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:42:37.772628+0000","last_change":"2024-09-17T05:42:37.772628+0000","last_active":"2024-09-17T05:42:37.772628+0000","last_peered":"2024-09-17T05:42:37.772628+0000","last_clean":"2024-09-17T05:42:37.772628+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:42:37.772628+0000","last_undegraded":"2024-09-17T05:42:37.772628+0000","last_fullsized":"2024-09-17T05:42:37.772628+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:42:37.772628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:42:37.772628+0000","last_clean_scrub_stamp":"2024-09-17T05:42:37.772628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:42:36.770435+0000","last_change":"2024-09-17T05:42:36.770435+0000","last_active":"2024-09-17T05:42:36.770435+0000","last_peered":"2024-09-17T05:42:36.770435+0000","last_clean":"2024-09-17T05:42:36.770435+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:42:36.770435+0000","last_undegraded":"2024-09-17T05:42:36.770435+0000","last_fullsized":"2024-09-17T05:42:36.770435+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:42:36.770435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:42:36.770435+0000","last_clean_scrub_stamp":"2024-09-17T05:42:36.770435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:42:37.772628+0000","last_change":"2024-09-17T05:42:37.772628+0000","last_active":"2024-09-17T05:42:37.772628+0000","last_peered":"2024-09-17T05:42:37.772628+0000","last_clean":"2024-09-17T05:42:37.772628+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:42:37.772628+0000","last_undegraded":"2024-09-17T05:42:37.772628+0000","last_fullsized":"2024-09-17T05:42:37.772628+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:42:37.772628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:42:37.772628+0000","last_clean_scrub_stamp":"2024-09-17T05:42:37.772628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":10,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T05:42:37.805813+0000","last_change":"2024-09-17T05:42:37.802055+0000","last_active":"2024-09-17T05:42:37.805813+0000","last_peered":"2024-09-17T05:42:37.805813+0000","last_clean":"2024-09-17T05:42:37.805813+0000","last_became_active":"2024-09-17T05:42:37.801718+0000","last_became_peered":"2024-09-17T05:42:37.801718+0000","last_unstale":"2024-09-17T05:42:37.805813+0000","last_undegraded":"2024-09-17T05:42:37.805813+0000","last_fullsized":"2024-09-17T05:42:37.805813+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:42:36.770435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:42:36.770435+0000","last_clean_scrub_stamp":"2024-09-17T05:42:36.770435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:16:12.275459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:42:37.772628+0000","last_change":"2024-09-17T05:42:37.772628+0000","last_active":"2024-09-17T05:42:37.772628+0000","last_peered":"2024-09-17T05:42:37.772628+0000","last_clean":"2024-09-17T05:42:37.772628+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:42:37.772628+0000","last_undegraded":"2024-09-17T05:42:37.772628+0000","last_fullsized":"2024-09-17T05:42:37.772628+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:42:37.772628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:42:37.772628+0000","last_clean_scrub_stamp":"2024-09-17T05:42:37.772628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:42:36.770435+0000","last_change":"2024-09-17T05:42:36.770435+0000","last_active":"2024-09-17T05:42:36.770435+0000","last_peered":"2024-09-17T05:42:36.770435+0000","last_clean":"2024-09-17T05:42:36.770435+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:42:36.770435+0000","last_undegraded":"2024-09-17T05:42:36.770435+0000","last_fullsized":"2024-09-17T05:42:36.770435+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:42:36.770435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:42:36.770435+0000","last_clean_scrub_stamp":"2024-09-17T05:42:36.770435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:42:37.772628+0000","last_change":"2024-09-17T05:42:37.772628+0000","last_active":"2024-09-17T05:42:37.772628+0000","last_peered":"2024-09-17T05:42:37.772628+0000","last_clean":"2024-09-17T05:42:37.772628+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:42:37.772628+0000","last_undegraded":"2024-09-17T05:42:37.772628+0000","last_fullsized":"2024-09-17T05:42:37.772628+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:42:37.772628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:42:37.772628+0000","last_clean_scrub_stamp":"2024-09-17T05:42:37.772628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:42:36.770435+0000","last_change":"2024-09-17T05:42:36.770435+0000","last_active":"2024-09-17T05:42:36.770435+0000","last_peered":"2024-09-17T05:42:36.770435+0000","last_clean":"2024-09-17T05:42:36.770435+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:42:36.770435+0000","last_undegraded":"2024-09-17T05:42:36.770435+0000","last_fullsized":"2024-09-17T05:42:36.770435+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:42:36.770435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:42:36.770435+0000","last_clean_scrub_stamp":"2024-09-17T05:42:36.770435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:42:37.772628+0000","last_change":"2024-09-17T05:42:37.772628+0000","last_active":"2024-09-17T05:42:37.772628+0000","last_peered":"2024-09-17T05:42:37.772628+0000","last_clean":"2024-09-17T05:42:37.772628+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:42:37.772628+0000","last_undegraded":"2024-09-17T05:42:37.772628+0000","last_fullsized":"2024-09-17T05:42:37.772628+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:42:37.772628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:42:37.772628+0000","last_clean_scrub_stamp":"2024-09-17T05:42:37.772628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:42:36.770435+0000","last_change":"2024-09-17T05:42:36.770435+0000","last_active":"2024-09-17T05:42:36.770435+0000","last_peered":"2024-09-17T05:42:36.770435+0000","last_clean":"2024-09-17T05:42:36.770435+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:42:36.770435+0000","last_undegraded":"2024-09-17T05:42:36.770435+0000","last_fullsized":"2024-09-17T05:42:36.770435+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:42:36.770435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:42:36.770435+0000","last_clean_scrub_stamp":"2024-09-17T05:42:36.770435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:42:37.772628+0000","last_change":"2024-09-17T05:42:37.772628+0000","last_active":"2024-09-17T05:42:37.772628+0000","last_peered":"2024-09-17T05:42:37.772628+0000","last_clean":"2024-09-17T05:42:37.772628+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:42:37.772628+0000","last_undegraded":"2024-09-17T05:42:37.772628+0000","last_fullsized":"2024-09-17T05:42:37.772628+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:42:37.772628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:42:37.772628+0000","last_clean_scrub_stamp":"2024-09-17T05:42:37.772628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:42:36.770435+0000","last_change":"2024-09-17T05:42:36.770435+0000","last_active":"2024-09-17T05:42:36.770435+0000","last_peered":"2024-09-17T05:42:36.770435+0000","last_clean":"2024-09-17T05:42:36.770435+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:42:36.770435+0000","last_undegraded":"2024-09-17T05:42:36.770435+0000","last_fullsized":"2024-09-17T05:42:36.770435+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:42:36.770435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:42:36.770435+0000","last_clean_scrub_stamp":"2024-09-17T05:42:36.770435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:42:37.772628+0000","last_change":"2024-09-17T05:42:37.772628+0000","last_active":"2024-09-17T05:42:37.772628+0000","last_peered":"2024-09-17T05:42:37.772628+0000","last_clean":"2024-09-17T05:42:37.772628+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:42:37.772628+0000","last_undegraded":"2024-09-17T05:42:37.772628+0000","last_fullsized":"2024-09-17T05:42:37.772628+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:42:37.772628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:42:37.772628+0000","last_clean_scrub_stamp":"2024-09-17T05:42:37.772628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:42:36.770435+0000","last_change":"2024-09-17T05:42:36.770435+0000","last_active":"2024-09-17T05:42:36.770435+0000","last_peered":"2024-09-17T05:42:36.770435+0000","last_clean":"2024-09-17T05:42:36.770435+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:42:36.770435+0000","last_undegraded":"2024-09-17T05:42:36.770435+0000","last_fullsized":"2024-09-17T05:42:36.770435+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:42:36.770435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:42:36.770435+0000","last_clean_scrub_stamp":"2024-09-17T05:42:36.770435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:42:37.772628+0000","last_change":"2024-09-17T05:42:37.772628+0000","last_active":"2024-09-17T05:42:37.772628+0000","last_peered":"2024-09-17T05:42:37.772628+0000","last_clean":"2024-09-17T05:42:37.772628+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:42:37.772628+0000","last_undegraded":"2024-09-17T05:42:37.772628+0000","last_fullsized":"2024-09-17T05:42:37.772628+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:42:37.772628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:42:37.772628+0000","last_clean_scrub_stamp":"2024-09-17T05:42:37.772628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:42:36.770435+0000","last_change":"2024-09-17T05:42:36.770435+0000","last_active":"2024-09-17T05:42:36.770435+0000","last_peered":"2024-09-17T05:42:36.770435+0000","last_clean":"2024-09-17T05:42:36.770435+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:42:36.770435+0000","last_undegraded":"2024-09-17T05:42:36.770435+0000","last_fullsized":"2024-09-17T05:42:36.770435+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:42:36.770435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:42:36.770435+0000","last_clean_scrub_stamp":"2024-09-17T05:42:36.770435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:42:37.772628+0000","last_change":"2024-09-17T05:42:37.772628+0000","last_active":"2024-09-17T05:42:37.772628+0000","last_peered":"2024-09-17T05:42:37.772628+0000","last_clean":"2024-09-17T05:42:37.772628+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:42:37.772628+0000","last_undegraded":"2024-09-17T05:42:37.772628+0000","last_fullsized":"2024-09-17T05:42:37.772628+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:42:37.772628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:42:37.772628+0000","last_clean_scrub_stamp":"2024-09-17T05:42:37.772628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:42:36.770435+0000","last_change":"2024-09-17T05:42:36.770435+0000","last_active":"2024-09-17T05:42:36.770435+0000","last_peered":"2024-09-17T05:42:36.770435+0000","last_clean":"2024-09-17T05:42:36.770435+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:42:36.770435+0000","last_undegraded":"2024-09-17T05:42:36.770435+0000","last_fullsized":"2024-09-17T05:42:36.770435+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:42:36.770435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:42:36.770435+0000","last_clean_scrub_stamp":"2024-09-17T05:42:36.770435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:42:37.772628+0000","last_change":"2024-09-17T05:42:37.772628+0000","last_active":"2024-09-17T05:42:37.772628+0000","last_peered":"2024-09-17T05:42:37.772628+0000","last_clean":"2024-09-17T05:42:37.772628+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:42:37.772628+0000","last_undegraded":"2024-09-17T05:42:37.772628+0000","last_fullsized":"2024-09-17T05:42:37.772628+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:42:37.772628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:42:37.772628+0000","last_clean_scrub_stamp":"2024-09-17T05:42:37.772628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:42:36.770435+0000","last_change":"2024-09-17T05:42:36.770435+0000","last_active":"2024-09-17T05:42:36.770435+0000","last_peered":"2024-09-17T05:42:36.770435+0000","last_clean":"2024-09-17T05:42:36.770435+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:42:36.770435+0000","last_undegraded":"2024-09-17T05:42:36.770435+0000","last_fullsized":"2024-09-17T05:42:36.770435+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:42:36.770435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:42:36.770435+0000","last_clean_scrub_stamp":"2024-09-17T05:42:36.770435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:42:37.772628+0000","last_change":"2024-09-17T05:42:37.772628+0000","last_active":"2024-09-17T05:42:37.772628+0000","last_peered":"2024-09-17T05:42:37.772628+0000","last_clean":"2024-09-17T05:42:37.772628+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:42:37.772628+0000","last_undegraded":"2024-09-17T05:42:37.772628+0000","last_fullsized":"2024-09-17T05:42:37.772628+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:42:37.772628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:42:37.772628+0000","last_clean_scrub_stamp":"2024-09-17T05:42:37.772628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:42:36.770435+0000","last_change":"2024-09-17T05:42:36.770435+0000","last_active":"2024-09-17T05:42:36.770435+0000","last_peered":"2024-09-17T05:42:36.770435+0000","last_clean":"2024-09-17T05:42:36.770435+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:42:36.770435+0000","last_undegraded":"2024-09-17T05:42:36.770435+0000","last_fullsized":"2024-09-17T05:42:36.770435+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:42:36.770435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:42:36.770435+0000","last_clean_scrub_stamp":"2024-09-17T05:42:36.770435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:42:37.772628+0000","last_change":"2024-09-17T05:42:37.772628+0000","last_active":"2024-09-17T05:42:37.772628+0000","last_peered":"2024-09-17T05:42:37.772628+0000","last_clean":"2024-09-17T05:42:37.772628+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:42:37.772628+0000","last_undegraded":"2024-09-17T05:42:37.772628+0000","last_fullsized":"2024-09-17T05:42:37.772628+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:42:37.772628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:42:37.772628+0000","last_clean_scrub_stamp":"2024-09-17T05:42:37.772628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:42:36.770435+0000","last_change":"2024-09-17T05:42:36.770435+0000","last_active":"2024-09-17T05:42:36.770435+0000","last_peered":"2024-09-17T05:42:36.770435+0000","last_clean":"2024-09-17T05:42:36.770435+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:42:36.770435+0000","last_undegraded":"2024-09-17T05:42:36.770435+0000","last_fullsized":"2024-09-17T05:42:36.770435+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:42:36.770435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:42:36.770435+0000","last_clean_scrub_stamp":"2024-09-17T05:42:36.770435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:42:37.772628+0000","last_change":"2024-09-17T05:42:37.772628+0000","last_active":"2024-09-17T05:42:37.772628+0000","last_peered":"2024-09-17T05:42:37.772628+0000","last_clean":"2024-09-17T05:42:37.772628+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:42:37.772628+0000","last_undegraded":"2024-09-17T05:42:37.772628+0000","last_fullsized":"2024-09-17T05:42:37.772628+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:42:37.772628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:42:37.772628+0000","last_clean_scrub_stamp":"2024-09-17T05:42:37.772628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":10,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T05:42:37.810685+0000","last_change":"2024-09-17T05:42:37.806715+0000","last_active":"2024-09-17T05:42:37.810685+0000","last_peered":"2024-09-17T05:42:37.810685+0000","last_clean":"2024-09-17T05:42:37.810685+0000","last_became_active":"2024-09-17T05:42:37.806401+0000","last_became_peered":"2024-09-17T05:42:37.806401+0000","last_unstale":"2024-09-17T05:42:37.810685+0000","last_undegraded":"2024-09-17T05:42:37.810685+0000","last_fullsized":"2024-09-17T05:42:37.810685+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:42:36.770435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:42:36.770435+0000","last_clean_scrub_stamp":"2024-09-17T05:42:36.770435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:17:40.016526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:42:37.772628+0000","last_change":"2024-09-17T05:42:37.772628+0000","last_active":"2024-09-17T05:42:37.772628+0000","last_peered":"2024-09-17T05:42:37.772628+0000","last_clean":"2024-09-17T05:42:37.772628+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:42:37.772628+0000","last_undegraded":"2024-09-17T05:42:37.772628+0000","last_fullsized":"2024-09-17T05:42:37.772628+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:42:37.772628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:42:37.772628+0000","last_clean_scrub_stamp":"2024-09-17T05:42:37.772628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-17T05:42:36.779764+0000","last_change":"2024-09-17T05:42:36.779764+0000","last_active":"2024-09-17T05:42:36.770435+0000","last_peered":"2024-09-17T05:42:36.770435+0000","last_clean":"2024-09-17T05:42:36.770435+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:42:36.779764+0000","last_undegraded":"2024-09-17T05:42:36.779764+0000","last_fullsized":"2024-09-17T05:42:36.779764+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:42:36.770435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:42:36.770435+0000","last_clean_scrub_stamp":"2024-09-17T05:42:36.770435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:42:37.772628+0000","last_change":"2024-09-17T05:42:37.772628+0000","last_active":"2024-09-17T05:42:37.772628+0000","last_peered":"2024-09-17T05:42:37.772628+0000","last_clean":"2024-09-17T05:42:37.772628+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:42:37.772628+0000","last_undegraded":"2024-09-17T05:42:37.772628+0000","last_fullsized":"2024-09-17T05:42:37.772628+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:42:37.772628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:42:37.772628+0000","last_clean_scrub_stamp":"2024-09-17T05:42:37.772628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:42:36.770435+0000","last_change":"2024-09-17T05:42:36.770435+0000","last_active":"2024-09-17T05:42:36.770435+0000","last_peered":"2024-09-17T05:42:36.770435+0000","last_clean":"2024-09-17T05:42:36.770435+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:42:36.770435+0000","last_undegraded":"2024-09-17T05:42:36.770435+0000","last_fullsized":"2024-09-17T05:42:36.770435+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:42:36.770435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:42:36.770435+0000","last_clean_scrub_stamp":"2024-09-17T05:42:36.770435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:42:37.772628+0000","last_change":"2024-09-17T05:42:37.772628+0000","last_active":"2024-09-17T05:42:37.772628+0000","last_peered":"2024-09-17T05:42:37.772628+0000","last_clean":"2024-09-17T05:42:37.772628+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:42:37.772628+0000","last_undegraded":"2024-09-17T05:42:37.772628+0000","last_fullsized":"2024-09-17T05:42:37.772628+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:42:37.772628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:42:37.772628+0000","last_clean_scrub_stamp":"2024-09-17T05:42:37.772628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:42:36.770435+0000","last_change":"2024-09-17T05:42:36.770435+0000","last_active":"2024-09-17T05:42:36.770435+0000","last_peered":"2024-09-17T05:42:36.770435+0000","last_clean":"2024-09-17T05:42:36.770435+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:42:36.770435+0000","last_undegraded":"2024-09-17T05:42:36.770435+0000","last_fullsized":"2024-09-17T05:42:36.770435+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:42:36.770435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:42:36.770435+0000","last_clean_scrub_stamp":"2024-09-17T05:42:36.770435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:42:37.772628+0000","last_change":"2024-09-17T05:42:37.772628+0000","last_active":"2024-09-17T05:42:37.772628+0000","last_peered":"2024-09-17T05:42:37.772628+0000","last_clean":"2024-09-17T05:42:37.772628+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:42:37.772628+0000","last_undegraded":"2024-09-17T05:42:37.772628+0000","last_fullsized":"2024-09-17T05:42:37.772628+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:42:37.772628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:42:37.772628+0000","last_clean_scrub_stamp":"2024-09-17T05:42:37.772628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:42:36.770435+0000","last_change":"2024-09-17T05:42:36.770435+0000","last_active":"2024-09-17T05:42:36.770435+0000","last_peered":"2024-09-17T05:42:36.770435+0000","last_clean":"2024-09-17T05:42:36.770435+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:42:36.770435+0000","last_undegraded":"2024-09-17T05:42:36.770435+0000","last_fullsized":"2024-09-17T05:42:36.770435+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:42:36.770435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:42:36.770435+0000","last_clean_scrub_stamp":"2024-09-17T05:42:36.770435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:42:37.772628+0000","last_change":"2024-09-17T05:42:37.772628+0000","last_active":"2024-09-17T05:42:37.772628+0000","last_peered":"2024-09-17T05:42:37.772628+0000","last_clean":"2024-09-17T05:42:37.772628+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:42:37.772628+0000","last_undegraded":"2024-09-17T05:42:37.772628+0000","last_fullsized":"2024-09-17T05:42:37.772628+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:42:37.772628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:42:37.772628+0000","last_clean_scrub_stamp":"2024-09-17T05:42:37.772628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":10,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T05:42:37.810634+0000","last_change":"2024-09-17T05:42:37.805790+0000","last_active":"2024-09-17T05:42:37.810634+0000","last_peered":"2024-09-17T05:42:37.810634+0000","last_clean":"2024-09-17T05:42:37.810634+0000","last_became_active":"2024-09-17T05:42:37.805423+0000","last_became_peered":"2024-09-17T05:42:37.805423+0000","last_unstale":"2024-09-17T05:42:37.810634+0000","last_undegraded":"2024-09-17T05:42:37.810634+0000","last_fullsized":"2024-09-17T05:42:37.810634+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:42:36.770435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:42:36.770435+0000","last_clean_scrub_stamp":"2024-09-17T05:42:36.770435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:53:44.743537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-09-17T05:42:37.792487+0000","last_change":"2024-09-17T05:42:37.792487+0000","last_active":"2024-09-17T05:42:37.772628+0000","last_peered":"2024-09-17T05:42:37.772628+0000","last_clean":"2024-09-17T05:42:37.772628+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:42:37.792487+0000","last_undegraded":"2024-09-17T05:42:37.792487+0000","last_fullsized":"2024-09-17T05:42:37.792487+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:42:37.772628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:42:37.772628+0000","last_clean_scrub_stamp":"2024-09-17T05:42:37.772628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:42:36.770435+0000","last_change":"2024-09-17T05:42:36.770435+0000","last_active":"2024-09-17T05:42:36.770435+0000","last_peered":"2024-09-17T05:42:36.770435+0000","last_clean":"2024-09-17T05:42:36.770435+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:42:36.770435+0000","last_undegraded":"2024-09-17T05:42:36.770435+0000","last_fullsized":"2024-09-17T05:42:36.770435+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:42:36.770435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:42:36.770435+0000","last_clean_scrub_stamp":"2024-09-17T05:42:36.770435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:42:37.772628+0000","last_change":"2024-09-17T05:42:37.772628+0000","last_active":"2024-09-17T05:42:37.772628+0000","last_peered":"2024-09-17T05:42:37.772628+0000","last_clean":"2024-09-17T05:42:37.772628+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:42:37.772628+0000","last_undegraded":"2024-09-17T05:42:37.772628+0000","last_fullsized":"2024-09-17T05:42:37.772628+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:42:37.772628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:42:37.772628+0000","last_clean_scrub_stamp":"2024-09-17T05:42:37.772628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":10,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T05:42:37.800315+0000","last_change":"2024-09-17T05:42:37.796847+0000","last_active":"2024-09-17T05:42:37.800315+0000","last_peered":"2024-09-17T05:42:37.800315+0000","last_clean":"2024-09-17T05:42:37.800315+0000","last_became_active":"2024-09-17T05:42:37.796077+0000","last_became_peered":"2024-09-17T05:42:37.796077+0000","last_unstale":"2024-09-17T05:42:37.800315+0000","last_undegraded":"2024-09-17T05:42:37.800315+0000","last_fullsized":"2024-09-17T05:42:37.800315+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:42:36.770435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:42:36.770435+0000","last_clean_scrub_stamp":"2024-09-17T05:42:36.770435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:36:15.516715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-09-17T05:42:37.791659+0000","last_change":"2024-09-17T05:42:37.791659+0000","last_active":"2024-09-17T05:42:37.772628+0000","last_peered":"2024-09-17T05:42:37.772628+0000","last_clean":"2024-09-17T05:42:37.772628+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:42:37.791659+0000","last_undegraded":"2024-09-17T05:42:37.791659+0000","last_fullsized":"2024-09-17T05:42:37.791659+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:42:37.772628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:42:37.772628+0000","last_clean_scrub_stamp":"2024-09-17T05:42:37.772628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:42:36.770435+0000","last_change":"2024-09-17T05:42:36.770435+0000","last_active":"2024-09-17T05:42:36.770435+0000","last_peered":"2024-09-17T05:42:36.770435+0000","last_clean":"2024-09-17T05:42:36.770435+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:42:36.770435+0000","last_undegraded":"2024-09-17T05:42:36.770435+0000","last_fullsized":"2024-09-17T05:42:36.770435+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:42:36.770435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:42:36.770435+0000","last_clean_scrub_stamp":"2024-09-17T05:42:36.770435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:42:37.772628+0000","last_change":"2024-09-17T05:42:37.772628+0000","last_active":"2024-09-17T05:42:37.772628+0000","last_peered":"2024-09-17T05:42:37.772628+0000","last_clean":"2024-09-17T05:42:37.772628+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:42:37.772628+0000","last_undegraded":"2024-09-17T05:42:37.772628+0000","last_fullsized":"2024-09-17T05:42:37.772628+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:42:37.772628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:42:37.772628+0000","last_clean_scrub_stamp":"2024-09-17T05:42:37.772628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:42:36.770435+0000","last_change":"2024-09-17T05:42:36.770435+0000","last_active":"2024-09-17T05:42:36.770435+0000","last_peered":"2024-09-17T05:42:36.770435+0000","last_clean":"2024-09-17T05:42:36.770435+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:42:36.770435+0000","last_undegraded":"2024-09-17T05:42:36.770435+0000","last_fullsized":"2024-09-17T05:42:36.770435+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:42:36.770435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:42:36.770435+0000","last_clean_scrub_stamp":"2024-09-17T05:42:36.770435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:42:37.772628+0000","last_change":"2024-09-17T05:42:37.772628+0000","last_active":"2024-09-17T05:42:37.772628+0000","last_peered":"2024-09-17T05:42:37.772628+0000","last_clean":"2024-09-17T05:42:37.772628+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:42:37.772628+0000","last_undegraded":"2024-09-17T05:42:37.772628+0000","last_fullsized":"2024-09-17T05:42:37.772628+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:42:37.772628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:42:37.772628+0000","last_clean_scrub_stamp":"2024-09-17T05:42:37.772628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:42:36.770435+0000","last_change":"2024-09-17T05:42:36.770435+0000","last_active":"2024-09-17T05:42:36.770435+0000","last_peered":"2024-09-17T05:42:36.770435+0000","last_clean":"2024-09-17T05:42:36.770435+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:42:36.770435+0000","last_undegraded":"2024-09-17T05:42:36.770435+0000","last_fullsized":"2024-09-17T05:42:36.770435+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:42:36.770435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:42:36.770435+0000","last_clean_scrub_stamp":"2024-09-17T05:42:36.770435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:42:37.772628+0000","last_change":"2024-09-17T05:42:37.772628+0000","last_active":"2024-09-17T05:42:37.772628+0000","last_peered":"2024-09-17T05:42:37.772628+0000","last_clean":"2024-09-17T05:42:37.772628+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:42:37.772628+0000","last_undegraded":"2024-09-17T05:42:37.772628+0000","last_fullsized":"2024-09-17T05:42:37.772628+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:42:37.772628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:42:37.772628+0000","last_clean_scrub_stamp":"2024-09-17T05:42:37.772628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-17T05:42:36.780020+0000","last_change":"2024-09-17T05:42:36.780020+0000","last_active":"2024-09-17T05:42:36.770435+0000","last_peered":"2024-09-17T05:42:36.770435+0000","last_clean":"2024-09-17T05:42:36.770435+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:42:36.780020+0000","last_undegraded":"2024-09-17T05:42:36.780020+0000","last_fullsized":"2024-09-17T05:42:36.780020+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:42:36.770435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:42:36.770435+0000","last_clean_scrub_stamp":"2024-09-17T05:42:36.770435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"19'72","reported_seq":122,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-17T05:42:34.245793+0000","last_change":"2024-09-17T05:41:48.539830+0000","last_active":"2024-09-17T05:42:34.245793+0000","last_peered":"2024-09-17T05:42:34.245793+0000","last_clean":"2024-09-17T05:42:34.245793+0000","last_became_active":"2024-09-17T05:41:48.538743+0000","last_became_peered":"2024-09-17T05:41:48.538743+0000","last_unstale":"2024-09-17T05:42:34.245793+0000","last_undegraded":"2024-09-17T05:42:34.245793+0000","last_fullsized":"2024-09-17T05:42:34.245793+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:47.152539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:47.152539+0000","last_clean_scrub_stamp":"2024-09-17T05:41:47.152539+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:08:02.952016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":8,"acting":8,"num_store_stats":1},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":2},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":16,"seq":68719476751,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27348,"kb_used_data":320,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344492,"statfs":{"total":96636764160,"available":96608759808,"internally_reserved":0,"allocated":327680,"data_stored":119860,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":7,"up_from":15,"seq":64424509455,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27932,"kb_used_data":900,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343908,"statfs":{"total":96636764160,"available":96608161792,"internally_reserved":0,"allocated":921600,"data_stored":710228,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509454,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27352,"kb_used_data":320,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344488,"statfs":{"total":96636764160,"available":96608755712,"internally_reserved":0,"allocated":327680,"data_stored":119860,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509454,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27360,"kb_used_data":320,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344480,"statfs":{"total":96636764160,"available":96608747520,"internally_reserved":0,"allocated":327680,"data_stored":119860,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509454,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27356,"kb_used_data":320,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344484,"statfs":{"total":96636764160,"available":96608751616,"internally_reserved":0,"allocated":327680,"data_stored":119860,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509454,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27348,"kb_used_data":320,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344492,"statfs":{"total":96636764160,"available":96608759808,"internally_reserved":0,"allocated":327680,"data_stored":119860,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509454,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27352,"kb_used_data":320,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344488,"statfs":{"total":96636764160,"available":96608755712,"internally_reserved":0,"allocated":327680,"data_stored":119860,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574862,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27940,"kb_used_data":912,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343900,"statfs":{"total":96636764160,"available":96608153600,"internally_reserved":0,"allocated":933888,"data_stored":716045,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-17T05:42:42.875 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-17T05:42:42.989 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:42.988+0000 7f05814b4640 1 -- 172.21.15.150:0/3897415553 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f057c0cf7c0 msgr2=0x7f057c0cfbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:42.989 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:42.988+0000 7f05814b4640 1 --2- 172.21.15.150:0/3897415553 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f057c0cf7c0 0x7f057c0cfbd0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f0564005fd0 tx=0x7f056402a530 comp rx=0 tx=0).stop 2024-09-17T05:42:42.989 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:42.988+0000 7f05814b4640 1 -- 172.21.15.150:0/3897415553 shutdown_connections 2024-09-17T05:42:42.989 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:42.988+0000 7f05814b4640 1 --2- 172.21.15.150:0/3897415553 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f057c0b5410 0x7f057c0b5820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:42.989 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:42.988+0000 7f05814b4640 1 --2- 172.21.15.150:0/3897415553 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f057c0cf7c0 0x7f057c0cfbd0 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:42.989 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:42.988+0000 7f05814b4640 1 -- 172.21.15.150:0/3897415553 >> 172.21.15.150:0/3897415553 conn(0x7f057c0b2fd0 msgr2=0x7f057c0b33e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:42:42.990 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:42.988+0000 7f05814b4640 1 -- 172.21.15.150:0/3897415553 shutdown_connections 2024-09-17T05:42:42.990 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:42.988+0000 7f05814b4640 1 -- 172.21.15.150:0/3897415553 wait complete. 2024-09-17T05:42:42.990 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:42.990+0000 7f05814b4640 1 Processor -- start 2024-09-17T05:42:42.990 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:42.990+0000 7f05814b4640 1 -- start start 2024-09-17T05:42:42.993 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:42.991+0000 7f05814b4640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f057c0b5410 0x7f057c1f18b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:42:42.993 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:42.991+0000 7f05814b4640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f057c0cf7c0 0x7f057c15a1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:42:42.993 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:42.991+0000 7f05814b4640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f057c15ee30 0x7f057c15a710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:42:42.993 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:42.991+0000 7f05814b4640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f057c0b61a0 con 0x7f057c15ee30 2024-09-17T05:42:42.993 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:42.991+0000 7f05814b4640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f057c0b6020 con 0x7f057c0cf7c0 2024-09-17T05:42:42.993 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:42.991+0000 7f05814b4640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f057c0b6320 con 0x7f057c0b5410 2024-09-17T05:42:42.993 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:42.991+0000 7f057b7fe640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f057c15ee30 0x7f057c15a710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:42:42.993 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:42.991+0000 7f057b7fe640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f057c15ee30 0x7f057c15a710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:59746/0 (socket says 172.21.15.150:59746) 2024-09-17T05:42:42.993 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:42.991+0000 7f057b7fe640 1 -- 172.21.15.150:0/1773445569 learned_addr learned my addr 172.21.15.150:0/1773445569 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:42:42.994 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:42.991+0000 7f05727fc640 1 --2- 172.21.15.150:0/1773445569 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f057c0cf7c0 0x7f057c15a1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:42:42.994 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:42.991+0000 7f057affd640 1 --2- 172.21.15.150:0/1773445569 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f057c0b5410 0x7f057c1f18b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:42:42.994 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:42.992+0000 7f057b7fe640 1 -- 172.21.15.150:0/1773445569 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f057c0b5410 msgr2=0x7f057c1f18b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:42.994 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:42.992+0000 7f057b7fe640 1 --2- 172.21.15.150:0/1773445569 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f057c0b5410 0x7f057c1f18b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:42.994 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:42.992+0000 7f057b7fe640 1 -- 172.21.15.150:0/1773445569 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f057c0cf7c0 msgr2=0x7f057c15a1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:42.994 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:42.992+0000 7f057b7fe640 1 --2- 172.21.15.150:0/1773445569 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f057c0cf7c0 0x7f057c15a1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:42.994 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:42.992+0000 7f057b7fe640 1 -- 172.21.15.150:0/1773445569 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f057c1f28d0 con 0x7f057c15ee30 2024-09-17T05:42:42.994 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:42.992+0000 7f057b7fe640 1 --2- 172.21.15.150:0/1773445569 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f057c15ee30 0x7f057c15a710 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f057400ca80 tx=0x7f057400cf40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:42:42.994 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:42.992+0000 7f0573fff640 1 -- 172.21.15.150:0/1773445569 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0574007d90 con 0x7f057c15ee30 2024-09-17T05:42:42.994 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:42.992+0000 7f0573fff640 1 -- 172.21.15.150:0/1773445569 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0574004c30 con 0x7f057c15ee30 2024-09-17T05:42:42.994 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:42.992+0000 7f05814b4640 1 -- 172.21.15.150:0/1773445569 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f057c14b510 con 0x7f057c15ee30 2024-09-17T05:42:42.994 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:42.992+0000 7f0573fff640 1 -- 172.21.15.150:0/1773445569 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0574005280 con 0x7f057c15ee30 2024-09-17T05:42:42.994 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:42.992+0000 7f05814b4640 1 -- 172.21.15.150:0/1773445569 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f057c0ccf50 con 0x7f057c15ee30 2024-09-17T05:42:42.995 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:42.993+0000 7f05814b4640 1 -- 172.21.15.150:0/1773445569 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f057c1f2360 con 0x7f057c15ee30 2024-09-17T05:42:42.995 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:42.994+0000 7f0573fff640 1 -- 172.21.15.150:0/1773445569 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f0574005420 con 0x7f057c15ee30 2024-09-17T05:42:42.995 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:42.994+0000 7f0573fff640 1 --2- 172.21.15.150:0/1773445569 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f055c078b90 0x7f055c07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:42:42.995 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:42.994+0000 7f0573fff640 1 -- 172.21.15.150:0/1773445569 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7f057409b760 con 0x7f057c15ee30 2024-09-17T05:42:42.996 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:42.994+0000 7f057affd640 1 --2- 172.21.15.150:0/1773445569 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f055c078b90 0x7f055c07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:42:42.996 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:42.995+0000 7f057affd640 1 --2- 172.21.15.150:0/1773445569 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f055c078b90 0x7f055c07b0a0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f056c006fd0 tx=0x7f056c009060 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:42:42.999 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:42.999+0000 7f0573fff640 1 -- 172.21.15.150:0/1773445569 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f0574014070 con 0x7f057c15ee30 2024-09-17T05:42:43.174 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:43.174+0000 7f05814b4640 1 -- 172.21.15.150:0/1773445569 --> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f057c0b0910 con 0x7f055c078b90 2024-09-17T05:42:43.179 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:43.178+0000 7f0573fff640 1 -- 172.21.15.150:0/1773445569 <== mgr.4108 v2:172.21.15.176:6800/3631216395 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251611 (secure 0 0 0) 0x7f057c0b0910 con 0x7f055c078b90 2024-09-17T05:42:43.181 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-09-17T05:42:43.183 INFO:teuthology.orchestra.run.smithi150.stderr:dumped all 2024-09-17T05:42:43.185 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:43.182+0000 7f05814b4640 1 -- 172.21.15.150:0/1773445569 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f055c078b90 msgr2=0x7f055c07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:43.185 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:43.182+0000 7f05814b4640 1 --2- 172.21.15.150:0/1773445569 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f055c078b90 0x7f055c07b0a0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f056c006fd0 tx=0x7f056c009060 comp rx=0 tx=0).stop 2024-09-17T05:42:43.185 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:43.182+0000 7f05814b4640 1 -- 172.21.15.150:0/1773445569 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f057c15ee30 msgr2=0x7f057c15a710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:43.185 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:43.182+0000 7f05814b4640 1 --2- 172.21.15.150:0/1773445569 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f057c15ee30 0x7f057c15a710 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f057400ca80 tx=0x7f057400cf40 comp rx=0 tx=0).stop 2024-09-17T05:42:43.185 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:43.182+0000 7f05814b4640 1 -- 172.21.15.150:0/1773445569 shutdown_connections 2024-09-17T05:42:43.185 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:43.182+0000 7f05814b4640 1 --2- 172.21.15.150:0/1773445569 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f057c0cf7c0 0x7f057c15a1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:43.185 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:43.182+0000 7f05814b4640 1 --2- 172.21.15.150:0/1773445569 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f055c078b90 0x7f055c07b0a0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:43.185 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:43.182+0000 7f05814b4640 1 --2- 172.21.15.150:0/1773445569 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f057c15ee30 0x7f057c15a710 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:43.185 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:43.182+0000 7f05814b4640 1 --2- 172.21.15.150:0/1773445569 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f057c0b5410 0x7f057c1f18b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:43.186 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:43.182+0000 7f05814b4640 1 -- 172.21.15.150:0/1773445569 >> 172.21.15.150:0/1773445569 conn(0x7f057c0b2fd0 msgr2=0x7f057c15d4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:42:43.186 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:43.182+0000 7f05814b4640 1 -- 172.21.15.150:0/1773445569 shutdown_connections 2024-09-17T05:42:43.186 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:43.182+0000 7f05814b4640 1 -- 172.21.15.150:0/1773445569 wait complete. 2024-09-17T05:42:43.194 INFO:teuthology.orchestra.run.smithi150.stdout:{"pg_ready":true,"pg_map":{"version":57,"stamp":"2024-09-17T05:42:42.853968+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":144,"num_write_kb":1642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":12,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":107,"ondisk_log_size":107,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":139,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":220340,"kb_used_data":4096,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754754380,"statfs":{"total":773094113280,"available":772868485120,"internally_reserved":0,"allocated":4194304,"data_stored":2307466,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":31,"apply_latency_ms":31,"commit_latency_ns":31000000,"apply_latency_ns":31000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":43,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":12,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001232"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-17T05:42:39.788326+0000","last_change":"2024-09-17T05:42:38.809600+0000","last_active":"2024-09-17T05:42:39.788326+0000","last_peered":"2024-09-17T05:42:39.788326+0000","last_clean":"2024-09-17T05:42:39.788326+0000","last_became_active":"2024-09-17T05:42:38.809252+0000","last_became_peered":"2024-09-17T05:42:38.809252+0000","last_unstale":"2024-09-17T05:42:39.788326+0000","last_undegraded":"2024-09-17T05:42:39.788326+0000","last_fullsized":"2024-09-17T05:42:39.788326+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:42:37.772628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:42:37.772628+0000","last_clean_scrub_stamp":"2024-09-17T05:42:37.772628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:29:00.810568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-17T05:42:39.787003+0000","last_change":"2024-09-17T05:42:38.810370+0000","last_active":"2024-09-17T05:42:39.787003+0000","last_peered":"2024-09-17T05:42:39.787003+0000","last_clean":"2024-09-17T05:42:39.787003+0000","last_became_active":"2024-09-17T05:42:38.809996+0000","last_became_peered":"2024-09-17T05:42:38.809996+0000","last_unstale":"2024-09-17T05:42:39.787003+0000","last_undegraded":"2024-09-17T05:42:39.787003+0000","last_fullsized":"2024-09-17T05:42:39.787003+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:42:37.772628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:42:37.772628+0000","last_clean_scrub_stamp":"2024-09-17T05:42:37.772628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:14:56.692341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-17T05:42:39.847318+0000","last_change":"2024-09-17T05:42:38.807299+0000","last_active":"2024-09-17T05:42:39.847318+0000","last_peered":"2024-09-17T05:42:39.847318+0000","last_clean":"2024-09-17T05:42:39.847318+0000","last_became_active":"2024-09-17T05:42:38.806807+0000","last_became_peered":"2024-09-17T05:42:38.806807+0000","last_unstale":"2024-09-17T05:42:39.847318+0000","last_undegraded":"2024-09-17T05:42:39.847318+0000","last_fullsized":"2024-09-17T05:42:39.847318+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:42:37.772628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:42:37.772628+0000","last_clean_scrub_stamp":"2024-09-17T05:42:37.772628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:48:13.659827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-17T05:42:40.797628+0000","last_change":"2024-09-17T05:42:38.818758+0000","last_active":"2024-09-17T05:42:40.797628+0000","last_peered":"2024-09-17T05:42:40.797628+0000","last_clean":"2024-09-17T05:42:40.797628+0000","last_became_active":"2024-09-17T05:42:38.817788+0000","last_became_peered":"2024-09-17T05:42:38.817788+0000","last_unstale":"2024-09-17T05:42:40.797628+0000","last_undegraded":"2024-09-17T05:42:40.797628+0000","last_fullsized":"2024-09-17T05:42:40.797628+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:42:37.772628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:42:37.772628+0000","last_clean_scrub_stamp":"2024-09-17T05:42:37.772628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:31:05.241317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-17T05:42:40.837070+0000","last_change":"2024-09-17T05:42:38.813119+0000","last_active":"2024-09-17T05:42:40.837070+0000","last_peered":"2024-09-17T05:42:40.837070+0000","last_clean":"2024-09-17T05:42:40.837070+0000","last_became_active":"2024-09-17T05:42:38.812772+0000","last_became_peered":"2024-09-17T05:42:38.812772+0000","last_unstale":"2024-09-17T05:42:40.837070+0000","last_undegraded":"2024-09-17T05:42:40.837070+0000","last_fullsized":"2024-09-17T05:42:40.837070+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:42:37.772628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:42:37.772628+0000","last_clean_scrub_stamp":"2024-09-17T05:42:37.772628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:29:08.669531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-17T05:42:39.786425+0000","last_change":"2024-09-17T05:42:38.816796+0000","last_active":"2024-09-17T05:42:39.786425+0000","last_peered":"2024-09-17T05:42:39.786425+0000","last_clean":"2024-09-17T05:42:39.786425+0000","last_became_active":"2024-09-17T05:42:38.816470+0000","last_became_peered":"2024-09-17T05:42:38.816470+0000","last_unstale":"2024-09-17T05:42:39.786425+0000","last_undegraded":"2024-09-17T05:42:39.786425+0000","last_fullsized":"2024-09-17T05:42:39.786425+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:42:37.772628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:42:37.772628+0000","last_clean_scrub_stamp":"2024-09-17T05:42:37.772628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:56:23.468850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-17T05:42:39.789536+0000","last_change":"2024-09-17T05:42:38.802573+0000","last_active":"2024-09-17T05:42:39.789536+0000","last_peered":"2024-09-17T05:42:39.789536+0000","last_clean":"2024-09-17T05:42:39.789536+0000","last_became_active":"2024-09-17T05:42:38.802290+0000","last_became_peered":"2024-09-17T05:42:38.802290+0000","last_unstale":"2024-09-17T05:42:39.789536+0000","last_undegraded":"2024-09-17T05:42:39.789536+0000","last_fullsized":"2024-09-17T05:42:39.789536+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:42:37.772628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:42:37.772628+0000","last_clean_scrub_stamp":"2024-09-17T05:42:37.772628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:45:42.335613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-17T05:42:39.788983+0000","last_change":"2024-09-17T05:42:38.804796+0000","last_active":"2024-09-17T05:42:39.788983+0000","last_peered":"2024-09-17T05:42:39.788983+0000","last_clean":"2024-09-17T05:42:39.788983+0000","last_became_active":"2024-09-17T05:42:38.804489+0000","last_became_peered":"2024-09-17T05:42:38.804489+0000","last_unstale":"2024-09-17T05:42:39.788983+0000","last_undegraded":"2024-09-17T05:42:39.788983+0000","last_fullsized":"2024-09-17T05:42:39.788983+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:42:37.772628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:42:37.772628+0000","last_clean_scrub_stamp":"2024-09-17T05:42:37.772628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:44:58.328573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-17T05:42:40.522284+0000","last_change":"2024-09-17T05:42:38.811030+0000","last_active":"2024-09-17T05:42:40.522284+0000","last_peered":"2024-09-17T05:42:40.522284+0000","last_clean":"2024-09-17T05:42:40.522284+0000","last_became_active":"2024-09-17T05:42:38.810688+0000","last_became_peered":"2024-09-17T05:42:38.810688+0000","last_unstale":"2024-09-17T05:42:40.522284+0000","last_undegraded":"2024-09-17T05:42:40.522284+0000","last_fullsized":"2024-09-17T05:42:40.522284+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:42:37.772628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:42:37.772628+0000","last_clean_scrub_stamp":"2024-09-17T05:42:37.772628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:21:58.970437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-17T05:42:40.797911+0000","last_change":"2024-09-17T05:42:38.818223+0000","last_active":"2024-09-17T05:42:40.797911+0000","last_peered":"2024-09-17T05:42:40.797911+0000","last_clean":"2024-09-17T05:42:40.797911+0000","last_became_active":"2024-09-17T05:42:38.817887+0000","last_became_peered":"2024-09-17T05:42:38.817887+0000","last_unstale":"2024-09-17T05:42:40.797911+0000","last_undegraded":"2024-09-17T05:42:40.797911+0000","last_fullsized":"2024-09-17T05:42:40.797911+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:42:37.772628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:42:37.772628+0000","last_clean_scrub_stamp":"2024-09-17T05:42:37.772628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:56:29.121255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-17T05:42:39.789271+0000","last_change":"2024-09-17T05:42:38.811781+0000","last_active":"2024-09-17T05:42:39.789271+0000","last_peered":"2024-09-17T05:42:39.789271+0000","last_clean":"2024-09-17T05:42:39.789271+0000","last_became_active":"2024-09-17T05:42:38.811496+0000","last_became_peered":"2024-09-17T05:42:38.811496+0000","last_unstale":"2024-09-17T05:42:39.789271+0000","last_undegraded":"2024-09-17T05:42:39.789271+0000","last_fullsized":"2024-09-17T05:42:39.789271+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:42:37.772628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:42:37.772628+0000","last_clean_scrub_stamp":"2024-09-17T05:42:37.772628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:14:51.758783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-17T05:42:39.847447+0000","last_change":"2024-09-17T05:42:38.815672+0000","last_active":"2024-09-17T05:42:39.847447+0000","last_peered":"2024-09-17T05:42:39.847447+0000","last_clean":"2024-09-17T05:42:39.847447+0000","last_became_active":"2024-09-17T05:42:38.815304+0000","last_became_peered":"2024-09-17T05:42:38.815304+0000","last_unstale":"2024-09-17T05:42:39.847447+0000","last_undegraded":"2024-09-17T05:42:39.847447+0000","last_fullsized":"2024-09-17T05:42:39.847447+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:42:37.772628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:42:37.772628+0000","last_clean_scrub_stamp":"2024-09-17T05:42:37.772628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:45:42.335613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-17T05:42:40.837016+0000","last_change":"2024-09-17T05:42:38.811245+0000","last_active":"2024-09-17T05:42:40.837016+0000","last_peered":"2024-09-17T05:42:40.837016+0000","last_clean":"2024-09-17T05:42:40.837016+0000","last_became_active":"2024-09-17T05:42:38.809546+0000","last_became_peered":"2024-09-17T05:42:38.809546+0000","last_unstale":"2024-09-17T05:42:40.837016+0000","last_undegraded":"2024-09-17T05:42:40.837016+0000","last_fullsized":"2024-09-17T05:42:40.837016+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:42:37.772628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:42:37.772628+0000","last_clean_scrub_stamp":"2024-09-17T05:42:37.772628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:49:05.954213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-17T05:42:39.786411+0000","last_change":"2024-09-17T05:42:38.817500+0000","last_active":"2024-09-17T05:42:39.786411+0000","last_peered":"2024-09-17T05:42:39.786411+0000","last_clean":"2024-09-17T05:42:39.786411+0000","last_became_active":"2024-09-17T05:42:38.816684+0000","last_became_peered":"2024-09-17T05:42:38.816684+0000","last_unstale":"2024-09-17T05:42:39.786411+0000","last_undegraded":"2024-09-17T05:42:39.786411+0000","last_fullsized":"2024-09-17T05:42:39.786411+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:42:37.772628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:42:37.772628+0000","last_clean_scrub_stamp":"2024-09-17T05:42:37.772628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:59:25.322085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-17T05:42:39.847253+0000","last_change":"2024-09-17T05:42:38.804339+0000","last_active":"2024-09-17T05:42:39.847253+0000","last_peered":"2024-09-17T05:42:39.847253+0000","last_clean":"2024-09-17T05:42:39.847253+0000","last_became_active":"2024-09-17T05:42:38.803924+0000","last_became_peered":"2024-09-17T05:42:38.803924+0000","last_unstale":"2024-09-17T05:42:39.847253+0000","last_undegraded":"2024-09-17T05:42:39.847253+0000","last_fullsized":"2024-09-17T05:42:39.847253+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:42:37.772628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:42:37.772628+0000","last_clean_scrub_stamp":"2024-09-17T05:42:37.772628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:06:11.277950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-17T05:42:39.789462+0000","last_change":"2024-09-17T05:42:38.815849+0000","last_active":"2024-09-17T05:42:39.789462+0000","last_peered":"2024-09-17T05:42:39.789462+0000","last_clean":"2024-09-17T05:42:39.789462+0000","last_became_active":"2024-09-17T05:42:38.815296+0000","last_became_peered":"2024-09-17T05:42:38.815296+0000","last_unstale":"2024-09-17T05:42:39.789462+0000","last_undegraded":"2024-09-17T05:42:39.789462+0000","last_fullsized":"2024-09-17T05:42:39.789462+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:42:37.772628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:42:37.772628+0000","last_clean_scrub_stamp":"2024-09-17T05:42:37.772628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:56:23.468850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-17T05:42:39.789530+0000","last_change":"2024-09-17T05:42:38.803948+0000","last_active":"2024-09-17T05:42:39.789530+0000","last_peered":"2024-09-17T05:42:39.789530+0000","last_clean":"2024-09-17T05:42:39.789530+0000","last_became_active":"2024-09-17T05:42:38.803640+0000","last_became_peered":"2024-09-17T05:42:38.803640+0000","last_unstale":"2024-09-17T05:42:39.789530+0000","last_undegraded":"2024-09-17T05:42:39.789530+0000","last_fullsized":"2024-09-17T05:42:39.789530+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:42:37.772628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:42:37.772628+0000","last_clean_scrub_stamp":"2024-09-17T05:42:37.772628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:01:56.852587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-17T05:42:39.787019+0000","last_change":"2024-09-17T05:42:38.820211+0000","last_active":"2024-09-17T05:42:39.787019+0000","last_peered":"2024-09-17T05:42:39.787019+0000","last_clean":"2024-09-17T05:42:39.787019+0000","last_became_active":"2024-09-17T05:42:38.819891+0000","last_became_peered":"2024-09-17T05:42:38.819891+0000","last_unstale":"2024-09-17T05:42:39.787019+0000","last_undegraded":"2024-09-17T05:42:39.787019+0000","last_fullsized":"2024-09-17T05:42:39.787019+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:42:37.772628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:42:37.772628+0000","last_clean_scrub_stamp":"2024-09-17T05:42:37.772628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:00:28.428098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-17T05:42:39.786739+0000","last_change":"2024-09-17T05:42:38.820057+0000","last_active":"2024-09-17T05:42:39.786739+0000","last_peered":"2024-09-17T05:42:39.786739+0000","last_clean":"2024-09-17T05:42:39.786739+0000","last_became_active":"2024-09-17T05:42:38.819752+0000","last_became_peered":"2024-09-17T05:42:38.819752+0000","last_unstale":"2024-09-17T05:42:39.786739+0000","last_undegraded":"2024-09-17T05:42:39.786739+0000","last_fullsized":"2024-09-17T05:42:39.786739+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:42:37.772628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:42:37.772628+0000","last_clean_scrub_stamp":"2024-09-17T05:42:37.772628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:57:09.386461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-17T05:42:40.837357+0000","last_change":"2024-09-17T05:42:38.809007+0000","last_active":"2024-09-17T05:42:40.837357+0000","last_peered":"2024-09-17T05:42:40.837357+0000","last_clean":"2024-09-17T05:42:40.837357+0000","last_became_active":"2024-09-17T05:42:38.808669+0000","last_became_peered":"2024-09-17T05:42:38.808669+0000","last_unstale":"2024-09-17T05:42:40.837357+0000","last_undegraded":"2024-09-17T05:42:40.837357+0000","last_fullsized":"2024-09-17T05:42:40.837357+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:42:37.772628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:42:37.772628+0000","last_clean_scrub_stamp":"2024-09-17T05:42:37.772628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:57:21.510110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-17T05:42:40.521773+0000","last_change":"2024-09-17T05:42:38.802973+0000","last_active":"2024-09-17T05:42:40.521773+0000","last_peered":"2024-09-17T05:42:40.521773+0000","last_clean":"2024-09-17T05:42:40.521773+0000","last_became_active":"2024-09-17T05:42:38.802601+0000","last_became_peered":"2024-09-17T05:42:38.802601+0000","last_unstale":"2024-09-17T05:42:40.521773+0000","last_undegraded":"2024-09-17T05:42:40.521773+0000","last_fullsized":"2024-09-17T05:42:40.521773+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:42:37.772628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:42:37.772628+0000","last_clean_scrub_stamp":"2024-09-17T05:42:37.772628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:50:47.581671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-17T05:42:40.521996+0000","last_change":"2024-09-17T05:42:38.813252+0000","last_active":"2024-09-17T05:42:40.521996+0000","last_peered":"2024-09-17T05:42:40.521996+0000","last_clean":"2024-09-17T05:42:40.521996+0000","last_became_active":"2024-09-17T05:42:38.812790+0000","last_became_peered":"2024-09-17T05:42:38.812790+0000","last_unstale":"2024-09-17T05:42:40.521996+0000","last_undegraded":"2024-09-17T05:42:40.521996+0000","last_fullsized":"2024-09-17T05:42:40.521996+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:42:37.772628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:42:37.772628+0000","last_clean_scrub_stamp":"2024-09-17T05:42:37.772628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:46:13.440636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-09-17T05:42:37.787939+0000","last_change":"2024-09-17T05:42:37.787939+0000","last_active":"2024-09-17T05:42:37.772628+0000","last_peered":"2024-09-17T05:42:37.772628+0000","last_clean":"2024-09-17T05:42:37.772628+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:42:37.787939+0000","last_undegraded":"2024-09-17T05:42:37.787939+0000","last_fullsized":"2024-09-17T05:42:37.787939+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:42:37.772628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:42:37.772628+0000","last_clean_scrub_stamp":"2024-09-17T05:42:37.772628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-17T05:42:39.847210+0000","last_change":"2024-09-17T05:42:38.808579+0000","last_active":"2024-09-17T05:42:39.847210+0000","last_peered":"2024-09-17T05:42:39.847210+0000","last_clean":"2024-09-17T05:42:39.847210+0000","last_became_active":"2024-09-17T05:42:38.808256+0000","last_became_peered":"2024-09-17T05:42:38.808256+0000","last_unstale":"2024-09-17T05:42:39.847210+0000","last_undegraded":"2024-09-17T05:42:39.847210+0000","last_fullsized":"2024-09-17T05:42:39.847210+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:42:37.772628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:42:37.772628+0000","last_clean_scrub_stamp":"2024-09-17T05:42:37.772628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:05:21.436685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-17T05:42:40.798046+0000","last_change":"2024-09-17T05:42:38.804818+0000","last_active":"2024-09-17T05:42:40.798046+0000","last_peered":"2024-09-17T05:42:40.798046+0000","last_clean":"2024-09-17T05:42:40.798046+0000","last_became_active":"2024-09-17T05:42:38.804487+0000","last_became_peered":"2024-09-17T05:42:38.804487+0000","last_unstale":"2024-09-17T05:42:40.798046+0000","last_undegraded":"2024-09-17T05:42:40.798046+0000","last_fullsized":"2024-09-17T05:42:40.798046+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:42:37.772628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:42:37.772628+0000","last_clean_scrub_stamp":"2024-09-17T05:42:37.772628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:11:24.017133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-17T05:42:39.787129+0000","last_change":"2024-09-17T05:42:38.812656+0000","last_active":"2024-09-17T05:42:39.787129+0000","last_peered":"2024-09-17T05:42:39.787129+0000","last_clean":"2024-09-17T05:42:39.787129+0000","last_became_active":"2024-09-17T05:42:38.812215+0000","last_became_peered":"2024-09-17T05:42:38.812215+0000","last_unstale":"2024-09-17T05:42:39.787129+0000","last_undegraded":"2024-09-17T05:42:39.787129+0000","last_fullsized":"2024-09-17T05:42:39.787129+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:42:37.772628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:42:37.772628+0000","last_clean_scrub_stamp":"2024-09-17T05:42:37.772628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:01:06.983156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-17T05:42:40.798003+0000","last_change":"2024-09-17T05:42:38.818086+0000","last_active":"2024-09-17T05:42:40.798003+0000","last_peered":"2024-09-17T05:42:40.798003+0000","last_clean":"2024-09-17T05:42:40.798003+0000","last_became_active":"2024-09-17T05:42:38.817663+0000","last_became_peered":"2024-09-17T05:42:38.817663+0000","last_unstale":"2024-09-17T05:42:40.798003+0000","last_undegraded":"2024-09-17T05:42:40.798003+0000","last_fullsized":"2024-09-17T05:42:40.798003+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:42:37.772628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:42:37.772628+0000","last_clean_scrub_stamp":"2024-09-17T05:42:37.772628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:05:21.436685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-17T05:42:39.847443+0000","last_change":"2024-09-17T05:42:38.805594+0000","last_active":"2024-09-17T05:42:39.847443+0000","last_peered":"2024-09-17T05:42:39.847443+0000","last_clean":"2024-09-17T05:42:39.847443+0000","last_became_active":"2024-09-17T05:42:38.804957+0000","last_became_peered":"2024-09-17T05:42:38.804957+0000","last_unstale":"2024-09-17T05:42:39.847443+0000","last_undegraded":"2024-09-17T05:42:39.847443+0000","last_fullsized":"2024-09-17T05:42:39.847443+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:42:37.772628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:42:37.772628+0000","last_clean_scrub_stamp":"2024-09-17T05:42:37.772628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:56:23.468850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-17T05:42:40.521839+0000","last_change":"2024-09-17T05:42:38.814787+0000","last_active":"2024-09-17T05:42:40.521839+0000","last_peered":"2024-09-17T05:42:40.521839+0000","last_clean":"2024-09-17T05:42:40.521839+0000","last_became_active":"2024-09-17T05:42:38.814444+0000","last_became_peered":"2024-09-17T05:42:38.814444+0000","last_unstale":"2024-09-17T05:42:40.521839+0000","last_undegraded":"2024-09-17T05:42:40.521839+0000","last_fullsized":"2024-09-17T05:42:40.521839+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:42:37.772628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:42:37.772628+0000","last_clean_scrub_stamp":"2024-09-17T05:42:37.772628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:33:11.874170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-17T05:42:39.788977+0000","last_change":"2024-09-17T05:42:38.800573+0000","last_active":"2024-09-17T05:42:39.788977+0000","last_peered":"2024-09-17T05:42:39.788977+0000","last_clean":"2024-09-17T05:42:39.788977+0000","last_became_active":"2024-09-17T05:42:38.800170+0000","last_became_peered":"2024-09-17T05:42:38.800170+0000","last_unstale":"2024-09-17T05:42:39.788977+0000","last_undegraded":"2024-09-17T05:42:39.788977+0000","last_fullsized":"2024-09-17T05:42:39.788977+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:42:37.772628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:42:37.772628+0000","last_clean_scrub_stamp":"2024-09-17T05:42:37.772628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:11:24.017133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-17T05:42:39.787984+0000","last_change":"2024-09-17T05:42:38.798553+0000","last_active":"2024-09-17T05:42:39.787984+0000","last_peered":"2024-09-17T05:42:39.787984+0000","last_clean":"2024-09-17T05:42:39.787984+0000","last_became_active":"2024-09-17T05:42:38.798026+0000","last_became_peered":"2024-09-17T05:42:38.798026+0000","last_unstale":"2024-09-17T05:42:39.787984+0000","last_undegraded":"2024-09-17T05:42:39.787984+0000","last_fullsized":"2024-09-17T05:42:39.787984+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:42:37.772628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:42:37.772628+0000","last_clean_scrub_stamp":"2024-09-17T05:42:37.772628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:35:43.722989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-17T05:42:39.788784+0000","last_change":"2024-09-17T05:42:38.809055+0000","last_active":"2024-09-17T05:42:39.788784+0000","last_peered":"2024-09-17T05:42:39.788784+0000","last_clean":"2024-09-17T05:42:39.788784+0000","last_became_active":"2024-09-17T05:42:38.808725+0000","last_became_peered":"2024-09-17T05:42:38.808725+0000","last_unstale":"2024-09-17T05:42:39.788784+0000","last_undegraded":"2024-09-17T05:42:39.788784+0000","last_fullsized":"2024-09-17T05:42:39.788784+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:42:37.772628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:42:37.772628+0000","last_clean_scrub_stamp":"2024-09-17T05:42:37.772628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:56:29.121255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-09-17T05:42:37.793868+0000","last_change":"2024-09-17T05:42:37.793868+0000","last_active":"2024-09-17T05:42:37.772628+0000","last_peered":"2024-09-17T05:42:37.772628+0000","last_clean":"2024-09-17T05:42:37.772628+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:42:37.793868+0000","last_undegraded":"2024-09-17T05:42:37.793868+0000","last_fullsized":"2024-09-17T05:42:37.793868+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:42:37.772628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:42:37.772628+0000","last_clean_scrub_stamp":"2024-09-17T05:42:37.772628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"33'4","reported_seq":19,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-17T05:42:39.788402+0000","last_change":"2024-09-17T05:42:37.796176+0000","last_active":"2024-09-17T05:42:39.788402+0000","last_peered":"2024-09-17T05:42:39.788402+0000","last_clean":"2024-09-17T05:42:39.788402+0000","last_became_active":"2024-09-17T05:42:37.795881+0000","last_became_peered":"2024-09-17T05:42:37.795881+0000","last_unstale":"2024-09-17T05:42:39.788402+0000","last_undegraded":"2024-09-17T05:42:39.788402+0000","last_fullsized":"2024-09-17T05:42:39.788402+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:42:36.770435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:42:36.770435+0000","last_clean_scrub_stamp":"2024-09-17T05:42:36.770435+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:56:54.491587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-17T05:42:39.788424+0000","last_change":"2024-09-17T05:42:38.809796+0000","last_active":"2024-09-17T05:42:39.788424+0000","last_peered":"2024-09-17T05:42:39.788424+0000","last_clean":"2024-09-17T05:42:39.788424+0000","last_became_active":"2024-09-17T05:42:38.809498+0000","last_became_peered":"2024-09-17T05:42:38.809498+0000","last_unstale":"2024-09-17T05:42:39.788424+0000","last_undegraded":"2024-09-17T05:42:39.788424+0000","last_fullsized":"2024-09-17T05:42:39.788424+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:42:37.772628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:42:37.772628+0000","last_clean_scrub_stamp":"2024-09-17T05:42:37.772628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:31:04.584637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":10,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T05:42:37.805843+0000","last_change":"2024-09-17T05:42:37.802980+0000","last_active":"2024-09-17T05:42:37.805843+0000","last_peered":"2024-09-17T05:42:37.805843+0000","last_clean":"2024-09-17T05:42:37.805843+0000","last_became_active":"2024-09-17T05:42:37.802617+0000","last_became_peered":"2024-09-17T05:42:37.802617+0000","last_unstale":"2024-09-17T05:42:37.805843+0000","last_undegraded":"2024-09-17T05:42:37.805843+0000","last_fullsized":"2024-09-17T05:42:37.805843+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:42:36.770435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:42:36.770435+0000","last_clean_scrub_stamp":"2024-09-17T05:42:36.770435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:53:27.876127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-17T05:42:40.522249+0000","last_change":"2024-09-17T05:42:38.818122+0000","last_active":"2024-09-17T05:42:40.522249+0000","last_peered":"2024-09-17T05:42:40.522249+0000","last_clean":"2024-09-17T05:42:40.522249+0000","last_became_active":"2024-09-17T05:42:38.817832+0000","last_became_peered":"2024-09-17T05:42:38.817832+0000","last_unstale":"2024-09-17T05:42:40.522249+0000","last_undegraded":"2024-09-17T05:42:40.522249+0000","last_fullsized":"2024-09-17T05:42:40.522249+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:42:37.772628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:42:37.772628+0000","last_clean_scrub_stamp":"2024-09-17T05:42:37.772628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:57:09.672673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"33'2","reported_seq":17,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-17T05:42:39.786857+0000","last_change":"2024-09-17T05:42:37.805183+0000","last_active":"2024-09-17T05:42:39.786857+0000","last_peered":"2024-09-17T05:42:39.786857+0000","last_clean":"2024-09-17T05:42:39.786857+0000","last_became_active":"2024-09-17T05:42:37.804856+0000","last_became_peered":"2024-09-17T05:42:37.804856+0000","last_unstale":"2024-09-17T05:42:39.786857+0000","last_undegraded":"2024-09-17T05:42:39.786857+0000","last_fullsized":"2024-09-17T05:42:39.786857+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:42:36.770435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:42:36.770435+0000","last_clean_scrub_stamp":"2024-09-17T05:42:36.770435+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:53:13.976559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-17T05:42:40.798052+0000","last_change":"2024-09-17T05:42:38.811881+0000","last_active":"2024-09-17T05:42:40.798052+0000","last_peered":"2024-09-17T05:42:40.798052+0000","last_clean":"2024-09-17T05:42:40.798052+0000","last_became_active":"2024-09-17T05:42:38.809272+0000","last_became_peered":"2024-09-17T05:42:38.809272+0000","last_unstale":"2024-09-17T05:42:40.798052+0000","last_undegraded":"2024-09-17T05:42:40.798052+0000","last_fullsized":"2024-09-17T05:42:40.798052+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:42:37.772628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:42:37.772628+0000","last_clean_scrub_stamp":"2024-09-17T05:42:37.772628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:06:11.277950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"33'2","reported_seq":17,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-17T05:42:40.837089+0000","last_change":"2024-09-17T05:42:37.806873+0000","last_active":"2024-09-17T05:42:40.837089+0000","last_peered":"2024-09-17T05:42:40.837089+0000","last_clean":"2024-09-17T05:42:40.837089+0000","last_became_active":"2024-09-17T05:42:37.806489+0000","last_became_peered":"2024-09-17T05:42:37.806489+0000","last_unstale":"2024-09-17T05:42:40.837089+0000","last_undegraded":"2024-09-17T05:42:40.837089+0000","last_fullsized":"2024-09-17T05:42:40.837089+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:42:36.770435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:42:36.770435+0000","last_clean_scrub_stamp":"2024-09-17T05:42:36.770435+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:56:33.527829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-17T05:42:39.789063+0000","last_change":"2024-09-17T05:42:38.810130+0000","last_active":"2024-09-17T05:42:39.789063+0000","last_peered":"2024-09-17T05:42:39.789063+0000","last_clean":"2024-09-17T05:42:39.789063+0000","last_became_active":"2024-09-17T05:42:38.809795+0000","last_became_peered":"2024-09-17T05:42:38.809795+0000","last_unstale":"2024-09-17T05:42:39.789063+0000","last_undegraded":"2024-09-17T05:42:39.789063+0000","last_fullsized":"2024-09-17T05:42:39.789063+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:42:37.772628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:42:37.772628+0000","last_clean_scrub_stamp":"2024-09-17T05:42:37.772628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:48:42.385641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"33'1","reported_seq":16,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-17T05:42:40.521934+0000","last_change":"2024-09-17T05:42:37.801623+0000","last_active":"2024-09-17T05:42:40.521934+0000","last_peered":"2024-09-17T05:42:40.521934+0000","last_clean":"2024-09-17T05:42:40.521934+0000","last_became_active":"2024-09-17T05:42:37.801212+0000","last_became_peered":"2024-09-17T05:42:37.801212+0000","last_unstale":"2024-09-17T05:42:40.521934+0000","last_undegraded":"2024-09-17T05:42:40.521934+0000","last_fullsized":"2024-09-17T05:42:40.521934+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:42:36.770435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:42:36.770435+0000","last_clean_scrub_stamp":"2024-09-17T05:42:36.770435+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:15:14.631270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-17T05:42:39.847267+0000","last_change":"2024-09-17T05:42:38.804702+0000","last_active":"2024-09-17T05:42:39.847267+0000","last_peered":"2024-09-17T05:42:39.847267+0000","last_clean":"2024-09-17T05:42:39.847267+0000","last_became_active":"2024-09-17T05:42:38.804359+0000","last_became_peered":"2024-09-17T05:42:38.804359+0000","last_unstale":"2024-09-17T05:42:39.847267+0000","last_undegraded":"2024-09-17T05:42:39.847267+0000","last_fullsized":"2024-09-17T05:42:39.847267+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:42:37.772628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:42:37.772628+0000","last_clean_scrub_stamp":"2024-09-17T05:42:37.772628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:50:12.834179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"33'1","reported_seq":16,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-17T05:42:40.522053+0000","last_change":"2024-09-17T05:42:37.797062+0000","last_active":"2024-09-17T05:42:40.522053+0000","last_peered":"2024-09-17T05:42:40.522053+0000","last_clean":"2024-09-17T05:42:40.522053+0000","last_became_active":"2024-09-17T05:42:37.796412+0000","last_became_peered":"2024-09-17T05:42:37.796412+0000","last_unstale":"2024-09-17T05:42:40.522053+0000","last_undegraded":"2024-09-17T05:42:40.522053+0000","last_fullsized":"2024-09-17T05:42:40.522053+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:42:36.770435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:42:36.770435+0000","last_clean_scrub_stamp":"2024-09-17T05:42:36.770435+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:28:00.710578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-17T05:42:40.521717+0000","last_change":"2024-09-17T05:42:38.800340+0000","last_active":"2024-09-17T05:42:40.521717+0000","last_peered":"2024-09-17T05:42:40.521717+0000","last_clean":"2024-09-17T05:42:40.521717+0000","last_became_active":"2024-09-17T05:42:38.798319+0000","last_became_peered":"2024-09-17T05:42:38.798319+0000","last_unstale":"2024-09-17T05:42:40.521717+0000","last_undegraded":"2024-09-17T05:42:40.521717+0000","last_fullsized":"2024-09-17T05:42:40.521717+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:42:37.772628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:42:37.772628+0000","last_clean_scrub_stamp":"2024-09-17T05:42:37.772628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:51:50.260513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":15,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-17T05:42:39.786151+0000","last_change":"2024-09-17T05:42:37.798675+0000","last_active":"2024-09-17T05:42:39.786151+0000","last_peered":"2024-09-17T05:42:39.786151+0000","last_clean":"2024-09-17T05:42:39.786151+0000","last_became_active":"2024-09-17T05:42:37.798337+0000","last_became_peered":"2024-09-17T05:42:37.798337+0000","last_unstale":"2024-09-17T05:42:39.786151+0000","last_undegraded":"2024-09-17T05:42:39.786151+0000","last_fullsized":"2024-09-17T05:42:39.786151+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:42:36.770435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:42:36.770435+0000","last_clean_scrub_stamp":"2024-09-17T05:42:36.770435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:26:38.326684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-17T05:42:40.797420+0000","last_change":"2024-09-17T05:42:38.812209+0000","last_active":"2024-09-17T05:42:40.797420+0000","last_peered":"2024-09-17T05:42:40.797420+0000","last_clean":"2024-09-17T05:42:40.797420+0000","last_became_active":"2024-09-17T05:42:38.811493+0000","last_became_peered":"2024-09-17T05:42:38.811493+0000","last_unstale":"2024-09-17T05:42:40.797420+0000","last_undegraded":"2024-09-17T05:42:40.797420+0000","last_fullsized":"2024-09-17T05:42:40.797420+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:42:37.772628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:42:37.772628+0000","last_clean_scrub_stamp":"2024-09-17T05:42:37.772628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:57:09.672673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":15,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-17T05:42:40.521535+0000","last_change":"2024-09-17T05:42:37.795964+0000","last_active":"2024-09-17T05:42:40.521535+0000","last_peered":"2024-09-17T05:42:40.521535+0000","last_clean":"2024-09-17T05:42:40.521535+0000","last_became_active":"2024-09-17T05:42:37.795311+0000","last_became_peered":"2024-09-17T05:42:37.795311+0000","last_unstale":"2024-09-17T05:42:40.521535+0000","last_undegraded":"2024-09-17T05:42:40.521535+0000","last_fullsized":"2024-09-17T05:42:40.521535+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:42:36.770435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:42:36.770435+0000","last_clean_scrub_stamp":"2024-09-17T05:42:36.770435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:57:20.507917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-17T05:42:39.847619+0000","last_change":"2024-09-17T05:42:38.812068+0000","last_active":"2024-09-17T05:42:39.847619+0000","last_peered":"2024-09-17T05:42:39.847619+0000","last_clean":"2024-09-17T05:42:39.847619+0000","last_became_active":"2024-09-17T05:42:38.811455+0000","last_became_peered":"2024-09-17T05:42:38.811455+0000","last_unstale":"2024-09-17T05:42:39.847619+0000","last_undegraded":"2024-09-17T05:42:39.847619+0000","last_fullsized":"2024-09-17T05:42:39.847619+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:42:37.772628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:42:37.772628+0000","last_clean_scrub_stamp":"2024-09-17T05:42:37.772628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:37:11.138729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":15,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-17T05:42:39.786891+0000","last_change":"2024-09-17T05:42:37.803872+0000","last_active":"2024-09-17T05:42:39.786891+0000","last_peered":"2024-09-17T05:42:39.786891+0000","last_clean":"2024-09-17T05:42:39.786891+0000","last_became_active":"2024-09-17T05:42:37.803571+0000","last_became_peered":"2024-09-17T05:42:37.803571+0000","last_unstale":"2024-09-17T05:42:39.786891+0000","last_undegraded":"2024-09-17T05:42:39.786891+0000","last_fullsized":"2024-09-17T05:42:39.786891+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:42:36.770435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:42:36.770435+0000","last_clean_scrub_stamp":"2024-09-17T05:42:36.770435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:18:31.876866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-17T05:42:39.786932+0000","last_change":"2024-09-17T05:42:38.820069+0000","last_active":"2024-09-17T05:42:39.786932+0000","last_peered":"2024-09-17T05:42:39.786932+0000","last_clean":"2024-09-17T05:42:39.786932+0000","last_became_active":"2024-09-17T05:42:38.819408+0000","last_became_peered":"2024-09-17T05:42:38.819408+0000","last_unstale":"2024-09-17T05:42:39.786932+0000","last_undegraded":"2024-09-17T05:42:39.786932+0000","last_fullsized":"2024-09-17T05:42:39.786932+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:42:37.772628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:42:37.772628+0000","last_clean_scrub_stamp":"2024-09-17T05:42:37.772628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:19:00.631236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":10,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T05:42:37.805813+0000","last_change":"2024-09-17T05:42:37.802055+0000","last_active":"2024-09-17T05:42:37.805813+0000","last_peered":"2024-09-17T05:42:37.805813+0000","last_clean":"2024-09-17T05:42:37.805813+0000","last_became_active":"2024-09-17T05:42:37.801718+0000","last_became_peered":"2024-09-17T05:42:37.801718+0000","last_unstale":"2024-09-17T05:42:37.805813+0000","last_undegraded":"2024-09-17T05:42:37.805813+0000","last_fullsized":"2024-09-17T05:42:37.805813+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:42:36.770435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:42:36.770435+0000","last_clean_scrub_stamp":"2024-09-17T05:42:36.770435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:16:12.275459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-17T05:42:39.786731+0000","last_change":"2024-09-17T05:42:38.814528+0000","last_active":"2024-09-17T05:42:39.786731+0000","last_peered":"2024-09-17T05:42:39.786731+0000","last_clean":"2024-09-17T05:42:39.786731+0000","last_became_active":"2024-09-17T05:42:38.814167+0000","last_became_peered":"2024-09-17T05:42:38.814167+0000","last_unstale":"2024-09-17T05:42:39.786731+0000","last_undegraded":"2024-09-17T05:42:39.786731+0000","last_fullsized":"2024-09-17T05:42:39.786731+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:42:37.772628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:42:37.772628+0000","last_clean_scrub_stamp":"2024-09-17T05:42:37.772628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:00:36.629732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.15","version":"33'3","reported_seq":18,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-17T05:42:39.847482+0000","last_change":"2024-09-17T05:42:37.802817+0000","last_active":"2024-09-17T05:42:39.847482+0000","last_peered":"2024-09-17T05:42:39.847482+0000","last_clean":"2024-09-17T05:42:39.847482+0000","last_became_active":"2024-09-17T05:42:37.802357+0000","last_became_peered":"2024-09-17T05:42:37.802357+0000","last_unstale":"2024-09-17T05:42:39.847482+0000","last_undegraded":"2024-09-17T05:42:39.847482+0000","last_fullsized":"2024-09-17T05:42:39.847482+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:42:36.770435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:42:36.770435+0000","last_clean_scrub_stamp":"2024-09-17T05:42:36.770435+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:04:15.682574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-17T05:42:39.847233+0000","last_change":"2024-09-17T05:42:38.806292+0000","last_active":"2024-09-17T05:42:39.847233+0000","last_peered":"2024-09-17T05:42:39.847233+0000","last_clean":"2024-09-17T05:42:39.847233+0000","last_became_active":"2024-09-17T05:42:38.805974+0000","last_became_peered":"2024-09-17T05:42:38.805974+0000","last_unstale":"2024-09-17T05:42:39.847233+0000","last_undegraded":"2024-09-17T05:42:39.847233+0000","last_fullsized":"2024-09-17T05:42:39.847233+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:42:37.772628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:42:37.772628+0000","last_clean_scrub_stamp":"2024-09-17T05:42:37.772628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:12:47.279209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"33'6","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-17T05:42:39.786777+0000","last_change":"2024-09-17T05:42:37.806610+0000","last_active":"2024-09-17T05:42:39.786777+0000","last_peered":"2024-09-17T05:42:39.786777+0000","last_clean":"2024-09-17T05:42:39.786777+0000","last_became_active":"2024-09-17T05:42:37.806267+0000","last_became_peered":"2024-09-17T05:42:37.806267+0000","last_unstale":"2024-09-17T05:42:39.786777+0000","last_undegraded":"2024-09-17T05:42:39.786777+0000","last_fullsized":"2024-09-17T05:42:39.786777+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:42:36.770435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:42:36.770435+0000","last_clean_scrub_stamp":"2024-09-17T05:42:36.770435+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:13:27.347285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-17T05:42:40.797411+0000","last_change":"2024-09-17T05:42:38.801931+0000","last_active":"2024-09-17T05:42:40.797411+0000","last_peered":"2024-09-17T05:42:40.797411+0000","last_clean":"2024-09-17T05:42:40.797411+0000","last_became_active":"2024-09-17T05:42:38.801616+0000","last_became_peered":"2024-09-17T05:42:38.801616+0000","last_unstale":"2024-09-17T05:42:40.797411+0000","last_undegraded":"2024-09-17T05:42:40.797411+0000","last_fullsized":"2024-09-17T05:42:40.797411+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:42:37.772628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:42:37.772628+0000","last_clean_scrub_stamp":"2024-09-17T05:42:37.772628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:25:01.585268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"33'2","reported_seq":17,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-17T05:42:40.522008+0000","last_change":"2024-09-17T05:42:37.799534+0000","last_active":"2024-09-17T05:42:40.522008+0000","last_peered":"2024-09-17T05:42:40.522008+0000","last_clean":"2024-09-17T05:42:40.522008+0000","last_became_active":"2024-09-17T05:42:37.798838+0000","last_became_peered":"2024-09-17T05:42:37.798838+0000","last_unstale":"2024-09-17T05:42:40.522008+0000","last_undegraded":"2024-09-17T05:42:40.522008+0000","last_fullsized":"2024-09-17T05:42:40.522008+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:42:36.770435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:42:36.770435+0000","last_clean_scrub_stamp":"2024-09-17T05:42:36.770435+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:05:24.768584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-17T05:42:39.786701+0000","last_change":"2024-09-17T05:42:38.813425+0000","last_active":"2024-09-17T05:42:39.786701+0000","last_peered":"2024-09-17T05:42:39.786701+0000","last_clean":"2024-09-17T05:42:39.786701+0000","last_became_active":"2024-09-17T05:42:38.813104+0000","last_became_peered":"2024-09-17T05:42:38.813104+0000","last_unstale":"2024-09-17T05:42:39.786701+0000","last_undegraded":"2024-09-17T05:42:39.786701+0000","last_fullsized":"2024-09-17T05:42:39.786701+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:42:37.772628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:42:37.772628+0000","last_clean_scrub_stamp":"2024-09-17T05:42:37.772628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:01:56.852587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":15,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-17T05:42:40.797333+0000","last_change":"2024-09-17T05:42:37.804193+0000","last_active":"2024-09-17T05:42:40.797333+0000","last_peered":"2024-09-17T05:42:40.797333+0000","last_clean":"2024-09-17T05:42:40.797333+0000","last_became_active":"2024-09-17T05:42:37.803188+0000","last_became_peered":"2024-09-17T05:42:37.803188+0000","last_unstale":"2024-09-17T05:42:40.797333+0000","last_undegraded":"2024-09-17T05:42:40.797333+0000","last_fullsized":"2024-09-17T05:42:40.797333+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:42:36.770435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:42:36.770435+0000","last_clean_scrub_stamp":"2024-09-17T05:42:36.770435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:51:43.041335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-17T05:42:39.789632+0000","last_change":"2024-09-17T05:42:38.814207+0000","last_active":"2024-09-17T05:42:39.789632+0000","last_peered":"2024-09-17T05:42:39.789632+0000","last_clean":"2024-09-17T05:42:39.789632+0000","last_became_active":"2024-09-17T05:42:38.813793+0000","last_became_peered":"2024-09-17T05:42:38.813793+0000","last_unstale":"2024-09-17T05:42:39.789632+0000","last_undegraded":"2024-09-17T05:42:39.789632+0000","last_fullsized":"2024-09-17T05:42:39.789632+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:42:37.772628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:42:37.772628+0000","last_clean_scrub_stamp":"2024-09-17T05:42:37.772628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:57:09.386461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":15,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-17T05:42:39.786209+0000","last_change":"2024-09-17T05:42:37.802960+0000","last_active":"2024-09-17T05:42:39.786209+0000","last_peered":"2024-09-17T05:42:39.786209+0000","last_clean":"2024-09-17T05:42:39.786209+0000","last_became_active":"2024-09-17T05:42:37.802639+0000","last_became_peered":"2024-09-17T05:42:37.802639+0000","last_unstale":"2024-09-17T05:42:39.786209+0000","last_undegraded":"2024-09-17T05:42:39.786209+0000","last_fullsized":"2024-09-17T05:42:39.786209+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:42:36.770435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:42:36.770435+0000","last_clean_scrub_stamp":"2024-09-17T05:42:36.770435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:04:15.682574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-17T05:42:39.787978+0000","last_change":"2024-09-17T05:42:38.809277+0000","last_active":"2024-09-17T05:42:39.787978+0000","last_peered":"2024-09-17T05:42:39.787978+0000","last_clean":"2024-09-17T05:42:39.787978+0000","last_became_active":"2024-09-17T05:42:38.807989+0000","last_became_peered":"2024-09-17T05:42:38.807989+0000","last_unstale":"2024-09-17T05:42:39.787978+0000","last_undegraded":"2024-09-17T05:42:39.787978+0000","last_fullsized":"2024-09-17T05:42:39.787978+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:42:37.772628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:42:37.772628+0000","last_clean_scrub_stamp":"2024-09-17T05:42:37.772628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:12:32.953365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.10","version":"33'8","reported_seq":23,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-17T05:42:39.786201+0000","last_change":"2024-09-17T05:42:37.804595+0000","last_active":"2024-09-17T05:42:39.786201+0000","last_peered":"2024-09-17T05:42:39.786201+0000","last_clean":"2024-09-17T05:42:39.786201+0000","last_became_active":"2024-09-17T05:42:37.804280+0000","last_became_peered":"2024-09-17T05:42:37.804280+0000","last_unstale":"2024-09-17T05:42:39.786201+0000","last_undegraded":"2024-09-17T05:42:39.786201+0000","last_fullsized":"2024-09-17T05:42:39.786201+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:42:36.770435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:42:36.770435+0000","last_clean_scrub_stamp":"2024-09-17T05:42:36.770435+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:23:24.440313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-17T05:42:40.522087+0000","last_change":"2024-09-17T05:42:38.809578+0000","last_active":"2024-09-17T05:42:40.522087+0000","last_peered":"2024-09-17T05:42:40.522087+0000","last_clean":"2024-09-17T05:42:40.522087+0000","last_became_active":"2024-09-17T05:42:38.809255+0000","last_became_peered":"2024-09-17T05:42:38.809255+0000","last_unstale":"2024-09-17T05:42:40.522087+0000","last_undegraded":"2024-09-17T05:42:40.522087+0000","last_fullsized":"2024-09-17T05:42:40.522087+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:42:37.772628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:42:37.772628+0000","last_clean_scrub_stamp":"2024-09-17T05:42:37.772628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:04:29.017402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"33'1","reported_seq":16,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-17T05:42:40.797976+0000","last_change":"2024-09-17T05:42:37.804246+0000","last_active":"2024-09-17T05:42:40.797976+0000","last_peered":"2024-09-17T05:42:40.797976+0000","last_clean":"2024-09-17T05:42:40.797976+0000","last_became_active":"2024-09-17T05:42:37.803529+0000","last_became_peered":"2024-09-17T05:42:37.803529+0000","last_unstale":"2024-09-17T05:42:40.797976+0000","last_undegraded":"2024-09-17T05:42:40.797976+0000","last_fullsized":"2024-09-17T05:42:40.797976+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:42:36.770435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:42:36.770435+0000","last_clean_scrub_stamp":"2024-09-17T05:42:36.770435+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:58:54.928408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-17T05:42:39.847725+0000","last_change":"2024-09-17T05:42:38.813180+0000","last_active":"2024-09-17T05:42:39.847725+0000","last_peered":"2024-09-17T05:42:39.847725+0000","last_clean":"2024-09-17T05:42:39.847725+0000","last_became_active":"2024-09-17T05:42:38.812734+0000","last_became_peered":"2024-09-17T05:42:38.812734+0000","last_unstale":"2024-09-17T05:42:39.847725+0000","last_undegraded":"2024-09-17T05:42:39.847725+0000","last_fullsized":"2024-09-17T05:42:39.847725+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:42:37.772628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:42:37.772628+0000","last_clean_scrub_stamp":"2024-09-17T05:42:37.772628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:57:09.386461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.e","version":"33'2","reported_seq":17,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-17T05:42:40.522075+0000","last_change":"2024-09-17T05:42:37.798247+0000","last_active":"2024-09-17T05:42:40.522075+0000","last_peered":"2024-09-17T05:42:40.522075+0000","last_clean":"2024-09-17T05:42:40.522075+0000","last_became_active":"2024-09-17T05:42:37.797389+0000","last_became_peered":"2024-09-17T05:42:37.797389+0000","last_unstale":"2024-09-17T05:42:40.522075+0000","last_undegraded":"2024-09-17T05:42:40.522075+0000","last_fullsized":"2024-09-17T05:42:40.522075+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:42:36.770435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:42:36.770435+0000","last_clean_scrub_stamp":"2024-09-17T05:42:36.770435+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:07:47.702071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-17T05:42:40.797619+0000","last_change":"2024-09-17T05:42:38.816785+0000","last_active":"2024-09-17T05:42:40.797619+0000","last_peered":"2024-09-17T05:42:40.797619+0000","last_clean":"2024-09-17T05:42:40.797619+0000","last_became_active":"2024-09-17T05:42:38.816471+0000","last_became_peered":"2024-09-17T05:42:38.816471+0000","last_unstale":"2024-09-17T05:42:40.797619+0000","last_undegraded":"2024-09-17T05:42:40.797619+0000","last_fullsized":"2024-09-17T05:42:40.797619+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:42:37.772628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:42:37.772628+0000","last_clean_scrub_stamp":"2024-09-17T05:42:37.772628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:42:20.311948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"33'1","reported_seq":16,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-17T05:42:40.522128+0000","last_change":"2024-09-17T05:42:37.801222+0000","last_active":"2024-09-17T05:42:40.522128+0000","last_peered":"2024-09-17T05:42:40.522128+0000","last_clean":"2024-09-17T05:42:40.522128+0000","last_became_active":"2024-09-17T05:42:37.800681+0000","last_became_peered":"2024-09-17T05:42:37.800681+0000","last_unstale":"2024-09-17T05:42:40.522128+0000","last_undegraded":"2024-09-17T05:42:40.522128+0000","last_fullsized":"2024-09-17T05:42:40.522128+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:42:36.770435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:42:36.770435+0000","last_clean_scrub_stamp":"2024-09-17T05:42:36.770435+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:32:51.037165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-17T05:42:40.837065+0000","last_change":"2024-09-17T05:42:38.804832+0000","last_active":"2024-09-17T05:42:40.837065+0000","last_peered":"2024-09-17T05:42:40.837065+0000","last_clean":"2024-09-17T05:42:40.837065+0000","last_became_active":"2024-09-17T05:42:38.804508+0000","last_became_peered":"2024-09-17T05:42:38.804508+0000","last_unstale":"2024-09-17T05:42:40.837065+0000","last_undegraded":"2024-09-17T05:42:40.837065+0000","last_fullsized":"2024-09-17T05:42:40.837065+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:42:37.772628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:42:37.772628+0000","last_clean_scrub_stamp":"2024-09-17T05:42:37.772628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:44:02.490887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":15,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-17T05:42:40.521963+0000","last_change":"2024-09-17T05:42:37.789708+0000","last_active":"2024-09-17T05:42:40.521963+0000","last_peered":"2024-09-17T05:42:40.521963+0000","last_clean":"2024-09-17T05:42:40.521963+0000","last_became_active":"2024-09-17T05:42:37.789299+0000","last_became_peered":"2024-09-17T05:42:37.789299+0000","last_unstale":"2024-09-17T05:42:40.521963+0000","last_undegraded":"2024-09-17T05:42:40.521963+0000","last_fullsized":"2024-09-17T05:42:40.521963+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:42:36.770435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:42:36.770435+0000","last_clean_scrub_stamp":"2024-09-17T05:42:36.770435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:09:15.481334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-17T05:42:40.837166+0000","last_change":"2024-09-17T05:42:38.802196+0000","last_active":"2024-09-17T05:42:40.837166+0000","last_peered":"2024-09-17T05:42:40.837166+0000","last_clean":"2024-09-17T05:42:40.837166+0000","last_became_active":"2024-09-17T05:42:38.801836+0000","last_became_peered":"2024-09-17T05:42:38.801836+0000","last_unstale":"2024-09-17T05:42:40.837166+0000","last_undegraded":"2024-09-17T05:42:40.837166+0000","last_fullsized":"2024-09-17T05:42:40.837166+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:42:37.772628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:42:37.772628+0000","last_clean_scrub_stamp":"2024-09-17T05:42:37.772628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:05:25.770777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":10,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T05:42:37.810685+0000","last_change":"2024-09-17T05:42:37.806715+0000","last_active":"2024-09-17T05:42:37.810685+0000","last_peered":"2024-09-17T05:42:37.810685+0000","last_clean":"2024-09-17T05:42:37.810685+0000","last_became_active":"2024-09-17T05:42:37.806401+0000","last_became_peered":"2024-09-17T05:42:37.806401+0000","last_unstale":"2024-09-17T05:42:37.810685+0000","last_undegraded":"2024-09-17T05:42:37.810685+0000","last_fullsized":"2024-09-17T05:42:37.810685+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:42:36.770435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:42:36.770435+0000","last_clean_scrub_stamp":"2024-09-17T05:42:36.770435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:17:40.016526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-17T05:42:40.837288+0000","last_change":"2024-09-17T05:42:38.797810+0000","last_active":"2024-09-17T05:42:40.837288+0000","last_peered":"2024-09-17T05:42:40.837288+0000","last_clean":"2024-09-17T05:42:40.837288+0000","last_became_active":"2024-09-17T05:42:38.796315+0000","last_became_peered":"2024-09-17T05:42:38.796315+0000","last_unstale":"2024-09-17T05:42:40.837288+0000","last_undegraded":"2024-09-17T05:42:40.837288+0000","last_fullsized":"2024-09-17T05:42:40.837288+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:42:37.772628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:42:37.772628+0000","last_clean_scrub_stamp":"2024-09-17T05:42:37.772628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:09:16.483527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":15,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-17T05:42:39.788131+0000","last_change":"2024-09-17T05:42:37.805124+0000","last_active":"2024-09-17T05:42:39.788131+0000","last_peered":"2024-09-17T05:42:39.788131+0000","last_clean":"2024-09-17T05:42:39.788131+0000","last_became_active":"2024-09-17T05:42:37.804866+0000","last_became_peered":"2024-09-17T05:42:37.804866+0000","last_unstale":"2024-09-17T05:42:39.788131+0000","last_undegraded":"2024-09-17T05:42:39.788131+0000","last_fullsized":"2024-09-17T05:42:39.788131+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:42:36.770435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:42:36.770435+0000","last_clean_scrub_stamp":"2024-09-17T05:42:36.770435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:46:38.031582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-17T05:42:40.837022+0000","last_change":"2024-09-17T05:42:38.797274+0000","last_active":"2024-09-17T05:42:40.837022+0000","last_peered":"2024-09-17T05:42:40.837022+0000","last_clean":"2024-09-17T05:42:40.837022+0000","last_became_active":"2024-09-17T05:42:38.796947+0000","last_became_peered":"2024-09-17T05:42:38.796947+0000","last_unstale":"2024-09-17T05:42:40.837022+0000","last_undegraded":"2024-09-17T05:42:40.837022+0000","last_fullsized":"2024-09-17T05:42:40.837022+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:42:37.772628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:42:37.772628+0000","last_clean_scrub_stamp":"2024-09-17T05:42:37.772628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:32:52.039358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":15,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-17T05:42:40.521606+0000","last_change":"2024-09-17T05:42:37.802039+0000","last_active":"2024-09-17T05:42:40.521606+0000","last_peered":"2024-09-17T05:42:40.521606+0000","last_clean":"2024-09-17T05:42:40.521606+0000","last_became_active":"2024-09-17T05:42:37.801719+0000","last_became_peered":"2024-09-17T05:42:37.801719+0000","last_unstale":"2024-09-17T05:42:40.521606+0000","last_undegraded":"2024-09-17T05:42:40.521606+0000","last_fullsized":"2024-09-17T05:42:40.521606+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:42:36.770435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:42:36.770435+0000","last_clean_scrub_stamp":"2024-09-17T05:42:36.770435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:39:18.681871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-17T05:42:39.788928+0000","last_change":"2024-09-17T05:42:38.800459+0000","last_active":"2024-09-17T05:42:39.788928+0000","last_peered":"2024-09-17T05:42:39.788928+0000","last_clean":"2024-09-17T05:42:39.788928+0000","last_became_active":"2024-09-17T05:42:38.800074+0000","last_became_peered":"2024-09-17T05:42:38.800074+0000","last_unstale":"2024-09-17T05:42:39.788928+0000","last_undegraded":"2024-09-17T05:42:39.788928+0000","last_fullsized":"2024-09-17T05:42:39.788928+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:42:37.772628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:42:37.772628+0000","last_clean_scrub_stamp":"2024-09-17T05:42:37.772628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:05:21.436685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":15,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-17T05:42:39.846965+0000","last_change":"2024-09-17T05:42:37.802800+0000","last_active":"2024-09-17T05:42:39.846965+0000","last_peered":"2024-09-17T05:42:39.846965+0000","last_clean":"2024-09-17T05:42:39.846965+0000","last_became_active":"2024-09-17T05:42:37.802451+0000","last_became_peered":"2024-09-17T05:42:37.802451+0000","last_unstale":"2024-09-17T05:42:39.846965+0000","last_undegraded":"2024-09-17T05:42:39.846965+0000","last_fullsized":"2024-09-17T05:42:39.846965+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:42:36.770435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:42:36.770435+0000","last_clean_scrub_stamp":"2024-09-17T05:42:36.770435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:26:38.326684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-17T05:42:40.837153+0000","last_change":"2024-09-17T05:42:38.811411+0000","last_active":"2024-09-17T05:42:40.837153+0000","last_peered":"2024-09-17T05:42:40.837153+0000","last_clean":"2024-09-17T05:42:40.837153+0000","last_became_active":"2024-09-17T05:42:38.810958+0000","last_became_peered":"2024-09-17T05:42:38.810958+0000","last_unstale":"2024-09-17T05:42:40.837153+0000","last_undegraded":"2024-09-17T05:42:40.837153+0000","last_fullsized":"2024-09-17T05:42:40.837153+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:42:37.772628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:42:37.772628+0000","last_clean_scrub_stamp":"2024-09-17T05:42:37.772628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:22:34.668025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"33'2","reported_seq":17,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-17T05:42:40.798059+0000","last_change":"2024-09-17T05:42:37.802205+0000","last_active":"2024-09-17T05:42:40.798059+0000","last_peered":"2024-09-17T05:42:40.798059+0000","last_clean":"2024-09-17T05:42:40.798059+0000","last_became_active":"2024-09-17T05:42:37.801813+0000","last_became_peered":"2024-09-17T05:42:37.801813+0000","last_unstale":"2024-09-17T05:42:40.798059+0000","last_undegraded":"2024-09-17T05:42:40.798059+0000","last_fullsized":"2024-09-17T05:42:40.798059+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:42:36.770435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:42:36.770435+0000","last_clean_scrub_stamp":"2024-09-17T05:42:36.770435+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:43:26.611720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-17T05:42:39.847774+0000","last_change":"2024-09-17T05:42:38.804765+0000","last_active":"2024-09-17T05:42:39.847774+0000","last_peered":"2024-09-17T05:42:39.847774+0000","last_clean":"2024-09-17T05:42:39.847774+0000","last_became_active":"2024-09-17T05:42:38.804428+0000","last_became_peered":"2024-09-17T05:42:38.804428+0000","last_unstale":"2024-09-17T05:42:39.847774+0000","last_undegraded":"2024-09-17T05:42:39.847774+0000","last_fullsized":"2024-09-17T05:42:39.847774+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:42:37.772628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:42:37.772628+0000","last_clean_scrub_stamp":"2024-09-17T05:42:37.772628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:00:24.792295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":10,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T05:42:37.810634+0000","last_change":"2024-09-17T05:42:37.805790+0000","last_active":"2024-09-17T05:42:37.810634+0000","last_peered":"2024-09-17T05:42:37.810634+0000","last_clean":"2024-09-17T05:42:37.810634+0000","last_became_active":"2024-09-17T05:42:37.805423+0000","last_became_peered":"2024-09-17T05:42:37.805423+0000","last_unstale":"2024-09-17T05:42:37.810634+0000","last_undegraded":"2024-09-17T05:42:37.810634+0000","last_fullsized":"2024-09-17T05:42:37.810634+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:42:36.770435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:42:36.770435+0000","last_clean_scrub_stamp":"2024-09-17T05:42:36.770435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:53:44.743537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-09-17T05:42:37.792487+0000","last_change":"2024-09-17T05:42:37.792487+0000","last_active":"2024-09-17T05:42:37.772628+0000","last_peered":"2024-09-17T05:42:37.772628+0000","last_clean":"2024-09-17T05:42:37.772628+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:42:37.792487+0000","last_undegraded":"2024-09-17T05:42:37.792487+0000","last_fullsized":"2024-09-17T05:42:37.792487+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:42:37.772628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:42:37.772628+0000","last_clean_scrub_stamp":"2024-09-17T05:42:37.772628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":15,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-17T05:42:40.797791+0000","last_change":"2024-09-17T05:42:37.805601+0000","last_active":"2024-09-17T05:42:40.797791+0000","last_peered":"2024-09-17T05:42:40.797791+0000","last_clean":"2024-09-17T05:42:40.797791+0000","last_became_active":"2024-09-17T05:42:37.805162+0000","last_became_peered":"2024-09-17T05:42:37.805162+0000","last_unstale":"2024-09-17T05:42:40.797791+0000","last_undegraded":"2024-09-17T05:42:40.797791+0000","last_fullsized":"2024-09-17T05:42:40.797791+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:42:36.770435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:42:36.770435+0000","last_clean_scrub_stamp":"2024-09-17T05:42:36.770435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:50:33.639876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-17T05:42:39.788059+0000","last_change":"2024-09-17T05:42:38.799674+0000","last_active":"2024-09-17T05:42:39.788059+0000","last_peered":"2024-09-17T05:42:39.788059+0000","last_clean":"2024-09-17T05:42:39.788059+0000","last_became_active":"2024-09-17T05:42:38.798334+0000","last_became_peered":"2024-09-17T05:42:38.798334+0000","last_unstale":"2024-09-17T05:42:39.788059+0000","last_undegraded":"2024-09-17T05:42:39.788059+0000","last_fullsized":"2024-09-17T05:42:39.788059+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:42:37.772628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:42:37.772628+0000","last_clean_scrub_stamp":"2024-09-17T05:42:37.772628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:11:54.209492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":10,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T05:42:37.800315+0000","last_change":"2024-09-17T05:42:37.796847+0000","last_active":"2024-09-17T05:42:37.800315+0000","last_peered":"2024-09-17T05:42:37.800315+0000","last_clean":"2024-09-17T05:42:37.800315+0000","last_became_active":"2024-09-17T05:42:37.796077+0000","last_became_peered":"2024-09-17T05:42:37.796077+0000","last_unstale":"2024-09-17T05:42:37.800315+0000","last_undegraded":"2024-09-17T05:42:37.800315+0000","last_fullsized":"2024-09-17T05:42:37.800315+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:42:36.770435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:42:36.770435+0000","last_clean_scrub_stamp":"2024-09-17T05:42:36.770435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:36:15.516715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-09-17T05:42:37.791659+0000","last_change":"2024-09-17T05:42:37.791659+0000","last_active":"2024-09-17T05:42:37.772628+0000","last_peered":"2024-09-17T05:42:37.772628+0000","last_clean":"2024-09-17T05:42:37.772628+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:42:37.791659+0000","last_undegraded":"2024-09-17T05:42:37.791659+0000","last_fullsized":"2024-09-17T05:42:37.791659+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:42:37.772628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:42:37.772628+0000","last_clean_scrub_stamp":"2024-09-17T05:42:37.772628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":15,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-17T05:42:40.797482+0000","last_change":"2024-09-17T05:42:37.802391+0000","last_active":"2024-09-17T05:42:40.797482+0000","last_peered":"2024-09-17T05:42:40.797482+0000","last_clean":"2024-09-17T05:42:40.797482+0000","last_became_active":"2024-09-17T05:42:37.802063+0000","last_became_peered":"2024-09-17T05:42:37.802063+0000","last_unstale":"2024-09-17T05:42:40.797482+0000","last_undegraded":"2024-09-17T05:42:40.797482+0000","last_fullsized":"2024-09-17T05:42:40.797482+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:42:36.770435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:42:36.770435+0000","last_clean_scrub_stamp":"2024-09-17T05:42:36.770435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:42:23.234276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-17T05:42:39.786278+0000","last_change":"2024-09-17T05:42:38.820142+0000","last_active":"2024-09-17T05:42:39.786278+0000","last_peered":"2024-09-17T05:42:39.786278+0000","last_clean":"2024-09-17T05:42:39.786278+0000","last_became_active":"2024-09-17T05:42:38.819558+0000","last_became_peered":"2024-09-17T05:42:38.819558+0000","last_unstale":"2024-09-17T05:42:39.786278+0000","last_undegraded":"2024-09-17T05:42:39.786278+0000","last_fullsized":"2024-09-17T05:42:39.786278+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:42:37.772628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:42:37.772628+0000","last_clean_scrub_stamp":"2024-09-17T05:42:37.772628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:14:51.758783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":15,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-17T05:42:40.521745+0000","last_change":"2024-09-17T05:42:37.790681+0000","last_active":"2024-09-17T05:42:40.521745+0000","last_peered":"2024-09-17T05:42:40.521745+0000","last_clean":"2024-09-17T05:42:40.521745+0000","last_became_active":"2024-09-17T05:42:37.790365+0000","last_became_peered":"2024-09-17T05:42:37.790365+0000","last_unstale":"2024-09-17T05:42:40.521745+0000","last_undegraded":"2024-09-17T05:42:40.521745+0000","last_fullsized":"2024-09-17T05:42:40.521745+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:42:36.770435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:42:36.770435+0000","last_clean_scrub_stamp":"2024-09-17T05:42:36.770435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:29:07.667338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-17T05:42:40.521796+0000","last_change":"2024-09-17T05:42:38.814045+0000","last_active":"2024-09-17T05:42:40.521796+0000","last_peered":"2024-09-17T05:42:40.521796+0000","last_clean":"2024-09-17T05:42:40.521796+0000","last_became_active":"2024-09-17T05:42:38.812842+0000","last_became_peered":"2024-09-17T05:42:38.812842+0000","last_unstale":"2024-09-17T05:42:40.521796+0000","last_undegraded":"2024-09-17T05:42:40.521796+0000","last_fullsized":"2024-09-17T05:42:40.521796+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:42:37.772628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:42:37.772628+0000","last_clean_scrub_stamp":"2024-09-17T05:42:37.772628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:58:52.289602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":15,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-17T05:42:39.786349+0000","last_change":"2024-09-17T05:42:37.804210+0000","last_active":"2024-09-17T05:42:39.786349+0000","last_peered":"2024-09-17T05:42:39.786349+0000","last_clean":"2024-09-17T05:42:39.786349+0000","last_became_active":"2024-09-17T05:42:37.803737+0000","last_became_peered":"2024-09-17T05:42:37.803737+0000","last_unstale":"2024-09-17T05:42:39.786349+0000","last_undegraded":"2024-09-17T05:42:39.786349+0000","last_fullsized":"2024-09-17T05:42:39.786349+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:42:36.770435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:42:36.770435+0000","last_clean_scrub_stamp":"2024-09-17T05:42:36.770435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:37:49.304309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-17T05:42:39.789268+0000","last_change":"2024-09-17T05:42:38.807775+0000","last_active":"2024-09-17T05:42:39.789268+0000","last_peered":"2024-09-17T05:42:39.789268+0000","last_clean":"2024-09-17T05:42:39.789268+0000","last_became_active":"2024-09-17T05:42:38.807458+0000","last_became_peered":"2024-09-17T05:42:38.807458+0000","last_unstale":"2024-09-17T05:42:39.789268+0000","last_undegraded":"2024-09-17T05:42:39.789268+0000","last_fullsized":"2024-09-17T05:42:39.789268+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:42:37.772628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:42:37.772628+0000","last_clean_scrub_stamp":"2024-09-17T05:42:37.772628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:50:12.834179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":15,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-17T05:42:39.788075+0000","last_change":"2024-09-17T05:42:37.799537+0000","last_active":"2024-09-17T05:42:39.788075+0000","last_peered":"2024-09-17T05:42:39.788075+0000","last_clean":"2024-09-17T05:42:39.788075+0000","last_became_active":"2024-09-17T05:42:37.799147+0000","last_became_peered":"2024-09-17T05:42:37.799147+0000","last_unstale":"2024-09-17T05:42:39.788075+0000","last_undegraded":"2024-09-17T05:42:39.788075+0000","last_fullsized":"2024-09-17T05:42:39.788075+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:42:36.770435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:42:36.770435+0000","last_clean_scrub_stamp":"2024-09-17T05:42:36.770435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:06:15.593910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"19'72","reported_seq":130,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-17T05:42:39.789515+0000","last_change":"2024-09-17T05:41:48.539830+0000","last_active":"2024-09-17T05:42:39.789515+0000","last_peered":"2024-09-17T05:42:39.789515+0000","last_clean":"2024-09-17T05:42:39.789515+0000","last_became_active":"2024-09-17T05:41:48.538743+0000","last_became_peered":"2024-09-17T05:41:48.538743+0000","last_unstale":"2024-09-17T05:42:39.789515+0000","last_undegraded":"2024-09-17T05:42:39.789515+0000","last_fullsized":"2024-09-17T05:42:39.789515+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:47.152539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:47.152539+0000","last_clean_scrub_stamp":"2024-09-17T05:41:47.152539+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:08:02.952016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":43,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":12,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":35,"ondisk_log_size":35,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":16,"seq":68719476752,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27404,"kb_used_data":376,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344436,"statfs":{"total":96636764160,"available":96608702464,"internally_reserved":0,"allocated":385024,"data_stored":145635,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":7,"up_from":15,"seq":64424509456,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27988,"kb_used_data":952,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343852,"statfs":{"total":96636764160,"available":96608104448,"internally_reserved":0,"allocated":974848,"data_stored":735477,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509455,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27408,"kb_used_data":376,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344432,"statfs":{"total":96636764160,"available":96608698368,"internally_reserved":0,"allocated":385024,"data_stored":145691,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509455,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27392,"kb_used_data":364,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344448,"statfs":{"total":96636764160,"available":96608714752,"internally_reserved":0,"allocated":372736,"data_stored":138823,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509455,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27420,"kb_used_data":384,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344420,"statfs":{"total":96636764160,"available":96608686080,"internally_reserved":0,"allocated":393216,"data_stored":146653,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509455,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27388,"kb_used_data":360,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344452,"statfs":{"total":96636764160,"available":96608718848,"internally_reserved":0,"allocated":368640,"data_stored":138789,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509455,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27400,"kb_used_data":372,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344440,"statfs":{"total":96636764160,"available":96608706560,"internally_reserved":0,"allocated":380928,"data_stored":140353,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574862,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27940,"kb_used_data":912,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343900,"statfs":{"total":96636764160,"available":96608153600,"internally_reserved":0,"allocated":933888,"data_stored":716045,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-17T05:42:43.198 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-17T05:42:43.348 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:43.348+0000 7f0367030640 1 -- 172.21.15.150:0/2845318884 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f03600d0550 msgr2=0x7f03600b18c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:43.349 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:43.348+0000 7f0367030640 1 --2- 172.21.15.150:0/2845318884 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f03600d0550 0x7f03600b18c0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f0350005fd0 tx=0x7f035002ab20 comp rx=0 tx=0).stop 2024-09-17T05:42:43.349 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:43.348+0000 7f0367030640 1 -- 172.21.15.150:0/2845318884 shutdown_connections 2024-09-17T05:42:43.349 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:43.348+0000 7f0367030640 1 --2- 172.21.15.150:0/2845318884 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f03600d0550 0x7f03600b18c0 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:43.349 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:43.348+0000 7f0367030640 1 --2- 172.21.15.150:0/2845318884 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f03600d0c50 0x7f03600d0010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:43.349 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:43.348+0000 7f0367030640 1 -- 172.21.15.150:0/2845318884 >> 172.21.15.150:0/2845318884 conn(0x7f03600b3fc0 msgr2=0x7f03600b43d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:42:43.349 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:43.348+0000 7f0367030640 1 -- 172.21.15.150:0/2845318884 shutdown_connections 2024-09-17T05:42:43.349 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:43.348+0000 7f0367030640 1 -- 172.21.15.150:0/2845318884 wait complete. 2024-09-17T05:42:43.350 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:43.349+0000 7f0367030640 1 Processor -- start 2024-09-17T05:42:43.350 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:43.349+0000 7f0367030640 1 -- start start 2024-09-17T05:42:43.353 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:43.351+0000 7f0367030640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f03600d0550 0x7f03601fa450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:42:43.353 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:43.351+0000 7f0367030640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f03600d0c50 0x7f036015eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:42:43.353 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:43.351+0000 7f0367030640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f03600d1060 0x7f03600b02e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:42:43.353 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:43.351+0000 7f0367030640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f03600cd130 con 0x7f03600d1060 2024-09-17T05:42:43.353 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:43.351+0000 7f0367030640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f0360070b60 con 0x7f03600d0c50 2024-09-17T05:42:43.353 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:43.351+0000 7f0367030640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f03600cd2b0 con 0x7f03600d0550 2024-09-17T05:42:43.353 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:43.351+0000 7f03655cd640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f03600d1060 0x7f03600b02e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:42:43.353 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:43.351+0000 7f03655cd640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f03600d1060 0x7f03600b02e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:59768/0 (socket says 172.21.15.150:59768) 2024-09-17T05:42:43.354 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:43.351+0000 7f03655cd640 1 -- 172.21.15.150:0/1772997744 learned_addr learned my addr 172.21.15.150:0/1772997744 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:42:43.354 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:43.351+0000 7f035ffff640 1 --2- 172.21.15.150:0/1772997744 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f03600d0c50 0x7f036015eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:42:43.354 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:43.351+0000 7f0364dcc640 1 --2- 172.21.15.150:0/1772997744 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f03600d0550 0x7f03601fa450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:42:43.354 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:43.351+0000 7f03655cd640 1 -- 172.21.15.150:0/1772997744 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f03600d0550 msgr2=0x7f03601fa450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:43.354 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:43.351+0000 7f03655cd640 1 --2- 172.21.15.150:0/1772997744 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f03600d0550 0x7f03601fa450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:43.354 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:43.351+0000 7f03655cd640 1 -- 172.21.15.150:0/1772997744 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f03600d0c50 msgr2=0x7f036015eb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:43.354 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:43.351+0000 7f03655cd640 1 --2- 172.21.15.150:0/1772997744 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f03600d0c50 0x7f036015eb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:43.354 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:43.351+0000 7f03655cd640 1 -- 172.21.15.150:0/1772997744 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f03601f99b0 con 0x7f03600d1060 2024-09-17T05:42:43.354 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:43.351+0000 7f0364dcc640 1 --2- 172.21.15.150:0/1772997744 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f03600d0550 0x7f03601fa450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:42:43.354 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:43.352+0000 7f03655cd640 1 --2- 172.21.15.150:0/1772997744 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f03600d1060 0x7f03600b02e0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f034800c3c0 tx=0x7f034800c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:42:43.354 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:43.352+0000 7f035d7fa640 1 -- 172.21.15.150:0/1772997744 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0348017070 con 0x7f03600d1060 2024-09-17T05:42:43.354 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:43.352+0000 7f035d7fa640 1 -- 172.21.15.150:0/1772997744 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f03480053c0 con 0x7f03600d1060 2024-09-17T05:42:43.354 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:43.352+0000 7f0367030640 1 -- 172.21.15.150:0/1772997744 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f03600cb5d0 con 0x7f03600d1060 2024-09-17T05:42:43.355 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:43.352+0000 7f035d7fa640 1 -- 172.21.15.150:0/1772997744 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0348003850 con 0x7f03600d1060 2024-09-17T05:42:43.355 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:43.352+0000 7f0367030640 1 -- 172.21.15.150:0/1772997744 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f03600cb8b0 con 0x7f03600d1060 2024-09-17T05:42:43.355 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:43.353+0000 7f0367030640 1 -- 172.21.15.150:0/1772997744 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f03600d0370 con 0x7f03600d1060 2024-09-17T05:42:43.355 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:43.354+0000 7f035d7fa640 1 -- 172.21.15.150:0/1772997744 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f034801a070 con 0x7f03600d1060 2024-09-17T05:42:43.355 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:43.354+0000 7f035d7fa640 1 --2- 172.21.15.150:0/1772997744 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f0340078b90 0x7f034007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:42:43.356 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:43.354+0000 7f035d7fa640 1 -- 172.21.15.150:0/1772997744 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7f034809a020 con 0x7f03600d1060 2024-09-17T05:42:43.356 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:43.354+0000 7f0364dcc640 1 --2- 172.21.15.150:0/1772997744 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f0340078b90 0x7f034007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:42:43.356 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:43.355+0000 7f0364dcc640 1 --2- 172.21.15.150:0/1772997744 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f0340078b90 0x7f034007b0a0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f0358005fd0 tx=0x7f035800f360 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:42:43.359 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:43.359+0000 7f035d7fa640 1 -- 172.21.15.150:0/1772997744 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f03600d0370 con 0x7f03600d1060 2024-09-17T05:42:43.534 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:43.531+0000 7f0367030640 1 -- 172.21.15.150:0/1772997744 --> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f03600d0010 con 0x7f0340078b90 2024-09-17T05:42:43.536 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:43.536+0000 7f035d7fa640 1 -- 172.21.15.150:0/1772997744 <== mgr.4108 v2:172.21.15.176:6800/3631216395 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251611 (secure 0 0 0) 0x7f03600d0010 con 0x7f0340078b90 2024-09-17T05:42:43.539 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-09-17T05:42:43.540 INFO:teuthology.orchestra.run.smithi150.stderr:dumped all 2024-09-17T05:42:43.542 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:43.539+0000 7f0367030640 1 -- 172.21.15.150:0/1772997744 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f0340078b90 msgr2=0x7f034007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:43.542 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:43.539+0000 7f0367030640 1 --2- 172.21.15.150:0/1772997744 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f0340078b90 0x7f034007b0a0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f0358005fd0 tx=0x7f035800f360 comp rx=0 tx=0).stop 2024-09-17T05:42:43.542 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:43.539+0000 7f0367030640 1 -- 172.21.15.150:0/1772997744 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f03600d1060 msgr2=0x7f03600b02e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:43.542 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:43.539+0000 7f0367030640 1 --2- 172.21.15.150:0/1772997744 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f03600d1060 0x7f03600b02e0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f034800c3c0 tx=0x7f034800c880 comp rx=0 tx=0).stop 2024-09-17T05:42:43.542 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:43.539+0000 7f0367030640 1 -- 172.21.15.150:0/1772997744 shutdown_connections 2024-09-17T05:42:43.542 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:43.539+0000 7f0367030640 1 --2- 172.21.15.150:0/1772997744 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f03600d0c50 0x7f036015eb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:43.542 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:43.539+0000 7f0367030640 1 --2- 172.21.15.150:0/1772997744 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f0340078b90 0x7f034007b0a0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:43.542 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:43.539+0000 7f0367030640 1 --2- 172.21.15.150:0/1772997744 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f03600d1060 0x7f03600b02e0 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:43.542 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:43.539+0000 7f0367030640 1 --2- 172.21.15.150:0/1772997744 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f03600d0550 0x7f03601fa450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:43.542 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:43.539+0000 7f0367030640 1 -- 172.21.15.150:0/1772997744 >> 172.21.15.150:0/1772997744 conn(0x7f03600b3fc0 msgr2=0x7f03600b1880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:42:43.542 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:43.539+0000 7f0367030640 1 -- 172.21.15.150:0/1772997744 shutdown_connections 2024-09-17T05:42:43.543 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:43.539+0000 7f0367030640 1 -- 172.21.15.150:0/1772997744 wait complete. 2024-09-17T05:42:43.551 INFO:teuthology.orchestra.run.smithi150.stdout:{"pg_ready":true,"pg_map":{"version":57,"stamp":"2024-09-17T05:42:42.853968+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":144,"num_write_kb":1642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":12,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":107,"ondisk_log_size":107,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":139,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":220340,"kb_used_data":4096,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754754380,"statfs":{"total":773094113280,"available":772868485120,"internally_reserved":0,"allocated":4194304,"data_stored":2307466,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":31,"apply_latency_ms":31,"commit_latency_ns":31000000,"apply_latency_ns":31000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":43,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":12,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001232"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-17T05:42:39.788326+0000","last_change":"2024-09-17T05:42:38.809600+0000","last_active":"2024-09-17T05:42:39.788326+0000","last_peered":"2024-09-17T05:42:39.788326+0000","last_clean":"2024-09-17T05:42:39.788326+0000","last_became_active":"2024-09-17T05:42:38.809252+0000","last_became_peered":"2024-09-17T05:42:38.809252+0000","last_unstale":"2024-09-17T05:42:39.788326+0000","last_undegraded":"2024-09-17T05:42:39.788326+0000","last_fullsized":"2024-09-17T05:42:39.788326+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:42:37.772628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:42:37.772628+0000","last_clean_scrub_stamp":"2024-09-17T05:42:37.772628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:29:00.810568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-17T05:42:39.787003+0000","last_change":"2024-09-17T05:42:38.810370+0000","last_active":"2024-09-17T05:42:39.787003+0000","last_peered":"2024-09-17T05:42:39.787003+0000","last_clean":"2024-09-17T05:42:39.787003+0000","last_became_active":"2024-09-17T05:42:38.809996+0000","last_became_peered":"2024-09-17T05:42:38.809996+0000","last_unstale":"2024-09-17T05:42:39.787003+0000","last_undegraded":"2024-09-17T05:42:39.787003+0000","last_fullsized":"2024-09-17T05:42:39.787003+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:42:37.772628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:42:37.772628+0000","last_clean_scrub_stamp":"2024-09-17T05:42:37.772628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:14:56.692341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-17T05:42:39.847318+0000","last_change":"2024-09-17T05:42:38.807299+0000","last_active":"2024-09-17T05:42:39.847318+0000","last_peered":"2024-09-17T05:42:39.847318+0000","last_clean":"2024-09-17T05:42:39.847318+0000","last_became_active":"2024-09-17T05:42:38.806807+0000","last_became_peered":"2024-09-17T05:42:38.806807+0000","last_unstale":"2024-09-17T05:42:39.847318+0000","last_undegraded":"2024-09-17T05:42:39.847318+0000","last_fullsized":"2024-09-17T05:42:39.847318+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:42:37.772628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:42:37.772628+0000","last_clean_scrub_stamp":"2024-09-17T05:42:37.772628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:48:13.659827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-17T05:42:40.797628+0000","last_change":"2024-09-17T05:42:38.818758+0000","last_active":"2024-09-17T05:42:40.797628+0000","last_peered":"2024-09-17T05:42:40.797628+0000","last_clean":"2024-09-17T05:42:40.797628+0000","last_became_active":"2024-09-17T05:42:38.817788+0000","last_became_peered":"2024-09-17T05:42:38.817788+0000","last_unstale":"2024-09-17T05:42:40.797628+0000","last_undegraded":"2024-09-17T05:42:40.797628+0000","last_fullsized":"2024-09-17T05:42:40.797628+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:42:37.772628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:42:37.772628+0000","last_clean_scrub_stamp":"2024-09-17T05:42:37.772628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:31:05.241317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-17T05:42:40.837070+0000","last_change":"2024-09-17T05:42:38.813119+0000","last_active":"2024-09-17T05:42:40.837070+0000","last_peered":"2024-09-17T05:42:40.837070+0000","last_clean":"2024-09-17T05:42:40.837070+0000","last_became_active":"2024-09-17T05:42:38.812772+0000","last_became_peered":"2024-09-17T05:42:38.812772+0000","last_unstale":"2024-09-17T05:42:40.837070+0000","last_undegraded":"2024-09-17T05:42:40.837070+0000","last_fullsized":"2024-09-17T05:42:40.837070+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:42:37.772628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:42:37.772628+0000","last_clean_scrub_stamp":"2024-09-17T05:42:37.772628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:29:08.669531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-17T05:42:39.786425+0000","last_change":"2024-09-17T05:42:38.816796+0000","last_active":"2024-09-17T05:42:39.786425+0000","last_peered":"2024-09-17T05:42:39.786425+0000","last_clean":"2024-09-17T05:42:39.786425+0000","last_became_active":"2024-09-17T05:42:38.816470+0000","last_became_peered":"2024-09-17T05:42:38.816470+0000","last_unstale":"2024-09-17T05:42:39.786425+0000","last_undegraded":"2024-09-17T05:42:39.786425+0000","last_fullsized":"2024-09-17T05:42:39.786425+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:42:37.772628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:42:37.772628+0000","last_clean_scrub_stamp":"2024-09-17T05:42:37.772628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:56:23.468850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-17T05:42:39.789536+0000","last_change":"2024-09-17T05:42:38.802573+0000","last_active":"2024-09-17T05:42:39.789536+0000","last_peered":"2024-09-17T05:42:39.789536+0000","last_clean":"2024-09-17T05:42:39.789536+0000","last_became_active":"2024-09-17T05:42:38.802290+0000","last_became_peered":"2024-09-17T05:42:38.802290+0000","last_unstale":"2024-09-17T05:42:39.789536+0000","last_undegraded":"2024-09-17T05:42:39.789536+0000","last_fullsized":"2024-09-17T05:42:39.789536+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:42:37.772628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:42:37.772628+0000","last_clean_scrub_stamp":"2024-09-17T05:42:37.772628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:45:42.335613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-17T05:42:39.788983+0000","last_change":"2024-09-17T05:42:38.804796+0000","last_active":"2024-09-17T05:42:39.788983+0000","last_peered":"2024-09-17T05:42:39.788983+0000","last_clean":"2024-09-17T05:42:39.788983+0000","last_became_active":"2024-09-17T05:42:38.804489+0000","last_became_peered":"2024-09-17T05:42:38.804489+0000","last_unstale":"2024-09-17T05:42:39.788983+0000","last_undegraded":"2024-09-17T05:42:39.788983+0000","last_fullsized":"2024-09-17T05:42:39.788983+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:42:37.772628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:42:37.772628+0000","last_clean_scrub_stamp":"2024-09-17T05:42:37.772628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:44:58.328573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-17T05:42:40.522284+0000","last_change":"2024-09-17T05:42:38.811030+0000","last_active":"2024-09-17T05:42:40.522284+0000","last_peered":"2024-09-17T05:42:40.522284+0000","last_clean":"2024-09-17T05:42:40.522284+0000","last_became_active":"2024-09-17T05:42:38.810688+0000","last_became_peered":"2024-09-17T05:42:38.810688+0000","last_unstale":"2024-09-17T05:42:40.522284+0000","last_undegraded":"2024-09-17T05:42:40.522284+0000","last_fullsized":"2024-09-17T05:42:40.522284+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:42:37.772628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:42:37.772628+0000","last_clean_scrub_stamp":"2024-09-17T05:42:37.772628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:21:58.970437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-17T05:42:40.797911+0000","last_change":"2024-09-17T05:42:38.818223+0000","last_active":"2024-09-17T05:42:40.797911+0000","last_peered":"2024-09-17T05:42:40.797911+0000","last_clean":"2024-09-17T05:42:40.797911+0000","last_became_active":"2024-09-17T05:42:38.817887+0000","last_became_peered":"2024-09-17T05:42:38.817887+0000","last_unstale":"2024-09-17T05:42:40.797911+0000","last_undegraded":"2024-09-17T05:42:40.797911+0000","last_fullsized":"2024-09-17T05:42:40.797911+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:42:37.772628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:42:37.772628+0000","last_clean_scrub_stamp":"2024-09-17T05:42:37.772628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:56:29.121255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-17T05:42:39.789271+0000","last_change":"2024-09-17T05:42:38.811781+0000","last_active":"2024-09-17T05:42:39.789271+0000","last_peered":"2024-09-17T05:42:39.789271+0000","last_clean":"2024-09-17T05:42:39.789271+0000","last_became_active":"2024-09-17T05:42:38.811496+0000","last_became_peered":"2024-09-17T05:42:38.811496+0000","last_unstale":"2024-09-17T05:42:39.789271+0000","last_undegraded":"2024-09-17T05:42:39.789271+0000","last_fullsized":"2024-09-17T05:42:39.789271+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:42:37.772628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:42:37.772628+0000","last_clean_scrub_stamp":"2024-09-17T05:42:37.772628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:14:51.758783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-17T05:42:39.847447+0000","last_change":"2024-09-17T05:42:38.815672+0000","last_active":"2024-09-17T05:42:39.847447+0000","last_peered":"2024-09-17T05:42:39.847447+0000","last_clean":"2024-09-17T05:42:39.847447+0000","last_became_active":"2024-09-17T05:42:38.815304+0000","last_became_peered":"2024-09-17T05:42:38.815304+0000","last_unstale":"2024-09-17T05:42:39.847447+0000","last_undegraded":"2024-09-17T05:42:39.847447+0000","last_fullsized":"2024-09-17T05:42:39.847447+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:42:37.772628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:42:37.772628+0000","last_clean_scrub_stamp":"2024-09-17T05:42:37.772628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:45:42.335613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-17T05:42:40.837016+0000","last_change":"2024-09-17T05:42:38.811245+0000","last_active":"2024-09-17T05:42:40.837016+0000","last_peered":"2024-09-17T05:42:40.837016+0000","last_clean":"2024-09-17T05:42:40.837016+0000","last_became_active":"2024-09-17T05:42:38.809546+0000","last_became_peered":"2024-09-17T05:42:38.809546+0000","last_unstale":"2024-09-17T05:42:40.837016+0000","last_undegraded":"2024-09-17T05:42:40.837016+0000","last_fullsized":"2024-09-17T05:42:40.837016+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:42:37.772628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:42:37.772628+0000","last_clean_scrub_stamp":"2024-09-17T05:42:37.772628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:49:05.954213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-17T05:42:39.786411+0000","last_change":"2024-09-17T05:42:38.817500+0000","last_active":"2024-09-17T05:42:39.786411+0000","last_peered":"2024-09-17T05:42:39.786411+0000","last_clean":"2024-09-17T05:42:39.786411+0000","last_became_active":"2024-09-17T05:42:38.816684+0000","last_became_peered":"2024-09-17T05:42:38.816684+0000","last_unstale":"2024-09-17T05:42:39.786411+0000","last_undegraded":"2024-09-17T05:42:39.786411+0000","last_fullsized":"2024-09-17T05:42:39.786411+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:42:37.772628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:42:37.772628+0000","last_clean_scrub_stamp":"2024-09-17T05:42:37.772628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:59:25.322085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-17T05:42:39.847253+0000","last_change":"2024-09-17T05:42:38.804339+0000","last_active":"2024-09-17T05:42:39.847253+0000","last_peered":"2024-09-17T05:42:39.847253+0000","last_clean":"2024-09-17T05:42:39.847253+0000","last_became_active":"2024-09-17T05:42:38.803924+0000","last_became_peered":"2024-09-17T05:42:38.803924+0000","last_unstale":"2024-09-17T05:42:39.847253+0000","last_undegraded":"2024-09-17T05:42:39.847253+0000","last_fullsized":"2024-09-17T05:42:39.847253+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:42:37.772628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:42:37.772628+0000","last_clean_scrub_stamp":"2024-09-17T05:42:37.772628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:06:11.277950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-17T05:42:39.789462+0000","last_change":"2024-09-17T05:42:38.815849+0000","last_active":"2024-09-17T05:42:39.789462+0000","last_peered":"2024-09-17T05:42:39.789462+0000","last_clean":"2024-09-17T05:42:39.789462+0000","last_became_active":"2024-09-17T05:42:38.815296+0000","last_became_peered":"2024-09-17T05:42:38.815296+0000","last_unstale":"2024-09-17T05:42:39.789462+0000","last_undegraded":"2024-09-17T05:42:39.789462+0000","last_fullsized":"2024-09-17T05:42:39.789462+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:42:37.772628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:42:37.772628+0000","last_clean_scrub_stamp":"2024-09-17T05:42:37.772628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:56:23.468850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-17T05:42:39.789530+0000","last_change":"2024-09-17T05:42:38.803948+0000","last_active":"2024-09-17T05:42:39.789530+0000","last_peered":"2024-09-17T05:42:39.789530+0000","last_clean":"2024-09-17T05:42:39.789530+0000","last_became_active":"2024-09-17T05:42:38.803640+0000","last_became_peered":"2024-09-17T05:42:38.803640+0000","last_unstale":"2024-09-17T05:42:39.789530+0000","last_undegraded":"2024-09-17T05:42:39.789530+0000","last_fullsized":"2024-09-17T05:42:39.789530+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:42:37.772628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:42:37.772628+0000","last_clean_scrub_stamp":"2024-09-17T05:42:37.772628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:01:56.852587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-17T05:42:39.787019+0000","last_change":"2024-09-17T05:42:38.820211+0000","last_active":"2024-09-17T05:42:39.787019+0000","last_peered":"2024-09-17T05:42:39.787019+0000","last_clean":"2024-09-17T05:42:39.787019+0000","last_became_active":"2024-09-17T05:42:38.819891+0000","last_became_peered":"2024-09-17T05:42:38.819891+0000","last_unstale":"2024-09-17T05:42:39.787019+0000","last_undegraded":"2024-09-17T05:42:39.787019+0000","last_fullsized":"2024-09-17T05:42:39.787019+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:42:37.772628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:42:37.772628+0000","last_clean_scrub_stamp":"2024-09-17T05:42:37.772628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:00:28.428098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-17T05:42:39.786739+0000","last_change":"2024-09-17T05:42:38.820057+0000","last_active":"2024-09-17T05:42:39.786739+0000","last_peered":"2024-09-17T05:42:39.786739+0000","last_clean":"2024-09-17T05:42:39.786739+0000","last_became_active":"2024-09-17T05:42:38.819752+0000","last_became_peered":"2024-09-17T05:42:38.819752+0000","last_unstale":"2024-09-17T05:42:39.786739+0000","last_undegraded":"2024-09-17T05:42:39.786739+0000","last_fullsized":"2024-09-17T05:42:39.786739+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:42:37.772628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:42:37.772628+0000","last_clean_scrub_stamp":"2024-09-17T05:42:37.772628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:57:09.386461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-17T05:42:40.837357+0000","last_change":"2024-09-17T05:42:38.809007+0000","last_active":"2024-09-17T05:42:40.837357+0000","last_peered":"2024-09-17T05:42:40.837357+0000","last_clean":"2024-09-17T05:42:40.837357+0000","last_became_active":"2024-09-17T05:42:38.808669+0000","last_became_peered":"2024-09-17T05:42:38.808669+0000","last_unstale":"2024-09-17T05:42:40.837357+0000","last_undegraded":"2024-09-17T05:42:40.837357+0000","last_fullsized":"2024-09-17T05:42:40.837357+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:42:37.772628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:42:37.772628+0000","last_clean_scrub_stamp":"2024-09-17T05:42:37.772628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:57:21.510110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-17T05:42:40.521773+0000","last_change":"2024-09-17T05:42:38.802973+0000","last_active":"2024-09-17T05:42:40.521773+0000","last_peered":"2024-09-17T05:42:40.521773+0000","last_clean":"2024-09-17T05:42:40.521773+0000","last_became_active":"2024-09-17T05:42:38.802601+0000","last_became_peered":"2024-09-17T05:42:38.802601+0000","last_unstale":"2024-09-17T05:42:40.521773+0000","last_undegraded":"2024-09-17T05:42:40.521773+0000","last_fullsized":"2024-09-17T05:42:40.521773+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:42:37.772628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:42:37.772628+0000","last_clean_scrub_stamp":"2024-09-17T05:42:37.772628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:50:47.581671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-17T05:42:40.521996+0000","last_change":"2024-09-17T05:42:38.813252+0000","last_active":"2024-09-17T05:42:40.521996+0000","last_peered":"2024-09-17T05:42:40.521996+0000","last_clean":"2024-09-17T05:42:40.521996+0000","last_became_active":"2024-09-17T05:42:38.812790+0000","last_became_peered":"2024-09-17T05:42:38.812790+0000","last_unstale":"2024-09-17T05:42:40.521996+0000","last_undegraded":"2024-09-17T05:42:40.521996+0000","last_fullsized":"2024-09-17T05:42:40.521996+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:42:37.772628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:42:37.772628+0000","last_clean_scrub_stamp":"2024-09-17T05:42:37.772628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:46:13.440636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-09-17T05:42:37.787939+0000","last_change":"2024-09-17T05:42:37.787939+0000","last_active":"2024-09-17T05:42:37.772628+0000","last_peered":"2024-09-17T05:42:37.772628+0000","last_clean":"2024-09-17T05:42:37.772628+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:42:37.787939+0000","last_undegraded":"2024-09-17T05:42:37.787939+0000","last_fullsized":"2024-09-17T05:42:37.787939+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:42:37.772628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:42:37.772628+0000","last_clean_scrub_stamp":"2024-09-17T05:42:37.772628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-17T05:42:39.847210+0000","last_change":"2024-09-17T05:42:38.808579+0000","last_active":"2024-09-17T05:42:39.847210+0000","last_peered":"2024-09-17T05:42:39.847210+0000","last_clean":"2024-09-17T05:42:39.847210+0000","last_became_active":"2024-09-17T05:42:38.808256+0000","last_became_peered":"2024-09-17T05:42:38.808256+0000","last_unstale":"2024-09-17T05:42:39.847210+0000","last_undegraded":"2024-09-17T05:42:39.847210+0000","last_fullsized":"2024-09-17T05:42:39.847210+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:42:37.772628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:42:37.772628+0000","last_clean_scrub_stamp":"2024-09-17T05:42:37.772628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:05:21.436685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-17T05:42:40.798046+0000","last_change":"2024-09-17T05:42:38.804818+0000","last_active":"2024-09-17T05:42:40.798046+0000","last_peered":"2024-09-17T05:42:40.798046+0000","last_clean":"2024-09-17T05:42:40.798046+0000","last_became_active":"2024-09-17T05:42:38.804487+0000","last_became_peered":"2024-09-17T05:42:38.804487+0000","last_unstale":"2024-09-17T05:42:40.798046+0000","last_undegraded":"2024-09-17T05:42:40.798046+0000","last_fullsized":"2024-09-17T05:42:40.798046+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:42:37.772628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:42:37.772628+0000","last_clean_scrub_stamp":"2024-09-17T05:42:37.772628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:11:24.017133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-17T05:42:39.787129+0000","last_change":"2024-09-17T05:42:38.812656+0000","last_active":"2024-09-17T05:42:39.787129+0000","last_peered":"2024-09-17T05:42:39.787129+0000","last_clean":"2024-09-17T05:42:39.787129+0000","last_became_active":"2024-09-17T05:42:38.812215+0000","last_became_peered":"2024-09-17T05:42:38.812215+0000","last_unstale":"2024-09-17T05:42:39.787129+0000","last_undegraded":"2024-09-17T05:42:39.787129+0000","last_fullsized":"2024-09-17T05:42:39.787129+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:42:37.772628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:42:37.772628+0000","last_clean_scrub_stamp":"2024-09-17T05:42:37.772628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:01:06.983156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-17T05:42:40.798003+0000","last_change":"2024-09-17T05:42:38.818086+0000","last_active":"2024-09-17T05:42:40.798003+0000","last_peered":"2024-09-17T05:42:40.798003+0000","last_clean":"2024-09-17T05:42:40.798003+0000","last_became_active":"2024-09-17T05:42:38.817663+0000","last_became_peered":"2024-09-17T05:42:38.817663+0000","last_unstale":"2024-09-17T05:42:40.798003+0000","last_undegraded":"2024-09-17T05:42:40.798003+0000","last_fullsized":"2024-09-17T05:42:40.798003+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:42:37.772628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:42:37.772628+0000","last_clean_scrub_stamp":"2024-09-17T05:42:37.772628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:05:21.436685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-17T05:42:39.847443+0000","last_change":"2024-09-17T05:42:38.805594+0000","last_active":"2024-09-17T05:42:39.847443+0000","last_peered":"2024-09-17T05:42:39.847443+0000","last_clean":"2024-09-17T05:42:39.847443+0000","last_became_active":"2024-09-17T05:42:38.804957+0000","last_became_peered":"2024-09-17T05:42:38.804957+0000","last_unstale":"2024-09-17T05:42:39.847443+0000","last_undegraded":"2024-09-17T05:42:39.847443+0000","last_fullsized":"2024-09-17T05:42:39.847443+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:42:37.772628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:42:37.772628+0000","last_clean_scrub_stamp":"2024-09-17T05:42:37.772628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:56:23.468850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-17T05:42:40.521839+0000","last_change":"2024-09-17T05:42:38.814787+0000","last_active":"2024-09-17T05:42:40.521839+0000","last_peered":"2024-09-17T05:42:40.521839+0000","last_clean":"2024-09-17T05:42:40.521839+0000","last_became_active":"2024-09-17T05:42:38.814444+0000","last_became_peered":"2024-09-17T05:42:38.814444+0000","last_unstale":"2024-09-17T05:42:40.521839+0000","last_undegraded":"2024-09-17T05:42:40.521839+0000","last_fullsized":"2024-09-17T05:42:40.521839+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:42:37.772628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:42:37.772628+0000","last_clean_scrub_stamp":"2024-09-17T05:42:37.772628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:33:11.874170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-17T05:42:39.788977+0000","last_change":"2024-09-17T05:42:38.800573+0000","last_active":"2024-09-17T05:42:39.788977+0000","last_peered":"2024-09-17T05:42:39.788977+0000","last_clean":"2024-09-17T05:42:39.788977+0000","last_became_active":"2024-09-17T05:42:38.800170+0000","last_became_peered":"2024-09-17T05:42:38.800170+0000","last_unstale":"2024-09-17T05:42:39.788977+0000","last_undegraded":"2024-09-17T05:42:39.788977+0000","last_fullsized":"2024-09-17T05:42:39.788977+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:42:37.772628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:42:37.772628+0000","last_clean_scrub_stamp":"2024-09-17T05:42:37.772628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:11:24.017133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-17T05:42:39.787984+0000","last_change":"2024-09-17T05:42:38.798553+0000","last_active":"2024-09-17T05:42:39.787984+0000","last_peered":"2024-09-17T05:42:39.787984+0000","last_clean":"2024-09-17T05:42:39.787984+0000","last_became_active":"2024-09-17T05:42:38.798026+0000","last_became_peered":"2024-09-17T05:42:38.798026+0000","last_unstale":"2024-09-17T05:42:39.787984+0000","last_undegraded":"2024-09-17T05:42:39.787984+0000","last_fullsized":"2024-09-17T05:42:39.787984+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:42:37.772628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:42:37.772628+0000","last_clean_scrub_stamp":"2024-09-17T05:42:37.772628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:35:43.722989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-17T05:42:39.788784+0000","last_change":"2024-09-17T05:42:38.809055+0000","last_active":"2024-09-17T05:42:39.788784+0000","last_peered":"2024-09-17T05:42:39.788784+0000","last_clean":"2024-09-17T05:42:39.788784+0000","last_became_active":"2024-09-17T05:42:38.808725+0000","last_became_peered":"2024-09-17T05:42:38.808725+0000","last_unstale":"2024-09-17T05:42:39.788784+0000","last_undegraded":"2024-09-17T05:42:39.788784+0000","last_fullsized":"2024-09-17T05:42:39.788784+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:42:37.772628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:42:37.772628+0000","last_clean_scrub_stamp":"2024-09-17T05:42:37.772628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:56:29.121255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-09-17T05:42:37.793868+0000","last_change":"2024-09-17T05:42:37.793868+0000","last_active":"2024-09-17T05:42:37.772628+0000","last_peered":"2024-09-17T05:42:37.772628+0000","last_clean":"2024-09-17T05:42:37.772628+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:42:37.793868+0000","last_undegraded":"2024-09-17T05:42:37.793868+0000","last_fullsized":"2024-09-17T05:42:37.793868+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:42:37.772628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:42:37.772628+0000","last_clean_scrub_stamp":"2024-09-17T05:42:37.772628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"33'4","reported_seq":19,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-17T05:42:39.788402+0000","last_change":"2024-09-17T05:42:37.796176+0000","last_active":"2024-09-17T05:42:39.788402+0000","last_peered":"2024-09-17T05:42:39.788402+0000","last_clean":"2024-09-17T05:42:39.788402+0000","last_became_active":"2024-09-17T05:42:37.795881+0000","last_became_peered":"2024-09-17T05:42:37.795881+0000","last_unstale":"2024-09-17T05:42:39.788402+0000","last_undegraded":"2024-09-17T05:42:39.788402+0000","last_fullsized":"2024-09-17T05:42:39.788402+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:42:36.770435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:42:36.770435+0000","last_clean_scrub_stamp":"2024-09-17T05:42:36.770435+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:56:54.491587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-17T05:42:39.788424+0000","last_change":"2024-09-17T05:42:38.809796+0000","last_active":"2024-09-17T05:42:39.788424+0000","last_peered":"2024-09-17T05:42:39.788424+0000","last_clean":"2024-09-17T05:42:39.788424+0000","last_became_active":"2024-09-17T05:42:38.809498+0000","last_became_peered":"2024-09-17T05:42:38.809498+0000","last_unstale":"2024-09-17T05:42:39.788424+0000","last_undegraded":"2024-09-17T05:42:39.788424+0000","last_fullsized":"2024-09-17T05:42:39.788424+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:42:37.772628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:42:37.772628+0000","last_clean_scrub_stamp":"2024-09-17T05:42:37.772628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:31:04.584637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":10,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T05:42:37.805843+0000","last_change":"2024-09-17T05:42:37.802980+0000","last_active":"2024-09-17T05:42:37.805843+0000","last_peered":"2024-09-17T05:42:37.805843+0000","last_clean":"2024-09-17T05:42:37.805843+0000","last_became_active":"2024-09-17T05:42:37.802617+0000","last_became_peered":"2024-09-17T05:42:37.802617+0000","last_unstale":"2024-09-17T05:42:37.805843+0000","last_undegraded":"2024-09-17T05:42:37.805843+0000","last_fullsized":"2024-09-17T05:42:37.805843+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:42:36.770435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:42:36.770435+0000","last_clean_scrub_stamp":"2024-09-17T05:42:36.770435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:53:27.876127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-17T05:42:40.522249+0000","last_change":"2024-09-17T05:42:38.818122+0000","last_active":"2024-09-17T05:42:40.522249+0000","last_peered":"2024-09-17T05:42:40.522249+0000","last_clean":"2024-09-17T05:42:40.522249+0000","last_became_active":"2024-09-17T05:42:38.817832+0000","last_became_peered":"2024-09-17T05:42:38.817832+0000","last_unstale":"2024-09-17T05:42:40.522249+0000","last_undegraded":"2024-09-17T05:42:40.522249+0000","last_fullsized":"2024-09-17T05:42:40.522249+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:42:37.772628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:42:37.772628+0000","last_clean_scrub_stamp":"2024-09-17T05:42:37.772628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:57:09.672673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"33'2","reported_seq":17,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-17T05:42:39.786857+0000","last_change":"2024-09-17T05:42:37.805183+0000","last_active":"2024-09-17T05:42:39.786857+0000","last_peered":"2024-09-17T05:42:39.786857+0000","last_clean":"2024-09-17T05:42:39.786857+0000","last_became_active":"2024-09-17T05:42:37.804856+0000","last_became_peered":"2024-09-17T05:42:37.804856+0000","last_unstale":"2024-09-17T05:42:39.786857+0000","last_undegraded":"2024-09-17T05:42:39.786857+0000","last_fullsized":"2024-09-17T05:42:39.786857+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:42:36.770435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:42:36.770435+0000","last_clean_scrub_stamp":"2024-09-17T05:42:36.770435+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:53:13.976559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-17T05:42:40.798052+0000","last_change":"2024-09-17T05:42:38.811881+0000","last_active":"2024-09-17T05:42:40.798052+0000","last_peered":"2024-09-17T05:42:40.798052+0000","last_clean":"2024-09-17T05:42:40.798052+0000","last_became_active":"2024-09-17T05:42:38.809272+0000","last_became_peered":"2024-09-17T05:42:38.809272+0000","last_unstale":"2024-09-17T05:42:40.798052+0000","last_undegraded":"2024-09-17T05:42:40.798052+0000","last_fullsized":"2024-09-17T05:42:40.798052+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:42:37.772628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:42:37.772628+0000","last_clean_scrub_stamp":"2024-09-17T05:42:37.772628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:06:11.277950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"33'2","reported_seq":17,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-17T05:42:40.837089+0000","last_change":"2024-09-17T05:42:37.806873+0000","last_active":"2024-09-17T05:42:40.837089+0000","last_peered":"2024-09-17T05:42:40.837089+0000","last_clean":"2024-09-17T05:42:40.837089+0000","last_became_active":"2024-09-17T05:42:37.806489+0000","last_became_peered":"2024-09-17T05:42:37.806489+0000","last_unstale":"2024-09-17T05:42:40.837089+0000","last_undegraded":"2024-09-17T05:42:40.837089+0000","last_fullsized":"2024-09-17T05:42:40.837089+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:42:36.770435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:42:36.770435+0000","last_clean_scrub_stamp":"2024-09-17T05:42:36.770435+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:56:33.527829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-17T05:42:39.789063+0000","last_change":"2024-09-17T05:42:38.810130+0000","last_active":"2024-09-17T05:42:39.789063+0000","last_peered":"2024-09-17T05:42:39.789063+0000","last_clean":"2024-09-17T05:42:39.789063+0000","last_became_active":"2024-09-17T05:42:38.809795+0000","last_became_peered":"2024-09-17T05:42:38.809795+0000","last_unstale":"2024-09-17T05:42:39.789063+0000","last_undegraded":"2024-09-17T05:42:39.789063+0000","last_fullsized":"2024-09-17T05:42:39.789063+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:42:37.772628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:42:37.772628+0000","last_clean_scrub_stamp":"2024-09-17T05:42:37.772628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:48:42.385641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"33'1","reported_seq":16,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-17T05:42:40.521934+0000","last_change":"2024-09-17T05:42:37.801623+0000","last_active":"2024-09-17T05:42:40.521934+0000","last_peered":"2024-09-17T05:42:40.521934+0000","last_clean":"2024-09-17T05:42:40.521934+0000","last_became_active":"2024-09-17T05:42:37.801212+0000","last_became_peered":"2024-09-17T05:42:37.801212+0000","last_unstale":"2024-09-17T05:42:40.521934+0000","last_undegraded":"2024-09-17T05:42:40.521934+0000","last_fullsized":"2024-09-17T05:42:40.521934+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:42:36.770435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:42:36.770435+0000","last_clean_scrub_stamp":"2024-09-17T05:42:36.770435+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:15:14.631270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-17T05:42:39.847267+0000","last_change":"2024-09-17T05:42:38.804702+0000","last_active":"2024-09-17T05:42:39.847267+0000","last_peered":"2024-09-17T05:42:39.847267+0000","last_clean":"2024-09-17T05:42:39.847267+0000","last_became_active":"2024-09-17T05:42:38.804359+0000","last_became_peered":"2024-09-17T05:42:38.804359+0000","last_unstale":"2024-09-17T05:42:39.847267+0000","last_undegraded":"2024-09-17T05:42:39.847267+0000","last_fullsized":"2024-09-17T05:42:39.847267+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:42:37.772628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:42:37.772628+0000","last_clean_scrub_stamp":"2024-09-17T05:42:37.772628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:50:12.834179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"33'1","reported_seq":16,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-17T05:42:40.522053+0000","last_change":"2024-09-17T05:42:37.797062+0000","last_active":"2024-09-17T05:42:40.522053+0000","last_peered":"2024-09-17T05:42:40.522053+0000","last_clean":"2024-09-17T05:42:40.522053+0000","last_became_active":"2024-09-17T05:42:37.796412+0000","last_became_peered":"2024-09-17T05:42:37.796412+0000","last_unstale":"2024-09-17T05:42:40.522053+0000","last_undegraded":"2024-09-17T05:42:40.522053+0000","last_fullsized":"2024-09-17T05:42:40.522053+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:42:36.770435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:42:36.770435+0000","last_clean_scrub_stamp":"2024-09-17T05:42:36.770435+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:28:00.710578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-17T05:42:40.521717+0000","last_change":"2024-09-17T05:42:38.800340+0000","last_active":"2024-09-17T05:42:40.521717+0000","last_peered":"2024-09-17T05:42:40.521717+0000","last_clean":"2024-09-17T05:42:40.521717+0000","last_became_active":"2024-09-17T05:42:38.798319+0000","last_became_peered":"2024-09-17T05:42:38.798319+0000","last_unstale":"2024-09-17T05:42:40.521717+0000","last_undegraded":"2024-09-17T05:42:40.521717+0000","last_fullsized":"2024-09-17T05:42:40.521717+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:42:37.772628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:42:37.772628+0000","last_clean_scrub_stamp":"2024-09-17T05:42:37.772628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:51:50.260513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":15,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-17T05:42:39.786151+0000","last_change":"2024-09-17T05:42:37.798675+0000","last_active":"2024-09-17T05:42:39.786151+0000","last_peered":"2024-09-17T05:42:39.786151+0000","last_clean":"2024-09-17T05:42:39.786151+0000","last_became_active":"2024-09-17T05:42:37.798337+0000","last_became_peered":"2024-09-17T05:42:37.798337+0000","last_unstale":"2024-09-17T05:42:39.786151+0000","last_undegraded":"2024-09-17T05:42:39.786151+0000","last_fullsized":"2024-09-17T05:42:39.786151+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:42:36.770435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:42:36.770435+0000","last_clean_scrub_stamp":"2024-09-17T05:42:36.770435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:26:38.326684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-17T05:42:40.797420+0000","last_change":"2024-09-17T05:42:38.812209+0000","last_active":"2024-09-17T05:42:40.797420+0000","last_peered":"2024-09-17T05:42:40.797420+0000","last_clean":"2024-09-17T05:42:40.797420+0000","last_became_active":"2024-09-17T05:42:38.811493+0000","last_became_peered":"2024-09-17T05:42:38.811493+0000","last_unstale":"2024-09-17T05:42:40.797420+0000","last_undegraded":"2024-09-17T05:42:40.797420+0000","last_fullsized":"2024-09-17T05:42:40.797420+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:42:37.772628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:42:37.772628+0000","last_clean_scrub_stamp":"2024-09-17T05:42:37.772628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:57:09.672673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":15,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-17T05:42:40.521535+0000","last_change":"2024-09-17T05:42:37.795964+0000","last_active":"2024-09-17T05:42:40.521535+0000","last_peered":"2024-09-17T05:42:40.521535+0000","last_clean":"2024-09-17T05:42:40.521535+0000","last_became_active":"2024-09-17T05:42:37.795311+0000","last_became_peered":"2024-09-17T05:42:37.795311+0000","last_unstale":"2024-09-17T05:42:40.521535+0000","last_undegraded":"2024-09-17T05:42:40.521535+0000","last_fullsized":"2024-09-17T05:42:40.521535+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:42:36.770435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:42:36.770435+0000","last_clean_scrub_stamp":"2024-09-17T05:42:36.770435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:57:20.507917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-17T05:42:39.847619+0000","last_change":"2024-09-17T05:42:38.812068+0000","last_active":"2024-09-17T05:42:39.847619+0000","last_peered":"2024-09-17T05:42:39.847619+0000","last_clean":"2024-09-17T05:42:39.847619+0000","last_became_active":"2024-09-17T05:42:38.811455+0000","last_became_peered":"2024-09-17T05:42:38.811455+0000","last_unstale":"2024-09-17T05:42:39.847619+0000","last_undegraded":"2024-09-17T05:42:39.847619+0000","last_fullsized":"2024-09-17T05:42:39.847619+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:42:37.772628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:42:37.772628+0000","last_clean_scrub_stamp":"2024-09-17T05:42:37.772628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:37:11.138729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":15,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-17T05:42:39.786891+0000","last_change":"2024-09-17T05:42:37.803872+0000","last_active":"2024-09-17T05:42:39.786891+0000","last_peered":"2024-09-17T05:42:39.786891+0000","last_clean":"2024-09-17T05:42:39.786891+0000","last_became_active":"2024-09-17T05:42:37.803571+0000","last_became_peered":"2024-09-17T05:42:37.803571+0000","last_unstale":"2024-09-17T05:42:39.786891+0000","last_undegraded":"2024-09-17T05:42:39.786891+0000","last_fullsized":"2024-09-17T05:42:39.786891+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:42:36.770435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:42:36.770435+0000","last_clean_scrub_stamp":"2024-09-17T05:42:36.770435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:18:31.876866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-17T05:42:39.786932+0000","last_change":"2024-09-17T05:42:38.820069+0000","last_active":"2024-09-17T05:42:39.786932+0000","last_peered":"2024-09-17T05:42:39.786932+0000","last_clean":"2024-09-17T05:42:39.786932+0000","last_became_active":"2024-09-17T05:42:38.819408+0000","last_became_peered":"2024-09-17T05:42:38.819408+0000","last_unstale":"2024-09-17T05:42:39.786932+0000","last_undegraded":"2024-09-17T05:42:39.786932+0000","last_fullsized":"2024-09-17T05:42:39.786932+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:42:37.772628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:42:37.772628+0000","last_clean_scrub_stamp":"2024-09-17T05:42:37.772628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:19:00.631236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":10,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T05:42:37.805813+0000","last_change":"2024-09-17T05:42:37.802055+0000","last_active":"2024-09-17T05:42:37.805813+0000","last_peered":"2024-09-17T05:42:37.805813+0000","last_clean":"2024-09-17T05:42:37.805813+0000","last_became_active":"2024-09-17T05:42:37.801718+0000","last_became_peered":"2024-09-17T05:42:37.801718+0000","last_unstale":"2024-09-17T05:42:37.805813+0000","last_undegraded":"2024-09-17T05:42:37.805813+0000","last_fullsized":"2024-09-17T05:42:37.805813+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:42:36.770435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:42:36.770435+0000","last_clean_scrub_stamp":"2024-09-17T05:42:36.770435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:16:12.275459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-17T05:42:39.786731+0000","last_change":"2024-09-17T05:42:38.814528+0000","last_active":"2024-09-17T05:42:39.786731+0000","last_peered":"2024-09-17T05:42:39.786731+0000","last_clean":"2024-09-17T05:42:39.786731+0000","last_became_active":"2024-09-17T05:42:38.814167+0000","last_became_peered":"2024-09-17T05:42:38.814167+0000","last_unstale":"2024-09-17T05:42:39.786731+0000","last_undegraded":"2024-09-17T05:42:39.786731+0000","last_fullsized":"2024-09-17T05:42:39.786731+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:42:37.772628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:42:37.772628+0000","last_clean_scrub_stamp":"2024-09-17T05:42:37.772628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:00:36.629732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.15","version":"33'3","reported_seq":18,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-17T05:42:39.847482+0000","last_change":"2024-09-17T05:42:37.802817+0000","last_active":"2024-09-17T05:42:39.847482+0000","last_peered":"2024-09-17T05:42:39.847482+0000","last_clean":"2024-09-17T05:42:39.847482+0000","last_became_active":"2024-09-17T05:42:37.802357+0000","last_became_peered":"2024-09-17T05:42:37.802357+0000","last_unstale":"2024-09-17T05:42:39.847482+0000","last_undegraded":"2024-09-17T05:42:39.847482+0000","last_fullsized":"2024-09-17T05:42:39.847482+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:42:36.770435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:42:36.770435+0000","last_clean_scrub_stamp":"2024-09-17T05:42:36.770435+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:04:15.682574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-17T05:42:39.847233+0000","last_change":"2024-09-17T05:42:38.806292+0000","last_active":"2024-09-17T05:42:39.847233+0000","last_peered":"2024-09-17T05:42:39.847233+0000","last_clean":"2024-09-17T05:42:39.847233+0000","last_became_active":"2024-09-17T05:42:38.805974+0000","last_became_peered":"2024-09-17T05:42:38.805974+0000","last_unstale":"2024-09-17T05:42:39.847233+0000","last_undegraded":"2024-09-17T05:42:39.847233+0000","last_fullsized":"2024-09-17T05:42:39.847233+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:42:37.772628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:42:37.772628+0000","last_clean_scrub_stamp":"2024-09-17T05:42:37.772628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:12:47.279209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"33'6","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-17T05:42:39.786777+0000","last_change":"2024-09-17T05:42:37.806610+0000","last_active":"2024-09-17T05:42:39.786777+0000","last_peered":"2024-09-17T05:42:39.786777+0000","last_clean":"2024-09-17T05:42:39.786777+0000","last_became_active":"2024-09-17T05:42:37.806267+0000","last_became_peered":"2024-09-17T05:42:37.806267+0000","last_unstale":"2024-09-17T05:42:39.786777+0000","last_undegraded":"2024-09-17T05:42:39.786777+0000","last_fullsized":"2024-09-17T05:42:39.786777+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:42:36.770435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:42:36.770435+0000","last_clean_scrub_stamp":"2024-09-17T05:42:36.770435+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:13:27.347285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-17T05:42:40.797411+0000","last_change":"2024-09-17T05:42:38.801931+0000","last_active":"2024-09-17T05:42:40.797411+0000","last_peered":"2024-09-17T05:42:40.797411+0000","last_clean":"2024-09-17T05:42:40.797411+0000","last_became_active":"2024-09-17T05:42:38.801616+0000","last_became_peered":"2024-09-17T05:42:38.801616+0000","last_unstale":"2024-09-17T05:42:40.797411+0000","last_undegraded":"2024-09-17T05:42:40.797411+0000","last_fullsized":"2024-09-17T05:42:40.797411+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:42:37.772628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:42:37.772628+0000","last_clean_scrub_stamp":"2024-09-17T05:42:37.772628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:25:01.585268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"33'2","reported_seq":17,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-17T05:42:40.522008+0000","last_change":"2024-09-17T05:42:37.799534+0000","last_active":"2024-09-17T05:42:40.522008+0000","last_peered":"2024-09-17T05:42:40.522008+0000","last_clean":"2024-09-17T05:42:40.522008+0000","last_became_active":"2024-09-17T05:42:37.798838+0000","last_became_peered":"2024-09-17T05:42:37.798838+0000","last_unstale":"2024-09-17T05:42:40.522008+0000","last_undegraded":"2024-09-17T05:42:40.522008+0000","last_fullsized":"2024-09-17T05:42:40.522008+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:42:36.770435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:42:36.770435+0000","last_clean_scrub_stamp":"2024-09-17T05:42:36.770435+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:05:24.768584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-17T05:42:39.786701+0000","last_change":"2024-09-17T05:42:38.813425+0000","last_active":"2024-09-17T05:42:39.786701+0000","last_peered":"2024-09-17T05:42:39.786701+0000","last_clean":"2024-09-17T05:42:39.786701+0000","last_became_active":"2024-09-17T05:42:38.813104+0000","last_became_peered":"2024-09-17T05:42:38.813104+0000","last_unstale":"2024-09-17T05:42:39.786701+0000","last_undegraded":"2024-09-17T05:42:39.786701+0000","last_fullsized":"2024-09-17T05:42:39.786701+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:42:37.772628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:42:37.772628+0000","last_clean_scrub_stamp":"2024-09-17T05:42:37.772628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:01:56.852587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":15,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-17T05:42:40.797333+0000","last_change":"2024-09-17T05:42:37.804193+0000","last_active":"2024-09-17T05:42:40.797333+0000","last_peered":"2024-09-17T05:42:40.797333+0000","last_clean":"2024-09-17T05:42:40.797333+0000","last_became_active":"2024-09-17T05:42:37.803188+0000","last_became_peered":"2024-09-17T05:42:37.803188+0000","last_unstale":"2024-09-17T05:42:40.797333+0000","last_undegraded":"2024-09-17T05:42:40.797333+0000","last_fullsized":"2024-09-17T05:42:40.797333+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:42:36.770435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:42:36.770435+0000","last_clean_scrub_stamp":"2024-09-17T05:42:36.770435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:51:43.041335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-17T05:42:39.789632+0000","last_change":"2024-09-17T05:42:38.814207+0000","last_active":"2024-09-17T05:42:39.789632+0000","last_peered":"2024-09-17T05:42:39.789632+0000","last_clean":"2024-09-17T05:42:39.789632+0000","last_became_active":"2024-09-17T05:42:38.813793+0000","last_became_peered":"2024-09-17T05:42:38.813793+0000","last_unstale":"2024-09-17T05:42:39.789632+0000","last_undegraded":"2024-09-17T05:42:39.789632+0000","last_fullsized":"2024-09-17T05:42:39.789632+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:42:37.772628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:42:37.772628+0000","last_clean_scrub_stamp":"2024-09-17T05:42:37.772628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:57:09.386461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":15,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-17T05:42:39.786209+0000","last_change":"2024-09-17T05:42:37.802960+0000","last_active":"2024-09-17T05:42:39.786209+0000","last_peered":"2024-09-17T05:42:39.786209+0000","last_clean":"2024-09-17T05:42:39.786209+0000","last_became_active":"2024-09-17T05:42:37.802639+0000","last_became_peered":"2024-09-17T05:42:37.802639+0000","last_unstale":"2024-09-17T05:42:39.786209+0000","last_undegraded":"2024-09-17T05:42:39.786209+0000","last_fullsized":"2024-09-17T05:42:39.786209+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:42:36.770435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:42:36.770435+0000","last_clean_scrub_stamp":"2024-09-17T05:42:36.770435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:04:15.682574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-17T05:42:39.787978+0000","last_change":"2024-09-17T05:42:38.809277+0000","last_active":"2024-09-17T05:42:39.787978+0000","last_peered":"2024-09-17T05:42:39.787978+0000","last_clean":"2024-09-17T05:42:39.787978+0000","last_became_active":"2024-09-17T05:42:38.807989+0000","last_became_peered":"2024-09-17T05:42:38.807989+0000","last_unstale":"2024-09-17T05:42:39.787978+0000","last_undegraded":"2024-09-17T05:42:39.787978+0000","last_fullsized":"2024-09-17T05:42:39.787978+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:42:37.772628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:42:37.772628+0000","last_clean_scrub_stamp":"2024-09-17T05:42:37.772628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:12:32.953365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.10","version":"33'8","reported_seq":23,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-17T05:42:39.786201+0000","last_change":"2024-09-17T05:42:37.804595+0000","last_active":"2024-09-17T05:42:39.786201+0000","last_peered":"2024-09-17T05:42:39.786201+0000","last_clean":"2024-09-17T05:42:39.786201+0000","last_became_active":"2024-09-17T05:42:37.804280+0000","last_became_peered":"2024-09-17T05:42:37.804280+0000","last_unstale":"2024-09-17T05:42:39.786201+0000","last_undegraded":"2024-09-17T05:42:39.786201+0000","last_fullsized":"2024-09-17T05:42:39.786201+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:42:36.770435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:42:36.770435+0000","last_clean_scrub_stamp":"2024-09-17T05:42:36.770435+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:23:24.440313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-17T05:42:40.522087+0000","last_change":"2024-09-17T05:42:38.809578+0000","last_active":"2024-09-17T05:42:40.522087+0000","last_peered":"2024-09-17T05:42:40.522087+0000","last_clean":"2024-09-17T05:42:40.522087+0000","last_became_active":"2024-09-17T05:42:38.809255+0000","last_became_peered":"2024-09-17T05:42:38.809255+0000","last_unstale":"2024-09-17T05:42:40.522087+0000","last_undegraded":"2024-09-17T05:42:40.522087+0000","last_fullsized":"2024-09-17T05:42:40.522087+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:42:37.772628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:42:37.772628+0000","last_clean_scrub_stamp":"2024-09-17T05:42:37.772628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:04:29.017402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"33'1","reported_seq":16,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-17T05:42:40.797976+0000","last_change":"2024-09-17T05:42:37.804246+0000","last_active":"2024-09-17T05:42:40.797976+0000","last_peered":"2024-09-17T05:42:40.797976+0000","last_clean":"2024-09-17T05:42:40.797976+0000","last_became_active":"2024-09-17T05:42:37.803529+0000","last_became_peered":"2024-09-17T05:42:37.803529+0000","last_unstale":"2024-09-17T05:42:40.797976+0000","last_undegraded":"2024-09-17T05:42:40.797976+0000","last_fullsized":"2024-09-17T05:42:40.797976+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:42:36.770435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:42:36.770435+0000","last_clean_scrub_stamp":"2024-09-17T05:42:36.770435+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:58:54.928408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-17T05:42:39.847725+0000","last_change":"2024-09-17T05:42:38.813180+0000","last_active":"2024-09-17T05:42:39.847725+0000","last_peered":"2024-09-17T05:42:39.847725+0000","last_clean":"2024-09-17T05:42:39.847725+0000","last_became_active":"2024-09-17T05:42:38.812734+0000","last_became_peered":"2024-09-17T05:42:38.812734+0000","last_unstale":"2024-09-17T05:42:39.847725+0000","last_undegraded":"2024-09-17T05:42:39.847725+0000","last_fullsized":"2024-09-17T05:42:39.847725+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:42:37.772628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:42:37.772628+0000","last_clean_scrub_stamp":"2024-09-17T05:42:37.772628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:57:09.386461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.e","version":"33'2","reported_seq":17,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-17T05:42:40.522075+0000","last_change":"2024-09-17T05:42:37.798247+0000","last_active":"2024-09-17T05:42:40.522075+0000","last_peered":"2024-09-17T05:42:40.522075+0000","last_clean":"2024-09-17T05:42:40.522075+0000","last_became_active":"2024-09-17T05:42:37.797389+0000","last_became_peered":"2024-09-17T05:42:37.797389+0000","last_unstale":"2024-09-17T05:42:40.522075+0000","last_undegraded":"2024-09-17T05:42:40.522075+0000","last_fullsized":"2024-09-17T05:42:40.522075+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:42:36.770435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:42:36.770435+0000","last_clean_scrub_stamp":"2024-09-17T05:42:36.770435+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:07:47.702071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-17T05:42:40.797619+0000","last_change":"2024-09-17T05:42:38.816785+0000","last_active":"2024-09-17T05:42:40.797619+0000","last_peered":"2024-09-17T05:42:40.797619+0000","last_clean":"2024-09-17T05:42:40.797619+0000","last_became_active":"2024-09-17T05:42:38.816471+0000","last_became_peered":"2024-09-17T05:42:38.816471+0000","last_unstale":"2024-09-17T05:42:40.797619+0000","last_undegraded":"2024-09-17T05:42:40.797619+0000","last_fullsized":"2024-09-17T05:42:40.797619+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:42:37.772628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:42:37.772628+0000","last_clean_scrub_stamp":"2024-09-17T05:42:37.772628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:42:20.311948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"33'1","reported_seq":16,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-17T05:42:40.522128+0000","last_change":"2024-09-17T05:42:37.801222+0000","last_active":"2024-09-17T05:42:40.522128+0000","last_peered":"2024-09-17T05:42:40.522128+0000","last_clean":"2024-09-17T05:42:40.522128+0000","last_became_active":"2024-09-17T05:42:37.800681+0000","last_became_peered":"2024-09-17T05:42:37.800681+0000","last_unstale":"2024-09-17T05:42:40.522128+0000","last_undegraded":"2024-09-17T05:42:40.522128+0000","last_fullsized":"2024-09-17T05:42:40.522128+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:42:36.770435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:42:36.770435+0000","last_clean_scrub_stamp":"2024-09-17T05:42:36.770435+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:32:51.037165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-17T05:42:40.837065+0000","last_change":"2024-09-17T05:42:38.804832+0000","last_active":"2024-09-17T05:42:40.837065+0000","last_peered":"2024-09-17T05:42:40.837065+0000","last_clean":"2024-09-17T05:42:40.837065+0000","last_became_active":"2024-09-17T05:42:38.804508+0000","last_became_peered":"2024-09-17T05:42:38.804508+0000","last_unstale":"2024-09-17T05:42:40.837065+0000","last_undegraded":"2024-09-17T05:42:40.837065+0000","last_fullsized":"2024-09-17T05:42:40.837065+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:42:37.772628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:42:37.772628+0000","last_clean_scrub_stamp":"2024-09-17T05:42:37.772628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:44:02.490887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":15,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-17T05:42:40.521963+0000","last_change":"2024-09-17T05:42:37.789708+0000","last_active":"2024-09-17T05:42:40.521963+0000","last_peered":"2024-09-17T05:42:40.521963+0000","last_clean":"2024-09-17T05:42:40.521963+0000","last_became_active":"2024-09-17T05:42:37.789299+0000","last_became_peered":"2024-09-17T05:42:37.789299+0000","last_unstale":"2024-09-17T05:42:40.521963+0000","last_undegraded":"2024-09-17T05:42:40.521963+0000","last_fullsized":"2024-09-17T05:42:40.521963+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:42:36.770435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:42:36.770435+0000","last_clean_scrub_stamp":"2024-09-17T05:42:36.770435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:09:15.481334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-17T05:42:40.837166+0000","last_change":"2024-09-17T05:42:38.802196+0000","last_active":"2024-09-17T05:42:40.837166+0000","last_peered":"2024-09-17T05:42:40.837166+0000","last_clean":"2024-09-17T05:42:40.837166+0000","last_became_active":"2024-09-17T05:42:38.801836+0000","last_became_peered":"2024-09-17T05:42:38.801836+0000","last_unstale":"2024-09-17T05:42:40.837166+0000","last_undegraded":"2024-09-17T05:42:40.837166+0000","last_fullsized":"2024-09-17T05:42:40.837166+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:42:37.772628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:42:37.772628+0000","last_clean_scrub_stamp":"2024-09-17T05:42:37.772628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:05:25.770777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":10,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T05:42:37.810685+0000","last_change":"2024-09-17T05:42:37.806715+0000","last_active":"2024-09-17T05:42:37.810685+0000","last_peered":"2024-09-17T05:42:37.810685+0000","last_clean":"2024-09-17T05:42:37.810685+0000","last_became_active":"2024-09-17T05:42:37.806401+0000","last_became_peered":"2024-09-17T05:42:37.806401+0000","last_unstale":"2024-09-17T05:42:37.810685+0000","last_undegraded":"2024-09-17T05:42:37.810685+0000","last_fullsized":"2024-09-17T05:42:37.810685+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:42:36.770435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:42:36.770435+0000","last_clean_scrub_stamp":"2024-09-17T05:42:36.770435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:17:40.016526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-17T05:42:40.837288+0000","last_change":"2024-09-17T05:42:38.797810+0000","last_active":"2024-09-17T05:42:40.837288+0000","last_peered":"2024-09-17T05:42:40.837288+0000","last_clean":"2024-09-17T05:42:40.837288+0000","last_became_active":"2024-09-17T05:42:38.796315+0000","last_became_peered":"2024-09-17T05:42:38.796315+0000","last_unstale":"2024-09-17T05:42:40.837288+0000","last_undegraded":"2024-09-17T05:42:40.837288+0000","last_fullsized":"2024-09-17T05:42:40.837288+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:42:37.772628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:42:37.772628+0000","last_clean_scrub_stamp":"2024-09-17T05:42:37.772628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:09:16.483527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":15,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-17T05:42:39.788131+0000","last_change":"2024-09-17T05:42:37.805124+0000","last_active":"2024-09-17T05:42:39.788131+0000","last_peered":"2024-09-17T05:42:39.788131+0000","last_clean":"2024-09-17T05:42:39.788131+0000","last_became_active":"2024-09-17T05:42:37.804866+0000","last_became_peered":"2024-09-17T05:42:37.804866+0000","last_unstale":"2024-09-17T05:42:39.788131+0000","last_undegraded":"2024-09-17T05:42:39.788131+0000","last_fullsized":"2024-09-17T05:42:39.788131+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:42:36.770435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:42:36.770435+0000","last_clean_scrub_stamp":"2024-09-17T05:42:36.770435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:46:38.031582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-17T05:42:40.837022+0000","last_change":"2024-09-17T05:42:38.797274+0000","last_active":"2024-09-17T05:42:40.837022+0000","last_peered":"2024-09-17T05:42:40.837022+0000","last_clean":"2024-09-17T05:42:40.837022+0000","last_became_active":"2024-09-17T05:42:38.796947+0000","last_became_peered":"2024-09-17T05:42:38.796947+0000","last_unstale":"2024-09-17T05:42:40.837022+0000","last_undegraded":"2024-09-17T05:42:40.837022+0000","last_fullsized":"2024-09-17T05:42:40.837022+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:42:37.772628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:42:37.772628+0000","last_clean_scrub_stamp":"2024-09-17T05:42:37.772628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:32:52.039358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":15,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-17T05:42:40.521606+0000","last_change":"2024-09-17T05:42:37.802039+0000","last_active":"2024-09-17T05:42:40.521606+0000","last_peered":"2024-09-17T05:42:40.521606+0000","last_clean":"2024-09-17T05:42:40.521606+0000","last_became_active":"2024-09-17T05:42:37.801719+0000","last_became_peered":"2024-09-17T05:42:37.801719+0000","last_unstale":"2024-09-17T05:42:40.521606+0000","last_undegraded":"2024-09-17T05:42:40.521606+0000","last_fullsized":"2024-09-17T05:42:40.521606+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:42:36.770435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:42:36.770435+0000","last_clean_scrub_stamp":"2024-09-17T05:42:36.770435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:39:18.681871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-17T05:42:39.788928+0000","last_change":"2024-09-17T05:42:38.800459+0000","last_active":"2024-09-17T05:42:39.788928+0000","last_peered":"2024-09-17T05:42:39.788928+0000","last_clean":"2024-09-17T05:42:39.788928+0000","last_became_active":"2024-09-17T05:42:38.800074+0000","last_became_peered":"2024-09-17T05:42:38.800074+0000","last_unstale":"2024-09-17T05:42:39.788928+0000","last_undegraded":"2024-09-17T05:42:39.788928+0000","last_fullsized":"2024-09-17T05:42:39.788928+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:42:37.772628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:42:37.772628+0000","last_clean_scrub_stamp":"2024-09-17T05:42:37.772628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:05:21.436685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":15,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-17T05:42:39.846965+0000","last_change":"2024-09-17T05:42:37.802800+0000","last_active":"2024-09-17T05:42:39.846965+0000","last_peered":"2024-09-17T05:42:39.846965+0000","last_clean":"2024-09-17T05:42:39.846965+0000","last_became_active":"2024-09-17T05:42:37.802451+0000","last_became_peered":"2024-09-17T05:42:37.802451+0000","last_unstale":"2024-09-17T05:42:39.846965+0000","last_undegraded":"2024-09-17T05:42:39.846965+0000","last_fullsized":"2024-09-17T05:42:39.846965+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:42:36.770435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:42:36.770435+0000","last_clean_scrub_stamp":"2024-09-17T05:42:36.770435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:26:38.326684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-17T05:42:40.837153+0000","last_change":"2024-09-17T05:42:38.811411+0000","last_active":"2024-09-17T05:42:40.837153+0000","last_peered":"2024-09-17T05:42:40.837153+0000","last_clean":"2024-09-17T05:42:40.837153+0000","last_became_active":"2024-09-17T05:42:38.810958+0000","last_became_peered":"2024-09-17T05:42:38.810958+0000","last_unstale":"2024-09-17T05:42:40.837153+0000","last_undegraded":"2024-09-17T05:42:40.837153+0000","last_fullsized":"2024-09-17T05:42:40.837153+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:42:37.772628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:42:37.772628+0000","last_clean_scrub_stamp":"2024-09-17T05:42:37.772628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:22:34.668025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"33'2","reported_seq":17,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-17T05:42:40.798059+0000","last_change":"2024-09-17T05:42:37.802205+0000","last_active":"2024-09-17T05:42:40.798059+0000","last_peered":"2024-09-17T05:42:40.798059+0000","last_clean":"2024-09-17T05:42:40.798059+0000","last_became_active":"2024-09-17T05:42:37.801813+0000","last_became_peered":"2024-09-17T05:42:37.801813+0000","last_unstale":"2024-09-17T05:42:40.798059+0000","last_undegraded":"2024-09-17T05:42:40.798059+0000","last_fullsized":"2024-09-17T05:42:40.798059+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:42:36.770435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:42:36.770435+0000","last_clean_scrub_stamp":"2024-09-17T05:42:36.770435+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:43:26.611720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-17T05:42:39.847774+0000","last_change":"2024-09-17T05:42:38.804765+0000","last_active":"2024-09-17T05:42:39.847774+0000","last_peered":"2024-09-17T05:42:39.847774+0000","last_clean":"2024-09-17T05:42:39.847774+0000","last_became_active":"2024-09-17T05:42:38.804428+0000","last_became_peered":"2024-09-17T05:42:38.804428+0000","last_unstale":"2024-09-17T05:42:39.847774+0000","last_undegraded":"2024-09-17T05:42:39.847774+0000","last_fullsized":"2024-09-17T05:42:39.847774+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:42:37.772628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:42:37.772628+0000","last_clean_scrub_stamp":"2024-09-17T05:42:37.772628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:00:24.792295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":10,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T05:42:37.810634+0000","last_change":"2024-09-17T05:42:37.805790+0000","last_active":"2024-09-17T05:42:37.810634+0000","last_peered":"2024-09-17T05:42:37.810634+0000","last_clean":"2024-09-17T05:42:37.810634+0000","last_became_active":"2024-09-17T05:42:37.805423+0000","last_became_peered":"2024-09-17T05:42:37.805423+0000","last_unstale":"2024-09-17T05:42:37.810634+0000","last_undegraded":"2024-09-17T05:42:37.810634+0000","last_fullsized":"2024-09-17T05:42:37.810634+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:42:36.770435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:42:36.770435+0000","last_clean_scrub_stamp":"2024-09-17T05:42:36.770435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:53:44.743537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-09-17T05:42:37.792487+0000","last_change":"2024-09-17T05:42:37.792487+0000","last_active":"2024-09-17T05:42:37.772628+0000","last_peered":"2024-09-17T05:42:37.772628+0000","last_clean":"2024-09-17T05:42:37.772628+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:42:37.792487+0000","last_undegraded":"2024-09-17T05:42:37.792487+0000","last_fullsized":"2024-09-17T05:42:37.792487+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:42:37.772628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:42:37.772628+0000","last_clean_scrub_stamp":"2024-09-17T05:42:37.772628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":15,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-17T05:42:40.797791+0000","last_change":"2024-09-17T05:42:37.805601+0000","last_active":"2024-09-17T05:42:40.797791+0000","last_peered":"2024-09-17T05:42:40.797791+0000","last_clean":"2024-09-17T05:42:40.797791+0000","last_became_active":"2024-09-17T05:42:37.805162+0000","last_became_peered":"2024-09-17T05:42:37.805162+0000","last_unstale":"2024-09-17T05:42:40.797791+0000","last_undegraded":"2024-09-17T05:42:40.797791+0000","last_fullsized":"2024-09-17T05:42:40.797791+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:42:36.770435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:42:36.770435+0000","last_clean_scrub_stamp":"2024-09-17T05:42:36.770435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:50:33.639876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-17T05:42:39.788059+0000","last_change":"2024-09-17T05:42:38.799674+0000","last_active":"2024-09-17T05:42:39.788059+0000","last_peered":"2024-09-17T05:42:39.788059+0000","last_clean":"2024-09-17T05:42:39.788059+0000","last_became_active":"2024-09-17T05:42:38.798334+0000","last_became_peered":"2024-09-17T05:42:38.798334+0000","last_unstale":"2024-09-17T05:42:39.788059+0000","last_undegraded":"2024-09-17T05:42:39.788059+0000","last_fullsized":"2024-09-17T05:42:39.788059+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:42:37.772628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:42:37.772628+0000","last_clean_scrub_stamp":"2024-09-17T05:42:37.772628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:11:54.209492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":10,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T05:42:37.800315+0000","last_change":"2024-09-17T05:42:37.796847+0000","last_active":"2024-09-17T05:42:37.800315+0000","last_peered":"2024-09-17T05:42:37.800315+0000","last_clean":"2024-09-17T05:42:37.800315+0000","last_became_active":"2024-09-17T05:42:37.796077+0000","last_became_peered":"2024-09-17T05:42:37.796077+0000","last_unstale":"2024-09-17T05:42:37.800315+0000","last_undegraded":"2024-09-17T05:42:37.800315+0000","last_fullsized":"2024-09-17T05:42:37.800315+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:42:36.770435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:42:36.770435+0000","last_clean_scrub_stamp":"2024-09-17T05:42:36.770435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:36:15.516715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-09-17T05:42:37.791659+0000","last_change":"2024-09-17T05:42:37.791659+0000","last_active":"2024-09-17T05:42:37.772628+0000","last_peered":"2024-09-17T05:42:37.772628+0000","last_clean":"2024-09-17T05:42:37.772628+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:42:37.791659+0000","last_undegraded":"2024-09-17T05:42:37.791659+0000","last_fullsized":"2024-09-17T05:42:37.791659+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:42:37.772628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:42:37.772628+0000","last_clean_scrub_stamp":"2024-09-17T05:42:37.772628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":15,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-17T05:42:40.797482+0000","last_change":"2024-09-17T05:42:37.802391+0000","last_active":"2024-09-17T05:42:40.797482+0000","last_peered":"2024-09-17T05:42:40.797482+0000","last_clean":"2024-09-17T05:42:40.797482+0000","last_became_active":"2024-09-17T05:42:37.802063+0000","last_became_peered":"2024-09-17T05:42:37.802063+0000","last_unstale":"2024-09-17T05:42:40.797482+0000","last_undegraded":"2024-09-17T05:42:40.797482+0000","last_fullsized":"2024-09-17T05:42:40.797482+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:42:36.770435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:42:36.770435+0000","last_clean_scrub_stamp":"2024-09-17T05:42:36.770435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:42:23.234276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-17T05:42:39.786278+0000","last_change":"2024-09-17T05:42:38.820142+0000","last_active":"2024-09-17T05:42:39.786278+0000","last_peered":"2024-09-17T05:42:39.786278+0000","last_clean":"2024-09-17T05:42:39.786278+0000","last_became_active":"2024-09-17T05:42:38.819558+0000","last_became_peered":"2024-09-17T05:42:38.819558+0000","last_unstale":"2024-09-17T05:42:39.786278+0000","last_undegraded":"2024-09-17T05:42:39.786278+0000","last_fullsized":"2024-09-17T05:42:39.786278+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:42:37.772628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:42:37.772628+0000","last_clean_scrub_stamp":"2024-09-17T05:42:37.772628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:14:51.758783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":15,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-17T05:42:40.521745+0000","last_change":"2024-09-17T05:42:37.790681+0000","last_active":"2024-09-17T05:42:40.521745+0000","last_peered":"2024-09-17T05:42:40.521745+0000","last_clean":"2024-09-17T05:42:40.521745+0000","last_became_active":"2024-09-17T05:42:37.790365+0000","last_became_peered":"2024-09-17T05:42:37.790365+0000","last_unstale":"2024-09-17T05:42:40.521745+0000","last_undegraded":"2024-09-17T05:42:40.521745+0000","last_fullsized":"2024-09-17T05:42:40.521745+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:42:36.770435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:42:36.770435+0000","last_clean_scrub_stamp":"2024-09-17T05:42:36.770435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:29:07.667338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-17T05:42:40.521796+0000","last_change":"2024-09-17T05:42:38.814045+0000","last_active":"2024-09-17T05:42:40.521796+0000","last_peered":"2024-09-17T05:42:40.521796+0000","last_clean":"2024-09-17T05:42:40.521796+0000","last_became_active":"2024-09-17T05:42:38.812842+0000","last_became_peered":"2024-09-17T05:42:38.812842+0000","last_unstale":"2024-09-17T05:42:40.521796+0000","last_undegraded":"2024-09-17T05:42:40.521796+0000","last_fullsized":"2024-09-17T05:42:40.521796+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:42:37.772628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:42:37.772628+0000","last_clean_scrub_stamp":"2024-09-17T05:42:37.772628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:58:52.289602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":15,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-17T05:42:39.786349+0000","last_change":"2024-09-17T05:42:37.804210+0000","last_active":"2024-09-17T05:42:39.786349+0000","last_peered":"2024-09-17T05:42:39.786349+0000","last_clean":"2024-09-17T05:42:39.786349+0000","last_became_active":"2024-09-17T05:42:37.803737+0000","last_became_peered":"2024-09-17T05:42:37.803737+0000","last_unstale":"2024-09-17T05:42:39.786349+0000","last_undegraded":"2024-09-17T05:42:39.786349+0000","last_fullsized":"2024-09-17T05:42:39.786349+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:42:36.770435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:42:36.770435+0000","last_clean_scrub_stamp":"2024-09-17T05:42:36.770435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:37:49.304309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-17T05:42:39.789268+0000","last_change":"2024-09-17T05:42:38.807775+0000","last_active":"2024-09-17T05:42:39.789268+0000","last_peered":"2024-09-17T05:42:39.789268+0000","last_clean":"2024-09-17T05:42:39.789268+0000","last_became_active":"2024-09-17T05:42:38.807458+0000","last_became_peered":"2024-09-17T05:42:38.807458+0000","last_unstale":"2024-09-17T05:42:39.789268+0000","last_undegraded":"2024-09-17T05:42:39.789268+0000","last_fullsized":"2024-09-17T05:42:39.789268+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:42:37.772628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:42:37.772628+0000","last_clean_scrub_stamp":"2024-09-17T05:42:37.772628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:50:12.834179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":15,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-17T05:42:39.788075+0000","last_change":"2024-09-17T05:42:37.799537+0000","last_active":"2024-09-17T05:42:39.788075+0000","last_peered":"2024-09-17T05:42:39.788075+0000","last_clean":"2024-09-17T05:42:39.788075+0000","last_became_active":"2024-09-17T05:42:37.799147+0000","last_became_peered":"2024-09-17T05:42:37.799147+0000","last_unstale":"2024-09-17T05:42:39.788075+0000","last_undegraded":"2024-09-17T05:42:39.788075+0000","last_fullsized":"2024-09-17T05:42:39.788075+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:42:36.770435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:42:36.770435+0000","last_clean_scrub_stamp":"2024-09-17T05:42:36.770435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:06:15.593910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"19'72","reported_seq":130,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-17T05:42:39.789515+0000","last_change":"2024-09-17T05:41:48.539830+0000","last_active":"2024-09-17T05:42:39.789515+0000","last_peered":"2024-09-17T05:42:39.789515+0000","last_clean":"2024-09-17T05:42:39.789515+0000","last_became_active":"2024-09-17T05:41:48.538743+0000","last_became_peered":"2024-09-17T05:41:48.538743+0000","last_unstale":"2024-09-17T05:42:39.789515+0000","last_undegraded":"2024-09-17T05:42:39.789515+0000","last_fullsized":"2024-09-17T05:42:39.789515+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:47.152539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:47.152539+0000","last_clean_scrub_stamp":"2024-09-17T05:41:47.152539+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:08:02.952016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":43,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":12,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":35,"ondisk_log_size":35,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":16,"seq":68719476752,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27404,"kb_used_data":376,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344436,"statfs":{"total":96636764160,"available":96608702464,"internally_reserved":0,"allocated":385024,"data_stored":145635,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":7,"up_from":15,"seq":64424509456,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27988,"kb_used_data":952,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343852,"statfs":{"total":96636764160,"available":96608104448,"internally_reserved":0,"allocated":974848,"data_stored":735477,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509455,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27408,"kb_used_data":376,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344432,"statfs":{"total":96636764160,"available":96608698368,"internally_reserved":0,"allocated":385024,"data_stored":145691,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509455,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27392,"kb_used_data":364,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344448,"statfs":{"total":96636764160,"available":96608714752,"internally_reserved":0,"allocated":372736,"data_stored":138823,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509455,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27420,"kb_used_data":384,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344420,"statfs":{"total":96636764160,"available":96608686080,"internally_reserved":0,"allocated":393216,"data_stored":146653,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509455,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27388,"kb_used_data":360,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344452,"statfs":{"total":96636764160,"available":96608718848,"internally_reserved":0,"allocated":368640,"data_stored":138789,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509455,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27400,"kb_used_data":372,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344440,"statfs":{"total":96636764160,"available":96608706560,"internally_reserved":0,"allocated":380928,"data_stored":140353,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574862,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27940,"kb_used_data":912,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343900,"statfs":{"total":96636764160,"available":96608153600,"internally_reserved":0,"allocated":933888,"data_stored":716045,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-17T05:42:43.555 INFO:tasks.ceph.ceph_manager.ceph:PG 5.29 is not active+clean 2024-09-17T05:42:43.555 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.29', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 32, 'state': 'creating+peering', 'last_fresh': '2024-09-17T05:42:37.787939+0000', 'last_change': '2024-09-17T05:42:37.787939+0000', 'last_active': '2024-09-17T05:42:37.772628+0000', 'last_peered': '2024-09-17T05:42:37.772628+0000', 'last_clean': '2024-09-17T05:42:37.772628+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:42:37.787939+0000', 'last_undegraded': '2024-09-17T05:42:37.787939+0000', 'last_fullsized': '2024-09-17T05:42:37.787939+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:42:37.772628+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:42:37.772628+0000', 'last_clean_scrub_stamp': '2024-09-17T05:42:37.772628+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 7], 'acting': [0, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-17T05:42:43.555 INFO:tasks.ceph.ceph_manager.ceph:PG 5.1e is not active+clean 2024-09-17T05:42:43.555 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.1e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 32, 'state': 'creating+peering', 'last_fresh': '2024-09-17T05:42:37.793868+0000', 'last_change': '2024-09-17T05:42:37.793868+0000', 'last_active': '2024-09-17T05:42:37.772628+0000', 'last_peered': '2024-09-17T05:42:37.772628+0000', 'last_clean': '2024-09-17T05:42:37.772628+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:42:37.793868+0000', 'last_undegraded': '2024-09-17T05:42:37.793868+0000', 'last_fullsized': '2024-09-17T05:42:37.793868+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:42:37.772628+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:42:37.772628+0000', 'last_clean_scrub_stamp': '2024-09-17T05:42:37.772628+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 7], 'acting': [0, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-17T05:42:43.555 INFO:tasks.ceph.ceph_manager.ceph:PG 5.5 is not active+clean 2024-09-17T05:42:43.555 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.5', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 32, 'state': 'creating+peering', 'last_fresh': '2024-09-17T05:42:37.792487+0000', 'last_change': '2024-09-17T05:42:37.792487+0000', 'last_active': '2024-09-17T05:42:37.772628+0000', 'last_peered': '2024-09-17T05:42:37.772628+0000', 'last_clean': '2024-09-17T05:42:37.772628+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:42:37.792487+0000', 'last_undegraded': '2024-09-17T05:42:37.792487+0000', 'last_fullsized': '2024-09-17T05:42:37.792487+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:42:37.772628+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:42:37.772628+0000', 'last_clean_scrub_stamp': '2024-09-17T05:42:37.772628+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-17T05:42:43.556 INFO:tasks.ceph.ceph_manager.ceph:PG 5.3 is not active+clean 2024-09-17T05:42:43.556 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.3', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 32, 'state': 'creating+peering', 'last_fresh': '2024-09-17T05:42:37.791659+0000', 'last_change': '2024-09-17T05:42:37.791659+0000', 'last_active': '2024-09-17T05:42:37.772628+0000', 'last_peered': '2024-09-17T05:42:37.772628+0000', 'last_clean': '2024-09-17T05:42:37.772628+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:42:37.791659+0000', 'last_undegraded': '2024-09-17T05:42:37.791659+0000', 'last_fullsized': '2024-09-17T05:42:37.791659+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:42:37.772628+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:42:37.772628+0000', 'last_clean_scrub_stamp': '2024-09-17T05:42:37.772628+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 6], 'acting': [0, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-17T05:42:43.556 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-09-17T05:42:43.705 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:43.704+0000 7ffad1007640 1 -- 172.21.15.150:0/2642401043 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ffab4004080 msgr2=0x7ffab4004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:43.705 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:43.704+0000 7ffad1007640 1 --2- 172.21.15.150:0/2642401043 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ffab4004080 0x7ffab4004800 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7ffac000c2e0 tx=0x7ffab4005830 comp rx=0 tx=0).stop 2024-09-17T05:42:43.705 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:43.704+0000 7ffacb59e640 1 -- 172.21.15.150:0/2642401043 reap_dead start 2024-09-17T05:42:43.705 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:43.704+0000 7ffad1007640 1 -- 172.21.15.150:0/2642401043 shutdown_connections 2024-09-17T05:42:43.705 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:43.704+0000 7ffad1007640 1 -- 172.21.15.150:0/2642401043 >> 172.21.15.150:0/2642401043 conn(0x7ffacc0cee90 msgr2=0x7ffacc0cf2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:42:43.705 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:43.704+0000 7ffad1007640 1 -- 172.21.15.150:0/2642401043 shutdown_connections 2024-09-17T05:42:43.706 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:43.704+0000 7ffad1007640 1 -- 172.21.15.150:0/2642401043 wait complete. 2024-09-17T05:42:43.707 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:43.706+0000 7ffad1007640 1 Processor -- start 2024-09-17T05:42:43.707 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:43.706+0000 7ffad1007640 1 -- start start 2024-09-17T05:42:43.710 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:43.708+0000 7ffad1007640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ffab4004080 0x7ffacc1d2090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:42:43.710 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:43.708+0000 7ffad1007640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ffacc1d50b0 0x7ffacc1d27e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:42:43.710 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:43.708+0000 7ffad1007640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ffacc1e48b0 0x7ffacc1e5ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:42:43.710 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:43.708+0000 7ffad1007640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7ffacc0d0870 con 0x7ffacc1e48b0 2024-09-17T05:42:43.710 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:43.708+0000 7ffad1007640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7ffacc0d06f0 con 0x7ffacc1d50b0 2024-09-17T05:42:43.710 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:43.708+0000 7ffad1007640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7ffacc0d09f0 con 0x7ffab4004080 2024-09-17T05:42:43.710 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:43.708+0000 7ffacb59e640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ffacc1e48b0 0x7ffacc1e5ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:42:43.710 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:43.708+0000 7ffacb59e640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ffacc1e48b0 0x7ffacc1e5ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:59776/0 (socket says 172.21.15.150:59776) 2024-09-17T05:42:43.710 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:43.708+0000 7ffacb59e640 1 -- 172.21.15.150:0/2523872239 learned_addr learned my addr 172.21.15.150:0/2523872239 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:42:43.710 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:43.708+0000 7ffacad9d640 1 --2- 172.21.15.150:0/2523872239 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ffab4004080 0x7ffacc1d2090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:42:43.710 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:43.708+0000 7ffaca59c640 1 --2- 172.21.15.150:0/2523872239 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ffacc1d50b0 0x7ffacc1d27e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:42:43.710 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:43.708+0000 7ffacb59e640 1 -- 172.21.15.150:0/2523872239 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ffab4004080 msgr2=0x7ffacc1d2090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:43.711 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:43.708+0000 7ffacb59e640 1 --2- 172.21.15.150:0/2523872239 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ffab4004080 0x7ffacc1d2090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:43.711 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:43.708+0000 7ffacb59e640 1 -- 172.21.15.150:0/2523872239 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ffacc1d50b0 msgr2=0x7ffacc1d27e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:43.711 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:43.708+0000 7ffacb59e640 1 --2- 172.21.15.150:0/2523872239 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ffacc1d50b0 0x7ffacc1d27e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:43.711 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:43.708+0000 7ffacb59e640 1 -- 172.21.15.150:0/2523872239 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffacc0c5f70 con 0x7ffacc1e48b0 2024-09-17T05:42:43.711 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:43.708+0000 7ffacb59e640 1 --2- 172.21.15.150:0/2523872239 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ffacc1e48b0 0x7ffacc1e5ee0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7ffac4005fd0 tx=0x7ffac4009a80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:42:43.711 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:43.708+0000 7ffab37fe640 1 -- 172.21.15.150:0/2523872239 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffac4004b20 con 0x7ffacc1e48b0 2024-09-17T05:42:43.711 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:43.708+0000 7ffab37fe640 1 -- 172.21.15.150:0/2523872239 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ffac4004db0 con 0x7ffacc1e48b0 2024-09-17T05:42:43.711 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:43.708+0000 7ffab37fe640 1 -- 172.21.15.150:0/2523872239 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffac4011970 con 0x7ffacc1e48b0 2024-09-17T05:42:43.711 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:43.708+0000 7ffad1007640 1 -- 172.21.15.150:0/2523872239 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffacc0c6250 con 0x7ffacc1e48b0 2024-09-17T05:42:43.711 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:43.709+0000 7ffad1007640 1 -- 172.21.15.150:0/2523872239 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffacc1d2e90 con 0x7ffacc1e48b0 2024-09-17T05:42:43.711 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:43.709+0000 7ffad1007640 1 -- 172.21.15.150:0/2523872239 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffacc0b7330 con 0x7ffacc1e48b0 2024-09-17T05:42:43.712 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:43.710+0000 7ffab37fe640 1 -- 172.21.15.150:0/2523872239 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7ffac401b020 con 0x7ffacc1e48b0 2024-09-17T05:42:43.712 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:43.711+0000 7ffab37fe640 1 --2- 172.21.15.150:0/2523872239 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7ffab8078bc0 0x7ffab807b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:42:43.712 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:43.711+0000 7ffab37fe640 1 -- 172.21.15.150:0/2523872239 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7ffac409ab60 con 0x7ffacc1e48b0 2024-09-17T05:42:43.712 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:43.711+0000 7ffacad9d640 1 --2- 172.21.15.150:0/2523872239 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7ffab8078bc0 0x7ffab807b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:42:43.713 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:43.711+0000 7ffacad9d640 1 --2- 172.21.15.150:0/2523872239 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7ffab8078bc0 0x7ffab807b0d0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7ffabc005fd0 tx=0x7ffabc00d410 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:42:43.715 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:43.715+0000 7ffab37fe640 1 -- 172.21.15.150:0/2523872239 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7ffac40629e0 con 0x7ffacc1e48b0 2024-09-17T05:42:43.961 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:43.960+0000 7ffad1007640 1 -- 172.21.15.150:0/2523872239 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) -- 0x7ffacc0b67c0 con 0x7ffacc1e48b0 2024-09-17T05:42:43.961 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:43.960+0000 7ffab37fe640 1 -- 172.21.15.150:0/2523872239 <== mon.0 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) ==== 72+0+2753 (secure 0 0 0) 0x7ffac4067410 con 0x7ffacc1e48b0 2024-09-17T05:42:43.961 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-09-17T05:42:43.961 INFO:teuthology.orchestra.run.smithi150.stdout:{"fsid":"9f2e05e9-d629-47b3-b26b-1360655b7d20","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":71,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":34,"num_osds":8,"num_up_osds":8,"osd_up_since":1726551706,"num_in_osds":8,"osd_in_since":1726551696,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":93},{"state_name":"creating+peering","count":4}],"num_pgs":97,"num_pools":3,"num_objects":22,"data_bytes":592778,"bytes_used":225628160,"bytes_avail":772868485120,"bytes_total":773094113280,"inactive_pgs_ratio":0.041237112134695053,"write_bytes_sec":2388,"read_op_per_sec":0,"write_op_per_sec":7},"fsmap":{"epoch":15,"btime":"2024-09-17T05:42:41:810497+0000","id":2,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":2,"rank":0,"name":"a","status":"up:active","gid":4938}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":3,"modified":"2024-09-17T05:42:38.853213+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}},"osd":{"daemons":{"summary":"","0":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"1":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"2":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"3":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"4":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"5":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"6":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"7":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2024-09-17T05:42:43.963 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:43.962+0000 7ffad1007640 1 -- 172.21.15.150:0/2523872239 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7ffab8078bc0 msgr2=0x7ffab807b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:43.963 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:43.962+0000 7ffad1007640 1 --2- 172.21.15.150:0/2523872239 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7ffab8078bc0 0x7ffab807b0d0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7ffabc005fd0 tx=0x7ffabc00d410 comp rx=0 tx=0).stop 2024-09-17T05:42:43.963 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:43.962+0000 7ffad1007640 1 -- 172.21.15.150:0/2523872239 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ffacc1e48b0 msgr2=0x7ffacc1e5ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:43.963 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:43.962+0000 7ffad1007640 1 --2- 172.21.15.150:0/2523872239 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ffacc1e48b0 0x7ffacc1e5ee0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7ffac4005fd0 tx=0x7ffac4009a80 comp rx=0 tx=0).stop 2024-09-17T05:42:43.963 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:43.962+0000 7ffad1007640 1 -- 172.21.15.150:0/2523872239 shutdown_connections 2024-09-17T05:42:43.963 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:43.962+0000 7ffad1007640 1 --2- 172.21.15.150:0/2523872239 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ffacc1d50b0 0x7ffacc1d27e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:43.963 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:43.962+0000 7ffad1007640 1 --2- 172.21.15.150:0/2523872239 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7ffab8078bc0 0x7ffab807b0d0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:43.964 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:43.962+0000 7ffad1007640 1 --2- 172.21.15.150:0/2523872239 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ffacc1e48b0 0x7ffacc1e5ee0 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:43.964 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:43.962+0000 7ffad1007640 1 --2- 172.21.15.150:0/2523872239 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ffab4004080 0x7ffacc1d2090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:43.964 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:43.962+0000 7ffad1007640 1 -- 172.21.15.150:0/2523872239 >> 172.21.15.150:0/2523872239 conn(0x7ffacc0cee90 msgr2=0x7ffacc0712d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:42:43.964 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:43.963+0000 7ffad1007640 1 -- 172.21.15.150:0/2523872239 shutdown_connections 2024-09-17T05:42:43.964 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:43.963+0000 7ffad1007640 1 -- 172.21.15.150:0/2523872239 wait complete. 2024-09-17T05:42:43.974 INFO:tasks.ceph.ceph_manager.ceph:no progress seen, keeping timeout for now 2024-09-17T05:42:43.974 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-17T05:42:44.088 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:44.087+0000 7f09da7a1640 1 -- 172.21.15.150:0/1465392630 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f09d40d0c50 msgr2=0x7f09d40d0010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:44.088 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:44.087+0000 7f09da7a1640 1 --2- 172.21.15.150:0/1465392630 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f09d40d0c50 0x7f09d40d0010 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f09d40d0960 tx=0x7f09c402a5d0 comp rx=0 tx=0).stop 2024-09-17T05:42:44.088 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:44.087+0000 7f09da7a1640 1 -- 172.21.15.150:0/1465392630 shutdown_connections 2024-09-17T05:42:44.088 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:44.087+0000 7f09da7a1640 1 --2- 172.21.15.150:0/1465392630 >> v2:172.21.15.176:3300/0 conn(0x7f09d40d1060 0x7f09d40b1fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:44.088 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:44.087+0000 7f09da7a1640 1 --2- 172.21.15.150:0/1465392630 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f09d40d0c50 0x7f09d40d0010 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:44.088 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:44.087+0000 7f09da7a1640 1 -- 172.21.15.150:0/1465392630 >> 172.21.15.150:0/1465392630 conn(0x7f09d40b3fc0 msgr2=0x7f09d40b43d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:42:44.089 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:44.087+0000 7f09da7a1640 1 -- 172.21.15.150:0/1465392630 shutdown_connections 2024-09-17T05:42:44.089 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:44.087+0000 7f09da7a1640 1 -- 172.21.15.150:0/1465392630 wait complete. 2024-09-17T05:42:44.089 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:44.089+0000 7f09da7a1640 1 Processor -- start 2024-09-17T05:42:44.089 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:44.089+0000 7f09da7a1640 1 -- start start 2024-09-17T05:42:44.092 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:44.090+0000 7f09da7a1640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f09d40d0550 0x7f09d415c9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:42:44.092 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:44.090+0000 7f09da7a1640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f09d40d0c50 0x7f09d40c7e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:42:44.092 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:44.090+0000 7f09da7a1640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f09d40d1060 0x7f09d41f6ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:42:44.092 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:44.090+0000 7f09da7a1640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f09d40ced30 con 0x7f09d40d0550 2024-09-17T05:42:44.093 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:44.090+0000 7f09da7a1640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f09d40cebb0 con 0x7f09d40d1060 2024-09-17T05:42:44.093 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:44.090+0000 7f09da7a1640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f09d40cd130 con 0x7f09d40d0c50 2024-09-17T05:42:44.093 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:44.091+0000 7f09d3fff640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f09d40d0550 0x7f09d415c9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:42:44.093 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:44.091+0000 7f09d3fff640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f09d40d0550 0x7f09d415c9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:59794/0 (socket says 172.21.15.150:59794) 2024-09-17T05:42:44.093 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:44.091+0000 7f09d3fff640 1 -- 172.21.15.150:0/3913072711 learned_addr learned my addr 172.21.15.150:0/3913072711 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:42:44.093 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:44.091+0000 7f09d8d3e640 1 --2- 172.21.15.150:0/3913072711 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f09d40d1060 0x7f09d41f6ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:42:44.093 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:44.091+0000 7f09d37fe640 1 --2- 172.21.15.150:0/3913072711 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f09d40d0c50 0x7f09d40c7e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:42:44.093 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:44.091+0000 7f09d3fff640 1 -- 172.21.15.150:0/3913072711 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f09d40d0c50 msgr2=0x7f09d40c7e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:44.093 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:44.091+0000 7f09d3fff640 1 --2- 172.21.15.150:0/3913072711 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f09d40d0c50 0x7f09d40c7e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:44.093 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:44.091+0000 7f09d3fff640 1 -- 172.21.15.150:0/3913072711 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f09d40d1060 msgr2=0x7f09d41f6ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:44.093 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:44.091+0000 7f09d3fff640 1 --2- 172.21.15.150:0/3913072711 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f09d40d1060 0x7f09d41f6ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:44.093 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:44.091+0000 7f09d3fff640 1 -- 172.21.15.150:0/3913072711 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f09d415cf30 con 0x7f09d40d0550 2024-09-17T05:42:44.093 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:44.091+0000 7f09d37fe640 1 --2- 172.21.15.150:0/3913072711 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f09d40d0c50 0x7f09d40c7e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T05:42:44.093 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:44.091+0000 7f09d3fff640 1 --2- 172.21.15.150:0/3913072711 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f09d40d0550 0x7f09d415c9f0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f09c4009920 tx=0x7f09c4033c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:42:44.094 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:44.091+0000 7f09d0ff9640 1 -- 172.21.15.150:0/3913072711 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f09c4033e10 con 0x7f09d40d0550 2024-09-17T05:42:44.094 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:44.091+0000 7f09d0ff9640 1 -- 172.21.15.150:0/3913072711 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f09c4031b60 con 0x7f09d40d0550 2024-09-17T05:42:44.094 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:44.091+0000 7f09da7a1640 1 -- 172.21.15.150:0/3913072711 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f09d40c8980 con 0x7f09d40d0550 2024-09-17T05:42:44.094 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:44.091+0000 7f09d0ff9640 1 -- 172.21.15.150:0/3913072711 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f09c4005020 con 0x7f09d40d0550 2024-09-17T05:42:44.094 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:44.091+0000 7f09da7a1640 1 -- 172.21.15.150:0/3913072711 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f09d40c9760 con 0x7f09d40d0550 2024-09-17T05:42:44.095 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:44.092+0000 7f09da7a1640 1 -- 172.21.15.150:0/3913072711 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f09d40d0010 con 0x7f09d40d0550 2024-09-17T05:42:44.095 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:44.093+0000 7f09d0ff9640 1 -- 172.21.15.150:0/3913072711 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f09c4045020 con 0x7f09d40d0550 2024-09-17T05:42:44.095 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:44.094+0000 7f09d0ff9640 1 --2- 172.21.15.150:0/3913072711 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f09c0078bc0 0x7f09c007b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:42:44.095 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:44.094+0000 7f09d0ff9640 1 -- 172.21.15.150:0/3913072711 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7f09c40bb570 con 0x7f09d40d0550 2024-09-17T05:42:44.095 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:44.094+0000 7f09d37fe640 1 --2- 172.21.15.150:0/3913072711 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f09c0078bc0 0x7f09c007b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:42:44.095 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:44.094+0000 7f09d37fe640 1 --2- 172.21.15.150:0/3913072711 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f09c0078bc0 0x7f09c007b0d0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f09d40cc8d0 tx=0x7f09c8009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:42:44.099 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:44.098+0000 7f09d0ff9640 1 -- 172.21.15.150:0/3913072711 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f09c40839b0 con 0x7f09d40d0550 2024-09-17T05:42:44.272 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:44.272+0000 7f09da7a1640 1 -- 172.21.15.150:0/3913072711 --> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f09d40b03f0 con 0x7f09c0078bc0 2024-09-17T05:42:44.277 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:44.277+0000 7f09d0ff9640 1 -- 172.21.15.150:0/3913072711 <== mgr.4108 v2:172.21.15.176:6800/3631216395 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251611 (secure 0 0 0) 0x7f09d40b03f0 con 0x7f09c0078bc0 2024-09-17T05:42:44.280 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-09-17T05:42:44.281 INFO:teuthology.orchestra.run.smithi150.stderr:dumped all 2024-09-17T05:42:44.283 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:44.280+0000 7f09da7a1640 1 -- 172.21.15.150:0/3913072711 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f09c0078bc0 msgr2=0x7f09c007b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:44.283 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:44.280+0000 7f09da7a1640 1 --2- 172.21.15.150:0/3913072711 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f09c0078bc0 0x7f09c007b0d0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f09d40cc8d0 tx=0x7f09c8009040 comp rx=0 tx=0).stop 2024-09-17T05:42:44.283 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:44.280+0000 7f09da7a1640 1 -- 172.21.15.150:0/3913072711 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f09d40d0550 msgr2=0x7f09d415c9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:44.283 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:44.280+0000 7f09da7a1640 1 --2- 172.21.15.150:0/3913072711 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f09d40d0550 0x7f09d415c9f0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f09c4009920 tx=0x7f09c4033c20 comp rx=0 tx=0).stop 2024-09-17T05:42:44.283 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:44.280+0000 7f09da7a1640 1 -- 172.21.15.150:0/3913072711 shutdown_connections 2024-09-17T05:42:44.283 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:44.280+0000 7f09da7a1640 1 --2- 172.21.15.150:0/3913072711 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f09d40d1060 0x7f09d41f6ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:44.283 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:44.280+0000 7f09da7a1640 1 --2- 172.21.15.150:0/3913072711 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f09c0078bc0 0x7f09c007b0d0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:44.283 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:44.280+0000 7f09da7a1640 1 --2- 172.21.15.150:0/3913072711 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f09d40d0c50 0x7f09d40c7e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:44.283 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:44.280+0000 7f09da7a1640 1 --2- 172.21.15.150:0/3913072711 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f09d40d0550 0x7f09d415c9f0 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:44.284 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:44.280+0000 7f09da7a1640 1 -- 172.21.15.150:0/3913072711 >> 172.21.15.150:0/3913072711 conn(0x7f09d40b3fc0 msgr2=0x7f09d4071280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:42:44.284 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:44.280+0000 7f09da7a1640 1 -- 172.21.15.150:0/3913072711 shutdown_connections 2024-09-17T05:42:44.284 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:44.280+0000 7f09da7a1640 1 -- 172.21.15.150:0/3913072711 wait complete. 2024-09-17T05:42:44.292 INFO:teuthology.orchestra.run.smithi150.stdout:{"pg_ready":true,"pg_map":{"version":57,"stamp":"2024-09-17T05:42:42.853968+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":144,"num_write_kb":1642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":12,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":107,"ondisk_log_size":107,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":139,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":220340,"kb_used_data":4096,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754754380,"statfs":{"total":773094113280,"available":772868485120,"internally_reserved":0,"allocated":4194304,"data_stored":2307466,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":31,"apply_latency_ms":31,"commit_latency_ns":31000000,"apply_latency_ns":31000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":43,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":12,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001232"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-17T05:42:39.788326+0000","last_change":"2024-09-17T05:42:38.809600+0000","last_active":"2024-09-17T05:42:39.788326+0000","last_peered":"2024-09-17T05:42:39.788326+0000","last_clean":"2024-09-17T05:42:39.788326+0000","last_became_active":"2024-09-17T05:42:38.809252+0000","last_became_peered":"2024-09-17T05:42:38.809252+0000","last_unstale":"2024-09-17T05:42:39.788326+0000","last_undegraded":"2024-09-17T05:42:39.788326+0000","last_fullsized":"2024-09-17T05:42:39.788326+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:42:37.772628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:42:37.772628+0000","last_clean_scrub_stamp":"2024-09-17T05:42:37.772628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:29:00.810568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-17T05:42:39.787003+0000","last_change":"2024-09-17T05:42:38.810370+0000","last_active":"2024-09-17T05:42:39.787003+0000","last_peered":"2024-09-17T05:42:39.787003+0000","last_clean":"2024-09-17T05:42:39.787003+0000","last_became_active":"2024-09-17T05:42:38.809996+0000","last_became_peered":"2024-09-17T05:42:38.809996+0000","last_unstale":"2024-09-17T05:42:39.787003+0000","last_undegraded":"2024-09-17T05:42:39.787003+0000","last_fullsized":"2024-09-17T05:42:39.787003+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:42:37.772628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:42:37.772628+0000","last_clean_scrub_stamp":"2024-09-17T05:42:37.772628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:14:56.692341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-17T05:42:39.847318+0000","last_change":"2024-09-17T05:42:38.807299+0000","last_active":"2024-09-17T05:42:39.847318+0000","last_peered":"2024-09-17T05:42:39.847318+0000","last_clean":"2024-09-17T05:42:39.847318+0000","last_became_active":"2024-09-17T05:42:38.806807+0000","last_became_peered":"2024-09-17T05:42:38.806807+0000","last_unstale":"2024-09-17T05:42:39.847318+0000","last_undegraded":"2024-09-17T05:42:39.847318+0000","last_fullsized":"2024-09-17T05:42:39.847318+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:42:37.772628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:42:37.772628+0000","last_clean_scrub_stamp":"2024-09-17T05:42:37.772628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:48:13.659827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-17T05:42:40.797628+0000","last_change":"2024-09-17T05:42:38.818758+0000","last_active":"2024-09-17T05:42:40.797628+0000","last_peered":"2024-09-17T05:42:40.797628+0000","last_clean":"2024-09-17T05:42:40.797628+0000","last_became_active":"2024-09-17T05:42:38.817788+0000","last_became_peered":"2024-09-17T05:42:38.817788+0000","last_unstale":"2024-09-17T05:42:40.797628+0000","last_undegraded":"2024-09-17T05:42:40.797628+0000","last_fullsized":"2024-09-17T05:42:40.797628+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:42:37.772628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:42:37.772628+0000","last_clean_scrub_stamp":"2024-09-17T05:42:37.772628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:31:05.241317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-17T05:42:40.837070+0000","last_change":"2024-09-17T05:42:38.813119+0000","last_active":"2024-09-17T05:42:40.837070+0000","last_peered":"2024-09-17T05:42:40.837070+0000","last_clean":"2024-09-17T05:42:40.837070+0000","last_became_active":"2024-09-17T05:42:38.812772+0000","last_became_peered":"2024-09-17T05:42:38.812772+0000","last_unstale":"2024-09-17T05:42:40.837070+0000","last_undegraded":"2024-09-17T05:42:40.837070+0000","last_fullsized":"2024-09-17T05:42:40.837070+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:42:37.772628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:42:37.772628+0000","last_clean_scrub_stamp":"2024-09-17T05:42:37.772628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:29:08.669531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-17T05:42:39.786425+0000","last_change":"2024-09-17T05:42:38.816796+0000","last_active":"2024-09-17T05:42:39.786425+0000","last_peered":"2024-09-17T05:42:39.786425+0000","last_clean":"2024-09-17T05:42:39.786425+0000","last_became_active":"2024-09-17T05:42:38.816470+0000","last_became_peered":"2024-09-17T05:42:38.816470+0000","last_unstale":"2024-09-17T05:42:39.786425+0000","last_undegraded":"2024-09-17T05:42:39.786425+0000","last_fullsized":"2024-09-17T05:42:39.786425+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:42:37.772628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:42:37.772628+0000","last_clean_scrub_stamp":"2024-09-17T05:42:37.772628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:56:23.468850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-17T05:42:39.789536+0000","last_change":"2024-09-17T05:42:38.802573+0000","last_active":"2024-09-17T05:42:39.789536+0000","last_peered":"2024-09-17T05:42:39.789536+0000","last_clean":"2024-09-17T05:42:39.789536+0000","last_became_active":"2024-09-17T05:42:38.802290+0000","last_became_peered":"2024-09-17T05:42:38.802290+0000","last_unstale":"2024-09-17T05:42:39.789536+0000","last_undegraded":"2024-09-17T05:42:39.789536+0000","last_fullsized":"2024-09-17T05:42:39.789536+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:42:37.772628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:42:37.772628+0000","last_clean_scrub_stamp":"2024-09-17T05:42:37.772628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:45:42.335613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-17T05:42:39.788983+0000","last_change":"2024-09-17T05:42:38.804796+0000","last_active":"2024-09-17T05:42:39.788983+0000","last_peered":"2024-09-17T05:42:39.788983+0000","last_clean":"2024-09-17T05:42:39.788983+0000","last_became_active":"2024-09-17T05:42:38.804489+0000","last_became_peered":"2024-09-17T05:42:38.804489+0000","last_unstale":"2024-09-17T05:42:39.788983+0000","last_undegraded":"2024-09-17T05:42:39.788983+0000","last_fullsized":"2024-09-17T05:42:39.788983+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:42:37.772628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:42:37.772628+0000","last_clean_scrub_stamp":"2024-09-17T05:42:37.772628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:44:58.328573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-17T05:42:40.522284+0000","last_change":"2024-09-17T05:42:38.811030+0000","last_active":"2024-09-17T05:42:40.522284+0000","last_peered":"2024-09-17T05:42:40.522284+0000","last_clean":"2024-09-17T05:42:40.522284+0000","last_became_active":"2024-09-17T05:42:38.810688+0000","last_became_peered":"2024-09-17T05:42:38.810688+0000","last_unstale":"2024-09-17T05:42:40.522284+0000","last_undegraded":"2024-09-17T05:42:40.522284+0000","last_fullsized":"2024-09-17T05:42:40.522284+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:42:37.772628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:42:37.772628+0000","last_clean_scrub_stamp":"2024-09-17T05:42:37.772628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:21:58.970437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-17T05:42:40.797911+0000","last_change":"2024-09-17T05:42:38.818223+0000","last_active":"2024-09-17T05:42:40.797911+0000","last_peered":"2024-09-17T05:42:40.797911+0000","last_clean":"2024-09-17T05:42:40.797911+0000","last_became_active":"2024-09-17T05:42:38.817887+0000","last_became_peered":"2024-09-17T05:42:38.817887+0000","last_unstale":"2024-09-17T05:42:40.797911+0000","last_undegraded":"2024-09-17T05:42:40.797911+0000","last_fullsized":"2024-09-17T05:42:40.797911+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:42:37.772628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:42:37.772628+0000","last_clean_scrub_stamp":"2024-09-17T05:42:37.772628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:56:29.121255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-17T05:42:39.789271+0000","last_change":"2024-09-17T05:42:38.811781+0000","last_active":"2024-09-17T05:42:39.789271+0000","last_peered":"2024-09-17T05:42:39.789271+0000","last_clean":"2024-09-17T05:42:39.789271+0000","last_became_active":"2024-09-17T05:42:38.811496+0000","last_became_peered":"2024-09-17T05:42:38.811496+0000","last_unstale":"2024-09-17T05:42:39.789271+0000","last_undegraded":"2024-09-17T05:42:39.789271+0000","last_fullsized":"2024-09-17T05:42:39.789271+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:42:37.772628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:42:37.772628+0000","last_clean_scrub_stamp":"2024-09-17T05:42:37.772628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:14:51.758783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-17T05:42:39.847447+0000","last_change":"2024-09-17T05:42:38.815672+0000","last_active":"2024-09-17T05:42:39.847447+0000","last_peered":"2024-09-17T05:42:39.847447+0000","last_clean":"2024-09-17T05:42:39.847447+0000","last_became_active":"2024-09-17T05:42:38.815304+0000","last_became_peered":"2024-09-17T05:42:38.815304+0000","last_unstale":"2024-09-17T05:42:39.847447+0000","last_undegraded":"2024-09-17T05:42:39.847447+0000","last_fullsized":"2024-09-17T05:42:39.847447+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:42:37.772628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:42:37.772628+0000","last_clean_scrub_stamp":"2024-09-17T05:42:37.772628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:45:42.335613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-17T05:42:40.837016+0000","last_change":"2024-09-17T05:42:38.811245+0000","last_active":"2024-09-17T05:42:40.837016+0000","last_peered":"2024-09-17T05:42:40.837016+0000","last_clean":"2024-09-17T05:42:40.837016+0000","last_became_active":"2024-09-17T05:42:38.809546+0000","last_became_peered":"2024-09-17T05:42:38.809546+0000","last_unstale":"2024-09-17T05:42:40.837016+0000","last_undegraded":"2024-09-17T05:42:40.837016+0000","last_fullsized":"2024-09-17T05:42:40.837016+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:42:37.772628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:42:37.772628+0000","last_clean_scrub_stamp":"2024-09-17T05:42:37.772628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:49:05.954213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-17T05:42:39.786411+0000","last_change":"2024-09-17T05:42:38.817500+0000","last_active":"2024-09-17T05:42:39.786411+0000","last_peered":"2024-09-17T05:42:39.786411+0000","last_clean":"2024-09-17T05:42:39.786411+0000","last_became_active":"2024-09-17T05:42:38.816684+0000","last_became_peered":"2024-09-17T05:42:38.816684+0000","last_unstale":"2024-09-17T05:42:39.786411+0000","last_undegraded":"2024-09-17T05:42:39.786411+0000","last_fullsized":"2024-09-17T05:42:39.786411+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:42:37.772628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:42:37.772628+0000","last_clean_scrub_stamp":"2024-09-17T05:42:37.772628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:59:25.322085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-17T05:42:39.847253+0000","last_change":"2024-09-17T05:42:38.804339+0000","last_active":"2024-09-17T05:42:39.847253+0000","last_peered":"2024-09-17T05:42:39.847253+0000","last_clean":"2024-09-17T05:42:39.847253+0000","last_became_active":"2024-09-17T05:42:38.803924+0000","last_became_peered":"2024-09-17T05:42:38.803924+0000","last_unstale":"2024-09-17T05:42:39.847253+0000","last_undegraded":"2024-09-17T05:42:39.847253+0000","last_fullsized":"2024-09-17T05:42:39.847253+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:42:37.772628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:42:37.772628+0000","last_clean_scrub_stamp":"2024-09-17T05:42:37.772628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:06:11.277950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-17T05:42:39.789462+0000","last_change":"2024-09-17T05:42:38.815849+0000","last_active":"2024-09-17T05:42:39.789462+0000","last_peered":"2024-09-17T05:42:39.789462+0000","last_clean":"2024-09-17T05:42:39.789462+0000","last_became_active":"2024-09-17T05:42:38.815296+0000","last_became_peered":"2024-09-17T05:42:38.815296+0000","last_unstale":"2024-09-17T05:42:39.789462+0000","last_undegraded":"2024-09-17T05:42:39.789462+0000","last_fullsized":"2024-09-17T05:42:39.789462+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:42:37.772628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:42:37.772628+0000","last_clean_scrub_stamp":"2024-09-17T05:42:37.772628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:56:23.468850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-17T05:42:39.789530+0000","last_change":"2024-09-17T05:42:38.803948+0000","last_active":"2024-09-17T05:42:39.789530+0000","last_peered":"2024-09-17T05:42:39.789530+0000","last_clean":"2024-09-17T05:42:39.789530+0000","last_became_active":"2024-09-17T05:42:38.803640+0000","last_became_peered":"2024-09-17T05:42:38.803640+0000","last_unstale":"2024-09-17T05:42:39.789530+0000","last_undegraded":"2024-09-17T05:42:39.789530+0000","last_fullsized":"2024-09-17T05:42:39.789530+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:42:37.772628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:42:37.772628+0000","last_clean_scrub_stamp":"2024-09-17T05:42:37.772628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:01:56.852587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-17T05:42:39.787019+0000","last_change":"2024-09-17T05:42:38.820211+0000","last_active":"2024-09-17T05:42:39.787019+0000","last_peered":"2024-09-17T05:42:39.787019+0000","last_clean":"2024-09-17T05:42:39.787019+0000","last_became_active":"2024-09-17T05:42:38.819891+0000","last_became_peered":"2024-09-17T05:42:38.819891+0000","last_unstale":"2024-09-17T05:42:39.787019+0000","last_undegraded":"2024-09-17T05:42:39.787019+0000","last_fullsized":"2024-09-17T05:42:39.787019+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:42:37.772628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:42:37.772628+0000","last_clean_scrub_stamp":"2024-09-17T05:42:37.772628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:00:28.428098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-17T05:42:39.786739+0000","last_change":"2024-09-17T05:42:38.820057+0000","last_active":"2024-09-17T05:42:39.786739+0000","last_peered":"2024-09-17T05:42:39.786739+0000","last_clean":"2024-09-17T05:42:39.786739+0000","last_became_active":"2024-09-17T05:42:38.819752+0000","last_became_peered":"2024-09-17T05:42:38.819752+0000","last_unstale":"2024-09-17T05:42:39.786739+0000","last_undegraded":"2024-09-17T05:42:39.786739+0000","last_fullsized":"2024-09-17T05:42:39.786739+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:42:37.772628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:42:37.772628+0000","last_clean_scrub_stamp":"2024-09-17T05:42:37.772628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:57:09.386461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-17T05:42:40.837357+0000","last_change":"2024-09-17T05:42:38.809007+0000","last_active":"2024-09-17T05:42:40.837357+0000","last_peered":"2024-09-17T05:42:40.837357+0000","last_clean":"2024-09-17T05:42:40.837357+0000","last_became_active":"2024-09-17T05:42:38.808669+0000","last_became_peered":"2024-09-17T05:42:38.808669+0000","last_unstale":"2024-09-17T05:42:40.837357+0000","last_undegraded":"2024-09-17T05:42:40.837357+0000","last_fullsized":"2024-09-17T05:42:40.837357+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:42:37.772628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:42:37.772628+0000","last_clean_scrub_stamp":"2024-09-17T05:42:37.772628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:57:21.510110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-17T05:42:40.521773+0000","last_change":"2024-09-17T05:42:38.802973+0000","last_active":"2024-09-17T05:42:40.521773+0000","last_peered":"2024-09-17T05:42:40.521773+0000","last_clean":"2024-09-17T05:42:40.521773+0000","last_became_active":"2024-09-17T05:42:38.802601+0000","last_became_peered":"2024-09-17T05:42:38.802601+0000","last_unstale":"2024-09-17T05:42:40.521773+0000","last_undegraded":"2024-09-17T05:42:40.521773+0000","last_fullsized":"2024-09-17T05:42:40.521773+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:42:37.772628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:42:37.772628+0000","last_clean_scrub_stamp":"2024-09-17T05:42:37.772628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:50:47.581671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-17T05:42:40.521996+0000","last_change":"2024-09-17T05:42:38.813252+0000","last_active":"2024-09-17T05:42:40.521996+0000","last_peered":"2024-09-17T05:42:40.521996+0000","last_clean":"2024-09-17T05:42:40.521996+0000","last_became_active":"2024-09-17T05:42:38.812790+0000","last_became_peered":"2024-09-17T05:42:38.812790+0000","last_unstale":"2024-09-17T05:42:40.521996+0000","last_undegraded":"2024-09-17T05:42:40.521996+0000","last_fullsized":"2024-09-17T05:42:40.521996+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:42:37.772628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:42:37.772628+0000","last_clean_scrub_stamp":"2024-09-17T05:42:37.772628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:46:13.440636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-09-17T05:42:37.787939+0000","last_change":"2024-09-17T05:42:37.787939+0000","last_active":"2024-09-17T05:42:37.772628+0000","last_peered":"2024-09-17T05:42:37.772628+0000","last_clean":"2024-09-17T05:42:37.772628+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:42:37.787939+0000","last_undegraded":"2024-09-17T05:42:37.787939+0000","last_fullsized":"2024-09-17T05:42:37.787939+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:42:37.772628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:42:37.772628+0000","last_clean_scrub_stamp":"2024-09-17T05:42:37.772628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-17T05:42:39.847210+0000","last_change":"2024-09-17T05:42:38.808579+0000","last_active":"2024-09-17T05:42:39.847210+0000","last_peered":"2024-09-17T05:42:39.847210+0000","last_clean":"2024-09-17T05:42:39.847210+0000","last_became_active":"2024-09-17T05:42:38.808256+0000","last_became_peered":"2024-09-17T05:42:38.808256+0000","last_unstale":"2024-09-17T05:42:39.847210+0000","last_undegraded":"2024-09-17T05:42:39.847210+0000","last_fullsized":"2024-09-17T05:42:39.847210+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:42:37.772628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:42:37.772628+0000","last_clean_scrub_stamp":"2024-09-17T05:42:37.772628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:05:21.436685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-17T05:42:40.798046+0000","last_change":"2024-09-17T05:42:38.804818+0000","last_active":"2024-09-17T05:42:40.798046+0000","last_peered":"2024-09-17T05:42:40.798046+0000","last_clean":"2024-09-17T05:42:40.798046+0000","last_became_active":"2024-09-17T05:42:38.804487+0000","last_became_peered":"2024-09-17T05:42:38.804487+0000","last_unstale":"2024-09-17T05:42:40.798046+0000","last_undegraded":"2024-09-17T05:42:40.798046+0000","last_fullsized":"2024-09-17T05:42:40.798046+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:42:37.772628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:42:37.772628+0000","last_clean_scrub_stamp":"2024-09-17T05:42:37.772628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:11:24.017133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-17T05:42:39.787129+0000","last_change":"2024-09-17T05:42:38.812656+0000","last_active":"2024-09-17T05:42:39.787129+0000","last_peered":"2024-09-17T05:42:39.787129+0000","last_clean":"2024-09-17T05:42:39.787129+0000","last_became_active":"2024-09-17T05:42:38.812215+0000","last_became_peered":"2024-09-17T05:42:38.812215+0000","last_unstale":"2024-09-17T05:42:39.787129+0000","last_undegraded":"2024-09-17T05:42:39.787129+0000","last_fullsized":"2024-09-17T05:42:39.787129+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:42:37.772628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:42:37.772628+0000","last_clean_scrub_stamp":"2024-09-17T05:42:37.772628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:01:06.983156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-17T05:42:40.798003+0000","last_change":"2024-09-17T05:42:38.818086+0000","last_active":"2024-09-17T05:42:40.798003+0000","last_peered":"2024-09-17T05:42:40.798003+0000","last_clean":"2024-09-17T05:42:40.798003+0000","last_became_active":"2024-09-17T05:42:38.817663+0000","last_became_peered":"2024-09-17T05:42:38.817663+0000","last_unstale":"2024-09-17T05:42:40.798003+0000","last_undegraded":"2024-09-17T05:42:40.798003+0000","last_fullsized":"2024-09-17T05:42:40.798003+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:42:37.772628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:42:37.772628+0000","last_clean_scrub_stamp":"2024-09-17T05:42:37.772628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:05:21.436685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-17T05:42:39.847443+0000","last_change":"2024-09-17T05:42:38.805594+0000","last_active":"2024-09-17T05:42:39.847443+0000","last_peered":"2024-09-17T05:42:39.847443+0000","last_clean":"2024-09-17T05:42:39.847443+0000","last_became_active":"2024-09-17T05:42:38.804957+0000","last_became_peered":"2024-09-17T05:42:38.804957+0000","last_unstale":"2024-09-17T05:42:39.847443+0000","last_undegraded":"2024-09-17T05:42:39.847443+0000","last_fullsized":"2024-09-17T05:42:39.847443+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:42:37.772628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:42:37.772628+0000","last_clean_scrub_stamp":"2024-09-17T05:42:37.772628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:56:23.468850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-17T05:42:40.521839+0000","last_change":"2024-09-17T05:42:38.814787+0000","last_active":"2024-09-17T05:42:40.521839+0000","last_peered":"2024-09-17T05:42:40.521839+0000","last_clean":"2024-09-17T05:42:40.521839+0000","last_became_active":"2024-09-17T05:42:38.814444+0000","last_became_peered":"2024-09-17T05:42:38.814444+0000","last_unstale":"2024-09-17T05:42:40.521839+0000","last_undegraded":"2024-09-17T05:42:40.521839+0000","last_fullsized":"2024-09-17T05:42:40.521839+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:42:37.772628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:42:37.772628+0000","last_clean_scrub_stamp":"2024-09-17T05:42:37.772628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:33:11.874170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-17T05:42:39.788977+0000","last_change":"2024-09-17T05:42:38.800573+0000","last_active":"2024-09-17T05:42:39.788977+0000","last_peered":"2024-09-17T05:42:39.788977+0000","last_clean":"2024-09-17T05:42:39.788977+0000","last_became_active":"2024-09-17T05:42:38.800170+0000","last_became_peered":"2024-09-17T05:42:38.800170+0000","last_unstale":"2024-09-17T05:42:39.788977+0000","last_undegraded":"2024-09-17T05:42:39.788977+0000","last_fullsized":"2024-09-17T05:42:39.788977+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:42:37.772628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:42:37.772628+0000","last_clean_scrub_stamp":"2024-09-17T05:42:37.772628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:11:24.017133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-17T05:42:39.787984+0000","last_change":"2024-09-17T05:42:38.798553+0000","last_active":"2024-09-17T05:42:39.787984+0000","last_peered":"2024-09-17T05:42:39.787984+0000","last_clean":"2024-09-17T05:42:39.787984+0000","last_became_active":"2024-09-17T05:42:38.798026+0000","last_became_peered":"2024-09-17T05:42:38.798026+0000","last_unstale":"2024-09-17T05:42:39.787984+0000","last_undegraded":"2024-09-17T05:42:39.787984+0000","last_fullsized":"2024-09-17T05:42:39.787984+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:42:37.772628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:42:37.772628+0000","last_clean_scrub_stamp":"2024-09-17T05:42:37.772628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:35:43.722989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-17T05:42:39.788784+0000","last_change":"2024-09-17T05:42:38.809055+0000","last_active":"2024-09-17T05:42:39.788784+0000","last_peered":"2024-09-17T05:42:39.788784+0000","last_clean":"2024-09-17T05:42:39.788784+0000","last_became_active":"2024-09-17T05:42:38.808725+0000","last_became_peered":"2024-09-17T05:42:38.808725+0000","last_unstale":"2024-09-17T05:42:39.788784+0000","last_undegraded":"2024-09-17T05:42:39.788784+0000","last_fullsized":"2024-09-17T05:42:39.788784+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:42:37.772628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:42:37.772628+0000","last_clean_scrub_stamp":"2024-09-17T05:42:37.772628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:56:29.121255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-09-17T05:42:37.793868+0000","last_change":"2024-09-17T05:42:37.793868+0000","last_active":"2024-09-17T05:42:37.772628+0000","last_peered":"2024-09-17T05:42:37.772628+0000","last_clean":"2024-09-17T05:42:37.772628+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:42:37.793868+0000","last_undegraded":"2024-09-17T05:42:37.793868+0000","last_fullsized":"2024-09-17T05:42:37.793868+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:42:37.772628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:42:37.772628+0000","last_clean_scrub_stamp":"2024-09-17T05:42:37.772628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"33'4","reported_seq":19,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-17T05:42:39.788402+0000","last_change":"2024-09-17T05:42:37.796176+0000","last_active":"2024-09-17T05:42:39.788402+0000","last_peered":"2024-09-17T05:42:39.788402+0000","last_clean":"2024-09-17T05:42:39.788402+0000","last_became_active":"2024-09-17T05:42:37.795881+0000","last_became_peered":"2024-09-17T05:42:37.795881+0000","last_unstale":"2024-09-17T05:42:39.788402+0000","last_undegraded":"2024-09-17T05:42:39.788402+0000","last_fullsized":"2024-09-17T05:42:39.788402+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:42:36.770435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:42:36.770435+0000","last_clean_scrub_stamp":"2024-09-17T05:42:36.770435+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:56:54.491587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-17T05:42:39.788424+0000","last_change":"2024-09-17T05:42:38.809796+0000","last_active":"2024-09-17T05:42:39.788424+0000","last_peered":"2024-09-17T05:42:39.788424+0000","last_clean":"2024-09-17T05:42:39.788424+0000","last_became_active":"2024-09-17T05:42:38.809498+0000","last_became_peered":"2024-09-17T05:42:38.809498+0000","last_unstale":"2024-09-17T05:42:39.788424+0000","last_undegraded":"2024-09-17T05:42:39.788424+0000","last_fullsized":"2024-09-17T05:42:39.788424+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:42:37.772628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:42:37.772628+0000","last_clean_scrub_stamp":"2024-09-17T05:42:37.772628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:31:04.584637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":10,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T05:42:37.805843+0000","last_change":"2024-09-17T05:42:37.802980+0000","last_active":"2024-09-17T05:42:37.805843+0000","last_peered":"2024-09-17T05:42:37.805843+0000","last_clean":"2024-09-17T05:42:37.805843+0000","last_became_active":"2024-09-17T05:42:37.802617+0000","last_became_peered":"2024-09-17T05:42:37.802617+0000","last_unstale":"2024-09-17T05:42:37.805843+0000","last_undegraded":"2024-09-17T05:42:37.805843+0000","last_fullsized":"2024-09-17T05:42:37.805843+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:42:36.770435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:42:36.770435+0000","last_clean_scrub_stamp":"2024-09-17T05:42:36.770435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:53:27.876127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-17T05:42:40.522249+0000","last_change":"2024-09-17T05:42:38.818122+0000","last_active":"2024-09-17T05:42:40.522249+0000","last_peered":"2024-09-17T05:42:40.522249+0000","last_clean":"2024-09-17T05:42:40.522249+0000","last_became_active":"2024-09-17T05:42:38.817832+0000","last_became_peered":"2024-09-17T05:42:38.817832+0000","last_unstale":"2024-09-17T05:42:40.522249+0000","last_undegraded":"2024-09-17T05:42:40.522249+0000","last_fullsized":"2024-09-17T05:42:40.522249+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:42:37.772628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:42:37.772628+0000","last_clean_scrub_stamp":"2024-09-17T05:42:37.772628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:57:09.672673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"33'2","reported_seq":17,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-17T05:42:39.786857+0000","last_change":"2024-09-17T05:42:37.805183+0000","last_active":"2024-09-17T05:42:39.786857+0000","last_peered":"2024-09-17T05:42:39.786857+0000","last_clean":"2024-09-17T05:42:39.786857+0000","last_became_active":"2024-09-17T05:42:37.804856+0000","last_became_peered":"2024-09-17T05:42:37.804856+0000","last_unstale":"2024-09-17T05:42:39.786857+0000","last_undegraded":"2024-09-17T05:42:39.786857+0000","last_fullsized":"2024-09-17T05:42:39.786857+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:42:36.770435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:42:36.770435+0000","last_clean_scrub_stamp":"2024-09-17T05:42:36.770435+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:53:13.976559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-17T05:42:40.798052+0000","last_change":"2024-09-17T05:42:38.811881+0000","last_active":"2024-09-17T05:42:40.798052+0000","last_peered":"2024-09-17T05:42:40.798052+0000","last_clean":"2024-09-17T05:42:40.798052+0000","last_became_active":"2024-09-17T05:42:38.809272+0000","last_became_peered":"2024-09-17T05:42:38.809272+0000","last_unstale":"2024-09-17T05:42:40.798052+0000","last_undegraded":"2024-09-17T05:42:40.798052+0000","last_fullsized":"2024-09-17T05:42:40.798052+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:42:37.772628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:42:37.772628+0000","last_clean_scrub_stamp":"2024-09-17T05:42:37.772628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:06:11.277950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"33'2","reported_seq":17,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-17T05:42:40.837089+0000","last_change":"2024-09-17T05:42:37.806873+0000","last_active":"2024-09-17T05:42:40.837089+0000","last_peered":"2024-09-17T05:42:40.837089+0000","last_clean":"2024-09-17T05:42:40.837089+0000","last_became_active":"2024-09-17T05:42:37.806489+0000","last_became_peered":"2024-09-17T05:42:37.806489+0000","last_unstale":"2024-09-17T05:42:40.837089+0000","last_undegraded":"2024-09-17T05:42:40.837089+0000","last_fullsized":"2024-09-17T05:42:40.837089+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:42:36.770435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:42:36.770435+0000","last_clean_scrub_stamp":"2024-09-17T05:42:36.770435+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:56:33.527829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-17T05:42:39.789063+0000","last_change":"2024-09-17T05:42:38.810130+0000","last_active":"2024-09-17T05:42:39.789063+0000","last_peered":"2024-09-17T05:42:39.789063+0000","last_clean":"2024-09-17T05:42:39.789063+0000","last_became_active":"2024-09-17T05:42:38.809795+0000","last_became_peered":"2024-09-17T05:42:38.809795+0000","last_unstale":"2024-09-17T05:42:39.789063+0000","last_undegraded":"2024-09-17T05:42:39.789063+0000","last_fullsized":"2024-09-17T05:42:39.789063+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:42:37.772628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:42:37.772628+0000","last_clean_scrub_stamp":"2024-09-17T05:42:37.772628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:48:42.385641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"33'1","reported_seq":16,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-17T05:42:40.521934+0000","last_change":"2024-09-17T05:42:37.801623+0000","last_active":"2024-09-17T05:42:40.521934+0000","last_peered":"2024-09-17T05:42:40.521934+0000","last_clean":"2024-09-17T05:42:40.521934+0000","last_became_active":"2024-09-17T05:42:37.801212+0000","last_became_peered":"2024-09-17T05:42:37.801212+0000","last_unstale":"2024-09-17T05:42:40.521934+0000","last_undegraded":"2024-09-17T05:42:40.521934+0000","last_fullsized":"2024-09-17T05:42:40.521934+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:42:36.770435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:42:36.770435+0000","last_clean_scrub_stamp":"2024-09-17T05:42:36.770435+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:15:14.631270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-17T05:42:39.847267+0000","last_change":"2024-09-17T05:42:38.804702+0000","last_active":"2024-09-17T05:42:39.847267+0000","last_peered":"2024-09-17T05:42:39.847267+0000","last_clean":"2024-09-17T05:42:39.847267+0000","last_became_active":"2024-09-17T05:42:38.804359+0000","last_became_peered":"2024-09-17T05:42:38.804359+0000","last_unstale":"2024-09-17T05:42:39.847267+0000","last_undegraded":"2024-09-17T05:42:39.847267+0000","last_fullsized":"2024-09-17T05:42:39.847267+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:42:37.772628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:42:37.772628+0000","last_clean_scrub_stamp":"2024-09-17T05:42:37.772628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:50:12.834179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"33'1","reported_seq":16,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-17T05:42:40.522053+0000","last_change":"2024-09-17T05:42:37.797062+0000","last_active":"2024-09-17T05:42:40.522053+0000","last_peered":"2024-09-17T05:42:40.522053+0000","last_clean":"2024-09-17T05:42:40.522053+0000","last_became_active":"2024-09-17T05:42:37.796412+0000","last_became_peered":"2024-09-17T05:42:37.796412+0000","last_unstale":"2024-09-17T05:42:40.522053+0000","last_undegraded":"2024-09-17T05:42:40.522053+0000","last_fullsized":"2024-09-17T05:42:40.522053+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:42:36.770435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:42:36.770435+0000","last_clean_scrub_stamp":"2024-09-17T05:42:36.770435+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:28:00.710578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-17T05:42:40.521717+0000","last_change":"2024-09-17T05:42:38.800340+0000","last_active":"2024-09-17T05:42:40.521717+0000","last_peered":"2024-09-17T05:42:40.521717+0000","last_clean":"2024-09-17T05:42:40.521717+0000","last_became_active":"2024-09-17T05:42:38.798319+0000","last_became_peered":"2024-09-17T05:42:38.798319+0000","last_unstale":"2024-09-17T05:42:40.521717+0000","last_undegraded":"2024-09-17T05:42:40.521717+0000","last_fullsized":"2024-09-17T05:42:40.521717+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:42:37.772628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:42:37.772628+0000","last_clean_scrub_stamp":"2024-09-17T05:42:37.772628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:51:50.260513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":15,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-17T05:42:39.786151+0000","last_change":"2024-09-17T05:42:37.798675+0000","last_active":"2024-09-17T05:42:39.786151+0000","last_peered":"2024-09-17T05:42:39.786151+0000","last_clean":"2024-09-17T05:42:39.786151+0000","last_became_active":"2024-09-17T05:42:37.798337+0000","last_became_peered":"2024-09-17T05:42:37.798337+0000","last_unstale":"2024-09-17T05:42:39.786151+0000","last_undegraded":"2024-09-17T05:42:39.786151+0000","last_fullsized":"2024-09-17T05:42:39.786151+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:42:36.770435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:42:36.770435+0000","last_clean_scrub_stamp":"2024-09-17T05:42:36.770435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:26:38.326684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-17T05:42:40.797420+0000","last_change":"2024-09-17T05:42:38.812209+0000","last_active":"2024-09-17T05:42:40.797420+0000","last_peered":"2024-09-17T05:42:40.797420+0000","last_clean":"2024-09-17T05:42:40.797420+0000","last_became_active":"2024-09-17T05:42:38.811493+0000","last_became_peered":"2024-09-17T05:42:38.811493+0000","last_unstale":"2024-09-17T05:42:40.797420+0000","last_undegraded":"2024-09-17T05:42:40.797420+0000","last_fullsized":"2024-09-17T05:42:40.797420+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:42:37.772628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:42:37.772628+0000","last_clean_scrub_stamp":"2024-09-17T05:42:37.772628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:57:09.672673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":15,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-17T05:42:40.521535+0000","last_change":"2024-09-17T05:42:37.795964+0000","last_active":"2024-09-17T05:42:40.521535+0000","last_peered":"2024-09-17T05:42:40.521535+0000","last_clean":"2024-09-17T05:42:40.521535+0000","last_became_active":"2024-09-17T05:42:37.795311+0000","last_became_peered":"2024-09-17T05:42:37.795311+0000","last_unstale":"2024-09-17T05:42:40.521535+0000","last_undegraded":"2024-09-17T05:42:40.521535+0000","last_fullsized":"2024-09-17T05:42:40.521535+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:42:36.770435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:42:36.770435+0000","last_clean_scrub_stamp":"2024-09-17T05:42:36.770435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:57:20.507917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-17T05:42:39.847619+0000","last_change":"2024-09-17T05:42:38.812068+0000","last_active":"2024-09-17T05:42:39.847619+0000","last_peered":"2024-09-17T05:42:39.847619+0000","last_clean":"2024-09-17T05:42:39.847619+0000","last_became_active":"2024-09-17T05:42:38.811455+0000","last_became_peered":"2024-09-17T05:42:38.811455+0000","last_unstale":"2024-09-17T05:42:39.847619+0000","last_undegraded":"2024-09-17T05:42:39.847619+0000","last_fullsized":"2024-09-17T05:42:39.847619+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:42:37.772628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:42:37.772628+0000","last_clean_scrub_stamp":"2024-09-17T05:42:37.772628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:37:11.138729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":15,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-17T05:42:39.786891+0000","last_change":"2024-09-17T05:42:37.803872+0000","last_active":"2024-09-17T05:42:39.786891+0000","last_peered":"2024-09-17T05:42:39.786891+0000","last_clean":"2024-09-17T05:42:39.786891+0000","last_became_active":"2024-09-17T05:42:37.803571+0000","last_became_peered":"2024-09-17T05:42:37.803571+0000","last_unstale":"2024-09-17T05:42:39.786891+0000","last_undegraded":"2024-09-17T05:42:39.786891+0000","last_fullsized":"2024-09-17T05:42:39.786891+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:42:36.770435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:42:36.770435+0000","last_clean_scrub_stamp":"2024-09-17T05:42:36.770435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:18:31.876866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-17T05:42:39.786932+0000","last_change":"2024-09-17T05:42:38.820069+0000","last_active":"2024-09-17T05:42:39.786932+0000","last_peered":"2024-09-17T05:42:39.786932+0000","last_clean":"2024-09-17T05:42:39.786932+0000","last_became_active":"2024-09-17T05:42:38.819408+0000","last_became_peered":"2024-09-17T05:42:38.819408+0000","last_unstale":"2024-09-17T05:42:39.786932+0000","last_undegraded":"2024-09-17T05:42:39.786932+0000","last_fullsized":"2024-09-17T05:42:39.786932+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:42:37.772628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:42:37.772628+0000","last_clean_scrub_stamp":"2024-09-17T05:42:37.772628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:19:00.631236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":10,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T05:42:37.805813+0000","last_change":"2024-09-17T05:42:37.802055+0000","last_active":"2024-09-17T05:42:37.805813+0000","last_peered":"2024-09-17T05:42:37.805813+0000","last_clean":"2024-09-17T05:42:37.805813+0000","last_became_active":"2024-09-17T05:42:37.801718+0000","last_became_peered":"2024-09-17T05:42:37.801718+0000","last_unstale":"2024-09-17T05:42:37.805813+0000","last_undegraded":"2024-09-17T05:42:37.805813+0000","last_fullsized":"2024-09-17T05:42:37.805813+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:42:36.770435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:42:36.770435+0000","last_clean_scrub_stamp":"2024-09-17T05:42:36.770435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:16:12.275459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-17T05:42:39.786731+0000","last_change":"2024-09-17T05:42:38.814528+0000","last_active":"2024-09-17T05:42:39.786731+0000","last_peered":"2024-09-17T05:42:39.786731+0000","last_clean":"2024-09-17T05:42:39.786731+0000","last_became_active":"2024-09-17T05:42:38.814167+0000","last_became_peered":"2024-09-17T05:42:38.814167+0000","last_unstale":"2024-09-17T05:42:39.786731+0000","last_undegraded":"2024-09-17T05:42:39.786731+0000","last_fullsized":"2024-09-17T05:42:39.786731+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:42:37.772628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:42:37.772628+0000","last_clean_scrub_stamp":"2024-09-17T05:42:37.772628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:00:36.629732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.15","version":"33'3","reported_seq":18,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-17T05:42:39.847482+0000","last_change":"2024-09-17T05:42:37.802817+0000","last_active":"2024-09-17T05:42:39.847482+0000","last_peered":"2024-09-17T05:42:39.847482+0000","last_clean":"2024-09-17T05:42:39.847482+0000","last_became_active":"2024-09-17T05:42:37.802357+0000","last_became_peered":"2024-09-17T05:42:37.802357+0000","last_unstale":"2024-09-17T05:42:39.847482+0000","last_undegraded":"2024-09-17T05:42:39.847482+0000","last_fullsized":"2024-09-17T05:42:39.847482+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:42:36.770435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:42:36.770435+0000","last_clean_scrub_stamp":"2024-09-17T05:42:36.770435+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:04:15.682574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-17T05:42:39.847233+0000","last_change":"2024-09-17T05:42:38.806292+0000","last_active":"2024-09-17T05:42:39.847233+0000","last_peered":"2024-09-17T05:42:39.847233+0000","last_clean":"2024-09-17T05:42:39.847233+0000","last_became_active":"2024-09-17T05:42:38.805974+0000","last_became_peered":"2024-09-17T05:42:38.805974+0000","last_unstale":"2024-09-17T05:42:39.847233+0000","last_undegraded":"2024-09-17T05:42:39.847233+0000","last_fullsized":"2024-09-17T05:42:39.847233+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:42:37.772628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:42:37.772628+0000","last_clean_scrub_stamp":"2024-09-17T05:42:37.772628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:12:47.279209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"33'6","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-17T05:42:39.786777+0000","last_change":"2024-09-17T05:42:37.806610+0000","last_active":"2024-09-17T05:42:39.786777+0000","last_peered":"2024-09-17T05:42:39.786777+0000","last_clean":"2024-09-17T05:42:39.786777+0000","last_became_active":"2024-09-17T05:42:37.806267+0000","last_became_peered":"2024-09-17T05:42:37.806267+0000","last_unstale":"2024-09-17T05:42:39.786777+0000","last_undegraded":"2024-09-17T05:42:39.786777+0000","last_fullsized":"2024-09-17T05:42:39.786777+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:42:36.770435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:42:36.770435+0000","last_clean_scrub_stamp":"2024-09-17T05:42:36.770435+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:13:27.347285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-17T05:42:40.797411+0000","last_change":"2024-09-17T05:42:38.801931+0000","last_active":"2024-09-17T05:42:40.797411+0000","last_peered":"2024-09-17T05:42:40.797411+0000","last_clean":"2024-09-17T05:42:40.797411+0000","last_became_active":"2024-09-17T05:42:38.801616+0000","last_became_peered":"2024-09-17T05:42:38.801616+0000","last_unstale":"2024-09-17T05:42:40.797411+0000","last_undegraded":"2024-09-17T05:42:40.797411+0000","last_fullsized":"2024-09-17T05:42:40.797411+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:42:37.772628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:42:37.772628+0000","last_clean_scrub_stamp":"2024-09-17T05:42:37.772628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:25:01.585268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"33'2","reported_seq":17,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-17T05:42:40.522008+0000","last_change":"2024-09-17T05:42:37.799534+0000","last_active":"2024-09-17T05:42:40.522008+0000","last_peered":"2024-09-17T05:42:40.522008+0000","last_clean":"2024-09-17T05:42:40.522008+0000","last_became_active":"2024-09-17T05:42:37.798838+0000","last_became_peered":"2024-09-17T05:42:37.798838+0000","last_unstale":"2024-09-17T05:42:40.522008+0000","last_undegraded":"2024-09-17T05:42:40.522008+0000","last_fullsized":"2024-09-17T05:42:40.522008+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:42:36.770435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:42:36.770435+0000","last_clean_scrub_stamp":"2024-09-17T05:42:36.770435+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:05:24.768584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-17T05:42:39.786701+0000","last_change":"2024-09-17T05:42:38.813425+0000","last_active":"2024-09-17T05:42:39.786701+0000","last_peered":"2024-09-17T05:42:39.786701+0000","last_clean":"2024-09-17T05:42:39.786701+0000","last_became_active":"2024-09-17T05:42:38.813104+0000","last_became_peered":"2024-09-17T05:42:38.813104+0000","last_unstale":"2024-09-17T05:42:39.786701+0000","last_undegraded":"2024-09-17T05:42:39.786701+0000","last_fullsized":"2024-09-17T05:42:39.786701+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:42:37.772628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:42:37.772628+0000","last_clean_scrub_stamp":"2024-09-17T05:42:37.772628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:01:56.852587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":15,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-17T05:42:40.797333+0000","last_change":"2024-09-17T05:42:37.804193+0000","last_active":"2024-09-17T05:42:40.797333+0000","last_peered":"2024-09-17T05:42:40.797333+0000","last_clean":"2024-09-17T05:42:40.797333+0000","last_became_active":"2024-09-17T05:42:37.803188+0000","last_became_peered":"2024-09-17T05:42:37.803188+0000","last_unstale":"2024-09-17T05:42:40.797333+0000","last_undegraded":"2024-09-17T05:42:40.797333+0000","last_fullsized":"2024-09-17T05:42:40.797333+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:42:36.770435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:42:36.770435+0000","last_clean_scrub_stamp":"2024-09-17T05:42:36.770435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:51:43.041335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-17T05:42:39.789632+0000","last_change":"2024-09-17T05:42:38.814207+0000","last_active":"2024-09-17T05:42:39.789632+0000","last_peered":"2024-09-17T05:42:39.789632+0000","last_clean":"2024-09-17T05:42:39.789632+0000","last_became_active":"2024-09-17T05:42:38.813793+0000","last_became_peered":"2024-09-17T05:42:38.813793+0000","last_unstale":"2024-09-17T05:42:39.789632+0000","last_undegraded":"2024-09-17T05:42:39.789632+0000","last_fullsized":"2024-09-17T05:42:39.789632+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:42:37.772628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:42:37.772628+0000","last_clean_scrub_stamp":"2024-09-17T05:42:37.772628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:57:09.386461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":15,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-17T05:42:39.786209+0000","last_change":"2024-09-17T05:42:37.802960+0000","last_active":"2024-09-17T05:42:39.786209+0000","last_peered":"2024-09-17T05:42:39.786209+0000","last_clean":"2024-09-17T05:42:39.786209+0000","last_became_active":"2024-09-17T05:42:37.802639+0000","last_became_peered":"2024-09-17T05:42:37.802639+0000","last_unstale":"2024-09-17T05:42:39.786209+0000","last_undegraded":"2024-09-17T05:42:39.786209+0000","last_fullsized":"2024-09-17T05:42:39.786209+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:42:36.770435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:42:36.770435+0000","last_clean_scrub_stamp":"2024-09-17T05:42:36.770435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:04:15.682574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-17T05:42:39.787978+0000","last_change":"2024-09-17T05:42:38.809277+0000","last_active":"2024-09-17T05:42:39.787978+0000","last_peered":"2024-09-17T05:42:39.787978+0000","last_clean":"2024-09-17T05:42:39.787978+0000","last_became_active":"2024-09-17T05:42:38.807989+0000","last_became_peered":"2024-09-17T05:42:38.807989+0000","last_unstale":"2024-09-17T05:42:39.787978+0000","last_undegraded":"2024-09-17T05:42:39.787978+0000","last_fullsized":"2024-09-17T05:42:39.787978+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:42:37.772628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:42:37.772628+0000","last_clean_scrub_stamp":"2024-09-17T05:42:37.772628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:12:32.953365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.10","version":"33'8","reported_seq":23,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-17T05:42:39.786201+0000","last_change":"2024-09-17T05:42:37.804595+0000","last_active":"2024-09-17T05:42:39.786201+0000","last_peered":"2024-09-17T05:42:39.786201+0000","last_clean":"2024-09-17T05:42:39.786201+0000","last_became_active":"2024-09-17T05:42:37.804280+0000","last_became_peered":"2024-09-17T05:42:37.804280+0000","last_unstale":"2024-09-17T05:42:39.786201+0000","last_undegraded":"2024-09-17T05:42:39.786201+0000","last_fullsized":"2024-09-17T05:42:39.786201+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:42:36.770435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:42:36.770435+0000","last_clean_scrub_stamp":"2024-09-17T05:42:36.770435+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:23:24.440313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-17T05:42:40.522087+0000","last_change":"2024-09-17T05:42:38.809578+0000","last_active":"2024-09-17T05:42:40.522087+0000","last_peered":"2024-09-17T05:42:40.522087+0000","last_clean":"2024-09-17T05:42:40.522087+0000","last_became_active":"2024-09-17T05:42:38.809255+0000","last_became_peered":"2024-09-17T05:42:38.809255+0000","last_unstale":"2024-09-17T05:42:40.522087+0000","last_undegraded":"2024-09-17T05:42:40.522087+0000","last_fullsized":"2024-09-17T05:42:40.522087+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:42:37.772628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:42:37.772628+0000","last_clean_scrub_stamp":"2024-09-17T05:42:37.772628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:04:29.017402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"33'1","reported_seq":16,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-17T05:42:40.797976+0000","last_change":"2024-09-17T05:42:37.804246+0000","last_active":"2024-09-17T05:42:40.797976+0000","last_peered":"2024-09-17T05:42:40.797976+0000","last_clean":"2024-09-17T05:42:40.797976+0000","last_became_active":"2024-09-17T05:42:37.803529+0000","last_became_peered":"2024-09-17T05:42:37.803529+0000","last_unstale":"2024-09-17T05:42:40.797976+0000","last_undegraded":"2024-09-17T05:42:40.797976+0000","last_fullsized":"2024-09-17T05:42:40.797976+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:42:36.770435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:42:36.770435+0000","last_clean_scrub_stamp":"2024-09-17T05:42:36.770435+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:58:54.928408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-17T05:42:39.847725+0000","last_change":"2024-09-17T05:42:38.813180+0000","last_active":"2024-09-17T05:42:39.847725+0000","last_peered":"2024-09-17T05:42:39.847725+0000","last_clean":"2024-09-17T05:42:39.847725+0000","last_became_active":"2024-09-17T05:42:38.812734+0000","last_became_peered":"2024-09-17T05:42:38.812734+0000","last_unstale":"2024-09-17T05:42:39.847725+0000","last_undegraded":"2024-09-17T05:42:39.847725+0000","last_fullsized":"2024-09-17T05:42:39.847725+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:42:37.772628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:42:37.772628+0000","last_clean_scrub_stamp":"2024-09-17T05:42:37.772628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:57:09.386461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.e","version":"33'2","reported_seq":17,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-17T05:42:40.522075+0000","last_change":"2024-09-17T05:42:37.798247+0000","last_active":"2024-09-17T05:42:40.522075+0000","last_peered":"2024-09-17T05:42:40.522075+0000","last_clean":"2024-09-17T05:42:40.522075+0000","last_became_active":"2024-09-17T05:42:37.797389+0000","last_became_peered":"2024-09-17T05:42:37.797389+0000","last_unstale":"2024-09-17T05:42:40.522075+0000","last_undegraded":"2024-09-17T05:42:40.522075+0000","last_fullsized":"2024-09-17T05:42:40.522075+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:42:36.770435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:42:36.770435+0000","last_clean_scrub_stamp":"2024-09-17T05:42:36.770435+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:07:47.702071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-17T05:42:40.797619+0000","last_change":"2024-09-17T05:42:38.816785+0000","last_active":"2024-09-17T05:42:40.797619+0000","last_peered":"2024-09-17T05:42:40.797619+0000","last_clean":"2024-09-17T05:42:40.797619+0000","last_became_active":"2024-09-17T05:42:38.816471+0000","last_became_peered":"2024-09-17T05:42:38.816471+0000","last_unstale":"2024-09-17T05:42:40.797619+0000","last_undegraded":"2024-09-17T05:42:40.797619+0000","last_fullsized":"2024-09-17T05:42:40.797619+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:42:37.772628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:42:37.772628+0000","last_clean_scrub_stamp":"2024-09-17T05:42:37.772628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:42:20.311948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"33'1","reported_seq":16,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-17T05:42:40.522128+0000","last_change":"2024-09-17T05:42:37.801222+0000","last_active":"2024-09-17T05:42:40.522128+0000","last_peered":"2024-09-17T05:42:40.522128+0000","last_clean":"2024-09-17T05:42:40.522128+0000","last_became_active":"2024-09-17T05:42:37.800681+0000","last_became_peered":"2024-09-17T05:42:37.800681+0000","last_unstale":"2024-09-17T05:42:40.522128+0000","last_undegraded":"2024-09-17T05:42:40.522128+0000","last_fullsized":"2024-09-17T05:42:40.522128+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:42:36.770435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:42:36.770435+0000","last_clean_scrub_stamp":"2024-09-17T05:42:36.770435+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:32:51.037165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-17T05:42:40.837065+0000","last_change":"2024-09-17T05:42:38.804832+0000","last_active":"2024-09-17T05:42:40.837065+0000","last_peered":"2024-09-17T05:42:40.837065+0000","last_clean":"2024-09-17T05:42:40.837065+0000","last_became_active":"2024-09-17T05:42:38.804508+0000","last_became_peered":"2024-09-17T05:42:38.804508+0000","last_unstale":"2024-09-17T05:42:40.837065+0000","last_undegraded":"2024-09-17T05:42:40.837065+0000","last_fullsized":"2024-09-17T05:42:40.837065+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:42:37.772628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:42:37.772628+0000","last_clean_scrub_stamp":"2024-09-17T05:42:37.772628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:44:02.490887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":15,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-17T05:42:40.521963+0000","last_change":"2024-09-17T05:42:37.789708+0000","last_active":"2024-09-17T05:42:40.521963+0000","last_peered":"2024-09-17T05:42:40.521963+0000","last_clean":"2024-09-17T05:42:40.521963+0000","last_became_active":"2024-09-17T05:42:37.789299+0000","last_became_peered":"2024-09-17T05:42:37.789299+0000","last_unstale":"2024-09-17T05:42:40.521963+0000","last_undegraded":"2024-09-17T05:42:40.521963+0000","last_fullsized":"2024-09-17T05:42:40.521963+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:42:36.770435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:42:36.770435+0000","last_clean_scrub_stamp":"2024-09-17T05:42:36.770435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:09:15.481334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-17T05:42:40.837166+0000","last_change":"2024-09-17T05:42:38.802196+0000","last_active":"2024-09-17T05:42:40.837166+0000","last_peered":"2024-09-17T05:42:40.837166+0000","last_clean":"2024-09-17T05:42:40.837166+0000","last_became_active":"2024-09-17T05:42:38.801836+0000","last_became_peered":"2024-09-17T05:42:38.801836+0000","last_unstale":"2024-09-17T05:42:40.837166+0000","last_undegraded":"2024-09-17T05:42:40.837166+0000","last_fullsized":"2024-09-17T05:42:40.837166+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:42:37.772628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:42:37.772628+0000","last_clean_scrub_stamp":"2024-09-17T05:42:37.772628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:05:25.770777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":10,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T05:42:37.810685+0000","last_change":"2024-09-17T05:42:37.806715+0000","last_active":"2024-09-17T05:42:37.810685+0000","last_peered":"2024-09-17T05:42:37.810685+0000","last_clean":"2024-09-17T05:42:37.810685+0000","last_became_active":"2024-09-17T05:42:37.806401+0000","last_became_peered":"2024-09-17T05:42:37.806401+0000","last_unstale":"2024-09-17T05:42:37.810685+0000","last_undegraded":"2024-09-17T05:42:37.810685+0000","last_fullsized":"2024-09-17T05:42:37.810685+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:42:36.770435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:42:36.770435+0000","last_clean_scrub_stamp":"2024-09-17T05:42:36.770435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:17:40.016526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-17T05:42:40.837288+0000","last_change":"2024-09-17T05:42:38.797810+0000","last_active":"2024-09-17T05:42:40.837288+0000","last_peered":"2024-09-17T05:42:40.837288+0000","last_clean":"2024-09-17T05:42:40.837288+0000","last_became_active":"2024-09-17T05:42:38.796315+0000","last_became_peered":"2024-09-17T05:42:38.796315+0000","last_unstale":"2024-09-17T05:42:40.837288+0000","last_undegraded":"2024-09-17T05:42:40.837288+0000","last_fullsized":"2024-09-17T05:42:40.837288+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:42:37.772628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:42:37.772628+0000","last_clean_scrub_stamp":"2024-09-17T05:42:37.772628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:09:16.483527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":15,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-17T05:42:39.788131+0000","last_change":"2024-09-17T05:42:37.805124+0000","last_active":"2024-09-17T05:42:39.788131+0000","last_peered":"2024-09-17T05:42:39.788131+0000","last_clean":"2024-09-17T05:42:39.788131+0000","last_became_active":"2024-09-17T05:42:37.804866+0000","last_became_peered":"2024-09-17T05:42:37.804866+0000","last_unstale":"2024-09-17T05:42:39.788131+0000","last_undegraded":"2024-09-17T05:42:39.788131+0000","last_fullsized":"2024-09-17T05:42:39.788131+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:42:36.770435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:42:36.770435+0000","last_clean_scrub_stamp":"2024-09-17T05:42:36.770435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:46:38.031582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-17T05:42:40.837022+0000","last_change":"2024-09-17T05:42:38.797274+0000","last_active":"2024-09-17T05:42:40.837022+0000","last_peered":"2024-09-17T05:42:40.837022+0000","last_clean":"2024-09-17T05:42:40.837022+0000","last_became_active":"2024-09-17T05:42:38.796947+0000","last_became_peered":"2024-09-17T05:42:38.796947+0000","last_unstale":"2024-09-17T05:42:40.837022+0000","last_undegraded":"2024-09-17T05:42:40.837022+0000","last_fullsized":"2024-09-17T05:42:40.837022+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:42:37.772628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:42:37.772628+0000","last_clean_scrub_stamp":"2024-09-17T05:42:37.772628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:32:52.039358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":15,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-17T05:42:40.521606+0000","last_change":"2024-09-17T05:42:37.802039+0000","last_active":"2024-09-17T05:42:40.521606+0000","last_peered":"2024-09-17T05:42:40.521606+0000","last_clean":"2024-09-17T05:42:40.521606+0000","last_became_active":"2024-09-17T05:42:37.801719+0000","last_became_peered":"2024-09-17T05:42:37.801719+0000","last_unstale":"2024-09-17T05:42:40.521606+0000","last_undegraded":"2024-09-17T05:42:40.521606+0000","last_fullsized":"2024-09-17T05:42:40.521606+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:42:36.770435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:42:36.770435+0000","last_clean_scrub_stamp":"2024-09-17T05:42:36.770435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:39:18.681871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-17T05:42:39.788928+0000","last_change":"2024-09-17T05:42:38.800459+0000","last_active":"2024-09-17T05:42:39.788928+0000","last_peered":"2024-09-17T05:42:39.788928+0000","last_clean":"2024-09-17T05:42:39.788928+0000","last_became_active":"2024-09-17T05:42:38.800074+0000","last_became_peered":"2024-09-17T05:42:38.800074+0000","last_unstale":"2024-09-17T05:42:39.788928+0000","last_undegraded":"2024-09-17T05:42:39.788928+0000","last_fullsized":"2024-09-17T05:42:39.788928+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:42:37.772628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:42:37.772628+0000","last_clean_scrub_stamp":"2024-09-17T05:42:37.772628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:05:21.436685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":15,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-17T05:42:39.846965+0000","last_change":"2024-09-17T05:42:37.802800+0000","last_active":"2024-09-17T05:42:39.846965+0000","last_peered":"2024-09-17T05:42:39.846965+0000","last_clean":"2024-09-17T05:42:39.846965+0000","last_became_active":"2024-09-17T05:42:37.802451+0000","last_became_peered":"2024-09-17T05:42:37.802451+0000","last_unstale":"2024-09-17T05:42:39.846965+0000","last_undegraded":"2024-09-17T05:42:39.846965+0000","last_fullsized":"2024-09-17T05:42:39.846965+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:42:36.770435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:42:36.770435+0000","last_clean_scrub_stamp":"2024-09-17T05:42:36.770435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:26:38.326684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-17T05:42:40.837153+0000","last_change":"2024-09-17T05:42:38.811411+0000","last_active":"2024-09-17T05:42:40.837153+0000","last_peered":"2024-09-17T05:42:40.837153+0000","last_clean":"2024-09-17T05:42:40.837153+0000","last_became_active":"2024-09-17T05:42:38.810958+0000","last_became_peered":"2024-09-17T05:42:38.810958+0000","last_unstale":"2024-09-17T05:42:40.837153+0000","last_undegraded":"2024-09-17T05:42:40.837153+0000","last_fullsized":"2024-09-17T05:42:40.837153+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:42:37.772628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:42:37.772628+0000","last_clean_scrub_stamp":"2024-09-17T05:42:37.772628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:22:34.668025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"33'2","reported_seq":17,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-17T05:42:40.798059+0000","last_change":"2024-09-17T05:42:37.802205+0000","last_active":"2024-09-17T05:42:40.798059+0000","last_peered":"2024-09-17T05:42:40.798059+0000","last_clean":"2024-09-17T05:42:40.798059+0000","last_became_active":"2024-09-17T05:42:37.801813+0000","last_became_peered":"2024-09-17T05:42:37.801813+0000","last_unstale":"2024-09-17T05:42:40.798059+0000","last_undegraded":"2024-09-17T05:42:40.798059+0000","last_fullsized":"2024-09-17T05:42:40.798059+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:42:36.770435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:42:36.770435+0000","last_clean_scrub_stamp":"2024-09-17T05:42:36.770435+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:43:26.611720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-17T05:42:39.847774+0000","last_change":"2024-09-17T05:42:38.804765+0000","last_active":"2024-09-17T05:42:39.847774+0000","last_peered":"2024-09-17T05:42:39.847774+0000","last_clean":"2024-09-17T05:42:39.847774+0000","last_became_active":"2024-09-17T05:42:38.804428+0000","last_became_peered":"2024-09-17T05:42:38.804428+0000","last_unstale":"2024-09-17T05:42:39.847774+0000","last_undegraded":"2024-09-17T05:42:39.847774+0000","last_fullsized":"2024-09-17T05:42:39.847774+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:42:37.772628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:42:37.772628+0000","last_clean_scrub_stamp":"2024-09-17T05:42:37.772628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:00:24.792295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":10,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T05:42:37.810634+0000","last_change":"2024-09-17T05:42:37.805790+0000","last_active":"2024-09-17T05:42:37.810634+0000","last_peered":"2024-09-17T05:42:37.810634+0000","last_clean":"2024-09-17T05:42:37.810634+0000","last_became_active":"2024-09-17T05:42:37.805423+0000","last_became_peered":"2024-09-17T05:42:37.805423+0000","last_unstale":"2024-09-17T05:42:37.810634+0000","last_undegraded":"2024-09-17T05:42:37.810634+0000","last_fullsized":"2024-09-17T05:42:37.810634+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:42:36.770435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:42:36.770435+0000","last_clean_scrub_stamp":"2024-09-17T05:42:36.770435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:53:44.743537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-09-17T05:42:37.792487+0000","last_change":"2024-09-17T05:42:37.792487+0000","last_active":"2024-09-17T05:42:37.772628+0000","last_peered":"2024-09-17T05:42:37.772628+0000","last_clean":"2024-09-17T05:42:37.772628+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:42:37.792487+0000","last_undegraded":"2024-09-17T05:42:37.792487+0000","last_fullsized":"2024-09-17T05:42:37.792487+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:42:37.772628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:42:37.772628+0000","last_clean_scrub_stamp":"2024-09-17T05:42:37.772628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":15,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-17T05:42:40.797791+0000","last_change":"2024-09-17T05:42:37.805601+0000","last_active":"2024-09-17T05:42:40.797791+0000","last_peered":"2024-09-17T05:42:40.797791+0000","last_clean":"2024-09-17T05:42:40.797791+0000","last_became_active":"2024-09-17T05:42:37.805162+0000","last_became_peered":"2024-09-17T05:42:37.805162+0000","last_unstale":"2024-09-17T05:42:40.797791+0000","last_undegraded":"2024-09-17T05:42:40.797791+0000","last_fullsized":"2024-09-17T05:42:40.797791+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:42:36.770435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:42:36.770435+0000","last_clean_scrub_stamp":"2024-09-17T05:42:36.770435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:50:33.639876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-17T05:42:39.788059+0000","last_change":"2024-09-17T05:42:38.799674+0000","last_active":"2024-09-17T05:42:39.788059+0000","last_peered":"2024-09-17T05:42:39.788059+0000","last_clean":"2024-09-17T05:42:39.788059+0000","last_became_active":"2024-09-17T05:42:38.798334+0000","last_became_peered":"2024-09-17T05:42:38.798334+0000","last_unstale":"2024-09-17T05:42:39.788059+0000","last_undegraded":"2024-09-17T05:42:39.788059+0000","last_fullsized":"2024-09-17T05:42:39.788059+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:42:37.772628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:42:37.772628+0000","last_clean_scrub_stamp":"2024-09-17T05:42:37.772628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:11:54.209492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":10,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T05:42:37.800315+0000","last_change":"2024-09-17T05:42:37.796847+0000","last_active":"2024-09-17T05:42:37.800315+0000","last_peered":"2024-09-17T05:42:37.800315+0000","last_clean":"2024-09-17T05:42:37.800315+0000","last_became_active":"2024-09-17T05:42:37.796077+0000","last_became_peered":"2024-09-17T05:42:37.796077+0000","last_unstale":"2024-09-17T05:42:37.800315+0000","last_undegraded":"2024-09-17T05:42:37.800315+0000","last_fullsized":"2024-09-17T05:42:37.800315+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:42:36.770435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:42:36.770435+0000","last_clean_scrub_stamp":"2024-09-17T05:42:36.770435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:36:15.516715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-09-17T05:42:37.791659+0000","last_change":"2024-09-17T05:42:37.791659+0000","last_active":"2024-09-17T05:42:37.772628+0000","last_peered":"2024-09-17T05:42:37.772628+0000","last_clean":"2024-09-17T05:42:37.772628+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:42:37.791659+0000","last_undegraded":"2024-09-17T05:42:37.791659+0000","last_fullsized":"2024-09-17T05:42:37.791659+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:42:37.772628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:42:37.772628+0000","last_clean_scrub_stamp":"2024-09-17T05:42:37.772628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":15,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-17T05:42:40.797482+0000","last_change":"2024-09-17T05:42:37.802391+0000","last_active":"2024-09-17T05:42:40.797482+0000","last_peered":"2024-09-17T05:42:40.797482+0000","last_clean":"2024-09-17T05:42:40.797482+0000","last_became_active":"2024-09-17T05:42:37.802063+0000","last_became_peered":"2024-09-17T05:42:37.802063+0000","last_unstale":"2024-09-17T05:42:40.797482+0000","last_undegraded":"2024-09-17T05:42:40.797482+0000","last_fullsized":"2024-09-17T05:42:40.797482+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:42:36.770435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:42:36.770435+0000","last_clean_scrub_stamp":"2024-09-17T05:42:36.770435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:42:23.234276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-17T05:42:39.786278+0000","last_change":"2024-09-17T05:42:38.820142+0000","last_active":"2024-09-17T05:42:39.786278+0000","last_peered":"2024-09-17T05:42:39.786278+0000","last_clean":"2024-09-17T05:42:39.786278+0000","last_became_active":"2024-09-17T05:42:38.819558+0000","last_became_peered":"2024-09-17T05:42:38.819558+0000","last_unstale":"2024-09-17T05:42:39.786278+0000","last_undegraded":"2024-09-17T05:42:39.786278+0000","last_fullsized":"2024-09-17T05:42:39.786278+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:42:37.772628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:42:37.772628+0000","last_clean_scrub_stamp":"2024-09-17T05:42:37.772628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:14:51.758783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":15,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-17T05:42:40.521745+0000","last_change":"2024-09-17T05:42:37.790681+0000","last_active":"2024-09-17T05:42:40.521745+0000","last_peered":"2024-09-17T05:42:40.521745+0000","last_clean":"2024-09-17T05:42:40.521745+0000","last_became_active":"2024-09-17T05:42:37.790365+0000","last_became_peered":"2024-09-17T05:42:37.790365+0000","last_unstale":"2024-09-17T05:42:40.521745+0000","last_undegraded":"2024-09-17T05:42:40.521745+0000","last_fullsized":"2024-09-17T05:42:40.521745+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:42:36.770435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:42:36.770435+0000","last_clean_scrub_stamp":"2024-09-17T05:42:36.770435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:29:07.667338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-17T05:42:40.521796+0000","last_change":"2024-09-17T05:42:38.814045+0000","last_active":"2024-09-17T05:42:40.521796+0000","last_peered":"2024-09-17T05:42:40.521796+0000","last_clean":"2024-09-17T05:42:40.521796+0000","last_became_active":"2024-09-17T05:42:38.812842+0000","last_became_peered":"2024-09-17T05:42:38.812842+0000","last_unstale":"2024-09-17T05:42:40.521796+0000","last_undegraded":"2024-09-17T05:42:40.521796+0000","last_fullsized":"2024-09-17T05:42:40.521796+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:42:37.772628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:42:37.772628+0000","last_clean_scrub_stamp":"2024-09-17T05:42:37.772628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:58:52.289602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":15,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-17T05:42:39.786349+0000","last_change":"2024-09-17T05:42:37.804210+0000","last_active":"2024-09-17T05:42:39.786349+0000","last_peered":"2024-09-17T05:42:39.786349+0000","last_clean":"2024-09-17T05:42:39.786349+0000","last_became_active":"2024-09-17T05:42:37.803737+0000","last_became_peered":"2024-09-17T05:42:37.803737+0000","last_unstale":"2024-09-17T05:42:39.786349+0000","last_undegraded":"2024-09-17T05:42:39.786349+0000","last_fullsized":"2024-09-17T05:42:39.786349+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:42:36.770435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:42:36.770435+0000","last_clean_scrub_stamp":"2024-09-17T05:42:36.770435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:37:49.304309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-17T05:42:39.789268+0000","last_change":"2024-09-17T05:42:38.807775+0000","last_active":"2024-09-17T05:42:39.789268+0000","last_peered":"2024-09-17T05:42:39.789268+0000","last_clean":"2024-09-17T05:42:39.789268+0000","last_became_active":"2024-09-17T05:42:38.807458+0000","last_became_peered":"2024-09-17T05:42:38.807458+0000","last_unstale":"2024-09-17T05:42:39.789268+0000","last_undegraded":"2024-09-17T05:42:39.789268+0000","last_fullsized":"2024-09-17T05:42:39.789268+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:42:37.772628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:42:37.772628+0000","last_clean_scrub_stamp":"2024-09-17T05:42:37.772628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:50:12.834179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":15,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-17T05:42:39.788075+0000","last_change":"2024-09-17T05:42:37.799537+0000","last_active":"2024-09-17T05:42:39.788075+0000","last_peered":"2024-09-17T05:42:39.788075+0000","last_clean":"2024-09-17T05:42:39.788075+0000","last_became_active":"2024-09-17T05:42:37.799147+0000","last_became_peered":"2024-09-17T05:42:37.799147+0000","last_unstale":"2024-09-17T05:42:39.788075+0000","last_undegraded":"2024-09-17T05:42:39.788075+0000","last_fullsized":"2024-09-17T05:42:39.788075+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:42:36.770435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:42:36.770435+0000","last_clean_scrub_stamp":"2024-09-17T05:42:36.770435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:06:15.593910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"19'72","reported_seq":130,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-17T05:42:39.789515+0000","last_change":"2024-09-17T05:41:48.539830+0000","last_active":"2024-09-17T05:42:39.789515+0000","last_peered":"2024-09-17T05:42:39.789515+0000","last_clean":"2024-09-17T05:42:39.789515+0000","last_became_active":"2024-09-17T05:41:48.538743+0000","last_became_peered":"2024-09-17T05:41:48.538743+0000","last_unstale":"2024-09-17T05:42:39.789515+0000","last_undegraded":"2024-09-17T05:42:39.789515+0000","last_fullsized":"2024-09-17T05:42:39.789515+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:47.152539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:47.152539+0000","last_clean_scrub_stamp":"2024-09-17T05:41:47.152539+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:08:02.952016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":43,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":12,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":35,"ondisk_log_size":35,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":16,"seq":68719476752,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27404,"kb_used_data":376,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344436,"statfs":{"total":96636764160,"available":96608702464,"internally_reserved":0,"allocated":385024,"data_stored":145635,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":7,"up_from":15,"seq":64424509456,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27988,"kb_used_data":952,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343852,"statfs":{"total":96636764160,"available":96608104448,"internally_reserved":0,"allocated":974848,"data_stored":735477,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509455,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27408,"kb_used_data":376,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344432,"statfs":{"total":96636764160,"available":96608698368,"internally_reserved":0,"allocated":385024,"data_stored":145691,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509455,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27392,"kb_used_data":364,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344448,"statfs":{"total":96636764160,"available":96608714752,"internally_reserved":0,"allocated":372736,"data_stored":138823,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509455,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27420,"kb_used_data":384,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344420,"statfs":{"total":96636764160,"available":96608686080,"internally_reserved":0,"allocated":393216,"data_stored":146653,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509455,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27388,"kb_used_data":360,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344452,"statfs":{"total":96636764160,"available":96608718848,"internally_reserved":0,"allocated":368640,"data_stored":138789,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509455,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27400,"kb_used_data":372,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344440,"statfs":{"total":96636764160,"available":96608706560,"internally_reserved":0,"allocated":380928,"data_stored":140353,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574862,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27940,"kb_used_data":912,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343900,"statfs":{"total":96636764160,"available":96608153600,"internally_reserved":0,"allocated":933888,"data_stored":716045,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-17T05:42:47.297 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-17T05:42:47.425 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:47.424+0000 7f4900ad5640 1 -- 172.21.15.150:0/1491789219 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f48fc0d1020 msgr2=0x7f48fc0d1430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:47.425 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:47.424+0000 7f4900ad5640 1 --2- 172.21.15.150:0/1491789219 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f48fc0d1020 0x7f48fc0d1430 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f48f4005fd0 tx=0x7f48f402aa90 comp rx=0 tx=0).stop 2024-09-17T05:42:47.425 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:47.424+0000 7f4900ad5640 1 -- 172.21.15.150:0/1491789219 shutdown_connections 2024-09-17T05:42:47.425 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:47.424+0000 7f4900ad5640 1 --2- 172.21.15.150:0/1491789219 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f48fc0d1020 0x7f48fc0d1430 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:47.425 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:47.424+0000 7f4900ad5640 1 --2- 172.21.15.150:0/1491789219 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f48fc0b9d10 0x7f48fc0d2f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:47.425 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:47.424+0000 7f4900ad5640 1 -- 172.21.15.150:0/1491789219 >> 172.21.15.150:0/1491789219 conn(0x7f48fc08bfe0 msgr2=0x7f48fc0d4650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:42:47.425 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:47.424+0000 7f4900ad5640 1 -- 172.21.15.150:0/1491789219 shutdown_connections 2024-09-17T05:42:47.425 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:47.424+0000 7f4900ad5640 1 -- 172.21.15.150:0/1491789219 wait complete. 2024-09-17T05:42:47.426 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:47.426+0000 7f4900ad5640 1 Processor -- start 2024-09-17T05:42:47.426 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:47.426+0000 7f4900ad5640 1 -- start start 2024-09-17T05:42:47.429 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:47.427+0000 7f4900ad5640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f48fc0b9d10 0x7f48fc1ebf90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:42:47.429 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:47.427+0000 7f4900ad5640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f48fc0d1020 0x7f48fc1f9e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:42:47.429 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:47.427+0000 7f4900ad5640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f48fc0d50c0 0x7f48fc160a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:42:47.429 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:47.427+0000 7f4900ad5640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f48fc0b43c0 con 0x7f48fc0d50c0 2024-09-17T05:42:47.429 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:47.427+0000 7f4900ad5640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f48fc0b4240 con 0x7f48fc0b9d10 2024-09-17T05:42:47.429 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:47.427+0000 7f4900ad5640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f48fc0b4540 con 0x7f48fc0d1020 2024-09-17T05:42:47.430 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:47.427+0000 7f48fad9d640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f48fc0d50c0 0x7f48fc160a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:42:47.430 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:47.427+0000 7f48fad9d640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f48fc0d50c0 0x7f48fc160a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:59812/0 (socket says 172.21.15.150:59812) 2024-09-17T05:42:47.430 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:47.427+0000 7f48fad9d640 1 -- 172.21.15.150:0/435415244 learned_addr learned my addr 172.21.15.150:0/435415244 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:42:47.430 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:47.427+0000 7f48fa59c640 1 --2- 172.21.15.150:0/435415244 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f48fc0b9d10 0x7f48fc1ebf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:42:47.430 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:47.427+0000 7f48f1d9b640 1 --2- 172.21.15.150:0/435415244 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f48fc0d1020 0x7f48fc1f9e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:42:47.430 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:47.428+0000 7f48fad9d640 1 -- 172.21.15.150:0/435415244 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f48fc0d1020 msgr2=0x7f48fc1f9e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:47.430 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:47.428+0000 7f48fad9d640 1 --2- 172.21.15.150:0/435415244 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f48fc0d1020 0x7f48fc1f9e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:47.430 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:47.428+0000 7f48fad9d640 1 -- 172.21.15.150:0/435415244 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f48fc0b9d10 msgr2=0x7f48fc1ebf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:47.430 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:47.428+0000 7f48fad9d640 1 --2- 172.21.15.150:0/435415244 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f48fc0b9d10 0x7f48fc1ebf90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:47.430 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:47.428+0000 7f48fad9d640 1 -- 172.21.15.150:0/435415244 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f48fc1fa370 con 0x7f48fc0d50c0 2024-09-17T05:42:47.430 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:47.428+0000 7f48fad9d640 1 --2- 172.21.15.150:0/435415244 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f48fc0d50c0 0x7f48fc160a70 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f48f4009d90 tx=0x7f48f4003f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:42:47.430 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:47.428+0000 7f48f37fe640 1 -- 172.21.15.150:0/435415244 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48f4044070 con 0x7f48fc0d50c0 2024-09-17T05:42:47.430 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:47.428+0000 7f48f37fe640 1 -- 172.21.15.150:0/435415244 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f48f402e7f0 con 0x7f48fc0d50c0 2024-09-17T05:42:47.431 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:47.428+0000 7f4900ad5640 1 -- 172.21.15.150:0/435415244 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f48fc1eaef0 con 0x7f48fc0d50c0 2024-09-17T05:42:47.431 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:47.428+0000 7f48f37fe640 1 -- 172.21.15.150:0/435415244 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48f40044b0 con 0x7f48fc0d50c0 2024-09-17T05:42:47.431 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:47.428+0000 7f4900ad5640 1 -- 172.21.15.150:0/435415244 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f48fc1eb4b0 con 0x7f48fc0d50c0 2024-09-17T05:42:47.431 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:47.429+0000 7f4900ad5640 1 -- 172.21.15.150:0/435415244 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f48fc0b4ad0 con 0x7f48fc0d50c0 2024-09-17T05:42:47.432 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:47.430+0000 7f48f37fe640 1 -- 172.21.15.150:0/435415244 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f48f4047070 con 0x7f48fc0d50c0 2024-09-17T05:42:47.432 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:47.430+0000 7f48f37fe640 1 --2- 172.21.15.150:0/435415244 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f48dc078b90 0x7f48dc07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:42:47.432 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:47.430+0000 7f48f37fe640 1 -- 172.21.15.150:0/435415244 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7f48f40bbc80 con 0x7f48fc0d50c0 2024-09-17T05:42:47.432 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:47.430+0000 7f48fa59c640 1 --2- 172.21.15.150:0/435415244 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f48dc078b90 0x7f48dc07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:42:47.432 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:47.431+0000 7f48fa59c640 1 --2- 172.21.15.150:0/435415244 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f48dc078b90 0x7f48dc07b0a0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f48ec004630 tx=0x7f48ec00b2e0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:42:47.435 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:47.435+0000 7f48f37fe640 1 -- 172.21.15.150:0/435415244 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f48f4032030 con 0x7f48fc0d50c0 2024-09-17T05:42:47.609 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:47.608+0000 7f4900ad5640 1 -- 172.21.15.150:0/435415244 --> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f48fc0c7bf0 con 0x7f48dc078b90 2024-09-17T05:42:47.613 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:47.613+0000 7f48f37fe640 1 -- 172.21.15.150:0/435415244 <== mgr.4108 v2:172.21.15.176:6800/3631216395 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251863 (secure 0 0 0) 0x7f48fc0c7bf0 con 0x7f48dc078b90 2024-09-17T05:42:47.616 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-09-17T05:42:47.617 INFO:teuthology.orchestra.run.smithi150.stderr:dumped all 2024-09-17T05:42:47.619 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:47.616+0000 7f4900ad5640 1 -- 172.21.15.150:0/435415244 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f48dc078b90 msgr2=0x7f48dc07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:47.619 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:47.616+0000 7f4900ad5640 1 --2- 172.21.15.150:0/435415244 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f48dc078b90 0x7f48dc07b0a0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f48ec004630 tx=0x7f48ec00b2e0 comp rx=0 tx=0).stop 2024-09-17T05:42:47.619 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:47.616+0000 7f4900ad5640 1 -- 172.21.15.150:0/435415244 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f48fc0d50c0 msgr2=0x7f48fc160a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:47.619 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:47.616+0000 7f4900ad5640 1 --2- 172.21.15.150:0/435415244 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f48fc0d50c0 0x7f48fc160a70 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f48f4009d90 tx=0x7f48f4003f10 comp rx=0 tx=0).stop 2024-09-17T05:42:47.619 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:47.616+0000 7f4900ad5640 1 -- 172.21.15.150:0/435415244 shutdown_connections 2024-09-17T05:42:47.619 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:47.616+0000 7f4900ad5640 1 --2- 172.21.15.150:0/435415244 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f48dc078b90 0x7f48dc07b0a0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:47.619 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:47.616+0000 7f4900ad5640 1 --2- 172.21.15.150:0/435415244 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f48fc0d50c0 0x7f48fc160a70 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:47.619 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:47.616+0000 7f4900ad5640 1 --2- 172.21.15.150:0/435415244 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f48fc0d1020 0x7f48fc1f9e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:47.619 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:47.616+0000 7f4900ad5640 1 --2- 172.21.15.150:0/435415244 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f48fc0b9d10 0x7f48fc1ebf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:47.619 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:47.616+0000 7f4900ad5640 1 -- 172.21.15.150:0/435415244 >> 172.21.15.150:0/435415244 conn(0x7f48fc08bfe0 msgr2=0x7f48fc0d2770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:42:47.619 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:47.616+0000 7f4900ad5640 1 -- 172.21.15.150:0/435415244 shutdown_connections 2024-09-17T05:42:47.619 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:47.616+0000 7f4900ad5640 1 -- 172.21.15.150:0/435415244 wait complete. 2024-09-17T05:42:47.628 INFO:teuthology.orchestra.run.smithi150.stdout:{"pg_ready":true,"pg_map":{"version":59,"stamp":"2024-09-17T05:42:46.855116+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":146,"num_write_kb":1642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":111,"ondisk_log_size":111,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":182,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":220428,"kb_used_data":4168,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754754292,"statfs":{"total":773094113280,"available":772868395008,"internally_reserved":0,"allocated":4268032,"data_stored":2345708,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.070124"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-17T05:42:39.788326+0000","last_change":"2024-09-17T05:42:38.809600+0000","last_active":"2024-09-17T05:42:39.788326+0000","last_peered":"2024-09-17T05:42:39.788326+0000","last_clean":"2024-09-17T05:42:39.788326+0000","last_became_active":"2024-09-17T05:42:38.809252+0000","last_became_peered":"2024-09-17T05:42:38.809252+0000","last_unstale":"2024-09-17T05:42:39.788326+0000","last_undegraded":"2024-09-17T05:42:39.788326+0000","last_fullsized":"2024-09-17T05:42:39.788326+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:42:37.772628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:42:37.772628+0000","last_clean_scrub_stamp":"2024-09-17T05:42:37.772628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:29:00.810568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-17T05:42:39.787003+0000","last_change":"2024-09-17T05:42:38.810370+0000","last_active":"2024-09-17T05:42:39.787003+0000","last_peered":"2024-09-17T05:42:39.787003+0000","last_clean":"2024-09-17T05:42:39.787003+0000","last_became_active":"2024-09-17T05:42:38.809996+0000","last_became_peered":"2024-09-17T05:42:38.809996+0000","last_unstale":"2024-09-17T05:42:39.787003+0000","last_undegraded":"2024-09-17T05:42:39.787003+0000","last_fullsized":"2024-09-17T05:42:39.787003+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:42:37.772628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:42:37.772628+0000","last_clean_scrub_stamp":"2024-09-17T05:42:37.772628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:14:56.692341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-17T05:42:39.847318+0000","last_change":"2024-09-17T05:42:38.807299+0000","last_active":"2024-09-17T05:42:39.847318+0000","last_peered":"2024-09-17T05:42:39.847318+0000","last_clean":"2024-09-17T05:42:39.847318+0000","last_became_active":"2024-09-17T05:42:38.806807+0000","last_became_peered":"2024-09-17T05:42:38.806807+0000","last_unstale":"2024-09-17T05:42:39.847318+0000","last_undegraded":"2024-09-17T05:42:39.847318+0000","last_fullsized":"2024-09-17T05:42:39.847318+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:42:37.772628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:42:37.772628+0000","last_clean_scrub_stamp":"2024-09-17T05:42:37.772628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:48:13.659827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-17T05:42:40.797628+0000","last_change":"2024-09-17T05:42:38.818758+0000","last_active":"2024-09-17T05:42:40.797628+0000","last_peered":"2024-09-17T05:42:40.797628+0000","last_clean":"2024-09-17T05:42:40.797628+0000","last_became_active":"2024-09-17T05:42:38.817788+0000","last_became_peered":"2024-09-17T05:42:38.817788+0000","last_unstale":"2024-09-17T05:42:40.797628+0000","last_undegraded":"2024-09-17T05:42:40.797628+0000","last_fullsized":"2024-09-17T05:42:40.797628+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:42:37.772628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:42:37.772628+0000","last_clean_scrub_stamp":"2024-09-17T05:42:37.772628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:31:05.241317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-17T05:42:40.837070+0000","last_change":"2024-09-17T05:42:38.813119+0000","last_active":"2024-09-17T05:42:40.837070+0000","last_peered":"2024-09-17T05:42:40.837070+0000","last_clean":"2024-09-17T05:42:40.837070+0000","last_became_active":"2024-09-17T05:42:38.812772+0000","last_became_peered":"2024-09-17T05:42:38.812772+0000","last_unstale":"2024-09-17T05:42:40.837070+0000","last_undegraded":"2024-09-17T05:42:40.837070+0000","last_fullsized":"2024-09-17T05:42:40.837070+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:42:37.772628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:42:37.772628+0000","last_clean_scrub_stamp":"2024-09-17T05:42:37.772628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:29:08.669531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-17T05:42:39.786425+0000","last_change":"2024-09-17T05:42:38.816796+0000","last_active":"2024-09-17T05:42:39.786425+0000","last_peered":"2024-09-17T05:42:39.786425+0000","last_clean":"2024-09-17T05:42:39.786425+0000","last_became_active":"2024-09-17T05:42:38.816470+0000","last_became_peered":"2024-09-17T05:42:38.816470+0000","last_unstale":"2024-09-17T05:42:39.786425+0000","last_undegraded":"2024-09-17T05:42:39.786425+0000","last_fullsized":"2024-09-17T05:42:39.786425+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:42:37.772628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:42:37.772628+0000","last_clean_scrub_stamp":"2024-09-17T05:42:37.772628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:56:23.468850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-17T05:42:39.789536+0000","last_change":"2024-09-17T05:42:38.802573+0000","last_active":"2024-09-17T05:42:39.789536+0000","last_peered":"2024-09-17T05:42:39.789536+0000","last_clean":"2024-09-17T05:42:39.789536+0000","last_became_active":"2024-09-17T05:42:38.802290+0000","last_became_peered":"2024-09-17T05:42:38.802290+0000","last_unstale":"2024-09-17T05:42:39.789536+0000","last_undegraded":"2024-09-17T05:42:39.789536+0000","last_fullsized":"2024-09-17T05:42:39.789536+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:42:37.772628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:42:37.772628+0000","last_clean_scrub_stamp":"2024-09-17T05:42:37.772628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:45:42.335613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-17T05:42:39.788983+0000","last_change":"2024-09-17T05:42:38.804796+0000","last_active":"2024-09-17T05:42:39.788983+0000","last_peered":"2024-09-17T05:42:39.788983+0000","last_clean":"2024-09-17T05:42:39.788983+0000","last_became_active":"2024-09-17T05:42:38.804489+0000","last_became_peered":"2024-09-17T05:42:38.804489+0000","last_unstale":"2024-09-17T05:42:39.788983+0000","last_undegraded":"2024-09-17T05:42:39.788983+0000","last_fullsized":"2024-09-17T05:42:39.788983+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:42:37.772628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:42:37.772628+0000","last_clean_scrub_stamp":"2024-09-17T05:42:37.772628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:44:58.328573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-17T05:42:40.522284+0000","last_change":"2024-09-17T05:42:38.811030+0000","last_active":"2024-09-17T05:42:40.522284+0000","last_peered":"2024-09-17T05:42:40.522284+0000","last_clean":"2024-09-17T05:42:40.522284+0000","last_became_active":"2024-09-17T05:42:38.810688+0000","last_became_peered":"2024-09-17T05:42:38.810688+0000","last_unstale":"2024-09-17T05:42:40.522284+0000","last_undegraded":"2024-09-17T05:42:40.522284+0000","last_fullsized":"2024-09-17T05:42:40.522284+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:42:37.772628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:42:37.772628+0000","last_clean_scrub_stamp":"2024-09-17T05:42:37.772628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:21:58.970437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-17T05:42:40.797911+0000","last_change":"2024-09-17T05:42:38.818223+0000","last_active":"2024-09-17T05:42:40.797911+0000","last_peered":"2024-09-17T05:42:40.797911+0000","last_clean":"2024-09-17T05:42:40.797911+0000","last_became_active":"2024-09-17T05:42:38.817887+0000","last_became_peered":"2024-09-17T05:42:38.817887+0000","last_unstale":"2024-09-17T05:42:40.797911+0000","last_undegraded":"2024-09-17T05:42:40.797911+0000","last_fullsized":"2024-09-17T05:42:40.797911+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:42:37.772628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:42:37.772628+0000","last_clean_scrub_stamp":"2024-09-17T05:42:37.772628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:56:29.121255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-17T05:42:39.789271+0000","last_change":"2024-09-17T05:42:38.811781+0000","last_active":"2024-09-17T05:42:39.789271+0000","last_peered":"2024-09-17T05:42:39.789271+0000","last_clean":"2024-09-17T05:42:39.789271+0000","last_became_active":"2024-09-17T05:42:38.811496+0000","last_became_peered":"2024-09-17T05:42:38.811496+0000","last_unstale":"2024-09-17T05:42:39.789271+0000","last_undegraded":"2024-09-17T05:42:39.789271+0000","last_fullsized":"2024-09-17T05:42:39.789271+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:42:37.772628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:42:37.772628+0000","last_clean_scrub_stamp":"2024-09-17T05:42:37.772628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:14:51.758783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-17T05:42:39.847447+0000","last_change":"2024-09-17T05:42:38.815672+0000","last_active":"2024-09-17T05:42:39.847447+0000","last_peered":"2024-09-17T05:42:39.847447+0000","last_clean":"2024-09-17T05:42:39.847447+0000","last_became_active":"2024-09-17T05:42:38.815304+0000","last_became_peered":"2024-09-17T05:42:38.815304+0000","last_unstale":"2024-09-17T05:42:39.847447+0000","last_undegraded":"2024-09-17T05:42:39.847447+0000","last_fullsized":"2024-09-17T05:42:39.847447+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:42:37.772628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:42:37.772628+0000","last_clean_scrub_stamp":"2024-09-17T05:42:37.772628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:45:42.335613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-17T05:42:40.837016+0000","last_change":"2024-09-17T05:42:38.811245+0000","last_active":"2024-09-17T05:42:40.837016+0000","last_peered":"2024-09-17T05:42:40.837016+0000","last_clean":"2024-09-17T05:42:40.837016+0000","last_became_active":"2024-09-17T05:42:38.809546+0000","last_became_peered":"2024-09-17T05:42:38.809546+0000","last_unstale":"2024-09-17T05:42:40.837016+0000","last_undegraded":"2024-09-17T05:42:40.837016+0000","last_fullsized":"2024-09-17T05:42:40.837016+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:42:37.772628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:42:37.772628+0000","last_clean_scrub_stamp":"2024-09-17T05:42:37.772628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:49:05.954213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-17T05:42:39.786411+0000","last_change":"2024-09-17T05:42:38.817500+0000","last_active":"2024-09-17T05:42:39.786411+0000","last_peered":"2024-09-17T05:42:39.786411+0000","last_clean":"2024-09-17T05:42:39.786411+0000","last_became_active":"2024-09-17T05:42:38.816684+0000","last_became_peered":"2024-09-17T05:42:38.816684+0000","last_unstale":"2024-09-17T05:42:39.786411+0000","last_undegraded":"2024-09-17T05:42:39.786411+0000","last_fullsized":"2024-09-17T05:42:39.786411+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:42:37.772628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:42:37.772628+0000","last_clean_scrub_stamp":"2024-09-17T05:42:37.772628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:59:25.322085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-17T05:42:39.847253+0000","last_change":"2024-09-17T05:42:38.804339+0000","last_active":"2024-09-17T05:42:39.847253+0000","last_peered":"2024-09-17T05:42:39.847253+0000","last_clean":"2024-09-17T05:42:39.847253+0000","last_became_active":"2024-09-17T05:42:38.803924+0000","last_became_peered":"2024-09-17T05:42:38.803924+0000","last_unstale":"2024-09-17T05:42:39.847253+0000","last_undegraded":"2024-09-17T05:42:39.847253+0000","last_fullsized":"2024-09-17T05:42:39.847253+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:42:37.772628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:42:37.772628+0000","last_clean_scrub_stamp":"2024-09-17T05:42:37.772628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:06:11.277950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-17T05:42:39.789462+0000","last_change":"2024-09-17T05:42:38.815849+0000","last_active":"2024-09-17T05:42:39.789462+0000","last_peered":"2024-09-17T05:42:39.789462+0000","last_clean":"2024-09-17T05:42:39.789462+0000","last_became_active":"2024-09-17T05:42:38.815296+0000","last_became_peered":"2024-09-17T05:42:38.815296+0000","last_unstale":"2024-09-17T05:42:39.789462+0000","last_undegraded":"2024-09-17T05:42:39.789462+0000","last_fullsized":"2024-09-17T05:42:39.789462+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:42:37.772628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:42:37.772628+0000","last_clean_scrub_stamp":"2024-09-17T05:42:37.772628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:56:23.468850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-17T05:42:39.789530+0000","last_change":"2024-09-17T05:42:38.803948+0000","last_active":"2024-09-17T05:42:39.789530+0000","last_peered":"2024-09-17T05:42:39.789530+0000","last_clean":"2024-09-17T05:42:39.789530+0000","last_became_active":"2024-09-17T05:42:38.803640+0000","last_became_peered":"2024-09-17T05:42:38.803640+0000","last_unstale":"2024-09-17T05:42:39.789530+0000","last_undegraded":"2024-09-17T05:42:39.789530+0000","last_fullsized":"2024-09-17T05:42:39.789530+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:42:37.772628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:42:37.772628+0000","last_clean_scrub_stamp":"2024-09-17T05:42:37.772628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:01:56.852587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-17T05:42:39.787019+0000","last_change":"2024-09-17T05:42:38.820211+0000","last_active":"2024-09-17T05:42:39.787019+0000","last_peered":"2024-09-17T05:42:39.787019+0000","last_clean":"2024-09-17T05:42:39.787019+0000","last_became_active":"2024-09-17T05:42:38.819891+0000","last_became_peered":"2024-09-17T05:42:38.819891+0000","last_unstale":"2024-09-17T05:42:39.787019+0000","last_undegraded":"2024-09-17T05:42:39.787019+0000","last_fullsized":"2024-09-17T05:42:39.787019+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:42:37.772628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:42:37.772628+0000","last_clean_scrub_stamp":"2024-09-17T05:42:37.772628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:00:28.428098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-17T05:42:39.786739+0000","last_change":"2024-09-17T05:42:38.820057+0000","last_active":"2024-09-17T05:42:39.786739+0000","last_peered":"2024-09-17T05:42:39.786739+0000","last_clean":"2024-09-17T05:42:39.786739+0000","last_became_active":"2024-09-17T05:42:38.819752+0000","last_became_peered":"2024-09-17T05:42:38.819752+0000","last_unstale":"2024-09-17T05:42:39.786739+0000","last_undegraded":"2024-09-17T05:42:39.786739+0000","last_fullsized":"2024-09-17T05:42:39.786739+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:42:37.772628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:42:37.772628+0000","last_clean_scrub_stamp":"2024-09-17T05:42:37.772628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:57:09.386461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-17T05:42:40.837357+0000","last_change":"2024-09-17T05:42:38.809007+0000","last_active":"2024-09-17T05:42:40.837357+0000","last_peered":"2024-09-17T05:42:40.837357+0000","last_clean":"2024-09-17T05:42:40.837357+0000","last_became_active":"2024-09-17T05:42:38.808669+0000","last_became_peered":"2024-09-17T05:42:38.808669+0000","last_unstale":"2024-09-17T05:42:40.837357+0000","last_undegraded":"2024-09-17T05:42:40.837357+0000","last_fullsized":"2024-09-17T05:42:40.837357+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:42:37.772628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:42:37.772628+0000","last_clean_scrub_stamp":"2024-09-17T05:42:37.772628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:57:21.510110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-17T05:42:40.521773+0000","last_change":"2024-09-17T05:42:38.802973+0000","last_active":"2024-09-17T05:42:40.521773+0000","last_peered":"2024-09-17T05:42:40.521773+0000","last_clean":"2024-09-17T05:42:40.521773+0000","last_became_active":"2024-09-17T05:42:38.802601+0000","last_became_peered":"2024-09-17T05:42:38.802601+0000","last_unstale":"2024-09-17T05:42:40.521773+0000","last_undegraded":"2024-09-17T05:42:40.521773+0000","last_fullsized":"2024-09-17T05:42:40.521773+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:42:37.772628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:42:37.772628+0000","last_clean_scrub_stamp":"2024-09-17T05:42:37.772628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:50:47.581671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-17T05:42:40.521996+0000","last_change":"2024-09-17T05:42:38.813252+0000","last_active":"2024-09-17T05:42:40.521996+0000","last_peered":"2024-09-17T05:42:40.521996+0000","last_clean":"2024-09-17T05:42:40.521996+0000","last_became_active":"2024-09-17T05:42:38.812790+0000","last_became_peered":"2024-09-17T05:42:38.812790+0000","last_unstale":"2024-09-17T05:42:40.521996+0000","last_undegraded":"2024-09-17T05:42:40.521996+0000","last_fullsized":"2024-09-17T05:42:40.521996+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:42:37.772628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:42:37.772628+0000","last_clean_scrub_stamp":"2024-09-17T05:42:37.772628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:46:13.440636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-17T05:42:40.792675+0000","last_change":"2024-09-17T05:42:38.811145+0000","last_active":"2024-09-17T05:42:40.792675+0000","last_peered":"2024-09-17T05:42:40.792675+0000","last_clean":"2024-09-17T05:42:40.792675+0000","last_became_active":"2024-09-17T05:42:38.810782+0000","last_became_peered":"2024-09-17T05:42:38.810782+0000","last_unstale":"2024-09-17T05:42:40.792675+0000","last_undegraded":"2024-09-17T05:42:40.792675+0000","last_fullsized":"2024-09-17T05:42:40.792675+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:42:37.772628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:42:37.772628+0000","last_clean_scrub_stamp":"2024-09-17T05:42:37.772628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:16:36.184234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-17T05:42:39.847210+0000","last_change":"2024-09-17T05:42:38.808579+0000","last_active":"2024-09-17T05:42:39.847210+0000","last_peered":"2024-09-17T05:42:39.847210+0000","last_clean":"2024-09-17T05:42:39.847210+0000","last_became_active":"2024-09-17T05:42:38.808256+0000","last_became_peered":"2024-09-17T05:42:38.808256+0000","last_unstale":"2024-09-17T05:42:39.847210+0000","last_undegraded":"2024-09-17T05:42:39.847210+0000","last_fullsized":"2024-09-17T05:42:39.847210+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:42:37.772628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:42:37.772628+0000","last_clean_scrub_stamp":"2024-09-17T05:42:37.772628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:05:21.436685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-17T05:42:40.798046+0000","last_change":"2024-09-17T05:42:38.804818+0000","last_active":"2024-09-17T05:42:40.798046+0000","last_peered":"2024-09-17T05:42:40.798046+0000","last_clean":"2024-09-17T05:42:40.798046+0000","last_became_active":"2024-09-17T05:42:38.804487+0000","last_became_peered":"2024-09-17T05:42:38.804487+0000","last_unstale":"2024-09-17T05:42:40.798046+0000","last_undegraded":"2024-09-17T05:42:40.798046+0000","last_fullsized":"2024-09-17T05:42:40.798046+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:42:37.772628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:42:37.772628+0000","last_clean_scrub_stamp":"2024-09-17T05:42:37.772628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:11:24.017133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-17T05:42:39.787129+0000","last_change":"2024-09-17T05:42:38.812656+0000","last_active":"2024-09-17T05:42:39.787129+0000","last_peered":"2024-09-17T05:42:39.787129+0000","last_clean":"2024-09-17T05:42:39.787129+0000","last_became_active":"2024-09-17T05:42:38.812215+0000","last_became_peered":"2024-09-17T05:42:38.812215+0000","last_unstale":"2024-09-17T05:42:39.787129+0000","last_undegraded":"2024-09-17T05:42:39.787129+0000","last_fullsized":"2024-09-17T05:42:39.787129+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:42:37.772628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:42:37.772628+0000","last_clean_scrub_stamp":"2024-09-17T05:42:37.772628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:01:06.983156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-17T05:42:40.798003+0000","last_change":"2024-09-17T05:42:38.818086+0000","last_active":"2024-09-17T05:42:40.798003+0000","last_peered":"2024-09-17T05:42:40.798003+0000","last_clean":"2024-09-17T05:42:40.798003+0000","last_became_active":"2024-09-17T05:42:38.817663+0000","last_became_peered":"2024-09-17T05:42:38.817663+0000","last_unstale":"2024-09-17T05:42:40.798003+0000","last_undegraded":"2024-09-17T05:42:40.798003+0000","last_fullsized":"2024-09-17T05:42:40.798003+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:42:37.772628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:42:37.772628+0000","last_clean_scrub_stamp":"2024-09-17T05:42:37.772628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:05:21.436685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-17T05:42:39.847443+0000","last_change":"2024-09-17T05:42:38.805594+0000","last_active":"2024-09-17T05:42:39.847443+0000","last_peered":"2024-09-17T05:42:39.847443+0000","last_clean":"2024-09-17T05:42:39.847443+0000","last_became_active":"2024-09-17T05:42:38.804957+0000","last_became_peered":"2024-09-17T05:42:38.804957+0000","last_unstale":"2024-09-17T05:42:39.847443+0000","last_undegraded":"2024-09-17T05:42:39.847443+0000","last_fullsized":"2024-09-17T05:42:39.847443+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:42:37.772628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:42:37.772628+0000","last_clean_scrub_stamp":"2024-09-17T05:42:37.772628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:56:23.468850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-17T05:42:40.521839+0000","last_change":"2024-09-17T05:42:38.814787+0000","last_active":"2024-09-17T05:42:40.521839+0000","last_peered":"2024-09-17T05:42:40.521839+0000","last_clean":"2024-09-17T05:42:40.521839+0000","last_became_active":"2024-09-17T05:42:38.814444+0000","last_became_peered":"2024-09-17T05:42:38.814444+0000","last_unstale":"2024-09-17T05:42:40.521839+0000","last_undegraded":"2024-09-17T05:42:40.521839+0000","last_fullsized":"2024-09-17T05:42:40.521839+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:42:37.772628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:42:37.772628+0000","last_clean_scrub_stamp":"2024-09-17T05:42:37.772628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:33:11.874170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-17T05:42:39.788977+0000","last_change":"2024-09-17T05:42:38.800573+0000","last_active":"2024-09-17T05:42:39.788977+0000","last_peered":"2024-09-17T05:42:39.788977+0000","last_clean":"2024-09-17T05:42:39.788977+0000","last_became_active":"2024-09-17T05:42:38.800170+0000","last_became_peered":"2024-09-17T05:42:38.800170+0000","last_unstale":"2024-09-17T05:42:39.788977+0000","last_undegraded":"2024-09-17T05:42:39.788977+0000","last_fullsized":"2024-09-17T05:42:39.788977+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:42:37.772628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:42:37.772628+0000","last_clean_scrub_stamp":"2024-09-17T05:42:37.772628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:11:24.017133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-17T05:42:39.787984+0000","last_change":"2024-09-17T05:42:38.798553+0000","last_active":"2024-09-17T05:42:39.787984+0000","last_peered":"2024-09-17T05:42:39.787984+0000","last_clean":"2024-09-17T05:42:39.787984+0000","last_became_active":"2024-09-17T05:42:38.798026+0000","last_became_peered":"2024-09-17T05:42:38.798026+0000","last_unstale":"2024-09-17T05:42:39.787984+0000","last_undegraded":"2024-09-17T05:42:39.787984+0000","last_fullsized":"2024-09-17T05:42:39.787984+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:42:37.772628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:42:37.772628+0000","last_clean_scrub_stamp":"2024-09-17T05:42:37.772628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:35:43.722989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-17T05:42:39.788784+0000","last_change":"2024-09-17T05:42:38.809055+0000","last_active":"2024-09-17T05:42:39.788784+0000","last_peered":"2024-09-17T05:42:39.788784+0000","last_clean":"2024-09-17T05:42:39.788784+0000","last_became_active":"2024-09-17T05:42:38.808725+0000","last_became_peered":"2024-09-17T05:42:38.808725+0000","last_unstale":"2024-09-17T05:42:39.788784+0000","last_undegraded":"2024-09-17T05:42:39.788784+0000","last_fullsized":"2024-09-17T05:42:39.788784+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:42:37.772628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:42:37.772628+0000","last_clean_scrub_stamp":"2024-09-17T05:42:37.772628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:56:29.121255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-17T05:42:40.792835+0000","last_change":"2024-09-17T05:42:38.810433+0000","last_active":"2024-09-17T05:42:40.792835+0000","last_peered":"2024-09-17T05:42:40.792835+0000","last_clean":"2024-09-17T05:42:40.792835+0000","last_became_active":"2024-09-17T05:42:38.810116+0000","last_became_peered":"2024-09-17T05:42:38.810116+0000","last_unstale":"2024-09-17T05:42:40.792835+0000","last_undegraded":"2024-09-17T05:42:40.792835+0000","last_fullsized":"2024-09-17T05:42:40.792835+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:42:37.772628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:42:37.772628+0000","last_clean_scrub_stamp":"2024-09-17T05:42:37.772628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:32:30.114769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"33'4","reported_seq":19,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-17T05:42:39.788402+0000","last_change":"2024-09-17T05:42:37.796176+0000","last_active":"2024-09-17T05:42:39.788402+0000","last_peered":"2024-09-17T05:42:39.788402+0000","last_clean":"2024-09-17T05:42:39.788402+0000","last_became_active":"2024-09-17T05:42:37.795881+0000","last_became_peered":"2024-09-17T05:42:37.795881+0000","last_unstale":"2024-09-17T05:42:39.788402+0000","last_undegraded":"2024-09-17T05:42:39.788402+0000","last_fullsized":"2024-09-17T05:42:39.788402+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:42:36.770435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:42:36.770435+0000","last_clean_scrub_stamp":"2024-09-17T05:42:36.770435+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:56:54.491587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-17T05:42:39.788424+0000","last_change":"2024-09-17T05:42:38.809796+0000","last_active":"2024-09-17T05:42:39.788424+0000","last_peered":"2024-09-17T05:42:39.788424+0000","last_clean":"2024-09-17T05:42:39.788424+0000","last_became_active":"2024-09-17T05:42:38.809498+0000","last_became_peered":"2024-09-17T05:42:38.809498+0000","last_unstale":"2024-09-17T05:42:39.788424+0000","last_undegraded":"2024-09-17T05:42:39.788424+0000","last_fullsized":"2024-09-17T05:42:39.788424+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:42:37.772628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:42:37.772628+0000","last_clean_scrub_stamp":"2024-09-17T05:42:37.772628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:31:04.584637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1e","version":"33'1","reported_seq":16,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-17T05:42:40.792824+0000","last_change":"2024-09-17T05:42:37.802980+0000","last_active":"2024-09-17T05:42:40.792824+0000","last_peered":"2024-09-17T05:42:40.792824+0000","last_clean":"2024-09-17T05:42:40.792824+0000","last_became_active":"2024-09-17T05:42:37.802617+0000","last_became_peered":"2024-09-17T05:42:37.802617+0000","last_unstale":"2024-09-17T05:42:40.792824+0000","last_undegraded":"2024-09-17T05:42:40.792824+0000","last_fullsized":"2024-09-17T05:42:40.792824+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:42:36.770435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:42:36.770435+0000","last_clean_scrub_stamp":"2024-09-17T05:42:36.770435+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:00:38.655270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-17T05:42:40.522249+0000","last_change":"2024-09-17T05:42:38.818122+0000","last_active":"2024-09-17T05:42:40.522249+0000","last_peered":"2024-09-17T05:42:40.522249+0000","last_clean":"2024-09-17T05:42:40.522249+0000","last_became_active":"2024-09-17T05:42:38.817832+0000","last_became_peered":"2024-09-17T05:42:38.817832+0000","last_unstale":"2024-09-17T05:42:40.522249+0000","last_undegraded":"2024-09-17T05:42:40.522249+0000","last_fullsized":"2024-09-17T05:42:40.522249+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:42:37.772628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:42:37.772628+0000","last_clean_scrub_stamp":"2024-09-17T05:42:37.772628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:57:09.672673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"33'2","reported_seq":17,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-17T05:42:39.786857+0000","last_change":"2024-09-17T05:42:37.805183+0000","last_active":"2024-09-17T05:42:39.786857+0000","last_peered":"2024-09-17T05:42:39.786857+0000","last_clean":"2024-09-17T05:42:39.786857+0000","last_became_active":"2024-09-17T05:42:37.804856+0000","last_became_peered":"2024-09-17T05:42:37.804856+0000","last_unstale":"2024-09-17T05:42:39.786857+0000","last_undegraded":"2024-09-17T05:42:39.786857+0000","last_fullsized":"2024-09-17T05:42:39.786857+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:42:36.770435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:42:36.770435+0000","last_clean_scrub_stamp":"2024-09-17T05:42:36.770435+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:53:13.976559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-17T05:42:40.798052+0000","last_change":"2024-09-17T05:42:38.811881+0000","last_active":"2024-09-17T05:42:40.798052+0000","last_peered":"2024-09-17T05:42:40.798052+0000","last_clean":"2024-09-17T05:42:40.798052+0000","last_became_active":"2024-09-17T05:42:38.809272+0000","last_became_peered":"2024-09-17T05:42:38.809272+0000","last_unstale":"2024-09-17T05:42:40.798052+0000","last_undegraded":"2024-09-17T05:42:40.798052+0000","last_fullsized":"2024-09-17T05:42:40.798052+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:42:37.772628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:42:37.772628+0000","last_clean_scrub_stamp":"2024-09-17T05:42:37.772628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:06:11.277950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"33'2","reported_seq":17,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-17T05:42:40.837089+0000","last_change":"2024-09-17T05:42:37.806873+0000","last_active":"2024-09-17T05:42:40.837089+0000","last_peered":"2024-09-17T05:42:40.837089+0000","last_clean":"2024-09-17T05:42:40.837089+0000","last_became_active":"2024-09-17T05:42:37.806489+0000","last_became_peered":"2024-09-17T05:42:37.806489+0000","last_unstale":"2024-09-17T05:42:40.837089+0000","last_undegraded":"2024-09-17T05:42:40.837089+0000","last_fullsized":"2024-09-17T05:42:40.837089+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:42:36.770435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:42:36.770435+0000","last_clean_scrub_stamp":"2024-09-17T05:42:36.770435+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:56:33.527829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-17T05:42:39.789063+0000","last_change":"2024-09-17T05:42:38.810130+0000","last_active":"2024-09-17T05:42:39.789063+0000","last_peered":"2024-09-17T05:42:39.789063+0000","last_clean":"2024-09-17T05:42:39.789063+0000","last_became_active":"2024-09-17T05:42:38.809795+0000","last_became_peered":"2024-09-17T05:42:38.809795+0000","last_unstale":"2024-09-17T05:42:39.789063+0000","last_undegraded":"2024-09-17T05:42:39.789063+0000","last_fullsized":"2024-09-17T05:42:39.789063+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:42:37.772628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:42:37.772628+0000","last_clean_scrub_stamp":"2024-09-17T05:42:37.772628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:48:42.385641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"33'1","reported_seq":16,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-17T05:42:40.521934+0000","last_change":"2024-09-17T05:42:37.801623+0000","last_active":"2024-09-17T05:42:40.521934+0000","last_peered":"2024-09-17T05:42:40.521934+0000","last_clean":"2024-09-17T05:42:40.521934+0000","last_became_active":"2024-09-17T05:42:37.801212+0000","last_became_peered":"2024-09-17T05:42:37.801212+0000","last_unstale":"2024-09-17T05:42:40.521934+0000","last_undegraded":"2024-09-17T05:42:40.521934+0000","last_fullsized":"2024-09-17T05:42:40.521934+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:42:36.770435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:42:36.770435+0000","last_clean_scrub_stamp":"2024-09-17T05:42:36.770435+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:15:14.631270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-17T05:42:39.847267+0000","last_change":"2024-09-17T05:42:38.804702+0000","last_active":"2024-09-17T05:42:39.847267+0000","last_peered":"2024-09-17T05:42:39.847267+0000","last_clean":"2024-09-17T05:42:39.847267+0000","last_became_active":"2024-09-17T05:42:38.804359+0000","last_became_peered":"2024-09-17T05:42:38.804359+0000","last_unstale":"2024-09-17T05:42:39.847267+0000","last_undegraded":"2024-09-17T05:42:39.847267+0000","last_fullsized":"2024-09-17T05:42:39.847267+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:42:37.772628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:42:37.772628+0000","last_clean_scrub_stamp":"2024-09-17T05:42:37.772628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:50:12.834179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"33'1","reported_seq":16,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-17T05:42:40.522053+0000","last_change":"2024-09-17T05:42:37.797062+0000","last_active":"2024-09-17T05:42:40.522053+0000","last_peered":"2024-09-17T05:42:40.522053+0000","last_clean":"2024-09-17T05:42:40.522053+0000","last_became_active":"2024-09-17T05:42:37.796412+0000","last_became_peered":"2024-09-17T05:42:37.796412+0000","last_unstale":"2024-09-17T05:42:40.522053+0000","last_undegraded":"2024-09-17T05:42:40.522053+0000","last_fullsized":"2024-09-17T05:42:40.522053+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:42:36.770435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:42:36.770435+0000","last_clean_scrub_stamp":"2024-09-17T05:42:36.770435+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:28:00.710578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-17T05:42:40.521717+0000","last_change":"2024-09-17T05:42:38.800340+0000","last_active":"2024-09-17T05:42:40.521717+0000","last_peered":"2024-09-17T05:42:40.521717+0000","last_clean":"2024-09-17T05:42:40.521717+0000","last_became_active":"2024-09-17T05:42:38.798319+0000","last_became_peered":"2024-09-17T05:42:38.798319+0000","last_unstale":"2024-09-17T05:42:40.521717+0000","last_undegraded":"2024-09-17T05:42:40.521717+0000","last_fullsized":"2024-09-17T05:42:40.521717+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:42:37.772628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:42:37.772628+0000","last_clean_scrub_stamp":"2024-09-17T05:42:37.772628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:51:50.260513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":15,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-17T05:42:39.786151+0000","last_change":"2024-09-17T05:42:37.798675+0000","last_active":"2024-09-17T05:42:39.786151+0000","last_peered":"2024-09-17T05:42:39.786151+0000","last_clean":"2024-09-17T05:42:39.786151+0000","last_became_active":"2024-09-17T05:42:37.798337+0000","last_became_peered":"2024-09-17T05:42:37.798337+0000","last_unstale":"2024-09-17T05:42:39.786151+0000","last_undegraded":"2024-09-17T05:42:39.786151+0000","last_fullsized":"2024-09-17T05:42:39.786151+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:42:36.770435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:42:36.770435+0000","last_clean_scrub_stamp":"2024-09-17T05:42:36.770435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:26:38.326684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-17T05:42:40.797420+0000","last_change":"2024-09-17T05:42:38.812209+0000","last_active":"2024-09-17T05:42:40.797420+0000","last_peered":"2024-09-17T05:42:40.797420+0000","last_clean":"2024-09-17T05:42:40.797420+0000","last_became_active":"2024-09-17T05:42:38.811493+0000","last_became_peered":"2024-09-17T05:42:38.811493+0000","last_unstale":"2024-09-17T05:42:40.797420+0000","last_undegraded":"2024-09-17T05:42:40.797420+0000","last_fullsized":"2024-09-17T05:42:40.797420+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:42:37.772628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:42:37.772628+0000","last_clean_scrub_stamp":"2024-09-17T05:42:37.772628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:57:09.672673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":15,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-17T05:42:40.521535+0000","last_change":"2024-09-17T05:42:37.795964+0000","last_active":"2024-09-17T05:42:40.521535+0000","last_peered":"2024-09-17T05:42:40.521535+0000","last_clean":"2024-09-17T05:42:40.521535+0000","last_became_active":"2024-09-17T05:42:37.795311+0000","last_became_peered":"2024-09-17T05:42:37.795311+0000","last_unstale":"2024-09-17T05:42:40.521535+0000","last_undegraded":"2024-09-17T05:42:40.521535+0000","last_fullsized":"2024-09-17T05:42:40.521535+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:42:36.770435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:42:36.770435+0000","last_clean_scrub_stamp":"2024-09-17T05:42:36.770435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:57:20.507917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-17T05:42:39.847619+0000","last_change":"2024-09-17T05:42:38.812068+0000","last_active":"2024-09-17T05:42:39.847619+0000","last_peered":"2024-09-17T05:42:39.847619+0000","last_clean":"2024-09-17T05:42:39.847619+0000","last_became_active":"2024-09-17T05:42:38.811455+0000","last_became_peered":"2024-09-17T05:42:38.811455+0000","last_unstale":"2024-09-17T05:42:39.847619+0000","last_undegraded":"2024-09-17T05:42:39.847619+0000","last_fullsized":"2024-09-17T05:42:39.847619+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:42:37.772628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:42:37.772628+0000","last_clean_scrub_stamp":"2024-09-17T05:42:37.772628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:37:11.138729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":15,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-17T05:42:39.786891+0000","last_change":"2024-09-17T05:42:37.803872+0000","last_active":"2024-09-17T05:42:39.786891+0000","last_peered":"2024-09-17T05:42:39.786891+0000","last_clean":"2024-09-17T05:42:39.786891+0000","last_became_active":"2024-09-17T05:42:37.803571+0000","last_became_peered":"2024-09-17T05:42:37.803571+0000","last_unstale":"2024-09-17T05:42:39.786891+0000","last_undegraded":"2024-09-17T05:42:39.786891+0000","last_fullsized":"2024-09-17T05:42:39.786891+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:42:36.770435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:42:36.770435+0000","last_clean_scrub_stamp":"2024-09-17T05:42:36.770435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:18:31.876866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-17T05:42:39.786932+0000","last_change":"2024-09-17T05:42:38.820069+0000","last_active":"2024-09-17T05:42:39.786932+0000","last_peered":"2024-09-17T05:42:39.786932+0000","last_clean":"2024-09-17T05:42:39.786932+0000","last_became_active":"2024-09-17T05:42:38.819408+0000","last_became_peered":"2024-09-17T05:42:38.819408+0000","last_unstale":"2024-09-17T05:42:39.786932+0000","last_undegraded":"2024-09-17T05:42:39.786932+0000","last_fullsized":"2024-09-17T05:42:39.786932+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:42:37.772628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:42:37.772628+0000","last_clean_scrub_stamp":"2024-09-17T05:42:37.772628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:19:00.631236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":15,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-17T05:42:40.792941+0000","last_change":"2024-09-17T05:42:37.802055+0000","last_active":"2024-09-17T05:42:40.792941+0000","last_peered":"2024-09-17T05:42:40.792941+0000","last_clean":"2024-09-17T05:42:40.792941+0000","last_became_active":"2024-09-17T05:42:37.801718+0000","last_became_peered":"2024-09-17T05:42:37.801718+0000","last_unstale":"2024-09-17T05:42:40.792941+0000","last_undegraded":"2024-09-17T05:42:40.792941+0000","last_fullsized":"2024-09-17T05:42:40.792941+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:42:36.770435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:42:36.770435+0000","last_clean_scrub_stamp":"2024-09-17T05:42:36.770435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:58:07.278247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-17T05:42:39.786731+0000","last_change":"2024-09-17T05:42:38.814528+0000","last_active":"2024-09-17T05:42:39.786731+0000","last_peered":"2024-09-17T05:42:39.786731+0000","last_clean":"2024-09-17T05:42:39.786731+0000","last_became_active":"2024-09-17T05:42:38.814167+0000","last_became_peered":"2024-09-17T05:42:38.814167+0000","last_unstale":"2024-09-17T05:42:39.786731+0000","last_undegraded":"2024-09-17T05:42:39.786731+0000","last_fullsized":"2024-09-17T05:42:39.786731+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:42:37.772628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:42:37.772628+0000","last_clean_scrub_stamp":"2024-09-17T05:42:37.772628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:00:36.629732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.15","version":"33'3","reported_seq":18,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-17T05:42:39.847482+0000","last_change":"2024-09-17T05:42:37.802817+0000","last_active":"2024-09-17T05:42:39.847482+0000","last_peered":"2024-09-17T05:42:39.847482+0000","last_clean":"2024-09-17T05:42:39.847482+0000","last_became_active":"2024-09-17T05:42:37.802357+0000","last_became_peered":"2024-09-17T05:42:37.802357+0000","last_unstale":"2024-09-17T05:42:39.847482+0000","last_undegraded":"2024-09-17T05:42:39.847482+0000","last_fullsized":"2024-09-17T05:42:39.847482+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:42:36.770435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:42:36.770435+0000","last_clean_scrub_stamp":"2024-09-17T05:42:36.770435+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:04:15.682574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-17T05:42:39.847233+0000","last_change":"2024-09-17T05:42:38.806292+0000","last_active":"2024-09-17T05:42:39.847233+0000","last_peered":"2024-09-17T05:42:39.847233+0000","last_clean":"2024-09-17T05:42:39.847233+0000","last_became_active":"2024-09-17T05:42:38.805974+0000","last_became_peered":"2024-09-17T05:42:38.805974+0000","last_unstale":"2024-09-17T05:42:39.847233+0000","last_undegraded":"2024-09-17T05:42:39.847233+0000","last_fullsized":"2024-09-17T05:42:39.847233+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:42:37.772628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:42:37.772628+0000","last_clean_scrub_stamp":"2024-09-17T05:42:37.772628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:12:47.279209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"33'6","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-17T05:42:39.786777+0000","last_change":"2024-09-17T05:42:37.806610+0000","last_active":"2024-09-17T05:42:39.786777+0000","last_peered":"2024-09-17T05:42:39.786777+0000","last_clean":"2024-09-17T05:42:39.786777+0000","last_became_active":"2024-09-17T05:42:37.806267+0000","last_became_peered":"2024-09-17T05:42:37.806267+0000","last_unstale":"2024-09-17T05:42:39.786777+0000","last_undegraded":"2024-09-17T05:42:39.786777+0000","last_fullsized":"2024-09-17T05:42:39.786777+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:42:36.770435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:42:36.770435+0000","last_clean_scrub_stamp":"2024-09-17T05:42:36.770435+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:13:27.347285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-17T05:42:40.797411+0000","last_change":"2024-09-17T05:42:38.801931+0000","last_active":"2024-09-17T05:42:40.797411+0000","last_peered":"2024-09-17T05:42:40.797411+0000","last_clean":"2024-09-17T05:42:40.797411+0000","last_became_active":"2024-09-17T05:42:38.801616+0000","last_became_peered":"2024-09-17T05:42:38.801616+0000","last_unstale":"2024-09-17T05:42:40.797411+0000","last_undegraded":"2024-09-17T05:42:40.797411+0000","last_fullsized":"2024-09-17T05:42:40.797411+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:42:37.772628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:42:37.772628+0000","last_clean_scrub_stamp":"2024-09-17T05:42:37.772628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:25:01.585268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"33'2","reported_seq":17,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-17T05:42:40.522008+0000","last_change":"2024-09-17T05:42:37.799534+0000","last_active":"2024-09-17T05:42:40.522008+0000","last_peered":"2024-09-17T05:42:40.522008+0000","last_clean":"2024-09-17T05:42:40.522008+0000","last_became_active":"2024-09-17T05:42:37.798838+0000","last_became_peered":"2024-09-17T05:42:37.798838+0000","last_unstale":"2024-09-17T05:42:40.522008+0000","last_undegraded":"2024-09-17T05:42:40.522008+0000","last_fullsized":"2024-09-17T05:42:40.522008+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:42:36.770435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:42:36.770435+0000","last_clean_scrub_stamp":"2024-09-17T05:42:36.770435+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:05:24.768584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-17T05:42:39.786701+0000","last_change":"2024-09-17T05:42:38.813425+0000","last_active":"2024-09-17T05:42:39.786701+0000","last_peered":"2024-09-17T05:42:39.786701+0000","last_clean":"2024-09-17T05:42:39.786701+0000","last_became_active":"2024-09-17T05:42:38.813104+0000","last_became_peered":"2024-09-17T05:42:38.813104+0000","last_unstale":"2024-09-17T05:42:39.786701+0000","last_undegraded":"2024-09-17T05:42:39.786701+0000","last_fullsized":"2024-09-17T05:42:39.786701+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:42:37.772628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:42:37.772628+0000","last_clean_scrub_stamp":"2024-09-17T05:42:37.772628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:01:56.852587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":15,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-17T05:42:40.797333+0000","last_change":"2024-09-17T05:42:37.804193+0000","last_active":"2024-09-17T05:42:40.797333+0000","last_peered":"2024-09-17T05:42:40.797333+0000","last_clean":"2024-09-17T05:42:40.797333+0000","last_became_active":"2024-09-17T05:42:37.803188+0000","last_became_peered":"2024-09-17T05:42:37.803188+0000","last_unstale":"2024-09-17T05:42:40.797333+0000","last_undegraded":"2024-09-17T05:42:40.797333+0000","last_fullsized":"2024-09-17T05:42:40.797333+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:42:36.770435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:42:36.770435+0000","last_clean_scrub_stamp":"2024-09-17T05:42:36.770435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:51:43.041335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-17T05:42:39.789632+0000","last_change":"2024-09-17T05:42:38.814207+0000","last_active":"2024-09-17T05:42:39.789632+0000","last_peered":"2024-09-17T05:42:39.789632+0000","last_clean":"2024-09-17T05:42:39.789632+0000","last_became_active":"2024-09-17T05:42:38.813793+0000","last_became_peered":"2024-09-17T05:42:38.813793+0000","last_unstale":"2024-09-17T05:42:39.789632+0000","last_undegraded":"2024-09-17T05:42:39.789632+0000","last_fullsized":"2024-09-17T05:42:39.789632+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:42:37.772628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:42:37.772628+0000","last_clean_scrub_stamp":"2024-09-17T05:42:37.772628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:57:09.386461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":15,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-17T05:42:39.786209+0000","last_change":"2024-09-17T05:42:37.802960+0000","last_active":"2024-09-17T05:42:39.786209+0000","last_peered":"2024-09-17T05:42:39.786209+0000","last_clean":"2024-09-17T05:42:39.786209+0000","last_became_active":"2024-09-17T05:42:37.802639+0000","last_became_peered":"2024-09-17T05:42:37.802639+0000","last_unstale":"2024-09-17T05:42:39.786209+0000","last_undegraded":"2024-09-17T05:42:39.786209+0000","last_fullsized":"2024-09-17T05:42:39.786209+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:42:36.770435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:42:36.770435+0000","last_clean_scrub_stamp":"2024-09-17T05:42:36.770435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:04:15.682574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-17T05:42:39.787978+0000","last_change":"2024-09-17T05:42:38.809277+0000","last_active":"2024-09-17T05:42:39.787978+0000","last_peered":"2024-09-17T05:42:39.787978+0000","last_clean":"2024-09-17T05:42:39.787978+0000","last_became_active":"2024-09-17T05:42:38.807989+0000","last_became_peered":"2024-09-17T05:42:38.807989+0000","last_unstale":"2024-09-17T05:42:39.787978+0000","last_undegraded":"2024-09-17T05:42:39.787978+0000","last_fullsized":"2024-09-17T05:42:39.787978+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:42:37.772628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:42:37.772628+0000","last_clean_scrub_stamp":"2024-09-17T05:42:37.772628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:12:32.953365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.10","version":"33'8","reported_seq":23,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-17T05:42:39.786201+0000","last_change":"2024-09-17T05:42:37.804595+0000","last_active":"2024-09-17T05:42:39.786201+0000","last_peered":"2024-09-17T05:42:39.786201+0000","last_clean":"2024-09-17T05:42:39.786201+0000","last_became_active":"2024-09-17T05:42:37.804280+0000","last_became_peered":"2024-09-17T05:42:37.804280+0000","last_unstale":"2024-09-17T05:42:39.786201+0000","last_undegraded":"2024-09-17T05:42:39.786201+0000","last_fullsized":"2024-09-17T05:42:39.786201+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:42:36.770435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:42:36.770435+0000","last_clean_scrub_stamp":"2024-09-17T05:42:36.770435+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:23:24.440313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-17T05:42:40.522087+0000","last_change":"2024-09-17T05:42:38.809578+0000","last_active":"2024-09-17T05:42:40.522087+0000","last_peered":"2024-09-17T05:42:40.522087+0000","last_clean":"2024-09-17T05:42:40.522087+0000","last_became_active":"2024-09-17T05:42:38.809255+0000","last_became_peered":"2024-09-17T05:42:38.809255+0000","last_unstale":"2024-09-17T05:42:40.522087+0000","last_undegraded":"2024-09-17T05:42:40.522087+0000","last_fullsized":"2024-09-17T05:42:40.522087+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:42:37.772628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:42:37.772628+0000","last_clean_scrub_stamp":"2024-09-17T05:42:37.772628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:04:29.017402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"33'1","reported_seq":16,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-17T05:42:40.797976+0000","last_change":"2024-09-17T05:42:37.804246+0000","last_active":"2024-09-17T05:42:40.797976+0000","last_peered":"2024-09-17T05:42:40.797976+0000","last_clean":"2024-09-17T05:42:40.797976+0000","last_became_active":"2024-09-17T05:42:37.803529+0000","last_became_peered":"2024-09-17T05:42:37.803529+0000","last_unstale":"2024-09-17T05:42:40.797976+0000","last_undegraded":"2024-09-17T05:42:40.797976+0000","last_fullsized":"2024-09-17T05:42:40.797976+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:42:36.770435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:42:36.770435+0000","last_clean_scrub_stamp":"2024-09-17T05:42:36.770435+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:58:54.928408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-17T05:42:39.847725+0000","last_change":"2024-09-17T05:42:38.813180+0000","last_active":"2024-09-17T05:42:39.847725+0000","last_peered":"2024-09-17T05:42:39.847725+0000","last_clean":"2024-09-17T05:42:39.847725+0000","last_became_active":"2024-09-17T05:42:38.812734+0000","last_became_peered":"2024-09-17T05:42:38.812734+0000","last_unstale":"2024-09-17T05:42:39.847725+0000","last_undegraded":"2024-09-17T05:42:39.847725+0000","last_fullsized":"2024-09-17T05:42:39.847725+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:42:37.772628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:42:37.772628+0000","last_clean_scrub_stamp":"2024-09-17T05:42:37.772628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:57:09.386461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.e","version":"33'2","reported_seq":17,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-17T05:42:40.522075+0000","last_change":"2024-09-17T05:42:37.798247+0000","last_active":"2024-09-17T05:42:40.522075+0000","last_peered":"2024-09-17T05:42:40.522075+0000","last_clean":"2024-09-17T05:42:40.522075+0000","last_became_active":"2024-09-17T05:42:37.797389+0000","last_became_peered":"2024-09-17T05:42:37.797389+0000","last_unstale":"2024-09-17T05:42:40.522075+0000","last_undegraded":"2024-09-17T05:42:40.522075+0000","last_fullsized":"2024-09-17T05:42:40.522075+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:42:36.770435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:42:36.770435+0000","last_clean_scrub_stamp":"2024-09-17T05:42:36.770435+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:07:47.702071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-17T05:42:40.797619+0000","last_change":"2024-09-17T05:42:38.816785+0000","last_active":"2024-09-17T05:42:40.797619+0000","last_peered":"2024-09-17T05:42:40.797619+0000","last_clean":"2024-09-17T05:42:40.797619+0000","last_became_active":"2024-09-17T05:42:38.816471+0000","last_became_peered":"2024-09-17T05:42:38.816471+0000","last_unstale":"2024-09-17T05:42:40.797619+0000","last_undegraded":"2024-09-17T05:42:40.797619+0000","last_fullsized":"2024-09-17T05:42:40.797619+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:42:37.772628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:42:37.772628+0000","last_clean_scrub_stamp":"2024-09-17T05:42:37.772628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:42:20.311948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"33'1","reported_seq":16,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-17T05:42:40.522128+0000","last_change":"2024-09-17T05:42:37.801222+0000","last_active":"2024-09-17T05:42:40.522128+0000","last_peered":"2024-09-17T05:42:40.522128+0000","last_clean":"2024-09-17T05:42:40.522128+0000","last_became_active":"2024-09-17T05:42:37.800681+0000","last_became_peered":"2024-09-17T05:42:37.800681+0000","last_unstale":"2024-09-17T05:42:40.522128+0000","last_undegraded":"2024-09-17T05:42:40.522128+0000","last_fullsized":"2024-09-17T05:42:40.522128+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:42:36.770435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:42:36.770435+0000","last_clean_scrub_stamp":"2024-09-17T05:42:36.770435+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:32:51.037165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-17T05:42:40.837065+0000","last_change":"2024-09-17T05:42:38.804832+0000","last_active":"2024-09-17T05:42:40.837065+0000","last_peered":"2024-09-17T05:42:40.837065+0000","last_clean":"2024-09-17T05:42:40.837065+0000","last_became_active":"2024-09-17T05:42:38.804508+0000","last_became_peered":"2024-09-17T05:42:38.804508+0000","last_unstale":"2024-09-17T05:42:40.837065+0000","last_undegraded":"2024-09-17T05:42:40.837065+0000","last_fullsized":"2024-09-17T05:42:40.837065+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:42:37.772628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:42:37.772628+0000","last_clean_scrub_stamp":"2024-09-17T05:42:37.772628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:44:02.490887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":15,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-17T05:42:40.521963+0000","last_change":"2024-09-17T05:42:37.789708+0000","last_active":"2024-09-17T05:42:40.521963+0000","last_peered":"2024-09-17T05:42:40.521963+0000","last_clean":"2024-09-17T05:42:40.521963+0000","last_became_active":"2024-09-17T05:42:37.789299+0000","last_became_peered":"2024-09-17T05:42:37.789299+0000","last_unstale":"2024-09-17T05:42:40.521963+0000","last_undegraded":"2024-09-17T05:42:40.521963+0000","last_fullsized":"2024-09-17T05:42:40.521963+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:42:36.770435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:42:36.770435+0000","last_clean_scrub_stamp":"2024-09-17T05:42:36.770435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:09:15.481334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-17T05:42:40.837166+0000","last_change":"2024-09-17T05:42:38.802196+0000","last_active":"2024-09-17T05:42:40.837166+0000","last_peered":"2024-09-17T05:42:40.837166+0000","last_clean":"2024-09-17T05:42:40.837166+0000","last_became_active":"2024-09-17T05:42:38.801836+0000","last_became_peered":"2024-09-17T05:42:38.801836+0000","last_unstale":"2024-09-17T05:42:40.837166+0000","last_undegraded":"2024-09-17T05:42:40.837166+0000","last_fullsized":"2024-09-17T05:42:40.837166+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:42:37.772628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:42:37.772628+0000","last_clean_scrub_stamp":"2024-09-17T05:42:37.772628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:05:25.770777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"33'2","reported_seq":17,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-17T05:42:40.792879+0000","last_change":"2024-09-17T05:42:37.806715+0000","last_active":"2024-09-17T05:42:40.792879+0000","last_peered":"2024-09-17T05:42:40.792879+0000","last_clean":"2024-09-17T05:42:40.792879+0000","last_became_active":"2024-09-17T05:42:37.806401+0000","last_became_peered":"2024-09-17T05:42:37.806401+0000","last_unstale":"2024-09-17T05:42:40.792879+0000","last_undegraded":"2024-09-17T05:42:40.792879+0000","last_fullsized":"2024-09-17T05:42:40.792879+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:42:36.770435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:42:36.770435+0000","last_clean_scrub_stamp":"2024-09-17T05:42:36.770435+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:21:24.259286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-17T05:42:40.837288+0000","last_change":"2024-09-17T05:42:38.797810+0000","last_active":"2024-09-17T05:42:40.837288+0000","last_peered":"2024-09-17T05:42:40.837288+0000","last_clean":"2024-09-17T05:42:40.837288+0000","last_became_active":"2024-09-17T05:42:38.796315+0000","last_became_peered":"2024-09-17T05:42:38.796315+0000","last_unstale":"2024-09-17T05:42:40.837288+0000","last_undegraded":"2024-09-17T05:42:40.837288+0000","last_fullsized":"2024-09-17T05:42:40.837288+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:42:37.772628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:42:37.772628+0000","last_clean_scrub_stamp":"2024-09-17T05:42:37.772628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:09:16.483527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":15,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-17T05:42:39.788131+0000","last_change":"2024-09-17T05:42:37.805124+0000","last_active":"2024-09-17T05:42:39.788131+0000","last_peered":"2024-09-17T05:42:39.788131+0000","last_clean":"2024-09-17T05:42:39.788131+0000","last_became_active":"2024-09-17T05:42:37.804866+0000","last_became_peered":"2024-09-17T05:42:37.804866+0000","last_unstale":"2024-09-17T05:42:39.788131+0000","last_undegraded":"2024-09-17T05:42:39.788131+0000","last_fullsized":"2024-09-17T05:42:39.788131+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:42:36.770435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:42:36.770435+0000","last_clean_scrub_stamp":"2024-09-17T05:42:36.770435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:46:38.031582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-17T05:42:40.837022+0000","last_change":"2024-09-17T05:42:38.797274+0000","last_active":"2024-09-17T05:42:40.837022+0000","last_peered":"2024-09-17T05:42:40.837022+0000","last_clean":"2024-09-17T05:42:40.837022+0000","last_became_active":"2024-09-17T05:42:38.796947+0000","last_became_peered":"2024-09-17T05:42:38.796947+0000","last_unstale":"2024-09-17T05:42:40.837022+0000","last_undegraded":"2024-09-17T05:42:40.837022+0000","last_fullsized":"2024-09-17T05:42:40.837022+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:42:37.772628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:42:37.772628+0000","last_clean_scrub_stamp":"2024-09-17T05:42:37.772628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:32:52.039358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":15,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-17T05:42:40.521606+0000","last_change":"2024-09-17T05:42:37.802039+0000","last_active":"2024-09-17T05:42:40.521606+0000","last_peered":"2024-09-17T05:42:40.521606+0000","last_clean":"2024-09-17T05:42:40.521606+0000","last_became_active":"2024-09-17T05:42:37.801719+0000","last_became_peered":"2024-09-17T05:42:37.801719+0000","last_unstale":"2024-09-17T05:42:40.521606+0000","last_undegraded":"2024-09-17T05:42:40.521606+0000","last_fullsized":"2024-09-17T05:42:40.521606+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:42:36.770435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:42:36.770435+0000","last_clean_scrub_stamp":"2024-09-17T05:42:36.770435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:39:18.681871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-17T05:42:39.788928+0000","last_change":"2024-09-17T05:42:38.800459+0000","last_active":"2024-09-17T05:42:39.788928+0000","last_peered":"2024-09-17T05:42:39.788928+0000","last_clean":"2024-09-17T05:42:39.788928+0000","last_became_active":"2024-09-17T05:42:38.800074+0000","last_became_peered":"2024-09-17T05:42:38.800074+0000","last_unstale":"2024-09-17T05:42:39.788928+0000","last_undegraded":"2024-09-17T05:42:39.788928+0000","last_fullsized":"2024-09-17T05:42:39.788928+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:42:37.772628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:42:37.772628+0000","last_clean_scrub_stamp":"2024-09-17T05:42:37.772628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:05:21.436685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":15,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-17T05:42:39.846965+0000","last_change":"2024-09-17T05:42:37.802800+0000","last_active":"2024-09-17T05:42:39.846965+0000","last_peered":"2024-09-17T05:42:39.846965+0000","last_clean":"2024-09-17T05:42:39.846965+0000","last_became_active":"2024-09-17T05:42:37.802451+0000","last_became_peered":"2024-09-17T05:42:37.802451+0000","last_unstale":"2024-09-17T05:42:39.846965+0000","last_undegraded":"2024-09-17T05:42:39.846965+0000","last_fullsized":"2024-09-17T05:42:39.846965+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:42:36.770435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:42:36.770435+0000","last_clean_scrub_stamp":"2024-09-17T05:42:36.770435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:26:38.326684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-17T05:42:40.837153+0000","last_change":"2024-09-17T05:42:38.811411+0000","last_active":"2024-09-17T05:42:40.837153+0000","last_peered":"2024-09-17T05:42:40.837153+0000","last_clean":"2024-09-17T05:42:40.837153+0000","last_became_active":"2024-09-17T05:42:38.810958+0000","last_became_peered":"2024-09-17T05:42:38.810958+0000","last_unstale":"2024-09-17T05:42:40.837153+0000","last_undegraded":"2024-09-17T05:42:40.837153+0000","last_fullsized":"2024-09-17T05:42:40.837153+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:42:37.772628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:42:37.772628+0000","last_clean_scrub_stamp":"2024-09-17T05:42:37.772628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:22:34.668025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"33'2","reported_seq":17,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-17T05:42:40.798059+0000","last_change":"2024-09-17T05:42:37.802205+0000","last_active":"2024-09-17T05:42:40.798059+0000","last_peered":"2024-09-17T05:42:40.798059+0000","last_clean":"2024-09-17T05:42:40.798059+0000","last_became_active":"2024-09-17T05:42:37.801813+0000","last_became_peered":"2024-09-17T05:42:37.801813+0000","last_unstale":"2024-09-17T05:42:40.798059+0000","last_undegraded":"2024-09-17T05:42:40.798059+0000","last_fullsized":"2024-09-17T05:42:40.798059+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:42:36.770435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:42:36.770435+0000","last_clean_scrub_stamp":"2024-09-17T05:42:36.770435+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:43:26.611720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-17T05:42:39.847774+0000","last_change":"2024-09-17T05:42:38.804765+0000","last_active":"2024-09-17T05:42:39.847774+0000","last_peered":"2024-09-17T05:42:39.847774+0000","last_clean":"2024-09-17T05:42:39.847774+0000","last_became_active":"2024-09-17T05:42:38.804428+0000","last_became_peered":"2024-09-17T05:42:38.804428+0000","last_unstale":"2024-09-17T05:42:39.847774+0000","last_undegraded":"2024-09-17T05:42:39.847774+0000","last_fullsized":"2024-09-17T05:42:39.847774+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:42:37.772628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:42:37.772628+0000","last_clean_scrub_stamp":"2024-09-17T05:42:37.772628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:00:24.792295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.6","version":"34'1","reported_seq":16,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-17T05:42:40.793067+0000","last_change":"2024-09-17T05:42:37.805790+0000","last_active":"2024-09-17T05:42:40.793067+0000","last_peered":"2024-09-17T05:42:40.793067+0000","last_clean":"2024-09-17T05:42:40.793067+0000","last_became_active":"2024-09-17T05:42:37.805423+0000","last_became_peered":"2024-09-17T05:42:37.805423+0000","last_unstale":"2024-09-17T05:42:40.793067+0000","last_undegraded":"2024-09-17T05:42:40.793067+0000","last_fullsized":"2024-09-17T05:42:40.793067+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:42:36.770435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:42:36.770435+0000","last_clean_scrub_stamp":"2024-09-17T05:42:36.770435+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:47:45.041531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-17T05:42:40.792811+0000","last_change":"2024-09-17T05:42:38.810272+0000","last_active":"2024-09-17T05:42:40.792811+0000","last_peered":"2024-09-17T05:42:40.792811+0000","last_clean":"2024-09-17T05:42:40.792811+0000","last_became_active":"2024-09-17T05:42:38.809926+0000","last_became_peered":"2024-09-17T05:42:38.809926+0000","last_unstale":"2024-09-17T05:42:40.792811+0000","last_undegraded":"2024-09-17T05:42:40.792811+0000","last_fullsized":"2024-09-17T05:42:40.792811+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:42:37.772628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:42:37.772628+0000","last_clean_scrub_stamp":"2024-09-17T05:42:37.772628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:09:31.528495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":15,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-17T05:42:40.797791+0000","last_change":"2024-09-17T05:42:37.805601+0000","last_active":"2024-09-17T05:42:40.797791+0000","last_peered":"2024-09-17T05:42:40.797791+0000","last_clean":"2024-09-17T05:42:40.797791+0000","last_became_active":"2024-09-17T05:42:37.805162+0000","last_became_peered":"2024-09-17T05:42:37.805162+0000","last_unstale":"2024-09-17T05:42:40.797791+0000","last_undegraded":"2024-09-17T05:42:40.797791+0000","last_fullsized":"2024-09-17T05:42:40.797791+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:42:36.770435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:42:36.770435+0000","last_clean_scrub_stamp":"2024-09-17T05:42:36.770435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:50:33.639876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-17T05:42:39.788059+0000","last_change":"2024-09-17T05:42:38.799674+0000","last_active":"2024-09-17T05:42:39.788059+0000","last_peered":"2024-09-17T05:42:39.788059+0000","last_clean":"2024-09-17T05:42:39.788059+0000","last_became_active":"2024-09-17T05:42:38.798334+0000","last_became_peered":"2024-09-17T05:42:38.798334+0000","last_unstale":"2024-09-17T05:42:39.788059+0000","last_undegraded":"2024-09-17T05:42:39.788059+0000","last_fullsized":"2024-09-17T05:42:39.788059+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:42:37.772628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:42:37.772628+0000","last_clean_scrub_stamp":"2024-09-17T05:42:37.772628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:11:54.209492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":15,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-17T05:42:40.793105+0000","last_change":"2024-09-17T05:42:37.796847+0000","last_active":"2024-09-17T05:42:40.793105+0000","last_peered":"2024-09-17T05:42:40.793105+0000","last_clean":"2024-09-17T05:42:40.793105+0000","last_became_active":"2024-09-17T05:42:37.796077+0000","last_became_peered":"2024-09-17T05:42:37.796077+0000","last_unstale":"2024-09-17T05:42:40.793105+0000","last_undegraded":"2024-09-17T05:42:40.793105+0000","last_fullsized":"2024-09-17T05:42:40.793105+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:42:36.770435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:42:36.770435+0000","last_clean_scrub_stamp":"2024-09-17T05:42:36.770435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:30:53.402225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-17T05:42:40.792889+0000","last_change":"2024-09-17T05:42:38.793362+0000","last_active":"2024-09-17T05:42:40.792889+0000","last_peered":"2024-09-17T05:42:40.792889+0000","last_clean":"2024-09-17T05:42:40.792889+0000","last_became_active":"2024-09-17T05:42:38.793032+0000","last_became_peered":"2024-09-17T05:42:38.793032+0000","last_unstale":"2024-09-17T05:42:40.792889+0000","last_undegraded":"2024-09-17T05:42:40.792889+0000","last_fullsized":"2024-09-17T05:42:40.792889+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:42:37.772628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:42:37.772628+0000","last_clean_scrub_stamp":"2024-09-17T05:42:37.772628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:05:49.877050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":15,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-17T05:42:40.797482+0000","last_change":"2024-09-17T05:42:37.802391+0000","last_active":"2024-09-17T05:42:40.797482+0000","last_peered":"2024-09-17T05:42:40.797482+0000","last_clean":"2024-09-17T05:42:40.797482+0000","last_became_active":"2024-09-17T05:42:37.802063+0000","last_became_peered":"2024-09-17T05:42:37.802063+0000","last_unstale":"2024-09-17T05:42:40.797482+0000","last_undegraded":"2024-09-17T05:42:40.797482+0000","last_fullsized":"2024-09-17T05:42:40.797482+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:42:36.770435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:42:36.770435+0000","last_clean_scrub_stamp":"2024-09-17T05:42:36.770435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:42:23.234276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-17T05:42:39.786278+0000","last_change":"2024-09-17T05:42:38.820142+0000","last_active":"2024-09-17T05:42:39.786278+0000","last_peered":"2024-09-17T05:42:39.786278+0000","last_clean":"2024-09-17T05:42:39.786278+0000","last_became_active":"2024-09-17T05:42:38.819558+0000","last_became_peered":"2024-09-17T05:42:38.819558+0000","last_unstale":"2024-09-17T05:42:39.786278+0000","last_undegraded":"2024-09-17T05:42:39.786278+0000","last_fullsized":"2024-09-17T05:42:39.786278+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:42:37.772628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:42:37.772628+0000","last_clean_scrub_stamp":"2024-09-17T05:42:37.772628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:14:51.758783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":15,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-17T05:42:40.521745+0000","last_change":"2024-09-17T05:42:37.790681+0000","last_active":"2024-09-17T05:42:40.521745+0000","last_peered":"2024-09-17T05:42:40.521745+0000","last_clean":"2024-09-17T05:42:40.521745+0000","last_became_active":"2024-09-17T05:42:37.790365+0000","last_became_peered":"2024-09-17T05:42:37.790365+0000","last_unstale":"2024-09-17T05:42:40.521745+0000","last_undegraded":"2024-09-17T05:42:40.521745+0000","last_fullsized":"2024-09-17T05:42:40.521745+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:42:36.770435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:42:36.770435+0000","last_clean_scrub_stamp":"2024-09-17T05:42:36.770435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:29:07.667338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-17T05:42:40.521796+0000","last_change":"2024-09-17T05:42:38.814045+0000","last_active":"2024-09-17T05:42:40.521796+0000","last_peered":"2024-09-17T05:42:40.521796+0000","last_clean":"2024-09-17T05:42:40.521796+0000","last_became_active":"2024-09-17T05:42:38.812842+0000","last_became_peered":"2024-09-17T05:42:38.812842+0000","last_unstale":"2024-09-17T05:42:40.521796+0000","last_undegraded":"2024-09-17T05:42:40.521796+0000","last_fullsized":"2024-09-17T05:42:40.521796+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:42:37.772628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:42:37.772628+0000","last_clean_scrub_stamp":"2024-09-17T05:42:37.772628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:58:52.289602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":15,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-17T05:42:39.786349+0000","last_change":"2024-09-17T05:42:37.804210+0000","last_active":"2024-09-17T05:42:39.786349+0000","last_peered":"2024-09-17T05:42:39.786349+0000","last_clean":"2024-09-17T05:42:39.786349+0000","last_became_active":"2024-09-17T05:42:37.803737+0000","last_became_peered":"2024-09-17T05:42:37.803737+0000","last_unstale":"2024-09-17T05:42:39.786349+0000","last_undegraded":"2024-09-17T05:42:39.786349+0000","last_fullsized":"2024-09-17T05:42:39.786349+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:42:36.770435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:42:36.770435+0000","last_clean_scrub_stamp":"2024-09-17T05:42:36.770435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:37:49.304309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-17T05:42:39.789268+0000","last_change":"2024-09-17T05:42:38.807775+0000","last_active":"2024-09-17T05:42:39.789268+0000","last_peered":"2024-09-17T05:42:39.789268+0000","last_clean":"2024-09-17T05:42:39.789268+0000","last_became_active":"2024-09-17T05:42:38.807458+0000","last_became_peered":"2024-09-17T05:42:38.807458+0000","last_unstale":"2024-09-17T05:42:39.789268+0000","last_undegraded":"2024-09-17T05:42:39.789268+0000","last_fullsized":"2024-09-17T05:42:39.789268+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:42:37.772628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:42:37.772628+0000","last_clean_scrub_stamp":"2024-09-17T05:42:37.772628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:50:12.834179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":15,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-17T05:42:39.788075+0000","last_change":"2024-09-17T05:42:37.799537+0000","last_active":"2024-09-17T05:42:39.788075+0000","last_peered":"2024-09-17T05:42:39.788075+0000","last_clean":"2024-09-17T05:42:39.788075+0000","last_became_active":"2024-09-17T05:42:37.799147+0000","last_became_peered":"2024-09-17T05:42:37.799147+0000","last_unstale":"2024-09-17T05:42:39.788075+0000","last_undegraded":"2024-09-17T05:42:39.788075+0000","last_fullsized":"2024-09-17T05:42:39.788075+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:42:36.770435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:42:36.770435+0000","last_clean_scrub_stamp":"2024-09-17T05:42:36.770435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:06:15.593910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"19'72","reported_seq":130,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-17T05:42:39.789515+0000","last_change":"2024-09-17T05:41:48.539830+0000","last_active":"2024-09-17T05:42:39.789515+0000","last_peered":"2024-09-17T05:42:39.789515+0000","last_clean":"2024-09-17T05:42:39.789515+0000","last_became_active":"2024-09-17T05:41:48.538743+0000","last_became_peered":"2024-09-17T05:41:48.538743+0000","last_unstale":"2024-09-17T05:42:39.789515+0000","last_undegraded":"2024-09-17T05:42:39.789515+0000","last_fullsized":"2024-09-17T05:42:39.789515+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:47.152539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:47.152539+0000","last_clean_scrub_stamp":"2024-09-17T05:41:47.152539+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:08:02.952016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":16,"seq":68719476752,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27404,"kb_used_data":376,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344436,"statfs":{"total":96636764160,"available":96608702464,"internally_reserved":0,"allocated":385024,"data_stored":145635,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":7,"up_from":15,"seq":64424509457,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27988,"kb_used_data":952,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343852,"statfs":{"total":96636764160,"available":96608104448,"internally_reserved":0,"allocated":974848,"data_stored":735477,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509456,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27408,"kb_used_data":376,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344432,"statfs":{"total":96636764160,"available":96608698368,"internally_reserved":0,"allocated":385024,"data_stored":145691,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509456,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27408,"kb_used_data":376,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344432,"statfs":{"total":96636764160,"available":96608698368,"internally_reserved":0,"allocated":385024,"data_stored":145123,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509456,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27420,"kb_used_data":384,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344420,"statfs":{"total":96636764160,"available":96608686080,"internally_reserved":0,"allocated":393216,"data_stored":146653,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509456,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27404,"kb_used_data":372,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344436,"statfs":{"total":96636764160,"available":96608702464,"internally_reserved":0,"allocated":380928,"data_stored":145089,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509456,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27416,"kb_used_data":384,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344424,"statfs":{"total":96636764160,"available":96608690176,"internally_reserved":0,"allocated":393216,"data_stored":146653,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574863,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27980,"kb_used_data":948,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343860,"statfs":{"total":96636764160,"available":96608112640,"internally_reserved":0,"allocated":970752,"data_stored":735387,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-17T05:42:47.632 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-17T05:42:47.632 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-09-17T05:42:47.789 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:47.788+0000 7f8c1092b640 1 -- 172.21.15.150:0/3225853315 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8c0c0d0fc0 msgr2=0x7f8c0c0cd0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:47.789 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:47.788+0000 7f8c1092b640 1 --2- 172.21.15.150:0/3225853315 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8c0c0d0fc0 0x7f8c0c0cd0e0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f8c04005fd0 tx=0x7f8c0402a780 comp rx=0 tx=0).stop 2024-09-17T05:42:47.789 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:47.788+0000 7f8c1092b640 1 -- 172.21.15.150:0/3225853315 shutdown_connections 2024-09-17T05:42:47.789 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:47.788+0000 7f8c1092b640 1 --2- 172.21.15.150:0/3225853315 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8c0c0d0fc0 0x7f8c0c0cd0e0 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:47.789 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:47.788+0000 7f8c1092b640 1 --2- 172.21.15.150:0/3225853315 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8c0c0b7d70 0x7f8c0c0d0a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:47.789 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:47.788+0000 7f8c1092b640 1 -- 172.21.15.150:0/3225853315 >> 172.21.15.150:0/3225853315 conn(0x7f8c0c0cef20 msgr2=0x7f8c0c0cf330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:42:47.790 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:47.788+0000 7f8c1092b640 1 -- 172.21.15.150:0/3225853315 shutdown_connections 2024-09-17T05:42:47.790 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:47.788+0000 7f8c1092b640 1 -- 172.21.15.150:0/3225853315 wait complete. 2024-09-17T05:42:47.790 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:47.790+0000 7f8c1092b640 1 Processor -- start 2024-09-17T05:42:47.790 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:47.790+0000 7f8c1092b640 1 -- start start 2024-09-17T05:42:47.793 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:47.791+0000 7f8c1092b640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8c0c0b7960 0x7f8c0c151b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:42:47.793 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:47.791+0000 7f8c1092b640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8c0c0b7d70 0x7f8c0c06f640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:42:47.793 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:47.791+0000 7f8c1092b640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8c0c0d0fc0 0x7f8c0c0b6410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:42:47.793 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:47.791+0000 7f8c1092b640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f8c0c0af900 con 0x7f8c0c0b7960 2024-09-17T05:42:47.794 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:47.791+0000 7f8c1092b640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f8c0c0d1480 con 0x7f8c0c0b7d70 2024-09-17T05:42:47.794 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:47.791+0000 7f8c1092b640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f8c0c15fca0 con 0x7f8c0c0d0fc0 2024-09-17T05:42:47.794 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:47.792+0000 7f8c0a59c640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8c0c0b7960 0x7f8c0c151b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:42:47.794 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:47.792+0000 7f8c0a59c640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8c0c0b7960 0x7f8c0c151b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:59818/0 (socket says 172.21.15.150:59818) 2024-09-17T05:42:47.794 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:47.792+0000 7f8c0a59c640 1 -- 172.21.15.150:0/884912998 learned_addr learned my addr 172.21.15.150:0/884912998 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:42:47.794 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:47.792+0000 7f8c0ad9d640 1 --2- 172.21.15.150:0/884912998 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8c0c0d0fc0 0x7f8c0c0b6410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:42:47.794 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:47.792+0000 7f8c09d9b640 1 --2- 172.21.15.150:0/884912998 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8c0c0b7d70 0x7f8c0c06f640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:42:47.794 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:47.792+0000 7f8c0a59c640 1 -- 172.21.15.150:0/884912998 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8c0c0d0fc0 msgr2=0x7f8c0c0b6410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:47.794 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:47.792+0000 7f8c0a59c640 1 --2- 172.21.15.150:0/884912998 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8c0c0d0fc0 0x7f8c0c0b6410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:47.794 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:47.792+0000 7f8c0a59c640 1 -- 172.21.15.150:0/884912998 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8c0c0b7d70 msgr2=0x7f8c0c06f640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:47.794 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:47.792+0000 7f8c0a59c640 1 --2- 172.21.15.150:0/884912998 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8c0c0b7d70 0x7f8c0c06f640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:47.794 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:47.792+0000 7f8c0a59c640 1 -- 172.21.15.150:0/884912998 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8c0c06ed60 con 0x7f8c0c0b7960 2024-09-17T05:42:47.794 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:47.792+0000 7f8c0a59c640 1 --2- 172.21.15.150:0/884912998 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8c0c0b7960 0x7f8c0c151b50 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f8bfc00c3c0 tx=0x7f8bfc00c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:42:47.795 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:47.792+0000 7f8bfaffd640 1 -- 172.21.15.150:0/884912998 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8bfc004020 con 0x7f8c0c0b7960 2024-09-17T05:42:47.795 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:47.792+0000 7f8bfaffd640 1 -- 172.21.15.150:0/884912998 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8bfc0042d0 con 0x7f8c0c0b7960 2024-09-17T05:42:47.795 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:47.792+0000 7f8c1092b640 1 -- 172.21.15.150:0/884912998 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8c0c1f93a0 con 0x7f8c0c0b7960 2024-09-17T05:42:47.795 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:47.792+0000 7f8bfaffd640 1 -- 172.21.15.150:0/884912998 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8bfc0038a0 con 0x7f8c0c0b7960 2024-09-17T05:42:47.795 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:47.792+0000 7f8c1092b640 1 -- 172.21.15.150:0/884912998 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8c0c1f9920 con 0x7f8c0c0b7960 2024-09-17T05:42:47.796 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:47.794+0000 7f8c1092b640 1 -- 172.21.15.150:0/884912998 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8c0c06a610 con 0x7f8c0c0b7960 2024-09-17T05:42:47.796 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:47.794+0000 7f8bfaffd640 1 -- 172.21.15.150:0/884912998 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f8bfc019020 con 0x7f8c0c0b7960 2024-09-17T05:42:47.796 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:47.795+0000 7f8bfaffd640 1 --2- 172.21.15.150:0/884912998 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f8bec078b90 0x7f8bec07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:42:47.796 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:47.795+0000 7f8bfaffd640 1 -- 172.21.15.150:0/884912998 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7f8bfc09a320 con 0x7f8c0c0b7960 2024-09-17T05:42:47.796 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:47.795+0000 7f8c09d9b640 1 --2- 172.21.15.150:0/884912998 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f8bec078b90 0x7f8bec07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:42:47.796 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:47.795+0000 7f8c09d9b640 1 --2- 172.21.15.150:0/884912998 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f8bec078b90 0x7f8bec07b0a0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f8c0c160720 tx=0x7f8c00005f90 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:42:47.799 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:47.799+0000 7f8bfaffd640 1 -- 172.21.15.150:0/884912998 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f8c0c06a610 con 0x7f8c0c0b7960 2024-09-17T05:42:48.042 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:48.042+0000 7f8c1092b640 1 -- 172.21.15.150:0/884912998 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) -- 0x7f8c0c0d0a80 con 0x7f8c0c0b7960 2024-09-17T05:42:48.046 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:48.046+0000 7f8bfaffd640 1 -- 172.21.15.150:0/884912998 <== mon.0 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v11) ==== 190+0+147 (secure 0 0 0) 0x7f8bfc020020 con 0x7f8c0c0b7960 2024-09-17T05:42:48.047 INFO:teuthology.orchestra.run.smithi150.stdout:[client.0] 2024-09-17T05:42:48.047 INFO:teuthology.orchestra.run.smithi150.stdout: key = AQBoFulmfF/1HBAAMezEjZDeoHTJ+uFfDXNWHQ== 2024-09-17T05:42:48.047 INFO:teuthology.orchestra.run.smithi150.stdout: caps mds = "allow" 2024-09-17T05:42:48.047 INFO:teuthology.orchestra.run.smithi150.stdout: caps mon = "allow r" 2024-09-17T05:42:48.047 INFO:teuthology.orchestra.run.smithi150.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2024-09-17T05:42:48.047 INFO:teuthology.orchestra.run.smithi150.stderr:updated caps for client.0 2024-09-17T05:42:48.049 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:48.049+0000 7f8c1092b640 1 -- 172.21.15.150:0/884912998 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f8bec078b90 msgr2=0x7f8bec07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:48.049 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:48.049+0000 7f8c1092b640 1 --2- 172.21.15.150:0/884912998 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f8bec078b90 0x7f8bec07b0a0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f8c0c160720 tx=0x7f8c00005f90 comp rx=0 tx=0).stop 2024-09-17T05:42:48.050 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:48.049+0000 7f8c1092b640 1 -- 172.21.15.150:0/884912998 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8c0c0b7960 msgr2=0x7f8c0c151b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:48.050 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:48.049+0000 7f8c1092b640 1 --2- 172.21.15.150:0/884912998 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8c0c0b7960 0x7f8c0c151b50 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f8bfc00c3c0 tx=0x7f8bfc00c880 comp rx=0 tx=0).stop 2024-09-17T05:42:48.050 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:48.049+0000 7f8c1092b640 1 -- 172.21.15.150:0/884912998 shutdown_connections 2024-09-17T05:42:48.050 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:48.049+0000 7f8c1092b640 1 --2- 172.21.15.150:0/884912998 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8c0c0b7d70 0x7f8c0c06f640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:48.050 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:48.049+0000 7f8c1092b640 1 --2- 172.21.15.150:0/884912998 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f8bec078b90 0x7f8bec07b0a0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:48.050 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:48.049+0000 7f8c1092b640 1 --2- 172.21.15.150:0/884912998 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8c0c0d0fc0 0x7f8c0c0b6410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:48.050 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:48.049+0000 7f8c1092b640 1 --2- 172.21.15.150:0/884912998 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8c0c0b7960 0x7f8c0c151b50 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:48.050 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:48.049+0000 7f8c1092b640 1 -- 172.21.15.150:0/884912998 >> 172.21.15.150:0/884912998 conn(0x7f8c0c0cef20 msgr2=0x7f8c0c15ca00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:42:48.050 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:48.049+0000 7f8c1092b640 1 -- 172.21.15.150:0/884912998 shutdown_connections 2024-09-17T05:42:48.050 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:48.049+0000 7f8c1092b640 1 -- 172.21.15.150:0/884912998 wait complete. 2024-09-17T05:42:48.061 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T05:42:48.174 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:48.173+0000 7f9448ae5640 1 -- 172.21.15.150:0/2469599954 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f942c004800 msgr2=0x7f942c004c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:48.174 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:48.173+0000 7f9448ae5640 1 --2- 172.21.15.150:0/2469599954 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f942c004800 0x7f942c004c10 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f9438009b50 tx=0x7f942c005830 comp rx=0 tx=0).stop 2024-09-17T05:42:48.174 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:48.173+0000 7f9442d9d640 1 -- 172.21.15.150:0/2469599954 reap_dead start 2024-09-17T05:42:48.174 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:48.173+0000 7f9448ae5640 1 -- 172.21.15.150:0/2469599954 shutdown_connections 2024-09-17T05:42:48.174 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:48.173+0000 7f9448ae5640 1 -- 172.21.15.150:0/2469599954 >> 172.21.15.150:0/2469599954 conn(0x7f94440b2e80 msgr2=0x7f94440b3290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:42:48.174 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:48.173+0000 7f9448ae5640 1 -- 172.21.15.150:0/2469599954 shutdown_connections 2024-09-17T05:42:48.174 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:48.173+0000 7f9448ae5640 1 -- 172.21.15.150:0/2469599954 wait complete. 2024-09-17T05:42:48.175 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:48.175+0000 7f9448ae5640 1 Processor -- start 2024-09-17T05:42:48.175 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:48.175+0000 7f9448ae5640 1 -- start start 2024-09-17T05:42:48.178 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:48.176+0000 7f9448ae5640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f942c004800 0x7f944414f0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:42:48.178 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:48.176+0000 7f9448ae5640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f944406cda0 0x7f944406d1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:42:48.178 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:48.176+0000 7f9448ae5640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9444151d30 0x7f9444152140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:42:48.178 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:48.176+0000 7f9448ae5640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f94440b6b30 con 0x7f944406cda0 2024-09-17T05:42:48.178 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:48.176+0000 7f9448ae5640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f94440b69b0 con 0x7f942c004800 2024-09-17T05:42:48.179 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:48.176+0000 7f9448ae5640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f94440b6cb0 con 0x7f9444151d30 2024-09-17T05:42:48.179 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:48.177+0000 7f9441d9b640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f944406cda0 0x7f944406d1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:42:48.179 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:48.177+0000 7f9441d9b640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f944406cda0 0x7f944406d1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:59836/0 (socket says 172.21.15.150:59836) 2024-09-17T05:42:48.179 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:48.177+0000 7f9441d9b640 1 -- 172.21.15.150:0/3486119073 learned_addr learned my addr 172.21.15.150:0/3486119073 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:42:48.179 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:48.177+0000 7f9442d9d640 1 --2- 172.21.15.150:0/3486119073 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9444151d30 0x7f9444152140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:42:48.179 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:48.177+0000 7f944259c640 1 --2- 172.21.15.150:0/3486119073 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f942c004800 0x7f944414f0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:42:48.179 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:48.177+0000 7f9441d9b640 1 -- 172.21.15.150:0/3486119073 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9444151d30 msgr2=0x7f9444152140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:48.179 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:48.177+0000 7f9441d9b640 1 --2- 172.21.15.150:0/3486119073 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9444151d30 0x7f9444152140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:48.179 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:48.177+0000 7f9441d9b640 1 -- 172.21.15.150:0/3486119073 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f942c004800 msgr2=0x7f944414f0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:48.179 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:48.177+0000 7f9441d9b640 1 --2- 172.21.15.150:0/3486119073 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f942c004800 0x7f944414f0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:48.179 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:48.177+0000 7f9441d9b640 1 -- 172.21.15.150:0/3486119073 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f944406d6f0 con 0x7f944406cda0 2024-09-17T05:42:48.179 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:48.177+0000 7f944259c640 1 --2- 172.21.15.150:0/3486119073 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f942c004800 0x7f944414f0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:42:48.179 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:48.177+0000 7f9441d9b640 1 --2- 172.21.15.150:0/3486119073 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f944406cda0 0x7f944406d1b0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f9438009a70 tx=0x7f9438009850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:42:48.180 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:48.177+0000 7f9432ffd640 1 -- 172.21.15.150:0/3486119073 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9438038050 con 0x7f944406cda0 2024-09-17T05:42:48.180 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:48.177+0000 7f9432ffd640 1 -- 172.21.15.150:0/3486119073 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9438039040 con 0x7f944406cda0 2024-09-17T05:42:48.180 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:48.177+0000 7f9432ffd640 1 -- 172.21.15.150:0/3486119073 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9438033e40 con 0x7f944406cda0 2024-09-17T05:42:48.180 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:48.177+0000 7f9448ae5640 1 -- 172.21.15.150:0/3486119073 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f944409c1b0 con 0x7f944406cda0 2024-09-17T05:42:48.180 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:48.177+0000 7f9448ae5640 1 -- 172.21.15.150:0/3486119073 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f944409b910 con 0x7f944406cda0 2024-09-17T05:42:48.181 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:48.179+0000 7f9448ae5640 1 -- 172.21.15.150:0/3486119073 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9444070bc0 con 0x7f944406cda0 2024-09-17T05:42:48.181 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:48.179+0000 7f9432ffd640 1 -- 172.21.15.150:0/3486119073 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f943802b8c0 con 0x7f944406cda0 2024-09-17T05:42:48.181 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:48.180+0000 7f9432ffd640 1 --2- 172.21.15.150:0/3486119073 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f9424078b90 0x7f942407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:42:48.181 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:48.180+0000 7f9432ffd640 1 -- 172.21.15.150:0/3486119073 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7f94380bbf00 con 0x7f944406cda0 2024-09-17T05:42:48.181 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:48.180+0000 7f944259c640 1 --2- 172.21.15.150:0/3486119073 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f9424078b90 0x7f942407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:42:48.181 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:48.181+0000 7f944259c640 1 --2- 172.21.15.150:0/3486119073 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f9424078b90 0x7f942407b0a0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f9434005eb0 tx=0x7f9434005f90 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:42:48.185 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:48.185+0000 7f9432ffd640 1 -- 172.21.15.150:0/3486119073 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f944406d6f0 con 0x7f944406cda0 2024-09-17T05:42:48.394 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:48.394+0000 7f9448ae5640 1 -- 172.21.15.150:0/3486119073 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f94440708e0 con 0x7f944406cda0 2024-09-17T05:42:48.395 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:48.394+0000 7f9432ffd640 1 -- 172.21.15.150:0/3486119073 <== mon.0 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 15 v15) ==== 94+0+5232 (secure 0 0 0) 0x7f9438083d80 con 0x7f944406cda0 2024-09-17T05:42:48.395 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-09-17T05:42:48.395 INFO:teuthology.orchestra.run.smithi150.stdout:{"epoch":15,"btime":"2024-09-17T05:42:41:810497+0000","default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4664,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6835/392464003","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6833","nonce":392464003},{"type":"v1","addr":"172.21.15.150:6835","nonce":392464003}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":4673,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6837/3232718608","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6835","nonce":3232718608},{"type":"v1","addr":"172.21.15.176:6837","nonce":3232718608}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":4867,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6836/2911955319","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6834","nonce":2911955319},{"type":"v1","addr":"172.21.15.176:6836","nonce":2911955319}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10}],"filesystems":[{"mdsmap":{"epoch":15,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T05:42:38.152690+0000","modified":"2024-09-17T05:42:41.171759+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4938},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4938":{"gid":4938,"name":"a","rank":0,"incarnation":11,"state":"up:active","state_seq":3,"addr":"172.21.15.150:6834/2837553407","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6832","nonce":2837553407},{"type":"v1","addr":"172.21.15.150:6834","nonce":2837553407}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4938,"qdb_cluster":[4938]},"id":2}]} 2024-09-17T05:42:48.396 INFO:teuthology.orchestra.run.smithi150.stderr:dumped fsmap epoch 15 2024-09-17T05:42:48.397 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:48.396+0000 7f9448ae5640 1 -- 172.21.15.150:0/3486119073 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f9424078b90 msgr2=0x7f942407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:48.398 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:48.396+0000 7f9448ae5640 1 --2- 172.21.15.150:0/3486119073 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f9424078b90 0x7f942407b0a0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f9434005eb0 tx=0x7f9434005f90 comp rx=0 tx=0).stop 2024-09-17T05:42:48.398 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:48.396+0000 7f9448ae5640 1 -- 172.21.15.150:0/3486119073 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f944406cda0 msgr2=0x7f944406d1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:48.398 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:48.396+0000 7f9448ae5640 1 --2- 172.21.15.150:0/3486119073 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f944406cda0 0x7f944406d1b0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f9438009a70 tx=0x7f9438009850 comp rx=0 tx=0).stop 2024-09-17T05:42:48.398 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:48.397+0000 7f9448ae5640 1 -- 172.21.15.150:0/3486119073 shutdown_connections 2024-09-17T05:42:48.398 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:48.397+0000 7f9448ae5640 1 --2- 172.21.15.150:0/3486119073 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f9424078b90 0x7f942407b0a0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:48.398 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:48.397+0000 7f9448ae5640 1 --2- 172.21.15.150:0/3486119073 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9444151d30 0x7f9444152140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:48.398 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:48.397+0000 7f9448ae5640 1 --2- 172.21.15.150:0/3486119073 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f944406cda0 0x7f944406d1b0 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:48.398 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:48.397+0000 7f9448ae5640 1 --2- 172.21.15.150:0/3486119073 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f942c004800 0x7f944414f0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:48.398 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:48.397+0000 7f9448ae5640 1 -- 172.21.15.150:0/3486119073 >> 172.21.15.150:0/3486119073 conn(0x7f94440b2e80 msgr2=0x7f944415c0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:42:48.398 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:48.397+0000 7f9448ae5640 1 -- 172.21.15.150:0/3486119073 shutdown_connections 2024-09-17T05:42:48.398 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:48.397+0000 7f9448ae5640 1 -- 172.21.15.150:0/3486119073 wait complete. 2024-09-17T05:42:48.811 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 15, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-17T05:42:38.152690+0000', 'modified': '2024-09-17T05:42:41.171759+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4938}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4938': {'gid': 4938, 'name': 'a', 'rank': 0, 'incarnation': 11, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.150:6834/2837553407', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.150:6832', 'nonce': 2837553407}, {'type': 'v1', 'addr': '172.21.15.150:6834', 'nonce': 2837553407}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [5], 'metadata_pool': 4, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 4938, 'qdb_cluster': [4938]} 2024-09-17T05:42:48.811 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-17T05:42:48.811 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2024-09-17T05:42:48.928 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:48.927+0000 7f03748c5640 1 -- 172.21.15.150:0/1633643460 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f03700d15d0 msgr2=0x7f03700cf470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:48.929 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:48.927+0000 7f03748c5640 1 --2- 172.21.15.150:0/1633643460 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f03700d15d0 0x7f03700cf470 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f0368005fd0 tx=0x7f036802a820 comp rx=0 tx=0).stop 2024-09-17T05:42:48.929 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:48.927+0000 7f03748c5640 1 -- 172.21.15.150:0/1633643460 shutdown_connections 2024-09-17T05:42:48.929 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:48.927+0000 7f03748c5640 1 --2- 172.21.15.150:0/1633643460 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f03700d15d0 0x7f03700cf470 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:48.929 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:48.927+0000 7f03748c5640 1 --2- 172.21.15.150:0/1633643460 >> v2:172.21.15.176:3300/0 conn(0x7f03700b3720 0x7f03700d1090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:48.930 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:48.927+0000 7f03748c5640 1 -- 172.21.15.150:0/1633643460 >> 172.21.15.150:0/1633643460 conn(0x7f03700d4680 msgr2=0x7f03700d4a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:42:48.930 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:48.927+0000 7f03748c5640 1 -- 172.21.15.150:0/1633643460 shutdown_connections 2024-09-17T05:42:48.930 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:48.927+0000 7f03748c5640 1 -- 172.21.15.150:0/1633643460 wait complete. 2024-09-17T05:42:48.939 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:48.929+0000 7f03748c5640 1 Processor -- start 2024-09-17T05:42:48.939 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:48.929+0000 7f03748c5640 1 -- start start 2024-09-17T05:42:48.939 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:48.930+0000 7f03748c5640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f03700b3720 0x7f03700cd890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:42:48.939 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:48.930+0000 7f03748c5640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f03700b9780 0x7f03701f69e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:42:48.940 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:48.930+0000 7f03748c5640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f03700d15d0 0x7f03701566b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:42:48.940 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:48.930+0000 7f03748c5640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f03700cfd40 con 0x7f03700b3720 2024-09-17T05:42:48.940 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:48.930+0000 7f03748c5640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f03700cfbc0 con 0x7f03700d15d0 2024-09-17T05:42:48.940 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:48.930+0000 7f03748c5640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f03700cfec0 con 0x7f03700b9780 2024-09-17T05:42:48.940 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:48.930+0000 7f036e59c640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f03700b3720 0x7f03700cd890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:42:48.940 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:48.930+0000 7f036e59c640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f03700b3720 0x7f03700cd890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:59844/0 (socket says 172.21.15.150:59844) 2024-09-17T05:42:48.940 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:48.930+0000 7f036e59c640 1 -- 172.21.15.150:0/835490661 learned_addr learned my addr 172.21.15.150:0/835490661 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:42:48.940 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:48.930+0000 7f036ed9d640 1 --2- 172.21.15.150:0/835490661 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f03700d15d0 0x7f03701566b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:42:48.940 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:48.930+0000 7f0365d9b640 1 --2- 172.21.15.150:0/835490661 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f03700b9780 0x7f03701f69e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:42:48.940 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:48.931+0000 7f036e59c640 1 -- 172.21.15.150:0/835490661 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f03700b9780 msgr2=0x7f03701f69e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:48.941 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:48.931+0000 7f036e59c640 1 --2- 172.21.15.150:0/835490661 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f03700b9780 0x7f03701f69e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:48.941 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:48.931+0000 7f036e59c640 1 -- 172.21.15.150:0/835490661 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f03700d15d0 msgr2=0x7f03701566b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:48.941 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:48.931+0000 7f036e59c640 1 --2- 172.21.15.150:0/835490661 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f03700d15d0 0x7f03701566b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:48.941 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:48.931+0000 7f036e59c640 1 -- 172.21.15.150:0/835490661 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0370156bf0 con 0x7f03700b3720 2024-09-17T05:42:48.941 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:48.931+0000 7f036e59c640 1 --2- 172.21.15.150:0/835490661 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f03700b3720 0x7f03700cd890 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f036000c3c0 tx=0x7f036000c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:42:48.941 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:48.931+0000 7f03677fe640 1 -- 172.21.15.150:0/835490661 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0360004220 con 0x7f03700b3720 2024-09-17T05:42:48.941 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:48.931+0000 7f03677fe640 1 -- 172.21.15.150:0/835490661 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f03600044d0 con 0x7f03700b3720 2024-09-17T05:42:48.941 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:48.931+0000 7f03748c5640 1 -- 172.21.15.150:0/835490661 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0370159190 con 0x7f03700b3720 2024-09-17T05:42:48.941 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:48.931+0000 7f03677fe640 1 -- 172.21.15.150:0/835490661 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0360005290 con 0x7f03700b3720 2024-09-17T05:42:48.941 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:48.931+0000 7f03748c5640 1 -- 172.21.15.150:0/835490661 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f037015ba80 con 0x7f03700b3720 2024-09-17T05:42:48.941 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:48.933+0000 7f03677fe640 1 -- 172.21.15.150:0/835490661 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f03600046d0 con 0x7f03700b3720 2024-09-17T05:42:48.941 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:48.933+0000 7f03677fe640 1 --2- 172.21.15.150:0/835490661 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f0350078b90 0x7f035007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:42:48.941 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:48.933+0000 7f03677fe640 1 -- 172.21.15.150:0/835490661 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7f036009a260 con 0x7f03700b3720 2024-09-17T05:42:48.941 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:48.934+0000 7f0365d9b640 1 --2- 172.21.15.150:0/835490661 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f0350078b90 0x7f035007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:42:48.942 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:48.934+0000 7f037b831740 1 Processor -- start 2024-09-17T05:42:48.942 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:48.934+0000 7f0365d9b640 1 --2- 172.21.15.150:0/835490661 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f0350078b90 0x7f035007b0a0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f03700b8790 tx=0x7f0358005f90 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:42:48.942 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:48.934+0000 7f037b831740 1 -- start start 2024-09-17T05:42:48.942 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:48.936+0000 7f037b831740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x564498fd7270 0x5644993a8fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:42:48.942 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:48.936+0000 7f037b831740 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x564498fae3b0 0x5644993a9500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:42:48.942 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:48.936+0000 7f037b831740 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x564498fb6590 0x5644993c6400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:42:48.942 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:48.936+0000 7f037b831740 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x5644992f1820 con 0x564498fae3b0 2024-09-17T05:42:48.942 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:48.936+0000 7f037b831740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x5644992e0c50 con 0x564498fd7270 2024-09-17T05:42:48.942 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:48.936+0000 7f037b831740 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x5644992e4a60 con 0x564498fb6590 2024-09-17T05:42:48.942 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:48.936+0000 7f0365d9b640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x564498fae3b0 0x5644993a9500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:42:48.942 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:48.936+0000 7f0365d9b640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x564498fae3b0 0x5644993a9500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:59854/0 (socket says 172.21.15.150:59854) 2024-09-17T05:42:48.942 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:48.936+0000 7f0365d9b640 1 -- 172.21.15.150:0/1097988462 learned_addr learned my addr 172.21.15.150:0/1097988462 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:42:48.942 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:48.936+0000 7f036e59c640 1 --2- 172.21.15.150:0/1097988462 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x564498fd7270 0x5644993a8fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:42:48.943 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:48.936+0000 7f036ed9d640 1 --2- 172.21.15.150:0/1097988462 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x564498fb6590 0x5644993c6400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:42:48.943 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:48.936+0000 7f0365d9b640 1 -- 172.21.15.150:0/1097988462 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x564498fb6590 msgr2=0x5644993c6400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:42:48.943 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:48.936+0000 7f0365d9b640 1 --2- 172.21.15.150:0/1097988462 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x564498fb6590 0x5644993c6400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:48.943 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:48.936+0000 7f0365d9b640 1 -- 172.21.15.150:0/1097988462 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x564498fd7270 msgr2=0x5644993a8fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:42:48.943 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:48.936+0000 7f0365d9b640 1 --2- 172.21.15.150:0/1097988462 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x564498fd7270 0x5644993a8fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:48.943 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:48.936+0000 7f0365d9b640 1 -- 172.21.15.150:0/1097988462 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564499042850 con 0x564498fae3b0 2024-09-17T05:42:48.943 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:48.936+0000 7f0365d9b640 1 --2- 172.21.15.150:0/1097988462 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x564498fae3b0 0x5644993a9500 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f0358011df0 tx=0x7f0358014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ea36249d686980f server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:42:48.943 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:48.936+0000 7f034ffff640 1 -- 172.21.15.150:0/1097988462 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0358004230 con 0x564498fae3b0 2024-09-17T05:42:48.943 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:48.936+0000 7f034ffff640 1 -- 172.21.15.150:0/1097988462 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f03580044c0 con 0x564498fae3b0 2024-09-17T05:42:48.943 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:48.936+0000 7f034ffff640 1 -- 172.21.15.150:0/1097988462 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f035800eb30 con 0x564498fae3b0 2024-09-17T05:42:48.943 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:48.937+0000 7f037b831740 1 -- 172.21.15.150:0/1097988462 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x564498fae3b0 msgr2=0x5644993a9500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:48.943 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:48.937+0000 7f037b831740 1 --2- 172.21.15.150:0/1097988462 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x564498fae3b0 0x5644993a9500 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f0358011df0 tx=0x7f0358014000 comp rx=0 tx=0).stop 2024-09-17T05:42:48.944 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:48.937+0000 7f037b831740 1 -- 172.21.15.150:0/1097988462 shutdown_connections 2024-09-17T05:42:48.944 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:48.937+0000 7f037b831740 1 --2- 172.21.15.150:0/1097988462 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x564498fb6590 0x5644993c6400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:48.944 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:48.937+0000 7f037b831740 1 --2- 172.21.15.150:0/1097988462 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x564498fae3b0 0x5644993a9500 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:48.944 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:48.937+0000 7f037b831740 1 --2- 172.21.15.150:0/1097988462 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x564498fd7270 0x5644993a8fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:48.944 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:48.937+0000 7f037b831740 1 -- 172.21.15.150:0/1097988462 >> 172.21.15.150:0/1097988462 conn(0x564498fcb3c0 msgr2=0x56449937f280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:42:48.944 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:48.937+0000 7f037b831740 1 -- 172.21.15.150:0/1097988462 shutdown_connections 2024-09-17T05:42:48.944 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:48.937+0000 7f037b831740 1 -- 172.21.15.150:0/1097988462 wait complete. 2024-09-17T05:42:48.944 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:48.938+0000 7f037b831740 1 -- start start 2024-09-17T05:42:48.944 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:48.938+0000 7f037b831740 1 Processor -- start 2024-09-17T05:42:48.948 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:48.940+0000 7f037b831740 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x564498fae3b0 0x5644993d2c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:42:48.949 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:48.940+0000 7f037b831740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x564498fb6590 0x5644993bd450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:42:48.949 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:48.940+0000 7f037b831740 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x564498fd7270 0x5644993bbb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:42:48.949 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:48.940+0000 7f037b831740 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x564499051620 con 0x564498fd7270 2024-09-17T05:42:48.949 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:48.940+0000 7f037b831740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x5644992865f0 con 0x564498fb6590 2024-09-17T05:42:48.949 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:48.940+0000 7f037b831740 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x5644993a9a40 con 0x564498fae3b0 2024-09-17T05:42:48.949 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:48.940+0000 7f037b831740 10 client.0 _ll_register_callbacks cb 0x56449928a0a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T05:42:48.949 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:48.940+0000 7f036ed9d640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x564498fd7270 0x5644993bbb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:42:48.949 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:48.940+0000 7f036ed9d640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x564498fd7270 0x5644993bbb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:59858/0 (socket says 172.21.15.150:59858) 2024-09-17T05:42:48.949 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:48.940+0000 7f036ed9d640 1 -- 172.21.15.150:0/2709821934 learned_addr learned my addr 172.21.15.150:0/2709821934 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:42:48.949 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:48.940+0000 7f036e59c640 1 --2- 172.21.15.150:0/2709821934 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x564498fae3b0 0x5644993d2c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:42:48.949 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:48.940+0000 7f0365d9b640 1 --2- 172.21.15.150:0/2709821934 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x564498fb6590 0x5644993bd450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:42:48.949 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:48.940+0000 7f036ed9d640 1 -- 172.21.15.150:0/2709821934 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x564498fae3b0 msgr2=0x5644993d2c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:42:48.950 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:48.940+0000 7f036ed9d640 1 --2- 172.21.15.150:0/2709821934 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x564498fae3b0 0x5644993d2c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:48.950 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:48.940+0000 7f036ed9d640 1 -- 172.21.15.150:0/2709821934 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x564498fb6590 msgr2=0x5644993bd450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:42:48.950 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:48.940+0000 7f036ed9d640 1 --2- 172.21.15.150:0/2709821934 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x564498fb6590 0x5644993bd450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:48.950 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:48.940+0000 7f036ed9d640 1 -- 172.21.15.150:0/2709821934 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5644990b96b0 con 0x564498fd7270 2024-09-17T05:42:48.950 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:48.940+0000 7f036ed9d640 1 --2- 172.21.15.150:0/2709821934 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x564498fd7270 0x5644993bbb80 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f0368006010 tx=0x7f0368003f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=12d615247eb41f06 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:42:48.950 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:48.940+0000 7f034d7fa640 10 client.0 ms_handle_connect on v2:172.21.15.150:3300/0 2024-09-17T05:42:48.950 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:48.940+0000 7f034d7fa640 1 -- 172.21.15.150:0/2709821934 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0368037040 con 0x564498fd7270 2024-09-17T05:42:48.950 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:48.941+0000 7f034d7fa640 1 -- 172.21.15.150:0/2709821934 <== mon.0 v2:172.21.15.150:3300/0 2 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7f0368049ac0 con 0x564498fd7270 2024-09-17T05:42:48.950 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:48.941+0000 7f037b831740 1 -- 172.21.15.150:0/2709821934 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5644992f3770 con 0x564498fd7270 2024-09-17T05:42:48.950 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:48.941+0000 7f034d7fa640 1 -- 172.21.15.150:0/2709821934 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_get_version_reply(handle=1 version=15) ==== 24+0+0 (secure 0 0 0) 0x7f0368049cc0 con 0x564498fd7270 2024-09-17T05:42:48.950 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:48.941+0000 7f037b831740 10 client.5124 fetch_fsmap learned FSMap version 15 2024-09-17T05:42:48.950 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:48.941+0000 7f037b831740 1 -- 172.21.15.150:0/2709821934 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,fsmap=15,monmap=2+}) -- 0x5644993bc0c0 con 0x564498fd7270 2024-09-17T05:42:48.951 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:48.941+0000 7f034d7fa640 1 -- 172.21.15.150:0/2709821934 <== mon.0 v2:172.21.15.150:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x5644992f3770 con 0x564498fd7270 2024-09-17T05:42:48.951 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:48.941+0000 7f034d7fa640 1 -- 172.21.15.150:0/2709821934 <== mon.0 v2:172.21.15.150:3300/0 5 ==== fsmap(e 15) ==== 3502+0+0 (secure 0 0 0) 0x7f0368004310 con 0x564498fd7270 2024-09-17T05:42:48.951 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:48.941+0000 7f037b831740 10 client.5124 fetch_fsmap finished waiting for FSMap version 15 2024-09-17T05:42:48.951 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:48.941+0000 7f037b831740 10 client.5124 resolve_mds: resolved name 'a' to daemon mds.a 2024-09-17T05:42:48.951 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:48.941+0000 7f037b831740 20 client.5124 populate_metadata read hostname 'smithi150' 2024-09-17T05:42:48.951 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:48.941+0000 7f037b831740 1 --2- 172.21.15.150:0/2709821934 >> [v2:172.21.15.150:6832/2837553407,v1:172.21.15.150:6834/2837553407] conn(0x564498f95e40 0x5644993d6250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:42:48.951 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:48.941+0000 7f037b831740 4 client.5124 mds_command: new command op to 4938 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-17T05:42:48.951 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:48.941+0000 7f037b831740 1 -- 172.21.15.150:0/2709821934 --> [v2:172.21.15.150:6832/2837553407,v1:172.21.15.150:6834/2837553407] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5644992ef220 con 0x564498f95e40 2024-09-17T05:42:48.951 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:48.941+0000 7f036e59c640 1 --2- 172.21.15.150:0/2709821934 >> [v2:172.21.15.150:6832/2837553407,v1:172.21.15.150:6834/2837553407] conn(0x564498f95e40 0x5644993d6250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:42:48.951 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:48.942+0000 7f034d7fa640 10 client.5124 ms_handle_connect on v2:172.21.15.150:6832/2837553407 2024-09-17T05:42:48.951 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:48.942+0000 7f036e59c640 1 --2- 172.21.15.150:0/2709821934 >> [v2:172.21.15.150:6832/2837553407,v1:172.21.15.150:6834/2837553407] conn(0x564498f95e40 0x5644993d6250 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=698dfc2aab16584d server_cookie=4dff2cce9fb1f5cb in_seq=0 out_seq=0 2024-09-17T05:42:48.951 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:48.942+0000 7f034d7fa640 1 -- 172.21.15.150:0/2709821934 <== mds.0 v2:172.21.15.150:6832/2837553407 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5644992ef220 con 0x564498f95e40 2024-09-17T05:42:48.952 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:48.942+0000 7f034d7fa640 10 client.5124 handle_command_reply: tid=0 2024-09-17T05:42:48.952 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:48.942+0000 7f037b831740 1 client.5124 shutdown 2024-09-17T05:42:48.952 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:48.942+0000 7f037b831740 1 -- 172.21.15.150:0/2709821934 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x564498fd7270 msgr2=0x5644993bbb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:48.952 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:48.942+0000 7f037b831740 1 --2- 172.21.15.150:0/2709821934 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x564498fd7270 0x5644993bbb80 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f0368006010 tx=0x7f0368003f40 comp rx=0 tx=0).stop 2024-09-17T05:42:48.952 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:48.943+0000 7f037b831740 1 -- 172.21.15.150:0/2709821934 shutdown_connections 2024-09-17T05:42:48.952 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:48.943+0000 7f037b831740 1 --2- 172.21.15.150:0/2709821934 >> [v2:172.21.15.150:6832/2837553407,v1:172.21.15.150:6834/2837553407] conn(0x564498f95e40 0x5644993d6250 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:48.952 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:48.943+0000 7f037b831740 1 --2- 172.21.15.150:0/2709821934 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x564498fb6590 0x5644993bd450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:48.952 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:48.943+0000 7f037b831740 1 --2- 172.21.15.150:0/2709821934 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x564498fd7270 0x5644993bbb80 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:48.952 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:48.943+0000 7f034d7fa640 0 client.5124 ms_handle_reset on v2:172.21.15.150:6832/2837553407 2024-09-17T05:42:48.952 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:48.943+0000 7f037b831740 1 --2- 172.21.15.150:0/2709821934 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x564498fae3b0 0x5644993d2c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:48.952 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:48.943+0000 7f037b831740 1 -- 172.21.15.150:0/2709821934 >> 172.21.15.150:0/2709821934 conn(0x564498fcb3c0 msgr2=0x56449937f130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:42:48.952 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:48.943+0000 7f037b831740 1 -- 172.21.15.150:0/2709821934 shutdown_connections 2024-09-17T05:42:48.953 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:48.943+0000 7f037b831740 1 -- 172.21.15.150:0/2709821934 wait complete. 2024-09-17T05:42:48.953 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:48.943+0000 7f037b831740 20 client.5124 trim_cache size 0 max 16384 2024-09-17T05:42:48.962 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:48.961+0000 7f037b831740 1 Processor -- start 2024-09-17T05:42:48.962 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:48.961+0000 7f037b831740 1 -- start start 2024-09-17T05:42:48.965 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:48.962+0000 7f037b831740 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x564498fae3b0 0x56449937f110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:42:48.965 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:48.962+0000 7f037b831740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x564498fb6590 0x56449937f650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:42:48.965 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:48.962+0000 7f037b831740 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x564498fd7270 0x5644993dc210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:42:48.965 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:48.962+0000 7f037b831740 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f03701f9f00 con 0x564498fae3b0 2024-09-17T05:42:48.965 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:48.962+0000 7f037b831740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f037015cba0 con 0x564498fb6590 2024-09-17T05:42:48.965 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:48.962+0000 7f037b831740 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f03701f98b0 con 0x564498fd7270 2024-09-17T05:42:48.965 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:48.963+0000 7f036e59c640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x564498fae3b0 0x56449937f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:42:48.965 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:48.963+0000 7f036e59c640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x564498fae3b0 0x56449937f110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:59860/0 (socket says 172.21.15.150:59860) 2024-09-17T05:42:48.965 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:48.963+0000 7f036e59c640 1 -- 172.21.15.150:0/423784925 learned_addr learned my addr 172.21.15.150:0/423784925 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:42:48.965 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:48.963+0000 7f036e59c640 1 -- 172.21.15.150:0/423784925 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x564498fd7270 msgr2=0x5644993dc210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:42:48.966 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:48.963+0000 7f036e59c640 1 --2- 172.21.15.150:0/423784925 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x564498fd7270 0x5644993dc210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:48.966 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:48.963+0000 7f036e59c640 1 -- 172.21.15.150:0/423784925 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x564498fb6590 msgr2=0x56449937f650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:42:48.966 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:48.963+0000 7f036e59c640 1 --2- 172.21.15.150:0/423784925 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x564498fb6590 0x56449937f650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:48.966 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:48.963+0000 7f036e59c640 1 -- 172.21.15.150:0/423784925 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5644993794e0 con 0x564498fae3b0 2024-09-17T05:42:48.966 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:48.963+0000 7f036e59c640 1 --2- 172.21.15.150:0/423784925 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x564498fae3b0 0x56449937f110 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f036000cd80 tx=0x7f0360014040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=72a70f5421242821 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:42:48.966 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:48.963+0000 7f034f7fe640 1 -- 172.21.15.150:0/423784925 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0360080070 con 0x564498fae3b0 2024-09-17T05:42:48.966 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:48.963+0000 7f034f7fe640 1 -- 172.21.15.150:0/423784925 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0360066a60 con 0x564498fae3b0 2024-09-17T05:42:48.966 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:48.963+0000 7f034f7fe640 1 -- 172.21.15.150:0/423784925 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f036006b9a0 con 0x564498fae3b0 2024-09-17T05:42:48.966 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:48.964+0000 7f037b831740 1 -- 172.21.15.150:0/423784925 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x564498fae3b0 msgr2=0x56449937f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:48.967 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:48.964+0000 7f037b831740 1 --2- 172.21.15.150:0/423784925 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x564498fae3b0 0x56449937f110 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f036000cd80 tx=0x7f0360014040 comp rx=0 tx=0).stop 2024-09-17T05:42:48.967 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:48.964+0000 7f037b831740 1 -- 172.21.15.150:0/423784925 shutdown_connections 2024-09-17T05:42:48.967 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:48.964+0000 7f037b831740 1 --2- 172.21.15.150:0/423784925 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x564498fb6590 0x56449937f650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:48.967 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:48.964+0000 7f037b831740 1 --2- 172.21.15.150:0/423784925 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x564498fd7270 0x5644993dc210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:48.967 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:48.964+0000 7f037b831740 1 --2- 172.21.15.150:0/423784925 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x564498fae3b0 0x56449937f110 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:48.967 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:48.964+0000 7f037b831740 1 -- 172.21.15.150:0/423784925 >> 172.21.15.150:0/423784925 conn(0x564498fcb3c0 msgr2=0x564499380280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:42:48.967 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:48.964+0000 7f037b831740 1 -- 172.21.15.150:0/423784925 shutdown_connections 2024-09-17T05:42:48.967 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:48.964+0000 7f037b831740 1 -- 172.21.15.150:0/423784925 wait complete. 2024-09-17T05:42:48.971 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:48.965+0000 7f037b831740 1 -- start start 2024-09-17T05:42:48.972 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:48.965+0000 7f037b831740 1 Processor -- start 2024-09-17T05:42:48.972 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:48.966+0000 7f037b831740 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x564498fae3b0 0x564499428190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:42:48.972 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:48.966+0000 7f037b831740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x564498fb6590 0x5644993c7290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:42:48.972 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:48.966+0000 7f037b831740 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x564498fd7270 0x5644993c77d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:42:48.972 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:48.966+0000 7f037b831740 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x564499378ff0 con 0x564498fd7270 2024-09-17T05:42:48.972 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:48.966+0000 7f037b831740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x5644993baf50 con 0x564498fb6590 2024-09-17T05:42:48.972 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:48.966+0000 7f037b831740 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x564499395880 con 0x564498fae3b0 2024-09-17T05:42:48.972 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:48.966+0000 7f037b831740 10 client.0 _ll_register_callbacks cb 0x7f0368009a60 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T05:42:48.973 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:48.967+0000 7f036ed9d640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x564498fd7270 0x5644993c77d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:42:48.973 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:48.967+0000 7f036ed9d640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x564498fd7270 0x5644993c77d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:59874/0 (socket says 172.21.15.150:59874) 2024-09-17T05:42:48.973 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:48.967+0000 7f036ed9d640 1 -- 172.21.15.150:0/1040164732 learned_addr learned my addr 172.21.15.150:0/1040164732 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:42:48.973 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:48.967+0000 7f036e59c640 1 --2- 172.21.15.150:0/1040164732 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x564498fae3b0 0x564499428190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:42:48.973 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:48.967+0000 7f0365d9b640 1 --2- 172.21.15.150:0/1040164732 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x564498fb6590 0x5644993c7290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:42:48.973 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:48.967+0000 7f036ed9d640 1 -- 172.21.15.150:0/1040164732 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x564498fae3b0 msgr2=0x564499428190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:42:48.973 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:48.967+0000 7f036ed9d640 1 --2- 172.21.15.150:0/1040164732 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x564498fae3b0 0x564499428190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:48.973 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:48.967+0000 7f036ed9d640 1 -- 172.21.15.150:0/1040164732 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x564498fb6590 msgr2=0x5644993c7290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:42:48.973 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:48.967+0000 7f036ed9d640 1 --2- 172.21.15.150:0/1040164732 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x564498fb6590 0x5644993c7290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:48.973 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:48.967+0000 7f036ed9d640 1 -- 172.21.15.150:0/1040164732 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564499395d00 con 0x564498fd7270 2024-09-17T05:42:48.973 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:48.967+0000 7f036ed9d640 1 --2- 172.21.15.150:0/1040164732 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x564498fd7270 0x5644993c77d0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f0368049ee0 tx=0x7f0368005c80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=13081ab626032fc8 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:42:48.973 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:48.967+0000 7f034d7fa640 10 client.0 ms_handle_connect on v2:172.21.15.150:3300/0 2024-09-17T05:42:48.974 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:48.967+0000 7f034d7fa640 1 -- 172.21.15.150:0/1040164732 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0368037030 con 0x564498fd7270 2024-09-17T05:42:48.974 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:48.967+0000 7f034d7fa640 1 -- 172.21.15.150:0/1040164732 <== mon.0 v2:172.21.15.150:3300/0 2 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7f036802f070 con 0x564498fd7270 2024-09-17T05:42:48.974 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:48.967+0000 7f037b831740 1 -- 172.21.15.150:0/1040164732 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0360066a60 con 0x564498fd7270 2024-09-17T05:42:48.974 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:48.967+0000 7f034d7fa640 1 -- 172.21.15.150:0/1040164732 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_get_version_reply(handle=1 version=15) ==== 24+0+0 (secure 0 0 0) 0x7f0368060050 con 0x564498fd7270 2024-09-17T05:42:48.974 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:48.967+0000 7f037b831740 10 client.5130 fetch_fsmap learned FSMap version 15 2024-09-17T05:42:48.974 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:48.967+0000 7f037b831740 1 -- 172.21.15.150:0/1040164732 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,fsmap=15,monmap=2+}) -- 0x56449937f570 con 0x564498fd7270 2024-09-17T05:42:48.974 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:48.967+0000 7f034d7fa640 1 -- 172.21.15.150:0/1040164732 <== mon.0 v2:172.21.15.150:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0360066a60 con 0x564498fd7270 2024-09-17T05:42:48.974 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:48.968+0000 7f034d7fa640 1 -- 172.21.15.150:0/1040164732 <== mon.0 v2:172.21.15.150:3300/0 5 ==== fsmap(e 15) ==== 3502+0+0 (secure 0 0 0) 0x7f0368063020 con 0x564498fd7270 2024-09-17T05:42:48.974 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:48.968+0000 7f037b831740 10 client.5130 fetch_fsmap finished waiting for FSMap version 15 2024-09-17T05:42:48.974 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:48.968+0000 7f037b831740 10 client.5130 resolve_mds: resolved name 'a' to daemon mds.a 2024-09-17T05:42:48.975 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:48.968+0000 7f037b831740 20 client.5130 populate_metadata read hostname 'smithi150' 2024-09-17T05:42:48.975 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:48.968+0000 7f037b831740 1 --2- 172.21.15.150:0/1040164732 >> [v2:172.21.15.150:6832/2837553407,v1:172.21.15.150:6834/2837553407] conn(0x5644993e5700 0x5644993e5b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:42:48.975 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:48.968+0000 7f037b831740 4 client.5130 mds_command: new command op to 4938 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-17T05:42:48.975 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:48.968+0000 7f037b831740 1 -- 172.21.15.150:0/1040164732 --> [v2:172.21.15.150:6832/2837553407,v1:172.21.15.150:6834/2837553407] -- command(tid 0: {"prefix": "status"}) -- 0x5644993c5580 con 0x5644993e5700 2024-09-17T05:42:48.975 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:48.968+0000 7f036e59c640 1 --2- 172.21.15.150:0/1040164732 >> [v2:172.21.15.150:6832/2837553407,v1:172.21.15.150:6834/2837553407] conn(0x5644993e5700 0x5644993e5b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:42:48.975 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:48.968+0000 7f034d7fa640 10 client.5130 ms_handle_connect on v2:172.21.15.150:6832/2837553407 2024-09-17T05:42:48.975 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:48.968+0000 7f036e59c640 1 --2- 172.21.15.150:0/1040164732 >> [v2:172.21.15.150:6832/2837553407,v1:172.21.15.150:6834/2837553407] conn(0x5644993e5700 0x5644993e5b10 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b553bafe43276f server_cookie=363e07e16bfa38d in_seq=0 out_seq=0 2024-09-17T05:42:48.975 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:48.968+0000 7f034d7fa640 1 -- 172.21.15.150:0/1040164732 <== mds.0 v2:172.21.15.150:6832/2837553407 1 ==== command_reply(tid 0: 0 ) ==== 8+0+319 (crc 0 0 0) 0x5644993c5580 con 0x5644993e5700 2024-09-17T05:42:48.975 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:48.968+0000 7f034d7fa640 10 client.5130 handle_command_reply: tid=0 2024-09-17T05:42:48.975 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:48.968+0000 7f037b831740 1 client.5130 shutdown 2024-09-17T05:42:48.975 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:48.969+0000 7f037b831740 1 -- 172.21.15.150:0/1040164732 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x564498fd7270 msgr2=0x5644993c77d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:48.975 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:48.969+0000 7f037b831740 1 --2- 172.21.15.150:0/1040164732 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x564498fd7270 0x5644993c77d0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f0368049ee0 tx=0x7f0368005c80 comp rx=0 tx=0).stop 2024-09-17T05:42:48.976 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:48.969+0000 7f037b831740 1 -- 172.21.15.150:0/1040164732 shutdown_connections 2024-09-17T05:42:48.976 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:48.969+0000 7f037b831740 1 --2- 172.21.15.150:0/1040164732 >> [v2:172.21.15.150:6832/2837553407,v1:172.21.15.150:6834/2837553407] conn(0x5644993e5700 0x5644993e5b10 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:48.976 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:48.969+0000 7f037b831740 1 --2- 172.21.15.150:0/1040164732 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x564498fb6590 0x5644993c7290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:48.976 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:48.969+0000 7f037b831740 1 --2- 172.21.15.150:0/1040164732 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x564498fd7270 0x5644993c77d0 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:48.976 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:48.969+0000 7f034d7fa640 0 client.5130 ms_handle_reset on v2:172.21.15.150:6832/2837553407 2024-09-17T05:42:48.976 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:48.969+0000 7f037b831740 1 --2- 172.21.15.150:0/1040164732 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x564498fae3b0 0x564499428190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:48.976 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:48.969+0000 7f037b831740 1 -- 172.21.15.150:0/1040164732 >> 172.21.15.150:0/1040164732 conn(0x564498fcb3c0 msgr2=0x5644993e6780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:42:48.976 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:48.969+0000 7f037b831740 1 -- 172.21.15.150:0/1040164732 shutdown_connections 2024-09-17T05:42:48.976 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:48.969+0000 7f037b831740 1 -- 172.21.15.150:0/1040164732 wait complete. 2024-09-17T05:42:48.976 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:48.969+0000 7f037b831740 20 client.5130 trim_cache size 0 max 16384 2024-09-17T05:42:48.976 INFO:teuthology.orchestra.run.smithi150.stdout:{ 2024-09-17T05:42:48.977 INFO:teuthology.orchestra.run.smithi150.stdout: "cluster_fsid": "9f2e05e9-d629-47b3-b26b-1360655b7d20", 2024-09-17T05:42:48.977 INFO:teuthology.orchestra.run.smithi150.stdout: "whoami": 0, 2024-09-17T05:42:48.977 INFO:teuthology.orchestra.run.smithi150.stdout: "id": 4938, 2024-09-17T05:42:48.977 INFO:teuthology.orchestra.run.smithi150.stdout: "want_state": "up:active", 2024-09-17T05:42:48.977 INFO:teuthology.orchestra.run.smithi150.stdout: "state": "up:active", 2024-09-17T05:42:48.977 INFO:teuthology.orchestra.run.smithi150.stdout: "fs_name": "cephfs", 2024-09-17T05:42:48.977 INFO:teuthology.orchestra.run.smithi150.stdout: "rank_uptime": 10.185772896, 2024-09-17T05:42:48.977 INFO:teuthology.orchestra.run.smithi150.stdout: "mdsmap_epoch": 15, 2024-09-17T05:42:48.977 INFO:teuthology.orchestra.run.smithi150.stdout: "osdmap_epoch": 34, 2024-09-17T05:42:48.977 INFO:teuthology.orchestra.run.smithi150.stdout: "osdmap_epoch_barrier": 34, 2024-09-17T05:42:48.978 INFO:teuthology.orchestra.run.smithi150.stdout: "uptime": 17.387177154 2024-09-17T05:42:48.978 INFO:teuthology.orchestra.run.smithi150.stdout:} 2024-09-17T05:42:48.978 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:48.969+0000 7f03748c5640 1 -- 172.21.15.150:0/835490661 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f0350078b90 msgr2=0x7f035007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:48.979 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:48.969+0000 7f03748c5640 1 --2- 172.21.15.150:0/835490661 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f0350078b90 0x7f035007b0a0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f03700b8790 tx=0x7f0358005f90 comp rx=0 tx=0).stop 2024-09-17T05:42:48.979 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:48.969+0000 7f03748c5640 1 -- 172.21.15.150:0/835490661 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f03700b3720 msgr2=0x7f03700cd890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:48.979 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:48.969+0000 7f03748c5640 1 --2- 172.21.15.150:0/835490661 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f03700b3720 0x7f03700cd890 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f036000c3c0 tx=0x7f036000c880 comp rx=0 tx=0).stop 2024-09-17T05:42:48.979 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:48.969+0000 7f03748c5640 1 -- 172.21.15.150:0/835490661 shutdown_connections 2024-09-17T05:42:48.979 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:48.969+0000 7f03748c5640 1 --2- 172.21.15.150:0/835490661 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f03700d15d0 0x7f03701566b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:48.979 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:48.969+0000 7f03748c5640 1 --2- 172.21.15.150:0/835490661 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f0350078b90 0x7f035007b0a0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:48.979 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:48.969+0000 7f03748c5640 1 --2- 172.21.15.150:0/835490661 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f03700b9780 0x7f03701f69e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:48.979 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:48.969+0000 7f03748c5640 1 --2- 172.21.15.150:0/835490661 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f03700b3720 0x7f03700cd890 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:48.979 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:48.969+0000 7f03748c5640 1 -- 172.21.15.150:0/835490661 >> 172.21.15.150:0/835490661 conn(0x7f03700d4680 msgr2=0x7f03700d4a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:42:48.979 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:48.969+0000 7f03748c5640 1 -- 172.21.15.150:0/835490661 shutdown_connections 2024-09-17T05:42:48.979 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:48.969+0000 7f03748c5640 1 -- 172.21.15.150:0/835490661 wait complete. 2024-09-17T05:42:48.981 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-17T05:42:49.094 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:49.094+0000 7fc7f2f0b640 1 -- 172.21.15.150:0/1501873660 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc7ec0d15d0 msgr2=0x7fc7ec162a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:49.095 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:49.094+0000 7fc7f2f0b640 1 --2- 172.21.15.150:0/1501873660 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc7ec0d15d0 0x7fc7ec162a60 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7fc7ec0b7270 tx=0x7fc7e402a980 comp rx=0 tx=0).stop 2024-09-17T05:42:49.095 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:49.094+0000 7fc7f2f0b640 1 -- 172.21.15.150:0/1501873660 shutdown_connections 2024-09-17T05:42:49.095 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:49.094+0000 7fc7f2f0b640 1 --2- 172.21.15.150:0/1501873660 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc7ec0d15d0 0x7fc7ec162a60 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:49.095 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:49.094+0000 7fc7f2f0b640 1 --2- 172.21.15.150:0/1501873660 >> v2:172.21.15.176:3300/0 conn(0x7fc7ec15ee50 0x7fc7ec0d1090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:49.095 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:49.094+0000 7fc7f2f0b640 1 --2- 172.21.15.150:0/1501873660 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc7ec0b9780 0x7fc7ec0b3720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:49.095 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:49.094+0000 7fc7f2f0b640 1 -- 172.21.15.150:0/1501873660 >> 172.21.15.150:0/1501873660 conn(0x7fc7ec0d4680 msgr2=0x7fc7ec0d4a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:42:49.095 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:49.094+0000 7fc7f2f0b640 1 -- 172.21.15.150:0/1501873660 shutdown_connections 2024-09-17T05:42:49.095 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:49.094+0000 7fc7f2f0b640 1 -- 172.21.15.150:0/1501873660 wait complete. 2024-09-17T05:42:49.096 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:49.095+0000 7fc7f2f0b640 1 Processor -- start 2024-09-17T05:42:49.096 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:49.095+0000 7fc7f2f0b640 1 -- start start 2024-09-17T05:42:49.098 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:49.097+0000 7fc7f2f0b640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc7ec0b9780 0x7fc7ec162200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:42:49.099 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:49.097+0000 7fc7f2f0b640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc7ec0d15d0 0x7fc7ec15a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:42:49.099 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:49.097+0000 7fc7f2f0b640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc7ec15ee50 0x7fc7ec1f5ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:42:49.099 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:49.097+0000 7fc7f2f0b640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7fc7ec163330 con 0x7fc7ec0d15d0 2024-09-17T05:42:49.099 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:49.097+0000 7fc7f2f0b640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fc7ec1631b0 con 0x7fc7ec0b9780 2024-09-17T05:42:49.099 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:49.097+0000 7fc7f2f0b640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fc7ec1634b0 con 0x7fc7ec15ee50 2024-09-17T05:42:49.099 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:49.097+0000 7fc7ebfff640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc7ec0d15d0 0x7fc7ec15a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:42:49.099 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:49.097+0000 7fc7ebfff640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc7ec0d15d0 0x7fc7ec15a840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:59888/0 (socket says 172.21.15.150:59888) 2024-09-17T05:42:49.099 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:49.097+0000 7fc7ebfff640 1 -- 172.21.15.150:0/439118675 learned_addr learned my addr 172.21.15.150:0/439118675 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:42:49.099 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:49.097+0000 7fc7f0ca7640 1 --2- 172.21.15.150:0/439118675 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc7ec0b9780 0x7fc7ec162200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:42:49.099 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:49.097+0000 7fc7f14a8640 1 --2- 172.21.15.150:0/439118675 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc7ec15ee50 0x7fc7ec1f5ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:42:49.099 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:49.097+0000 7fc7ebfff640 1 -- 172.21.15.150:0/439118675 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc7ec15ee50 msgr2=0x7fc7ec1f5ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:49.100 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:49.097+0000 7fc7ebfff640 1 --2- 172.21.15.150:0/439118675 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc7ec15ee50 0x7fc7ec1f5ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:49.100 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:49.097+0000 7fc7ebfff640 1 -- 172.21.15.150:0/439118675 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc7ec0b9780 msgr2=0x7fc7ec162200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:49.100 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:49.097+0000 7fc7ebfff640 1 --2- 172.21.15.150:0/439118675 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc7ec0b9780 0x7fc7ec162200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:49.100 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:49.097+0000 7fc7ebfff640 1 -- 172.21.15.150:0/439118675 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc7ec14e750 con 0x7fc7ec0d15d0 2024-09-17T05:42:49.100 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:49.097+0000 7fc7f0ca7640 1 --2- 172.21.15.150:0/439118675 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc7ec0b9780 0x7fc7ec162200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T05:42:49.100 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:49.098+0000 7fc7ebfff640 1 --2- 172.21.15.150:0/439118675 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc7ec0d15d0 0x7fc7ec15a840 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7fc7e000d6a0 tx=0x7fc7e000db60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:42:49.100 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:49.098+0000 7fc7e97fa640 1 -- 172.21.15.150:0/439118675 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7e0017070 con 0x7fc7ec0d15d0 2024-09-17T05:42:49.100 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:49.098+0000 7fc7e97fa640 1 -- 172.21.15.150:0/439118675 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc7e0004310 con 0x7fc7ec0d15d0 2024-09-17T05:42:49.100 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:49.098+0000 7fc7f2f0b640 1 -- 172.21.15.150:0/439118675 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc7ec0b5020 con 0x7fc7ec0d15d0 2024-09-17T05:42:49.100 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:49.098+0000 7fc7e97fa640 1 -- 172.21.15.150:0/439118675 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7e0005280 con 0x7fc7ec0d15d0 2024-09-17T05:42:49.100 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:49.098+0000 7fc7f2f0b640 1 -- 172.21.15.150:0/439118675 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc7ec0b55e0 con 0x7fc7ec0d15d0 2024-09-17T05:42:49.101 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:49.099+0000 7fc7f2f0b640 1 -- 172.21.15.150:0/439118675 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc7ec14e4c0 con 0x7fc7ec0d15d0 2024-09-17T05:42:49.101 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:49.100+0000 7fc7e97fa640 1 -- 172.21.15.150:0/439118675 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fc7e0005420 con 0x7fc7ec0d15d0 2024-09-17T05:42:49.102 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:49.100+0000 7fc7e97fa640 1 --2- 172.21.15.150:0/439118675 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fc7d8078b90 0x7fc7d807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:42:49.102 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:49.100+0000 7fc7e97fa640 1 -- 172.21.15.150:0/439118675 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7fc7e009b0d0 con 0x7fc7ec0d15d0 2024-09-17T05:42:49.102 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:49.100+0000 7fc7f0ca7640 1 --2- 172.21.15.150:0/439118675 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fc7d8078b90 0x7fc7d807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:42:49.102 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:49.101+0000 7fc7f0ca7640 1 --2- 172.21.15.150:0/439118675 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fc7d8078b90 0x7fc7d807b0a0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fc7dc009a00 tx=0x7fc7dc005cc0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:42:49.105 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:49.105+0000 7fc7e97fa640 1 -- 172.21.15.150:0/439118675 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fc7e0020020 con 0x7fc7ec0d15d0 2024-09-17T05:42:49.317 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:49.316+0000 7fc7f2f0b640 1 -- 172.21.15.150:0/439118675 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7fc7ec162a60 con 0x7fc7ec0d15d0 2024-09-17T05:42:49.317 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:49.316+0000 7fc7e97fa640 1 -- 172.21.15.150:0/439118675 <== mon.0 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v15) ==== 53+0+73 (secure 0 0 0) 0x7fc7e0063510 con 0x7fc7ec0d15d0 2024-09-17T05:42:49.317 INFO:teuthology.orchestra.run.smithi150.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-17T05:42:49.319 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:49.319+0000 7fc7f2f0b640 1 -- 172.21.15.150:0/439118675 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fc7d8078b90 msgr2=0x7fc7d807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:49.320 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:49.319+0000 7fc7f2f0b640 1 --2- 172.21.15.150:0/439118675 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fc7d8078b90 0x7fc7d807b0a0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fc7dc009a00 tx=0x7fc7dc005cc0 comp rx=0 tx=0).stop 2024-09-17T05:42:49.320 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:49.319+0000 7fc7f2f0b640 1 -- 172.21.15.150:0/439118675 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc7ec0d15d0 msgr2=0x7fc7ec15a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:49.320 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:49.319+0000 7fc7f2f0b640 1 --2- 172.21.15.150:0/439118675 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc7ec0d15d0 0x7fc7ec15a840 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7fc7e000d6a0 tx=0x7fc7e000db60 comp rx=0 tx=0).stop 2024-09-17T05:42:49.320 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:49.319+0000 7fc7f2f0b640 1 -- 172.21.15.150:0/439118675 shutdown_connections 2024-09-17T05:42:49.320 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:49.319+0000 7fc7f2f0b640 1 --2- 172.21.15.150:0/439118675 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fc7d8078b90 0x7fc7d807b0a0 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:49.320 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:49.319+0000 7fc7f2f0b640 1 --2- 172.21.15.150:0/439118675 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc7ec15ee50 0x7fc7ec1f5ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:49.320 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:49.319+0000 7fc7f2f0b640 1 --2- 172.21.15.150:0/439118675 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc7ec0d15d0 0x7fc7ec15a840 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:49.320 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:49.319+0000 7fc7f2f0b640 1 --2- 172.21.15.150:0/439118675 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc7ec0b9780 0x7fc7ec162200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:49.320 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:49.319+0000 7fc7f2f0b640 1 -- 172.21.15.150:0/439118675 >> 172.21.15.150:0/439118675 conn(0x7fc7ec0d4680 msgr2=0x7fc7ec0b7870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:42:49.320 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:49.319+0000 7fc7f2f0b640 1 -- 172.21.15.150:0/439118675 shutdown_connections 2024-09-17T05:42:49.321 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:49.319+0000 7fc7f2f0b640 1 -- 172.21.15.150:0/439118675 wait complete. 2024-09-17T05:42:49.330 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-09-17T05:42:49.331 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-17T05:42:49.331 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi150.front.sepia.ceph.com 2024-09-17T05:42:49.331 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-17T05:42:49.331 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-17T05:42:49.331 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-09-17T05:42:49.331 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-09-17T05:42:49.331 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-17T05:42:49.331 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-17T05:42:49.331 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:42:49.331 DEBUG:teuthology.orchestra.run.smithi150:> ip addr 2024-09-17T05:42:49.348 INFO:teuthology.orchestra.run.smithi150.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-17T05:42:49.348 INFO:teuthology.orchestra.run.smithi150.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-17T05:42:49.348 INFO:teuthology.orchestra.run.smithi150.stdout: inet 127.0.0.1/8 scope host lo 2024-09-17T05:42:49.348 INFO:teuthology.orchestra.run.smithi150.stdout: valid_lft forever preferred_lft forever 2024-09-17T05:42:49.348 INFO:teuthology.orchestra.run.smithi150.stdout: inet6 ::1/128 scope host 2024-09-17T05:42:49.348 INFO:teuthology.orchestra.run.smithi150.stdout: valid_lft forever preferred_lft forever 2024-09-17T05:42:49.348 INFO:teuthology.orchestra.run.smithi150.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-17T05:42:49.348 INFO:teuthology.orchestra.run.smithi150.stdout: link/ether 0c:c4:7a:d9:da:bc brd ff:ff:ff:ff:ff:ff 2024-09-17T05:42:49.348 INFO:teuthology.orchestra.run.smithi150.stdout: altname enp7s0f0 2024-09-17T05:42:49.349 INFO:teuthology.orchestra.run.smithi150.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-17T05:42:49.349 INFO:teuthology.orchestra.run.smithi150.stdout: link/ether 0c:c4:7a:d9:da:bd brd ff:ff:ff:ff:ff:ff 2024-09-17T05:42:49.349 INFO:teuthology.orchestra.run.smithi150.stdout: altname enp7s0f1 2024-09-17T05:42:49.349 INFO:teuthology.orchestra.run.smithi150.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-17T05:42:49.349 INFO:teuthology.orchestra.run.smithi150.stdout: link/ether 0c:c4:7a:88:6e:34 brd ff:ff:ff:ff:ff:ff 2024-09-17T05:42:49.349 INFO:teuthology.orchestra.run.smithi150.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-17T05:42:49.349 INFO:teuthology.orchestra.run.smithi150.stdout: link/ether 0c:c4:7a:88:6e:35 brd ff:ff:ff:ff:ff:ff 2024-09-17T05:42:49.349 INFO:teuthology.orchestra.run.smithi150.stdout: inet 172.21.15.150/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-09-17T05:42:49.349 INFO:teuthology.orchestra.run.smithi150.stdout: valid_lft 42745sec preferred_lft 42745sec 2024-09-17T05:42:49.349 INFO:teuthology.orchestra.run.smithi150.stdout: inet6 fe80::ec4:7aff:fe88:6e35/64 scope link noprefixroute 2024-09-17T05:42:49.349 INFO:teuthology.orchestra.run.smithi150.stdout: valid_lft forever preferred_lft forever 2024-09-17T05:42:49.349 INFO:teuthology.orchestra.run.smithi150.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-17T05:42:49.349 INFO:teuthology.orchestra.run.smithi150.stdout: link/ether 1a:d2:4c:31:46:82 brd ff:ff:ff:ff:ff:ff 2024-09-17T05:42:49.350 INFO:teuthology.orchestra.run.smithi150.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-17T05:42:49.350 INFO:teuthology.orchestra.run.smithi150.stdout: valid_lft forever preferred_lft forever 2024-09-17T05:42:49.350 INFO:teuthology.orchestra.run.smithi150.stdout: inet6 fe80::70b6:c6ff:fe60:62a2/64 scope link 2024-09-17T05:42:49.350 INFO:teuthology.orchestra.run.smithi150.stdout: valid_lft forever preferred_lft forever 2024-09-17T05:42:49.350 INFO:teuthology.orchestra.run.smithi150.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-17T05:42:49.350 INFO:teuthology.orchestra.run.smithi150.stdout: link/ether 32:e1:8b:37:8c:b3 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-17T05:42:49.350 INFO:teuthology.orchestra.run.smithi150.stdout: inet6 fe80::30e1:8bff:fe37:8cb3/64 scope link 2024-09-17T05:42:49.350 INFO:teuthology.orchestra.run.smithi150.stdout: valid_lft forever preferred_lft forever 2024-09-17T05:42:49.350 INFO:teuthology.orchestra.run.smithi150.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-17T05:42:49.350 INFO:teuthology.orchestra.run.smithi150.stdout: link/ether 1a:d2:4c:31:46:82 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-17T05:42:49.350 INFO:teuthology.orchestra.run.smithi150.stdout: inet6 fe80::18d2:4cff:fe31:4682/64 scope link 2024-09-17T05:42:49.350 INFO:teuthology.orchestra.run.smithi150.stdout: valid_lft forever preferred_lft forever 2024-09-17T05:42:49.351 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:42:49.351 DEBUG:teuthology.orchestra.run.smithi150:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-17T05:42:49.412 INFO:teuthology.orchestra.run.smithi150.stdout:1 2024-09-17T05:42:49.413 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:42:49.413 DEBUG:teuthology.orchestra.run.smithi150:> route 2024-09-17T05:42:49.469 INFO:teuthology.orchestra.run.smithi150.stdout:Kernel IP routing table 2024-09-17T05:42:49.470 INFO:teuthology.orchestra.run.smithi150.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-17T05:42:49.470 INFO:teuthology.orchestra.run.smithi150.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-17T05:42:49.470 INFO:teuthology.orchestra.run.smithi150.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-17T05:42:49.470 INFO:teuthology.orchestra.run.smithi150.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-17T05:42:49.472 DEBUG:teuthology.orchestra.run.smithi150:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-17T05:42:49.473 DEBUG:teuthology.orchestra.run.smithi150:> set -e 2024-09-17T05:42:49.473 DEBUG:teuthology.orchestra.run.smithi150:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-17T05:42:49.473 DEBUG:teuthology.orchestra.run.smithi150:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-17T05:42:49.473 DEBUG:teuthology.orchestra.run.smithi150:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-17T05:42:49.473 DEBUG:teuthology.orchestra.run.smithi150:> ') 2024-09-17T05:42:49.558 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:49 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-17T05:42:49.590 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:49 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T05:42:49.597 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:42:49.597 DEBUG:teuthology.orchestra.run.smithi150:> ip netns list 2024-09-17T05:42:49.612 INFO:teuthology.orchestra.run.smithi150.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-09-17T05:42:49.612 INFO:teuthology.orchestra.run.smithi150.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-17T05:42:49.612 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-17T05:42:49.612 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:42:49.613 DEBUG:teuthology.orchestra.run.smithi150:> sudo ip link set brx.0 up 2024-09-17T05:42:49.678 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-17T05:42:49.678 DEBUG:teuthology.orchestra.run.smithi150:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-17T05:42:49.734 INFO:teuthology.orchestra.run.smithi150.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-17T05:42:49.734 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-17T05:42:49.734 DEBUG:teuthology.orchestra.run.smithi150:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-17T05:42:49.789 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-09-17T05:42:49.789 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:42:49.789 DEBUG:teuthology.orchestra.run.smithi150:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-17T05:42:49.883 INFO:teuthology.orchestra.run.smithi150.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-17T05:42:49.884 INFO:teuthology.orchestra.run.smithi150.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-17T05:42:49.884 INFO:teuthology.orchestra.run.smithi150.stdout:invalid new device string format 2024-09-17T05:42:49.894 INFO:teuthology.orchestra.run.smithi150.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-17T05:42:49.895 INFO:teuthology.orchestra.run.smithi150.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-17T05:42:49.895 INFO:teuthology.orchestra.run.smithi150.stdout:invalid new device string format 2024-09-17T05:42:49.895 INFO:teuthology.orchestra.run.smithi150.stdout:mount.ceph: resolved to: "172.21.15.150:3300,172.21.15.176:3300,172.21.15.176:3301" 2024-09-17T05:42:49.895 INFO:teuthology.orchestra.run.smithi150.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-17T05:42:49.901 INFO:teuthology.orchestra.run.smithi150.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-17T05:42:49.901 INFO:teuthology.orchestra.run.smithi150.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-17T05:42:49.901 INFO:teuthology.orchestra.run.smithi150.stdout:invalid new device string format 2024-09-17T05:42:49.901 INFO:teuthology.orchestra.run.smithi150.stdout:mount.ceph: resolved to: "172.21.15.150:3300,172.21.15.176:3300,172.21.15.176:3301" 2024-09-17T05:42:49.901 INFO:teuthology.orchestra.run.smithi150.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-17T05:42:49.902 INFO:teuthology.orchestra.run.smithi150.stdout:mount.ceph: resolved to: "172.21.15.150:6789,172.21.15.176:6789,172.21.15.176:6790" 2024-09-17T05:42:49.902 INFO:teuthology.orchestra.run.smithi150.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.150:6789,172.21.15.176:6789,172.21.15.176:6790:/ 2024-09-17T05:42:49.902 INFO:teuthology.orchestra.run.smithi150.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=9f2e05e9-d629-47b3-b26b-1360655b7d20" will pass to kernel 2024-09-17T05:42:49.904 INFO:teuthology.orchestra.run.smithi150.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-09-17T05:42:49.904 INFO:teuthology.orchestra.run.smithi150.stdout: You just mounted a file system that supports labels which does not 2024-09-17T05:42:49.904 INFO:teuthology.orchestra.run.smithi150.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-09-17T05:42:49.904 INFO:teuthology.orchestra.run.smithi150.stdout: applications will generate AVC messages and not be allowed access to 2024-09-17T05:42:49.905 INFO:teuthology.orchestra.run.smithi150.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-09-17T05:42:49.905 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-17T05:42:49.905 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:42:49.905 DEBUG:teuthology.orchestra.run.smithi150:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-17T05:42:49.931 DEBUG:teuthology.orchestra.run.smithi150:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-17T05:42:50.022 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:50 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-17T05:42:50.027 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:50 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T05:42:50.033 INFO:teuthology.orchestra.run.smithi150.stdout:client4802 2024-09-17T05:42:50.033 DEBUG:teuthology.orchestra.run.smithi150:> set -ex 2024-09-17T05:42:50.033 DEBUG:teuthology.orchestra.run.smithi150:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T05:42:50.049 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs flag set enable_multiple true --yes-i-really-mean-it 2024-09-17T05:42:50.208 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:50.207+0000 7fde88d4a640 1 -- 172.21.15.150:0/218889734 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fde840b42f0 msgr2=0x7fde8415cfc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:50.262 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:50.207+0000 7fde88d4a640 1 --2- 172.21.15.150:0/218889734 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fde840b42f0 0x7fde8415cfc0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7fde840d1370 tx=0x7fde7402a5f0 comp rx=0 tx=0).stop 2024-09-17T05:42:50.263 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:50.207+0000 7fde88d4a640 1 -- 172.21.15.150:0/218889734 shutdown_connections 2024-09-17T05:42:50.263 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:50.207+0000 7fde88d4a640 1 --2- 172.21.15.150:0/218889734 >> v2:172.21.15.176:3300/0 conn(0x7fde8415ba80 0x7fde8415be90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:50.263 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:50.207+0000 7fde88d4a640 1 --2- 172.21.15.150:0/218889734 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fde840b42f0 0x7fde8415cfc0 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:50.263 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:50.207+0000 7fde88d4a640 1 -- 172.21.15.150:0/218889734 >> 172.21.15.150:0/218889734 conn(0x7fde8409aa50 msgr2=0x7fde840b2ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:42:50.263 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:50.207+0000 7fde88d4a640 1 -- 172.21.15.150:0/218889734 shutdown_connections 2024-09-17T05:42:50.263 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:50.207+0000 7fde88d4a640 1 -- 172.21.15.150:0/218889734 wait complete. 2024-09-17T05:42:50.266 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:50.209+0000 7fde88d4a640 1 Processor -- start 2024-09-17T05:42:50.266 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:50.209+0000 7fde88d4a640 1 -- start start 2024-09-17T05:42:50.266 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:50.211+0000 7fde88d4a640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fde840b42f0 0x7fde841f7c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:42:50.266 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:50.211+0000 7fde88d4a640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fde840b5610 0x7fde8414b0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:42:50.266 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:50.211+0000 7fde88d4a640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fde8415ba80 0x7fde8406cda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:42:50.266 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:50.211+0000 7fde88d4a640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7fde840af950 con 0x7fde840b42f0 2024-09-17T05:42:50.266 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:50.211+0000 7fde88d4a640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fde840af7d0 con 0x7fde8415ba80 2024-09-17T05:42:50.266 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:50.211+0000 7fde88d4a640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fde840afad0 con 0x7fde840b5610 2024-09-17T05:42:50.266 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:50.211+0000 7fde8259c640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fde840b42f0 0x7fde841f7c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:42:50.267 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:50.211+0000 7fde8259c640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fde840b42f0 0x7fde841f7c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:60892/0 (socket says 172.21.15.150:60892) 2024-09-17T05:42:50.267 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:50.211+0000 7fde8259c640 1 -- 172.21.15.150:0/4017289780 learned_addr learned my addr 172.21.15.150:0/4017289780 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:42:50.267 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:50.211+0000 7fde79d9b640 1 --2- 172.21.15.150:0/4017289780 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fde840b5610 0x7fde8414b0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:42:50.267 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:50.211+0000 7fde82d9d640 1 --2- 172.21.15.150:0/4017289780 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fde8415ba80 0x7fde8406cda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:42:50.267 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:50.211+0000 7fde8259c640 1 -- 172.21.15.150:0/4017289780 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fde840b5610 msgr2=0x7fde8414b0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:50.267 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:50.211+0000 7fde8259c640 1 --2- 172.21.15.150:0/4017289780 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fde840b5610 0x7fde8414b0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:50.267 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:50.211+0000 7fde8259c640 1 -- 172.21.15.150:0/4017289780 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fde8415ba80 msgr2=0x7fde8406cda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:50.267 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:50.211+0000 7fde8259c640 1 --2- 172.21.15.150:0/4017289780 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fde8415ba80 0x7fde8406cda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:50.267 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:50.211+0000 7fde8259c640 1 -- 172.21.15.150:0/4017289780 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fde840c6260 con 0x7fde840b42f0 2024-09-17T05:42:50.267 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:50.211+0000 7fde82d9d640 1 --2- 172.21.15.150:0/4017289780 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fde8415ba80 0x7fde8406cda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:42:50.267 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:50.211+0000 7fde8259c640 1 --2- 172.21.15.150:0/4017289780 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fde840b42f0 0x7fde841f7c30 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7fde74034040 tx=0x7fde740039e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:42:50.267 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:50.212+0000 7fde7b7fe640 1 -- 172.21.15.150:0/4017289780 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde7403e030 con 0x7fde840b42f0 2024-09-17T05:42:50.267 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:50.212+0000 7fde7b7fe640 1 -- 172.21.15.150:0/4017289780 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fde740047a0 con 0x7fde840b42f0 2024-09-17T05:42:50.267 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:50.212+0000 7fde7b7fe640 1 -- 172.21.15.150:0/4017289780 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde74035040 con 0x7fde840b42f0 2024-09-17T05:42:50.268 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:50.212+0000 7fde88d4a640 1 -- 172.21.15.150:0/4017289780 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fde841f8170 con 0x7fde840b42f0 2024-09-17T05:42:50.268 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:50.212+0000 7fde88d4a640 1 -- 172.21.15.150:0/4017289780 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fde8414e2d0 con 0x7fde840b42f0 2024-09-17T05:42:50.268 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:50.213+0000 7fde88d4a640 1 -- 172.21.15.150:0/4017289780 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fde840aff80 con 0x7fde840b42f0 2024-09-17T05:42:50.268 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:50.213+0000 7fde7b7fe640 1 -- 172.21.15.150:0/4017289780 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fde74041030 con 0x7fde840b42f0 2024-09-17T05:42:50.268 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:50.214+0000 7fde7b7fe640 1 --2- 172.21.15.150:0/4017289780 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fde64078b90 0x7fde6407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:42:50.268 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:50.214+0000 7fde7b7fe640 1 -- 172.21.15.150:0/4017289780 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7fde740bb520 con 0x7fde840b42f0 2024-09-17T05:42:50.268 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:50.214+0000 7fde79d9b640 1 --2- 172.21.15.150:0/4017289780 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fde64078b90 0x7fde6407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:42:50.268 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:50.215+0000 7fde79d9b640 1 --2- 172.21.15.150:0/4017289780 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fde64078b90 0x7fde6407b0a0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fde8409df50 tx=0x7fde6c00b2e0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:42:50.268 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:50.219+0000 7fde7b7fe640 1 -- 172.21.15.150:0/4017289780 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fde74083310 con 0x7fde840b42f0 2024-09-17T05:42:50.428 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:50.427+0000 7fde88d4a640 1 -- 172.21.15.150:0/4017289780 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "fs flag set", "flag_name": "enable_multiple", "val": "true", "yes_i_really_mean_it": true} v 0) -- 0x7fde840c6430 con 0x7fde840b42f0 2024-09-17T05:42:51.056 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:51.056+0000 7fde7b7fe640 1 -- 172.21.15.150:0/4017289780 <== mon.0 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "fs flag set", "flag_name": "enable_multiple", "val": "true", "yes_i_really_mean_it": true}]=0 v16) ==== 136+0+0 (secure 0 0 0) 0x7fde74087d40 con 0x7fde840b42f0 2024-09-17T05:42:51.059 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:51.058+0000 7fde88d4a640 1 -- 172.21.15.150:0/4017289780 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fde64078b90 msgr2=0x7fde6407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:51.059 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:51.058+0000 7fde88d4a640 1 --2- 172.21.15.150:0/4017289780 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fde64078b90 0x7fde6407b0a0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fde8409df50 tx=0x7fde6c00b2e0 comp rx=0 tx=0).stop 2024-09-17T05:42:51.059 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:51.058+0000 7fde88d4a640 1 -- 172.21.15.150:0/4017289780 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fde840b42f0 msgr2=0x7fde841f7c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:51.059 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:51.058+0000 7fde88d4a640 1 --2- 172.21.15.150:0/4017289780 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fde840b42f0 0x7fde841f7c30 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7fde74034040 tx=0x7fde740039e0 comp rx=0 tx=0).stop 2024-09-17T05:42:51.059 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:51.058+0000 7fde88d4a640 1 -- 172.21.15.150:0/4017289780 shutdown_connections 2024-09-17T05:42:51.059 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:51.058+0000 7fde88d4a640 1 --2- 172.21.15.150:0/4017289780 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fde8415ba80 0x7fde8406cda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:51.059 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:51.058+0000 7fde88d4a640 1 --2- 172.21.15.150:0/4017289780 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fde64078b90 0x7fde6407b0a0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:51.060 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:51.058+0000 7fde88d4a640 1 --2- 172.21.15.150:0/4017289780 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fde840b5610 0x7fde8414b0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:51.060 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:51.058+0000 7fde88d4a640 1 --2- 172.21.15.150:0/4017289780 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fde840b42f0 0x7fde841f7c30 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:51.060 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:51.058+0000 7fde88d4a640 1 -- 172.21.15.150:0/4017289780 >> 172.21.15.150:0/4017289780 conn(0x7fde8409aa50 msgr2=0x7fde840b0f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:42:51.060 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:51.059+0000 7fde88d4a640 1 -- 172.21.15.150:0/4017289780 shutdown_connections 2024-09-17T05:42:51.060 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:51.059+0000 7fde88d4a640 1 -- 172.21.15.150:0/4017289780 wait complete. 2024-09-17T05:42:51.072 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume ls 2024-09-17T05:42:51.188 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:51.187+0000 7fb8a8e0e640 1 -- 172.21.15.150:0/2897063956 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb8a40ce150 msgr2=0x7fb8a40ce560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:51.188 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:51.187+0000 7fb8a8e0e640 1 --2- 172.21.15.150:0/2897063956 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb8a40ce150 0x7fb8a40ce560 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7fb8a40cdab0 tx=0x7fb88c02a4d0 comp rx=0 tx=0).stop 2024-09-17T05:42:51.188 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:51.187+0000 7fb8a8e0e640 1 -- 172.21.15.150:0/2897063956 shutdown_connections 2024-09-17T05:42:51.188 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:51.187+0000 7fb8a8e0e640 1 --2- 172.21.15.150:0/2897063956 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb8a40ce150 0x7fb8a40ce560 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:51.188 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:51.187+0000 7fb8a8e0e640 1 --2- 172.21.15.150:0/2897063956 >> v2:172.21.15.176:3300/0 conn(0x7fb8a40b6530 0x7fb8a40cdc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:51.188 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:51.187+0000 7fb8a8e0e640 1 -- 172.21.15.150:0/2897063956 >> 172.21.15.150:0/2897063956 conn(0x7fb8a40b2ef0 msgr2=0x7fb8a40b3300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:42:51.188 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:51.187+0000 7fb8a8e0e640 1 -- 172.21.15.150:0/2897063956 shutdown_connections 2024-09-17T05:42:51.188 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:51.187+0000 7fb8a8e0e640 1 -- 172.21.15.150:0/2897063956 wait complete. 2024-09-17T05:42:51.189 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:51.189+0000 7fb8a8e0e640 1 Processor -- start 2024-09-17T05:42:51.190 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:51.189+0000 7fb8a8e0e640 1 -- start start 2024-09-17T05:42:51.192 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:51.190+0000 7fb8a8e0e640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb8a40b6530 0x7fb8a40b1190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:42:51.192 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:51.190+0000 7fb8a8e0e640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb8a40cbca0 0x7fb8a40b16d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:42:51.192 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:51.190+0000 7fb8a8e0e640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb8a40ce150 0x7fb8a41d87f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:42:51.192 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:51.191+0000 7fb8a8e0e640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7fb8a40cc940 con 0x7fb8a40ce150 2024-09-17T05:42:51.193 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:51.191+0000 7fb8a8e0e640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fb8a40cc7c0 con 0x7fb8a40cbca0 2024-09-17T05:42:51.193 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:51.191+0000 7fb8a8e0e640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fb8a40ccac0 con 0x7fb8a40b6530 2024-09-17T05:42:51.193 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:51.191+0000 7fb8a2d9d640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb8a40ce150 0x7fb8a41d87f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:42:51.193 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:51.191+0000 7fb8a2d9d640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb8a40ce150 0x7fb8a41d87f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:60914/0 (socket says 172.21.15.150:60914) 2024-09-17T05:42:51.193 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:51.191+0000 7fb8a2d9d640 1 -- 172.21.15.150:0/1248416055 learned_addr learned my addr 172.21.15.150:0/1248416055 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:42:51.193 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:51.191+0000 7fb8a259c640 1 --2- 172.21.15.150:0/1248416055 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb8a40b6530 0x7fb8a40b1190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:42:51.193 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:51.191+0000 7fb899d9b640 1 --2- 172.21.15.150:0/1248416055 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb8a40cbca0 0x7fb8a40b16d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:42:51.193 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:51.191+0000 7fb8a2d9d640 1 -- 172.21.15.150:0/1248416055 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb8a40b6530 msgr2=0x7fb8a40b1190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:51.193 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:51.191+0000 7fb8a2d9d640 1 --2- 172.21.15.150:0/1248416055 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb8a40b6530 0x7fb8a40b1190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:51.193 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:51.191+0000 7fb8a2d9d640 1 -- 172.21.15.150:0/1248416055 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb8a40cbca0 msgr2=0x7fb8a40b16d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:51.193 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:51.191+0000 7fb8a2d9d640 1 --2- 172.21.15.150:0/1248416055 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb8a40cbca0 0x7fb8a40b16d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:51.193 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:51.191+0000 7fb8a2d9d640 1 -- 172.21.15.150:0/1248416055 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb8a40ca050 con 0x7fb8a40ce150 2024-09-17T05:42:51.193 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:51.191+0000 7fb8a2d9d640 1 --2- 172.21.15.150:0/1248416055 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb8a40ce150 0x7fb8a41d87f0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7fb89c00cae0 tx=0x7fb89c00a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:42:51.193 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:51.191+0000 7fb89b7fe640 1 -- 172.21.15.150:0/1248416055 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb89c016020 con 0x7fb8a40ce150 2024-09-17T05:42:51.194 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:51.191+0000 7fb89b7fe640 1 -- 172.21.15.150:0/1248416055 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb89c00ad30 con 0x7fb8a40ce150 2024-09-17T05:42:51.194 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:51.191+0000 7fb89b7fe640 1 -- 172.21.15.150:0/1248416055 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb89c012680 con 0x7fb8a40ce150 2024-09-17T05:42:51.194 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:51.191+0000 7fb8a8e0e640 1 -- 172.21.15.150:0/1248416055 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb8a41f3780 con 0x7fb8a40ce150 2024-09-17T05:42:51.194 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:51.191+0000 7fb8a8e0e640 1 -- 172.21.15.150:0/1248416055 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb8a41f3d40 con 0x7fb8a40ce150 2024-09-17T05:42:51.195 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:51.193+0000 7fb8a8e0e640 1 -- 172.21.15.150:0/1248416055 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb8a40cdc10 con 0x7fb8a40ce150 2024-09-17T05:42:51.195 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:51.193+0000 7fb89b7fe640 1 -- 172.21.15.150:0/1248416055 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fb89c019020 con 0x7fb8a40ce150 2024-09-17T05:42:51.195 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:51.194+0000 7fb89b7fe640 1 --2- 172.21.15.150:0/1248416055 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fb884078b90 0x7fb88407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:42:51.195 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:51.194+0000 7fb89b7fe640 1 -- 172.21.15.150:0/1248416055 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7fb89c09ae80 con 0x7fb8a40ce150 2024-09-17T05:42:51.195 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:51.194+0000 7fb8a259c640 1 --2- 172.21.15.150:0/1248416055 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fb884078b90 0x7fb88407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:42:51.195 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:51.195+0000 7fb8a259c640 1 --2- 172.21.15.150:0/1248416055 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fb884078b90 0x7fb88407b0a0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fb8a40d24c0 tx=0x7fb89400b2e0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:42:51.199 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:51.198+0000 7fb89b7fe640 1 -- 172.21.15.150:0/1248416055 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fb89c020030 con 0x7fb8a40ce150 2024-09-17T05:42:51.396 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:51.395+0000 7fb8a8e0e640 1 -- 172.21.15.150:0/1248416055 --> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] -- mgr_command(tid 0: {"prefix": "fs volume ls", "target": ["mon-mgr", ""]}) -- 0x7fb8a40b2cd0 con 0x7fb884078b90 2024-09-17T05:42:51.397 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:51.397+0000 7fb89b7fe640 1 -- 172.21.15.150:0/1248416055 <== mgr.4108 v2:172.21.15.176:6800/3631216395 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+41 (secure 0 0 0) 0x7fb8a40b2cd0 con 0x7fb884078b90 2024-09-17T05:42:51.398 INFO:teuthology.orchestra.run.smithi150.stdout:[ 2024-09-17T05:42:51.398 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-09-17T05:42:51.398 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "cephfs" 2024-09-17T05:42:51.398 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-09-17T05:42:51.398 INFO:teuthology.orchestra.run.smithi150.stdout:] 2024-09-17T05:42:51.401 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:51.400+0000 7fb8a8e0e640 1 -- 172.21.15.150:0/1248416055 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fb884078b90 msgr2=0x7fb88407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:51.401 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:51.400+0000 7fb8a8e0e640 1 --2- 172.21.15.150:0/1248416055 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fb884078b90 0x7fb88407b0a0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fb8a40d24c0 tx=0x7fb89400b2e0 comp rx=0 tx=0).stop 2024-09-17T05:42:51.401 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:51.400+0000 7fb8a8e0e640 1 -- 172.21.15.150:0/1248416055 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb8a40ce150 msgr2=0x7fb8a41d87f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:51.401 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:51.400+0000 7fb8a8e0e640 1 --2- 172.21.15.150:0/1248416055 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb8a40ce150 0x7fb8a41d87f0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7fb89c00cae0 tx=0x7fb89c00a060 comp rx=0 tx=0).stop 2024-09-17T05:42:51.401 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:51.400+0000 7fb8a8e0e640 1 -- 172.21.15.150:0/1248416055 shutdown_connections 2024-09-17T05:42:51.401 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:51.400+0000 7fb8a8e0e640 1 --2- 172.21.15.150:0/1248416055 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb8a40cbca0 0x7fb8a40b16d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:51.401 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:51.400+0000 7fb8a8e0e640 1 --2- 172.21.15.150:0/1248416055 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fb884078b90 0x7fb88407b0a0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:51.401 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:51.400+0000 7fb8a8e0e640 1 --2- 172.21.15.150:0/1248416055 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb8a40ce150 0x7fb8a41d87f0 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:51.401 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:51.400+0000 7fb8a8e0e640 1 --2- 172.21.15.150:0/1248416055 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb8a40b6530 0x7fb8a40b1190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:51.401 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:51.400+0000 7fb8a8e0e640 1 -- 172.21.15.150:0/1248416055 >> 172.21.15.150:0/1248416055 conn(0x7fb8a40b2ef0 msgr2=0x7fb8a409c8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:42:51.401 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:51.400+0000 7fb8a8e0e640 1 -- 172.21.15.150:0/1248416055 shutdown_connections 2024-09-17T05:42:51.401 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:51.400+0000 7fb8a8e0e640 1 -- 172.21.15.150:0/1248416055 wait complete. 2024-09-17T05:42:51.412 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-09-17T05:42:51.528 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:51.527+0000 7fde34a30640 1 -- 172.21.15.150:0/566648534 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fde300b25e0 msgr2=0x7fde300b1ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:51.528 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:51.527+0000 7fde34a30640 1 --2- 172.21.15.150:0/566648534 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fde300b25e0 0x7fde300b1ec0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7fde300d2470 tx=0x7fde2002a9a0 comp rx=0 tx=0).stop 2024-09-17T05:42:51.528 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:51.527+0000 7fde34a30640 1 -- 172.21.15.150:0/566648534 shutdown_connections 2024-09-17T05:42:51.528 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:51.527+0000 7fde34a30640 1 --2- 172.21.15.150:0/566648534 >> v2:172.21.15.176:3300/0 conn(0x7fde300b0fe0 0x7fde300b13f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:51.528 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:51.527+0000 7fde34a30640 1 --2- 172.21.15.150:0/566648534 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fde300b25e0 0x7fde300b1ec0 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:51.528 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:51.527+0000 7fde34a30640 1 -- 172.21.15.150:0/566648534 >> 172.21.15.150:0/566648534 conn(0x7fde300b2ff0 msgr2=0x7fde300b3400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:42:51.529 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:51.527+0000 7fde34a30640 1 -- 172.21.15.150:0/566648534 shutdown_connections 2024-09-17T05:42:51.529 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:51.527+0000 7fde34a30640 1 -- 172.21.15.150:0/566648534 wait complete. 2024-09-17T05:42:51.530 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:51.529+0000 7fde34a30640 1 Processor -- start 2024-09-17T05:42:51.530 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:51.529+0000 7fde34a30640 1 -- start start 2024-09-17T05:42:51.532 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:51.531+0000 7fde34a30640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fde300b0fe0 0x7fde300ca620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:42:51.533 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:51.531+0000 7fde34a30640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fde300b25e0 0x7fde300cab60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:42:51.533 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:51.531+0000 7fde34a30640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fde3015fa30 0x7fde3006cda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:42:51.533 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:51.531+0000 7fde34a30640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7fde300ae740 con 0x7fde300b0fe0 2024-09-17T05:42:51.533 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:51.531+0000 7fde34a30640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fde300ae5c0 con 0x7fde3015fa30 2024-09-17T05:42:51.533 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:51.531+0000 7fde34a30640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fde300ae8c0 con 0x7fde300b25e0 2024-09-17T05:42:51.533 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:51.531+0000 7fde2e59c640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fde300b0fe0 0x7fde300ca620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:42:51.533 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:51.531+0000 7fde2e59c640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fde300b0fe0 0x7fde300ca620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:60922/0 (socket says 172.21.15.150:60922) 2024-09-17T05:42:51.533 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:51.531+0000 7fde2e59c640 1 -- 172.21.15.150:0/3585003500 learned_addr learned my addr 172.21.15.150:0/3585003500 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:42:51.533 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:51.531+0000 7fde2ed9d640 1 --2- 172.21.15.150:0/3585003500 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fde3015fa30 0x7fde3006cda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:42:51.533 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:51.531+0000 7fde2dd9b640 1 --2- 172.21.15.150:0/3585003500 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fde300b25e0 0x7fde300cab60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:42:51.533 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:51.531+0000 7fde2e59c640 1 -- 172.21.15.150:0/3585003500 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fde300b25e0 msgr2=0x7fde300cab60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:51.533 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:51.531+0000 7fde2e59c640 1 --2- 172.21.15.150:0/3585003500 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fde300b25e0 0x7fde300cab60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:51.534 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:51.531+0000 7fde2e59c640 1 -- 172.21.15.150:0/3585003500 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fde3015fa30 msgr2=0x7fde3006cda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:51.534 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:51.531+0000 7fde2e59c640 1 --2- 172.21.15.150:0/3585003500 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fde3015fa30 0x7fde3006cda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:51.534 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:51.531+0000 7fde2e59c640 1 -- 172.21.15.150:0/3585003500 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fde301f93c0 con 0x7fde300b0fe0 2024-09-17T05:42:51.534 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:51.531+0000 7fde2e59c640 1 --2- 172.21.15.150:0/3585003500 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fde300b0fe0 0x7fde300ca620 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7fde20009bf0 tx=0x7fde20003f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:42:51.534 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:51.531+0000 7fde1effd640 1 -- 172.21.15.150:0/3585003500 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde20033050 con 0x7fde300b0fe0 2024-09-17T05:42:51.534 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:51.531+0000 7fde1effd640 1 -- 172.21.15.150:0/3585003500 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fde200044d0 con 0x7fde300b0fe0 2024-09-17T05:42:51.534 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:51.531+0000 7fde34a30640 1 -- 172.21.15.150:0/3585003500 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fde301f96a0 con 0x7fde300b0fe0 2024-09-17T05:42:51.534 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:51.531+0000 7fde1effd640 1 -- 172.21.15.150:0/3585003500 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde20038450 con 0x7fde300b0fe0 2024-09-17T05:42:51.534 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:51.531+0000 7fde34a30640 1 -- 172.21.15.150:0/3585003500 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fde301f9c60 con 0x7fde300b0fe0 2024-09-17T05:42:51.535 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:51.533+0000 7fde34a30640 1 -- 172.21.15.150:0/3585003500 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fde300b13f0 con 0x7fde300b0fe0 2024-09-17T05:42:51.535 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:51.533+0000 7fde1effd640 1 -- 172.21.15.150:0/3585003500 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fde20036070 con 0x7fde300b0fe0 2024-09-17T05:42:51.535 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:51.534+0000 7fde1effd640 1 --2- 172.21.15.150:0/3585003500 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fde10078b90 0x7fde1007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:42:51.535 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:51.534+0000 7fde1effd640 1 -- 172.21.15.150:0/3585003500 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7fde200bbed0 con 0x7fde300b0fe0 2024-09-17T05:42:51.535 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:51.534+0000 7fde2dd9b640 1 --2- 172.21.15.150:0/3585003500 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fde10078b90 0x7fde1007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:42:51.536 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:51.534+0000 7fde2dd9b640 1 --2- 172.21.15.150:0/3585003500 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fde10078b90 0x7fde1007b0a0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fde24005fd0 tx=0x7fde24005850 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:42:51.538 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:51.538+0000 7fde1effd640 1 -- 172.21.15.150:0/3585003500 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fde20084430 con 0x7fde300b0fe0 2024-09-17T05:42:51.716 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:51.716+0000 7fde34a30640 1 -- 172.21.15.150:0/3585003500 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) -- 0x7fde30071760 con 0x7fde300b0fe0 2024-09-17T05:42:51.717 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:51.716+0000 7fde1effd640 1 -- 172.21.15.150:0/3585003500 <== mon.0 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v32)=0 v32) ==== 122+0+0 (secure 0 0 0) 0x7fde20083d30 con 0x7fde300b0fe0 2024-09-17T05:42:51.719 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:51.718+0000 7fde34a30640 1 -- 172.21.15.150:0/3585003500 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fde10078b90 msgr2=0x7fde1007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:51.719 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:51.718+0000 7fde34a30640 1 --2- 172.21.15.150:0/3585003500 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fde10078b90 0x7fde1007b0a0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fde24005fd0 tx=0x7fde24005850 comp rx=0 tx=0).stop 2024-09-17T05:42:51.719 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:51.718+0000 7fde34a30640 1 -- 172.21.15.150:0/3585003500 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fde300b0fe0 msgr2=0x7fde300ca620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:51.719 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:51.718+0000 7fde34a30640 1 --2- 172.21.15.150:0/3585003500 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fde300b0fe0 0x7fde300ca620 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7fde20009bf0 tx=0x7fde20003f90 comp rx=0 tx=0).stop 2024-09-17T05:42:51.720 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:51.718+0000 7fde34a30640 1 -- 172.21.15.150:0/3585003500 shutdown_connections 2024-09-17T05:42:51.720 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:51.718+0000 7fde34a30640 1 --2- 172.21.15.150:0/3585003500 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fde3015fa30 0x7fde3006cda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:51.720 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:51.718+0000 7fde34a30640 1 --2- 172.21.15.150:0/3585003500 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fde10078b90 0x7fde1007b0a0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:51.720 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:51.718+0000 7fde34a30640 1 --2- 172.21.15.150:0/3585003500 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fde300b25e0 0x7fde300cab60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:51.720 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:51.718+0000 7fde34a30640 1 --2- 172.21.15.150:0/3585003500 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fde300b0fe0 0x7fde300ca620 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:51.720 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:51.719+0000 7fde34a30640 1 -- 172.21.15.150:0/3585003500 >> 172.21.15.150:0/3585003500 conn(0x7fde300b2ff0 msgr2=0x7fde300701d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:42:51.720 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:51.719+0000 7fde34a30640 1 -- 172.21.15.150:0/3585003500 shutdown_connections 2024-09-17T05:42:51.720 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:51.719+0000 7fde34a30640 1 -- 172.21.15.150:0/3585003500 wait complete. 2024-09-17T05:42:51.731 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config get mgr mgr/volumes/max_concurrent_clones 2024-09-17T05:42:51.846 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:51.845+0000 7f9a2b0f9640 1 -- 172.21.15.150:0/420087479 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9a240b16f0 msgr2=0x7f9a240b1ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:51.846 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:51.845+0000 7f9a2b0f9640 1 --2- 172.21.15.150:0/420087479 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9a240b16f0 0x7f9a240b1ec0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f9a240cb970 tx=0x7f9a1802a4d0 comp rx=0 tx=0).stop 2024-09-17T05:42:51.846 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:51.845+0000 7f9a2b0f9640 1 -- 172.21.15.150:0/420087479 shutdown_connections 2024-09-17T05:42:51.846 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:51.845+0000 7f9a2b0f9640 1 --2- 172.21.15.150:0/420087479 >> v2:172.21.15.176:3300/0 conn(0x7f9a240cf390 0x7f9a240cf7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:51.846 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:51.845+0000 7f9a2b0f9640 1 --2- 172.21.15.150:0/420087479 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9a240b16f0 0x7f9a240b1ec0 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:51.846 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:51.845+0000 7f9a2b0f9640 1 -- 172.21.15.150:0/420087479 >> 172.21.15.150:0/420087479 conn(0x7f9a240b2ff0 msgr2=0x7f9a240b3400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:42:51.846 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:51.845+0000 7f9a2b0f9640 1 -- 172.21.15.150:0/420087479 shutdown_connections 2024-09-17T05:42:51.846 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:51.845+0000 7f9a2b0f9640 1 -- 172.21.15.150:0/420087479 wait complete. 2024-09-17T05:42:51.847 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:51.847+0000 7f9a2b0f9640 1 Processor -- start 2024-09-17T05:42:51.847 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:51.847+0000 7f9a2b0f9640 1 -- start start 2024-09-17T05:42:51.851 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:51.848+0000 7f9a2b0f9640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9a240b16f0 0x7f9a241f3090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:42:51.851 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:51.848+0000 7f9a2b0f9640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9a240b25e0 0x7f9a240caf90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:42:51.851 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:51.848+0000 7f9a2b0f9640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9a240cf390 0x7f9a240713b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:42:51.851 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:51.848+0000 7f9a2b0f9640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f9a240ae740 con 0x7f9a240b16f0 2024-09-17T05:42:51.851 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:51.848+0000 7f9a2b0f9640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f9a240ae5c0 con 0x7f9a240b25e0 2024-09-17T05:42:51.851 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:51.848+0000 7f9a2b0f9640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f9a240ae8c0 con 0x7f9a240cf390 2024-09-17T05:42:51.851 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:51.849+0000 7f9a28e95640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9a240b16f0 0x7f9a241f3090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:42:51.851 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:51.849+0000 7f9a28e95640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9a240b16f0 0x7f9a241f3090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:60946/0 (socket says 172.21.15.150:60946) 2024-09-17T05:42:51.851 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:51.849+0000 7f9a28e95640 1 -- 172.21.15.150:0/3138910770 learned_addr learned my addr 172.21.15.150:0/3138910770 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:42:51.851 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:51.849+0000 7f9a23fff640 1 --2- 172.21.15.150:0/3138910770 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9a240b25e0 0x7f9a240caf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:42:51.851 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:51.849+0000 7f9a29696640 1 --2- 172.21.15.150:0/3138910770 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9a240cf390 0x7f9a240713b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:42:51.852 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:51.849+0000 7f9a28e95640 1 -- 172.21.15.150:0/3138910770 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9a240cf390 msgr2=0x7f9a240713b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:51.852 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:51.849+0000 7f9a28e95640 1 --2- 172.21.15.150:0/3138910770 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9a240cf390 0x7f9a240713b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:51.852 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:51.849+0000 7f9a28e95640 1 -- 172.21.15.150:0/3138910770 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9a240b25e0 msgr2=0x7f9a240caf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:51.852 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:51.849+0000 7f9a28e95640 1 --2- 172.21.15.150:0/3138910770 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9a240b25e0 0x7f9a240caf90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:51.852 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:51.849+0000 7f9a28e95640 1 -- 172.21.15.150:0/3138910770 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9a241f35d0 con 0x7f9a240b16f0 2024-09-17T05:42:51.852 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:51.849+0000 7f9a28e95640 1 --2- 172.21.15.150:0/3138910770 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9a240b16f0 0x7f9a241f3090 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f9a1400c3d0 tx=0x7f9a1400c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:42:51.852 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:51.849+0000 7f9a217fa640 1 -- 172.21.15.150:0/3138910770 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a14017070 con 0x7f9a240b16f0 2024-09-17T05:42:51.852 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:51.849+0000 7f9a217fa640 1 -- 172.21.15.150:0/3138910770 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9a140053c0 con 0x7f9a240b16f0 2024-09-17T05:42:51.852 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:51.849+0000 7f9a2b0f9640 1 -- 172.21.15.150:0/3138910770 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9a240cb4d0 con 0x7f9a240b16f0 2024-09-17T05:42:51.852 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:51.849+0000 7f9a217fa640 1 -- 172.21.15.150:0/3138910770 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a14003850 con 0x7f9a240b16f0 2024-09-17T05:42:51.852 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:51.849+0000 7f9a2b0f9640 1 -- 172.21.15.150:0/3138910770 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9a240b5c70 con 0x7f9a240b16f0 2024-09-17T05:42:51.852 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:51.850+0000 7f9a2b0f9640 1 -- 172.21.15.150:0/3138910770 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9a240b1ec0 con 0x7f9a240b16f0 2024-09-17T05:42:51.853 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:51.851+0000 7f9a217fa640 1 -- 172.21.15.150:0/3138910770 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f9a1401a070 con 0x7f9a240b16f0 2024-09-17T05:42:51.853 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:51.851+0000 7f9a217fa640 1 --2- 172.21.15.150:0/3138910770 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f9a10078b90 0x7f9a1007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:42:51.853 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:51.852+0000 7f9a217fa640 1 -- 172.21.15.150:0/3138910770 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7f9a1409a020 con 0x7f9a240b16f0 2024-09-17T05:42:51.853 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:51.852+0000 7f9a23fff640 1 --2- 172.21.15.150:0/3138910770 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f9a10078b90 0x7f9a1007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:42:51.854 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:51.852+0000 7f9a23fff640 1 --2- 172.21.15.150:0/3138910770 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f9a10078b90 0x7f9a1007b0a0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f9a18033000 tx=0x7f9a18004730 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:42:51.856 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:51.856+0000 7f9a217fa640 1 -- 172.21.15.150:0/3138910770 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f9a241f35d0 con 0x7f9a240b16f0 2024-09-17T05:42:52.034 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:52.033+0000 7f9a2b0f9640 1 -- 172.21.15.150:0/3138910770 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "config get", "who": "mgr", "key": "mgr/volumes/max_concurrent_clones"} v 0) -- 0x7f9a240cd310 con 0x7f9a240b16f0 2024-09-17T05:42:52.034 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:52.034+0000 7f9a217fa640 1 -- 172.21.15.150:0/3138910770 <== mon.0 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "config get", "who": "mgr", "key": "mgr/volumes/max_concurrent_clones"}]=0 v32) ==== 116+0+2 (secure 0 0 0) 0x7f9a14061ea0 con 0x7f9a240b16f0 2024-09-17T05:42:52.034 INFO:teuthology.orchestra.run.smithi150.stdout:4 2024-09-17T05:42:52.037 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:52.036+0000 7f9a2b0f9640 1 -- 172.21.15.150:0/3138910770 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f9a10078b90 msgr2=0x7f9a1007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:52.037 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:52.036+0000 7f9a2b0f9640 1 --2- 172.21.15.150:0/3138910770 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f9a10078b90 0x7f9a1007b0a0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f9a18033000 tx=0x7f9a18004730 comp rx=0 tx=0).stop 2024-09-17T05:42:52.037 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:52.036+0000 7f9a2b0f9640 1 -- 172.21.15.150:0/3138910770 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9a240b16f0 msgr2=0x7f9a241f3090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:52.037 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:52.036+0000 7f9a2b0f9640 1 --2- 172.21.15.150:0/3138910770 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9a240b16f0 0x7f9a241f3090 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f9a1400c3d0 tx=0x7f9a1400c890 comp rx=0 tx=0).stop 2024-09-17T05:42:52.037 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:52.036+0000 7f9a2b0f9640 1 -- 172.21.15.150:0/3138910770 shutdown_connections 2024-09-17T05:42:52.037 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:52.036+0000 7f9a2b0f9640 1 --2- 172.21.15.150:0/3138910770 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9a240b25e0 0x7f9a240caf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:52.037 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:52.036+0000 7f9a2b0f9640 1 --2- 172.21.15.150:0/3138910770 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f9a10078b90 0x7f9a1007b0a0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:52.038 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:52.036+0000 7f9a2b0f9640 1 --2- 172.21.15.150:0/3138910770 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9a240cf390 0x7f9a240713b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:52.038 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:52.036+0000 7f9a2b0f9640 1 --2- 172.21.15.150:0/3138910770 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9a240b16f0 0x7f9a241f3090 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:52.038 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:52.036+0000 7f9a2b0f9640 1 -- 172.21.15.150:0/3138910770 >> 172.21.15.150:0/3138910770 conn(0x7f9a240b2ff0 msgr2=0x7f9a241e4120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:42:52.038 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:52.036+0000 7f9a2b0f9640 1 -- 172.21.15.150:0/3138910770 shutdown_connections 2024-09-17T05:42:52.038 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:52.036+0000 7f9a2b0f9640 1 -- 172.21.15.150:0/3138910770 wait complete. 2024-09-17T05:42:52.050 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mgr mgr/volumes/max_concurrent_clones 4 2024-09-17T05:42:52.165 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:52.165+0000 7fd9e5ff1640 1 -- 172.21.15.150:0/859065489 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd9e00d2370 msgr2=0x7fd9e0162fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:52.166 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:52.165+0000 7fd9e5ff1640 1 --2- 172.21.15.150:0/859065489 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd9e00d2370 0x7fd9e0162fd0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7fd9c8009830 tx=0x7fd9c802a500 comp rx=0 tx=0).stop 2024-09-17T05:42:52.166 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:52.165+0000 7fd9e5ff1640 1 -- 172.21.15.150:0/859065489 shutdown_connections 2024-09-17T05:42:52.166 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:52.165+0000 7fd9e5ff1640 1 --2- 172.21.15.150:0/859065489 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd9e0166be0 0x7fd9e0169000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:52.166 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:52.165+0000 7fd9e5ff1640 1 --2- 172.21.15.150:0/859065489 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd9e00d2370 0x7fd9e0162fd0 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:52.166 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:52.165+0000 7fd9e5ff1640 1 -- 172.21.15.150:0/859065489 >> 172.21.15.150:0/859065489 conn(0x7fd9e00d4680 msgr2=0x7fd9e00d4a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:42:52.166 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:52.165+0000 7fd9e5ff1640 1 -- 172.21.15.150:0/859065489 shutdown_connections 2024-09-17T05:42:52.166 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:52.165+0000 7fd9e5ff1640 1 -- 172.21.15.150:0/859065489 wait complete. 2024-09-17T05:42:52.167 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:52.166+0000 7fd9e5ff1640 1 Processor -- start 2024-09-17T05:42:52.167 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:52.166+0000 7fd9e5ff1640 1 -- start start 2024-09-17T05:42:52.169 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:52.168+0000 7fd9e5ff1640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd9e00b3ae0 0x7fd9e0154a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:42:52.169 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:52.168+0000 7fd9e5ff1640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd9e00d2370 0x7fd9e00b27c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:42:52.169 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:52.168+0000 7fd9e5ff1640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd9e0166be0 0x7fd9e00b2d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:42:52.169 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:52.168+0000 7fd9e5ff1640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7fd9e0163690 con 0x7fd9e00d2370 2024-09-17T05:42:52.170 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:52.168+0000 7fd9e5ff1640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fd9e0163510 con 0x7fd9e00b3ae0 2024-09-17T05:42:52.170 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:52.168+0000 7fd9e5ff1640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fd9e0169540 con 0x7fd9e0166be0 2024-09-17T05:42:52.170 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:52.168+0000 7fd9d7fff640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd9e00d2370 0x7fd9e00b27c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:42:52.170 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:52.168+0000 7fd9d7fff640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd9e00d2370 0x7fd9e00b27c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:60966/0 (socket says 172.21.15.150:60966) 2024-09-17T05:42:52.170 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:52.168+0000 7fd9d7fff640 1 -- 172.21.15.150:0/99698120 learned_addr learned my addr 172.21.15.150:0/99698120 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:42:52.170 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:52.168+0000 7fd9d7fff640 1 -- 172.21.15.150:0/99698120 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd9e0166be0 msgr2=0x7fd9e00b2d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:52.170 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:52.168+0000 7fd9d7fff640 1 --2- 172.21.15.150:0/99698120 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd9e0166be0 0x7fd9e00b2d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:52.170 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:52.168+0000 7fd9d7fff640 1 -- 172.21.15.150:0/99698120 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd9e00b3ae0 msgr2=0x7fd9e0154a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:52.170 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:52.168+0000 7fd9df7fe640 1 --2- 172.21.15.150:0/99698120 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd9e00b3ae0 0x7fd9e0154a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:42:52.170 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:52.168+0000 7fd9d7fff640 1 --2- 172.21.15.150:0/99698120 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd9e00b3ae0 0x7fd9e0154a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:52.170 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:52.168+0000 7fd9d7fff640 1 -- 172.21.15.150:0/99698120 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd9e015bb90 con 0x7fd9e00d2370 2024-09-17T05:42:52.170 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:52.168+0000 7fd9d7fff640 1 --2- 172.21.15.150:0/99698120 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd9e00d2370 0x7fd9e00b27c0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7fd9c802aaf0 tx=0x7fd9c8033c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:42:52.171 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:52.168+0000 7fd9dcff9640 1 -- 172.21.15.150:0/99698120 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9c8031d60 con 0x7fd9e00d2370 2024-09-17T05:42:52.171 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:52.168+0000 7fd9e5ff1640 1 -- 172.21.15.150:0/99698120 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd9e0155020 con 0x7fd9e00d2370 2024-09-17T05:42:52.171 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:52.168+0000 7fd9dcff9640 1 -- 172.21.15.150:0/99698120 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd9c8033e10 con 0x7fd9e00d2370 2024-09-17T05:42:52.171 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:52.168+0000 7fd9dcff9640 1 -- 172.21.15.150:0/99698120 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9c8005260 con 0x7fd9e00d2370 2024-09-17T05:42:52.171 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:52.169+0000 7fd9e5ff1640 1 -- 172.21.15.150:0/99698120 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd9e015af20 con 0x7fd9e00d2370 2024-09-17T05:42:52.172 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:52.169+0000 7fd9e5ff1640 1 -- 172.21.15.150:0/99698120 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd9e008d090 con 0x7fd9e00d2370 2024-09-17T05:42:52.172 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:52.170+0000 7fd9dcff9640 1 -- 172.21.15.150:0/99698120 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fd9c8005400 con 0x7fd9e00d2370 2024-09-17T05:42:52.172 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:52.171+0000 7fd9dcff9640 1 --2- 172.21.15.150:0/99698120 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fd9c0078bc0 0x7fd9c007b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:42:52.172 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:52.171+0000 7fd9dcff9640 1 -- 172.21.15.150:0/99698120 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7fd9c80bc060 con 0x7fd9e00d2370 2024-09-17T05:42:52.172 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:52.171+0000 7fd9df7fe640 1 --2- 172.21.15.150:0/99698120 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fd9c0078bc0 0x7fd9c007b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:42:52.172 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:52.171+0000 7fd9df7fe640 1 --2- 172.21.15.150:0/99698120 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fd9c0078bc0 0x7fd9c007b0d0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fd9d0001510 tx=0x7fd9d0009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:42:52.175 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:52.175+0000 7fd9dcff9640 1 -- 172.21.15.150:0/99698120 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fd9e008d090 con 0x7fd9e00d2370 2024-09-17T05:42:52.352 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:52.351+0000 7fd9e5ff1640 1 -- 172.21.15.150:0/99698120 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command([{prefix=config set, name=mgr/volumes/max_concurrent_clones}] v 0) -- 0x7fd9e01628c0 con 0x7fd9e00d2370 2024-09-17T05:42:52.356 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:52.355+0000 7fd9dcff9640 1 -- 172.21.15.150:0/99698120 <== mon.0 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/volumes/max_concurrent_clones}]=0 v33)=0 v33) ==== 131+0+0 (secure 0 0 0) 0x7fd9c803f030 con 0x7fd9e00d2370 2024-09-17T05:42:52.358 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:52.357+0000 7fd9e5ff1640 1 -- 172.21.15.150:0/99698120 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fd9c0078bc0 msgr2=0x7fd9c007b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:52.358 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:52.357+0000 7fd9e5ff1640 1 --2- 172.21.15.150:0/99698120 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fd9c0078bc0 0x7fd9c007b0d0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fd9d0001510 tx=0x7fd9d0009040 comp rx=0 tx=0).stop 2024-09-17T05:42:52.358 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:52.357+0000 7fd9e5ff1640 1 -- 172.21.15.150:0/99698120 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd9e00d2370 msgr2=0x7fd9e00b27c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:52.358 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:52.357+0000 7fd9e5ff1640 1 --2- 172.21.15.150:0/99698120 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd9e00d2370 0x7fd9e00b27c0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7fd9c802aaf0 tx=0x7fd9c8033c20 comp rx=0 tx=0).stop 2024-09-17T05:42:52.359 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:52.357+0000 7fd9e5ff1640 1 -- 172.21.15.150:0/99698120 shutdown_connections 2024-09-17T05:42:52.359 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:52.357+0000 7fd9e5ff1640 1 --2- 172.21.15.150:0/99698120 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fd9c0078bc0 0x7fd9c007b0d0 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:52.359 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:52.357+0000 7fd9e5ff1640 1 --2- 172.21.15.150:0/99698120 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd9e0166be0 0x7fd9e00b2d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:52.359 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:52.357+0000 7fd9e5ff1640 1 --2- 172.21.15.150:0/99698120 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd9e00d2370 0x7fd9e00b27c0 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:52.359 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:52.357+0000 7fd9e5ff1640 1 --2- 172.21.15.150:0/99698120 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd9e00b3ae0 0x7fd9e0154a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:52.359 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:52.357+0000 7fd9e5ff1640 1 -- 172.21.15.150:0/99698120 >> 172.21.15.150:0/99698120 conn(0x7fd9e00d4680 msgr2=0x7fd9e006f390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:42:52.360 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:52.357+0000 7fd9e5ff1640 1 -- 172.21.15.150:0/99698120 shutdown_connections 2024-09-17T05:42:52.360 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:52.357+0000 7fd9e5ff1640 1 -- 172.21.15.150:0/99698120 wait complete. 2024-09-17T05:42:52.370 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolumegroup create cephfs group1 2024-09-17T05:42:52.487 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:52.486+0000 7fbc8c9cf640 1 -- 172.21.15.150:0/179991459 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbc88070a10 msgr2=0x7fbc880b4070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:52.488 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:52.486+0000 7fbc8c9cf640 1 --2- 172.21.15.150:0/179991459 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbc88070a10 0x7fbc880b4070 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7fbc80005fd0 tx=0x7fbc8002a940 comp rx=0 tx=0).stop 2024-09-17T05:42:52.488 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:52.487+0000 7fbc8c9cf640 1 -- 172.21.15.150:0/179991459 shutdown_connections 2024-09-17T05:42:52.488 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:52.487+0000 7fbc8c9cf640 1 --2- 172.21.15.150:0/179991459 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbc88070a10 0x7fbc880b4070 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:52.488 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:52.487+0000 7fbc8c9cf640 1 -- 172.21.15.150:0/179991459 >> 172.21.15.150:0/179991459 conn(0x7fbc8806d1c0 msgr2=0x7fbc8806d5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:42:52.488 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:52.487+0000 7fbc8c9cf640 1 -- 172.21.15.150:0/179991459 shutdown_connections 2024-09-17T05:42:52.488 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:52.487+0000 7fbc8c9cf640 1 -- 172.21.15.150:0/179991459 wait complete. 2024-09-17T05:42:52.489 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:52.489+0000 7fbc8c9cf640 1 Processor -- start 2024-09-17T05:42:52.489 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:52.489+0000 7fbc8c9cf640 1 -- start start 2024-09-17T05:42:52.492 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:52.490+0000 7fbc8c9cf640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fbc88070600 0x7fbc881f5f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:42:52.492 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:52.490+0000 7fbc8c9cf640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fbc88070a10 0x7fbc881f7050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:42:52.492 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:52.490+0000 7fbc8c9cf640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbc88154390 0x7fbc881547a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:42:52.493 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:52.490+0000 7fbc8c9cf640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7fbc880cf9c0 con 0x7fbc88154390 2024-09-17T05:42:52.493 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:52.490+0000 7fbc8c9cf640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fbc880cf840 con 0x7fbc88070600 2024-09-17T05:42:52.493 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:52.490+0000 7fbc8c9cf640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fbc880cfb40 con 0x7fbc88070a10 2024-09-17T05:42:52.493 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:52.490+0000 7fbc86d9d640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbc88154390 0x7fbc881547a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:42:52.493 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:52.490+0000 7fbc86d9d640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbc88154390 0x7fbc881547a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:60982/0 (socket says 172.21.15.150:60982) 2024-09-17T05:42:52.493 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:52.490+0000 7fbc86d9d640 1 -- 172.21.15.150:0/1955228884 learned_addr learned my addr 172.21.15.150:0/1955228884 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:42:52.493 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:52.490+0000 7fbc8659c640 1 --2- 172.21.15.150:0/1955228884 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fbc88070600 0x7fbc881f5f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:42:52.493 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:52.490+0000 7fbc86d9d640 1 -- 172.21.15.150:0/1955228884 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fbc88070a10 msgr2=0x7fbc881f7050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:52.493 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:52.490+0000 7fbc86d9d640 1 --2- 172.21.15.150:0/1955228884 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fbc88070a10 0x7fbc881f7050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:52.493 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:52.490+0000 7fbc86d9d640 1 -- 172.21.15.150:0/1955228884 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fbc88070600 msgr2=0x7fbc881f5f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:52.493 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:52.490+0000 7fbc86d9d640 1 --2- 172.21.15.150:0/1955228884 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fbc88070600 0x7fbc881f5f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:52.494 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:52.490+0000 7fbc86d9d640 1 -- 172.21.15.150:0/1955228884 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbc88154ce0 con 0x7fbc88154390 2024-09-17T05:42:52.494 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:52.490+0000 7fbc8659c640 1 --2- 172.21.15.150:0/1955228884 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fbc88070600 0x7fbc881f5f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T05:42:52.494 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:52.491+0000 7fbc86d9d640 1 --2- 172.21.15.150:0/1955228884 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbc88154390 0x7fbc881547a0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7fbc80009cd0 tx=0x7fbc80031ea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:42:52.494 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:52.491+0000 7fbc7f7fe640 1 -- 172.21.15.150:0/1955228884 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc8003e070 con 0x7fbc88154390 2024-09-17T05:42:52.494 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:52.491+0000 7fbc7f7fe640 1 -- 172.21.15.150:0/1955228884 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fbc80004600 con 0x7fbc88154390 2024-09-17T05:42:52.494 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:52.491+0000 7fbc8c9cf640 1 -- 172.21.15.150:0/1955228884 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbc88073c60 con 0x7fbc88154390 2024-09-17T05:42:52.494 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:52.491+0000 7fbc7f7fe640 1 -- 172.21.15.150:0/1955228884 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc80043460 con 0x7fbc88154390 2024-09-17T05:42:52.494 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:52.491+0000 7fbc8c9cf640 1 -- 172.21.15.150:0/1955228884 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbc881f7590 con 0x7fbc88154390 2024-09-17T05:42:52.494 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:52.492+0000 7fbc8c9cf640 1 -- 172.21.15.150:0/1955228884 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbc880736e0 con 0x7fbc88154390 2024-09-17T05:42:52.495 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:52.493+0000 7fbc7f7fe640 1 -- 172.21.15.150:0/1955228884 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fbc80043600 con 0x7fbc88154390 2024-09-17T05:42:52.495 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:52.493+0000 7fbc7f7fe640 1 --2- 172.21.15.150:0/1955228884 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fbc68078b90 0x7fbc6807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:42:52.495 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:52.493+0000 7fbc7f7fe640 1 -- 172.21.15.150:0/1955228884 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7fbc800bcab0 con 0x7fbc88154390 2024-09-17T05:42:52.495 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:52.493+0000 7fbc8659c640 1 --2- 172.21.15.150:0/1955228884 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fbc68078b90 0x7fbc6807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:42:52.496 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:52.494+0000 7fbc8659c640 1 --2- 172.21.15.150:0/1955228884 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fbc68078b90 0x7fbc6807b0a0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fbc78007fd0 tx=0x7fbc78009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:42:52.498 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:52.498+0000 7fbc7f7fe640 1 -- 172.21.15.150:0/1955228884 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fbc880736e0 con 0x7fbc88154390 2024-09-17T05:42:52.701 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:52.701+0000 7fbc8c9cf640 1 -- 172.21.15.150:0/1955228884 --> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] -- mgr_command(tid 0: {"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "group1", "target": ["mon-mgr", ""]}) -- 0x7fbc880cfff0 con 0x7fbc68078b90 2024-09-17T05:42:52.707 INFO:tasks.ceph.mgr.x.smithi176.stderr:2024-09-17T05:42:52.706+0000 7f33d771a640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-17T05:42:52.707 INFO:tasks.ceph.mgr.x.smithi176.stderr:2024-09-17T05:42:52.706+0000 7f33d771a640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-17T05:42:52.708 INFO:tasks.ceph.mgr.x.smithi176.stderr:2024-09-17T05:42:52.706+0000 7f33d771a640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-17T05:42:52.708 INFO:tasks.ceph.mgr.x.smithi176.stderr:2024-09-17T05:42:52.706+0000 7f33d771a640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-17T05:42:52.708 INFO:tasks.ceph.mgr.x.smithi176.stderr:2024-09-17T05:42:52.706+0000 7f33d771a640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-17T05:42:52.723 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:52.722+0000 7fbc7f7fe640 1 -- 172.21.15.150:0/1955228884 <== mgr.4108 v2:172.21.15.176:6800/3631216395 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7fbc880cfff0 con 0x7fbc68078b90 2024-09-17T05:42:52.725 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:52.724+0000 7fbc8c9cf640 1 -- 172.21.15.150:0/1955228884 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fbc68078b90 msgr2=0x7fbc6807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:52.725 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:52.724+0000 7fbc8c9cf640 1 --2- 172.21.15.150:0/1955228884 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fbc68078b90 0x7fbc6807b0a0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fbc78007fd0 tx=0x7fbc78009040 comp rx=0 tx=0).stop 2024-09-17T05:42:52.726 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:52.725+0000 7fbc8c9cf640 1 -- 172.21.15.150:0/1955228884 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbc88154390 msgr2=0x7fbc881547a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:52.726 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:52.725+0000 7fbc8c9cf640 1 --2- 172.21.15.150:0/1955228884 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbc88154390 0x7fbc881547a0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7fbc80009cd0 tx=0x7fbc80031ea0 comp rx=0 tx=0).stop 2024-09-17T05:42:52.726 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:52.725+0000 7fbc8c9cf640 1 -- 172.21.15.150:0/1955228884 shutdown_connections 2024-09-17T05:42:52.726 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:52.725+0000 7fbc8c9cf640 1 --2- 172.21.15.150:0/1955228884 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fbc68078b90 0x7fbc6807b0a0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:52.726 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:52.725+0000 7fbc8c9cf640 1 --2- 172.21.15.150:0/1955228884 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbc88154390 0x7fbc881547a0 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:52.726 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:52.725+0000 7fbc8c9cf640 1 --2- 172.21.15.150:0/1955228884 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fbc88070a10 0x7fbc881f7050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:52.726 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:52.725+0000 7fbc8c9cf640 1 --2- 172.21.15.150:0/1955228884 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fbc88070600 0x7fbc881f5f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:52.726 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:52.725+0000 7fbc8c9cf640 1 -- 172.21.15.150:0/1955228884 >> 172.21.15.150:0/1955228884 conn(0x7fbc8806d1c0 msgr2=0x7fbc8815d580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:42:52.726 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:52.725+0000 7fbc8c9cf640 1 -- 172.21.15.150:0/1955228884 shutdown_connections 2024-09-17T05:42:52.726 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:52.725+0000 7fbc8c9cf640 1 -- 172.21.15.150:0/1955228884 wait complete. 2024-09-17T05:42:52.736 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume create cephfs sv1 group1 --mode=777 2024-09-17T05:42:52.855 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:52.854+0000 7f7505f62640 1 -- 172.21.15.150:0/3445111268 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f75000b6320 msgr2=0x7f75000b6730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:52.856 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:52.854+0000 7f7505f62640 1 --2- 172.21.15.150:0/3445111268 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f75000b6320 0x7f75000b6730 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f74f4009820 tx=0x7f74f402a3f0 comp rx=0 tx=0).stop 2024-09-17T05:42:52.856 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:52.855+0000 7f7505f62640 1 -- 172.21.15.150:0/3445111268 shutdown_connections 2024-09-17T05:42:52.856 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:52.855+0000 7f7505f62640 1 --2- 172.21.15.150:0/3445111268 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f75000b6320 0x7f75000b6730 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:52.856 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:52.855+0000 7f7505f62640 1 --2- 172.21.15.150:0/3445111268 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f75000d5300 0x7f75000d2420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:52.856 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:52.855+0000 7f7505f62640 1 -- 172.21.15.150:0/3445111268 >> 172.21.15.150:0/3445111268 conn(0x7f75000d46c0 msgr2=0x7f75000d4ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:42:52.856 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:52.855+0000 7f7505f62640 1 -- 172.21.15.150:0/3445111268 shutdown_connections 2024-09-17T05:42:52.856 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:52.855+0000 7f7505f62640 1 -- 172.21.15.150:0/3445111268 wait complete. 2024-09-17T05:42:52.857 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:52.856+0000 7f7505f62640 1 Processor -- start 2024-09-17T05:42:52.857 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:52.857+0000 7f7505f62640 1 -- start start 2024-09-17T05:42:52.860 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:52.858+0000 7f7505f62640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f75000b6320 0x7f750009e280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:42:52.861 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:52.858+0000 7f7505f62640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f75000b7510 0x7f75000b4d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:42:52.861 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:52.858+0000 7f7505f62640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f75000d5300 0x7f75000b13d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:42:52.861 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:52.858+0000 7f7505f62640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f75000b7cb0 con 0x7f75000b7510 2024-09-17T05:42:52.861 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:52.858+0000 7f7505f62640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f75000b7b30 con 0x7f75000d5300 2024-09-17T05:42:52.861 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:52.858+0000 7f7505f62640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f75000cf500 con 0x7f75000b6320 2024-09-17T05:42:52.861 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:52.858+0000 7f74feffd640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f75000b7510 0x7f75000b4d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:42:52.861 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:52.858+0000 7f74feffd640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f75000b7510 0x7f75000b4d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:32780/0 (socket says 172.21.15.150:32780) 2024-09-17T05:42:52.861 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:52.858+0000 7f74feffd640 1 -- 172.21.15.150:0/785210667 learned_addr learned my addr 172.21.15.150:0/785210667 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:42:52.861 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:52.858+0000 7f74ff7fe640 1 --2- 172.21.15.150:0/785210667 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f75000b6320 0x7f750009e280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:42:52.861 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:52.858+0000 7f74fffff640 1 --2- 172.21.15.150:0/785210667 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f75000d5300 0x7f75000b13d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:42:52.861 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:52.858+0000 7f74feffd640 1 -- 172.21.15.150:0/785210667 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f75000b6320 msgr2=0x7f750009e280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:52.862 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:52.858+0000 7f74feffd640 1 --2- 172.21.15.150:0/785210667 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f75000b6320 0x7f750009e280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:52.862 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:52.858+0000 7f74feffd640 1 -- 172.21.15.150:0/785210667 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f75000d5300 msgr2=0x7f75000b13d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:52.862 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:52.858+0000 7f74feffd640 1 --2- 172.21.15.150:0/785210667 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f75000d5300 0x7f75000b13d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:52.862 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:52.858+0000 7f74feffd640 1 -- 172.21.15.150:0/785210667 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f75001f6610 con 0x7f75000b7510 2024-09-17T05:42:52.862 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:52.859+0000 7f74feffd640 1 --2- 172.21.15.150:0/785210667 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f75000b7510 0x7f75000b4d00 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f74f4009910 tx=0x7f74f4004a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:42:52.862 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:52.859+0000 7f74e7fff640 1 -- 172.21.15.150:0/785210667 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74f403f070 con 0x7f75000b7510 2024-09-17T05:42:52.862 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:52.859+0000 7f74e7fff640 1 -- 172.21.15.150:0/785210667 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f74f4004e50 con 0x7f75000b7510 2024-09-17T05:42:52.862 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:52.859+0000 7f7505f62640 1 -- 172.21.15.150:0/785210667 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f75000b3f40 con 0x7f75000b7510 2024-09-17T05:42:52.862 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:52.859+0000 7f74e7fff640 1 -- 172.21.15.150:0/785210667 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74f4031950 con 0x7f75000b7510 2024-09-17T05:42:52.862 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:52.859+0000 7f7505f62640 1 -- 172.21.15.150:0/785210667 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f75000b4500 con 0x7f75000b7510 2024-09-17T05:42:52.862 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:52.860+0000 7f7505f62640 1 -- 172.21.15.150:0/785210667 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f750008cd50 con 0x7f75000b7510 2024-09-17T05:42:52.863 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:52.861+0000 7f74e7fff640 1 -- 172.21.15.150:0/785210667 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f74f4042070 con 0x7f75000b7510 2024-09-17T05:42:52.863 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:52.861+0000 7f74e7fff640 1 --2- 172.21.15.150:0/785210667 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f74ec078b90 0x7f74ec07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:42:52.863 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:52.861+0000 7f74e7fff640 1 -- 172.21.15.150:0/785210667 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7f74f40bbd00 con 0x7f75000b7510 2024-09-17T05:42:52.863 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:52.861+0000 7f74ff7fe640 1 --2- 172.21.15.150:0/785210667 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f74ec078b90 0x7f74ec07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:42:52.864 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:52.862+0000 7f74ff7fe640 1 --2- 172.21.15.150:0/785210667 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f74ec078b90 0x7f74ec07b0a0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f74f0005c40 tx=0x7f74f000a550 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:42:52.866 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:52.866+0000 7f74e7fff640 1 -- 172.21.15.150:0/785210667 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f750008cd50 con 0x7f75000b7510 2024-09-17T05:42:53.068 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:53.067+0000 7f7505f62640 1 -- 172.21.15.150:0/785210667 --> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] -- mgr_command(tid 0: {"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv1", "group_name": "group1", "mode": "777", "target": ["mon-mgr", ""]}) -- 0x7f75000b6730 con 0x7f74ec078b90 2024-09-17T05:42:53.094 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:53.094+0000 7f74e7fff640 1 -- 172.21.15.150:0/785210667 <== mgr.4108 v2:172.21.15.176:6800/3631216395 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f75000b6730 con 0x7f74ec078b90 2024-09-17T05:42:53.097 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:53.096+0000 7f7505f62640 1 -- 172.21.15.150:0/785210667 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f74ec078b90 msgr2=0x7f74ec07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:53.097 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:53.096+0000 7f7505f62640 1 --2- 172.21.15.150:0/785210667 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f74ec078b90 0x7f74ec07b0a0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f74f0005c40 tx=0x7f74f000a550 comp rx=0 tx=0).stop 2024-09-17T05:42:53.097 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:53.096+0000 7f7505f62640 1 -- 172.21.15.150:0/785210667 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f75000b7510 msgr2=0x7f75000b4d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:53.097 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:53.096+0000 7f7505f62640 1 --2- 172.21.15.150:0/785210667 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f75000b7510 0x7f75000b4d00 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f74f4009910 tx=0x7f74f4004a50 comp rx=0 tx=0).stop 2024-09-17T05:42:53.097 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:53.096+0000 7f7505f62640 1 -- 172.21.15.150:0/785210667 shutdown_connections 2024-09-17T05:42:53.097 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:53.096+0000 7f7505f62640 1 --2- 172.21.15.150:0/785210667 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f75000d5300 0x7f75000b13d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:53.097 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:53.096+0000 7f7505f62640 1 --2- 172.21.15.150:0/785210667 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f74ec078b90 0x7f74ec07b0a0 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:53.097 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:53.096+0000 7f7505f62640 1 --2- 172.21.15.150:0/785210667 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f75000b7510 0x7f75000b4d00 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:53.097 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:53.096+0000 7f7505f62640 1 --2- 172.21.15.150:0/785210667 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f75000b6320 0x7f750009e280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:53.098 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:53.096+0000 7f7505f62640 1 -- 172.21.15.150:0/785210667 >> 172.21.15.150:0/785210667 conn(0x7f75000d46c0 msgr2=0x7f75000d3180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:42:53.098 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:53.096+0000 7f7505f62640 1 -- 172.21.15.150:0/785210667 shutdown_connections 2024-09-17T05:42:53.098 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:53.096+0000 7f7505f62640 1 -- 172.21.15.150:0/785210667 wait complete. 2024-09-17T05:42:53.108 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume getpath cephfs sv1 group1 2024-09-17T05:42:53.225 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:53.224+0000 7f863167e640 1 -- 172.21.15.150:0/2588761358 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f862c0b9e40 msgr2=0x7f862c0b60f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:53.225 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:53.224+0000 7f863167e640 1 --2- 172.21.15.150:0/2588761358 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f862c0b9e40 0x7f862c0b60f0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f8614009910 tx=0x7f861402a6c0 comp rx=0 tx=0).stop 2024-09-17T05:42:53.225 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:53.224+0000 7f863167e640 1 -- 172.21.15.150:0/2588761358 shutdown_connections 2024-09-17T05:42:53.225 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:53.224+0000 7f863167e640 1 --2- 172.21.15.150:0/2588761358 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f862c0b9e40 0x7f862c0b60f0 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:53.225 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:53.224+0000 7f863167e640 1 --2- 172.21.15.150:0/2588761358 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f862c0cf380 0x7f862c0d0290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:53.226 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:53.224+0000 7f863167e640 1 -- 172.21.15.150:0/2588761358 >> 172.21.15.150:0/2588761358 conn(0x7f862c0d4670 msgr2=0x7f862c0d4a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:42:53.226 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:53.224+0000 7f863167e640 1 -- 172.21.15.150:0/2588761358 shutdown_connections 2024-09-17T05:42:53.226 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:53.224+0000 7f863167e640 1 -- 172.21.15.150:0/2588761358 wait complete. 2024-09-17T05:42:53.226 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:53.226+0000 7f863167e640 1 Processor -- start 2024-09-17T05:42:53.226 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:53.226+0000 7f863167e640 1 -- start start 2024-09-17T05:42:53.229 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:53.227+0000 7f863167e640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f862c0b6630 0x7f862c14e3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:42:53.229 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:53.227+0000 7f863167e640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f862c0b9e40 0x7f862c1f68d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:42:53.229 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:53.227+0000 7f863167e640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f862c0cf380 0x7f862c1f9440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:42:53.229 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:53.227+0000 7f863167e640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f862c163190 con 0x7f862c0b9e40 2024-09-17T05:42:53.229 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:53.227+0000 7f863167e640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f862c163010 con 0x7f862c0b6630 2024-09-17T05:42:53.229 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:53.227+0000 7f863167e640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f862c163310 con 0x7f862c0cf380 2024-09-17T05:42:53.229 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:53.227+0000 7f86227fc640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f862c0b9e40 0x7f862c1f68d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:42:53.230 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:53.227+0000 7f86227fc640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f862c0b9e40 0x7f862c1f68d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:32794/0 (socket says 172.21.15.150:32794) 2024-09-17T05:42:53.230 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:53.227+0000 7f86227fc640 1 -- 172.21.15.150:0/1569436449 learned_addr learned my addr 172.21.15.150:0/1569436449 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:42:53.230 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:53.227+0000 7f862affd640 1 --2- 172.21.15.150:0/1569436449 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f862c0b6630 0x7f862c14e3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:42:53.230 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:53.227+0000 7f862b7fe640 1 --2- 172.21.15.150:0/1569436449 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f862c0cf380 0x7f862c1f9440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:42:53.230 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:53.228+0000 7f86227fc640 1 -- 172.21.15.150:0/1569436449 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f862c0cf380 msgr2=0x7f862c1f9440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:53.230 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:53.228+0000 7f86227fc640 1 --2- 172.21.15.150:0/1569436449 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f862c0cf380 0x7f862c1f9440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:53.230 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:53.228+0000 7f86227fc640 1 -- 172.21.15.150:0/1569436449 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f862c0b6630 msgr2=0x7f862c14e3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:53.230 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:53.228+0000 7f86227fc640 1 --2- 172.21.15.150:0/1569436449 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f862c0b6630 0x7f862c14e3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:53.230 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:53.228+0000 7f86227fc640 1 -- 172.21.15.150:0/1569436449 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f862c1f6e10 con 0x7f862c0b9e40 2024-09-17T05:42:53.230 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:53.228+0000 7f86227fc640 1 --2- 172.21.15.150:0/1569436449 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f862c0b9e40 0x7f862c1f68d0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f8614009a30 tx=0x7f8614033c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:42:53.230 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:53.228+0000 7f8623fff640 1 -- 172.21.15.150:0/1569436449 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8614005cf0 con 0x7f862c0b9e40 2024-09-17T05:42:53.230 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:53.228+0000 7f8623fff640 1 -- 172.21.15.150:0/1569436449 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8614033e10 con 0x7f862c0b9e40 2024-09-17T05:42:53.231 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:53.228+0000 7f863167e640 1 -- 172.21.15.150:0/1569436449 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f862c0c8770 con 0x7f862c0b9e40 2024-09-17T05:42:53.231 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:53.228+0000 7f8623fff640 1 -- 172.21.15.150:0/1569436449 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8614033330 con 0x7f862c0b9e40 2024-09-17T05:42:53.231 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:53.228+0000 7f863167e640 1 -- 172.21.15.150:0/1569436449 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f862c0c9e70 con 0x7f862c0b9e40 2024-09-17T05:42:53.232 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:53.229+0000 7f863167e640 1 -- 172.21.15.150:0/1569436449 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f862c0b60f0 con 0x7f862c0b9e40 2024-09-17T05:42:53.232 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:53.230+0000 7f8623fff640 1 -- 172.21.15.150:0/1569436449 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f86140334d0 con 0x7f862c0b9e40 2024-09-17T05:42:53.232 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:53.230+0000 7f8623fff640 1 --2- 172.21.15.150:0/1569436449 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f860c078b90 0x7f860c07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:42:53.232 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:53.231+0000 7f8623fff640 1 -- 172.21.15.150:0/1569436449 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7f86140bc1d0 con 0x7f862c0b9e40 2024-09-17T05:42:53.232 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:53.231+0000 7f862affd640 1 --2- 172.21.15.150:0/1569436449 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f860c078b90 0x7f860c07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:42:53.232 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:53.231+0000 7f862affd640 1 --2- 172.21.15.150:0/1569436449 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f860c078b90 0x7f860c07b0a0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f861c004630 tx=0x7f861c00b2e0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:42:53.235 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:53.234+0000 7f8623fff640 1 -- 172.21.15.150:0/1569436449 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f862c1f6e10 con 0x7f862c0b9e40 2024-09-17T05:42:53.365 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:53.365+0000 7f8623fff640 1 -- 172.21.15.150:0/1569436449 <== mon.0 v2:172.21.15.150:3300/0 7 ==== mgrmap(e 6) ==== 101492+0+0 (secure 0 0 0) 0x7f8614080430 con 0x7f862c0b9e40 2024-09-17T05:42:53.442 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:53.441+0000 7f863167e640 1 -- 172.21.15.150:0/1569436449 --> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "sub_name": "sv1", "group_name": "group1", "target": ["mon-mgr", ""]}) -- 0x7f862c0ce9d0 con 0x7f860c078b90 2024-09-17T05:42:53.447 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:53.447+0000 7f8623fff640 1 -- 172.21.15.150:0/1569436449 <== mgr.4108 v2:172.21.15.176:6800/3631216395 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+57 (secure 0 0 0) 0x7f861c00b800 con 0x7f860c078b90 2024-09-17T05:42:53.448 INFO:teuthology.orchestra.run.smithi150.stdout:/volumes/group1/sv1/7e00e3a9-c765-4d8a-9dbc-0871e9440c37 2024-09-17T05:42:53.450 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:53.449+0000 7f863167e640 1 -- 172.21.15.150:0/1569436449 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f860c078b90 msgr2=0x7f860c07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:53.450 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:53.449+0000 7f863167e640 1 --2- 172.21.15.150:0/1569436449 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f860c078b90 0x7f860c07b0a0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f861c004630 tx=0x7f861c00b2e0 comp rx=0 tx=0).stop 2024-09-17T05:42:53.450 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:53.449+0000 7f863167e640 1 -- 172.21.15.150:0/1569436449 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f862c0b9e40 msgr2=0x7f862c1f68d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:53.450 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:53.449+0000 7f863167e640 1 --2- 172.21.15.150:0/1569436449 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f862c0b9e40 0x7f862c1f68d0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f8614009a30 tx=0x7f8614033c20 comp rx=0 tx=0).stop 2024-09-17T05:42:53.450 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:53.449+0000 7f863167e640 1 -- 172.21.15.150:0/1569436449 shutdown_connections 2024-09-17T05:42:53.450 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:53.449+0000 7f863167e640 1 --2- 172.21.15.150:0/1569436449 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f860c078b90 0x7f860c07b0a0 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:53.450 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:53.449+0000 7f863167e640 1 --2- 172.21.15.150:0/1569436449 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f862c0cf380 0x7f862c1f9440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:53.450 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:53.449+0000 7f863167e640 1 --2- 172.21.15.150:0/1569436449 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f862c0b9e40 0x7f862c1f68d0 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:53.450 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:53.449+0000 7f863167e640 1 --2- 172.21.15.150:0/1569436449 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f862c0b6630 0x7f862c14e3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:53.451 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:53.449+0000 7f863167e640 1 -- 172.21.15.150:0/1569436449 >> 172.21.15.150:0/1569436449 conn(0x7f862c0d4670 msgr2=0x7f862c06f330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:42:53.451 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:53.449+0000 7f863167e640 1 -- 172.21.15.150:0/1569436449 shutdown_connections 2024-09-17T05:42:53.451 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:42:53.449+0000 7f863167e640 1 -- 172.21.15.150:0/1569436449 wait complete. 2024-09-17T05:42:53.461 DEBUG:tasks.cephfs.test_volumes:filling subvolume sv1 with 10 files each 1024MB size under directory volumes/group1/sv1/7e00e3a9-c765-4d8a-9dbc-0871e9440c37 2024-09-17T05:42:53.461 DEBUG:teuthology.orchestra.run.smithi150:> set -ex 2024-09-17T05:42:53.461 DEBUG:teuthology.orchestra.run.smithi150:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T05:42:53.478 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:42:53.478 DEBUG:teuthology.orchestra.run.smithi150:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/group1/sv1/7e00e3a9-c765-4d8a-9dbc-0871e9440c37/subvolume_file.0 bs=1M conv=fdatasync count=1024 seek=0) 2024-09-17T05:42:53.984 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-17T05:42:53.987 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-17T05:42:57.233 INFO:teuthology.orchestra.run.smithi150.stderr:1024+0 records in 2024-09-17T05:42:57.233 INFO:teuthology.orchestra.run.smithi150.stderr:1024+0 records out 2024-09-17T05:42:57.233 INFO:teuthology.orchestra.run.smithi150.stderr:1073741824 bytes (1.1 GB, 1.0 GiB) copied, 3.69247 s, 291 MB/s 2024-09-17T05:42:57.233 DEBUG:teuthology.orchestra.run.smithi150:> set -ex 2024-09-17T05:42:57.234 DEBUG:teuthology.orchestra.run.smithi150:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T05:42:57.250 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:42:57.250 DEBUG:teuthology.orchestra.run.smithi150:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/group1/sv1/7e00e3a9-c765-4d8a-9dbc-0871e9440c37/subvolume_file.1 bs=1M conv=fdatasync count=1024 seek=0) 2024-09-17T05:43:00.987 INFO:teuthology.orchestra.run.smithi150.stderr:1024+0 records in 2024-09-17T05:43:00.987 INFO:teuthology.orchestra.run.smithi150.stderr:1024+0 records out 2024-09-17T05:43:00.987 INFO:teuthology.orchestra.run.smithi150.stderr:1073741824 bytes (1.1 GB, 1.0 GiB) copied, 3.67984 s, 292 MB/s 2024-09-17T05:43:00.987 DEBUG:teuthology.orchestra.run.smithi150:> set -ex 2024-09-17T05:43:00.988 DEBUG:teuthology.orchestra.run.smithi150:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T05:43:01.003 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:43:01.003 DEBUG:teuthology.orchestra.run.smithi150:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/group1/sv1/7e00e3a9-c765-4d8a-9dbc-0871e9440c37/subvolume_file.2 bs=1M conv=fdatasync count=1024 seek=0) 2024-09-17T05:43:04.828 INFO:teuthology.orchestra.run.smithi150.stderr:1024+0 records in 2024-09-17T05:43:04.828 INFO:teuthology.orchestra.run.smithi150.stderr:1024+0 records out 2024-09-17T05:43:04.828 INFO:teuthology.orchestra.run.smithi150.stderr:1073741824 bytes (1.1 GB, 1.0 GiB) copied, 3.76694 s, 285 MB/s 2024-09-17T05:43:04.828 DEBUG:teuthology.orchestra.run.smithi150:> set -ex 2024-09-17T05:43:04.828 DEBUG:teuthology.orchestra.run.smithi150:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T05:43:04.844 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:43:04.844 DEBUG:teuthology.orchestra.run.smithi150:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/group1/sv1/7e00e3a9-c765-4d8a-9dbc-0871e9440c37/subvolume_file.3 bs=1M conv=fdatasync count=1024 seek=0) 2024-09-17T05:43:08.643 INFO:teuthology.orchestra.run.smithi150.stderr:1024+0 records in 2024-09-17T05:43:08.643 INFO:teuthology.orchestra.run.smithi150.stderr:1024+0 records out 2024-09-17T05:43:08.643 INFO:teuthology.orchestra.run.smithi150.stderr:1073741824 bytes (1.1 GB, 1.0 GiB) copied, 3.74221 s, 287 MB/s 2024-09-17T05:43:08.644 DEBUG:teuthology.orchestra.run.smithi150:> set -ex 2024-09-17T05:43:08.644 DEBUG:teuthology.orchestra.run.smithi150:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T05:43:08.659 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:43:08.660 DEBUG:teuthology.orchestra.run.smithi150:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/group1/sv1/7e00e3a9-c765-4d8a-9dbc-0871e9440c37/subvolume_file.4 bs=1M conv=fdatasync count=1024 seek=0) 2024-09-17T05:43:12.468 INFO:teuthology.orchestra.run.smithi150.stderr:1024+0 records in 2024-09-17T05:43:12.468 INFO:teuthology.orchestra.run.smithi150.stderr:1024+0 records out 2024-09-17T05:43:12.468 INFO:teuthology.orchestra.run.smithi150.stderr:1073741824 bytes (1.1 GB, 1.0 GiB) copied, 3.75113 s, 286 MB/s 2024-09-17T05:43:12.468 DEBUG:teuthology.orchestra.run.smithi150:> set -ex 2024-09-17T05:43:12.469 DEBUG:teuthology.orchestra.run.smithi150:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T05:43:12.484 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:43:12.484 DEBUG:teuthology.orchestra.run.smithi150:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/group1/sv1/7e00e3a9-c765-4d8a-9dbc-0871e9440c37/subvolume_file.5 bs=1M conv=fdatasync count=1024 seek=0) 2024-09-17T05:43:16.272 INFO:teuthology.orchestra.run.smithi150.stderr:1024+0 records in 2024-09-17T05:43:16.272 INFO:teuthology.orchestra.run.smithi150.stderr:1024+0 records out 2024-09-17T05:43:16.273 INFO:teuthology.orchestra.run.smithi150.stderr:1073741824 bytes (1.1 GB, 1.0 GiB) copied, 3.73176 s, 288 MB/s 2024-09-17T05:43:16.273 DEBUG:teuthology.orchestra.run.smithi150:> set -ex 2024-09-17T05:43:16.273 DEBUG:teuthology.orchestra.run.smithi150:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T05:43:16.289 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:43:16.289 DEBUG:teuthology.orchestra.run.smithi150:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/group1/sv1/7e00e3a9-c765-4d8a-9dbc-0871e9440c37/subvolume_file.6 bs=1M conv=fdatasync count=1024 seek=0) 2024-09-17T05:43:20.068 INFO:teuthology.orchestra.run.smithi150.stderr:1024+0 records in 2024-09-17T05:43:20.068 INFO:teuthology.orchestra.run.smithi150.stderr:1024+0 records out 2024-09-17T05:43:20.068 INFO:teuthology.orchestra.run.smithi150.stderr:1073741824 bytes (1.1 GB, 1.0 GiB) copied, 3.72062 s, 289 MB/s 2024-09-17T05:43:20.069 DEBUG:teuthology.orchestra.run.smithi150:> set -ex 2024-09-17T05:43:20.069 DEBUG:teuthology.orchestra.run.smithi150:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T05:43:20.085 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:43:20.085 DEBUG:teuthology.orchestra.run.smithi150:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/group1/sv1/7e00e3a9-c765-4d8a-9dbc-0871e9440c37/subvolume_file.7 bs=1M conv=fdatasync count=1024 seek=0) 2024-09-17T05:43:23.901 INFO:teuthology.orchestra.run.smithi150.stderr:1024+0 records in 2024-09-17T05:43:23.902 INFO:teuthology.orchestra.run.smithi150.stderr:1024+0 records out 2024-09-17T05:43:23.902 INFO:teuthology.orchestra.run.smithi150.stderr:1073741824 bytes (1.1 GB, 1.0 GiB) copied, 3.75726 s, 286 MB/s 2024-09-17T05:43:23.902 DEBUG:teuthology.orchestra.run.smithi150:> set -ex 2024-09-17T05:43:23.902 DEBUG:teuthology.orchestra.run.smithi150:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T05:43:23.918 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:43:23.919 DEBUG:teuthology.orchestra.run.smithi150:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/group1/sv1/7e00e3a9-c765-4d8a-9dbc-0871e9440c37/subvolume_file.8 bs=1M conv=fdatasync count=1024 seek=0) 2024-09-17T05:43:24.176 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-17T05:43:24.179 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-17T05:43:27.695 INFO:teuthology.orchestra.run.smithi150.stderr:1024+0 records in 2024-09-17T05:43:27.696 INFO:teuthology.orchestra.run.smithi150.stderr:1024+0 records out 2024-09-17T05:43:27.696 INFO:teuthology.orchestra.run.smithi150.stderr:1073741824 bytes (1.1 GB, 1.0 GiB) copied, 3.72036 s, 289 MB/s 2024-09-17T05:43:27.696 DEBUG:teuthology.orchestra.run.smithi150:> set -ex 2024-09-17T05:43:27.696 DEBUG:teuthology.orchestra.run.smithi150:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T05:43:27.712 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:43:27.712 DEBUG:teuthology.orchestra.run.smithi150:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/group1/sv1/7e00e3a9-c765-4d8a-9dbc-0871e9440c37/subvolume_file.9 bs=1M conv=fdatasync count=1024 seek=0) 2024-09-17T05:43:31.490 INFO:teuthology.orchestra.run.smithi150.stderr:1024+0 records in 2024-09-17T05:43:31.490 INFO:teuthology.orchestra.run.smithi150.stderr:1024+0 records out 2024-09-17T05:43:31.490 INFO:teuthology.orchestra.run.smithi150.stderr:1073741824 bytes (1.1 GB, 1.0 GiB) copied, 3.72024 s, 289 MB/s 2024-09-17T05:43:31.491 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume snapshot create cephfs sv1 ss1 group1 2024-09-17T05:43:31.611 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:31.611+0000 7f06acfdf640 1 -- 172.21.15.150:0/332888104 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f06a80ce800 msgr2=0x7f06a809aa50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:43:31.612 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:31.611+0000 7f06acfdf640 1 --2- 172.21.15.150:0/332888104 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f06a80ce800 0x7f06a809aa50 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f0698005fd0 tx=0x7f069802a4f0 comp rx=0 tx=0).stop 2024-09-17T05:43:31.612 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:31.611+0000 7f06acfdf640 1 -- 172.21.15.150:0/332888104 shutdown_connections 2024-09-17T05:43:31.612 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:31.611+0000 7f06acfdf640 1 --2- 172.21.15.150:0/332888104 >> v2:172.21.15.176:3300/0 conn(0x7f06a809af90 0x7f06a80ccce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:43:31.612 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:31.611+0000 7f06acfdf640 1 --2- 172.21.15.150:0/332888104 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f06a80ce800 0x7f06a809aa50 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:43:31.612 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:31.611+0000 7f06acfdf640 1 -- 172.21.15.150:0/332888104 >> 172.21.15.150:0/332888104 conn(0x7f06a80d2550 msgr2=0x7f06a80d2960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:43:31.612 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:31.611+0000 7f06acfdf640 1 -- 172.21.15.150:0/332888104 shutdown_connections 2024-09-17T05:43:31.612 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:31.611+0000 7f06acfdf640 1 -- 172.21.15.150:0/332888104 wait complete. 2024-09-17T05:43:31.613 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:31.613+0000 7f06acfdf640 1 Processor -- start 2024-09-17T05:43:31.613 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:31.613+0000 7f06acfdf640 1 -- start start 2024-09-17T05:43:31.616 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:31.614+0000 7f06acfdf640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f06a809af90 0x7f06a815ace0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:43:31.616 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:31.614+0000 7f06acfdf640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f06a80cd220 0x7f06a815f900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:43:31.616 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:31.614+0000 7f06acfdf640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f06a80ce800 0x7f06a815fe40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:43:31.616 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:31.614+0000 7f06acfdf640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f06a80cee20 con 0x7f06a80ce800 2024-09-17T05:43:31.616 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:31.614+0000 7f06acfdf640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f06a80b6450 con 0x7f06a809af90 2024-09-17T05:43:31.616 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:31.614+0000 7f06acfdf640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f06a80c9f30 con 0x7f06a80cd220 2024-09-17T05:43:31.616 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:31.614+0000 7f06a6d9d640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f06a80ce800 0x7f06a815fe40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:43:31.616 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:31.614+0000 7f06a6d9d640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f06a80ce800 0x7f06a815fe40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:53938/0 (socket says 172.21.15.150:53938) 2024-09-17T05:43:31.617 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:31.614+0000 7f06a6d9d640 1 -- 172.21.15.150:0/1216770861 learned_addr learned my addr 172.21.15.150:0/1216770861 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:43:31.617 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:31.614+0000 7f06a659c640 1 --2- 172.21.15.150:0/1216770861 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f06a809af90 0x7f06a815ace0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:43:31.617 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:31.614+0000 7f06a5d9b640 1 --2- 172.21.15.150:0/1216770861 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f06a80cd220 0x7f06a815f900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:43:31.617 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:31.614+0000 7f06a6d9d640 1 -- 172.21.15.150:0/1216770861 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f06a80cd220 msgr2=0x7f06a815f900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:43:31.617 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:31.614+0000 7f06a6d9d640 1 --2- 172.21.15.150:0/1216770861 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f06a80cd220 0x7f06a815f900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:43:31.617 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:31.614+0000 7f06a6d9d640 1 -- 172.21.15.150:0/1216770861 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f06a809af90 msgr2=0x7f06a815ace0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:43:31.617 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:31.614+0000 7f06a6d9d640 1 --2- 172.21.15.150:0/1216770861 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f06a809af90 0x7f06a815ace0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:43:31.617 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:31.614+0000 7f06a6d9d640 1 -- 172.21.15.150:0/1216770861 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f06a806f9c0 con 0x7f06a80ce800 2024-09-17T05:43:31.617 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:31.615+0000 7f06a6d9d640 1 --2- 172.21.15.150:0/1216770861 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f06a80ce800 0x7f06a815fe40 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f06a000b9e0 tx=0x7f06a000bea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:43:31.617 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:31.615+0000 7f0696ffd640 1 -- 172.21.15.150:0/1216770861 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06a0019070 con 0x7f06a80ce800 2024-09-17T05:43:31.618 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:31.615+0000 7f0696ffd640 1 -- 172.21.15.150:0/1216770861 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f06a000cc10 con 0x7f06a80ce800 2024-09-17T05:43:31.618 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:31.615+0000 7f0696ffd640 1 -- 172.21.15.150:0/1216770861 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06a00146a0 con 0x7f06a80ce800 2024-09-17T05:43:31.618 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:31.615+0000 7f06acfdf640 1 -- 172.21.15.150:0/1216770861 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f06a806fca0 con 0x7f06a80ce800 2024-09-17T05:43:31.618 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:31.615+0000 7f06acfdf640 1 -- 172.21.15.150:0/1216770861 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f06a815da20 con 0x7f06a80ce800 2024-09-17T05:43:31.619 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:31.616+0000 7f06acfdf640 1 -- 172.21.15.150:0/1216770861 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f06a80ccce0 con 0x7f06a80ce800 2024-09-17T05:43:31.619 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:31.617+0000 7f0696ffd640 1 -- 172.21.15.150:0/1216770861 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 6) ==== 101492+0+0 (secure 0 0 0) 0x7f06a001c070 con 0x7f06a80ce800 2024-09-17T05:43:31.619 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:31.617+0000 7f0696ffd640 1 --2- 172.21.15.150:0/1216770861 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f0688078c20 0x7f068807b130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:43:31.619 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:31.617+0000 7f0696ffd640 1 -- 172.21.15.150:0/1216770861 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7f06a009ab20 con 0x7f06a80ce800 2024-09-17T05:43:31.619 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:31.617+0000 7f06a659c640 1 --2- 172.21.15.150:0/1216770861 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f0688078c20 0x7f068807b130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:43:31.619 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:31.618+0000 7f06a659c640 1 --2- 172.21.15.150:0/1216770861 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f0688078c20 0x7f068807b130 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f0698033000 tx=0x7f0698004730 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:43:31.622 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:31.622+0000 7f0696ffd640 1 -- 172.21.15.150:0/1216770861 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f06a0062810 con 0x7f06a80ce800 2024-09-17T05:43:31.826 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:31.826+0000 7f06acfdf640 1 -- 172.21.15.150:0/1216770861 --> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] -- mgr_command(tid 0: {"prefix": "fs subvolume snapshot create", "vol_name": "cephfs", "sub_name": "sv1", "snap_name": "ss1", "group_name": "group1", "target": ["mon-mgr", ""]}) -- 0x7f06a80b7610 con 0x7f0688078c20 2024-09-17T05:43:31.838 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:31.838+0000 7f0696ffd640 1 -- 172.21.15.150:0/1216770861 <== mgr.4108 v2:172.21.15.176:6800/3631216395 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f0698004020 con 0x7f0688078c20 2024-09-17T05:43:31.842 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:31.841+0000 7f06acfdf640 1 -- 172.21.15.150:0/1216770861 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f0688078c20 msgr2=0x7f068807b130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:43:31.842 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:31.841+0000 7f06acfdf640 1 --2- 172.21.15.150:0/1216770861 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f0688078c20 0x7f068807b130 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f0698033000 tx=0x7f0698004730 comp rx=0 tx=0).stop 2024-09-17T05:43:31.842 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:31.841+0000 7f06acfdf640 1 -- 172.21.15.150:0/1216770861 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f06a80ce800 msgr2=0x7f06a815fe40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:43:31.842 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:31.841+0000 7f06acfdf640 1 --2- 172.21.15.150:0/1216770861 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f06a80ce800 0x7f06a815fe40 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f06a000b9e0 tx=0x7f06a000bea0 comp rx=0 tx=0).stop 2024-09-17T05:43:31.842 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:31.841+0000 7f06acfdf640 1 -- 172.21.15.150:0/1216770861 shutdown_connections 2024-09-17T05:43:31.843 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:31.841+0000 7f06acfdf640 1 --2- 172.21.15.150:0/1216770861 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f0688078c20 0x7f068807b130 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:43:31.843 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:31.841+0000 7f06acfdf640 1 --2- 172.21.15.150:0/1216770861 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f06a80ce800 0x7f06a815fe40 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:43:31.843 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:31.841+0000 7f06acfdf640 1 --2- 172.21.15.150:0/1216770861 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f06a80cd220 0x7f06a815f900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:43:31.843 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:31.841+0000 7f06acfdf640 1 --2- 172.21.15.150:0/1216770861 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f06a809af90 0x7f06a815ace0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:43:31.843 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:31.841+0000 7f06acfdf640 1 -- 172.21.15.150:0/1216770861 >> 172.21.15.150:0/1216770861 conn(0x7f06a80d2550 msgr2=0x7f06a80cc3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:43:31.843 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:31.841+0000 7f06acfdf640 1 -- 172.21.15.150:0/1216770861 shutdown_connections 2024-09-17T05:43:31.843 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:31.841+0000 7f06acfdf640 1 -- 172.21.15.150:0/1216770861 wait complete. 2024-09-17T05:43:31.853 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume getpath cephfs sv1 group1 2024-09-17T05:43:31.974 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:31.973+0000 7f78487b0640 1 -- 172.21.15.150:0/2855499142 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f78400cc7d0 msgr2=0x7f78400b3120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:43:31.974 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:31.973+0000 7f78487b0640 1 --2- 172.21.15.150:0/2855499142 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f78400cc7d0 0x7f78400b3120 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f78400ce2e0 tx=0x7f783802a410 comp rx=0 tx=0).stop 2024-09-17T05:43:31.975 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:31.974+0000 7f78487b0640 1 -- 172.21.15.150:0/2855499142 shutdown_connections 2024-09-17T05:43:31.975 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:31.974+0000 7f78487b0640 1 --2- 172.21.15.150:0/2855499142 >> v2:172.21.15.176:3300/0 conn(0x7f784015ba50 0x7f78400b36f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:43:31.975 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:31.974+0000 7f78487b0640 1 --2- 172.21.15.150:0/2855499142 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f78400cc7d0 0x7f78400b3120 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:43:31.975 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:31.974+0000 7f78487b0640 1 -- 172.21.15.150:0/2855499142 >> 172.21.15.150:0/2855499142 conn(0x7f78400b2540 msgr2=0x7f78400d02d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:43:31.975 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:31.974+0000 7f78487b0640 1 -- 172.21.15.150:0/2855499142 shutdown_connections 2024-09-17T05:43:31.975 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:31.974+0000 7f78487b0640 1 -- 172.21.15.150:0/2855499142 wait complete. 2024-09-17T05:43:31.976 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:31.975+0000 7f78487b0640 1 Processor -- start 2024-09-17T05:43:31.976 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:31.975+0000 7f78487b0640 1 -- start start 2024-09-17T05:43:31.979 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:31.977+0000 7f78487b0640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f784006f010 0x7f784009c070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:43:31.979 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:31.977+0000 7f78487b0640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f78400cc7d0 0x7f7840156870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:43:31.979 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:31.977+0000 7f78487b0640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f784015ba50 0x7f78400b0ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:43:31.979 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:31.977+0000 7f78487b0640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f7840070010 con 0x7f784015ba50 2024-09-17T05:43:31.979 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:31.977+0000 7f78487b0640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f784006fe90 con 0x7f78400cc7d0 2024-09-17T05:43:31.979 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:31.977+0000 7f78487b0640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f78400cb930 con 0x7f784006f010 2024-09-17T05:43:31.979 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:31.977+0000 7f7846d4d640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f784015ba50 0x7f78400b0ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:43:31.980 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:31.977+0000 7f7846d4d640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f784015ba50 0x7f78400b0ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:53958/0 (socket says 172.21.15.150:53958) 2024-09-17T05:43:31.980 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:31.977+0000 7f7846d4d640 1 -- 172.21.15.150:0/2043835291 learned_addr learned my addr 172.21.15.150:0/2043835291 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:43:31.980 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:31.977+0000 7f7845d4b640 1 --2- 172.21.15.150:0/2043835291 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f78400cc7d0 0x7f7840156870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:43:31.980 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:31.977+0000 7f784654c640 1 --2- 172.21.15.150:0/2043835291 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f784006f010 0x7f784009c070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:43:31.980 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:31.977+0000 7f7846d4d640 1 -- 172.21.15.150:0/2043835291 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f784006f010 msgr2=0x7f784009c070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:43:31.980 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:31.977+0000 7f7846d4d640 1 --2- 172.21.15.150:0/2043835291 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f784006f010 0x7f784009c070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:43:31.980 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:31.977+0000 7f7846d4d640 1 -- 172.21.15.150:0/2043835291 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f78400cc7d0 msgr2=0x7f7840156870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:43:31.980 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:31.977+0000 7f7846d4d640 1 --2- 172.21.15.150:0/2043835291 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f78400cc7d0 0x7f7840156870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:43:31.980 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:31.977+0000 7f7846d4d640 1 -- 172.21.15.150:0/2043835291 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f78401f7e30 con 0x7f784015ba50 2024-09-17T05:43:31.980 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:31.977+0000 7f784654c640 1 --2- 172.21.15.150:0/2043835291 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f784006f010 0x7f784009c070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:43:31.980 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:31.977+0000 7f7846d4d640 1 --2- 172.21.15.150:0/2043835291 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f784015ba50 0x7f78400b0ec0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f783000caa0 tx=0x7f783000cf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:43:31.980 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:31.977+0000 7f783effd640 1 -- 172.21.15.150:0/2043835291 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7830016020 con 0x7f784015ba50 2024-09-17T05:43:31.981 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:31.977+0000 7f783effd640 1 -- 172.21.15.150:0/2043835291 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f783000acf0 con 0x7f784015ba50 2024-09-17T05:43:31.981 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:31.977+0000 7f78487b0640 1 -- 172.21.15.150:0/2043835291 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f78401f7590 con 0x7f784015ba50 2024-09-17T05:43:31.981 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:31.977+0000 7f783effd640 1 -- 172.21.15.150:0/2043835291 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7830012680 con 0x7f784015ba50 2024-09-17T05:43:31.981 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:31.977+0000 7f78487b0640 1 -- 172.21.15.150:0/2043835291 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f78401f7b50 con 0x7f784015ba50 2024-09-17T05:43:31.981 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:31.978+0000 7f78487b0640 1 -- 172.21.15.150:0/2043835291 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f78400cbde0 con 0x7f784015ba50 2024-09-17T05:43:31.982 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:31.979+0000 7f783effd640 1 -- 172.21.15.150:0/2043835291 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 6) ==== 101492+0+0 (secure 0 0 0) 0x7f7830019020 con 0x7f784015ba50 2024-09-17T05:43:31.982 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:31.980+0000 7f783effd640 1 --2- 172.21.15.150:0/2043835291 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f782c078c20 0x7f782c07b130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:43:31.982 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:31.980+0000 7f783effd640 1 -- 172.21.15.150:0/2043835291 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7f783009b240 con 0x7f784015ba50 2024-09-17T05:43:31.982 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:31.980+0000 7f784654c640 1 --2- 172.21.15.150:0/2043835291 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f782c078c20 0x7f782c07b130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:43:31.982 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:31.980+0000 7f784654c640 1 --2- 172.21.15.150:0/2043835291 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f782c078c20 0x7f782c07b130 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f7838034000 tx=0x7f7838004730 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:43:31.984 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:31.984+0000 7f783effd640 1 -- 172.21.15.150:0/2043835291 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f7830020020 con 0x7f784015ba50 2024-09-17T05:43:32.188 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:32.187+0000 7f78487b0640 1 -- 172.21.15.150:0/2043835291 --> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "sub_name": "sv1", "group_name": "group1", "target": ["mon-mgr", ""]}) -- 0x7f78400b4720 con 0x7f782c078c20 2024-09-17T05:43:32.194 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:32.193+0000 7f783effd640 1 -- 172.21.15.150:0/2043835291 <== mgr.4108 v2:172.21.15.176:6800/3631216395 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+57 (secure 0 0 0) 0x7f78400b4720 con 0x7f782c078c20 2024-09-17T05:43:32.194 INFO:teuthology.orchestra.run.smithi150.stdout:/volumes/group1/sv1/7e00e3a9-c765-4d8a-9dbc-0871e9440c37 2024-09-17T05:43:32.197 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:32.195+0000 7f78487b0640 1 -- 172.21.15.150:0/2043835291 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f782c078c20 msgr2=0x7f782c07b130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:43:32.197 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:32.195+0000 7f78487b0640 1 --2- 172.21.15.150:0/2043835291 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f782c078c20 0x7f782c07b130 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f7838034000 tx=0x7f7838004730 comp rx=0 tx=0).stop 2024-09-17T05:43:32.197 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:32.195+0000 7f78487b0640 1 -- 172.21.15.150:0/2043835291 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f784015ba50 msgr2=0x7f78400b0ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:43:32.197 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:32.195+0000 7f78487b0640 1 --2- 172.21.15.150:0/2043835291 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f784015ba50 0x7f78400b0ec0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f783000caa0 tx=0x7f783000cf60 comp rx=0 tx=0).stop 2024-09-17T05:43:32.197 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:32.195+0000 7f78487b0640 1 -- 172.21.15.150:0/2043835291 shutdown_connections 2024-09-17T05:43:32.198 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:32.195+0000 7f78487b0640 1 --2- 172.21.15.150:0/2043835291 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f78400cc7d0 0x7f7840156870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:43:32.198 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:32.195+0000 7f78487b0640 1 --2- 172.21.15.150:0/2043835291 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f782c078c20 0x7f782c07b130 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:43:32.198 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:32.195+0000 7f78487b0640 1 --2- 172.21.15.150:0/2043835291 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f784015ba50 0x7f78400b0ec0 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:43:32.198 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:32.195+0000 7f78487b0640 1 --2- 172.21.15.150:0/2043835291 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f784006f010 0x7f784009c070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:43:32.198 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:32.195+0000 7f78487b0640 1 -- 172.21.15.150:0/2043835291 >> 172.21.15.150:0/2043835291 conn(0x7f78400b2540 msgr2=0x7f784006f420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:43:32.198 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:32.195+0000 7f78487b0640 1 -- 172.21.15.150:0/2043835291 shutdown_connections 2024-09-17T05:43:32.199 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:32.195+0000 7f78487b0640 1 -- 172.21.15.150:0/2043835291 wait complete. 2024-09-17T05:43:32.207 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:43:32.207 DEBUG:teuthology.orchestra.run.smithi150:> (cd /home/ubuntu/cephtest/mnt.0 && exec getfattr -n ceph.dir.rbytes volumes/group1/sv1/7e00e3a9-c765-4d8a-9dbc-0871e9440c37 2024-09-17T05:43:32.207 DEBUG:teuthology.orchestra.run.smithi150:> ) 2024-09-17T05:43:32.223 INFO:teuthology.orchestra.run.smithi150.stdout:# file: volumes/group1/sv1/7e00e3a9-c765-4d8a-9dbc-0871e9440c37 2024-09-17T05:43:32.224 INFO:teuthology.orchestra.run.smithi150.stdout:ceph.dir.rbytes="9990258688" 2024-09-17T05:43:32.224 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-09-17T05:43:32.224 INFO:tasks.cephfs.test_volumes:r_size = 9990258688 exp_size = 10737418240 2024-09-17T05:43:34.225 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:43:34.225 DEBUG:teuthology.orchestra.run.smithi150:> (cd /home/ubuntu/cephtest/mnt.0 && exec getfattr -n ceph.dir.rbytes volumes/group1/sv1/7e00e3a9-c765-4d8a-9dbc-0871e9440c37 2024-09-17T05:43:34.225 DEBUG:teuthology.orchestra.run.smithi150:> ) 2024-09-17T05:43:34.245 INFO:teuthology.orchestra.run.smithi150.stdout:# file: volumes/group1/sv1/7e00e3a9-c765-4d8a-9dbc-0871e9440c37 2024-09-17T05:43:34.246 INFO:teuthology.orchestra.run.smithi150.stdout:ceph.dir.rbytes="9990258688" 2024-09-17T05:43:34.246 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-09-17T05:43:34.246 INFO:tasks.cephfs.test_volumes:r_size = 9990258688 exp_size = 10737418240 2024-09-17T05:43:36.247 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:43:36.247 DEBUG:teuthology.orchestra.run.smithi150:> (cd /home/ubuntu/cephtest/mnt.0 && exec getfattr -n ceph.dir.rbytes volumes/group1/sv1/7e00e3a9-c765-4d8a-9dbc-0871e9440c37 2024-09-17T05:43:36.247 DEBUG:teuthology.orchestra.run.smithi150:> ) 2024-09-17T05:43:36.268 INFO:teuthology.orchestra.run.smithi150.stdout:# file: volumes/group1/sv1/7e00e3a9-c765-4d8a-9dbc-0871e9440c37 2024-09-17T05:43:36.268 INFO:teuthology.orchestra.run.smithi150.stdout:ceph.dir.rbytes="9990258688" 2024-09-17T05:43:36.268 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-09-17T05:43:36.268 INFO:tasks.cephfs.test_volumes:r_size = 9990258688 exp_size = 10737418240 2024-09-17T05:43:38.270 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:43:38.270 DEBUG:teuthology.orchestra.run.smithi150:> (cd /home/ubuntu/cephtest/mnt.0 && exec getfattr -n ceph.dir.rbytes volumes/group1/sv1/7e00e3a9-c765-4d8a-9dbc-0871e9440c37 2024-09-17T05:43:38.270 DEBUG:teuthology.orchestra.run.smithi150:> ) 2024-09-17T05:43:38.291 INFO:teuthology.orchestra.run.smithi150.stdout:# file: volumes/group1/sv1/7e00e3a9-c765-4d8a-9dbc-0871e9440c37 2024-09-17T05:43:38.291 INFO:teuthology.orchestra.run.smithi150.stdout:ceph.dir.rbytes="10737418240" 2024-09-17T05:43:38.291 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-09-17T05:43:38.292 INFO:tasks.cephfs.test_volumes:r_size = 10737418240 exp_size = 10737418240 2024-09-17T05:43:38.292 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume snapshot clone cephfs sv1 ss1 ss1clone1 --group-name group1 2024-09-17T05:43:38.468 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:38.467+0000 7f1ef3ab6640 1 -- 172.21.15.150:0/1140284995 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1ed8004e50 msgr2=0x7f1ed800b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:43:38.468 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:38.467+0000 7f1ef3ab6640 1 --2- 172.21.15.150:0/1140284995 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1ed8004e50 0x7f1ed800b9c0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f1ee4005fd0 tx=0x7f1ed8005830 comp rx=0 tx=0).stop 2024-09-17T05:43:38.468 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:38.467+0000 7f1ef2053640 1 -- 172.21.15.150:0/1140284995 reap_dead start 2024-09-17T05:43:38.468 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:38.467+0000 7f1ef3ab6640 1 -- 172.21.15.150:0/1140284995 shutdown_connections 2024-09-17T05:43:38.468 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:38.467+0000 7f1ef3ab6640 1 -- 172.21.15.150:0/1140284995 >> 172.21.15.150:0/1140284995 conn(0x7f1eec0b2ff0 msgr2=0x7f1eec0b3400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:43:38.468 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:38.467+0000 7f1ef3ab6640 1 -- 172.21.15.150:0/1140284995 shutdown_connections 2024-09-17T05:43:38.468 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:38.467+0000 7f1ef3ab6640 1 -- 172.21.15.150:0/1140284995 wait complete. 2024-09-17T05:43:38.469 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:38.469+0000 7f1ef3ab6640 1 Processor -- start 2024-09-17T05:43:38.469 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:38.469+0000 7f1ef3ab6640 1 -- start start 2024-09-17T05:43:38.472 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:38.470+0000 7f1ef3ab6640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1eec1d19d0 0x7f1eec1e4b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:43:38.472 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:38.470+0000 7f1ef3ab6640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1eec1f6920 0x7f1eec1f3980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:43:38.472 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:38.470+0000 7f1ef3ab6640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1eec1f6d30 0x7f1eec1f3ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:43:38.472 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:38.470+0000 7f1ef3ab6640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f1eec0cfe80 con 0x7f1eec1f6d30 2024-09-17T05:43:38.473 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:38.470+0000 7f1ef3ab6640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f1eec0cfd00 con 0x7f1eec1d19d0 2024-09-17T05:43:38.473 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:38.470+0000 7f1ef3ab6640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f1eec0d0000 con 0x7f1eec1f6920 2024-09-17T05:43:38.473 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:38.470+0000 7f1ef2053640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1eec1f6d30 0x7f1eec1f3ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:43:38.473 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:38.470+0000 7f1ef2053640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1eec1f6d30 0x7f1eec1f3ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:53982/0 (socket says 172.21.15.150:53982) 2024-09-17T05:43:38.473 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:38.470+0000 7f1ef2053640 1 -- 172.21.15.150:0/3141043467 learned_addr learned my addr 172.21.15.150:0/3141043467 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:43:38.473 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:38.470+0000 7f1ef1051640 1 --2- 172.21.15.150:0/3141043467 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1eec1f6920 0x7f1eec1f3980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:43:38.473 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:38.470+0000 7f1ef1852640 1 --2- 172.21.15.150:0/3141043467 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1eec1d19d0 0x7f1eec1e4b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:43:38.473 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:38.471+0000 7f1ef2053640 1 -- 172.21.15.150:0/3141043467 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1eec1f6920 msgr2=0x7f1eec1f3980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:43:38.473 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:38.471+0000 7f1ef2053640 1 --2- 172.21.15.150:0/3141043467 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1eec1f6920 0x7f1eec1f3980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:43:38.473 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:38.471+0000 7f1ef2053640 1 -- 172.21.15.150:0/3141043467 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1eec1d19d0 msgr2=0x7f1eec1e4b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:43:38.473 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:38.471+0000 7f1ef2053640 1 --2- 172.21.15.150:0/3141043467 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1eec1d19d0 0x7f1eec1e4b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:43:38.474 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:38.471+0000 7f1ef2053640 1 -- 172.21.15.150:0/3141043467 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1eec1e2090 con 0x7f1eec1f6d30 2024-09-17T05:43:38.474 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:38.471+0000 7f1ef2053640 1 --2- 172.21.15.150:0/3141043467 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1eec1f6d30 0x7f1eec1f3ec0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f1ee402aea0 tx=0x7f1ee4033b80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:43:38.474 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:38.471+0000 7f1ee27fc640 1 -- 172.21.15.150:0/3141043467 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ee4042070 con 0x7f1eec1f6d30 2024-09-17T05:43:38.474 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:38.471+0000 7f1ee27fc640 1 -- 172.21.15.150:0/3141043467 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f1ee4003970 con 0x7f1eec1f6d30 2024-09-17T05:43:38.474 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:38.471+0000 7f1ef3ab6640 1 -- 172.21.15.150:0/3141043467 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1eec1e27a0 con 0x7f1eec1f6d30 2024-09-17T05:43:38.474 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:38.471+0000 7f1ee27fc640 1 -- 172.21.15.150:0/3141043467 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ee4038040 con 0x7f1eec1f6d30 2024-09-17T05:43:38.474 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:38.471+0000 7f1ef3ab6640 1 -- 172.21.15.150:0/3141043467 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1eec1e1d10 con 0x7f1eec1f6d30 2024-09-17T05:43:38.474 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:38.472+0000 7f1ef3ab6640 1 -- 172.21.15.150:0/3141043467 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1eec1e2590 con 0x7f1eec1f6d30 2024-09-17T05:43:38.475 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:38.473+0000 7f1ee27fc640 1 -- 172.21.15.150:0/3141043467 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 6) ==== 101492+0+0 (secure 0 0 0) 0x7f1ee4004030 con 0x7f1eec1f6d30 2024-09-17T05:43:38.475 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:38.473+0000 7f1ee27fc640 1 --2- 172.21.15.150:0/3141043467 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f1ed0078c20 0x7f1ed007b130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:43:38.476 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:38.474+0000 7f1ee27fc640 1 -- 172.21.15.150:0/3141043467 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7f1ee40bb150 con 0x7f1eec1f6d30 2024-09-17T05:43:38.476 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:38.474+0000 7f1ef1852640 1 --2- 172.21.15.150:0/3141043467 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f1ed0078c20 0x7f1ed007b130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:43:38.476 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:38.474+0000 7f1ef1852640 1 --2- 172.21.15.150:0/3141043467 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f1ed0078c20 0x7f1ed007b130 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f1eec0d0f20 tx=0x7f1ee8006b10 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:43:38.478 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:38.478+0000 7f1ee27fc640 1 -- 172.21.15.150:0/3141043467 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f1ee4082ed0 con 0x7f1eec1f6d30 2024-09-17T05:43:38.687 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:38.686+0000 7f1ef3ab6640 1 -- 172.21.15.150:0/3141043467 --> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] -- mgr_command(tid 0: {"prefix": "fs subvolume snapshot clone", "vol_name": "cephfs", "sub_name": "sv1", "snap_name": "ss1", "target_sub_name": "ss1clone1", "group_name": "group1", "target": ["mon-mgr", ""]}) -- 0x7f1eec1e50b0 con 0x7f1ed0078c20 2024-09-17T05:43:38.750 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:38.749+0000 7f1ee27fc640 1 -- 172.21.15.150:0/3141043467 <== mgr.4108 v2:172.21.15.176:6800/3631216395 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f1ee8001620 con 0x7f1ed0078c20 2024-09-17T05:43:38.753 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:38.752+0000 7f1ef3ab6640 1 -- 172.21.15.150:0/3141043467 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f1ed0078c20 msgr2=0x7f1ed007b130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:43:38.753 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:38.752+0000 7f1ef3ab6640 1 --2- 172.21.15.150:0/3141043467 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f1ed0078c20 0x7f1ed007b130 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f1eec0d0f20 tx=0x7f1ee8006b10 comp rx=0 tx=0).stop 2024-09-17T05:43:38.753 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:38.752+0000 7f1ef3ab6640 1 -- 172.21.15.150:0/3141043467 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1eec1f6d30 msgr2=0x7f1eec1f3ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:43:38.753 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:38.752+0000 7f1ef3ab6640 1 --2- 172.21.15.150:0/3141043467 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1eec1f6d30 0x7f1eec1f3ec0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f1ee402aea0 tx=0x7f1ee4033b80 comp rx=0 tx=0).stop 2024-09-17T05:43:38.753 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:38.752+0000 7f1ef3ab6640 1 -- 172.21.15.150:0/3141043467 shutdown_connections 2024-09-17T05:43:38.753 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:38.752+0000 7f1ef3ab6640 1 --2- 172.21.15.150:0/3141043467 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f1ed0078c20 0x7f1ed007b130 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:43:38.753 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:38.752+0000 7f1ef3ab6640 1 --2- 172.21.15.150:0/3141043467 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1eec1f6d30 0x7f1eec1f3ec0 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:43:38.753 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:38.752+0000 7f1ef3ab6640 1 --2- 172.21.15.150:0/3141043467 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1eec1f6920 0x7f1eec1f3980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:43:38.753 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:38.752+0000 7f1ef3ab6640 1 --2- 172.21.15.150:0/3141043467 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1eec1d19d0 0x7f1eec1e4b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:43:38.753 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:38.752+0000 7f1ef3ab6640 1 -- 172.21.15.150:0/3141043467 >> 172.21.15.150:0/3141043467 conn(0x7f1eec0b2ff0 msgr2=0x7f1eec0b06c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:43:38.754 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:38.752+0000 7f1ef3ab6640 1 -- 172.21.15.150:0/3141043467 shutdown_connections 2024-09-17T05:43:38.754 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:38.752+0000 7f1ef3ab6640 1 -- 172.21.15.150:0/3141043467 wait complete. 2024-09-17T05:43:38.754 INFO:tasks.ceph.mgr.x.smithi176.stderr:2024-09-17T05:43:38.752+0000 7f33dc724640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-17T05:43:38.754 INFO:tasks.ceph.mgr.x.smithi176.stderr:2024-09-17T05:43:38.752+0000 7f33dc724640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-17T05:43:38.754 INFO:tasks.ceph.mgr.x.smithi176.stderr:2024-09-17T05:43:38.752+0000 7f33dc724640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-17T05:43:38.754 INFO:tasks.ceph.mgr.x.smithi176.stderr:2024-09-17T05:43:38.752+0000 7f33dc724640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-17T05:43:38.754 INFO:tasks.ceph.mgr.x.smithi176.stderr:2024-09-17T05:43:38.752+0000 7f33dc724640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-17T05:43:38.765 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format json-pretty 2024-09-17T05:43:38.771 INFO:tasks.ceph.mgr.x.smithi176.stderr:2024-09-17T05:43:38.770+0000 7f33dbf23640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-17T05:43:38.771 INFO:tasks.ceph.mgr.x.smithi176.stderr:2024-09-17T05:43:38.770+0000 7f33dbf23640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-17T05:43:38.771 INFO:tasks.ceph.mgr.x.smithi176.stderr:2024-09-17T05:43:38.770+0000 7f33dbf23640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-17T05:43:38.771 INFO:tasks.ceph.mgr.x.smithi176.stderr:2024-09-17T05:43:38.770+0000 7f33dbf23640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-17T05:43:38.771 INFO:tasks.ceph.mgr.x.smithi176.stderr:2024-09-17T05:43:38.770+0000 7f33dbf23640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-17T05:43:38.884 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:38.883+0000 7f7d6510b640 1 -- 172.21.15.150:0/476270874 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7d48003a50 msgr2=0x7f7d48003ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:43:38.884 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:38.883+0000 7f7d6510b640 1 --2- 172.21.15.150:0/476270874 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7d48003a50 0x7f7d48003ec0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f7d58006fc0 tx=0x7f7d48005830 comp rx=0 tx=0).stop 2024-09-17T05:43:38.884 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:38.883+0000 7f7d6510b640 1 -- 172.21.15.150:0/476270874 shutdown_connections 2024-09-17T05:43:38.884 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:38.883+0000 7f7d6510b640 1 --2- 172.21.15.150:0/476270874 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7d48003a50 0x7f7d48003ec0 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:43:38.884 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:38.883+0000 7f7d6510b640 1 -- 172.21.15.150:0/476270874 >> 172.21.15.150:0/476270874 conn(0x7f7d600d4680 msgr2=0x7f7d600d4a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:43:38.884 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:38.883+0000 7f7d6510b640 1 -- 172.21.15.150:0/476270874 shutdown_connections 2024-09-17T05:43:38.885 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:38.883+0000 7f7d6510b640 1 -- 172.21.15.150:0/476270874 wait complete. 2024-09-17T05:43:38.886 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:38.885+0000 7f7d6510b640 1 Processor -- start 2024-09-17T05:43:38.886 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:38.885+0000 7f7d6510b640 1 -- start start 2024-09-17T05:43:38.889 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:38.887+0000 7f7d6510b640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7d48003a50 0x7f7d60156da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:43:38.889 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:38.887+0000 7f7d6510b640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7d60150510 0x7f7d6015f520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:43:38.890 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:38.887+0000 7f7d6510b640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7d6015fa60 0x7f7d601f8de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:43:38.890 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:38.887+0000 7f7d6510b640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f7d6015f3a0 con 0x7f7d6015fa60 2024-09-17T05:43:38.890 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:38.887+0000 7f7d6510b640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f7d6015f220 con 0x7f7d48003a50 2024-09-17T05:43:38.890 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:38.887+0000 7f7d6510b640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f7d600d1090 con 0x7f7d60150510 2024-09-17T05:43:38.890 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:38.887+0000 7f7d5f59e640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7d6015fa60 0x7f7d601f8de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:43:38.890 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:38.887+0000 7f7d5f59e640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7d6015fa60 0x7f7d601f8de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:53998/0 (socket says 172.21.15.150:53998) 2024-09-17T05:43:38.890 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:38.887+0000 7f7d5f59e640 1 -- 172.21.15.150:0/1481053832 learned_addr learned my addr 172.21.15.150:0/1481053832 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:43:38.890 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:38.887+0000 7f7d5ed9d640 1 --2- 172.21.15.150:0/1481053832 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7d48003a50 0x7f7d60156da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:43:38.890 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:38.887+0000 7f7d5e59c640 1 --2- 172.21.15.150:0/1481053832 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7d60150510 0x7f7d6015f520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:43:38.890 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:38.887+0000 7f7d5f59e640 1 -- 172.21.15.150:0/1481053832 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7d60150510 msgr2=0x7f7d6015f520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:43:38.890 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:38.887+0000 7f7d5f59e640 1 --2- 172.21.15.150:0/1481053832 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7d60150510 0x7f7d6015f520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:43:38.890 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:38.887+0000 7f7d5f59e640 1 -- 172.21.15.150:0/1481053832 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7d48003a50 msgr2=0x7f7d60156da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:43:38.891 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:38.887+0000 7f7d5f59e640 1 --2- 172.21.15.150:0/1481053832 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7d48003a50 0x7f7d60156da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:43:38.891 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:38.887+0000 7f7d5f59e640 1 -- 172.21.15.150:0/1481053832 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7d60162590 con 0x7f7d6015fa60 2024-09-17T05:43:38.891 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:38.887+0000 7f7d5ed9d640 1 --2- 172.21.15.150:0/1481053832 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7d48003a50 0x7f7d60156da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T05:43:38.891 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:38.887+0000 7f7d5f59e640 1 --2- 172.21.15.150:0/1481053832 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7d6015fa60 0x7f7d601f8de0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f7d600a2620 tx=0x7f7d50011b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:43:38.891 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:38.887+0000 7f7d477fe640 1 -- 172.21.15.150:0/1481053832 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d5001f070 con 0x7f7d6015fa60 2024-09-17T05:43:38.891 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:38.887+0000 7f7d477fe640 1 -- 172.21.15.150:0/1481053832 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f7d5000faa0 con 0x7f7d6015fa60 2024-09-17T05:43:38.891 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:38.887+0000 7f7d6510b640 1 -- 172.21.15.150:0/1481053832 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7d601e8a90 con 0x7f7d6015fa60 2024-09-17T05:43:38.891 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:38.887+0000 7f7d477fe640 1 -- 172.21.15.150:0/1481053832 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d50012450 con 0x7f7d6015fa60 2024-09-17T05:43:38.891 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:38.888+0000 7f7d6510b640 1 -- 172.21.15.150:0/1481053832 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7d601622b0 con 0x7f7d6015fa60 2024-09-17T05:43:38.891 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:38.889+0000 7f7d6510b640 1 -- 172.21.15.150:0/1481053832 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7d6006a610 con 0x7f7d6015fa60 2024-09-17T05:43:38.892 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:38.889+0000 7f7d477fe640 1 -- 172.21.15.150:0/1481053832 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 6) ==== 101492+0+0 (secure 0 0 0) 0x7f7d50022070 con 0x7f7d6015fa60 2024-09-17T05:43:38.892 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:38.890+0000 7f7d477fe640 1 --2- 172.21.15.150:0/1481053832 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f7d4c078c20 0x7f7d4c07b130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:43:38.892 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:38.890+0000 7f7d5ed9d640 1 --2- 172.21.15.150:0/1481053832 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f7d4c078c20 0x7f7d4c07b130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:43:38.892 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:38.890+0000 7f7d477fe640 1 -- 172.21.15.150:0/1481053832 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7f7d5009b640 con 0x7f7d6015fa60 2024-09-17T05:43:38.892 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:38.891+0000 7f7d5ed9d640 1 --2- 172.21.15.150:0/1481053832 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f7d4c078c20 0x7f7d4c07b130 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f7d58033000 tx=0x7f7d600b3fd0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:43:38.895 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:38.895+0000 7f7d477fe640 1 -- 172.21.15.150:0/1481053832 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f7d6006a610 con 0x7f7d6015fa60 2024-09-17T05:43:39.138 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:39.137+0000 7f7d6510b640 1 -- 172.21.15.150:0/1481053832 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) -- 0x7f7d600d15f0 con 0x7f7d6015fa60 2024-09-17T05:43:39.138 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:39.138+0000 7f7d477fe640 1 -- 172.21.15.150:0/1481053832 <== mon.0 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) ==== 79+0+2335 (secure 0 0 0) 0x7f7d601e8a90 con 0x7f7d6015fa60 2024-09-17T05:43:39.138 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-09-17T05:43:39.139 INFO:teuthology.orchestra.run.smithi150.stdout:{ 2024-09-17T05:43:39.139 INFO:teuthology.orchestra.run.smithi150.stdout: "fsid": "9f2e05e9-d629-47b3-b26b-1360655b7d20", 2024-09-17T05:43:39.139 INFO:teuthology.orchestra.run.smithi150.stdout: "health": { 2024-09-17T05:43:39.139 INFO:teuthology.orchestra.run.smithi150.stdout: "status": "HEALTH_OK", 2024-09-17T05:43:39.139 INFO:teuthology.orchestra.run.smithi150.stdout: "checks": {}, 2024-09-17T05:43:39.139 INFO:teuthology.orchestra.run.smithi150.stdout: "mutes": [] 2024-09-17T05:43:39.139 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-17T05:43:39.139 INFO:teuthology.orchestra.run.smithi150.stdout: "election_epoch": 4, 2024-09-17T05:43:39.139 INFO:teuthology.orchestra.run.smithi150.stdout: "quorum": [ 2024-09-17T05:43:39.139 INFO:teuthology.orchestra.run.smithi150.stdout: 0, 2024-09-17T05:43:39.139 INFO:teuthology.orchestra.run.smithi150.stdout: 1, 2024-09-17T05:43:39.139 INFO:teuthology.orchestra.run.smithi150.stdout: 2 2024-09-17T05:43:39.140 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2024-09-17T05:43:39.140 INFO:teuthology.orchestra.run.smithi150.stdout: "quorum_names": [ 2024-09-17T05:43:39.140 INFO:teuthology.orchestra.run.smithi150.stdout: "a", 2024-09-17T05:43:39.140 INFO:teuthology.orchestra.run.smithi150.stdout: "b", 2024-09-17T05:43:39.140 INFO:teuthology.orchestra.run.smithi150.stdout: "c" 2024-09-17T05:43:39.140 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2024-09-17T05:43:39.140 INFO:teuthology.orchestra.run.smithi150.stdout: "quorum_age": 126, 2024-09-17T05:43:39.140 INFO:teuthology.orchestra.run.smithi150.stdout: "monmap": { 2024-09-17T05:43:39.140 INFO:teuthology.orchestra.run.smithi150.stdout: "epoch": 1, 2024-09-17T05:43:39.140 INFO:teuthology.orchestra.run.smithi150.stdout: "min_mon_release_name": "squid", 2024-09-17T05:43:39.140 INFO:teuthology.orchestra.run.smithi150.stdout: "num_mons": 3 2024-09-17T05:43:39.140 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-17T05:43:39.140 INFO:teuthology.orchestra.run.smithi150.stdout: "osdmap": { 2024-09-17T05:43:39.141 INFO:teuthology.orchestra.run.smithi150.stdout: "epoch": 34, 2024-09-17T05:43:39.141 INFO:teuthology.orchestra.run.smithi150.stdout: "num_osds": 8, 2024-09-17T05:43:39.141 INFO:teuthology.orchestra.run.smithi150.stdout: "num_up_osds": 8, 2024-09-17T05:43:39.141 INFO:teuthology.orchestra.run.smithi150.stdout: "osd_up_since": 1726551706, 2024-09-17T05:43:39.141 INFO:teuthology.orchestra.run.smithi150.stdout: "num_in_osds": 8, 2024-09-17T05:43:39.141 INFO:teuthology.orchestra.run.smithi150.stdout: "osd_in_since": 1726551696, 2024-09-17T05:43:39.141 INFO:teuthology.orchestra.run.smithi150.stdout: "num_remapped_pgs": 0 2024-09-17T05:43:39.142 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-17T05:43:39.142 INFO:teuthology.orchestra.run.smithi150.stdout: "pgmap": { 2024-09-17T05:43:39.142 INFO:teuthology.orchestra.run.smithi150.stdout: "pgs_by_state": [ 2024-09-17T05:43:39.142 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-09-17T05:43:39.142 INFO:teuthology.orchestra.run.smithi150.stdout: "state_name": "active+clean", 2024-09-17T05:43:39.142 INFO:teuthology.orchestra.run.smithi150.stdout: "count": 97 2024-09-17T05:43:39.142 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-09-17T05:43:39.142 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2024-09-17T05:43:39.142 INFO:teuthology.orchestra.run.smithi150.stdout: "num_pgs": 97, 2024-09-17T05:43:39.142 INFO:teuthology.orchestra.run.smithi150.stdout: "num_pools": 3, 2024-09-17T05:43:39.142 INFO:teuthology.orchestra.run.smithi150.stdout: "num_objects": 2585, 2024-09-17T05:43:39.142 INFO:teuthology.orchestra.run.smithi150.stdout: "data_bytes": 10738478013, 2024-09-17T05:43:39.142 INFO:teuthology.orchestra.run.smithi150.stdout: "bytes_used": 21718466560, 2024-09-17T05:43:39.142 INFO:teuthology.orchestra.run.smithi150.stdout: "bytes_avail": 751375646720, 2024-09-17T05:43:39.143 INFO:teuthology.orchestra.run.smithi150.stdout: "bytes_total": 773094113280, 2024-09-17T05:43:39.143 INFO:teuthology.orchestra.run.smithi150.stdout: "write_bytes_sec": 264851508, 2024-09-17T05:43:39.143 INFO:teuthology.orchestra.run.smithi150.stdout: "read_op_per_sec": 0, 2024-09-17T05:43:39.143 INFO:teuthology.orchestra.run.smithi150.stdout: "write_op_per_sec": 67 2024-09-17T05:43:39.143 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-17T05:43:39.143 INFO:teuthology.orchestra.run.smithi150.stdout: "fsmap": { 2024-09-17T05:43:39.143 INFO:teuthology.orchestra.run.smithi150.stdout: "epoch": 16, 2024-09-17T05:43:39.143 INFO:teuthology.orchestra.run.smithi150.stdout: "btime": "2024-09-17T05:42:51:051729+0000", 2024-09-17T05:43:39.143 INFO:teuthology.orchestra.run.smithi150.stdout: "id": 2, 2024-09-17T05:43:39.143 INFO:teuthology.orchestra.run.smithi150.stdout: "up": 1, 2024-09-17T05:43:39.143 INFO:teuthology.orchestra.run.smithi150.stdout: "in": 1, 2024-09-17T05:43:39.143 INFO:teuthology.orchestra.run.smithi150.stdout: "max": 1, 2024-09-17T05:43:39.143 INFO:teuthology.orchestra.run.smithi150.stdout: "by_rank": [ 2024-09-17T05:43:39.144 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-09-17T05:43:39.144 INFO:teuthology.orchestra.run.smithi150.stdout: "filesystem_id": 2, 2024-09-17T05:43:39.144 INFO:teuthology.orchestra.run.smithi150.stdout: "rank": 0, 2024-09-17T05:43:39.144 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "a", 2024-09-17T05:43:39.144 INFO:teuthology.orchestra.run.smithi150.stdout: "status": "up:active", 2024-09-17T05:43:39.144 INFO:teuthology.orchestra.run.smithi150.stdout: "gid": 4938 2024-09-17T05:43:39.144 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-09-17T05:43:39.144 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2024-09-17T05:43:39.145 INFO:teuthology.orchestra.run.smithi150.stdout: "up:standby": 3 2024-09-17T05:43:39.145 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-17T05:43:39.145 INFO:teuthology.orchestra.run.smithi150.stdout: "mgrmap": { 2024-09-17T05:43:39.145 INFO:teuthology.orchestra.run.smithi150.stdout: "available": true, 2024-09-17T05:43:39.145 INFO:teuthology.orchestra.run.smithi150.stdout: "num_standbys": 1, 2024-09-17T05:43:39.145 INFO:teuthology.orchestra.run.smithi150.stdout: "modules": [ 2024-09-17T05:43:39.145 INFO:teuthology.orchestra.run.smithi150.stdout: "iostat", 2024-09-17T05:43:39.145 INFO:teuthology.orchestra.run.smithi150.stdout: "nfs", 2024-09-17T05:43:39.145 INFO:teuthology.orchestra.run.smithi150.stdout: "restful" 2024-09-17T05:43:39.146 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2024-09-17T05:43:39.146 INFO:teuthology.orchestra.run.smithi150.stdout: "services": {} 2024-09-17T05:43:39.146 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-17T05:43:39.146 INFO:teuthology.orchestra.run.smithi150.stdout: "servicemap": { 2024-09-17T05:43:39.146 INFO:teuthology.orchestra.run.smithi150.stdout: "epoch": 7, 2024-09-17T05:43:39.146 INFO:teuthology.orchestra.run.smithi150.stdout: "modified": "2024-09-17T05:43:34.869904+0000", 2024-09-17T05:43:39.146 INFO:teuthology.orchestra.run.smithi150.stdout: "services": { 2024-09-17T05:43:39.146 INFO:teuthology.orchestra.run.smithi150.stdout: "mds": { 2024-09-17T05:43:39.146 INFO:teuthology.orchestra.run.smithi150.stdout: "daemons": { 2024-09-17T05:43:39.146 INFO:teuthology.orchestra.run.smithi150.stdout: "summary": "", 2024-09-17T05:43:39.146 INFO:teuthology.orchestra.run.smithi150.stdout: "a": { 2024-09-17T05:43:39.146 INFO:teuthology.orchestra.run.smithi150.stdout: "start_epoch": 0, 2024-09-17T05:43:39.146 INFO:teuthology.orchestra.run.smithi150.stdout: "start_stamp": "0.000000", 2024-09-17T05:43:39.147 INFO:teuthology.orchestra.run.smithi150.stdout: "gid": 0, 2024-09-17T05:43:39.147 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "(unrecognized address family 0)/0", 2024-09-17T05:43:39.147 INFO:teuthology.orchestra.run.smithi150.stdout: "metadata": {}, 2024-09-17T05:43:39.147 INFO:teuthology.orchestra.run.smithi150.stdout: "task_status": {} 2024-09-17T05:43:39.147 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-09-17T05:43:39.147 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-09-17T05:43:39.147 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-09-17T05:43:39.147 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-09-17T05:43:39.147 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-17T05:43:39.147 INFO:teuthology.orchestra.run.smithi150.stdout: "progress_events": {} 2024-09-17T05:43:39.147 INFO:teuthology.orchestra.run.smithi150.stdout:} 2024-09-17T05:43:39.148 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:39.140+0000 7f7d6510b640 1 -- 172.21.15.150:0/1481053832 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f7d4c078c20 msgr2=0x7f7d4c07b130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:43:39.148 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:39.140+0000 7f7d6510b640 1 --2- 172.21.15.150:0/1481053832 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f7d4c078c20 0x7f7d4c07b130 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f7d58033000 tx=0x7f7d600b3fd0 comp rx=0 tx=0).stop 2024-09-17T05:43:39.148 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:39.140+0000 7f7d6510b640 1 -- 172.21.15.150:0/1481053832 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7d6015fa60 msgr2=0x7f7d601f8de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:43:39.149 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:39.140+0000 7f7d6510b640 1 --2- 172.21.15.150:0/1481053832 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7d6015fa60 0x7f7d601f8de0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f7d600a2620 tx=0x7f7d50011b30 comp rx=0 tx=0).stop 2024-09-17T05:43:39.149 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:39.140+0000 7f7d6510b640 1 -- 172.21.15.150:0/1481053832 shutdown_connections 2024-09-17T05:43:39.149 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:39.140+0000 7f7d6510b640 1 --2- 172.21.15.150:0/1481053832 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f7d4c078c20 0x7f7d4c07b130 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:43:39.149 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:39.140+0000 7f7d6510b640 1 --2- 172.21.15.150:0/1481053832 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7d6015fa60 0x7f7d601f8de0 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:43:39.149 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:39.140+0000 7f7d6510b640 1 --2- 172.21.15.150:0/1481053832 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7d60150510 0x7f7d6015f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:43:39.149 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:39.140+0000 7f7d6510b640 1 --2- 172.21.15.150:0/1481053832 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7d48003a50 0x7f7d60156da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:43:39.149 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:39.140+0000 7f7d6510b640 1 -- 172.21.15.150:0/1481053832 >> 172.21.15.150:0/1481053832 conn(0x7f7d600d4680 msgr2=0x7f7d601595d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:43:39.149 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:39.140+0000 7f7d6510b640 1 -- 172.21.15.150:0/1481053832 shutdown_connections 2024-09-17T05:43:39.149 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:39.140+0000 7f7d6510b640 1 -- 172.21.15.150:0/1481053832 wait complete. 2024-09-17T05:43:39.758 INFO:tasks.ceph.mgr.x.smithi176.stderr:2024-09-17T05:43:39.757+0000 7f33cd686640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-17T05:43:39.758 INFO:tasks.ceph.mgr.x.smithi176.stderr:2024-09-17T05:43:39.757+0000 7f33cd686640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-17T05:43:39.758 INFO:tasks.ceph.mgr.x.smithi176.stderr:2024-09-17T05:43:39.757+0000 7f33cd686640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-17T05:43:39.758 INFO:tasks.ceph.mgr.x.smithi176.stderr:2024-09-17T05:43:39.757+0000 7f33cd686640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-17T05:43:39.758 INFO:tasks.ceph.mgr.x.smithi176.stderr:2024-09-17T05:43:39.757+0000 7f33cd686640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-17T05:43:40.153 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format json-pretty 2024-09-17T05:43:40.331 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:40.330+0000 7fcbc6919640 1 -- 172.21.15.150:0/1816267615 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fcba8004800 msgr2=0x7fcba8004c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:43:40.332 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:40.330+0000 7fcbc6919640 1 --2- 172.21.15.150:0/1816267615 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fcba8004800 0x7fcba8004c10 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7fcbb400c310 tx=0x7fcba8005830 comp rx=0 tx=0).stop 2024-09-17T05:43:40.332 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:40.331+0000 7fcbc6919640 1 -- 172.21.15.150:0/1816267615 shutdown_connections 2024-09-17T05:43:40.332 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:40.331+0000 7fcbc6919640 1 --2- 172.21.15.150:0/1816267615 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fcba8004800 0x7fcba8004c10 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:43:40.332 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:40.331+0000 7fcbc6919640 1 -- 172.21.15.150:0/1816267615 >> 172.21.15.150:0/1816267615 conn(0x7fcbc0073890 msgr2=0x7fcbc0073ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:43:40.332 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:40.331+0000 7fcbc6919640 1 -- 172.21.15.150:0/1816267615 shutdown_connections 2024-09-17T05:43:40.332 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:40.331+0000 7fcbc6919640 1 -- 172.21.15.150:0/1816267615 wait complete. 2024-09-17T05:43:40.333 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:40.333+0000 7fcbc6919640 1 Processor -- start 2024-09-17T05:43:40.333 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:40.333+0000 7fcbc6919640 1 -- start start 2024-09-17T05:43:40.337 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:40.335+0000 7fcbc6919640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fcba8004800 0x7fcbc01f71a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:43:40.337 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:40.335+0000 7fcbc6919640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fcbc00c5b60 0x7fcbc01422b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:43:40.337 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:40.335+0000 7fcbc6919640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fcbc01427f0 0x7fcbc01f2450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:43:40.337 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:40.335+0000 7fcbc6919640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7fcbc0076100 con 0x7fcbc01427f0 2024-09-17T05:43:40.337 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:40.335+0000 7fcbc6919640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fcbc0075f80 con 0x7fcbc00c5b60 2024-09-17T05:43:40.337 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:40.335+0000 7fcbc6919640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fcbc0076280 con 0x7fcba8004800 2024-09-17T05:43:40.337 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:40.335+0000 7fcbc4eb6640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fcbc01427f0 0x7fcbc01f2450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:43:40.337 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:40.335+0000 7fcbc4eb6640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fcbc01427f0 0x7fcbc01f2450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:43700/0 (socket says 172.21.15.150:43700) 2024-09-17T05:43:40.338 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:40.335+0000 7fcbc4eb6640 1 -- 172.21.15.150:0/2341615606 learned_addr learned my addr 172.21.15.150:0/2341615606 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:43:40.338 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:40.336+0000 7fcbbf7fe640 1 --2- 172.21.15.150:0/2341615606 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fcbc00c5b60 0x7fcbc01422b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:43:40.338 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:40.336+0000 7fcbc4eb6640 1 -- 172.21.15.150:0/2341615606 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fcba8004800 msgr2=0x7fcbc01f71a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:43:40.338 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:40.336+0000 7fcbc4eb6640 1 --2- 172.21.15.150:0/2341615606 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fcba8004800 0x7fcbc01f71a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:43:40.338 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:40.336+0000 7fcbc4eb6640 1 -- 172.21.15.150:0/2341615606 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fcbc00c5b60 msgr2=0x7fcbc01422b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:43:40.338 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:40.336+0000 7fcbc4eb6640 1 --2- 172.21.15.150:0/2341615606 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fcbc00c5b60 0x7fcbc01422b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:43:40.338 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:40.336+0000 7fcbc4eb6640 1 -- 172.21.15.150:0/2341615606 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcbc0134c80 con 0x7fcbc01427f0 2024-09-17T05:43:40.338 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:40.336+0000 7fcbbf7fe640 1 --2- 172.21.15.150:0/2341615606 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fcbc00c5b60 0x7fcbc01422b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T05:43:40.338 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:40.336+0000 7fcbc4eb6640 1 --2- 172.21.15.150:0/2341615606 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fcbc01427f0 0x7fcbc01f2450 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7fcbb8005fd0 tx=0x7fcbb800d7b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:43:40.338 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:40.336+0000 7fcbbcff9640 1 -- 172.21.15.150:0/2341615606 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcbb801c070 con 0x7fcbc01427f0 2024-09-17T05:43:40.339 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:40.336+0000 7fcbc6919640 1 -- 172.21.15.150:0/2341615606 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcbc00c62d0 con 0x7fcbc01427f0 2024-09-17T05:43:40.339 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:40.336+0000 7fcbbcff9640 1 -- 172.21.15.150:0/2341615606 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fcbb800de20 con 0x7fcbc01427f0 2024-09-17T05:43:40.339 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:40.336+0000 7fcbc6919640 1 -- 172.21.15.150:0/2341615606 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcbc00c6890 con 0x7fcbc01427f0 2024-09-17T05:43:40.339 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:40.336+0000 7fcbbcff9640 1 -- 172.21.15.150:0/2341615606 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcbb800c840 con 0x7fcbc01427f0 2024-09-17T05:43:40.339 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:40.338+0000 7fcbc6919640 1 -- 172.21.15.150:0/2341615606 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcba0005290 con 0x7fcbc01427f0 2024-09-17T05:43:40.339 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:40.338+0000 7fcbbcff9640 1 -- 172.21.15.150:0/2341615606 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 7) ==== 101594+0+0 (secure 0 0 0) 0x7fcbb801f070 con 0x7fcbc01427f0 2024-09-17T05:43:40.340 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:40.339+0000 7fcbbcff9640 1 --2- 172.21.15.150:0/2341615606 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fcbac078d70 0x7fcbac07b280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:43:40.340 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:40.340+0000 7fcbbcff9640 1 -- 172.21.15.150:0/2341615606 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7fcbb809b8a0 con 0x7fcbc01427f0 2024-09-17T05:43:40.340 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:40.340+0000 7fcbbffff640 1 --2- 172.21.15.150:0/2341615606 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fcbac078d70 0x7fcbac07b280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:43:40.342 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:40.341+0000 7fcbbffff640 1 --2- 172.21.15.150:0/2341615606 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fcbac078d70 0x7fcbac07b280 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fcbb0006fd0 tx=0x7fcbb0006890 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:43:40.348 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:40.347+0000 7fcbbcff9640 1 -- 172.21.15.150:0/2341615606 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fcbb800ee20 con 0x7fcbc01427f0 2024-09-17T05:43:40.722 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:40.721+0000 7fcbc6919640 1 -- 172.21.15.150:0/2341615606 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) -- 0x7fcba0005850 con 0x7fcbc01427f0 2024-09-17T05:43:40.722 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:40.721+0000 7fcbbcff9640 1 -- 172.21.15.150:0/2341615606 <== mon.0 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) ==== 79+0+2335 (secure 0 0 0) 0x7fcbb80639e0 con 0x7fcbc01427f0 2024-09-17T05:43:40.722 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-09-17T05:43:40.722 INFO:teuthology.orchestra.run.smithi150.stdout:{ 2024-09-17T05:43:40.722 INFO:teuthology.orchestra.run.smithi150.stdout: "fsid": "9f2e05e9-d629-47b3-b26b-1360655b7d20", 2024-09-17T05:43:40.723 INFO:teuthology.orchestra.run.smithi150.stdout: "health": { 2024-09-17T05:43:40.723 INFO:teuthology.orchestra.run.smithi150.stdout: "status": "HEALTH_OK", 2024-09-17T05:43:40.723 INFO:teuthology.orchestra.run.smithi150.stdout: "checks": {}, 2024-09-17T05:43:40.723 INFO:teuthology.orchestra.run.smithi150.stdout: "mutes": [] 2024-09-17T05:43:40.723 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-17T05:43:40.723 INFO:teuthology.orchestra.run.smithi150.stdout: "election_epoch": 4, 2024-09-17T05:43:40.723 INFO:teuthology.orchestra.run.smithi150.stdout: "quorum": [ 2024-09-17T05:43:40.723 INFO:teuthology.orchestra.run.smithi150.stdout: 0, 2024-09-17T05:43:40.723 INFO:teuthology.orchestra.run.smithi150.stdout: 1, 2024-09-17T05:43:40.723 INFO:teuthology.orchestra.run.smithi150.stdout: 2 2024-09-17T05:43:40.723 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2024-09-17T05:43:40.723 INFO:teuthology.orchestra.run.smithi150.stdout: "quorum_names": [ 2024-09-17T05:43:40.723 INFO:teuthology.orchestra.run.smithi150.stdout: "a", 2024-09-17T05:43:40.724 INFO:teuthology.orchestra.run.smithi150.stdout: "b", 2024-09-17T05:43:40.724 INFO:teuthology.orchestra.run.smithi150.stdout: "c" 2024-09-17T05:43:40.724 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2024-09-17T05:43:40.724 INFO:teuthology.orchestra.run.smithi150.stdout: "quorum_age": 128, 2024-09-17T05:43:40.724 INFO:teuthology.orchestra.run.smithi150.stdout: "monmap": { 2024-09-17T05:43:40.724 INFO:teuthology.orchestra.run.smithi150.stdout: "epoch": 1, 2024-09-17T05:43:40.724 INFO:teuthology.orchestra.run.smithi150.stdout: "min_mon_release_name": "squid", 2024-09-17T05:43:40.724 INFO:teuthology.orchestra.run.smithi150.stdout: "num_mons": 3 2024-09-17T05:43:40.724 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-17T05:43:40.724 INFO:teuthology.orchestra.run.smithi150.stdout: "osdmap": { 2024-09-17T05:43:40.724 INFO:teuthology.orchestra.run.smithi150.stdout: "epoch": 34, 2024-09-17T05:43:40.724 INFO:teuthology.orchestra.run.smithi150.stdout: "num_osds": 8, 2024-09-17T05:43:40.724 INFO:teuthology.orchestra.run.smithi150.stdout: "num_up_osds": 8, 2024-09-17T05:43:40.725 INFO:teuthology.orchestra.run.smithi150.stdout: "osd_up_since": 1726551706, 2024-09-17T05:43:40.725 INFO:teuthology.orchestra.run.smithi150.stdout: "num_in_osds": 8, 2024-09-17T05:43:40.725 INFO:teuthology.orchestra.run.smithi150.stdout: "osd_in_since": 1726551696, 2024-09-17T05:43:40.725 INFO:teuthology.orchestra.run.smithi150.stdout: "num_remapped_pgs": 0 2024-09-17T05:43:40.725 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-17T05:43:40.725 INFO:teuthology.orchestra.run.smithi150.stdout: "pgmap": { 2024-09-17T05:43:40.725 INFO:teuthology.orchestra.run.smithi150.stdout: "pgs_by_state": [ 2024-09-17T05:43:40.725 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-09-17T05:43:40.725 INFO:teuthology.orchestra.run.smithi150.stdout: "state_name": "active+clean", 2024-09-17T05:43:40.725 INFO:teuthology.orchestra.run.smithi150.stdout: "count": 97 2024-09-17T05:43:40.725 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-09-17T05:43:40.725 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2024-09-17T05:43:40.725 INFO:teuthology.orchestra.run.smithi150.stdout: "num_pgs": 97, 2024-09-17T05:43:40.725 INFO:teuthology.orchestra.run.smithi150.stdout: "num_pools": 3, 2024-09-17T05:43:40.726 INFO:teuthology.orchestra.run.smithi150.stdout: "num_objects": 2585, 2024-09-17T05:43:40.726 INFO:teuthology.orchestra.run.smithi150.stdout: "data_bytes": 10738478013, 2024-09-17T05:43:40.726 INFO:teuthology.orchestra.run.smithi150.stdout: "bytes_used": 21718466560, 2024-09-17T05:43:40.726 INFO:teuthology.orchestra.run.smithi150.stdout: "bytes_avail": 751375646720, 2024-09-17T05:43:40.726 INFO:teuthology.orchestra.run.smithi150.stdout: "bytes_total": 773094113280, 2024-09-17T05:43:40.726 INFO:teuthology.orchestra.run.smithi150.stdout: "write_bytes_sec": 188328371, 2024-09-17T05:43:40.726 INFO:teuthology.orchestra.run.smithi150.stdout: "read_op_per_sec": 0, 2024-09-17T05:43:40.726 INFO:teuthology.orchestra.run.smithi150.stdout: "write_op_per_sec": 47 2024-09-17T05:43:40.726 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-17T05:43:40.726 INFO:teuthology.orchestra.run.smithi150.stdout: "fsmap": { 2024-09-17T05:43:40.726 INFO:teuthology.orchestra.run.smithi150.stdout: "epoch": 16, 2024-09-17T05:43:40.726 INFO:teuthology.orchestra.run.smithi150.stdout: "btime": "2024-09-17T05:42:51:051729+0000", 2024-09-17T05:43:40.726 INFO:teuthology.orchestra.run.smithi150.stdout: "id": 2, 2024-09-17T05:43:40.726 INFO:teuthology.orchestra.run.smithi150.stdout: "up": 1, 2024-09-17T05:43:40.727 INFO:teuthology.orchestra.run.smithi150.stdout: "in": 1, 2024-09-17T05:43:40.727 INFO:teuthology.orchestra.run.smithi150.stdout: "max": 1, 2024-09-17T05:43:40.727 INFO:teuthology.orchestra.run.smithi150.stdout: "by_rank": [ 2024-09-17T05:43:40.727 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-09-17T05:43:40.727 INFO:teuthology.orchestra.run.smithi150.stdout: "filesystem_id": 2, 2024-09-17T05:43:40.727 INFO:teuthology.orchestra.run.smithi150.stdout: "rank": 0, 2024-09-17T05:43:40.727 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "a", 2024-09-17T05:43:40.727 INFO:teuthology.orchestra.run.smithi150.stdout: "status": "up:active", 2024-09-17T05:43:40.727 INFO:teuthology.orchestra.run.smithi150.stdout: "gid": 4938 2024-09-17T05:43:40.727 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-09-17T05:43:40.727 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2024-09-17T05:43:40.727 INFO:teuthology.orchestra.run.smithi150.stdout: "up:standby": 3 2024-09-17T05:43:40.727 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-17T05:43:40.727 INFO:teuthology.orchestra.run.smithi150.stdout: "mgrmap": { 2024-09-17T05:43:40.728 INFO:teuthology.orchestra.run.smithi150.stdout: "available": true, 2024-09-17T05:43:40.728 INFO:teuthology.orchestra.run.smithi150.stdout: "num_standbys": 1, 2024-09-17T05:43:40.728 INFO:teuthology.orchestra.run.smithi150.stdout: "modules": [ 2024-09-17T05:43:40.728 INFO:teuthology.orchestra.run.smithi150.stdout: "iostat", 2024-09-17T05:43:40.728 INFO:teuthology.orchestra.run.smithi150.stdout: "nfs", 2024-09-17T05:43:40.728 INFO:teuthology.orchestra.run.smithi150.stdout: "restful" 2024-09-17T05:43:40.728 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2024-09-17T05:43:40.728 INFO:teuthology.orchestra.run.smithi150.stdout: "services": {} 2024-09-17T05:43:40.728 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-17T05:43:40.728 INFO:teuthology.orchestra.run.smithi150.stdout: "servicemap": { 2024-09-17T05:43:40.728 INFO:teuthology.orchestra.run.smithi150.stdout: "epoch": 7, 2024-09-17T05:43:40.728 INFO:teuthology.orchestra.run.smithi150.stdout: "modified": "2024-09-17T05:43:34.869904+0000", 2024-09-17T05:43:40.728 INFO:teuthology.orchestra.run.smithi150.stdout: "services": { 2024-09-17T05:43:40.729 INFO:teuthology.orchestra.run.smithi150.stdout: "mds": { 2024-09-17T05:43:40.729 INFO:teuthology.orchestra.run.smithi150.stdout: "daemons": { 2024-09-17T05:43:40.729 INFO:teuthology.orchestra.run.smithi150.stdout: "summary": "", 2024-09-17T05:43:40.729 INFO:teuthology.orchestra.run.smithi150.stdout: "a": { 2024-09-17T05:43:40.729 INFO:teuthology.orchestra.run.smithi150.stdout: "start_epoch": 0, 2024-09-17T05:43:40.729 INFO:teuthology.orchestra.run.smithi150.stdout: "start_stamp": "0.000000", 2024-09-17T05:43:40.729 INFO:teuthology.orchestra.run.smithi150.stdout: "gid": 0, 2024-09-17T05:43:40.729 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "(unrecognized address family 0)/0", 2024-09-17T05:43:40.729 INFO:teuthology.orchestra.run.smithi150.stdout: "metadata": {}, 2024-09-17T05:43:40.729 INFO:teuthology.orchestra.run.smithi150.stdout: "task_status": {} 2024-09-17T05:43:40.729 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-09-17T05:43:40.729 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-09-17T05:43:40.729 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-09-17T05:43:40.730 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-09-17T05:43:40.730 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-17T05:43:40.730 INFO:teuthology.orchestra.run.smithi150.stdout: "progress_events": {} 2024-09-17T05:43:40.730 INFO:teuthology.orchestra.run.smithi150.stdout:} 2024-09-17T05:43:40.731 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:40.724+0000 7fcbc6919640 1 -- 172.21.15.150:0/2341615606 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fcbac078d70 msgr2=0x7fcbac07b280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:43:40.731 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:40.724+0000 7fcbc6919640 1 --2- 172.21.15.150:0/2341615606 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fcbac078d70 0x7fcbac07b280 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fcbb0006fd0 tx=0x7fcbb0006890 comp rx=0 tx=0).stop 2024-09-17T05:43:40.731 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:40.724+0000 7fcbc6919640 1 -- 172.21.15.150:0/2341615606 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fcbc01427f0 msgr2=0x7fcbc01f2450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:43:40.731 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:40.724+0000 7fcbc6919640 1 --2- 172.21.15.150:0/2341615606 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fcbc01427f0 0x7fcbc01f2450 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7fcbb8005fd0 tx=0x7fcbb800d7b0 comp rx=0 tx=0).stop 2024-09-17T05:43:40.731 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:40.724+0000 7fcbc6919640 1 -- 172.21.15.150:0/2341615606 shutdown_connections 2024-09-17T05:43:40.731 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:40.724+0000 7fcbc6919640 1 --2- 172.21.15.150:0/2341615606 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fcbc00c5b60 0x7fcbc01422b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:43:40.731 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:40.724+0000 7fcbc6919640 1 --2- 172.21.15.150:0/2341615606 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fcbac078d70 0x7fcbac07b280 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:43:40.731 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:40.724+0000 7fcbc6919640 1 --2- 172.21.15.150:0/2341615606 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fcbc01427f0 0x7fcbc01f2450 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:43:40.731 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:40.724+0000 7fcbc6919640 1 --2- 172.21.15.150:0/2341615606 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fcba8004800 0x7fcbc01f71a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:43:40.731 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:40.724+0000 7fcbc6919640 1 -- 172.21.15.150:0/2341615606 >> 172.21.15.150:0/2341615606 conn(0x7fcbc0073890 msgr2=0x7fcbc00ce950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:43:40.731 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:40.724+0000 7fcbc6919640 1 -- 172.21.15.150:0/2341615606 shutdown_connections 2024-09-17T05:43:40.732 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:40.724+0000 7fcbc6919640 1 -- 172.21.15.150:0/2341615606 wait complete. 2024-09-17T05:43:41.739 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format json-pretty 2024-09-17T05:43:41.920 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:41.919+0000 7f6af444d640 1 -- 172.21.15.150:0/1197371553 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6aec155530 msgr2=0x7f6aec15bf40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:43:41.920 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:41.919+0000 7f6af444d640 1 --2- 172.21.15.150:0/1197371553 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6aec155530 0x7f6aec15bf40 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f6aec0b5690 tx=0x7f6ae802a4f0 comp rx=0 tx=0).stop 2024-09-17T05:43:41.921 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:41.920+0000 7f6af444d640 1 -- 172.21.15.150:0/1197371553 shutdown_connections 2024-09-17T05:43:41.921 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:41.920+0000 7f6af444d640 1 --2- 172.21.15.150:0/1197371553 >> v2:172.21.15.176:3300/0 conn(0x7f6aec06ddb0 0x7f6aec06e1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:43:41.921 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:41.920+0000 7f6af444d640 1 --2- 172.21.15.150:0/1197371553 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6aec155530 0x7f6aec15bf40 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:43:41.921 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:41.920+0000 7f6af444d640 1 -- 172.21.15.150:0/1197371553 >> 172.21.15.150:0/1197371553 conn(0x7f6aec073890 msgr2=0x7f6aec073ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:43:41.921 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:41.920+0000 7f6af444d640 1 -- 172.21.15.150:0/1197371553 shutdown_connections 2024-09-17T05:43:41.921 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:41.920+0000 7f6af444d640 1 -- 172.21.15.150:0/1197371553 wait complete. 2024-09-17T05:43:41.923 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:41.922+0000 7f6af444d640 1 Processor -- start 2024-09-17T05:43:41.923 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:41.922+0000 7f6af444d640 1 -- start start 2024-09-17T05:43:41.926 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:41.924+0000 7f6af444d640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6aec06ddb0 0x7f6aec150ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:43:41.926 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:41.924+0000 7f6af444d640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6aec155530 0x7f6aec0b1bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:43:41.926 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:41.924+0000 7f6af444d640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6aec15eab0 0x7f6aec0b2130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:43:41.926 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:41.924+0000 7f6af444d640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f6aec070a40 con 0x7f6aec15eab0 2024-09-17T05:43:41.926 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:41.925+0000 7f6af444d640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f6aec0708c0 con 0x7f6aec06ddb0 2024-09-17T05:43:41.926 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:41.925+0000 7f6af444d640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f6aec0b58a0 con 0x7f6aec155530 2024-09-17T05:43:41.926 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:41.925+0000 7f6af29ea640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6aec15eab0 0x7f6aec0b2130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:43:41.926 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:41.925+0000 7f6af29ea640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6aec15eab0 0x7f6aec0b2130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:43710/0 (socket says 172.21.15.150:43710) 2024-09-17T05:43:41.926 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:41.925+0000 7f6af29ea640 1 -- 172.21.15.150:0/2724862806 learned_addr learned my addr 172.21.15.150:0/2724862806 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:43:41.927 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:41.925+0000 7f6af29ea640 1 -- 172.21.15.150:0/2724862806 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6aec155530 msgr2=0x7f6aec0b1bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:43:41.927 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:41.925+0000 7f6af29ea640 1 --2- 172.21.15.150:0/2724862806 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6aec155530 0x7f6aec0b1bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:43:41.927 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:41.925+0000 7f6af29ea640 1 -- 172.21.15.150:0/2724862806 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6aec06ddb0 msgr2=0x7f6aec150ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:43:41.927 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:41.925+0000 7f6af29ea640 1 --2- 172.21.15.150:0/2724862806 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6aec06ddb0 0x7f6aec150ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:43:41.927 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:41.925+0000 7f6af29ea640 1 -- 172.21.15.150:0/2724862806 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6aec0cff20 con 0x7f6aec15eab0 2024-09-17T05:43:41.927 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:41.926+0000 7f6af29ea640 1 --2- 172.21.15.150:0/2724862806 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6aec15eab0 0x7f6aec0b2130 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f6ae400b9e0 tx=0x7f6ae400bea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:43:41.928 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:41.926+0000 7f6ae2ffd640 1 -- 172.21.15.150:0/2724862806 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ae4019070 con 0x7f6aec15eab0 2024-09-17T05:43:41.928 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:41.926+0000 7f6af444d640 1 -- 172.21.15.150:0/2724862806 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6aec137cc0 con 0x7f6aec15eab0 2024-09-17T05:43:41.928 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:41.926+0000 7f6ae2ffd640 1 -- 172.21.15.150:0/2724862806 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f6ae400cc10 con 0x7f6aec15eab0 2024-09-17T05:43:41.928 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:41.926+0000 7f6af444d640 1 -- 172.21.15.150:0/2724862806 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6aec138240 con 0x7f6aec15eab0 2024-09-17T05:43:41.928 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:41.926+0000 7f6ae2ffd640 1 -- 172.21.15.150:0/2724862806 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ae40146a0 con 0x7f6aec15eab0 2024-09-17T05:43:41.929 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:41.929+0000 7f6af444d640 1 -- 172.21.15.150:0/2724862806 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6ad4005290 con 0x7f6aec15eab0 2024-09-17T05:43:41.930 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:41.929+0000 7f6ae2ffd640 1 -- 172.21.15.150:0/2724862806 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 8) ==== 101645+0+0 (secure 0 0 0) 0x7f6ae401c070 con 0x7f6aec15eab0 2024-09-17T05:43:41.930 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:41.930+0000 7f6ae2ffd640 1 --2- 172.21.15.150:0/2724862806 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f6ad0078e00 0x7f6ad007b310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:43:41.931 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:41.930+0000 7f6ae2ffd640 1 -- 172.21.15.150:0/2724862806 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7f6ae409adf0 con 0x7f6aec15eab0 2024-09-17T05:43:41.934 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:41.933+0000 7f6af21e9640 1 --2- 172.21.15.150:0/2724862806 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f6ad0078e00 0x7f6ad007b310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:43:41.936 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:41.935+0000 7f6af21e9640 1 --2- 172.21.15.150:0/2724862806 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f6ad0078e00 0x7f6ad007b310 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f6ae8033000 tx=0x7f6ae80046c0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:43:41.937 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:41.937+0000 7f6ae2ffd640 1 -- 172.21.15.150:0/2724862806 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f6aec137cc0 con 0x7f6aec15eab0 2024-09-17T05:43:42.292 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:42.291+0000 7f6af444d640 1 -- 172.21.15.150:0/2724862806 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) -- 0x7f6ad4005850 con 0x7f6aec15eab0 2024-09-17T05:43:42.292 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:42.292+0000 7f6ae2ffd640 1 -- 172.21.15.150:0/2724862806 <== mon.0 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) ==== 79+0+2561 (secure 0 0 0) 0x7f6ae4062e50 con 0x7f6aec15eab0 2024-09-17T05:43:42.293 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-09-17T05:43:42.293 INFO:teuthology.orchestra.run.smithi150.stdout:{ 2024-09-17T05:43:42.293 INFO:teuthology.orchestra.run.smithi150.stdout: "fsid": "9f2e05e9-d629-47b3-b26b-1360655b7d20", 2024-09-17T05:43:42.293 INFO:teuthology.orchestra.run.smithi150.stdout: "health": { 2024-09-17T05:43:42.293 INFO:teuthology.orchestra.run.smithi150.stdout: "status": "HEALTH_OK", 2024-09-17T05:43:42.293 INFO:teuthology.orchestra.run.smithi150.stdout: "checks": {}, 2024-09-17T05:43:42.293 INFO:teuthology.orchestra.run.smithi150.stdout: "mutes": [] 2024-09-17T05:43:42.293 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-17T05:43:42.293 INFO:teuthology.orchestra.run.smithi150.stdout: "election_epoch": 4, 2024-09-17T05:43:42.293 INFO:teuthology.orchestra.run.smithi150.stdout: "quorum": [ 2024-09-17T05:43:42.293 INFO:teuthology.orchestra.run.smithi150.stdout: 0, 2024-09-17T05:43:42.293 INFO:teuthology.orchestra.run.smithi150.stdout: 1, 2024-09-17T05:43:42.294 INFO:teuthology.orchestra.run.smithi150.stdout: 2 2024-09-17T05:43:42.294 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2024-09-17T05:43:42.294 INFO:teuthology.orchestra.run.smithi150.stdout: "quorum_names": [ 2024-09-17T05:43:42.294 INFO:teuthology.orchestra.run.smithi150.stdout: "a", 2024-09-17T05:43:42.294 INFO:teuthology.orchestra.run.smithi150.stdout: "b", 2024-09-17T05:43:42.294 INFO:teuthology.orchestra.run.smithi150.stdout: "c" 2024-09-17T05:43:42.294 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2024-09-17T05:43:42.294 INFO:teuthology.orchestra.run.smithi150.stdout: "quorum_age": 129, 2024-09-17T05:43:42.294 INFO:teuthology.orchestra.run.smithi150.stdout: "monmap": { 2024-09-17T05:43:42.294 INFO:teuthology.orchestra.run.smithi150.stdout: "epoch": 1, 2024-09-17T05:43:42.294 INFO:teuthology.orchestra.run.smithi150.stdout: "min_mon_release_name": "squid", 2024-09-17T05:43:42.294 INFO:teuthology.orchestra.run.smithi150.stdout: "num_mons": 3 2024-09-17T05:43:42.294 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-17T05:43:42.295 INFO:teuthology.orchestra.run.smithi150.stdout: "osdmap": { 2024-09-17T05:43:42.295 INFO:teuthology.orchestra.run.smithi150.stdout: "epoch": 34, 2024-09-17T05:43:42.295 INFO:teuthology.orchestra.run.smithi150.stdout: "num_osds": 8, 2024-09-17T05:43:42.295 INFO:teuthology.orchestra.run.smithi150.stdout: "num_up_osds": 8, 2024-09-17T05:43:42.295 INFO:teuthology.orchestra.run.smithi150.stdout: "osd_up_since": 1726551706, 2024-09-17T05:43:42.295 INFO:teuthology.orchestra.run.smithi150.stdout: "num_in_osds": 8, 2024-09-17T05:43:42.295 INFO:teuthology.orchestra.run.smithi150.stdout: "osd_in_since": 1726551696, 2024-09-17T05:43:42.295 INFO:teuthology.orchestra.run.smithi150.stdout: "num_remapped_pgs": 0 2024-09-17T05:43:42.295 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-17T05:43:42.295 INFO:teuthology.orchestra.run.smithi150.stdout: "pgmap": { 2024-09-17T05:43:42.295 INFO:teuthology.orchestra.run.smithi150.stdout: "pgs_by_state": [ 2024-09-17T05:43:42.295 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-09-17T05:43:42.295 INFO:teuthology.orchestra.run.smithi150.stdout: "state_name": "active+clean", 2024-09-17T05:43:42.296 INFO:teuthology.orchestra.run.smithi150.stdout: "count": 97 2024-09-17T05:43:42.296 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-09-17T05:43:42.296 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2024-09-17T05:43:42.296 INFO:teuthology.orchestra.run.smithi150.stdout: "num_pgs": 97, 2024-09-17T05:43:42.296 INFO:teuthology.orchestra.run.smithi150.stdout: "num_pools": 3, 2024-09-17T05:43:42.296 INFO:teuthology.orchestra.run.smithi150.stdout: "num_objects": 2585, 2024-09-17T05:43:42.296 INFO:teuthology.orchestra.run.smithi150.stdout: "data_bytes": 10738478013, 2024-09-17T05:43:42.296 INFO:teuthology.orchestra.run.smithi150.stdout: "bytes_used": 21718466560, 2024-09-17T05:43:42.296 INFO:teuthology.orchestra.run.smithi150.stdout: "bytes_avail": 751375646720, 2024-09-17T05:43:42.296 INFO:teuthology.orchestra.run.smithi150.stdout: "bytes_total": 773094113280, 2024-09-17T05:43:42.296 INFO:teuthology.orchestra.run.smithi150.stdout: "write_bytes_sec": 170493923, 2024-09-17T05:43:42.296 INFO:teuthology.orchestra.run.smithi150.stdout: "read_op_per_sec": 0, 2024-09-17T05:43:42.296 INFO:teuthology.orchestra.run.smithi150.stdout: "write_op_per_sec": 42 2024-09-17T05:43:42.297 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-17T05:43:42.297 INFO:teuthology.orchestra.run.smithi150.stdout: "fsmap": { 2024-09-17T05:43:42.297 INFO:teuthology.orchestra.run.smithi150.stdout: "epoch": 16, 2024-09-17T05:43:42.297 INFO:teuthology.orchestra.run.smithi150.stdout: "btime": "2024-09-17T05:42:51:051729+0000", 2024-09-17T05:43:42.297 INFO:teuthology.orchestra.run.smithi150.stdout: "id": 2, 2024-09-17T05:43:42.297 INFO:teuthology.orchestra.run.smithi150.stdout: "up": 1, 2024-09-17T05:43:42.297 INFO:teuthology.orchestra.run.smithi150.stdout: "in": 1, 2024-09-17T05:43:42.297 INFO:teuthology.orchestra.run.smithi150.stdout: "max": 1, 2024-09-17T05:43:42.297 INFO:teuthology.orchestra.run.smithi150.stdout: "by_rank": [ 2024-09-17T05:43:42.297 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-09-17T05:43:42.297 INFO:teuthology.orchestra.run.smithi150.stdout: "filesystem_id": 2, 2024-09-17T05:43:42.297 INFO:teuthology.orchestra.run.smithi150.stdout: "rank": 0, 2024-09-17T05:43:42.297 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "a", 2024-09-17T05:43:42.298 INFO:teuthology.orchestra.run.smithi150.stdout: "status": "up:active", 2024-09-17T05:43:42.298 INFO:teuthology.orchestra.run.smithi150.stdout: "gid": 4938 2024-09-17T05:43:42.298 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-09-17T05:43:42.298 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2024-09-17T05:43:42.298 INFO:teuthology.orchestra.run.smithi150.stdout: "up:standby": 3 2024-09-17T05:43:42.298 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-17T05:43:42.298 INFO:teuthology.orchestra.run.smithi150.stdout: "mgrmap": { 2024-09-17T05:43:42.298 INFO:teuthology.orchestra.run.smithi150.stdout: "available": true, 2024-09-17T05:43:42.298 INFO:teuthology.orchestra.run.smithi150.stdout: "num_standbys": 1, 2024-09-17T05:43:42.298 INFO:teuthology.orchestra.run.smithi150.stdout: "modules": [ 2024-09-17T05:43:42.298 INFO:teuthology.orchestra.run.smithi150.stdout: "iostat", 2024-09-17T05:43:42.298 INFO:teuthology.orchestra.run.smithi150.stdout: "nfs", 2024-09-17T05:43:42.298 INFO:teuthology.orchestra.run.smithi150.stdout: "restful" 2024-09-17T05:43:42.299 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2024-09-17T05:43:42.299 INFO:teuthology.orchestra.run.smithi150.stdout: "services": {} 2024-09-17T05:43:42.299 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-17T05:43:42.299 INFO:teuthology.orchestra.run.smithi150.stdout: "servicemap": { 2024-09-17T05:43:42.299 INFO:teuthology.orchestra.run.smithi150.stdout: "epoch": 7, 2024-09-17T05:43:42.299 INFO:teuthology.orchestra.run.smithi150.stdout: "modified": "2024-09-17T05:43:34.869904+0000", 2024-09-17T05:43:42.299 INFO:teuthology.orchestra.run.smithi150.stdout: "services": { 2024-09-17T05:43:42.299 INFO:teuthology.orchestra.run.smithi150.stdout: "mds": { 2024-09-17T05:43:42.299 INFO:teuthology.orchestra.run.smithi150.stdout: "daemons": { 2024-09-17T05:43:42.299 INFO:teuthology.orchestra.run.smithi150.stdout: "summary": "", 2024-09-17T05:43:42.299 INFO:teuthology.orchestra.run.smithi150.stdout: "a": { 2024-09-17T05:43:42.299 INFO:teuthology.orchestra.run.smithi150.stdout: "start_epoch": 0, 2024-09-17T05:43:42.299 INFO:teuthology.orchestra.run.smithi150.stdout: "start_stamp": "0.000000", 2024-09-17T05:43:42.299 INFO:teuthology.orchestra.run.smithi150.stdout: "gid": 0, 2024-09-17T05:43:42.300 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "(unrecognized address family 0)/0", 2024-09-17T05:43:42.300 INFO:teuthology.orchestra.run.smithi150.stdout: "metadata": {}, 2024-09-17T05:43:42.300 INFO:teuthology.orchestra.run.smithi150.stdout: "task_status": {} 2024-09-17T05:43:42.300 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-09-17T05:43:42.300 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-09-17T05:43:42.300 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-09-17T05:43:42.300 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-09-17T05:43:42.300 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-17T05:43:42.300 INFO:teuthology.orchestra.run.smithi150.stdout: "progress_events": { 2024-09-17T05:43:42.300 INFO:teuthology.orchestra.run.smithi150.stdout: "mgr-vol-ongoing-clones": { 2024-09-17T05:43:42.300 INFO:teuthology.orchestra.run.smithi150.stdout: "message": "1 ongoing clones - average progress is 0.0% (0s)\n [............................] ", 2024-09-17T05:43:42.300 INFO:teuthology.orchestra.run.smithi150.stdout: "progress": 0, 2024-09-17T05:43:42.301 INFO:teuthology.orchestra.run.smithi150.stdout: "add_to_ceph_s": true 2024-09-17T05:43:42.301 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-09-17T05:43:42.301 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-09-17T05:43:42.301 INFO:teuthology.orchestra.run.smithi150.stdout:} 2024-09-17T05:43:42.302 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:42.294+0000 7f6af444d640 1 -- 172.21.15.150:0/2724862806 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f6ad0078e00 msgr2=0x7f6ad007b310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:43:42.302 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:42.294+0000 7f6af444d640 1 --2- 172.21.15.150:0/2724862806 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f6ad0078e00 0x7f6ad007b310 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f6ae8033000 tx=0x7f6ae80046c0 comp rx=0 tx=0).stop 2024-09-17T05:43:42.302 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:42.294+0000 7f6af444d640 1 -- 172.21.15.150:0/2724862806 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6aec15eab0 msgr2=0x7f6aec0b2130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:43:42.302 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:42.294+0000 7f6af444d640 1 --2- 172.21.15.150:0/2724862806 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6aec15eab0 0x7f6aec0b2130 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f6ae400b9e0 tx=0x7f6ae400bea0 comp rx=0 tx=0).stop 2024-09-17T05:43:42.302 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:42.294+0000 7f6af444d640 1 -- 172.21.15.150:0/2724862806 shutdown_connections 2024-09-17T05:43:42.302 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:42.294+0000 7f6af444d640 1 --2- 172.21.15.150:0/2724862806 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f6ad0078e00 0x7f6ad007b310 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:43:42.302 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:42.294+0000 7f6af444d640 1 --2- 172.21.15.150:0/2724862806 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6aec15eab0 0x7f6aec0b2130 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:43:42.302 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:42.294+0000 7f6af444d640 1 --2- 172.21.15.150:0/2724862806 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6aec155530 0x7f6aec0b1bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:43:42.302 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:42.295+0000 7f6af444d640 1 --2- 172.21.15.150:0/2724862806 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6aec06ddb0 0x7f6aec150ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:43:42.302 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:42.295+0000 7f6af444d640 1 -- 172.21.15.150:0/2724862806 >> 172.21.15.150:0/2724862806 conn(0x7f6aec073890 msgr2=0x7f6aec15eec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:43:42.303 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:42.295+0000 7f6af444d640 1 -- 172.21.15.150:0/2724862806 shutdown_connections 2024-09-17T05:43:42.303 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:42.295+0000 7f6af444d640 1 -- 172.21.15.150:0/2724862806 wait complete. 2024-09-17T05:43:42.309 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs clone cancel cephfs ss1clone1 2024-09-17T05:43:42.488 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:42.487+0000 7feba72b4640 1 -- 172.21.15.150:0/1662081203 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7feba00ccc50 msgr2=0x7feba00cf570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:43:42.488 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:42.487+0000 7feba72b4640 1 --2- 172.21.15.150:0/1662081203 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7feba00ccc50 0x7feba00cf570 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7feb90005fd0 tx=0x7feb9002a970 comp rx=0 tx=0).stop 2024-09-17T05:43:42.488 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:42.487+0000 7feba72b4640 1 -- 172.21.15.150:0/1662081203 shutdown_connections 2024-09-17T05:43:42.488 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:42.487+0000 7feba72b4640 1 --2- 172.21.15.150:0/1662081203 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7feba0073d40 0x7feba015ccf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:43:42.488 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:42.487+0000 7feba72b4640 1 --2- 172.21.15.150:0/1662081203 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7feba00ccc50 0x7feba00cf570 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:43:42.489 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:42.487+0000 7feba72b4640 1 -- 172.21.15.150:0/1662081203 >> 172.21.15.150:0/1662081203 conn(0x7feba006d1c0 msgr2=0x7feba006d5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:43:42.489 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:42.487+0000 7feba72b4640 1 -- 172.21.15.150:0/1662081203 shutdown_connections 2024-09-17T05:43:42.489 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:42.487+0000 7feba72b4640 1 -- 172.21.15.150:0/1662081203 wait complete. 2024-09-17T05:43:42.490 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:42.490+0000 7feba72b4640 1 Processor -- start 2024-09-17T05:43:42.490 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:42.490+0000 7feba72b4640 1 -- start start 2024-09-17T05:43:42.493 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:42.491+0000 7feba72b4640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7feba00ccc50 0x7feba0140290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:43:42.493 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:42.491+0000 7feba72b4640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7feba00cfab0 0x7feba01407d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:43:42.493 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:42.491+0000 7feba72b4640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7feba01f7670 0x7feba01546b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:43:42.493 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:42.491+0000 7feba72b4640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7feba015d830 con 0x7feba00ccc50 2024-09-17T05:43:42.493 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:42.491+0000 7feba72b4640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7feba015d6b0 con 0x7feba01f7670 2024-09-17T05:43:42.493 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:42.491+0000 7feba72b4640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7feba015d9b0 con 0x7feba00cfab0 2024-09-17T05:43:42.493 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:42.491+0000 7feba5050640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7feba00ccc50 0x7feba0140290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:43:42.493 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:42.491+0000 7feba5050640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7feba00ccc50 0x7feba0140290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:43734/0 (socket says 172.21.15.150:43734) 2024-09-17T05:43:42.493 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:42.491+0000 7feba5050640 1 -- 172.21.15.150:0/35573535 learned_addr learned my addr 172.21.15.150:0/35573535 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:43:42.493 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:42.491+0000 7feba484f640 1 --2- 172.21.15.150:0/35573535 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7feba00cfab0 0x7feba01407d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:43:42.493 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:42.491+0000 7feba5851640 1 --2- 172.21.15.150:0/35573535 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7feba01f7670 0x7feba01546b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:43:42.493 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:42.491+0000 7feba5050640 1 -- 172.21.15.150:0/35573535 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7feba00cfab0 msgr2=0x7feba01407d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:43:42.494 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:42.491+0000 7feba5050640 1 --2- 172.21.15.150:0/35573535 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7feba00cfab0 0x7feba01407d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:43:42.494 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:42.491+0000 7feba5050640 1 -- 172.21.15.150:0/35573535 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7feba01f7670 msgr2=0x7feba01546b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:43:42.494 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:42.491+0000 7feba5050640 1 --2- 172.21.15.150:0/35573535 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7feba01f7670 0x7feba01546b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:43:42.494 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:42.491+0000 7feba5050640 1 -- 172.21.15.150:0/35573535 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feba01f3810 con 0x7feba00ccc50 2024-09-17T05:43:42.494 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:42.492+0000 7feba5050640 1 --2- 172.21.15.150:0/35573535 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7feba00ccc50 0x7feba0140290 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7feb90033040 tx=0x7feb90003f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:43:42.494 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:42.492+0000 7feb9dffb640 1 -- 172.21.15.150:0/35573535 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb90034070 con 0x7feba00ccc50 2024-09-17T05:43:42.494 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:42.492+0000 7feb9dffb640 1 -- 172.21.15.150:0/35573535 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7feb90004690 con 0x7feba00ccc50 2024-09-17T05:43:42.494 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:42.492+0000 7feba72b4640 1 -- 172.21.15.150:0/35573535 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feba01f3af0 con 0x7feba00ccc50 2024-09-17T05:43:42.494 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:42.492+0000 7feb9dffb640 1 -- 172.21.15.150:0/35573535 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb900436a0 con 0x7feba00ccc50 2024-09-17T05:43:42.494 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:42.492+0000 7feba72b4640 1 -- 172.21.15.150:0/35573535 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feba01f40b0 con 0x7feba00ccc50 2024-09-17T05:43:42.495 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:42.493+0000 7feba72b4640 1 -- 172.21.15.150:0/35573535 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7feba00cdcb0 con 0x7feba00ccc50 2024-09-17T05:43:42.495 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:42.494+0000 7feb9dffb640 1 -- 172.21.15.150:0/35573535 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 8) ==== 101645+0+0 (secure 0 0 0) 0x7feb90037020 con 0x7feba00ccc50 2024-09-17T05:43:42.495 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:42.494+0000 7feb9dffb640 1 --2- 172.21.15.150:0/35573535 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7feb8c078dd0 0x7feb8c07b2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:43:42.495 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:42.494+0000 7feb9dffb640 1 -- 172.21.15.150:0/35573535 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7feb900bc760 con 0x7feba00ccc50 2024-09-17T05:43:42.501 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:42.501+0000 7feb9dffb640 1 -- 172.21.15.150:0/35573535 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7feba00cdcb0 con 0x7feba00ccc50 2024-09-17T05:43:42.501 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:42.501+0000 7feba484f640 1 --2- 172.21.15.150:0/35573535 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7feb8c078dd0 0x7feb8c07b2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:43:42.503 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:42.503+0000 7feba484f640 1 --2- 172.21.15.150:0/35573535 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7feb8c078dd0 0x7feb8c07b2e0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7feb94006fd0 tx=0x7feb94008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:43:42.811 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:42.811+0000 7feba72b4640 1 -- 172.21.15.150:0/35573535 --> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] -- mgr_command(tid 0: {"prefix": "fs clone cancel", "vol_name": "cephfs", "clone_name": "ss1clone1", "target": ["mon-mgr", ""]}) -- 0x7feba013ea30 con 0x7feb8c078dd0 2024-09-17T05:43:42.968 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:42.967+0000 7feb9dffb640 1 -- 172.21.15.150:0/35573535 <== mgr.4108 v2:172.21.15.176:6800/3631216395 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7feba013ea30 con 0x7feb8c078dd0 2024-09-17T05:43:42.970 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:42.970+0000 7feba72b4640 1 -- 172.21.15.150:0/35573535 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7feb8c078dd0 msgr2=0x7feb8c07b2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:43:42.971 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:42.970+0000 7feba72b4640 1 --2- 172.21.15.150:0/35573535 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7feb8c078dd0 0x7feb8c07b2e0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7feb94006fd0 tx=0x7feb94008040 comp rx=0 tx=0).stop 2024-09-17T05:43:42.971 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:42.970+0000 7feba72b4640 1 -- 172.21.15.150:0/35573535 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7feba00ccc50 msgr2=0x7feba0140290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:43:42.971 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:42.970+0000 7feba72b4640 1 --2- 172.21.15.150:0/35573535 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7feba00ccc50 0x7feba0140290 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7feb90033040 tx=0x7feb90003f90 comp rx=0 tx=0).stop 2024-09-17T05:43:42.971 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:42.970+0000 7feba72b4640 1 -- 172.21.15.150:0/35573535 shutdown_connections 2024-09-17T05:43:42.971 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:42.970+0000 7feba72b4640 1 --2- 172.21.15.150:0/35573535 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7feba01f7670 0x7feba01546b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:43:42.971 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:42.970+0000 7feba72b4640 1 --2- 172.21.15.150:0/35573535 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7feb8c078dd0 0x7feb8c07b2e0 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:43:42.971 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:42.970+0000 7feba72b4640 1 --2- 172.21.15.150:0/35573535 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7feba00cfab0 0x7feba01407d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:43:42.971 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:42.970+0000 7feba72b4640 1 --2- 172.21.15.150:0/35573535 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7feba00ccc50 0x7feba0140290 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:43:42.971 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:42.970+0000 7feba72b4640 1 -- 172.21.15.150:0/35573535 >> 172.21.15.150:0/35573535 conn(0x7feba006d1c0 msgr2=0x7feba00b3ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:43:42.971 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:42.970+0000 7feba72b4640 1 -- 172.21.15.150:0/35573535 shutdown_connections 2024-09-17T05:43:42.971 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:42.970+0000 7feba72b4640 1 -- 172.21.15.150:0/35573535 wait complete. 2024-09-17T05:43:42.982 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume ls 2024-09-17T05:43:43.096 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:43.095+0000 7f3f98512640 1 -- 172.21.15.150:0/2271064140 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3f900c5a90 msgr2=0x7f3f900b5250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:43:43.097 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:43.095+0000 7f3f98512640 1 --2- 172.21.15.150:0/2271064140 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3f900c5a90 0x7f3f900b5250 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f3f80005fd0 tx=0x7f3f8002a5c0 comp rx=0 tx=0).stop 2024-09-17T05:43:43.097 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:43.095+0000 7f3f98512640 1 -- 172.21.15.150:0/2271064140 shutdown_connections 2024-09-17T05:43:43.097 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:43.095+0000 7f3f98512640 1 --2- 172.21.15.150:0/2271064140 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3f900b5790 0x7f3f900b5ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:43:43.097 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:43.095+0000 7f3f98512640 1 --2- 172.21.15.150:0/2271064140 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3f900c5a90 0x7f3f900b5250 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:43:43.097 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:43.095+0000 7f3f98512640 1 -- 172.21.15.150:0/2271064140 >> 172.21.15.150:0/2271064140 conn(0x7f3f900cee80 msgr2=0x7f3f900cf290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:43:43.097 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:43.096+0000 7f3f98512640 1 -- 172.21.15.150:0/2271064140 shutdown_connections 2024-09-17T05:43:43.097 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:43.096+0000 7f3f98512640 1 -- 172.21.15.150:0/2271064140 wait complete. 2024-09-17T05:43:43.097 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:43.097+0000 7f3f98512640 1 Processor -- start 2024-09-17T05:43:43.098 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:43.097+0000 7f3f98512640 1 -- start start 2024-09-17T05:43:43.100 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:43.098+0000 7f3f98512640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3f900b5790 0x7f3f901e7e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:43:43.101 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:43.098+0000 7f3f98512640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3f900c5a90 0x7f3f901e8350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:43:43.101 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:43.099+0000 7f3f98512640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3f900cea50 0x7f3f901f6d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:43:43.101 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:43.099+0000 7f3f98512640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f3f900cd270 con 0x7f3f900cea50 2024-09-17T05:43:43.101 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:43.099+0000 7f3f98512640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f3f900cd0f0 con 0x7f3f900c5a90 2024-09-17T05:43:43.101 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:43.099+0000 7f3f98512640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f3f900cd3f0 con 0x7f3f900b5790 2024-09-17T05:43:43.101 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:43.099+0000 7f3f96aaf640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3f900cea50 0x7f3f901f6d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:43:43.101 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:43.099+0000 7f3f96aaf640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3f900cea50 0x7f3f901f6d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:43766/0 (socket says 172.21.15.150:43766) 2024-09-17T05:43:43.101 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:43.099+0000 7f3f96aaf640 1 -- 172.21.15.150:0/4168370556 learned_addr learned my addr 172.21.15.150:0/4168370556 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:43:43.101 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:43.099+0000 7f3f95aad640 1 --2- 172.21.15.150:0/4168370556 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3f900c5a90 0x7f3f901e8350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:43:43.101 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:43.099+0000 7f3f962ae640 1 --2- 172.21.15.150:0/4168370556 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3f900b5790 0x7f3f901e7e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:43:43.101 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:43.099+0000 7f3f96aaf640 1 -- 172.21.15.150:0/4168370556 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3f900b5790 msgr2=0x7f3f901e7e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:43:43.101 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:43.099+0000 7f3f96aaf640 1 --2- 172.21.15.150:0/4168370556 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3f900b5790 0x7f3f901e7e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:43:43.101 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:43.099+0000 7f3f96aaf640 1 -- 172.21.15.150:0/4168370556 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3f900c5a90 msgr2=0x7f3f901e8350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:43:43.101 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:43.099+0000 7f3f96aaf640 1 --2- 172.21.15.150:0/4168370556 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3f900c5a90 0x7f3f901e8350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:43:43.102 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:43.099+0000 7f3f96aaf640 1 -- 172.21.15.150:0/4168370556 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3f9009d6a0 con 0x7f3f900cea50 2024-09-17T05:43:43.102 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:43.099+0000 7f3f96aaf640 1 --2- 172.21.15.150:0/4168370556 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3f900cea50 0x7f3f901f6d50 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f3f8800d9d0 tx=0x7f3f8800de90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:43:43.102 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:43.099+0000 7f3f86ffd640 1 -- 172.21.15.150:0/4168370556 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f88017070 con 0x7f3f900cea50 2024-09-17T05:43:43.102 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:43.099+0000 7f3f86ffd640 1 -- 172.21.15.150:0/4168370556 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f3f88003970 con 0x7f3f900cea50 2024-09-17T05:43:43.102 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:43.099+0000 7f3f98512640 1 -- 172.21.15.150:0/4168370556 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3f9009d980 con 0x7f3f900cea50 2024-09-17T05:43:43.102 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:43.099+0000 7f3f86ffd640 1 -- 172.21.15.150:0/4168370556 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f8800be60 con 0x7f3f900cea50 2024-09-17T05:43:43.102 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:43.099+0000 7f3f98512640 1 -- 172.21.15.150:0/4168370556 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3f9009fd20 con 0x7f3f900cea50 2024-09-17T05:43:43.102 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:43.100+0000 7f3f98512640 1 -- 172.21.15.150:0/4168370556 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3f900b5ba0 con 0x7f3f900cea50 2024-09-17T05:43:43.103 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:43.101+0000 7f3f86ffd640 1 -- 172.21.15.150:0/4168370556 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 8) ==== 101645+0+0 (secure 0 0 0) 0x7f3f88010460 con 0x7f3f900cea50 2024-09-17T05:43:43.103 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:43.101+0000 7f3f86ffd640 1 --2- 172.21.15.150:0/4168370556 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f3f74078e00 0x7f3f7407b310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:43:43.103 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:43.102+0000 7f3f86ffd640 1 -- 172.21.15.150:0/4168370556 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7f3f8809b510 con 0x7f3f900cea50 2024-09-17T05:43:43.103 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:43.102+0000 7f3f962ae640 1 --2- 172.21.15.150:0/4168370556 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f3f74078e00 0x7f3f7407b310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:43:43.103 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:43.102+0000 7f3f962ae640 1 --2- 172.21.15.150:0/4168370556 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f3f74078e00 0x7f3f7407b310 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f3f8c007fd0 tx=0x7f3f8c009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:43:43.106 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:43.106+0000 7f3f86ffd640 1 -- 172.21.15.150:0/4168370556 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f3f88062f20 con 0x7f3f900cea50 2024-09-17T05:43:43.308 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:43.308+0000 7f3f98512640 1 -- 172.21.15.150:0/4168370556 --> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] -- mgr_command(tid 0: {"prefix": "fs volume ls", "target": ["mon-mgr", ""]}) -- 0x7f3f9014a380 con 0x7f3f74078e00 2024-09-17T05:43:43.310 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:43.310+0000 7f3f86ffd640 1 -- 172.21.15.150:0/4168370556 <== mgr.4108 v2:172.21.15.176:6800/3631216395 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+41 (secure 0 0 0) 0x7f3f8c001d40 con 0x7f3f74078e00 2024-09-17T05:43:43.310 INFO:teuthology.orchestra.run.smithi150.stdout:[ 2024-09-17T05:43:43.310 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-09-17T05:43:43.310 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "cephfs" 2024-09-17T05:43:43.310 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-09-17T05:43:43.310 INFO:teuthology.orchestra.run.smithi150.stdout:] 2024-09-17T05:43:43.313 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:43.312+0000 7f3f98512640 1 -- 172.21.15.150:0/4168370556 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f3f74078e00 msgr2=0x7f3f7407b310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:43:43.313 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:43.312+0000 7f3f98512640 1 --2- 172.21.15.150:0/4168370556 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f3f74078e00 0x7f3f7407b310 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f3f8c007fd0 tx=0x7f3f8c009040 comp rx=0 tx=0).stop 2024-09-17T05:43:43.313 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:43.312+0000 7f3f98512640 1 -- 172.21.15.150:0/4168370556 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3f900cea50 msgr2=0x7f3f901f6d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:43:43.313 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:43.312+0000 7f3f98512640 1 --2- 172.21.15.150:0/4168370556 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3f900cea50 0x7f3f901f6d50 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f3f8800d9d0 tx=0x7f3f8800de90 comp rx=0 tx=0).stop 2024-09-17T05:43:43.313 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:43.312+0000 7f3f98512640 1 -- 172.21.15.150:0/4168370556 shutdown_connections 2024-09-17T05:43:43.313 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:43.312+0000 7f3f98512640 1 --2- 172.21.15.150:0/4168370556 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3f900c5a90 0x7f3f901e8350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:43:43.313 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:43.312+0000 7f3f98512640 1 --2- 172.21.15.150:0/4168370556 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f3f74078e00 0x7f3f7407b310 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:43:43.313 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:43.312+0000 7f3f98512640 1 --2- 172.21.15.150:0/4168370556 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3f900cea50 0x7f3f901f6d50 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:43:43.313 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:43.312+0000 7f3f98512640 1 --2- 172.21.15.150:0/4168370556 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3f900b5790 0x7f3f901e7e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:43:43.313 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:43.312+0000 7f3f98512640 1 -- 172.21.15.150:0/4168370556 >> 172.21.15.150:0/4168370556 conn(0x7f3f900cee80 msgr2=0x7f3f90072040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:43:43.314 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:43.312+0000 7f3f98512640 1 -- 172.21.15.150:0/4168370556 shutdown_connections 2024-09-17T05:43:43.314 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:43.312+0000 7f3f98512640 1 -- 172.21.15.150:0/4168370556 wait complete. 2024-09-17T05:43:43.324 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume ls cephfs --format json 2024-09-17T05:43:43.440 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:43.439+0000 7f3cba85c640 1 -- 172.21.15.150:0/1982965756 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3cb40b1350 msgr2=0x7f3cb415d900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:43:43.440 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:43.439+0000 7f3cba85c640 1 --2- 172.21.15.150:0/1982965756 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3cb40b1350 0x7f3cb415d900 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f3cb40b2fc0 tx=0x7f3cac02aa30 comp rx=0 tx=0).stop 2024-09-17T05:43:43.440 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:43.439+0000 7f3cba85c640 1 -- 172.21.15.150:0/1982965756 shutdown_connections 2024-09-17T05:43:43.440 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:43.439+0000 7f3cba85c640 1 --2- 172.21.15.150:0/1982965756 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3cb40b1350 0x7f3cb415d900 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:43:43.440 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:43.439+0000 7f3cba85c640 1 --2- 172.21.15.150:0/1982965756 >> v2:172.21.15.176:3300/0 conn(0x7f3cb40ce730 0x7f3cb40b0e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:43:43.440 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:43.439+0000 7f3cba85c640 1 -- 172.21.15.150:0/1982965756 >> 172.21.15.150:0/1982965756 conn(0x7f3cb40b2ff0 msgr2=0x7f3cb40b3400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:43:43.440 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:43.439+0000 7f3cba85c640 1 -- 172.21.15.150:0/1982965756 shutdown_connections 2024-09-17T05:43:43.441 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:43.439+0000 7f3cba85c640 1 -- 172.21.15.150:0/1982965756 wait complete. 2024-09-17T05:43:43.441 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:43.441+0000 7f3cba85c640 1 Processor -- start 2024-09-17T05:43:43.441 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:43.441+0000 7f3cba85c640 1 -- start start 2024-09-17T05:43:43.444 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:43.442+0000 7f3cba85c640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3cb40b1350 0x7f3cb41e7ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:43:43.444 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:43.442+0000 7f3cba85c640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3cb40ce730 0x7f3cb4147100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:43:43.445 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:43.442+0000 7f3cba85c640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3cb4147640 0x7f3cb4147a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:43:43.445 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:43.442+0000 7f3cba85c640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f3cb40c76c0 con 0x7f3cb4147640 2024-09-17T05:43:43.445 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:43.442+0000 7f3cba85c640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f3cb40c7540 con 0x7f3cb40b1350 2024-09-17T05:43:43.445 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:43.442+0000 7f3cba85c640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f3cb40c7840 con 0x7f3cb40ce730 2024-09-17T05:43:43.445 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:43.442+0000 7f3cb8df9640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3cb4147640 0x7f3cb4147a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:43:43.445 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:43.442+0000 7f3cb8df9640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3cb4147640 0x7f3cb4147a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:43774/0 (socket says 172.21.15.150:43774) 2024-09-17T05:43:43.445 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:43.442+0000 7f3cb8df9640 1 -- 172.21.15.150:0/3548585952 learned_addr learned my addr 172.21.15.150:0/3548585952 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:43:43.445 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:43.443+0000 7f3cb3fff640 1 --2- 172.21.15.150:0/3548585952 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3cb40b1350 0x7f3cb41e7ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:43:43.445 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:43.443+0000 7f3cb37fe640 1 --2- 172.21.15.150:0/3548585952 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3cb40ce730 0x7f3cb4147100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:43:43.445 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:43.443+0000 7f3cb8df9640 1 -- 172.21.15.150:0/3548585952 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3cb40ce730 msgr2=0x7f3cb4147100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:43:43.445 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:43.443+0000 7f3cb8df9640 1 --2- 172.21.15.150:0/3548585952 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3cb40ce730 0x7f3cb4147100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:43:43.445 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:43.443+0000 7f3cb8df9640 1 -- 172.21.15.150:0/3548585952 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3cb40b1350 msgr2=0x7f3cb41e7ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:43:43.446 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:43.443+0000 7f3cb8df9640 1 --2- 172.21.15.150:0/3548585952 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3cb40b1350 0x7f3cb41e7ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:43:43.446 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:43.443+0000 7f3cb8df9640 1 -- 172.21.15.150:0/3548585952 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3cb4147f90 con 0x7f3cb4147640 2024-09-17T05:43:43.446 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:43.443+0000 7f3cb3fff640 1 --2- 172.21.15.150:0/3548585952 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3cb40b1350 0x7f3cb41e7ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:43:43.446 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:43.443+0000 7f3cb8df9640 1 --2- 172.21.15.150:0/3548585952 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3cb4147640 0x7f3cb4147a50 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f3cac005fd0 tx=0x7f3cac003f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:43:43.446 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:43.443+0000 7f3cb0ff9640 1 -- 172.21.15.150:0/3548585952 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3cac033050 con 0x7f3cb4147640 2024-09-17T05:43:43.446 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:43.443+0000 7f3cb0ff9640 1 -- 172.21.15.150:0/3548585952 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f3cac004450 con 0x7f3cb4147640 2024-09-17T05:43:43.446 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:43.443+0000 7f3cba85c640 1 -- 172.21.15.150:0/3548585952 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3cb415b980 con 0x7f3cb4147640 2024-09-17T05:43:43.446 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:43.443+0000 7f3cb0ff9640 1 -- 172.21.15.150:0/3548585952 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3cac004840 con 0x7f3cb4147640 2024-09-17T05:43:43.446 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:43.443+0000 7f3cba85c640 1 -- 172.21.15.150:0/3548585952 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3cb4146620 con 0x7f3cb4147640 2024-09-17T05:43:43.446 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:43.444+0000 7f3cba85c640 1 -- 172.21.15.150:0/3548585952 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3cb40b3b80 con 0x7f3cb4147640 2024-09-17T05:43:43.447 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:43.445+0000 7f3cb0ff9640 1 -- 172.21.15.150:0/3548585952 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 8) ==== 101645+0+0 (secure 0 0 0) 0x7f3cac036070 con 0x7f3cb4147640 2024-09-17T05:43:43.447 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:43.445+0000 7f3cb0ff9640 1 --2- 172.21.15.150:0/3548585952 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f3ca0078dd0 0x7f3ca007b2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:43:43.447 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:43.445+0000 7f3cb0ff9640 1 -- 172.21.15.150:0/3548585952 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7f3cac0bc870 con 0x7f3cb4147640 2024-09-17T05:43:43.447 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:43.445+0000 7f3cb3fff640 1 --2- 172.21.15.150:0/3548585952 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f3ca0078dd0 0x7f3ca007b2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:43:43.447 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:43.446+0000 7f3cb3fff640 1 --2- 172.21.15.150:0/3548585952 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f3ca0078dd0 0x7f3ca007b2e0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f3ca4007fd0 tx=0x7f3ca4009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:43:43.450 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:43.450+0000 7f3cb0ff9640 1 -- 172.21.15.150:0/3548585952 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f3cac037e90 con 0x7f3cb4147640 2024-09-17T05:43:43.649 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:43.648+0000 7f3cba85c640 1 -- 172.21.15.150:0/3548585952 --> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] -- mgr_command(tid 0: {"prefix": "fs subvolume ls", "vol_name": "cephfs", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f3cb40b56f0 con 0x7f3ca0078dd0 2024-09-17T05:43:43.653 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:43.653+0000 7f3cb0ff9640 1 -- 172.21.15.150:0/3548585952 <== mgr.4108 v2:172.21.15.176:6800/3631216395 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+44 (secure 0 0 0) 0x7f3cb40b56f0 con 0x7f3ca0078dd0 2024-09-17T05:43:43.653 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-09-17T05:43:43.653 INFO:teuthology.orchestra.run.smithi150.stdout:[ 2024-09-17T05:43:43.653 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-09-17T05:43:43.653 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "ss1clone1" 2024-09-17T05:43:43.654 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-09-17T05:43:43.654 INFO:teuthology.orchestra.run.smithi150.stdout:] 2024-09-17T05:43:43.655 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:43.655+0000 7f3cba85c640 1 -- 172.21.15.150:0/3548585952 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f3ca0078dd0 msgr2=0x7f3ca007b2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:43:43.656 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:43.655+0000 7f3cba85c640 1 --2- 172.21.15.150:0/3548585952 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f3ca0078dd0 0x7f3ca007b2e0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f3ca4007fd0 tx=0x7f3ca4009040 comp rx=0 tx=0).stop 2024-09-17T05:43:43.656 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:43.655+0000 7f3cba85c640 1 -- 172.21.15.150:0/3548585952 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3cb4147640 msgr2=0x7f3cb4147a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:43:43.656 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:43.655+0000 7f3cba85c640 1 --2- 172.21.15.150:0/3548585952 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3cb4147640 0x7f3cb4147a50 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f3cac005fd0 tx=0x7f3cac003f10 comp rx=0 tx=0).stop 2024-09-17T05:43:43.656 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:43.655+0000 7f3cba85c640 1 -- 172.21.15.150:0/3548585952 shutdown_connections 2024-09-17T05:43:43.656 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:43.655+0000 7f3cba85c640 1 --2- 172.21.15.150:0/3548585952 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f3ca0078dd0 0x7f3ca007b2e0 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:43:43.656 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:43.655+0000 7f3cba85c640 1 --2- 172.21.15.150:0/3548585952 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3cb4147640 0x7f3cb4147a50 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:43:43.656 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:43.655+0000 7f3cba85c640 1 --2- 172.21.15.150:0/3548585952 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3cb40ce730 0x7f3cb4147100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:43:43.656 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:43.655+0000 7f3cba85c640 1 --2- 172.21.15.150:0/3548585952 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3cb40b1350 0x7f3cb41e7ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:43:43.656 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:43.655+0000 7f3cba85c640 1 -- 172.21.15.150:0/3548585952 >> 172.21.15.150:0/3548585952 conn(0x7f3cb40b2ff0 msgr2=0x7f3cb415cbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:43:43.656 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:43.655+0000 7f3cba85c640 1 -- 172.21.15.150:0/3548585952 shutdown_connections 2024-09-17T05:43:43.656 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:43.655+0000 7f3cba85c640 1 -- 172.21.15.150:0/3548585952 wait complete. 2024-09-17T05:43:43.667 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume rm --force cephfs ss1clone1 2024-09-17T05:43:43.785 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:43.784+0000 7fafa1df1640 1 -- 172.21.15.150:0/2533450341 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7faf9c0b5d20 msgr2=0x7faf9c15be90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:43:43.785 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:43.784+0000 7fafa1df1640 1 --2- 172.21.15.150:0/2533450341 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7faf9c0b5d20 0x7faf9c15be90 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7faf9c072be0 tx=0x7faf9402aa30 comp rx=0 tx=0).stop 2024-09-17T05:43:43.785 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:43.784+0000 7fafa1df1640 1 -- 172.21.15.150:0/2533450341 shutdown_connections 2024-09-17T05:43:43.785 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:43.784+0000 7fafa1df1640 1 --2- 172.21.15.150:0/2533450341 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7faf9c0b5d20 0x7faf9c15be90 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:43:43.785 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:43.784+0000 7fafa1df1640 1 --2- 172.21.15.150:0/2533450341 >> v2:172.21.15.176:3300/0 conn(0x7faf9c0b42f0 0x7faf9c15cfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:43:43.785 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:43.784+0000 7fafa1df1640 1 -- 172.21.15.150:0/2533450341 >> 172.21.15.150:0/2533450341 conn(0x7faf9c09aa50 msgr2=0x7faf9c0b2ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:43:43.785 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:43.784+0000 7fafa1df1640 1 -- 172.21.15.150:0/2533450341 shutdown_connections 2024-09-17T05:43:43.785 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:43.784+0000 7fafa1df1640 1 -- 172.21.15.150:0/2533450341 wait complete. 2024-09-17T05:43:43.786 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:43.786+0000 7fafa1df1640 1 Processor -- start 2024-09-17T05:43:43.786 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:43.786+0000 7fafa1df1640 1 -- start start 2024-09-17T05:43:43.789 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:43.787+0000 7fafa1df1640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7faf9c0b42f0 0x7faf9c0d0b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:43:43.789 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:43.787+0000 7fafa1df1640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7faf9c15ba80 0x7faf9c14c990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:43:43.789 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:43.787+0000 7fafa1df1640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7faf9c1f9140 0x7faf9c1f9550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:43:43.789 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:43.787+0000 7fafa1df1640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7faf9c0afa10 con 0x7faf9c15ba80 2024-09-17T05:43:43.789 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:43.787+0000 7fafa1df1640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7faf9c0af890 con 0x7faf9c0b42f0 2024-09-17T05:43:43.790 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:43.787+0000 7fafa1df1640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7faf9c0afb90 con 0x7faf9c1f9140 2024-09-17T05:43:43.790 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:43.787+0000 7faf9affd640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7faf9c15ba80 0x7faf9c14c990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:43:43.790 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:43.787+0000 7faf9affd640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7faf9c15ba80 0x7faf9c14c990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:43798/0 (socket says 172.21.15.150:43798) 2024-09-17T05:43:43.790 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:43.787+0000 7faf9affd640 1 -- 172.21.15.150:0/1857064960 learned_addr learned my addr 172.21.15.150:0/1857064960 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:43:43.790 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:43.787+0000 7faf9b7fe640 1 --2- 172.21.15.150:0/1857064960 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7faf9c0b42f0 0x7faf9c0d0b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:43:43.790 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:43.787+0000 7faf9bfff640 1 --2- 172.21.15.150:0/1857064960 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7faf9c1f9140 0x7faf9c1f9550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:43:43.790 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:43.788+0000 7faf9affd640 1 -- 172.21.15.150:0/1857064960 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7faf9c1f9140 msgr2=0x7faf9c1f9550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:43:43.790 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:43.788+0000 7faf9affd640 1 --2- 172.21.15.150:0/1857064960 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7faf9c1f9140 0x7faf9c1f9550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:43:43.790 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:43.788+0000 7faf9affd640 1 -- 172.21.15.150:0/1857064960 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7faf9c0b42f0 msgr2=0x7faf9c0d0b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:43:43.790 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:43.788+0000 7faf9affd640 1 --2- 172.21.15.150:0/1857064960 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7faf9c0b42f0 0x7faf9c0d0b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:43:43.790 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:43.788+0000 7faf9affd640 1 -- 172.21.15.150:0/1857064960 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faf9c0cc550 con 0x7faf9c15ba80 2024-09-17T05:43:43.790 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:43.788+0000 7faf9affd640 1 --2- 172.21.15.150:0/1857064960 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7faf9c15ba80 0x7faf9c14c990 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7faf9000b3e0 tx=0x7faf9000b8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:43:43.790 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:43.788+0000 7faf83fff640 1 -- 172.21.15.150:0/1857064960 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf90015020 con 0x7faf9c15ba80 2024-09-17T05:43:43.791 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:43.788+0000 7faf83fff640 1 -- 172.21.15.150:0/1857064960 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7faf90011940 con 0x7faf9c15ba80 2024-09-17T05:43:43.791 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:43.788+0000 7fafa1df1640 1 -- 172.21.15.150:0/1857064960 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faf9c14fca0 con 0x7faf9c15ba80 2024-09-17T05:43:43.791 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:43.788+0000 7faf83fff640 1 -- 172.21.15.150:0/1857064960 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf90011d90 con 0x7faf9c15ba80 2024-09-17T05:43:43.791 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:43.788+0000 7fafa1df1640 1 -- 172.21.15.150:0/1857064960 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faf9c0cacd0 con 0x7faf9c15ba80 2024-09-17T05:43:43.791 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:43.789+0000 7fafa1df1640 1 -- 172.21.15.150:0/1857064960 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faf9c0d1100 con 0x7faf9c15ba80 2024-09-17T05:43:43.792 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:43.790+0000 7faf83fff640 1 -- 172.21.15.150:0/1857064960 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 8) ==== 101645+0+0 (secure 0 0 0) 0x7faf90018020 con 0x7faf9c15ba80 2024-09-17T05:43:43.792 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:43.790+0000 7faf83fff640 1 --2- 172.21.15.150:0/1857064960 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7faf88078dd0 0x7faf8807b2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:43:43.792 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:43.790+0000 7faf83fff640 1 -- 172.21.15.150:0/1857064960 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7faf9009af90 con 0x7faf9c15ba80 2024-09-17T05:43:43.792 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:43.790+0000 7faf9b7fe640 1 --2- 172.21.15.150:0/1857064960 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7faf88078dd0 0x7faf8807b2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:43:43.792 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:43.791+0000 7faf9b7fe640 1 --2- 172.21.15.150:0/1857064960 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7faf88078dd0 0x7faf8807b2e0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7faf8c0098e0 tx=0x7faf8c009060 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:43:43.795 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:43.795+0000 7faf83fff640 1 -- 172.21.15.150:0/1857064960 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7faf9001f020 con 0x7faf9c15ba80 2024-09-17T05:43:43.998 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:43.998+0000 7fafa1df1640 1 -- 172.21.15.150:0/1857064960 --> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] -- mgr_command(tid 0: {"prefix": "fs subvolume rm", "force": true, "vol_name": "cephfs", "sub_name": "ss1clone1", "target": ["mon-mgr", ""]}) -- 0x7faf9c0b39b0 con 0x7faf88078dd0 2024-09-17T05:43:46.609 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:46.607+0000 7faf83fff640 1 -- 172.21.15.150:0/1857064960 <== mgr.4108 v2:172.21.15.176:6800/3631216395 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7faf9c0b39b0 con 0x7faf88078dd0 2024-09-17T05:43:46.612 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:46.610+0000 7fafa1df1640 1 -- 172.21.15.150:0/1857064960 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7faf88078dd0 msgr2=0x7faf8807b2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:43:46.612 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:46.610+0000 7fafa1df1640 1 --2- 172.21.15.150:0/1857064960 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7faf88078dd0 0x7faf8807b2e0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7faf8c0098e0 tx=0x7faf8c009060 comp rx=0 tx=0).stop 2024-09-17T05:43:46.612 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:46.610+0000 7fafa1df1640 1 -- 172.21.15.150:0/1857064960 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7faf9c15ba80 msgr2=0x7faf9c14c990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:43:46.612 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:46.610+0000 7fafa1df1640 1 --2- 172.21.15.150:0/1857064960 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7faf9c15ba80 0x7faf9c14c990 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7faf9000b3e0 tx=0x7faf9000b8a0 comp rx=0 tx=0).stop 2024-09-17T05:43:46.613 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:46.610+0000 7fafa1df1640 1 -- 172.21.15.150:0/1857064960 shutdown_connections 2024-09-17T05:43:46.613 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:46.610+0000 7fafa1df1640 1 --2- 172.21.15.150:0/1857064960 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7faf88078dd0 0x7faf8807b2e0 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:43:46.613 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:46.610+0000 7fafa1df1640 1 --2- 172.21.15.150:0/1857064960 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7faf9c1f9140 0x7faf9c1f9550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:43:46.613 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:46.610+0000 7fafa1df1640 1 --2- 172.21.15.150:0/1857064960 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7faf9c15ba80 0x7faf9c14c990 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:43:46.613 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:46.610+0000 7fafa1df1640 1 --2- 172.21.15.150:0/1857064960 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7faf9c0b42f0 0x7faf9c0d0b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:43:46.613 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:46.610+0000 7fafa1df1640 1 -- 172.21.15.150:0/1857064960 >> 172.21.15.150:0/1857064960 conn(0x7faf9c09aa50 msgr2=0x7faf9c0b27a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:43:46.613 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:46.611+0000 7fafa1df1640 1 -- 172.21.15.150:0/1857064960 shutdown_connections 2024-09-17T05:43:46.613 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:46.611+0000 7fafa1df1640 1 -- 172.21.15.150:0/1857064960 wait complete. 2024-09-17T05:43:46.614 INFO:tasks.ceph.mgr.x.smithi176.stderr:2024-09-17T05:43:46.612+0000 7f33d971e640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-17T05:43:46.614 INFO:tasks.ceph.mgr.x.smithi176.stderr:2024-09-17T05:43:46.612+0000 7f33d971e640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-17T05:43:46.614 INFO:tasks.ceph.mgr.x.smithi176.stderr:2024-09-17T05:43:46.612+0000 7f33d971e640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-17T05:43:46.614 INFO:tasks.ceph.mgr.x.smithi176.stderr:2024-09-17T05:43:46.612+0000 7f33d971e640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-17T05:43:46.614 INFO:tasks.ceph.mgr.x.smithi176.stderr:2024-09-17T05:43:46.612+0000 7f33d971e640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-17T05:43:46.628 DEBUG:teuthology.orchestra.run.smithi150:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'stat -c %h /home/ubuntu/cephtest/mnt.0/./volumes/_deleting') 2024-09-17T05:43:46.628 INFO:tasks.ceph.mgr.x.smithi176.stderr:2024-09-17T05:43:46.627+0000 7f33da720640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-17T05:43:46.629 INFO:tasks.ceph.mgr.x.smithi176.stderr:2024-09-17T05:43:46.627+0000 7f33da720640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-17T05:43:46.629 INFO:tasks.ceph.mgr.x.smithi176.stderr:2024-09-17T05:43:46.627+0000 7f33da720640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-17T05:43:46.629 INFO:tasks.ceph.mgr.x.smithi176.stderr:2024-09-17T05:43:46.627+0000 7f33da720640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-17T05:43:46.629 INFO:tasks.ceph.mgr.x.smithi176.stderr:2024-09-17T05:43:46.627+0000 7f33da720640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-17T05:43:46.683 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:46 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-17T05:43:46.688 INFO:teuthology.orchestra.run.smithi150.stdout:2 2024-09-17T05:43:46.688 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:46 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T05:43:46.695 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mgr mgr/volumes/max_concurrent_clones 4 2024-09-17T05:43:46.812 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:46.810+0000 7fb69fa27640 1 -- 172.21.15.150:0/4022104862 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb6980b3ae0 msgr2=0x7fb6980d2370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:43:46.812 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:46.810+0000 7fb69fa27640 1 --2- 172.21.15.150:0/4022104862 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb6980b3ae0 0x7fb6980d2370 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7fb6980b9d60 tx=0x7fb69402a5d0 comp rx=0 tx=0).stop 2024-09-17T05:43:46.813 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:46.810+0000 7fb69fa27640 1 -- 172.21.15.150:0/4022104862 shutdown_connections 2024-09-17T05:43:46.813 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:46.810+0000 7fb69fa27640 1 --2- 172.21.15.150:0/4022104862 >> v2:172.21.15.176:3300/0 conn(0x7fb6981633e0 0x7fb698168bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:43:46.813 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:46.810+0000 7fb69fa27640 1 --2- 172.21.15.150:0/4022104862 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb6980b3ae0 0x7fb6980d2370 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:43:46.813 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:46.810+0000 7fb69fa27640 1 -- 172.21.15.150:0/4022104862 >> 172.21.15.150:0/4022104862 conn(0x7fb6980d4680 msgr2=0x7fb6980d4a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:43:46.813 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:46.810+0000 7fb69fa27640 1 -- 172.21.15.150:0/4022104862 shutdown_connections 2024-09-17T05:43:46.813 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:46.810+0000 7fb69fa27640 1 -- 172.21.15.150:0/4022104862 wait complete. 2024-09-17T05:43:46.813 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:46.812+0000 7fb69fa27640 1 Processor -- start 2024-09-17T05:43:46.814 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:46.812+0000 7fb69fa27640 1 -- start start 2024-09-17T05:43:46.817 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:46.813+0000 7fb69fa27640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb6980b3ae0 0x7fb6980cac50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:43:46.817 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:46.813+0000 7fb69fa27640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb6981628c0 0x7fb698145570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:43:46.817 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:46.814+0000 7fb69fa27640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb6981633e0 0x7fb698145ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:43:46.817 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:46.814+0000 7fb69fa27640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7fb6981692b0 con 0x7fb6981628c0 2024-09-17T05:43:46.817 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:46.814+0000 7fb69fa27640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fb698169130 con 0x7fb6981633e0 2024-09-17T05:43:46.817 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:46.814+0000 7fb69fa27640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fb698169430 con 0x7fb6980b3ae0 2024-09-17T05:43:46.817 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:46.814+0000 7fb69cfc2640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb6981628c0 0x7fb698145570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:43:46.818 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:46.814+0000 7fb69cfc2640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb6981628c0 0x7fb698145570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:43826/0 (socket says 172.21.15.150:43826) 2024-09-17T05:43:46.818 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:46.814+0000 7fb69cfc2640 1 -- 172.21.15.150:0/1856461827 learned_addr learned my addr 172.21.15.150:0/1856461827 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:43:46.818 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:46.814+0000 7fb69d7c3640 1 --2- 172.21.15.150:0/1856461827 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb6980b3ae0 0x7fb6980cac50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:43:46.818 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:46.814+0000 7fb69dfc4640 1 --2- 172.21.15.150:0/1856461827 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb6981633e0 0x7fb698145ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:43:46.818 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:46.814+0000 7fb69cfc2640 1 -- 172.21.15.150:0/1856461827 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb6980b3ae0 msgr2=0x7fb6980cac50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:43:46.818 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:46.814+0000 7fb69cfc2640 1 --2- 172.21.15.150:0/1856461827 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb6980b3ae0 0x7fb6980cac50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:43:46.818 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:46.814+0000 7fb69cfc2640 1 -- 172.21.15.150:0/1856461827 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb6981633e0 msgr2=0x7fb698145ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:43:46.818 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:46.814+0000 7fb69cfc2640 1 --2- 172.21.15.150:0/1856461827 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb6981633e0 0x7fb698145ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:43:46.820 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:46.814+0000 7fb69cfc2640 1 -- 172.21.15.150:0/1856461827 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb698146410 con 0x7fb6981628c0 2024-09-17T05:43:46.820 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:46.814+0000 7fb69cfc2640 1 --2- 172.21.15.150:0/1856461827 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb6981628c0 0x7fb698145570 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7fb68800c3a0 tx=0x7fb68800c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:43:46.820 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:46.814+0000 7fb68dffb640 1 -- 172.21.15.150:0/1856461827 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb688017070 con 0x7fb6981628c0 2024-09-17T05:43:46.820 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:46.814+0000 7fb68dffb640 1 -- 172.21.15.150:0/1856461827 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb6880053c0 con 0x7fb6981628c0 2024-09-17T05:43:46.820 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:46.814+0000 7fb69fa27640 1 -- 172.21.15.150:0/1856461827 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb6980ccbf0 con 0x7fb6981628c0 2024-09-17T05:43:46.820 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:46.814+0000 7fb68dffb640 1 -- 172.21.15.150:0/1856461827 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb688003850 con 0x7fb6981628c0 2024-09-17T05:43:46.821 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:46.815+0000 7fb69fa27640 1 -- 172.21.15.150:0/1856461827 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb6980cd1b0 con 0x7fb6981628c0 2024-09-17T05:43:46.821 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:46.816+0000 7fb69fa27640 1 -- 172.21.15.150:0/1856461827 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb69808d090 con 0x7fb6981628c0 2024-09-17T05:43:46.822 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:46.816+0000 7fb68dffb640 1 -- 172.21.15.150:0/1856461827 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 8) ==== 101645+0+0 (secure 0 0 0) 0x7fb68801a070 con 0x7fb6981628c0 2024-09-17T05:43:46.822 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:46.817+0000 7fb68dffb640 1 --2- 172.21.15.150:0/1856461827 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fb67c078dd0 0x7fb67c07b2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:43:46.822 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:46.817+0000 7fb68dffb640 1 -- 172.21.15.150:0/1856461827 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7fb68809a4b0 con 0x7fb6981628c0 2024-09-17T05:43:46.822 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:46.817+0000 7fb69d7c3640 1 --2- 172.21.15.150:0/1856461827 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fb67c078dd0 0x7fb67c07b2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:43:46.822 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:46.817+0000 7fb69d7c3640 1 --2- 172.21.15.150:0/1856461827 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fb67c078dd0 0x7fb67c07b2e0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fb694034000 tx=0x7fb694004730 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:43:46.822 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:46.821+0000 7fb68dffb640 1 -- 172.21.15.150:0/1856461827 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fb69808d090 con 0x7fb6981628c0 2024-09-17T05:43:47.002 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:47.000+0000 7fb69fa27640 1 -- 172.21.15.150:0/1856461827 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command([{prefix=config set, name=mgr/volumes/max_concurrent_clones}] v 0) -- 0x7fb6980d2370 con 0x7fb6981628c0 2024-09-17T05:43:47.002 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:47.001+0000 7fb68dffb640 1 -- 172.21.15.150:0/1856461827 <== mon.0 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/volumes/max_concurrent_clones}]=0 v33)=0 v33) ==== 131+0+0 (secure 0 0 0) 0x7fb688061f00 con 0x7fb6981628c0 2024-09-17T05:43:47.005 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:47.003+0000 7fb69fa27640 1 -- 172.21.15.150:0/1856461827 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fb67c078dd0 msgr2=0x7fb67c07b2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:43:47.005 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:47.003+0000 7fb69fa27640 1 --2- 172.21.15.150:0/1856461827 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fb67c078dd0 0x7fb67c07b2e0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fb694034000 tx=0x7fb694004730 comp rx=0 tx=0).stop 2024-09-17T05:43:47.005 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:47.003+0000 7fb69fa27640 1 -- 172.21.15.150:0/1856461827 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb6981628c0 msgr2=0x7fb698145570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:43:47.005 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:47.003+0000 7fb69fa27640 1 --2- 172.21.15.150:0/1856461827 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb6981628c0 0x7fb698145570 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7fb68800c3a0 tx=0x7fb68800c860 comp rx=0 tx=0).stop 2024-09-17T05:43:47.005 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:47.003+0000 7fb69fa27640 1 -- 172.21.15.150:0/1856461827 shutdown_connections 2024-09-17T05:43:47.005 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:47.003+0000 7fb69fa27640 1 --2- 172.21.15.150:0/1856461827 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb6981633e0 0x7fb698145ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:43:47.005 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:47.003+0000 7fb69fa27640 1 --2- 172.21.15.150:0/1856461827 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fb67c078dd0 0x7fb67c07b2e0 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:43:47.006 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:47.003+0000 7fb69fa27640 1 --2- 172.21.15.150:0/1856461827 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb6981628c0 0x7fb698145570 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:43:47.006 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:47.003+0000 7fb69fa27640 1 --2- 172.21.15.150:0/1856461827 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb6980b3ae0 0x7fb6980cac50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:43:47.006 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:47.003+0000 7fb69fa27640 1 -- 172.21.15.150:0/1856461827 >> 172.21.15.150:0/1856461827 conn(0x7fb6980d4680 msgr2=0x7fb698068e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:43:47.006 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:47.003+0000 7fb69fa27640 1 -- 172.21.15.150:0/1856461827 shutdown_connections 2024-09-17T05:43:47.006 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:47.003+0000 7fb69fa27640 1 -- 172.21.15.150:0/1856461827 wait complete. 2024-09-17T05:43:47.015 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-17T05:43:47.016 DEBUG:teuthology.orchestra.run.smithi150:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-17T05:43:47.053 DEBUG:teuthology.orchestra.run.smithi176:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-17T05:43:47.100 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-17T05:43:47.100 INFO:tasks.cephfs.mount:Terminating background process 2024-09-17T05:43:47.100 DEBUG:teuthology.orchestra.run.smithi150:> set -ex 2024-09-17T05:43:47.100 DEBUG:teuthology.orchestra.run.smithi150:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T05:43:47.116 DEBUG:teuthology.orchestra.run.smithi150:> set -ex 2024-09-17T05:43:47.116 DEBUG:teuthology.orchestra.run.smithi150:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T05:43:47.172 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-17T05:43:47.326 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:47.325+0000 7f4a4ada8640 1 -- 172.21.15.150:0/1902593382 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4a440ae880 msgr2=0x7f4a44165580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:43:47.327 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:47.325+0000 7f4a4ada8640 1 --2- 172.21.15.150:0/1902593382 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4a440ae880 0x7f4a44165580 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f4a3c005fd0 tx=0x7f4a3c02aa00 comp rx=0 tx=0).stop 2024-09-17T05:43:47.327 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:47.325+0000 7f4a4ada8640 1 -- 172.21.15.150:0/1902593382 shutdown_connections 2024-09-17T05:43:47.327 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:47.325+0000 7f4a4ada8640 1 --2- 172.21.15.150:0/1902593382 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4a440ae880 0x7f4a44165580 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:43:47.327 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:47.325+0000 7f4a4ada8640 1 --2- 172.21.15.150:0/1902593382 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4a440d0cd0 0x7f4a440ae340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:43:47.327 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:47.325+0000 7f4a4ada8640 1 -- 172.21.15.150:0/1902593382 >> 172.21.15.150:0/1902593382 conn(0x7f4a440b6880 msgr2=0x7f4a440b3060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:43:47.327 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:47.325+0000 7f4a4ada8640 1 -- 172.21.15.150:0/1902593382 shutdown_connections 2024-09-17T05:43:47.327 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:47.325+0000 7f4a4ada8640 1 -- 172.21.15.150:0/1902593382 wait complete. 2024-09-17T05:43:47.328 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:47.326+0000 7f4a4ada8640 1 Processor -- start 2024-09-17T05:43:47.328 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:47.326+0000 7f4a4ada8640 1 -- start start 2024-09-17T05:43:47.330 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:47.328+0000 7f4a4ada8640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4a440ae880 0x7f4a44145f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:43:47.331 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:47.328+0000 7f4a4ada8640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4a440d0cd0 0x7f4a44150090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:43:47.331 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:47.328+0000 7f4a4ada8640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4a44156130 0x7f4a44148fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:43:47.331 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:47.328+0000 7f4a4ada8640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f4a44165c40 con 0x7f4a44156130 2024-09-17T05:43:47.331 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:47.328+0000 7f4a4ada8640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f4a44165ac0 con 0x7f4a440ae880 2024-09-17T05:43:47.331 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:47.328+0000 7f4a4ada8640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f4a44165dc0 con 0x7f4a440d0cd0 2024-09-17T05:43:47.331 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:47.328+0000 7f4a49345640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4a44156130 0x7f4a44148fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:43:47.331 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:47.328+0000 7f4a49345640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4a44156130 0x7f4a44148fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:43848/0 (socket says 172.21.15.150:43848) 2024-09-17T05:43:47.331 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:47.328+0000 7f4a49345640 1 -- 172.21.15.150:0/1934962846 learned_addr learned my addr 172.21.15.150:0/1934962846 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:43:47.331 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:47.328+0000 7f4a43fff640 1 --2- 172.21.15.150:0/1934962846 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4a440d0cd0 0x7f4a44150090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:43:47.331 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:47.328+0000 7f4a48b44640 1 --2- 172.21.15.150:0/1934962846 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4a440ae880 0x7f4a44145f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:43:47.331 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:47.328+0000 7f4a49345640 1 -- 172.21.15.150:0/1934962846 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4a440d0cd0 msgr2=0x7f4a44150090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:43:47.332 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:47.328+0000 7f4a49345640 1 --2- 172.21.15.150:0/1934962846 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4a440d0cd0 0x7f4a44150090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:43:47.332 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:47.328+0000 7f4a49345640 1 -- 172.21.15.150:0/1934962846 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4a440ae880 msgr2=0x7f4a44145f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:43:47.332 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:47.328+0000 7f4a49345640 1 --2- 172.21.15.150:0/1934962846 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4a440ae880 0x7f4a44145f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:43:47.332 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:47.328+0000 7f4a49345640 1 -- 172.21.15.150:0/1934962846 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4a44071d70 con 0x7f4a44156130 2024-09-17T05:43:47.332 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:47.328+0000 7f4a48b44640 1 --2- 172.21.15.150:0/1934962846 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4a440ae880 0x7f4a44145f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:43:47.332 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:47.328+0000 7f4a43fff640 1 --2- 172.21.15.150:0/1934962846 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4a440d0cd0 0x7f4a44150090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:43:47.332 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:47.329+0000 7f4a49345640 1 --2- 172.21.15.150:0/1934962846 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4a44156130 0x7f4a44148fb0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f4a3c009d90 tx=0x7f4a3c02f6d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:43:47.332 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:47.329+0000 7f4a417fa640 1 -- 172.21.15.150:0/1934962846 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a3c033050 con 0x7f4a44156130 2024-09-17T05:43:47.332 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:47.329+0000 7f4a417fa640 1 -- 172.21.15.150:0/1934962846 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f4a3c0044d0 con 0x7f4a44156130 2024-09-17T05:43:47.332 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:47.329+0000 7f4a4ada8640 1 -- 172.21.15.150:0/1934962846 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4a44151900 con 0x7f4a44156130 2024-09-17T05:43:47.332 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:47.329+0000 7f4a417fa640 1 -- 172.21.15.150:0/1934962846 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a3c038450 con 0x7f4a44156130 2024-09-17T05:43:47.332 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:47.329+0000 7f4a4ada8640 1 -- 172.21.15.150:0/1934962846 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4a44150cf0 con 0x7f4a44156130 2024-09-17T05:43:47.333 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:47.330+0000 7f4a4ada8640 1 -- 172.21.15.150:0/1934962846 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4a44155a20 con 0x7f4a44156130 2024-09-17T05:43:47.333 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:47.331+0000 7f4a417fa640 1 -- 172.21.15.150:0/1934962846 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 8) ==== 101645+0+0 (secure 0 0 0) 0x7f4a3c036070 con 0x7f4a44156130 2024-09-17T05:43:47.333 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:47.331+0000 7f4a417fa640 1 --2- 172.21.15.150:0/1934962846 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f4a30078dd0 0x7f4a3007b2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:43:47.333 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:47.331+0000 7f4a417fa640 1 -- 172.21.15.150:0/1934962846 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7f4a3c0bc8f0 con 0x7f4a44156130 2024-09-17T05:43:47.334 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:47.331+0000 7f4a48b44640 1 --2- 172.21.15.150:0/1934962846 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f4a30078dd0 0x7f4a3007b2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:43:47.334 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:47.332+0000 7f4a48b44640 1 --2- 172.21.15.150:0/1934962846 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f4a30078dd0 0x7f4a3007b2e0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f4a34006fd0 tx=0x7f4a34008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:43:47.337 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:47.336+0000 7f4a417fa640 1 -- 172.21.15.150:0/1934962846 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f4a44155a20 con 0x7f4a44156130 2024-09-17T05:43:47.524 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:47.523+0000 7f4a4ada8640 1 -- 172.21.15.150:0/1934962846 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f4a440cfd30 con 0x7f4a44156130 2024-09-17T05:43:47.525 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:47.523+0000 7f4a417fa640 1 -- 172.21.15.150:0/1934962846 <== mon.0 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v34) ==== 80+0+0 (secure 0 0 0) 0x7f4a440cfd30 con 0x7f4a44156130 2024-09-17T05:43:47.525 INFO:teuthology.orchestra.run.smithi150.stderr:listed 0 entries 2024-09-17T05:43:47.527 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:47.525+0000 7f4a4ada8640 1 -- 172.21.15.150:0/1934962846 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f4a30078dd0 msgr2=0x7f4a3007b2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:43:47.527 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:47.525+0000 7f4a4ada8640 1 --2- 172.21.15.150:0/1934962846 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f4a30078dd0 0x7f4a3007b2e0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f4a34006fd0 tx=0x7f4a34008040 comp rx=0 tx=0).stop 2024-09-17T05:43:47.527 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:47.525+0000 7f4a4ada8640 1 -- 172.21.15.150:0/1934962846 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4a44156130 msgr2=0x7f4a44148fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:43:47.528 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:47.525+0000 7f4a4ada8640 1 --2- 172.21.15.150:0/1934962846 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4a44156130 0x7f4a44148fb0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f4a3c009d90 tx=0x7f4a3c02f6d0 comp rx=0 tx=0).stop 2024-09-17T05:43:47.528 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:47.525+0000 7f4a4ada8640 1 -- 172.21.15.150:0/1934962846 shutdown_connections 2024-09-17T05:43:47.528 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:47.525+0000 7f4a4ada8640 1 --2- 172.21.15.150:0/1934962846 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f4a30078dd0 0x7f4a3007b2e0 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:43:47.528 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:47.525+0000 7f4a4ada8640 1 --2- 172.21.15.150:0/1934962846 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4a44156130 0x7f4a44148fb0 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:43:47.528 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:47.525+0000 7f4a4ada8640 1 --2- 172.21.15.150:0/1934962846 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4a440d0cd0 0x7f4a44150090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:43:47.528 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:47.525+0000 7f4a4ada8640 1 --2- 172.21.15.150:0/1934962846 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4a440ae880 0x7f4a44145f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:43:47.528 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:47.525+0000 7f4a4ada8640 1 -- 172.21.15.150:0/1934962846 >> 172.21.15.150:0/1934962846 conn(0x7f4a440b6880 msgr2=0x7f4a4414ace0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:43:47.528 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:47.526+0000 7f4a4ada8640 1 -- 172.21.15.150:0/1934962846 shutdown_connections 2024-09-17T05:43:47.528 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:47.526+0000 7f4a4ada8640 1 -- 172.21.15.150:0/1934962846 wait complete. 2024-09-17T05:43:47.538 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-09-17T05:43:47.538 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:43:47.538 DEBUG:teuthology.orchestra.run.smithi150:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-09-17T05:43:48.139 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi150.front.sepia.ceph.com 2024-09-17T05:43:48.140 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:43:48.140 DEBUG:teuthology.orchestra.run.smithi150:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-17T05:43:48.177 INFO:tasks.cephfs.mount:Terminating background process 2024-09-17T05:43:48.177 DEBUG:teuthology.orchestra.run.smithi176:> set -ex 2024-09-17T05:43:48.177 DEBUG:teuthology.orchestra.run.smithi176:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T05:43:48.194 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056030,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497468k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=3379 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248732k,nr_inodes=812183,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497468k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-17T05:43:48.194 INFO:tasks.cephfs.mount:Terminating background process 2024-09-17T05:43:48.194 DEBUG:teuthology.orchestra.run.smithi150:> set -ex 2024-09-17T05:43:48.194 DEBUG:teuthology.orchestra.run.smithi150:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T05:43:48.233 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056027,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497464k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=18693 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248728k,nr_inodes=812182,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497464k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-17T05:43:48.233 INFO:tasks.cephfs.mount:Terminating background process 2024-09-17T05:43:48.234 DEBUG:teuthology.orchestra.run.smithi176:> set -ex 2024-09-17T05:43:48.234 DEBUG:teuthology.orchestra.run.smithi176:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T05:43:48.250 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056030,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497468k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=3379 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248732k,nr_inodes=812183,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497468k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-17T05:43:48.250 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T05:43:48.387 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:48.385+0000 7fa9ced69640 1 -- 172.21.15.150:0/1863232724 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa9c80b9d10 msgr2=0x7fa9c80d2f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:43:48.387 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:48.385+0000 7fa9ced69640 1 --2- 172.21.15.150:0/1863232724 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa9c80b9d10 0x7fa9c80d2f60 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7fa9c80d2180 tx=0x7fa9b802a4a0 comp rx=0 tx=0).stop 2024-09-17T05:43:48.387 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:48.385+0000 7fa9ced69640 1 -- 172.21.15.150:0/1863232724 shutdown_connections 2024-09-17T05:43:48.387 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:48.385+0000 7fa9ced69640 1 --2- 172.21.15.150:0/1863232724 >> v2:172.21.15.176:3300/0 conn(0x7fa9c80d1020 0x7fa9c80d1430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:43:48.387 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:48.385+0000 7fa9ced69640 1 --2- 172.21.15.150:0/1863232724 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa9c80b9d10 0x7fa9c80d2f60 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:43:48.388 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:48.385+0000 7fa9ced69640 1 -- 172.21.15.150:0/1863232724 >> 172.21.15.150:0/1863232724 conn(0x7fa9c808bfe0 msgr2=0x7fa9c80d4650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:43:48.388 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:48.385+0000 7fa9ced69640 1 -- 172.21.15.150:0/1863232724 shutdown_connections 2024-09-17T05:43:48.388 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:48.385+0000 7fa9ced69640 1 -- 172.21.15.150:0/1863232724 wait complete. 2024-09-17T05:43:48.388 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:48.387+0000 7fa9ced69640 1 Processor -- start 2024-09-17T05:43:48.388 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:48.387+0000 7fa9ced69640 1 -- start start 2024-09-17T05:43:48.391 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:48.388+0000 7fa9ced69640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa9c80b9d10 0x7fa9c81f9f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:43:48.391 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:48.388+0000 7fa9ced69640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa9c80d1020 0x7fa9c814e8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:43:48.391 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:48.388+0000 7fa9ced69640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa9c80d50c0 0x7fa9c80cce40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:43:48.391 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:48.388+0000 7fa9ced69640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7fa9c80b4300 con 0x7fa9c80b9d10 2024-09-17T05:43:48.391 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:48.388+0000 7fa9ced69640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fa9c80b4180 con 0x7fa9c80d50c0 2024-09-17T05:43:48.392 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:48.388+0000 7fa9ced69640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fa9c80b4480 con 0x7fa9c80d1020 2024-09-17T05:43:48.392 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:48.388+0000 7fa9ccb05640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa9c80b9d10 0x7fa9c81f9f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:43:48.392 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:48.389+0000 7fa9ccb05640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa9c80b9d10 0x7fa9c81f9f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:43862/0 (socket says 172.21.15.150:43862) 2024-09-17T05:43:48.392 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:48.389+0000 7fa9ccb05640 1 -- 172.21.15.150:0/3381389041 learned_addr learned my addr 172.21.15.150:0/3381389041 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:43:48.392 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:48.389+0000 7fa9cd306640 1 --2- 172.21.15.150:0/3381389041 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa9c80d50c0 0x7fa9c80cce40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:43:48.392 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:48.389+0000 7fa9c7fff640 1 --2- 172.21.15.150:0/3381389041 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa9c80d1020 0x7fa9c814e8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:43:48.392 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:48.389+0000 7fa9ccb05640 1 -- 172.21.15.150:0/3381389041 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa9c80d1020 msgr2=0x7fa9c814e8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:43:48.392 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:48.389+0000 7fa9ccb05640 1 --2- 172.21.15.150:0/3381389041 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa9c80d1020 0x7fa9c814e8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:43:48.392 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:48.389+0000 7fa9ccb05640 1 -- 172.21.15.150:0/3381389041 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa9c80d50c0 msgr2=0x7fa9c80cce40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:43:48.392 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:48.389+0000 7fa9ccb05640 1 --2- 172.21.15.150:0/3381389041 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa9c80d50c0 0x7fa9c80cce40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:43:48.392 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:48.389+0000 7fa9ccb05640 1 -- 172.21.15.150:0/3381389041 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa9c81fa450 con 0x7fa9c80b9d10 2024-09-17T05:43:48.392 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:48.389+0000 7fa9ccb05640 1 --2- 172.21.15.150:0/3381389041 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa9c80b9d10 0x7fa9c81f9f10 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7fa9b8009780 tx=0x7fa9b8033c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:43:48.393 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:48.389+0000 7fa9c57fa640 1 -- 172.21.15.150:0/3381389041 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9b8031d60 con 0x7fa9c80b9d10 2024-09-17T05:43:48.393 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:48.389+0000 7fa9c57fa640 1 -- 172.21.15.150:0/3381389041 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa9b8033e10 con 0x7fa9c80b9d10 2024-09-17T05:43:48.393 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:48.389+0000 7fa9ced69640 1 -- 172.21.15.150:0/3381389041 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa9c81f5ed0 con 0x7fa9c80b9d10 2024-09-17T05:43:48.393 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:48.389+0000 7fa9c57fa640 1 -- 172.21.15.150:0/3381389041 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9b8005260 con 0x7fa9c80b9d10 2024-09-17T05:43:48.393 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:48.389+0000 7fa9ced69640 1 -- 172.21.15.150:0/3381389041 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa9c81f6190 con 0x7fa9c80b9d10 2024-09-17T05:43:48.394 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:48.390+0000 7fa9ced69640 1 -- 172.21.15.150:0/3381389041 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa9c80b4950 con 0x7fa9c80b9d10 2024-09-17T05:43:48.394 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:48.391+0000 7fa9c57fa640 1 -- 172.21.15.150:0/3381389041 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 9) ==== 101747+0+0 (secure 0 0 0) 0x7fa9b8005400 con 0x7fa9c80b9d10 2024-09-17T05:43:48.394 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:48.391+0000 7fa9c57fa640 1 --2- 172.21.15.150:0/3381389041 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fa9b4078ef0 0x7fa9b407b400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:43:48.395 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:48.391+0000 7fa9c57fa640 1 -- 172.21.15.150:0/3381389041 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7fa9b80bc690 con 0x7fa9c80b9d10 2024-09-17T05:43:48.395 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:48.392+0000 7fa9c7fff640 1 --2- 172.21.15.150:0/3381389041 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fa9b4078ef0 0x7fa9b407b400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:43:48.395 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:48.392+0000 7fa9c7fff640 1 --2- 172.21.15.150:0/3381389041 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fa9b4078ef0 0x7fa9b407b400 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fa9c80ce2c0 tx=0x7fa9bc009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:43:48.397 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:48.396+0000 7fa9c57fa640 1 -- 172.21.15.150:0/3381389041 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fa9c81fa450 con 0x7fa9c80b9d10 2024-09-17T05:43:48.606 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:48.605+0000 7fa9ced69640 1 -- 172.21.15.150:0/3381389041 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fa9c80d1db0 con 0x7fa9c80b9d10 2024-09-17T05:43:48.607 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:48.606+0000 7fa9c57fa640 1 -- 172.21.15.150:0/3381389041 <== mon.0 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 16 v16) ==== 94+0+5232 (secure 0 0 0) 0x7fa9b803f030 con 0x7fa9c80b9d10 2024-09-17T05:43:48.607 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-09-17T05:43:48.608 INFO:teuthology.orchestra.run.smithi150.stdout:{"epoch":16,"btime":"2024-09-17T05:42:51:051729+0000","default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4664,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6835/392464003","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6833","nonce":392464003},{"type":"v1","addr":"172.21.15.150:6835","nonce":392464003}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":4673,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6837/3232718608","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6835","nonce":3232718608},{"type":"v1","addr":"172.21.15.176:6837","nonce":3232718608}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":4867,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6836/2911955319","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6834","nonce":2911955319},{"type":"v1","addr":"172.21.15.176:6836","nonce":2911955319}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10}],"filesystems":[{"mdsmap":{"epoch":15,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T05:42:38.152690+0000","modified":"2024-09-17T05:42:41.171759+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4938},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4938":{"gid":4938,"name":"a","rank":0,"incarnation":11,"state":"up:active","state_seq":3,"addr":"172.21.15.150:6834/2837553407","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6832","nonce":2837553407},{"type":"v1","addr":"172.21.15.150:6834","nonce":2837553407}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4938,"qdb_cluster":[4938]},"id":2}]} 2024-09-17T05:43:48.608 INFO:teuthology.orchestra.run.smithi150.stderr:dumped fsmap epoch 16 2024-09-17T05:43:48.610 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:48.608+0000 7fa9ced69640 1 -- 172.21.15.150:0/3381389041 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fa9b4078ef0 msgr2=0x7fa9b407b400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:43:48.610 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:48.608+0000 7fa9ced69640 1 --2- 172.21.15.150:0/3381389041 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fa9b4078ef0 0x7fa9b407b400 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fa9c80ce2c0 tx=0x7fa9bc009040 comp rx=0 tx=0).stop 2024-09-17T05:43:48.610 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:48.608+0000 7fa9ced69640 1 -- 172.21.15.150:0/3381389041 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa9c80b9d10 msgr2=0x7fa9c81f9f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:43:48.610 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:48.608+0000 7fa9ced69640 1 --2- 172.21.15.150:0/3381389041 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa9c80b9d10 0x7fa9c81f9f10 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7fa9b8009780 tx=0x7fa9b8033c20 comp rx=0 tx=0).stop 2024-09-17T05:43:48.610 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:48.608+0000 7fa9ced69640 1 -- 172.21.15.150:0/3381389041 shutdown_connections 2024-09-17T05:43:48.610 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:48.608+0000 7fa9ced69640 1 --2- 172.21.15.150:0/3381389041 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa9c80d50c0 0x7fa9c80cce40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:43:48.610 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:48.608+0000 7fa9ced69640 1 --2- 172.21.15.150:0/3381389041 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fa9b4078ef0 0x7fa9b407b400 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:43:48.610 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:48.608+0000 7fa9ced69640 1 --2- 172.21.15.150:0/3381389041 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa9c80d1020 0x7fa9c814e8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:43:48.611 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:48.608+0000 7fa9ced69640 1 --2- 172.21.15.150:0/3381389041 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa9c80b9d10 0x7fa9c81f9f10 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:43:48.611 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:48.608+0000 7fa9ced69640 1 -- 172.21.15.150:0/3381389041 >> 172.21.15.150:0/3381389041 conn(0x7fa9c808bfe0 msgr2=0x7fa9c80b31d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:43:48.611 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:48.608+0000 7fa9ced69640 1 -- 172.21.15.150:0/3381389041 shutdown_connections 2024-09-17T05:43:48.611 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:48.608+0000 7fa9ced69640 1 -- 172.21.15.150:0/3381389041 wait complete. 2024-09-17T05:43:48.622 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T05:43:48.734 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:48.732+0000 7eff45071640 1 -- 172.21.15.150:0/3804814866 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7eff4006d2e0 msgr2=0x7eff4015c770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:43:48.734 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:48.732+0000 7eff45071640 1 --2- 172.21.15.150:0/3804814866 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7eff4006d2e0 0x7eff4015c770 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7eff38005fd0 tx=0x7eff3802aa90 comp rx=0 tx=0).stop 2024-09-17T05:43:48.734 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:48.732+0000 7eff45071640 1 -- 172.21.15.150:0/3804814866 shutdown_connections 2024-09-17T05:43:48.735 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:48.732+0000 7eff45071640 1 --2- 172.21.15.150:0/3804814866 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7eff4006d2e0 0x7eff4015c770 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:43:48.735 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:48.732+0000 7eff45071640 1 --2- 172.21.15.150:0/3804814866 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7eff400b2360 0x7eff4006cda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:43:48.735 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:48.732+0000 7eff45071640 1 -- 172.21.15.150:0/3804814866 >> 172.21.15.150:0/3804814866 conn(0x7eff400b2fd0 msgr2=0x7eff400b33e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:43:48.735 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:48.732+0000 7eff45071640 1 -- 172.21.15.150:0/3804814866 shutdown_connections 2024-09-17T05:43:48.735 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:48.733+0000 7eff45071640 1 -- 172.21.15.150:0/3804814866 wait complete. 2024-09-17T05:43:48.736 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:48.734+0000 7eff45071640 1 Processor -- start 2024-09-17T05:43:48.736 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:48.735+0000 7eff45071640 1 -- start start 2024-09-17T05:43:48.739 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:48.736+0000 7eff45071640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7eff4006d2e0 0x7eff4014f3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:43:48.739 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:48.736+0000 7eff45071640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7eff400b2360 0x7eff4014fcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:43:48.739 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:48.736+0000 7eff45071640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7eff400cd8f0 0x7eff40150230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:43:48.739 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:48.736+0000 7eff45071640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7eff400b4e80 con 0x7eff400cd8f0 2024-09-17T05:43:48.739 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:48.736+0000 7eff45071640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7eff400b7010 con 0x7eff4006d2e0 2024-09-17T05:43:48.739 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:48.736+0000 7eff45071640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7eff400b5000 con 0x7eff400b2360 2024-09-17T05:43:48.739 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:48.736+0000 7eff3f59e640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7eff400cd8f0 0x7eff40150230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:43:48.740 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:48.736+0000 7eff3f59e640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7eff400cd8f0 0x7eff40150230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:43878/0 (socket says 172.21.15.150:43878) 2024-09-17T05:43:48.740 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:48.736+0000 7eff3f59e640 1 -- 172.21.15.150:0/3360450060 learned_addr learned my addr 172.21.15.150:0/3360450060 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:43:48.740 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:48.736+0000 7eff3ed9d640 1 --2- 172.21.15.150:0/3360450060 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7eff4006d2e0 0x7eff4014f3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:43:48.740 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:48.736+0000 7eff3659c640 1 --2- 172.21.15.150:0/3360450060 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7eff400b2360 0x7eff4014fcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:43:48.740 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:48.736+0000 7eff3f59e640 1 -- 172.21.15.150:0/3360450060 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7eff400b2360 msgr2=0x7eff4014fcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:43:48.740 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:48.736+0000 7eff3f59e640 1 --2- 172.21.15.150:0/3360450060 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7eff400b2360 0x7eff4014fcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:43:48.740 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:48.736+0000 7eff3f59e640 1 -- 172.21.15.150:0/3360450060 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7eff4006d2e0 msgr2=0x7eff4014f3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:43:48.740 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:48.736+0000 7eff3f59e640 1 --2- 172.21.15.150:0/3360450060 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7eff4006d2e0 0x7eff4014f3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:43:48.740 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:48.736+0000 7eff3f59e640 1 -- 172.21.15.150:0/3360450060 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7eff400c56a0 con 0x7eff400cd8f0 2024-09-17T05:43:48.740 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:48.736+0000 7eff3ed9d640 1 --2- 172.21.15.150:0/3360450060 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7eff4006d2e0 0x7eff4014f3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T05:43:48.740 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:48.736+0000 7eff3659c640 1 --2- 172.21.15.150:0/3360450060 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7eff400b2360 0x7eff4014fcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T05:43:48.740 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:48.737+0000 7eff3f59e640 1 --2- 172.21.15.150:0/3360450060 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7eff400cd8f0 0x7eff40150230 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7eff38009d90 tx=0x7eff38003ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:43:48.740 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:48.737+0000 7eff37fff640 1 -- 172.21.15.150:0/3360450060 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff38044070 con 0x7eff400cd8f0 2024-09-17T05:43:48.741 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:48.737+0000 7eff37fff640 1 -- 172.21.15.150:0/3360450060 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7eff38004250 con 0x7eff400cd8f0 2024-09-17T05:43:48.741 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:48.737+0000 7eff37fff640 1 -- 172.21.15.150:0/3360450060 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff38004660 con 0x7eff400cd8f0 2024-09-17T05:43:48.741 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:48.737+0000 7eff45071640 1 -- 172.21.15.150:0/3360450060 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7eff400c5980 con 0x7eff400cd8f0 2024-09-17T05:43:48.741 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:48.737+0000 7eff45071640 1 -- 172.21.15.150:0/3360450060 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7eff400c5f40 con 0x7eff400cd8f0 2024-09-17T05:43:48.741 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:48.738+0000 7eff45071640 1 -- 172.21.15.150:0/3360450060 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7eff400c5410 con 0x7eff400cd8f0 2024-09-17T05:43:48.742 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:48.739+0000 7eff37fff640 1 -- 172.21.15.150:0/3360450060 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 9) ==== 101747+0+0 (secure 0 0 0) 0x7eff38047070 con 0x7eff400cd8f0 2024-09-17T05:43:48.742 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:48.739+0000 7eff37fff640 1 --2- 172.21.15.150:0/3360450060 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7eff20078ef0 0x7eff2007b400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:43:48.742 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:48.739+0000 7eff37fff640 1 -- 172.21.15.150:0/3360450060 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7eff380bc370 con 0x7eff400cd8f0 2024-09-17T05:43:48.742 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:48.739+0000 7eff3ed9d640 1 --2- 172.21.15.150:0/3360450060 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7eff20078ef0 0x7eff2007b400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:43:48.742 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:48.740+0000 7eff3ed9d640 1 --2- 172.21.15.150:0/3360450060 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7eff20078ef0 0x7eff2007b400 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7eff30009aa0 tx=0x7eff30005db0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:43:48.745 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:48.744+0000 7eff37fff640 1 -- 172.21.15.150:0/3360450060 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7eff38032030 con 0x7eff400cd8f0 2024-09-17T05:43:49.056 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:49.055+0000 7eff45071640 1 -- 172.21.15.150:0/3360450060 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7eff4006cda0 con 0x7eff400cd8f0 2024-09-17T05:43:49.057 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:49.055+0000 7eff37fff640 1 -- 172.21.15.150:0/3360450060 <== mon.0 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 16 v16) ==== 94+0+5232 (secure 0 0 0) 0x7eff38084290 con 0x7eff400cd8f0 2024-09-17T05:43:49.057 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-09-17T05:43:49.057 INFO:teuthology.orchestra.run.smithi150.stdout:{"epoch":16,"btime":"2024-09-17T05:42:51:051729+0000","default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4664,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6835/392464003","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6833","nonce":392464003},{"type":"v1","addr":"172.21.15.150:6835","nonce":392464003}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":4673,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6837/3232718608","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6835","nonce":3232718608},{"type":"v1","addr":"172.21.15.176:6837","nonce":3232718608}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":4867,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6836/2911955319","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6834","nonce":2911955319},{"type":"v1","addr":"172.21.15.176:6836","nonce":2911955319}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10}],"filesystems":[{"mdsmap":{"epoch":15,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T05:42:38.152690+0000","modified":"2024-09-17T05:42:41.171759+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4938},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4938":{"gid":4938,"name":"a","rank":0,"incarnation":11,"state":"up:active","state_seq":3,"addr":"172.21.15.150:6834/2837553407","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6832","nonce":2837553407},{"type":"v1","addr":"172.21.15.150:6834","nonce":2837553407}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4938,"qdb_cluster":[4938]},"id":2}]} 2024-09-17T05:43:49.057 INFO:teuthology.orchestra.run.smithi150.stderr:dumped fsmap epoch 16 2024-09-17T05:43:49.060 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:49.058+0000 7eff45071640 1 -- 172.21.15.150:0/3360450060 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7eff20078ef0 msgr2=0x7eff2007b400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:43:49.060 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:49.058+0000 7eff45071640 1 --2- 172.21.15.150:0/3360450060 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7eff20078ef0 0x7eff2007b400 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7eff30009aa0 tx=0x7eff30005db0 comp rx=0 tx=0).stop 2024-09-17T05:43:49.060 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:49.058+0000 7eff45071640 1 -- 172.21.15.150:0/3360450060 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7eff400cd8f0 msgr2=0x7eff40150230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:43:49.060 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:49.058+0000 7eff45071640 1 --2- 172.21.15.150:0/3360450060 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7eff400cd8f0 0x7eff40150230 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7eff38009d90 tx=0x7eff38003ce0 comp rx=0 tx=0).stop 2024-09-17T05:43:49.060 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:49.059+0000 7eff45071640 1 -- 172.21.15.150:0/3360450060 shutdown_connections 2024-09-17T05:43:49.061 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:49.059+0000 7eff45071640 1 --2- 172.21.15.150:0/3360450060 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7eff20078ef0 0x7eff2007b400 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:43:49.061 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:49.059+0000 7eff45071640 1 --2- 172.21.15.150:0/3360450060 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7eff400cd8f0 0x7eff40150230 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:43:49.061 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:49.059+0000 7eff45071640 1 --2- 172.21.15.150:0/3360450060 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7eff400b2360 0x7eff4014fcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:43:49.061 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:49.059+0000 7eff45071640 1 --2- 172.21.15.150:0/3360450060 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7eff4006d2e0 0x7eff4014f3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:43:49.061 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:49.059+0000 7eff45071640 1 -- 172.21.15.150:0/3360450060 >> 172.21.15.150:0/3360450060 conn(0x7eff400b2fd0 msgr2=0x7eff400aea20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:43:49.061 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:49.059+0000 7eff45071640 1 -- 172.21.15.150:0/3360450060 shutdown_connections 2024-09-17T05:43:49.061 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:49.059+0000 7eff45071640 1 -- 172.21.15.150:0/3360450060 wait complete. 2024-09-17T05:43:49.075 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T05:43:49.187 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:49.185+0000 7fefa998b640 1 -- 172.21.15.150:0/2499465928 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fefa40d1450 msgr2=0x7fefa40d51c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:43:49.187 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:49.185+0000 7fefa998b640 1 --2- 172.21.15.150:0/2499465928 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fefa40d1450 0x7fefa40d51c0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fef9c009830 tx=0x7fef9c02a5c0 comp rx=0 tx=0).stop 2024-09-17T05:43:49.187 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:49.185+0000 7fefa998b640 1 -- 172.21.15.150:0/2499465928 shutdown_connections 2024-09-17T05:43:49.188 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:49.185+0000 7fefa998b640 1 --2- 172.21.15.150:0/2499465928 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fefa40d1450 0x7fefa40d51c0 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:43:49.188 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:49.185+0000 7fefa998b640 1 -- 172.21.15.150:0/2499465928 >> 172.21.15.150:0/2499465928 conn(0x7fefa40d46a0 msgr2=0x7fefa40d4ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:43:49.188 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:49.185+0000 7fefa998b640 1 -- 172.21.15.150:0/2499465928 shutdown_connections 2024-09-17T05:43:49.188 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:49.185+0000 7fefa998b640 1 -- 172.21.15.150:0/2499465928 wait complete. 2024-09-17T05:43:49.188 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:49.187+0000 7fefa998b640 1 Processor -- start 2024-09-17T05:43:49.189 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:49.187+0000 7fefa998b640 1 -- start start 2024-09-17T05:43:49.191 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:49.189+0000 7fefa998b640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fefa40d33e0 0x7fefa415d8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:43:49.192 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:49.189+0000 7fefa998b640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fefa4163280 0x7fefa41f9400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:43:49.192 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:49.189+0000 7fefa998b640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fefa40b1720 0x7fefa40b4810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:43:49.192 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:49.189+0000 7fefa998b640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7fefa416a200 con 0x7fefa40d33e0 2024-09-17T05:43:49.192 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:49.189+0000 7fefa998b640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fefa416a080 con 0x7fefa4163280 2024-09-17T05:43:49.192 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:49.189+0000 7fefa998b640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fefa416a380 con 0x7fefa40b1720 2024-09-17T05:43:49.192 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:49.189+0000 7fefa2ffd640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fefa40d33e0 0x7fefa415d8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:43:49.192 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:49.189+0000 7fefa2ffd640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fefa40d33e0 0x7fefa415d8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:43894/0 (socket says 172.21.15.150:43894) 2024-09-17T05:43:49.192 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:49.189+0000 7fefa2ffd640 1 -- 172.21.15.150:0/3448781967 learned_addr learned my addr 172.21.15.150:0/3448781967 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:43:49.192 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:49.189+0000 7fefa27fc640 1 --2- 172.21.15.150:0/3448781967 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fefa4163280 0x7fefa41f9400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:43:49.192 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:49.189+0000 7fefa37fe640 1 --2- 172.21.15.150:0/3448781967 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fefa40b1720 0x7fefa40b4810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:43:49.192 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:49.189+0000 7fefa2ffd640 1 -- 172.21.15.150:0/3448781967 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fefa40b1720 msgr2=0x7fefa40b4810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:43:49.192 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:49.189+0000 7fefa2ffd640 1 --2- 172.21.15.150:0/3448781967 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fefa40b1720 0x7fefa40b4810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:43:49.192 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:49.189+0000 7fefa2ffd640 1 -- 172.21.15.150:0/3448781967 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fefa4163280 msgr2=0x7fefa41f9400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:43:49.193 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:49.189+0000 7fefa2ffd640 1 --2- 172.21.15.150:0/3448781967 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fefa4163280 0x7fefa41f9400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:43:49.193 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:49.189+0000 7fefa2ffd640 1 -- 172.21.15.150:0/3448781967 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fefa41f9d70 con 0x7fefa40d33e0 2024-09-17T05:43:49.193 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:49.189+0000 7fefa27fc640 1 --2- 172.21.15.150:0/3448781967 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fefa4163280 0x7fefa41f9400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T05:43:49.193 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:49.189+0000 7fefa2ffd640 1 --2- 172.21.15.150:0/3448781967 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fefa40d33e0 0x7fefa415d8d0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7fef9400c770 tx=0x7fef9400cc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:43:49.193 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:49.189+0000 7fef8bfff640 1 -- 172.21.15.150:0/3448781967 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef94003bc0 con 0x7fefa40d33e0 2024-09-17T05:43:49.193 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:49.189+0000 7fefa998b640 1 -- 172.21.15.150:0/3448781967 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fefa41fa050 con 0x7fefa40d33e0 2024-09-17T05:43:49.193 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:49.189+0000 7fef8bfff640 1 -- 172.21.15.150:0/3448781967 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fef94003d60 con 0x7fefa40d33e0 2024-09-17T05:43:49.193 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:49.189+0000 7fef8bfff640 1 -- 172.21.15.150:0/3448781967 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef9400aab0 con 0x7fefa40d33e0 2024-09-17T05:43:49.193 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:49.190+0000 7fefa998b640 1 -- 172.21.15.150:0/3448781967 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fefa40b42f0 con 0x7fefa40d33e0 2024-09-17T05:43:49.194 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:49.191+0000 7fefa998b640 1 -- 172.21.15.150:0/3448781967 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fefa408dde0 con 0x7fefa40d33e0 2024-09-17T05:43:49.194 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:49.191+0000 7fef8bfff640 1 -- 172.21.15.150:0/3448781967 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 9) ==== 101747+0+0 (secure 0 0 0) 0x7fef9400ac50 con 0x7fefa40d33e0 2024-09-17T05:43:49.194 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:49.192+0000 7fef8bfff640 1 --2- 172.21.15.150:0/3448781967 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fef90078f20 0x7fef9007b430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:43:49.194 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:49.192+0000 7fef8bfff640 1 -- 172.21.15.150:0/3448781967 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7fef9409b350 con 0x7fefa40d33e0 2024-09-17T05:43:49.194 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:49.192+0000 7fefa27fc640 1 --2- 172.21.15.150:0/3448781967 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fef90078f20 0x7fef9007b430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:43:49.194 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:49.193+0000 7fefa27fc640 1 --2- 172.21.15.150:0/3448781967 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fef90078f20 0x7fef9007b430 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fefa414dd40 tx=0x7fef98009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:43:49.198 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:49.197+0000 7fef8bfff640 1 -- 172.21.15.150:0/3448781967 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fefa408dde0 con 0x7fefa40d33e0 2024-09-17T05:43:49.373 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:49.372+0000 7fefa998b640 1 -- 172.21.15.150:0/3448781967 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fefa40d1ce0 con 0x7fefa40d33e0 2024-09-17T05:43:49.374 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:49.373+0000 7fef8bfff640 1 -- 172.21.15.150:0/3448781967 <== mon.0 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v34) ==== 74+0+16765 (secure 0 0 0) 0x7fef94063180 con 0x7fefa40d33e0 2024-09-17T05:43:49.375 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-09-17T05:43:49.375 INFO:teuthology.orchestra.run.smithi150.stdout:{"epoch":34,"fsid":"9f2e05e9-d629-47b3-b26b-1360655b7d20","created":"2024-09-17T05:41:32.502979+0000","modified":"2024-09-17T05:42:39.782812+0000","last_up_change":"2024-09-17T05:41:46.150225+0000","last_in_change":"2024-09-17T05:41:36.120274+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T05:41:46.860779+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-09-17T05:42:35.815685+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-09-17T05:42:37.101233+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"4f31c018-c8a4-4d6d-b0c2-a597c47aae4a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6800","nonce":479374392},{"type":"v1","addr":"172.21.15.150:6801","nonce":479374392}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6802","nonce":479374392},{"type":"v1","addr":"172.21.15.150:6803","nonce":479374392}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6806","nonce":479374392},{"type":"v1","addr":"172.21.15.150:6807","nonce":479374392}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6804","nonce":479374392},{"type":"v1","addr":"172.21.15.150:6805","nonce":479374392}]},"public_addr":"172.21.15.150:6801/479374392","cluster_addr":"172.21.15.150:6803/479374392","heartbeat_back_addr":"172.21.15.150:6807/479374392","heartbeat_front_addr":"172.21.15.150:6805/479374392","state":["exists","up"]},{"osd":1,"uuid":"6ff4a573-500b-4e04-9de3-39265ead78b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6824","nonce":913899800},{"type":"v1","addr":"172.21.15.150:6825","nonce":913899800}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6826","nonce":913899800},{"type":"v1","addr":"172.21.15.150:6827","nonce":913899800}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6830","nonce":913899800},{"type":"v1","addr":"172.21.15.150:6831","nonce":913899800}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6828","nonce":913899800},{"type":"v1","addr":"172.21.15.150:6829","nonce":913899800}]},"public_addr":"172.21.15.150:6825/913899800","cluster_addr":"172.21.15.150:6827/913899800","heartbeat_back_addr":"172.21.15.150:6831/913899800","heartbeat_front_addr":"172.21.15.150:6829/913899800","state":["exists","up"]},{"osd":2,"uuid":"bffea6f9-2465-4182-b205-00436c41ac1c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6816","nonce":363718461},{"type":"v1","addr":"172.21.15.150:6817","nonce":363718461}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6818","nonce":363718461},{"type":"v1","addr":"172.21.15.150:6819","nonce":363718461}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6822","nonce":363718461},{"type":"v1","addr":"172.21.15.150:6823","nonce":363718461}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6820","nonce":363718461},{"type":"v1","addr":"172.21.15.150:6821","nonce":363718461}]},"public_addr":"172.21.15.150:6817/363718461","cluster_addr":"172.21.15.150:6819/363718461","heartbeat_back_addr":"172.21.15.150:6823/363718461","heartbeat_front_addr":"172.21.15.150:6821/363718461","state":["exists","up"]},{"osd":3,"uuid":"cda70430-d1e1-427e-b04e-56db4031d078","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6808","nonce":3550994626},{"type":"v1","addr":"172.21.15.150:6809","nonce":3550994626}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6810","nonce":3550994626},{"type":"v1","addr":"172.21.15.150:6811","nonce":3550994626}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6814","nonce":3550994626},{"type":"v1","addr":"172.21.15.150:6815","nonce":3550994626}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6812","nonce":3550994626},{"type":"v1","addr":"172.21.15.150:6813","nonce":3550994626}]},"public_addr":"172.21.15.150:6809/3550994626","cluster_addr":"172.21.15.150:6811/3550994626","heartbeat_back_addr":"172.21.15.150:6815/3550994626","heartbeat_front_addr":"172.21.15.150:6813/3550994626","state":["exists","up"]},{"osd":4,"uuid":"3a0277fb-5e1e-4f68-bb2d-9a8a0152f64a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6810","nonce":2718261497},{"type":"v1","addr":"172.21.15.176:6811","nonce":2718261497}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6812","nonce":2718261497},{"type":"v1","addr":"172.21.15.176:6813","nonce":2718261497}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6816","nonce":2718261497},{"type":"v1","addr":"172.21.15.176:6817","nonce":2718261497}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6814","nonce":2718261497},{"type":"v1","addr":"172.21.15.176:6815","nonce":2718261497}]},"public_addr":"172.21.15.176:6811/2718261497","cluster_addr":"172.21.15.176:6813/2718261497","heartbeat_back_addr":"172.21.15.176:6817/2718261497","heartbeat_front_addr":"172.21.15.176:6815/2718261497","state":["exists","up"]},{"osd":5,"uuid":"33aebee6-0315-40b7-a11c-6702f0be494d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6818","nonce":2049295774},{"type":"v1","addr":"172.21.15.176:6819","nonce":2049295774}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6820","nonce":2049295774},{"type":"v1","addr":"172.21.15.176:6821","nonce":2049295774}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6824","nonce":2049295774},{"type":"v1","addr":"172.21.15.176:6825","nonce":2049295774}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6822","nonce":2049295774},{"type":"v1","addr":"172.21.15.176:6823","nonce":2049295774}]},"public_addr":"172.21.15.176:6819/2049295774","cluster_addr":"172.21.15.176:6821/2049295774","heartbeat_back_addr":"172.21.15.176:6825/2049295774","heartbeat_front_addr":"172.21.15.176:6823/2049295774","state":["exists","up"]},{"osd":6,"uuid":"4d24f360-6751-4263-841b-d77793d33540","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6826","nonce":2164458476},{"type":"v1","addr":"172.21.15.176:6827","nonce":2164458476}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6828","nonce":2164458476},{"type":"v1","addr":"172.21.15.176:6829","nonce":2164458476}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6832","nonce":2164458476},{"type":"v1","addr":"172.21.15.176:6833","nonce":2164458476}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6830","nonce":2164458476},{"type":"v1","addr":"172.21.15.176:6831","nonce":2164458476}]},"public_addr":"172.21.15.176:6827/2164458476","cluster_addr":"172.21.15.176:6829/2164458476","heartbeat_back_addr":"172.21.15.176:6833/2164458476","heartbeat_front_addr":"172.21.15.176:6831/2164458476","state":["exists","up"]},{"osd":7,"uuid":"c8594fda-c74a-4ba9-8277-caf101d58ca1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6802","nonce":3239587708},{"type":"v1","addr":"172.21.15.176:6803","nonce":3239587708}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6804","nonce":3239587708},{"type":"v1","addr":"172.21.15.176:6805","nonce":3239587708}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6808","nonce":3239587708},{"type":"v1","addr":"172.21.15.176:6809","nonce":3239587708}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6806","nonce":3239587708},{"type":"v1","addr":"172.21.15.176:6807","nonce":3239587708}]},"public_addr":"172.21.15.176:6803/3239587708","cluster_addr":"172.21.15.176:6805/3239587708","heartbeat_back_addr":"172.21.15.176:6809/3239587708","heartbeat_front_addr":"172.21.15.176:6807/3239587708","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:41:41.905151+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:41:42.705679+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:41:42.459673+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:41:42.440819+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:41:42.668428+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:41:42.694972+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:41:43.078535+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:41:42.363539+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T05:43:49.377 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:49.375+0000 7fefa998b640 1 -- 172.21.15.150:0/3448781967 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fef90078f20 msgr2=0x7fef9007b430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:43:49.377 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:49.375+0000 7fefa998b640 1 --2- 172.21.15.150:0/3448781967 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fef90078f20 0x7fef9007b430 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fefa414dd40 tx=0x7fef98009040 comp rx=0 tx=0).stop 2024-09-17T05:43:49.377 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:49.375+0000 7fefa998b640 1 -- 172.21.15.150:0/3448781967 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fefa40d33e0 msgr2=0x7fefa415d8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:43:49.378 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:49.375+0000 7fefa998b640 1 --2- 172.21.15.150:0/3448781967 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fefa40d33e0 0x7fefa415d8d0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7fef9400c770 tx=0x7fef9400cc30 comp rx=0 tx=0).stop 2024-09-17T05:43:49.378 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:49.375+0000 7fefa998b640 1 -- 172.21.15.150:0/3448781967 shutdown_connections 2024-09-17T05:43:49.378 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:49.375+0000 7fefa998b640 1 --2- 172.21.15.150:0/3448781967 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fefa4163280 0x7fefa41f9400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:43:49.378 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:49.375+0000 7fefa998b640 1 --2- 172.21.15.150:0/3448781967 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fef90078f20 0x7fef9007b430 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:43:49.378 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:49.375+0000 7fefa998b640 1 --2- 172.21.15.150:0/3448781967 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fefa40b1720 0x7fefa40b4810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:43:49.378 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:49.375+0000 7fefa998b640 1 --2- 172.21.15.150:0/3448781967 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fefa40d33e0 0x7fefa415d8d0 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:43:49.378 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:49.375+0000 7fefa998b640 1 -- 172.21.15.150:0/3448781967 >> 172.21.15.150:0/3448781967 conn(0x7fefa40d46a0 msgr2=0x7fefa40b68e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:43:49.378 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:49.376+0000 7fefa998b640 1 -- 172.21.15.150:0/3448781967 shutdown_connections 2024-09-17T05:43:49.378 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:49.376+0000 7fefa998b640 1 -- 172.21.15.150:0/3448781967 wait complete. 2024-09-17T05:43:49.389 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-09-17T05:43:49.389 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T05:43:49.502 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:49.500+0000 7fbca0aa2640 1 -- 172.21.15.150:0/3283200874 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbc9c15ee30 msgr2=0x7fbc9c0b2840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:43:49.502 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:49.500+0000 7fbca0aa2640 1 --2- 172.21.15.150:0/3283200874 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbc9c15ee30 0x7fbc9c0b2840 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7fbc8c005fd0 tx=0x7fbc8c02a5d0 comp rx=0 tx=0).stop 2024-09-17T05:43:49.502 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:49.500+0000 7fbca0aa2640 1 -- 172.21.15.150:0/3283200874 shutdown_connections 2024-09-17T05:43:49.503 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:49.501+0000 7fbca0aa2640 1 --2- 172.21.15.150:0/3283200874 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fbc9c0cf7c0 0x7fbc9c0cfbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:43:49.503 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:49.501+0000 7fbca0aa2640 1 --2- 172.21.15.150:0/3283200874 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbc9c15ee30 0x7fbc9c0b2840 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:43:49.503 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:49.501+0000 7fbca0aa2640 1 -- 172.21.15.150:0/3283200874 >> 172.21.15.150:0/3283200874 conn(0x7fbc9c0b2fd0 msgr2=0x7fbc9c0b33e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:43:49.503 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:49.501+0000 7fbca0aa2640 1 -- 172.21.15.150:0/3283200874 shutdown_connections 2024-09-17T05:43:49.503 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:49.501+0000 7fbca0aa2640 1 -- 172.21.15.150:0/3283200874 wait complete. 2024-09-17T05:43:49.504 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:49.503+0000 7fbca0aa2640 1 Processor -- start 2024-09-17T05:43:49.504 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:49.503+0000 7fbca0aa2640 1 -- start start 2024-09-17T05:43:49.506 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:49.504+0000 7fbca0aa2640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fbc9c0b0e20 0x7fbc9c0cce40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:43:49.507 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:49.504+0000 7fbca0aa2640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fbc9c0cf7c0 0x7fbc9c149a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:43:49.507 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:49.504+0000 7fbca0aa2640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbc9c15ee30 0x7fbc9c0ca750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:43:49.507 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:49.504+0000 7fbca0aa2640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7fbc9c15f350 con 0x7fbc9c15ee30 2024-09-17T05:43:49.507 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:49.504+0000 7fbca0aa2640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fbc9c0b1b50 con 0x7fbc9c0b0e20 2024-09-17T05:43:49.507 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:49.504+0000 7fbca0aa2640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fbc9c0b6420 con 0x7fbc9c0cf7c0 2024-09-17T05:43:49.507 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:49.504+0000 7fbc9ad9d640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbc9c15ee30 0x7fbc9c0ca750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:43:49.507 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:49.504+0000 7fbc91d9b640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fbc9c0cf7c0 0x7fbc9c149a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:43:49.507 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:49.504+0000 7fbc9ad9d640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbc9c15ee30 0x7fbc9c0ca750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:43904/0 (socket says 172.21.15.150:43904) 2024-09-17T05:43:49.507 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:49.504+0000 7fbc91d9b640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fbc9c0cf7c0 0x7fbc9c149a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3301/0 says I am v2:172.21.15.150:46906/0 (socket says 172.21.15.150:46906) 2024-09-17T05:43:49.507 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:49.504+0000 7fbc9ad9d640 1 -- 172.21.15.150:0/2019810245 learned_addr learned my addr 172.21.15.150:0/2019810245 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:43:49.507 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:49.504+0000 7fbc9a59c640 1 --2- 172.21.15.150:0/2019810245 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fbc9c0b0e20 0x7fbc9c0cce40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:43:49.508 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:49.504+0000 7fbc9ad9d640 1 -- 172.21.15.150:0/2019810245 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fbc9c0cf7c0 msgr2=0x7fbc9c149a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:43:49.508 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:49.504+0000 7fbc9ad9d640 1 --2- 172.21.15.150:0/2019810245 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fbc9c0cf7c0 0x7fbc9c149a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:43:49.508 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:49.504+0000 7fbc9ad9d640 1 -- 172.21.15.150:0/2019810245 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fbc9c0b0e20 msgr2=0x7fbc9c0cce40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:43:49.508 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:49.504+0000 7fbc9ad9d640 1 --2- 172.21.15.150:0/2019810245 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fbc9c0b0e20 0x7fbc9c0cce40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:43:49.508 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:49.504+0000 7fbc9ad9d640 1 -- 172.21.15.150:0/2019810245 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbc9c1f63c0 con 0x7fbc9c15ee30 2024-09-17T05:43:49.508 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:49.504+0000 7fbc91d9b640 1 --2- 172.21.15.150:0/2019810245 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fbc9c0cf7c0 0x7fbc9c149a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T05:43:49.508 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:49.505+0000 7fbc9ad9d640 1 --2- 172.21.15.150:0/2019810245 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbc9c15ee30 0x7fbc9c0ca750 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7fbc9400c700 tx=0x7fbc9400cbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:43:49.508 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:49.505+0000 7fbc937fe640 1 -- 172.21.15.150:0/2019810245 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc94003b70 con 0x7fbc9c15ee30 2024-09-17T05:43:49.508 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:49.505+0000 7fbc937fe640 1 -- 172.21.15.150:0/2019810245 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fbc94003d10 con 0x7fbc9c15ee30 2024-09-17T05:43:49.508 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:49.505+0000 7fbca0aa2640 1 -- 172.21.15.150:0/2019810245 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbc9c149f40 con 0x7fbc9c15ee30 2024-09-17T05:43:49.508 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:49.505+0000 7fbc937fe640 1 -- 172.21.15.150:0/2019810245 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc9400aab0 con 0x7fbc9c15ee30 2024-09-17T05:43:49.508 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:49.505+0000 7fbca0aa2640 1 -- 172.21.15.150:0/2019810245 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbc9c0c9c70 con 0x7fbc9c15ee30 2024-09-17T05:43:49.509 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:49.506+0000 7fbca0aa2640 1 -- 172.21.15.150:0/2019810245 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbc9c1f6130 con 0x7fbc9c15ee30 2024-09-17T05:43:49.509 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:49.506+0000 7fbc937fe640 1 -- 172.21.15.150:0/2019810245 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 9) ==== 101747+0+0 (secure 0 0 0) 0x7fbc9400ac50 con 0x7fbc9c15ee30 2024-09-17T05:43:49.509 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:49.507+0000 7fbc937fe640 1 --2- 172.21.15.150:0/2019810245 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fbc7c078ef0 0x7fbc7c07b400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:43:49.510 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:49.507+0000 7fbc937fe640 1 -- 172.21.15.150:0/2019810245 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7fbc9409b1b0 con 0x7fbc9c15ee30 2024-09-17T05:43:49.510 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:49.507+0000 7fbc9a59c640 1 --2- 172.21.15.150:0/2019810245 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fbc7c078ef0 0x7fbc7c07b400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:43:49.510 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:49.508+0000 7fbc9a59c640 1 --2- 172.21.15.150:0/2019810245 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fbc7c078ef0 0x7fbc7c07b400 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fbc8c033000 tx=0x7fbc8c004730 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:43:49.513 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:49.511+0000 7fbc937fe640 1 -- 172.21.15.150:0/2019810245 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fbc9c0d0110 con 0x7fbc9c15ee30 2024-09-17T05:43:49.724 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:49.722+0000 7fbca0aa2640 1 -- 172.21.15.150:0/2019810245 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fbc9c0b68d0 con 0x7fbc9c15ee30 2024-09-17T05:43:49.724 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:49.723+0000 7fbc937fe640 1 -- 172.21.15.150:0/2019810245 <== mon.0 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 16 v16) ==== 94+0+5232 (secure 0 0 0) 0x7fbc94062980 con 0x7fbc9c15ee30 2024-09-17T05:43:49.725 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-09-17T05:43:49.725 INFO:teuthology.orchestra.run.smithi150.stdout:{"epoch":16,"btime":"2024-09-17T05:42:51:051729+0000","default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4664,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6835/392464003","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6833","nonce":392464003},{"type":"v1","addr":"172.21.15.150:6835","nonce":392464003}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":4673,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6837/3232718608","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6835","nonce":3232718608},{"type":"v1","addr":"172.21.15.176:6837","nonce":3232718608}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":4867,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6836/2911955319","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6834","nonce":2911955319},{"type":"v1","addr":"172.21.15.176:6836","nonce":2911955319}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10}],"filesystems":[{"mdsmap":{"epoch":15,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T05:42:38.152690+0000","modified":"2024-09-17T05:42:41.171759+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4938},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4938":{"gid":4938,"name":"a","rank":0,"incarnation":11,"state":"up:active","state_seq":3,"addr":"172.21.15.150:6834/2837553407","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6832","nonce":2837553407},{"type":"v1","addr":"172.21.15.150:6834","nonce":2837553407}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4938,"qdb_cluster":[4938]},"id":2}]} 2024-09-17T05:43:49.725 INFO:teuthology.orchestra.run.smithi150.stderr:dumped fsmap epoch 16 2024-09-17T05:43:49.727 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:49.725+0000 7fbca0aa2640 1 -- 172.21.15.150:0/2019810245 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fbc7c078ef0 msgr2=0x7fbc7c07b400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:43:49.727 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:49.725+0000 7fbca0aa2640 1 --2- 172.21.15.150:0/2019810245 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fbc7c078ef0 0x7fbc7c07b400 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fbc8c033000 tx=0x7fbc8c004730 comp rx=0 tx=0).stop 2024-09-17T05:43:49.728 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:49.725+0000 7fbca0aa2640 1 -- 172.21.15.150:0/2019810245 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbc9c15ee30 msgr2=0x7fbc9c0ca750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:43:49.728 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:49.725+0000 7fbca0aa2640 1 --2- 172.21.15.150:0/2019810245 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbc9c15ee30 0x7fbc9c0ca750 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7fbc9400c700 tx=0x7fbc9400cbc0 comp rx=0 tx=0).stop 2024-09-17T05:43:49.728 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:49.725+0000 7fbca0aa2640 1 -- 172.21.15.150:0/2019810245 shutdown_connections 2024-09-17T05:43:49.728 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:49.725+0000 7fbca0aa2640 1 --2- 172.21.15.150:0/2019810245 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fbc7c078ef0 0x7fbc7c07b400 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:43:49.728 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:49.725+0000 7fbca0aa2640 1 --2- 172.21.15.150:0/2019810245 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbc9c15ee30 0x7fbc9c0ca750 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:43:49.728 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:49.725+0000 7fbca0aa2640 1 --2- 172.21.15.150:0/2019810245 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fbc9c0cf7c0 0x7fbc9c149a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:43:49.728 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:49.725+0000 7fbca0aa2640 1 --2- 172.21.15.150:0/2019810245 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fbc9c0b0e20 0x7fbc9c0cce40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:43:49.728 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:49.725+0000 7fbca0aa2640 1 -- 172.21.15.150:0/2019810245 >> 172.21.15.150:0/2019810245 conn(0x7fbc9c0b2fd0 msgr2=0x7fbc9c15d4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:43:49.728 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:49.725+0000 7fbca0aa2640 1 -- 172.21.15.150:0/2019810245 shutdown_connections 2024-09-17T05:43:49.728 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:49.725+0000 7fbca0aa2640 1 -- 172.21.15.150:0/2019810245 wait complete. 2024-09-17T05:43:49.738 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T05:43:49.853 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:49.851+0000 7ff6fccf9640 1 -- 172.21.15.150:0/468556429 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff6f80cf7c0 msgr2=0x7ff6f80cfbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:43:49.853 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:49.851+0000 7ff6fccf9640 1 --2- 172.21.15.150:0/468556429 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff6f80cf7c0 0x7ff6f80cfbd0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7ff6f8073cf0 tx=0x7ff6ec02a560 comp rx=0 tx=0).stop 2024-09-17T05:43:49.854 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:49.851+0000 7ff6fccf9640 1 -- 172.21.15.150:0/468556429 shutdown_connections 2024-09-17T05:43:49.854 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:49.851+0000 7ff6fccf9640 1 --2- 172.21.15.150:0/468556429 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff6f80cf7c0 0x7ff6f80cfbd0 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:43:49.854 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:49.851+0000 7ff6fccf9640 1 --2- 172.21.15.150:0/468556429 >> v2:172.21.15.176:3300/0 conn(0x7ff6f815ee30 0x7ff6f80b2840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:43:49.854 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:49.851+0000 7ff6fccf9640 1 -- 172.21.15.150:0/468556429 >> 172.21.15.150:0/468556429 conn(0x7ff6f80b2fd0 msgr2=0x7ff6f80b33e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:43:49.854 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:49.851+0000 7ff6fccf9640 1 -- 172.21.15.150:0/468556429 shutdown_connections 2024-09-17T05:43:49.855 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:49.851+0000 7ff6fccf9640 1 -- 172.21.15.150:0/468556429 wait complete. 2024-09-17T05:43:49.860 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:49.853+0000 7ff6fccf9640 1 Processor -- start 2024-09-17T05:43:49.860 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:49.853+0000 7ff6fccf9640 1 -- start start 2024-09-17T05:43:49.860 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:49.854+0000 7ff6fccf9640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff6f80b0e20 0x7ff6f814b8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:43:49.861 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:49.854+0000 7ff6fccf9640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff6f80cf7c0 0x7ff6f814cfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:43:49.861 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:49.854+0000 7ff6fccf9640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff6f815ee30 0x7ff6f814d4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:43:49.861 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:49.854+0000 7ff6fccf9640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7ff6f815f350 con 0x7ff6f80b0e20 2024-09-17T05:43:49.861 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:49.854+0000 7ff6fccf9640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7ff6f80b1b50 con 0x7ff6f80cf7c0 2024-09-17T05:43:49.861 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:49.854+0000 7ff6fccf9640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7ff6f80b6420 con 0x7ff6f815ee30 2024-09-17T05:43:49.861 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:49.854+0000 7ff6f659c640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff6f80b0e20 0x7ff6f814b8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:43:49.862 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:49.854+0000 7ff6f659c640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff6f80b0e20 0x7ff6f814b8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:43922/0 (socket says 172.21.15.150:43922) 2024-09-17T05:43:49.862 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:49.854+0000 7ff6f659c640 1 -- 172.21.15.150:0/1504637246 learned_addr learned my addr 172.21.15.150:0/1504637246 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:43:49.863 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:49.854+0000 7ff6f659c640 1 -- 172.21.15.150:0/1504637246 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff6f815ee30 msgr2=0x7ff6f814d4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:43:49.863 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:49.854+0000 7ff6f6d9d640 1 --2- 172.21.15.150:0/1504637246 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff6f815ee30 0x7ff6f814d4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:43:49.863 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:49.854+0000 7ff6f5d9b640 1 --2- 172.21.15.150:0/1504637246 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff6f80cf7c0 0x7ff6f814cfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:43:49.863 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:49.854+0000 7ff6f659c640 1 --2- 172.21.15.150:0/1504637246 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff6f815ee30 0x7ff6f814d4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:43:49.863 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:49.854+0000 7ff6f659c640 1 -- 172.21.15.150:0/1504637246 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff6f80cf7c0 msgr2=0x7ff6f814cfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:43:49.863 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:49.854+0000 7ff6f659c640 1 --2- 172.21.15.150:0/1504637246 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff6f80cf7c0 0x7ff6f814cfa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:43:49.863 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:49.854+0000 7ff6f659c640 1 -- 172.21.15.150:0/1504637246 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff6f814dd20 con 0x7ff6f80b0e20 2024-09-17T05:43:49.863 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:49.855+0000 7ff6f659c640 1 --2- 172.21.15.150:0/1504637246 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff6f80b0e20 0x7ff6f814b8d0 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7ff6e800d700 tx=0x7ff6e800dbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:43:49.863 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:49.855+0000 7ff6e6ffd640 1 -- 172.21.15.150:0/1504637246 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff6e8017070 con 0x7ff6f80b0e20 2024-09-17T05:43:49.863 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:49.855+0000 7ff6e6ffd640 1 -- 172.21.15.150:0/1504637246 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff6e8004310 con 0x7ff6f80b0e20 2024-09-17T05:43:49.864 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:49.855+0000 7ff6fccf9640 1 -- 172.21.15.150:0/1504637246 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff6f814e000 con 0x7ff6f80b0e20 2024-09-17T05:43:49.864 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:49.855+0000 7ff6e6ffd640 1 -- 172.21.15.150:0/1504637246 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff6e8009a80 con 0x7ff6f80b0e20 2024-09-17T05:43:49.864 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:49.855+0000 7ff6fccf9640 1 -- 172.21.15.150:0/1504637246 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff6f814e5c0 con 0x7ff6f80b0e20 2024-09-17T05:43:49.864 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:49.856+0000 7ff6fccf9640 1 -- 172.21.15.150:0/1504637246 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff6f80b6940 con 0x7ff6f80b0e20 2024-09-17T05:43:49.864 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:49.857+0000 7ff6e6ffd640 1 -- 172.21.15.150:0/1504637246 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 9) ==== 101747+0+0 (secure 0 0 0) 0x7ff6e8009c20 con 0x7ff6f80b0e20 2024-09-17T05:43:49.864 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:49.857+0000 7ff6e6ffd640 1 --2- 172.21.15.150:0/1504637246 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7ff6d8078f20 0x7ff6d807b430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:43:49.865 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:49.857+0000 7ff6e6ffd640 1 -- 172.21.15.150:0/1504637246 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7ff6e809b560 con 0x7ff6f80b0e20 2024-09-17T05:43:49.865 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:49.857+0000 7ff6f5d9b640 1 --2- 172.21.15.150:0/1504637246 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7ff6d8078f20 0x7ff6d807b430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:43:49.865 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:49.858+0000 7ff6f5d9b640 1 --2- 172.21.15.150:0/1504637246 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7ff6d8078f20 0x7ff6d807b430 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7ff6ec033000 tx=0x7ff6ec004730 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:43:49.865 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:49.862+0000 7ff6e6ffd640 1 -- 172.21.15.150:0/1504637246 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7ff6e8063380 con 0x7ff6f80b0e20 2024-09-17T05:43:50.072 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:50.071+0000 7ff6fccf9640 1 -- 172.21.15.150:0/1504637246 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7ff6f80cfde0 con 0x7ff6f80b0e20 2024-09-17T05:43:50.073 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:50.071+0000 7ff6e6ffd640 1 -- 172.21.15.150:0/1504637246 <== mon.0 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 16 v16) ==== 94+0+5232 (secure 0 0 0) 0x7ff6e8062c80 con 0x7ff6f80b0e20 2024-09-17T05:43:50.073 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-09-17T05:43:50.073 INFO:teuthology.orchestra.run.smithi150.stdout:{"epoch":16,"btime":"2024-09-17T05:42:51:051729+0000","default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4664,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6835/392464003","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6833","nonce":392464003},{"type":"v1","addr":"172.21.15.150:6835","nonce":392464003}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":4673,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6837/3232718608","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6835","nonce":3232718608},{"type":"v1","addr":"172.21.15.176:6837","nonce":3232718608}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":4867,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6836/2911955319","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6834","nonce":2911955319},{"type":"v1","addr":"172.21.15.176:6836","nonce":2911955319}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10}],"filesystems":[{"mdsmap":{"epoch":15,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T05:42:38.152690+0000","modified":"2024-09-17T05:42:41.171759+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4938},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4938":{"gid":4938,"name":"a","rank":0,"incarnation":11,"state":"up:active","state_seq":3,"addr":"172.21.15.150:6834/2837553407","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6832","nonce":2837553407},{"type":"v1","addr":"172.21.15.150:6834","nonce":2837553407}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4938,"qdb_cluster":[4938]},"id":2}]} 2024-09-17T05:43:50.073 INFO:teuthology.orchestra.run.smithi150.stderr:dumped fsmap epoch 16 2024-09-17T05:43:50.075 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:50.073+0000 7ff6fccf9640 1 -- 172.21.15.150:0/1504637246 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7ff6d8078f20 msgr2=0x7ff6d807b430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:43:50.075 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:50.073+0000 7ff6fccf9640 1 --2- 172.21.15.150:0/1504637246 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7ff6d8078f20 0x7ff6d807b430 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7ff6ec033000 tx=0x7ff6ec004730 comp rx=0 tx=0).stop 2024-09-17T05:43:50.075 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:50.073+0000 7ff6fccf9640 1 -- 172.21.15.150:0/1504637246 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff6f80b0e20 msgr2=0x7ff6f814b8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:43:50.075 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:50.073+0000 7ff6fccf9640 1 --2- 172.21.15.150:0/1504637246 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff6f80b0e20 0x7ff6f814b8d0 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7ff6e800d700 tx=0x7ff6e800dbc0 comp rx=0 tx=0).stop 2024-09-17T05:43:50.076 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:50.073+0000 7ff6fccf9640 1 -- 172.21.15.150:0/1504637246 shutdown_connections 2024-09-17T05:43:50.076 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:50.073+0000 7ff6fccf9640 1 --2- 172.21.15.150:0/1504637246 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff6f80cf7c0 0x7ff6f814cfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:43:50.076 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:50.073+0000 7ff6fccf9640 1 --2- 172.21.15.150:0/1504637246 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7ff6d8078f20 0x7ff6d807b430 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:43:50.076 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:50.073+0000 7ff6fccf9640 1 --2- 172.21.15.150:0/1504637246 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff6f815ee30 0x7ff6f814d4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:43:50.076 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:50.073+0000 7ff6fccf9640 1 --2- 172.21.15.150:0/1504637246 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff6f80b0e20 0x7ff6f814b8d0 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:43:50.076 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:50.073+0000 7ff6fccf9640 1 -- 172.21.15.150:0/1504637246 >> 172.21.15.150:0/1504637246 conn(0x7ff6f80b2fd0 msgr2=0x7ff6f80d1210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:43:50.076 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:50.074+0000 7ff6fccf9640 1 -- 172.21.15.150:0/1504637246 shutdown_connections 2024-09-17T05:43:50.076 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:50.074+0000 7ff6fccf9640 1 -- 172.21.15.150:0/1504637246 wait complete. 2024-09-17T05:43:50.087 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T05:43:50.202 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:50.200+0000 7fb0d06c5640 1 -- 172.21.15.150:0/3670266041 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb0c8152920 msgr2=0x7fb0c815f3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:43:50.202 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:50.200+0000 7fb0d06c5640 1 --2- 172.21.15.150:0/3670266041 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb0c8152920 0x7fb0c815f3d0 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7fb0b8009830 tx=0x7fb0b802a480 comp rx=0 tx=0).stop 2024-09-17T05:43:50.202 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:50.200+0000 7fb0d06c5640 1 -- 172.21.15.150:0/3670266041 shutdown_connections 2024-09-17T05:43:50.202 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:50.200+0000 7fb0d06c5640 1 --2- 172.21.15.150:0/3670266041 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb0c815f910 0x7fb0c80b3750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:43:50.202 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:50.200+0000 7fb0d06c5640 1 --2- 172.21.15.150:0/3670266041 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb0c8152920 0x7fb0c815f3d0 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:43:50.202 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:50.200+0000 7fb0d06c5640 1 -- 172.21.15.150:0/3670266041 >> 172.21.15.150:0/3670266041 conn(0x7fb0c806d730 msgr2=0x7fb0c80b1e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:43:50.202 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:50.200+0000 7fb0d06c5640 1 -- 172.21.15.150:0/3670266041 shutdown_connections 2024-09-17T05:43:50.202 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:50.200+0000 7fb0d06c5640 1 -- 172.21.15.150:0/3670266041 wait complete. 2024-09-17T05:43:50.203 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:50.202+0000 7fb0d06c5640 1 Processor -- start 2024-09-17T05:43:50.203 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:50.202+0000 7fb0d06c5640 1 -- start start 2024-09-17T05:43:50.207 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:50.203+0000 7fb0d06c5640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb0c80aebc0 0x7fb0c8150300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:43:50.208 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:50.203+0000 7fb0d06c5640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb0c8152920 0x7fb0c81536b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:43:50.208 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:50.203+0000 7fb0d06c5640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb0c815f910 0x7fb0c8153bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:43:50.208 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:50.203+0000 7fb0d06c5640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7fb0c80b4190 con 0x7fb0c80aebc0 2024-09-17T05:43:50.208 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:50.203+0000 7fb0d06c5640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fb0c80b4010 con 0x7fb0c8152920 2024-09-17T05:43:50.208 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:50.203+0000 7fb0d06c5640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fb0c80b4310 con 0x7fb0c815f910 2024-09-17T05:43:50.208 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:50.203+0000 7fb0ce461640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb0c80aebc0 0x7fb0c8150300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:43:50.208 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:50.203+0000 7fb0ce461640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb0c80aebc0 0x7fb0c8150300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:45028/0 (socket says 172.21.15.150:45028) 2024-09-17T05:43:50.208 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:50.203+0000 7fb0ce461640 1 -- 172.21.15.150:0/2543647291 learned_addr learned my addr 172.21.15.150:0/2543647291 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:43:50.208 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:50.203+0000 7fb0cdc60640 1 --2- 172.21.15.150:0/2543647291 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb0c8152920 0x7fb0c81536b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:43:50.208 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:50.203+0000 7fb0cec62640 1 --2- 172.21.15.150:0/2543647291 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb0c815f910 0x7fb0c8153bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:43:50.208 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:50.203+0000 7fb0ce461640 1 -- 172.21.15.150:0/2543647291 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb0c815f910 msgr2=0x7fb0c8153bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:43:50.209 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:50.203+0000 7fb0ce461640 1 --2- 172.21.15.150:0/2543647291 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb0c815f910 0x7fb0c8153bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:43:50.209 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:50.203+0000 7fb0ce461640 1 -- 172.21.15.150:0/2543647291 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb0c8152920 msgr2=0x7fb0c81536b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:43:50.209 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:50.203+0000 7fb0ce461640 1 --2- 172.21.15.150:0/2543647291 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb0c8152920 0x7fb0c81536b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:43:50.209 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:50.203+0000 7fb0ce461640 1 -- 172.21.15.150:0/2543647291 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb0c8151200 con 0x7fb0c80aebc0 2024-09-17T05:43:50.209 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:50.203+0000 7fb0cec62640 1 --2- 172.21.15.150:0/2543647291 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb0c815f910 0x7fb0c8153bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:43:50.209 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:50.203+0000 7fb0cdc60640 1 --2- 172.21.15.150:0/2543647291 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb0c8152920 0x7fb0c81536b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:43:50.209 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:50.204+0000 7fb0ce461640 1 --2- 172.21.15.150:0/2543647291 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb0c80aebc0 0x7fb0c8150300 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7fb0c400c3f0 tx=0x7fb0c400c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:43:50.209 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:50.204+0000 7fb0beffd640 1 -- 172.21.15.150:0/2543647291 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb0c4017070 con 0x7fb0c80aebc0 2024-09-17T05:43:50.209 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:50.204+0000 7fb0beffd640 1 -- 172.21.15.150:0/2543647291 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb0c40035f0 con 0x7fb0c80aebc0 2024-09-17T05:43:50.209 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:50.204+0000 7fb0beffd640 1 -- 172.21.15.150:0/2543647291 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb0c4003a40 con 0x7fb0c80aebc0 2024-09-17T05:43:50.209 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:50.204+0000 7fb0d06c5640 1 -- 172.21.15.150:0/2543647291 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb0c81514e0 con 0x7fb0c80aebc0 2024-09-17T05:43:50.209 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:50.204+0000 7fb0d06c5640 1 -- 172.21.15.150:0/2543647291 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb0c8151aa0 con 0x7fb0c80aebc0 2024-09-17T05:43:50.209 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:50.205+0000 7fb0d06c5640 1 -- 172.21.15.150:0/2543647291 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb0c80b48a0 con 0x7fb0c80aebc0 2024-09-17T05:43:50.209 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:50.206+0000 7fb0beffd640 1 -- 172.21.15.150:0/2543647291 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 9) ==== 101747+0+0 (secure 0 0 0) 0x7fb0c401a070 con 0x7fb0c80aebc0 2024-09-17T05:43:50.210 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:50.206+0000 7fb0beffd640 1 --2- 172.21.15.150:0/2543647291 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fb0ac078ef0 0x7fb0ac07b400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:43:50.210 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:50.206+0000 7fb0beffd640 1 -- 172.21.15.150:0/2543647291 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7fb0c409a5e0 con 0x7fb0c80aebc0 2024-09-17T05:43:50.210 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:50.206+0000 7fb0cdc60640 1 --2- 172.21.15.150:0/2543647291 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fb0ac078ef0 0x7fb0ac07b400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:43:50.210 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:50.207+0000 7fb0cdc60640 1 --2- 172.21.15.150:0/2543647291 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fb0ac078ef0 0x7fb0ac07b400 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fb0b8034000 tx=0x7fb0b8004730 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:43:50.212 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:50.211+0000 7fb0beffd640 1 -- 172.21.15.150:0/2543647291 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fb0c4062620 con 0x7fb0c80aebc0 2024-09-17T05:43:50.387 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:50.385+0000 7fb0d06c5640 1 -- 172.21.15.150:0/2543647291 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fb0c8070390 con 0x7fb0c80aebc0 2024-09-17T05:43:50.388 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:50.386+0000 7fb0beffd640 1 -- 172.21.15.150:0/2543647291 <== mon.0 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v34) ==== 74+0+16765 (secure 0 0 0) 0x7fb0c4061f20 con 0x7fb0c80aebc0 2024-09-17T05:43:50.388 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-09-17T05:43:50.389 INFO:teuthology.orchestra.run.smithi150.stdout:{"epoch":34,"fsid":"9f2e05e9-d629-47b3-b26b-1360655b7d20","created":"2024-09-17T05:41:32.502979+0000","modified":"2024-09-17T05:42:39.782812+0000","last_up_change":"2024-09-17T05:41:46.150225+0000","last_in_change":"2024-09-17T05:41:36.120274+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T05:41:46.860779+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-09-17T05:42:35.815685+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-09-17T05:42:37.101233+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"4f31c018-c8a4-4d6d-b0c2-a597c47aae4a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6800","nonce":479374392},{"type":"v1","addr":"172.21.15.150:6801","nonce":479374392}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6802","nonce":479374392},{"type":"v1","addr":"172.21.15.150:6803","nonce":479374392}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6806","nonce":479374392},{"type":"v1","addr":"172.21.15.150:6807","nonce":479374392}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6804","nonce":479374392},{"type":"v1","addr":"172.21.15.150:6805","nonce":479374392}]},"public_addr":"172.21.15.150:6801/479374392","cluster_addr":"172.21.15.150:6803/479374392","heartbeat_back_addr":"172.21.15.150:6807/479374392","heartbeat_front_addr":"172.21.15.150:6805/479374392","state":["exists","up"]},{"osd":1,"uuid":"6ff4a573-500b-4e04-9de3-39265ead78b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6824","nonce":913899800},{"type":"v1","addr":"172.21.15.150:6825","nonce":913899800}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6826","nonce":913899800},{"type":"v1","addr":"172.21.15.150:6827","nonce":913899800}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6830","nonce":913899800},{"type":"v1","addr":"172.21.15.150:6831","nonce":913899800}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6828","nonce":913899800},{"type":"v1","addr":"172.21.15.150:6829","nonce":913899800}]},"public_addr":"172.21.15.150:6825/913899800","cluster_addr":"172.21.15.150:6827/913899800","heartbeat_back_addr":"172.21.15.150:6831/913899800","heartbeat_front_addr":"172.21.15.150:6829/913899800","state":["exists","up"]},{"osd":2,"uuid":"bffea6f9-2465-4182-b205-00436c41ac1c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6816","nonce":363718461},{"type":"v1","addr":"172.21.15.150:6817","nonce":363718461}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6818","nonce":363718461},{"type":"v1","addr":"172.21.15.150:6819","nonce":363718461}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6822","nonce":363718461},{"type":"v1","addr":"172.21.15.150:6823","nonce":363718461}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6820","nonce":363718461},{"type":"v1","addr":"172.21.15.150:6821","nonce":363718461}]},"public_addr":"172.21.15.150:6817/363718461","cluster_addr":"172.21.15.150:6819/363718461","heartbeat_back_addr":"172.21.15.150:6823/363718461","heartbeat_front_addr":"172.21.15.150:6821/363718461","state":["exists","up"]},{"osd":3,"uuid":"cda70430-d1e1-427e-b04e-56db4031d078","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6808","nonce":3550994626},{"type":"v1","addr":"172.21.15.150:6809","nonce":3550994626}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6810","nonce":3550994626},{"type":"v1","addr":"172.21.15.150:6811","nonce":3550994626}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6814","nonce":3550994626},{"type":"v1","addr":"172.21.15.150:6815","nonce":3550994626}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6812","nonce":3550994626},{"type":"v1","addr":"172.21.15.150:6813","nonce":3550994626}]},"public_addr":"172.21.15.150:6809/3550994626","cluster_addr":"172.21.15.150:6811/3550994626","heartbeat_back_addr":"172.21.15.150:6815/3550994626","heartbeat_front_addr":"172.21.15.150:6813/3550994626","state":["exists","up"]},{"osd":4,"uuid":"3a0277fb-5e1e-4f68-bb2d-9a8a0152f64a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6810","nonce":2718261497},{"type":"v1","addr":"172.21.15.176:6811","nonce":2718261497}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6812","nonce":2718261497},{"type":"v1","addr":"172.21.15.176:6813","nonce":2718261497}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6816","nonce":2718261497},{"type":"v1","addr":"172.21.15.176:6817","nonce":2718261497}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6814","nonce":2718261497},{"type":"v1","addr":"172.21.15.176:6815","nonce":2718261497}]},"public_addr":"172.21.15.176:6811/2718261497","cluster_addr":"172.21.15.176:6813/2718261497","heartbeat_back_addr":"172.21.15.176:6817/2718261497","heartbeat_front_addr":"172.21.15.176:6815/2718261497","state":["exists","up"]},{"osd":5,"uuid":"33aebee6-0315-40b7-a11c-6702f0be494d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6818","nonce":2049295774},{"type":"v1","addr":"172.21.15.176:6819","nonce":2049295774}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6820","nonce":2049295774},{"type":"v1","addr":"172.21.15.176:6821","nonce":2049295774}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6824","nonce":2049295774},{"type":"v1","addr":"172.21.15.176:6825","nonce":2049295774}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6822","nonce":2049295774},{"type":"v1","addr":"172.21.15.176:6823","nonce":2049295774}]},"public_addr":"172.21.15.176:6819/2049295774","cluster_addr":"172.21.15.176:6821/2049295774","heartbeat_back_addr":"172.21.15.176:6825/2049295774","heartbeat_front_addr":"172.21.15.176:6823/2049295774","state":["exists","up"]},{"osd":6,"uuid":"4d24f360-6751-4263-841b-d77793d33540","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6826","nonce":2164458476},{"type":"v1","addr":"172.21.15.176:6827","nonce":2164458476}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6828","nonce":2164458476},{"type":"v1","addr":"172.21.15.176:6829","nonce":2164458476}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6832","nonce":2164458476},{"type":"v1","addr":"172.21.15.176:6833","nonce":2164458476}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6830","nonce":2164458476},{"type":"v1","addr":"172.21.15.176:6831","nonce":2164458476}]},"public_addr":"172.21.15.176:6827/2164458476","cluster_addr":"172.21.15.176:6829/2164458476","heartbeat_back_addr":"172.21.15.176:6833/2164458476","heartbeat_front_addr":"172.21.15.176:6831/2164458476","state":["exists","up"]},{"osd":7,"uuid":"c8594fda-c74a-4ba9-8277-caf101d58ca1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6802","nonce":3239587708},{"type":"v1","addr":"172.21.15.176:6803","nonce":3239587708}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6804","nonce":3239587708},{"type":"v1","addr":"172.21.15.176:6805","nonce":3239587708}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6808","nonce":3239587708},{"type":"v1","addr":"172.21.15.176:6809","nonce":3239587708}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6806","nonce":3239587708},{"type":"v1","addr":"172.21.15.176:6807","nonce":3239587708}]},"public_addr":"172.21.15.176:6803/3239587708","cluster_addr":"172.21.15.176:6805/3239587708","heartbeat_back_addr":"172.21.15.176:6809/3239587708","heartbeat_front_addr":"172.21.15.176:6807/3239587708","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:41:41.905151+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:41:42.705679+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:41:42.459673+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:41:42.440819+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:41:42.668428+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:41:42.694972+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:41:43.078535+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:41:42.363539+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T05:43:50.390 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:50.389+0000 7fb0d06c5640 1 -- 172.21.15.150:0/2543647291 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fb0ac078ef0 msgr2=0x7fb0ac07b400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:43:50.391 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:50.389+0000 7fb0d06c5640 1 --2- 172.21.15.150:0/2543647291 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fb0ac078ef0 0x7fb0ac07b400 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fb0b8034000 tx=0x7fb0b8004730 comp rx=0 tx=0).stop 2024-09-17T05:43:50.391 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:50.389+0000 7fb0d06c5640 1 -- 172.21.15.150:0/2543647291 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb0c80aebc0 msgr2=0x7fb0c8150300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:43:50.391 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:50.389+0000 7fb0d06c5640 1 --2- 172.21.15.150:0/2543647291 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb0c80aebc0 0x7fb0c8150300 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7fb0c400c3f0 tx=0x7fb0c400c8b0 comp rx=0 tx=0).stop 2024-09-17T05:43:50.391 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:50.389+0000 7fb0d06c5640 1 -- 172.21.15.150:0/2543647291 shutdown_connections 2024-09-17T05:43:50.391 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:50.389+0000 7fb0d06c5640 1 --2- 172.21.15.150:0/2543647291 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb0c8152920 0x7fb0c81536b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:43:50.391 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:50.389+0000 7fb0d06c5640 1 --2- 172.21.15.150:0/2543647291 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fb0ac078ef0 0x7fb0ac07b400 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:43:50.391 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:50.389+0000 7fb0d06c5640 1 --2- 172.21.15.150:0/2543647291 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb0c815f910 0x7fb0c8153bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:43:50.391 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:50.389+0000 7fb0d06c5640 1 --2- 172.21.15.150:0/2543647291 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb0c80aebc0 0x7fb0c8150300 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:43:50.391 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:50.389+0000 7fb0d06c5640 1 -- 172.21.15.150:0/2543647291 >> 172.21.15.150:0/2543647291 conn(0x7fb0c806d730 msgr2=0x7fb0c815d1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:43:50.391 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:50.389+0000 7fb0d06c5640 1 -- 172.21.15.150:0/2543647291 shutdown_connections 2024-09-17T05:43:50.391 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:50.389+0000 7fb0d06c5640 1 -- 172.21.15.150:0/2543647291 wait complete. 2024-09-17T05:43:50.402 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-09-17T05:43:50.517 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:50.515+0000 7fb048d8e640 1 -- 172.21.15.150:0/2409117295 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb0440b44d0 msgr2=0x7fb0440af1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:43:50.517 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:50.515+0000 7fb048d8e640 1 --2- 172.21.15.150:0/2409117295 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb0440b44d0 0x7fb0440af1e0 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7fb03c009830 tx=0x7fb03c02a510 comp rx=0 tx=0).stop 2024-09-17T05:43:50.517 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:50.515+0000 7fb048d8e640 1 -- 172.21.15.150:0/2409117295 shutdown_connections 2024-09-17T05:43:50.517 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:50.515+0000 7fb048d8e640 1 --2- 172.21.15.150:0/2409117295 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb0440b44d0 0x7fb0440af1e0 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:43:50.517 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:50.515+0000 7fb048d8e640 1 -- 172.21.15.150:0/2409117295 >> 172.21.15.150:0/2409117295 conn(0x7fb04406d3d0 msgr2=0x7fb0440b1ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:43:50.517 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:50.515+0000 7fb048d8e640 1 -- 172.21.15.150:0/2409117295 shutdown_connections 2024-09-17T05:43:50.517 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:50.515+0000 7fb048d8e640 1 -- 172.21.15.150:0/2409117295 wait complete. 2024-09-17T05:43:50.518 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:50.517+0000 7fb048d8e640 1 Processor -- start 2024-09-17T05:43:50.518 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:50.517+0000 7fb048d8e640 1 -- start start 2024-09-17T05:43:50.521 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:50.518+0000 7fb048d8e640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb0440b44d0 0x7fb04415bf50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:43:50.521 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:50.518+0000 7fb048d8e640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb0440ccd00 0x7fb0441552e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:43:50.521 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:50.518+0000 7fb048d8e640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb04415ae80 0x7fb04409b130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:43:50.521 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:50.518+0000 7fb048d8e640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7fb0440afab0 con 0x7fb0440ccd00 2024-09-17T05:43:50.521 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:50.518+0000 7fb048d8e640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fb0440af930 con 0x7fb04415ae80 2024-09-17T05:43:50.521 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:50.518+0000 7fb048d8e640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fb0440afc30 con 0x7fb0440b44d0 2024-09-17T05:43:50.521 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:50.518+0000 7fb041d9b640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb0440ccd00 0x7fb0441552e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:43:50.521 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:50.518+0000 7fb041d9b640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb0440ccd00 0x7fb0441552e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:45036/0 (socket says 172.21.15.150:45036) 2024-09-17T05:43:50.521 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:50.518+0000 7fb041d9b640 1 -- 172.21.15.150:0/774103384 learned_addr learned my addr 172.21.15.150:0/774103384 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:43:50.521 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:50.518+0000 7fb04259c640 1 --2- 172.21.15.150:0/774103384 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb0440b44d0 0x7fb04415bf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:43:50.521 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:50.518+0000 7fb042d9d640 1 --2- 172.21.15.150:0/774103384 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb04415ae80 0x7fb04409b130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:43:50.522 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:50.519+0000 7fb041d9b640 1 -- 172.21.15.150:0/774103384 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb0440b44d0 msgr2=0x7fb04415bf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:43:50.522 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:50.519+0000 7fb041d9b640 1 --2- 172.21.15.150:0/774103384 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb0440b44d0 0x7fb04415bf50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:43:50.522 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:50.519+0000 7fb041d9b640 1 -- 172.21.15.150:0/774103384 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb04415ae80 msgr2=0x7fb04409b130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:43:50.522 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:50.519+0000 7fb041d9b640 1 --2- 172.21.15.150:0/774103384 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb04415ae80 0x7fb04409b130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:43:50.522 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:50.519+0000 7fb041d9b640 1 -- 172.21.15.150:0/774103384 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb044155820 con 0x7fb0440ccd00 2024-09-17T05:43:50.522 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:50.519+0000 7fb041d9b640 1 --2- 172.21.15.150:0/774103384 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb0440ccd00 0x7fb0441552e0 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7fb02c00c3f0 tx=0x7fb02c00c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:43:50.522 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:50.519+0000 7fb03affd640 1 -- 172.21.15.150:0/774103384 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb02c017070 con 0x7fb0440ccd00 2024-09-17T05:43:50.522 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:50.519+0000 7fb03affd640 1 -- 172.21.15.150:0/774103384 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb02c0035f0 con 0x7fb0440ccd00 2024-09-17T05:43:50.522 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:50.519+0000 7fb048d8e640 1 -- 172.21.15.150:0/774103384 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb04415c710 con 0x7fb0440ccd00 2024-09-17T05:43:50.522 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:50.519+0000 7fb03affd640 1 -- 172.21.15.150:0/774103384 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb02c003a40 con 0x7fb0440ccd00 2024-09-17T05:43:50.522 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:50.519+0000 7fb048d8e640 1 -- 172.21.15.150:0/774103384 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb04415ccd0 con 0x7fb0440ccd00 2024-09-17T05:43:50.523 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:50.520+0000 7fb048d8e640 1 -- 172.21.15.150:0/774103384 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb0440af1e0 con 0x7fb0440ccd00 2024-09-17T05:43:50.523 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:50.521+0000 7fb03affd640 1 -- 172.21.15.150:0/774103384 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 9) ==== 101747+0+0 (secure 0 0 0) 0x7fb02c01a070 con 0x7fb0440ccd00 2024-09-17T05:43:50.523 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:50.521+0000 7fb03affd640 1 --2- 172.21.15.150:0/774103384 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fb024078ef0 0x7fb02407b400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:43:50.523 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:50.521+0000 7fb03affd640 1 -- 172.21.15.150:0/774103384 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7fb02c09a650 con 0x7fb0440ccd00 2024-09-17T05:43:50.523 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:50.522+0000 7fb04259c640 1 --2- 172.21.15.150:0/774103384 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fb024078ef0 0x7fb02407b400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:43:50.523 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:50.522+0000 7fb04259c640 1 --2- 172.21.15.150:0/774103384 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fb024078ef0 0x7fb02407b400 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fb0440cf660 tx=0x7fb03400d040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:43:50.527 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:50.526+0000 7fb03affd640 1 -- 172.21.15.150:0/774103384 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fb02c061f20 con 0x7fb0440ccd00 2024-09-17T05:43:50.735 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:50.734+0000 7fb048d8e640 1 -- 172.21.15.150:0/774103384 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7fb04415c4a0 con 0x7fb0440ccd00 2024-09-17T05:43:50.736 INFO:tasks.ceph.mon.a.smithi150.stderr:2024-09-17T05:43:50.734+0000 7f73931ae640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-17T05:43:50.737 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:50.736+0000 7fb03affd640 1 -- 172.21.15.150:0/774103384 <== mon.0 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v17) ==== 161+0+0 (secure 0 0 0) 0x7fb02c066950 con 0x7fb0440ccd00 2024-09-17T05:43:50.737 INFO:teuthology.orchestra.run.smithi150.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-09-17T05:43:50.741 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:50.739+0000 7fb048d8e640 1 -- 172.21.15.150:0/774103384 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fb024078ef0 msgr2=0x7fb02407b400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:43:50.742 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:50.739+0000 7fb048d8e640 1 --2- 172.21.15.150:0/774103384 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fb024078ef0 0x7fb02407b400 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fb0440cf660 tx=0x7fb03400d040 comp rx=0 tx=0).stop 2024-09-17T05:43:50.742 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:50.739+0000 7fb048d8e640 1 -- 172.21.15.150:0/774103384 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb0440ccd00 msgr2=0x7fb0441552e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:43:50.742 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:50.739+0000 7fb048d8e640 1 --2- 172.21.15.150:0/774103384 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb0440ccd00 0x7fb0441552e0 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7fb02c00c3f0 tx=0x7fb02c00c8b0 comp rx=0 tx=0).stop 2024-09-17T05:43:50.742 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:50.739+0000 7fb048d8e640 1 -- 172.21.15.150:0/774103384 shutdown_connections 2024-09-17T05:43:50.742 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:50.739+0000 7fb048d8e640 1 --2- 172.21.15.150:0/774103384 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb04415ae80 0x7fb04409b130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:43:50.742 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:50.739+0000 7fb048d8e640 1 --2- 172.21.15.150:0/774103384 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fb024078ef0 0x7fb02407b400 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:43:50.742 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:50.739+0000 7fb048d8e640 1 --2- 172.21.15.150:0/774103384 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb0440ccd00 0x7fb0441552e0 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:43:50.742 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:50.739+0000 7fb048d8e640 1 --2- 172.21.15.150:0/774103384 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb0440b44d0 0x7fb04415bf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:43:50.742 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:50.740+0000 7fb048d8e640 1 -- 172.21.15.150:0/774103384 >> 172.21.15.150:0/774103384 conn(0x7fb04406d3d0 msgr2=0x7fb0440ae1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:43:50.742 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:50.740+0000 7fb048d8e640 1 -- 172.21.15.150:0/774103384 shutdown_connections 2024-09-17T05:43:50.742 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:50.740+0000 7fb048d8e640 1 -- 172.21.15.150:0/774103384 wait complete. 2024-09-17T05:43:50.755 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-09-17T05:43:50.805 INFO:tasks.ceph.mds.a.smithi150.stdout:starting mds.a at 2024-09-17T05:43:50.875 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:50.873+0000 7fea3187e640 1 -- 172.21.15.150:0/3937843770 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fea2c0b9810 msgr2=0x7fea2c0b7ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:43:50.875 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:50.873+0000 7fea3187e640 1 --2- 172.21.15.150:0/3937843770 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fea2c0b9810 0x7fea2c0b7ff0 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7fea2c0ceca0 tx=0x7fea1c02a820 comp rx=0 tx=0).stop 2024-09-17T05:43:50.875 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:50.873+0000 7fea3187e640 1 -- 172.21.15.150:0/3937843770 shutdown_connections 2024-09-17T05:43:50.875 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:50.873+0000 7fea3187e640 1 --2- 172.21.15.150:0/3937843770 >> v2:172.21.15.176:3300/0 conn(0x7fea2c162160 0x7fea2c0b8c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:43:50.875 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:50.873+0000 7fea3187e640 1 --2- 172.21.15.150:0/3937843770 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fea2c0b9810 0x7fea2c0b7ff0 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:43:50.875 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:50.873+0000 7fea3187e640 1 -- 172.21.15.150:0/3937843770 >> 172.21.15.150:0/3937843770 conn(0x7fea2c0d46c0 msgr2=0x7fea2c0d4ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:43:50.875 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:50.873+0000 7fea3187e640 1 -- 172.21.15.150:0/3937843770 shutdown_connections 2024-09-17T05:43:50.875 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:50.873+0000 7fea3187e640 1 -- 172.21.15.150:0/3937843770 wait complete. 2024-09-17T05:43:50.876 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:50.875+0000 7fea3187e640 1 Processor -- start 2024-09-17T05:43:50.876 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:50.875+0000 7fea3187e640 1 -- start start 2024-09-17T05:43:50.879 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:50.876+0000 7fea3187e640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fea2c0b9d80 0x7fea2c0d1ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:43:50.879 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:50.876+0000 7fea3187e640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fea2c162160 0x7fea2c1e8580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:43:50.879 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:50.876+0000 7fea3187e640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fea2c153640 0x7fea2c153a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:43:50.879 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:50.876+0000 7fea3187e640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7fea2c06f390 con 0x7fea2c0b9d80 2024-09-17T05:43:50.879 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:50.876+0000 7fea3187e640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fea2c06f210 con 0x7fea2c153640 2024-09-17T05:43:50.879 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:50.876+0000 7fea3187e640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fea2c06f510 con 0x7fea2c162160 2024-09-17T05:43:50.879 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:50.876+0000 7fea2affd640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fea2c0b9d80 0x7fea2c0d1ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:43:50.879 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:50.876+0000 7fea2affd640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fea2c0b9d80 0x7fea2c0d1ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:45064/0 (socket says 172.21.15.150:45064) 2024-09-17T05:43:50.880 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:50.876+0000 7fea2affd640 1 -- 172.21.15.150:0/2673359796 learned_addr learned my addr 172.21.15.150:0/2673359796 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:43:50.880 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:50.876+0000 7fea2a7fc640 1 --2- 172.21.15.150:0/2673359796 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fea2c162160 0x7fea2c1e8580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:43:50.880 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:50.877+0000 7fea2affd640 1 -- 172.21.15.150:0/2673359796 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fea2c162160 msgr2=0x7fea2c1e8580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:43:50.880 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:50.877+0000 7fea2affd640 1 --2- 172.21.15.150:0/2673359796 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fea2c162160 0x7fea2c1e8580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:43:50.880 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:50.877+0000 7fea2affd640 1 -- 172.21.15.150:0/2673359796 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fea2c153640 msgr2=0x7fea2c153a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:43:50.880 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:50.877+0000 7fea2affd640 1 --2- 172.21.15.150:0/2673359796 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fea2c153640 0x7fea2c153a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:43:50.880 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:50.877+0000 7fea2affd640 1 -- 172.21.15.150:0/2673359796 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fea2c1e8ac0 con 0x7fea2c0b9d80 2024-09-17T05:43:50.880 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:50.877+0000 7fea2affd640 1 --2- 172.21.15.150:0/2673359796 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fea2c0b9d80 0x7fea2c0d1ad0 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7fea1c009ca0 tx=0x7fea1c004790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:43:50.880 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:50.877+0000 7fea23fff640 1 -- 172.21.15.150:0/2673359796 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea1c037040 con 0x7fea2c0b9d80 2024-09-17T05:43:50.880 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:50.877+0000 7fea23fff640 1 -- 172.21.15.150:0/2673359796 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fea1c040070 con 0x7fea2c0b9d80 2024-09-17T05:43:50.880 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:50.877+0000 7fea3187e640 1 -- 172.21.15.150:0/2673359796 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fea2c0d0a50 con 0x7fea2c0b9d80 2024-09-17T05:43:50.881 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:50.877+0000 7fea23fff640 1 -- 172.21.15.150:0/2673359796 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea1c0327a0 con 0x7fea2c0b9d80 2024-09-17T05:43:50.881 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:50.877+0000 7fea3187e640 1 -- 172.21.15.150:0/2673359796 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fea2c0d0ff0 con 0x7fea2c0b9d80 2024-09-17T05:43:50.881 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:50.878+0000 7fea3187e640 1 -- 172.21.15.150:0/2673359796 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fea2c06fa60 con 0x7fea2c0b9d80 2024-09-17T05:43:50.883 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:50.879+0000 7fea23fff640 1 -- 172.21.15.150:0/2673359796 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 9) ==== 101747+0+0 (secure 0 0 0) 0x7fea1c032940 con 0x7fea2c0b9d80 2024-09-17T05:43:50.883 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:50.879+0000 7fea23fff640 1 --2- 172.21.15.150:0/2673359796 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fea0c078ef0 0x7fea0c07b400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:43:50.883 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:50.879+0000 7fea23fff640 1 -- 172.21.15.150:0/2673359796 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 5795+0+0 (secure 0 0 0) 0x7fea1c0bbad0 con 0x7fea2c0b9d80 2024-09-17T05:43:50.883 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:50.880+0000 7fea2a7fc640 1 --2- 172.21.15.150:0/2673359796 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fea0c078ef0 0x7fea0c07b400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:43:50.883 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:50.880+0000 7fea2a7fc640 1 --2- 172.21.15.150:0/2673359796 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fea0c078ef0 0x7fea0c07b400 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fea14000f60 tx=0x7fea14009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:43:50.885 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:50.884+0000 7fea23fff640 1 -- 172.21.15.150:0/2673359796 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fea1c083a20 con 0x7fea2c0b9d80 2024-09-17T05:43:51.097 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:51.096+0000 7fea3187e640 1 -- 172.21.15.150:0/2673359796 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7fea2c161650 con 0x7fea2c0b9d80 2024-09-17T05:43:51.743 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:51.741+0000 7fea23fff640 1 -- 172.21.15.150:0/2673359796 <== mon.0 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v18) ==== 104+0+0 (secure 0 0 0) 0x7fea1c083320 con 0x7fea2c0b9d80 2024-09-17T05:43:51.746 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:51.744+0000 7fea3187e640 1 -- 172.21.15.150:0/2673359796 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fea0c078ef0 msgr2=0x7fea0c07b400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:43:51.746 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:51.744+0000 7fea3187e640 1 --2- 172.21.15.150:0/2673359796 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fea0c078ef0 0x7fea0c07b400 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fea14000f60 tx=0x7fea14009040 comp rx=0 tx=0).stop 2024-09-17T05:43:51.746 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:51.744+0000 7fea3187e640 1 -- 172.21.15.150:0/2673359796 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fea2c0b9d80 msgr2=0x7fea2c0d1ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:43:51.746 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:51.744+0000 7fea3187e640 1 --2- 172.21.15.150:0/2673359796 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fea2c0b9d80 0x7fea2c0d1ad0 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7fea1c009ca0 tx=0x7fea1c004790 comp rx=0 tx=0).stop 2024-09-17T05:43:51.746 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:51.744+0000 7fea3187e640 1 -- 172.21.15.150:0/2673359796 shutdown_connections 2024-09-17T05:43:51.746 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:51.744+0000 7fea3187e640 1 --2- 172.21.15.150:0/2673359796 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fea2c153640 0x7fea2c153a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:43:51.746 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:51.744+0000 7fea3187e640 1 --2- 172.21.15.150:0/2673359796 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fea0c078ef0 0x7fea0c07b400 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:43:51.746 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:51.744+0000 7fea3187e640 1 --2- 172.21.15.150:0/2673359796 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fea2c162160 0x7fea2c1e8580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:43:51.746 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:51.744+0000 7fea3187e640 1 --2- 172.21.15.150:0/2673359796 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fea2c0b9d80 0x7fea2c0d1ad0 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:43:51.746 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:51.744+0000 7fea3187e640 1 -- 172.21.15.150:0/2673359796 >> 172.21.15.150:0/2673359796 conn(0x7fea2c0d46c0 msgr2=0x7fea2c0b94c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:43:51.747 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:51.744+0000 7fea3187e640 1 -- 172.21.15.150:0/2673359796 shutdown_connections 2024-09-17T05:43:51.747 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:51.744+0000 7fea3187e640 1 -- 172.21.15.150:0/2673359796 wait complete. 2024-09-17T05:43:51.760 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-09-17T05:43:51.883 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:51.881+0000 7ffa83c4d640 1 -- 172.21.15.150:0/3888431739 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ffa7c156db0 msgr2=0x7ffa7c0b5f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:43:51.883 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:51.881+0000 7ffa83c4d640 1 --2- 172.21.15.150:0/3888431739 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ffa7c156db0 0x7ffa7c0b5f40 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7ffa78005fd0 tx=0x7ffa7802a5d0 comp rx=0 tx=0).stop 2024-09-17T05:43:51.883 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:51.881+0000 7ffa83c4d640 1 -- 172.21.15.150:0/3888431739 shutdown_connections 2024-09-17T05:43:51.883 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:51.881+0000 7ffa83c4d640 1 --2- 172.21.15.150:0/3888431739 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ffa7c0745c0 0x7ffa7c15d610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:43:51.883 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:51.881+0000 7ffa83c4d640 1 --2- 172.21.15.150:0/3888431739 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ffa7c156db0 0x7ffa7c0b5f40 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:43:51.883 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:51.881+0000 7ffa83c4d640 1 -- 172.21.15.150:0/3888431739 >> 172.21.15.150:0/3888431739 conn(0x7ffa7c073890 msgr2=0x7ffa7c073ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:43:51.883 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:51.881+0000 7ffa83c4d640 1 -- 172.21.15.150:0/3888431739 shutdown_connections 2024-09-17T05:43:51.883 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:51.881+0000 7ffa83c4d640 1 -- 172.21.15.150:0/3888431739 wait complete. 2024-09-17T05:43:51.884 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:51.883+0000 7ffa83c4d640 1 Processor -- start 2024-09-17T05:43:51.884 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:51.883+0000 7ffa83c4d640 1 -- start start 2024-09-17T05:43:51.887 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:51.884+0000 7ffa83c4d640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ffa7c06ddb0 0x7ffa7c15c030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:43:51.887 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:51.884+0000 7ffa83c4d640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ffa7c0745c0 0x7ffa7c140450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:43:51.887 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:51.884+0000 7ffa83c4d640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ffa7c156db0 0x7ffa7c158380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:43:51.887 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:51.884+0000 7ffa83c4d640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7ffa7c0cea20 con 0x7ffa7c06ddb0 2024-09-17T05:43:51.887 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:51.884+0000 7ffa83c4d640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7ffa7c0ce8a0 con 0x7ffa7c156db0 2024-09-17T05:43:51.887 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:51.884+0000 7ffa83c4d640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7ffa7c0ceba0 con 0x7ffa7c0745c0 2024-09-17T05:43:51.887 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:51.884+0000 7ffa819e9640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ffa7c06ddb0 0x7ffa7c15c030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:43:51.887 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:51.884+0000 7ffa819e9640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ffa7c06ddb0 0x7ffa7c15c030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:45078/0 (socket says 172.21.15.150:45078) 2024-09-17T05:43:51.888 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:51.884+0000 7ffa819e9640 1 -- 172.21.15.150:0/4108618305 learned_addr learned my addr 172.21.15.150:0/4108618305 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:43:51.888 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:51.884+0000 7ffa811e8640 1 --2- 172.21.15.150:0/4108618305 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ffa7c0745c0 0x7ffa7c140450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:43:51.888 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:51.884+0000 7ffa821ea640 1 --2- 172.21.15.150:0/4108618305 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ffa7c156db0 0x7ffa7c158380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:43:51.888 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:51.885+0000 7ffa819e9640 1 -- 172.21.15.150:0/4108618305 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ffa7c0745c0 msgr2=0x7ffa7c140450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:43:51.888 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:51.885+0000 7ffa819e9640 1 --2- 172.21.15.150:0/4108618305 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ffa7c0745c0 0x7ffa7c140450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:43:51.888 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:51.885+0000 7ffa819e9640 1 -- 172.21.15.150:0/4108618305 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ffa7c156db0 msgr2=0x7ffa7c158380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:43:51.888 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:51.885+0000 7ffa819e9640 1 --2- 172.21.15.150:0/4108618305 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ffa7c156db0 0x7ffa7c158380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:43:51.888 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:51.885+0000 7ffa819e9640 1 -- 172.21.15.150:0/4108618305 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffa7c15af90 con 0x7ffa7c06ddb0 2024-09-17T05:43:51.888 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:51.885+0000 7ffa819e9640 1 --2- 172.21.15.150:0/4108618305 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ffa7c06ddb0 0x7ffa7c15c030 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7ffa78034040 tx=0x7ffa780038a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:43:51.888 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:51.885+0000 7ffa727fc640 1 -- 172.21.15.150:0/4108618305 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa7803e030 con 0x7ffa7c06ddb0 2024-09-17T05:43:51.888 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:51.885+0000 7ffa727fc640 1 -- 172.21.15.150:0/4108618305 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ffa78003ca0 con 0x7ffa7c06ddb0 2024-09-17T05:43:51.889 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:51.885+0000 7ffa83c4d640 1 -- 172.21.15.150:0/4108618305 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffa7c15b270 con 0x7ffa7c06ddb0 2024-09-17T05:43:51.889 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:51.885+0000 7ffa727fc640 1 -- 172.21.15.150:0/4108618305 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa78035040 con 0x7ffa7c06ddb0 2024-09-17T05:43:51.889 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:51.885+0000 7ffa83c4d640 1 -- 172.21.15.150:0/4108618305 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffa7c15b830 con 0x7ffa7c06ddb0 2024-09-17T05:43:51.890 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:51.886+0000 7ffa83c4d640 1 -- 172.21.15.150:0/4108618305 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffa7c0cf0f0 con 0x7ffa7c06ddb0 2024-09-17T05:43:51.890 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:51.887+0000 7ffa727fc640 1 -- 172.21.15.150:0/4108618305 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 9) ==== 101747+0+0 (secure 0 0 0) 0x7ffa78041030 con 0x7ffa7c06ddb0 2024-09-17T05:43:51.890 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:51.887+0000 7ffa727fc640 1 --2- 172.21.15.150:0/4108618305 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7ffa60078ef0 0x7ffa6007b400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:43:51.890 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:51.888+0000 7ffa727fc640 1 -- 172.21.15.150:0/4108618305 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 5795+0+0 (secure 0 0 0) 0x7ffa780bb9d0 con 0x7ffa7c06ddb0 2024-09-17T05:43:51.890 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:51.888+0000 7ffa811e8640 1 --2- 172.21.15.150:0/4108618305 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7ffa60078ef0 0x7ffa6007b400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:43:51.890 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:51.888+0000 7ffa811e8640 1 --2- 172.21.15.150:0/4108618305 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7ffa60078ef0 0x7ffa6007b400 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7ffa7c0d04e0 tx=0x7ffa6c00b2e0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:43:51.895 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:51.894+0000 7ffa727fc640 1 -- 172.21.15.150:0/4108618305 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7ffa78083240 con 0x7ffa7c06ddb0 2024-09-17T05:43:52.075 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:52.073+0000 7ffa83c4d640 1 -- 172.21.15.150:0/4108618305 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7ffa7c06e4d0 con 0x7ffa7c06ddb0 2024-09-17T05:43:52.893 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:52.892+0000 7ffa727fc640 1 -- 172.21.15.150:0/4108618305 <== mon.0 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v36) ==== 181+0+0 (secure 0 0 0) 0x7ffa78087c70 con 0x7ffa7c06ddb0 2024-09-17T05:43:52.894 INFO:teuthology.orchestra.run.smithi150.stderr:pool 'cephfs_metadata' removed 2024-09-17T05:43:52.897 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:52.895+0000 7ffa83c4d640 1 -- 172.21.15.150:0/4108618305 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7ffa60078ef0 msgr2=0x7ffa6007b400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:43:52.897 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:52.895+0000 7ffa83c4d640 1 --2- 172.21.15.150:0/4108618305 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7ffa60078ef0 0x7ffa6007b400 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7ffa7c0d04e0 tx=0x7ffa6c00b2e0 comp rx=0 tx=0).stop 2024-09-17T05:43:52.897 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:52.895+0000 7ffa83c4d640 1 -- 172.21.15.150:0/4108618305 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ffa7c06ddb0 msgr2=0x7ffa7c15c030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:43:52.897 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:52.895+0000 7ffa83c4d640 1 --2- 172.21.15.150:0/4108618305 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ffa7c06ddb0 0x7ffa7c15c030 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7ffa78034040 tx=0x7ffa780038a0 comp rx=0 tx=0).stop 2024-09-17T05:43:52.897 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:52.895+0000 7ffa83c4d640 1 -- 172.21.15.150:0/4108618305 shutdown_connections 2024-09-17T05:43:52.898 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:52.895+0000 7ffa83c4d640 1 --2- 172.21.15.150:0/4108618305 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ffa7c156db0 0x7ffa7c158380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:43:52.898 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:52.895+0000 7ffa83c4d640 1 --2- 172.21.15.150:0/4108618305 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7ffa60078ef0 0x7ffa6007b400 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:43:52.898 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:52.895+0000 7ffa83c4d640 1 --2- 172.21.15.150:0/4108618305 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ffa7c0745c0 0x7ffa7c140450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:43:52.898 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:52.895+0000 7ffa83c4d640 1 --2- 172.21.15.150:0/4108618305 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ffa7c06ddb0 0x7ffa7c15c030 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:43:52.898 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:52.895+0000 7ffa83c4d640 1 -- 172.21.15.150:0/4108618305 >> 172.21.15.150:0/4108618305 conn(0x7ffa7c073890 msgr2=0x7ffa7c0cf300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:43:52.898 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:52.895+0000 7ffa83c4d640 1 -- 172.21.15.150:0/4108618305 shutdown_connections 2024-09-17T05:43:52.898 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:52.895+0000 7ffa83c4d640 1 -- 172.21.15.150:0/4108618305 wait complete. 2024-09-17T05:43:52.912 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-09-17T05:43:53.032 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:53.030+0000 7f74936a2640 1 -- 172.21.15.150:0/2704713759 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f748c0d0770 msgr2=0x7f748c0cd150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:43:53.032 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:53.030+0000 7f74936a2640 1 --2- 172.21.15.150:0/2704713759 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f748c0d0770 0x7f748c0cd150 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f747c005fd0 tx=0x7f747c02a670 comp rx=0 tx=0).stop 2024-09-17T05:43:53.032 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:53.030+0000 7f74936a2640 1 -- 172.21.15.150:0/2704713759 shutdown_connections 2024-09-17T05:43:53.032 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:53.030+0000 7f74936a2640 1 --2- 172.21.15.150:0/2704713759 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f748c0d0770 0x7f748c0cd150 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:43:53.033 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:53.030+0000 7f74936a2640 1 --2- 172.21.15.150:0/2704713759 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f748c0c5b10 0x7f748c0d0230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:43:53.033 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:53.030+0000 7f74936a2640 1 -- 172.21.15.150:0/2704713759 >> 172.21.15.150:0/2704713759 conn(0x7f748c0cef00 msgr2=0x7f748c0cf310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:43:53.033 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:53.030+0000 7f74936a2640 1 -- 172.21.15.150:0/2704713759 shutdown_connections 2024-09-17T05:43:53.033 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:53.030+0000 7f74936a2640 1 -- 172.21.15.150:0/2704713759 wait complete. 2024-09-17T05:43:53.033 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:53.032+0000 7f74936a2640 1 Processor -- start 2024-09-17T05:43:53.034 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:53.032+0000 7f74936a2640 1 -- start start 2024-09-17T05:43:53.036 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:53.033+0000 7f74936a2640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f748c0c5b10 0x7f748c09cc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:43:53.036 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:53.033+0000 7f74936a2640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f748c0cd690 0x7f748c1f7030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:43:53.036 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:53.033+0000 7f74936a2640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f748c0d0770 0x7f748c1f7570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:43:53.036 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:53.034+0000 7f74936a2640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f748c0b2de0 con 0x7f748c0d0770 2024-09-17T05:43:53.036 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:53.034+0000 7f74936a2640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f748c0b2c60 con 0x7f748c0c5b10 2024-09-17T05:43:53.037 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:53.034+0000 7f74936a2640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f748c0b2f60 con 0x7f748c0cd690 2024-09-17T05:43:53.037 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:53.034+0000 7f7491c3f640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f748c0d0770 0x7f748c1f7570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:43:53.037 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:53.034+0000 7f7491c3f640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f748c0d0770 0x7f748c1f7570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:45098/0 (socket says 172.21.15.150:45098) 2024-09-17T05:43:53.037 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:53.034+0000 7f7491c3f640 1 -- 172.21.15.150:0/1628826050 learned_addr learned my addr 172.21.15.150:0/1628826050 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:43:53.037 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:53.034+0000 7f7490c3d640 1 --2- 172.21.15.150:0/1628826050 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f748c0cd690 0x7f748c1f7030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:43:53.037 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:53.034+0000 7f749143e640 1 --2- 172.21.15.150:0/1628826050 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f748c0c5b10 0x7f748c09cc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:43:53.037 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:53.034+0000 7f7491c3f640 1 -- 172.21.15.150:0/1628826050 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f748c0cd690 msgr2=0x7f748c1f7030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:43:53.037 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:53.034+0000 7f7491c3f640 1 --2- 172.21.15.150:0/1628826050 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f748c0cd690 0x7f748c1f7030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:43:53.037 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:53.034+0000 7f7491c3f640 1 -- 172.21.15.150:0/1628826050 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f748c0c5b10 msgr2=0x7f748c09cc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:43:53.037 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:53.034+0000 7f7491c3f640 1 --2- 172.21.15.150:0/1628826050 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f748c0c5b10 0x7f748c09cc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:43:53.037 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:53.034+0000 7f7491c3f640 1 -- 172.21.15.150:0/1628826050 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f748c09c650 con 0x7f748c0d0770 2024-09-17T05:43:53.038 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:53.034+0000 7f7491c3f640 1 --2- 172.21.15.150:0/1628826050 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f748c0d0770 0x7f748c1f7570 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f748400c6b0 tx=0x7f748400cb70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:43:53.038 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:53.034+0000 7f7481ffb640 1 -- 172.21.15.150:0/1628826050 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7484003b70 con 0x7f748c0d0770 2024-09-17T05:43:53.038 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:53.034+0000 7f7481ffb640 1 -- 172.21.15.150:0/1628826050 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f7484003d10 con 0x7f748c0d0770 2024-09-17T05:43:53.038 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:53.034+0000 7f74936a2640 1 -- 172.21.15.150:0/1628826050 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f748c09c930 con 0x7f748c0d0770 2024-09-17T05:43:53.038 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:53.034+0000 7f7481ffb640 1 -- 172.21.15.150:0/1628826050 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7484005330 con 0x7f748c0d0770 2024-09-17T05:43:53.038 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:53.035+0000 7f74936a2640 1 -- 172.21.15.150:0/1628826050 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f748c15aa50 con 0x7f748c0d0770 2024-09-17T05:43:53.039 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:53.036+0000 7f74936a2640 1 -- 172.21.15.150:0/1628826050 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f748c09c3c0 con 0x7f748c0d0770 2024-09-17T05:43:53.039 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:53.036+0000 7f7481ffb640 1 -- 172.21.15.150:0/1628826050 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 9) ==== 101747+0+0 (secure 0 0 0) 0x7f74840054d0 con 0x7f748c0d0770 2024-09-17T05:43:53.039 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:53.037+0000 7f7481ffb640 1 --2- 172.21.15.150:0/1628826050 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f7470078ef0 0x7f747007b400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:43:53.039 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:53.037+0000 7f7481ffb640 1 -- 172.21.15.150:0/1628826050 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 5357+0+0 (secure 0 0 0) 0x7f748409b0e0 con 0x7f748c0d0770 2024-09-17T05:43:53.039 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:53.037+0000 7f749143e640 1 --2- 172.21.15.150:0/1628826050 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f7470078ef0 0x7f747007b400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:43:53.039 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:53.038+0000 7f749143e640 1 --2- 172.21.15.150:0/1628826050 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f7470078ef0 0x7f747007b400 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f7488005fd0 tx=0x7f7488005dc0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:43:53.043 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:53.042+0000 7f7481ffb640 1 -- 172.21.15.150:0/1628826050 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f7484063070 con 0x7f748c0d0770 2024-09-17T05:43:53.220 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:53.218+0000 7f74936a2640 1 -- 172.21.15.150:0/1628826050 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7f748c0d0230 con 0x7f748c0d0770 2024-09-17T05:43:53.902 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:53.901+0000 7f7481ffb640 1 -- 172.21.15.150:0/1628826050 <== mon.0 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v37) ==== 169+0+0 (secure 0 0 0) 0x7f7484062970 con 0x7f748c0d0770 2024-09-17T05:43:53.903 INFO:teuthology.orchestra.run.smithi150.stderr:pool 'cephfs_data' removed 2024-09-17T05:43:53.905 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:53.903+0000 7f74936a2640 1 -- 172.21.15.150:0/1628826050 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f7470078ef0 msgr2=0x7f747007b400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:43:53.906 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:53.904+0000 7f74936a2640 1 --2- 172.21.15.150:0/1628826050 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f7470078ef0 0x7f747007b400 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f7488005fd0 tx=0x7f7488005dc0 comp rx=0 tx=0).stop 2024-09-17T05:43:53.906 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:53.904+0000 7f74936a2640 1 -- 172.21.15.150:0/1628826050 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f748c0d0770 msgr2=0x7f748c1f7570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:43:53.906 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:53.904+0000 7f74936a2640 1 --2- 172.21.15.150:0/1628826050 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f748c0d0770 0x7f748c1f7570 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f748400c6b0 tx=0x7f748400cb70 comp rx=0 tx=0).stop 2024-09-17T05:43:53.906 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:53.904+0000 7f74936a2640 1 -- 172.21.15.150:0/1628826050 shutdown_connections 2024-09-17T05:43:53.906 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:53.904+0000 7f74936a2640 1 --2- 172.21.15.150:0/1628826050 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f7470078ef0 0x7f747007b400 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:43:53.906 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:53.904+0000 7f74936a2640 1 --2- 172.21.15.150:0/1628826050 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f748c0d0770 0x7f748c1f7570 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:43:53.906 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:53.904+0000 7f74936a2640 1 --2- 172.21.15.150:0/1628826050 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f748c0cd690 0x7f748c1f7030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:43:53.906 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:53.904+0000 7f74936a2640 1 --2- 172.21.15.150:0/1628826050 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f748c0c5b10 0x7f748c09cc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:43:53.906 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:53.904+0000 7f74936a2640 1 -- 172.21.15.150:0/1628826050 >> 172.21.15.150:0/1628826050 conn(0x7f748c0cef00 msgr2=0x7f748c15f900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:43:53.906 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:53.904+0000 7f74936a2640 1 -- 172.21.15.150:0/1628826050 shutdown_connections 2024-09-17T05:43:53.906 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:53.904+0000 7f74936a2640 1 -- 172.21.15.150:0/1628826050 wait complete. 2024-09-17T05:43:53.931 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config reset 31 2024-09-17T05:43:54.118 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:54.116+0000 7fb98d7c3640 1 -- 172.21.15.150:0/112081375 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb9800520b0 msgr2=0x7fb980007c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:43:54.118 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:54.116+0000 7fb98d7c3640 1 --2- 172.21.15.150:0/112081375 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb9800520b0 0x7fb980007c60 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7fb974005fd0 tx=0x7fb97402a4d0 comp rx=0 tx=0).stop 2024-09-17T05:43:54.118 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:54.116+0000 7fb98d7c3640 1 -- 172.21.15.150:0/112081375 shutdown_connections 2024-09-17T05:43:54.118 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:54.116+0000 7fb98d7c3640 1 --2- 172.21.15.150:0/112081375 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb9800520b0 0x7fb980007c60 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:43:54.118 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:54.116+0000 7fb98d7c3640 1 -- 172.21.15.150:0/112081375 >> 172.21.15.150:0/112081375 conn(0x7fb98001e260 msgr2=0x7fb980039e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:43:54.118 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:54.116+0000 7fb98d7c3640 1 -- 172.21.15.150:0/112081375 shutdown_connections 2024-09-17T05:43:54.118 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:54.116+0000 7fb98d7c3640 1 -- 172.21.15.150:0/112081375 wait complete. 2024-09-17T05:43:54.119 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:54.118+0000 7fb98d7c3640 1 Processor -- start 2024-09-17T05:43:54.119 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:54.118+0000 7fb98d7c3640 1 -- start start 2024-09-17T05:43:54.122 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:54.119+0000 7fb98d7c3640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb980053710 0x7fb98004e760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:43:54.122 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:54.119+0000 7fb98d7c3640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb9800df800 0x7fb98004cae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:43:54.122 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:54.119+0000 7fb98d7c3640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb980033d20 0x7fb980034130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:43:54.122 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:54.119+0000 7fb98d7c3640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7fb980006110 con 0x7fb980033d20 2024-09-17T05:43:54.122 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:54.119+0000 7fb98d7c3640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fb980005f90 con 0x7fb980053710 2024-09-17T05:43:54.123 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:54.119+0000 7fb98d7c3640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fb980006290 con 0x7fb9800df800 2024-09-17T05:43:54.123 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:54.120+0000 7fb9877fe640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb9800df800 0x7fb98004cae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:43:54.123 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:54.120+0000 7fb987fff640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb980053710 0x7fb98004e760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:43:54.123 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:54.120+0000 7fb987fff640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb980053710 0x7fb98004e760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3300/0 says I am v2:172.21.15.150:45154/0 (socket says 172.21.15.150:45154) 2024-09-17T05:43:54.123 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:54.120+0000 7fb987fff640 1 -- 172.21.15.150:0/1435570153 learned_addr learned my addr 172.21.15.150:0/1435570153 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:43:54.123 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:54.120+0000 7fb98cfc2640 1 --2- 172.21.15.150:0/1435570153 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb980033d20 0x7fb980034130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:43:54.123 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:54.120+0000 7fb987fff640 1 -- 172.21.15.150:0/1435570153 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb9800df800 msgr2=0x7fb98004cae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:43:54.123 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:54.120+0000 7fb987fff640 1 --2- 172.21.15.150:0/1435570153 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb9800df800 0x7fb98004cae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:43:54.123 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:54.120+0000 7fb987fff640 1 -- 172.21.15.150:0/1435570153 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb980033d20 msgr2=0x7fb980034130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:43:54.123 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:54.120+0000 7fb987fff640 1 --2- 172.21.15.150:0/1435570153 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb980033d20 0x7fb980034130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:43:54.123 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:54.120+0000 7fb987fff640 1 -- 172.21.15.150:0/1435570153 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb980034670 con 0x7fb980053710 2024-09-17T05:43:54.123 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:54.120+0000 7fb9877fe640 1 --2- 172.21.15.150:0/1435570153 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb9800df800 0x7fb98004cae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T05:43:54.124 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:54.120+0000 7fb987fff640 1 --2- 172.21.15.150:0/1435570153 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb980053710 0x7fb98004e760 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fb97c00b3f0 tx=0x7fb97c00b7f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:43:54.124 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:54.121+0000 7fb984ff9640 1 -- 172.21.15.150:0/1435570153 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb97c015020 con 0x7fb980053710 2024-09-17T05:43:54.124 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:54.121+0000 7fb98d7c3640 1 -- 172.21.15.150:0/1435570153 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb98004f290 con 0x7fb980053710 2024-09-17T05:43:54.124 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:54.121+0000 7fb984ff9640 1 -- 172.21.15.150:0/1435570153 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb97c011830 con 0x7fb980053710 2024-09-17T05:43:54.124 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:54.121+0000 7fb98d7c3640 1 -- 172.21.15.150:0/1435570153 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb98004efb0 con 0x7fb980053710 2024-09-17T05:43:54.125 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:54.121+0000 7fb984ff9640 1 -- 172.21.15.150:0/1435570153 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb97c015020 con 0x7fb980053710 2024-09-17T05:43:54.125 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:54.122+0000 7fb98d7c3640 1 -- 172.21.15.150:0/1435570153 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb980007c60 con 0x7fb980053710 2024-09-17T05:43:54.125 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:54.123+0000 7fb984ff9640 1 -- 172.21.15.150:0/1435570153 <== mon.1 v2:172.21.15.176:3300/0 4 ==== mgrmap(e 9) ==== 101747+0+0 (secure 0 0 0) 0x7fb97c018020 con 0x7fb980053710 2024-09-17T05:43:54.125 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:54.123+0000 7fb984ff9640 1 --2- 172.21.15.150:0/1435570153 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fb96c0790f0 0x7fb96c07b600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:43:54.125 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:54.123+0000 7fb984ff9640 1 -- 172.21.15.150:0/1435570153 <== mon.1 v2:172.21.15.176:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 4943+0+0 (secure 0 0 0) 0x7fb97c09aaf0 con 0x7fb980053710 2024-09-17T05:43:54.125 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:54.124+0000 7fb9877fe640 1 --2- 172.21.15.150:0/1435570153 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fb96c0790f0 0x7fb96c07b600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:43:54.125 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:54.124+0000 7fb9877fe640 1 --2- 172.21.15.150:0/1435570153 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fb96c0790f0 0x7fb96c07b600 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fb974033000 tx=0x7fb974004730 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:43:54.129 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:54.128+0000 7fb984ff9640 1 -- 172.21.15.150:0/1435570153 <== mon.1 v2:172.21.15.176:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fb97c01f020 con 0x7fb980053710 2024-09-17T05:43:54.307 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:54.305+0000 7fb98d7c3640 1 -- 172.21.15.150:0/1435570153 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_command({"prefix": "config reset", "num": 31} v 0) -- 0x7fb9800520d0 con 0x7fb980053710 2024-09-17T05:43:54.315 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-17T05:43:54.315 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:54.313+0000 7fb984ff9640 1 -- 172.21.15.150:0/1435570153 <== mon.1 v2:172.21.15.176:3300/0 7 ==== mon_command_ack([{"prefix": "config reset", "num": 31}]=0 v34) ==== 71+0+0 (secure 0 0 0) 0x7fb980034670 con 0x7fb980053710 2024-09-17T05:43:54.317 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-17T05:43:54.318 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:54.315+0000 7fb98d7c3640 1 -- 172.21.15.150:0/1435570153 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fb96c0790f0 msgr2=0x7fb96c07b600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:43:54.318 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:54.315+0000 7fb98d7c3640 1 --2- 172.21.15.150:0/1435570153 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fb96c0790f0 0x7fb96c07b600 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fb974033000 tx=0x7fb974004730 comp rx=0 tx=0).stop 2024-09-17T05:43:54.318 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:54.315+0000 7fb98d7c3640 1 -- 172.21.15.150:0/1435570153 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb980053710 msgr2=0x7fb98004e760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:43:54.318 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:54.315+0000 7fb98d7c3640 1 --2- 172.21.15.150:0/1435570153 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb980053710 0x7fb98004e760 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fb97c00b3f0 tx=0x7fb97c00b7f0 comp rx=0 tx=0).stop 2024-09-17T05:43:54.318 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:54.315+0000 7fb98d7c3640 1 -- 172.21.15.150:0/1435570153 shutdown_connections 2024-09-17T05:43:54.318 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:54.315+0000 7fb98d7c3640 1 --2- 172.21.15.150:0/1435570153 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fb96c0790f0 0x7fb96c07b600 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:43:54.319 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:54.316+0000 7fb98d7c3640 1 --2- 172.21.15.150:0/1435570153 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb980033d20 0x7fb980034130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:43:54.319 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:54.316+0000 7fb98d7c3640 1 --2- 172.21.15.150:0/1435570153 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb9800df800 0x7fb98004cae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:43:54.319 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:54.316+0000 7fb98d7c3640 1 --2- 172.21.15.150:0/1435570153 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb980053710 0x7fb98004e760 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:43:54.319 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:54.316+0000 7fb98d7c3640 1 -- 172.21.15.150:0/1435570153 >> 172.21.15.150:0/1435570153 conn(0x7fb98001e260 msgr2=0x7fb980053b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:43:54.319 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:54.316+0000 7fb98d7c3640 1 -- 172.21.15.150:0/1435570153 shutdown_connections 2024-09-17T05:43:54.319 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:54.316+0000 7fb98d7c3640 1 -- 172.21.15.150:0/1435570153 wait complete. 2024-09-17T05:43:54.329 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_volumes.TestCloneProgressReporter.test_clone_to_diff_group_and_less_than_cloner_threads' 2024-09-17T05:43:54.483 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:54.481+0000 7f0912a25640 1 -- 172.21.15.150:0/872543706 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f090c0cffe0 msgr2=0x7f090c0d03f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:43:54.483 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:54.481+0000 7f0912a25640 1 --2- 172.21.15.150:0/872543706 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f090c0cffe0 0x7f090c0d03f0 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f090c069f50 tx=0x7f090402aa30 comp rx=0 tx=0).stop 2024-09-17T05:43:54.483 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:54.481+0000 7f0912a25640 1 -- 172.21.15.150:0/872543706 shutdown_connections 2024-09-17T05:43:54.483 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:54.481+0000 7f0912a25640 1 --2- 172.21.15.150:0/872543706 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f090c0cffe0 0x7f090c0d03f0 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:43:54.483 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:54.481+0000 7f0912a25640 1 --2- 172.21.15.150:0/872543706 >> v2:172.21.15.176:3300/0 conn(0x7f090c0cd440 0x7f090c0cd850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:43:54.483 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:54.481+0000 7f0912a25640 1 --2- 172.21.15.150:0/872543706 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f090c09ba60 0x7f090c0b7330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:43:54.483 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:54.481+0000 7f0912a25640 1 -- 172.21.15.150:0/872543706 >> 172.21.15.150:0/872543706 conn(0x7f090c0cee90 msgr2=0x7f090c0cf2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:43:54.483 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:54.481+0000 7f0912a25640 1 -- 172.21.15.150:0/872543706 shutdown_connections 2024-09-17T05:43:54.484 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:54.481+0000 7f0912a25640 1 -- 172.21.15.150:0/872543706 wait complete. 2024-09-17T05:43:54.484 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:54.483+0000 7f0912a25640 1 Processor -- start 2024-09-17T05:43:54.484 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:54.483+0000 7f0912a25640 1 -- start start 2024-09-17T05:43:54.487 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:54.485+0000 7f0912a25640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f090c09ba60 0x7f090c1f4090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:43:54.488 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:54.485+0000 7f0912a25640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f090c0cd440 0x7f090c0af330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:43:54.488 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:54.485+0000 7f0912a25640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f090c0cffe0 0x7f090c0c76b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:43:54.488 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:54.485+0000 7f0912a25640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f090c0d0d70 con 0x7f090c09ba60 2024-09-17T05:43:54.488 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:54.485+0000 7f0912a25640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f090c0d0bf0 con 0x7f090c0cffe0 2024-09-17T05:43:54.488 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:54.485+0000 7f0912a25640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f090c0d0ef0 con 0x7f090c0cd440 2024-09-17T05:43:54.488 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:54.485+0000 7f090bfff640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f090c09ba60 0x7f090c1f4090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:43:54.488 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:54.485+0000 7f090bfff640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f090c09ba60 0x7f090c1f4090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:45152/0 (socket says 172.21.15.150:45152) 2024-09-17T05:43:54.488 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:54.485+0000 7f090bfff640 1 -- 172.21.15.150:0/3270411087 learned_addr learned my addr 172.21.15.150:0/3270411087 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:43:54.488 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:54.486+0000 7f090b7fe640 1 --2- 172.21.15.150:0/3270411087 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f090c0cd440 0x7f090c0af330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:43:54.489 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:54.487+0000 7f090bfff640 1 -- 172.21.15.150:0/3270411087 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f090c0cd440 msgr2=0x7f090c0af330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:43:54.489 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:54.487+0000 7f090bfff640 1 --2- 172.21.15.150:0/3270411087 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f090c0cd440 0x7f090c0af330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:43:54.489 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:54.487+0000 7f090bfff640 1 -- 172.21.15.150:0/3270411087 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f090c0cffe0 msgr2=0x7f090c0c76b0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-17T05:43:54.490 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:54.487+0000 7f090bfff640 1 --2- 172.21.15.150:0/3270411087 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f090c0cffe0 0x7f090c0c76b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:43:54.490 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:54.487+0000 7f090bfff640 1 -- 172.21.15.150:0/3270411087 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f090c0afb60 con 0x7f090c09ba60 2024-09-17T05:43:54.490 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:54.487+0000 7f090bfff640 1 --2- 172.21.15.150:0/3270411087 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f090c09ba60 0x7f090c1f4090 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f08fc00e7c0 tx=0x7f08fc00ec80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:43:54.490 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:54.488+0000 7f0908ff9640 1 -- 172.21.15.150:0/3270411087 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f08fc00ccc0 con 0x7f090c09ba60 2024-09-17T05:43:54.490 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:54.488+0000 7f0908ff9640 1 -- 172.21.15.150:0/3270411087 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f08fc010430 con 0x7f090c09ba60 2024-09-17T05:43:54.491 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:54.488+0000 7f0912a25640 1 -- 172.21.15.150:0/3270411087 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f090c0afe40 con 0x7f090c09ba60 2024-09-17T05:43:54.491 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:54.488+0000 7f0908ff9640 1 -- 172.21.15.150:0/3270411087 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f08fc010880 con 0x7f090c09ba60 2024-09-17T05:43:54.491 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:54.489+0000 7f0912a25640 1 -- 172.21.15.150:0/3270411087 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f090c0b0400 con 0x7f090c09ba60 2024-09-17T05:43:54.492 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:54.490+0000 7f0912a25640 1 -- 172.21.15.150:0/3270411087 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f090c0cd850 con 0x7f090c09ba60 2024-09-17T05:43:54.500 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:54.496+0000 7f0908ff9640 1 -- 172.21.15.150:0/3270411087 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 9) ==== 101747+0+0 (secure 0 0 0) 0x7f08fc010a20 con 0x7f090c09ba60 2024-09-17T05:43:54.500 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:54.496+0000 7f0908ff9640 1 --2- 172.21.15.150:0/3270411087 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f08f8078fc0 0x7f08f807b4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:43:54.500 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:54.496+0000 7f0908ff9640 1 -- 172.21.15.150:0/3270411087 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 4943+0+0 (secure 0 0 0) 0x7f08fc09c220 con 0x7f090c09ba60 2024-09-17T05:43:54.501 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:54.500+0000 7f090b7fe640 1 --2- 172.21.15.150:0/3270411087 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f08f8078fc0 0x7f08f807b4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:43:54.503 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:54.501+0000 7f090b7fe640 1 --2- 172.21.15.150:0/3270411087 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f08f8078fc0 0x7f08f807b4d0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f090c0b1f30 tx=0x7f0900005f90 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:43:54.505 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:54.503+0000 7f0908ff9640 1 -- 172.21.15.150:0/3270411087 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f08fc063ec0 con 0x7f090c09ba60 2024-09-17T05:43:54.879 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:54.877+0000 7f0912a25640 1 -- 172.21.15.150:0/3270411087 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_volumes.TestCloneProgressReporter.test_clone_to_diff_group_and_less_than_cloner_threads"]} v 0) -- 0x7f090c0d0710 con 0x7f090c09ba60 2024-09-17T05:43:54.904 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:54.902+0000 7f0908ff9640 1 -- 172.21.15.150:0/3270411087 <== mon.0 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_volumes.TestCloneProgressReporter.test_clone_to_diff_group_and_less_than_cloner_threads"]}]=0 v113) ==== 184+0+0 (secure 0 0 0) 0x7f08fc0688f0 con 0x7f090c09ba60 2024-09-17T05:43:54.907 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:54.905+0000 7f0912a25640 1 -- 172.21.15.150:0/3270411087 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f08f8078fc0 msgr2=0x7f08f807b4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:43:54.907 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:54.905+0000 7f0912a25640 1 --2- 172.21.15.150:0/3270411087 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f08f8078fc0 0x7f08f807b4d0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f090c0b1f30 tx=0x7f0900005f90 comp rx=0 tx=0).stop 2024-09-17T05:43:54.907 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:54.905+0000 7f0912a25640 1 -- 172.21.15.150:0/3270411087 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f090c09ba60 msgr2=0x7f090c1f4090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:43:54.907 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:54.905+0000 7f0912a25640 1 --2- 172.21.15.150:0/3270411087 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f090c09ba60 0x7f090c1f4090 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f08fc00e7c0 tx=0x7f08fc00ec80 comp rx=0 tx=0).stop 2024-09-17T05:43:54.908 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:54.905+0000 7f0912a25640 1 -- 172.21.15.150:0/3270411087 shutdown_connections 2024-09-17T05:43:54.908 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:54.905+0000 7f0912a25640 1 --2- 172.21.15.150:0/3270411087 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f090c0cffe0 0x7f090c0c76b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:43:54.908 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:54.905+0000 7f0912a25640 1 --2- 172.21.15.150:0/3270411087 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f08f8078fc0 0x7f08f807b4d0 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:43:54.908 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:54.905+0000 7f0912a25640 1 --2- 172.21.15.150:0/3270411087 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f090c0cd440 0x7f090c0af330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:43:54.908 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:54.905+0000 7f0912a25640 1 --2- 172.21.15.150:0/3270411087 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f090c09ba60 0x7f090c1f4090 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:43:54.908 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:54.905+0000 7f0912a25640 1 -- 172.21.15.150:0/3270411087 >> 172.21.15.150:0/3270411087 conn(0x7f090c0cee90 msgr2=0x7f090c0cda60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:43:54.908 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:54.906+0000 7f0912a25640 1 -- 172.21.15.150:0/3270411087 shutdown_connections 2024-09-17T05:43:54.908 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:54.906+0000 7f0912a25640 1 -- 172.21.15.150:0/3270411087 wait complete. 2024-09-17T05:43:54.919 INFO:tasks.cephfs_test_runner:Initiate cloning where clone subvolume and source subvolume are located ... ok 2024-09-17T05:43:54.919 INFO:tasks.cephfs_test_runner:Starting test: test_clones_equal_to_cloner_threads (tasks.cephfs.test_volumes.TestCloneProgressReporter) Test that one progress bar is printed in output of "ceph status" output 2024-09-17T05:43:54.919 INFO:tasks.cephfs_test_runner:test_clones_equal_to_cloner_threads (tasks.cephfs.test_volumes.TestCloneProgressReporter) 2024-09-17T05:43:54.920 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T05:43:55.033 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:55.032+0000 7fbd9f4a9640 1 -- 172.21.15.150:0/669981010 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbd980b4110 msgr2=0x7fbd9815ea20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:43:55.034 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:55.032+0000 7fbd9f4a9640 1 --2- 172.21.15.150:0/669981010 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbd980b4110 0x7fbd9815ea20 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7fbd9806dd20 tx=0x7fbd9002a980 comp rx=0 tx=0).stop 2024-09-17T05:43:55.034 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:55.032+0000 7fbd9f4a9640 1 -- 172.21.15.150:0/669981010 shutdown_connections 2024-09-17T05:43:55.034 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:55.032+0000 7fbd9f4a9640 1 --2- 172.21.15.150:0/669981010 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbd980b4110 0x7fbd9815ea20 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:43:55.034 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:55.032+0000 7fbd9f4a9640 1 --2- 172.21.15.150:0/669981010 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fbd980730b0 0x7fbd9806fe70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:43:55.034 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:55.032+0000 7fbd9f4a9640 1 --2- 172.21.15.150:0/669981010 >> v2:172.21.15.176:3300/0 conn(0x7fbd980707b0 0x7fbd9806f930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:43:55.034 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:55.032+0000 7fbd9f4a9640 1 -- 172.21.15.150:0/669981010 >> 172.21.15.150:0/669981010 conn(0x7fbd9806d730 msgr2=0x7fbd980b1e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:43:55.034 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:55.032+0000 7fbd9f4a9640 1 -- 172.21.15.150:0/669981010 shutdown_connections 2024-09-17T05:43:55.034 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:55.032+0000 7fbd9f4a9640 1 -- 172.21.15.150:0/669981010 wait complete. 2024-09-17T05:43:55.035 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:55.033+0000 7fbd9f4a9640 1 Processor -- start 2024-09-17T05:43:55.035 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:55.034+0000 7fbd9f4a9640 1 -- start start 2024-09-17T05:43:55.038 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:55.035+0000 7fbd9f4a9640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbd980707b0 0x7fbd98098970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:43:55.038 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:55.035+0000 7fbd9f4a9640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fbd980730b0 0x7fbd980ae9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:43:55.038 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:55.035+0000 7fbd9f4a9640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fbd980b4110 0x7fbd980aef00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:43:55.038 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:55.035+0000 7fbd9f4a9640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7fbd9806f0a0 con 0x7fbd980707b0 2024-09-17T05:43:55.038 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:55.035+0000 7fbd9f4a9640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fbd9815b2b0 con 0x7fbd980730b0 2024-09-17T05:43:55.038 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:55.035+0000 7fbd9f4a9640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fbd9806f220 con 0x7fbd980b4110 2024-09-17T05:43:55.038 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:55.035+0000 7fbd9d245640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbd980707b0 0x7fbd98098970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:43:55.038 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:55.035+0000 7fbd9d245640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbd980707b0 0x7fbd98098970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:45172/0 (socket says 172.21.15.150:45172) 2024-09-17T05:43:55.038 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:55.035+0000 7fbd9d245640 1 -- 172.21.15.150:0/4026239321 learned_addr learned my addr 172.21.15.150:0/4026239321 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:43:55.038 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:55.035+0000 7fbd9da46640 1 --2- 172.21.15.150:0/4026239321 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fbd980b4110 0x7fbd980aef00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:43:55.038 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:55.035+0000 7fbd9ca44640 1 --2- 172.21.15.150:0/4026239321 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fbd980730b0 0x7fbd980ae9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:43:55.039 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:55.035+0000 7fbd9d245640 1 -- 172.21.15.150:0/4026239321 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fbd980b4110 msgr2=0x7fbd980aef00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:43:55.039 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:55.035+0000 7fbd9d245640 1 --2- 172.21.15.150:0/4026239321 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fbd980b4110 0x7fbd980aef00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:43:55.039 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:55.035+0000 7fbd9d245640 1 -- 172.21.15.150:0/4026239321 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fbd980730b0 msgr2=0x7fbd980ae9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:43:55.039 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:55.035+0000 7fbd9d245640 1 --2- 172.21.15.150:0/4026239321 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fbd980730b0 0x7fbd980ae9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:43:55.039 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:55.035+0000 7fbd9d245640 1 -- 172.21.15.150:0/4026239321 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbd981687b0 con 0x7fbd980707b0 2024-09-17T05:43:55.039 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:55.035+0000 7fbd9da46640 1 --2- 172.21.15.150:0/4026239321 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fbd980b4110 0x7fbd980aef00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:43:55.039 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:55.035+0000 7fbd9d245640 1 --2- 172.21.15.150:0/4026239321 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbd980707b0 0x7fbd98098970 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7fbd9400d6d0 tx=0x7fbd9400db90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:43:55.039 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:55.035+0000 7fbd89ffb640 1 -- 172.21.15.150:0/4026239321 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd94017070 con 0x7fbd980707b0 2024-09-17T05:43:55.039 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:55.036+0000 7fbd89ffb640 1 -- 172.21.15.150:0/4026239321 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fbd94004310 con 0x7fbd980707b0 2024-09-17T05:43:55.039 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:55.036+0000 7fbd9f4a9640 1 -- 172.21.15.150:0/4026239321 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbd98168a90 con 0x7fbd980707b0 2024-09-17T05:43:55.039 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:55.036+0000 7fbd89ffb640 1 -- 172.21.15.150:0/4026239321 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd94009a80 con 0x7fbd980707b0 2024-09-17T05:43:55.039 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:55.036+0000 7fbd9f4a9640 1 -- 172.21.15.150:0/4026239321 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbd98152ef0 con 0x7fbd980707b0 2024-09-17T05:43:55.040 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:55.037+0000 7fbd9f4a9640 1 -- 172.21.15.150:0/4026239321 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbd98153150 con 0x7fbd980707b0 2024-09-17T05:43:55.040 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:55.037+0000 7fbd89ffb640 1 -- 172.21.15.150:0/4026239321 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 9) ==== 101747+0+0 (secure 0 0 0) 0x7fbd940035f0 con 0x7fbd980707b0 2024-09-17T05:43:55.040 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:55.038+0000 7fbd89ffb640 1 --2- 172.21.15.150:0/4026239321 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fbd7c078f20 0x7fbd7c07b430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:43:55.040 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:55.038+0000 7fbd89ffb640 1 -- 172.21.15.150:0/4026239321 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 4943+0+0 (secure 0 0 0) 0x7fbd9409b390 con 0x7fbd980707b0 2024-09-17T05:43:55.040 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:55.038+0000 7fbd9ca44640 1 --2- 172.21.15.150:0/4026239321 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fbd7c078f20 0x7fbd7c07b430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:43:55.041 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:55.038+0000 7fbd9ca44640 1 --2- 172.21.15.150:0/4026239321 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fbd7c078f20 0x7fbd7c07b430 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fbd8c005fd0 tx=0x7fbd8c005cf0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:43:55.043 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:55.042+0000 7fbd89ffb640 1 -- 172.21.15.150:0/4026239321 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fbd94063550 con 0x7fbd980707b0 2024-09-17T05:43:55.220 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:55.219+0000 7fbd9f4a9640 1 -- 172.21.15.150:0/4026239321 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fbd9806f740 con 0x7fbd980707b0 2024-09-17T05:43:55.221 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:55.219+0000 7fbd89ffb640 1 -- 172.21.15.150:0/4026239321 <== mon.0 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v37) ==== 74+0+13070 (secure 0 0 0) 0x7fbd94062e50 con 0x7fbd980707b0 2024-09-17T05:43:55.221 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-09-17T05:43:55.221 INFO:teuthology.orchestra.run.smithi150.stdout:{"epoch":37,"fsid":"9f2e05e9-d629-47b3-b26b-1360655b7d20","created":"2024-09-17T05:41:32.502979+0000","modified":"2024-09-17T05:43:53.894106+0000","last_up_change":"2024-09-17T05:41:46.150225+0000","last_in_change":"2024-09-17T05:41:36.120274+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T05:41:46.860779+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"4f31c018-c8a4-4d6d-b0c2-a597c47aae4a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6800","nonce":479374392},{"type":"v1","addr":"172.21.15.150:6801","nonce":479374392}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6802","nonce":479374392},{"type":"v1","addr":"172.21.15.150:6803","nonce":479374392}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6806","nonce":479374392},{"type":"v1","addr":"172.21.15.150:6807","nonce":479374392}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6804","nonce":479374392},{"type":"v1","addr":"172.21.15.150:6805","nonce":479374392}]},"public_addr":"172.21.15.150:6801/479374392","cluster_addr":"172.21.15.150:6803/479374392","heartbeat_back_addr":"172.21.15.150:6807/479374392","heartbeat_front_addr":"172.21.15.150:6805/479374392","state":["exists","up"]},{"osd":1,"uuid":"6ff4a573-500b-4e04-9de3-39265ead78b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6824","nonce":913899800},{"type":"v1","addr":"172.21.15.150:6825","nonce":913899800}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6826","nonce":913899800},{"type":"v1","addr":"172.21.15.150:6827","nonce":913899800}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6830","nonce":913899800},{"type":"v1","addr":"172.21.15.150:6831","nonce":913899800}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6828","nonce":913899800},{"type":"v1","addr":"172.21.15.150:6829","nonce":913899800}]},"public_addr":"172.21.15.150:6825/913899800","cluster_addr":"172.21.15.150:6827/913899800","heartbeat_back_addr":"172.21.15.150:6831/913899800","heartbeat_front_addr":"172.21.15.150:6829/913899800","state":["exists","up"]},{"osd":2,"uuid":"bffea6f9-2465-4182-b205-00436c41ac1c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6816","nonce":363718461},{"type":"v1","addr":"172.21.15.150:6817","nonce":363718461}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6818","nonce":363718461},{"type":"v1","addr":"172.21.15.150:6819","nonce":363718461}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6822","nonce":363718461},{"type":"v1","addr":"172.21.15.150:6823","nonce":363718461}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6820","nonce":363718461},{"type":"v1","addr":"172.21.15.150:6821","nonce":363718461}]},"public_addr":"172.21.15.150:6817/363718461","cluster_addr":"172.21.15.150:6819/363718461","heartbeat_back_addr":"172.21.15.150:6823/363718461","heartbeat_front_addr":"172.21.15.150:6821/363718461","state":["exists","up"]},{"osd":3,"uuid":"cda70430-d1e1-427e-b04e-56db4031d078","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6808","nonce":3550994626},{"type":"v1","addr":"172.21.15.150:6809","nonce":3550994626}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6810","nonce":3550994626},{"type":"v1","addr":"172.21.15.150:6811","nonce":3550994626}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6814","nonce":3550994626},{"type":"v1","addr":"172.21.15.150:6815","nonce":3550994626}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6812","nonce":3550994626},{"type":"v1","addr":"172.21.15.150:6813","nonce":3550994626}]},"public_addr":"172.21.15.150:6809/3550994626","cluster_addr":"172.21.15.150:6811/3550994626","heartbeat_back_addr":"172.21.15.150:6815/3550994626","heartbeat_front_addr":"172.21.15.150:6813/3550994626","state":["exists","up"]},{"osd":4,"uuid":"3a0277fb-5e1e-4f68-bb2d-9a8a0152f64a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6810","nonce":2718261497},{"type":"v1","addr":"172.21.15.176:6811","nonce":2718261497}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6812","nonce":2718261497},{"type":"v1","addr":"172.21.15.176:6813","nonce":2718261497}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6816","nonce":2718261497},{"type":"v1","addr":"172.21.15.176:6817","nonce":2718261497}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6814","nonce":2718261497},{"type":"v1","addr":"172.21.15.176:6815","nonce":2718261497}]},"public_addr":"172.21.15.176:6811/2718261497","cluster_addr":"172.21.15.176:6813/2718261497","heartbeat_back_addr":"172.21.15.176:6817/2718261497","heartbeat_front_addr":"172.21.15.176:6815/2718261497","state":["exists","up"]},{"osd":5,"uuid":"33aebee6-0315-40b7-a11c-6702f0be494d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6818","nonce":2049295774},{"type":"v1","addr":"172.21.15.176:6819","nonce":2049295774}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6820","nonce":2049295774},{"type":"v1","addr":"172.21.15.176:6821","nonce":2049295774}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6824","nonce":2049295774},{"type":"v1","addr":"172.21.15.176:6825","nonce":2049295774}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6822","nonce":2049295774},{"type":"v1","addr":"172.21.15.176:6823","nonce":2049295774}]},"public_addr":"172.21.15.176:6819/2049295774","cluster_addr":"172.21.15.176:6821/2049295774","heartbeat_back_addr":"172.21.15.176:6825/2049295774","heartbeat_front_addr":"172.21.15.176:6823/2049295774","state":["exists","up"]},{"osd":6,"uuid":"4d24f360-6751-4263-841b-d77793d33540","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6826","nonce":2164458476},{"type":"v1","addr":"172.21.15.176:6827","nonce":2164458476}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6828","nonce":2164458476},{"type":"v1","addr":"172.21.15.176:6829","nonce":2164458476}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6832","nonce":2164458476},{"type":"v1","addr":"172.21.15.176:6833","nonce":2164458476}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6830","nonce":2164458476},{"type":"v1","addr":"172.21.15.176:6831","nonce":2164458476}]},"public_addr":"172.21.15.176:6827/2164458476","cluster_addr":"172.21.15.176:6829/2164458476","heartbeat_back_addr":"172.21.15.176:6833/2164458476","heartbeat_front_addr":"172.21.15.176:6831/2164458476","state":["exists","up"]},{"osd":7,"uuid":"c8594fda-c74a-4ba9-8277-caf101d58ca1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6802","nonce":3239587708},{"type":"v1","addr":"172.21.15.176:6803","nonce":3239587708}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6804","nonce":3239587708},{"type":"v1","addr":"172.21.15.176:6805","nonce":3239587708}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6808","nonce":3239587708},{"type":"v1","addr":"172.21.15.176:6809","nonce":3239587708}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6806","nonce":3239587708},{"type":"v1","addr":"172.21.15.176:6807","nonce":3239587708}]},"public_addr":"172.21.15.176:6803/3239587708","cluster_addr":"172.21.15.176:6805/3239587708","heartbeat_back_addr":"172.21.15.176:6809/3239587708","heartbeat_front_addr":"172.21.15.176:6807/3239587708","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:41:41.905151+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:41:42.705679+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:41:42.459673+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:41:42.440819+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:41:42.668428+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:41:42.694972+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:41:43.078535+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:41:42.363539+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.150:6834/2837553407":"2024-09-18T05:43:50.736123+0000","172.21.15.150:6832/2837553407":"2024-09-18T05:43:50.736123+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T05:43:55.223 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:55.222+0000 7fbd9f4a9640 1 -- 172.21.15.150:0/4026239321 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fbd7c078f20 msgr2=0x7fbd7c07b430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:43:55.224 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:55.222+0000 7fbd9f4a9640 1 --2- 172.21.15.150:0/4026239321 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fbd7c078f20 0x7fbd7c07b430 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fbd8c005fd0 tx=0x7fbd8c005cf0 comp rx=0 tx=0).stop 2024-09-17T05:43:55.224 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:55.222+0000 7fbd9f4a9640 1 -- 172.21.15.150:0/4026239321 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbd980707b0 msgr2=0x7fbd98098970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:43:55.224 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:55.222+0000 7fbd9f4a9640 1 --2- 172.21.15.150:0/4026239321 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbd980707b0 0x7fbd98098970 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7fbd9400d6d0 tx=0x7fbd9400db90 comp rx=0 tx=0).stop 2024-09-17T05:43:55.224 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:55.222+0000 7fbd9f4a9640 1 -- 172.21.15.150:0/4026239321 shutdown_connections 2024-09-17T05:43:55.224 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:55.222+0000 7fbd9f4a9640 1 --2- 172.21.15.150:0/4026239321 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fbd980730b0 0x7fbd980ae9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:43:55.224 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:55.222+0000 7fbd9f4a9640 1 --2- 172.21.15.150:0/4026239321 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fbd7c078f20 0x7fbd7c07b430 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:43:55.224 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:55.222+0000 7fbd9f4a9640 1 --2- 172.21.15.150:0/4026239321 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fbd980b4110 0x7fbd980aef00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:43:55.224 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:55.222+0000 7fbd9f4a9640 1 --2- 172.21.15.150:0/4026239321 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbd980707b0 0x7fbd98098970 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:43:55.224 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:55.222+0000 7fbd9f4a9640 1 -- 172.21.15.150:0/4026239321 >> 172.21.15.150:0/4026239321 conn(0x7fbd9806d730 msgr2=0x7fbd980b1cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:43:55.224 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:55.222+0000 7fbd9f4a9640 1 -- 172.21.15.150:0/4026239321 shutdown_connections 2024-09-17T05:43:55.224 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:55.222+0000 7fbd9f4a9640 1 -- 172.21.15.150:0/4026239321 wait complete. 2024-09-17T05:43:55.235 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-17T05:41:46.860779+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-17T05:43:55.236 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-17T05:43:55.352 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:55.350+0000 7fef65572640 1 -- 172.21.15.150:0/1975263753 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fef600af160 msgr2=0x7fef600af570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:43:55.352 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:55.350+0000 7fef65572640 1 --2- 172.21.15.150:0/1975263753 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fef600af160 0x7fef600af570 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7fef600b1b20 tx=0x7fef5002a790 comp rx=0 tx=0).stop 2024-09-17T05:43:55.352 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:55.350+0000 7fef65572640 1 -- 172.21.15.150:0/1975263753 shutdown_connections 2024-09-17T05:43:55.352 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:55.350+0000 7fef65572640 1 --2- 172.21.15.150:0/1975263753 >> v2:172.21.15.176:3300/0 conn(0x7fef600d1090 0x7fef600ce8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:43:55.352 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:55.350+0000 7fef65572640 1 --2- 172.21.15.150:0/1975263753 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fef600af160 0x7fef600af570 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:43:55.353 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:55.350+0000 7fef65572640 1 -- 172.21.15.150:0/1975263753 >> 172.21.15.150:0/1975263753 conn(0x7fef600cefb0 msgr2=0x7fef600cf3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:43:55.353 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:55.350+0000 7fef65572640 1 -- 172.21.15.150:0/1975263753 shutdown_connections 2024-09-17T05:43:55.353 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:55.350+0000 7fef65572640 1 -- 172.21.15.150:0/1975263753 wait complete. 2024-09-17T05:43:55.353 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:55.352+0000 7fef65572640 1 Processor -- start 2024-09-17T05:43:55.354 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:55.352+0000 7fef65572640 1 -- start start 2024-09-17T05:43:55.356 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:55.353+0000 7fef65572640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fef600af160 0x7fef601e5950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:43:55.356 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:55.353+0000 7fef65572640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fef600ce4c0 0x7fef601f41d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:43:55.356 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:55.353+0000 7fef65572640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fef600d1090 0x7fef60148910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:43:55.356 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:55.353+0000 7fef65572640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7fef600b18e0 con 0x7fef600af160 2024-09-17T05:43:55.357 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:55.353+0000 7fef65572640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fef600b1760 con 0x7fef600ce4c0 2024-09-17T05:43:55.357 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:55.353+0000 7fef65572640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fef600cd040 con 0x7fef600d1090 2024-09-17T05:43:55.357 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:55.353+0000 7fef5effd640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fef600af160 0x7fef601e5950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:43:55.357 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:55.353+0000 7fef5effd640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fef600af160 0x7fef601e5950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:45192/0 (socket says 172.21.15.150:45192) 2024-09-17T05:43:55.357 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:55.353+0000 7fef5effd640 1 -- 172.21.15.150:0/189367882 learned_addr learned my addr 172.21.15.150:0/189367882 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:43:55.357 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:55.354+0000 7fef5e7fc640 1 --2- 172.21.15.150:0/189367882 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fef600ce4c0 0x7fef601f41d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:43:55.357 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:55.354+0000 7fef5f7fe640 1 --2- 172.21.15.150:0/189367882 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fef600d1090 0x7fef60148910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:43:55.357 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:55.354+0000 7fef5effd640 1 -- 172.21.15.150:0/189367882 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fef600d1090 msgr2=0x7fef60148910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:43:55.357 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:55.354+0000 7fef5effd640 1 --2- 172.21.15.150:0/189367882 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fef600d1090 0x7fef60148910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:43:55.357 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:55.354+0000 7fef5effd640 1 -- 172.21.15.150:0/189367882 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fef600ce4c0 msgr2=0x7fef601f41d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:43:55.357 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:55.354+0000 7fef5effd640 1 --2- 172.21.15.150:0/189367882 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fef600ce4c0 0x7fef601f41d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:43:55.357 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:55.354+0000 7fef5effd640 1 -- 172.21.15.150:0/189367882 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fef601e6110 con 0x7fef600af160 2024-09-17T05:43:55.358 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:55.354+0000 7fef5effd640 1 --2- 172.21.15.150:0/189367882 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fef600af160 0x7fef601e5950 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7fef50009b30 tx=0x7fef50032f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:43:55.358 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:55.354+0000 7fef477fe640 1 -- 172.21.15.150:0/189367882 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef50041020 con 0x7fef600af160 2024-09-17T05:43:55.358 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:55.354+0000 7fef477fe640 1 -- 172.21.15.150:0/189367882 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fef50004280 con 0x7fef600af160 2024-09-17T05:43:55.358 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:55.354+0000 7fef65572640 1 -- 172.21.15.150:0/189367882 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fef601e63f0 con 0x7fef600af160 2024-09-17T05:43:55.358 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:55.354+0000 7fef477fe640 1 -- 172.21.15.150:0/189367882 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef50036040 con 0x7fef600af160 2024-09-17T05:43:55.358 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:55.354+0000 7fef65572640 1 -- 172.21.15.150:0/189367882 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fef601e7e00 con 0x7fef600af160 2024-09-17T05:43:55.359 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:55.355+0000 7fef65572640 1 -- 172.21.15.150:0/189367882 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fef600af570 con 0x7fef600af160 2024-09-17T05:43:55.359 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:55.356+0000 7fef477fe640 1 -- 172.21.15.150:0/189367882 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 9) ==== 101747+0+0 (secure 0 0 0) 0x7fef50044020 con 0x7fef600af160 2024-09-17T05:43:55.359 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:55.356+0000 7fef477fe640 1 --2- 172.21.15.150:0/189367882 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fef4c078ef0 0x7fef4c07b400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:43:55.359 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:55.357+0000 7fef477fe640 1 -- 172.21.15.150:0/189367882 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 4943+0+0 (secure 0 0 0) 0x7fef500bbd80 con 0x7fef600af160 2024-09-17T05:43:55.359 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:55.357+0000 7fef5e7fc640 1 --2- 172.21.15.150:0/189367882 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fef4c078ef0 0x7fef4c07b400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:43:55.359 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:55.357+0000 7fef5e7fc640 1 --2- 172.21.15.150:0/189367882 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fef4c078ef0 0x7fef4c07b400 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fef600b3790 tx=0x7fef54007e90 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:43:55.363 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:55.361+0000 7fef477fe640 1 -- 172.21.15.150:0/189367882 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fef5004b070 con 0x7fef600af160 2024-09-17T05:43:55.538 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:55.536+0000 7fef65572640 1 -- 172.21.15.150:0/189367882 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fef600d0d50 con 0x7fef600af160 2024-09-17T05:43:55.538 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:55.537+0000 7fef477fe640 1 -- 172.21.15.150:0/189367882 <== mon.0 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v37) ==== 93+0+10 (secure 0 0 0) 0x7fef50083950 con 0x7fef600af160 2024-09-17T05:43:55.539 INFO:teuthology.orchestra.run.smithi150.stdout:pg_num: 1 2024-09-17T05:43:55.541 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:55.539+0000 7fef65572640 1 -- 172.21.15.150:0/189367882 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fef4c078ef0 msgr2=0x7fef4c07b400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:43:55.541 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:55.539+0000 7fef65572640 1 --2- 172.21.15.150:0/189367882 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fef4c078ef0 0x7fef4c07b400 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fef600b3790 tx=0x7fef54007e90 comp rx=0 tx=0).stop 2024-09-17T05:43:55.541 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:55.539+0000 7fef65572640 1 -- 172.21.15.150:0/189367882 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fef600af160 msgr2=0x7fef601e5950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:43:55.541 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:55.539+0000 7fef65572640 1 --2- 172.21.15.150:0/189367882 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fef600af160 0x7fef601e5950 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7fef50009b30 tx=0x7fef50032f10 comp rx=0 tx=0).stop 2024-09-17T05:43:55.541 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:55.539+0000 7fef65572640 1 -- 172.21.15.150:0/189367882 shutdown_connections 2024-09-17T05:43:55.541 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:55.539+0000 7fef65572640 1 --2- 172.21.15.150:0/189367882 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fef600ce4c0 0x7fef601f41d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:43:55.541 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:55.539+0000 7fef65572640 1 --2- 172.21.15.150:0/189367882 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fef4c078ef0 0x7fef4c07b400 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:43:55.541 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:55.539+0000 7fef65572640 1 --2- 172.21.15.150:0/189367882 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fef600d1090 0x7fef60148910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:43:55.541 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:55.539+0000 7fef65572640 1 --2- 172.21.15.150:0/189367882 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fef600af160 0x7fef601e5950 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:43:55.542 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:55.539+0000 7fef65572640 1 -- 172.21.15.150:0/189367882 >> 172.21.15.150:0/189367882 conn(0x7fef600cefb0 msgr2=0x7fef600b6ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:43:55.542 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:55.539+0000 7fef65572640 1 -- 172.21.15.150:0/189367882 shutdown_connections 2024-09-17T05:43:55.542 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:55.539+0000 7fef65572640 1 -- 172.21.15.150:0/189367882 wait complete. 2024-09-17T05:43:55.552 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_volumes.TestCloneProgressReporter.test_clones_equal_to_cloner_threads' 2024-09-17T05:43:55.665 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:55.663+0000 7ff17c007640 1 -- 172.21.15.150:0/890377057 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff1740b57a0 msgr2=0x7ff1740b5bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:43:55.665 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:55.663+0000 7ff17c007640 1 --2- 172.21.15.150:0/890377057 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff1740b57a0 0x7ff1740b5bb0 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7ff16c005fd0 tx=0x7ff16c02aa90 comp rx=0 tx=0).stop 2024-09-17T05:43:55.665 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:55.663+0000 7ff17c007640 1 -- 172.21.15.150:0/890377057 shutdown_connections 2024-09-17T05:43:55.666 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:55.663+0000 7ff17c007640 1 --2- 172.21.15.150:0/890377057 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff1740b57a0 0x7ff1740b5bb0 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:43:55.666 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:55.663+0000 7ff17c007640 1 --2- 172.21.15.150:0/890377057 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff1740b7330 0x7ff1740b5260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:43:55.666 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:55.663+0000 7ff17c007640 1 -- 172.21.15.150:0/890377057 >> 172.21.15.150:0/890377057 conn(0x7ff1740cee90 msgr2=0x7ff1740cf2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:43:55.666 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:55.663+0000 7ff17c007640 1 -- 172.21.15.150:0/890377057 shutdown_connections 2024-09-17T05:43:55.666 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:55.663+0000 7ff17c007640 1 -- 172.21.15.150:0/890377057 wait complete. 2024-09-17T05:43:55.666 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:55.665+0000 7ff17c007640 1 Processor -- start 2024-09-17T05:43:55.667 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:55.665+0000 7ff17c007640 1 -- start start 2024-09-17T05:43:55.669 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:55.666+0000 7ff17c007640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff17409ba60 0x7ff17409cbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:43:55.669 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:55.666+0000 7ff17c007640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff1740b57a0 0x7ff17415a980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:43:55.669 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:55.667+0000 7ff17c007640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff1740b7330 0x7ff17415c5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:43:55.669 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:55.667+0000 7ff17c007640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7ff1740d1550 con 0x7ff1740b57a0 2024-09-17T05:43:55.669 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:55.667+0000 7ff17c007640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7ff1740d13d0 con 0x7ff17409ba60 2024-09-17T05:43:55.670 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:55.667+0000 7ff17c007640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7ff1741670e0 con 0x7ff1740b7330 2024-09-17T05:43:55.670 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:55.667+0000 7ff1795a2640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff1740b57a0 0x7ff17415a980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:43:55.670 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:55.667+0000 7ff1795a2640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff1740b57a0 0x7ff17415a980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:45208/0 (socket says 172.21.15.150:45208) 2024-09-17T05:43:55.670 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:55.667+0000 7ff1795a2640 1 -- 172.21.15.150:0/3116161888 learned_addr learned my addr 172.21.15.150:0/3116161888 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:43:55.670 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:55.667+0000 7ff17a5a4640 1 --2- 172.21.15.150:0/3116161888 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff1740b7330 0x7ff17415c5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:43:55.670 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:55.667+0000 7ff179da3640 1 --2- 172.21.15.150:0/3116161888 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff17409ba60 0x7ff17409cbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:43:55.670 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:55.667+0000 7ff1795a2640 1 -- 172.21.15.150:0/3116161888 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff1740b7330 msgr2=0x7ff17415c5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:43:55.670 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:55.667+0000 7ff1795a2640 1 --2- 172.21.15.150:0/3116161888 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff1740b7330 0x7ff17415c5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:43:55.670 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:55.667+0000 7ff1795a2640 1 -- 172.21.15.150:0/3116161888 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff17409ba60 msgr2=0x7ff17409cbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:43:55.670 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:55.667+0000 7ff1795a2640 1 --2- 172.21.15.150:0/3116161888 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff17409ba60 0x7ff17409cbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:43:55.670 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:55.667+0000 7ff1795a2640 1 -- 172.21.15.150:0/3116161888 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff1740b3100 con 0x7ff1740b57a0 2024-09-17T05:43:55.670 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:55.667+0000 7ff1795a2640 1 --2- 172.21.15.150:0/3116161888 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff1740b57a0 0x7ff17415a980 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7ff16400e6d0 tx=0x7ff16400eb90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:43:55.670 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:55.667+0000 7ff16a7fc640 1 -- 172.21.15.150:0/3116161888 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff164004220 con 0x7ff1740b57a0 2024-09-17T05:43:55.671 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:55.667+0000 7ff16a7fc640 1 -- 172.21.15.150:0/3116161888 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff1640043c0 con 0x7ff1740b57a0 2024-09-17T05:43:55.671 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:55.667+0000 7ff16a7fc640 1 -- 172.21.15.150:0/3116161888 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff16400cb10 con 0x7ff1740b57a0 2024-09-17T05:43:55.671 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:55.667+0000 7ff17c007640 1 -- 172.21.15.150:0/3116161888 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff17409d620 con 0x7ff1740b57a0 2024-09-17T05:43:55.671 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:55.667+0000 7ff17c007640 1 -- 172.21.15.150:0/3116161888 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff17415aec0 con 0x7ff1740b57a0 2024-09-17T05:43:55.672 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:55.668+0000 7ff17c007640 1 -- 172.21.15.150:0/3116161888 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff1740b5bb0 con 0x7ff1740b57a0 2024-09-17T05:43:55.672 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:55.669+0000 7ff16a7fc640 1 -- 172.21.15.150:0/3116161888 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 9) ==== 101747+0+0 (secure 0 0 0) 0x7ff16400ccb0 con 0x7ff1740b57a0 2024-09-17T05:43:55.672 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:55.669+0000 7ff16a7fc640 1 --2- 172.21.15.150:0/3116161888 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7ff158078ef0 0x7ff15807b400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:43:55.672 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:55.670+0000 7ff16a7fc640 1 -- 172.21.15.150:0/3116161888 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 4943+0+0 (secure 0 0 0) 0x7ff16409b860 con 0x7ff1740b57a0 2024-09-17T05:43:55.672 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:55.670+0000 7ff179da3640 1 --2- 172.21.15.150:0/3116161888 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7ff158078ef0 0x7ff15807b400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:43:55.672 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:55.670+0000 7ff179da3640 1 --2- 172.21.15.150:0/3116161888 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7ff158078ef0 0x7ff15807b400 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7ff1700017a0 tx=0x7ff170009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:43:55.675 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:55.674+0000 7ff16a7fc640 1 -- 172.21.15.150:0/3116161888 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7ff1640633c0 con 0x7ff1740b57a0 2024-09-17T05:43:55.917 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:55.915+0000 7ff17c007640 1 -- 172.21.15.150:0/3116161888 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_volumes.TestCloneProgressReporter.test_clones_equal_to_cloner_threads"]} v 0) -- 0x7ff174071e80 con 0x7ff1740b57a0 2024-09-17T05:43:56.910 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:56.909+0000 7ff16a7fc640 1 -- 172.21.15.150:0/3116161888 <== mon.0 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_volumes.TestCloneProgressReporter.test_clones_equal_to_cloner_threads"]}]=0 v115) ==== 169+0+0 (secure 0 0 0) 0x7ff164067df0 con 0x7ff1740b57a0 2024-09-17T05:43:56.914 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:56.912+0000 7ff17c007640 1 -- 172.21.15.150:0/3116161888 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7ff158078ef0 msgr2=0x7ff15807b400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:43:56.914 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:56.912+0000 7ff17c007640 1 --2- 172.21.15.150:0/3116161888 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7ff158078ef0 0x7ff15807b400 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7ff1700017a0 tx=0x7ff170009040 comp rx=0 tx=0).stop 2024-09-17T05:43:56.914 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:56.912+0000 7ff17c007640 1 -- 172.21.15.150:0/3116161888 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff1740b57a0 msgr2=0x7ff17415a980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:43:56.914 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:56.912+0000 7ff17c007640 1 --2- 172.21.15.150:0/3116161888 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff1740b57a0 0x7ff17415a980 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7ff16400e6d0 tx=0x7ff16400eb90 comp rx=0 tx=0).stop 2024-09-17T05:43:56.914 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:56.912+0000 7ff17c007640 1 -- 172.21.15.150:0/3116161888 shutdown_connections 2024-09-17T05:43:56.914 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:56.912+0000 7ff17c007640 1 --2- 172.21.15.150:0/3116161888 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7ff158078ef0 0x7ff15807b400 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:43:56.915 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:56.912+0000 7ff17c007640 1 --2- 172.21.15.150:0/3116161888 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff1740b7330 0x7ff17415c5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:43:56.915 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:56.912+0000 7ff17c007640 1 --2- 172.21.15.150:0/3116161888 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff1740b57a0 0x7ff17415a980 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:43:56.915 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:56.912+0000 7ff17c007640 1 --2- 172.21.15.150:0/3116161888 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff17409ba60 0x7ff17409cbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:43:56.915 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:56.912+0000 7ff17c007640 1 -- 172.21.15.150:0/3116161888 >> 172.21.15.150:0/3116161888 conn(0x7ff1740cee90 msgr2=0x7ff1740712d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:43:56.915 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:56.912+0000 7ff17c007640 1 -- 172.21.15.150:0/3116161888 shutdown_connections 2024-09-17T05:43:56.915 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:56.912+0000 7ff17c007640 1 -- 172.21.15.150:0/3116161888 wait complete. 2024-09-17T05:43:56.927 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config dump 2024-09-17T05:43:57.047 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:57.045+0000 7f919008c640 1 -- 172.21.15.150:0/1541401705 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f91880b4110 msgr2=0x7f918806fe70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:43:57.047 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:57.045+0000 7f919008c640 1 --2- 172.21.15.150:0/1541401705 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f91880b4110 0x7f918806fe70 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f9180005fd0 tx=0x7f918002bb30 comp rx=0 tx=0).stop 2024-09-17T05:43:57.047 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:57.045+0000 7f919008c640 1 -- 172.21.15.150:0/1541401705 shutdown_connections 2024-09-17T05:43:57.047 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:57.045+0000 7f919008c640 1 --2- 172.21.15.150:0/1541401705 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f91880b4110 0x7f918806fe70 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:43:57.047 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:57.045+0000 7f919008c640 1 --2- 172.21.15.150:0/1541401705 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f91880707b0 0x7f918806f930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:43:57.047 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:57.045+0000 7f919008c640 1 -- 172.21.15.150:0/1541401705 >> 172.21.15.150:0/1541401705 conn(0x7f918806d730 msgr2=0x7f91880b1e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:43:57.048 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:57.045+0000 7f919008c640 1 -- 172.21.15.150:0/1541401705 shutdown_connections 2024-09-17T05:43:57.048 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:57.045+0000 7f919008c640 1 -- 172.21.15.150:0/1541401705 wait complete. 2024-09-17T05:43:57.048 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:57.047+0000 7f919008c640 1 Processor -- start 2024-09-17T05:43:57.048 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:57.047+0000 7f919008c640 1 -- start start 2024-09-17T05:43:57.051 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:57.048+0000 7f919008c640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f91880707b0 0x7f9188154260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:43:57.051 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:57.048+0000 7f919008c640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f91880730b0 0x7f9188151b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:43:57.051 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:57.048+0000 7f919008c640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f91880b4110 0x7f9188152ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:43:57.051 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:57.048+0000 7f919008c640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f918806f0a0 con 0x7f91880b4110 2024-09-17T05:43:57.051 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:57.048+0000 7f919008c640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f918815b280 con 0x7f91880730b0 2024-09-17T05:43:57.051 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:57.048+0000 7f919008c640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f918806f220 con 0x7f91880707b0 2024-09-17T05:43:57.052 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:57.048+0000 7f918e629640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f91880b4110 0x7f9188152ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:43:57.052 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:57.048+0000 7f918e629640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f91880b4110 0x7f9188152ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:45230/0 (socket says 172.21.15.150:45230) 2024-09-17T05:43:57.052 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:57.048+0000 7f918e629640 1 -- 172.21.15.150:0/2920629415 learned_addr learned my addr 172.21.15.150:0/2920629415 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:43:57.052 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:57.048+0000 7f918de28640 1 --2- 172.21.15.150:0/2920629415 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f91880707b0 0x7f9188154260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:43:57.052 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:57.048+0000 7f918d627640 1 --2- 172.21.15.150:0/2920629415 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f91880730b0 0x7f9188151b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:43:57.052 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:57.049+0000 7f918e629640 1 -- 172.21.15.150:0/2920629415 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f91880707b0 msgr2=0x7f9188154260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:43:57.052 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:57.049+0000 7f918e629640 1 --2- 172.21.15.150:0/2920629415 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f91880707b0 0x7f9188154260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:43:57.052 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:57.049+0000 7f918e629640 1 -- 172.21.15.150:0/2920629415 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f91880730b0 msgr2=0x7f9188151b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:43:57.052 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:57.049+0000 7f918e629640 1 --2- 172.21.15.150:0/2920629415 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f91880730b0 0x7f9188151b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:43:57.052 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:57.049+0000 7f918e629640 1 -- 172.21.15.150:0/2920629415 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f91881f5510 con 0x7f91880b4110 2024-09-17T05:43:57.052 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:57.049+0000 7f918e629640 1 --2- 172.21.15.150:0/2920629415 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f91880b4110 0x7f9188152ca0 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f918000ade0 tx=0x7f918002df00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:43:57.052 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:57.049+0000 7f917e7fc640 1 -- 172.21.15.150:0/2920629415 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9180045070 con 0x7f91880b4110 2024-09-17T05:43:57.052 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:57.049+0000 7f917e7fc640 1 -- 172.21.15.150:0/2920629415 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9180004250 con 0x7f91880b4110 2024-09-17T05:43:57.053 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:57.049+0000 7f919008c640 1 -- 172.21.15.150:0/2920629415 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f91881f57f0 con 0x7f91880b4110 2024-09-17T05:43:57.053 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:57.049+0000 7f917e7fc640 1 -- 172.21.15.150:0/2920629415 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9180004680 con 0x7f91880b4110 2024-09-17T05:43:57.053 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:57.049+0000 7f919008c640 1 -- 172.21.15.150:0/2920629415 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f91881521b0 con 0x7f91880b4110 2024-09-17T05:43:57.054 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:57.050+0000 7f919008c640 1 -- 172.21.15.150:0/2920629415 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f91881f17b0 con 0x7f91880b4110 2024-09-17T05:43:57.054 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:57.051+0000 7f917e7fc640 1 -- 172.21.15.150:0/2920629415 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 9) ==== 101747+0+0 (secure 0 0 0) 0x7f91800493f0 con 0x7f91880b4110 2024-09-17T05:43:57.054 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:57.051+0000 7f917e7fc640 1 --2- 172.21.15.150:0/2920629415 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f916c078f20 0x7f916c07b430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:43:57.054 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:57.051+0000 7f917e7fc640 1 -- 172.21.15.150:0/2920629415 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 4943+0+0 (secure 0 0 0) 0x7f91800bce90 con 0x7f91880b4110 2024-09-17T05:43:57.054 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:57.051+0000 7f918de28640 1 --2- 172.21.15.150:0/2920629415 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f916c078f20 0x7f916c07b430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:43:57.054 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:57.052+0000 7f918de28640 1 --2- 172.21.15.150:0/2920629415 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f916c078f20 0x7f916c07b430 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f91880b4630 tx=0x7f918400b2e0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:43:57.057 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:57.056+0000 7f917e7fc640 1 -- 172.21.15.150:0/2920629415 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f9180033070 con 0x7f91880b4110 2024-09-17T05:43:57.234 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:57.232+0000 7f919008c640 1 -- 172.21.15.150:0/2920629415 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "config dump"} v 0) -- 0x7f9188152410 con 0x7f91880b4110 2024-09-17T05:43:57.234 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:57.233+0000 7f917e7fc640 1 -- 172.21.15.150:0/2920629415 <== mon.0 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "config dump"}]=0 v34) ==== 59+0+2294 (secure 0 0 0) 0x7f9180004820 con 0x7f91880b4110 2024-09-17T05:43:57.234 INFO:teuthology.orchestra.run.smithi150.stdout:WHO MASK LEVEL OPTION VALUE RO 2024-09-17T05:43:57.234 INFO:teuthology.orchestra.run.smithi150.stdout:mon advanced mon_op_complaint_time 120 2024-09-17T05:43:57.234 INFO:teuthology.orchestra.run.smithi150.stdout:mgr advanced client_mount_timeout 30 2024-09-17T05:43:57.235 INFO:teuthology.orchestra.run.smithi150.stdout:mgr advanced debug_client 20/20 2024-09-17T05:43:57.235 INFO:teuthology.orchestra.run.smithi150.stdout:mgr advanced debug_mgr 20/20 2024-09-17T05:43:57.235 INFO:teuthology.orchestra.run.smithi150.stdout:mgr advanced debug_ms 1/1 2024-09-17T05:43:57.235 INFO:teuthology.orchestra.run.smithi150.stdout:mgr dev mon_warn_on_pool_no_app false 2024-09-17T05:43:57.235 INFO:teuthology.orchestra.run.smithi150.stdout:osd advanced osd_op_complaint_time 180.000000 2024-09-17T05:43:57.235 INFO:teuthology.orchestra.run.smithi150.stdout:osd.0 basic osd_mclock_max_capacity_iops_ssd 6764.239331 2024-09-17T05:43:57.235 INFO:teuthology.orchestra.run.smithi150.stdout:osd.1 basic osd_mclock_max_capacity_iops_ssd 4956.769289 2024-09-17T05:43:57.235 INFO:teuthology.orchestra.run.smithi150.stdout:osd.2 basic osd_mclock_max_capacity_iops_ssd 5099.704467 2024-09-17T05:43:57.235 INFO:teuthology.orchestra.run.smithi150.stdout:osd.3 basic osd_mclock_max_capacity_iops_ssd 4681.616196 2024-09-17T05:43:57.235 INFO:teuthology.orchestra.run.smithi150.stdout:osd.4 basic osd_mclock_max_capacity_iops_ssd 4723.364425 2024-09-17T05:43:57.235 INFO:teuthology.orchestra.run.smithi150.stdout:osd.5 basic osd_mclock_max_capacity_iops_ssd 4509.722124 2024-09-17T05:43:57.235 INFO:teuthology.orchestra.run.smithi150.stdout:osd.6 basic osd_mclock_max_capacity_iops_ssd 6380.664158 2024-09-17T05:43:57.236 INFO:teuthology.orchestra.run.smithi150.stdout:osd.7 basic osd_mclock_max_capacity_iops_ssd 4303.333825 2024-09-17T05:43:57.236 INFO:teuthology.orchestra.run.smithi150.stdout:mds advanced debug_mds 20/20 2024-09-17T05:43:57.236 INFO:teuthology.orchestra.run.smithi150.stdout:mds advanced debug_mds_balancer 20/20 2024-09-17T05:43:57.236 INFO:teuthology.orchestra.run.smithi150.stdout:mds advanced debug_ms 2/2 2024-09-17T05:43:57.236 INFO:teuthology.orchestra.run.smithi150.stdout:mds dev mds_debug_frag true 2024-09-17T05:43:57.236 INFO:teuthology.orchestra.run.smithi150.stdout:mds dev mds_debug_scatterstat true 2024-09-17T05:43:57.236 INFO:teuthology.orchestra.run.smithi150.stdout:mds advanced mds_op_complaint_time 180.000000 2024-09-17T05:43:57.236 INFO:teuthology.orchestra.run.smithi150.stdout:mds dev mds_verify_scatter true 2024-09-17T05:43:57.236 INFO:teuthology.orchestra.run.smithi150.stdout:mds advanced osd_op_complaint_time 180.000000 2024-09-17T05:43:57.236 INFO:teuthology.orchestra.run.smithi150.stdout:mds advanced rados_mon_op_timeout 900 2024-09-17T05:43:57.236 INFO:teuthology.orchestra.run.smithi150.stdout:mds advanced rados_osd_op_timeout 900 2024-09-17T05:43:57.236 INFO:teuthology.orchestra.run.smithi150.stdout:client advanced client_mount_timeout 600 2024-09-17T05:43:57.236 INFO:teuthology.orchestra.run.smithi150.stdout:client advanced debug_client 20/20 2024-09-17T05:43:57.236 INFO:teuthology.orchestra.run.smithi150.stdout:client advanced debug_ms 1/1 2024-09-17T05:43:57.237 INFO:teuthology.orchestra.run.smithi150.stdout:client advanced rados_mon_op_timeout 900 2024-09-17T05:43:57.237 INFO:teuthology.orchestra.run.smithi150.stdout:client advanced rados_osd_op_timeout 900 2024-09-17T05:43:57.238 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:57.235+0000 7f919008c640 1 -- 172.21.15.150:0/2920629415 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f916c078f20 msgr2=0x7f916c07b430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:43:57.238 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:57.235+0000 7f919008c640 1 --2- 172.21.15.150:0/2920629415 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f916c078f20 0x7f916c07b430 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f91880b4630 tx=0x7f918400b2e0 comp rx=0 tx=0).stop 2024-09-17T05:43:57.238 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:57.235+0000 7f919008c640 1 -- 172.21.15.150:0/2920629415 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f91880b4110 msgr2=0x7f9188152ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:43:57.238 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:57.235+0000 7f919008c640 1 --2- 172.21.15.150:0/2920629415 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f91880b4110 0x7f9188152ca0 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f918000ade0 tx=0x7f918002df00 comp rx=0 tx=0).stop 2024-09-17T05:43:57.238 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:57.235+0000 7f919008c640 1 -- 172.21.15.150:0/2920629415 shutdown_connections 2024-09-17T05:43:57.238 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:57.235+0000 7f919008c640 1 --2- 172.21.15.150:0/2920629415 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f91880730b0 0x7f9188151b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:43:57.238 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:57.235+0000 7f919008c640 1 --2- 172.21.15.150:0/2920629415 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f916c078f20 0x7f916c07b430 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:43:57.238 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:57.235+0000 7f919008c640 1 --2- 172.21.15.150:0/2920629415 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f91880b4110 0x7f9188152ca0 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:43:57.238 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:57.235+0000 7f919008c640 1 --2- 172.21.15.150:0/2920629415 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f91880707b0 0x7f9188154260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:43:57.238 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:57.235+0000 7f919008c640 1 -- 172.21.15.150:0/2920629415 >> 172.21.15.150:0/2920629415 conn(0x7f918806d730 msgr2=0x7f9188143320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:43:57.238 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:57.235+0000 7f919008c640 1 -- 172.21.15.150:0/2920629415 shutdown_connections 2024-09-17T05:43:57.238 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:57.235+0000 7f919008c640 1 -- 172.21.15.150:0/2920629415 wait complete. 2024-09-17T05:43:57.248 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-09-17T05:43:57.365 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:57.363+0000 7ff19de4d640 1 -- 172.21.15.150:0/2073322193 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff180003a50 msgr2=0x7ff180003ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:43:57.365 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:57.363+0000 7ff19de4d640 1 --2- 172.21.15.150:0/2073322193 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff180003a50 0x7ff180003ec0 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7ff188009ec0 tx=0x7ff180005830 comp rx=0 tx=0).stop 2024-09-17T05:43:57.365 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:57.363+0000 7ff19de4d640 1 -- 172.21.15.150:0/2073322193 shutdown_connections 2024-09-17T05:43:57.366 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:57.363+0000 7ff19de4d640 1 --2- 172.21.15.150:0/2073322193 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff180003a50 0x7ff180003ec0 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:43:57.366 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:57.363+0000 7ff19de4d640 1 -- 172.21.15.150:0/2073322193 >> 172.21.15.150:0/2073322193 conn(0x7ff1980d4670 msgr2=0x7ff1980d4a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:43:57.366 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:57.363+0000 7ff19de4d640 1 -- 172.21.15.150:0/2073322193 shutdown_connections 2024-09-17T05:43:57.366 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:57.363+0000 7ff19de4d640 1 -- 172.21.15.150:0/2073322193 wait complete. 2024-09-17T05:43:57.366 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:57.365+0000 7ff19de4d640 1 Processor -- start 2024-09-17T05:43:57.367 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:57.365+0000 7ff19de4d640 1 -- start start 2024-09-17T05:43:57.369 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:57.367+0000 7ff19de4d640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff180003a50 0x7ff1980b4a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:43:57.370 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:57.367+0000 7ff19de4d640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff19814c380 0x7ff1980b7dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:43:57.370 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:57.367+0000 7ff19de4d640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff1980b8310 0x7ff1981f8fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:43:57.370 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:57.367+0000 7ff19de4d640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7ff1980d5190 con 0x7ff19814c380 2024-09-17T05:43:57.370 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:57.367+0000 7ff19de4d640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7ff198163420 con 0x7ff180003a50 2024-09-17T05:43:57.370 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:57.367+0000 7ff19de4d640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7ff1980d5310 con 0x7ff1980b8310 2024-09-17T05:43:57.370 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:57.367+0000 7ff196ffd640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff19814c380 0x7ff1980b7dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:43:57.370 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:57.367+0000 7ff196ffd640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff19814c380 0x7ff1980b7dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:45254/0 (socket says 172.21.15.150:45254) 2024-09-17T05:43:57.370 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:57.367+0000 7ff196ffd640 1 -- 172.21.15.150:0/691056024 learned_addr learned my addr 172.21.15.150:0/691056024 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:43:57.370 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:57.367+0000 7ff1977fe640 1 --2- 172.21.15.150:0/691056024 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff180003a50 0x7ff1980b4a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:43:57.370 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:57.367+0000 7ff197fff640 1 --2- 172.21.15.150:0/691056024 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff1980b8310 0x7ff1981f8fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:43:57.370 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:57.367+0000 7ff196ffd640 1 -- 172.21.15.150:0/691056024 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff1980b8310 msgr2=0x7ff1981f8fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:43:57.370 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:57.367+0000 7ff196ffd640 1 --2- 172.21.15.150:0/691056024 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff1980b8310 0x7ff1981f8fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:43:57.371 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:57.367+0000 7ff196ffd640 1 -- 172.21.15.150:0/691056024 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff180003a50 msgr2=0x7ff1980b4a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:43:57.371 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:57.367+0000 7ff196ffd640 1 --2- 172.21.15.150:0/691056024 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff180003a50 0x7ff1980b4a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:43:57.371 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:57.367+0000 7ff196ffd640 1 -- 172.21.15.150:0/691056024 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff1980b8720 con 0x7ff19814c380 2024-09-17T05:43:57.371 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:57.367+0000 7ff197fff640 1 --2- 172.21.15.150:0/691056024 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff1980b8310 0x7ff1981f8fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T05:43:57.371 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:57.367+0000 7ff196ffd640 1 --2- 172.21.15.150:0/691056024 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff19814c380 0x7ff1980b7dd0 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7ff18c00e5c0 tx=0x7ff18c001990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:43:57.371 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:57.367+0000 7ff17ffff640 1 -- 172.21.15.150:0/691056024 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff18c015070 con 0x7ff19814c380 2024-09-17T05:43:57.371 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:57.367+0000 7ff17ffff640 1 -- 172.21.15.150:0/691056024 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff18c00c9e0 con 0x7ff19814c380 2024-09-17T05:43:57.371 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:57.367+0000 7ff19de4d640 1 -- 172.21.15.150:0/691056024 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff1980b4fd0 con 0x7ff19814c380 2024-09-17T05:43:57.371 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:57.367+0000 7ff17ffff640 1 -- 172.21.15.150:0/691056024 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff18c00ce30 con 0x7ff19814c380 2024-09-17T05:43:57.371 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:57.367+0000 7ff19de4d640 1 -- 172.21.15.150:0/691056024 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff19814f240 con 0x7ff19814c380 2024-09-17T05:43:57.371 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:57.368+0000 7ff19de4d640 1 -- 172.21.15.150:0/691056024 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff198162780 con 0x7ff19814c380 2024-09-17T05:43:57.372 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:57.369+0000 7ff17ffff640 1 -- 172.21.15.150:0/691056024 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 9) ==== 101747+0+0 (secure 0 0 0) 0x7ff18c018070 con 0x7ff19814c380 2024-09-17T05:43:57.372 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:57.370+0000 7ff17ffff640 1 --2- 172.21.15.150:0/691056024 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7ff184078f20 0x7ff18407b430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:43:57.372 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:57.370+0000 7ff17ffff640 1 -- 172.21.15.150:0/691056024 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 4943+0+0 (secure 0 0 0) 0x7ff18c09b620 con 0x7ff19814c380 2024-09-17T05:43:57.372 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:57.370+0000 7ff1977fe640 1 --2- 172.21.15.150:0/691056024 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7ff184078f20 0x7ff18407b430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:43:57.372 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:57.371+0000 7ff1977fe640 1 --2- 172.21.15.150:0/691056024 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7ff184078f20 0x7ff18407b430 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7ff188035000 tx=0x7ff18802d040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:43:57.376 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:57.374+0000 7ff17ffff640 1 -- 172.21.15.150:0/691056024 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7ff1980b8720 con 0x7ff19814c380 2024-09-17T05:43:57.553 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:57.551+0000 7ff19de4d640 1 -- 172.21.15.150:0/691056024 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) -- 0x7ff19814efd0 con 0x7ff19814c380 2024-09-17T05:43:57.556 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:57.555+0000 7ff17ffff640 1 -- 172.21.15.150:0/691056024 <== mon.0 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v35)=0 v35) ==== 122+0+0 (secure 0 0 0) 0x7ff18c063740 con 0x7ff19814c380 2024-09-17T05:43:57.559 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:57.557+0000 7ff19de4d640 1 -- 172.21.15.150:0/691056024 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7ff184078f20 msgr2=0x7ff18407b430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:43:57.559 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:57.557+0000 7ff19de4d640 1 --2- 172.21.15.150:0/691056024 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7ff184078f20 0x7ff18407b430 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7ff188035000 tx=0x7ff18802d040 comp rx=0 tx=0).stop 2024-09-17T05:43:57.559 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:57.557+0000 7ff19de4d640 1 -- 172.21.15.150:0/691056024 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff19814c380 msgr2=0x7ff1980b7dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:43:57.559 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:57.557+0000 7ff19de4d640 1 --2- 172.21.15.150:0/691056024 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff19814c380 0x7ff1980b7dd0 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7ff18c00e5c0 tx=0x7ff18c001990 comp rx=0 tx=0).stop 2024-09-17T05:43:57.559 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:57.557+0000 7ff19de4d640 1 -- 172.21.15.150:0/691056024 shutdown_connections 2024-09-17T05:43:57.559 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:57.557+0000 7ff19de4d640 1 --2- 172.21.15.150:0/691056024 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7ff184078f20 0x7ff18407b430 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:43:57.559 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:57.557+0000 7ff19de4d640 1 --2- 172.21.15.150:0/691056024 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff1980b8310 0x7ff1981f8fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:43:57.559 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:57.557+0000 7ff19de4d640 1 --2- 172.21.15.150:0/691056024 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff19814c380 0x7ff1980b7dd0 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:43:57.560 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:57.557+0000 7ff19de4d640 1 --2- 172.21.15.150:0/691056024 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff180003a50 0x7ff1980b4a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:43:57.560 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:57.557+0000 7ff19de4d640 1 -- 172.21.15.150:0/691056024 >> 172.21.15.150:0/691056024 conn(0x7ff1980d4670 msgr2=0x7ff19806e2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:43:57.560 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:57.557+0000 7ff19de4d640 1 -- 172.21.15.150:0/691056024 shutdown_connections 2024-09-17T05:43:57.560 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:57.557+0000 7ff19de4d640 1 -- 172.21.15.150:0/691056024 wait complete. 2024-09-17T05:43:57.570 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-17T05:43:57.570 DEBUG:teuthology.orchestra.run.smithi150:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-17T05:43:57.610 DEBUG:teuthology.orchestra.run.smithi176:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-17T05:43:57.660 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-17T05:43:57.660 DEBUG:teuthology.orchestra.run.smithi150:> set -ex 2024-09-17T05:43:57.660 DEBUG:teuthology.orchestra.run.smithi150:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T05:43:57.676 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056027,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497464k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=18693 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248728k,nr_inodes=812182,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497464k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-17T05:43:57.676 DEBUG:teuthology.orchestra.run.smithi176:> set -ex 2024-09-17T05:43:57.677 DEBUG:teuthology.orchestra.run.smithi176:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T05:43:57.695 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056030,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497468k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=3379 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248732k,nr_inodes=812183,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497468k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-17T05:43:57.695 DEBUG:teuthology.orchestra.run.smithi150:> set -ex 2024-09-17T05:43:57.695 DEBUG:teuthology.orchestra.run.smithi150:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T05:43:57.731 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056027,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497464k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=18693 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248728k,nr_inodes=812182,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497464k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-17T05:43:57.732 DEBUG:teuthology.orchestra.run.smithi176:> set -ex 2024-09-17T05:43:57.732 DEBUG:teuthology.orchestra.run.smithi176:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T05:43:57.753 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056030,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497468k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=3379 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248732k,nr_inodes=812183,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497468k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-17T05:43:57.753 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-09-17T05:43:57.753 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T05:43:57.885 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:57.884+0000 7febb0b58640 1 -- 172.21.15.150:0/3266769684 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7febac0b9780 msgr2=0x7febac0b3720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:43:57.886 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:57.884+0000 7febb0b58640 1 --2- 172.21.15.150:0/3266769684 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7febac0b9780 0x7febac0b3720 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7febac0d5740 tx=0x7feb9c02a4a0 comp rx=0 tx=0).stop 2024-09-17T05:43:57.886 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:57.884+0000 7febb0b58640 1 -- 172.21.15.150:0/3266769684 shutdown_connections 2024-09-17T05:43:57.886 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:57.884+0000 7febb0b58640 1 --2- 172.21.15.150:0/3266769684 >> v2:172.21.15.176:3300/0 conn(0x7febac0d17a0 0x7febac0cf470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:43:57.886 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:57.884+0000 7febb0b58640 1 --2- 172.21.15.150:0/3266769684 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7febac0b9780 0x7febac0b3720 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:43:57.886 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:57.884+0000 7febb0b58640 1 -- 172.21.15.150:0/3266769684 >> 172.21.15.150:0/3266769684 conn(0x7febac0d4680 msgr2=0x7febac0d4a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:43:57.886 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:57.884+0000 7febb0b58640 1 -- 172.21.15.150:0/3266769684 shutdown_connections 2024-09-17T05:43:57.886 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:57.884+0000 7febb0b58640 1 -- 172.21.15.150:0/3266769684 wait complete. 2024-09-17T05:43:57.887 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:57.886+0000 7febb0b58640 1 Processor -- start 2024-09-17T05:43:57.887 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:57.886+0000 7febb0b58640 1 -- start start 2024-09-17T05:43:57.890 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:57.887+0000 7febb0b58640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7febac0b9780 0x7febac0b55d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:43:57.890 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:57.887+0000 7febb0b58640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7febac15ee50 0x7febac1f5b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:43:57.890 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:57.887+0000 7febb0b58640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7febac144bc0 0x7febac0b26b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:43:57.890 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:57.887+0000 7febb0b58640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7febac0cfd40 con 0x7febac144bc0 2024-09-17T05:43:57.890 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:57.887+0000 7febb0b58640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7febac0cfbc0 con 0x7febac0b9780 2024-09-17T05:43:57.890 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:57.887+0000 7febb0b58640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7febac0cfec0 con 0x7febac15ee50 2024-09-17T05:43:57.891 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:57.887+0000 7febaad9d640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7febac144bc0 0x7febac0b26b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:43:57.891 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:57.887+0000 7febaad9d640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7febac144bc0 0x7febac0b26b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:45260/0 (socket says 172.21.15.150:45260) 2024-09-17T05:43:57.891 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:57.887+0000 7febaad9d640 1 -- 172.21.15.150:0/2372059409 learned_addr learned my addr 172.21.15.150:0/2372059409 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:43:57.891 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:57.887+0000 7febaa59c640 1 --2- 172.21.15.150:0/2372059409 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7febac0b9780 0x7febac0b55d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:43:57.891 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:57.887+0000 7feba1d9b640 1 --2- 172.21.15.150:0/2372059409 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7febac15ee50 0x7febac1f5b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:43:57.891 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:57.888+0000 7febaad9d640 1 -- 172.21.15.150:0/2372059409 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7febac15ee50 msgr2=0x7febac1f5b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:43:57.891 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:57.888+0000 7febaad9d640 1 --2- 172.21.15.150:0/2372059409 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7febac15ee50 0x7febac1f5b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:43:57.891 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:57.888+0000 7febaad9d640 1 -- 172.21.15.150:0/2372059409 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7febac0b9780 msgr2=0x7febac0b55d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:43:57.891 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:57.888+0000 7febaad9d640 1 --2- 172.21.15.150:0/2372059409 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7febac0b9780 0x7febac0b55d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:43:57.891 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:57.888+0000 7febaad9d640 1 -- 172.21.15.150:0/2372059409 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7febac15d520 con 0x7febac144bc0 2024-09-17T05:43:57.891 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:57.888+0000 7febaad9d640 1 --2- 172.21.15.150:0/2372059409 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7febac144bc0 0x7febac0b26b0 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7feba400e9c0 tx=0x7feba400ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:43:57.891 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:57.888+0000 7feba37fe640 1 -- 172.21.15.150:0/2372059409 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feba4004d20 con 0x7febac144bc0 2024-09-17T05:43:57.892 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:57.888+0000 7feba37fe640 1 -- 172.21.15.150:0/2372059409 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7feba400cac0 con 0x7febac144bc0 2024-09-17T05:43:57.892 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:57.888+0000 7febb0b58640 1 -- 172.21.15.150:0/2372059409 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7febac0b5b10 con 0x7febac144bc0 2024-09-17T05:43:57.892 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:57.888+0000 7feba37fe640 1 -- 172.21.15.150:0/2372059409 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feba4005020 con 0x7febac144bc0 2024-09-17T05:43:57.892 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:57.888+0000 7febb0b58640 1 -- 172.21.15.150:0/2372059409 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7febac15da00 con 0x7febac144bc0 2024-09-17T05:43:57.893 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:57.889+0000 7febb0b58640 1 -- 172.21.15.150:0/2372059409 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7febac0b3500 con 0x7febac144bc0 2024-09-17T05:43:57.893 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:57.890+0000 7feba37fe640 1 -- 172.21.15.150:0/2372059409 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 9) ==== 101747+0+0 (secure 0 0 0) 0x7feba40051c0 con 0x7febac144bc0 2024-09-17T05:43:57.893 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:57.890+0000 7feba37fe640 1 --2- 172.21.15.150:0/2372059409 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7feb8c078ef0 0x7feb8c07b400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:43:57.893 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:57.891+0000 7feba37fe640 1 -- 172.21.15.150:0/2372059409 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 4943+0+0 (secure 0 0 0) 0x7feba409b930 con 0x7febac144bc0 2024-09-17T05:43:57.893 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:57.891+0000 7febaa59c640 1 --2- 172.21.15.150:0/2372059409 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7feb8c078ef0 0x7feb8c07b400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:43:57.893 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:57.891+0000 7febaa59c640 1 --2- 172.21.15.150:0/2372059409 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7feb8c078ef0 0x7feb8c07b400 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7feb9c034000 tx=0x7feb9c004730 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:43:57.897 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:57.895+0000 7feba37fe640 1 -- 172.21.15.150:0/2372059409 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7febac0b3500 con 0x7febac144bc0 2024-09-17T05:43:58.111 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:58.109+0000 7febb0b58640 1 -- 172.21.15.150:0/2372059409 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7febac15d790 con 0x7febac144bc0 2024-09-17T05:43:58.111 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:58.110+0000 7feba37fe640 1 -- 172.21.15.150:0/2372059409 <== mon.0 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 18 v18) ==== 94+0+3920 (secure 0 0 0) 0x7feba406c020 con 0x7febac144bc0 2024-09-17T05:43:58.112 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-09-17T05:43:58.112 INFO:teuthology.orchestra.run.smithi150.stdout:{"epoch":18,"btime":"2024-09-17T05:43:51:738367+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4664,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6835/392464003","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6833","nonce":392464003},{"type":"v1","addr":"172.21.15.150:6835","nonce":392464003}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":4673,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6837/3232718608","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6835","nonce":3232718608},{"type":"v1","addr":"172.21.15.176:6837","nonce":3232718608}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":4867,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6836/2911955319","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6834","nonce":2911955319},{"type":"v1","addr":"172.21.15.176:6836","nonce":2911955319}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":5367,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6834/2586978791","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6832","nonce":2586978791},{"type":"v1","addr":"172.21.15.150:6834","nonce":2586978791}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":18}],"filesystems":[]} 2024-09-17T05:43:58.112 INFO:teuthology.orchestra.run.smithi150.stderr:dumped fsmap epoch 18 2024-09-17T05:43:58.116 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:58.112+0000 7febb0b58640 1 -- 172.21.15.150:0/2372059409 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7feb8c078ef0 msgr2=0x7feb8c07b400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:43:58.117 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:58.112+0000 7febb0b58640 1 --2- 172.21.15.150:0/2372059409 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7feb8c078ef0 0x7feb8c07b400 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7feb9c034000 tx=0x7feb9c004730 comp rx=0 tx=0).stop 2024-09-17T05:43:58.117 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:58.112+0000 7febb0b58640 1 -- 172.21.15.150:0/2372059409 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7febac144bc0 msgr2=0x7febac0b26b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:43:58.117 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:58.112+0000 7febb0b58640 1 --2- 172.21.15.150:0/2372059409 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7febac144bc0 0x7febac0b26b0 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7feba400e9c0 tx=0x7feba400ee80 comp rx=0 tx=0).stop 2024-09-17T05:43:58.117 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:58.112+0000 7febb0b58640 1 -- 172.21.15.150:0/2372059409 shutdown_connections 2024-09-17T05:43:58.117 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:58.112+0000 7febb0b58640 1 --2- 172.21.15.150:0/2372059409 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7feb8c078ef0 0x7feb8c07b400 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:43:58.117 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:58.112+0000 7febb0b58640 1 --2- 172.21.15.150:0/2372059409 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7febac144bc0 0x7febac0b26b0 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:43:58.117 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:58.112+0000 7febb0b58640 1 --2- 172.21.15.150:0/2372059409 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7febac15ee50 0x7febac1f5b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:43:58.117 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:58.112+0000 7febb0b58640 1 --2- 172.21.15.150:0/2372059409 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7febac0b9780 0x7febac0b55d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:43:58.117 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:58.112+0000 7febb0b58640 1 -- 172.21.15.150:0/2372059409 >> 172.21.15.150:0/2372059409 conn(0x7febac0d4680 msgr2=0x7febac0d13e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:43:58.117 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:58.112+0000 7febb0b58640 1 -- 172.21.15.150:0/2372059409 shutdown_connections 2024-09-17T05:43:58.117 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:58.112+0000 7febb0b58640 1 -- 172.21.15.150:0/2372059409 wait complete. 2024-09-17T05:43:58.126 INFO:tasks.ceph.mds.a:Restarting daemon 2024-09-17T05:43:58.126 INFO:tasks.ceph.mds.a:Stopping old one... 2024-09-17T05:43:58.126 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-09-17T05:43:58.126 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T05:43:58.126 INFO:tasks.ceph.mds.c:Restarting daemon 2024-09-17T05:43:58.127 INFO:tasks.ceph.mds.c:Stopping old one... 2024-09-17T05:43:58.127 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-09-17T05:43:58.127 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T05:43:58.127 INFO:tasks.ceph.mds.b:Restarting daemon 2024-09-17T05:43:58.127 INFO:tasks.ceph.mds.b:Stopping old one... 2024-09-17T05:43:58.127 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-09-17T05:43:58.127 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T05:43:58.128 INFO:tasks.ceph.mds.d:Restarting daemon 2024-09-17T05:43:58.128 INFO:tasks.ceph.mds.d:Stopping old one... 2024-09-17T05:43:58.128 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-09-17T05:43:58.128 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T05:43:58.138 INFO:tasks.ceph.mds.c:Stopped 2024-09-17T05:43:58.138 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-09-17T05:43:58.140 INFO:tasks.ceph.mds.d:Stopped 2024-09-17T05:43:58.141 DEBUG:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-09-17T05:43:58.141 INFO:tasks.ceph.mds.b:Stopped 2024-09-17T05:43:58.142 DEBUG:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-09-17T05:43:58.143 INFO:tasks.ceph.mds.a:Stopped 2024-09-17T05:43:58.143 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-09-17T05:43:58.184 INFO:tasks.ceph.mds.d:Started 2024-09-17T05:43:58.184 DEBUG:teuthology.parallel:result is None 2024-09-17T05:43:58.185 INFO:tasks.ceph.mds.b:Started 2024-09-17T05:43:58.185 DEBUG:teuthology.parallel:result is None 2024-09-17T05:43:58.185 INFO:tasks.ceph.mds.c:Started 2024-09-17T05:43:58.186 DEBUG:teuthology.parallel:result is None 2024-09-17T05:43:58.187 INFO:tasks.ceph.mds.a:Started 2024-09-17T05:43:58.187 DEBUG:teuthology.parallel:result is None 2024-09-17T05:43:58.187 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-09-17T05:43:58.273 INFO:tasks.ceph.mds.a.smithi150.stdout:starting mds.a at 2024-09-17T05:43:58.274 INFO:tasks.ceph.mds.c.smithi150.stdout:starting mds.c at 2024-09-17T05:43:58.277 INFO:tasks.ceph.mds.d.smithi176.stdout:starting mds.d at 2024-09-17T05:43:58.277 INFO:tasks.ceph.mds.b.smithi176.stdout:starting mds.b at 2024-09-17T05:43:58.307 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:58.305+0000 7f9b4078b640 1 -- 172.21.15.150:0/3824192361 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9b380b74b0 msgr2=0x7f9b380b78c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:43:58.307 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:58.305+0000 7f9b4078b640 1 --2- 172.21.15.150:0/3824192361 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9b380b74b0 0x7f9b380b78c0 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f9b380b9c80 tx=0x7f9b3002a5c0 comp rx=0 tx=0).stop 2024-09-17T05:43:58.307 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:58.305+0000 7f9b4078b640 1 -- 172.21.15.150:0/3824192361 shutdown_connections 2024-09-17T05:43:58.307 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:58.305+0000 7f9b4078b640 1 --2- 172.21.15.150:0/3824192361 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9b380b74b0 0x7f9b380b78c0 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:43:58.307 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:58.305+0000 7f9b4078b640 1 -- 172.21.15.150:0/3824192361 >> 172.21.15.150:0/3824192361 conn(0x7f9b3808bfe0 msgr2=0x7f9b380d4660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:43:58.308 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:58.305+0000 7f9b4078b640 1 -- 172.21.15.150:0/3824192361 shutdown_connections 2024-09-17T05:43:58.308 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:58.305+0000 7f9b4078b640 1 -- 172.21.15.150:0/3824192361 wait complete. 2024-09-17T05:43:58.308 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:58.307+0000 7f9b4078b640 1 Processor -- start 2024-09-17T05:43:58.309 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:58.307+0000 7f9b4078b640 1 -- start start 2024-09-17T05:43:58.311 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:58.308+0000 7f9b4078b640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9b380b6a30 0x7f9b380b20d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:43:58.311 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:58.308+0000 7f9b4078b640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9b380b74b0 0x7f9b380cd0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:43:58.311 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:58.309+0000 7f9b4078b640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9b380d2e50 0x7f9b381613f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:43:58.312 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:58.309+0000 7f9b4078b640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f9b3816a340 con 0x7f9b380b74b0 2024-09-17T05:43:58.312 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:58.309+0000 7f9b4078b640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f9b380d34f0 con 0x7f9b380d2e50 2024-09-17T05:43:58.312 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:58.309+0000 7f9b4078b640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f9b3816a4c0 con 0x7f9b380b6a30 2024-09-17T05:43:58.312 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:58.309+0000 7f9b3dd26640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9b380b74b0 0x7f9b380cd0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:43:58.312 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:58.309+0000 7f9b3dd26640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9b380b74b0 0x7f9b380cd0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:45322/0 (socket says 172.21.15.150:45322) 2024-09-17T05:43:58.312 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:58.309+0000 7f9b3dd26640 1 -- 172.21.15.150:0/3822419036 learned_addr learned my addr 172.21.15.150:0/3822419036 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:43:58.312 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:58.309+0000 7f9b3e527640 1 --2- 172.21.15.150:0/3822419036 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9b380b6a30 0x7f9b380b20d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:43:58.312 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:58.309+0000 7f9b3ed28640 1 --2- 172.21.15.150:0/3822419036 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9b380d2e50 0x7f9b381613f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:43:58.312 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:58.309+0000 7f9b3dd26640 1 -- 172.21.15.150:0/3822419036 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9b380b6a30 msgr2=0x7f9b380b20d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:43:58.312 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:58.309+0000 7f9b3dd26640 1 --2- 172.21.15.150:0/3822419036 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9b380b6a30 0x7f9b380b20d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:43:58.312 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:58.309+0000 7f9b3dd26640 1 -- 172.21.15.150:0/3822419036 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9b380d2e50 msgr2=0x7f9b381613f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:43:58.312 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:58.309+0000 7f9b3dd26640 1 --2- 172.21.15.150:0/3822419036 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9b380d2e50 0x7f9b381613f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:43:58.313 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:58.309+0000 7f9b3dd26640 1 -- 172.21.15.150:0/3822419036 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9b381f95d0 con 0x7f9b380b74b0 2024-09-17T05:43:58.313 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:58.309+0000 7f9b3dd26640 1 --2- 172.21.15.150:0/3822419036 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9b380b74b0 0x7f9b380cd0a0 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f9b2c00c3d0 tx=0x7f9b2c00c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:43:58.313 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:58.309+0000 7f9b36ffd640 1 -- 172.21.15.150:0/3822419036 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b2c017070 con 0x7f9b380b74b0 2024-09-17T05:43:58.313 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:58.309+0000 7f9b36ffd640 1 -- 172.21.15.150:0/3822419036 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9b2c0053c0 con 0x7f9b380b74b0 2024-09-17T05:43:58.313 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:58.309+0000 7f9b4078b640 1 -- 172.21.15.150:0/3822419036 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9b381f98b0 con 0x7f9b380b74b0 2024-09-17T05:43:58.313 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:58.309+0000 7f9b36ffd640 1 -- 172.21.15.150:0/3822419036 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b2c003850 con 0x7f9b380b74b0 2024-09-17T05:43:58.313 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:58.309+0000 7f9b4078b640 1 -- 172.21.15.150:0/3822419036 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9b381f9e70 con 0x7f9b380b74b0 2024-09-17T05:43:58.314 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:58.310+0000 7f9b4078b640 1 -- 172.21.15.150:0/3822419036 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9b3808caf0 con 0x7f9b380b74b0 2024-09-17T05:43:58.314 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:58.311+0000 7f9b36ffd640 1 -- 172.21.15.150:0/3822419036 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 9) ==== 101747+0+0 (secure 0 0 0) 0x7f9b2c01a070 con 0x7f9b380b74b0 2024-09-17T05:43:58.314 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:58.312+0000 7f9b36ffd640 1 --2- 172.21.15.150:0/3822419036 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f9b24078f20 0x7f9b2407b430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:43:58.314 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:58.312+0000 7f9b36ffd640 1 -- 172.21.15.150:0/3822419036 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 4943+0+0 (secure 0 0 0) 0x7f9b2c09a2c0 con 0x7f9b380b74b0 2024-09-17T05:43:58.314 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:58.312+0000 7f9b3e527640 1 --2- 172.21.15.150:0/3822419036 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f9b24078f20 0x7f9b2407b430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:43:58.314 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:58.313+0000 7f9b3e527640 1 --2- 172.21.15.150:0/3822419036 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f9b24078f20 0x7f9b2407b430 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f9b30034000 tx=0x7f9b30004730 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:43:58.318 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:58.316+0000 7f9b36ffd640 1 -- 172.21.15.150:0/3822419036 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f9b3808caf0 con 0x7f9b380b74b0 2024-09-17T05:43:58.503 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:58.501+0000 7f9b4078b640 1 -- 172.21.15.150:0/3822419036 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) -- 0x7f9b381f9360 con 0x7f9b380b74b0 2024-09-17T05:43:58.923 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:58.922+0000 7f9b36ffd640 1 -- 172.21.15.150:0/3822419036 <== mon.0 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v39) ==== 97+0+0 (secure 0 0 0) 0x7f9b2c061f20 con 0x7f9b380b74b0 2024-09-17T05:43:58.924 INFO:teuthology.orchestra.run.smithi150.stderr: removed all blocklist entries 2024-09-17T05:43:58.927 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:58.925+0000 7f9b4078b640 1 -- 172.21.15.150:0/3822419036 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f9b24078f20 msgr2=0x7f9b2407b430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:43:58.927 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:58.925+0000 7f9b4078b640 1 --2- 172.21.15.150:0/3822419036 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f9b24078f20 0x7f9b2407b430 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f9b30034000 tx=0x7f9b30004730 comp rx=0 tx=0).stop 2024-09-17T05:43:58.927 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:58.925+0000 7f9b4078b640 1 -- 172.21.15.150:0/3822419036 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9b380b74b0 msgr2=0x7f9b380cd0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:43:58.927 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:58.925+0000 7f9b4078b640 1 --2- 172.21.15.150:0/3822419036 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9b380b74b0 0x7f9b380cd0a0 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f9b2c00c3d0 tx=0x7f9b2c00c890 comp rx=0 tx=0).stop 2024-09-17T05:43:58.927 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:58.925+0000 7f9b4078b640 1 -- 172.21.15.150:0/3822419036 shutdown_connections 2024-09-17T05:43:58.927 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:58.925+0000 7f9b4078b640 1 --2- 172.21.15.150:0/3822419036 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9b380d2e50 0x7f9b381613f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:43:58.927 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:58.925+0000 7f9b4078b640 1 --2- 172.21.15.150:0/3822419036 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f9b24078f20 0x7f9b2407b430 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:43:58.927 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:58.925+0000 7f9b4078b640 1 --2- 172.21.15.150:0/3822419036 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9b380b74b0 0x7f9b380cd0a0 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:43:58.928 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:58.925+0000 7f9b4078b640 1 --2- 172.21.15.150:0/3822419036 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9b380b6a30 0x7f9b380b20d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:43:58.928 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:58.925+0000 7f9b4078b640 1 -- 172.21.15.150:0/3822419036 >> 172.21.15.150:0/3822419036 conn(0x7f9b3808bfe0 msgr2=0x7f9b380b7ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:43:58.928 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:58.925+0000 7f9b4078b640 1 -- 172.21.15.150:0/3822419036 shutdown_connections 2024-09-17T05:43:58.928 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:58.926+0000 7f9b4078b640 1 -- 172.21.15.150:0/3822419036 wait complete. 2024-09-17T05:43:58.941 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-09-17T05:43:59.056 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:59.054+0000 7fa36c782640 1 -- 172.21.15.150:0/3900564276 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa350004800 msgr2=0x7fa350004c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:43:59.056 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:59.054+0000 7fa36c782640 1 --2- 172.21.15.150:0/3900564276 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa350004800 0x7fa350004c10 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7fa364077250 tx=0x7fa350005830 comp rx=0 tx=0).stop 2024-09-17T05:43:59.056 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:59.054+0000 7fa36ad1f640 1 -- 172.21.15.150:0/3900564276 reap_dead start 2024-09-17T05:43:59.056 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:59.054+0000 7fa36c782640 1 -- 172.21.15.150:0/3900564276 shutdown_connections 2024-09-17T05:43:59.056 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:59.054+0000 7fa36c782640 1 -- 172.21.15.150:0/3900564276 >> 172.21.15.150:0/3900564276 conn(0x7fa3640b3fc0 msgr2=0x7fa3640b43d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:43:59.056 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:59.054+0000 7fa36c782640 1 -- 172.21.15.150:0/3900564276 shutdown_connections 2024-09-17T05:43:59.056 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:59.054+0000 7fa36c782640 1 -- 172.21.15.150:0/3900564276 wait complete. 2024-09-17T05:43:59.057 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:59.056+0000 7fa36c782640 1 Processor -- start 2024-09-17T05:43:59.057 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:59.056+0000 7fa36c782640 1 -- start start 2024-09-17T05:43:59.060 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:59.057+0000 7fa36c782640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa350004800 0x7fa36406ea70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:43:59.060 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:59.057+0000 7fa36c782640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa3640cbdf0 0x7fa3640c5340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:43:59.060 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:59.057+0000 7fa36c782640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa3640b6480 0x7fa3640b6890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:43:59.060 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:59.057+0000 7fa36c782640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7fa3640b2390 con 0x7fa350004800 2024-09-17T05:43:59.060 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:59.057+0000 7fa36c782640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fa3640b2210 con 0x7fa3640b6480 2024-09-17T05:43:59.061 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:59.057+0000 7fa36c782640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fa3640ceb70 con 0x7fa3640cbdf0 2024-09-17T05:43:59.061 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:59.057+0000 7fa36a51e640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa350004800 0x7fa36406ea70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:43:59.061 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:59.057+0000 7fa36a51e640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa350004800 0x7fa36406ea70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:45348/0 (socket says 172.21.15.150:45348) 2024-09-17T05:43:59.061 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:59.057+0000 7fa36a51e640 1 -- 172.21.15.150:0/4104566375 learned_addr learned my addr 172.21.15.150:0/4104566375 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:43:59.061 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:59.057+0000 7fa369d1d640 1 --2- 172.21.15.150:0/4104566375 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa3640cbdf0 0x7fa3640c5340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:43:59.061 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:59.057+0000 7fa36ad1f640 1 --2- 172.21.15.150:0/4104566375 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa3640b6480 0x7fa3640b6890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:43:59.061 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:59.057+0000 7fa36a51e640 1 -- 172.21.15.150:0/4104566375 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa3640cbdf0 msgr2=0x7fa3640c5340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:43:59.061 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:59.057+0000 7fa36a51e640 1 --2- 172.21.15.150:0/4104566375 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa3640cbdf0 0x7fa3640c5340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:43:59.061 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:59.057+0000 7fa36a51e640 1 -- 172.21.15.150:0/4104566375 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa3640b6480 msgr2=0x7fa3640b6890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:43:59.061 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:59.057+0000 7fa36a51e640 1 --2- 172.21.15.150:0/4104566375 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa3640b6480 0x7fa3640b6890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:43:59.061 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:59.057+0000 7fa36a51e640 1 -- 172.21.15.150:0/4104566375 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa3640b6dd0 con 0x7fa350004800 2024-09-17T05:43:59.061 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:59.058+0000 7fa36a51e640 1 --2- 172.21.15.150:0/4104566375 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa350004800 0x7fa36406ea70 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7fa3600065f0 tx=0x7fa3600039c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:43:59.061 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:59.058+0000 7fa35affd640 1 -- 172.21.15.150:0/4104566375 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa360015070 con 0x7fa350004800 2024-09-17T05:43:59.062 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:59.058+0000 7fa35affd640 1 -- 172.21.15.150:0/4104566375 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa360011920 con 0x7fa350004800 2024-09-17T05:43:59.062 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:59.058+0000 7fa36c782640 1 -- 172.21.15.150:0/4104566375 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa3641f9ad0 con 0x7fa350004800 2024-09-17T05:43:59.062 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:59.058+0000 7fa35affd640 1 -- 172.21.15.150:0/4104566375 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa360011d70 con 0x7fa350004800 2024-09-17T05:43:59.062 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:59.058+0000 7fa36c782640 1 -- 172.21.15.150:0/4104566375 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa3641f8ff0 con 0x7fa350004800 2024-09-17T05:43:59.062 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:59.059+0000 7fa36c782640 1 -- 172.21.15.150:0/4104566375 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa3640b1910 con 0x7fa350004800 2024-09-17T05:43:59.063 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:59.060+0000 7fa35affd640 1 -- 172.21.15.150:0/4104566375 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 9) ==== 101747+0+0 (secure 0 0 0) 0x7fa360010420 con 0x7fa350004800 2024-09-17T05:43:59.063 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:59.060+0000 7fa35affd640 1 --2- 172.21.15.150:0/4104566375 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fa348078f20 0x7fa34807b430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:43:59.063 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:59.060+0000 7fa35affd640 1 -- 172.21.15.150:0/4104566375 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(41..41 src has 1..41) ==== 4857+0+0 (secure 0 0 0) 0x7fa36009bec0 con 0x7fa350004800 2024-09-17T05:43:59.063 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:59.060+0000 7fa369d1d640 1 --2- 172.21.15.150:0/4104566375 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fa348078f20 0x7fa34807b430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:43:59.063 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:59.061+0000 7fa369d1d640 1 --2- 172.21.15.150:0/4104566375 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fa348078f20 0x7fa34807b430 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fa354035000 tx=0x7fa35402d040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:43:59.066 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:59.065+0000 7fa35affd640 1 -- 172.21.15.150:0/4104566375 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fa3640b6dd0 con 0x7fa350004800 2024-09-17T05:43:59.307 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:59.306+0000 7fa36c782640 1 -- 172.21.15.150:0/4104566375 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) -- 0x7fa3640cc200 con 0x7fa350004800 2024-09-17T05:43:59.307 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:59.306+0000 7fa35affd640 1 -- 172.21.15.150:0/4104566375 <== mon.0 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v11) ==== 80+0+5304 (secure 0 0 0) 0x7fa360064030 con 0x7fa350004800 2024-09-17T05:43:59.308 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-09-17T05:43:59.308 INFO:teuthology.orchestra.run.smithi150.stdout:{ 2024-09-17T05:43:59.308 INFO:teuthology.orchestra.run.smithi150.stdout: "auth_dump": [ 2024-09-17T05:43:59.308 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-09-17T05:43:59.308 INFO:teuthology.orchestra.run.smithi150.stdout: "entity": "mds.a", 2024-09-17T05:43:59.308 INFO:teuthology.orchestra.run.smithi150.stdout: "key": "AQBoFulmMHALAxAAEO+QBgzbd+BNfhyY2qPiqw==", 2024-09-17T05:43:59.308 INFO:teuthology.orchestra.run.smithi150.stdout: "caps": { 2024-09-17T05:43:59.308 INFO:teuthology.orchestra.run.smithi150.stdout: "mds": "allow", 2024-09-17T05:43:59.308 INFO:teuthology.orchestra.run.smithi150.stdout: "mgr": "allow *", 2024-09-17T05:43:59.308 INFO:teuthology.orchestra.run.smithi150.stdout: "mon": "allow *", 2024-09-17T05:43:59.308 INFO:teuthology.orchestra.run.smithi150.stdout: "osd": "allow *" 2024-09-17T05:43:59.309 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-09-17T05:43:59.309 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-17T05:43:59.309 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-09-17T05:43:59.309 INFO:teuthology.orchestra.run.smithi150.stdout: "entity": "mds.b", 2024-09-17T05:43:59.309 INFO:teuthology.orchestra.run.smithi150.stdout: "key": "AQBoFulmtutmEBAAhKJEJQm181pL1lPmSSdYRQ==", 2024-09-17T05:43:59.309 INFO:teuthology.orchestra.run.smithi150.stdout: "caps": { 2024-09-17T05:43:59.309 INFO:teuthology.orchestra.run.smithi150.stdout: "mds": "allow", 2024-09-17T05:43:59.309 INFO:teuthology.orchestra.run.smithi150.stdout: "mgr": "allow *", 2024-09-17T05:43:59.309 INFO:teuthology.orchestra.run.smithi150.stdout: "mon": "allow *", 2024-09-17T05:43:59.309 INFO:teuthology.orchestra.run.smithi150.stdout: "osd": "allow *" 2024-09-17T05:43:59.309 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-09-17T05:43:59.309 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-17T05:43:59.309 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-09-17T05:43:59.309 INFO:teuthology.orchestra.run.smithi150.stdout: "entity": "mds.c", 2024-09-17T05:43:59.310 INFO:teuthology.orchestra.run.smithi150.stdout: "key": "AQBoFulmHTKsChAA4/fUb2NC+fMhR+xIYIDjgQ==", 2024-09-17T05:43:59.310 INFO:teuthology.orchestra.run.smithi150.stdout: "caps": { 2024-09-17T05:43:59.310 INFO:teuthology.orchestra.run.smithi150.stdout: "mds": "allow", 2024-09-17T05:43:59.310 INFO:teuthology.orchestra.run.smithi150.stdout: "mgr": "allow *", 2024-09-17T05:43:59.310 INFO:teuthology.orchestra.run.smithi150.stdout: "mon": "allow *", 2024-09-17T05:43:59.310 INFO:teuthology.orchestra.run.smithi150.stdout: "osd": "allow *" 2024-09-17T05:43:59.310 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-09-17T05:43:59.310 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-17T05:43:59.310 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-09-17T05:43:59.310 INFO:teuthology.orchestra.run.smithi150.stdout: "entity": "mds.d", 2024-09-17T05:43:59.310 INFO:teuthology.orchestra.run.smithi150.stdout: "key": "AQBoFulmr2s3GBAAhXzLVtObF/LwTpDIrY8MIQ==", 2024-09-17T05:43:59.310 INFO:teuthology.orchestra.run.smithi150.stdout: "caps": { 2024-09-17T05:43:59.310 INFO:teuthology.orchestra.run.smithi150.stdout: "mds": "allow", 2024-09-17T05:43:59.310 INFO:teuthology.orchestra.run.smithi150.stdout: "mgr": "allow *", 2024-09-17T05:43:59.311 INFO:teuthology.orchestra.run.smithi150.stdout: "mon": "allow *", 2024-09-17T05:43:59.311 INFO:teuthology.orchestra.run.smithi150.stdout: "osd": "allow *" 2024-09-17T05:43:59.311 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-09-17T05:43:59.311 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-17T05:43:59.311 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-09-17T05:43:59.311 INFO:teuthology.orchestra.run.smithi150.stdout: "entity": "osd.0", 2024-09-17T05:43:59.311 INFO:teuthology.orchestra.run.smithi150.stdout: "key": "AQBrFulm9eU0NRAAqgc1CtMOz+jDCHBn8coaVw==", 2024-09-17T05:43:59.311 INFO:teuthology.orchestra.run.smithi150.stdout: "caps": { 2024-09-17T05:43:59.311 INFO:teuthology.orchestra.run.smithi150.stdout: "mgr": "allow profile osd", 2024-09-17T05:43:59.311 INFO:teuthology.orchestra.run.smithi150.stdout: "mon": "allow profile osd", 2024-09-17T05:43:59.311 INFO:teuthology.orchestra.run.smithi150.stdout: "osd": "allow *" 2024-09-17T05:43:59.311 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-09-17T05:43:59.311 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-17T05:43:59.311 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-09-17T05:43:59.311 INFO:teuthology.orchestra.run.smithi150.stdout: "entity": "osd.1", 2024-09-17T05:43:59.312 INFO:teuthology.orchestra.run.smithi150.stdout: "key": "AQBvFulmlFL6CxAA8ByBraZue2FLfyZeOIpj3A==", 2024-09-17T05:43:59.312 INFO:teuthology.orchestra.run.smithi150.stdout: "caps": { 2024-09-17T05:43:59.312 INFO:teuthology.orchestra.run.smithi150.stdout: "mgr": "allow profile osd", 2024-09-17T05:43:59.312 INFO:teuthology.orchestra.run.smithi150.stdout: "mon": "allow profile osd", 2024-09-17T05:43:59.312 INFO:teuthology.orchestra.run.smithi150.stdout: "osd": "allow *" 2024-09-17T05:43:59.312 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-09-17T05:43:59.312 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-17T05:43:59.312 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-09-17T05:43:59.312 INFO:teuthology.orchestra.run.smithi150.stdout: "entity": "osd.2", 2024-09-17T05:43:59.312 INFO:teuthology.orchestra.run.smithi150.stdout: "key": "AQByFulmMQF5LBAAB4rbdIL6Zd+l4I4LDC/r3Q==", 2024-09-17T05:43:59.312 INFO:teuthology.orchestra.run.smithi150.stdout: "caps": { 2024-09-17T05:43:59.312 INFO:teuthology.orchestra.run.smithi150.stdout: "mgr": "allow profile osd", 2024-09-17T05:43:59.312 INFO:teuthology.orchestra.run.smithi150.stdout: "mon": "allow profile osd", 2024-09-17T05:43:59.312 INFO:teuthology.orchestra.run.smithi150.stdout: "osd": "allow *" 2024-09-17T05:43:59.313 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-09-17T05:43:59.313 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-17T05:43:59.313 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-09-17T05:43:59.313 INFO:teuthology.orchestra.run.smithi150.stdout: "entity": "osd.3", 2024-09-17T05:43:59.313 INFO:teuthology.orchestra.run.smithi150.stdout: "key": "AQB2Fulm5fjaAhAASnkpgsW79Sr9IIiy4HMm4g==", 2024-09-17T05:43:59.313 INFO:teuthology.orchestra.run.smithi150.stdout: "caps": { 2024-09-17T05:43:59.313 INFO:teuthology.orchestra.run.smithi150.stdout: "mgr": "allow profile osd", 2024-09-17T05:43:59.313 INFO:teuthology.orchestra.run.smithi150.stdout: "mon": "allow profile osd", 2024-09-17T05:43:59.313 INFO:teuthology.orchestra.run.smithi150.stdout: "osd": "allow *" 2024-09-17T05:43:59.313 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-09-17T05:43:59.313 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-17T05:43:59.313 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-09-17T05:43:59.313 INFO:teuthology.orchestra.run.smithi150.stdout: "entity": "osd.4", 2024-09-17T05:43:59.313 INFO:teuthology.orchestra.run.smithi150.stdout: "key": "AQB8Fulm9fWPGhAA9nNf+0znlS0Z7rqOvC47xQ==", 2024-09-17T05:43:59.313 INFO:teuthology.orchestra.run.smithi150.stdout: "caps": { 2024-09-17T05:43:59.314 INFO:teuthology.orchestra.run.smithi150.stdout: "mgr": "allow profile osd", 2024-09-17T05:43:59.314 INFO:teuthology.orchestra.run.smithi150.stdout: "mon": "allow profile osd", 2024-09-17T05:43:59.314 INFO:teuthology.orchestra.run.smithi150.stdout: "osd": "allow *" 2024-09-17T05:43:59.314 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-09-17T05:43:59.314 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-17T05:43:59.314 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-09-17T05:43:59.314 INFO:teuthology.orchestra.run.smithi150.stdout: "entity": "osd.5", 2024-09-17T05:43:59.314 INFO:teuthology.orchestra.run.smithi150.stdout: "key": "AQB/FulmeHakHRAASlnmKa0UTqVX+NSbmiHEBw==", 2024-09-17T05:43:59.314 INFO:teuthology.orchestra.run.smithi150.stdout: "caps": { 2024-09-17T05:43:59.314 INFO:teuthology.orchestra.run.smithi150.stdout: "mgr": "allow profile osd", 2024-09-17T05:43:59.314 INFO:teuthology.orchestra.run.smithi150.stdout: "mon": "allow profile osd", 2024-09-17T05:43:59.314 INFO:teuthology.orchestra.run.smithi150.stdout: "osd": "allow *" 2024-09-17T05:43:59.314 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-09-17T05:43:59.314 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-17T05:43:59.314 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-09-17T05:43:59.315 INFO:teuthology.orchestra.run.smithi150.stdout: "entity": "osd.6", 2024-09-17T05:43:59.315 INFO:teuthology.orchestra.run.smithi150.stdout: "key": "AQCCFulmEZF3IBAAhtpCanI6m8Kb3hyi+sRyyQ==", 2024-09-17T05:43:59.315 INFO:teuthology.orchestra.run.smithi150.stdout: "caps": { 2024-09-17T05:43:59.315 INFO:teuthology.orchestra.run.smithi150.stdout: "mgr": "allow profile osd", 2024-09-17T05:43:59.315 INFO:teuthology.orchestra.run.smithi150.stdout: "mon": "allow profile osd", 2024-09-17T05:43:59.315 INFO:teuthology.orchestra.run.smithi150.stdout: "osd": "allow *" 2024-09-17T05:43:59.315 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-09-17T05:43:59.315 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-17T05:43:59.315 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-09-17T05:43:59.315 INFO:teuthology.orchestra.run.smithi150.stdout: "entity": "osd.7", 2024-09-17T05:43:59.315 INFO:teuthology.orchestra.run.smithi150.stdout: "key": "AQCGFulmdcs7BRAAxsctes949cbkGkivdGpoYw==", 2024-09-17T05:43:59.315 INFO:teuthology.orchestra.run.smithi150.stdout: "caps": { 2024-09-17T05:43:59.315 INFO:teuthology.orchestra.run.smithi150.stdout: "mgr": "allow profile osd", 2024-09-17T05:43:59.315 INFO:teuthology.orchestra.run.smithi150.stdout: "mon": "allow profile osd", 2024-09-17T05:43:59.316 INFO:teuthology.orchestra.run.smithi150.stdout: "osd": "allow *" 2024-09-17T05:43:59.316 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-09-17T05:43:59.316 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-17T05:43:59.316 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-09-17T05:43:59.316 INFO:teuthology.orchestra.run.smithi150.stdout: "entity": "client.0", 2024-09-17T05:43:59.316 INFO:teuthology.orchestra.run.smithi150.stdout: "key": "AQBoFulmfF/1HBAAMezEjZDeoHTJ+uFfDXNWHQ==", 2024-09-17T05:43:59.316 INFO:teuthology.orchestra.run.smithi150.stdout: "caps": { 2024-09-17T05:43:59.316 INFO:teuthology.orchestra.run.smithi150.stdout: "mds": "allow", 2024-09-17T05:43:59.316 INFO:teuthology.orchestra.run.smithi150.stdout: "mon": "allow r", 2024-09-17T05:43:59.316 INFO:teuthology.orchestra.run.smithi150.stdout: "osd": "allow rw tag cephfs data=cephfs" 2024-09-17T05:43:59.316 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-09-17T05:43:59.316 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-17T05:43:59.316 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-09-17T05:43:59.316 INFO:teuthology.orchestra.run.smithi150.stdout: "entity": "client.1", 2024-09-17T05:43:59.316 INFO:teuthology.orchestra.run.smithi150.stdout: "key": "AQBoFulmv3GQJBAANlgjLqiCwzNfmBh8uClJ9A==", 2024-09-17T05:43:59.317 INFO:teuthology.orchestra.run.smithi150.stdout: "caps": { 2024-09-17T05:43:59.317 INFO:teuthology.orchestra.run.smithi150.stdout: "mds": "allow", 2024-09-17T05:43:59.317 INFO:teuthology.orchestra.run.smithi150.stdout: "mgr": "allow r", 2024-09-17T05:43:59.317 INFO:teuthology.orchestra.run.smithi150.stdout: "mon": "allow rw", 2024-09-17T05:43:59.317 INFO:teuthology.orchestra.run.smithi150.stdout: "osd": "allow rwx" 2024-09-17T05:43:59.317 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-09-17T05:43:59.317 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-17T05:43:59.317 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-09-17T05:43:59.317 INFO:teuthology.orchestra.run.smithi150.stdout: "entity": "client.2", 2024-09-17T05:43:59.317 INFO:teuthology.orchestra.run.smithi150.stdout: "key": "AQBoFulm1O/BIBAA8kfQL3/13SmZO1+y2tOZvw==", 2024-09-17T05:43:59.317 INFO:teuthology.orchestra.run.smithi150.stdout: "caps": { 2024-09-17T05:43:59.317 INFO:teuthology.orchestra.run.smithi150.stdout: "mds": "allow", 2024-09-17T05:43:59.317 INFO:teuthology.orchestra.run.smithi150.stdout: "mgr": "allow r", 2024-09-17T05:43:59.318 INFO:teuthology.orchestra.run.smithi150.stdout: "mon": "allow rw", 2024-09-17T05:43:59.318 INFO:teuthology.orchestra.run.smithi150.stdout: "osd": "allow rwx" 2024-09-17T05:43:59.318 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-09-17T05:43:59.318 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-17T05:43:59.318 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-09-17T05:43:59.318 INFO:teuthology.orchestra.run.smithi150.stdout: "entity": "client.3", 2024-09-17T05:43:59.318 INFO:teuthology.orchestra.run.smithi150.stdout: "key": "AQBoFulmF4hVKBAAZ5FGapBLLLtez3t8kON9dg==", 2024-09-17T05:43:59.318 INFO:teuthology.orchestra.run.smithi150.stdout: "caps": { 2024-09-17T05:43:59.318 INFO:teuthology.orchestra.run.smithi150.stdout: "mds": "allow", 2024-09-17T05:43:59.318 INFO:teuthology.orchestra.run.smithi150.stdout: "mgr": "allow r", 2024-09-17T05:43:59.318 INFO:teuthology.orchestra.run.smithi150.stdout: "mon": "allow rw", 2024-09-17T05:43:59.318 INFO:teuthology.orchestra.run.smithi150.stdout: "osd": "allow rwx" 2024-09-17T05:43:59.318 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-09-17T05:43:59.318 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-17T05:43:59.318 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-09-17T05:43:59.319 INFO:teuthology.orchestra.run.smithi150.stdout: "entity": "client.admin", 2024-09-17T05:43:59.319 INFO:teuthology.orchestra.run.smithi150.stdout: "key": "AQBnFulmaU9+IBAA7ZmXWZ44s0IpQ+C+Zw2V1g==", 2024-09-17T05:43:59.319 INFO:teuthology.orchestra.run.smithi150.stdout: "caps": { 2024-09-17T05:43:59.319 INFO:teuthology.orchestra.run.smithi150.stdout: "mds": "allow *", 2024-09-17T05:43:59.319 INFO:teuthology.orchestra.run.smithi150.stdout: "mgr": "allow *", 2024-09-17T05:43:59.319 INFO:teuthology.orchestra.run.smithi150.stdout: "mon": "allow *", 2024-09-17T05:43:59.319 INFO:teuthology.orchestra.run.smithi150.stdout: "osd": "allow *" 2024-09-17T05:43:59.319 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-09-17T05:43:59.319 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-17T05:43:59.319 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-09-17T05:43:59.319 INFO:teuthology.orchestra.run.smithi150.stdout: "entity": "mgr.x", 2024-09-17T05:43:59.319 INFO:teuthology.orchestra.run.smithi150.stdout: "key": "AQBnFulmEjvROhAAn3GZxCEtqPYLWopR1AcSFA==", 2024-09-17T05:43:59.319 INFO:teuthology.orchestra.run.smithi150.stdout: "caps": { 2024-09-17T05:43:59.319 INFO:teuthology.orchestra.run.smithi150.stdout: "mds": "allow *", 2024-09-17T05:43:59.320 INFO:teuthology.orchestra.run.smithi150.stdout: "mon": "allow profile mgr", 2024-09-17T05:43:59.320 INFO:teuthology.orchestra.run.smithi150.stdout: "osd": "allow *" 2024-09-17T05:43:59.320 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-09-17T05:43:59.320 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-17T05:43:59.320 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-09-17T05:43:59.320 INFO:teuthology.orchestra.run.smithi150.stdout: "entity": "mgr.y", 2024-09-17T05:43:59.320 INFO:teuthology.orchestra.run.smithi150.stdout: "key": "AQBnFulm9IkENhAA4uf1vzhYOepmovspN5/v1w==", 2024-09-17T05:43:59.320 INFO:teuthology.orchestra.run.smithi150.stdout: "caps": { 2024-09-17T05:43:59.320 INFO:teuthology.orchestra.run.smithi150.stdout: "mds": "allow *", 2024-09-17T05:43:59.320 INFO:teuthology.orchestra.run.smithi150.stdout: "mon": "allow profile mgr", 2024-09-17T05:43:59.320 INFO:teuthology.orchestra.run.smithi150.stdout: "osd": "allow *" 2024-09-17T05:43:59.320 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-09-17T05:43:59.320 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-09-17T05:43:59.321 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2024-09-17T05:43:59.321 INFO:teuthology.orchestra.run.smithi150.stdout:} 2024-09-17T05:43:59.322 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:59.308+0000 7fa36c782640 1 -- 172.21.15.150:0/4104566375 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fa348078f20 msgr2=0x7fa34807b430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:43:59.322 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:59.308+0000 7fa36c782640 1 --2- 172.21.15.150:0/4104566375 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fa348078f20 0x7fa34807b430 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fa354035000 tx=0x7fa35402d040 comp rx=0 tx=0).stop 2024-09-17T05:43:59.322 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:59.308+0000 7fa36c782640 1 -- 172.21.15.150:0/4104566375 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa350004800 msgr2=0x7fa36406ea70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:43:59.322 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:59.308+0000 7fa36c782640 1 --2- 172.21.15.150:0/4104566375 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa350004800 0x7fa36406ea70 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7fa3600065f0 tx=0x7fa3600039c0 comp rx=0 tx=0).stop 2024-09-17T05:43:59.322 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:59.308+0000 7fa36c782640 1 -- 172.21.15.150:0/4104566375 shutdown_connections 2024-09-17T05:43:59.322 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:59.308+0000 7fa36c782640 1 --2- 172.21.15.150:0/4104566375 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa3640b6480 0x7fa3640b6890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:43:59.322 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:59.308+0000 7fa36c782640 1 --2- 172.21.15.150:0/4104566375 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fa348078f20 0x7fa34807b430 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:43:59.322 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:59.308+0000 7fa36c782640 1 --2- 172.21.15.150:0/4104566375 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa3640cbdf0 0x7fa3640c5340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:43:59.323 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:59.308+0000 7fa36c782640 1 --2- 172.21.15.150:0/4104566375 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa350004800 0x7fa36406ea70 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:43:59.323 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:59.308+0000 7fa36c782640 1 -- 172.21.15.150:0/4104566375 >> 172.21.15.150:0/4104566375 conn(0x7fa3640b3fc0 msgr2=0x7fa3640ce2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:43:59.323 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:59.308+0000 7fa36c782640 1 -- 172.21.15.150:0/4104566375 shutdown_connections 2024-09-17T05:43:59.323 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:59.308+0000 7fa36c782640 1 -- 172.21.15.150:0/4104566375 wait complete. 2024-09-17T05:43:59.323 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-09-17T05:43:59.437 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:59.435+0000 7f6e93dba640 1 -- 172.21.15.150:0/245637233 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6e8c15ee30 msgr2=0x7f6e8c0b2840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:43:59.437 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:59.435+0000 7f6e93dba640 1 --2- 172.21.15.150:0/245637233 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6e8c15ee30 0x7f6e8c0b2840 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f6e8c075540 tx=0x7f6e8402a5f0 comp rx=0 tx=0).stop 2024-09-17T05:43:59.437 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:59.435+0000 7f6e93dba640 1 -- 172.21.15.150:0/245637233 shutdown_connections 2024-09-17T05:43:59.437 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:59.435+0000 7f6e93dba640 1 --2- 172.21.15.150:0/245637233 >> v2:172.21.15.176:3300/0 conn(0x7f6e8c0cf7c0 0x7f6e8c0cfbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:43:59.437 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:59.435+0000 7f6e93dba640 1 --2- 172.21.15.150:0/245637233 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6e8c15ee30 0x7f6e8c0b2840 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:43:59.437 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:59.435+0000 7f6e93dba640 1 -- 172.21.15.150:0/245637233 >> 172.21.15.150:0/245637233 conn(0x7f6e8c0b2fd0 msgr2=0x7f6e8c0b33e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:43:59.437 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:59.435+0000 7f6e93dba640 1 -- 172.21.15.150:0/245637233 shutdown_connections 2024-09-17T05:43:59.437 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:59.435+0000 7f6e93dba640 1 -- 172.21.15.150:0/245637233 wait complete. 2024-09-17T05:43:59.438 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:59.437+0000 7f6e93dba640 1 Processor -- start 2024-09-17T05:43:59.438 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:59.437+0000 7f6e93dba640 1 -- start start 2024-09-17T05:43:59.441 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:59.438+0000 7f6e93dba640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6e8c0b0e20 0x7f6e8c1e7370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:43:59.441 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:59.438+0000 7f6e93dba640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6e8c0cf7c0 0x7f6e8c1e5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:43:59.441 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:59.438+0000 7f6e93dba640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6e8c15ee30 0x7f6e8c06d040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:43:59.441 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:59.438+0000 7f6e93dba640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f6e8c15f350 con 0x7f6e8c0b0e20 2024-09-17T05:43:59.442 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:59.438+0000 7f6e93dba640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f6e8c0b1b50 con 0x7f6e8c0cf7c0 2024-09-17T05:43:59.442 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:59.438+0000 7f6e93dba640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f6e8c0b6420 con 0x7f6e8c15ee30 2024-09-17T05:43:59.442 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:59.438+0000 7f6e91b56640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6e8c0b0e20 0x7f6e8c1e7370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:43:59.442 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:59.438+0000 7f6e91b56640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6e8c0b0e20 0x7f6e8c1e7370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:45378/0 (socket says 172.21.15.150:45378) 2024-09-17T05:43:59.442 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:59.438+0000 7f6e91b56640 1 -- 172.21.15.150:0/2159481507 learned_addr learned my addr 172.21.15.150:0/2159481507 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:43:59.442 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:59.438+0000 7f6e91355640 1 --2- 172.21.15.150:0/2159481507 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6e8c0cf7c0 0x7f6e8c1e5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:43:59.442 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:59.438+0000 7f6e92357640 1 --2- 172.21.15.150:0/2159481507 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6e8c15ee30 0x7f6e8c06d040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:43:59.442 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:59.438+0000 7f6e91b56640 1 -- 172.21.15.150:0/2159481507 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6e8c15ee30 msgr2=0x7f6e8c06d040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:43:59.442 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:59.438+0000 7f6e91b56640 1 --2- 172.21.15.150:0/2159481507 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6e8c15ee30 0x7f6e8c06d040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:43:59.442 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:59.438+0000 7f6e91b56640 1 -- 172.21.15.150:0/2159481507 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6e8c0cf7c0 msgr2=0x7f6e8c1e5040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:43:59.442 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:59.438+0000 7f6e91b56640 1 --2- 172.21.15.150:0/2159481507 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6e8c0cf7c0 0x7f6e8c1e5040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:43:59.442 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:59.438+0000 7f6e91b56640 1 -- 172.21.15.150:0/2159481507 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6e8c1e7bc0 con 0x7f6e8c0b0e20 2024-09-17T05:43:59.442 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:59.439+0000 7f6e91b56640 1 --2- 172.21.15.150:0/2159481507 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6e8c0b0e20 0x7f6e8c1e7370 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f6e84034040 tx=0x7f6e840039e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:43:59.442 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:59.439+0000 7f6e8a7fc640 1 -- 172.21.15.150:0/2159481507 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e8403e030 con 0x7f6e8c0b0e20 2024-09-17T05:43:59.443 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:59.439+0000 7f6e8a7fc640 1 -- 172.21.15.150:0/2159481507 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f6e840047a0 con 0x7f6e8c0b0e20 2024-09-17T05:43:59.443 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:59.439+0000 7f6e8a7fc640 1 -- 172.21.15.150:0/2159481507 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e84035040 con 0x7f6e8c0b0e20 2024-09-17T05:43:59.443 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:59.439+0000 7f6e93dba640 1 -- 172.21.15.150:0/2159481507 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6e8c1e7ea0 con 0x7f6e8c0b0e20 2024-09-17T05:43:59.443 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:59.439+0000 7f6e93dba640 1 -- 172.21.15.150:0/2159481507 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6e8c0caec0 con 0x7f6e8c0b0e20 2024-09-17T05:43:59.443 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:59.440+0000 7f6e93dba640 1 -- 172.21.15.150:0/2159481507 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6e8c1e80e0 con 0x7f6e8c0b0e20 2024-09-17T05:43:59.444 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:59.441+0000 7f6e8a7fc640 1 -- 172.21.15.150:0/2159481507 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 9) ==== 101747+0+0 (secure 0 0 0) 0x7f6e84041030 con 0x7f6e8c0b0e20 2024-09-17T05:43:59.444 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:59.441+0000 7f6e8a7fc640 1 --2- 172.21.15.150:0/2159481507 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f6e78078ef0 0x7f6e7807b400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:43:59.444 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:59.441+0000 7f6e8a7fc640 1 -- 172.21.15.150:0/2159481507 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(41..41 src has 1..41) ==== 4857+0+0 (secure 0 0 0) 0x7f6e840bb680 con 0x7f6e8c0b0e20 2024-09-17T05:43:59.444 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:59.442+0000 7f6e91355640 1 --2- 172.21.15.150:0/2159481507 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f6e78078ef0 0x7f6e7807b400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:43:59.444 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:59.442+0000 7f6e91355640 1 --2- 172.21.15.150:0/2159481507 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f6e78078ef0 0x7f6e7807b400 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f6e8c0d1a50 tx=0x7f6e8000b2e0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:43:59.447 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:59.446+0000 7f6e8a7fc640 1 -- 172.21.15.150:0/2159481507 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f6e8c1e80e0 con 0x7f6e8c0b0e20 2024-09-17T05:43:59.628 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:59.626+0000 7f6e93dba640 1 -- 172.21.15.150:0/2159481507 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7f6e8c076850 con 0x7f6e8c0b0e20 2024-09-17T05:43:59.628 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:59.627+0000 7f6e8a7fc640 1 -- 172.21.15.150:0/2159481507 <== mon.0 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v41) ==== 84+0+65 (secure 0 0 0) 0x7f6e8c076850 con 0x7f6e8c0b0e20 2024-09-17T05:43:59.629 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-09-17T05:43:59.629 INFO:teuthology.orchestra.run.smithi150.stdout:[ 2024-09-17T05:43:59.629 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-09-17T05:43:59.629 INFO:teuthology.orchestra.run.smithi150.stdout: "poolnum": 1, 2024-09-17T05:43:59.629 INFO:teuthology.orchestra.run.smithi150.stdout: "poolname": ".mgr" 2024-09-17T05:43:59.629 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-09-17T05:43:59.629 INFO:teuthology.orchestra.run.smithi150.stdout:] 2024-09-17T05:43:59.631 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:59.629+0000 7f6e93dba640 1 -- 172.21.15.150:0/2159481507 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f6e78078ef0 msgr2=0x7f6e7807b400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:43:59.631 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:59.629+0000 7f6e93dba640 1 --2- 172.21.15.150:0/2159481507 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f6e78078ef0 0x7f6e7807b400 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f6e8c0d1a50 tx=0x7f6e8000b2e0 comp rx=0 tx=0).stop 2024-09-17T05:43:59.631 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:59.629+0000 7f6e93dba640 1 -- 172.21.15.150:0/2159481507 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6e8c0b0e20 msgr2=0x7f6e8c1e7370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:43:59.631 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:59.629+0000 7f6e93dba640 1 --2- 172.21.15.150:0/2159481507 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6e8c0b0e20 0x7f6e8c1e7370 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f6e84034040 tx=0x7f6e840039e0 comp rx=0 tx=0).stop 2024-09-17T05:43:59.632 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:59.629+0000 7f6e93dba640 1 -- 172.21.15.150:0/2159481507 shutdown_connections 2024-09-17T05:43:59.632 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:59.629+0000 7f6e93dba640 1 --2- 172.21.15.150:0/2159481507 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6e8c0cf7c0 0x7f6e8c1e5040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:43:59.632 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:59.629+0000 7f6e93dba640 1 --2- 172.21.15.150:0/2159481507 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f6e78078ef0 0x7f6e7807b400 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:43:59.632 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:59.629+0000 7f6e93dba640 1 --2- 172.21.15.150:0/2159481507 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6e8c15ee30 0x7f6e8c06d040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:43:59.632 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:59.629+0000 7f6e93dba640 1 --2- 172.21.15.150:0/2159481507 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6e8c0b0e20 0x7f6e8c1e7370 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:43:59.632 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:59.629+0000 7f6e93dba640 1 -- 172.21.15.150:0/2159481507 >> 172.21.15.150:0/2159481507 conn(0x7f6e8c0b2fd0 msgr2=0x7f6e8c0b0410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:43:59.632 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:59.629+0000 7f6e93dba640 1 -- 172.21.15.150:0/2159481507 shutdown_connections 2024-09-17T05:43:59.632 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:59.629+0000 7f6e93dba640 1 -- 172.21.15.150:0/2159481507 wait complete. 2024-09-17T05:43:59.642 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-09-17T05:43:59.643 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-09-17T05:43:59.759 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:59.757+0000 7f0337382640 1 -- 172.21.15.150:0/2239232790 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f03300d0310 msgr2=0x7f033006eaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:43:59.759 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:59.757+0000 7f0337382640 1 --2- 172.21.15.150:0/2239232790 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f03300d0310 0x7f033006eaa0 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f03300d3990 tx=0x7f032802aaa0 comp rx=0 tx=0).stop 2024-09-17T05:43:59.759 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:59.757+0000 7f0337382640 1 -- 172.21.15.150:0/2239232790 shutdown_connections 2024-09-17T05:43:59.760 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:59.757+0000 7f0337382640 1 --2- 172.21.15.150:0/2239232790 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f03300d0310 0x7f033006eaa0 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:43:59.760 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:59.757+0000 7f0337382640 1 --2- 172.21.15.150:0/2239232790 >> v2:172.21.15.176:3300/0 conn(0x7f03300d0d20 0x7f03300d1130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:43:59.760 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:59.757+0000 7f0337382640 1 -- 172.21.15.150:0/2239232790 >> 172.21.15.150:0/2239232790 conn(0x7f03300d46f0 msgr2=0x7f03300d4b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:43:59.760 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:59.757+0000 7f0337382640 1 -- 172.21.15.150:0/2239232790 shutdown_connections 2024-09-17T05:43:59.760 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:59.757+0000 7f0337382640 1 -- 172.21.15.150:0/2239232790 wait complete. 2024-09-17T05:43:59.761 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:59.759+0000 7f0337382640 1 Processor -- start 2024-09-17T05:43:59.761 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:59.759+0000 7f0337382640 1 -- start start 2024-09-17T05:43:59.763 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:59.761+0000 7f0337382640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f03300d0310 0x7f03300ca250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:43:59.763 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:59.761+0000 7f0337382640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f03300d0d20 0x7f0330157b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:43:59.763 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:59.761+0000 7f0337382640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f03300d1670 0x7f03300a18d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:43:59.764 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:59.761+0000 7f0337382640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f03300ba200 con 0x7f03300d1670 2024-09-17T05:43:59.764 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:59.761+0000 7f0337382640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f03300ba080 con 0x7f03300d0310 2024-09-17T05:43:59.764 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:59.761+0000 7f0337382640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f033006efe0 con 0x7f03300d0d20 2024-09-17T05:43:59.764 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:59.761+0000 7f033591f640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f03300d1670 0x7f03300a18d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:43:59.764 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:59.761+0000 7f033591f640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f03300d1670 0x7f03300a18d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:45388/0 (socket says 172.21.15.150:45388) 2024-09-17T05:43:59.764 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:59.761+0000 7f033591f640 1 -- 172.21.15.150:0/384740312 learned_addr learned my addr 172.21.15.150:0/384740312 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:43:59.764 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:59.761+0000 7f033511e640 1 --2- 172.21.15.150:0/384740312 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f03300d0310 0x7f03300ca250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:43:59.764 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:59.761+0000 7f033491d640 1 --2- 172.21.15.150:0/384740312 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f03300d0d20 0x7f0330157b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:43:59.764 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:59.761+0000 7f033591f640 1 -- 172.21.15.150:0/384740312 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f03300d0d20 msgr2=0x7f0330157b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:43:59.764 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:59.761+0000 7f033591f640 1 --2- 172.21.15.150:0/384740312 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f03300d0d20 0x7f0330157b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:43:59.764 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:59.761+0000 7f033591f640 1 -- 172.21.15.150:0/384740312 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f03300d0310 msgr2=0x7f03300ca250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:43:59.764 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:59.761+0000 7f033591f640 1 --2- 172.21.15.150:0/384740312 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f03300d0310 0x7f03300ca250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:43:59.765 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:59.761+0000 7f033591f640 1 -- 172.21.15.150:0/384740312 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f03300c92c0 con 0x7f03300d1670 2024-09-17T05:43:59.765 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:59.761+0000 7f033591f640 1 --2- 172.21.15.150:0/384740312 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f03300d1670 0x7f03300a18d0 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f0328005fd0 tx=0x7f0328003ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:43:59.765 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:59.761+0000 7f0325ffb640 1 -- 172.21.15.150:0/384740312 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0328044070 con 0x7f03300d1670 2024-09-17T05:43:59.765 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:59.761+0000 7f0325ffb640 1 -- 172.21.15.150:0/384740312 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0328004250 con 0x7f03300d1670 2024-09-17T05:43:59.765 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:59.761+0000 7f0337382640 1 -- 172.21.15.150:0/384740312 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f033009f6d0 con 0x7f03300d1670 2024-09-17T05:43:59.765 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:59.761+0000 7f0325ffb640 1 -- 172.21.15.150:0/384740312 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f03280046a0 con 0x7f03300d1670 2024-09-17T05:43:59.765 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:59.762+0000 7f0337382640 1 -- 172.21.15.150:0/384740312 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f03300ca790 con 0x7f03300d1670 2024-09-17T05:43:59.766 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:59.763+0000 7f0337382640 1 -- 172.21.15.150:0/384740312 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f03300c9030 con 0x7f03300d1670 2024-09-17T05:43:59.766 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:59.763+0000 7f0325ffb640 1 -- 172.21.15.150:0/384740312 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 9) ==== 101747+0+0 (secure 0 0 0) 0x7f0328047070 con 0x7f03300d1670 2024-09-17T05:43:59.766 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:59.764+0000 7f0325ffb640 1 --2- 172.21.15.150:0/384740312 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f0314078f20 0x7f031407b430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:43:59.766 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:59.764+0000 7f0325ffb640 1 -- 172.21.15.150:0/384740312 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(41..41 src has 1..41) ==== 4857+0+0 (secure 0 0 0) 0x7f03280bbf40 con 0x7f03300d1670 2024-09-17T05:43:59.766 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:59.764+0000 7f033511e640 1 --2- 172.21.15.150:0/384740312 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f0314078f20 0x7f031407b430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:43:59.766 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:59.765+0000 7f033511e640 1 --2- 172.21.15.150:0/384740312 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f0314078f20 0x7f031407b430 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f032c004630 tx=0x7f032c00b2e0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:43:59.769 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:59.768+0000 7f0325ffb640 1 -- 172.21.15.150:0/384740312 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f0328032030 con 0x7f03300d1670 2024-09-17T05:43:59.945 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:43:59.944+0000 7f0337382640 1 -- 172.21.15.150:0/384740312 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7f03300b2510 con 0x7f03300d1670 2024-09-17T05:44:00.930 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:00.929+0000 7f0325ffb640 1 -- 172.21.15.150:0/384740312 <== mon.0 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v42) ==== 138+0+0 (secure 0 0 0) 0x7f0328083b80 con 0x7f03300d1670 2024-09-17T05:44:00.930 INFO:teuthology.orchestra.run.smithi150.stderr:pool 'cephfs_metadata' created 2024-09-17T05:44:00.934 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:00.933+0000 7f0337382640 1 -- 172.21.15.150:0/384740312 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f0314078f20 msgr2=0x7f031407b430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:44:00.934 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:00.933+0000 7f0337382640 1 --2- 172.21.15.150:0/384740312 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f0314078f20 0x7f031407b430 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f032c004630 tx=0x7f032c00b2e0 comp rx=0 tx=0).stop 2024-09-17T05:44:00.935 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:00.933+0000 7f0337382640 1 -- 172.21.15.150:0/384740312 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f03300d1670 msgr2=0x7f03300a18d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:44:00.935 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:00.933+0000 7f0337382640 1 --2- 172.21.15.150:0/384740312 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f03300d1670 0x7f03300a18d0 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f0328005fd0 tx=0x7f0328003ce0 comp rx=0 tx=0).stop 2024-09-17T05:44:00.935 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:00.933+0000 7f0337382640 1 -- 172.21.15.150:0/384740312 shutdown_connections 2024-09-17T05:44:00.935 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:00.933+0000 7f0337382640 1 --2- 172.21.15.150:0/384740312 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f0314078f20 0x7f031407b430 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:00.935 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:00.933+0000 7f0337382640 1 --2- 172.21.15.150:0/384740312 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f03300d1670 0x7f03300a18d0 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:00.935 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:00.933+0000 7f0337382640 1 --2- 172.21.15.150:0/384740312 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f03300d0d20 0x7f0330157b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:00.935 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:00.933+0000 7f0337382640 1 --2- 172.21.15.150:0/384740312 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f03300d0310 0x7f03300ca250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:00.935 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:00.933+0000 7f0337382640 1 -- 172.21.15.150:0/384740312 >> 172.21.15.150:0/384740312 conn(0x7f03300d46f0 msgr2=0x7f0330161b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:44:00.935 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:00.933+0000 7f0337382640 1 -- 172.21.15.150:0/384740312 shutdown_connections 2024-09-17T05:44:00.935 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:00.933+0000 7f0337382640 1 -- 172.21.15.150:0/384740312 wait complete. 2024-09-17T05:44:00.952 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-09-17T05:44:01.080 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:01.078+0000 7f9427b07640 1 -- 172.21.15.150:0/2744621001 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f94200b6b80 msgr2=0x7f942006cda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:44:01.080 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:01.078+0000 7f9427b07640 1 --2- 172.21.15.150:0/2744621001 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f94200b6b80 0x7f942006cda0 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f94200cef20 tx=0x7f941802aa30 comp rx=0 tx=0).stop 2024-09-17T05:44:01.080 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:01.078+0000 7f9427b07640 1 -- 172.21.15.150:0/2744621001 shutdown_connections 2024-09-17T05:44:01.080 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:01.078+0000 7f9427b07640 1 --2- 172.21.15.150:0/2744621001 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f94200b6b80 0x7f942006cda0 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:01.080 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:01.078+0000 7f9427b07640 1 --2- 172.21.15.150:0/2744621001 >> v2:172.21.15.176:3300/0 conn(0x7f94200d0ee0 0x7f94200c7c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:01.080 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:01.078+0000 7f9427b07640 1 --2- 172.21.15.150:0/2744621001 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f942015ee80 0x7f94200c7730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:01.080 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:01.078+0000 7f9427b07640 1 -- 172.21.15.150:0/2744621001 >> 172.21.15.150:0/2744621001 conn(0x7f94200b2ff0 msgr2=0x7f94200b3400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:44:01.080 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:01.078+0000 7f9427b07640 1 -- 172.21.15.150:0/2744621001 shutdown_connections 2024-09-17T05:44:01.080 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:01.078+0000 7f9427b07640 1 -- 172.21.15.150:0/2744621001 wait complete. 2024-09-17T05:44:01.081 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:01.079+0000 7f9427b07640 1 Processor -- start 2024-09-17T05:44:01.081 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:01.080+0000 7f9427b07640 1 -- start start 2024-09-17T05:44:01.084 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:01.081+0000 7f9427b07640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f94200b6b80 0x7f94201f2960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:44:01.084 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:01.081+0000 7f9427b07640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f94200d0ee0 0x7f94201613a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:44:01.084 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:01.081+0000 7f9427b07640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f942015ee80 0x7f942015f2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:44:01.084 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:01.081+0000 7f9427b07640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f942006d2e0 con 0x7f94200b6b80 2024-09-17T05:44:01.084 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:01.081+0000 7f9427b07640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f94200b2d80 con 0x7f942015ee80 2024-09-17T05:44:01.084 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:01.081+0000 7f9427b07640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f942006d460 con 0x7f94200d0ee0 2024-09-17T05:44:01.084 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:01.081+0000 7f94258a3640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f94200b6b80 0x7f94201f2960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:44:01.084 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:01.081+0000 7f94258a3640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f94200b6b80 0x7f94201f2960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:43016/0 (socket says 172.21.15.150:43016) 2024-09-17T05:44:01.084 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:01.081+0000 7f94258a3640 1 -- 172.21.15.150:0/4127284771 learned_addr learned my addr 172.21.15.150:0/4127284771 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:44:01.084 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:01.081+0000 7f94250a2640 1 --2- 172.21.15.150:0/4127284771 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f94200d0ee0 0x7f94201613a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:44:01.084 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:01.081+0000 7f94260a4640 1 --2- 172.21.15.150:0/4127284771 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f942015ee80 0x7f942015f2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:44:01.084 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:01.081+0000 7f94258a3640 1 -- 172.21.15.150:0/4127284771 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f94200d0ee0 msgr2=0x7f94201613a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:44:01.085 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:01.081+0000 7f94258a3640 1 --2- 172.21.15.150:0/4127284771 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f94200d0ee0 0x7f94201613a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:01.085 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:01.081+0000 7f94258a3640 1 -- 172.21.15.150:0/4127284771 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f942015ee80 msgr2=0x7f942015f2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:44:01.085 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:01.081+0000 7f94258a3640 1 --2- 172.21.15.150:0/4127284771 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f942015ee80 0x7f942015f2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:01.085 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:01.081+0000 7f94258a3640 1 -- 172.21.15.150:0/4127284771 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9420162110 con 0x7f94200b6b80 2024-09-17T05:44:01.085 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:01.081+0000 7f94260a4640 1 --2- 172.21.15.150:0/4127284771 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f942015ee80 0x7f942015f2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:44:01.085 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:01.081+0000 7f94258a3640 1 --2- 172.21.15.150:0/4127284771 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f94200b6b80 0x7f94201f2960 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f941c00e7f0 tx=0x7f941c00ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:44:01.085 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:01.082+0000 7f94167fc640 1 -- 172.21.15.150:0/4127284771 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f941c00ccc0 con 0x7f94200b6b80 2024-09-17T05:44:01.085 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:01.082+0000 7f94167fc640 1 -- 172.21.15.150:0/4127284771 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f941c00ce80 con 0x7f94200b6b80 2024-09-17T05:44:01.085 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:01.082+0000 7f9427b07640 1 -- 172.21.15.150:0/4127284771 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f94201623f0 con 0x7f94200b6b80 2024-09-17T05:44:01.085 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:01.082+0000 7f94167fc640 1 -- 172.21.15.150:0/4127284771 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f941c005280 con 0x7f94200b6b80 2024-09-17T05:44:01.085 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:01.082+0000 7f9427b07640 1 -- 172.21.15.150:0/4127284771 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f94200af600 con 0x7f94200b6b80 2024-09-17T05:44:01.086 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:01.083+0000 7f9427b07640 1 -- 172.21.15.150:0/4127284771 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f942006d9f0 con 0x7f94200b6b80 2024-09-17T05:44:01.086 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:01.083+0000 7f94167fc640 1 -- 172.21.15.150:0/4127284771 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 9) ==== 101747+0+0 (secure 0 0 0) 0x7f941c005420 con 0x7f94200b6b80 2024-09-17T05:44:01.086 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:01.084+0000 7f94167fc640 1 --2- 172.21.15.150:0/4127284771 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f9404078ef0 0x7f940407b400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:44:01.086 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:01.084+0000 7f94167fc640 1 -- 172.21.15.150:0/4127284771 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(42..42 src has 1..42) ==== 5227+0+0 (secure 0 0 0) 0x7f941c09bb40 con 0x7f94200b6b80 2024-09-17T05:44:01.087 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:01.084+0000 7f94250a2640 1 --2- 172.21.15.150:0/4127284771 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f9404078ef0 0x7f940407b400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:44:01.087 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:01.085+0000 7f94250a2640 1 --2- 172.21.15.150:0/4127284771 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f9404078ef0 0x7f940407b400 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f942015e9c0 tx=0x7f9410005f90 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:44:01.090 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:01.089+0000 7f94167fc640 1 -- 172.21.15.150:0/4127284771 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f941c063bd0 con 0x7f94200b6b80 2024-09-17T05:44:01.267 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:01.265+0000 7f9427b07640 1 -- 172.21.15.150:0/4127284771 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7f94200afaa0 con 0x7f94200b6b80 2024-09-17T05:44:01.932 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:01.931+0000 7f94167fc640 1 -- 172.21.15.150:0/4127284771 <== mon.0 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v43) ==== 170+0+0 (secure 0 0 0) 0x7f941c0634d0 con 0x7f94200b6b80 2024-09-17T05:44:01.933 INFO:teuthology.orchestra.run.smithi150.stderr:pool 'cephfs_data' created 2024-09-17T05:44:01.935 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:01.934+0000 7f9427b07640 1 -- 172.21.15.150:0/4127284771 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f9404078ef0 msgr2=0x7f940407b400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:44:01.935 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:01.934+0000 7f9427b07640 1 --2- 172.21.15.150:0/4127284771 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f9404078ef0 0x7f940407b400 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f942015e9c0 tx=0x7f9410005f90 comp rx=0 tx=0).stop 2024-09-17T05:44:01.935 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:01.934+0000 7f9427b07640 1 -- 172.21.15.150:0/4127284771 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f94200b6b80 msgr2=0x7f94201f2960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:44:01.935 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:01.934+0000 7f9427b07640 1 --2- 172.21.15.150:0/4127284771 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f94200b6b80 0x7f94201f2960 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f941c00e7f0 tx=0x7f941c00ecb0 comp rx=0 tx=0).stop 2024-09-17T05:44:01.936 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:01.934+0000 7f9427b07640 1 -- 172.21.15.150:0/4127284771 shutdown_connections 2024-09-17T05:44:01.936 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:01.934+0000 7f9427b07640 1 --2- 172.21.15.150:0/4127284771 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f942015ee80 0x7f942015f2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:01.937 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:01.934+0000 7f9427b07640 1 --2- 172.21.15.150:0/4127284771 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f9404078ef0 0x7f940407b400 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:01.937 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:01.934+0000 7f9427b07640 1 --2- 172.21.15.150:0/4127284771 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f94200d0ee0 0x7f94201613a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:01.937 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:01.934+0000 7f9427b07640 1 --2- 172.21.15.150:0/4127284771 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f94200b6b80 0x7f94201f2960 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:01.937 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:01.934+0000 7f9427b07640 1 -- 172.21.15.150:0/4127284771 >> 172.21.15.150:0/4127284771 conn(0x7f94200b2ff0 msgr2=0x7f94200706b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:44:01.937 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:01.936+0000 7f9427b07640 1 -- 172.21.15.150:0/4127284771 shutdown_connections 2024-09-17T05:44:01.937 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:01.936+0000 7f9427b07640 1 -- 172.21.15.150:0/4127284771 wait complete. 2024-09-17T05:44:01.966 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-09-17T05:44:02.086 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:02.084+0000 7f39b38c4640 1 -- 172.21.15.150:0/665462720 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f39ac09b160 msgr2=0x7f39ac0d03e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:44:02.086 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:02.084+0000 7f39b38c4640 1 --2- 172.21.15.150:0/665462720 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f39ac09b160 0x7f39ac0d03e0 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f39a0005fd0 tx=0x7f39a002a490 comp rx=0 tx=0).stop 2024-09-17T05:44:02.086 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:02.084+0000 7f39b38c4640 1 -- 172.21.15.150:0/665462720 shutdown_connections 2024-09-17T05:44:02.086 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:02.084+0000 7f39b38c4640 1 --2- 172.21.15.150:0/665462720 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f39ac0ce4e0 0x7f39ac0d0920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:02.086 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:02.084+0000 7f39b38c4640 1 --2- 172.21.15.150:0/665462720 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f39ac09b160 0x7f39ac0d03e0 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:02.086 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:02.084+0000 7f39b38c4640 1 -- 172.21.15.150:0/665462720 >> 172.21.15.150:0/665462720 conn(0x7f39ac0d2550 msgr2=0x7f39ac0d2960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:44:02.086 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:02.084+0000 7f39b38c4640 1 -- 172.21.15.150:0/665462720 shutdown_connections 2024-09-17T05:44:02.087 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:02.084+0000 7f39b38c4640 1 -- 172.21.15.150:0/665462720 wait complete. 2024-09-17T05:44:02.087 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:02.085+0000 7f39b38c4640 1 Processor -- start 2024-09-17T05:44:02.087 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:02.086+0000 7f39b38c4640 1 -- start start 2024-09-17T05:44:02.090 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:02.087+0000 7f39b38c4640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f39ac06eb40 0x7f39ac0b3a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:44:02.090 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:02.087+0000 7f39b38c4640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f39ac0ce4e0 0x7f39ac1612b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:44:02.090 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:02.087+0000 7f39b38c4640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f39ac1566b0 0x7f39ac1e94f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:44:02.090 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:02.087+0000 7f39b38c4640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f39ac0d12d0 con 0x7f39ac0ce4e0 2024-09-17T05:44:02.090 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:02.087+0000 7f39b38c4640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f39ac0d1150 con 0x7f39ac06eb40 2024-09-17T05:44:02.090 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:02.087+0000 7f39b38c4640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f39ac0d1450 con 0x7f39ac1566b0 2024-09-17T05:44:02.090 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:02.087+0000 7f39b0e5f640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f39ac0ce4e0 0x7f39ac1612b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:44:02.090 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:02.087+0000 7f39b0e5f640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f39ac0ce4e0 0x7f39ac1612b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:43034/0 (socket says 172.21.15.150:43034) 2024-09-17T05:44:02.090 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:02.087+0000 7f39b0e5f640 1 -- 172.21.15.150:0/2954741379 learned_addr learned my addr 172.21.15.150:0/2954741379 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:44:02.091 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:02.087+0000 7f39b1e61640 1 --2- 172.21.15.150:0/2954741379 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f39ac1566b0 0x7f39ac1e94f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:44:02.091 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:02.087+0000 7f39b1660640 1 --2- 172.21.15.150:0/2954741379 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f39ac06eb40 0x7f39ac0b3a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:44:02.091 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:02.087+0000 7f39b0e5f640 1 -- 172.21.15.150:0/2954741379 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f39ac1566b0 msgr2=0x7f39ac1e94f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:44:02.091 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:02.087+0000 7f39b0e5f640 1 --2- 172.21.15.150:0/2954741379 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f39ac1566b0 0x7f39ac1e94f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:02.091 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:02.087+0000 7f39b0e5f640 1 -- 172.21.15.150:0/2954741379 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f39ac06eb40 msgr2=0x7f39ac0b3a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:44:02.091 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:02.087+0000 7f39b0e5f640 1 --2- 172.21.15.150:0/2954741379 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f39ac06eb40 0x7f39ac0b3a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:02.091 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:02.087+0000 7f39b0e5f640 1 -- 172.21.15.150:0/2954741379 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f39ac1561d0 con 0x7f39ac0ce4e0 2024-09-17T05:44:02.091 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:02.087+0000 7f39b1660640 1 --2- 172.21.15.150:0/2954741379 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f39ac06eb40 0x7f39ac0b3a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:44:02.091 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:02.087+0000 7f39b0e5f640 1 --2- 172.21.15.150:0/2954741379 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f39ac0ce4e0 0x7f39ac1612b0 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f39a0034040 tx=0x7f39a0003970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:44:02.091 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:02.088+0000 7f399dffb640 1 -- 172.21.15.150:0/2954741379 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39a003e030 con 0x7f39ac0ce4e0 2024-09-17T05:44:02.091 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:02.088+0000 7f399dffb640 1 -- 172.21.15.150:0/2954741379 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f39a00047a0 con 0x7f39ac0ce4e0 2024-09-17T05:44:02.091 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:02.088+0000 7f39b38c4640 1 -- 172.21.15.150:0/2954741379 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f39ac160db0 con 0x7f39ac0ce4e0 2024-09-17T05:44:02.092 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:02.088+0000 7f399dffb640 1 -- 172.21.15.150:0/2954741379 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39a0035040 con 0x7f39ac0ce4e0 2024-09-17T05:44:02.092 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:02.088+0000 7f39b38c4640 1 -- 172.21.15.150:0/2954741379 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f39ac1590b0 con 0x7f39ac0ce4e0 2024-09-17T05:44:02.093 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:02.089+0000 7f39b38c4640 1 -- 172.21.15.150:0/2954741379 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f39ac160b00 con 0x7f39ac0ce4e0 2024-09-17T05:44:02.093 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:02.090+0000 7f399dffb640 1 -- 172.21.15.150:0/2954741379 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 9) ==== 101747+0+0 (secure 0 0 0) 0x7f39a0041030 con 0x7f39ac0ce4e0 2024-09-17T05:44:02.093 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:02.090+0000 7f399dffb640 1 --2- 172.21.15.150:0/2954741379 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f3990078f20 0x7f399007b430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:44:02.093 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:02.090+0000 7f399dffb640 1 -- 172.21.15.150:0/2954741379 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(43..43 src has 1..43) ==== 5609+0+0 (secure 0 0 0) 0x7f39a00bbbf0 con 0x7f39ac0ce4e0 2024-09-17T05:44:02.093 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:02.091+0000 7f39b1660640 1 --2- 172.21.15.150:0/2954741379 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f3990078f20 0x7f399007b430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:44:02.093 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:02.091+0000 7f39b1660640 1 --2- 172.21.15.150:0/2954741379 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f3990078f20 0x7f399007b430 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f39a4006fd0 tx=0x7f39a4008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:44:02.096 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:02.095+0000 7f399dffb640 1 -- 172.21.15.150:0/2954741379 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f39a0083520 con 0x7f39ac0ce4e0 2024-09-17T05:44:02.307 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:02.306+0000 7f39b38c4640 1 -- 172.21.15.150:0/2954741379 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7f39ac0d1990 con 0x7f39ac0ce4e0 2024-09-17T05:44:02.968 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:02.961+0000 7f399dffb640 1 -- 172.21.15.150:0/2954741379 <== mon.0 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 6 and data pool 7 v21) ==== 172+0+0 (secure 0 0 0) 0x7f39a0087f50 con 0x7f39ac0ce4e0 2024-09-17T05:44:02.968 INFO:teuthology.orchestra.run.smithi150.stderr:new fs with metadata pool 6 and data pool 7 2024-09-17T05:44:02.973 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:02.971+0000 7f39b38c4640 1 -- 172.21.15.150:0/2954741379 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f3990078f20 msgr2=0x7f399007b430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:44:02.973 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:02.971+0000 7f39b38c4640 1 --2- 172.21.15.150:0/2954741379 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f3990078f20 0x7f399007b430 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f39a4006fd0 tx=0x7f39a4008040 comp rx=0 tx=0).stop 2024-09-17T05:44:02.973 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:02.971+0000 7f39b38c4640 1 -- 172.21.15.150:0/2954741379 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f39ac0ce4e0 msgr2=0x7f39ac1612b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:44:02.973 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:02.971+0000 7f39b38c4640 1 --2- 172.21.15.150:0/2954741379 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f39ac0ce4e0 0x7f39ac1612b0 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f39a0034040 tx=0x7f39a0003970 comp rx=0 tx=0).stop 2024-09-17T05:44:02.974 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:02.971+0000 7f39b38c4640 1 -- 172.21.15.150:0/2954741379 shutdown_connections 2024-09-17T05:44:02.974 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:02.971+0000 7f39b38c4640 1 --2- 172.21.15.150:0/2954741379 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f3990078f20 0x7f399007b430 secure :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f39a4006fd0 tx=0x7f39a4008040 comp rx=0 tx=0).stop 2024-09-17T05:44:02.974 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:02.971+0000 7f39b38c4640 1 --2- 172.21.15.150:0/2954741379 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f39ac1566b0 0x7f39ac1e94f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:02.974 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:02.971+0000 7f39b38c4640 1 --2- 172.21.15.150:0/2954741379 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f39ac0ce4e0 0x7f39ac1612b0 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:02.974 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:02.971+0000 7f39b38c4640 1 --2- 172.21.15.150:0/2954741379 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f39ac06eb40 0x7f39ac0b3a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:02.974 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:02.971+0000 7f39b38c4640 1 -- 172.21.15.150:0/2954741379 >> 172.21.15.150:0/2954741379 conn(0x7f39ac0d2550 msgr2=0x7f39ac1ea6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:44:02.977 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:02.975+0000 7f39b38c4640 1 -- 172.21.15.150:0/2954741379 shutdown_connections 2024-09-17T05:44:02.977 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:02.975+0000 7f39b38c4640 1 -- 172.21.15.150:0/2954741379 wait complete. 2024-09-17T05:44:02.998 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T05:44:03.113 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:03.110+0000 7fe4327c6640 1 -- 172.21.15.150:0/3821581987 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe42c0d1790 msgr2=0x7fe42c0d2780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:44:03.113 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:03.110+0000 7fe4327c6640 1 --2- 172.21.15.150:0/3821581987 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe42c0d1790 0x7fe42c0d2780 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fe414009830 tx=0x7fe41402a510 comp rx=0 tx=0).stop 2024-09-17T05:44:03.113 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:03.111+0000 7fe4327c6640 1 -- 172.21.15.150:0/3821581987 shutdown_connections 2024-09-17T05:44:03.113 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:03.111+0000 7fe4327c6640 1 --2- 172.21.15.150:0/3821581987 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe42c0d4f90 0x7fe42c0d0400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:03.113 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:03.111+0000 7fe4327c6640 1 --2- 172.21.15.150:0/3821581987 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe42c0d1790 0x7fe42c0d2780 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:03.113 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:03.111+0000 7fe4327c6640 1 -- 172.21.15.150:0/3821581987 >> 172.21.15.150:0/3821581987 conn(0x7fe42c08bfe0 msgr2=0x7fe42c0d4670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:44:03.113 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:03.111+0000 7fe4327c6640 1 -- 172.21.15.150:0/3821581987 shutdown_connections 2024-09-17T05:44:03.113 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:03.111+0000 7fe4327c6640 1 -- 172.21.15.150:0/3821581987 wait complete. 2024-09-17T05:44:03.114 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:03.112+0000 7fe4327c6640 1 Processor -- start 2024-09-17T05:44:03.114 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:03.112+0000 7fe4327c6640 1 -- start start 2024-09-17T05:44:03.116 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:03.114+0000 7fe4327c6640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe42c0b5d50 0x7fe42c14b370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:44:03.117 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:03.114+0000 7fe4327c6640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe42c0d4f90 0x7fe42c09edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:44:03.117 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:03.114+0000 7fe4327c6640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe42c160500 0x7fe42c160910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:44:03.117 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:03.114+0000 7fe4327c6640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7fe42c0b7b00 con 0x7fe42c0b5d50 2024-09-17T05:44:03.117 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:03.114+0000 7fe4327c6640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fe42c0b7980 con 0x7fe42c160500 2024-09-17T05:44:03.117 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:03.114+0000 7fe4327c6640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fe42c0b7c80 con 0x7fe42c0d4f90 2024-09-17T05:44:03.117 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:03.114+0000 7fe42bfff640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe42c0b5d50 0x7fe42c14b370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:44:03.117 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:03.114+0000 7fe42bfff640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe42c0b5d50 0x7fe42c14b370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:43044/0 (socket says 172.21.15.150:43044) 2024-09-17T05:44:03.117 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:03.114+0000 7fe42bfff640 1 -- 172.21.15.150:0/151740418 learned_addr learned my addr 172.21.15.150:0/151740418 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:44:03.117 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:03.114+0000 7fe430d63640 1 --2- 172.21.15.150:0/151740418 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe42c160500 0x7fe42c160910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:44:03.117 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:03.114+0000 7fe423fff640 1 --2- 172.21.15.150:0/151740418 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe42c0d4f90 0x7fe42c09edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:44:03.117 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:03.114+0000 7fe42bfff640 1 -- 172.21.15.150:0/151740418 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe42c0d4f90 msgr2=0x7fe42c09edb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:44:03.117 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:03.114+0000 7fe42bfff640 1 --2- 172.21.15.150:0/151740418 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe42c0d4f90 0x7fe42c09edb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:03.117 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:03.114+0000 7fe42bfff640 1 -- 172.21.15.150:0/151740418 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe42c160500 msgr2=0x7fe42c160910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:44:03.118 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:03.114+0000 7fe42bfff640 1 --2- 172.21.15.150:0/151740418 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe42c160500 0x7fe42c160910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:03.118 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:03.114+0000 7fe42bfff640 1 -- 172.21.15.150:0/151740418 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe42c160e50 con 0x7fe42c0b5d50 2024-09-17T05:44:03.118 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:03.114+0000 7fe430d63640 1 --2- 172.21.15.150:0/151740418 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe42c160500 0x7fe42c160910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T05:44:03.118 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:03.115+0000 7fe42bfff640 1 --2- 172.21.15.150:0/151740418 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe42c0b5d50 0x7fe42c14b370 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7fe41c00c3a0 tx=0x7fe41c00c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:44:03.118 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:03.115+0000 7fe4297fa640 1 -- 172.21.15.150:0/151740418 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe41c017070 con 0x7fe42c0b5d50 2024-09-17T05:44:03.118 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:03.115+0000 7fe4327c6640 1 -- 172.21.15.150:0/151740418 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe42c09f2f0 con 0x7fe42c0b5d50 2024-09-17T05:44:03.118 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:03.115+0000 7fe4297fa640 1 -- 172.21.15.150:0/151740418 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe41c0053c0 con 0x7fe42c0b5d50 2024-09-17T05:44:03.118 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:03.115+0000 7fe4297fa640 1 -- 172.21.15.150:0/151740418 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe41c003850 con 0x7fe42c0b5d50 2024-09-17T05:44:03.118 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:03.115+0000 7fe4327c6640 1 -- 172.21.15.150:0/151740418 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe42c0a20a0 con 0x7fe42c0b5d50 2024-09-17T05:44:03.119 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:03.116+0000 7fe4327c6640 1 -- 172.21.15.150:0/151740418 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe42c06a610 con 0x7fe42c0b5d50 2024-09-17T05:44:03.119 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:03.117+0000 7fe4297fa640 1 -- 172.21.15.150:0/151740418 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 9) ==== 101747+0+0 (secure 0 0 0) 0x7fe41c01a070 con 0x7fe42c0b5d50 2024-09-17T05:44:03.119 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:03.117+0000 7fe4297fa640 1 --2- 172.21.15.150:0/151740418 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fe40c078ef0 0x7fe40c07b400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:44:03.119 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:03.117+0000 7fe4297fa640 1 -- 172.21.15.150:0/151740418 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(44..44 src has 1..44) ==== 5709+0+0 (secure 0 0 0) 0x7fe41c09a690 con 0x7fe42c0b5d50 2024-09-17T05:44:03.119 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:03.117+0000 7fe423fff640 1 --2- 172.21.15.150:0/151740418 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fe40c078ef0 0x7fe40c07b400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:44:03.119 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:03.118+0000 7fe423fff640 1 --2- 172.21.15.150:0/151740418 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fe40c078ef0 0x7fe40c07b400 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fe414034000 tx=0x7fe4140046c0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:44:03.123 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:03.122+0000 7fe4297fa640 1 -- 172.21.15.150:0/151740418 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fe42c06a610 con 0x7fe42c0b5d50 2024-09-17T05:44:03.301 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:03.300+0000 7fe4327c6640 1 -- 172.21.15.150:0/151740418 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fe42c0761d0 con 0x7fe42c0b5d50 2024-09-17T05:44:03.302 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:03.301+0000 7fe4297fa640 1 -- 172.21.15.150:0/151740418 <== mon.0 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v44) ==== 74+0+16722 (secure 0 0 0) 0x7fe42c160e50 con 0x7fe42c0b5d50 2024-09-17T05:44:03.303 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-09-17T05:44:03.303 INFO:teuthology.orchestra.run.smithi150.stdout:{"epoch":44,"fsid":"9f2e05e9-d629-47b3-b26b-1360655b7d20","created":"2024-09-17T05:41:32.502979+0000","modified":"2024-09-17T05:44:02.308106+0000","last_up_change":"2024-09-17T05:41:46.150225+0000","last_in_change":"2024-09-17T05:41:36.120274+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T05:41:46.860779+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2024-09-17T05:43:59.949433+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"44","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_data","create_time":"2024-09-17T05:44:01.270712+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"44","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"4f31c018-c8a4-4d6d-b0c2-a597c47aae4a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6800","nonce":479374392},{"type":"v1","addr":"172.21.15.150:6801","nonce":479374392}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6802","nonce":479374392},{"type":"v1","addr":"172.21.15.150:6803","nonce":479374392}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6806","nonce":479374392},{"type":"v1","addr":"172.21.15.150:6807","nonce":479374392}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6804","nonce":479374392},{"type":"v1","addr":"172.21.15.150:6805","nonce":479374392}]},"public_addr":"172.21.15.150:6801/479374392","cluster_addr":"172.21.15.150:6803/479374392","heartbeat_back_addr":"172.21.15.150:6807/479374392","heartbeat_front_addr":"172.21.15.150:6805/479374392","state":["exists","up"]},{"osd":1,"uuid":"6ff4a573-500b-4e04-9de3-39265ead78b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6824","nonce":913899800},{"type":"v1","addr":"172.21.15.150:6825","nonce":913899800}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6826","nonce":913899800},{"type":"v1","addr":"172.21.15.150:6827","nonce":913899800}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6830","nonce":913899800},{"type":"v1","addr":"172.21.15.150:6831","nonce":913899800}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6828","nonce":913899800},{"type":"v1","addr":"172.21.15.150:6829","nonce":913899800}]},"public_addr":"172.21.15.150:6825/913899800","cluster_addr":"172.21.15.150:6827/913899800","heartbeat_back_addr":"172.21.15.150:6831/913899800","heartbeat_front_addr":"172.21.15.150:6829/913899800","state":["exists","up"]},{"osd":2,"uuid":"bffea6f9-2465-4182-b205-00436c41ac1c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6816","nonce":363718461},{"type":"v1","addr":"172.21.15.150:6817","nonce":363718461}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6818","nonce":363718461},{"type":"v1","addr":"172.21.15.150:6819","nonce":363718461}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6822","nonce":363718461},{"type":"v1","addr":"172.21.15.150:6823","nonce":363718461}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6820","nonce":363718461},{"type":"v1","addr":"172.21.15.150:6821","nonce":363718461}]},"public_addr":"172.21.15.150:6817/363718461","cluster_addr":"172.21.15.150:6819/363718461","heartbeat_back_addr":"172.21.15.150:6823/363718461","heartbeat_front_addr":"172.21.15.150:6821/363718461","state":["exists","up"]},{"osd":3,"uuid":"cda70430-d1e1-427e-b04e-56db4031d078","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6808","nonce":3550994626},{"type":"v1","addr":"172.21.15.150:6809","nonce":3550994626}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6810","nonce":3550994626},{"type":"v1","addr":"172.21.15.150:6811","nonce":3550994626}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6814","nonce":3550994626},{"type":"v1","addr":"172.21.15.150:6815","nonce":3550994626}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6812","nonce":3550994626},{"type":"v1","addr":"172.21.15.150:6813","nonce":3550994626}]},"public_addr":"172.21.15.150:6809/3550994626","cluster_addr":"172.21.15.150:6811/3550994626","heartbeat_back_addr":"172.21.15.150:6815/3550994626","heartbeat_front_addr":"172.21.15.150:6813/3550994626","state":["exists","up"]},{"osd":4,"uuid":"3a0277fb-5e1e-4f68-bb2d-9a8a0152f64a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6810","nonce":2718261497},{"type":"v1","addr":"172.21.15.176:6811","nonce":2718261497}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6812","nonce":2718261497},{"type":"v1","addr":"172.21.15.176:6813","nonce":2718261497}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6816","nonce":2718261497},{"type":"v1","addr":"172.21.15.176:6817","nonce":2718261497}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6814","nonce":2718261497},{"type":"v1","addr":"172.21.15.176:6815","nonce":2718261497}]},"public_addr":"172.21.15.176:6811/2718261497","cluster_addr":"172.21.15.176:6813/2718261497","heartbeat_back_addr":"172.21.15.176:6817/2718261497","heartbeat_front_addr":"172.21.15.176:6815/2718261497","state":["exists","up"]},{"osd":5,"uuid":"33aebee6-0315-40b7-a11c-6702f0be494d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6818","nonce":2049295774},{"type":"v1","addr":"172.21.15.176:6819","nonce":2049295774}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6820","nonce":2049295774},{"type":"v1","addr":"172.21.15.176:6821","nonce":2049295774}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6824","nonce":2049295774},{"type":"v1","addr":"172.21.15.176:6825","nonce":2049295774}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6822","nonce":2049295774},{"type":"v1","addr":"172.21.15.176:6823","nonce":2049295774}]},"public_addr":"172.21.15.176:6819/2049295774","cluster_addr":"172.21.15.176:6821/2049295774","heartbeat_back_addr":"172.21.15.176:6825/2049295774","heartbeat_front_addr":"172.21.15.176:6823/2049295774","state":["exists","up"]},{"osd":6,"uuid":"4d24f360-6751-4263-841b-d77793d33540","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6826","nonce":2164458476},{"type":"v1","addr":"172.21.15.176:6827","nonce":2164458476}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6828","nonce":2164458476},{"type":"v1","addr":"172.21.15.176:6829","nonce":2164458476}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6832","nonce":2164458476},{"type":"v1","addr":"172.21.15.176:6833","nonce":2164458476}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6830","nonce":2164458476},{"type":"v1","addr":"172.21.15.176:6831","nonce":2164458476}]},"public_addr":"172.21.15.176:6827/2164458476","cluster_addr":"172.21.15.176:6829/2164458476","heartbeat_back_addr":"172.21.15.176:6833/2164458476","heartbeat_front_addr":"172.21.15.176:6831/2164458476","state":["exists","up"]},{"osd":7,"uuid":"c8594fda-c74a-4ba9-8277-caf101d58ca1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6802","nonce":3239587708},{"type":"v1","addr":"172.21.15.176:6803","nonce":3239587708}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6804","nonce":3239587708},{"type":"v1","addr":"172.21.15.176:6805","nonce":3239587708}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6808","nonce":3239587708},{"type":"v1","addr":"172.21.15.176:6809","nonce":3239587708}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6806","nonce":3239587708},{"type":"v1","addr":"172.21.15.176:6807","nonce":3239587708}]},"public_addr":"172.21.15.176:6803/3239587708","cluster_addr":"172.21.15.176:6805/3239587708","heartbeat_back_addr":"172.21.15.176:6809/3239587708","heartbeat_front_addr":"172.21.15.176:6807/3239587708","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:41:41.905151+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:41:42.705679+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:41:42.459673+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:41:42.440819+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:41:42.668428+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:41:42.694972+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:41:43.078535+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:41:42.363539+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T05:44:03.305 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:03.303+0000 7fe4327c6640 1 -- 172.21.15.150:0/151740418 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fe40c078ef0 msgr2=0x7fe40c07b400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:44:03.305 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:03.303+0000 7fe4327c6640 1 --2- 172.21.15.150:0/151740418 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fe40c078ef0 0x7fe40c07b400 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fe414034000 tx=0x7fe4140046c0 comp rx=0 tx=0).stop 2024-09-17T05:44:03.305 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:03.303+0000 7fe4327c6640 1 -- 172.21.15.150:0/151740418 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe42c0b5d50 msgr2=0x7fe42c14b370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:44:03.305 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:03.303+0000 7fe4327c6640 1 --2- 172.21.15.150:0/151740418 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe42c0b5d50 0x7fe42c14b370 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7fe41c00c3a0 tx=0x7fe41c00c860 comp rx=0 tx=0).stop 2024-09-17T05:44:03.305 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:03.303+0000 7fe4327c6640 1 -- 172.21.15.150:0/151740418 shutdown_connections 2024-09-17T05:44:03.305 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:03.303+0000 7fe4327c6640 1 --2- 172.21.15.150:0/151740418 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe42c160500 0x7fe42c160910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:03.305 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:03.303+0000 7fe4327c6640 1 --2- 172.21.15.150:0/151740418 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fe40c078ef0 0x7fe40c07b400 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:03.305 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:03.303+0000 7fe4327c6640 1 --2- 172.21.15.150:0/151740418 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe42c0d4f90 0x7fe42c09edb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:03.305 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:03.303+0000 7fe4327c6640 1 --2- 172.21.15.150:0/151740418 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe42c0b5d50 0x7fe42c14b370 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:03.305 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:03.303+0000 7fe4327c6640 1 -- 172.21.15.150:0/151740418 >> 172.21.15.150:0/151740418 conn(0x7fe42c08bfe0 msgr2=0x7fe42c15ea30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:44:03.305 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:03.303+0000 7fe4327c6640 1 -- 172.21.15.150:0/151740418 shutdown_connections 2024-09-17T05:44:03.306 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:03.303+0000 7fe4327c6640 1 -- 172.21.15.150:0/151740418 wait complete. 2024-09-17T05:44:03.317 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T05:44:03.431 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:03.429+0000 7f8963cde640 1 -- 172.21.15.150:0/419331096 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8948004d90 msgr2=0x7f8948005220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:44:03.432 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:03.429+0000 7f8963cde640 1 --2- 172.21.15.150:0/419331096 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8948004d90 0x7f8948005220 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f895c0b50a0 tx=0x7f8948005830 comp rx=0 tx=0).stop 2024-09-17T05:44:03.432 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:03.429+0000 7f896227b640 1 -- 172.21.15.150:0/419331096 reap_dead start 2024-09-17T05:44:03.432 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:03.430+0000 7f8963cde640 1 -- 172.21.15.150:0/419331096 shutdown_connections 2024-09-17T05:44:03.432 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:03.430+0000 7f8963cde640 1 -- 172.21.15.150:0/419331096 >> 172.21.15.150:0/419331096 conn(0x7f895c0cef30 msgr2=0x7f895c0cf340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:44:03.432 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:03.430+0000 7f8963cde640 1 -- 172.21.15.150:0/419331096 shutdown_connections 2024-09-17T05:44:03.432 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:03.430+0000 7f8963cde640 1 -- 172.21.15.150:0/419331096 wait complete. 2024-09-17T05:44:03.433 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:03.431+0000 7f8963cde640 1 Processor -- start 2024-09-17T05:44:03.433 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:03.431+0000 7f8963cde640 1 -- start start 2024-09-17T05:44:03.437 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:03.433+0000 7f8963cde640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8948004d90 0x7f895c1d36b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:44:03.437 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:03.433+0000 7f8963cde640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f895c09e2c0 0x7f895c1e77e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:44:03.437 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:03.433+0000 7f8963cde640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f895c09e6d0 0x7f895c1e7d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:44:03.437 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:03.433+0000 7f8963cde640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f895c0ceb70 con 0x7f8948004d90 2024-09-17T05:44:03.438 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:03.433+0000 7f8963cde640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f895c0b8390 con 0x7f895c09e2c0 2024-09-17T05:44:03.438 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:03.433+0000 7f8963cde640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f895c0cecf0 con 0x7f895c09e6d0 2024-09-17T05:44:03.438 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:03.433+0000 7f8961a7a640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8948004d90 0x7f895c1d36b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:44:03.438 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:03.433+0000 7f8961a7a640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8948004d90 0x7f895c1d36b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:43054/0 (socket says 172.21.15.150:43054) 2024-09-17T05:44:03.438 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:03.433+0000 7f8961a7a640 1 -- 172.21.15.150:0/1397932491 learned_addr learned my addr 172.21.15.150:0/1397932491 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:44:03.438 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:03.433+0000 7f8961a7a640 1 -- 172.21.15.150:0/1397932491 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f895c09e6d0 msgr2=0x7f895c1e7d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:44:03.438 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:03.433+0000 7f896227b640 1 --2- 172.21.15.150:0/1397932491 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f895c09e6d0 0x7f895c1e7d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:44:03.438 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:03.433+0000 7f8961a7a640 1 --2- 172.21.15.150:0/1397932491 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f895c09e6d0 0x7f895c1e7d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:03.438 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:03.433+0000 7f8961a7a640 1 -- 172.21.15.150:0/1397932491 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f895c09e2c0 msgr2=0x7f895c1e77e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:44:03.438 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:03.433+0000 7f8961a7a640 1 --2- 172.21.15.150:0/1397932491 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f895c09e2c0 0x7f895c1e77e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:03.438 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:03.433+0000 7f8961a7a640 1 -- 172.21.15.150:0/1397932491 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f895c1f56a0 con 0x7f8948004d90 2024-09-17T05:44:03.438 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:03.433+0000 7f8961a7a640 1 --2- 172.21.15.150:0/1397932491 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8948004d90 0x7f895c1d36b0 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f89580063d0 tx=0x7f89580039c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:44:03.439 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:03.433+0000 7f89527fc640 1 -- 172.21.15.150:0/1397932491 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8958015070 con 0x7f8948004d90 2024-09-17T05:44:03.439 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:03.434+0000 7f89527fc640 1 -- 172.21.15.150:0/1397932491 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8958011900 con 0x7f8948004d90 2024-09-17T05:44:03.439 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:03.434+0000 7f8963cde640 1 -- 172.21.15.150:0/1397932491 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f895c1f5910 con 0x7f8948004d90 2024-09-17T05:44:03.439 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:03.434+0000 7f89527fc640 1 -- 172.21.15.150:0/1397932491 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8958011d50 con 0x7f8948004d90 2024-09-17T05:44:03.439 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:03.434+0000 7f8963cde640 1 -- 172.21.15.150:0/1397932491 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f895c1f5ed0 con 0x7f8948004d90 2024-09-17T05:44:03.439 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:03.435+0000 7f8963cde640 1 -- 172.21.15.150:0/1397932491 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f895c0b62e0 con 0x7f8948004d90 2024-09-17T05:44:03.439 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:03.435+0000 7f89527fc640 1 -- 172.21.15.150:0/1397932491 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 9) ==== 101747+0+0 (secure 0 0 0) 0x7f8958018070 con 0x7f8948004d90 2024-09-17T05:44:03.439 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:03.436+0000 7f89527fc640 1 --2- 172.21.15.150:0/1397932491 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f8940078f20 0x7f894007b430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:44:03.440 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:03.436+0000 7f89527fc640 1 -- 172.21.15.150:0/1397932491 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(44..44 src has 1..44) ==== 5709+0+0 (secure 0 0 0) 0x7f895809c1f0 con 0x7f8948004d90 2024-09-17T05:44:03.440 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:03.436+0000 7f8961279640 1 --2- 172.21.15.150:0/1397932491 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f8940078f20 0x7f894007b430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:44:03.440 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:03.437+0000 7f8961279640 1 --2- 172.21.15.150:0/1397932491 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f8940078f20 0x7f894007b430 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f895c0cdbb0 tx=0x7f894c009660 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:44:03.442 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:03.440+0000 7f89527fc640 1 -- 172.21.15.150:0/1397932491 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f8958064020 con 0x7f8948004d90 2024-09-17T05:44:03.619 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:03.617+0000 7f8963cde640 1 -- 172.21.15.150:0/1397932491 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f895c0ce680 con 0x7f8948004d90 2024-09-17T05:44:03.620 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:03.618+0000 7f89527fc640 1 -- 172.21.15.150:0/1397932491 <== mon.0 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v44) ==== 74+0+16722 (secure 0 0 0) 0x7f8958063920 con 0x7f8948004d90 2024-09-17T05:44:03.620 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-09-17T05:44:03.620 INFO:teuthology.orchestra.run.smithi150.stdout:{"epoch":44,"fsid":"9f2e05e9-d629-47b3-b26b-1360655b7d20","created":"2024-09-17T05:41:32.502979+0000","modified":"2024-09-17T05:44:02.308106+0000","last_up_change":"2024-09-17T05:41:46.150225+0000","last_in_change":"2024-09-17T05:41:36.120274+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T05:41:46.860779+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2024-09-17T05:43:59.949433+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"44","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_data","create_time":"2024-09-17T05:44:01.270712+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"44","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"4f31c018-c8a4-4d6d-b0c2-a597c47aae4a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6800","nonce":479374392},{"type":"v1","addr":"172.21.15.150:6801","nonce":479374392}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6802","nonce":479374392},{"type":"v1","addr":"172.21.15.150:6803","nonce":479374392}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6806","nonce":479374392},{"type":"v1","addr":"172.21.15.150:6807","nonce":479374392}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6804","nonce":479374392},{"type":"v1","addr":"172.21.15.150:6805","nonce":479374392}]},"public_addr":"172.21.15.150:6801/479374392","cluster_addr":"172.21.15.150:6803/479374392","heartbeat_back_addr":"172.21.15.150:6807/479374392","heartbeat_front_addr":"172.21.15.150:6805/479374392","state":["exists","up"]},{"osd":1,"uuid":"6ff4a573-500b-4e04-9de3-39265ead78b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6824","nonce":913899800},{"type":"v1","addr":"172.21.15.150:6825","nonce":913899800}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6826","nonce":913899800},{"type":"v1","addr":"172.21.15.150:6827","nonce":913899800}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6830","nonce":913899800},{"type":"v1","addr":"172.21.15.150:6831","nonce":913899800}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6828","nonce":913899800},{"type":"v1","addr":"172.21.15.150:6829","nonce":913899800}]},"public_addr":"172.21.15.150:6825/913899800","cluster_addr":"172.21.15.150:6827/913899800","heartbeat_back_addr":"172.21.15.150:6831/913899800","heartbeat_front_addr":"172.21.15.150:6829/913899800","state":["exists","up"]},{"osd":2,"uuid":"bffea6f9-2465-4182-b205-00436c41ac1c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6816","nonce":363718461},{"type":"v1","addr":"172.21.15.150:6817","nonce":363718461}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6818","nonce":363718461},{"type":"v1","addr":"172.21.15.150:6819","nonce":363718461}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6822","nonce":363718461},{"type":"v1","addr":"172.21.15.150:6823","nonce":363718461}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6820","nonce":363718461},{"type":"v1","addr":"172.21.15.150:6821","nonce":363718461}]},"public_addr":"172.21.15.150:6817/363718461","cluster_addr":"172.21.15.150:6819/363718461","heartbeat_back_addr":"172.21.15.150:6823/363718461","heartbeat_front_addr":"172.21.15.150:6821/363718461","state":["exists","up"]},{"osd":3,"uuid":"cda70430-d1e1-427e-b04e-56db4031d078","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6808","nonce":3550994626},{"type":"v1","addr":"172.21.15.150:6809","nonce":3550994626}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6810","nonce":3550994626},{"type":"v1","addr":"172.21.15.150:6811","nonce":3550994626}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6814","nonce":3550994626},{"type":"v1","addr":"172.21.15.150:6815","nonce":3550994626}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6812","nonce":3550994626},{"type":"v1","addr":"172.21.15.150:6813","nonce":3550994626}]},"public_addr":"172.21.15.150:6809/3550994626","cluster_addr":"172.21.15.150:6811/3550994626","heartbeat_back_addr":"172.21.15.150:6815/3550994626","heartbeat_front_addr":"172.21.15.150:6813/3550994626","state":["exists","up"]},{"osd":4,"uuid":"3a0277fb-5e1e-4f68-bb2d-9a8a0152f64a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6810","nonce":2718261497},{"type":"v1","addr":"172.21.15.176:6811","nonce":2718261497}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6812","nonce":2718261497},{"type":"v1","addr":"172.21.15.176:6813","nonce":2718261497}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6816","nonce":2718261497},{"type":"v1","addr":"172.21.15.176:6817","nonce":2718261497}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6814","nonce":2718261497},{"type":"v1","addr":"172.21.15.176:6815","nonce":2718261497}]},"public_addr":"172.21.15.176:6811/2718261497","cluster_addr":"172.21.15.176:6813/2718261497","heartbeat_back_addr":"172.21.15.176:6817/2718261497","heartbeat_front_addr":"172.21.15.176:6815/2718261497","state":["exists","up"]},{"osd":5,"uuid":"33aebee6-0315-40b7-a11c-6702f0be494d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6818","nonce":2049295774},{"type":"v1","addr":"172.21.15.176:6819","nonce":2049295774}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6820","nonce":2049295774},{"type":"v1","addr":"172.21.15.176:6821","nonce":2049295774}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6824","nonce":2049295774},{"type":"v1","addr":"172.21.15.176:6825","nonce":2049295774}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6822","nonce":2049295774},{"type":"v1","addr":"172.21.15.176:6823","nonce":2049295774}]},"public_addr":"172.21.15.176:6819/2049295774","cluster_addr":"172.21.15.176:6821/2049295774","heartbeat_back_addr":"172.21.15.176:6825/2049295774","heartbeat_front_addr":"172.21.15.176:6823/2049295774","state":["exists","up"]},{"osd":6,"uuid":"4d24f360-6751-4263-841b-d77793d33540","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6826","nonce":2164458476},{"type":"v1","addr":"172.21.15.176:6827","nonce":2164458476}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6828","nonce":2164458476},{"type":"v1","addr":"172.21.15.176:6829","nonce":2164458476}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6832","nonce":2164458476},{"type":"v1","addr":"172.21.15.176:6833","nonce":2164458476}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6830","nonce":2164458476},{"type":"v1","addr":"172.21.15.176:6831","nonce":2164458476}]},"public_addr":"172.21.15.176:6827/2164458476","cluster_addr":"172.21.15.176:6829/2164458476","heartbeat_back_addr":"172.21.15.176:6833/2164458476","heartbeat_front_addr":"172.21.15.176:6831/2164458476","state":["exists","up"]},{"osd":7,"uuid":"c8594fda-c74a-4ba9-8277-caf101d58ca1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6802","nonce":3239587708},{"type":"v1","addr":"172.21.15.176:6803","nonce":3239587708}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6804","nonce":3239587708},{"type":"v1","addr":"172.21.15.176:6805","nonce":3239587708}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6808","nonce":3239587708},{"type":"v1","addr":"172.21.15.176:6809","nonce":3239587708}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6806","nonce":3239587708},{"type":"v1","addr":"172.21.15.176:6807","nonce":3239587708}]},"public_addr":"172.21.15.176:6803/3239587708","cluster_addr":"172.21.15.176:6805/3239587708","heartbeat_back_addr":"172.21.15.176:6809/3239587708","heartbeat_front_addr":"172.21.15.176:6807/3239587708","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:41:41.905151+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:41:42.705679+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:41:42.459673+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:41:42.440819+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:41:42.668428+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:41:42.694972+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:41:43.078535+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:41:42.363539+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T05:44:03.622 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:03.621+0000 7f8963cde640 1 -- 172.21.15.150:0/1397932491 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f8940078f20 msgr2=0x7f894007b430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:44:03.622 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:03.621+0000 7f8963cde640 1 --2- 172.21.15.150:0/1397932491 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f8940078f20 0x7f894007b430 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f895c0cdbb0 tx=0x7f894c009660 comp rx=0 tx=0).stop 2024-09-17T05:44:03.623 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:03.621+0000 7f8963cde640 1 -- 172.21.15.150:0/1397932491 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8948004d90 msgr2=0x7f895c1d36b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:44:03.623 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:03.621+0000 7f8963cde640 1 --2- 172.21.15.150:0/1397932491 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8948004d90 0x7f895c1d36b0 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f89580063d0 tx=0x7f89580039c0 comp rx=0 tx=0).stop 2024-09-17T05:44:03.623 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:03.621+0000 7f8963cde640 1 -- 172.21.15.150:0/1397932491 shutdown_connections 2024-09-17T05:44:03.623 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:03.621+0000 7f8963cde640 1 --2- 172.21.15.150:0/1397932491 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f895c09e2c0 0x7f895c1e77e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:03.623 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:03.621+0000 7f8963cde640 1 --2- 172.21.15.150:0/1397932491 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f8940078f20 0x7f894007b430 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:03.623 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:03.621+0000 7f8963cde640 1 --2- 172.21.15.150:0/1397932491 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f895c09e6d0 0x7f895c1e7d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:03.623 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:03.621+0000 7f8963cde640 1 --2- 172.21.15.150:0/1397932491 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8948004d90 0x7f895c1d36b0 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:03.623 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:03.621+0000 7f8963cde640 1 -- 172.21.15.150:0/1397932491 >> 172.21.15.150:0/1397932491 conn(0x7f895c0cef30 msgr2=0x7f895c072af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:44:03.623 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:03.621+0000 7f8963cde640 1 -- 172.21.15.150:0/1397932491 shutdown_connections 2024-09-17T05:44:03.623 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:03.621+0000 7f8963cde640 1 -- 172.21.15.150:0/1397932491 wait complete. 2024-09-17T05:44:03.634 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-09-17T05:44:03.751 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:03.749+0000 7f4ca3113640 1 -- 172.21.15.150:0/1490394243 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4c9c06dea0 msgr2=0x7f4c9c0d0020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:44:03.751 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:03.749+0000 7f4ca3113640 1 --2- 172.21.15.150:0/1490394243 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4c9c06dea0 0x7f4c9c0d0020 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f4c9c08d600 tx=0x7f4c9002aa30 comp rx=0 tx=0).stop 2024-09-17T05:44:03.751 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:03.749+0000 7f4ca3113640 1 -- 172.21.15.150:0/1490394243 shutdown_connections 2024-09-17T05:44:03.751 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:03.749+0000 7f4ca3113640 1 --2- 172.21.15.150:0/1490394243 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4c9c06e2b0 0x7f4c9c0d0560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:03.751 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:03.749+0000 7f4ca3113640 1 --2- 172.21.15.150:0/1490394243 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4c9c06dea0 0x7f4c9c0d0020 unknown :-1 s=CLOSED pgs=443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:03.752 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:03.749+0000 7f4ca3113640 1 --2- 172.21.15.150:0/1490394243 >> v2:172.21.15.176:3300/0 conn(0x7f4c9c0d5150 0x7f4c9c0b9b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:03.752 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:03.749+0000 7f4ca3113640 1 -- 172.21.15.150:0/1490394243 >> 172.21.15.150:0/1490394243 conn(0x7f4c9c08bfe0 msgr2=0x7f4c9c0d46e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:44:03.752 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:03.749+0000 7f4ca3113640 1 -- 172.21.15.150:0/1490394243 shutdown_connections 2024-09-17T05:44:03.752 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:03.749+0000 7f4ca3113640 1 -- 172.21.15.150:0/1490394243 wait complete. 2024-09-17T05:44:03.753 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:03.751+0000 7f4ca3113640 1 Processor -- start 2024-09-17T05:44:03.753 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:03.751+0000 7f4ca3113640 1 -- start start 2024-09-17T05:44:03.756 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:03.753+0000 7f4ca3113640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4c9c06dea0 0x7f4c9c0cc8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:44:03.756 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:03.753+0000 7f4ca3113640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4c9c06e2b0 0x7f4c9c14f240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:44:03.756 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:03.753+0000 7f4ca3113640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4c9c0d5150 0x7f4c9c1f8df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:44:03.756 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:03.753+0000 7f4ca3113640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f4c9c0d3150 con 0x7f4c9c06dea0 2024-09-17T05:44:03.756 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:03.753+0000 7f4ca3113640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f4c9c0d2fd0 con 0x7f4c9c0d5150 2024-09-17T05:44:03.756 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:03.753+0000 7f4ca3113640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f4c9c0b6160 con 0x7f4c9c06e2b0 2024-09-17T05:44:03.756 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:03.753+0000 7f4ca0eaf640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4c9c06dea0 0x7f4c9c0cc8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:44:03.756 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:03.753+0000 7f4ca0eaf640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4c9c06dea0 0x7f4c9c0cc8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:43066/0 (socket says 172.21.15.150:43066) 2024-09-17T05:44:03.756 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:03.753+0000 7f4ca0eaf640 1 -- 172.21.15.150:0/766154428 learned_addr learned my addr 172.21.15.150:0/766154428 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:44:03.756 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:03.753+0000 7f4c9bfff640 1 --2- 172.21.15.150:0/766154428 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4c9c06e2b0 0x7f4c9c14f240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:44:03.757 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:03.753+0000 7f4ca16b0640 1 --2- 172.21.15.150:0/766154428 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4c9c0d5150 0x7f4c9c1f8df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:44:03.757 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:03.753+0000 7f4ca0eaf640 1 -- 172.21.15.150:0/766154428 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4c9c06e2b0 msgr2=0x7f4c9c14f240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:44:03.757 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:03.753+0000 7f4ca0eaf640 1 --2- 172.21.15.150:0/766154428 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4c9c06e2b0 0x7f4c9c14f240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:03.757 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:03.753+0000 7f4ca0eaf640 1 -- 172.21.15.150:0/766154428 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4c9c0d5150 msgr2=0x7f4c9c1f8df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:44:03.757 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:03.753+0000 7f4ca0eaf640 1 --2- 172.21.15.150:0/766154428 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4c9c0d5150 0x7f4c9c1f8df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:03.757 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:03.753+0000 7f4ca0eaf640 1 -- 172.21.15.150:0/766154428 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4c9c152b40 con 0x7f4c9c06dea0 2024-09-17T05:44:03.757 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:03.753+0000 7f4ca0eaf640 1 --2- 172.21.15.150:0/766154428 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4c9c06dea0 0x7f4c9c0cc8a0 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f4c8c00c970 tx=0x7f4c8c00ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:44:03.757 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:03.753+0000 7f4c997fa640 1 -- 172.21.15.150:0/766154428 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c8c007bb0 con 0x7f4c9c06dea0 2024-09-17T05:44:03.757 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:03.753+0000 7f4c997fa640 1 -- 172.21.15.150:0/766154428 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f4c8c007e40 con 0x7f4c9c06dea0 2024-09-17T05:44:03.757 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:03.753+0000 7f4ca3113640 1 -- 172.21.15.150:0/766154428 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4c9c0ccde0 con 0x7f4c9c06dea0 2024-09-17T05:44:03.757 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:03.753+0000 7f4c997fa640 1 -- 172.21.15.150:0/766154428 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c8c005290 con 0x7f4c9c06dea0 2024-09-17T05:44:03.757 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:03.753+0000 7f4ca3113640 1 -- 172.21.15.150:0/766154428 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4c9c0cd390 con 0x7f4c9c06dea0 2024-09-17T05:44:03.758 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:03.754+0000 7f4ca3113640 1 -- 172.21.15.150:0/766154428 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4c9c0b9b10 con 0x7f4c9c06dea0 2024-09-17T05:44:03.758 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:03.755+0000 7f4c997fa640 1 -- 172.21.15.150:0/766154428 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 9) ==== 101747+0+0 (secure 0 0 0) 0x7f4c8c005430 con 0x7f4c9c06dea0 2024-09-17T05:44:03.758 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:03.756+0000 7f4c997fa640 1 --2- 172.21.15.150:0/766154428 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f4c88078ef0 0x7f4c8807b400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:44:03.759 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:03.756+0000 7f4c997fa640 1 -- 172.21.15.150:0/766154428 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(44..44 src has 1..44) ==== 5709+0+0 (secure 0 0 0) 0x7f4c8c09ba50 con 0x7f4c9c06dea0 2024-09-17T05:44:03.759 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:03.756+0000 7f4c9bfff640 1 --2- 172.21.15.150:0/766154428 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f4c88078ef0 0x7f4c8807b400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:44:03.759 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:03.756+0000 7f4c9bfff640 1 --2- 172.21.15.150:0/766154428 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f4c88078ef0 0x7f4c8807b400 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f4c90035000 tx=0x7f4c90004ab0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:44:03.761 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:03.760+0000 7f4c997fa640 1 -- 172.21.15.150:0/766154428 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f4c8c014070 con 0x7f4c9c06dea0 2024-09-17T05:44:03.973 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:03.971+0000 7f4ca3113640 1 -- 172.21.15.150:0/766154428 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7f4c9c0d4f30 con 0x7f4c9c06dea0 2024-09-17T05:44:04.931 INFO:tasks.ceph.mds.c.smithi150.stderr:2024-09-17T05:44:04.930+0000 7f3f4ab9a640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-17T05:44:04.984 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:04.982+0000 7f4c997fa640 1 -- 172.21.15.150:0/766154428 <== mon.0 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v24) ==== 118+0+0 (secure 0 0 0) 0x7f4c8c063870 con 0x7f4c9c06dea0 2024-09-17T05:44:04.988 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:04.985+0000 7f4ca3113640 1 -- 172.21.15.150:0/766154428 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f4c88078ef0 msgr2=0x7f4c8807b400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:44:04.988 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:04.985+0000 7f4ca3113640 1 --2- 172.21.15.150:0/766154428 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f4c88078ef0 0x7f4c8807b400 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f4c90035000 tx=0x7f4c90004ab0 comp rx=0 tx=0).stop 2024-09-17T05:44:04.988 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:04.985+0000 7f4ca3113640 1 -- 172.21.15.150:0/766154428 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4c9c06dea0 msgr2=0x7f4c9c0cc8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:44:04.988 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:04.985+0000 7f4ca3113640 1 --2- 172.21.15.150:0/766154428 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4c9c06dea0 0x7f4c9c0cc8a0 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f4c8c00c970 tx=0x7f4c8c00ce30 comp rx=0 tx=0).stop 2024-09-17T05:44:04.988 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:04.985+0000 7f4ca3113640 1 -- 172.21.15.150:0/766154428 shutdown_connections 2024-09-17T05:44:04.989 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:04.985+0000 7f4ca3113640 1 --2- 172.21.15.150:0/766154428 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4c9c0d5150 0x7f4c9c1f8df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:04.989 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:04.985+0000 7f4ca3113640 1 --2- 172.21.15.150:0/766154428 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f4c88078ef0 0x7f4c8807b400 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:04.989 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:04.985+0000 7f4ca3113640 1 --2- 172.21.15.150:0/766154428 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4c9c06e2b0 0x7f4c9c14f240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:04.989 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:04.985+0000 7f4ca3113640 1 --2- 172.21.15.150:0/766154428 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4c9c06dea0 0x7f4c9c0cc8a0 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:04.989 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:04.985+0000 7f4ca3113640 1 -- 172.21.15.150:0/766154428 >> 172.21.15.150:0/766154428 conn(0x7f4c9c08bfe0 msgr2=0x7f4c9c0b1cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:44:04.989 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:04.985+0000 7f4ca3113640 1 -- 172.21.15.150:0/766154428 shutdown_connections 2024-09-17T05:44:04.990 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:04.985+0000 7f4ca3113640 1 -- 172.21.15.150:0/766154428 wait complete. 2024-09-17T05:44:05.002 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-09-17T05:44:05.002 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-09-17T05:44:05.126 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:05.124+0000 7f4bffd82640 1 -- 172.21.15.150:0/2216019727 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4bf80b7960 msgr2=0x7f4bf80af1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:44:05.127 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:05.125+0000 7f4bffd82640 1 --2- 172.21.15.150:0/2216019727 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4bf80b7960 0x7f4bf80af1f0 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f4bf00098e0 tx=0x7f4bf002a540 comp rx=0 tx=0).stop 2024-09-17T05:44:05.127 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:05.125+0000 7f4bffd82640 1 -- 172.21.15.150:0/2216019727 shutdown_connections 2024-09-17T05:44:05.127 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:05.125+0000 7f4bffd82640 1 --2- 172.21.15.150:0/2216019727 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4bf80b7960 0x7f4bf80af1f0 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:05.127 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:05.125+0000 7f4bffd82640 1 -- 172.21.15.150:0/2216019727 >> 172.21.15.150:0/2216019727 conn(0x7f4bf80cef20 msgr2=0x7f4bf80cf330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:44:05.127 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:05.125+0000 7f4bffd82640 1 -- 172.21.15.150:0/2216019727 shutdown_connections 2024-09-17T05:44:05.127 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:05.125+0000 7f4bffd82640 1 -- 172.21.15.150:0/2216019727 wait complete. 2024-09-17T05:44:05.128 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:05.126+0000 7f4bffd82640 1 Processor -- start 2024-09-17T05:44:05.128 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:05.126+0000 7f4bffd82640 1 -- start start 2024-09-17T05:44:05.130 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:05.128+0000 7f4bffd82640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4bf80b7960 0x7f4bf8144d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:44:05.130 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:05.128+0000 7f4bffd82640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4bf80b7d70 0x7f4bf81452b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:44:05.131 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:05.128+0000 7f4bffd82640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4bf80d1190 0x7f4bf81e5850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:44:05.131 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:05.128+0000 7f4bffd82640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f4bf80b8380 con 0x7f4bf80b7960 2024-09-17T05:44:05.131 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:05.128+0000 7f4bffd82640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f4bf80ceda0 con 0x7f4bf80d1190 2024-09-17T05:44:05.131 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:05.128+0000 7f4bffd82640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f4bf80af730 con 0x7f4bf80b7d70 2024-09-17T05:44:05.131 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:05.128+0000 7f4bfdb1e640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4bf80b7960 0x7f4bf8144d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:44:05.131 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:05.128+0000 7f4bfdb1e640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4bf80b7960 0x7f4bf8144d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:43088/0 (socket says 172.21.15.150:43088) 2024-09-17T05:44:05.131 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:05.128+0000 7f4bfdb1e640 1 -- 172.21.15.150:0/1735287048 learned_addr learned my addr 172.21.15.150:0/1735287048 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:44:05.131 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:05.128+0000 7f4bfe31f640 1 --2- 172.21.15.150:0/1735287048 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4bf80d1190 0x7f4bf81e5850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:44:05.131 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:05.128+0000 7f4bfdb1e640 1 -- 172.21.15.150:0/1735287048 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4bf80b7d70 msgr2=0x7f4bf81452b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:44:05.131 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:05.128+0000 7f4bfd31d640 1 --2- 172.21.15.150:0/1735287048 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4bf80b7d70 0x7f4bf81452b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:44:05.131 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:05.128+0000 7f4bfdb1e640 1 --2- 172.21.15.150:0/1735287048 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4bf80b7d70 0x7f4bf81452b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:05.131 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:05.128+0000 7f4bfdb1e640 1 -- 172.21.15.150:0/1735287048 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4bf80d1190 msgr2=0x7f4bf81e5850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:44:05.132 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:05.128+0000 7f4bfdb1e640 1 --2- 172.21.15.150:0/1735287048 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4bf80d1190 0x7f4bf81e5850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:05.132 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:05.128+0000 7f4bfdb1e640 1 -- 172.21.15.150:0/1735287048 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4bf80cba40 con 0x7f4bf80b7960 2024-09-17T05:44:05.132 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:05.128+0000 7f4bfdb1e640 1 --2- 172.21.15.150:0/1735287048 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4bf80b7960 0x7f4bf8144d70 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f4bf0009a00 tx=0x7f4bf0005270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:44:05.132 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:05.128+0000 7f4bf67fc640 1 -- 172.21.15.150:0/1735287048 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4bf003f070 con 0x7f4bf80b7960 2024-09-17T05:44:05.132 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:05.128+0000 7f4bf67fc640 1 -- 172.21.15.150:0/1735287048 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f4bf0004360 con 0x7f4bf80b7960 2024-09-17T05:44:05.132 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:05.128+0000 7f4bffd82640 1 -- 172.21.15.150:0/1735287048 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4bf80b6c10 con 0x7f4bf80b7960 2024-09-17T05:44:05.132 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:05.128+0000 7f4bf67fc640 1 -- 172.21.15.150:0/1735287048 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4bf0031bb0 con 0x7f4bf80b7960 2024-09-17T05:44:05.132 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:05.129+0000 7f4bffd82640 1 -- 172.21.15.150:0/1735287048 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4bf81e8540 con 0x7f4bf80b7960 2024-09-17T05:44:05.133 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:05.129+0000 7f4bffd82640 1 -- 172.21.15.150:0/1735287048 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4bf81e8780 con 0x7f4bf80b7960 2024-09-17T05:44:05.133 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:05.130+0000 7f4bf67fc640 1 -- 172.21.15.150:0/1735287048 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 9) ==== 101747+0+0 (secure 0 0 0) 0x7f4bf0042070 con 0x7f4bf80b7960 2024-09-17T05:44:05.133 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:05.131+0000 7f4bf67fc640 1 --2- 172.21.15.150:0/1735287048 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f4be4078ef0 0x7f4be407b400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:44:05.133 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:05.131+0000 7f4bf67fc640 1 -- 172.21.15.150:0/1735287048 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 5709+0+0 (secure 0 0 0) 0x7f4bf00bc4c0 con 0x7f4bf80b7960 2024-09-17T05:44:05.133 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:05.131+0000 7f4bfd31d640 1 --2- 172.21.15.150:0/1735287048 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f4be4078ef0 0x7f4be407b400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:44:05.133 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:05.131+0000 7f4bfd31d640 1 --2- 172.21.15.150:0/1735287048 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f4be4078ef0 0x7f4be407b400 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f4bf80b09b0 tx=0x7f4bec009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:44:05.136 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:05.135+0000 7f4bf67fc640 1 -- 172.21.15.150:0/1735287048 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f4bf81e8780 con 0x7f4bf80b7960 2024-09-17T05:44:05.352 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:05.351+0000 7f4bffd82640 1 -- 172.21.15.150:0/1735287048 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7f4bf8160920 con 0x7f4bf80b7960 2024-09-17T05:44:05.985 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:05.983+0000 7f4bf67fc640 1 -- 172.21.15.150:0/1735287048 <== mon.0 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v25) ==== 122+0+0 (secure 0 0 0) 0x7f4bf0084370 con 0x7f4bf80b7960 2024-09-17T05:44:05.988 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:05.986+0000 7f4bffd82640 1 -- 172.21.15.150:0/1735287048 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f4be4078ef0 msgr2=0x7f4be407b400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:44:05.988 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:05.986+0000 7f4bffd82640 1 --2- 172.21.15.150:0/1735287048 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f4be4078ef0 0x7f4be407b400 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f4bf80b09b0 tx=0x7f4bec009040 comp rx=0 tx=0).stop 2024-09-17T05:44:05.989 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:05.986+0000 7f4bffd82640 1 -- 172.21.15.150:0/1735287048 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4bf80b7960 msgr2=0x7f4bf8144d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:44:05.989 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:05.986+0000 7f4bffd82640 1 --2- 172.21.15.150:0/1735287048 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4bf80b7960 0x7f4bf8144d70 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f4bf0009a00 tx=0x7f4bf0005270 comp rx=0 tx=0).stop 2024-09-17T05:44:05.989 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:05.986+0000 7f4bffd82640 1 -- 172.21.15.150:0/1735287048 shutdown_connections 2024-09-17T05:44:05.989 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:05.986+0000 7f4bffd82640 1 --2- 172.21.15.150:0/1735287048 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4bf80d1190 0x7f4bf81e5850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:05.989 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:05.986+0000 7f4bffd82640 1 --2- 172.21.15.150:0/1735287048 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f4be4078ef0 0x7f4be407b400 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:05.989 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:05.986+0000 7f4bffd82640 1 --2- 172.21.15.150:0/1735287048 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4bf80b7d70 0x7f4bf81452b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:05.989 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:05.986+0000 7f4bffd82640 1 --2- 172.21.15.150:0/1735287048 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4bf80b7960 0x7f4bf8144d70 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:05.989 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:05.986+0000 7f4bffd82640 1 -- 172.21.15.150:0/1735287048 >> 172.21.15.150:0/1735287048 conn(0x7f4bf80cef20 msgr2=0x7f4bf8142f20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:44:05.989 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:05.987+0000 7f4bffd82640 1 -- 172.21.15.150:0/1735287048 shutdown_connections 2024-09-17T05:44:05.989 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:05.987+0000 7f4bffd82640 1 -- 172.21.15.150:0/1735287048 wait complete. 2024-09-17T05:44:06.002 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-09-17T05:44:06.002 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T05:44:06.120 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:06.118+0000 7fe63b015640 1 -- 172.21.15.150:0/3444689440 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe63415f310 msgr2=0x7fe63415f720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:44:06.120 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:06.118+0000 7fe63b015640 1 --2- 172.21.15.150:0/3444689440 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe63415f310 0x7fe63415f720 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7fe620005fd0 tx=0x7fe62002a5d0 comp rx=0 tx=0).stop 2024-09-17T05:44:06.121 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:06.118+0000 7fe63b015640 1 -- 172.21.15.150:0/3444689440 shutdown_connections 2024-09-17T05:44:06.121 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:06.118+0000 7fe63b015640 1 --2- 172.21.15.150:0/3444689440 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe63415f310 0x7fe63415f720 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:06.121 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:06.118+0000 7fe63b015640 1 -- 172.21.15.150:0/3444689440 >> 172.21.15.150:0/3444689440 conn(0x7fe63406d730 msgr2=0x7fe6340b1e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:44:06.121 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:06.118+0000 7fe63b015640 1 -- 172.21.15.150:0/3444689440 shutdown_connections 2024-09-17T05:44:06.121 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:06.118+0000 7fe63b015640 1 -- 172.21.15.150:0/3444689440 wait complete. 2024-09-17T05:44:06.121 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:06.120+0000 7fe63b015640 1 Processor -- start 2024-09-17T05:44:06.122 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:06.120+0000 7fe63b015640 1 -- start start 2024-09-17T05:44:06.124 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:06.122+0000 7fe63b015640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe6340b3a80 0x7fe6341f4690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:44:06.124 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:06.122+0000 7fe63b015640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe6341527b0 0x7fe63409da80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:44:06.125 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:06.122+0000 7fe63b015640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe63415f310 0x7fe6341f71e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:44:06.125 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:06.122+0000 7fe63b015640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7fe6340b4930 con 0x7fe63415f310 2024-09-17T05:44:06.125 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:06.122+0000 7fe63b015640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fe6340b47b0 con 0x7fe6341527b0 2024-09-17T05:44:06.125 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:06.122+0000 7fe63b015640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fe6340b4ab0 con 0x7fe6340b3a80 2024-09-17T05:44:06.125 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:06.122+0000 7fe6395b2640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe63415f310 0x7fe6341f71e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:44:06.125 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:06.122+0000 7fe6395b2640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe63415f310 0x7fe6341f71e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:43116/0 (socket says 172.21.15.150:43116) 2024-09-17T05:44:06.125 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:06.122+0000 7fe6395b2640 1 -- 172.21.15.150:0/4093560422 learned_addr learned my addr 172.21.15.150:0/4093560422 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:44:06.125 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:06.122+0000 7fe633fff640 1 --2- 172.21.15.150:0/4093560422 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe6341527b0 0x7fe63409da80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:44:06.125 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:06.122+0000 7fe638db1640 1 --2- 172.21.15.150:0/4093560422 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe6340b3a80 0x7fe6341f4690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:44:06.125 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:06.122+0000 7fe6395b2640 1 -- 172.21.15.150:0/4093560422 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe6340b3a80 msgr2=0x7fe6341f4690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:44:06.125 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:06.122+0000 7fe6395b2640 1 --2- 172.21.15.150:0/4093560422 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe6340b3a80 0x7fe6341f4690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:06.125 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:06.122+0000 7fe6395b2640 1 -- 172.21.15.150:0/4093560422 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe6341527b0 msgr2=0x7fe63409da80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:44:06.126 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:06.122+0000 7fe6395b2640 1 --2- 172.21.15.150:0/4093560422 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe6341527b0 0x7fe63409da80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:06.126 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:06.122+0000 7fe6395b2640 1 -- 172.21.15.150:0/4093560422 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe6341f7720 con 0x7fe63415f310 2024-09-17T05:44:06.126 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:06.122+0000 7fe633fff640 1 --2- 172.21.15.150:0/4093560422 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe6341527b0 0x7fe63409da80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T05:44:06.126 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:06.122+0000 7fe6395b2640 1 --2- 172.21.15.150:0/4093560422 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe63415f310 0x7fe6341f71e0 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7fe62c00b9c0 tx=0x7fe62c00be80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:44:06.126 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:06.122+0000 7fe6317fa640 1 -- 172.21.15.150:0/4093560422 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe62c019070 con 0x7fe63415f310 2024-09-17T05:44:06.126 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:06.122+0000 7fe6317fa640 1 -- 172.21.15.150:0/4093560422 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe62c00cc90 con 0x7fe63415f310 2024-09-17T05:44:06.126 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:06.122+0000 7fe63b015640 1 -- 172.21.15.150:0/4093560422 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe6341f7c10 con 0x7fe63415f310 2024-09-17T05:44:06.126 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:06.122+0000 7fe6317fa640 1 -- 172.21.15.150:0/4093560422 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe62c0146a0 con 0x7fe63415f310 2024-09-17T05:44:06.126 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:06.123+0000 7fe63b015640 1 -- 172.21.15.150:0/4093560422 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe6341f3e90 con 0x7fe63415f310 2024-09-17T05:44:06.127 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:06.124+0000 7fe63b015640 1 -- 172.21.15.150:0/4093560422 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe6341f7980 con 0x7fe63415f310 2024-09-17T05:44:06.127 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:06.124+0000 7fe6317fa640 1 -- 172.21.15.150:0/4093560422 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 9) ==== 101747+0+0 (secure 0 0 0) 0x7fe62c01c070 con 0x7fe63415f310 2024-09-17T05:44:06.127 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:06.125+0000 7fe6317fa640 1 --2- 172.21.15.150:0/4093560422 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fe618078ef0 0x7fe61807b400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:44:06.127 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:06.125+0000 7fe6317fa640 1 -- 172.21.15.150:0/4093560422 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 5709+0+0 (secure 0 0 0) 0x7fe62c09b0a0 con 0x7fe63415f310 2024-09-17T05:44:06.127 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:06.125+0000 7fe638db1640 1 --2- 172.21.15.150:0/4093560422 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fe618078ef0 0x7fe61807b400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:44:06.127 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:06.126+0000 7fe638db1640 1 --2- 172.21.15.150:0/4093560422 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fe618078ef0 0x7fe61807b400 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fe6280015a0 tx=0x7fe628009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:44:06.131 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:06.129+0000 7fe6317fa640 1 -- 172.21.15.150:0/4093560422 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fe62c063060 con 0x7fe63415f310 2024-09-17T05:44:06.339 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:06.338+0000 7fe63b015640 1 -- 172.21.15.150:0/4093560422 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fe63415f720 con 0x7fe63415f310 2024-09-17T05:44:06.340 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:06.338+0000 7fe6317fa640 1 -- 172.21.15.150:0/4093560422 <== mon.0 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) ==== 94+0+5235 (secure 0 0 0) 0x7fe62c062960 con 0x7fe63415f310 2024-09-17T05:44:06.340 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-09-17T05:44:06.340 INFO:teuthology.orchestra.run.smithi150.stdout:{"epoch":25,"btime":"2024-09-17T05:44:05:983657+0000","default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5278,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6836/1460864883","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6834","nonce":1460864883},{"type":"v1","addr":"172.21.15.176:6836","nonce":1460864883}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":20},{"gid":5281,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6837/3149402402","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6835","nonce":3149402402},{"type":"v1","addr":"172.21.15.176:6837","nonce":3149402402}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":20},{"gid":5469,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6833/3082315470","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6832","nonce":3082315470},{"type":"v1","addr":"172.21.15.150:6833","nonce":3082315470}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":19}],"filesystems":[{"mdsmap":{"epoch":25,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T05:44:02.308071+0000","modified":"2024-09-17T05:44:05.353165+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5472},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5472":{"gid":5472,"name":"c","rank":0,"incarnation":21,"state":"up:active","state_seq":3,"addr":"172.21.15.150:6835/1137907102","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6834","nonce":1137907102},{"type":"v1","addr":"172.21.15.150:6835","nonce":1137907102}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5472,"qdb_cluster":[5472]},"id":3}]} 2024-09-17T05:44:06.340 INFO:teuthology.orchestra.run.smithi150.stderr:dumped fsmap epoch 25 2024-09-17T05:44:06.342 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:06.340+0000 7fe63b015640 1 -- 172.21.15.150:0/4093560422 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fe618078ef0 msgr2=0x7fe61807b400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:44:06.342 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:06.340+0000 7fe63b015640 1 --2- 172.21.15.150:0/4093560422 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fe618078ef0 0x7fe61807b400 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fe6280015a0 tx=0x7fe628009040 comp rx=0 tx=0).stop 2024-09-17T05:44:06.342 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:06.340+0000 7fe63b015640 1 -- 172.21.15.150:0/4093560422 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe63415f310 msgr2=0x7fe6341f71e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:44:06.342 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:06.340+0000 7fe63b015640 1 --2- 172.21.15.150:0/4093560422 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe63415f310 0x7fe6341f71e0 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7fe62c00b9c0 tx=0x7fe62c00be80 comp rx=0 tx=0).stop 2024-09-17T05:44:06.342 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:06.340+0000 7fe63b015640 1 -- 172.21.15.150:0/4093560422 shutdown_connections 2024-09-17T05:44:06.343 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:06.340+0000 7fe63b015640 1 --2- 172.21.15.150:0/4093560422 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe6341527b0 0x7fe63409da80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:06.343 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:06.341+0000 7fe63b015640 1 --2- 172.21.15.150:0/4093560422 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fe618078ef0 0x7fe61807b400 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:06.343 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:06.341+0000 7fe63b015640 1 --2- 172.21.15.150:0/4093560422 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe63415f310 0x7fe6341f71e0 unknown :-1 s=CLOSED pgs=450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:06.343 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:06.341+0000 7fe63b015640 1 --2- 172.21.15.150:0/4093560422 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe6340b3a80 0x7fe6341f4690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:06.343 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:06.341+0000 7fe63b015640 1 -- 172.21.15.150:0/4093560422 >> 172.21.15.150:0/4093560422 conn(0x7fe63406d730 msgr2=0x7fe6340b3e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:44:06.343 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:06.341+0000 7fe63b015640 1 -- 172.21.15.150:0/4093560422 shutdown_connections 2024-09-17T05:44:06.343 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:06.341+0000 7fe63b015640 1 -- 172.21.15.150:0/4093560422 wait complete. 2024-09-17T05:44:06.354 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T05:44:06.468 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:06.466+0000 7f8a6568b640 1 -- 172.21.15.150:0/2265748848 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8a600d0c50 msgr2=0x7f8a600d0010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:44:06.468 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:06.466+0000 7f8a6568b640 1 --2- 172.21.15.150:0/2265748848 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8a600d0c50 0x7f8a600d0010 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f8a50005fd0 tx=0x7f8a5002a670 comp rx=0 tx=0).stop 2024-09-17T05:44:06.469 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:06.466+0000 7f8a6568b640 1 -- 172.21.15.150:0/2265748848 shutdown_connections 2024-09-17T05:44:06.469 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:06.466+0000 7f8a6568b640 1 --2- 172.21.15.150:0/2265748848 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8a600d0c50 0x7f8a600d0010 unknown :-1 s=CLOSED pgs=452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:06.469 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:06.466+0000 7f8a6568b640 1 -- 172.21.15.150:0/2265748848 >> 172.21.15.150:0/2265748848 conn(0x7f8a600b3fc0 msgr2=0x7f8a600b43d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:44:06.469 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:06.466+0000 7f8a6568b640 1 -- 172.21.15.150:0/2265748848 shutdown_connections 2024-09-17T05:44:06.469 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:06.467+0000 7f8a6568b640 1 -- 172.21.15.150:0/2265748848 wait complete. 2024-09-17T05:44:06.469 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:06.468+0000 7f8a6568b640 1 Processor -- start 2024-09-17T05:44:06.470 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:06.468+0000 7f8a6568b640 1 -- start start 2024-09-17T05:44:06.472 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:06.469+0000 7f8a6568b640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8a600d0550 0x7f8a600afc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:44:06.472 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:06.469+0000 7f8a6568b640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8a600d0c50 0x7f8a601f3bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:44:06.472 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:06.469+0000 7f8a6568b640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8a600d1060 0x7f8a601f4110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:44:06.473 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:06.469+0000 7f8a6568b640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f8a600b1fd0 con 0x7f8a600d0c50 2024-09-17T05:44:06.473 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:06.469+0000 7f8a6568b640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f8a600ced80 con 0x7f8a600d1060 2024-09-17T05:44:06.473 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:06.469+0000 7f8a6568b640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f8a600b2150 con 0x7f8a600d0550 2024-09-17T05:44:06.473 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:06.470+0000 7f8a57fff640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8a600d0c50 0x7f8a601f3bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:44:06.473 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:06.470+0000 7f8a57fff640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8a600d0c50 0x7f8a601f3bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:43144/0 (socket says 172.21.15.150:43144) 2024-09-17T05:44:06.473 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:06.470+0000 7f8a57fff640 1 -- 172.21.15.150:0/1610638825 learned_addr learned my addr 172.21.15.150:0/1610638825 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:44:06.473 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:06.470+0000 7f8a5effd640 1 --2- 172.21.15.150:0/1610638825 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8a600d0550 0x7f8a600afc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:44:06.473 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:06.470+0000 7f8a5f7fe640 1 --2- 172.21.15.150:0/1610638825 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8a600d1060 0x7f8a601f4110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:44:06.473 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:06.470+0000 7f8a57fff640 1 -- 172.21.15.150:0/1610638825 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8a600d0550 msgr2=0x7f8a600afc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:44:06.473 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:06.470+0000 7f8a57fff640 1 --2- 172.21.15.150:0/1610638825 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8a600d0550 0x7f8a600afc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:06.473 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:06.470+0000 7f8a57fff640 1 -- 172.21.15.150:0/1610638825 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8a600d1060 msgr2=0x7f8a601f4110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:44:06.473 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:06.470+0000 7f8a57fff640 1 --2- 172.21.15.150:0/1610638825 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8a600d1060 0x7f8a601f4110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:06.474 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:06.470+0000 7f8a57fff640 1 -- 172.21.15.150:0/1610638825 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8a601f4920 con 0x7f8a600d0c50 2024-09-17T05:44:06.474 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:06.470+0000 7f8a57fff640 1 --2- 172.21.15.150:0/1610638825 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8a600d0c50 0x7f8a601f3bd0 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f8a4800b3e0 tx=0x7f8a4800b8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:44:06.474 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:06.470+0000 7f8a577fe640 1 -- 172.21.15.150:0/1610638825 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a48015020 con 0x7f8a600d0c50 2024-09-17T05:44:06.474 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:06.470+0000 7f8a577fe640 1 -- 172.21.15.150:0/1610638825 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8a48011920 con 0x7f8a600d0c50 2024-09-17T05:44:06.474 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:06.470+0000 7f8a6568b640 1 -- 172.21.15.150:0/1610638825 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8a600b53a0 con 0x7f8a600d0c50 2024-09-17T05:44:06.474 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:06.470+0000 7f8a577fe640 1 -- 172.21.15.150:0/1610638825 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a48011d70 con 0x7f8a600d0c50 2024-09-17T05:44:06.474 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:06.470+0000 7f8a6568b640 1 -- 172.21.15.150:0/1610638825 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8a600b5960 con 0x7f8a600d0c50 2024-09-17T05:44:06.475 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:06.471+0000 7f8a6568b640 1 -- 172.21.15.150:0/1610638825 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8a600d0010 con 0x7f8a600d0c50 2024-09-17T05:44:06.475 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:06.472+0000 7f8a577fe640 1 -- 172.21.15.150:0/1610638825 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 9) ==== 101747+0+0 (secure 0 0 0) 0x7f8a48018020 con 0x7f8a600d0c50 2024-09-17T05:44:06.475 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:06.473+0000 7f8a577fe640 1 --2- 172.21.15.150:0/1610638825 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f8a40078ef0 0x7f8a4007b400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:44:06.475 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:06.473+0000 7f8a577fe640 1 -- 172.21.15.150:0/1610638825 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 5709+0+0 (secure 0 0 0) 0x7f8a4809b1e0 con 0x7f8a600d0c50 2024-09-17T05:44:06.475 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:06.473+0000 7f8a5effd640 1 --2- 172.21.15.150:0/1610638825 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f8a40078ef0 0x7f8a4007b400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:44:06.475 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:06.474+0000 7f8a5effd640 1 --2- 172.21.15.150:0/1610638825 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f8a40078ef0 0x7f8a4007b400 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f8a50033000 tx=0x7f8a50004730 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:44:06.479 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:06.477+0000 7f8a577fe640 1 -- 172.21.15.150:0/1610638825 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f8a4801f020 con 0x7f8a600d0c50 2024-09-17T05:44:06.658 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:06.657+0000 7f8a6568b640 1 -- 172.21.15.150:0/1610638825 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f8a601f46b0 con 0x7f8a600d0c50 2024-09-17T05:44:06.660 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:06.658+0000 7f8a577fe640 1 -- 172.21.15.150:0/1610638825 <== mon.0 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v45) ==== 74+0+16709 (secure 0 0 0) 0x7f8a48062ab0 con 0x7f8a600d0c50 2024-09-17T05:44:06.660 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-09-17T05:44:06.660 INFO:teuthology.orchestra.run.smithi150.stdout:{"epoch":45,"fsid":"9f2e05e9-d629-47b3-b26b-1360655b7d20","created":"2024-09-17T05:41:32.502979+0000","modified":"2024-09-17T05:44:03.962519+0000","last_up_change":"2024-09-17T05:41:46.150225+0000","last_in_change":"2024-09-17T05:41:36.120274+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T05:41:46.860779+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2024-09-17T05:43:59.949433+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"44","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_data","create_time":"2024-09-17T05:44:01.270712+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"45","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"4f31c018-c8a4-4d6d-b0c2-a597c47aae4a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6800","nonce":479374392},{"type":"v1","addr":"172.21.15.150:6801","nonce":479374392}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6802","nonce":479374392},{"type":"v1","addr":"172.21.15.150:6803","nonce":479374392}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6806","nonce":479374392},{"type":"v1","addr":"172.21.15.150:6807","nonce":479374392}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6804","nonce":479374392},{"type":"v1","addr":"172.21.15.150:6805","nonce":479374392}]},"public_addr":"172.21.15.150:6801/479374392","cluster_addr":"172.21.15.150:6803/479374392","heartbeat_back_addr":"172.21.15.150:6807/479374392","heartbeat_front_addr":"172.21.15.150:6805/479374392","state":["exists","up"]},{"osd":1,"uuid":"6ff4a573-500b-4e04-9de3-39265ead78b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6824","nonce":913899800},{"type":"v1","addr":"172.21.15.150:6825","nonce":913899800}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6826","nonce":913899800},{"type":"v1","addr":"172.21.15.150:6827","nonce":913899800}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6830","nonce":913899800},{"type":"v1","addr":"172.21.15.150:6831","nonce":913899800}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6828","nonce":913899800},{"type":"v1","addr":"172.21.15.150:6829","nonce":913899800}]},"public_addr":"172.21.15.150:6825/913899800","cluster_addr":"172.21.15.150:6827/913899800","heartbeat_back_addr":"172.21.15.150:6831/913899800","heartbeat_front_addr":"172.21.15.150:6829/913899800","state":["exists","up"]},{"osd":2,"uuid":"bffea6f9-2465-4182-b205-00436c41ac1c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6816","nonce":363718461},{"type":"v1","addr":"172.21.15.150:6817","nonce":363718461}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6818","nonce":363718461},{"type":"v1","addr":"172.21.15.150:6819","nonce":363718461}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6822","nonce":363718461},{"type":"v1","addr":"172.21.15.150:6823","nonce":363718461}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6820","nonce":363718461},{"type":"v1","addr":"172.21.15.150:6821","nonce":363718461}]},"public_addr":"172.21.15.150:6817/363718461","cluster_addr":"172.21.15.150:6819/363718461","heartbeat_back_addr":"172.21.15.150:6823/363718461","heartbeat_front_addr":"172.21.15.150:6821/363718461","state":["exists","up"]},{"osd":3,"uuid":"cda70430-d1e1-427e-b04e-56db4031d078","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6808","nonce":3550994626},{"type":"v1","addr":"172.21.15.150:6809","nonce":3550994626}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6810","nonce":3550994626},{"type":"v1","addr":"172.21.15.150:6811","nonce":3550994626}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6814","nonce":3550994626},{"type":"v1","addr":"172.21.15.150:6815","nonce":3550994626}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6812","nonce":3550994626},{"type":"v1","addr":"172.21.15.150:6813","nonce":3550994626}]},"public_addr":"172.21.15.150:6809/3550994626","cluster_addr":"172.21.15.150:6811/3550994626","heartbeat_back_addr":"172.21.15.150:6815/3550994626","heartbeat_front_addr":"172.21.15.150:6813/3550994626","state":["exists","up"]},{"osd":4,"uuid":"3a0277fb-5e1e-4f68-bb2d-9a8a0152f64a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6810","nonce":2718261497},{"type":"v1","addr":"172.21.15.176:6811","nonce":2718261497}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6812","nonce":2718261497},{"type":"v1","addr":"172.21.15.176:6813","nonce":2718261497}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6816","nonce":2718261497},{"type":"v1","addr":"172.21.15.176:6817","nonce":2718261497}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6814","nonce":2718261497},{"type":"v1","addr":"172.21.15.176:6815","nonce":2718261497}]},"public_addr":"172.21.15.176:6811/2718261497","cluster_addr":"172.21.15.176:6813/2718261497","heartbeat_back_addr":"172.21.15.176:6817/2718261497","heartbeat_front_addr":"172.21.15.176:6815/2718261497","state":["exists","up"]},{"osd":5,"uuid":"33aebee6-0315-40b7-a11c-6702f0be494d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6818","nonce":2049295774},{"type":"v1","addr":"172.21.15.176:6819","nonce":2049295774}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6820","nonce":2049295774},{"type":"v1","addr":"172.21.15.176:6821","nonce":2049295774}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6824","nonce":2049295774},{"type":"v1","addr":"172.21.15.176:6825","nonce":2049295774}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6822","nonce":2049295774},{"type":"v1","addr":"172.21.15.176:6823","nonce":2049295774}]},"public_addr":"172.21.15.176:6819/2049295774","cluster_addr":"172.21.15.176:6821/2049295774","heartbeat_back_addr":"172.21.15.176:6825/2049295774","heartbeat_front_addr":"172.21.15.176:6823/2049295774","state":["exists","up"]},{"osd":6,"uuid":"4d24f360-6751-4263-841b-d77793d33540","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6826","nonce":2164458476},{"type":"v1","addr":"172.21.15.176:6827","nonce":2164458476}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6828","nonce":2164458476},{"type":"v1","addr":"172.21.15.176:6829","nonce":2164458476}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6832","nonce":2164458476},{"type":"v1","addr":"172.21.15.176:6833","nonce":2164458476}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6830","nonce":2164458476},{"type":"v1","addr":"172.21.15.176:6831","nonce":2164458476}]},"public_addr":"172.21.15.176:6827/2164458476","cluster_addr":"172.21.15.176:6829/2164458476","heartbeat_back_addr":"172.21.15.176:6833/2164458476","heartbeat_front_addr":"172.21.15.176:6831/2164458476","state":["exists","up"]},{"osd":7,"uuid":"c8594fda-c74a-4ba9-8277-caf101d58ca1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6802","nonce":3239587708},{"type":"v1","addr":"172.21.15.176:6803","nonce":3239587708}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6804","nonce":3239587708},{"type":"v1","addr":"172.21.15.176:6805","nonce":3239587708}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6808","nonce":3239587708},{"type":"v1","addr":"172.21.15.176:6809","nonce":3239587708}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6806","nonce":3239587708},{"type":"v1","addr":"172.21.15.176:6807","nonce":3239587708}]},"public_addr":"172.21.15.176:6803/3239587708","cluster_addr":"172.21.15.176:6805/3239587708","heartbeat_back_addr":"172.21.15.176:6809/3239587708","heartbeat_front_addr":"172.21.15.176:6807/3239587708","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:41:41.905151+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:41:42.705679+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:41:42.459673+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:41:42.440819+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:41:42.668428+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:41:42.694972+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:41:43.078535+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:41:42.363539+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T05:44:06.662 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:06.660+0000 7f8a6568b640 1 -- 172.21.15.150:0/1610638825 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f8a40078ef0 msgr2=0x7f8a4007b400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:44:06.662 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:06.660+0000 7f8a6568b640 1 --2- 172.21.15.150:0/1610638825 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f8a40078ef0 0x7f8a4007b400 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f8a50033000 tx=0x7f8a50004730 comp rx=0 tx=0).stop 2024-09-17T05:44:06.662 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:06.660+0000 7f8a6568b640 1 -- 172.21.15.150:0/1610638825 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8a600d0c50 msgr2=0x7f8a601f3bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:44:06.662 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:06.660+0000 7f8a6568b640 1 --2- 172.21.15.150:0/1610638825 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8a600d0c50 0x7f8a601f3bd0 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f8a4800b3e0 tx=0x7f8a4800b8a0 comp rx=0 tx=0).stop 2024-09-17T05:44:06.662 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:06.660+0000 7f8a6568b640 1 -- 172.21.15.150:0/1610638825 shutdown_connections 2024-09-17T05:44:06.663 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:06.660+0000 7f8a6568b640 1 --2- 172.21.15.150:0/1610638825 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8a600d1060 0x7f8a601f4110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:06.663 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:06.660+0000 7f8a6568b640 1 --2- 172.21.15.150:0/1610638825 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f8a40078ef0 0x7f8a4007b400 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:06.663 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:06.660+0000 7f8a6568b640 1 --2- 172.21.15.150:0/1610638825 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8a600d0c50 0x7f8a601f3bd0 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:06.663 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:06.660+0000 7f8a6568b640 1 --2- 172.21.15.150:0/1610638825 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8a600d0550 0x7f8a600afc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:06.663 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:06.660+0000 7f8a6568b640 1 -- 172.21.15.150:0/1610638825 >> 172.21.15.150:0/1610638825 conn(0x7f8a600b3fc0 msgr2=0x7f8a6015d910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:44:06.663 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:06.660+0000 7f8a6568b640 1 -- 172.21.15.150:0/1610638825 shutdown_connections 2024-09-17T05:44:06.663 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:06.660+0000 7f8a6568b640 1 -- 172.21.15.150:0/1610638825 wait complete. 2024-09-17T05:44:06.674 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-17T05:44:06.674 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-17T05:44:06.788 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:06.786+0000 7fad0ab51640 1 -- 172.21.15.150:0/1996763340 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fad040d0c50 msgr2=0x7fad040d0010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:44:06.788 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:06.786+0000 7fad0ab51640 1 --2- 172.21.15.150:0/1996763340 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fad040d0c50 0x7fad040d0010 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7fad00005fd0 tx=0x7fad0002a5c0 comp rx=0 tx=0).stop 2024-09-17T05:44:06.789 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:06.786+0000 7fad0ab51640 1 -- 172.21.15.150:0/1996763340 shutdown_connections 2024-09-17T05:44:06.789 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:06.786+0000 7fad0ab51640 1 --2- 172.21.15.150:0/1996763340 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fad040d0550 0x7fad040b18c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:06.789 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:06.786+0000 7fad0ab51640 1 --2- 172.21.15.150:0/1996763340 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fad040d0c50 0x7fad040d0010 unknown :-1 s=CLOSED pgs=454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:06.789 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:06.786+0000 7fad0ab51640 1 -- 172.21.15.150:0/1996763340 >> 172.21.15.150:0/1996763340 conn(0x7fad040b3fc0 msgr2=0x7fad040b43d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:44:06.789 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:06.786+0000 7fad0ab51640 1 -- 172.21.15.150:0/1996763340 shutdown_connections 2024-09-17T05:44:06.789 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:06.786+0000 7fad0ab51640 1 -- 172.21.15.150:0/1996763340 wait complete. 2024-09-17T05:44:06.789 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:06.788+0000 7fad0ab51640 1 Processor -- start 2024-09-17T05:44:06.790 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:06.788+0000 7fad0ab51640 1 -- start start 2024-09-17T05:44:06.793 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:06.790+0000 7fad0ab51640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fad040d0550 0x7fad040c8a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:44:06.793 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:06.790+0000 7fad0ab51640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fad040d0c50 0x7fad040ca9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:44:06.793 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:06.790+0000 7fad0ab51640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fad040d1060 0x7fad040caf20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:44:06.793 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:06.790+0000 7fad0ab51640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7fad040ced80 con 0x7fad040d0c50 2024-09-17T05:44:06.793 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:06.790+0000 7fad0ab51640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fad040cd130 con 0x7fad040d0550 2024-09-17T05:44:06.793 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:06.790+0000 7fad0ab51640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fad040c8470 con 0x7fad040d1060 2024-09-17T05:44:06.793 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:06.790+0000 7facfbfff640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fad040d0c50 0x7fad040ca9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:44:06.793 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:06.790+0000 7facfbfff640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fad040d0c50 0x7fad040ca9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:43152/0 (socket says 172.21.15.150:43152) 2024-09-17T05:44:06.793 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:06.790+0000 7facfbfff640 1 -- 172.21.15.150:0/669751743 learned_addr learned my addr 172.21.15.150:0/669751743 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:44:06.793 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:06.790+0000 7fad090ee640 1 --2- 172.21.15.150:0/669751743 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fad040d1060 0x7fad040caf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:44:06.793 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:06.790+0000 7fad088ed640 1 --2- 172.21.15.150:0/669751743 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fad040d0550 0x7fad040c8a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:44:06.794 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:06.790+0000 7facfbfff640 1 -- 172.21.15.150:0/669751743 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fad040d1060 msgr2=0x7fad040caf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:44:06.794 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:06.790+0000 7facfbfff640 1 --2- 172.21.15.150:0/669751743 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fad040d1060 0x7fad040caf20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:06.794 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:06.790+0000 7facfbfff640 1 -- 172.21.15.150:0/669751743 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fad040d0550 msgr2=0x7fad040c8a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:44:06.794 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:06.790+0000 7facfbfff640 1 --2- 172.21.15.150:0/669751743 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fad040d0550 0x7fad040c8a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:06.794 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:06.790+0000 7facfbfff640 1 -- 172.21.15.150:0/669751743 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fad041f7e20 con 0x7fad040d0c50 2024-09-17T05:44:06.794 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:06.790+0000 7fad088ed640 1 --2- 172.21.15.150:0/669751743 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fad040d0550 0x7fad040c8a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T05:44:06.794 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:06.790+0000 7facfbfff640 1 --2- 172.21.15.150:0/669751743 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fad040d0c50 0x7fad040ca9e0 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7facf400d6a0 tx=0x7facf400db60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:44:06.794 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:06.790+0000 7facf97fa640 1 -- 172.21.15.150:0/669751743 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7facf4017070 con 0x7fad040d0c50 2024-09-17T05:44:06.794 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:06.790+0000 7facf97fa640 1 -- 172.21.15.150:0/669751743 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7facf4009b10 con 0x7fad040d0c50 2024-09-17T05:44:06.794 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:06.790+0000 7facf97fa640 1 -- 172.21.15.150:0/669751743 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7facf4010460 con 0x7fad040d0c50 2024-09-17T05:44:06.794 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:06.790+0000 7fad0ab51640 1 -- 172.21.15.150:0/669751743 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fad041f3a90 con 0x7fad040d0c50 2024-09-17T05:44:06.794 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:06.791+0000 7fad0ab51640 1 -- 172.21.15.150:0/669751743 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fad041f3d30 con 0x7fad040d0c50 2024-09-17T05:44:06.795 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:06.791+0000 7fad0ab51640 1 -- 172.21.15.150:0/669751743 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fad040d0010 con 0x7fad040d0c50 2024-09-17T05:44:06.795 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:06.792+0000 7facf97fa640 1 -- 172.21.15.150:0/669751743 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 9) ==== 101747+0+0 (secure 0 0 0) 0x7facf401a070 con 0x7fad040d0c50 2024-09-17T05:44:06.795 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:06.793+0000 7facf97fa640 1 --2- 172.21.15.150:0/669751743 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7facf0078ef0 0x7facf007b400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:44:06.795 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:06.793+0000 7facf97fa640 1 -- 172.21.15.150:0/669751743 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 5709+0+0 (secure 0 0 0) 0x7facf409b550 con 0x7fad040d0c50 2024-09-17T05:44:06.796 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:06.793+0000 7fad088ed640 1 --2- 172.21.15.150:0/669751743 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7facf0078ef0 0x7facf007b400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:44:06.796 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:06.793+0000 7fad088ed640 1 --2- 172.21.15.150:0/669751743 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7facf0078ef0 0x7facf007b400 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fad00033000 tx=0x7fad00004730 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:44:06.798 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:06.797+0000 7facf97fa640 1 -- 172.21.15.150:0/669751743 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7facf4063400 con 0x7fad040d0c50 2024-09-17T05:44:06.971 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:06.970+0000 7fad0ab51640 1 -- 172.21.15.150:0/669751743 --> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fad041f4250 con 0x7facf0078ef0 2024-09-17T05:44:06.976 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:06.975+0000 7facf97fa640 1 -- 172.21.15.150:0/669751743 <== mgr.4108 v2:172.21.15.176:6800/3631216395 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+250970 (secure 0 0 0) 0x7fad000055f0 con 0x7facf0078ef0 2024-09-17T05:44:06.980 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-09-17T05:44:06.981 INFO:teuthology.orchestra.run.smithi150.stderr:dumped all 2024-09-17T05:44:06.983 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:06.978+0000 7fad0ab51640 1 -- 172.21.15.150:0/669751743 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7facf0078ef0 msgr2=0x7facf007b400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:44:06.983 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:06.978+0000 7fad0ab51640 1 --2- 172.21.15.150:0/669751743 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7facf0078ef0 0x7facf007b400 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fad00033000 tx=0x7fad00004730 comp rx=0 tx=0).stop 2024-09-17T05:44:06.983 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:06.978+0000 7fad0ab51640 1 -- 172.21.15.150:0/669751743 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fad040d0c50 msgr2=0x7fad040ca9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:44:06.983 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:06.978+0000 7fad0ab51640 1 --2- 172.21.15.150:0/669751743 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fad040d0c50 0x7fad040ca9e0 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7facf400d6a0 tx=0x7facf400db60 comp rx=0 tx=0).stop 2024-09-17T05:44:06.983 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:06.978+0000 7fad0ab51640 1 -- 172.21.15.150:0/669751743 shutdown_connections 2024-09-17T05:44:06.983 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:06.978+0000 7fad0ab51640 1 --2- 172.21.15.150:0/669751743 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7facf0078ef0 0x7facf007b400 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:06.983 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:06.978+0000 7fad0ab51640 1 --2- 172.21.15.150:0/669751743 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fad040d1060 0x7fad040caf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:06.983 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:06.978+0000 7fad0ab51640 1 --2- 172.21.15.150:0/669751743 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fad040d0c50 0x7fad040ca9e0 unknown :-1 s=CLOSED pgs=455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:06.983 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:06.978+0000 7fad0ab51640 1 --2- 172.21.15.150:0/669751743 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fad040d0550 0x7fad040c8a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:06.983 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:06.978+0000 7fad0ab51640 1 -- 172.21.15.150:0/669751743 >> 172.21.15.150:0/669751743 conn(0x7fad040b3fc0 msgr2=0x7fad040729d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:44:06.984 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:06.978+0000 7fad0ab51640 1 -- 172.21.15.150:0/669751743 shutdown_connections 2024-09-17T05:44:06.984 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:06.978+0000 7fad0ab51640 1 -- 172.21.15.150:0/669751743 wait complete. 2024-09-17T05:44:06.991 INFO:teuthology.orchestra.run.smithi150.stdout:{"pg_ready":true,"pg_map":{"version":110,"stamp":"2024-09-17T05:44:06.879800+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":146,"num_write_kb":1642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":111,"ondisk_log_size":111,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":140,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":254728,"kb_used_data":5204,"kb_used_omap":12,"kb_used_meta":249331,"kb_avail":754719992,"statfs":{"total":773094113280,"available":772833271808,"internally_reserved":0,"allocated":5328896,"data_stored":2811821,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":255315504},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":34,"apply_latency_ms":34,"commit_latency_ns":34000000,"apply_latency_ns":34000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.947889"},"pg_stats":[{"pgid":"7.3f","version":"0'0","reported_seq":13,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T05:44:05.415186+0000","last_change":"2024-09-17T05:44:02.974554+0000","last_active":"2024-09-17T05:44:05.415186+0000","last_peered":"2024-09-17T05:44:05.415186+0000","last_clean":"2024-09-17T05:44:05.415186+0000","last_became_active":"2024-09-17T05:44:02.974231+0000","last_became_peered":"2024-09-17T05:44:02.974231+0000","last_unstale":"2024-09-17T05:44:05.415186+0000","last_undegraded":"2024-09-17T05:44:05.415186+0000","last_fullsized":"2024-09-17T05:44:05.415186+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:44:01.930501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:44:01.930501+0000","last_clean_scrub_stamp":"2024-09-17T05:44:01.930501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:47:00.250341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3e","version":"0'0","reported_seq":13,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T05:44:05.659404+0000","last_change":"2024-09-17T05:44:02.988339+0000","last_active":"2024-09-17T05:44:05.659404+0000","last_peered":"2024-09-17T05:44:05.659404+0000","last_clean":"2024-09-17T05:44:05.659404+0000","last_became_active":"2024-09-17T05:44:02.987682+0000","last_became_peered":"2024-09-17T05:44:02.987682+0000","last_unstale":"2024-09-17T05:44:05.659404+0000","last_undegraded":"2024-09-17T05:44:05.659404+0000","last_fullsized":"2024-09-17T05:44:05.659404+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:44:01.930501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:44:01.930501+0000","last_clean_scrub_stamp":"2024-09-17T05:44:01.930501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:28:30.401981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3d","version":"0'0","reported_seq":13,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T05:44:04.970610+0000","last_change":"2024-09-17T05:44:02.971036+0000","last_active":"2024-09-17T05:44:04.970610+0000","last_peered":"2024-09-17T05:44:04.970610+0000","last_clean":"2024-09-17T05:44:04.970610+0000","last_became_active":"2024-09-17T05:44:02.970669+0000","last_became_peered":"2024-09-17T05:44:02.970669+0000","last_unstale":"2024-09-17T05:44:04.970610+0000","last_undegraded":"2024-09-17T05:44:04.970610+0000","last_fullsized":"2024-09-17T05:44:04.970610+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:44:01.930501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:44:01.930501+0000","last_clean_scrub_stamp":"2024-09-17T05:44:01.930501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:21:11.719829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3c","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:44:02.986117+0000","last_change":"2024-09-17T05:44:02.975046+0000","last_active":"2024-09-17T05:44:02.986117+0000","last_peered":"2024-09-17T05:44:02.986117+0000","last_clean":"2024-09-17T05:44:02.986117+0000","last_became_active":"2024-09-17T05:44:02.973872+0000","last_became_peered":"2024-09-17T05:44:02.973872+0000","last_unstale":"2024-09-17T05:44:02.986117+0000","last_undegraded":"2024-09-17T05:44:02.986117+0000","last_fullsized":"2024-09-17T05:44:02.986117+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:44:01.930501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:44:01.930501+0000","last_clean_scrub_stamp":"2024-09-17T05:44:01.930501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:23:39.449652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3b","version":"0'0","reported_seq":13,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T05:44:05.659101+0000","last_change":"2024-09-17T05:44:02.987062+0000","last_active":"2024-09-17T05:44:05.659101+0000","last_peered":"2024-09-17T05:44:05.659101+0000","last_clean":"2024-09-17T05:44:05.659101+0000","last_became_active":"2024-09-17T05:44:02.986714+0000","last_became_peered":"2024-09-17T05:44:02.986714+0000","last_unstale":"2024-09-17T05:44:05.659101+0000","last_undegraded":"2024-09-17T05:44:05.659101+0000","last_fullsized":"2024-09-17T05:44:05.659101+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:44:01.930501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:44:01.930501+0000","last_clean_scrub_stamp":"2024-09-17T05:44:01.930501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:42:40.168866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3a","version":"0'0","reported_seq":13,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T05:44:03.970509+0000","last_change":"2024-09-17T05:44:02.967402+0000","last_active":"2024-09-17T05:44:03.970509+0000","last_peered":"2024-09-17T05:44:03.970509+0000","last_clean":"2024-09-17T05:44:03.970509+0000","last_became_active":"2024-09-17T05:44:02.967118+0000","last_became_peered":"2024-09-17T05:44:02.967118+0000","last_unstale":"2024-09-17T05:44:03.970509+0000","last_undegraded":"2024-09-17T05:44:03.970509+0000","last_fullsized":"2024-09-17T05:44:03.970509+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:44:01.930501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:44:01.930501+0000","last_clean_scrub_stamp":"2024-09-17T05:44:01.930501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:42:22.361286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.39","version":"0'0","reported_seq":13,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T05:44:05.414847+0000","last_change":"2024-09-17T05:44:02.964592+0000","last_active":"2024-09-17T05:44:05.414847+0000","last_peered":"2024-09-17T05:44:05.414847+0000","last_clean":"2024-09-17T05:44:05.414847+0000","last_became_active":"2024-09-17T05:44:02.964316+0000","last_became_peered":"2024-09-17T05:44:02.964316+0000","last_unstale":"2024-09-17T05:44:05.414847+0000","last_undegraded":"2024-09-17T05:44:05.414847+0000","last_fullsized":"2024-09-17T05:44:05.414847+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:44:01.930501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:44:01.930501+0000","last_clean_scrub_stamp":"2024-09-17T05:44:01.930501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:18:09.625824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.38","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:44:02.993116+0000","last_change":"2024-09-17T05:44:02.988346+0000","last_active":"2024-09-17T05:44:02.993116+0000","last_peered":"2024-09-17T05:44:02.993116+0000","last_clean":"2024-09-17T05:44:02.993116+0000","last_became_active":"2024-09-17T05:44:02.987992+0000","last_became_peered":"2024-09-17T05:44:02.987992+0000","last_unstale":"2024-09-17T05:44:02.993116+0000","last_undegraded":"2024-09-17T05:44:02.993116+0000","last_fullsized":"2024-09-17T05:44:02.993116+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:44:01.930501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:44:01.930501+0000","last_clean_scrub_stamp":"2024-09-17T05:44:01.930501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:50:42.000977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.37","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:44:02.983745+0000","last_change":"2024-09-17T05:44:02.967050+0000","last_active":"2024-09-17T05:44:02.983745+0000","last_peered":"2024-09-17T05:44:02.983745+0000","last_clean":"2024-09-17T05:44:02.983745+0000","last_became_active":"2024-09-17T05:44:02.966728+0000","last_became_peered":"2024-09-17T05:44:02.966728+0000","last_unstale":"2024-09-17T05:44:02.983745+0000","last_undegraded":"2024-09-17T05:44:02.983745+0000","last_fullsized":"2024-09-17T05:44:02.983745+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:44:01.930501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:44:01.930501+0000","last_clean_scrub_stamp":"2024-09-17T05:44:01.930501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:52:36.822899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.36","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:44:02.986190+0000","last_change":"2024-09-17T05:44:02.975494+0000","last_active":"2024-09-17T05:44:02.986190+0000","last_peered":"2024-09-17T05:44:02.986190+0000","last_clean":"2024-09-17T05:44:02.986190+0000","last_became_active":"2024-09-17T05:44:02.975170+0000","last_became_peered":"2024-09-17T05:44:02.975170+0000","last_unstale":"2024-09-17T05:44:02.986190+0000","last_undegraded":"2024-09-17T05:44:02.986190+0000","last_fullsized":"2024-09-17T05:44:02.986190+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:44:01.930501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:44:01.930501+0000","last_clean_scrub_stamp":"2024-09-17T05:44:01.930501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:24:41.631032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.35","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:44:02.986369+0000","last_change":"2024-09-17T05:44:02.975023+0000","last_active":"2024-09-17T05:44:02.986369+0000","last_peered":"2024-09-17T05:44:02.986369+0000","last_clean":"2024-09-17T05:44:02.986369+0000","last_became_active":"2024-09-17T05:44:02.974597+0000","last_became_peered":"2024-09-17T05:44:02.974597+0000","last_unstale":"2024-09-17T05:44:02.986369+0000","last_undegraded":"2024-09-17T05:44:02.986369+0000","last_fullsized":"2024-09-17T05:44:02.986369+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:44:01.930501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:44:01.930501+0000","last_clean_scrub_stamp":"2024-09-17T05:44:01.930501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:23:02.419379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.34","version":"0'0","reported_seq":13,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T05:44:05.659346+0000","last_change":"2024-09-17T05:44:02.983676+0000","last_active":"2024-09-17T05:44:05.659346+0000","last_peered":"2024-09-17T05:44:05.659346+0000","last_clean":"2024-09-17T05:44:05.659346+0000","last_became_active":"2024-09-17T05:44:02.983071+0000","last_became_peered":"2024-09-17T05:44:02.983071+0000","last_unstale":"2024-09-17T05:44:05.659346+0000","last_undegraded":"2024-09-17T05:44:05.659346+0000","last_fullsized":"2024-09-17T05:44:05.659346+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:44:01.930501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:44:01.930501+0000","last_clean_scrub_stamp":"2024-09-17T05:44:01.930501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:45:10.615693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.33","version":"0'0","reported_seq":13,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T05:44:03.970768+0000","last_change":"2024-09-17T05:44:02.976306+0000","last_active":"2024-09-17T05:44:03.970768+0000","last_peered":"2024-09-17T05:44:03.970768+0000","last_clean":"2024-09-17T05:44:03.970768+0000","last_became_active":"2024-09-17T05:44:02.975950+0000","last_became_peered":"2024-09-17T05:44:02.975950+0000","last_unstale":"2024-09-17T05:44:03.970768+0000","last_undegraded":"2024-09-17T05:44:03.970768+0000","last_fullsized":"2024-09-17T05:44:03.970768+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:44:01.930501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:44:01.930501+0000","last_clean_scrub_stamp":"2024-09-17T05:44:01.930501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:16:15.916655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.32","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:44:02.983744+0000","last_change":"2024-09-17T05:44:02.964776+0000","last_active":"2024-09-17T05:44:02.983744+0000","last_peered":"2024-09-17T05:44:02.983744+0000","last_clean":"2024-09-17T05:44:02.983744+0000","last_became_active":"2024-09-17T05:44:02.964467+0000","last_became_peered":"2024-09-17T05:44:02.964467+0000","last_unstale":"2024-09-17T05:44:02.983744+0000","last_undegraded":"2024-09-17T05:44:02.983744+0000","last_fullsized":"2024-09-17T05:44:02.983744+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:44:01.930501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:44:01.930501+0000","last_clean_scrub_stamp":"2024-09-17T05:44:01.930501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:58:37.326070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.31","version":"0'0","reported_seq":13,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T05:44:03.970324+0000","last_change":"2024-09-17T05:44:02.973423+0000","last_active":"2024-09-17T05:44:03.970324+0000","last_peered":"2024-09-17T05:44:03.970324+0000","last_clean":"2024-09-17T05:44:03.970324+0000","last_became_active":"2024-09-17T05:44:02.973088+0000","last_became_peered":"2024-09-17T05:44:02.973088+0000","last_unstale":"2024-09-17T05:44:03.970324+0000","last_undegraded":"2024-09-17T05:44:03.970324+0000","last_fullsized":"2024-09-17T05:44:03.970324+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:44:01.930501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:44:01.930501+0000","last_clean_scrub_stamp":"2024-09-17T05:44:01.930501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:48:33.128790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.30","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-09-17T05:44:01.946541+0000","last_change":"2024-09-17T05:44:01.946541+0000","last_active":"2024-09-17T05:44:01.930501+0000","last_peered":"2024-09-17T05:44:01.930501+0000","last_clean":"2024-09-17T05:44:01.930501+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:44:01.946541+0000","last_undegraded":"2024-09-17T05:44:01.946541+0000","last_fullsized":"2024-09-17T05:44:01.946541+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:44:01.930501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:44:01.930501+0000","last_clean_scrub_stamp":"2024-09-17T05:44:01.930501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.2f","version":"0'0","reported_seq":13,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T05:44:04.970797+0000","last_change":"2024-09-17T05:44:02.980385+0000","last_active":"2024-09-17T05:44:04.970797+0000","last_peered":"2024-09-17T05:44:04.970797+0000","last_clean":"2024-09-17T05:44:04.970797+0000","last_became_active":"2024-09-17T05:44:02.979899+0000","last_became_peered":"2024-09-17T05:44:02.979899+0000","last_unstale":"2024-09-17T05:44:04.970797+0000","last_undegraded":"2024-09-17T05:44:04.970797+0000","last_fullsized":"2024-09-17T05:44:04.970797+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:44:01.930501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:44:01.930501+0000","last_clean_scrub_stamp":"2024-09-17T05:44:01.930501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:06:08.980606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2e","version":"0'0","reported_seq":13,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T05:44:04.971126+0000","last_change":"2024-09-17T05:44:02.987933+0000","last_active":"2024-09-17T05:44:04.971126+0000","last_peered":"2024-09-17T05:44:04.971126+0000","last_clean":"2024-09-17T05:44:04.971126+0000","last_became_active":"2024-09-17T05:44:02.986841+0000","last_became_peered":"2024-09-17T05:44:02.986841+0000","last_unstale":"2024-09-17T05:44:04.971126+0000","last_undegraded":"2024-09-17T05:44:04.971126+0000","last_fullsized":"2024-09-17T05:44:04.971126+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:44:01.930501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:44:01.930501+0000","last_clean_scrub_stamp":"2024-09-17T05:44:01.930501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:16:54.417419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2d","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-09-17T05:44:01.946426+0000","last_change":"2024-09-17T05:44:01.946426+0000","last_active":"2024-09-17T05:44:01.930501+0000","last_peered":"2024-09-17T05:44:01.930501+0000","last_clean":"2024-09-17T05:44:01.930501+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:44:01.946426+0000","last_undegraded":"2024-09-17T05:44:01.946426+0000","last_fullsized":"2024-09-17T05:44:01.946426+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:44:01.930501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:44:01.930501+0000","last_clean_scrub_stamp":"2024-09-17T05:44:01.930501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.2c","version":"0'0","reported_seq":13,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T05:44:03.971091+0000","last_change":"2024-09-17T05:44:02.975384+0000","last_active":"2024-09-17T05:44:03.971091+0000","last_peered":"2024-09-17T05:44:03.971091+0000","last_clean":"2024-09-17T05:44:03.971091+0000","last_became_active":"2024-09-17T05:44:02.969887+0000","last_became_peered":"2024-09-17T05:44:02.969887+0000","last_unstale":"2024-09-17T05:44:03.971091+0000","last_undegraded":"2024-09-17T05:44:03.971091+0000","last_fullsized":"2024-09-17T05:44:03.971091+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:44:01.930501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:44:01.930501+0000","last_clean_scrub_stamp":"2024-09-17T05:44:01.930501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:57:47.626723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2b","version":"0'0","reported_seq":13,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T05:44:03.971047+0000","last_change":"2024-09-17T05:44:02.975815+0000","last_active":"2024-09-17T05:44:03.971047+0000","last_peered":"2024-09-17T05:44:03.971047+0000","last_clean":"2024-09-17T05:44:03.971047+0000","last_became_active":"2024-09-17T05:44:02.975521+0000","last_became_peered":"2024-09-17T05:44:02.975521+0000","last_unstale":"2024-09-17T05:44:03.971047+0000","last_undegraded":"2024-09-17T05:44:03.971047+0000","last_fullsized":"2024-09-17T05:44:03.971047+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:44:01.930501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:44:01.930501+0000","last_clean_scrub_stamp":"2024-09-17T05:44:01.930501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:26:45.903869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.2a","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:44:02.986331+0000","last_change":"2024-09-17T05:44:02.976190+0000","last_active":"2024-09-17T05:44:02.986331+0000","last_peered":"2024-09-17T05:44:02.986331+0000","last_clean":"2024-09-17T05:44:02.986331+0000","last_became_active":"2024-09-17T05:44:02.975892+0000","last_became_peered":"2024-09-17T05:44:02.975892+0000","last_unstale":"2024-09-17T05:44:02.986331+0000","last_undegraded":"2024-09-17T05:44:02.986331+0000","last_fullsized":"2024-09-17T05:44:02.986331+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:44:01.930501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:44:01.930501+0000","last_clean_scrub_stamp":"2024-09-17T05:44:01.930501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:17:11.221074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.29","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-09-17T05:44:01.948604+0000","last_change":"2024-09-17T05:44:01.948604+0000","last_active":"2024-09-17T05:44:01.930501+0000","last_peered":"2024-09-17T05:44:01.930501+0000","last_clean":"2024-09-17T05:44:01.930501+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:44:01.948604+0000","last_undegraded":"2024-09-17T05:44:01.948604+0000","last_fullsized":"2024-09-17T05:44:01.948604+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:44:01.930501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:44:01.930501+0000","last_clean_scrub_stamp":"2024-09-17T05:44:01.930501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.28","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-09-17T05:44:01.945901+0000","last_change":"2024-09-17T05:44:01.945901+0000","last_active":"2024-09-17T05:44:01.930501+0000","last_peered":"2024-09-17T05:44:01.930501+0000","last_clean":"2024-09-17T05:44:01.930501+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:44:01.945901+0000","last_undegraded":"2024-09-17T05:44:01.945901+0000","last_fullsized":"2024-09-17T05:44:01.945901+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:44:01.930501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:44:01.930501+0000","last_clean_scrub_stamp":"2024-09-17T05:44:01.930501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.27","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-09-17T05:44:01.949356+0000","last_change":"2024-09-17T05:44:01.949356+0000","last_active":"2024-09-17T05:44:01.930501+0000","last_peered":"2024-09-17T05:44:01.930501+0000","last_clean":"2024-09-17T05:44:01.930501+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:44:01.949356+0000","last_undegraded":"2024-09-17T05:44:01.949356+0000","last_fullsized":"2024-09-17T05:44:01.949356+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:44:01.930501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:44:01.930501+0000","last_clean_scrub_stamp":"2024-09-17T05:44:01.930501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.26","version":"0'0","reported_seq":13,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T05:44:03.970968+0000","last_change":"2024-09-17T05:44:02.975515+0000","last_active":"2024-09-17T05:44:03.970968+0000","last_peered":"2024-09-17T05:44:03.970968+0000","last_clean":"2024-09-17T05:44:03.970968+0000","last_became_active":"2024-09-17T05:44:02.975200+0000","last_became_peered":"2024-09-17T05:44:02.975200+0000","last_unstale":"2024-09-17T05:44:03.970968+0000","last_undegraded":"2024-09-17T05:44:03.970968+0000","last_fullsized":"2024-09-17T05:44:03.970968+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:44:01.930501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:44:01.930501+0000","last_clean_scrub_stamp":"2024-09-17T05:44:01.930501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:00:49.479958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.25","version":"0'0","reported_seq":13,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T05:44:04.970651+0000","last_change":"2024-09-17T05:44:02.980263+0000","last_active":"2024-09-17T05:44:04.970651+0000","last_peered":"2024-09-17T05:44:04.970651+0000","last_clean":"2024-09-17T05:44:04.970651+0000","last_became_active":"2024-09-17T05:44:02.979881+0000","last_became_peered":"2024-09-17T05:44:02.979881+0000","last_unstale":"2024-09-17T05:44:04.970651+0000","last_undegraded":"2024-09-17T05:44:04.970651+0000","last_fullsized":"2024-09-17T05:44:04.970651+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:44:01.930501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:44:01.930501+0000","last_clean_scrub_stamp":"2024-09-17T05:44:01.930501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:55:06.339857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.24","version":"0'0","reported_seq":13,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T05:44:05.659277+0000","last_change":"2024-09-17T05:44:02.983423+0000","last_active":"2024-09-17T05:44:05.659277+0000","last_peered":"2024-09-17T05:44:05.659277+0000","last_clean":"2024-09-17T05:44:05.659277+0000","last_became_active":"2024-09-17T05:44:02.982942+0000","last_became_peered":"2024-09-17T05:44:02.982942+0000","last_unstale":"2024-09-17T05:44:05.659277+0000","last_undegraded":"2024-09-17T05:44:05.659277+0000","last_fullsized":"2024-09-17T05:44:05.659277+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:44:01.930501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:44:01.930501+0000","last_clean_scrub_stamp":"2024-09-17T05:44:01.930501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:23:24.999309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.23","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-09-17T05:44:01.945462+0000","last_change":"2024-09-17T05:44:01.945462+0000","last_active":"2024-09-17T05:44:01.930501+0000","last_peered":"2024-09-17T05:44:01.930501+0000","last_clean":"2024-09-17T05:44:01.930501+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:44:01.945462+0000","last_undegraded":"2024-09-17T05:44:01.945462+0000","last_fullsized":"2024-09-17T05:44:01.945462+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:44:01.930501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:44:01.930501+0000","last_clean_scrub_stamp":"2024-09-17T05:44:01.930501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.22","version":"0'0","reported_seq":13,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T05:44:04.970507+0000","last_change":"2024-09-17T05:44:02.973004+0000","last_active":"2024-09-17T05:44:04.970507+0000","last_peered":"2024-09-17T05:44:04.970507+0000","last_clean":"2024-09-17T05:44:04.970507+0000","last_became_active":"2024-09-17T05:44:02.972681+0000","last_became_peered":"2024-09-17T05:44:02.972681+0000","last_unstale":"2024-09-17T05:44:04.970507+0000","last_undegraded":"2024-09-17T05:44:04.970507+0000","last_fullsized":"2024-09-17T05:44:04.970507+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:44:01.930501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:44:01.930501+0000","last_clean_scrub_stamp":"2024-09-17T05:44:01.930501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:41:24.794306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.21","version":"0'0","reported_seq":13,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T05:44:03.970995+0000","last_change":"2024-09-17T05:44:02.977953+0000","last_active":"2024-09-17T05:44:03.970995+0000","last_peered":"2024-09-17T05:44:03.970995+0000","last_clean":"2024-09-17T05:44:03.970995+0000","last_became_active":"2024-09-17T05:44:02.977624+0000","last_became_peered":"2024-09-17T05:44:02.977624+0000","last_unstale":"2024-09-17T05:44:03.970995+0000","last_undegraded":"2024-09-17T05:44:03.970995+0000","last_fullsized":"2024-09-17T05:44:03.970995+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:44:01.930501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:44:01.930501+0000","last_clean_scrub_stamp":"2024-09-17T05:44:01.930501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:51:59.823755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.20","version":"0'0","reported_seq":13,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T05:44:03.971876+0000","last_change":"2024-09-17T05:44:02.978709+0000","last_active":"2024-09-17T05:44:03.971876+0000","last_peered":"2024-09-17T05:44:03.971876+0000","last_clean":"2024-09-17T05:44:03.971876+0000","last_became_active":"2024-09-17T05:44:02.978052+0000","last_became_peered":"2024-09-17T05:44:02.978052+0000","last_unstale":"2024-09-17T05:44:03.971876+0000","last_undegraded":"2024-09-17T05:44:03.971876+0000","last_fullsized":"2024-09-17T05:44:03.971876+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:44:01.930501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:44:01.930501+0000","last_clean_scrub_stamp":"2024-09-17T05:44:01.930501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:42:10.964610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":13,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T05:44:05.915609+0000","last_change":"2024-09-17T05:44:02.965033+0000","last_active":"2024-09-17T05:44:05.915609+0000","last_peered":"2024-09-17T05:44:05.915609+0000","last_clean":"2024-09-17T05:44:05.915609+0000","last_became_active":"2024-09-17T05:44:02.964721+0000","last_became_peered":"2024-09-17T05:44:02.964721+0000","last_unstale":"2024-09-17T05:44:05.915609+0000","last_undegraded":"2024-09-17T05:44:05.915609+0000","last_fullsized":"2024-09-17T05:44:05.915609+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:44:01.930501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:44:01.930501+0000","last_clean_scrub_stamp":"2024-09-17T05:44:01.930501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:44:44.295610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"44'4","reported_seq":19,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T05:44:03.970754+0000","last_change":"2024-09-17T05:44:01.954506+0000","last_active":"2024-09-17T05:44:03.970754+0000","last_peered":"2024-09-17T05:44:03.970754+0000","last_clean":"2024-09-17T05:44:03.970754+0000","last_became_active":"2024-09-17T05:44:01.954200+0000","last_became_peered":"2024-09-17T05:44:01.954200+0000","last_unstale":"2024-09-17T05:44:03.970754+0000","last_undegraded":"2024-09-17T05:44:03.970754+0000","last_fullsized":"2024-09-17T05:44:03.970754+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:44:00.925414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:44:00.925414+0000","last_clean_scrub_stamp":"2024-09-17T05:44:00.925414+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:06:07.975519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-09-17T05:44:01.948703+0000","last_change":"2024-09-17T05:44:01.948703+0000","last_active":"2024-09-17T05:44:01.930501+0000","last_peered":"2024-09-17T05:44:01.930501+0000","last_clean":"2024-09-17T05:44:01.930501+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:44:01.948703+0000","last_undegraded":"2024-09-17T05:44:01.948703+0000","last_fullsized":"2024-09-17T05:44:01.948703+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:44:01.930501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:44:01.930501+0000","last_clean_scrub_stamp":"2024-09-17T05:44:01.930501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1e","version":"44'1","reported_seq":16,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T05:44:04.971199+0000","last_change":"2024-09-17T05:44:01.952534+0000","last_active":"2024-09-17T05:44:04.971199+0000","last_peered":"2024-09-17T05:44:04.971199+0000","last_clean":"2024-09-17T05:44:04.971199+0000","last_became_active":"2024-09-17T05:44:01.952187+0000","last_became_peered":"2024-09-17T05:44:01.952187+0000","last_unstale":"2024-09-17T05:44:04.971199+0000","last_undegraded":"2024-09-17T05:44:04.971199+0000","last_fullsized":"2024-09-17T05:44:04.971199+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:44:00.925414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:44:00.925414+0000","last_clean_scrub_stamp":"2024-09-17T05:44:00.925414+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:12:38.503949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":13,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T05:44:05.659502+0000","last_change":"2024-09-17T05:44:02.980083+0000","last_active":"2024-09-17T05:44:05.659502+0000","last_peered":"2024-09-17T05:44:05.659502+0000","last_clean":"2024-09-17T05:44:05.659502+0000","last_became_active":"2024-09-17T05:44:02.979747+0000","last_became_peered":"2024-09-17T05:44:02.979747+0000","last_unstale":"2024-09-17T05:44:05.659502+0000","last_undegraded":"2024-09-17T05:44:05.659502+0000","last_fullsized":"2024-09-17T05:44:05.659502+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:44:01.930501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:44:01.930501+0000","last_clean_scrub_stamp":"2024-09-17T05:44:01.930501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:51:23.709979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1d","version":"44'2","reported_seq":17,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T05:44:05.915916+0000","last_change":"2024-09-17T05:44:01.956537+0000","last_active":"2024-09-17T05:44:05.915916+0000","last_peered":"2024-09-17T05:44:05.915916+0000","last_clean":"2024-09-17T05:44:05.915916+0000","last_became_active":"2024-09-17T05:44:01.956185+0000","last_became_peered":"2024-09-17T05:44:01.956185+0000","last_unstale":"2024-09-17T05:44:05.915916+0000","last_undegraded":"2024-09-17T05:44:05.915916+0000","last_fullsized":"2024-09-17T05:44:05.915916+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:44:00.925414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:44:00.925414+0000","last_clean_scrub_stamp":"2024-09-17T05:44:00.925414+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:46:03.151717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":13,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T05:44:05.916049+0000","last_change":"2024-09-17T05:44:02.976645+0000","last_active":"2024-09-17T05:44:05.916049+0000","last_peered":"2024-09-17T05:44:05.916049+0000","last_clean":"2024-09-17T05:44:05.916049+0000","last_became_active":"2024-09-17T05:44:02.976312+0000","last_became_peered":"2024-09-17T05:44:02.976312+0000","last_unstale":"2024-09-17T05:44:05.916049+0000","last_undegraded":"2024-09-17T05:44:05.916049+0000","last_fullsized":"2024-09-17T05:44:05.916049+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:44:01.930501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:44:01.930501+0000","last_clean_scrub_stamp":"2024-09-17T05:44:01.930501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:05:28.918610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"44'2","reported_seq":17,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T05:44:05.414708+0000","last_change":"2024-09-17T05:44:01.957595+0000","last_active":"2024-09-17T05:44:05.414708+0000","last_peered":"2024-09-17T05:44:05.414708+0000","last_clean":"2024-09-17T05:44:05.414708+0000","last_became_active":"2024-09-17T05:44:01.957224+0000","last_became_peered":"2024-09-17T05:44:01.957224+0000","last_unstale":"2024-09-17T05:44:05.414708+0000","last_undegraded":"2024-09-17T05:44:05.414708+0000","last_fullsized":"2024-09-17T05:44:05.414708+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:44:00.925414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:44:00.925414+0000","last_clean_scrub_stamp":"2024-09-17T05:44:00.925414+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:35:05.665060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":13,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T05:44:04.970762+0000","last_change":"2024-09-17T05:44:02.976326+0000","last_active":"2024-09-17T05:44:04.970762+0000","last_peered":"2024-09-17T05:44:04.970762+0000","last_clean":"2024-09-17T05:44:04.970762+0000","last_became_active":"2024-09-17T05:44:02.975980+0000","last_became_peered":"2024-09-17T05:44:02.975980+0000","last_unstale":"2024-09-17T05:44:04.970762+0000","last_undegraded":"2024-09-17T05:44:04.970762+0000","last_fullsized":"2024-09-17T05:44:04.970762+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:44:01.930501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:44:01.930501+0000","last_clean_scrub_stamp":"2024-09-17T05:44:01.930501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:51:53.246482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"44'1","reported_seq":16,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T05:44:03.971076+0000","last_change":"2024-09-17T05:44:01.949683+0000","last_active":"2024-09-17T05:44:03.971076+0000","last_peered":"2024-09-17T05:44:03.971076+0000","last_clean":"2024-09-17T05:44:03.971076+0000","last_became_active":"2024-09-17T05:44:01.949320+0000","last_became_peered":"2024-09-17T05:44:01.949320+0000","last_unstale":"2024-09-17T05:44:03.971076+0000","last_undegraded":"2024-09-17T05:44:03.971076+0000","last_fullsized":"2024-09-17T05:44:03.971076+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:44:00.925414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:44:00.925414+0000","last_clean_scrub_stamp":"2024-09-17T05:44:00.925414+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:46:36.414158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:44:02.986043+0000","last_change":"2024-09-17T05:44:02.968696+0000","last_active":"2024-09-17T05:44:02.986043+0000","last_peered":"2024-09-17T05:44:02.986043+0000","last_clean":"2024-09-17T05:44:02.986043+0000","last_became_active":"2024-09-17T05:44:02.968360+0000","last_became_peered":"2024-09-17T05:44:02.968360+0000","last_unstale":"2024-09-17T05:44:02.986043+0000","last_undegraded":"2024-09-17T05:44:02.986043+0000","last_fullsized":"2024-09-17T05:44:02.986043+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:44:01.930501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:44:01.930501+0000","last_clean_scrub_stamp":"2024-09-17T05:44:01.930501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:05:09.812483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1a","version":"44'1","reported_seq":16,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T05:44:04.970598+0000","last_change":"2024-09-17T05:44:01.949830+0000","last_active":"2024-09-17T05:44:04.970598+0000","last_peered":"2024-09-17T05:44:04.970598+0000","last_clean":"2024-09-17T05:44:04.970598+0000","last_became_active":"2024-09-17T05:44:01.949509+0000","last_became_peered":"2024-09-17T05:44:01.949509+0000","last_unstale":"2024-09-17T05:44:04.970598+0000","last_undegraded":"2024-09-17T05:44:04.970598+0000","last_fullsized":"2024-09-17T05:44:04.970598+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:44:00.925414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:44:00.925414+0000","last_clean_scrub_stamp":"2024-09-17T05:44:00.925414+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:13:58.348730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:44:02.993131+0000","last_change":"2024-09-17T05:44:02.989081+0000","last_active":"2024-09-17T05:44:02.993131+0000","last_peered":"2024-09-17T05:44:02.993131+0000","last_clean":"2024-09-17T05:44:02.993131+0000","last_became_active":"2024-09-17T05:44:02.988354+0000","last_became_peered":"2024-09-17T05:44:02.988354+0000","last_unstale":"2024-09-17T05:44:02.993131+0000","last_undegraded":"2024-09-17T05:44:02.993131+0000","last_fullsized":"2024-09-17T05:44:02.993131+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:44:01.930501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:44:01.930501+0000","last_clean_scrub_stamp":"2024-09-17T05:44:01.930501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:36:28.222836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":15,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T05:44:05.658774+0000","last_change":"2024-09-17T05:44:01.955804+0000","last_active":"2024-09-17T05:44:05.658774+0000","last_peered":"2024-09-17T05:44:05.658774+0000","last_clean":"2024-09-17T05:44:05.658774+0000","last_became_active":"2024-09-17T05:44:01.955195+0000","last_became_peered":"2024-09-17T05:44:01.955195+0000","last_unstale":"2024-09-17T05:44:05.658774+0000","last_undegraded":"2024-09-17T05:44:05.658774+0000","last_fullsized":"2024-09-17T05:44:05.658774+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:44:00.925414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:44:00.925414+0000","last_clean_scrub_stamp":"2024-09-17T05:44:00.925414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:44:43.290523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-09-17T05:44:01.949231+0000","last_change":"2024-09-17T05:44:01.949231+0000","last_active":"2024-09-17T05:44:01.930501+0000","last_peered":"2024-09-17T05:44:01.930501+0000","last_clean":"2024-09-17T05:44:01.930501+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:44:01.949231+0000","last_undegraded":"2024-09-17T05:44:01.949231+0000","last_fullsized":"2024-09-17T05:44:01.949231+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:44:01.930501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:44:01.930501+0000","last_clean_scrub_stamp":"2024-09-17T05:44:01.930501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:44:02.958951+0000","last_change":"2024-09-17T05:44:01.949647+0000","last_active":"2024-09-17T05:44:02.958951+0000","last_peered":"2024-09-17T05:44:02.958951+0000","last_clean":"2024-09-17T05:44:02.958951+0000","last_became_active":"2024-09-17T05:44:01.949263+0000","last_became_peered":"2024-09-17T05:44:01.949263+0000","last_unstale":"2024-09-17T05:44:02.958951+0000","last_undegraded":"2024-09-17T05:44:02.958951+0000","last_fullsized":"2024-09-17T05:44:02.958951+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:44:00.925414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:44:00.925414+0000","last_clean_scrub_stamp":"2024-09-17T05:44:00.925414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:26:01.492424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":13,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T05:44:04.971121+0000","last_change":"2024-09-17T05:44:02.987319+0000","last_active":"2024-09-17T05:44:04.971121+0000","last_peered":"2024-09-17T05:44:04.971121+0000","last_clean":"2024-09-17T05:44:04.971121+0000","last_became_active":"2024-09-17T05:44:02.986401+0000","last_became_peered":"2024-09-17T05:44:02.986401+0000","last_unstale":"2024-09-17T05:44:04.971121+0000","last_undegraded":"2024-09-17T05:44:04.971121+0000","last_fullsized":"2024-09-17T05:44:04.971121+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:44:01.930501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:44:01.930501+0000","last_clean_scrub_stamp":"2024-09-17T05:44:01.930501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:36:30.650560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":15,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T05:44:04.970859+0000","last_change":"2024-09-17T05:44:01.951077+0000","last_active":"2024-09-17T05:44:04.970859+0000","last_peered":"2024-09-17T05:44:04.970859+0000","last_clean":"2024-09-17T05:44:04.970859+0000","last_became_active":"2024-09-17T05:44:01.950715+0000","last_became_peered":"2024-09-17T05:44:01.950715+0000","last_unstale":"2024-09-17T05:44:04.970859+0000","last_undegraded":"2024-09-17T05:44:04.970859+0000","last_fullsized":"2024-09-17T05:44:04.970859+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:44:00.925414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:44:00.925414+0000","last_clean_scrub_stamp":"2024-09-17T05:44:00.925414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:34:19.904802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":13,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T05:44:05.415322+0000","last_change":"2024-09-17T05:44:02.980515+0000","last_active":"2024-09-17T05:44:05.415322+0000","last_peered":"2024-09-17T05:44:05.415322+0000","last_clean":"2024-09-17T05:44:05.415322+0000","last_became_active":"2024-09-17T05:44:02.980069+0000","last_became_peered":"2024-09-17T05:44:02.980069+0000","last_unstale":"2024-09-17T05:44:05.415322+0000","last_undegraded":"2024-09-17T05:44:05.415322+0000","last_fullsized":"2024-09-17T05:44:05.415322+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:44:01.930501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:44:01.930501+0000","last_clean_scrub_stamp":"2024-09-17T05:44:01.930501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:35:11.922195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:44:02.959919+0000","last_change":"2024-09-17T05:44:01.950607+0000","last_active":"2024-09-17T05:44:02.959919+0000","last_peered":"2024-09-17T05:44:02.959919+0000","last_clean":"2024-09-17T05:44:02.959919+0000","last_became_active":"2024-09-17T05:44:01.950263+0000","last_became_peered":"2024-09-17T05:44:01.950263+0000","last_unstale":"2024-09-17T05:44:02.959919+0000","last_undegraded":"2024-09-17T05:44:02.959919+0000","last_fullsized":"2024-09-17T05:44:02.959919+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:44:00.925414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:44:00.925414+0000","last_clean_scrub_stamp":"2024-09-17T05:44:00.925414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:53:32.014377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":13,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T05:44:03.970541+0000","last_change":"2024-09-17T05:44:02.970209+0000","last_active":"2024-09-17T05:44:03.970541+0000","last_peered":"2024-09-17T05:44:03.970541+0000","last_clean":"2024-09-17T05:44:03.970541+0000","last_became_active":"2024-09-17T05:44:02.969924+0000","last_became_peered":"2024-09-17T05:44:02.969924+0000","last_unstale":"2024-09-17T05:44:03.970541+0000","last_undegraded":"2024-09-17T05:44:03.970541+0000","last_fullsized":"2024-09-17T05:44:03.970541+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:44:01.930501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:44:01.930501+0000","last_clean_scrub_stamp":"2024-09-17T05:44:01.930501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:40:41.740300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"44'3","reported_seq":18,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T05:44:05.414988+0000","last_change":"2024-09-17T05:44:01.958643+0000","last_active":"2024-09-17T05:44:05.414988+0000","last_peered":"2024-09-17T05:44:05.414988+0000","last_clean":"2024-09-17T05:44:05.414988+0000","last_became_active":"2024-09-17T05:44:01.958310+0000","last_became_peered":"2024-09-17T05:44:01.958310+0000","last_unstale":"2024-09-17T05:44:05.414988+0000","last_undegraded":"2024-09-17T05:44:05.414988+0000","last_fullsized":"2024-09-17T05:44:05.414988+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:44:00.925414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:44:00.925414+0000","last_clean_scrub_stamp":"2024-09-17T05:44:00.925414+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:03:12.501051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":13,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T05:44:05.414895+0000","last_change":"2024-09-17T05:44:02.968507+0000","last_active":"2024-09-17T05:44:05.414895+0000","last_peered":"2024-09-17T05:44:05.414895+0000","last_clean":"2024-09-17T05:44:05.414895+0000","last_became_active":"2024-09-17T05:44:02.968167+0000","last_became_peered":"2024-09-17T05:44:02.968167+0000","last_unstale":"2024-09-17T05:44:05.414895+0000","last_undegraded":"2024-09-17T05:44:05.414895+0000","last_fullsized":"2024-09-17T05:44:05.414895+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:44:01.930501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:44:01.930501+0000","last_clean_scrub_stamp":"2024-09-17T05:44:01.930501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:27:06.309594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.14","version":"44'6","reported_seq":21,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T05:44:03.971157+0000","last_change":"2024-09-17T05:44:01.942944+0000","last_active":"2024-09-17T05:44:03.971157+0000","last_peered":"2024-09-17T05:44:03.971157+0000","last_clean":"2024-09-17T05:44:03.971157+0000","last_became_active":"2024-09-17T05:44:01.942488+0000","last_became_peered":"2024-09-17T05:44:01.942488+0000","last_unstale":"2024-09-17T05:44:03.971157+0000","last_undegraded":"2024-09-17T05:44:03.971157+0000","last_fullsized":"2024-09-17T05:44:03.971157+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:44:00.925414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:44:00.925414+0000","last_clean_scrub_stamp":"2024-09-17T05:44:00.925414+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:29:01.447727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-09-17T05:44:01.946200+0000","last_change":"2024-09-17T05:44:01.946200+0000","last_active":"2024-09-17T05:44:01.930501+0000","last_peered":"2024-09-17T05:44:01.930501+0000","last_clean":"2024-09-17T05:44:01.930501+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:44:01.946200+0000","last_undegraded":"2024-09-17T05:44:01.946200+0000","last_fullsized":"2024-09-17T05:44:01.946200+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:44:01.930501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:44:01.930501+0000","last_clean_scrub_stamp":"2024-09-17T05:44:01.930501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"44'2","reported_seq":17,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T05:44:03.971121+0000","last_change":"2024-09-17T05:44:01.948885+0000","last_active":"2024-09-17T05:44:03.971121+0000","last_peered":"2024-09-17T05:44:03.971121+0000","last_clean":"2024-09-17T05:44:03.971121+0000","last_became_active":"2024-09-17T05:44:01.948319+0000","last_became_peered":"2024-09-17T05:44:01.948319+0000","last_unstale":"2024-09-17T05:44:03.971121+0000","last_undegraded":"2024-09-17T05:44:03.971121+0000","last_fullsized":"2024-09-17T05:44:03.971121+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:44:00.925414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:44:00.925414+0000","last_clean_scrub_stamp":"2024-09-17T05:44:00.925414+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:26:48.401818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:44:02.986237+0000","last_change":"2024-09-17T05:44:02.979714+0000","last_active":"2024-09-17T05:44:02.986237+0000","last_peered":"2024-09-17T05:44:02.986237+0000","last_clean":"2024-09-17T05:44:02.986237+0000","last_became_active":"2024-09-17T05:44:02.977592+0000","last_became_peered":"2024-09-17T05:44:02.977592+0000","last_unstale":"2024-09-17T05:44:02.986237+0000","last_undegraded":"2024-09-17T05:44:02.986237+0000","last_fullsized":"2024-09-17T05:44:02.986237+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:44:01.930501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:44:01.930501+0000","last_clean_scrub_stamp":"2024-09-17T05:44:01.930501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:04:06.058220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":15,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T05:44:05.414641+0000","last_change":"2024-09-17T05:44:01.952325+0000","last_active":"2024-09-17T05:44:05.414641+0000","last_peered":"2024-09-17T05:44:05.414641+0000","last_clean":"2024-09-17T05:44:05.414641+0000","last_became_active":"2024-09-17T05:44:01.952005+0000","last_became_peered":"2024-09-17T05:44:01.952005+0000","last_unstale":"2024-09-17T05:44:05.414641+0000","last_undegraded":"2024-09-17T05:44:05.414641+0000","last_fullsized":"2024-09-17T05:44:05.414641+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:44:00.925414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:44:00.925414+0000","last_clean_scrub_stamp":"2024-09-17T05:44:00.925414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:01:33.262027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":13,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T05:44:03.970252+0000","last_change":"2024-09-17T05:44:02.969515+0000","last_active":"2024-09-17T05:44:03.970252+0000","last_peered":"2024-09-17T05:44:03.970252+0000","last_clean":"2024-09-17T05:44:03.970252+0000","last_became_active":"2024-09-17T05:44:02.968910+0000","last_became_peered":"2024-09-17T05:44:02.968910+0000","last_unstale":"2024-09-17T05:44:03.970252+0000","last_undegraded":"2024-09-17T05:44:03.970252+0000","last_fullsized":"2024-09-17T05:44:03.970252+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:44:01.930501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:44:01.930501+0000","last_clean_scrub_stamp":"2024-09-17T05:44:01.930501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:04:08.756849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":15,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T05:44:03.970397+0000","last_change":"2024-09-17T05:44:01.948603+0000","last_active":"2024-09-17T05:44:03.970397+0000","last_peered":"2024-09-17T05:44:03.970397+0000","last_clean":"2024-09-17T05:44:03.970397+0000","last_became_active":"2024-09-17T05:44:01.948261+0000","last_became_peered":"2024-09-17T05:44:01.948261+0000","last_unstale":"2024-09-17T05:44:03.970397+0000","last_undegraded":"2024-09-17T05:44:03.970397+0000","last_fullsized":"2024-09-17T05:44:03.970397+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:44:00.925414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:44:00.925414+0000","last_clean_scrub_stamp":"2024-09-17T05:44:00.925414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:51:52.241395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":13,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T05:44:05.414907+0000","last_change":"2024-09-17T05:44:02.980463+0000","last_active":"2024-09-17T05:44:05.414907+0000","last_peered":"2024-09-17T05:44:05.414907+0000","last_clean":"2024-09-17T05:44:05.414907+0000","last_became_active":"2024-09-17T05:44:02.979921+0000","last_became_peered":"2024-09-17T05:44:02.979921+0000","last_unstale":"2024-09-17T05:44:05.414907+0000","last_undegraded":"2024-09-17T05:44:05.414907+0000","last_fullsized":"2024-09-17T05:44:05.414907+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:44:01.930501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:44:01.930501+0000","last_clean_scrub_stamp":"2024-09-17T05:44:01.930501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:32:37.948066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.10","version":"44'8","reported_seq":21,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:44:02.993082+0000","last_change":"2024-09-17T05:44:01.955769+0000","last_active":"2024-09-17T05:44:02.993082+0000","last_peered":"2024-09-17T05:44:02.993082+0000","last_clean":"2024-09-17T05:44:02.993082+0000","last_became_active":"2024-09-17T05:44:01.955407+0000","last_became_peered":"2024-09-17T05:44:01.955407+0000","last_unstale":"2024-09-17T05:44:02.993082+0000","last_undegraded":"2024-09-17T05:44:02.993082+0000","last_fullsized":"2024-09-17T05:44:02.993082+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:44:00.925414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:44:00.925414+0000","last_clean_scrub_stamp":"2024-09-17T05:44:00.925414+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:16:36.932317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":13,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T05:44:03.971209+0000","last_change":"2024-09-17T05:44:02.977094+0000","last_active":"2024-09-17T05:44:03.971209+0000","last_peered":"2024-09-17T05:44:03.971209+0000","last_clean":"2024-09-17T05:44:03.971209+0000","last_became_active":"2024-09-17T05:44:02.976821+0000","last_became_peered":"2024-09-17T05:44:02.976821+0000","last_unstale":"2024-09-17T05:44:03.971209+0000","last_undegraded":"2024-09-17T05:44:03.971209+0000","last_fullsized":"2024-09-17T05:44:03.971209+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:44:01.930501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:44:01.930501+0000","last_clean_scrub_stamp":"2024-09-17T05:44:01.930501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:03:21.010459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"44'1","reported_seq":16,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T05:44:03.971363+0000","last_change":"2024-09-17T05:44:01.947617+0000","last_active":"2024-09-17T05:44:03.971363+0000","last_peered":"2024-09-17T05:44:03.971363+0000","last_clean":"2024-09-17T05:44:03.971363+0000","last_became_active":"2024-09-17T05:44:01.947272+0000","last_became_peered":"2024-09-17T05:44:01.947272+0000","last_unstale":"2024-09-17T05:44:03.971363+0000","last_undegraded":"2024-09-17T05:44:03.971363+0000","last_fullsized":"2024-09-17T05:44:03.971363+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:44:00.925414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:44:00.925414+0000","last_clean_scrub_stamp":"2024-09-17T05:44:00.925414+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:26:24.738054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:44:02.983449+0000","last_change":"2024-09-17T05:44:02.964018+0000","last_active":"2024-09-17T05:44:02.983449+0000","last_peered":"2024-09-17T05:44:02.983449+0000","last_clean":"2024-09-17T05:44:02.983449+0000","last_became_active":"2024-09-17T05:44:02.963717+0000","last_became_peered":"2024-09-17T05:44:02.963717+0000","last_unstale":"2024-09-17T05:44:02.983449+0000","last_undegraded":"2024-09-17T05:44:02.983449+0000","last_fullsized":"2024-09-17T05:44:02.983449+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:44:01.930501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:44:01.930501+0000","last_clean_scrub_stamp":"2024-09-17T05:44:01.930501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:56:58.722211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.e","version":"44'2","reported_seq":17,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T05:44:04.971214+0000","last_change":"2024-09-17T05:44:01.948758+0000","last_active":"2024-09-17T05:44:04.971214+0000","last_peered":"2024-09-17T05:44:04.971214+0000","last_clean":"2024-09-17T05:44:04.971214+0000","last_became_active":"2024-09-17T05:44:01.948353+0000","last_became_peered":"2024-09-17T05:44:01.948353+0000","last_unstale":"2024-09-17T05:44:04.971214+0000","last_undegraded":"2024-09-17T05:44:04.971214+0000","last_fullsized":"2024-09-17T05:44:04.971214+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:44:00.925414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:44:00.925414+0000","last_clean_scrub_stamp":"2024-09-17T05:44:00.925414+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:40:24.517815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-09-17T05:44:01.946176+0000","last_change":"2024-09-17T05:44:01.946176+0000","last_active":"2024-09-17T05:44:01.930501+0000","last_peered":"2024-09-17T05:44:01.930501+0000","last_clean":"2024-09-17T05:44:01.930501+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:44:01.946176+0000","last_undegraded":"2024-09-17T05:44:01.946176+0000","last_fullsized":"2024-09-17T05:44:01.946176+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:44:01.930501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:44:01.930501+0000","last_clean_scrub_stamp":"2024-09-17T05:44:01.930501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.d","version":"44'1","reported_seq":16,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T05:44:05.659115+0000","last_change":"2024-09-17T05:44:01.952723+0000","last_active":"2024-09-17T05:44:05.659115+0000","last_peered":"2024-09-17T05:44:05.659115+0000","last_clean":"2024-09-17T05:44:05.659115+0000","last_became_active":"2024-09-17T05:44:01.952249+0000","last_became_peered":"2024-09-17T05:44:01.952249+0000","last_unstale":"2024-09-17T05:44:05.659115+0000","last_undegraded":"2024-09-17T05:44:05.659115+0000","last_fullsized":"2024-09-17T05:44:05.659115+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:44:00.925414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:44:00.925414+0000","last_clean_scrub_stamp":"2024-09-17T05:44:00.925414+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:05:27.913523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-09-17T05:44:01.948237+0000","last_change":"2024-09-17T05:44:01.948237+0000","last_active":"2024-09-17T05:44:01.930501+0000","last_peered":"2024-09-17T05:44:01.930501+0000","last_clean":"2024-09-17T05:44:01.930501+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:44:01.948237+0000","last_undegraded":"2024-09-17T05:44:01.948237+0000","last_fullsized":"2024-09-17T05:44:01.948237+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:44:01.930501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:44:01.930501+0000","last_clean_scrub_stamp":"2024-09-17T05:44:01.930501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":15,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T05:44:03.970437+0000","last_change":"2024-09-17T05:44:01.954281+0000","last_active":"2024-09-17T05:44:03.970437+0000","last_peered":"2024-09-17T05:44:03.970437+0000","last_clean":"2024-09-17T05:44:03.970437+0000","last_became_active":"2024-09-17T05:44:01.953910+0000","last_became_peered":"2024-09-17T05:44:01.953910+0000","last_unstale":"2024-09-17T05:44:03.970437+0000","last_undegraded":"2024-09-17T05:44:03.970437+0000","last_fullsized":"2024-09-17T05:44:03.970437+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:44:00.925414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:44:00.925414+0000","last_clean_scrub_stamp":"2024-09-17T05:44:00.925414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:16:53.412332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":13,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T05:44:03.970683+0000","last_change":"2024-09-17T05:44:02.970330+0000","last_active":"2024-09-17T05:44:03.970683+0000","last_peered":"2024-09-17T05:44:03.970683+0000","last_clean":"2024-09-17T05:44:03.970683+0000","last_became_active":"2024-09-17T05:44:02.969132+0000","last_became_peered":"2024-09-17T05:44:02.969132+0000","last_unstale":"2024-09-17T05:44:03.970683+0000","last_undegraded":"2024-09-17T05:44:03.970683+0000","last_fullsized":"2024-09-17T05:44:03.970683+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:44:01.930501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:44:01.930501+0000","last_clean_scrub_stamp":"2024-09-17T05:44:01.930501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:12:05.855315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.b","version":"44'2","reported_seq":17,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T05:44:03.971241+0000","last_change":"2024-09-17T05:44:01.952417+0000","last_active":"2024-09-17T05:44:03.971241+0000","last_peered":"2024-09-17T05:44:03.971241+0000","last_clean":"2024-09-17T05:44:03.971241+0000","last_became_active":"2024-09-17T05:44:01.951779+0000","last_became_peered":"2024-09-17T05:44:01.951779+0000","last_unstale":"2024-09-17T05:44:03.971241+0000","last_undegraded":"2024-09-17T05:44:03.971241+0000","last_fullsized":"2024-09-17T05:44:03.971241+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:44:00.925414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:44:00.925414+0000","last_clean_scrub_stamp":"2024-09-17T05:44:00.925414+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:39:36.775312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":13,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T05:44:05.915357+0000","last_change":"2024-09-17T05:44:02.976421+0000","last_active":"2024-09-17T05:44:05.915357+0000","last_peered":"2024-09-17T05:44:05.915357+0000","last_clean":"2024-09-17T05:44:05.915357+0000","last_became_active":"2024-09-17T05:44:02.976091+0000","last_became_peered":"2024-09-17T05:44:02.976091+0000","last_unstale":"2024-09-17T05:44:05.915357+0000","last_undegraded":"2024-09-17T05:44:05.915357+0000","last_fullsized":"2024-09-17T05:44:05.915357+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:44:01.930501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:44:01.930501+0000","last_clean_scrub_stamp":"2024-09-17T05:44:01.930501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:17:16.014677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":15,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T05:44:05.658767+0000","last_change":"2024-09-17T05:44:01.956743+0000","last_active":"2024-09-17T05:44:05.658767+0000","last_peered":"2024-09-17T05:44:05.658767+0000","last_clean":"2024-09-17T05:44:05.658767+0000","last_became_active":"2024-09-17T05:44:01.955453+0000","last_became_peered":"2024-09-17T05:44:01.955453+0000","last_unstale":"2024-09-17T05:44:05.658767+0000","last_undegraded":"2024-09-17T05:44:05.658767+0000","last_fullsized":"2024-09-17T05:44:05.658767+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:44:00.925414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:44:00.925414+0000","last_clean_scrub_stamp":"2024-09-17T05:44:00.925414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:17:15.009590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":13,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T05:44:03.971825+0000","last_change":"2024-09-17T05:44:02.973112+0000","last_active":"2024-09-17T05:44:03.971825+0000","last_peered":"2024-09-17T05:44:03.971825+0000","last_clean":"2024-09-17T05:44:03.971825+0000","last_became_active":"2024-09-17T05:44:02.972818+0000","last_became_peered":"2024-09-17T05:44:02.972818+0000","last_unstale":"2024-09-17T05:44:03.971825+0000","last_undegraded":"2024-09-17T05:44:03.971825+0000","last_fullsized":"2024-09-17T05:44:03.971825+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:44:01.930501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:44:01.930501+0000","last_clean_scrub_stamp":"2024-09-17T05:44:01.930501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:02:00.787605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:44:02.959170+0000","last_change":"2024-09-17T05:44:01.953671+0000","last_active":"2024-09-17T05:44:02.959170+0000","last_peered":"2024-09-17T05:44:02.959170+0000","last_clean":"2024-09-17T05:44:02.959170+0000","last_became_active":"2024-09-17T05:44:01.953335+0000","last_became_peered":"2024-09-17T05:44:01.953335+0000","last_unstale":"2024-09-17T05:44:02.959170+0000","last_undegraded":"2024-09-17T05:44:02.959170+0000","last_fullsized":"2024-09-17T05:44:02.959170+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:44:00.925414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:44:00.925414+0000","last_clean_scrub_stamp":"2024-09-17T05:44:00.925414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:37:02.646622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:44:02.983693+0000","last_change":"2024-09-17T05:44:02.965586+0000","last_active":"2024-09-17T05:44:02.983693+0000","last_peered":"2024-09-17T05:44:02.983693+0000","last_clean":"2024-09-17T05:44:02.983693+0000","last_became_active":"2024-09-17T05:44:02.965276+0000","last_became_peered":"2024-09-17T05:44:02.965276+0000","last_unstale":"2024-09-17T05:44:02.983693+0000","last_undegraded":"2024-09-17T05:44:02.983693+0000","last_fullsized":"2024-09-17T05:44:02.983693+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:44:01.930501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:44:01.930501+0000","last_clean_scrub_stamp":"2024-09-17T05:44:01.930501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:36:57.786003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":15,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T05:44:05.414441+0000","last_change":"2024-09-17T05:44:01.952963+0000","last_active":"2024-09-17T05:44:05.414441+0000","last_peered":"2024-09-17T05:44:05.414441+0000","last_clean":"2024-09-17T05:44:05.414441+0000","last_became_active":"2024-09-17T05:44:01.952635+0000","last_became_peered":"2024-09-17T05:44:01.952635+0000","last_unstale":"2024-09-17T05:44:05.414441+0000","last_undegraded":"2024-09-17T05:44:05.414441+0000","last_fullsized":"2024-09-17T05:44:05.414441+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:44:00.925414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:44:00.925414+0000","last_clean_scrub_stamp":"2024-09-17T05:44:00.925414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:01:52.592469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-09-17T05:44:01.948175+0000","last_change":"2024-09-17T05:44:01.948175+0000","last_active":"2024-09-17T05:44:01.930501+0000","last_peered":"2024-09-17T05:44:01.930501+0000","last_clean":"2024-09-17T05:44:01.930501+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:44:01.948175+0000","last_undegraded":"2024-09-17T05:44:01.948175+0000","last_fullsized":"2024-09-17T05:44:01.948175+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:44:01.930501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:44:01.930501+0000","last_clean_scrub_stamp":"2024-09-17T05:44:01.930501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.6","version":"45'1","reported_seq":16,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T05:44:03.971074+0000","last_change":"2024-09-17T05:44:01.948222+0000","last_active":"2024-09-17T05:44:03.971074+0000","last_peered":"2024-09-17T05:44:03.971074+0000","last_clean":"2024-09-17T05:44:03.971074+0000","last_became_active":"2024-09-17T05:44:01.947920+0000","last_became_peered":"2024-09-17T05:44:01.947920+0000","last_unstale":"2024-09-17T05:44:03.971074+0000","last_undegraded":"2024-09-17T05:44:03.971074+0000","last_fullsized":"2024-09-17T05:44:03.971074+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:44:00.925414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:44:00.925414+0000","last_clean_scrub_stamp":"2024-09-17T05:44:00.925414+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:36:29.645473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:44:02.986147+0000","last_change":"2024-09-17T05:44:02.975385+0000","last_active":"2024-09-17T05:44:02.986147+0000","last_peered":"2024-09-17T05:44:02.986147+0000","last_clean":"2024-09-17T05:44:02.986147+0000","last_became_active":"2024-09-17T05:44:02.974263+0000","last_became_peered":"2024-09-17T05:44:02.974263+0000","last_unstale":"2024-09-17T05:44:02.986147+0000","last_undegraded":"2024-09-17T05:44:02.986147+0000","last_fullsized":"2024-09-17T05:44:02.986147+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:44:01.930501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:44:01.930501+0000","last_clean_scrub_stamp":"2024-09-17T05:44:01.930501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:04:07.130698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":15,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T05:44:05.415120+0000","last_change":"2024-09-17T05:44:01.960684+0000","last_active":"2024-09-17T05:44:05.415120+0000","last_peered":"2024-09-17T05:44:05.415120+0000","last_clean":"2024-09-17T05:44:05.415120+0000","last_became_active":"2024-09-17T05:44:01.960310+0000","last_became_peered":"2024-09-17T05:44:01.960310+0000","last_unstale":"2024-09-17T05:44:05.415120+0000","last_undegraded":"2024-09-17T05:44:05.415120+0000","last_fullsized":"2024-09-17T05:44:05.415120+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:44:00.925414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:44:00.925414+0000","last_clean_scrub_stamp":"2024-09-17T05:44:00.925414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:25:07.911474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":13,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T05:44:05.415126+0000","last_change":"2024-09-17T05:44:02.965931+0000","last_active":"2024-09-17T05:44:05.415126+0000","last_peered":"2024-09-17T05:44:05.415126+0000","last_clean":"2024-09-17T05:44:05.415126+0000","last_became_active":"2024-09-17T05:44:02.965685+0000","last_became_peered":"2024-09-17T05:44:02.965685+0000","last_unstale":"2024-09-17T05:44:05.415126+0000","last_undegraded":"2024-09-17T05:44:05.415126+0000","last_fullsized":"2024-09-17T05:44:05.415126+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:44:01.930501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:44:01.930501+0000","last_clean_scrub_stamp":"2024-09-17T05:44:01.930501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:42:28.449626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":15,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T05:44:05.915011+0000","last_change":"2024-09-17T05:44:01.956609+0000","last_active":"2024-09-17T05:44:05.915011+0000","last_peered":"2024-09-17T05:44:05.915011+0000","last_clean":"2024-09-17T05:44:05.915011+0000","last_became_active":"2024-09-17T05:44:01.956251+0000","last_became_peered":"2024-09-17T05:44:01.956251+0000","last_unstale":"2024-09-17T05:44:05.915011+0000","last_undegraded":"2024-09-17T05:44:05.915011+0000","last_fullsized":"2024-09-17T05:44:05.915011+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:44:00.925414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:44:00.925414+0000","last_clean_scrub_stamp":"2024-09-17T05:44:00.925414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:12:38.919452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":13,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T05:44:03.970760+0000","last_change":"2024-09-17T05:44:02.963129+0000","last_active":"2024-09-17T05:44:03.970760+0000","last_peered":"2024-09-17T05:44:03.970760+0000","last_clean":"2024-09-17T05:44:03.970760+0000","last_became_active":"2024-09-17T05:44:02.962771+0000","last_became_peered":"2024-09-17T05:44:02.962771+0000","last_unstale":"2024-09-17T05:44:03.970760+0000","last_undegraded":"2024-09-17T05:44:03.970760+0000","last_fullsized":"2024-09-17T05:44:03.970760+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:44:01.930501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:44:01.930501+0000","last_clean_scrub_stamp":"2024-09-17T05:44:01.930501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:42:32.839604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":15,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T05:44:05.414803+0000","last_change":"2024-09-17T05:44:01.955931+0000","last_active":"2024-09-17T05:44:05.414803+0000","last_peered":"2024-09-17T05:44:05.414803+0000","last_clean":"2024-09-17T05:44:05.414803+0000","last_became_active":"2024-09-17T05:44:01.955587+0000","last_became_peered":"2024-09-17T05:44:01.955587+0000","last_unstale":"2024-09-17T05:44:05.414803+0000","last_undegraded":"2024-09-17T05:44:05.414803+0000","last_fullsized":"2024-09-17T05:44:05.414803+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:44:00.925414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:44:00.925414+0000","last_clean_scrub_stamp":"2024-09-17T05:44:00.925414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:53:49.002592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":13,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T05:44:03.971011+0000","last_change":"2024-09-17T05:44:02.969696+0000","last_active":"2024-09-17T05:44:03.971011+0000","last_peered":"2024-09-17T05:44:03.971011+0000","last_clean":"2024-09-17T05:44:03.971011+0000","last_became_active":"2024-09-17T05:44:02.969397+0000","last_became_peered":"2024-09-17T05:44:02.969397+0000","last_unstale":"2024-09-17T05:44:03.971011+0000","last_undegraded":"2024-09-17T05:44:03.971011+0000","last_fullsized":"2024-09-17T05:44:03.971011+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:44:01.930501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:44:01.930501+0000","last_clean_scrub_stamp":"2024-09-17T05:44:01.930501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:25:36.619406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":15,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T05:44:04.970704+0000","last_change":"2024-09-17T05:44:01.947767+0000","last_active":"2024-09-17T05:44:04.970704+0000","last_peered":"2024-09-17T05:44:04.970704+0000","last_clean":"2024-09-17T05:44:04.970704+0000","last_became_active":"2024-09-17T05:44:01.947426+0000","last_became_peered":"2024-09-17T05:44:01.947426+0000","last_unstale":"2024-09-17T05:44:04.970704+0000","last_undegraded":"2024-09-17T05:44:04.970704+0000","last_fullsized":"2024-09-17T05:44:04.970704+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:44:00.925414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:44:00.925414+0000","last_clean_scrub_stamp":"2024-09-17T05:44:00.925414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:48:16.308463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":13,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T05:44:05.658926+0000","last_change":"2024-09-17T05:44:02.982212+0000","last_active":"2024-09-17T05:44:05.658926+0000","last_peered":"2024-09-17T05:44:05.658926+0000","last_clean":"2024-09-17T05:44:05.658926+0000","last_became_active":"2024-09-17T05:44:02.981857+0000","last_became_peered":"2024-09-17T05:44:02.981857+0000","last_unstale":"2024-09-17T05:44:05.658926+0000","last_undegraded":"2024-09-17T05:44:05.658926+0000","last_fullsized":"2024-09-17T05:44:05.658926+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:44:01.930501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:44:01.930501+0000","last_clean_scrub_stamp":"2024-09-17T05:44:01.930501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:48:36.558940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":15,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T05:44:05.915617+0000","last_change":"2024-09-17T05:44:01.957935+0000","last_active":"2024-09-17T05:44:05.915617+0000","last_peered":"2024-09-17T05:44:05.915617+0000","last_clean":"2024-09-17T05:44:05.915617+0000","last_became_active":"2024-09-17T05:44:01.957554+0000","last_became_peered":"2024-09-17T05:44:01.957554+0000","last_unstale":"2024-09-17T05:44:05.915617+0000","last_undegraded":"2024-09-17T05:44:05.915617+0000","last_fullsized":"2024-09-17T05:44:05.915617+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:44:00.925414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:44:00.925414+0000","last_clean_scrub_stamp":"2024-09-17T05:44:00.925414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:12:38.503949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":13,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T05:44:04.971182+0000","last_change":"2024-09-17T05:44:02.970436+0000","last_active":"2024-09-17T05:44:04.971182+0000","last_peered":"2024-09-17T05:44:04.971182+0000","last_clean":"2024-09-17T05:44:04.971182+0000","last_became_active":"2024-09-17T05:44:02.967032+0000","last_became_peered":"2024-09-17T05:44:02.967032+0000","last_unstale":"2024-09-17T05:44:04.971182+0000","last_undegraded":"2024-09-17T05:44:04.971182+0000","last_fullsized":"2024-09-17T05:44:04.971182+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:44:01.930501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:44:01.930501+0000","last_clean_scrub_stamp":"2024-09-17T05:44:01.930501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:46:37.419245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:44:02.959419+0000","last_change":"2024-09-17T05:44:01.948502+0000","last_active":"2024-09-17T05:44:02.959419+0000","last_peered":"2024-09-17T05:44:02.959419+0000","last_clean":"2024-09-17T05:44:02.959419+0000","last_became_active":"2024-09-17T05:44:01.948181+0000","last_became_peered":"2024-09-17T05:44:01.948181+0000","last_unstale":"2024-09-17T05:44:02.959419+0000","last_undegraded":"2024-09-17T05:44:02.959419+0000","last_fullsized":"2024-09-17T05:44:02.959419+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:44:00.925414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:44:00.925414+0000","last_clean_scrub_stamp":"2024-09-17T05:44:00.925414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:00:31.292020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:44:02.986221+0000","last_change":"2024-09-17T05:44:02.977230+0000","last_active":"2024-09-17T05:44:02.986221+0000","last_peered":"2024-09-17T05:44:02.986221+0000","last_clean":"2024-09-17T05:44:02.986221+0000","last_became_active":"2024-09-17T05:44:02.976922+0000","last_became_peered":"2024-09-17T05:44:02.976922+0000","last_unstale":"2024-09-17T05:44:02.986221+0000","last_undegraded":"2024-09-17T05:44:02.986221+0000","last_fullsized":"2024-09-17T05:44:02.986221+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:44:01.930501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:44:01.930501+0000","last_clean_scrub_stamp":"2024-09-17T05:44:01.930501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:44:44.232120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"44'2","reported_seq":17,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T05:44:05.659350+0000","last_change":"2024-09-17T05:44:01.956246+0000","last_active":"2024-09-17T05:44:05.659350+0000","last_peered":"2024-09-17T05:44:05.659350+0000","last_clean":"2024-09-17T05:44:05.659350+0000","last_became_active":"2024-09-17T05:44:01.954475+0000","last_became_peered":"2024-09-17T05:44:01.954475+0000","last_unstale":"2024-09-17T05:44:05.659350+0000","last_undegraded":"2024-09-17T05:44:05.659350+0000","last_fullsized":"2024-09-17T05:44:05.659350+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:44:00.925414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:44:00.925414+0000","last_clean_scrub_stamp":"2024-09-17T05:44:00.925414+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:41:23.789219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"19'72","reported_seq":151,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T05:44:05.414476+0000","last_change":"2024-09-17T05:41:48.539830+0000","last_active":"2024-09-17T05:44:05.414476+0000","last_peered":"2024-09-17T05:44:05.414476+0000","last_clean":"2024-09-17T05:44:05.414476+0000","last_became_active":"2024-09-17T05:41:48.538743+0000","last_became_peered":"2024-09-17T05:41:48.538743+0000","last_unstale":"2024-09-17T05:44:05.414476+0000","last_undegraded":"2024-09-17T05:44:05.414476+0000","last_fullsized":"2024-09-17T05:44:05.414476+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:47.152539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:47.152539+0000","last_clean_scrub_stamp":"2024-09-17T05:41:47.152539+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:08:02.952016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":4148,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":16,"seq":68719476768,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31660,"kb_used_data":472,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340180,"statfs":{"total":96636764160,"available":96604344320,"internally_reserved":0,"allocated":483328,"data_stored":188869,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":7,"up_from":15,"seq":64424509473,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32280,"kb_used_data":1092,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339560,"statfs":{"total":96636764160,"available":96603709440,"internally_reserved":0,"allocated":1118208,"data_stored":798669,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509472,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31700,"kb_used_data":512,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340140,"statfs":{"total":96636764160,"available":96604303360,"internally_reserved":0,"allocated":524288,"data_stored":208281,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509472,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31712,"kb_used_data":520,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340128,"statfs":{"total":96636764160,"available":96604291072,"internally_reserved":0,"allocated":532480,"data_stored":209823,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509472,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31708,"kb_used_data":520,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340132,"statfs":{"total":96636764160,"available":96604295168,"internally_reserved":0,"allocated":532480,"data_stored":208849,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509472,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31712,"kb_used_data":524,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340128,"statfs":{"total":96636764160,"available":96604291072,"internally_reserved":0,"allocated":536576,"data_stored":209845,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509472,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31696,"kb_used_data":500,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340144,"statfs":{"total":96636764160,"available":96604307456,"internally_reserved":0,"allocated":512000,"data_stored":201981,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574879,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32260,"kb_used_data":1064,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339580,"statfs":{"total":96636764160,"available":96603729920,"internally_reserved":0,"allocated":1089536,"data_stored":785504,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-17T05:44:06.996 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-17T05:44:07.146 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:07.144+0000 7fd5c62b4640 1 -- 172.21.15.150:0/4197753012 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd5c015ee50 msgr2=0x7fd5c00d1090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:44:07.146 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:07.144+0000 7fd5c62b4640 1 --2- 172.21.15.150:0/4197753012 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd5c015ee50 0x7fd5c00d1090 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fd5b4009830 tx=0x7fd5b402a480 comp rx=0 tx=0).stop 2024-09-17T05:44:07.146 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:07.144+0000 7fd5c62b4640 1 -- 172.21.15.150:0/4197753012 shutdown_connections 2024-09-17T05:44:07.146 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:07.144+0000 7fd5c62b4640 1 --2- 172.21.15.150:0/4197753012 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd5c015ee50 0x7fd5c00d1090 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:07.147 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:07.144+0000 7fd5c62b4640 1 --2- 172.21.15.150:0/4197753012 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd5c00b9780 0x7fd5c00b3720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:07.147 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:07.144+0000 7fd5c62b4640 1 -- 172.21.15.150:0/4197753012 >> 172.21.15.150:0/4197753012 conn(0x7fd5c00d4680 msgr2=0x7fd5c00d4a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:44:07.147 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:07.144+0000 7fd5c62b4640 1 -- 172.21.15.150:0/4197753012 shutdown_connections 2024-09-17T05:44:07.147 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:07.144+0000 7fd5c62b4640 1 -- 172.21.15.150:0/4197753012 wait complete. 2024-09-17T05:44:07.147 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:07.146+0000 7fd5c62b4640 1 Processor -- start 2024-09-17T05:44:07.147 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:07.146+0000 7fd5c62b4640 1 -- start start 2024-09-17T05:44:07.150 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:07.147+0000 7fd5c62b4640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd5c00b9780 0x7fd5c0160d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:44:07.151 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:07.147+0000 7fd5c62b4640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd5c00d15d0 0x7fd5c01501f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:44:07.151 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:07.147+0000 7fd5c62b4640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd5c015ee50 0x7fd5c0150730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:44:07.151 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:07.147+0000 7fd5c62b4640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7fd5c00d0810 con 0x7fd5c015ee50 2024-09-17T05:44:07.151 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:07.147+0000 7fd5c62b4640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fd5c00d0690 con 0x7fd5c00b9780 2024-09-17T05:44:07.151 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:07.147+0000 7fd5c62b4640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fd5c0163170 con 0x7fd5c00d15d0 2024-09-17T05:44:07.151 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:07.148+0000 7fd5c4851640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd5c015ee50 0x7fd5c0150730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:44:07.151 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:07.148+0000 7fd5c4851640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd5c015ee50 0x7fd5c0150730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:43158/0 (socket says 172.21.15.150:43158) 2024-09-17T05:44:07.151 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:07.148+0000 7fd5c4851640 1 -- 172.21.15.150:0/3374508473 learned_addr learned my addr 172.21.15.150:0/3374508473 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:44:07.151 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:07.148+0000 7fd5bf7fe640 1 --2- 172.21.15.150:0/3374508473 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd5c00d15d0 0x7fd5c01501f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:44:07.151 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:07.148+0000 7fd5bffff640 1 --2- 172.21.15.150:0/3374508473 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd5c00b9780 0x7fd5c0160d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:44:07.151 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:07.148+0000 7fd5c4851640 1 -- 172.21.15.150:0/3374508473 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd5c00d15d0 msgr2=0x7fd5c01501f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:44:07.152 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:07.148+0000 7fd5c4851640 1 --2- 172.21.15.150:0/3374508473 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd5c00d15d0 0x7fd5c01501f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:07.152 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:07.148+0000 7fd5c4851640 1 -- 172.21.15.150:0/3374508473 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd5c00b9780 msgr2=0x7fd5c0160d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:44:07.152 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:07.148+0000 7fd5c4851640 1 --2- 172.21.15.150:0/3374508473 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd5c00b9780 0x7fd5c0160d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:07.152 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:07.148+0000 7fd5c4851640 1 -- 172.21.15.150:0/3374508473 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd5c00b6a40 con 0x7fd5c015ee50 2024-09-17T05:44:07.152 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:07.148+0000 7fd5bffff640 1 --2- 172.21.15.150:0/3374508473 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd5c00b9780 0x7fd5c0160d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:44:07.152 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:07.148+0000 7fd5c4851640 1 --2- 172.21.15.150:0/3374508473 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd5c015ee50 0x7fd5c0150730 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7fd5b800c6e0 tx=0x7fd5b800cba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:44:07.152 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:07.148+0000 7fd5bcff9640 1 -- 172.21.15.150:0/3374508473 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5b8003b70 con 0x7fd5c015ee50 2024-09-17T05:44:07.152 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:07.148+0000 7fd5bcff9640 1 -- 172.21.15.150:0/3374508473 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd5b8003d10 con 0x7fd5c015ee50 2024-09-17T05:44:07.152 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:07.148+0000 7fd5c62b4640 1 -- 172.21.15.150:0/3374508473 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd5c00b6d20 con 0x7fd5c015ee50 2024-09-17T05:44:07.153 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:07.148+0000 7fd5bcff9640 1 -- 172.21.15.150:0/3374508473 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5b8005330 con 0x7fd5c015ee50 2024-09-17T05:44:07.153 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:07.148+0000 7fd5c62b4640 1 -- 172.21.15.150:0/3374508473 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd5c0161260 con 0x7fd5c015ee50 2024-09-17T05:44:07.153 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:07.149+0000 7fd5c62b4640 1 -- 172.21.15.150:0/3374508473 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd5c00b3fd0 con 0x7fd5c015ee50 2024-09-17T05:44:07.154 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:07.150+0000 7fd5bcff9640 1 -- 172.21.15.150:0/3374508473 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 9) ==== 101747+0+0 (secure 0 0 0) 0x7fd5b80054d0 con 0x7fd5c015ee50 2024-09-17T05:44:07.154 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:07.150+0000 7fd5bcff9640 1 --2- 172.21.15.150:0/3374508473 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fd5ac078f20 0x7fd5ac07b430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:44:07.154 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:07.151+0000 7fd5bcff9640 1 -- 172.21.15.150:0/3374508473 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 5709+0+0 (secure 0 0 0) 0x7fd5b809b1c0 con 0x7fd5c015ee50 2024-09-17T05:44:07.154 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:07.151+0000 7fd5bffff640 1 --2- 172.21.15.150:0/3374508473 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fd5ac078f20 0x7fd5ac07b430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:44:07.154 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:07.151+0000 7fd5bffff640 1 --2- 172.21.15.150:0/3374508473 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fd5ac078f20 0x7fd5ac07b430 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fd5b0009c10 tx=0x7fd5b00091e0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:44:07.156 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:07.156+0000 7fd5bcff9640 1 -- 172.21.15.150:0/3374508473 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fd5c00b3fd0 con 0x7fd5c015ee50 2024-09-17T05:44:07.329 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:07.328+0000 7fd5c62b4640 1 -- 172.21.15.150:0/3374508473 --> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fd5c0163690 con 0x7fd5ac078f20 2024-09-17T05:44:07.334 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:07.333+0000 7fd5bcff9640 1 -- 172.21.15.150:0/3374508473 <== mgr.4108 v2:172.21.15.176:6800/3631216395 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+250970 (secure 0 0 0) 0x7fd5c0163690 con 0x7fd5ac078f20 2024-09-17T05:44:07.336 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-09-17T05:44:07.338 INFO:teuthology.orchestra.run.smithi150.stderr:dumped all 2024-09-17T05:44:07.339 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:07.337+0000 7fd5c62b4640 1 -- 172.21.15.150:0/3374508473 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fd5ac078f20 msgr2=0x7fd5ac07b430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:44:07.339 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:07.337+0000 7fd5c62b4640 1 --2- 172.21.15.150:0/3374508473 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fd5ac078f20 0x7fd5ac07b430 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fd5b0009c10 tx=0x7fd5b00091e0 comp rx=0 tx=0).stop 2024-09-17T05:44:07.339 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:07.337+0000 7fd5c62b4640 1 -- 172.21.15.150:0/3374508473 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd5c015ee50 msgr2=0x7fd5c0150730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:44:07.339 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:07.337+0000 7fd5c62b4640 1 --2- 172.21.15.150:0/3374508473 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd5c015ee50 0x7fd5c0150730 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7fd5b800c6e0 tx=0x7fd5b800cba0 comp rx=0 tx=0).stop 2024-09-17T05:44:07.339 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:07.337+0000 7fd5c62b4640 1 -- 172.21.15.150:0/3374508473 shutdown_connections 2024-09-17T05:44:07.340 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:07.337+0000 7fd5c62b4640 1 --2- 172.21.15.150:0/3374508473 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fd5ac078f20 0x7fd5ac07b430 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:07.340 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:07.337+0000 7fd5c62b4640 1 --2- 172.21.15.150:0/3374508473 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd5c015ee50 0x7fd5c0150730 unknown :-1 s=CLOSED pgs=456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:07.340 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:07.337+0000 7fd5c62b4640 1 --2- 172.21.15.150:0/3374508473 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd5c00d15d0 0x7fd5c01501f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:07.340 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:07.337+0000 7fd5c62b4640 1 --2- 172.21.15.150:0/3374508473 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd5c00b9780 0x7fd5c0160d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:07.340 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:07.337+0000 7fd5c62b4640 1 -- 172.21.15.150:0/3374508473 >> 172.21.15.150:0/3374508473 conn(0x7fd5c00d4680 msgr2=0x7fd5c00b74d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:44:07.340 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:07.337+0000 7fd5c62b4640 1 -- 172.21.15.150:0/3374508473 shutdown_connections 2024-09-17T05:44:07.340 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:07.337+0000 7fd5c62b4640 1 -- 172.21.15.150:0/3374508473 wait complete. 2024-09-17T05:44:07.349 INFO:teuthology.orchestra.run.smithi150.stdout:{"pg_ready":true,"pg_map":{"version":110,"stamp":"2024-09-17T05:44:06.879800+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":146,"num_write_kb":1642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":111,"ondisk_log_size":111,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":140,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":254728,"kb_used_data":5204,"kb_used_omap":12,"kb_used_meta":249331,"kb_avail":754719992,"statfs":{"total":773094113280,"available":772833271808,"internally_reserved":0,"allocated":5328896,"data_stored":2811821,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":255315504},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":34,"apply_latency_ms":34,"commit_latency_ns":34000000,"apply_latency_ns":34000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.947889"},"pg_stats":[{"pgid":"7.3f","version":"0'0","reported_seq":13,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T05:44:05.415186+0000","last_change":"2024-09-17T05:44:02.974554+0000","last_active":"2024-09-17T05:44:05.415186+0000","last_peered":"2024-09-17T05:44:05.415186+0000","last_clean":"2024-09-17T05:44:05.415186+0000","last_became_active":"2024-09-17T05:44:02.974231+0000","last_became_peered":"2024-09-17T05:44:02.974231+0000","last_unstale":"2024-09-17T05:44:05.415186+0000","last_undegraded":"2024-09-17T05:44:05.415186+0000","last_fullsized":"2024-09-17T05:44:05.415186+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:44:01.930501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:44:01.930501+0000","last_clean_scrub_stamp":"2024-09-17T05:44:01.930501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:47:00.250341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3e","version":"0'0","reported_seq":13,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T05:44:05.659404+0000","last_change":"2024-09-17T05:44:02.988339+0000","last_active":"2024-09-17T05:44:05.659404+0000","last_peered":"2024-09-17T05:44:05.659404+0000","last_clean":"2024-09-17T05:44:05.659404+0000","last_became_active":"2024-09-17T05:44:02.987682+0000","last_became_peered":"2024-09-17T05:44:02.987682+0000","last_unstale":"2024-09-17T05:44:05.659404+0000","last_undegraded":"2024-09-17T05:44:05.659404+0000","last_fullsized":"2024-09-17T05:44:05.659404+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:44:01.930501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:44:01.930501+0000","last_clean_scrub_stamp":"2024-09-17T05:44:01.930501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:28:30.401981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3d","version":"0'0","reported_seq":13,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T05:44:04.970610+0000","last_change":"2024-09-17T05:44:02.971036+0000","last_active":"2024-09-17T05:44:04.970610+0000","last_peered":"2024-09-17T05:44:04.970610+0000","last_clean":"2024-09-17T05:44:04.970610+0000","last_became_active":"2024-09-17T05:44:02.970669+0000","last_became_peered":"2024-09-17T05:44:02.970669+0000","last_unstale":"2024-09-17T05:44:04.970610+0000","last_undegraded":"2024-09-17T05:44:04.970610+0000","last_fullsized":"2024-09-17T05:44:04.970610+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:44:01.930501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:44:01.930501+0000","last_clean_scrub_stamp":"2024-09-17T05:44:01.930501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:21:11.719829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3c","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:44:02.986117+0000","last_change":"2024-09-17T05:44:02.975046+0000","last_active":"2024-09-17T05:44:02.986117+0000","last_peered":"2024-09-17T05:44:02.986117+0000","last_clean":"2024-09-17T05:44:02.986117+0000","last_became_active":"2024-09-17T05:44:02.973872+0000","last_became_peered":"2024-09-17T05:44:02.973872+0000","last_unstale":"2024-09-17T05:44:02.986117+0000","last_undegraded":"2024-09-17T05:44:02.986117+0000","last_fullsized":"2024-09-17T05:44:02.986117+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:44:01.930501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:44:01.930501+0000","last_clean_scrub_stamp":"2024-09-17T05:44:01.930501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:23:39.449652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3b","version":"0'0","reported_seq":13,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T05:44:05.659101+0000","last_change":"2024-09-17T05:44:02.987062+0000","last_active":"2024-09-17T05:44:05.659101+0000","last_peered":"2024-09-17T05:44:05.659101+0000","last_clean":"2024-09-17T05:44:05.659101+0000","last_became_active":"2024-09-17T05:44:02.986714+0000","last_became_peered":"2024-09-17T05:44:02.986714+0000","last_unstale":"2024-09-17T05:44:05.659101+0000","last_undegraded":"2024-09-17T05:44:05.659101+0000","last_fullsized":"2024-09-17T05:44:05.659101+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:44:01.930501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:44:01.930501+0000","last_clean_scrub_stamp":"2024-09-17T05:44:01.930501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:42:40.168866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3a","version":"0'0","reported_seq":13,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T05:44:03.970509+0000","last_change":"2024-09-17T05:44:02.967402+0000","last_active":"2024-09-17T05:44:03.970509+0000","last_peered":"2024-09-17T05:44:03.970509+0000","last_clean":"2024-09-17T05:44:03.970509+0000","last_became_active":"2024-09-17T05:44:02.967118+0000","last_became_peered":"2024-09-17T05:44:02.967118+0000","last_unstale":"2024-09-17T05:44:03.970509+0000","last_undegraded":"2024-09-17T05:44:03.970509+0000","last_fullsized":"2024-09-17T05:44:03.970509+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:44:01.930501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:44:01.930501+0000","last_clean_scrub_stamp":"2024-09-17T05:44:01.930501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:42:22.361286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.39","version":"0'0","reported_seq":13,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T05:44:05.414847+0000","last_change":"2024-09-17T05:44:02.964592+0000","last_active":"2024-09-17T05:44:05.414847+0000","last_peered":"2024-09-17T05:44:05.414847+0000","last_clean":"2024-09-17T05:44:05.414847+0000","last_became_active":"2024-09-17T05:44:02.964316+0000","last_became_peered":"2024-09-17T05:44:02.964316+0000","last_unstale":"2024-09-17T05:44:05.414847+0000","last_undegraded":"2024-09-17T05:44:05.414847+0000","last_fullsized":"2024-09-17T05:44:05.414847+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:44:01.930501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:44:01.930501+0000","last_clean_scrub_stamp":"2024-09-17T05:44:01.930501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:18:09.625824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.38","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:44:02.993116+0000","last_change":"2024-09-17T05:44:02.988346+0000","last_active":"2024-09-17T05:44:02.993116+0000","last_peered":"2024-09-17T05:44:02.993116+0000","last_clean":"2024-09-17T05:44:02.993116+0000","last_became_active":"2024-09-17T05:44:02.987992+0000","last_became_peered":"2024-09-17T05:44:02.987992+0000","last_unstale":"2024-09-17T05:44:02.993116+0000","last_undegraded":"2024-09-17T05:44:02.993116+0000","last_fullsized":"2024-09-17T05:44:02.993116+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:44:01.930501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:44:01.930501+0000","last_clean_scrub_stamp":"2024-09-17T05:44:01.930501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:50:42.000977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.37","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:44:02.983745+0000","last_change":"2024-09-17T05:44:02.967050+0000","last_active":"2024-09-17T05:44:02.983745+0000","last_peered":"2024-09-17T05:44:02.983745+0000","last_clean":"2024-09-17T05:44:02.983745+0000","last_became_active":"2024-09-17T05:44:02.966728+0000","last_became_peered":"2024-09-17T05:44:02.966728+0000","last_unstale":"2024-09-17T05:44:02.983745+0000","last_undegraded":"2024-09-17T05:44:02.983745+0000","last_fullsized":"2024-09-17T05:44:02.983745+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:44:01.930501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:44:01.930501+0000","last_clean_scrub_stamp":"2024-09-17T05:44:01.930501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:52:36.822899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.36","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:44:02.986190+0000","last_change":"2024-09-17T05:44:02.975494+0000","last_active":"2024-09-17T05:44:02.986190+0000","last_peered":"2024-09-17T05:44:02.986190+0000","last_clean":"2024-09-17T05:44:02.986190+0000","last_became_active":"2024-09-17T05:44:02.975170+0000","last_became_peered":"2024-09-17T05:44:02.975170+0000","last_unstale":"2024-09-17T05:44:02.986190+0000","last_undegraded":"2024-09-17T05:44:02.986190+0000","last_fullsized":"2024-09-17T05:44:02.986190+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:44:01.930501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:44:01.930501+0000","last_clean_scrub_stamp":"2024-09-17T05:44:01.930501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:24:41.631032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.35","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:44:02.986369+0000","last_change":"2024-09-17T05:44:02.975023+0000","last_active":"2024-09-17T05:44:02.986369+0000","last_peered":"2024-09-17T05:44:02.986369+0000","last_clean":"2024-09-17T05:44:02.986369+0000","last_became_active":"2024-09-17T05:44:02.974597+0000","last_became_peered":"2024-09-17T05:44:02.974597+0000","last_unstale":"2024-09-17T05:44:02.986369+0000","last_undegraded":"2024-09-17T05:44:02.986369+0000","last_fullsized":"2024-09-17T05:44:02.986369+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:44:01.930501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:44:01.930501+0000","last_clean_scrub_stamp":"2024-09-17T05:44:01.930501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:23:02.419379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.34","version":"0'0","reported_seq":13,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T05:44:05.659346+0000","last_change":"2024-09-17T05:44:02.983676+0000","last_active":"2024-09-17T05:44:05.659346+0000","last_peered":"2024-09-17T05:44:05.659346+0000","last_clean":"2024-09-17T05:44:05.659346+0000","last_became_active":"2024-09-17T05:44:02.983071+0000","last_became_peered":"2024-09-17T05:44:02.983071+0000","last_unstale":"2024-09-17T05:44:05.659346+0000","last_undegraded":"2024-09-17T05:44:05.659346+0000","last_fullsized":"2024-09-17T05:44:05.659346+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:44:01.930501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:44:01.930501+0000","last_clean_scrub_stamp":"2024-09-17T05:44:01.930501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:45:10.615693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.33","version":"0'0","reported_seq":13,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T05:44:03.970768+0000","last_change":"2024-09-17T05:44:02.976306+0000","last_active":"2024-09-17T05:44:03.970768+0000","last_peered":"2024-09-17T05:44:03.970768+0000","last_clean":"2024-09-17T05:44:03.970768+0000","last_became_active":"2024-09-17T05:44:02.975950+0000","last_became_peered":"2024-09-17T05:44:02.975950+0000","last_unstale":"2024-09-17T05:44:03.970768+0000","last_undegraded":"2024-09-17T05:44:03.970768+0000","last_fullsized":"2024-09-17T05:44:03.970768+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:44:01.930501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:44:01.930501+0000","last_clean_scrub_stamp":"2024-09-17T05:44:01.930501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:16:15.916655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.32","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:44:02.983744+0000","last_change":"2024-09-17T05:44:02.964776+0000","last_active":"2024-09-17T05:44:02.983744+0000","last_peered":"2024-09-17T05:44:02.983744+0000","last_clean":"2024-09-17T05:44:02.983744+0000","last_became_active":"2024-09-17T05:44:02.964467+0000","last_became_peered":"2024-09-17T05:44:02.964467+0000","last_unstale":"2024-09-17T05:44:02.983744+0000","last_undegraded":"2024-09-17T05:44:02.983744+0000","last_fullsized":"2024-09-17T05:44:02.983744+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:44:01.930501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:44:01.930501+0000","last_clean_scrub_stamp":"2024-09-17T05:44:01.930501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:58:37.326070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.31","version":"0'0","reported_seq":13,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T05:44:03.970324+0000","last_change":"2024-09-17T05:44:02.973423+0000","last_active":"2024-09-17T05:44:03.970324+0000","last_peered":"2024-09-17T05:44:03.970324+0000","last_clean":"2024-09-17T05:44:03.970324+0000","last_became_active":"2024-09-17T05:44:02.973088+0000","last_became_peered":"2024-09-17T05:44:02.973088+0000","last_unstale":"2024-09-17T05:44:03.970324+0000","last_undegraded":"2024-09-17T05:44:03.970324+0000","last_fullsized":"2024-09-17T05:44:03.970324+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:44:01.930501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:44:01.930501+0000","last_clean_scrub_stamp":"2024-09-17T05:44:01.930501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:48:33.128790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.30","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-09-17T05:44:01.946541+0000","last_change":"2024-09-17T05:44:01.946541+0000","last_active":"2024-09-17T05:44:01.930501+0000","last_peered":"2024-09-17T05:44:01.930501+0000","last_clean":"2024-09-17T05:44:01.930501+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:44:01.946541+0000","last_undegraded":"2024-09-17T05:44:01.946541+0000","last_fullsized":"2024-09-17T05:44:01.946541+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:44:01.930501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:44:01.930501+0000","last_clean_scrub_stamp":"2024-09-17T05:44:01.930501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.2f","version":"0'0","reported_seq":13,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T05:44:04.970797+0000","last_change":"2024-09-17T05:44:02.980385+0000","last_active":"2024-09-17T05:44:04.970797+0000","last_peered":"2024-09-17T05:44:04.970797+0000","last_clean":"2024-09-17T05:44:04.970797+0000","last_became_active":"2024-09-17T05:44:02.979899+0000","last_became_peered":"2024-09-17T05:44:02.979899+0000","last_unstale":"2024-09-17T05:44:04.970797+0000","last_undegraded":"2024-09-17T05:44:04.970797+0000","last_fullsized":"2024-09-17T05:44:04.970797+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:44:01.930501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:44:01.930501+0000","last_clean_scrub_stamp":"2024-09-17T05:44:01.930501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:06:08.980606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2e","version":"0'0","reported_seq":13,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T05:44:04.971126+0000","last_change":"2024-09-17T05:44:02.987933+0000","last_active":"2024-09-17T05:44:04.971126+0000","last_peered":"2024-09-17T05:44:04.971126+0000","last_clean":"2024-09-17T05:44:04.971126+0000","last_became_active":"2024-09-17T05:44:02.986841+0000","last_became_peered":"2024-09-17T05:44:02.986841+0000","last_unstale":"2024-09-17T05:44:04.971126+0000","last_undegraded":"2024-09-17T05:44:04.971126+0000","last_fullsized":"2024-09-17T05:44:04.971126+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:44:01.930501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:44:01.930501+0000","last_clean_scrub_stamp":"2024-09-17T05:44:01.930501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:16:54.417419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2d","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-09-17T05:44:01.946426+0000","last_change":"2024-09-17T05:44:01.946426+0000","last_active":"2024-09-17T05:44:01.930501+0000","last_peered":"2024-09-17T05:44:01.930501+0000","last_clean":"2024-09-17T05:44:01.930501+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:44:01.946426+0000","last_undegraded":"2024-09-17T05:44:01.946426+0000","last_fullsized":"2024-09-17T05:44:01.946426+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:44:01.930501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:44:01.930501+0000","last_clean_scrub_stamp":"2024-09-17T05:44:01.930501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.2c","version":"0'0","reported_seq":13,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T05:44:03.971091+0000","last_change":"2024-09-17T05:44:02.975384+0000","last_active":"2024-09-17T05:44:03.971091+0000","last_peered":"2024-09-17T05:44:03.971091+0000","last_clean":"2024-09-17T05:44:03.971091+0000","last_became_active":"2024-09-17T05:44:02.969887+0000","last_became_peered":"2024-09-17T05:44:02.969887+0000","last_unstale":"2024-09-17T05:44:03.971091+0000","last_undegraded":"2024-09-17T05:44:03.971091+0000","last_fullsized":"2024-09-17T05:44:03.971091+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:44:01.930501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:44:01.930501+0000","last_clean_scrub_stamp":"2024-09-17T05:44:01.930501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:57:47.626723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2b","version":"0'0","reported_seq":13,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T05:44:03.971047+0000","last_change":"2024-09-17T05:44:02.975815+0000","last_active":"2024-09-17T05:44:03.971047+0000","last_peered":"2024-09-17T05:44:03.971047+0000","last_clean":"2024-09-17T05:44:03.971047+0000","last_became_active":"2024-09-17T05:44:02.975521+0000","last_became_peered":"2024-09-17T05:44:02.975521+0000","last_unstale":"2024-09-17T05:44:03.971047+0000","last_undegraded":"2024-09-17T05:44:03.971047+0000","last_fullsized":"2024-09-17T05:44:03.971047+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:44:01.930501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:44:01.930501+0000","last_clean_scrub_stamp":"2024-09-17T05:44:01.930501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:26:45.903869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.2a","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:44:02.986331+0000","last_change":"2024-09-17T05:44:02.976190+0000","last_active":"2024-09-17T05:44:02.986331+0000","last_peered":"2024-09-17T05:44:02.986331+0000","last_clean":"2024-09-17T05:44:02.986331+0000","last_became_active":"2024-09-17T05:44:02.975892+0000","last_became_peered":"2024-09-17T05:44:02.975892+0000","last_unstale":"2024-09-17T05:44:02.986331+0000","last_undegraded":"2024-09-17T05:44:02.986331+0000","last_fullsized":"2024-09-17T05:44:02.986331+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:44:01.930501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:44:01.930501+0000","last_clean_scrub_stamp":"2024-09-17T05:44:01.930501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:17:11.221074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.29","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-09-17T05:44:01.948604+0000","last_change":"2024-09-17T05:44:01.948604+0000","last_active":"2024-09-17T05:44:01.930501+0000","last_peered":"2024-09-17T05:44:01.930501+0000","last_clean":"2024-09-17T05:44:01.930501+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:44:01.948604+0000","last_undegraded":"2024-09-17T05:44:01.948604+0000","last_fullsized":"2024-09-17T05:44:01.948604+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:44:01.930501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:44:01.930501+0000","last_clean_scrub_stamp":"2024-09-17T05:44:01.930501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.28","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-09-17T05:44:01.945901+0000","last_change":"2024-09-17T05:44:01.945901+0000","last_active":"2024-09-17T05:44:01.930501+0000","last_peered":"2024-09-17T05:44:01.930501+0000","last_clean":"2024-09-17T05:44:01.930501+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:44:01.945901+0000","last_undegraded":"2024-09-17T05:44:01.945901+0000","last_fullsized":"2024-09-17T05:44:01.945901+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:44:01.930501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:44:01.930501+0000","last_clean_scrub_stamp":"2024-09-17T05:44:01.930501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.27","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-09-17T05:44:01.949356+0000","last_change":"2024-09-17T05:44:01.949356+0000","last_active":"2024-09-17T05:44:01.930501+0000","last_peered":"2024-09-17T05:44:01.930501+0000","last_clean":"2024-09-17T05:44:01.930501+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:44:01.949356+0000","last_undegraded":"2024-09-17T05:44:01.949356+0000","last_fullsized":"2024-09-17T05:44:01.949356+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:44:01.930501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:44:01.930501+0000","last_clean_scrub_stamp":"2024-09-17T05:44:01.930501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.26","version":"0'0","reported_seq":13,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T05:44:03.970968+0000","last_change":"2024-09-17T05:44:02.975515+0000","last_active":"2024-09-17T05:44:03.970968+0000","last_peered":"2024-09-17T05:44:03.970968+0000","last_clean":"2024-09-17T05:44:03.970968+0000","last_became_active":"2024-09-17T05:44:02.975200+0000","last_became_peered":"2024-09-17T05:44:02.975200+0000","last_unstale":"2024-09-17T05:44:03.970968+0000","last_undegraded":"2024-09-17T05:44:03.970968+0000","last_fullsized":"2024-09-17T05:44:03.970968+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:44:01.930501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:44:01.930501+0000","last_clean_scrub_stamp":"2024-09-17T05:44:01.930501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:00:49.479958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.25","version":"0'0","reported_seq":13,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T05:44:04.970651+0000","last_change":"2024-09-17T05:44:02.980263+0000","last_active":"2024-09-17T05:44:04.970651+0000","last_peered":"2024-09-17T05:44:04.970651+0000","last_clean":"2024-09-17T05:44:04.970651+0000","last_became_active":"2024-09-17T05:44:02.979881+0000","last_became_peered":"2024-09-17T05:44:02.979881+0000","last_unstale":"2024-09-17T05:44:04.970651+0000","last_undegraded":"2024-09-17T05:44:04.970651+0000","last_fullsized":"2024-09-17T05:44:04.970651+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:44:01.930501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:44:01.930501+0000","last_clean_scrub_stamp":"2024-09-17T05:44:01.930501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:55:06.339857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.24","version":"0'0","reported_seq":13,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T05:44:05.659277+0000","last_change":"2024-09-17T05:44:02.983423+0000","last_active":"2024-09-17T05:44:05.659277+0000","last_peered":"2024-09-17T05:44:05.659277+0000","last_clean":"2024-09-17T05:44:05.659277+0000","last_became_active":"2024-09-17T05:44:02.982942+0000","last_became_peered":"2024-09-17T05:44:02.982942+0000","last_unstale":"2024-09-17T05:44:05.659277+0000","last_undegraded":"2024-09-17T05:44:05.659277+0000","last_fullsized":"2024-09-17T05:44:05.659277+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:44:01.930501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:44:01.930501+0000","last_clean_scrub_stamp":"2024-09-17T05:44:01.930501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:23:24.999309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.23","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-09-17T05:44:01.945462+0000","last_change":"2024-09-17T05:44:01.945462+0000","last_active":"2024-09-17T05:44:01.930501+0000","last_peered":"2024-09-17T05:44:01.930501+0000","last_clean":"2024-09-17T05:44:01.930501+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:44:01.945462+0000","last_undegraded":"2024-09-17T05:44:01.945462+0000","last_fullsized":"2024-09-17T05:44:01.945462+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:44:01.930501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:44:01.930501+0000","last_clean_scrub_stamp":"2024-09-17T05:44:01.930501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.22","version":"0'0","reported_seq":13,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T05:44:04.970507+0000","last_change":"2024-09-17T05:44:02.973004+0000","last_active":"2024-09-17T05:44:04.970507+0000","last_peered":"2024-09-17T05:44:04.970507+0000","last_clean":"2024-09-17T05:44:04.970507+0000","last_became_active":"2024-09-17T05:44:02.972681+0000","last_became_peered":"2024-09-17T05:44:02.972681+0000","last_unstale":"2024-09-17T05:44:04.970507+0000","last_undegraded":"2024-09-17T05:44:04.970507+0000","last_fullsized":"2024-09-17T05:44:04.970507+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:44:01.930501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:44:01.930501+0000","last_clean_scrub_stamp":"2024-09-17T05:44:01.930501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:41:24.794306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.21","version":"0'0","reported_seq":13,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T05:44:03.970995+0000","last_change":"2024-09-17T05:44:02.977953+0000","last_active":"2024-09-17T05:44:03.970995+0000","last_peered":"2024-09-17T05:44:03.970995+0000","last_clean":"2024-09-17T05:44:03.970995+0000","last_became_active":"2024-09-17T05:44:02.977624+0000","last_became_peered":"2024-09-17T05:44:02.977624+0000","last_unstale":"2024-09-17T05:44:03.970995+0000","last_undegraded":"2024-09-17T05:44:03.970995+0000","last_fullsized":"2024-09-17T05:44:03.970995+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:44:01.930501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:44:01.930501+0000","last_clean_scrub_stamp":"2024-09-17T05:44:01.930501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:51:59.823755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.20","version":"0'0","reported_seq":13,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T05:44:03.971876+0000","last_change":"2024-09-17T05:44:02.978709+0000","last_active":"2024-09-17T05:44:03.971876+0000","last_peered":"2024-09-17T05:44:03.971876+0000","last_clean":"2024-09-17T05:44:03.971876+0000","last_became_active":"2024-09-17T05:44:02.978052+0000","last_became_peered":"2024-09-17T05:44:02.978052+0000","last_unstale":"2024-09-17T05:44:03.971876+0000","last_undegraded":"2024-09-17T05:44:03.971876+0000","last_fullsized":"2024-09-17T05:44:03.971876+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:44:01.930501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:44:01.930501+0000","last_clean_scrub_stamp":"2024-09-17T05:44:01.930501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:42:10.964610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":13,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T05:44:05.915609+0000","last_change":"2024-09-17T05:44:02.965033+0000","last_active":"2024-09-17T05:44:05.915609+0000","last_peered":"2024-09-17T05:44:05.915609+0000","last_clean":"2024-09-17T05:44:05.915609+0000","last_became_active":"2024-09-17T05:44:02.964721+0000","last_became_peered":"2024-09-17T05:44:02.964721+0000","last_unstale":"2024-09-17T05:44:05.915609+0000","last_undegraded":"2024-09-17T05:44:05.915609+0000","last_fullsized":"2024-09-17T05:44:05.915609+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:44:01.930501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:44:01.930501+0000","last_clean_scrub_stamp":"2024-09-17T05:44:01.930501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:44:44.295610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"44'4","reported_seq":19,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T05:44:03.970754+0000","last_change":"2024-09-17T05:44:01.954506+0000","last_active":"2024-09-17T05:44:03.970754+0000","last_peered":"2024-09-17T05:44:03.970754+0000","last_clean":"2024-09-17T05:44:03.970754+0000","last_became_active":"2024-09-17T05:44:01.954200+0000","last_became_peered":"2024-09-17T05:44:01.954200+0000","last_unstale":"2024-09-17T05:44:03.970754+0000","last_undegraded":"2024-09-17T05:44:03.970754+0000","last_fullsized":"2024-09-17T05:44:03.970754+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:44:00.925414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:44:00.925414+0000","last_clean_scrub_stamp":"2024-09-17T05:44:00.925414+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:06:07.975519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-09-17T05:44:01.948703+0000","last_change":"2024-09-17T05:44:01.948703+0000","last_active":"2024-09-17T05:44:01.930501+0000","last_peered":"2024-09-17T05:44:01.930501+0000","last_clean":"2024-09-17T05:44:01.930501+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:44:01.948703+0000","last_undegraded":"2024-09-17T05:44:01.948703+0000","last_fullsized":"2024-09-17T05:44:01.948703+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:44:01.930501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:44:01.930501+0000","last_clean_scrub_stamp":"2024-09-17T05:44:01.930501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1e","version":"44'1","reported_seq":16,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T05:44:04.971199+0000","last_change":"2024-09-17T05:44:01.952534+0000","last_active":"2024-09-17T05:44:04.971199+0000","last_peered":"2024-09-17T05:44:04.971199+0000","last_clean":"2024-09-17T05:44:04.971199+0000","last_became_active":"2024-09-17T05:44:01.952187+0000","last_became_peered":"2024-09-17T05:44:01.952187+0000","last_unstale":"2024-09-17T05:44:04.971199+0000","last_undegraded":"2024-09-17T05:44:04.971199+0000","last_fullsized":"2024-09-17T05:44:04.971199+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:44:00.925414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:44:00.925414+0000","last_clean_scrub_stamp":"2024-09-17T05:44:00.925414+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:12:38.503949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":13,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T05:44:05.659502+0000","last_change":"2024-09-17T05:44:02.980083+0000","last_active":"2024-09-17T05:44:05.659502+0000","last_peered":"2024-09-17T05:44:05.659502+0000","last_clean":"2024-09-17T05:44:05.659502+0000","last_became_active":"2024-09-17T05:44:02.979747+0000","last_became_peered":"2024-09-17T05:44:02.979747+0000","last_unstale":"2024-09-17T05:44:05.659502+0000","last_undegraded":"2024-09-17T05:44:05.659502+0000","last_fullsized":"2024-09-17T05:44:05.659502+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:44:01.930501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:44:01.930501+0000","last_clean_scrub_stamp":"2024-09-17T05:44:01.930501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:51:23.709979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1d","version":"44'2","reported_seq":17,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T05:44:05.915916+0000","last_change":"2024-09-17T05:44:01.956537+0000","last_active":"2024-09-17T05:44:05.915916+0000","last_peered":"2024-09-17T05:44:05.915916+0000","last_clean":"2024-09-17T05:44:05.915916+0000","last_became_active":"2024-09-17T05:44:01.956185+0000","last_became_peered":"2024-09-17T05:44:01.956185+0000","last_unstale":"2024-09-17T05:44:05.915916+0000","last_undegraded":"2024-09-17T05:44:05.915916+0000","last_fullsized":"2024-09-17T05:44:05.915916+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:44:00.925414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:44:00.925414+0000","last_clean_scrub_stamp":"2024-09-17T05:44:00.925414+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:46:03.151717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":13,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T05:44:05.916049+0000","last_change":"2024-09-17T05:44:02.976645+0000","last_active":"2024-09-17T05:44:05.916049+0000","last_peered":"2024-09-17T05:44:05.916049+0000","last_clean":"2024-09-17T05:44:05.916049+0000","last_became_active":"2024-09-17T05:44:02.976312+0000","last_became_peered":"2024-09-17T05:44:02.976312+0000","last_unstale":"2024-09-17T05:44:05.916049+0000","last_undegraded":"2024-09-17T05:44:05.916049+0000","last_fullsized":"2024-09-17T05:44:05.916049+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:44:01.930501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:44:01.930501+0000","last_clean_scrub_stamp":"2024-09-17T05:44:01.930501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:05:28.918610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"44'2","reported_seq":17,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T05:44:05.414708+0000","last_change":"2024-09-17T05:44:01.957595+0000","last_active":"2024-09-17T05:44:05.414708+0000","last_peered":"2024-09-17T05:44:05.414708+0000","last_clean":"2024-09-17T05:44:05.414708+0000","last_became_active":"2024-09-17T05:44:01.957224+0000","last_became_peered":"2024-09-17T05:44:01.957224+0000","last_unstale":"2024-09-17T05:44:05.414708+0000","last_undegraded":"2024-09-17T05:44:05.414708+0000","last_fullsized":"2024-09-17T05:44:05.414708+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:44:00.925414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:44:00.925414+0000","last_clean_scrub_stamp":"2024-09-17T05:44:00.925414+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:35:05.665060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":13,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T05:44:04.970762+0000","last_change":"2024-09-17T05:44:02.976326+0000","last_active":"2024-09-17T05:44:04.970762+0000","last_peered":"2024-09-17T05:44:04.970762+0000","last_clean":"2024-09-17T05:44:04.970762+0000","last_became_active":"2024-09-17T05:44:02.975980+0000","last_became_peered":"2024-09-17T05:44:02.975980+0000","last_unstale":"2024-09-17T05:44:04.970762+0000","last_undegraded":"2024-09-17T05:44:04.970762+0000","last_fullsized":"2024-09-17T05:44:04.970762+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:44:01.930501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:44:01.930501+0000","last_clean_scrub_stamp":"2024-09-17T05:44:01.930501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:51:53.246482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"44'1","reported_seq":16,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T05:44:03.971076+0000","last_change":"2024-09-17T05:44:01.949683+0000","last_active":"2024-09-17T05:44:03.971076+0000","last_peered":"2024-09-17T05:44:03.971076+0000","last_clean":"2024-09-17T05:44:03.971076+0000","last_became_active":"2024-09-17T05:44:01.949320+0000","last_became_peered":"2024-09-17T05:44:01.949320+0000","last_unstale":"2024-09-17T05:44:03.971076+0000","last_undegraded":"2024-09-17T05:44:03.971076+0000","last_fullsized":"2024-09-17T05:44:03.971076+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:44:00.925414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:44:00.925414+0000","last_clean_scrub_stamp":"2024-09-17T05:44:00.925414+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:46:36.414158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:44:02.986043+0000","last_change":"2024-09-17T05:44:02.968696+0000","last_active":"2024-09-17T05:44:02.986043+0000","last_peered":"2024-09-17T05:44:02.986043+0000","last_clean":"2024-09-17T05:44:02.986043+0000","last_became_active":"2024-09-17T05:44:02.968360+0000","last_became_peered":"2024-09-17T05:44:02.968360+0000","last_unstale":"2024-09-17T05:44:02.986043+0000","last_undegraded":"2024-09-17T05:44:02.986043+0000","last_fullsized":"2024-09-17T05:44:02.986043+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:44:01.930501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:44:01.930501+0000","last_clean_scrub_stamp":"2024-09-17T05:44:01.930501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:05:09.812483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1a","version":"44'1","reported_seq":16,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T05:44:04.970598+0000","last_change":"2024-09-17T05:44:01.949830+0000","last_active":"2024-09-17T05:44:04.970598+0000","last_peered":"2024-09-17T05:44:04.970598+0000","last_clean":"2024-09-17T05:44:04.970598+0000","last_became_active":"2024-09-17T05:44:01.949509+0000","last_became_peered":"2024-09-17T05:44:01.949509+0000","last_unstale":"2024-09-17T05:44:04.970598+0000","last_undegraded":"2024-09-17T05:44:04.970598+0000","last_fullsized":"2024-09-17T05:44:04.970598+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:44:00.925414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:44:00.925414+0000","last_clean_scrub_stamp":"2024-09-17T05:44:00.925414+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:13:58.348730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:44:02.993131+0000","last_change":"2024-09-17T05:44:02.989081+0000","last_active":"2024-09-17T05:44:02.993131+0000","last_peered":"2024-09-17T05:44:02.993131+0000","last_clean":"2024-09-17T05:44:02.993131+0000","last_became_active":"2024-09-17T05:44:02.988354+0000","last_became_peered":"2024-09-17T05:44:02.988354+0000","last_unstale":"2024-09-17T05:44:02.993131+0000","last_undegraded":"2024-09-17T05:44:02.993131+0000","last_fullsized":"2024-09-17T05:44:02.993131+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:44:01.930501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:44:01.930501+0000","last_clean_scrub_stamp":"2024-09-17T05:44:01.930501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:36:28.222836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":15,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T05:44:05.658774+0000","last_change":"2024-09-17T05:44:01.955804+0000","last_active":"2024-09-17T05:44:05.658774+0000","last_peered":"2024-09-17T05:44:05.658774+0000","last_clean":"2024-09-17T05:44:05.658774+0000","last_became_active":"2024-09-17T05:44:01.955195+0000","last_became_peered":"2024-09-17T05:44:01.955195+0000","last_unstale":"2024-09-17T05:44:05.658774+0000","last_undegraded":"2024-09-17T05:44:05.658774+0000","last_fullsized":"2024-09-17T05:44:05.658774+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:44:00.925414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:44:00.925414+0000","last_clean_scrub_stamp":"2024-09-17T05:44:00.925414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:44:43.290523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-09-17T05:44:01.949231+0000","last_change":"2024-09-17T05:44:01.949231+0000","last_active":"2024-09-17T05:44:01.930501+0000","last_peered":"2024-09-17T05:44:01.930501+0000","last_clean":"2024-09-17T05:44:01.930501+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:44:01.949231+0000","last_undegraded":"2024-09-17T05:44:01.949231+0000","last_fullsized":"2024-09-17T05:44:01.949231+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:44:01.930501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:44:01.930501+0000","last_clean_scrub_stamp":"2024-09-17T05:44:01.930501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:44:02.958951+0000","last_change":"2024-09-17T05:44:01.949647+0000","last_active":"2024-09-17T05:44:02.958951+0000","last_peered":"2024-09-17T05:44:02.958951+0000","last_clean":"2024-09-17T05:44:02.958951+0000","last_became_active":"2024-09-17T05:44:01.949263+0000","last_became_peered":"2024-09-17T05:44:01.949263+0000","last_unstale":"2024-09-17T05:44:02.958951+0000","last_undegraded":"2024-09-17T05:44:02.958951+0000","last_fullsized":"2024-09-17T05:44:02.958951+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:44:00.925414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:44:00.925414+0000","last_clean_scrub_stamp":"2024-09-17T05:44:00.925414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:26:01.492424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":13,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T05:44:04.971121+0000","last_change":"2024-09-17T05:44:02.987319+0000","last_active":"2024-09-17T05:44:04.971121+0000","last_peered":"2024-09-17T05:44:04.971121+0000","last_clean":"2024-09-17T05:44:04.971121+0000","last_became_active":"2024-09-17T05:44:02.986401+0000","last_became_peered":"2024-09-17T05:44:02.986401+0000","last_unstale":"2024-09-17T05:44:04.971121+0000","last_undegraded":"2024-09-17T05:44:04.971121+0000","last_fullsized":"2024-09-17T05:44:04.971121+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:44:01.930501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:44:01.930501+0000","last_clean_scrub_stamp":"2024-09-17T05:44:01.930501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:36:30.650560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":15,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T05:44:04.970859+0000","last_change":"2024-09-17T05:44:01.951077+0000","last_active":"2024-09-17T05:44:04.970859+0000","last_peered":"2024-09-17T05:44:04.970859+0000","last_clean":"2024-09-17T05:44:04.970859+0000","last_became_active":"2024-09-17T05:44:01.950715+0000","last_became_peered":"2024-09-17T05:44:01.950715+0000","last_unstale":"2024-09-17T05:44:04.970859+0000","last_undegraded":"2024-09-17T05:44:04.970859+0000","last_fullsized":"2024-09-17T05:44:04.970859+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:44:00.925414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:44:00.925414+0000","last_clean_scrub_stamp":"2024-09-17T05:44:00.925414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:34:19.904802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":13,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T05:44:05.415322+0000","last_change":"2024-09-17T05:44:02.980515+0000","last_active":"2024-09-17T05:44:05.415322+0000","last_peered":"2024-09-17T05:44:05.415322+0000","last_clean":"2024-09-17T05:44:05.415322+0000","last_became_active":"2024-09-17T05:44:02.980069+0000","last_became_peered":"2024-09-17T05:44:02.980069+0000","last_unstale":"2024-09-17T05:44:05.415322+0000","last_undegraded":"2024-09-17T05:44:05.415322+0000","last_fullsized":"2024-09-17T05:44:05.415322+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:44:01.930501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:44:01.930501+0000","last_clean_scrub_stamp":"2024-09-17T05:44:01.930501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:35:11.922195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:44:02.959919+0000","last_change":"2024-09-17T05:44:01.950607+0000","last_active":"2024-09-17T05:44:02.959919+0000","last_peered":"2024-09-17T05:44:02.959919+0000","last_clean":"2024-09-17T05:44:02.959919+0000","last_became_active":"2024-09-17T05:44:01.950263+0000","last_became_peered":"2024-09-17T05:44:01.950263+0000","last_unstale":"2024-09-17T05:44:02.959919+0000","last_undegraded":"2024-09-17T05:44:02.959919+0000","last_fullsized":"2024-09-17T05:44:02.959919+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:44:00.925414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:44:00.925414+0000","last_clean_scrub_stamp":"2024-09-17T05:44:00.925414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:53:32.014377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":13,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T05:44:03.970541+0000","last_change":"2024-09-17T05:44:02.970209+0000","last_active":"2024-09-17T05:44:03.970541+0000","last_peered":"2024-09-17T05:44:03.970541+0000","last_clean":"2024-09-17T05:44:03.970541+0000","last_became_active":"2024-09-17T05:44:02.969924+0000","last_became_peered":"2024-09-17T05:44:02.969924+0000","last_unstale":"2024-09-17T05:44:03.970541+0000","last_undegraded":"2024-09-17T05:44:03.970541+0000","last_fullsized":"2024-09-17T05:44:03.970541+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:44:01.930501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:44:01.930501+0000","last_clean_scrub_stamp":"2024-09-17T05:44:01.930501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:40:41.740300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"44'3","reported_seq":18,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T05:44:05.414988+0000","last_change":"2024-09-17T05:44:01.958643+0000","last_active":"2024-09-17T05:44:05.414988+0000","last_peered":"2024-09-17T05:44:05.414988+0000","last_clean":"2024-09-17T05:44:05.414988+0000","last_became_active":"2024-09-17T05:44:01.958310+0000","last_became_peered":"2024-09-17T05:44:01.958310+0000","last_unstale":"2024-09-17T05:44:05.414988+0000","last_undegraded":"2024-09-17T05:44:05.414988+0000","last_fullsized":"2024-09-17T05:44:05.414988+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:44:00.925414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:44:00.925414+0000","last_clean_scrub_stamp":"2024-09-17T05:44:00.925414+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:03:12.501051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":13,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T05:44:05.414895+0000","last_change":"2024-09-17T05:44:02.968507+0000","last_active":"2024-09-17T05:44:05.414895+0000","last_peered":"2024-09-17T05:44:05.414895+0000","last_clean":"2024-09-17T05:44:05.414895+0000","last_became_active":"2024-09-17T05:44:02.968167+0000","last_became_peered":"2024-09-17T05:44:02.968167+0000","last_unstale":"2024-09-17T05:44:05.414895+0000","last_undegraded":"2024-09-17T05:44:05.414895+0000","last_fullsized":"2024-09-17T05:44:05.414895+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:44:01.930501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:44:01.930501+0000","last_clean_scrub_stamp":"2024-09-17T05:44:01.930501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:27:06.309594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.14","version":"44'6","reported_seq":21,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T05:44:03.971157+0000","last_change":"2024-09-17T05:44:01.942944+0000","last_active":"2024-09-17T05:44:03.971157+0000","last_peered":"2024-09-17T05:44:03.971157+0000","last_clean":"2024-09-17T05:44:03.971157+0000","last_became_active":"2024-09-17T05:44:01.942488+0000","last_became_peered":"2024-09-17T05:44:01.942488+0000","last_unstale":"2024-09-17T05:44:03.971157+0000","last_undegraded":"2024-09-17T05:44:03.971157+0000","last_fullsized":"2024-09-17T05:44:03.971157+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:44:00.925414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:44:00.925414+0000","last_clean_scrub_stamp":"2024-09-17T05:44:00.925414+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:29:01.447727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-09-17T05:44:01.946200+0000","last_change":"2024-09-17T05:44:01.946200+0000","last_active":"2024-09-17T05:44:01.930501+0000","last_peered":"2024-09-17T05:44:01.930501+0000","last_clean":"2024-09-17T05:44:01.930501+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:44:01.946200+0000","last_undegraded":"2024-09-17T05:44:01.946200+0000","last_fullsized":"2024-09-17T05:44:01.946200+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:44:01.930501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:44:01.930501+0000","last_clean_scrub_stamp":"2024-09-17T05:44:01.930501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"44'2","reported_seq":17,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T05:44:03.971121+0000","last_change":"2024-09-17T05:44:01.948885+0000","last_active":"2024-09-17T05:44:03.971121+0000","last_peered":"2024-09-17T05:44:03.971121+0000","last_clean":"2024-09-17T05:44:03.971121+0000","last_became_active":"2024-09-17T05:44:01.948319+0000","last_became_peered":"2024-09-17T05:44:01.948319+0000","last_unstale":"2024-09-17T05:44:03.971121+0000","last_undegraded":"2024-09-17T05:44:03.971121+0000","last_fullsized":"2024-09-17T05:44:03.971121+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:44:00.925414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:44:00.925414+0000","last_clean_scrub_stamp":"2024-09-17T05:44:00.925414+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:26:48.401818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:44:02.986237+0000","last_change":"2024-09-17T05:44:02.979714+0000","last_active":"2024-09-17T05:44:02.986237+0000","last_peered":"2024-09-17T05:44:02.986237+0000","last_clean":"2024-09-17T05:44:02.986237+0000","last_became_active":"2024-09-17T05:44:02.977592+0000","last_became_peered":"2024-09-17T05:44:02.977592+0000","last_unstale":"2024-09-17T05:44:02.986237+0000","last_undegraded":"2024-09-17T05:44:02.986237+0000","last_fullsized":"2024-09-17T05:44:02.986237+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:44:01.930501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:44:01.930501+0000","last_clean_scrub_stamp":"2024-09-17T05:44:01.930501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:04:06.058220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":15,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T05:44:05.414641+0000","last_change":"2024-09-17T05:44:01.952325+0000","last_active":"2024-09-17T05:44:05.414641+0000","last_peered":"2024-09-17T05:44:05.414641+0000","last_clean":"2024-09-17T05:44:05.414641+0000","last_became_active":"2024-09-17T05:44:01.952005+0000","last_became_peered":"2024-09-17T05:44:01.952005+0000","last_unstale":"2024-09-17T05:44:05.414641+0000","last_undegraded":"2024-09-17T05:44:05.414641+0000","last_fullsized":"2024-09-17T05:44:05.414641+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:44:00.925414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:44:00.925414+0000","last_clean_scrub_stamp":"2024-09-17T05:44:00.925414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:01:33.262027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":13,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T05:44:03.970252+0000","last_change":"2024-09-17T05:44:02.969515+0000","last_active":"2024-09-17T05:44:03.970252+0000","last_peered":"2024-09-17T05:44:03.970252+0000","last_clean":"2024-09-17T05:44:03.970252+0000","last_became_active":"2024-09-17T05:44:02.968910+0000","last_became_peered":"2024-09-17T05:44:02.968910+0000","last_unstale":"2024-09-17T05:44:03.970252+0000","last_undegraded":"2024-09-17T05:44:03.970252+0000","last_fullsized":"2024-09-17T05:44:03.970252+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:44:01.930501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:44:01.930501+0000","last_clean_scrub_stamp":"2024-09-17T05:44:01.930501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:04:08.756849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":15,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T05:44:03.970397+0000","last_change":"2024-09-17T05:44:01.948603+0000","last_active":"2024-09-17T05:44:03.970397+0000","last_peered":"2024-09-17T05:44:03.970397+0000","last_clean":"2024-09-17T05:44:03.970397+0000","last_became_active":"2024-09-17T05:44:01.948261+0000","last_became_peered":"2024-09-17T05:44:01.948261+0000","last_unstale":"2024-09-17T05:44:03.970397+0000","last_undegraded":"2024-09-17T05:44:03.970397+0000","last_fullsized":"2024-09-17T05:44:03.970397+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:44:00.925414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:44:00.925414+0000","last_clean_scrub_stamp":"2024-09-17T05:44:00.925414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:51:52.241395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":13,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T05:44:05.414907+0000","last_change":"2024-09-17T05:44:02.980463+0000","last_active":"2024-09-17T05:44:05.414907+0000","last_peered":"2024-09-17T05:44:05.414907+0000","last_clean":"2024-09-17T05:44:05.414907+0000","last_became_active":"2024-09-17T05:44:02.979921+0000","last_became_peered":"2024-09-17T05:44:02.979921+0000","last_unstale":"2024-09-17T05:44:05.414907+0000","last_undegraded":"2024-09-17T05:44:05.414907+0000","last_fullsized":"2024-09-17T05:44:05.414907+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:44:01.930501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:44:01.930501+0000","last_clean_scrub_stamp":"2024-09-17T05:44:01.930501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:32:37.948066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.10","version":"44'8","reported_seq":21,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:44:02.993082+0000","last_change":"2024-09-17T05:44:01.955769+0000","last_active":"2024-09-17T05:44:02.993082+0000","last_peered":"2024-09-17T05:44:02.993082+0000","last_clean":"2024-09-17T05:44:02.993082+0000","last_became_active":"2024-09-17T05:44:01.955407+0000","last_became_peered":"2024-09-17T05:44:01.955407+0000","last_unstale":"2024-09-17T05:44:02.993082+0000","last_undegraded":"2024-09-17T05:44:02.993082+0000","last_fullsized":"2024-09-17T05:44:02.993082+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:44:00.925414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:44:00.925414+0000","last_clean_scrub_stamp":"2024-09-17T05:44:00.925414+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:16:36.932317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":13,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T05:44:03.971209+0000","last_change":"2024-09-17T05:44:02.977094+0000","last_active":"2024-09-17T05:44:03.971209+0000","last_peered":"2024-09-17T05:44:03.971209+0000","last_clean":"2024-09-17T05:44:03.971209+0000","last_became_active":"2024-09-17T05:44:02.976821+0000","last_became_peered":"2024-09-17T05:44:02.976821+0000","last_unstale":"2024-09-17T05:44:03.971209+0000","last_undegraded":"2024-09-17T05:44:03.971209+0000","last_fullsized":"2024-09-17T05:44:03.971209+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:44:01.930501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:44:01.930501+0000","last_clean_scrub_stamp":"2024-09-17T05:44:01.930501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:03:21.010459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"44'1","reported_seq":16,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T05:44:03.971363+0000","last_change":"2024-09-17T05:44:01.947617+0000","last_active":"2024-09-17T05:44:03.971363+0000","last_peered":"2024-09-17T05:44:03.971363+0000","last_clean":"2024-09-17T05:44:03.971363+0000","last_became_active":"2024-09-17T05:44:01.947272+0000","last_became_peered":"2024-09-17T05:44:01.947272+0000","last_unstale":"2024-09-17T05:44:03.971363+0000","last_undegraded":"2024-09-17T05:44:03.971363+0000","last_fullsized":"2024-09-17T05:44:03.971363+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:44:00.925414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:44:00.925414+0000","last_clean_scrub_stamp":"2024-09-17T05:44:00.925414+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:26:24.738054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:44:02.983449+0000","last_change":"2024-09-17T05:44:02.964018+0000","last_active":"2024-09-17T05:44:02.983449+0000","last_peered":"2024-09-17T05:44:02.983449+0000","last_clean":"2024-09-17T05:44:02.983449+0000","last_became_active":"2024-09-17T05:44:02.963717+0000","last_became_peered":"2024-09-17T05:44:02.963717+0000","last_unstale":"2024-09-17T05:44:02.983449+0000","last_undegraded":"2024-09-17T05:44:02.983449+0000","last_fullsized":"2024-09-17T05:44:02.983449+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:44:01.930501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:44:01.930501+0000","last_clean_scrub_stamp":"2024-09-17T05:44:01.930501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:56:58.722211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.e","version":"44'2","reported_seq":17,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T05:44:04.971214+0000","last_change":"2024-09-17T05:44:01.948758+0000","last_active":"2024-09-17T05:44:04.971214+0000","last_peered":"2024-09-17T05:44:04.971214+0000","last_clean":"2024-09-17T05:44:04.971214+0000","last_became_active":"2024-09-17T05:44:01.948353+0000","last_became_peered":"2024-09-17T05:44:01.948353+0000","last_unstale":"2024-09-17T05:44:04.971214+0000","last_undegraded":"2024-09-17T05:44:04.971214+0000","last_fullsized":"2024-09-17T05:44:04.971214+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:44:00.925414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:44:00.925414+0000","last_clean_scrub_stamp":"2024-09-17T05:44:00.925414+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:40:24.517815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-09-17T05:44:01.946176+0000","last_change":"2024-09-17T05:44:01.946176+0000","last_active":"2024-09-17T05:44:01.930501+0000","last_peered":"2024-09-17T05:44:01.930501+0000","last_clean":"2024-09-17T05:44:01.930501+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:44:01.946176+0000","last_undegraded":"2024-09-17T05:44:01.946176+0000","last_fullsized":"2024-09-17T05:44:01.946176+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:44:01.930501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:44:01.930501+0000","last_clean_scrub_stamp":"2024-09-17T05:44:01.930501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.d","version":"44'1","reported_seq":16,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T05:44:05.659115+0000","last_change":"2024-09-17T05:44:01.952723+0000","last_active":"2024-09-17T05:44:05.659115+0000","last_peered":"2024-09-17T05:44:05.659115+0000","last_clean":"2024-09-17T05:44:05.659115+0000","last_became_active":"2024-09-17T05:44:01.952249+0000","last_became_peered":"2024-09-17T05:44:01.952249+0000","last_unstale":"2024-09-17T05:44:05.659115+0000","last_undegraded":"2024-09-17T05:44:05.659115+0000","last_fullsized":"2024-09-17T05:44:05.659115+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:44:00.925414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:44:00.925414+0000","last_clean_scrub_stamp":"2024-09-17T05:44:00.925414+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:05:27.913523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-09-17T05:44:01.948237+0000","last_change":"2024-09-17T05:44:01.948237+0000","last_active":"2024-09-17T05:44:01.930501+0000","last_peered":"2024-09-17T05:44:01.930501+0000","last_clean":"2024-09-17T05:44:01.930501+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:44:01.948237+0000","last_undegraded":"2024-09-17T05:44:01.948237+0000","last_fullsized":"2024-09-17T05:44:01.948237+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:44:01.930501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:44:01.930501+0000","last_clean_scrub_stamp":"2024-09-17T05:44:01.930501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":15,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T05:44:03.970437+0000","last_change":"2024-09-17T05:44:01.954281+0000","last_active":"2024-09-17T05:44:03.970437+0000","last_peered":"2024-09-17T05:44:03.970437+0000","last_clean":"2024-09-17T05:44:03.970437+0000","last_became_active":"2024-09-17T05:44:01.953910+0000","last_became_peered":"2024-09-17T05:44:01.953910+0000","last_unstale":"2024-09-17T05:44:03.970437+0000","last_undegraded":"2024-09-17T05:44:03.970437+0000","last_fullsized":"2024-09-17T05:44:03.970437+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:44:00.925414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:44:00.925414+0000","last_clean_scrub_stamp":"2024-09-17T05:44:00.925414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:16:53.412332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":13,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T05:44:03.970683+0000","last_change":"2024-09-17T05:44:02.970330+0000","last_active":"2024-09-17T05:44:03.970683+0000","last_peered":"2024-09-17T05:44:03.970683+0000","last_clean":"2024-09-17T05:44:03.970683+0000","last_became_active":"2024-09-17T05:44:02.969132+0000","last_became_peered":"2024-09-17T05:44:02.969132+0000","last_unstale":"2024-09-17T05:44:03.970683+0000","last_undegraded":"2024-09-17T05:44:03.970683+0000","last_fullsized":"2024-09-17T05:44:03.970683+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:44:01.930501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:44:01.930501+0000","last_clean_scrub_stamp":"2024-09-17T05:44:01.930501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:12:05.855315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.b","version":"44'2","reported_seq":17,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T05:44:03.971241+0000","last_change":"2024-09-17T05:44:01.952417+0000","last_active":"2024-09-17T05:44:03.971241+0000","last_peered":"2024-09-17T05:44:03.971241+0000","last_clean":"2024-09-17T05:44:03.971241+0000","last_became_active":"2024-09-17T05:44:01.951779+0000","last_became_peered":"2024-09-17T05:44:01.951779+0000","last_unstale":"2024-09-17T05:44:03.971241+0000","last_undegraded":"2024-09-17T05:44:03.971241+0000","last_fullsized":"2024-09-17T05:44:03.971241+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:44:00.925414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:44:00.925414+0000","last_clean_scrub_stamp":"2024-09-17T05:44:00.925414+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:39:36.775312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":13,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T05:44:05.915357+0000","last_change":"2024-09-17T05:44:02.976421+0000","last_active":"2024-09-17T05:44:05.915357+0000","last_peered":"2024-09-17T05:44:05.915357+0000","last_clean":"2024-09-17T05:44:05.915357+0000","last_became_active":"2024-09-17T05:44:02.976091+0000","last_became_peered":"2024-09-17T05:44:02.976091+0000","last_unstale":"2024-09-17T05:44:05.915357+0000","last_undegraded":"2024-09-17T05:44:05.915357+0000","last_fullsized":"2024-09-17T05:44:05.915357+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:44:01.930501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:44:01.930501+0000","last_clean_scrub_stamp":"2024-09-17T05:44:01.930501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:17:16.014677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":15,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T05:44:05.658767+0000","last_change":"2024-09-17T05:44:01.956743+0000","last_active":"2024-09-17T05:44:05.658767+0000","last_peered":"2024-09-17T05:44:05.658767+0000","last_clean":"2024-09-17T05:44:05.658767+0000","last_became_active":"2024-09-17T05:44:01.955453+0000","last_became_peered":"2024-09-17T05:44:01.955453+0000","last_unstale":"2024-09-17T05:44:05.658767+0000","last_undegraded":"2024-09-17T05:44:05.658767+0000","last_fullsized":"2024-09-17T05:44:05.658767+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:44:00.925414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:44:00.925414+0000","last_clean_scrub_stamp":"2024-09-17T05:44:00.925414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:17:15.009590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":13,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T05:44:03.971825+0000","last_change":"2024-09-17T05:44:02.973112+0000","last_active":"2024-09-17T05:44:03.971825+0000","last_peered":"2024-09-17T05:44:03.971825+0000","last_clean":"2024-09-17T05:44:03.971825+0000","last_became_active":"2024-09-17T05:44:02.972818+0000","last_became_peered":"2024-09-17T05:44:02.972818+0000","last_unstale":"2024-09-17T05:44:03.971825+0000","last_undegraded":"2024-09-17T05:44:03.971825+0000","last_fullsized":"2024-09-17T05:44:03.971825+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:44:01.930501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:44:01.930501+0000","last_clean_scrub_stamp":"2024-09-17T05:44:01.930501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:02:00.787605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:44:02.959170+0000","last_change":"2024-09-17T05:44:01.953671+0000","last_active":"2024-09-17T05:44:02.959170+0000","last_peered":"2024-09-17T05:44:02.959170+0000","last_clean":"2024-09-17T05:44:02.959170+0000","last_became_active":"2024-09-17T05:44:01.953335+0000","last_became_peered":"2024-09-17T05:44:01.953335+0000","last_unstale":"2024-09-17T05:44:02.959170+0000","last_undegraded":"2024-09-17T05:44:02.959170+0000","last_fullsized":"2024-09-17T05:44:02.959170+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:44:00.925414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:44:00.925414+0000","last_clean_scrub_stamp":"2024-09-17T05:44:00.925414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:37:02.646622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:44:02.983693+0000","last_change":"2024-09-17T05:44:02.965586+0000","last_active":"2024-09-17T05:44:02.983693+0000","last_peered":"2024-09-17T05:44:02.983693+0000","last_clean":"2024-09-17T05:44:02.983693+0000","last_became_active":"2024-09-17T05:44:02.965276+0000","last_became_peered":"2024-09-17T05:44:02.965276+0000","last_unstale":"2024-09-17T05:44:02.983693+0000","last_undegraded":"2024-09-17T05:44:02.983693+0000","last_fullsized":"2024-09-17T05:44:02.983693+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:44:01.930501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:44:01.930501+0000","last_clean_scrub_stamp":"2024-09-17T05:44:01.930501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:36:57.786003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":15,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T05:44:05.414441+0000","last_change":"2024-09-17T05:44:01.952963+0000","last_active":"2024-09-17T05:44:05.414441+0000","last_peered":"2024-09-17T05:44:05.414441+0000","last_clean":"2024-09-17T05:44:05.414441+0000","last_became_active":"2024-09-17T05:44:01.952635+0000","last_became_peered":"2024-09-17T05:44:01.952635+0000","last_unstale":"2024-09-17T05:44:05.414441+0000","last_undegraded":"2024-09-17T05:44:05.414441+0000","last_fullsized":"2024-09-17T05:44:05.414441+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:44:00.925414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:44:00.925414+0000","last_clean_scrub_stamp":"2024-09-17T05:44:00.925414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:01:52.592469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-09-17T05:44:01.948175+0000","last_change":"2024-09-17T05:44:01.948175+0000","last_active":"2024-09-17T05:44:01.930501+0000","last_peered":"2024-09-17T05:44:01.930501+0000","last_clean":"2024-09-17T05:44:01.930501+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:44:01.948175+0000","last_undegraded":"2024-09-17T05:44:01.948175+0000","last_fullsized":"2024-09-17T05:44:01.948175+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:44:01.930501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:44:01.930501+0000","last_clean_scrub_stamp":"2024-09-17T05:44:01.930501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.6","version":"45'1","reported_seq":16,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T05:44:03.971074+0000","last_change":"2024-09-17T05:44:01.948222+0000","last_active":"2024-09-17T05:44:03.971074+0000","last_peered":"2024-09-17T05:44:03.971074+0000","last_clean":"2024-09-17T05:44:03.971074+0000","last_became_active":"2024-09-17T05:44:01.947920+0000","last_became_peered":"2024-09-17T05:44:01.947920+0000","last_unstale":"2024-09-17T05:44:03.971074+0000","last_undegraded":"2024-09-17T05:44:03.971074+0000","last_fullsized":"2024-09-17T05:44:03.971074+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:44:00.925414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:44:00.925414+0000","last_clean_scrub_stamp":"2024-09-17T05:44:00.925414+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:36:29.645473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:44:02.986147+0000","last_change":"2024-09-17T05:44:02.975385+0000","last_active":"2024-09-17T05:44:02.986147+0000","last_peered":"2024-09-17T05:44:02.986147+0000","last_clean":"2024-09-17T05:44:02.986147+0000","last_became_active":"2024-09-17T05:44:02.974263+0000","last_became_peered":"2024-09-17T05:44:02.974263+0000","last_unstale":"2024-09-17T05:44:02.986147+0000","last_undegraded":"2024-09-17T05:44:02.986147+0000","last_fullsized":"2024-09-17T05:44:02.986147+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:44:01.930501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:44:01.930501+0000","last_clean_scrub_stamp":"2024-09-17T05:44:01.930501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:04:07.130698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":15,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T05:44:05.415120+0000","last_change":"2024-09-17T05:44:01.960684+0000","last_active":"2024-09-17T05:44:05.415120+0000","last_peered":"2024-09-17T05:44:05.415120+0000","last_clean":"2024-09-17T05:44:05.415120+0000","last_became_active":"2024-09-17T05:44:01.960310+0000","last_became_peered":"2024-09-17T05:44:01.960310+0000","last_unstale":"2024-09-17T05:44:05.415120+0000","last_undegraded":"2024-09-17T05:44:05.415120+0000","last_fullsized":"2024-09-17T05:44:05.415120+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:44:00.925414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:44:00.925414+0000","last_clean_scrub_stamp":"2024-09-17T05:44:00.925414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:25:07.911474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":13,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T05:44:05.415126+0000","last_change":"2024-09-17T05:44:02.965931+0000","last_active":"2024-09-17T05:44:05.415126+0000","last_peered":"2024-09-17T05:44:05.415126+0000","last_clean":"2024-09-17T05:44:05.415126+0000","last_became_active":"2024-09-17T05:44:02.965685+0000","last_became_peered":"2024-09-17T05:44:02.965685+0000","last_unstale":"2024-09-17T05:44:05.415126+0000","last_undegraded":"2024-09-17T05:44:05.415126+0000","last_fullsized":"2024-09-17T05:44:05.415126+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:44:01.930501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:44:01.930501+0000","last_clean_scrub_stamp":"2024-09-17T05:44:01.930501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:42:28.449626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":15,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T05:44:05.915011+0000","last_change":"2024-09-17T05:44:01.956609+0000","last_active":"2024-09-17T05:44:05.915011+0000","last_peered":"2024-09-17T05:44:05.915011+0000","last_clean":"2024-09-17T05:44:05.915011+0000","last_became_active":"2024-09-17T05:44:01.956251+0000","last_became_peered":"2024-09-17T05:44:01.956251+0000","last_unstale":"2024-09-17T05:44:05.915011+0000","last_undegraded":"2024-09-17T05:44:05.915011+0000","last_fullsized":"2024-09-17T05:44:05.915011+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:44:00.925414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:44:00.925414+0000","last_clean_scrub_stamp":"2024-09-17T05:44:00.925414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:12:38.919452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":13,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T05:44:03.970760+0000","last_change":"2024-09-17T05:44:02.963129+0000","last_active":"2024-09-17T05:44:03.970760+0000","last_peered":"2024-09-17T05:44:03.970760+0000","last_clean":"2024-09-17T05:44:03.970760+0000","last_became_active":"2024-09-17T05:44:02.962771+0000","last_became_peered":"2024-09-17T05:44:02.962771+0000","last_unstale":"2024-09-17T05:44:03.970760+0000","last_undegraded":"2024-09-17T05:44:03.970760+0000","last_fullsized":"2024-09-17T05:44:03.970760+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:44:01.930501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:44:01.930501+0000","last_clean_scrub_stamp":"2024-09-17T05:44:01.930501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:42:32.839604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":15,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T05:44:05.414803+0000","last_change":"2024-09-17T05:44:01.955931+0000","last_active":"2024-09-17T05:44:05.414803+0000","last_peered":"2024-09-17T05:44:05.414803+0000","last_clean":"2024-09-17T05:44:05.414803+0000","last_became_active":"2024-09-17T05:44:01.955587+0000","last_became_peered":"2024-09-17T05:44:01.955587+0000","last_unstale":"2024-09-17T05:44:05.414803+0000","last_undegraded":"2024-09-17T05:44:05.414803+0000","last_fullsized":"2024-09-17T05:44:05.414803+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:44:00.925414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:44:00.925414+0000","last_clean_scrub_stamp":"2024-09-17T05:44:00.925414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:53:49.002592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":13,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T05:44:03.971011+0000","last_change":"2024-09-17T05:44:02.969696+0000","last_active":"2024-09-17T05:44:03.971011+0000","last_peered":"2024-09-17T05:44:03.971011+0000","last_clean":"2024-09-17T05:44:03.971011+0000","last_became_active":"2024-09-17T05:44:02.969397+0000","last_became_peered":"2024-09-17T05:44:02.969397+0000","last_unstale":"2024-09-17T05:44:03.971011+0000","last_undegraded":"2024-09-17T05:44:03.971011+0000","last_fullsized":"2024-09-17T05:44:03.971011+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:44:01.930501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:44:01.930501+0000","last_clean_scrub_stamp":"2024-09-17T05:44:01.930501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:25:36.619406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":15,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T05:44:04.970704+0000","last_change":"2024-09-17T05:44:01.947767+0000","last_active":"2024-09-17T05:44:04.970704+0000","last_peered":"2024-09-17T05:44:04.970704+0000","last_clean":"2024-09-17T05:44:04.970704+0000","last_became_active":"2024-09-17T05:44:01.947426+0000","last_became_peered":"2024-09-17T05:44:01.947426+0000","last_unstale":"2024-09-17T05:44:04.970704+0000","last_undegraded":"2024-09-17T05:44:04.970704+0000","last_fullsized":"2024-09-17T05:44:04.970704+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:44:00.925414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:44:00.925414+0000","last_clean_scrub_stamp":"2024-09-17T05:44:00.925414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:48:16.308463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":13,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T05:44:05.658926+0000","last_change":"2024-09-17T05:44:02.982212+0000","last_active":"2024-09-17T05:44:05.658926+0000","last_peered":"2024-09-17T05:44:05.658926+0000","last_clean":"2024-09-17T05:44:05.658926+0000","last_became_active":"2024-09-17T05:44:02.981857+0000","last_became_peered":"2024-09-17T05:44:02.981857+0000","last_unstale":"2024-09-17T05:44:05.658926+0000","last_undegraded":"2024-09-17T05:44:05.658926+0000","last_fullsized":"2024-09-17T05:44:05.658926+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:44:01.930501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:44:01.930501+0000","last_clean_scrub_stamp":"2024-09-17T05:44:01.930501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:48:36.558940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":15,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T05:44:05.915617+0000","last_change":"2024-09-17T05:44:01.957935+0000","last_active":"2024-09-17T05:44:05.915617+0000","last_peered":"2024-09-17T05:44:05.915617+0000","last_clean":"2024-09-17T05:44:05.915617+0000","last_became_active":"2024-09-17T05:44:01.957554+0000","last_became_peered":"2024-09-17T05:44:01.957554+0000","last_unstale":"2024-09-17T05:44:05.915617+0000","last_undegraded":"2024-09-17T05:44:05.915617+0000","last_fullsized":"2024-09-17T05:44:05.915617+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:44:00.925414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:44:00.925414+0000","last_clean_scrub_stamp":"2024-09-17T05:44:00.925414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:12:38.503949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":13,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T05:44:04.971182+0000","last_change":"2024-09-17T05:44:02.970436+0000","last_active":"2024-09-17T05:44:04.971182+0000","last_peered":"2024-09-17T05:44:04.971182+0000","last_clean":"2024-09-17T05:44:04.971182+0000","last_became_active":"2024-09-17T05:44:02.967032+0000","last_became_peered":"2024-09-17T05:44:02.967032+0000","last_unstale":"2024-09-17T05:44:04.971182+0000","last_undegraded":"2024-09-17T05:44:04.971182+0000","last_fullsized":"2024-09-17T05:44:04.971182+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:44:01.930501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:44:01.930501+0000","last_clean_scrub_stamp":"2024-09-17T05:44:01.930501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:46:37.419245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:44:02.959419+0000","last_change":"2024-09-17T05:44:01.948502+0000","last_active":"2024-09-17T05:44:02.959419+0000","last_peered":"2024-09-17T05:44:02.959419+0000","last_clean":"2024-09-17T05:44:02.959419+0000","last_became_active":"2024-09-17T05:44:01.948181+0000","last_became_peered":"2024-09-17T05:44:01.948181+0000","last_unstale":"2024-09-17T05:44:02.959419+0000","last_undegraded":"2024-09-17T05:44:02.959419+0000","last_fullsized":"2024-09-17T05:44:02.959419+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:44:00.925414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:44:00.925414+0000","last_clean_scrub_stamp":"2024-09-17T05:44:00.925414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:00:31.292020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:44:02.986221+0000","last_change":"2024-09-17T05:44:02.977230+0000","last_active":"2024-09-17T05:44:02.986221+0000","last_peered":"2024-09-17T05:44:02.986221+0000","last_clean":"2024-09-17T05:44:02.986221+0000","last_became_active":"2024-09-17T05:44:02.976922+0000","last_became_peered":"2024-09-17T05:44:02.976922+0000","last_unstale":"2024-09-17T05:44:02.986221+0000","last_undegraded":"2024-09-17T05:44:02.986221+0000","last_fullsized":"2024-09-17T05:44:02.986221+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:44:01.930501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:44:01.930501+0000","last_clean_scrub_stamp":"2024-09-17T05:44:01.930501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:44:44.232120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"44'2","reported_seq":17,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T05:44:05.659350+0000","last_change":"2024-09-17T05:44:01.956246+0000","last_active":"2024-09-17T05:44:05.659350+0000","last_peered":"2024-09-17T05:44:05.659350+0000","last_clean":"2024-09-17T05:44:05.659350+0000","last_became_active":"2024-09-17T05:44:01.954475+0000","last_became_peered":"2024-09-17T05:44:01.954475+0000","last_unstale":"2024-09-17T05:44:05.659350+0000","last_undegraded":"2024-09-17T05:44:05.659350+0000","last_fullsized":"2024-09-17T05:44:05.659350+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:44:00.925414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:44:00.925414+0000","last_clean_scrub_stamp":"2024-09-17T05:44:00.925414+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:41:23.789219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"19'72","reported_seq":151,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T05:44:05.414476+0000","last_change":"2024-09-17T05:41:48.539830+0000","last_active":"2024-09-17T05:44:05.414476+0000","last_peered":"2024-09-17T05:44:05.414476+0000","last_clean":"2024-09-17T05:44:05.414476+0000","last_became_active":"2024-09-17T05:41:48.538743+0000","last_became_peered":"2024-09-17T05:41:48.538743+0000","last_unstale":"2024-09-17T05:44:05.414476+0000","last_undegraded":"2024-09-17T05:44:05.414476+0000","last_fullsized":"2024-09-17T05:44:05.414476+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:47.152539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:47.152539+0000","last_clean_scrub_stamp":"2024-09-17T05:41:47.152539+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:08:02.952016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":4148,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":16,"seq":68719476768,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31660,"kb_used_data":472,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340180,"statfs":{"total":96636764160,"available":96604344320,"internally_reserved":0,"allocated":483328,"data_stored":188869,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":7,"up_from":15,"seq":64424509473,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32280,"kb_used_data":1092,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339560,"statfs":{"total":96636764160,"available":96603709440,"internally_reserved":0,"allocated":1118208,"data_stored":798669,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509472,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31700,"kb_used_data":512,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340140,"statfs":{"total":96636764160,"available":96604303360,"internally_reserved":0,"allocated":524288,"data_stored":208281,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509472,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31712,"kb_used_data":520,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340128,"statfs":{"total":96636764160,"available":96604291072,"internally_reserved":0,"allocated":532480,"data_stored":209823,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509472,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31708,"kb_used_data":520,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340132,"statfs":{"total":96636764160,"available":96604295168,"internally_reserved":0,"allocated":532480,"data_stored":208849,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509472,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31712,"kb_used_data":524,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340128,"statfs":{"total":96636764160,"available":96604291072,"internally_reserved":0,"allocated":536576,"data_stored":209845,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509472,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31696,"kb_used_data":500,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340144,"statfs":{"total":96636764160,"available":96604307456,"internally_reserved":0,"allocated":512000,"data_stored":201981,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574879,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32260,"kb_used_data":1064,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339580,"statfs":{"total":96636764160,"available":96603729920,"internally_reserved":0,"allocated":1089536,"data_stored":785504,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-17T05:44:07.353 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-17T05:44:07.504 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:07.502+0000 7f738f994640 1 -- 172.21.15.150:0/50626968 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f738806e5c0 msgr2=0x7f738806efa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:44:07.505 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:07.502+0000 7f738f994640 1 --2- 172.21.15.150:0/50626968 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f738806e5c0 0x7f738806efa0 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f737c005fd0 tx=0x7f737c02a670 comp rx=0 tx=0).stop 2024-09-17T05:44:07.505 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:07.502+0000 7f738f994640 1 -- 172.21.15.150:0/50626968 shutdown_connections 2024-09-17T05:44:07.505 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:07.502+0000 7f738f994640 1 --2- 172.21.15.150:0/50626968 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f73880b1c10 0x7f73880b2020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:07.505 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:07.502+0000 7f738f994640 1 --2- 172.21.15.150:0/50626968 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f738806e5c0 0x7f738806efa0 unknown :-1 s=CLOSED pgs=458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:07.505 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:07.502+0000 7f738f994640 1 -- 172.21.15.150:0/50626968 >> 172.21.15.150:0/50626968 conn(0x7f73880b3fc0 msgr2=0x7f73880b43d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:44:07.505 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:07.502+0000 7f738f994640 1 -- 172.21.15.150:0/50626968 shutdown_connections 2024-09-17T05:44:07.505 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:07.502+0000 7f738f994640 1 -- 172.21.15.150:0/50626968 wait complete. 2024-09-17T05:44:07.506 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:07.504+0000 7f738f994640 1 Processor -- start 2024-09-17T05:44:07.506 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:07.504+0000 7f738f994640 1 -- start start 2024-09-17T05:44:07.508 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:07.505+0000 7f738f994640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f73880b1c10 0x7f73881638a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:44:07.508 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:07.505+0000 7f738f994640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f73880c8210 0x7f73880c5f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:44:07.508 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:07.505+0000 7f738f994640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f73880c64b0 0x7f73880c68c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:44:07.508 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:07.505+0000 7f738f994640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f73880b28f0 con 0x7f73880b1c10 2024-09-17T05:44:07.509 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:07.505+0000 7f738f994640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f73880b2770 con 0x7f73880c64b0 2024-09-17T05:44:07.509 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:07.505+0000 7f738f994640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f73880c9310 con 0x7f73880c8210 2024-09-17T05:44:07.509 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:07.506+0000 7f738d730640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f73880b1c10 0x7f73881638a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:44:07.509 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:07.506+0000 7f738d730640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f73880b1c10 0x7f73881638a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:43174/0 (socket says 172.21.15.150:43174) 2024-09-17T05:44:07.509 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:07.506+0000 7f738d730640 1 -- 172.21.15.150:0/4056431536 learned_addr learned my addr 172.21.15.150:0/4056431536 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:44:07.509 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:07.506+0000 7f738cf2f640 1 --2- 172.21.15.150:0/4056431536 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f73880c8210 0x7f73880c5f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:44:07.509 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:07.506+0000 7f738df31640 1 --2- 172.21.15.150:0/4056431536 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f73880c64b0 0x7f73880c68c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:44:07.509 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:07.506+0000 7f738d730640 1 -- 172.21.15.150:0/4056431536 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f73880c8210 msgr2=0x7f73880c5f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:44:07.509 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:07.506+0000 7f738d730640 1 --2- 172.21.15.150:0/4056431536 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f73880c8210 0x7f73880c5f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:07.509 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:07.506+0000 7f738d730640 1 -- 172.21.15.150:0/4056431536 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f73880c64b0 msgr2=0x7f73880c68c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:44:07.509 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:07.506+0000 7f738d730640 1 --2- 172.21.15.150:0/4056431536 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f73880c64b0 0x7f73880c68c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:07.509 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:07.506+0000 7f738d730640 1 -- 172.21.15.150:0/4056431536 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f73880b7000 con 0x7f73880b1c10 2024-09-17T05:44:07.510 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:07.506+0000 7f738df31640 1 --2- 172.21.15.150:0/4056431536 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f73880c64b0 0x7f73880c68c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T05:44:07.510 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:07.506+0000 7f738d730640 1 --2- 172.21.15.150:0/4056431536 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f73880b1c10 0x7f73881638a0 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f737800c3a0 tx=0x7f737800c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:44:07.510 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:07.506+0000 7f7385ffb640 1 -- 172.21.15.150:0/4056431536 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7378017070 con 0x7f73880b1c10 2024-09-17T05:44:07.510 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:07.506+0000 7f7385ffb640 1 -- 172.21.15.150:0/4056431536 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f73780053c0 con 0x7f73880b1c10 2024-09-17T05:44:07.510 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:07.506+0000 7f738f994640 1 -- 172.21.15.150:0/4056431536 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f73880b72e0 con 0x7f73880b1c10 2024-09-17T05:44:07.510 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:07.506+0000 7f7385ffb640 1 -- 172.21.15.150:0/4056431536 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7378003850 con 0x7f73880b1c10 2024-09-17T05:44:07.510 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:07.507+0000 7f738f994640 1 -- 172.21.15.150:0/4056431536 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f73881658b0 con 0x7f73880b1c10 2024-09-17T05:44:07.511 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:07.507+0000 7f738f994640 1 -- 172.21.15.150:0/4056431536 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f738809ba60 con 0x7f73880b1c10 2024-09-17T05:44:07.511 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:07.508+0000 7f7385ffb640 1 -- 172.21.15.150:0/4056431536 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 9) ==== 101747+0+0 (secure 0 0 0) 0x7f737801a070 con 0x7f73880b1c10 2024-09-17T05:44:07.511 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:07.509+0000 7f7385ffb640 1 --2- 172.21.15.150:0/4056431536 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f7374078e60 0x7f737407b370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:44:07.511 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:07.509+0000 7f7385ffb640 1 -- 172.21.15.150:0/4056431536 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 5709+0+0 (secure 0 0 0) 0x7f737809a5e0 con 0x7f73880b1c10 2024-09-17T05:44:07.511 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:07.509+0000 7f738cf2f640 1 --2- 172.21.15.150:0/4056431536 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f7374078e60 0x7f737407b370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:44:07.512 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:07.510+0000 7f738cf2f640 1 --2- 172.21.15.150:0/4056431536 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f7374078e60 0x7f737407b370 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f737c033000 tx=0x7f737c004730 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:44:07.515 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:07.514+0000 7f7385ffb640 1 -- 172.21.15.150:0/4056431536 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f7378062670 con 0x7f73880b1c10 2024-09-17T05:44:07.687 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:07.685+0000 7f738f994640 1 -- 172.21.15.150:0/4056431536 --> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f73880d1dd0 con 0x7f7374078e60 2024-09-17T05:44:07.691 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:07.691+0000 7f7385ffb640 1 -- 172.21.15.150:0/4056431536 <== mgr.4108 v2:172.21.15.176:6800/3631216395 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+250970 (secure 0 0 0) 0x7f73880d1dd0 con 0x7f7374078e60 2024-09-17T05:44:07.694 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-09-17T05:44:07.696 INFO:teuthology.orchestra.run.smithi150.stderr:dumped all 2024-09-17T05:44:07.697 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:07.693+0000 7f738f994640 1 -- 172.21.15.150:0/4056431536 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f7374078e60 msgr2=0x7f737407b370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:44:07.697 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:07.693+0000 7f738f994640 1 --2- 172.21.15.150:0/4056431536 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f7374078e60 0x7f737407b370 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f737c033000 tx=0x7f737c004730 comp rx=0 tx=0).stop 2024-09-17T05:44:07.697 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:07.693+0000 7f738f994640 1 -- 172.21.15.150:0/4056431536 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f73880b1c10 msgr2=0x7f73881638a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:44:07.697 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:07.693+0000 7f738f994640 1 --2- 172.21.15.150:0/4056431536 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f73880b1c10 0x7f73881638a0 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f737800c3a0 tx=0x7f737800c860 comp rx=0 tx=0).stop 2024-09-17T05:44:07.698 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:07.694+0000 7f738f994640 1 -- 172.21.15.150:0/4056431536 shutdown_connections 2024-09-17T05:44:07.698 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:07.694+0000 7f738f994640 1 --2- 172.21.15.150:0/4056431536 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f73880c64b0 0x7f73880c68c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:07.698 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:07.694+0000 7f738f994640 1 --2- 172.21.15.150:0/4056431536 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f7374078e60 0x7f737407b370 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:07.698 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:07.694+0000 7f738f994640 1 --2- 172.21.15.150:0/4056431536 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f73880c8210 0x7f73880c5f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:07.698 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:07.694+0000 7f738f994640 1 --2- 172.21.15.150:0/4056431536 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f73880b1c10 0x7f73881638a0 unknown :-1 s=CLOSED pgs=459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:07.698 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:07.694+0000 7f738f994640 1 -- 172.21.15.150:0/4056431536 >> 172.21.15.150:0/4056431536 conn(0x7f73880b3fc0 msgr2=0x7f73880b43d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:44:07.698 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:07.694+0000 7f738f994640 1 -- 172.21.15.150:0/4056431536 shutdown_connections 2024-09-17T05:44:07.698 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:07.694+0000 7f738f994640 1 -- 172.21.15.150:0/4056431536 wait complete. 2024-09-17T05:44:07.707 INFO:teuthology.orchestra.run.smithi150.stdout:{"pg_ready":true,"pg_map":{"version":110,"stamp":"2024-09-17T05:44:06.879800+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":146,"num_write_kb":1642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":111,"ondisk_log_size":111,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":140,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":254728,"kb_used_data":5204,"kb_used_omap":12,"kb_used_meta":249331,"kb_avail":754719992,"statfs":{"total":773094113280,"available":772833271808,"internally_reserved":0,"allocated":5328896,"data_stored":2811821,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":255315504},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":34,"apply_latency_ms":34,"commit_latency_ns":34000000,"apply_latency_ns":34000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.947889"},"pg_stats":[{"pgid":"7.3f","version":"0'0","reported_seq":13,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T05:44:05.415186+0000","last_change":"2024-09-17T05:44:02.974554+0000","last_active":"2024-09-17T05:44:05.415186+0000","last_peered":"2024-09-17T05:44:05.415186+0000","last_clean":"2024-09-17T05:44:05.415186+0000","last_became_active":"2024-09-17T05:44:02.974231+0000","last_became_peered":"2024-09-17T05:44:02.974231+0000","last_unstale":"2024-09-17T05:44:05.415186+0000","last_undegraded":"2024-09-17T05:44:05.415186+0000","last_fullsized":"2024-09-17T05:44:05.415186+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:44:01.930501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:44:01.930501+0000","last_clean_scrub_stamp":"2024-09-17T05:44:01.930501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:47:00.250341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3e","version":"0'0","reported_seq":13,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T05:44:05.659404+0000","last_change":"2024-09-17T05:44:02.988339+0000","last_active":"2024-09-17T05:44:05.659404+0000","last_peered":"2024-09-17T05:44:05.659404+0000","last_clean":"2024-09-17T05:44:05.659404+0000","last_became_active":"2024-09-17T05:44:02.987682+0000","last_became_peered":"2024-09-17T05:44:02.987682+0000","last_unstale":"2024-09-17T05:44:05.659404+0000","last_undegraded":"2024-09-17T05:44:05.659404+0000","last_fullsized":"2024-09-17T05:44:05.659404+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:44:01.930501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:44:01.930501+0000","last_clean_scrub_stamp":"2024-09-17T05:44:01.930501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:28:30.401981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3d","version":"0'0","reported_seq":13,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T05:44:04.970610+0000","last_change":"2024-09-17T05:44:02.971036+0000","last_active":"2024-09-17T05:44:04.970610+0000","last_peered":"2024-09-17T05:44:04.970610+0000","last_clean":"2024-09-17T05:44:04.970610+0000","last_became_active":"2024-09-17T05:44:02.970669+0000","last_became_peered":"2024-09-17T05:44:02.970669+0000","last_unstale":"2024-09-17T05:44:04.970610+0000","last_undegraded":"2024-09-17T05:44:04.970610+0000","last_fullsized":"2024-09-17T05:44:04.970610+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:44:01.930501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:44:01.930501+0000","last_clean_scrub_stamp":"2024-09-17T05:44:01.930501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:21:11.719829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3c","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:44:02.986117+0000","last_change":"2024-09-17T05:44:02.975046+0000","last_active":"2024-09-17T05:44:02.986117+0000","last_peered":"2024-09-17T05:44:02.986117+0000","last_clean":"2024-09-17T05:44:02.986117+0000","last_became_active":"2024-09-17T05:44:02.973872+0000","last_became_peered":"2024-09-17T05:44:02.973872+0000","last_unstale":"2024-09-17T05:44:02.986117+0000","last_undegraded":"2024-09-17T05:44:02.986117+0000","last_fullsized":"2024-09-17T05:44:02.986117+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:44:01.930501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:44:01.930501+0000","last_clean_scrub_stamp":"2024-09-17T05:44:01.930501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:23:39.449652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3b","version":"0'0","reported_seq":13,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T05:44:05.659101+0000","last_change":"2024-09-17T05:44:02.987062+0000","last_active":"2024-09-17T05:44:05.659101+0000","last_peered":"2024-09-17T05:44:05.659101+0000","last_clean":"2024-09-17T05:44:05.659101+0000","last_became_active":"2024-09-17T05:44:02.986714+0000","last_became_peered":"2024-09-17T05:44:02.986714+0000","last_unstale":"2024-09-17T05:44:05.659101+0000","last_undegraded":"2024-09-17T05:44:05.659101+0000","last_fullsized":"2024-09-17T05:44:05.659101+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:44:01.930501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:44:01.930501+0000","last_clean_scrub_stamp":"2024-09-17T05:44:01.930501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:42:40.168866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3a","version":"0'0","reported_seq":13,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T05:44:03.970509+0000","last_change":"2024-09-17T05:44:02.967402+0000","last_active":"2024-09-17T05:44:03.970509+0000","last_peered":"2024-09-17T05:44:03.970509+0000","last_clean":"2024-09-17T05:44:03.970509+0000","last_became_active":"2024-09-17T05:44:02.967118+0000","last_became_peered":"2024-09-17T05:44:02.967118+0000","last_unstale":"2024-09-17T05:44:03.970509+0000","last_undegraded":"2024-09-17T05:44:03.970509+0000","last_fullsized":"2024-09-17T05:44:03.970509+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:44:01.930501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:44:01.930501+0000","last_clean_scrub_stamp":"2024-09-17T05:44:01.930501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:42:22.361286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.39","version":"0'0","reported_seq":13,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T05:44:05.414847+0000","last_change":"2024-09-17T05:44:02.964592+0000","last_active":"2024-09-17T05:44:05.414847+0000","last_peered":"2024-09-17T05:44:05.414847+0000","last_clean":"2024-09-17T05:44:05.414847+0000","last_became_active":"2024-09-17T05:44:02.964316+0000","last_became_peered":"2024-09-17T05:44:02.964316+0000","last_unstale":"2024-09-17T05:44:05.414847+0000","last_undegraded":"2024-09-17T05:44:05.414847+0000","last_fullsized":"2024-09-17T05:44:05.414847+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:44:01.930501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:44:01.930501+0000","last_clean_scrub_stamp":"2024-09-17T05:44:01.930501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:18:09.625824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.38","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:44:02.993116+0000","last_change":"2024-09-17T05:44:02.988346+0000","last_active":"2024-09-17T05:44:02.993116+0000","last_peered":"2024-09-17T05:44:02.993116+0000","last_clean":"2024-09-17T05:44:02.993116+0000","last_became_active":"2024-09-17T05:44:02.987992+0000","last_became_peered":"2024-09-17T05:44:02.987992+0000","last_unstale":"2024-09-17T05:44:02.993116+0000","last_undegraded":"2024-09-17T05:44:02.993116+0000","last_fullsized":"2024-09-17T05:44:02.993116+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:44:01.930501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:44:01.930501+0000","last_clean_scrub_stamp":"2024-09-17T05:44:01.930501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:50:42.000977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.37","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:44:02.983745+0000","last_change":"2024-09-17T05:44:02.967050+0000","last_active":"2024-09-17T05:44:02.983745+0000","last_peered":"2024-09-17T05:44:02.983745+0000","last_clean":"2024-09-17T05:44:02.983745+0000","last_became_active":"2024-09-17T05:44:02.966728+0000","last_became_peered":"2024-09-17T05:44:02.966728+0000","last_unstale":"2024-09-17T05:44:02.983745+0000","last_undegraded":"2024-09-17T05:44:02.983745+0000","last_fullsized":"2024-09-17T05:44:02.983745+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:44:01.930501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:44:01.930501+0000","last_clean_scrub_stamp":"2024-09-17T05:44:01.930501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:52:36.822899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.36","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:44:02.986190+0000","last_change":"2024-09-17T05:44:02.975494+0000","last_active":"2024-09-17T05:44:02.986190+0000","last_peered":"2024-09-17T05:44:02.986190+0000","last_clean":"2024-09-17T05:44:02.986190+0000","last_became_active":"2024-09-17T05:44:02.975170+0000","last_became_peered":"2024-09-17T05:44:02.975170+0000","last_unstale":"2024-09-17T05:44:02.986190+0000","last_undegraded":"2024-09-17T05:44:02.986190+0000","last_fullsized":"2024-09-17T05:44:02.986190+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:44:01.930501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:44:01.930501+0000","last_clean_scrub_stamp":"2024-09-17T05:44:01.930501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:24:41.631032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.35","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:44:02.986369+0000","last_change":"2024-09-17T05:44:02.975023+0000","last_active":"2024-09-17T05:44:02.986369+0000","last_peered":"2024-09-17T05:44:02.986369+0000","last_clean":"2024-09-17T05:44:02.986369+0000","last_became_active":"2024-09-17T05:44:02.974597+0000","last_became_peered":"2024-09-17T05:44:02.974597+0000","last_unstale":"2024-09-17T05:44:02.986369+0000","last_undegraded":"2024-09-17T05:44:02.986369+0000","last_fullsized":"2024-09-17T05:44:02.986369+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:44:01.930501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:44:01.930501+0000","last_clean_scrub_stamp":"2024-09-17T05:44:01.930501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:23:02.419379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.34","version":"0'0","reported_seq":13,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T05:44:05.659346+0000","last_change":"2024-09-17T05:44:02.983676+0000","last_active":"2024-09-17T05:44:05.659346+0000","last_peered":"2024-09-17T05:44:05.659346+0000","last_clean":"2024-09-17T05:44:05.659346+0000","last_became_active":"2024-09-17T05:44:02.983071+0000","last_became_peered":"2024-09-17T05:44:02.983071+0000","last_unstale":"2024-09-17T05:44:05.659346+0000","last_undegraded":"2024-09-17T05:44:05.659346+0000","last_fullsized":"2024-09-17T05:44:05.659346+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:44:01.930501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:44:01.930501+0000","last_clean_scrub_stamp":"2024-09-17T05:44:01.930501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:45:10.615693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.33","version":"0'0","reported_seq":13,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T05:44:03.970768+0000","last_change":"2024-09-17T05:44:02.976306+0000","last_active":"2024-09-17T05:44:03.970768+0000","last_peered":"2024-09-17T05:44:03.970768+0000","last_clean":"2024-09-17T05:44:03.970768+0000","last_became_active":"2024-09-17T05:44:02.975950+0000","last_became_peered":"2024-09-17T05:44:02.975950+0000","last_unstale":"2024-09-17T05:44:03.970768+0000","last_undegraded":"2024-09-17T05:44:03.970768+0000","last_fullsized":"2024-09-17T05:44:03.970768+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:44:01.930501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:44:01.930501+0000","last_clean_scrub_stamp":"2024-09-17T05:44:01.930501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:16:15.916655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.32","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:44:02.983744+0000","last_change":"2024-09-17T05:44:02.964776+0000","last_active":"2024-09-17T05:44:02.983744+0000","last_peered":"2024-09-17T05:44:02.983744+0000","last_clean":"2024-09-17T05:44:02.983744+0000","last_became_active":"2024-09-17T05:44:02.964467+0000","last_became_peered":"2024-09-17T05:44:02.964467+0000","last_unstale":"2024-09-17T05:44:02.983744+0000","last_undegraded":"2024-09-17T05:44:02.983744+0000","last_fullsized":"2024-09-17T05:44:02.983744+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:44:01.930501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:44:01.930501+0000","last_clean_scrub_stamp":"2024-09-17T05:44:01.930501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:58:37.326070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.31","version":"0'0","reported_seq":13,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T05:44:03.970324+0000","last_change":"2024-09-17T05:44:02.973423+0000","last_active":"2024-09-17T05:44:03.970324+0000","last_peered":"2024-09-17T05:44:03.970324+0000","last_clean":"2024-09-17T05:44:03.970324+0000","last_became_active":"2024-09-17T05:44:02.973088+0000","last_became_peered":"2024-09-17T05:44:02.973088+0000","last_unstale":"2024-09-17T05:44:03.970324+0000","last_undegraded":"2024-09-17T05:44:03.970324+0000","last_fullsized":"2024-09-17T05:44:03.970324+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:44:01.930501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:44:01.930501+0000","last_clean_scrub_stamp":"2024-09-17T05:44:01.930501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:48:33.128790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.30","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-09-17T05:44:01.946541+0000","last_change":"2024-09-17T05:44:01.946541+0000","last_active":"2024-09-17T05:44:01.930501+0000","last_peered":"2024-09-17T05:44:01.930501+0000","last_clean":"2024-09-17T05:44:01.930501+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:44:01.946541+0000","last_undegraded":"2024-09-17T05:44:01.946541+0000","last_fullsized":"2024-09-17T05:44:01.946541+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:44:01.930501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:44:01.930501+0000","last_clean_scrub_stamp":"2024-09-17T05:44:01.930501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.2f","version":"0'0","reported_seq":13,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T05:44:04.970797+0000","last_change":"2024-09-17T05:44:02.980385+0000","last_active":"2024-09-17T05:44:04.970797+0000","last_peered":"2024-09-17T05:44:04.970797+0000","last_clean":"2024-09-17T05:44:04.970797+0000","last_became_active":"2024-09-17T05:44:02.979899+0000","last_became_peered":"2024-09-17T05:44:02.979899+0000","last_unstale":"2024-09-17T05:44:04.970797+0000","last_undegraded":"2024-09-17T05:44:04.970797+0000","last_fullsized":"2024-09-17T05:44:04.970797+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:44:01.930501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:44:01.930501+0000","last_clean_scrub_stamp":"2024-09-17T05:44:01.930501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:06:08.980606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2e","version":"0'0","reported_seq":13,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T05:44:04.971126+0000","last_change":"2024-09-17T05:44:02.987933+0000","last_active":"2024-09-17T05:44:04.971126+0000","last_peered":"2024-09-17T05:44:04.971126+0000","last_clean":"2024-09-17T05:44:04.971126+0000","last_became_active":"2024-09-17T05:44:02.986841+0000","last_became_peered":"2024-09-17T05:44:02.986841+0000","last_unstale":"2024-09-17T05:44:04.971126+0000","last_undegraded":"2024-09-17T05:44:04.971126+0000","last_fullsized":"2024-09-17T05:44:04.971126+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:44:01.930501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:44:01.930501+0000","last_clean_scrub_stamp":"2024-09-17T05:44:01.930501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:16:54.417419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2d","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-09-17T05:44:01.946426+0000","last_change":"2024-09-17T05:44:01.946426+0000","last_active":"2024-09-17T05:44:01.930501+0000","last_peered":"2024-09-17T05:44:01.930501+0000","last_clean":"2024-09-17T05:44:01.930501+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:44:01.946426+0000","last_undegraded":"2024-09-17T05:44:01.946426+0000","last_fullsized":"2024-09-17T05:44:01.946426+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:44:01.930501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:44:01.930501+0000","last_clean_scrub_stamp":"2024-09-17T05:44:01.930501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.2c","version":"0'0","reported_seq":13,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T05:44:03.971091+0000","last_change":"2024-09-17T05:44:02.975384+0000","last_active":"2024-09-17T05:44:03.971091+0000","last_peered":"2024-09-17T05:44:03.971091+0000","last_clean":"2024-09-17T05:44:03.971091+0000","last_became_active":"2024-09-17T05:44:02.969887+0000","last_became_peered":"2024-09-17T05:44:02.969887+0000","last_unstale":"2024-09-17T05:44:03.971091+0000","last_undegraded":"2024-09-17T05:44:03.971091+0000","last_fullsized":"2024-09-17T05:44:03.971091+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:44:01.930501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:44:01.930501+0000","last_clean_scrub_stamp":"2024-09-17T05:44:01.930501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:57:47.626723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2b","version":"0'0","reported_seq":13,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T05:44:03.971047+0000","last_change":"2024-09-17T05:44:02.975815+0000","last_active":"2024-09-17T05:44:03.971047+0000","last_peered":"2024-09-17T05:44:03.971047+0000","last_clean":"2024-09-17T05:44:03.971047+0000","last_became_active":"2024-09-17T05:44:02.975521+0000","last_became_peered":"2024-09-17T05:44:02.975521+0000","last_unstale":"2024-09-17T05:44:03.971047+0000","last_undegraded":"2024-09-17T05:44:03.971047+0000","last_fullsized":"2024-09-17T05:44:03.971047+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:44:01.930501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:44:01.930501+0000","last_clean_scrub_stamp":"2024-09-17T05:44:01.930501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:26:45.903869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.2a","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:44:02.986331+0000","last_change":"2024-09-17T05:44:02.976190+0000","last_active":"2024-09-17T05:44:02.986331+0000","last_peered":"2024-09-17T05:44:02.986331+0000","last_clean":"2024-09-17T05:44:02.986331+0000","last_became_active":"2024-09-17T05:44:02.975892+0000","last_became_peered":"2024-09-17T05:44:02.975892+0000","last_unstale":"2024-09-17T05:44:02.986331+0000","last_undegraded":"2024-09-17T05:44:02.986331+0000","last_fullsized":"2024-09-17T05:44:02.986331+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:44:01.930501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:44:01.930501+0000","last_clean_scrub_stamp":"2024-09-17T05:44:01.930501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:17:11.221074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.29","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-09-17T05:44:01.948604+0000","last_change":"2024-09-17T05:44:01.948604+0000","last_active":"2024-09-17T05:44:01.930501+0000","last_peered":"2024-09-17T05:44:01.930501+0000","last_clean":"2024-09-17T05:44:01.930501+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:44:01.948604+0000","last_undegraded":"2024-09-17T05:44:01.948604+0000","last_fullsized":"2024-09-17T05:44:01.948604+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:44:01.930501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:44:01.930501+0000","last_clean_scrub_stamp":"2024-09-17T05:44:01.930501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.28","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-09-17T05:44:01.945901+0000","last_change":"2024-09-17T05:44:01.945901+0000","last_active":"2024-09-17T05:44:01.930501+0000","last_peered":"2024-09-17T05:44:01.930501+0000","last_clean":"2024-09-17T05:44:01.930501+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:44:01.945901+0000","last_undegraded":"2024-09-17T05:44:01.945901+0000","last_fullsized":"2024-09-17T05:44:01.945901+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:44:01.930501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:44:01.930501+0000","last_clean_scrub_stamp":"2024-09-17T05:44:01.930501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.27","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-09-17T05:44:01.949356+0000","last_change":"2024-09-17T05:44:01.949356+0000","last_active":"2024-09-17T05:44:01.930501+0000","last_peered":"2024-09-17T05:44:01.930501+0000","last_clean":"2024-09-17T05:44:01.930501+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:44:01.949356+0000","last_undegraded":"2024-09-17T05:44:01.949356+0000","last_fullsized":"2024-09-17T05:44:01.949356+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:44:01.930501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:44:01.930501+0000","last_clean_scrub_stamp":"2024-09-17T05:44:01.930501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.26","version":"0'0","reported_seq":13,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T05:44:03.970968+0000","last_change":"2024-09-17T05:44:02.975515+0000","last_active":"2024-09-17T05:44:03.970968+0000","last_peered":"2024-09-17T05:44:03.970968+0000","last_clean":"2024-09-17T05:44:03.970968+0000","last_became_active":"2024-09-17T05:44:02.975200+0000","last_became_peered":"2024-09-17T05:44:02.975200+0000","last_unstale":"2024-09-17T05:44:03.970968+0000","last_undegraded":"2024-09-17T05:44:03.970968+0000","last_fullsized":"2024-09-17T05:44:03.970968+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:44:01.930501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:44:01.930501+0000","last_clean_scrub_stamp":"2024-09-17T05:44:01.930501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:00:49.479958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.25","version":"0'0","reported_seq":13,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T05:44:04.970651+0000","last_change":"2024-09-17T05:44:02.980263+0000","last_active":"2024-09-17T05:44:04.970651+0000","last_peered":"2024-09-17T05:44:04.970651+0000","last_clean":"2024-09-17T05:44:04.970651+0000","last_became_active":"2024-09-17T05:44:02.979881+0000","last_became_peered":"2024-09-17T05:44:02.979881+0000","last_unstale":"2024-09-17T05:44:04.970651+0000","last_undegraded":"2024-09-17T05:44:04.970651+0000","last_fullsized":"2024-09-17T05:44:04.970651+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:44:01.930501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:44:01.930501+0000","last_clean_scrub_stamp":"2024-09-17T05:44:01.930501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:55:06.339857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.24","version":"0'0","reported_seq":13,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T05:44:05.659277+0000","last_change":"2024-09-17T05:44:02.983423+0000","last_active":"2024-09-17T05:44:05.659277+0000","last_peered":"2024-09-17T05:44:05.659277+0000","last_clean":"2024-09-17T05:44:05.659277+0000","last_became_active":"2024-09-17T05:44:02.982942+0000","last_became_peered":"2024-09-17T05:44:02.982942+0000","last_unstale":"2024-09-17T05:44:05.659277+0000","last_undegraded":"2024-09-17T05:44:05.659277+0000","last_fullsized":"2024-09-17T05:44:05.659277+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:44:01.930501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:44:01.930501+0000","last_clean_scrub_stamp":"2024-09-17T05:44:01.930501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:23:24.999309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.23","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-09-17T05:44:01.945462+0000","last_change":"2024-09-17T05:44:01.945462+0000","last_active":"2024-09-17T05:44:01.930501+0000","last_peered":"2024-09-17T05:44:01.930501+0000","last_clean":"2024-09-17T05:44:01.930501+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:44:01.945462+0000","last_undegraded":"2024-09-17T05:44:01.945462+0000","last_fullsized":"2024-09-17T05:44:01.945462+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:44:01.930501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:44:01.930501+0000","last_clean_scrub_stamp":"2024-09-17T05:44:01.930501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.22","version":"0'0","reported_seq":13,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T05:44:04.970507+0000","last_change":"2024-09-17T05:44:02.973004+0000","last_active":"2024-09-17T05:44:04.970507+0000","last_peered":"2024-09-17T05:44:04.970507+0000","last_clean":"2024-09-17T05:44:04.970507+0000","last_became_active":"2024-09-17T05:44:02.972681+0000","last_became_peered":"2024-09-17T05:44:02.972681+0000","last_unstale":"2024-09-17T05:44:04.970507+0000","last_undegraded":"2024-09-17T05:44:04.970507+0000","last_fullsized":"2024-09-17T05:44:04.970507+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:44:01.930501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:44:01.930501+0000","last_clean_scrub_stamp":"2024-09-17T05:44:01.930501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:41:24.794306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.21","version":"0'0","reported_seq":13,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T05:44:03.970995+0000","last_change":"2024-09-17T05:44:02.977953+0000","last_active":"2024-09-17T05:44:03.970995+0000","last_peered":"2024-09-17T05:44:03.970995+0000","last_clean":"2024-09-17T05:44:03.970995+0000","last_became_active":"2024-09-17T05:44:02.977624+0000","last_became_peered":"2024-09-17T05:44:02.977624+0000","last_unstale":"2024-09-17T05:44:03.970995+0000","last_undegraded":"2024-09-17T05:44:03.970995+0000","last_fullsized":"2024-09-17T05:44:03.970995+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:44:01.930501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:44:01.930501+0000","last_clean_scrub_stamp":"2024-09-17T05:44:01.930501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:51:59.823755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.20","version":"0'0","reported_seq":13,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T05:44:03.971876+0000","last_change":"2024-09-17T05:44:02.978709+0000","last_active":"2024-09-17T05:44:03.971876+0000","last_peered":"2024-09-17T05:44:03.971876+0000","last_clean":"2024-09-17T05:44:03.971876+0000","last_became_active":"2024-09-17T05:44:02.978052+0000","last_became_peered":"2024-09-17T05:44:02.978052+0000","last_unstale":"2024-09-17T05:44:03.971876+0000","last_undegraded":"2024-09-17T05:44:03.971876+0000","last_fullsized":"2024-09-17T05:44:03.971876+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:44:01.930501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:44:01.930501+0000","last_clean_scrub_stamp":"2024-09-17T05:44:01.930501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:42:10.964610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":13,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T05:44:05.915609+0000","last_change":"2024-09-17T05:44:02.965033+0000","last_active":"2024-09-17T05:44:05.915609+0000","last_peered":"2024-09-17T05:44:05.915609+0000","last_clean":"2024-09-17T05:44:05.915609+0000","last_became_active":"2024-09-17T05:44:02.964721+0000","last_became_peered":"2024-09-17T05:44:02.964721+0000","last_unstale":"2024-09-17T05:44:05.915609+0000","last_undegraded":"2024-09-17T05:44:05.915609+0000","last_fullsized":"2024-09-17T05:44:05.915609+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:44:01.930501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:44:01.930501+0000","last_clean_scrub_stamp":"2024-09-17T05:44:01.930501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:44:44.295610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"44'4","reported_seq":19,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T05:44:03.970754+0000","last_change":"2024-09-17T05:44:01.954506+0000","last_active":"2024-09-17T05:44:03.970754+0000","last_peered":"2024-09-17T05:44:03.970754+0000","last_clean":"2024-09-17T05:44:03.970754+0000","last_became_active":"2024-09-17T05:44:01.954200+0000","last_became_peered":"2024-09-17T05:44:01.954200+0000","last_unstale":"2024-09-17T05:44:03.970754+0000","last_undegraded":"2024-09-17T05:44:03.970754+0000","last_fullsized":"2024-09-17T05:44:03.970754+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:44:00.925414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:44:00.925414+0000","last_clean_scrub_stamp":"2024-09-17T05:44:00.925414+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:06:07.975519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-09-17T05:44:01.948703+0000","last_change":"2024-09-17T05:44:01.948703+0000","last_active":"2024-09-17T05:44:01.930501+0000","last_peered":"2024-09-17T05:44:01.930501+0000","last_clean":"2024-09-17T05:44:01.930501+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:44:01.948703+0000","last_undegraded":"2024-09-17T05:44:01.948703+0000","last_fullsized":"2024-09-17T05:44:01.948703+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:44:01.930501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:44:01.930501+0000","last_clean_scrub_stamp":"2024-09-17T05:44:01.930501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1e","version":"44'1","reported_seq":16,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T05:44:04.971199+0000","last_change":"2024-09-17T05:44:01.952534+0000","last_active":"2024-09-17T05:44:04.971199+0000","last_peered":"2024-09-17T05:44:04.971199+0000","last_clean":"2024-09-17T05:44:04.971199+0000","last_became_active":"2024-09-17T05:44:01.952187+0000","last_became_peered":"2024-09-17T05:44:01.952187+0000","last_unstale":"2024-09-17T05:44:04.971199+0000","last_undegraded":"2024-09-17T05:44:04.971199+0000","last_fullsized":"2024-09-17T05:44:04.971199+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:44:00.925414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:44:00.925414+0000","last_clean_scrub_stamp":"2024-09-17T05:44:00.925414+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:12:38.503949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":13,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T05:44:05.659502+0000","last_change":"2024-09-17T05:44:02.980083+0000","last_active":"2024-09-17T05:44:05.659502+0000","last_peered":"2024-09-17T05:44:05.659502+0000","last_clean":"2024-09-17T05:44:05.659502+0000","last_became_active":"2024-09-17T05:44:02.979747+0000","last_became_peered":"2024-09-17T05:44:02.979747+0000","last_unstale":"2024-09-17T05:44:05.659502+0000","last_undegraded":"2024-09-17T05:44:05.659502+0000","last_fullsized":"2024-09-17T05:44:05.659502+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:44:01.930501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:44:01.930501+0000","last_clean_scrub_stamp":"2024-09-17T05:44:01.930501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:51:23.709979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1d","version":"44'2","reported_seq":17,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T05:44:05.915916+0000","last_change":"2024-09-17T05:44:01.956537+0000","last_active":"2024-09-17T05:44:05.915916+0000","last_peered":"2024-09-17T05:44:05.915916+0000","last_clean":"2024-09-17T05:44:05.915916+0000","last_became_active":"2024-09-17T05:44:01.956185+0000","last_became_peered":"2024-09-17T05:44:01.956185+0000","last_unstale":"2024-09-17T05:44:05.915916+0000","last_undegraded":"2024-09-17T05:44:05.915916+0000","last_fullsized":"2024-09-17T05:44:05.915916+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:44:00.925414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:44:00.925414+0000","last_clean_scrub_stamp":"2024-09-17T05:44:00.925414+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:46:03.151717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":13,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T05:44:05.916049+0000","last_change":"2024-09-17T05:44:02.976645+0000","last_active":"2024-09-17T05:44:05.916049+0000","last_peered":"2024-09-17T05:44:05.916049+0000","last_clean":"2024-09-17T05:44:05.916049+0000","last_became_active":"2024-09-17T05:44:02.976312+0000","last_became_peered":"2024-09-17T05:44:02.976312+0000","last_unstale":"2024-09-17T05:44:05.916049+0000","last_undegraded":"2024-09-17T05:44:05.916049+0000","last_fullsized":"2024-09-17T05:44:05.916049+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:44:01.930501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:44:01.930501+0000","last_clean_scrub_stamp":"2024-09-17T05:44:01.930501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:05:28.918610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"44'2","reported_seq":17,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T05:44:05.414708+0000","last_change":"2024-09-17T05:44:01.957595+0000","last_active":"2024-09-17T05:44:05.414708+0000","last_peered":"2024-09-17T05:44:05.414708+0000","last_clean":"2024-09-17T05:44:05.414708+0000","last_became_active":"2024-09-17T05:44:01.957224+0000","last_became_peered":"2024-09-17T05:44:01.957224+0000","last_unstale":"2024-09-17T05:44:05.414708+0000","last_undegraded":"2024-09-17T05:44:05.414708+0000","last_fullsized":"2024-09-17T05:44:05.414708+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:44:00.925414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:44:00.925414+0000","last_clean_scrub_stamp":"2024-09-17T05:44:00.925414+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:35:05.665060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":13,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T05:44:04.970762+0000","last_change":"2024-09-17T05:44:02.976326+0000","last_active":"2024-09-17T05:44:04.970762+0000","last_peered":"2024-09-17T05:44:04.970762+0000","last_clean":"2024-09-17T05:44:04.970762+0000","last_became_active":"2024-09-17T05:44:02.975980+0000","last_became_peered":"2024-09-17T05:44:02.975980+0000","last_unstale":"2024-09-17T05:44:04.970762+0000","last_undegraded":"2024-09-17T05:44:04.970762+0000","last_fullsized":"2024-09-17T05:44:04.970762+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:44:01.930501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:44:01.930501+0000","last_clean_scrub_stamp":"2024-09-17T05:44:01.930501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:51:53.246482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"44'1","reported_seq":16,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T05:44:03.971076+0000","last_change":"2024-09-17T05:44:01.949683+0000","last_active":"2024-09-17T05:44:03.971076+0000","last_peered":"2024-09-17T05:44:03.971076+0000","last_clean":"2024-09-17T05:44:03.971076+0000","last_became_active":"2024-09-17T05:44:01.949320+0000","last_became_peered":"2024-09-17T05:44:01.949320+0000","last_unstale":"2024-09-17T05:44:03.971076+0000","last_undegraded":"2024-09-17T05:44:03.971076+0000","last_fullsized":"2024-09-17T05:44:03.971076+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:44:00.925414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:44:00.925414+0000","last_clean_scrub_stamp":"2024-09-17T05:44:00.925414+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:46:36.414158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:44:02.986043+0000","last_change":"2024-09-17T05:44:02.968696+0000","last_active":"2024-09-17T05:44:02.986043+0000","last_peered":"2024-09-17T05:44:02.986043+0000","last_clean":"2024-09-17T05:44:02.986043+0000","last_became_active":"2024-09-17T05:44:02.968360+0000","last_became_peered":"2024-09-17T05:44:02.968360+0000","last_unstale":"2024-09-17T05:44:02.986043+0000","last_undegraded":"2024-09-17T05:44:02.986043+0000","last_fullsized":"2024-09-17T05:44:02.986043+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:44:01.930501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:44:01.930501+0000","last_clean_scrub_stamp":"2024-09-17T05:44:01.930501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:05:09.812483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1a","version":"44'1","reported_seq":16,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T05:44:04.970598+0000","last_change":"2024-09-17T05:44:01.949830+0000","last_active":"2024-09-17T05:44:04.970598+0000","last_peered":"2024-09-17T05:44:04.970598+0000","last_clean":"2024-09-17T05:44:04.970598+0000","last_became_active":"2024-09-17T05:44:01.949509+0000","last_became_peered":"2024-09-17T05:44:01.949509+0000","last_unstale":"2024-09-17T05:44:04.970598+0000","last_undegraded":"2024-09-17T05:44:04.970598+0000","last_fullsized":"2024-09-17T05:44:04.970598+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:44:00.925414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:44:00.925414+0000","last_clean_scrub_stamp":"2024-09-17T05:44:00.925414+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:13:58.348730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:44:02.993131+0000","last_change":"2024-09-17T05:44:02.989081+0000","last_active":"2024-09-17T05:44:02.993131+0000","last_peered":"2024-09-17T05:44:02.993131+0000","last_clean":"2024-09-17T05:44:02.993131+0000","last_became_active":"2024-09-17T05:44:02.988354+0000","last_became_peered":"2024-09-17T05:44:02.988354+0000","last_unstale":"2024-09-17T05:44:02.993131+0000","last_undegraded":"2024-09-17T05:44:02.993131+0000","last_fullsized":"2024-09-17T05:44:02.993131+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:44:01.930501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:44:01.930501+0000","last_clean_scrub_stamp":"2024-09-17T05:44:01.930501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:36:28.222836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":15,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T05:44:05.658774+0000","last_change":"2024-09-17T05:44:01.955804+0000","last_active":"2024-09-17T05:44:05.658774+0000","last_peered":"2024-09-17T05:44:05.658774+0000","last_clean":"2024-09-17T05:44:05.658774+0000","last_became_active":"2024-09-17T05:44:01.955195+0000","last_became_peered":"2024-09-17T05:44:01.955195+0000","last_unstale":"2024-09-17T05:44:05.658774+0000","last_undegraded":"2024-09-17T05:44:05.658774+0000","last_fullsized":"2024-09-17T05:44:05.658774+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:44:00.925414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:44:00.925414+0000","last_clean_scrub_stamp":"2024-09-17T05:44:00.925414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:44:43.290523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-09-17T05:44:01.949231+0000","last_change":"2024-09-17T05:44:01.949231+0000","last_active":"2024-09-17T05:44:01.930501+0000","last_peered":"2024-09-17T05:44:01.930501+0000","last_clean":"2024-09-17T05:44:01.930501+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:44:01.949231+0000","last_undegraded":"2024-09-17T05:44:01.949231+0000","last_fullsized":"2024-09-17T05:44:01.949231+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:44:01.930501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:44:01.930501+0000","last_clean_scrub_stamp":"2024-09-17T05:44:01.930501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:44:02.958951+0000","last_change":"2024-09-17T05:44:01.949647+0000","last_active":"2024-09-17T05:44:02.958951+0000","last_peered":"2024-09-17T05:44:02.958951+0000","last_clean":"2024-09-17T05:44:02.958951+0000","last_became_active":"2024-09-17T05:44:01.949263+0000","last_became_peered":"2024-09-17T05:44:01.949263+0000","last_unstale":"2024-09-17T05:44:02.958951+0000","last_undegraded":"2024-09-17T05:44:02.958951+0000","last_fullsized":"2024-09-17T05:44:02.958951+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:44:00.925414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:44:00.925414+0000","last_clean_scrub_stamp":"2024-09-17T05:44:00.925414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:26:01.492424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":13,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T05:44:04.971121+0000","last_change":"2024-09-17T05:44:02.987319+0000","last_active":"2024-09-17T05:44:04.971121+0000","last_peered":"2024-09-17T05:44:04.971121+0000","last_clean":"2024-09-17T05:44:04.971121+0000","last_became_active":"2024-09-17T05:44:02.986401+0000","last_became_peered":"2024-09-17T05:44:02.986401+0000","last_unstale":"2024-09-17T05:44:04.971121+0000","last_undegraded":"2024-09-17T05:44:04.971121+0000","last_fullsized":"2024-09-17T05:44:04.971121+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:44:01.930501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:44:01.930501+0000","last_clean_scrub_stamp":"2024-09-17T05:44:01.930501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:36:30.650560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":15,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T05:44:04.970859+0000","last_change":"2024-09-17T05:44:01.951077+0000","last_active":"2024-09-17T05:44:04.970859+0000","last_peered":"2024-09-17T05:44:04.970859+0000","last_clean":"2024-09-17T05:44:04.970859+0000","last_became_active":"2024-09-17T05:44:01.950715+0000","last_became_peered":"2024-09-17T05:44:01.950715+0000","last_unstale":"2024-09-17T05:44:04.970859+0000","last_undegraded":"2024-09-17T05:44:04.970859+0000","last_fullsized":"2024-09-17T05:44:04.970859+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:44:00.925414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:44:00.925414+0000","last_clean_scrub_stamp":"2024-09-17T05:44:00.925414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:34:19.904802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":13,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T05:44:05.415322+0000","last_change":"2024-09-17T05:44:02.980515+0000","last_active":"2024-09-17T05:44:05.415322+0000","last_peered":"2024-09-17T05:44:05.415322+0000","last_clean":"2024-09-17T05:44:05.415322+0000","last_became_active":"2024-09-17T05:44:02.980069+0000","last_became_peered":"2024-09-17T05:44:02.980069+0000","last_unstale":"2024-09-17T05:44:05.415322+0000","last_undegraded":"2024-09-17T05:44:05.415322+0000","last_fullsized":"2024-09-17T05:44:05.415322+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:44:01.930501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:44:01.930501+0000","last_clean_scrub_stamp":"2024-09-17T05:44:01.930501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:35:11.922195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:44:02.959919+0000","last_change":"2024-09-17T05:44:01.950607+0000","last_active":"2024-09-17T05:44:02.959919+0000","last_peered":"2024-09-17T05:44:02.959919+0000","last_clean":"2024-09-17T05:44:02.959919+0000","last_became_active":"2024-09-17T05:44:01.950263+0000","last_became_peered":"2024-09-17T05:44:01.950263+0000","last_unstale":"2024-09-17T05:44:02.959919+0000","last_undegraded":"2024-09-17T05:44:02.959919+0000","last_fullsized":"2024-09-17T05:44:02.959919+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:44:00.925414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:44:00.925414+0000","last_clean_scrub_stamp":"2024-09-17T05:44:00.925414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:53:32.014377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":13,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T05:44:03.970541+0000","last_change":"2024-09-17T05:44:02.970209+0000","last_active":"2024-09-17T05:44:03.970541+0000","last_peered":"2024-09-17T05:44:03.970541+0000","last_clean":"2024-09-17T05:44:03.970541+0000","last_became_active":"2024-09-17T05:44:02.969924+0000","last_became_peered":"2024-09-17T05:44:02.969924+0000","last_unstale":"2024-09-17T05:44:03.970541+0000","last_undegraded":"2024-09-17T05:44:03.970541+0000","last_fullsized":"2024-09-17T05:44:03.970541+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:44:01.930501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:44:01.930501+0000","last_clean_scrub_stamp":"2024-09-17T05:44:01.930501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:40:41.740300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"44'3","reported_seq":18,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T05:44:05.414988+0000","last_change":"2024-09-17T05:44:01.958643+0000","last_active":"2024-09-17T05:44:05.414988+0000","last_peered":"2024-09-17T05:44:05.414988+0000","last_clean":"2024-09-17T05:44:05.414988+0000","last_became_active":"2024-09-17T05:44:01.958310+0000","last_became_peered":"2024-09-17T05:44:01.958310+0000","last_unstale":"2024-09-17T05:44:05.414988+0000","last_undegraded":"2024-09-17T05:44:05.414988+0000","last_fullsized":"2024-09-17T05:44:05.414988+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:44:00.925414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:44:00.925414+0000","last_clean_scrub_stamp":"2024-09-17T05:44:00.925414+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:03:12.501051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":13,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T05:44:05.414895+0000","last_change":"2024-09-17T05:44:02.968507+0000","last_active":"2024-09-17T05:44:05.414895+0000","last_peered":"2024-09-17T05:44:05.414895+0000","last_clean":"2024-09-17T05:44:05.414895+0000","last_became_active":"2024-09-17T05:44:02.968167+0000","last_became_peered":"2024-09-17T05:44:02.968167+0000","last_unstale":"2024-09-17T05:44:05.414895+0000","last_undegraded":"2024-09-17T05:44:05.414895+0000","last_fullsized":"2024-09-17T05:44:05.414895+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:44:01.930501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:44:01.930501+0000","last_clean_scrub_stamp":"2024-09-17T05:44:01.930501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:27:06.309594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.14","version":"44'6","reported_seq":21,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T05:44:03.971157+0000","last_change":"2024-09-17T05:44:01.942944+0000","last_active":"2024-09-17T05:44:03.971157+0000","last_peered":"2024-09-17T05:44:03.971157+0000","last_clean":"2024-09-17T05:44:03.971157+0000","last_became_active":"2024-09-17T05:44:01.942488+0000","last_became_peered":"2024-09-17T05:44:01.942488+0000","last_unstale":"2024-09-17T05:44:03.971157+0000","last_undegraded":"2024-09-17T05:44:03.971157+0000","last_fullsized":"2024-09-17T05:44:03.971157+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:44:00.925414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:44:00.925414+0000","last_clean_scrub_stamp":"2024-09-17T05:44:00.925414+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:29:01.447727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-09-17T05:44:01.946200+0000","last_change":"2024-09-17T05:44:01.946200+0000","last_active":"2024-09-17T05:44:01.930501+0000","last_peered":"2024-09-17T05:44:01.930501+0000","last_clean":"2024-09-17T05:44:01.930501+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:44:01.946200+0000","last_undegraded":"2024-09-17T05:44:01.946200+0000","last_fullsized":"2024-09-17T05:44:01.946200+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:44:01.930501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:44:01.930501+0000","last_clean_scrub_stamp":"2024-09-17T05:44:01.930501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"44'2","reported_seq":17,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T05:44:03.971121+0000","last_change":"2024-09-17T05:44:01.948885+0000","last_active":"2024-09-17T05:44:03.971121+0000","last_peered":"2024-09-17T05:44:03.971121+0000","last_clean":"2024-09-17T05:44:03.971121+0000","last_became_active":"2024-09-17T05:44:01.948319+0000","last_became_peered":"2024-09-17T05:44:01.948319+0000","last_unstale":"2024-09-17T05:44:03.971121+0000","last_undegraded":"2024-09-17T05:44:03.971121+0000","last_fullsized":"2024-09-17T05:44:03.971121+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:44:00.925414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:44:00.925414+0000","last_clean_scrub_stamp":"2024-09-17T05:44:00.925414+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:26:48.401818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:44:02.986237+0000","last_change":"2024-09-17T05:44:02.979714+0000","last_active":"2024-09-17T05:44:02.986237+0000","last_peered":"2024-09-17T05:44:02.986237+0000","last_clean":"2024-09-17T05:44:02.986237+0000","last_became_active":"2024-09-17T05:44:02.977592+0000","last_became_peered":"2024-09-17T05:44:02.977592+0000","last_unstale":"2024-09-17T05:44:02.986237+0000","last_undegraded":"2024-09-17T05:44:02.986237+0000","last_fullsized":"2024-09-17T05:44:02.986237+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:44:01.930501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:44:01.930501+0000","last_clean_scrub_stamp":"2024-09-17T05:44:01.930501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:04:06.058220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":15,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T05:44:05.414641+0000","last_change":"2024-09-17T05:44:01.952325+0000","last_active":"2024-09-17T05:44:05.414641+0000","last_peered":"2024-09-17T05:44:05.414641+0000","last_clean":"2024-09-17T05:44:05.414641+0000","last_became_active":"2024-09-17T05:44:01.952005+0000","last_became_peered":"2024-09-17T05:44:01.952005+0000","last_unstale":"2024-09-17T05:44:05.414641+0000","last_undegraded":"2024-09-17T05:44:05.414641+0000","last_fullsized":"2024-09-17T05:44:05.414641+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:44:00.925414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:44:00.925414+0000","last_clean_scrub_stamp":"2024-09-17T05:44:00.925414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:01:33.262027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":13,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T05:44:03.970252+0000","last_change":"2024-09-17T05:44:02.969515+0000","last_active":"2024-09-17T05:44:03.970252+0000","last_peered":"2024-09-17T05:44:03.970252+0000","last_clean":"2024-09-17T05:44:03.970252+0000","last_became_active":"2024-09-17T05:44:02.968910+0000","last_became_peered":"2024-09-17T05:44:02.968910+0000","last_unstale":"2024-09-17T05:44:03.970252+0000","last_undegraded":"2024-09-17T05:44:03.970252+0000","last_fullsized":"2024-09-17T05:44:03.970252+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:44:01.930501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:44:01.930501+0000","last_clean_scrub_stamp":"2024-09-17T05:44:01.930501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:04:08.756849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":15,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T05:44:03.970397+0000","last_change":"2024-09-17T05:44:01.948603+0000","last_active":"2024-09-17T05:44:03.970397+0000","last_peered":"2024-09-17T05:44:03.970397+0000","last_clean":"2024-09-17T05:44:03.970397+0000","last_became_active":"2024-09-17T05:44:01.948261+0000","last_became_peered":"2024-09-17T05:44:01.948261+0000","last_unstale":"2024-09-17T05:44:03.970397+0000","last_undegraded":"2024-09-17T05:44:03.970397+0000","last_fullsized":"2024-09-17T05:44:03.970397+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:44:00.925414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:44:00.925414+0000","last_clean_scrub_stamp":"2024-09-17T05:44:00.925414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:51:52.241395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":13,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T05:44:05.414907+0000","last_change":"2024-09-17T05:44:02.980463+0000","last_active":"2024-09-17T05:44:05.414907+0000","last_peered":"2024-09-17T05:44:05.414907+0000","last_clean":"2024-09-17T05:44:05.414907+0000","last_became_active":"2024-09-17T05:44:02.979921+0000","last_became_peered":"2024-09-17T05:44:02.979921+0000","last_unstale":"2024-09-17T05:44:05.414907+0000","last_undegraded":"2024-09-17T05:44:05.414907+0000","last_fullsized":"2024-09-17T05:44:05.414907+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:44:01.930501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:44:01.930501+0000","last_clean_scrub_stamp":"2024-09-17T05:44:01.930501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:32:37.948066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.10","version":"44'8","reported_seq":21,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:44:02.993082+0000","last_change":"2024-09-17T05:44:01.955769+0000","last_active":"2024-09-17T05:44:02.993082+0000","last_peered":"2024-09-17T05:44:02.993082+0000","last_clean":"2024-09-17T05:44:02.993082+0000","last_became_active":"2024-09-17T05:44:01.955407+0000","last_became_peered":"2024-09-17T05:44:01.955407+0000","last_unstale":"2024-09-17T05:44:02.993082+0000","last_undegraded":"2024-09-17T05:44:02.993082+0000","last_fullsized":"2024-09-17T05:44:02.993082+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:44:00.925414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:44:00.925414+0000","last_clean_scrub_stamp":"2024-09-17T05:44:00.925414+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:16:36.932317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":13,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T05:44:03.971209+0000","last_change":"2024-09-17T05:44:02.977094+0000","last_active":"2024-09-17T05:44:03.971209+0000","last_peered":"2024-09-17T05:44:03.971209+0000","last_clean":"2024-09-17T05:44:03.971209+0000","last_became_active":"2024-09-17T05:44:02.976821+0000","last_became_peered":"2024-09-17T05:44:02.976821+0000","last_unstale":"2024-09-17T05:44:03.971209+0000","last_undegraded":"2024-09-17T05:44:03.971209+0000","last_fullsized":"2024-09-17T05:44:03.971209+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:44:01.930501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:44:01.930501+0000","last_clean_scrub_stamp":"2024-09-17T05:44:01.930501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:03:21.010459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"44'1","reported_seq":16,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T05:44:03.971363+0000","last_change":"2024-09-17T05:44:01.947617+0000","last_active":"2024-09-17T05:44:03.971363+0000","last_peered":"2024-09-17T05:44:03.971363+0000","last_clean":"2024-09-17T05:44:03.971363+0000","last_became_active":"2024-09-17T05:44:01.947272+0000","last_became_peered":"2024-09-17T05:44:01.947272+0000","last_unstale":"2024-09-17T05:44:03.971363+0000","last_undegraded":"2024-09-17T05:44:03.971363+0000","last_fullsized":"2024-09-17T05:44:03.971363+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:44:00.925414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:44:00.925414+0000","last_clean_scrub_stamp":"2024-09-17T05:44:00.925414+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:26:24.738054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:44:02.983449+0000","last_change":"2024-09-17T05:44:02.964018+0000","last_active":"2024-09-17T05:44:02.983449+0000","last_peered":"2024-09-17T05:44:02.983449+0000","last_clean":"2024-09-17T05:44:02.983449+0000","last_became_active":"2024-09-17T05:44:02.963717+0000","last_became_peered":"2024-09-17T05:44:02.963717+0000","last_unstale":"2024-09-17T05:44:02.983449+0000","last_undegraded":"2024-09-17T05:44:02.983449+0000","last_fullsized":"2024-09-17T05:44:02.983449+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:44:01.930501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:44:01.930501+0000","last_clean_scrub_stamp":"2024-09-17T05:44:01.930501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:56:58.722211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.e","version":"44'2","reported_seq":17,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T05:44:04.971214+0000","last_change":"2024-09-17T05:44:01.948758+0000","last_active":"2024-09-17T05:44:04.971214+0000","last_peered":"2024-09-17T05:44:04.971214+0000","last_clean":"2024-09-17T05:44:04.971214+0000","last_became_active":"2024-09-17T05:44:01.948353+0000","last_became_peered":"2024-09-17T05:44:01.948353+0000","last_unstale":"2024-09-17T05:44:04.971214+0000","last_undegraded":"2024-09-17T05:44:04.971214+0000","last_fullsized":"2024-09-17T05:44:04.971214+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:44:00.925414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:44:00.925414+0000","last_clean_scrub_stamp":"2024-09-17T05:44:00.925414+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:40:24.517815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-09-17T05:44:01.946176+0000","last_change":"2024-09-17T05:44:01.946176+0000","last_active":"2024-09-17T05:44:01.930501+0000","last_peered":"2024-09-17T05:44:01.930501+0000","last_clean":"2024-09-17T05:44:01.930501+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:44:01.946176+0000","last_undegraded":"2024-09-17T05:44:01.946176+0000","last_fullsized":"2024-09-17T05:44:01.946176+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:44:01.930501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:44:01.930501+0000","last_clean_scrub_stamp":"2024-09-17T05:44:01.930501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.d","version":"44'1","reported_seq":16,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T05:44:05.659115+0000","last_change":"2024-09-17T05:44:01.952723+0000","last_active":"2024-09-17T05:44:05.659115+0000","last_peered":"2024-09-17T05:44:05.659115+0000","last_clean":"2024-09-17T05:44:05.659115+0000","last_became_active":"2024-09-17T05:44:01.952249+0000","last_became_peered":"2024-09-17T05:44:01.952249+0000","last_unstale":"2024-09-17T05:44:05.659115+0000","last_undegraded":"2024-09-17T05:44:05.659115+0000","last_fullsized":"2024-09-17T05:44:05.659115+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:44:00.925414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:44:00.925414+0000","last_clean_scrub_stamp":"2024-09-17T05:44:00.925414+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:05:27.913523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-09-17T05:44:01.948237+0000","last_change":"2024-09-17T05:44:01.948237+0000","last_active":"2024-09-17T05:44:01.930501+0000","last_peered":"2024-09-17T05:44:01.930501+0000","last_clean":"2024-09-17T05:44:01.930501+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:44:01.948237+0000","last_undegraded":"2024-09-17T05:44:01.948237+0000","last_fullsized":"2024-09-17T05:44:01.948237+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:44:01.930501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:44:01.930501+0000","last_clean_scrub_stamp":"2024-09-17T05:44:01.930501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":15,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T05:44:03.970437+0000","last_change":"2024-09-17T05:44:01.954281+0000","last_active":"2024-09-17T05:44:03.970437+0000","last_peered":"2024-09-17T05:44:03.970437+0000","last_clean":"2024-09-17T05:44:03.970437+0000","last_became_active":"2024-09-17T05:44:01.953910+0000","last_became_peered":"2024-09-17T05:44:01.953910+0000","last_unstale":"2024-09-17T05:44:03.970437+0000","last_undegraded":"2024-09-17T05:44:03.970437+0000","last_fullsized":"2024-09-17T05:44:03.970437+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:44:00.925414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:44:00.925414+0000","last_clean_scrub_stamp":"2024-09-17T05:44:00.925414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:16:53.412332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":13,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T05:44:03.970683+0000","last_change":"2024-09-17T05:44:02.970330+0000","last_active":"2024-09-17T05:44:03.970683+0000","last_peered":"2024-09-17T05:44:03.970683+0000","last_clean":"2024-09-17T05:44:03.970683+0000","last_became_active":"2024-09-17T05:44:02.969132+0000","last_became_peered":"2024-09-17T05:44:02.969132+0000","last_unstale":"2024-09-17T05:44:03.970683+0000","last_undegraded":"2024-09-17T05:44:03.970683+0000","last_fullsized":"2024-09-17T05:44:03.970683+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:44:01.930501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:44:01.930501+0000","last_clean_scrub_stamp":"2024-09-17T05:44:01.930501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:12:05.855315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.b","version":"44'2","reported_seq":17,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T05:44:03.971241+0000","last_change":"2024-09-17T05:44:01.952417+0000","last_active":"2024-09-17T05:44:03.971241+0000","last_peered":"2024-09-17T05:44:03.971241+0000","last_clean":"2024-09-17T05:44:03.971241+0000","last_became_active":"2024-09-17T05:44:01.951779+0000","last_became_peered":"2024-09-17T05:44:01.951779+0000","last_unstale":"2024-09-17T05:44:03.971241+0000","last_undegraded":"2024-09-17T05:44:03.971241+0000","last_fullsized":"2024-09-17T05:44:03.971241+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:44:00.925414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:44:00.925414+0000","last_clean_scrub_stamp":"2024-09-17T05:44:00.925414+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:39:36.775312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":13,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T05:44:05.915357+0000","last_change":"2024-09-17T05:44:02.976421+0000","last_active":"2024-09-17T05:44:05.915357+0000","last_peered":"2024-09-17T05:44:05.915357+0000","last_clean":"2024-09-17T05:44:05.915357+0000","last_became_active":"2024-09-17T05:44:02.976091+0000","last_became_peered":"2024-09-17T05:44:02.976091+0000","last_unstale":"2024-09-17T05:44:05.915357+0000","last_undegraded":"2024-09-17T05:44:05.915357+0000","last_fullsized":"2024-09-17T05:44:05.915357+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:44:01.930501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:44:01.930501+0000","last_clean_scrub_stamp":"2024-09-17T05:44:01.930501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:17:16.014677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":15,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T05:44:05.658767+0000","last_change":"2024-09-17T05:44:01.956743+0000","last_active":"2024-09-17T05:44:05.658767+0000","last_peered":"2024-09-17T05:44:05.658767+0000","last_clean":"2024-09-17T05:44:05.658767+0000","last_became_active":"2024-09-17T05:44:01.955453+0000","last_became_peered":"2024-09-17T05:44:01.955453+0000","last_unstale":"2024-09-17T05:44:05.658767+0000","last_undegraded":"2024-09-17T05:44:05.658767+0000","last_fullsized":"2024-09-17T05:44:05.658767+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:44:00.925414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:44:00.925414+0000","last_clean_scrub_stamp":"2024-09-17T05:44:00.925414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:17:15.009590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":13,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T05:44:03.971825+0000","last_change":"2024-09-17T05:44:02.973112+0000","last_active":"2024-09-17T05:44:03.971825+0000","last_peered":"2024-09-17T05:44:03.971825+0000","last_clean":"2024-09-17T05:44:03.971825+0000","last_became_active":"2024-09-17T05:44:02.972818+0000","last_became_peered":"2024-09-17T05:44:02.972818+0000","last_unstale":"2024-09-17T05:44:03.971825+0000","last_undegraded":"2024-09-17T05:44:03.971825+0000","last_fullsized":"2024-09-17T05:44:03.971825+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:44:01.930501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:44:01.930501+0000","last_clean_scrub_stamp":"2024-09-17T05:44:01.930501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:02:00.787605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:44:02.959170+0000","last_change":"2024-09-17T05:44:01.953671+0000","last_active":"2024-09-17T05:44:02.959170+0000","last_peered":"2024-09-17T05:44:02.959170+0000","last_clean":"2024-09-17T05:44:02.959170+0000","last_became_active":"2024-09-17T05:44:01.953335+0000","last_became_peered":"2024-09-17T05:44:01.953335+0000","last_unstale":"2024-09-17T05:44:02.959170+0000","last_undegraded":"2024-09-17T05:44:02.959170+0000","last_fullsized":"2024-09-17T05:44:02.959170+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:44:00.925414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:44:00.925414+0000","last_clean_scrub_stamp":"2024-09-17T05:44:00.925414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:37:02.646622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:44:02.983693+0000","last_change":"2024-09-17T05:44:02.965586+0000","last_active":"2024-09-17T05:44:02.983693+0000","last_peered":"2024-09-17T05:44:02.983693+0000","last_clean":"2024-09-17T05:44:02.983693+0000","last_became_active":"2024-09-17T05:44:02.965276+0000","last_became_peered":"2024-09-17T05:44:02.965276+0000","last_unstale":"2024-09-17T05:44:02.983693+0000","last_undegraded":"2024-09-17T05:44:02.983693+0000","last_fullsized":"2024-09-17T05:44:02.983693+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:44:01.930501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:44:01.930501+0000","last_clean_scrub_stamp":"2024-09-17T05:44:01.930501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:36:57.786003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":15,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T05:44:05.414441+0000","last_change":"2024-09-17T05:44:01.952963+0000","last_active":"2024-09-17T05:44:05.414441+0000","last_peered":"2024-09-17T05:44:05.414441+0000","last_clean":"2024-09-17T05:44:05.414441+0000","last_became_active":"2024-09-17T05:44:01.952635+0000","last_became_peered":"2024-09-17T05:44:01.952635+0000","last_unstale":"2024-09-17T05:44:05.414441+0000","last_undegraded":"2024-09-17T05:44:05.414441+0000","last_fullsized":"2024-09-17T05:44:05.414441+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:44:00.925414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:44:00.925414+0000","last_clean_scrub_stamp":"2024-09-17T05:44:00.925414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:01:52.592469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-09-17T05:44:01.948175+0000","last_change":"2024-09-17T05:44:01.948175+0000","last_active":"2024-09-17T05:44:01.930501+0000","last_peered":"2024-09-17T05:44:01.930501+0000","last_clean":"2024-09-17T05:44:01.930501+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:44:01.948175+0000","last_undegraded":"2024-09-17T05:44:01.948175+0000","last_fullsized":"2024-09-17T05:44:01.948175+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:44:01.930501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:44:01.930501+0000","last_clean_scrub_stamp":"2024-09-17T05:44:01.930501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.6","version":"45'1","reported_seq":16,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T05:44:03.971074+0000","last_change":"2024-09-17T05:44:01.948222+0000","last_active":"2024-09-17T05:44:03.971074+0000","last_peered":"2024-09-17T05:44:03.971074+0000","last_clean":"2024-09-17T05:44:03.971074+0000","last_became_active":"2024-09-17T05:44:01.947920+0000","last_became_peered":"2024-09-17T05:44:01.947920+0000","last_unstale":"2024-09-17T05:44:03.971074+0000","last_undegraded":"2024-09-17T05:44:03.971074+0000","last_fullsized":"2024-09-17T05:44:03.971074+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:44:00.925414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:44:00.925414+0000","last_clean_scrub_stamp":"2024-09-17T05:44:00.925414+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:36:29.645473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:44:02.986147+0000","last_change":"2024-09-17T05:44:02.975385+0000","last_active":"2024-09-17T05:44:02.986147+0000","last_peered":"2024-09-17T05:44:02.986147+0000","last_clean":"2024-09-17T05:44:02.986147+0000","last_became_active":"2024-09-17T05:44:02.974263+0000","last_became_peered":"2024-09-17T05:44:02.974263+0000","last_unstale":"2024-09-17T05:44:02.986147+0000","last_undegraded":"2024-09-17T05:44:02.986147+0000","last_fullsized":"2024-09-17T05:44:02.986147+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:44:01.930501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:44:01.930501+0000","last_clean_scrub_stamp":"2024-09-17T05:44:01.930501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:04:07.130698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":15,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T05:44:05.415120+0000","last_change":"2024-09-17T05:44:01.960684+0000","last_active":"2024-09-17T05:44:05.415120+0000","last_peered":"2024-09-17T05:44:05.415120+0000","last_clean":"2024-09-17T05:44:05.415120+0000","last_became_active":"2024-09-17T05:44:01.960310+0000","last_became_peered":"2024-09-17T05:44:01.960310+0000","last_unstale":"2024-09-17T05:44:05.415120+0000","last_undegraded":"2024-09-17T05:44:05.415120+0000","last_fullsized":"2024-09-17T05:44:05.415120+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:44:00.925414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:44:00.925414+0000","last_clean_scrub_stamp":"2024-09-17T05:44:00.925414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:25:07.911474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":13,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T05:44:05.415126+0000","last_change":"2024-09-17T05:44:02.965931+0000","last_active":"2024-09-17T05:44:05.415126+0000","last_peered":"2024-09-17T05:44:05.415126+0000","last_clean":"2024-09-17T05:44:05.415126+0000","last_became_active":"2024-09-17T05:44:02.965685+0000","last_became_peered":"2024-09-17T05:44:02.965685+0000","last_unstale":"2024-09-17T05:44:05.415126+0000","last_undegraded":"2024-09-17T05:44:05.415126+0000","last_fullsized":"2024-09-17T05:44:05.415126+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:44:01.930501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:44:01.930501+0000","last_clean_scrub_stamp":"2024-09-17T05:44:01.930501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:42:28.449626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":15,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T05:44:05.915011+0000","last_change":"2024-09-17T05:44:01.956609+0000","last_active":"2024-09-17T05:44:05.915011+0000","last_peered":"2024-09-17T05:44:05.915011+0000","last_clean":"2024-09-17T05:44:05.915011+0000","last_became_active":"2024-09-17T05:44:01.956251+0000","last_became_peered":"2024-09-17T05:44:01.956251+0000","last_unstale":"2024-09-17T05:44:05.915011+0000","last_undegraded":"2024-09-17T05:44:05.915011+0000","last_fullsized":"2024-09-17T05:44:05.915011+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:44:00.925414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:44:00.925414+0000","last_clean_scrub_stamp":"2024-09-17T05:44:00.925414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:12:38.919452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":13,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T05:44:03.970760+0000","last_change":"2024-09-17T05:44:02.963129+0000","last_active":"2024-09-17T05:44:03.970760+0000","last_peered":"2024-09-17T05:44:03.970760+0000","last_clean":"2024-09-17T05:44:03.970760+0000","last_became_active":"2024-09-17T05:44:02.962771+0000","last_became_peered":"2024-09-17T05:44:02.962771+0000","last_unstale":"2024-09-17T05:44:03.970760+0000","last_undegraded":"2024-09-17T05:44:03.970760+0000","last_fullsized":"2024-09-17T05:44:03.970760+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:44:01.930501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:44:01.930501+0000","last_clean_scrub_stamp":"2024-09-17T05:44:01.930501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:42:32.839604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":15,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T05:44:05.414803+0000","last_change":"2024-09-17T05:44:01.955931+0000","last_active":"2024-09-17T05:44:05.414803+0000","last_peered":"2024-09-17T05:44:05.414803+0000","last_clean":"2024-09-17T05:44:05.414803+0000","last_became_active":"2024-09-17T05:44:01.955587+0000","last_became_peered":"2024-09-17T05:44:01.955587+0000","last_unstale":"2024-09-17T05:44:05.414803+0000","last_undegraded":"2024-09-17T05:44:05.414803+0000","last_fullsized":"2024-09-17T05:44:05.414803+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:44:00.925414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:44:00.925414+0000","last_clean_scrub_stamp":"2024-09-17T05:44:00.925414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:53:49.002592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":13,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T05:44:03.971011+0000","last_change":"2024-09-17T05:44:02.969696+0000","last_active":"2024-09-17T05:44:03.971011+0000","last_peered":"2024-09-17T05:44:03.971011+0000","last_clean":"2024-09-17T05:44:03.971011+0000","last_became_active":"2024-09-17T05:44:02.969397+0000","last_became_peered":"2024-09-17T05:44:02.969397+0000","last_unstale":"2024-09-17T05:44:03.971011+0000","last_undegraded":"2024-09-17T05:44:03.971011+0000","last_fullsized":"2024-09-17T05:44:03.971011+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:44:01.930501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:44:01.930501+0000","last_clean_scrub_stamp":"2024-09-17T05:44:01.930501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:25:36.619406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":15,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T05:44:04.970704+0000","last_change":"2024-09-17T05:44:01.947767+0000","last_active":"2024-09-17T05:44:04.970704+0000","last_peered":"2024-09-17T05:44:04.970704+0000","last_clean":"2024-09-17T05:44:04.970704+0000","last_became_active":"2024-09-17T05:44:01.947426+0000","last_became_peered":"2024-09-17T05:44:01.947426+0000","last_unstale":"2024-09-17T05:44:04.970704+0000","last_undegraded":"2024-09-17T05:44:04.970704+0000","last_fullsized":"2024-09-17T05:44:04.970704+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:44:00.925414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:44:00.925414+0000","last_clean_scrub_stamp":"2024-09-17T05:44:00.925414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:48:16.308463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":13,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T05:44:05.658926+0000","last_change":"2024-09-17T05:44:02.982212+0000","last_active":"2024-09-17T05:44:05.658926+0000","last_peered":"2024-09-17T05:44:05.658926+0000","last_clean":"2024-09-17T05:44:05.658926+0000","last_became_active":"2024-09-17T05:44:02.981857+0000","last_became_peered":"2024-09-17T05:44:02.981857+0000","last_unstale":"2024-09-17T05:44:05.658926+0000","last_undegraded":"2024-09-17T05:44:05.658926+0000","last_fullsized":"2024-09-17T05:44:05.658926+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:44:01.930501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:44:01.930501+0000","last_clean_scrub_stamp":"2024-09-17T05:44:01.930501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:48:36.558940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":15,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T05:44:05.915617+0000","last_change":"2024-09-17T05:44:01.957935+0000","last_active":"2024-09-17T05:44:05.915617+0000","last_peered":"2024-09-17T05:44:05.915617+0000","last_clean":"2024-09-17T05:44:05.915617+0000","last_became_active":"2024-09-17T05:44:01.957554+0000","last_became_peered":"2024-09-17T05:44:01.957554+0000","last_unstale":"2024-09-17T05:44:05.915617+0000","last_undegraded":"2024-09-17T05:44:05.915617+0000","last_fullsized":"2024-09-17T05:44:05.915617+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:44:00.925414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:44:00.925414+0000","last_clean_scrub_stamp":"2024-09-17T05:44:00.925414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:12:38.503949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":13,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T05:44:04.971182+0000","last_change":"2024-09-17T05:44:02.970436+0000","last_active":"2024-09-17T05:44:04.971182+0000","last_peered":"2024-09-17T05:44:04.971182+0000","last_clean":"2024-09-17T05:44:04.971182+0000","last_became_active":"2024-09-17T05:44:02.967032+0000","last_became_peered":"2024-09-17T05:44:02.967032+0000","last_unstale":"2024-09-17T05:44:04.971182+0000","last_undegraded":"2024-09-17T05:44:04.971182+0000","last_fullsized":"2024-09-17T05:44:04.971182+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:44:01.930501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:44:01.930501+0000","last_clean_scrub_stamp":"2024-09-17T05:44:01.930501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:46:37.419245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:44:02.959419+0000","last_change":"2024-09-17T05:44:01.948502+0000","last_active":"2024-09-17T05:44:02.959419+0000","last_peered":"2024-09-17T05:44:02.959419+0000","last_clean":"2024-09-17T05:44:02.959419+0000","last_became_active":"2024-09-17T05:44:01.948181+0000","last_became_peered":"2024-09-17T05:44:01.948181+0000","last_unstale":"2024-09-17T05:44:02.959419+0000","last_undegraded":"2024-09-17T05:44:02.959419+0000","last_fullsized":"2024-09-17T05:44:02.959419+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:44:00.925414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:44:00.925414+0000","last_clean_scrub_stamp":"2024-09-17T05:44:00.925414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:00:31.292020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:44:02.986221+0000","last_change":"2024-09-17T05:44:02.977230+0000","last_active":"2024-09-17T05:44:02.986221+0000","last_peered":"2024-09-17T05:44:02.986221+0000","last_clean":"2024-09-17T05:44:02.986221+0000","last_became_active":"2024-09-17T05:44:02.976922+0000","last_became_peered":"2024-09-17T05:44:02.976922+0000","last_unstale":"2024-09-17T05:44:02.986221+0000","last_undegraded":"2024-09-17T05:44:02.986221+0000","last_fullsized":"2024-09-17T05:44:02.986221+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:44:01.930501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:44:01.930501+0000","last_clean_scrub_stamp":"2024-09-17T05:44:01.930501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:44:44.232120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"44'2","reported_seq":17,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T05:44:05.659350+0000","last_change":"2024-09-17T05:44:01.956246+0000","last_active":"2024-09-17T05:44:05.659350+0000","last_peered":"2024-09-17T05:44:05.659350+0000","last_clean":"2024-09-17T05:44:05.659350+0000","last_became_active":"2024-09-17T05:44:01.954475+0000","last_became_peered":"2024-09-17T05:44:01.954475+0000","last_unstale":"2024-09-17T05:44:05.659350+0000","last_undegraded":"2024-09-17T05:44:05.659350+0000","last_fullsized":"2024-09-17T05:44:05.659350+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:44:00.925414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:44:00.925414+0000","last_clean_scrub_stamp":"2024-09-17T05:44:00.925414+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:41:23.789219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"19'72","reported_seq":151,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T05:44:05.414476+0000","last_change":"2024-09-17T05:41:48.539830+0000","last_active":"2024-09-17T05:44:05.414476+0000","last_peered":"2024-09-17T05:44:05.414476+0000","last_clean":"2024-09-17T05:44:05.414476+0000","last_became_active":"2024-09-17T05:41:48.538743+0000","last_became_peered":"2024-09-17T05:41:48.538743+0000","last_unstale":"2024-09-17T05:44:05.414476+0000","last_undegraded":"2024-09-17T05:44:05.414476+0000","last_fullsized":"2024-09-17T05:44:05.414476+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:47.152539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:47.152539+0000","last_clean_scrub_stamp":"2024-09-17T05:41:47.152539+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:08:02.952016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":4148,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":16,"seq":68719476768,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31660,"kb_used_data":472,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340180,"statfs":{"total":96636764160,"available":96604344320,"internally_reserved":0,"allocated":483328,"data_stored":188869,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":7,"up_from":15,"seq":64424509473,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32280,"kb_used_data":1092,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339560,"statfs":{"total":96636764160,"available":96603709440,"internally_reserved":0,"allocated":1118208,"data_stored":798669,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509472,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31700,"kb_used_data":512,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340140,"statfs":{"total":96636764160,"available":96604303360,"internally_reserved":0,"allocated":524288,"data_stored":208281,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509472,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31712,"kb_used_data":520,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340128,"statfs":{"total":96636764160,"available":96604291072,"internally_reserved":0,"allocated":532480,"data_stored":209823,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509472,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31708,"kb_used_data":520,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340132,"statfs":{"total":96636764160,"available":96604295168,"internally_reserved":0,"allocated":532480,"data_stored":208849,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509472,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31712,"kb_used_data":524,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340128,"statfs":{"total":96636764160,"available":96604291072,"internally_reserved":0,"allocated":536576,"data_stored":209845,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509472,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31696,"kb_used_data":500,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340144,"statfs":{"total":96636764160,"available":96604307456,"internally_reserved":0,"allocated":512000,"data_stored":201981,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574879,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32260,"kb_used_data":1064,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339580,"statfs":{"total":96636764160,"available":96603729920,"internally_reserved":0,"allocated":1089536,"data_stored":785504,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-17T05:44:07.711 INFO:tasks.ceph.ceph_manager.ceph:PG 7.30 is not active+clean 2024-09-17T05:44:07.711 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.30', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 43, 'state': 'creating+peering', 'last_fresh': '2024-09-17T05:44:01.946541+0000', 'last_change': '2024-09-17T05:44:01.946541+0000', 'last_active': '2024-09-17T05:44:01.930501+0000', 'last_peered': '2024-09-17T05:44:01.930501+0000', 'last_clean': '2024-09-17T05:44:01.930501+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:44:01.946541+0000', 'last_undegraded': '2024-09-17T05:44:01.946541+0000', 'last_fullsized': '2024-09-17T05:44:01.946541+0000', 'mapping_epoch': 43, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 43, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:44:01.930501+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:44:01.930501+0000', 'last_clean_scrub_stamp': '2024-09-17T05:44:01.930501+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 0], 'acting': [6, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-17T05:44:07.711 INFO:tasks.ceph.ceph_manager.ceph:PG 7.2d is not active+clean 2024-09-17T05:44:07.711 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.2d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 43, 'state': 'creating+peering', 'last_fresh': '2024-09-17T05:44:01.946426+0000', 'last_change': '2024-09-17T05:44:01.946426+0000', 'last_active': '2024-09-17T05:44:01.930501+0000', 'last_peered': '2024-09-17T05:44:01.930501+0000', 'last_clean': '2024-09-17T05:44:01.930501+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:44:01.946426+0000', 'last_undegraded': '2024-09-17T05:44:01.946426+0000', 'last_fullsized': '2024-09-17T05:44:01.946426+0000', 'mapping_epoch': 43, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 43, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:44:01.930501+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:44:01.930501+0000', 'last_clean_scrub_stamp': '2024-09-17T05:44:01.930501+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 0], 'acting': [6, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-17T05:44:07.711 INFO:tasks.ceph.ceph_manager.ceph:PG 7.29 is not active+clean 2024-09-17T05:44:07.711 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.29', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 43, 'state': 'creating+peering', 'last_fresh': '2024-09-17T05:44:01.948604+0000', 'last_change': '2024-09-17T05:44:01.948604+0000', 'last_active': '2024-09-17T05:44:01.930501+0000', 'last_peered': '2024-09-17T05:44:01.930501+0000', 'last_clean': '2024-09-17T05:44:01.930501+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:44:01.948604+0000', 'last_undegraded': '2024-09-17T05:44:01.948604+0000', 'last_fullsized': '2024-09-17T05:44:01.948604+0000', 'mapping_epoch': 43, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 43, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:44:01.930501+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:44:01.930501+0000', 'last_clean_scrub_stamp': '2024-09-17T05:44:01.930501+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 7], 'acting': [6, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-17T05:44:07.711 INFO:tasks.ceph.ceph_manager.ceph:PG 7.28 is not active+clean 2024-09-17T05:44:07.711 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.28', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 43, 'state': 'creating+peering', 'last_fresh': '2024-09-17T05:44:01.945901+0000', 'last_change': '2024-09-17T05:44:01.945901+0000', 'last_active': '2024-09-17T05:44:01.930501+0000', 'last_peered': '2024-09-17T05:44:01.930501+0000', 'last_clean': '2024-09-17T05:44:01.930501+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:44:01.945901+0000', 'last_undegraded': '2024-09-17T05:44:01.945901+0000', 'last_fullsized': '2024-09-17T05:44:01.945901+0000', 'mapping_epoch': 43, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 43, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:44:01.930501+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:44:01.930501+0000', 'last_clean_scrub_stamp': '2024-09-17T05:44:01.930501+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 7], 'acting': [6, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-17T05:44:07.711 INFO:tasks.ceph.ceph_manager.ceph:PG 7.27 is not active+clean 2024-09-17T05:44:07.711 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.27', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 43, 'state': 'creating+peering', 'last_fresh': '2024-09-17T05:44:01.949356+0000', 'last_change': '2024-09-17T05:44:01.949356+0000', 'last_active': '2024-09-17T05:44:01.930501+0000', 'last_peered': '2024-09-17T05:44:01.930501+0000', 'last_clean': '2024-09-17T05:44:01.930501+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:44:01.949356+0000', 'last_undegraded': '2024-09-17T05:44:01.949356+0000', 'last_fullsized': '2024-09-17T05:44:01.949356+0000', 'mapping_epoch': 43, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 43, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:44:01.930501+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:44:01.930501+0000', 'last_clean_scrub_stamp': '2024-09-17T05:44:01.930501+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 1], 'acting': [6, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-17T05:44:07.712 INFO:tasks.ceph.ceph_manager.ceph:PG 7.23 is not active+clean 2024-09-17T05:44:07.712 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.23', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 43, 'state': 'creating+peering', 'last_fresh': '2024-09-17T05:44:01.945462+0000', 'last_change': '2024-09-17T05:44:01.945462+0000', 'last_active': '2024-09-17T05:44:01.930501+0000', 'last_peered': '2024-09-17T05:44:01.930501+0000', 'last_clean': '2024-09-17T05:44:01.930501+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:44:01.945462+0000', 'last_undegraded': '2024-09-17T05:44:01.945462+0000', 'last_fullsized': '2024-09-17T05:44:01.945462+0000', 'mapping_epoch': 43, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 43, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:44:01.930501+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:44:01.930501+0000', 'last_clean_scrub_stamp': '2024-09-17T05:44:01.930501+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 1], 'acting': [6, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-17T05:44:07.712 INFO:tasks.ceph.ceph_manager.ceph:PG 7.1f is not active+clean 2024-09-17T05:44:07.712 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.1f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 43, 'state': 'creating+peering', 'last_fresh': '2024-09-17T05:44:01.948703+0000', 'last_change': '2024-09-17T05:44:01.948703+0000', 'last_active': '2024-09-17T05:44:01.930501+0000', 'last_peered': '2024-09-17T05:44:01.930501+0000', 'last_clean': '2024-09-17T05:44:01.930501+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:44:01.948703+0000', 'last_undegraded': '2024-09-17T05:44:01.948703+0000', 'last_fullsized': '2024-09-17T05:44:01.948703+0000', 'mapping_epoch': 43, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 43, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:44:01.930501+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:44:01.930501+0000', 'last_clean_scrub_stamp': '2024-09-17T05:44:01.930501+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 4], 'acting': [6, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-17T05:44:07.712 INFO:tasks.ceph.ceph_manager.ceph:PG 7.19 is not active+clean 2024-09-17T05:44:07.712 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.19', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 43, 'state': 'creating+peering', 'last_fresh': '2024-09-17T05:44:01.949231+0000', 'last_change': '2024-09-17T05:44:01.949231+0000', 'last_active': '2024-09-17T05:44:01.930501+0000', 'last_peered': '2024-09-17T05:44:01.930501+0000', 'last_clean': '2024-09-17T05:44:01.930501+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:44:01.949231+0000', 'last_undegraded': '2024-09-17T05:44:01.949231+0000', 'last_fullsized': '2024-09-17T05:44:01.949231+0000', 'mapping_epoch': 43, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 43, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:44:01.930501+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:44:01.930501+0000', 'last_clean_scrub_stamp': '2024-09-17T05:44:01.930501+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 7], 'acting': [6, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-17T05:44:07.712 INFO:tasks.ceph.ceph_manager.ceph:PG 7.12 is not active+clean 2024-09-17T05:44:07.712 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.12', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 43, 'state': 'creating+peering', 'last_fresh': '2024-09-17T05:44:01.946200+0000', 'last_change': '2024-09-17T05:44:01.946200+0000', 'last_active': '2024-09-17T05:44:01.930501+0000', 'last_peered': '2024-09-17T05:44:01.930501+0000', 'last_clean': '2024-09-17T05:44:01.930501+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:44:01.946200+0000', 'last_undegraded': '2024-09-17T05:44:01.946200+0000', 'last_fullsized': '2024-09-17T05:44:01.946200+0000', 'mapping_epoch': 43, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 43, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:44:01.930501+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:44:01.930501+0000', 'last_clean_scrub_stamp': '2024-09-17T05:44:01.930501+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 0], 'acting': [6, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-17T05:44:07.712 INFO:tasks.ceph.ceph_manager.ceph:PG 7.c is not active+clean 2024-09-17T05:44:07.712 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 43, 'state': 'creating+peering', 'last_fresh': '2024-09-17T05:44:01.946176+0000', 'last_change': '2024-09-17T05:44:01.946176+0000', 'last_active': '2024-09-17T05:44:01.930501+0000', 'last_peered': '2024-09-17T05:44:01.930501+0000', 'last_clean': '2024-09-17T05:44:01.930501+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:44:01.946176+0000', 'last_undegraded': '2024-09-17T05:44:01.946176+0000', 'last_fullsized': '2024-09-17T05:44:01.946176+0000', 'mapping_epoch': 43, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 43, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:44:01.930501+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:44:01.930501+0000', 'last_clean_scrub_stamp': '2024-09-17T05:44:01.930501+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 3], 'acting': [6, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-17T05:44:07.713 INFO:tasks.ceph.ceph_manager.ceph:PG 7.d is not active+clean 2024-09-17T05:44:07.713 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 43, 'state': 'creating+peering', 'last_fresh': '2024-09-17T05:44:01.948237+0000', 'last_change': '2024-09-17T05:44:01.948237+0000', 'last_active': '2024-09-17T05:44:01.930501+0000', 'last_peered': '2024-09-17T05:44:01.930501+0000', 'last_clean': '2024-09-17T05:44:01.930501+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:44:01.948237+0000', 'last_undegraded': '2024-09-17T05:44:01.948237+0000', 'last_fullsized': '2024-09-17T05:44:01.948237+0000', 'mapping_epoch': 43, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 43, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:44:01.930501+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:44:01.930501+0000', 'last_clean_scrub_stamp': '2024-09-17T05:44:01.930501+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 1], 'acting': [6, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-17T05:44:07.713 INFO:tasks.ceph.ceph_manager.ceph:PG 7.7 is not active+clean 2024-09-17T05:44:07.713 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.7', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 43, 'state': 'creating+peering', 'last_fresh': '2024-09-17T05:44:01.948175+0000', 'last_change': '2024-09-17T05:44:01.948175+0000', 'last_active': '2024-09-17T05:44:01.930501+0000', 'last_peered': '2024-09-17T05:44:01.930501+0000', 'last_clean': '2024-09-17T05:44:01.930501+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:44:01.948175+0000', 'last_undegraded': '2024-09-17T05:44:01.948175+0000', 'last_fullsized': '2024-09-17T05:44:01.948175+0000', 'mapping_epoch': 43, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 43, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:44:01.930501+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:44:01.930501+0000', 'last_clean_scrub_stamp': '2024-09-17T05:44:01.930501+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 0], 'acting': [6, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-17T05:44:07.713 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-09-17T05:44:07.860 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:07.858+0000 7f08e1c30640 1 -- 172.21.15.150:0/2708080053 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f08dc0d50c0 msgr2=0x7f08dc0d0240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:44:07.860 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:07.858+0000 7f08e1c30640 1 --2- 172.21.15.150:0/2708080053 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f08dc0d50c0 0x7f08dc0d0240 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f08dc0d0dc0 tx=0x7f08d002a4d0 comp rx=0 tx=0).stop 2024-09-17T05:44:07.860 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:07.858+0000 7f08e1c30640 1 -- 172.21.15.150:0/2708080053 shutdown_connections 2024-09-17T05:44:07.860 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:07.858+0000 7f08e1c30640 1 --2- 172.21.15.150:0/2708080053 >> v2:172.21.15.176:3300/0 conn(0x7f08dc0d1020 0x7f08dc0d1430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:07.860 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:07.858+0000 7f08e1c30640 1 --2- 172.21.15.150:0/2708080053 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f08dc0d50c0 0x7f08dc0d0240 unknown :-1 s=CLOSED pgs=460 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:07.860 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:07.858+0000 7f08e1c30640 1 --2- 172.21.15.150:0/2708080053 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f08dc0b9d10 0x7f08dc0d2f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:07.860 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:07.858+0000 7f08e1c30640 1 -- 172.21.15.150:0/2708080053 >> 172.21.15.150:0/2708080053 conn(0x7f08dc08bfe0 msgr2=0x7f08dc0d4650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:44:07.861 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:07.858+0000 7f08e1c30640 1 -- 172.21.15.150:0/2708080053 shutdown_connections 2024-09-17T05:44:07.861 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:07.858+0000 7f08e1c30640 1 -- 172.21.15.150:0/2708080053 wait complete. 2024-09-17T05:44:07.861 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:07.860+0000 7f08e1c30640 1 Processor -- start 2024-09-17T05:44:07.861 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:07.860+0000 7f08e1c30640 1 -- start start 2024-09-17T05:44:07.864 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:07.861+0000 7f08e1c30640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f08dc0b9d10 0x7f08dc09e3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:44:07.864 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:07.861+0000 7f08e1c30640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f08dc0d1020 0x7f08dc158a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:44:07.864 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:07.861+0000 7f08e1c30640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f08dc0d50c0 0x7f08dc0b1760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:44:07.864 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:07.861+0000 7f08e1c30640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f08dc0b4300 con 0x7f08dc0d50c0 2024-09-17T05:44:07.864 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:07.861+0000 7f08e1c30640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f08dc0b4180 con 0x7f08dc0b9d10 2024-09-17T05:44:07.865 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:07.861+0000 7f08e1c30640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f08dc0b4480 con 0x7f08dc0d1020 2024-09-17T05:44:07.865 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:07.861+0000 7f08dbfff640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f08dc0d50c0 0x7f08dc0b1760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:44:07.865 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:07.861+0000 7f08dbfff640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f08dc0d50c0 0x7f08dc0b1760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:43196/0 (socket says 172.21.15.150:43196) 2024-09-17T05:44:07.865 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:07.861+0000 7f08dbfff640 1 -- 172.21.15.150:0/3624459356 learned_addr learned my addr 172.21.15.150:0/3624459356 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:44:07.865 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:07.862+0000 7f08db7fe640 1 --2- 172.21.15.150:0/3624459356 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f08dc0b9d10 0x7f08dc09e3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:44:07.865 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:07.862+0000 7f08daffd640 1 --2- 172.21.15.150:0/3624459356 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f08dc0d1020 0x7f08dc158a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:44:07.865 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:07.862+0000 7f08dbfff640 1 -- 172.21.15.150:0/3624459356 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f08dc0d1020 msgr2=0x7f08dc158a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:44:07.865 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:07.862+0000 7f08dbfff640 1 --2- 172.21.15.150:0/3624459356 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f08dc0d1020 0x7f08dc158a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:07.865 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:07.862+0000 7f08dbfff640 1 -- 172.21.15.150:0/3624459356 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f08dc0b9d10 msgr2=0x7f08dc09e3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:44:07.865 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:07.862+0000 7f08dbfff640 1 --2- 172.21.15.150:0/3624459356 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f08dc0b9d10 0x7f08dc09e3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:07.865 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:07.862+0000 7f08dbfff640 1 -- 172.21.15.150:0/3624459356 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f08dc0c88f0 con 0x7f08dc0d50c0 2024-09-17T05:44:07.865 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:07.862+0000 7f08daffd640 1 --2- 172.21.15.150:0/3624459356 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f08dc0d1020 0x7f08dc158a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:44:07.865 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:07.862+0000 7f08db7fe640 1 --2- 172.21.15.150:0/3624459356 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f08dc0b9d10 0x7f08dc09e3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:44:07.866 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:07.862+0000 7f08dbfff640 1 --2- 172.21.15.150:0/3624459356 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f08dc0d50c0 0x7f08dc0b1760 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f08d400d620 tx=0x7f08d400dae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:44:07.866 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:07.862+0000 7f08c3fff640 1 -- 172.21.15.150:0/3624459356 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f08d4017070 con 0x7f08dc0d50c0 2024-09-17T05:44:07.866 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:07.862+0000 7f08c3fff640 1 -- 172.21.15.150:0/3624459356 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f08d4005310 con 0x7f08dc0d50c0 2024-09-17T05:44:07.866 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:07.862+0000 7f08e1c30640 1 -- 172.21.15.150:0/3624459356 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f08dc0c8bd0 con 0x7f08dc0d50c0 2024-09-17T05:44:07.866 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:07.862+0000 7f08c3fff640 1 -- 172.21.15.150:0/3624459356 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f08d40047a0 con 0x7f08dc0d50c0 2024-09-17T05:44:07.866 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:07.862+0000 7f08e1c30640 1 -- 172.21.15.150:0/3624459356 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f08dc0a10b0 con 0x7f08dc0d50c0 2024-09-17T05:44:07.867 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:07.863+0000 7f08e1c30640 1 -- 172.21.15.150:0/3624459356 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f08dc0b4a10 con 0x7f08dc0d50c0 2024-09-17T05:44:07.867 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:07.864+0000 7f08c3fff640 1 -- 172.21.15.150:0/3624459356 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 9) ==== 101747+0+0 (secure 0 0 0) 0x7f08d4004940 con 0x7f08dc0d50c0 2024-09-17T05:44:07.867 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:07.864+0000 7f08c3fff640 1 --2- 172.21.15.150:0/3624459356 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f08c8078f20 0x7f08c807b430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:44:07.867 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:07.865+0000 7f08c3fff640 1 -- 172.21.15.150:0/3624459356 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 5709+0+0 (secure 0 0 0) 0x7f08d409b450 con 0x7f08dc0d50c0 2024-09-17T05:44:07.868 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:07.865+0000 7f08db7fe640 1 --2- 172.21.15.150:0/3624459356 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f08c8078f20 0x7f08c807b430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:44:07.868 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:07.865+0000 7f08db7fe640 1 --2- 172.21.15.150:0/3624459356 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f08c8078f20 0x7f08c807b430 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f08cc005fd0 tx=0x7f08cc009400 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:44:07.870 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:07.870+0000 7f08c3fff640 1 -- 172.21.15.150:0/3624459356 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f08d4063280 con 0x7f08dc0d50c0 2024-09-17T05:44:08.114 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:08.112+0000 7f08e1c30640 1 -- 172.21.15.150:0/3624459356 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) -- 0x7f08dc0c8680 con 0x7f08dc0d50c0 2024-09-17T05:44:08.114 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:08.112+0000 7f08c3fff640 1 -- 172.21.15.150:0/3624459356 <== mon.0 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) ==== 72+0+1141 (secure 0 0 0) 0x7f08d4062b80 con 0x7f08dc0d50c0 2024-09-17T05:44:08.114 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-09-17T05:44:08.115 INFO:teuthology.orchestra.run.smithi150.stdout:{"fsid":"9f2e05e9-d629-47b3-b26b-1360655b7d20","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":155,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":45,"num_osds":8,"num_up_osds":8,"osd_up_since":1726551706,"num_in_osds":8,"osd_in_since":1726551696,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":85},{"state_name":"creating+peering","count":12}],"num_pgs":97,"num_pools":3,"num_objects":24,"data_bytes":592778,"bytes_used":260841472,"bytes_avail":772833271808,"bytes_total":773094113280,"inactive_pgs_ratio":0.12371134012937546,"write_bytes_sec":2410,"read_op_per_sec":0,"write_op_per_sec":7},"fsmap":{"epoch":25,"btime":"2024-09-17T05:44:05:983657+0000","id":3,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":3,"rank":0,"name":"c","status":"up:active","gid":5472}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":8,"modified":"2024-09-17T05:43:42.873939+0000","services":{}},"progress_events":{}} 2024-09-17T05:44:08.117 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:08.115+0000 7f08e1c30640 1 -- 172.21.15.150:0/3624459356 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f08c8078f20 msgr2=0x7f08c807b430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:44:08.118 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:08.115+0000 7f08e1c30640 1 --2- 172.21.15.150:0/3624459356 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f08c8078f20 0x7f08c807b430 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f08cc005fd0 tx=0x7f08cc009400 comp rx=0 tx=0).stop 2024-09-17T05:44:08.118 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:08.115+0000 7f08e1c30640 1 -- 172.21.15.150:0/3624459356 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f08dc0d50c0 msgr2=0x7f08dc0b1760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:44:08.118 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:08.115+0000 7f08e1c30640 1 --2- 172.21.15.150:0/3624459356 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f08dc0d50c0 0x7f08dc0b1760 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f08d400d620 tx=0x7f08d400dae0 comp rx=0 tx=0).stop 2024-09-17T05:44:08.118 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:08.115+0000 7f08e1c30640 1 -- 172.21.15.150:0/3624459356 shutdown_connections 2024-09-17T05:44:08.118 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:08.115+0000 7f08e1c30640 1 --2- 172.21.15.150:0/3624459356 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f08c8078f20 0x7f08c807b430 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:08.118 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:08.115+0000 7f08e1c30640 1 --2- 172.21.15.150:0/3624459356 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f08dc0d50c0 0x7f08dc0b1760 unknown :-1 s=CLOSED pgs=461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:08.118 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:08.115+0000 7f08e1c30640 1 --2- 172.21.15.150:0/3624459356 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f08dc0d1020 0x7f08dc158a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:08.118 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:08.115+0000 7f08e1c30640 1 --2- 172.21.15.150:0/3624459356 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f08dc0b9d10 0x7f08dc09e3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:08.118 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:08.115+0000 7f08e1c30640 1 -- 172.21.15.150:0/3624459356 >> 172.21.15.150:0/3624459356 conn(0x7f08dc08bfe0 msgr2=0x7f08dc06deb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:44:08.118 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:08.115+0000 7f08e1c30640 1 -- 172.21.15.150:0/3624459356 shutdown_connections 2024-09-17T05:44:08.118 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:08.115+0000 7f08e1c30640 1 -- 172.21.15.150:0/3624459356 wait complete. 2024-09-17T05:44:08.128 INFO:tasks.ceph.ceph_manager.ceph:no progress seen, keeping timeout for now 2024-09-17T05:44:08.128 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-17T05:44:08.242 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:08.240+0000 7ff256743640 1 -- 172.21.15.150:0/2942888391 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff2500cf7c0 msgr2=0x7ff2500cfbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:44:08.242 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:08.240+0000 7ff256743640 1 --2- 172.21.15.150:0/2942888391 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff2500cf7c0 0x7ff2500cfbd0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7ff244009830 tx=0x7ff24402a4a0 comp rx=0 tx=0).stop 2024-09-17T05:44:08.242 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:08.240+0000 7ff256743640 1 -- 172.21.15.150:0/2942888391 shutdown_connections 2024-09-17T05:44:08.243 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:08.240+0000 7ff256743640 1 --2- 172.21.15.150:0/2942888391 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff2500cf7c0 0x7ff2500cfbd0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:08.243 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:08.240+0000 7ff256743640 1 --2- 172.21.15.150:0/2942888391 >> v2:172.21.15.176:3300/0 conn(0x7ff25015ee30 0x7ff2500b2840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:08.243 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:08.240+0000 7ff256743640 1 -- 172.21.15.150:0/2942888391 >> 172.21.15.150:0/2942888391 conn(0x7ff2500b2fd0 msgr2=0x7ff2500b33e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:44:08.243 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:08.240+0000 7ff256743640 1 -- 172.21.15.150:0/2942888391 shutdown_connections 2024-09-17T05:44:08.243 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:08.240+0000 7ff256743640 1 -- 172.21.15.150:0/2942888391 wait complete. 2024-09-17T05:44:08.243 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:08.242+0000 7ff256743640 1 Processor -- start 2024-09-17T05:44:08.243 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:08.242+0000 7ff256743640 1 -- start start 2024-09-17T05:44:08.246 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:08.243+0000 7ff256743640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff2500b0e20 0x7ff250155dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:44:08.246 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:08.243+0000 7ff256743640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff2500cf7c0 0x7ff250152920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:44:08.246 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:08.243+0000 7ff256743640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff25015ee30 0x7ff25015a790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:44:08.246 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:08.243+0000 7ff256743640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7ff25015f350 con 0x7ff2500cf7c0 2024-09-17T05:44:08.246 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:08.243+0000 7ff256743640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7ff2500b1b50 con 0x7ff2500b0e20 2024-09-17T05:44:08.246 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:08.243+0000 7ff256743640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7ff2500b6420 con 0x7ff25015ee30 2024-09-17T05:44:08.247 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:08.244+0000 7ff24f7fe640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff2500cf7c0 0x7ff250152920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:44:08.247 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:08.244+0000 7ff24f7fe640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff2500cf7c0 0x7ff250152920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:43210/0 (socket says 172.21.15.150:43210) 2024-09-17T05:44:08.247 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:08.244+0000 7ff24f7fe640 1 -- 172.21.15.150:0/1141383468 learned_addr learned my addr 172.21.15.150:0/1141383468 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:44:08.247 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:08.244+0000 7ff24ffff640 1 --2- 172.21.15.150:0/1141383468 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff2500b0e20 0x7ff250155dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:44:08.247 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:08.244+0000 7ff254ce0640 1 --2- 172.21.15.150:0/1141383468 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff25015ee30 0x7ff25015a790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:44:08.247 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:08.244+0000 7ff24f7fe640 1 -- 172.21.15.150:0/1141383468 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff25015ee30 msgr2=0x7ff25015a790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:44:08.247 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:08.244+0000 7ff24f7fe640 1 --2- 172.21.15.150:0/1141383468 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff25015ee30 0x7ff25015a790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:08.247 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:08.244+0000 7ff24f7fe640 1 -- 172.21.15.150:0/1141383468 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff2500b0e20 msgr2=0x7ff250155dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:44:08.247 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:08.244+0000 7ff24f7fe640 1 --2- 172.21.15.150:0/1141383468 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff2500b0e20 0x7ff250155dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:08.247 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:08.244+0000 7ff24f7fe640 1 -- 172.21.15.150:0/1141383468 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff25009bfd0 con 0x7ff2500cf7c0 2024-09-17T05:44:08.247 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:08.244+0000 7ff24f7fe640 1 --2- 172.21.15.150:0/1141383468 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff2500cf7c0 0x7ff250152920 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7ff24402aa90 tx=0x7ff244003c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:44:08.247 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:08.244+0000 7ff24cff9640 1 -- 172.21.15.150:0/1141383468 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff244005c90 con 0x7ff2500cf7c0 2024-09-17T05:44:08.248 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:08.244+0000 7ff24cff9640 1 -- 172.21.15.150:0/1141383468 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff244005020 con 0x7ff2500cf7c0 2024-09-17T05:44:08.248 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:08.244+0000 7ff256743640 1 -- 172.21.15.150:0/1141383468 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff250154970 con 0x7ff2500cf7c0 2024-09-17T05:44:08.248 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:08.244+0000 7ff24cff9640 1 -- 172.21.15.150:0/1141383468 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff244005450 con 0x7ff2500cf7c0 2024-09-17T05:44:08.248 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:08.244+0000 7ff256743640 1 -- 172.21.15.150:0/1141383468 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff250154f30 con 0x7ff2500cf7c0 2024-09-17T05:44:08.249 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:08.245+0000 7ff256743640 1 -- 172.21.15.150:0/1141383468 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff2501546e0 con 0x7ff2500cf7c0 2024-09-17T05:44:08.249 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:08.246+0000 7ff24cff9640 1 -- 172.21.15.150:0/1141383468 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 9) ==== 101747+0+0 (secure 0 0 0) 0x7ff2440317c0 con 0x7ff2500cf7c0 2024-09-17T05:44:08.249 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:08.247+0000 7ff24cff9640 1 --2- 172.21.15.150:0/1141383468 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7ff23c078ef0 0x7ff23c07b400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:44:08.249 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:08.247+0000 7ff24cff9640 1 -- 172.21.15.150:0/1141383468 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 5709+0+0 (secure 0 0 0) 0x7ff2440bc370 con 0x7ff2500cf7c0 2024-09-17T05:44:08.249 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:08.247+0000 7ff24ffff640 1 --2- 172.21.15.150:0/1141383468 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7ff23c078ef0 0x7ff23c07b400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:44:08.249 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:08.247+0000 7ff24ffff640 1 --2- 172.21.15.150:0/1141383468 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7ff23c078ef0 0x7ff23c07b400 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7ff2500d0de0 tx=0x7ff240005f90 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:44:08.253 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:08.252+0000 7ff24cff9640 1 -- 172.21.15.150:0/1141383468 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7ff24403f030 con 0x7ff2500cf7c0 2024-09-17T05:44:08.422 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:08.422+0000 7ff256743640 1 -- 172.21.15.150:0/1141383468 --> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7ff2500b68f0 con 0x7ff23c078ef0 2024-09-17T05:44:08.427 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:08.427+0000 7ff24cff9640 1 -- 172.21.15.150:0/1141383468 <== mgr.4108 v2:172.21.15.176:6800/3631216395 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+250970 (secure 0 0 0) 0x7ff2500b68f0 con 0x7ff23c078ef0 2024-09-17T05:44:08.430 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-09-17T05:44:08.432 INFO:teuthology.orchestra.run.smithi150.stderr:dumped all 2024-09-17T05:44:08.433 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:08.430+0000 7ff256743640 1 -- 172.21.15.150:0/1141383468 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7ff23c078ef0 msgr2=0x7ff23c07b400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:44:08.433 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:08.430+0000 7ff256743640 1 --2- 172.21.15.150:0/1141383468 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7ff23c078ef0 0x7ff23c07b400 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7ff2500d0de0 tx=0x7ff240005f90 comp rx=0 tx=0).stop 2024-09-17T05:44:08.433 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:08.430+0000 7ff256743640 1 -- 172.21.15.150:0/1141383468 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff2500cf7c0 msgr2=0x7ff250152920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:44:08.433 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:08.430+0000 7ff256743640 1 --2- 172.21.15.150:0/1141383468 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff2500cf7c0 0x7ff250152920 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7ff24402aa90 tx=0x7ff244003c10 comp rx=0 tx=0).stop 2024-09-17T05:44:08.433 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:08.430+0000 7ff256743640 1 -- 172.21.15.150:0/1141383468 shutdown_connections 2024-09-17T05:44:08.434 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:08.430+0000 7ff256743640 1 --2- 172.21.15.150:0/1141383468 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7ff23c078ef0 0x7ff23c07b400 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:08.434 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:08.430+0000 7ff256743640 1 --2- 172.21.15.150:0/1141383468 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff25015ee30 0x7ff25015a790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:08.434 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:08.430+0000 7ff256743640 1 --2- 172.21.15.150:0/1141383468 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff2500cf7c0 0x7ff250152920 unknown :-1 s=CLOSED pgs=463 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:08.434 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:08.430+0000 7ff256743640 1 --2- 172.21.15.150:0/1141383468 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff2500b0e20 0x7ff250155dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:08.434 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:08.430+0000 7ff256743640 1 -- 172.21.15.150:0/1141383468 >> 172.21.15.150:0/1141383468 conn(0x7ff2500b2fd0 msgr2=0x7ff2500d1c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:44:08.434 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:08.430+0000 7ff256743640 1 -- 172.21.15.150:0/1141383468 shutdown_connections 2024-09-17T05:44:08.434 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:08.431+0000 7ff256743640 1 -- 172.21.15.150:0/1141383468 wait complete. 2024-09-17T05:44:08.442 INFO:teuthology.orchestra.run.smithi150.stdout:{"pg_ready":true,"pg_map":{"version":110,"stamp":"2024-09-17T05:44:06.879800+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":146,"num_write_kb":1642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":111,"ondisk_log_size":111,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":140,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":254728,"kb_used_data":5204,"kb_used_omap":12,"kb_used_meta":249331,"kb_avail":754719992,"statfs":{"total":773094113280,"available":772833271808,"internally_reserved":0,"allocated":5328896,"data_stored":2811821,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":255315504},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":34,"apply_latency_ms":34,"commit_latency_ns":34000000,"apply_latency_ns":34000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.947889"},"pg_stats":[{"pgid":"7.3f","version":"0'0","reported_seq":13,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T05:44:05.415186+0000","last_change":"2024-09-17T05:44:02.974554+0000","last_active":"2024-09-17T05:44:05.415186+0000","last_peered":"2024-09-17T05:44:05.415186+0000","last_clean":"2024-09-17T05:44:05.415186+0000","last_became_active":"2024-09-17T05:44:02.974231+0000","last_became_peered":"2024-09-17T05:44:02.974231+0000","last_unstale":"2024-09-17T05:44:05.415186+0000","last_undegraded":"2024-09-17T05:44:05.415186+0000","last_fullsized":"2024-09-17T05:44:05.415186+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:44:01.930501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:44:01.930501+0000","last_clean_scrub_stamp":"2024-09-17T05:44:01.930501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:47:00.250341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3e","version":"0'0","reported_seq":13,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T05:44:05.659404+0000","last_change":"2024-09-17T05:44:02.988339+0000","last_active":"2024-09-17T05:44:05.659404+0000","last_peered":"2024-09-17T05:44:05.659404+0000","last_clean":"2024-09-17T05:44:05.659404+0000","last_became_active":"2024-09-17T05:44:02.987682+0000","last_became_peered":"2024-09-17T05:44:02.987682+0000","last_unstale":"2024-09-17T05:44:05.659404+0000","last_undegraded":"2024-09-17T05:44:05.659404+0000","last_fullsized":"2024-09-17T05:44:05.659404+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:44:01.930501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:44:01.930501+0000","last_clean_scrub_stamp":"2024-09-17T05:44:01.930501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:28:30.401981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3d","version":"0'0","reported_seq":13,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T05:44:04.970610+0000","last_change":"2024-09-17T05:44:02.971036+0000","last_active":"2024-09-17T05:44:04.970610+0000","last_peered":"2024-09-17T05:44:04.970610+0000","last_clean":"2024-09-17T05:44:04.970610+0000","last_became_active":"2024-09-17T05:44:02.970669+0000","last_became_peered":"2024-09-17T05:44:02.970669+0000","last_unstale":"2024-09-17T05:44:04.970610+0000","last_undegraded":"2024-09-17T05:44:04.970610+0000","last_fullsized":"2024-09-17T05:44:04.970610+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:44:01.930501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:44:01.930501+0000","last_clean_scrub_stamp":"2024-09-17T05:44:01.930501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:21:11.719829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3c","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:44:02.986117+0000","last_change":"2024-09-17T05:44:02.975046+0000","last_active":"2024-09-17T05:44:02.986117+0000","last_peered":"2024-09-17T05:44:02.986117+0000","last_clean":"2024-09-17T05:44:02.986117+0000","last_became_active":"2024-09-17T05:44:02.973872+0000","last_became_peered":"2024-09-17T05:44:02.973872+0000","last_unstale":"2024-09-17T05:44:02.986117+0000","last_undegraded":"2024-09-17T05:44:02.986117+0000","last_fullsized":"2024-09-17T05:44:02.986117+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:44:01.930501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:44:01.930501+0000","last_clean_scrub_stamp":"2024-09-17T05:44:01.930501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:23:39.449652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3b","version":"0'0","reported_seq":13,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T05:44:05.659101+0000","last_change":"2024-09-17T05:44:02.987062+0000","last_active":"2024-09-17T05:44:05.659101+0000","last_peered":"2024-09-17T05:44:05.659101+0000","last_clean":"2024-09-17T05:44:05.659101+0000","last_became_active":"2024-09-17T05:44:02.986714+0000","last_became_peered":"2024-09-17T05:44:02.986714+0000","last_unstale":"2024-09-17T05:44:05.659101+0000","last_undegraded":"2024-09-17T05:44:05.659101+0000","last_fullsized":"2024-09-17T05:44:05.659101+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:44:01.930501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:44:01.930501+0000","last_clean_scrub_stamp":"2024-09-17T05:44:01.930501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:42:40.168866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3a","version":"0'0","reported_seq":13,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T05:44:03.970509+0000","last_change":"2024-09-17T05:44:02.967402+0000","last_active":"2024-09-17T05:44:03.970509+0000","last_peered":"2024-09-17T05:44:03.970509+0000","last_clean":"2024-09-17T05:44:03.970509+0000","last_became_active":"2024-09-17T05:44:02.967118+0000","last_became_peered":"2024-09-17T05:44:02.967118+0000","last_unstale":"2024-09-17T05:44:03.970509+0000","last_undegraded":"2024-09-17T05:44:03.970509+0000","last_fullsized":"2024-09-17T05:44:03.970509+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:44:01.930501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:44:01.930501+0000","last_clean_scrub_stamp":"2024-09-17T05:44:01.930501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:42:22.361286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.39","version":"0'0","reported_seq":13,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T05:44:05.414847+0000","last_change":"2024-09-17T05:44:02.964592+0000","last_active":"2024-09-17T05:44:05.414847+0000","last_peered":"2024-09-17T05:44:05.414847+0000","last_clean":"2024-09-17T05:44:05.414847+0000","last_became_active":"2024-09-17T05:44:02.964316+0000","last_became_peered":"2024-09-17T05:44:02.964316+0000","last_unstale":"2024-09-17T05:44:05.414847+0000","last_undegraded":"2024-09-17T05:44:05.414847+0000","last_fullsized":"2024-09-17T05:44:05.414847+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:44:01.930501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:44:01.930501+0000","last_clean_scrub_stamp":"2024-09-17T05:44:01.930501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:18:09.625824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.38","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:44:02.993116+0000","last_change":"2024-09-17T05:44:02.988346+0000","last_active":"2024-09-17T05:44:02.993116+0000","last_peered":"2024-09-17T05:44:02.993116+0000","last_clean":"2024-09-17T05:44:02.993116+0000","last_became_active":"2024-09-17T05:44:02.987992+0000","last_became_peered":"2024-09-17T05:44:02.987992+0000","last_unstale":"2024-09-17T05:44:02.993116+0000","last_undegraded":"2024-09-17T05:44:02.993116+0000","last_fullsized":"2024-09-17T05:44:02.993116+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:44:01.930501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:44:01.930501+0000","last_clean_scrub_stamp":"2024-09-17T05:44:01.930501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:50:42.000977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.37","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:44:02.983745+0000","last_change":"2024-09-17T05:44:02.967050+0000","last_active":"2024-09-17T05:44:02.983745+0000","last_peered":"2024-09-17T05:44:02.983745+0000","last_clean":"2024-09-17T05:44:02.983745+0000","last_became_active":"2024-09-17T05:44:02.966728+0000","last_became_peered":"2024-09-17T05:44:02.966728+0000","last_unstale":"2024-09-17T05:44:02.983745+0000","last_undegraded":"2024-09-17T05:44:02.983745+0000","last_fullsized":"2024-09-17T05:44:02.983745+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:44:01.930501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:44:01.930501+0000","last_clean_scrub_stamp":"2024-09-17T05:44:01.930501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:52:36.822899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.36","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:44:02.986190+0000","last_change":"2024-09-17T05:44:02.975494+0000","last_active":"2024-09-17T05:44:02.986190+0000","last_peered":"2024-09-17T05:44:02.986190+0000","last_clean":"2024-09-17T05:44:02.986190+0000","last_became_active":"2024-09-17T05:44:02.975170+0000","last_became_peered":"2024-09-17T05:44:02.975170+0000","last_unstale":"2024-09-17T05:44:02.986190+0000","last_undegraded":"2024-09-17T05:44:02.986190+0000","last_fullsized":"2024-09-17T05:44:02.986190+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:44:01.930501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:44:01.930501+0000","last_clean_scrub_stamp":"2024-09-17T05:44:01.930501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:24:41.631032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.35","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:44:02.986369+0000","last_change":"2024-09-17T05:44:02.975023+0000","last_active":"2024-09-17T05:44:02.986369+0000","last_peered":"2024-09-17T05:44:02.986369+0000","last_clean":"2024-09-17T05:44:02.986369+0000","last_became_active":"2024-09-17T05:44:02.974597+0000","last_became_peered":"2024-09-17T05:44:02.974597+0000","last_unstale":"2024-09-17T05:44:02.986369+0000","last_undegraded":"2024-09-17T05:44:02.986369+0000","last_fullsized":"2024-09-17T05:44:02.986369+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:44:01.930501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:44:01.930501+0000","last_clean_scrub_stamp":"2024-09-17T05:44:01.930501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:23:02.419379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.34","version":"0'0","reported_seq":13,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T05:44:05.659346+0000","last_change":"2024-09-17T05:44:02.983676+0000","last_active":"2024-09-17T05:44:05.659346+0000","last_peered":"2024-09-17T05:44:05.659346+0000","last_clean":"2024-09-17T05:44:05.659346+0000","last_became_active":"2024-09-17T05:44:02.983071+0000","last_became_peered":"2024-09-17T05:44:02.983071+0000","last_unstale":"2024-09-17T05:44:05.659346+0000","last_undegraded":"2024-09-17T05:44:05.659346+0000","last_fullsized":"2024-09-17T05:44:05.659346+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:44:01.930501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:44:01.930501+0000","last_clean_scrub_stamp":"2024-09-17T05:44:01.930501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:45:10.615693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.33","version":"0'0","reported_seq":13,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T05:44:03.970768+0000","last_change":"2024-09-17T05:44:02.976306+0000","last_active":"2024-09-17T05:44:03.970768+0000","last_peered":"2024-09-17T05:44:03.970768+0000","last_clean":"2024-09-17T05:44:03.970768+0000","last_became_active":"2024-09-17T05:44:02.975950+0000","last_became_peered":"2024-09-17T05:44:02.975950+0000","last_unstale":"2024-09-17T05:44:03.970768+0000","last_undegraded":"2024-09-17T05:44:03.970768+0000","last_fullsized":"2024-09-17T05:44:03.970768+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:44:01.930501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:44:01.930501+0000","last_clean_scrub_stamp":"2024-09-17T05:44:01.930501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:16:15.916655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.32","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:44:02.983744+0000","last_change":"2024-09-17T05:44:02.964776+0000","last_active":"2024-09-17T05:44:02.983744+0000","last_peered":"2024-09-17T05:44:02.983744+0000","last_clean":"2024-09-17T05:44:02.983744+0000","last_became_active":"2024-09-17T05:44:02.964467+0000","last_became_peered":"2024-09-17T05:44:02.964467+0000","last_unstale":"2024-09-17T05:44:02.983744+0000","last_undegraded":"2024-09-17T05:44:02.983744+0000","last_fullsized":"2024-09-17T05:44:02.983744+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:44:01.930501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:44:01.930501+0000","last_clean_scrub_stamp":"2024-09-17T05:44:01.930501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:58:37.326070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.31","version":"0'0","reported_seq":13,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T05:44:03.970324+0000","last_change":"2024-09-17T05:44:02.973423+0000","last_active":"2024-09-17T05:44:03.970324+0000","last_peered":"2024-09-17T05:44:03.970324+0000","last_clean":"2024-09-17T05:44:03.970324+0000","last_became_active":"2024-09-17T05:44:02.973088+0000","last_became_peered":"2024-09-17T05:44:02.973088+0000","last_unstale":"2024-09-17T05:44:03.970324+0000","last_undegraded":"2024-09-17T05:44:03.970324+0000","last_fullsized":"2024-09-17T05:44:03.970324+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:44:01.930501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:44:01.930501+0000","last_clean_scrub_stamp":"2024-09-17T05:44:01.930501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:48:33.128790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.30","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-09-17T05:44:01.946541+0000","last_change":"2024-09-17T05:44:01.946541+0000","last_active":"2024-09-17T05:44:01.930501+0000","last_peered":"2024-09-17T05:44:01.930501+0000","last_clean":"2024-09-17T05:44:01.930501+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:44:01.946541+0000","last_undegraded":"2024-09-17T05:44:01.946541+0000","last_fullsized":"2024-09-17T05:44:01.946541+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:44:01.930501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:44:01.930501+0000","last_clean_scrub_stamp":"2024-09-17T05:44:01.930501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.2f","version":"0'0","reported_seq":13,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T05:44:04.970797+0000","last_change":"2024-09-17T05:44:02.980385+0000","last_active":"2024-09-17T05:44:04.970797+0000","last_peered":"2024-09-17T05:44:04.970797+0000","last_clean":"2024-09-17T05:44:04.970797+0000","last_became_active":"2024-09-17T05:44:02.979899+0000","last_became_peered":"2024-09-17T05:44:02.979899+0000","last_unstale":"2024-09-17T05:44:04.970797+0000","last_undegraded":"2024-09-17T05:44:04.970797+0000","last_fullsized":"2024-09-17T05:44:04.970797+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:44:01.930501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:44:01.930501+0000","last_clean_scrub_stamp":"2024-09-17T05:44:01.930501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:06:08.980606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2e","version":"0'0","reported_seq":13,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T05:44:04.971126+0000","last_change":"2024-09-17T05:44:02.987933+0000","last_active":"2024-09-17T05:44:04.971126+0000","last_peered":"2024-09-17T05:44:04.971126+0000","last_clean":"2024-09-17T05:44:04.971126+0000","last_became_active":"2024-09-17T05:44:02.986841+0000","last_became_peered":"2024-09-17T05:44:02.986841+0000","last_unstale":"2024-09-17T05:44:04.971126+0000","last_undegraded":"2024-09-17T05:44:04.971126+0000","last_fullsized":"2024-09-17T05:44:04.971126+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:44:01.930501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:44:01.930501+0000","last_clean_scrub_stamp":"2024-09-17T05:44:01.930501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:16:54.417419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2d","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-09-17T05:44:01.946426+0000","last_change":"2024-09-17T05:44:01.946426+0000","last_active":"2024-09-17T05:44:01.930501+0000","last_peered":"2024-09-17T05:44:01.930501+0000","last_clean":"2024-09-17T05:44:01.930501+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:44:01.946426+0000","last_undegraded":"2024-09-17T05:44:01.946426+0000","last_fullsized":"2024-09-17T05:44:01.946426+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:44:01.930501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:44:01.930501+0000","last_clean_scrub_stamp":"2024-09-17T05:44:01.930501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.2c","version":"0'0","reported_seq":13,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T05:44:03.971091+0000","last_change":"2024-09-17T05:44:02.975384+0000","last_active":"2024-09-17T05:44:03.971091+0000","last_peered":"2024-09-17T05:44:03.971091+0000","last_clean":"2024-09-17T05:44:03.971091+0000","last_became_active":"2024-09-17T05:44:02.969887+0000","last_became_peered":"2024-09-17T05:44:02.969887+0000","last_unstale":"2024-09-17T05:44:03.971091+0000","last_undegraded":"2024-09-17T05:44:03.971091+0000","last_fullsized":"2024-09-17T05:44:03.971091+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:44:01.930501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:44:01.930501+0000","last_clean_scrub_stamp":"2024-09-17T05:44:01.930501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:57:47.626723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2b","version":"0'0","reported_seq":13,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T05:44:03.971047+0000","last_change":"2024-09-17T05:44:02.975815+0000","last_active":"2024-09-17T05:44:03.971047+0000","last_peered":"2024-09-17T05:44:03.971047+0000","last_clean":"2024-09-17T05:44:03.971047+0000","last_became_active":"2024-09-17T05:44:02.975521+0000","last_became_peered":"2024-09-17T05:44:02.975521+0000","last_unstale":"2024-09-17T05:44:03.971047+0000","last_undegraded":"2024-09-17T05:44:03.971047+0000","last_fullsized":"2024-09-17T05:44:03.971047+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:44:01.930501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:44:01.930501+0000","last_clean_scrub_stamp":"2024-09-17T05:44:01.930501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:26:45.903869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.2a","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:44:02.986331+0000","last_change":"2024-09-17T05:44:02.976190+0000","last_active":"2024-09-17T05:44:02.986331+0000","last_peered":"2024-09-17T05:44:02.986331+0000","last_clean":"2024-09-17T05:44:02.986331+0000","last_became_active":"2024-09-17T05:44:02.975892+0000","last_became_peered":"2024-09-17T05:44:02.975892+0000","last_unstale":"2024-09-17T05:44:02.986331+0000","last_undegraded":"2024-09-17T05:44:02.986331+0000","last_fullsized":"2024-09-17T05:44:02.986331+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:44:01.930501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:44:01.930501+0000","last_clean_scrub_stamp":"2024-09-17T05:44:01.930501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:17:11.221074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.29","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-09-17T05:44:01.948604+0000","last_change":"2024-09-17T05:44:01.948604+0000","last_active":"2024-09-17T05:44:01.930501+0000","last_peered":"2024-09-17T05:44:01.930501+0000","last_clean":"2024-09-17T05:44:01.930501+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:44:01.948604+0000","last_undegraded":"2024-09-17T05:44:01.948604+0000","last_fullsized":"2024-09-17T05:44:01.948604+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:44:01.930501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:44:01.930501+0000","last_clean_scrub_stamp":"2024-09-17T05:44:01.930501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.28","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-09-17T05:44:01.945901+0000","last_change":"2024-09-17T05:44:01.945901+0000","last_active":"2024-09-17T05:44:01.930501+0000","last_peered":"2024-09-17T05:44:01.930501+0000","last_clean":"2024-09-17T05:44:01.930501+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:44:01.945901+0000","last_undegraded":"2024-09-17T05:44:01.945901+0000","last_fullsized":"2024-09-17T05:44:01.945901+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:44:01.930501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:44:01.930501+0000","last_clean_scrub_stamp":"2024-09-17T05:44:01.930501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.27","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-09-17T05:44:01.949356+0000","last_change":"2024-09-17T05:44:01.949356+0000","last_active":"2024-09-17T05:44:01.930501+0000","last_peered":"2024-09-17T05:44:01.930501+0000","last_clean":"2024-09-17T05:44:01.930501+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:44:01.949356+0000","last_undegraded":"2024-09-17T05:44:01.949356+0000","last_fullsized":"2024-09-17T05:44:01.949356+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:44:01.930501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:44:01.930501+0000","last_clean_scrub_stamp":"2024-09-17T05:44:01.930501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.26","version":"0'0","reported_seq":13,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T05:44:03.970968+0000","last_change":"2024-09-17T05:44:02.975515+0000","last_active":"2024-09-17T05:44:03.970968+0000","last_peered":"2024-09-17T05:44:03.970968+0000","last_clean":"2024-09-17T05:44:03.970968+0000","last_became_active":"2024-09-17T05:44:02.975200+0000","last_became_peered":"2024-09-17T05:44:02.975200+0000","last_unstale":"2024-09-17T05:44:03.970968+0000","last_undegraded":"2024-09-17T05:44:03.970968+0000","last_fullsized":"2024-09-17T05:44:03.970968+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:44:01.930501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:44:01.930501+0000","last_clean_scrub_stamp":"2024-09-17T05:44:01.930501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:00:49.479958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.25","version":"0'0","reported_seq":13,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T05:44:04.970651+0000","last_change":"2024-09-17T05:44:02.980263+0000","last_active":"2024-09-17T05:44:04.970651+0000","last_peered":"2024-09-17T05:44:04.970651+0000","last_clean":"2024-09-17T05:44:04.970651+0000","last_became_active":"2024-09-17T05:44:02.979881+0000","last_became_peered":"2024-09-17T05:44:02.979881+0000","last_unstale":"2024-09-17T05:44:04.970651+0000","last_undegraded":"2024-09-17T05:44:04.970651+0000","last_fullsized":"2024-09-17T05:44:04.970651+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:44:01.930501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:44:01.930501+0000","last_clean_scrub_stamp":"2024-09-17T05:44:01.930501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:55:06.339857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.24","version":"0'0","reported_seq":13,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T05:44:05.659277+0000","last_change":"2024-09-17T05:44:02.983423+0000","last_active":"2024-09-17T05:44:05.659277+0000","last_peered":"2024-09-17T05:44:05.659277+0000","last_clean":"2024-09-17T05:44:05.659277+0000","last_became_active":"2024-09-17T05:44:02.982942+0000","last_became_peered":"2024-09-17T05:44:02.982942+0000","last_unstale":"2024-09-17T05:44:05.659277+0000","last_undegraded":"2024-09-17T05:44:05.659277+0000","last_fullsized":"2024-09-17T05:44:05.659277+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:44:01.930501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:44:01.930501+0000","last_clean_scrub_stamp":"2024-09-17T05:44:01.930501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:23:24.999309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.23","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-09-17T05:44:01.945462+0000","last_change":"2024-09-17T05:44:01.945462+0000","last_active":"2024-09-17T05:44:01.930501+0000","last_peered":"2024-09-17T05:44:01.930501+0000","last_clean":"2024-09-17T05:44:01.930501+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:44:01.945462+0000","last_undegraded":"2024-09-17T05:44:01.945462+0000","last_fullsized":"2024-09-17T05:44:01.945462+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:44:01.930501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:44:01.930501+0000","last_clean_scrub_stamp":"2024-09-17T05:44:01.930501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.22","version":"0'0","reported_seq":13,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T05:44:04.970507+0000","last_change":"2024-09-17T05:44:02.973004+0000","last_active":"2024-09-17T05:44:04.970507+0000","last_peered":"2024-09-17T05:44:04.970507+0000","last_clean":"2024-09-17T05:44:04.970507+0000","last_became_active":"2024-09-17T05:44:02.972681+0000","last_became_peered":"2024-09-17T05:44:02.972681+0000","last_unstale":"2024-09-17T05:44:04.970507+0000","last_undegraded":"2024-09-17T05:44:04.970507+0000","last_fullsized":"2024-09-17T05:44:04.970507+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:44:01.930501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:44:01.930501+0000","last_clean_scrub_stamp":"2024-09-17T05:44:01.930501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:41:24.794306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.21","version":"0'0","reported_seq":13,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T05:44:03.970995+0000","last_change":"2024-09-17T05:44:02.977953+0000","last_active":"2024-09-17T05:44:03.970995+0000","last_peered":"2024-09-17T05:44:03.970995+0000","last_clean":"2024-09-17T05:44:03.970995+0000","last_became_active":"2024-09-17T05:44:02.977624+0000","last_became_peered":"2024-09-17T05:44:02.977624+0000","last_unstale":"2024-09-17T05:44:03.970995+0000","last_undegraded":"2024-09-17T05:44:03.970995+0000","last_fullsized":"2024-09-17T05:44:03.970995+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:44:01.930501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:44:01.930501+0000","last_clean_scrub_stamp":"2024-09-17T05:44:01.930501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:51:59.823755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.20","version":"0'0","reported_seq":13,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T05:44:03.971876+0000","last_change":"2024-09-17T05:44:02.978709+0000","last_active":"2024-09-17T05:44:03.971876+0000","last_peered":"2024-09-17T05:44:03.971876+0000","last_clean":"2024-09-17T05:44:03.971876+0000","last_became_active":"2024-09-17T05:44:02.978052+0000","last_became_peered":"2024-09-17T05:44:02.978052+0000","last_unstale":"2024-09-17T05:44:03.971876+0000","last_undegraded":"2024-09-17T05:44:03.971876+0000","last_fullsized":"2024-09-17T05:44:03.971876+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:44:01.930501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:44:01.930501+0000","last_clean_scrub_stamp":"2024-09-17T05:44:01.930501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:42:10.964610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":13,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T05:44:05.915609+0000","last_change":"2024-09-17T05:44:02.965033+0000","last_active":"2024-09-17T05:44:05.915609+0000","last_peered":"2024-09-17T05:44:05.915609+0000","last_clean":"2024-09-17T05:44:05.915609+0000","last_became_active":"2024-09-17T05:44:02.964721+0000","last_became_peered":"2024-09-17T05:44:02.964721+0000","last_unstale":"2024-09-17T05:44:05.915609+0000","last_undegraded":"2024-09-17T05:44:05.915609+0000","last_fullsized":"2024-09-17T05:44:05.915609+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:44:01.930501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:44:01.930501+0000","last_clean_scrub_stamp":"2024-09-17T05:44:01.930501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:44:44.295610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"44'4","reported_seq":19,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T05:44:03.970754+0000","last_change":"2024-09-17T05:44:01.954506+0000","last_active":"2024-09-17T05:44:03.970754+0000","last_peered":"2024-09-17T05:44:03.970754+0000","last_clean":"2024-09-17T05:44:03.970754+0000","last_became_active":"2024-09-17T05:44:01.954200+0000","last_became_peered":"2024-09-17T05:44:01.954200+0000","last_unstale":"2024-09-17T05:44:03.970754+0000","last_undegraded":"2024-09-17T05:44:03.970754+0000","last_fullsized":"2024-09-17T05:44:03.970754+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:44:00.925414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:44:00.925414+0000","last_clean_scrub_stamp":"2024-09-17T05:44:00.925414+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:06:07.975519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-09-17T05:44:01.948703+0000","last_change":"2024-09-17T05:44:01.948703+0000","last_active":"2024-09-17T05:44:01.930501+0000","last_peered":"2024-09-17T05:44:01.930501+0000","last_clean":"2024-09-17T05:44:01.930501+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:44:01.948703+0000","last_undegraded":"2024-09-17T05:44:01.948703+0000","last_fullsized":"2024-09-17T05:44:01.948703+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:44:01.930501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:44:01.930501+0000","last_clean_scrub_stamp":"2024-09-17T05:44:01.930501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1e","version":"44'1","reported_seq":16,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T05:44:04.971199+0000","last_change":"2024-09-17T05:44:01.952534+0000","last_active":"2024-09-17T05:44:04.971199+0000","last_peered":"2024-09-17T05:44:04.971199+0000","last_clean":"2024-09-17T05:44:04.971199+0000","last_became_active":"2024-09-17T05:44:01.952187+0000","last_became_peered":"2024-09-17T05:44:01.952187+0000","last_unstale":"2024-09-17T05:44:04.971199+0000","last_undegraded":"2024-09-17T05:44:04.971199+0000","last_fullsized":"2024-09-17T05:44:04.971199+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:44:00.925414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:44:00.925414+0000","last_clean_scrub_stamp":"2024-09-17T05:44:00.925414+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:12:38.503949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":13,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T05:44:05.659502+0000","last_change":"2024-09-17T05:44:02.980083+0000","last_active":"2024-09-17T05:44:05.659502+0000","last_peered":"2024-09-17T05:44:05.659502+0000","last_clean":"2024-09-17T05:44:05.659502+0000","last_became_active":"2024-09-17T05:44:02.979747+0000","last_became_peered":"2024-09-17T05:44:02.979747+0000","last_unstale":"2024-09-17T05:44:05.659502+0000","last_undegraded":"2024-09-17T05:44:05.659502+0000","last_fullsized":"2024-09-17T05:44:05.659502+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:44:01.930501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:44:01.930501+0000","last_clean_scrub_stamp":"2024-09-17T05:44:01.930501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:51:23.709979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1d","version":"44'2","reported_seq":17,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T05:44:05.915916+0000","last_change":"2024-09-17T05:44:01.956537+0000","last_active":"2024-09-17T05:44:05.915916+0000","last_peered":"2024-09-17T05:44:05.915916+0000","last_clean":"2024-09-17T05:44:05.915916+0000","last_became_active":"2024-09-17T05:44:01.956185+0000","last_became_peered":"2024-09-17T05:44:01.956185+0000","last_unstale":"2024-09-17T05:44:05.915916+0000","last_undegraded":"2024-09-17T05:44:05.915916+0000","last_fullsized":"2024-09-17T05:44:05.915916+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:44:00.925414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:44:00.925414+0000","last_clean_scrub_stamp":"2024-09-17T05:44:00.925414+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:46:03.151717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":13,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T05:44:05.916049+0000","last_change":"2024-09-17T05:44:02.976645+0000","last_active":"2024-09-17T05:44:05.916049+0000","last_peered":"2024-09-17T05:44:05.916049+0000","last_clean":"2024-09-17T05:44:05.916049+0000","last_became_active":"2024-09-17T05:44:02.976312+0000","last_became_peered":"2024-09-17T05:44:02.976312+0000","last_unstale":"2024-09-17T05:44:05.916049+0000","last_undegraded":"2024-09-17T05:44:05.916049+0000","last_fullsized":"2024-09-17T05:44:05.916049+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:44:01.930501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:44:01.930501+0000","last_clean_scrub_stamp":"2024-09-17T05:44:01.930501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:05:28.918610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"44'2","reported_seq":17,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T05:44:05.414708+0000","last_change":"2024-09-17T05:44:01.957595+0000","last_active":"2024-09-17T05:44:05.414708+0000","last_peered":"2024-09-17T05:44:05.414708+0000","last_clean":"2024-09-17T05:44:05.414708+0000","last_became_active":"2024-09-17T05:44:01.957224+0000","last_became_peered":"2024-09-17T05:44:01.957224+0000","last_unstale":"2024-09-17T05:44:05.414708+0000","last_undegraded":"2024-09-17T05:44:05.414708+0000","last_fullsized":"2024-09-17T05:44:05.414708+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:44:00.925414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:44:00.925414+0000","last_clean_scrub_stamp":"2024-09-17T05:44:00.925414+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:35:05.665060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":13,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T05:44:04.970762+0000","last_change":"2024-09-17T05:44:02.976326+0000","last_active":"2024-09-17T05:44:04.970762+0000","last_peered":"2024-09-17T05:44:04.970762+0000","last_clean":"2024-09-17T05:44:04.970762+0000","last_became_active":"2024-09-17T05:44:02.975980+0000","last_became_peered":"2024-09-17T05:44:02.975980+0000","last_unstale":"2024-09-17T05:44:04.970762+0000","last_undegraded":"2024-09-17T05:44:04.970762+0000","last_fullsized":"2024-09-17T05:44:04.970762+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:44:01.930501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:44:01.930501+0000","last_clean_scrub_stamp":"2024-09-17T05:44:01.930501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:51:53.246482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"44'1","reported_seq":16,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T05:44:03.971076+0000","last_change":"2024-09-17T05:44:01.949683+0000","last_active":"2024-09-17T05:44:03.971076+0000","last_peered":"2024-09-17T05:44:03.971076+0000","last_clean":"2024-09-17T05:44:03.971076+0000","last_became_active":"2024-09-17T05:44:01.949320+0000","last_became_peered":"2024-09-17T05:44:01.949320+0000","last_unstale":"2024-09-17T05:44:03.971076+0000","last_undegraded":"2024-09-17T05:44:03.971076+0000","last_fullsized":"2024-09-17T05:44:03.971076+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:44:00.925414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:44:00.925414+0000","last_clean_scrub_stamp":"2024-09-17T05:44:00.925414+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:46:36.414158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:44:02.986043+0000","last_change":"2024-09-17T05:44:02.968696+0000","last_active":"2024-09-17T05:44:02.986043+0000","last_peered":"2024-09-17T05:44:02.986043+0000","last_clean":"2024-09-17T05:44:02.986043+0000","last_became_active":"2024-09-17T05:44:02.968360+0000","last_became_peered":"2024-09-17T05:44:02.968360+0000","last_unstale":"2024-09-17T05:44:02.986043+0000","last_undegraded":"2024-09-17T05:44:02.986043+0000","last_fullsized":"2024-09-17T05:44:02.986043+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:44:01.930501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:44:01.930501+0000","last_clean_scrub_stamp":"2024-09-17T05:44:01.930501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:05:09.812483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1a","version":"44'1","reported_seq":16,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T05:44:04.970598+0000","last_change":"2024-09-17T05:44:01.949830+0000","last_active":"2024-09-17T05:44:04.970598+0000","last_peered":"2024-09-17T05:44:04.970598+0000","last_clean":"2024-09-17T05:44:04.970598+0000","last_became_active":"2024-09-17T05:44:01.949509+0000","last_became_peered":"2024-09-17T05:44:01.949509+0000","last_unstale":"2024-09-17T05:44:04.970598+0000","last_undegraded":"2024-09-17T05:44:04.970598+0000","last_fullsized":"2024-09-17T05:44:04.970598+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:44:00.925414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:44:00.925414+0000","last_clean_scrub_stamp":"2024-09-17T05:44:00.925414+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:13:58.348730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:44:02.993131+0000","last_change":"2024-09-17T05:44:02.989081+0000","last_active":"2024-09-17T05:44:02.993131+0000","last_peered":"2024-09-17T05:44:02.993131+0000","last_clean":"2024-09-17T05:44:02.993131+0000","last_became_active":"2024-09-17T05:44:02.988354+0000","last_became_peered":"2024-09-17T05:44:02.988354+0000","last_unstale":"2024-09-17T05:44:02.993131+0000","last_undegraded":"2024-09-17T05:44:02.993131+0000","last_fullsized":"2024-09-17T05:44:02.993131+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:44:01.930501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:44:01.930501+0000","last_clean_scrub_stamp":"2024-09-17T05:44:01.930501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:36:28.222836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":15,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T05:44:05.658774+0000","last_change":"2024-09-17T05:44:01.955804+0000","last_active":"2024-09-17T05:44:05.658774+0000","last_peered":"2024-09-17T05:44:05.658774+0000","last_clean":"2024-09-17T05:44:05.658774+0000","last_became_active":"2024-09-17T05:44:01.955195+0000","last_became_peered":"2024-09-17T05:44:01.955195+0000","last_unstale":"2024-09-17T05:44:05.658774+0000","last_undegraded":"2024-09-17T05:44:05.658774+0000","last_fullsized":"2024-09-17T05:44:05.658774+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:44:00.925414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:44:00.925414+0000","last_clean_scrub_stamp":"2024-09-17T05:44:00.925414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:44:43.290523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-09-17T05:44:01.949231+0000","last_change":"2024-09-17T05:44:01.949231+0000","last_active":"2024-09-17T05:44:01.930501+0000","last_peered":"2024-09-17T05:44:01.930501+0000","last_clean":"2024-09-17T05:44:01.930501+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:44:01.949231+0000","last_undegraded":"2024-09-17T05:44:01.949231+0000","last_fullsized":"2024-09-17T05:44:01.949231+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:44:01.930501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:44:01.930501+0000","last_clean_scrub_stamp":"2024-09-17T05:44:01.930501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:44:02.958951+0000","last_change":"2024-09-17T05:44:01.949647+0000","last_active":"2024-09-17T05:44:02.958951+0000","last_peered":"2024-09-17T05:44:02.958951+0000","last_clean":"2024-09-17T05:44:02.958951+0000","last_became_active":"2024-09-17T05:44:01.949263+0000","last_became_peered":"2024-09-17T05:44:01.949263+0000","last_unstale":"2024-09-17T05:44:02.958951+0000","last_undegraded":"2024-09-17T05:44:02.958951+0000","last_fullsized":"2024-09-17T05:44:02.958951+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:44:00.925414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:44:00.925414+0000","last_clean_scrub_stamp":"2024-09-17T05:44:00.925414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:26:01.492424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":13,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T05:44:04.971121+0000","last_change":"2024-09-17T05:44:02.987319+0000","last_active":"2024-09-17T05:44:04.971121+0000","last_peered":"2024-09-17T05:44:04.971121+0000","last_clean":"2024-09-17T05:44:04.971121+0000","last_became_active":"2024-09-17T05:44:02.986401+0000","last_became_peered":"2024-09-17T05:44:02.986401+0000","last_unstale":"2024-09-17T05:44:04.971121+0000","last_undegraded":"2024-09-17T05:44:04.971121+0000","last_fullsized":"2024-09-17T05:44:04.971121+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:44:01.930501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:44:01.930501+0000","last_clean_scrub_stamp":"2024-09-17T05:44:01.930501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:36:30.650560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":15,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T05:44:04.970859+0000","last_change":"2024-09-17T05:44:01.951077+0000","last_active":"2024-09-17T05:44:04.970859+0000","last_peered":"2024-09-17T05:44:04.970859+0000","last_clean":"2024-09-17T05:44:04.970859+0000","last_became_active":"2024-09-17T05:44:01.950715+0000","last_became_peered":"2024-09-17T05:44:01.950715+0000","last_unstale":"2024-09-17T05:44:04.970859+0000","last_undegraded":"2024-09-17T05:44:04.970859+0000","last_fullsized":"2024-09-17T05:44:04.970859+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:44:00.925414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:44:00.925414+0000","last_clean_scrub_stamp":"2024-09-17T05:44:00.925414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:34:19.904802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":13,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T05:44:05.415322+0000","last_change":"2024-09-17T05:44:02.980515+0000","last_active":"2024-09-17T05:44:05.415322+0000","last_peered":"2024-09-17T05:44:05.415322+0000","last_clean":"2024-09-17T05:44:05.415322+0000","last_became_active":"2024-09-17T05:44:02.980069+0000","last_became_peered":"2024-09-17T05:44:02.980069+0000","last_unstale":"2024-09-17T05:44:05.415322+0000","last_undegraded":"2024-09-17T05:44:05.415322+0000","last_fullsized":"2024-09-17T05:44:05.415322+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:44:01.930501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:44:01.930501+0000","last_clean_scrub_stamp":"2024-09-17T05:44:01.930501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:35:11.922195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:44:02.959919+0000","last_change":"2024-09-17T05:44:01.950607+0000","last_active":"2024-09-17T05:44:02.959919+0000","last_peered":"2024-09-17T05:44:02.959919+0000","last_clean":"2024-09-17T05:44:02.959919+0000","last_became_active":"2024-09-17T05:44:01.950263+0000","last_became_peered":"2024-09-17T05:44:01.950263+0000","last_unstale":"2024-09-17T05:44:02.959919+0000","last_undegraded":"2024-09-17T05:44:02.959919+0000","last_fullsized":"2024-09-17T05:44:02.959919+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:44:00.925414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:44:00.925414+0000","last_clean_scrub_stamp":"2024-09-17T05:44:00.925414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:53:32.014377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":13,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T05:44:03.970541+0000","last_change":"2024-09-17T05:44:02.970209+0000","last_active":"2024-09-17T05:44:03.970541+0000","last_peered":"2024-09-17T05:44:03.970541+0000","last_clean":"2024-09-17T05:44:03.970541+0000","last_became_active":"2024-09-17T05:44:02.969924+0000","last_became_peered":"2024-09-17T05:44:02.969924+0000","last_unstale":"2024-09-17T05:44:03.970541+0000","last_undegraded":"2024-09-17T05:44:03.970541+0000","last_fullsized":"2024-09-17T05:44:03.970541+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:44:01.930501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:44:01.930501+0000","last_clean_scrub_stamp":"2024-09-17T05:44:01.930501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:40:41.740300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"44'3","reported_seq":18,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T05:44:05.414988+0000","last_change":"2024-09-17T05:44:01.958643+0000","last_active":"2024-09-17T05:44:05.414988+0000","last_peered":"2024-09-17T05:44:05.414988+0000","last_clean":"2024-09-17T05:44:05.414988+0000","last_became_active":"2024-09-17T05:44:01.958310+0000","last_became_peered":"2024-09-17T05:44:01.958310+0000","last_unstale":"2024-09-17T05:44:05.414988+0000","last_undegraded":"2024-09-17T05:44:05.414988+0000","last_fullsized":"2024-09-17T05:44:05.414988+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:44:00.925414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:44:00.925414+0000","last_clean_scrub_stamp":"2024-09-17T05:44:00.925414+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:03:12.501051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":13,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T05:44:05.414895+0000","last_change":"2024-09-17T05:44:02.968507+0000","last_active":"2024-09-17T05:44:05.414895+0000","last_peered":"2024-09-17T05:44:05.414895+0000","last_clean":"2024-09-17T05:44:05.414895+0000","last_became_active":"2024-09-17T05:44:02.968167+0000","last_became_peered":"2024-09-17T05:44:02.968167+0000","last_unstale":"2024-09-17T05:44:05.414895+0000","last_undegraded":"2024-09-17T05:44:05.414895+0000","last_fullsized":"2024-09-17T05:44:05.414895+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:44:01.930501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:44:01.930501+0000","last_clean_scrub_stamp":"2024-09-17T05:44:01.930501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:27:06.309594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.14","version":"44'6","reported_seq":21,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T05:44:03.971157+0000","last_change":"2024-09-17T05:44:01.942944+0000","last_active":"2024-09-17T05:44:03.971157+0000","last_peered":"2024-09-17T05:44:03.971157+0000","last_clean":"2024-09-17T05:44:03.971157+0000","last_became_active":"2024-09-17T05:44:01.942488+0000","last_became_peered":"2024-09-17T05:44:01.942488+0000","last_unstale":"2024-09-17T05:44:03.971157+0000","last_undegraded":"2024-09-17T05:44:03.971157+0000","last_fullsized":"2024-09-17T05:44:03.971157+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:44:00.925414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:44:00.925414+0000","last_clean_scrub_stamp":"2024-09-17T05:44:00.925414+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:29:01.447727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-09-17T05:44:01.946200+0000","last_change":"2024-09-17T05:44:01.946200+0000","last_active":"2024-09-17T05:44:01.930501+0000","last_peered":"2024-09-17T05:44:01.930501+0000","last_clean":"2024-09-17T05:44:01.930501+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:44:01.946200+0000","last_undegraded":"2024-09-17T05:44:01.946200+0000","last_fullsized":"2024-09-17T05:44:01.946200+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:44:01.930501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:44:01.930501+0000","last_clean_scrub_stamp":"2024-09-17T05:44:01.930501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"44'2","reported_seq":17,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T05:44:03.971121+0000","last_change":"2024-09-17T05:44:01.948885+0000","last_active":"2024-09-17T05:44:03.971121+0000","last_peered":"2024-09-17T05:44:03.971121+0000","last_clean":"2024-09-17T05:44:03.971121+0000","last_became_active":"2024-09-17T05:44:01.948319+0000","last_became_peered":"2024-09-17T05:44:01.948319+0000","last_unstale":"2024-09-17T05:44:03.971121+0000","last_undegraded":"2024-09-17T05:44:03.971121+0000","last_fullsized":"2024-09-17T05:44:03.971121+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:44:00.925414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:44:00.925414+0000","last_clean_scrub_stamp":"2024-09-17T05:44:00.925414+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:26:48.401818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:44:02.986237+0000","last_change":"2024-09-17T05:44:02.979714+0000","last_active":"2024-09-17T05:44:02.986237+0000","last_peered":"2024-09-17T05:44:02.986237+0000","last_clean":"2024-09-17T05:44:02.986237+0000","last_became_active":"2024-09-17T05:44:02.977592+0000","last_became_peered":"2024-09-17T05:44:02.977592+0000","last_unstale":"2024-09-17T05:44:02.986237+0000","last_undegraded":"2024-09-17T05:44:02.986237+0000","last_fullsized":"2024-09-17T05:44:02.986237+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:44:01.930501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:44:01.930501+0000","last_clean_scrub_stamp":"2024-09-17T05:44:01.930501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:04:06.058220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":15,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T05:44:05.414641+0000","last_change":"2024-09-17T05:44:01.952325+0000","last_active":"2024-09-17T05:44:05.414641+0000","last_peered":"2024-09-17T05:44:05.414641+0000","last_clean":"2024-09-17T05:44:05.414641+0000","last_became_active":"2024-09-17T05:44:01.952005+0000","last_became_peered":"2024-09-17T05:44:01.952005+0000","last_unstale":"2024-09-17T05:44:05.414641+0000","last_undegraded":"2024-09-17T05:44:05.414641+0000","last_fullsized":"2024-09-17T05:44:05.414641+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:44:00.925414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:44:00.925414+0000","last_clean_scrub_stamp":"2024-09-17T05:44:00.925414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:01:33.262027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":13,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T05:44:03.970252+0000","last_change":"2024-09-17T05:44:02.969515+0000","last_active":"2024-09-17T05:44:03.970252+0000","last_peered":"2024-09-17T05:44:03.970252+0000","last_clean":"2024-09-17T05:44:03.970252+0000","last_became_active":"2024-09-17T05:44:02.968910+0000","last_became_peered":"2024-09-17T05:44:02.968910+0000","last_unstale":"2024-09-17T05:44:03.970252+0000","last_undegraded":"2024-09-17T05:44:03.970252+0000","last_fullsized":"2024-09-17T05:44:03.970252+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:44:01.930501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:44:01.930501+0000","last_clean_scrub_stamp":"2024-09-17T05:44:01.930501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:04:08.756849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":15,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T05:44:03.970397+0000","last_change":"2024-09-17T05:44:01.948603+0000","last_active":"2024-09-17T05:44:03.970397+0000","last_peered":"2024-09-17T05:44:03.970397+0000","last_clean":"2024-09-17T05:44:03.970397+0000","last_became_active":"2024-09-17T05:44:01.948261+0000","last_became_peered":"2024-09-17T05:44:01.948261+0000","last_unstale":"2024-09-17T05:44:03.970397+0000","last_undegraded":"2024-09-17T05:44:03.970397+0000","last_fullsized":"2024-09-17T05:44:03.970397+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:44:00.925414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:44:00.925414+0000","last_clean_scrub_stamp":"2024-09-17T05:44:00.925414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:51:52.241395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":13,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T05:44:05.414907+0000","last_change":"2024-09-17T05:44:02.980463+0000","last_active":"2024-09-17T05:44:05.414907+0000","last_peered":"2024-09-17T05:44:05.414907+0000","last_clean":"2024-09-17T05:44:05.414907+0000","last_became_active":"2024-09-17T05:44:02.979921+0000","last_became_peered":"2024-09-17T05:44:02.979921+0000","last_unstale":"2024-09-17T05:44:05.414907+0000","last_undegraded":"2024-09-17T05:44:05.414907+0000","last_fullsized":"2024-09-17T05:44:05.414907+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:44:01.930501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:44:01.930501+0000","last_clean_scrub_stamp":"2024-09-17T05:44:01.930501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:32:37.948066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.10","version":"44'8","reported_seq":21,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:44:02.993082+0000","last_change":"2024-09-17T05:44:01.955769+0000","last_active":"2024-09-17T05:44:02.993082+0000","last_peered":"2024-09-17T05:44:02.993082+0000","last_clean":"2024-09-17T05:44:02.993082+0000","last_became_active":"2024-09-17T05:44:01.955407+0000","last_became_peered":"2024-09-17T05:44:01.955407+0000","last_unstale":"2024-09-17T05:44:02.993082+0000","last_undegraded":"2024-09-17T05:44:02.993082+0000","last_fullsized":"2024-09-17T05:44:02.993082+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:44:00.925414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:44:00.925414+0000","last_clean_scrub_stamp":"2024-09-17T05:44:00.925414+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:16:36.932317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":13,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T05:44:03.971209+0000","last_change":"2024-09-17T05:44:02.977094+0000","last_active":"2024-09-17T05:44:03.971209+0000","last_peered":"2024-09-17T05:44:03.971209+0000","last_clean":"2024-09-17T05:44:03.971209+0000","last_became_active":"2024-09-17T05:44:02.976821+0000","last_became_peered":"2024-09-17T05:44:02.976821+0000","last_unstale":"2024-09-17T05:44:03.971209+0000","last_undegraded":"2024-09-17T05:44:03.971209+0000","last_fullsized":"2024-09-17T05:44:03.971209+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:44:01.930501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:44:01.930501+0000","last_clean_scrub_stamp":"2024-09-17T05:44:01.930501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:03:21.010459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"44'1","reported_seq":16,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T05:44:03.971363+0000","last_change":"2024-09-17T05:44:01.947617+0000","last_active":"2024-09-17T05:44:03.971363+0000","last_peered":"2024-09-17T05:44:03.971363+0000","last_clean":"2024-09-17T05:44:03.971363+0000","last_became_active":"2024-09-17T05:44:01.947272+0000","last_became_peered":"2024-09-17T05:44:01.947272+0000","last_unstale":"2024-09-17T05:44:03.971363+0000","last_undegraded":"2024-09-17T05:44:03.971363+0000","last_fullsized":"2024-09-17T05:44:03.971363+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:44:00.925414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:44:00.925414+0000","last_clean_scrub_stamp":"2024-09-17T05:44:00.925414+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:26:24.738054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:44:02.983449+0000","last_change":"2024-09-17T05:44:02.964018+0000","last_active":"2024-09-17T05:44:02.983449+0000","last_peered":"2024-09-17T05:44:02.983449+0000","last_clean":"2024-09-17T05:44:02.983449+0000","last_became_active":"2024-09-17T05:44:02.963717+0000","last_became_peered":"2024-09-17T05:44:02.963717+0000","last_unstale":"2024-09-17T05:44:02.983449+0000","last_undegraded":"2024-09-17T05:44:02.983449+0000","last_fullsized":"2024-09-17T05:44:02.983449+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:44:01.930501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:44:01.930501+0000","last_clean_scrub_stamp":"2024-09-17T05:44:01.930501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:56:58.722211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.e","version":"44'2","reported_seq":17,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T05:44:04.971214+0000","last_change":"2024-09-17T05:44:01.948758+0000","last_active":"2024-09-17T05:44:04.971214+0000","last_peered":"2024-09-17T05:44:04.971214+0000","last_clean":"2024-09-17T05:44:04.971214+0000","last_became_active":"2024-09-17T05:44:01.948353+0000","last_became_peered":"2024-09-17T05:44:01.948353+0000","last_unstale":"2024-09-17T05:44:04.971214+0000","last_undegraded":"2024-09-17T05:44:04.971214+0000","last_fullsized":"2024-09-17T05:44:04.971214+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:44:00.925414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:44:00.925414+0000","last_clean_scrub_stamp":"2024-09-17T05:44:00.925414+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:40:24.517815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-09-17T05:44:01.946176+0000","last_change":"2024-09-17T05:44:01.946176+0000","last_active":"2024-09-17T05:44:01.930501+0000","last_peered":"2024-09-17T05:44:01.930501+0000","last_clean":"2024-09-17T05:44:01.930501+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:44:01.946176+0000","last_undegraded":"2024-09-17T05:44:01.946176+0000","last_fullsized":"2024-09-17T05:44:01.946176+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:44:01.930501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:44:01.930501+0000","last_clean_scrub_stamp":"2024-09-17T05:44:01.930501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.d","version":"44'1","reported_seq":16,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T05:44:05.659115+0000","last_change":"2024-09-17T05:44:01.952723+0000","last_active":"2024-09-17T05:44:05.659115+0000","last_peered":"2024-09-17T05:44:05.659115+0000","last_clean":"2024-09-17T05:44:05.659115+0000","last_became_active":"2024-09-17T05:44:01.952249+0000","last_became_peered":"2024-09-17T05:44:01.952249+0000","last_unstale":"2024-09-17T05:44:05.659115+0000","last_undegraded":"2024-09-17T05:44:05.659115+0000","last_fullsized":"2024-09-17T05:44:05.659115+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:44:00.925414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:44:00.925414+0000","last_clean_scrub_stamp":"2024-09-17T05:44:00.925414+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:05:27.913523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-09-17T05:44:01.948237+0000","last_change":"2024-09-17T05:44:01.948237+0000","last_active":"2024-09-17T05:44:01.930501+0000","last_peered":"2024-09-17T05:44:01.930501+0000","last_clean":"2024-09-17T05:44:01.930501+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:44:01.948237+0000","last_undegraded":"2024-09-17T05:44:01.948237+0000","last_fullsized":"2024-09-17T05:44:01.948237+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:44:01.930501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:44:01.930501+0000","last_clean_scrub_stamp":"2024-09-17T05:44:01.930501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":15,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T05:44:03.970437+0000","last_change":"2024-09-17T05:44:01.954281+0000","last_active":"2024-09-17T05:44:03.970437+0000","last_peered":"2024-09-17T05:44:03.970437+0000","last_clean":"2024-09-17T05:44:03.970437+0000","last_became_active":"2024-09-17T05:44:01.953910+0000","last_became_peered":"2024-09-17T05:44:01.953910+0000","last_unstale":"2024-09-17T05:44:03.970437+0000","last_undegraded":"2024-09-17T05:44:03.970437+0000","last_fullsized":"2024-09-17T05:44:03.970437+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:44:00.925414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:44:00.925414+0000","last_clean_scrub_stamp":"2024-09-17T05:44:00.925414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:16:53.412332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":13,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T05:44:03.970683+0000","last_change":"2024-09-17T05:44:02.970330+0000","last_active":"2024-09-17T05:44:03.970683+0000","last_peered":"2024-09-17T05:44:03.970683+0000","last_clean":"2024-09-17T05:44:03.970683+0000","last_became_active":"2024-09-17T05:44:02.969132+0000","last_became_peered":"2024-09-17T05:44:02.969132+0000","last_unstale":"2024-09-17T05:44:03.970683+0000","last_undegraded":"2024-09-17T05:44:03.970683+0000","last_fullsized":"2024-09-17T05:44:03.970683+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:44:01.930501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:44:01.930501+0000","last_clean_scrub_stamp":"2024-09-17T05:44:01.930501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:12:05.855315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.b","version":"44'2","reported_seq":17,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T05:44:03.971241+0000","last_change":"2024-09-17T05:44:01.952417+0000","last_active":"2024-09-17T05:44:03.971241+0000","last_peered":"2024-09-17T05:44:03.971241+0000","last_clean":"2024-09-17T05:44:03.971241+0000","last_became_active":"2024-09-17T05:44:01.951779+0000","last_became_peered":"2024-09-17T05:44:01.951779+0000","last_unstale":"2024-09-17T05:44:03.971241+0000","last_undegraded":"2024-09-17T05:44:03.971241+0000","last_fullsized":"2024-09-17T05:44:03.971241+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:44:00.925414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:44:00.925414+0000","last_clean_scrub_stamp":"2024-09-17T05:44:00.925414+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:39:36.775312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":13,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T05:44:05.915357+0000","last_change":"2024-09-17T05:44:02.976421+0000","last_active":"2024-09-17T05:44:05.915357+0000","last_peered":"2024-09-17T05:44:05.915357+0000","last_clean":"2024-09-17T05:44:05.915357+0000","last_became_active":"2024-09-17T05:44:02.976091+0000","last_became_peered":"2024-09-17T05:44:02.976091+0000","last_unstale":"2024-09-17T05:44:05.915357+0000","last_undegraded":"2024-09-17T05:44:05.915357+0000","last_fullsized":"2024-09-17T05:44:05.915357+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:44:01.930501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:44:01.930501+0000","last_clean_scrub_stamp":"2024-09-17T05:44:01.930501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:17:16.014677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":15,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T05:44:05.658767+0000","last_change":"2024-09-17T05:44:01.956743+0000","last_active":"2024-09-17T05:44:05.658767+0000","last_peered":"2024-09-17T05:44:05.658767+0000","last_clean":"2024-09-17T05:44:05.658767+0000","last_became_active":"2024-09-17T05:44:01.955453+0000","last_became_peered":"2024-09-17T05:44:01.955453+0000","last_unstale":"2024-09-17T05:44:05.658767+0000","last_undegraded":"2024-09-17T05:44:05.658767+0000","last_fullsized":"2024-09-17T05:44:05.658767+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:44:00.925414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:44:00.925414+0000","last_clean_scrub_stamp":"2024-09-17T05:44:00.925414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:17:15.009590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":13,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T05:44:03.971825+0000","last_change":"2024-09-17T05:44:02.973112+0000","last_active":"2024-09-17T05:44:03.971825+0000","last_peered":"2024-09-17T05:44:03.971825+0000","last_clean":"2024-09-17T05:44:03.971825+0000","last_became_active":"2024-09-17T05:44:02.972818+0000","last_became_peered":"2024-09-17T05:44:02.972818+0000","last_unstale":"2024-09-17T05:44:03.971825+0000","last_undegraded":"2024-09-17T05:44:03.971825+0000","last_fullsized":"2024-09-17T05:44:03.971825+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:44:01.930501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:44:01.930501+0000","last_clean_scrub_stamp":"2024-09-17T05:44:01.930501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:02:00.787605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:44:02.959170+0000","last_change":"2024-09-17T05:44:01.953671+0000","last_active":"2024-09-17T05:44:02.959170+0000","last_peered":"2024-09-17T05:44:02.959170+0000","last_clean":"2024-09-17T05:44:02.959170+0000","last_became_active":"2024-09-17T05:44:01.953335+0000","last_became_peered":"2024-09-17T05:44:01.953335+0000","last_unstale":"2024-09-17T05:44:02.959170+0000","last_undegraded":"2024-09-17T05:44:02.959170+0000","last_fullsized":"2024-09-17T05:44:02.959170+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:44:00.925414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:44:00.925414+0000","last_clean_scrub_stamp":"2024-09-17T05:44:00.925414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:37:02.646622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:44:02.983693+0000","last_change":"2024-09-17T05:44:02.965586+0000","last_active":"2024-09-17T05:44:02.983693+0000","last_peered":"2024-09-17T05:44:02.983693+0000","last_clean":"2024-09-17T05:44:02.983693+0000","last_became_active":"2024-09-17T05:44:02.965276+0000","last_became_peered":"2024-09-17T05:44:02.965276+0000","last_unstale":"2024-09-17T05:44:02.983693+0000","last_undegraded":"2024-09-17T05:44:02.983693+0000","last_fullsized":"2024-09-17T05:44:02.983693+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:44:01.930501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:44:01.930501+0000","last_clean_scrub_stamp":"2024-09-17T05:44:01.930501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:36:57.786003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":15,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T05:44:05.414441+0000","last_change":"2024-09-17T05:44:01.952963+0000","last_active":"2024-09-17T05:44:05.414441+0000","last_peered":"2024-09-17T05:44:05.414441+0000","last_clean":"2024-09-17T05:44:05.414441+0000","last_became_active":"2024-09-17T05:44:01.952635+0000","last_became_peered":"2024-09-17T05:44:01.952635+0000","last_unstale":"2024-09-17T05:44:05.414441+0000","last_undegraded":"2024-09-17T05:44:05.414441+0000","last_fullsized":"2024-09-17T05:44:05.414441+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:44:00.925414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:44:00.925414+0000","last_clean_scrub_stamp":"2024-09-17T05:44:00.925414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:01:52.592469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-09-17T05:44:01.948175+0000","last_change":"2024-09-17T05:44:01.948175+0000","last_active":"2024-09-17T05:44:01.930501+0000","last_peered":"2024-09-17T05:44:01.930501+0000","last_clean":"2024-09-17T05:44:01.930501+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:44:01.948175+0000","last_undegraded":"2024-09-17T05:44:01.948175+0000","last_fullsized":"2024-09-17T05:44:01.948175+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:44:01.930501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:44:01.930501+0000","last_clean_scrub_stamp":"2024-09-17T05:44:01.930501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.6","version":"45'1","reported_seq":16,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T05:44:03.971074+0000","last_change":"2024-09-17T05:44:01.948222+0000","last_active":"2024-09-17T05:44:03.971074+0000","last_peered":"2024-09-17T05:44:03.971074+0000","last_clean":"2024-09-17T05:44:03.971074+0000","last_became_active":"2024-09-17T05:44:01.947920+0000","last_became_peered":"2024-09-17T05:44:01.947920+0000","last_unstale":"2024-09-17T05:44:03.971074+0000","last_undegraded":"2024-09-17T05:44:03.971074+0000","last_fullsized":"2024-09-17T05:44:03.971074+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:44:00.925414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:44:00.925414+0000","last_clean_scrub_stamp":"2024-09-17T05:44:00.925414+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:36:29.645473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:44:02.986147+0000","last_change":"2024-09-17T05:44:02.975385+0000","last_active":"2024-09-17T05:44:02.986147+0000","last_peered":"2024-09-17T05:44:02.986147+0000","last_clean":"2024-09-17T05:44:02.986147+0000","last_became_active":"2024-09-17T05:44:02.974263+0000","last_became_peered":"2024-09-17T05:44:02.974263+0000","last_unstale":"2024-09-17T05:44:02.986147+0000","last_undegraded":"2024-09-17T05:44:02.986147+0000","last_fullsized":"2024-09-17T05:44:02.986147+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:44:01.930501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:44:01.930501+0000","last_clean_scrub_stamp":"2024-09-17T05:44:01.930501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:04:07.130698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":15,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T05:44:05.415120+0000","last_change":"2024-09-17T05:44:01.960684+0000","last_active":"2024-09-17T05:44:05.415120+0000","last_peered":"2024-09-17T05:44:05.415120+0000","last_clean":"2024-09-17T05:44:05.415120+0000","last_became_active":"2024-09-17T05:44:01.960310+0000","last_became_peered":"2024-09-17T05:44:01.960310+0000","last_unstale":"2024-09-17T05:44:05.415120+0000","last_undegraded":"2024-09-17T05:44:05.415120+0000","last_fullsized":"2024-09-17T05:44:05.415120+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:44:00.925414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:44:00.925414+0000","last_clean_scrub_stamp":"2024-09-17T05:44:00.925414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:25:07.911474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":13,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T05:44:05.415126+0000","last_change":"2024-09-17T05:44:02.965931+0000","last_active":"2024-09-17T05:44:05.415126+0000","last_peered":"2024-09-17T05:44:05.415126+0000","last_clean":"2024-09-17T05:44:05.415126+0000","last_became_active":"2024-09-17T05:44:02.965685+0000","last_became_peered":"2024-09-17T05:44:02.965685+0000","last_unstale":"2024-09-17T05:44:05.415126+0000","last_undegraded":"2024-09-17T05:44:05.415126+0000","last_fullsized":"2024-09-17T05:44:05.415126+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:44:01.930501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:44:01.930501+0000","last_clean_scrub_stamp":"2024-09-17T05:44:01.930501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:42:28.449626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":15,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T05:44:05.915011+0000","last_change":"2024-09-17T05:44:01.956609+0000","last_active":"2024-09-17T05:44:05.915011+0000","last_peered":"2024-09-17T05:44:05.915011+0000","last_clean":"2024-09-17T05:44:05.915011+0000","last_became_active":"2024-09-17T05:44:01.956251+0000","last_became_peered":"2024-09-17T05:44:01.956251+0000","last_unstale":"2024-09-17T05:44:05.915011+0000","last_undegraded":"2024-09-17T05:44:05.915011+0000","last_fullsized":"2024-09-17T05:44:05.915011+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:44:00.925414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:44:00.925414+0000","last_clean_scrub_stamp":"2024-09-17T05:44:00.925414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:12:38.919452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":13,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T05:44:03.970760+0000","last_change":"2024-09-17T05:44:02.963129+0000","last_active":"2024-09-17T05:44:03.970760+0000","last_peered":"2024-09-17T05:44:03.970760+0000","last_clean":"2024-09-17T05:44:03.970760+0000","last_became_active":"2024-09-17T05:44:02.962771+0000","last_became_peered":"2024-09-17T05:44:02.962771+0000","last_unstale":"2024-09-17T05:44:03.970760+0000","last_undegraded":"2024-09-17T05:44:03.970760+0000","last_fullsized":"2024-09-17T05:44:03.970760+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:44:01.930501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:44:01.930501+0000","last_clean_scrub_stamp":"2024-09-17T05:44:01.930501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:42:32.839604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":15,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T05:44:05.414803+0000","last_change":"2024-09-17T05:44:01.955931+0000","last_active":"2024-09-17T05:44:05.414803+0000","last_peered":"2024-09-17T05:44:05.414803+0000","last_clean":"2024-09-17T05:44:05.414803+0000","last_became_active":"2024-09-17T05:44:01.955587+0000","last_became_peered":"2024-09-17T05:44:01.955587+0000","last_unstale":"2024-09-17T05:44:05.414803+0000","last_undegraded":"2024-09-17T05:44:05.414803+0000","last_fullsized":"2024-09-17T05:44:05.414803+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:44:00.925414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:44:00.925414+0000","last_clean_scrub_stamp":"2024-09-17T05:44:00.925414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:53:49.002592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":13,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T05:44:03.971011+0000","last_change":"2024-09-17T05:44:02.969696+0000","last_active":"2024-09-17T05:44:03.971011+0000","last_peered":"2024-09-17T05:44:03.971011+0000","last_clean":"2024-09-17T05:44:03.971011+0000","last_became_active":"2024-09-17T05:44:02.969397+0000","last_became_peered":"2024-09-17T05:44:02.969397+0000","last_unstale":"2024-09-17T05:44:03.971011+0000","last_undegraded":"2024-09-17T05:44:03.971011+0000","last_fullsized":"2024-09-17T05:44:03.971011+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:44:01.930501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:44:01.930501+0000","last_clean_scrub_stamp":"2024-09-17T05:44:01.930501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:25:36.619406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":15,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T05:44:04.970704+0000","last_change":"2024-09-17T05:44:01.947767+0000","last_active":"2024-09-17T05:44:04.970704+0000","last_peered":"2024-09-17T05:44:04.970704+0000","last_clean":"2024-09-17T05:44:04.970704+0000","last_became_active":"2024-09-17T05:44:01.947426+0000","last_became_peered":"2024-09-17T05:44:01.947426+0000","last_unstale":"2024-09-17T05:44:04.970704+0000","last_undegraded":"2024-09-17T05:44:04.970704+0000","last_fullsized":"2024-09-17T05:44:04.970704+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:44:00.925414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:44:00.925414+0000","last_clean_scrub_stamp":"2024-09-17T05:44:00.925414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:48:16.308463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":13,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T05:44:05.658926+0000","last_change":"2024-09-17T05:44:02.982212+0000","last_active":"2024-09-17T05:44:05.658926+0000","last_peered":"2024-09-17T05:44:05.658926+0000","last_clean":"2024-09-17T05:44:05.658926+0000","last_became_active":"2024-09-17T05:44:02.981857+0000","last_became_peered":"2024-09-17T05:44:02.981857+0000","last_unstale":"2024-09-17T05:44:05.658926+0000","last_undegraded":"2024-09-17T05:44:05.658926+0000","last_fullsized":"2024-09-17T05:44:05.658926+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:44:01.930501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:44:01.930501+0000","last_clean_scrub_stamp":"2024-09-17T05:44:01.930501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:48:36.558940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":15,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T05:44:05.915617+0000","last_change":"2024-09-17T05:44:01.957935+0000","last_active":"2024-09-17T05:44:05.915617+0000","last_peered":"2024-09-17T05:44:05.915617+0000","last_clean":"2024-09-17T05:44:05.915617+0000","last_became_active":"2024-09-17T05:44:01.957554+0000","last_became_peered":"2024-09-17T05:44:01.957554+0000","last_unstale":"2024-09-17T05:44:05.915617+0000","last_undegraded":"2024-09-17T05:44:05.915617+0000","last_fullsized":"2024-09-17T05:44:05.915617+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:44:00.925414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:44:00.925414+0000","last_clean_scrub_stamp":"2024-09-17T05:44:00.925414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:12:38.503949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":13,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T05:44:04.971182+0000","last_change":"2024-09-17T05:44:02.970436+0000","last_active":"2024-09-17T05:44:04.971182+0000","last_peered":"2024-09-17T05:44:04.971182+0000","last_clean":"2024-09-17T05:44:04.971182+0000","last_became_active":"2024-09-17T05:44:02.967032+0000","last_became_peered":"2024-09-17T05:44:02.967032+0000","last_unstale":"2024-09-17T05:44:04.971182+0000","last_undegraded":"2024-09-17T05:44:04.971182+0000","last_fullsized":"2024-09-17T05:44:04.971182+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:44:01.930501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:44:01.930501+0000","last_clean_scrub_stamp":"2024-09-17T05:44:01.930501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:46:37.419245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:44:02.959419+0000","last_change":"2024-09-17T05:44:01.948502+0000","last_active":"2024-09-17T05:44:02.959419+0000","last_peered":"2024-09-17T05:44:02.959419+0000","last_clean":"2024-09-17T05:44:02.959419+0000","last_became_active":"2024-09-17T05:44:01.948181+0000","last_became_peered":"2024-09-17T05:44:01.948181+0000","last_unstale":"2024-09-17T05:44:02.959419+0000","last_undegraded":"2024-09-17T05:44:02.959419+0000","last_fullsized":"2024-09-17T05:44:02.959419+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:44:00.925414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:44:00.925414+0000","last_clean_scrub_stamp":"2024-09-17T05:44:00.925414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:00:31.292020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:44:02.986221+0000","last_change":"2024-09-17T05:44:02.977230+0000","last_active":"2024-09-17T05:44:02.986221+0000","last_peered":"2024-09-17T05:44:02.986221+0000","last_clean":"2024-09-17T05:44:02.986221+0000","last_became_active":"2024-09-17T05:44:02.976922+0000","last_became_peered":"2024-09-17T05:44:02.976922+0000","last_unstale":"2024-09-17T05:44:02.986221+0000","last_undegraded":"2024-09-17T05:44:02.986221+0000","last_fullsized":"2024-09-17T05:44:02.986221+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:44:01.930501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:44:01.930501+0000","last_clean_scrub_stamp":"2024-09-17T05:44:01.930501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:44:44.232120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"44'2","reported_seq":17,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T05:44:05.659350+0000","last_change":"2024-09-17T05:44:01.956246+0000","last_active":"2024-09-17T05:44:05.659350+0000","last_peered":"2024-09-17T05:44:05.659350+0000","last_clean":"2024-09-17T05:44:05.659350+0000","last_became_active":"2024-09-17T05:44:01.954475+0000","last_became_peered":"2024-09-17T05:44:01.954475+0000","last_unstale":"2024-09-17T05:44:05.659350+0000","last_undegraded":"2024-09-17T05:44:05.659350+0000","last_fullsized":"2024-09-17T05:44:05.659350+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:44:00.925414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:44:00.925414+0000","last_clean_scrub_stamp":"2024-09-17T05:44:00.925414+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:41:23.789219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"19'72","reported_seq":151,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T05:44:05.414476+0000","last_change":"2024-09-17T05:41:48.539830+0000","last_active":"2024-09-17T05:44:05.414476+0000","last_peered":"2024-09-17T05:44:05.414476+0000","last_clean":"2024-09-17T05:44:05.414476+0000","last_became_active":"2024-09-17T05:41:48.538743+0000","last_became_peered":"2024-09-17T05:41:48.538743+0000","last_unstale":"2024-09-17T05:44:05.414476+0000","last_undegraded":"2024-09-17T05:44:05.414476+0000","last_fullsized":"2024-09-17T05:44:05.414476+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:47.152539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:47.152539+0000","last_clean_scrub_stamp":"2024-09-17T05:41:47.152539+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:08:02.952016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":4148,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":16,"seq":68719476768,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31660,"kb_used_data":472,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340180,"statfs":{"total":96636764160,"available":96604344320,"internally_reserved":0,"allocated":483328,"data_stored":188869,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":7,"up_from":15,"seq":64424509473,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32280,"kb_used_data":1092,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339560,"statfs":{"total":96636764160,"available":96603709440,"internally_reserved":0,"allocated":1118208,"data_stored":798669,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509472,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31700,"kb_used_data":512,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340140,"statfs":{"total":96636764160,"available":96604303360,"internally_reserved":0,"allocated":524288,"data_stored":208281,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509472,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31712,"kb_used_data":520,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340128,"statfs":{"total":96636764160,"available":96604291072,"internally_reserved":0,"allocated":532480,"data_stored":209823,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509472,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31708,"kb_used_data":520,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340132,"statfs":{"total":96636764160,"available":96604295168,"internally_reserved":0,"allocated":532480,"data_stored":208849,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509472,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31712,"kb_used_data":524,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340128,"statfs":{"total":96636764160,"available":96604291072,"internally_reserved":0,"allocated":536576,"data_stored":209845,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509472,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31696,"kb_used_data":500,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340144,"statfs":{"total":96636764160,"available":96604307456,"internally_reserved":0,"allocated":512000,"data_stored":201981,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574879,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32260,"kb_used_data":1064,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339580,"statfs":{"total":96636764160,"available":96603729920,"internally_reserved":0,"allocated":1089536,"data_stored":785504,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-17T05:44:11.447 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-17T05:44:11.576 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:11.575+0000 7f2765739640 1 -- 172.21.15.150:0/3031798870 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f27600d1790 msgr2=0x7f27600d2780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:44:11.576 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:11.575+0000 7f2765739640 1 --2- 172.21.15.150:0/3031798870 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f27600d1790 0x7f27600d2780 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f2748005fd0 tx=0x7f274802a5d0 comp rx=0 tx=0).stop 2024-09-17T05:44:11.576 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:11.575+0000 7f2765739640 1 -- 172.21.15.150:0/3031798870 shutdown_connections 2024-09-17T05:44:11.576 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:11.575+0000 7f2765739640 1 --2- 172.21.15.150:0/3031798870 >> v2:172.21.15.176:3300/0 conn(0x7f27600d4f90 0x7f27600d0400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:11.576 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:11.575+0000 7f2765739640 1 --2- 172.21.15.150:0/3031798870 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f27600d1790 0x7f27600d2780 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:11.576 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:11.575+0000 7f2765739640 1 -- 172.21.15.150:0/3031798870 >> 172.21.15.150:0/3031798870 conn(0x7f276008bfe0 msgr2=0x7f27600d4670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:44:11.577 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:11.575+0000 7f2765739640 1 -- 172.21.15.150:0/3031798870 shutdown_connections 2024-09-17T05:44:11.577 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:11.575+0000 7f2765739640 1 -- 172.21.15.150:0/3031798870 wait complete. 2024-09-17T05:44:11.577 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:11.577+0000 7f2765739640 1 Processor -- start 2024-09-17T05:44:11.578 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:11.577+0000 7f2765739640 1 -- start start 2024-09-17T05:44:11.580 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:11.578+0000 7f2765739640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f27600b5d50 0x7f2760158be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:44:11.580 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:11.578+0000 7f2765739640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f27600d4f90 0x7f2760159c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:44:11.580 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:11.578+0000 7f2765739640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f276015a1c0 0x7f27601546e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:44:11.580 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:11.579+0000 7f2765739640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f27600b7b00 con 0x7f276015a1c0 2024-09-17T05:44:11.580 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:11.579+0000 7f2765739640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f27600b7980 con 0x7f27600d4f90 2024-09-17T05:44:11.580 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:11.579+0000 7f2765739640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f27600b7c80 con 0x7f27600b5d50 2024-09-17T05:44:11.581 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:11.579+0000 7f275f7fe640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f276015a1c0 0x7f27601546e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:44:11.581 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:11.579+0000 7f275f7fe640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f276015a1c0 0x7f27601546e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:39830/0 (socket says 172.21.15.150:39830) 2024-09-17T05:44:11.581 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:11.579+0000 7f275f7fe640 1 -- 172.21.15.150:0/4143835552 learned_addr learned my addr 172.21.15.150:0/4143835552 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:44:11.581 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:11.579+0000 7f27567fc640 1 --2- 172.21.15.150:0/4143835552 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f27600d4f90 0x7f2760159c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:44:11.581 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:11.579+0000 7f275effd640 1 --2- 172.21.15.150:0/4143835552 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f27600b5d50 0x7f2760158be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:44:11.581 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:11.579+0000 7f275f7fe640 1 -- 172.21.15.150:0/4143835552 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f27600b5d50 msgr2=0x7f2760158be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:44:11.582 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:11.579+0000 7f275f7fe640 1 --2- 172.21.15.150:0/4143835552 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f27600b5d50 0x7f2760158be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:11.582 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:11.579+0000 7f275f7fe640 1 -- 172.21.15.150:0/4143835552 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f27600d4f90 msgr2=0x7f2760159c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:44:11.582 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:11.579+0000 7f275f7fe640 1 --2- 172.21.15.150:0/4143835552 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f27600d4f90 0x7f2760159c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:11.582 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:11.579+0000 7f275f7fe640 1 -- 172.21.15.150:0/4143835552 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f276015a900 con 0x7f276015a1c0 2024-09-17T05:44:11.582 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:11.579+0000 7f275f7fe640 1 --2- 172.21.15.150:0/4143835552 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f276015a1c0 0x7f27601546e0 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f275800ec20 tx=0x7f275800c6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:44:11.582 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:11.579+0000 7f2757fff640 1 -- 172.21.15.150:0/4143835552 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2758003b70 con 0x7f276015a1c0 2024-09-17T05:44:11.582 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:11.579+0000 7f2765739640 1 -- 172.21.15.150:0/4143835552 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f276015abe0 con 0x7f276015a1c0 2024-09-17T05:44:11.582 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:11.579+0000 7f2757fff640 1 -- 172.21.15.150:0/4143835552 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f2758003d10 con 0x7f276015a1c0 2024-09-17T05:44:11.582 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:11.579+0000 7f2757fff640 1 -- 172.21.15.150:0/4143835552 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2758004280 con 0x7f276015a1c0 2024-09-17T05:44:11.582 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:11.580+0000 7f2765739640 1 -- 172.21.15.150:0/4143835552 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2760155540 con 0x7f276015a1c0 2024-09-17T05:44:11.583 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:11.581+0000 7f2765739640 1 -- 172.21.15.150:0/4143835552 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f27600d0650 con 0x7f276015a1c0 2024-09-17T05:44:11.583 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:11.581+0000 7f2757fff640 1 -- 172.21.15.150:0/4143835552 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 9) ==== 101747+0+0 (secure 0 0 0) 0x7f2758004420 con 0x7f276015a1c0 2024-09-17T05:44:11.583 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:11.582+0000 7f2757fff640 1 --2- 172.21.15.150:0/4143835552 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f2740078f20 0x7f274007b430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:44:11.583 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:11.582+0000 7f2757fff640 1 -- 172.21.15.150:0/4143835552 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 5709+0+0 (secure 0 0 0) 0x7f275809c010 con 0x7f276015a1c0 2024-09-17T05:44:11.583 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:11.582+0000 7f275effd640 1 --2- 172.21.15.150:0/4143835552 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f2740078f20 0x7f274007b430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:44:11.584 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:11.583+0000 7f275effd640 1 --2- 172.21.15.150:0/4143835552 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f2740078f20 0x7f274007b430 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f2750001720 tx=0x7f2750009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:44:11.587 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:11.586+0000 7f2757fff640 1 -- 172.21.15.150:0/4143835552 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f27600d0650 con 0x7f276015a1c0 2024-09-17T05:44:11.759 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:11.758+0000 7f2765739640 1 -- 172.21.15.150:0/4143835552 --> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f276015a690 con 0x7f2740078f20 2024-09-17T05:44:11.764 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:11.763+0000 7f2757fff640 1 -- 172.21.15.150:0/4143835552 <== mgr.4108 v2:172.21.15.176:6800/3631216395 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251937 (secure 0 0 0) 0x7f276015a690 con 0x7f2740078f20 2024-09-17T05:44:11.767 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-09-17T05:44:11.768 INFO:teuthology.orchestra.run.smithi150.stderr:dumped all 2024-09-17T05:44:11.770 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:11.766+0000 7f2765739640 1 -- 172.21.15.150:0/4143835552 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f2740078f20 msgr2=0x7f274007b430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:44:11.770 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:11.766+0000 7f2765739640 1 --2- 172.21.15.150:0/4143835552 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f2740078f20 0x7f274007b430 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f2750001720 tx=0x7f2750009040 comp rx=0 tx=0).stop 2024-09-17T05:44:11.770 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:11.766+0000 7f2765739640 1 -- 172.21.15.150:0/4143835552 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f276015a1c0 msgr2=0x7f27601546e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:44:11.770 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:11.766+0000 7f2765739640 1 --2- 172.21.15.150:0/4143835552 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f276015a1c0 0x7f27601546e0 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f275800ec20 tx=0x7f275800c6a0 comp rx=0 tx=0).stop 2024-09-17T05:44:11.770 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:11.766+0000 7f2765739640 1 -- 172.21.15.150:0/4143835552 shutdown_connections 2024-09-17T05:44:11.770 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:11.766+0000 7f2765739640 1 --2- 172.21.15.150:0/4143835552 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f27600d4f90 0x7f2760159c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:11.770 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:11.766+0000 7f2765739640 1 --2- 172.21.15.150:0/4143835552 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f2740078f20 0x7f274007b430 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:11.770 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:11.766+0000 7f2765739640 1 --2- 172.21.15.150:0/4143835552 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f276015a1c0 0x7f27601546e0 unknown :-1 s=CLOSED pgs=464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:11.771 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:11.766+0000 7f2765739640 1 --2- 172.21.15.150:0/4143835552 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f27600b5d50 0x7f2760158be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:11.771 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:11.766+0000 7f2765739640 1 -- 172.21.15.150:0/4143835552 >> 172.21.15.150:0/4143835552 conn(0x7f276008bfe0 msgr2=0x7f27600d1470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:44:11.771 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:11.767+0000 7f2765739640 1 -- 172.21.15.150:0/4143835552 shutdown_connections 2024-09-17T05:44:11.771 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:11.767+0000 7f2765739640 1 -- 172.21.15.150:0/4143835552 wait complete. 2024-09-17T05:44:11.779 INFO:teuthology.orchestra.run.smithi150.stdout:{"pg_ready":true,"pg_map":{"version":112,"stamp":"2024-09-17T05:44:10.881145+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":146,"num_write_kb":1642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":111,"ondisk_log_size":111,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":254792,"kb_used_data":5276,"kb_used_omap":12,"kb_used_meta":249331,"kb_avail":754719928,"statfs":{"total":773094113280,"available":772833206272,"internally_reserved":0,"allocated":5402624,"data_stored":2844944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":255315504},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":28,"apply_latency_ms":28,"commit_latency_ns":28000000,"apply_latency_ns":28000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.002325"},"pg_stats":[{"pgid":"7.3f","version":"0'0","reported_seq":13,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T05:44:05.415186+0000","last_change":"2024-09-17T05:44:02.974554+0000","last_active":"2024-09-17T05:44:05.415186+0000","last_peered":"2024-09-17T05:44:05.415186+0000","last_clean":"2024-09-17T05:44:05.415186+0000","last_became_active":"2024-09-17T05:44:02.974231+0000","last_became_peered":"2024-09-17T05:44:02.974231+0000","last_unstale":"2024-09-17T05:44:05.415186+0000","last_undegraded":"2024-09-17T05:44:05.415186+0000","last_fullsized":"2024-09-17T05:44:05.415186+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:44:01.930501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:44:01.930501+0000","last_clean_scrub_stamp":"2024-09-17T05:44:01.930501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:47:00.250341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3e","version":"0'0","reported_seq":13,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T05:44:05.659404+0000","last_change":"2024-09-17T05:44:02.988339+0000","last_active":"2024-09-17T05:44:05.659404+0000","last_peered":"2024-09-17T05:44:05.659404+0000","last_clean":"2024-09-17T05:44:05.659404+0000","last_became_active":"2024-09-17T05:44:02.987682+0000","last_became_peered":"2024-09-17T05:44:02.987682+0000","last_unstale":"2024-09-17T05:44:05.659404+0000","last_undegraded":"2024-09-17T05:44:05.659404+0000","last_fullsized":"2024-09-17T05:44:05.659404+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:44:01.930501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:44:01.930501+0000","last_clean_scrub_stamp":"2024-09-17T05:44:01.930501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:28:30.401981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3d","version":"0'0","reported_seq":13,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T05:44:04.970610+0000","last_change":"2024-09-17T05:44:02.971036+0000","last_active":"2024-09-17T05:44:04.970610+0000","last_peered":"2024-09-17T05:44:04.970610+0000","last_clean":"2024-09-17T05:44:04.970610+0000","last_became_active":"2024-09-17T05:44:02.970669+0000","last_became_peered":"2024-09-17T05:44:02.970669+0000","last_unstale":"2024-09-17T05:44:04.970610+0000","last_undegraded":"2024-09-17T05:44:04.970610+0000","last_fullsized":"2024-09-17T05:44:04.970610+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:44:01.930501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:44:01.930501+0000","last_clean_scrub_stamp":"2024-09-17T05:44:01.930501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:21:11.719829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3c","version":"0'0","reported_seq":13,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T05:44:05.915408+0000","last_change":"2024-09-17T05:44:02.975046+0000","last_active":"2024-09-17T05:44:05.915408+0000","last_peered":"2024-09-17T05:44:05.915408+0000","last_clean":"2024-09-17T05:44:05.915408+0000","last_became_active":"2024-09-17T05:44:02.973872+0000","last_became_peered":"2024-09-17T05:44:02.973872+0000","last_unstale":"2024-09-17T05:44:05.915408+0000","last_undegraded":"2024-09-17T05:44:05.915408+0000","last_fullsized":"2024-09-17T05:44:05.915408+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:44:01.930501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:44:01.930501+0000","last_clean_scrub_stamp":"2024-09-17T05:44:01.930501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:26:18.985731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3b","version":"0'0","reported_seq":13,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T05:44:05.659101+0000","last_change":"2024-09-17T05:44:02.987062+0000","last_active":"2024-09-17T05:44:05.659101+0000","last_peered":"2024-09-17T05:44:05.659101+0000","last_clean":"2024-09-17T05:44:05.659101+0000","last_became_active":"2024-09-17T05:44:02.986714+0000","last_became_peered":"2024-09-17T05:44:02.986714+0000","last_unstale":"2024-09-17T05:44:05.659101+0000","last_undegraded":"2024-09-17T05:44:05.659101+0000","last_fullsized":"2024-09-17T05:44:05.659101+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:44:01.930501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:44:01.930501+0000","last_clean_scrub_stamp":"2024-09-17T05:44:01.930501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:42:40.168866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3a","version":"0'0","reported_seq":13,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T05:44:03.970509+0000","last_change":"2024-09-17T05:44:02.967402+0000","last_active":"2024-09-17T05:44:03.970509+0000","last_peered":"2024-09-17T05:44:03.970509+0000","last_clean":"2024-09-17T05:44:03.970509+0000","last_became_active":"2024-09-17T05:44:02.967118+0000","last_became_peered":"2024-09-17T05:44:02.967118+0000","last_unstale":"2024-09-17T05:44:03.970509+0000","last_undegraded":"2024-09-17T05:44:03.970509+0000","last_fullsized":"2024-09-17T05:44:03.970509+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:44:01.930501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:44:01.930501+0000","last_clean_scrub_stamp":"2024-09-17T05:44:01.930501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:42:22.361286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.39","version":"0'0","reported_seq":13,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T05:44:05.414847+0000","last_change":"2024-09-17T05:44:02.964592+0000","last_active":"2024-09-17T05:44:05.414847+0000","last_peered":"2024-09-17T05:44:05.414847+0000","last_clean":"2024-09-17T05:44:05.414847+0000","last_became_active":"2024-09-17T05:44:02.964316+0000","last_became_peered":"2024-09-17T05:44:02.964316+0000","last_unstale":"2024-09-17T05:44:05.414847+0000","last_undegraded":"2024-09-17T05:44:05.414847+0000","last_fullsized":"2024-09-17T05:44:05.414847+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:44:01.930501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:44:01.930501+0000","last_clean_scrub_stamp":"2024-09-17T05:44:01.930501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:18:09.625824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.38","version":"0'0","reported_seq":13,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T05:44:05.914908+0000","last_change":"2024-09-17T05:44:02.988346+0000","last_active":"2024-09-17T05:44:05.914908+0000","last_peered":"2024-09-17T05:44:05.914908+0000","last_clean":"2024-09-17T05:44:05.914908+0000","last_became_active":"2024-09-17T05:44:02.987992+0000","last_became_peered":"2024-09-17T05:44:02.987992+0000","last_unstale":"2024-09-17T05:44:05.914908+0000","last_undegraded":"2024-09-17T05:44:05.914908+0000","last_fullsized":"2024-09-17T05:44:05.914908+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:44:01.930501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:44:01.930501+0000","last_clean_scrub_stamp":"2024-09-17T05:44:01.930501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:51:51.186155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.37","version":"0'0","reported_seq":13,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T05:44:05.915639+0000","last_change":"2024-09-17T05:44:02.967050+0000","last_active":"2024-09-17T05:44:05.915639+0000","last_peered":"2024-09-17T05:44:05.915639+0000","last_clean":"2024-09-17T05:44:05.915639+0000","last_became_active":"2024-09-17T05:44:02.966728+0000","last_became_peered":"2024-09-17T05:44:02.966728+0000","last_unstale":"2024-09-17T05:44:05.915639+0000","last_undegraded":"2024-09-17T05:44:05.915639+0000","last_fullsized":"2024-09-17T05:44:05.915639+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:44:01.930501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:44:01.930501+0000","last_clean_scrub_stamp":"2024-09-17T05:44:01.930501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:32:16.597816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.36","version":"0'0","reported_seq":13,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T05:44:05.916152+0000","last_change":"2024-09-17T05:44:02.975494+0000","last_active":"2024-09-17T05:44:05.916152+0000","last_peered":"2024-09-17T05:44:05.916152+0000","last_clean":"2024-09-17T05:44:05.916152+0000","last_became_active":"2024-09-17T05:44:02.975170+0000","last_became_peered":"2024-09-17T05:44:02.975170+0000","last_unstale":"2024-09-17T05:44:05.916152+0000","last_undegraded":"2024-09-17T05:44:05.916152+0000","last_fullsized":"2024-09-17T05:44:05.916152+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:44:01.930501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:44:01.930501+0000","last_clean_scrub_stamp":"2024-09-17T05:44:01.930501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:06:57.193601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.35","version":"0'0","reported_seq":13,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T05:44:05.915252+0000","last_change":"2024-09-17T05:44:02.975023+0000","last_active":"2024-09-17T05:44:05.915252+0000","last_peered":"2024-09-17T05:44:05.915252+0000","last_clean":"2024-09-17T05:44:05.915252+0000","last_became_active":"2024-09-17T05:44:02.974597+0000","last_became_peered":"2024-09-17T05:44:02.974597+0000","last_unstale":"2024-09-17T05:44:05.915252+0000","last_undegraded":"2024-09-17T05:44:05.915252+0000","last_fullsized":"2024-09-17T05:44:05.915252+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:44:01.930501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:44:01.930501+0000","last_clean_scrub_stamp":"2024-09-17T05:44:01.930501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:41:50.749986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.34","version":"0'0","reported_seq":13,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T05:44:05.659346+0000","last_change":"2024-09-17T05:44:02.983676+0000","last_active":"2024-09-17T05:44:05.659346+0000","last_peered":"2024-09-17T05:44:05.659346+0000","last_clean":"2024-09-17T05:44:05.659346+0000","last_became_active":"2024-09-17T05:44:02.983071+0000","last_became_peered":"2024-09-17T05:44:02.983071+0000","last_unstale":"2024-09-17T05:44:05.659346+0000","last_undegraded":"2024-09-17T05:44:05.659346+0000","last_fullsized":"2024-09-17T05:44:05.659346+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:44:01.930501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:44:01.930501+0000","last_clean_scrub_stamp":"2024-09-17T05:44:01.930501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:45:10.615693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.33","version":"0'0","reported_seq":13,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T05:44:03.970768+0000","last_change":"2024-09-17T05:44:02.976306+0000","last_active":"2024-09-17T05:44:03.970768+0000","last_peered":"2024-09-17T05:44:03.970768+0000","last_clean":"2024-09-17T05:44:03.970768+0000","last_became_active":"2024-09-17T05:44:02.975950+0000","last_became_peered":"2024-09-17T05:44:02.975950+0000","last_unstale":"2024-09-17T05:44:03.970768+0000","last_undegraded":"2024-09-17T05:44:03.970768+0000","last_fullsized":"2024-09-17T05:44:03.970768+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:44:01.930501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:44:01.930501+0000","last_clean_scrub_stamp":"2024-09-17T05:44:01.930501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:16:15.916655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.32","version":"0'0","reported_seq":13,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T05:44:05.915711+0000","last_change":"2024-09-17T05:44:02.964776+0000","last_active":"2024-09-17T05:44:05.915711+0000","last_peered":"2024-09-17T05:44:05.915711+0000","last_clean":"2024-09-17T05:44:05.915711+0000","last_became_active":"2024-09-17T05:44:02.964467+0000","last_became_peered":"2024-09-17T05:44:02.964467+0000","last_unstale":"2024-09-17T05:44:05.915711+0000","last_undegraded":"2024-09-17T05:44:05.915711+0000","last_fullsized":"2024-09-17T05:44:05.915711+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:44:01.930501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:44:01.930501+0000","last_clean_scrub_stamp":"2024-09-17T05:44:01.930501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:41:59.120847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.31","version":"0'0","reported_seq":13,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T05:44:03.970324+0000","last_change":"2024-09-17T05:44:02.973423+0000","last_active":"2024-09-17T05:44:03.970324+0000","last_peered":"2024-09-17T05:44:03.970324+0000","last_clean":"2024-09-17T05:44:03.970324+0000","last_became_active":"2024-09-17T05:44:02.973088+0000","last_became_peered":"2024-09-17T05:44:02.973088+0000","last_unstale":"2024-09-17T05:44:03.970324+0000","last_undegraded":"2024-09-17T05:44:03.970324+0000","last_fullsized":"2024-09-17T05:44:03.970324+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:44:01.930501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:44:01.930501+0000","last_clean_scrub_stamp":"2024-09-17T05:44:01.930501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:48:33.128790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.30","version":"0'0","reported_seq":13,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T05:44:03.971035+0000","last_change":"2024-09-17T05:44:02.989658+0000","last_active":"2024-09-17T05:44:03.971035+0000","last_peered":"2024-09-17T05:44:03.971035+0000","last_clean":"2024-09-17T05:44:03.971035+0000","last_became_active":"2024-09-17T05:44:02.989316+0000","last_became_peered":"2024-09-17T05:44:02.989316+0000","last_unstale":"2024-09-17T05:44:03.971035+0000","last_undegraded":"2024-09-17T05:44:03.971035+0000","last_fullsized":"2024-09-17T05:44:03.971035+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:44:01.930501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:44:01.930501+0000","last_clean_scrub_stamp":"2024-09-17T05:44:01.930501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:44:49.629317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.2f","version":"0'0","reported_seq":13,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T05:44:04.970797+0000","last_change":"2024-09-17T05:44:02.980385+0000","last_active":"2024-09-17T05:44:04.970797+0000","last_peered":"2024-09-17T05:44:04.970797+0000","last_clean":"2024-09-17T05:44:04.970797+0000","last_became_active":"2024-09-17T05:44:02.979899+0000","last_became_peered":"2024-09-17T05:44:02.979899+0000","last_unstale":"2024-09-17T05:44:04.970797+0000","last_undegraded":"2024-09-17T05:44:04.970797+0000","last_fullsized":"2024-09-17T05:44:04.970797+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:44:01.930501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:44:01.930501+0000","last_clean_scrub_stamp":"2024-09-17T05:44:01.930501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:06:08.980606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2e","version":"0'0","reported_seq":13,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T05:44:04.971126+0000","last_change":"2024-09-17T05:44:02.987933+0000","last_active":"2024-09-17T05:44:04.971126+0000","last_peered":"2024-09-17T05:44:04.971126+0000","last_clean":"2024-09-17T05:44:04.971126+0000","last_became_active":"2024-09-17T05:44:02.986841+0000","last_became_peered":"2024-09-17T05:44:02.986841+0000","last_unstale":"2024-09-17T05:44:04.971126+0000","last_undegraded":"2024-09-17T05:44:04.971126+0000","last_fullsized":"2024-09-17T05:44:04.971126+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:44:01.930501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:44:01.930501+0000","last_clean_scrub_stamp":"2024-09-17T05:44:01.930501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:16:54.417419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2d","version":"0'0","reported_seq":13,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T05:44:03.972067+0000","last_change":"2024-09-17T05:44:02.987100+0000","last_active":"2024-09-17T05:44:03.972067+0000","last_peered":"2024-09-17T05:44:03.972067+0000","last_clean":"2024-09-17T05:44:03.972067+0000","last_became_active":"2024-09-17T05:44:02.986755+0000","last_became_peered":"2024-09-17T05:44:02.986755+0000","last_unstale":"2024-09-17T05:44:03.972067+0000","last_undegraded":"2024-09-17T05:44:03.972067+0000","last_fullsized":"2024-09-17T05:44:03.972067+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:44:01.930501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:44:01.930501+0000","last_clean_scrub_stamp":"2024-09-17T05:44:01.930501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:38:39.058115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.2c","version":"0'0","reported_seq":13,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T05:44:03.971091+0000","last_change":"2024-09-17T05:44:02.975384+0000","last_active":"2024-09-17T05:44:03.971091+0000","last_peered":"2024-09-17T05:44:03.971091+0000","last_clean":"2024-09-17T05:44:03.971091+0000","last_became_active":"2024-09-17T05:44:02.969887+0000","last_became_peered":"2024-09-17T05:44:02.969887+0000","last_unstale":"2024-09-17T05:44:03.971091+0000","last_undegraded":"2024-09-17T05:44:03.971091+0000","last_fullsized":"2024-09-17T05:44:03.971091+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:44:01.930501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:44:01.930501+0000","last_clean_scrub_stamp":"2024-09-17T05:44:01.930501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:57:47.626723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2b","version":"0'0","reported_seq":13,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T05:44:03.971047+0000","last_change":"2024-09-17T05:44:02.975815+0000","last_active":"2024-09-17T05:44:03.971047+0000","last_peered":"2024-09-17T05:44:03.971047+0000","last_clean":"2024-09-17T05:44:03.971047+0000","last_became_active":"2024-09-17T05:44:02.975521+0000","last_became_peered":"2024-09-17T05:44:02.975521+0000","last_unstale":"2024-09-17T05:44:03.971047+0000","last_undegraded":"2024-09-17T05:44:03.971047+0000","last_fullsized":"2024-09-17T05:44:03.971047+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:44:01.930501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:44:01.930501+0000","last_clean_scrub_stamp":"2024-09-17T05:44:01.930501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:26:45.903869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.2a","version":"0'0","reported_seq":13,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T05:44:05.915944+0000","last_change":"2024-09-17T05:44:02.976190+0000","last_active":"2024-09-17T05:44:05.915944+0000","last_peered":"2024-09-17T05:44:05.915944+0000","last_clean":"2024-09-17T05:44:05.915944+0000","last_became_active":"2024-09-17T05:44:02.975892+0000","last_became_peered":"2024-09-17T05:44:02.975892+0000","last_unstale":"2024-09-17T05:44:05.915944+0000","last_undegraded":"2024-09-17T05:44:05.915944+0000","last_fullsized":"2024-09-17T05:44:05.915944+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:44:01.930501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:44:01.930501+0000","last_clean_scrub_stamp":"2024-09-17T05:44:01.930501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:18:38.045463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.29","version":"0'0","reported_seq":13,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T05:44:03.970976+0000","last_change":"2024-09-17T05:44:02.981592+0000","last_active":"2024-09-17T05:44:03.970976+0000","last_peered":"2024-09-17T05:44:03.970976+0000","last_clean":"2024-09-17T05:44:03.970976+0000","last_became_active":"2024-09-17T05:44:02.981214+0000","last_became_peered":"2024-09-17T05:44:02.981214+0000","last_unstale":"2024-09-17T05:44:03.970976+0000","last_undegraded":"2024-09-17T05:44:03.970976+0000","last_fullsized":"2024-09-17T05:44:03.970976+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:44:01.930501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:44:01.930501+0000","last_clean_scrub_stamp":"2024-09-17T05:44:01.930501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:43:56.021899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.28","version":"0'0","reported_seq":13,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T05:44:03.971013+0000","last_change":"2024-09-17T05:44:02.978074+0000","last_active":"2024-09-17T05:44:03.971013+0000","last_peered":"2024-09-17T05:44:03.971013+0000","last_clean":"2024-09-17T05:44:03.971013+0000","last_became_active":"2024-09-17T05:44:02.977513+0000","last_became_peered":"2024-09-17T05:44:02.977513+0000","last_unstale":"2024-09-17T05:44:03.971013+0000","last_undegraded":"2024-09-17T05:44:03.971013+0000","last_fullsized":"2024-09-17T05:44:03.971013+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:44:01.930501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:44:01.930501+0000","last_clean_scrub_stamp":"2024-09-17T05:44:01.930501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:59:15.536538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.27","version":"0'0","reported_seq":13,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T05:44:03.971822+0000","last_change":"2024-09-17T05:44:02.982679+0000","last_active":"2024-09-17T05:44:03.971822+0000","last_peered":"2024-09-17T05:44:03.971822+0000","last_clean":"2024-09-17T05:44:03.971822+0000","last_became_active":"2024-09-17T05:44:02.981443+0000","last_became_peered":"2024-09-17T05:44:02.981443+0000","last_unstale":"2024-09-17T05:44:03.971822+0000","last_undegraded":"2024-09-17T05:44:03.971822+0000","last_fullsized":"2024-09-17T05:44:03.971822+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:44:01.930501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:44:01.930501+0000","last_clean_scrub_stamp":"2024-09-17T05:44:01.930501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:12:44.711846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.26","version":"0'0","reported_seq":13,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T05:44:03.970968+0000","last_change":"2024-09-17T05:44:02.975515+0000","last_active":"2024-09-17T05:44:03.970968+0000","last_peered":"2024-09-17T05:44:03.970968+0000","last_clean":"2024-09-17T05:44:03.970968+0000","last_became_active":"2024-09-17T05:44:02.975200+0000","last_became_peered":"2024-09-17T05:44:02.975200+0000","last_unstale":"2024-09-17T05:44:03.970968+0000","last_undegraded":"2024-09-17T05:44:03.970968+0000","last_fullsized":"2024-09-17T05:44:03.970968+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:44:01.930501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:44:01.930501+0000","last_clean_scrub_stamp":"2024-09-17T05:44:01.930501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:00:49.479958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.25","version":"0'0","reported_seq":13,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T05:44:04.970651+0000","last_change":"2024-09-17T05:44:02.980263+0000","last_active":"2024-09-17T05:44:04.970651+0000","last_peered":"2024-09-17T05:44:04.970651+0000","last_clean":"2024-09-17T05:44:04.970651+0000","last_became_active":"2024-09-17T05:44:02.979881+0000","last_became_peered":"2024-09-17T05:44:02.979881+0000","last_unstale":"2024-09-17T05:44:04.970651+0000","last_undegraded":"2024-09-17T05:44:04.970651+0000","last_fullsized":"2024-09-17T05:44:04.970651+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:44:01.930501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:44:01.930501+0000","last_clean_scrub_stamp":"2024-09-17T05:44:01.930501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:55:06.339857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.24","version":"0'0","reported_seq":13,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T05:44:05.659277+0000","last_change":"2024-09-17T05:44:02.983423+0000","last_active":"2024-09-17T05:44:05.659277+0000","last_peered":"2024-09-17T05:44:05.659277+0000","last_clean":"2024-09-17T05:44:05.659277+0000","last_became_active":"2024-09-17T05:44:02.982942+0000","last_became_peered":"2024-09-17T05:44:02.982942+0000","last_unstale":"2024-09-17T05:44:05.659277+0000","last_undegraded":"2024-09-17T05:44:05.659277+0000","last_fullsized":"2024-09-17T05:44:05.659277+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:44:01.930501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:44:01.930501+0000","last_clean_scrub_stamp":"2024-09-17T05:44:01.930501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:23:24.999309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.23","version":"0'0","reported_seq":13,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T05:44:03.971277+0000","last_change":"2024-09-17T05:44:02.976711+0000","last_active":"2024-09-17T05:44:03.971277+0000","last_peered":"2024-09-17T05:44:03.971277+0000","last_clean":"2024-09-17T05:44:03.971277+0000","last_became_active":"2024-09-17T05:44:02.976122+0000","last_became_peered":"2024-09-17T05:44:02.976122+0000","last_unstale":"2024-09-17T05:44:03.971277+0000","last_undegraded":"2024-09-17T05:44:03.971277+0000","last_fullsized":"2024-09-17T05:44:03.971277+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:44:01.930501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:44:01.930501+0000","last_clean_scrub_stamp":"2024-09-17T05:44:01.930501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:07:03.760053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.22","version":"0'0","reported_seq":13,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T05:44:04.970507+0000","last_change":"2024-09-17T05:44:02.973004+0000","last_active":"2024-09-17T05:44:04.970507+0000","last_peered":"2024-09-17T05:44:04.970507+0000","last_clean":"2024-09-17T05:44:04.970507+0000","last_became_active":"2024-09-17T05:44:02.972681+0000","last_became_peered":"2024-09-17T05:44:02.972681+0000","last_unstale":"2024-09-17T05:44:04.970507+0000","last_undegraded":"2024-09-17T05:44:04.970507+0000","last_fullsized":"2024-09-17T05:44:04.970507+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:44:01.930501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:44:01.930501+0000","last_clean_scrub_stamp":"2024-09-17T05:44:01.930501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:41:24.794306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.21","version":"0'0","reported_seq":13,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T05:44:03.970995+0000","last_change":"2024-09-17T05:44:02.977953+0000","last_active":"2024-09-17T05:44:03.970995+0000","last_peered":"2024-09-17T05:44:03.970995+0000","last_clean":"2024-09-17T05:44:03.970995+0000","last_became_active":"2024-09-17T05:44:02.977624+0000","last_became_peered":"2024-09-17T05:44:02.977624+0000","last_unstale":"2024-09-17T05:44:03.970995+0000","last_undegraded":"2024-09-17T05:44:03.970995+0000","last_fullsized":"2024-09-17T05:44:03.970995+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:44:01.930501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:44:01.930501+0000","last_clean_scrub_stamp":"2024-09-17T05:44:01.930501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:51:59.823755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.20","version":"0'0","reported_seq":13,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T05:44:03.971876+0000","last_change":"2024-09-17T05:44:02.978709+0000","last_active":"2024-09-17T05:44:03.971876+0000","last_peered":"2024-09-17T05:44:03.971876+0000","last_clean":"2024-09-17T05:44:03.971876+0000","last_became_active":"2024-09-17T05:44:02.978052+0000","last_became_peered":"2024-09-17T05:44:02.978052+0000","last_unstale":"2024-09-17T05:44:03.971876+0000","last_undegraded":"2024-09-17T05:44:03.971876+0000","last_fullsized":"2024-09-17T05:44:03.971876+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:44:01.930501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:44:01.930501+0000","last_clean_scrub_stamp":"2024-09-17T05:44:01.930501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:42:10.964610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":13,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T05:44:05.915609+0000","last_change":"2024-09-17T05:44:02.965033+0000","last_active":"2024-09-17T05:44:05.915609+0000","last_peered":"2024-09-17T05:44:05.915609+0000","last_clean":"2024-09-17T05:44:05.915609+0000","last_became_active":"2024-09-17T05:44:02.964721+0000","last_became_peered":"2024-09-17T05:44:02.964721+0000","last_unstale":"2024-09-17T05:44:05.915609+0000","last_undegraded":"2024-09-17T05:44:05.915609+0000","last_fullsized":"2024-09-17T05:44:05.915609+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:44:01.930501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:44:01.930501+0000","last_clean_scrub_stamp":"2024-09-17T05:44:01.930501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:44:44.295610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"44'4","reported_seq":19,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T05:44:03.970754+0000","last_change":"2024-09-17T05:44:01.954506+0000","last_active":"2024-09-17T05:44:03.970754+0000","last_peered":"2024-09-17T05:44:03.970754+0000","last_clean":"2024-09-17T05:44:03.970754+0000","last_became_active":"2024-09-17T05:44:01.954200+0000","last_became_peered":"2024-09-17T05:44:01.954200+0000","last_unstale":"2024-09-17T05:44:03.970754+0000","last_undegraded":"2024-09-17T05:44:03.970754+0000","last_fullsized":"2024-09-17T05:44:03.970754+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:44:00.925414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:44:00.925414+0000","last_clean_scrub_stamp":"2024-09-17T05:44:00.925414+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:06:07.975519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":13,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T05:44:03.971902+0000","last_change":"2024-09-17T05:44:02.985038+0000","last_active":"2024-09-17T05:44:03.971902+0000","last_peered":"2024-09-17T05:44:03.971902+0000","last_clean":"2024-09-17T05:44:03.971902+0000","last_became_active":"2024-09-17T05:44:02.984685+0000","last_became_peered":"2024-09-17T05:44:02.984685+0000","last_unstale":"2024-09-17T05:44:03.971902+0000","last_undegraded":"2024-09-17T05:44:03.971902+0000","last_fullsized":"2024-09-17T05:44:03.971902+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:44:01.930501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:44:01.930501+0000","last_clean_scrub_stamp":"2024-09-17T05:44:01.930501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:02:36.233984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1e","version":"44'1","reported_seq":16,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T05:44:04.971199+0000","last_change":"2024-09-17T05:44:01.952534+0000","last_active":"2024-09-17T05:44:04.971199+0000","last_peered":"2024-09-17T05:44:04.971199+0000","last_clean":"2024-09-17T05:44:04.971199+0000","last_became_active":"2024-09-17T05:44:01.952187+0000","last_became_peered":"2024-09-17T05:44:01.952187+0000","last_unstale":"2024-09-17T05:44:04.971199+0000","last_undegraded":"2024-09-17T05:44:04.971199+0000","last_fullsized":"2024-09-17T05:44:04.971199+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:44:00.925414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:44:00.925414+0000","last_clean_scrub_stamp":"2024-09-17T05:44:00.925414+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:12:38.503949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":13,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T05:44:05.659502+0000","last_change":"2024-09-17T05:44:02.980083+0000","last_active":"2024-09-17T05:44:05.659502+0000","last_peered":"2024-09-17T05:44:05.659502+0000","last_clean":"2024-09-17T05:44:05.659502+0000","last_became_active":"2024-09-17T05:44:02.979747+0000","last_became_peered":"2024-09-17T05:44:02.979747+0000","last_unstale":"2024-09-17T05:44:05.659502+0000","last_undegraded":"2024-09-17T05:44:05.659502+0000","last_fullsized":"2024-09-17T05:44:05.659502+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:44:01.930501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:44:01.930501+0000","last_clean_scrub_stamp":"2024-09-17T05:44:01.930501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:51:23.709979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1d","version":"44'2","reported_seq":17,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T05:44:05.915916+0000","last_change":"2024-09-17T05:44:01.956537+0000","last_active":"2024-09-17T05:44:05.915916+0000","last_peered":"2024-09-17T05:44:05.915916+0000","last_clean":"2024-09-17T05:44:05.915916+0000","last_became_active":"2024-09-17T05:44:01.956185+0000","last_became_peered":"2024-09-17T05:44:01.956185+0000","last_unstale":"2024-09-17T05:44:05.915916+0000","last_undegraded":"2024-09-17T05:44:05.915916+0000","last_fullsized":"2024-09-17T05:44:05.915916+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:44:00.925414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:44:00.925414+0000","last_clean_scrub_stamp":"2024-09-17T05:44:00.925414+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:46:03.151717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":13,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T05:44:05.916049+0000","last_change":"2024-09-17T05:44:02.976645+0000","last_active":"2024-09-17T05:44:05.916049+0000","last_peered":"2024-09-17T05:44:05.916049+0000","last_clean":"2024-09-17T05:44:05.916049+0000","last_became_active":"2024-09-17T05:44:02.976312+0000","last_became_peered":"2024-09-17T05:44:02.976312+0000","last_unstale":"2024-09-17T05:44:05.916049+0000","last_undegraded":"2024-09-17T05:44:05.916049+0000","last_fullsized":"2024-09-17T05:44:05.916049+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:44:01.930501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:44:01.930501+0000","last_clean_scrub_stamp":"2024-09-17T05:44:01.930501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:05:28.918610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"44'2","reported_seq":17,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T05:44:05.414708+0000","last_change":"2024-09-17T05:44:01.957595+0000","last_active":"2024-09-17T05:44:05.414708+0000","last_peered":"2024-09-17T05:44:05.414708+0000","last_clean":"2024-09-17T05:44:05.414708+0000","last_became_active":"2024-09-17T05:44:01.957224+0000","last_became_peered":"2024-09-17T05:44:01.957224+0000","last_unstale":"2024-09-17T05:44:05.414708+0000","last_undegraded":"2024-09-17T05:44:05.414708+0000","last_fullsized":"2024-09-17T05:44:05.414708+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:44:00.925414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:44:00.925414+0000","last_clean_scrub_stamp":"2024-09-17T05:44:00.925414+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:35:05.665060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":13,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T05:44:04.970762+0000","last_change":"2024-09-17T05:44:02.976326+0000","last_active":"2024-09-17T05:44:04.970762+0000","last_peered":"2024-09-17T05:44:04.970762+0000","last_clean":"2024-09-17T05:44:04.970762+0000","last_became_active":"2024-09-17T05:44:02.975980+0000","last_became_peered":"2024-09-17T05:44:02.975980+0000","last_unstale":"2024-09-17T05:44:04.970762+0000","last_undegraded":"2024-09-17T05:44:04.970762+0000","last_fullsized":"2024-09-17T05:44:04.970762+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:44:01.930501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:44:01.930501+0000","last_clean_scrub_stamp":"2024-09-17T05:44:01.930501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:51:53.246482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"44'1","reported_seq":16,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T05:44:03.971076+0000","last_change":"2024-09-17T05:44:01.949683+0000","last_active":"2024-09-17T05:44:03.971076+0000","last_peered":"2024-09-17T05:44:03.971076+0000","last_clean":"2024-09-17T05:44:03.971076+0000","last_became_active":"2024-09-17T05:44:01.949320+0000","last_became_peered":"2024-09-17T05:44:01.949320+0000","last_unstale":"2024-09-17T05:44:03.971076+0000","last_undegraded":"2024-09-17T05:44:03.971076+0000","last_fullsized":"2024-09-17T05:44:03.971076+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:44:00.925414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:44:00.925414+0000","last_clean_scrub_stamp":"2024-09-17T05:44:00.925414+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:46:36.414158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":13,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T05:44:05.916017+0000","last_change":"2024-09-17T05:44:02.968696+0000","last_active":"2024-09-17T05:44:05.916017+0000","last_peered":"2024-09-17T05:44:05.916017+0000","last_clean":"2024-09-17T05:44:05.916017+0000","last_became_active":"2024-09-17T05:44:02.968360+0000","last_became_peered":"2024-09-17T05:44:02.968360+0000","last_unstale":"2024-09-17T05:44:05.916017+0000","last_undegraded":"2024-09-17T05:44:05.916017+0000","last_fullsized":"2024-09-17T05:44:05.916017+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:44:01.930501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:44:01.930501+0000","last_clean_scrub_stamp":"2024-09-17T05:44:01.930501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:37:34.310025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1a","version":"44'1","reported_seq":16,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T05:44:04.970598+0000","last_change":"2024-09-17T05:44:01.949830+0000","last_active":"2024-09-17T05:44:04.970598+0000","last_peered":"2024-09-17T05:44:04.970598+0000","last_clean":"2024-09-17T05:44:04.970598+0000","last_became_active":"2024-09-17T05:44:01.949509+0000","last_became_peered":"2024-09-17T05:44:01.949509+0000","last_unstale":"2024-09-17T05:44:04.970598+0000","last_undegraded":"2024-09-17T05:44:04.970598+0000","last_fullsized":"2024-09-17T05:44:04.970598+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:44:00.925414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:44:00.925414+0000","last_clean_scrub_stamp":"2024-09-17T05:44:00.925414+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:13:58.348730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":13,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T05:44:05.915020+0000","last_change":"2024-09-17T05:44:02.989081+0000","last_active":"2024-09-17T05:44:05.915020+0000","last_peered":"2024-09-17T05:44:05.915020+0000","last_clean":"2024-09-17T05:44:05.915020+0000","last_became_active":"2024-09-17T05:44:02.988354+0000","last_became_peered":"2024-09-17T05:44:02.988354+0000","last_unstale":"2024-09-17T05:44:05.915020+0000","last_undegraded":"2024-09-17T05:44:05.915020+0000","last_fullsized":"2024-09-17T05:44:05.915020+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:44:01.930501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:44:01.930501+0000","last_clean_scrub_stamp":"2024-09-17T05:44:01.930501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:00:33.320825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":15,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T05:44:05.658774+0000","last_change":"2024-09-17T05:44:01.955804+0000","last_active":"2024-09-17T05:44:05.658774+0000","last_peered":"2024-09-17T05:44:05.658774+0000","last_clean":"2024-09-17T05:44:05.658774+0000","last_became_active":"2024-09-17T05:44:01.955195+0000","last_became_peered":"2024-09-17T05:44:01.955195+0000","last_unstale":"2024-09-17T05:44:05.658774+0000","last_undegraded":"2024-09-17T05:44:05.658774+0000","last_fullsized":"2024-09-17T05:44:05.658774+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:44:00.925414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:44:00.925414+0000","last_clean_scrub_stamp":"2024-09-17T05:44:00.925414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:44:43.290523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":13,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T05:44:03.970996+0000","last_change":"2024-09-17T05:44:02.978352+0000","last_active":"2024-09-17T05:44:03.970996+0000","last_peered":"2024-09-17T05:44:03.970996+0000","last_clean":"2024-09-17T05:44:03.970996+0000","last_became_active":"2024-09-17T05:44:02.978033+0000","last_became_peered":"2024-09-17T05:44:02.978033+0000","last_unstale":"2024-09-17T05:44:03.970996+0000","last_undegraded":"2024-09-17T05:44:03.970996+0000","last_fullsized":"2024-09-17T05:44:03.970996+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:44:01.930501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:44:01.930501+0000","last_clean_scrub_stamp":"2024-09-17T05:44:01.930501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:51:55.275592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":15,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T05:44:05.915204+0000","last_change":"2024-09-17T05:44:01.949647+0000","last_active":"2024-09-17T05:44:05.915204+0000","last_peered":"2024-09-17T05:44:05.915204+0000","last_clean":"2024-09-17T05:44:05.915204+0000","last_became_active":"2024-09-17T05:44:01.949263+0000","last_became_peered":"2024-09-17T05:44:01.949263+0000","last_unstale":"2024-09-17T05:44:05.915204+0000","last_undegraded":"2024-09-17T05:44:05.915204+0000","last_fullsized":"2024-09-17T05:44:05.915204+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:44:00.925414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:44:00.925414+0000","last_clean_scrub_stamp":"2024-09-17T05:44:00.925414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:26:01.492424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":13,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T05:44:04.971121+0000","last_change":"2024-09-17T05:44:02.987319+0000","last_active":"2024-09-17T05:44:04.971121+0000","last_peered":"2024-09-17T05:44:04.971121+0000","last_clean":"2024-09-17T05:44:04.971121+0000","last_became_active":"2024-09-17T05:44:02.986401+0000","last_became_peered":"2024-09-17T05:44:02.986401+0000","last_unstale":"2024-09-17T05:44:04.971121+0000","last_undegraded":"2024-09-17T05:44:04.971121+0000","last_fullsized":"2024-09-17T05:44:04.971121+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:44:01.930501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:44:01.930501+0000","last_clean_scrub_stamp":"2024-09-17T05:44:01.930501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:36:30.650560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":15,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T05:44:04.970859+0000","last_change":"2024-09-17T05:44:01.951077+0000","last_active":"2024-09-17T05:44:04.970859+0000","last_peered":"2024-09-17T05:44:04.970859+0000","last_clean":"2024-09-17T05:44:04.970859+0000","last_became_active":"2024-09-17T05:44:01.950715+0000","last_became_peered":"2024-09-17T05:44:01.950715+0000","last_unstale":"2024-09-17T05:44:04.970859+0000","last_undegraded":"2024-09-17T05:44:04.970859+0000","last_fullsized":"2024-09-17T05:44:04.970859+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:44:00.925414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:44:00.925414+0000","last_clean_scrub_stamp":"2024-09-17T05:44:00.925414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:34:19.904802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":13,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T05:44:05.415322+0000","last_change":"2024-09-17T05:44:02.980515+0000","last_active":"2024-09-17T05:44:05.415322+0000","last_peered":"2024-09-17T05:44:05.415322+0000","last_clean":"2024-09-17T05:44:05.415322+0000","last_became_active":"2024-09-17T05:44:02.980069+0000","last_became_peered":"2024-09-17T05:44:02.980069+0000","last_unstale":"2024-09-17T05:44:05.415322+0000","last_undegraded":"2024-09-17T05:44:05.415322+0000","last_fullsized":"2024-09-17T05:44:05.415322+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:44:01.930501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:44:01.930501+0000","last_clean_scrub_stamp":"2024-09-17T05:44:01.930501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:35:11.922195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":15,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T05:44:05.916246+0000","last_change":"2024-09-17T05:44:01.950607+0000","last_active":"2024-09-17T05:44:05.916246+0000","last_peered":"2024-09-17T05:44:05.916246+0000","last_clean":"2024-09-17T05:44:05.916246+0000","last_became_active":"2024-09-17T05:44:01.950263+0000","last_became_peered":"2024-09-17T05:44:01.950263+0000","last_unstale":"2024-09-17T05:44:05.916246+0000","last_undegraded":"2024-09-17T05:44:05.916246+0000","last_fullsized":"2024-09-17T05:44:05.916246+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:44:00.925414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:44:00.925414+0000","last_clean_scrub_stamp":"2024-09-17T05:44:00.925414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:53:32.014377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":13,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T05:44:03.970541+0000","last_change":"2024-09-17T05:44:02.970209+0000","last_active":"2024-09-17T05:44:03.970541+0000","last_peered":"2024-09-17T05:44:03.970541+0000","last_clean":"2024-09-17T05:44:03.970541+0000","last_became_active":"2024-09-17T05:44:02.969924+0000","last_became_peered":"2024-09-17T05:44:02.969924+0000","last_unstale":"2024-09-17T05:44:03.970541+0000","last_undegraded":"2024-09-17T05:44:03.970541+0000","last_fullsized":"2024-09-17T05:44:03.970541+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:44:01.930501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:44:01.930501+0000","last_clean_scrub_stamp":"2024-09-17T05:44:01.930501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:40:41.740300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"44'3","reported_seq":18,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T05:44:05.414988+0000","last_change":"2024-09-17T05:44:01.958643+0000","last_active":"2024-09-17T05:44:05.414988+0000","last_peered":"2024-09-17T05:44:05.414988+0000","last_clean":"2024-09-17T05:44:05.414988+0000","last_became_active":"2024-09-17T05:44:01.958310+0000","last_became_peered":"2024-09-17T05:44:01.958310+0000","last_unstale":"2024-09-17T05:44:05.414988+0000","last_undegraded":"2024-09-17T05:44:05.414988+0000","last_fullsized":"2024-09-17T05:44:05.414988+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:44:00.925414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:44:00.925414+0000","last_clean_scrub_stamp":"2024-09-17T05:44:00.925414+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:03:12.501051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":13,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T05:44:05.414895+0000","last_change":"2024-09-17T05:44:02.968507+0000","last_active":"2024-09-17T05:44:05.414895+0000","last_peered":"2024-09-17T05:44:05.414895+0000","last_clean":"2024-09-17T05:44:05.414895+0000","last_became_active":"2024-09-17T05:44:02.968167+0000","last_became_peered":"2024-09-17T05:44:02.968167+0000","last_unstale":"2024-09-17T05:44:05.414895+0000","last_undegraded":"2024-09-17T05:44:05.414895+0000","last_fullsized":"2024-09-17T05:44:05.414895+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:44:01.930501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:44:01.930501+0000","last_clean_scrub_stamp":"2024-09-17T05:44:01.930501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:27:06.309594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.14","version":"44'6","reported_seq":21,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T05:44:03.971157+0000","last_change":"2024-09-17T05:44:01.942944+0000","last_active":"2024-09-17T05:44:03.971157+0000","last_peered":"2024-09-17T05:44:03.971157+0000","last_clean":"2024-09-17T05:44:03.971157+0000","last_became_active":"2024-09-17T05:44:01.942488+0000","last_became_peered":"2024-09-17T05:44:01.942488+0000","last_unstale":"2024-09-17T05:44:03.971157+0000","last_undegraded":"2024-09-17T05:44:03.971157+0000","last_fullsized":"2024-09-17T05:44:03.971157+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:44:00.925414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:44:00.925414+0000","last_clean_scrub_stamp":"2024-09-17T05:44:00.925414+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:29:01.447727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":13,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T05:44:03.971519+0000","last_change":"2024-09-17T05:44:02.986308+0000","last_active":"2024-09-17T05:44:03.971519+0000","last_peered":"2024-09-17T05:44:03.971519+0000","last_clean":"2024-09-17T05:44:03.971519+0000","last_became_active":"2024-09-17T05:44:02.985977+0000","last_became_peered":"2024-09-17T05:44:02.985977+0000","last_unstale":"2024-09-17T05:44:03.971519+0000","last_undegraded":"2024-09-17T05:44:03.971519+0000","last_fullsized":"2024-09-17T05:44:03.971519+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:44:01.930501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:44:01.930501+0000","last_clean_scrub_stamp":"2024-09-17T05:44:01.930501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:46:52.605688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"44'2","reported_seq":17,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T05:44:03.971121+0000","last_change":"2024-09-17T05:44:01.948885+0000","last_active":"2024-09-17T05:44:03.971121+0000","last_peered":"2024-09-17T05:44:03.971121+0000","last_clean":"2024-09-17T05:44:03.971121+0000","last_became_active":"2024-09-17T05:44:01.948319+0000","last_became_peered":"2024-09-17T05:44:01.948319+0000","last_unstale":"2024-09-17T05:44:03.971121+0000","last_undegraded":"2024-09-17T05:44:03.971121+0000","last_fullsized":"2024-09-17T05:44:03.971121+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:44:00.925414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:44:00.925414+0000","last_clean_scrub_stamp":"2024-09-17T05:44:00.925414+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:26:48.401818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":13,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T05:44:05.916401+0000","last_change":"2024-09-17T05:44:02.979714+0000","last_active":"2024-09-17T05:44:05.916401+0000","last_peered":"2024-09-17T05:44:05.916401+0000","last_clean":"2024-09-17T05:44:05.916401+0000","last_became_active":"2024-09-17T05:44:02.977592+0000","last_became_peered":"2024-09-17T05:44:02.977592+0000","last_unstale":"2024-09-17T05:44:05.916401+0000","last_undegraded":"2024-09-17T05:44:05.916401+0000","last_fullsized":"2024-09-17T05:44:05.916401+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:44:01.930501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:44:01.930501+0000","last_clean_scrub_stamp":"2024-09-17T05:44:01.930501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:32:00.634453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":15,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T05:44:05.414641+0000","last_change":"2024-09-17T05:44:01.952325+0000","last_active":"2024-09-17T05:44:05.414641+0000","last_peered":"2024-09-17T05:44:05.414641+0000","last_clean":"2024-09-17T05:44:05.414641+0000","last_became_active":"2024-09-17T05:44:01.952005+0000","last_became_peered":"2024-09-17T05:44:01.952005+0000","last_unstale":"2024-09-17T05:44:05.414641+0000","last_undegraded":"2024-09-17T05:44:05.414641+0000","last_fullsized":"2024-09-17T05:44:05.414641+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:44:00.925414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:44:00.925414+0000","last_clean_scrub_stamp":"2024-09-17T05:44:00.925414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:01:33.262027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":13,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T05:44:03.970252+0000","last_change":"2024-09-17T05:44:02.969515+0000","last_active":"2024-09-17T05:44:03.970252+0000","last_peered":"2024-09-17T05:44:03.970252+0000","last_clean":"2024-09-17T05:44:03.970252+0000","last_became_active":"2024-09-17T05:44:02.968910+0000","last_became_peered":"2024-09-17T05:44:02.968910+0000","last_unstale":"2024-09-17T05:44:03.970252+0000","last_undegraded":"2024-09-17T05:44:03.970252+0000","last_fullsized":"2024-09-17T05:44:03.970252+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:44:01.930501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:44:01.930501+0000","last_clean_scrub_stamp":"2024-09-17T05:44:01.930501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:04:08.756849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":15,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T05:44:03.970397+0000","last_change":"2024-09-17T05:44:01.948603+0000","last_active":"2024-09-17T05:44:03.970397+0000","last_peered":"2024-09-17T05:44:03.970397+0000","last_clean":"2024-09-17T05:44:03.970397+0000","last_became_active":"2024-09-17T05:44:01.948261+0000","last_became_peered":"2024-09-17T05:44:01.948261+0000","last_unstale":"2024-09-17T05:44:03.970397+0000","last_undegraded":"2024-09-17T05:44:03.970397+0000","last_fullsized":"2024-09-17T05:44:03.970397+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:44:00.925414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:44:00.925414+0000","last_clean_scrub_stamp":"2024-09-17T05:44:00.925414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:51:52.241395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":13,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T05:44:05.414907+0000","last_change":"2024-09-17T05:44:02.980463+0000","last_active":"2024-09-17T05:44:05.414907+0000","last_peered":"2024-09-17T05:44:05.414907+0000","last_clean":"2024-09-17T05:44:05.414907+0000","last_became_active":"2024-09-17T05:44:02.979921+0000","last_became_peered":"2024-09-17T05:44:02.979921+0000","last_unstale":"2024-09-17T05:44:05.414907+0000","last_undegraded":"2024-09-17T05:44:05.414907+0000","last_fullsized":"2024-09-17T05:44:05.414907+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:44:01.930501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:44:01.930501+0000","last_clean_scrub_stamp":"2024-09-17T05:44:01.930501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:32:37.948066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.10","version":"44'8","reported_seq":23,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T05:44:05.915311+0000","last_change":"2024-09-17T05:44:01.955769+0000","last_active":"2024-09-17T05:44:05.915311+0000","last_peered":"2024-09-17T05:44:05.915311+0000","last_clean":"2024-09-17T05:44:05.915311+0000","last_became_active":"2024-09-17T05:44:01.955407+0000","last_became_peered":"2024-09-17T05:44:01.955407+0000","last_unstale":"2024-09-17T05:44:05.915311+0000","last_undegraded":"2024-09-17T05:44:05.915311+0000","last_fullsized":"2024-09-17T05:44:05.915311+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:44:00.925414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:44:00.925414+0000","last_clean_scrub_stamp":"2024-09-17T05:44:00.925414+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:16:36.932317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":13,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T05:44:03.971209+0000","last_change":"2024-09-17T05:44:02.977094+0000","last_active":"2024-09-17T05:44:03.971209+0000","last_peered":"2024-09-17T05:44:03.971209+0000","last_clean":"2024-09-17T05:44:03.971209+0000","last_became_active":"2024-09-17T05:44:02.976821+0000","last_became_peered":"2024-09-17T05:44:02.976821+0000","last_unstale":"2024-09-17T05:44:03.971209+0000","last_undegraded":"2024-09-17T05:44:03.971209+0000","last_fullsized":"2024-09-17T05:44:03.971209+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:44:01.930501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:44:01.930501+0000","last_clean_scrub_stamp":"2024-09-17T05:44:01.930501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:03:21.010459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"44'1","reported_seq":16,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T05:44:03.971363+0000","last_change":"2024-09-17T05:44:01.947617+0000","last_active":"2024-09-17T05:44:03.971363+0000","last_peered":"2024-09-17T05:44:03.971363+0000","last_clean":"2024-09-17T05:44:03.971363+0000","last_became_active":"2024-09-17T05:44:01.947272+0000","last_became_peered":"2024-09-17T05:44:01.947272+0000","last_unstale":"2024-09-17T05:44:03.971363+0000","last_undegraded":"2024-09-17T05:44:03.971363+0000","last_fullsized":"2024-09-17T05:44:03.971363+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:44:00.925414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:44:00.925414+0000","last_clean_scrub_stamp":"2024-09-17T05:44:00.925414+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:26:24.738054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":13,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T05:44:05.915739+0000","last_change":"2024-09-17T05:44:02.964018+0000","last_active":"2024-09-17T05:44:05.915739+0000","last_peered":"2024-09-17T05:44:05.915739+0000","last_clean":"2024-09-17T05:44:05.915739+0000","last_became_active":"2024-09-17T05:44:02.963717+0000","last_became_peered":"2024-09-17T05:44:02.963717+0000","last_unstale":"2024-09-17T05:44:05.915739+0000","last_undegraded":"2024-09-17T05:44:05.915739+0000","last_fullsized":"2024-09-17T05:44:05.915739+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:44:01.930501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:44:01.930501+0000","last_clean_scrub_stamp":"2024-09-17T05:44:01.930501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:52:50.994694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.e","version":"44'2","reported_seq":17,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T05:44:04.971214+0000","last_change":"2024-09-17T05:44:01.948758+0000","last_active":"2024-09-17T05:44:04.971214+0000","last_peered":"2024-09-17T05:44:04.971214+0000","last_clean":"2024-09-17T05:44:04.971214+0000","last_became_active":"2024-09-17T05:44:01.948353+0000","last_became_peered":"2024-09-17T05:44:01.948353+0000","last_unstale":"2024-09-17T05:44:04.971214+0000","last_undegraded":"2024-09-17T05:44:04.971214+0000","last_fullsized":"2024-09-17T05:44:04.971214+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:44:00.925414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:44:00.925414+0000","last_clean_scrub_stamp":"2024-09-17T05:44:00.925414+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:40:24.517815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":13,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T05:44:03.971313+0000","last_change":"2024-09-17T05:44:02.976515+0000","last_active":"2024-09-17T05:44:03.971313+0000","last_peered":"2024-09-17T05:44:03.971313+0000","last_clean":"2024-09-17T05:44:03.971313+0000","last_became_active":"2024-09-17T05:44:02.976138+0000","last_became_peered":"2024-09-17T05:44:02.976138+0000","last_unstale":"2024-09-17T05:44:03.971313+0000","last_undegraded":"2024-09-17T05:44:03.971313+0000","last_fullsized":"2024-09-17T05:44:03.971313+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:44:01.930501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:44:01.930501+0000","last_clean_scrub_stamp":"2024-09-17T05:44:01.930501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:47:25.323190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.d","version":"44'1","reported_seq":16,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T05:44:05.659115+0000","last_change":"2024-09-17T05:44:01.952723+0000","last_active":"2024-09-17T05:44:05.659115+0000","last_peered":"2024-09-17T05:44:05.659115+0000","last_clean":"2024-09-17T05:44:05.659115+0000","last_became_active":"2024-09-17T05:44:01.952249+0000","last_became_peered":"2024-09-17T05:44:01.952249+0000","last_unstale":"2024-09-17T05:44:05.659115+0000","last_undegraded":"2024-09-17T05:44:05.659115+0000","last_fullsized":"2024-09-17T05:44:05.659115+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:44:00.925414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:44:00.925414+0000","last_clean_scrub_stamp":"2024-09-17T05:44:00.925414+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:05:27.913523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":13,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T05:44:03.971780+0000","last_change":"2024-09-17T05:44:02.976865+0000","last_active":"2024-09-17T05:44:03.971780+0000","last_peered":"2024-09-17T05:44:03.971780+0000","last_clean":"2024-09-17T05:44:03.971780+0000","last_became_active":"2024-09-17T05:44:02.975981+0000","last_became_peered":"2024-09-17T05:44:02.975981+0000","last_unstale":"2024-09-17T05:44:03.971780+0000","last_undegraded":"2024-09-17T05:44:03.971780+0000","last_fullsized":"2024-09-17T05:44:03.971780+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:44:01.930501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:44:01.930501+0000","last_clean_scrub_stamp":"2024-09-17T05:44:01.930501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:10:36.323431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":15,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T05:44:03.970437+0000","last_change":"2024-09-17T05:44:01.954281+0000","last_active":"2024-09-17T05:44:03.970437+0000","last_peered":"2024-09-17T05:44:03.970437+0000","last_clean":"2024-09-17T05:44:03.970437+0000","last_became_active":"2024-09-17T05:44:01.953910+0000","last_became_peered":"2024-09-17T05:44:01.953910+0000","last_unstale":"2024-09-17T05:44:03.970437+0000","last_undegraded":"2024-09-17T05:44:03.970437+0000","last_fullsized":"2024-09-17T05:44:03.970437+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:44:00.925414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:44:00.925414+0000","last_clean_scrub_stamp":"2024-09-17T05:44:00.925414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:16:53.412332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":13,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T05:44:03.970683+0000","last_change":"2024-09-17T05:44:02.970330+0000","last_active":"2024-09-17T05:44:03.970683+0000","last_peered":"2024-09-17T05:44:03.970683+0000","last_clean":"2024-09-17T05:44:03.970683+0000","last_became_active":"2024-09-17T05:44:02.969132+0000","last_became_peered":"2024-09-17T05:44:02.969132+0000","last_unstale":"2024-09-17T05:44:03.970683+0000","last_undegraded":"2024-09-17T05:44:03.970683+0000","last_fullsized":"2024-09-17T05:44:03.970683+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:44:01.930501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:44:01.930501+0000","last_clean_scrub_stamp":"2024-09-17T05:44:01.930501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:12:05.855315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.b","version":"44'2","reported_seq":17,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T05:44:03.971241+0000","last_change":"2024-09-17T05:44:01.952417+0000","last_active":"2024-09-17T05:44:03.971241+0000","last_peered":"2024-09-17T05:44:03.971241+0000","last_clean":"2024-09-17T05:44:03.971241+0000","last_became_active":"2024-09-17T05:44:01.951779+0000","last_became_peered":"2024-09-17T05:44:01.951779+0000","last_unstale":"2024-09-17T05:44:03.971241+0000","last_undegraded":"2024-09-17T05:44:03.971241+0000","last_fullsized":"2024-09-17T05:44:03.971241+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:44:00.925414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:44:00.925414+0000","last_clean_scrub_stamp":"2024-09-17T05:44:00.925414+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:39:36.775312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":13,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T05:44:05.915357+0000","last_change":"2024-09-17T05:44:02.976421+0000","last_active":"2024-09-17T05:44:05.915357+0000","last_peered":"2024-09-17T05:44:05.915357+0000","last_clean":"2024-09-17T05:44:05.915357+0000","last_became_active":"2024-09-17T05:44:02.976091+0000","last_became_peered":"2024-09-17T05:44:02.976091+0000","last_unstale":"2024-09-17T05:44:05.915357+0000","last_undegraded":"2024-09-17T05:44:05.915357+0000","last_fullsized":"2024-09-17T05:44:05.915357+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:44:01.930501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:44:01.930501+0000","last_clean_scrub_stamp":"2024-09-17T05:44:01.930501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:17:16.014677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":15,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T05:44:05.658767+0000","last_change":"2024-09-17T05:44:01.956743+0000","last_active":"2024-09-17T05:44:05.658767+0000","last_peered":"2024-09-17T05:44:05.658767+0000","last_clean":"2024-09-17T05:44:05.658767+0000","last_became_active":"2024-09-17T05:44:01.955453+0000","last_became_peered":"2024-09-17T05:44:01.955453+0000","last_unstale":"2024-09-17T05:44:05.658767+0000","last_undegraded":"2024-09-17T05:44:05.658767+0000","last_fullsized":"2024-09-17T05:44:05.658767+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:44:00.925414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:44:00.925414+0000","last_clean_scrub_stamp":"2024-09-17T05:44:00.925414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:17:15.009590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":13,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T05:44:03.971825+0000","last_change":"2024-09-17T05:44:02.973112+0000","last_active":"2024-09-17T05:44:03.971825+0000","last_peered":"2024-09-17T05:44:03.971825+0000","last_clean":"2024-09-17T05:44:03.971825+0000","last_became_active":"2024-09-17T05:44:02.972818+0000","last_became_peered":"2024-09-17T05:44:02.972818+0000","last_unstale":"2024-09-17T05:44:03.971825+0000","last_undegraded":"2024-09-17T05:44:03.971825+0000","last_fullsized":"2024-09-17T05:44:03.971825+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:44:01.930501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:44:01.930501+0000","last_clean_scrub_stamp":"2024-09-17T05:44:01.930501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:02:00.787605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":15,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T05:44:05.914970+0000","last_change":"2024-09-17T05:44:01.953671+0000","last_active":"2024-09-17T05:44:05.914970+0000","last_peered":"2024-09-17T05:44:05.914970+0000","last_clean":"2024-09-17T05:44:05.914970+0000","last_became_active":"2024-09-17T05:44:01.953335+0000","last_became_peered":"2024-09-17T05:44:01.953335+0000","last_unstale":"2024-09-17T05:44:05.914970+0000","last_undegraded":"2024-09-17T05:44:05.914970+0000","last_fullsized":"2024-09-17T05:44:05.914970+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:44:00.925414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:44:00.925414+0000","last_clean_scrub_stamp":"2024-09-17T05:44:00.925414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:37:02.646622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":13,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T05:44:05.914946+0000","last_change":"2024-09-17T05:44:02.965586+0000","last_active":"2024-09-17T05:44:05.914946+0000","last_peered":"2024-09-17T05:44:05.914946+0000","last_clean":"2024-09-17T05:44:05.914946+0000","last_became_active":"2024-09-17T05:44:02.965276+0000","last_became_peered":"2024-09-17T05:44:02.965276+0000","last_unstale":"2024-09-17T05:44:05.914946+0000","last_undegraded":"2024-09-17T05:44:05.914946+0000","last_fullsized":"2024-09-17T05:44:05.914946+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:44:01.930501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:44:01.930501+0000","last_clean_scrub_stamp":"2024-09-17T05:44:01.930501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:56:22.921485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":15,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T05:44:05.414441+0000","last_change":"2024-09-17T05:44:01.952963+0000","last_active":"2024-09-17T05:44:05.414441+0000","last_peered":"2024-09-17T05:44:05.414441+0000","last_clean":"2024-09-17T05:44:05.414441+0000","last_became_active":"2024-09-17T05:44:01.952635+0000","last_became_peered":"2024-09-17T05:44:01.952635+0000","last_unstale":"2024-09-17T05:44:05.414441+0000","last_undegraded":"2024-09-17T05:44:05.414441+0000","last_fullsized":"2024-09-17T05:44:05.414441+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:44:00.925414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:44:00.925414+0000","last_clean_scrub_stamp":"2024-09-17T05:44:00.925414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:01:52.592469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":13,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T05:44:03.972116+0000","last_change":"2024-09-17T05:44:02.988479+0000","last_active":"2024-09-17T05:44:03.972116+0000","last_peered":"2024-09-17T05:44:03.972116+0000","last_clean":"2024-09-17T05:44:03.972116+0000","last_became_active":"2024-09-17T05:44:02.988144+0000","last_became_peered":"2024-09-17T05:44:02.988144+0000","last_unstale":"2024-09-17T05:44:03.972116+0000","last_undegraded":"2024-09-17T05:44:03.972116+0000","last_fullsized":"2024-09-17T05:44:03.972116+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:44:01.930501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:44:01.930501+0000","last_clean_scrub_stamp":"2024-09-17T05:44:01.930501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:56:57.221262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.6","version":"45'1","reported_seq":16,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T05:44:03.971074+0000","last_change":"2024-09-17T05:44:01.948222+0000","last_active":"2024-09-17T05:44:03.971074+0000","last_peered":"2024-09-17T05:44:03.971074+0000","last_clean":"2024-09-17T05:44:03.971074+0000","last_became_active":"2024-09-17T05:44:01.947920+0000","last_became_peered":"2024-09-17T05:44:01.947920+0000","last_unstale":"2024-09-17T05:44:03.971074+0000","last_undegraded":"2024-09-17T05:44:03.971074+0000","last_fullsized":"2024-09-17T05:44:03.971074+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:44:00.925414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:44:00.925414+0000","last_clean_scrub_stamp":"2024-09-17T05:44:00.925414+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:36:29.645473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":13,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T05:44:05.915193+0000","last_change":"2024-09-17T05:44:02.975385+0000","last_active":"2024-09-17T05:44:05.915193+0000","last_peered":"2024-09-17T05:44:05.915193+0000","last_clean":"2024-09-17T05:44:05.915193+0000","last_became_active":"2024-09-17T05:44:02.974263+0000","last_became_peered":"2024-09-17T05:44:02.974263+0000","last_unstale":"2024-09-17T05:44:05.915193+0000","last_undegraded":"2024-09-17T05:44:05.915193+0000","last_fullsized":"2024-09-17T05:44:05.915193+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:44:01.930501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:44:01.930501+0000","last_clean_scrub_stamp":"2024-09-17T05:44:01.930501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:27:20.575313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":15,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T05:44:05.415120+0000","last_change":"2024-09-17T05:44:01.960684+0000","last_active":"2024-09-17T05:44:05.415120+0000","last_peered":"2024-09-17T05:44:05.415120+0000","last_clean":"2024-09-17T05:44:05.415120+0000","last_became_active":"2024-09-17T05:44:01.960310+0000","last_became_peered":"2024-09-17T05:44:01.960310+0000","last_unstale":"2024-09-17T05:44:05.415120+0000","last_undegraded":"2024-09-17T05:44:05.415120+0000","last_fullsized":"2024-09-17T05:44:05.415120+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:44:00.925414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:44:00.925414+0000","last_clean_scrub_stamp":"2024-09-17T05:44:00.925414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:25:07.911474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":13,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T05:44:05.415126+0000","last_change":"2024-09-17T05:44:02.965931+0000","last_active":"2024-09-17T05:44:05.415126+0000","last_peered":"2024-09-17T05:44:05.415126+0000","last_clean":"2024-09-17T05:44:05.415126+0000","last_became_active":"2024-09-17T05:44:02.965685+0000","last_became_peered":"2024-09-17T05:44:02.965685+0000","last_unstale":"2024-09-17T05:44:05.415126+0000","last_undegraded":"2024-09-17T05:44:05.415126+0000","last_fullsized":"2024-09-17T05:44:05.415126+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:44:01.930501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:44:01.930501+0000","last_clean_scrub_stamp":"2024-09-17T05:44:01.930501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:42:28.449626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":15,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T05:44:05.915011+0000","last_change":"2024-09-17T05:44:01.956609+0000","last_active":"2024-09-17T05:44:05.915011+0000","last_peered":"2024-09-17T05:44:05.915011+0000","last_clean":"2024-09-17T05:44:05.915011+0000","last_became_active":"2024-09-17T05:44:01.956251+0000","last_became_peered":"2024-09-17T05:44:01.956251+0000","last_unstale":"2024-09-17T05:44:05.915011+0000","last_undegraded":"2024-09-17T05:44:05.915011+0000","last_fullsized":"2024-09-17T05:44:05.915011+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:44:00.925414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:44:00.925414+0000","last_clean_scrub_stamp":"2024-09-17T05:44:00.925414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:12:38.919452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":13,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T05:44:03.970760+0000","last_change":"2024-09-17T05:44:02.963129+0000","last_active":"2024-09-17T05:44:03.970760+0000","last_peered":"2024-09-17T05:44:03.970760+0000","last_clean":"2024-09-17T05:44:03.970760+0000","last_became_active":"2024-09-17T05:44:02.962771+0000","last_became_peered":"2024-09-17T05:44:02.962771+0000","last_unstale":"2024-09-17T05:44:03.970760+0000","last_undegraded":"2024-09-17T05:44:03.970760+0000","last_fullsized":"2024-09-17T05:44:03.970760+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:44:01.930501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:44:01.930501+0000","last_clean_scrub_stamp":"2024-09-17T05:44:01.930501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:42:32.839604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":15,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T05:44:05.414803+0000","last_change":"2024-09-17T05:44:01.955931+0000","last_active":"2024-09-17T05:44:05.414803+0000","last_peered":"2024-09-17T05:44:05.414803+0000","last_clean":"2024-09-17T05:44:05.414803+0000","last_became_active":"2024-09-17T05:44:01.955587+0000","last_became_peered":"2024-09-17T05:44:01.955587+0000","last_unstale":"2024-09-17T05:44:05.414803+0000","last_undegraded":"2024-09-17T05:44:05.414803+0000","last_fullsized":"2024-09-17T05:44:05.414803+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:44:00.925414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:44:00.925414+0000","last_clean_scrub_stamp":"2024-09-17T05:44:00.925414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:53:49.002592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":13,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T05:44:03.971011+0000","last_change":"2024-09-17T05:44:02.969696+0000","last_active":"2024-09-17T05:44:03.971011+0000","last_peered":"2024-09-17T05:44:03.971011+0000","last_clean":"2024-09-17T05:44:03.971011+0000","last_became_active":"2024-09-17T05:44:02.969397+0000","last_became_peered":"2024-09-17T05:44:02.969397+0000","last_unstale":"2024-09-17T05:44:03.971011+0000","last_undegraded":"2024-09-17T05:44:03.971011+0000","last_fullsized":"2024-09-17T05:44:03.971011+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:44:01.930501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:44:01.930501+0000","last_clean_scrub_stamp":"2024-09-17T05:44:01.930501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:25:36.619406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":15,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T05:44:04.970704+0000","last_change":"2024-09-17T05:44:01.947767+0000","last_active":"2024-09-17T05:44:04.970704+0000","last_peered":"2024-09-17T05:44:04.970704+0000","last_clean":"2024-09-17T05:44:04.970704+0000","last_became_active":"2024-09-17T05:44:01.947426+0000","last_became_peered":"2024-09-17T05:44:01.947426+0000","last_unstale":"2024-09-17T05:44:04.970704+0000","last_undegraded":"2024-09-17T05:44:04.970704+0000","last_fullsized":"2024-09-17T05:44:04.970704+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:44:00.925414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:44:00.925414+0000","last_clean_scrub_stamp":"2024-09-17T05:44:00.925414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:48:16.308463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":13,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T05:44:05.658926+0000","last_change":"2024-09-17T05:44:02.982212+0000","last_active":"2024-09-17T05:44:05.658926+0000","last_peered":"2024-09-17T05:44:05.658926+0000","last_clean":"2024-09-17T05:44:05.658926+0000","last_became_active":"2024-09-17T05:44:02.981857+0000","last_became_peered":"2024-09-17T05:44:02.981857+0000","last_unstale":"2024-09-17T05:44:05.658926+0000","last_undegraded":"2024-09-17T05:44:05.658926+0000","last_fullsized":"2024-09-17T05:44:05.658926+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:44:01.930501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:44:01.930501+0000","last_clean_scrub_stamp":"2024-09-17T05:44:01.930501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:48:36.558940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":15,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T05:44:05.915617+0000","last_change":"2024-09-17T05:44:01.957935+0000","last_active":"2024-09-17T05:44:05.915617+0000","last_peered":"2024-09-17T05:44:05.915617+0000","last_clean":"2024-09-17T05:44:05.915617+0000","last_became_active":"2024-09-17T05:44:01.957554+0000","last_became_peered":"2024-09-17T05:44:01.957554+0000","last_unstale":"2024-09-17T05:44:05.915617+0000","last_undegraded":"2024-09-17T05:44:05.915617+0000","last_fullsized":"2024-09-17T05:44:05.915617+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:44:00.925414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:44:00.925414+0000","last_clean_scrub_stamp":"2024-09-17T05:44:00.925414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:12:38.503949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":13,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T05:44:04.971182+0000","last_change":"2024-09-17T05:44:02.970436+0000","last_active":"2024-09-17T05:44:04.971182+0000","last_peered":"2024-09-17T05:44:04.971182+0000","last_clean":"2024-09-17T05:44:04.971182+0000","last_became_active":"2024-09-17T05:44:02.967032+0000","last_became_peered":"2024-09-17T05:44:02.967032+0000","last_unstale":"2024-09-17T05:44:04.971182+0000","last_undegraded":"2024-09-17T05:44:04.971182+0000","last_fullsized":"2024-09-17T05:44:04.971182+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:44:01.930501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:44:01.930501+0000","last_clean_scrub_stamp":"2024-09-17T05:44:01.930501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:46:37.419245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":15,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T05:44:05.915428+0000","last_change":"2024-09-17T05:44:01.948502+0000","last_active":"2024-09-17T05:44:05.915428+0000","last_peered":"2024-09-17T05:44:05.915428+0000","last_clean":"2024-09-17T05:44:05.915428+0000","last_became_active":"2024-09-17T05:44:01.948181+0000","last_became_peered":"2024-09-17T05:44:01.948181+0000","last_unstale":"2024-09-17T05:44:05.915428+0000","last_undegraded":"2024-09-17T05:44:05.915428+0000","last_fullsized":"2024-09-17T05:44:05.915428+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:44:00.925414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:44:00.925414+0000","last_clean_scrub_stamp":"2024-09-17T05:44:00.925414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:00:31.292020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":13,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T05:44:05.916142+0000","last_change":"2024-09-17T05:44:02.977230+0000","last_active":"2024-09-17T05:44:05.916142+0000","last_peered":"2024-09-17T05:44:05.916142+0000","last_clean":"2024-09-17T05:44:05.916142+0000","last_became_active":"2024-09-17T05:44:02.976922+0000","last_became_peered":"2024-09-17T05:44:02.976922+0000","last_unstale":"2024-09-17T05:44:05.916142+0000","last_undegraded":"2024-09-17T05:44:05.916142+0000","last_fullsized":"2024-09-17T05:44:05.916142+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:44:01.930501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:44:01.930501+0000","last_clean_scrub_stamp":"2024-09-17T05:44:01.930501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:29:27.092647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"44'2","reported_seq":17,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T05:44:05.659350+0000","last_change":"2024-09-17T05:44:01.956246+0000","last_active":"2024-09-17T05:44:05.659350+0000","last_peered":"2024-09-17T05:44:05.659350+0000","last_clean":"2024-09-17T05:44:05.659350+0000","last_became_active":"2024-09-17T05:44:01.954475+0000","last_became_peered":"2024-09-17T05:44:01.954475+0000","last_unstale":"2024-09-17T05:44:05.659350+0000","last_undegraded":"2024-09-17T05:44:05.659350+0000","last_fullsized":"2024-09-17T05:44:05.659350+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:44:00.925414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:44:00.925414+0000","last_clean_scrub_stamp":"2024-09-17T05:44:00.925414+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:41:23.789219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"19'72","reported_seq":151,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T05:44:05.414476+0000","last_change":"2024-09-17T05:41:48.539830+0000","last_active":"2024-09-17T05:44:05.414476+0000","last_peered":"2024-09-17T05:44:05.414476+0000","last_clean":"2024-09-17T05:44:05.414476+0000","last_became_active":"2024-09-17T05:41:48.538743+0000","last_became_peered":"2024-09-17T05:41:48.538743+0000","last_unstale":"2024-09-17T05:44:05.414476+0000","last_undegraded":"2024-09-17T05:44:05.414476+0000","last_fullsized":"2024-09-17T05:44:05.414476+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:47.152539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:47.152539+0000","last_clean_scrub_stamp":"2024-09-17T05:41:47.152539+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:08:02.952016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":16,"seq":68719476769,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31704,"kb_used_data":516,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340136,"statfs":{"total":96636764160,"available":96604299264,"internally_reserved":0,"allocated":528384,"data_stored":208883,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":7,"up_from":15,"seq":64424509473,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32280,"kb_used_data":1092,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339560,"statfs":{"total":96636764160,"available":96603709440,"internally_reserved":0,"allocated":1118208,"data_stored":798669,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509472,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31700,"kb_used_data":512,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340140,"statfs":{"total":96636764160,"available":96604303360,"internally_reserved":0,"allocated":524288,"data_stored":208281,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509472,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31712,"kb_used_data":520,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340128,"statfs":{"total":96636764160,"available":96604291072,"internally_reserved":0,"allocated":532480,"data_stored":209823,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509472,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31708,"kb_used_data":520,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340132,"statfs":{"total":96636764160,"available":96604295168,"internally_reserved":0,"allocated":532480,"data_stored":208849,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509472,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31712,"kb_used_data":524,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340128,"statfs":{"total":96636764160,"available":96604291072,"internally_reserved":0,"allocated":536576,"data_stored":209845,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509472,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31696,"kb_used_data":500,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340144,"statfs":{"total":96636764160,"available":96604307456,"internally_reserved":0,"allocated":512000,"data_stored":201981,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574880,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32280,"kb_used_data":1092,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339560,"statfs":{"total":96636764160,"available":96603709440,"internally_reserved":0,"allocated":1118208,"data_stored":798613,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-17T05:44:11.783 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-17T05:44:11.783 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-09-17T05:44:11.941 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:11.940+0000 7fe549e0a640 1 -- 172.21.15.150:0/2526754866 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe52c004800 msgr2=0x7fe52c004c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:44:11.941 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:11.940+0000 7fe549e0a640 1 --2- 172.21.15.150:0/2526754866 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe52c004800 0x7fe52c004c10 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7fe538001690 tx=0x7fe52c005830 comp rx=0 tx=0).stop 2024-09-17T05:44:11.941 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:11.940+0000 7fe549e0a640 1 -- 172.21.15.150:0/2526754866 shutdown_connections 2024-09-17T05:44:11.942 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:11.940+0000 7fe549e0a640 1 --2- 172.21.15.150:0/2526754866 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe52c004800 0x7fe52c004c10 unknown :-1 s=CLOSED pgs=466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:11.942 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:11.940+0000 7fe549e0a640 1 -- 172.21.15.150:0/2526754866 >> 172.21.15.150:0/2526754866 conn(0x7fe5440b2ff0 msgr2=0x7fe5440b3400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:44:11.942 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:11.940+0000 7fe549e0a640 1 -- 172.21.15.150:0/2526754866 shutdown_connections 2024-09-17T05:44:11.942 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:11.940+0000 7fe549e0a640 1 -- 172.21.15.150:0/2526754866 wait complete. 2024-09-17T05:44:11.942 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:11.942+0000 7fe549e0a640 1 Processor -- start 2024-09-17T05:44:11.943 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:11.942+0000 7fe549e0a640 1 -- start start 2024-09-17T05:44:11.945 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:11.944+0000 7fe549e0a640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe52c004800 0x7fe5441f91e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:44:11.945 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:11.944+0000 7fe549e0a640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe5441f67e0 0x7fe5441d9af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:44:11.945 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:11.944+0000 7fe549e0a640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe54406cda0 0x7fe54406d1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:44:11.946 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:11.944+0000 7fe549e0a640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7fe5440b1830 con 0x7fe5441f67e0 2024-09-17T05:44:11.946 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:11.944+0000 7fe549e0a640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fe5440b16b0 con 0x7fe54406cda0 2024-09-17T05:44:11.946 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:11.944+0000 7fe549e0a640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fe5440cf7a0 con 0x7fe52c004800 2024-09-17T05:44:11.946 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:11.944+0000 7fe542ffd640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe5441f67e0 0x7fe5441d9af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:44:11.946 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:11.944+0000 7fe542ffd640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe5441f67e0 0x7fe5441d9af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:39850/0 (socket says 172.21.15.150:39850) 2024-09-17T05:44:11.946 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:11.944+0000 7fe542ffd640 1 -- 172.21.15.150:0/2883127272 learned_addr learned my addr 172.21.15.150:0/2883127272 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:44:11.946 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:11.944+0000 7fe5437fe640 1 --2- 172.21.15.150:0/2883127272 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe52c004800 0x7fe5441f91e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:44:11.946 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:11.944+0000 7fe543fff640 1 --2- 172.21.15.150:0/2883127272 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe54406cda0 0x7fe54406d1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:44:11.946 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:11.944+0000 7fe542ffd640 1 -- 172.21.15.150:0/2883127272 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe52c004800 msgr2=0x7fe5441f91e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:44:11.946 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:11.944+0000 7fe542ffd640 1 --2- 172.21.15.150:0/2883127272 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe52c004800 0x7fe5441f91e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:11.946 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:11.944+0000 7fe542ffd640 1 -- 172.21.15.150:0/2883127272 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe54406cda0 msgr2=0x7fe54406d1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:44:11.946 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:11.944+0000 7fe542ffd640 1 --2- 172.21.15.150:0/2883127272 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe54406cda0 0x7fe54406d1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:11.946 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:11.944+0000 7fe542ffd640 1 -- 172.21.15.150:0/2883127272 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe54406d6f0 con 0x7fe5441f67e0 2024-09-17T05:44:11.947 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:11.944+0000 7fe5437fe640 1 --2- 172.21.15.150:0/2883127272 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe52c004800 0x7fe5441f91e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:44:11.947 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:11.944+0000 7fe543fff640 1 --2- 172.21.15.150:0/2883127272 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe54406cda0 0x7fe54406d1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:44:11.947 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:11.944+0000 7fe542ffd640 1 --2- 172.21.15.150:0/2883127272 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe5441f67e0 0x7fe5441d9af0 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7fe5380017b0 tx=0x7fe5380063a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:44:11.947 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:11.944+0000 7fe52bfff640 1 -- 172.21.15.150:0/2883127272 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe538042070 con 0x7fe5441f67e0 2024-09-17T05:44:11.947 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:11.944+0000 7fe52bfff640 1 -- 172.21.15.150:0/2883127272 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe538039070 con 0x7fe5441f67e0 2024-09-17T05:44:11.947 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:11.944+0000 7fe549e0a640 1 -- 172.21.15.150:0/2883127272 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe5441fa060 con 0x7fe5441f67e0 2024-09-17T05:44:11.947 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:11.944+0000 7fe52bfff640 1 -- 172.21.15.150:0/2883127272 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe538003d90 con 0x7fe5441f67e0 2024-09-17T05:44:11.947 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:11.944+0000 7fe549e0a640 1 -- 172.21.15.150:0/2883127272 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe5441f9d80 con 0x7fe5441f67e0 2024-09-17T05:44:11.948 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:11.945+0000 7fe549e0a640 1 -- 172.21.15.150:0/2883127272 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe5441f9af0 con 0x7fe5441f67e0 2024-09-17T05:44:11.948 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:11.946+0000 7fe52bfff640 1 -- 172.21.15.150:0/2883127272 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 9) ==== 101747+0+0 (secure 0 0 0) 0x7fe53803b070 con 0x7fe5441f67e0 2024-09-17T05:44:11.948 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:11.947+0000 7fe52bfff640 1 --2- 172.21.15.150:0/2883127272 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fe530078f20 0x7fe53007b430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:44:11.948 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:11.947+0000 7fe52bfff640 1 -- 172.21.15.150:0/2883127272 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 5709+0+0 (secure 0 0 0) 0x7fe5380baad0 con 0x7fe5441f67e0 2024-09-17T05:44:11.948 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:11.947+0000 7fe5437fe640 1 --2- 172.21.15.150:0/2883127272 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fe530078f20 0x7fe53007b430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:44:11.948 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:11.947+0000 7fe5437fe640 1 --2- 172.21.15.150:0/2883127272 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fe530078f20 0x7fe53007b430 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fe534009cd0 tx=0x7fe534005f90 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:44:11.951 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:11.951+0000 7fe52bfff640 1 -- 172.21.15.150:0/2883127272 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fe54406d6f0 con 0x7fe5441f67e0 2024-09-17T05:44:12.195 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:12.195+0000 7fe549e0a640 1 -- 172.21.15.150:0/2883127272 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) -- 0x7fe5440cfc70 con 0x7fe5441f67e0 2024-09-17T05:44:12.198 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:12.197+0000 7fe52bfff640 1 -- 172.21.15.150:0/2883127272 <== mon.0 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v12) ==== 190+0+147 (secure 0 0 0) 0x7fe5380828f0 con 0x7fe5441f67e0 2024-09-17T05:44:12.198 INFO:teuthology.orchestra.run.smithi150.stdout:[client.0] 2024-09-17T05:44:12.198 INFO:teuthology.orchestra.run.smithi150.stdout: key = AQBoFulmfF/1HBAAMezEjZDeoHTJ+uFfDXNWHQ== 2024-09-17T05:44:12.198 INFO:teuthology.orchestra.run.smithi150.stdout: caps mds = "allow" 2024-09-17T05:44:12.198 INFO:teuthology.orchestra.run.smithi150.stdout: caps mon = "allow r" 2024-09-17T05:44:12.199 INFO:teuthology.orchestra.run.smithi150.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2024-09-17T05:44:12.199 INFO:teuthology.orchestra.run.smithi150.stderr:updated caps for client.0 2024-09-17T05:44:12.201 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:12.200+0000 7fe549e0a640 1 -- 172.21.15.150:0/2883127272 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fe530078f20 msgr2=0x7fe53007b430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:44:12.201 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:12.200+0000 7fe549e0a640 1 --2- 172.21.15.150:0/2883127272 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fe530078f20 0x7fe53007b430 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fe534009cd0 tx=0x7fe534005f90 comp rx=0 tx=0).stop 2024-09-17T05:44:12.201 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:12.200+0000 7fe549e0a640 1 -- 172.21.15.150:0/2883127272 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe5441f67e0 msgr2=0x7fe5441d9af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:44:12.201 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:12.200+0000 7fe549e0a640 1 --2- 172.21.15.150:0/2883127272 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe5441f67e0 0x7fe5441d9af0 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7fe5380017b0 tx=0x7fe5380063a0 comp rx=0 tx=0).stop 2024-09-17T05:44:12.201 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:12.200+0000 7fe549e0a640 1 -- 172.21.15.150:0/2883127272 shutdown_connections 2024-09-17T05:44:12.201 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:12.200+0000 7fe549e0a640 1 --2- 172.21.15.150:0/2883127272 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe54406cda0 0x7fe54406d1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:12.201 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:12.200+0000 7fe549e0a640 1 --2- 172.21.15.150:0/2883127272 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fe530078f20 0x7fe53007b430 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:12.201 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:12.200+0000 7fe549e0a640 1 --2- 172.21.15.150:0/2883127272 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe5441f67e0 0x7fe5441d9af0 unknown :-1 s=CLOSED pgs=467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:12.201 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:12.200+0000 7fe549e0a640 1 --2- 172.21.15.150:0/2883127272 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe52c004800 0x7fe5441f91e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:12.201 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:12.200+0000 7fe549e0a640 1 -- 172.21.15.150:0/2883127272 >> 172.21.15.150:0/2883127272 conn(0x7fe5440b2ff0 msgr2=0x7fe5440afb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:44:12.202 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:12.200+0000 7fe549e0a640 1 -- 172.21.15.150:0/2883127272 shutdown_connections 2024-09-17T05:44:12.202 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:12.200+0000 7fe549e0a640 1 -- 172.21.15.150:0/2883127272 wait complete. 2024-09-17T05:44:12.212 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T05:44:12.326 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:12.326+0000 7f3b88739640 1 -- 172.21.15.150:0/2189550639 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3b801654c0 msgr2=0x7f3b801678e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:44:12.326 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:12.326+0000 7f3b88739640 1 --2- 172.21.15.150:0/2189550639 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3b801654c0 0x7f3b801678e0 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f3b78005fd0 tx=0x7f3b7802aa90 comp rx=0 tx=0).stop 2024-09-17T05:44:12.326 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:12.326+0000 7f3b88739640 1 -- 172.21.15.150:0/2189550639 shutdown_connections 2024-09-17T05:44:12.327 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:12.326+0000 7f3b88739640 1 --2- 172.21.15.150:0/2189550639 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3b801654c0 0x7f3b801678e0 unknown :-1 s=CLOSED pgs=469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:12.327 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:12.326+0000 7f3b88739640 1 -- 172.21.15.150:0/2189550639 >> 172.21.15.150:0/2189550639 conn(0x7f3b800d0b50 msgr2=0x7f3b800d0f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:44:12.327 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:12.326+0000 7f3b88739640 1 -- 172.21.15.150:0/2189550639 shutdown_connections 2024-09-17T05:44:12.327 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:12.326+0000 7f3b88739640 1 -- 172.21.15.150:0/2189550639 wait complete. 2024-09-17T05:44:12.328 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:12.327+0000 7f3b88739640 1 Processor -- start 2024-09-17T05:44:12.328 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:12.327+0000 7f3b88739640 1 -- start start 2024-09-17T05:44:12.330 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:12.329+0000 7f3b88739640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3b800716f0 0x7f3b8013e650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:44:12.330 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:12.329+0000 7f3b88739640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3b8015d730 0x7f3b800cfa00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:44:12.331 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:12.329+0000 7f3b88739640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3b801654c0 0x7f3b800cff40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:44:12.331 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:12.329+0000 7f3b88739640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f3b80167fa0 con 0x7f3b8015d730 2024-09-17T05:44:12.331 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:12.329+0000 7f3b88739640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f3b80167e20 con 0x7f3b801654c0 2024-09-17T05:44:12.331 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:12.329+0000 7f3b88739640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f3b80168120 con 0x7f3b800716f0 2024-09-17T05:44:12.331 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:12.329+0000 7f3b85cd4640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3b8015d730 0x7f3b800cfa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:44:12.331 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:12.329+0000 7f3b85cd4640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3b8015d730 0x7f3b800cfa00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:39866/0 (socket says 172.21.15.150:39866) 2024-09-17T05:44:12.331 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:12.329+0000 7f3b85cd4640 1 -- 172.21.15.150:0/3147054340 learned_addr learned my addr 172.21.15.150:0/3147054340 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:44:12.331 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:12.329+0000 7f3b86cd6640 1 --2- 172.21.15.150:0/3147054340 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3b801654c0 0x7f3b800cff40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:44:12.331 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:12.329+0000 7f3b864d5640 1 --2- 172.21.15.150:0/3147054340 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3b800716f0 0x7f3b8013e650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:44:12.331 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:12.329+0000 7f3b85cd4640 1 -- 172.21.15.150:0/3147054340 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3b800716f0 msgr2=0x7f3b8013e650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:44:12.331 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:12.329+0000 7f3b85cd4640 1 --2- 172.21.15.150:0/3147054340 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3b800716f0 0x7f3b8013e650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:12.331 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:12.329+0000 7f3b85cd4640 1 -- 172.21.15.150:0/3147054340 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3b801654c0 msgr2=0x7f3b800cff40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:44:12.331 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:12.329+0000 7f3b85cd4640 1 --2- 172.21.15.150:0/3147054340 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3b801654c0 0x7f3b800cff40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:12.331 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:12.329+0000 7f3b85cd4640 1 -- 172.21.15.150:0/3147054340 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3b800cf680 con 0x7f3b8015d730 2024-09-17T05:44:12.331 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:12.329+0000 7f3b86cd6640 1 --2- 172.21.15.150:0/3147054340 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3b801654c0 0x7f3b800cff40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T05:44:12.332 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:12.329+0000 7f3b864d5640 1 --2- 172.21.15.150:0/3147054340 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3b800716f0 0x7f3b8013e650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T05:44:12.332 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:12.329+0000 7f3b85cd4640 1 --2- 172.21.15.150:0/3147054340 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3b8015d730 0x7f3b800cfa00 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f3b7000b440 tx=0x7f3b7000b900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:44:12.332 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:12.330+0000 7f3b76ffd640 1 -- 172.21.15.150:0/3147054340 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b70015020 con 0x7f3b8015d730 2024-09-17T05:44:12.332 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:12.330+0000 7f3b76ffd640 1 -- 172.21.15.150:0/3147054340 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f3b700119a0 con 0x7f3b8015d730 2024-09-17T05:44:12.332 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:12.330+0000 7f3b88739640 1 -- 172.21.15.150:0/3147054340 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3b800aeca0 con 0x7f3b8015d730 2024-09-17T05:44:12.332 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:12.330+0000 7f3b76ffd640 1 -- 172.21.15.150:0/3147054340 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b70011df0 con 0x7f3b8015d730 2024-09-17T05:44:12.332 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:12.330+0000 7f3b88739640 1 -- 172.21.15.150:0/3147054340 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3b800af260 con 0x7f3b8015d730 2024-09-17T05:44:12.333 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:12.331+0000 7f3b88739640 1 -- 172.21.15.150:0/3147054340 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3b80071b00 con 0x7f3b8015d730 2024-09-17T05:44:12.333 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:12.331+0000 7f3b76ffd640 1 -- 172.21.15.150:0/3147054340 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 9) ==== 101747+0+0 (secure 0 0 0) 0x7f3b70018020 con 0x7f3b8015d730 2024-09-17T05:44:12.333 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:12.332+0000 7f3b76ffd640 1 --2- 172.21.15.150:0/3147054340 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f3b64078f20 0x7f3b6407b430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:44:12.333 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:12.332+0000 7f3b76ffd640 1 -- 172.21.15.150:0/3147054340 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 5709+0+0 (secure 0 0 0) 0x7f3b7009b460 con 0x7f3b8015d730 2024-09-17T05:44:12.333 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:12.332+0000 7f3b864d5640 1 --2- 172.21.15.150:0/3147054340 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f3b64078f20 0x7f3b6407b430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:44:12.333 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:12.333+0000 7f3b864d5640 1 --2- 172.21.15.150:0/3147054340 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f3b64078f20 0x7f3b6407b430 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f3b80142fe0 tx=0x7f3b7c009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:44:12.337 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:12.336+0000 7f3b76ffd640 1 -- 172.21.15.150:0/3147054340 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f3b7001f020 con 0x7f3b8015d730 2024-09-17T05:44:12.549 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:12.548+0000 7f3b88739640 1 -- 172.21.15.150:0/3147054340 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f3b8015baf0 con 0x7f3b8015d730 2024-09-17T05:44:12.549 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:12.549+0000 7f3b76ffd640 1 -- 172.21.15.150:0/3147054340 <== mon.0 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) ==== 94+0+5235 (secure 0 0 0) 0x7f3b7000d040 con 0x7f3b8015d730 2024-09-17T05:44:12.550 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-09-17T05:44:12.550 INFO:teuthology.orchestra.run.smithi150.stdout:{"epoch":25,"btime":"2024-09-17T05:44:05:983657+0000","default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5278,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6836/1460864883","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6834","nonce":1460864883},{"type":"v1","addr":"172.21.15.176:6836","nonce":1460864883}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":20},{"gid":5281,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6837/3149402402","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6835","nonce":3149402402},{"type":"v1","addr":"172.21.15.176:6837","nonce":3149402402}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":20},{"gid":5469,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6833/3082315470","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6832","nonce":3082315470},{"type":"v1","addr":"172.21.15.150:6833","nonce":3082315470}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":19}],"filesystems":[{"mdsmap":{"epoch":25,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T05:44:02.308071+0000","modified":"2024-09-17T05:44:05.353165+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5472},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5472":{"gid":5472,"name":"c","rank":0,"incarnation":21,"state":"up:active","state_seq":3,"addr":"172.21.15.150:6835/1137907102","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6834","nonce":1137907102},{"type":"v1","addr":"172.21.15.150:6835","nonce":1137907102}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5472,"qdb_cluster":[5472]},"id":3}]} 2024-09-17T05:44:12.550 INFO:teuthology.orchestra.run.smithi150.stderr:dumped fsmap epoch 25 2024-09-17T05:44:12.552 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:12.551+0000 7f3b88739640 1 -- 172.21.15.150:0/3147054340 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f3b64078f20 msgr2=0x7f3b6407b430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:44:12.552 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:12.551+0000 7f3b88739640 1 --2- 172.21.15.150:0/3147054340 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f3b64078f20 0x7f3b6407b430 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f3b80142fe0 tx=0x7f3b7c009040 comp rx=0 tx=0).stop 2024-09-17T05:44:12.552 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:12.551+0000 7f3b88739640 1 -- 172.21.15.150:0/3147054340 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3b8015d730 msgr2=0x7f3b800cfa00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:44:12.552 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:12.551+0000 7f3b88739640 1 --2- 172.21.15.150:0/3147054340 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3b8015d730 0x7f3b800cfa00 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f3b7000b440 tx=0x7f3b7000b900 comp rx=0 tx=0).stop 2024-09-17T05:44:12.553 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:12.551+0000 7f3b88739640 1 -- 172.21.15.150:0/3147054340 shutdown_connections 2024-09-17T05:44:12.553 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:12.551+0000 7f3b88739640 1 --2- 172.21.15.150:0/3147054340 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3b801654c0 0x7f3b800cff40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:12.553 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:12.551+0000 7f3b88739640 1 --2- 172.21.15.150:0/3147054340 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f3b64078f20 0x7f3b6407b430 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:12.553 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:12.551+0000 7f3b88739640 1 --2- 172.21.15.150:0/3147054340 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3b8015d730 0x7f3b800cfa00 unknown :-1 s=CLOSED pgs=470 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:12.553 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:12.551+0000 7f3b88739640 1 --2- 172.21.15.150:0/3147054340 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3b800716f0 0x7f3b8013e650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:12.553 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:12.551+0000 7f3b88739640 1 -- 172.21.15.150:0/3147054340 >> 172.21.15.150:0/3147054340 conn(0x7f3b800d0b50 msgr2=0x7f3b800b08d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:44:12.553 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:12.551+0000 7f3b88739640 1 -- 172.21.15.150:0/3147054340 shutdown_connections 2024-09-17T05:44:12.553 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:12.552+0000 7f3b88739640 1 -- 172.21.15.150:0/3147054340 wait complete. 2024-09-17T05:44:12.966 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 25, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-17T05:44:02.308071+0000', 'modified': '2024-09-17T05:44:05.353165+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5472}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5472': {'gid': 5472, 'name': 'c', 'rank': 0, 'incarnation': 21, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.150:6835/1137907102', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.150:6834', 'nonce': 1137907102}, {'type': 'v1', 'addr': '172.21.15.150:6835', 'nonce': 1137907102}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [7], 'metadata_pool': 6, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 5472, 'qdb_cluster': [5472]} 2024-09-17T05:44:12.966 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-17T05:44:12.967 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2024-09-17T05:44:13.082 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:13.081+0000 7f8d8a830640 1 -- 172.21.15.150:0/3644520857 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8d84160f60 msgr2=0x7f8d840cd0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:44:13.082 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:13.081+0000 7f8d8a830640 1 --2- 172.21.15.150:0/3644520857 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8d84160f60 0x7f8d840cd0f0 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f8d84069f20 tx=0x7f8d7c02aa30 comp rx=0 tx=0).stop 2024-09-17T05:44:13.082 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:13.081+0000 7f8d8a830640 1 -- 172.21.15.150:0/3644520857 shutdown_connections 2024-09-17T05:44:13.082 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:13.081+0000 7f8d8a830640 1 --2- 172.21.15.150:0/3644520857 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8d84160f60 0x7f8d840cd0f0 unknown :-1 s=CLOSED pgs=471 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:13.082 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:13.081+0000 7f8d8a830640 1 --2- 172.21.15.150:0/3644520857 >> v2:172.21.15.176:3300/0 conn(0x7f8d840cea50 0x7f8d840d0270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:13.083 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:13.081+0000 7f8d8a830640 1 -- 172.21.15.150:0/3644520857 >> 172.21.15.150:0/3644520857 conn(0x7f8d840cee80 msgr2=0x7f8d840cf290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:44:13.083 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:13.081+0000 7f8d8a830640 1 -- 172.21.15.150:0/3644520857 shutdown_connections 2024-09-17T05:44:13.083 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:13.082+0000 7f8d8a830640 1 -- 172.21.15.150:0/3644520857 wait complete. 2024-09-17T05:44:13.083 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:13.083+0000 7f8d8a830640 1 Processor -- start 2024-09-17T05:44:13.084 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:13.083+0000 7f8d8a830640 1 -- start start 2024-09-17T05:44:13.087 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:13.085+0000 7f8d8a830640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8d840c5a90 0x7f8d840b2700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:44:13.087 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:13.085+0000 7f8d8a830640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8d840cea50 0x7f8d8414c130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:44:13.087 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:13.085+0000 7f8d8a830640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8d84160f60 0x7f8d841f6c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:44:13.087 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:13.085+0000 7f8d8a830640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f8d841614f0 con 0x7f8d840c5a90 2024-09-17T05:44:13.087 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:13.085+0000 7f8d8a830640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f8d84161370 con 0x7f8d84160f60 2024-09-17T05:44:13.087 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:13.085+0000 7f8d8a830640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f8d84161670 con 0x7f8d840cea50 2024-09-17T05:44:13.087 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:13.085+0000 7f8d83fff640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8d840c5a90 0x7f8d840b2700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:44:13.087 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:13.085+0000 7f8d83fff640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8d840c5a90 0x7f8d840b2700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:39886/0 (socket says 172.21.15.150:39886) 2024-09-17T05:44:13.087 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:13.085+0000 7f8d83fff640 1 -- 172.21.15.150:0/1812369677 learned_addr learned my addr 172.21.15.150:0/1812369677 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:44:13.087 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:13.085+0000 7f8d837fe640 1 --2- 172.21.15.150:0/1812369677 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8d840cea50 0x7f8d8414c130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:44:13.088 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:13.085+0000 7f8d88dcd640 1 --2- 172.21.15.150:0/1812369677 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8d84160f60 0x7f8d841f6c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:44:13.088 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:13.085+0000 7f8d83fff640 1 -- 172.21.15.150:0/1812369677 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8d840cea50 msgr2=0x7f8d8414c130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:44:13.088 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:13.085+0000 7f8d83fff640 1 --2- 172.21.15.150:0/1812369677 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8d840cea50 0x7f8d8414c130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:13.088 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:13.085+0000 7f8d83fff640 1 -- 172.21.15.150:0/1812369677 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8d84160f60 msgr2=0x7f8d841f6c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:44:13.088 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:13.085+0000 7f8d83fff640 1 --2- 172.21.15.150:0/1812369677 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8d84160f60 0x7f8d841f6c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:13.088 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:13.085+0000 7f8d83fff640 1 -- 172.21.15.150:0/1812369677 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8d8409e3f0 con 0x7f8d840c5a90 2024-09-17T05:44:13.088 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:13.085+0000 7f8d83fff640 1 --2- 172.21.15.150:0/1812369677 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8d840c5a90 0x7f8d840b2700 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f8d7400d720 tx=0x7f8d7400dbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:44:13.088 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:13.086+0000 7f8d80ff9640 1 -- 172.21.15.150:0/1812369677 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d74017070 con 0x7f8d840c5a90 2024-09-17T05:44:13.088 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:13.086+0000 7f8d80ff9640 1 -- 172.21.15.150:0/1812369677 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8d74009b30 con 0x7f8d840c5a90 2024-09-17T05:44:13.088 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:13.086+0000 7f8d8a830640 1 -- 172.21.15.150:0/1812369677 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8d8409e6d0 con 0x7f8d840c5a90 2024-09-17T05:44:13.088 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:13.086+0000 7f8d80ff9640 1 -- 172.21.15.150:0/1812369677 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d74010460 con 0x7f8d840c5a90 2024-09-17T05:44:13.088 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:13.086+0000 7f8d8a830640 1 -- 172.21.15.150:0/1812369677 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8d8414c670 con 0x7f8d840c5a90 2024-09-17T05:44:13.089 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:13.088+0000 7f8d80ff9640 1 -- 172.21.15.150:0/1812369677 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 9) ==== 101747+0+0 (secure 0 0 0) 0x7f8d7401a070 con 0x7f8d840c5a90 2024-09-17T05:44:13.089 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:13.088+0000 7f8d80ff9640 1 --2- 172.21.15.150:0/1812369677 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f8d70078ef0 0x7f8d7007b400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:44:13.090 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:13.088+0000 7f8d80ff9640 1 -- 172.21.15.150:0/1812369677 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 5709+0+0 (secure 0 0 0) 0x7f8d7409b5b0 con 0x7f8d840c5a90 2024-09-17T05:44:13.090 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:13.088+0000 7f8d837fe640 1 --2- 172.21.15.150:0/1812369677 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f8d70078ef0 0x7f8d7007b400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:44:13.090 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:13.089+0000 7f8d837fe640 1 --2- 172.21.15.150:0/1812369677 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f8d70078ef0 0x7f8d7007b400 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f8d840b6f10 tx=0x7f8d78009060 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:44:13.090 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:13.089+0000 7f8d91881740 1 Processor -- start 2024-09-17T05:44:13.090 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:13.089+0000 7f8d91881740 1 -- start start 2024-09-17T05:44:13.092 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:13.090+0000 7f8d91881740 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x56274be81270 0x56274c252fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:44:13.092 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:13.090+0000 7f8d91881740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x56274be583b0 0x56274c253500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:44:13.092 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:13.090+0000 7f8d91881740 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x56274be60590 0x56274c270400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:44:13.093 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:13.090+0000 7f8d91881740 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x56274c19b820 con 0x56274be81270 2024-09-17T05:44:13.093 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:13.090+0000 7f8d91881740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x56274c18ac50 con 0x56274be583b0 2024-09-17T05:44:13.093 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:13.090+0000 7f8d91881740 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x56274c18ea60 con 0x56274be60590 2024-09-17T05:44:13.093 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:13.090+0000 7f8d83fff640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x56274be81270 0x56274c252fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:44:13.093 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:13.090+0000 7f8d83fff640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x56274be81270 0x56274c252fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:39896/0 (socket says 172.21.15.150:39896) 2024-09-17T05:44:13.093 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:13.090+0000 7f8d83fff640 1 -- 172.21.15.150:0/4262385384 learned_addr learned my addr 172.21.15.150:0/4262385384 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:44:13.093 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:13.091+0000 7f8d837fe640 1 --2- 172.21.15.150:0/4262385384 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x56274be583b0 0x56274c253500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:44:13.093 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:13.091+0000 7f8d88dcd640 1 --2- 172.21.15.150:0/4262385384 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x56274be60590 0x56274c270400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:44:13.093 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:13.091+0000 7f8d83fff640 1 -- 172.21.15.150:0/4262385384 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x56274be60590 msgr2=0x56274c270400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:44:13.093 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:13.091+0000 7f8d83fff640 1 --2- 172.21.15.150:0/4262385384 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x56274be60590 0x56274c270400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:13.093 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:13.091+0000 7f8d83fff640 1 -- 172.21.15.150:0/4262385384 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x56274be583b0 msgr2=0x56274c253500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:44:13.093 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:13.091+0000 7f8d83fff640 1 --2- 172.21.15.150:0/4262385384 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x56274be583b0 0x56274c253500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:13.093 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:13.091+0000 7f8d83fff640 1 -- 172.21.15.150:0/4262385384 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56274beec850 con 0x56274be81270 2024-09-17T05:44:13.093 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:13.091+0000 7f8d837fe640 1 --2- 172.21.15.150:0/4262385384 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x56274be583b0 0x56274c253500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:44:13.094 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:13.091+0000 7f8d83fff640 1 --2- 172.21.15.150:0/4262385384 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x56274be81270 0x56274c252fc0 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f8d7405fff0 tx=0x7f8d74062620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2c3921a184ba0dd8 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:44:13.094 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:13.091+0000 7f8d69ffb640 1 -- 172.21.15.150:0/4262385384 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d74021040 con 0x56274be81270 2024-09-17T05:44:13.094 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:13.091+0000 7f8d69ffb640 1 -- 172.21.15.150:0/4262385384 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8d7406ae20 con 0x56274be81270 2024-09-17T05:44:13.094 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:13.091+0000 7f8d69ffb640 1 -- 172.21.15.150:0/4262385384 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d74062240 con 0x56274be81270 2024-09-17T05:44:13.094 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:13.092+0000 7f8d91881740 1 -- 172.21.15.150:0/4262385384 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x56274be81270 msgr2=0x56274c252fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:44:13.094 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:13.092+0000 7f8d91881740 1 --2- 172.21.15.150:0/4262385384 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x56274be81270 0x56274c252fc0 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f8d7405fff0 tx=0x7f8d74062620 comp rx=0 tx=0).stop 2024-09-17T05:44:13.094 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:13.092+0000 7f8d91881740 1 -- 172.21.15.150:0/4262385384 shutdown_connections 2024-09-17T05:44:13.094 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:13.092+0000 7f8d91881740 1 --2- 172.21.15.150:0/4262385384 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x56274be583b0 0x56274c253500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:13.094 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:13.092+0000 7f8d91881740 1 --2- 172.21.15.150:0/4262385384 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x56274be60590 0x56274c270400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:13.094 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:13.092+0000 7f8d91881740 1 --2- 172.21.15.150:0/4262385384 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x56274be81270 0x56274c252fc0 unknown :-1 s=CLOSED pgs=473 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:13.094 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:13.092+0000 7f8d91881740 1 -- 172.21.15.150:0/4262385384 >> 172.21.15.150:0/4262385384 conn(0x56274be753c0 msgr2=0x56274c229280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:44:13.094 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:13.092+0000 7f8d91881740 1 -- 172.21.15.150:0/4262385384 shutdown_connections 2024-09-17T05:44:13.094 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:13.092+0000 7f8d91881740 1 -- 172.21.15.150:0/4262385384 wait complete. 2024-09-17T05:44:13.099 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:13.093+0000 7f8d91881740 1 -- start start 2024-09-17T05:44:13.099 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:13.093+0000 7f8d91881740 1 Processor -- start 2024-09-17T05:44:13.099 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:13.094+0000 7f8d91881740 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x56274be583b0 0x56274c280330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:44:13.099 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:13.094+0000 7f8d91881740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x56274be60590 0x56274c270160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:44:13.099 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:13.094+0000 7f8d91881740 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x56274be81270 0x56274c2706a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:44:13.099 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:13.094+0000 7f8d91881740 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x56274befb620 con 0x56274be583b0 2024-09-17T05:44:13.099 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:13.094+0000 7f8d91881740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x56274c1305f0 con 0x56274be60590 2024-09-17T05:44:13.099 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:13.094+0000 7f8d91881740 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x56274c253a40 con 0x56274be81270 2024-09-17T05:44:13.099 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:13.094+0000 7f8d91881740 10 client.0 _ll_register_callbacks cb 0x56274c1340a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T05:44:13.099 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:13.094+0000 7f8d83fff640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x56274be583b0 0x56274c280330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:44:13.099 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:13.094+0000 7f8d83fff640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x56274be583b0 0x56274c280330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:39906/0 (socket says 172.21.15.150:39906) 2024-09-17T05:44:13.099 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:13.094+0000 7f8d83fff640 1 -- 172.21.15.150:0/3063345101 learned_addr learned my addr 172.21.15.150:0/3063345101 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:44:13.100 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:13.094+0000 7f8d88dcd640 1 --2- 172.21.15.150:0/3063345101 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x56274be81270 0x56274c2706a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:44:13.100 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:13.094+0000 7f8d837fe640 1 --2- 172.21.15.150:0/3063345101 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x56274be60590 0x56274c270160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:44:13.100 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:13.095+0000 7f8d83fff640 1 -- 172.21.15.150:0/3063345101 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x56274be81270 msgr2=0x56274c2706a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:44:13.100 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:13.095+0000 7f8d83fff640 1 --2- 172.21.15.150:0/3063345101 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x56274be81270 0x56274c2706a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:13.100 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:13.095+0000 7f8d83fff640 1 -- 172.21.15.150:0/3063345101 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x56274be60590 msgr2=0x56274c270160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:44:13.100 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:13.095+0000 7f8d83fff640 1 --2- 172.21.15.150:0/3063345101 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x56274be60590 0x56274c270160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:13.100 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:13.095+0000 7f8d83fff640 1 -- 172.21.15.150:0/3063345101 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56274bf636b0 con 0x56274be583b0 2024-09-17T05:44:13.100 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:13.095+0000 7f8d83fff640 1 --2- 172.21.15.150:0/3063345101 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x56274be583b0 0x56274c280330 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f8d7405fff0 tx=0x7f8d74062210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f0a56fce380c8486 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:44:13.100 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:13.095+0000 7f8d62ffd640 10 client.0 ms_handle_connect on v2:172.21.15.150:3300/0 2024-09-17T05:44:13.100 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:13.095+0000 7f8d62ffd640 1 -- 172.21.15.150:0/3063345101 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d74021070 con 0x56274be583b0 2024-09-17T05:44:13.100 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:13.095+0000 7f8d62ffd640 1 -- 172.21.15.150:0/3063345101 <== mon.0 v2:172.21.15.150:3300/0 2 ==== osd_map(45..45 src has 1..45) ==== 5709+0+0 (secure 0 0 0) 0x7f8d7409b2d0 con 0x56274be583b0 2024-09-17T05:44:13.100 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:13.095+0000 7f8d91881740 1 -- 172.21.15.150:0/3063345101 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8d7406ae20 con 0x56274be583b0 2024-09-17T05:44:13.100 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:13.095+0000 7f8d62ffd640 1 -- 172.21.15.150:0/3063345101 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f8d74089120 con 0x56274be583b0 2024-09-17T05:44:13.100 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:13.095+0000 7f8d91881740 10 client.5604 fetch_fsmap learned FSMap version 25 2024-09-17T05:44:13.101 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:13.095+0000 7f8d91881740 1 -- 172.21.15.150:0/3063345101 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=2+}) -- 0x56274c2660a0 con 0x56274be583b0 2024-09-17T05:44:13.101 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:13.095+0000 7f8d62ffd640 1 -- 172.21.15.150:0/3063345101 <== mon.0 v2:172.21.15.150:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8d7406ae20 con 0x56274be583b0 2024-09-17T05:44:13.101 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:13.095+0000 7f8d62ffd640 1 -- 172.21.15.150:0/3063345101 <== mon.0 v2:172.21.15.150:3300/0 5 ==== fsmap(e 25) ==== 3502+0+0 (secure 0 0 0) 0x7f8d7405e6d0 con 0x56274be583b0 2024-09-17T05:44:13.101 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:13.095+0000 7f8d91881740 10 client.5604 fetch_fsmap finished waiting for FSMap version 25 2024-09-17T05:44:13.101 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:13.095+0000 7f8d91881740 10 client.5604 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-17T05:44:13.101 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:13.095+0000 7f8d91881740 20 client.5604 populate_metadata read hostname 'smithi150' 2024-09-17T05:44:13.101 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:13.095+0000 7f8d91881740 1 --2- 172.21.15.150:0/3063345101 >> [v2:172.21.15.150:6834/1137907102,v1:172.21.15.150:6835/1137907102] conn(0x56274be3fe40 0x56274c2665c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:44:13.101 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:13.095+0000 7f8d91881740 4 client.5604 mds_command: new command op to 5472 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-17T05:44:13.101 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:13.095+0000 7f8d91881740 1 -- 172.21.15.150:0/3063345101 --> [v2:172.21.15.150:6834/1137907102,v1:172.21.15.150:6835/1137907102] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56274c19d770 con 0x56274be3fe40 2024-09-17T05:44:13.101 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:13.096+0000 7f8d837fe640 1 --2- 172.21.15.150:0/3063345101 >> [v2:172.21.15.150:6834/1137907102,v1:172.21.15.150:6835/1137907102] conn(0x56274be3fe40 0x56274c2665c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:44:13.101 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:13.096+0000 7f8d62ffd640 10 client.5604 ms_handle_connect on v2:172.21.15.150:6834/1137907102 2024-09-17T05:44:13.101 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:13.096+0000 7f8d837fe640 1 --2- 172.21.15.150:0/3063345101 >> [v2:172.21.15.150:6834/1137907102,v1:172.21.15.150:6835/1137907102] conn(0x56274be3fe40 0x56274c2665c0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9a3eb8312e64fc92 server_cookie=ed1a376273ef2f51 in_seq=0 out_seq=0 2024-09-17T05:44:13.101 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:13.097+0000 7f8d62ffd640 1 -- 172.21.15.150:0/3063345101 <== mds.0 v2:172.21.15.150:6834/1137907102 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x56274c19d770 con 0x56274be3fe40 2024-09-17T05:44:13.102 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:13.097+0000 7f8d62ffd640 10 client.5604 handle_command_reply: tid=0 2024-09-17T05:44:13.102 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:13.097+0000 7f8d91881740 1 client.5604 shutdown 2024-09-17T05:44:13.102 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:13.097+0000 7f8d91881740 1 -- 172.21.15.150:0/3063345101 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x56274be583b0 msgr2=0x56274c280330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:44:13.102 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:13.097+0000 7f8d91881740 1 --2- 172.21.15.150:0/3063345101 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x56274be583b0 0x56274c280330 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f8d7405fff0 tx=0x7f8d74062210 comp rx=0 tx=0).stop 2024-09-17T05:44:13.102 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:13.097+0000 7f8d91881740 1 -- 172.21.15.150:0/3063345101 shutdown_connections 2024-09-17T05:44:13.102 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:13.097+0000 7f8d91881740 1 --2- 172.21.15.150:0/3063345101 >> [v2:172.21.15.150:6834/1137907102,v1:172.21.15.150:6835/1137907102] conn(0x56274be3fe40 0x56274c2665c0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:13.102 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:13.097+0000 7f8d91881740 1 --2- 172.21.15.150:0/3063345101 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x56274be60590 0x56274c270160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:13.102 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:13.097+0000 7f8d62ffd640 0 client.5604 ms_handle_reset on v2:172.21.15.150:6834/1137907102 2024-09-17T05:44:13.102 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:13.097+0000 7f8d91881740 1 --2- 172.21.15.150:0/3063345101 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x56274be81270 0x56274c2706a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:13.102 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:13.097+0000 7f8d91881740 1 --2- 172.21.15.150:0/3063345101 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x56274be583b0 0x56274c280330 unknown :-1 s=CLOSED pgs=474 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:13.102 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:13.097+0000 7f8d91881740 1 -- 172.21.15.150:0/3063345101 >> 172.21.15.150:0/3063345101 conn(0x56274be753c0 msgr2=0x56274c26f9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:44:13.102 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:13.097+0000 7f8d91881740 1 -- 172.21.15.150:0/3063345101 shutdown_connections 2024-09-17T05:44:13.102 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:13.097+0000 7f8d91881740 1 -- 172.21.15.150:0/3063345101 wait complete. 2024-09-17T05:44:13.103 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:13.097+0000 7f8d91881740 20 client.5604 trim_cache size 0 max 16384 2024-09-17T05:44:13.116 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:13.116+0000 7f8d91881740 1 Processor -- start 2024-09-17T05:44:13.116 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:13.116+0000 7f8d91881740 1 -- start start 2024-09-17T05:44:13.118 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:13.117+0000 7f8d91881740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x56274be583b0 0x56274c229360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:44:13.118 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:13.117+0000 7f8d91881740 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x56274be60590 0x56274c2298a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:44:13.118 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:13.117+0000 7f8d91881740 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x56274be81270 0x56274c2857f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:44:13.118 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:13.117+0000 7f8d91881740 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f8d841ff290 con 0x56274be81270 2024-09-17T05:44:13.118 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:13.117+0000 7f8d91881740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f8d841f4460 con 0x56274be583b0 2024-09-17T05:44:13.118 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:13.117+0000 7f8d91881740 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f8d8409f910 con 0x56274be60590 2024-09-17T05:44:13.118 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:13.117+0000 7f8d88dcd640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x56274be81270 0x56274c2857f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:44:13.118 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:13.117+0000 7f8d88dcd640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x56274be81270 0x56274c2857f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:39914/0 (socket says 172.21.15.150:39914) 2024-09-17T05:44:13.118 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:13.117+0000 7f8d88dcd640 1 -- 172.21.15.150:0/3750460685 learned_addr learned my addr 172.21.15.150:0/3750460685 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:44:13.119 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:13.117+0000 7f8d88dcd640 1 -- 172.21.15.150:0/3750460685 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x56274be60590 msgr2=0x56274c2298a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:44:13.119 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:13.117+0000 7f8d88dcd640 1 --2- 172.21.15.150:0/3750460685 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x56274be60590 0x56274c2298a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:13.119 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:13.117+0000 7f8d83fff640 1 --2- 172.21.15.150:0/3750460685 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x56274be583b0 0x56274c229360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:44:13.119 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:13.117+0000 7f8d88dcd640 1 -- 172.21.15.150:0/3750460685 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x56274be583b0 msgr2=0x56274c229360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:44:13.119 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:13.117+0000 7f8d88dcd640 1 --2- 172.21.15.150:0/3750460685 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x56274be583b0 0x56274c229360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:13.119 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:13.117+0000 7f8d88dcd640 1 -- 172.21.15.150:0/3750460685 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56274c26a2d0 con 0x56274be81270 2024-09-17T05:44:13.119 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:13.117+0000 7f8d88dcd640 1 --2- 172.21.15.150:0/3750460685 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x56274be81270 0x56274c2857f0 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f8d7c005fd0 tx=0x7f8d7c004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b0c2acc136af754a server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:44:13.119 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:13.118+0000 7f8d697fa640 1 -- 172.21.15.150:0/3750460685 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d7c033040 con 0x56274be81270 2024-09-17T05:44:13.119 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:13.118+0000 7f8d697fa640 1 -- 172.21.15.150:0/3750460685 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8d7c02fc40 con 0x56274be81270 2024-09-17T05:44:13.119 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:13.118+0000 7f8d697fa640 1 -- 172.21.15.150:0/3750460685 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d7c003bd0 con 0x56274be81270 2024-09-17T05:44:13.120 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:13.118+0000 7f8d91881740 1 -- 172.21.15.150:0/3750460685 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x56274be81270 msgr2=0x56274c2857f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:44:13.120 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:13.118+0000 7f8d91881740 1 --2- 172.21.15.150:0/3750460685 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x56274be81270 0x56274c2857f0 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f8d7c005fd0 tx=0x7f8d7c004ab0 comp rx=0 tx=0).stop 2024-09-17T05:44:13.120 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:13.118+0000 7f8d91881740 1 -- 172.21.15.150:0/3750460685 shutdown_connections 2024-09-17T05:44:13.120 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:13.118+0000 7f8d91881740 1 --2- 172.21.15.150:0/3750460685 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x56274be81270 0x56274c2857f0 unknown :-1 s=CLOSED pgs=475 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:13.120 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:13.118+0000 7f8d91881740 1 --2- 172.21.15.150:0/3750460685 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x56274be60590 0x56274c2298a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:13.121 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:13.118+0000 7f8d91881740 1 --2- 172.21.15.150:0/3750460685 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x56274be583b0 0x56274c229360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:13.121 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:13.118+0000 7f8d91881740 1 -- 172.21.15.150:0/3750460685 >> 172.21.15.150:0/3750460685 conn(0x56274be753c0 msgr2=0x56274c234e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:44:13.121 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:13.118+0000 7f8d91881740 1 -- 172.21.15.150:0/3750460685 shutdown_connections 2024-09-17T05:44:13.121 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:13.118+0000 7f8d91881740 1 -- 172.21.15.150:0/3750460685 wait complete. 2024-09-17T05:44:13.121 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:13.119+0000 7f8d91881740 1 -- start start 2024-09-17T05:44:13.121 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:13.119+0000 7f8d91881740 1 Processor -- start 2024-09-17T05:44:13.125 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:13.121+0000 7f8d91881740 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x56274be583b0 0x56274c2d3d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:44:13.125 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:13.121+0000 7f8d91881740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x56274be60590 0x56274c2d6ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:44:13.125 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:13.121+0000 7f8d91881740 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x56274be81270 0x56274c264bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:44:13.125 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:13.121+0000 7f8d91881740 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x56274c267640 con 0x56274be583b0 2024-09-17T05:44:13.125 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:13.121+0000 7f8d91881740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x56274befb620 con 0x56274be60590 2024-09-17T05:44:13.125 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:13.121+0000 7f8d91881740 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x56274c2356f0 con 0x56274be81270 2024-09-17T05:44:13.125 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:13.121+0000 7f8d91881740 10 client.0 _ll_register_callbacks cb 0x7f8d740624f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T05:44:13.125 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:13.121+0000 7f8d83fff640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x56274be583b0 0x56274c2d3d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:44:13.125 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:13.121+0000 7f8d83fff640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x56274be583b0 0x56274c2d3d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:39926/0 (socket says 172.21.15.150:39926) 2024-09-17T05:44:13.125 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:13.121+0000 7f8d83fff640 1 -- 172.21.15.150:0/1950481881 learned_addr learned my addr 172.21.15.150:0/1950481881 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:44:13.126 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:13.121+0000 7f8d83fff640 1 -- 172.21.15.150:0/1950481881 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x56274be81270 msgr2=0x56274c264bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:44:13.126 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:13.121+0000 7f8d83fff640 1 --2- 172.21.15.150:0/1950481881 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x56274be81270 0x56274c264bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:13.126 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:13.121+0000 7f8d83fff640 1 -- 172.21.15.150:0/1950481881 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x56274be60590 msgr2=0x56274c2d6ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:44:13.126 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:13.121+0000 7f8d837fe640 1 --2- 172.21.15.150:0/1950481881 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x56274be60590 0x56274c2d6ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:44:13.126 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:13.121+0000 7f8d83fff640 1 --2- 172.21.15.150:0/1950481881 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x56274be60590 0x56274c2d6ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:13.126 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:13.121+0000 7f8d83fff640 1 -- 172.21.15.150:0/1950481881 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56274c2f61f0 con 0x56274be583b0 2024-09-17T05:44:13.126 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:13.121+0000 7f8d83fff640 1 --2- 172.21.15.150:0/1950481881 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x56274be583b0 0x56274c2d3d60 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f8d7409b850 tx=0x7f8d7405f200 comp rx=0 tx=0).ready entity=mon.0 client_cookie=181f8bc51da49057 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:44:13.126 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:13.121+0000 7f8d62ffd640 10 client.0 ms_handle_connect on v2:172.21.15.150:3300/0 2024-09-17T05:44:13.126 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:13.122+0000 7f8d62ffd640 1 -- 172.21.15.150:0/1950481881 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d74021040 con 0x56274be583b0 2024-09-17T05:44:13.126 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:13.122+0000 7f8d62ffd640 1 -- 172.21.15.150:0/1950481881 <== mon.0 v2:172.21.15.150:3300/0 2 ==== osd_map(45..45 src has 1..45) ==== 5709+0+0 (secure 0 0 0) 0x7f8d7404e1b0 con 0x56274be583b0 2024-09-17T05:44:13.126 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:13.122+0000 7f8d91881740 1 -- 172.21.15.150:0/1950481881 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8d7c02fc40 con 0x56274be583b0 2024-09-17T05:44:13.126 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:13.122+0000 7f8d62ffd640 1 -- 172.21.15.150:0/1950481881 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f8d7407d020 con 0x56274be583b0 2024-09-17T05:44:13.126 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:13.122+0000 7f8d91881740 10 client.5610 fetch_fsmap learned FSMap version 25 2024-09-17T05:44:13.126 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:13.122+0000 7f8d91881740 1 -- 172.21.15.150:0/1950481881 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=2+}) -- 0x56274c290b20 con 0x56274be583b0 2024-09-17T05:44:13.127 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:13.122+0000 7f8d62ffd640 1 -- 172.21.15.150:0/1950481881 <== mon.0 v2:172.21.15.150:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8d7c02fc40 con 0x56274be583b0 2024-09-17T05:44:13.127 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:13.122+0000 7f8d62ffd640 1 -- 172.21.15.150:0/1950481881 <== mon.0 v2:172.21.15.150:3300/0 5 ==== fsmap(e 25) ==== 3502+0+0 (secure 0 0 0) 0x7f8d74061a50 con 0x56274be583b0 2024-09-17T05:44:13.127 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:13.122+0000 7f8d91881740 10 client.5610 fetch_fsmap finished waiting for FSMap version 25 2024-09-17T05:44:13.127 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:13.122+0000 7f8d91881740 10 client.5610 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-17T05:44:13.127 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:13.122+0000 7f8d91881740 20 client.5610 populate_metadata read hostname 'smithi150' 2024-09-17T05:44:13.127 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:13.122+0000 7f8d91881740 1 --2- 172.21.15.150:0/1950481881 >> [v2:172.21.15.150:6834/1137907102,v1:172.21.15.150:6835/1137907102] conn(0x56274c229720 0x56274c252c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:44:13.127 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:13.122+0000 7f8d91881740 4 client.5610 mds_command: new command op to 5472 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-17T05:44:13.127 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:13.122+0000 7f8d91881740 1 -- 172.21.15.150:0/1950481881 --> [v2:172.21.15.150:6834/1137907102,v1:172.21.15.150:6835/1137907102] -- command(tid 0: {"prefix": "status"}) -- 0x56274c21ef00 con 0x56274c229720 2024-09-17T05:44:13.127 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:13.122+0000 7f8d837fe640 1 --2- 172.21.15.150:0/1950481881 >> [v2:172.21.15.150:6834/1137907102,v1:172.21.15.150:6835/1137907102] conn(0x56274c229720 0x56274c252c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:44:13.127 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:13.122+0000 7f8d62ffd640 10 client.5610 ms_handle_connect on v2:172.21.15.150:6834/1137907102 2024-09-17T05:44:13.127 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:13.123+0000 7f8d837fe640 1 --2- 172.21.15.150:0/1950481881 >> [v2:172.21.15.150:6834/1137907102,v1:172.21.15.150:6835/1137907102] conn(0x56274c229720 0x56274c252c60 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=255d210974d412df server_cookie=66f2bc5c788f7a15 in_seq=0 out_seq=0 2024-09-17T05:44:13.127 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:13.123+0000 7f8d62ffd640 1 -- 172.21.15.150:0/1950481881 <== mds.0 v2:172.21.15.150:6834/1137907102 1 ==== command_reply(tid 0: 0 ) ==== 8+0+318 (crc 0 0 0) 0x56274c21ef00 con 0x56274c229720 2024-09-17T05:44:13.127 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:13.123+0000 7f8d62ffd640 10 client.5610 handle_command_reply: tid=0 2024-09-17T05:44:13.128 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:13.123+0000 7f8d91881740 1 client.5610 shutdown 2024-09-17T05:44:13.128 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:13.123+0000 7f8d91881740 1 -- 172.21.15.150:0/1950481881 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x56274be583b0 msgr2=0x56274c2d3d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:44:13.128 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:13.123+0000 7f8d91881740 1 --2- 172.21.15.150:0/1950481881 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x56274be583b0 0x56274c2d3d60 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f8d7409b850 tx=0x7f8d7405f200 comp rx=0 tx=0).stop 2024-09-17T05:44:13.128 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:13.123+0000 7f8d91881740 1 -- 172.21.15.150:0/1950481881 shutdown_connections 2024-09-17T05:44:13.128 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:13.123+0000 7f8d91881740 1 --2- 172.21.15.150:0/1950481881 >> [v2:172.21.15.150:6834/1137907102,v1:172.21.15.150:6835/1137907102] conn(0x56274c229720 0x56274c252c60 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:13.128 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:13.123+0000 7f8d91881740 1 --2- 172.21.15.150:0/1950481881 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x56274be60590 0x56274c2d6ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:13.128 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:13.123+0000 7f8d91881740 1 --2- 172.21.15.150:0/1950481881 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x56274be81270 0x56274c264bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:13.128 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:13.123+0000 7f8d62ffd640 0 client.5610 ms_handle_reset on v2:172.21.15.150:6834/1137907102 2024-09-17T05:44:13.128 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:13.123+0000 7f8d91881740 1 --2- 172.21.15.150:0/1950481881 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x56274be583b0 0x56274c2d3d60 unknown :-1 s=CLOSED pgs=476 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:13.128 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:13.123+0000 7f8d91881740 1 -- 172.21.15.150:0/1950481881 >> 172.21.15.150:0/1950481881 conn(0x56274be753c0 msgr2=0x56274c267a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:44:13.128 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:13.123+0000 7f8d91881740 1 -- 172.21.15.150:0/1950481881 shutdown_connections 2024-09-17T05:44:13.129 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:13.123+0000 7f8d91881740 1 -- 172.21.15.150:0/1950481881 wait complete. 2024-09-17T05:44:13.129 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:13.123+0000 7f8d91881740 20 client.5610 trim_cache size 0 max 16384 2024-09-17T05:44:13.129 INFO:teuthology.orchestra.run.smithi150.stdout:{ 2024-09-17T05:44:13.129 INFO:teuthology.orchestra.run.smithi150.stdout: "cluster_fsid": "9f2e05e9-d629-47b3-b26b-1360655b7d20", 2024-09-17T05:44:13.129 INFO:teuthology.orchestra.run.smithi150.stdout: "whoami": 0, 2024-09-17T05:44:13.129 INFO:teuthology.orchestra.run.smithi150.stdout: "id": 5472, 2024-09-17T05:44:13.129 INFO:teuthology.orchestra.run.smithi150.stdout: "want_state": "up:active", 2024-09-17T05:44:13.129 INFO:teuthology.orchestra.run.smithi150.stdout: "state": "up:active", 2024-09-17T05:44:13.130 INFO:teuthology.orchestra.run.smithi150.stdout: "fs_name": "cephfs", 2024-09-17T05:44:13.130 INFO:teuthology.orchestra.run.smithi150.stdout: "rank_uptime": 10.160123612, 2024-09-17T05:44:13.130 INFO:teuthology.orchestra.run.smithi150.stdout: "mdsmap_epoch": 25, 2024-09-17T05:44:13.130 INFO:teuthology.orchestra.run.smithi150.stdout: "osdmap_epoch": 45, 2024-09-17T05:44:13.130 INFO:teuthology.orchestra.run.smithi150.stdout: "osdmap_epoch_barrier": 45, 2024-09-17T05:44:13.130 INFO:teuthology.orchestra.run.smithi150.stdout: "uptime": 14.84837295 2024-09-17T05:44:13.130 INFO:teuthology.orchestra.run.smithi150.stdout:} 2024-09-17T05:44:13.131 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:13.124+0000 7f8d8a830640 1 -- 172.21.15.150:0/1812369677 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f8d70078ef0 msgr2=0x7f8d7007b400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:44:13.131 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:13.124+0000 7f8d8a830640 1 --2- 172.21.15.150:0/1812369677 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f8d70078ef0 0x7f8d7007b400 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f8d840b6f10 tx=0x7f8d78009060 comp rx=0 tx=0).stop 2024-09-17T05:44:13.131 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:13.124+0000 7f8d8a830640 1 -- 172.21.15.150:0/1812369677 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8d840c5a90 msgr2=0x7f8d840b2700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:44:13.131 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:13.124+0000 7f8d8a830640 1 --2- 172.21.15.150:0/1812369677 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8d840c5a90 0x7f8d840b2700 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f8d7400d720 tx=0x7f8d7400dbe0 comp rx=0 tx=0).stop 2024-09-17T05:44:13.131 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:13.124+0000 7f8d8a830640 1 -- 172.21.15.150:0/1812369677 shutdown_connections 2024-09-17T05:44:13.131 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:13.124+0000 7f8d8a830640 1 --2- 172.21.15.150:0/1812369677 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8d84160f60 0x7f8d841f6c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:13.131 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:13.124+0000 7f8d8a830640 1 --2- 172.21.15.150:0/1812369677 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f8d70078ef0 0x7f8d7007b400 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:13.132 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:13.124+0000 7f8d8a830640 1 --2- 172.21.15.150:0/1812369677 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8d840cea50 0x7f8d8414c130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:13.132 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:13.124+0000 7f8d8a830640 1 --2- 172.21.15.150:0/1812369677 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8d840c5a90 0x7f8d840b2700 unknown :-1 s=CLOSED pgs=472 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:13.132 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:13.124+0000 7f8d8a830640 1 -- 172.21.15.150:0/1812369677 >> 172.21.15.150:0/1812369677 conn(0x7f8d840cee80 msgr2=0x7f8d84072710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:44:13.132 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:13.124+0000 7f8d8a830640 1 -- 172.21.15.150:0/1812369677 shutdown_connections 2024-09-17T05:44:13.132 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:13.124+0000 7f8d8a830640 1 -- 172.21.15.150:0/1812369677 wait complete. 2024-09-17T05:44:13.136 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-17T05:44:13.250 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:13.249+0000 7fbbc01b0640 1 -- 172.21.15.150:0/3767426099 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbbb80b5d50 msgr2=0x7fbbb80d2780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:44:13.250 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:13.249+0000 7fbbc01b0640 1 --2- 172.21.15.150:0/3767426099 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbbb80b5d50 0x7fbbb80d2780 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7fbbb808d3a0 tx=0x7fbba802a560 comp rx=0 tx=0).stop 2024-09-17T05:44:13.250 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:13.249+0000 7fbbc01b0640 1 -- 172.21.15.150:0/3767426099 shutdown_connections 2024-09-17T05:44:13.250 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:13.249+0000 7fbbc01b0640 1 --2- 172.21.15.150:0/3767426099 >> v2:172.21.15.176:3300/0 conn(0x7fbbb80d4f90 0x7fbbb80d0400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:13.251 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:13.249+0000 7fbbc01b0640 1 --2- 172.21.15.150:0/3767426099 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbbb80b5d50 0x7fbbb80d2780 unknown :-1 s=CLOSED pgs=477 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:13.251 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:13.249+0000 7fbbc01b0640 1 -- 172.21.15.150:0/3767426099 >> 172.21.15.150:0/3767426099 conn(0x7fbbb808bfe0 msgr2=0x7fbbb80d4670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:44:13.251 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:13.249+0000 7fbbc01b0640 1 -- 172.21.15.150:0/3767426099 shutdown_connections 2024-09-17T05:44:13.251 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:13.249+0000 7fbbc01b0640 1 -- 172.21.15.150:0/3767426099 wait complete. 2024-09-17T05:44:13.251 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:13.251+0000 7fbbc01b0640 1 Processor -- start 2024-09-17T05:44:13.251 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:13.251+0000 7fbbc01b0640 1 -- start start 2024-09-17T05:44:13.254 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:13.252+0000 7fbbc01b0640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbbb80b5d50 0x7fbbb8147250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:44:13.254 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:13.252+0000 7fbbc01b0640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fbbb80d1080 0x7fbbb8147790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:44:13.254 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:13.252+0000 7fbbc01b0640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fbbb80d4f90 0x7fbbb80b41e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:44:13.254 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:13.252+0000 7fbbc01b0640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7fbbb80b7aa0 con 0x7fbbb80b5d50 2024-09-17T05:44:13.255 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:13.252+0000 7fbbc01b0640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fbbb80b7920 con 0x7fbbb80d1080 2024-09-17T05:44:13.255 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:13.252+0000 7fbbc01b0640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fbbb80b7c20 con 0x7fbbb80d4f90 2024-09-17T05:44:13.255 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:13.252+0000 7fbbbdf4c640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbbb80b5d50 0x7fbbb8147250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:44:13.255 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:13.253+0000 7fbbbdf4c640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbbb80b5d50 0x7fbbb8147250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:39932/0 (socket says 172.21.15.150:39932) 2024-09-17T05:44:13.255 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:13.253+0000 7fbbbdf4c640 1 -- 172.21.15.150:0/625319320 learned_addr learned my addr 172.21.15.150:0/625319320 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:44:13.255 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:13.253+0000 7fbbbd74b640 1 --2- 172.21.15.150:0/625319320 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fbbb80d1080 0x7fbbb8147790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:44:13.255 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:13.253+0000 7fbbbe74d640 1 --2- 172.21.15.150:0/625319320 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fbbb80d4f90 0x7fbbb80b41e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:44:13.255 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:13.253+0000 7fbbbdf4c640 1 -- 172.21.15.150:0/625319320 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fbbb80d4f90 msgr2=0x7fbbb80b41e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:44:13.255 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:13.253+0000 7fbbbdf4c640 1 --2- 172.21.15.150:0/625319320 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fbbb80d4f90 0x7fbbb80b41e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:13.255 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:13.253+0000 7fbbbdf4c640 1 -- 172.21.15.150:0/625319320 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fbbb80d1080 msgr2=0x7fbbb8147790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:44:13.255 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:13.253+0000 7fbbbdf4c640 1 --2- 172.21.15.150:0/625319320 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fbbb80d1080 0x7fbbb8147790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:13.255 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:13.253+0000 7fbbbdf4c640 1 -- 172.21.15.150:0/625319320 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbbb8157da0 con 0x7fbbb80b5d50 2024-09-17T05:44:13.255 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:13.253+0000 7fbbbdf4c640 1 --2- 172.21.15.150:0/625319320 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbbb80b5d50 0x7fbbb8147250 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7fbba8034040 tx=0x7fbba80039e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:44:13.256 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:13.253+0000 7fbbb67fc640 1 -- 172.21.15.150:0/625319320 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbba803e030 con 0x7fbbb80b5d50 2024-09-17T05:44:13.256 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:13.253+0000 7fbbb67fc640 1 -- 172.21.15.150:0/625319320 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fbba80047a0 con 0x7fbbb80b5d50 2024-09-17T05:44:13.256 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:13.253+0000 7fbbc01b0640 1 -- 172.21.15.150:0/625319320 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbbb8158080 con 0x7fbbb80b5d50 2024-09-17T05:44:13.256 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:13.253+0000 7fbbb67fc640 1 -- 172.21.15.150:0/625319320 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbba8035040 con 0x7fbbb80b5d50 2024-09-17T05:44:13.256 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:13.253+0000 7fbbc01b0640 1 -- 172.21.15.150:0/625319320 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbbb81e92b0 con 0x7fbbb80b5d50 2024-09-17T05:44:13.257 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:13.254+0000 7fbbc01b0640 1 -- 172.21.15.150:0/625319320 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbbb80b51d0 con 0x7fbbb80b5d50 2024-09-17T05:44:13.257 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:13.255+0000 7fbbb67fc640 1 -- 172.21.15.150:0/625319320 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 9) ==== 101747+0+0 (secure 0 0 0) 0x7fbba8041030 con 0x7fbbb80b5d50 2024-09-17T05:44:13.257 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:13.256+0000 7fbbb67fc640 1 --2- 172.21.15.150:0/625319320 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fbba4078f20 0x7fbba407b430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:44:13.257 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:13.256+0000 7fbbb67fc640 1 -- 172.21.15.150:0/625319320 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 5709+0+0 (secure 0 0 0) 0x7fbba80bbdd0 con 0x7fbbb80b5d50 2024-09-17T05:44:13.257 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:13.256+0000 7fbbbd74b640 1 --2- 172.21.15.150:0/625319320 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fbba4078f20 0x7fbba407b430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:44:13.257 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:13.257+0000 7fbbbd74b640 1 --2- 172.21.15.150:0/625319320 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fbba4078f20 0x7fbba407b430 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fbbb806e570 tx=0x7fbbac00b2e0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:44:13.260 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:13.259+0000 7fbbb67fc640 1 -- 172.21.15.150:0/625319320 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fbba8083830 con 0x7fbbb80b5d50 2024-09-17T05:44:13.469 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:13.468+0000 7fbbc01b0640 1 -- 172.21.15.150:0/625319320 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7fbbb80d2d60 con 0x7fbbb80b5d50 2024-09-17T05:44:13.469 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:13.469+0000 7fbbb67fc640 1 -- 172.21.15.150:0/625319320 <== mon.0 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v25) ==== 53+0+73 (secure 0 0 0) 0x7fbba80bb020 con 0x7fbbb80b5d50 2024-09-17T05:44:13.469 INFO:teuthology.orchestra.run.smithi150.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-17T05:44:13.472 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:13.471+0000 7fbbc01b0640 1 -- 172.21.15.150:0/625319320 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fbba4078f20 msgr2=0x7fbba407b430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:44:13.472 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:13.471+0000 7fbbc01b0640 1 --2- 172.21.15.150:0/625319320 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fbba4078f20 0x7fbba407b430 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fbbb806e570 tx=0x7fbbac00b2e0 comp rx=0 tx=0).stop 2024-09-17T05:44:13.472 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:13.471+0000 7fbbc01b0640 1 -- 172.21.15.150:0/625319320 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbbb80b5d50 msgr2=0x7fbbb8147250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:44:13.472 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:13.471+0000 7fbbc01b0640 1 --2- 172.21.15.150:0/625319320 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbbb80b5d50 0x7fbbb8147250 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7fbba8034040 tx=0x7fbba80039e0 comp rx=0 tx=0).stop 2024-09-17T05:44:13.472 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:13.471+0000 7fbbc01b0640 1 -- 172.21.15.150:0/625319320 shutdown_connections 2024-09-17T05:44:13.472 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:13.471+0000 7fbbc01b0640 1 --2- 172.21.15.150:0/625319320 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fbbb80d1080 0x7fbbb8147790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:13.472 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:13.471+0000 7fbbc01b0640 1 --2- 172.21.15.150:0/625319320 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fbba4078f20 0x7fbba407b430 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:13.473 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:13.471+0000 7fbbc01b0640 1 --2- 172.21.15.150:0/625319320 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fbbb80d4f90 0x7fbbb80b41e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:13.473 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:13.471+0000 7fbbc01b0640 1 --2- 172.21.15.150:0/625319320 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbbb80b5d50 0x7fbbb8147250 unknown :-1 s=CLOSED pgs=478 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:13.473 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:13.471+0000 7fbbc01b0640 1 -- 172.21.15.150:0/625319320 >> 172.21.15.150:0/625319320 conn(0x7fbbb808bfe0 msgr2=0x7fbbb806eb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:44:13.473 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:13.471+0000 7fbbc01b0640 1 -- 172.21.15.150:0/625319320 shutdown_connections 2024-09-17T05:44:13.473 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:13.471+0000 7fbbc01b0640 1 -- 172.21.15.150:0/625319320 wait complete. 2024-09-17T05:44:13.483 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-09-17T05:44:13.483 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-17T05:44:13.483 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi150.front.sepia.ceph.com 2024-09-17T05:44:13.483 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-17T05:44:13.483 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-17T05:44:13.483 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-09-17T05:44:13.483 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-09-17T05:44:13.484 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-17T05:44:13.484 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-17T05:44:13.484 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:44:13.484 DEBUG:teuthology.orchestra.run.smithi150:> ip addr 2024-09-17T05:44:13.501 INFO:teuthology.orchestra.run.smithi150.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-17T05:44:13.501 INFO:teuthology.orchestra.run.smithi150.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-17T05:44:13.501 INFO:teuthology.orchestra.run.smithi150.stdout: inet 127.0.0.1/8 scope host lo 2024-09-17T05:44:13.501 INFO:teuthology.orchestra.run.smithi150.stdout: valid_lft forever preferred_lft forever 2024-09-17T05:44:13.501 INFO:teuthology.orchestra.run.smithi150.stdout: inet6 ::1/128 scope host 2024-09-17T05:44:13.501 INFO:teuthology.orchestra.run.smithi150.stdout: valid_lft forever preferred_lft forever 2024-09-17T05:44:13.501 INFO:teuthology.orchestra.run.smithi150.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-17T05:44:13.502 INFO:teuthology.orchestra.run.smithi150.stdout: link/ether 0c:c4:7a:d9:da:bc brd ff:ff:ff:ff:ff:ff 2024-09-17T05:44:13.502 INFO:teuthology.orchestra.run.smithi150.stdout: altname enp7s0f0 2024-09-17T05:44:13.502 INFO:teuthology.orchestra.run.smithi150.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-17T05:44:13.502 INFO:teuthology.orchestra.run.smithi150.stdout: link/ether 0c:c4:7a:d9:da:bd brd ff:ff:ff:ff:ff:ff 2024-09-17T05:44:13.502 INFO:teuthology.orchestra.run.smithi150.stdout: altname enp7s0f1 2024-09-17T05:44:13.502 INFO:teuthology.orchestra.run.smithi150.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-17T05:44:13.502 INFO:teuthology.orchestra.run.smithi150.stdout: link/ether 0c:c4:7a:88:6e:34 brd ff:ff:ff:ff:ff:ff 2024-09-17T05:44:13.502 INFO:teuthology.orchestra.run.smithi150.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-17T05:44:13.502 INFO:teuthology.orchestra.run.smithi150.stdout: link/ether 0c:c4:7a:88:6e:35 brd ff:ff:ff:ff:ff:ff 2024-09-17T05:44:13.502 INFO:teuthology.orchestra.run.smithi150.stdout: inet 172.21.15.150/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-09-17T05:44:13.502 INFO:teuthology.orchestra.run.smithi150.stdout: valid_lft 42661sec preferred_lft 42661sec 2024-09-17T05:44:13.502 INFO:teuthology.orchestra.run.smithi150.stdout: inet6 fe80::ec4:7aff:fe88:6e35/64 scope link noprefixroute 2024-09-17T05:44:13.502 INFO:teuthology.orchestra.run.smithi150.stdout: valid_lft forever preferred_lft forever 2024-09-17T05:44:13.503 INFO:teuthology.orchestra.run.smithi150.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-17T05:44:13.503 INFO:teuthology.orchestra.run.smithi150.stdout: link/ether 1a:d2:4c:31:46:82 brd ff:ff:ff:ff:ff:ff 2024-09-17T05:44:13.503 INFO:teuthology.orchestra.run.smithi150.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-17T05:44:13.503 INFO:teuthology.orchestra.run.smithi150.stdout: valid_lft forever preferred_lft forever 2024-09-17T05:44:13.503 INFO:teuthology.orchestra.run.smithi150.stdout: inet6 fe80::70b6:c6ff:fe60:62a2/64 scope link 2024-09-17T05:44:13.503 INFO:teuthology.orchestra.run.smithi150.stdout: valid_lft forever preferred_lft forever 2024-09-17T05:44:13.503 INFO:teuthology.orchestra.run.smithi150.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-17T05:44:13.503 INFO:teuthology.orchestra.run.smithi150.stdout: link/ether 32:e1:8b:37:8c:b3 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-17T05:44:13.503 INFO:teuthology.orchestra.run.smithi150.stdout: inet6 fe80::30e1:8bff:fe37:8cb3/64 scope link 2024-09-17T05:44:13.503 INFO:teuthology.orchestra.run.smithi150.stdout: valid_lft forever preferred_lft forever 2024-09-17T05:44:13.504 INFO:teuthology.orchestra.run.smithi150.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-17T05:44:13.504 INFO:teuthology.orchestra.run.smithi150.stdout: link/ether 1a:d2:4c:31:46:82 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-17T05:44:13.504 INFO:teuthology.orchestra.run.smithi150.stdout: inet6 fe80::18d2:4cff:fe31:4682/64 scope link 2024-09-17T05:44:13.504 INFO:teuthology.orchestra.run.smithi150.stdout: valid_lft forever preferred_lft forever 2024-09-17T05:44:13.504 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:44:13.504 DEBUG:teuthology.orchestra.run.smithi150:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-17T05:44:13.565 INFO:teuthology.orchestra.run.smithi150.stdout:1 2024-09-17T05:44:13.567 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:44:13.567 DEBUG:teuthology.orchestra.run.smithi150:> route 2024-09-17T05:44:13.623 INFO:teuthology.orchestra.run.smithi150.stdout:Kernel IP routing table 2024-09-17T05:44:13.623 INFO:teuthology.orchestra.run.smithi150.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-17T05:44:13.623 INFO:teuthology.orchestra.run.smithi150.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-17T05:44:13.623 INFO:teuthology.orchestra.run.smithi150.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-17T05:44:13.623 INFO:teuthology.orchestra.run.smithi150.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-17T05:44:13.623 DEBUG:teuthology.orchestra.run.smithi150:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-17T05:44:13.624 DEBUG:teuthology.orchestra.run.smithi150:> set -e 2024-09-17T05:44:13.624 DEBUG:teuthology.orchestra.run.smithi150:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-17T05:44:13.624 DEBUG:teuthology.orchestra.run.smithi150:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-17T05:44:13.624 DEBUG:teuthology.orchestra.run.smithi150:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-17T05:44:13.624 DEBUG:teuthology.orchestra.run.smithi150:> ') 2024-09-17T05:44:13.711 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:13 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-17T05:44:13.743 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:13 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T05:44:13.749 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:44:13.750 DEBUG:teuthology.orchestra.run.smithi150:> ip netns list 2024-09-17T05:44:13.765 INFO:teuthology.orchestra.run.smithi150.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-09-17T05:44:13.765 INFO:teuthology.orchestra.run.smithi150.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-17T05:44:13.765 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-17T05:44:13.765 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:44:13.765 DEBUG:teuthology.orchestra.run.smithi150:> sudo ip link set brx.0 up 2024-09-17T05:44:13.830 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-17T05:44:13.830 DEBUG:teuthology.orchestra.run.smithi150:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-17T05:44:13.886 INFO:teuthology.orchestra.run.smithi150.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-17T05:44:13.887 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-17T05:44:13.887 DEBUG:teuthology.orchestra.run.smithi150:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-17T05:44:13.941 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-09-17T05:44:13.942 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:44:13.942 DEBUG:teuthology.orchestra.run.smithi150:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-17T05:44:14.036 INFO:teuthology.orchestra.run.smithi150.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-17T05:44:14.036 INFO:teuthology.orchestra.run.smithi150.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-17T05:44:14.036 INFO:teuthology.orchestra.run.smithi150.stdout:invalid new device string format 2024-09-17T05:44:14.047 INFO:teuthology.orchestra.run.smithi150.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-17T05:44:14.047 INFO:teuthology.orchestra.run.smithi150.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-17T05:44:14.047 INFO:teuthology.orchestra.run.smithi150.stdout:invalid new device string format 2024-09-17T05:44:14.047 INFO:teuthology.orchestra.run.smithi150.stdout:mount.ceph: resolved to: "172.21.15.150:3300,172.21.15.176:3300,172.21.15.176:3301" 2024-09-17T05:44:14.047 INFO:teuthology.orchestra.run.smithi150.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-17T05:44:14.054 INFO:teuthology.orchestra.run.smithi150.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-17T05:44:14.054 INFO:teuthology.orchestra.run.smithi150.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-17T05:44:14.054 INFO:teuthology.orchestra.run.smithi150.stdout:invalid new device string format 2024-09-17T05:44:14.054 INFO:teuthology.orchestra.run.smithi150.stdout:mount.ceph: resolved to: "172.21.15.150:3300,172.21.15.176:3300,172.21.15.176:3301" 2024-09-17T05:44:14.054 INFO:teuthology.orchestra.run.smithi150.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-17T05:44:14.054 INFO:teuthology.orchestra.run.smithi150.stdout:mount.ceph: resolved to: "172.21.15.150:6789,172.21.15.176:6789,172.21.15.176:6790" 2024-09-17T05:44:14.054 INFO:teuthology.orchestra.run.smithi150.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.150:6789,172.21.15.176:6789,172.21.15.176:6790:/ 2024-09-17T05:44:14.054 INFO:teuthology.orchestra.run.smithi150.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=9f2e05e9-d629-47b3-b26b-1360655b7d20" will pass to kernel 2024-09-17T05:44:14.055 INFO:teuthology.orchestra.run.smithi150.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-09-17T05:44:14.055 INFO:teuthology.orchestra.run.smithi150.stdout: You just mounted a file system that supports labels which does not 2024-09-17T05:44:14.055 INFO:teuthology.orchestra.run.smithi150.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-09-17T05:44:14.055 INFO:teuthology.orchestra.run.smithi150.stdout: applications will generate AVC messages and not be allowed access to 2024-09-17T05:44:14.055 INFO:teuthology.orchestra.run.smithi150.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-09-17T05:44:14.057 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-17T05:44:14.057 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:44:14.057 DEBUG:teuthology.orchestra.run.smithi150:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-17T05:44:14.082 DEBUG:teuthology.orchestra.run.smithi150:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-17T05:44:14.172 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:14 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-17T05:44:14.177 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:14 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T05:44:14.183 INFO:teuthology.orchestra.run.smithi150.stdout:client5078 2024-09-17T05:44:14.184 DEBUG:teuthology.orchestra.run.smithi150:> set -ex 2024-09-17T05:44:14.184 DEBUG:teuthology.orchestra.run.smithi150:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T05:44:14.199 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs flag set enable_multiple true --yes-i-really-mean-it 2024-09-17T05:44:14.358 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:14.357+0000 7efe9b151640 1 -- 172.21.15.150:0/1882678742 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7efe9415ba50 msgr2=0x7efe940b3120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:44:14.358 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:14.357+0000 7efe9b151640 1 --2- 172.21.15.150:0/1882678742 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7efe9415ba50 0x7efe940b3120 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7efe88005fd0 tx=0x7efe8802a4b0 comp rx=0 tx=0).stop 2024-09-17T05:44:14.358 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:14.357+0000 7efe9b151640 1 -- 172.21.15.150:0/1882678742 shutdown_connections 2024-09-17T05:44:14.358 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:14.357+0000 7efe9b151640 1 --2- 172.21.15.150:0/1882678742 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7efe940b36f0 0x7efe940cb930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:14.358 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:14.357+0000 7efe9b151640 1 --2- 172.21.15.150:0/1882678742 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7efe9415ba50 0x7efe940b3120 unknown :-1 s=CLOSED pgs=480 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:14.358 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:14.357+0000 7efe9b151640 1 -- 172.21.15.150:0/1882678742 >> 172.21.15.150:0/1882678742 conn(0x7efe940b2540 msgr2=0x7efe940d02d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:44:14.358 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:14.357+0000 7efe9b151640 1 -- 172.21.15.150:0/1882678742 shutdown_connections 2024-09-17T05:44:14.358 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:14.357+0000 7efe9b151640 1 -- 172.21.15.150:0/1882678742 wait complete. 2024-09-17T05:44:14.359 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:14.359+0000 7efe9b151640 1 Processor -- start 2024-09-17T05:44:14.359 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:14.359+0000 7efe9b151640 1 -- start start 2024-09-17T05:44:14.362 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:14.360+0000 7efe9b151640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7efe940b36f0 0x7efe941f5960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:44:14.362 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:14.360+0000 7efe9b151640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7efe940cc7d0 0x7efe941f5ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:44:14.362 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:14.360+0000 7efe9b151640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7efe9415ba50 0x7efe941f63e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:44:14.362 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:14.360+0000 7efe9b151640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7efe9406f8a0 con 0x7efe940cc7d0 2024-09-17T05:44:14.362 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:14.360+0000 7efe9b151640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7efe9406f720 con 0x7efe940b36f0 2024-09-17T05:44:14.362 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:14.360+0000 7efe9b151640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7efe9406fa20 con 0x7efe9415ba50 2024-09-17T05:44:14.362 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:14.360+0000 7efe93fff640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7efe940cc7d0 0x7efe941f5ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:44:14.362 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:14.360+0000 7efe93fff640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7efe940cc7d0 0x7efe941f5ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:39950/0 (socket says 172.21.15.150:39950) 2024-09-17T05:44:14.362 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:14.360+0000 7efe93fff640 1 -- 172.21.15.150:0/3614310575 learned_addr learned my addr 172.21.15.150:0/3614310575 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:44:14.362 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:14.360+0000 7efe996ee640 1 --2- 172.21.15.150:0/3614310575 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7efe9415ba50 0x7efe941f63e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:44:14.363 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:14.360+0000 7efe98eed640 1 --2- 172.21.15.150:0/3614310575 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7efe940b36f0 0x7efe941f5960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:44:14.363 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:14.360+0000 7efe93fff640 1 -- 172.21.15.150:0/3614310575 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7efe9415ba50 msgr2=0x7efe941f63e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:44:14.363 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:14.360+0000 7efe93fff640 1 --2- 172.21.15.150:0/3614310575 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7efe9415ba50 0x7efe941f63e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:14.363 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:14.360+0000 7efe93fff640 1 -- 172.21.15.150:0/3614310575 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7efe940b36f0 msgr2=0x7efe941f5960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:44:14.363 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:14.360+0000 7efe93fff640 1 --2- 172.21.15.150:0/3614310575 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7efe940b36f0 0x7efe941f5960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:14.363 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:14.360+0000 7efe93fff640 1 -- 172.21.15.150:0/3614310575 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efe9409a470 con 0x7efe940cc7d0 2024-09-17T05:44:14.363 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:14.361+0000 7efe93fff640 1 --2- 172.21.15.150:0/3614310575 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7efe940cc7d0 0x7efe941f5ea0 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7efe88006010 tx=0x7efe880038a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:44:14.363 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:14.361+0000 7efe917fa640 1 -- 172.21.15.150:0/3614310575 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe8803e030 con 0x7efe940cc7d0 2024-09-17T05:44:14.363 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:14.361+0000 7efe917fa640 1 -- 172.21.15.150:0/3614310575 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7efe88003d90 con 0x7efe940cc7d0 2024-09-17T05:44:14.363 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:14.361+0000 7efe917fa640 1 -- 172.21.15.150:0/3614310575 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe88035040 con 0x7efe940cc7d0 2024-09-17T05:44:14.363 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:14.361+0000 7efe9b151640 1 -- 172.21.15.150:0/3614310575 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efe941586f0 con 0x7efe940cc7d0 2024-09-17T05:44:14.363 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:14.361+0000 7efe9b151640 1 -- 172.21.15.150:0/3614310575 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efe94158cb0 con 0x7efe940cc7d0 2024-09-17T05:44:14.364 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:14.362+0000 7efe9b151640 1 -- 172.21.15.150:0/3614310575 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efe9406fef0 con 0x7efe940cc7d0 2024-09-17T05:44:14.364 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:14.363+0000 7efe917fa640 1 -- 172.21.15.150:0/3614310575 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 9) ==== 101747+0+0 (secure 0 0 0) 0x7efe88041030 con 0x7efe940cc7d0 2024-09-17T05:44:14.364 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:14.363+0000 7efe917fa640 1 --2- 172.21.15.150:0/3614310575 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7efe80078f20 0x7efe8007b430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:44:14.364 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:14.364+0000 7efe917fa640 1 -- 172.21.15.150:0/3614310575 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 5709+0+0 (secure 0 0 0) 0x7efe880bb9e0 con 0x7efe940cc7d0 2024-09-17T05:44:14.365 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:14.364+0000 7efe98eed640 1 --2- 172.21.15.150:0/3614310575 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7efe80078f20 0x7efe8007b430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:44:14.365 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:14.364+0000 7efe98eed640 1 --2- 172.21.15.150:0/3614310575 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7efe80078f20 0x7efe8007b430 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7efe84001720 tx=0x7efe84009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:44:14.369 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:14.368+0000 7efe917fa640 1 -- 172.21.15.150:0/3614310575 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7efe88083340 con 0x7efe940cc7d0 2024-09-17T05:44:14.583 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:14.582+0000 7efe9b151640 1 -- 172.21.15.150:0/3614310575 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "fs flag set", "flag_name": "enable_multiple", "val": "true", "yes_i_really_mean_it": true} v 0) -- 0x7efe94074a70 con 0x7efe940cc7d0 2024-09-17T05:44:15.207 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:15.206+0000 7efe917fa640 1 -- 172.21.15.150:0/3614310575 <== mon.0 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "fs flag set", "flag_name": "enable_multiple", "val": "true", "yes_i_really_mean_it": true}]=0 v26) ==== 136+0+0 (secure 0 0 0) 0x7efe88087d70 con 0x7efe940cc7d0 2024-09-17T05:44:15.210 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:15.209+0000 7efe9b151640 1 -- 172.21.15.150:0/3614310575 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7efe80078f20 msgr2=0x7efe8007b430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:44:15.210 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:15.209+0000 7efe9b151640 1 --2- 172.21.15.150:0/3614310575 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7efe80078f20 0x7efe8007b430 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7efe84001720 tx=0x7efe84009040 comp rx=0 tx=0).stop 2024-09-17T05:44:15.210 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:15.209+0000 7efe9b151640 1 -- 172.21.15.150:0/3614310575 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7efe940cc7d0 msgr2=0x7efe941f5ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:44:15.210 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:15.209+0000 7efe9b151640 1 --2- 172.21.15.150:0/3614310575 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7efe940cc7d0 0x7efe941f5ea0 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7efe88006010 tx=0x7efe880038a0 comp rx=0 tx=0).stop 2024-09-17T05:44:15.210 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:15.209+0000 7efe9b151640 1 -- 172.21.15.150:0/3614310575 shutdown_connections 2024-09-17T05:44:15.211 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:15.209+0000 7efe9b151640 1 --2- 172.21.15.150:0/3614310575 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7efe80078f20 0x7efe8007b430 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:15.211 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:15.209+0000 7efe9b151640 1 --2- 172.21.15.150:0/3614310575 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7efe9415ba50 0x7efe941f63e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:15.211 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:15.209+0000 7efe9b151640 1 --2- 172.21.15.150:0/3614310575 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7efe940cc7d0 0x7efe941f5ea0 unknown :-1 s=CLOSED pgs=481 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:15.211 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:15.209+0000 7efe9b151640 1 --2- 172.21.15.150:0/3614310575 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7efe940b36f0 0x7efe941f5960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:15.211 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:15.209+0000 7efe9b151640 1 -- 172.21.15.150:0/3614310575 >> 172.21.15.150:0/3614310575 conn(0x7efe940b2540 msgr2=0x7efe940cb2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:44:15.211 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:15.210+0000 7efe9b151640 1 -- 172.21.15.150:0/3614310575 shutdown_connections 2024-09-17T05:44:15.211 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:15.210+0000 7efe9b151640 1 -- 172.21.15.150:0/3614310575 wait complete. 2024-09-17T05:44:15.223 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume ls 2024-09-17T05:44:15.339 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:15.338+0000 7f920c2ce640 1 -- 172.21.15.150:0/729056065 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9204160f60 msgr2=0x7f92040cd0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:44:15.339 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:15.338+0000 7f920c2ce640 1 --2- 172.21.15.150:0/729056065 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9204160f60 0x7f92040cd0f0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f91fc005fd0 tx=0x7f91fc02a8b0 comp rx=0 tx=0).stop 2024-09-17T05:44:15.339 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:15.338+0000 7f920c2ce640 1 -- 172.21.15.150:0/729056065 shutdown_connections 2024-09-17T05:44:15.339 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:15.338+0000 7f920c2ce640 1 --2- 172.21.15.150:0/729056065 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9204160f60 0x7f92040cd0f0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:15.340 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:15.338+0000 7f920c2ce640 1 --2- 172.21.15.150:0/729056065 >> v2:172.21.15.176:3300/0 conn(0x7f92040cea50 0x7f92040d0270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:15.340 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:15.338+0000 7f920c2ce640 1 -- 172.21.15.150:0/729056065 >> 172.21.15.150:0/729056065 conn(0x7f92040cee80 msgr2=0x7f92040cf290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:44:15.340 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:15.338+0000 7f920c2ce640 1 -- 172.21.15.150:0/729056065 shutdown_connections 2024-09-17T05:44:15.340 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:15.338+0000 7f920c2ce640 1 -- 172.21.15.150:0/729056065 wait complete. 2024-09-17T05:44:15.340 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:15.340+0000 7f920c2ce640 1 Processor -- start 2024-09-17T05:44:15.340 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:15.340+0000 7f920c2ce640 1 -- start start 2024-09-17T05:44:15.343 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:15.341+0000 7f920c2ce640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f92040c5a90 0x7f92041f40d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:44:15.343 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:15.341+0000 7f920c2ce640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f92040cea50 0x7f92040cbe30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:44:15.343 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:15.341+0000 7f920c2ce640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9204160f60 0x7f92041f6bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:44:15.343 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:15.341+0000 7f920c2ce640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f92041614f0 con 0x7f9204160f60 2024-09-17T05:44:15.343 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:15.341+0000 7f920c2ce640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f9204161370 con 0x7f92040c5a90 2024-09-17T05:44:15.343 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:15.341+0000 7f920c2ce640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f9204161670 con 0x7f92040cea50 2024-09-17T05:44:15.343 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:15.341+0000 7f920a86b640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9204160f60 0x7f92041f6bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:44:15.343 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:15.341+0000 7f920a86b640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9204160f60 0x7f92041f6bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:39952/0 (socket says 172.21.15.150:39952) 2024-09-17T05:44:15.343 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:15.341+0000 7f920a86b640 1 -- 172.21.15.150:0/2966442526 learned_addr learned my addr 172.21.15.150:0/2966442526 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:44:15.344 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:15.341+0000 7f920a06a640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f92040c5a90 0x7f92041f40d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:44:15.344 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:15.341+0000 7f9209869640 1 --2- 172.21.15.150:0/2966442526 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f92040cea50 0x7f92040cbe30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:44:15.344 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:15.342+0000 7f920a86b640 1 -- 172.21.15.150:0/2966442526 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f92040cea50 msgr2=0x7f92040cbe30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:44:15.344 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:15.342+0000 7f920a86b640 1 --2- 172.21.15.150:0/2966442526 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f92040cea50 0x7f92040cbe30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:15.344 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:15.342+0000 7f920a86b640 1 -- 172.21.15.150:0/2966442526 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f92040c5a90 msgr2=0x7f92041f40d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:44:15.344 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:15.342+0000 7f920a86b640 1 --2- 172.21.15.150:0/2966442526 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f92040c5a90 0x7f92041f40d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:15.344 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:15.342+0000 7f920a86b640 1 -- 172.21.15.150:0/2966442526 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f92040b19f0 con 0x7f9204160f60 2024-09-17T05:44:15.344 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:15.342+0000 7f9209869640 1 --2- 172.21.15.150:0/2966442526 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f92040cea50 0x7f92040cbe30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T05:44:15.344 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:15.342+0000 7f920a06a640 1 --2- 172.21.15.150:0/2966442526 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f92040c5a90 0x7f92041f40d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T05:44:15.344 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:15.342+0000 7f920a86b640 1 --2- 172.21.15.150:0/2966442526 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9204160f60 0x7f92041f6bb0 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f91fc02aea0 tx=0x7f91fc033f70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:44:15.344 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:15.342+0000 7f91faffd640 1 -- 172.21.15.150:0/2966442526 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91fc031990 con 0x7f9204160f60 2024-09-17T05:44:15.344 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:15.342+0000 7f91faffd640 1 -- 172.21.15.150:0/2966442526 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f91fc031c20 con 0x7f9204160f60 2024-09-17T05:44:15.344 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:15.342+0000 7f91faffd640 1 -- 172.21.15.150:0/2966442526 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91fc033070 con 0x7f9204160f60 2024-09-17T05:44:15.345 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:15.342+0000 7f920c2ce640 1 -- 172.21.15.150:0/2966442526 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f92040b1cd0 con 0x7f9204160f60 2024-09-17T05:44:15.345 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:15.342+0000 7f920c2ce640 1 -- 172.21.15.150:0/2966442526 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f92040b2290 con 0x7f9204160f60 2024-09-17T05:44:15.346 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:15.343+0000 7f920c2ce640 1 -- 172.21.15.150:0/2966442526 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f92040d0270 con 0x7f9204160f60 2024-09-17T05:44:15.346 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:15.344+0000 7f91faffd640 1 -- 172.21.15.150:0/2966442526 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 9) ==== 101747+0+0 (secure 0 0 0) 0x7f91fc033210 con 0x7f9204160f60 2024-09-17T05:44:15.346 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:15.344+0000 7f91faffd640 1 --2- 172.21.15.150:0/2966442526 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f91e8078ef0 0x7f91e807b400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:44:15.346 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:15.345+0000 7f91faffd640 1 -- 172.21.15.150:0/2966442526 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 5709+0+0 (secure 0 0 0) 0x7f91fc0bc620 con 0x7f9204160f60 2024-09-17T05:44:15.346 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:15.345+0000 7f920a06a640 1 --2- 172.21.15.150:0/2966442526 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f91e8078ef0 0x7f91e807b400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:44:15.346 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:15.345+0000 7f920a06a640 1 --2- 172.21.15.150:0/2966442526 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f91e8078ef0 0x7f91e807b400 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f9200009660 tx=0x7f92000091e0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:44:15.349 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:15.349+0000 7f91faffd640 1 -- 172.21.15.150:0/2966442526 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f91fc03f030 con 0x7f9204160f60 2024-09-17T05:44:15.547 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:15.547+0000 7f920c2ce640 1 -- 172.21.15.150:0/2966442526 --> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] -- mgr_command(tid 0: {"prefix": "fs volume ls", "target": ["mon-mgr", ""]}) -- 0x7f92040b1780 con 0x7f91e8078ef0 2024-09-17T05:44:15.549 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:15.549+0000 7f91faffd640 1 -- 172.21.15.150:0/2966442526 <== mgr.4108 v2:172.21.15.176:6800/3631216395 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+41 (secure 0 0 0) 0x7f92040b1780 con 0x7f91e8078ef0 2024-09-17T05:44:15.550 INFO:teuthology.orchestra.run.smithi150.stdout:[ 2024-09-17T05:44:15.550 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-09-17T05:44:15.550 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "cephfs" 2024-09-17T05:44:15.550 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-09-17T05:44:15.550 INFO:teuthology.orchestra.run.smithi150.stdout:] 2024-09-17T05:44:15.552 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:15.551+0000 7f920c2ce640 1 -- 172.21.15.150:0/2966442526 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f91e8078ef0 msgr2=0x7f91e807b400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:44:15.552 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:15.551+0000 7f920c2ce640 1 --2- 172.21.15.150:0/2966442526 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f91e8078ef0 0x7f91e807b400 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f9200009660 tx=0x7f92000091e0 comp rx=0 tx=0).stop 2024-09-17T05:44:15.553 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:15.551+0000 7f920c2ce640 1 -- 172.21.15.150:0/2966442526 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9204160f60 msgr2=0x7f92041f6bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:44:15.553 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:15.551+0000 7f920c2ce640 1 --2- 172.21.15.150:0/2966442526 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9204160f60 0x7f92041f6bb0 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f91fc02aea0 tx=0x7f91fc033f70 comp rx=0 tx=0).stop 2024-09-17T05:44:15.553 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:15.551+0000 7f920c2ce640 1 -- 172.21.15.150:0/2966442526 shutdown_connections 2024-09-17T05:44:15.553 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:15.551+0000 7f920c2ce640 1 --2- 172.21.15.150:0/2966442526 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f91e8078ef0 0x7f91e807b400 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:15.553 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:15.551+0000 7f920c2ce640 1 --2- 172.21.15.150:0/2966442526 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9204160f60 0x7f92041f6bb0 unknown :-1 s=CLOSED pgs=482 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:15.553 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:15.551+0000 7f920c2ce640 1 --2- 172.21.15.150:0/2966442526 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f92040cea50 0x7f92040cbe30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:15.553 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:15.551+0000 7f920c2ce640 1 --2- 172.21.15.150:0/2966442526 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f92040c5a90 0x7f92041f40d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:15.553 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:15.551+0000 7f920c2ce640 1 -- 172.21.15.150:0/2966442526 >> 172.21.15.150:0/2966442526 conn(0x7f92040cee80 msgr2=0x7f92040b6c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:44:15.553 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:15.551+0000 7f920c2ce640 1 -- 172.21.15.150:0/2966442526 shutdown_connections 2024-09-17T05:44:15.553 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:15.552+0000 7f920c2ce640 1 -- 172.21.15.150:0/2966442526 wait complete. 2024-09-17T05:44:15.564 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-09-17T05:44:15.681 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:15.680+0000 7f2594f01640 1 -- 172.21.15.150:0/1438500741 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f25900ce800 msgr2=0x7f259009aa50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:44:15.681 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:15.680+0000 7f2594f01640 1 --2- 172.21.15.150:0/1438500741 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f25900ce800 0x7f259009aa50 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f2580005fd0 tx=0x7f258002a540 comp rx=0 tx=0).stop 2024-09-17T05:44:15.681 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:15.680+0000 7f2594f01640 1 -- 172.21.15.150:0/1438500741 shutdown_connections 2024-09-17T05:44:15.681 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:15.680+0000 7f2594f01640 1 --2- 172.21.15.150:0/1438500741 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f259009af90 0x7f25900ccce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:15.681 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:15.680+0000 7f2594f01640 1 --2- 172.21.15.150:0/1438500741 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f25900ce800 0x7f259009aa50 unknown :-1 s=CLOSED pgs=484 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:15.681 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:15.680+0000 7f2594f01640 1 -- 172.21.15.150:0/1438500741 >> 172.21.15.150:0/1438500741 conn(0x7f25900d2550 msgr2=0x7f25900d2960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:44:15.681 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:15.680+0000 7f2594f01640 1 -- 172.21.15.150:0/1438500741 shutdown_connections 2024-09-17T05:44:15.682 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:15.680+0000 7f2594f01640 1 -- 172.21.15.150:0/1438500741 wait complete. 2024-09-17T05:44:15.682 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:15.682+0000 7f2594f01640 1 Processor -- start 2024-09-17T05:44:15.682 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:15.682+0000 7f2594f01640 1 -- start start 2024-09-17T05:44:15.686 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:15.683+0000 7f2594f01640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f259009af90 0x7f25900ca230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:44:15.686 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:15.683+0000 7f2594f01640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f25900cd220 0x7f2590159bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:44:15.686 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:15.683+0000 7f2594f01640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f25900ce800 0x7f25901636a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:44:15.686 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:15.683+0000 7f2594f01640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f25900b6450 con 0x7f25900cd220 2024-09-17T05:44:15.686 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:15.683+0000 7f2594f01640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f25900cee20 con 0x7f25900ce800 2024-09-17T05:44:15.686 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:15.683+0000 7f2594f01640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f25900b65d0 con 0x7f259009af90 2024-09-17T05:44:15.686 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:15.683+0000 7f258dd9b640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f25900cd220 0x7f2590159bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:44:15.686 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:15.683+0000 7f258dd9b640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f25900cd220 0x7f2590159bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:39964/0 (socket says 172.21.15.150:39964) 2024-09-17T05:44:15.686 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:15.683+0000 7f258dd9b640 1 -- 172.21.15.150:0/2368830018 learned_addr learned my addr 172.21.15.150:0/2368830018 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:44:15.686 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:15.683+0000 7f258e59c640 1 --2- 172.21.15.150:0/2368830018 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f259009af90 0x7f25900ca230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:44:15.686 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:15.683+0000 7f258ed9d640 1 --2- 172.21.15.150:0/2368830018 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f25900ce800 0x7f25901636a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:44:15.687 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:15.684+0000 7f258dd9b640 1 -- 172.21.15.150:0/2368830018 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f259009af90 msgr2=0x7f25900ca230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:44:15.687 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:15.684+0000 7f258dd9b640 1 --2- 172.21.15.150:0/2368830018 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f259009af90 0x7f25900ca230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:15.687 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:15.684+0000 7f258dd9b640 1 -- 172.21.15.150:0/2368830018 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f25900ce800 msgr2=0x7f25901636a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:44:15.687 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:15.684+0000 7f258dd9b640 1 --2- 172.21.15.150:0/2368830018 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f25900ce800 0x7f25901636a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:15.687 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:15.684+0000 7f258dd9b640 1 -- 172.21.15.150:0/2368830018 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f259015baa0 con 0x7f25900cd220 2024-09-17T05:44:15.687 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:15.684+0000 7f258dd9b640 1 --2- 172.21.15.150:0/2368830018 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f25900cd220 0x7f2590159bf0 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7f258400c9a0 tx=0x7f258400ce60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:44:15.687 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:15.684+0000 7f257effd640 1 -- 172.21.15.150:0/2368830018 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2584007bb0 con 0x7f25900cd220 2024-09-17T05:44:15.687 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:15.684+0000 7f257effd640 1 -- 172.21.15.150:0/2368830018 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f2584007e40 con 0x7f25900cd220 2024-09-17T05:44:15.687 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:15.684+0000 7f2594f01640 1 -- 172.21.15.150:0/2368830018 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f259015a130 con 0x7f25900cd220 2024-09-17T05:44:15.687 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:15.684+0000 7f257effd640 1 -- 172.21.15.150:0/2368830018 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2584005280 con 0x7f25900cd220 2024-09-17T05:44:15.687 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:15.684+0000 7f2594f01640 1 -- 172.21.15.150:0/2368830018 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f259015c120 con 0x7f25900cd220 2024-09-17T05:44:15.687 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:15.685+0000 7f2594f01640 1 -- 172.21.15.150:0/2368830018 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f25900ccce0 con 0x7f25900cd220 2024-09-17T05:44:15.688 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:15.686+0000 7f257effd640 1 -- 172.21.15.150:0/2368830018 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 9) ==== 101747+0+0 (secure 0 0 0) 0x7f2584005420 con 0x7f25900cd220 2024-09-17T05:44:15.688 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:15.686+0000 7f257effd640 1 --2- 172.21.15.150:0/2368830018 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f2570078f20 0x7f257007b430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:44:15.688 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:15.686+0000 7f257effd640 1 -- 172.21.15.150:0/2368830018 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 5709+0+0 (secure 0 0 0) 0x7f258409b830 con 0x7f25900cd220 2024-09-17T05:44:15.688 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:15.686+0000 7f258e59c640 1 --2- 172.21.15.150:0/2368830018 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f2570078f20 0x7f257007b430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:44:15.689 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:15.687+0000 7f258e59c640 1 --2- 172.21.15.150:0/2368830018 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f2570078f20 0x7f257007b430 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f2580033000 tx=0x7f2580004730 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:44:15.691 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:15.691+0000 7f257effd640 1 -- 172.21.15.150:0/2368830018 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f259015baa0 con 0x7f25900cd220 2024-09-17T05:44:15.866 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:15.865+0000 7f2594f01640 1 -- 172.21.15.150:0/2368830018 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) -- 0x7f25900d04e0 con 0x7f25900cd220 2024-09-17T05:44:15.866 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:15.866+0000 7f257effd640 1 -- 172.21.15.150:0/2368830018 <== mon.0 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v35)=0 v35) ==== 122+0+0 (secure 0 0 0) 0x7f2584014030 con 0x7f25900cd220 2024-09-17T05:44:15.868 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:15.868+0000 7f2594f01640 1 -- 172.21.15.150:0/2368830018 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f2570078f20 msgr2=0x7f257007b430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:44:15.869 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:15.868+0000 7f2594f01640 1 --2- 172.21.15.150:0/2368830018 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f2570078f20 0x7f257007b430 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f2580033000 tx=0x7f2580004730 comp rx=0 tx=0).stop 2024-09-17T05:44:15.869 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:15.868+0000 7f2594f01640 1 -- 172.21.15.150:0/2368830018 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f25900cd220 msgr2=0x7f2590159bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:44:15.869 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:15.868+0000 7f2594f01640 1 --2- 172.21.15.150:0/2368830018 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f25900cd220 0x7f2590159bf0 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7f258400c9a0 tx=0x7f258400ce60 comp rx=0 tx=0).stop 2024-09-17T05:44:15.869 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:15.868+0000 7f2594f01640 1 -- 172.21.15.150:0/2368830018 shutdown_connections 2024-09-17T05:44:15.869 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:15.868+0000 7f2594f01640 1 --2- 172.21.15.150:0/2368830018 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f25900ce800 0x7f25901636a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:15.869 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:15.868+0000 7f2594f01640 1 --2- 172.21.15.150:0/2368830018 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f2570078f20 0x7f257007b430 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:15.869 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:15.868+0000 7f2594f01640 1 --2- 172.21.15.150:0/2368830018 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f25900cd220 0x7f2590159bf0 unknown :-1 s=CLOSED pgs=485 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:15.869 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:15.868+0000 7f2594f01640 1 --2- 172.21.15.150:0/2368830018 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f259009af90 0x7f25900ca230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:15.869 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:15.868+0000 7f2594f01640 1 -- 172.21.15.150:0/2368830018 >> 172.21.15.150:0/2368830018 conn(0x7f25900d2550 msgr2=0x7f2590164ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:44:15.869 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:15.868+0000 7f2594f01640 1 -- 172.21.15.150:0/2368830018 shutdown_connections 2024-09-17T05:44:15.869 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:15.868+0000 7f2594f01640 1 -- 172.21.15.150:0/2368830018 wait complete. 2024-09-17T05:44:15.881 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config get mgr mgr/volumes/max_concurrent_clones 2024-09-17T05:44:15.997 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:15.996+0000 7f9a20a64640 1 -- 172.21.15.150:0/3384342263 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9a1c06dea0 msgr2=0x7f9a1c0d0020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:44:15.998 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:15.996+0000 7f9a20a64640 1 --2- 172.21.15.150:0/3384342263 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9a1c06dea0 0x7f9a1c0d0020 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f9a1c08d600 tx=0x7f9a0402a5f0 comp rx=0 tx=0).stop 2024-09-17T05:44:15.998 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:15.997+0000 7f9a20a64640 1 -- 172.21.15.150:0/3384342263 shutdown_connections 2024-09-17T05:44:15.998 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:15.997+0000 7f9a20a64640 1 --2- 172.21.15.150:0/3384342263 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9a1c06dea0 0x7f9a1c0d0020 unknown :-1 s=CLOSED pgs=486 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:15.998 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:15.997+0000 7f9a20a64640 1 --2- 172.21.15.150:0/3384342263 >> v2:172.21.15.176:3300/0 conn(0x7f9a1c0d5150 0x7f9a1c0b9b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:15.998 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:15.997+0000 7f9a20a64640 1 -- 172.21.15.150:0/3384342263 >> 172.21.15.150:0/3384342263 conn(0x7f9a1c08bfe0 msgr2=0x7f9a1c0d46e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:44:15.998 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:15.997+0000 7f9a20a64640 1 -- 172.21.15.150:0/3384342263 shutdown_connections 2024-09-17T05:44:15.998 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:15.997+0000 7f9a20a64640 1 -- 172.21.15.150:0/3384342263 wait complete. 2024-09-17T05:44:15.999 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:15.999+0000 7f9a20a64640 1 Processor -- start 2024-09-17T05:44:15.999 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:15.999+0000 7f9a20a64640 1 -- start start 2024-09-17T05:44:16.002 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:16.000+0000 7f9a20a64640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9a1c06dea0 0x7f9a1c0cd180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:44:16.002 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:16.000+0000 7f9a20a64640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9a1c06e2b0 0x7f9a1c153990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:44:16.002 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:16.000+0000 7f9a20a64640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9a1c0d5150 0x7f9a1c153ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:44:16.002 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:16.000+0000 7f9a20a64640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f9a1c0d3150 con 0x7f9a1c06dea0 2024-09-17T05:44:16.002 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:16.000+0000 7f9a20a64640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f9a1c0d2fd0 con 0x7f9a1c06e2b0 2024-09-17T05:44:16.003 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:16.000+0000 7f9a20a64640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f9a1c0b6870 con 0x7f9a1c0d5150 2024-09-17T05:44:16.003 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:16.000+0000 7f9a1a59c640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9a1c06dea0 0x7f9a1c0cd180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:44:16.003 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:16.000+0000 7f9a1a59c640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9a1c06dea0 0x7f9a1c0cd180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:39972/0 (socket says 172.21.15.150:39972) 2024-09-17T05:44:16.003 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:16.000+0000 7f9a1a59c640 1 -- 172.21.15.150:0/1686992106 learned_addr learned my addr 172.21.15.150:0/1686992106 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:44:16.003 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:16.000+0000 7f9a11d9b640 1 --2- 172.21.15.150:0/1686992106 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9a1c06e2b0 0x7f9a1c153990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:44:16.003 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:16.000+0000 7f9a1ad9d640 1 --2- 172.21.15.150:0/1686992106 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9a1c0d5150 0x7f9a1c153ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:44:16.003 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:16.000+0000 7f9a1a59c640 1 -- 172.21.15.150:0/1686992106 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9a1c0d5150 msgr2=0x7f9a1c153ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:44:16.003 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:16.000+0000 7f9a1a59c640 1 --2- 172.21.15.150:0/1686992106 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9a1c0d5150 0x7f9a1c153ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:16.003 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:16.000+0000 7f9a1a59c640 1 -- 172.21.15.150:0/1686992106 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9a1c06e2b0 msgr2=0x7f9a1c153990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:44:16.003 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:16.000+0000 7f9a1a59c640 1 --2- 172.21.15.150:0/1686992106 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9a1c06e2b0 0x7f9a1c153990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:16.003 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:16.000+0000 7f9a1a59c640 1 -- 172.21.15.150:0/1686992106 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9a1c1f6e70 con 0x7f9a1c06dea0 2024-09-17T05:44:16.003 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:16.001+0000 7f9a1a59c640 1 --2- 172.21.15.150:0/1686992106 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9a1c06dea0 0x7f9a1c0cd180 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7f9a0c00d730 tx=0x7f9a0c00dbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:44:16.003 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:16.001+0000 7f9a137fe640 1 -- 172.21.15.150:0/1686992106 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a0c017070 con 0x7f9a1c06dea0 2024-09-17T05:44:16.004 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:16.001+0000 7f9a20a64640 1 -- 172.21.15.150:0/1686992106 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9a1c0cd9d0 con 0x7f9a1c06dea0 2024-09-17T05:44:16.004 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:16.001+0000 7f9a137fe640 1 -- 172.21.15.150:0/1686992106 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9a0c0099d0 con 0x7f9a1c06dea0 2024-09-17T05:44:16.004 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:16.001+0000 7f9a137fe640 1 -- 172.21.15.150:0/1686992106 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a0c009e20 con 0x7f9a1c06dea0 2024-09-17T05:44:16.004 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:16.001+0000 7f9a20a64640 1 -- 172.21.15.150:0/1686992106 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9a1c0cdf90 con 0x7f9a1c06dea0 2024-09-17T05:44:16.004 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:16.002+0000 7f9a20a64640 1 -- 172.21.15.150:0/1686992106 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9a1c0d4f30 con 0x7f9a1c06dea0 2024-09-17T05:44:16.005 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:16.003+0000 7f9a137fe640 1 -- 172.21.15.150:0/1686992106 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 9) ==== 101747+0+0 (secure 0 0 0) 0x7f9a0c01a070 con 0x7f9a1c06dea0 2024-09-17T05:44:16.005 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:16.003+0000 7f9a137fe640 1 --2- 172.21.15.150:0/1686992106 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f99fc078ef0 0x7f99fc07b400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:44:16.005 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:16.003+0000 7f9a137fe640 1 -- 172.21.15.150:0/1686992106 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 5709+0+0 (secure 0 0 0) 0x7f9a0c09b5e0 con 0x7f9a1c06dea0 2024-09-17T05:44:16.005 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:16.003+0000 7f9a11d9b640 1 --2- 172.21.15.150:0/1686992106 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f99fc078ef0 0x7f99fc07b400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:44:16.005 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:16.004+0000 7f9a11d9b640 1 --2- 172.21.15.150:0/1686992106 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f99fc078ef0 0x7f99fc07b400 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f9a04033000 tx=0x7f9a04004730 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:44:16.008 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:16.008+0000 7f9a137fe640 1 -- 172.21.15.150:0/1686992106 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f9a0c063410 con 0x7f9a1c06dea0 2024-09-17T05:44:16.183 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:16.182+0000 7f9a20a64640 1 -- 172.21.15.150:0/1686992106 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "config get", "who": "mgr", "key": "mgr/volumes/max_concurrent_clones"} v 0) -- 0x7f9a1c0d1bc0 con 0x7f9a1c06dea0 2024-09-17T05:44:16.183 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:16.183+0000 7f9a137fe640 1 -- 172.21.15.150:0/1686992106 <== mon.0 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "config get", "who": "mgr", "key": "mgr/volumes/max_concurrent_clones"}]=0 v35) ==== 116+0+2 (secure 0 0 0) 0x7f9a0c062d10 con 0x7f9a1c06dea0 2024-09-17T05:44:16.184 INFO:teuthology.orchestra.run.smithi150.stdout:4 2024-09-17T05:44:16.186 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:16.185+0000 7f9a20a64640 1 -- 172.21.15.150:0/1686992106 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f99fc078ef0 msgr2=0x7f99fc07b400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:44:16.186 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:16.185+0000 7f9a20a64640 1 --2- 172.21.15.150:0/1686992106 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f99fc078ef0 0x7f99fc07b400 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f9a04033000 tx=0x7f9a04004730 comp rx=0 tx=0).stop 2024-09-17T05:44:16.186 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:16.185+0000 7f9a20a64640 1 -- 172.21.15.150:0/1686992106 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9a1c06dea0 msgr2=0x7f9a1c0cd180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:44:16.186 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:16.185+0000 7f9a20a64640 1 --2- 172.21.15.150:0/1686992106 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9a1c06dea0 0x7f9a1c0cd180 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7f9a0c00d730 tx=0x7f9a0c00dbf0 comp rx=0 tx=0).stop 2024-09-17T05:44:16.186 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:16.185+0000 7f9a20a64640 1 -- 172.21.15.150:0/1686992106 shutdown_connections 2024-09-17T05:44:16.186 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:16.185+0000 7f9a20a64640 1 --2- 172.21.15.150:0/1686992106 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9a1c06e2b0 0x7f9a1c153990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:16.186 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:16.185+0000 7f9a20a64640 1 --2- 172.21.15.150:0/1686992106 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f99fc078ef0 0x7f99fc07b400 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:16.186 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:16.185+0000 7f9a20a64640 1 --2- 172.21.15.150:0/1686992106 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9a1c0d5150 0x7f9a1c153ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:16.186 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:16.185+0000 7f9a20a64640 1 --2- 172.21.15.150:0/1686992106 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9a1c06dea0 0x7f9a1c0cd180 unknown :-1 s=CLOSED pgs=487 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:16.186 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:16.185+0000 7f9a20a64640 1 -- 172.21.15.150:0/1686992106 >> 172.21.15.150:0/1686992106 conn(0x7f9a1c08bfe0 msgr2=0x7f9a1c0d0d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:44:16.186 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:16.185+0000 7f9a20a64640 1 -- 172.21.15.150:0/1686992106 shutdown_connections 2024-09-17T05:44:16.187 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:16.185+0000 7f9a20a64640 1 -- 172.21.15.150:0/1686992106 wait complete. 2024-09-17T05:44:16.197 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mgr mgr/volumes/max_concurrent_clones 4 2024-09-17T05:44:16.315 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:16.314+0000 7fa5d3158640 1 -- 172.21.15.150:0/2518059409 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa5b4004800 msgr2=0x7fa5b4004c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:44:16.315 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:16.314+0000 7fa5d3158640 1 --2- 172.21.15.150:0/2518059409 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa5b4004800 0x7fa5b4004c10 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7fa5bc00c310 tx=0x7fa5b4005830 comp rx=0 tx=0).stop 2024-09-17T05:44:16.315 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:16.314+0000 7fa5d3158640 1 -- 172.21.15.150:0/2518059409 shutdown_connections 2024-09-17T05:44:16.316 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:16.314+0000 7fa5d3158640 1 --2- 172.21.15.150:0/2518059409 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa5b4004800 0x7fa5b4004c10 unknown :-1 s=CLOSED pgs=489 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:16.316 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:16.314+0000 7fa5d3158640 1 -- 172.21.15.150:0/2518059409 >> 172.21.15.150:0/2518059409 conn(0x7fa5cc0d4680 msgr2=0x7fa5cc0d4a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:44:16.316 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:16.314+0000 7fa5d3158640 1 -- 172.21.15.150:0/2518059409 shutdown_connections 2024-09-17T05:44:16.316 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:16.314+0000 7fa5d3158640 1 -- 172.21.15.150:0/2518059409 wait complete. 2024-09-17T05:44:16.317 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:16.316+0000 7fa5d3158640 1 Processor -- start 2024-09-17T05:44:16.317 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:16.316+0000 7fa5d3158640 1 -- start start 2024-09-17T05:44:16.322 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:16.318+0000 7fa5d3158640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa5b4004800 0x7fa5cc161f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:44:16.322 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:16.318+0000 7fa5d3158640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa5cc15da80 0x7fa5cc1509e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:44:16.322 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:16.318+0000 7fa5d3158640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa5cc150f20 0x7fa5cc151330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:44:16.323 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:16.318+0000 7fa5d3158640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7fa5cc0d2700 con 0x7fa5cc150f20 2024-09-17T05:44:16.323 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:16.318+0000 7fa5d3158640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fa5cc0d2580 con 0x7fa5b4004800 2024-09-17T05:44:16.323 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:16.318+0000 7fa5d3158640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fa5cc162cd0 con 0x7fa5cc15da80 2024-09-17T05:44:16.323 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:16.318+0000 7fa5d16f5640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa5cc150f20 0x7fa5cc151330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:44:16.323 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:16.318+0000 7fa5d16f5640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa5cc150f20 0x7fa5cc151330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:39988/0 (socket says 172.21.15.150:39988) 2024-09-17T05:44:16.323 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:16.318+0000 7fa5d16f5640 1 -- 172.21.15.150:0/3815786353 learned_addr learned my addr 172.21.15.150:0/3815786353 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:44:16.323 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:16.318+0000 7fa5d0ef4640 1 --2- 172.21.15.150:0/3815786353 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa5b4004800 0x7fa5cc161f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:44:16.323 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:16.318+0000 7fa5c3fff640 1 --2- 172.21.15.150:0/3815786353 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa5cc15da80 0x7fa5cc1509e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:44:16.323 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:16.318+0000 7fa5d16f5640 1 -- 172.21.15.150:0/3815786353 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa5cc15da80 msgr2=0x7fa5cc1509e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:44:16.323 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:16.318+0000 7fa5d16f5640 1 --2- 172.21.15.150:0/3815786353 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa5cc15da80 0x7fa5cc1509e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:16.324 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:16.318+0000 7fa5d16f5640 1 -- 172.21.15.150:0/3815786353 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa5b4004800 msgr2=0x7fa5cc161f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:44:16.324 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:16.318+0000 7fa5d16f5640 1 --2- 172.21.15.150:0/3815786353 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa5b4004800 0x7fa5cc161f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:16.324 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:16.318+0000 7fa5d16f5640 1 -- 172.21.15.150:0/3815786353 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa5cc0cccb0 con 0x7fa5cc150f20 2024-09-17T05:44:16.324 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:16.318+0000 7fa5d16f5640 1 --2- 172.21.15.150:0/3815786353 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa5cc150f20 0x7fa5cc151330 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7fa5cc0d2320 tx=0x7fa5c4006430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:44:16.324 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:16.318+0000 7fa5c17fa640 1 -- 172.21.15.150:0/3815786353 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5c4011900 con 0x7fa5cc150f20 2024-09-17T05:44:16.324 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:16.318+0000 7fa5c17fa640 1 -- 172.21.15.150:0/3815786353 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa5c4018070 con 0x7fa5cc150f20 2024-09-17T05:44:16.324 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:16.318+0000 7fa5d3158640 1 -- 172.21.15.150:0/3815786353 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa5cc0ccf90 con 0x7fa5cc150f20 2024-09-17T05:44:16.324 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:16.318+0000 7fa5c17fa640 1 -- 172.21.15.150:0/3815786353 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5c4011d40 con 0x7fa5cc150f20 2024-09-17T05:44:16.324 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:16.318+0000 7fa5d3158640 1 -- 172.21.15.150:0/3815786353 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa5cc0cd550 con 0x7fa5cc150f20 2024-09-17T05:44:16.324 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:16.320+0000 7fa5d3158640 1 -- 172.21.15.150:0/3815786353 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa5cc08d090 con 0x7fa5cc150f20 2024-09-17T05:44:16.324 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:16.320+0000 7fa5c17fa640 1 -- 172.21.15.150:0/3815786353 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 9) ==== 101747+0+0 (secure 0 0 0) 0x7fa5c401d460 con 0x7fa5cc150f20 2024-09-17T05:44:16.324 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:16.321+0000 7fa5c17fa640 1 --2- 172.21.15.150:0/3815786353 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fa5b8078ef0 0x7fa5b807b400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:44:16.324 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:16.321+0000 7fa5c17fa640 1 -- 172.21.15.150:0/3815786353 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 5709+0+0 (secure 0 0 0) 0x7fa5c409bd30 con 0x7fa5cc150f20 2024-09-17T05:44:16.325 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:16.321+0000 7fa5d0ef4640 1 --2- 172.21.15.150:0/3815786353 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fa5b8078ef0 0x7fa5b807b400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:44:16.325 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:16.322+0000 7fa5d0ef4640 1 --2- 172.21.15.150:0/3815786353 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fa5b8078ef0 0x7fa5b807b400 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fa5c8009c90 tx=0x7fa5c8005f30 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:44:16.326 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:16.325+0000 7fa5c17fa640 1 -- 172.21.15.150:0/3815786353 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fa5cc08d090 con 0x7fa5cc150f20 2024-09-17T05:44:16.501 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:16.500+0000 7fa5d3158640 1 -- 172.21.15.150:0/3815786353 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command([{prefix=config set, name=mgr/volumes/max_concurrent_clones}] v 0) -- 0x7fa5cc0cca40 con 0x7fa5cc150f20 2024-09-17T05:44:16.504 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:16.504+0000 7fa5c17fa640 1 -- 172.21.15.150:0/3815786353 <== mon.0 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/volumes/max_concurrent_clones}]=0 v36)=0 v36) ==== 131+0+0 (secure 0 0 0) 0x7fa5c4063c50 con 0x7fa5cc150f20 2024-09-17T05:44:16.508 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:16.507+0000 7fa5d3158640 1 -- 172.21.15.150:0/3815786353 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fa5b8078ef0 msgr2=0x7fa5b807b400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:44:16.508 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:16.507+0000 7fa5d3158640 1 --2- 172.21.15.150:0/3815786353 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fa5b8078ef0 0x7fa5b807b400 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fa5c8009c90 tx=0x7fa5c8005f30 comp rx=0 tx=0).stop 2024-09-17T05:44:16.508 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:16.507+0000 7fa5d3158640 1 -- 172.21.15.150:0/3815786353 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa5cc150f20 msgr2=0x7fa5cc151330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:44:16.508 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:16.507+0000 7fa5d3158640 1 --2- 172.21.15.150:0/3815786353 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa5cc150f20 0x7fa5cc151330 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7fa5cc0d2320 tx=0x7fa5c4006430 comp rx=0 tx=0).stop 2024-09-17T05:44:16.508 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:16.507+0000 7fa5d3158640 1 -- 172.21.15.150:0/3815786353 shutdown_connections 2024-09-17T05:44:16.508 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:16.507+0000 7fa5d3158640 1 --2- 172.21.15.150:0/3815786353 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fa5b8078ef0 0x7fa5b807b400 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:16.508 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:16.507+0000 7fa5d3158640 1 --2- 172.21.15.150:0/3815786353 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa5cc150f20 0x7fa5cc151330 unknown :-1 s=CLOSED pgs=490 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:16.508 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:16.507+0000 7fa5d3158640 1 --2- 172.21.15.150:0/3815786353 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa5cc15da80 0x7fa5cc1509e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:16.508 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:16.507+0000 7fa5d3158640 1 --2- 172.21.15.150:0/3815786353 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa5b4004800 0x7fa5cc161f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:16.508 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:16.507+0000 7fa5d3158640 1 -- 172.21.15.150:0/3815786353 >> 172.21.15.150:0/3815786353 conn(0x7fa5cc0d4680 msgr2=0x7fa5cc0b8e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:44:16.509 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:16.507+0000 7fa5d3158640 1 -- 172.21.15.150:0/3815786353 shutdown_connections 2024-09-17T05:44:16.509 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:16.507+0000 7fa5d3158640 1 -- 172.21.15.150:0/3815786353 wait complete. 2024-09-17T05:44:16.519 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume create cephfs sv1 --mode=777 2024-09-17T05:44:16.521 INFO:tasks.ceph.mgr.x.smithi176.stderr:2024-09-17T05:44:16.521+0000 7f33d8f1d640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-17T05:44:16.521 INFO:tasks.ceph.mgr.x.smithi176.stderr:2024-09-17T05:44:16.521+0000 7f33d8f1d640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-17T05:44:16.521 INFO:tasks.ceph.mgr.x.smithi176.stderr:2024-09-17T05:44:16.521+0000 7f33d8f1d640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-17T05:44:16.521 INFO:tasks.ceph.mgr.x.smithi176.stderr:2024-09-17T05:44:16.521+0000 7f33d8f1d640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-17T05:44:16.521 INFO:tasks.ceph.mgr.x.smithi176.stderr:2024-09-17T05:44:16.521+0000 7f33d8f1d640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-17T05:44:16.638 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:16.637+0000 7ff8a09f1640 1 -- 172.21.15.150:0/3526011184 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff884004800 msgr2=0x7ff884004c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:44:16.638 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:16.637+0000 7ff8a09f1640 1 --2- 172.21.15.150:0/3526011184 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff884004800 0x7ff884004c10 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7ff89c073840 tx=0x7ff884005830 comp rx=0 tx=0).stop 2024-09-17T05:44:16.638 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:16.637+0000 7ff8a09f1640 1 -- 172.21.15.150:0/3526011184 shutdown_connections 2024-09-17T05:44:16.638 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:16.637+0000 7ff8a09f1640 1 --2- 172.21.15.150:0/3526011184 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff884004800 0x7ff884004c10 unknown :-1 s=CLOSED pgs=492 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:16.638 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:16.637+0000 7ff8a09f1640 1 -- 172.21.15.150:0/3526011184 >> 172.21.15.150:0/3526011184 conn(0x7ff89c073890 msgr2=0x7ff89c073ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:44:16.638 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:16.637+0000 7ff8a09f1640 1 -- 172.21.15.150:0/3526011184 shutdown_connections 2024-09-17T05:44:16.638 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:16.637+0000 7ff8a09f1640 1 -- 172.21.15.150:0/3526011184 wait complete. 2024-09-17T05:44:16.639 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:16.639+0000 7ff8a09f1640 1 Processor -- start 2024-09-17T05:44:16.639 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:16.639+0000 7ff8a09f1640 1 -- start start 2024-09-17T05:44:16.642 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:16.640+0000 7ff8a09f1640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff884004800 0x7ff89c156340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:44:16.642 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:16.640+0000 7ff8a09f1640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff89c0ccf50 0x7ff89c149870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:44:16.642 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:16.640+0000 7ff8a09f1640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff89c1f5500 0x7ff89c1f5910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:44:16.642 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:16.640+0000 7ff8a09f1640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7ff89c15cad0 con 0x7ff89c0ccf50 2024-09-17T05:44:16.642 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:16.640+0000 7ff8a09f1640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7ff89c15c950 con 0x7ff884004800 2024-09-17T05:44:16.642 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:16.640+0000 7ff8a09f1640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7ff89c15cc50 con 0x7ff89c1f5500 2024-09-17T05:44:16.642 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:16.640+0000 7ff899d9b640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff89c0ccf50 0x7ff89c149870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:44:16.642 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:16.640+0000 7ff899d9b640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff89c0ccf50 0x7ff89c149870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:40008/0 (socket says 172.21.15.150:40008) 2024-09-17T05:44:16.642 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:16.640+0000 7ff899d9b640 1 -- 172.21.15.150:0/1465328442 learned_addr learned my addr 172.21.15.150:0/1465328442 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:44:16.642 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:16.640+0000 7ff89a59c640 1 --2- 172.21.15.150:0/1465328442 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff884004800 0x7ff89c156340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:44:16.642 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:16.640+0000 7ff89ad9d640 1 --2- 172.21.15.150:0/1465328442 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff89c1f5500 0x7ff89c1f5910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:44:16.643 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:16.640+0000 7ff899d9b640 1 -- 172.21.15.150:0/1465328442 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff89c1f5500 msgr2=0x7ff89c1f5910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:44:16.643 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:16.640+0000 7ff899d9b640 1 --2- 172.21.15.150:0/1465328442 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff89c1f5500 0x7ff89c1f5910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:16.643 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:16.640+0000 7ff899d9b640 1 -- 172.21.15.150:0/1465328442 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff884004800 msgr2=0x7ff89c156340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:44:16.643 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:16.640+0000 7ff899d9b640 1 --2- 172.21.15.150:0/1465328442 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff884004800 0x7ff89c156340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:16.643 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:16.640+0000 7ff899d9b640 1 -- 172.21.15.150:0/1465328442 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff89c1f5e50 con 0x7ff89c0ccf50 2024-09-17T05:44:16.643 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:16.640+0000 7ff89a59c640 1 --2- 172.21.15.150:0/1465328442 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff884004800 0x7ff89c156340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:44:16.643 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:16.641+0000 7ff899d9b640 1 --2- 172.21.15.150:0/1465328442 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff89c0ccf50 0x7ff89c149870 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7ff89002a8d0 tx=0x7ff8900063c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:44:16.643 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:16.641+0000 7ff88affd640 1 -- 172.21.15.150:0/1465328442 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff89003f020 con 0x7ff89c0ccf50 2024-09-17T05:44:16.643 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:16.641+0000 7ff88affd640 1 -- 172.21.15.150:0/1465328442 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff890003b10 con 0x7ff89c0ccf50 2024-09-17T05:44:16.643 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:16.641+0000 7ff8a09f1640 1 -- 172.21.15.150:0/1465328442 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff89c156bd0 con 0x7ff89c0ccf50 2024-09-17T05:44:16.643 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:16.641+0000 7ff88affd640 1 -- 172.21.15.150:0/1465328442 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff89003b430 con 0x7ff89c0ccf50 2024-09-17T05:44:16.643 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:16.641+0000 7ff8a09f1640 1 -- 172.21.15.150:0/1465328442 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff89c157190 con 0x7ff89c0ccf50 2024-09-17T05:44:16.644 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:16.642+0000 7ff8a09f1640 1 -- 172.21.15.150:0/1465328442 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff89c06e050 con 0x7ff89c0ccf50 2024-09-17T05:44:16.644 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:16.642+0000 7ff88affd640 1 -- 172.21.15.150:0/1465328442 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 9) ==== 101747+0+0 (secure 0 0 0) 0x7ff890042020 con 0x7ff89c0ccf50 2024-09-17T05:44:16.644 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:16.643+0000 7ff88affd640 1 --2- 172.21.15.150:0/1465328442 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7ff87c078ef0 0x7ff87c07b400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:44:16.645 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:16.643+0000 7ff88affd640 1 -- 172.21.15.150:0/1465328442 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 5709+0+0 (secure 0 0 0) 0x7ff8900bdd50 con 0x7ff89c0ccf50 2024-09-17T05:44:16.645 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:16.643+0000 7ff89a59c640 1 --2- 172.21.15.150:0/1465328442 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7ff87c078ef0 0x7ff87c07b400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:44:16.645 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:16.644+0000 7ff89a59c640 1 --2- 172.21.15.150:0/1465328442 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7ff87c078ef0 0x7ff87c07b400 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7ff89c0521d0 tx=0x7ff88c005f90 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:44:16.648 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:16.648+0000 7ff88affd640 1 -- 172.21.15.150:0/1465328442 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7ff890049020 con 0x7ff89c0ccf50 2024-09-17T05:44:16.852 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:16.852+0000 7ff8a09f1640 1 -- 172.21.15.150:0/1465328442 --> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] -- mgr_command(tid 0: {"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv1", "mode": "777", "target": ["mon-mgr", ""]}) -- 0x7ff89c157360 con 0x7ff87c078ef0 2024-09-17T05:44:17.514 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:17.513+0000 7ff88affd640 1 -- 172.21.15.150:0/1465328442 <== mon.0 v2:172.21.15.150:3300/0 7 ==== mgrmap(e 10) ==== 101798+0+0 (secure 0 0 0) 0x7ff890030050 con 0x7ff89c0ccf50 2024-09-17T05:44:17.771 INFO:tasks.ceph.mgr.x.smithi176.stderr:2024-09-17T05:44:17.771+0000 7f33d771a640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-17T05:44:17.772 INFO:tasks.ceph.mgr.x.smithi176.stderr:2024-09-17T05:44:17.771+0000 7f33d771a640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-17T05:44:17.772 INFO:tasks.ceph.mgr.x.smithi176.stderr:2024-09-17T05:44:17.771+0000 7f33d771a640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-17T05:44:17.772 INFO:tasks.ceph.mgr.x.smithi176.stderr:2024-09-17T05:44:17.771+0000 7f33d771a640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-17T05:44:17.772 INFO:tasks.ceph.mgr.x.smithi176.stderr:2024-09-17T05:44:17.771+0000 7f33d771a640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-17T05:44:17.806 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:17.806+0000 7ff88affd640 1 -- 172.21.15.150:0/1465328442 <== mgr.4108 v2:172.21.15.176:6800/3631216395 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7ff89c157360 con 0x7ff87c078ef0 2024-09-17T05:44:17.809 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:17.808+0000 7ff8a09f1640 1 -- 172.21.15.150:0/1465328442 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7ff87c078ef0 msgr2=0x7ff87c07b400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:44:17.809 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:17.808+0000 7ff8a09f1640 1 --2- 172.21.15.150:0/1465328442 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7ff87c078ef0 0x7ff87c07b400 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7ff89c0521d0 tx=0x7ff88c005f90 comp rx=0 tx=0).stop 2024-09-17T05:44:17.809 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:17.808+0000 7ff8a09f1640 1 -- 172.21.15.150:0/1465328442 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff89c0ccf50 msgr2=0x7ff89c149870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:44:17.809 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:17.808+0000 7ff8a09f1640 1 --2- 172.21.15.150:0/1465328442 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff89c0ccf50 0x7ff89c149870 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7ff89002a8d0 tx=0x7ff8900063c0 comp rx=0 tx=0).stop 2024-09-17T05:44:17.810 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:17.808+0000 7ff8a09f1640 1 -- 172.21.15.150:0/1465328442 shutdown_connections 2024-09-17T05:44:17.810 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:17.808+0000 7ff8a09f1640 1 --2- 172.21.15.150:0/1465328442 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7ff87c078ef0 0x7ff87c07b400 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:17.810 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:17.808+0000 7ff8a09f1640 1 --2- 172.21.15.150:0/1465328442 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff89c1f5500 0x7ff89c1f5910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:17.810 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:17.808+0000 7ff8a09f1640 1 --2- 172.21.15.150:0/1465328442 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff89c0ccf50 0x7ff89c149870 unknown :-1 s=CLOSED pgs=493 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:17.810 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:17.808+0000 7ff8a09f1640 1 --2- 172.21.15.150:0/1465328442 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff884004800 0x7ff89c156340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:17.810 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:17.808+0000 7ff8a09f1640 1 -- 172.21.15.150:0/1465328442 >> 172.21.15.150:0/1465328442 conn(0x7ff89c073890 msgr2=0x7ff89c0b6650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:44:17.810 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:17.808+0000 7ff8a09f1640 1 -- 172.21.15.150:0/1465328442 shutdown_connections 2024-09-17T05:44:17.810 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:17.809+0000 7ff8a09f1640 1 -- 172.21.15.150:0/1465328442 wait complete. 2024-09-17T05:44:17.822 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume getpath cephfs sv1 2024-09-17T05:44:17.941 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:17.940+0000 7f69e94b4640 1 -- 172.21.15.150:0/2181153751 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f69e40d5150 msgr2=0x7f69e40b9b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:44:17.941 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:17.940+0000 7f69e94b4640 1 --2- 172.21.15.150:0/2181153751 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f69e40d5150 0x7f69e40b9b10 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f69e40cfd10 tx=0x7f69d402a4f0 comp rx=0 tx=0).stop 2024-09-17T05:44:17.941 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:17.940+0000 7f69e94b4640 1 -- 172.21.15.150:0/2181153751 shutdown_connections 2024-09-17T05:44:17.941 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:17.940+0000 7f69e94b4640 1 --2- 172.21.15.150:0/2181153751 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f69e406dea0 0x7f69e40d0020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:17.942 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:17.940+0000 7f69e94b4640 1 --2- 172.21.15.150:0/2181153751 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f69e40d5150 0x7f69e40b9b10 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:17.942 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:17.940+0000 7f69e94b4640 1 -- 172.21.15.150:0/2181153751 >> 172.21.15.150:0/2181153751 conn(0x7f69e408bfe0 msgr2=0x7f69e40d46e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:44:17.942 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:17.940+0000 7f69e94b4640 1 -- 172.21.15.150:0/2181153751 shutdown_connections 2024-09-17T05:44:17.942 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:17.940+0000 7f69e94b4640 1 -- 172.21.15.150:0/2181153751 wait complete. 2024-09-17T05:44:17.942 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:17.942+0000 7f69e94b4640 1 Processor -- start 2024-09-17T05:44:17.943 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:17.942+0000 7f69e94b4640 1 -- start start 2024-09-17T05:44:17.945 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:17.943+0000 7f69e94b4640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f69e406dea0 0x7f69e415d350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:44:17.945 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:17.943+0000 7f69e94b4640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f69e406e2b0 0x7f69e40cc7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:44:17.945 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:17.943+0000 7f69e94b4640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f69e40d5150 0x7f69e41549d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:44:17.945 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:17.943+0000 7f69e94b4640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f69e40ba1a0 con 0x7f69e406dea0 2024-09-17T05:44:17.945 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:17.943+0000 7f69e94b4640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f69e40d31e0 con 0x7f69e40d5150 2024-09-17T05:44:17.946 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:17.943+0000 7f69e94b4640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f69e40b6870 con 0x7f69e406e2b0 2024-09-17T05:44:17.946 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:17.944+0000 7f69e2ffd640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f69e406dea0 0x7f69e415d350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:44:17.946 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:17.944+0000 7f69e2ffd640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f69e406dea0 0x7f69e415d350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:40014/0 (socket says 172.21.15.150:40014) 2024-09-17T05:44:17.946 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:17.944+0000 7f69e2ffd640 1 -- 172.21.15.150:0/3139529198 learned_addr learned my addr 172.21.15.150:0/3139529198 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:44:17.946 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:17.944+0000 7f69da7fc640 1 --2- 172.21.15.150:0/3139529198 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f69e406e2b0 0x7f69e40cc7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:44:17.946 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:17.944+0000 7f69e37fe640 1 --2- 172.21.15.150:0/3139529198 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f69e40d5150 0x7f69e41549d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:44:17.946 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:17.944+0000 7f69e2ffd640 1 -- 172.21.15.150:0/3139529198 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f69e406e2b0 msgr2=0x7f69e40cc7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:44:17.946 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:17.944+0000 7f69e2ffd640 1 --2- 172.21.15.150:0/3139529198 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f69e406e2b0 0x7f69e40cc7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:17.946 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:17.944+0000 7f69e2ffd640 1 -- 172.21.15.150:0/3139529198 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f69e40d5150 msgr2=0x7f69e41549d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:44:17.946 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:17.944+0000 7f69e2ffd640 1 --2- 172.21.15.150:0/3139529198 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f69e40d5150 0x7f69e41549d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:17.946 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:17.944+0000 7f69e2ffd640 1 -- 172.21.15.150:0/3139529198 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f69e40c91c0 con 0x7f69e406dea0 2024-09-17T05:44:17.946 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:17.944+0000 7f69e2ffd640 1 --2- 172.21.15.150:0/3139529198 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f69e406dea0 0x7f69e415d350 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7f69d402aae0 tx=0x7f69d40049d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:44:17.946 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:17.944+0000 7f69dbfff640 1 -- 172.21.15.150:0/3139529198 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69d4031d60 con 0x7f69e406dea0 2024-09-17T05:44:17.947 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:17.944+0000 7f69dbfff640 1 -- 172.21.15.150:0/3139529198 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f69d40330d0 con 0x7f69e406dea0 2024-09-17T05:44:17.947 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:17.944+0000 7f69e94b4640 1 -- 172.21.15.150:0/3139529198 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f69e40c94a0 con 0x7f69e406dea0 2024-09-17T05:44:17.947 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:17.944+0000 7f69dbfff640 1 -- 172.21.15.150:0/3139529198 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69d4033520 con 0x7f69e406dea0 2024-09-17T05:44:17.947 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:17.944+0000 7f69e94b4640 1 -- 172.21.15.150:0/3139529198 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f69e40c9a60 con 0x7f69e406dea0 2024-09-17T05:44:17.948 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:17.945+0000 7f69e94b4640 1 -- 172.21.15.150:0/3139529198 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f69e40d0020 con 0x7f69e406dea0 2024-09-17T05:44:17.948 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:17.946+0000 7f69dbfff640 1 -- 172.21.15.150:0/3139529198 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 10) ==== 101798+0+0 (secure 0 0 0) 0x7f69d402ad10 con 0x7f69e406dea0 2024-09-17T05:44:17.948 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:17.946+0000 7f69dbfff640 1 --2- 172.21.15.150:0/3139529198 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f69c4078fb0 0x7f69c407b4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:44:17.948 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:17.947+0000 7f69dbfff640 1 -- 172.21.15.150:0/3139529198 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 5709+0+0 (secure 0 0 0) 0x7f69d40bc4a0 con 0x7f69e406dea0 2024-09-17T05:44:17.948 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:17.947+0000 7f69da7fc640 1 --2- 172.21.15.150:0/3139529198 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f69c4078fb0 0x7f69c407b4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:44:17.948 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:17.947+0000 7f69da7fc640 1 --2- 172.21.15.150:0/3139529198 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f69c4078fb0 0x7f69c407b4c0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f69e40d19f0 tx=0x7f69cc009260 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:44:17.952 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:17.952+0000 7f69dbfff640 1 -- 172.21.15.150:0/3139529198 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f69d403f030 con 0x7f69e406dea0 2024-09-17T05:44:18.156 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:18.155+0000 7f69e94b4640 1 -- 172.21.15.150:0/3139529198 --> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "sub_name": "sv1", "target": ["mon-mgr", ""]}) -- 0x7f69e40d4f30 con 0x7f69c4078fb0 2024-09-17T05:44:18.162 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:18.161+0000 7f69dbfff640 1 -- 172.21.15.150:0/3139529198 <== mgr.4108 v2:172.21.15.176:6800/3631216395 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+59 (secure 0 0 0) 0x7f69e40d4f30 con 0x7f69c4078fb0 2024-09-17T05:44:18.162 INFO:teuthology.orchestra.run.smithi150.stdout:/volumes/_nogroup/sv1/b7410b75-5328-4452-afd7-a02a01f63fb2 2024-09-17T05:44:18.164 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:18.163+0000 7f69e94b4640 1 -- 172.21.15.150:0/3139529198 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f69c4078fb0 msgr2=0x7f69c407b4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:44:18.164 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:18.163+0000 7f69e94b4640 1 --2- 172.21.15.150:0/3139529198 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f69c4078fb0 0x7f69c407b4c0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f69e40d19f0 tx=0x7f69cc009260 comp rx=0 tx=0).stop 2024-09-17T05:44:18.165 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:18.163+0000 7f69e94b4640 1 -- 172.21.15.150:0/3139529198 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f69e406dea0 msgr2=0x7f69e415d350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:44:18.165 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:18.163+0000 7f69e94b4640 1 --2- 172.21.15.150:0/3139529198 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f69e406dea0 0x7f69e415d350 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7f69d402aae0 tx=0x7f69d40049d0 comp rx=0 tx=0).stop 2024-09-17T05:44:18.165 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:18.164+0000 7f69e94b4640 1 -- 172.21.15.150:0/3139529198 shutdown_connections 2024-09-17T05:44:18.165 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:18.164+0000 7f69e94b4640 1 --2- 172.21.15.150:0/3139529198 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f69e40d5150 0x7f69e41549d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:18.165 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:18.164+0000 7f69e94b4640 1 --2- 172.21.15.150:0/3139529198 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f69c4078fb0 0x7f69c407b4c0 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:18.165 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:18.164+0000 7f69e94b4640 1 --2- 172.21.15.150:0/3139529198 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f69e406e2b0 0x7f69e40cc7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:18.165 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:18.164+0000 7f69e94b4640 1 --2- 172.21.15.150:0/3139529198 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f69e406dea0 0x7f69e415d350 unknown :-1 s=CLOSED pgs=494 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:18.165 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:18.164+0000 7f69e94b4640 1 -- 172.21.15.150:0/3139529198 >> 172.21.15.150:0/3139529198 conn(0x7f69e408bfe0 msgr2=0x7f69e40d1f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:44:18.165 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:18.164+0000 7f69e94b4640 1 -- 172.21.15.150:0/3139529198 shutdown_connections 2024-09-17T05:44:18.165 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:18.164+0000 7f69e94b4640 1 -- 172.21.15.150:0/3139529198 wait complete. 2024-09-17T05:44:18.176 DEBUG:tasks.cephfs.test_volumes:filling subvolume sv1 with 10 files each 1024MB size under directory volumes/_nogroup/sv1/b7410b75-5328-4452-afd7-a02a01f63fb2 2024-09-17T05:44:18.176 DEBUG:teuthology.orchestra.run.smithi150:> set -ex 2024-09-17T05:44:18.176 DEBUG:teuthology.orchestra.run.smithi150:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T05:44:18.193 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:44:18.193 DEBUG:teuthology.orchestra.run.smithi150:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/sv1/b7410b75-5328-4452-afd7-a02a01f63fb2/subvolume_file.0 bs=1M conv=fdatasync count=1024 seek=0) 2024-09-17T05:44:22.056 INFO:teuthology.orchestra.run.smithi150.stderr:1024+0 records in 2024-09-17T05:44:22.056 INFO:teuthology.orchestra.run.smithi150.stderr:1024+0 records out 2024-09-17T05:44:22.056 INFO:teuthology.orchestra.run.smithi150.stderr:1073741824 bytes (1.1 GB, 1.0 GiB) copied, 3.79921 s, 283 MB/s 2024-09-17T05:44:22.057 DEBUG:teuthology.orchestra.run.smithi150:> set -ex 2024-09-17T05:44:22.057 DEBUG:teuthology.orchestra.run.smithi150:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T05:44:22.072 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:44:22.073 DEBUG:teuthology.orchestra.run.smithi150:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/sv1/b7410b75-5328-4452-afd7-a02a01f63fb2/subvolume_file.1 bs=1M conv=fdatasync count=1024 seek=0) 2024-09-17T05:44:24.507 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-17T05:44:24.509 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-17T05:44:25.905 INFO:teuthology.orchestra.run.smithi150.stderr:1024+0 records in 2024-09-17T05:44:25.905 INFO:teuthology.orchestra.run.smithi150.stderr:1024+0 records out 2024-09-17T05:44:25.906 INFO:teuthology.orchestra.run.smithi150.stderr:1073741824 bytes (1.1 GB, 1.0 GiB) copied, 3.77571 s, 284 MB/s 2024-09-17T05:44:25.906 DEBUG:teuthology.orchestra.run.smithi150:> set -ex 2024-09-17T05:44:25.906 DEBUG:teuthology.orchestra.run.smithi150:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T05:44:25.921 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:44:25.921 DEBUG:teuthology.orchestra.run.smithi150:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/sv1/b7410b75-5328-4452-afd7-a02a01f63fb2/subvolume_file.2 bs=1M conv=fdatasync count=1024 seek=0) 2024-09-17T05:44:29.764 INFO:teuthology.orchestra.run.smithi150.stderr:1024+0 records in 2024-09-17T05:44:29.765 INFO:teuthology.orchestra.run.smithi150.stderr:1024+0 records out 2024-09-17T05:44:29.765 INFO:teuthology.orchestra.run.smithi150.stderr:1073741824 bytes (1.1 GB, 1.0 GiB) copied, 3.78625 s, 284 MB/s 2024-09-17T05:44:29.765 DEBUG:teuthology.orchestra.run.smithi150:> set -ex 2024-09-17T05:44:29.765 DEBUG:teuthology.orchestra.run.smithi150:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T05:44:29.781 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:44:29.781 DEBUG:teuthology.orchestra.run.smithi150:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/sv1/b7410b75-5328-4452-afd7-a02a01f63fb2/subvolume_file.3 bs=1M conv=fdatasync count=1024 seek=0) 2024-09-17T05:44:33.514 INFO:teuthology.orchestra.run.smithi150.stderr:1024+0 records in 2024-09-17T05:44:33.515 INFO:teuthology.orchestra.run.smithi150.stderr:1024+0 records out 2024-09-17T05:44:33.515 INFO:teuthology.orchestra.run.smithi150.stderr:1073741824 bytes (1.1 GB, 1.0 GiB) copied, 3.67686 s, 292 MB/s 2024-09-17T05:44:33.515 DEBUG:teuthology.orchestra.run.smithi150:> set -ex 2024-09-17T05:44:33.515 DEBUG:teuthology.orchestra.run.smithi150:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T05:44:33.531 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:44:33.531 DEBUG:teuthology.orchestra.run.smithi150:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/sv1/b7410b75-5328-4452-afd7-a02a01f63fb2/subvolume_file.4 bs=1M conv=fdatasync count=1024 seek=0) 2024-09-17T05:44:37.346 INFO:teuthology.orchestra.run.smithi150.stderr:1024+0 records in 2024-09-17T05:44:37.346 INFO:teuthology.orchestra.run.smithi150.stderr:1024+0 records out 2024-09-17T05:44:37.346 INFO:teuthology.orchestra.run.smithi150.stderr:1073741824 bytes (1.1 GB, 1.0 GiB) copied, 3.75681 s, 286 MB/s 2024-09-17T05:44:37.347 DEBUG:teuthology.orchestra.run.smithi150:> set -ex 2024-09-17T05:44:37.347 DEBUG:teuthology.orchestra.run.smithi150:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T05:44:37.363 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:44:37.363 DEBUG:teuthology.orchestra.run.smithi150:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/sv1/b7410b75-5328-4452-afd7-a02a01f63fb2/subvolume_file.5 bs=1M conv=fdatasync count=1024 seek=0) 2024-09-17T05:44:41.156 INFO:teuthology.orchestra.run.smithi150.stderr:1024+0 records in 2024-09-17T05:44:41.156 INFO:teuthology.orchestra.run.smithi150.stderr:1024+0 records out 2024-09-17T05:44:41.156 INFO:teuthology.orchestra.run.smithi150.stderr:1073741824 bytes (1.1 GB, 1.0 GiB) copied, 3.73552 s, 287 MB/s 2024-09-17T05:44:41.157 DEBUG:teuthology.orchestra.run.smithi150:> set -ex 2024-09-17T05:44:41.157 DEBUG:teuthology.orchestra.run.smithi150:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T05:44:41.173 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:44:41.173 DEBUG:teuthology.orchestra.run.smithi150:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/sv1/b7410b75-5328-4452-afd7-a02a01f63fb2/subvolume_file.6 bs=1M conv=fdatasync count=1024 seek=0) 2024-09-17T05:44:45.004 INFO:teuthology.orchestra.run.smithi150.stderr:1024+0 records in 2024-09-17T05:44:45.005 INFO:teuthology.orchestra.run.smithi150.stderr:1024+0 records out 2024-09-17T05:44:45.005 INFO:teuthology.orchestra.run.smithi150.stderr:1073741824 bytes (1.1 GB, 1.0 GiB) copied, 3.77288 s, 285 MB/s 2024-09-17T05:44:45.005 DEBUG:teuthology.orchestra.run.smithi150:> set -ex 2024-09-17T05:44:45.005 DEBUG:teuthology.orchestra.run.smithi150:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T05:44:45.021 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:44:45.021 DEBUG:teuthology.orchestra.run.smithi150:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/sv1/b7410b75-5328-4452-afd7-a02a01f63fb2/subvolume_file.7 bs=1M conv=fdatasync count=1024 seek=0) 2024-09-17T05:44:48.819 INFO:teuthology.orchestra.run.smithi150.stderr:1024+0 records in 2024-09-17T05:44:48.819 INFO:teuthology.orchestra.run.smithi150.stderr:1024+0 records out 2024-09-17T05:44:48.819 INFO:teuthology.orchestra.run.smithi150.stderr:1073741824 bytes (1.1 GB, 1.0 GiB) copied, 3.74027 s, 287 MB/s 2024-09-17T05:44:48.819 DEBUG:teuthology.orchestra.run.smithi150:> set -ex 2024-09-17T05:44:48.819 DEBUG:teuthology.orchestra.run.smithi150:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T05:44:48.836 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:44:48.836 DEBUG:teuthology.orchestra.run.smithi150:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/sv1/b7410b75-5328-4452-afd7-a02a01f63fb2/subvolume_file.8 bs=1M conv=fdatasync count=1024 seek=0) 2024-09-17T05:44:52.614 INFO:teuthology.orchestra.run.smithi150.stderr:1024+0 records in 2024-09-17T05:44:52.614 INFO:teuthology.orchestra.run.smithi150.stderr:1024+0 records out 2024-09-17T05:44:52.614 INFO:teuthology.orchestra.run.smithi150.stderr:1073741824 bytes (1.1 GB, 1.0 GiB) copied, 3.72028 s, 289 MB/s 2024-09-17T05:44:52.614 DEBUG:teuthology.orchestra.run.smithi150:> set -ex 2024-09-17T05:44:52.614 DEBUG:teuthology.orchestra.run.smithi150:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T05:44:52.630 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:44:52.631 DEBUG:teuthology.orchestra.run.smithi150:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/sv1/b7410b75-5328-4452-afd7-a02a01f63fb2/subvolume_file.9 bs=1M conv=fdatasync count=1024 seek=0) 2024-09-17T05:44:54.870 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-17T05:44:54.872 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-17T05:44:56.469 INFO:teuthology.orchestra.run.smithi150.stderr:1024+0 records in 2024-09-17T05:44:56.469 INFO:teuthology.orchestra.run.smithi150.stderr:1024+0 records out 2024-09-17T05:44:56.469 INFO:teuthology.orchestra.run.smithi150.stderr:1073741824 bytes (1.1 GB, 1.0 GiB) copied, 3.78157 s, 284 MB/s 2024-09-17T05:44:56.470 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume snapshot create cephfs sv1 ss1 2024-09-17T05:44:56.590 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:56.588+0000 7f63e6694640 1 -- 172.21.15.150:0/4009866056 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f63c8004e50 msgr2=0x7f63c800b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:44:56.591 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:56.588+0000 7f63e6694640 1 --2- 172.21.15.150:0/4009866056 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f63c8004e50 0x7f63c800b9c0 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7f63d8001f00 tx=0x7f63c8005830 comp rx=0 tx=0).stop 2024-09-17T05:44:56.591 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:56.588+0000 7f63e4c31640 1 -- 172.21.15.150:0/4009866056 reap_dead start 2024-09-17T05:44:56.591 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:56.588+0000 7f63e6694640 1 -- 172.21.15.150:0/4009866056 shutdown_connections 2024-09-17T05:44:56.591 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:56.588+0000 7f63e6694640 1 -- 172.21.15.150:0/4009866056 >> 172.21.15.150:0/4009866056 conn(0x7f63e009aa50 msgr2=0x7f63e00b2ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:44:56.591 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:56.588+0000 7f63e6694640 1 -- 172.21.15.150:0/4009866056 shutdown_connections 2024-09-17T05:44:56.591 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:56.589+0000 7f63e6694640 1 -- 172.21.15.150:0/4009866056 wait complete. 2024-09-17T05:44:56.591 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:56.590+0000 7f63e6694640 1 Processor -- start 2024-09-17T05:44:56.592 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:56.590+0000 7f63e6694640 1 -- start start 2024-09-17T05:44:56.595 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:56.592+0000 7f63e6694640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f63e016a300 0x7f63e00b02f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:44:56.595 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:56.592+0000 7f63e6694640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f63e00b0830 0x7f63e0168d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:44:56.595 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:56.592+0000 7f63e6694640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f63e0169270 0x7f63e0169680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:44:56.595 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:56.592+0000 7f63e6694640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f63e00b4470 con 0x7f63e016a300 2024-09-17T05:44:56.595 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:56.592+0000 7f63e6694640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f63e00b42f0 con 0x7f63e00b0830 2024-09-17T05:44:56.595 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:56.592+0000 7f63e6694640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f63e00b45f0 con 0x7f63e0169270 2024-09-17T05:44:56.596 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:56.592+0000 7f63dffff640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f63e016a300 0x7f63e00b02f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:44:56.596 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:56.592+0000 7f63dffff640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f63e016a300 0x7f63e00b02f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:55564/0 (socket says 172.21.15.150:55564) 2024-09-17T05:44:56.596 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:56.592+0000 7f63dffff640 1 -- 172.21.15.150:0/1961876417 learned_addr learned my addr 172.21.15.150:0/1961876417 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:44:56.596 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:56.592+0000 7f63e4c31640 1 --2- 172.21.15.150:0/1961876417 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f63e0169270 0x7f63e0169680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:44:56.596 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:56.592+0000 7f63df7fe640 1 --2- 172.21.15.150:0/1961876417 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f63e00b0830 0x7f63e0168d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:44:56.596 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:56.592+0000 7f63dffff640 1 -- 172.21.15.150:0/1961876417 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f63e0169270 msgr2=0x7f63e0169680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:44:56.597 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:56.592+0000 7f63dffff640 1 --2- 172.21.15.150:0/1961876417 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f63e0169270 0x7f63e0169680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:56.597 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:56.592+0000 7f63dffff640 1 -- 172.21.15.150:0/1961876417 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f63e00b0830 msgr2=0x7f63e0168d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:44:56.597 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:56.592+0000 7f63dffff640 1 --2- 172.21.15.150:0/1961876417 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f63e00b0830 0x7f63e0168d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:56.597 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:56.592+0000 7f63dffff640 1 -- 172.21.15.150:0/1961876417 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f63e00b1480 con 0x7f63e016a300 2024-09-17T05:44:56.597 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:56.592+0000 7f63dffff640 1 --2- 172.21.15.150:0/1961876417 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f63e016a300 0x7f63e00b02f0 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7f63d0001860 tx=0x7f63d0003aa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:44:56.597 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:56.593+0000 7f63dcff9640 1 -- 172.21.15.150:0/1961876417 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63d0015070 con 0x7f63e016a300 2024-09-17T05:44:56.597 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:56.593+0000 7f63dcff9640 1 -- 172.21.15.150:0/1961876417 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f63d0011900 con 0x7f63e016a300 2024-09-17T05:44:56.597 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:56.593+0000 7f63dcff9640 1 -- 172.21.15.150:0/1961876417 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63d0011d50 con 0x7f63e016a300 2024-09-17T05:44:56.597 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:56.593+0000 7f63e6694640 1 -- 172.21.15.150:0/1961876417 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f63e00b0c40 con 0x7f63e016a300 2024-09-17T05:44:56.597 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:56.593+0000 7f63e6694640 1 -- 172.21.15.150:0/1961876417 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f63e00b0ec0 con 0x7f63e016a300 2024-09-17T05:44:56.598 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:56.594+0000 7f63e6694640 1 -- 172.21.15.150:0/1961876417 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f63e00af8a0 con 0x7f63e016a300 2024-09-17T05:44:56.598 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:56.594+0000 7f63dcff9640 1 -- 172.21.15.150:0/1961876417 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 11) ==== 101849+0+0 (secure 0 0 0) 0x7f63d0018070 con 0x7f63e016a300 2024-09-17T05:44:56.598 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:56.595+0000 7f63dcff9640 1 --2- 172.21.15.150:0/1961876417 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f63cc079010 0x7f63cc07b520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:44:56.598 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:56.595+0000 7f63dcff9640 1 -- 172.21.15.150:0/1961876417 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 5767+0+0 (secure 0 0 0) 0x7f63d009c440 con 0x7f63e016a300 2024-09-17T05:44:56.599 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:56.595+0000 7f63df7fe640 1 --2- 172.21.15.150:0/1961876417 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f63cc079010 0x7f63cc07b520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:44:56.599 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:56.596+0000 7f63df7fe640 1 --2- 172.21.15.150:0/1961876417 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f63cc079010 0x7f63cc07b520 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f63e00b2d80 tx=0x7f63d4005f90 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:44:56.601 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:56.600+0000 7f63dcff9640 1 -- 172.21.15.150:0/1961876417 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f63e00b0c40 con 0x7f63e016a300 2024-09-17T05:44:56.809 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:56.808+0000 7f63e6694640 1 -- 172.21.15.150:0/1961876417 --> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] -- mgr_command(tid 0: {"prefix": "fs subvolume snapshot create", "vol_name": "cephfs", "sub_name": "sv1", "snap_name": "ss1", "target": ["mon-mgr", ""]}) -- 0x7f63e014f2e0 con 0x7f63cc079010 2024-09-17T05:44:56.822 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:56.821+0000 7f63dcff9640 1 -- 172.21.15.150:0/1961876417 <== mgr.4108 v2:172.21.15.176:6800/3631216395 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f63e014f2e0 con 0x7f63cc079010 2024-09-17T05:44:56.826 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:56.824+0000 7f63e6694640 1 -- 172.21.15.150:0/1961876417 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f63cc079010 msgr2=0x7f63cc07b520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:44:56.826 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:56.824+0000 7f63e6694640 1 --2- 172.21.15.150:0/1961876417 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f63cc079010 0x7f63cc07b520 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f63e00b2d80 tx=0x7f63d4005f90 comp rx=0 tx=0).stop 2024-09-17T05:44:56.826 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:56.824+0000 7f63e6694640 1 -- 172.21.15.150:0/1961876417 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f63e016a300 msgr2=0x7f63e00b02f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:44:56.827 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:56.824+0000 7f63e6694640 1 --2- 172.21.15.150:0/1961876417 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f63e016a300 0x7f63e00b02f0 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7f63d0001860 tx=0x7f63d0003aa0 comp rx=0 tx=0).stop 2024-09-17T05:44:56.827 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:56.824+0000 7f63e6694640 1 -- 172.21.15.150:0/1961876417 shutdown_connections 2024-09-17T05:44:56.827 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:56.824+0000 7f63e6694640 1 --2- 172.21.15.150:0/1961876417 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f63e00b0830 0x7f63e0168d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:56.827 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:56.824+0000 7f63e6694640 1 --2- 172.21.15.150:0/1961876417 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f63cc079010 0x7f63cc07b520 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:56.827 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:56.824+0000 7f63e6694640 1 --2- 172.21.15.150:0/1961876417 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f63e0169270 0x7f63e0169680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:56.827 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:56.824+0000 7f63e6694640 1 --2- 172.21.15.150:0/1961876417 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f63e016a300 0x7f63e00b02f0 unknown :-1 s=CLOSED pgs=497 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:56.828 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:56.824+0000 7f63e6694640 1 -- 172.21.15.150:0/1961876417 >> 172.21.15.150:0/1961876417 conn(0x7f63e009aa50 msgr2=0x7f63e015af50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:44:56.828 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:56.824+0000 7f63e6694640 1 -- 172.21.15.150:0/1961876417 shutdown_connections 2024-09-17T05:44:56.828 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:56.824+0000 7f63e6694640 1 -- 172.21.15.150:0/1961876417 wait complete. 2024-09-17T05:44:56.838 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume getpath cephfs sv1 2024-09-17T05:44:56.955 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:56.953+0000 7fe0a2b62640 1 -- 172.21.15.150:0/2665251557 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe09c0af730 msgr2=0x7fe09c0d0fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:44:56.955 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:56.953+0000 7fe0a2b62640 1 --2- 172.21.15.150:0/2665251557 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe09c0af730 0x7fe09c0d0fc0 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7fe09c0d1660 tx=0x7fe09402a440 comp rx=0 tx=0).stop 2024-09-17T05:44:56.955 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:56.953+0000 7fe0a2b62640 1 -- 172.21.15.150:0/2665251557 shutdown_connections 2024-09-17T05:44:56.955 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:56.953+0000 7fe0a2b62640 1 --2- 172.21.15.150:0/2665251557 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe09c0af730 0x7fe09c0d0fc0 unknown :-1 s=CLOSED pgs=498 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:56.955 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:56.953+0000 7fe0a2b62640 1 --2- 172.21.15.150:0/2665251557 >> v2:172.21.15.176:3300/0 conn(0x7fe09c0b7d70 0x7fe09c0d0a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:56.955 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:56.953+0000 7fe0a2b62640 1 --2- 172.21.15.150:0/2665251557 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe09c0b7960 0x7fe09c0af1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:56.956 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:56.953+0000 7fe0a2b62640 1 -- 172.21.15.150:0/2665251557 >> 172.21.15.150:0/2665251557 conn(0x7fe09c0cef20 msgr2=0x7fe09c0cf330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:44:56.956 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:56.953+0000 7fe0a2b62640 1 -- 172.21.15.150:0/2665251557 shutdown_connections 2024-09-17T05:44:56.956 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:56.953+0000 7fe0a2b62640 1 -- 172.21.15.150:0/2665251557 wait complete. 2024-09-17T05:44:56.956 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:56.955+0000 7fe0a2b62640 1 Processor -- start 2024-09-17T05:44:56.956 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:56.955+0000 7fe0a2b62640 1 -- start start 2024-09-17T05:44:56.959 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:56.956+0000 7fe0a2b62640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe09c0af730 0x7fe09c152920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:44:56.960 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:56.956+0000 7fe0a2b62640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe09c0b7960 0x7fe09c06f080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:44:56.960 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:56.956+0000 7fe0a2b62640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe09c0b7d70 0x7fe09c06f5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:44:56.960 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:56.956+0000 7fe0a2b62640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7fe09c0ceb90 con 0x7fe09c0af730 2024-09-17T05:44:56.960 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:56.956+0000 7fe0a2b62640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fe09c0b8310 con 0x7fe09c0b7d70 2024-09-17T05:44:56.960 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:56.956+0000 7fe0a2b62640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fe09c0ced10 con 0x7fe09c0b7960 2024-09-17T05:44:56.960 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:56.956+0000 7fe0a08fe640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe09c0af730 0x7fe09c152920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:44:56.960 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:56.956+0000 7fe0a08fe640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe09c0af730 0x7fe09c152920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:55590/0 (socket says 172.21.15.150:55590) 2024-09-17T05:44:56.960 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:56.957+0000 7fe0a08fe640 1 -- 172.21.15.150:0/2032782949 learned_addr learned my addr 172.21.15.150:0/2032782949 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:44:56.960 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:56.957+0000 7fe09bfff640 1 --2- 172.21.15.150:0/2032782949 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe09c0b7960 0x7fe09c06f080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:44:56.960 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:56.957+0000 7fe0a10ff640 1 --2- 172.21.15.150:0/2032782949 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe09c0b7d70 0x7fe09c06f5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:44:56.960 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:56.957+0000 7fe0a08fe640 1 -- 172.21.15.150:0/2032782949 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe09c0b7960 msgr2=0x7fe09c06f080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:44:56.961 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:56.957+0000 7fe0a08fe640 1 --2- 172.21.15.150:0/2032782949 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe09c0b7960 0x7fe09c06f080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:56.961 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:56.957+0000 7fe0a08fe640 1 -- 172.21.15.150:0/2032782949 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe09c0b7d70 msgr2=0x7fe09c06f5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:44:56.961 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:56.957+0000 7fe0a08fe640 1 --2- 172.21.15.150:0/2032782949 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe09c0b7d70 0x7fe09c06f5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:56.961 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:56.957+0000 7fe0a08fe640 1 -- 172.21.15.150:0/2032782949 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe09c06dfe0 con 0x7fe09c0af730 2024-09-17T05:44:56.961 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:56.957+0000 7fe0a08fe640 1 --2- 172.21.15.150:0/2032782949 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe09c0af730 0x7fe09c152920 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7fe08c00c8f0 tx=0x7fe08c00cdb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:44:56.961 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:56.957+0000 7fe0997fa640 1 -- 172.21.15.150:0/2032782949 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe08c00ae60 con 0x7fe09c0af730 2024-09-17T05:44:56.961 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:56.957+0000 7fe0997fa640 1 -- 172.21.15.150:0/2032782949 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe08c004330 con 0x7fe09c0af730 2024-09-17T05:44:56.961 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:56.957+0000 7fe0997fa640 1 -- 172.21.15.150:0/2032782949 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe08c007c10 con 0x7fe09c0af730 2024-09-17T05:44:56.961 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:56.957+0000 7fe0a2b62640 1 -- 172.21.15.150:0/2032782949 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe09c06e2c0 con 0x7fe09c0af730 2024-09-17T05:44:56.962 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:56.957+0000 7fe0a2b62640 1 -- 172.21.15.150:0/2032782949 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe09c06e880 con 0x7fe09c0af730 2024-09-17T05:44:56.962 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:56.958+0000 7fe0a2b62640 1 -- 172.21.15.150:0/2032782949 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe09c0af1f0 con 0x7fe09c0af730 2024-09-17T05:44:56.963 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:56.959+0000 7fe0997fa640 1 -- 172.21.15.150:0/2032782949 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 11) ==== 101849+0+0 (secure 0 0 0) 0x7fe08c003610 con 0x7fe09c0af730 2024-09-17T05:44:56.963 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:56.959+0000 7fe0997fa640 1 --2- 172.21.15.150:0/2032782949 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fe088079010 0x7fe08807b520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:44:56.964 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:56.959+0000 7fe0997fa640 1 -- 172.21.15.150:0/2032782949 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 5767+0+0 (secure 0 0 0) 0x7fe08c09b630 con 0x7fe09c0af730 2024-09-17T05:44:56.964 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:56.960+0000 7fe09bfff640 1 --2- 172.21.15.150:0/2032782949 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fe088079010 0x7fe08807b520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:44:56.964 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:56.960+0000 7fe09bfff640 1 --2- 172.21.15.150:0/2032782949 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fe088079010 0x7fe08807b520 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fe09c071f00 tx=0x7fe09000a550 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:44:56.965 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:56.964+0000 7fe0997fa640 1 -- 172.21.15.150:0/2032782949 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fe08c014030 con 0x7fe09c0af730 2024-09-17T05:44:57.167 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:57.165+0000 7fe0a2b62640 1 -- 172.21.15.150:0/2032782949 --> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "sub_name": "sv1", "target": ["mon-mgr", ""]}) -- 0x7fe09c0b7690 con 0x7fe088079010 2024-09-17T05:44:57.173 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:57.171+0000 7fe0997fa640 1 -- 172.21.15.150:0/2032782949 <== mgr.4108 v2:172.21.15.176:6800/3631216395 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+59 (secure 0 0 0) 0x7fe09c0b7690 con 0x7fe088079010 2024-09-17T05:44:57.173 INFO:teuthology.orchestra.run.smithi150.stdout:/volumes/_nogroup/sv1/b7410b75-5328-4452-afd7-a02a01f63fb2 2024-09-17T05:44:57.175 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:57.173+0000 7fe0a2b62640 1 -- 172.21.15.150:0/2032782949 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fe088079010 msgr2=0x7fe08807b520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:44:57.176 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:57.173+0000 7fe0a2b62640 1 --2- 172.21.15.150:0/2032782949 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fe088079010 0x7fe08807b520 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fe09c071f00 tx=0x7fe09000a550 comp rx=0 tx=0).stop 2024-09-17T05:44:57.176 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:57.173+0000 7fe0a2b62640 1 -- 172.21.15.150:0/2032782949 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe09c0af730 msgr2=0x7fe09c152920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:44:57.176 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:57.173+0000 7fe0a2b62640 1 --2- 172.21.15.150:0/2032782949 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe09c0af730 0x7fe09c152920 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7fe08c00c8f0 tx=0x7fe08c00cdb0 comp rx=0 tx=0).stop 2024-09-17T05:44:57.176 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:57.174+0000 7fe0a2b62640 1 -- 172.21.15.150:0/2032782949 shutdown_connections 2024-09-17T05:44:57.176 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:57.174+0000 7fe0a2b62640 1 --2- 172.21.15.150:0/2032782949 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe09c0b7d70 0x7fe09c06f5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:57.176 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:57.174+0000 7fe0a2b62640 1 --2- 172.21.15.150:0/2032782949 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fe088079010 0x7fe08807b520 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:57.176 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:57.174+0000 7fe0a2b62640 1 --2- 172.21.15.150:0/2032782949 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe09c0b7960 0x7fe09c06f080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:57.176 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:57.174+0000 7fe0a2b62640 1 --2- 172.21.15.150:0/2032782949 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe09c0af730 0x7fe09c152920 unknown :-1 s=CLOSED pgs=499 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:57.176 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:57.174+0000 7fe0a2b62640 1 -- 172.21.15.150:0/2032782949 >> 172.21.15.150:0/2032782949 conn(0x7fe09c0cef20 msgr2=0x7fe09c072450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:44:57.176 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:57.174+0000 7fe0a2b62640 1 -- 172.21.15.150:0/2032782949 shutdown_connections 2024-09-17T05:44:57.177 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:57.174+0000 7fe0a2b62640 1 -- 172.21.15.150:0/2032782949 wait complete. 2024-09-17T05:44:57.187 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:44:57.187 DEBUG:teuthology.orchestra.run.smithi150:> (cd /home/ubuntu/cephtest/mnt.0 && exec getfattr -n ceph.dir.rbytes volumes/_nogroup/sv1/b7410b75-5328-4452-afd7-a02a01f63fb2 2024-09-17T05:44:57.187 DEBUG:teuthology.orchestra.run.smithi150:> ) 2024-09-17T05:44:57.203 INFO:teuthology.orchestra.run.smithi150.stdout:# file: volumes/_nogroup/sv1/b7410b75-5328-4452-afd7-a02a01f63fb2 2024-09-17T05:44:57.203 INFO:teuthology.orchestra.run.smithi150.stdout:ceph.dir.rbytes="9990258688" 2024-09-17T05:44:57.203 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-09-17T05:44:57.204 INFO:tasks.cephfs.test_volumes:r_size = 9990258688 exp_size = 10737418240 2024-09-17T05:44:59.204 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:44:59.205 DEBUG:teuthology.orchestra.run.smithi150:> (cd /home/ubuntu/cephtest/mnt.0 && exec getfattr -n ceph.dir.rbytes volumes/_nogroup/sv1/b7410b75-5328-4452-afd7-a02a01f63fb2 2024-09-17T05:44:59.205 DEBUG:teuthology.orchestra.run.smithi150:> ) 2024-09-17T05:44:59.225 INFO:teuthology.orchestra.run.smithi150.stdout:# file: volumes/_nogroup/sv1/b7410b75-5328-4452-afd7-a02a01f63fb2 2024-09-17T05:44:59.225 INFO:teuthology.orchestra.run.smithi150.stdout:ceph.dir.rbytes="10737418240" 2024-09-17T05:44:59.225 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-09-17T05:44:59.226 INFO:tasks.cephfs.test_volumes:r_size = 10737418240 exp_size = 10737418240 2024-09-17T05:44:59.226 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume snapshot clone cephfs sv1 ss1 subvol_clone83860 2024-09-17T05:44:59.400 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:59.398+0000 7f5f8c9f1640 1 -- 172.21.15.150:0/191100880 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5f880ccc50 msgr2=0x7f5f880cf570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:44:59.400 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:59.398+0000 7f5f8c9f1640 1 --2- 172.21.15.150:0/191100880 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5f880ccc50 0x7f5f880cf570 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7f5f78005fd0 tx=0x7f5f7802a970 comp rx=0 tx=0).stop 2024-09-17T05:44:59.400 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:59.398+0000 7f5f8c9f1640 1 -- 172.21.15.150:0/191100880 shutdown_connections 2024-09-17T05:44:59.400 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:59.398+0000 7f5f8c9f1640 1 --2- 172.21.15.150:0/191100880 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5f880cfab0 0x7f5f88073630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:59.401 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:59.398+0000 7f5f8c9f1640 1 --2- 172.21.15.150:0/191100880 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5f880ccc50 0x7f5f880cf570 unknown :-1 s=CLOSED pgs=500 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:59.401 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:59.398+0000 7f5f8c9f1640 1 -- 172.21.15.150:0/191100880 >> 172.21.15.150:0/191100880 conn(0x7f5f8806d1c0 msgr2=0x7f5f8806d5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:44:59.401 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:59.398+0000 7f5f8c9f1640 1 -- 172.21.15.150:0/191100880 shutdown_connections 2024-09-17T05:44:59.401 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:59.398+0000 7f5f8c9f1640 1 -- 172.21.15.150:0/191100880 wait complete. 2024-09-17T05:44:59.407 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:59.400+0000 7f5f8c9f1640 1 Processor -- start 2024-09-17T05:44:59.407 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:59.400+0000 7f5f8c9f1640 1 -- start start 2024-09-17T05:44:59.407 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:59.402+0000 7f5f8c9f1640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5f88073b70 0x7f5f8814e9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:44:59.408 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:59.402+0000 7f5f8c9f1640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5f880ccc50 0x7f5f8814ef00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:44:59.408 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:59.402+0000 7f5f8c9f1640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5f880cfab0 0x7f5f881f6e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:44:59.408 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:59.402+0000 7f5f8c9f1640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f5f8815fa00 con 0x7f5f88073b70 2024-09-17T05:44:59.408 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:59.402+0000 7f5f8c9f1640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f5f8815f880 con 0x7f5f880ccc50 2024-09-17T05:44:59.408 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:59.402+0000 7f5f8c9f1640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f5f8815fb80 con 0x7f5f880cfab0 2024-09-17T05:44:59.409 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:59.402+0000 7f5f8659c640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5f88073b70 0x7f5f8814e9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:44:59.409 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:59.402+0000 7f5f8659c640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5f88073b70 0x7f5f8814e9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:55620/0 (socket says 172.21.15.150:55620) 2024-09-17T05:44:59.409 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:59.402+0000 7f5f8659c640 1 -- 172.21.15.150:0/798578791 learned_addr learned my addr 172.21.15.150:0/798578791 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:44:59.409 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:59.402+0000 7f5f85d9b640 1 --2- 172.21.15.150:0/798578791 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5f880ccc50 0x7f5f8814ef00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:44:59.410 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:59.402+0000 7f5f86d9d640 1 --2- 172.21.15.150:0/798578791 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5f880cfab0 0x7f5f881f6e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:44:59.410 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:59.402+0000 7f5f8659c640 1 -- 172.21.15.150:0/798578791 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5f880cfab0 msgr2=0x7f5f881f6e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:44:59.410 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:59.402+0000 7f5f8659c640 1 --2- 172.21.15.150:0/798578791 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5f880cfab0 0x7f5f881f6e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:59.410 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:59.402+0000 7f5f8659c640 1 -- 172.21.15.150:0/798578791 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5f880ccc50 msgr2=0x7f5f8814ef00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:44:59.410 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:59.402+0000 7f5f8659c640 1 --2- 172.21.15.150:0/798578791 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5f880ccc50 0x7f5f8814ef00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:59.410 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:59.402+0000 7f5f8659c640 1 -- 172.21.15.150:0/798578791 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5f881f4610 con 0x7f5f88073b70 2024-09-17T05:44:59.411 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:59.402+0000 7f5f8659c640 1 --2- 172.21.15.150:0/798578791 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5f88073b70 0x7f5f8814e9c0 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7f5f78006010 tx=0x7f5f78003f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:44:59.411 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:59.402+0000 7f5f76ffd640 1 -- 172.21.15.150:0/798578791 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f78034040 con 0x7f5f88073b70 2024-09-17T05:44:59.411 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:59.402+0000 7f5f76ffd640 1 -- 172.21.15.150:0/798578791 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f5f780045c0 con 0x7f5f88073b70 2024-09-17T05:44:59.411 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:59.403+0000 7f5f76ffd640 1 -- 172.21.15.150:0/798578791 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f78045480 con 0x7f5f88073b70 2024-09-17T05:44:59.411 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:59.403+0000 7f5f8c9f1640 1 -- 172.21.15.150:0/798578791 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5f881f3890 con 0x7f5f88073b70 2024-09-17T05:44:59.411 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:59.403+0000 7f5f8c9f1640 1 -- 172.21.15.150:0/798578791 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5f881f3b30 con 0x7f5f88073b70 2024-09-17T05:44:59.412 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:59.404+0000 7f5f8c9f1640 1 -- 172.21.15.150:0/798578791 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5f880cf570 con 0x7f5f88073b70 2024-09-17T05:44:59.412 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:59.404+0000 7f5f76ffd640 1 -- 172.21.15.150:0/798578791 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 11) ==== 101849+0+0 (secure 0 0 0) 0x7f5f78037020 con 0x7f5f88073b70 2024-09-17T05:44:59.412 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:59.405+0000 7f5f76ffd640 1 --2- 172.21.15.150:0/798578791 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f5f68079010 0x7f5f6807b520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:44:59.412 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:59.405+0000 7f5f76ffd640 1 -- 172.21.15.150:0/798578791 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 5767+0+0 (secure 0 0 0) 0x7f5f780bcec0 con 0x7f5f88073b70 2024-09-17T05:44:59.412 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:59.405+0000 7f5f85d9b640 1 --2- 172.21.15.150:0/798578791 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f5f68079010 0x7f5f6807b520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:44:59.412 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:59.406+0000 7f5f85d9b640 1 --2- 172.21.15.150:0/798578791 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f5f68079010 0x7f5f6807b520 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f5f880cca40 tx=0x7f5f7c00b2e0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:44:59.413 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:59.409+0000 7f5f76ffd640 1 -- 172.21.15.150:0/798578791 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f5f88073f80 con 0x7f5f88073b70 2024-09-17T05:44:59.619 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:59.619+0000 7f5f8c9f1640 1 -- 172.21.15.150:0/798578791 --> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] -- mgr_command(tid 0: {"prefix": "fs subvolume snapshot clone", "vol_name": "cephfs", "sub_name": "sv1", "snap_name": "ss1", "target_sub_name": "subvol_clone83860", "target": ["mon-mgr", ""]}) -- 0x7f5f880b22a0 con 0x7f5f68079010 2024-09-17T05:44:59.680 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:59.679+0000 7f5f76ffd640 1 -- 172.21.15.150:0/798578791 <== mgr.4108 v2:172.21.15.176:6800/3631216395 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f5f880b22a0 con 0x7f5f68079010 2024-09-17T05:44:59.683 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:59.681+0000 7f5f8c9f1640 1 -- 172.21.15.150:0/798578791 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f5f68079010 msgr2=0x7f5f6807b520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:44:59.683 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:59.681+0000 7f5f8c9f1640 1 --2- 172.21.15.150:0/798578791 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f5f68079010 0x7f5f6807b520 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f5f880cca40 tx=0x7f5f7c00b2e0 comp rx=0 tx=0).stop 2024-09-17T05:44:59.683 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:59.681+0000 7f5f8c9f1640 1 -- 172.21.15.150:0/798578791 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5f88073b70 msgr2=0x7f5f8814e9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:44:59.683 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:59.681+0000 7f5f8c9f1640 1 --2- 172.21.15.150:0/798578791 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5f88073b70 0x7f5f8814e9c0 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7f5f78006010 tx=0x7f5f78003f10 comp rx=0 tx=0).stop 2024-09-17T05:44:59.684 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:59.681+0000 7f5f8c9f1640 1 -- 172.21.15.150:0/798578791 shutdown_connections 2024-09-17T05:44:59.684 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:59.681+0000 7f5f8c9f1640 1 --2- 172.21.15.150:0/798578791 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5f880ccc50 0x7f5f8814ef00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:59.684 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:59.681+0000 7f5f8c9f1640 1 --2- 172.21.15.150:0/798578791 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f5f68079010 0x7f5f6807b520 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:59.684 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:59.681+0000 7f5f8c9f1640 1 --2- 172.21.15.150:0/798578791 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5f880cfab0 0x7f5f881f6e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:59.685 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:59.681+0000 7f5f8c9f1640 1 --2- 172.21.15.150:0/798578791 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5f88073b70 0x7f5f8814e9c0 unknown :-1 s=CLOSED pgs=501 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:59.685 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:59.681+0000 7f5f8c9f1640 1 -- 172.21.15.150:0/798578791 >> 172.21.15.150:0/798578791 conn(0x7f5f8806d1c0 msgr2=0x7f5f880b2aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:44:59.685 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:59.682+0000 7f5f8c9f1640 1 -- 172.21.15.150:0/798578791 shutdown_connections 2024-09-17T05:44:59.685 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:59.682+0000 7f5f8c9f1640 1 -- 172.21.15.150:0/798578791 wait complete. 2024-09-17T05:44:59.694 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume snapshot clone cephfs sv1 ss1 subvol_clone43941 2024-09-17T05:44:59.772 INFO:tasks.ceph.mgr.x.smithi176.stderr:2024-09-17T05:44:59.771+0000 7f33dbf23640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-17T05:44:59.772 INFO:tasks.ceph.mgr.x.smithi176.stderr:2024-09-17T05:44:59.771+0000 7f33dbf23640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-17T05:44:59.772 INFO:tasks.ceph.mgr.x.smithi176.stderr:2024-09-17T05:44:59.771+0000 7f33dbf23640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-17T05:44:59.773 INFO:tasks.ceph.mgr.x.smithi176.stderr:2024-09-17T05:44:59.771+0000 7f33dbf23640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-17T05:44:59.773 INFO:tasks.ceph.mgr.x.smithi176.stderr:2024-09-17T05:44:59.771+0000 7f33dbf23640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-17T05:44:59.787 INFO:tasks.ceph.mgr.x.smithi176.stderr:2024-09-17T05:44:59.786+0000 7f33dd726640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-17T05:44:59.787 INFO:tasks.ceph.mgr.x.smithi176.stderr:2024-09-17T05:44:59.786+0000 7f33dd726640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-17T05:44:59.787 INFO:tasks.ceph.mgr.x.smithi176.stderr:2024-09-17T05:44:59.786+0000 7f33dd726640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-17T05:44:59.787 INFO:tasks.ceph.mgr.x.smithi176.stderr:2024-09-17T05:44:59.786+0000 7f33dd726640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-17T05:44:59.787 INFO:tasks.ceph.mgr.x.smithi176.stderr:2024-09-17T05:44:59.786+0000 7f33dd726640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-17T05:44:59.819 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:59.818+0000 7f8eb71da640 1 -- 172.21.15.150:0/2953532639 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8eb015fa30 msgr2=0x7f8eb015fe40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:44:59.819 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:59.818+0000 7f8eb71da640 1 --2- 172.21.15.150:0/2953532639 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8eb015fa30 0x7f8eb015fe40 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7f8eb0072b00 tx=0x7f8ea802a440 comp rx=0 tx=0).stop 2024-09-17T05:44:59.819 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:59.818+0000 7f8eb71da640 1 -- 172.21.15.150:0/2953532639 shutdown_connections 2024-09-17T05:44:59.819 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:59.818+0000 7f8eb71da640 1 --2- 172.21.15.150:0/2953532639 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8eb015fa30 0x7f8eb015fe40 unknown :-1 s=CLOSED pgs=502 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:59.819 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:59.818+0000 7f8eb71da640 1 --2- 172.21.15.150:0/2953532639 >> v2:172.21.15.176:3300/0 conn(0x7f8eb00b0fe0 0x7f8eb00b13f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:59.819 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:59.818+0000 7f8eb71da640 1 --2- 172.21.15.150:0/2953532639 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8eb00b25e0 0x7f8eb00b1ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:59.820 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:59.818+0000 7f8eb71da640 1 -- 172.21.15.150:0/2953532639 >> 172.21.15.150:0/2953532639 conn(0x7f8eb00b2ff0 msgr2=0x7f8eb00b3400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:44:59.820 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:59.818+0000 7f8eb71da640 1 -- 172.21.15.150:0/2953532639 shutdown_connections 2024-09-17T05:44:59.820 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:59.818+0000 7f8eb71da640 1 -- 172.21.15.150:0/2953532639 wait complete. 2024-09-17T05:44:59.821 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:59.820+0000 7f8eb71da640 1 Processor -- start 2024-09-17T05:44:59.821 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:59.821+0000 7f8eb71da640 1 -- start start 2024-09-17T05:44:59.824 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:59.822+0000 7f8eb71da640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8eb00b0fe0 0x7f8eb01489e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:44:59.824 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:59.822+0000 7f8eb71da640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8eb00b25e0 0x7f8eb00b5da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:44:59.824 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:59.822+0000 7f8eb71da640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8eb015fa30 0x7f8eb00b62e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:44:59.824 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:59.822+0000 7f8eb71da640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f8eb00cf510 con 0x7f8eb00b0fe0 2024-09-17T05:44:59.824 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:59.822+0000 7f8eb71da640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f8eb00cf390 con 0x7f8eb015fa30 2024-09-17T05:44:59.824 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:59.822+0000 7f8eb71da640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f8eb00cf690 con 0x7f8eb00b25e0 2024-09-17T05:44:59.825 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:59.822+0000 7f8eb4f76640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8eb00b0fe0 0x7f8eb01489e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:44:59.825 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:59.822+0000 7f8eb4f76640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8eb00b0fe0 0x7f8eb01489e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:55642/0 (socket says 172.21.15.150:55642) 2024-09-17T05:44:59.825 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:59.822+0000 7f8eb4f76640 1 -- 172.21.15.150:0/2610173193 learned_addr learned my addr 172.21.15.150:0/2610173193 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:44:59.825 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:59.822+0000 7f8eaffff640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8eb00b25e0 0x7f8eb00b5da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:44:59.825 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:59.822+0000 7f8eb5777640 1 --2- 172.21.15.150:0/2610173193 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8eb015fa30 0x7f8eb00b62e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:44:59.825 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:59.823+0000 7f8eb4f76640 1 -- 172.21.15.150:0/2610173193 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8eb00b25e0 msgr2=0x7f8eb00b5da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:44:59.825 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:59.823+0000 7f8eb4f76640 1 --2- 172.21.15.150:0/2610173193 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8eb00b25e0 0x7f8eb00b5da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:59.825 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:59.823+0000 7f8eb4f76640 1 -- 172.21.15.150:0/2610173193 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8eb015fa30 msgr2=0x7f8eb00b62e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:44:59.825 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:59.823+0000 7f8eb4f76640 1 --2- 172.21.15.150:0/2610173193 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8eb015fa30 0x7f8eb00b62e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:59.825 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:59.823+0000 7f8eb4f76640 1 -- 172.21.15.150:0/2610173193 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8eb0148f20 con 0x7f8eb00b0fe0 2024-09-17T05:44:59.825 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:59.823+0000 7f8eb4f76640 1 --2- 172.21.15.150:0/2610173193 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8eb00b0fe0 0x7f8eb01489e0 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7f8e9800e7c0 tx=0x7f8e9800ebc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:44:59.825 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:59.823+0000 7f8ead7fa640 1 -- 172.21.15.150:0/2610173193 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e9800cab0 con 0x7f8eb00b0fe0 2024-09-17T05:44:59.825 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:59.823+0000 7f8ead7fa640 1 -- 172.21.15.150:0/2610173193 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8e9800cc50 con 0x7f8eb00b0fe0 2024-09-17T05:44:59.826 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:59.823+0000 7f8eb71da640 1 -- 172.21.15.150:0/2610173193 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8eb0158080 con 0x7f8eb00b0fe0 2024-09-17T05:44:59.826 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:59.823+0000 7f8ead7fa640 1 -- 172.21.15.150:0/2610173193 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e98005020 con 0x7f8eb00b0fe0 2024-09-17T05:44:59.826 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:59.823+0000 7f8eb71da640 1 -- 172.21.15.150:0/2610173193 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8eb0146330 con 0x7f8eb00b0fe0 2024-09-17T05:44:59.827 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:59.825+0000 7f8eb71da640 1 -- 172.21.15.150:0/2610173193 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8eb00af970 con 0x7f8eb00b0fe0 2024-09-17T05:44:59.827 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:59.825+0000 7f8ead7fa640 1 -- 172.21.15.150:0/2610173193 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 11) ==== 101849+0+0 (secure 0 0 0) 0x7f8e980051c0 con 0x7f8eb00b0fe0 2024-09-17T05:44:59.827 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:59.825+0000 7f8ead7fa640 1 --2- 172.21.15.150:0/2610173193 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f8e90079010 0x7f8e9007b520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:44:59.827 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:59.826+0000 7f8ead7fa640 1 -- 172.21.15.150:0/2610173193 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 5767+0+0 (secure 0 0 0) 0x7f8e9809bf40 con 0x7f8eb00b0fe0 2024-09-17T05:44:59.827 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:59.826+0000 7f8eaffff640 1 --2- 172.21.15.150:0/2610173193 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f8e90079010 0x7f8e9007b520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:44:59.827 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:59.826+0000 7f8eaffff640 1 --2- 172.21.15.150:0/2610173193 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f8e90079010 0x7f8e9007b520 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f8eb006de60 tx=0x7f8ea0012040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:44:59.831 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:44:59.830+0000 7f8ead7fa640 1 -- 172.21.15.150:0/2610173193 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f8eb00af970 con 0x7f8eb00b0fe0 2024-09-17T05:45:00.037 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:00.036+0000 7f8eb71da640 1 -- 172.21.15.150:0/2610173193 --> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] -- mgr_command(tid 0: {"prefix": "fs subvolume snapshot clone", "vol_name": "cephfs", "sub_name": "sv1", "snap_name": "ss1", "target_sub_name": "subvol_clone43941", "target": ["mon-mgr", ""]}) -- 0x7f8eb00c69b0 con 0x7f8e90079010 2024-09-17T05:45:00.684 INFO:tasks.ceph.mgr.x.smithi176.stderr:2024-09-17T05:45:00.683+0000 7f33cf68a640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-17T05:45:00.685 INFO:tasks.ceph.mgr.x.smithi176.stderr:2024-09-17T05:45:00.683+0000 7f33cf68a640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-17T05:45:00.685 INFO:tasks.ceph.mgr.x.smithi176.stderr:2024-09-17T05:45:00.683+0000 7f33cf68a640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-17T05:45:00.685 INFO:tasks.ceph.mgr.x.smithi176.stderr:2024-09-17T05:45:00.683+0000 7f33cf68a640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-17T05:45:00.685 INFO:tasks.ceph.mgr.x.smithi176.stderr:2024-09-17T05:45:00.683+0000 7f33cf68a640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-17T05:45:00.805 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:00.804+0000 7f8ead7fa640 1 -- 172.21.15.150:0/2610173193 <== mgr.4108 v2:172.21.15.176:6800/3631216395 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f8eb00c69b0 con 0x7f8e90079010 2024-09-17T05:45:00.810 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:00.809+0000 7f8eb71da640 1 -- 172.21.15.150:0/2610173193 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f8e90079010 msgr2=0x7f8e9007b520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:45:00.810 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:00.809+0000 7f8eb71da640 1 --2- 172.21.15.150:0/2610173193 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f8e90079010 0x7f8e9007b520 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f8eb006de60 tx=0x7f8ea0012040 comp rx=0 tx=0).stop 2024-09-17T05:45:00.810 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:00.809+0000 7f8eb71da640 1 -- 172.21.15.150:0/2610173193 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8eb00b0fe0 msgr2=0x7f8eb01489e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:45:00.810 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:00.809+0000 7f8eb71da640 1 --2- 172.21.15.150:0/2610173193 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8eb00b0fe0 0x7f8eb01489e0 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7f8e9800e7c0 tx=0x7f8e9800ebc0 comp rx=0 tx=0).stop 2024-09-17T05:45:00.810 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:00.809+0000 7f8eb71da640 1 -- 172.21.15.150:0/2610173193 shutdown_connections 2024-09-17T05:45:00.810 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:00.809+0000 7f8eb71da640 1 --2- 172.21.15.150:0/2610173193 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8eb015fa30 0x7f8eb00b62e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:00.811 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:00.809+0000 7f8eb71da640 1 --2- 172.21.15.150:0/2610173193 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f8e90079010 0x7f8e9007b520 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:00.811 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:00.809+0000 7f8eb71da640 1 --2- 172.21.15.150:0/2610173193 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8eb00b25e0 0x7f8eb00b5da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:00.811 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:00.809+0000 7f8eb71da640 1 --2- 172.21.15.150:0/2610173193 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8eb00b0fe0 0x7f8eb01489e0 unknown :-1 s=CLOSED pgs=503 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:00.811 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:00.809+0000 7f8eb71da640 1 -- 172.21.15.150:0/2610173193 >> 172.21.15.150:0/2610173193 conn(0x7f8eb00b2ff0 msgr2=0x7f8eb0154b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:45:00.811 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:00.809+0000 7f8eb71da640 1 -- 172.21.15.150:0/2610173193 shutdown_connections 2024-09-17T05:45:00.811 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:00.809+0000 7f8eb71da640 1 -- 172.21.15.150:0/2610173193 wait complete. 2024-09-17T05:45:00.830 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume snapshot clone cephfs sv1 ss1 subvol_clone99852 2024-09-17T05:45:00.835 INFO:tasks.ceph.mgr.x.smithi176.stderr:2024-09-17T05:45:00.834+0000 7f33dcf25640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-17T05:45:00.835 INFO:tasks.ceph.mgr.x.smithi176.stderr:2024-09-17T05:45:00.834+0000 7f33dcf25640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-17T05:45:00.835 INFO:tasks.ceph.mgr.x.smithi176.stderr:2024-09-17T05:45:00.834+0000 7f33dcf25640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-17T05:45:00.835 INFO:tasks.ceph.mgr.x.smithi176.stderr:2024-09-17T05:45:00.834+0000 7f33dcf25640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-17T05:45:00.836 INFO:tasks.ceph.mgr.x.smithi176.stderr:2024-09-17T05:45:00.834+0000 7f33dcf25640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-17T05:45:01.015 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:01.013+0000 7ff63cd41640 1 -- 172.21.15.150:0/1756575274 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff638073630 msgr2=0x7ff638073a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:45:01.015 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:01.013+0000 7ff63cd41640 1 --2- 172.21.15.150:0/1756575274 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff638073630 0x7ff638073a40 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7ff6380ceaf0 tx=0x7ff62002a560 comp rx=0 tx=0).stop 2024-09-17T05:45:01.015 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:01.013+0000 7ff63cd41640 1 -- 172.21.15.150:0/1756575274 shutdown_connections 2024-09-17T05:45:01.015 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:01.014+0000 7ff63cd41640 1 --2- 172.21.15.150:0/1756575274 >> v2:172.21.15.176:3300/0 conn(0x7ff63815ccf0 0x7ff63815d100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:01.015 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:01.014+0000 7ff63cd41640 1 --2- 172.21.15.150:0/1756575274 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff638073630 0x7ff638073a40 unknown :-1 s=CLOSED pgs=504 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:01.015 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:01.014+0000 7ff63cd41640 1 -- 172.21.15.150:0/1756575274 >> 172.21.15.150:0/1756575274 conn(0x7ff63806d1c0 msgr2=0x7ff63806d5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:45:01.015 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:01.014+0000 7ff63cd41640 1 -- 172.21.15.150:0/1756575274 shutdown_connections 2024-09-17T05:45:01.015 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:01.014+0000 7ff63cd41640 1 -- 172.21.15.150:0/1756575274 wait complete. 2024-09-17T05:45:01.018 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:01.017+0000 7ff63cd41640 1 Processor -- start 2024-09-17T05:45:01.018 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:01.018+0000 7ff63cd41640 1 -- start start 2024-09-17T05:45:01.022 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:01.020+0000 7ff63cd41640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff638073630 0x7ff638143e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:45:01.022 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:01.020+0000 7ff63cd41640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff6380ccc50 0x7ff63814e860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:45:01.022 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:01.020+0000 7ff63cd41640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff63815ccf0 0x7ff63814f4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:45:01.022 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:01.020+0000 7ff63cd41640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7ff63815d7c0 con 0x7ff63815ccf0 2024-09-17T05:45:01.022 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:01.020+0000 7ff63cd41640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7ff63815d640 con 0x7ff638073630 2024-09-17T05:45:01.022 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:01.020+0000 7ff63cd41640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7ff63815d940 con 0x7ff6380ccc50 2024-09-17T05:45:01.022 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:01.020+0000 7ff636d9d640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff63815ccf0 0x7ff63814f4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:45:01.022 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:01.020+0000 7ff636d9d640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff63815ccf0 0x7ff63814f4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:56988/0 (socket says 172.21.15.150:56988) 2024-09-17T05:45:01.022 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:01.020+0000 7ff636d9d640 1 -- 172.21.15.150:0/675481437 learned_addr learned my addr 172.21.15.150:0/675481437 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:45:01.022 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:01.020+0000 7ff636d9d640 1 -- 172.21.15.150:0/675481437 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff6380ccc50 msgr2=0x7ff63814e860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:45:01.023 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:01.020+0000 7ff636d9d640 1 --2- 172.21.15.150:0/675481437 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff6380ccc50 0x7ff63814e860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:01.023 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:01.020+0000 7ff63659c640 1 --2- 172.21.15.150:0/675481437 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff638073630 0x7ff638143e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:45:01.023 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:01.020+0000 7ff636d9d640 1 -- 172.21.15.150:0/675481437 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff638073630 msgr2=0x7ff638143e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:45:01.023 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:01.020+0000 7ff636d9d640 1 --2- 172.21.15.150:0/675481437 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff638073630 0x7ff638143e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:01.023 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:01.020+0000 7ff636d9d640 1 -- 172.21.15.150:0/675481437 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff63815a880 con 0x7ff63815ccf0 2024-09-17T05:45:01.023 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:01.021+0000 7ff63659c640 1 --2- 172.21.15.150:0/675481437 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff638073630 0x7ff638143e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T05:45:01.023 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:01.021+0000 7ff636d9d640 1 --2- 172.21.15.150:0/675481437 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff63815ccf0 0x7ff63814f4e0 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7ff630010f90 tx=0x7ff63000e490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:45:01.023 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:01.021+0000 7ff62effd640 1 -- 172.21.15.150:0/675481437 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff63001a030 con 0x7ff63815ccf0 2024-09-17T05:45:01.023 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:01.021+0000 7ff62effd640 1 -- 172.21.15.150:0/675481437 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff63000ed30 con 0x7ff63815ccf0 2024-09-17T05:45:01.023 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:01.021+0000 7ff63cd41640 1 -- 172.21.15.150:0/675481437 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff63815ab60 con 0x7ff63815ccf0 2024-09-17T05:45:01.023 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:01.021+0000 7ff62effd640 1 -- 172.21.15.150:0/675481437 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff63000be60 con 0x7ff63815ccf0 2024-09-17T05:45:01.023 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:01.021+0000 7ff63cd41640 1 -- 172.21.15.150:0/675481437 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff638157400 con 0x7ff63815ccf0 2024-09-17T05:45:01.025 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:01.024+0000 7ff63cd41640 1 -- 172.21.15.150:0/675481437 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff63815b080 con 0x7ff63815ccf0 2024-09-17T05:45:01.026 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:01.025+0000 7ff62effd640 1 -- 172.21.15.150:0/675481437 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 11) ==== 101849+0+0 (secure 0 0 0) 0x7ff63001d070 con 0x7ff63815ccf0 2024-09-17T05:45:01.027 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:01.026+0000 7ff62effd640 1 --2- 172.21.15.150:0/675481437 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7ff618079040 0x7ff61807b550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:45:01.027 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:01.026+0000 7ff62effd640 1 -- 172.21.15.150:0/675481437 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 5767+0+0 (secure 0 0 0) 0x7ff63009dfd0 con 0x7ff63815ccf0 2024-09-17T05:45:01.028 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:01.027+0000 7ff63659c640 1 --2- 172.21.15.150:0/675481437 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7ff618079040 0x7ff61807b550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:45:01.030 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:01.029+0000 7ff63659c640 1 --2- 172.21.15.150:0/675481437 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7ff618079040 0x7ff61807b550 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7ff6280016a0 tx=0x7ff628009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:45:01.032 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:01.032+0000 7ff62effd640 1 -- 172.21.15.150:0/675481437 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7ff63815b080 con 0x7ff63815ccf0 2024-09-17T05:45:01.341 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:01.341+0000 7ff63cd41640 1 -- 172.21.15.150:0/675481437 --> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] -- mgr_command(tid 0: {"prefix": "fs subvolume snapshot clone", "vol_name": "cephfs", "sub_name": "sv1", "snap_name": "ss1", "target_sub_name": "subvol_clone99852", "target": ["mon-mgr", ""]}) -- 0x7ff638073a40 con 0x7ff618079040 2024-09-17T05:45:01.477 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:01.477+0000 7ff62effd640 1 -- 172.21.15.150:0/675481437 <== mon.0 v2:172.21.15.150:3300/0 7 ==== mgrmap(e 12) ==== 102053+0+0 (secure 0 0 0) 0x7ff630014050 con 0x7ff63815ccf0 2024-09-17T05:45:01.875 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:01.874+0000 7ff62effd640 1 -- 172.21.15.150:0/675481437 <== mgr.4108 v2:172.21.15.176:6800/3631216395 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7ff638073a40 con 0x7ff618079040 2024-09-17T05:45:01.879 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:01.879+0000 7ff63cd41640 1 -- 172.21.15.150:0/675481437 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7ff618079040 msgr2=0x7ff61807b550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:45:01.879 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:01.879+0000 7ff63cd41640 1 --2- 172.21.15.150:0/675481437 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7ff618079040 0x7ff61807b550 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7ff6280016a0 tx=0x7ff628009040 comp rx=0 tx=0).stop 2024-09-17T05:45:01.879 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:01.879+0000 7ff63cd41640 1 -- 172.21.15.150:0/675481437 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff63815ccf0 msgr2=0x7ff63814f4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:45:01.879 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:01.879+0000 7ff63cd41640 1 --2- 172.21.15.150:0/675481437 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff63815ccf0 0x7ff63814f4e0 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7ff630010f90 tx=0x7ff63000e490 comp rx=0 tx=0).stop 2024-09-17T05:45:01.880 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:01.879+0000 7ff63cd41640 1 -- 172.21.15.150:0/675481437 shutdown_connections 2024-09-17T05:45:01.880 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:01.879+0000 7ff63cd41640 1 --2- 172.21.15.150:0/675481437 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7ff618079040 0x7ff61807b550 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:01.880 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:01.879+0000 7ff63cd41640 1 --2- 172.21.15.150:0/675481437 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff63815ccf0 0x7ff63814f4e0 unknown :-1 s=CLOSED pgs=505 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:01.880 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:01.879+0000 7ff63cd41640 1 --2- 172.21.15.150:0/675481437 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff6380ccc50 0x7ff63814e860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:01.880 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:01.879+0000 7ff63cd41640 1 --2- 172.21.15.150:0/675481437 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff638073630 0x7ff638143e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:01.880 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:01.879+0000 7ff63cd41640 1 -- 172.21.15.150:0/675481437 >> 172.21.15.150:0/675481437 conn(0x7ff63806d1c0 msgr2=0x7ff638154130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:45:01.880 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:01.879+0000 7ff63cd41640 1 -- 172.21.15.150:0/675481437 shutdown_connections 2024-09-17T05:45:01.880 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:01.879+0000 7ff63cd41640 1 -- 172.21.15.150:0/675481437 wait complete. 2024-09-17T05:45:01.912 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume snapshot clone cephfs sv1 ss1 subvol_clone13123 2024-09-17T05:45:01.915 INFO:tasks.ceph.mgr.x.smithi176.stderr:2024-09-17T05:45:01.914+0000 7f33dd726640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-17T05:45:01.915 INFO:tasks.ceph.mgr.x.smithi176.stderr:2024-09-17T05:45:01.914+0000 7f33dd726640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-17T05:45:01.916 INFO:tasks.ceph.mgr.x.smithi176.stderr:2024-09-17T05:45:01.914+0000 7f33dd726640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-17T05:45:01.916 INFO:tasks.ceph.mgr.x.smithi176.stderr:2024-09-17T05:45:01.914+0000 7f33dd726640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-17T05:45:01.916 INFO:tasks.ceph.mgr.x.smithi176.stderr:2024-09-17T05:45:01.914+0000 7f33dd726640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-17T05:45:02.096 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:02.095+0000 7f53f8962640 1 -- 172.21.15.150:0/3839704177 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f53f415c820 msgr2=0x7f53f40d0530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:45:02.096 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:02.095+0000 7f53f8962640 1 --2- 172.21.15.150:0/3839704177 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f53f415c820 0x7f53f40d0530 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7f53e4009830 tx=0x7f53e402a480 comp rx=0 tx=0).stop 2024-09-17T05:45:02.096 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:02.095+0000 7f53f8962640 1 -- 172.21.15.150:0/3839704177 shutdown_connections 2024-09-17T05:45:02.096 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:02.095+0000 7f53f8962640 1 --2- 172.21.15.150:0/3839704177 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f53f406ddb0 0x7f53f406e1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:02.096 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:02.095+0000 7f53f8962640 1 --2- 172.21.15.150:0/3839704177 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f53f415c820 0x7f53f40d0530 unknown :-1 s=CLOSED pgs=508 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:02.096 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:02.095+0000 7f53f8962640 1 -- 172.21.15.150:0/3839704177 >> 172.21.15.150:0/3839704177 conn(0x7f53f4073890 msgr2=0x7f53f4073ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:45:02.096 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:02.095+0000 7f53f8962640 1 -- 172.21.15.150:0/3839704177 shutdown_connections 2024-09-17T05:45:02.096 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:02.095+0000 7f53f8962640 1 -- 172.21.15.150:0/3839704177 wait complete. 2024-09-17T05:45:02.098 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:02.098+0000 7f53f8962640 1 Processor -- start 2024-09-17T05:45:02.098 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:02.098+0000 7f53f8962640 1 -- start start 2024-09-17T05:45:02.102 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:02.100+0000 7f53f8962640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f53f406ddb0 0x7f53f40b3ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:45:02.102 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:02.100+0000 7f53f8962640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f53f40cd380 0x7f53f4143d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:45:02.102 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:02.100+0000 7f53f8962640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f53f415c820 0x7f53f4147190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:45:02.102 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:02.100+0000 7f53f8962640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f53f40cf8e0 con 0x7f53f40cd380 2024-09-17T05:45:02.102 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:02.100+0000 7f53f8962640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f53f40cf760 con 0x7f53f415c820 2024-09-17T05:45:02.102 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:02.100+0000 7f53f8962640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f53f40cfa60 con 0x7f53f406ddb0 2024-09-17T05:45:02.102 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:02.100+0000 7f53e9d9b640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f53f40cd380 0x7f53f4143d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:45:02.102 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:02.100+0000 7f53e9d9b640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f53f40cd380 0x7f53f4143d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:57012/0 (socket says 172.21.15.150:57012) 2024-09-17T05:45:02.102 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:02.100+0000 7f53e9d9b640 1 -- 172.21.15.150:0/1087620234 learned_addr learned my addr 172.21.15.150:0/1087620234 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:45:02.102 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:02.101+0000 7f53e9d9b640 1 -- 172.21.15.150:0/1087620234 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f53f406ddb0 msgr2=0x7f53f40b3ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:45:02.103 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:02.101+0000 7f53e9d9b640 1 --2- 172.21.15.150:0/1087620234 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f53f406ddb0 0x7f53f40b3ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:02.103 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:02.101+0000 7f53e9d9b640 1 -- 172.21.15.150:0/1087620234 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f53f415c820 msgr2=0x7f53f4147190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:45:02.103 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:02.101+0000 7f53e9d9b640 1 --2- 172.21.15.150:0/1087620234 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f53f415c820 0x7f53f4147190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:02.103 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:02.101+0000 7f53e9d9b640 1 -- 172.21.15.150:0/1087620234 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f53f4141e00 con 0x7f53f40cd380 2024-09-17T05:45:02.103 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:02.101+0000 7f53e9d9b640 1 --2- 172.21.15.150:0/1087620234 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f53f40cd380 0x7f53f4143d10 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f53dc00e740 tx=0x7f53dc00ec00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:45:02.104 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:02.102+0000 7f53eb7fe640 1 -- 172.21.15.150:0/1087620234 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53dc001a10 con 0x7f53f40cd380 2024-09-17T05:45:02.104 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:02.102+0000 7f53eb7fe640 1 -- 172.21.15.150:0/1087620234 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f53dc00ee50 con 0x7f53f40cd380 2024-09-17T05:45:02.104 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:02.102+0000 7f53f8962640 1 -- 172.21.15.150:0/1087620234 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f53f4144a40 con 0x7f53f40cd380 2024-09-17T05:45:02.104 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:02.102+0000 7f53eb7fe640 1 -- 172.21.15.150:0/1087620234 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53dc0116d0 con 0x7f53f40cd380 2024-09-17T05:45:02.104 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:02.102+0000 7f53f8962640 1 -- 172.21.15.150:0/1087620234 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f53f4143940 con 0x7f53f40cd380 2024-09-17T05:45:02.105 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:02.104+0000 7f53f8962640 1 -- 172.21.15.150:0/1087620234 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f53d8005290 con 0x7f53f40cd380 2024-09-17T05:45:02.107 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:02.106+0000 7f53eb7fe640 1 -- 172.21.15.150:0/1087620234 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 12) ==== 102053+0+0 (secure 0 0 0) 0x7f53dc011870 con 0x7f53f40cd380 2024-09-17T05:45:02.108 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:02.107+0000 7f53eb7fe640 1 --2- 172.21.15.150:0/1087620234 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f53d4079250 0x7f53d407b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:45:02.108 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:02.107+0000 7f53eb7fe640 1 -- 172.21.15.150:0/1087620234 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 5767+0+0 (secure 0 0 0) 0x7f53dc09e190 con 0x7f53f40cd380 2024-09-17T05:45:02.114 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:02.114+0000 7f53f259c640 1 --2- 172.21.15.150:0/1087620234 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f53d4079250 0x7f53d407b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:45:02.115 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:02.115+0000 7f53eb7fe640 1 -- 172.21.15.150:0/1087620234 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f53dc016030 con 0x7f53f40cd380 2024-09-17T05:45:02.122 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:02.121+0000 7f53f259c640 1 --2- 172.21.15.150:0/1087620234 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f53d4079250 0x7f53d407b760 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f53e4034000 tx=0x7f53e40046c0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:45:02.471 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:02.470+0000 7f53f8962640 1 -- 172.21.15.150:0/1087620234 --> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] -- mgr_command(tid 0: {"prefix": "fs subvolume snapshot clone", "vol_name": "cephfs", "sub_name": "sv1", "snap_name": "ss1", "target_sub_name": "subvol_clone13123", "target": ["mon-mgr", ""]}) -- 0x7f53d8000c80 con 0x7f53d4079250 2024-09-17T05:45:03.294 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:03.293+0000 7f53eb7fe640 1 -- 172.21.15.150:0/1087620234 <== mgr.4108 v2:172.21.15.176:6800/3631216395 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f53d8000c80 con 0x7f53d4079250 2024-09-17T05:45:03.301 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:03.300+0000 7f53f8962640 1 -- 172.21.15.150:0/1087620234 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f53d4079250 msgr2=0x7f53d407b760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:45:03.301 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:03.300+0000 7f53f8962640 1 --2- 172.21.15.150:0/1087620234 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f53d4079250 0x7f53d407b760 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f53e4034000 tx=0x7f53e40046c0 comp rx=0 tx=0).stop 2024-09-17T05:45:03.301 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:03.300+0000 7f53f8962640 1 -- 172.21.15.150:0/1087620234 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f53f40cd380 msgr2=0x7f53f4143d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:45:03.301 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:03.300+0000 7f53f8962640 1 --2- 172.21.15.150:0/1087620234 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f53f40cd380 0x7f53f4143d10 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f53dc00e740 tx=0x7f53dc00ec00 comp rx=0 tx=0).stop 2024-09-17T05:45:03.301 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:03.300+0000 7f53f8962640 1 -- 172.21.15.150:0/1087620234 shutdown_connections 2024-09-17T05:45:03.301 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:03.300+0000 7f53f8962640 1 --2- 172.21.15.150:0/1087620234 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f53f415c820 0x7f53f4147190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:03.302 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:03.300+0000 7f53f8962640 1 --2- 172.21.15.150:0/1087620234 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f53d4079250 0x7f53d407b760 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:03.302 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:03.300+0000 7f53f8962640 1 --2- 172.21.15.150:0/1087620234 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f53f40cd380 0x7f53f4143d10 unknown :-1 s=CLOSED pgs=509 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:03.302 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:03.300+0000 7f53f8962640 1 --2- 172.21.15.150:0/1087620234 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f53f406ddb0 0x7f53f40b3ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:03.302 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:03.300+0000 7f53f8962640 1 -- 172.21.15.150:0/1087620234 >> 172.21.15.150:0/1087620234 conn(0x7f53f4073890 msgr2=0x7f53f40b5ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:45:03.302 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:03.300+0000 7f53f8962640 1 -- 172.21.15.150:0/1087620234 shutdown_connections 2024-09-17T05:45:03.302 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:03.300+0000 7f53f8962640 1 -- 172.21.15.150:0/1087620234 wait complete. 2024-09-17T05:45:03.328 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format json-pretty 2024-09-17T05:45:03.520 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:03.518+0000 7f89faff1640 1 -- 172.21.15.150:0/2550756 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f89f40b3990 msgr2=0x7f89f40d51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:45:03.520 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:03.518+0000 7f89faff1640 1 --2- 172.21.15.150:0/2550756 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f89f40b3990 0x7f89f40d51b0 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7f89f408cca0 tx=0x7f89e002a560 comp rx=0 tx=0).stop 2024-09-17T05:45:03.520 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:03.519+0000 7f89faff1640 1 -- 172.21.15.150:0/2550756 shutdown_connections 2024-09-17T05:45:03.520 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:03.519+0000 7f89faff1640 1 --2- 172.21.15.150:0/2550756 >> v2:172.21.15.176:3300/0 conn(0x7f89f40cf810 0x7f89f40cfc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:03.520 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:03.519+0000 7f89faff1640 1 --2- 172.21.15.150:0/2550756 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f89f40b3990 0x7f89f40d51b0 unknown :-1 s=CLOSED pgs=510 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:03.521 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:03.519+0000 7f89faff1640 1 -- 172.21.15.150:0/2550756 >> 172.21.15.150:0/2550756 conn(0x7f89f40d4690 msgr2=0x7f89f40d4aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:45:03.521 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:03.519+0000 7f89faff1640 1 -- 172.21.15.150:0/2550756 shutdown_connections 2024-09-17T05:45:03.521 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:03.519+0000 7f89faff1640 1 -- 172.21.15.150:0/2550756 wait complete. 2024-09-17T05:45:03.523 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:03.522+0000 7f89faff1640 1 Processor -- start 2024-09-17T05:45:03.523 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:03.522+0000 7f89faff1640 1 -- start start 2024-09-17T05:45:03.528 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:03.524+0000 7f89faff1640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f89f406dff0 0x7f89f415fa00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:45:03.528 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:03.524+0000 7f89faff1640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f89f40b3990 0x7f89f41469e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:45:03.528 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:03.524+0000 7f89faff1640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f89f40cf810 0x7f89f4159e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:45:03.528 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:03.524+0000 7f89faff1640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f89f40d04f0 con 0x7f89f40b3990 2024-09-17T05:45:03.528 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:03.524+0000 7f89faff1640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f89f40d0370 con 0x7f89f406dff0 2024-09-17T05:45:03.528 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:03.524+0000 7f89faff1640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f89f4160370 con 0x7f89f40cf810 2024-09-17T05:45:03.528 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:03.524+0000 7f89f3fff640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f89f40b3990 0x7f89f41469e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:45:03.529 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:03.524+0000 7f89f3fff640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f89f40b3990 0x7f89f41469e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:57040/0 (socket says 172.21.15.150:57040) 2024-09-17T05:45:03.529 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:03.524+0000 7f89f3fff640 1 -- 172.21.15.150:0/2725797832 learned_addr learned my addr 172.21.15.150:0/2725797832 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:45:03.529 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:03.525+0000 7f89f3fff640 1 -- 172.21.15.150:0/2725797832 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f89f40cf810 msgr2=0x7f89f4159e60 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-17T05:45:03.529 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:03.525+0000 7f89f3fff640 1 --2- 172.21.15.150:0/2725797832 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f89f40cf810 0x7f89f4159e60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:03.529 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:03.525+0000 7f89f3fff640 1 -- 172.21.15.150:0/2725797832 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f89f406dff0 msgr2=0x7f89f415fa00 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-17T05:45:03.529 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:03.525+0000 7f89f3fff640 1 --2- 172.21.15.150:0/2725797832 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f89f406dff0 0x7f89f415fa00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:03.529 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:03.525+0000 7f89f3fff640 1 -- 172.21.15.150:0/2725797832 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f89f40b6f90 con 0x7f89f40b3990 2024-09-17T05:45:03.529 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:03.525+0000 7f89f3fff640 1 --2- 172.21.15.150:0/2725797832 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f89f40b3990 0x7f89f41469e0 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7f89e00099d0 tx=0x7f89e00052f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:45:03.529 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:03.525+0000 7f89f17fa640 1 -- 172.21.15.150:0/2725797832 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89e0005cf0 con 0x7f89f40b3990 2024-09-17T05:45:03.530 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:03.525+0000 7f89faff1640 1 -- 172.21.15.150:0/2725797832 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f89f40b4030 con 0x7f89f40b3990 2024-09-17T05:45:03.530 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:03.525+0000 7f89f17fa640 1 -- 172.21.15.150:0/2725797832 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f89e0031b50 con 0x7f89f40b3990 2024-09-17T05:45:03.530 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:03.525+0000 7f89f17fa640 1 -- 172.21.15.150:0/2725797832 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89e00330d0 con 0x7f89f40b3990 2024-09-17T05:45:03.530 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:03.525+0000 7f89faff1640 1 -- 172.21.15.150:0/2725797832 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f89f41600b0 con 0x7f89f40b3990 2024-09-17T05:45:03.530 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:03.526+0000 7f89faff1640 1 -- 172.21.15.150:0/2725797832 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f89f40b4550 con 0x7f89f40b3990 2024-09-17T05:45:03.530 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:03.527+0000 7f89f17fa640 1 -- 172.21.15.150:0/2725797832 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 12) ==== 102053+0+0 (secure 0 0 0) 0x7f89e0033270 con 0x7f89f40b3990 2024-09-17T05:45:03.531 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:03.528+0000 7f89f17fa640 1 --2- 172.21.15.150:0/2725797832 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f89d8079250 0x7f89d807b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:45:03.531 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:03.528+0000 7f89f17fa640 1 -- 172.21.15.150:0/2725797832 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 5767+0+0 (secure 0 0 0) 0x7f89e00bcd50 con 0x7f89f40b3990 2024-09-17T05:45:03.531 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:03.529+0000 7f89f8d8d640 1 --2- 172.21.15.150:0/2725797832 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f89d8079250 0x7f89d807b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:45:03.532 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:03.530+0000 7f89f8d8d640 1 --2- 172.21.15.150:0/2725797832 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f89d8079250 0x7f89d807b760 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f89e80014d0 tx=0x7f89e8007a00 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:45:03.533 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:03.533+0000 7f89f17fa640 1 -- 172.21.15.150:0/2725797832 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f89e003f030 con 0x7f89f40b3990 2024-09-17T05:45:03.589 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:03.588+0000 7f89f17fa640 1 -- 172.21.15.150:0/2725797832 <== mon.0 v2:172.21.15.150:3300/0 7 ==== mgrmap(e 13) ==== 102104+0+0 (secure 0 0 0) 0x7f89e00802a0 con 0x7f89f40b3990 2024-09-17T05:45:03.944 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:03.943+0000 7f89faff1640 1 -- 172.21.15.150:0/2725797832 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) -- 0x7f89f40d51b0 con 0x7f89f40b3990 2024-09-17T05:45:03.945 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:03.944+0000 7f89f17fa640 1 -- 172.21.15.150:0/2725797832 <== mon.0 v2:172.21.15.150:3300/0 8 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) ==== 79+0+2619 (secure 0 0 0) 0x7f89e009ba00 con 0x7f89f40b3990 2024-09-17T05:45:03.945 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-09-17T05:45:03.945 INFO:teuthology.orchestra.run.smithi150.stdout:{ 2024-09-17T05:45:03.945 INFO:teuthology.orchestra.run.smithi150.stdout: "fsid": "9f2e05e9-d629-47b3-b26b-1360655b7d20", 2024-09-17T05:45:03.945 INFO:teuthology.orchestra.run.smithi150.stdout: "health": { 2024-09-17T05:45:03.945 INFO:teuthology.orchestra.run.smithi150.stdout: "status": "HEALTH_OK", 2024-09-17T05:45:03.945 INFO:teuthology.orchestra.run.smithi150.stdout: "checks": {}, 2024-09-17T05:45:03.946 INFO:teuthology.orchestra.run.smithi150.stdout: "mutes": [] 2024-09-17T05:45:03.946 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-17T05:45:03.946 INFO:teuthology.orchestra.run.smithi150.stdout: "election_epoch": 4, 2024-09-17T05:45:03.946 INFO:teuthology.orchestra.run.smithi150.stdout: "quorum": [ 2024-09-17T05:45:03.946 INFO:teuthology.orchestra.run.smithi150.stdout: 0, 2024-09-17T05:45:03.946 INFO:teuthology.orchestra.run.smithi150.stdout: 1, 2024-09-17T05:45:03.946 INFO:teuthology.orchestra.run.smithi150.stdout: 2 2024-09-17T05:45:03.946 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2024-09-17T05:45:03.946 INFO:teuthology.orchestra.run.smithi150.stdout: "quorum_names": [ 2024-09-17T05:45:03.946 INFO:teuthology.orchestra.run.smithi150.stdout: "a", 2024-09-17T05:45:03.946 INFO:teuthology.orchestra.run.smithi150.stdout: "b", 2024-09-17T05:45:03.946 INFO:teuthology.orchestra.run.smithi150.stdout: "c" 2024-09-17T05:45:03.946 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2024-09-17T05:45:03.947 INFO:teuthology.orchestra.run.smithi150.stdout: "quorum_age": 211, 2024-09-17T05:45:03.947 INFO:teuthology.orchestra.run.smithi150.stdout: "monmap": { 2024-09-17T05:45:03.947 INFO:teuthology.orchestra.run.smithi150.stdout: "epoch": 1, 2024-09-17T05:45:03.947 INFO:teuthology.orchestra.run.smithi150.stdout: "min_mon_release_name": "squid", 2024-09-17T05:45:03.947 INFO:teuthology.orchestra.run.smithi150.stdout: "num_mons": 3 2024-09-17T05:45:03.947 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-17T05:45:03.947 INFO:teuthology.orchestra.run.smithi150.stdout: "osdmap": { 2024-09-17T05:45:03.947 INFO:teuthology.orchestra.run.smithi150.stdout: "epoch": 47, 2024-09-17T05:45:03.947 INFO:teuthology.orchestra.run.smithi150.stdout: "num_osds": 8, 2024-09-17T05:45:03.947 INFO:teuthology.orchestra.run.smithi150.stdout: "num_up_osds": 8, 2024-09-17T05:45:03.947 INFO:teuthology.orchestra.run.smithi150.stdout: "osd_up_since": 1726551706, 2024-09-17T05:45:03.947 INFO:teuthology.orchestra.run.smithi150.stdout: "num_in_osds": 8, 2024-09-17T05:45:03.947 INFO:teuthology.orchestra.run.smithi150.stdout: "osd_in_since": 1726551696, 2024-09-17T05:45:03.948 INFO:teuthology.orchestra.run.smithi150.stdout: "num_remapped_pgs": 0 2024-09-17T05:45:03.948 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-17T05:45:03.948 INFO:teuthology.orchestra.run.smithi150.stdout: "pgmap": { 2024-09-17T05:45:03.948 INFO:teuthology.orchestra.run.smithi150.stdout: "pgs_by_state": [ 2024-09-17T05:45:03.948 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-09-17T05:45:03.948 INFO:teuthology.orchestra.run.smithi150.stdout: "state_name": "active+clean", 2024-09-17T05:45:03.948 INFO:teuthology.orchestra.run.smithi150.stdout: "count": 97 2024-09-17T05:45:03.948 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-09-17T05:45:03.948 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2024-09-17T05:45:03.948 INFO:teuthology.orchestra.run.smithi150.stdout: "num_pgs": 97, 2024-09-17T05:45:03.948 INFO:teuthology.orchestra.run.smithi150.stdout: "num_pools": 3, 2024-09-17T05:45:03.948 INFO:teuthology.orchestra.run.smithi150.stdout: "num_objects": 2741, 2024-09-17T05:45:03.948 INFO:teuthology.orchestra.run.smithi150.stdout: "data_bytes": 11359471740, 2024-09-17T05:45:03.948 INFO:teuthology.orchestra.run.smithi150.stdout: "bytes_used": 22605549568, 2024-09-17T05:45:03.949 INFO:teuthology.orchestra.run.smithi150.stdout: "bytes_avail": 750488563712, 2024-09-17T05:45:03.949 INFO:teuthology.orchestra.run.smithi150.stdout: "bytes_total": 773094113280, 2024-09-17T05:45:03.949 INFO:teuthology.orchestra.run.smithi150.stdout: "read_bytes_sec": 62199808, 2024-09-17T05:45:03.949 INFO:teuthology.orchestra.run.smithi150.stdout: "write_bytes_sec": 305788085, 2024-09-17T05:45:03.949 INFO:teuthology.orchestra.run.smithi150.stdout: "read_op_per_sec": 15, 2024-09-17T05:45:03.949 INFO:teuthology.orchestra.run.smithi150.stdout: "write_op_per_sec": 82 2024-09-17T05:45:03.949 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-17T05:45:03.949 INFO:teuthology.orchestra.run.smithi150.stdout: "fsmap": { 2024-09-17T05:45:03.949 INFO:teuthology.orchestra.run.smithi150.stdout: "epoch": 26, 2024-09-17T05:45:03.949 INFO:teuthology.orchestra.run.smithi150.stdout: "btime": "2024-09-17T05:44:15:201423+0000", 2024-09-17T05:45:03.949 INFO:teuthology.orchestra.run.smithi150.stdout: "id": 3, 2024-09-17T05:45:03.949 INFO:teuthology.orchestra.run.smithi150.stdout: "up": 1, 2024-09-17T05:45:03.949 INFO:teuthology.orchestra.run.smithi150.stdout: "in": 1, 2024-09-17T05:45:03.950 INFO:teuthology.orchestra.run.smithi150.stdout: "max": 1, 2024-09-17T05:45:03.950 INFO:teuthology.orchestra.run.smithi150.stdout: "by_rank": [ 2024-09-17T05:45:03.950 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-09-17T05:45:03.950 INFO:teuthology.orchestra.run.smithi150.stdout: "filesystem_id": 3, 2024-09-17T05:45:03.950 INFO:teuthology.orchestra.run.smithi150.stdout: "rank": 0, 2024-09-17T05:45:03.950 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "c", 2024-09-17T05:45:03.950 INFO:teuthology.orchestra.run.smithi150.stdout: "status": "up:active", 2024-09-17T05:45:03.950 INFO:teuthology.orchestra.run.smithi150.stdout: "gid": 5472 2024-09-17T05:45:03.950 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-09-17T05:45:03.950 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2024-09-17T05:45:03.950 INFO:teuthology.orchestra.run.smithi150.stdout: "up:standby": 3 2024-09-17T05:45:03.950 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-17T05:45:03.950 INFO:teuthology.orchestra.run.smithi150.stdout: "mgrmap": { 2024-09-17T05:45:03.950 INFO:teuthology.orchestra.run.smithi150.stdout: "available": true, 2024-09-17T05:45:03.951 INFO:teuthology.orchestra.run.smithi150.stdout: "num_standbys": 1, 2024-09-17T05:45:03.951 INFO:teuthology.orchestra.run.smithi150.stdout: "modules": [ 2024-09-17T05:45:03.951 INFO:teuthology.orchestra.run.smithi150.stdout: "iostat", 2024-09-17T05:45:03.951 INFO:teuthology.orchestra.run.smithi150.stdout: "nfs", 2024-09-17T05:45:03.951 INFO:teuthology.orchestra.run.smithi150.stdout: "restful" 2024-09-17T05:45:03.951 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2024-09-17T05:45:03.951 INFO:teuthology.orchestra.run.smithi150.stdout: "services": {} 2024-09-17T05:45:03.951 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-17T05:45:03.951 INFO:teuthology.orchestra.run.smithi150.stdout: "servicemap": { 2024-09-17T05:45:03.951 INFO:teuthology.orchestra.run.smithi150.stdout: "epoch": 9, 2024-09-17T05:45:03.951 INFO:teuthology.orchestra.run.smithi150.stdout: "modified": "2024-09-17T05:45:00.896082+0000", 2024-09-17T05:45:03.951 INFO:teuthology.orchestra.run.smithi150.stdout: "services": { 2024-09-17T05:45:03.951 INFO:teuthology.orchestra.run.smithi150.stdout: "mds": { 2024-09-17T05:45:03.951 INFO:teuthology.orchestra.run.smithi150.stdout: "daemons": { 2024-09-17T05:45:03.951 INFO:teuthology.orchestra.run.smithi150.stdout: "summary": "", 2024-09-17T05:45:03.952 INFO:teuthology.orchestra.run.smithi150.stdout: "c": { 2024-09-17T05:45:03.952 INFO:teuthology.orchestra.run.smithi150.stdout: "start_epoch": 0, 2024-09-17T05:45:03.952 INFO:teuthology.orchestra.run.smithi150.stdout: "start_stamp": "0.000000", 2024-09-17T05:45:03.952 INFO:teuthology.orchestra.run.smithi150.stdout: "gid": 0, 2024-09-17T05:45:03.952 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "(unrecognized address family 0)/0", 2024-09-17T05:45:03.952 INFO:teuthology.orchestra.run.smithi150.stdout: "metadata": {}, 2024-09-17T05:45:03.952 INFO:teuthology.orchestra.run.smithi150.stdout: "task_status": {} 2024-09-17T05:45:03.952 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-09-17T05:45:03.952 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-09-17T05:45:03.952 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-09-17T05:45:03.953 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-09-17T05:45:03.953 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-17T05:45:03.953 INFO:teuthology.orchestra.run.smithi150.stdout: "progress_events": { 2024-09-17T05:45:03.953 INFO:teuthology.orchestra.run.smithi150.stdout: "mgr-vol-ongoing-clones": { 2024-09-17T05:45:03.953 INFO:teuthology.orchestra.run.smithi150.stdout: "message": "1 ongoing clones - average progress is 1.016% (0s)\n [............................] ", 2024-09-17T05:45:03.953 INFO:teuthology.orchestra.run.smithi150.stdout: "progress": 0.010160000063478947, 2024-09-17T05:45:03.953 INFO:teuthology.orchestra.run.smithi150.stdout: "add_to_ceph_s": true 2024-09-17T05:45:03.953 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-09-17T05:45:03.953 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-09-17T05:45:03.953 INFO:teuthology.orchestra.run.smithi150.stdout:} 2024-09-17T05:45:03.954 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:03.948+0000 7f89faff1640 1 -- 172.21.15.150:0/2725797832 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f89d8079250 msgr2=0x7f89d807b760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:45:03.954 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:03.948+0000 7f89faff1640 1 --2- 172.21.15.150:0/2725797832 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f89d8079250 0x7f89d807b760 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f89e80014d0 tx=0x7f89e8007a00 comp rx=0 tx=0).stop 2024-09-17T05:45:03.954 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:03.948+0000 7f89faff1640 1 -- 172.21.15.150:0/2725797832 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f89f40b3990 msgr2=0x7f89f41469e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:45:03.954 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:03.948+0000 7f89faff1640 1 --2- 172.21.15.150:0/2725797832 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f89f40b3990 0x7f89f41469e0 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7f89e00099d0 tx=0x7f89e00052f0 comp rx=0 tx=0).stop 2024-09-17T05:45:03.954 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:03.948+0000 7f89faff1640 1 -- 172.21.15.150:0/2725797832 shutdown_connections 2024-09-17T05:45:03.954 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:03.948+0000 7f89faff1640 1 --2- 172.21.15.150:0/2725797832 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f89d8079250 0x7f89d807b760 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:03.955 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:03.948+0000 7f89faff1640 1 --2- 172.21.15.150:0/2725797832 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f89f40cf810 0x7f89f4159e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:03.955 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:03.948+0000 7f89faff1640 1 --2- 172.21.15.150:0/2725797832 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f89f40b3990 0x7f89f41469e0 unknown :-1 s=CLOSED pgs=511 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:03.955 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:03.948+0000 7f89faff1640 1 --2- 172.21.15.150:0/2725797832 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f89f406dff0 0x7f89f415fa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:03.955 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:03.948+0000 7f89faff1640 1 -- 172.21.15.150:0/2725797832 >> 172.21.15.150:0/2725797832 conn(0x7f89f40d4690 msgr2=0x7f89f40b1b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:45:03.955 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:03.949+0000 7f89faff1640 1 -- 172.21.15.150:0/2725797832 shutdown_connections 2024-09-17T05:45:03.955 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:03.949+0000 7f89faff1640 1 -- 172.21.15.150:0/2725797832 wait complete. 2024-09-17T05:45:03.966 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs clone cancel cephfs subvol_clone83860 2024-09-17T05:45:04.165 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:04.164+0000 7fc8ed18b640 1 -- 172.21.15.150:0/349043144 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc8e80b4070 msgr2=0x7fc8e815ee80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:45:04.165 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:04.164+0000 7fc8ed18b640 1 --2- 172.21.15.150:0/349043144 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc8e80b4070 0x7fc8e815ee80 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7fc8e8072bd0 tx=0x7fc8e002a8b0 comp rx=0 tx=0).stop 2024-09-17T05:45:04.165 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:04.164+0000 7fc8ed18b640 1 -- 172.21.15.150:0/349043144 shutdown_connections 2024-09-17T05:45:04.165 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:04.164+0000 7fc8ed18b640 1 --2- 172.21.15.150:0/349043144 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc8e80b4070 0x7fc8e815ee80 unknown :-1 s=CLOSED pgs=513 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:04.165 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:04.164+0000 7fc8ed18b640 1 --2- 172.21.15.150:0/349043144 >> v2:172.21.15.176:3300/0 conn(0x7fc8e8070600 0x7fc8e815e940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:04.165 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:04.164+0000 7fc8ed18b640 1 -- 172.21.15.150:0/349043144 >> 172.21.15.150:0/349043144 conn(0x7fc8e806d1c0 msgr2=0x7fc8e806d5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:45:04.166 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:04.164+0000 7fc8ed18b640 1 -- 172.21.15.150:0/349043144 shutdown_connections 2024-09-17T05:45:04.166 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:04.164+0000 7fc8ed18b640 1 -- 172.21.15.150:0/349043144 wait complete. 2024-09-17T05:45:04.168 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:04.167+0000 7fc8ed18b640 1 Processor -- start 2024-09-17T05:45:04.168 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:04.168+0000 7fc8ed18b640 1 -- start start 2024-09-17T05:45:04.171 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:04.169+0000 7fc8ed18b640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc8e8070600 0x7fc8e81f6300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:45:04.171 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:04.169+0000 7fc8ed18b640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc8e8070a10 0x7fc8e80aea70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:45:04.171 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:04.169+0000 7fc8ed18b640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc8e80b4070 0x7fc8e81f97d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:45:04.171 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:04.169+0000 7fc8ed18b640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7fc8e80cf790 con 0x7fc8e80b4070 2024-09-17T05:45:04.171 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:04.169+0000 7fc8ed18b640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fc8e80cf610 con 0x7fc8e8070600 2024-09-17T05:45:04.171 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:04.169+0000 7fc8ed18b640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fc8e80cf910 con 0x7fc8e8070a10 2024-09-17T05:45:04.171 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:04.169+0000 7fc8e759e640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc8e80b4070 0x7fc8e81f97d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:45:04.171 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:04.170+0000 7fc8e759e640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc8e80b4070 0x7fc8e81f97d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:57070/0 (socket says 172.21.15.150:57070) 2024-09-17T05:45:04.172 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:04.170+0000 7fc8e759e640 1 -- 172.21.15.150:0/3229945906 learned_addr learned my addr 172.21.15.150:0/3229945906 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:45:04.172 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:04.170+0000 7fc8e659c640 1 --2- 172.21.15.150:0/3229945906 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc8e8070a10 0x7fc8e80aea70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:45:04.172 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:04.170+0000 7fc8e6d9d640 1 --2- 172.21.15.150:0/3229945906 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc8e8070600 0x7fc8e81f6300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:45:04.172 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:04.170+0000 7fc8e759e640 1 -- 172.21.15.150:0/3229945906 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc8e8070a10 msgr2=0x7fc8e80aea70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:45:04.172 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:04.170+0000 7fc8e759e640 1 --2- 172.21.15.150:0/3229945906 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc8e8070a10 0x7fc8e80aea70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:04.172 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:04.170+0000 7fc8e759e640 1 -- 172.21.15.150:0/3229945906 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc8e8070600 msgr2=0x7fc8e81f6300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:45:04.172 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:04.170+0000 7fc8e759e640 1 --2- 172.21.15.150:0/3229945906 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc8e8070600 0x7fc8e81f6300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:04.172 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:04.170+0000 7fc8e759e640 1 -- 172.21.15.150:0/3229945906 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc8e80b5500 con 0x7fc8e80b4070 2024-09-17T05:45:04.172 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:04.170+0000 7fc8e759e640 1 --2- 172.21.15.150:0/3229945906 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc8e80b4070 0x7fc8e81f97d0 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7fc8e0005fd0 tx=0x7fc8e00039f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:45:04.172 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:04.170+0000 7fc8cf7fe640 1 -- 172.21.15.150:0/3229945906 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8e0031990 con 0x7fc8e80b4070 2024-09-17T05:45:04.172 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:04.170+0000 7fc8cf7fe640 1 -- 172.21.15.150:0/3229945906 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc8e0031c20 con 0x7fc8e80b4070 2024-09-17T05:45:04.173 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:04.170+0000 7fc8ed18b640 1 -- 172.21.15.150:0/3229945906 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc8e81f9d10 con 0x7fc8e80b4070 2024-09-17T05:45:04.173 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:04.170+0000 7fc8cf7fe640 1 -- 172.21.15.150:0/3229945906 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8e00330d0 con 0x7fc8e80b4070 2024-09-17T05:45:04.173 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:04.170+0000 7fc8ed18b640 1 -- 172.21.15.150:0/3229945906 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc8e8141710 con 0x7fc8e80b4070 2024-09-17T05:45:04.174 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:04.172+0000 7fc8ed18b640 1 -- 172.21.15.150:0/3229945906 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc8e80cfde0 con 0x7fc8e80b4070 2024-09-17T05:45:04.174 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:04.172+0000 7fc8cf7fe640 1 -- 172.21.15.150:0/3229945906 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 13) ==== 102104+0+0 (secure 0 0 0) 0x7fc8e0033290 con 0x7fc8e80b4070 2024-09-17T05:45:04.174 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:04.173+0000 7fc8cf7fe640 1 --2- 172.21.15.150:0/3229945906 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fc8d40792e0 0x7fc8d407b7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:45:04.174 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:04.173+0000 7fc8cf7fe640 1 -- 172.21.15.150:0/3229945906 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 5767+0+0 (secure 0 0 0) 0x7fc8e00bd610 con 0x7fc8e80b4070 2024-09-17T05:45:04.180 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:04.178+0000 7fc8cf7fe640 1 -- 172.21.15.150:0/3229945906 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fc8e003f030 con 0x7fc8e80b4070 2024-09-17T05:45:04.181 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:04.180+0000 7fc8e6d9d640 1 --2- 172.21.15.150:0/3229945906 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fc8d40792e0 0x7fc8d407b7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:45:04.188 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:04.188+0000 7fc8e6d9d640 1 --2- 172.21.15.150:0/3229945906 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fc8d40792e0 0x7fc8d407b7f0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fc8d800b810 tx=0x7fc8d8008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:45:04.541 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:04.540+0000 7fc8ed18b640 1 -- 172.21.15.150:0/3229945906 --> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] -- mgr_command(tid 0: {"prefix": "fs clone cancel", "vol_name": "cephfs", "clone_name": "subvol_clone83860", "target": ["mon-mgr", ""]}) -- 0x7fc8e80694e0 con 0x7fc8d40792e0 2024-09-17T05:45:04.611 INFO:tasks.ceph.mgr.x.smithi176.stderr:2024-09-17T05:45:04.609+0000 7f33d771a640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-17T05:45:04.611 INFO:tasks.ceph.mgr.x.smithi176.stderr:2024-09-17T05:45:04.609+0000 7f33d771a640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-17T05:45:04.611 INFO:tasks.ceph.mgr.x.smithi176.stderr:2024-09-17T05:45:04.609+0000 7f33d771a640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-17T05:45:04.611 INFO:tasks.ceph.mgr.x.smithi176.stderr:2024-09-17T05:45:04.609+0000 7f33d771a640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-17T05:45:04.611 INFO:tasks.ceph.mgr.x.smithi176.stderr:2024-09-17T05:45:04.609+0000 7f33d771a640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-17T05:45:05.659 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:05.658+0000 7fc8cf7fe640 1 -- 172.21.15.150:0/3229945906 <== mon.0 v2:172.21.15.150:3300/0 7 ==== mgrmap(e 14) ==== 102155+0+0 (secure 0 0 0) 0x7fc8e0080680 con 0x7fc8e80b4070 2024-09-17T05:45:05.986 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:05.986+0000 7fc8cf7fe640 1 -- 172.21.15.150:0/3229945906 <== mgr.4108 v2:172.21.15.176:6800/3631216395 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7fc8e80694e0 con 0x7fc8d40792e0 2024-09-17T05:45:05.989 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:05.988+0000 7fc8ed18b640 1 -- 172.21.15.150:0/3229945906 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fc8d40792e0 msgr2=0x7fc8d407b7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:45:05.989 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:05.988+0000 7fc8ed18b640 1 --2- 172.21.15.150:0/3229945906 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fc8d40792e0 0x7fc8d407b7f0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fc8d800b810 tx=0x7fc8d8008040 comp rx=0 tx=0).stop 2024-09-17T05:45:05.989 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:05.988+0000 7fc8ed18b640 1 -- 172.21.15.150:0/3229945906 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc8e80b4070 msgr2=0x7fc8e81f97d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:45:05.989 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:05.988+0000 7fc8ed18b640 1 --2- 172.21.15.150:0/3229945906 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc8e80b4070 0x7fc8e81f97d0 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7fc8e0005fd0 tx=0x7fc8e00039f0 comp rx=0 tx=0).stop 2024-09-17T05:45:05.989 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:05.988+0000 7fc8ed18b640 1 -- 172.21.15.150:0/3229945906 shutdown_connections 2024-09-17T05:45:05.990 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:05.988+0000 7fc8ed18b640 1 --2- 172.21.15.150:0/3229945906 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fc8d40792e0 0x7fc8d407b7f0 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:05.990 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:05.988+0000 7fc8ed18b640 1 --2- 172.21.15.150:0/3229945906 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc8e80b4070 0x7fc8e81f97d0 unknown :-1 s=CLOSED pgs=514 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:05.990 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:05.988+0000 7fc8ed18b640 1 --2- 172.21.15.150:0/3229945906 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc8e8070a10 0x7fc8e80aea70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:05.990 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:05.988+0000 7fc8ed18b640 1 --2- 172.21.15.150:0/3229945906 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc8e8070600 0x7fc8e81f6300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:05.990 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:05.988+0000 7fc8ed18b640 1 -- 172.21.15.150:0/3229945906 >> 172.21.15.150:0/3229945906 conn(0x7fc8e806d1c0 msgr2=0x7fc8e813dff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:45:05.990 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:05.988+0000 7fc8ed18b640 1 -- 172.21.15.150:0/3229945906 shutdown_connections 2024-09-17T05:45:05.990 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:05.988+0000 7fc8ed18b640 1 -- 172.21.15.150:0/3229945906 wait complete. 2024-09-17T05:45:06.001 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs clone cancel cephfs subvol_clone43941 2024-09-17T05:45:06.119 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:06.118+0000 7fa55faf2640 1 -- 172.21.15.150:0/1761369770 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa544005320 msgr2=0x7fa54400b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:45:06.119 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:06.118+0000 7fa55faf2640 1 --2- 172.21.15.150:0/1761369770 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa544005320 0x7fa54400b9c0 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7fa550001800 tx=0x7fa544005830 comp rx=0 tx=0).stop 2024-09-17T05:45:06.120 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:06.118+0000 7fa55e08f640 1 -- 172.21.15.150:0/1761369770 reap_dead start 2024-09-17T05:45:06.120 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:06.118+0000 7fa55faf2640 1 -- 172.21.15.150:0/1761369770 shutdown_connections 2024-09-17T05:45:06.120 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:06.118+0000 7fa55faf2640 1 -- 172.21.15.150:0/1761369770 >> 172.21.15.150:0/1761369770 conn(0x7fa55806d1c0 msgr2=0x7fa55806d5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:45:06.120 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:06.119+0000 7fa55faf2640 1 -- 172.21.15.150:0/1761369770 shutdown_connections 2024-09-17T05:45:06.120 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:06.119+0000 7fa55faf2640 1 -- 172.21.15.150:0/1761369770 wait complete. 2024-09-17T05:45:06.121 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:06.120+0000 7fa55faf2640 1 Processor -- start 2024-09-17T05:45:06.121 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:06.120+0000 7fa55faf2640 1 -- start start 2024-09-17T05:45:06.123 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:06.122+0000 7fa55faf2640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa544005320 0x7fa558156210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:45:06.124 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:06.122+0000 7fa55faf2640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa5581f4af0 0x7fa5581f4f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:45:06.124 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:06.122+0000 7fa55faf2640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa5580b1e10 0x7fa5580b2220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:45:06.124 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:06.122+0000 7fa55faf2640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7fa55815d580 con 0x7fa544005320 2024-09-17T05:45:06.124 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:06.122+0000 7fa55faf2640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fa55815d400 con 0x7fa5581f4af0 2024-09-17T05:45:06.124 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:06.122+0000 7fa55faf2640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fa55815d700 con 0x7fa5580b1e10 2024-09-17T05:45:06.124 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:06.122+0000 7fa55d88e640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa544005320 0x7fa558156210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:45:06.124 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:06.122+0000 7fa55d88e640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa544005320 0x7fa558156210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:57092/0 (socket says 172.21.15.150:57092) 2024-09-17T05:45:06.124 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:06.122+0000 7fa55d88e640 1 -- 172.21.15.150:0/2740627903 learned_addr learned my addr 172.21.15.150:0/2740627903 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:45:06.124 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:06.122+0000 7fa55d08d640 1 --2- 172.21.15.150:0/2740627903 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa5581f4af0 0x7fa5581f4f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:45:06.124 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:06.122+0000 7fa55e08f640 1 --2- 172.21.15.150:0/2740627903 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa5580b1e10 0x7fa5580b2220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:45:06.124 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:06.122+0000 7fa55d88e640 1 -- 172.21.15.150:0/2740627903 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa5580b1e10 msgr2=0x7fa5580b2220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:45:06.125 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:06.122+0000 7fa55d88e640 1 --2- 172.21.15.150:0/2740627903 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa5580b1e10 0x7fa5580b2220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:06.125 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:06.122+0000 7fa55d88e640 1 -- 172.21.15.150:0/2740627903 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa5581f4af0 msgr2=0x7fa5581f4f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:45:06.125 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:06.122+0000 7fa55d88e640 1 --2- 172.21.15.150:0/2740627903 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa5581f4af0 0x7fa5581f4f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:06.125 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:06.122+0000 7fa55d88e640 1 -- 172.21.15.150:0/2740627903 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa5580b2760 con 0x7fa544005320 2024-09-17T05:45:06.125 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:06.122+0000 7fa55d88e640 1 --2- 172.21.15.150:0/2740627903 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa544005320 0x7fa558156210 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7fa554009f10 tx=0x7fa55400f790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:45:06.125 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:06.122+0000 7fa54e7fc640 1 -- 172.21.15.150:0/2740627903 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa554003b80 con 0x7fa544005320 2024-09-17T05:45:06.125 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:06.122+0000 7fa54e7fc640 1 -- 172.21.15.150:0/2740627903 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa554003d20 con 0x7fa544005320 2024-09-17T05:45:06.125 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:06.122+0000 7fa55faf2640 1 -- 172.21.15.150:0/2740627903 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa5581f1e30 con 0x7fa544005320 2024-09-17T05:45:06.125 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:06.122+0000 7fa54e7fc640 1 -- 172.21.15.150:0/2740627903 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa554004d60 con 0x7fa544005320 2024-09-17T05:45:06.125 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:06.122+0000 7fa55faf2640 1 -- 172.21.15.150:0/2740627903 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa5581f1870 con 0x7fa544005320 2024-09-17T05:45:06.125 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:06.123+0000 7fa55faf2640 1 -- 172.21.15.150:0/2740627903 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa55815dbd0 con 0x7fa544005320 2024-09-17T05:45:06.126 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:06.124+0000 7fa54e7fc640 1 -- 172.21.15.150:0/2740627903 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 14) ==== 102155+0+0 (secure 0 0 0) 0x7fa554004050 con 0x7fa544005320 2024-09-17T05:45:06.126 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:06.125+0000 7fa54e7fc640 1 --2- 172.21.15.150:0/2740627903 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fa53c079370 0x7fa53c07b880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:45:06.126 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:06.125+0000 7fa54e7fc640 1 -- 172.21.15.150:0/2740627903 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 5767+0+0 (secure 0 0 0) 0x7fa55409a740 con 0x7fa544005320 2024-09-17T05:45:06.126 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:06.125+0000 7fa55d08d640 1 --2- 172.21.15.150:0/2740627903 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fa53c079370 0x7fa53c07b880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:45:06.126 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:06.125+0000 7fa55d08d640 1 --2- 172.21.15.150:0/2740627903 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fa53c079370 0x7fa53c07b880 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fa5581eb520 tx=0x7fa548000fe0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:45:06.129 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:06.129+0000 7fa54e7fc640 1 -- 172.21.15.150:0/2740627903 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fa5580b2760 con 0x7fa544005320 2024-09-17T05:45:06.427 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:06.426+0000 7fa55faf2640 1 -- 172.21.15.150:0/2740627903 --> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] -- mgr_command(tid 0: {"prefix": "fs clone cancel", "vol_name": "cephfs", "clone_name": "subvol_clone43941", "target": ["mon-mgr", ""]}) -- 0x7fa558154700 con 0x7fa53c079370 2024-09-17T05:45:07.477 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:07.476+0000 7fa54e7fc640 1 -- 172.21.15.150:0/2740627903 <== mgr.4108 v2:172.21.15.176:6800/3631216395 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7fa558154700 con 0x7fa53c079370 2024-09-17T05:45:07.480 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:07.479+0000 7fa55faf2640 1 -- 172.21.15.150:0/2740627903 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fa53c079370 msgr2=0x7fa53c07b880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:45:07.480 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:07.479+0000 7fa55faf2640 1 --2- 172.21.15.150:0/2740627903 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fa53c079370 0x7fa53c07b880 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fa5581eb520 tx=0x7fa548000fe0 comp rx=0 tx=0).stop 2024-09-17T05:45:07.481 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:07.479+0000 7fa55faf2640 1 -- 172.21.15.150:0/2740627903 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa544005320 msgr2=0x7fa558156210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:45:07.481 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:07.479+0000 7fa55faf2640 1 --2- 172.21.15.150:0/2740627903 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa544005320 0x7fa558156210 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7fa554009f10 tx=0x7fa55400f790 comp rx=0 tx=0).stop 2024-09-17T05:45:07.481 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:07.479+0000 7fa55faf2640 1 -- 172.21.15.150:0/2740627903 shutdown_connections 2024-09-17T05:45:07.481 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:07.479+0000 7fa55faf2640 1 --2- 172.21.15.150:0/2740627903 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa5581f4af0 0x7fa5581f4f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:07.481 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:07.479+0000 7fa55faf2640 1 --2- 172.21.15.150:0/2740627903 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fa53c079370 0x7fa53c07b880 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:07.481 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:07.479+0000 7fa55faf2640 1 --2- 172.21.15.150:0/2740627903 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa5580b1e10 0x7fa5580b2220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:07.481 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:07.479+0000 7fa55faf2640 1 --2- 172.21.15.150:0/2740627903 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa544005320 0x7fa558156210 unknown :-1 s=CLOSED pgs=517 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:07.481 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:07.479+0000 7fa55faf2640 1 -- 172.21.15.150:0/2740627903 >> 172.21.15.150:0/2740627903 conn(0x7fa55806d1c0 msgr2=0x7fa55815dde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:45:07.481 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:07.479+0000 7fa55faf2640 1 -- 172.21.15.150:0/2740627903 shutdown_connections 2024-09-17T05:45:07.481 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:07.479+0000 7fa55faf2640 1 -- 172.21.15.150:0/2740627903 wait complete. 2024-09-17T05:45:07.496 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs clone cancel cephfs subvol_clone99852 2024-09-17T05:45:07.678 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:07.678+0000 7f56f87ba640 1 -- 172.21.15.150:0/1824397558 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f56dc004d40 msgr2=0x7f56dc005190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:45:07.679 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:07.678+0000 7f56f87ba640 1 --2- 172.21.15.150:0/1824397558 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f56dc004d40 0x7f56dc005190 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f56e8009e20 tx=0x7f56dc005830 comp rx=0 tx=0).stop 2024-09-17T05:45:07.679 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:07.678+0000 7f56f6d57640 1 -- 172.21.15.150:0/1824397558 reap_dead start 2024-09-17T05:45:07.679 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:07.678+0000 7f56f87ba640 1 -- 172.21.15.150:0/1824397558 shutdown_connections 2024-09-17T05:45:07.679 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:07.678+0000 7f56f87ba640 1 -- 172.21.15.150:0/1824397558 >> 172.21.15.150:0/1824397558 conn(0x7f56f00b2ff0 msgr2=0x7f56f00b3400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:45:07.679 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:07.678+0000 7f56f87ba640 1 -- 172.21.15.150:0/1824397558 shutdown_connections 2024-09-17T05:45:07.679 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:07.678+0000 7f56f87ba640 1 -- 172.21.15.150:0/1824397558 wait complete. 2024-09-17T05:45:07.680 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:07.680+0000 7f56f87ba640 1 Processor -- start 2024-09-17T05:45:07.680 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:07.680+0000 7f56f87ba640 1 -- start start 2024-09-17T05:45:07.684 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:07.681+0000 7f56f87ba640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f56dc004d40 0x7f56f01547b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:45:07.684 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:07.681+0000 7f56f87ba640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f56f009c5b0 0x7f56f009e560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:45:07.684 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:07.681+0000 7f56f87ba640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f56f01560a0 0x7f56f01564b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:45:07.684 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:07.681+0000 7f56f87ba640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f56f00b6aa0 con 0x7f56f009c5b0 2024-09-17T05:45:07.685 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:07.681+0000 7f56f87ba640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f56f00b6920 con 0x7f56dc004d40 2024-09-17T05:45:07.685 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:07.681+0000 7f56f87ba640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f56f00b4910 con 0x7f56f01560a0 2024-09-17T05:45:07.685 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:07.682+0000 7f56f5d55640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f56f009c5b0 0x7f56f009e560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:45:07.685 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:07.682+0000 7f56f5d55640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f56f009c5b0 0x7f56f009e560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:57096/0 (socket says 172.21.15.150:57096) 2024-09-17T05:45:07.685 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:07.682+0000 7f56f5d55640 1 -- 172.21.15.150:0/719803384 learned_addr learned my addr 172.21.15.150:0/719803384 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:45:07.685 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:07.682+0000 7f56f6d57640 1 --2- 172.21.15.150:0/719803384 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f56f01560a0 0x7f56f01564b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:45:07.685 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:07.682+0000 7f56f6556640 1 --2- 172.21.15.150:0/719803384 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f56dc004d40 0x7f56f01547b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:45:07.685 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:07.682+0000 7f56f5d55640 1 -- 172.21.15.150:0/719803384 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f56f01560a0 msgr2=0x7f56f01564b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:45:07.685 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:07.682+0000 7f56f5d55640 1 --2- 172.21.15.150:0/719803384 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f56f01560a0 0x7f56f01564b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:07.685 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:07.682+0000 7f56f5d55640 1 -- 172.21.15.150:0/719803384 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f56dc004d40 msgr2=0x7f56f01547b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:45:07.686 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:07.682+0000 7f56f5d55640 1 --2- 172.21.15.150:0/719803384 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f56dc004d40 0x7f56f01547b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:07.686 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:07.682+0000 7f56f5d55640 1 -- 172.21.15.150:0/719803384 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f56f009eaa0 con 0x7f56f009c5b0 2024-09-17T05:45:07.686 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:07.682+0000 7f56f6d57640 1 --2- 172.21.15.150:0/719803384 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f56f01560a0 0x7f56f01564b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:45:07.686 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:07.682+0000 7f56f5d55640 1 --2- 172.21.15.150:0/719803384 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f56f009c5b0 0x7f56f009e560 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7f56e000c7d0 tx=0x7f56e000cc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:45:07.686 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:07.683+0000 7f56e6ffd640 1 -- 172.21.15.150:0/719803384 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56e00035f0 con 0x7f56f009c5b0 2024-09-17T05:45:07.686 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:07.683+0000 7f56f87ba640 1 -- 172.21.15.150:0/719803384 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f56f0155000 con 0x7f56f009c5b0 2024-09-17T05:45:07.686 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:07.683+0000 7f56e6ffd640 1 -- 172.21.15.150:0/719803384 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f56e0003790 con 0x7f56f009c5b0 2024-09-17T05:45:07.686 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:07.683+0000 7f56e6ffd640 1 -- 172.21.15.150:0/719803384 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56e0003be0 con 0x7f56f009c5b0 2024-09-17T05:45:07.686 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:07.683+0000 7f56f87ba640 1 -- 172.21.15.150:0/719803384 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f56f01555c0 con 0x7f56f009c5b0 2024-09-17T05:45:07.687 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:07.685+0000 7f56f87ba640 1 -- 172.21.15.150:0/719803384 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f56f00b43d0 con 0x7f56f009c5b0 2024-09-17T05:45:07.687 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:07.686+0000 7f56e6ffd640 1 -- 172.21.15.150:0/719803384 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 14) ==== 102155+0+0 (secure 0 0 0) 0x7f56e000a5e0 con 0x7f56f009c5b0 2024-09-17T05:45:07.687 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:07.686+0000 7f56e6ffd640 1 --2- 172.21.15.150:0/719803384 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f56d4079370 0x7f56d407b880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:45:07.687 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:07.686+0000 7f56e6ffd640 1 -- 172.21.15.150:0/719803384 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 5767+0+0 (secure 0 0 0) 0x7f56e009cb10 con 0x7f56f009c5b0 2024-09-17T05:45:07.687 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:07.687+0000 7f56f6556640 1 --2- 172.21.15.150:0/719803384 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f56d4079370 0x7f56d407b880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:45:07.688 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:07.687+0000 7f56f6556640 1 --2- 172.21.15.150:0/719803384 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f56d4079370 0x7f56d407b880 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f56ec005fd0 tx=0x7f56ec005f20 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:45:07.690 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:07.690+0000 7f56e6ffd640 1 -- 172.21.15.150:0/719803384 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f56e0063e60 con 0x7f56f009c5b0 2024-09-17T05:45:07.974 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:07.973+0000 7f56f87ba640 1 -- 172.21.15.150:0/719803384 --> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] -- mgr_command(tid 0: {"prefix": "fs clone cancel", "vol_name": "cephfs", "clone_name": "subvol_clone99852", "target": ["mon-mgr", ""]}) -- 0x7f56f00c4af0 con 0x7f56d4079370 2024-09-17T05:45:08.332 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:08.331+0000 7f56e6ffd640 1 -- 172.21.15.150:0/719803384 <== mgr.4108 v2:172.21.15.176:6800/3631216395 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f56f00c4af0 con 0x7f56d4079370 2024-09-17T05:45:08.335 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:08.334+0000 7f56f87ba640 1 -- 172.21.15.150:0/719803384 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f56d4079370 msgr2=0x7f56d407b880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:45:08.335 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:08.334+0000 7f56f87ba640 1 --2- 172.21.15.150:0/719803384 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f56d4079370 0x7f56d407b880 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f56ec005fd0 tx=0x7f56ec005f20 comp rx=0 tx=0).stop 2024-09-17T05:45:08.335 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:08.334+0000 7f56f87ba640 1 -- 172.21.15.150:0/719803384 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f56f009c5b0 msgr2=0x7f56f009e560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:45:08.335 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:08.334+0000 7f56f87ba640 1 --2- 172.21.15.150:0/719803384 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f56f009c5b0 0x7f56f009e560 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7f56e000c7d0 tx=0x7f56e000cc90 comp rx=0 tx=0).stop 2024-09-17T05:45:08.335 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:08.334+0000 7f56f87ba640 1 -- 172.21.15.150:0/719803384 shutdown_connections 2024-09-17T05:45:08.335 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:08.334+0000 7f56f87ba640 1 --2- 172.21.15.150:0/719803384 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f56d4079370 0x7f56d407b880 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:08.335 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:08.334+0000 7f56f87ba640 1 --2- 172.21.15.150:0/719803384 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f56f01560a0 0x7f56f01564b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:08.335 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:08.334+0000 7f56f87ba640 1 --2- 172.21.15.150:0/719803384 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f56f009c5b0 0x7f56f009e560 unknown :-1 s=CLOSED pgs=520 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:08.335 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:08.334+0000 7f56f87ba640 1 --2- 172.21.15.150:0/719803384 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f56dc004d40 0x7f56f01547b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:08.335 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:08.334+0000 7f56f87ba640 1 -- 172.21.15.150:0/719803384 >> 172.21.15.150:0/719803384 conn(0x7f56f00b2ff0 msgr2=0x7f56f00cfb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:45:08.336 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:08.334+0000 7f56f87ba640 1 -- 172.21.15.150:0/719803384 shutdown_connections 2024-09-17T05:45:08.336 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:08.334+0000 7f56f87ba640 1 -- 172.21.15.150:0/719803384 wait complete. 2024-09-17T05:45:08.348 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs clone cancel cephfs subvol_clone13123 2024-09-17T05:45:08.515 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:08.514+0000 7f9b42a70640 1 -- 172.21.15.150:0/928248263 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9b3c0d1090 msgr2=0x7f9b3c0ce8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:45:08.515 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:08.514+0000 7f9b42a70640 1 --2- 172.21.15.150:0/928248263 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9b3c0d1090 0x7f9b3c0ce8d0 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7f9b3c077500 tx=0x7f9b3402a790 comp rx=0 tx=0).stop 2024-09-17T05:45:08.515 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:08.514+0000 7f9b42a70640 1 -- 172.21.15.150:0/928248263 shutdown_connections 2024-09-17T05:45:08.515 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:08.514+0000 7f9b42a70640 1 --2- 172.21.15.150:0/928248263 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9b3c0d1090 0x7f9b3c0ce8d0 unknown :-1 s=CLOSED pgs=522 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:08.515 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:08.514+0000 7f9b42a70640 1 --2- 172.21.15.150:0/928248263 >> v2:172.21.15.176:3300/0 conn(0x7f9b3c0af160 0x7f9b3c0af570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:08.516 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:08.514+0000 7f9b42a70640 1 -- 172.21.15.150:0/928248263 >> 172.21.15.150:0/928248263 conn(0x7f9b3c0cefb0 msgr2=0x7f9b3c0cf3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:45:08.516 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:08.514+0000 7f9b42a70640 1 -- 172.21.15.150:0/928248263 shutdown_connections 2024-09-17T05:45:08.516 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:08.514+0000 7f9b42a70640 1 -- 172.21.15.150:0/928248263 wait complete. 2024-09-17T05:45:08.517 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:08.517+0000 7f9b42a70640 1 Processor -- start 2024-09-17T05:45:08.517 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:08.517+0000 7f9b42a70640 1 -- start start 2024-09-17T05:45:08.521 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:08.520+0000 7f9b42a70640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9b3c0af160 0x7f9b3c09e5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:45:08.521 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:08.520+0000 7f9b42a70640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9b3c0ce4c0 0x7f9b3c06e900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:45:08.521 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:08.520+0000 7f9b42a70640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9b3c0d1090 0x7f9b3c15b960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:45:08.521 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:08.520+0000 7f9b42a70640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f9b3c0b18e0 con 0x7f9b3c0d1090 2024-09-17T05:45:08.521 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:08.520+0000 7f9b42a70640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f9b3c0b1760 con 0x7f9b3c0af160 2024-09-17T05:45:08.522 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:08.520+0000 7f9b42a70640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f9b3c0cd040 con 0x7f9b3c0ce4c0 2024-09-17T05:45:08.522 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:08.520+0000 7f9b4100d640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9b3c0d1090 0x7f9b3c15b960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:45:08.522 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:08.520+0000 7f9b4100d640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9b3c0d1090 0x7f9b3c15b960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:57112/0 (socket says 172.21.15.150:57112) 2024-09-17T05:45:08.522 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:08.520+0000 7f9b4100d640 1 -- 172.21.15.150:0/708421133 learned_addr learned my addr 172.21.15.150:0/708421133 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:45:08.522 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:08.520+0000 7f9b3bfff640 1 --2- 172.21.15.150:0/708421133 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9b3c0ce4c0 0x7f9b3c06e900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:45:08.523 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:08.521+0000 7f9b4100d640 1 -- 172.21.15.150:0/708421133 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9b3c0ce4c0 msgr2=0x7f9b3c06e900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:45:08.523 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:08.521+0000 7f9b4100d640 1 --2- 172.21.15.150:0/708421133 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9b3c0ce4c0 0x7f9b3c06e900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:08.523 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:08.521+0000 7f9b4100d640 1 -- 172.21.15.150:0/708421133 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9b3c0af160 msgr2=0x7f9b3c09e5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:45:08.523 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:08.521+0000 7f9b4100d640 1 --2- 172.21.15.150:0/708421133 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9b3c0af160 0x7f9b3c09e5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:08.523 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:08.521+0000 7f9b4100d640 1 -- 172.21.15.150:0/708421133 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9b3c0a0240 con 0x7f9b3c0d1090 2024-09-17T05:45:08.523 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:08.521+0000 7f9b4100d640 1 --2- 172.21.15.150:0/708421133 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9b3c0d1090 0x7f9b3c15b960 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7f9b34034040 tx=0x7f9b34032e90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:45:08.524 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:08.522+0000 7f9b397fa640 1 -- 172.21.15.150:0/708421133 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b34041020 con 0x7f9b3c0d1090 2024-09-17T05:45:08.524 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:08.522+0000 7f9b397fa640 1 -- 172.21.15.150:0/708421133 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9b34004330 con 0x7f9b3c0d1090 2024-09-17T05:45:08.524 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:08.522+0000 7f9b397fa640 1 -- 172.21.15.150:0/708421133 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b34036040 con 0x7f9b3c0d1090 2024-09-17T05:45:08.524 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:08.522+0000 7f9b42a70640 1 -- 172.21.15.150:0/708421133 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9b3c06fa90 con 0x7f9b3c0d1090 2024-09-17T05:45:08.524 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:08.522+0000 7f9b42a70640 1 -- 172.21.15.150:0/708421133 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9b3c06e100 con 0x7f9b3c0d1090 2024-09-17T05:45:08.525 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:08.524+0000 7f9b42a70640 1 -- 172.21.15.150:0/708421133 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9b3c0af570 con 0x7f9b3c0d1090 2024-09-17T05:45:08.525 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:08.525+0000 7f9b397fa640 1 -- 172.21.15.150:0/708421133 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 14) ==== 102155+0+0 (secure 0 0 0) 0x7f9b34044020 con 0x7f9b3c0d1090 2024-09-17T05:45:08.526 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:08.525+0000 7f9b397fa640 1 --2- 172.21.15.150:0/708421133 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f9b200793a0 0x7f9b2007b8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:45:08.526 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:08.526+0000 7f9b397fa640 1 -- 172.21.15.150:0/708421133 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 5767+0+0 (secure 0 0 0) 0x7f9b340ba5a0 con 0x7f9b3c0d1090 2024-09-17T05:45:08.527 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:08.526+0000 7f9b4080c640 1 --2- 172.21.15.150:0/708421133 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f9b200793a0 0x7f9b2007b8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:45:08.530 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:08.530+0000 7f9b4080c640 1 --2- 172.21.15.150:0/708421133 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f9b200793a0 0x7f9b2007b8b0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f9b30009670 tx=0x7f9b30006bf0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:45:08.533 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:08.532+0000 7f9b397fa640 1 -- 172.21.15.150:0/708421133 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f9b3404b070 con 0x7f9b3c0d1090 2024-09-17T05:45:08.870 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:08.870+0000 7f9b42a70640 1 -- 172.21.15.150:0/708421133 --> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] -- mgr_command(tid 0: {"prefix": "fs clone cancel", "vol_name": "cephfs", "clone_name": "subvol_clone13123", "target": ["mon-mgr", ""]}) -- 0x7f9b3c0c5cb0 con 0x7f9b200793a0 2024-09-17T05:45:09.012 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:09.011+0000 7f9b397fa640 1 -- 172.21.15.150:0/708421133 <== mgr.4108 v2:172.21.15.176:6800/3631216395 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f9b3c0c5cb0 con 0x7f9b200793a0 2024-09-17T05:45:09.014 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:09.013+0000 7f9b42a70640 1 -- 172.21.15.150:0/708421133 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f9b200793a0 msgr2=0x7f9b2007b8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:45:09.014 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:09.013+0000 7f9b42a70640 1 --2- 172.21.15.150:0/708421133 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f9b200793a0 0x7f9b2007b8b0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f9b30009670 tx=0x7f9b30006bf0 comp rx=0 tx=0).stop 2024-09-17T05:45:09.014 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:09.013+0000 7f9b42a70640 1 -- 172.21.15.150:0/708421133 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9b3c0d1090 msgr2=0x7f9b3c15b960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:45:09.014 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:09.013+0000 7f9b42a70640 1 --2- 172.21.15.150:0/708421133 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9b3c0d1090 0x7f9b3c15b960 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7f9b34034040 tx=0x7f9b34032e90 comp rx=0 tx=0).stop 2024-09-17T05:45:09.015 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:09.014+0000 7f9b42a70640 1 -- 172.21.15.150:0/708421133 shutdown_connections 2024-09-17T05:45:09.015 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:09.014+0000 7f9b42a70640 1 --2- 172.21.15.150:0/708421133 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f9b200793a0 0x7f9b2007b8b0 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:09.015 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:09.014+0000 7f9b42a70640 1 --2- 172.21.15.150:0/708421133 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9b3c0d1090 0x7f9b3c15b960 unknown :-1 s=CLOSED pgs=523 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:09.015 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:09.014+0000 7f9b42a70640 1 --2- 172.21.15.150:0/708421133 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9b3c0ce4c0 0x7f9b3c06e900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:09.015 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:09.014+0000 7f9b42a70640 1 --2- 172.21.15.150:0/708421133 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9b3c0af160 0x7f9b3c09e5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:09.015 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:09.014+0000 7f9b42a70640 1 -- 172.21.15.150:0/708421133 >> 172.21.15.150:0/708421133 conn(0x7f9b3c0cefb0 msgr2=0x7f9b3c0d0980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:45:09.015 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:09.014+0000 7f9b42a70640 1 -- 172.21.15.150:0/708421133 shutdown_connections 2024-09-17T05:45:09.015 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:09.014+0000 7f9b42a70640 1 -- 172.21.15.150:0/708421133 wait complete. 2024-09-17T05:45:09.025 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume ls 2024-09-17T05:45:09.140 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:09.139+0000 7f646084d640 1 -- 172.21.15.150:0/2022329017 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f645c0c5a90 msgr2=0x7f645c0b5250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:45:09.140 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:09.139+0000 7f646084d640 1 --2- 172.21.15.150:0/2022329017 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f645c0c5a90 0x7f645c0b5250 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f6444009830 tx=0x7f644402a540 comp rx=0 tx=0).stop 2024-09-17T05:45:09.140 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:09.139+0000 7f646084d640 1 -- 172.21.15.150:0/2022329017 shutdown_connections 2024-09-17T05:45:09.140 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:09.139+0000 7f646084d640 1 --2- 172.21.15.150:0/2022329017 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f645c0c5a90 0x7f645c0b5250 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:09.141 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:09.139+0000 7f646084d640 1 -- 172.21.15.150:0/2022329017 >> 172.21.15.150:0/2022329017 conn(0x7f645c0cee80 msgr2=0x7f645c0cf290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:45:09.141 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:09.139+0000 7f646084d640 1 -- 172.21.15.150:0/2022329017 shutdown_connections 2024-09-17T05:45:09.141 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:09.139+0000 7f646084d640 1 -- 172.21.15.150:0/2022329017 wait complete. 2024-09-17T05:45:09.141 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:09.141+0000 7f646084d640 1 Processor -- start 2024-09-17T05:45:09.141 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:09.141+0000 7f646084d640 1 -- start start 2024-09-17T05:45:09.144 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:09.142+0000 7f646084d640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f645c0b5790 0x7f645c154ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:45:09.145 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:09.142+0000 7f646084d640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f645c0c5a90 0x7f645c06deb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:45:09.145 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:09.142+0000 7f646084d640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f645c0cea50 0x7f645c06e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:45:09.145 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:09.142+0000 7f646084d640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f645c167ec0 con 0x7f645c0c5a90 2024-09-17T05:45:09.145 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:09.142+0000 7f646084d640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f645c167d40 con 0x7f645c0b5790 2024-09-17T05:45:09.145 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:09.142+0000 7f646084d640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f645c168040 con 0x7f645c0cea50 2024-09-17T05:45:09.146 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:09.142+0000 7f6451d9b640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f645c0c5a90 0x7f645c06deb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:45:09.146 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:09.142+0000 7f6451d9b640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f645c0c5a90 0x7f645c06deb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:57114/0 (socket says 172.21.15.150:57114) 2024-09-17T05:45:09.146 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:09.142+0000 7f6451d9b640 1 -- 172.21.15.150:0/3294345668 learned_addr learned my addr 172.21.15.150:0/3294345668 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:45:09.146 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:09.142+0000 7f645a59c640 1 --2- 172.21.15.150:0/3294345668 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f645c0b5790 0x7f645c154ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:45:09.146 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:09.142+0000 7f645ad9d640 1 --2- 172.21.15.150:0/3294345668 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f645c0cea50 0x7f645c06e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:45:09.146 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:09.143+0000 7f6451d9b640 1 -- 172.21.15.150:0/3294345668 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f645c0cea50 msgr2=0x7f645c06e7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:45:09.147 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:09.143+0000 7f6451d9b640 1 --2- 172.21.15.150:0/3294345668 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f645c0cea50 0x7f645c06e7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:09.147 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:09.143+0000 7f6451d9b640 1 -- 172.21.15.150:0/3294345668 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f645c0b5790 msgr2=0x7f645c154ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:45:09.147 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:09.143+0000 7f6451d9b640 1 --2- 172.21.15.150:0/3294345668 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f645c0b5790 0x7f645c154ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:09.147 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:09.143+0000 7f6451d9b640 1 -- 172.21.15.150:0/3294345668 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f645c155020 con 0x7f645c0c5a90 2024-09-17T05:45:09.147 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:09.143+0000 7f645a59c640 1 --2- 172.21.15.150:0/3294345668 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f645c0b5790 0x7f645c154ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T05:45:09.147 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:09.143+0000 7f6451d9b640 1 --2- 172.21.15.150:0/3294345668 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f645c0c5a90 0x7f645c06deb0 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7f644402ab30 tx=0x7f6444003c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:45:09.148 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:09.143+0000 7f64537fe640 1 -- 172.21.15.150:0/3294345668 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6444005c90 con 0x7f645c0c5a90 2024-09-17T05:45:09.148 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:09.143+0000 7f64537fe640 1 -- 172.21.15.150:0/3294345668 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f6444005020 con 0x7f645c0c5a90 2024-09-17T05:45:09.148 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:09.143+0000 7f646084d640 1 -- 172.21.15.150:0/3294345668 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f645c06e3f0 con 0x7f645c0c5a90 2024-09-17T05:45:09.148 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:09.143+0000 7f64537fe640 1 -- 172.21.15.150:0/3294345668 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6444005450 con 0x7f645c0c5a90 2024-09-17T05:45:09.148 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:09.143+0000 7f646084d640 1 -- 172.21.15.150:0/3294345668 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f645c15e650 con 0x7f645c0c5a90 2024-09-17T05:45:09.149 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:09.144+0000 7f646084d640 1 -- 172.21.15.150:0/3294345668 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f645c0b5250 con 0x7f645c0c5a90 2024-09-17T05:45:09.150 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:09.145+0000 7f64537fe640 1 -- 172.21.15.150:0/3294345668 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 14) ==== 102155+0+0 (secure 0 0 0) 0x7f64440317c0 con 0x7f645c0c5a90 2024-09-17T05:45:09.150 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:09.145+0000 7f64537fe640 1 --2- 172.21.15.150:0/3294345668 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f643c079370 0x7f643c07b880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:45:09.150 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:09.145+0000 7f64537fe640 1 -- 172.21.15.150:0/3294345668 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 5767+0+0 (secure 0 0 0) 0x7f64440ba720 con 0x7f645c0c5a90 2024-09-17T05:45:09.151 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:09.145+0000 7f645a59c640 1 --2- 172.21.15.150:0/3294345668 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f643c079370 0x7f643c07b880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:45:09.151 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:09.146+0000 7f645a59c640 1 --2- 172.21.15.150:0/3294345668 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f643c079370 0x7f643c07b880 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f644c007fd0 tx=0x7f644c009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:45:09.151 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:09.150+0000 7f64537fe640 1 -- 172.21.15.150:0/3294345668 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f644403f030 con 0x7f645c0c5a90 2024-09-17T05:45:09.349 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:09.348+0000 7f646084d640 1 -- 172.21.15.150:0/3294345668 --> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] -- mgr_command(tid 0: {"prefix": "fs volume ls", "target": ["mon-mgr", ""]}) -- 0x7f645c0cc700 con 0x7f643c079370 2024-09-17T05:45:09.350 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:09.350+0000 7f64537fe640 1 -- 172.21.15.150:0/3294345668 <== mgr.4108 v2:172.21.15.176:6800/3631216395 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+41 (secure 0 0 0) 0x7f645c0cc700 con 0x7f643c079370 2024-09-17T05:45:09.350 INFO:teuthology.orchestra.run.smithi150.stdout:[ 2024-09-17T05:45:09.351 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-09-17T05:45:09.351 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "cephfs" 2024-09-17T05:45:09.351 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-09-17T05:45:09.351 INFO:teuthology.orchestra.run.smithi150.stdout:] 2024-09-17T05:45:09.353 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:09.352+0000 7f646084d640 1 -- 172.21.15.150:0/3294345668 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f643c079370 msgr2=0x7f643c07b880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:45:09.353 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:09.352+0000 7f646084d640 1 --2- 172.21.15.150:0/3294345668 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f643c079370 0x7f643c07b880 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f644c007fd0 tx=0x7f644c009040 comp rx=0 tx=0).stop 2024-09-17T05:45:09.353 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:09.352+0000 7f646084d640 1 -- 172.21.15.150:0/3294345668 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f645c0c5a90 msgr2=0x7f645c06deb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:45:09.353 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:09.352+0000 7f646084d640 1 --2- 172.21.15.150:0/3294345668 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f645c0c5a90 0x7f645c06deb0 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7f644402ab30 tx=0x7f6444003c10 comp rx=0 tx=0).stop 2024-09-17T05:45:09.353 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:09.352+0000 7f646084d640 1 -- 172.21.15.150:0/3294345668 shutdown_connections 2024-09-17T05:45:09.354 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:09.352+0000 7f646084d640 1 --2- 172.21.15.150:0/3294345668 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f643c079370 0x7f643c07b880 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:09.354 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:09.352+0000 7f646084d640 1 --2- 172.21.15.150:0/3294345668 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f645c0cea50 0x7f645c06e7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:09.354 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:09.352+0000 7f646084d640 1 --2- 172.21.15.150:0/3294345668 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f645c0c5a90 0x7f645c06deb0 unknown :-1 s=CLOSED pgs=525 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:09.354 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:09.352+0000 7f646084d640 1 --2- 172.21.15.150:0/3294345668 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f645c0b5790 0x7f645c154ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:09.354 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:09.352+0000 7f646084d640 1 -- 172.21.15.150:0/3294345668 >> 172.21.15.150:0/3294345668 conn(0x7f645c0cee80 msgr2=0x7f645c0b6790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:45:09.354 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:09.352+0000 7f646084d640 1 -- 172.21.15.150:0/3294345668 shutdown_connections 2024-09-17T05:45:09.354 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:09.352+0000 7f646084d640 1 -- 172.21.15.150:0/3294345668 wait complete. 2024-09-17T05:45:09.365 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume ls cephfs --format json 2024-09-17T05:45:09.480 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:09.479+0000 7ffb2e719640 1 -- 172.21.15.150:0/150664303 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ffb28070a70 msgr2=0x7ffb2806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:45:09.480 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:09.479+0000 7ffb2e719640 1 --2- 172.21.15.150:0/150664303 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ffb28070a70 0x7ffb2806e2f0 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7ffb1c005fd0 tx=0x7ffb1c02a540 comp rx=0 tx=0).stop 2024-09-17T05:45:09.480 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:09.479+0000 7ffb2e719640 1 -- 172.21.15.150:0/150664303 shutdown_connections 2024-09-17T05:45:09.480 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:09.479+0000 7ffb2e719640 1 --2- 172.21.15.150:0/150664303 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ffb28070a70 0x7ffb2806e2f0 unknown :-1 s=CLOSED pgs=526 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:09.480 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:09.479+0000 7ffb2e719640 1 --2- 172.21.15.150:0/150664303 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ffb28074440 0x7ffb2806ddb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:09.480 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:09.479+0000 7ffb2e719640 1 -- 172.21.15.150:0/150664303 >> 172.21.15.150:0/150664303 conn(0x7ffb28073920 msgr2=0x7ffb28073d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:45:09.481 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:09.479+0000 7ffb2e719640 1 -- 172.21.15.150:0/150664303 shutdown_connections 2024-09-17T05:45:09.481 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:09.479+0000 7ffb2e719640 1 -- 172.21.15.150:0/150664303 wait complete. 2024-09-17T05:45:09.481 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:09.481+0000 7ffb2e719640 1 Processor -- start 2024-09-17T05:45:09.481 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:09.481+0000 7ffb2e719640 1 -- start start 2024-09-17T05:45:09.484 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:09.482+0000 7ffb2e719640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ffb28070a70 0x7ffb2813dc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:45:09.484 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:09.482+0000 7ffb2e719640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ffb28074440 0x7ffb281408b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:45:09.484 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:09.482+0000 7ffb2e719640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ffb2815b920 0x7ffb28140df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:45:09.484 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:09.482+0000 7ffb2e719640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7ffb280b41b0 con 0x7ffb28070a70 2024-09-17T05:45:09.484 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:09.482+0000 7ffb2e719640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7ffb280d0590 con 0x7ffb2815b920 2024-09-17T05:45:09.484 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:09.482+0000 7ffb2e719640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7ffb280b4330 con 0x7ffb28074440 2024-09-17T05:45:09.484 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:09.482+0000 7ffb27fff640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ffb28070a70 0x7ffb2813dc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:45:09.484 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:09.482+0000 7ffb27fff640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ffb28070a70 0x7ffb2813dc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:57140/0 (socket says 172.21.15.150:57140) 2024-09-17T05:45:09.484 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:09.482+0000 7ffb27fff640 1 -- 172.21.15.150:0/3603419966 learned_addr learned my addr 172.21.15.150:0/3603419966 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:45:09.484 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:09.482+0000 7ffb2ccb6640 1 --2- 172.21.15.150:0/3603419966 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ffb2815b920 0x7ffb28140df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:45:09.485 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:09.482+0000 7ffb277fe640 1 --2- 172.21.15.150:0/3603419966 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ffb28074440 0x7ffb281408b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:45:09.485 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:09.483+0000 7ffb27fff640 1 -- 172.21.15.150:0/3603419966 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ffb28074440 msgr2=0x7ffb281408b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:45:09.485 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:09.483+0000 7ffb27fff640 1 --2- 172.21.15.150:0/3603419966 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ffb28074440 0x7ffb281408b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:09.485 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:09.483+0000 7ffb27fff640 1 -- 172.21.15.150:0/3603419966 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ffb2815b920 msgr2=0x7ffb28140df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:45:09.485 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:09.483+0000 7ffb27fff640 1 --2- 172.21.15.150:0/3603419966 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ffb2815b920 0x7ffb28140df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:09.485 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:09.483+0000 7ffb27fff640 1 -- 172.21.15.150:0/3603419966 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffb281f7b50 con 0x7ffb28070a70 2024-09-17T05:45:09.485 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:09.483+0000 7ffb2ccb6640 1 --2- 172.21.15.150:0/3603419966 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ffb2815b920 0x7ffb28140df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T05:45:09.485 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:09.483+0000 7ffb27fff640 1 --2- 172.21.15.150:0/3603419966 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ffb28070a70 0x7ffb2813dc80 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7ffb1800e790 tx=0x7ffb1800ec50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:45:09.485 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:09.483+0000 7ffb24ff9640 1 -- 172.21.15.150:0/3603419966 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb1800eea0 con 0x7ffb28070a70 2024-09-17T05:45:09.485 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:09.483+0000 7ffb24ff9640 1 -- 172.21.15.150:0/3603419966 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ffb1800cdb0 con 0x7ffb28070a70 2024-09-17T05:45:09.485 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:09.483+0000 7ffb24ff9640 1 -- 172.21.15.150:0/3603419966 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb18010690 con 0x7ffb28070a70 2024-09-17T05:45:09.485 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:09.483+0000 7ffb2e719640 1 -- 172.21.15.150:0/3603419966 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffb281f6d90 con 0x7ffb28070a70 2024-09-17T05:45:09.485 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:09.483+0000 7ffb2e719640 1 -- 172.21.15.150:0/3603419966 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffb281f7350 con 0x7ffb28070a70 2024-09-17T05:45:09.486 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:09.484+0000 7ffb2e719640 1 -- 172.21.15.150:0/3603419966 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffb280b4880 con 0x7ffb28070a70 2024-09-17T05:45:09.486 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:09.485+0000 7ffb24ff9640 1 -- 172.21.15.150:0/3603419966 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 14) ==== 102155+0+0 (secure 0 0 0) 0x7ffb18010830 con 0x7ffb28070a70 2024-09-17T05:45:09.486 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:09.485+0000 7ffb24ff9640 1 --2- 172.21.15.150:0/3603419966 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7ffb14079370 0x7ffb1407b880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:45:09.487 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:09.485+0000 7ffb24ff9640 1 -- 172.21.15.150:0/3603419966 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 5767+0+0 (secure 0 0 0) 0x7ffb18099ef0 con 0x7ffb28070a70 2024-09-17T05:45:09.487 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:09.486+0000 7ffb277fe640 1 --2- 172.21.15.150:0/3603419966 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7ffb14079370 0x7ffb1407b880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:45:09.487 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:09.486+0000 7ffb277fe640 1 --2- 172.21.15.150:0/3603419966 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7ffb14079370 0x7ffb1407b880 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7ffb1c033000 tx=0x7ffb1c004730 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:45:09.490 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:09.490+0000 7ffb24ff9640 1 -- 172.21.15.150:0/3603419966 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7ffb18063790 con 0x7ffb28070a70 2024-09-17T05:45:09.692 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:09.691+0000 7ffb2e719640 1 -- 172.21.15.150:0/3603419966 --> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] -- mgr_command(tid 0: {"prefix": "fs subvolume ls", "vol_name": "cephfs", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7ffb280d0140 con 0x7ffb14079370 2024-09-17T05:45:09.697 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:09.697+0000 7ffb24ff9640 1 -- 172.21.15.150:0/3603419966 <== mgr.4108 v2:172.21.15.176:6800/3631216395 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+234 (secure 0 0 0) 0x7ffb280d0140 con 0x7ffb14079370 2024-09-17T05:45:09.697 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-09-17T05:45:09.698 INFO:teuthology.orchestra.run.smithi150.stdout:[ 2024-09-17T05:45:09.698 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-09-17T05:45:09.698 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "subvol_clone99852" 2024-09-17T05:45:09.698 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-17T05:45:09.698 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-09-17T05:45:09.698 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "sv1" 2024-09-17T05:45:09.698 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-17T05:45:09.698 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-09-17T05:45:09.698 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "subvol_clone83860" 2024-09-17T05:45:09.698 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-17T05:45:09.698 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-09-17T05:45:09.698 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "subvol_clone43941" 2024-09-17T05:45:09.699 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-17T05:45:09.699 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-09-17T05:45:09.699 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "subvol_clone13123" 2024-09-17T05:45:09.699 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-09-17T05:45:09.699 INFO:teuthology.orchestra.run.smithi150.stdout:] 2024-09-17T05:45:09.700 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:09.699+0000 7ffb2e719640 1 -- 172.21.15.150:0/3603419966 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7ffb14079370 msgr2=0x7ffb1407b880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:45:09.700 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:09.699+0000 7ffb2e719640 1 --2- 172.21.15.150:0/3603419966 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7ffb14079370 0x7ffb1407b880 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7ffb1c033000 tx=0x7ffb1c004730 comp rx=0 tx=0).stop 2024-09-17T05:45:09.700 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:09.699+0000 7ffb2e719640 1 -- 172.21.15.150:0/3603419966 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ffb28070a70 msgr2=0x7ffb2813dc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:45:09.700 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:09.699+0000 7ffb2e719640 1 --2- 172.21.15.150:0/3603419966 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ffb28070a70 0x7ffb2813dc80 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7ffb1800e790 tx=0x7ffb1800ec50 comp rx=0 tx=0).stop 2024-09-17T05:45:09.700 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:09.699+0000 7ffb2e719640 1 -- 172.21.15.150:0/3603419966 shutdown_connections 2024-09-17T05:45:09.700 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:09.699+0000 7ffb2e719640 1 --2- 172.21.15.150:0/3603419966 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ffb2815b920 0x7ffb28140df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:09.700 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:09.699+0000 7ffb2e719640 1 --2- 172.21.15.150:0/3603419966 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7ffb14079370 0x7ffb1407b880 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:09.700 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:09.699+0000 7ffb2e719640 1 --2- 172.21.15.150:0/3603419966 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ffb28074440 0x7ffb281408b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:09.701 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:09.699+0000 7ffb2e719640 1 --2- 172.21.15.150:0/3603419966 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ffb28070a70 0x7ffb2813dc80 unknown :-1 s=CLOSED pgs=527 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:09.701 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:09.699+0000 7ffb2e719640 1 -- 172.21.15.150:0/3603419966 >> 172.21.15.150:0/3603419966 conn(0x7ffb28073920 msgr2=0x7ffb280cfa30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:45:09.701 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:09.699+0000 7ffb2e719640 1 -- 172.21.15.150:0/3603419966 shutdown_connections 2024-09-17T05:45:09.701 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:09.699+0000 7ffb2e719640 1 -- 172.21.15.150:0/3603419966 wait complete. 2024-09-17T05:45:09.711 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume rm --force cephfs subvol_clone99852 2024-09-17T05:45:09.830 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:09.829+0000 7ff4593c6640 1 -- 172.21.15.150:0/442581963 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff434005360 msgr2=0x7ff43400b9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:45:09.830 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:09.829+0000 7ff4593c6640 1 --2- 172.21.15.150:0/442581963 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff434005360 0x7ff43400b9e0 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7ff45408e5a0 tx=0x7ff434005830 comp rx=0 tx=0).stop 2024-09-17T05:45:09.830 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:09.829+0000 7ff4537fe640 1 -- 172.21.15.150:0/442581963 reap_dead start 2024-09-17T05:45:09.830 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:09.829+0000 7ff4593c6640 1 -- 172.21.15.150:0/442581963 shutdown_connections 2024-09-17T05:45:09.830 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:09.829+0000 7ff4593c6640 1 -- 172.21.15.150:0/442581963 >> 172.21.15.150:0/442581963 conn(0x7ff4540d46c0 msgr2=0x7ff4540d4ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:45:09.830 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:09.829+0000 7ff4593c6640 1 -- 172.21.15.150:0/442581963 shutdown_connections 2024-09-17T05:45:09.831 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:09.829+0000 7ff4593c6640 1 -- 172.21.15.150:0/442581963 wait complete. 2024-09-17T05:45:09.831 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:09.831+0000 7ff4593c6640 1 Processor -- start 2024-09-17T05:45:09.831 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:09.831+0000 7ff4593c6640 1 -- start start 2024-09-17T05:45:09.834 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:09.832+0000 7ff4593c6640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff434005360 0x7ff4541f9f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:45:09.834 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:09.832+0000 7ff4593c6640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff454157a90 0x7ff4541eaf90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:45:09.834 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:09.832+0000 7ff4593c6640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff454157ea0 0x7ff4541eb4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:45:09.834 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:09.832+0000 7ff4593c6640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7ff4540d27b0 con 0x7ff434005360 2024-09-17T05:45:09.834 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:09.832+0000 7ff4593c6640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7ff4540d2630 con 0x7ff454157a90 2024-09-17T05:45:09.835 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:09.832+0000 7ff4593c6640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7ff4540d2930 con 0x7ff454157ea0 2024-09-17T05:45:09.835 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:09.832+0000 7ff452ffd640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff434005360 0x7ff4541f9f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:45:09.835 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:09.832+0000 7ff452ffd640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff434005360 0x7ff4541f9f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:57166/0 (socket says 172.21.15.150:57166) 2024-09-17T05:45:09.835 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:09.832+0000 7ff452ffd640 1 -- 172.21.15.150:0/666839203 learned_addr learned my addr 172.21.15.150:0/666839203 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:45:09.835 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:09.832+0000 7ff44a7fc640 1 --2- 172.21.15.150:0/666839203 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff454157a90 0x7ff4541eaf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:45:09.835 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:09.832+0000 7ff4537fe640 1 --2- 172.21.15.150:0/666839203 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff454157ea0 0x7ff4541eb4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:45:09.835 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:09.833+0000 7ff452ffd640 1 -- 172.21.15.150:0/666839203 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff454157ea0 msgr2=0x7ff4541eb4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:45:09.835 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:09.833+0000 7ff452ffd640 1 --2- 172.21.15.150:0/666839203 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff454157ea0 0x7ff4541eb4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:09.835 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:09.833+0000 7ff452ffd640 1 -- 172.21.15.150:0/666839203 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff454157a90 msgr2=0x7ff4541eaf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:45:09.835 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:09.833+0000 7ff452ffd640 1 --2- 172.21.15.150:0/666839203 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff454157a90 0x7ff4541eaf90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:09.835 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:09.833+0000 7ff452ffd640 1 -- 172.21.15.150:0/666839203 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff45415ecb0 con 0x7ff434005360 2024-09-17T05:45:09.835 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:09.833+0000 7ff452ffd640 1 --2- 172.21.15.150:0/666839203 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff434005360 0x7ff4541f9f00 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7ff444011a10 tx=0x7ff444011ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:45:09.835 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:09.833+0000 7ff44bfff640 1 -- 172.21.15.150:0/666839203 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff44401e070 con 0x7ff434005360 2024-09-17T05:45:09.836 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:09.833+0000 7ff44bfff640 1 -- 172.21.15.150:0/666839203 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff44400fd60 con 0x7ff434005360 2024-09-17T05:45:09.836 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:09.833+0000 7ff4593c6640 1 -- 172.21.15.150:0/666839203 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff4540cb7a0 con 0x7ff434005360 2024-09-17T05:45:09.836 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:09.833+0000 7ff44bfff640 1 -- 172.21.15.150:0/666839203 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff444019650 con 0x7ff434005360 2024-09-17T05:45:09.836 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:09.833+0000 7ff4593c6640 1 -- 172.21.15.150:0/666839203 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff4541f67d0 con 0x7ff434005360 2024-09-17T05:45:09.837 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:09.834+0000 7ff4593c6640 1 -- 172.21.15.150:0/666839203 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff45408cd50 con 0x7ff434005360 2024-09-17T05:45:09.837 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:09.835+0000 7ff44bfff640 1 -- 172.21.15.150:0/666839203 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 14) ==== 102155+0+0 (secure 0 0 0) 0x7ff444021070 con 0x7ff434005360 2024-09-17T05:45:09.837 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:09.835+0000 7ff44bfff640 1 --2- 172.21.15.150:0/666839203 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7ff438079370 0x7ff43807b880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:45:09.837 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:09.835+0000 7ff44bfff640 1 -- 172.21.15.150:0/666839203 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 5767+0+0 (secure 0 0 0) 0x7ff44409a0d0 con 0x7ff434005360 2024-09-17T05:45:09.837 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:09.836+0000 7ff44a7fc640 1 --2- 172.21.15.150:0/666839203 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7ff438079370 0x7ff43807b880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:45:09.837 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:09.836+0000 7ff44a7fc640 1 --2- 172.21.15.150:0/666839203 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7ff438079370 0x7ff43807b880 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7ff4540ccf70 tx=0x7ff43c006b10 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:45:09.841 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:09.840+0000 7ff44bfff640 1 -- 172.21.15.150:0/666839203 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7ff45408cd50 con 0x7ff434005360 2024-09-17T05:45:10.041 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:10.041+0000 7ff4593c6640 1 -- 172.21.15.150:0/666839203 --> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] -- mgr_command(tid 0: {"prefix": "fs subvolume rm", "force": true, "vol_name": "cephfs", "sub_name": "subvol_clone99852", "target": ["mon-mgr", ""]}) -- 0x7ff4540d0e00 con 0x7ff438079370 2024-09-17T05:45:13.305 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:13.304+0000 7ff44bfff640 1 -- 172.21.15.150:0/666839203 <== mgr.4108 v2:172.21.15.176:6800/3631216395 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7ff4540d0e00 con 0x7ff438079370 2024-09-17T05:45:13.308 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:13.307+0000 7ff4593c6640 1 -- 172.21.15.150:0/666839203 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7ff438079370 msgr2=0x7ff43807b880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:45:13.308 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:13.307+0000 7ff4593c6640 1 --2- 172.21.15.150:0/666839203 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7ff438079370 0x7ff43807b880 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7ff4540ccf70 tx=0x7ff43c006b10 comp rx=0 tx=0).stop 2024-09-17T05:45:13.308 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:13.307+0000 7ff4593c6640 1 -- 172.21.15.150:0/666839203 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff434005360 msgr2=0x7ff4541f9f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:45:13.308 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:13.307+0000 7ff4593c6640 1 --2- 172.21.15.150:0/666839203 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff434005360 0x7ff4541f9f00 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7ff444011a10 tx=0x7ff444011ed0 comp rx=0 tx=0).stop 2024-09-17T05:45:13.308 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:13.307+0000 7ff4593c6640 1 -- 172.21.15.150:0/666839203 shutdown_connections 2024-09-17T05:45:13.308 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:13.307+0000 7ff4593c6640 1 --2- 172.21.15.150:0/666839203 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff454157a90 0x7ff4541eaf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:13.308 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:13.307+0000 7ff4593c6640 1 --2- 172.21.15.150:0/666839203 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7ff438079370 0x7ff43807b880 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:13.308 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:13.307+0000 7ff4593c6640 1 --2- 172.21.15.150:0/666839203 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff454157ea0 0x7ff4541eb4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:13.308 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:13.307+0000 7ff4593c6640 1 --2- 172.21.15.150:0/666839203 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff434005360 0x7ff4541f9f00 unknown :-1 s=CLOSED pgs=530 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:13.308 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:13.307+0000 7ff4593c6640 1 -- 172.21.15.150:0/666839203 >> 172.21.15.150:0/666839203 conn(0x7ff4540d46c0 msgr2=0x7ff454163a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:45:13.308 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:13.307+0000 7ff4593c6640 1 -- 172.21.15.150:0/666839203 shutdown_connections 2024-09-17T05:45:13.309 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:13.307+0000 7ff4593c6640 1 -- 172.21.15.150:0/666839203 wait complete. 2024-09-17T05:45:13.317 INFO:tasks.ceph.mgr.x.smithi176.stderr:2024-09-17T05:45:13.316+0000 7f33d9f1f640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-17T05:45:13.317 INFO:tasks.ceph.mgr.x.smithi176.stderr:2024-09-17T05:45:13.316+0000 7f33d9f1f640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-17T05:45:13.317 INFO:tasks.ceph.mgr.x.smithi176.stderr:2024-09-17T05:45:13.316+0000 7f33d9f1f640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-17T05:45:13.317 INFO:tasks.ceph.mgr.x.smithi176.stderr:2024-09-17T05:45:13.316+0000 7f33d9f1f640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-17T05:45:13.318 INFO:tasks.ceph.mgr.x.smithi176.stderr:2024-09-17T05:45:13.316+0000 7f33d9f1f640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-17T05:45:13.323 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume snapshot ls cephfs sv1 --format json 2024-09-17T05:45:13.448 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:13.447+0000 7fd0d8a9b640 1 -- 172.21.15.150:0/444101480 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd0d415f200 msgr2=0x7fd0d415bc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:45:13.448 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:13.447+0000 7fd0d8a9b640 1 --2- 172.21.15.150:0/444101480 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd0d415f200 0x7fd0d415bc10 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7fd0d4070ec0 tx=0x7fd0c402a4a0 comp rx=0 tx=0).stop 2024-09-17T05:45:13.448 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:13.447+0000 7fd0d8a9b640 1 -- 172.21.15.150:0/444101480 shutdown_connections 2024-09-17T05:45:13.448 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:13.447+0000 7fd0d8a9b640 1 --2- 172.21.15.150:0/444101480 >> v2:172.21.15.176:3300/0 conn(0x7fd0d40d0000 0x7fd0d40b5200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:13.448 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:13.447+0000 7fd0d8a9b640 1 --2- 172.21.15.150:0/444101480 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd0d415f200 0x7fd0d415bc10 unknown :-1 s=CLOSED pgs=532 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:13.448 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:13.447+0000 7fd0d8a9b640 1 -- 172.21.15.150:0/444101480 >> 172.21.15.150:0/444101480 conn(0x7fd0d406d3d0 msgr2=0x7fd0d40b2470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:45:13.448 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:13.447+0000 7fd0d8a9b640 1 -- 172.21.15.150:0/444101480 shutdown_connections 2024-09-17T05:45:13.448 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:13.447+0000 7fd0d8a9b640 1 -- 172.21.15.150:0/444101480 wait complete. 2024-09-17T05:45:13.449 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:13.449+0000 7fd0d8a9b640 1 Processor -- start 2024-09-17T05:45:13.449 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:13.449+0000 7fd0d8a9b640 1 -- start start 2024-09-17T05:45:13.452 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:13.450+0000 7fd0d8a9b640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd0d40b5740 0x7fd0d413fe90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:45:13.452 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:13.450+0000 7fd0d8a9b640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd0d40d0000 0x7fd0d4152d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:45:13.452 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:13.450+0000 7fd0d8a9b640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd0d415f200 0x7fd0d415de00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:45:13.452 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:13.450+0000 7fd0d8a9b640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7fd0d4159420 con 0x7fd0d40d0000 2024-09-17T05:45:13.452 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:13.450+0000 7fd0d8a9b640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fd0d41592a0 con 0x7fd0d415f200 2024-09-17T05:45:13.452 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:13.450+0000 7fd0d8a9b640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fd0d41595a0 con 0x7fd0d40b5740 2024-09-17T05:45:13.452 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:13.450+0000 7fd0d1d9b640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd0d40d0000 0x7fd0d4152d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:45:13.452 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:13.450+0000 7fd0d1d9b640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd0d40d0000 0x7fd0d4152d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:50696/0 (socket says 172.21.15.150:50696) 2024-09-17T05:45:13.453 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:13.450+0000 7fd0d1d9b640 1 -- 172.21.15.150:0/701449513 learned_addr learned my addr 172.21.15.150:0/701449513 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:45:13.453 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:13.450+0000 7fd0d2d9d640 1 --2- 172.21.15.150:0/701449513 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd0d415f200 0x7fd0d415de00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:45:13.453 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:13.450+0000 7fd0d259c640 1 --2- 172.21.15.150:0/701449513 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd0d40b5740 0x7fd0d413fe90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:45:13.453 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:13.450+0000 7fd0d1d9b640 1 -- 172.21.15.150:0/701449513 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd0d40b5740 msgr2=0x7fd0d413fe90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:45:13.453 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:13.450+0000 7fd0d1d9b640 1 --2- 172.21.15.150:0/701449513 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd0d40b5740 0x7fd0d413fe90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:13.453 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:13.450+0000 7fd0d1d9b640 1 -- 172.21.15.150:0/701449513 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd0d415f200 msgr2=0x7fd0d415de00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:45:13.453 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:13.450+0000 7fd0d1d9b640 1 --2- 172.21.15.150:0/701449513 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd0d415f200 0x7fd0d415de00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:13.453 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:13.450+0000 7fd0d1d9b640 1 -- 172.21.15.150:0/701449513 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd0d4153710 con 0x7fd0d40d0000 2024-09-17T05:45:13.453 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:13.451+0000 7fd0d1d9b640 1 --2- 172.21.15.150:0/701449513 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd0d40d0000 0x7fd0d4152d50 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7fd0c800d770 tx=0x7fd0c800dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:45:13.453 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:13.451+0000 7fd0c2ffd640 1 -- 172.21.15.150:0/701449513 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0c8017070 con 0x7fd0d40d0000 2024-09-17T05:45:13.453 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:13.451+0000 7fd0c2ffd640 1 -- 172.21.15.150:0/701449513 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd0c8009cc0 con 0x7fd0d40d0000 2024-09-17T05:45:13.453 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:13.451+0000 7fd0d8a9b640 1 -- 172.21.15.150:0/701449513 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd0d41403d0 con 0x7fd0d40d0000 2024-09-17T05:45:13.453 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:13.451+0000 7fd0c2ffd640 1 -- 172.21.15.150:0/701449513 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0c80106c0 con 0x7fd0d40d0000 2024-09-17T05:45:13.454 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:13.451+0000 7fd0d8a9b640 1 -- 172.21.15.150:0/701449513 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd0d41f4970 con 0x7fd0d40d0000 2024-09-17T05:45:13.455 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:13.452+0000 7fd0d8a9b640 1 -- 172.21.15.150:0/701449513 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd0d4153470 con 0x7fd0d40d0000 2024-09-17T05:45:13.455 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:13.452+0000 7fd0c2ffd640 1 -- 172.21.15.150:0/701449513 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 14) ==== 102155+0+0 (secure 0 0 0) 0x7fd0c801a070 con 0x7fd0d40d0000 2024-09-17T05:45:13.455 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:13.453+0000 7fd0c2ffd640 1 --2- 172.21.15.150:0/701449513 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fd0b40793a0 0x7fd0b407b8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:45:13.455 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:13.453+0000 7fd0c2ffd640 1 -- 172.21.15.150:0/701449513 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 5767+0+0 (secure 0 0 0) 0x7fd0c809c120 con 0x7fd0d40d0000 2024-09-17T05:45:13.455 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:13.453+0000 7fd0d259c640 1 --2- 172.21.15.150:0/701449513 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fd0b40793a0 0x7fd0b407b8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:45:13.455 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:13.454+0000 7fd0d259c640 1 --2- 172.21.15.150:0/701449513 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fd0b40793a0 0x7fd0b407b8b0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fd0c4034000 tx=0x7fd0c4004730 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:45:13.458 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:13.458+0000 7fd0c2ffd640 1 -- 172.21.15.150:0/701449513 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fd0d4153470 con 0x7fd0d40d0000 2024-09-17T05:45:13.663 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:13.662+0000 7fd0d8a9b640 1 -- 172.21.15.150:0/701449513 --> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] -- mgr_command(tid 0: {"prefix": "fs subvolume snapshot ls", "vol_name": "cephfs", "sub_name": "sv1", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fd0d40b5200 con 0x7fd0b40793a0 2024-09-17T05:45:13.678 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:13.678+0000 7fd0c2ffd640 1 -- 172.21.15.150:0/701449513 <== mgr.4108 v2:172.21.15.176:6800/3631216395 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+38 (secure 0 0 0) 0x7fd0d40b5200 con 0x7fd0b40793a0 2024-09-17T05:45:13.679 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-09-17T05:45:13.679 INFO:teuthology.orchestra.run.smithi150.stdout:[ 2024-09-17T05:45:13.679 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-09-17T05:45:13.679 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "ss1" 2024-09-17T05:45:13.679 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-09-17T05:45:13.679 INFO:teuthology.orchestra.run.smithi150.stdout:] 2024-09-17T05:45:13.681 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:13.680+0000 7fd0d8a9b640 1 -- 172.21.15.150:0/701449513 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fd0b40793a0 msgr2=0x7fd0b407b8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:45:13.681 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:13.680+0000 7fd0d8a9b640 1 --2- 172.21.15.150:0/701449513 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fd0b40793a0 0x7fd0b407b8b0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fd0c4034000 tx=0x7fd0c4004730 comp rx=0 tx=0).stop 2024-09-17T05:45:13.681 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:13.680+0000 7fd0d8a9b640 1 -- 172.21.15.150:0/701449513 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd0d40d0000 msgr2=0x7fd0d4152d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:45:13.681 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:13.680+0000 7fd0d8a9b640 1 --2- 172.21.15.150:0/701449513 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd0d40d0000 0x7fd0d4152d50 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7fd0c800d770 tx=0x7fd0c800dc30 comp rx=0 tx=0).stop 2024-09-17T05:45:13.681 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:13.680+0000 7fd0d8a9b640 1 -- 172.21.15.150:0/701449513 shutdown_connections 2024-09-17T05:45:13.681 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:13.680+0000 7fd0d8a9b640 1 --2- 172.21.15.150:0/701449513 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd0d415f200 0x7fd0d415de00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:13.681 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:13.680+0000 7fd0d8a9b640 1 --2- 172.21.15.150:0/701449513 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fd0b40793a0 0x7fd0b407b8b0 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:13.681 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:13.680+0000 7fd0d8a9b640 1 --2- 172.21.15.150:0/701449513 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd0d40d0000 0x7fd0d4152d50 unknown :-1 s=CLOSED pgs=533 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:13.681 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:13.680+0000 7fd0d8a9b640 1 --2- 172.21.15.150:0/701449513 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd0d40b5740 0x7fd0d413fe90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:13.681 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:13.680+0000 7fd0d8a9b640 1 -- 172.21.15.150:0/701449513 >> 172.21.15.150:0/701449513 conn(0x7fd0d406d3d0 msgr2=0x7fd0d415f6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:45:13.681 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:13.680+0000 7fd0d8a9b640 1 -- 172.21.15.150:0/701449513 shutdown_connections 2024-09-17T05:45:13.682 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:13.680+0000 7fd0d8a9b640 1 -- 172.21.15.150:0/701449513 wait complete. 2024-09-17T05:45:13.692 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume snapshot rm --force --format json cephfs sv1 ss1 2024-09-17T05:45:13.812 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:13.811+0000 7ff128a55640 1 -- 172.21.15.150:0/4029396528 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff12406dea0 msgr2=0x7ff1240d0020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:45:13.813 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:13.811+0000 7ff128a55640 1 --2- 172.21.15.150:0/4029396528 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff12406dea0 0x7ff1240d0020 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7ff1240cfd10 tx=0x7ff10c02a510 comp rx=0 tx=0).stop 2024-09-17T05:45:13.813 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:13.811+0000 7ff128a55640 1 -- 172.21.15.150:0/4029396528 shutdown_connections 2024-09-17T05:45:13.813 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:13.811+0000 7ff128a55640 1 --2- 172.21.15.150:0/4029396528 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff12406dea0 0x7ff1240d0020 unknown :-1 s=CLOSED pgs=535 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:13.813 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:13.811+0000 7ff128a55640 1 -- 172.21.15.150:0/4029396528 >> 172.21.15.150:0/4029396528 conn(0x7ff12408bfe0 msgr2=0x7ff1240d46e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:45:13.813 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:13.811+0000 7ff128a55640 1 -- 172.21.15.150:0/4029396528 shutdown_connections 2024-09-17T05:45:13.813 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:13.811+0000 7ff128a55640 1 -- 172.21.15.150:0/4029396528 wait complete. 2024-09-17T05:45:13.814 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:13.813+0000 7ff128a55640 1 Processor -- start 2024-09-17T05:45:13.814 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:13.813+0000 7ff128a55640 1 -- start start 2024-09-17T05:45:13.817 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:13.814+0000 7ff128a55640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff12406dea0 0x7ff12414fba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:45:13.817 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:13.814+0000 7ff128a55640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff12406e2b0 0x7ff1240cd410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:45:13.817 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:13.815+0000 7ff128a55640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff1240d5150 0x7ff1240cd950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:45:13.817 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:13.815+0000 7ff128a55640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7ff1240b6870 con 0x7ff12406dea0 2024-09-17T05:45:13.817 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:13.815+0000 7ff128a55640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7ff1240d31e0 con 0x7ff1240d5150 2024-09-17T05:45:13.817 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:13.815+0000 7ff128a55640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7ff1240b69f0 con 0x7ff12406e2b0 2024-09-17T05:45:13.817 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:13.815+0000 7ff12259c640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff12406dea0 0x7ff12414fba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:45:13.818 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:13.815+0000 7ff12259c640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff12406dea0 0x7ff12414fba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:50720/0 (socket says 172.21.15.150:50720) 2024-09-17T05:45:13.818 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:13.815+0000 7ff12259c640 1 -- 172.21.15.150:0/3993000966 learned_addr learned my addr 172.21.15.150:0/3993000966 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:45:13.818 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:13.815+0000 7ff11bfff640 1 --2- 172.21.15.150:0/3993000966 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff12406e2b0 0x7ff1240cd410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:45:13.818 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:13.815+0000 7ff122d9d640 1 --2- 172.21.15.150:0/3993000966 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff1240d5150 0x7ff1240cd950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:45:13.818 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:13.815+0000 7ff12259c640 1 -- 172.21.15.150:0/3993000966 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff12406e2b0 msgr2=0x7ff1240cd410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:45:13.818 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:13.815+0000 7ff12259c640 1 --2- 172.21.15.150:0/3993000966 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff12406e2b0 0x7ff1240cd410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:13.818 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:13.815+0000 7ff12259c640 1 -- 172.21.15.150:0/3993000966 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff1240d5150 msgr2=0x7ff1240cd950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:45:13.818 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:13.815+0000 7ff12259c640 1 --2- 172.21.15.150:0/3993000966 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff1240d5150 0x7ff1240cd950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:13.818 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:13.815+0000 7ff12259c640 1 -- 172.21.15.150:0/3993000966 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff1240cc130 con 0x7ff12406dea0 2024-09-17T05:45:13.818 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:13.815+0000 7ff11bfff640 1 --2- 172.21.15.150:0/3993000966 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff12406e2b0 0x7ff1240cd410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T05:45:13.818 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:13.815+0000 7ff122d9d640 1 --2- 172.21.15.150:0/3993000966 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff1240d5150 0x7ff1240cd950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T05:45:13.818 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:13.815+0000 7ff12259c640 1 --2- 172.21.15.150:0/3993000966 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff12406dea0 0x7ff12414fba0 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7ff11400c3c0 tx=0x7ff11400c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:45:13.818 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:13.815+0000 7ff11affd640 1 -- 172.21.15.150:0/3993000966 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff114017070 con 0x7ff12406dea0 2024-09-17T05:45:13.819 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:13.815+0000 7ff11affd640 1 -- 172.21.15.150:0/3993000966 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff1140035f0 con 0x7ff12406dea0 2024-09-17T05:45:13.819 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:13.815+0000 7ff128a55640 1 -- 172.21.15.150:0/3993000966 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff1240cc5a0 con 0x7ff12406dea0 2024-09-17T05:45:13.819 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:13.815+0000 7ff11affd640 1 -- 172.21.15.150:0/3993000966 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff114003a40 con 0x7ff12406dea0 2024-09-17T05:45:13.819 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:13.815+0000 7ff128a55640 1 -- 172.21.15.150:0/3993000966 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff1240ccb60 con 0x7ff12406dea0 2024-09-17T05:45:13.819 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:13.816+0000 7ff128a55640 1 -- 172.21.15.150:0/3993000966 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff12406fe60 con 0x7ff12406dea0 2024-09-17T05:45:13.820 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:13.817+0000 7ff11affd640 1 -- 172.21.15.150:0/3993000966 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 14) ==== 102155+0+0 (secure 0 0 0) 0x7ff11401a070 con 0x7ff12406dea0 2024-09-17T05:45:13.820 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:13.817+0000 7ff11affd640 1 --2- 172.21.15.150:0/3993000966 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7ff104079370 0x7ff10407b880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:45:13.820 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:13.818+0000 7ff11affd640 1 -- 172.21.15.150:0/3993000966 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 5767+0+0 (secure 0 0 0) 0x7ff1140989a0 con 0x7ff12406dea0 2024-09-17T05:45:13.820 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:13.818+0000 7ff11bfff640 1 --2- 172.21.15.150:0/3993000966 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7ff104079370 0x7ff10407b880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:45:13.820 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:13.818+0000 7ff11bfff640 1 --2- 172.21.15.150:0/3993000966 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7ff104079370 0x7ff10407b880 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7ff10c034000 tx=0x7ff10c004730 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:45:13.822 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:13.822+0000 7ff11affd640 1 -- 172.21.15.150:0/3993000966 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7ff114062790 con 0x7ff12406dea0 2024-09-17T05:45:14.034 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:14.033+0000 7ff128a55640 1 -- 172.21.15.150:0/3993000966 --> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] -- mgr_command(tid 0: {"prefix": "fs subvolume snapshot rm", "force": true, "vol_name": "cephfs", "sub_name": "sv1", "snap_name": "ss1", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7ff1240d4f10 con 0x7ff104079370 2024-09-17T05:45:14.065 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:14.065+0000 7ff11affd640 1 -- 172.21.15.150:0/3993000966 <== mgr.4108 v2:172.21.15.176:6800/3631216395 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7ff1240d4f10 con 0x7ff104079370 2024-09-17T05:45:14.066 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-09-17T05:45:14.068 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:14.067+0000 7ff128a55640 1 -- 172.21.15.150:0/3993000966 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7ff104079370 msgr2=0x7ff10407b880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:45:14.068 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:14.067+0000 7ff128a55640 1 --2- 172.21.15.150:0/3993000966 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7ff104079370 0x7ff10407b880 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7ff10c034000 tx=0x7ff10c004730 comp rx=0 tx=0).stop 2024-09-17T05:45:14.068 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:14.067+0000 7ff128a55640 1 -- 172.21.15.150:0/3993000966 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff12406dea0 msgr2=0x7ff12414fba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:45:14.068 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:14.067+0000 7ff128a55640 1 --2- 172.21.15.150:0/3993000966 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff12406dea0 0x7ff12414fba0 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7ff11400c3c0 tx=0x7ff11400c880 comp rx=0 tx=0).stop 2024-09-17T05:45:14.068 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:14.067+0000 7ff128a55640 1 -- 172.21.15.150:0/3993000966 shutdown_connections 2024-09-17T05:45:14.069 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:14.067+0000 7ff128a55640 1 --2- 172.21.15.150:0/3993000966 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff1240d5150 0x7ff1240cd950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:14.069 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:14.067+0000 7ff128a55640 1 --2- 172.21.15.150:0/3993000966 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7ff104079370 0x7ff10407b880 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:14.069 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:14.067+0000 7ff128a55640 1 --2- 172.21.15.150:0/3993000966 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff12406e2b0 0x7ff1240cd410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:14.069 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:14.067+0000 7ff128a55640 1 --2- 172.21.15.150:0/3993000966 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff12406dea0 0x7ff12414fba0 unknown :-1 s=CLOSED pgs=536 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:14.069 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:14.067+0000 7ff128a55640 1 -- 172.21.15.150:0/3993000966 >> 172.21.15.150:0/3993000966 conn(0x7ff12408bfe0 msgr2=0x7ff1240d1140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:45:14.069 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:14.067+0000 7ff128a55640 1 -- 172.21.15.150:0/3993000966 shutdown_connections 2024-09-17T05:45:14.069 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:14.067+0000 7ff128a55640 1 -- 172.21.15.150:0/3993000966 wait complete. 2024-09-17T05:45:14.080 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume rm cephfs sv1 2024-09-17T05:45:14.196 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:14.195+0000 7f66147a1640 1 -- 172.21.15.150:0/551700007 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f660c073630 msgr2=0x7f660c073a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:45:14.197 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:14.195+0000 7f66147a1640 1 --2- 172.21.15.150:0/551700007 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f660c073630 0x7f660c073a40 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7f65fc009830 tx=0x7f65fc02a480 comp rx=0 tx=0).stop 2024-09-17T05:45:14.197 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:14.196+0000 7f66147a1640 1 -- 172.21.15.150:0/551700007 shutdown_connections 2024-09-17T05:45:14.197 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:14.196+0000 7f66147a1640 1 --2- 172.21.15.150:0/551700007 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f660c15ccf0 0x7f660c15d100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:14.197 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:14.196+0000 7f66147a1640 1 --2- 172.21.15.150:0/551700007 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f660c073630 0x7f660c073a40 unknown :-1 s=CLOSED pgs=538 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:14.197 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:14.196+0000 7f66147a1640 1 -- 172.21.15.150:0/551700007 >> 172.21.15.150:0/551700007 conn(0x7f660c06d1c0 msgr2=0x7f660c06d5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:45:14.197 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:14.196+0000 7f66147a1640 1 -- 172.21.15.150:0/551700007 shutdown_connections 2024-09-17T05:45:14.197 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:14.196+0000 7f66147a1640 1 -- 172.21.15.150:0/551700007 wait complete. 2024-09-17T05:45:14.198 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:14.197+0000 7f66147a1640 1 Processor -- start 2024-09-17T05:45:14.198 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:14.197+0000 7f66147a1640 1 -- start start 2024-09-17T05:45:14.200 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:14.199+0000 7f66147a1640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f660c073630 0x7f660c1511e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:45:14.200 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:14.199+0000 7f66147a1640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f660c0ccc50 0x7f660c152370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:45:14.200 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:14.199+0000 7f66147a1640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f660c15ccf0 0x7f660c1f6000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:45:14.201 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:14.199+0000 7f66147a1640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f660c15d9d0 con 0x7f660c073630 2024-09-17T05:45:14.201 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:14.199+0000 7f66147a1640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f660c15d850 con 0x7f660c15ccf0 2024-09-17T05:45:14.201 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:14.199+0000 7f66147a1640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f660c15db50 con 0x7f660c0ccc50 2024-09-17T05:45:14.201 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:14.199+0000 7f661253d640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f660c073630 0x7f660c1511e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:45:14.201 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:14.199+0000 7f661253d640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f660c073630 0x7f660c1511e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:50750/0 (socket says 172.21.15.150:50750) 2024-09-17T05:45:14.201 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:14.199+0000 7f661253d640 1 -- 172.21.15.150:0/1597275126 learned_addr learned my addr 172.21.15.150:0/1597275126 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:45:14.201 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:14.199+0000 7f6612d3e640 1 --2- 172.21.15.150:0/1597275126 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f660c15ccf0 0x7f660c1f6000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:45:14.201 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:14.199+0000 7f6611d3c640 1 --2- 172.21.15.150:0/1597275126 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f660c0ccc50 0x7f660c152370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:45:14.201 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:14.199+0000 7f661253d640 1 -- 172.21.15.150:0/1597275126 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f660c0ccc50 msgr2=0x7f660c152370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:45:14.201 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:14.199+0000 7f661253d640 1 --2- 172.21.15.150:0/1597275126 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f660c0ccc50 0x7f660c152370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:14.201 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:14.199+0000 7f661253d640 1 -- 172.21.15.150:0/1597275126 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f660c15ccf0 msgr2=0x7f660c1f6000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:45:14.201 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:14.199+0000 7f661253d640 1 --2- 172.21.15.150:0/1597275126 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f660c15ccf0 0x7f660c1f6000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:14.202 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:14.199+0000 7f661253d640 1 -- 172.21.15.150:0/1597275126 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f660c1f5820 con 0x7f660c073630 2024-09-17T05:45:14.202 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:14.199+0000 7f6612d3e640 1 --2- 172.21.15.150:0/1597275126 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f660c15ccf0 0x7f660c1f6000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:45:14.202 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:14.199+0000 7f661253d640 1 --2- 172.21.15.150:0/1597275126 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f660c073630 0x7f660c1511e0 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7f660800c3c0 tx=0x7f660800c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:45:14.202 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:14.199+0000 7f6602ffd640 1 -- 172.21.15.150:0/1597275126 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6608017070 con 0x7f660c073630 2024-09-17T05:45:14.202 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:14.199+0000 7f6602ffd640 1 -- 172.21.15.150:0/1597275126 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f66080035f0 con 0x7f660c073630 2024-09-17T05:45:14.202 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:14.199+0000 7f66147a1640 1 -- 172.21.15.150:0/1597275126 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f660c1f9580 con 0x7f660c073630 2024-09-17T05:45:14.202 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:14.199+0000 7f6602ffd640 1 -- 172.21.15.150:0/1597275126 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6608003a80 con 0x7f660c073630 2024-09-17T05:45:14.202 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:14.199+0000 7f66147a1640 1 -- 172.21.15.150:0/1597275126 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f660c1f9b40 con 0x7f660c073630 2024-09-17T05:45:14.203 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:14.200+0000 7f66147a1640 1 -- 172.21.15.150:0/1597275126 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f660c073a40 con 0x7f660c073630 2024-09-17T05:45:14.203 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:14.201+0000 7f6602ffd640 1 -- 172.21.15.150:0/1597275126 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 14) ==== 102155+0+0 (secure 0 0 0) 0x7f660801a070 con 0x7f660c073630 2024-09-17T05:45:14.203 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:14.202+0000 7f6602ffd640 1 --2- 172.21.15.150:0/1597275126 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f65f00793a0 0x7f65f007b8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:45:14.203 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:14.202+0000 7f6602ffd640 1 -- 172.21.15.150:0/1597275126 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 5767+0+0 (secure 0 0 0) 0x7f660809b640 con 0x7f660c073630 2024-09-17T05:45:14.203 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:14.202+0000 7f6611d3c640 1 --2- 172.21.15.150:0/1597275126 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f65f00793a0 0x7f65f007b8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:45:14.203 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:14.203+0000 7f6611d3c640 1 --2- 172.21.15.150:0/1597275126 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f65f00793a0 0x7f65f007b8b0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f65fc034000 tx=0x7f65fc004730 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:45:14.206 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:14.205+0000 7f6602ffd640 1 -- 172.21.15.150:0/1597275126 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f6608021020 con 0x7f660c073630 2024-09-17T05:45:14.407 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:14.406+0000 7f66147a1640 1 -- 172.21.15.150:0/1597275126 --> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] -- mgr_command(tid 0: {"prefix": "fs subvolume rm", "vol_name": "cephfs", "sub_name": "sv1", "target": ["mon-mgr", ""]}) -- 0x7f660c152d70 con 0x7f65f00793a0 2024-09-17T05:45:14.426 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:14.426+0000 7f6602ffd640 1 -- 172.21.15.150:0/1597275126 <== mgr.4108 v2:172.21.15.176:6800/3631216395 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f660c152d70 con 0x7f65f00793a0 2024-09-17T05:45:14.429 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:14.428+0000 7f66147a1640 1 -- 172.21.15.150:0/1597275126 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f65f00793a0 msgr2=0x7f65f007b8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:45:14.429 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:14.428+0000 7f66147a1640 1 --2- 172.21.15.150:0/1597275126 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f65f00793a0 0x7f65f007b8b0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f65fc034000 tx=0x7f65fc004730 comp rx=0 tx=0).stop 2024-09-17T05:45:14.429 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:14.428+0000 7f66147a1640 1 -- 172.21.15.150:0/1597275126 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f660c073630 msgr2=0x7f660c1511e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:45:14.429 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:14.428+0000 7f66147a1640 1 --2- 172.21.15.150:0/1597275126 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f660c073630 0x7f660c1511e0 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7f660800c3c0 tx=0x7f660800c880 comp rx=0 tx=0).stop 2024-09-17T05:45:14.430 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:14.428+0000 7f66147a1640 1 -- 172.21.15.150:0/1597275126 shutdown_connections 2024-09-17T05:45:14.430 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:14.428+0000 7f66147a1640 1 --2- 172.21.15.150:0/1597275126 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f660c15ccf0 0x7f660c1f6000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:14.430 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:14.428+0000 7f66147a1640 1 --2- 172.21.15.150:0/1597275126 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f65f00793a0 0x7f65f007b8b0 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:14.430 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:14.428+0000 7f66147a1640 1 --2- 172.21.15.150:0/1597275126 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f660c0ccc50 0x7f660c152370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:14.430 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:14.428+0000 7f66147a1640 1 --2- 172.21.15.150:0/1597275126 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f660c073630 0x7f660c1511e0 unknown :-1 s=CLOSED pgs=539 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:14.430 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:14.428+0000 7f66147a1640 1 -- 172.21.15.150:0/1597275126 >> 172.21.15.150:0/1597275126 conn(0x7f660c06d1c0 msgr2=0x7f660c15ef20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:45:14.430 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:14.428+0000 7f66147a1640 1 -- 172.21.15.150:0/1597275126 shutdown_connections 2024-09-17T05:45:14.430 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:14.428+0000 7f66147a1640 1 -- 172.21.15.150:0/1597275126 wait complete. 2024-09-17T05:45:14.441 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume rm --force cephfs subvol_clone83860 2024-09-17T05:45:14.565 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:14.564+0000 7f36e6f19640 1 -- 172.21.15.150:0/258442339 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f36cc003a00 msgr2=0x7f36cc003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:45:14.566 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:14.564+0000 7f36e6f19640 1 --2- 172.21.15.150:0/258442339 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f36cc003a00 0x7f36cc003e70 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7f36d8009b40 tx=0x7f36cc005830 comp rx=0 tx=0).stop 2024-09-17T05:45:14.566 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:14.564+0000 7f36e54b6640 1 -- 172.21.15.150:0/258442339 reap_dead start 2024-09-17T05:45:14.566 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:14.564+0000 7f36e6f19640 1 -- 172.21.15.150:0/258442339 shutdown_connections 2024-09-17T05:45:14.566 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:14.564+0000 7f36e6f19640 1 -- 172.21.15.150:0/258442339 >> 172.21.15.150:0/258442339 conn(0x7f36e00cef00 msgr2=0x7f36e00cf310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:45:14.566 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:14.564+0000 7f36e6f19640 1 -- 172.21.15.150:0/258442339 shutdown_connections 2024-09-17T05:45:14.567 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:14.564+0000 7f36e6f19640 1 -- 172.21.15.150:0/258442339 wait complete. 2024-09-17T05:45:14.571 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:14.566+0000 7f36e6f19640 1 Processor -- start 2024-09-17T05:45:14.571 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:14.566+0000 7f36e6f19640 1 -- start start 2024-09-17T05:45:14.571 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:14.567+0000 7f36e6f19640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f36cc003a00 0x7f36e01d0e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:45:14.571 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:14.567+0000 7f36e6f19640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f36e01d46e0 0x7f36e01f7300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:45:14.572 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:14.567+0000 7f36e6f19640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f36e01cedc0 0x7f36e01e1ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:45:14.572 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:14.567+0000 7f36e6f19640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f36e00b2de0 con 0x7f36e01cedc0 2024-09-17T05:45:14.572 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:14.567+0000 7f36e6f19640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f36e00b2c60 con 0x7f36cc003a00 2024-09-17T05:45:14.572 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:14.567+0000 7f36e6f19640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f36e00b2f60 con 0x7f36e01d46e0 2024-09-17T05:45:14.572 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:14.567+0000 7f36e54b6640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f36e01cedc0 0x7f36e01e1ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:45:14.572 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:14.567+0000 7f36dffff640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f36e01d46e0 0x7f36e01f7300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:45:14.572 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:14.567+0000 7f36e4cb5640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f36cc003a00 0x7f36e01d0e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:45:14.573 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:14.567+0000 7f36e54b6640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f36e01cedc0 0x7f36e01e1ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:50778/0 (socket says 172.21.15.150:50778) 2024-09-17T05:45:14.573 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:14.567+0000 7f36e54b6640 1 -- 172.21.15.150:0/682303572 learned_addr learned my addr 172.21.15.150:0/682303572 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:45:14.573 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:14.568+0000 7f36e54b6640 1 -- 172.21.15.150:0/682303572 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f36e01d46e0 msgr2=0x7f36e01f7300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:45:14.573 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:14.568+0000 7f36e54b6640 1 --2- 172.21.15.150:0/682303572 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f36e01d46e0 0x7f36e01f7300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:14.573 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:14.568+0000 7f36e54b6640 1 -- 172.21.15.150:0/682303572 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f36cc003a00 msgr2=0x7f36e01d0e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:45:14.574 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:14.568+0000 7f36e54b6640 1 --2- 172.21.15.150:0/682303572 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f36cc003a00 0x7f36e01d0e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:14.574 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:14.568+0000 7f36e54b6640 1 -- 172.21.15.150:0/682303572 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f36e01d17c0 con 0x7f36e01cedc0 2024-09-17T05:45:14.574 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:14.568+0000 7f36e4cb5640 1 --2- 172.21.15.150:0/682303572 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f36cc003a00 0x7f36e01d0e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T05:45:14.574 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:14.568+0000 7f36e54b6640 1 --2- 172.21.15.150:0/682303572 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f36e01cedc0 0x7f36e01e1ec0 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7f36e006a9b0 tx=0x7f36c80039c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:45:14.574 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:14.568+0000 7f36dd7fa640 1 -- 172.21.15.150:0/682303572 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36c8011840 con 0x7f36e01cedc0 2024-09-17T05:45:14.574 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:14.568+0000 7f36dd7fa640 1 -- 172.21.15.150:0/682303572 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f36c8018070 con 0x7f36e01cedc0 2024-09-17T05:45:14.574 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:14.568+0000 7f36e6f19640 1 -- 172.21.15.150:0/682303572 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f36e01d1aa0 con 0x7f36e01cedc0 2024-09-17T05:45:14.574 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:14.568+0000 7f36dd7fa640 1 -- 172.21.15.150:0/682303572 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36c8011c60 con 0x7f36e01cedc0 2024-09-17T05:45:14.574 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:14.568+0000 7f36e6f19640 1 -- 172.21.15.150:0/682303572 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f36e01cf6a0 con 0x7f36e01cedc0 2024-09-17T05:45:14.574 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:14.570+0000 7f36e6f19640 1 -- 172.21.15.150:0/682303572 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f36e01cf900 con 0x7f36e01cedc0 2024-09-17T05:45:14.575 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:14.571+0000 7f36dd7fa640 1 -- 172.21.15.150:0/682303572 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 14) ==== 102155+0+0 (secure 0 0 0) 0x7f36c801d460 con 0x7f36e01cedc0 2024-09-17T05:45:14.575 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:14.571+0000 7f36dd7fa640 1 --2- 172.21.15.150:0/682303572 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f36c00793a0 0x7f36c007b8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:45:14.575 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:14.571+0000 7f36dd7fa640 1 -- 172.21.15.150:0/682303572 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 5767+0+0 (secure 0 0 0) 0x7f36c8099ec0 con 0x7f36e01cedc0 2024-09-17T05:45:14.575 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:14.572+0000 7f36e4cb5640 1 --2- 172.21.15.150:0/682303572 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f36c00793a0 0x7f36c007b8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:45:14.575 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:14.572+0000 7f36e4cb5640 1 --2- 172.21.15.150:0/682303572 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f36c00793a0 0x7f36c007b8b0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f36d8009b40 tx=0x7f36d802d040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:45:14.576 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:14.576+0000 7f36dd7fa640 1 -- 172.21.15.150:0/682303572 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f36c80635b0 con 0x7f36e01cedc0 2024-09-17T05:45:14.786 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:14.785+0000 7f36e6f19640 1 -- 172.21.15.150:0/682303572 --> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] -- mgr_command(tid 0: {"prefix": "fs subvolume rm", "force": true, "vol_name": "cephfs", "sub_name": "subvol_clone83860", "target": ["mon-mgr", ""]}) -- 0x7f36e01d1550 con 0x7f36c00793a0 2024-09-17T05:45:14.804 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:14.803+0000 7f36dd7fa640 1 -- 172.21.15.150:0/682303572 <== mgr.4108 v2:172.21.15.176:6800/3631216395 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f36e01d1550 con 0x7f36c00793a0 2024-09-17T05:45:14.807 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:14.806+0000 7f36e6f19640 1 -- 172.21.15.150:0/682303572 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f36c00793a0 msgr2=0x7f36c007b8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:45:14.807 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:14.806+0000 7f36e6f19640 1 --2- 172.21.15.150:0/682303572 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f36c00793a0 0x7f36c007b8b0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f36d8009b40 tx=0x7f36d802d040 comp rx=0 tx=0).stop 2024-09-17T05:45:14.807 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:14.806+0000 7f36e6f19640 1 -- 172.21.15.150:0/682303572 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f36e01cedc0 msgr2=0x7f36e01e1ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:45:14.808 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:14.806+0000 7f36e6f19640 1 --2- 172.21.15.150:0/682303572 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f36e01cedc0 0x7f36e01e1ec0 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7f36e006a9b0 tx=0x7f36c80039c0 comp rx=0 tx=0).stop 2024-09-17T05:45:14.808 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:14.807+0000 7f36e6f19640 1 -- 172.21.15.150:0/682303572 shutdown_connections 2024-09-17T05:45:14.808 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:14.807+0000 7f36e6f19640 1 --2- 172.21.15.150:0/682303572 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f36c00793a0 0x7f36c007b8b0 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:14.808 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:14.807+0000 7f36e6f19640 1 --2- 172.21.15.150:0/682303572 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f36e01cedc0 0x7f36e01e1ec0 unknown :-1 s=CLOSED pgs=542 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:14.808 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:14.807+0000 7f36e6f19640 1 --2- 172.21.15.150:0/682303572 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f36e01d46e0 0x7f36e01f7300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:14.808 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:14.807+0000 7f36e6f19640 1 --2- 172.21.15.150:0/682303572 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f36cc003a00 0x7f36e01d0e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:14.808 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:14.807+0000 7f36e6f19640 1 -- 172.21.15.150:0/682303572 >> 172.21.15.150:0/682303572 conn(0x7f36e00cef00 msgr2=0x7f36e0072480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:45:14.808 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:14.807+0000 7f36e6f19640 1 -- 172.21.15.150:0/682303572 shutdown_connections 2024-09-17T05:45:14.808 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:14.807+0000 7f36e6f19640 1 -- 172.21.15.150:0/682303572 wait complete. 2024-09-17T05:45:14.814 INFO:tasks.ceph.mgr.x.smithi176.stderr:2024-09-17T05:45:14.813+0000 7f33d971e640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-17T05:45:14.814 INFO:tasks.ceph.mgr.x.smithi176.stderr:2024-09-17T05:45:14.813+0000 7f33d971e640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-17T05:45:14.815 INFO:tasks.ceph.mgr.x.smithi176.stderr:2024-09-17T05:45:14.813+0000 7f33d971e640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-17T05:45:14.815 INFO:tasks.ceph.mgr.x.smithi176.stderr:2024-09-17T05:45:14.813+0000 7f33d971e640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-17T05:45:14.815 INFO:tasks.ceph.mgr.x.smithi176.stderr:2024-09-17T05:45:14.813+0000 7f33d971e640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-17T05:45:14.823 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume rm --force cephfs subvol_clone43941 2024-09-17T05:45:14.946 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:14.945+0000 7f619b72b640 1 -- 172.21.15.150:0/2564426846 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f61940b1c50 msgr2=0x7f61940b2060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:45:14.947 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:14.945+0000 7f619b72b640 1 --2- 172.21.15.150:0/2564426846 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f61940b1c50 0x7f61940b2060 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f6184005fd0 tx=0x7f618402a670 comp rx=0 tx=0).stop 2024-09-17T05:45:14.947 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:14.945+0000 7f619b72b640 1 -- 172.21.15.150:0/2564426846 shutdown_connections 2024-09-17T05:45:14.947 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:14.945+0000 7f619b72b640 1 --2- 172.21.15.150:0/2564426846 >> v2:172.21.15.176:3300/0 conn(0x7f61940b25a0 0x7f61940b29b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:14.947 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:14.945+0000 7f619b72b640 1 --2- 172.21.15.150:0/2564426846 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f61940b1c50 0x7f61940b2060 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:14.947 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:14.945+0000 7f619b72b640 1 -- 172.21.15.150:0/2564426846 >> 172.21.15.150:0/2564426846 conn(0x7f61940cef00 msgr2=0x7f61940cf310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:45:14.947 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:14.946+0000 7f619b72b640 1 -- 172.21.15.150:0/2564426846 shutdown_connections 2024-09-17T05:45:14.947 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:14.946+0000 7f619b72b640 1 -- 172.21.15.150:0/2564426846 wait complete. 2024-09-17T05:45:14.948 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:14.947+0000 7f619b72b640 1 Processor -- start 2024-09-17T05:45:14.948 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:14.947+0000 7f619b72b640 1 -- start start 2024-09-17T05:45:14.950 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:14.949+0000 7f619b72b640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f61940b1c50 0x7f6194157080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:45:14.951 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:14.949+0000 7f619b72b640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f61940b25a0 0x7f61940b6cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:45:14.951 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:14.949+0000 7f619b72b640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f61940c5b10 0x7f61940b71f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:45:14.951 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:14.949+0000 7f619b72b640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f61940b7b30 con 0x7f61940b25a0 2024-09-17T05:45:14.951 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:14.949+0000 7f619b72b640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f61940b79b0 con 0x7f61940c5b10 2024-09-17T05:45:14.951 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:14.949+0000 7f619b72b640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f619409bc60 con 0x7f61940b1c50 2024-09-17T05:45:14.951 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:14.949+0000 7f6198cc6640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f61940b25a0 0x7f61940b6cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:45:14.951 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:14.949+0000 7f6198cc6640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f61940b25a0 0x7f61940b6cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:50788/0 (socket says 172.21.15.150:50788) 2024-09-17T05:45:14.951 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:14.949+0000 7f6198cc6640 1 -- 172.21.15.150:0/261070651 learned_addr learned my addr 172.21.15.150:0/261070651 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:45:14.951 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:14.949+0000 7f61994c7640 1 --2- 172.21.15.150:0/261070651 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f61940b1c50 0x7f6194157080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:45:14.951 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:14.949+0000 7f6199cc8640 1 --2- 172.21.15.150:0/261070651 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f61940c5b10 0x7f61940b71f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:45:14.951 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:14.949+0000 7f6198cc6640 1 -- 172.21.15.150:0/261070651 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f61940b1c50 msgr2=0x7f6194157080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:45:14.951 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:14.949+0000 7f6198cc6640 1 --2- 172.21.15.150:0/261070651 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f61940b1c50 0x7f6194157080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:14.952 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:14.949+0000 7f6198cc6640 1 -- 172.21.15.150:0/261070651 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f61940c5b10 msgr2=0x7f61940b71f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:45:14.952 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:14.949+0000 7f6198cc6640 1 --2- 172.21.15.150:0/261070651 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f61940c5b10 0x7f61940b71f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:14.952 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:14.949+0000 7f6198cc6640 1 -- 172.21.15.150:0/261070651 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6194160dc0 con 0x7f61940b25a0 2024-09-17T05:45:14.952 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:14.949+0000 7f61994c7640 1 --2- 172.21.15.150:0/261070651 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f61940b1c50 0x7f6194157080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T05:45:14.952 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:14.949+0000 7f6198cc6640 1 --2- 172.21.15.150:0/261070651 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f61940b25a0 0x7f61940b6cb0 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7f6184034040 tx=0x7f61840038a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:45:14.952 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:14.950+0000 7f6189ffb640 1 -- 172.21.15.150:0/261070651 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f618403e030 con 0x7f61940b25a0 2024-09-17T05:45:14.952 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:14.950+0000 7f6189ffb640 1 -- 172.21.15.150:0/261070651 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f6184003ca0 con 0x7f61940b25a0 2024-09-17T05:45:14.952 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:14.950+0000 7f619b72b640 1 -- 172.21.15.150:0/261070651 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f619415c6d0 con 0x7f61940b25a0 2024-09-17T05:45:14.952 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:14.950+0000 7f6189ffb640 1 -- 172.21.15.150:0/261070651 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6184035040 con 0x7f61940b25a0 2024-09-17T05:45:14.953 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:14.950+0000 7f619b72b640 1 -- 172.21.15.150:0/261070651 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6194159960 con 0x7f61940b25a0 2024-09-17T05:45:14.953 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:14.951+0000 7f619b72b640 1 -- 172.21.15.150:0/261070651 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f619415c440 con 0x7f61940b25a0 2024-09-17T05:45:14.953 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:14.952+0000 7f6189ffb640 1 -- 172.21.15.150:0/261070651 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 14) ==== 102155+0+0 (secure 0 0 0) 0x7f6184041030 con 0x7f61940b25a0 2024-09-17T05:45:14.954 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:14.952+0000 7f6189ffb640 1 --2- 172.21.15.150:0/261070651 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f6178079370 0x7f617807b880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:45:14.954 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:14.953+0000 7f6189ffb640 1 -- 172.21.15.150:0/261070651 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 5767+0+0 (secure 0 0 0) 0x7f61840ba140 con 0x7f61940b25a0 2024-09-17T05:45:14.954 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:14.953+0000 7f61994c7640 1 --2- 172.21.15.150:0/261070651 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f6178079370 0x7f617807b880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:45:14.954 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:14.953+0000 7f61994c7640 1 --2- 172.21.15.150:0/261070651 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f6178079370 0x7f617807b880 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f6190007fd0 tx=0x7f6190009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:45:14.957 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:14.957+0000 7f6189ffb640 1 -- 172.21.15.150:0/261070651 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f61840837a0 con 0x7f61940b25a0 2024-09-17T05:45:15.237 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:15.237+0000 7f619b72b640 1 -- 172.21.15.150:0/261070651 --> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] -- mgr_command(tid 0: {"prefix": "fs subvolume rm", "force": true, "vol_name": "cephfs", "sub_name": "subvol_clone43941", "target": ["mon-mgr", ""]}) -- 0x7f61940b2060 con 0x7f6178079370 2024-09-17T05:45:15.254 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:15.254+0000 7f6189ffb640 1 -- 172.21.15.150:0/261070651 <== mgr.4108 v2:172.21.15.176:6800/3631216395 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f61940b2060 con 0x7f6178079370 2024-09-17T05:45:15.257 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:15.256+0000 7f619b72b640 1 -- 172.21.15.150:0/261070651 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f6178079370 msgr2=0x7f617807b880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:45:15.258 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:15.256+0000 7f619b72b640 1 --2- 172.21.15.150:0/261070651 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f6178079370 0x7f617807b880 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f6190007fd0 tx=0x7f6190009040 comp rx=0 tx=0).stop 2024-09-17T05:45:15.258 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:15.257+0000 7f619b72b640 1 -- 172.21.15.150:0/261070651 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f61940b25a0 msgr2=0x7f61940b6cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:45:15.258 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:15.257+0000 7f619b72b640 1 --2- 172.21.15.150:0/261070651 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f61940b25a0 0x7f61940b6cb0 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7f6184034040 tx=0x7f61840038a0 comp rx=0 tx=0).stop 2024-09-17T05:45:15.258 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:15.257+0000 7f619b72b640 1 -- 172.21.15.150:0/261070651 shutdown_connections 2024-09-17T05:45:15.258 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:15.257+0000 7f619b72b640 1 --2- 172.21.15.150:0/261070651 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f61940c5b10 0x7f61940b71f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:15.258 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:15.257+0000 7f619b72b640 1 --2- 172.21.15.150:0/261070651 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f6178079370 0x7f617807b880 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:15.258 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:15.257+0000 7f619b72b640 1 --2- 172.21.15.150:0/261070651 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f61940b25a0 0x7f61940b6cb0 unknown :-1 s=CLOSED pgs=543 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:15.258 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:15.257+0000 7f619b72b640 1 --2- 172.21.15.150:0/261070651 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f61940b1c50 0x7f6194157080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:15.258 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:15.257+0000 7f619b72b640 1 -- 172.21.15.150:0/261070651 >> 172.21.15.150:0/261070651 conn(0x7f61940cef00 msgr2=0x7f61941647a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:45:15.258 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:15.257+0000 7f619b72b640 1 -- 172.21.15.150:0/261070651 shutdown_connections 2024-09-17T05:45:15.258 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:15.257+0000 7f619b72b640 1 -- 172.21.15.150:0/261070651 wait complete. 2024-09-17T05:45:15.272 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume rm --force cephfs subvol_clone13123 2024-09-17T05:45:15.391 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:15.390+0000 7fe16527e640 1 -- 172.21.15.150:0/1139743555 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe16015ba50 msgr2=0x7fe1600b36f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:45:15.391 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:15.390+0000 7fe16527e640 1 --2- 172.21.15.150:0/1139743555 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe16015ba50 0x7fe1600b36f0 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7fe1600d0230 tx=0x7fe14802a440 comp rx=0 tx=0).stop 2024-09-17T05:45:15.391 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:15.390+0000 7fe16527e640 1 -- 172.21.15.150:0/1139743555 shutdown_connections 2024-09-17T05:45:15.391 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:15.390+0000 7fe16527e640 1 --2- 172.21.15.150:0/1139743555 >> v2:172.21.15.176:3300/0 conn(0x7fe16006f010 0x7fe16006f420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:15.391 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:15.390+0000 7fe16527e640 1 --2- 172.21.15.150:0/1139743555 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe16015ba50 0x7fe1600b36f0 unknown :-1 s=CLOSED pgs=544 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:15.391 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:15.390+0000 7fe16527e640 1 --2- 172.21.15.150:0/1139743555 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe1600cc7d0 0x7fe1600b3120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:15.391 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:15.390+0000 7fe16527e640 1 -- 172.21.15.150:0/1139743555 >> 172.21.15.150:0/1139743555 conn(0x7fe1600b2540 msgr2=0x7fe1600d02d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:45:15.391 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:15.390+0000 7fe16527e640 1 -- 172.21.15.150:0/1139743555 shutdown_connections 2024-09-17T05:45:15.391 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:15.390+0000 7fe16527e640 1 -- 172.21.15.150:0/1139743555 wait complete. 2024-09-17T05:45:15.392 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:15.392+0000 7fe16527e640 1 Processor -- start 2024-09-17T05:45:15.392 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:15.392+0000 7fe16527e640 1 -- start start 2024-09-17T05:45:15.395 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:15.393+0000 7fe16527e640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe16006f010 0x7fe1601f4040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:45:15.395 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:15.393+0000 7fe16527e640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe1600cc7d0 0x7fe1600b0d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:45:15.395 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:15.393+0000 7fe16527e640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe16015ba50 0x7fe1600b12d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:45:15.395 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:15.393+0000 7fe16527e640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7fe16006fe90 con 0x7fe1600cc7d0 2024-09-17T05:45:15.395 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:15.393+0000 7fe16527e640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fe16006fd10 con 0x7fe16015ba50 2024-09-17T05:45:15.395 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:15.393+0000 7fe16527e640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fe160070010 con 0x7fe16006f010 2024-09-17T05:45:15.395 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:15.393+0000 7fe1567fc640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe1600cc7d0 0x7fe1600b0d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:45:15.395 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:15.393+0000 7fe1567fc640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe1600cc7d0 0x7fe1600b0d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:50804/0 (socket says 172.21.15.150:50804) 2024-09-17T05:45:15.396 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:15.393+0000 7fe1567fc640 1 -- 172.21.15.150:0/1110277112 learned_addr learned my addr 172.21.15.150:0/1110277112 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:45:15.396 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:15.393+0000 7fe15effd640 1 --2- 172.21.15.150:0/1110277112 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe16006f010 0x7fe1601f4040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:45:15.396 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:15.393+0000 7fe15f7fe640 1 --2- 172.21.15.150:0/1110277112 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe16015ba50 0x7fe1600b12d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:45:15.396 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:15.394+0000 7fe1567fc640 1 -- 172.21.15.150:0/1110277112 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe16006f010 msgr2=0x7fe1601f4040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:45:15.396 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:15.394+0000 7fe1567fc640 1 --2- 172.21.15.150:0/1110277112 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe16006f010 0x7fe1601f4040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:15.396 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:15.394+0000 7fe1567fc640 1 -- 172.21.15.150:0/1110277112 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe16015ba50 msgr2=0x7fe1600b12d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:45:15.396 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:15.394+0000 7fe1567fc640 1 --2- 172.21.15.150:0/1110277112 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe16015ba50 0x7fe1600b12d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:15.396 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:15.394+0000 7fe1567fc640 1 -- 172.21.15.150:0/1110277112 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe1600d0f40 con 0x7fe1600cc7d0 2024-09-17T05:45:15.396 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:15.394+0000 7fe1567fc640 1 --2- 172.21.15.150:0/1110277112 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe1600cc7d0 0x7fe1600b0d90 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7fe148034040 tx=0x7fe1480039e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:45:15.396 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:15.394+0000 7fe157fff640 1 -- 172.21.15.150:0/1110277112 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe14803e030 con 0x7fe1600cc7d0 2024-09-17T05:45:15.396 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:15.394+0000 7fe157fff640 1 -- 172.21.15.150:0/1110277112 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe1480047a0 con 0x7fe1600cc7d0 2024-09-17T05:45:15.396 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:15.394+0000 7fe157fff640 1 -- 172.21.15.150:0/1110277112 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe148035040 con 0x7fe1600cc7d0 2024-09-17T05:45:15.397 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:15.394+0000 7fe16527e640 1 -- 172.21.15.150:0/1110277112 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe16015a5f0 con 0x7fe1600cc7d0 2024-09-17T05:45:15.397 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:15.394+0000 7fe16527e640 1 -- 172.21.15.150:0/1110277112 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe160153fb0 con 0x7fe1600cc7d0 2024-09-17T05:45:15.398 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:15.395+0000 7fe16527e640 1 -- 172.21.15.150:0/1110277112 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe1600d11b0 con 0x7fe1600cc7d0 2024-09-17T05:45:15.398 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:15.396+0000 7fe157fff640 1 -- 172.21.15.150:0/1110277112 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 14) ==== 102155+0+0 (secure 0 0 0) 0x7fe148041030 con 0x7fe1600cc7d0 2024-09-17T05:45:15.398 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:15.396+0000 7fe157fff640 1 --2- 172.21.15.150:0/1110277112 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fe1400793a0 0x7fe14007b8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:45:15.398 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:15.396+0000 7fe157fff640 1 -- 172.21.15.150:0/1110277112 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 5767+0+0 (secure 0 0 0) 0x7fe1480b9f20 con 0x7fe1600cc7d0 2024-09-17T05:45:15.398 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:15.397+0000 7fe15effd640 1 --2- 172.21.15.150:0/1110277112 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fe1400793a0 0x7fe14007b8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:45:15.398 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:15.397+0000 7fe15effd640 1 --2- 172.21.15.150:0/1110277112 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fe1400793a0 0x7fe14007b8b0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fe150005fd0 tx=0x7fe15000a250 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:45:15.401 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:15.401+0000 7fe157fff640 1 -- 172.21.15.150:0/1110277112 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fe148083690 con 0x7fe1600cc7d0 2024-09-17T05:45:15.604 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:15.603+0000 7fe16527e640 1 -- 172.21.15.150:0/1110277112 --> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] -- mgr_command(tid 0: {"prefix": "fs subvolume rm", "force": true, "vol_name": "cephfs", "sub_name": "subvol_clone13123", "target": ["mon-mgr", ""]}) -- 0x7fe1601f4580 con 0x7fe1400793a0 2024-09-17T05:45:15.622 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:15.622+0000 7fe157fff640 1 -- 172.21.15.150:0/1110277112 <== mgr.4108 v2:172.21.15.176:6800/3631216395 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7fe1601f4580 con 0x7fe1400793a0 2024-09-17T05:45:15.625 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:15.624+0000 7fe16527e640 1 -- 172.21.15.150:0/1110277112 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fe1400793a0 msgr2=0x7fe14007b8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:45:15.625 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:15.624+0000 7fe16527e640 1 --2- 172.21.15.150:0/1110277112 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fe1400793a0 0x7fe14007b8b0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fe150005fd0 tx=0x7fe15000a250 comp rx=0 tx=0).stop 2024-09-17T05:45:15.626 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:15.624+0000 7fe16527e640 1 -- 172.21.15.150:0/1110277112 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe1600cc7d0 msgr2=0x7fe1600b0d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:45:15.626 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:15.624+0000 7fe16527e640 1 --2- 172.21.15.150:0/1110277112 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe1600cc7d0 0x7fe1600b0d90 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7fe148034040 tx=0x7fe1480039e0 comp rx=0 tx=0).stop 2024-09-17T05:45:15.626 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:15.624+0000 7fe16527e640 1 -- 172.21.15.150:0/1110277112 shutdown_connections 2024-09-17T05:45:15.626 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:15.624+0000 7fe16527e640 1 --2- 172.21.15.150:0/1110277112 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe16015ba50 0x7fe1600b12d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:15.626 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:15.624+0000 7fe16527e640 1 --2- 172.21.15.150:0/1110277112 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fe1400793a0 0x7fe14007b8b0 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:15.626 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:15.624+0000 7fe16527e640 1 --2- 172.21.15.150:0/1110277112 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe1600cc7d0 0x7fe1600b0d90 unknown :-1 s=CLOSED pgs=545 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:15.626 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:15.624+0000 7fe16527e640 1 --2- 172.21.15.150:0/1110277112 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe16006f010 0x7fe1601f4040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:15.626 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:15.624+0000 7fe16527e640 1 -- 172.21.15.150:0/1110277112 >> 172.21.15.150:0/1110277112 conn(0x7fe1600b2540 msgr2=0x7fe1600b3930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:45:15.626 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:15.625+0000 7fe16527e640 1 -- 172.21.15.150:0/1110277112 shutdown_connections 2024-09-17T05:45:15.626 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:15.625+0000 7fe16527e640 1 -- 172.21.15.150:0/1110277112 wait complete. 2024-09-17T05:45:15.639 DEBUG:teuthology.orchestra.run.smithi150:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'stat -c %h /home/ubuntu/cephtest/mnt.0/./volumes/_deleting') 2024-09-17T05:45:15.689 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:15 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-17T05:45:15.696 INFO:teuthology.orchestra.run.smithi150.stdout:2 2024-09-17T05:45:15.696 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:15 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T05:45:15.702 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mgr mgr/volumes/max_concurrent_clones 4 2024-09-17T05:45:15.821 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:15.820+0000 7efe29758640 1 -- 172.21.15.150:0/4211250060 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7efe240d0380 msgr2=0x7efe2406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:45:15.821 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:15.820+0000 7efe29758640 1 --2- 172.21.15.150:0/4211250060 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7efe240d0380 0x7efe2406e2f0 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7efe1c005fd0 tx=0x7efe1c02a820 comp rx=0 tx=0).stop 2024-09-17T05:45:15.821 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:15.820+0000 7efe29758640 1 -- 172.21.15.150:0/4211250060 shutdown_connections 2024-09-17T05:45:15.821 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:15.820+0000 7efe29758640 1 --2- 172.21.15.150:0/4211250060 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7efe240d0380 0x7efe2406e2f0 unknown :-1 s=CLOSED pgs=547 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:15.821 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:15.820+0000 7efe29758640 1 --2- 172.21.15.150:0/4211250060 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7efe24074440 0x7efe2406ddb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:15.821 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:15.820+0000 7efe29758640 1 -- 172.21.15.150:0/4211250060 >> 172.21.15.150:0/4211250060 conn(0x7efe24073920 msgr2=0x7efe24073d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:45:15.821 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:15.820+0000 7efe29758640 1 -- 172.21.15.150:0/4211250060 shutdown_connections 2024-09-17T05:45:15.821 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:15.820+0000 7efe29758640 1 -- 172.21.15.150:0/4211250060 wait complete. 2024-09-17T05:45:15.822 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:15.822+0000 7efe29758640 1 Processor -- start 2024-09-17T05:45:15.822 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:15.822+0000 7efe29758640 1 -- start start 2024-09-17T05:45:15.825 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:15.823+0000 7efe29758640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7efe24070a70 0x7efe240cc470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:45:15.825 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:15.823+0000 7efe29758640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7efe24074440 0x7efe24156c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:45:15.825 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:15.823+0000 7efe29758640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7efe240d0380 0x7efe2406f960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:45:15.825 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:15.823+0000 7efe29758640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7efe240b41b0 con 0x7efe240d0380 2024-09-17T05:45:15.825 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:15.823+0000 7efe29758640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7efe2415bbe0 con 0x7efe24070a70 2024-09-17T05:45:15.825 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:15.823+0000 7efe29758640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7efe240b4330 con 0x7efe24074440 2024-09-17T05:45:15.825 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:15.823+0000 7efe237fe640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7efe240d0380 0x7efe2406f960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:45:15.825 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:15.823+0000 7efe237fe640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7efe240d0380 0x7efe2406f960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:50816/0 (socket says 172.21.15.150:50816) 2024-09-17T05:45:15.826 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:15.823+0000 7efe237fe640 1 -- 172.21.15.150:0/254464940 learned_addr learned my addr 172.21.15.150:0/254464940 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:45:15.826 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:15.823+0000 7efe1a7fc640 1 --2- 172.21.15.150:0/254464940 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7efe24074440 0x7efe24156c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:45:15.826 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:15.823+0000 7efe22ffd640 1 --2- 172.21.15.150:0/254464940 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7efe24070a70 0x7efe240cc470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:45:15.826 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:15.823+0000 7efe237fe640 1 -- 172.21.15.150:0/254464940 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7efe24074440 msgr2=0x7efe24156c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:45:15.826 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:15.823+0000 7efe237fe640 1 --2- 172.21.15.150:0/254464940 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7efe24074440 0x7efe24156c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:15.826 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:15.823+0000 7efe237fe640 1 -- 172.21.15.150:0/254464940 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7efe24070a70 msgr2=0x7efe240cc470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:45:15.826 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:15.823+0000 7efe237fe640 1 --2- 172.21.15.150:0/254464940 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7efe24070a70 0x7efe240cc470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:15.826 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:15.823+0000 7efe237fe640 1 -- 172.21.15.150:0/254464940 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efe240cad20 con 0x7efe240d0380 2024-09-17T05:45:15.826 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:15.823+0000 7efe22ffd640 1 --2- 172.21.15.150:0/254464940 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7efe24070a70 0x7efe240cc470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:45:15.826 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:15.824+0000 7efe237fe640 1 --2- 172.21.15.150:0/254464940 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7efe240d0380 0x7efe2406f960 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7efe1c035040 tx=0x7efe1c032d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:45:15.826 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:15.824+0000 7efe1bfff640 1 -- 172.21.15.150:0/254464940 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe1c037040 con 0x7efe240d0380 2024-09-17T05:45:15.826 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:15.824+0000 7efe1bfff640 1 -- 172.21.15.150:0/254464940 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7efe1c042070 con 0x7efe240d0380 2024-09-17T05:45:15.826 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:15.824+0000 7efe29758640 1 -- 172.21.15.150:0/254464940 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efe240a94b0 con 0x7efe240d0380 2024-09-17T05:45:15.826 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:15.824+0000 7efe1bfff640 1 -- 172.21.15.150:0/254464940 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe1c004260 con 0x7efe240d0380 2024-09-17T05:45:15.827 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:15.824+0000 7efe29758640 1 -- 172.21.15.150:0/254464940 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efe241f3e40 con 0x7efe240d0380 2024-09-17T05:45:15.829 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:15.825+0000 7efe29758640 1 -- 172.21.15.150:0/254464940 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efe241f38d0 con 0x7efe240d0380 2024-09-17T05:45:15.829 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:15.826+0000 7efe1bfff640 1 -- 172.21.15.150:0/254464940 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 14) ==== 102155+0+0 (secure 0 0 0) 0x7efe1c004400 con 0x7efe240d0380 2024-09-17T05:45:15.829 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:15.826+0000 7efe1bfff640 1 --2- 172.21.15.150:0/254464940 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7efe04079370 0x7efe0407b880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:45:15.829 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:15.826+0000 7efe1bfff640 1 -- 172.21.15.150:0/254464940 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 5767+0+0 (secure 0 0 0) 0x7efe1c0ba660 con 0x7efe240d0380 2024-09-17T05:45:15.829 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:15.826+0000 7efe22ffd640 1 --2- 172.21.15.150:0/254464940 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7efe04079370 0x7efe0407b880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:45:15.829 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:15.827+0000 7efe22ffd640 1 --2- 172.21.15.150:0/254464940 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7efe04079370 0x7efe0407b880 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7efe14005fd0 tx=0x7efe14005e20 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:45:15.831 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:15.831+0000 7efe1bfff640 1 -- 172.21.15.150:0/254464940 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7efe1c084310 con 0x7efe240d0380 2024-09-17T05:45:15.895 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:15.894+0000 7efe1bfff640 1 -- 172.21.15.150:0/254464940 <== mon.0 v2:172.21.15.150:3300/0 7 ==== mgrmap(e 15) ==== 102257+0+0 (secure 0 0 0) 0x7efe1c0046f0 con 0x7efe240d0380 2024-09-17T05:45:16.022 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:16.022+0000 7efe29758640 1 -- 172.21.15.150:0/254464940 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command([{prefix=config set, name=mgr/volumes/max_concurrent_clones}] v 0) -- 0x7efe240b4850 con 0x7efe240d0380 2024-09-17T05:45:16.023 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:16.022+0000 7efe1bfff640 1 -- 172.21.15.150:0/254464940 <== mon.0 v2:172.21.15.150:3300/0 8 ==== mon_command_ack([{prefix=config set, name=mgr/volumes/max_concurrent_clones}]=0 v36)=0 v36) ==== 131+0+0 (secure 0 0 0) 0x7efe1c09f070 con 0x7efe240d0380 2024-09-17T05:45:16.026 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:16.025+0000 7efe29758640 1 -- 172.21.15.150:0/254464940 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7efe04079370 msgr2=0x7efe0407b880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:45:16.026 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:16.025+0000 7efe29758640 1 --2- 172.21.15.150:0/254464940 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7efe04079370 0x7efe0407b880 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7efe14005fd0 tx=0x7efe14005e20 comp rx=0 tx=0).stop 2024-09-17T05:45:16.026 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:16.025+0000 7efe29758640 1 -- 172.21.15.150:0/254464940 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7efe240d0380 msgr2=0x7efe2406f960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:45:16.026 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:16.025+0000 7efe29758640 1 --2- 172.21.15.150:0/254464940 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7efe240d0380 0x7efe2406f960 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7efe1c035040 tx=0x7efe1c032d10 comp rx=0 tx=0).stop 2024-09-17T05:45:16.027 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:16.025+0000 7efe29758640 1 -- 172.21.15.150:0/254464940 shutdown_connections 2024-09-17T05:45:16.027 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:16.025+0000 7efe29758640 1 --2- 172.21.15.150:0/254464940 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7efe04079370 0x7efe0407b880 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:16.027 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:16.025+0000 7efe29758640 1 --2- 172.21.15.150:0/254464940 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7efe240d0380 0x7efe2406f960 unknown :-1 s=CLOSED pgs=548 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:16.027 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:16.025+0000 7efe29758640 1 --2- 172.21.15.150:0/254464940 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7efe24074440 0x7efe24156c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:16.027 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:16.025+0000 7efe29758640 1 --2- 172.21.15.150:0/254464940 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7efe24070a70 0x7efe240cc470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:16.027 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:16.025+0000 7efe29758640 1 -- 172.21.15.150:0/254464940 >> 172.21.15.150:0/254464940 conn(0x7efe24073920 msgr2=0x7efe2415c8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:45:16.027 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:16.026+0000 7efe29758640 1 -- 172.21.15.150:0/254464940 shutdown_connections 2024-09-17T05:45:16.027 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:16.026+0000 7efe29758640 1 -- 172.21.15.150:0/254464940 wait complete. 2024-09-17T05:45:16.043 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-17T05:45:16.043 DEBUG:teuthology.orchestra.run.smithi150:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-17T05:45:16.096 DEBUG:teuthology.orchestra.run.smithi176:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-17T05:45:16.139 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-17T05:45:16.139 INFO:tasks.cephfs.mount:Terminating background process 2024-09-17T05:45:16.139 DEBUG:teuthology.orchestra.run.smithi150:> set -ex 2024-09-17T05:45:16.139 DEBUG:teuthology.orchestra.run.smithi150:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T05:45:16.162 DEBUG:teuthology.orchestra.run.smithi150:> set -ex 2024-09-17T05:45:16.162 DEBUG:teuthology.orchestra.run.smithi150:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T05:45:16.226 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-17T05:45:16.441 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:16.440+0000 7f1c150de640 1 -- 172.21.15.150:0/4044379348 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1c100b27a0 msgr2=0x7f1c1015ed90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:45:16.441 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:16.440+0000 7f1c150de640 1 --2- 172.21.15.150:0/4044379348 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1c100b27a0 0x7f1c1015ed90 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f1c00009850 tx=0x7f1c0002a5a0 comp rx=0 tx=0).stop 2024-09-17T05:45:16.442 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:16.440+0000 7f1c150de640 1 -- 172.21.15.150:0/4044379348 shutdown_connections 2024-09-17T05:45:16.442 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:16.441+0000 7f1c150de640 1 --2- 172.21.15.150:0/4044379348 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1c100b27a0 0x7f1c1015ed90 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:16.442 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:16.441+0000 7f1c150de640 1 -- 172.21.15.150:0/4044379348 >> 172.21.15.150:0/4044379348 conn(0x7f1c100b2f60 msgr2=0x7f1c100b3370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:45:16.442 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:16.441+0000 7f1c150de640 1 -- 172.21.15.150:0/4044379348 shutdown_connections 2024-09-17T05:45:16.442 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:16.441+0000 7f1c150de640 1 -- 172.21.15.150:0/4044379348 wait complete. 2024-09-17T05:45:16.444 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:16.443+0000 7f1c150de640 1 Processor -- start 2024-09-17T05:45:16.444 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:16.443+0000 7f1c150de640 1 -- start start 2024-09-17T05:45:16.447 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:16.446+0000 7f1c150de640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1c100b27a0 0x7f1c10158730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:45:16.447 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:16.446+0000 7f1c150de640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1c100b52c0 0x7f1c101f0a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:45:16.447 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:16.446+0000 7f1c150de640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1c100cf9d0 0x7f1c101fa050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:45:16.447 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:16.446+0000 7f1c150de640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f1c100b63a0 con 0x7f1c100cf9d0 2024-09-17T05:45:16.447 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:16.446+0000 7f1c150de640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f1c100b6220 con 0x7f1c100b27a0 2024-09-17T05:45:16.447 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:16.446+0000 7f1c0f59e640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1c100cf9d0 0x7f1c101fa050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:45:16.447 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:16.446+0000 7f1c0f59e640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1c100cf9d0 0x7f1c101fa050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:50820/0 (socket says 172.21.15.150:50820) 2024-09-17T05:45:16.447 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:16.446+0000 7f1c0e59c640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1c100b52c0 0x7f1c101f0a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:45:16.447 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:16.446+0000 7f1c0f59e640 1 -- 172.21.15.150:0/2768711160 learned_addr learned my addr 172.21.15.150:0/2768711160 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:45:16.447 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:16.446+0000 7f1c0ed9d640 1 --2- 172.21.15.150:0/2768711160 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1c100b27a0 0x7f1c10158730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:45:16.448 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:16.446+0000 7f1c150de640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f1c100b6520 con 0x7f1c100b52c0 2024-09-17T05:45:16.449 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:16.447+0000 7f1c0f59e640 1 -- 172.21.15.150:0/2768711160 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1c100b52c0 msgr2=0x7f1c101f0a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:45:16.449 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:16.447+0000 7f1c0f59e640 1 --2- 172.21.15.150:0/2768711160 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1c100b52c0 0x7f1c101f0a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:16.449 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:16.447+0000 7f1c0f59e640 1 -- 172.21.15.150:0/2768711160 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1c100b27a0 msgr2=0x7f1c10158730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:45:16.449 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:16.447+0000 7f1c0f59e640 1 --2- 172.21.15.150:0/2768711160 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1c100b27a0 0x7f1c10158730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:16.449 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:16.447+0000 7f1c0f59e640 1 -- 172.21.15.150:0/2768711160 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1c101574f0 con 0x7f1c100cf9d0 2024-09-17T05:45:16.449 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:16.447+0000 7f1c0f59e640 1 --2- 172.21.15.150:0/2768711160 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1c100cf9d0 0x7f1c101fa050 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7f1c0800cb10 tx=0x7f1c0800a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:45:16.449 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:16.447+0000 7f1bf77fe640 1 -- 172.21.15.150:0/2768711160 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c08016020 con 0x7f1c100cf9d0 2024-09-17T05:45:16.450 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:16.447+0000 7f1bf77fe640 1 -- 172.21.15.150:0/2768711160 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f1c0800ad80 con 0x7f1c100cf9d0 2024-09-17T05:45:16.450 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:16.447+0000 7f1bf77fe640 1 -- 172.21.15.150:0/2768711160 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c08012680 con 0x7f1c100cf9d0 2024-09-17T05:45:16.450 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:16.447+0000 7f1c150de640 1 -- 172.21.15.150:0/2768711160 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1c101fac60 con 0x7f1c100cf9d0 2024-09-17T05:45:16.450 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:16.447+0000 7f1c150de640 1 -- 172.21.15.150:0/2768711160 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1c10157c50 con 0x7f1c100cf9d0 2024-09-17T05:45:16.450 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:16.449+0000 7f1c150de640 1 -- 172.21.15.150:0/2768711160 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1c1015ed90 con 0x7f1c100cf9d0 2024-09-17T05:45:16.451 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:16.450+0000 7f1bf77fe640 1 -- 172.21.15.150:0/2768711160 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 15) ==== 102257+0+0 (secure 0 0 0) 0x7f1c08019020 con 0x7f1c100cf9d0 2024-09-17T05:45:16.452 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:16.451+0000 7f1bf77fe640 1 --2- 172.21.15.150:0/2768711160 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f1bfc079560 0x7f1bfc07ba70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:45:16.452 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:16.451+0000 7f1bf77fe640 1 -- 172.21.15.150:0/2768711160 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 5767+0+0 (secure 0 0 0) 0x7f1c08099a70 con 0x7f1c100cf9d0 2024-09-17T05:45:16.452 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:16.452+0000 7f1c0ed9d640 1 --2- 172.21.15.150:0/2768711160 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f1bfc079560 0x7f1bfc07ba70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:45:16.455 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:16.453+0000 7f1c0ed9d640 1 --2- 172.21.15.150:0/2768711160 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f1bfc079560 0x7f1bfc07ba70 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f1c00034000 tx=0x7f1c00004730 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:45:16.460 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:16.460+0000 7f1bf77fe640 1 -- 172.21.15.150:0/2768711160 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f1c08020020 con 0x7f1c100cf9d0 2024-09-17T05:45:16.816 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:16.816+0000 7f1c150de640 1 -- 172.21.15.150:0/2768711160 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f1c10070d90 con 0x7f1c100cf9d0 2024-09-17T05:45:16.817 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:16.816+0000 7f1bf77fe640 1 -- 172.21.15.150:0/2768711160 <== mon.0 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v47) ==== 80+0+0 (secure 0 0 0) 0x7f1c080632b0 con 0x7f1c100cf9d0 2024-09-17T05:45:16.817 INFO:teuthology.orchestra.run.smithi150.stderr:listed 0 entries 2024-09-17T05:45:16.820 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:16.820+0000 7f1c150de640 1 -- 172.21.15.150:0/2768711160 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f1bfc079560 msgr2=0x7f1bfc07ba70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:45:16.820 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:16.820+0000 7f1c150de640 1 --2- 172.21.15.150:0/2768711160 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f1bfc079560 0x7f1bfc07ba70 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f1c00034000 tx=0x7f1c00004730 comp rx=0 tx=0).stop 2024-09-17T05:45:16.820 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:16.820+0000 7f1c150de640 1 -- 172.21.15.150:0/2768711160 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1c100cf9d0 msgr2=0x7f1c101fa050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:45:16.820 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:16.820+0000 7f1c150de640 1 --2- 172.21.15.150:0/2768711160 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1c100cf9d0 0x7f1c101fa050 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7f1c0800cb10 tx=0x7f1c0800a060 comp rx=0 tx=0).stop 2024-09-17T05:45:16.821 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:16.820+0000 7f1c150de640 1 -- 172.21.15.150:0/2768711160 shutdown_connections 2024-09-17T05:45:16.821 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:16.820+0000 7f1c150de640 1 --2- 172.21.15.150:0/2768711160 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f1bfc079560 0x7f1bfc07ba70 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:16.821 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:16.820+0000 7f1c150de640 1 --2- 172.21.15.150:0/2768711160 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1c100cf9d0 0x7f1c101fa050 unknown :-1 s=CLOSED pgs=550 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:16.821 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:16.820+0000 7f1c150de640 1 --2- 172.21.15.150:0/2768711160 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1c100b52c0 0x7f1c101f0a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:16.821 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:16.820+0000 7f1c150de640 1 --2- 172.21.15.150:0/2768711160 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1c100b27a0 0x7f1c10158730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:16.821 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:16.820+0000 7f1c150de640 1 -- 172.21.15.150:0/2768711160 >> 172.21.15.150:0/2768711160 conn(0x7f1c100b2f60 msgr2=0x7f1c100d1240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:45:16.821 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:16.820+0000 7f1c150de640 1 -- 172.21.15.150:0/2768711160 shutdown_connections 2024-09-17T05:45:16.822 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:16.820+0000 7f1c150de640 1 -- 172.21.15.150:0/2768711160 wait complete. 2024-09-17T05:45:16.840 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-09-17T05:45:16.840 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:45:16.841 DEBUG:teuthology.orchestra.run.smithi150:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-09-17T05:45:16.903 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi150.front.sepia.ceph.com 2024-09-17T05:45:16.903 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:45:16.903 DEBUG:teuthology.orchestra.run.smithi150:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-17T05:45:16.941 INFO:tasks.cephfs.mount:Terminating background process 2024-09-17T05:45:16.941 DEBUG:teuthology.orchestra.run.smithi176:> set -ex 2024-09-17T05:45:16.941 DEBUG:teuthology.orchestra.run.smithi176:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T05:45:16.964 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056030,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497468k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=3379 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248732k,nr_inodes=812183,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497468k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-17T05:45:16.965 INFO:tasks.cephfs.mount:Terminating background process 2024-09-17T05:45:16.965 DEBUG:teuthology.orchestra.run.smithi150:> set -ex 2024-09-17T05:45:16.965 DEBUG:teuthology.orchestra.run.smithi150:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T05:45:17.005 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056027,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497464k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=18693 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248728k,nr_inodes=812182,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497464k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-17T05:45:17.005 INFO:tasks.cephfs.mount:Terminating background process 2024-09-17T05:45:17.005 DEBUG:teuthology.orchestra.run.smithi176:> set -ex 2024-09-17T05:45:17.005 DEBUG:teuthology.orchestra.run.smithi176:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T05:45:17.028 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056030,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497468k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=3379 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248732k,nr_inodes=812183,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497468k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-17T05:45:17.028 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T05:45:17.222 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:17.220+0000 7f438bfff640 1 -- 172.21.15.150:0/3427147596 <== mon.2 v2:172.21.15.176:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f438c0363f0 con 0x7f439406ddb0 2024-09-17T05:45:17.222 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:17.221+0000 7f439b969640 1 -- 172.21.15.150:0/3427147596 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f439406ddb0 msgr2=0x7f439406e1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:45:17.222 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:17.221+0000 7f439b969640 1 --2- 172.21.15.150:0/3427147596 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f439406ddb0 0x7f439406e1c0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f438c0082a0 tx=0x7f438c02aaa0 comp rx=0 tx=0).stop 2024-09-17T05:45:17.223 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:17.221+0000 7f439b969640 1 -- 172.21.15.150:0/3427147596 shutdown_connections 2024-09-17T05:45:17.223 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:17.221+0000 7f439b969640 1 --2- 172.21.15.150:0/3427147596 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f439406ddb0 0x7f439406e1c0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:17.223 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:17.221+0000 7f439b969640 1 --2- 172.21.15.150:0/3427147596 >> v2:172.21.15.150:3300/0 conn(0x7f43940b3af0 0x7f4394071980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:17.223 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:17.221+0000 7f439b969640 1 -- 172.21.15.150:0/3427147596 >> 172.21.15.150:0/3427147596 conn(0x7f43940738b0 msgr2=0x7f4394073cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:45:17.223 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:17.222+0000 7f439b969640 1 -- 172.21.15.150:0/3427147596 shutdown_connections 2024-09-17T05:45:17.224 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:17.222+0000 7f439b969640 1 -- 172.21.15.150:0/3427147596 wait complete. 2024-09-17T05:45:17.225 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:17.225+0000 7f439b969640 1 Processor -- start 2024-09-17T05:45:17.225 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:17.225+0000 7f439b969640 1 -- start start 2024-09-17T05:45:17.227 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:17.227+0000 7f439b969640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f439406ddb0 0x7f439415dbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:45:17.227 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:17.227+0000 7f439b969640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f43940b3af0 0x7f4394155d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:45:17.227 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:17.227+0000 7f439b969640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f43940ce450 0x7f43941562d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:45:17.227 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:17.227+0000 7f439b969640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f4394076410 con 0x7f43940b3af0 2024-09-17T05:45:17.227 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:17.227+0000 7f439b969640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f4394076290 con 0x7f43940ce450 2024-09-17T05:45:17.227 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:17.227+0000 7f439b969640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f439406fe50 con 0x7f439406ddb0 2024-09-17T05:45:17.228 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:17.227+0000 7f4399f06640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f43940ce450 0x7f43941562d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:45:17.228 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:17.227+0000 7f4399f06640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f43940ce450 0x7f43941562d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3300/0 says I am v2:172.21.15.150:48390/0 (socket says 172.21.15.150:48390) 2024-09-17T05:45:17.228 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:17.227+0000 7f4399f06640 1 -- 172.21.15.150:0/2997518698 learned_addr learned my addr 172.21.15.150:0/2997518698 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:45:17.228 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:17.227+0000 7f4399705640 1 --2- 172.21.15.150:0/2997518698 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f439406ddb0 0x7f439415dbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:45:17.228 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:17.227+0000 7f4398f04640 1 --2- 172.21.15.150:0/2997518698 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f43940b3af0 0x7f4394155d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:45:17.229 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:17.228+0000 7f4399f06640 1 -- 172.21.15.150:0/2997518698 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f439406ddb0 msgr2=0x7f439415dbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:45:17.230 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:17.228+0000 7f4399f06640 1 --2- 172.21.15.150:0/2997518698 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f439406ddb0 0x7f439415dbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:17.230 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:17.228+0000 7f4399f06640 1 -- 172.21.15.150:0/2997518698 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f43940b3af0 msgr2=0x7f4394155d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:45:17.230 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:17.228+0000 7f4399f06640 1 --2- 172.21.15.150:0/2997518698 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f43940b3af0 0x7f4394155d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:17.230 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:17.228+0000 7f4399f06640 1 -- 172.21.15.150:0/2997518698 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f43941f29a0 con 0x7f43940ce450 2024-09-17T05:45:17.230 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:17.228+0000 7f4399f06640 1 --2- 172.21.15.150:0/2997518698 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f43940ce450 0x7f43941562d0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f438c02b090 tx=0x7f438c036e10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:45:17.230 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:17.228+0000 7f4399705640 1 --2- 172.21.15.150:0/2997518698 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f439406ddb0 0x7f439415dbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:45:17.230 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:17.229+0000 7f4389ffb640 1 -- 172.21.15.150:0/2997518698 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f438c003b70 con 0x7f43940ce450 2024-09-17T05:45:17.230 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:17.229+0000 7f439b969640 1 -- 172.21.15.150:0/2997518698 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f43941f1be0 con 0x7f43940ce450 2024-09-17T05:45:17.230 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:17.229+0000 7f439b969640 1 -- 172.21.15.150:0/2997518698 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f43941f21a0 con 0x7f43940ce450 2024-09-17T05:45:17.231 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:17.230+0000 7f4389ffb640 1 -- 172.21.15.150:0/2997518698 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f438c003e00 con 0x7f43940ce450 2024-09-17T05:45:17.231 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:17.230+0000 7f4389ffb640 1 -- 172.21.15.150:0/2997518698 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f438c004280 con 0x7f43940ce450 2024-09-17T05:45:17.232 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:17.232+0000 7f437f7fe640 1 -- 172.21.15.150:0/2997518698 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f439406e1c0 con 0x7f43940ce450 2024-09-17T05:45:17.233 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:17.233+0000 7f4389ffb640 1 -- 172.21.15.150:0/2997518698 <== mon.1 v2:172.21.15.176:3300/0 4 ==== mgrmap(e 15) ==== 102257+0+0 (secure 0 0 0) 0x7f438c02c040 con 0x7f43940ce450 2024-09-17T05:45:17.234 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:17.233+0000 7f4389ffb640 1 --2- 172.21.15.150:0/2997518698 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f4378079560 0x7f437807ba70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:45:17.234 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:17.234+0000 7f4389ffb640 1 -- 172.21.15.150:0/2997518698 <== mon.1 v2:172.21.15.176:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 5767+0+0 (secure 0 0 0) 0x7f438c0baa00 con 0x7f43940ce450 2024-09-17T05:45:17.234 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:17.234+0000 7f4399705640 1 --2- 172.21.15.150:0/2997518698 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f4378079560 0x7f437807ba70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:45:17.235 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:17.235+0000 7f4399705640 1 --2- 172.21.15.150:0/2997518698 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f4378079560 0x7f437807ba70 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f43900013f0 tx=0x7f4390009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:45:17.243 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:17.243+0000 7f4389ffb640 1 -- 172.21.15.150:0/2997518698 <== mon.1 v2:172.21.15.176:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f438c032070 con 0x7f43940ce450 2024-09-17T05:45:17.588 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:17.587+0000 7f437f7fe640 1 -- 172.21.15.150:0/2997518698 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f439415e2f0 con 0x7f43940ce450 2024-09-17T05:45:17.588 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:17.588+0000 7f4389ffb640 1 -- 172.21.15.150:0/2997518698 <== mon.1 v2:172.21.15.176:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) ==== 94+0+5235 (secure 0 0 0) 0x7f438c0842d0 con 0x7f43940ce450 2024-09-17T05:45:17.589 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-09-17T05:45:17.589 INFO:teuthology.orchestra.run.smithi150.stdout:{"epoch":26,"btime":"2024-09-17T05:44:15:201423+0000","default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5278,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6836/1460864883","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6834","nonce":1460864883},{"type":"v1","addr":"172.21.15.176:6836","nonce":1460864883}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":20},{"gid":5281,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6837/3149402402","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6835","nonce":3149402402},{"type":"v1","addr":"172.21.15.176:6837","nonce":3149402402}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":20},{"gid":5469,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6833/3082315470","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6832","nonce":3082315470},{"type":"v1","addr":"172.21.15.150:6833","nonce":3082315470}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":19}],"filesystems":[{"mdsmap":{"epoch":25,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T05:44:02.308071+0000","modified":"2024-09-17T05:44:05.353165+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5472},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5472":{"gid":5472,"name":"c","rank":0,"incarnation":21,"state":"up:active","state_seq":3,"addr":"172.21.15.150:6835/1137907102","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6834","nonce":1137907102},{"type":"v1","addr":"172.21.15.150:6835","nonce":1137907102}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5472,"qdb_cluster":[5472]},"id":3}]} 2024-09-17T05:45:17.589 INFO:teuthology.orchestra.run.smithi150.stderr:dumped fsmap epoch 26 2024-09-17T05:45:17.591 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:17.590+0000 7f437f7fe640 1 -- 172.21.15.150:0/2997518698 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f4378079560 msgr2=0x7f437807ba70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:45:17.592 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:17.590+0000 7f437f7fe640 1 --2- 172.21.15.150:0/2997518698 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f4378079560 0x7f437807ba70 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f43900013f0 tx=0x7f4390009040 comp rx=0 tx=0).stop 2024-09-17T05:45:17.592 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:17.591+0000 7f437f7fe640 1 -- 172.21.15.150:0/2997518698 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f43940ce450 msgr2=0x7f43941562d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:45:17.592 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:17.591+0000 7f437f7fe640 1 --2- 172.21.15.150:0/2997518698 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f43940ce450 0x7f43941562d0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f438c02b090 tx=0x7f438c036e10 comp rx=0 tx=0).stop 2024-09-17T05:45:17.592 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:17.591+0000 7f437f7fe640 1 -- 172.21.15.150:0/2997518698 shutdown_connections 2024-09-17T05:45:17.592 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:17.591+0000 7f437f7fe640 1 --2- 172.21.15.150:0/2997518698 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f43940ce450 0x7f43941562d0 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:17.592 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:17.591+0000 7f437f7fe640 1 --2- 172.21.15.150:0/2997518698 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f4378079560 0x7f437807ba70 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:17.592 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:17.591+0000 7f437f7fe640 1 --2- 172.21.15.150:0/2997518698 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f43940b3af0 0x7f4394155d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:17.592 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:17.591+0000 7f437f7fe640 1 --2- 172.21.15.150:0/2997518698 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f439406ddb0 0x7f439415dbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:17.592 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:17.591+0000 7f437f7fe640 1 -- 172.21.15.150:0/2997518698 >> 172.21.15.150:0/2997518698 conn(0x7f43940738b0 msgr2=0x7f4394150420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:45:17.592 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:17.591+0000 7f437f7fe640 1 -- 172.21.15.150:0/2997518698 shutdown_connections 2024-09-17T05:45:17.592 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:17.591+0000 7f437f7fe640 1 -- 172.21.15.150:0/2997518698 wait complete. 2024-09-17T05:45:17.603 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T05:45:17.720 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:17.719+0000 7f0a29c07640 1 -- 172.21.15.150:0/2571294148 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0a240d1790 msgr2=0x7f0a240d2780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:45:17.720 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:17.719+0000 7f0a29c07640 1 --2- 172.21.15.150:0/2571294148 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0a240d1790 0x7f0a240d2780 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7f0a18009830 tx=0x7f0a1802a5c0 comp rx=0 tx=0).stop 2024-09-17T05:45:17.720 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:17.719+0000 7f0a29c07640 1 -- 172.21.15.150:0/2571294148 shutdown_connections 2024-09-17T05:45:17.720 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:17.719+0000 7f0a29c07640 1 --2- 172.21.15.150:0/2571294148 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0a240d1790 0x7f0a240d2780 unknown :-1 s=CLOSED pgs=552 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:17.720 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:17.719+0000 7f0a29c07640 1 -- 172.21.15.150:0/2571294148 >> 172.21.15.150:0/2571294148 conn(0x7f0a2408bfe0 msgr2=0x7f0a240d4670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:45:17.720 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:17.719+0000 7f0a29c07640 1 -- 172.21.15.150:0/2571294148 shutdown_connections 2024-09-17T05:45:17.720 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:17.719+0000 7f0a29c07640 1 -- 172.21.15.150:0/2571294148 wait complete. 2024-09-17T05:45:17.721 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:17.721+0000 7f0a29c07640 1 Processor -- start 2024-09-17T05:45:17.721 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:17.721+0000 7f0a29c07640 1 -- start start 2024-09-17T05:45:17.724 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:17.722+0000 7f0a29c07640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0a240b5d50 0x7f0a240b4d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:45:17.724 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:17.722+0000 7f0a29c07640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0a240d4f90 0x7f0a2414f260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:45:17.724 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:17.722+0000 7f0a29c07640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0a240b1e30 0x7f0a240a1400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:45:17.724 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:17.722+0000 7f0a29c07640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f0a240b7d50 con 0x7f0a240d4f90 2024-09-17T05:45:17.724 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:17.722+0000 7f0a29c07640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f0a240b7bd0 con 0x7f0a240b1e30 2024-09-17T05:45:17.724 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:17.722+0000 7f0a29c07640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f0a240b7ed0 con 0x7f0a240b5d50 2024-09-17T05:45:17.724 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:17.723+0000 7f0a22ffd640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0a240d4f90 0x7f0a2414f260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:45:17.725 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:17.723+0000 7f0a22ffd640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0a240d4f90 0x7f0a2414f260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:50868/0 (socket says 172.21.15.150:50868) 2024-09-17T05:45:17.725 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:17.723+0000 7f0a22ffd640 1 -- 172.21.15.150:0/4012586504 learned_addr learned my addr 172.21.15.150:0/4012586504 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:45:17.725 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:17.723+0000 7f0a237fe640 1 --2- 172.21.15.150:0/4012586504 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0a240b5d50 0x7f0a240b4d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:45:17.725 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:17.723+0000 7f0a23fff640 1 --2- 172.21.15.150:0/4012586504 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0a240b1e30 0x7f0a240a1400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:45:17.725 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:17.723+0000 7f0a22ffd640 1 -- 172.21.15.150:0/4012586504 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0a240b5d50 msgr2=0x7f0a240b4d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:45:17.725 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:17.723+0000 7f0a22ffd640 1 --2- 172.21.15.150:0/4012586504 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0a240b5d50 0x7f0a240b4d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:17.725 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:17.723+0000 7f0a22ffd640 1 -- 172.21.15.150:0/4012586504 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0a240b1e30 msgr2=0x7f0a240a1400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:45:17.725 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:17.723+0000 7f0a22ffd640 1 --2- 172.21.15.150:0/4012586504 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0a240b1e30 0x7f0a240a1400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:17.725 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:17.723+0000 7f0a22ffd640 1 -- 172.21.15.150:0/4012586504 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0a241e7a80 con 0x7f0a240d4f90 2024-09-17T05:45:17.725 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:17.723+0000 7f0a22ffd640 1 --2- 172.21.15.150:0/4012586504 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0a240d4f90 0x7f0a2414f260 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7f0a1802abb0 tx=0x7f0a18033ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:45:17.725 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:17.723+0000 7f0a0bfff640 1 -- 172.21.15.150:0/4012586504 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a18031d60 con 0x7f0a240d4f90 2024-09-17T05:45:17.725 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:17.723+0000 7f0a0bfff640 1 -- 172.21.15.150:0/4012586504 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0a18005020 con 0x7f0a240d4f90 2024-09-17T05:45:17.725 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:17.723+0000 7f0a0bfff640 1 -- 172.21.15.150:0/4012586504 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a18005470 con 0x7f0a240d4f90 2024-09-17T05:45:17.725 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:17.723+0000 7f0a29c07640 1 -- 172.21.15.150:0/4012586504 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0a2414f7a0 con 0x7f0a240d4f90 2024-09-17T05:45:17.726 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:17.723+0000 7f0a29c07640 1 -- 172.21.15.150:0/4012586504 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0a240b1350 con 0x7f0a240d4f90 2024-09-17T05:45:17.726 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:17.725+0000 7f0a29c07640 1 -- 172.21.15.150:0/4012586504 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0a240d2780 con 0x7f0a240d4f90 2024-09-17T05:45:17.726 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:17.725+0000 7f0a0bfff640 1 -- 172.21.15.150:0/4012586504 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 15) ==== 102257+0+0 (secure 0 0 0) 0x7f0a180047a0 con 0x7f0a240d4f90 2024-09-17T05:45:17.726 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:17.726+0000 7f0a0bfff640 1 --2- 172.21.15.150:0/4012586504 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f0a10079490 0x7f0a1007b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:45:17.727 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:17.726+0000 7f0a0bfff640 1 -- 172.21.15.150:0/4012586504 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 5767+0+0 (secure 0 0 0) 0x7f0a180ba820 con 0x7f0a240d4f90 2024-09-17T05:45:17.727 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:17.726+0000 7f0a237fe640 1 --2- 172.21.15.150:0/4012586504 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f0a10079490 0x7f0a1007b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:45:17.727 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:17.726+0000 7f0a237fe640 1 --2- 172.21.15.150:0/4012586504 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f0a10079490 0x7f0a1007b9a0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f0a14001720 tx=0x7f0a14009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:45:17.731 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:17.730+0000 7f0a0bfff640 1 -- 172.21.15.150:0/4012586504 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f0a1803f030 con 0x7f0a240d4f90 2024-09-17T05:45:17.946 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:17.946+0000 7f0a29c07640 1 -- 172.21.15.150:0/4012586504 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f0a240d2d60 con 0x7f0a240d4f90 2024-09-17T05:45:17.947 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:17.946+0000 7f0a0bfff640 1 -- 172.21.15.150:0/4012586504 <== mon.0 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) ==== 94+0+5235 (secure 0 0 0) 0x7f0a180840d0 con 0x7f0a240d4f90 2024-09-17T05:45:17.947 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-09-17T05:45:17.947 INFO:teuthology.orchestra.run.smithi150.stdout:{"epoch":26,"btime":"2024-09-17T05:44:15:201423+0000","default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5278,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6836/1460864883","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6834","nonce":1460864883},{"type":"v1","addr":"172.21.15.176:6836","nonce":1460864883}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":20},{"gid":5281,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6837/3149402402","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6835","nonce":3149402402},{"type":"v1","addr":"172.21.15.176:6837","nonce":3149402402}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":20},{"gid":5469,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6833/3082315470","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6832","nonce":3082315470},{"type":"v1","addr":"172.21.15.150:6833","nonce":3082315470}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":19}],"filesystems":[{"mdsmap":{"epoch":25,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T05:44:02.308071+0000","modified":"2024-09-17T05:44:05.353165+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5472},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5472":{"gid":5472,"name":"c","rank":0,"incarnation":21,"state":"up:active","state_seq":3,"addr":"172.21.15.150:6835/1137907102","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6834","nonce":1137907102},{"type":"v1","addr":"172.21.15.150:6835","nonce":1137907102}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5472,"qdb_cluster":[5472]},"id":3}]} 2024-09-17T05:45:17.948 INFO:teuthology.orchestra.run.smithi150.stderr:dumped fsmap epoch 26 2024-09-17T05:45:17.949 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:17.948+0000 7f0a29c07640 1 -- 172.21.15.150:0/4012586504 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f0a10079490 msgr2=0x7f0a1007b9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:45:17.949 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:17.948+0000 7f0a29c07640 1 --2- 172.21.15.150:0/4012586504 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f0a10079490 0x7f0a1007b9a0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f0a14001720 tx=0x7f0a14009040 comp rx=0 tx=0).stop 2024-09-17T05:45:17.950 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:17.948+0000 7f0a29c07640 1 -- 172.21.15.150:0/4012586504 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0a240d4f90 msgr2=0x7f0a2414f260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:45:17.950 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:17.948+0000 7f0a29c07640 1 --2- 172.21.15.150:0/4012586504 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0a240d4f90 0x7f0a2414f260 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7f0a1802abb0 tx=0x7f0a18033ce0 comp rx=0 tx=0).stop 2024-09-17T05:45:17.950 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:17.949+0000 7f0a29c07640 1 -- 172.21.15.150:0/4012586504 shutdown_connections 2024-09-17T05:45:17.950 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:17.949+0000 7f0a29c07640 1 --2- 172.21.15.150:0/4012586504 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0a240b1e30 0x7f0a240a1400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:17.950 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:17.949+0000 7f0a29c07640 1 --2- 172.21.15.150:0/4012586504 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f0a10079490 0x7f0a1007b9a0 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:17.950 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:17.949+0000 7f0a29c07640 1 --2- 172.21.15.150:0/4012586504 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0a240d4f90 0x7f0a2414f260 unknown :-1 s=CLOSED pgs=553 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:17.950 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:17.949+0000 7f0a29c07640 1 --2- 172.21.15.150:0/4012586504 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0a240b5d50 0x7f0a240b4d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:17.950 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:17.949+0000 7f0a29c07640 1 -- 172.21.15.150:0/4012586504 >> 172.21.15.150:0/4012586504 conn(0x7f0a2408bfe0 msgr2=0x7f0a2406deb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:45:17.950 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:17.949+0000 7f0a29c07640 1 -- 172.21.15.150:0/4012586504 shutdown_connections 2024-09-17T05:45:17.951 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:17.949+0000 7f0a29c07640 1 -- 172.21.15.150:0/4012586504 wait complete. 2024-09-17T05:45:17.961 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T05:45:18.118 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:18.117+0000 7f272d59a640 1 -- 172.21.15.150:0/352786876 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27200047a0 con 0x7f273015ef40 2024-09-17T05:45:18.118 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:18.117+0000 7f2734ccc640 1 -- 172.21.15.150:0/352786876 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f273015ef40 msgr2=0x7f27300d3f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:45:18.119 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:18.117+0000 7f2734ccc640 1 --2- 172.21.15.150:0/352786876 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f273015ef40 0x7f27300d3f20 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7f27301624e0 tx=0x7f272002a560 comp rx=0 tx=0).stop 2024-09-17T05:45:18.119 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:18.117+0000 7f2734ccc640 1 -- 172.21.15.150:0/352786876 shutdown_connections 2024-09-17T05:45:18.119 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:18.117+0000 7f2734ccc640 1 --2- 172.21.15.150:0/352786876 >> v2:172.21.15.176:3300/0 conn(0x7f27300ceef0 0x7f27300d30a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:18.119 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:18.117+0000 7f2734ccc640 1 --2- 172.21.15.150:0/352786876 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f273015ef40 0x7f27300d3f20 unknown :-1 s=CLOSED pgs=554 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:18.119 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:18.117+0000 7f2734ccc640 1 -- 172.21.15.150:0/352786876 >> 172.21.15.150:0/352786876 conn(0x7f273006df90 msgr2=0x7f273006e3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:45:18.119 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:18.117+0000 7f2734ccc640 1 -- 172.21.15.150:0/352786876 shutdown_connections 2024-09-17T05:45:18.119 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:18.117+0000 7f2734ccc640 1 -- 172.21.15.150:0/352786876 wait complete. 2024-09-17T05:45:18.121 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:18.120+0000 7f2734ccc640 1 Processor -- start 2024-09-17T05:45:18.121 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:18.121+0000 7f2734ccc640 1 -- start start 2024-09-17T05:45:18.123 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:18.123+0000 7f2734ccc640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f27300ceef0 0x7f27300b6730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:45:18.124 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:18.123+0000 7f2734ccc640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f27300d35e0 0x7f273015b230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:45:18.124 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:18.123+0000 7f2734ccc640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f273015ef40 0x7f273015b770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:45:18.124 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:18.123+0000 7f2734ccc640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f27300d0de0 con 0x7f27300d35e0 2024-09-17T05:45:18.124 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:18.123+0000 7f2734ccc640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f27300cf510 con 0x7f27300ceef0 2024-09-17T05:45:18.124 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:18.123+0000 7f272e59c640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f27300ceef0 0x7f27300b6730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:45:18.124 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:18.123+0000 7f272e59c640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f27300ceef0 0x7f27300b6730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3300/0 says I am v2:172.21.15.150:48424/0 (socket says 172.21.15.150:48424) 2024-09-17T05:45:18.124 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:18.123+0000 7f272e59c640 1 -- 172.21.15.150:0/2997490789 learned_addr learned my addr 172.21.15.150:0/2997490789 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:45:18.124 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:18.123+0000 7f2734ccc640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f27300d0f60 con 0x7f273015ef40 2024-09-17T05:45:18.125 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:18.123+0000 7f272ed9d640 1 --2- 172.21.15.150:0/2997490789 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f273015ef40 0x7f273015b770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:45:18.125 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:18.123+0000 7f272dd9b640 1 --2- 172.21.15.150:0/2997490789 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f27300d35e0 0x7f273015b230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:45:18.126 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:18.124+0000 7f272e59c640 1 -- 172.21.15.150:0/2997490789 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f273015ef40 msgr2=0x7f273015b770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:45:18.126 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:18.124+0000 7f272e59c640 1 --2- 172.21.15.150:0/2997490789 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f273015ef40 0x7f273015b770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:18.126 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:18.124+0000 7f272e59c640 1 -- 172.21.15.150:0/2997490789 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f27300d35e0 msgr2=0x7f273015b230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:45:18.126 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:18.124+0000 7f272e59c640 1 --2- 172.21.15.150:0/2997490789 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f27300d35e0 0x7f273015b230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:18.126 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:18.124+0000 7f272e59c640 1 -- 172.21.15.150:0/2997490789 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f27300b4c60 con 0x7f27300ceef0 2024-09-17T05:45:18.127 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:18.124+0000 7f272dd9b640 1 --2- 172.21.15.150:0/2997490789 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f27300d35e0 0x7f273015b230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T05:45:18.127 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:18.124+0000 7f272e59c640 1 --2- 172.21.15.150:0/2997490789 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f27300ceef0 0x7f27300b6730 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f2720000c00 tx=0x7f2720003820 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:45:18.127 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:18.124+0000 7f271effd640 1 -- 172.21.15.150:0/2997490789 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f272003e030 con 0x7f27300ceef0 2024-09-17T05:45:18.127 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:18.124+0000 7f271effd640 1 -- 172.21.15.150:0/2997490789 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f2720003d10 con 0x7f27300ceef0 2024-09-17T05:45:18.127 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:18.124+0000 7f2734ccc640 1 -- 172.21.15.150:0/2997490789 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f27300b4f20 con 0x7f27300ceef0 2024-09-17T05:45:18.127 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:18.125+0000 7f271effd640 1 -- 172.21.15.150:0/2997490789 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2720035040 con 0x7f27300ceef0 2024-09-17T05:45:18.127 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:18.125+0000 7f2734ccc640 1 -- 172.21.15.150:0/2997490789 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f273014ff30 con 0x7f27300ceef0 2024-09-17T05:45:18.127 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:18.126+0000 7f2734ccc640 1 -- 172.21.15.150:0/2997490789 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f27300cfa70 con 0x7f27300ceef0 2024-09-17T05:45:18.128 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:18.127+0000 7f271effd640 1 -- 172.21.15.150:0/2997490789 <== mon.1 v2:172.21.15.176:3300/0 4 ==== mgrmap(e 15) ==== 102257+0+0 (secure 0 0 0) 0x7f2720041030 con 0x7f27300ceef0 2024-09-17T05:45:18.128 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:18.128+0000 7f271effd640 1 --2- 172.21.15.150:0/2997490789 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f27100794c0 0x7f271007b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:45:18.129 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:18.128+0000 7f271effd640 1 -- 172.21.15.150:0/2997490789 <== mon.1 v2:172.21.15.176:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 5767+0+0 (secure 0 0 0) 0x7f27200b9a50 con 0x7f27300ceef0 2024-09-17T05:45:18.129 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:18.128+0000 7f272dd9b640 1 --2- 172.21.15.150:0/2997490789 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f27100794c0 0x7f271007b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:45:18.131 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:18.130+0000 7f272dd9b640 1 --2- 172.21.15.150:0/2997490789 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f27100794c0 0x7f271007b9d0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f27300b8460 tx=0x7f2724005f90 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:45:18.137 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:18.136+0000 7f271effd640 1 -- 172.21.15.150:0/2997490789 <== mon.1 v2:172.21.15.176:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f2720083210 con 0x7f27300ceef0 2024-09-17T05:45:18.335 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:18.334+0000 7f2734ccc640 1 -- 172.21.15.150:0/2997490789 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f273006cfa0 con 0x7f27300ceef0 2024-09-17T05:45:18.336 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:18.336+0000 7f271effd640 1 -- 172.21.15.150:0/2997490789 <== mon.1 v2:172.21.15.176:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v47) ==== 74+0+16860 (secure 0 0 0) 0x7f2720087c40 con 0x7f27300ceef0 2024-09-17T05:45:18.337 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-09-17T05:45:18.337 INFO:teuthology.orchestra.run.smithi150.stdout:{"epoch":47,"fsid":"9f2e05e9-d629-47b3-b26b-1360655b7d20","created":"2024-09-17T05:41:32.502979+0000","modified":"2024-09-17T05:44:38.517595+0000","last_up_change":"2024-09-17T05:41:46.150225+0000","last_in_change":"2024-09-17T05:41:36.120274+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T05:41:46.860779+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2024-09-17T05:43:59.949433+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"44","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_data","create_time":"2024-09-17T05:44:01.270712+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"45","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"4f31c018-c8a4-4d6d-b0c2-a597c47aae4a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6800","nonce":479374392},{"type":"v1","addr":"172.21.15.150:6801","nonce":479374392}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6802","nonce":479374392},{"type":"v1","addr":"172.21.15.150:6803","nonce":479374392}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6806","nonce":479374392},{"type":"v1","addr":"172.21.15.150:6807","nonce":479374392}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6804","nonce":479374392},{"type":"v1","addr":"172.21.15.150:6805","nonce":479374392}]},"public_addr":"172.21.15.150:6801/479374392","cluster_addr":"172.21.15.150:6803/479374392","heartbeat_back_addr":"172.21.15.150:6807/479374392","heartbeat_front_addr":"172.21.15.150:6805/479374392","state":["exists","up"]},{"osd":1,"uuid":"6ff4a573-500b-4e04-9de3-39265ead78b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6824","nonce":913899800},{"type":"v1","addr":"172.21.15.150:6825","nonce":913899800}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6826","nonce":913899800},{"type":"v1","addr":"172.21.15.150:6827","nonce":913899800}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6830","nonce":913899800},{"type":"v1","addr":"172.21.15.150:6831","nonce":913899800}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6828","nonce":913899800},{"type":"v1","addr":"172.21.15.150:6829","nonce":913899800}]},"public_addr":"172.21.15.150:6825/913899800","cluster_addr":"172.21.15.150:6827/913899800","heartbeat_back_addr":"172.21.15.150:6831/913899800","heartbeat_front_addr":"172.21.15.150:6829/913899800","state":["exists","up"]},{"osd":2,"uuid":"bffea6f9-2465-4182-b205-00436c41ac1c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6816","nonce":363718461},{"type":"v1","addr":"172.21.15.150:6817","nonce":363718461}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6818","nonce":363718461},{"type":"v1","addr":"172.21.15.150:6819","nonce":363718461}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6822","nonce":363718461},{"type":"v1","addr":"172.21.15.150:6823","nonce":363718461}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6820","nonce":363718461},{"type":"v1","addr":"172.21.15.150:6821","nonce":363718461}]},"public_addr":"172.21.15.150:6817/363718461","cluster_addr":"172.21.15.150:6819/363718461","heartbeat_back_addr":"172.21.15.150:6823/363718461","heartbeat_front_addr":"172.21.15.150:6821/363718461","state":["exists","up"]},{"osd":3,"uuid":"cda70430-d1e1-427e-b04e-56db4031d078","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6808","nonce":3550994626},{"type":"v1","addr":"172.21.15.150:6809","nonce":3550994626}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6810","nonce":3550994626},{"type":"v1","addr":"172.21.15.150:6811","nonce":3550994626}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6814","nonce":3550994626},{"type":"v1","addr":"172.21.15.150:6815","nonce":3550994626}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6812","nonce":3550994626},{"type":"v1","addr":"172.21.15.150:6813","nonce":3550994626}]},"public_addr":"172.21.15.150:6809/3550994626","cluster_addr":"172.21.15.150:6811/3550994626","heartbeat_back_addr":"172.21.15.150:6815/3550994626","heartbeat_front_addr":"172.21.15.150:6813/3550994626","state":["exists","up"]},{"osd":4,"uuid":"3a0277fb-5e1e-4f68-bb2d-9a8a0152f64a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6810","nonce":2718261497},{"type":"v1","addr":"172.21.15.176:6811","nonce":2718261497}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6812","nonce":2718261497},{"type":"v1","addr":"172.21.15.176:6813","nonce":2718261497}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6816","nonce":2718261497},{"type":"v1","addr":"172.21.15.176:6817","nonce":2718261497}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6814","nonce":2718261497},{"type":"v1","addr":"172.21.15.176:6815","nonce":2718261497}]},"public_addr":"172.21.15.176:6811/2718261497","cluster_addr":"172.21.15.176:6813/2718261497","heartbeat_back_addr":"172.21.15.176:6817/2718261497","heartbeat_front_addr":"172.21.15.176:6815/2718261497","state":["exists","up"]},{"osd":5,"uuid":"33aebee6-0315-40b7-a11c-6702f0be494d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6818","nonce":2049295774},{"type":"v1","addr":"172.21.15.176:6819","nonce":2049295774}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6820","nonce":2049295774},{"type":"v1","addr":"172.21.15.176:6821","nonce":2049295774}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6824","nonce":2049295774},{"type":"v1","addr":"172.21.15.176:6825","nonce":2049295774}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6822","nonce":2049295774},{"type":"v1","addr":"172.21.15.176:6823","nonce":2049295774}]},"public_addr":"172.21.15.176:6819/2049295774","cluster_addr":"172.21.15.176:6821/2049295774","heartbeat_back_addr":"172.21.15.176:6825/2049295774","heartbeat_front_addr":"172.21.15.176:6823/2049295774","state":["exists","up"]},{"osd":6,"uuid":"4d24f360-6751-4263-841b-d77793d33540","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6826","nonce":2164458476},{"type":"v1","addr":"172.21.15.176:6827","nonce":2164458476}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6828","nonce":2164458476},{"type":"v1","addr":"172.21.15.176:6829","nonce":2164458476}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6832","nonce":2164458476},{"type":"v1","addr":"172.21.15.176:6833","nonce":2164458476}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6830","nonce":2164458476},{"type":"v1","addr":"172.21.15.176:6831","nonce":2164458476}]},"public_addr":"172.21.15.176:6827/2164458476","cluster_addr":"172.21.15.176:6829/2164458476","heartbeat_back_addr":"172.21.15.176:6833/2164458476","heartbeat_front_addr":"172.21.15.176:6831/2164458476","state":["exists","up"]},{"osd":7,"uuid":"c8594fda-c74a-4ba9-8277-caf101d58ca1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6802","nonce":3239587708},{"type":"v1","addr":"172.21.15.176:6803","nonce":3239587708}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6804","nonce":3239587708},{"type":"v1","addr":"172.21.15.176:6805","nonce":3239587708}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6808","nonce":3239587708},{"type":"v1","addr":"172.21.15.176:6809","nonce":3239587708}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6806","nonce":3239587708},{"type":"v1","addr":"172.21.15.176:6807","nonce":3239587708}]},"public_addr":"172.21.15.176:6803/3239587708","cluster_addr":"172.21.15.176:6805/3239587708","heartbeat_back_addr":"172.21.15.176:6809/3239587708","heartbeat_front_addr":"172.21.15.176:6807/3239587708","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:41:41.905151+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:41:42.705679+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:41:42.459673+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:41:42.440819+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:41:42.668428+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:41:42.694972+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:41:43.078535+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:41:42.363539+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"7.9","mappings":[{"from":0,"to":5}]},{"pgid":"7.12","mappings":[{"from":0,"to":4}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T05:45:18.339 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:18.338+0000 7f2734ccc640 1 -- 172.21.15.150:0/2997490789 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f27100794c0 msgr2=0x7f271007b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:45:18.339 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:18.338+0000 7f2734ccc640 1 --2- 172.21.15.150:0/2997490789 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f27100794c0 0x7f271007b9d0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f27300b8460 tx=0x7f2724005f90 comp rx=0 tx=0).stop 2024-09-17T05:45:18.339 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:18.338+0000 7f2734ccc640 1 -- 172.21.15.150:0/2997490789 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f27300ceef0 msgr2=0x7f27300b6730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:45:18.339 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:18.338+0000 7f2734ccc640 1 --2- 172.21.15.150:0/2997490789 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f27300ceef0 0x7f27300b6730 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f2720000c00 tx=0x7f2720003820 comp rx=0 tx=0).stop 2024-09-17T05:45:18.339 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:18.338+0000 7f2734ccc640 1 -- 172.21.15.150:0/2997490789 shutdown_connections 2024-09-17T05:45:18.339 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:18.338+0000 7f2734ccc640 1 --2- 172.21.15.150:0/2997490789 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f27100794c0 0x7f271007b9d0 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:18.339 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:18.338+0000 7f2734ccc640 1 --2- 172.21.15.150:0/2997490789 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f273015ef40 0x7f273015b770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:18.340 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:18.338+0000 7f2734ccc640 1 --2- 172.21.15.150:0/2997490789 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f27300d35e0 0x7f273015b230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:18.340 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:18.338+0000 7f2734ccc640 1 --2- 172.21.15.150:0/2997490789 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f27300ceef0 0x7f27300b6730 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:18.340 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:18.338+0000 7f2734ccc640 1 -- 172.21.15.150:0/2997490789 >> 172.21.15.150:0/2997490789 conn(0x7f273006df90 msgr2=0x7f27300b84b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:45:18.340 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:18.338+0000 7f2734ccc640 1 -- 172.21.15.150:0/2997490789 shutdown_connections 2024-09-17T05:45:18.340 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:18.338+0000 7f2734ccc640 1 -- 172.21.15.150:0/2997490789 wait complete. 2024-09-17T05:45:18.351 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-09-17T05:45:18.351 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T05:45:18.465 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:18.464+0000 7f21e5fba640 1 -- 172.21.15.150:0/2196462983 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f21c8003fd0 msgr2=0x7f21c8004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:45:18.465 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:18.464+0000 7f21e5fba640 1 --2- 172.21.15.150:0/2196462983 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f21c8003fd0 0x7f21c8004800 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7f21d4009b20 tx=0x7f21c8005830 comp rx=0 tx=0).stop 2024-09-17T05:45:18.465 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:18.464+0000 7f21dffff640 1 -- 172.21.15.150:0/2196462983 reap_dead start 2024-09-17T05:45:18.466 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:18.464+0000 7f21e5fba640 1 -- 172.21.15.150:0/2196462983 shutdown_connections 2024-09-17T05:45:18.466 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:18.464+0000 7f21e5fba640 1 -- 172.21.15.150:0/2196462983 >> 172.21.15.150:0/2196462983 conn(0x7f21e008bfe0 msgr2=0x7f21e00d4670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:45:18.466 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:18.464+0000 7f21e5fba640 1 -- 172.21.15.150:0/2196462983 shutdown_connections 2024-09-17T05:45:18.466 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:18.464+0000 7f21e5fba640 1 -- 172.21.15.150:0/2196462983 wait complete. 2024-09-17T05:45:18.467 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:18.466+0000 7f21e5fba640 1 Processor -- start 2024-09-17T05:45:18.467 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:18.466+0000 7f21e5fba640 1 -- start start 2024-09-17T05:45:18.472 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:18.467+0000 7f21e5fba640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f21c8003fd0 0x7f21e00a1bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:45:18.472 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:18.467+0000 7f21e5fba640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f21e00a0570 0x7f21e01508d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:45:18.472 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:18.467+0000 7f21e5fba640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f21e00ce610 0x7f21e014de70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:45:18.472 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:18.467+0000 7f21e5fba640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f21e00b7640 con 0x7f21e00ce610 2024-09-17T05:45:18.473 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:18.467+0000 7f21e5fba640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f21e00b74c0 con 0x7f21c8003fd0 2024-09-17T05:45:18.473 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:18.467+0000 7f21e5fba640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f21e00b77c0 con 0x7f21e00a0570 2024-09-17T05:45:18.473 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:18.467+0000 7f21dffff640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f21e00ce610 0x7f21e014de70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:45:18.473 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:18.467+0000 7f21dffff640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f21e00ce610 0x7f21e014de70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:50902/0 (socket says 172.21.15.150:50902) 2024-09-17T05:45:18.473 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:18.467+0000 7f21dffff640 1 -- 172.21.15.150:0/817556227 learned_addr learned my addr 172.21.15.150:0/817556227 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:45:18.473 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:18.468+0000 7f21deffd640 1 --2- 172.21.15.150:0/817556227 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f21e00a0570 0x7f21e01508d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:45:18.474 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:18.468+0000 7f21df7fe640 1 --2- 172.21.15.150:0/817556227 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f21c8003fd0 0x7f21e00a1bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:45:18.474 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:18.468+0000 7f21dffff640 1 -- 172.21.15.150:0/817556227 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f21e00a0570 msgr2=0x7f21e01508d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:45:18.474 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:18.468+0000 7f21dffff640 1 --2- 172.21.15.150:0/817556227 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f21e00a0570 0x7f21e01508d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:18.474 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:18.468+0000 7f21dffff640 1 -- 172.21.15.150:0/817556227 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f21c8003fd0 msgr2=0x7f21e00a1bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:45:18.474 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:18.468+0000 7f21dffff640 1 --2- 172.21.15.150:0/817556227 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f21c8003fd0 0x7f21e00a1bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:18.475 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:18.468+0000 7f21dffff640 1 -- 172.21.15.150:0/817556227 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f21e0150e10 con 0x7f21e00ce610 2024-09-17T05:45:18.475 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:18.468+0000 7f21df7fe640 1 --2- 172.21.15.150:0/817556227 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f21c8003fd0 0x7f21e00a1bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:45:18.475 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:18.468+0000 7f21dffff640 1 --2- 172.21.15.150:0/817556227 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f21e00ce610 0x7f21e014de70 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7f21e008d0c0 tx=0x7f21d8006720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:45:18.475 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:18.468+0000 7f21c7fff640 1 -- 172.21.15.150:0/817556227 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21d800fa00 con 0x7f21e00ce610 2024-09-17T05:45:18.475 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:18.468+0000 7f21c7fff640 1 -- 172.21.15.150:0/817556227 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f21d800fba0 con 0x7f21e00ce610 2024-09-17T05:45:18.475 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:18.468+0000 7f21c7fff640 1 -- 172.21.15.150:0/817556227 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21d8011430 con 0x7f21e00ce610 2024-09-17T05:45:18.476 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:18.468+0000 7f21e5fba640 1 -- 172.21.15.150:0/817556227 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f21e00a0b10 con 0x7f21e00ce610 2024-09-17T05:45:18.476 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:18.468+0000 7f21e5fba640 1 -- 172.21.15.150:0/817556227 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f21e00a10d0 con 0x7f21e00ce610 2024-09-17T05:45:18.476 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:18.469+0000 7f21e5fba640 1 -- 172.21.15.150:0/817556227 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f21e00d0400 con 0x7f21e00ce610 2024-09-17T05:45:18.476 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:18.470+0000 7f21c7fff640 1 -- 172.21.15.150:0/817556227 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 15) ==== 102257+0+0 (secure 0 0 0) 0x7f21d80115d0 con 0x7f21e00ce610 2024-09-17T05:45:18.476 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:18.470+0000 7f21c7fff640 1 --2- 172.21.15.150:0/817556227 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f21cc079490 0x7f21cc07b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:45:18.476 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:18.471+0000 7f21c7fff640 1 -- 172.21.15.150:0/817556227 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 5767+0+0 (secure 0 0 0) 0x7f21d8099e60 con 0x7f21e00ce610 2024-09-17T05:45:18.477 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:18.471+0000 7f21df7fe640 1 --2- 172.21.15.150:0/817556227 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f21cc079490 0x7f21cc07b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:45:18.477 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:18.471+0000 7f21df7fe640 1 --2- 172.21.15.150:0/817556227 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f21cc079490 0x7f21cc07b9a0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f21d0005eb0 tx=0x7f21d0005f90 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:45:18.477 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:18.475+0000 7f21c7fff640 1 -- 172.21.15.150:0/817556227 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f21d8063de0 con 0x7f21e00ce610 2024-09-17T05:45:18.686 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:18.686+0000 7f21e5fba640 1 -- 172.21.15.150:0/817556227 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f21e00d2d60 con 0x7f21e00ce610 2024-09-17T05:45:18.687 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:18.686+0000 7f21c7fff640 1 -- 172.21.15.150:0/817556227 <== mon.0 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) ==== 94+0+5235 (secure 0 0 0) 0x7f21d80636e0 con 0x7f21e00ce610 2024-09-17T05:45:18.687 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-09-17T05:45:18.687 INFO:teuthology.orchestra.run.smithi150.stdout:{"epoch":26,"btime":"2024-09-17T05:44:15:201423+0000","default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5278,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6836/1460864883","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6834","nonce":1460864883},{"type":"v1","addr":"172.21.15.176:6836","nonce":1460864883}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":20},{"gid":5281,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6837/3149402402","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6835","nonce":3149402402},{"type":"v1","addr":"172.21.15.176:6837","nonce":3149402402}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":20},{"gid":5469,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6833/3082315470","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6832","nonce":3082315470},{"type":"v1","addr":"172.21.15.150:6833","nonce":3082315470}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":19}],"filesystems":[{"mdsmap":{"epoch":25,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T05:44:02.308071+0000","modified":"2024-09-17T05:44:05.353165+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5472},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5472":{"gid":5472,"name":"c","rank":0,"incarnation":21,"state":"up:active","state_seq":3,"addr":"172.21.15.150:6835/1137907102","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6834","nonce":1137907102},{"type":"v1","addr":"172.21.15.150:6835","nonce":1137907102}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5472,"qdb_cluster":[5472]},"id":3}]} 2024-09-17T05:45:18.687 INFO:teuthology.orchestra.run.smithi150.stderr:dumped fsmap epoch 26 2024-09-17T05:45:18.689 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:18.689+0000 7f21e5fba640 1 -- 172.21.15.150:0/817556227 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f21cc079490 msgr2=0x7f21cc07b9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:45:18.690 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:18.689+0000 7f21e5fba640 1 --2- 172.21.15.150:0/817556227 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f21cc079490 0x7f21cc07b9a0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f21d0005eb0 tx=0x7f21d0005f90 comp rx=0 tx=0).stop 2024-09-17T05:45:18.690 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:18.689+0000 7f21e5fba640 1 -- 172.21.15.150:0/817556227 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f21e00ce610 msgr2=0x7f21e014de70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:45:18.690 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:18.689+0000 7f21e5fba640 1 --2- 172.21.15.150:0/817556227 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f21e00ce610 0x7f21e014de70 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7f21e008d0c0 tx=0x7f21d8006720 comp rx=0 tx=0).stop 2024-09-17T05:45:18.690 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:18.689+0000 7f21e5fba640 1 -- 172.21.15.150:0/817556227 shutdown_connections 2024-09-17T05:45:18.690 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:18.689+0000 7f21e5fba640 1 --2- 172.21.15.150:0/817556227 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f21cc079490 0x7f21cc07b9a0 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:18.690 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:18.689+0000 7f21e5fba640 1 --2- 172.21.15.150:0/817556227 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f21e00ce610 0x7f21e014de70 unknown :-1 s=CLOSED pgs=557 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:18.690 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:18.689+0000 7f21e5fba640 1 --2- 172.21.15.150:0/817556227 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f21e00a0570 0x7f21e01508d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:18.690 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:18.689+0000 7f21e5fba640 1 --2- 172.21.15.150:0/817556227 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f21c8003fd0 0x7f21e00a1bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:18.690 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:18.689+0000 7f21e5fba640 1 -- 172.21.15.150:0/817556227 >> 172.21.15.150:0/817556227 conn(0x7f21e008bfe0 msgr2=0x7f21e00b1220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:45:18.690 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:18.689+0000 7f21e5fba640 1 -- 172.21.15.150:0/817556227 shutdown_connections 2024-09-17T05:45:18.690 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:18.689+0000 7f21e5fba640 1 -- 172.21.15.150:0/817556227 wait complete. 2024-09-17T05:45:18.701 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T05:45:18.814 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:18.813+0000 7fa23cc2e640 1 -- 172.21.15.150:0/3663752208 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa2380b5ff0 msgr2=0x7fa2380b67a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:45:18.814 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:18.813+0000 7fa23cc2e640 1 --2- 172.21.15.150:0/3663752208 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa2380b5ff0 0x7fa2380b67a0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fa228005fd0 tx=0x7fa22802a5d0 comp rx=0 tx=0).stop 2024-09-17T05:45:18.814 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:18.813+0000 7fa23cc2e640 1 -- 172.21.15.150:0/3663752208 shutdown_connections 2024-09-17T05:45:18.814 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:18.813+0000 7fa23cc2e640 1 --2- 172.21.15.150:0/3663752208 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa2380b4460 0x7fa2380b4870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:18.814 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:18.813+0000 7fa23cc2e640 1 --2- 172.21.15.150:0/3663752208 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa2380b5ff0 0x7fa2380b67a0 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:18.815 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:18.813+0000 7fa23cc2e640 1 -- 172.21.15.150:0/3663752208 >> 172.21.15.150:0/3663752208 conn(0x7fa2380b2e80 msgr2=0x7fa2380b3290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:45:18.815 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:18.813+0000 7fa23cc2e640 1 -- 172.21.15.150:0/3663752208 shutdown_connections 2024-09-17T05:45:18.815 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:18.813+0000 7fa23cc2e640 1 -- 172.21.15.150:0/3663752208 wait complete. 2024-09-17T05:45:18.816 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:18.815+0000 7fa23cc2e640 1 Processor -- start 2024-09-17T05:45:18.816 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:18.815+0000 7fa23cc2e640 1 -- start start 2024-09-17T05:45:18.818 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:18.817+0000 7fa23cc2e640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa2380b4460 0x7fa23809ed10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:45:18.818 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:18.817+0000 7fa23cc2e640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa2380b5ff0 0x7fa23809dd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:45:18.818 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:18.817+0000 7fa23cc2e640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa2380cda20 0x7fa2380b1d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:45:18.818 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:18.817+0000 7fa23cc2e640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7fa2380b4f30 con 0x7fa2380b4460 2024-09-17T05:45:18.819 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:18.817+0000 7fa23cc2e640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fa2380b4db0 con 0x7fa2380cda20 2024-09-17T05:45:18.819 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:18.817+0000 7fa23cc2e640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fa2380b50b0 con 0x7fa2380b5ff0 2024-09-17T05:45:18.819 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:18.817+0000 7fa23659c640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa2380b4460 0x7fa23809ed10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:45:18.819 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:18.817+0000 7fa23659c640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa2380b4460 0x7fa23809ed10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:50914/0 (socket says 172.21.15.150:50914) 2024-09-17T05:45:18.819 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:18.817+0000 7fa23659c640 1 -- 172.21.15.150:0/2795569368 learned_addr learned my addr 172.21.15.150:0/2795569368 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:45:18.819 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:18.817+0000 7fa236d9d640 1 --2- 172.21.15.150:0/2795569368 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa2380cda20 0x7fa2380b1d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:45:18.819 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:18.817+0000 7fa22dd9b640 1 --2- 172.21.15.150:0/2795569368 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa2380b5ff0 0x7fa23809dd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:45:18.819 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:18.817+0000 7fa23659c640 1 -- 172.21.15.150:0/2795569368 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa2380b5ff0 msgr2=0x7fa23809dd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:45:18.819 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:18.817+0000 7fa23659c640 1 --2- 172.21.15.150:0/2795569368 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa2380b5ff0 0x7fa23809dd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:18.819 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:18.817+0000 7fa23659c640 1 -- 172.21.15.150:0/2795569368 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa2380cda20 msgr2=0x7fa2380b1d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:45:18.819 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:18.817+0000 7fa23659c640 1 --2- 172.21.15.150:0/2795569368 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa2380cda20 0x7fa2380b1d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:18.819 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:18.817+0000 7fa23659c640 1 -- 172.21.15.150:0/2795569368 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa23809f250 con 0x7fa2380b4460 2024-09-17T05:45:18.819 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:18.817+0000 7fa23659c640 1 --2- 172.21.15.150:0/2795569368 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa2380b4460 0x7fa23809ed10 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7fa228006010 tx=0x7fa2280035f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:45:18.820 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:18.817+0000 7fa22f7fe640 1 -- 172.21.15.150:0/2795569368 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa22803e030 con 0x7fa2380b4460 2024-09-17T05:45:18.820 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:18.818+0000 7fa23cc2e640 1 -- 172.21.15.150:0/2795569368 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa2381f2e70 con 0x7fa2380b4460 2024-09-17T05:45:18.820 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:18.818+0000 7fa22f7fe640 1 -- 172.21.15.150:0/2795569368 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa228003ae0 con 0x7fa2380b4460 2024-09-17T05:45:18.820 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:18.818+0000 7fa22f7fe640 1 -- 172.21.15.150:0/2795569368 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa228035040 con 0x7fa2380b4460 2024-09-17T05:45:18.820 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:18.818+0000 7fa23cc2e640 1 -- 172.21.15.150:0/2795569368 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa2381f3430 con 0x7fa2380b4460 2024-09-17T05:45:18.821 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:18.819+0000 7fa23cc2e640 1 -- 172.21.15.150:0/2795569368 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa2380b5580 con 0x7fa2380b4460 2024-09-17T05:45:18.821 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:18.819+0000 7fa22f7fe640 1 -- 172.21.15.150:0/2795569368 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 15) ==== 102257+0+0 (secure 0 0 0) 0x7fa228041030 con 0x7fa2380b4460 2024-09-17T05:45:18.821 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:18.820+0000 7fa22f7fe640 1 --2- 172.21.15.150:0/2795569368 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fa218079490 0x7fa21807b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:45:18.821 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:18.820+0000 7fa22f7fe640 1 -- 172.21.15.150:0/2795569368 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 5767+0+0 (secure 0 0 0) 0x7fa2280b9980 con 0x7fa2380b4460 2024-09-17T05:45:18.821 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:18.820+0000 7fa22dd9b640 1 --2- 172.21.15.150:0/2795569368 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fa218079490 0x7fa21807b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:45:18.821 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:18.821+0000 7fa22dd9b640 1 --2- 172.21.15.150:0/2795569368 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fa218079490 0x7fa21807b9a0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fa23815b130 tx=0x7fa220009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:45:18.826 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:18.825+0000 7fa22f7fe640 1 -- 172.21.15.150:0/2795569368 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fa228083230 con 0x7fa2380b4460 2024-09-17T05:45:19.039 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:19.039+0000 7fa23cc2e640 1 -- 172.21.15.150:0/2795569368 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fa2380b59a0 con 0x7fa2380b4460 2024-09-17T05:45:19.040 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:19.039+0000 7fa22f7fe640 1 -- 172.21.15.150:0/2795569368 <== mon.0 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) ==== 94+0+5235 (secure 0 0 0) 0x7fa228087c60 con 0x7fa2380b4460 2024-09-17T05:45:19.040 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-09-17T05:45:19.040 INFO:teuthology.orchestra.run.smithi150.stdout:{"epoch":26,"btime":"2024-09-17T05:44:15:201423+0000","default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5278,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6836/1460864883","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6834","nonce":1460864883},{"type":"v1","addr":"172.21.15.176:6836","nonce":1460864883}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":20},{"gid":5281,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6837/3149402402","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6835","nonce":3149402402},{"type":"v1","addr":"172.21.15.176:6837","nonce":3149402402}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":20},{"gid":5469,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6833/3082315470","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6832","nonce":3082315470},{"type":"v1","addr":"172.21.15.150:6833","nonce":3082315470}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":19}],"filesystems":[{"mdsmap":{"epoch":25,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T05:44:02.308071+0000","modified":"2024-09-17T05:44:05.353165+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5472},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5472":{"gid":5472,"name":"c","rank":0,"incarnation":21,"state":"up:active","state_seq":3,"addr":"172.21.15.150:6835/1137907102","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6834","nonce":1137907102},{"type":"v1","addr":"172.21.15.150:6835","nonce":1137907102}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5472,"qdb_cluster":[5472]},"id":3}]} 2024-09-17T05:45:19.041 INFO:teuthology.orchestra.run.smithi150.stderr:dumped fsmap epoch 26 2024-09-17T05:45:19.043 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:19.042+0000 7fa23cc2e640 1 -- 172.21.15.150:0/2795569368 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fa218079490 msgr2=0x7fa21807b9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:45:19.043 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:19.042+0000 7fa23cc2e640 1 --2- 172.21.15.150:0/2795569368 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fa218079490 0x7fa21807b9a0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fa23815b130 tx=0x7fa220009040 comp rx=0 tx=0).stop 2024-09-17T05:45:19.043 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:19.042+0000 7fa23cc2e640 1 -- 172.21.15.150:0/2795569368 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa2380b4460 msgr2=0x7fa23809ed10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:45:19.043 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:19.042+0000 7fa23cc2e640 1 --2- 172.21.15.150:0/2795569368 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa2380b4460 0x7fa23809ed10 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7fa228006010 tx=0x7fa2280035f0 comp rx=0 tx=0).stop 2024-09-17T05:45:19.043 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:19.042+0000 7fa23cc2e640 1 -- 172.21.15.150:0/2795569368 shutdown_connections 2024-09-17T05:45:19.043 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:19.042+0000 7fa23cc2e640 1 --2- 172.21.15.150:0/2795569368 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa2380cda20 0x7fa2380b1d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:19.043 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:19.042+0000 7fa23cc2e640 1 --2- 172.21.15.150:0/2795569368 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fa218079490 0x7fa21807b9a0 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:19.043 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:19.042+0000 7fa23cc2e640 1 --2- 172.21.15.150:0/2795569368 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa2380b5ff0 0x7fa23809dd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:19.043 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:19.042+0000 7fa23cc2e640 1 --2- 172.21.15.150:0/2795569368 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa2380b4460 0x7fa23809ed10 unknown :-1 s=CLOSED pgs=558 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:19.043 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:19.042+0000 7fa23cc2e640 1 -- 172.21.15.150:0/2795569368 >> 172.21.15.150:0/2795569368 conn(0x7fa2380b2e80 msgr2=0x7fa2380d1370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:45:19.043 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:19.042+0000 7fa23cc2e640 1 -- 172.21.15.150:0/2795569368 shutdown_connections 2024-09-17T05:45:19.043 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:19.042+0000 7fa23cc2e640 1 -- 172.21.15.150:0/2795569368 wait complete. 2024-09-17T05:45:19.054 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T05:45:19.168 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:19.167+0000 7fda43be6640 1 -- 172.21.15.150:0/3039340387 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fda24004800 msgr2=0x7fda24004c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:45:19.168 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:19.167+0000 7fda43be6640 1 --2- 172.21.15.150:0/3039340387 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fda24004800 0x7fda24004c10 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7fda3c071170 tx=0x7fda24005830 comp rx=0 tx=0).stop 2024-09-17T05:45:19.168 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:19.167+0000 7fda42183640 1 -- 172.21.15.150:0/3039340387 reap_dead start 2024-09-17T05:45:19.168 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:19.167+0000 7fda43be6640 1 -- 172.21.15.150:0/3039340387 shutdown_connections 2024-09-17T05:45:19.168 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:19.167+0000 7fda43be6640 1 -- 172.21.15.150:0/3039340387 >> 172.21.15.150:0/3039340387 conn(0x7fda3c0b3fc0 msgr2=0x7fda3c0b43d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:45:19.168 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:19.167+0000 7fda43be6640 1 -- 172.21.15.150:0/3039340387 shutdown_connections 2024-09-17T05:45:19.168 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:19.167+0000 7fda43be6640 1 -- 172.21.15.150:0/3039340387 wait complete. 2024-09-17T05:45:19.169 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:19.169+0000 7fda43be6640 1 Processor -- start 2024-09-17T05:45:19.169 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:19.169+0000 7fda43be6640 1 -- start start 2024-09-17T05:45:19.172 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:19.170+0000 7fda43be6640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fda24004800 0x7fda3c1f97c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:45:19.172 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:19.170+0000 7fda43be6640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fda3c1e6ce0 0x7fda3c1e7dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:45:19.172 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:19.170+0000 7fda43be6640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fda3c1e5730 0x7fda3c0b0170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:45:19.172 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:19.170+0000 7fda43be6640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7fda3c0d0010 con 0x7fda3c1e6ce0 2024-09-17T05:45:19.172 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:19.170+0000 7fda43be6640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fda3c070b60 con 0x7fda3c1e5730 2024-09-17T05:45:19.173 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:19.170+0000 7fda43be6640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fda3c0d0190 con 0x7fda24004800 2024-09-17T05:45:19.173 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:19.170+0000 7fda41181640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fda3c1e6ce0 0x7fda3c1e7dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:45:19.173 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:19.170+0000 7fda41181640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fda3c1e6ce0 0x7fda3c1e7dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:50930/0 (socket says 172.21.15.150:50930) 2024-09-17T05:45:19.173 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:19.170+0000 7fda41181640 1 -- 172.21.15.150:0/2389496492 learned_addr learned my addr 172.21.15.150:0/2389496492 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:45:19.173 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:19.170+0000 7fda41982640 1 --2- 172.21.15.150:0/2389496492 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fda24004800 0x7fda3c1f97c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:45:19.173 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:19.170+0000 7fda42183640 1 --2- 172.21.15.150:0/2389496492 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fda3c1e5730 0x7fda3c0b0170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:45:19.173 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:19.171+0000 7fda41181640 1 -- 172.21.15.150:0/2389496492 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fda24004800 msgr2=0x7fda3c1f97c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:45:19.173 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:19.171+0000 7fda41181640 1 --2- 172.21.15.150:0/2389496492 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fda24004800 0x7fda3c1f97c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:19.173 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:19.171+0000 7fda41181640 1 -- 172.21.15.150:0/2389496492 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fda3c1e5730 msgr2=0x7fda3c0b0170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:45:19.173 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:19.171+0000 7fda41181640 1 --2- 172.21.15.150:0/2389496492 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fda3c1e5730 0x7fda3c0b0170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:19.173 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:19.171+0000 7fda41181640 1 -- 172.21.15.150:0/2389496492 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fda3c1f9d00 con 0x7fda3c1e6ce0 2024-09-17T05:45:19.173 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:19.171+0000 7fda41181640 1 --2- 172.21.15.150:0/2389496492 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fda3c1e6ce0 0x7fda3c1e7dd0 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7fda3000c320 tx=0x7fda30006ca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:45:19.174 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:19.171+0000 7fda3a7fc640 1 -- 172.21.15.150:0/2389496492 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda30031040 con 0x7fda3c1e6ce0 2024-09-17T05:45:19.174 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:19.171+0000 7fda3a7fc640 1 -- 172.21.15.150:0/2389496492 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fda300035f0 con 0x7fda3c1e6ce0 2024-09-17T05:45:19.174 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:19.171+0000 7fda43be6640 1 -- 172.21.15.150:0/2389496492 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fda3c06fb00 con 0x7fda3c1e6ce0 2024-09-17T05:45:19.174 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:19.171+0000 7fda3a7fc640 1 -- 172.21.15.150:0/2389496492 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda300039c0 con 0x7fda3c1e6ce0 2024-09-17T05:45:19.174 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:19.171+0000 7fda43be6640 1 -- 172.21.15.150:0/2389496492 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fda3c1f8fc0 con 0x7fda3c1e6ce0 2024-09-17T05:45:19.175 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:19.172+0000 7fda43be6640 1 -- 172.21.15.150:0/2389496492 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fda3c0c5900 con 0x7fda3c1e6ce0 2024-09-17T05:45:19.175 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:19.173+0000 7fda3a7fc640 1 -- 172.21.15.150:0/2389496492 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 15) ==== 102257+0+0 (secure 0 0 0) 0x7fda30034070 con 0x7fda3c1e6ce0 2024-09-17T05:45:19.175 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:19.173+0000 7fda3a7fc640 1 --2- 172.21.15.150:0/2389496492 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fda28079490 0x7fda2807b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:45:19.175 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:19.173+0000 7fda3a7fc640 1 -- 172.21.15.150:0/2389496492 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(48..48 src has 1..48) ==== 5823+0+0 (secure 0 0 0) 0x7fda300b93b0 con 0x7fda3c1e6ce0 2024-09-17T05:45:19.175 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:19.173+0000 7fda41982640 1 --2- 172.21.15.150:0/2389496492 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fda28079490 0x7fda2807b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:45:19.175 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:19.174+0000 7fda41982640 1 --2- 172.21.15.150:0/2389496492 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fda28079490 0x7fda2807b9a0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fda3c0711a0 tx=0x7fda2c009620 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:45:19.178 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:19.178+0000 7fda3a7fc640 1 -- 172.21.15.150:0/2389496492 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fda3c0c5900 con 0x7fda3c1e6ce0 2024-09-17T05:45:19.358 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:19.357+0000 7fda43be6640 1 -- 172.21.15.150:0/2389496492 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fda3c06fd90 con 0x7fda3c1e6ce0 2024-09-17T05:45:19.359 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:19.359+0000 7fda3a7fc640 1 -- 172.21.15.150:0/2389496492 <== mon.0 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v48) ==== 74+0+16968 (secure 0 0 0) 0x7fda30083330 con 0x7fda3c1e6ce0 2024-09-17T05:45:19.359 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-09-17T05:45:19.359 INFO:teuthology.orchestra.run.smithi150.stdout:{"epoch":48,"fsid":"9f2e05e9-d629-47b3-b26b-1360655b7d20","created":"2024-09-17T05:41:32.502979+0000","modified":"2024-09-17T05:45:18.899877+0000","last_up_change":"2024-09-17T05:41:46.150225+0000","last_in_change":"2024-09-17T05:41:36.120274+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T05:41:46.860779+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2024-09-17T05:43:59.949433+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"44","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_data","create_time":"2024-09-17T05:44:01.270712+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"48","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":3,"snap_epoch":48,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"4f31c018-c8a4-4d6d-b0c2-a597c47aae4a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6800","nonce":479374392},{"type":"v1","addr":"172.21.15.150:6801","nonce":479374392}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6802","nonce":479374392},{"type":"v1","addr":"172.21.15.150:6803","nonce":479374392}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6806","nonce":479374392},{"type":"v1","addr":"172.21.15.150:6807","nonce":479374392}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6804","nonce":479374392},{"type":"v1","addr":"172.21.15.150:6805","nonce":479374392}]},"public_addr":"172.21.15.150:6801/479374392","cluster_addr":"172.21.15.150:6803/479374392","heartbeat_back_addr":"172.21.15.150:6807/479374392","heartbeat_front_addr":"172.21.15.150:6805/479374392","state":["exists","up"]},{"osd":1,"uuid":"6ff4a573-500b-4e04-9de3-39265ead78b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6824","nonce":913899800},{"type":"v1","addr":"172.21.15.150:6825","nonce":913899800}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6826","nonce":913899800},{"type":"v1","addr":"172.21.15.150:6827","nonce":913899800}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6830","nonce":913899800},{"type":"v1","addr":"172.21.15.150:6831","nonce":913899800}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6828","nonce":913899800},{"type":"v1","addr":"172.21.15.150:6829","nonce":913899800}]},"public_addr":"172.21.15.150:6825/913899800","cluster_addr":"172.21.15.150:6827/913899800","heartbeat_back_addr":"172.21.15.150:6831/913899800","heartbeat_front_addr":"172.21.15.150:6829/913899800","state":["exists","up"]},{"osd":2,"uuid":"bffea6f9-2465-4182-b205-00436c41ac1c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6816","nonce":363718461},{"type":"v1","addr":"172.21.15.150:6817","nonce":363718461}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6818","nonce":363718461},{"type":"v1","addr":"172.21.15.150:6819","nonce":363718461}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6822","nonce":363718461},{"type":"v1","addr":"172.21.15.150:6823","nonce":363718461}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6820","nonce":363718461},{"type":"v1","addr":"172.21.15.150:6821","nonce":363718461}]},"public_addr":"172.21.15.150:6817/363718461","cluster_addr":"172.21.15.150:6819/363718461","heartbeat_back_addr":"172.21.15.150:6823/363718461","heartbeat_front_addr":"172.21.15.150:6821/363718461","state":["exists","up"]},{"osd":3,"uuid":"cda70430-d1e1-427e-b04e-56db4031d078","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6808","nonce":3550994626},{"type":"v1","addr":"172.21.15.150:6809","nonce":3550994626}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6810","nonce":3550994626},{"type":"v1","addr":"172.21.15.150:6811","nonce":3550994626}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6814","nonce":3550994626},{"type":"v1","addr":"172.21.15.150:6815","nonce":3550994626}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6812","nonce":3550994626},{"type":"v1","addr":"172.21.15.150:6813","nonce":3550994626}]},"public_addr":"172.21.15.150:6809/3550994626","cluster_addr":"172.21.15.150:6811/3550994626","heartbeat_back_addr":"172.21.15.150:6815/3550994626","heartbeat_front_addr":"172.21.15.150:6813/3550994626","state":["exists","up"]},{"osd":4,"uuid":"3a0277fb-5e1e-4f68-bb2d-9a8a0152f64a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6810","nonce":2718261497},{"type":"v1","addr":"172.21.15.176:6811","nonce":2718261497}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6812","nonce":2718261497},{"type":"v1","addr":"172.21.15.176:6813","nonce":2718261497}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6816","nonce":2718261497},{"type":"v1","addr":"172.21.15.176:6817","nonce":2718261497}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6814","nonce":2718261497},{"type":"v1","addr":"172.21.15.176:6815","nonce":2718261497}]},"public_addr":"172.21.15.176:6811/2718261497","cluster_addr":"172.21.15.176:6813/2718261497","heartbeat_back_addr":"172.21.15.176:6817/2718261497","heartbeat_front_addr":"172.21.15.176:6815/2718261497","state":["exists","up"]},{"osd":5,"uuid":"33aebee6-0315-40b7-a11c-6702f0be494d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6818","nonce":2049295774},{"type":"v1","addr":"172.21.15.176:6819","nonce":2049295774}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6820","nonce":2049295774},{"type":"v1","addr":"172.21.15.176:6821","nonce":2049295774}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6824","nonce":2049295774},{"type":"v1","addr":"172.21.15.176:6825","nonce":2049295774}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6822","nonce":2049295774},{"type":"v1","addr":"172.21.15.176:6823","nonce":2049295774}]},"public_addr":"172.21.15.176:6819/2049295774","cluster_addr":"172.21.15.176:6821/2049295774","heartbeat_back_addr":"172.21.15.176:6825/2049295774","heartbeat_front_addr":"172.21.15.176:6823/2049295774","state":["exists","up"]},{"osd":6,"uuid":"4d24f360-6751-4263-841b-d77793d33540","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6826","nonce":2164458476},{"type":"v1","addr":"172.21.15.176:6827","nonce":2164458476}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6828","nonce":2164458476},{"type":"v1","addr":"172.21.15.176:6829","nonce":2164458476}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6832","nonce":2164458476},{"type":"v1","addr":"172.21.15.176:6833","nonce":2164458476}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6830","nonce":2164458476},{"type":"v1","addr":"172.21.15.176:6831","nonce":2164458476}]},"public_addr":"172.21.15.176:6827/2164458476","cluster_addr":"172.21.15.176:6829/2164458476","heartbeat_back_addr":"172.21.15.176:6833/2164458476","heartbeat_front_addr":"172.21.15.176:6831/2164458476","state":["exists","up"]},{"osd":7,"uuid":"c8594fda-c74a-4ba9-8277-caf101d58ca1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6802","nonce":3239587708},{"type":"v1","addr":"172.21.15.176:6803","nonce":3239587708}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6804","nonce":3239587708},{"type":"v1","addr":"172.21.15.176:6805","nonce":3239587708}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6808","nonce":3239587708},{"type":"v1","addr":"172.21.15.176:6809","nonce":3239587708}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6806","nonce":3239587708},{"type":"v1","addr":"172.21.15.176:6807","nonce":3239587708}]},"public_addr":"172.21.15.176:6803/3239587708","cluster_addr":"172.21.15.176:6805/3239587708","heartbeat_back_addr":"172.21.15.176:6809/3239587708","heartbeat_front_addr":"172.21.15.176:6807/3239587708","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:41:41.905151+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:41:42.705679+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:41:42.459673+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:41:42.440819+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:41:42.668428+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:41:42.694972+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:41:43.078535+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:41:42.363539+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"7.9","mappings":[{"from":0,"to":5}]},{"pgid":"7.12","mappings":[{"from":0,"to":4}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":7,"snaps":[{"begin":2,"length":2}]}],"new_removed_snaps":[{"pool":7,"snaps":[{"begin":2,"length":2}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T05:45:19.362 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:19.361+0000 7fda43be6640 1 -- 172.21.15.150:0/2389496492 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fda28079490 msgr2=0x7fda2807b9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:45:19.362 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:19.361+0000 7fda43be6640 1 --2- 172.21.15.150:0/2389496492 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fda28079490 0x7fda2807b9a0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fda3c0711a0 tx=0x7fda2c009620 comp rx=0 tx=0).stop 2024-09-17T05:45:19.362 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:19.361+0000 7fda43be6640 1 -- 172.21.15.150:0/2389496492 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fda3c1e6ce0 msgr2=0x7fda3c1e7dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:45:19.362 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:19.361+0000 7fda43be6640 1 --2- 172.21.15.150:0/2389496492 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fda3c1e6ce0 0x7fda3c1e7dd0 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7fda3000c320 tx=0x7fda30006ca0 comp rx=0 tx=0).stop 2024-09-17T05:45:19.362 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:19.361+0000 7fda43be6640 1 -- 172.21.15.150:0/2389496492 shutdown_connections 2024-09-17T05:45:19.362 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:19.361+0000 7fda43be6640 1 --2- 172.21.15.150:0/2389496492 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fda3c1e5730 0x7fda3c0b0170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:19.362 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:19.361+0000 7fda43be6640 1 --2- 172.21.15.150:0/2389496492 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fda28079490 0x7fda2807b9a0 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:19.362 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:19.361+0000 7fda43be6640 1 --2- 172.21.15.150:0/2389496492 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fda3c1e6ce0 0x7fda3c1e7dd0 unknown :-1 s=CLOSED pgs=561 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:19.362 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:19.361+0000 7fda43be6640 1 --2- 172.21.15.150:0/2389496492 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fda24004800 0x7fda3c1f97c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:19.362 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:19.361+0000 7fda43be6640 1 -- 172.21.15.150:0/2389496492 >> 172.21.15.150:0/2389496492 conn(0x7fda3c0b3fc0 msgr2=0x7fda3c0b1ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:45:19.362 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:19.361+0000 7fda43be6640 1 -- 172.21.15.150:0/2389496492 shutdown_connections 2024-09-17T05:45:19.362 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:19.361+0000 7fda43be6640 1 -- 172.21.15.150:0/2389496492 wait complete. 2024-09-17T05:45:19.373 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-09-17T05:45:19.489 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:19.488+0000 7f6af74c5640 1 -- 172.21.15.150:0/796448844 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6af00b5c50 msgr2=0x7f6af0167180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:45:19.489 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:19.488+0000 7f6af74c5640 1 --2- 172.21.15.150:0/796448844 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6af00b5c50 0x7f6af0167180 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7f6af0075220 tx=0x7f6ae802aa30 comp rx=0 tx=0).stop 2024-09-17T05:45:19.489 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:19.488+0000 7f6af74c5640 1 -- 172.21.15.150:0/796448844 shutdown_connections 2024-09-17T05:45:19.489 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:19.488+0000 7f6af74c5640 1 --2- 172.21.15.150:0/796448844 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6af00b5c50 0x7f6af0167180 unknown :-1 s=CLOSED pgs=562 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:19.489 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:19.488+0000 7f6af74c5640 1 --2- 172.21.15.150:0/796448844 >> v2:172.21.15.176:3300/0 conn(0x7f6af00b5300 0x7f6af00b5710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:19.489 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:19.488+0000 7f6af74c5640 1 -- 172.21.15.150:0/796448844 >> 172.21.15.150:0/796448844 conn(0x7f6af00cef30 msgr2=0x7f6af00cf340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:45:19.489 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:19.488+0000 7f6af74c5640 1 -- 172.21.15.150:0/796448844 shutdown_connections 2024-09-17T05:45:19.489 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:19.488+0000 7f6af74c5640 1 -- 172.21.15.150:0/796448844 wait complete. 2024-09-17T05:45:19.490 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:19.490+0000 7f6af74c5640 1 Processor -- start 2024-09-17T05:45:19.490 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:19.490+0000 7f6af74c5640 1 -- start start 2024-09-17T05:45:19.493 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:19.491+0000 7f6af74c5640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6af00b5300 0x7f6af01f7770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:45:19.493 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:19.491+0000 7f6af74c5640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6af00b5c50 0x7f6af01e2760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:45:19.493 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:19.491+0000 7f6af74c5640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6af00b7490 0x7f6af009e7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:45:19.493 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:19.491+0000 7f6af74c5640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f6af00d15e0 con 0x7f6af00b5300 2024-09-17T05:45:19.493 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:19.491+0000 7f6af74c5640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f6af00d1460 con 0x7f6af00b5c50 2024-09-17T05:45:19.493 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:19.491+0000 7f6af74c5640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f6af00ceb70 con 0x7f6af00b7490 2024-09-17T05:45:19.494 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:19.491+0000 7f6af5261640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6af00b5300 0x7f6af01f7770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:45:19.494 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:19.491+0000 7f6af5261640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6af00b5300 0x7f6af01f7770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:50954/0 (socket says 172.21.15.150:50954) 2024-09-17T05:45:19.494 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:19.491+0000 7f6af5261640 1 -- 172.21.15.150:0/1726592415 learned_addr learned my addr 172.21.15.150:0/1726592415 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:45:19.494 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:19.491+0000 7f6af4a60640 1 --2- 172.21.15.150:0/1726592415 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6af00b5c50 0x7f6af01e2760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:45:19.494 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:19.491+0000 7f6af5a62640 1 --2- 172.21.15.150:0/1726592415 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6af00b7490 0x7f6af009e7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:45:19.494 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:19.492+0000 7f6af5261640 1 -- 172.21.15.150:0/1726592415 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6af00b7490 msgr2=0x7f6af009e7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:45:19.494 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:19.492+0000 7f6af5261640 1 --2- 172.21.15.150:0/1726592415 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6af00b7490 0x7f6af009e7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:19.494 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:19.492+0000 7f6af5261640 1 -- 172.21.15.150:0/1726592415 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6af00b5c50 msgr2=0x7f6af01e2760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:45:19.494 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:19.492+0000 7f6af5261640 1 --2- 172.21.15.150:0/1726592415 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6af00b5c50 0x7f6af01e2760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:19.494 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:19.492+0000 7f6af5261640 1 -- 172.21.15.150:0/1726592415 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6af00c6180 con 0x7f6af00b5300 2024-09-17T05:45:19.494 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:19.492+0000 7f6af5261640 1 --2- 172.21.15.150:0/1726592415 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6af00b5300 0x7f6af01f7770 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7f6aec00b410 tx=0x7f6aec00b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:45:19.494 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:19.492+0000 7f6ae5ffb640 1 -- 172.21.15.150:0/1726592415 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6aec015020 con 0x7f6af00b5300 2024-09-17T05:45:19.494 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:19.492+0000 7f6ae5ffb640 1 -- 172.21.15.150:0/1726592415 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f6aec011920 con 0x7f6af00b5300 2024-09-17T05:45:19.495 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:19.492+0000 7f6af74c5640 1 -- 172.21.15.150:0/1726592415 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6af00c6460 con 0x7f6af00b5300 2024-09-17T05:45:19.495 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:19.492+0000 7f6ae5ffb640 1 -- 172.21.15.150:0/1726592415 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6aec011d70 con 0x7f6af00b5300 2024-09-17T05:45:19.495 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:19.492+0000 7f6af74c5640 1 -- 172.21.15.150:0/1726592415 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6af00c6e70 con 0x7f6af00b5300 2024-09-17T05:45:19.495 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:19.493+0000 7f6af74c5640 1 -- 172.21.15.150:0/1726592415 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6af00c66a0 con 0x7f6af00b5300 2024-09-17T05:45:19.496 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:19.494+0000 7f6ae5ffb640 1 -- 172.21.15.150:0/1726592415 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 15) ==== 102257+0+0 (secure 0 0 0) 0x7f6aec018020 con 0x7f6af00b5300 2024-09-17T05:45:19.496 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:19.494+0000 7f6ae5ffb640 1 --2- 172.21.15.150:0/1726592415 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f6ad4079490 0x7f6ad407b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:45:19.496 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:19.494+0000 7f6ae5ffb640 1 -- 172.21.15.150:0/1726592415 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(48..48 src has 1..48) ==== 5823+0+0 (secure 0 0 0) 0x7f6aec0991f0 con 0x7f6af00b5300 2024-09-17T05:45:19.496 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:19.494+0000 7f6af4a60640 1 --2- 172.21.15.150:0/1726592415 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f6ad4079490 0x7f6ad407b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:45:19.496 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:19.495+0000 7f6af4a60640 1 --2- 172.21.15.150:0/1726592415 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f6ad4079490 0x7f6ad407b9a0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f6af00d0600 tx=0x7f6ae000b2e0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:45:19.499 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:19.498+0000 7f6ae5ffb640 1 -- 172.21.15.150:0/1726592415 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f6af00c66a0 con 0x7f6af00b5300 2024-09-17T05:45:19.711 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:19.711+0000 7f6af74c5640 1 -- 172.21.15.150:0/1726592415 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7f6af00b6180 con 0x7f6af00b5300 2024-09-17T05:45:19.712 INFO:tasks.ceph.mon.a.smithi150.stderr:2024-09-17T05:45:19.711+0000 7f73931ae640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-17T05:45:19.713 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:19.713+0000 7f6ae5ffb640 1 -- 172.21.15.150:0/1726592415 <== mon.0 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v27) ==== 161+0+0 (secure 0 0 0) 0x7f6aec062b20 con 0x7f6af00b5300 2024-09-17T05:45:19.713 INFO:teuthology.orchestra.run.smithi150.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-09-17T05:45:19.717 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:19.717+0000 7f6af74c5640 1 -- 172.21.15.150:0/1726592415 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f6ad4079490 msgr2=0x7f6ad407b9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:45:19.717 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:19.717+0000 7f6af74c5640 1 --2- 172.21.15.150:0/1726592415 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f6ad4079490 0x7f6ad407b9a0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f6af00d0600 tx=0x7f6ae000b2e0 comp rx=0 tx=0).stop 2024-09-17T05:45:19.719 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:19.717+0000 7f6af74c5640 1 -- 172.21.15.150:0/1726592415 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6af00b5300 msgr2=0x7f6af01f7770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:45:19.719 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:19.717+0000 7f6af74c5640 1 --2- 172.21.15.150:0/1726592415 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6af00b5300 0x7f6af01f7770 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7f6aec00b410 tx=0x7f6aec00b8d0 comp rx=0 tx=0).stop 2024-09-17T05:45:19.719 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:19.717+0000 7f6af74c5640 1 -- 172.21.15.150:0/1726592415 shutdown_connections 2024-09-17T05:45:19.719 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:19.717+0000 7f6af74c5640 1 --2- 172.21.15.150:0/1726592415 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6af00b5c50 0x7f6af01e2760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:19.719 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:19.717+0000 7f6af74c5640 1 --2- 172.21.15.150:0/1726592415 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f6ad4079490 0x7f6ad407b9a0 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:19.719 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:19.717+0000 7f6af74c5640 1 --2- 172.21.15.150:0/1726592415 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6af00b7490 0x7f6af009e7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:19.719 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:19.717+0000 7f6af74c5640 1 --2- 172.21.15.150:0/1726592415 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6af00b5300 0x7f6af01f7770 unknown :-1 s=CLOSED pgs=563 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:19.719 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:19.717+0000 7f6af74c5640 1 -- 172.21.15.150:0/1726592415 >> 172.21.15.150:0/1726592415 conn(0x7f6af00cef30 msgr2=0x7f6af0071f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:45:19.719 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:19.718+0000 7f6af74c5640 1 -- 172.21.15.150:0/1726592415 shutdown_connections 2024-09-17T05:45:19.719 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:19.718+0000 7f6af74c5640 1 -- 172.21.15.150:0/1726592415 wait complete. 2024-09-17T05:45:19.731 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-09-17T05:45:19.781 INFO:tasks.ceph.mds.c.smithi150.stdout:starting mds.c at 2024-09-17T05:45:19.852 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:19.851+0000 7f2a736ce640 1 -- 172.21.15.150:0/2173865618 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2a6c15b740 msgr2=0x7f2a6c0cf550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:45:19.852 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:19.851+0000 7f2a736ce640 1 --2- 172.21.15.150:0/2173865618 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2a6c15b740 0x7f2a6c0cf550 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7f2a6c072f60 tx=0x7f2a6002a530 comp rx=0 tx=0).stop 2024-09-17T05:45:19.852 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:19.851+0000 7f2a736ce640 1 -- 172.21.15.150:0/2173865618 shutdown_connections 2024-09-17T05:45:19.852 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:19.851+0000 7f2a736ce640 1 --2- 172.21.15.150:0/2173865618 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2a6c15f230 0x7f2a6c15f640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:19.852 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:19.851+0000 7f2a736ce640 1 --2- 172.21.15.150:0/2173865618 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2a6c15b740 0x7f2a6c0cf550 unknown :-1 s=CLOSED pgs=567 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:19.852 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:19.851+0000 7f2a736ce640 1 -- 172.21.15.150:0/2173865618 >> 172.21.15.150:0/2173865618 conn(0x7f2a6c0b2400 msgr2=0x7f2a6c0b2810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:45:19.853 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:19.851+0000 7f2a736ce640 1 -- 172.21.15.150:0/2173865618 shutdown_connections 2024-09-17T05:45:19.853 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:19.851+0000 7f2a736ce640 1 -- 172.21.15.150:0/2173865618 wait complete. 2024-09-17T05:45:19.853 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:19.853+0000 7f2a736ce640 1 Processor -- start 2024-09-17T05:45:19.853 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:19.853+0000 7f2a736ce640 1 -- start start 2024-09-17T05:45:19.856 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:19.854+0000 7f2a736ce640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2a6c15b740 0x7f2a6c1496d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:45:19.856 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:19.854+0000 7f2a736ce640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2a6c15f230 0x7f2a6c1f5bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:45:19.856 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:19.854+0000 7f2a736ce640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2a6c15fb80 0x7f2a6c146d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:45:19.856 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:19.854+0000 7f2a736ce640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f2a6c0ceb10 con 0x7f2a6c15f230 2024-09-17T05:45:19.856 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:19.854+0000 7f2a736ce640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f2a6c0ce990 con 0x7f2a6c15b740 2024-09-17T05:45:19.856 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:19.854+0000 7f2a736ce640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f2a6c0cec90 con 0x7f2a6c15fb80 2024-09-17T05:45:19.857 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:19.854+0000 7f2a70c69640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2a6c15f230 0x7f2a6c1f5bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:45:19.857 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:19.854+0000 7f2a70c69640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2a6c15f230 0x7f2a6c1f5bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:50990/0 (socket says 172.21.15.150:50990) 2024-09-17T05:45:19.857 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:19.854+0000 7f2a70c69640 1 -- 172.21.15.150:0/828792292 learned_addr learned my addr 172.21.15.150:0/828792292 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:45:19.857 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:19.854+0000 7f2a71c6b640 1 --2- 172.21.15.150:0/828792292 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2a6c15fb80 0x7f2a6c146d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:45:19.857 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:19.854+0000 7f2a7146a640 1 --2- 172.21.15.150:0/828792292 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2a6c15b740 0x7f2a6c1496d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:45:19.857 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:19.855+0000 7f2a70c69640 1 -- 172.21.15.150:0/828792292 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2a6c15fb80 msgr2=0x7f2a6c146d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:45:19.857 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:19.855+0000 7f2a70c69640 1 --2- 172.21.15.150:0/828792292 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2a6c15fb80 0x7f2a6c146d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:19.857 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:19.855+0000 7f2a70c69640 1 -- 172.21.15.150:0/828792292 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2a6c15b740 msgr2=0x7f2a6c1496d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:45:19.857 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:19.855+0000 7f2a70c69640 1 --2- 172.21.15.150:0/828792292 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2a6c15b740 0x7f2a6c1496d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:19.857 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:19.855+0000 7f2a70c69640 1 -- 172.21.15.150:0/828792292 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2a6c1f6ad0 con 0x7f2a6c15f230 2024-09-17T05:45:19.857 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:19.855+0000 7f2a70c69640 1 --2- 172.21.15.150:0/828792292 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2a6c15f230 0x7f2a6c1f5bf0 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7f2a68007870 tx=0x7f2a68007d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:45:19.857 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:19.855+0000 7f2a5dffb640 1 -- 172.21.15.150:0/828792292 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a6800e630 con 0x7f2a6c15f230 2024-09-17T05:45:19.858 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:19.855+0000 7f2a5dffb640 1 -- 172.21.15.150:0/828792292 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f2a6800e7d0 con 0x7f2a6c15f230 2024-09-17T05:45:19.858 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:19.855+0000 7f2a5dffb640 1 -- 172.21.15.150:0/828792292 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a6800ec20 con 0x7f2a6c15f230 2024-09-17T05:45:19.858 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:19.855+0000 7f2a736ce640 1 -- 172.21.15.150:0/828792292 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2a6c1f6230 con 0x7f2a6c15f230 2024-09-17T05:45:19.858 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:19.855+0000 7f2a736ce640 1 -- 172.21.15.150:0/828792292 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2a6c1f67f0 con 0x7f2a6c15f230 2024-09-17T05:45:19.859 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:19.856+0000 7f2a736ce640 1 -- 172.21.15.150:0/828792292 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2a6c0b5520 con 0x7f2a6c15f230 2024-09-17T05:45:19.859 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:19.857+0000 7f2a5dffb640 1 -- 172.21.15.150:0/828792292 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 15) ==== 102257+0+0 (secure 0 0 0) 0x7f2a6800a440 con 0x7f2a6c15f230 2024-09-17T05:45:19.859 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:19.857+0000 7f2a5dffb640 1 --2- 172.21.15.150:0/828792292 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f2a50079490 0x7f2a5007b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:45:19.859 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:19.858+0000 7f2a5dffb640 1 -- 172.21.15.150:0/828792292 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(49..49 src has 1..49) ==== 5881+0+0 (secure 0 0 0) 0x7f2a6809b2d0 con 0x7f2a6c15f230 2024-09-17T05:45:19.859 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:19.858+0000 7f2a7146a640 1 --2- 172.21.15.150:0/828792292 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f2a50079490 0x7f2a5007b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:45:19.859 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:19.858+0000 7f2a7146a640 1 --2- 172.21.15.150:0/828792292 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f2a50079490 0x7f2a5007b9a0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f2a60033000 tx=0x7f2a60004730 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:45:19.862 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:19.862+0000 7f2a5dffb640 1 -- 172.21.15.150:0/828792292 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f2a6c0b5520 con 0x7f2a6c15f230 2024-09-17T05:45:20.078 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:20.077+0000 7f2a736ce640 1 -- 172.21.15.150:0/828792292 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7f2a6c0cf550 con 0x7f2a6c15f230 2024-09-17T05:45:20.715 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:20.714+0000 7f2a5dffb640 1 -- 172.21.15.150:0/828792292 <== mon.0 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v28) ==== 104+0+0 (secure 0 0 0) 0x7f2a68064c00 con 0x7f2a6c15f230 2024-09-17T05:45:20.718 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:20.717+0000 7f2a736ce640 1 -- 172.21.15.150:0/828792292 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f2a50079490 msgr2=0x7f2a5007b9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:45:20.718 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:20.717+0000 7f2a736ce640 1 --2- 172.21.15.150:0/828792292 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f2a50079490 0x7f2a5007b9a0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f2a60033000 tx=0x7f2a60004730 comp rx=0 tx=0).stop 2024-09-17T05:45:20.718 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:20.717+0000 7f2a736ce640 1 -- 172.21.15.150:0/828792292 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2a6c15f230 msgr2=0x7f2a6c1f5bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:45:20.718 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:20.717+0000 7f2a736ce640 1 --2- 172.21.15.150:0/828792292 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2a6c15f230 0x7f2a6c1f5bf0 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7f2a68007870 tx=0x7f2a68007d30 comp rx=0 tx=0).stop 2024-09-17T05:45:20.718 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:20.717+0000 7f2a736ce640 1 -- 172.21.15.150:0/828792292 shutdown_connections 2024-09-17T05:45:20.718 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:20.717+0000 7f2a736ce640 1 --2- 172.21.15.150:0/828792292 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f2a50079490 0x7f2a5007b9a0 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:20.718 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:20.717+0000 7f2a736ce640 1 --2- 172.21.15.150:0/828792292 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2a6c15fb80 0x7f2a6c146d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:20.718 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:20.717+0000 7f2a736ce640 1 --2- 172.21.15.150:0/828792292 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2a6c15f230 0x7f2a6c1f5bf0 unknown :-1 s=CLOSED pgs=568 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:20.718 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:20.717+0000 7f2a736ce640 1 --2- 172.21.15.150:0/828792292 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2a6c15b740 0x7f2a6c1496d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:20.718 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:20.717+0000 7f2a736ce640 1 -- 172.21.15.150:0/828792292 >> 172.21.15.150:0/828792292 conn(0x7f2a6c0b2400 msgr2=0x7f2a6c0b0a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:45:20.719 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:20.717+0000 7f2a736ce640 1 -- 172.21.15.150:0/828792292 shutdown_connections 2024-09-17T05:45:20.719 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:20.717+0000 7f2a736ce640 1 -- 172.21.15.150:0/828792292 wait complete. 2024-09-17T05:45:20.732 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-09-17T05:45:20.852 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:20.851+0000 7f1aef7ba640 1 -- 172.21.15.150:0/2122801229 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1ae8162140 msgr2=0x7f1ae80d2610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:45:20.852 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:20.851+0000 7f1aef7ba640 1 --2- 172.21.15.150:0/2122801229 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1ae8162140 0x7f1ae80d2610 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7f1ae81637e0 tx=0x7f1ae002a8b0 comp rx=0 tx=0).stop 2024-09-17T05:45:20.852 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:20.851+0000 7f1aef7ba640 1 -- 172.21.15.150:0/2122801229 shutdown_connections 2024-09-17T05:45:20.853 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:20.851+0000 7f1aef7ba640 1 --2- 172.21.15.150:0/2122801229 >> v2:172.21.15.176:3300/0 conn(0x7f1ae80d17c0 0x7f1ae80b9910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:20.853 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:20.851+0000 7f1aef7ba640 1 --2- 172.21.15.150:0/2122801229 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1ae8162140 0x7f1ae80d2610 unknown :-1 s=CLOSED pgs=570 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:20.853 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:20.851+0000 7f1aef7ba640 1 -- 172.21.15.150:0/2122801229 >> 172.21.15.150:0/2122801229 conn(0x7f1ae80d46a0 msgr2=0x7f1ae80d4ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:45:20.853 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:20.851+0000 7f1aef7ba640 1 -- 172.21.15.150:0/2122801229 shutdown_connections 2024-09-17T05:45:20.853 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:20.851+0000 7f1aef7ba640 1 -- 172.21.15.150:0/2122801229 wait complete. 2024-09-17T05:45:20.854 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:20.853+0000 7f1aef7ba640 1 Processor -- start 2024-09-17T05:45:20.854 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:20.853+0000 7f1aef7ba640 1 -- start start 2024-09-17T05:45:20.856 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:20.854+0000 7f1aef7ba640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1ae80b9e80 0x7f1ae80cb730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:45:20.856 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:20.854+0000 7f1aef7ba640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1ae8162140 0x7f1ae81602c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:45:20.856 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:20.854+0000 7f1aef7ba640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1ae8155d70 0x7f1ae815ef30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:45:20.856 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:20.854+0000 7f1aef7ba640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f1ae80d2ee0 con 0x7f1ae8155d70 2024-09-17T05:45:20.857 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:20.854+0000 7f1aef7ba640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f1ae80d2d60 con 0x7f1ae80b9e80 2024-09-17T05:45:20.857 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:20.854+0000 7f1aef7ba640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f1ae80d3060 con 0x7f1ae8162140 2024-09-17T05:45:20.857 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:20.855+0000 7f1aedd57640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1ae8155d70 0x7f1ae815ef30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:45:20.857 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:20.855+0000 7f1aedd57640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1ae8155d70 0x7f1ae815ef30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:36534/0 (socket says 172.21.15.150:36534) 2024-09-17T05:45:20.857 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:20.855+0000 7f1aedd57640 1 -- 172.21.15.150:0/2706855215 learned_addr learned my addr 172.21.15.150:0/2706855215 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:45:20.857 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:20.855+0000 7f1aed556640 1 --2- 172.21.15.150:0/2706855215 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1ae80b9e80 0x7f1ae80cb730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:45:20.857 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:20.855+0000 7f1aecd55640 1 --2- 172.21.15.150:0/2706855215 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1ae8162140 0x7f1ae81602c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:45:20.857 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:20.855+0000 7f1aedd57640 1 -- 172.21.15.150:0/2706855215 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1ae8162140 msgr2=0x7f1ae81602c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:45:20.857 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:20.855+0000 7f1aedd57640 1 --2- 172.21.15.150:0/2706855215 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1ae8162140 0x7f1ae81602c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:20.857 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:20.855+0000 7f1aedd57640 1 -- 172.21.15.150:0/2706855215 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1ae80b9e80 msgr2=0x7f1ae80cb730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:45:20.857 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:20.855+0000 7f1aedd57640 1 --2- 172.21.15.150:0/2706855215 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1ae80b9e80 0x7f1ae80cb730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:20.858 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:20.855+0000 7f1aedd57640 1 -- 172.21.15.150:0/2706855215 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1ae80cc660 con 0x7f1ae8155d70 2024-09-17T05:45:20.858 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:20.855+0000 7f1aedd57640 1 --2- 172.21.15.150:0/2706855215 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1ae8155d70 0x7f1ae815ef30 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7f1ae002aea0 tx=0x7f1ae0003ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:45:20.858 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:20.855+0000 7f1addffb640 1 -- 172.21.15.150:0/2706855215 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ae0031b90 con 0x7f1ae8155d70 2024-09-17T05:45:20.858 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:20.855+0000 7f1addffb640 1 -- 172.21.15.150:0/2706855215 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f1ae0031e20 con 0x7f1ae8155d70 2024-09-17T05:45:20.858 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:20.855+0000 7f1aef7ba640 1 -- 172.21.15.150:0/2706855215 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1ae80cc0a0 con 0x7f1ae8155d70 2024-09-17T05:45:20.858 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:20.855+0000 7f1addffb640 1 -- 172.21.15.150:0/2706855215 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ae00332f0 con 0x7f1ae8155d70 2024-09-17T05:45:20.858 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:20.856+0000 7f1aef7ba640 1 -- 172.21.15.150:0/2706855215 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1ae815e730 con 0x7f1ae8155d70 2024-09-17T05:45:20.859 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:20.857+0000 7f1aef7ba640 1 -- 172.21.15.150:0/2706855215 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1ae80d3580 con 0x7f1ae8155d70 2024-09-17T05:45:20.860 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:20.857+0000 7f1addffb640 1 -- 172.21.15.150:0/2706855215 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 15) ==== 102257+0+0 (secure 0 0 0) 0x7f1ae00316a0 con 0x7f1ae8155d70 2024-09-17T05:45:20.860 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:20.858+0000 7f1addffb640 1 --2- 172.21.15.150:0/2706855215 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f1acc079490 0x7f1acc07b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:45:20.860 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:20.858+0000 7f1addffb640 1 -- 172.21.15.150:0/2706855215 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(49..49 src has 1..49) ==== 5881+0+0 (secure 0 0 0) 0x7f1ae00baaa0 con 0x7f1ae8155d70 2024-09-17T05:45:20.860 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:20.858+0000 7f1aed556640 1 --2- 172.21.15.150:0/2706855215 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f1acc079490 0x7f1acc07b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:45:20.860 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:20.859+0000 7f1aed556640 1 --2- 172.21.15.150:0/2706855215 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f1acc079490 0x7f1acc07b9a0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f1ae4001720 tx=0x7f1ae4007e90 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:45:20.863 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:20.862+0000 7f1addffb640 1 -- 172.21.15.150:0/2706855215 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f1ae003f030 con 0x7f1ae8155d70 2024-09-17T05:45:21.044 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:21.043+0000 7f1aef7ba640 1 -- 172.21.15.150:0/2706855215 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7f1ae80cb4e0 con 0x7f1ae8155d70 2024-09-17T05:45:21.921 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:21.920+0000 7f1addffb640 1 -- 172.21.15.150:0/2706855215 <== mon.0 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v50) ==== 181+0+0 (secure 0 0 0) 0x7f1ae00843d0 con 0x7f1ae8155d70 2024-09-17T05:45:21.921 INFO:teuthology.orchestra.run.smithi150.stderr:pool 'cephfs_metadata' removed 2024-09-17T05:45:21.925 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:21.924+0000 7f1aef7ba640 1 -- 172.21.15.150:0/2706855215 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f1acc079490 msgr2=0x7f1acc07b9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:45:21.925 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:21.924+0000 7f1aef7ba640 1 --2- 172.21.15.150:0/2706855215 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f1acc079490 0x7f1acc07b9a0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f1ae4001720 tx=0x7f1ae4007e90 comp rx=0 tx=0).stop 2024-09-17T05:45:21.925 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:21.924+0000 7f1aef7ba640 1 -- 172.21.15.150:0/2706855215 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1ae8155d70 msgr2=0x7f1ae815ef30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:45:21.925 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:21.924+0000 7f1aef7ba640 1 --2- 172.21.15.150:0/2706855215 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1ae8155d70 0x7f1ae815ef30 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7f1ae002aea0 tx=0x7f1ae0003ba0 comp rx=0 tx=0).stop 2024-09-17T05:45:21.926 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:21.924+0000 7f1aef7ba640 1 -- 172.21.15.150:0/2706855215 shutdown_connections 2024-09-17T05:45:21.926 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:21.924+0000 7f1aef7ba640 1 --2- 172.21.15.150:0/2706855215 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f1acc079490 0x7f1acc07b9a0 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:21.926 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:21.924+0000 7f1aef7ba640 1 --2- 172.21.15.150:0/2706855215 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1ae8155d70 0x7f1ae815ef30 unknown :-1 s=CLOSED pgs=571 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:21.926 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:21.924+0000 7f1aef7ba640 1 --2- 172.21.15.150:0/2706855215 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1ae8162140 0x7f1ae81602c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:21.926 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:21.924+0000 7f1aef7ba640 1 --2- 172.21.15.150:0/2706855215 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1ae80b9e80 0x7f1ae80cb730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:21.927 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:21.924+0000 7f1aef7ba640 1 -- 172.21.15.150:0/2706855215 >> 172.21.15.150:0/2706855215 conn(0x7f1ae80d46a0 msgr2=0x7f1ae80ca1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:45:21.927 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:21.925+0000 7f1aef7ba640 1 -- 172.21.15.150:0/2706855215 shutdown_connections 2024-09-17T05:45:21.927 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:21.925+0000 7f1aef7ba640 1 -- 172.21.15.150:0/2706855215 wait complete. 2024-09-17T05:45:21.942 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-09-17T05:45:22.066 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:22.065+0000 7fa9ad969640 1 -- 172.21.15.150:0/4280956586 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa9a80d0520 msgr2=0x7fa9a80b7a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:45:22.066 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:22.065+0000 7fa9ad969640 1 --2- 172.21.15.150:0/4280956586 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa9a80d0520 0x7fa9a80b7a50 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7fa998009830 tx=0x7fa99802a5a0 comp rx=0 tx=0).stop 2024-09-17T05:45:22.066 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:22.065+0000 7fa9ad969640 1 -- 172.21.15.150:0/4280956586 shutdown_connections 2024-09-17T05:45:22.066 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:22.065+0000 7fa9ad969640 1 --2- 172.21.15.150:0/4280956586 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa9a80d0520 0x7fa9a80b7a50 unknown :-1 s=CLOSED pgs=573 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:22.066 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:22.065+0000 7fa9ad969640 1 -- 172.21.15.150:0/4280956586 >> 172.21.15.150:0/4280956586 conn(0x7fa9a80cef30 msgr2=0x7fa9a80cf340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:45:22.066 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:22.065+0000 7fa9ad969640 1 -- 172.21.15.150:0/4280956586 shutdown_connections 2024-09-17T05:45:22.066 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:22.065+0000 7fa9ad969640 1 -- 172.21.15.150:0/4280956586 wait complete. 2024-09-17T05:45:22.067 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:22.067+0000 7fa9ad969640 1 Processor -- start 2024-09-17T05:45:22.067 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:22.067+0000 7fa9ad969640 1 -- start start 2024-09-17T05:45:22.070 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:22.068+0000 7fa9ad969640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa9a80b1d80 0x7fa9a8155270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:45:22.070 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:22.068+0000 7fa9ad969640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa9a80b2190 0x7fa9a81f64e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:45:22.070 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:22.068+0000 7fa9ad969640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa9a80d0520 0x7fa9a806f4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:45:22.070 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:22.068+0000 7fa9ad969640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7fa9a80d3310 con 0x7fa9a80d0520 2024-09-17T05:45:22.070 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:22.068+0000 7fa9ad969640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fa9a8074ae0 con 0x7fa9a80b1d80 2024-09-17T05:45:22.070 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:22.068+0000 7fa9ad969640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fa9a8070f20 con 0x7fa9a80b2190 2024-09-17T05:45:22.070 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:22.068+0000 7fa9a77fe640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa9a80d0520 0x7fa9a806f4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:45:22.071 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:22.068+0000 7fa9a77fe640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa9a80d0520 0x7fa9a806f4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:36544/0 (socket says 172.21.15.150:36544) 2024-09-17T05:45:22.071 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:22.068+0000 7fa9a77fe640 1 -- 172.21.15.150:0/2530255900 learned_addr learned my addr 172.21.15.150:0/2530255900 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:45:22.071 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:22.068+0000 7fa99e7fc640 1 --2- 172.21.15.150:0/2530255900 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa9a80b2190 0x7fa9a81f64e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:45:22.071 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:22.068+0000 7fa9a6ffd640 1 --2- 172.21.15.150:0/2530255900 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa9a80b1d80 0x7fa9a8155270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:45:22.071 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:22.069+0000 7fa9a77fe640 1 -- 172.21.15.150:0/2530255900 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa9a80b2190 msgr2=0x7fa9a81f64e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:45:22.071 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:22.069+0000 7fa9a77fe640 1 --2- 172.21.15.150:0/2530255900 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa9a80b2190 0x7fa9a81f64e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:22.071 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:22.069+0000 7fa9a77fe640 1 -- 172.21.15.150:0/2530255900 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa9a80b1d80 msgr2=0x7fa9a8155270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:45:22.071 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:22.069+0000 7fa9a77fe640 1 --2- 172.21.15.150:0/2530255900 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa9a80b1d80 0x7fa9a8155270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:22.071 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:22.069+0000 7fa9a77fe640 1 -- 172.21.15.150:0/2530255900 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa9a80ca9d0 con 0x7fa9a80d0520 2024-09-17T05:45:22.071 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:22.069+0000 7fa9a77fe640 1 --2- 172.21.15.150:0/2530255900 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa9a80d0520 0x7fa9a806f4c0 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7fa9a000b990 tx=0x7fa9a000be50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:45:22.071 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:22.069+0000 7fa9a4ff9640 1 -- 172.21.15.150:0/2530255900 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9a0019070 con 0x7fa9a80d0520 2024-09-17T05:45:22.071 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:22.069+0000 7fa9a4ff9640 1 -- 172.21.15.150:0/2530255900 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa9a000cc30 con 0x7fa9a80d0520 2024-09-17T05:45:22.072 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:22.069+0000 7fa9ad969640 1 -- 172.21.15.150:0/2530255900 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa9a80cacb0 con 0x7fa9a80d0520 2024-09-17T05:45:22.072 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:22.069+0000 7fa9a4ff9640 1 -- 172.21.15.150:0/2530255900 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9a00146a0 con 0x7fa9a80d0520 2024-09-17T05:45:22.072 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:22.069+0000 7fa9ad969640 1 -- 172.21.15.150:0/2530255900 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa9a80cb270 con 0x7fa9a80d0520 2024-09-17T05:45:22.072 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:22.070+0000 7fa9ad969640 1 -- 172.21.15.150:0/2530255900 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa9a80ca740 con 0x7fa9a80d0520 2024-09-17T05:45:22.072 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:22.071+0000 7fa9a4ff9640 1 -- 172.21.15.150:0/2530255900 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 15) ==== 102257+0+0 (secure 0 0 0) 0x7fa9a001c070 con 0x7fa9a80d0520 2024-09-17T05:45:22.073 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:22.071+0000 7fa9a4ff9640 1 --2- 172.21.15.150:0/2530255900 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fa988079490 0x7fa98807b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:45:22.073 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:22.072+0000 7fa9a4ff9640 1 -- 172.21.15.150:0/2530255900 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(50..50 src has 1..50) ==== 5443+0+0 (secure 0 0 0) 0x7fa9a00994b0 con 0x7fa9a80d0520 2024-09-17T05:45:22.073 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:22.072+0000 7fa9a6ffd640 1 --2- 172.21.15.150:0/2530255900 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fa988079490 0x7fa98807b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:45:22.073 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:22.073+0000 7fa9a6ffd640 1 --2- 172.21.15.150:0/2530255900 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fa988079490 0x7fa98807b9a0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7fa998034000 tx=0x7fa998004730 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:45:22.076 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:22.076+0000 7fa9a4ff9640 1 -- 172.21.15.150:0/2530255900 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fa9a000ce20 con 0x7fa9a80d0520 2024-09-17T05:45:22.256 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:22.256+0000 7fa9ad969640 1 -- 172.21.15.150:0/2530255900 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7fa9a81557b0 con 0x7fa9a80d0520 2024-09-17T05:45:22.928 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:22.927+0000 7fa9a4ff9640 1 -- 172.21.15.150:0/2530255900 <== mon.0 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v51) ==== 169+0+0 (secure 0 0 0) 0x7fa9a0062b70 con 0x7fa9a80d0520 2024-09-17T05:45:22.928 INFO:teuthology.orchestra.run.smithi150.stderr:pool 'cephfs_data' removed 2024-09-17T05:45:22.931 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:22.930+0000 7fa9ad969640 1 -- 172.21.15.150:0/2530255900 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fa988079490 msgr2=0x7fa98807b9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:45:22.931 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:22.930+0000 7fa9ad969640 1 --2- 172.21.15.150:0/2530255900 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fa988079490 0x7fa98807b9a0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7fa998034000 tx=0x7fa998004730 comp rx=0 tx=0).stop 2024-09-17T05:45:22.931 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:22.930+0000 7fa9ad969640 1 -- 172.21.15.150:0/2530255900 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa9a80d0520 msgr2=0x7fa9a806f4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:45:22.931 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:22.930+0000 7fa9ad969640 1 --2- 172.21.15.150:0/2530255900 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa9a80d0520 0x7fa9a806f4c0 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7fa9a000b990 tx=0x7fa9a000be50 comp rx=0 tx=0).stop 2024-09-17T05:45:22.931 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:22.930+0000 7fa9ad969640 1 -- 172.21.15.150:0/2530255900 shutdown_connections 2024-09-17T05:45:22.932 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:22.930+0000 7fa9ad969640 1 --2- 172.21.15.150:0/2530255900 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fa988079490 0x7fa98807b9a0 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:22.932 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:22.930+0000 7fa9ad969640 1 --2- 172.21.15.150:0/2530255900 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa9a80d0520 0x7fa9a806f4c0 unknown :-1 s=CLOSED pgs=574 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:22.932 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:22.930+0000 7fa9ad969640 1 --2- 172.21.15.150:0/2530255900 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa9a80b2190 0x7fa9a81f64e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:22.932 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:22.930+0000 7fa9ad969640 1 --2- 172.21.15.150:0/2530255900 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa9a80b1d80 0x7fa9a8155270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:22.932 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:22.930+0000 7fa9ad969640 1 -- 172.21.15.150:0/2530255900 >> 172.21.15.150:0/2530255900 conn(0x7fa9a80cef30 msgr2=0x7fa9a815ca20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:45:22.932 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:22.930+0000 7fa9ad969640 1 -- 172.21.15.150:0/2530255900 shutdown_connections 2024-09-17T05:45:22.932 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:22.930+0000 7fa9ad969640 1 -- 172.21.15.150:0/2530255900 wait complete. 2024-09-17T05:45:22.952 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config reset 31 2024-09-17T05:45:23.080 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:23.079+0000 7f66ccd7b640 1 -- 172.21.15.150:0/2176203229 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f66b4003a30 msgr2=0x7f66b4003ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:45:23.080 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:23.079+0000 7f66ccd7b640 1 --2- 172.21.15.150:0/2176203229 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f66b4003a30 0x7f66b4003ea0 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7f66b8006fc0 tx=0x7f66b4005830 comp rx=0 tx=0).stop 2024-09-17T05:45:23.080 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:23.079+0000 7f66c6d9d640 1 -- 172.21.15.150:0/2176203229 reap_dead start 2024-09-17T05:45:23.080 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:23.079+0000 7f66ccd7b640 1 -- 172.21.15.150:0/2176203229 shutdown_connections 2024-09-17T05:45:23.080 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:23.079+0000 7f66ccd7b640 1 -- 172.21.15.150:0/2176203229 >> 172.21.15.150:0/2176203229 conn(0x7f66c808bfe0 msgr2=0x7f66c80d4660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:45:23.081 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:23.079+0000 7f66ccd7b640 1 -- 172.21.15.150:0/2176203229 shutdown_connections 2024-09-17T05:45:23.081 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:23.079+0000 7f66ccd7b640 1 -- 172.21.15.150:0/2176203229 wait complete. 2024-09-17T05:45:23.081 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:23.081+0000 7f66ccd7b640 1 Processor -- start 2024-09-17T05:45:23.082 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:23.081+0000 7f66ccd7b640 1 -- start start 2024-09-17T05:45:23.084 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:23.082+0000 7f66ccd7b640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f66b4003a30 0x7f66c80b3ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:45:23.084 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:23.082+0000 7f66ccd7b640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f66c80b11f0 0x7f66c81f9350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:45:23.085 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:23.082+0000 7f66ccd7b640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f66c81f9890 0x7f66c81605d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:45:23.085 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:23.082+0000 7f66ccd7b640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f66c80b6730 con 0x7f66c80b11f0 2024-09-17T05:45:23.085 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:23.082+0000 7f66ccd7b640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f66c80b5570 con 0x7f66c81f9890 2024-09-17T05:45:23.085 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:23.082+0000 7f66ccd7b640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f66c80b68b0 con 0x7f66b4003a30 2024-09-17T05:45:23.085 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:23.082+0000 7f66bffff640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f66c80b11f0 0x7f66c81f9350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:45:23.085 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:23.082+0000 7f66bffff640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f66c80b11f0 0x7f66c81f9350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:36558/0 (socket says 172.21.15.150:36558) 2024-09-17T05:45:23.085 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:23.082+0000 7f66bffff640 1 -- 172.21.15.150:0/1548721019 learned_addr learned my addr 172.21.15.150:0/1548721019 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:45:23.085 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:23.082+0000 7f66c659c640 1 --2- 172.21.15.150:0/1548721019 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f66b4003a30 0x7f66c80b3ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:45:23.085 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:23.083+0000 7f66c6d9d640 1 --2- 172.21.15.150:0/1548721019 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f66c81f9890 0x7f66c81605d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:45:23.085 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:23.083+0000 7f66bffff640 1 -- 172.21.15.150:0/1548721019 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f66b4003a30 msgr2=0x7f66c80b3ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:45:23.085 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:23.083+0000 7f66bffff640 1 --2- 172.21.15.150:0/1548721019 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f66b4003a30 0x7f66c80b3ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:23.086 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:23.083+0000 7f66bffff640 1 -- 172.21.15.150:0/1548721019 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f66c81f9890 msgr2=0x7f66c81605d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:45:23.086 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:23.083+0000 7f66bffff640 1 --2- 172.21.15.150:0/1548721019 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f66c81f9890 0x7f66c81605d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:23.086 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:23.083+0000 7f66bffff640 1 -- 172.21.15.150:0/1548721019 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f66c80b30e0 con 0x7f66c80b11f0 2024-09-17T05:45:23.086 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:23.083+0000 7f66bffff640 1 --2- 172.21.15.150:0/1548721019 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f66c80b11f0 0x7f66c81f9350 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7f66b0006690 tx=0x7f66b00016f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:45:23.086 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:23.083+0000 7f66beffd640 1 -- 172.21.15.150:0/1548721019 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f66b0015020 con 0x7f66c80b11f0 2024-09-17T05:45:23.086 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:23.083+0000 7f66beffd640 1 -- 172.21.15.150:0/1548721019 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f66b0011840 con 0x7f66c80b11f0 2024-09-17T05:45:23.086 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:23.083+0000 7f66ccd7b640 1 -- 172.21.15.150:0/1548721019 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f66c80b33c0 con 0x7f66c80b11f0 2024-09-17T05:45:23.086 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:23.083+0000 7f66beffd640 1 -- 172.21.15.150:0/1548721019 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f66b0011c70 con 0x7f66c80b11f0 2024-09-17T05:45:23.086 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:23.083+0000 7f66ccd7b640 1 -- 172.21.15.150:0/1548721019 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f66c80b1a00 con 0x7f66c80b11f0 2024-09-17T05:45:23.087 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:23.084+0000 7f66ccd7b640 1 -- 172.21.15.150:0/1548721019 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f66c80b1770 con 0x7f66c80b11f0 2024-09-17T05:45:23.087 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:23.085+0000 7f66beffd640 1 -- 172.21.15.150:0/1548721019 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 15) ==== 102257+0+0 (secure 0 0 0) 0x7f66b0018020 con 0x7f66c80b11f0 2024-09-17T05:45:23.087 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:23.085+0000 7f66beffd640 1 --2- 172.21.15.150:0/1548721019 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f66a80794c0 0x7f66a807b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:45:23.087 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:23.086+0000 7f66beffd640 1 -- 172.21.15.150:0/1548721019 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(51..51 src has 1..51) ==== 4971+0+0 (secure 0 0 0) 0x7f66b0099f70 con 0x7f66c80b11f0 2024-09-17T05:45:23.087 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:23.086+0000 7f66c659c640 1 --2- 172.21.15.150:0/1548721019 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f66a80794c0 0x7f66a807b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:45:23.088 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:23.086+0000 7f66c659c640 1 --2- 172.21.15.150:0/1548721019 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f66a80794c0 0x7f66a807b9d0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f66b8033000 tx=0x7f66b8001110 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:45:23.090 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:23.090+0000 7f66beffd640 1 -- 172.21.15.150:0/1548721019 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f66b001f020 con 0x7f66c80b11f0 2024-09-17T05:45:23.265 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:23.265+0000 7f66ccd7b640 1 -- 172.21.15.150:0/1548721019 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "config reset", "num": 31} v 0) -- 0x7f66c808caf0 con 0x7f66c80b11f0 2024-09-17T05:45:23.269 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:23.269+0000 7f66beffd640 1 -- 172.21.15.150:0/1548721019 <== mon.0 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "config reset", "num": 31}]=0 v37) ==== 71+0+0 (secure 0 0 0) 0x7f66c808caf0 con 0x7f66c80b11f0 2024-09-17T05:45:23.272 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:23.271+0000 7f66ccd7b640 1 -- 172.21.15.150:0/1548721019 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f66a80794c0 msgr2=0x7f66a807b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:45:23.272 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:23.271+0000 7f66ccd7b640 1 --2- 172.21.15.150:0/1548721019 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f66a80794c0 0x7f66a807b9d0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f66b8033000 tx=0x7f66b8001110 comp rx=0 tx=0).stop 2024-09-17T05:45:23.272 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:23.271+0000 7f66ccd7b640 1 -- 172.21.15.150:0/1548721019 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f66c80b11f0 msgr2=0x7f66c81f9350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:45:23.272 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:23.271+0000 7f66ccd7b640 1 --2- 172.21.15.150:0/1548721019 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f66c80b11f0 0x7f66c81f9350 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7f66b0006690 tx=0x7f66b00016f0 comp rx=0 tx=0).stop 2024-09-17T05:45:23.272 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:23.271+0000 7f66ccd7b640 1 -- 172.21.15.150:0/1548721019 shutdown_connections 2024-09-17T05:45:23.273 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:23.271+0000 7f66ccd7b640 1 --2- 172.21.15.150:0/1548721019 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f66c81f9890 0x7f66c81605d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:23.273 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:23.271+0000 7f66ccd7b640 1 --2- 172.21.15.150:0/1548721019 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f66a80794c0 0x7f66a807b9d0 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:23.273 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:23.271+0000 7f66ccd7b640 1 --2- 172.21.15.150:0/1548721019 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f66c80b11f0 0x7f66c81f9350 unknown :-1 s=CLOSED pgs=577 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:23.273 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:23.271+0000 7f66ccd7b640 1 --2- 172.21.15.150:0/1548721019 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f66b4003a30 0x7f66c80b3ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:23.273 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:23.271+0000 7f66ccd7b640 1 -- 172.21.15.150:0/1548721019 >> 172.21.15.150:0/1548721019 conn(0x7f66c808bfe0 msgr2=0x7f66c806dea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:45:23.273 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:23.271+0000 7f66ccd7b640 1 -- 172.21.15.150:0/1548721019 shutdown_connections 2024-09-17T05:45:23.273 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:23.271+0000 7f66ccd7b640 1 -- 172.21.15.150:0/1548721019 wait complete. 2024-09-17T05:45:23.283 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_volumes.TestCloneProgressReporter.test_clones_equal_to_cloner_threads' 2024-09-17T05:45:23.397 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:23.396+0000 7fd4ec67e640 1 -- 172.21.15.150:0/3830115794 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd4e40cd850 msgr2=0x7fd4e40d06f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:45:23.397 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:23.396+0000 7fd4ec67e640 1 --2- 172.21.15.150:0/3830115794 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd4e40cd850 0x7fd4e40d06f0 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7fd4e40b84c0 tx=0x7fd4dc02aac0 comp rx=0 tx=0).stop 2024-09-17T05:45:23.397 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:23.396+0000 7fd4ec67e640 1 -- 172.21.15.150:0/3830115794 shutdown_connections 2024-09-17T05:45:23.397 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:23.396+0000 7fd4ec67e640 1 --2- 172.21.15.150:0/3830115794 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd4e40cd850 0x7fd4e40d06f0 unknown :-1 s=CLOSED pgs=578 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:23.397 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:23.396+0000 7fd4ec67e640 1 --2- 172.21.15.150:0/3830115794 >> v2:172.21.15.176:3300/0 conn(0x7fd4e409ba60 0x7fd4e40b7330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:23.398 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:23.396+0000 7fd4ec67e640 1 -- 172.21.15.150:0/3830115794 >> 172.21.15.150:0/3830115794 conn(0x7fd4e40cee90 msgr2=0x7fd4e40cf2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:45:23.398 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:23.396+0000 7fd4ec67e640 1 -- 172.21.15.150:0/3830115794 shutdown_connections 2024-09-17T05:45:23.398 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:23.396+0000 7fd4ec67e640 1 -- 172.21.15.150:0/3830115794 wait complete. 2024-09-17T05:45:23.398 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:23.398+0000 7fd4ec67e640 1 Processor -- start 2024-09-17T05:45:23.398 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:23.398+0000 7fd4ec67e640 1 -- start start 2024-09-17T05:45:23.401 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:23.399+0000 7fd4ec67e640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd4e409ba60 0x7fd4e409f6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:45:23.401 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:23.399+0000 7fd4ec67e640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd4e40cd440 0x7fd4e41f43d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:45:23.402 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:23.399+0000 7fd4ec67e640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd4e40cd850 0x7fd4e409dd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:45:23.402 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:23.399+0000 7fd4ec67e640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7fd4e40d0db0 con 0x7fd4e40cd850 2024-09-17T05:45:23.402 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:23.399+0000 7fd4ec67e640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fd4e40d0c30 con 0x7fd4e409ba60 2024-09-17T05:45:23.402 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:23.399+0000 7fd4ec67e640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fd4e40d0f30 con 0x7fd4e40cd440 2024-09-17T05:45:23.402 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:23.399+0000 7fd4eac1b640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd4e40cd850 0x7fd4e409dd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:45:23.402 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:23.399+0000 7fd4eac1b640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd4e40cd850 0x7fd4e409dd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:36572/0 (socket says 172.21.15.150:36572) 2024-09-17T05:45:23.402 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:23.399+0000 7fd4eac1b640 1 -- 172.21.15.150:0/1030728498 learned_addr learned my addr 172.21.15.150:0/1030728498 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:45:23.402 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:23.399+0000 7fd4ea41a640 1 --2- 172.21.15.150:0/1030728498 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd4e409ba60 0x7fd4e409f6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:45:23.403 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:23.399+0000 7fd4e9c19640 1 --2- 172.21.15.150:0/1030728498 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd4e40cd440 0x7fd4e41f43d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:45:23.403 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:23.400+0000 7fd4eac1b640 1 -- 172.21.15.150:0/1030728498 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd4e40cd440 msgr2=0x7fd4e41f43d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:45:23.403 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:23.400+0000 7fd4eac1b640 1 --2- 172.21.15.150:0/1030728498 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd4e40cd440 0x7fd4e41f43d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:23.403 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:23.400+0000 7fd4eac1b640 1 -- 172.21.15.150:0/1030728498 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd4e409ba60 msgr2=0x7fd4e409f6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:45:23.403 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:23.400+0000 7fd4eac1b640 1 --2- 172.21.15.150:0/1030728498 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd4e409ba60 0x7fd4e409f6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:23.403 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:23.400+0000 7fd4eac1b640 1 -- 172.21.15.150:0/1030728498 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd4e409ff20 con 0x7fd4e40cd850 2024-09-17T05:45:23.403 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:23.400+0000 7fd4eac1b640 1 --2- 172.21.15.150:0/1030728498 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd4e40cd850 0x7fd4e409dd00 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7fd4dc009d60 tx=0x7fd4dc003ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:45:23.403 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:23.400+0000 7fd4daffd640 1 -- 172.21.15.150:0/1030728498 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4dc044070 con 0x7fd4e40cd850 2024-09-17T05:45:23.403 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:23.400+0000 7fd4daffd640 1 -- 172.21.15.150:0/1030728498 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd4dc003e50 con 0x7fd4e40cd850 2024-09-17T05:45:23.403 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:23.400+0000 7fd4ec67e640 1 -- 172.21.15.150:0/1030728498 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd4e40a0200 con 0x7fd4e40cd850 2024-09-17T05:45:23.403 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:23.400+0000 7fd4daffd640 1 -- 172.21.15.150:0/1030728498 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4dc0044b0 con 0x7fd4e40cd850 2024-09-17T05:45:23.404 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:23.400+0000 7fd4ec67e640 1 -- 172.21.15.150:0/1030728498 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd4e409d500 con 0x7fd4e40cd850 2024-09-17T05:45:23.404 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:23.401+0000 7fd4ec67e640 1 -- 172.21.15.150:0/1030728498 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd4e40b7330 con 0x7fd4e40cd850 2024-09-17T05:45:23.405 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:23.402+0000 7fd4daffd640 1 -- 172.21.15.150:0/1030728498 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 15) ==== 102257+0+0 (secure 0 0 0) 0x7fd4dc004650 con 0x7fd4e40cd850 2024-09-17T05:45:23.405 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:23.402+0000 7fd4daffd640 1 --2- 172.21.15.150:0/1030728498 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fd4c8079490 0x7fd4c807b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:45:23.405 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:23.402+0000 7fd4daffd640 1 -- 172.21.15.150:0/1030728498 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(51..51 src has 1..51) ==== 4971+0+0 (secure 0 0 0) 0x7fd4dc0bc320 con 0x7fd4e40cd850 2024-09-17T05:45:23.405 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:23.403+0000 7fd4ea41a640 1 --2- 172.21.15.150:0/1030728498 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fd4c8079490 0x7fd4c807b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:45:23.405 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:23.403+0000 7fd4ea41a640 1 --2- 172.21.15.150:0/1030728498 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fd4c8079490 0x7fd4c807b9a0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fd4e0009c00 tx=0x7fd4e0005f30 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:45:23.407 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:23.407+0000 7fd4daffd640 1 -- 172.21.15.150:0/1030728498 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fd4dc032030 con 0x7fd4e40cd850 2024-09-17T05:45:23.651 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:23.650+0000 7fd4ec67e640 1 -- 172.21.15.150:0/1030728498 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_volumes.TestCloneProgressReporter.test_clones_equal_to_cloner_threads"]} v 0) -- 0x7fd4e409fcb0 con 0x7fd4e40cd850 2024-09-17T05:45:23.930 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:23.929+0000 7fd4daffd640 1 -- 172.21.15.150:0/1030728498 <== mon.0 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_volumes.TestCloneProgressReporter.test_clones_equal_to_cloner_threads"]}]=0 v182) ==== 166+0+0 (secure 0 0 0) 0x7fd4dc083450 con 0x7fd4e40cd850 2024-09-17T05:45:23.934 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:23.932+0000 7fd4ec67e640 1 -- 172.21.15.150:0/1030728498 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fd4c8079490 msgr2=0x7fd4c807b9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:45:23.934 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:23.932+0000 7fd4ec67e640 1 --2- 172.21.15.150:0/1030728498 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fd4c8079490 0x7fd4c807b9a0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fd4e0009c00 tx=0x7fd4e0005f30 comp rx=0 tx=0).stop 2024-09-17T05:45:23.934 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:23.932+0000 7fd4ec67e640 1 -- 172.21.15.150:0/1030728498 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd4e40cd850 msgr2=0x7fd4e409dd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:45:23.934 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:23.932+0000 7fd4ec67e640 1 --2- 172.21.15.150:0/1030728498 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd4e40cd850 0x7fd4e409dd00 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7fd4dc009d60 tx=0x7fd4dc003ce0 comp rx=0 tx=0).stop 2024-09-17T05:45:23.934 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:23.932+0000 7fd4ec67e640 1 -- 172.21.15.150:0/1030728498 shutdown_connections 2024-09-17T05:45:23.934 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:23.932+0000 7fd4ec67e640 1 --2- 172.21.15.150:0/1030728498 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fd4c8079490 0x7fd4c807b9a0 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:23.934 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:23.932+0000 7fd4ec67e640 1 --2- 172.21.15.150:0/1030728498 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd4e40cd850 0x7fd4e409dd00 unknown :-1 s=CLOSED pgs=579 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:23.934 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:23.932+0000 7fd4ec67e640 1 --2- 172.21.15.150:0/1030728498 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd4e40cd440 0x7fd4e41f43d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:23.934 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:23.932+0000 7fd4ec67e640 1 --2- 172.21.15.150:0/1030728498 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd4e409ba60 0x7fd4e409f6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:23.934 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:23.932+0000 7fd4ec67e640 1 -- 172.21.15.150:0/1030728498 >> 172.21.15.150:0/1030728498 conn(0x7fd4e40cee90 msgr2=0x7fd4e4164380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:45:23.934 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:23.932+0000 7fd4ec67e640 1 -- 172.21.15.150:0/1030728498 shutdown_connections 2024-09-17T05:45:23.934 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:23.932+0000 7fd4ec67e640 1 -- 172.21.15.150:0/1030728498 wait complete. 2024-09-17T05:45:23.945 INFO:tasks.cephfs_test_runner:Test that one progress bar is printed in output of "ceph status" output ... ok 2024-09-17T05:45:23.946 INFO:tasks.cephfs_test_runner:Starting test: test_clones_less_than_cloner_threads (tasks.cephfs.test_volumes.TestCloneProgressReporter) Test that one progress bar is printed in output of "ceph status" output 2024-09-17T05:45:23.946 INFO:tasks.cephfs_test_runner:test_clones_less_than_cloner_threads (tasks.cephfs.test_volumes.TestCloneProgressReporter) 2024-09-17T05:45:23.946 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T05:45:24.060 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:24.059+0000 7f55974b6640 1 -- 172.21.15.150:0/213254270 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5590152920 msgr2=0x7f559015f3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:45:24.060 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:24.059+0000 7f55974b6640 1 --2- 172.21.15.150:0/213254270 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5590152920 0x7f559015f3d0 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7f5584009830 tx=0x7f558402a480 comp rx=0 tx=0).stop 2024-09-17T05:45:24.060 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:24.059+0000 7f55974b6640 1 -- 172.21.15.150:0/213254270 shutdown_connections 2024-09-17T05:45:24.060 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:24.059+0000 7f55974b6640 1 --2- 172.21.15.150:0/213254270 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5590152920 0x7f559015f3d0 unknown :-1 s=CLOSED pgs=581 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:24.060 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:24.059+0000 7f55974b6640 1 -- 172.21.15.150:0/213254270 >> 172.21.15.150:0/213254270 conn(0x7f559006d730 msgr2=0x7f55900b1e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:45:24.060 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:24.059+0000 7f55974b6640 1 -- 172.21.15.150:0/213254270 shutdown_connections 2024-09-17T05:45:24.061 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:24.059+0000 7f55974b6640 1 -- 172.21.15.150:0/213254270 wait complete. 2024-09-17T05:45:24.061 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:24.061+0000 7f55974b6640 1 Processor -- start 2024-09-17T05:45:24.062 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:24.061+0000 7f55974b6640 1 -- start start 2024-09-17T05:45:24.064 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:24.062+0000 7f55974b6640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f55900aebc0 0x7f5590074870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:45:24.064 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:24.062+0000 7f55974b6640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5590152920 0x7f559014f880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:45:24.065 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:24.062+0000 7f55974b6640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f559015f910 0x7f55901e9650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:45:24.065 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:24.062+0000 7f55974b6640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f55900b4390 con 0x7f55900aebc0 2024-09-17T05:45:24.065 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:24.062+0000 7f55974b6640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f55900b4210 con 0x7f5590152920 2024-09-17T05:45:24.065 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:24.062+0000 7f55974b6640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f55900b4510 con 0x7f559015f910 2024-09-17T05:45:24.065 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:24.062+0000 7f5595252640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f55900aebc0 0x7f5590074870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:45:24.065 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:24.063+0000 7f5595252640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f55900aebc0 0x7f5590074870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:36602/0 (socket says 172.21.15.150:36602) 2024-09-17T05:45:24.065 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:24.063+0000 7f5595252640 1 -- 172.21.15.150:0/3419585769 learned_addr learned my addr 172.21.15.150:0/3419585769 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:45:24.065 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:24.063+0000 7f5594a51640 1 --2- 172.21.15.150:0/3419585769 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5590152920 0x7f559014f880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:45:24.065 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:24.063+0000 7f5595a53640 1 --2- 172.21.15.150:0/3419585769 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f559015f910 0x7f55901e9650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:45:24.065 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:24.063+0000 7f5595252640 1 -- 172.21.15.150:0/3419585769 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f559015f910 msgr2=0x7f55901e9650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:45:24.065 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:24.063+0000 7f5595252640 1 --2- 172.21.15.150:0/3419585769 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f559015f910 0x7f55901e9650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:24.065 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:24.063+0000 7f5595252640 1 -- 172.21.15.150:0/3419585769 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5590152920 msgr2=0x7f559014f880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:45:24.066 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:24.063+0000 7f5595252640 1 --2- 172.21.15.150:0/3419585769 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5590152920 0x7f559014f880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:24.066 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:24.063+0000 7f5595252640 1 -- 172.21.15.150:0/3419585769 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f55901f96b0 con 0x7f55900aebc0 2024-09-17T05:45:24.066 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:24.063+0000 7f5595252640 1 --2- 172.21.15.150:0/3419585769 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f55900aebc0 0x7f5590074870 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7f558000ba80 tx=0x7f558000bf40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:45:24.066 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:24.063+0000 7f558dffb640 1 -- 172.21.15.150:0/3419585769 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5580019070 con 0x7f55900aebc0 2024-09-17T05:45:24.066 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:24.063+0000 7f558dffb640 1 -- 172.21.15.150:0/3419585769 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f558000cd20 con 0x7f55900aebc0 2024-09-17T05:45:24.066 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:24.063+0000 7f55974b6640 1 -- 172.21.15.150:0/3419585769 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f55901f9990 con 0x7f55900aebc0 2024-09-17T05:45:24.066 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:24.063+0000 7f558dffb640 1 -- 172.21.15.150:0/3419585769 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55800146a0 con 0x7f55900aebc0 2024-09-17T05:45:24.066 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:24.063+0000 7f55974b6640 1 -- 172.21.15.150:0/3419585769 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f55901f9f50 con 0x7f55900aebc0 2024-09-17T05:45:24.067 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:24.064+0000 7f55974b6640 1 -- 172.21.15.150:0/3419585769 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f55900b4de0 con 0x7f55900aebc0 2024-09-17T05:45:24.067 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:24.065+0000 7f558dffb640 1 -- 172.21.15.150:0/3419585769 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 15) ==== 102257+0+0 (secure 0 0 0) 0x7f558001d3f0 con 0x7f55900aebc0 2024-09-17T05:45:24.067 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:24.066+0000 7f558dffb640 1 --2- 172.21.15.150:0/3419585769 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f557c0794c0 0x7f557c07b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:45:24.067 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:24.066+0000 7f558dffb640 1 -- 172.21.15.150:0/3419585769 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(51..51 src has 1..51) ==== 4971+0+0 (secure 0 0 0) 0x7f55800992b0 con 0x7f55900aebc0 2024-09-17T05:45:24.067 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:24.066+0000 7f5594a51640 1 --2- 172.21.15.150:0/3419585769 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f557c0794c0 0x7f557c07b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:45:24.067 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:24.067+0000 7f5594a51640 1 --2- 172.21.15.150:0/3419585769 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f557c0794c0 0x7f557c07b9d0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f5584034000 tx=0x7f5584004730 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:45:24.071 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:24.070+0000 7f558dffb640 1 -- 172.21.15.150:0/3419585769 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f55800629f0 con 0x7f55900aebc0 2024-09-17T05:45:24.247 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:24.247+0000 7f55974b6640 1 -- 172.21.15.150:0/3419585769 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f559006e060 con 0x7f55900aebc0 2024-09-17T05:45:24.248 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:24.248+0000 7f558dffb640 1 -- 172.21.15.150:0/3419585769 <== mon.0 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v51) ==== 74+0+13113 (secure 0 0 0) 0x7f5580067420 con 0x7f55900aebc0 2024-09-17T05:45:24.249 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-09-17T05:45:24.249 INFO:teuthology.orchestra.run.smithi150.stdout:{"epoch":51,"fsid":"9f2e05e9-d629-47b3-b26b-1360655b7d20","created":"2024-09-17T05:41:32.502979+0000","modified":"2024-09-17T05:45:22.920912+0000","last_up_change":"2024-09-17T05:41:46.150225+0000","last_in_change":"2024-09-17T05:41:36.120274+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T05:41:46.860779+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"4f31c018-c8a4-4d6d-b0c2-a597c47aae4a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6800","nonce":479374392},{"type":"v1","addr":"172.21.15.150:6801","nonce":479374392}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6802","nonce":479374392},{"type":"v1","addr":"172.21.15.150:6803","nonce":479374392}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6806","nonce":479374392},{"type":"v1","addr":"172.21.15.150:6807","nonce":479374392}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6804","nonce":479374392},{"type":"v1","addr":"172.21.15.150:6805","nonce":479374392}]},"public_addr":"172.21.15.150:6801/479374392","cluster_addr":"172.21.15.150:6803/479374392","heartbeat_back_addr":"172.21.15.150:6807/479374392","heartbeat_front_addr":"172.21.15.150:6805/479374392","state":["exists","up"]},{"osd":1,"uuid":"6ff4a573-500b-4e04-9de3-39265ead78b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6824","nonce":913899800},{"type":"v1","addr":"172.21.15.150:6825","nonce":913899800}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6826","nonce":913899800},{"type":"v1","addr":"172.21.15.150:6827","nonce":913899800}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6830","nonce":913899800},{"type":"v1","addr":"172.21.15.150:6831","nonce":913899800}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6828","nonce":913899800},{"type":"v1","addr":"172.21.15.150:6829","nonce":913899800}]},"public_addr":"172.21.15.150:6825/913899800","cluster_addr":"172.21.15.150:6827/913899800","heartbeat_back_addr":"172.21.15.150:6831/913899800","heartbeat_front_addr":"172.21.15.150:6829/913899800","state":["exists","up"]},{"osd":2,"uuid":"bffea6f9-2465-4182-b205-00436c41ac1c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6816","nonce":363718461},{"type":"v1","addr":"172.21.15.150:6817","nonce":363718461}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6818","nonce":363718461},{"type":"v1","addr":"172.21.15.150:6819","nonce":363718461}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6822","nonce":363718461},{"type":"v1","addr":"172.21.15.150:6823","nonce":363718461}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6820","nonce":363718461},{"type":"v1","addr":"172.21.15.150:6821","nonce":363718461}]},"public_addr":"172.21.15.150:6817/363718461","cluster_addr":"172.21.15.150:6819/363718461","heartbeat_back_addr":"172.21.15.150:6823/363718461","heartbeat_front_addr":"172.21.15.150:6821/363718461","state":["exists","up"]},{"osd":3,"uuid":"cda70430-d1e1-427e-b04e-56db4031d078","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6808","nonce":3550994626},{"type":"v1","addr":"172.21.15.150:6809","nonce":3550994626}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6810","nonce":3550994626},{"type":"v1","addr":"172.21.15.150:6811","nonce":3550994626}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6814","nonce":3550994626},{"type":"v1","addr":"172.21.15.150:6815","nonce":3550994626}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6812","nonce":3550994626},{"type":"v1","addr":"172.21.15.150:6813","nonce":3550994626}]},"public_addr":"172.21.15.150:6809/3550994626","cluster_addr":"172.21.15.150:6811/3550994626","heartbeat_back_addr":"172.21.15.150:6815/3550994626","heartbeat_front_addr":"172.21.15.150:6813/3550994626","state":["exists","up"]},{"osd":4,"uuid":"3a0277fb-5e1e-4f68-bb2d-9a8a0152f64a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6810","nonce":2718261497},{"type":"v1","addr":"172.21.15.176:6811","nonce":2718261497}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6812","nonce":2718261497},{"type":"v1","addr":"172.21.15.176:6813","nonce":2718261497}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6816","nonce":2718261497},{"type":"v1","addr":"172.21.15.176:6817","nonce":2718261497}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6814","nonce":2718261497},{"type":"v1","addr":"172.21.15.176:6815","nonce":2718261497}]},"public_addr":"172.21.15.176:6811/2718261497","cluster_addr":"172.21.15.176:6813/2718261497","heartbeat_back_addr":"172.21.15.176:6817/2718261497","heartbeat_front_addr":"172.21.15.176:6815/2718261497","state":["exists","up"]},{"osd":5,"uuid":"33aebee6-0315-40b7-a11c-6702f0be494d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6818","nonce":2049295774},{"type":"v1","addr":"172.21.15.176:6819","nonce":2049295774}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6820","nonce":2049295774},{"type":"v1","addr":"172.21.15.176:6821","nonce":2049295774}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6824","nonce":2049295774},{"type":"v1","addr":"172.21.15.176:6825","nonce":2049295774}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6822","nonce":2049295774},{"type":"v1","addr":"172.21.15.176:6823","nonce":2049295774}]},"public_addr":"172.21.15.176:6819/2049295774","cluster_addr":"172.21.15.176:6821/2049295774","heartbeat_back_addr":"172.21.15.176:6825/2049295774","heartbeat_front_addr":"172.21.15.176:6823/2049295774","state":["exists","up"]},{"osd":6,"uuid":"4d24f360-6751-4263-841b-d77793d33540","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6826","nonce":2164458476},{"type":"v1","addr":"172.21.15.176:6827","nonce":2164458476}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6828","nonce":2164458476},{"type":"v1","addr":"172.21.15.176:6829","nonce":2164458476}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6832","nonce":2164458476},{"type":"v1","addr":"172.21.15.176:6833","nonce":2164458476}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6830","nonce":2164458476},{"type":"v1","addr":"172.21.15.176:6831","nonce":2164458476}]},"public_addr":"172.21.15.176:6827/2164458476","cluster_addr":"172.21.15.176:6829/2164458476","heartbeat_back_addr":"172.21.15.176:6833/2164458476","heartbeat_front_addr":"172.21.15.176:6831/2164458476","state":["exists","up"]},{"osd":7,"uuid":"c8594fda-c74a-4ba9-8277-caf101d58ca1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6802","nonce":3239587708},{"type":"v1","addr":"172.21.15.176:6803","nonce":3239587708}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6804","nonce":3239587708},{"type":"v1","addr":"172.21.15.176:6805","nonce":3239587708}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6808","nonce":3239587708},{"type":"v1","addr":"172.21.15.176:6809","nonce":3239587708}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6806","nonce":3239587708},{"type":"v1","addr":"172.21.15.176:6807","nonce":3239587708}]},"public_addr":"172.21.15.176:6803/3239587708","cluster_addr":"172.21.15.176:6805/3239587708","heartbeat_back_addr":"172.21.15.176:6809/3239587708","heartbeat_front_addr":"172.21.15.176:6807/3239587708","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:41:41.905151+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:41:42.705679+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:41:42.459673+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:41:42.440819+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:41:42.668428+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:41:42.694972+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:41:43.078535+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:41:42.363539+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.150:6835/1137907102":"2024-09-18T05:45:19.711953+0000","172.21.15.150:6834/1137907102":"2024-09-18T05:45:19.711953+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":7,"snaps":[{"begin":2,"length":2}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T05:45:24.251 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:24.250+0000 7f55974b6640 1 -- 172.21.15.150:0/3419585769 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f557c0794c0 msgr2=0x7f557c07b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:45:24.251 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:24.250+0000 7f55974b6640 1 --2- 172.21.15.150:0/3419585769 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f557c0794c0 0x7f557c07b9d0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f5584034000 tx=0x7f5584004730 comp rx=0 tx=0).stop 2024-09-17T05:45:24.251 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:24.250+0000 7f55974b6640 1 -- 172.21.15.150:0/3419585769 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f55900aebc0 msgr2=0x7f5590074870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:45:24.251 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:24.250+0000 7f55974b6640 1 --2- 172.21.15.150:0/3419585769 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f55900aebc0 0x7f5590074870 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7f558000ba80 tx=0x7f558000bf40 comp rx=0 tx=0).stop 2024-09-17T05:45:24.251 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:24.250+0000 7f55974b6640 1 -- 172.21.15.150:0/3419585769 shutdown_connections 2024-09-17T05:45:24.252 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:24.250+0000 7f55974b6640 1 --2- 172.21.15.150:0/3419585769 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5590152920 0x7f559014f880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:24.252 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:24.250+0000 7f55974b6640 1 --2- 172.21.15.150:0/3419585769 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f557c0794c0 0x7f557c07b9d0 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:24.252 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:24.250+0000 7f55974b6640 1 --2- 172.21.15.150:0/3419585769 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f559015f910 0x7f55901e9650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:24.252 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:24.250+0000 7f55974b6640 1 --2- 172.21.15.150:0/3419585769 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f55900aebc0 0x7f5590074870 unknown :-1 s=CLOSED pgs=582 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:24.252 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:24.250+0000 7f55974b6640 1 -- 172.21.15.150:0/3419585769 >> 172.21.15.150:0/3419585769 conn(0x7f559006d730 msgr2=0x7f559015cf60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:45:24.252 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:24.250+0000 7f55974b6640 1 -- 172.21.15.150:0/3419585769 shutdown_connections 2024-09-17T05:45:24.252 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:24.250+0000 7f55974b6640 1 -- 172.21.15.150:0/3419585769 wait complete. 2024-09-17T05:45:24.263 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-17T05:41:46.860779+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-17T05:45:24.263 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-17T05:45:24.381 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:24.379+0000 7f9b81fc3640 1 -- 172.21.15.150:0/627400502 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9b7c0af570 msgr2=0x7f9b7c0d0980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:45:24.381 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:24.379+0000 7f9b81fc3640 1 --2- 172.21.15.150:0/627400502 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9b7c0af570 0x7f9b7c0d0980 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7f9b70009830 tx=0x7f9b7002a3f0 comp rx=0 tx=0).stop 2024-09-17T05:45:24.381 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:24.379+0000 7f9b81fc3640 1 -- 172.21.15.150:0/627400502 shutdown_connections 2024-09-17T05:45:24.381 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:24.379+0000 7f9b81fc3640 1 --2- 172.21.15.150:0/627400502 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9b7c0d0ec0 0x7f9b7c0cd040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:24.381 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:24.379+0000 7f9b81fc3640 1 --2- 172.21.15.150:0/627400502 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9b7c0af570 0x7f9b7c0d0980 unknown :-1 s=CLOSED pgs=584 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:24.381 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:24.379+0000 7f9b81fc3640 1 -- 172.21.15.150:0/627400502 >> 172.21.15.150:0/627400502 conn(0x7f9b7c0cefb0 msgr2=0x7f9b7c0cf3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:45:24.381 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:24.380+0000 7f9b81fc3640 1 -- 172.21.15.150:0/627400502 shutdown_connections 2024-09-17T05:45:24.382 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:24.380+0000 7f9b81fc3640 1 -- 172.21.15.150:0/627400502 wait complete. 2024-09-17T05:45:24.382 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:24.381+0000 7f9b81fc3640 1 Processor -- start 2024-09-17T05:45:24.382 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:24.381+0000 7f9b81fc3640 1 -- start start 2024-09-17T05:45:24.385 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:24.383+0000 7f9b81fc3640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9b7c0af160 0x7f9b7c0c86f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:45:24.385 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:24.383+0000 7f9b81fc3640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9b7c0af570 0x7f9b7c15c9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:45:24.385 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:24.383+0000 7f9b81fc3640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9b7c0d0ec0 0x7f9b7c15f510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:45:24.385 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:24.383+0000 7f9b81fc3640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f9b7c0ced50 con 0x7f9b7c0af160 2024-09-17T05:45:24.385 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:24.383+0000 7f9b81fc3640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f9b7c0cebd0 con 0x7f9b7c0af570 2024-09-17T05:45:24.385 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:24.383+0000 7f9b81fc3640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f9b7c0d12d0 con 0x7f9b7c0d0ec0 2024-09-17T05:45:24.385 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:24.383+0000 7f9b7b7fe640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9b7c0af160 0x7f9b7c0c86f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:45:24.386 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:24.383+0000 7f9b7b7fe640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9b7c0af160 0x7f9b7c0c86f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:36634/0 (socket says 172.21.15.150:36634) 2024-09-17T05:45:24.386 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:24.383+0000 7f9b7b7fe640 1 -- 172.21.15.150:0/1366156951 learned_addr learned my addr 172.21.15.150:0/1366156951 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:45:24.386 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:24.383+0000 7f9b7bfff640 1 --2- 172.21.15.150:0/1366156951 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9b7c0d0ec0 0x7f9b7c15f510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:45:24.386 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:24.383+0000 7f9b7affd640 1 --2- 172.21.15.150:0/1366156951 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9b7c0af570 0x7f9b7c15c9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:45:24.386 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:24.383+0000 7f9b7b7fe640 1 -- 172.21.15.150:0/1366156951 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9b7c0d0ec0 msgr2=0x7f9b7c15f510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:45:24.386 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:24.383+0000 7f9b7b7fe640 1 --2- 172.21.15.150:0/1366156951 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9b7c0d0ec0 0x7f9b7c15f510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:24.386 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:24.383+0000 7f9b7b7fe640 1 -- 172.21.15.150:0/1366156951 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9b7c0af570 msgr2=0x7f9b7c15c9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:45:24.386 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:24.383+0000 7f9b7b7fe640 1 --2- 172.21.15.150:0/1366156951 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9b7c0af570 0x7f9b7c15c9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:24.386 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:24.383+0000 7f9b7b7fe640 1 -- 172.21.15.150:0/1366156951 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9b7c1f6c80 con 0x7f9b7c0af160 2024-09-17T05:45:24.386 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:24.383+0000 7f9b7bfff640 1 --2- 172.21.15.150:0/1366156951 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9b7c0d0ec0 0x7f9b7c15f510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T05:45:24.386 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:24.383+0000 7f9b7affd640 1 --2- 172.21.15.150:0/1366156951 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9b7c0af570 0x7f9b7c15c9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T05:45:24.387 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:24.383+0000 7f9b7b7fe640 1 --2- 172.21.15.150:0/1366156951 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9b7c0af160 0x7f9b7c0c86f0 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7f9b6c00c460 tx=0x7f9b6c00c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:45:24.387 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:24.383+0000 7f9b63fff640 1 -- 172.21.15.150:0/1366156951 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b6c016020 con 0x7f9b7c0af160 2024-09-17T05:45:24.387 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:24.383+0000 7f9b63fff640 1 -- 172.21.15.150:0/1366156951 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9b6c012940 con 0x7f9b7c0af160 2024-09-17T05:45:24.387 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:24.383+0000 7f9b63fff640 1 -- 172.21.15.150:0/1366156951 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b6c012d90 con 0x7f9b7c0af160 2024-09-17T05:45:24.387 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:24.384+0000 7f9b81fc3640 1 -- 172.21.15.150:0/1366156951 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9b7c1f3640 con 0x7f9b7c0af160 2024-09-17T05:45:24.387 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:24.384+0000 7f9b81fc3640 1 -- 172.21.15.150:0/1366156951 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9b7c1f7180 con 0x7f9b7c0af160 2024-09-17T05:45:24.387 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:24.384+0000 7f9b81fc3640 1 -- 172.21.15.150:0/1366156951 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9b7c0d0980 con 0x7f9b7c0af160 2024-09-17T05:45:24.388 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:24.385+0000 7f9b63fff640 1 -- 172.21.15.150:0/1366156951 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 15) ==== 102257+0+0 (secure 0 0 0) 0x7f9b6c019020 con 0x7f9b7c0af160 2024-09-17T05:45:24.388 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:24.386+0000 7f9b63fff640 1 --2- 172.21.15.150:0/1366156951 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f9b68079490 0x7f9b6807b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:45:24.388 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:24.386+0000 7f9b63fff640 1 -- 172.21.15.150:0/1366156951 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(51..51 src has 1..51) ==== 4971+0+0 (secure 0 0 0) 0x7f9b6c098f40 con 0x7f9b7c0af160 2024-09-17T05:45:24.388 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:24.386+0000 7f9b7affd640 1 --2- 172.21.15.150:0/1366156951 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f9b68079490 0x7f9b6807b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:45:24.388 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:24.386+0000 7f9b7affd640 1 --2- 172.21.15.150:0/1366156951 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f9b68079490 0x7f9b6807b9a0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f9b70034000 tx=0x7f9b70004730 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:45:24.391 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:24.390+0000 7f9b63fff640 1 -- 172.21.15.150:0/1366156951 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f9b6c020070 con 0x7f9b7c0af160 2024-09-17T05:45:24.567 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:24.566+0000 7f9b81fc3640 1 -- 172.21.15.150:0/1366156951 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f9b7c0cf740 con 0x7f9b7c0af160 2024-09-17T05:45:24.567 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:24.566+0000 7f9b63fff640 1 -- 172.21.15.150:0/1366156951 <== mon.0 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v51) ==== 93+0+10 (secure 0 0 0) 0x7f9b6c062ec0 con 0x7f9b7c0af160 2024-09-17T05:45:24.567 INFO:teuthology.orchestra.run.smithi150.stdout:pg_num: 1 2024-09-17T05:45:24.570 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:24.569+0000 7f9b81fc3640 1 -- 172.21.15.150:0/1366156951 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f9b68079490 msgr2=0x7f9b6807b9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:45:24.570 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:24.569+0000 7f9b81fc3640 1 --2- 172.21.15.150:0/1366156951 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f9b68079490 0x7f9b6807b9a0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f9b70034000 tx=0x7f9b70004730 comp rx=0 tx=0).stop 2024-09-17T05:45:24.571 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:24.569+0000 7f9b81fc3640 1 -- 172.21.15.150:0/1366156951 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9b7c0af160 msgr2=0x7f9b7c0c86f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:45:24.571 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:24.569+0000 7f9b81fc3640 1 --2- 172.21.15.150:0/1366156951 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9b7c0af160 0x7f9b7c0c86f0 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7f9b6c00c460 tx=0x7f9b6c00c920 comp rx=0 tx=0).stop 2024-09-17T05:45:24.571 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:24.569+0000 7f9b81fc3640 1 -- 172.21.15.150:0/1366156951 shutdown_connections 2024-09-17T05:45:24.571 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:24.569+0000 7f9b81fc3640 1 --2- 172.21.15.150:0/1366156951 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9b7c0af570 0x7f9b7c15c9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:24.571 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:24.569+0000 7f9b81fc3640 1 --2- 172.21.15.150:0/1366156951 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f9b68079490 0x7f9b6807b9a0 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:24.571 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:24.569+0000 7f9b81fc3640 1 --2- 172.21.15.150:0/1366156951 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9b7c0d0ec0 0x7f9b7c15f510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:24.572 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:24.569+0000 7f9b81fc3640 1 --2- 172.21.15.150:0/1366156951 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9b7c0af160 0x7f9b7c0c86f0 unknown :-1 s=CLOSED pgs=585 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:24.572 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:24.569+0000 7f9b81fc3640 1 -- 172.21.15.150:0/1366156951 >> 172.21.15.150:0/1366156951 conn(0x7f9b7c0cefb0 msgr2=0x7f9b7c0ce4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:45:24.572 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:24.569+0000 7f9b81fc3640 1 -- 172.21.15.150:0/1366156951 shutdown_connections 2024-09-17T05:45:24.572 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:24.569+0000 7f9b81fc3640 1 -- 172.21.15.150:0/1366156951 wait complete. 2024-09-17T05:45:24.581 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_volumes.TestCloneProgressReporter.test_clones_less_than_cloner_threads' 2024-09-17T05:45:24.696 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:24.695+0000 7f7373b50640 1 -- 172.21.15.150:0/4042889176 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f736c0aebc0 msgr2=0x7f736c152920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:45:24.697 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:24.695+0000 7f7373b50640 1 --2- 172.21.15.150:0/4042889176 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f736c0aebc0 0x7f736c152920 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7f7368009830 tx=0x7f736802a480 comp rx=0 tx=0).stop 2024-09-17T05:45:24.697 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:24.695+0000 7f7373b50640 1 -- 172.21.15.150:0/4042889176 shutdown_connections 2024-09-17T05:45:24.697 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:24.695+0000 7f7373b50640 1 --2- 172.21.15.150:0/4042889176 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f736c15fae0 0x7f736c0b3750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:24.697 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:24.695+0000 7f7373b50640 1 --2- 172.21.15.150:0/4042889176 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f736c0aebc0 0x7f736c152920 unknown :-1 s=CLOSED pgs=587 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:24.697 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:24.695+0000 7f7373b50640 1 -- 172.21.15.150:0/4042889176 >> 172.21.15.150:0/4042889176 conn(0x7f736c06d730 msgr2=0x7f736c0b1e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:45:24.697 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:24.695+0000 7f7373b50640 1 -- 172.21.15.150:0/4042889176 shutdown_connections 2024-09-17T05:45:24.698 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:24.695+0000 7f7373b50640 1 -- 172.21.15.150:0/4042889176 wait complete. 2024-09-17T05:45:24.704 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:24.697+0000 7f7373b50640 1 Processor -- start 2024-09-17T05:45:24.704 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:24.697+0000 7f7373b50640 1 -- start start 2024-09-17T05:45:24.704 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:24.698+0000 7f7373b50640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f736c0aebc0 0x7f736c1564a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:45:24.704 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:24.698+0000 7f7373b50640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f736c0b2750 0x7f736c155a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:45:24.704 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:24.698+0000 7f7373b50640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f736c1f5650 0x7f736c1f5a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:45:24.705 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:24.698+0000 7f7373b50640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f736c0b4190 con 0x7f736c1f5650 2024-09-17T05:45:24.705 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:24.698+0000 7f7373b50640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f736c0b4010 con 0x7f736c0aebc0 2024-09-17T05:45:24.705 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:24.698+0000 7f7373b50640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f736c0b4310 con 0x7f736c0b2750 2024-09-17T05:45:24.705 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:24.698+0000 7f73720ed640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f736c1f5650 0x7f736c1f5a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:45:24.705 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:24.698+0000 7f73720ed640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f736c1f5650 0x7f736c1f5a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:36654/0 (socket says 172.21.15.150:36654) 2024-09-17T05:45:24.706 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:24.698+0000 7f73720ed640 1 -- 172.21.15.150:0/1852804836 learned_addr learned my addr 172.21.15.150:0/1852804836 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:45:24.706 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:24.699+0000 7f73710eb640 1 --2- 172.21.15.150:0/1852804836 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f736c0b2750 0x7f736c155a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:45:24.706 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:24.699+0000 7f73718ec640 1 --2- 172.21.15.150:0/1852804836 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f736c0aebc0 0x7f736c1564a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:45:24.706 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:24.699+0000 7f73720ed640 1 -- 172.21.15.150:0/1852804836 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f736c0b2750 msgr2=0x7f736c155a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:45:24.706 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:24.699+0000 7f73720ed640 1 --2- 172.21.15.150:0/1852804836 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f736c0b2750 0x7f736c155a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:24.706 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:24.699+0000 7f73720ed640 1 -- 172.21.15.150:0/1852804836 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f736c0aebc0 msgr2=0x7f736c1564a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:45:24.706 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:24.699+0000 7f73720ed640 1 --2- 172.21.15.150:0/1852804836 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f736c0aebc0 0x7f736c1564a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:24.707 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:24.699+0000 7f73720ed640 1 -- 172.21.15.150:0/1852804836 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f736c1f5fa0 con 0x7f736c1f5650 2024-09-17T05:45:24.707 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:24.699+0000 7f73710eb640 1 --2- 172.21.15.150:0/1852804836 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f736c0b2750 0x7f736c155a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T05:45:24.707 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:24.699+0000 7f73718ec640 1 --2- 172.21.15.150:0/1852804836 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f736c0aebc0 0x7f736c1564a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T05:45:24.707 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:24.699+0000 7f73720ed640 1 --2- 172.21.15.150:0/1852804836 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f736c1f5650 0x7f736c1f5a60 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7f736400cad0 tx=0x7f736400cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:45:24.707 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:24.699+0000 7f73627fc640 1 -- 172.21.15.150:0/1852804836 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f736400ae20 con 0x7f736c1f5650 2024-09-17T05:45:24.707 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:24.699+0000 7f73627fc640 1 -- 172.21.15.150:0/1852804836 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f736400f450 con 0x7f736c1f5650 2024-09-17T05:45:24.708 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:24.699+0000 7f73627fc640 1 -- 172.21.15.150:0/1852804836 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f736400f8c0 con 0x7f736c1f5650 2024-09-17T05:45:24.708 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:24.699+0000 7f7373b50640 1 -- 172.21.15.150:0/1852804836 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f736c1f6420 con 0x7f736c1f5650 2024-09-17T05:45:24.708 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:24.699+0000 7f7373b50640 1 -- 172.21.15.150:0/1852804836 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f736c159100 con 0x7f736c1f5650 2024-09-17T05:45:24.708 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:24.700+0000 7f7373b50640 1 -- 172.21.15.150:0/1852804836 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f736c0b47c0 con 0x7f736c1f5650 2024-09-17T05:45:24.708 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:24.701+0000 7f73627fc640 1 -- 172.21.15.150:0/1852804836 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 15) ==== 102257+0+0 (secure 0 0 0) 0x7f736400fa60 con 0x7f736c1f5650 2024-09-17T05:45:24.708 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:24.701+0000 7f73627fc640 1 --2- 172.21.15.150:0/1852804836 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f7350079490 0x7f735007b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:45:24.708 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:24.701+0000 7f73627fc640 1 -- 172.21.15.150:0/1852804836 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(51..51 src has 1..51) ==== 4971+0+0 (secure 0 0 0) 0x7f736409a100 con 0x7f736c1f5650 2024-09-17T05:45:24.709 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:24.701+0000 7f73718ec640 1 --2- 172.21.15.150:0/1852804836 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f7350079490 0x7f735007b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:45:24.709 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:24.702+0000 7f73718ec640 1 --2- 172.21.15.150:0/1852804836 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f7350079490 0x7f735007b9a0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f7368034000 tx=0x7f7368004730 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:45:24.709 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:24.706+0000 7f73627fc640 1 -- 172.21.15.150:0/1852804836 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f736c1f5fa0 con 0x7f736c1f5650 2024-09-17T05:45:24.932 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-17T05:45:24.935 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-17T05:45:24.948 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:24.948+0000 7f7373b50640 1 -- 172.21.15.150:0/1852804836 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_volumes.TestCloneProgressReporter.test_clones_less_than_cloner_threads"]} v 0) -- 0x7f736c15d800 con 0x7f736c1f5650 2024-09-17T05:45:25.938 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:25.937+0000 7f73627fc640 1 -- 172.21.15.150:0/1852804836 <== mon.0 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_volumes.TestCloneProgressReporter.test_clones_less_than_cloner_threads"]}]=0 v184) ==== 170+0+0 (secure 0 0 0) 0x7f7364014030 con 0x7f736c1f5650 2024-09-17T05:45:25.941 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:25.940+0000 7f7373b50640 1 -- 172.21.15.150:0/1852804836 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f7350079490 msgr2=0x7f735007b9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:45:25.941 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:25.940+0000 7f7373b50640 1 --2- 172.21.15.150:0/1852804836 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f7350079490 0x7f735007b9a0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f7368034000 tx=0x7f7368004730 comp rx=0 tx=0).stop 2024-09-17T05:45:25.941 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:25.940+0000 7f7373b50640 1 -- 172.21.15.150:0/1852804836 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f736c1f5650 msgr2=0x7f736c1f5a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:45:25.942 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:25.940+0000 7f7373b50640 1 --2- 172.21.15.150:0/1852804836 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f736c1f5650 0x7f736c1f5a60 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7f736400cad0 tx=0x7f736400cf90 comp rx=0 tx=0).stop 2024-09-17T05:45:25.942 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:25.941+0000 7f7373b50640 1 -- 172.21.15.150:0/1852804836 shutdown_connections 2024-09-17T05:45:25.942 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:25.941+0000 7f7373b50640 1 --2- 172.21.15.150:0/1852804836 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f7350079490 0x7f735007b9a0 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:25.942 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:25.941+0000 7f7373b50640 1 --2- 172.21.15.150:0/1852804836 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f736c1f5650 0x7f736c1f5a60 unknown :-1 s=CLOSED pgs=588 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:25.942 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:25.941+0000 7f7373b50640 1 --2- 172.21.15.150:0/1852804836 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f736c0b2750 0x7f736c155a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:25.942 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:25.941+0000 7f7373b50640 1 --2- 172.21.15.150:0/1852804836 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f736c0aebc0 0x7f736c1564a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:25.942 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:25.941+0000 7f7373b50640 1 -- 172.21.15.150:0/1852804836 >> 172.21.15.150:0/1852804836 conn(0x7f736c06d730 msgr2=0x7f736c0b49d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:45:25.942 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:25.941+0000 7f7373b50640 1 -- 172.21.15.150:0/1852804836 shutdown_connections 2024-09-17T05:45:25.942 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:25.941+0000 7f7373b50640 1 -- 172.21.15.150:0/1852804836 wait complete. 2024-09-17T05:45:25.955 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config dump 2024-09-17T05:45:26.075 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:26.074+0000 7f5e8747e640 1 -- 172.21.15.150:0/3142476011 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5e8015ee30 msgr2=0x7f5e800b2840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:45:26.075 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:26.074+0000 7f5e8747e640 1 --2- 172.21.15.150:0/3142476011 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5e8015ee30 0x7f5e800b2840 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7f5e70005fd0 tx=0x7f5e7002aa00 comp rx=0 tx=0).stop 2024-09-17T05:45:26.075 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:26.074+0000 7f5e8747e640 1 -- 172.21.15.150:0/3142476011 shutdown_connections 2024-09-17T05:45:26.075 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:26.074+0000 7f5e8747e640 1 --2- 172.21.15.150:0/3142476011 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5e800b5410 0x7f5e800b5820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:26.075 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:26.074+0000 7f5e8747e640 1 --2- 172.21.15.150:0/3142476011 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5e8015ee30 0x7f5e800b2840 unknown :-1 s=CLOSED pgs=589 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:26.075 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:26.074+0000 7f5e8747e640 1 -- 172.21.15.150:0/3142476011 >> 172.21.15.150:0/3142476011 conn(0x7f5e800b2fd0 msgr2=0x7f5e800b33e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:45:26.075 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:26.074+0000 7f5e8747e640 1 -- 172.21.15.150:0/3142476011 shutdown_connections 2024-09-17T05:45:26.075 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:26.074+0000 7f5e8747e640 1 -- 172.21.15.150:0/3142476011 wait complete. 2024-09-17T05:45:26.076 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:26.076+0000 7f5e8747e640 1 Processor -- start 2024-09-17T05:45:26.076 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:26.076+0000 7f5e8747e640 1 -- start start 2024-09-17T05:45:26.079 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:26.077+0000 7f5e8747e640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5e800b5410 0x7f5e800c4ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:45:26.079 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:26.077+0000 7f5e8747e640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5e800cf7c0 0x7f5e800cdbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:45:26.079 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:26.077+0000 7f5e8747e640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5e8015ee30 0x7f5e8009e780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:45:26.079 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:26.077+0000 7f5e8747e640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f5e800b6150 con 0x7f5e800b5410 2024-09-17T05:45:26.079 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:26.077+0000 7f5e8747e640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f5e800b5fd0 con 0x7f5e8015ee30 2024-09-17T05:45:26.079 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:26.077+0000 7f5e8747e640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f5e800b62d0 con 0x7f5e800cf7c0 2024-09-17T05:45:26.079 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:26.077+0000 7f5e8521a640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5e800b5410 0x7f5e800c4ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:45:26.079 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:26.077+0000 7f5e8521a640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5e800b5410 0x7f5e800c4ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:36668/0 (socket says 172.21.15.150:36668) 2024-09-17T05:45:26.079 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:26.077+0000 7f5e8521a640 1 -- 172.21.15.150:0/2728608059 learned_addr learned my addr 172.21.15.150:0/2728608059 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:45:26.079 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:26.077+0000 7f5e85a1b640 1 --2- 172.21.15.150:0/2728608059 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5e8015ee30 0x7f5e8009e780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:45:26.079 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:26.077+0000 7f5e84a19640 1 --2- 172.21.15.150:0/2728608059 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5e800cf7c0 0x7f5e800cdbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:45:26.080 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:26.077+0000 7f5e8521a640 1 -- 172.21.15.150:0/2728608059 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5e800cf7c0 msgr2=0x7f5e800cdbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:45:26.080 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:26.077+0000 7f5e8521a640 1 --2- 172.21.15.150:0/2728608059 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5e800cf7c0 0x7f5e800cdbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:26.080 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:26.077+0000 7f5e8521a640 1 -- 172.21.15.150:0/2728608059 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5e8015ee30 msgr2=0x7f5e8009e780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:45:26.080 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:26.077+0000 7f5e8521a640 1 --2- 172.21.15.150:0/2728608059 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5e8015ee30 0x7f5e8009e780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:26.080 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:26.077+0000 7f5e8521a640 1 -- 172.21.15.150:0/2728608059 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5e801f7bd0 con 0x7f5e800b5410 2024-09-17T05:45:26.080 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:26.077+0000 7f5e85a1b640 1 --2- 172.21.15.150:0/2728608059 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5e8015ee30 0x7f5e8009e780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:45:26.080 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:26.078+0000 7f5e8521a640 1 --2- 172.21.15.150:0/2728608059 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5e800b5410 0x7f5e800c4ec0 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7f5e70000f80 tx=0x7f5e70003f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:45:26.080 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:26.078+0000 7f5e7dffb640 1 -- 172.21.15.150:0/2728608059 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e70046070 con 0x7f5e800b5410 2024-09-17T05:45:26.080 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:26.078+0000 7f5e7dffb640 1 -- 172.21.15.150:0/2728608059 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f5e700045c0 con 0x7f5e800b5410 2024-09-17T05:45:26.080 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:26.078+0000 7f5e7dffb640 1 -- 172.21.15.150:0/2728608059 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e70033070 con 0x7f5e800b5410 2024-09-17T05:45:26.080 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:26.078+0000 7f5e8747e640 1 -- 172.21.15.150:0/2728608059 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5e801f7eb0 con 0x7f5e800b5410 2024-09-17T05:45:26.081 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:26.078+0000 7f5e8747e640 1 -- 172.21.15.150:0/2728608059 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5e800c5420 con 0x7f5e800b5410 2024-09-17T05:45:26.086 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:26.079+0000 7f5e8747e640 1 -- 172.21.15.150:0/2728608059 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5e800c56a0 con 0x7f5e800b5410 2024-09-17T05:45:26.086 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:26.080+0000 7f5e7dffb640 1 -- 172.21.15.150:0/2728608059 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 15) ==== 102257+0+0 (secure 0 0 0) 0x7f5e70036070 con 0x7f5e800b5410 2024-09-17T05:45:26.086 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:26.080+0000 7f5e7dffb640 1 --2- 172.21.15.150:0/2728608059 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f5e6c079490 0x7f5e6c07b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:45:26.086 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:26.081+0000 7f5e7dffb640 1 -- 172.21.15.150:0/2728608059 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(51..51 src has 1..51) ==== 4971+0+0 (secure 0 0 0) 0x7f5e700ba470 con 0x7f5e800b5410 2024-09-17T05:45:26.086 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:26.081+0000 7f5e84a19640 1 --2- 172.21.15.150:0/2728608059 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f5e6c079490 0x7f5e6c07b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:45:26.086 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:26.081+0000 7f5e84a19640 1 --2- 172.21.15.150:0/2728608059 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f5e6c079490 0x7f5e6c07b9a0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f5e74006fd0 tx=0x7f5e74008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:45:26.086 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:26.085+0000 7f5e7dffb640 1 -- 172.21.15.150:0/2728608059 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f5e7003e070 con 0x7f5e800b5410 2024-09-17T05:45:26.260 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:26.260+0000 7f5e8747e640 1 -- 172.21.15.150:0/2728608059 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "config dump"} v 0) -- 0x7f5e8009e080 con 0x7f5e800b5410 2024-09-17T05:45:26.261 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:26.260+0000 7f5e7dffb640 1 -- 172.21.15.150:0/2728608059 <== mon.0 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "config dump"}]=0 v37) ==== 59+0+2294 (secure 0 0 0) 0x7f5e8009e080 con 0x7f5e800b5410 2024-09-17T05:45:26.261 INFO:teuthology.orchestra.run.smithi150.stdout:WHO MASK LEVEL OPTION VALUE RO 2024-09-17T05:45:26.261 INFO:teuthology.orchestra.run.smithi150.stdout:mon advanced mon_op_complaint_time 120 2024-09-17T05:45:26.261 INFO:teuthology.orchestra.run.smithi150.stdout:mgr advanced client_mount_timeout 30 2024-09-17T05:45:26.261 INFO:teuthology.orchestra.run.smithi150.stdout:mgr advanced debug_client 20/20 2024-09-17T05:45:26.262 INFO:teuthology.orchestra.run.smithi150.stdout:mgr advanced debug_mgr 20/20 2024-09-17T05:45:26.262 INFO:teuthology.orchestra.run.smithi150.stdout:mgr advanced debug_ms 1/1 2024-09-17T05:45:26.262 INFO:teuthology.orchestra.run.smithi150.stdout:mgr dev mon_warn_on_pool_no_app false 2024-09-17T05:45:26.262 INFO:teuthology.orchestra.run.smithi150.stdout:osd advanced osd_op_complaint_time 180.000000 2024-09-17T05:45:26.262 INFO:teuthology.orchestra.run.smithi150.stdout:osd.0 basic osd_mclock_max_capacity_iops_ssd 6764.239331 2024-09-17T05:45:26.262 INFO:teuthology.orchestra.run.smithi150.stdout:osd.1 basic osd_mclock_max_capacity_iops_ssd 4956.769289 2024-09-17T05:45:26.262 INFO:teuthology.orchestra.run.smithi150.stdout:osd.2 basic osd_mclock_max_capacity_iops_ssd 5099.704467 2024-09-17T05:45:26.262 INFO:teuthology.orchestra.run.smithi150.stdout:osd.3 basic osd_mclock_max_capacity_iops_ssd 4681.616196 2024-09-17T05:45:26.262 INFO:teuthology.orchestra.run.smithi150.stdout:osd.4 basic osd_mclock_max_capacity_iops_ssd 4723.364425 2024-09-17T05:45:26.262 INFO:teuthology.orchestra.run.smithi150.stdout:osd.5 basic osd_mclock_max_capacity_iops_ssd 4509.722124 2024-09-17T05:45:26.262 INFO:teuthology.orchestra.run.smithi150.stdout:osd.6 basic osd_mclock_max_capacity_iops_ssd 6380.664158 2024-09-17T05:45:26.262 INFO:teuthology.orchestra.run.smithi150.stdout:osd.7 basic osd_mclock_max_capacity_iops_ssd 4303.333825 2024-09-17T05:45:26.262 INFO:teuthology.orchestra.run.smithi150.stdout:mds advanced debug_mds 20/20 2024-09-17T05:45:26.262 INFO:teuthology.orchestra.run.smithi150.stdout:mds advanced debug_mds_balancer 20/20 2024-09-17T05:45:26.263 INFO:teuthology.orchestra.run.smithi150.stdout:mds advanced debug_ms 2/2 2024-09-17T05:45:26.263 INFO:teuthology.orchestra.run.smithi150.stdout:mds dev mds_debug_frag true 2024-09-17T05:45:26.263 INFO:teuthology.orchestra.run.smithi150.stdout:mds dev mds_debug_scatterstat true 2024-09-17T05:45:26.263 INFO:teuthology.orchestra.run.smithi150.stdout:mds advanced mds_op_complaint_time 180.000000 2024-09-17T05:45:26.263 INFO:teuthology.orchestra.run.smithi150.stdout:mds dev mds_verify_scatter true 2024-09-17T05:45:26.263 INFO:teuthology.orchestra.run.smithi150.stdout:mds advanced osd_op_complaint_time 180.000000 2024-09-17T05:45:26.263 INFO:teuthology.orchestra.run.smithi150.stdout:mds advanced rados_mon_op_timeout 900 2024-09-17T05:45:26.263 INFO:teuthology.orchestra.run.smithi150.stdout:mds advanced rados_osd_op_timeout 900 2024-09-17T05:45:26.263 INFO:teuthology.orchestra.run.smithi150.stdout:client advanced client_mount_timeout 600 2024-09-17T05:45:26.263 INFO:teuthology.orchestra.run.smithi150.stdout:client advanced debug_client 20/20 2024-09-17T05:45:26.263 INFO:teuthology.orchestra.run.smithi150.stdout:client advanced debug_ms 1/1 2024-09-17T05:45:26.263 INFO:teuthology.orchestra.run.smithi150.stdout:client advanced rados_mon_op_timeout 900 2024-09-17T05:45:26.263 INFO:teuthology.orchestra.run.smithi150.stdout:client advanced rados_osd_op_timeout 900 2024-09-17T05:45:26.264 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:26.263+0000 7f5e8747e640 1 -- 172.21.15.150:0/2728608059 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f5e6c079490 msgr2=0x7f5e6c07b9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:45:26.264 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:26.263+0000 7f5e8747e640 1 --2- 172.21.15.150:0/2728608059 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f5e6c079490 0x7f5e6c07b9a0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f5e74006fd0 tx=0x7f5e74008040 comp rx=0 tx=0).stop 2024-09-17T05:45:26.265 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:26.263+0000 7f5e8747e640 1 -- 172.21.15.150:0/2728608059 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5e800b5410 msgr2=0x7f5e800c4ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:45:26.265 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:26.263+0000 7f5e8747e640 1 --2- 172.21.15.150:0/2728608059 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5e800b5410 0x7f5e800c4ec0 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7f5e70000f80 tx=0x7f5e70003f90 comp rx=0 tx=0).stop 2024-09-17T05:45:26.265 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:26.263+0000 7f5e8747e640 1 -- 172.21.15.150:0/2728608059 shutdown_connections 2024-09-17T05:45:26.265 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:26.263+0000 7f5e8747e640 1 --2- 172.21.15.150:0/2728608059 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5e8015ee30 0x7f5e8009e780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:26.265 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:26.263+0000 7f5e8747e640 1 --2- 172.21.15.150:0/2728608059 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f5e6c079490 0x7f5e6c07b9a0 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:26.265 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:26.263+0000 7f5e8747e640 1 --2- 172.21.15.150:0/2728608059 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5e800cf7c0 0x7f5e800cdbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:26.265 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:26.263+0000 7f5e8747e640 1 --2- 172.21.15.150:0/2728608059 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5e800b5410 0x7f5e800c4ec0 unknown :-1 s=CLOSED pgs=590 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:26.265 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:26.263+0000 7f5e8747e640 1 -- 172.21.15.150:0/2728608059 >> 172.21.15.150:0/2728608059 conn(0x7f5e800b2fd0 msgr2=0x7f5e80071580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:45:26.265 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:26.263+0000 7f5e8747e640 1 -- 172.21.15.150:0/2728608059 shutdown_connections 2024-09-17T05:45:26.265 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:26.263+0000 7f5e8747e640 1 -- 172.21.15.150:0/2728608059 wait complete. 2024-09-17T05:45:26.275 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-09-17T05:45:26.391 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:26.391+0000 7f7d2125c640 1 -- 172.21.15.150:0/3709549454 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7d1c0b7d70 msgr2=0x7f7d1c0d0a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:45:26.392 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:26.391+0000 7f7d2125c640 1 --2- 172.21.15.150:0/3709549454 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7d1c0b7d70 0x7f7d1c0d0a80 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7f7d10009830 tx=0x7f7d1002a3e0 comp rx=0 tx=0).stop 2024-09-17T05:45:26.392 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:26.391+0000 7f7d2125c640 1 -- 172.21.15.150:0/3709549454 shutdown_connections 2024-09-17T05:45:26.392 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:26.391+0000 7f7d2125c640 1 --2- 172.21.15.150:0/3709549454 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7d1c0b7d70 0x7f7d1c0d0a80 unknown :-1 s=CLOSED pgs=592 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:26.392 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:26.391+0000 7f7d2125c640 1 --2- 172.21.15.150:0/3709549454 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7d1c0b7960 0x7f7d1c0af1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:26.392 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:26.391+0000 7f7d2125c640 1 -- 172.21.15.150:0/3709549454 >> 172.21.15.150:0/3709549454 conn(0x7f7d1c0cef20 msgr2=0x7f7d1c0cf330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:45:26.392 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:26.391+0000 7f7d2125c640 1 -- 172.21.15.150:0/3709549454 shutdown_connections 2024-09-17T05:45:26.392 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:26.391+0000 7f7d2125c640 1 -- 172.21.15.150:0/3709549454 wait complete. 2024-09-17T05:45:26.393 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:26.393+0000 7f7d2125c640 1 Processor -- start 2024-09-17T05:45:26.393 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:26.393+0000 7f7d2125c640 1 -- start start 2024-09-17T05:45:26.397 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:26.394+0000 7f7d2125c640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7d1c0af730 0x7f7d1c15ea70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:45:26.397 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:26.394+0000 7f7d2125c640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7d1c0b7960 0x7f7d1c154a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:45:26.397 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:26.394+0000 7f7d2125c640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7d1c0b7d70 0x7f7d1c15dd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:45:26.397 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:26.394+0000 7f7d2125c640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f7d1c0ced10 con 0x7f7d1c0b7d70 2024-09-17T05:45:26.397 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:26.394+0000 7f7d2125c640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f7d1c0ceb90 con 0x7f7d1c0b7960 2024-09-17T05:45:26.397 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:26.394+0000 7f7d2125c640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f7d1c0d0fc0 con 0x7f7d1c0af730 2024-09-17T05:45:26.397 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:26.394+0000 7f7d1b59e640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7d1c0b7d70 0x7f7d1c15dd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:45:26.397 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:26.394+0000 7f7d1b59e640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7d1c0b7d70 0x7f7d1c15dd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:36690/0 (socket says 172.21.15.150:36690) 2024-09-17T05:45:26.398 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:26.394+0000 7f7d1b59e640 1 -- 172.21.15.150:0/1834912376 learned_addr learned my addr 172.21.15.150:0/1834912376 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:45:26.398 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:26.394+0000 7f7d1a59c640 1 --2- 172.21.15.150:0/1834912376 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7d1c0b7960 0x7f7d1c154a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:45:26.398 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:26.394+0000 7f7d1ad9d640 1 --2- 172.21.15.150:0/1834912376 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7d1c0af730 0x7f7d1c15ea70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:45:26.398 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:26.395+0000 7f7d1b59e640 1 -- 172.21.15.150:0/1834912376 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7d1c0af730 msgr2=0x7f7d1c15ea70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:45:26.398 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:26.395+0000 7f7d1b59e640 1 --2- 172.21.15.150:0/1834912376 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7d1c0af730 0x7f7d1c15ea70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:26.398 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:26.395+0000 7f7d1b59e640 1 -- 172.21.15.150:0/1834912376 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7d1c0b7960 msgr2=0x7f7d1c154a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:45:26.398 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:26.395+0000 7f7d1b59e640 1 --2- 172.21.15.150:0/1834912376 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7d1c0b7960 0x7f7d1c154a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:26.398 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:26.395+0000 7f7d1b59e640 1 -- 172.21.15.150:0/1834912376 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7d1c1f5f30 con 0x7f7d1c0b7d70 2024-09-17T05:45:26.398 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:26.395+0000 7f7d1a59c640 1 --2- 172.21.15.150:0/1834912376 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7d1c0b7960 0x7f7d1c154a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:45:26.398 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:26.395+0000 7f7d1b59e640 1 --2- 172.21.15.150:0/1834912376 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7d1c0b7d70 0x7f7d1c15dd00 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7f7d1400c730 tx=0x7f7d1400cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:45:26.398 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:26.395+0000 7f7d037fe640 1 -- 172.21.15.150:0/1834912376 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d14003b70 con 0x7f7d1c0b7d70 2024-09-17T05:45:26.398 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:26.395+0000 7f7d037fe640 1 -- 172.21.15.150:0/1834912376 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f7d14003d30 con 0x7f7d1c0b7d70 2024-09-17T05:45:26.399 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:26.395+0000 7f7d2125c640 1 -- 172.21.15.150:0/1834912376 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7d1c1f6210 con 0x7f7d1c0b7d70 2024-09-17T05:45:26.399 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:26.395+0000 7f7d037fe640 1 -- 172.21.15.150:0/1834912376 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d140052d0 con 0x7f7d1c0b7d70 2024-09-17T05:45:26.399 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:26.395+0000 7f7d2125c640 1 -- 172.21.15.150:0/1834912376 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7d1c15c4b0 con 0x7f7d1c0b7d70 2024-09-17T05:45:26.399 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:26.396+0000 7f7d2125c640 1 -- 172.21.15.150:0/1834912376 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7d1c1f5ca0 con 0x7f7d1c0b7d70 2024-09-17T05:45:26.399 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:26.397+0000 7f7d037fe640 1 -- 172.21.15.150:0/1834912376 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 15) ==== 102257+0+0 (secure 0 0 0) 0x7f7d14005680 con 0x7f7d1c0b7d70 2024-09-17T05:45:26.400 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:26.397+0000 7f7d037fe640 1 --2- 172.21.15.150:0/1834912376 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f7d08079490 0x7f7d0807b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:45:26.400 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:26.397+0000 7f7d037fe640 1 -- 172.21.15.150:0/1834912376 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(51..51 src has 1..51) ==== 4971+0+0 (secure 0 0 0) 0x7f7d140995f0 con 0x7f7d1c0b7d70 2024-09-17T05:45:26.400 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:26.397+0000 7f7d1ad9d640 1 --2- 172.21.15.150:0/1834912376 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f7d08079490 0x7f7d0807b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:45:26.400 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:26.398+0000 7f7d1ad9d640 1 --2- 172.21.15.150:0/1834912376 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f7d08079490 0x7f7d0807b9a0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f7d0c005860 tx=0x7f7d0c0057d0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:45:26.402 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:26.402+0000 7f7d037fe640 1 -- 172.21.15.150:0/1834912376 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f7d140634e0 con 0x7f7d1c0b7d70 2024-09-17T05:45:26.580 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:26.579+0000 7f7d2125c640 1 -- 172.21.15.150:0/1834912376 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) -- 0x7f7d1c1f6730 con 0x7f7d1c0b7d70 2024-09-17T05:45:26.583 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:26.583+0000 7f7d037fe640 1 -- 172.21.15.150:0/1834912376 <== mon.0 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v38)=0 v38) ==== 122+0+0 (secure 0 0 0) 0x7f7d1c1f6730 con 0x7f7d1c0b7d70 2024-09-17T05:45:26.586 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:26.585+0000 7f7d2125c640 1 -- 172.21.15.150:0/1834912376 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f7d08079490 msgr2=0x7f7d0807b9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:45:26.586 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:26.585+0000 7f7d2125c640 1 --2- 172.21.15.150:0/1834912376 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f7d08079490 0x7f7d0807b9a0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f7d0c005860 tx=0x7f7d0c0057d0 comp rx=0 tx=0).stop 2024-09-17T05:45:26.586 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:26.585+0000 7f7d2125c640 1 -- 172.21.15.150:0/1834912376 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7d1c0b7d70 msgr2=0x7f7d1c15dd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:45:26.587 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:26.585+0000 7f7d2125c640 1 --2- 172.21.15.150:0/1834912376 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7d1c0b7d70 0x7f7d1c15dd00 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7f7d1400c730 tx=0x7f7d1400cbf0 comp rx=0 tx=0).stop 2024-09-17T05:45:26.587 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:26.585+0000 7f7d2125c640 1 -- 172.21.15.150:0/1834912376 shutdown_connections 2024-09-17T05:45:26.587 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:26.585+0000 7f7d2125c640 1 --2- 172.21.15.150:0/1834912376 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7d1c0b7960 0x7f7d1c154a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:26.587 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:26.585+0000 7f7d2125c640 1 --2- 172.21.15.150:0/1834912376 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f7d08079490 0x7f7d0807b9a0 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:26.587 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:26.585+0000 7f7d2125c640 1 --2- 172.21.15.150:0/1834912376 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7d1c0b7d70 0x7f7d1c15dd00 unknown :-1 s=CLOSED pgs=593 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:26.587 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:26.585+0000 7f7d2125c640 1 --2- 172.21.15.150:0/1834912376 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7d1c0af730 0x7f7d1c15ea70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:26.587 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:26.585+0000 7f7d2125c640 1 -- 172.21.15.150:0/1834912376 >> 172.21.15.150:0/1834912376 conn(0x7f7d1c0cef20 msgr2=0x7f7d1c0cc260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:45:26.587 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:26.586+0000 7f7d2125c640 1 -- 172.21.15.150:0/1834912376 shutdown_connections 2024-09-17T05:45:26.587 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:26.586+0000 7f7d2125c640 1 -- 172.21.15.150:0/1834912376 wait complete. 2024-09-17T05:45:26.598 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-17T05:45:26.598 DEBUG:teuthology.orchestra.run.smithi150:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-17T05:45:26.635 DEBUG:teuthology.orchestra.run.smithi176:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-17T05:45:26.696 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-17T05:45:26.697 DEBUG:teuthology.orchestra.run.smithi150:> set -ex 2024-09-17T05:45:26.697 DEBUG:teuthology.orchestra.run.smithi150:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T05:45:26.713 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056027,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497464k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=18693 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248728k,nr_inodes=812182,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497464k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-17T05:45:26.713 DEBUG:teuthology.orchestra.run.smithi176:> set -ex 2024-09-17T05:45:26.713 DEBUG:teuthology.orchestra.run.smithi176:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T05:45:26.732 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056030,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497468k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=3379 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248732k,nr_inodes=812183,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497468k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-17T05:45:26.732 DEBUG:teuthology.orchestra.run.smithi150:> set -ex 2024-09-17T05:45:26.732 DEBUG:teuthology.orchestra.run.smithi150:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T05:45:26.768 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056027,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497464k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=18693 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248728k,nr_inodes=812182,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497464k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-17T05:45:26.769 DEBUG:teuthology.orchestra.run.smithi176:> set -ex 2024-09-17T05:45:26.769 DEBUG:teuthology.orchestra.run.smithi176:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T05:45:26.790 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056030,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497468k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=3379 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248732k,nr_inodes=812183,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497468k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-17T05:45:26.791 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-09-17T05:45:26.791 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T05:45:26.922 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:26.921+0000 7fada4732640 1 -- 172.21.15.150:0/1269015341 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fad84004210 msgr2=0x7fad84004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:45:26.922 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:26.921+0000 7fada4732640 1 --2- 172.21.15.150:0/1269015341 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fad84004210 0x7fad84004800 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7fad90006f70 tx=0x7fad84005830 comp rx=0 tx=0).stop 2024-09-17T05:45:26.922 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:26.921+0000 7fada2ccf640 1 -- 172.21.15.150:0/1269015341 reap_dead start 2024-09-17T05:45:26.922 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:26.921+0000 7fada4732640 1 -- 172.21.15.150:0/1269015341 shutdown_connections 2024-09-17T05:45:26.922 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:26.921+0000 7fada4732640 1 -- 172.21.15.150:0/1269015341 >> 172.21.15.150:0/1269015341 conn(0x7fad9c0cee90 msgr2=0x7fad9c0cf2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:45:26.922 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:26.921+0000 7fada4732640 1 -- 172.21.15.150:0/1269015341 shutdown_connections 2024-09-17T05:45:26.922 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:26.921+0000 7fada4732640 1 -- 172.21.15.150:0/1269015341 wait complete. 2024-09-17T05:45:26.923 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:26.923+0000 7fada4732640 1 Processor -- start 2024-09-17T05:45:26.923 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:26.923+0000 7fada4732640 1 -- start start 2024-09-17T05:45:26.926 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:26.924+0000 7fada4732640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fad84004210 0x7fad9c0b2ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:45:26.926 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:26.924+0000 7fada4732640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fad9c1e4e20 0x7fad9c1dfdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:45:26.926 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:26.924+0000 7fada4732640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fad9c1e0310 0x7fad9c1dd860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:45:26.926 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:26.924+0000 7fada4732640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7fad9c0b5f00 con 0x7fad84004210 2024-09-17T05:45:26.926 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:26.924+0000 7fada4732640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fad9c0b5d80 con 0x7fad9c1e4e20 2024-09-17T05:45:26.927 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:26.924+0000 7fada4732640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fad9c0b6080 con 0x7fad9c1e0310 2024-09-17T05:45:26.927 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:26.924+0000 7fada24ce640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fad84004210 0x7fad9c0b2ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:45:26.927 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:26.924+0000 7fada24ce640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fad84004210 0x7fad9c0b2ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:36708/0 (socket says 172.21.15.150:36708) 2024-09-17T05:45:26.927 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:26.924+0000 7fada24ce640 1 -- 172.21.15.150:0/2256343335 learned_addr learned my addr 172.21.15.150:0/2256343335 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:45:26.927 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:26.924+0000 7fada2ccf640 1 --2- 172.21.15.150:0/2256343335 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fad9c1e0310 0x7fad9c1dd860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:45:26.927 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:26.924+0000 7fada1ccd640 1 --2- 172.21.15.150:0/2256343335 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fad9c1e4e20 0x7fad9c1dfdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:45:26.927 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:26.924+0000 7fada24ce640 1 -- 172.21.15.150:0/2256343335 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fad9c1e0310 msgr2=0x7fad9c1dd860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:45:26.927 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:26.924+0000 7fada24ce640 1 --2- 172.21.15.150:0/2256343335 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fad9c1e0310 0x7fad9c1dd860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:26.927 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:26.924+0000 7fada24ce640 1 -- 172.21.15.150:0/2256343335 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fad9c1e4e20 msgr2=0x7fad9c1dfdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:45:26.927 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:26.924+0000 7fada24ce640 1 --2- 172.21.15.150:0/2256343335 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fad9c1e4e20 0x7fad9c1dfdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:26.927 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:26.924+0000 7fada24ce640 1 -- 172.21.15.150:0/2256343335 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fad9c1e0720 con 0x7fad84004210 2024-09-17T05:45:26.927 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:26.924+0000 7fada1ccd640 1 --2- 172.21.15.150:0/2256343335 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fad9c1e4e20 0x7fad9c1dfdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:45:26.927 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:26.925+0000 7fada24ce640 1 --2- 172.21.15.150:0/2256343335 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fad84004210 0x7fad9c0b2ac0 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7fad8c006060 tx=0x7fad8c006520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:45:26.928 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:26.925+0000 7fad9affd640 1 -- 172.21.15.150:0/2256343335 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad8c015070 con 0x7fad84004210 2024-09-17T05:45:26.928 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:26.925+0000 7fad9affd640 1 -- 172.21.15.150:0/2256343335 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fad8c00fa60 con 0x7fad84004210 2024-09-17T05:45:26.928 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:26.925+0000 7fad9affd640 1 -- 172.21.15.150:0/2256343335 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad8c011430 con 0x7fad84004210 2024-09-17T05:45:26.928 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:26.925+0000 7fada4732640 1 -- 172.21.15.150:0/2256343335 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fad9c1e34b0 con 0x7fad84004210 2024-09-17T05:45:26.928 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:26.925+0000 7fada4732640 1 -- 172.21.15.150:0/2256343335 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fad9c1e3a70 con 0x7fad84004210 2024-09-17T05:45:26.928 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:26.926+0000 7fada4732640 1 -- 172.21.15.150:0/2256343335 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fad9c0cd440 con 0x7fad84004210 2024-09-17T05:45:26.929 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:26.927+0000 7fad9affd640 1 -- 172.21.15.150:0/2256343335 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 15) ==== 102257+0+0 (secure 0 0 0) 0x7fad8c0115d0 con 0x7fad84004210 2024-09-17T05:45:26.929 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:26.927+0000 7fad9affd640 1 --2- 172.21.15.150:0/2256343335 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fad88079490 0x7fad8807b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:45:26.929 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:26.927+0000 7fad9affd640 1 -- 172.21.15.150:0/2256343335 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(51..51 src has 1..51) ==== 4971+0+0 (secure 0 0 0) 0x7fad8c09a4e0 con 0x7fad84004210 2024-09-17T05:45:26.929 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:26.927+0000 7fada1ccd640 1 --2- 172.21.15.150:0/2256343335 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fad88079490 0x7fad8807b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:45:26.929 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:26.928+0000 7fada1ccd640 1 --2- 172.21.15.150:0/2256343335 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fad88079490 0x7fad8807b9a0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fad90033000 tx=0x7fad9c0b8020 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:45:26.932 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:26.932+0000 7fad9affd640 1 -- 172.21.15.150:0/2256343335 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fad9c1e0720 con 0x7fad84004210 2024-09-17T05:45:27.142 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:27.141+0000 7fada4732640 1 -- 172.21.15.150:0/2256343335 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fad9c1e92d0 con 0x7fad84004210 2024-09-17T05:45:27.142 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:27.142+0000 7fad9affd640 1 -- 172.21.15.150:0/2256343335 <== mon.0 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) ==== 94+0+3923 (secure 0 0 0) 0x7fad8c063d80 con 0x7fad84004210 2024-09-17T05:45:27.143 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-09-17T05:45:27.143 INFO:teuthology.orchestra.run.smithi150.stdout:{"epoch":28,"btime":"2024-09-17T05:45:20:713737+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5278,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6836/1460864883","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6834","nonce":1460864883},{"type":"v1","addr":"172.21.15.176:6836","nonce":1460864883}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":20},{"gid":5281,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6837/3149402402","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6835","nonce":3149402402},{"type":"v1","addr":"172.21.15.176:6837","nonce":3149402402}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":20},{"gid":5469,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6833/3082315470","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6832","nonce":3082315470},{"type":"v1","addr":"172.21.15.150:6833","nonce":3082315470}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":19},{"gid":5907,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6835/2533452013","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6834","nonce":2533452013},{"type":"v1","addr":"172.21.15.150:6835","nonce":2533452013}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":28}],"filesystems":[]} 2024-09-17T05:45:27.143 INFO:teuthology.orchestra.run.smithi150.stderr:dumped fsmap epoch 28 2024-09-17T05:45:27.145 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:27.144+0000 7fada4732640 1 -- 172.21.15.150:0/2256343335 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fad88079490 msgr2=0x7fad8807b9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:45:27.145 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:27.144+0000 7fada4732640 1 --2- 172.21.15.150:0/2256343335 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fad88079490 0x7fad8807b9a0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fad90033000 tx=0x7fad9c0b8020 comp rx=0 tx=0).stop 2024-09-17T05:45:27.145 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:27.144+0000 7fada4732640 1 -- 172.21.15.150:0/2256343335 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fad84004210 msgr2=0x7fad9c0b2ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:45:27.145 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:27.144+0000 7fada4732640 1 --2- 172.21.15.150:0/2256343335 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fad84004210 0x7fad9c0b2ac0 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7fad8c006060 tx=0x7fad8c006520 comp rx=0 tx=0).stop 2024-09-17T05:45:27.145 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:27.144+0000 7fada4732640 1 -- 172.21.15.150:0/2256343335 shutdown_connections 2024-09-17T05:45:27.145 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:27.144+0000 7fada4732640 1 --2- 172.21.15.150:0/2256343335 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fad9c1e4e20 0x7fad9c1dfdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:27.145 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:27.144+0000 7fada4732640 1 --2- 172.21.15.150:0/2256343335 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fad88079490 0x7fad8807b9a0 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:27.145 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:27.144+0000 7fada4732640 1 --2- 172.21.15.150:0/2256343335 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fad9c1e0310 0x7fad9c1dd860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:27.145 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:27.144+0000 7fada4732640 1 --2- 172.21.15.150:0/2256343335 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fad84004210 0x7fad9c0b2ac0 unknown :-1 s=CLOSED pgs=596 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:27.146 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:27.144+0000 7fada4732640 1 -- 172.21.15.150:0/2256343335 >> 172.21.15.150:0/2256343335 conn(0x7fad9c0cee90 msgr2=0x7fad9c1e26b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:45:27.146 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:27.144+0000 7fada4732640 1 -- 172.21.15.150:0/2256343335 shutdown_connections 2024-09-17T05:45:27.146 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:27.144+0000 7fada4732640 1 -- 172.21.15.150:0/2256343335 wait complete. 2024-09-17T05:45:27.157 INFO:tasks.ceph.mds.a:Restarting daemon 2024-09-17T05:45:27.157 INFO:tasks.ceph.mds.a:Stopping old one... 2024-09-17T05:45:27.157 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-09-17T05:45:27.157 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T05:45:27.157 INFO:tasks.ceph.mds.c:Restarting daemon 2024-09-17T05:45:27.158 INFO:tasks.ceph.mds.c:Stopping old one... 2024-09-17T05:45:27.158 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-09-17T05:45:27.158 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T05:45:27.158 INFO:tasks.ceph.mds.b:Restarting daemon 2024-09-17T05:45:27.158 INFO:tasks.ceph.mds.b:Stopping old one... 2024-09-17T05:45:27.158 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-09-17T05:45:27.158 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T05:45:27.159 INFO:tasks.ceph.mds.d:Restarting daemon 2024-09-17T05:45:27.159 INFO:tasks.ceph.mds.d:Stopping old one... 2024-09-17T05:45:27.159 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-09-17T05:45:27.159 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T05:45:27.169 INFO:tasks.ceph.mds.a:Stopped 2024-09-17T05:45:27.169 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-09-17T05:45:27.172 INFO:tasks.ceph.mds.b:Stopped 2024-09-17T05:45:27.172 DEBUG:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-09-17T05:45:27.173 INFO:tasks.ceph.mds.d:Stopped 2024-09-17T05:45:27.173 DEBUG:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-09-17T05:45:27.174 INFO:tasks.ceph.mds.c:Stopped 2024-09-17T05:45:27.174 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-09-17T05:45:27.216 INFO:tasks.ceph.mds.b:Started 2024-09-17T05:45:27.216 DEBUG:teuthology.parallel:result is None 2024-09-17T05:45:27.217 INFO:tasks.ceph.mds.a:Started 2024-09-17T05:45:27.217 INFO:tasks.ceph.mds.d:Started 2024-09-17T05:45:27.217 DEBUG:teuthology.parallel:result is None 2024-09-17T05:45:27.217 DEBUG:teuthology.parallel:result is None 2024-09-17T05:45:27.219 INFO:tasks.ceph.mds.c:Started 2024-09-17T05:45:27.219 DEBUG:teuthology.parallel:result is None 2024-09-17T05:45:27.219 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-09-17T05:45:27.304 INFO:tasks.ceph.mds.c.smithi150.stdout:starting mds.c at 2024-09-17T05:45:27.304 INFO:tasks.ceph.mds.a.smithi150.stdout:starting mds.a at 2024-09-17T05:45:27.309 INFO:tasks.ceph.mds.b.smithi176.stdout:starting mds.b at 2024-09-17T05:45:27.309 INFO:tasks.ceph.mds.d.smithi176.stdout:starting mds.d at 2024-09-17T05:45:27.340 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:27.339+0000 7f81a4b58640 1 -- 172.21.15.150:0/2271877915 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f81a00d07f0 msgr2=0x7f81a00b1da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:45:27.340 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:27.339+0000 7f81a4b58640 1 --2- 172.21.15.150:0/2271877915 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f81a00d07f0 0x7f81a00b1da0 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7f8194009830 tx=0x7f819402a510 comp rx=0 tx=0).stop 2024-09-17T05:45:27.340 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:27.339+0000 7f81a4b58640 1 -- 172.21.15.150:0/2271877915 shutdown_connections 2024-09-17T05:45:27.340 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:27.339+0000 7f81a4b58640 1 --2- 172.21.15.150:0/2271877915 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f81a00d07f0 0x7f81a00b1da0 unknown :-1 s=CLOSED pgs=603 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:27.341 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:27.339+0000 7f81a4b58640 1 --2- 172.21.15.150:0/2271877915 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f81a00c5b90 0x7f81a00d02b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:27.341 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:27.339+0000 7f81a4b58640 1 -- 172.21.15.150:0/2271877915 >> 172.21.15.150:0/2271877915 conn(0x7f81a00cef80 msgr2=0x7f81a00cf390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:45:27.341 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:27.339+0000 7f81a4b58640 1 -- 172.21.15.150:0/2271877915 shutdown_connections 2024-09-17T05:45:27.341 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:27.339+0000 7f81a4b58640 1 -- 172.21.15.150:0/2271877915 wait complete. 2024-09-17T05:45:27.342 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:27.341+0000 7f81a4b58640 1 Processor -- start 2024-09-17T05:45:27.342 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:27.341+0000 7f81a4b58640 1 -- start start 2024-09-17T05:45:27.344 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:27.343+0000 7f81a4b58640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f81a009ba60 0x7f81a0156470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:45:27.344 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:27.343+0000 7f81a4b58640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f81a00c5b90 0x7f81a00af150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:45:27.344 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:27.343+0000 7f81a4b58640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f81a00d07f0 0x7f81a015a320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:45:27.345 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:27.343+0000 7f81a4b58640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f81a00b2b70 con 0x7f81a00c5b90 2024-09-17T05:45:27.345 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:27.343+0000 7f81a4b58640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f81a00b29f0 con 0x7f81a009ba60 2024-09-17T05:45:27.345 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:27.343+0000 7f81a4b58640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f81a00b2cf0 con 0x7f81a00d07f0 2024-09-17T05:45:27.345 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:27.343+0000 7f819dd9b640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f81a00c5b90 0x7f81a00af150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:45:27.345 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:27.343+0000 7f819dd9b640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f81a00c5b90 0x7f81a00af150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:36740/0 (socket says 172.21.15.150:36740) 2024-09-17T05:45:27.345 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:27.343+0000 7f819dd9b640 1 -- 172.21.15.150:0/2996388426 learned_addr learned my addr 172.21.15.150:0/2996388426 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:45:27.345 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:27.343+0000 7f819e59c640 1 --2- 172.21.15.150:0/2996388426 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f81a009ba60 0x7f81a0156470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:45:27.345 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:27.343+0000 7f819ed9d640 1 --2- 172.21.15.150:0/2996388426 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f81a00d07f0 0x7f81a015a320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:45:27.345 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:27.343+0000 7f819dd9b640 1 -- 172.21.15.150:0/2996388426 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f81a00d07f0 msgr2=0x7f81a015a320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:45:27.345 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:27.343+0000 7f819dd9b640 1 --2- 172.21.15.150:0/2996388426 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f81a00d07f0 0x7f81a015a320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:27.345 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:27.343+0000 7f819dd9b640 1 -- 172.21.15.150:0/2996388426 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f81a009ba60 msgr2=0x7f81a0156470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:45:27.345 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:27.343+0000 7f819dd9b640 1 --2- 172.21.15.150:0/2996388426 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f81a009ba60 0x7f81a0156470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:27.345 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:27.343+0000 7f819dd9b640 1 -- 172.21.15.150:0/2996388426 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f81a0158040 con 0x7f81a00c5b90 2024-09-17T05:45:27.346 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:27.343+0000 7f819dd9b640 1 --2- 172.21.15.150:0/2996388426 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f81a00c5b90 0x7f81a00af150 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7f8194009950 tx=0x7f8194033c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:45:27.346 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:27.343+0000 7f818effd640 1 -- 172.21.15.150:0/2996388426 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8194031d60 con 0x7f81a00c5b90 2024-09-17T05:45:27.346 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:27.343+0000 7f81a4b58640 1 -- 172.21.15.150:0/2996388426 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f81a0157d60 con 0x7f81a00c5b90 2024-09-17T05:45:27.346 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:27.344+0000 7f818effd640 1 -- 172.21.15.150:0/2996388426 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8194033e10 con 0x7f81a00c5b90 2024-09-17T05:45:27.346 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:27.344+0000 7f818effd640 1 -- 172.21.15.150:0/2996388426 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81940332b0 con 0x7f81a00c5b90 2024-09-17T05:45:27.346 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:27.344+0000 7f81a4b58640 1 -- 172.21.15.150:0/2996388426 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f81a0160470 con 0x7f81a00c5b90 2024-09-17T05:45:27.347 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:27.345+0000 7f81a4b58640 1 -- 172.21.15.150:0/2996388426 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f81a00d02b0 con 0x7f81a00c5b90 2024-09-17T05:45:27.347 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:27.345+0000 7f818effd640 1 -- 172.21.15.150:0/2996388426 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 15) ==== 102257+0+0 (secure 0 0 0) 0x7f8194033450 con 0x7f81a00c5b90 2024-09-17T05:45:27.347 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:27.346+0000 7f818effd640 1 --2- 172.21.15.150:0/2996388426 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f81800794c0 0x7f818007b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:45:27.347 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:27.346+0000 7f818effd640 1 -- 172.21.15.150:0/2996388426 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(51..51 src has 1..51) ==== 4971+0+0 (secure 0 0 0) 0x7f81940ba8d0 con 0x7f81a00c5b90 2024-09-17T05:45:27.347 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:27.346+0000 7f819e59c640 1 --2- 172.21.15.150:0/2996388426 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f81800794c0 0x7f818007b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:45:27.347 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:27.346+0000 7f819e59c640 1 --2- 172.21.15.150:0/2996388426 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f81800794c0 0x7f818007b9d0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f8190009c00 tx=0x7f8190005f30 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:45:27.350 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:27.350+0000 7f818effd640 1 -- 172.21.15.150:0/2996388426 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f819403f030 con 0x7f81a00c5b90 2024-09-17T05:45:27.537 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:27.536+0000 7f81a4b58640 1 -- 172.21.15.150:0/2996388426 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) -- 0x7f81a0161150 con 0x7f81a00c5b90 2024-09-17T05:45:28.611 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:28.609+0000 7f818effd640 1 -- 172.21.15.150:0/2996388426 <== mon.0 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v56) ==== 97+0+0 (secure 0 0 0) 0x7f8194084200 con 0x7f81a00c5b90 2024-09-17T05:45:28.611 INFO:teuthology.orchestra.run.smithi150.stderr: removed all blocklist entries 2024-09-17T05:45:28.614 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:28.612+0000 7f81a4b58640 1 -- 172.21.15.150:0/2996388426 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f81800794c0 msgr2=0x7f818007b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:45:28.614 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:28.612+0000 7f81a4b58640 1 --2- 172.21.15.150:0/2996388426 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f81800794c0 0x7f818007b9d0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f8190009c00 tx=0x7f8190005f30 comp rx=0 tx=0).stop 2024-09-17T05:45:28.614 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:28.612+0000 7f81a4b58640 1 -- 172.21.15.150:0/2996388426 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f81a00c5b90 msgr2=0x7f81a00af150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:45:28.614 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:28.612+0000 7f81a4b58640 1 --2- 172.21.15.150:0/2996388426 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f81a00c5b90 0x7f81a00af150 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7f8194009950 tx=0x7f8194033c20 comp rx=0 tx=0).stop 2024-09-17T05:45:28.614 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:28.612+0000 7f81a4b58640 1 -- 172.21.15.150:0/2996388426 shutdown_connections 2024-09-17T05:45:28.614 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:28.612+0000 7f81a4b58640 1 --2- 172.21.15.150:0/2996388426 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f81800794c0 0x7f818007b9d0 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:28.615 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:28.612+0000 7f81a4b58640 1 --2- 172.21.15.150:0/2996388426 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f81a00d07f0 0x7f81a015a320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:28.615 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:28.612+0000 7f81a4b58640 1 --2- 172.21.15.150:0/2996388426 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f81a00c5b90 0x7f81a00af150 unknown :-1 s=CLOSED pgs=604 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:28.615 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:28.612+0000 7f81a4b58640 1 --2- 172.21.15.150:0/2996388426 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f81a009ba60 0x7f81a0156470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:28.615 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:28.612+0000 7f81a4b58640 1 -- 172.21.15.150:0/2996388426 >> 172.21.15.150:0/2996388426 conn(0x7f81a00cef80 msgr2=0x7f81a00b1c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:45:28.615 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:28.612+0000 7f81a4b58640 1 -- 172.21.15.150:0/2996388426 shutdown_connections 2024-09-17T05:45:28.615 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:28.612+0000 7f81a4b58640 1 -- 172.21.15.150:0/2996388426 wait complete. 2024-09-17T05:45:28.629 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-09-17T05:45:28.749 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:28.747+0000 7f059f615640 1 -- 172.21.15.150:0/2928073529 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0584004800 msgr2=0x7f0584004c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:45:28.750 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:28.747+0000 7f059f615640 1 --2- 172.21.15.150:0/2928073529 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0584004800 0x7f0584004c10 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7f0588001690 tx=0x7f0584005830 comp rx=0 tx=0).stop 2024-09-17T05:45:28.750 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:28.747+0000 7f059dbb2640 1 -- 172.21.15.150:0/2928073529 reap_dead start 2024-09-17T05:45:28.750 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:28.748+0000 7f059f615640 1 -- 172.21.15.150:0/2928073529 shutdown_connections 2024-09-17T05:45:28.750 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:28.748+0000 7f059f615640 1 -- 172.21.15.150:0/2928073529 >> 172.21.15.150:0/2928073529 conn(0x7f059806d730 msgr2=0x7f05980b1e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:45:28.750 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:28.748+0000 7f059f615640 1 -- 172.21.15.150:0/2928073529 shutdown_connections 2024-09-17T05:45:28.750 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:28.748+0000 7f059f615640 1 -- 172.21.15.150:0/2928073529 wait complete. 2024-09-17T05:45:28.751 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:28.749+0000 7f059f615640 1 Processor -- start 2024-09-17T05:45:28.751 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:28.749+0000 7f059f615640 1 -- start start 2024-09-17T05:45:28.753 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:28.751+0000 7f059f615640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0584004800 0x7f0598099290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:45:28.754 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:28.751+0000 7f059f615640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f05981489b0 0x7f059814ac40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:45:28.754 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:28.751+0000 7f059f615640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f059814b180 0x7f059814ca90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:45:28.754 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:28.751+0000 7f059f615640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f05980b41f0 con 0x7f0584004800 2024-09-17T05:45:28.754 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:28.751+0000 7f059f615640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f05980b4070 con 0x7f059814b180 2024-09-17T05:45:28.754 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:28.751+0000 7f059f615640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f05980b4370 con 0x7f05981489b0 2024-09-17T05:45:28.754 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:28.751+0000 7f059d3b1640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0584004800 0x7f0598099290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:45:28.754 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:28.751+0000 7f059d3b1640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0584004800 0x7f0598099290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:36750/0 (socket says 172.21.15.150:36750) 2024-09-17T05:45:28.754 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:28.751+0000 7f059d3b1640 1 -- 172.21.15.150:0/2150824528 learned_addr learned my addr 172.21.15.150:0/2150824528 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:45:28.754 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:28.751+0000 7f059cbb0640 1 --2- 172.21.15.150:0/2150824528 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f05981489b0 0x7f059814ac40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:45:28.754 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:28.751+0000 7f059dbb2640 1 --2- 172.21.15.150:0/2150824528 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f059814b180 0x7f059814ca90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:45:28.754 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:28.751+0000 7f059d3b1640 1 -- 172.21.15.150:0/2150824528 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f05981489b0 msgr2=0x7f059814ac40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:45:28.754 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:28.751+0000 7f059d3b1640 1 --2- 172.21.15.150:0/2150824528 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f05981489b0 0x7f059814ac40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:28.755 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:28.751+0000 7f059d3b1640 1 -- 172.21.15.150:0/2150824528 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f059814b180 msgr2=0x7f059814ca90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:45:28.755 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:28.751+0000 7f059d3b1640 1 --2- 172.21.15.150:0/2150824528 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f059814b180 0x7f059814ca90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:28.755 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:28.751+0000 7f059d3b1640 1 -- 172.21.15.150:0/2150824528 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f059814f900 con 0x7f0584004800 2024-09-17T05:45:28.755 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:28.751+0000 7f059cbb0640 1 --2- 172.21.15.150:0/2150824528 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f05981489b0 0x7f059814ac40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:45:28.755 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:28.751+0000 7f059d3b1640 1 --2- 172.21.15.150:0/2150824528 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0584004800 0x7f0598099290 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7f0594011ae0 tx=0x7f0594009e90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:45:28.755 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:28.751+0000 7f058dffb640 1 -- 172.21.15.150:0/2150824528 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f059401e070 con 0x7f0584004800 2024-09-17T05:45:28.755 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:28.751+0000 7f058dffb640 1 -- 172.21.15.150:0/2150824528 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f059400fe70 con 0x7f0584004800 2024-09-17T05:45:28.755 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:28.751+0000 7f059f615640 1 -- 172.21.15.150:0/2150824528 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0598149ba0 con 0x7f0584004800 2024-09-17T05:45:28.755 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:28.752+0000 7f058dffb640 1 -- 172.21.15.150:0/2150824528 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0594004290 con 0x7f0584004800 2024-09-17T05:45:28.755 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:28.752+0000 7f059f615640 1 -- 172.21.15.150:0/2150824528 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f059814a160 con 0x7f0584004800 2024-09-17T05:45:28.756 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:28.753+0000 7f059f615640 1 -- 172.21.15.150:0/2150824528 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0598153780 con 0x7f0584004800 2024-09-17T05:45:28.756 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:28.753+0000 7f058dffb640 1 -- 172.21.15.150:0/2150824528 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 15) ==== 102257+0+0 (secure 0 0 0) 0x7f0594021070 con 0x7f0584004800 2024-09-17T05:45:28.756 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:28.754+0000 7f058dffb640 1 --2- 172.21.15.150:0/2150824528 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f057c079490 0x7f057c07b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:45:28.756 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:28.754+0000 7f058dffb640 1 -- 172.21.15.150:0/2150824528 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(56..56 src has 1..56) ==== 4885+0+0 (secure 0 0 0) 0x7f059409a020 con 0x7f0584004800 2024-09-17T05:45:28.756 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:28.754+0000 7f059cbb0640 1 --2- 172.21.15.150:0/2150824528 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f057c079490 0x7f057c07b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:45:28.756 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:28.755+0000 7f059cbb0640 1 --2- 172.21.15.150:0/2150824528 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f057c079490 0x7f057c07b9a0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f0588032000 tx=0x7f0588001190 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:45:28.760 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:28.759+0000 7f058dffb640 1 -- 172.21.15.150:0/2150824528 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f0594063980 con 0x7f0584004800 2024-09-17T05:45:29.003 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:29.002+0000 7f059f615640 1 -- 172.21.15.150:0/2150824528 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) -- 0x7f05980d0a10 con 0x7f0584004800 2024-09-17T05:45:29.004 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:29.002+0000 7f058dffb640 1 -- 172.21.15.150:0/2150824528 <== mon.0 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v12) ==== 80+0+5304 (secure 0 0 0) 0x7f05940683b0 con 0x7f0584004800 2024-09-17T05:45:29.004 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-09-17T05:45:29.004 INFO:teuthology.orchestra.run.smithi150.stdout:{ 2024-09-17T05:45:29.004 INFO:teuthology.orchestra.run.smithi150.stdout: "auth_dump": [ 2024-09-17T05:45:29.005 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-09-17T05:45:29.005 INFO:teuthology.orchestra.run.smithi150.stdout: "entity": "mds.a", 2024-09-17T05:45:29.005 INFO:teuthology.orchestra.run.smithi150.stdout: "key": "AQBoFulmMHALAxAAEO+QBgzbd+BNfhyY2qPiqw==", 2024-09-17T05:45:29.005 INFO:teuthology.orchestra.run.smithi150.stdout: "caps": { 2024-09-17T05:45:29.005 INFO:teuthology.orchestra.run.smithi150.stdout: "mds": "allow", 2024-09-17T05:45:29.005 INFO:teuthology.orchestra.run.smithi150.stdout: "mgr": "allow *", 2024-09-17T05:45:29.005 INFO:teuthology.orchestra.run.smithi150.stdout: "mon": "allow *", 2024-09-17T05:45:29.005 INFO:teuthology.orchestra.run.smithi150.stdout: "osd": "allow *" 2024-09-17T05:45:29.005 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-09-17T05:45:29.005 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-17T05:45:29.005 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-09-17T05:45:29.005 INFO:teuthology.orchestra.run.smithi150.stdout: "entity": "mds.b", 2024-09-17T05:45:29.005 INFO:teuthology.orchestra.run.smithi150.stdout: "key": "AQBoFulmtutmEBAAhKJEJQm181pL1lPmSSdYRQ==", 2024-09-17T05:45:29.006 INFO:teuthology.orchestra.run.smithi150.stdout: "caps": { 2024-09-17T05:45:29.006 INFO:teuthology.orchestra.run.smithi150.stdout: "mds": "allow", 2024-09-17T05:45:29.006 INFO:teuthology.orchestra.run.smithi150.stdout: "mgr": "allow *", 2024-09-17T05:45:29.006 INFO:teuthology.orchestra.run.smithi150.stdout: "mon": "allow *", 2024-09-17T05:45:29.006 INFO:teuthology.orchestra.run.smithi150.stdout: "osd": "allow *" 2024-09-17T05:45:29.006 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-09-17T05:45:29.006 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-17T05:45:29.006 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-09-17T05:45:29.006 INFO:teuthology.orchestra.run.smithi150.stdout: "entity": "mds.c", 2024-09-17T05:45:29.006 INFO:teuthology.orchestra.run.smithi150.stdout: "key": "AQBoFulmHTKsChAA4/fUb2NC+fMhR+xIYIDjgQ==", 2024-09-17T05:45:29.006 INFO:teuthology.orchestra.run.smithi150.stdout: "caps": { 2024-09-17T05:45:29.006 INFO:teuthology.orchestra.run.smithi150.stdout: "mds": "allow", 2024-09-17T05:45:29.006 INFO:teuthology.orchestra.run.smithi150.stdout: "mgr": "allow *", 2024-09-17T05:45:29.007 INFO:teuthology.orchestra.run.smithi150.stdout: "mon": "allow *", 2024-09-17T05:45:29.007 INFO:teuthology.orchestra.run.smithi150.stdout: "osd": "allow *" 2024-09-17T05:45:29.007 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-09-17T05:45:29.007 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-17T05:45:29.007 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-09-17T05:45:29.007 INFO:teuthology.orchestra.run.smithi150.stdout: "entity": "mds.d", 2024-09-17T05:45:29.007 INFO:teuthology.orchestra.run.smithi150.stdout: "key": "AQBoFulmr2s3GBAAhXzLVtObF/LwTpDIrY8MIQ==", 2024-09-17T05:45:29.007 INFO:teuthology.orchestra.run.smithi150.stdout: "caps": { 2024-09-17T05:45:29.007 INFO:teuthology.orchestra.run.smithi150.stdout: "mds": "allow", 2024-09-17T05:45:29.007 INFO:teuthology.orchestra.run.smithi150.stdout: "mgr": "allow *", 2024-09-17T05:45:29.007 INFO:teuthology.orchestra.run.smithi150.stdout: "mon": "allow *", 2024-09-17T05:45:29.007 INFO:teuthology.orchestra.run.smithi150.stdout: "osd": "allow *" 2024-09-17T05:45:29.007 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-09-17T05:45:29.007 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-17T05:45:29.008 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-09-17T05:45:29.008 INFO:teuthology.orchestra.run.smithi150.stdout: "entity": "osd.0", 2024-09-17T05:45:29.008 INFO:teuthology.orchestra.run.smithi150.stdout: "key": "AQBrFulm9eU0NRAAqgc1CtMOz+jDCHBn8coaVw==", 2024-09-17T05:45:29.008 INFO:teuthology.orchestra.run.smithi150.stdout: "caps": { 2024-09-17T05:45:29.008 INFO:teuthology.orchestra.run.smithi150.stdout: "mgr": "allow profile osd", 2024-09-17T05:45:29.008 INFO:teuthology.orchestra.run.smithi150.stdout: "mon": "allow profile osd", 2024-09-17T05:45:29.008 INFO:teuthology.orchestra.run.smithi150.stdout: "osd": "allow *" 2024-09-17T05:45:29.008 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-09-17T05:45:29.008 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-17T05:45:29.008 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-09-17T05:45:29.008 INFO:teuthology.orchestra.run.smithi150.stdout: "entity": "osd.1", 2024-09-17T05:45:29.008 INFO:teuthology.orchestra.run.smithi150.stdout: "key": "AQBvFulmlFL6CxAA8ByBraZue2FLfyZeOIpj3A==", 2024-09-17T05:45:29.008 INFO:teuthology.orchestra.run.smithi150.stdout: "caps": { 2024-09-17T05:45:29.009 INFO:teuthology.orchestra.run.smithi150.stdout: "mgr": "allow profile osd", 2024-09-17T05:45:29.009 INFO:teuthology.orchestra.run.smithi150.stdout: "mon": "allow profile osd", 2024-09-17T05:45:29.009 INFO:teuthology.orchestra.run.smithi150.stdout: "osd": "allow *" 2024-09-17T05:45:29.009 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-09-17T05:45:29.009 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-17T05:45:29.009 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-09-17T05:45:29.009 INFO:teuthology.orchestra.run.smithi150.stdout: "entity": "osd.2", 2024-09-17T05:45:29.009 INFO:teuthology.orchestra.run.smithi150.stdout: "key": "AQByFulmMQF5LBAAB4rbdIL6Zd+l4I4LDC/r3Q==", 2024-09-17T05:45:29.009 INFO:teuthology.orchestra.run.smithi150.stdout: "caps": { 2024-09-17T05:45:29.009 INFO:teuthology.orchestra.run.smithi150.stdout: "mgr": "allow profile osd", 2024-09-17T05:45:29.009 INFO:teuthology.orchestra.run.smithi150.stdout: "mon": "allow profile osd", 2024-09-17T05:45:29.009 INFO:teuthology.orchestra.run.smithi150.stdout: "osd": "allow *" 2024-09-17T05:45:29.009 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-09-17T05:45:29.009 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-17T05:45:29.010 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-09-17T05:45:29.010 INFO:teuthology.orchestra.run.smithi150.stdout: "entity": "osd.3", 2024-09-17T05:45:29.010 INFO:teuthology.orchestra.run.smithi150.stdout: "key": "AQB2Fulm5fjaAhAASnkpgsW79Sr9IIiy4HMm4g==", 2024-09-17T05:45:29.010 INFO:teuthology.orchestra.run.smithi150.stdout: "caps": { 2024-09-17T05:45:29.010 INFO:teuthology.orchestra.run.smithi150.stdout: "mgr": "allow profile osd", 2024-09-17T05:45:29.010 INFO:teuthology.orchestra.run.smithi150.stdout: "mon": "allow profile osd", 2024-09-17T05:45:29.010 INFO:teuthology.orchestra.run.smithi150.stdout: "osd": "allow *" 2024-09-17T05:45:29.010 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-09-17T05:45:29.010 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-17T05:45:29.010 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-09-17T05:45:29.010 INFO:teuthology.orchestra.run.smithi150.stdout: "entity": "osd.4", 2024-09-17T05:45:29.010 INFO:teuthology.orchestra.run.smithi150.stdout: "key": "AQB8Fulm9fWPGhAA9nNf+0znlS0Z7rqOvC47xQ==", 2024-09-17T05:45:29.010 INFO:teuthology.orchestra.run.smithi150.stdout: "caps": { 2024-09-17T05:45:29.011 INFO:teuthology.orchestra.run.smithi150.stdout: "mgr": "allow profile osd", 2024-09-17T05:45:29.011 INFO:teuthology.orchestra.run.smithi150.stdout: "mon": "allow profile osd", 2024-09-17T05:45:29.011 INFO:teuthology.orchestra.run.smithi150.stdout: "osd": "allow *" 2024-09-17T05:45:29.011 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-09-17T05:45:29.011 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-17T05:45:29.011 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-09-17T05:45:29.011 INFO:teuthology.orchestra.run.smithi150.stdout: "entity": "osd.5", 2024-09-17T05:45:29.011 INFO:teuthology.orchestra.run.smithi150.stdout: "key": "AQB/FulmeHakHRAASlnmKa0UTqVX+NSbmiHEBw==", 2024-09-17T05:45:29.011 INFO:teuthology.orchestra.run.smithi150.stdout: "caps": { 2024-09-17T05:45:29.011 INFO:teuthology.orchestra.run.smithi150.stdout: "mgr": "allow profile osd", 2024-09-17T05:45:29.011 INFO:teuthology.orchestra.run.smithi150.stdout: "mon": "allow profile osd", 2024-09-17T05:45:29.011 INFO:teuthology.orchestra.run.smithi150.stdout: "osd": "allow *" 2024-09-17T05:45:29.011 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-09-17T05:45:29.011 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-17T05:45:29.012 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-09-17T05:45:29.012 INFO:teuthology.orchestra.run.smithi150.stdout: "entity": "osd.6", 2024-09-17T05:45:29.012 INFO:teuthology.orchestra.run.smithi150.stdout: "key": "AQCCFulmEZF3IBAAhtpCanI6m8Kb3hyi+sRyyQ==", 2024-09-17T05:45:29.012 INFO:teuthology.orchestra.run.smithi150.stdout: "caps": { 2024-09-17T05:45:29.012 INFO:teuthology.orchestra.run.smithi150.stdout: "mgr": "allow profile osd", 2024-09-17T05:45:29.012 INFO:teuthology.orchestra.run.smithi150.stdout: "mon": "allow profile osd", 2024-09-17T05:45:29.012 INFO:teuthology.orchestra.run.smithi150.stdout: "osd": "allow *" 2024-09-17T05:45:29.012 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-09-17T05:45:29.012 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-17T05:45:29.012 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-09-17T05:45:29.012 INFO:teuthology.orchestra.run.smithi150.stdout: "entity": "osd.7", 2024-09-17T05:45:29.012 INFO:teuthology.orchestra.run.smithi150.stdout: "key": "AQCGFulmdcs7BRAAxsctes949cbkGkivdGpoYw==", 2024-09-17T05:45:29.012 INFO:teuthology.orchestra.run.smithi150.stdout: "caps": { 2024-09-17T05:45:29.013 INFO:teuthology.orchestra.run.smithi150.stdout: "mgr": "allow profile osd", 2024-09-17T05:45:29.013 INFO:teuthology.orchestra.run.smithi150.stdout: "mon": "allow profile osd", 2024-09-17T05:45:29.013 INFO:teuthology.orchestra.run.smithi150.stdout: "osd": "allow *" 2024-09-17T05:45:29.013 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-09-17T05:45:29.013 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-17T05:45:29.013 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-09-17T05:45:29.013 INFO:teuthology.orchestra.run.smithi150.stdout: "entity": "client.0", 2024-09-17T05:45:29.013 INFO:teuthology.orchestra.run.smithi150.stdout: "key": "AQBoFulmfF/1HBAAMezEjZDeoHTJ+uFfDXNWHQ==", 2024-09-17T05:45:29.013 INFO:teuthology.orchestra.run.smithi150.stdout: "caps": { 2024-09-17T05:45:29.013 INFO:teuthology.orchestra.run.smithi150.stdout: "mds": "allow", 2024-09-17T05:45:29.013 INFO:teuthology.orchestra.run.smithi150.stdout: "mon": "allow r", 2024-09-17T05:45:29.013 INFO:teuthology.orchestra.run.smithi150.stdout: "osd": "allow rw tag cephfs data=cephfs" 2024-09-17T05:45:29.013 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-09-17T05:45:29.013 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-17T05:45:29.014 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-09-17T05:45:29.014 INFO:teuthology.orchestra.run.smithi150.stdout: "entity": "client.1", 2024-09-17T05:45:29.014 INFO:teuthology.orchestra.run.smithi150.stdout: "key": "AQBoFulmv3GQJBAANlgjLqiCwzNfmBh8uClJ9A==", 2024-09-17T05:45:29.014 INFO:teuthology.orchestra.run.smithi150.stdout: "caps": { 2024-09-17T05:45:29.014 INFO:teuthology.orchestra.run.smithi150.stdout: "mds": "allow", 2024-09-17T05:45:29.014 INFO:teuthology.orchestra.run.smithi150.stdout: "mgr": "allow r", 2024-09-17T05:45:29.014 INFO:teuthology.orchestra.run.smithi150.stdout: "mon": "allow rw", 2024-09-17T05:45:29.014 INFO:teuthology.orchestra.run.smithi150.stdout: "osd": "allow rwx" 2024-09-17T05:45:29.014 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-09-17T05:45:29.014 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-17T05:45:29.014 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-09-17T05:45:29.014 INFO:teuthology.orchestra.run.smithi150.stdout: "entity": "client.2", 2024-09-17T05:45:29.014 INFO:teuthology.orchestra.run.smithi150.stdout: "key": "AQBoFulm1O/BIBAA8kfQL3/13SmZO1+y2tOZvw==", 2024-09-17T05:45:29.014 INFO:teuthology.orchestra.run.smithi150.stdout: "caps": { 2024-09-17T05:45:29.015 INFO:teuthology.orchestra.run.smithi150.stdout: "mds": "allow", 2024-09-17T05:45:29.015 INFO:teuthology.orchestra.run.smithi150.stdout: "mgr": "allow r", 2024-09-17T05:45:29.015 INFO:teuthology.orchestra.run.smithi150.stdout: "mon": "allow rw", 2024-09-17T05:45:29.015 INFO:teuthology.orchestra.run.smithi150.stdout: "osd": "allow rwx" 2024-09-17T05:45:29.015 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-09-17T05:45:29.015 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-17T05:45:29.015 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-09-17T05:45:29.015 INFO:teuthology.orchestra.run.smithi150.stdout: "entity": "client.3", 2024-09-17T05:45:29.015 INFO:teuthology.orchestra.run.smithi150.stdout: "key": "AQBoFulmF4hVKBAAZ5FGapBLLLtez3t8kON9dg==", 2024-09-17T05:45:29.015 INFO:teuthology.orchestra.run.smithi150.stdout: "caps": { 2024-09-17T05:45:29.015 INFO:teuthology.orchestra.run.smithi150.stdout: "mds": "allow", 2024-09-17T05:45:29.015 INFO:teuthology.orchestra.run.smithi150.stdout: "mgr": "allow r", 2024-09-17T05:45:29.015 INFO:teuthology.orchestra.run.smithi150.stdout: "mon": "allow rw", 2024-09-17T05:45:29.015 INFO:teuthology.orchestra.run.smithi150.stdout: "osd": "allow rwx" 2024-09-17T05:45:29.016 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-09-17T05:45:29.016 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-17T05:45:29.016 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-09-17T05:45:29.016 INFO:teuthology.orchestra.run.smithi150.stdout: "entity": "client.admin", 2024-09-17T05:45:29.016 INFO:teuthology.orchestra.run.smithi150.stdout: "key": "AQBnFulmaU9+IBAA7ZmXWZ44s0IpQ+C+Zw2V1g==", 2024-09-17T05:45:29.016 INFO:teuthology.orchestra.run.smithi150.stdout: "caps": { 2024-09-17T05:45:29.016 INFO:teuthology.orchestra.run.smithi150.stdout: "mds": "allow *", 2024-09-17T05:45:29.016 INFO:teuthology.orchestra.run.smithi150.stdout: "mgr": "allow *", 2024-09-17T05:45:29.016 INFO:teuthology.orchestra.run.smithi150.stdout: "mon": "allow *", 2024-09-17T05:45:29.016 INFO:teuthology.orchestra.run.smithi150.stdout: "osd": "allow *" 2024-09-17T05:45:29.016 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-09-17T05:45:29.016 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-17T05:45:29.016 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-09-17T05:45:29.017 INFO:teuthology.orchestra.run.smithi150.stdout: "entity": "mgr.x", 2024-09-17T05:45:29.017 INFO:teuthology.orchestra.run.smithi150.stdout: "key": "AQBnFulmEjvROhAAn3GZxCEtqPYLWopR1AcSFA==", 2024-09-17T05:45:29.017 INFO:teuthology.orchestra.run.smithi150.stdout: "caps": { 2024-09-17T05:45:29.017 INFO:teuthology.orchestra.run.smithi150.stdout: "mds": "allow *", 2024-09-17T05:45:29.017 INFO:teuthology.orchestra.run.smithi150.stdout: "mon": "allow profile mgr", 2024-09-17T05:45:29.017 INFO:teuthology.orchestra.run.smithi150.stdout: "osd": "allow *" 2024-09-17T05:45:29.017 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-09-17T05:45:29.017 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-17T05:45:29.017 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-09-17T05:45:29.017 INFO:teuthology.orchestra.run.smithi150.stdout: "entity": "mgr.y", 2024-09-17T05:45:29.017 INFO:teuthology.orchestra.run.smithi150.stdout: "key": "AQBnFulm9IkENhAA4uf1vzhYOepmovspN5/v1w==", 2024-09-17T05:45:29.017 INFO:teuthology.orchestra.run.smithi150.stdout: "caps": { 2024-09-17T05:45:29.017 INFO:teuthology.orchestra.run.smithi150.stdout: "mds": "allow *", 2024-09-17T05:45:29.017 INFO:teuthology.orchestra.run.smithi150.stdout: "mon": "allow profile mgr", 2024-09-17T05:45:29.018 INFO:teuthology.orchestra.run.smithi150.stdout: "osd": "allow *" 2024-09-17T05:45:29.018 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-09-17T05:45:29.018 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-09-17T05:45:29.018 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2024-09-17T05:45:29.018 INFO:teuthology.orchestra.run.smithi150.stdout:} 2024-09-17T05:45:29.019 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:29.005+0000 7f059f615640 1 -- 172.21.15.150:0/2150824528 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f057c079490 msgr2=0x7f057c07b9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:45:29.019 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:29.005+0000 7f059f615640 1 --2- 172.21.15.150:0/2150824528 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f057c079490 0x7f057c07b9a0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f0588032000 tx=0x7f0588001190 comp rx=0 tx=0).stop 2024-09-17T05:45:29.020 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:29.005+0000 7f059f615640 1 -- 172.21.15.150:0/2150824528 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0584004800 msgr2=0x7f0598099290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:45:29.020 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:29.005+0000 7f059f615640 1 --2- 172.21.15.150:0/2150824528 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0584004800 0x7f0598099290 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7f0594011ae0 tx=0x7f0594009e90 comp rx=0 tx=0).stop 2024-09-17T05:45:29.020 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:29.005+0000 7f059f615640 1 -- 172.21.15.150:0/2150824528 shutdown_connections 2024-09-17T05:45:29.020 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:29.005+0000 7f059f615640 1 --2- 172.21.15.150:0/2150824528 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f059814b180 0x7f059814ca90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:29.020 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:29.005+0000 7f059f615640 1 --2- 172.21.15.150:0/2150824528 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f057c079490 0x7f057c07b9a0 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:29.020 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:29.005+0000 7f059f615640 1 --2- 172.21.15.150:0/2150824528 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f05981489b0 0x7f059814ac40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:29.020 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:29.005+0000 7f059f615640 1 --2- 172.21.15.150:0/2150824528 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0584004800 0x7f0598099290 unknown :-1 s=CLOSED pgs=607 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:29.020 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:29.005+0000 7f059f615640 1 -- 172.21.15.150:0/2150824528 >> 172.21.15.150:0/2150824528 conn(0x7f059806d730 msgr2=0x7f05980cfb40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:45:29.020 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:29.005+0000 7f059f615640 1 -- 172.21.15.150:0/2150824528 shutdown_connections 2024-09-17T05:45:29.020 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:29.005+0000 7f059f615640 1 -- 172.21.15.150:0/2150824528 wait complete. 2024-09-17T05:45:29.021 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-09-17T05:45:29.135 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:29.134+0000 7fd26429b640 1 -- 172.21.15.150:0/3589048298 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd248003a00 msgr2=0x7fd248003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:45:29.136 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:29.134+0000 7fd26429b640 1 --2- 172.21.15.150:0/3589048298 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd248003a00 0x7fd248003e70 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7fd25800c290 tx=0x7fd248005830 comp rx=0 tx=0).stop 2024-09-17T05:45:29.136 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:29.134+0000 7fd262838640 1 -- 172.21.15.150:0/3589048298 reap_dead start 2024-09-17T05:45:29.136 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:29.134+0000 7fd26429b640 1 -- 172.21.15.150:0/3589048298 shutdown_connections 2024-09-17T05:45:29.136 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:29.134+0000 7fd26429b640 1 -- 172.21.15.150:0/3589048298 >> 172.21.15.150:0/3589048298 conn(0x7fd25c0cee90 msgr2=0x7fd25c0cf2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:45:29.136 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:29.134+0000 7fd26429b640 1 -- 172.21.15.150:0/3589048298 shutdown_connections 2024-09-17T05:45:29.136 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:29.134+0000 7fd26429b640 1 -- 172.21.15.150:0/3589048298 wait complete. 2024-09-17T05:45:29.137 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:29.136+0000 7fd26429b640 1 Processor -- start 2024-09-17T05:45:29.137 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:29.136+0000 7fd26429b640 1 -- start start 2024-09-17T05:45:29.140 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:29.137+0000 7fd26429b640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd248003a00 0x7fd25c09d9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:45:29.140 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:29.137+0000 7fd26429b640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd25c1df960 0x7fd25c0cb3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:45:29.140 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:29.137+0000 7fd26429b640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd25c06e3c0 0x7fd25c09f2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:45:29.140 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:29.137+0000 7fd26429b640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7fd25c0b5d30 con 0x7fd25c06e3c0 2024-09-17T05:45:29.140 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:29.137+0000 7fd26429b640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fd25c0b5bb0 con 0x7fd248003a00 2024-09-17T05:45:29.140 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:29.137+0000 7fd26429b640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fd25c0b5eb0 con 0x7fd25c1df960 2024-09-17T05:45:29.140 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:29.137+0000 7fd262838640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd25c06e3c0 0x7fd25c09f2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:45:29.140 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:29.137+0000 7fd262838640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd25c06e3c0 0x7fd25c09f2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:36782/0 (socket says 172.21.15.150:36782) 2024-09-17T05:45:29.140 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:29.137+0000 7fd262838640 1 -- 172.21.15.150:0/2828256721 learned_addr learned my addr 172.21.15.150:0/2828256721 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:45:29.140 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:29.137+0000 7fd262037640 1 --2- 172.21.15.150:0/2828256721 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd248003a00 0x7fd25c09d9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:45:29.140 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:29.137+0000 7fd261836640 1 --2- 172.21.15.150:0/2828256721 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd25c1df960 0x7fd25c0cb3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:45:29.141 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:29.137+0000 7fd262838640 1 -- 172.21.15.150:0/2828256721 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd25c1df960 msgr2=0x7fd25c0cb3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:45:29.141 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:29.137+0000 7fd262838640 1 --2- 172.21.15.150:0/2828256721 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd25c1df960 0x7fd25c0cb3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:29.141 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:29.137+0000 7fd262838640 1 -- 172.21.15.150:0/2828256721 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd248003a00 msgr2=0x7fd25c09d9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:45:29.141 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:29.137+0000 7fd262838640 1 --2- 172.21.15.150:0/2828256721 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd248003a00 0x7fd25c09d9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:29.141 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:29.137+0000 7fd262838640 1 -- 172.21.15.150:0/2828256721 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd25c09d110 con 0x7fd25c06e3c0 2024-09-17T05:45:29.141 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:29.138+0000 7fd262838640 1 --2- 172.21.15.150:0/2828256721 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd25c06e3c0 0x7fd25c09f2d0 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7fd254005fd0 tx=0x7fd254010d90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:45:29.141 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:29.138+0000 7fd252ffd640 1 -- 172.21.15.150:0/2828256721 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd25400ed80 con 0x7fd25c06e3c0 2024-09-17T05:45:29.141 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:29.138+0000 7fd252ffd640 1 -- 172.21.15.150:0/2828256721 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd254015070 con 0x7fd25c06e3c0 2024-09-17T05:45:29.141 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:29.138+0000 7fd26429b640 1 -- 172.21.15.150:0/2828256721 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd25c09d3f0 con 0x7fd25c06e3c0 2024-09-17T05:45:29.141 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:29.138+0000 7fd252ffd640 1 -- 172.21.15.150:0/2828256721 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd254003b90 con 0x7fd25c06e3c0 2024-09-17T05:45:29.141 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:29.138+0000 7fd26429b640 1 -- 172.21.15.150:0/2828256721 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd25c0caec0 con 0x7fd25c06e3c0 2024-09-17T05:45:29.145 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:29.139+0000 7fd26429b640 1 -- 172.21.15.150:0/2828256721 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd25c1e8a50 con 0x7fd25c06e3c0 2024-09-17T05:45:29.145 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:29.140+0000 7fd252ffd640 1 -- 172.21.15.150:0/2828256721 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 15) ==== 102257+0+0 (secure 0 0 0) 0x7fd254004030 con 0x7fd25c06e3c0 2024-09-17T05:45:29.145 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:29.140+0000 7fd252ffd640 1 --2- 172.21.15.150:0/2828256721 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fd2400794c0 0x7fd24007b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:45:29.145 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:29.140+0000 7fd252ffd640 1 -- 172.21.15.150:0/2828256721 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(56..56 src has 1..56) ==== 4885+0+0 (secure 0 0 0) 0x7fd254099b40 con 0x7fd25c06e3c0 2024-09-17T05:45:29.145 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:29.140+0000 7fd262037640 1 --2- 172.21.15.150:0/2828256721 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fd2400794c0 0x7fd24007b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:45:29.145 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:29.141+0000 7fd262037640 1 --2- 172.21.15.150:0/2828256721 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fd2400794c0 0x7fd24007b9d0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fd25800c290 tx=0x7fd25802d000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:45:29.146 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:29.145+0000 7fd252ffd640 1 -- 172.21.15.150:0/2828256721 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fd254063470 con 0x7fd25c06e3c0 2024-09-17T05:45:29.325 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:29.323+0000 7fd26429b640 1 -- 172.21.15.150:0/2828256721 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7fd25c0b5260 con 0x7fd25c06e3c0 2024-09-17T05:45:29.325 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:29.324+0000 7fd252ffd640 1 -- 172.21.15.150:0/2828256721 <== mon.0 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v56) ==== 84+0+65 (secure 0 0 0) 0x7fd254067ea0 con 0x7fd25c06e3c0 2024-09-17T05:45:29.325 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-09-17T05:45:29.326 INFO:teuthology.orchestra.run.smithi150.stdout:[ 2024-09-17T05:45:29.326 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-09-17T05:45:29.326 INFO:teuthology.orchestra.run.smithi150.stdout: "poolnum": 1, 2024-09-17T05:45:29.326 INFO:teuthology.orchestra.run.smithi150.stdout: "poolname": ".mgr" 2024-09-17T05:45:29.326 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-09-17T05:45:29.326 INFO:teuthology.orchestra.run.smithi150.stdout:] 2024-09-17T05:45:29.328 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:29.326+0000 7fd26429b640 1 -- 172.21.15.150:0/2828256721 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fd2400794c0 msgr2=0x7fd24007b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:45:29.328 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:29.326+0000 7fd26429b640 1 --2- 172.21.15.150:0/2828256721 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fd2400794c0 0x7fd24007b9d0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fd25800c290 tx=0x7fd25802d000 comp rx=0 tx=0).stop 2024-09-17T05:45:29.328 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:29.326+0000 7fd26429b640 1 -- 172.21.15.150:0/2828256721 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd25c06e3c0 msgr2=0x7fd25c09f2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:45:29.328 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:29.326+0000 7fd26429b640 1 --2- 172.21.15.150:0/2828256721 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd25c06e3c0 0x7fd25c09f2d0 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7fd254005fd0 tx=0x7fd254010d90 comp rx=0 tx=0).stop 2024-09-17T05:45:29.329 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:29.326+0000 7fd26429b640 1 -- 172.21.15.150:0/2828256721 shutdown_connections 2024-09-17T05:45:29.329 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:29.326+0000 7fd26429b640 1 --2- 172.21.15.150:0/2828256721 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fd2400794c0 0x7fd24007b9d0 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:29.329 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:29.326+0000 7fd26429b640 1 --2- 172.21.15.150:0/2828256721 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd25c06e3c0 0x7fd25c09f2d0 unknown :-1 s=CLOSED pgs=610 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:29.329 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:29.326+0000 7fd26429b640 1 --2- 172.21.15.150:0/2828256721 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd25c1df960 0x7fd25c0cb3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:29.329 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:29.326+0000 7fd26429b640 1 --2- 172.21.15.150:0/2828256721 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd248003a00 0x7fd25c09d9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:29.330 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:29.326+0000 7fd26429b640 1 -- 172.21.15.150:0/2828256721 >> 172.21.15.150:0/2828256721 conn(0x7fd25c0cee90 msgr2=0x7fd25c1e4b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:45:29.331 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:29.326+0000 7fd26429b640 1 -- 172.21.15.150:0/2828256721 shutdown_connections 2024-09-17T05:45:29.331 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:29.326+0000 7fd26429b640 1 -- 172.21.15.150:0/2828256721 wait complete. 2024-09-17T05:45:29.339 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-09-17T05:45:29.339 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-09-17T05:45:29.458 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:29.456+0000 7f82429c3640 1 -- 172.21.15.150:0/3600075679 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f823c0d3320 msgr2=0x7f823c06df40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:45:29.458 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:29.456+0000 7f82429c3640 1 --2- 172.21.15.150:0/3600075679 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f823c0d3320 0x7f823c06df40 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7f8224009820 tx=0x7f822402a480 comp rx=0 tx=0).stop 2024-09-17T05:45:29.458 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:29.456+0000 7f82429c3640 1 -- 172.21.15.150:0/3600075679 shutdown_connections 2024-09-17T05:45:29.459 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:29.456+0000 7f82429c3640 1 --2- 172.21.15.150:0/3600075679 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f823c0b3ad0 0x7f823c06e480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:29.459 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:29.456+0000 7f82429c3640 1 --2- 172.21.15.150:0/3600075679 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f823c0d3320 0x7f823c06df40 unknown :-1 s=CLOSED pgs=612 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:29.459 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:29.456+0000 7f82429c3640 1 -- 172.21.15.150:0/3600075679 >> 172.21.15.150:0/3600075679 conn(0x7f823c0d46e0 msgr2=0x7f823c0d4af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:45:29.459 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:29.456+0000 7f82429c3640 1 -- 172.21.15.150:0/3600075679 shutdown_connections 2024-09-17T05:45:29.459 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:29.456+0000 7f82429c3640 1 -- 172.21.15.150:0/3600075679 wait complete. 2024-09-17T05:45:29.459 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:29.458+0000 7f82429c3640 1 Processor -- start 2024-09-17T05:45:29.460 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:29.458+0000 7f82429c3640 1 -- start start 2024-09-17T05:45:29.462 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:29.459+0000 7f82429c3640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f823c0b3580 0x7f823c0c9830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:45:29.462 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:29.459+0000 7f82429c3640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f823c0b3ad0 0x7f823c1e9be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:45:29.462 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:29.459+0000 7f82429c3640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f823c154d80 0x7f823c0c8180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:45:29.462 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:29.459+0000 7f82429c3640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f823c0ba1c0 con 0x7f823c0b3ad0 2024-09-17T05:45:29.462 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:29.459+0000 7f82429c3640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f823c0ba040 con 0x7f823c154d80 2024-09-17T05:45:29.462 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:29.459+0000 7f82429c3640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f823c06e9c0 con 0x7f823c0b3580 2024-09-17T05:45:29.463 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:29.460+0000 7f823b7fe640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f823c0b3ad0 0x7f823c1e9be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:45:29.463 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:29.460+0000 7f823b7fe640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f823c0b3ad0 0x7f823c1e9be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:36810/0 (socket says 172.21.15.150:36810) 2024-09-17T05:45:29.463 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:29.460+0000 7f823b7fe640 1 -- 172.21.15.150:0/194308734 learned_addr learned my addr 172.21.15.150:0/194308734 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:45:29.463 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:29.460+0000 7f823bfff640 1 --2- 172.21.15.150:0/194308734 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f823c0b3580 0x7f823c0c9830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:45:29.463 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:29.460+0000 7f8240f60640 1 --2- 172.21.15.150:0/194308734 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f823c154d80 0x7f823c0c8180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:45:29.463 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:29.460+0000 7f823b7fe640 1 -- 172.21.15.150:0/194308734 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f823c0b3580 msgr2=0x7f823c0c9830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:45:29.463 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:29.460+0000 7f823b7fe640 1 --2- 172.21.15.150:0/194308734 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f823c0b3580 0x7f823c0c9830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:29.463 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:29.460+0000 7f823b7fe640 1 -- 172.21.15.150:0/194308734 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f823c154d80 msgr2=0x7f823c0c8180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:45:29.463 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:29.460+0000 7f823b7fe640 1 --2- 172.21.15.150:0/194308734 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f823c154d80 0x7f823c0c8180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:29.463 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:29.460+0000 7f823b7fe640 1 -- 172.21.15.150:0/194308734 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f823c1e81d0 con 0x7f823c0b3ad0 2024-09-17T05:45:29.463 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:29.460+0000 7f823b7fe640 1 --2- 172.21.15.150:0/194308734 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f823c0b3ad0 0x7f823c1e9be0 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7f8224009940 tx=0x7f8224005270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:45:29.463 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:29.460+0000 7f8238ff9640 1 -- 172.21.15.150:0/194308734 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f822403f070 con 0x7f823c0b3ad0 2024-09-17T05:45:29.463 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:29.460+0000 7f8238ff9640 1 -- 172.21.15.150:0/194308734 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8224004340 con 0x7f823c0b3ad0 2024-09-17T05:45:29.464 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:29.460+0000 7f82429c3640 1 -- 172.21.15.150:0/194308734 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f823c1e9100 con 0x7f823c0b3ad0 2024-09-17T05:45:29.464 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:29.460+0000 7f8238ff9640 1 -- 172.21.15.150:0/194308734 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8224031bb0 con 0x7f823c0b3ad0 2024-09-17T05:45:29.464 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:29.460+0000 7f82429c3640 1 -- 172.21.15.150:0/194308734 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f823c1e96c0 con 0x7f823c0b3ad0 2024-09-17T05:45:29.465 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:29.461+0000 7f82429c3640 1 -- 172.21.15.150:0/194308734 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f823c08d090 con 0x7f823c0b3ad0 2024-09-17T05:45:29.465 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:29.462+0000 7f8238ff9640 1 -- 172.21.15.150:0/194308734 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 15) ==== 102257+0+0 (secure 0 0 0) 0x7f8224042070 con 0x7f823c0b3ad0 2024-09-17T05:45:29.465 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:29.463+0000 7f8238ff9640 1 --2- 172.21.15.150:0/194308734 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f821c079490 0x7f821c07b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:45:29.465 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:29.463+0000 7f8238ff9640 1 -- 172.21.15.150:0/194308734 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(56..56 src has 1..56) ==== 4885+0+0 (secure 0 0 0) 0x7f82240ba820 con 0x7f823c0b3ad0 2024-09-17T05:45:29.465 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:29.463+0000 7f823bfff640 1 --2- 172.21.15.150:0/194308734 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f821c079490 0x7f821c07b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:45:29.465 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:29.463+0000 7f823bfff640 1 --2- 172.21.15.150:0/194308734 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f821c079490 0x7f821c07b9a0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f822c0016f0 tx=0x7f822c009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:45:29.469 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:29.467+0000 7f8238ff9640 1 -- 172.21.15.150:0/194308734 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f823c08d090 con 0x7f823c0b3ad0 2024-09-17T05:45:29.642 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:29.640+0000 7f82429c3640 1 -- 172.21.15.150:0/194308734 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7f823c06eee0 con 0x7f823c0b3ad0 2024-09-17T05:45:30.614 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:30.612+0000 7f8238ff9640 1 -- 172.21.15.150:0/194308734 <== mon.0 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v57) ==== 138+0+0 (secure 0 0 0) 0x7f8224031770 con 0x7f823c0b3ad0 2024-09-17T05:45:30.614 INFO:teuthology.orchestra.run.smithi150.stderr:pool 'cephfs_metadata' created 2024-09-17T05:45:30.617 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:30.615+0000 7f82429c3640 1 -- 172.21.15.150:0/194308734 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f821c079490 msgr2=0x7f821c07b9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:45:30.617 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:30.615+0000 7f82429c3640 1 --2- 172.21.15.150:0/194308734 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f821c079490 0x7f821c07b9a0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f822c0016f0 tx=0x7f822c009040 comp rx=0 tx=0).stop 2024-09-17T05:45:30.617 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:30.615+0000 7f82429c3640 1 -- 172.21.15.150:0/194308734 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f823c0b3ad0 msgr2=0x7f823c1e9be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:45:30.617 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:30.615+0000 7f82429c3640 1 --2- 172.21.15.150:0/194308734 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f823c0b3ad0 0x7f823c1e9be0 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7f8224009940 tx=0x7f8224005270 comp rx=0 tx=0).stop 2024-09-17T05:45:30.617 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:30.615+0000 7f82429c3640 1 -- 172.21.15.150:0/194308734 shutdown_connections 2024-09-17T05:45:30.617 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:30.615+0000 7f82429c3640 1 --2- 172.21.15.150:0/194308734 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f823c154d80 0x7f823c0c8180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:30.617 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:30.615+0000 7f82429c3640 1 --2- 172.21.15.150:0/194308734 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f821c079490 0x7f821c07b9a0 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:30.617 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:30.615+0000 7f82429c3640 1 --2- 172.21.15.150:0/194308734 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f823c0b3ad0 0x7f823c1e9be0 unknown :-1 s=CLOSED pgs=613 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:30.617 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:30.615+0000 7f82429c3640 1 --2- 172.21.15.150:0/194308734 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f823c0b3580 0x7f823c0c9830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:30.618 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:30.615+0000 7f82429c3640 1 -- 172.21.15.150:0/194308734 >> 172.21.15.150:0/194308734 conn(0x7f823c0d46e0 msgr2=0x7f823c068f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:45:30.618 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:30.615+0000 7f82429c3640 1 -- 172.21.15.150:0/194308734 shutdown_connections 2024-09-17T05:45:30.618 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:30.615+0000 7f82429c3640 1 -- 172.21.15.150:0/194308734 wait complete. 2024-09-17T05:45:30.633 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-09-17T05:45:30.756 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:30.754+0000 7fdb783ad640 1 -- 172.21.15.150:0/2418323394 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fdb70162160 msgr2=0x7fdb700b8c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:45:30.756 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:30.754+0000 7fdb783ad640 1 --2- 172.21.15.150:0/2418323394 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fdb70162160 0x7fdb700b8c40 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7fdb68005fd0 tx=0x7fdb6802a970 comp rx=0 tx=0).stop 2024-09-17T05:45:30.756 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:30.754+0000 7fdb783ad640 1 -- 172.21.15.150:0/2418323394 shutdown_connections 2024-09-17T05:45:30.756 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:30.754+0000 7fdb783ad640 1 --2- 172.21.15.150:0/2418323394 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fdb70162160 0x7fdb700b8c40 unknown :-1 s=CLOSED pgs=614 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:30.756 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:30.754+0000 7fdb783ad640 1 --2- 172.21.15.150:0/2418323394 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fdb700b9810 0x7fdb700b7ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:30.757 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:30.754+0000 7fdb783ad640 1 -- 172.21.15.150:0/2418323394 >> 172.21.15.150:0/2418323394 conn(0x7fdb700d46c0 msgr2=0x7fdb700d4ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:45:30.757 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:30.754+0000 7fdb783ad640 1 -- 172.21.15.150:0/2418323394 shutdown_connections 2024-09-17T05:45:30.757 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:30.754+0000 7fdb783ad640 1 -- 172.21.15.150:0/2418323394 wait complete. 2024-09-17T05:45:30.757 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:30.756+0000 7fdb783ad640 1 Processor -- start 2024-09-17T05:45:30.757 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:30.756+0000 7fdb783ad640 1 -- start start 2024-09-17T05:45:30.760 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:30.757+0000 7fdb783ad640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fdb700b9d80 0x7fdb700b15d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:45:30.761 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:30.757+0000 7fdb783ad640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fdb70162160 0x7fdb701548f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:45:30.761 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:30.757+0000 7fdb783ad640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fdb700b1b10 0x7fdb70154e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:45:30.761 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:30.757+0000 7fdb783ad640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7fdb7006f4a0 con 0x7fdb700b9d80 2024-09-17T05:45:30.761 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:30.757+0000 7fdb783ad640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fdb7006f320 con 0x7fdb70162160 2024-09-17T05:45:30.761 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:30.757+0000 7fdb783ad640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fdb7006f620 con 0x7fdb700b1b10 2024-09-17T05:45:30.761 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:30.757+0000 7fdb76149640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fdb700b9d80 0x7fdb700b15d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:45:30.761 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:30.757+0000 7fdb76149640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fdb700b9d80 0x7fdb700b15d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:39126/0 (socket says 172.21.15.150:39126) 2024-09-17T05:45:30.761 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:30.757+0000 7fdb76149640 1 -- 172.21.15.150:0/1635361100 learned_addr learned my addr 172.21.15.150:0/1635361100 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:45:30.761 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:30.757+0000 7fdb7694a640 1 --2- 172.21.15.150:0/1635361100 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fdb700b1b10 0x7fdb70154e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:45:30.761 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:30.757+0000 7fdb75948640 1 --2- 172.21.15.150:0/1635361100 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fdb70162160 0x7fdb701548f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:45:30.761 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:30.757+0000 7fdb76149640 1 -- 172.21.15.150:0/1635361100 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fdb700b1b10 msgr2=0x7fdb70154e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:45:30.761 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:30.757+0000 7fdb76149640 1 --2- 172.21.15.150:0/1635361100 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fdb700b1b10 0x7fdb70154e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:30.761 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:30.757+0000 7fdb76149640 1 -- 172.21.15.150:0/1635361100 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fdb70162160 msgr2=0x7fdb701548f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:45:30.762 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:30.757+0000 7fdb76149640 1 --2- 172.21.15.150:0/1635361100 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fdb70162160 0x7fdb701548f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:30.762 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:30.757+0000 7fdb76149640 1 -- 172.21.15.150:0/1635361100 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdb701555c0 con 0x7fdb700b9d80 2024-09-17T05:45:30.762 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:30.757+0000 7fdb75948640 1 --2- 172.21.15.150:0/1635361100 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fdb70162160 0x7fdb701548f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:45:30.762 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:30.758+0000 7fdb76149640 1 --2- 172.21.15.150:0/1635361100 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fdb700b9d80 0x7fdb700b15d0 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7fdb6c00c970 tx=0x7fdb6c00ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:45:30.762 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:30.758+0000 7fdb66ffd640 1 -- 172.21.15.150:0/1635361100 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb6c007bb0 con 0x7fdb700b9d80 2024-09-17T05:45:30.762 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:30.758+0000 7fdb66ffd640 1 -- 172.21.15.150:0/1635361100 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fdb6c007e40 con 0x7fdb700b9d80 2024-09-17T05:45:30.762 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:30.758+0000 7fdb783ad640 1 -- 172.21.15.150:0/1635361100 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdb701f90c0 con 0x7fdb700b9d80 2024-09-17T05:45:30.762 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:30.758+0000 7fdb66ffd640 1 -- 172.21.15.150:0/1635361100 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb6c005290 con 0x7fdb700b9d80 2024-09-17T05:45:30.762 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:30.758+0000 7fdb783ad640 1 -- 172.21.15.150:0/1635361100 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdb701f9680 con 0x7fdb700b9d80 2024-09-17T05:45:30.762 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:30.759+0000 7fdb783ad640 1 -- 172.21.15.150:0/1635361100 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdb700b9810 con 0x7fdb700b9d80 2024-09-17T05:45:30.763 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:30.760+0000 7fdb66ffd640 1 -- 172.21.15.150:0/1635361100 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 15) ==== 102257+0+0 (secure 0 0 0) 0x7fdb6c005430 con 0x7fdb700b9d80 2024-09-17T05:45:30.763 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:30.760+0000 7fdb66ffd640 1 --2- 172.21.15.150:0/1635361100 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fdb54079490 0x7fdb5407b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:45:30.763 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:30.760+0000 7fdb66ffd640 1 -- 172.21.15.150:0/1635361100 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(57..57 src has 1..57) ==== 5255+0+0 (secure 0 0 0) 0x7fdb6c099e00 con 0x7fdb700b9d80 2024-09-17T05:45:30.763 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:30.760+0000 7fdb75948640 1 --2- 172.21.15.150:0/1635361100 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fdb54079490 0x7fdb5407b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:45:30.763 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:30.761+0000 7fdb75948640 1 --2- 172.21.15.150:0/1635361100 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fdb54079490 0x7fdb5407b9a0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fdb60006fd0 tx=0x7fdb60008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:45:30.766 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:30.764+0000 7fdb66ffd640 1 -- 172.21.15.150:0/1635361100 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fdb6c014070 con 0x7fdb700b9d80 2024-09-17T05:45:30.944 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:30.943+0000 7fdb783ad640 1 -- 172.21.15.150:0/1635361100 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7fdb70160b70 con 0x7fdb700b9d80 2024-09-17T05:45:31.620 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:31.618+0000 7fdb66ffd640 1 -- 172.21.15.150:0/1635361100 <== mon.0 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v58) ==== 170+0+0 (secure 0 0 0) 0x7fdb6c063710 con 0x7fdb700b9d80 2024-09-17T05:45:31.620 INFO:teuthology.orchestra.run.smithi150.stderr:pool 'cephfs_data' created 2024-09-17T05:45:31.624 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:31.622+0000 7fdb783ad640 1 -- 172.21.15.150:0/1635361100 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fdb54079490 msgr2=0x7fdb5407b9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:45:31.624 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:31.622+0000 7fdb783ad640 1 --2- 172.21.15.150:0/1635361100 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fdb54079490 0x7fdb5407b9a0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fdb60006fd0 tx=0x7fdb60008040 comp rx=0 tx=0).stop 2024-09-17T05:45:31.624 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:31.622+0000 7fdb783ad640 1 -- 172.21.15.150:0/1635361100 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fdb700b9d80 msgr2=0x7fdb700b15d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:45:31.624 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:31.622+0000 7fdb783ad640 1 --2- 172.21.15.150:0/1635361100 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fdb700b9d80 0x7fdb700b15d0 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7fdb6c00c970 tx=0x7fdb6c00ce30 comp rx=0 tx=0).stop 2024-09-17T05:45:31.624 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:31.622+0000 7fdb783ad640 1 -- 172.21.15.150:0/1635361100 shutdown_connections 2024-09-17T05:45:31.624 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:31.622+0000 7fdb783ad640 1 --2- 172.21.15.150:0/1635361100 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fdb70162160 0x7fdb701548f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:31.624 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:31.622+0000 7fdb783ad640 1 --2- 172.21.15.150:0/1635361100 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fdb54079490 0x7fdb5407b9a0 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:31.624 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:31.622+0000 7fdb783ad640 1 --2- 172.21.15.150:0/1635361100 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fdb700b1b10 0x7fdb70154e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:31.624 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:31.622+0000 7fdb783ad640 1 --2- 172.21.15.150:0/1635361100 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fdb700b9d80 0x7fdb700b15d0 unknown :-1 s=CLOSED pgs=615 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:31.624 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:31.622+0000 7fdb783ad640 1 -- 172.21.15.150:0/1635361100 >> 172.21.15.150:0/1635361100 conn(0x7fdb700d46c0 msgr2=0x7fdb700d4ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:45:31.625 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:31.622+0000 7fdb783ad640 1 -- 172.21.15.150:0/1635361100 shutdown_connections 2024-09-17T05:45:31.625 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:31.622+0000 7fdb783ad640 1 -- 172.21.15.150:0/1635361100 wait complete. 2024-09-17T05:45:31.648 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-09-17T05:45:31.766 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:31.764+0000 7f76e83f1640 1 -- 172.21.15.150:0/1748164720 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f76e0167bf0 msgr2=0x7f76e016a010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:45:31.766 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:31.764+0000 7f76e83f1640 1 --2- 172.21.15.150:0/1748164720 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f76e0167bf0 0x7f76e016a010 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7f76d8009830 tx=0x7f76d802a5c0 comp rx=0 tx=0).stop 2024-09-17T05:45:31.766 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:31.764+0000 7f76e83f1640 1 -- 172.21.15.150:0/1748164720 shutdown_connections 2024-09-17T05:45:31.767 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:31.764+0000 7f76e83f1640 1 --2- 172.21.15.150:0/1748164720 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f76e0167bf0 0x7f76e016a010 unknown :-1 s=CLOSED pgs=617 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:31.767 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:31.764+0000 7f76e83f1640 1 -- 172.21.15.150:0/1748164720 >> 172.21.15.150:0/1748164720 conn(0x7f76e00d4680 msgr2=0x7f76e00d4a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:45:31.767 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:31.764+0000 7f76e83f1640 1 -- 172.21.15.150:0/1748164720 shutdown_connections 2024-09-17T05:45:31.767 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:31.764+0000 7f76e83f1640 1 -- 172.21.15.150:0/1748164720 wait complete. 2024-09-17T05:45:31.767 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:31.766+0000 7f76e83f1640 1 Processor -- start 2024-09-17T05:45:31.768 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:31.766+0000 7f76e83f1640 1 -- start start 2024-09-17T05:45:31.771 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:31.767+0000 7f76e83f1640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f76e00b3ae0 0x7f76e0152ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:45:31.771 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:31.767+0000 7f76e83f1640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f76e00d2370 0x7f76e0158d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:45:31.771 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:31.767+0000 7f76e83f1640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f76e0167bf0 0x7f76e0159250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:45:31.771 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:31.767+0000 7f76e83f1640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f76e016a550 con 0x7f76e0167bf0 2024-09-17T05:45:31.771 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:31.767+0000 7f76e83f1640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f76e00d0f50 con 0x7f76e00b3ae0 2024-09-17T05:45:31.771 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:31.767+0000 7f76e83f1640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f76e016a6d0 con 0x7f76e00d2370 2024-09-17T05:45:31.771 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:31.768+0000 7f76e698e640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f76e0167bf0 0x7f76e0159250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:45:31.771 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:31.768+0000 7f76e698e640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f76e0167bf0 0x7f76e0159250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:39154/0 (socket says 172.21.15.150:39154) 2024-09-17T05:45:31.772 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:31.768+0000 7f76e698e640 1 -- 172.21.15.150:0/416464737 learned_addr learned my addr 172.21.15.150:0/416464737 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:45:31.772 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:31.768+0000 7f76e618d640 1 --2- 172.21.15.150:0/416464737 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f76e00b3ae0 0x7f76e0152ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:45:31.772 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:31.768+0000 7f76e598c640 1 --2- 172.21.15.150:0/416464737 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f76e00d2370 0x7f76e0158d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:45:31.772 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:31.768+0000 7f76e698e640 1 -- 172.21.15.150:0/416464737 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f76e00d2370 msgr2=0x7f76e0158d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:45:31.772 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:31.768+0000 7f76e698e640 1 --2- 172.21.15.150:0/416464737 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f76e00d2370 0x7f76e0158d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:31.772 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:31.768+0000 7f76e698e640 1 -- 172.21.15.150:0/416464737 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f76e00b3ae0 msgr2=0x7f76e0152ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:45:31.773 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:31.768+0000 7f76e698e640 1 --2- 172.21.15.150:0/416464737 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f76e00b3ae0 0x7f76e0152ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:31.773 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:31.768+0000 7f76e698e640 1 -- 172.21.15.150:0/416464737 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f76e0169490 con 0x7f76e0167bf0 2024-09-17T05:45:31.773 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:31.768+0000 7f76e598c640 1 --2- 172.21.15.150:0/416464737 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f76e00d2370 0x7f76e0158d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T05:45:31.773 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:31.768+0000 7f76e698e640 1 --2- 172.21.15.150:0/416464737 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f76e0167bf0 0x7f76e0159250 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7f76d8009950 tx=0x7f76d8033ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:45:31.773 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:31.768+0000 7f76deffd640 1 -- 172.21.15.150:0/416464737 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76d8031d60 con 0x7f76e0167bf0 2024-09-17T05:45:31.773 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:31.768+0000 7f76deffd640 1 -- 172.21.15.150:0/416464737 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f76d8005020 con 0x7f76e0167bf0 2024-09-17T05:45:31.773 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:31.768+0000 7f76deffd640 1 -- 172.21.15.150:0/416464737 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76d8005450 con 0x7f76e0167bf0 2024-09-17T05:45:31.773 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:31.768+0000 7f76e83f1640 1 -- 172.21.15.150:0/416464737 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f76e015ace0 con 0x7f76e0167bf0 2024-09-17T05:45:31.773 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:31.768+0000 7f76e83f1640 1 -- 172.21.15.150:0/416464737 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f76e01691b0 con 0x7f76e0167bf0 2024-09-17T05:45:31.773 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:31.769+0000 7f76e83f1640 1 -- 172.21.15.150:0/416464737 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f76e008d090 con 0x7f76e0167bf0 2024-09-17T05:45:31.775 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:31.770+0000 7f76deffd640 1 -- 172.21.15.150:0/416464737 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 15) ==== 102257+0+0 (secure 0 0 0) 0x7f76d80047a0 con 0x7f76e0167bf0 2024-09-17T05:45:31.775 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:31.771+0000 7f76deffd640 1 --2- 172.21.15.150:0/416464737 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f76cc0794c0 0x7f76cc07b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:45:31.775 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:31.771+0000 7f76deffd640 1 -- 172.21.15.150:0/416464737 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(58..58 src has 1..58) ==== 5637+0+0 (secure 0 0 0) 0x7f76d80ba830 con 0x7f76e0167bf0 2024-09-17T05:45:31.775 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:31.771+0000 7f76e618d640 1 --2- 172.21.15.150:0/416464737 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f76cc0794c0 0x7f76cc07b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:45:31.775 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:31.772+0000 7f76e618d640 1 --2- 172.21.15.150:0/416464737 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f76cc0794c0 0x7f76cc07b9d0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f76d0001d10 tx=0x7f76d0009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:45:31.778 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:31.776+0000 7f76deffd640 1 -- 172.21.15.150:0/416464737 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f76e008d090 con 0x7f76e0167bf0 2024-09-17T05:45:31.988 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:31.987+0000 7f76e83f1640 1 -- 172.21.15.150:0/416464737 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7f76e01628c0 con 0x7f76e0167bf0 2024-09-17T05:45:32.621 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:32.620+0000 7f76deffd640 1 -- 172.21.15.150:0/416464737 <== mon.0 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 8 and data pool 9 v30) ==== 172+0+0 (secure 0 0 0) 0x7f76d803f030 con 0x7f76e0167bf0 2024-09-17T05:45:32.622 INFO:teuthology.orchestra.run.smithi150.stderr:new fs with metadata pool 8 and data pool 9 2024-09-17T05:45:32.626 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:32.624+0000 7f76e83f1640 1 -- 172.21.15.150:0/416464737 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f76cc0794c0 msgr2=0x7f76cc07b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:45:32.626 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:32.624+0000 7f76e83f1640 1 --2- 172.21.15.150:0/416464737 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f76cc0794c0 0x7f76cc07b9d0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f76d0001d10 tx=0x7f76d0009040 comp rx=0 tx=0).stop 2024-09-17T05:45:32.626 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:32.624+0000 7f76e83f1640 1 -- 172.21.15.150:0/416464737 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f76e0167bf0 msgr2=0x7f76e0159250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:45:32.626 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:32.624+0000 7f76e83f1640 1 --2- 172.21.15.150:0/416464737 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f76e0167bf0 0x7f76e0159250 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7f76d8009950 tx=0x7f76d8033ce0 comp rx=0 tx=0).stop 2024-09-17T05:45:32.627 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:32.624+0000 7f76e83f1640 1 -- 172.21.15.150:0/416464737 shutdown_connections 2024-09-17T05:45:32.627 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:32.624+0000 7f76e83f1640 1 --2- 172.21.15.150:0/416464737 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f76cc0794c0 0x7f76cc07b9d0 secure :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f76d0001d10 tx=0x7f76d0009040 comp rx=0 tx=0).stop 2024-09-17T05:45:32.627 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:32.624+0000 7f76e83f1640 1 --2- 172.21.15.150:0/416464737 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f76e0167bf0 0x7f76e0159250 unknown :-1 s=CLOSED pgs=618 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:32.627 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:32.624+0000 7f76e83f1640 1 --2- 172.21.15.150:0/416464737 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f76e00d2370 0x7f76e0158d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:32.627 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:32.624+0000 7f76e83f1640 1 --2- 172.21.15.150:0/416464737 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f76e00b3ae0 0x7f76e0152ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:32.627 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:32.624+0000 7f76e83f1640 1 -- 172.21.15.150:0/416464737 >> 172.21.15.150:0/416464737 conn(0x7f76e00d4680 msgr2=0x7f76e00b8ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:45:32.627 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:32.625+0000 7f76e83f1640 1 -- 172.21.15.150:0/416464737 shutdown_connections 2024-09-17T05:45:32.627 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:32.626+0000 7f76e83f1640 1 -- 172.21.15.150:0/416464737 wait complete. 2024-09-17T05:45:32.660 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T05:45:32.775 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:32.773+0000 7efc3cf8e640 1 -- 172.21.15.150:0/3389549239 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7efc381528b0 msgr2=0x7efc3815fa40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:45:32.775 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:32.773+0000 7efc3cf8e640 1 --2- 172.21.15.150:0/3389549239 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7efc381528b0 0x7efc3815fa40 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7efc2c009860 tx=0x7efc2c02a5a0 comp rx=0 tx=0).stop 2024-09-17T05:45:32.775 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:32.773+0000 7efc3cf8e640 1 -- 172.21.15.150:0/3389549239 shutdown_connections 2024-09-17T05:45:32.775 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:32.773+0000 7efc3cf8e640 1 --2- 172.21.15.150:0/3389549239 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7efc381528b0 0x7efc3815fa40 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:32.775 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:32.773+0000 7efc3cf8e640 1 -- 172.21.15.150:0/3389549239 >> 172.21.15.150:0/3389549239 conn(0x7efc380d0b50 msgr2=0x7efc380d0f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:45:32.776 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:32.773+0000 7efc3cf8e640 1 -- 172.21.15.150:0/3389549239 shutdown_connections 2024-09-17T05:45:32.776 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:32.773+0000 7efc3cf8e640 1 -- 172.21.15.150:0/3389549239 wait complete. 2024-09-17T05:45:32.776 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:32.775+0000 7efc3cf8e640 1 Processor -- start 2024-09-17T05:45:32.776 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:32.775+0000 7efc3cf8e640 1 -- start start 2024-09-17T05:45:32.779 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:32.776+0000 7efc3cf8e640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7efc380705b0 0x7efc381f34b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:45:32.779 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:32.776+0000 7efc3cf8e640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7efc380cd040 0x7efc38158e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:45:32.779 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:32.776+0000 7efc3cf8e640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7efc381528b0 0x7efc38154810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:45:32.779 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:32.776+0000 7efc3cf8e640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7efc38071460 con 0x7efc380705b0 2024-09-17T05:45:32.779 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:32.776+0000 7efc3cf8e640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7efc380712e0 con 0x7efc381528b0 2024-09-17T05:45:32.779 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:32.776+0000 7efc3cf8e640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7efc380715e0 con 0x7efc380cd040 2024-09-17T05:45:32.779 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:32.776+0000 7efc3659c640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7efc380705b0 0x7efc381f34b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:45:32.779 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:32.777+0000 7efc3659c640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7efc380705b0 0x7efc381f34b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:39166/0 (socket says 172.21.15.150:39166) 2024-09-17T05:45:32.780 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:32.777+0000 7efc3659c640 1 -- 172.21.15.150:0/1687239480 learned_addr learned my addr 172.21.15.150:0/1687239480 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:45:32.780 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:32.777+0000 7efc35d9b640 1 --2- 172.21.15.150:0/1687239480 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7efc380cd040 0x7efc38158e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:45:32.780 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:32.777+0000 7efc36d9d640 1 --2- 172.21.15.150:0/1687239480 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7efc381528b0 0x7efc38154810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:45:32.780 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:32.777+0000 7efc3659c640 1 -- 172.21.15.150:0/1687239480 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7efc380cd040 msgr2=0x7efc38158e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:45:32.780 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:32.777+0000 7efc3659c640 1 --2- 172.21.15.150:0/1687239480 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7efc380cd040 0x7efc38158e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:32.780 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:32.777+0000 7efc3659c640 1 -- 172.21.15.150:0/1687239480 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7efc381528b0 msgr2=0x7efc38154810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:45:32.780 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:32.777+0000 7efc3659c640 1 --2- 172.21.15.150:0/1687239480 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7efc381528b0 0x7efc38154810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:32.780 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:32.777+0000 7efc3659c640 1 -- 172.21.15.150:0/1687239480 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efc381412f0 con 0x7efc380705b0 2024-09-17T05:45:32.780 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:32.777+0000 7efc3659c640 1 --2- 172.21.15.150:0/1687239480 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7efc380705b0 0x7efc381f34b0 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7efc2800c430 tx=0x7efc2800c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:45:32.780 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:32.777+0000 7efc26ffd640 1 -- 172.21.15.150:0/1687239480 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc28011790 con 0x7efc380705b0 2024-09-17T05:45:32.780 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:32.777+0000 7efc3cf8e640 1 -- 172.21.15.150:0/1687239480 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efc381f3d50 con 0x7efc380705b0 2024-09-17T05:45:32.781 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:32.777+0000 7efc26ffd640 1 -- 172.21.15.150:0/1687239480 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7efc28017070 con 0x7efc380705b0 2024-09-17T05:45:32.781 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:32.777+0000 7efc26ffd640 1 -- 172.21.15.150:0/1687239480 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc28011ce0 con 0x7efc380705b0 2024-09-17T05:45:32.781 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:32.777+0000 7efc3cf8e640 1 -- 172.21.15.150:0/1687239480 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efc38141560 con 0x7efc380705b0 2024-09-17T05:45:32.782 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:32.778+0000 7efc3cf8e640 1 -- 172.21.15.150:0/1687239480 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efc380709c0 con 0x7efc380705b0 2024-09-17T05:45:32.782 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:32.779+0000 7efc26ffd640 1 -- 172.21.15.150:0/1687239480 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 15) ==== 102257+0+0 (secure 0 0 0) 0x7efc2801c460 con 0x7efc380705b0 2024-09-17T05:45:32.782 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:32.780+0000 7efc26ffd640 1 --2- 172.21.15.150:0/1687239480 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7efc18079490 0x7efc1807b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:45:32.782 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:32.780+0000 7efc26ffd640 1 -- 172.21.15.150:0/1687239480 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(59..59 src has 1..59) ==== 5737+0+0 (secure 0 0 0) 0x7efc28099d50 con 0x7efc380705b0 2024-09-17T05:45:32.783 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:32.780+0000 7efc35d9b640 1 --2- 172.21.15.150:0/1687239480 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7efc18079490 0x7efc1807b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:45:32.783 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:32.780+0000 7efc35d9b640 1 --2- 172.21.15.150:0/1687239480 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7efc18079490 0x7efc1807b9a0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7efc2c034000 tx=0x7efc2c004730 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:45:32.785 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:32.783+0000 7efc26ffd640 1 -- 172.21.15.150:0/1687239480 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7efc280635f0 con 0x7efc380705b0 2024-09-17T05:45:32.962 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:32.960+0000 7efc3cf8e640 1 -- 172.21.15.150:0/1687239480 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7efc380d1830 con 0x7efc380705b0 2024-09-17T05:45:32.963 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:32.961+0000 7efc26ffd640 1 -- 172.21.15.150:0/1687239480 <== mon.0 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v59) ==== 74+0+16817 (secure 0 0 0) 0x7efc28068020 con 0x7efc380705b0 2024-09-17T05:45:32.963 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-09-17T05:45:32.963 INFO:teuthology.orchestra.run.smithi150.stdout:{"epoch":59,"fsid":"9f2e05e9-d629-47b3-b26b-1360655b7d20","created":"2024-09-17T05:41:32.502979+0000","modified":"2024-09-17T05:45:31.989061+0000","last_up_change":"2024-09-17T05:41:46.150225+0000","last_in_change":"2024-09-17T05:41:36.120274+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T05:41:46.860779+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2024-09-17T05:45:29.646151+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"59","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_data","create_time":"2024-09-17T05:45:30.948666+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"59","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"4f31c018-c8a4-4d6d-b0c2-a597c47aae4a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6800","nonce":479374392},{"type":"v1","addr":"172.21.15.150:6801","nonce":479374392}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6802","nonce":479374392},{"type":"v1","addr":"172.21.15.150:6803","nonce":479374392}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6806","nonce":479374392},{"type":"v1","addr":"172.21.15.150:6807","nonce":479374392}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6804","nonce":479374392},{"type":"v1","addr":"172.21.15.150:6805","nonce":479374392}]},"public_addr":"172.21.15.150:6801/479374392","cluster_addr":"172.21.15.150:6803/479374392","heartbeat_back_addr":"172.21.15.150:6807/479374392","heartbeat_front_addr":"172.21.15.150:6805/479374392","state":["exists","up"]},{"osd":1,"uuid":"6ff4a573-500b-4e04-9de3-39265ead78b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6824","nonce":913899800},{"type":"v1","addr":"172.21.15.150:6825","nonce":913899800}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6826","nonce":913899800},{"type":"v1","addr":"172.21.15.150:6827","nonce":913899800}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6830","nonce":913899800},{"type":"v1","addr":"172.21.15.150:6831","nonce":913899800}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6828","nonce":913899800},{"type":"v1","addr":"172.21.15.150:6829","nonce":913899800}]},"public_addr":"172.21.15.150:6825/913899800","cluster_addr":"172.21.15.150:6827/913899800","heartbeat_back_addr":"172.21.15.150:6831/913899800","heartbeat_front_addr":"172.21.15.150:6829/913899800","state":["exists","up"]},{"osd":2,"uuid":"bffea6f9-2465-4182-b205-00436c41ac1c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6816","nonce":363718461},{"type":"v1","addr":"172.21.15.150:6817","nonce":363718461}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6818","nonce":363718461},{"type":"v1","addr":"172.21.15.150:6819","nonce":363718461}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6822","nonce":363718461},{"type":"v1","addr":"172.21.15.150:6823","nonce":363718461}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6820","nonce":363718461},{"type":"v1","addr":"172.21.15.150:6821","nonce":363718461}]},"public_addr":"172.21.15.150:6817/363718461","cluster_addr":"172.21.15.150:6819/363718461","heartbeat_back_addr":"172.21.15.150:6823/363718461","heartbeat_front_addr":"172.21.15.150:6821/363718461","state":["exists","up"]},{"osd":3,"uuid":"cda70430-d1e1-427e-b04e-56db4031d078","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6808","nonce":3550994626},{"type":"v1","addr":"172.21.15.150:6809","nonce":3550994626}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6810","nonce":3550994626},{"type":"v1","addr":"172.21.15.150:6811","nonce":3550994626}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6814","nonce":3550994626},{"type":"v1","addr":"172.21.15.150:6815","nonce":3550994626}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6812","nonce":3550994626},{"type":"v1","addr":"172.21.15.150:6813","nonce":3550994626}]},"public_addr":"172.21.15.150:6809/3550994626","cluster_addr":"172.21.15.150:6811/3550994626","heartbeat_back_addr":"172.21.15.150:6815/3550994626","heartbeat_front_addr":"172.21.15.150:6813/3550994626","state":["exists","up"]},{"osd":4,"uuid":"3a0277fb-5e1e-4f68-bb2d-9a8a0152f64a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6810","nonce":2718261497},{"type":"v1","addr":"172.21.15.176:6811","nonce":2718261497}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6812","nonce":2718261497},{"type":"v1","addr":"172.21.15.176:6813","nonce":2718261497}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6816","nonce":2718261497},{"type":"v1","addr":"172.21.15.176:6817","nonce":2718261497}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6814","nonce":2718261497},{"type":"v1","addr":"172.21.15.176:6815","nonce":2718261497}]},"public_addr":"172.21.15.176:6811/2718261497","cluster_addr":"172.21.15.176:6813/2718261497","heartbeat_back_addr":"172.21.15.176:6817/2718261497","heartbeat_front_addr":"172.21.15.176:6815/2718261497","state":["exists","up"]},{"osd":5,"uuid":"33aebee6-0315-40b7-a11c-6702f0be494d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6818","nonce":2049295774},{"type":"v1","addr":"172.21.15.176:6819","nonce":2049295774}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6820","nonce":2049295774},{"type":"v1","addr":"172.21.15.176:6821","nonce":2049295774}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6824","nonce":2049295774},{"type":"v1","addr":"172.21.15.176:6825","nonce":2049295774}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6822","nonce":2049295774},{"type":"v1","addr":"172.21.15.176:6823","nonce":2049295774}]},"public_addr":"172.21.15.176:6819/2049295774","cluster_addr":"172.21.15.176:6821/2049295774","heartbeat_back_addr":"172.21.15.176:6825/2049295774","heartbeat_front_addr":"172.21.15.176:6823/2049295774","state":["exists","up"]},{"osd":6,"uuid":"4d24f360-6751-4263-841b-d77793d33540","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6826","nonce":2164458476},{"type":"v1","addr":"172.21.15.176:6827","nonce":2164458476}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6828","nonce":2164458476},{"type":"v1","addr":"172.21.15.176:6829","nonce":2164458476}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6832","nonce":2164458476},{"type":"v1","addr":"172.21.15.176:6833","nonce":2164458476}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6830","nonce":2164458476},{"type":"v1","addr":"172.21.15.176:6831","nonce":2164458476}]},"public_addr":"172.21.15.176:6827/2164458476","cluster_addr":"172.21.15.176:6829/2164458476","heartbeat_back_addr":"172.21.15.176:6833/2164458476","heartbeat_front_addr":"172.21.15.176:6831/2164458476","state":["exists","up"]},{"osd":7,"uuid":"c8594fda-c74a-4ba9-8277-caf101d58ca1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6802","nonce":3239587708},{"type":"v1","addr":"172.21.15.176:6803","nonce":3239587708}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6804","nonce":3239587708},{"type":"v1","addr":"172.21.15.176:6805","nonce":3239587708}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6808","nonce":3239587708},{"type":"v1","addr":"172.21.15.176:6809","nonce":3239587708}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6806","nonce":3239587708},{"type":"v1","addr":"172.21.15.176:6807","nonce":3239587708}]},"public_addr":"172.21.15.176:6803/3239587708","cluster_addr":"172.21.15.176:6805/3239587708","heartbeat_back_addr":"172.21.15.176:6809/3239587708","heartbeat_front_addr":"172.21.15.176:6807/3239587708","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:41:41.905151+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:41:42.705679+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:41:42.459673+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:41:42.440819+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:41:42.668428+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:41:42.694972+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:41:43.078535+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:41:42.363539+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":7,"snaps":[{"begin":2,"length":2}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T05:45:32.965 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:32.964+0000 7efc3cf8e640 1 -- 172.21.15.150:0/1687239480 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7efc18079490 msgr2=0x7efc1807b9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:45:32.966 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:32.964+0000 7efc3cf8e640 1 --2- 172.21.15.150:0/1687239480 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7efc18079490 0x7efc1807b9a0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7efc2c034000 tx=0x7efc2c004730 comp rx=0 tx=0).stop 2024-09-17T05:45:32.966 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:32.964+0000 7efc3cf8e640 1 -- 172.21.15.150:0/1687239480 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7efc380705b0 msgr2=0x7efc381f34b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:45:32.966 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:32.964+0000 7efc3cf8e640 1 --2- 172.21.15.150:0/1687239480 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7efc380705b0 0x7efc381f34b0 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7efc2800c430 tx=0x7efc2800c8f0 comp rx=0 tx=0).stop 2024-09-17T05:45:32.966 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:32.964+0000 7efc3cf8e640 1 -- 172.21.15.150:0/1687239480 shutdown_connections 2024-09-17T05:45:32.966 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:32.964+0000 7efc3cf8e640 1 --2- 172.21.15.150:0/1687239480 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7efc381528b0 0x7efc38154810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:32.966 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:32.964+0000 7efc3cf8e640 1 --2- 172.21.15.150:0/1687239480 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7efc18079490 0x7efc1807b9a0 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:32.966 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:32.964+0000 7efc3cf8e640 1 --2- 172.21.15.150:0/1687239480 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7efc380cd040 0x7efc38158e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:32.966 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:32.964+0000 7efc3cf8e640 1 --2- 172.21.15.150:0/1687239480 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7efc380705b0 0x7efc381f34b0 unknown :-1 s=CLOSED pgs=620 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:32.966 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:32.964+0000 7efc3cf8e640 1 -- 172.21.15.150:0/1687239480 >> 172.21.15.150:0/1687239480 conn(0x7efc380d0b50 msgr2=0x7efc380b3ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:45:32.966 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:32.964+0000 7efc3cf8e640 1 -- 172.21.15.150:0/1687239480 shutdown_connections 2024-09-17T05:45:32.966 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:32.964+0000 7efc3cf8e640 1 -- 172.21.15.150:0/1687239480 wait complete. 2024-09-17T05:45:32.978 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T05:45:33.091 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:33.089+0000 7f1b667ba640 1 -- 172.21.15.150:0/3916187463 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1b6009ba60 msgr2=0x7f1b600b7330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:45:33.092 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:33.089+0000 7f1b667ba640 1 --2- 172.21.15.150:0/3916187463 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1b6009ba60 0x7f1b600b7330 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7f1b50009820 tx=0x7f1b5002a5a0 comp rx=0 tx=0).stop 2024-09-17T05:45:33.092 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:33.090+0000 7f1b667ba640 1 -- 172.21.15.150:0/3916187463 shutdown_connections 2024-09-17T05:45:33.092 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:33.090+0000 7f1b667ba640 1 --2- 172.21.15.150:0/3916187463 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1b6009ba60 0x7f1b600b7330 unknown :-1 s=CLOSED pgs=622 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:33.092 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:33.090+0000 7f1b667ba640 1 -- 172.21.15.150:0/3916187463 >> 172.21.15.150:0/3916187463 conn(0x7f1b600cee90 msgr2=0x7f1b600cf2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:45:33.092 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:33.090+0000 7f1b667ba640 1 -- 172.21.15.150:0/3916187463 shutdown_connections 2024-09-17T05:45:33.092 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:33.090+0000 7f1b667ba640 1 -- 172.21.15.150:0/3916187463 wait complete. 2024-09-17T05:45:33.093 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:33.091+0000 7f1b667ba640 1 Processor -- start 2024-09-17T05:45:33.093 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:33.092+0000 7f1b667ba640 1 -- start start 2024-09-17T05:45:33.096 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:33.093+0000 7f1b667ba640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1b6009ba60 0x7f1b6006eba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:45:33.096 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:33.093+0000 7f1b667ba640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1b600cd440 0x7f1b6015dd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:45:33.096 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:33.093+0000 7f1b667ba640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1b600cd850 0x7f1b6015e2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:45:33.097 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:33.093+0000 7f1b667ba640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f1b601680f0 con 0x7f1b600cd440 2024-09-17T05:45:33.097 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:33.093+0000 7f1b667ba640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f1b60168270 con 0x7f1b6009ba60 2024-09-17T05:45:33.097 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:33.093+0000 7f1b667ba640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f1b601683f0 con 0x7f1b600cd850 2024-09-17T05:45:33.097 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:33.093+0000 7f1b5f7fe640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1b600cd440 0x7f1b6015dd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:45:33.097 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:33.093+0000 7f1b5f7fe640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1b600cd440 0x7f1b6015dd60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:39178/0 (socket says 172.21.15.150:39178) 2024-09-17T05:45:33.097 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:33.093+0000 7f1b5f7fe640 1 -- 172.21.15.150:0/3627101821 learned_addr learned my addr 172.21.15.150:0/3627101821 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:45:33.097 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:33.093+0000 7f1b5ffff640 1 --2- 172.21.15.150:0/3627101821 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1b6009ba60 0x7f1b6006eba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:45:33.097 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:33.093+0000 7f1b64d57640 1 --2- 172.21.15.150:0/3627101821 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1b600cd850 0x7f1b6015e2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:45:33.098 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:33.093+0000 7f1b5f7fe640 1 -- 172.21.15.150:0/3627101821 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1b600cd850 msgr2=0x7f1b6015e2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:45:33.098 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:33.093+0000 7f1b5f7fe640 1 --2- 172.21.15.150:0/3627101821 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1b600cd850 0x7f1b6015e2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:33.098 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:33.093+0000 7f1b5f7fe640 1 -- 172.21.15.150:0/3627101821 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1b6009ba60 msgr2=0x7f1b6006eba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:45:33.098 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:33.093+0000 7f1b5f7fe640 1 --2- 172.21.15.150:0/3627101821 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1b6009ba60 0x7f1b6006eba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:33.098 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:33.093+0000 7f1b5f7fe640 1 -- 172.21.15.150:0/3627101821 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1b60160a10 con 0x7f1b600cd440 2024-09-17T05:45:33.098 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:33.093+0000 7f1b5f7fe640 1 --2- 172.21.15.150:0/3627101821 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1b600cd440 0x7f1b6015dd60 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7f1b5400c3a0 tx=0x7f1b5400c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:45:33.098 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:33.094+0000 7f1b5cff9640 1 -- 172.21.15.150:0/3627101821 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b54017070 con 0x7f1b600cd440 2024-09-17T05:45:33.099 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:33.094+0000 7f1b5cff9640 1 -- 172.21.15.150:0/3627101821 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f1b540053c0 con 0x7f1b600cd440 2024-09-17T05:45:33.099 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:33.094+0000 7f1b667ba640 1 -- 172.21.15.150:0/3627101821 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1b601f6a30 con 0x7f1b600cd440 2024-09-17T05:45:33.099 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:33.094+0000 7f1b5cff9640 1 -- 172.21.15.150:0/3627101821 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b54003850 con 0x7f1b600cd440 2024-09-17T05:45:33.099 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:33.094+0000 7f1b667ba640 1 -- 172.21.15.150:0/3627101821 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1b601f6ff0 con 0x7f1b600cd440 2024-09-17T05:45:33.099 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:33.095+0000 7f1b667ba640 1 -- 172.21.15.150:0/3627101821 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1b601f9d40 con 0x7f1b600cd440 2024-09-17T05:45:33.100 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:33.095+0000 7f1b5cff9640 1 -- 172.21.15.150:0/3627101821 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 15) ==== 102257+0+0 (secure 0 0 0) 0x7f1b5401a070 con 0x7f1b600cd440 2024-09-17T05:45:33.100 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:33.096+0000 7f1b5cff9640 1 --2- 172.21.15.150:0/3627101821 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f1b4c079490 0x7f1b4c07b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:45:33.100 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:33.096+0000 7f1b5cff9640 1 -- 172.21.15.150:0/3627101821 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(59..59 src has 1..59) ==== 5737+0+0 (secure 0 0 0) 0x7f1b54098810 con 0x7f1b600cd440 2024-09-17T05:45:33.100 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:33.096+0000 7f1b5ffff640 1 --2- 172.21.15.150:0/3627101821 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f1b4c079490 0x7f1b4c07b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:45:33.100 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:33.097+0000 7f1b5ffff640 1 --2- 172.21.15.150:0/3627101821 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f1b4c079490 0x7f1b4c07b9a0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f1b50034000 tx=0x7f1b50004730 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:45:33.102 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:33.101+0000 7f1b5cff9640 1 -- 172.21.15.150:0/3627101821 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f1b601f9d40 con 0x7f1b600cd440 2024-09-17T05:45:33.279 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:33.277+0000 7f1b667ba640 1 -- 172.21.15.150:0/3627101821 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f1b600b7330 con 0x7f1b600cd440 2024-09-17T05:45:33.280 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:33.279+0000 7f1b5cff9640 1 -- 172.21.15.150:0/3627101821 <== mon.0 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v59) ==== 74+0+16817 (secure 0 0 0) 0x7f1b540620c0 con 0x7f1b600cd440 2024-09-17T05:45:33.281 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-09-17T05:45:33.281 INFO:teuthology.orchestra.run.smithi150.stdout:{"epoch":59,"fsid":"9f2e05e9-d629-47b3-b26b-1360655b7d20","created":"2024-09-17T05:41:32.502979+0000","modified":"2024-09-17T05:45:31.989061+0000","last_up_change":"2024-09-17T05:41:46.150225+0000","last_in_change":"2024-09-17T05:41:36.120274+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T05:41:46.860779+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2024-09-17T05:45:29.646151+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"59","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_data","create_time":"2024-09-17T05:45:30.948666+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"59","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"4f31c018-c8a4-4d6d-b0c2-a597c47aae4a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6800","nonce":479374392},{"type":"v1","addr":"172.21.15.150:6801","nonce":479374392}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6802","nonce":479374392},{"type":"v1","addr":"172.21.15.150:6803","nonce":479374392}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6806","nonce":479374392},{"type":"v1","addr":"172.21.15.150:6807","nonce":479374392}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6804","nonce":479374392},{"type":"v1","addr":"172.21.15.150:6805","nonce":479374392}]},"public_addr":"172.21.15.150:6801/479374392","cluster_addr":"172.21.15.150:6803/479374392","heartbeat_back_addr":"172.21.15.150:6807/479374392","heartbeat_front_addr":"172.21.15.150:6805/479374392","state":["exists","up"]},{"osd":1,"uuid":"6ff4a573-500b-4e04-9de3-39265ead78b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6824","nonce":913899800},{"type":"v1","addr":"172.21.15.150:6825","nonce":913899800}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6826","nonce":913899800},{"type":"v1","addr":"172.21.15.150:6827","nonce":913899800}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6830","nonce":913899800},{"type":"v1","addr":"172.21.15.150:6831","nonce":913899800}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6828","nonce":913899800},{"type":"v1","addr":"172.21.15.150:6829","nonce":913899800}]},"public_addr":"172.21.15.150:6825/913899800","cluster_addr":"172.21.15.150:6827/913899800","heartbeat_back_addr":"172.21.15.150:6831/913899800","heartbeat_front_addr":"172.21.15.150:6829/913899800","state":["exists","up"]},{"osd":2,"uuid":"bffea6f9-2465-4182-b205-00436c41ac1c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6816","nonce":363718461},{"type":"v1","addr":"172.21.15.150:6817","nonce":363718461}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6818","nonce":363718461},{"type":"v1","addr":"172.21.15.150:6819","nonce":363718461}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6822","nonce":363718461},{"type":"v1","addr":"172.21.15.150:6823","nonce":363718461}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6820","nonce":363718461},{"type":"v1","addr":"172.21.15.150:6821","nonce":363718461}]},"public_addr":"172.21.15.150:6817/363718461","cluster_addr":"172.21.15.150:6819/363718461","heartbeat_back_addr":"172.21.15.150:6823/363718461","heartbeat_front_addr":"172.21.15.150:6821/363718461","state":["exists","up"]},{"osd":3,"uuid":"cda70430-d1e1-427e-b04e-56db4031d078","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6808","nonce":3550994626},{"type":"v1","addr":"172.21.15.150:6809","nonce":3550994626}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6810","nonce":3550994626},{"type":"v1","addr":"172.21.15.150:6811","nonce":3550994626}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6814","nonce":3550994626},{"type":"v1","addr":"172.21.15.150:6815","nonce":3550994626}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6812","nonce":3550994626},{"type":"v1","addr":"172.21.15.150:6813","nonce":3550994626}]},"public_addr":"172.21.15.150:6809/3550994626","cluster_addr":"172.21.15.150:6811/3550994626","heartbeat_back_addr":"172.21.15.150:6815/3550994626","heartbeat_front_addr":"172.21.15.150:6813/3550994626","state":["exists","up"]},{"osd":4,"uuid":"3a0277fb-5e1e-4f68-bb2d-9a8a0152f64a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6810","nonce":2718261497},{"type":"v1","addr":"172.21.15.176:6811","nonce":2718261497}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6812","nonce":2718261497},{"type":"v1","addr":"172.21.15.176:6813","nonce":2718261497}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6816","nonce":2718261497},{"type":"v1","addr":"172.21.15.176:6817","nonce":2718261497}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6814","nonce":2718261497},{"type":"v1","addr":"172.21.15.176:6815","nonce":2718261497}]},"public_addr":"172.21.15.176:6811/2718261497","cluster_addr":"172.21.15.176:6813/2718261497","heartbeat_back_addr":"172.21.15.176:6817/2718261497","heartbeat_front_addr":"172.21.15.176:6815/2718261497","state":["exists","up"]},{"osd":5,"uuid":"33aebee6-0315-40b7-a11c-6702f0be494d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6818","nonce":2049295774},{"type":"v1","addr":"172.21.15.176:6819","nonce":2049295774}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6820","nonce":2049295774},{"type":"v1","addr":"172.21.15.176:6821","nonce":2049295774}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6824","nonce":2049295774},{"type":"v1","addr":"172.21.15.176:6825","nonce":2049295774}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6822","nonce":2049295774},{"type":"v1","addr":"172.21.15.176:6823","nonce":2049295774}]},"public_addr":"172.21.15.176:6819/2049295774","cluster_addr":"172.21.15.176:6821/2049295774","heartbeat_back_addr":"172.21.15.176:6825/2049295774","heartbeat_front_addr":"172.21.15.176:6823/2049295774","state":["exists","up"]},{"osd":6,"uuid":"4d24f360-6751-4263-841b-d77793d33540","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6826","nonce":2164458476},{"type":"v1","addr":"172.21.15.176:6827","nonce":2164458476}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6828","nonce":2164458476},{"type":"v1","addr":"172.21.15.176:6829","nonce":2164458476}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6832","nonce":2164458476},{"type":"v1","addr":"172.21.15.176:6833","nonce":2164458476}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6830","nonce":2164458476},{"type":"v1","addr":"172.21.15.176:6831","nonce":2164458476}]},"public_addr":"172.21.15.176:6827/2164458476","cluster_addr":"172.21.15.176:6829/2164458476","heartbeat_back_addr":"172.21.15.176:6833/2164458476","heartbeat_front_addr":"172.21.15.176:6831/2164458476","state":["exists","up"]},{"osd":7,"uuid":"c8594fda-c74a-4ba9-8277-caf101d58ca1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6802","nonce":3239587708},{"type":"v1","addr":"172.21.15.176:6803","nonce":3239587708}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6804","nonce":3239587708},{"type":"v1","addr":"172.21.15.176:6805","nonce":3239587708}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6808","nonce":3239587708},{"type":"v1","addr":"172.21.15.176:6809","nonce":3239587708}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6806","nonce":3239587708},{"type":"v1","addr":"172.21.15.176:6807","nonce":3239587708}]},"public_addr":"172.21.15.176:6803/3239587708","cluster_addr":"172.21.15.176:6805/3239587708","heartbeat_back_addr":"172.21.15.176:6809/3239587708","heartbeat_front_addr":"172.21.15.176:6807/3239587708","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:41:41.905151+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:41:42.705679+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:41:42.459673+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:41:42.440819+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:41:42.668428+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:41:42.694972+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:41:43.078535+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:41:42.363539+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":7,"snaps":[{"begin":2,"length":2}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T05:45:33.283 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:33.281+0000 7f1b667ba640 1 -- 172.21.15.150:0/3627101821 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f1b4c079490 msgr2=0x7f1b4c07b9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:45:33.283 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:33.281+0000 7f1b667ba640 1 --2- 172.21.15.150:0/3627101821 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f1b4c079490 0x7f1b4c07b9a0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f1b50034000 tx=0x7f1b50004730 comp rx=0 tx=0).stop 2024-09-17T05:45:33.283 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:33.281+0000 7f1b667ba640 1 -- 172.21.15.150:0/3627101821 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1b600cd440 msgr2=0x7f1b6015dd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:45:33.283 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:33.281+0000 7f1b667ba640 1 --2- 172.21.15.150:0/3627101821 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1b600cd440 0x7f1b6015dd60 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7f1b5400c3a0 tx=0x7f1b5400c860 comp rx=0 tx=0).stop 2024-09-17T05:45:33.283 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:33.281+0000 7f1b667ba640 1 -- 172.21.15.150:0/3627101821 shutdown_connections 2024-09-17T05:45:33.283 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:33.281+0000 7f1b667ba640 1 --2- 172.21.15.150:0/3627101821 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f1b4c079490 0x7f1b4c07b9a0 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:33.283 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:33.281+0000 7f1b667ba640 1 --2- 172.21.15.150:0/3627101821 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1b600cd850 0x7f1b6015e2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:33.284 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:33.281+0000 7f1b667ba640 1 --2- 172.21.15.150:0/3627101821 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1b600cd440 0x7f1b6015dd60 unknown :-1 s=CLOSED pgs=623 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:33.284 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:33.281+0000 7f1b667ba640 1 --2- 172.21.15.150:0/3627101821 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1b6009ba60 0x7f1b6006eba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:33.284 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:33.281+0000 7f1b667ba640 1 -- 172.21.15.150:0/3627101821 >> 172.21.15.150:0/3627101821 conn(0x7f1b600cee90 msgr2=0x7f1b6015f890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:45:33.284 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:33.281+0000 7f1b667ba640 1 -- 172.21.15.150:0/3627101821 shutdown_connections 2024-09-17T05:45:33.284 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:33.281+0000 7f1b667ba640 1 -- 172.21.15.150:0/3627101821 wait complete. 2024-09-17T05:45:33.295 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-09-17T05:45:33.412 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:33.410+0000 7f92e492b640 1 -- 172.21.15.150:0/172156574 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f92e00cf390 msgr2=0x7f92e00cf7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:45:33.412 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:33.410+0000 7f92e492b640 1 --2- 172.21.15.150:0/172156574 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f92e00cf390 0x7f92e00cf7a0 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7f92e0073060 tx=0x7f92d802a790 comp rx=0 tx=0).stop 2024-09-17T05:45:33.412 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:33.410+0000 7f92e492b640 1 -- 172.21.15.150:0/172156574 shutdown_connections 2024-09-17T05:45:33.412 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:33.410+0000 7f92e492b640 1 --2- 172.21.15.150:0/172156574 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f92e00cf390 0x7f92e00cf7a0 unknown :-1 s=CLOSED pgs=625 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:33.412 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:33.410+0000 7f92e492b640 1 --2- 172.21.15.150:0/172156574 >> v2:172.21.15.176:3300/0 conn(0x7f92e00b25e0 0x7f92e00b1ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:33.412 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:33.410+0000 7f92e492b640 1 -- 172.21.15.150:0/172156574 >> 172.21.15.150:0/172156574 conn(0x7f92e00b2ff0 msgr2=0x7f92e00b3400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:45:33.412 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:33.410+0000 7f92e492b640 1 -- 172.21.15.150:0/172156574 shutdown_connections 2024-09-17T05:45:33.412 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:33.410+0000 7f92e492b640 1 -- 172.21.15.150:0/172156574 wait complete. 2024-09-17T05:45:33.413 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:33.412+0000 7f92e492b640 1 Processor -- start 2024-09-17T05:45:33.413 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:33.412+0000 7f92e492b640 1 -- start start 2024-09-17T05:45:33.417 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:33.413+0000 7f92e492b640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f92e00b0fe0 0x7f92e0154af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:45:33.417 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:33.413+0000 7f92e492b640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f92e00b25e0 0x7f92e01f6af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:45:33.417 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:33.413+0000 7f92e492b640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f92e00cf390 0x7f92e00ca470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:45:33.417 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:33.413+0000 7f92e492b640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f92e006d130 con 0x7f92e00cf390 2024-09-17T05:45:33.417 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:33.413+0000 7f92e492b640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f92e006cfb0 con 0x7f92e00b25e0 2024-09-17T05:45:33.417 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:33.413+0000 7f92e492b640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f92e006d2b0 con 0x7f92e00b0fe0 2024-09-17T05:45:33.417 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:33.413+0000 7f92ded9d640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f92e00cf390 0x7f92e00ca470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:45:33.417 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:33.413+0000 7f92ded9d640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f92e00cf390 0x7f92e00ca470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:39208/0 (socket says 172.21.15.150:39208) 2024-09-17T05:45:33.418 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:33.413+0000 7f92ded9d640 1 -- 172.21.15.150:0/1435565964 learned_addr learned my addr 172.21.15.150:0/1435565964 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:45:33.418 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:33.414+0000 7f92de59c640 1 --2- 172.21.15.150:0/1435565964 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f92e00b0fe0 0x7f92e0154af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:45:33.418 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:33.414+0000 7f92ddd9b640 1 --2- 172.21.15.150:0/1435565964 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f92e00b25e0 0x7f92e01f6af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:45:33.418 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:33.414+0000 7f92ded9d640 1 -- 172.21.15.150:0/1435565964 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f92e00b0fe0 msgr2=0x7f92e0154af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:45:33.418 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:33.414+0000 7f92ded9d640 1 --2- 172.21.15.150:0/1435565964 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f92e00b0fe0 0x7f92e0154af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:33.418 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:33.414+0000 7f92ded9d640 1 -- 172.21.15.150:0/1435565964 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f92e00b25e0 msgr2=0x7f92e01f6af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:45:33.418 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:33.414+0000 7f92ded9d640 1 --2- 172.21.15.150:0/1435565964 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f92e00b25e0 0x7f92e01f6af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:33.418 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:33.414+0000 7f92ded9d640 1 -- 172.21.15.150:0/1435565964 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f92e0153510 con 0x7f92e00cf390 2024-09-17T05:45:33.418 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:33.414+0000 7f92ddd9b640 1 --2- 172.21.15.150:0/1435565964 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f92e00b25e0 0x7f92e01f6af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:45:33.418 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:33.414+0000 7f92ded9d640 1 --2- 172.21.15.150:0/1435565964 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f92e00cf390 0x7f92e00ca470 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7f92d8009ca0 tx=0x7f92d8032de0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:45:33.418 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:33.414+0000 7f92ceffd640 1 -- 172.21.15.150:0/1435565964 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f92d8041020 con 0x7f92e00cf390 2024-09-17T05:45:33.418 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:33.414+0000 7f92ceffd640 1 -- 172.21.15.150:0/1435565964 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f92d8004040 con 0x7f92e00cf390 2024-09-17T05:45:33.418 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:33.414+0000 7f92e492b640 1 -- 172.21.15.150:0/1435565964 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f92e01537f0 con 0x7f92e00cf390 2024-09-17T05:45:33.419 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:33.414+0000 7f92ceffd640 1 -- 172.21.15.150:0/1435565964 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f92d8036040 con 0x7f92e00cf390 2024-09-17T05:45:33.419 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:33.414+0000 7f92e492b640 1 -- 172.21.15.150:0/1435565964 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f92e0153db0 con 0x7f92e00cf390 2024-09-17T05:45:33.419 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:33.415+0000 7f92e492b640 1 -- 172.21.15.150:0/1435565964 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f92e00b1ec0 con 0x7f92e00cf390 2024-09-17T05:45:33.419 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:33.416+0000 7f92ceffd640 1 -- 172.21.15.150:0/1435565964 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 15) ==== 102257+0+0 (secure 0 0 0) 0x7f92d8044020 con 0x7f92e00cf390 2024-09-17T05:45:33.420 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:33.417+0000 7f92ceffd640 1 --2- 172.21.15.150:0/1435565964 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f92c0079490 0x7f92c007b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:45:33.420 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:33.417+0000 7f92ceffd640 1 -- 172.21.15.150:0/1435565964 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(59..59 src has 1..59) ==== 5737+0+0 (secure 0 0 0) 0x7f92d80ba5e0 con 0x7f92e00cf390 2024-09-17T05:45:33.420 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:33.417+0000 7f92de59c640 1 --2- 172.21.15.150:0/1435565964 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f92c0079490 0x7f92c007b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:45:33.420 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:33.417+0000 7f92de59c640 1 --2- 172.21.15.150:0/1435565964 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f92c0079490 0x7f92c007b9a0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f92d0009b30 tx=0x7f92d0005f90 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:45:33.423 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:33.421+0000 7f92ceffd640 1 -- 172.21.15.150:0/1435565964 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f92d804b030 con 0x7f92e00cf390 2024-09-17T05:45:33.633 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:33.632+0000 7f92e492b640 1 -- 172.21.15.150:0/1435565964 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7f92e00b5d60 con 0x7f92e00cf390 2024-09-17T05:45:34.644 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:34.642+0000 7f92ceffd640 1 -- 172.21.15.150:0/1435565964 <== mon.0 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v32) ==== 118+0+0 (secure 0 0 0) 0x7f92d80844d0 con 0x7f92e00cf390 2024-09-17T05:45:34.647 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:34.645+0000 7f92e492b640 1 -- 172.21.15.150:0/1435565964 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f92c0079490 msgr2=0x7f92c007b9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:45:34.647 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:34.645+0000 7f92e492b640 1 --2- 172.21.15.150:0/1435565964 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f92c0079490 0x7f92c007b9a0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f92d0009b30 tx=0x7f92d0005f90 comp rx=0 tx=0).stop 2024-09-17T05:45:34.648 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:34.645+0000 7f92e492b640 1 -- 172.21.15.150:0/1435565964 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f92e00cf390 msgr2=0x7f92e00ca470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:45:34.648 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:34.645+0000 7f92e492b640 1 --2- 172.21.15.150:0/1435565964 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f92e00cf390 0x7f92e00ca470 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7f92d8009ca0 tx=0x7f92d8032de0 comp rx=0 tx=0).stop 2024-09-17T05:45:34.648 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:34.645+0000 7f92e492b640 1 -- 172.21.15.150:0/1435565964 shutdown_connections 2024-09-17T05:45:34.648 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:34.645+0000 7f92e492b640 1 --2- 172.21.15.150:0/1435565964 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f92e00b25e0 0x7f92e01f6af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:34.648 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:34.645+0000 7f92e492b640 1 --2- 172.21.15.150:0/1435565964 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f92c0079490 0x7f92c007b9a0 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:34.648 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:34.645+0000 7f92e492b640 1 --2- 172.21.15.150:0/1435565964 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f92e00cf390 0x7f92e00ca470 unknown :-1 s=CLOSED pgs=626 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:34.648 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:34.645+0000 7f92e492b640 1 --2- 172.21.15.150:0/1435565964 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f92e00b0fe0 0x7f92e0154af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:34.648 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:34.645+0000 7f92e492b640 1 -- 172.21.15.150:0/1435565964 >> 172.21.15.150:0/1435565964 conn(0x7f92e00b2ff0 msgr2=0x7f92e015ec90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:45:34.648 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:34.645+0000 7f92e492b640 1 -- 172.21.15.150:0/1435565964 shutdown_connections 2024-09-17T05:45:34.648 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:34.645+0000 7f92e492b640 1 -- 172.21.15.150:0/1435565964 wait complete. 2024-09-17T05:45:34.660 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-09-17T05:45:34.660 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-09-17T05:45:34.789 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:34.780+0000 7f99b02be640 1 -- 172.21.15.150:0/2120117466 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f99a80d0fc0 msgr2=0x7f99a80cd0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:45:34.789 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:34.780+0000 7f99b02be640 1 --2- 172.21.15.150:0/2120117466 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f99a80d0fc0 0x7f99a80cd0e0 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7f99a80cfd70 tx=0x7f99a002a8f0 comp rx=0 tx=0).stop 2024-09-17T05:45:34.789 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:34.780+0000 7f99b02be640 1 -- 172.21.15.150:0/2120117466 shutdown_connections 2024-09-17T05:45:34.789 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:34.780+0000 7f99b02be640 1 --2- 172.21.15.150:0/2120117466 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f99a80d0fc0 0x7f99a80cd0e0 unknown :-1 s=CLOSED pgs=627 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:34.789 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:34.780+0000 7f99b02be640 1 --2- 172.21.15.150:0/2120117466 >> v2:172.21.15.176:3300/0 conn(0x7f99a80b7d70 0x7f99a80d0a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:34.789 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:34.780+0000 7f99b02be640 1 -- 172.21.15.150:0/2120117466 >> 172.21.15.150:0/2120117466 conn(0x7f99a80cef20 msgr2=0x7f99a80cf330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:45:34.790 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:34.780+0000 7f99b02be640 1 -- 172.21.15.150:0/2120117466 shutdown_connections 2024-09-17T05:45:34.790 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:34.780+0000 7f99b02be640 1 -- 172.21.15.150:0/2120117466 wait complete. 2024-09-17T05:45:34.790 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:34.781+0000 7f99b02be640 1 Processor -- start 2024-09-17T05:45:34.790 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:34.782+0000 7f99b02be640 1 -- start start 2024-09-17T05:45:34.790 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:34.783+0000 7f99b02be640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f99a80b7960 0x7f99a81410e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:45:34.790 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:34.783+0000 7f99b02be640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f99a80b7d70 0x7f99a815ff30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:45:34.790 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:34.783+0000 7f99b02be640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f99a80d0fc0 0x7f99a815ab50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:45:34.790 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:34.783+0000 7f99b02be640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f99a80af900 con 0x7f99a80b7d70 2024-09-17T05:45:34.790 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:34.783+0000 7f99b02be640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f99a80d14e0 con 0x7f99a80b7960 2024-09-17T05:45:34.790 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:34.783+0000 7f99b02be640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f99a8141620 con 0x7f99a80d0fc0 2024-09-17T05:45:34.790 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:34.783+0000 7f99ad859640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f99a80b7d70 0x7f99a815ff30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:45:34.790 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:34.783+0000 7f99ad859640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f99a80b7d70 0x7f99a815ff30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:39234/0 (socket says 172.21.15.150:39234) 2024-09-17T05:45:34.790 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:34.783+0000 7f99ad859640 1 -- 172.21.15.150:0/1549262227 learned_addr learned my addr 172.21.15.150:0/1549262227 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:45:34.791 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:34.783+0000 7f99ae85b640 1 --2- 172.21.15.150:0/1549262227 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f99a80d0fc0 0x7f99a815ab50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:45:34.791 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:34.783+0000 7f99ae05a640 1 --2- 172.21.15.150:0/1549262227 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f99a80b7960 0x7f99a81410e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:45:34.791 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:34.783+0000 7f99ad859640 1 -- 172.21.15.150:0/1549262227 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f99a80d0fc0 msgr2=0x7f99a815ab50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:45:34.791 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:34.783+0000 7f99ad859640 1 --2- 172.21.15.150:0/1549262227 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f99a80d0fc0 0x7f99a815ab50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:34.791 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:34.783+0000 7f99ad859640 1 -- 172.21.15.150:0/1549262227 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f99a80b7960 msgr2=0x7f99a81410e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:45:34.791 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:34.783+0000 7f99ad859640 1 --2- 172.21.15.150:0/1549262227 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f99a80b7960 0x7f99a81410e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:34.791 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:34.783+0000 7f99ad859640 1 -- 172.21.15.150:0/1549262227 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f99a8160470 con 0x7f99a80b7d70 2024-09-17T05:45:34.791 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:34.783+0000 7f99ae05a640 1 --2- 172.21.15.150:0/1549262227 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f99a80b7960 0x7f99a81410e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:45:34.791 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:34.783+0000 7f99ae85b640 1 --2- 172.21.15.150:0/1549262227 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f99a80d0fc0 0x7f99a815ab50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:45:34.791 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:34.783+0000 7f99ad859640 1 --2- 172.21.15.150:0/1549262227 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f99a80b7d70 0x7f99a815ff30 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7f999800d720 tx=0x7f999800dbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:45:34.791 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:34.784+0000 7f999effd640 1 -- 172.21.15.150:0/1549262227 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9998017070 con 0x7f99a80b7d70 2024-09-17T05:45:34.791 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:34.784+0000 7f999effd640 1 -- 172.21.15.150:0/1549262227 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9998009b10 con 0x7f99a80b7d70 2024-09-17T05:45:34.791 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:34.784+0000 7f99b02be640 1 -- 172.21.15.150:0/1549262227 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f99a81542a0 con 0x7f99a80b7d70 2024-09-17T05:45:34.792 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:34.784+0000 7f999effd640 1 -- 172.21.15.150:0/1549262227 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9998010460 con 0x7f99a80b7d70 2024-09-17T05:45:34.792 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:34.784+0000 7f99b02be640 1 -- 172.21.15.150:0/1549262227 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f99a8155f40 con 0x7f99a80b7d70 2024-09-17T05:45:34.792 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:34.785+0000 7f99b02be640 1 -- 172.21.15.150:0/1549262227 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f99a8155a70 con 0x7f99a80b7d70 2024-09-17T05:45:34.792 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:34.785+0000 7f999effd640 1 -- 172.21.15.150:0/1549262227 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 15) ==== 102257+0+0 (secure 0 0 0) 0x7f999801a070 con 0x7f99a80b7d70 2024-09-17T05:45:34.792 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:34.786+0000 7f999effd640 1 --2- 172.21.15.150:0/1549262227 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f998c079490 0x7f998c07b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:45:34.792 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:34.786+0000 7f999effd640 1 -- 172.21.15.150:0/1549262227 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(60..60 src has 1..60) ==== 5737+0+0 (secure 0 0 0) 0x7f9998099730 con 0x7f99a80b7d70 2024-09-17T05:45:34.792 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:34.786+0000 7f99ae05a640 1 --2- 172.21.15.150:0/1549262227 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f998c079490 0x7f998c07b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:45:34.792 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:34.787+0000 7f99ae05a640 1 --2- 172.21.15.150:0/1549262227 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f998c079490 0x7f998c07b9a0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f99a80d2470 tx=0x7f99a4008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:45:34.792 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:34.791+0000 7f999effd640 1 -- 172.21.15.150:0/1549262227 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f99980636b0 con 0x7f99a80b7d70 2024-09-17T05:45:35.004 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:35.002+0000 7f99b02be640 1 -- 172.21.15.150:0/1549262227 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7f99a80d0a80 con 0x7f99a80b7d70 2024-09-17T05:45:35.650 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:35.648+0000 7f999effd640 1 -- 172.21.15.150:0/1549262227 <== mon.0 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v33) ==== 122+0+0 (secure 0 0 0) 0x7f9998062fb0 con 0x7f99a80b7d70 2024-09-17T05:45:35.653 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:35.651+0000 7f99b02be640 1 -- 172.21.15.150:0/1549262227 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f998c079490 msgr2=0x7f998c07b9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:45:35.653 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:35.651+0000 7f99b02be640 1 --2- 172.21.15.150:0/1549262227 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f998c079490 0x7f998c07b9a0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f99a80d2470 tx=0x7f99a4008040 comp rx=0 tx=0).stop 2024-09-17T05:45:35.653 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:35.651+0000 7f99b02be640 1 -- 172.21.15.150:0/1549262227 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f99a80b7d70 msgr2=0x7f99a815ff30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:45:35.653 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:35.651+0000 7f99b02be640 1 --2- 172.21.15.150:0/1549262227 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f99a80b7d70 0x7f99a815ff30 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7f999800d720 tx=0x7f999800dbe0 comp rx=0 tx=0).stop 2024-09-17T05:45:35.653 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:35.651+0000 7f99b02be640 1 -- 172.21.15.150:0/1549262227 shutdown_connections 2024-09-17T05:45:35.653 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:35.651+0000 7f99b02be640 1 --2- 172.21.15.150:0/1549262227 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f998c079490 0x7f998c07b9a0 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:35.654 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:35.651+0000 7f99b02be640 1 --2- 172.21.15.150:0/1549262227 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f99a80d0fc0 0x7f99a815ab50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:35.654 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:35.651+0000 7f99b02be640 1 --2- 172.21.15.150:0/1549262227 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f99a80b7d70 0x7f99a815ff30 unknown :-1 s=CLOSED pgs=628 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:35.654 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:35.651+0000 7f99b02be640 1 --2- 172.21.15.150:0/1549262227 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f99a80b7960 0x7f99a81410e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:35.654 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:35.651+0000 7f99b02be640 1 -- 172.21.15.150:0/1549262227 >> 172.21.15.150:0/1549262227 conn(0x7f99a80cef20 msgr2=0x7f99a81538d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:45:35.654 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:35.651+0000 7f99b02be640 1 -- 172.21.15.150:0/1549262227 shutdown_connections 2024-09-17T05:45:35.654 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:35.651+0000 7f99b02be640 1 -- 172.21.15.150:0/1549262227 wait complete. 2024-09-17T05:45:35.667 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-09-17T05:45:35.667 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T05:45:35.786 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:35.784+0000 7fb76f5f1640 1 -- 172.21.15.150:0/275575582 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb76815fae0 msgr2=0x7fb7680b3750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:45:35.786 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:35.784+0000 7fb76f5f1640 1 --2- 172.21.15.150:0/275575582 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb76815fae0 0x7fb7680b3750 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7fb760005fd0 tx=0x7fb76002aa10 comp rx=0 tx=0).stop 2024-09-17T05:45:35.786 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:35.784+0000 7fb76f5f1640 1 -- 172.21.15.150:0/275575582 shutdown_connections 2024-09-17T05:45:35.786 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:35.784+0000 7fb76f5f1640 1 --2- 172.21.15.150:0/275575582 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb76815fae0 0x7fb7680b3750 unknown :-1 s=CLOSED pgs=629 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:35.786 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:35.784+0000 7fb76f5f1640 1 --2- 172.21.15.150:0/275575582 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb7680aebc0 0x7fb768152920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:35.786 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:35.784+0000 7fb76f5f1640 1 -- 172.21.15.150:0/275575582 >> 172.21.15.150:0/275575582 conn(0x7fb76806d730 msgr2=0x7fb7680b1e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:45:35.786 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:35.784+0000 7fb76f5f1640 1 -- 172.21.15.150:0/275575582 shutdown_connections 2024-09-17T05:45:35.786 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:35.784+0000 7fb76f5f1640 1 -- 172.21.15.150:0/275575582 wait complete. 2024-09-17T05:45:35.787 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:35.786+0000 7fb76f5f1640 1 Processor -- start 2024-09-17T05:45:35.787 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:35.786+0000 7fb76f5f1640 1 -- start start 2024-09-17T05:45:35.790 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:35.787+0000 7fb76f5f1640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb7680aebc0 0x7fb7681f9320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:45:35.790 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:35.787+0000 7fb76f5f1640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb7680b2750 0x7fb76814ec00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:45:35.790 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:35.787+0000 7fb76f5f1640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb7680b15b0 0x7fb7680b19c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:45:35.791 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:35.787+0000 7fb76f5f1640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7fb7680b4210 con 0x7fb7680aebc0 2024-09-17T05:45:35.791 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:35.787+0000 7fb76f5f1640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fb7680b4090 con 0x7fb7680b2750 2024-09-17T05:45:35.791 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:35.787+0000 7fb76f5f1640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fb7680b4390 con 0x7fb7680b15b0 2024-09-17T05:45:35.791 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:35.787+0000 7fb76d38d640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb7680aebc0 0x7fb7681f9320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:45:35.791 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:35.787+0000 7fb76d38d640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb7680aebc0 0x7fb7681f9320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:39258/0 (socket says 172.21.15.150:39258) 2024-09-17T05:45:35.791 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:35.787+0000 7fb76d38d640 1 -- 172.21.15.150:0/3967946967 learned_addr learned my addr 172.21.15.150:0/3967946967 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:45:35.791 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:35.787+0000 7fb76db8e640 1 --2- 172.21.15.150:0/3967946967 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb7680b15b0 0x7fb7680b19c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:45:35.791 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:35.787+0000 7fb76cb8c640 1 --2- 172.21.15.150:0/3967946967 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb7680b2750 0x7fb76814ec00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:45:35.791 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:35.787+0000 7fb76d38d640 1 -- 172.21.15.150:0/3967946967 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb7680b15b0 msgr2=0x7fb7680b19c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:45:35.791 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:35.787+0000 7fb76d38d640 1 --2- 172.21.15.150:0/3967946967 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb7680b15b0 0x7fb7680b19c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:35.792 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:35.787+0000 7fb76d38d640 1 -- 172.21.15.150:0/3967946967 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb7680b2750 msgr2=0x7fb76814ec00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:45:35.792 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:35.787+0000 7fb76d38d640 1 --2- 172.21.15.150:0/3967946967 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb7680b2750 0x7fb76814ec00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:35.792 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:35.787+0000 7fb76d38d640 1 -- 172.21.15.150:0/3967946967 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb7681f9860 con 0x7fb7680aebc0 2024-09-17T05:45:35.792 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:35.788+0000 7fb76d38d640 1 --2- 172.21.15.150:0/3967946967 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb7680aebc0 0x7fb7681f9320 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7fb76400d700 tx=0x7fb76400dbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:45:35.792 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:35.788+0000 7fb75dffb640 1 -- 172.21.15.150:0/3967946967 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb764017070 con 0x7fb7680aebc0 2024-09-17T05:45:35.792 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:35.788+0000 7fb75dffb640 1 -- 172.21.15.150:0/3967946967 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb764005310 con 0x7fb7680aebc0 2024-09-17T05:45:35.792 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:35.788+0000 7fb76f5f1640 1 -- 172.21.15.150:0/3967946967 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb76814f140 con 0x7fb7680aebc0 2024-09-17T05:45:35.792 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:35.788+0000 7fb75dffb640 1 -- 172.21.15.150:0/3967946967 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb764009820 con 0x7fb7680aebc0 2024-09-17T05:45:35.792 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:35.788+0000 7fb76f5f1640 1 -- 172.21.15.150:0/3967946967 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb7681582d0 con 0x7fb7680aebc0 2024-09-17T05:45:35.792 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:35.789+0000 7fb76f5f1640 1 -- 172.21.15.150:0/3967946967 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb7680b48b0 con 0x7fb7680aebc0 2024-09-17T05:45:35.793 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:35.790+0000 7fb75dffb640 1 -- 172.21.15.150:0/3967946967 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 15) ==== 102257+0+0 (secure 0 0 0) 0x7fb7640099c0 con 0x7fb7680aebc0 2024-09-17T05:45:35.793 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:35.790+0000 7fb75dffb640 1 --2- 172.21.15.150:0/3967946967 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fb74c079490 0x7fb74c07b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:45:35.793 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:35.790+0000 7fb75dffb640 1 -- 172.21.15.150:0/3967946967 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(60..60 src has 1..60) ==== 5737+0+0 (secure 0 0 0) 0x7fb7640996a0 con 0x7fb7680aebc0 2024-09-17T05:45:35.793 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:35.791+0000 7fb76cb8c640 1 --2- 172.21.15.150:0/3967946967 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fb74c079490 0x7fb74c07b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:45:35.793 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:35.791+0000 7fb76cb8c640 1 --2- 172.21.15.150:0/3967946967 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fb74c079490 0x7fb74c07b9a0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7fb7680709d0 tx=0x7fb758009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:45:35.796 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:35.795+0000 7fb75dffb640 1 -- 172.21.15.150:0/3967946967 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fb76814f140 con 0x7fb7680aebc0 2024-09-17T05:45:36.005 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:36.004+0000 7fb76f5f1640 1 -- 172.21.15.150:0/3967946967 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fb76815ebd0 con 0x7fb7680aebc0 2024-09-17T05:45:36.006 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:36.004+0000 7fb75dffb640 1 -- 172.21.15.150:0/3967946967 <== mon.0 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 33 v33) ==== 94+0+5235 (secure 0 0 0) 0x7fb7681f9860 con 0x7fb7680aebc0 2024-09-17T05:45:36.006 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-09-17T05:45:36.006 INFO:teuthology.orchestra.run.smithi150.stdout:{"epoch":33,"btime":"2024-09-17T05:45:35:644540+0000","default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5692,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6836/2204030245","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6834","nonce":2204030245},{"type":"v1","addr":"172.21.15.176:6836","nonce":2204030245}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":29},{"gid":5695,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6837/4065519712","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6835","nonce":4065519712},{"type":"v1","addr":"172.21.15.176:6837","nonce":4065519712}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":29},{"gid":6006,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6834/3602763503","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6832","nonce":3602763503},{"type":"v1","addr":"172.21.15.150:6834","nonce":3602763503}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":29}],"filesystems":[{"mdsmap":{"epoch":33,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T05:45:31.989014+0000","modified":"2024-09-17T05:45:35.004451+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6009},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6009":{"gid":6009,"name":"a","rank":0,"incarnation":30,"state":"up:active","state_seq":3,"addr":"172.21.15.150:6835/3434025708","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6833","nonce":3434025708},{"type":"v1","addr":"172.21.15.150:6835","nonce":3434025708}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6009,"qdb_cluster":[6009]},"id":4}]} 2024-09-17T05:45:36.006 INFO:teuthology.orchestra.run.smithi150.stderr:dumped fsmap epoch 33 2024-09-17T05:45:36.009 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:36.007+0000 7fb76f5f1640 1 -- 172.21.15.150:0/3967946967 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fb74c079490 msgr2=0x7fb74c07b9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:45:36.009 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:36.007+0000 7fb76f5f1640 1 --2- 172.21.15.150:0/3967946967 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fb74c079490 0x7fb74c07b9a0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7fb7680709d0 tx=0x7fb758009040 comp rx=0 tx=0).stop 2024-09-17T05:45:36.009 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:36.007+0000 7fb76f5f1640 1 -- 172.21.15.150:0/3967946967 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb7680aebc0 msgr2=0x7fb7681f9320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:45:36.009 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:36.007+0000 7fb76f5f1640 1 --2- 172.21.15.150:0/3967946967 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb7680aebc0 0x7fb7681f9320 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7fb76400d700 tx=0x7fb76400dbc0 comp rx=0 tx=0).stop 2024-09-17T05:45:36.009 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:36.007+0000 7fb76f5f1640 1 -- 172.21.15.150:0/3967946967 shutdown_connections 2024-09-17T05:45:36.009 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:36.007+0000 7fb76f5f1640 1 --2- 172.21.15.150:0/3967946967 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb7680b2750 0x7fb76814ec00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:36.009 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:36.007+0000 7fb76f5f1640 1 --2- 172.21.15.150:0/3967946967 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fb74c079490 0x7fb74c07b9a0 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:36.009 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:36.007+0000 7fb76f5f1640 1 --2- 172.21.15.150:0/3967946967 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb7680b15b0 0x7fb7680b19c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:36.009 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:36.007+0000 7fb76f5f1640 1 --2- 172.21.15.150:0/3967946967 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb7680aebc0 0x7fb7681f9320 unknown :-1 s=CLOSED pgs=630 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:36.010 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:36.007+0000 7fb76f5f1640 1 -- 172.21.15.150:0/3967946967 >> 172.21.15.150:0/3967946967 conn(0x7fb76806d730 msgr2=0x7fb76815f1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:45:36.010 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:36.007+0000 7fb76f5f1640 1 -- 172.21.15.150:0/3967946967 shutdown_connections 2024-09-17T05:45:36.010 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:36.007+0000 7fb76f5f1640 1 -- 172.21.15.150:0/3967946967 wait complete. 2024-09-17T05:45:36.020 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T05:45:36.133 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:36.131+0000 7f0ffba15640 1 -- 172.21.15.150:0/1111743190 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0ff40d15d0 msgr2=0x7f0ff40cf470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:45:36.133 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:36.131+0000 7f0ffba15640 1 --2- 172.21.15.150:0/1111743190 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0ff40d15d0 0x7f0ff40cf470 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7f0fec005fd0 tx=0x7f0fec02a820 comp rx=0 tx=0).stop 2024-09-17T05:45:36.133 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:36.131+0000 7f0ffba15640 1 -- 172.21.15.150:0/1111743190 shutdown_connections 2024-09-17T05:45:36.133 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:36.131+0000 7f0ffba15640 1 --2- 172.21.15.150:0/1111743190 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0ff40b3720 0x7f0ff40d1090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:36.133 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:36.131+0000 7f0ffba15640 1 --2- 172.21.15.150:0/1111743190 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0ff40d15d0 0x7f0ff40cf470 unknown :-1 s=CLOSED pgs=632 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:36.134 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:36.131+0000 7f0ffba15640 1 -- 172.21.15.150:0/1111743190 >> 172.21.15.150:0/1111743190 conn(0x7f0ff40d4680 msgr2=0x7f0ff40d4a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:45:36.134 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:36.131+0000 7f0ffba15640 1 -- 172.21.15.150:0/1111743190 shutdown_connections 2024-09-17T05:45:36.134 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:36.131+0000 7f0ffba15640 1 -- 172.21.15.150:0/1111743190 wait complete. 2024-09-17T05:45:36.134 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:36.133+0000 7f0ffba15640 1 Processor -- start 2024-09-17T05:45:36.134 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:36.133+0000 7f0ffba15640 1 -- start start 2024-09-17T05:45:36.137 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:36.134+0000 7f0ffba15640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0ff40b3720 0x7f0ff4158980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:45:36.137 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:36.134+0000 7f0ffba15640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0ff40b9780 0x7f0ff41fa0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:45:36.137 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:36.134+0000 7f0ffba15640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0ff40d15d0 0x7f0ff40b2950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:45:36.137 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:36.134+0000 7f0ffba15640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f0ff40cfdc0 con 0x7f0ff40b3720 2024-09-17T05:45:36.137 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:36.134+0000 7f0ffba15640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f0ff40cfc40 con 0x7f0ff40b9780 2024-09-17T05:45:36.137 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:36.134+0000 7f0ffba15640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f0ff40cff40 con 0x7f0ff40d15d0 2024-09-17T05:45:36.137 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:36.134+0000 7f0ff97b1640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0ff40b3720 0x7f0ff4158980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:45:36.138 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:36.134+0000 7f0ff97b1640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0ff40b3720 0x7f0ff4158980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:39270/0 (socket says 172.21.15.150:39270) 2024-09-17T05:45:36.138 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:36.134+0000 7f0ff97b1640 1 -- 172.21.15.150:0/24198013 learned_addr learned my addr 172.21.15.150:0/24198013 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:45:36.138 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:36.134+0000 7f0ff9fb2640 1 --2- 172.21.15.150:0/24198013 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0ff40d15d0 0x7f0ff40b2950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:45:36.138 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:36.134+0000 7f0ff8fb0640 1 --2- 172.21.15.150:0/24198013 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0ff40b9780 0x7f0ff41fa0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:45:36.138 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:36.134+0000 7f0ff97b1640 1 -- 172.21.15.150:0/24198013 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0ff40d15d0 msgr2=0x7f0ff40b2950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:45:36.138 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:36.134+0000 7f0ff97b1640 1 --2- 172.21.15.150:0/24198013 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0ff40d15d0 0x7f0ff40b2950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:36.138 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:36.134+0000 7f0ff97b1640 1 -- 172.21.15.150:0/24198013 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0ff40b9780 msgr2=0x7f0ff41fa0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:45:36.138 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:36.134+0000 7f0ff97b1640 1 --2- 172.21.15.150:0/24198013 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0ff40b9780 0x7f0ff41fa0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:36.138 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:36.134+0000 7f0ff97b1640 1 -- 172.21.15.150:0/24198013 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0ff4159420 con 0x7f0ff40b3720 2024-09-17T05:45:36.138 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:36.134+0000 7f0ff8fb0640 1 --2- 172.21.15.150:0/24198013 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0ff40b9780 0x7f0ff41fa0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T05:45:36.139 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:36.135+0000 7f0ff97b1640 1 --2- 172.21.15.150:0/24198013 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0ff40b3720 0x7f0ff4158980 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7f0ff000c3f0 tx=0x7f0ff0001e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:45:36.139 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:36.135+0000 7f0fe9ffb640 1 -- 172.21.15.150:0/24198013 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ff0017070 con 0x7f0ff40b3720 2024-09-17T05:45:36.139 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:36.135+0000 7f0fe9ffb640 1 -- 172.21.15.150:0/24198013 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0ff00035f0 con 0x7f0ff40b3720 2024-09-17T05:45:36.139 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:36.135+0000 7f0ffba15640 1 -- 172.21.15.150:0/24198013 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0ff4158ec0 con 0x7f0ff40b3720 2024-09-17T05:45:36.139 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:36.135+0000 7f0fe9ffb640 1 -- 172.21.15.150:0/24198013 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ff0003a80 con 0x7f0ff40b3720 2024-09-17T05:45:36.139 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:36.135+0000 7f0ffba15640 1 -- 172.21.15.150:0/24198013 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0ff41fa600 con 0x7f0ff40b3720 2024-09-17T05:45:36.140 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:36.136+0000 7f0ffba15640 1 -- 172.21.15.150:0/24198013 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0ff408d100 con 0x7f0ff40b3720 2024-09-17T05:45:36.140 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:36.136+0000 7f0fe9ffb640 1 -- 172.21.15.150:0/24198013 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 15) ==== 102257+0+0 (secure 0 0 0) 0x7f0ff001a070 con 0x7f0ff40b3720 2024-09-17T05:45:36.140 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:36.137+0000 7f0fe9ffb640 1 --2- 172.21.15.150:0/24198013 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f0fd8079490 0x7f0fd807b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:45:36.140 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:36.137+0000 7f0fe9ffb640 1 -- 172.21.15.150:0/24198013 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(60..60 src has 1..60) ==== 5737+0+0 (secure 0 0 0) 0x7f0ff00988b0 con 0x7f0ff40b3720 2024-09-17T05:45:36.140 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:36.137+0000 7f0ff8fb0640 1 --2- 172.21.15.150:0/24198013 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f0fd8079490 0x7f0fd807b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:45:36.140 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:36.138+0000 7f0ff8fb0640 1 --2- 172.21.15.150:0/24198013 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f0fd8079490 0x7f0fd807b9a0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f0ff41596f0 tx=0x7f0fe4005f90 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:45:36.143 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:36.141+0000 7f0fe9ffb640 1 -- 172.21.15.150:0/24198013 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f0ff408d100 con 0x7f0ff40b3720 2024-09-17T05:45:36.318 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:36.317+0000 7f0ffba15640 1 -- 172.21.15.150:0/24198013 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f0ff40d04f0 con 0x7f0ff40b3720 2024-09-17T05:45:36.320 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:36.318+0000 7f0fe9ffb640 1 -- 172.21.15.150:0/24198013 <== mon.0 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v60) ==== 74+0+16804 (secure 0 0 0) 0x7f0ff4159420 con 0x7f0ff40b3720 2024-09-17T05:45:36.320 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-09-17T05:45:36.320 INFO:teuthology.orchestra.run.smithi150.stdout:{"epoch":60,"fsid":"9f2e05e9-d629-47b3-b26b-1360655b7d20","created":"2024-09-17T05:41:32.502979+0000","modified":"2024-09-17T05:45:33.632493+0000","last_up_change":"2024-09-17T05:41:46.150225+0000","last_in_change":"2024-09-17T05:41:36.120274+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T05:41:46.860779+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2024-09-17T05:45:29.646151+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"59","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_data","create_time":"2024-09-17T05:45:30.948666+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"60","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"4f31c018-c8a4-4d6d-b0c2-a597c47aae4a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6800","nonce":479374392},{"type":"v1","addr":"172.21.15.150:6801","nonce":479374392}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6802","nonce":479374392},{"type":"v1","addr":"172.21.15.150:6803","nonce":479374392}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6806","nonce":479374392},{"type":"v1","addr":"172.21.15.150:6807","nonce":479374392}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6804","nonce":479374392},{"type":"v1","addr":"172.21.15.150:6805","nonce":479374392}]},"public_addr":"172.21.15.150:6801/479374392","cluster_addr":"172.21.15.150:6803/479374392","heartbeat_back_addr":"172.21.15.150:6807/479374392","heartbeat_front_addr":"172.21.15.150:6805/479374392","state":["exists","up"]},{"osd":1,"uuid":"6ff4a573-500b-4e04-9de3-39265ead78b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6824","nonce":913899800},{"type":"v1","addr":"172.21.15.150:6825","nonce":913899800}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6826","nonce":913899800},{"type":"v1","addr":"172.21.15.150:6827","nonce":913899800}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6830","nonce":913899800},{"type":"v1","addr":"172.21.15.150:6831","nonce":913899800}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6828","nonce":913899800},{"type":"v1","addr":"172.21.15.150:6829","nonce":913899800}]},"public_addr":"172.21.15.150:6825/913899800","cluster_addr":"172.21.15.150:6827/913899800","heartbeat_back_addr":"172.21.15.150:6831/913899800","heartbeat_front_addr":"172.21.15.150:6829/913899800","state":["exists","up"]},{"osd":2,"uuid":"bffea6f9-2465-4182-b205-00436c41ac1c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6816","nonce":363718461},{"type":"v1","addr":"172.21.15.150:6817","nonce":363718461}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6818","nonce":363718461},{"type":"v1","addr":"172.21.15.150:6819","nonce":363718461}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6822","nonce":363718461},{"type":"v1","addr":"172.21.15.150:6823","nonce":363718461}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6820","nonce":363718461},{"type":"v1","addr":"172.21.15.150:6821","nonce":363718461}]},"public_addr":"172.21.15.150:6817/363718461","cluster_addr":"172.21.15.150:6819/363718461","heartbeat_back_addr":"172.21.15.150:6823/363718461","heartbeat_front_addr":"172.21.15.150:6821/363718461","state":["exists","up"]},{"osd":3,"uuid":"cda70430-d1e1-427e-b04e-56db4031d078","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6808","nonce":3550994626},{"type":"v1","addr":"172.21.15.150:6809","nonce":3550994626}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6810","nonce":3550994626},{"type":"v1","addr":"172.21.15.150:6811","nonce":3550994626}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6814","nonce":3550994626},{"type":"v1","addr":"172.21.15.150:6815","nonce":3550994626}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6812","nonce":3550994626},{"type":"v1","addr":"172.21.15.150:6813","nonce":3550994626}]},"public_addr":"172.21.15.150:6809/3550994626","cluster_addr":"172.21.15.150:6811/3550994626","heartbeat_back_addr":"172.21.15.150:6815/3550994626","heartbeat_front_addr":"172.21.15.150:6813/3550994626","state":["exists","up"]},{"osd":4,"uuid":"3a0277fb-5e1e-4f68-bb2d-9a8a0152f64a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6810","nonce":2718261497},{"type":"v1","addr":"172.21.15.176:6811","nonce":2718261497}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6812","nonce":2718261497},{"type":"v1","addr":"172.21.15.176:6813","nonce":2718261497}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6816","nonce":2718261497},{"type":"v1","addr":"172.21.15.176:6817","nonce":2718261497}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6814","nonce":2718261497},{"type":"v1","addr":"172.21.15.176:6815","nonce":2718261497}]},"public_addr":"172.21.15.176:6811/2718261497","cluster_addr":"172.21.15.176:6813/2718261497","heartbeat_back_addr":"172.21.15.176:6817/2718261497","heartbeat_front_addr":"172.21.15.176:6815/2718261497","state":["exists","up"]},{"osd":5,"uuid":"33aebee6-0315-40b7-a11c-6702f0be494d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6818","nonce":2049295774},{"type":"v1","addr":"172.21.15.176:6819","nonce":2049295774}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6820","nonce":2049295774},{"type":"v1","addr":"172.21.15.176:6821","nonce":2049295774}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6824","nonce":2049295774},{"type":"v1","addr":"172.21.15.176:6825","nonce":2049295774}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6822","nonce":2049295774},{"type":"v1","addr":"172.21.15.176:6823","nonce":2049295774}]},"public_addr":"172.21.15.176:6819/2049295774","cluster_addr":"172.21.15.176:6821/2049295774","heartbeat_back_addr":"172.21.15.176:6825/2049295774","heartbeat_front_addr":"172.21.15.176:6823/2049295774","state":["exists","up"]},{"osd":6,"uuid":"4d24f360-6751-4263-841b-d77793d33540","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6826","nonce":2164458476},{"type":"v1","addr":"172.21.15.176:6827","nonce":2164458476}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6828","nonce":2164458476},{"type":"v1","addr":"172.21.15.176:6829","nonce":2164458476}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6832","nonce":2164458476},{"type":"v1","addr":"172.21.15.176:6833","nonce":2164458476}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6830","nonce":2164458476},{"type":"v1","addr":"172.21.15.176:6831","nonce":2164458476}]},"public_addr":"172.21.15.176:6827/2164458476","cluster_addr":"172.21.15.176:6829/2164458476","heartbeat_back_addr":"172.21.15.176:6833/2164458476","heartbeat_front_addr":"172.21.15.176:6831/2164458476","state":["exists","up"]},{"osd":7,"uuid":"c8594fda-c74a-4ba9-8277-caf101d58ca1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6802","nonce":3239587708},{"type":"v1","addr":"172.21.15.176:6803","nonce":3239587708}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6804","nonce":3239587708},{"type":"v1","addr":"172.21.15.176:6805","nonce":3239587708}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6808","nonce":3239587708},{"type":"v1","addr":"172.21.15.176:6809","nonce":3239587708}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6806","nonce":3239587708},{"type":"v1","addr":"172.21.15.176:6807","nonce":3239587708}]},"public_addr":"172.21.15.176:6803/3239587708","cluster_addr":"172.21.15.176:6805/3239587708","heartbeat_back_addr":"172.21.15.176:6809/3239587708","heartbeat_front_addr":"172.21.15.176:6807/3239587708","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:41:41.905151+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:41:42.705679+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:41:42.459673+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:41:42.440819+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:41:42.668428+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:41:42.694972+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:41:43.078535+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:41:42.363539+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":7,"snaps":[{"begin":2,"length":2}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T05:45:36.322 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:36.320+0000 7f0ffba15640 1 -- 172.21.15.150:0/24198013 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f0fd8079490 msgr2=0x7f0fd807b9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:45:36.322 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:36.320+0000 7f0ffba15640 1 --2- 172.21.15.150:0/24198013 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f0fd8079490 0x7f0fd807b9a0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f0ff41596f0 tx=0x7f0fe4005f90 comp rx=0 tx=0).stop 2024-09-17T05:45:36.322 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:36.320+0000 7f0ffba15640 1 -- 172.21.15.150:0/24198013 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0ff40b3720 msgr2=0x7f0ff4158980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:45:36.322 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:36.320+0000 7f0ffba15640 1 --2- 172.21.15.150:0/24198013 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0ff40b3720 0x7f0ff4158980 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7f0ff000c3f0 tx=0x7f0ff0001e70 comp rx=0 tx=0).stop 2024-09-17T05:45:36.322 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:36.320+0000 7f0ffba15640 1 -- 172.21.15.150:0/24198013 shutdown_connections 2024-09-17T05:45:36.322 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:36.320+0000 7f0ffba15640 1 --2- 172.21.15.150:0/24198013 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0ff40b9780 0x7f0ff41fa0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:36.322 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:36.320+0000 7f0ffba15640 1 --2- 172.21.15.150:0/24198013 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f0fd8079490 0x7f0fd807b9a0 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:36.322 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:36.320+0000 7f0ffba15640 1 --2- 172.21.15.150:0/24198013 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0ff40d15d0 0x7f0ff40b2950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:36.322 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:36.320+0000 7f0ffba15640 1 --2- 172.21.15.150:0/24198013 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0ff40b3720 0x7f0ff4158980 unknown :-1 s=CLOSED pgs=633 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:36.323 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:36.320+0000 7f0ffba15640 1 -- 172.21.15.150:0/24198013 >> 172.21.15.150:0/24198013 conn(0x7f0ff40d4680 msgr2=0x7f0ff40b76d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:45:36.323 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:36.320+0000 7f0ffba15640 1 -- 172.21.15.150:0/24198013 shutdown_connections 2024-09-17T05:45:36.323 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:36.320+0000 7f0ffba15640 1 -- 172.21.15.150:0/24198013 wait complete. 2024-09-17T05:45:36.334 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-17T05:45:36.334 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-17T05:45:36.448 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:36.446+0000 7fc70b9ba640 1 -- 172.21.15.150:0/4153381179 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc7040b5d50 msgr2=0x7fc7040d2780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:45:36.448 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:36.446+0000 7fc70b9ba640 1 --2- 172.21.15.150:0/4153381179 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc7040b5d50 0x7fc7040d2780 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fc700005fd0 tx=0x7fc70002a5d0 comp rx=0 tx=0).stop 2024-09-17T05:45:36.448 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:36.446+0000 7fc70b9ba640 1 -- 172.21.15.150:0/4153381179 shutdown_connections 2024-09-17T05:45:36.448 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:36.446+0000 7fc70b9ba640 1 --2- 172.21.15.150:0/4153381179 >> v2:172.21.15.176:3300/0 conn(0x7fc7040d4f90 0x7fc7040d0400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:36.448 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:36.446+0000 7fc70b9ba640 1 --2- 172.21.15.150:0/4153381179 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc7040b5d50 0x7fc7040d2780 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:36.448 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:36.446+0000 7fc70b9ba640 1 -- 172.21.15.150:0/4153381179 >> 172.21.15.150:0/4153381179 conn(0x7fc70408bfe0 msgr2=0x7fc7040d4670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:45:36.448 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:36.446+0000 7fc70b9ba640 1 -- 172.21.15.150:0/4153381179 shutdown_connections 2024-09-17T05:45:36.448 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:36.446+0000 7fc70b9ba640 1 -- 172.21.15.150:0/4153381179 wait complete. 2024-09-17T05:45:36.449 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:36.448+0000 7fc70b9ba640 1 Processor -- start 2024-09-17T05:45:36.449 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:36.448+0000 7fc70b9ba640 1 -- start start 2024-09-17T05:45:36.452 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:36.449+0000 7fc70b9ba640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc7040b5d50 0x7fc704147a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:45:36.452 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:36.449+0000 7fc70b9ba640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc7040d1080 0x7fc704157080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:45:36.452 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:36.449+0000 7fc70b9ba640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc7040d4f90 0x7fc7041575c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:45:36.452 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:36.449+0000 7fc70b9ba640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7fc7040b7b00 con 0x7fc7040d1080 2024-09-17T05:45:36.452 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:36.449+0000 7fc70b9ba640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fc7040b7980 con 0x7fc7040d4f90 2024-09-17T05:45:36.452 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:36.449+0000 7fc70b9ba640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fc7040b7c80 con 0x7fc7040b5d50 2024-09-17T05:45:36.452 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:36.449+0000 7fc708f55640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc7040d1080 0x7fc704157080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:45:36.453 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:36.449+0000 7fc708f55640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc7040d1080 0x7fc704157080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:39286/0 (socket says 172.21.15.150:39286) 2024-09-17T05:45:36.453 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:36.449+0000 7fc708f55640 1 -- 172.21.15.150:0/3629818611 learned_addr learned my addr 172.21.15.150:0/3629818611 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:45:36.453 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:36.449+0000 7fc709756640 1 --2- 172.21.15.150:0/3629818611 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc7040b5d50 0x7fc704147a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:45:36.453 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:36.449+0000 7fc709f57640 1 --2- 172.21.15.150:0/3629818611 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc7040d4f90 0x7fc7041575c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:45:36.453 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:36.449+0000 7fc708f55640 1 -- 172.21.15.150:0/3629818611 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc7040b5d50 msgr2=0x7fc704147a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:45:36.453 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:36.449+0000 7fc708f55640 1 --2- 172.21.15.150:0/3629818611 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc7040b5d50 0x7fc704147a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:36.453 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:36.449+0000 7fc708f55640 1 -- 172.21.15.150:0/3629818611 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc7040d4f90 msgr2=0x7fc7041575c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:45:36.453 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:36.449+0000 7fc708f55640 1 --2- 172.21.15.150:0/3629818611 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc7040d4f90 0x7fc7041575c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:36.453 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:36.449+0000 7fc708f55640 1 -- 172.21.15.150:0/3629818611 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc7040b2c00 con 0x7fc7040d1080 2024-09-17T05:45:36.453 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:36.450+0000 7fc708f55640 1 --2- 172.21.15.150:0/3629818611 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc7040d1080 0x7fc704157080 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7fc6f400e790 tx=0x7fc6f400ec50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:45:36.453 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:36.450+0000 7fc6f9ffb640 1 -- 172.21.15.150:0/3629818611 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6f400eea0 con 0x7fc7040d1080 2024-09-17T05:45:36.453 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:36.450+0000 7fc6f9ffb640 1 -- 172.21.15.150:0/3629818611 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc6f400ccc0 con 0x7fc7040d1080 2024-09-17T05:45:36.454 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:36.450+0000 7fc70b9ba640 1 -- 172.21.15.150:0/3629818611 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc7040b2ea0 con 0x7fc7040d1080 2024-09-17T05:45:36.454 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:36.450+0000 7fc6f9ffb640 1 -- 172.21.15.150:0/3629818611 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6f4005280 con 0x7fc7040d1080 2024-09-17T05:45:36.454 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:36.450+0000 7fc70b9ba640 1 -- 172.21.15.150:0/3629818611 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc7040b3460 con 0x7fc7040d1080 2024-09-17T05:45:36.454 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:36.451+0000 7fc70b9ba640 1 -- 172.21.15.150:0/3629818611 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc7040d2780 con 0x7fc7040d1080 2024-09-17T05:45:36.455 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:36.452+0000 7fc6f9ffb640 1 -- 172.21.15.150:0/3629818611 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 15) ==== 102257+0+0 (secure 0 0 0) 0x7fc6f4005420 con 0x7fc7040d1080 2024-09-17T05:45:36.455 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:36.452+0000 7fc6f9ffb640 1 --2- 172.21.15.150:0/3629818611 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fc6e8079490 0x7fc6e807b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:45:36.455 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:36.452+0000 7fc6f9ffb640 1 -- 172.21.15.150:0/3629818611 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(60..60 src has 1..60) ==== 5737+0+0 (secure 0 0 0) 0x7fc6f4099de0 con 0x7fc7040d1080 2024-09-17T05:45:36.455 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:36.452+0000 7fc709756640 1 --2- 172.21.15.150:0/3629818611 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fc6e8079490 0x7fc6e807b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:45:36.455 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:36.453+0000 7fc709756640 1 --2- 172.21.15.150:0/3629818611 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fc6e8079490 0x7fc6e807b9a0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7fc700033000 tx=0x7fc700004730 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:45:36.458 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:36.457+0000 7fc6f9ffb640 1 -- 172.21.15.150:0/3629818611 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fc6f4063600 con 0x7fc7040d1080 2024-09-17T05:45:36.632 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:36.630+0000 7fc70b9ba640 1 -- 172.21.15.150:0/3629818611 --> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fc7040d2d60 con 0x7fc6e8079490 2024-09-17T05:45:36.637 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:36.636+0000 7fc6f9ffb640 1 -- 172.21.15.150:0/3629818611 <== mgr.4108 v2:172.21.15.176:6800/3631216395 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+244858 (secure 0 0 0) 0x7fc7040d2d60 con 0x7fc6e8079490 2024-09-17T05:45:36.640 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-09-17T05:45:36.641 INFO:teuthology.orchestra.run.smithi150.stderr:dumped all 2024-09-17T05:45:36.643 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:36.639+0000 7fc70b9ba640 1 -- 172.21.15.150:0/3629818611 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fc6e8079490 msgr2=0x7fc6e807b9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:45:36.644 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:36.639+0000 7fc70b9ba640 1 --2- 172.21.15.150:0/3629818611 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fc6e8079490 0x7fc6e807b9a0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7fc700033000 tx=0x7fc700004730 comp rx=0 tx=0).stop 2024-09-17T05:45:36.644 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:36.639+0000 7fc70b9ba640 1 -- 172.21.15.150:0/3629818611 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc7040d1080 msgr2=0x7fc704157080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:45:36.644 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:36.639+0000 7fc70b9ba640 1 --2- 172.21.15.150:0/3629818611 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc7040d1080 0x7fc704157080 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7fc6f400e790 tx=0x7fc6f400ec50 comp rx=0 tx=0).stop 2024-09-17T05:45:36.644 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:36.639+0000 7fc70b9ba640 1 -- 172.21.15.150:0/3629818611 shutdown_connections 2024-09-17T05:45:36.644 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:36.639+0000 7fc70b9ba640 1 --2- 172.21.15.150:0/3629818611 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc7040d4f90 0x7fc7041575c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:36.644 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:36.639+0000 7fc70b9ba640 1 --2- 172.21.15.150:0/3629818611 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fc6e8079490 0x7fc6e807b9a0 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:36.644 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:36.639+0000 7fc70b9ba640 1 --2- 172.21.15.150:0/3629818611 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc7040d1080 0x7fc704157080 unknown :-1 s=CLOSED pgs=634 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:36.644 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:36.639+0000 7fc70b9ba640 1 --2- 172.21.15.150:0/3629818611 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc7040b5d50 0x7fc704147a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:36.644 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:36.639+0000 7fc70b9ba640 1 -- 172.21.15.150:0/3629818611 >> 172.21.15.150:0/3629818611 conn(0x7fc70408bfe0 msgr2=0x7fc7040b5460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:45:36.644 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:36.639+0000 7fc70b9ba640 1 -- 172.21.15.150:0/3629818611 shutdown_connections 2024-09-17T05:45:36.645 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:36.639+0000 7fc70b9ba640 1 -- 172.21.15.150:0/3629818611 wait complete. 2024-09-17T05:45:36.653 INFO:teuthology.orchestra.run.smithi150.stdout:{"pg_ready":true,"pg_map":{"version":169,"stamp":"2024-09-17T05:45:34.908611+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590950,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":111,"num_write_kb":1629,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":81,"ondisk_log_size":81,"up":142,"acting":142,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":8,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":365672,"kb_used_data":6516,"kb_used_omap":12,"kb_used_meta":358963,"kb_avail":754609048,"statfs":{"total":773094113280,"available":772719665152,"internally_reserved":0,"allocated":6672384,"data_stored":3424737,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":367578672},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":15,"apply_latency_ms":15,"commit_latency_ns":15000000,"apply_latency_ns":15000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.290816"},"pg_stats":[{"pgid":"9.3f","version":"0'0","reported_seq":1,"reported_epoch":58,"state":"creating+peering","last_fresh":"2024-09-17T05:45:31.635800+0000","last_change":"2024-09-17T05:45:31.635800+0000","last_active":"2024-09-17T05:45:31.614428+0000","last_peered":"2024-09-17T05:45:31.614428+0000","last_clean":"2024-09-17T05:45:31.614428+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:45:31.635800+0000","last_undegraded":"2024-09-17T05:45:31.635800+0000","last_fullsized":"2024-09-17T05:45:31.635800+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:45:31.614428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:45:31.614428+0000","last_clean_scrub_stamp":"2024-09-17T05:45:31.614428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3e","version":"0'0","reported_seq":1,"reported_epoch":58,"state":"creating+peering","last_fresh":"2024-09-17T05:45:31.628405+0000","last_change":"2024-09-17T05:45:31.628405+0000","last_active":"2024-09-17T05:45:31.614428+0000","last_peered":"2024-09-17T05:45:31.614428+0000","last_clean":"2024-09-17T05:45:31.614428+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:45:31.628405+0000","last_undegraded":"2024-09-17T05:45:31.628405+0000","last_fullsized":"2024-09-17T05:45:31.628405+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:45:31.614428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:45:31.614428+0000","last_clean_scrub_stamp":"2024-09-17T05:45:31.614428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:45:31.614428+0000","last_change":"2024-09-17T05:45:31.614428+0000","last_active":"2024-09-17T05:45:31.614428+0000","last_peered":"2024-09-17T05:45:31.614428+0000","last_clean":"2024-09-17T05:45:31.614428+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:45:31.614428+0000","last_undegraded":"2024-09-17T05:45:31.614428+0000","last_fullsized":"2024-09-17T05:45:31.614428+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:45:31.614428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:45:31.614428+0000","last_clean_scrub_stamp":"2024-09-17T05:45:31.614428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:45:31.614428+0000","last_change":"2024-09-17T05:45:31.614428+0000","last_active":"2024-09-17T05:45:31.614428+0000","last_peered":"2024-09-17T05:45:31.614428+0000","last_clean":"2024-09-17T05:45:31.614428+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:45:31.614428+0000","last_undegraded":"2024-09-17T05:45:31.614428+0000","last_fullsized":"2024-09-17T05:45:31.614428+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:45:31.614428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:45:31.614428+0000","last_clean_scrub_stamp":"2024-09-17T05:45:31.614428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.3b","version":"0'0","reported_seq":1,"reported_epoch":58,"state":"creating+peering","last_fresh":"2024-09-17T05:45:31.638143+0000","last_change":"2024-09-17T05:45:31.638143+0000","last_active":"2024-09-17T05:45:31.614428+0000","last_peered":"2024-09-17T05:45:31.614428+0000","last_clean":"2024-09-17T05:45:31.614428+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:45:31.638143+0000","last_undegraded":"2024-09-17T05:45:31.638143+0000","last_fullsized":"2024-09-17T05:45:31.638143+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:45:31.614428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:45:31.614428+0000","last_clean_scrub_stamp":"2024-09-17T05:45:31.614428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3a","version":"0'0","reported_seq":10,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-17T05:45:32.642546+0000","last_change":"2024-09-17T05:45:32.639148+0000","last_active":"2024-09-17T05:45:32.642546+0000","last_peered":"2024-09-17T05:45:32.642546+0000","last_clean":"2024-09-17T05:45:32.642546+0000","last_became_active":"2024-09-17T05:45:32.638816+0000","last_became_peered":"2024-09-17T05:45:32.638816+0000","last_unstale":"2024-09-17T05:45:32.642546+0000","last_undegraded":"2024-09-17T05:45:32.642546+0000","last_fullsized":"2024-09-17T05:45:32.642546+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:45:31.614428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:45:31.614428+0000","last_clean_scrub_stamp":"2024-09-17T05:45:31.614428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:47:31.319688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:45:31.614428+0000","last_change":"2024-09-17T05:45:31.614428+0000","last_active":"2024-09-17T05:45:31.614428+0000","last_peered":"2024-09-17T05:45:31.614428+0000","last_clean":"2024-09-17T05:45:31.614428+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:45:31.614428+0000","last_undegraded":"2024-09-17T05:45:31.614428+0000","last_fullsized":"2024-09-17T05:45:31.614428+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:45:31.614428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:45:31.614428+0000","last_clean_scrub_stamp":"2024-09-17T05:45:31.614428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.38","version":"0'0","reported_seq":1,"reported_epoch":58,"state":"creating+peering","last_fresh":"2024-09-17T05:45:31.628464+0000","last_change":"2024-09-17T05:45:31.628464+0000","last_active":"2024-09-17T05:45:31.614428+0000","last_peered":"2024-09-17T05:45:31.614428+0000","last_clean":"2024-09-17T05:45:31.614428+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:45:31.628464+0000","last_undegraded":"2024-09-17T05:45:31.628464+0000","last_fullsized":"2024-09-17T05:45:31.628464+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:45:31.614428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:45:31.614428+0000","last_clean_scrub_stamp":"2024-09-17T05:45:31.614428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:45:31.614428+0000","last_change":"2024-09-17T05:45:31.614428+0000","last_active":"2024-09-17T05:45:31.614428+0000","last_peered":"2024-09-17T05:45:31.614428+0000","last_clean":"2024-09-17T05:45:31.614428+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:45:31.614428+0000","last_undegraded":"2024-09-17T05:45:31.614428+0000","last_fullsized":"2024-09-17T05:45:31.614428+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:45:31.614428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:45:31.614428+0000","last_clean_scrub_stamp":"2024-09-17T05:45:31.614428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.36","version":"0'0","reported_seq":1,"reported_epoch":58,"state":"creating+peering","last_fresh":"2024-09-17T05:45:31.628670+0000","last_change":"2024-09-17T05:45:31.628670+0000","last_active":"2024-09-17T05:45:31.614428+0000","last_peered":"2024-09-17T05:45:31.614428+0000","last_clean":"2024-09-17T05:45:31.614428+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:45:31.628670+0000","last_undegraded":"2024-09-17T05:45:31.628670+0000","last_fullsized":"2024-09-17T05:45:31.628670+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:45:31.614428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:45:31.614428+0000","last_clean_scrub_stamp":"2024-09-17T05:45:31.614428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.35","version":"0'0","reported_seq":1,"reported_epoch":58,"state":"creating+peering","last_fresh":"2024-09-17T05:45:31.628550+0000","last_change":"2024-09-17T05:45:31.628550+0000","last_active":"2024-09-17T05:45:31.614428+0000","last_peered":"2024-09-17T05:45:31.614428+0000","last_clean":"2024-09-17T05:45:31.614428+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:45:31.628550+0000","last_undegraded":"2024-09-17T05:45:31.628550+0000","last_fullsized":"2024-09-17T05:45:31.628550+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:45:31.614428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:45:31.614428+0000","last_clean_scrub_stamp":"2024-09-17T05:45:31.614428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:45:31.614428+0000","last_change":"2024-09-17T05:45:31.614428+0000","last_active":"2024-09-17T05:45:31.614428+0000","last_peered":"2024-09-17T05:45:31.614428+0000","last_clean":"2024-09-17T05:45:31.614428+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:45:31.614428+0000","last_undegraded":"2024-09-17T05:45:31.614428+0000","last_fullsized":"2024-09-17T05:45:31.614428+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:45:31.614428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:45:31.614428+0000","last_clean_scrub_stamp":"2024-09-17T05:45:31.614428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.33","version":"0'0","reported_seq":1,"reported_epoch":58,"state":"creating+peering","last_fresh":"2024-09-17T05:45:31.623675+0000","last_change":"2024-09-17T05:45:31.623675+0000","last_active":"2024-09-17T05:45:31.614428+0000","last_peered":"2024-09-17T05:45:31.614428+0000","last_clean":"2024-09-17T05:45:31.614428+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:45:31.623675+0000","last_undegraded":"2024-09-17T05:45:31.623675+0000","last_fullsized":"2024-09-17T05:45:31.623675+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:45:31.614428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:45:31.614428+0000","last_clean_scrub_stamp":"2024-09-17T05:45:31.614428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:45:31.614428+0000","last_change":"2024-09-17T05:45:31.614428+0000","last_active":"2024-09-17T05:45:31.614428+0000","last_peered":"2024-09-17T05:45:31.614428+0000","last_clean":"2024-09-17T05:45:31.614428+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:45:31.614428+0000","last_undegraded":"2024-09-17T05:45:31.614428+0000","last_fullsized":"2024-09-17T05:45:31.614428+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:45:31.614428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:45:31.614428+0000","last_clean_scrub_stamp":"2024-09-17T05:45:31.614428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:45:31.614428+0000","last_change":"2024-09-17T05:45:31.614428+0000","last_active":"2024-09-17T05:45:31.614428+0000","last_peered":"2024-09-17T05:45:31.614428+0000","last_clean":"2024-09-17T05:45:31.614428+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:45:31.614428+0000","last_undegraded":"2024-09-17T05:45:31.614428+0000","last_fullsized":"2024-09-17T05:45:31.614428+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:45:31.614428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:45:31.614428+0000","last_clean_scrub_stamp":"2024-09-17T05:45:31.614428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.30","version":"0'0","reported_seq":10,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-17T05:45:32.649772+0000","last_change":"2024-09-17T05:45:32.645281+0000","last_active":"2024-09-17T05:45:32.649772+0000","last_peered":"2024-09-17T05:45:32.649772+0000","last_clean":"2024-09-17T05:45:32.649772+0000","last_became_active":"2024-09-17T05:45:32.644707+0000","last_became_peered":"2024-09-17T05:45:32.644707+0000","last_unstale":"2024-09-17T05:45:32.649772+0000","last_undegraded":"2024-09-17T05:45:32.649772+0000","last_fullsized":"2024-09-17T05:45:32.649772+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:45:31.614428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:45:31.614428+0000","last_clean_scrub_stamp":"2024-09-17T05:45:31.614428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:35:47.004290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.2f","version":"0'0","reported_seq":1,"reported_epoch":58,"state":"creating+peering","last_fresh":"2024-09-17T05:45:31.628311+0000","last_change":"2024-09-17T05:45:31.628311+0000","last_active":"2024-09-17T05:45:31.614428+0000","last_peered":"2024-09-17T05:45:31.614428+0000","last_clean":"2024-09-17T05:45:31.614428+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:45:31.628311+0000","last_undegraded":"2024-09-17T05:45:31.628311+0000","last_fullsized":"2024-09-17T05:45:31.628311+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:45:31.614428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:45:31.614428+0000","last_clean_scrub_stamp":"2024-09-17T05:45:31.614428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:45:31.614428+0000","last_change":"2024-09-17T05:45:31.614428+0000","last_active":"2024-09-17T05:45:31.614428+0000","last_peered":"2024-09-17T05:45:31.614428+0000","last_clean":"2024-09-17T05:45:31.614428+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:45:31.614428+0000","last_undegraded":"2024-09-17T05:45:31.614428+0000","last_fullsized":"2024-09-17T05:45:31.614428+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:45:31.614428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:45:31.614428+0000","last_clean_scrub_stamp":"2024-09-17T05:45:31.614428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.2d","version":"0'0","reported_seq":1,"reported_epoch":58,"state":"creating+peering","last_fresh":"2024-09-17T05:45:31.633549+0000","last_change":"2024-09-17T05:45:31.633549+0000","last_active":"2024-09-17T05:45:31.614428+0000","last_peered":"2024-09-17T05:45:31.614428+0000","last_clean":"2024-09-17T05:45:31.614428+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:45:31.633549+0000","last_undegraded":"2024-09-17T05:45:31.633549+0000","last_fullsized":"2024-09-17T05:45:31.633549+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:45:31.614428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:45:31.614428+0000","last_clean_scrub_stamp":"2024-09-17T05:45:31.614428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.2c","version":"0'0","reported_seq":1,"reported_epoch":58,"state":"creating+peering","last_fresh":"2024-09-17T05:45:31.628712+0000","last_change":"2024-09-17T05:45:31.628712+0000","last_active":"2024-09-17T05:45:31.614428+0000","last_peered":"2024-09-17T05:45:31.614428+0000","last_clean":"2024-09-17T05:45:31.614428+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:45:31.628712+0000","last_undegraded":"2024-09-17T05:45:31.628712+0000","last_fullsized":"2024-09-17T05:45:31.628712+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:45:31.614428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:45:31.614428+0000","last_clean_scrub_stamp":"2024-09-17T05:45:31.614428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:45:31.614428+0000","last_change":"2024-09-17T05:45:31.614428+0000","last_active":"2024-09-17T05:45:31.614428+0000","last_peered":"2024-09-17T05:45:31.614428+0000","last_clean":"2024-09-17T05:45:31.614428+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:45:31.614428+0000","last_undegraded":"2024-09-17T05:45:31.614428+0000","last_fullsized":"2024-09-17T05:45:31.614428+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:45:31.614428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:45:31.614428+0000","last_clean_scrub_stamp":"2024-09-17T05:45:31.614428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.2a","version":"0'0","reported_seq":1,"reported_epoch":58,"state":"creating+peering","last_fresh":"2024-09-17T05:45:31.634734+0000","last_change":"2024-09-17T05:45:31.634734+0000","last_active":"2024-09-17T05:45:31.614428+0000","last_peered":"2024-09-17T05:45:31.614428+0000","last_clean":"2024-09-17T05:45:31.614428+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:45:31.634734+0000","last_undegraded":"2024-09-17T05:45:31.634734+0000","last_fullsized":"2024-09-17T05:45:31.634734+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:45:31.614428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:45:31.614428+0000","last_clean_scrub_stamp":"2024-09-17T05:45:31.614428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:45:31.614428+0000","last_change":"2024-09-17T05:45:31.614428+0000","last_active":"2024-09-17T05:45:31.614428+0000","last_peered":"2024-09-17T05:45:31.614428+0000","last_clean":"2024-09-17T05:45:31.614428+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:45:31.614428+0000","last_undegraded":"2024-09-17T05:45:31.614428+0000","last_fullsized":"2024-09-17T05:45:31.614428+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:45:31.614428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:45:31.614428+0000","last_clean_scrub_stamp":"2024-09-17T05:45:31.614428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.28","version":"0'0","reported_seq":1,"reported_epoch":58,"state":"creating+peering","last_fresh":"2024-09-17T05:45:31.625136+0000","last_change":"2024-09-17T05:45:31.625136+0000","last_active":"2024-09-17T05:45:31.614428+0000","last_peered":"2024-09-17T05:45:31.614428+0000","last_clean":"2024-09-17T05:45:31.614428+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:45:31.625136+0000","last_undegraded":"2024-09-17T05:45:31.625136+0000","last_fullsized":"2024-09-17T05:45:31.625136+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:45:31.614428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:45:31.614428+0000","last_clean_scrub_stamp":"2024-09-17T05:45:31.614428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.27","version":"0'0","reported_seq":1,"reported_epoch":58,"state":"creating+peering","last_fresh":"2024-09-17T05:45:31.635240+0000","last_change":"2024-09-17T05:45:31.635240+0000","last_active":"2024-09-17T05:45:31.614428+0000","last_peered":"2024-09-17T05:45:31.614428+0000","last_clean":"2024-09-17T05:45:31.614428+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:45:31.635240+0000","last_undegraded":"2024-09-17T05:45:31.635240+0000","last_fullsized":"2024-09-17T05:45:31.635240+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:45:31.614428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:45:31.614428+0000","last_clean_scrub_stamp":"2024-09-17T05:45:31.614428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:45:31.614428+0000","last_change":"2024-09-17T05:45:31.614428+0000","last_active":"2024-09-17T05:45:31.614428+0000","last_peered":"2024-09-17T05:45:31.614428+0000","last_clean":"2024-09-17T05:45:31.614428+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:45:31.614428+0000","last_undegraded":"2024-09-17T05:45:31.614428+0000","last_fullsized":"2024-09-17T05:45:31.614428+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:45:31.614428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:45:31.614428+0000","last_clean_scrub_stamp":"2024-09-17T05:45:31.614428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.25","version":"0'0","reported_seq":10,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-17T05:45:32.643075+0000","last_change":"2024-09-17T05:45:32.637435+0000","last_active":"2024-09-17T05:45:32.643075+0000","last_peered":"2024-09-17T05:45:32.643075+0000","last_clean":"2024-09-17T05:45:32.643075+0000","last_became_active":"2024-09-17T05:45:32.637137+0000","last_became_peered":"2024-09-17T05:45:32.637137+0000","last_unstale":"2024-09-17T05:45:32.643075+0000","last_undegraded":"2024-09-17T05:45:32.643075+0000","last_fullsized":"2024-09-17T05:45:32.643075+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:45:31.614428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:45:31.614428+0000","last_clean_scrub_stamp":"2024-09-17T05:45:31.614428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:40:05.262567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.24","version":"0'0","reported_seq":1,"reported_epoch":58,"state":"creating+peering","last_fresh":"2024-09-17T05:45:31.635964+0000","last_change":"2024-09-17T05:45:31.635964+0000","last_active":"2024-09-17T05:45:31.614428+0000","last_peered":"2024-09-17T05:45:31.614428+0000","last_clean":"2024-09-17T05:45:31.614428+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:45:31.635964+0000","last_undegraded":"2024-09-17T05:45:31.635964+0000","last_fullsized":"2024-09-17T05:45:31.635964+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:45:31.614428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:45:31.614428+0000","last_clean_scrub_stamp":"2024-09-17T05:45:31.614428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.23","version":"0'0","reported_seq":1,"reported_epoch":58,"state":"creating+peering","last_fresh":"2024-09-17T05:45:31.631473+0000","last_change":"2024-09-17T05:45:31.631473+0000","last_active":"2024-09-17T05:45:31.614428+0000","last_peered":"2024-09-17T05:45:31.614428+0000","last_clean":"2024-09-17T05:45:31.614428+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:45:31.631473+0000","last_undegraded":"2024-09-17T05:45:31.631473+0000","last_fullsized":"2024-09-17T05:45:31.631473+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:45:31.614428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:45:31.614428+0000","last_clean_scrub_stamp":"2024-09-17T05:45:31.614428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:45:31.614428+0000","last_change":"2024-09-17T05:45:31.614428+0000","last_active":"2024-09-17T05:45:31.614428+0000","last_peered":"2024-09-17T05:45:31.614428+0000","last_clean":"2024-09-17T05:45:31.614428+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:45:31.614428+0000","last_undegraded":"2024-09-17T05:45:31.614428+0000","last_fullsized":"2024-09-17T05:45:31.614428+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:45:31.614428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:45:31.614428+0000","last_clean_scrub_stamp":"2024-09-17T05:45:31.614428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.21","version":"0'0","reported_seq":1,"reported_epoch":58,"state":"creating+peering","last_fresh":"2024-09-17T05:45:31.633306+0000","last_change":"2024-09-17T05:45:31.633306+0000","last_active":"2024-09-17T05:45:31.614428+0000","last_peered":"2024-09-17T05:45:31.614428+0000","last_clean":"2024-09-17T05:45:31.614428+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:45:31.633306+0000","last_undegraded":"2024-09-17T05:45:31.633306+0000","last_fullsized":"2024-09-17T05:45:31.633306+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:45:31.614428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:45:31.614428+0000","last_clean_scrub_stamp":"2024-09-17T05:45:31.614428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.20","version":"0'0","reported_seq":10,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-17T05:45:32.644914+0000","last_change":"2024-09-17T05:45:32.641063+0000","last_active":"2024-09-17T05:45:32.644914+0000","last_peered":"2024-09-17T05:45:32.644914+0000","last_clean":"2024-09-17T05:45:32.644914+0000","last_became_active":"2024-09-17T05:45:32.640742+0000","last_became_peered":"2024-09-17T05:45:32.640742+0000","last_unstale":"2024-09-17T05:45:32.644914+0000","last_undegraded":"2024-09-17T05:45:32.644914+0000","last_fullsized":"2024-09-17T05:45:32.644914+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:45:31.614428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:45:31.614428+0000","last_clean_scrub_stamp":"2024-09-17T05:45:31.614428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:07:58.852633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1e","version":"0'0","reported_seq":10,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-17T05:45:32.657055+0000","last_change":"2024-09-17T05:45:32.654896+0000","last_active":"2024-09-17T05:45:32.657055+0000","last_peered":"2024-09-17T05:45:32.657055+0000","last_clean":"2024-09-17T05:45:32.657055+0000","last_became_active":"2024-09-17T05:45:32.652165+0000","last_became_peered":"2024-09-17T05:45:32.652165+0000","last_unstale":"2024-09-17T05:45:32.657055+0000","last_undegraded":"2024-09-17T05:45:32.657055+0000","last_fullsized":"2024-09-17T05:45:32.657055+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:45:31.614428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:45:31.614428+0000","last_clean_scrub_stamp":"2024-09-17T05:45:31.614428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:51:41.489630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1f","version":"59'4","reported_seq":17,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-17T05:45:32.655111+0000","last_change":"2024-09-17T05:45:31.639533+0000","last_active":"2024-09-17T05:45:32.655111+0000","last_peered":"2024-09-17T05:45:32.655111+0000","last_clean":"2024-09-17T05:45:32.655111+0000","last_became_active":"2024-09-17T05:45:31.638859+0000","last_became_peered":"2024-09-17T05:45:31.638859+0000","last_unstale":"2024-09-17T05:45:32.655111+0000","last_undegraded":"2024-09-17T05:45:32.655111+0000","last_fullsized":"2024-09-17T05:45:32.655111+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:45:30.612191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:45:30.612191+0000","last_clean_scrub_stamp":"2024-09-17T05:45:30.612191+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:50:36.495235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1f","version":"0'0","reported_seq":1,"reported_epoch":58,"state":"creating+peering","last_fresh":"2024-09-17T05:45:31.627774+0000","last_change":"2024-09-17T05:45:31.627774+0000","last_active":"2024-09-17T05:45:31.614428+0000","last_peered":"2024-09-17T05:45:31.614428+0000","last_clean":"2024-09-17T05:45:31.614428+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:45:31.627774+0000","last_undegraded":"2024-09-17T05:45:31.627774+0000","last_fullsized":"2024-09-17T05:45:31.627774+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:45:31.614428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:45:31.614428+0000","last_clean_scrub_stamp":"2024-09-17T05:45:31.614428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":10,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-17T05:45:31.636336+0000","last_change":"2024-09-17T05:45:31.629458+0000","last_active":"2024-09-17T05:45:31.636336+0000","last_peered":"2024-09-17T05:45:31.636336+0000","last_clean":"2024-09-17T05:45:31.636336+0000","last_became_active":"2024-09-17T05:45:31.629161+0000","last_became_peered":"2024-09-17T05:45:31.629161+0000","last_unstale":"2024-09-17T05:45:31.636336+0000","last_undegraded":"2024-09-17T05:45:31.636336+0000","last_fullsized":"2024-09-17T05:45:31.636336+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:45:30.612191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:45:30.612191+0000","last_clean_scrub_stamp":"2024-09-17T05:45:30.612191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:13:41.291969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.1c","version":"0'0","reported_seq":10,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-17T05:45:32.642493+0000","last_change":"2024-09-17T05:45:32.639921+0000","last_active":"2024-09-17T05:45:32.642493+0000","last_peered":"2024-09-17T05:45:32.642493+0000","last_clean":"2024-09-17T05:45:32.642493+0000","last_became_active":"2024-09-17T05:45:32.639588+0000","last_became_peered":"2024-09-17T05:45:32.639588+0000","last_unstale":"2024-09-17T05:45:32.642493+0000","last_undegraded":"2024-09-17T05:45:32.642493+0000","last_fullsized":"2024-09-17T05:45:32.642493+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:45:31.614428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:45:31.614428+0000","last_clean_scrub_stamp":"2024-09-17T05:45:31.614428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:58:26.605060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1d","version":"59'2","reported_seq":15,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-17T05:45:32.658108+0000","last_change":"2024-09-17T05:45:31.634645+0000","last_active":"2024-09-17T05:45:32.658108+0000","last_peered":"2024-09-17T05:45:32.658108+0000","last_clean":"2024-09-17T05:45:32.658108+0000","last_became_active":"2024-09-17T05:45:31.634306+0000","last_became_peered":"2024-09-17T05:45:31.634306+0000","last_unstale":"2024-09-17T05:45:32.658108+0000","last_undegraded":"2024-09-17T05:45:32.658108+0000","last_fullsized":"2024-09-17T05:45:32.658108+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:45:30.612191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:45:30.612191+0000","last_clean_scrub_stamp":"2024-09-17T05:45:30.612191+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:11:50.501779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1d","version":"0'0","reported_seq":10,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-17T05:45:32.643019+0000","last_change":"2024-09-17T05:45:32.634215+0000","last_active":"2024-09-17T05:45:32.643019+0000","last_peered":"2024-09-17T05:45:32.643019+0000","last_clean":"2024-09-17T05:45:32.643019+0000","last_became_active":"2024-09-17T05:45:32.633773+0000","last_became_peered":"2024-09-17T05:45:32.633773+0000","last_unstale":"2024-09-17T05:45:32.643019+0000","last_undegraded":"2024-09-17T05:45:32.643019+0000","last_fullsized":"2024-09-17T05:45:32.643019+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:45:31.614428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:45:31.614428+0000","last_clean_scrub_stamp":"2024-09-17T05:45:31.614428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:31:38.357082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-09-17T05:45:30.623018+0000","last_change":"2024-09-17T05:45:30.623018+0000","last_active":"2024-09-17T05:45:30.612191+0000","last_peered":"2024-09-17T05:45:30.612191+0000","last_clean":"2024-09-17T05:45:30.612191+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:45:30.623018+0000","last_undegraded":"2024-09-17T05:45:30.623018+0000","last_fullsized":"2024-09-17T05:45:30.623018+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:45:30.612191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:45:30.612191+0000","last_clean_scrub_stamp":"2024-09-17T05:45:30.612191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.1a","version":"0'0","reported_seq":1,"reported_epoch":58,"state":"creating+peering","last_fresh":"2024-09-17T05:45:31.634200+0000","last_change":"2024-09-17T05:45:31.634200+0000","last_active":"2024-09-17T05:45:31.614428+0000","last_peered":"2024-09-17T05:45:31.614428+0000","last_clean":"2024-09-17T05:45:31.614428+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:45:31.634200+0000","last_undegraded":"2024-09-17T05:45:31.634200+0000","last_fullsized":"2024-09-17T05:45:31.634200+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:45:31.614428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:45:31.614428+0000","last_clean_scrub_stamp":"2024-09-17T05:45:31.614428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-09-17T05:45:30.619692+0000","last_change":"2024-09-17T05:45:30.619692+0000","last_active":"2024-09-17T05:45:30.612191+0000","last_peered":"2024-09-17T05:45:30.612191+0000","last_clean":"2024-09-17T05:45:30.612191+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:45:30.619692+0000","last_undegraded":"2024-09-17T05:45:30.619692+0000","last_fullsized":"2024-09-17T05:45:30.619692+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:45:30.612191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:45:30.612191+0000","last_clean_scrub_stamp":"2024-09-17T05:45:30.612191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1b","version":"0'0","reported_seq":1,"reported_epoch":58,"state":"creating+peering","last_fresh":"2024-09-17T05:45:31.630970+0000","last_change":"2024-09-17T05:45:31.630970+0000","last_active":"2024-09-17T05:45:31.614428+0000","last_peered":"2024-09-17T05:45:31.614428+0000","last_clean":"2024-09-17T05:45:31.614428+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:45:31.630970+0000","last_undegraded":"2024-09-17T05:45:31.630970+0000","last_fullsized":"2024-09-17T05:45:31.630970+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:45:31.614428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:45:31.614428+0000","last_clean_scrub_stamp":"2024-09-17T05:45:31.614428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1a","version":"59'1","reported_seq":14,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-17T05:45:32.649523+0000","last_change":"2024-09-17T05:45:31.637200+0000","last_active":"2024-09-17T05:45:32.649523+0000","last_peered":"2024-09-17T05:45:32.649523+0000","last_clean":"2024-09-17T05:45:32.649523+0000","last_became_active":"2024-09-17T05:45:31.636713+0000","last_became_peered":"2024-09-17T05:45:31.636713+0000","last_unstale":"2024-09-17T05:45:32.649523+0000","last_undegraded":"2024-09-17T05:45:32.649523+0000","last_fullsized":"2024-09-17T05:45:32.649523+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:45:30.612191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:45:30.612191+0000","last_clean_scrub_stamp":"2024-09-17T05:45:30.612191+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:22:55.029575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":1,"reported_epoch":58,"state":"creating+peering","last_fresh":"2024-09-17T05:45:31.623504+0000","last_change":"2024-09-17T05:45:31.623504+0000","last_active":"2024-09-17T05:45:31.614428+0000","last_peered":"2024-09-17T05:45:31.614428+0000","last_clean":"2024-09-17T05:45:31.614428+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:45:31.623504+0000","last_undegraded":"2024-09-17T05:45:31.623504+0000","last_fullsized":"2024-09-17T05:45:31.623504+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:45:31.614428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:45:31.614428+0000","last_clean_scrub_stamp":"2024-09-17T05:45:31.614428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-09-17T05:45:30.621574+0000","last_change":"2024-09-17T05:45:30.621574+0000","last_active":"2024-09-17T05:45:30.612191+0000","last_peered":"2024-09-17T05:45:30.612191+0000","last_clean":"2024-09-17T05:45:30.612191+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:45:30.621574+0000","last_undegraded":"2024-09-17T05:45:30.621574+0000","last_fullsized":"2024-09-17T05:45:30.621574+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:45:30.612191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:45:30.612191+0000","last_clean_scrub_stamp":"2024-09-17T05:45:30.612191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":1,"reported_epoch":58,"state":"creating+peering","last_fresh":"2024-09-17T05:45:31.632251+0000","last_change":"2024-09-17T05:45:31.632251+0000","last_active":"2024-09-17T05:45:31.614428+0000","last_peered":"2024-09-17T05:45:31.614428+0000","last_clean":"2024-09-17T05:45:31.614428+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:45:31.632251+0000","last_undegraded":"2024-09-17T05:45:31.632251+0000","last_fullsized":"2024-09-17T05:45:31.632251+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:45:31.614428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:45:31.614428+0000","last_clean_scrub_stamp":"2024-09-17T05:45:31.614428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-09-17T05:45:30.619500+0000","last_change":"2024-09-17T05:45:30.619500+0000","last_active":"2024-09-17T05:45:30.612191+0000","last_peered":"2024-09-17T05:45:30.612191+0000","last_clean":"2024-09-17T05:45:30.612191+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:45:30.619500+0000","last_undegraded":"2024-09-17T05:45:30.619500+0000","last_fullsized":"2024-09-17T05:45:30.619500+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:45:30.612191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:45:30.612191+0000","last_clean_scrub_stamp":"2024-09-17T05:45:30.612191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:45:31.614428+0000","last_change":"2024-09-17T05:45:31.614428+0000","last_active":"2024-09-17T05:45:31.614428+0000","last_peered":"2024-09-17T05:45:31.614428+0000","last_clean":"2024-09-17T05:45:31.614428+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:45:31.614428+0000","last_undegraded":"2024-09-17T05:45:31.614428+0000","last_fullsized":"2024-09-17T05:45:31.614428+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:45:31.614428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:45:31.614428+0000","last_clean_scrub_stamp":"2024-09-17T05:45:31.614428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-09-17T05:45:30.624941+0000","last_change":"2024-09-17T05:45:30.624941+0000","last_active":"2024-09-17T05:45:30.612191+0000","last_peered":"2024-09-17T05:45:30.612191+0000","last_clean":"2024-09-17T05:45:30.612191+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:45:30.624941+0000","last_undegraded":"2024-09-17T05:45:30.624941+0000","last_fullsized":"2024-09-17T05:45:30.624941+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:45:30.612191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:45:30.612191+0000","last_clean_scrub_stamp":"2024-09-17T05:45:30.612191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:45:31.614428+0000","last_change":"2024-09-17T05:45:31.614428+0000","last_active":"2024-09-17T05:45:31.614428+0000","last_peered":"2024-09-17T05:45:31.614428+0000","last_clean":"2024-09-17T05:45:31.614428+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:45:31.614428+0000","last_undegraded":"2024-09-17T05:45:31.614428+0000","last_fullsized":"2024-09-17T05:45:31.614428+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:45:31.614428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:45:31.614428+0000","last_clean_scrub_stamp":"2024-09-17T05:45:31.614428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":10,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-17T05:45:31.643163+0000","last_change":"2024-09-17T05:45:31.640475+0000","last_active":"2024-09-17T05:45:31.643163+0000","last_peered":"2024-09-17T05:45:31.643163+0000","last_clean":"2024-09-17T05:45:31.643163+0000","last_became_active":"2024-09-17T05:45:31.640191+0000","last_became_peered":"2024-09-17T05:45:31.640191+0000","last_unstale":"2024-09-17T05:45:31.643163+0000","last_undegraded":"2024-09-17T05:45:31.643163+0000","last_fullsized":"2024-09-17T05:45:31.643163+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:45:30.612191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:45:30.612191+0000","last_clean_scrub_stamp":"2024-09-17T05:45:30.612191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:18:44.004602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.14","version":"0'0","reported_seq":1,"reported_epoch":58,"state":"creating+peering","last_fresh":"2024-09-17T05:45:31.627249+0000","last_change":"2024-09-17T05:45:31.627249+0000","last_active":"2024-09-17T05:45:31.614428+0000","last_peered":"2024-09-17T05:45:31.614428+0000","last_clean":"2024-09-17T05:45:31.614428+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:45:31.627249+0000","last_undegraded":"2024-09-17T05:45:31.627249+0000","last_fullsized":"2024-09-17T05:45:31.627249+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:45:31.614428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:45:31.614428+0000","last_clean_scrub_stamp":"2024-09-17T05:45:31.614428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-09-17T05:45:30.623630+0000","last_change":"2024-09-17T05:45:30.623630+0000","last_active":"2024-09-17T05:45:30.612191+0000","last_peered":"2024-09-17T05:45:30.612191+0000","last_clean":"2024-09-17T05:45:30.612191+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:45:30.623630+0000","last_undegraded":"2024-09-17T05:45:30.623630+0000","last_fullsized":"2024-09-17T05:45:30.623630+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:45:30.612191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:45:30.612191+0000","last_clean_scrub_stamp":"2024-09-17T05:45:30.612191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:45:31.614428+0000","last_change":"2024-09-17T05:45:31.614428+0000","last_active":"2024-09-17T05:45:31.614428+0000","last_peered":"2024-09-17T05:45:31.614428+0000","last_clean":"2024-09-17T05:45:31.614428+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:45:31.614428+0000","last_undegraded":"2024-09-17T05:45:31.614428+0000","last_fullsized":"2024-09-17T05:45:31.614428+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:45:31.614428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:45:31.614428+0000","last_clean_scrub_stamp":"2024-09-17T05:45:31.614428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-09-17T05:45:30.619517+0000","last_change":"2024-09-17T05:45:30.619517+0000","last_active":"2024-09-17T05:45:30.612191+0000","last_peered":"2024-09-17T05:45:30.612191+0000","last_clean":"2024-09-17T05:45:30.612191+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:45:30.619517+0000","last_undegraded":"2024-09-17T05:45:30.619517+0000","last_fullsized":"2024-09-17T05:45:30.619517+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:45:30.612191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:45:30.612191+0000","last_clean_scrub_stamp":"2024-09-17T05:45:30.612191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:45:31.614428+0000","last_change":"2024-09-17T05:45:31.614428+0000","last_active":"2024-09-17T05:45:31.614428+0000","last_peered":"2024-09-17T05:45:31.614428+0000","last_clean":"2024-09-17T05:45:31.614428+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:45:31.614428+0000","last_undegraded":"2024-09-17T05:45:31.614428+0000","last_fullsized":"2024-09-17T05:45:31.614428+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:45:31.614428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:45:31.614428+0000","last_clean_scrub_stamp":"2024-09-17T05:45:31.614428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":10,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-17T05:45:31.647136+0000","last_change":"2024-09-17T05:45:31.644303+0000","last_active":"2024-09-17T05:45:31.647136+0000","last_peered":"2024-09-17T05:45:31.647136+0000","last_clean":"2024-09-17T05:45:31.647136+0000","last_became_active":"2024-09-17T05:45:31.644011+0000","last_became_peered":"2024-09-17T05:45:31.644011+0000","last_unstale":"2024-09-17T05:45:31.647136+0000","last_undegraded":"2024-09-17T05:45:31.647136+0000","last_fullsized":"2024-09-17T05:45:31.647136+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:45:30.612191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:45:30.612191+0000","last_clean_scrub_stamp":"2024-09-17T05:45:30.612191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:57:52.826866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:45:31.614428+0000","last_change":"2024-09-17T05:45:31.614428+0000","last_active":"2024-09-17T05:45:31.614428+0000","last_peered":"2024-09-17T05:45:31.614428+0000","last_clean":"2024-09-17T05:45:31.614428+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:45:31.614428+0000","last_undegraded":"2024-09-17T05:45:31.614428+0000","last_fullsized":"2024-09-17T05:45:31.614428+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:45:31.614428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:45:31.614428+0000","last_clean_scrub_stamp":"2024-09-17T05:45:31.614428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":10,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-17T05:45:31.635300+0000","last_change":"2024-09-17T05:45:31.629800+0000","last_active":"2024-09-17T05:45:31.635300+0000","last_peered":"2024-09-17T05:45:31.635300+0000","last_clean":"2024-09-17T05:45:31.635300+0000","last_became_active":"2024-09-17T05:45:31.629475+0000","last_became_peered":"2024-09-17T05:45:31.629475+0000","last_unstale":"2024-09-17T05:45:31.635300+0000","last_undegraded":"2024-09-17T05:45:31.635300+0000","last_fullsized":"2024-09-17T05:45:31.635300+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:45:30.612191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:45:30.612191+0000","last_clean_scrub_stamp":"2024-09-17T05:45:30.612191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:26:33.564340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:45:31.614428+0000","last_change":"2024-09-17T05:45:31.614428+0000","last_active":"2024-09-17T05:45:31.614428+0000","last_peered":"2024-09-17T05:45:31.614428+0000","last_clean":"2024-09-17T05:45:31.614428+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:45:31.614428+0000","last_undegraded":"2024-09-17T05:45:31.614428+0000","last_fullsized":"2024-09-17T05:45:31.614428+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:45:31.614428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:45:31.614428+0000","last_clean_scrub_stamp":"2024-09-17T05:45:31.614428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-09-17T05:45:30.620814+0000","last_change":"2024-09-17T05:45:30.620814+0000","last_active":"2024-09-17T05:45:30.612191+0000","last_peered":"2024-09-17T05:45:30.612191+0000","last_clean":"2024-09-17T05:45:30.612191+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:45:30.620814+0000","last_undegraded":"2024-09-17T05:45:30.620814+0000","last_fullsized":"2024-09-17T05:45:30.620814+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:45:30.612191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:45:30.612191+0000","last_clean_scrub_stamp":"2024-09-17T05:45:30.612191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:45:31.614428+0000","last_change":"2024-09-17T05:45:31.614428+0000","last_active":"2024-09-17T05:45:31.614428+0000","last_peered":"2024-09-17T05:45:31.614428+0000","last_clean":"2024-09-17T05:45:31.614428+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:45:31.614428+0000","last_undegraded":"2024-09-17T05:45:31.614428+0000","last_fullsized":"2024-09-17T05:45:31.614428+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:45:31.614428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:45:31.614428+0000","last_clean_scrub_stamp":"2024-09-17T05:45:31.614428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-09-17T05:45:30.623922+0000","last_change":"2024-09-17T05:45:30.623922+0000","last_active":"2024-09-17T05:45:30.612191+0000","last_peered":"2024-09-17T05:45:30.612191+0000","last_clean":"2024-09-17T05:45:30.612191+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:45:30.623922+0000","last_undegraded":"2024-09-17T05:45:30.623922+0000","last_fullsized":"2024-09-17T05:45:30.623922+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:45:30.612191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:45:30.612191+0000","last_clean_scrub_stamp":"2024-09-17T05:45:30.612191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:45:31.614428+0000","last_change":"2024-09-17T05:45:31.614428+0000","last_active":"2024-09-17T05:45:31.614428+0000","last_peered":"2024-09-17T05:45:31.614428+0000","last_clean":"2024-09-17T05:45:31.614428+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:45:31.614428+0000","last_undegraded":"2024-09-17T05:45:31.614428+0000","last_fullsized":"2024-09-17T05:45:31.614428+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:45:31.614428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:45:31.614428+0000","last_clean_scrub_stamp":"2024-09-17T05:45:31.614428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":10,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-17T05:45:31.643225+0000","last_change":"2024-09-17T05:45:31.640449+0000","last_active":"2024-09-17T05:45:31.643225+0000","last_peered":"2024-09-17T05:45:31.643225+0000","last_clean":"2024-09-17T05:45:31.643225+0000","last_became_active":"2024-09-17T05:45:31.640151+0000","last_became_peered":"2024-09-17T05:45:31.640151+0000","last_unstale":"2024-09-17T05:45:31.643225+0000","last_undegraded":"2024-09-17T05:45:31.643225+0000","last_fullsized":"2024-09-17T05:45:31.643225+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:45:30.612191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:45:30.612191+0000","last_clean_scrub_stamp":"2024-09-17T05:45:30.612191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:45:55.100047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:45:31.614428+0000","last_change":"2024-09-17T05:45:31.614428+0000","last_active":"2024-09-17T05:45:31.614428+0000","last_peered":"2024-09-17T05:45:31.614428+0000","last_clean":"2024-09-17T05:45:31.614428+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:45:31.614428+0000","last_undegraded":"2024-09-17T05:45:31.614428+0000","last_fullsized":"2024-09-17T05:45:31.614428+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:45:31.614428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:45:31.614428+0000","last_clean_scrub_stamp":"2024-09-17T05:45:31.614428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.e","version":"59'2","reported_seq":15,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-17T05:45:32.657557+0000","last_change":"2024-09-17T05:45:31.640980+0000","last_active":"2024-09-17T05:45:32.657557+0000","last_peered":"2024-09-17T05:45:32.657557+0000","last_clean":"2024-09-17T05:45:32.657557+0000","last_became_active":"2024-09-17T05:45:31.640679+0000","last_became_peered":"2024-09-17T05:45:31.640679+0000","last_unstale":"2024-09-17T05:45:32.657557+0000","last_undegraded":"2024-09-17T05:45:32.657557+0000","last_fullsized":"2024-09-17T05:45:32.657557+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:45:30.612191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:45:30.612191+0000","last_clean_scrub_stamp":"2024-09-17T05:45:30.612191+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:10:04.148047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":1,"reported_epoch":58,"state":"creating+peering","last_fresh":"2024-09-17T05:45:31.626776+0000","last_change":"2024-09-17T05:45:31.626776+0000","last_active":"2024-09-17T05:45:31.614428+0000","last_peered":"2024-09-17T05:45:31.614428+0000","last_clean":"2024-09-17T05:45:31.614428+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:45:31.626776+0000","last_undegraded":"2024-09-17T05:45:31.626776+0000","last_fullsized":"2024-09-17T05:45:31.626776+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:45:31.614428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:45:31.614428+0000","last_clean_scrub_stamp":"2024-09-17T05:45:31.614428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-09-17T05:45:30.620812+0000","last_change":"2024-09-17T05:45:30.620812+0000","last_active":"2024-09-17T05:45:30.612191+0000","last_peered":"2024-09-17T05:45:30.612191+0000","last_clean":"2024-09-17T05:45:30.612191+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:45:30.620812+0000","last_undegraded":"2024-09-17T05:45:30.620812+0000","last_fullsized":"2024-09-17T05:45:30.620812+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:45:30.612191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:45:30.612191+0000","last_clean_scrub_stamp":"2024-09-17T05:45:30.612191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:45:31.614428+0000","last_change":"2024-09-17T05:45:31.614428+0000","last_active":"2024-09-17T05:45:31.614428+0000","last_peered":"2024-09-17T05:45:31.614428+0000","last_clean":"2024-09-17T05:45:31.614428+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:45:31.614428+0000","last_undegraded":"2024-09-17T05:45:31.614428+0000","last_fullsized":"2024-09-17T05:45:31.614428+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:45:31.614428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:45:31.614428+0000","last_clean_scrub_stamp":"2024-09-17T05:45:31.614428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":13,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-17T05:45:32.624746+0000","last_change":"2024-09-17T05:45:31.643975+0000","last_active":"2024-09-17T05:45:32.624746+0000","last_peered":"2024-09-17T05:45:32.624746+0000","last_clean":"2024-09-17T05:45:32.624746+0000","last_became_active":"2024-09-17T05:45:31.643609+0000","last_became_peered":"2024-09-17T05:45:31.643609+0000","last_unstale":"2024-09-17T05:45:32.624746+0000","last_undegraded":"2024-09-17T05:45:32.624746+0000","last_fullsized":"2024-09-17T05:45:32.624746+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:45:30.612191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:45:30.612191+0000","last_clean_scrub_stamp":"2024-09-17T05:45:30.612191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:49:10.450094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:45:31.614428+0000","last_change":"2024-09-17T05:45:31.614428+0000","last_active":"2024-09-17T05:45:31.614428+0000","last_peered":"2024-09-17T05:45:31.614428+0000","last_clean":"2024-09-17T05:45:31.614428+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:45:31.614428+0000","last_undegraded":"2024-09-17T05:45:31.614428+0000","last_fullsized":"2024-09-17T05:45:31.614428+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:45:31.614428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:45:31.614428+0000","last_clean_scrub_stamp":"2024-09-17T05:45:31.614428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":10,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-17T05:45:31.643026+0000","last_change":"2024-09-17T05:45:31.638240+0000","last_active":"2024-09-17T05:45:31.643026+0000","last_peered":"2024-09-17T05:45:31.643026+0000","last_clean":"2024-09-17T05:45:31.643026+0000","last_became_active":"2024-09-17T05:45:31.637885+0000","last_became_peered":"2024-09-17T05:45:31.637885+0000","last_unstale":"2024-09-17T05:45:31.643026+0000","last_undegraded":"2024-09-17T05:45:31.643026+0000","last_fullsized":"2024-09-17T05:45:31.643026+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:45:30.612191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:45:30.612191+0000","last_clean_scrub_stamp":"2024-09-17T05:45:30.612191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:42:29.350273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.b","version":"0'0","reported_seq":10,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-17T05:45:32.650606+0000","last_change":"2024-09-17T05:45:32.646091+0000","last_active":"2024-09-17T05:45:32.650606+0000","last_peered":"2024-09-17T05:45:32.650606+0000","last_clean":"2024-09-17T05:45:32.650606+0000","last_became_active":"2024-09-17T05:45:32.645766+0000","last_became_peered":"2024-09-17T05:45:32.645766+0000","last_unstale":"2024-09-17T05:45:32.650606+0000","last_undegraded":"2024-09-17T05:45:32.650606+0000","last_fullsized":"2024-09-17T05:45:32.650606+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:45:31.614428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:45:31.614428+0000","last_clean_scrub_stamp":"2024-09-17T05:45:31.614428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:41:42.920657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":10,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-17T05:45:31.642057+0000","last_change":"2024-09-17T05:45:31.640272+0000","last_active":"2024-09-17T05:45:31.642057+0000","last_peered":"2024-09-17T05:45:31.642057+0000","last_clean":"2024-09-17T05:45:31.642057+0000","last_became_active":"2024-09-17T05:45:31.639976+0000","last_became_peered":"2024-09-17T05:45:31.639976+0000","last_unstale":"2024-09-17T05:45:31.642057+0000","last_undegraded":"2024-09-17T05:45:31.642057+0000","last_fullsized":"2024-09-17T05:45:31.642057+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:45:30.612191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:45:30.612191+0000","last_clean_scrub_stamp":"2024-09-17T05:45:30.612191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:58:52.331715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":10,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-17T05:45:32.655188+0000","last_change":"2024-09-17T05:45:32.651035+0000","last_active":"2024-09-17T05:45:32.655188+0000","last_peered":"2024-09-17T05:45:32.655188+0000","last_clean":"2024-09-17T05:45:32.655188+0000","last_became_active":"2024-09-17T05:45:32.650692+0000","last_became_peered":"2024-09-17T05:45:32.650692+0000","last_unstale":"2024-09-17T05:45:32.655188+0000","last_undegraded":"2024-09-17T05:45:32.655188+0000","last_fullsized":"2024-09-17T05:45:32.655188+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:45:31.614428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:45:31.614428+0000","last_clean_scrub_stamp":"2024-09-17T05:45:31.614428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:20:10.605318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-09-17T05:45:30.621379+0000","last_change":"2024-09-17T05:45:30.621379+0000","last_active":"2024-09-17T05:45:30.612191+0000","last_peered":"2024-09-17T05:45:30.612191+0000","last_clean":"2024-09-17T05:45:30.612191+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:45:30.621379+0000","last_undegraded":"2024-09-17T05:45:30.621379+0000","last_fullsized":"2024-09-17T05:45:30.621379+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:45:30.612191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:45:30.612191+0000","last_clean_scrub_stamp":"2024-09-17T05:45:30.612191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:45:31.614428+0000","last_change":"2024-09-17T05:45:31.614428+0000","last_active":"2024-09-17T05:45:31.614428+0000","last_peered":"2024-09-17T05:45:31.614428+0000","last_clean":"2024-09-17T05:45:31.614428+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:45:31.614428+0000","last_undegraded":"2024-09-17T05:45:31.614428+0000","last_fullsized":"2024-09-17T05:45:31.614428+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:45:31.614428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:45:31.614428+0000","last_clean_scrub_stamp":"2024-09-17T05:45:31.614428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":10,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-17T05:45:31.641974+0000","last_change":"2024-09-17T05:45:31.636162+0000","last_active":"2024-09-17T05:45:31.641974+0000","last_peered":"2024-09-17T05:45:31.641974+0000","last_clean":"2024-09-17T05:45:31.641974+0000","last_became_active":"2024-09-17T05:45:31.635754+0000","last_became_peered":"2024-09-17T05:45:31.635754+0000","last_unstale":"2024-09-17T05:45:31.641974+0000","last_undegraded":"2024-09-17T05:45:31.641974+0000","last_fullsized":"2024-09-17T05:45:31.641974+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:45:30.612191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:45:30.612191+0000","last_clean_scrub_stamp":"2024-09-17T05:45:30.612191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:48:28.932032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:45:31.614428+0000","last_change":"2024-09-17T05:45:31.614428+0000","last_active":"2024-09-17T05:45:31.614428+0000","last_peered":"2024-09-17T05:45:31.614428+0000","last_clean":"2024-09-17T05:45:31.614428+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:45:31.614428+0000","last_undegraded":"2024-09-17T05:45:31.614428+0000","last_fullsized":"2024-09-17T05:45:31.614428+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:45:31.614428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:45:31.614428+0000","last_clean_scrub_stamp":"2024-09-17T05:45:31.614428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":13,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-17T05:45:32.626208+0000","last_change":"2024-09-17T05:45:31.639739+0000","last_active":"2024-09-17T05:45:32.626208+0000","last_peered":"2024-09-17T05:45:32.626208+0000","last_clean":"2024-09-17T05:45:32.626208+0000","last_became_active":"2024-09-17T05:45:31.639123+0000","last_became_peered":"2024-09-17T05:45:31.639123+0000","last_unstale":"2024-09-17T05:45:32.626208+0000","last_undegraded":"2024-09-17T05:45:32.626208+0000","last_fullsized":"2024-09-17T05:45:32.626208+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:45:30.612191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:45:30.612191+0000","last_clean_scrub_stamp":"2024-09-17T05:45:30.612191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:47:45.086586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":1,"reported_epoch":58,"state":"creating+peering","last_fresh":"2024-09-17T05:45:31.626771+0000","last_change":"2024-09-17T05:45:31.626771+0000","last_active":"2024-09-17T05:45:31.614428+0000","last_peered":"2024-09-17T05:45:31.614428+0000","last_clean":"2024-09-17T05:45:31.614428+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:45:31.626771+0000","last_undegraded":"2024-09-17T05:45:31.626771+0000","last_fullsized":"2024-09-17T05:45:31.626771+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:45:31.614428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:45:31.614428+0000","last_clean_scrub_stamp":"2024-09-17T05:45:31.614428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":10,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-17T05:45:31.637530+0000","last_change":"2024-09-17T05:45:31.636335+0000","last_active":"2024-09-17T05:45:31.637530+0000","last_peered":"2024-09-17T05:45:31.637530+0000","last_clean":"2024-09-17T05:45:31.637530+0000","last_became_active":"2024-09-17T05:45:31.635851+0000","last_became_peered":"2024-09-17T05:45:31.635851+0000","last_unstale":"2024-09-17T05:45:31.637530+0000","last_undegraded":"2024-09-17T05:45:31.637530+0000","last_fullsized":"2024-09-17T05:45:31.637530+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:45:30.612191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:45:30.612191+0000","last_clean_scrub_stamp":"2024-09-17T05:45:30.612191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:39:41.148406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":10,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-17T05:45:32.643047+0000","last_change":"2024-09-17T05:45:32.634960+0000","last_active":"2024-09-17T05:45:32.643047+0000","last_peered":"2024-09-17T05:45:32.643047+0000","last_clean":"2024-09-17T05:45:32.643047+0000","last_became_active":"2024-09-17T05:45:32.634609+0000","last_became_peered":"2024-09-17T05:45:32.634609+0000","last_unstale":"2024-09-17T05:45:32.643047+0000","last_undegraded":"2024-09-17T05:45:32.643047+0000","last_fullsized":"2024-09-17T05:45:32.643047+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:45:31.614428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:45:31.614428+0000","last_clean_scrub_stamp":"2024-09-17T05:45:31.614428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:41:03.714251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-09-17T05:45:30.622035+0000","last_change":"2024-09-17T05:45:30.622035+0000","last_active":"2024-09-17T05:45:30.612191+0000","last_peered":"2024-09-17T05:45:30.612191+0000","last_clean":"2024-09-17T05:45:30.612191+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:45:30.622035+0000","last_undegraded":"2024-09-17T05:45:30.622035+0000","last_fullsized":"2024-09-17T05:45:30.622035+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:45:30.612191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:45:30.612191+0000","last_clean_scrub_stamp":"2024-09-17T05:45:30.612191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":1,"reported_epoch":58,"state":"creating+peering","last_fresh":"2024-09-17T05:45:31.633719+0000","last_change":"2024-09-17T05:45:31.633719+0000","last_active":"2024-09-17T05:45:31.614428+0000","last_peered":"2024-09-17T05:45:31.614428+0000","last_clean":"2024-09-17T05:45:31.614428+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:45:31.633719+0000","last_undegraded":"2024-09-17T05:45:31.633719+0000","last_fullsized":"2024-09-17T05:45:31.633719+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:45:31.614428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:45:31.614428+0000","last_clean_scrub_stamp":"2024-09-17T05:45:31.614428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":10,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-17T05:45:31.642891+0000","last_change":"2024-09-17T05:45:31.640803+0000","last_active":"2024-09-17T05:45:31.642891+0000","last_peered":"2024-09-17T05:45:31.642891+0000","last_clean":"2024-09-17T05:45:31.642891+0000","last_became_active":"2024-09-17T05:45:31.640497+0000","last_became_peered":"2024-09-17T05:45:31.640497+0000","last_unstale":"2024-09-17T05:45:31.642891+0000","last_undegraded":"2024-09-17T05:45:31.642891+0000","last_fullsized":"2024-09-17T05:45:31.642891+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:45:30.612191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:45:30.612191+0000","last_clean_scrub_stamp":"2024-09-17T05:45:30.612191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:43:30.388415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:45:31.614428+0000","last_change":"2024-09-17T05:45:31.614428+0000","last_active":"2024-09-17T05:45:31.614428+0000","last_peered":"2024-09-17T05:45:31.614428+0000","last_clean":"2024-09-17T05:45:31.614428+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:45:31.614428+0000","last_undegraded":"2024-09-17T05:45:31.614428+0000","last_fullsized":"2024-09-17T05:45:31.614428+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:45:31.614428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:45:31.614428+0000","last_clean_scrub_stamp":"2024-09-17T05:45:31.614428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-09-17T05:45:30.619500+0000","last_change":"2024-09-17T05:45:30.619500+0000","last_active":"2024-09-17T05:45:30.612191+0000","last_peered":"2024-09-17T05:45:30.612191+0000","last_clean":"2024-09-17T05:45:30.612191+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:45:30.619500+0000","last_undegraded":"2024-09-17T05:45:30.619500+0000","last_fullsized":"2024-09-17T05:45:30.619500+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:45:30.612191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:45:30.612191+0000","last_clean_scrub_stamp":"2024-09-17T05:45:30.612191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":1,"reported_epoch":58,"state":"creating+peering","last_fresh":"2024-09-17T05:45:31.626880+0000","last_change":"2024-09-17T05:45:31.626880+0000","last_active":"2024-09-17T05:45:31.614428+0000","last_peered":"2024-09-17T05:45:31.614428+0000","last_clean":"2024-09-17T05:45:31.614428+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:45:31.626880+0000","last_undegraded":"2024-09-17T05:45:31.626880+0000","last_fullsized":"2024-09-17T05:45:31.626880+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:45:31.614428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:45:31.614428+0000","last_clean_scrub_stamp":"2024-09-17T05:45:31.614428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":10,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-17T05:45:31.641182+0000","last_change":"2024-09-17T05:45:31.637639+0000","last_active":"2024-09-17T05:45:31.641182+0000","last_peered":"2024-09-17T05:45:31.641182+0000","last_clean":"2024-09-17T05:45:31.641182+0000","last_became_active":"2024-09-17T05:45:31.637329+0000","last_became_peered":"2024-09-17T05:45:31.637329+0000","last_unstale":"2024-09-17T05:45:31.641182+0000","last_undegraded":"2024-09-17T05:45:31.641182+0000","last_fullsized":"2024-09-17T05:45:31.641182+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:45:30.612191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:45:30.612191+0000","last_clean_scrub_stamp":"2024-09-17T05:45:30.612191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:36:40.603886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":1,"reported_epoch":58,"state":"creating+peering","last_fresh":"2024-09-17T05:45:31.627608+0000","last_change":"2024-09-17T05:45:31.627608+0000","last_active":"2024-09-17T05:45:31.614428+0000","last_peered":"2024-09-17T05:45:31.614428+0000","last_clean":"2024-09-17T05:45:31.614428+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:45:31.627608+0000","last_undegraded":"2024-09-17T05:45:31.627608+0000","last_fullsized":"2024-09-17T05:45:31.627608+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:45:31.614428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:45:31.614428+0000","last_clean_scrub_stamp":"2024-09-17T05:45:31.614428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":10,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-17T05:45:31.643206+0000","last_change":"2024-09-17T05:45:31.639583+0000","last_active":"2024-09-17T05:45:31.643206+0000","last_peered":"2024-09-17T05:45:31.643206+0000","last_clean":"2024-09-17T05:45:31.643206+0000","last_became_active":"2024-09-17T05:45:31.639274+0000","last_became_peered":"2024-09-17T05:45:31.639274+0000","last_unstale":"2024-09-17T05:45:31.643206+0000","last_undegraded":"2024-09-17T05:45:31.643206+0000","last_fullsized":"2024-09-17T05:45:31.643206+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:45:30.612191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:45:30.612191+0000","last_clean_scrub_stamp":"2024-09-17T05:45:30.612191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:32:10.295673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":1,"reported_epoch":58,"state":"creating+peering","last_fresh":"2024-09-17T05:45:31.626798+0000","last_change":"2024-09-17T05:45:31.626798+0000","last_active":"2024-09-17T05:45:31.614428+0000","last_peered":"2024-09-17T05:45:31.614428+0000","last_clean":"2024-09-17T05:45:31.614428+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:45:31.626798+0000","last_undegraded":"2024-09-17T05:45:31.626798+0000","last_fullsized":"2024-09-17T05:45:31.626798+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:45:31.614428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:45:31.614428+0000","last_clean_scrub_stamp":"2024-09-17T05:45:31.614428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":10,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-17T05:45:31.641653+0000","last_change":"2024-09-17T05:45:31.639879+0000","last_active":"2024-09-17T05:45:31.641653+0000","last_peered":"2024-09-17T05:45:31.641653+0000","last_clean":"2024-09-17T05:45:31.641653+0000","last_became_active":"2024-09-17T05:45:31.639553+0000","last_became_peered":"2024-09-17T05:45:31.639553+0000","last_unstale":"2024-09-17T05:45:31.641653+0000","last_undegraded":"2024-09-17T05:45:31.641653+0000","last_fullsized":"2024-09-17T05:45:31.641653+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:45:30.612191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:45:30.612191+0000","last_clean_scrub_stamp":"2024-09-17T05:45:30.612191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:06:24.325125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"19'72","reported_seq":172,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-17T05:45:30.625294+0000","last_change":"2024-09-17T05:41:48.539830+0000","last_active":"2024-09-17T05:45:30.625294+0000","last_peered":"2024-09-17T05:45:30.625294+0000","last_clean":"2024-09-17T05:45:30.625294+0000","last_became_active":"2024-09-17T05:41:48.538743+0000","last_became_peered":"2024-09-17T05:41:48.538743+0000","last_unstale":"2024-09-17T05:45:30.625294+0000","last_undegraded":"2024-09-17T05:45:30.625294+0000","last_fullsized":"2024-09-17T05:45:30.625294+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:47.152539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:47.152539+0000","last_clean_scrub_stamp":"2024-09-17T05:41:47.152539+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:08:02.952016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":9,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":76,"acting":76,"num_store_stats":5},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2194,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":9,"ondisk_log_size":9,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":16,"seq":68719476786,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40180,"kb_used_data":672,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331660,"statfs":{"total":96636764160,"available":96595619840,"internally_reserved":0,"allocated":688128,"data_stored":282523,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":40434118},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":7,"up_from":15,"seq":64424509490,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36588,"kb_used_data":1240,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335252,"statfs":{"total":96636764160,"available":96599298048,"internally_reserved":0,"allocated":1269760,"data_stored":866596,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":36174282},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509489,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36008,"kb_used_data":660,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335832,"statfs":{"total":96636764160,"available":96599891968,"internally_reserved":0,"allocated":675840,"data_stored":276228,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509489,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":54060,"kb_used_data":660,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94317780,"statfs":{"total":96636764160,"available":96581406720,"internally_reserved":0,"allocated":675840,"data_stored":276228,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509489,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":54068,"kb_used_data":672,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94317772,"statfs":{"total":96636764160,"available":96581398528,"internally_reserved":0,"allocated":688128,"data_stored":282523,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":54655431},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509489,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36020,"kb_used_data":672,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335820,"statfs":{"total":96636764160,"available":96599879680,"internally_reserved":0,"allocated":688128,"data_stored":282523,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509489,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":54064,"kb_used_data":660,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94317776,"statfs":{"total":96636764160,"available":96581402624,"internally_reserved":0,"allocated":675840,"data_stored":276228,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574897,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":54684,"kb_used_data":1280,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94317156,"statfs":{"total":96636764160,"available":96580767744,"internally_reserved":0,"allocated":1310720,"data_stored":881888,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2194,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-17T05:45:36.660 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-17T05:45:36.806 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:36.804+0000 7fdd84169640 1 -- 172.21.15.150:0/1401016963 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fdd7c0cd8f0 msgr2=0x7fdd7c15c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:45:36.806 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:36.804+0000 7fdd84169640 1 --2- 172.21.15.150:0/1401016963 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fdd7c0cd8f0 0x7fdd7c15c5a0 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7fdd7c074170 tx=0x7fdd7402aac0 comp rx=0 tx=0).stop 2024-09-17T05:45:36.806 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:36.804+0000 7fdd84169640 1 -- 172.21.15.150:0/1401016963 shutdown_connections 2024-09-17T05:45:36.807 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:36.804+0000 7fdd84169640 1 --2- 172.21.15.150:0/1401016963 >> v2:172.21.15.176:3300/0 conn(0x7fdd7c06d4b0 0x7fdd7c15c060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:36.807 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:36.804+0000 7fdd84169640 1 --2- 172.21.15.150:0/1401016963 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fdd7c0cd8f0 0x7fdd7c15c5a0 unknown :-1 s=CLOSED pgs=636 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:36.807 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:36.804+0000 7fdd84169640 1 -- 172.21.15.150:0/1401016963 >> 172.21.15.150:0/1401016963 conn(0x7fdd7c0b2fd0 msgr2=0x7fdd7c0b33e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:45:36.807 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:36.804+0000 7fdd84169640 1 -- 172.21.15.150:0/1401016963 shutdown_connections 2024-09-17T05:45:36.807 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:36.804+0000 7fdd84169640 1 -- 172.21.15.150:0/1401016963 wait complete. 2024-09-17T05:45:36.807 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:36.806+0000 7fdd84169640 1 Processor -- start 2024-09-17T05:45:36.808 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:36.806+0000 7fdd84169640 1 -- start start 2024-09-17T05:45:36.810 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:36.807+0000 7fdd84169640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fdd7c0b2360 0x7fdd7c1e4260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:45:36.810 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:36.807+0000 7fdd84169640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fdd7c0cd8f0 0x7fdd7c1f6860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:45:36.810 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:36.807+0000 7fdd84169640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fdd7c1e47a0 0x7fdd7c1f6da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:45:36.811 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:36.807+0000 7fdd84169640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7fdd7c0b5000 con 0x7fdd7c0cd8f0 2024-09-17T05:45:36.811 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:36.807+0000 7fdd84169640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fdd7c0b4e80 con 0x7fdd7c0b2360 2024-09-17T05:45:36.811 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:36.807+0000 7fdd84169640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fdd7c0b5180 con 0x7fdd7c1e47a0 2024-09-17T05:45:36.811 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:36.808+0000 7fdd81704640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fdd7c0cd8f0 0x7fdd7c1f6860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:45:36.811 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:36.808+0000 7fdd81704640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fdd7c0cd8f0 0x7fdd7c1f6860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:39302/0 (socket says 172.21.15.150:39302) 2024-09-17T05:45:36.811 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:36.808+0000 7fdd81704640 1 -- 172.21.15.150:0/369944280 learned_addr learned my addr 172.21.15.150:0/369944280 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:45:36.811 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:36.808+0000 7fdd82706640 1 --2- 172.21.15.150:0/369944280 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fdd7c1e47a0 0x7fdd7c1f6da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:45:36.812 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:36.808+0000 7fdd81f05640 1 --2- 172.21.15.150:0/369944280 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fdd7c0b2360 0x7fdd7c1e4260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:45:36.812 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:36.808+0000 7fdd81704640 1 -- 172.21.15.150:0/369944280 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fdd7c1e47a0 msgr2=0x7fdd7c1f6da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:45:36.812 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:36.808+0000 7fdd81704640 1 --2- 172.21.15.150:0/369944280 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fdd7c1e47a0 0x7fdd7c1f6da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:36.812 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:36.808+0000 7fdd81704640 1 -- 172.21.15.150:0/369944280 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fdd7c0b2360 msgr2=0x7fdd7c1e4260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:45:36.812 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:36.808+0000 7fdd81704640 1 --2- 172.21.15.150:0/369944280 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fdd7c0b2360 0x7fdd7c1e4260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:36.812 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:36.808+0000 7fdd81704640 1 -- 172.21.15.150:0/369944280 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdd7c153270 con 0x7fdd7c0cd8f0 2024-09-17T05:45:36.812 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:36.808+0000 7fdd81704640 1 --2- 172.21.15.150:0/369944280 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fdd7c0cd8f0 0x7fdd7c1f6860 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7fdd6c00d770 tx=0x7fdd6c00dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:45:36.812 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:36.808+0000 7fdd727fc640 1 -- 172.21.15.150:0/369944280 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd6c017070 con 0x7fdd7c0cd8f0 2024-09-17T05:45:36.812 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:36.808+0000 7fdd727fc640 1 -- 172.21.15.150:0/369944280 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fdd6c009d20 con 0x7fdd7c0cd8f0 2024-09-17T05:45:36.812 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:36.808+0000 7fdd84169640 1 -- 172.21.15.150:0/369944280 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdd7c153530 con 0x7fdd7c0cd8f0 2024-09-17T05:45:36.812 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:36.808+0000 7fdd727fc640 1 -- 172.21.15.150:0/369944280 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd6c0106c0 con 0x7fdd7c0cd8f0 2024-09-17T05:45:36.813 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:36.808+0000 7fdd84169640 1 -- 172.21.15.150:0/369944280 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdd7c153af0 con 0x7fdd7c0cd8f0 2024-09-17T05:45:36.813 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:36.809+0000 7fdd84169640 1 -- 172.21.15.150:0/369944280 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdd7c15c060 con 0x7fdd7c0cd8f0 2024-09-17T05:45:36.814 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:36.810+0000 7fdd727fc640 1 -- 172.21.15.150:0/369944280 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 15) ==== 102257+0+0 (secure 0 0 0) 0x7fdd6c01a070 con 0x7fdd7c0cd8f0 2024-09-17T05:45:36.814 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:36.811+0000 7fdd727fc640 1 --2- 172.21.15.150:0/369944280 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fdd60079490 0x7fdd6007b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:45:36.814 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:36.811+0000 7fdd727fc640 1 -- 172.21.15.150:0/369944280 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(60..60 src has 1..60) ==== 5737+0+0 (secure 0 0 0) 0x7fdd6c099670 con 0x7fdd7c0cd8f0 2024-09-17T05:45:36.814 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:36.811+0000 7fdd81f05640 1 --2- 172.21.15.150:0/369944280 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fdd60079490 0x7fdd6007b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:45:36.814 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:36.811+0000 7fdd81f05640 1 --2- 172.21.15.150:0/369944280 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fdd60079490 0x7fdd6007b9a0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fdd78000f60 tx=0x7fdd78009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:45:36.817 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:36.815+0000 7fdd727fc640 1 -- 172.21.15.150:0/369944280 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fdd6c062f10 con 0x7fdd7c0cd8f0 2024-09-17T05:45:36.992 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:36.990+0000 7fdd84169640 1 -- 172.21.15.150:0/369944280 --> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fdd7c0b3ea0 con 0x7fdd60079490 2024-09-17T05:45:36.997 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:36.995+0000 7fdd727fc640 1 -- 172.21.15.150:0/369944280 <== mgr.4108 v2:172.21.15.176:6800/3631216395 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+250141 (secure 0 0 0) 0x7fdd7c0b3ea0 con 0x7fdd60079490 2024-09-17T05:45:36.999 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-09-17T05:45:37.001 INFO:teuthology.orchestra.run.smithi150.stderr:dumped all 2024-09-17T05:45:37.002 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:36.998+0000 7fdd84169640 1 -- 172.21.15.150:0/369944280 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fdd60079490 msgr2=0x7fdd6007b9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:45:37.002 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:36.998+0000 7fdd84169640 1 --2- 172.21.15.150:0/369944280 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fdd60079490 0x7fdd6007b9a0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fdd78000f60 tx=0x7fdd78009040 comp rx=0 tx=0).stop 2024-09-17T05:45:37.002 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:36.998+0000 7fdd84169640 1 -- 172.21.15.150:0/369944280 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fdd7c0cd8f0 msgr2=0x7fdd7c1f6860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:45:37.002 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:36.998+0000 7fdd84169640 1 --2- 172.21.15.150:0/369944280 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fdd7c0cd8f0 0x7fdd7c1f6860 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7fdd6c00d770 tx=0x7fdd6c00dc30 comp rx=0 tx=0).stop 2024-09-17T05:45:37.003 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:36.998+0000 7fdd84169640 1 -- 172.21.15.150:0/369944280 shutdown_connections 2024-09-17T05:45:37.003 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:36.998+0000 7fdd84169640 1 --2- 172.21.15.150:0/369944280 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fdd60079490 0x7fdd6007b9a0 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:37.003 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:36.998+0000 7fdd84169640 1 --2- 172.21.15.150:0/369944280 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fdd7c1e47a0 0x7fdd7c1f6da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:37.003 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:36.998+0000 7fdd84169640 1 --2- 172.21.15.150:0/369944280 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fdd7c0cd8f0 0x7fdd7c1f6860 unknown :-1 s=CLOSED pgs=637 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:37.003 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:36.998+0000 7fdd84169640 1 --2- 172.21.15.150:0/369944280 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fdd7c0b2360 0x7fdd7c1e4260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:37.003 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:36.998+0000 7fdd84169640 1 -- 172.21.15.150:0/369944280 >> 172.21.15.150:0/369944280 conn(0x7fdd7c0b2fd0 msgr2=0x7fdd7c068e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:45:37.003 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:36.998+0000 7fdd84169640 1 -- 172.21.15.150:0/369944280 shutdown_connections 2024-09-17T05:45:37.003 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:36.998+0000 7fdd84169640 1 -- 172.21.15.150:0/369944280 wait complete. 2024-09-17T05:45:37.011 INFO:teuthology.orchestra.run.smithi150.stdout:{"pg_ready":true,"pg_map":{"version":170,"stamp":"2024-09-17T05:45:36.909116+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592722,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":140,"num_write_kb":1634,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":104,"ondisk_log_size":104,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":108,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":365848,"kb_used_data":6692,"kb_used_omap":12,"kb_used_meta":358963,"kb_avail":754608872,"statfs":{"total":773094113280,"available":772719484928,"internally_reserved":0,"allocated":6852608,"data_stored":3504955,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":367578672},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":27,"apply_latency_ms":27,"commit_latency_ns":27000000,"apply_latency_ns":27000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2354,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":39,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001502"},"pg_stats":[{"pgid":"9.3f","version":"0'0","reported_seq":1,"reported_epoch":58,"state":"creating+peering","last_fresh":"2024-09-17T05:45:31.635800+0000","last_change":"2024-09-17T05:45:31.635800+0000","last_active":"2024-09-17T05:45:31.614428+0000","last_peered":"2024-09-17T05:45:31.614428+0000","last_clean":"2024-09-17T05:45:31.614428+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:45:31.635800+0000","last_undegraded":"2024-09-17T05:45:31.635800+0000","last_fullsized":"2024-09-17T05:45:31.635800+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:45:31.614428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:45:31.614428+0000","last_clean_scrub_stamp":"2024-09-17T05:45:31.614428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3e","version":"0'0","reported_seq":1,"reported_epoch":58,"state":"creating+peering","last_fresh":"2024-09-17T05:45:31.628405+0000","last_change":"2024-09-17T05:45:31.628405+0000","last_active":"2024-09-17T05:45:31.614428+0000","last_peered":"2024-09-17T05:45:31.614428+0000","last_clean":"2024-09-17T05:45:31.614428+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:45:31.628405+0000","last_undegraded":"2024-09-17T05:45:31.628405+0000","last_fullsized":"2024-09-17T05:45:31.628405+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:45:31.614428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:45:31.614428+0000","last_clean_scrub_stamp":"2024-09-17T05:45:31.614428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.3d","version":"0'0","reported_seq":13,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-17T05:45:33.954721+0000","last_change":"2024-09-17T05:45:32.653926+0000","last_active":"2024-09-17T05:45:33.954721+0000","last_peered":"2024-09-17T05:45:33.954721+0000","last_clean":"2024-09-17T05:45:33.954721+0000","last_became_active":"2024-09-17T05:45:32.653577+0000","last_became_peered":"2024-09-17T05:45:32.653577+0000","last_unstale":"2024-09-17T05:45:33.954721+0000","last_undegraded":"2024-09-17T05:45:33.954721+0000","last_fullsized":"2024-09-17T05:45:33.954721+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:45:31.614428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:45:31.614428+0000","last_clean_scrub_stamp":"2024-09-17T05:45:31.614428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:18:45.006839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.3c","version":"0'0","reported_seq":13,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-17T05:45:33.643532+0000","last_change":"2024-09-17T05:45:32.644544+0000","last_active":"2024-09-17T05:45:33.643532+0000","last_peered":"2024-09-17T05:45:33.643532+0000","last_clean":"2024-09-17T05:45:33.643532+0000","last_became_active":"2024-09-17T05:45:32.644206+0000","last_became_peered":"2024-09-17T05:45:32.644206+0000","last_unstale":"2024-09-17T05:45:33.643532+0000","last_undegraded":"2024-09-17T05:45:33.643532+0000","last_fullsized":"2024-09-17T05:45:33.643532+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:45:31.614428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:45:31.614428+0000","last_clean_scrub_stamp":"2024-09-17T05:45:31.614428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:07:39.923649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.3b","version":"0'0","reported_seq":1,"reported_epoch":58,"state":"creating+peering","last_fresh":"2024-09-17T05:45:31.638143+0000","last_change":"2024-09-17T05:45:31.638143+0000","last_active":"2024-09-17T05:45:31.614428+0000","last_peered":"2024-09-17T05:45:31.614428+0000","last_clean":"2024-09-17T05:45:31.614428+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:45:31.638143+0000","last_undegraded":"2024-09-17T05:45:31.638143+0000","last_fullsized":"2024-09-17T05:45:31.638143+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:45:31.614428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:45:31.614428+0000","last_clean_scrub_stamp":"2024-09-17T05:45:31.614428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3a","version":"0'0","reported_seq":10,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-17T05:45:32.642546+0000","last_change":"2024-09-17T05:45:32.639148+0000","last_active":"2024-09-17T05:45:32.642546+0000","last_peered":"2024-09-17T05:45:32.642546+0000","last_clean":"2024-09-17T05:45:32.642546+0000","last_became_active":"2024-09-17T05:45:32.638816+0000","last_became_peered":"2024-09-17T05:45:32.638816+0000","last_unstale":"2024-09-17T05:45:32.642546+0000","last_undegraded":"2024-09-17T05:45:32.642546+0000","last_fullsized":"2024-09-17T05:45:32.642546+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:45:31.614428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:45:31.614428+0000","last_clean_scrub_stamp":"2024-09-17T05:45:31.614428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:47:31.319688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.39","version":"0'0","reported_seq":13,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-17T05:45:33.642542+0000","last_change":"2024-09-17T05:45:32.631297+0000","last_active":"2024-09-17T05:45:33.642542+0000","last_peered":"2024-09-17T05:45:33.642542+0000","last_clean":"2024-09-17T05:45:33.642542+0000","last_became_active":"2024-09-17T05:45:32.630792+0000","last_became_peered":"2024-09-17T05:45:32.630792+0000","last_unstale":"2024-09-17T05:45:33.642542+0000","last_undegraded":"2024-09-17T05:45:33.642542+0000","last_fullsized":"2024-09-17T05:45:33.642542+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:45:31.614428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:45:31.614428+0000","last_clean_scrub_stamp":"2024-09-17T05:45:31.614428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:40:44.182767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.38","version":"0'0","reported_seq":1,"reported_epoch":58,"state":"creating+peering","last_fresh":"2024-09-17T05:45:31.628464+0000","last_change":"2024-09-17T05:45:31.628464+0000","last_active":"2024-09-17T05:45:31.614428+0000","last_peered":"2024-09-17T05:45:31.614428+0000","last_clean":"2024-09-17T05:45:31.614428+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:45:31.628464+0000","last_undegraded":"2024-09-17T05:45:31.628464+0000","last_fullsized":"2024-09-17T05:45:31.628464+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:45:31.614428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:45:31.614428+0000","last_clean_scrub_stamp":"2024-09-17T05:45:31.614428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.37","version":"0'0","reported_seq":13,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-17T05:45:33.643100+0000","last_change":"2024-09-17T05:45:32.629786+0000","last_active":"2024-09-17T05:45:33.643100+0000","last_peered":"2024-09-17T05:45:33.643100+0000","last_clean":"2024-09-17T05:45:33.643100+0000","last_became_active":"2024-09-17T05:45:32.629438+0000","last_became_peered":"2024-09-17T05:45:32.629438+0000","last_unstale":"2024-09-17T05:45:33.643100+0000","last_undegraded":"2024-09-17T05:45:33.643100+0000","last_fullsized":"2024-09-17T05:45:33.643100+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:45:31.614428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:45:31.614428+0000","last_clean_scrub_stamp":"2024-09-17T05:45:31.614428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:06:56.405523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.36","version":"0'0","reported_seq":13,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-17T05:45:33.955260+0000","last_change":"2024-09-17T05:45:32.647536+0000","last_active":"2024-09-17T05:45:33.955260+0000","last_peered":"2024-09-17T05:45:33.955260+0000","last_clean":"2024-09-17T05:45:33.955260+0000","last_became_active":"2024-09-17T05:45:32.647207+0000","last_became_peered":"2024-09-17T05:45:32.647207+0000","last_unstale":"2024-09-17T05:45:33.955260+0000","last_undegraded":"2024-09-17T05:45:33.955260+0000","last_fullsized":"2024-09-17T05:45:33.955260+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:45:31.614428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:45:31.614428+0000","last_clean_scrub_stamp":"2024-09-17T05:45:31.614428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:53:08.537231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.35","version":"0'0","reported_seq":13,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-17T05:45:33.954382+0000","last_change":"2024-09-17T05:45:32.650441+0000","last_active":"2024-09-17T05:45:33.954382+0000","last_peered":"2024-09-17T05:45:33.954382+0000","last_clean":"2024-09-17T05:45:33.954382+0000","last_became_active":"2024-09-17T05:45:32.644229+0000","last_became_peered":"2024-09-17T05:45:32.644229+0000","last_unstale":"2024-09-17T05:45:33.954382+0000","last_undegraded":"2024-09-17T05:45:33.954382+0000","last_fullsized":"2024-09-17T05:45:33.954382+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:45:31.614428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:45:31.614428+0000","last_clean_scrub_stamp":"2024-09-17T05:45:31.614428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:15:00.651839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.34","version":"0'0","reported_seq":13,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-17T05:45:33.643819+0000","last_change":"2024-09-17T05:45:32.648016+0000","last_active":"2024-09-17T05:45:33.643819+0000","last_peered":"2024-09-17T05:45:33.643819+0000","last_clean":"2024-09-17T05:45:33.643819+0000","last_became_active":"2024-09-17T05:45:32.647657+0000","last_became_peered":"2024-09-17T05:45:32.647657+0000","last_unstale":"2024-09-17T05:45:33.643819+0000","last_undegraded":"2024-09-17T05:45:33.643819+0000","last_fullsized":"2024-09-17T05:45:33.643819+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:45:31.614428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:45:31.614428+0000","last_clean_scrub_stamp":"2024-09-17T05:45:31.614428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:15:14.618900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.33","version":"0'0","reported_seq":1,"reported_epoch":58,"state":"creating+peering","last_fresh":"2024-09-17T05:45:31.623675+0000","last_change":"2024-09-17T05:45:31.623675+0000","last_active":"2024-09-17T05:45:31.614428+0000","last_peered":"2024-09-17T05:45:31.614428+0000","last_clean":"2024-09-17T05:45:31.614428+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:45:31.623675+0000","last_undegraded":"2024-09-17T05:45:31.623675+0000","last_fullsized":"2024-09-17T05:45:31.623675+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:45:31.614428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:45:31.614428+0000","last_clean_scrub_stamp":"2024-09-17T05:45:31.614428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.32","version":"0'0","reported_seq":13,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-17T05:45:33.642905+0000","last_change":"2024-09-17T05:45:32.640531+0000","last_active":"2024-09-17T05:45:33.642905+0000","last_peered":"2024-09-17T05:45:33.642905+0000","last_clean":"2024-09-17T05:45:33.642905+0000","last_became_active":"2024-09-17T05:45:32.640176+0000","last_became_peered":"2024-09-17T05:45:32.640176+0000","last_unstale":"2024-09-17T05:45:33.642905+0000","last_undegraded":"2024-09-17T05:45:33.642905+0000","last_fullsized":"2024-09-17T05:45:33.642905+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:45:31.614428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:45:31.614428+0000","last_clean_scrub_stamp":"2024-09-17T05:45:31.614428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:25:16.583193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.31","version":"0'0","reported_seq":13,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-17T05:45:33.643442+0000","last_change":"2024-09-17T05:45:32.637116+0000","last_active":"2024-09-17T05:45:33.643442+0000","last_peered":"2024-09-17T05:45:33.643442+0000","last_clean":"2024-09-17T05:45:33.643442+0000","last_became_active":"2024-09-17T05:45:32.636454+0000","last_became_peered":"2024-09-17T05:45:32.636454+0000","last_unstale":"2024-09-17T05:45:33.643442+0000","last_undegraded":"2024-09-17T05:45:33.643442+0000","last_fullsized":"2024-09-17T05:45:33.643442+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:45:31.614428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:45:31.614428+0000","last_clean_scrub_stamp":"2024-09-17T05:45:31.614428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:05:03.043597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.30","version":"0'0","reported_seq":10,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-17T05:45:32.649772+0000","last_change":"2024-09-17T05:45:32.645281+0000","last_active":"2024-09-17T05:45:32.649772+0000","last_peered":"2024-09-17T05:45:32.649772+0000","last_clean":"2024-09-17T05:45:32.649772+0000","last_became_active":"2024-09-17T05:45:32.644707+0000","last_became_peered":"2024-09-17T05:45:32.644707+0000","last_unstale":"2024-09-17T05:45:32.649772+0000","last_undegraded":"2024-09-17T05:45:32.649772+0000","last_fullsized":"2024-09-17T05:45:32.649772+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:45:31.614428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:45:31.614428+0000","last_clean_scrub_stamp":"2024-09-17T05:45:31.614428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:35:47.004290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.2f","version":"0'0","reported_seq":1,"reported_epoch":58,"state":"creating+peering","last_fresh":"2024-09-17T05:45:31.628311+0000","last_change":"2024-09-17T05:45:31.628311+0000","last_active":"2024-09-17T05:45:31.614428+0000","last_peered":"2024-09-17T05:45:31.614428+0000","last_clean":"2024-09-17T05:45:31.614428+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:45:31.628311+0000","last_undegraded":"2024-09-17T05:45:31.628311+0000","last_fullsized":"2024-09-17T05:45:31.628311+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:45:31.614428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:45:31.614428+0000","last_clean_scrub_stamp":"2024-09-17T05:45:31.614428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2e","version":"0'0","reported_seq":13,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-17T05:45:33.955372+0000","last_change":"2024-09-17T05:45:32.648441+0000","last_active":"2024-09-17T05:45:33.955372+0000","last_peered":"2024-09-17T05:45:33.955372+0000","last_clean":"2024-09-17T05:45:33.955372+0000","last_became_active":"2024-09-17T05:45:32.646007+0000","last_became_peered":"2024-09-17T05:45:32.646007+0000","last_unstale":"2024-09-17T05:45:33.955372+0000","last_undegraded":"2024-09-17T05:45:33.955372+0000","last_fullsized":"2024-09-17T05:45:33.955372+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:45:31.614428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:45:31.614428+0000","last_clean_scrub_stamp":"2024-09-17T05:45:31.614428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:17:14.808917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2d","version":"0'0","reported_seq":1,"reported_epoch":58,"state":"creating+peering","last_fresh":"2024-09-17T05:45:31.633549+0000","last_change":"2024-09-17T05:45:31.633549+0000","last_active":"2024-09-17T05:45:31.614428+0000","last_peered":"2024-09-17T05:45:31.614428+0000","last_clean":"2024-09-17T05:45:31.614428+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:45:31.633549+0000","last_undegraded":"2024-09-17T05:45:31.633549+0000","last_fullsized":"2024-09-17T05:45:31.633549+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:45:31.614428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:45:31.614428+0000","last_clean_scrub_stamp":"2024-09-17T05:45:31.614428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.2c","version":"0'0","reported_seq":1,"reported_epoch":58,"state":"creating+peering","last_fresh":"2024-09-17T05:45:31.628712+0000","last_change":"2024-09-17T05:45:31.628712+0000","last_active":"2024-09-17T05:45:31.614428+0000","last_peered":"2024-09-17T05:45:31.614428+0000","last_clean":"2024-09-17T05:45:31.614428+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:45:31.628712+0000","last_undegraded":"2024-09-17T05:45:31.628712+0000","last_fullsized":"2024-09-17T05:45:31.628712+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:45:31.614428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:45:31.614428+0000","last_clean_scrub_stamp":"2024-09-17T05:45:31.614428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2b","version":"0'0","reported_seq":13,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-17T05:45:33.954893+0000","last_change":"2024-09-17T05:45:32.648315+0000","last_active":"2024-09-17T05:45:33.954893+0000","last_peered":"2024-09-17T05:45:33.954893+0000","last_clean":"2024-09-17T05:45:33.954893+0000","last_became_active":"2024-09-17T05:45:32.646021+0000","last_became_peered":"2024-09-17T05:45:32.646021+0000","last_unstale":"2024-09-17T05:45:33.954893+0000","last_undegraded":"2024-09-17T05:45:33.954893+0000","last_fullsized":"2024-09-17T05:45:33.954893+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:45:31.614428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:45:31.614428+0000","last_clean_scrub_stamp":"2024-09-17T05:45:31.614428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:21:50.109729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2a","version":"0'0","reported_seq":1,"reported_epoch":58,"state":"creating+peering","last_fresh":"2024-09-17T05:45:31.634734+0000","last_change":"2024-09-17T05:45:31.634734+0000","last_active":"2024-09-17T05:45:31.614428+0000","last_peered":"2024-09-17T05:45:31.614428+0000","last_clean":"2024-09-17T05:45:31.614428+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:45:31.634734+0000","last_undegraded":"2024-09-17T05:45:31.634734+0000","last_fullsized":"2024-09-17T05:45:31.634734+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:45:31.614428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:45:31.614428+0000","last_clean_scrub_stamp":"2024-09-17T05:45:31.614428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.29","version":"0'0","reported_seq":13,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-17T05:45:33.955465+0000","last_change":"2024-09-17T05:45:32.651396+0000","last_active":"2024-09-17T05:45:33.955465+0000","last_peered":"2024-09-17T05:45:33.955465+0000","last_clean":"2024-09-17T05:45:33.955465+0000","last_became_active":"2024-09-17T05:45:32.651072+0000","last_became_peered":"2024-09-17T05:45:32.651072+0000","last_unstale":"2024-09-17T05:45:33.955465+0000","last_undegraded":"2024-09-17T05:45:33.955465+0000","last_fullsized":"2024-09-17T05:45:33.955465+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:45:31.614428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:45:31.614428+0000","last_clean_scrub_stamp":"2024-09-17T05:45:31.614428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:44:57.086608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.28","version":"0'0","reported_seq":1,"reported_epoch":58,"state":"creating+peering","last_fresh":"2024-09-17T05:45:31.625136+0000","last_change":"2024-09-17T05:45:31.625136+0000","last_active":"2024-09-17T05:45:31.614428+0000","last_peered":"2024-09-17T05:45:31.614428+0000","last_clean":"2024-09-17T05:45:31.614428+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:45:31.625136+0000","last_undegraded":"2024-09-17T05:45:31.625136+0000","last_fullsized":"2024-09-17T05:45:31.625136+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:45:31.614428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:45:31.614428+0000","last_clean_scrub_stamp":"2024-09-17T05:45:31.614428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.27","version":"0'0","reported_seq":1,"reported_epoch":58,"state":"creating+peering","last_fresh":"2024-09-17T05:45:31.635240+0000","last_change":"2024-09-17T05:45:31.635240+0000","last_active":"2024-09-17T05:45:31.614428+0000","last_peered":"2024-09-17T05:45:31.614428+0000","last_clean":"2024-09-17T05:45:31.614428+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:45:31.635240+0000","last_undegraded":"2024-09-17T05:45:31.635240+0000","last_fullsized":"2024-09-17T05:45:31.635240+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:45:31.614428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:45:31.614428+0000","last_clean_scrub_stamp":"2024-09-17T05:45:31.614428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.26","version":"0'0","reported_seq":13,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-17T05:45:33.643810+0000","last_change":"2024-09-17T05:45:32.631723+0000","last_active":"2024-09-17T05:45:33.643810+0000","last_peered":"2024-09-17T05:45:33.643810+0000","last_clean":"2024-09-17T05:45:33.643810+0000","last_became_active":"2024-09-17T05:45:32.631351+0000","last_became_peered":"2024-09-17T05:45:32.631351+0000","last_unstale":"2024-09-17T05:45:33.643810+0000","last_undegraded":"2024-09-17T05:45:33.643810+0000","last_fullsized":"2024-09-17T05:45:33.643810+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:45:31.614428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:45:31.614428+0000","last_clean_scrub_stamp":"2024-09-17T05:45:31.614428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:17:02.678048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.25","version":"0'0","reported_seq":10,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-17T05:45:32.643075+0000","last_change":"2024-09-17T05:45:32.637435+0000","last_active":"2024-09-17T05:45:32.643075+0000","last_peered":"2024-09-17T05:45:32.643075+0000","last_clean":"2024-09-17T05:45:32.643075+0000","last_became_active":"2024-09-17T05:45:32.637137+0000","last_became_peered":"2024-09-17T05:45:32.637137+0000","last_unstale":"2024-09-17T05:45:32.643075+0000","last_undegraded":"2024-09-17T05:45:32.643075+0000","last_fullsized":"2024-09-17T05:45:32.643075+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:45:31.614428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:45:31.614428+0000","last_clean_scrub_stamp":"2024-09-17T05:45:31.614428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:40:05.262567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.24","version":"0'0","reported_seq":1,"reported_epoch":58,"state":"creating+peering","last_fresh":"2024-09-17T05:45:31.635964+0000","last_change":"2024-09-17T05:45:31.635964+0000","last_active":"2024-09-17T05:45:31.614428+0000","last_peered":"2024-09-17T05:45:31.614428+0000","last_clean":"2024-09-17T05:45:31.614428+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:45:31.635964+0000","last_undegraded":"2024-09-17T05:45:31.635964+0000","last_fullsized":"2024-09-17T05:45:31.635964+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:45:31.614428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:45:31.614428+0000","last_clean_scrub_stamp":"2024-09-17T05:45:31.614428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.23","version":"0'0","reported_seq":1,"reported_epoch":58,"state":"creating+peering","last_fresh":"2024-09-17T05:45:31.631473+0000","last_change":"2024-09-17T05:45:31.631473+0000","last_active":"2024-09-17T05:45:31.614428+0000","last_peered":"2024-09-17T05:45:31.614428+0000","last_clean":"2024-09-17T05:45:31.614428+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:45:31.631473+0000","last_undegraded":"2024-09-17T05:45:31.631473+0000","last_fullsized":"2024-09-17T05:45:31.631473+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:45:31.614428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:45:31.614428+0000","last_clean_scrub_stamp":"2024-09-17T05:45:31.614428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.22","version":"0'0","reported_seq":13,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-17T05:45:33.954765+0000","last_change":"2024-09-17T05:45:32.655106+0000","last_active":"2024-09-17T05:45:33.954765+0000","last_peered":"2024-09-17T05:45:33.954765+0000","last_clean":"2024-09-17T05:45:33.954765+0000","last_became_active":"2024-09-17T05:45:32.654852+0000","last_became_peered":"2024-09-17T05:45:32.654852+0000","last_unstale":"2024-09-17T05:45:33.954765+0000","last_undegraded":"2024-09-17T05:45:33.954765+0000","last_fullsized":"2024-09-17T05:45:33.954765+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:45:31.614428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:45:31.614428+0000","last_clean_scrub_stamp":"2024-09-17T05:45:31.614428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:57:53.829103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.21","version":"0'0","reported_seq":1,"reported_epoch":58,"state":"creating+peering","last_fresh":"2024-09-17T05:45:31.633306+0000","last_change":"2024-09-17T05:45:31.633306+0000","last_active":"2024-09-17T05:45:31.614428+0000","last_peered":"2024-09-17T05:45:31.614428+0000","last_clean":"2024-09-17T05:45:31.614428+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:45:31.633306+0000","last_undegraded":"2024-09-17T05:45:31.633306+0000","last_fullsized":"2024-09-17T05:45:31.633306+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:45:31.614428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:45:31.614428+0000","last_clean_scrub_stamp":"2024-09-17T05:45:31.614428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.20","version":"0'0","reported_seq":10,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-17T05:45:32.644914+0000","last_change":"2024-09-17T05:45:32.641063+0000","last_active":"2024-09-17T05:45:32.644914+0000","last_peered":"2024-09-17T05:45:32.644914+0000","last_clean":"2024-09-17T05:45:32.644914+0000","last_became_active":"2024-09-17T05:45:32.640742+0000","last_became_peered":"2024-09-17T05:45:32.640742+0000","last_unstale":"2024-09-17T05:45:32.644914+0000","last_undegraded":"2024-09-17T05:45:32.644914+0000","last_fullsized":"2024-09-17T05:45:32.644914+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:45:31.614428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:45:31.614428+0000","last_clean_scrub_stamp":"2024-09-17T05:45:31.614428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:07:58.852633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1e","version":"0'0","reported_seq":10,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-17T05:45:32.657055+0000","last_change":"2024-09-17T05:45:32.654896+0000","last_active":"2024-09-17T05:45:32.657055+0000","last_peered":"2024-09-17T05:45:32.657055+0000","last_clean":"2024-09-17T05:45:32.657055+0000","last_became_active":"2024-09-17T05:45:32.652165+0000","last_became_peered":"2024-09-17T05:45:32.652165+0000","last_unstale":"2024-09-17T05:45:32.657055+0000","last_undegraded":"2024-09-17T05:45:32.657055+0000","last_fullsized":"2024-09-17T05:45:32.657055+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:45:31.614428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:45:31.614428+0000","last_clean_scrub_stamp":"2024-09-17T05:45:31.614428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:51:41.489630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1f","version":"59'4","reported_seq":17,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-17T05:45:32.655111+0000","last_change":"2024-09-17T05:45:31.639533+0000","last_active":"2024-09-17T05:45:32.655111+0000","last_peered":"2024-09-17T05:45:32.655111+0000","last_clean":"2024-09-17T05:45:32.655111+0000","last_became_active":"2024-09-17T05:45:31.638859+0000","last_became_peered":"2024-09-17T05:45:31.638859+0000","last_unstale":"2024-09-17T05:45:32.655111+0000","last_undegraded":"2024-09-17T05:45:32.655111+0000","last_fullsized":"2024-09-17T05:45:32.655111+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:45:30.612191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:45:30.612191+0000","last_clean_scrub_stamp":"2024-09-17T05:45:30.612191+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:50:36.495235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1f","version":"0'0","reported_seq":13,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-17T05:45:33.955336+0000","last_change":"2024-09-17T05:45:32.650676+0000","last_active":"2024-09-17T05:45:33.955336+0000","last_peered":"2024-09-17T05:45:33.955336+0000","last_clean":"2024-09-17T05:45:33.955336+0000","last_became_active":"2024-09-17T05:45:32.650377+0000","last_became_peered":"2024-09-17T05:45:32.650377+0000","last_unstale":"2024-09-17T05:45:33.955336+0000","last_undegraded":"2024-09-17T05:45:33.955336+0000","last_fullsized":"2024-09-17T05:45:33.955336+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:45:31.614428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:45:31.614428+0000","last_clean_scrub_stamp":"2024-09-17T05:45:31.614428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:42:03.873298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":10,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-17T05:45:31.636336+0000","last_change":"2024-09-17T05:45:31.629458+0000","last_active":"2024-09-17T05:45:31.636336+0000","last_peered":"2024-09-17T05:45:31.636336+0000","last_clean":"2024-09-17T05:45:31.636336+0000","last_became_active":"2024-09-17T05:45:31.629161+0000","last_became_peered":"2024-09-17T05:45:31.629161+0000","last_unstale":"2024-09-17T05:45:31.636336+0000","last_undegraded":"2024-09-17T05:45:31.636336+0000","last_fullsized":"2024-09-17T05:45:31.636336+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:45:30.612191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:45:30.612191+0000","last_clean_scrub_stamp":"2024-09-17T05:45:30.612191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:13:41.291969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.1c","version":"0'0","reported_seq":10,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-17T05:45:32.642493+0000","last_change":"2024-09-17T05:45:32.639921+0000","last_active":"2024-09-17T05:45:32.642493+0000","last_peered":"2024-09-17T05:45:32.642493+0000","last_clean":"2024-09-17T05:45:32.642493+0000","last_became_active":"2024-09-17T05:45:32.639588+0000","last_became_peered":"2024-09-17T05:45:32.639588+0000","last_unstale":"2024-09-17T05:45:32.642493+0000","last_undegraded":"2024-09-17T05:45:32.642493+0000","last_fullsized":"2024-09-17T05:45:32.642493+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:45:31.614428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:45:31.614428+0000","last_clean_scrub_stamp":"2024-09-17T05:45:31.614428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:58:26.605060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1d","version":"59'2","reported_seq":15,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-17T05:45:32.658108+0000","last_change":"2024-09-17T05:45:31.634645+0000","last_active":"2024-09-17T05:45:32.658108+0000","last_peered":"2024-09-17T05:45:32.658108+0000","last_clean":"2024-09-17T05:45:32.658108+0000","last_became_active":"2024-09-17T05:45:31.634306+0000","last_became_peered":"2024-09-17T05:45:31.634306+0000","last_unstale":"2024-09-17T05:45:32.658108+0000","last_undegraded":"2024-09-17T05:45:32.658108+0000","last_fullsized":"2024-09-17T05:45:32.658108+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:45:30.612191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:45:30.612191+0000","last_clean_scrub_stamp":"2024-09-17T05:45:30.612191+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:11:50.501779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1d","version":"0'0","reported_seq":10,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-17T05:45:32.643019+0000","last_change":"2024-09-17T05:45:32.634215+0000","last_active":"2024-09-17T05:45:32.643019+0000","last_peered":"2024-09-17T05:45:32.643019+0000","last_clean":"2024-09-17T05:45:32.643019+0000","last_became_active":"2024-09-17T05:45:32.633773+0000","last_became_peered":"2024-09-17T05:45:32.633773+0000","last_unstale":"2024-09-17T05:45:32.643019+0000","last_undegraded":"2024-09-17T05:45:32.643019+0000","last_fullsized":"2024-09-17T05:45:32.643019+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:45:31.614428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:45:31.614428+0000","last_clean_scrub_stamp":"2024-09-17T05:45:31.614428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:31:38.357082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1c","version":"59'2","reported_seq":17,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-17T05:45:33.643901+0000","last_change":"2024-09-17T05:45:31.642391+0000","last_active":"2024-09-17T05:45:33.643901+0000","last_peered":"2024-09-17T05:45:33.643901+0000","last_clean":"2024-09-17T05:45:33.643901+0000","last_became_active":"2024-09-17T05:45:31.641969+0000","last_became_peered":"2024-09-17T05:45:31.641969+0000","last_unstale":"2024-09-17T05:45:33.643901+0000","last_undegraded":"2024-09-17T05:45:33.643901+0000","last_fullsized":"2024-09-17T05:45:33.643901+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:45:30.612191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:45:30.612191+0000","last_clean_scrub_stamp":"2024-09-17T05:45:30.612191+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:25:15.580957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.1a","version":"0'0","reported_seq":1,"reported_epoch":58,"state":"creating+peering","last_fresh":"2024-09-17T05:45:31.634200+0000","last_change":"2024-09-17T05:45:31.634200+0000","last_active":"2024-09-17T05:45:31.614428+0000","last_peered":"2024-09-17T05:45:31.614428+0000","last_clean":"2024-09-17T05:45:31.614428+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:45:31.634200+0000","last_undegraded":"2024-09-17T05:45:31.634200+0000","last_fullsized":"2024-09-17T05:45:31.634200+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:45:31.614428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:45:31.614428+0000","last_clean_scrub_stamp":"2024-09-17T05:45:31.614428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"59'1","reported_seq":16,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-17T05:45:33.642253+0000","last_change":"2024-09-17T05:45:31.644223+0000","last_active":"2024-09-17T05:45:33.642253+0000","last_peered":"2024-09-17T05:45:33.642253+0000","last_clean":"2024-09-17T05:45:33.642253+0000","last_became_active":"2024-09-17T05:45:31.643842+0000","last_became_peered":"2024-09-17T05:45:31.643842+0000","last_unstale":"2024-09-17T05:45:33.642253+0000","last_undegraded":"2024-09-17T05:45:33.642253+0000","last_fullsized":"2024-09-17T05:45:33.642253+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:45:30.612191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:45:30.612191+0000","last_clean_scrub_stamp":"2024-09-17T05:45:30.612191+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:42:04.702175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1b","version":"0'0","reported_seq":1,"reported_epoch":58,"state":"creating+peering","last_fresh":"2024-09-17T05:45:31.630970+0000","last_change":"2024-09-17T05:45:31.630970+0000","last_active":"2024-09-17T05:45:31.614428+0000","last_peered":"2024-09-17T05:45:31.614428+0000","last_clean":"2024-09-17T05:45:31.614428+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:45:31.630970+0000","last_undegraded":"2024-09-17T05:45:31.630970+0000","last_fullsized":"2024-09-17T05:45:31.630970+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:45:31.614428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:45:31.614428+0000","last_clean_scrub_stamp":"2024-09-17T05:45:31.614428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1a","version":"59'1","reported_seq":14,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-17T05:45:32.649523+0000","last_change":"2024-09-17T05:45:31.637200+0000","last_active":"2024-09-17T05:45:32.649523+0000","last_peered":"2024-09-17T05:45:32.649523+0000","last_clean":"2024-09-17T05:45:32.649523+0000","last_became_active":"2024-09-17T05:45:31.636713+0000","last_became_peered":"2024-09-17T05:45:31.636713+0000","last_unstale":"2024-09-17T05:45:32.649523+0000","last_undegraded":"2024-09-17T05:45:32.649523+0000","last_fullsized":"2024-09-17T05:45:32.649523+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:45:30.612191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:45:30.612191+0000","last_clean_scrub_stamp":"2024-09-17T05:45:30.612191+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:22:55.029575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":1,"reported_epoch":58,"state":"creating+peering","last_fresh":"2024-09-17T05:45:31.623504+0000","last_change":"2024-09-17T05:45:31.623504+0000","last_active":"2024-09-17T05:45:31.614428+0000","last_peered":"2024-09-17T05:45:31.614428+0000","last_clean":"2024-09-17T05:45:31.614428+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:45:31.623504+0000","last_undegraded":"2024-09-17T05:45:31.623504+0000","last_fullsized":"2024-09-17T05:45:31.623504+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:45:31.614428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:45:31.614428+0000","last_clean_scrub_stamp":"2024-09-17T05:45:31.614428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":15,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-17T05:45:33.642939+0000","last_change":"2024-09-17T05:45:31.639388+0000","last_active":"2024-09-17T05:45:33.642939+0000","last_peered":"2024-09-17T05:45:33.642939+0000","last_clean":"2024-09-17T05:45:33.642939+0000","last_became_active":"2024-09-17T05:45:31.639055+0000","last_became_peered":"2024-09-17T05:45:31.639055+0000","last_unstale":"2024-09-17T05:45:33.642939+0000","last_undegraded":"2024-09-17T05:45:33.642939+0000","last_fullsized":"2024-09-17T05:45:33.642939+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:45:30.612191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:45:30.612191+0000","last_clean_scrub_stamp":"2024-09-17T05:45:30.612191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:40:43.180531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":1,"reported_epoch":58,"state":"creating+peering","last_fresh":"2024-09-17T05:45:31.632251+0000","last_change":"2024-09-17T05:45:31.632251+0000","last_active":"2024-09-17T05:45:31.614428+0000","last_peered":"2024-09-17T05:45:31.614428+0000","last_clean":"2024-09-17T05:45:31.614428+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:45:31.632251+0000","last_undegraded":"2024-09-17T05:45:31.632251+0000","last_fullsized":"2024-09-17T05:45:31.632251+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:45:31.614428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:45:31.614428+0000","last_clean_scrub_stamp":"2024-09-17T05:45:31.614428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":15,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-17T05:45:33.642214+0000","last_change":"2024-09-17T05:45:31.640961+0000","last_active":"2024-09-17T05:45:33.642214+0000","last_peered":"2024-09-17T05:45:33.642214+0000","last_clean":"2024-09-17T05:45:33.642214+0000","last_became_active":"2024-09-17T05:45:31.640611+0000","last_became_peered":"2024-09-17T05:45:31.640611+0000","last_unstale":"2024-09-17T05:45:33.642214+0000","last_undegraded":"2024-09-17T05:45:33.642214+0000","last_fullsized":"2024-09-17T05:45:33.642214+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:45:30.612191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:45:30.612191+0000","last_clean_scrub_stamp":"2024-09-17T05:45:30.612191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:42:02.871061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":13,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-17T05:45:33.643152+0000","last_change":"2024-09-17T05:45:32.639298+0000","last_active":"2024-09-17T05:45:33.643152+0000","last_peered":"2024-09-17T05:45:33.643152+0000","last_clean":"2024-09-17T05:45:33.643152+0000","last_became_active":"2024-09-17T05:45:32.638969+0000","last_became_peered":"2024-09-17T05:45:32.638969+0000","last_unstale":"2024-09-17T05:45:33.643152+0000","last_undegraded":"2024-09-17T05:45:33.643152+0000","last_fullsized":"2024-09-17T05:45:33.643152+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:45:31.614428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:45:31.614428+0000","last_clean_scrub_stamp":"2024-09-17T05:45:31.614428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:14:04.950271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":15,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-17T05:45:33.955451+0000","last_change":"2024-09-17T05:45:31.639874+0000","last_active":"2024-09-17T05:45:33.955451+0000","last_peered":"2024-09-17T05:45:33.955451+0000","last_clean":"2024-09-17T05:45:33.955451+0000","last_became_active":"2024-09-17T05:45:31.639537+0000","last_became_peered":"2024-09-17T05:45:31.639537+0000","last_unstale":"2024-09-17T05:45:33.955451+0000","last_undegraded":"2024-09-17T05:45:33.955451+0000","last_fullsized":"2024-09-17T05:45:33.955451+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:45:30.612191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:45:30.612191+0000","last_clean_scrub_stamp":"2024-09-17T05:45:30.612191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:28:11.674936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":13,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-17T05:45:33.955442+0000","last_change":"2024-09-17T05:45:32.654783+0000","last_active":"2024-09-17T05:45:33.955442+0000","last_peered":"2024-09-17T05:45:33.955442+0000","last_clean":"2024-09-17T05:45:33.955442+0000","last_became_active":"2024-09-17T05:45:32.654448+0000","last_became_peered":"2024-09-17T05:45:32.654448+0000","last_unstale":"2024-09-17T05:45:33.955442+0000","last_undegraded":"2024-09-17T05:45:33.955442+0000","last_fullsized":"2024-09-17T05:45:33.955442+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:45:31.614428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:45:31.614428+0000","last_clean_scrub_stamp":"2024-09-17T05:45:31.614428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:14:04.792704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":10,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-17T05:45:31.643163+0000","last_change":"2024-09-17T05:45:31.640475+0000","last_active":"2024-09-17T05:45:31.643163+0000","last_peered":"2024-09-17T05:45:31.643163+0000","last_clean":"2024-09-17T05:45:31.643163+0000","last_became_active":"2024-09-17T05:45:31.640191+0000","last_became_peered":"2024-09-17T05:45:31.640191+0000","last_unstale":"2024-09-17T05:45:31.643163+0000","last_undegraded":"2024-09-17T05:45:31.643163+0000","last_fullsized":"2024-09-17T05:45:31.643163+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:45:30.612191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:45:30.612191+0000","last_clean_scrub_stamp":"2024-09-17T05:45:30.612191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:18:44.004602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.14","version":"0'0","reported_seq":13,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-17T05:45:33.954927+0000","last_change":"2024-09-17T05:45:32.648272+0000","last_active":"2024-09-17T05:45:33.954927+0000","last_peered":"2024-09-17T05:45:33.954927+0000","last_clean":"2024-09-17T05:45:33.954927+0000","last_became_active":"2024-09-17T05:45:32.642778+0000","last_became_peered":"2024-09-17T05:45:32.642778+0000","last_unstale":"2024-09-17T05:45:33.954927+0000","last_undegraded":"2024-09-17T05:45:33.954927+0000","last_fullsized":"2024-09-17T05:45:33.954927+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:45:31.614428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:45:31.614428+0000","last_clean_scrub_stamp":"2024-09-17T05:45:31.614428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:27:46.994037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.15","version":"59'3","reported_seq":18,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-17T05:45:33.955209+0000","last_change":"2024-09-17T05:45:31.631099+0000","last_active":"2024-09-17T05:45:33.955209+0000","last_peered":"2024-09-17T05:45:33.955209+0000","last_clean":"2024-09-17T05:45:33.955209+0000","last_became_active":"2024-09-17T05:45:31.630774+0000","last_became_peered":"2024-09-17T05:45:31.630774+0000","last_unstale":"2024-09-17T05:45:33.955209+0000","last_undegraded":"2024-09-17T05:45:33.955209+0000","last_fullsized":"2024-09-17T05:45:33.955209+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:45:30.612191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:45:30.612191+0000","last_clean_scrub_stamp":"2024-09-17T05:45:30.612191+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:59:40.798271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.15","version":"0'0","reported_seq":13,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-17T05:45:33.955107+0000","last_change":"2024-09-17T05:45:32.656952+0000","last_active":"2024-09-17T05:45:33.955107+0000","last_peered":"2024-09-17T05:45:33.955107+0000","last_clean":"2024-09-17T05:45:33.955107+0000","last_became_active":"2024-09-17T05:45:32.656656+0000","last_became_peered":"2024-09-17T05:45:32.656656+0000","last_unstale":"2024-09-17T05:45:33.955107+0000","last_undegraded":"2024-09-17T05:45:33.955107+0000","last_fullsized":"2024-09-17T05:45:33.955107+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:45:31.614428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:45:31.614428+0000","last_clean_scrub_stamp":"2024-09-17T05:45:31.614428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:15:14.618900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.14","version":"59'6","reported_seq":21,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-17T05:45:33.642762+0000","last_change":"2024-09-17T05:45:31.637717+0000","last_active":"2024-09-17T05:45:33.642762+0000","last_peered":"2024-09-17T05:45:33.642762+0000","last_clean":"2024-09-17T05:45:33.642762+0000","last_became_active":"2024-09-17T05:45:31.637335+0000","last_became_peered":"2024-09-17T05:45:31.637335+0000","last_unstale":"2024-09-17T05:45:33.642762+0000","last_undegraded":"2024-09-17T05:45:33.642762+0000","last_fullsized":"2024-09-17T05:45:33.642762+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:45:30.612191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:45:30.612191+0000","last_clean_scrub_stamp":"2024-09-17T05:45:30.612191+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:28:45.681547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":13,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-17T05:45:33.643776+0000","last_change":"2024-09-17T05:45:32.640295+0000","last_active":"2024-09-17T05:45:33.643776+0000","last_peered":"2024-09-17T05:45:33.643776+0000","last_clean":"2024-09-17T05:45:33.643776+0000","last_became_active":"2024-09-17T05:45:32.639626+0000","last_became_peered":"2024-09-17T05:45:32.639626+0000","last_unstale":"2024-09-17T05:45:33.643776+0000","last_undegraded":"2024-09-17T05:45:33.643776+0000","last_fullsized":"2024-09-17T05:45:33.643776+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:45:31.614428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:45:31.614428+0000","last_clean_scrub_stamp":"2024-09-17T05:45:31.614428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:23:18.865215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":10,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-17T05:45:31.647136+0000","last_change":"2024-09-17T05:45:31.644303+0000","last_active":"2024-09-17T05:45:31.647136+0000","last_peered":"2024-09-17T05:45:31.647136+0000","last_clean":"2024-09-17T05:45:31.647136+0000","last_became_active":"2024-09-17T05:45:31.644011+0000","last_became_peered":"2024-09-17T05:45:31.644011+0000","last_unstale":"2024-09-17T05:45:31.647136+0000","last_undegraded":"2024-09-17T05:45:31.647136+0000","last_fullsized":"2024-09-17T05:45:31.647136+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:45:30.612191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:45:30.612191+0000","last_clean_scrub_stamp":"2024-09-17T05:45:30.612191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:57:52.826866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.13","version":"0'0","reported_seq":13,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-17T05:45:33.954984+0000","last_change":"2024-09-17T05:45:32.649405+0000","last_active":"2024-09-17T05:45:33.954984+0000","last_peered":"2024-09-17T05:45:33.954984+0000","last_clean":"2024-09-17T05:45:33.954984+0000","last_became_active":"2024-09-17T05:45:32.649052+0000","last_became_peered":"2024-09-17T05:45:32.649052+0000","last_unstale":"2024-09-17T05:45:33.954984+0000","last_undegraded":"2024-09-17T05:45:33.954984+0000","last_fullsized":"2024-09-17T05:45:33.954984+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:45:31.614428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:45:31.614428+0000","last_clean_scrub_stamp":"2024-09-17T05:45:31.614428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:14:32.500946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":10,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-17T05:45:31.635300+0000","last_change":"2024-09-17T05:45:31.629800+0000","last_active":"2024-09-17T05:45:31.635300+0000","last_peered":"2024-09-17T05:45:31.635300+0000","last_clean":"2024-09-17T05:45:31.635300+0000","last_became_active":"2024-09-17T05:45:31.629475+0000","last_became_peered":"2024-09-17T05:45:31.629475+0000","last_unstale":"2024-09-17T05:45:31.635300+0000","last_undegraded":"2024-09-17T05:45:31.635300+0000","last_fullsized":"2024-09-17T05:45:31.635300+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:45:30.612191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:45:30.612191+0000","last_clean_scrub_stamp":"2024-09-17T05:45:30.612191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:26:33.564340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.10","version":"0'0","reported_seq":13,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-17T05:45:33.642459+0000","last_change":"2024-09-17T05:45:32.647139+0000","last_active":"2024-09-17T05:45:33.642459+0000","last_peered":"2024-09-17T05:45:33.642459+0000","last_clean":"2024-09-17T05:45:33.642459+0000","last_became_active":"2024-09-17T05:45:32.646721+0000","last_became_peered":"2024-09-17T05:45:32.646721+0000","last_unstale":"2024-09-17T05:45:33.642459+0000","last_undegraded":"2024-09-17T05:45:33.642459+0000","last_fullsized":"2024-09-17T05:45:33.642459+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:45:31.614428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:45:31.614428+0000","last_clean_scrub_stamp":"2024-09-17T05:45:31.614428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:10:56.650561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":15,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-17T05:45:33.643055+0000","last_change":"2024-09-17T05:45:31.638931+0000","last_active":"2024-09-17T05:45:33.643055+0000","last_peered":"2024-09-17T05:45:33.643055+0000","last_clean":"2024-09-17T05:45:33.643055+0000","last_became_active":"2024-09-17T05:45:31.638553+0000","last_became_peered":"2024-09-17T05:45:31.638553+0000","last_unstale":"2024-09-17T05:45:33.643055+0000","last_undegraded":"2024-09-17T05:45:33.643055+0000","last_fullsized":"2024-09-17T05:45:33.643055+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:45:30.612191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:45:30.612191+0000","last_clean_scrub_stamp":"2024-09-17T05:45:30.612191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:10:55.648324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":13,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-17T05:45:33.955462+0000","last_change":"2024-09-17T05:45:32.653723+0000","last_active":"2024-09-17T05:45:33.955462+0000","last_peered":"2024-09-17T05:45:33.955462+0000","last_clean":"2024-09-17T05:45:33.955462+0000","last_became_active":"2024-09-17T05:45:32.653153+0000","last_became_peered":"2024-09-17T05:45:32.653153+0000","last_unstale":"2024-09-17T05:45:33.955462+0000","last_undegraded":"2024-09-17T05:45:33.955462+0000","last_fullsized":"2024-09-17T05:45:33.955462+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:45:31.614428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:45:31.614428+0000","last_clean_scrub_stamp":"2024-09-17T05:45:31.614428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:07:41.347650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.10","version":"59'8","reported_seq":23,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-17T05:45:33.954532+0000","last_change":"2024-09-17T05:45:31.639504+0000","last_active":"2024-09-17T05:45:33.954532+0000","last_peered":"2024-09-17T05:45:33.954532+0000","last_clean":"2024-09-17T05:45:33.954532+0000","last_became_active":"2024-09-17T05:45:31.638977+0000","last_became_peered":"2024-09-17T05:45:31.638977+0000","last_unstale":"2024-09-17T05:45:33.954532+0000","last_undegraded":"2024-09-17T05:45:33.954532+0000","last_fullsized":"2024-09-17T05:45:33.954532+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:45:30.612191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:45:30.612191+0000","last_clean_scrub_stamp":"2024-09-17T05:45:30.612191+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:07:21.436157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.e","version":"0'0","reported_seq":13,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-17T05:45:33.955484+0000","last_change":"2024-09-17T05:45:32.653968+0000","last_active":"2024-09-17T05:45:33.955484+0000","last_peered":"2024-09-17T05:45:33.955484+0000","last_clean":"2024-09-17T05:45:33.955484+0000","last_became_active":"2024-09-17T05:45:32.653675+0000","last_became_peered":"2024-09-17T05:45:32.653675+0000","last_unstale":"2024-09-17T05:45:33.955484+0000","last_undegraded":"2024-09-17T05:45:33.955484+0000","last_fullsized":"2024-09-17T05:45:33.955484+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:45:31.614428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:45:31.614428+0000","last_clean_scrub_stamp":"2024-09-17T05:45:31.614428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:52:42.817700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":10,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-17T05:45:31.643225+0000","last_change":"2024-09-17T05:45:31.640449+0000","last_active":"2024-09-17T05:45:31.643225+0000","last_peered":"2024-09-17T05:45:31.643225+0000","last_clean":"2024-09-17T05:45:31.643225+0000","last_became_active":"2024-09-17T05:45:31.640151+0000","last_became_peered":"2024-09-17T05:45:31.640151+0000","last_unstale":"2024-09-17T05:45:31.643225+0000","last_undegraded":"2024-09-17T05:45:31.643225+0000","last_fullsized":"2024-09-17T05:45:31.643225+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:45:30.612191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:45:30.612191+0000","last_clean_scrub_stamp":"2024-09-17T05:45:30.612191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:45:55.100047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.f","version":"0'0","reported_seq":13,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-17T05:45:33.643484+0000","last_change":"2024-09-17T05:45:32.645212+0000","last_active":"2024-09-17T05:45:33.643484+0000","last_peered":"2024-09-17T05:45:33.643484+0000","last_clean":"2024-09-17T05:45:33.643484+0000","last_became_active":"2024-09-17T05:45:32.644921+0000","last_became_peered":"2024-09-17T05:45:32.644921+0000","last_unstale":"2024-09-17T05:45:33.643484+0000","last_undegraded":"2024-09-17T05:45:33.643484+0000","last_fullsized":"2024-09-17T05:45:33.643484+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:45:31.614428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:45:31.614428+0000","last_clean_scrub_stamp":"2024-09-17T05:45:31.614428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:15:12.766358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.e","version":"59'2","reported_seq":15,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-17T05:45:32.657557+0000","last_change":"2024-09-17T05:45:31.640980+0000","last_active":"2024-09-17T05:45:32.657557+0000","last_peered":"2024-09-17T05:45:32.657557+0000","last_clean":"2024-09-17T05:45:32.657557+0000","last_became_active":"2024-09-17T05:45:31.640679+0000","last_became_peered":"2024-09-17T05:45:31.640679+0000","last_unstale":"2024-09-17T05:45:32.657557+0000","last_undegraded":"2024-09-17T05:45:32.657557+0000","last_fullsized":"2024-09-17T05:45:32.657557+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:45:30.612191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:45:30.612191+0000","last_clean_scrub_stamp":"2024-09-17T05:45:30.612191+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:10:04.148047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":1,"reported_epoch":58,"state":"creating+peering","last_fresh":"2024-09-17T05:45:31.626776+0000","last_change":"2024-09-17T05:45:31.626776+0000","last_active":"2024-09-17T05:45:31.614428+0000","last_peered":"2024-09-17T05:45:31.614428+0000","last_clean":"2024-09-17T05:45:31.614428+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:45:31.626776+0000","last_undegraded":"2024-09-17T05:45:31.626776+0000","last_fullsized":"2024-09-17T05:45:31.626776+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:45:31.614428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:45:31.614428+0000","last_clean_scrub_stamp":"2024-09-17T05:45:31.614428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"59'1","reported_seq":16,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-17T05:45:33.642693+0000","last_change":"2024-09-17T05:45:31.638394+0000","last_active":"2024-09-17T05:45:33.642693+0000","last_peered":"2024-09-17T05:45:33.642693+0000","last_clean":"2024-09-17T05:45:33.642693+0000","last_became_active":"2024-09-17T05:45:31.638048+0000","last_became_peered":"2024-09-17T05:45:31.638048+0000","last_unstale":"2024-09-17T05:45:33.642693+0000","last_undegraded":"2024-09-17T05:45:33.642693+0000","last_fullsized":"2024-09-17T05:45:33.642693+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:45:30.612191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:45:30.612191+0000","last_clean_scrub_stamp":"2024-09-17T05:45:30.612191+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:48:56.125063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.d","version":"0'0","reported_seq":13,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-17T05:45:33.955462+0000","last_change":"2024-09-17T05:45:32.657075+0000","last_active":"2024-09-17T05:45:33.955462+0000","last_peered":"2024-09-17T05:45:33.955462+0000","last_clean":"2024-09-17T05:45:33.955462+0000","last_became_active":"2024-09-17T05:45:32.656753+0000","last_became_peered":"2024-09-17T05:45:32.656753+0000","last_unstale":"2024-09-17T05:45:33.955462+0000","last_undegraded":"2024-09-17T05:45:33.955462+0000","last_fullsized":"2024-09-17T05:45:33.955462+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:45:31.614428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:45:31.614428+0000","last_clean_scrub_stamp":"2024-09-17T05:45:31.614428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:36:46.238066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":13,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-17T05:45:32.624746+0000","last_change":"2024-09-17T05:45:31.643975+0000","last_active":"2024-09-17T05:45:32.624746+0000","last_peered":"2024-09-17T05:45:32.624746+0000","last_clean":"2024-09-17T05:45:32.624746+0000","last_became_active":"2024-09-17T05:45:31.643609+0000","last_became_peered":"2024-09-17T05:45:31.643609+0000","last_unstale":"2024-09-17T05:45:32.624746+0000","last_undegraded":"2024-09-17T05:45:32.624746+0000","last_fullsized":"2024-09-17T05:45:32.624746+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:45:30.612191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:45:30.612191+0000","last_clean_scrub_stamp":"2024-09-17T05:45:30.612191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:49:10.450094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":13,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-17T05:45:33.644055+0000","last_change":"2024-09-17T05:45:32.639943+0000","last_active":"2024-09-17T05:45:33.644055+0000","last_peered":"2024-09-17T05:45:33.644055+0000","last_clean":"2024-09-17T05:45:33.644055+0000","last_became_active":"2024-09-17T05:45:32.639216+0000","last_became_peered":"2024-09-17T05:45:32.639216+0000","last_unstale":"2024-09-17T05:45:33.644055+0000","last_undegraded":"2024-09-17T05:45:33.644055+0000","last_fullsized":"2024-09-17T05:45:33.644055+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:45:31.614428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:45:31.614428+0000","last_clean_scrub_stamp":"2024-09-17T05:45:31.614428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:36:39.409995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":10,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-17T05:45:31.643026+0000","last_change":"2024-09-17T05:45:31.638240+0000","last_active":"2024-09-17T05:45:31.643026+0000","last_peered":"2024-09-17T05:45:31.643026+0000","last_clean":"2024-09-17T05:45:31.643026+0000","last_became_active":"2024-09-17T05:45:31.637885+0000","last_became_peered":"2024-09-17T05:45:31.637885+0000","last_unstale":"2024-09-17T05:45:31.643026+0000","last_undegraded":"2024-09-17T05:45:31.643026+0000","last_fullsized":"2024-09-17T05:45:31.643026+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:45:30.612191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:45:30.612191+0000","last_clean_scrub_stamp":"2024-09-17T05:45:30.612191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:42:29.350273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.b","version":"0'0","reported_seq":10,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-17T05:45:32.650606+0000","last_change":"2024-09-17T05:45:32.646091+0000","last_active":"2024-09-17T05:45:32.650606+0000","last_peered":"2024-09-17T05:45:32.650606+0000","last_clean":"2024-09-17T05:45:32.650606+0000","last_became_active":"2024-09-17T05:45:32.645766+0000","last_became_peered":"2024-09-17T05:45:32.645766+0000","last_unstale":"2024-09-17T05:45:32.650606+0000","last_undegraded":"2024-09-17T05:45:32.650606+0000","last_fullsized":"2024-09-17T05:45:32.650606+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:45:31.614428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:45:31.614428+0000","last_clean_scrub_stamp":"2024-09-17T05:45:31.614428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:41:42.920657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":15,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-17T05:45:33.954645+0000","last_change":"2024-09-17T05:45:31.640272+0000","last_active":"2024-09-17T05:45:33.954645+0000","last_peered":"2024-09-17T05:45:33.954645+0000","last_clean":"2024-09-17T05:45:33.954645+0000","last_became_active":"2024-09-17T05:45:31.639976+0000","last_became_peered":"2024-09-17T05:45:31.639976+0000","last_unstale":"2024-09-17T05:45:33.954645+0000","last_undegraded":"2024-09-17T05:45:33.954645+0000","last_fullsized":"2024-09-17T05:45:33.954645+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:45:30.612191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:45:30.612191+0000","last_clean_scrub_stamp":"2024-09-17T05:45:30.612191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:50:01.810481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":10,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-17T05:45:32.655188+0000","last_change":"2024-09-17T05:45:32.651035+0000","last_active":"2024-09-17T05:45:32.655188+0000","last_peered":"2024-09-17T05:45:32.655188+0000","last_clean":"2024-09-17T05:45:32.655188+0000","last_became_active":"2024-09-17T05:45:32.650692+0000","last_became_peered":"2024-09-17T05:45:32.650692+0000","last_unstale":"2024-09-17T05:45:32.655188+0000","last_undegraded":"2024-09-17T05:45:32.655188+0000","last_fullsized":"2024-09-17T05:45:32.655188+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:45:31.614428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:45:31.614428+0000","last_clean_scrub_stamp":"2024-09-17T05:45:31.614428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:20:10.605318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":15,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-17T05:45:33.642625+0000","last_change":"2024-09-17T05:45:31.643740+0000","last_active":"2024-09-17T05:45:33.642625+0000","last_peered":"2024-09-17T05:45:33.642625+0000","last_clean":"2024-09-17T05:45:33.642625+0000","last_became_active":"2024-09-17T05:45:31.643434+0000","last_became_peered":"2024-09-17T05:45:31.643434+0000","last_unstale":"2024-09-17T05:45:33.642625+0000","last_undegraded":"2024-09-17T05:45:33.642625+0000","last_fullsized":"2024-09-17T05:45:33.642625+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:45:30.612191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:45:30.612191+0000","last_clean_scrub_stamp":"2024-09-17T05:45:30.612191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:07:14.433577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":13,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-17T05:45:33.644080+0000","last_change":"2024-09-17T05:45:32.644449+0000","last_active":"2024-09-17T05:45:33.644080+0000","last_peered":"2024-09-17T05:45:33.644080+0000","last_clean":"2024-09-17T05:45:33.644080+0000","last_became_active":"2024-09-17T05:45:32.641454+0000","last_became_peered":"2024-09-17T05:45:32.641454+0000","last_unstale":"2024-09-17T05:45:33.644080+0000","last_undegraded":"2024-09-17T05:45:33.644080+0000","last_fullsized":"2024-09-17T05:45:33.644080+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:45:31.614428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:45:31.614428+0000","last_clean_scrub_stamp":"2024-09-17T05:45:31.614428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:31:53.970125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.7","version":"59'2","reported_seq":17,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-17T05:45:33.955334+0000","last_change":"2024-09-17T05:45:31.636162+0000","last_active":"2024-09-17T05:45:33.955334+0000","last_peered":"2024-09-17T05:45:33.955334+0000","last_clean":"2024-09-17T05:45:33.955334+0000","last_became_active":"2024-09-17T05:45:31.635754+0000","last_became_peered":"2024-09-17T05:45:31.635754+0000","last_unstale":"2024-09-17T05:45:33.955334+0000","last_undegraded":"2024-09-17T05:45:33.955334+0000","last_fullsized":"2024-09-17T05:45:33.955334+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:45:30.612191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:45:30.612191+0000","last_clean_scrub_stamp":"2024-09-17T05:45:30.612191+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:42:10.421991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.7","version":"0'0","reported_seq":13,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-17T05:45:33.643714+0000","last_change":"2024-09-17T05:45:32.651010+0000","last_active":"2024-09-17T05:45:33.643714+0000","last_peered":"2024-09-17T05:45:33.643714+0000","last_clean":"2024-09-17T05:45:33.643714+0000","last_became_active":"2024-09-17T05:45:32.650681+0000","last_became_peered":"2024-09-17T05:45:32.650681+0000","last_unstale":"2024-09-17T05:45:33.643714+0000","last_undegraded":"2024-09-17T05:45:33.643714+0000","last_fullsized":"2024-09-17T05:45:33.643714+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:45:31.614428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:45:31.614428+0000","last_clean_scrub_stamp":"2024-09-17T05:45:31.614428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:22:10.519690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":13,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-17T05:45:32.626208+0000","last_change":"2024-09-17T05:45:31.639739+0000","last_active":"2024-09-17T05:45:32.626208+0000","last_peered":"2024-09-17T05:45:32.626208+0000","last_clean":"2024-09-17T05:45:32.626208+0000","last_became_active":"2024-09-17T05:45:31.639123+0000","last_became_peered":"2024-09-17T05:45:31.639123+0000","last_unstale":"2024-09-17T05:45:32.626208+0000","last_undegraded":"2024-09-17T05:45:32.626208+0000","last_fullsized":"2024-09-17T05:45:32.626208+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:45:30.612191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:45:30.612191+0000","last_clean_scrub_stamp":"2024-09-17T05:45:30.612191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:47:45.086586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":13,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-17T05:45:33.955091+0000","last_change":"2024-09-17T05:45:32.638243+0000","last_active":"2024-09-17T05:45:33.955091+0000","last_peered":"2024-09-17T05:45:33.955091+0000","last_clean":"2024-09-17T05:45:33.955091+0000","last_became_active":"2024-09-17T05:45:32.637937+0000","last_became_peered":"2024-09-17T05:45:32.637937+0000","last_unstale":"2024-09-17T05:45:33.955091+0000","last_undegraded":"2024-09-17T05:45:33.955091+0000","last_fullsized":"2024-09-17T05:45:33.955091+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:45:31.614428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:45:31.614428+0000","last_clean_scrub_stamp":"2024-09-17T05:45:31.614428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:42:05.704412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":10,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-17T05:45:31.637530+0000","last_change":"2024-09-17T05:45:31.636335+0000","last_active":"2024-09-17T05:45:31.637530+0000","last_peered":"2024-09-17T05:45:31.637530+0000","last_clean":"2024-09-17T05:45:31.637530+0000","last_became_active":"2024-09-17T05:45:31.635851+0000","last_became_peered":"2024-09-17T05:45:31.635851+0000","last_unstale":"2024-09-17T05:45:31.637530+0000","last_undegraded":"2024-09-17T05:45:31.637530+0000","last_fullsized":"2024-09-17T05:45:31.637530+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:45:30.612191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:45:30.612191+0000","last_clean_scrub_stamp":"2024-09-17T05:45:30.612191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:39:41.148406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":10,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-17T05:45:32.643047+0000","last_change":"2024-09-17T05:45:32.634960+0000","last_active":"2024-09-17T05:45:32.643047+0000","last_peered":"2024-09-17T05:45:32.643047+0000","last_clean":"2024-09-17T05:45:32.643047+0000","last_became_active":"2024-09-17T05:45:32.634609+0000","last_became_peered":"2024-09-17T05:45:32.634609+0000","last_unstale":"2024-09-17T05:45:32.643047+0000","last_undegraded":"2024-09-17T05:45:32.643047+0000","last_fullsized":"2024-09-17T05:45:32.643047+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:45:31.614428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:45:31.614428+0000","last_clean_scrub_stamp":"2024-09-17T05:45:31.614428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:41:03.714251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":15,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-17T05:45:33.644013+0000","last_change":"2024-09-17T05:45:31.638944+0000","last_active":"2024-09-17T05:45:33.644013+0000","last_peered":"2024-09-17T05:45:33.644013+0000","last_clean":"2024-09-17T05:45:33.644013+0000","last_became_active":"2024-09-17T05:45:31.638594+0000","last_became_peered":"2024-09-17T05:45:31.638594+0000","last_unstale":"2024-09-17T05:45:33.644013+0000","last_undegraded":"2024-09-17T05:45:33.644013+0000","last_fullsized":"2024-09-17T05:45:33.644013+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:45:30.612191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:45:30.612191+0000","last_clean_scrub_stamp":"2024-09-17T05:45:30.612191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:31:48.568445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":1,"reported_epoch":58,"state":"creating+peering","last_fresh":"2024-09-17T05:45:31.633719+0000","last_change":"2024-09-17T05:45:31.633719+0000","last_active":"2024-09-17T05:45:31.614428+0000","last_peered":"2024-09-17T05:45:31.614428+0000","last_clean":"2024-09-17T05:45:31.614428+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:45:31.633719+0000","last_undegraded":"2024-09-17T05:45:31.633719+0000","last_fullsized":"2024-09-17T05:45:31.633719+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:45:31.614428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:45:31.614428+0000","last_clean_scrub_stamp":"2024-09-17T05:45:31.614428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":15,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-17T05:45:33.954023+0000","last_change":"2024-09-17T05:45:31.640803+0000","last_active":"2024-09-17T05:45:33.954023+0000","last_peered":"2024-09-17T05:45:33.954023+0000","last_clean":"2024-09-17T05:45:33.954023+0000","last_became_active":"2024-09-17T05:45:31.640497+0000","last_became_peered":"2024-09-17T05:45:31.640497+0000","last_unstale":"2024-09-17T05:45:33.954023+0000","last_undegraded":"2024-09-17T05:45:33.954023+0000","last_fullsized":"2024-09-17T05:45:33.954023+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:45:30.612191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:45:30.612191+0000","last_clean_scrub_stamp":"2024-09-17T05:45:30.612191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:05:37.438540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":13,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-17T05:45:33.955297+0000","last_change":"2024-09-17T05:45:32.653467+0000","last_active":"2024-09-17T05:45:33.955297+0000","last_peered":"2024-09-17T05:45:33.955297+0000","last_clean":"2024-09-17T05:45:33.955297+0000","last_became_active":"2024-09-17T05:45:32.653172+0000","last_became_peered":"2024-09-17T05:45:32.653172+0000","last_unstale":"2024-09-17T05:45:33.955297+0000","last_undegraded":"2024-09-17T05:45:33.955297+0000","last_fullsized":"2024-09-17T05:45:33.955297+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:45:31.614428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:45:31.614428+0000","last_clean_scrub_stamp":"2024-09-17T05:45:31.614428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:03:20.634302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":15,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-17T05:45:33.642981+0000","last_change":"2024-09-17T05:45:31.640591+0000","last_active":"2024-09-17T05:45:33.642981+0000","last_peered":"2024-09-17T05:45:33.642981+0000","last_clean":"2024-09-17T05:45:33.642981+0000","last_became_active":"2024-09-17T05:45:31.640103+0000","last_became_peered":"2024-09-17T05:45:31.640103+0000","last_unstale":"2024-09-17T05:45:33.642981+0000","last_undegraded":"2024-09-17T05:45:33.642981+0000","last_fullsized":"2024-09-17T05:45:33.642981+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:45:30.612191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:45:30.612191+0000","last_clean_scrub_stamp":"2024-09-17T05:45:30.612191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:53:07.534995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":13,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-17T05:45:33.954155+0000","last_change":"2024-09-17T05:45:32.648684+0000","last_active":"2024-09-17T05:45:33.954155+0000","last_peered":"2024-09-17T05:45:33.954155+0000","last_clean":"2024-09-17T05:45:33.954155+0000","last_became_active":"2024-09-17T05:45:32.643607+0000","last_became_peered":"2024-09-17T05:45:32.643607+0000","last_unstale":"2024-09-17T05:45:33.954155+0000","last_undegraded":"2024-09-17T05:45:33.954155+0000","last_fullsized":"2024-09-17T05:45:33.954155+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:45:31.614428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:45:31.614428+0000","last_clean_scrub_stamp":"2024-09-17T05:45:31.614428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:32:54.601957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":15,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-17T05:45:33.954224+0000","last_change":"2024-09-17T05:45:31.637639+0000","last_active":"2024-09-17T05:45:33.954224+0000","last_peered":"2024-09-17T05:45:33.954224+0000","last_clean":"2024-09-17T05:45:33.954224+0000","last_became_active":"2024-09-17T05:45:31.637329+0000","last_became_peered":"2024-09-17T05:45:31.637329+0000","last_unstale":"2024-09-17T05:45:33.954224+0000","last_undegraded":"2024-09-17T05:45:33.954224+0000","last_fullsized":"2024-09-17T05:45:33.954224+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:45:30.612191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:45:30.612191+0000","last_clean_scrub_stamp":"2024-09-17T05:45:30.612191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:43:51.042977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":1,"reported_epoch":58,"state":"creating+peering","last_fresh":"2024-09-17T05:45:31.627608+0000","last_change":"2024-09-17T05:45:31.627608+0000","last_active":"2024-09-17T05:45:31.614428+0000","last_peered":"2024-09-17T05:45:31.614428+0000","last_clean":"2024-09-17T05:45:31.614428+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:45:31.627608+0000","last_undegraded":"2024-09-17T05:45:31.627608+0000","last_fullsized":"2024-09-17T05:45:31.627608+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:45:31.614428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:45:31.614428+0000","last_clean_scrub_stamp":"2024-09-17T05:45:31.614428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":10,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-17T05:45:31.643206+0000","last_change":"2024-09-17T05:45:31.639583+0000","last_active":"2024-09-17T05:45:31.643206+0000","last_peered":"2024-09-17T05:45:31.643206+0000","last_clean":"2024-09-17T05:45:31.643206+0000","last_became_active":"2024-09-17T05:45:31.639274+0000","last_became_peered":"2024-09-17T05:45:31.639274+0000","last_unstale":"2024-09-17T05:45:31.643206+0000","last_undegraded":"2024-09-17T05:45:31.643206+0000","last_fullsized":"2024-09-17T05:45:31.643206+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:45:30.612191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:45:30.612191+0000","last_clean_scrub_stamp":"2024-09-17T05:45:30.612191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:32:10.295673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":1,"reported_epoch":58,"state":"creating+peering","last_fresh":"2024-09-17T05:45:31.626798+0000","last_change":"2024-09-17T05:45:31.626798+0000","last_active":"2024-09-17T05:45:31.614428+0000","last_peered":"2024-09-17T05:45:31.614428+0000","last_clean":"2024-09-17T05:45:31.614428+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:45:31.626798+0000","last_undegraded":"2024-09-17T05:45:31.626798+0000","last_fullsized":"2024-09-17T05:45:31.626798+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:45:31.614428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:45:31.614428+0000","last_clean_scrub_stamp":"2024-09-17T05:45:31.614428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":10,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-17T05:45:31.641653+0000","last_change":"2024-09-17T05:45:31.639879+0000","last_active":"2024-09-17T05:45:31.641653+0000","last_peered":"2024-09-17T05:45:31.641653+0000","last_clean":"2024-09-17T05:45:31.641653+0000","last_became_active":"2024-09-17T05:45:31.639553+0000","last_became_peered":"2024-09-17T05:45:31.639553+0000","last_unstale":"2024-09-17T05:45:31.641653+0000","last_undegraded":"2024-09-17T05:45:31.641653+0000","last_fullsized":"2024-09-17T05:45:31.641653+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:45:30.612191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:45:30.612191+0000","last_clean_scrub_stamp":"2024-09-17T05:45:30.612191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:06:24.325125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"19'72","reported_seq":178,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-17T05:45:33.954772+0000","last_change":"2024-09-17T05:41:48.539830+0000","last_active":"2024-09-17T05:45:33.954772+0000","last_peered":"2024-09-17T05:45:33.954772+0000","last_clean":"2024-09-17T05:45:33.954772+0000","last_became_active":"2024-09-17T05:41:48.538743+0000","last_became_peered":"2024-09-17T05:41:48.538743+0000","last_unstale":"2024-09-17T05:45:33.954772+0000","last_undegraded":"2024-09-17T05:45:33.954772+0000","last_fullsized":"2024-09-17T05:45:33.954772+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:47.152539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:47.152539+0000","last_clean_scrub_stamp":"2024-09-17T05:41:47.152539+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:08:02.952016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":9,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":2354,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":39,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":4708,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":32,"ondisk_log_size":32,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":16,"seq":68719476786,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40180,"kb_used_data":672,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331660,"statfs":{"total":96636764160,"available":96595619840,"internally_reserved":0,"allocated":688128,"data_stored":282523,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":40434118},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":7,"up_from":15,"seq":64424509491,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36636,"kb_used_data":1284,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335204,"statfs":{"total":96636764160,"available":96599248896,"internally_reserved":0,"allocated":1314816,"data_stored":886182,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":36174282},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509490,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36052,"kb_used_data":704,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335788,"statfs":{"total":96636764160,"available":96599846912,"internally_reserved":0,"allocated":720896,"data_stored":296306,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509490,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":54112,"kb_used_data":708,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94317728,"statfs":{"total":96636764160,"available":96581353472,"internally_reserved":0,"allocated":724992,"data_stored":297266,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509489,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":54068,"kb_used_data":672,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94317772,"statfs":{"total":96636764160,"available":96581398528,"internally_reserved":0,"allocated":688128,"data_stored":282523,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":54655431},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509489,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36020,"kb_used_data":672,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335820,"statfs":{"total":96636764160,"available":96599879680,"internally_reserved":0,"allocated":688128,"data_stored":282523,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509490,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":54096,"kb_used_data":700,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94317744,"statfs":{"total":96636764160,"available":96581369856,"internally_reserved":0,"allocated":716800,"data_stored":295744,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574897,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":54684,"kb_used_data":1280,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94317156,"statfs":{"total":96636764160,"available":96580767744,"internally_reserved":0,"allocated":1310720,"data_stored":881888,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2194,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-17T05:45:37.015 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-17T05:45:37.165 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:37.163+0000 7f400d7f1640 1 -- 172.21.15.150:0/3686354842 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f40080b6420 msgr2=0x7f40081665a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:45:37.165 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:37.163+0000 7f400d7f1640 1 --2- 172.21.15.150:0/3686354842 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f40080b6420 0x7f40081665a0 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7f4000005fd0 tx=0x7f400002a8b0 comp rx=0 tx=0).stop 2024-09-17T05:45:37.165 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:37.163+0000 7f400d7f1640 1 -- 172.21.15.150:0/3686354842 shutdown_connections 2024-09-17T05:45:37.165 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:37.163+0000 7f400d7f1640 1 --2- 172.21.15.150:0/3686354842 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f40080b6420 0x7f40081665a0 unknown :-1 s=CLOSED pgs=639 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:37.165 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:37.163+0000 7f400d7f1640 1 -- 172.21.15.150:0/3686354842 >> 172.21.15.150:0/3686354842 conn(0x7f40080b2fd0 msgr2=0x7f40080b33e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:45:37.165 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:37.163+0000 7f400d7f1640 1 -- 172.21.15.150:0/3686354842 shutdown_connections 2024-09-17T05:45:37.165 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:37.163+0000 7f400d7f1640 1 -- 172.21.15.150:0/3686354842 wait complete. 2024-09-17T05:45:37.166 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:37.165+0000 7f400d7f1640 1 Processor -- start 2024-09-17T05:45:37.166 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:37.165+0000 7f400d7f1640 1 -- start start 2024-09-17T05:45:37.170 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:37.166+0000 7f400d7f1640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f40080b6420 0x7f400814d150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:45:37.170 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:37.166+0000 7f400d7f1640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f40080cf7c0 0x7f40080b0490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:45:37.170 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:37.166+0000 7f400d7f1640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f400815ee30 0x7f400806cda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:45:37.170 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:37.166+0000 7f400d7f1640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f4008166cf0 con 0x7f40080b6420 2024-09-17T05:45:37.170 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:37.166+0000 7f400d7f1640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f40080b6ae0 con 0x7f400815ee30 2024-09-17T05:45:37.170 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:37.166+0000 7f400d7f1640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f4008166e70 con 0x7f40080cf7c0 2024-09-17T05:45:37.170 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:37.166+0000 7f4006ffd640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f40080b6420 0x7f400814d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:45:37.170 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:37.166+0000 7f4006ffd640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f40080b6420 0x7f400814d150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:39328/0 (socket says 172.21.15.150:39328) 2024-09-17T05:45:37.171 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:37.166+0000 7f4006ffd640 1 -- 172.21.15.150:0/3968152156 learned_addr learned my addr 172.21.15.150:0/3968152156 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:45:37.171 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:37.166+0000 7f40077fe640 1 --2- 172.21.15.150:0/3968152156 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f400815ee30 0x7f400806cda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:45:37.171 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:37.166+0000 7f3ffe7fc640 1 --2- 172.21.15.150:0/3968152156 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f40080cf7c0 0x7f40080b0490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:45:37.171 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:37.167+0000 7f4006ffd640 1 -- 172.21.15.150:0/3968152156 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f40080cf7c0 msgr2=0x7f40080b0490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:45:37.171 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:37.167+0000 7f4006ffd640 1 --2- 172.21.15.150:0/3968152156 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f40080cf7c0 0x7f40080b0490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:37.171 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:37.167+0000 7f4006ffd640 1 -- 172.21.15.150:0/3968152156 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f400815ee30 msgr2=0x7f400806cda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:45:37.171 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:37.167+0000 7f4006ffd640 1 --2- 172.21.15.150:0/3968152156 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f400815ee30 0x7f400806cda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:37.171 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:37.167+0000 7f4006ffd640 1 -- 172.21.15.150:0/3968152156 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f40080af1d0 con 0x7f40080b6420 2024-09-17T05:45:37.171 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:37.167+0000 7f40077fe640 1 --2- 172.21.15.150:0/3968152156 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f400815ee30 0x7f400806cda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T05:45:37.171 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:37.167+0000 7f4006ffd640 1 --2- 172.21.15.150:0/3968152156 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f40080b6420 0x7f400814d150 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7f3ff800c370 tx=0x7f3ff800c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:45:37.171 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:37.167+0000 7f3ffffff640 1 -- 172.21.15.150:0/3968152156 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ff8011790 con 0x7f40080b6420 2024-09-17T05:45:37.171 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:37.167+0000 7f3ffffff640 1 -- 172.21.15.150:0/3968152156 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f3ff8017070 con 0x7f40080b6420 2024-09-17T05:45:37.171 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:37.167+0000 7f400d7f1640 1 -- 172.21.15.150:0/3968152156 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f40080af4b0 con 0x7f40080b6420 2024-09-17T05:45:37.172 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:37.167+0000 7f3ffffff640 1 -- 172.21.15.150:0/3968152156 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ff8011c80 con 0x7f40080b6420 2024-09-17T05:45:37.172 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:37.167+0000 7f400d7f1640 1 -- 172.21.15.150:0/3968152156 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f40080afa70 con 0x7f40080b6420 2024-09-17T05:45:37.172 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:37.168+0000 7f400d7f1640 1 -- 172.21.15.150:0/3968152156 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f40080b2840 con 0x7f40080b6420 2024-09-17T05:45:37.172 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:37.169+0000 7f3ffffff640 1 -- 172.21.15.150:0/3968152156 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 15) ==== 102257+0+0 (secure 0 0 0) 0x7f3ff801c460 con 0x7f40080b6420 2024-09-17T05:45:37.173 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:37.169+0000 7f3ffffff640 1 --2- 172.21.15.150:0/3968152156 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f3fe8079490 0x7f3fe807b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:45:37.173 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:37.169+0000 7f3ffffff640 1 -- 172.21.15.150:0/3968152156 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(60..60 src has 1..60) ==== 5737+0+0 (secure 0 0 0) 0x7f3ff80992e0 con 0x7f40080b6420 2024-09-17T05:45:37.173 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:37.169+0000 7f3ffe7fc640 1 --2- 172.21.15.150:0/3968152156 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f3fe8079490 0x7f3fe807b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:45:37.173 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:37.170+0000 7f3ffe7fc640 1 --2- 172.21.15.150:0/3968152156 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f3fe8079490 0x7f3fe807b9a0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f3ff0006fd0 tx=0x7f3ff0008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:45:37.175 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:37.174+0000 7f3ffffff640 1 -- 172.21.15.150:0/3968152156 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f3ff8063260 con 0x7f40080b6420 2024-09-17T05:45:37.348 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:37.347+0000 7f400d7f1640 1 -- 172.21.15.150:0/3968152156 --> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f40080cffc0 con 0x7f3fe8079490 2024-09-17T05:45:37.353 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:37.351+0000 7f3ffffff640 1 -- 172.21.15.150:0/3968152156 <== mgr.4108 v2:172.21.15.176:6800/3631216395 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+250141 (secure 0 0 0) 0x7f40080cffc0 con 0x7f3fe8079490 2024-09-17T05:45:37.356 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-09-17T05:45:37.357 INFO:teuthology.orchestra.run.smithi150.stderr:dumped all 2024-09-17T05:45:37.358 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:37.354+0000 7f400d7f1640 1 -- 172.21.15.150:0/3968152156 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f3fe8079490 msgr2=0x7f3fe807b9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:45:37.359 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:37.354+0000 7f400d7f1640 1 --2- 172.21.15.150:0/3968152156 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f3fe8079490 0x7f3fe807b9a0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f3ff0006fd0 tx=0x7f3ff0008040 comp rx=0 tx=0).stop 2024-09-17T05:45:37.359 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:37.354+0000 7f400d7f1640 1 -- 172.21.15.150:0/3968152156 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f40080b6420 msgr2=0x7f400814d150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:45:37.359 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:37.354+0000 7f400d7f1640 1 --2- 172.21.15.150:0/3968152156 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f40080b6420 0x7f400814d150 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7f3ff800c370 tx=0x7f3ff800c830 comp rx=0 tx=0).stop 2024-09-17T05:45:37.359 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:37.354+0000 7f400d7f1640 1 -- 172.21.15.150:0/3968152156 shutdown_connections 2024-09-17T05:45:37.359 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:37.354+0000 7f400d7f1640 1 --2- 172.21.15.150:0/3968152156 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f400815ee30 0x7f400806cda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:37.359 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:37.354+0000 7f400d7f1640 1 --2- 172.21.15.150:0/3968152156 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f3fe8079490 0x7f3fe807b9a0 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:37.359 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:37.354+0000 7f400d7f1640 1 --2- 172.21.15.150:0/3968152156 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f40080cf7c0 0x7f40080b0490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:37.359 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:37.354+0000 7f400d7f1640 1 --2- 172.21.15.150:0/3968152156 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f40080b6420 0x7f400814d150 unknown :-1 s=CLOSED pgs=640 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:37.359 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:37.354+0000 7f400d7f1640 1 -- 172.21.15.150:0/3968152156 >> 172.21.15.150:0/3968152156 conn(0x7f40080b2fd0 msgr2=0x7f4008155060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:45:37.359 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:37.355+0000 7f400d7f1640 1 -- 172.21.15.150:0/3968152156 shutdown_connections 2024-09-17T05:45:37.359 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:37.355+0000 7f400d7f1640 1 -- 172.21.15.150:0/3968152156 wait complete. 2024-09-17T05:45:37.367 INFO:teuthology.orchestra.run.smithi150.stdout:{"pg_ready":true,"pg_map":{"version":170,"stamp":"2024-09-17T05:45:36.909116+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592722,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":140,"num_write_kb":1634,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":104,"ondisk_log_size":104,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":108,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":365848,"kb_used_data":6692,"kb_used_omap":12,"kb_used_meta":358963,"kb_avail":754608872,"statfs":{"total":773094113280,"available":772719484928,"internally_reserved":0,"allocated":6852608,"data_stored":3504955,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":367578672},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":27,"apply_latency_ms":27,"commit_latency_ns":27000000,"apply_latency_ns":27000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2354,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":39,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001502"},"pg_stats":[{"pgid":"9.3f","version":"0'0","reported_seq":1,"reported_epoch":58,"state":"creating+peering","last_fresh":"2024-09-17T05:45:31.635800+0000","last_change":"2024-09-17T05:45:31.635800+0000","last_active":"2024-09-17T05:45:31.614428+0000","last_peered":"2024-09-17T05:45:31.614428+0000","last_clean":"2024-09-17T05:45:31.614428+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:45:31.635800+0000","last_undegraded":"2024-09-17T05:45:31.635800+0000","last_fullsized":"2024-09-17T05:45:31.635800+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:45:31.614428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:45:31.614428+0000","last_clean_scrub_stamp":"2024-09-17T05:45:31.614428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3e","version":"0'0","reported_seq":1,"reported_epoch":58,"state":"creating+peering","last_fresh":"2024-09-17T05:45:31.628405+0000","last_change":"2024-09-17T05:45:31.628405+0000","last_active":"2024-09-17T05:45:31.614428+0000","last_peered":"2024-09-17T05:45:31.614428+0000","last_clean":"2024-09-17T05:45:31.614428+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:45:31.628405+0000","last_undegraded":"2024-09-17T05:45:31.628405+0000","last_fullsized":"2024-09-17T05:45:31.628405+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:45:31.614428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:45:31.614428+0000","last_clean_scrub_stamp":"2024-09-17T05:45:31.614428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.3d","version":"0'0","reported_seq":13,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-17T05:45:33.954721+0000","last_change":"2024-09-17T05:45:32.653926+0000","last_active":"2024-09-17T05:45:33.954721+0000","last_peered":"2024-09-17T05:45:33.954721+0000","last_clean":"2024-09-17T05:45:33.954721+0000","last_became_active":"2024-09-17T05:45:32.653577+0000","last_became_peered":"2024-09-17T05:45:32.653577+0000","last_unstale":"2024-09-17T05:45:33.954721+0000","last_undegraded":"2024-09-17T05:45:33.954721+0000","last_fullsized":"2024-09-17T05:45:33.954721+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:45:31.614428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:45:31.614428+0000","last_clean_scrub_stamp":"2024-09-17T05:45:31.614428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:18:45.006839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.3c","version":"0'0","reported_seq":13,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-17T05:45:33.643532+0000","last_change":"2024-09-17T05:45:32.644544+0000","last_active":"2024-09-17T05:45:33.643532+0000","last_peered":"2024-09-17T05:45:33.643532+0000","last_clean":"2024-09-17T05:45:33.643532+0000","last_became_active":"2024-09-17T05:45:32.644206+0000","last_became_peered":"2024-09-17T05:45:32.644206+0000","last_unstale":"2024-09-17T05:45:33.643532+0000","last_undegraded":"2024-09-17T05:45:33.643532+0000","last_fullsized":"2024-09-17T05:45:33.643532+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:45:31.614428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:45:31.614428+0000","last_clean_scrub_stamp":"2024-09-17T05:45:31.614428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:07:39.923649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.3b","version":"0'0","reported_seq":1,"reported_epoch":58,"state":"creating+peering","last_fresh":"2024-09-17T05:45:31.638143+0000","last_change":"2024-09-17T05:45:31.638143+0000","last_active":"2024-09-17T05:45:31.614428+0000","last_peered":"2024-09-17T05:45:31.614428+0000","last_clean":"2024-09-17T05:45:31.614428+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:45:31.638143+0000","last_undegraded":"2024-09-17T05:45:31.638143+0000","last_fullsized":"2024-09-17T05:45:31.638143+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:45:31.614428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:45:31.614428+0000","last_clean_scrub_stamp":"2024-09-17T05:45:31.614428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3a","version":"0'0","reported_seq":10,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-17T05:45:32.642546+0000","last_change":"2024-09-17T05:45:32.639148+0000","last_active":"2024-09-17T05:45:32.642546+0000","last_peered":"2024-09-17T05:45:32.642546+0000","last_clean":"2024-09-17T05:45:32.642546+0000","last_became_active":"2024-09-17T05:45:32.638816+0000","last_became_peered":"2024-09-17T05:45:32.638816+0000","last_unstale":"2024-09-17T05:45:32.642546+0000","last_undegraded":"2024-09-17T05:45:32.642546+0000","last_fullsized":"2024-09-17T05:45:32.642546+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:45:31.614428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:45:31.614428+0000","last_clean_scrub_stamp":"2024-09-17T05:45:31.614428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:47:31.319688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.39","version":"0'0","reported_seq":13,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-17T05:45:33.642542+0000","last_change":"2024-09-17T05:45:32.631297+0000","last_active":"2024-09-17T05:45:33.642542+0000","last_peered":"2024-09-17T05:45:33.642542+0000","last_clean":"2024-09-17T05:45:33.642542+0000","last_became_active":"2024-09-17T05:45:32.630792+0000","last_became_peered":"2024-09-17T05:45:32.630792+0000","last_unstale":"2024-09-17T05:45:33.642542+0000","last_undegraded":"2024-09-17T05:45:33.642542+0000","last_fullsized":"2024-09-17T05:45:33.642542+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:45:31.614428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:45:31.614428+0000","last_clean_scrub_stamp":"2024-09-17T05:45:31.614428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:40:44.182767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.38","version":"0'0","reported_seq":1,"reported_epoch":58,"state":"creating+peering","last_fresh":"2024-09-17T05:45:31.628464+0000","last_change":"2024-09-17T05:45:31.628464+0000","last_active":"2024-09-17T05:45:31.614428+0000","last_peered":"2024-09-17T05:45:31.614428+0000","last_clean":"2024-09-17T05:45:31.614428+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:45:31.628464+0000","last_undegraded":"2024-09-17T05:45:31.628464+0000","last_fullsized":"2024-09-17T05:45:31.628464+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:45:31.614428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:45:31.614428+0000","last_clean_scrub_stamp":"2024-09-17T05:45:31.614428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.37","version":"0'0","reported_seq":13,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-17T05:45:33.643100+0000","last_change":"2024-09-17T05:45:32.629786+0000","last_active":"2024-09-17T05:45:33.643100+0000","last_peered":"2024-09-17T05:45:33.643100+0000","last_clean":"2024-09-17T05:45:33.643100+0000","last_became_active":"2024-09-17T05:45:32.629438+0000","last_became_peered":"2024-09-17T05:45:32.629438+0000","last_unstale":"2024-09-17T05:45:33.643100+0000","last_undegraded":"2024-09-17T05:45:33.643100+0000","last_fullsized":"2024-09-17T05:45:33.643100+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:45:31.614428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:45:31.614428+0000","last_clean_scrub_stamp":"2024-09-17T05:45:31.614428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:06:56.405523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.36","version":"0'0","reported_seq":13,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-17T05:45:33.955260+0000","last_change":"2024-09-17T05:45:32.647536+0000","last_active":"2024-09-17T05:45:33.955260+0000","last_peered":"2024-09-17T05:45:33.955260+0000","last_clean":"2024-09-17T05:45:33.955260+0000","last_became_active":"2024-09-17T05:45:32.647207+0000","last_became_peered":"2024-09-17T05:45:32.647207+0000","last_unstale":"2024-09-17T05:45:33.955260+0000","last_undegraded":"2024-09-17T05:45:33.955260+0000","last_fullsized":"2024-09-17T05:45:33.955260+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:45:31.614428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:45:31.614428+0000","last_clean_scrub_stamp":"2024-09-17T05:45:31.614428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:53:08.537231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.35","version":"0'0","reported_seq":13,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-17T05:45:33.954382+0000","last_change":"2024-09-17T05:45:32.650441+0000","last_active":"2024-09-17T05:45:33.954382+0000","last_peered":"2024-09-17T05:45:33.954382+0000","last_clean":"2024-09-17T05:45:33.954382+0000","last_became_active":"2024-09-17T05:45:32.644229+0000","last_became_peered":"2024-09-17T05:45:32.644229+0000","last_unstale":"2024-09-17T05:45:33.954382+0000","last_undegraded":"2024-09-17T05:45:33.954382+0000","last_fullsized":"2024-09-17T05:45:33.954382+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:45:31.614428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:45:31.614428+0000","last_clean_scrub_stamp":"2024-09-17T05:45:31.614428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:15:00.651839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.34","version":"0'0","reported_seq":13,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-17T05:45:33.643819+0000","last_change":"2024-09-17T05:45:32.648016+0000","last_active":"2024-09-17T05:45:33.643819+0000","last_peered":"2024-09-17T05:45:33.643819+0000","last_clean":"2024-09-17T05:45:33.643819+0000","last_became_active":"2024-09-17T05:45:32.647657+0000","last_became_peered":"2024-09-17T05:45:32.647657+0000","last_unstale":"2024-09-17T05:45:33.643819+0000","last_undegraded":"2024-09-17T05:45:33.643819+0000","last_fullsized":"2024-09-17T05:45:33.643819+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:45:31.614428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:45:31.614428+0000","last_clean_scrub_stamp":"2024-09-17T05:45:31.614428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:15:14.618900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.33","version":"0'0","reported_seq":1,"reported_epoch":58,"state":"creating+peering","last_fresh":"2024-09-17T05:45:31.623675+0000","last_change":"2024-09-17T05:45:31.623675+0000","last_active":"2024-09-17T05:45:31.614428+0000","last_peered":"2024-09-17T05:45:31.614428+0000","last_clean":"2024-09-17T05:45:31.614428+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:45:31.623675+0000","last_undegraded":"2024-09-17T05:45:31.623675+0000","last_fullsized":"2024-09-17T05:45:31.623675+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:45:31.614428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:45:31.614428+0000","last_clean_scrub_stamp":"2024-09-17T05:45:31.614428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.32","version":"0'0","reported_seq":13,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-17T05:45:33.642905+0000","last_change":"2024-09-17T05:45:32.640531+0000","last_active":"2024-09-17T05:45:33.642905+0000","last_peered":"2024-09-17T05:45:33.642905+0000","last_clean":"2024-09-17T05:45:33.642905+0000","last_became_active":"2024-09-17T05:45:32.640176+0000","last_became_peered":"2024-09-17T05:45:32.640176+0000","last_unstale":"2024-09-17T05:45:33.642905+0000","last_undegraded":"2024-09-17T05:45:33.642905+0000","last_fullsized":"2024-09-17T05:45:33.642905+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:45:31.614428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:45:31.614428+0000","last_clean_scrub_stamp":"2024-09-17T05:45:31.614428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:25:16.583193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.31","version":"0'0","reported_seq":13,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-17T05:45:33.643442+0000","last_change":"2024-09-17T05:45:32.637116+0000","last_active":"2024-09-17T05:45:33.643442+0000","last_peered":"2024-09-17T05:45:33.643442+0000","last_clean":"2024-09-17T05:45:33.643442+0000","last_became_active":"2024-09-17T05:45:32.636454+0000","last_became_peered":"2024-09-17T05:45:32.636454+0000","last_unstale":"2024-09-17T05:45:33.643442+0000","last_undegraded":"2024-09-17T05:45:33.643442+0000","last_fullsized":"2024-09-17T05:45:33.643442+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:45:31.614428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:45:31.614428+0000","last_clean_scrub_stamp":"2024-09-17T05:45:31.614428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:05:03.043597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.30","version":"0'0","reported_seq":10,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-17T05:45:32.649772+0000","last_change":"2024-09-17T05:45:32.645281+0000","last_active":"2024-09-17T05:45:32.649772+0000","last_peered":"2024-09-17T05:45:32.649772+0000","last_clean":"2024-09-17T05:45:32.649772+0000","last_became_active":"2024-09-17T05:45:32.644707+0000","last_became_peered":"2024-09-17T05:45:32.644707+0000","last_unstale":"2024-09-17T05:45:32.649772+0000","last_undegraded":"2024-09-17T05:45:32.649772+0000","last_fullsized":"2024-09-17T05:45:32.649772+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:45:31.614428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:45:31.614428+0000","last_clean_scrub_stamp":"2024-09-17T05:45:31.614428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:35:47.004290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.2f","version":"0'0","reported_seq":1,"reported_epoch":58,"state":"creating+peering","last_fresh":"2024-09-17T05:45:31.628311+0000","last_change":"2024-09-17T05:45:31.628311+0000","last_active":"2024-09-17T05:45:31.614428+0000","last_peered":"2024-09-17T05:45:31.614428+0000","last_clean":"2024-09-17T05:45:31.614428+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:45:31.628311+0000","last_undegraded":"2024-09-17T05:45:31.628311+0000","last_fullsized":"2024-09-17T05:45:31.628311+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:45:31.614428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:45:31.614428+0000","last_clean_scrub_stamp":"2024-09-17T05:45:31.614428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2e","version":"0'0","reported_seq":13,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-17T05:45:33.955372+0000","last_change":"2024-09-17T05:45:32.648441+0000","last_active":"2024-09-17T05:45:33.955372+0000","last_peered":"2024-09-17T05:45:33.955372+0000","last_clean":"2024-09-17T05:45:33.955372+0000","last_became_active":"2024-09-17T05:45:32.646007+0000","last_became_peered":"2024-09-17T05:45:32.646007+0000","last_unstale":"2024-09-17T05:45:33.955372+0000","last_undegraded":"2024-09-17T05:45:33.955372+0000","last_fullsized":"2024-09-17T05:45:33.955372+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:45:31.614428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:45:31.614428+0000","last_clean_scrub_stamp":"2024-09-17T05:45:31.614428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:17:14.808917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2d","version":"0'0","reported_seq":1,"reported_epoch":58,"state":"creating+peering","last_fresh":"2024-09-17T05:45:31.633549+0000","last_change":"2024-09-17T05:45:31.633549+0000","last_active":"2024-09-17T05:45:31.614428+0000","last_peered":"2024-09-17T05:45:31.614428+0000","last_clean":"2024-09-17T05:45:31.614428+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:45:31.633549+0000","last_undegraded":"2024-09-17T05:45:31.633549+0000","last_fullsized":"2024-09-17T05:45:31.633549+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:45:31.614428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:45:31.614428+0000","last_clean_scrub_stamp":"2024-09-17T05:45:31.614428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.2c","version":"0'0","reported_seq":1,"reported_epoch":58,"state":"creating+peering","last_fresh":"2024-09-17T05:45:31.628712+0000","last_change":"2024-09-17T05:45:31.628712+0000","last_active":"2024-09-17T05:45:31.614428+0000","last_peered":"2024-09-17T05:45:31.614428+0000","last_clean":"2024-09-17T05:45:31.614428+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:45:31.628712+0000","last_undegraded":"2024-09-17T05:45:31.628712+0000","last_fullsized":"2024-09-17T05:45:31.628712+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:45:31.614428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:45:31.614428+0000","last_clean_scrub_stamp":"2024-09-17T05:45:31.614428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2b","version":"0'0","reported_seq":13,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-17T05:45:33.954893+0000","last_change":"2024-09-17T05:45:32.648315+0000","last_active":"2024-09-17T05:45:33.954893+0000","last_peered":"2024-09-17T05:45:33.954893+0000","last_clean":"2024-09-17T05:45:33.954893+0000","last_became_active":"2024-09-17T05:45:32.646021+0000","last_became_peered":"2024-09-17T05:45:32.646021+0000","last_unstale":"2024-09-17T05:45:33.954893+0000","last_undegraded":"2024-09-17T05:45:33.954893+0000","last_fullsized":"2024-09-17T05:45:33.954893+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:45:31.614428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:45:31.614428+0000","last_clean_scrub_stamp":"2024-09-17T05:45:31.614428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:21:50.109729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2a","version":"0'0","reported_seq":1,"reported_epoch":58,"state":"creating+peering","last_fresh":"2024-09-17T05:45:31.634734+0000","last_change":"2024-09-17T05:45:31.634734+0000","last_active":"2024-09-17T05:45:31.614428+0000","last_peered":"2024-09-17T05:45:31.614428+0000","last_clean":"2024-09-17T05:45:31.614428+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:45:31.634734+0000","last_undegraded":"2024-09-17T05:45:31.634734+0000","last_fullsized":"2024-09-17T05:45:31.634734+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:45:31.614428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:45:31.614428+0000","last_clean_scrub_stamp":"2024-09-17T05:45:31.614428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.29","version":"0'0","reported_seq":13,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-17T05:45:33.955465+0000","last_change":"2024-09-17T05:45:32.651396+0000","last_active":"2024-09-17T05:45:33.955465+0000","last_peered":"2024-09-17T05:45:33.955465+0000","last_clean":"2024-09-17T05:45:33.955465+0000","last_became_active":"2024-09-17T05:45:32.651072+0000","last_became_peered":"2024-09-17T05:45:32.651072+0000","last_unstale":"2024-09-17T05:45:33.955465+0000","last_undegraded":"2024-09-17T05:45:33.955465+0000","last_fullsized":"2024-09-17T05:45:33.955465+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:45:31.614428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:45:31.614428+0000","last_clean_scrub_stamp":"2024-09-17T05:45:31.614428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:44:57.086608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.28","version":"0'0","reported_seq":1,"reported_epoch":58,"state":"creating+peering","last_fresh":"2024-09-17T05:45:31.625136+0000","last_change":"2024-09-17T05:45:31.625136+0000","last_active":"2024-09-17T05:45:31.614428+0000","last_peered":"2024-09-17T05:45:31.614428+0000","last_clean":"2024-09-17T05:45:31.614428+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:45:31.625136+0000","last_undegraded":"2024-09-17T05:45:31.625136+0000","last_fullsized":"2024-09-17T05:45:31.625136+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:45:31.614428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:45:31.614428+0000","last_clean_scrub_stamp":"2024-09-17T05:45:31.614428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.27","version":"0'0","reported_seq":1,"reported_epoch":58,"state":"creating+peering","last_fresh":"2024-09-17T05:45:31.635240+0000","last_change":"2024-09-17T05:45:31.635240+0000","last_active":"2024-09-17T05:45:31.614428+0000","last_peered":"2024-09-17T05:45:31.614428+0000","last_clean":"2024-09-17T05:45:31.614428+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:45:31.635240+0000","last_undegraded":"2024-09-17T05:45:31.635240+0000","last_fullsized":"2024-09-17T05:45:31.635240+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:45:31.614428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:45:31.614428+0000","last_clean_scrub_stamp":"2024-09-17T05:45:31.614428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.26","version":"0'0","reported_seq":13,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-17T05:45:33.643810+0000","last_change":"2024-09-17T05:45:32.631723+0000","last_active":"2024-09-17T05:45:33.643810+0000","last_peered":"2024-09-17T05:45:33.643810+0000","last_clean":"2024-09-17T05:45:33.643810+0000","last_became_active":"2024-09-17T05:45:32.631351+0000","last_became_peered":"2024-09-17T05:45:32.631351+0000","last_unstale":"2024-09-17T05:45:33.643810+0000","last_undegraded":"2024-09-17T05:45:33.643810+0000","last_fullsized":"2024-09-17T05:45:33.643810+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:45:31.614428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:45:31.614428+0000","last_clean_scrub_stamp":"2024-09-17T05:45:31.614428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:17:02.678048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.25","version":"0'0","reported_seq":10,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-17T05:45:32.643075+0000","last_change":"2024-09-17T05:45:32.637435+0000","last_active":"2024-09-17T05:45:32.643075+0000","last_peered":"2024-09-17T05:45:32.643075+0000","last_clean":"2024-09-17T05:45:32.643075+0000","last_became_active":"2024-09-17T05:45:32.637137+0000","last_became_peered":"2024-09-17T05:45:32.637137+0000","last_unstale":"2024-09-17T05:45:32.643075+0000","last_undegraded":"2024-09-17T05:45:32.643075+0000","last_fullsized":"2024-09-17T05:45:32.643075+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:45:31.614428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:45:31.614428+0000","last_clean_scrub_stamp":"2024-09-17T05:45:31.614428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:40:05.262567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.24","version":"0'0","reported_seq":1,"reported_epoch":58,"state":"creating+peering","last_fresh":"2024-09-17T05:45:31.635964+0000","last_change":"2024-09-17T05:45:31.635964+0000","last_active":"2024-09-17T05:45:31.614428+0000","last_peered":"2024-09-17T05:45:31.614428+0000","last_clean":"2024-09-17T05:45:31.614428+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:45:31.635964+0000","last_undegraded":"2024-09-17T05:45:31.635964+0000","last_fullsized":"2024-09-17T05:45:31.635964+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:45:31.614428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:45:31.614428+0000","last_clean_scrub_stamp":"2024-09-17T05:45:31.614428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.23","version":"0'0","reported_seq":1,"reported_epoch":58,"state":"creating+peering","last_fresh":"2024-09-17T05:45:31.631473+0000","last_change":"2024-09-17T05:45:31.631473+0000","last_active":"2024-09-17T05:45:31.614428+0000","last_peered":"2024-09-17T05:45:31.614428+0000","last_clean":"2024-09-17T05:45:31.614428+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:45:31.631473+0000","last_undegraded":"2024-09-17T05:45:31.631473+0000","last_fullsized":"2024-09-17T05:45:31.631473+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:45:31.614428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:45:31.614428+0000","last_clean_scrub_stamp":"2024-09-17T05:45:31.614428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.22","version":"0'0","reported_seq":13,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-17T05:45:33.954765+0000","last_change":"2024-09-17T05:45:32.655106+0000","last_active":"2024-09-17T05:45:33.954765+0000","last_peered":"2024-09-17T05:45:33.954765+0000","last_clean":"2024-09-17T05:45:33.954765+0000","last_became_active":"2024-09-17T05:45:32.654852+0000","last_became_peered":"2024-09-17T05:45:32.654852+0000","last_unstale":"2024-09-17T05:45:33.954765+0000","last_undegraded":"2024-09-17T05:45:33.954765+0000","last_fullsized":"2024-09-17T05:45:33.954765+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:45:31.614428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:45:31.614428+0000","last_clean_scrub_stamp":"2024-09-17T05:45:31.614428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:57:53.829103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.21","version":"0'0","reported_seq":1,"reported_epoch":58,"state":"creating+peering","last_fresh":"2024-09-17T05:45:31.633306+0000","last_change":"2024-09-17T05:45:31.633306+0000","last_active":"2024-09-17T05:45:31.614428+0000","last_peered":"2024-09-17T05:45:31.614428+0000","last_clean":"2024-09-17T05:45:31.614428+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:45:31.633306+0000","last_undegraded":"2024-09-17T05:45:31.633306+0000","last_fullsized":"2024-09-17T05:45:31.633306+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:45:31.614428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:45:31.614428+0000","last_clean_scrub_stamp":"2024-09-17T05:45:31.614428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.20","version":"0'0","reported_seq":10,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-17T05:45:32.644914+0000","last_change":"2024-09-17T05:45:32.641063+0000","last_active":"2024-09-17T05:45:32.644914+0000","last_peered":"2024-09-17T05:45:32.644914+0000","last_clean":"2024-09-17T05:45:32.644914+0000","last_became_active":"2024-09-17T05:45:32.640742+0000","last_became_peered":"2024-09-17T05:45:32.640742+0000","last_unstale":"2024-09-17T05:45:32.644914+0000","last_undegraded":"2024-09-17T05:45:32.644914+0000","last_fullsized":"2024-09-17T05:45:32.644914+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:45:31.614428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:45:31.614428+0000","last_clean_scrub_stamp":"2024-09-17T05:45:31.614428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:07:58.852633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1e","version":"0'0","reported_seq":10,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-17T05:45:32.657055+0000","last_change":"2024-09-17T05:45:32.654896+0000","last_active":"2024-09-17T05:45:32.657055+0000","last_peered":"2024-09-17T05:45:32.657055+0000","last_clean":"2024-09-17T05:45:32.657055+0000","last_became_active":"2024-09-17T05:45:32.652165+0000","last_became_peered":"2024-09-17T05:45:32.652165+0000","last_unstale":"2024-09-17T05:45:32.657055+0000","last_undegraded":"2024-09-17T05:45:32.657055+0000","last_fullsized":"2024-09-17T05:45:32.657055+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:45:31.614428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:45:31.614428+0000","last_clean_scrub_stamp":"2024-09-17T05:45:31.614428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:51:41.489630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1f","version":"59'4","reported_seq":17,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-17T05:45:32.655111+0000","last_change":"2024-09-17T05:45:31.639533+0000","last_active":"2024-09-17T05:45:32.655111+0000","last_peered":"2024-09-17T05:45:32.655111+0000","last_clean":"2024-09-17T05:45:32.655111+0000","last_became_active":"2024-09-17T05:45:31.638859+0000","last_became_peered":"2024-09-17T05:45:31.638859+0000","last_unstale":"2024-09-17T05:45:32.655111+0000","last_undegraded":"2024-09-17T05:45:32.655111+0000","last_fullsized":"2024-09-17T05:45:32.655111+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:45:30.612191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:45:30.612191+0000","last_clean_scrub_stamp":"2024-09-17T05:45:30.612191+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:50:36.495235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1f","version":"0'0","reported_seq":13,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-17T05:45:33.955336+0000","last_change":"2024-09-17T05:45:32.650676+0000","last_active":"2024-09-17T05:45:33.955336+0000","last_peered":"2024-09-17T05:45:33.955336+0000","last_clean":"2024-09-17T05:45:33.955336+0000","last_became_active":"2024-09-17T05:45:32.650377+0000","last_became_peered":"2024-09-17T05:45:32.650377+0000","last_unstale":"2024-09-17T05:45:33.955336+0000","last_undegraded":"2024-09-17T05:45:33.955336+0000","last_fullsized":"2024-09-17T05:45:33.955336+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:45:31.614428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:45:31.614428+0000","last_clean_scrub_stamp":"2024-09-17T05:45:31.614428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:42:03.873298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":10,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-17T05:45:31.636336+0000","last_change":"2024-09-17T05:45:31.629458+0000","last_active":"2024-09-17T05:45:31.636336+0000","last_peered":"2024-09-17T05:45:31.636336+0000","last_clean":"2024-09-17T05:45:31.636336+0000","last_became_active":"2024-09-17T05:45:31.629161+0000","last_became_peered":"2024-09-17T05:45:31.629161+0000","last_unstale":"2024-09-17T05:45:31.636336+0000","last_undegraded":"2024-09-17T05:45:31.636336+0000","last_fullsized":"2024-09-17T05:45:31.636336+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:45:30.612191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:45:30.612191+0000","last_clean_scrub_stamp":"2024-09-17T05:45:30.612191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:13:41.291969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.1c","version":"0'0","reported_seq":10,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-17T05:45:32.642493+0000","last_change":"2024-09-17T05:45:32.639921+0000","last_active":"2024-09-17T05:45:32.642493+0000","last_peered":"2024-09-17T05:45:32.642493+0000","last_clean":"2024-09-17T05:45:32.642493+0000","last_became_active":"2024-09-17T05:45:32.639588+0000","last_became_peered":"2024-09-17T05:45:32.639588+0000","last_unstale":"2024-09-17T05:45:32.642493+0000","last_undegraded":"2024-09-17T05:45:32.642493+0000","last_fullsized":"2024-09-17T05:45:32.642493+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:45:31.614428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:45:31.614428+0000","last_clean_scrub_stamp":"2024-09-17T05:45:31.614428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:58:26.605060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1d","version":"59'2","reported_seq":15,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-17T05:45:32.658108+0000","last_change":"2024-09-17T05:45:31.634645+0000","last_active":"2024-09-17T05:45:32.658108+0000","last_peered":"2024-09-17T05:45:32.658108+0000","last_clean":"2024-09-17T05:45:32.658108+0000","last_became_active":"2024-09-17T05:45:31.634306+0000","last_became_peered":"2024-09-17T05:45:31.634306+0000","last_unstale":"2024-09-17T05:45:32.658108+0000","last_undegraded":"2024-09-17T05:45:32.658108+0000","last_fullsized":"2024-09-17T05:45:32.658108+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:45:30.612191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:45:30.612191+0000","last_clean_scrub_stamp":"2024-09-17T05:45:30.612191+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:11:50.501779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1d","version":"0'0","reported_seq":10,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-17T05:45:32.643019+0000","last_change":"2024-09-17T05:45:32.634215+0000","last_active":"2024-09-17T05:45:32.643019+0000","last_peered":"2024-09-17T05:45:32.643019+0000","last_clean":"2024-09-17T05:45:32.643019+0000","last_became_active":"2024-09-17T05:45:32.633773+0000","last_became_peered":"2024-09-17T05:45:32.633773+0000","last_unstale":"2024-09-17T05:45:32.643019+0000","last_undegraded":"2024-09-17T05:45:32.643019+0000","last_fullsized":"2024-09-17T05:45:32.643019+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:45:31.614428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:45:31.614428+0000","last_clean_scrub_stamp":"2024-09-17T05:45:31.614428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:31:38.357082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1c","version":"59'2","reported_seq":17,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-17T05:45:33.643901+0000","last_change":"2024-09-17T05:45:31.642391+0000","last_active":"2024-09-17T05:45:33.643901+0000","last_peered":"2024-09-17T05:45:33.643901+0000","last_clean":"2024-09-17T05:45:33.643901+0000","last_became_active":"2024-09-17T05:45:31.641969+0000","last_became_peered":"2024-09-17T05:45:31.641969+0000","last_unstale":"2024-09-17T05:45:33.643901+0000","last_undegraded":"2024-09-17T05:45:33.643901+0000","last_fullsized":"2024-09-17T05:45:33.643901+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:45:30.612191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:45:30.612191+0000","last_clean_scrub_stamp":"2024-09-17T05:45:30.612191+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:25:15.580957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.1a","version":"0'0","reported_seq":1,"reported_epoch":58,"state":"creating+peering","last_fresh":"2024-09-17T05:45:31.634200+0000","last_change":"2024-09-17T05:45:31.634200+0000","last_active":"2024-09-17T05:45:31.614428+0000","last_peered":"2024-09-17T05:45:31.614428+0000","last_clean":"2024-09-17T05:45:31.614428+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:45:31.634200+0000","last_undegraded":"2024-09-17T05:45:31.634200+0000","last_fullsized":"2024-09-17T05:45:31.634200+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:45:31.614428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:45:31.614428+0000","last_clean_scrub_stamp":"2024-09-17T05:45:31.614428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"59'1","reported_seq":16,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-17T05:45:33.642253+0000","last_change":"2024-09-17T05:45:31.644223+0000","last_active":"2024-09-17T05:45:33.642253+0000","last_peered":"2024-09-17T05:45:33.642253+0000","last_clean":"2024-09-17T05:45:33.642253+0000","last_became_active":"2024-09-17T05:45:31.643842+0000","last_became_peered":"2024-09-17T05:45:31.643842+0000","last_unstale":"2024-09-17T05:45:33.642253+0000","last_undegraded":"2024-09-17T05:45:33.642253+0000","last_fullsized":"2024-09-17T05:45:33.642253+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:45:30.612191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:45:30.612191+0000","last_clean_scrub_stamp":"2024-09-17T05:45:30.612191+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:42:04.702175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1b","version":"0'0","reported_seq":1,"reported_epoch":58,"state":"creating+peering","last_fresh":"2024-09-17T05:45:31.630970+0000","last_change":"2024-09-17T05:45:31.630970+0000","last_active":"2024-09-17T05:45:31.614428+0000","last_peered":"2024-09-17T05:45:31.614428+0000","last_clean":"2024-09-17T05:45:31.614428+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:45:31.630970+0000","last_undegraded":"2024-09-17T05:45:31.630970+0000","last_fullsized":"2024-09-17T05:45:31.630970+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:45:31.614428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:45:31.614428+0000","last_clean_scrub_stamp":"2024-09-17T05:45:31.614428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1a","version":"59'1","reported_seq":14,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-17T05:45:32.649523+0000","last_change":"2024-09-17T05:45:31.637200+0000","last_active":"2024-09-17T05:45:32.649523+0000","last_peered":"2024-09-17T05:45:32.649523+0000","last_clean":"2024-09-17T05:45:32.649523+0000","last_became_active":"2024-09-17T05:45:31.636713+0000","last_became_peered":"2024-09-17T05:45:31.636713+0000","last_unstale":"2024-09-17T05:45:32.649523+0000","last_undegraded":"2024-09-17T05:45:32.649523+0000","last_fullsized":"2024-09-17T05:45:32.649523+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:45:30.612191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:45:30.612191+0000","last_clean_scrub_stamp":"2024-09-17T05:45:30.612191+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:22:55.029575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":1,"reported_epoch":58,"state":"creating+peering","last_fresh":"2024-09-17T05:45:31.623504+0000","last_change":"2024-09-17T05:45:31.623504+0000","last_active":"2024-09-17T05:45:31.614428+0000","last_peered":"2024-09-17T05:45:31.614428+0000","last_clean":"2024-09-17T05:45:31.614428+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:45:31.623504+0000","last_undegraded":"2024-09-17T05:45:31.623504+0000","last_fullsized":"2024-09-17T05:45:31.623504+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:45:31.614428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:45:31.614428+0000","last_clean_scrub_stamp":"2024-09-17T05:45:31.614428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":15,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-17T05:45:33.642939+0000","last_change":"2024-09-17T05:45:31.639388+0000","last_active":"2024-09-17T05:45:33.642939+0000","last_peered":"2024-09-17T05:45:33.642939+0000","last_clean":"2024-09-17T05:45:33.642939+0000","last_became_active":"2024-09-17T05:45:31.639055+0000","last_became_peered":"2024-09-17T05:45:31.639055+0000","last_unstale":"2024-09-17T05:45:33.642939+0000","last_undegraded":"2024-09-17T05:45:33.642939+0000","last_fullsized":"2024-09-17T05:45:33.642939+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:45:30.612191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:45:30.612191+0000","last_clean_scrub_stamp":"2024-09-17T05:45:30.612191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:40:43.180531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":1,"reported_epoch":58,"state":"creating+peering","last_fresh":"2024-09-17T05:45:31.632251+0000","last_change":"2024-09-17T05:45:31.632251+0000","last_active":"2024-09-17T05:45:31.614428+0000","last_peered":"2024-09-17T05:45:31.614428+0000","last_clean":"2024-09-17T05:45:31.614428+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:45:31.632251+0000","last_undegraded":"2024-09-17T05:45:31.632251+0000","last_fullsized":"2024-09-17T05:45:31.632251+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:45:31.614428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:45:31.614428+0000","last_clean_scrub_stamp":"2024-09-17T05:45:31.614428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":15,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-17T05:45:33.642214+0000","last_change":"2024-09-17T05:45:31.640961+0000","last_active":"2024-09-17T05:45:33.642214+0000","last_peered":"2024-09-17T05:45:33.642214+0000","last_clean":"2024-09-17T05:45:33.642214+0000","last_became_active":"2024-09-17T05:45:31.640611+0000","last_became_peered":"2024-09-17T05:45:31.640611+0000","last_unstale":"2024-09-17T05:45:33.642214+0000","last_undegraded":"2024-09-17T05:45:33.642214+0000","last_fullsized":"2024-09-17T05:45:33.642214+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:45:30.612191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:45:30.612191+0000","last_clean_scrub_stamp":"2024-09-17T05:45:30.612191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:42:02.871061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":13,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-17T05:45:33.643152+0000","last_change":"2024-09-17T05:45:32.639298+0000","last_active":"2024-09-17T05:45:33.643152+0000","last_peered":"2024-09-17T05:45:33.643152+0000","last_clean":"2024-09-17T05:45:33.643152+0000","last_became_active":"2024-09-17T05:45:32.638969+0000","last_became_peered":"2024-09-17T05:45:32.638969+0000","last_unstale":"2024-09-17T05:45:33.643152+0000","last_undegraded":"2024-09-17T05:45:33.643152+0000","last_fullsized":"2024-09-17T05:45:33.643152+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:45:31.614428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:45:31.614428+0000","last_clean_scrub_stamp":"2024-09-17T05:45:31.614428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:14:04.950271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":15,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-17T05:45:33.955451+0000","last_change":"2024-09-17T05:45:31.639874+0000","last_active":"2024-09-17T05:45:33.955451+0000","last_peered":"2024-09-17T05:45:33.955451+0000","last_clean":"2024-09-17T05:45:33.955451+0000","last_became_active":"2024-09-17T05:45:31.639537+0000","last_became_peered":"2024-09-17T05:45:31.639537+0000","last_unstale":"2024-09-17T05:45:33.955451+0000","last_undegraded":"2024-09-17T05:45:33.955451+0000","last_fullsized":"2024-09-17T05:45:33.955451+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:45:30.612191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:45:30.612191+0000","last_clean_scrub_stamp":"2024-09-17T05:45:30.612191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:28:11.674936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":13,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-17T05:45:33.955442+0000","last_change":"2024-09-17T05:45:32.654783+0000","last_active":"2024-09-17T05:45:33.955442+0000","last_peered":"2024-09-17T05:45:33.955442+0000","last_clean":"2024-09-17T05:45:33.955442+0000","last_became_active":"2024-09-17T05:45:32.654448+0000","last_became_peered":"2024-09-17T05:45:32.654448+0000","last_unstale":"2024-09-17T05:45:33.955442+0000","last_undegraded":"2024-09-17T05:45:33.955442+0000","last_fullsized":"2024-09-17T05:45:33.955442+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:45:31.614428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:45:31.614428+0000","last_clean_scrub_stamp":"2024-09-17T05:45:31.614428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:14:04.792704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":10,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-17T05:45:31.643163+0000","last_change":"2024-09-17T05:45:31.640475+0000","last_active":"2024-09-17T05:45:31.643163+0000","last_peered":"2024-09-17T05:45:31.643163+0000","last_clean":"2024-09-17T05:45:31.643163+0000","last_became_active":"2024-09-17T05:45:31.640191+0000","last_became_peered":"2024-09-17T05:45:31.640191+0000","last_unstale":"2024-09-17T05:45:31.643163+0000","last_undegraded":"2024-09-17T05:45:31.643163+0000","last_fullsized":"2024-09-17T05:45:31.643163+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:45:30.612191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:45:30.612191+0000","last_clean_scrub_stamp":"2024-09-17T05:45:30.612191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:18:44.004602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.14","version":"0'0","reported_seq":13,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-17T05:45:33.954927+0000","last_change":"2024-09-17T05:45:32.648272+0000","last_active":"2024-09-17T05:45:33.954927+0000","last_peered":"2024-09-17T05:45:33.954927+0000","last_clean":"2024-09-17T05:45:33.954927+0000","last_became_active":"2024-09-17T05:45:32.642778+0000","last_became_peered":"2024-09-17T05:45:32.642778+0000","last_unstale":"2024-09-17T05:45:33.954927+0000","last_undegraded":"2024-09-17T05:45:33.954927+0000","last_fullsized":"2024-09-17T05:45:33.954927+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:45:31.614428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:45:31.614428+0000","last_clean_scrub_stamp":"2024-09-17T05:45:31.614428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:27:46.994037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.15","version":"59'3","reported_seq":18,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-17T05:45:33.955209+0000","last_change":"2024-09-17T05:45:31.631099+0000","last_active":"2024-09-17T05:45:33.955209+0000","last_peered":"2024-09-17T05:45:33.955209+0000","last_clean":"2024-09-17T05:45:33.955209+0000","last_became_active":"2024-09-17T05:45:31.630774+0000","last_became_peered":"2024-09-17T05:45:31.630774+0000","last_unstale":"2024-09-17T05:45:33.955209+0000","last_undegraded":"2024-09-17T05:45:33.955209+0000","last_fullsized":"2024-09-17T05:45:33.955209+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:45:30.612191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:45:30.612191+0000","last_clean_scrub_stamp":"2024-09-17T05:45:30.612191+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:59:40.798271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.15","version":"0'0","reported_seq":13,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-17T05:45:33.955107+0000","last_change":"2024-09-17T05:45:32.656952+0000","last_active":"2024-09-17T05:45:33.955107+0000","last_peered":"2024-09-17T05:45:33.955107+0000","last_clean":"2024-09-17T05:45:33.955107+0000","last_became_active":"2024-09-17T05:45:32.656656+0000","last_became_peered":"2024-09-17T05:45:32.656656+0000","last_unstale":"2024-09-17T05:45:33.955107+0000","last_undegraded":"2024-09-17T05:45:33.955107+0000","last_fullsized":"2024-09-17T05:45:33.955107+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:45:31.614428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:45:31.614428+0000","last_clean_scrub_stamp":"2024-09-17T05:45:31.614428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:15:14.618900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.14","version":"59'6","reported_seq":21,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-17T05:45:33.642762+0000","last_change":"2024-09-17T05:45:31.637717+0000","last_active":"2024-09-17T05:45:33.642762+0000","last_peered":"2024-09-17T05:45:33.642762+0000","last_clean":"2024-09-17T05:45:33.642762+0000","last_became_active":"2024-09-17T05:45:31.637335+0000","last_became_peered":"2024-09-17T05:45:31.637335+0000","last_unstale":"2024-09-17T05:45:33.642762+0000","last_undegraded":"2024-09-17T05:45:33.642762+0000","last_fullsized":"2024-09-17T05:45:33.642762+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:45:30.612191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:45:30.612191+0000","last_clean_scrub_stamp":"2024-09-17T05:45:30.612191+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:28:45.681547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":13,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-17T05:45:33.643776+0000","last_change":"2024-09-17T05:45:32.640295+0000","last_active":"2024-09-17T05:45:33.643776+0000","last_peered":"2024-09-17T05:45:33.643776+0000","last_clean":"2024-09-17T05:45:33.643776+0000","last_became_active":"2024-09-17T05:45:32.639626+0000","last_became_peered":"2024-09-17T05:45:32.639626+0000","last_unstale":"2024-09-17T05:45:33.643776+0000","last_undegraded":"2024-09-17T05:45:33.643776+0000","last_fullsized":"2024-09-17T05:45:33.643776+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:45:31.614428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:45:31.614428+0000","last_clean_scrub_stamp":"2024-09-17T05:45:31.614428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:23:18.865215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":10,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-17T05:45:31.647136+0000","last_change":"2024-09-17T05:45:31.644303+0000","last_active":"2024-09-17T05:45:31.647136+0000","last_peered":"2024-09-17T05:45:31.647136+0000","last_clean":"2024-09-17T05:45:31.647136+0000","last_became_active":"2024-09-17T05:45:31.644011+0000","last_became_peered":"2024-09-17T05:45:31.644011+0000","last_unstale":"2024-09-17T05:45:31.647136+0000","last_undegraded":"2024-09-17T05:45:31.647136+0000","last_fullsized":"2024-09-17T05:45:31.647136+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:45:30.612191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:45:30.612191+0000","last_clean_scrub_stamp":"2024-09-17T05:45:30.612191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:57:52.826866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.13","version":"0'0","reported_seq":13,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-17T05:45:33.954984+0000","last_change":"2024-09-17T05:45:32.649405+0000","last_active":"2024-09-17T05:45:33.954984+0000","last_peered":"2024-09-17T05:45:33.954984+0000","last_clean":"2024-09-17T05:45:33.954984+0000","last_became_active":"2024-09-17T05:45:32.649052+0000","last_became_peered":"2024-09-17T05:45:32.649052+0000","last_unstale":"2024-09-17T05:45:33.954984+0000","last_undegraded":"2024-09-17T05:45:33.954984+0000","last_fullsized":"2024-09-17T05:45:33.954984+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:45:31.614428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:45:31.614428+0000","last_clean_scrub_stamp":"2024-09-17T05:45:31.614428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:14:32.500946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":10,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-17T05:45:31.635300+0000","last_change":"2024-09-17T05:45:31.629800+0000","last_active":"2024-09-17T05:45:31.635300+0000","last_peered":"2024-09-17T05:45:31.635300+0000","last_clean":"2024-09-17T05:45:31.635300+0000","last_became_active":"2024-09-17T05:45:31.629475+0000","last_became_peered":"2024-09-17T05:45:31.629475+0000","last_unstale":"2024-09-17T05:45:31.635300+0000","last_undegraded":"2024-09-17T05:45:31.635300+0000","last_fullsized":"2024-09-17T05:45:31.635300+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:45:30.612191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:45:30.612191+0000","last_clean_scrub_stamp":"2024-09-17T05:45:30.612191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:26:33.564340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.10","version":"0'0","reported_seq":13,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-17T05:45:33.642459+0000","last_change":"2024-09-17T05:45:32.647139+0000","last_active":"2024-09-17T05:45:33.642459+0000","last_peered":"2024-09-17T05:45:33.642459+0000","last_clean":"2024-09-17T05:45:33.642459+0000","last_became_active":"2024-09-17T05:45:32.646721+0000","last_became_peered":"2024-09-17T05:45:32.646721+0000","last_unstale":"2024-09-17T05:45:33.642459+0000","last_undegraded":"2024-09-17T05:45:33.642459+0000","last_fullsized":"2024-09-17T05:45:33.642459+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:45:31.614428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:45:31.614428+0000","last_clean_scrub_stamp":"2024-09-17T05:45:31.614428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:10:56.650561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":15,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-17T05:45:33.643055+0000","last_change":"2024-09-17T05:45:31.638931+0000","last_active":"2024-09-17T05:45:33.643055+0000","last_peered":"2024-09-17T05:45:33.643055+0000","last_clean":"2024-09-17T05:45:33.643055+0000","last_became_active":"2024-09-17T05:45:31.638553+0000","last_became_peered":"2024-09-17T05:45:31.638553+0000","last_unstale":"2024-09-17T05:45:33.643055+0000","last_undegraded":"2024-09-17T05:45:33.643055+0000","last_fullsized":"2024-09-17T05:45:33.643055+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:45:30.612191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:45:30.612191+0000","last_clean_scrub_stamp":"2024-09-17T05:45:30.612191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:10:55.648324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":13,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-17T05:45:33.955462+0000","last_change":"2024-09-17T05:45:32.653723+0000","last_active":"2024-09-17T05:45:33.955462+0000","last_peered":"2024-09-17T05:45:33.955462+0000","last_clean":"2024-09-17T05:45:33.955462+0000","last_became_active":"2024-09-17T05:45:32.653153+0000","last_became_peered":"2024-09-17T05:45:32.653153+0000","last_unstale":"2024-09-17T05:45:33.955462+0000","last_undegraded":"2024-09-17T05:45:33.955462+0000","last_fullsized":"2024-09-17T05:45:33.955462+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:45:31.614428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:45:31.614428+0000","last_clean_scrub_stamp":"2024-09-17T05:45:31.614428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:07:41.347650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.10","version":"59'8","reported_seq":23,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-17T05:45:33.954532+0000","last_change":"2024-09-17T05:45:31.639504+0000","last_active":"2024-09-17T05:45:33.954532+0000","last_peered":"2024-09-17T05:45:33.954532+0000","last_clean":"2024-09-17T05:45:33.954532+0000","last_became_active":"2024-09-17T05:45:31.638977+0000","last_became_peered":"2024-09-17T05:45:31.638977+0000","last_unstale":"2024-09-17T05:45:33.954532+0000","last_undegraded":"2024-09-17T05:45:33.954532+0000","last_fullsized":"2024-09-17T05:45:33.954532+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:45:30.612191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:45:30.612191+0000","last_clean_scrub_stamp":"2024-09-17T05:45:30.612191+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:07:21.436157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.e","version":"0'0","reported_seq":13,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-17T05:45:33.955484+0000","last_change":"2024-09-17T05:45:32.653968+0000","last_active":"2024-09-17T05:45:33.955484+0000","last_peered":"2024-09-17T05:45:33.955484+0000","last_clean":"2024-09-17T05:45:33.955484+0000","last_became_active":"2024-09-17T05:45:32.653675+0000","last_became_peered":"2024-09-17T05:45:32.653675+0000","last_unstale":"2024-09-17T05:45:33.955484+0000","last_undegraded":"2024-09-17T05:45:33.955484+0000","last_fullsized":"2024-09-17T05:45:33.955484+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:45:31.614428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:45:31.614428+0000","last_clean_scrub_stamp":"2024-09-17T05:45:31.614428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:52:42.817700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":10,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-17T05:45:31.643225+0000","last_change":"2024-09-17T05:45:31.640449+0000","last_active":"2024-09-17T05:45:31.643225+0000","last_peered":"2024-09-17T05:45:31.643225+0000","last_clean":"2024-09-17T05:45:31.643225+0000","last_became_active":"2024-09-17T05:45:31.640151+0000","last_became_peered":"2024-09-17T05:45:31.640151+0000","last_unstale":"2024-09-17T05:45:31.643225+0000","last_undegraded":"2024-09-17T05:45:31.643225+0000","last_fullsized":"2024-09-17T05:45:31.643225+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:45:30.612191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:45:30.612191+0000","last_clean_scrub_stamp":"2024-09-17T05:45:30.612191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:45:55.100047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.f","version":"0'0","reported_seq":13,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-17T05:45:33.643484+0000","last_change":"2024-09-17T05:45:32.645212+0000","last_active":"2024-09-17T05:45:33.643484+0000","last_peered":"2024-09-17T05:45:33.643484+0000","last_clean":"2024-09-17T05:45:33.643484+0000","last_became_active":"2024-09-17T05:45:32.644921+0000","last_became_peered":"2024-09-17T05:45:32.644921+0000","last_unstale":"2024-09-17T05:45:33.643484+0000","last_undegraded":"2024-09-17T05:45:33.643484+0000","last_fullsized":"2024-09-17T05:45:33.643484+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:45:31.614428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:45:31.614428+0000","last_clean_scrub_stamp":"2024-09-17T05:45:31.614428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:15:12.766358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.e","version":"59'2","reported_seq":15,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-17T05:45:32.657557+0000","last_change":"2024-09-17T05:45:31.640980+0000","last_active":"2024-09-17T05:45:32.657557+0000","last_peered":"2024-09-17T05:45:32.657557+0000","last_clean":"2024-09-17T05:45:32.657557+0000","last_became_active":"2024-09-17T05:45:31.640679+0000","last_became_peered":"2024-09-17T05:45:31.640679+0000","last_unstale":"2024-09-17T05:45:32.657557+0000","last_undegraded":"2024-09-17T05:45:32.657557+0000","last_fullsized":"2024-09-17T05:45:32.657557+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:45:30.612191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:45:30.612191+0000","last_clean_scrub_stamp":"2024-09-17T05:45:30.612191+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:10:04.148047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":1,"reported_epoch":58,"state":"creating+peering","last_fresh":"2024-09-17T05:45:31.626776+0000","last_change":"2024-09-17T05:45:31.626776+0000","last_active":"2024-09-17T05:45:31.614428+0000","last_peered":"2024-09-17T05:45:31.614428+0000","last_clean":"2024-09-17T05:45:31.614428+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:45:31.626776+0000","last_undegraded":"2024-09-17T05:45:31.626776+0000","last_fullsized":"2024-09-17T05:45:31.626776+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:45:31.614428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:45:31.614428+0000","last_clean_scrub_stamp":"2024-09-17T05:45:31.614428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"59'1","reported_seq":16,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-17T05:45:33.642693+0000","last_change":"2024-09-17T05:45:31.638394+0000","last_active":"2024-09-17T05:45:33.642693+0000","last_peered":"2024-09-17T05:45:33.642693+0000","last_clean":"2024-09-17T05:45:33.642693+0000","last_became_active":"2024-09-17T05:45:31.638048+0000","last_became_peered":"2024-09-17T05:45:31.638048+0000","last_unstale":"2024-09-17T05:45:33.642693+0000","last_undegraded":"2024-09-17T05:45:33.642693+0000","last_fullsized":"2024-09-17T05:45:33.642693+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:45:30.612191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:45:30.612191+0000","last_clean_scrub_stamp":"2024-09-17T05:45:30.612191+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:48:56.125063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.d","version":"0'0","reported_seq":13,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-17T05:45:33.955462+0000","last_change":"2024-09-17T05:45:32.657075+0000","last_active":"2024-09-17T05:45:33.955462+0000","last_peered":"2024-09-17T05:45:33.955462+0000","last_clean":"2024-09-17T05:45:33.955462+0000","last_became_active":"2024-09-17T05:45:32.656753+0000","last_became_peered":"2024-09-17T05:45:32.656753+0000","last_unstale":"2024-09-17T05:45:33.955462+0000","last_undegraded":"2024-09-17T05:45:33.955462+0000","last_fullsized":"2024-09-17T05:45:33.955462+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:45:31.614428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:45:31.614428+0000","last_clean_scrub_stamp":"2024-09-17T05:45:31.614428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:36:46.238066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":13,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-17T05:45:32.624746+0000","last_change":"2024-09-17T05:45:31.643975+0000","last_active":"2024-09-17T05:45:32.624746+0000","last_peered":"2024-09-17T05:45:32.624746+0000","last_clean":"2024-09-17T05:45:32.624746+0000","last_became_active":"2024-09-17T05:45:31.643609+0000","last_became_peered":"2024-09-17T05:45:31.643609+0000","last_unstale":"2024-09-17T05:45:32.624746+0000","last_undegraded":"2024-09-17T05:45:32.624746+0000","last_fullsized":"2024-09-17T05:45:32.624746+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:45:30.612191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:45:30.612191+0000","last_clean_scrub_stamp":"2024-09-17T05:45:30.612191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:49:10.450094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":13,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-17T05:45:33.644055+0000","last_change":"2024-09-17T05:45:32.639943+0000","last_active":"2024-09-17T05:45:33.644055+0000","last_peered":"2024-09-17T05:45:33.644055+0000","last_clean":"2024-09-17T05:45:33.644055+0000","last_became_active":"2024-09-17T05:45:32.639216+0000","last_became_peered":"2024-09-17T05:45:32.639216+0000","last_unstale":"2024-09-17T05:45:33.644055+0000","last_undegraded":"2024-09-17T05:45:33.644055+0000","last_fullsized":"2024-09-17T05:45:33.644055+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:45:31.614428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:45:31.614428+0000","last_clean_scrub_stamp":"2024-09-17T05:45:31.614428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:36:39.409995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":10,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-17T05:45:31.643026+0000","last_change":"2024-09-17T05:45:31.638240+0000","last_active":"2024-09-17T05:45:31.643026+0000","last_peered":"2024-09-17T05:45:31.643026+0000","last_clean":"2024-09-17T05:45:31.643026+0000","last_became_active":"2024-09-17T05:45:31.637885+0000","last_became_peered":"2024-09-17T05:45:31.637885+0000","last_unstale":"2024-09-17T05:45:31.643026+0000","last_undegraded":"2024-09-17T05:45:31.643026+0000","last_fullsized":"2024-09-17T05:45:31.643026+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:45:30.612191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:45:30.612191+0000","last_clean_scrub_stamp":"2024-09-17T05:45:30.612191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:42:29.350273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.b","version":"0'0","reported_seq":10,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-17T05:45:32.650606+0000","last_change":"2024-09-17T05:45:32.646091+0000","last_active":"2024-09-17T05:45:32.650606+0000","last_peered":"2024-09-17T05:45:32.650606+0000","last_clean":"2024-09-17T05:45:32.650606+0000","last_became_active":"2024-09-17T05:45:32.645766+0000","last_became_peered":"2024-09-17T05:45:32.645766+0000","last_unstale":"2024-09-17T05:45:32.650606+0000","last_undegraded":"2024-09-17T05:45:32.650606+0000","last_fullsized":"2024-09-17T05:45:32.650606+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:45:31.614428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:45:31.614428+0000","last_clean_scrub_stamp":"2024-09-17T05:45:31.614428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:41:42.920657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":15,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-17T05:45:33.954645+0000","last_change":"2024-09-17T05:45:31.640272+0000","last_active":"2024-09-17T05:45:33.954645+0000","last_peered":"2024-09-17T05:45:33.954645+0000","last_clean":"2024-09-17T05:45:33.954645+0000","last_became_active":"2024-09-17T05:45:31.639976+0000","last_became_peered":"2024-09-17T05:45:31.639976+0000","last_unstale":"2024-09-17T05:45:33.954645+0000","last_undegraded":"2024-09-17T05:45:33.954645+0000","last_fullsized":"2024-09-17T05:45:33.954645+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:45:30.612191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:45:30.612191+0000","last_clean_scrub_stamp":"2024-09-17T05:45:30.612191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:50:01.810481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":10,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-17T05:45:32.655188+0000","last_change":"2024-09-17T05:45:32.651035+0000","last_active":"2024-09-17T05:45:32.655188+0000","last_peered":"2024-09-17T05:45:32.655188+0000","last_clean":"2024-09-17T05:45:32.655188+0000","last_became_active":"2024-09-17T05:45:32.650692+0000","last_became_peered":"2024-09-17T05:45:32.650692+0000","last_unstale":"2024-09-17T05:45:32.655188+0000","last_undegraded":"2024-09-17T05:45:32.655188+0000","last_fullsized":"2024-09-17T05:45:32.655188+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:45:31.614428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:45:31.614428+0000","last_clean_scrub_stamp":"2024-09-17T05:45:31.614428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:20:10.605318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":15,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-17T05:45:33.642625+0000","last_change":"2024-09-17T05:45:31.643740+0000","last_active":"2024-09-17T05:45:33.642625+0000","last_peered":"2024-09-17T05:45:33.642625+0000","last_clean":"2024-09-17T05:45:33.642625+0000","last_became_active":"2024-09-17T05:45:31.643434+0000","last_became_peered":"2024-09-17T05:45:31.643434+0000","last_unstale":"2024-09-17T05:45:33.642625+0000","last_undegraded":"2024-09-17T05:45:33.642625+0000","last_fullsized":"2024-09-17T05:45:33.642625+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:45:30.612191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:45:30.612191+0000","last_clean_scrub_stamp":"2024-09-17T05:45:30.612191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:07:14.433577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":13,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-17T05:45:33.644080+0000","last_change":"2024-09-17T05:45:32.644449+0000","last_active":"2024-09-17T05:45:33.644080+0000","last_peered":"2024-09-17T05:45:33.644080+0000","last_clean":"2024-09-17T05:45:33.644080+0000","last_became_active":"2024-09-17T05:45:32.641454+0000","last_became_peered":"2024-09-17T05:45:32.641454+0000","last_unstale":"2024-09-17T05:45:33.644080+0000","last_undegraded":"2024-09-17T05:45:33.644080+0000","last_fullsized":"2024-09-17T05:45:33.644080+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:45:31.614428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:45:31.614428+0000","last_clean_scrub_stamp":"2024-09-17T05:45:31.614428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:31:53.970125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.7","version":"59'2","reported_seq":17,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-17T05:45:33.955334+0000","last_change":"2024-09-17T05:45:31.636162+0000","last_active":"2024-09-17T05:45:33.955334+0000","last_peered":"2024-09-17T05:45:33.955334+0000","last_clean":"2024-09-17T05:45:33.955334+0000","last_became_active":"2024-09-17T05:45:31.635754+0000","last_became_peered":"2024-09-17T05:45:31.635754+0000","last_unstale":"2024-09-17T05:45:33.955334+0000","last_undegraded":"2024-09-17T05:45:33.955334+0000","last_fullsized":"2024-09-17T05:45:33.955334+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:45:30.612191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:45:30.612191+0000","last_clean_scrub_stamp":"2024-09-17T05:45:30.612191+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:42:10.421991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.7","version":"0'0","reported_seq":13,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-17T05:45:33.643714+0000","last_change":"2024-09-17T05:45:32.651010+0000","last_active":"2024-09-17T05:45:33.643714+0000","last_peered":"2024-09-17T05:45:33.643714+0000","last_clean":"2024-09-17T05:45:33.643714+0000","last_became_active":"2024-09-17T05:45:32.650681+0000","last_became_peered":"2024-09-17T05:45:32.650681+0000","last_unstale":"2024-09-17T05:45:33.643714+0000","last_undegraded":"2024-09-17T05:45:33.643714+0000","last_fullsized":"2024-09-17T05:45:33.643714+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:45:31.614428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:45:31.614428+0000","last_clean_scrub_stamp":"2024-09-17T05:45:31.614428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:22:10.519690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":13,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-17T05:45:32.626208+0000","last_change":"2024-09-17T05:45:31.639739+0000","last_active":"2024-09-17T05:45:32.626208+0000","last_peered":"2024-09-17T05:45:32.626208+0000","last_clean":"2024-09-17T05:45:32.626208+0000","last_became_active":"2024-09-17T05:45:31.639123+0000","last_became_peered":"2024-09-17T05:45:31.639123+0000","last_unstale":"2024-09-17T05:45:32.626208+0000","last_undegraded":"2024-09-17T05:45:32.626208+0000","last_fullsized":"2024-09-17T05:45:32.626208+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:45:30.612191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:45:30.612191+0000","last_clean_scrub_stamp":"2024-09-17T05:45:30.612191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:47:45.086586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":13,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-17T05:45:33.955091+0000","last_change":"2024-09-17T05:45:32.638243+0000","last_active":"2024-09-17T05:45:33.955091+0000","last_peered":"2024-09-17T05:45:33.955091+0000","last_clean":"2024-09-17T05:45:33.955091+0000","last_became_active":"2024-09-17T05:45:32.637937+0000","last_became_peered":"2024-09-17T05:45:32.637937+0000","last_unstale":"2024-09-17T05:45:33.955091+0000","last_undegraded":"2024-09-17T05:45:33.955091+0000","last_fullsized":"2024-09-17T05:45:33.955091+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:45:31.614428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:45:31.614428+0000","last_clean_scrub_stamp":"2024-09-17T05:45:31.614428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:42:05.704412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":10,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-17T05:45:31.637530+0000","last_change":"2024-09-17T05:45:31.636335+0000","last_active":"2024-09-17T05:45:31.637530+0000","last_peered":"2024-09-17T05:45:31.637530+0000","last_clean":"2024-09-17T05:45:31.637530+0000","last_became_active":"2024-09-17T05:45:31.635851+0000","last_became_peered":"2024-09-17T05:45:31.635851+0000","last_unstale":"2024-09-17T05:45:31.637530+0000","last_undegraded":"2024-09-17T05:45:31.637530+0000","last_fullsized":"2024-09-17T05:45:31.637530+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:45:30.612191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:45:30.612191+0000","last_clean_scrub_stamp":"2024-09-17T05:45:30.612191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:39:41.148406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":10,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-17T05:45:32.643047+0000","last_change":"2024-09-17T05:45:32.634960+0000","last_active":"2024-09-17T05:45:32.643047+0000","last_peered":"2024-09-17T05:45:32.643047+0000","last_clean":"2024-09-17T05:45:32.643047+0000","last_became_active":"2024-09-17T05:45:32.634609+0000","last_became_peered":"2024-09-17T05:45:32.634609+0000","last_unstale":"2024-09-17T05:45:32.643047+0000","last_undegraded":"2024-09-17T05:45:32.643047+0000","last_fullsized":"2024-09-17T05:45:32.643047+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:45:31.614428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:45:31.614428+0000","last_clean_scrub_stamp":"2024-09-17T05:45:31.614428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:41:03.714251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":15,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-17T05:45:33.644013+0000","last_change":"2024-09-17T05:45:31.638944+0000","last_active":"2024-09-17T05:45:33.644013+0000","last_peered":"2024-09-17T05:45:33.644013+0000","last_clean":"2024-09-17T05:45:33.644013+0000","last_became_active":"2024-09-17T05:45:31.638594+0000","last_became_peered":"2024-09-17T05:45:31.638594+0000","last_unstale":"2024-09-17T05:45:33.644013+0000","last_undegraded":"2024-09-17T05:45:33.644013+0000","last_fullsized":"2024-09-17T05:45:33.644013+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:45:30.612191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:45:30.612191+0000","last_clean_scrub_stamp":"2024-09-17T05:45:30.612191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:31:48.568445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":1,"reported_epoch":58,"state":"creating+peering","last_fresh":"2024-09-17T05:45:31.633719+0000","last_change":"2024-09-17T05:45:31.633719+0000","last_active":"2024-09-17T05:45:31.614428+0000","last_peered":"2024-09-17T05:45:31.614428+0000","last_clean":"2024-09-17T05:45:31.614428+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:45:31.633719+0000","last_undegraded":"2024-09-17T05:45:31.633719+0000","last_fullsized":"2024-09-17T05:45:31.633719+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:45:31.614428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:45:31.614428+0000","last_clean_scrub_stamp":"2024-09-17T05:45:31.614428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":15,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-17T05:45:33.954023+0000","last_change":"2024-09-17T05:45:31.640803+0000","last_active":"2024-09-17T05:45:33.954023+0000","last_peered":"2024-09-17T05:45:33.954023+0000","last_clean":"2024-09-17T05:45:33.954023+0000","last_became_active":"2024-09-17T05:45:31.640497+0000","last_became_peered":"2024-09-17T05:45:31.640497+0000","last_unstale":"2024-09-17T05:45:33.954023+0000","last_undegraded":"2024-09-17T05:45:33.954023+0000","last_fullsized":"2024-09-17T05:45:33.954023+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:45:30.612191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:45:30.612191+0000","last_clean_scrub_stamp":"2024-09-17T05:45:30.612191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:05:37.438540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":13,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-17T05:45:33.955297+0000","last_change":"2024-09-17T05:45:32.653467+0000","last_active":"2024-09-17T05:45:33.955297+0000","last_peered":"2024-09-17T05:45:33.955297+0000","last_clean":"2024-09-17T05:45:33.955297+0000","last_became_active":"2024-09-17T05:45:32.653172+0000","last_became_peered":"2024-09-17T05:45:32.653172+0000","last_unstale":"2024-09-17T05:45:33.955297+0000","last_undegraded":"2024-09-17T05:45:33.955297+0000","last_fullsized":"2024-09-17T05:45:33.955297+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:45:31.614428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:45:31.614428+0000","last_clean_scrub_stamp":"2024-09-17T05:45:31.614428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:03:20.634302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":15,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-17T05:45:33.642981+0000","last_change":"2024-09-17T05:45:31.640591+0000","last_active":"2024-09-17T05:45:33.642981+0000","last_peered":"2024-09-17T05:45:33.642981+0000","last_clean":"2024-09-17T05:45:33.642981+0000","last_became_active":"2024-09-17T05:45:31.640103+0000","last_became_peered":"2024-09-17T05:45:31.640103+0000","last_unstale":"2024-09-17T05:45:33.642981+0000","last_undegraded":"2024-09-17T05:45:33.642981+0000","last_fullsized":"2024-09-17T05:45:33.642981+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:45:30.612191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:45:30.612191+0000","last_clean_scrub_stamp":"2024-09-17T05:45:30.612191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:53:07.534995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":13,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-17T05:45:33.954155+0000","last_change":"2024-09-17T05:45:32.648684+0000","last_active":"2024-09-17T05:45:33.954155+0000","last_peered":"2024-09-17T05:45:33.954155+0000","last_clean":"2024-09-17T05:45:33.954155+0000","last_became_active":"2024-09-17T05:45:32.643607+0000","last_became_peered":"2024-09-17T05:45:32.643607+0000","last_unstale":"2024-09-17T05:45:33.954155+0000","last_undegraded":"2024-09-17T05:45:33.954155+0000","last_fullsized":"2024-09-17T05:45:33.954155+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:45:31.614428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:45:31.614428+0000","last_clean_scrub_stamp":"2024-09-17T05:45:31.614428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:32:54.601957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":15,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-17T05:45:33.954224+0000","last_change":"2024-09-17T05:45:31.637639+0000","last_active":"2024-09-17T05:45:33.954224+0000","last_peered":"2024-09-17T05:45:33.954224+0000","last_clean":"2024-09-17T05:45:33.954224+0000","last_became_active":"2024-09-17T05:45:31.637329+0000","last_became_peered":"2024-09-17T05:45:31.637329+0000","last_unstale":"2024-09-17T05:45:33.954224+0000","last_undegraded":"2024-09-17T05:45:33.954224+0000","last_fullsized":"2024-09-17T05:45:33.954224+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:45:30.612191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:45:30.612191+0000","last_clean_scrub_stamp":"2024-09-17T05:45:30.612191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:43:51.042977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":1,"reported_epoch":58,"state":"creating+peering","last_fresh":"2024-09-17T05:45:31.627608+0000","last_change":"2024-09-17T05:45:31.627608+0000","last_active":"2024-09-17T05:45:31.614428+0000","last_peered":"2024-09-17T05:45:31.614428+0000","last_clean":"2024-09-17T05:45:31.614428+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:45:31.627608+0000","last_undegraded":"2024-09-17T05:45:31.627608+0000","last_fullsized":"2024-09-17T05:45:31.627608+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:45:31.614428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:45:31.614428+0000","last_clean_scrub_stamp":"2024-09-17T05:45:31.614428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":10,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-17T05:45:31.643206+0000","last_change":"2024-09-17T05:45:31.639583+0000","last_active":"2024-09-17T05:45:31.643206+0000","last_peered":"2024-09-17T05:45:31.643206+0000","last_clean":"2024-09-17T05:45:31.643206+0000","last_became_active":"2024-09-17T05:45:31.639274+0000","last_became_peered":"2024-09-17T05:45:31.639274+0000","last_unstale":"2024-09-17T05:45:31.643206+0000","last_undegraded":"2024-09-17T05:45:31.643206+0000","last_fullsized":"2024-09-17T05:45:31.643206+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:45:30.612191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:45:30.612191+0000","last_clean_scrub_stamp":"2024-09-17T05:45:30.612191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:32:10.295673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":1,"reported_epoch":58,"state":"creating+peering","last_fresh":"2024-09-17T05:45:31.626798+0000","last_change":"2024-09-17T05:45:31.626798+0000","last_active":"2024-09-17T05:45:31.614428+0000","last_peered":"2024-09-17T05:45:31.614428+0000","last_clean":"2024-09-17T05:45:31.614428+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:45:31.626798+0000","last_undegraded":"2024-09-17T05:45:31.626798+0000","last_fullsized":"2024-09-17T05:45:31.626798+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:45:31.614428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:45:31.614428+0000","last_clean_scrub_stamp":"2024-09-17T05:45:31.614428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":10,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-17T05:45:31.641653+0000","last_change":"2024-09-17T05:45:31.639879+0000","last_active":"2024-09-17T05:45:31.641653+0000","last_peered":"2024-09-17T05:45:31.641653+0000","last_clean":"2024-09-17T05:45:31.641653+0000","last_became_active":"2024-09-17T05:45:31.639553+0000","last_became_peered":"2024-09-17T05:45:31.639553+0000","last_unstale":"2024-09-17T05:45:31.641653+0000","last_undegraded":"2024-09-17T05:45:31.641653+0000","last_fullsized":"2024-09-17T05:45:31.641653+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:45:30.612191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:45:30.612191+0000","last_clean_scrub_stamp":"2024-09-17T05:45:30.612191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:06:24.325125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"19'72","reported_seq":178,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-17T05:45:33.954772+0000","last_change":"2024-09-17T05:41:48.539830+0000","last_active":"2024-09-17T05:45:33.954772+0000","last_peered":"2024-09-17T05:45:33.954772+0000","last_clean":"2024-09-17T05:45:33.954772+0000","last_became_active":"2024-09-17T05:41:48.538743+0000","last_became_peered":"2024-09-17T05:41:48.538743+0000","last_unstale":"2024-09-17T05:45:33.954772+0000","last_undegraded":"2024-09-17T05:45:33.954772+0000","last_fullsized":"2024-09-17T05:45:33.954772+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:47.152539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:47.152539+0000","last_clean_scrub_stamp":"2024-09-17T05:41:47.152539+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:08:02.952016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":9,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":2354,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":39,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":4708,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":32,"ondisk_log_size":32,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":16,"seq":68719476786,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40180,"kb_used_data":672,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331660,"statfs":{"total":96636764160,"available":96595619840,"internally_reserved":0,"allocated":688128,"data_stored":282523,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":40434118},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":7,"up_from":15,"seq":64424509491,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36636,"kb_used_data":1284,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335204,"statfs":{"total":96636764160,"available":96599248896,"internally_reserved":0,"allocated":1314816,"data_stored":886182,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":36174282},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509490,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36052,"kb_used_data":704,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335788,"statfs":{"total":96636764160,"available":96599846912,"internally_reserved":0,"allocated":720896,"data_stored":296306,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509490,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":54112,"kb_used_data":708,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94317728,"statfs":{"total":96636764160,"available":96581353472,"internally_reserved":0,"allocated":724992,"data_stored":297266,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509489,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":54068,"kb_used_data":672,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94317772,"statfs":{"total":96636764160,"available":96581398528,"internally_reserved":0,"allocated":688128,"data_stored":282523,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":54655431},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509489,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36020,"kb_used_data":672,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335820,"statfs":{"total":96636764160,"available":96599879680,"internally_reserved":0,"allocated":688128,"data_stored":282523,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509490,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":54096,"kb_used_data":700,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94317744,"statfs":{"total":96636764160,"available":96581369856,"internally_reserved":0,"allocated":716800,"data_stored":295744,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574897,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":54684,"kb_used_data":1280,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94317156,"statfs":{"total":96636764160,"available":96580767744,"internally_reserved":0,"allocated":1310720,"data_stored":881888,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2194,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-17T05:45:37.372 INFO:tasks.ceph.ceph_manager.ceph:PG 9.3f is not active+clean 2024-09-17T05:45:37.372 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.3f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 58, 'state': 'creating+peering', 'last_fresh': '2024-09-17T05:45:31.635800+0000', 'last_change': '2024-09-17T05:45:31.635800+0000', 'last_active': '2024-09-17T05:45:31.614428+0000', 'last_peered': '2024-09-17T05:45:31.614428+0000', 'last_clean': '2024-09-17T05:45:31.614428+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:45:31.635800+0000', 'last_undegraded': '2024-09-17T05:45:31.635800+0000', 'last_fullsized': '2024-09-17T05:45:31.635800+0000', 'mapping_epoch': 58, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 58, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:45:31.614428+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:45:31.614428+0000', 'last_clean_scrub_stamp': '2024-09-17T05:45:31.614428+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 3], 'acting': [2, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-17T05:45:37.372 INFO:tasks.ceph.ceph_manager.ceph:PG 9.3e is not active+clean 2024-09-17T05:45:37.372 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.3e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 58, 'state': 'creating+peering', 'last_fresh': '2024-09-17T05:45:31.628405+0000', 'last_change': '2024-09-17T05:45:31.628405+0000', 'last_active': '2024-09-17T05:45:31.614428+0000', 'last_peered': '2024-09-17T05:45:31.614428+0000', 'last_clean': '2024-09-17T05:45:31.614428+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:45:31.628405+0000', 'last_undegraded': '2024-09-17T05:45:31.628405+0000', 'last_fullsized': '2024-09-17T05:45:31.628405+0000', 'mapping_epoch': 58, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 58, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:45:31.614428+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:45:31.614428+0000', 'last_clean_scrub_stamp': '2024-09-17T05:45:31.614428+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 1], 'acting': [3, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-17T05:45:37.373 INFO:tasks.ceph.ceph_manager.ceph:PG 9.3b is not active+clean 2024-09-17T05:45:37.373 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.3b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 58, 'state': 'creating+peering', 'last_fresh': '2024-09-17T05:45:31.638143+0000', 'last_change': '2024-09-17T05:45:31.638143+0000', 'last_active': '2024-09-17T05:45:31.614428+0000', 'last_peered': '2024-09-17T05:45:31.614428+0000', 'last_clean': '2024-09-17T05:45:31.614428+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:45:31.638143+0000', 'last_undegraded': '2024-09-17T05:45:31.638143+0000', 'last_fullsized': '2024-09-17T05:45:31.638143+0000', 'mapping_epoch': 58, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 58, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:45:31.614428+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:45:31.614428+0000', 'last_clean_scrub_stamp': '2024-09-17T05:45:31.614428+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 5], 'acting': [2, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-17T05:45:37.373 INFO:tasks.ceph.ceph_manager.ceph:PG 9.38 is not active+clean 2024-09-17T05:45:37.373 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.38', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 58, 'state': 'creating+peering', 'last_fresh': '2024-09-17T05:45:31.628464+0000', 'last_change': '2024-09-17T05:45:31.628464+0000', 'last_active': '2024-09-17T05:45:31.614428+0000', 'last_peered': '2024-09-17T05:45:31.614428+0000', 'last_clean': '2024-09-17T05:45:31.614428+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:45:31.628464+0000', 'last_undegraded': '2024-09-17T05:45:31.628464+0000', 'last_fullsized': '2024-09-17T05:45:31.628464+0000', 'mapping_epoch': 58, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 58, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:45:31.614428+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:45:31.614428+0000', 'last_clean_scrub_stamp': '2024-09-17T05:45:31.614428+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 4], 'acting': [3, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-17T05:45:37.373 INFO:tasks.ceph.ceph_manager.ceph:PG 9.33 is not active+clean 2024-09-17T05:45:37.373 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.33', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 58, 'state': 'creating+peering', 'last_fresh': '2024-09-17T05:45:31.623675+0000', 'last_change': '2024-09-17T05:45:31.623675+0000', 'last_active': '2024-09-17T05:45:31.614428+0000', 'last_peered': '2024-09-17T05:45:31.614428+0000', 'last_clean': '2024-09-17T05:45:31.614428+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:45:31.623675+0000', 'last_undegraded': '2024-09-17T05:45:31.623675+0000', 'last_fullsized': '2024-09-17T05:45:31.623675+0000', 'mapping_epoch': 58, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 58, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:45:31.614428+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:45:31.614428+0000', 'last_clean_scrub_stamp': '2024-09-17T05:45:31.614428+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 0], 'acting': [6, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-17T05:45:37.373 INFO:tasks.ceph.ceph_manager.ceph:PG 9.2f is not active+clean 2024-09-17T05:45:37.373 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.2f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 58, 'state': 'creating+peering', 'last_fresh': '2024-09-17T05:45:31.628311+0000', 'last_change': '2024-09-17T05:45:31.628311+0000', 'last_active': '2024-09-17T05:45:31.614428+0000', 'last_peered': '2024-09-17T05:45:31.614428+0000', 'last_clean': '2024-09-17T05:45:31.614428+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:45:31.628311+0000', 'last_undegraded': '2024-09-17T05:45:31.628311+0000', 'last_fullsized': '2024-09-17T05:45:31.628311+0000', 'mapping_epoch': 58, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 58, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:45:31.614428+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:45:31.614428+0000', 'last_clean_scrub_stamp': '2024-09-17T05:45:31.614428+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 6], 'acting': [3, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-17T05:45:37.373 INFO:tasks.ceph.ceph_manager.ceph:PG 9.2d is not active+clean 2024-09-17T05:45:37.373 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.2d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 58, 'state': 'creating+peering', 'last_fresh': '2024-09-17T05:45:31.633549+0000', 'last_change': '2024-09-17T05:45:31.633549+0000', 'last_active': '2024-09-17T05:45:31.614428+0000', 'last_peered': '2024-09-17T05:45:31.614428+0000', 'last_clean': '2024-09-17T05:45:31.614428+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:45:31.633549+0000', 'last_undegraded': '2024-09-17T05:45:31.633549+0000', 'last_fullsized': '2024-09-17T05:45:31.633549+0000', 'mapping_epoch': 58, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 58, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:45:31.614428+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:45:31.614428+0000', 'last_clean_scrub_stamp': '2024-09-17T05:45:31.614428+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 3], 'acting': [2, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-17T05:45:37.374 INFO:tasks.ceph.ceph_manager.ceph:PG 9.2c is not active+clean 2024-09-17T05:45:37.374 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.2c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 58, 'state': 'creating+peering', 'last_fresh': '2024-09-17T05:45:31.628712+0000', 'last_change': '2024-09-17T05:45:31.628712+0000', 'last_active': '2024-09-17T05:45:31.614428+0000', 'last_peered': '2024-09-17T05:45:31.614428+0000', 'last_clean': '2024-09-17T05:45:31.614428+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:45:31.628712+0000', 'last_undegraded': '2024-09-17T05:45:31.628712+0000', 'last_fullsized': '2024-09-17T05:45:31.628712+0000', 'mapping_epoch': 58, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 58, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:45:31.614428+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:45:31.614428+0000', 'last_clean_scrub_stamp': '2024-09-17T05:45:31.614428+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 0], 'acting': [3, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-17T05:45:37.374 INFO:tasks.ceph.ceph_manager.ceph:PG 9.2a is not active+clean 2024-09-17T05:45:37.374 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.2a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 58, 'state': 'creating+peering', 'last_fresh': '2024-09-17T05:45:31.634734+0000', 'last_change': '2024-09-17T05:45:31.634734+0000', 'last_active': '2024-09-17T05:45:31.614428+0000', 'last_peered': '2024-09-17T05:45:31.614428+0000', 'last_clean': '2024-09-17T05:45:31.614428+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:45:31.634734+0000', 'last_undegraded': '2024-09-17T05:45:31.634734+0000', 'last_fullsized': '2024-09-17T05:45:31.634734+0000', 'mapping_epoch': 58, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 58, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:45:31.614428+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:45:31.614428+0000', 'last_clean_scrub_stamp': '2024-09-17T05:45:31.614428+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 2], 'acting': [3, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-17T05:45:37.374 INFO:tasks.ceph.ceph_manager.ceph:PG 9.28 is not active+clean 2024-09-17T05:45:37.374 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.28', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 58, 'state': 'creating+peering', 'last_fresh': '2024-09-17T05:45:31.625136+0000', 'last_change': '2024-09-17T05:45:31.625136+0000', 'last_active': '2024-09-17T05:45:31.614428+0000', 'last_peered': '2024-09-17T05:45:31.614428+0000', 'last_clean': '2024-09-17T05:45:31.614428+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:45:31.625136+0000', 'last_undegraded': '2024-09-17T05:45:31.625136+0000', 'last_fullsized': '2024-09-17T05:45:31.625136+0000', 'mapping_epoch': 58, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 58, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:45:31.614428+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:45:31.614428+0000', 'last_clean_scrub_stamp': '2024-09-17T05:45:31.614428+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 0], 'acting': [6, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-17T05:45:37.374 INFO:tasks.ceph.ceph_manager.ceph:PG 9.27 is not active+clean 2024-09-17T05:45:37.374 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.27', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 58, 'state': 'creating+peering', 'last_fresh': '2024-09-17T05:45:31.635240+0000', 'last_change': '2024-09-17T05:45:31.635240+0000', 'last_active': '2024-09-17T05:45:31.614428+0000', 'last_peered': '2024-09-17T05:45:31.614428+0000', 'last_clean': '2024-09-17T05:45:31.614428+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:45:31.635240+0000', 'last_undegraded': '2024-09-17T05:45:31.635240+0000', 'last_fullsized': '2024-09-17T05:45:31.635240+0000', 'mapping_epoch': 58, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 58, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:45:31.614428+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:45:31.614428+0000', 'last_clean_scrub_stamp': '2024-09-17T05:45:31.614428+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 1], 'acting': [2, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-17T05:45:37.374 INFO:tasks.ceph.ceph_manager.ceph:PG 9.24 is not active+clean 2024-09-17T05:45:37.374 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.24', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 58, 'state': 'creating+peering', 'last_fresh': '2024-09-17T05:45:31.635964+0000', 'last_change': '2024-09-17T05:45:31.635964+0000', 'last_active': '2024-09-17T05:45:31.614428+0000', 'last_peered': '2024-09-17T05:45:31.614428+0000', 'last_clean': '2024-09-17T05:45:31.614428+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:45:31.635964+0000', 'last_undegraded': '2024-09-17T05:45:31.635964+0000', 'last_fullsized': '2024-09-17T05:45:31.635964+0000', 'mapping_epoch': 58, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 58, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:45:31.614428+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:45:31.614428+0000', 'last_clean_scrub_stamp': '2024-09-17T05:45:31.614428+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 5], 'acting': [2, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-17T05:45:37.374 INFO:tasks.ceph.ceph_manager.ceph:PG 9.23 is not active+clean 2024-09-17T05:45:37.374 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.23', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 58, 'state': 'creating+peering', 'last_fresh': '2024-09-17T05:45:31.631473+0000', 'last_change': '2024-09-17T05:45:31.631473+0000', 'last_active': '2024-09-17T05:45:31.614428+0000', 'last_peered': '2024-09-17T05:45:31.614428+0000', 'last_clean': '2024-09-17T05:45:31.614428+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:45:31.631473+0000', 'last_undegraded': '2024-09-17T05:45:31.631473+0000', 'last_fullsized': '2024-09-17T05:45:31.631473+0000', 'mapping_epoch': 58, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 58, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:45:31.614428+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:45:31.614428+0000', 'last_clean_scrub_stamp': '2024-09-17T05:45:31.614428+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 5], 'acting': [3, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-17T05:45:37.375 INFO:tasks.ceph.ceph_manager.ceph:PG 9.21 is not active+clean 2024-09-17T05:45:37.375 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.21', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 58, 'state': 'creating+peering', 'last_fresh': '2024-09-17T05:45:31.633306+0000', 'last_change': '2024-09-17T05:45:31.633306+0000', 'last_active': '2024-09-17T05:45:31.614428+0000', 'last_peered': '2024-09-17T05:45:31.614428+0000', 'last_clean': '2024-09-17T05:45:31.614428+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:45:31.633306+0000', 'last_undegraded': '2024-09-17T05:45:31.633306+0000', 'last_fullsized': '2024-09-17T05:45:31.633306+0000', 'mapping_epoch': 58, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 58, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:45:31.614428+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:45:31.614428+0000', 'last_clean_scrub_stamp': '2024-09-17T05:45:31.614428+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 1], 'acting': [2, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-17T05:45:37.375 INFO:tasks.ceph.ceph_manager.ceph:PG 9.1a is not active+clean 2024-09-17T05:45:37.375 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.1a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 58, 'state': 'creating+peering', 'last_fresh': '2024-09-17T05:45:31.634200+0000', 'last_change': '2024-09-17T05:45:31.634200+0000', 'last_active': '2024-09-17T05:45:31.614428+0000', 'last_peered': '2024-09-17T05:45:31.614428+0000', 'last_clean': '2024-09-17T05:45:31.614428+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:45:31.634200+0000', 'last_undegraded': '2024-09-17T05:45:31.634200+0000', 'last_fullsized': '2024-09-17T05:45:31.634200+0000', 'mapping_epoch': 58, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 58, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:45:31.614428+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:45:31.614428+0000', 'last_clean_scrub_stamp': '2024-09-17T05:45:31.614428+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 2], 'acting': [3, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-17T05:45:37.375 INFO:tasks.ceph.ceph_manager.ceph:PG 9.1b is not active+clean 2024-09-17T05:45:37.375 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.1b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 58, 'state': 'creating+peering', 'last_fresh': '2024-09-17T05:45:31.630970+0000', 'last_change': '2024-09-17T05:45:31.630970+0000', 'last_active': '2024-09-17T05:45:31.614428+0000', 'last_peered': '2024-09-17T05:45:31.614428+0000', 'last_clean': '2024-09-17T05:45:31.614428+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:45:31.630970+0000', 'last_undegraded': '2024-09-17T05:45:31.630970+0000', 'last_fullsized': '2024-09-17T05:45:31.630970+0000', 'mapping_epoch': 58, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 58, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:45:31.614428+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:45:31.614428+0000', 'last_clean_scrub_stamp': '2024-09-17T05:45:31.614428+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 0], 'acting': [3, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-17T05:45:37.375 INFO:tasks.ceph.ceph_manager.ceph:PG 9.18 is not active+clean 2024-09-17T05:45:37.375 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.18', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 58, 'state': 'creating+peering', 'last_fresh': '2024-09-17T05:45:31.623504+0000', 'last_change': '2024-09-17T05:45:31.623504+0000', 'last_active': '2024-09-17T05:45:31.614428+0000', 'last_peered': '2024-09-17T05:45:31.614428+0000', 'last_clean': '2024-09-17T05:45:31.614428+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:45:31.623504+0000', 'last_undegraded': '2024-09-17T05:45:31.623504+0000', 'last_fullsized': '2024-09-17T05:45:31.623504+0000', 'mapping_epoch': 58, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 58, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:45:31.614428+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:45:31.614428+0000', 'last_clean_scrub_stamp': '2024-09-17T05:45:31.614428+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 7], 'acting': [6, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-17T05:45:37.375 INFO:tasks.ceph.ceph_manager.ceph:PG 9.19 is not active+clean 2024-09-17T05:45:37.375 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.19', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 58, 'state': 'creating+peering', 'last_fresh': '2024-09-17T05:45:31.632251+0000', 'last_change': '2024-09-17T05:45:31.632251+0000', 'last_active': '2024-09-17T05:45:31.614428+0000', 'last_peered': '2024-09-17T05:45:31.614428+0000', 'last_clean': '2024-09-17T05:45:31.614428+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:45:31.632251+0000', 'last_undegraded': '2024-09-17T05:45:31.632251+0000', 'last_fullsized': '2024-09-17T05:45:31.632251+0000', 'mapping_epoch': 58, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 58, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:45:31.614428+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:45:31.614428+0000', 'last_clean_scrub_stamp': '2024-09-17T05:45:31.614428+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 6], 'acting': [3, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-17T05:45:37.375 INFO:tasks.ceph.ceph_manager.ceph:PG 9.c is not active+clean 2024-09-17T05:45:37.376 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 58, 'state': 'creating+peering', 'last_fresh': '2024-09-17T05:45:31.626776+0000', 'last_change': '2024-09-17T05:45:31.626776+0000', 'last_active': '2024-09-17T05:45:31.614428+0000', 'last_peered': '2024-09-17T05:45:31.614428+0000', 'last_clean': '2024-09-17T05:45:31.614428+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:45:31.626776+0000', 'last_undegraded': '2024-09-17T05:45:31.626776+0000', 'last_fullsized': '2024-09-17T05:45:31.626776+0000', 'mapping_epoch': 58, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 58, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:45:31.614428+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:45:31.614428+0000', 'last_clean_scrub_stamp': '2024-09-17T05:45:31.614428+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 4], 'acting': [3, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-17T05:45:37.376 INFO:tasks.ceph.ceph_manager.ceph:PG 9.2 is not active+clean 2024-09-17T05:45:37.376 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.2', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 58, 'state': 'creating+peering', 'last_fresh': '2024-09-17T05:45:31.633719+0000', 'last_change': '2024-09-17T05:45:31.633719+0000', 'last_active': '2024-09-17T05:45:31.614428+0000', 'last_peered': '2024-09-17T05:45:31.614428+0000', 'last_clean': '2024-09-17T05:45:31.614428+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:45:31.633719+0000', 'last_undegraded': '2024-09-17T05:45:31.633719+0000', 'last_fullsized': '2024-09-17T05:45:31.633719+0000', 'mapping_epoch': 58, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 58, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:45:31.614428+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:45:31.614428+0000', 'last_clean_scrub_stamp': '2024-09-17T05:45:31.614428+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 1], 'acting': [3, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-17T05:45:37.376 INFO:tasks.ceph.ceph_manager.ceph:PG 9.1 is not active+clean 2024-09-17T05:45:37.376 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.1', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 58, 'state': 'creating+peering', 'last_fresh': '2024-09-17T05:45:31.627608+0000', 'last_change': '2024-09-17T05:45:31.627608+0000', 'last_active': '2024-09-17T05:45:31.614428+0000', 'last_peered': '2024-09-17T05:45:31.614428+0000', 'last_clean': '2024-09-17T05:45:31.614428+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:45:31.627608+0000', 'last_undegraded': '2024-09-17T05:45:31.627608+0000', 'last_fullsized': '2024-09-17T05:45:31.627608+0000', 'mapping_epoch': 58, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 58, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:45:31.614428+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:45:31.614428+0000', 'last_clean_scrub_stamp': '2024-09-17T05:45:31.614428+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 6], 'acting': [3, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-17T05:45:37.376 INFO:tasks.ceph.ceph_manager.ceph:PG 9.8 is not active+clean 2024-09-17T05:45:37.376 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.8', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 58, 'state': 'creating+peering', 'last_fresh': '2024-09-17T05:45:31.626798+0000', 'last_change': '2024-09-17T05:45:31.626798+0000', 'last_active': '2024-09-17T05:45:31.614428+0000', 'last_peered': '2024-09-17T05:45:31.614428+0000', 'last_clean': '2024-09-17T05:45:31.614428+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:45:31.626798+0000', 'last_undegraded': '2024-09-17T05:45:31.626798+0000', 'last_fullsized': '2024-09-17T05:45:31.626798+0000', 'mapping_epoch': 58, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 58, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:45:31.614428+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:45:31.614428+0000', 'last_clean_scrub_stamp': '2024-09-17T05:45:31.614428+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 0], 'acting': [3, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-17T05:45:37.377 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-09-17T05:45:37.521 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:37.519+0000 7fee7ad39640 1 -- 172.21.15.150:0/3462219546 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fee64004d40 msgr2=0x7fee640051f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:45:37.522 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:37.520+0000 7fee7ad39640 1 --2- 172.21.15.150:0/3462219546 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fee64004d40 0x7fee640051f0 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7fee74159930 tx=0x7fee64005830 comp rx=0 tx=0).stop 2024-09-17T05:45:37.522 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:37.520+0000 7fee792d6640 1 -- 172.21.15.150:0/3462219546 reap_dead start 2024-09-17T05:45:37.522 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:37.520+0000 7fee7ad39640 1 -- 172.21.15.150:0/3462219546 shutdown_connections 2024-09-17T05:45:37.522 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:37.520+0000 7fee7ad39640 1 -- 172.21.15.150:0/3462219546 >> 172.21.15.150:0/3462219546 conn(0x7fee740d0b50 msgr2=0x7fee740d0f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:45:37.522 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:37.520+0000 7fee7ad39640 1 -- 172.21.15.150:0/3462219546 shutdown_connections 2024-09-17T05:45:37.522 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:37.520+0000 7fee7ad39640 1 -- 172.21.15.150:0/3462219546 wait complete. 2024-09-17T05:45:37.523 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:37.521+0000 7fee7ad39640 1 Processor -- start 2024-09-17T05:45:37.523 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:37.521+0000 7fee7ad39640 1 -- start start 2024-09-17T05:45:37.526 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:37.523+0000 7fee7ad39640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fee64004d40 0x7fee74147100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:45:37.526 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:37.523+0000 7fee7ad39640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fee7415ce80 0x7fee7415d290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:45:37.526 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:37.523+0000 7fee7ad39640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fee7414ceb0 0x7fee7414d2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:45:37.526 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:37.523+0000 7fee7ad39640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7fee741648c0 con 0x7fee64004d40 2024-09-17T05:45:37.527 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:37.523+0000 7fee7ad39640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fee740cfc00 con 0x7fee7414ceb0 2024-09-17T05:45:37.527 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:37.523+0000 7fee7ad39640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fee74164a40 con 0x7fee7415ce80 2024-09-17T05:45:37.527 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:37.523+0000 7fee78ad5640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fee64004d40 0x7fee74147100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:45:37.527 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:37.523+0000 7fee78ad5640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fee64004d40 0x7fee74147100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:39342/0 (socket says 172.21.15.150:39342) 2024-09-17T05:45:37.527 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:37.523+0000 7fee78ad5640 1 -- 172.21.15.150:0/3265096600 learned_addr learned my addr 172.21.15.150:0/3265096600 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:45:37.527 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:37.523+0000 7fee792d6640 1 --2- 172.21.15.150:0/3265096600 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fee7414ceb0 0x7fee7414d2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:45:37.527 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:37.523+0000 7fee73fff640 1 --2- 172.21.15.150:0/3265096600 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fee7415ce80 0x7fee7415d290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:45:37.527 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:37.523+0000 7fee78ad5640 1 -- 172.21.15.150:0/3265096600 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fee7415ce80 msgr2=0x7fee7415d290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:45:37.527 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:37.523+0000 7fee78ad5640 1 --2- 172.21.15.150:0/3265096600 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fee7415ce80 0x7fee7415d290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:37.527 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:37.523+0000 7fee78ad5640 1 -- 172.21.15.150:0/3265096600 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fee7414ceb0 msgr2=0x7fee7414d2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:45:37.527 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:37.523+0000 7fee78ad5640 1 --2- 172.21.15.150:0/3265096600 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fee7414ceb0 0x7fee7414d2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:37.527 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:37.523+0000 7fee78ad5640 1 -- 172.21.15.150:0/3265096600 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fee7414d800 con 0x7fee64004d40 2024-09-17T05:45:37.528 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:37.523+0000 7fee78ad5640 1 --2- 172.21.15.150:0/3265096600 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fee64004d40 0x7fee74147100 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7fee6800e600 tx=0x7fee6800eac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:45:37.528 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:37.524+0000 7fee717fa640 1 -- 172.21.15.150:0/3265096600 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee68015070 con 0x7fee64004d40 2024-09-17T05:45:37.528 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:37.524+0000 7fee717fa640 1 -- 172.21.15.150:0/3265096600 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fee6800ca90 con 0x7fee64004d40 2024-09-17T05:45:37.528 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:37.524+0000 7fee7ad39640 1 -- 172.21.15.150:0/3265096600 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fee741f3370 con 0x7fee64004d40 2024-09-17T05:45:37.528 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:37.524+0000 7fee717fa640 1 -- 172.21.15.150:0/3265096600 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee6800cea0 con 0x7fee64004d40 2024-09-17T05:45:37.528 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:37.524+0000 7fee7ad39640 1 -- 172.21.15.150:0/3265096600 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fee741f3630 con 0x7fee64004d40 2024-09-17T05:45:37.528 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:37.525+0000 7fee7ad39640 1 -- 172.21.15.150:0/3265096600 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fee7415f330 con 0x7fee64004d40 2024-09-17T05:45:37.529 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:37.525+0000 7fee717fa640 1 -- 172.21.15.150:0/3265096600 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 15) ==== 102257+0+0 (secure 0 0 0) 0x7fee68018070 con 0x7fee64004d40 2024-09-17T05:45:37.529 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:37.526+0000 7fee717fa640 1 --2- 172.21.15.150:0/3265096600 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fee58079490 0x7fee5807b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:45:37.533 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:37.526+0000 7fee717fa640 1 -- 172.21.15.150:0/3265096600 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(60..60 src has 1..60) ==== 5737+0+0 (secure 0 0 0) 0x7fee68099ad0 con 0x7fee64004d40 2024-09-17T05:45:37.533 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:37.526+0000 7fee73fff640 1 --2- 172.21.15.150:0/3265096600 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fee58079490 0x7fee5807b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:45:37.533 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:37.527+0000 7fee73fff640 1 --2- 172.21.15.150:0/3265096600 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fee58079490 0x7fee5807b9a0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7fee74147c90 tx=0x7fee60006b70 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:45:37.534 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:37.531+0000 7fee717fa640 1 -- 172.21.15.150:0/3265096600 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fee7414d800 con 0x7fee64004d40 2024-09-17T05:45:37.779 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:37.778+0000 7fee7ad39640 1 -- 172.21.15.150:0/3265096600 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) -- 0x7fee74075d20 con 0x7fee64004d40 2024-09-17T05:45:37.780 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:37.778+0000 7fee717fa640 1 -- 172.21.15.150:0/3265096600 <== mon.0 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) ==== 72+0+1142 (secure 0 0 0) 0x7fee68063a50 con 0x7fee64004d40 2024-09-17T05:45:37.780 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-09-17T05:45:37.780 INFO:teuthology.orchestra.run.smithi150.stdout:{"fsid":"9f2e05e9-d629-47b3-b26b-1360655b7d20","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":245,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":60,"num_osds":8,"num_up_osds":8,"osd_up_since":1726551706,"num_in_osds":8,"osd_in_since":1726551696,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":75},{"state_name":"creating+peering","count":22}],"num_pgs":97,"num_pools":3,"num_objects":19,"data_bytes":592722,"bytes_used":374628352,"bytes_avail":772719484928,"bytes_total":773094113280,"inactive_pgs_ratio":0.22680412232875824,"write_bytes_sec":1023,"read_op_per_sec":0,"write_op_per_sec":6},"fsmap":{"epoch":33,"btime":"2024-09-17T05:45:35:644540+0000","id":4,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":4,"rank":0,"name":"a","status":"up:active","gid":6009}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":10,"modified":"2024-09-17T05:45:10.902513+0000","services":{}},"progress_events":{}} 2024-09-17T05:45:37.782 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:37.780+0000 7fee7ad39640 1 -- 172.21.15.150:0/3265096600 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fee58079490 msgr2=0x7fee5807b9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:45:37.782 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:37.780+0000 7fee7ad39640 1 --2- 172.21.15.150:0/3265096600 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fee58079490 0x7fee5807b9a0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7fee74147c90 tx=0x7fee60006b70 comp rx=0 tx=0).stop 2024-09-17T05:45:37.782 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:37.780+0000 7fee7ad39640 1 -- 172.21.15.150:0/3265096600 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fee64004d40 msgr2=0x7fee74147100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:45:37.783 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:37.780+0000 7fee7ad39640 1 --2- 172.21.15.150:0/3265096600 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fee64004d40 0x7fee74147100 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7fee6800e600 tx=0x7fee6800eac0 comp rx=0 tx=0).stop 2024-09-17T05:45:37.783 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:37.781+0000 7fee7ad39640 1 -- 172.21.15.150:0/3265096600 shutdown_connections 2024-09-17T05:45:37.783 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:37.781+0000 7fee7ad39640 1 --2- 172.21.15.150:0/3265096600 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fee7414ceb0 0x7fee7414d2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:37.783 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:37.781+0000 7fee7ad39640 1 --2- 172.21.15.150:0/3265096600 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fee58079490 0x7fee5807b9a0 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:37.783 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:37.781+0000 7fee7ad39640 1 --2- 172.21.15.150:0/3265096600 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fee7415ce80 0x7fee7415d290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:37.783 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:37.781+0000 7fee7ad39640 1 --2- 172.21.15.150:0/3265096600 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fee64004d40 0x7fee74147100 unknown :-1 s=CLOSED pgs=643 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:37.783 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:37.781+0000 7fee7ad39640 1 -- 172.21.15.150:0/3265096600 >> 172.21.15.150:0/3265096600 conn(0x7fee740d0b50 msgr2=0x7fee740b3ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:45:37.783 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:37.781+0000 7fee7ad39640 1 -- 172.21.15.150:0/3265096600 shutdown_connections 2024-09-17T05:45:37.783 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:37.781+0000 7fee7ad39640 1 -- 172.21.15.150:0/3265096600 wait complete. 2024-09-17T05:45:37.794 INFO:tasks.ceph.ceph_manager.ceph:no progress seen, keeping timeout for now 2024-09-17T05:45:37.794 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-17T05:45:37.908 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:37.906+0000 7f177e158640 1 -- 172.21.15.150:0/772439371 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1760004d90 msgr2=0x7f1760005260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:45:37.908 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:37.906+0000 7f177e158640 1 --2- 172.21.15.150:0/772439371 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1760004d90 0x7f1760005260 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7f1770001d90 tx=0x7f1760005830 comp rx=0 tx=0).stop 2024-09-17T05:45:37.908 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:37.906+0000 7f1777fff640 1 -- 172.21.15.150:0/772439371 reap_dead start 2024-09-17T05:45:37.908 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:37.906+0000 7f177e158640 1 -- 172.21.15.150:0/772439371 shutdown_connections 2024-09-17T05:45:37.908 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:37.906+0000 7f177e158640 1 -- 172.21.15.150:0/772439371 >> 172.21.15.150:0/772439371 conn(0x7f17780b2e80 msgr2=0x7f17780b3290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:45:37.908 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:37.906+0000 7f177e158640 1 -- 172.21.15.150:0/772439371 shutdown_connections 2024-09-17T05:45:37.909 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:37.906+0000 7f177e158640 1 -- 172.21.15.150:0/772439371 wait complete. 2024-09-17T05:45:37.909 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:37.908+0000 7f177e158640 1 Processor -- start 2024-09-17T05:45:37.910 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:37.908+0000 7f177e158640 1 -- start start 2024-09-17T05:45:37.912 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:37.909+0000 7f177e158640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1778159630 0x7f177809ed20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:45:37.912 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:37.909+0000 7f177e158640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1778150f00 0x7f17781f8990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:45:37.912 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:37.909+0000 7f177e158640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f177815a970 0x7f177815ad80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:45:37.912 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:37.909+0000 7f177e158640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f17780b4b70 con 0x7f1778159630 2024-09-17T05:45:37.913 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:37.909+0000 7f177e158640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f17780ce0a0 con 0x7f1778150f00 2024-09-17T05:45:37.913 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:37.909+0000 7f177e158640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f17780b4cf0 con 0x7f177815a970 2024-09-17T05:45:37.913 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:37.910+0000 7f17777fe640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1778159630 0x7f177809ed20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:45:37.913 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:37.910+0000 7f17777fe640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1778159630 0x7f177809ed20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:39354/0 (socket says 172.21.15.150:39354) 2024-09-17T05:45:37.913 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:37.910+0000 7f17777fe640 1 -- 172.21.15.150:0/2099626162 learned_addr learned my addr 172.21.15.150:0/2099626162 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:45:37.913 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:37.910+0000 7f1776ffd640 1 --2- 172.21.15.150:0/2099626162 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1778150f00 0x7f17781f8990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:45:37.913 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:37.910+0000 7f1777fff640 1 --2- 172.21.15.150:0/2099626162 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f177815a970 0x7f177815ad80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:45:37.913 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:37.910+0000 7f17777fe640 1 -- 172.21.15.150:0/2099626162 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f177815a970 msgr2=0x7f177815ad80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:45:37.913 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:37.910+0000 7f17777fe640 1 --2- 172.21.15.150:0/2099626162 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f177815a970 0x7f177815ad80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:37.913 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:37.910+0000 7f17777fe640 1 -- 172.21.15.150:0/2099626162 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1778150f00 msgr2=0x7f17781f8990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:45:37.913 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:37.910+0000 7f17777fe640 1 --2- 172.21.15.150:0/2099626162 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1778150f00 0x7f17781f8990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:37.914 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:37.910+0000 7f17777fe640 1 -- 172.21.15.150:0/2099626162 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f177815b2c0 con 0x7f1778159630 2024-09-17T05:45:37.914 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:37.910+0000 7f17777fe640 1 --2- 172.21.15.150:0/2099626162 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1778159630 0x7f177809ed20 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7f17680066e0 tx=0x7f1768003aa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:45:37.914 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:37.910+0000 7f175ffff640 1 -- 172.21.15.150:0/2099626162 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1768011700 con 0x7f1778159630 2024-09-17T05:45:37.914 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:37.910+0000 7f175ffff640 1 -- 172.21.15.150:0/2099626162 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f1768016020 con 0x7f1778159630 2024-09-17T05:45:37.914 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:37.910+0000 7f175ffff640 1 -- 172.21.15.150:0/2099626162 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1768011b60 con 0x7f1778159630 2024-09-17T05:45:37.914 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:37.910+0000 7f177e158640 1 -- 172.21.15.150:0/2099626162 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f17781f9300 con 0x7f1778159630 2024-09-17T05:45:37.914 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:37.910+0000 7f177e158640 1 -- 172.21.15.150:0/2099626162 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1778150700 con 0x7f1778159630 2024-09-17T05:45:37.915 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:37.911+0000 7f177e158640 1 -- 172.21.15.150:0/2099626162 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1778150520 con 0x7f1778159630 2024-09-17T05:45:37.915 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:37.912+0000 7f175ffff640 1 -- 172.21.15.150:0/2099626162 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 15) ==== 102257+0+0 (secure 0 0 0) 0x7f1768011d00 con 0x7f1778159630 2024-09-17T05:45:37.915 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:37.913+0000 7f175ffff640 1 --2- 172.21.15.150:0/2099626162 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f1764079490 0x7f176407b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:45:37.915 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:37.913+0000 7f175ffff640 1 -- 172.21.15.150:0/2099626162 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(60..60 src has 1..60) ==== 5737+0+0 (secure 0 0 0) 0x7f1768099cf0 con 0x7f1778159630 2024-09-17T05:45:37.915 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:37.913+0000 7f1776ffd640 1 --2- 172.21.15.150:0/2099626162 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f1764079490 0x7f176407b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:45:37.915 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:37.913+0000 7f1776ffd640 1 --2- 172.21.15.150:0/2099626162 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f1764079490 0x7f176407b9a0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f17780d1340 tx=0x7f176c005f90 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:45:37.918 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:37.917+0000 7f175ffff640 1 -- 172.21.15.150:0/2099626162 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f1778150520 con 0x7f1778159630 2024-09-17T05:45:37.951 INFO:tasks.ceph.mds.a.smithi150.stderr:2024-09-17T05:45:37.949+0000 7f0ce943c640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-17T05:45:38.090 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:38.088+0000 7f177e158640 1 -- 172.21.15.150:0/2099626162 --> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f17781f9820 con 0x7f1764079490 2024-09-17T05:45:38.094 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:38.093+0000 7f175ffff640 1 -- 172.21.15.150:0/2099626162 <== mgr.4108 v2:172.21.15.176:6800/3631216395 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+250141 (secure 0 0 0) 0x7f176c05e130 con 0x7f1764079490 2024-09-17T05:45:38.097 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-09-17T05:45:38.098 INFO:teuthology.orchestra.run.smithi150.stderr:dumped all 2024-09-17T05:45:38.100 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:38.096+0000 7f177e158640 1 -- 172.21.15.150:0/2099626162 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f1764079490 msgr2=0x7f176407b9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:45:38.100 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:38.096+0000 7f177e158640 1 --2- 172.21.15.150:0/2099626162 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f1764079490 0x7f176407b9a0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f17780d1340 tx=0x7f176c005f90 comp rx=0 tx=0).stop 2024-09-17T05:45:38.100 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:38.096+0000 7f177e158640 1 -- 172.21.15.150:0/2099626162 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1778159630 msgr2=0x7f177809ed20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:45:38.100 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:38.096+0000 7f177e158640 1 --2- 172.21.15.150:0/2099626162 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1778159630 0x7f177809ed20 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7f17680066e0 tx=0x7f1768003aa0 comp rx=0 tx=0).stop 2024-09-17T05:45:38.100 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:38.096+0000 7f177e158640 1 -- 172.21.15.150:0/2099626162 shutdown_connections 2024-09-17T05:45:38.100 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:38.096+0000 7f177e158640 1 --2- 172.21.15.150:0/2099626162 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1778150f00 0x7f17781f8990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:38.100 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:38.096+0000 7f177e158640 1 --2- 172.21.15.150:0/2099626162 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f1764079490 0x7f176407b9a0 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:38.100 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:38.096+0000 7f177e158640 1 --2- 172.21.15.150:0/2099626162 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f177815a970 0x7f177815ad80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:38.100 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:38.096+0000 7f177e158640 1 --2- 172.21.15.150:0/2099626162 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1778159630 0x7f177809ed20 unknown :-1 s=CLOSED pgs=646 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:38.100 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:38.096+0000 7f177e158640 1 -- 172.21.15.150:0/2099626162 >> 172.21.15.150:0/2099626162 conn(0x7f17780b2e80 msgr2=0x7f17780cf0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:45:38.100 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:38.096+0000 7f177e158640 1 -- 172.21.15.150:0/2099626162 shutdown_connections 2024-09-17T05:45:38.100 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:38.096+0000 7f177e158640 1 -- 172.21.15.150:0/2099626162 wait complete. 2024-09-17T05:45:38.109 INFO:teuthology.orchestra.run.smithi150.stdout:{"pg_ready":true,"pg_map":{"version":170,"stamp":"2024-09-17T05:45:36.909116+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592722,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":140,"num_write_kb":1634,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":104,"ondisk_log_size":104,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":108,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":365848,"kb_used_data":6692,"kb_used_omap":12,"kb_used_meta":358963,"kb_avail":754608872,"statfs":{"total":773094113280,"available":772719484928,"internally_reserved":0,"allocated":6852608,"data_stored":3504955,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":367578672},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":27,"apply_latency_ms":27,"commit_latency_ns":27000000,"apply_latency_ns":27000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2354,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":39,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001502"},"pg_stats":[{"pgid":"9.3f","version":"0'0","reported_seq":1,"reported_epoch":58,"state":"creating+peering","last_fresh":"2024-09-17T05:45:31.635800+0000","last_change":"2024-09-17T05:45:31.635800+0000","last_active":"2024-09-17T05:45:31.614428+0000","last_peered":"2024-09-17T05:45:31.614428+0000","last_clean":"2024-09-17T05:45:31.614428+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:45:31.635800+0000","last_undegraded":"2024-09-17T05:45:31.635800+0000","last_fullsized":"2024-09-17T05:45:31.635800+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:45:31.614428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:45:31.614428+0000","last_clean_scrub_stamp":"2024-09-17T05:45:31.614428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3e","version":"0'0","reported_seq":1,"reported_epoch":58,"state":"creating+peering","last_fresh":"2024-09-17T05:45:31.628405+0000","last_change":"2024-09-17T05:45:31.628405+0000","last_active":"2024-09-17T05:45:31.614428+0000","last_peered":"2024-09-17T05:45:31.614428+0000","last_clean":"2024-09-17T05:45:31.614428+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:45:31.628405+0000","last_undegraded":"2024-09-17T05:45:31.628405+0000","last_fullsized":"2024-09-17T05:45:31.628405+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:45:31.614428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:45:31.614428+0000","last_clean_scrub_stamp":"2024-09-17T05:45:31.614428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.3d","version":"0'0","reported_seq":13,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-17T05:45:33.954721+0000","last_change":"2024-09-17T05:45:32.653926+0000","last_active":"2024-09-17T05:45:33.954721+0000","last_peered":"2024-09-17T05:45:33.954721+0000","last_clean":"2024-09-17T05:45:33.954721+0000","last_became_active":"2024-09-17T05:45:32.653577+0000","last_became_peered":"2024-09-17T05:45:32.653577+0000","last_unstale":"2024-09-17T05:45:33.954721+0000","last_undegraded":"2024-09-17T05:45:33.954721+0000","last_fullsized":"2024-09-17T05:45:33.954721+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:45:31.614428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:45:31.614428+0000","last_clean_scrub_stamp":"2024-09-17T05:45:31.614428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:18:45.006839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.3c","version":"0'0","reported_seq":13,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-17T05:45:33.643532+0000","last_change":"2024-09-17T05:45:32.644544+0000","last_active":"2024-09-17T05:45:33.643532+0000","last_peered":"2024-09-17T05:45:33.643532+0000","last_clean":"2024-09-17T05:45:33.643532+0000","last_became_active":"2024-09-17T05:45:32.644206+0000","last_became_peered":"2024-09-17T05:45:32.644206+0000","last_unstale":"2024-09-17T05:45:33.643532+0000","last_undegraded":"2024-09-17T05:45:33.643532+0000","last_fullsized":"2024-09-17T05:45:33.643532+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:45:31.614428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:45:31.614428+0000","last_clean_scrub_stamp":"2024-09-17T05:45:31.614428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:07:39.923649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.3b","version":"0'0","reported_seq":1,"reported_epoch":58,"state":"creating+peering","last_fresh":"2024-09-17T05:45:31.638143+0000","last_change":"2024-09-17T05:45:31.638143+0000","last_active":"2024-09-17T05:45:31.614428+0000","last_peered":"2024-09-17T05:45:31.614428+0000","last_clean":"2024-09-17T05:45:31.614428+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:45:31.638143+0000","last_undegraded":"2024-09-17T05:45:31.638143+0000","last_fullsized":"2024-09-17T05:45:31.638143+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:45:31.614428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:45:31.614428+0000","last_clean_scrub_stamp":"2024-09-17T05:45:31.614428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3a","version":"0'0","reported_seq":10,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-17T05:45:32.642546+0000","last_change":"2024-09-17T05:45:32.639148+0000","last_active":"2024-09-17T05:45:32.642546+0000","last_peered":"2024-09-17T05:45:32.642546+0000","last_clean":"2024-09-17T05:45:32.642546+0000","last_became_active":"2024-09-17T05:45:32.638816+0000","last_became_peered":"2024-09-17T05:45:32.638816+0000","last_unstale":"2024-09-17T05:45:32.642546+0000","last_undegraded":"2024-09-17T05:45:32.642546+0000","last_fullsized":"2024-09-17T05:45:32.642546+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:45:31.614428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:45:31.614428+0000","last_clean_scrub_stamp":"2024-09-17T05:45:31.614428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:47:31.319688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.39","version":"0'0","reported_seq":13,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-17T05:45:33.642542+0000","last_change":"2024-09-17T05:45:32.631297+0000","last_active":"2024-09-17T05:45:33.642542+0000","last_peered":"2024-09-17T05:45:33.642542+0000","last_clean":"2024-09-17T05:45:33.642542+0000","last_became_active":"2024-09-17T05:45:32.630792+0000","last_became_peered":"2024-09-17T05:45:32.630792+0000","last_unstale":"2024-09-17T05:45:33.642542+0000","last_undegraded":"2024-09-17T05:45:33.642542+0000","last_fullsized":"2024-09-17T05:45:33.642542+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:45:31.614428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:45:31.614428+0000","last_clean_scrub_stamp":"2024-09-17T05:45:31.614428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:40:44.182767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.38","version":"0'0","reported_seq":1,"reported_epoch":58,"state":"creating+peering","last_fresh":"2024-09-17T05:45:31.628464+0000","last_change":"2024-09-17T05:45:31.628464+0000","last_active":"2024-09-17T05:45:31.614428+0000","last_peered":"2024-09-17T05:45:31.614428+0000","last_clean":"2024-09-17T05:45:31.614428+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:45:31.628464+0000","last_undegraded":"2024-09-17T05:45:31.628464+0000","last_fullsized":"2024-09-17T05:45:31.628464+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:45:31.614428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:45:31.614428+0000","last_clean_scrub_stamp":"2024-09-17T05:45:31.614428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.37","version":"0'0","reported_seq":13,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-17T05:45:33.643100+0000","last_change":"2024-09-17T05:45:32.629786+0000","last_active":"2024-09-17T05:45:33.643100+0000","last_peered":"2024-09-17T05:45:33.643100+0000","last_clean":"2024-09-17T05:45:33.643100+0000","last_became_active":"2024-09-17T05:45:32.629438+0000","last_became_peered":"2024-09-17T05:45:32.629438+0000","last_unstale":"2024-09-17T05:45:33.643100+0000","last_undegraded":"2024-09-17T05:45:33.643100+0000","last_fullsized":"2024-09-17T05:45:33.643100+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:45:31.614428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:45:31.614428+0000","last_clean_scrub_stamp":"2024-09-17T05:45:31.614428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:06:56.405523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.36","version":"0'0","reported_seq":13,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-17T05:45:33.955260+0000","last_change":"2024-09-17T05:45:32.647536+0000","last_active":"2024-09-17T05:45:33.955260+0000","last_peered":"2024-09-17T05:45:33.955260+0000","last_clean":"2024-09-17T05:45:33.955260+0000","last_became_active":"2024-09-17T05:45:32.647207+0000","last_became_peered":"2024-09-17T05:45:32.647207+0000","last_unstale":"2024-09-17T05:45:33.955260+0000","last_undegraded":"2024-09-17T05:45:33.955260+0000","last_fullsized":"2024-09-17T05:45:33.955260+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:45:31.614428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:45:31.614428+0000","last_clean_scrub_stamp":"2024-09-17T05:45:31.614428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:53:08.537231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.35","version":"0'0","reported_seq":13,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-17T05:45:33.954382+0000","last_change":"2024-09-17T05:45:32.650441+0000","last_active":"2024-09-17T05:45:33.954382+0000","last_peered":"2024-09-17T05:45:33.954382+0000","last_clean":"2024-09-17T05:45:33.954382+0000","last_became_active":"2024-09-17T05:45:32.644229+0000","last_became_peered":"2024-09-17T05:45:32.644229+0000","last_unstale":"2024-09-17T05:45:33.954382+0000","last_undegraded":"2024-09-17T05:45:33.954382+0000","last_fullsized":"2024-09-17T05:45:33.954382+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:45:31.614428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:45:31.614428+0000","last_clean_scrub_stamp":"2024-09-17T05:45:31.614428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:15:00.651839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.34","version":"0'0","reported_seq":13,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-17T05:45:33.643819+0000","last_change":"2024-09-17T05:45:32.648016+0000","last_active":"2024-09-17T05:45:33.643819+0000","last_peered":"2024-09-17T05:45:33.643819+0000","last_clean":"2024-09-17T05:45:33.643819+0000","last_became_active":"2024-09-17T05:45:32.647657+0000","last_became_peered":"2024-09-17T05:45:32.647657+0000","last_unstale":"2024-09-17T05:45:33.643819+0000","last_undegraded":"2024-09-17T05:45:33.643819+0000","last_fullsized":"2024-09-17T05:45:33.643819+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:45:31.614428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:45:31.614428+0000","last_clean_scrub_stamp":"2024-09-17T05:45:31.614428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:15:14.618900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.33","version":"0'0","reported_seq":1,"reported_epoch":58,"state":"creating+peering","last_fresh":"2024-09-17T05:45:31.623675+0000","last_change":"2024-09-17T05:45:31.623675+0000","last_active":"2024-09-17T05:45:31.614428+0000","last_peered":"2024-09-17T05:45:31.614428+0000","last_clean":"2024-09-17T05:45:31.614428+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:45:31.623675+0000","last_undegraded":"2024-09-17T05:45:31.623675+0000","last_fullsized":"2024-09-17T05:45:31.623675+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:45:31.614428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:45:31.614428+0000","last_clean_scrub_stamp":"2024-09-17T05:45:31.614428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.32","version":"0'0","reported_seq":13,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-17T05:45:33.642905+0000","last_change":"2024-09-17T05:45:32.640531+0000","last_active":"2024-09-17T05:45:33.642905+0000","last_peered":"2024-09-17T05:45:33.642905+0000","last_clean":"2024-09-17T05:45:33.642905+0000","last_became_active":"2024-09-17T05:45:32.640176+0000","last_became_peered":"2024-09-17T05:45:32.640176+0000","last_unstale":"2024-09-17T05:45:33.642905+0000","last_undegraded":"2024-09-17T05:45:33.642905+0000","last_fullsized":"2024-09-17T05:45:33.642905+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:45:31.614428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:45:31.614428+0000","last_clean_scrub_stamp":"2024-09-17T05:45:31.614428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:25:16.583193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.31","version":"0'0","reported_seq":13,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-17T05:45:33.643442+0000","last_change":"2024-09-17T05:45:32.637116+0000","last_active":"2024-09-17T05:45:33.643442+0000","last_peered":"2024-09-17T05:45:33.643442+0000","last_clean":"2024-09-17T05:45:33.643442+0000","last_became_active":"2024-09-17T05:45:32.636454+0000","last_became_peered":"2024-09-17T05:45:32.636454+0000","last_unstale":"2024-09-17T05:45:33.643442+0000","last_undegraded":"2024-09-17T05:45:33.643442+0000","last_fullsized":"2024-09-17T05:45:33.643442+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:45:31.614428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:45:31.614428+0000","last_clean_scrub_stamp":"2024-09-17T05:45:31.614428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:05:03.043597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.30","version":"0'0","reported_seq":10,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-17T05:45:32.649772+0000","last_change":"2024-09-17T05:45:32.645281+0000","last_active":"2024-09-17T05:45:32.649772+0000","last_peered":"2024-09-17T05:45:32.649772+0000","last_clean":"2024-09-17T05:45:32.649772+0000","last_became_active":"2024-09-17T05:45:32.644707+0000","last_became_peered":"2024-09-17T05:45:32.644707+0000","last_unstale":"2024-09-17T05:45:32.649772+0000","last_undegraded":"2024-09-17T05:45:32.649772+0000","last_fullsized":"2024-09-17T05:45:32.649772+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:45:31.614428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:45:31.614428+0000","last_clean_scrub_stamp":"2024-09-17T05:45:31.614428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:35:47.004290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.2f","version":"0'0","reported_seq":1,"reported_epoch":58,"state":"creating+peering","last_fresh":"2024-09-17T05:45:31.628311+0000","last_change":"2024-09-17T05:45:31.628311+0000","last_active":"2024-09-17T05:45:31.614428+0000","last_peered":"2024-09-17T05:45:31.614428+0000","last_clean":"2024-09-17T05:45:31.614428+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:45:31.628311+0000","last_undegraded":"2024-09-17T05:45:31.628311+0000","last_fullsized":"2024-09-17T05:45:31.628311+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:45:31.614428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:45:31.614428+0000","last_clean_scrub_stamp":"2024-09-17T05:45:31.614428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2e","version":"0'0","reported_seq":13,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-17T05:45:33.955372+0000","last_change":"2024-09-17T05:45:32.648441+0000","last_active":"2024-09-17T05:45:33.955372+0000","last_peered":"2024-09-17T05:45:33.955372+0000","last_clean":"2024-09-17T05:45:33.955372+0000","last_became_active":"2024-09-17T05:45:32.646007+0000","last_became_peered":"2024-09-17T05:45:32.646007+0000","last_unstale":"2024-09-17T05:45:33.955372+0000","last_undegraded":"2024-09-17T05:45:33.955372+0000","last_fullsized":"2024-09-17T05:45:33.955372+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:45:31.614428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:45:31.614428+0000","last_clean_scrub_stamp":"2024-09-17T05:45:31.614428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:17:14.808917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2d","version":"0'0","reported_seq":1,"reported_epoch":58,"state":"creating+peering","last_fresh":"2024-09-17T05:45:31.633549+0000","last_change":"2024-09-17T05:45:31.633549+0000","last_active":"2024-09-17T05:45:31.614428+0000","last_peered":"2024-09-17T05:45:31.614428+0000","last_clean":"2024-09-17T05:45:31.614428+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:45:31.633549+0000","last_undegraded":"2024-09-17T05:45:31.633549+0000","last_fullsized":"2024-09-17T05:45:31.633549+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:45:31.614428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:45:31.614428+0000","last_clean_scrub_stamp":"2024-09-17T05:45:31.614428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.2c","version":"0'0","reported_seq":1,"reported_epoch":58,"state":"creating+peering","last_fresh":"2024-09-17T05:45:31.628712+0000","last_change":"2024-09-17T05:45:31.628712+0000","last_active":"2024-09-17T05:45:31.614428+0000","last_peered":"2024-09-17T05:45:31.614428+0000","last_clean":"2024-09-17T05:45:31.614428+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:45:31.628712+0000","last_undegraded":"2024-09-17T05:45:31.628712+0000","last_fullsized":"2024-09-17T05:45:31.628712+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:45:31.614428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:45:31.614428+0000","last_clean_scrub_stamp":"2024-09-17T05:45:31.614428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2b","version":"0'0","reported_seq":13,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-17T05:45:33.954893+0000","last_change":"2024-09-17T05:45:32.648315+0000","last_active":"2024-09-17T05:45:33.954893+0000","last_peered":"2024-09-17T05:45:33.954893+0000","last_clean":"2024-09-17T05:45:33.954893+0000","last_became_active":"2024-09-17T05:45:32.646021+0000","last_became_peered":"2024-09-17T05:45:32.646021+0000","last_unstale":"2024-09-17T05:45:33.954893+0000","last_undegraded":"2024-09-17T05:45:33.954893+0000","last_fullsized":"2024-09-17T05:45:33.954893+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:45:31.614428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:45:31.614428+0000","last_clean_scrub_stamp":"2024-09-17T05:45:31.614428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:21:50.109729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2a","version":"0'0","reported_seq":1,"reported_epoch":58,"state":"creating+peering","last_fresh":"2024-09-17T05:45:31.634734+0000","last_change":"2024-09-17T05:45:31.634734+0000","last_active":"2024-09-17T05:45:31.614428+0000","last_peered":"2024-09-17T05:45:31.614428+0000","last_clean":"2024-09-17T05:45:31.614428+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:45:31.634734+0000","last_undegraded":"2024-09-17T05:45:31.634734+0000","last_fullsized":"2024-09-17T05:45:31.634734+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:45:31.614428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:45:31.614428+0000","last_clean_scrub_stamp":"2024-09-17T05:45:31.614428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.29","version":"0'0","reported_seq":13,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-17T05:45:33.955465+0000","last_change":"2024-09-17T05:45:32.651396+0000","last_active":"2024-09-17T05:45:33.955465+0000","last_peered":"2024-09-17T05:45:33.955465+0000","last_clean":"2024-09-17T05:45:33.955465+0000","last_became_active":"2024-09-17T05:45:32.651072+0000","last_became_peered":"2024-09-17T05:45:32.651072+0000","last_unstale":"2024-09-17T05:45:33.955465+0000","last_undegraded":"2024-09-17T05:45:33.955465+0000","last_fullsized":"2024-09-17T05:45:33.955465+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:45:31.614428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:45:31.614428+0000","last_clean_scrub_stamp":"2024-09-17T05:45:31.614428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:44:57.086608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.28","version":"0'0","reported_seq":1,"reported_epoch":58,"state":"creating+peering","last_fresh":"2024-09-17T05:45:31.625136+0000","last_change":"2024-09-17T05:45:31.625136+0000","last_active":"2024-09-17T05:45:31.614428+0000","last_peered":"2024-09-17T05:45:31.614428+0000","last_clean":"2024-09-17T05:45:31.614428+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:45:31.625136+0000","last_undegraded":"2024-09-17T05:45:31.625136+0000","last_fullsized":"2024-09-17T05:45:31.625136+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:45:31.614428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:45:31.614428+0000","last_clean_scrub_stamp":"2024-09-17T05:45:31.614428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.27","version":"0'0","reported_seq":1,"reported_epoch":58,"state":"creating+peering","last_fresh":"2024-09-17T05:45:31.635240+0000","last_change":"2024-09-17T05:45:31.635240+0000","last_active":"2024-09-17T05:45:31.614428+0000","last_peered":"2024-09-17T05:45:31.614428+0000","last_clean":"2024-09-17T05:45:31.614428+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:45:31.635240+0000","last_undegraded":"2024-09-17T05:45:31.635240+0000","last_fullsized":"2024-09-17T05:45:31.635240+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:45:31.614428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:45:31.614428+0000","last_clean_scrub_stamp":"2024-09-17T05:45:31.614428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.26","version":"0'0","reported_seq":13,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-17T05:45:33.643810+0000","last_change":"2024-09-17T05:45:32.631723+0000","last_active":"2024-09-17T05:45:33.643810+0000","last_peered":"2024-09-17T05:45:33.643810+0000","last_clean":"2024-09-17T05:45:33.643810+0000","last_became_active":"2024-09-17T05:45:32.631351+0000","last_became_peered":"2024-09-17T05:45:32.631351+0000","last_unstale":"2024-09-17T05:45:33.643810+0000","last_undegraded":"2024-09-17T05:45:33.643810+0000","last_fullsized":"2024-09-17T05:45:33.643810+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:45:31.614428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:45:31.614428+0000","last_clean_scrub_stamp":"2024-09-17T05:45:31.614428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:17:02.678048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.25","version":"0'0","reported_seq":10,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-17T05:45:32.643075+0000","last_change":"2024-09-17T05:45:32.637435+0000","last_active":"2024-09-17T05:45:32.643075+0000","last_peered":"2024-09-17T05:45:32.643075+0000","last_clean":"2024-09-17T05:45:32.643075+0000","last_became_active":"2024-09-17T05:45:32.637137+0000","last_became_peered":"2024-09-17T05:45:32.637137+0000","last_unstale":"2024-09-17T05:45:32.643075+0000","last_undegraded":"2024-09-17T05:45:32.643075+0000","last_fullsized":"2024-09-17T05:45:32.643075+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:45:31.614428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:45:31.614428+0000","last_clean_scrub_stamp":"2024-09-17T05:45:31.614428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:40:05.262567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.24","version":"0'0","reported_seq":1,"reported_epoch":58,"state":"creating+peering","last_fresh":"2024-09-17T05:45:31.635964+0000","last_change":"2024-09-17T05:45:31.635964+0000","last_active":"2024-09-17T05:45:31.614428+0000","last_peered":"2024-09-17T05:45:31.614428+0000","last_clean":"2024-09-17T05:45:31.614428+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:45:31.635964+0000","last_undegraded":"2024-09-17T05:45:31.635964+0000","last_fullsized":"2024-09-17T05:45:31.635964+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:45:31.614428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:45:31.614428+0000","last_clean_scrub_stamp":"2024-09-17T05:45:31.614428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.23","version":"0'0","reported_seq":1,"reported_epoch":58,"state":"creating+peering","last_fresh":"2024-09-17T05:45:31.631473+0000","last_change":"2024-09-17T05:45:31.631473+0000","last_active":"2024-09-17T05:45:31.614428+0000","last_peered":"2024-09-17T05:45:31.614428+0000","last_clean":"2024-09-17T05:45:31.614428+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:45:31.631473+0000","last_undegraded":"2024-09-17T05:45:31.631473+0000","last_fullsized":"2024-09-17T05:45:31.631473+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:45:31.614428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:45:31.614428+0000","last_clean_scrub_stamp":"2024-09-17T05:45:31.614428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.22","version":"0'0","reported_seq":13,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-17T05:45:33.954765+0000","last_change":"2024-09-17T05:45:32.655106+0000","last_active":"2024-09-17T05:45:33.954765+0000","last_peered":"2024-09-17T05:45:33.954765+0000","last_clean":"2024-09-17T05:45:33.954765+0000","last_became_active":"2024-09-17T05:45:32.654852+0000","last_became_peered":"2024-09-17T05:45:32.654852+0000","last_unstale":"2024-09-17T05:45:33.954765+0000","last_undegraded":"2024-09-17T05:45:33.954765+0000","last_fullsized":"2024-09-17T05:45:33.954765+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:45:31.614428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:45:31.614428+0000","last_clean_scrub_stamp":"2024-09-17T05:45:31.614428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:57:53.829103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.21","version":"0'0","reported_seq":1,"reported_epoch":58,"state":"creating+peering","last_fresh":"2024-09-17T05:45:31.633306+0000","last_change":"2024-09-17T05:45:31.633306+0000","last_active":"2024-09-17T05:45:31.614428+0000","last_peered":"2024-09-17T05:45:31.614428+0000","last_clean":"2024-09-17T05:45:31.614428+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:45:31.633306+0000","last_undegraded":"2024-09-17T05:45:31.633306+0000","last_fullsized":"2024-09-17T05:45:31.633306+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:45:31.614428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:45:31.614428+0000","last_clean_scrub_stamp":"2024-09-17T05:45:31.614428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.20","version":"0'0","reported_seq":10,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-17T05:45:32.644914+0000","last_change":"2024-09-17T05:45:32.641063+0000","last_active":"2024-09-17T05:45:32.644914+0000","last_peered":"2024-09-17T05:45:32.644914+0000","last_clean":"2024-09-17T05:45:32.644914+0000","last_became_active":"2024-09-17T05:45:32.640742+0000","last_became_peered":"2024-09-17T05:45:32.640742+0000","last_unstale":"2024-09-17T05:45:32.644914+0000","last_undegraded":"2024-09-17T05:45:32.644914+0000","last_fullsized":"2024-09-17T05:45:32.644914+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:45:31.614428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:45:31.614428+0000","last_clean_scrub_stamp":"2024-09-17T05:45:31.614428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:07:58.852633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1e","version":"0'0","reported_seq":10,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-17T05:45:32.657055+0000","last_change":"2024-09-17T05:45:32.654896+0000","last_active":"2024-09-17T05:45:32.657055+0000","last_peered":"2024-09-17T05:45:32.657055+0000","last_clean":"2024-09-17T05:45:32.657055+0000","last_became_active":"2024-09-17T05:45:32.652165+0000","last_became_peered":"2024-09-17T05:45:32.652165+0000","last_unstale":"2024-09-17T05:45:32.657055+0000","last_undegraded":"2024-09-17T05:45:32.657055+0000","last_fullsized":"2024-09-17T05:45:32.657055+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:45:31.614428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:45:31.614428+0000","last_clean_scrub_stamp":"2024-09-17T05:45:31.614428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:51:41.489630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1f","version":"59'4","reported_seq":17,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-17T05:45:32.655111+0000","last_change":"2024-09-17T05:45:31.639533+0000","last_active":"2024-09-17T05:45:32.655111+0000","last_peered":"2024-09-17T05:45:32.655111+0000","last_clean":"2024-09-17T05:45:32.655111+0000","last_became_active":"2024-09-17T05:45:31.638859+0000","last_became_peered":"2024-09-17T05:45:31.638859+0000","last_unstale":"2024-09-17T05:45:32.655111+0000","last_undegraded":"2024-09-17T05:45:32.655111+0000","last_fullsized":"2024-09-17T05:45:32.655111+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:45:30.612191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:45:30.612191+0000","last_clean_scrub_stamp":"2024-09-17T05:45:30.612191+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:50:36.495235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1f","version":"0'0","reported_seq":13,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-17T05:45:33.955336+0000","last_change":"2024-09-17T05:45:32.650676+0000","last_active":"2024-09-17T05:45:33.955336+0000","last_peered":"2024-09-17T05:45:33.955336+0000","last_clean":"2024-09-17T05:45:33.955336+0000","last_became_active":"2024-09-17T05:45:32.650377+0000","last_became_peered":"2024-09-17T05:45:32.650377+0000","last_unstale":"2024-09-17T05:45:33.955336+0000","last_undegraded":"2024-09-17T05:45:33.955336+0000","last_fullsized":"2024-09-17T05:45:33.955336+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:45:31.614428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:45:31.614428+0000","last_clean_scrub_stamp":"2024-09-17T05:45:31.614428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:42:03.873298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":10,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-17T05:45:31.636336+0000","last_change":"2024-09-17T05:45:31.629458+0000","last_active":"2024-09-17T05:45:31.636336+0000","last_peered":"2024-09-17T05:45:31.636336+0000","last_clean":"2024-09-17T05:45:31.636336+0000","last_became_active":"2024-09-17T05:45:31.629161+0000","last_became_peered":"2024-09-17T05:45:31.629161+0000","last_unstale":"2024-09-17T05:45:31.636336+0000","last_undegraded":"2024-09-17T05:45:31.636336+0000","last_fullsized":"2024-09-17T05:45:31.636336+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:45:30.612191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:45:30.612191+0000","last_clean_scrub_stamp":"2024-09-17T05:45:30.612191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:13:41.291969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.1c","version":"0'0","reported_seq":10,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-17T05:45:32.642493+0000","last_change":"2024-09-17T05:45:32.639921+0000","last_active":"2024-09-17T05:45:32.642493+0000","last_peered":"2024-09-17T05:45:32.642493+0000","last_clean":"2024-09-17T05:45:32.642493+0000","last_became_active":"2024-09-17T05:45:32.639588+0000","last_became_peered":"2024-09-17T05:45:32.639588+0000","last_unstale":"2024-09-17T05:45:32.642493+0000","last_undegraded":"2024-09-17T05:45:32.642493+0000","last_fullsized":"2024-09-17T05:45:32.642493+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:45:31.614428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:45:31.614428+0000","last_clean_scrub_stamp":"2024-09-17T05:45:31.614428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:58:26.605060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1d","version":"59'2","reported_seq":15,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-17T05:45:32.658108+0000","last_change":"2024-09-17T05:45:31.634645+0000","last_active":"2024-09-17T05:45:32.658108+0000","last_peered":"2024-09-17T05:45:32.658108+0000","last_clean":"2024-09-17T05:45:32.658108+0000","last_became_active":"2024-09-17T05:45:31.634306+0000","last_became_peered":"2024-09-17T05:45:31.634306+0000","last_unstale":"2024-09-17T05:45:32.658108+0000","last_undegraded":"2024-09-17T05:45:32.658108+0000","last_fullsized":"2024-09-17T05:45:32.658108+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:45:30.612191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:45:30.612191+0000","last_clean_scrub_stamp":"2024-09-17T05:45:30.612191+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:11:50.501779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1d","version":"0'0","reported_seq":10,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-17T05:45:32.643019+0000","last_change":"2024-09-17T05:45:32.634215+0000","last_active":"2024-09-17T05:45:32.643019+0000","last_peered":"2024-09-17T05:45:32.643019+0000","last_clean":"2024-09-17T05:45:32.643019+0000","last_became_active":"2024-09-17T05:45:32.633773+0000","last_became_peered":"2024-09-17T05:45:32.633773+0000","last_unstale":"2024-09-17T05:45:32.643019+0000","last_undegraded":"2024-09-17T05:45:32.643019+0000","last_fullsized":"2024-09-17T05:45:32.643019+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:45:31.614428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:45:31.614428+0000","last_clean_scrub_stamp":"2024-09-17T05:45:31.614428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:31:38.357082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1c","version":"59'2","reported_seq":17,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-17T05:45:33.643901+0000","last_change":"2024-09-17T05:45:31.642391+0000","last_active":"2024-09-17T05:45:33.643901+0000","last_peered":"2024-09-17T05:45:33.643901+0000","last_clean":"2024-09-17T05:45:33.643901+0000","last_became_active":"2024-09-17T05:45:31.641969+0000","last_became_peered":"2024-09-17T05:45:31.641969+0000","last_unstale":"2024-09-17T05:45:33.643901+0000","last_undegraded":"2024-09-17T05:45:33.643901+0000","last_fullsized":"2024-09-17T05:45:33.643901+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:45:30.612191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:45:30.612191+0000","last_clean_scrub_stamp":"2024-09-17T05:45:30.612191+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:25:15.580957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.1a","version":"0'0","reported_seq":1,"reported_epoch":58,"state":"creating+peering","last_fresh":"2024-09-17T05:45:31.634200+0000","last_change":"2024-09-17T05:45:31.634200+0000","last_active":"2024-09-17T05:45:31.614428+0000","last_peered":"2024-09-17T05:45:31.614428+0000","last_clean":"2024-09-17T05:45:31.614428+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:45:31.634200+0000","last_undegraded":"2024-09-17T05:45:31.634200+0000","last_fullsized":"2024-09-17T05:45:31.634200+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:45:31.614428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:45:31.614428+0000","last_clean_scrub_stamp":"2024-09-17T05:45:31.614428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"59'1","reported_seq":16,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-17T05:45:33.642253+0000","last_change":"2024-09-17T05:45:31.644223+0000","last_active":"2024-09-17T05:45:33.642253+0000","last_peered":"2024-09-17T05:45:33.642253+0000","last_clean":"2024-09-17T05:45:33.642253+0000","last_became_active":"2024-09-17T05:45:31.643842+0000","last_became_peered":"2024-09-17T05:45:31.643842+0000","last_unstale":"2024-09-17T05:45:33.642253+0000","last_undegraded":"2024-09-17T05:45:33.642253+0000","last_fullsized":"2024-09-17T05:45:33.642253+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:45:30.612191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:45:30.612191+0000","last_clean_scrub_stamp":"2024-09-17T05:45:30.612191+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:42:04.702175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1b","version":"0'0","reported_seq":1,"reported_epoch":58,"state":"creating+peering","last_fresh":"2024-09-17T05:45:31.630970+0000","last_change":"2024-09-17T05:45:31.630970+0000","last_active":"2024-09-17T05:45:31.614428+0000","last_peered":"2024-09-17T05:45:31.614428+0000","last_clean":"2024-09-17T05:45:31.614428+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:45:31.630970+0000","last_undegraded":"2024-09-17T05:45:31.630970+0000","last_fullsized":"2024-09-17T05:45:31.630970+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:45:31.614428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:45:31.614428+0000","last_clean_scrub_stamp":"2024-09-17T05:45:31.614428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1a","version":"59'1","reported_seq":14,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-17T05:45:32.649523+0000","last_change":"2024-09-17T05:45:31.637200+0000","last_active":"2024-09-17T05:45:32.649523+0000","last_peered":"2024-09-17T05:45:32.649523+0000","last_clean":"2024-09-17T05:45:32.649523+0000","last_became_active":"2024-09-17T05:45:31.636713+0000","last_became_peered":"2024-09-17T05:45:31.636713+0000","last_unstale":"2024-09-17T05:45:32.649523+0000","last_undegraded":"2024-09-17T05:45:32.649523+0000","last_fullsized":"2024-09-17T05:45:32.649523+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:45:30.612191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:45:30.612191+0000","last_clean_scrub_stamp":"2024-09-17T05:45:30.612191+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:22:55.029575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":1,"reported_epoch":58,"state":"creating+peering","last_fresh":"2024-09-17T05:45:31.623504+0000","last_change":"2024-09-17T05:45:31.623504+0000","last_active":"2024-09-17T05:45:31.614428+0000","last_peered":"2024-09-17T05:45:31.614428+0000","last_clean":"2024-09-17T05:45:31.614428+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:45:31.623504+0000","last_undegraded":"2024-09-17T05:45:31.623504+0000","last_fullsized":"2024-09-17T05:45:31.623504+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:45:31.614428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:45:31.614428+0000","last_clean_scrub_stamp":"2024-09-17T05:45:31.614428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":15,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-17T05:45:33.642939+0000","last_change":"2024-09-17T05:45:31.639388+0000","last_active":"2024-09-17T05:45:33.642939+0000","last_peered":"2024-09-17T05:45:33.642939+0000","last_clean":"2024-09-17T05:45:33.642939+0000","last_became_active":"2024-09-17T05:45:31.639055+0000","last_became_peered":"2024-09-17T05:45:31.639055+0000","last_unstale":"2024-09-17T05:45:33.642939+0000","last_undegraded":"2024-09-17T05:45:33.642939+0000","last_fullsized":"2024-09-17T05:45:33.642939+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:45:30.612191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:45:30.612191+0000","last_clean_scrub_stamp":"2024-09-17T05:45:30.612191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:40:43.180531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":1,"reported_epoch":58,"state":"creating+peering","last_fresh":"2024-09-17T05:45:31.632251+0000","last_change":"2024-09-17T05:45:31.632251+0000","last_active":"2024-09-17T05:45:31.614428+0000","last_peered":"2024-09-17T05:45:31.614428+0000","last_clean":"2024-09-17T05:45:31.614428+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:45:31.632251+0000","last_undegraded":"2024-09-17T05:45:31.632251+0000","last_fullsized":"2024-09-17T05:45:31.632251+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:45:31.614428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:45:31.614428+0000","last_clean_scrub_stamp":"2024-09-17T05:45:31.614428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":15,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-17T05:45:33.642214+0000","last_change":"2024-09-17T05:45:31.640961+0000","last_active":"2024-09-17T05:45:33.642214+0000","last_peered":"2024-09-17T05:45:33.642214+0000","last_clean":"2024-09-17T05:45:33.642214+0000","last_became_active":"2024-09-17T05:45:31.640611+0000","last_became_peered":"2024-09-17T05:45:31.640611+0000","last_unstale":"2024-09-17T05:45:33.642214+0000","last_undegraded":"2024-09-17T05:45:33.642214+0000","last_fullsized":"2024-09-17T05:45:33.642214+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:45:30.612191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:45:30.612191+0000","last_clean_scrub_stamp":"2024-09-17T05:45:30.612191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:42:02.871061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":13,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-17T05:45:33.643152+0000","last_change":"2024-09-17T05:45:32.639298+0000","last_active":"2024-09-17T05:45:33.643152+0000","last_peered":"2024-09-17T05:45:33.643152+0000","last_clean":"2024-09-17T05:45:33.643152+0000","last_became_active":"2024-09-17T05:45:32.638969+0000","last_became_peered":"2024-09-17T05:45:32.638969+0000","last_unstale":"2024-09-17T05:45:33.643152+0000","last_undegraded":"2024-09-17T05:45:33.643152+0000","last_fullsized":"2024-09-17T05:45:33.643152+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:45:31.614428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:45:31.614428+0000","last_clean_scrub_stamp":"2024-09-17T05:45:31.614428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:14:04.950271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":15,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-17T05:45:33.955451+0000","last_change":"2024-09-17T05:45:31.639874+0000","last_active":"2024-09-17T05:45:33.955451+0000","last_peered":"2024-09-17T05:45:33.955451+0000","last_clean":"2024-09-17T05:45:33.955451+0000","last_became_active":"2024-09-17T05:45:31.639537+0000","last_became_peered":"2024-09-17T05:45:31.639537+0000","last_unstale":"2024-09-17T05:45:33.955451+0000","last_undegraded":"2024-09-17T05:45:33.955451+0000","last_fullsized":"2024-09-17T05:45:33.955451+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:45:30.612191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:45:30.612191+0000","last_clean_scrub_stamp":"2024-09-17T05:45:30.612191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:28:11.674936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":13,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-17T05:45:33.955442+0000","last_change":"2024-09-17T05:45:32.654783+0000","last_active":"2024-09-17T05:45:33.955442+0000","last_peered":"2024-09-17T05:45:33.955442+0000","last_clean":"2024-09-17T05:45:33.955442+0000","last_became_active":"2024-09-17T05:45:32.654448+0000","last_became_peered":"2024-09-17T05:45:32.654448+0000","last_unstale":"2024-09-17T05:45:33.955442+0000","last_undegraded":"2024-09-17T05:45:33.955442+0000","last_fullsized":"2024-09-17T05:45:33.955442+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:45:31.614428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:45:31.614428+0000","last_clean_scrub_stamp":"2024-09-17T05:45:31.614428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:14:04.792704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":10,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-17T05:45:31.643163+0000","last_change":"2024-09-17T05:45:31.640475+0000","last_active":"2024-09-17T05:45:31.643163+0000","last_peered":"2024-09-17T05:45:31.643163+0000","last_clean":"2024-09-17T05:45:31.643163+0000","last_became_active":"2024-09-17T05:45:31.640191+0000","last_became_peered":"2024-09-17T05:45:31.640191+0000","last_unstale":"2024-09-17T05:45:31.643163+0000","last_undegraded":"2024-09-17T05:45:31.643163+0000","last_fullsized":"2024-09-17T05:45:31.643163+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:45:30.612191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:45:30.612191+0000","last_clean_scrub_stamp":"2024-09-17T05:45:30.612191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:18:44.004602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.14","version":"0'0","reported_seq":13,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-17T05:45:33.954927+0000","last_change":"2024-09-17T05:45:32.648272+0000","last_active":"2024-09-17T05:45:33.954927+0000","last_peered":"2024-09-17T05:45:33.954927+0000","last_clean":"2024-09-17T05:45:33.954927+0000","last_became_active":"2024-09-17T05:45:32.642778+0000","last_became_peered":"2024-09-17T05:45:32.642778+0000","last_unstale":"2024-09-17T05:45:33.954927+0000","last_undegraded":"2024-09-17T05:45:33.954927+0000","last_fullsized":"2024-09-17T05:45:33.954927+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:45:31.614428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:45:31.614428+0000","last_clean_scrub_stamp":"2024-09-17T05:45:31.614428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:27:46.994037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.15","version":"59'3","reported_seq":18,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-17T05:45:33.955209+0000","last_change":"2024-09-17T05:45:31.631099+0000","last_active":"2024-09-17T05:45:33.955209+0000","last_peered":"2024-09-17T05:45:33.955209+0000","last_clean":"2024-09-17T05:45:33.955209+0000","last_became_active":"2024-09-17T05:45:31.630774+0000","last_became_peered":"2024-09-17T05:45:31.630774+0000","last_unstale":"2024-09-17T05:45:33.955209+0000","last_undegraded":"2024-09-17T05:45:33.955209+0000","last_fullsized":"2024-09-17T05:45:33.955209+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:45:30.612191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:45:30.612191+0000","last_clean_scrub_stamp":"2024-09-17T05:45:30.612191+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:59:40.798271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.15","version":"0'0","reported_seq":13,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-17T05:45:33.955107+0000","last_change":"2024-09-17T05:45:32.656952+0000","last_active":"2024-09-17T05:45:33.955107+0000","last_peered":"2024-09-17T05:45:33.955107+0000","last_clean":"2024-09-17T05:45:33.955107+0000","last_became_active":"2024-09-17T05:45:32.656656+0000","last_became_peered":"2024-09-17T05:45:32.656656+0000","last_unstale":"2024-09-17T05:45:33.955107+0000","last_undegraded":"2024-09-17T05:45:33.955107+0000","last_fullsized":"2024-09-17T05:45:33.955107+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:45:31.614428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:45:31.614428+0000","last_clean_scrub_stamp":"2024-09-17T05:45:31.614428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:15:14.618900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.14","version":"59'6","reported_seq":21,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-17T05:45:33.642762+0000","last_change":"2024-09-17T05:45:31.637717+0000","last_active":"2024-09-17T05:45:33.642762+0000","last_peered":"2024-09-17T05:45:33.642762+0000","last_clean":"2024-09-17T05:45:33.642762+0000","last_became_active":"2024-09-17T05:45:31.637335+0000","last_became_peered":"2024-09-17T05:45:31.637335+0000","last_unstale":"2024-09-17T05:45:33.642762+0000","last_undegraded":"2024-09-17T05:45:33.642762+0000","last_fullsized":"2024-09-17T05:45:33.642762+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:45:30.612191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:45:30.612191+0000","last_clean_scrub_stamp":"2024-09-17T05:45:30.612191+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:28:45.681547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":13,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-17T05:45:33.643776+0000","last_change":"2024-09-17T05:45:32.640295+0000","last_active":"2024-09-17T05:45:33.643776+0000","last_peered":"2024-09-17T05:45:33.643776+0000","last_clean":"2024-09-17T05:45:33.643776+0000","last_became_active":"2024-09-17T05:45:32.639626+0000","last_became_peered":"2024-09-17T05:45:32.639626+0000","last_unstale":"2024-09-17T05:45:33.643776+0000","last_undegraded":"2024-09-17T05:45:33.643776+0000","last_fullsized":"2024-09-17T05:45:33.643776+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:45:31.614428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:45:31.614428+0000","last_clean_scrub_stamp":"2024-09-17T05:45:31.614428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:23:18.865215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":10,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-17T05:45:31.647136+0000","last_change":"2024-09-17T05:45:31.644303+0000","last_active":"2024-09-17T05:45:31.647136+0000","last_peered":"2024-09-17T05:45:31.647136+0000","last_clean":"2024-09-17T05:45:31.647136+0000","last_became_active":"2024-09-17T05:45:31.644011+0000","last_became_peered":"2024-09-17T05:45:31.644011+0000","last_unstale":"2024-09-17T05:45:31.647136+0000","last_undegraded":"2024-09-17T05:45:31.647136+0000","last_fullsized":"2024-09-17T05:45:31.647136+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:45:30.612191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:45:30.612191+0000","last_clean_scrub_stamp":"2024-09-17T05:45:30.612191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:57:52.826866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.13","version":"0'0","reported_seq":13,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-17T05:45:33.954984+0000","last_change":"2024-09-17T05:45:32.649405+0000","last_active":"2024-09-17T05:45:33.954984+0000","last_peered":"2024-09-17T05:45:33.954984+0000","last_clean":"2024-09-17T05:45:33.954984+0000","last_became_active":"2024-09-17T05:45:32.649052+0000","last_became_peered":"2024-09-17T05:45:32.649052+0000","last_unstale":"2024-09-17T05:45:33.954984+0000","last_undegraded":"2024-09-17T05:45:33.954984+0000","last_fullsized":"2024-09-17T05:45:33.954984+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:45:31.614428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:45:31.614428+0000","last_clean_scrub_stamp":"2024-09-17T05:45:31.614428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:14:32.500946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":10,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-17T05:45:31.635300+0000","last_change":"2024-09-17T05:45:31.629800+0000","last_active":"2024-09-17T05:45:31.635300+0000","last_peered":"2024-09-17T05:45:31.635300+0000","last_clean":"2024-09-17T05:45:31.635300+0000","last_became_active":"2024-09-17T05:45:31.629475+0000","last_became_peered":"2024-09-17T05:45:31.629475+0000","last_unstale":"2024-09-17T05:45:31.635300+0000","last_undegraded":"2024-09-17T05:45:31.635300+0000","last_fullsized":"2024-09-17T05:45:31.635300+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:45:30.612191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:45:30.612191+0000","last_clean_scrub_stamp":"2024-09-17T05:45:30.612191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:26:33.564340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.10","version":"0'0","reported_seq":13,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-17T05:45:33.642459+0000","last_change":"2024-09-17T05:45:32.647139+0000","last_active":"2024-09-17T05:45:33.642459+0000","last_peered":"2024-09-17T05:45:33.642459+0000","last_clean":"2024-09-17T05:45:33.642459+0000","last_became_active":"2024-09-17T05:45:32.646721+0000","last_became_peered":"2024-09-17T05:45:32.646721+0000","last_unstale":"2024-09-17T05:45:33.642459+0000","last_undegraded":"2024-09-17T05:45:33.642459+0000","last_fullsized":"2024-09-17T05:45:33.642459+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:45:31.614428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:45:31.614428+0000","last_clean_scrub_stamp":"2024-09-17T05:45:31.614428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:10:56.650561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":15,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-17T05:45:33.643055+0000","last_change":"2024-09-17T05:45:31.638931+0000","last_active":"2024-09-17T05:45:33.643055+0000","last_peered":"2024-09-17T05:45:33.643055+0000","last_clean":"2024-09-17T05:45:33.643055+0000","last_became_active":"2024-09-17T05:45:31.638553+0000","last_became_peered":"2024-09-17T05:45:31.638553+0000","last_unstale":"2024-09-17T05:45:33.643055+0000","last_undegraded":"2024-09-17T05:45:33.643055+0000","last_fullsized":"2024-09-17T05:45:33.643055+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:45:30.612191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:45:30.612191+0000","last_clean_scrub_stamp":"2024-09-17T05:45:30.612191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:10:55.648324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":13,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-17T05:45:33.955462+0000","last_change":"2024-09-17T05:45:32.653723+0000","last_active":"2024-09-17T05:45:33.955462+0000","last_peered":"2024-09-17T05:45:33.955462+0000","last_clean":"2024-09-17T05:45:33.955462+0000","last_became_active":"2024-09-17T05:45:32.653153+0000","last_became_peered":"2024-09-17T05:45:32.653153+0000","last_unstale":"2024-09-17T05:45:33.955462+0000","last_undegraded":"2024-09-17T05:45:33.955462+0000","last_fullsized":"2024-09-17T05:45:33.955462+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:45:31.614428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:45:31.614428+0000","last_clean_scrub_stamp":"2024-09-17T05:45:31.614428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:07:41.347650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.10","version":"59'8","reported_seq":23,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-17T05:45:33.954532+0000","last_change":"2024-09-17T05:45:31.639504+0000","last_active":"2024-09-17T05:45:33.954532+0000","last_peered":"2024-09-17T05:45:33.954532+0000","last_clean":"2024-09-17T05:45:33.954532+0000","last_became_active":"2024-09-17T05:45:31.638977+0000","last_became_peered":"2024-09-17T05:45:31.638977+0000","last_unstale":"2024-09-17T05:45:33.954532+0000","last_undegraded":"2024-09-17T05:45:33.954532+0000","last_fullsized":"2024-09-17T05:45:33.954532+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:45:30.612191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:45:30.612191+0000","last_clean_scrub_stamp":"2024-09-17T05:45:30.612191+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:07:21.436157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.e","version":"0'0","reported_seq":13,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-17T05:45:33.955484+0000","last_change":"2024-09-17T05:45:32.653968+0000","last_active":"2024-09-17T05:45:33.955484+0000","last_peered":"2024-09-17T05:45:33.955484+0000","last_clean":"2024-09-17T05:45:33.955484+0000","last_became_active":"2024-09-17T05:45:32.653675+0000","last_became_peered":"2024-09-17T05:45:32.653675+0000","last_unstale":"2024-09-17T05:45:33.955484+0000","last_undegraded":"2024-09-17T05:45:33.955484+0000","last_fullsized":"2024-09-17T05:45:33.955484+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:45:31.614428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:45:31.614428+0000","last_clean_scrub_stamp":"2024-09-17T05:45:31.614428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:52:42.817700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":10,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-17T05:45:31.643225+0000","last_change":"2024-09-17T05:45:31.640449+0000","last_active":"2024-09-17T05:45:31.643225+0000","last_peered":"2024-09-17T05:45:31.643225+0000","last_clean":"2024-09-17T05:45:31.643225+0000","last_became_active":"2024-09-17T05:45:31.640151+0000","last_became_peered":"2024-09-17T05:45:31.640151+0000","last_unstale":"2024-09-17T05:45:31.643225+0000","last_undegraded":"2024-09-17T05:45:31.643225+0000","last_fullsized":"2024-09-17T05:45:31.643225+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:45:30.612191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:45:30.612191+0000","last_clean_scrub_stamp":"2024-09-17T05:45:30.612191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:45:55.100047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.f","version":"0'0","reported_seq":13,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-17T05:45:33.643484+0000","last_change":"2024-09-17T05:45:32.645212+0000","last_active":"2024-09-17T05:45:33.643484+0000","last_peered":"2024-09-17T05:45:33.643484+0000","last_clean":"2024-09-17T05:45:33.643484+0000","last_became_active":"2024-09-17T05:45:32.644921+0000","last_became_peered":"2024-09-17T05:45:32.644921+0000","last_unstale":"2024-09-17T05:45:33.643484+0000","last_undegraded":"2024-09-17T05:45:33.643484+0000","last_fullsized":"2024-09-17T05:45:33.643484+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:45:31.614428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:45:31.614428+0000","last_clean_scrub_stamp":"2024-09-17T05:45:31.614428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:15:12.766358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.e","version":"59'2","reported_seq":15,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-17T05:45:32.657557+0000","last_change":"2024-09-17T05:45:31.640980+0000","last_active":"2024-09-17T05:45:32.657557+0000","last_peered":"2024-09-17T05:45:32.657557+0000","last_clean":"2024-09-17T05:45:32.657557+0000","last_became_active":"2024-09-17T05:45:31.640679+0000","last_became_peered":"2024-09-17T05:45:31.640679+0000","last_unstale":"2024-09-17T05:45:32.657557+0000","last_undegraded":"2024-09-17T05:45:32.657557+0000","last_fullsized":"2024-09-17T05:45:32.657557+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:45:30.612191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:45:30.612191+0000","last_clean_scrub_stamp":"2024-09-17T05:45:30.612191+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:10:04.148047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":1,"reported_epoch":58,"state":"creating+peering","last_fresh":"2024-09-17T05:45:31.626776+0000","last_change":"2024-09-17T05:45:31.626776+0000","last_active":"2024-09-17T05:45:31.614428+0000","last_peered":"2024-09-17T05:45:31.614428+0000","last_clean":"2024-09-17T05:45:31.614428+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:45:31.626776+0000","last_undegraded":"2024-09-17T05:45:31.626776+0000","last_fullsized":"2024-09-17T05:45:31.626776+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:45:31.614428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:45:31.614428+0000","last_clean_scrub_stamp":"2024-09-17T05:45:31.614428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"59'1","reported_seq":16,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-17T05:45:33.642693+0000","last_change":"2024-09-17T05:45:31.638394+0000","last_active":"2024-09-17T05:45:33.642693+0000","last_peered":"2024-09-17T05:45:33.642693+0000","last_clean":"2024-09-17T05:45:33.642693+0000","last_became_active":"2024-09-17T05:45:31.638048+0000","last_became_peered":"2024-09-17T05:45:31.638048+0000","last_unstale":"2024-09-17T05:45:33.642693+0000","last_undegraded":"2024-09-17T05:45:33.642693+0000","last_fullsized":"2024-09-17T05:45:33.642693+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:45:30.612191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:45:30.612191+0000","last_clean_scrub_stamp":"2024-09-17T05:45:30.612191+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:48:56.125063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.d","version":"0'0","reported_seq":13,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-17T05:45:33.955462+0000","last_change":"2024-09-17T05:45:32.657075+0000","last_active":"2024-09-17T05:45:33.955462+0000","last_peered":"2024-09-17T05:45:33.955462+0000","last_clean":"2024-09-17T05:45:33.955462+0000","last_became_active":"2024-09-17T05:45:32.656753+0000","last_became_peered":"2024-09-17T05:45:32.656753+0000","last_unstale":"2024-09-17T05:45:33.955462+0000","last_undegraded":"2024-09-17T05:45:33.955462+0000","last_fullsized":"2024-09-17T05:45:33.955462+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:45:31.614428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:45:31.614428+0000","last_clean_scrub_stamp":"2024-09-17T05:45:31.614428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:36:46.238066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":13,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-17T05:45:32.624746+0000","last_change":"2024-09-17T05:45:31.643975+0000","last_active":"2024-09-17T05:45:32.624746+0000","last_peered":"2024-09-17T05:45:32.624746+0000","last_clean":"2024-09-17T05:45:32.624746+0000","last_became_active":"2024-09-17T05:45:31.643609+0000","last_became_peered":"2024-09-17T05:45:31.643609+0000","last_unstale":"2024-09-17T05:45:32.624746+0000","last_undegraded":"2024-09-17T05:45:32.624746+0000","last_fullsized":"2024-09-17T05:45:32.624746+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:45:30.612191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:45:30.612191+0000","last_clean_scrub_stamp":"2024-09-17T05:45:30.612191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:49:10.450094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":13,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-17T05:45:33.644055+0000","last_change":"2024-09-17T05:45:32.639943+0000","last_active":"2024-09-17T05:45:33.644055+0000","last_peered":"2024-09-17T05:45:33.644055+0000","last_clean":"2024-09-17T05:45:33.644055+0000","last_became_active":"2024-09-17T05:45:32.639216+0000","last_became_peered":"2024-09-17T05:45:32.639216+0000","last_unstale":"2024-09-17T05:45:33.644055+0000","last_undegraded":"2024-09-17T05:45:33.644055+0000","last_fullsized":"2024-09-17T05:45:33.644055+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:45:31.614428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:45:31.614428+0000","last_clean_scrub_stamp":"2024-09-17T05:45:31.614428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:36:39.409995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":10,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-17T05:45:31.643026+0000","last_change":"2024-09-17T05:45:31.638240+0000","last_active":"2024-09-17T05:45:31.643026+0000","last_peered":"2024-09-17T05:45:31.643026+0000","last_clean":"2024-09-17T05:45:31.643026+0000","last_became_active":"2024-09-17T05:45:31.637885+0000","last_became_peered":"2024-09-17T05:45:31.637885+0000","last_unstale":"2024-09-17T05:45:31.643026+0000","last_undegraded":"2024-09-17T05:45:31.643026+0000","last_fullsized":"2024-09-17T05:45:31.643026+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:45:30.612191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:45:30.612191+0000","last_clean_scrub_stamp":"2024-09-17T05:45:30.612191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:42:29.350273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.b","version":"0'0","reported_seq":10,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-17T05:45:32.650606+0000","last_change":"2024-09-17T05:45:32.646091+0000","last_active":"2024-09-17T05:45:32.650606+0000","last_peered":"2024-09-17T05:45:32.650606+0000","last_clean":"2024-09-17T05:45:32.650606+0000","last_became_active":"2024-09-17T05:45:32.645766+0000","last_became_peered":"2024-09-17T05:45:32.645766+0000","last_unstale":"2024-09-17T05:45:32.650606+0000","last_undegraded":"2024-09-17T05:45:32.650606+0000","last_fullsized":"2024-09-17T05:45:32.650606+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:45:31.614428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:45:31.614428+0000","last_clean_scrub_stamp":"2024-09-17T05:45:31.614428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:41:42.920657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":15,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-17T05:45:33.954645+0000","last_change":"2024-09-17T05:45:31.640272+0000","last_active":"2024-09-17T05:45:33.954645+0000","last_peered":"2024-09-17T05:45:33.954645+0000","last_clean":"2024-09-17T05:45:33.954645+0000","last_became_active":"2024-09-17T05:45:31.639976+0000","last_became_peered":"2024-09-17T05:45:31.639976+0000","last_unstale":"2024-09-17T05:45:33.954645+0000","last_undegraded":"2024-09-17T05:45:33.954645+0000","last_fullsized":"2024-09-17T05:45:33.954645+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:45:30.612191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:45:30.612191+0000","last_clean_scrub_stamp":"2024-09-17T05:45:30.612191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:50:01.810481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":10,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-17T05:45:32.655188+0000","last_change":"2024-09-17T05:45:32.651035+0000","last_active":"2024-09-17T05:45:32.655188+0000","last_peered":"2024-09-17T05:45:32.655188+0000","last_clean":"2024-09-17T05:45:32.655188+0000","last_became_active":"2024-09-17T05:45:32.650692+0000","last_became_peered":"2024-09-17T05:45:32.650692+0000","last_unstale":"2024-09-17T05:45:32.655188+0000","last_undegraded":"2024-09-17T05:45:32.655188+0000","last_fullsized":"2024-09-17T05:45:32.655188+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:45:31.614428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:45:31.614428+0000","last_clean_scrub_stamp":"2024-09-17T05:45:31.614428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:20:10.605318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":15,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-17T05:45:33.642625+0000","last_change":"2024-09-17T05:45:31.643740+0000","last_active":"2024-09-17T05:45:33.642625+0000","last_peered":"2024-09-17T05:45:33.642625+0000","last_clean":"2024-09-17T05:45:33.642625+0000","last_became_active":"2024-09-17T05:45:31.643434+0000","last_became_peered":"2024-09-17T05:45:31.643434+0000","last_unstale":"2024-09-17T05:45:33.642625+0000","last_undegraded":"2024-09-17T05:45:33.642625+0000","last_fullsized":"2024-09-17T05:45:33.642625+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:45:30.612191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:45:30.612191+0000","last_clean_scrub_stamp":"2024-09-17T05:45:30.612191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:07:14.433577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":13,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-17T05:45:33.644080+0000","last_change":"2024-09-17T05:45:32.644449+0000","last_active":"2024-09-17T05:45:33.644080+0000","last_peered":"2024-09-17T05:45:33.644080+0000","last_clean":"2024-09-17T05:45:33.644080+0000","last_became_active":"2024-09-17T05:45:32.641454+0000","last_became_peered":"2024-09-17T05:45:32.641454+0000","last_unstale":"2024-09-17T05:45:33.644080+0000","last_undegraded":"2024-09-17T05:45:33.644080+0000","last_fullsized":"2024-09-17T05:45:33.644080+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:45:31.614428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:45:31.614428+0000","last_clean_scrub_stamp":"2024-09-17T05:45:31.614428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:31:53.970125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.7","version":"59'2","reported_seq":17,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-17T05:45:33.955334+0000","last_change":"2024-09-17T05:45:31.636162+0000","last_active":"2024-09-17T05:45:33.955334+0000","last_peered":"2024-09-17T05:45:33.955334+0000","last_clean":"2024-09-17T05:45:33.955334+0000","last_became_active":"2024-09-17T05:45:31.635754+0000","last_became_peered":"2024-09-17T05:45:31.635754+0000","last_unstale":"2024-09-17T05:45:33.955334+0000","last_undegraded":"2024-09-17T05:45:33.955334+0000","last_fullsized":"2024-09-17T05:45:33.955334+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:45:30.612191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:45:30.612191+0000","last_clean_scrub_stamp":"2024-09-17T05:45:30.612191+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:42:10.421991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.7","version":"0'0","reported_seq":13,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-17T05:45:33.643714+0000","last_change":"2024-09-17T05:45:32.651010+0000","last_active":"2024-09-17T05:45:33.643714+0000","last_peered":"2024-09-17T05:45:33.643714+0000","last_clean":"2024-09-17T05:45:33.643714+0000","last_became_active":"2024-09-17T05:45:32.650681+0000","last_became_peered":"2024-09-17T05:45:32.650681+0000","last_unstale":"2024-09-17T05:45:33.643714+0000","last_undegraded":"2024-09-17T05:45:33.643714+0000","last_fullsized":"2024-09-17T05:45:33.643714+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:45:31.614428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:45:31.614428+0000","last_clean_scrub_stamp":"2024-09-17T05:45:31.614428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:22:10.519690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":13,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-17T05:45:32.626208+0000","last_change":"2024-09-17T05:45:31.639739+0000","last_active":"2024-09-17T05:45:32.626208+0000","last_peered":"2024-09-17T05:45:32.626208+0000","last_clean":"2024-09-17T05:45:32.626208+0000","last_became_active":"2024-09-17T05:45:31.639123+0000","last_became_peered":"2024-09-17T05:45:31.639123+0000","last_unstale":"2024-09-17T05:45:32.626208+0000","last_undegraded":"2024-09-17T05:45:32.626208+0000","last_fullsized":"2024-09-17T05:45:32.626208+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:45:30.612191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:45:30.612191+0000","last_clean_scrub_stamp":"2024-09-17T05:45:30.612191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:47:45.086586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":13,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-17T05:45:33.955091+0000","last_change":"2024-09-17T05:45:32.638243+0000","last_active":"2024-09-17T05:45:33.955091+0000","last_peered":"2024-09-17T05:45:33.955091+0000","last_clean":"2024-09-17T05:45:33.955091+0000","last_became_active":"2024-09-17T05:45:32.637937+0000","last_became_peered":"2024-09-17T05:45:32.637937+0000","last_unstale":"2024-09-17T05:45:33.955091+0000","last_undegraded":"2024-09-17T05:45:33.955091+0000","last_fullsized":"2024-09-17T05:45:33.955091+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:45:31.614428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:45:31.614428+0000","last_clean_scrub_stamp":"2024-09-17T05:45:31.614428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:42:05.704412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":10,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-17T05:45:31.637530+0000","last_change":"2024-09-17T05:45:31.636335+0000","last_active":"2024-09-17T05:45:31.637530+0000","last_peered":"2024-09-17T05:45:31.637530+0000","last_clean":"2024-09-17T05:45:31.637530+0000","last_became_active":"2024-09-17T05:45:31.635851+0000","last_became_peered":"2024-09-17T05:45:31.635851+0000","last_unstale":"2024-09-17T05:45:31.637530+0000","last_undegraded":"2024-09-17T05:45:31.637530+0000","last_fullsized":"2024-09-17T05:45:31.637530+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:45:30.612191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:45:30.612191+0000","last_clean_scrub_stamp":"2024-09-17T05:45:30.612191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:39:41.148406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":10,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-17T05:45:32.643047+0000","last_change":"2024-09-17T05:45:32.634960+0000","last_active":"2024-09-17T05:45:32.643047+0000","last_peered":"2024-09-17T05:45:32.643047+0000","last_clean":"2024-09-17T05:45:32.643047+0000","last_became_active":"2024-09-17T05:45:32.634609+0000","last_became_peered":"2024-09-17T05:45:32.634609+0000","last_unstale":"2024-09-17T05:45:32.643047+0000","last_undegraded":"2024-09-17T05:45:32.643047+0000","last_fullsized":"2024-09-17T05:45:32.643047+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:45:31.614428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:45:31.614428+0000","last_clean_scrub_stamp":"2024-09-17T05:45:31.614428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:41:03.714251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":15,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-17T05:45:33.644013+0000","last_change":"2024-09-17T05:45:31.638944+0000","last_active":"2024-09-17T05:45:33.644013+0000","last_peered":"2024-09-17T05:45:33.644013+0000","last_clean":"2024-09-17T05:45:33.644013+0000","last_became_active":"2024-09-17T05:45:31.638594+0000","last_became_peered":"2024-09-17T05:45:31.638594+0000","last_unstale":"2024-09-17T05:45:33.644013+0000","last_undegraded":"2024-09-17T05:45:33.644013+0000","last_fullsized":"2024-09-17T05:45:33.644013+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:45:30.612191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:45:30.612191+0000","last_clean_scrub_stamp":"2024-09-17T05:45:30.612191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:31:48.568445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":1,"reported_epoch":58,"state":"creating+peering","last_fresh":"2024-09-17T05:45:31.633719+0000","last_change":"2024-09-17T05:45:31.633719+0000","last_active":"2024-09-17T05:45:31.614428+0000","last_peered":"2024-09-17T05:45:31.614428+0000","last_clean":"2024-09-17T05:45:31.614428+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:45:31.633719+0000","last_undegraded":"2024-09-17T05:45:31.633719+0000","last_fullsized":"2024-09-17T05:45:31.633719+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:45:31.614428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:45:31.614428+0000","last_clean_scrub_stamp":"2024-09-17T05:45:31.614428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":15,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-17T05:45:33.954023+0000","last_change":"2024-09-17T05:45:31.640803+0000","last_active":"2024-09-17T05:45:33.954023+0000","last_peered":"2024-09-17T05:45:33.954023+0000","last_clean":"2024-09-17T05:45:33.954023+0000","last_became_active":"2024-09-17T05:45:31.640497+0000","last_became_peered":"2024-09-17T05:45:31.640497+0000","last_unstale":"2024-09-17T05:45:33.954023+0000","last_undegraded":"2024-09-17T05:45:33.954023+0000","last_fullsized":"2024-09-17T05:45:33.954023+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:45:30.612191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:45:30.612191+0000","last_clean_scrub_stamp":"2024-09-17T05:45:30.612191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:05:37.438540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":13,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-17T05:45:33.955297+0000","last_change":"2024-09-17T05:45:32.653467+0000","last_active":"2024-09-17T05:45:33.955297+0000","last_peered":"2024-09-17T05:45:33.955297+0000","last_clean":"2024-09-17T05:45:33.955297+0000","last_became_active":"2024-09-17T05:45:32.653172+0000","last_became_peered":"2024-09-17T05:45:32.653172+0000","last_unstale":"2024-09-17T05:45:33.955297+0000","last_undegraded":"2024-09-17T05:45:33.955297+0000","last_fullsized":"2024-09-17T05:45:33.955297+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:45:31.614428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:45:31.614428+0000","last_clean_scrub_stamp":"2024-09-17T05:45:31.614428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:03:20.634302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":15,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-17T05:45:33.642981+0000","last_change":"2024-09-17T05:45:31.640591+0000","last_active":"2024-09-17T05:45:33.642981+0000","last_peered":"2024-09-17T05:45:33.642981+0000","last_clean":"2024-09-17T05:45:33.642981+0000","last_became_active":"2024-09-17T05:45:31.640103+0000","last_became_peered":"2024-09-17T05:45:31.640103+0000","last_unstale":"2024-09-17T05:45:33.642981+0000","last_undegraded":"2024-09-17T05:45:33.642981+0000","last_fullsized":"2024-09-17T05:45:33.642981+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:45:30.612191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:45:30.612191+0000","last_clean_scrub_stamp":"2024-09-17T05:45:30.612191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:53:07.534995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":13,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-17T05:45:33.954155+0000","last_change":"2024-09-17T05:45:32.648684+0000","last_active":"2024-09-17T05:45:33.954155+0000","last_peered":"2024-09-17T05:45:33.954155+0000","last_clean":"2024-09-17T05:45:33.954155+0000","last_became_active":"2024-09-17T05:45:32.643607+0000","last_became_peered":"2024-09-17T05:45:32.643607+0000","last_unstale":"2024-09-17T05:45:33.954155+0000","last_undegraded":"2024-09-17T05:45:33.954155+0000","last_fullsized":"2024-09-17T05:45:33.954155+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:45:31.614428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:45:31.614428+0000","last_clean_scrub_stamp":"2024-09-17T05:45:31.614428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:32:54.601957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":15,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-17T05:45:33.954224+0000","last_change":"2024-09-17T05:45:31.637639+0000","last_active":"2024-09-17T05:45:33.954224+0000","last_peered":"2024-09-17T05:45:33.954224+0000","last_clean":"2024-09-17T05:45:33.954224+0000","last_became_active":"2024-09-17T05:45:31.637329+0000","last_became_peered":"2024-09-17T05:45:31.637329+0000","last_unstale":"2024-09-17T05:45:33.954224+0000","last_undegraded":"2024-09-17T05:45:33.954224+0000","last_fullsized":"2024-09-17T05:45:33.954224+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:45:30.612191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:45:30.612191+0000","last_clean_scrub_stamp":"2024-09-17T05:45:30.612191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:43:51.042977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":1,"reported_epoch":58,"state":"creating+peering","last_fresh":"2024-09-17T05:45:31.627608+0000","last_change":"2024-09-17T05:45:31.627608+0000","last_active":"2024-09-17T05:45:31.614428+0000","last_peered":"2024-09-17T05:45:31.614428+0000","last_clean":"2024-09-17T05:45:31.614428+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:45:31.627608+0000","last_undegraded":"2024-09-17T05:45:31.627608+0000","last_fullsized":"2024-09-17T05:45:31.627608+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:45:31.614428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:45:31.614428+0000","last_clean_scrub_stamp":"2024-09-17T05:45:31.614428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":10,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-17T05:45:31.643206+0000","last_change":"2024-09-17T05:45:31.639583+0000","last_active":"2024-09-17T05:45:31.643206+0000","last_peered":"2024-09-17T05:45:31.643206+0000","last_clean":"2024-09-17T05:45:31.643206+0000","last_became_active":"2024-09-17T05:45:31.639274+0000","last_became_peered":"2024-09-17T05:45:31.639274+0000","last_unstale":"2024-09-17T05:45:31.643206+0000","last_undegraded":"2024-09-17T05:45:31.643206+0000","last_fullsized":"2024-09-17T05:45:31.643206+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:45:30.612191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:45:30.612191+0000","last_clean_scrub_stamp":"2024-09-17T05:45:30.612191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:32:10.295673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":1,"reported_epoch":58,"state":"creating+peering","last_fresh":"2024-09-17T05:45:31.626798+0000","last_change":"2024-09-17T05:45:31.626798+0000","last_active":"2024-09-17T05:45:31.614428+0000","last_peered":"2024-09-17T05:45:31.614428+0000","last_clean":"2024-09-17T05:45:31.614428+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:45:31.626798+0000","last_undegraded":"2024-09-17T05:45:31.626798+0000","last_fullsized":"2024-09-17T05:45:31.626798+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:45:31.614428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:45:31.614428+0000","last_clean_scrub_stamp":"2024-09-17T05:45:31.614428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":10,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-17T05:45:31.641653+0000","last_change":"2024-09-17T05:45:31.639879+0000","last_active":"2024-09-17T05:45:31.641653+0000","last_peered":"2024-09-17T05:45:31.641653+0000","last_clean":"2024-09-17T05:45:31.641653+0000","last_became_active":"2024-09-17T05:45:31.639553+0000","last_became_peered":"2024-09-17T05:45:31.639553+0000","last_unstale":"2024-09-17T05:45:31.641653+0000","last_undegraded":"2024-09-17T05:45:31.641653+0000","last_fullsized":"2024-09-17T05:45:31.641653+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:45:30.612191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:45:30.612191+0000","last_clean_scrub_stamp":"2024-09-17T05:45:30.612191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:06:24.325125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"19'72","reported_seq":178,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-17T05:45:33.954772+0000","last_change":"2024-09-17T05:41:48.539830+0000","last_active":"2024-09-17T05:45:33.954772+0000","last_peered":"2024-09-17T05:45:33.954772+0000","last_clean":"2024-09-17T05:45:33.954772+0000","last_became_active":"2024-09-17T05:41:48.538743+0000","last_became_peered":"2024-09-17T05:41:48.538743+0000","last_unstale":"2024-09-17T05:45:33.954772+0000","last_undegraded":"2024-09-17T05:45:33.954772+0000","last_fullsized":"2024-09-17T05:45:33.954772+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:47.152539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:47.152539+0000","last_clean_scrub_stamp":"2024-09-17T05:41:47.152539+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:08:02.952016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":9,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":2354,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":39,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":4708,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":32,"ondisk_log_size":32,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":16,"seq":68719476786,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40180,"kb_used_data":672,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331660,"statfs":{"total":96636764160,"available":96595619840,"internally_reserved":0,"allocated":688128,"data_stored":282523,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":40434118},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":7,"up_from":15,"seq":64424509491,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36636,"kb_used_data":1284,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335204,"statfs":{"total":96636764160,"available":96599248896,"internally_reserved":0,"allocated":1314816,"data_stored":886182,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":36174282},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509490,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36052,"kb_used_data":704,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335788,"statfs":{"total":96636764160,"available":96599846912,"internally_reserved":0,"allocated":720896,"data_stored":296306,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509490,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":54112,"kb_used_data":708,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94317728,"statfs":{"total":96636764160,"available":96581353472,"internally_reserved":0,"allocated":724992,"data_stored":297266,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509489,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":54068,"kb_used_data":672,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94317772,"statfs":{"total":96636764160,"available":96581398528,"internally_reserved":0,"allocated":688128,"data_stored":282523,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":54655431},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509489,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36020,"kb_used_data":672,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335820,"statfs":{"total":96636764160,"available":96599879680,"internally_reserved":0,"allocated":688128,"data_stored":282523,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509490,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":54096,"kb_used_data":700,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94317744,"statfs":{"total":96636764160,"available":96581369856,"internally_reserved":0,"allocated":716800,"data_stored":295744,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574897,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":54684,"kb_used_data":1280,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94317156,"statfs":{"total":96636764160,"available":96580767744,"internally_reserved":0,"allocated":1310720,"data_stored":881888,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2194,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-17T05:45:41.116 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-17T05:45:41.244 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:41.242+0000 7fb6c9e5c640 1 -- 172.21.15.150:0/445197159 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb6c40b9780 msgr2=0x7fb6c40b3720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:45:41.244 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:41.242+0000 7fb6c9e5c640 1 --2- 172.21.15.150:0/445197159 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb6c40b9780 0x7fb6c40b3720 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fb6b4009820 tx=0x7fb6b402a480 comp rx=0 tx=0).stop 2024-09-17T05:45:41.245 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:41.242+0000 7fb6c9e5c640 1 -- 172.21.15.150:0/445197159 shutdown_connections 2024-09-17T05:45:41.245 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:41.242+0000 7fb6c9e5c640 1 --2- 172.21.15.150:0/445197159 >> v2:172.21.15.176:3300/0 conn(0x7fb6c40d17a0 0x7fb6c40cf470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:41.245 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:41.242+0000 7fb6c9e5c640 1 --2- 172.21.15.150:0/445197159 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb6c40b9780 0x7fb6c40b3720 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:41.245 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:41.242+0000 7fb6c9e5c640 1 -- 172.21.15.150:0/445197159 >> 172.21.15.150:0/445197159 conn(0x7fb6c40d4680 msgr2=0x7fb6c40d4a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:45:41.245 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:41.242+0000 7fb6c9e5c640 1 -- 172.21.15.150:0/445197159 shutdown_connections 2024-09-17T05:45:41.245 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:41.242+0000 7fb6c9e5c640 1 -- 172.21.15.150:0/445197159 wait complete. 2024-09-17T05:45:41.246 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:41.244+0000 7fb6c9e5c640 1 Processor -- start 2024-09-17T05:45:41.246 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:41.244+0000 7fb6c9e5c640 1 -- start start 2024-09-17T05:45:41.249 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:41.246+0000 7fb6c9e5c640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb6c40b9780 0x7fb6c414aca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:45:41.249 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:41.246+0000 7fb6c9e5c640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb6c415ee50 0x7fb6c41f9050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:45:41.249 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:41.246+0000 7fb6c9e5c640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb6c41f9590 0x7fb6c41f99a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:45:41.249 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:41.246+0000 7fb6c9e5c640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7fb6c40cfd70 con 0x7fb6c415ee50 2024-09-17T05:45:41.249 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:41.246+0000 7fb6c9e5c640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fb6c40cfbf0 con 0x7fb6c41f9590 2024-09-17T05:45:41.249 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:41.246+0000 7fb6c9e5c640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fb6c40cfef0 con 0x7fb6c40b9780 2024-09-17T05:45:41.249 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:41.246+0000 7fb6c2ffd640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb6c415ee50 0x7fb6c41f9050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:45:41.249 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:41.246+0000 7fb6c2ffd640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb6c415ee50 0x7fb6c41f9050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:38110/0 (socket says 172.21.15.150:38110) 2024-09-17T05:45:41.249 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:41.246+0000 7fb6c2ffd640 1 -- 172.21.15.150:0/2551283439 learned_addr learned my addr 172.21.15.150:0/2551283439 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:45:41.250 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:41.246+0000 7fb6c37fe640 1 --2- 172.21.15.150:0/2551283439 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb6c40b9780 0x7fb6c414aca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:45:41.250 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:41.246+0000 7fb6c3fff640 1 --2- 172.21.15.150:0/2551283439 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb6c41f9590 0x7fb6c41f99a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:45:41.250 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:41.246+0000 7fb6c2ffd640 1 -- 172.21.15.150:0/2551283439 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb6c40b9780 msgr2=0x7fb6c414aca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:45:41.250 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:41.246+0000 7fb6c2ffd640 1 --2- 172.21.15.150:0/2551283439 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb6c40b9780 0x7fb6c414aca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:41.250 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:41.246+0000 7fb6c2ffd640 1 -- 172.21.15.150:0/2551283439 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb6c41f9590 msgr2=0x7fb6c41f99a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:45:41.250 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:41.246+0000 7fb6c2ffd640 1 --2- 172.21.15.150:0/2551283439 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb6c41f9590 0x7fb6c41f99a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:41.250 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:41.246+0000 7fb6c2ffd640 1 -- 172.21.15.150:0/2551283439 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb6c41548a0 con 0x7fb6c415ee50 2024-09-17T05:45:41.250 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:41.247+0000 7fb6c2ffd640 1 --2- 172.21.15.150:0/2551283439 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb6c415ee50 0x7fb6c41f9050 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7fb6b800c390 tx=0x7fb6b800c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:45:41.250 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:41.247+0000 7fb6abfff640 1 -- 172.21.15.150:0/2551283439 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6b8011790 con 0x7fb6c415ee50 2024-09-17T05:45:41.251 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:41.247+0000 7fb6c9e5c640 1 -- 172.21.15.150:0/2551283439 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb6c4161fc0 con 0x7fb6c415ee50 2024-09-17T05:45:41.251 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:41.247+0000 7fb6abfff640 1 -- 172.21.15.150:0/2551283439 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb6b8017070 con 0x7fb6c415ee50 2024-09-17T05:45:41.251 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:41.247+0000 7fb6abfff640 1 -- 172.21.15.150:0/2551283439 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6b8011ce0 con 0x7fb6c415ee50 2024-09-17T05:45:41.251 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:41.247+0000 7fb6c9e5c640 1 -- 172.21.15.150:0/2551283439 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb6c415c7b0 con 0x7fb6c415ee50 2024-09-17T05:45:41.252 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:41.248+0000 7fb6c9e5c640 1 -- 172.21.15.150:0/2551283439 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb6c408d100 con 0x7fb6c415ee50 2024-09-17T05:45:41.252 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:41.249+0000 7fb6abfff640 1 -- 172.21.15.150:0/2551283439 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 15) ==== 102257+0+0 (secure 0 0 0) 0x7fb6b801c460 con 0x7fb6c415ee50 2024-09-17T05:45:41.252 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:41.249+0000 7fb6abfff640 1 --2- 172.21.15.150:0/2551283439 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fb6b0079490 0x7fb6b007b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:45:41.252 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:41.249+0000 7fb6abfff640 1 -- 172.21.15.150:0/2551283439 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(60..60 src has 1..60) ==== 5737+0+0 (secure 0 0 0) 0x7fb6b8099280 con 0x7fb6c415ee50 2024-09-17T05:45:41.252 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:41.250+0000 7fb6c37fe640 1 --2- 172.21.15.150:0/2551283439 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fb6b0079490 0x7fb6b007b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:45:41.252 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:41.250+0000 7fb6c37fe640 1 --2- 172.21.15.150:0/2551283439 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fb6b0079490 0x7fb6b007b9a0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7fb6b4034000 tx=0x7fb6b4004730 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:45:41.255 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:41.254+0000 7fb6abfff640 1 -- 172.21.15.150:0/2551283439 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fb6c408d100 con 0x7fb6c415ee50 2024-09-17T05:45:41.430 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:41.429+0000 7fb6c9e5c640 1 -- 172.21.15.150:0/2551283439 --> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fb6c40b3720 con 0x7fb6b0079490 2024-09-17T05:45:41.435 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:41.434+0000 7fb6abfff640 1 -- 172.21.15.150:0/2551283439 <== mgr.4108 v2:172.21.15.176:6800/3631216395 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251932 (secure 0 0 0) 0x7fb6c40b3720 con 0x7fb6b0079490 2024-09-17T05:45:41.439 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-09-17T05:45:41.440 INFO:teuthology.orchestra.run.smithi150.stderr:dumped all 2024-09-17T05:45:41.441 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:41.437+0000 7fb6c9e5c640 1 -- 172.21.15.150:0/2551283439 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fb6b0079490 msgr2=0x7fb6b007b9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:45:41.442 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:41.437+0000 7fb6c9e5c640 1 --2- 172.21.15.150:0/2551283439 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fb6b0079490 0x7fb6b007b9a0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7fb6b4034000 tx=0x7fb6b4004730 comp rx=0 tx=0).stop 2024-09-17T05:45:41.442 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:41.437+0000 7fb6c9e5c640 1 -- 172.21.15.150:0/2551283439 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb6c415ee50 msgr2=0x7fb6c41f9050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:45:41.442 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:41.437+0000 7fb6c9e5c640 1 --2- 172.21.15.150:0/2551283439 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb6c415ee50 0x7fb6c41f9050 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7fb6b800c390 tx=0x7fb6b800c850 comp rx=0 tx=0).stop 2024-09-17T05:45:41.442 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:41.437+0000 7fb6c9e5c640 1 -- 172.21.15.150:0/2551283439 shutdown_connections 2024-09-17T05:45:41.442 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:41.437+0000 7fb6c9e5c640 1 --2- 172.21.15.150:0/2551283439 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb6c41f9590 0x7fb6c41f99a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:41.442 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:41.437+0000 7fb6c9e5c640 1 --2- 172.21.15.150:0/2551283439 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fb6b0079490 0x7fb6b007b9a0 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:41.442 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:41.437+0000 7fb6c9e5c640 1 --2- 172.21.15.150:0/2551283439 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb6c415ee50 0x7fb6c41f9050 unknown :-1 s=CLOSED pgs=647 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:41.442 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:41.437+0000 7fb6c9e5c640 1 --2- 172.21.15.150:0/2551283439 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb6c40b9780 0x7fb6c414aca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:41.442 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:41.437+0000 7fb6c9e5c640 1 -- 172.21.15.150:0/2551283439 >> 172.21.15.150:0/2551283439 conn(0x7fb6c40d4680 msgr2=0x7fb6c406e5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:45:41.442 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:41.437+0000 7fb6c9e5c640 1 -- 172.21.15.150:0/2551283439 shutdown_connections 2024-09-17T05:45:41.443 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:41.437+0000 7fb6c9e5c640 1 -- 172.21.15.150:0/2551283439 wait complete. 2024-09-17T05:45:41.450 INFO:teuthology.orchestra.run.smithi150.stdout:{"pg_ready":true,"pg_map":{"version":172,"stamp":"2024-09-17T05:45:40.910292+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":146,"num_write_kb":1642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":111,"ondisk_log_size":111,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":365964,"kb_used_data":6792,"kb_used_omap":12,"kb_used_meta":358963,"kb_avail":754608756,"statfs":{"total":773094113280,"available":772719366144,"internally_reserved":0,"allocated":6955008,"data_stored":3550788,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":367578672},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":25,"apply_latency_ms":25,"commit_latency_ns":25000000,"apply_latency_ns":25000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.287300"},"pg_stats":[{"pgid":"9.3f","version":"0'0","reported_seq":13,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-17T05:45:33.863796+0000","last_change":"2024-09-17T05:45:32.652820+0000","last_active":"2024-09-17T05:45:33.863796+0000","last_peered":"2024-09-17T05:45:33.863796+0000","last_clean":"2024-09-17T05:45:33.863796+0000","last_became_active":"2024-09-17T05:45:32.652539+0000","last_became_peered":"2024-09-17T05:45:32.652539+0000","last_unstale":"2024-09-17T05:45:33.863796+0000","last_undegraded":"2024-09-17T05:45:33.863796+0000","last_fullsized":"2024-09-17T05:45:33.863796+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:45:31.614428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:45:31.614428+0000","last_clean_scrub_stamp":"2024-09-17T05:45:31.614428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:19:39.309751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3e","version":"0'0","reported_seq":13,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-17T05:45:33.640682+0000","last_change":"2024-09-17T05:45:32.638601+0000","last_active":"2024-09-17T05:45:33.640682+0000","last_peered":"2024-09-17T05:45:33.640682+0000","last_clean":"2024-09-17T05:45:33.640682+0000","last_became_active":"2024-09-17T05:45:32.638018+0000","last_became_peered":"2024-09-17T05:45:32.638018+0000","last_unstale":"2024-09-17T05:45:33.640682+0000","last_undegraded":"2024-09-17T05:45:33.640682+0000","last_fullsized":"2024-09-17T05:45:33.640682+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:45:31.614428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:45:31.614428+0000","last_clean_scrub_stamp":"2024-09-17T05:45:31.614428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:54:05.428237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.3d","version":"0'0","reported_seq":13,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-17T05:45:33.954721+0000","last_change":"2024-09-17T05:45:32.653926+0000","last_active":"2024-09-17T05:45:33.954721+0000","last_peered":"2024-09-17T05:45:33.954721+0000","last_clean":"2024-09-17T05:45:33.954721+0000","last_became_active":"2024-09-17T05:45:32.653577+0000","last_became_peered":"2024-09-17T05:45:32.653577+0000","last_unstale":"2024-09-17T05:45:33.954721+0000","last_undegraded":"2024-09-17T05:45:33.954721+0000","last_fullsized":"2024-09-17T05:45:33.954721+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:45:31.614428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:45:31.614428+0000","last_clean_scrub_stamp":"2024-09-17T05:45:31.614428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:18:45.006839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.3c","version":"0'0","reported_seq":13,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-17T05:45:33.643532+0000","last_change":"2024-09-17T05:45:32.644544+0000","last_active":"2024-09-17T05:45:33.643532+0000","last_peered":"2024-09-17T05:45:33.643532+0000","last_clean":"2024-09-17T05:45:33.643532+0000","last_became_active":"2024-09-17T05:45:32.644206+0000","last_became_peered":"2024-09-17T05:45:32.644206+0000","last_unstale":"2024-09-17T05:45:33.643532+0000","last_undegraded":"2024-09-17T05:45:33.643532+0000","last_fullsized":"2024-09-17T05:45:33.643532+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:45:31.614428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:45:31.614428+0000","last_clean_scrub_stamp":"2024-09-17T05:45:31.614428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:07:39.923649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.3b","version":"0'0","reported_seq":13,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-17T05:45:33.863589+0000","last_change":"2024-09-17T05:45:32.647336+0000","last_active":"2024-09-17T05:45:33.863589+0000","last_peered":"2024-09-17T05:45:33.863589+0000","last_clean":"2024-09-17T05:45:33.863589+0000","last_became_active":"2024-09-17T05:45:32.647022+0000","last_became_peered":"2024-09-17T05:45:32.647022+0000","last_unstale":"2024-09-17T05:45:33.863589+0000","last_undegraded":"2024-09-17T05:45:33.863589+0000","last_fullsized":"2024-09-17T05:45:33.863589+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:45:31.614428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:45:31.614428+0000","last_clean_scrub_stamp":"2024-09-17T05:45:31.614428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:28:19.090832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3a","version":"0'0","reported_seq":13,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-17T05:45:33.954615+0000","last_change":"2024-09-17T05:45:32.639148+0000","last_active":"2024-09-17T05:45:33.954615+0000","last_peered":"2024-09-17T05:45:33.954615+0000","last_clean":"2024-09-17T05:45:33.954615+0000","last_became_active":"2024-09-17T05:45:32.638816+0000","last_became_peered":"2024-09-17T05:45:32.638816+0000","last_unstale":"2024-09-17T05:45:33.954615+0000","last_undegraded":"2024-09-17T05:45:33.954615+0000","last_fullsized":"2024-09-17T05:45:33.954615+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:45:31.614428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:45:31.614428+0000","last_clean_scrub_stamp":"2024-09-17T05:45:31.614428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:51:23.050003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.39","version":"0'0","reported_seq":13,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-17T05:45:33.642542+0000","last_change":"2024-09-17T05:45:32.631297+0000","last_active":"2024-09-17T05:45:33.642542+0000","last_peered":"2024-09-17T05:45:33.642542+0000","last_clean":"2024-09-17T05:45:33.642542+0000","last_became_active":"2024-09-17T05:45:32.630792+0000","last_became_peered":"2024-09-17T05:45:32.630792+0000","last_unstale":"2024-09-17T05:45:33.642542+0000","last_undegraded":"2024-09-17T05:45:33.642542+0000","last_fullsized":"2024-09-17T05:45:33.642542+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:45:31.614428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:45:31.614428+0000","last_clean_scrub_stamp":"2024-09-17T05:45:31.614428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:40:44.182767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.38","version":"0'0","reported_seq":13,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-17T05:45:33.640280+0000","last_change":"2024-09-17T05:45:32.638071+0000","last_active":"2024-09-17T05:45:33.640280+0000","last_peered":"2024-09-17T05:45:33.640280+0000","last_clean":"2024-09-17T05:45:33.640280+0000","last_became_active":"2024-09-17T05:45:32.637767+0000","last_became_peered":"2024-09-17T05:45:32.637767+0000","last_unstale":"2024-09-17T05:45:33.640280+0000","last_undegraded":"2024-09-17T05:45:33.640280+0000","last_fullsized":"2024-09-17T05:45:33.640280+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:45:31.614428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:45:31.614428+0000","last_clean_scrub_stamp":"2024-09-17T05:45:31.614428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:04:08.641706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.37","version":"0'0","reported_seq":13,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-17T05:45:33.643100+0000","last_change":"2024-09-17T05:45:32.629786+0000","last_active":"2024-09-17T05:45:33.643100+0000","last_peered":"2024-09-17T05:45:33.643100+0000","last_clean":"2024-09-17T05:45:33.643100+0000","last_became_active":"2024-09-17T05:45:32.629438+0000","last_became_peered":"2024-09-17T05:45:32.629438+0000","last_unstale":"2024-09-17T05:45:33.643100+0000","last_undegraded":"2024-09-17T05:45:33.643100+0000","last_fullsized":"2024-09-17T05:45:33.643100+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:45:31.614428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:45:31.614428+0000","last_clean_scrub_stamp":"2024-09-17T05:45:31.614428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:06:56.405523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.36","version":"0'0","reported_seq":13,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-17T05:45:33.955260+0000","last_change":"2024-09-17T05:45:32.647536+0000","last_active":"2024-09-17T05:45:33.955260+0000","last_peered":"2024-09-17T05:45:33.955260+0000","last_clean":"2024-09-17T05:45:33.955260+0000","last_became_active":"2024-09-17T05:45:32.647207+0000","last_became_peered":"2024-09-17T05:45:32.647207+0000","last_unstale":"2024-09-17T05:45:33.955260+0000","last_undegraded":"2024-09-17T05:45:33.955260+0000","last_fullsized":"2024-09-17T05:45:33.955260+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:45:31.614428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:45:31.614428+0000","last_clean_scrub_stamp":"2024-09-17T05:45:31.614428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:53:08.537231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.35","version":"0'0","reported_seq":13,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-17T05:45:33.954382+0000","last_change":"2024-09-17T05:45:32.650441+0000","last_active":"2024-09-17T05:45:33.954382+0000","last_peered":"2024-09-17T05:45:33.954382+0000","last_clean":"2024-09-17T05:45:33.954382+0000","last_became_active":"2024-09-17T05:45:32.644229+0000","last_became_peered":"2024-09-17T05:45:32.644229+0000","last_unstale":"2024-09-17T05:45:33.954382+0000","last_undegraded":"2024-09-17T05:45:33.954382+0000","last_fullsized":"2024-09-17T05:45:33.954382+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:45:31.614428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:45:31.614428+0000","last_clean_scrub_stamp":"2024-09-17T05:45:31.614428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:15:00.651839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.34","version":"0'0","reported_seq":13,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-17T05:45:33.643819+0000","last_change":"2024-09-17T05:45:32.648016+0000","last_active":"2024-09-17T05:45:33.643819+0000","last_peered":"2024-09-17T05:45:33.643819+0000","last_clean":"2024-09-17T05:45:33.643819+0000","last_became_active":"2024-09-17T05:45:32.647657+0000","last_became_peered":"2024-09-17T05:45:32.647657+0000","last_unstale":"2024-09-17T05:45:33.643819+0000","last_undegraded":"2024-09-17T05:45:33.643819+0000","last_fullsized":"2024-09-17T05:45:33.643819+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:45:31.614428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:45:31.614428+0000","last_clean_scrub_stamp":"2024-09-17T05:45:31.614428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:15:14.618900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.33","version":"0'0","reported_seq":13,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-17T05:45:33.954562+0000","last_change":"2024-09-17T05:45:32.634829+0000","last_active":"2024-09-17T05:45:33.954562+0000","last_peered":"2024-09-17T05:45:33.954562+0000","last_clean":"2024-09-17T05:45:33.954562+0000","last_became_active":"2024-09-17T05:45:32.634448+0000","last_became_peered":"2024-09-17T05:45:32.634448+0000","last_unstale":"2024-09-17T05:45:33.954562+0000","last_undegraded":"2024-09-17T05:45:33.954562+0000","last_fullsized":"2024-09-17T05:45:33.954562+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:45:31.614428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:45:31.614428+0000","last_clean_scrub_stamp":"2024-09-17T05:45:31.614428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:01:36.311918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.32","version":"0'0","reported_seq":13,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-17T05:45:33.642905+0000","last_change":"2024-09-17T05:45:32.640531+0000","last_active":"2024-09-17T05:45:33.642905+0000","last_peered":"2024-09-17T05:45:33.642905+0000","last_clean":"2024-09-17T05:45:33.642905+0000","last_became_active":"2024-09-17T05:45:32.640176+0000","last_became_peered":"2024-09-17T05:45:32.640176+0000","last_unstale":"2024-09-17T05:45:33.642905+0000","last_undegraded":"2024-09-17T05:45:33.642905+0000","last_fullsized":"2024-09-17T05:45:33.642905+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:45:31.614428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:45:31.614428+0000","last_clean_scrub_stamp":"2024-09-17T05:45:31.614428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:25:16.583193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.31","version":"0'0","reported_seq":13,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-17T05:45:33.643442+0000","last_change":"2024-09-17T05:45:32.637116+0000","last_active":"2024-09-17T05:45:33.643442+0000","last_peered":"2024-09-17T05:45:33.643442+0000","last_clean":"2024-09-17T05:45:33.643442+0000","last_became_active":"2024-09-17T05:45:32.636454+0000","last_became_peered":"2024-09-17T05:45:32.636454+0000","last_unstale":"2024-09-17T05:45:33.643442+0000","last_undegraded":"2024-09-17T05:45:33.643442+0000","last_fullsized":"2024-09-17T05:45:33.643442+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:45:31.614428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:45:31.614428+0000","last_clean_scrub_stamp":"2024-09-17T05:45:31.614428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:05:03.043597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.30","version":"0'0","reported_seq":13,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-17T05:45:33.953964+0000","last_change":"2024-09-17T05:45:32.645281+0000","last_active":"2024-09-17T05:45:33.953964+0000","last_peered":"2024-09-17T05:45:33.953964+0000","last_clean":"2024-09-17T05:45:33.953964+0000","last_became_active":"2024-09-17T05:45:32.644707+0000","last_became_peered":"2024-09-17T05:45:32.644707+0000","last_unstale":"2024-09-17T05:45:33.953964+0000","last_undegraded":"2024-09-17T05:45:33.953964+0000","last_fullsized":"2024-09-17T05:45:33.953964+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:45:31.614428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:45:31.614428+0000","last_clean_scrub_stamp":"2024-09-17T05:45:31.614428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:43:27.107380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.2f","version":"0'0","reported_seq":13,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-17T05:45:33.640685+0000","last_change":"2024-09-17T05:45:32.636566+0000","last_active":"2024-09-17T05:45:33.640685+0000","last_peered":"2024-09-17T05:45:33.640685+0000","last_clean":"2024-09-17T05:45:33.640685+0000","last_became_active":"2024-09-17T05:45:32.636290+0000","last_became_peered":"2024-09-17T05:45:32.636290+0000","last_unstale":"2024-09-17T05:45:33.640685+0000","last_undegraded":"2024-09-17T05:45:33.640685+0000","last_fullsized":"2024-09-17T05:45:33.640685+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:45:31.614428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:45:31.614428+0000","last_clean_scrub_stamp":"2024-09-17T05:45:31.614428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:56:05.572109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2e","version":"0'0","reported_seq":13,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-17T05:45:33.955372+0000","last_change":"2024-09-17T05:45:32.648441+0000","last_active":"2024-09-17T05:45:33.955372+0000","last_peered":"2024-09-17T05:45:33.955372+0000","last_clean":"2024-09-17T05:45:33.955372+0000","last_became_active":"2024-09-17T05:45:32.646007+0000","last_became_peered":"2024-09-17T05:45:32.646007+0000","last_unstale":"2024-09-17T05:45:33.955372+0000","last_undegraded":"2024-09-17T05:45:33.955372+0000","last_fullsized":"2024-09-17T05:45:33.955372+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:45:31.614428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:45:31.614428+0000","last_clean_scrub_stamp":"2024-09-17T05:45:31.614428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:17:14.808917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2d","version":"0'0","reported_seq":13,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-17T05:45:33.863727+0000","last_change":"2024-09-17T05:45:32.646294+0000","last_active":"2024-09-17T05:45:33.863727+0000","last_peered":"2024-09-17T05:45:33.863727+0000","last_clean":"2024-09-17T05:45:33.863727+0000","last_became_active":"2024-09-17T05:45:32.644085+0000","last_became_peered":"2024-09-17T05:45:32.644085+0000","last_unstale":"2024-09-17T05:45:33.863727+0000","last_undegraded":"2024-09-17T05:45:33.863727+0000","last_fullsized":"2024-09-17T05:45:33.863727+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:45:31.614428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:45:31.614428+0000","last_clean_scrub_stamp":"2024-09-17T05:45:31.614428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:41:07.464327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.2c","version":"0'0","reported_seq":13,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-17T05:45:33.640552+0000","last_change":"2024-09-17T05:45:32.643180+0000","last_active":"2024-09-17T05:45:33.640552+0000","last_peered":"2024-09-17T05:45:33.640552+0000","last_clean":"2024-09-17T05:45:33.640552+0000","last_became_active":"2024-09-17T05:45:32.642864+0000","last_became_peered":"2024-09-17T05:45:32.642864+0000","last_unstale":"2024-09-17T05:45:33.640552+0000","last_undegraded":"2024-09-17T05:45:33.640552+0000","last_fullsized":"2024-09-17T05:45:33.640552+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:45:31.614428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:45:31.614428+0000","last_clean_scrub_stamp":"2024-09-17T05:45:31.614428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:09:40.054892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2b","version":"0'0","reported_seq":13,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-17T05:45:33.954893+0000","last_change":"2024-09-17T05:45:32.648315+0000","last_active":"2024-09-17T05:45:33.954893+0000","last_peered":"2024-09-17T05:45:33.954893+0000","last_clean":"2024-09-17T05:45:33.954893+0000","last_became_active":"2024-09-17T05:45:32.646021+0000","last_became_peered":"2024-09-17T05:45:32.646021+0000","last_unstale":"2024-09-17T05:45:33.954893+0000","last_undegraded":"2024-09-17T05:45:33.954893+0000","last_fullsized":"2024-09-17T05:45:33.954893+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:45:31.614428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:45:31.614428+0000","last_clean_scrub_stamp":"2024-09-17T05:45:31.614428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:21:50.109729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2a","version":"0'0","reported_seq":13,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-17T05:45:33.640290+0000","last_change":"2024-09-17T05:45:32.648232+0000","last_active":"2024-09-17T05:45:33.640290+0000","last_peered":"2024-09-17T05:45:33.640290+0000","last_clean":"2024-09-17T05:45:33.640290+0000","last_became_active":"2024-09-17T05:45:32.646365+0000","last_became_peered":"2024-09-17T05:45:32.646365+0000","last_unstale":"2024-09-17T05:45:33.640290+0000","last_undegraded":"2024-09-17T05:45:33.640290+0000","last_fullsized":"2024-09-17T05:45:33.640290+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:45:31.614428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:45:31.614428+0000","last_clean_scrub_stamp":"2024-09-17T05:45:31.614428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:32:54.834902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.29","version":"0'0","reported_seq":13,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-17T05:45:33.955465+0000","last_change":"2024-09-17T05:45:32.651396+0000","last_active":"2024-09-17T05:45:33.955465+0000","last_peered":"2024-09-17T05:45:33.955465+0000","last_clean":"2024-09-17T05:45:33.955465+0000","last_became_active":"2024-09-17T05:45:32.651072+0000","last_became_peered":"2024-09-17T05:45:32.651072+0000","last_unstale":"2024-09-17T05:45:33.955465+0000","last_undegraded":"2024-09-17T05:45:33.955465+0000","last_fullsized":"2024-09-17T05:45:33.955465+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:45:31.614428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:45:31.614428+0000","last_clean_scrub_stamp":"2024-09-17T05:45:31.614428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:44:57.086608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.28","version":"0'0","reported_seq":13,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-17T05:45:33.954532+0000","last_change":"2024-09-17T05:45:32.642531+0000","last_active":"2024-09-17T05:45:33.954532+0000","last_peered":"2024-09-17T05:45:33.954532+0000","last_clean":"2024-09-17T05:45:33.954532+0000","last_became_active":"2024-09-17T05:45:32.642155+0000","last_became_peered":"2024-09-17T05:45:32.642155+0000","last_unstale":"2024-09-17T05:45:33.954532+0000","last_undegraded":"2024-09-17T05:45:33.954532+0000","last_fullsized":"2024-09-17T05:45:33.954532+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:45:31.614428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:45:31.614428+0000","last_clean_scrub_stamp":"2024-09-17T05:45:31.614428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:16:09.180385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.27","version":"0'0","reported_seq":13,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-17T05:45:33.863829+0000","last_change":"2024-09-17T05:45:32.654520+0000","last_active":"2024-09-17T05:45:33.863829+0000","last_peered":"2024-09-17T05:45:33.863829+0000","last_clean":"2024-09-17T05:45:33.863829+0000","last_became_active":"2024-09-17T05:45:32.654141+0000","last_became_peered":"2024-09-17T05:45:32.654141+0000","last_unstale":"2024-09-17T05:45:33.863829+0000","last_undegraded":"2024-09-17T05:45:33.863829+0000","last_fullsized":"2024-09-17T05:45:33.863829+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:45:31.614428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:45:31.614428+0000","last_clean_scrub_stamp":"2024-09-17T05:45:31.614428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:28:35.993521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.26","version":"0'0","reported_seq":13,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-17T05:45:33.643810+0000","last_change":"2024-09-17T05:45:32.631723+0000","last_active":"2024-09-17T05:45:33.643810+0000","last_peered":"2024-09-17T05:45:33.643810+0000","last_clean":"2024-09-17T05:45:33.643810+0000","last_became_active":"2024-09-17T05:45:32.631351+0000","last_became_peered":"2024-09-17T05:45:32.631351+0000","last_unstale":"2024-09-17T05:45:33.643810+0000","last_undegraded":"2024-09-17T05:45:33.643810+0000","last_fullsized":"2024-09-17T05:45:33.643810+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:45:31.614428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:45:31.614428+0000","last_clean_scrub_stamp":"2024-09-17T05:45:31.614428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:17:02.678048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.25","version":"0'0","reported_seq":13,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-17T05:45:33.954966+0000","last_change":"2024-09-17T05:45:32.637435+0000","last_active":"2024-09-17T05:45:33.954966+0000","last_peered":"2024-09-17T05:45:33.954966+0000","last_clean":"2024-09-17T05:45:33.954966+0000","last_became_active":"2024-09-17T05:45:32.637137+0000","last_became_peered":"2024-09-17T05:45:32.637137+0000","last_unstale":"2024-09-17T05:45:33.954966+0000","last_undegraded":"2024-09-17T05:45:33.954966+0000","last_fullsized":"2024-09-17T05:45:33.954966+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:45:31.614428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:45:31.614428+0000","last_clean_scrub_stamp":"2024-09-17T05:45:31.614428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:52:41.647757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.24","version":"0'0","reported_seq":13,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-17T05:45:33.863789+0000","last_change":"2024-09-17T05:45:32.650599+0000","last_active":"2024-09-17T05:45:33.863789+0000","last_peered":"2024-09-17T05:45:33.863789+0000","last_clean":"2024-09-17T05:45:33.863789+0000","last_became_active":"2024-09-17T05:45:32.650181+0000","last_became_peered":"2024-09-17T05:45:32.650181+0000","last_unstale":"2024-09-17T05:45:33.863789+0000","last_undegraded":"2024-09-17T05:45:33.863789+0000","last_fullsized":"2024-09-17T05:45:33.863789+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:45:31.614428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:45:31.614428+0000","last_clean_scrub_stamp":"2024-09-17T05:45:31.614428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:58:11.459517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.23","version":"0'0","reported_seq":13,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-17T05:45:33.640639+0000","last_change":"2024-09-17T05:45:32.636807+0000","last_active":"2024-09-17T05:45:33.640639+0000","last_peered":"2024-09-17T05:45:33.640639+0000","last_clean":"2024-09-17T05:45:33.640639+0000","last_became_active":"2024-09-17T05:45:32.635470+0000","last_became_peered":"2024-09-17T05:45:32.635470+0000","last_unstale":"2024-09-17T05:45:33.640639+0000","last_undegraded":"2024-09-17T05:45:33.640639+0000","last_fullsized":"2024-09-17T05:45:33.640639+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:45:31.614428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:45:31.614428+0000","last_clean_scrub_stamp":"2024-09-17T05:45:31.614428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:11:00.975340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.22","version":"0'0","reported_seq":13,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-17T05:45:33.954765+0000","last_change":"2024-09-17T05:45:32.655106+0000","last_active":"2024-09-17T05:45:33.954765+0000","last_peered":"2024-09-17T05:45:33.954765+0000","last_clean":"2024-09-17T05:45:33.954765+0000","last_became_active":"2024-09-17T05:45:32.654852+0000","last_became_peered":"2024-09-17T05:45:32.654852+0000","last_unstale":"2024-09-17T05:45:33.954765+0000","last_undegraded":"2024-09-17T05:45:33.954765+0000","last_fullsized":"2024-09-17T05:45:33.954765+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:45:31.614428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:45:31.614428+0000","last_clean_scrub_stamp":"2024-09-17T05:45:31.614428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:57:53.829103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.21","version":"0'0","reported_seq":13,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-17T05:45:33.863522+0000","last_change":"2024-09-17T05:45:32.654339+0000","last_active":"2024-09-17T05:45:33.863522+0000","last_peered":"2024-09-17T05:45:33.863522+0000","last_clean":"2024-09-17T05:45:33.863522+0000","last_became_active":"2024-09-17T05:45:32.653658+0000","last_became_peered":"2024-09-17T05:45:32.653658+0000","last_unstale":"2024-09-17T05:45:33.863522+0000","last_undegraded":"2024-09-17T05:45:33.863522+0000","last_fullsized":"2024-09-17T05:45:33.863522+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:45:31.614428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:45:31.614428+0000","last_clean_scrub_stamp":"2024-09-17T05:45:31.614428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:48:07.103172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.20","version":"0'0","reported_seq":13,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-17T05:45:33.954245+0000","last_change":"2024-09-17T05:45:32.641063+0000","last_active":"2024-09-17T05:45:33.954245+0000","last_peered":"2024-09-17T05:45:33.954245+0000","last_clean":"2024-09-17T05:45:33.954245+0000","last_became_active":"2024-09-17T05:45:32.640742+0000","last_became_peered":"2024-09-17T05:45:32.640742+0000","last_unstale":"2024-09-17T05:45:33.954245+0000","last_undegraded":"2024-09-17T05:45:33.954245+0000","last_fullsized":"2024-09-17T05:45:33.954245+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:45:31.614428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:45:31.614428+0000","last_clean_scrub_stamp":"2024-09-17T05:45:31.614428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:15:00.409410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1e","version":"0'0","reported_seq":13,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-17T05:45:33.954789+0000","last_change":"2024-09-17T05:45:32.654896+0000","last_active":"2024-09-17T05:45:33.954789+0000","last_peered":"2024-09-17T05:45:33.954789+0000","last_clean":"2024-09-17T05:45:33.954789+0000","last_became_active":"2024-09-17T05:45:32.652165+0000","last_became_peered":"2024-09-17T05:45:32.652165+0000","last_unstale":"2024-09-17T05:45:33.954789+0000","last_undegraded":"2024-09-17T05:45:33.954789+0000","last_fullsized":"2024-09-17T05:45:33.954789+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:45:31.614428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:45:31.614428+0000","last_clean_scrub_stamp":"2024-09-17T05:45:31.614428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:50:41.665712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1f","version":"59'4","reported_seq":19,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-17T05:45:33.955000+0000","last_change":"2024-09-17T05:45:31.639533+0000","last_active":"2024-09-17T05:45:33.955000+0000","last_peered":"2024-09-17T05:45:33.955000+0000","last_clean":"2024-09-17T05:45:33.955000+0000","last_became_active":"2024-09-17T05:45:31.638859+0000","last_became_peered":"2024-09-17T05:45:31.638859+0000","last_unstale":"2024-09-17T05:45:33.955000+0000","last_undegraded":"2024-09-17T05:45:33.955000+0000","last_fullsized":"2024-09-17T05:45:33.955000+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:45:30.612191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:45:30.612191+0000","last_clean_scrub_stamp":"2024-09-17T05:45:30.612191+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:50:36.495235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1f","version":"0'0","reported_seq":13,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-17T05:45:33.955336+0000","last_change":"2024-09-17T05:45:32.650676+0000","last_active":"2024-09-17T05:45:33.955336+0000","last_peered":"2024-09-17T05:45:33.955336+0000","last_clean":"2024-09-17T05:45:33.955336+0000","last_became_active":"2024-09-17T05:45:32.650377+0000","last_became_peered":"2024-09-17T05:45:32.650377+0000","last_unstale":"2024-09-17T05:45:33.955336+0000","last_undegraded":"2024-09-17T05:45:33.955336+0000","last_fullsized":"2024-09-17T05:45:33.955336+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:45:31.614428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:45:31.614428+0000","last_clean_scrub_stamp":"2024-09-17T05:45:31.614428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:42:03.873298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1e","version":"59'1","reported_seq":16,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-17T05:45:33.640705+0000","last_change":"2024-09-17T05:45:31.629458+0000","last_active":"2024-09-17T05:45:33.640705+0000","last_peered":"2024-09-17T05:45:33.640705+0000","last_clean":"2024-09-17T05:45:33.640705+0000","last_became_active":"2024-09-17T05:45:31.629161+0000","last_became_peered":"2024-09-17T05:45:31.629161+0000","last_unstale":"2024-09-17T05:45:33.640705+0000","last_undegraded":"2024-09-17T05:45:33.640705+0000","last_fullsized":"2024-09-17T05:45:33.640705+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:45:30.612191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:45:30.612191+0000","last_clean_scrub_stamp":"2024-09-17T05:45:30.612191+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:14:31.498709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.1c","version":"0'0","reported_seq":13,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-17T05:45:33.954477+0000","last_change":"2024-09-17T05:45:32.639921+0000","last_active":"2024-09-17T05:45:33.954477+0000","last_peered":"2024-09-17T05:45:33.954477+0000","last_clean":"2024-09-17T05:45:33.954477+0000","last_became_active":"2024-09-17T05:45:32.639588+0000","last_became_peered":"2024-09-17T05:45:32.639588+0000","last_unstale":"2024-09-17T05:45:33.954477+0000","last_undegraded":"2024-09-17T05:45:33.954477+0000","last_fullsized":"2024-09-17T05:45:33.954477+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:45:31.614428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:45:31.614428+0000","last_clean_scrub_stamp":"2024-09-17T05:45:31.614428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:12:02.824488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1d","version":"59'2","reported_seq":17,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-17T05:45:33.955142+0000","last_change":"2024-09-17T05:45:31.634645+0000","last_active":"2024-09-17T05:45:33.955142+0000","last_peered":"2024-09-17T05:45:33.955142+0000","last_clean":"2024-09-17T05:45:33.955142+0000","last_became_active":"2024-09-17T05:45:31.634306+0000","last_became_peered":"2024-09-17T05:45:31.634306+0000","last_unstale":"2024-09-17T05:45:33.955142+0000","last_undegraded":"2024-09-17T05:45:33.955142+0000","last_fullsized":"2024-09-17T05:45:33.955142+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:45:30.612191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:45:30.612191+0000","last_clean_scrub_stamp":"2024-09-17T05:45:30.612191+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:11:50.501779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1d","version":"0'0","reported_seq":13,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-17T05:45:33.954722+0000","last_change":"2024-09-17T05:45:32.634215+0000","last_active":"2024-09-17T05:45:33.954722+0000","last_peered":"2024-09-17T05:45:33.954722+0000","last_clean":"2024-09-17T05:45:33.954722+0000","last_became_active":"2024-09-17T05:45:32.633773+0000","last_became_peered":"2024-09-17T05:45:32.633773+0000","last_unstale":"2024-09-17T05:45:33.954722+0000","last_undegraded":"2024-09-17T05:45:33.954722+0000","last_fullsized":"2024-09-17T05:45:33.954722+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:45:31.614428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:45:31.614428+0000","last_clean_scrub_stamp":"2024-09-17T05:45:31.614428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:06:53.000716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1c","version":"59'2","reported_seq":17,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-17T05:45:33.643901+0000","last_change":"2024-09-17T05:45:31.642391+0000","last_active":"2024-09-17T05:45:33.643901+0000","last_peered":"2024-09-17T05:45:33.643901+0000","last_clean":"2024-09-17T05:45:33.643901+0000","last_became_active":"2024-09-17T05:45:31.641969+0000","last_became_peered":"2024-09-17T05:45:31.641969+0000","last_unstale":"2024-09-17T05:45:33.643901+0000","last_undegraded":"2024-09-17T05:45:33.643901+0000","last_fullsized":"2024-09-17T05:45:33.643901+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:45:30.612191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:45:30.612191+0000","last_clean_scrub_stamp":"2024-09-17T05:45:30.612191+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:25:15.580957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.1a","version":"0'0","reported_seq":13,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-17T05:45:33.640353+0000","last_change":"2024-09-17T05:45:32.643182+0000","last_active":"2024-09-17T05:45:33.640353+0000","last_peered":"2024-09-17T05:45:33.640353+0000","last_clean":"2024-09-17T05:45:33.640353+0000","last_became_active":"2024-09-17T05:45:32.642876+0000","last_became_peered":"2024-09-17T05:45:32.642876+0000","last_unstale":"2024-09-17T05:45:33.640353+0000","last_undegraded":"2024-09-17T05:45:33.640353+0000","last_fullsized":"2024-09-17T05:45:33.640353+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:45:31.614428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:45:31.614428+0000","last_clean_scrub_stamp":"2024-09-17T05:45:31.614428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:27:06.968610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"59'1","reported_seq":16,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-17T05:45:33.642253+0000","last_change":"2024-09-17T05:45:31.644223+0000","last_active":"2024-09-17T05:45:33.642253+0000","last_peered":"2024-09-17T05:45:33.642253+0000","last_clean":"2024-09-17T05:45:33.642253+0000","last_became_active":"2024-09-17T05:45:31.643842+0000","last_became_peered":"2024-09-17T05:45:31.643842+0000","last_unstale":"2024-09-17T05:45:33.642253+0000","last_undegraded":"2024-09-17T05:45:33.642253+0000","last_fullsized":"2024-09-17T05:45:33.642253+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:45:30.612191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:45:30.612191+0000","last_clean_scrub_stamp":"2024-09-17T05:45:30.612191+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:42:04.702175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1b","version":"0'0","reported_seq":13,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-17T05:45:33.640391+0000","last_change":"2024-09-17T05:45:32.648823+0000","last_active":"2024-09-17T05:45:33.640391+0000","last_peered":"2024-09-17T05:45:33.640391+0000","last_clean":"2024-09-17T05:45:33.640391+0000","last_became_active":"2024-09-17T05:45:32.648504+0000","last_became_peered":"2024-09-17T05:45:32.648504+0000","last_unstale":"2024-09-17T05:45:33.640391+0000","last_undegraded":"2024-09-17T05:45:33.640391+0000","last_fullsized":"2024-09-17T05:45:33.640391+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:45:31.614428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:45:31.614428+0000","last_clean_scrub_stamp":"2024-09-17T05:45:31.614428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:50:32.108404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1a","version":"59'1","reported_seq":16,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-17T05:45:33.954414+0000","last_change":"2024-09-17T05:45:31.637200+0000","last_active":"2024-09-17T05:45:33.954414+0000","last_peered":"2024-09-17T05:45:33.954414+0000","last_clean":"2024-09-17T05:45:33.954414+0000","last_became_active":"2024-09-17T05:45:31.636713+0000","last_became_peered":"2024-09-17T05:45:31.636713+0000","last_unstale":"2024-09-17T05:45:33.954414+0000","last_undegraded":"2024-09-17T05:45:33.954414+0000","last_fullsized":"2024-09-17T05:45:33.954414+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:45:30.612191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:45:30.612191+0000","last_clean_scrub_stamp":"2024-09-17T05:45:30.612191+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:22:55.029575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":13,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-17T05:45:33.954352+0000","last_change":"2024-09-17T05:45:32.647406+0000","last_active":"2024-09-17T05:45:33.954352+0000","last_peered":"2024-09-17T05:45:33.954352+0000","last_clean":"2024-09-17T05:45:33.954352+0000","last_became_active":"2024-09-17T05:45:32.647034+0000","last_became_peered":"2024-09-17T05:45:32.647034+0000","last_unstale":"2024-09-17T05:45:33.954352+0000","last_undegraded":"2024-09-17T05:45:33.954352+0000","last_fullsized":"2024-09-17T05:45:33.954352+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:45:31.614428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:45:31.614428+0000","last_clean_scrub_stamp":"2024-09-17T05:45:31.614428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:20:04.106877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":15,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-17T05:45:33.642939+0000","last_change":"2024-09-17T05:45:31.639388+0000","last_active":"2024-09-17T05:45:33.642939+0000","last_peered":"2024-09-17T05:45:33.642939+0000","last_clean":"2024-09-17T05:45:33.642939+0000","last_became_active":"2024-09-17T05:45:31.639055+0000","last_became_peered":"2024-09-17T05:45:31.639055+0000","last_unstale":"2024-09-17T05:45:33.642939+0000","last_undegraded":"2024-09-17T05:45:33.642939+0000","last_fullsized":"2024-09-17T05:45:33.642939+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:45:30.612191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:45:30.612191+0000","last_clean_scrub_stamp":"2024-09-17T05:45:30.612191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:40:43.180531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":13,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-17T05:45:33.640442+0000","last_change":"2024-09-17T05:45:32.651614+0000","last_active":"2024-09-17T05:45:33.640442+0000","last_peered":"2024-09-17T05:45:33.640442+0000","last_clean":"2024-09-17T05:45:33.640442+0000","last_became_active":"2024-09-17T05:45:32.650084+0000","last_became_peered":"2024-09-17T05:45:32.650084+0000","last_unstale":"2024-09-17T05:45:33.640442+0000","last_undegraded":"2024-09-17T05:45:33.640442+0000","last_fullsized":"2024-09-17T05:45:33.640442+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:45:31.614428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:45:31.614428+0000","last_clean_scrub_stamp":"2024-09-17T05:45:31.614428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:26:50.206596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":15,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-17T05:45:33.642214+0000","last_change":"2024-09-17T05:45:31.640961+0000","last_active":"2024-09-17T05:45:33.642214+0000","last_peered":"2024-09-17T05:45:33.642214+0000","last_clean":"2024-09-17T05:45:33.642214+0000","last_became_active":"2024-09-17T05:45:31.640611+0000","last_became_peered":"2024-09-17T05:45:31.640611+0000","last_unstale":"2024-09-17T05:45:33.642214+0000","last_undegraded":"2024-09-17T05:45:33.642214+0000","last_fullsized":"2024-09-17T05:45:33.642214+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:45:30.612191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:45:30.612191+0000","last_clean_scrub_stamp":"2024-09-17T05:45:30.612191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:42:02.871061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":13,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-17T05:45:33.643152+0000","last_change":"2024-09-17T05:45:32.639298+0000","last_active":"2024-09-17T05:45:33.643152+0000","last_peered":"2024-09-17T05:45:33.643152+0000","last_clean":"2024-09-17T05:45:33.643152+0000","last_became_active":"2024-09-17T05:45:32.638969+0000","last_became_peered":"2024-09-17T05:45:32.638969+0000","last_unstale":"2024-09-17T05:45:33.643152+0000","last_undegraded":"2024-09-17T05:45:33.643152+0000","last_fullsized":"2024-09-17T05:45:33.643152+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:45:31.614428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:45:31.614428+0000","last_clean_scrub_stamp":"2024-09-17T05:45:31.614428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:14:04.950271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":15,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-17T05:45:33.955451+0000","last_change":"2024-09-17T05:45:31.639874+0000","last_active":"2024-09-17T05:45:33.955451+0000","last_peered":"2024-09-17T05:45:33.955451+0000","last_clean":"2024-09-17T05:45:33.955451+0000","last_became_active":"2024-09-17T05:45:31.639537+0000","last_became_peered":"2024-09-17T05:45:31.639537+0000","last_unstale":"2024-09-17T05:45:33.955451+0000","last_undegraded":"2024-09-17T05:45:33.955451+0000","last_fullsized":"2024-09-17T05:45:33.955451+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:45:30.612191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:45:30.612191+0000","last_clean_scrub_stamp":"2024-09-17T05:45:30.612191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:28:11.674936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":13,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-17T05:45:33.955442+0000","last_change":"2024-09-17T05:45:32.654783+0000","last_active":"2024-09-17T05:45:33.955442+0000","last_peered":"2024-09-17T05:45:33.955442+0000","last_clean":"2024-09-17T05:45:33.955442+0000","last_became_active":"2024-09-17T05:45:32.654448+0000","last_became_peered":"2024-09-17T05:45:32.654448+0000","last_unstale":"2024-09-17T05:45:33.955442+0000","last_undegraded":"2024-09-17T05:45:33.955442+0000","last_fullsized":"2024-09-17T05:45:33.955442+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:45:31.614428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:45:31.614428+0000","last_clean_scrub_stamp":"2024-09-17T05:45:31.614428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:14:04.792704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":15,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-17T05:45:33.640818+0000","last_change":"2024-09-17T05:45:31.640475+0000","last_active":"2024-09-17T05:45:33.640818+0000","last_peered":"2024-09-17T05:45:33.640818+0000","last_clean":"2024-09-17T05:45:33.640818+0000","last_became_active":"2024-09-17T05:45:31.640191+0000","last_became_peered":"2024-09-17T05:45:31.640191+0000","last_unstale":"2024-09-17T05:45:33.640818+0000","last_undegraded":"2024-09-17T05:45:33.640818+0000","last_fullsized":"2024-09-17T05:45:33.640818+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:45:30.612191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:45:30.612191+0000","last_clean_scrub_stamp":"2024-09-17T05:45:30.612191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:15:13.616663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.14","version":"0'0","reported_seq":13,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-17T05:45:33.954927+0000","last_change":"2024-09-17T05:45:32.648272+0000","last_active":"2024-09-17T05:45:33.954927+0000","last_peered":"2024-09-17T05:45:33.954927+0000","last_clean":"2024-09-17T05:45:33.954927+0000","last_became_active":"2024-09-17T05:45:32.642778+0000","last_became_peered":"2024-09-17T05:45:32.642778+0000","last_unstale":"2024-09-17T05:45:33.954927+0000","last_undegraded":"2024-09-17T05:45:33.954927+0000","last_fullsized":"2024-09-17T05:45:33.954927+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:45:31.614428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:45:31.614428+0000","last_clean_scrub_stamp":"2024-09-17T05:45:31.614428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:27:46.994037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.15","version":"59'3","reported_seq":18,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-17T05:45:33.955209+0000","last_change":"2024-09-17T05:45:31.631099+0000","last_active":"2024-09-17T05:45:33.955209+0000","last_peered":"2024-09-17T05:45:33.955209+0000","last_clean":"2024-09-17T05:45:33.955209+0000","last_became_active":"2024-09-17T05:45:31.630774+0000","last_became_peered":"2024-09-17T05:45:31.630774+0000","last_unstale":"2024-09-17T05:45:33.955209+0000","last_undegraded":"2024-09-17T05:45:33.955209+0000","last_fullsized":"2024-09-17T05:45:33.955209+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:45:30.612191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:45:30.612191+0000","last_clean_scrub_stamp":"2024-09-17T05:45:30.612191+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:59:40.798271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.15","version":"0'0","reported_seq":13,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-17T05:45:33.955107+0000","last_change":"2024-09-17T05:45:32.656952+0000","last_active":"2024-09-17T05:45:33.955107+0000","last_peered":"2024-09-17T05:45:33.955107+0000","last_clean":"2024-09-17T05:45:33.955107+0000","last_became_active":"2024-09-17T05:45:32.656656+0000","last_became_peered":"2024-09-17T05:45:32.656656+0000","last_unstale":"2024-09-17T05:45:33.955107+0000","last_undegraded":"2024-09-17T05:45:33.955107+0000","last_fullsized":"2024-09-17T05:45:33.955107+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:45:31.614428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:45:31.614428+0000","last_clean_scrub_stamp":"2024-09-17T05:45:31.614428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:15:14.618900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.14","version":"59'6","reported_seq":21,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-17T05:45:33.642762+0000","last_change":"2024-09-17T05:45:31.637717+0000","last_active":"2024-09-17T05:45:33.642762+0000","last_peered":"2024-09-17T05:45:33.642762+0000","last_clean":"2024-09-17T05:45:33.642762+0000","last_became_active":"2024-09-17T05:45:31.637335+0000","last_became_peered":"2024-09-17T05:45:31.637335+0000","last_unstale":"2024-09-17T05:45:33.642762+0000","last_undegraded":"2024-09-17T05:45:33.642762+0000","last_fullsized":"2024-09-17T05:45:33.642762+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:45:30.612191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:45:30.612191+0000","last_clean_scrub_stamp":"2024-09-17T05:45:30.612191+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:28:45.681547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":13,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-17T05:45:33.643776+0000","last_change":"2024-09-17T05:45:32.640295+0000","last_active":"2024-09-17T05:45:33.643776+0000","last_peered":"2024-09-17T05:45:33.643776+0000","last_clean":"2024-09-17T05:45:33.643776+0000","last_became_active":"2024-09-17T05:45:32.639626+0000","last_became_peered":"2024-09-17T05:45:32.639626+0000","last_unstale":"2024-09-17T05:45:33.643776+0000","last_undegraded":"2024-09-17T05:45:33.643776+0000","last_fullsized":"2024-09-17T05:45:33.643776+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:45:31.614428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:45:31.614428+0000","last_clean_scrub_stamp":"2024-09-17T05:45:31.614428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:23:18.865215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"59'2","reported_seq":17,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-17T05:45:33.640353+0000","last_change":"2024-09-17T05:45:31.644303+0000","last_active":"2024-09-17T05:45:33.640353+0000","last_peered":"2024-09-17T05:45:33.640353+0000","last_clean":"2024-09-17T05:45:33.640353+0000","last_became_active":"2024-09-17T05:45:31.644011+0000","last_became_peered":"2024-09-17T05:45:31.644011+0000","last_unstale":"2024-09-17T05:45:33.640353+0000","last_undegraded":"2024-09-17T05:45:33.640353+0000","last_fullsized":"2024-09-17T05:45:33.640353+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:45:30.612191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:45:30.612191+0000","last_clean_scrub_stamp":"2024-09-17T05:45:30.612191+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:17:13.806680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.13","version":"0'0","reported_seq":13,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-17T05:45:33.954984+0000","last_change":"2024-09-17T05:45:32.649405+0000","last_active":"2024-09-17T05:45:33.954984+0000","last_peered":"2024-09-17T05:45:33.954984+0000","last_clean":"2024-09-17T05:45:33.954984+0000","last_became_active":"2024-09-17T05:45:32.649052+0000","last_became_peered":"2024-09-17T05:45:32.649052+0000","last_unstale":"2024-09-17T05:45:33.954984+0000","last_undegraded":"2024-09-17T05:45:33.954984+0000","last_fullsized":"2024-09-17T05:45:33.954984+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:45:31.614428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:45:31.614428+0000","last_clean_scrub_stamp":"2024-09-17T05:45:31.614428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:14:32.500946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":15,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-17T05:45:33.954352+0000","last_change":"2024-09-17T05:45:31.629800+0000","last_active":"2024-09-17T05:45:33.954352+0000","last_peered":"2024-09-17T05:45:33.954352+0000","last_clean":"2024-09-17T05:45:33.954352+0000","last_became_active":"2024-09-17T05:45:31.629475+0000","last_became_peered":"2024-09-17T05:45:31.629475+0000","last_unstale":"2024-09-17T05:45:33.954352+0000","last_undegraded":"2024-09-17T05:45:33.954352+0000","last_fullsized":"2024-09-17T05:45:33.954352+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:45:30.612191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:45:30.612191+0000","last_clean_scrub_stamp":"2024-09-17T05:45:30.612191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:01:22.592548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.10","version":"0'0","reported_seq":13,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-17T05:45:33.642459+0000","last_change":"2024-09-17T05:45:32.647139+0000","last_active":"2024-09-17T05:45:33.642459+0000","last_peered":"2024-09-17T05:45:33.642459+0000","last_clean":"2024-09-17T05:45:33.642459+0000","last_became_active":"2024-09-17T05:45:32.646721+0000","last_became_peered":"2024-09-17T05:45:32.646721+0000","last_unstale":"2024-09-17T05:45:33.642459+0000","last_undegraded":"2024-09-17T05:45:33.642459+0000","last_fullsized":"2024-09-17T05:45:33.642459+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:45:31.614428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:45:31.614428+0000","last_clean_scrub_stamp":"2024-09-17T05:45:31.614428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:10:56.650561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":15,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-17T05:45:33.643055+0000","last_change":"2024-09-17T05:45:31.638931+0000","last_active":"2024-09-17T05:45:33.643055+0000","last_peered":"2024-09-17T05:45:33.643055+0000","last_clean":"2024-09-17T05:45:33.643055+0000","last_became_active":"2024-09-17T05:45:31.638553+0000","last_became_peered":"2024-09-17T05:45:31.638553+0000","last_unstale":"2024-09-17T05:45:33.643055+0000","last_undegraded":"2024-09-17T05:45:33.643055+0000","last_fullsized":"2024-09-17T05:45:33.643055+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:45:30.612191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:45:30.612191+0000","last_clean_scrub_stamp":"2024-09-17T05:45:30.612191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:10:55.648324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":13,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-17T05:45:33.955462+0000","last_change":"2024-09-17T05:45:32.653723+0000","last_active":"2024-09-17T05:45:33.955462+0000","last_peered":"2024-09-17T05:45:33.955462+0000","last_clean":"2024-09-17T05:45:33.955462+0000","last_became_active":"2024-09-17T05:45:32.653153+0000","last_became_peered":"2024-09-17T05:45:32.653153+0000","last_unstale":"2024-09-17T05:45:33.955462+0000","last_undegraded":"2024-09-17T05:45:33.955462+0000","last_fullsized":"2024-09-17T05:45:33.955462+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:45:31.614428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:45:31.614428+0000","last_clean_scrub_stamp":"2024-09-17T05:45:31.614428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:07:41.347650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.10","version":"59'8","reported_seq":23,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-17T05:45:33.954532+0000","last_change":"2024-09-17T05:45:31.639504+0000","last_active":"2024-09-17T05:45:33.954532+0000","last_peered":"2024-09-17T05:45:33.954532+0000","last_clean":"2024-09-17T05:45:33.954532+0000","last_became_active":"2024-09-17T05:45:31.638977+0000","last_became_peered":"2024-09-17T05:45:31.638977+0000","last_unstale":"2024-09-17T05:45:33.954532+0000","last_undegraded":"2024-09-17T05:45:33.954532+0000","last_fullsized":"2024-09-17T05:45:33.954532+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:45:30.612191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:45:30.612191+0000","last_clean_scrub_stamp":"2024-09-17T05:45:30.612191+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:07:21.436157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.e","version":"0'0","reported_seq":13,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-17T05:45:33.955484+0000","last_change":"2024-09-17T05:45:32.653968+0000","last_active":"2024-09-17T05:45:33.955484+0000","last_peered":"2024-09-17T05:45:33.955484+0000","last_clean":"2024-09-17T05:45:33.955484+0000","last_became_active":"2024-09-17T05:45:32.653675+0000","last_became_peered":"2024-09-17T05:45:32.653675+0000","last_unstale":"2024-09-17T05:45:33.955484+0000","last_undegraded":"2024-09-17T05:45:33.955484+0000","last_fullsized":"2024-09-17T05:45:33.955484+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:45:31.614428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:45:31.614428+0000","last_clean_scrub_stamp":"2024-09-17T05:45:31.614428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:52:42.817700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.f","version":"59'1","reported_seq":16,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-17T05:45:33.640953+0000","last_change":"2024-09-17T05:45:31.640449+0000","last_active":"2024-09-17T05:45:33.640953+0000","last_peered":"2024-09-17T05:45:33.640953+0000","last_clean":"2024-09-17T05:45:33.640953+0000","last_became_active":"2024-09-17T05:45:31.640151+0000","last_became_peered":"2024-09-17T05:45:31.640151+0000","last_unstale":"2024-09-17T05:45:33.640953+0000","last_undegraded":"2024-09-17T05:45:33.640953+0000","last_fullsized":"2024-09-17T05:45:33.640953+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:45:30.612191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:45:30.612191+0000","last_clean_scrub_stamp":"2024-09-17T05:45:30.612191+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:03:19.632066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.f","version":"0'0","reported_seq":13,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-17T05:45:33.643484+0000","last_change":"2024-09-17T05:45:32.645212+0000","last_active":"2024-09-17T05:45:33.643484+0000","last_peered":"2024-09-17T05:45:33.643484+0000","last_clean":"2024-09-17T05:45:33.643484+0000","last_became_active":"2024-09-17T05:45:32.644921+0000","last_became_peered":"2024-09-17T05:45:32.644921+0000","last_unstale":"2024-09-17T05:45:33.643484+0000","last_undegraded":"2024-09-17T05:45:33.643484+0000","last_fullsized":"2024-09-17T05:45:33.643484+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:45:31.614428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:45:31.614428+0000","last_clean_scrub_stamp":"2024-09-17T05:45:31.614428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:15:12.766358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.e","version":"59'2","reported_seq":17,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-17T05:45:33.954693+0000","last_change":"2024-09-17T05:45:31.640980+0000","last_active":"2024-09-17T05:45:33.954693+0000","last_peered":"2024-09-17T05:45:33.954693+0000","last_clean":"2024-09-17T05:45:33.954693+0000","last_became_active":"2024-09-17T05:45:31.640679+0000","last_became_peered":"2024-09-17T05:45:31.640679+0000","last_unstale":"2024-09-17T05:45:33.954693+0000","last_undegraded":"2024-09-17T05:45:33.954693+0000","last_fullsized":"2024-09-17T05:45:33.954693+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:45:30.612191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:45:30.612191+0000","last_clean_scrub_stamp":"2024-09-17T05:45:30.612191+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:10:04.148047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":13,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-17T05:45:33.640827+0000","last_change":"2024-09-17T05:45:32.639450+0000","last_active":"2024-09-17T05:45:33.640827+0000","last_peered":"2024-09-17T05:45:33.640827+0000","last_clean":"2024-09-17T05:45:33.640827+0000","last_became_active":"2024-09-17T05:45:32.639129+0000","last_became_peered":"2024-09-17T05:45:32.639129+0000","last_unstale":"2024-09-17T05:45:33.640827+0000","last_undegraded":"2024-09-17T05:45:33.640827+0000","last_fullsized":"2024-09-17T05:45:33.640827+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:45:31.614428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:45:31.614428+0000","last_clean_scrub_stamp":"2024-09-17T05:45:31.614428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:59:30.403141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"59'1","reported_seq":16,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-17T05:45:33.642693+0000","last_change":"2024-09-17T05:45:31.638394+0000","last_active":"2024-09-17T05:45:33.642693+0000","last_peered":"2024-09-17T05:45:33.642693+0000","last_clean":"2024-09-17T05:45:33.642693+0000","last_became_active":"2024-09-17T05:45:31.638048+0000","last_became_peered":"2024-09-17T05:45:31.638048+0000","last_unstale":"2024-09-17T05:45:33.642693+0000","last_undegraded":"2024-09-17T05:45:33.642693+0000","last_fullsized":"2024-09-17T05:45:33.642693+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:45:30.612191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:45:30.612191+0000","last_clean_scrub_stamp":"2024-09-17T05:45:30.612191+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:48:56.125063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.d","version":"0'0","reported_seq":13,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-17T05:45:33.955462+0000","last_change":"2024-09-17T05:45:32.657075+0000","last_active":"2024-09-17T05:45:33.955462+0000","last_peered":"2024-09-17T05:45:33.955462+0000","last_clean":"2024-09-17T05:45:33.955462+0000","last_became_active":"2024-09-17T05:45:32.656753+0000","last_became_peered":"2024-09-17T05:45:32.656753+0000","last_unstale":"2024-09-17T05:45:33.955462+0000","last_undegraded":"2024-09-17T05:45:33.955462+0000","last_fullsized":"2024-09-17T05:45:33.955462+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:45:31.614428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:45:31.614428+0000","last_clean_scrub_stamp":"2024-09-17T05:45:31.614428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:36:46.238066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":15,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-17T05:45:33.954614+0000","last_change":"2024-09-17T05:45:31.643975+0000","last_active":"2024-09-17T05:45:33.954614+0000","last_peered":"2024-09-17T05:45:33.954614+0000","last_clean":"2024-09-17T05:45:33.954614+0000","last_became_active":"2024-09-17T05:45:31.643609+0000","last_became_peered":"2024-09-17T05:45:31.643609+0000","last_unstale":"2024-09-17T05:45:33.954614+0000","last_undegraded":"2024-09-17T05:45:33.954614+0000","last_fullsized":"2024-09-17T05:45:33.954614+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:45:30.612191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:45:30.612191+0000","last_clean_scrub_stamp":"2024-09-17T05:45:30.612191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:49:10.450094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":13,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-17T05:45:33.644055+0000","last_change":"2024-09-17T05:45:32.639943+0000","last_active":"2024-09-17T05:45:33.644055+0000","last_peered":"2024-09-17T05:45:33.644055+0000","last_clean":"2024-09-17T05:45:33.644055+0000","last_became_active":"2024-09-17T05:45:32.639216+0000","last_became_peered":"2024-09-17T05:45:32.639216+0000","last_unstale":"2024-09-17T05:45:33.644055+0000","last_undegraded":"2024-09-17T05:45:33.644055+0000","last_fullsized":"2024-09-17T05:45:33.644055+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:45:31.614428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:45:31.614428+0000","last_clean_scrub_stamp":"2024-09-17T05:45:31.614428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:36:39.409995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.b","version":"59'2","reported_seq":17,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-17T05:45:33.640783+0000","last_change":"2024-09-17T05:45:31.638240+0000","last_active":"2024-09-17T05:45:33.640783+0000","last_peered":"2024-09-17T05:45:33.640783+0000","last_clean":"2024-09-17T05:45:33.640783+0000","last_became_active":"2024-09-17T05:45:31.637885+0000","last_became_peered":"2024-09-17T05:45:31.637885+0000","last_unstale":"2024-09-17T05:45:33.640783+0000","last_undegraded":"2024-09-17T05:45:33.640783+0000","last_fullsized":"2024-09-17T05:45:33.640783+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:45:30.612191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:45:30.612191+0000","last_clean_scrub_stamp":"2024-09-17T05:45:30.612191+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:07:40.345414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.b","version":"0'0","reported_seq":13,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-17T05:45:33.955098+0000","last_change":"2024-09-17T05:45:32.646091+0000","last_active":"2024-09-17T05:45:33.955098+0000","last_peered":"2024-09-17T05:45:33.955098+0000","last_clean":"2024-09-17T05:45:33.955098+0000","last_became_active":"2024-09-17T05:45:32.645766+0000","last_became_peered":"2024-09-17T05:45:32.645766+0000","last_unstale":"2024-09-17T05:45:33.955098+0000","last_undegraded":"2024-09-17T05:45:33.955098+0000","last_fullsized":"2024-09-17T05:45:33.955098+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:45:31.614428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:45:31.614428+0000","last_clean_scrub_stamp":"2024-09-17T05:45:31.614428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:23:48.582650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":15,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-17T05:45:33.954645+0000","last_change":"2024-09-17T05:45:31.640272+0000","last_active":"2024-09-17T05:45:33.954645+0000","last_peered":"2024-09-17T05:45:33.954645+0000","last_clean":"2024-09-17T05:45:33.954645+0000","last_became_active":"2024-09-17T05:45:31.639976+0000","last_became_peered":"2024-09-17T05:45:31.639976+0000","last_unstale":"2024-09-17T05:45:33.954645+0000","last_undegraded":"2024-09-17T05:45:33.954645+0000","last_fullsized":"2024-09-17T05:45:33.954645+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:45:30.612191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:45:30.612191+0000","last_clean_scrub_stamp":"2024-09-17T05:45:30.612191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:50:01.810481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":13,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-17T05:45:33.954272+0000","last_change":"2024-09-17T05:45:32.651035+0000","last_active":"2024-09-17T05:45:33.954272+0000","last_peered":"2024-09-17T05:45:33.954272+0000","last_clean":"2024-09-17T05:45:33.954272+0000","last_became_active":"2024-09-17T05:45:32.650692+0000","last_became_peered":"2024-09-17T05:45:32.650692+0000","last_unstale":"2024-09-17T05:45:33.954272+0000","last_undegraded":"2024-09-17T05:45:33.954272+0000","last_fullsized":"2024-09-17T05:45:33.954272+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:45:31.614428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:45:31.614428+0000","last_clean_scrub_stamp":"2024-09-17T05:45:31.614428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:34:55.553974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":15,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-17T05:45:33.642625+0000","last_change":"2024-09-17T05:45:31.643740+0000","last_active":"2024-09-17T05:45:33.642625+0000","last_peered":"2024-09-17T05:45:33.642625+0000","last_clean":"2024-09-17T05:45:33.642625+0000","last_became_active":"2024-09-17T05:45:31.643434+0000","last_became_peered":"2024-09-17T05:45:31.643434+0000","last_unstale":"2024-09-17T05:45:33.642625+0000","last_undegraded":"2024-09-17T05:45:33.642625+0000","last_fullsized":"2024-09-17T05:45:33.642625+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:45:30.612191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:45:30.612191+0000","last_clean_scrub_stamp":"2024-09-17T05:45:30.612191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:07:14.433577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":13,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-17T05:45:33.644080+0000","last_change":"2024-09-17T05:45:32.644449+0000","last_active":"2024-09-17T05:45:33.644080+0000","last_peered":"2024-09-17T05:45:33.644080+0000","last_clean":"2024-09-17T05:45:33.644080+0000","last_became_active":"2024-09-17T05:45:32.641454+0000","last_became_peered":"2024-09-17T05:45:32.641454+0000","last_unstale":"2024-09-17T05:45:33.644080+0000","last_undegraded":"2024-09-17T05:45:33.644080+0000","last_fullsized":"2024-09-17T05:45:33.644080+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:45:31.614428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:45:31.614428+0000","last_clean_scrub_stamp":"2024-09-17T05:45:31.614428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:31:53.970125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.7","version":"59'2","reported_seq":17,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-17T05:45:33.955334+0000","last_change":"2024-09-17T05:45:31.636162+0000","last_active":"2024-09-17T05:45:33.955334+0000","last_peered":"2024-09-17T05:45:33.955334+0000","last_clean":"2024-09-17T05:45:33.955334+0000","last_became_active":"2024-09-17T05:45:31.635754+0000","last_became_peered":"2024-09-17T05:45:31.635754+0000","last_unstale":"2024-09-17T05:45:33.955334+0000","last_undegraded":"2024-09-17T05:45:33.955334+0000","last_fullsized":"2024-09-17T05:45:33.955334+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:45:30.612191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:45:30.612191+0000","last_clean_scrub_stamp":"2024-09-17T05:45:30.612191+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:42:10.421991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.7","version":"0'0","reported_seq":13,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-17T05:45:33.643714+0000","last_change":"2024-09-17T05:45:32.651010+0000","last_active":"2024-09-17T05:45:33.643714+0000","last_peered":"2024-09-17T05:45:33.643714+0000","last_clean":"2024-09-17T05:45:33.643714+0000","last_became_active":"2024-09-17T05:45:32.650681+0000","last_became_peered":"2024-09-17T05:45:32.650681+0000","last_unstale":"2024-09-17T05:45:33.643714+0000","last_undegraded":"2024-09-17T05:45:33.643714+0000","last_fullsized":"2024-09-17T05:45:33.643714+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:45:31.614428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:45:31.614428+0000","last_clean_scrub_stamp":"2024-09-17T05:45:31.614428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:22:10.519690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.6","version":"60'1","reported_seq":16,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-17T05:45:33.954851+0000","last_change":"2024-09-17T05:45:31.639739+0000","last_active":"2024-09-17T05:45:33.954851+0000","last_peered":"2024-09-17T05:45:33.954851+0000","last_clean":"2024-09-17T05:45:33.954851+0000","last_became_active":"2024-09-17T05:45:31.639123+0000","last_became_peered":"2024-09-17T05:45:31.639123+0000","last_unstale":"2024-09-17T05:45:33.954851+0000","last_undegraded":"2024-09-17T05:45:33.954851+0000","last_fullsized":"2024-09-17T05:45:33.954851+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:45:30.612191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:45:30.612191+0000","last_clean_scrub_stamp":"2024-09-17T05:45:30.612191+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:47:45.086586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":13,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-17T05:45:33.955091+0000","last_change":"2024-09-17T05:45:32.638243+0000","last_active":"2024-09-17T05:45:33.955091+0000","last_peered":"2024-09-17T05:45:33.955091+0000","last_clean":"2024-09-17T05:45:33.955091+0000","last_became_active":"2024-09-17T05:45:32.637937+0000","last_became_peered":"2024-09-17T05:45:32.637937+0000","last_unstale":"2024-09-17T05:45:33.955091+0000","last_undegraded":"2024-09-17T05:45:33.955091+0000","last_fullsized":"2024-09-17T05:45:33.955091+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:45:31.614428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:45:31.614428+0000","last_clean_scrub_stamp":"2024-09-17T05:45:31.614428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:42:05.704412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":15,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-17T05:45:33.954546+0000","last_change":"2024-09-17T05:45:31.636335+0000","last_active":"2024-09-17T05:45:33.954546+0000","last_peered":"2024-09-17T05:45:33.954546+0000","last_clean":"2024-09-17T05:45:33.954546+0000","last_became_active":"2024-09-17T05:45:31.635851+0000","last_became_peered":"2024-09-17T05:45:31.635851+0000","last_unstale":"2024-09-17T05:45:33.954546+0000","last_undegraded":"2024-09-17T05:45:33.954546+0000","last_fullsized":"2024-09-17T05:45:33.954546+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:45:30.612191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:45:30.612191+0000","last_clean_scrub_stamp":"2024-09-17T05:45:30.612191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:51:54.761335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":13,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-17T05:45:33.954966+0000","last_change":"2024-09-17T05:45:32.634960+0000","last_active":"2024-09-17T05:45:33.954966+0000","last_peered":"2024-09-17T05:45:33.954966+0000","last_clean":"2024-09-17T05:45:33.954966+0000","last_became_active":"2024-09-17T05:45:32.634609+0000","last_became_peered":"2024-09-17T05:45:32.634609+0000","last_unstale":"2024-09-17T05:45:33.954966+0000","last_undegraded":"2024-09-17T05:45:33.954966+0000","last_fullsized":"2024-09-17T05:45:33.954966+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:45:31.614428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:45:31.614428+0000","last_clean_scrub_stamp":"2024-09-17T05:45:31.614428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:16:21.638467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":15,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-17T05:45:33.644013+0000","last_change":"2024-09-17T05:45:31.638944+0000","last_active":"2024-09-17T05:45:33.644013+0000","last_peered":"2024-09-17T05:45:33.644013+0000","last_clean":"2024-09-17T05:45:33.644013+0000","last_became_active":"2024-09-17T05:45:31.638594+0000","last_became_peered":"2024-09-17T05:45:31.638594+0000","last_unstale":"2024-09-17T05:45:33.644013+0000","last_undegraded":"2024-09-17T05:45:33.644013+0000","last_fullsized":"2024-09-17T05:45:33.644013+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:45:30.612191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:45:30.612191+0000","last_clean_scrub_stamp":"2024-09-17T05:45:30.612191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:31:48.568445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":13,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-17T05:45:33.640594+0000","last_change":"2024-09-17T05:45:32.639854+0000","last_active":"2024-09-17T05:45:33.640594+0000","last_peered":"2024-09-17T05:45:33.640594+0000","last_clean":"2024-09-17T05:45:33.640594+0000","last_became_active":"2024-09-17T05:45:32.639532+0000","last_became_peered":"2024-09-17T05:45:32.639532+0000","last_unstale":"2024-09-17T05:45:33.640594+0000","last_undegraded":"2024-09-17T05:45:33.640594+0000","last_fullsized":"2024-09-17T05:45:33.640594+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:45:31.614428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:45:31.614428+0000","last_clean_scrub_stamp":"2024-09-17T05:45:31.614428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:38:36.713568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":15,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-17T05:45:33.954023+0000","last_change":"2024-09-17T05:45:31.640803+0000","last_active":"2024-09-17T05:45:33.954023+0000","last_peered":"2024-09-17T05:45:33.954023+0000","last_clean":"2024-09-17T05:45:33.954023+0000","last_became_active":"2024-09-17T05:45:31.640497+0000","last_became_peered":"2024-09-17T05:45:31.640497+0000","last_unstale":"2024-09-17T05:45:33.954023+0000","last_undegraded":"2024-09-17T05:45:33.954023+0000","last_fullsized":"2024-09-17T05:45:33.954023+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:45:30.612191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:45:30.612191+0000","last_clean_scrub_stamp":"2024-09-17T05:45:30.612191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:05:37.438540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":13,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-17T05:45:33.955297+0000","last_change":"2024-09-17T05:45:32.653467+0000","last_active":"2024-09-17T05:45:33.955297+0000","last_peered":"2024-09-17T05:45:33.955297+0000","last_clean":"2024-09-17T05:45:33.955297+0000","last_became_active":"2024-09-17T05:45:32.653172+0000","last_became_peered":"2024-09-17T05:45:32.653172+0000","last_unstale":"2024-09-17T05:45:33.955297+0000","last_undegraded":"2024-09-17T05:45:33.955297+0000","last_fullsized":"2024-09-17T05:45:33.955297+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:45:31.614428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:45:31.614428+0000","last_clean_scrub_stamp":"2024-09-17T05:45:31.614428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:03:20.634302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":15,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-17T05:45:33.642981+0000","last_change":"2024-09-17T05:45:31.640591+0000","last_active":"2024-09-17T05:45:33.642981+0000","last_peered":"2024-09-17T05:45:33.642981+0000","last_clean":"2024-09-17T05:45:33.642981+0000","last_became_active":"2024-09-17T05:45:31.640103+0000","last_became_peered":"2024-09-17T05:45:31.640103+0000","last_unstale":"2024-09-17T05:45:33.642981+0000","last_undegraded":"2024-09-17T05:45:33.642981+0000","last_fullsized":"2024-09-17T05:45:33.642981+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:45:30.612191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:45:30.612191+0000","last_clean_scrub_stamp":"2024-09-17T05:45:30.612191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:53:07.534995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":13,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-17T05:45:33.954155+0000","last_change":"2024-09-17T05:45:32.648684+0000","last_active":"2024-09-17T05:45:33.954155+0000","last_peered":"2024-09-17T05:45:33.954155+0000","last_clean":"2024-09-17T05:45:33.954155+0000","last_became_active":"2024-09-17T05:45:32.643607+0000","last_became_peered":"2024-09-17T05:45:32.643607+0000","last_unstale":"2024-09-17T05:45:33.954155+0000","last_undegraded":"2024-09-17T05:45:33.954155+0000","last_fullsized":"2024-09-17T05:45:33.954155+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:45:31.614428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:45:31.614428+0000","last_clean_scrub_stamp":"2024-09-17T05:45:31.614428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:32:54.601957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":15,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-17T05:45:33.954224+0000","last_change":"2024-09-17T05:45:31.637639+0000","last_active":"2024-09-17T05:45:33.954224+0000","last_peered":"2024-09-17T05:45:33.954224+0000","last_clean":"2024-09-17T05:45:33.954224+0000","last_became_active":"2024-09-17T05:45:31.637329+0000","last_became_peered":"2024-09-17T05:45:31.637329+0000","last_unstale":"2024-09-17T05:45:33.954224+0000","last_undegraded":"2024-09-17T05:45:33.954224+0000","last_fullsized":"2024-09-17T05:45:33.954224+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:45:30.612191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:45:30.612191+0000","last_clean_scrub_stamp":"2024-09-17T05:45:30.612191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:43:51.042977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":13,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-17T05:45:33.640514+0000","last_change":"2024-09-17T05:45:32.643730+0000","last_active":"2024-09-17T05:45:33.640514+0000","last_peered":"2024-09-17T05:45:33.640514+0000","last_clean":"2024-09-17T05:45:33.640514+0000","last_became_active":"2024-09-17T05:45:32.640950+0000","last_became_peered":"2024-09-17T05:45:32.640950+0000","last_unstale":"2024-09-17T05:45:33.640514+0000","last_undegraded":"2024-09-17T05:45:33.640514+0000","last_fullsized":"2024-09-17T05:45:33.640514+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:45:31.614428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:45:31.614428+0000","last_clean_scrub_stamp":"2024-09-17T05:45:31.614428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:41:49.439087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":15,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-17T05:45:33.640483+0000","last_change":"2024-09-17T05:45:31.639583+0000","last_active":"2024-09-17T05:45:33.640483+0000","last_peered":"2024-09-17T05:45:33.640483+0000","last_clean":"2024-09-17T05:45:33.640483+0000","last_became_active":"2024-09-17T05:45:31.639274+0000","last_became_peered":"2024-09-17T05:45:31.639274+0000","last_unstale":"2024-09-17T05:45:33.640483+0000","last_undegraded":"2024-09-17T05:45:33.640483+0000","last_fullsized":"2024-09-17T05:45:33.640483+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:45:30.612191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:45:30.612191+0000","last_clean_scrub_stamp":"2024-09-17T05:45:30.612191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:21:49.107492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":13,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-17T05:45:33.640325+0000","last_change":"2024-09-17T05:45:32.648431+0000","last_active":"2024-09-17T05:45:33.640325+0000","last_peered":"2024-09-17T05:45:33.640325+0000","last_clean":"2024-09-17T05:45:33.640325+0000","last_became_active":"2024-09-17T05:45:32.648122+0000","last_became_peered":"2024-09-17T05:45:32.648122+0000","last_unstale":"2024-09-17T05:45:33.640325+0000","last_undegraded":"2024-09-17T05:45:33.640325+0000","last_fullsized":"2024-09-17T05:45:33.640325+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:45:31.614428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:45:31.614428+0000","last_clean_scrub_stamp":"2024-09-17T05:45:31.614428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:24:09.458541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":15,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-17T05:45:33.954310+0000","last_change":"2024-09-17T05:45:31.639879+0000","last_active":"2024-09-17T05:45:33.954310+0000","last_peered":"2024-09-17T05:45:33.954310+0000","last_clean":"2024-09-17T05:45:33.954310+0000","last_became_active":"2024-09-17T05:45:31.639553+0000","last_became_peered":"2024-09-17T05:45:31.639553+0000","last_unstale":"2024-09-17T05:45:33.954310+0000","last_undegraded":"2024-09-17T05:45:33.954310+0000","last_fullsized":"2024-09-17T05:45:33.954310+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:45:30.612191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:45:30.612191+0000","last_clean_scrub_stamp":"2024-09-17T05:45:30.612191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:50:33.356033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"19'72","reported_seq":178,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-17T05:45:33.954772+0000","last_change":"2024-09-17T05:41:48.539830+0000","last_active":"2024-09-17T05:45:33.954772+0000","last_peered":"2024-09-17T05:45:33.954772+0000","last_clean":"2024-09-17T05:45:33.954772+0000","last_became_active":"2024-09-17T05:41:48.538743+0000","last_became_peered":"2024-09-17T05:41:48.538743+0000","last_unstale":"2024-09-17T05:45:33.954772+0000","last_undegraded":"2024-09-17T05:45:33.954772+0000","last_fullsized":"2024-09-17T05:45:33.954772+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:47.152539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:47.152539+0000","last_clean_scrub_stamp":"2024-09-17T05:41:47.152539+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:08:02.952016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":9,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":16,"seq":68719476787,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40212,"kb_used_data":696,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331628,"statfs":{"total":96636764160,"available":96595587072,"internally_reserved":0,"allocated":712704,"data_stored":295654,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":40434118},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":7,"up_from":15,"seq":64424509491,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36636,"kb_used_data":1284,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335204,"statfs":{"total":96636764160,"available":96599248896,"internally_reserved":0,"allocated":1314816,"data_stored":886182,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":36174282},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509490,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36052,"kb_used_data":704,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335788,"statfs":{"total":96636764160,"available":96599846912,"internally_reserved":0,"allocated":720896,"data_stored":296306,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509490,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":54112,"kb_used_data":708,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94317728,"statfs":{"total":96636764160,"available":96581353472,"internally_reserved":0,"allocated":724992,"data_stored":297266,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509490,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":54108,"kb_used_data":704,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94317732,"statfs":{"total":96636764160,"available":96581357568,"internally_reserved":0,"allocated":720896,"data_stored":295710,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":54655431},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509490,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36060,"kb_used_data":704,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335780,"statfs":{"total":96636764160,"available":96599838720,"internally_reserved":0,"allocated":720896,"data_stored":295710,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509490,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":54096,"kb_used_data":700,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94317744,"statfs":{"total":96636764160,"available":96581369856,"internally_reserved":0,"allocated":716800,"data_stored":295744,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574898,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":54688,"kb_used_data":1292,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94317152,"statfs":{"total":96636764160,"available":96580763648,"internally_reserved":0,"allocated":1323008,"data_stored":888216,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2194,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-17T05:45:41.455 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-17T05:45:41.455 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-09-17T05:45:41.612 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:41.610+0000 7fee79e27640 1 -- 172.21.15.150:0/2133344543 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fee740b7960 msgr2=0x7fee740af1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:45:41.612 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:41.610+0000 7fee79e27640 1 --2- 172.21.15.150:0/2133344543 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fee740b7960 0x7fee740af1f0 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7fee740cfd70 tx=0x7fee6402a420 comp rx=0 tx=0).stop 2024-09-17T05:45:41.612 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:41.610+0000 7fee79e27640 1 -- 172.21.15.150:0/2133344543 shutdown_connections 2024-09-17T05:45:41.612 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:41.610+0000 7fee79e27640 1 --2- 172.21.15.150:0/2133344543 >> v2:172.21.15.176:3300/0 conn(0x7fee740b7d70 0x7fee740d0a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:41.612 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:41.610+0000 7fee79e27640 1 --2- 172.21.15.150:0/2133344543 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fee740b7960 0x7fee740af1f0 unknown :-1 s=CLOSED pgs=648 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:41.612 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:41.610+0000 7fee79e27640 1 -- 172.21.15.150:0/2133344543 >> 172.21.15.150:0/2133344543 conn(0x7fee740cef20 msgr2=0x7fee740cf330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:45:41.612 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:41.610+0000 7fee79e27640 1 -- 172.21.15.150:0/2133344543 shutdown_connections 2024-09-17T05:45:41.612 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:41.610+0000 7fee79e27640 1 -- 172.21.15.150:0/2133344543 wait complete. 2024-09-17T05:45:41.613 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:41.611+0000 7fee79e27640 1 Processor -- start 2024-09-17T05:45:41.613 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:41.612+0000 7fee79e27640 1 -- start start 2024-09-17T05:45:41.616 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:41.613+0000 7fee79e27640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fee740af730 0x7fee74144140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:45:41.616 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:41.613+0000 7fee79e27640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fee740b7960 0x7fee7415e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:45:41.616 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:41.613+0000 7fee79e27640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fee740b7d70 0x7fee7415a4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:45:41.616 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:41.613+0000 7fee79e27640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7fee740ced10 con 0x7fee740b7960 2024-09-17T05:45:41.616 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:41.613+0000 7fee79e27640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fee740ceb90 con 0x7fee740b7d70 2024-09-17T05:45:41.616 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:41.613+0000 7fee79e27640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fee740d0fc0 con 0x7fee740af730 2024-09-17T05:45:41.616 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:41.613+0000 7fee72ffd640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fee740b7960 0x7fee7415e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:45:41.616 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:41.613+0000 7fee72ffd640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fee740b7960 0x7fee7415e090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:38134/0 (socket says 172.21.15.150:38134) 2024-09-17T05:45:41.617 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:41.613+0000 7fee72ffd640 1 -- 172.21.15.150:0/3220613339 learned_addr learned my addr 172.21.15.150:0/3220613339 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:45:41.617 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:41.613+0000 7fee737fe640 1 --2- 172.21.15.150:0/3220613339 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fee740af730 0x7fee74144140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:45:41.617 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:41.613+0000 7fee73fff640 1 --2- 172.21.15.150:0/3220613339 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fee740b7d70 0x7fee7415a4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:45:41.617 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:41.613+0000 7fee72ffd640 1 -- 172.21.15.150:0/3220613339 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fee740af730 msgr2=0x7fee74144140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:45:41.617 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:41.613+0000 7fee72ffd640 1 --2- 172.21.15.150:0/3220613339 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fee740af730 0x7fee74144140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:41.617 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:41.613+0000 7fee72ffd640 1 -- 172.21.15.150:0/3220613339 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fee740b7d70 msgr2=0x7fee7415a4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:45:41.617 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:41.613+0000 7fee72ffd640 1 --2- 172.21.15.150:0/3220613339 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fee740b7d70 0x7fee7415a4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:41.617 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:41.613+0000 7fee72ffd640 1 -- 172.21.15.150:0/3220613339 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fee740cbb70 con 0x7fee740b7960 2024-09-17T05:45:41.617 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:41.614+0000 7fee72ffd640 1 --2- 172.21.15.150:0/3220613339 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fee740b7960 0x7fee7415e090 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7fee6800c970 tx=0x7fee6800ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:45:41.617 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:41.614+0000 7fee5bfff640 1 -- 172.21.15.150:0/3220613339 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee68004220 con 0x7fee740b7960 2024-09-17T05:45:41.617 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:41.614+0000 7fee5bfff640 1 -- 172.21.15.150:0/3220613339 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fee680044b0 con 0x7fee740b7960 2024-09-17T05:45:41.617 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:41.614+0000 7fee79e27640 1 -- 172.21.15.150:0/3220613339 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fee740cc560 con 0x7fee740b7960 2024-09-17T05:45:41.617 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:41.614+0000 7fee5bfff640 1 -- 172.21.15.150:0/3220613339 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee68007c10 con 0x7fee740b7960 2024-09-17T05:45:41.618 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:41.614+0000 7fee79e27640 1 -- 172.21.15.150:0/3220613339 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fee7415fa70 con 0x7fee740b7960 2024-09-17T05:45:41.618 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:41.615+0000 7fee79e27640 1 -- 172.21.15.150:0/3220613339 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fee7415f500 con 0x7fee740b7960 2024-09-17T05:45:41.619 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:41.616+0000 7fee5bfff640 1 -- 172.21.15.150:0/3220613339 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 15) ==== 102257+0+0 (secure 0 0 0) 0x7fee68003610 con 0x7fee740b7960 2024-09-17T05:45:41.619 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:41.616+0000 7fee5bfff640 1 --2- 172.21.15.150:0/3220613339 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fee60079490 0x7fee6007b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:45:41.619 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:41.616+0000 7fee5bfff640 1 -- 172.21.15.150:0/3220613339 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(60..60 src has 1..60) ==== 5737+0+0 (secure 0 0 0) 0x7fee68099950 con 0x7fee740b7960 2024-09-17T05:45:41.619 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:41.616+0000 7fee737fe640 1 --2- 172.21.15.150:0/3220613339 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fee60079490 0x7fee6007b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:45:41.619 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:41.617+0000 7fee737fe640 1 --2- 172.21.15.150:0/3220613339 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fee60079490 0x7fee6007b9a0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7fee64034000 tx=0x7fee64004730 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:45:41.622 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:41.621+0000 7fee5bfff640 1 -- 172.21.15.150:0/3220613339 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fee68014030 con 0x7fee740b7960 2024-09-17T05:45:41.870 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:41.869+0000 7fee79e27640 1 -- 172.21.15.150:0/3220613339 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) -- 0x7fee740af1f0 con 0x7fee740b7960 2024-09-17T05:45:41.873 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:41.872+0000 7fee5bfff640 1 -- 172.21.15.150:0/3220613339 <== mon.0 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v13) ==== 190+0+147 (secure 0 0 0) 0x7fee68063280 con 0x7fee740b7960 2024-09-17T05:45:41.873 INFO:teuthology.orchestra.run.smithi150.stdout:[client.0] 2024-09-17T05:45:41.873 INFO:teuthology.orchestra.run.smithi150.stdout: key = AQBoFulmfF/1HBAAMezEjZDeoHTJ+uFfDXNWHQ== 2024-09-17T05:45:41.873 INFO:teuthology.orchestra.run.smithi150.stdout: caps mds = "allow" 2024-09-17T05:45:41.873 INFO:teuthology.orchestra.run.smithi150.stdout: caps mon = "allow r" 2024-09-17T05:45:41.873 INFO:teuthology.orchestra.run.smithi150.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2024-09-17T05:45:41.874 INFO:teuthology.orchestra.run.smithi150.stderr:updated caps for client.0 2024-09-17T05:45:41.876 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:41.874+0000 7fee79e27640 1 -- 172.21.15.150:0/3220613339 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fee60079490 msgr2=0x7fee6007b9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:45:41.876 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:41.874+0000 7fee79e27640 1 --2- 172.21.15.150:0/3220613339 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fee60079490 0x7fee6007b9a0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7fee64034000 tx=0x7fee64004730 comp rx=0 tx=0).stop 2024-09-17T05:45:41.876 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:41.874+0000 7fee79e27640 1 -- 172.21.15.150:0/3220613339 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fee740b7960 msgr2=0x7fee7415e090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:45:41.876 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:41.874+0000 7fee79e27640 1 --2- 172.21.15.150:0/3220613339 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fee740b7960 0x7fee7415e090 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7fee6800c970 tx=0x7fee6800ce30 comp rx=0 tx=0).stop 2024-09-17T05:45:41.876 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:41.874+0000 7fee79e27640 1 -- 172.21.15.150:0/3220613339 shutdown_connections 2024-09-17T05:45:41.876 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:41.874+0000 7fee79e27640 1 --2- 172.21.15.150:0/3220613339 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fee740b7d70 0x7fee7415a4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:41.876 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:41.874+0000 7fee79e27640 1 --2- 172.21.15.150:0/3220613339 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fee60079490 0x7fee6007b9a0 secure :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7fee64034000 tx=0x7fee64004730 comp rx=0 tx=0).stop 2024-09-17T05:45:41.876 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:41.874+0000 7fee79e27640 1 --2- 172.21.15.150:0/3220613339 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fee740b7960 0x7fee7415e090 unknown :-1 s=CLOSED pgs=649 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:41.876 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:41.874+0000 7fee79e27640 1 --2- 172.21.15.150:0/3220613339 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fee740af730 0x7fee74144140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:41.877 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:41.874+0000 7fee79e27640 1 -- 172.21.15.150:0/3220613339 >> 172.21.15.150:0/3220613339 conn(0x7fee740cef20 msgr2=0x7fee74071310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:45:41.877 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:41.874+0000 7fee79e27640 1 -- 172.21.15.150:0/3220613339 shutdown_connections 2024-09-17T05:45:41.877 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:41.874+0000 7fee79e27640 1 -- 172.21.15.150:0/3220613339 wait complete. 2024-09-17T05:45:41.887 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T05:45:42.002 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:42.000+0000 7f6dec20a640 1 -- 172.21.15.150:0/653916578 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6de40cd440 msgr2=0x7f6de40cd850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:45:42.002 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:42.000+0000 7f6dec20a640 1 --2- 172.21.15.150:0/653916578 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6de40cd440 0x7f6de40cd850 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7f6de40b84c0 tx=0x7f6dd402a560 comp rx=0 tx=0).stop 2024-09-17T05:45:42.002 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:42.000+0000 7f6dec20a640 1 -- 172.21.15.150:0/653916578 shutdown_connections 2024-09-17T05:45:42.002 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:42.000+0000 7f6dec20a640 1 --2- 172.21.15.150:0/653916578 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6de40cd440 0x7f6de40cd850 unknown :-1 s=CLOSED pgs=650 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:42.002 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:42.000+0000 7f6dec20a640 1 --2- 172.21.15.150:0/653916578 >> v2:172.21.15.176:3300/0 conn(0x7f6de409ba60 0x7f6de40b7330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:42.002 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:42.000+0000 7f6dec20a640 1 -- 172.21.15.150:0/653916578 >> 172.21.15.150:0/653916578 conn(0x7f6de40cee90 msgr2=0x7f6de40cf2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:45:42.002 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:42.000+0000 7f6dec20a640 1 -- 172.21.15.150:0/653916578 shutdown_connections 2024-09-17T05:45:42.002 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:42.000+0000 7f6dec20a640 1 -- 172.21.15.150:0/653916578 wait complete. 2024-09-17T05:45:42.003 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:42.002+0000 7f6dec20a640 1 Processor -- start 2024-09-17T05:45:42.003 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:42.002+0000 7f6dec20a640 1 -- start start 2024-09-17T05:45:42.006 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:42.003+0000 7f6dec20a640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6de409ba60 0x7f6de41f4670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:45:42.006 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:42.003+0000 7f6dec20a640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6de40cd440 0x7f6de41f4e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:45:42.006 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:42.003+0000 7f6dec20a640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6de40cffe0 0x7f6de415ce40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:45:42.006 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:42.003+0000 7f6dec20a640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f6de40d0ed0 con 0x7f6de40cd440 2024-09-17T05:45:42.006 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:42.003+0000 7f6dec20a640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f6de40d0d50 con 0x7f6de409ba60 2024-09-17T05:45:42.006 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:42.003+0000 7f6dec20a640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f6de40d1570 con 0x7f6de40cffe0 2024-09-17T05:45:42.006 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:42.003+0000 7f6de97a5640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6de40cd440 0x7f6de41f4e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:45:42.006 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:42.003+0000 7f6de97a5640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6de40cd440 0x7f6de41f4e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:38160/0 (socket says 172.21.15.150:38160) 2024-09-17T05:45:42.006 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:42.003+0000 7f6de97a5640 1 -- 172.21.15.150:0/1686836356 learned_addr learned my addr 172.21.15.150:0/1686836356 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:45:42.006 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:42.003+0000 7f6de9fa6640 1 --2- 172.21.15.150:0/1686836356 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6de409ba60 0x7f6de41f4670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:45:42.006 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:42.003+0000 7f6dea7a7640 1 --2- 172.21.15.150:0/1686836356 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6de40cffe0 0x7f6de415ce40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:45:42.007 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:42.003+0000 7f6de97a5640 1 -- 172.21.15.150:0/1686836356 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6de40cffe0 msgr2=0x7f6de415ce40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:45:42.007 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:42.003+0000 7f6de97a5640 1 --2- 172.21.15.150:0/1686836356 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6de40cffe0 0x7f6de415ce40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:42.007 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:42.003+0000 7f6de97a5640 1 -- 172.21.15.150:0/1686836356 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6de409ba60 msgr2=0x7f6de41f4670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:45:42.007 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:42.003+0000 7f6de97a5640 1 --2- 172.21.15.150:0/1686836356 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6de409ba60 0x7f6de41f4670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:42.007 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:42.003+0000 7f6de97a5640 1 -- 172.21.15.150:0/1686836356 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6de41f4bb0 con 0x7f6de40cd440 2024-09-17T05:45:42.007 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:42.003+0000 7f6de9fa6640 1 --2- 172.21.15.150:0/1686836356 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6de409ba60 0x7f6de41f4670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:45:42.007 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:42.004+0000 7f6de97a5640 1 --2- 172.21.15.150:0/1686836356 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6de40cd440 0x7f6de41f4e00 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7f6dd4034040 tx=0x7f6dd4003910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:45:42.007 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:42.004+0000 7f6dda7fc640 1 -- 172.21.15.150:0/1686836356 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6dd403e030 con 0x7f6de40cd440 2024-09-17T05:45:42.007 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:42.004+0000 7f6dda7fc640 1 -- 172.21.15.150:0/1686836356 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f6dd4003e00 con 0x7f6de40cd440 2024-09-17T05:45:42.007 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:42.004+0000 7f6dec20a640 1 -- 172.21.15.150:0/1686836356 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6de4160290 con 0x7f6de40cd440 2024-09-17T05:45:42.007 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:42.004+0000 7f6dda7fc640 1 -- 172.21.15.150:0/1686836356 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6dd4035040 con 0x7f6de40cd440 2024-09-17T05:45:42.007 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:42.004+0000 7f6dec20a640 1 -- 172.21.15.150:0/1686836356 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6de415f8b0 con 0x7f6de40cd440 2024-09-17T05:45:42.008 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:42.005+0000 7f6dec20a640 1 -- 172.21.15.150:0/1686836356 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6de40b7330 con 0x7f6de40cd440 2024-09-17T05:45:42.008 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:42.006+0000 7f6dda7fc640 1 -- 172.21.15.150:0/1686836356 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 15) ==== 102257+0+0 (secure 0 0 0) 0x7f6dd4041030 con 0x7f6de40cd440 2024-09-17T05:45:42.008 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:42.006+0000 7f6dda7fc640 1 --2- 172.21.15.150:0/1686836356 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f6dc8079490 0x7f6dc807b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:45:42.008 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:42.006+0000 7f6dda7fc640 1 -- 172.21.15.150:0/1686836356 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(60..60 src has 1..60) ==== 5737+0+0 (secure 0 0 0) 0x7f6dd40b9de0 con 0x7f6de40cd440 2024-09-17T05:45:42.008 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:42.007+0000 7f6de9fa6640 1 --2- 172.21.15.150:0/1686836356 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f6dc8079490 0x7f6dc807b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:45:42.009 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:42.007+0000 7f6de9fa6640 1 --2- 172.21.15.150:0/1686836356 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f6dc8079490 0x7f6dc807b9a0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f6de000bbb0 tx=0x7f6de0005ec0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:45:42.013 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:42.011+0000 7f6dda7fc640 1 -- 172.21.15.150:0/1686836356 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f6dd4083ce0 con 0x7f6de40cd440 2024-09-17T05:45:42.222 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:42.221+0000 7f6dec20a640 1 -- 172.21.15.150:0/1686836356 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f6de41606d0 con 0x7f6de40cd440 2024-09-17T05:45:42.223 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:42.221+0000 7f6dda7fc640 1 -- 172.21.15.150:0/1686836356 <== mon.0 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 33 v33) ==== 94+0+5235 (secure 0 0 0) 0x7f6dd40835e0 con 0x7f6de40cd440 2024-09-17T05:45:42.223 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-09-17T05:45:42.223 INFO:teuthology.orchestra.run.smithi150.stdout:{"epoch":33,"btime":"2024-09-17T05:45:35:644540+0000","default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5692,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6836/2204030245","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6834","nonce":2204030245},{"type":"v1","addr":"172.21.15.176:6836","nonce":2204030245}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":29},{"gid":5695,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6837/4065519712","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6835","nonce":4065519712},{"type":"v1","addr":"172.21.15.176:6837","nonce":4065519712}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":29},{"gid":6006,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6834/3602763503","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6832","nonce":3602763503},{"type":"v1","addr":"172.21.15.150:6834","nonce":3602763503}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":29}],"filesystems":[{"mdsmap":{"epoch":33,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T05:45:31.989014+0000","modified":"2024-09-17T05:45:35.004451+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6009},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6009":{"gid":6009,"name":"a","rank":0,"incarnation":30,"state":"up:active","state_seq":3,"addr":"172.21.15.150:6835/3434025708","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6833","nonce":3434025708},{"type":"v1","addr":"172.21.15.150:6835","nonce":3434025708}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6009,"qdb_cluster":[6009]},"id":4}]} 2024-09-17T05:45:42.223 INFO:teuthology.orchestra.run.smithi150.stderr:dumped fsmap epoch 33 2024-09-17T05:45:42.225 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:42.223+0000 7f6dec20a640 1 -- 172.21.15.150:0/1686836356 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f6dc8079490 msgr2=0x7f6dc807b9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:45:42.226 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:42.223+0000 7f6dec20a640 1 --2- 172.21.15.150:0/1686836356 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f6dc8079490 0x7f6dc807b9a0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f6de000bbb0 tx=0x7f6de0005ec0 comp rx=0 tx=0).stop 2024-09-17T05:45:42.226 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:42.223+0000 7f6dec20a640 1 -- 172.21.15.150:0/1686836356 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6de40cd440 msgr2=0x7f6de41f4e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:45:42.226 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:42.223+0000 7f6dec20a640 1 --2- 172.21.15.150:0/1686836356 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6de40cd440 0x7f6de41f4e00 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7f6dd4034040 tx=0x7f6dd4003910 comp rx=0 tx=0).stop 2024-09-17T05:45:42.226 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:42.223+0000 7f6dec20a640 1 -- 172.21.15.150:0/1686836356 shutdown_connections 2024-09-17T05:45:42.226 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:42.223+0000 7f6dec20a640 1 --2- 172.21.15.150:0/1686836356 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f6dc8079490 0x7f6dc807b9a0 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:42.226 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:42.223+0000 7f6dec20a640 1 --2- 172.21.15.150:0/1686836356 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6de40cffe0 0x7f6de415ce40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:42.226 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:42.223+0000 7f6dec20a640 1 --2- 172.21.15.150:0/1686836356 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6de40cd440 0x7f6de41f4e00 unknown :-1 s=CLOSED pgs=651 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:42.226 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:42.223+0000 7f6dec20a640 1 --2- 172.21.15.150:0/1686836356 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6de409ba60 0x7f6de41f4670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:42.226 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:42.223+0000 7f6dec20a640 1 -- 172.21.15.150:0/1686836356 >> 172.21.15.150:0/1686836356 conn(0x7f6de40cee90 msgr2=0x7f6de415d810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:45:42.226 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:42.223+0000 7f6dec20a640 1 -- 172.21.15.150:0/1686836356 shutdown_connections 2024-09-17T05:45:42.226 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:42.223+0000 7f6dec20a640 1 -- 172.21.15.150:0/1686836356 wait complete. 2024-09-17T05:45:42.639 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 33, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-17T05:45:31.989014+0000', 'modified': '2024-09-17T05:45:35.004451+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 6009}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_6009': {'gid': 6009, 'name': 'a', 'rank': 0, 'incarnation': 30, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.150:6835/3434025708', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.150:6833', 'nonce': 3434025708}, {'type': 'v1', 'addr': '172.21.15.150:6835', 'nonce': 3434025708}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [9], 'metadata_pool': 8, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 6009, 'qdb_cluster': [6009]} 2024-09-17T05:45:42.640 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-17T05:45:42.640 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2024-09-17T05:45:42.757 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:42.755+0000 7f3859d32640 1 -- 172.21.15.150:0/2692776682 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f383c005250 msgr2=0x7f383c00b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:45:42.757 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:42.755+0000 7f3859d32640 1 --2- 172.21.15.150:0/2692776682 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f383c005250 0x7f383c00b9c0 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7f384c001d90 tx=0x7f383c005830 comp rx=0 tx=0).stop 2024-09-17T05:45:42.757 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:42.755+0000 7f3859d32640 1 -- 172.21.15.150:0/2692776682 shutdown_connections 2024-09-17T05:45:42.757 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:42.755+0000 7f3859d32640 1 --2- 172.21.15.150:0/2692776682 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f383c005250 0x7f383c00b9c0 unknown :-1 s=CLOSED pgs=653 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:42.757 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:42.755+0000 7f3859d32640 1 -- 172.21.15.150:0/2692776682 >> 172.21.15.150:0/2692776682 conn(0x7f38540cef80 msgr2=0x7f38540cf390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:45:42.757 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:42.755+0000 7f3859d32640 1 -- 172.21.15.150:0/2692776682 shutdown_connections 2024-09-17T05:45:42.757 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:42.755+0000 7f3859d32640 1 -- 172.21.15.150:0/2692776682 wait complete. 2024-09-17T05:45:42.758 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:42.757+0000 7f3859d32640 1 Processor -- start 2024-09-17T05:45:42.758 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:42.757+0000 7f3859d32640 1 -- start start 2024-09-17T05:45:42.761 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:42.758+0000 7f3859d32640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f383c005250 0x7f38541db9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:45:42.761 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:42.758+0000 7f3859d32640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f38541df1d0 0x7f38540b0590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:45:42.761 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:42.758+0000 7f3859d32640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f38540b0ad0 0x7f38541e1c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:45:42.762 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:42.758+0000 7f3859d32640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f38540b1da0 con 0x7f38540b0ad0 2024-09-17T05:45:42.762 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:42.758+0000 7f3859d32640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f38540d0570 con 0x7f38541df1d0 2024-09-17T05:45:42.762 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:42.758+0000 7f3859d32640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f38540b1f20 con 0x7f383c005250 2024-09-17T05:45:42.762 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:42.758+0000 7f3853fff640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f38540b0ad0 0x7f38541e1c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:45:42.762 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:42.758+0000 7f3853fff640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f38540b0ad0 0x7f38541e1c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:38186/0 (socket says 172.21.15.150:38186) 2024-09-17T05:45:42.762 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:42.758+0000 7f3853fff640 1 -- 172.21.15.150:0/4060186968 learned_addr learned my addr 172.21.15.150:0/4060186968 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:45:42.762 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:42.759+0000 7f38537fe640 1 --2- 172.21.15.150:0/4060186968 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f383c005250 0x7f38541db9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:45:42.762 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:42.759+0000 7f3852ffd640 1 --2- 172.21.15.150:0/4060186968 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f38541df1d0 0x7f38540b0590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:45:42.762 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:42.759+0000 7f3853fff640 1 -- 172.21.15.150:0/4060186968 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f383c005250 msgr2=0x7f38541db9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:45:42.762 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:42.759+0000 7f3853fff640 1 --2- 172.21.15.150:0/4060186968 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f383c005250 0x7f38541db9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:42.762 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:42.759+0000 7f3853fff640 1 -- 172.21.15.150:0/4060186968 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f38541df1d0 msgr2=0x7f38540b0590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:45:42.762 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:42.759+0000 7f3853fff640 1 --2- 172.21.15.150:0/4060186968 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f38541df1d0 0x7f38540b0590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:42.762 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:42.759+0000 7f3853fff640 1 -- 172.21.15.150:0/4060186968 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f38540b0ee0 con 0x7f38540b0ad0 2024-09-17T05:45:42.763 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:42.759+0000 7f38537fe640 1 --2- 172.21.15.150:0/4060186968 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f383c005250 0x7f38541db9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:45:42.763 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:42.759+0000 7f3852ffd640 1 --2- 172.21.15.150:0/4060186968 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f38541df1d0 0x7f38540b0590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:45:42.763 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:42.759+0000 7f3853fff640 1 --2- 172.21.15.150:0/4060186968 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f38540b0ad0 0x7f38541e1c20 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7f384c001370 tx=0x7f384c006d40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:45:42.763 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:42.759+0000 7f383bfff640 1 -- 172.21.15.150:0/4060186968 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f384c003d80 con 0x7f38540b0ad0 2024-09-17T05:45:42.763 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:42.759+0000 7f383bfff640 1 -- 172.21.15.150:0/4060186968 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f384c005b80 con 0x7f38540b0ad0 2024-09-17T05:45:42.763 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:42.759+0000 7f3859d32640 1 -- 172.21.15.150:0/4060186968 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f38541deaf0 con 0x7f38540b0ad0 2024-09-17T05:45:42.763 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:42.759+0000 7f383bfff640 1 -- 172.21.15.150:0/4060186968 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f384c005fd0 con 0x7f38540b0ad0 2024-09-17T05:45:42.763 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:42.759+0000 7f3859d32640 1 -- 172.21.15.150:0/4060186968 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f38541f9410 con 0x7f38540b0ad0 2024-09-17T05:45:42.764 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:42.761+0000 7f383bfff640 1 -- 172.21.15.150:0/4060186968 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 15) ==== 102257+0+0 (secure 0 0 0) 0x7f384c0050d0 con 0x7f38540b0ad0 2024-09-17T05:45:42.764 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:42.761+0000 7f383bfff640 1 --2- 172.21.15.150:0/4060186968 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f3840079490 0x7f384007b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:45:42.764 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:42.761+0000 7f383bfff640 1 -- 172.21.15.150:0/4060186968 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(60..60 src has 1..60) ==== 5737+0+0 (secure 0 0 0) 0x7f384c0b9810 con 0x7f38540b0ad0 2024-09-17T05:45:42.764 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:42.762+0000 7f38537fe640 1 --2- 172.21.15.150:0/4060186968 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f3840079490 0x7f384007b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:45:42.764 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:42.762+0000 7f38537fe640 1 --2- 172.21.15.150:0/4060186968 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f3840079490 0x7f384007b9a0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f3844009bc0 tx=0x7f3844005f30 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:45:42.764 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:42.762+0000 7f3860ca0740 1 Processor -- start 2024-09-17T05:45:42.765 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:42.762+0000 7f3860ca0740 1 -- start start 2024-09-17T05:45:42.766 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:42.764+0000 7f3860ca0740 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55742260d270 0x5574229defa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:45:42.766 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:42.764+0000 7f3860ca0740 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5574225e43b0 0x5574229df4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:45:42.766 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:42.764+0000 7f3860ca0740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5574225ec590 0x5574229fc3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:45:42.767 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:42.764+0000 7f3860ca0740 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x557422927820 con 0x5574225e43b0 2024-09-17T05:45:42.767 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:42.764+0000 7f3860ca0740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x557422916c50 con 0x5574225ec590 2024-09-17T05:45:42.767 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:42.764+0000 7f3860ca0740 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x55742291aa60 con 0x55742260d270 2024-09-17T05:45:42.767 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:42.764+0000 7f3852ffd640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5574225e43b0 0x5574229df4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:45:42.767 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:42.764+0000 7f3852ffd640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5574225e43b0 0x5574229df4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:38194/0 (socket says 172.21.15.150:38194) 2024-09-17T05:45:42.767 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:42.764+0000 7f3852ffd640 1 -- 172.21.15.150:0/438201655 learned_addr learned my addr 172.21.15.150:0/438201655 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:45:42.767 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:42.764+0000 7f38537fe640 1 --2- 172.21.15.150:0/438201655 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55742260d270 0x5574229defa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:45:42.767 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:42.764+0000 7f3853fff640 1 --2- 172.21.15.150:0/438201655 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5574225ec590 0x5574229fc3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:45:42.767 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:42.764+0000 7f3852ffd640 1 -- 172.21.15.150:0/438201655 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55742260d270 msgr2=0x5574229defa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:45:42.767 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:42.764+0000 7f3852ffd640 1 --2- 172.21.15.150:0/438201655 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55742260d270 0x5574229defa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:42.767 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:42.764+0000 7f3852ffd640 1 -- 172.21.15.150:0/438201655 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5574225ec590 msgr2=0x5574229fc3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:45:42.767 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:42.764+0000 7f3852ffd640 1 --2- 172.21.15.150:0/438201655 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5574225ec590 0x5574229fc3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:42.768 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:42.764+0000 7f3852ffd640 1 -- 172.21.15.150:0/438201655 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557422678850 con 0x5574225e43b0 2024-09-17T05:45:42.768 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:42.764+0000 7f3852ffd640 1 --2- 172.21.15.150:0/438201655 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5574225e43b0 0x5574229df4e0 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7f38480049e0 tx=0x7f3848004ea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1b21ab05123f5bed server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:45:42.768 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:42.765+0000 7f38397fa640 1 -- 172.21.15.150:0/438201655 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3848010af0 con 0x5574225e43b0 2024-09-17T05:45:42.768 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:42.765+0000 7f38397fa640 1 -- 172.21.15.150:0/438201655 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f3848017020 con 0x5574225e43b0 2024-09-17T05:45:42.768 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:42.765+0000 7f38397fa640 1 -- 172.21.15.150:0/438201655 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3848004030 con 0x5574225e43b0 2024-09-17T05:45:42.769 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:42.765+0000 7f3860ca0740 1 -- 172.21.15.150:0/438201655 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5574225e43b0 msgr2=0x5574229df4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:45:42.769 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:42.765+0000 7f3860ca0740 1 --2- 172.21.15.150:0/438201655 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5574225e43b0 0x5574229df4e0 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7f38480049e0 tx=0x7f3848004ea0 comp rx=0 tx=0).stop 2024-09-17T05:45:42.769 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:42.766+0000 7f3860ca0740 1 -- 172.21.15.150:0/438201655 shutdown_connections 2024-09-17T05:45:42.769 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:42.766+0000 7f3860ca0740 1 --2- 172.21.15.150:0/438201655 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5574225ec590 0x5574229fc3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:42.769 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:42.766+0000 7f3860ca0740 1 --2- 172.21.15.150:0/438201655 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5574225e43b0 0x5574229df4e0 unknown :-1 s=CLOSED pgs=655 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:42.769 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:42.766+0000 7f3860ca0740 1 --2- 172.21.15.150:0/438201655 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55742260d270 0x5574229defa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:42.769 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:42.766+0000 7f3860ca0740 1 -- 172.21.15.150:0/438201655 >> 172.21.15.150:0/438201655 conn(0x5574226013c0 msgr2=0x5574229b5260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:45:42.769 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:42.766+0000 7f3860ca0740 1 -- 172.21.15.150:0/438201655 shutdown_connections 2024-09-17T05:45:42.770 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:42.766+0000 7f3860ca0740 1 -- 172.21.15.150:0/438201655 wait complete. 2024-09-17T05:45:42.770 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:42.766+0000 7f3860ca0740 1 -- start start 2024-09-17T05:45:42.770 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:42.767+0000 7f3860ca0740 1 Processor -- start 2024-09-17T05:45:42.774 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:42.768+0000 7f3860ca0740 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5574225e43b0 0x5574229f0b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:45:42.774 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:42.768+0000 7f3860ca0740 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x5574225ec590 0x557422a086a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:45:42.774 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:42.768+0000 7f3860ca0740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55742260d270 0x5574229fcf40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:45:42.774 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:42.768+0000 7f3860ca0740 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x557422687620 con 0x5574225e43b0 2024-09-17T05:45:42.774 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:42.768+0000 7f3860ca0740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x5574228bc5f0 con 0x55742260d270 2024-09-17T05:45:42.774 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:42.768+0000 7f3860ca0740 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x5574229dfa20 con 0x5574225ec590 2024-09-17T05:45:42.775 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:42.768+0000 7f3860ca0740 10 client.0 _ll_register_callbacks cb 0x5574228c00a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T05:45:42.775 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:42.768+0000 7f38537fe640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5574225e43b0 0x5574229f0b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:45:42.775 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:42.768+0000 7f38537fe640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5574225e43b0 0x5574229f0b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:38206/0 (socket says 172.21.15.150:38206) 2024-09-17T05:45:42.775 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:42.768+0000 7f38537fe640 1 -- 172.21.15.150:0/2435670122 learned_addr learned my addr 172.21.15.150:0/2435670122 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:45:42.775 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:42.768+0000 7f3853fff640 1 --2- 172.21.15.150:0/2435670122 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55742260d270 0x5574229fcf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:45:42.775 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:42.768+0000 7f3852ffd640 1 --2- 172.21.15.150:0/2435670122 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x5574225ec590 0x557422a086a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:45:42.775 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:42.768+0000 7f38537fe640 1 -- 172.21.15.150:0/2435670122 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x5574225ec590 msgr2=0x557422a086a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:45:42.775 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:42.768+0000 7f38537fe640 1 --2- 172.21.15.150:0/2435670122 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x5574225ec590 0x557422a086a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:42.775 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:42.768+0000 7f38537fe640 1 -- 172.21.15.150:0/2435670122 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55742260d270 msgr2=0x5574229fcf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:45:42.775 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:42.768+0000 7f38537fe640 1 --2- 172.21.15.150:0/2435670122 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55742260d270 0x5574229fcf40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:42.775 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:42.768+0000 7f38537fe640 1 -- 172.21.15.150:0/2435670122 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5574226ef6b0 con 0x5574225e43b0 2024-09-17T05:45:42.775 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:42.768+0000 7f3853fff640 1 --2- 172.21.15.150:0/2435670122 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55742260d270 0x5574229fcf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:45:42.775 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:42.768+0000 7f38537fe640 1 --2- 172.21.15.150:0/2435670122 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5574225e43b0 0x5574229f0b90 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7f384401d9c0 tx=0x7f3844004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=69c416c36a5653bf server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:45:42.776 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:42.768+0000 7f38327fc640 10 client.0 ms_handle_connect on v2:172.21.15.150:3300/0 2024-09-17T05:45:42.776 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:42.769+0000 7f38327fc640 1 -- 172.21.15.150:0/2435670122 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38440285d0 con 0x5574225e43b0 2024-09-17T05:45:42.776 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:42.769+0000 7f38327fc640 1 -- 172.21.15.150:0/2435670122 <== mon.0 v2:172.21.15.150:3300/0 2 ==== osd_map(60..60 src has 1..60) ==== 5737+0+0 (secure 0 0 0) 0x7f3844028770 con 0x5574225e43b0 2024-09-17T05:45:42.776 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:42.769+0000 7f3860ca0740 1 -- 172.21.15.150:0/2435670122 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3848017020 con 0x5574225e43b0 2024-09-17T05:45:42.776 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:42.769+0000 7f38327fc640 1 -- 172.21.15.150:0/2435670122 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7f3844036050 con 0x5574225e43b0 2024-09-17T05:45:42.776 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:42.769+0000 7f3860ca0740 10 client.6165 fetch_fsmap learned FSMap version 33 2024-09-17T05:45:42.776 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:42.769+0000 7f3860ca0740 1 -- 172.21.15.150:0/2435670122 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=2+}) -- 0x5574229f25a0 con 0x5574225e43b0 2024-09-17T05:45:42.776 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:42.769+0000 7f38327fc640 1 -- 172.21.15.150:0/2435670122 <== mon.0 v2:172.21.15.150:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f3848017020 con 0x5574225e43b0 2024-09-17T05:45:42.776 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:42.769+0000 7f38327fc640 1 -- 172.21.15.150:0/2435670122 <== mon.0 v2:172.21.15.150:3300/0 5 ==== fsmap(e 33) ==== 3502+0+0 (secure 0 0 0) 0x7f3844039020 con 0x5574225e43b0 2024-09-17T05:45:42.776 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:42.769+0000 7f3860ca0740 10 client.6165 fetch_fsmap finished waiting for FSMap version 33 2024-09-17T05:45:42.776 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:42.769+0000 7f3860ca0740 10 client.6165 resolve_mds: resolved name 'a' to daemon mds.a 2024-09-17T05:45:42.776 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:42.769+0000 7f3860ca0740 20 client.6165 populate_metadata read hostname 'smithi150' 2024-09-17T05:45:42.777 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:42.769+0000 7f3860ca0740 1 --2- 172.21.15.150:0/2435670122 >> [v2:172.21.15.150:6833/3434025708,v1:172.21.15.150:6835/3434025708] conn(0x5574225cbe40 0x557422a0c530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:45:42.777 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:42.769+0000 7f3860ca0740 4 client.6165 mds_command: new command op to 6009 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-17T05:45:42.777 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:42.769+0000 7f3860ca0740 1 -- 172.21.15.150:0/2435670122 --> [v2:172.21.15.150:6833/3434025708,v1:172.21.15.150:6835/3434025708] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x557422929770 con 0x5574225cbe40 2024-09-17T05:45:42.777 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:42.769+0000 7f3852ffd640 1 --2- 172.21.15.150:0/2435670122 >> [v2:172.21.15.150:6833/3434025708,v1:172.21.15.150:6835/3434025708] conn(0x5574225cbe40 0x557422a0c530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:45:42.777 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:42.770+0000 7f38327fc640 10 client.6165 ms_handle_connect on v2:172.21.15.150:6833/3434025708 2024-09-17T05:45:42.777 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:42.770+0000 7f3852ffd640 1 --2- 172.21.15.150:0/2435670122 >> [v2:172.21.15.150:6833/3434025708,v1:172.21.15.150:6835/3434025708] conn(0x5574225cbe40 0x557422a0c530 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=aa79b3f58e4ab70 server_cookie=c17d2f25fd5369f2 in_seq=0 out_seq=0 2024-09-17T05:45:42.777 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:42.770+0000 7f38327fc640 1 -- 172.21.15.150:0/2435670122 <== mds.0 v2:172.21.15.150:6833/3434025708 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x557422929770 con 0x5574225cbe40 2024-09-17T05:45:42.777 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:42.770+0000 7f38327fc640 10 client.6165 handle_command_reply: tid=0 2024-09-17T05:45:42.777 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:42.770+0000 7f3860ca0740 1 client.6165 shutdown 2024-09-17T05:45:42.777 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:42.771+0000 7f3860ca0740 1 -- 172.21.15.150:0/2435670122 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5574225e43b0 msgr2=0x5574229f0b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:45:42.777 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:42.771+0000 7f3860ca0740 1 --2- 172.21.15.150:0/2435670122 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5574225e43b0 0x5574229f0b90 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7f384401d9c0 tx=0x7f3844004730 comp rx=0 tx=0).stop 2024-09-17T05:45:42.777 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:42.771+0000 7f3860ca0740 1 -- 172.21.15.150:0/2435670122 shutdown_connections 2024-09-17T05:45:42.778 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:42.771+0000 7f3860ca0740 1 --2- 172.21.15.150:0/2435670122 >> [v2:172.21.15.150:6833/3434025708,v1:172.21.15.150:6835/3434025708] conn(0x5574225cbe40 0x557422a0c530 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:42.778 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:42.771+0000 7f3860ca0740 1 --2- 172.21.15.150:0/2435670122 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55742260d270 0x5574229fcf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:42.778 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:42.771+0000 7f38327fc640 0 client.6165 ms_handle_reset on v2:172.21.15.150:6833/3434025708 2024-09-17T05:45:42.778 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:42.771+0000 7f3860ca0740 1 --2- 172.21.15.150:0/2435670122 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x5574225ec590 0x557422a086a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:42.778 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:42.771+0000 7f3860ca0740 1 --2- 172.21.15.150:0/2435670122 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5574225e43b0 0x5574229f0b90 unknown :-1 s=CLOSED pgs=656 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:42.778 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:42.771+0000 7f3860ca0740 1 -- 172.21.15.150:0/2435670122 >> 172.21.15.150:0/2435670122 conn(0x5574226013c0 msgr2=0x5574229ce760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:45:42.778 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:42.771+0000 7f3860ca0740 1 -- 172.21.15.150:0/2435670122 shutdown_connections 2024-09-17T05:45:42.778 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:42.771+0000 7f3860ca0740 1 -- 172.21.15.150:0/2435670122 wait complete. 2024-09-17T05:45:42.778 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:42.771+0000 7f3860ca0740 20 client.6165 trim_cache size 0 max 16384 2024-09-17T05:45:42.791 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:42.789+0000 7f3860ca0740 1 Processor -- start 2024-09-17T05:45:42.791 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:42.789+0000 7f3860ca0740 1 -- start start 2024-09-17T05:45:42.794 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:42.790+0000 7f3860ca0740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5574225e43b0 0x5574229eff80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:45:42.794 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:42.790+0000 7f3860ca0740 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x5574225ec590 0x5574229b4020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:45:42.794 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:42.790+0000 7f3860ca0740 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55742260d270 0x5574229b4560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:45:42.794 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:42.790+0000 7f3860ca0740 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f38542018d0 con 0x55742260d270 2024-09-17T05:45:42.794 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:42.790+0000 7f3860ca0740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f38540cb160 con 0x5574225e43b0 2024-09-17T05:45:42.794 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:42.790+0000 7f3860ca0740 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f38541e2920 con 0x5574225ec590 2024-09-17T05:45:42.794 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:42.791+0000 7f3853fff640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55742260d270 0x5574229b4560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:45:42.794 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:42.791+0000 7f3853fff640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55742260d270 0x5574229b4560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:38212/0 (socket says 172.21.15.150:38212) 2024-09-17T05:45:42.794 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:42.791+0000 7f3853fff640 1 -- 172.21.15.150:0/3934862010 learned_addr learned my addr 172.21.15.150:0/3934862010 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:45:42.794 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:42.791+0000 7f3852ffd640 1 --2- 172.21.15.150:0/3934862010 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x5574225ec590 0x5574229b4020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:45:42.794 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:42.791+0000 7f38537fe640 1 --2- 172.21.15.150:0/3934862010 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5574225e43b0 0x5574229eff80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:45:42.795 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:42.791+0000 7f3853fff640 1 -- 172.21.15.150:0/3934862010 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x5574225ec590 msgr2=0x5574229b4020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:45:42.795 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:42.791+0000 7f3853fff640 1 --2- 172.21.15.150:0/3934862010 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x5574225ec590 0x5574229b4020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:42.795 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:42.791+0000 7f3853fff640 1 -- 172.21.15.150:0/3934862010 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5574225e43b0 msgr2=0x5574229eff80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:45:42.795 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:42.791+0000 7f3853fff640 1 --2- 172.21.15.150:0/3934862010 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5574225e43b0 0x5574229eff80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:42.795 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:42.791+0000 7f3853fff640 1 -- 172.21.15.150:0/3934862010 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5574229d9060 con 0x55742260d270 2024-09-17T05:45:42.795 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:42.791+0000 7f38537fe640 1 --2- 172.21.15.150:0/3934862010 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5574225e43b0 0x5574229eff80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T05:45:42.795 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:42.791+0000 7f3853fff640 1 --2- 172.21.15.150:0/3934862010 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55742260d270 0x5574229b4560 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7f384c001d90 tx=0x7f384c02ab90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3162be9dce16a9a1 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:45:42.795 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:42.791+0000 7f3838ff9640 1 -- 172.21.15.150:0/3934862010 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f384c082b20 con 0x55742260d270 2024-09-17T05:45:42.795 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:42.791+0000 7f3838ff9640 1 -- 172.21.15.150:0/3934862010 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f384c083710 con 0x55742260d270 2024-09-17T05:45:42.795 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:42.791+0000 7f3838ff9640 1 -- 172.21.15.150:0/3934862010 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f384c0824d0 con 0x55742260d270 2024-09-17T05:45:42.795 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:42.792+0000 7f3860ca0740 1 -- 172.21.15.150:0/3934862010 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55742260d270 msgr2=0x5574229b4560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:45:42.795 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:42.792+0000 7f3860ca0740 1 --2- 172.21.15.150:0/3934862010 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55742260d270 0x5574229b4560 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7f384c001d90 tx=0x7f384c02ab90 comp rx=0 tx=0).stop 2024-09-17T05:45:42.796 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:42.792+0000 7f3860ca0740 1 -- 172.21.15.150:0/3934862010 shutdown_connections 2024-09-17T05:45:42.796 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:42.792+0000 7f3860ca0740 1 --2- 172.21.15.150:0/3934862010 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55742260d270 0x5574229b4560 unknown :-1 s=CLOSED pgs=657 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:42.796 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:42.792+0000 7f3860ca0740 1 --2- 172.21.15.150:0/3934862010 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x5574225ec590 0x5574229b4020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:42.796 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:42.792+0000 7f3860ca0740 1 --2- 172.21.15.150:0/3934862010 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5574225e43b0 0x5574229eff80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:42.796 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:42.792+0000 7f3860ca0740 1 -- 172.21.15.150:0/3934862010 >> 172.21.15.150:0/3934862010 conn(0x5574226013c0 msgr2=0x5574229df490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:45:42.796 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:42.792+0000 7f3860ca0740 1 -- 172.21.15.150:0/3934862010 shutdown_connections 2024-09-17T05:45:42.796 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:42.792+0000 7f3860ca0740 1 -- 172.21.15.150:0/3934862010 wait complete. 2024-09-17T05:45:42.800 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:42.793+0000 7f3860ca0740 1 -- start start 2024-09-17T05:45:42.800 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:42.793+0000 7f3860ca0740 1 Processor -- start 2024-09-17T05:45:42.800 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:42.794+0000 7f3860ca0740 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x5574225e43b0 0x5574229d6960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:45:42.800 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:42.794+0000 7f3860ca0740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5574225ec590 0x557422a6fcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:45:42.800 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:42.794+0000 7f3860ca0740 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55742260d270 0x5574229b4000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:45:42.800 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:42.794+0000 7f3860ca0740 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x5574229dc6e0 con 0x55742260d270 2024-09-17T05:45:42.800 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:42.794+0000 7f3860ca0740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x5574229f2300 con 0x5574225ec590 2024-09-17T05:45:42.801 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:42.794+0000 7f3860ca0740 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x5574229cd0f0 con 0x5574225e43b0 2024-09-17T05:45:42.801 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:42.794+0000 7f3860ca0740 10 client.0 _ll_register_callbacks cb 0x7f3844012c50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T05:45:42.801 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:42.794+0000 7f3853fff640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55742260d270 0x5574229b4000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:45:42.801 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:42.795+0000 7f3853fff640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55742260d270 0x5574229b4000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:38214/0 (socket says 172.21.15.150:38214) 2024-09-17T05:45:42.801 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:42.795+0000 7f3853fff640 1 -- 172.21.15.150:0/602522816 learned_addr learned my addr 172.21.15.150:0/602522816 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:45:42.801 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:42.795+0000 7f3852ffd640 1 --2- 172.21.15.150:0/602522816 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5574225ec590 0x557422a6fcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:45:42.801 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:42.795+0000 7f38537fe640 1 --2- 172.21.15.150:0/602522816 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x5574225e43b0 0x5574229d6960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:45:42.801 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:42.795+0000 7f3853fff640 1 -- 172.21.15.150:0/602522816 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x5574225e43b0 msgr2=0x5574229d6960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:45:42.801 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:42.795+0000 7f3853fff640 1 --2- 172.21.15.150:0/602522816 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x5574225e43b0 0x5574229d6960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:42.801 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:42.795+0000 7f3853fff640 1 -- 172.21.15.150:0/602522816 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5574225ec590 msgr2=0x557422a6fcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:45:42.801 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:42.795+0000 7f3853fff640 1 --2- 172.21.15.150:0/602522816 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5574225ec590 0x557422a6fcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:42.801 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:42.795+0000 7f3853fff640 1 -- 172.21.15.150:0/602522816 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5574229ae450 con 0x55742260d270 2024-09-17T05:45:42.801 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:42.795+0000 7f3853fff640 1 --2- 172.21.15.150:0/602522816 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55742260d270 0x5574229b4000 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7f384c001d90 tx=0x7f384c082500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c86e6f5272e6c36e server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:45:42.802 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:42.795+0000 7f38327fc640 10 client.0 ms_handle_connect on v2:172.21.15.150:3300/0 2024-09-17T05:45:42.802 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:42.795+0000 7f38327fc640 1 -- 172.21.15.150:0/602522816 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f384c0a2060 con 0x55742260d270 2024-09-17T05:45:42.802 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:42.795+0000 7f38327fc640 1 -- 172.21.15.150:0/602522816 <== mon.0 v2:172.21.15.150:3300/0 2 ==== osd_map(60..60 src has 1..60) ==== 5737+0+0 (secure 0 0 0) 0x7f384c09d260 con 0x55742260d270 2024-09-17T05:45:42.802 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:42.795+0000 7f3860ca0740 1 -- 172.21.15.150:0/602522816 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f384c083710 con 0x55742260d270 2024-09-17T05:45:42.802 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:42.795+0000 7f38327fc640 1 -- 172.21.15.150:0/602522816 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7f384c091050 con 0x55742260d270 2024-09-17T05:45:42.802 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:42.795+0000 7f3860ca0740 10 client.6171 fetch_fsmap learned FSMap version 33 2024-09-17T05:45:42.802 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:42.795+0000 7f3860ca0740 1 -- 172.21.15.150:0/602522816 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=2+}) -- 0x557422a7d660 con 0x55742260d270 2024-09-17T05:45:42.802 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:42.795+0000 7f38327fc640 1 -- 172.21.15.150:0/602522816 <== mon.0 v2:172.21.15.150:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f384c083710 con 0x55742260d270 2024-09-17T05:45:42.802 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:42.795+0000 7f38327fc640 1 -- 172.21.15.150:0/602522816 <== mon.0 v2:172.21.15.150:3300/0 5 ==== fsmap(e 33) ==== 3502+0+0 (secure 0 0 0) 0x7f384c094020 con 0x55742260d270 2024-09-17T05:45:42.802 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:42.795+0000 7f3860ca0740 10 client.6171 fetch_fsmap finished waiting for FSMap version 33 2024-09-17T05:45:42.802 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:42.795+0000 7f3860ca0740 10 client.6171 resolve_mds: resolved name 'a' to daemon mds.a 2024-09-17T05:45:42.802 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:42.795+0000 7f3860ca0740 20 client.6171 populate_metadata read hostname 'smithi150' 2024-09-17T05:45:42.802 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:42.796+0000 7f3860ca0740 1 --2- 172.21.15.150:0/602522816 >> [v2:172.21.15.150:6833/3434025708,v1:172.21.15.150:6835/3434025708] conn(0x557422a7ca70 0x557422a7ce80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:45:42.802 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:42.796+0000 7f3860ca0740 4 client.6171 mds_command: new command op to 6009 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-17T05:45:42.803 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:42.796+0000 7f3860ca0740 1 -- 172.21.15.150:0/602522816 --> [v2:172.21.15.150:6833/3434025708,v1:172.21.15.150:6835/3434025708] -- command(tid 0: {"prefix": "status"}) -- 0x557422925220 con 0x557422a7ca70 2024-09-17T05:45:42.803 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:42.796+0000 7f38537fe640 1 --2- 172.21.15.150:0/602522816 >> [v2:172.21.15.150:6833/3434025708,v1:172.21.15.150:6835/3434025708] conn(0x557422a7ca70 0x557422a7ce80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:45:42.803 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:42.796+0000 7f38327fc640 10 client.6171 ms_handle_connect on v2:172.21.15.150:6833/3434025708 2024-09-17T05:45:42.803 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:42.796+0000 7f38537fe640 1 --2- 172.21.15.150:0/602522816 >> [v2:172.21.15.150:6833/3434025708,v1:172.21.15.150:6835/3434025708] conn(0x557422a7ca70 0x557422a7ce80 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ce1a5b51905c7df5 server_cookie=589a593498450828 in_seq=0 out_seq=0 2024-09-17T05:45:42.803 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:42.796+0000 7f38327fc640 1 -- 172.21.15.150:0/602522816 <== mds.0 v2:172.21.15.150:6833/3434025708 1 ==== command_reply(tid 0: 0 ) ==== 8+0+325 (crc 0 0 0) 0x557422925220 con 0x557422a7ca70 2024-09-17T05:45:42.803 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:42.796+0000 7f38327fc640 10 client.6171 handle_command_reply: tid=0 2024-09-17T05:45:42.803 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:42.796+0000 7f3860ca0740 1 client.6171 shutdown 2024-09-17T05:45:42.803 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:42.796+0000 7f3860ca0740 1 -- 172.21.15.150:0/602522816 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55742260d270 msgr2=0x5574229b4000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:45:42.803 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:42.796+0000 7f3860ca0740 1 --2- 172.21.15.150:0/602522816 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55742260d270 0x5574229b4000 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7f384c001d90 tx=0x7f384c082500 comp rx=0 tx=0).stop 2024-09-17T05:45:42.803 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:42.796+0000 7f3860ca0740 1 -- 172.21.15.150:0/602522816 shutdown_connections 2024-09-17T05:45:42.803 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:42.796+0000 7f3860ca0740 1 --2- 172.21.15.150:0/602522816 >> [v2:172.21.15.150:6833/3434025708,v1:172.21.15.150:6835/3434025708] conn(0x557422a7ca70 0x557422a7ce80 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:42.803 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:42.796+0000 7f3860ca0740 1 --2- 172.21.15.150:0/602522816 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5574225ec590 0x557422a6fcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:42.803 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:42.796+0000 7f38327fc640 0 client.6171 ms_handle_reset on v2:172.21.15.150:6833/3434025708 2024-09-17T05:45:42.804 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:42.796+0000 7f3860ca0740 1 --2- 172.21.15.150:0/602522816 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55742260d270 0x5574229b4000 unknown :-1 s=CLOSED pgs=658 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:42.804 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:42.796+0000 7f3860ca0740 1 --2- 172.21.15.150:0/602522816 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x5574225e43b0 0x5574229d6960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:42.804 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:42.796+0000 7f3860ca0740 1 -- 172.21.15.150:0/602522816 >> 172.21.15.150:0/602522816 conn(0x5574226013c0 msgr2=0x5574229fcd50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:45:42.804 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:42.797+0000 7f3860ca0740 1 -- 172.21.15.150:0/602522816 shutdown_connections 2024-09-17T05:45:42.804 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:42.797+0000 7f3860ca0740 1 -- 172.21.15.150:0/602522816 wait complete. 2024-09-17T05:45:42.804 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:42.797+0000 7f3860ca0740 20 client.6171 trim_cache size 0 max 16384 2024-09-17T05:45:42.804 INFO:teuthology.orchestra.run.smithi150.stdout:{ 2024-09-17T05:45:42.804 INFO:teuthology.orchestra.run.smithi150.stdout: "cluster_fsid": "9f2e05e9-d629-47b3-b26b-1360655b7d20", 2024-09-17T05:45:42.804 INFO:teuthology.orchestra.run.smithi150.stdout: "whoami": 0, 2024-09-17T05:45:42.804 INFO:teuthology.orchestra.run.smithi150.stdout: "id": 6009, 2024-09-17T05:45:42.805 INFO:teuthology.orchestra.run.smithi150.stdout: "want_state": "up:active", 2024-09-17T05:45:42.805 INFO:teuthology.orchestra.run.smithi150.stdout: "state": "up:active", 2024-09-17T05:45:42.805 INFO:teuthology.orchestra.run.smithi150.stdout: "fs_name": "cephfs", 2024-09-17T05:45:42.805 INFO:teuthology.orchestra.run.smithi150.stdout: "rank_uptime": 10.175963147999999, 2024-09-17T05:45:42.805 INFO:teuthology.orchestra.run.smithi150.stdout: "mdsmap_epoch": 33, 2024-09-17T05:45:42.805 INFO:teuthology.orchestra.run.smithi150.stdout: "osdmap_epoch": 60, 2024-09-17T05:45:42.805 INFO:teuthology.orchestra.run.smithi150.stdout: "osdmap_epoch_barrier": 60, 2024-09-17T05:45:42.805 INFO:teuthology.orchestra.run.smithi150.stdout: "uptime": 15.492100868 2024-09-17T05:45:42.805 INFO:teuthology.orchestra.run.smithi150.stdout:} 2024-09-17T05:45:42.806 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:42.797+0000 7f3859d32640 1 -- 172.21.15.150:0/4060186968 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f3840079490 msgr2=0x7f384007b9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:45:42.806 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:42.797+0000 7f3859d32640 1 --2- 172.21.15.150:0/4060186968 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f3840079490 0x7f384007b9a0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f3844009bc0 tx=0x7f3844005f30 comp rx=0 tx=0).stop 2024-09-17T05:45:42.806 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:42.797+0000 7f3859d32640 1 -- 172.21.15.150:0/4060186968 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f38540b0ad0 msgr2=0x7f38541e1c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:45:42.806 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:42.797+0000 7f3859d32640 1 --2- 172.21.15.150:0/4060186968 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f38540b0ad0 0x7f38541e1c20 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7f384c001370 tx=0x7f384c006d40 comp rx=0 tx=0).stop 2024-09-17T05:45:42.806 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:42.797+0000 7f3859d32640 1 -- 172.21.15.150:0/4060186968 shutdown_connections 2024-09-17T05:45:42.806 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:42.797+0000 7f3859d32640 1 --2- 172.21.15.150:0/4060186968 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f38541df1d0 0x7f38540b0590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:42.806 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:42.797+0000 7f3859d32640 1 --2- 172.21.15.150:0/4060186968 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f3840079490 0x7f384007b9a0 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:42.807 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:42.797+0000 7f3859d32640 1 --2- 172.21.15.150:0/4060186968 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f38540b0ad0 0x7f38541e1c20 unknown :-1 s=CLOSED pgs=654 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:42.807 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:42.797+0000 7f3859d32640 1 --2- 172.21.15.150:0/4060186968 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f383c005250 0x7f38541db9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:42.807 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:42.797+0000 7f3859d32640 1 -- 172.21.15.150:0/4060186968 >> 172.21.15.150:0/4060186968 conn(0x7f38540cef80 msgr2=0x7f38540cda50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:45:42.807 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:42.797+0000 7f3859d32640 1 -- 172.21.15.150:0/4060186968 shutdown_connections 2024-09-17T05:45:42.807 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:42.797+0000 7f3859d32640 1 -- 172.21.15.150:0/4060186968 wait complete. 2024-09-17T05:45:42.810 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-17T05:45:42.923 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:42.921+0000 7f4ccfe07640 1 -- 172.21.15.150:0/2787445792 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4cc80b7330 msgr2=0x7f4cc80b5260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:45:42.923 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:42.921+0000 7f4ccfe07640 1 --2- 172.21.15.150:0/2787445792 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4cc80b7330 0x7f4cc80b5260 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7f4cc80a0410 tx=0x7f4cb802a530 comp rx=0 tx=0).stop 2024-09-17T05:45:42.923 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:42.921+0000 7f4ccfe07640 1 -- 172.21.15.150:0/2787445792 shutdown_connections 2024-09-17T05:45:42.923 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:42.921+0000 7f4ccfe07640 1 --2- 172.21.15.150:0/2787445792 >> v2:172.21.15.176:3300/0 conn(0x7f4cc80b57a0 0x7f4cc80b5bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:42.923 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:42.921+0000 7f4ccfe07640 1 --2- 172.21.15.150:0/2787445792 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4cc80b7330 0x7f4cc80b5260 unknown :-1 s=CLOSED pgs=660 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:42.923 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:42.921+0000 7f4ccfe07640 1 -- 172.21.15.150:0/2787445792 >> 172.21.15.150:0/2787445792 conn(0x7f4cc80cee90 msgr2=0x7f4cc80cf2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:45:42.924 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:42.921+0000 7f4ccfe07640 1 -- 172.21.15.150:0/2787445792 shutdown_connections 2024-09-17T05:45:42.924 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:42.921+0000 7f4ccfe07640 1 -- 172.21.15.150:0/2787445792 wait complete. 2024-09-17T05:45:42.925 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:42.923+0000 7f4ccfe07640 1 Processor -- start 2024-09-17T05:45:42.925 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:42.923+0000 7f4ccfe07640 1 -- start start 2024-09-17T05:45:42.927 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:42.924+0000 7f4ccfe07640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4cc809ba60 0x7f4cc815bb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:45:42.928 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:42.924+0000 7f4ccfe07640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4cc80b57a0 0x7f4cc806f820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:45:42.928 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:42.924+0000 7f4ccfe07640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4cc80b7330 0x7f4cc815c770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:45:42.928 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:42.924+0000 7f4ccfe07640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f4cc80d1550 con 0x7f4cc80b57a0 2024-09-17T05:45:42.928 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:42.924+0000 7f4ccfe07640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f4cc80d13d0 con 0x7f4cc809ba60 2024-09-17T05:45:42.928 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:42.924+0000 7f4ccfe07640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f4cc81670e0 con 0x7f4cc80b7330 2024-09-17T05:45:42.928 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:42.924+0000 7f4ccd3a2640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4cc80b57a0 0x7f4cc806f820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:45:42.928 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:42.924+0000 7f4ccd3a2640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4cc80b57a0 0x7f4cc806f820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:38232/0 (socket says 172.21.15.150:38232) 2024-09-17T05:45:42.928 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:42.924+0000 7f4ccd3a2640 1 -- 172.21.15.150:0/3121777717 learned_addr learned my addr 172.21.15.150:0/3121777717 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:45:42.928 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:42.924+0000 7f4cce3a4640 1 --2- 172.21.15.150:0/3121777717 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4cc80b7330 0x7f4cc815c770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:45:42.929 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:42.924+0000 7f4ccdba3640 1 --2- 172.21.15.150:0/3121777717 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4cc809ba60 0x7f4cc815bb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:45:42.929 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:42.924+0000 7f4ccd3a2640 1 -- 172.21.15.150:0/3121777717 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4cc80b7330 msgr2=0x7f4cc815c770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:45:42.929 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:42.924+0000 7f4ccd3a2640 1 --2- 172.21.15.150:0/3121777717 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4cc80b7330 0x7f4cc815c770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:42.929 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:42.924+0000 7f4ccd3a2640 1 -- 172.21.15.150:0/3121777717 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4cc809ba60 msgr2=0x7f4cc815bb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:45:42.929 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:42.924+0000 7f4ccd3a2640 1 --2- 172.21.15.150:0/3121777717 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4cc809ba60 0x7f4cc815bb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:42.929 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:42.924+0000 7f4ccd3a2640 1 -- 172.21.15.150:0/3121777717 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4cc80cbb40 con 0x7f4cc80b57a0 2024-09-17T05:45:42.929 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:42.925+0000 7f4ccd3a2640 1 --2- 172.21.15.150:0/3121777717 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4cc80b57a0 0x7f4cc806f820 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7f4cb8009780 tx=0x7f4cb8033d60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:45:42.929 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:42.925+0000 7f4cbe7fc640 1 -- 172.21.15.150:0/3121777717 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4cb8031d60 con 0x7f4cc80b57a0 2024-09-17T05:45:42.929 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:42.925+0000 7f4cbe7fc640 1 -- 172.21.15.150:0/3121777717 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f4cb8005020 con 0x7f4cc80b57a0 2024-09-17T05:45:42.929 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:42.925+0000 7f4cbe7fc640 1 -- 172.21.15.150:0/3121777717 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4cb8005470 con 0x7f4cc80b57a0 2024-09-17T05:45:42.930 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:42.925+0000 7f4ccfe07640 1 -- 172.21.15.150:0/3121777717 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4cc815f4d0 con 0x7f4cc80b57a0 2024-09-17T05:45:42.930 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:42.925+0000 7f4ccfe07640 1 -- 172.21.15.150:0/3121777717 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4cc815fa90 con 0x7f4cc80b57a0 2024-09-17T05:45:42.930 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:42.926+0000 7f4ccfe07640 1 -- 172.21.15.150:0/3121777717 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4cc815f240 con 0x7f4cc80b57a0 2024-09-17T05:45:42.931 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:42.926+0000 7f4cbe7fc640 1 -- 172.21.15.150:0/3121777717 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 15) ==== 102257+0+0 (secure 0 0 0) 0x7f4cb80047a0 con 0x7f4cc80b57a0 2024-09-17T05:45:42.931 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:42.927+0000 7f4cbe7fc640 1 --2- 172.21.15.150:0/3121777717 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f4cac079490 0x7f4cac07b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:45:42.931 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:42.927+0000 7f4cbe7fc640 1 -- 172.21.15.150:0/3121777717 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(60..60 src has 1..60) ==== 5737+0+0 (secure 0 0 0) 0x7f4cb80ba920 con 0x7f4cc80b57a0 2024-09-17T05:45:42.932 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:42.927+0000 7f4ccdba3640 1 --2- 172.21.15.150:0/3121777717 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f4cac079490 0x7f4cac07b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:45:42.932 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:42.928+0000 7f4ccdba3640 1 --2- 172.21.15.150:0/3121777717 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f4cac079490 0x7f4cac07b9a0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f4cc40015b0 tx=0x7f4cc4009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:45:42.933 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:42.932+0000 7f4cbe7fc640 1 -- 172.21.15.150:0/3121777717 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f4cb803f030 con 0x7f4cc80b57a0 2024-09-17T05:45:43.144 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:43.143+0000 7f4ccfe07640 1 -- 172.21.15.150:0/3121777717 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f4cc80b5bb0 con 0x7f4cc80b57a0 2024-09-17T05:45:43.145 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:43.143+0000 7f4cbe7fc640 1 -- 172.21.15.150:0/3121777717 <== mon.0 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v33) ==== 53+0+73 (secure 0 0 0) 0x7f4cb8084790 con 0x7f4cc80b57a0 2024-09-17T05:45:43.145 INFO:teuthology.orchestra.run.smithi150.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-17T05:45:43.148 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:43.145+0000 7f4ccfe07640 1 -- 172.21.15.150:0/3121777717 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f4cac079490 msgr2=0x7f4cac07b9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:45:43.149 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:43.145+0000 7f4ccfe07640 1 --2- 172.21.15.150:0/3121777717 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f4cac079490 0x7f4cac07b9a0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f4cc40015b0 tx=0x7f4cc4009040 comp rx=0 tx=0).stop 2024-09-17T05:45:43.149 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:43.145+0000 7f4ccfe07640 1 -- 172.21.15.150:0/3121777717 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4cc80b57a0 msgr2=0x7f4cc806f820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:45:43.149 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:43.145+0000 7f4ccfe07640 1 --2- 172.21.15.150:0/3121777717 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4cc80b57a0 0x7f4cc806f820 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7f4cb8009780 tx=0x7f4cb8033d60 comp rx=0 tx=0).stop 2024-09-17T05:45:43.149 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:43.145+0000 7f4ccfe07640 1 -- 172.21.15.150:0/3121777717 shutdown_connections 2024-09-17T05:45:43.149 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:43.145+0000 7f4ccfe07640 1 --2- 172.21.15.150:0/3121777717 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f4cac079490 0x7f4cac07b9a0 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:43.149 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:43.145+0000 7f4ccfe07640 1 --2- 172.21.15.150:0/3121777717 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4cc80b7330 0x7f4cc815c770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:43.149 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:43.145+0000 7f4ccfe07640 1 --2- 172.21.15.150:0/3121777717 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4cc80b57a0 0x7f4cc806f820 unknown :-1 s=CLOSED pgs=661 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:43.150 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:43.145+0000 7f4ccfe07640 1 --2- 172.21.15.150:0/3121777717 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4cc809ba60 0x7f4cc815bb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:43.150 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:43.145+0000 7f4ccfe07640 1 -- 172.21.15.150:0/3121777717 >> 172.21.15.150:0/3121777717 conn(0x7f4cc80cee90 msgr2=0x7f4cc80cd440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:45:43.150 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:43.145+0000 7f4ccfe07640 1 -- 172.21.15.150:0/3121777717 shutdown_connections 2024-09-17T05:45:43.150 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:43.145+0000 7f4ccfe07640 1 -- 172.21.15.150:0/3121777717 wait complete. 2024-09-17T05:45:43.159 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-09-17T05:45:43.159 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-17T05:45:43.159 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi150.front.sepia.ceph.com 2024-09-17T05:45:43.159 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-17T05:45:43.159 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-17T05:45:43.159 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-09-17T05:45:43.159 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-09-17T05:45:43.159 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-17T05:45:43.159 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-17T05:45:43.159 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:45:43.160 DEBUG:teuthology.orchestra.run.smithi150:> ip addr 2024-09-17T05:45:43.175 INFO:teuthology.orchestra.run.smithi150.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-17T05:45:43.175 INFO:teuthology.orchestra.run.smithi150.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-17T05:45:43.176 INFO:teuthology.orchestra.run.smithi150.stdout: inet 127.0.0.1/8 scope host lo 2024-09-17T05:45:43.176 INFO:teuthology.orchestra.run.smithi150.stdout: valid_lft forever preferred_lft forever 2024-09-17T05:45:43.176 INFO:teuthology.orchestra.run.smithi150.stdout: inet6 ::1/128 scope host 2024-09-17T05:45:43.176 INFO:teuthology.orchestra.run.smithi150.stdout: valid_lft forever preferred_lft forever 2024-09-17T05:45:43.176 INFO:teuthology.orchestra.run.smithi150.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-17T05:45:43.176 INFO:teuthology.orchestra.run.smithi150.stdout: link/ether 0c:c4:7a:d9:da:bc brd ff:ff:ff:ff:ff:ff 2024-09-17T05:45:43.176 INFO:teuthology.orchestra.run.smithi150.stdout: altname enp7s0f0 2024-09-17T05:45:43.176 INFO:teuthology.orchestra.run.smithi150.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-17T05:45:43.176 INFO:teuthology.orchestra.run.smithi150.stdout: link/ether 0c:c4:7a:d9:da:bd brd ff:ff:ff:ff:ff:ff 2024-09-17T05:45:43.176 INFO:teuthology.orchestra.run.smithi150.stdout: altname enp7s0f1 2024-09-17T05:45:43.176 INFO:teuthology.orchestra.run.smithi150.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-17T05:45:43.176 INFO:teuthology.orchestra.run.smithi150.stdout: link/ether 0c:c4:7a:88:6e:34 brd ff:ff:ff:ff:ff:ff 2024-09-17T05:45:43.177 INFO:teuthology.orchestra.run.smithi150.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-17T05:45:43.177 INFO:teuthology.orchestra.run.smithi150.stdout: link/ether 0c:c4:7a:88:6e:35 brd ff:ff:ff:ff:ff:ff 2024-09-17T05:45:43.177 INFO:teuthology.orchestra.run.smithi150.stdout: inet 172.21.15.150/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-09-17T05:45:43.177 INFO:teuthology.orchestra.run.smithi150.stdout: valid_lft 42572sec preferred_lft 42572sec 2024-09-17T05:45:43.177 INFO:teuthology.orchestra.run.smithi150.stdout: inet6 fe80::ec4:7aff:fe88:6e35/64 scope link noprefixroute 2024-09-17T05:45:43.177 INFO:teuthology.orchestra.run.smithi150.stdout: valid_lft forever preferred_lft forever 2024-09-17T05:45:43.177 INFO:teuthology.orchestra.run.smithi150.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-17T05:45:43.177 INFO:teuthology.orchestra.run.smithi150.stdout: link/ether 1a:d2:4c:31:46:82 brd ff:ff:ff:ff:ff:ff 2024-09-17T05:45:43.177 INFO:teuthology.orchestra.run.smithi150.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-17T05:45:43.177 INFO:teuthology.orchestra.run.smithi150.stdout: valid_lft forever preferred_lft forever 2024-09-17T05:45:43.177 INFO:teuthology.orchestra.run.smithi150.stdout: inet6 fe80::70b6:c6ff:fe60:62a2/64 scope link 2024-09-17T05:45:43.177 INFO:teuthology.orchestra.run.smithi150.stdout: valid_lft forever preferred_lft forever 2024-09-17T05:45:43.177 INFO:teuthology.orchestra.run.smithi150.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-17T05:45:43.178 INFO:teuthology.orchestra.run.smithi150.stdout: link/ether 32:e1:8b:37:8c:b3 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-17T05:45:43.178 INFO:teuthology.orchestra.run.smithi150.stdout: inet6 fe80::30e1:8bff:fe37:8cb3/64 scope link 2024-09-17T05:45:43.178 INFO:teuthology.orchestra.run.smithi150.stdout: valid_lft forever preferred_lft forever 2024-09-17T05:45:43.178 INFO:teuthology.orchestra.run.smithi150.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-17T05:45:43.178 INFO:teuthology.orchestra.run.smithi150.stdout: link/ether 1a:d2:4c:31:46:82 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-17T05:45:43.178 INFO:teuthology.orchestra.run.smithi150.stdout: inet6 fe80::18d2:4cff:fe31:4682/64 scope link 2024-09-17T05:45:43.178 INFO:teuthology.orchestra.run.smithi150.stdout: valid_lft forever preferred_lft forever 2024-09-17T05:45:43.178 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:45:43.178 DEBUG:teuthology.orchestra.run.smithi150:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-17T05:45:43.239 INFO:teuthology.orchestra.run.smithi150.stdout:1 2024-09-17T05:45:43.240 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:45:43.240 DEBUG:teuthology.orchestra.run.smithi150:> route 2024-09-17T05:45:43.297 INFO:teuthology.orchestra.run.smithi150.stdout:Kernel IP routing table 2024-09-17T05:45:43.297 INFO:teuthology.orchestra.run.smithi150.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-17T05:45:43.297 INFO:teuthology.orchestra.run.smithi150.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-17T05:45:43.297 INFO:teuthology.orchestra.run.smithi150.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-17T05:45:43.297 INFO:teuthology.orchestra.run.smithi150.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-17T05:45:43.298 DEBUG:teuthology.orchestra.run.smithi150:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-17T05:45:43.298 DEBUG:teuthology.orchestra.run.smithi150:> set -e 2024-09-17T05:45:43.298 DEBUG:teuthology.orchestra.run.smithi150:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-17T05:45:43.298 DEBUG:teuthology.orchestra.run.smithi150:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-17T05:45:43.298 DEBUG:teuthology.orchestra.run.smithi150:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-17T05:45:43.298 DEBUG:teuthology.orchestra.run.smithi150:> ') 2024-09-17T05:45:43.385 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:43 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-17T05:45:43.418 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:43 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T05:45:43.424 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:45:43.424 DEBUG:teuthology.orchestra.run.smithi150:> ip netns list 2024-09-17T05:45:43.440 INFO:teuthology.orchestra.run.smithi150.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-09-17T05:45:43.440 INFO:teuthology.orchestra.run.smithi150.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-17T05:45:43.440 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-17T05:45:43.440 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:45:43.440 DEBUG:teuthology.orchestra.run.smithi150:> sudo ip link set brx.0 up 2024-09-17T05:45:43.505 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-17T05:45:43.506 DEBUG:teuthology.orchestra.run.smithi150:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-17T05:45:43.561 INFO:teuthology.orchestra.run.smithi150.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-17T05:45:43.561 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-17T05:45:43.561 DEBUG:teuthology.orchestra.run.smithi150:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-17T05:45:43.617 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-09-17T05:45:43.617 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:45:43.618 DEBUG:teuthology.orchestra.run.smithi150:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-17T05:45:43.711 INFO:teuthology.orchestra.run.smithi150.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-17T05:45:43.712 INFO:teuthology.orchestra.run.smithi150.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-17T05:45:43.712 INFO:teuthology.orchestra.run.smithi150.stdout:invalid new device string format 2024-09-17T05:45:43.722 INFO:teuthology.orchestra.run.smithi150.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-17T05:45:43.722 INFO:teuthology.orchestra.run.smithi150.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-17T05:45:43.723 INFO:teuthology.orchestra.run.smithi150.stdout:invalid new device string format 2024-09-17T05:45:43.723 INFO:teuthology.orchestra.run.smithi150.stdout:mount.ceph: resolved to: "172.21.15.150:3300,172.21.15.176:3300,172.21.15.176:3301" 2024-09-17T05:45:43.723 INFO:teuthology.orchestra.run.smithi150.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-17T05:45:43.728 INFO:teuthology.orchestra.run.smithi150.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-17T05:45:43.729 INFO:teuthology.orchestra.run.smithi150.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-17T05:45:43.729 INFO:teuthology.orchestra.run.smithi150.stdout:invalid new device string format 2024-09-17T05:45:43.729 INFO:teuthology.orchestra.run.smithi150.stdout:mount.ceph: resolved to: "172.21.15.150:3300,172.21.15.176:3300,172.21.15.176:3301" 2024-09-17T05:45:43.729 INFO:teuthology.orchestra.run.smithi150.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-17T05:45:43.729 INFO:teuthology.orchestra.run.smithi150.stdout:mount.ceph: resolved to: "172.21.15.150:6789,172.21.15.176:6789,172.21.15.176:6790" 2024-09-17T05:45:43.729 INFO:teuthology.orchestra.run.smithi150.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.150:6789,172.21.15.176:6789,172.21.15.176:6790:/ 2024-09-17T05:45:43.729 INFO:teuthology.orchestra.run.smithi150.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=9f2e05e9-d629-47b3-b26b-1360655b7d20" will pass to kernel 2024-09-17T05:45:43.730 INFO:teuthology.orchestra.run.smithi150.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-09-17T05:45:43.730 INFO:teuthology.orchestra.run.smithi150.stdout: You just mounted a file system that supports labels which does not 2024-09-17T05:45:43.730 INFO:teuthology.orchestra.run.smithi150.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-09-17T05:45:43.730 INFO:teuthology.orchestra.run.smithi150.stdout: applications will generate AVC messages and not be allowed access to 2024-09-17T05:45:43.730 INFO:teuthology.orchestra.run.smithi150.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-09-17T05:45:43.731 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-17T05:45:43.732 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:45:43.732 DEBUG:teuthology.orchestra.run.smithi150:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-17T05:45:43.757 DEBUG:teuthology.orchestra.run.smithi150:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-17T05:45:43.848 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:43 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-17T05:45:43.855 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:43 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T05:45:43.861 INFO:teuthology.orchestra.run.smithi150.stdout:client5818 2024-09-17T05:45:43.862 DEBUG:teuthology.orchestra.run.smithi150:> set -ex 2024-09-17T05:45:43.862 DEBUG:teuthology.orchestra.run.smithi150:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T05:45:43.880 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs flag set enable_multiple true --yes-i-really-mean-it 2024-09-17T05:45:44.036 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:44.034+0000 7f4577b32640 1 -- 172.21.15.150:0/2441194919 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f45700cd690 msgr2=0x7f45700cdaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:45:44.036 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:44.034+0000 7f4577b32640 1 --2- 172.21.15.150:0/2441194919 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f45700cd690 0x7f45700cdaa0 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7f4570074030 tx=0x7f456802a5f0 comp rx=0 tx=0).stop 2024-09-17T05:45:44.036 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:44.034+0000 7f4577b32640 1 -- 172.21.15.150:0/2441194919 shutdown_connections 2024-09-17T05:45:44.037 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:44.034+0000 7f4577b32640 1 --2- 172.21.15.150:0/2441194919 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f45700cd690 0x7f45700cdaa0 unknown :-1 s=CLOSED pgs=662 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:44.037 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:44.034+0000 7f4577b32640 1 --2- 172.21.15.150:0/2441194919 >> v2:172.21.15.176:3300/0 conn(0x7f45700d0770 0x7f45700cd150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:44.037 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:44.034+0000 7f4577b32640 1 --2- 172.21.15.150:0/2441194919 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f45700c5b10 0x7f45700d0230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:44.037 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:44.034+0000 7f4577b32640 1 -- 172.21.15.150:0/2441194919 >> 172.21.15.150:0/2441194919 conn(0x7f45700cef00 msgr2=0x7f45700cf310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:45:44.037 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:44.034+0000 7f4577b32640 1 -- 172.21.15.150:0/2441194919 shutdown_connections 2024-09-17T05:45:44.037 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:44.034+0000 7f4577b32640 1 -- 172.21.15.150:0/2441194919 wait complete. 2024-09-17T05:45:44.037 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:44.036+0000 7f4577b32640 1 Processor -- start 2024-09-17T05:45:44.038 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:44.036+0000 7f4577b32640 1 -- start start 2024-09-17T05:45:44.040 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:44.037+0000 7f4577b32640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f45700c5b10 0x7f45701df6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:45:44.040 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:44.037+0000 7f4577b32640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f45700cd690 0x7f45700b26e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:45:44.040 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:44.037+0000 7f4577b32640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f45700d0770 0x7f45700b2c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:45:44.040 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:44.037+0000 7f4577b32640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f457009bde0 con 0x7f45700d0770 2024-09-17T05:45:44.041 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:44.037+0000 7f4577b32640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f457009bc60 con 0x7f45700c5b10 2024-09-17T05:45:44.041 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:44.037+0000 7f4577b32640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f45700b1c50 con 0x7f45700cd690 2024-09-17T05:45:44.041 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:44.038+0000 7f45760cf640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f45700d0770 0x7f45700b2c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:45:44.041 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:44.038+0000 7f45760cf640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f45700d0770 0x7f45700b2c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:38260/0 (socket says 172.21.15.150:38260) 2024-09-17T05:45:44.041 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:44.038+0000 7f45760cf640 1 -- 172.21.15.150:0/2686251975 learned_addr learned my addr 172.21.15.150:0/2686251975 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:45:44.041 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:44.038+0000 7f45750cd640 1 --2- 172.21.15.150:0/2686251975 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f45700cd690 0x7f45700b26e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:45:44.041 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:44.038+0000 7f45758ce640 1 --2- 172.21.15.150:0/2686251975 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f45700c5b10 0x7f45701df6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:45:44.041 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:44.038+0000 7f45760cf640 1 -- 172.21.15.150:0/2686251975 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f45700cd690 msgr2=0x7f45700b26e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:45:44.041 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:44.038+0000 7f45760cf640 1 --2- 172.21.15.150:0/2686251975 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f45700cd690 0x7f45700b26e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:44.041 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:44.038+0000 7f45760cf640 1 -- 172.21.15.150:0/2686251975 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f45700c5b10 msgr2=0x7f45701df6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:45:44.041 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:44.038+0000 7f45760cf640 1 --2- 172.21.15.150:0/2686251975 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f45700c5b10 0x7f45701df6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:44.041 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:44.038+0000 7f45760cf640 1 -- 172.21.15.150:0/2686251975 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f45700b0a70 con 0x7f45700d0770 2024-09-17T05:45:44.041 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:44.038+0000 7f45760cf640 1 --2- 172.21.15.150:0/2686251975 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f45700d0770 0x7f45700b2c20 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7f4568009230 tx=0x7f4568003960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:45:44.042 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:44.038+0000 7f456e7fc640 1 -- 172.21.15.150:0/2686251975 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f456803e030 con 0x7f45700d0770 2024-09-17T05:45:44.042 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:44.038+0000 7f456e7fc640 1 -- 172.21.15.150:0/2686251975 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f4568003e50 con 0x7f45700d0770 2024-09-17T05:45:44.042 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:44.038+0000 7f4577b32640 1 -- 172.21.15.150:0/2686251975 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f45700b5940 con 0x7f45700d0770 2024-09-17T05:45:44.042 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:44.038+0000 7f456e7fc640 1 -- 172.21.15.150:0/2686251975 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4568035040 con 0x7f45700d0770 2024-09-17T05:45:44.042 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:44.038+0000 7f4577b32640 1 -- 172.21.15.150:0/2686251975 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f45700b5f00 con 0x7f45700d0770 2024-09-17T05:45:44.042 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:44.039+0000 7f4577b32640 1 -- 172.21.15.150:0/2686251975 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f45700cdaa0 con 0x7f45700d0770 2024-09-17T05:45:44.043 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:44.040+0000 7f456e7fc640 1 -- 172.21.15.150:0/2686251975 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 15) ==== 102257+0+0 (secure 0 0 0) 0x7f4568041030 con 0x7f45700d0770 2024-09-17T05:45:44.043 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:44.041+0000 7f456e7fc640 1 --2- 172.21.15.150:0/2686251975 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f455c079490 0x7f455c07b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:45:44.043 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:44.041+0000 7f456e7fc640 1 -- 172.21.15.150:0/2686251975 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(60..60 src has 1..60) ==== 5737+0+0 (secure 0 0 0) 0x7f45680b9c90 con 0x7f45700d0770 2024-09-17T05:45:44.043 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:44.041+0000 7f45758ce640 1 --2- 172.21.15.150:0/2686251975 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f455c079490 0x7f455c07b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:45:44.043 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:44.042+0000 7f45758ce640 1 --2- 172.21.15.150:0/2686251975 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f455c079490 0x7f455c07b9a0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f4560005c60 tx=0x7f456000a540 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:45:44.047 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:44.046+0000 7f456e7fc640 1 -- 172.21.15.150:0/2686251975 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f45680835c0 con 0x7f45700d0770 2024-09-17T05:45:44.260 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:44.258+0000 7f4577b32640 1 -- 172.21.15.150:0/2686251975 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "fs flag set", "flag_name": "enable_multiple", "val": "true", "yes_i_really_mean_it": true} v 0) -- 0x7f45700b56b0 con 0x7f45700d0770 2024-09-17T05:45:44.979 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:44.978+0000 7f456e7fc640 1 -- 172.21.15.150:0/2686251975 <== mon.0 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "fs flag set", "flag_name": "enable_multiple", "val": "true", "yes_i_really_mean_it": true}]=0 v34) ==== 136+0+0 (secure 0 0 0) 0x7f4568087ff0 con 0x7f45700d0770 2024-09-17T05:45:44.983 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:44.981+0000 7f4577b32640 1 -- 172.21.15.150:0/2686251975 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f455c079490 msgr2=0x7f455c07b9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:45:44.983 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:44.981+0000 7f4577b32640 1 --2- 172.21.15.150:0/2686251975 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f455c079490 0x7f455c07b9a0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f4560005c60 tx=0x7f456000a540 comp rx=0 tx=0).stop 2024-09-17T05:45:44.983 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:44.981+0000 7f4577b32640 1 -- 172.21.15.150:0/2686251975 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f45700d0770 msgr2=0x7f45700b2c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:45:44.983 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:44.981+0000 7f4577b32640 1 --2- 172.21.15.150:0/2686251975 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f45700d0770 0x7f45700b2c20 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7f4568009230 tx=0x7f4568003960 comp rx=0 tx=0).stop 2024-09-17T05:45:44.983 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:44.981+0000 7f4577b32640 1 -- 172.21.15.150:0/2686251975 shutdown_connections 2024-09-17T05:45:44.983 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:44.981+0000 7f4577b32640 1 --2- 172.21.15.150:0/2686251975 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f455c079490 0x7f455c07b9a0 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:44.983 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:44.981+0000 7f4577b32640 1 --2- 172.21.15.150:0/2686251975 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f45700d0770 0x7f45700b2c20 unknown :-1 s=CLOSED pgs=663 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:44.983 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:44.981+0000 7f4577b32640 1 --2- 172.21.15.150:0/2686251975 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f45700cd690 0x7f45700b26e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:44.983 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:44.981+0000 7f4577b32640 1 --2- 172.21.15.150:0/2686251975 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f45700c5b10 0x7f45701df6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:44.984 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:44.981+0000 7f4577b32640 1 -- 172.21.15.150:0/2686251975 >> 172.21.15.150:0/2686251975 conn(0x7f45700cef00 msgr2=0x7f45701e4bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:45:44.984 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:44.981+0000 7f4577b32640 1 -- 172.21.15.150:0/2686251975 shutdown_connections 2024-09-17T05:45:44.984 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:44.981+0000 7f4577b32640 1 -- 172.21.15.150:0/2686251975 wait complete. 2024-09-17T05:45:44.997 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume ls 2024-09-17T05:45:45.117 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:45.115+0000 7fe223f98640 1 -- 172.21.15.150:0/1049027048 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe21c0b75a0 msgr2=0x7fe21c06e090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:45:45.117 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:45.115+0000 7fe223f98640 1 --2- 172.21.15.150:0/1049027048 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe21c0b75a0 0x7fe21c06e090 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7fe21c0d35b0 tx=0x7fe21802a540 comp rx=0 tx=0).stop 2024-09-17T05:45:45.118 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:45.115+0000 7fe223f98640 1 -- 172.21.15.150:0/1049027048 shutdown_connections 2024-09-17T05:45:45.118 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:45.115+0000 7fe223f98640 1 --2- 172.21.15.150:0/1049027048 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe21c0d0db0 0x7fe21c0d11c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:45.118 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:45.115+0000 7fe223f98640 1 --2- 172.21.15.150:0/1049027048 >> v2:172.21.15.176:3300/0 conn(0x7fe21c06e5d0 0x7fe21c0d0870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:45.118 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:45.115+0000 7fe223f98640 1 --2- 172.21.15.150:0/1049027048 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe21c0b75a0 0x7fe21c06e090 unknown :-1 s=CLOSED pgs=664 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:45.118 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:45.115+0000 7fe223f98640 1 -- 172.21.15.150:0/1049027048 >> 172.21.15.150:0/1049027048 conn(0x7fe21c0cef80 msgr2=0x7fe21c0cf390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:45:45.118 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:45.115+0000 7fe223f98640 1 -- 172.21.15.150:0/1049027048 shutdown_connections 2024-09-17T05:45:45.118 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:45.115+0000 7fe223f98640 1 -- 172.21.15.150:0/1049027048 wait complete. 2024-09-17T05:45:45.119 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:45.117+0000 7fe223f98640 1 Processor -- start 2024-09-17T05:45:45.119 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:45.117+0000 7fe223f98640 1 -- start start 2024-09-17T05:45:45.121 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:45.118+0000 7fe223f98640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe21c06e5d0 0x7fe21c0b0830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:45:45.121 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:45.118+0000 7fe223f98640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe21c0b75a0 0x7fe21c09f670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:45:45.122 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:45.118+0000 7fe223f98640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe21c0d0db0 0x7fe21c1f9170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:45:45.122 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:45.118+0000 7fe223f98640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7fe21c0d17e0 con 0x7fe21c0d0db0 2024-09-17T05:45:45.122 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:45.118+0000 7fe223f98640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fe21c0cfec0 con 0x7fe21c0b75a0 2024-09-17T05:45:45.122 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:45.119+0000 7fe223f98640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fe21c0b5590 con 0x7fe21c06e5d0 2024-09-17T05:45:45.122 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:45.119+0000 7fe222535640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe21c0d0db0 0x7fe21c1f9170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:45:45.122 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:45.119+0000 7fe222535640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe21c0d0db0 0x7fe21c1f9170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:38272/0 (socket says 172.21.15.150:38272) 2024-09-17T05:45:45.122 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:45.119+0000 7fe222535640 1 -- 172.21.15.150:0/2328159918 learned_addr learned my addr 172.21.15.150:0/2328159918 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:45:45.122 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:45.119+0000 7fe221d34640 1 --2- 172.21.15.150:0/2328159918 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe21c06e5d0 0x7fe21c0b0830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:45:45.122 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:45.119+0000 7fe221533640 1 --2- 172.21.15.150:0/2328159918 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe21c0b75a0 0x7fe21c09f670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:45:45.122 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:45.119+0000 7fe222535640 1 -- 172.21.15.150:0/2328159918 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe21c06e5d0 msgr2=0x7fe21c0b0830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:45:45.122 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:45.119+0000 7fe222535640 1 --2- 172.21.15.150:0/2328159918 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe21c06e5d0 0x7fe21c0b0830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:45.122 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:45.119+0000 7fe222535640 1 -- 172.21.15.150:0/2328159918 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe21c0b75a0 msgr2=0x7fe21c09f670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:45:45.122 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:45.119+0000 7fe222535640 1 --2- 172.21.15.150:0/2328159918 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe21c0b75a0 0x7fe21c09f670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:45.123 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:45.119+0000 7fe222535640 1 -- 172.21.15.150:0/2328159918 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe21c0b0d70 con 0x7fe21c0d0db0 2024-09-17T05:45:45.123 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:45.119+0000 7fe222535640 1 --2- 172.21.15.150:0/2328159918 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe21c0d0db0 0x7fe21c1f9170 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7fe21400e960 tx=0x7fe21400ee20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:45:45.123 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:45.119+0000 7fe2127fc640 1 -- 172.21.15.150:0/2328159918 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe214004d20 con 0x7fe21c0d0db0 2024-09-17T05:45:45.123 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:45.119+0000 7fe2127fc640 1 -- 172.21.15.150:0/2328159918 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe21400cac0 con 0x7fe21c0d0db0 2024-09-17T05:45:45.123 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:45.119+0000 7fe2127fc640 1 -- 172.21.15.150:0/2328159918 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe214005020 con 0x7fe21c0d0db0 2024-09-17T05:45:45.123 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:45.119+0000 7fe223f98640 1 -- 172.21.15.150:0/2328159918 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe21c1f5950 con 0x7fe21c0d0db0 2024-09-17T05:45:45.123 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:45.119+0000 7fe223f98640 1 -- 172.21.15.150:0/2328159918 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe21c1f5ef0 con 0x7fe21c0d0db0 2024-09-17T05:45:45.124 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:45.120+0000 7fe223f98640 1 -- 172.21.15.150:0/2328159918 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe21c0d0170 con 0x7fe21c0d0db0 2024-09-17T05:45:45.124 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:45.121+0000 7fe2127fc640 1 -- 172.21.15.150:0/2328159918 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 15) ==== 102257+0+0 (secure 0 0 0) 0x7fe2140051c0 con 0x7fe21c0d0db0 2024-09-17T05:45:45.124 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:45.122+0000 7fe2127fc640 1 --2- 172.21.15.150:0/2328159918 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fe200079490 0x7fe20007b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:45:45.124 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:45.122+0000 7fe2127fc640 1 -- 172.21.15.150:0/2328159918 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(60..60 src has 1..60) ==== 5737+0+0 (secure 0 0 0) 0x7fe214099d50 con 0x7fe21c0d0db0 2024-09-17T05:45:45.124 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:45.122+0000 7fe221d34640 1 --2- 172.21.15.150:0/2328159918 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fe200079490 0x7fe20007b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:45:45.124 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:45.123+0000 7fe221d34640 1 --2- 172.21.15.150:0/2328159918 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fe200079490 0x7fe20007b9a0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7fe218034000 tx=0x7fe218004730 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:45:45.128 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:45.126+0000 7fe2127fc640 1 -- 172.21.15.150:0/2328159918 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fe21c0d0170 con 0x7fe21c0d0db0 2024-09-17T05:45:45.325 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:45.324+0000 7fe223f98640 1 -- 172.21.15.150:0/2328159918 --> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] -- mgr_command(tid 0: {"prefix": "fs volume ls", "target": ["mon-mgr", ""]}) -- 0x7fe21c06e090 con 0x7fe200079490 2024-09-17T05:45:45.327 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:45.326+0000 7fe2127fc640 1 -- 172.21.15.150:0/2328159918 <== mgr.4108 v2:172.21.15.176:6800/3631216395 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+41 (secure 0 0 0) 0x7fe21c06e090 con 0x7fe200079490 2024-09-17T05:45:45.327 INFO:teuthology.orchestra.run.smithi150.stdout:[ 2024-09-17T05:45:45.328 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-09-17T05:45:45.328 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "cephfs" 2024-09-17T05:45:45.328 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-09-17T05:45:45.328 INFO:teuthology.orchestra.run.smithi150.stdout:] 2024-09-17T05:45:45.330 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:45.328+0000 7fe223f98640 1 -- 172.21.15.150:0/2328159918 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fe200079490 msgr2=0x7fe20007b9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:45:45.330 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:45.328+0000 7fe223f98640 1 --2- 172.21.15.150:0/2328159918 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fe200079490 0x7fe20007b9a0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7fe218034000 tx=0x7fe218004730 comp rx=0 tx=0).stop 2024-09-17T05:45:45.330 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:45.328+0000 7fe223f98640 1 -- 172.21.15.150:0/2328159918 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe21c0d0db0 msgr2=0x7fe21c1f9170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:45:45.330 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:45.328+0000 7fe223f98640 1 --2- 172.21.15.150:0/2328159918 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe21c0d0db0 0x7fe21c1f9170 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7fe21400e960 tx=0x7fe21400ee20 comp rx=0 tx=0).stop 2024-09-17T05:45:45.330 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:45.328+0000 7fe223f98640 1 -- 172.21.15.150:0/2328159918 shutdown_connections 2024-09-17T05:45:45.330 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:45.328+0000 7fe223f98640 1 --2- 172.21.15.150:0/2328159918 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe21c0b75a0 0x7fe21c09f670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:45.331 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:45.328+0000 7fe223f98640 1 --2- 172.21.15.150:0/2328159918 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fe200079490 0x7fe20007b9a0 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:45.331 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:45.328+0000 7fe223f98640 1 --2- 172.21.15.150:0/2328159918 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe21c0d0db0 0x7fe21c1f9170 unknown :-1 s=CLOSED pgs=665 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:45.331 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:45.328+0000 7fe223f98640 1 --2- 172.21.15.150:0/2328159918 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe21c06e5d0 0x7fe21c0b0830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:45.331 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:45.328+0000 7fe223f98640 1 -- 172.21.15.150:0/2328159918 >> 172.21.15.150:0/2328159918 conn(0x7fe21c0cef80 msgr2=0x7fe21c09aa50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:45:45.331 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:45.328+0000 7fe223f98640 1 -- 172.21.15.150:0/2328159918 shutdown_connections 2024-09-17T05:45:45.331 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:45.328+0000 7fe223f98640 1 -- 172.21.15.150:0/2328159918 wait complete. 2024-09-17T05:45:45.342 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-09-17T05:45:45.458 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:45.456+0000 7f9674a5c640 1 -- 172.21.15.150:0/3001774486 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f965c004d40 msgr2=0x7f965c005190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:45:45.459 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:45.456+0000 7f9674a5c640 1 --2- 172.21.15.150:0/3001774486 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f965c004d40 0x7f965c005190 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7f96680013d0 tx=0x7f965c005830 comp rx=0 tx=0).stop 2024-09-17T05:45:45.459 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:45.456+0000 7f966ed9d640 1 -- 172.21.15.150:0/3001774486 reap_dead start 2024-09-17T05:45:45.459 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:45.456+0000 7f9674a5c640 1 -- 172.21.15.150:0/3001774486 shutdown_connections 2024-09-17T05:45:45.459 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:45.456+0000 7f9674a5c640 1 -- 172.21.15.150:0/3001774486 >> 172.21.15.150:0/3001774486 conn(0x7f96700d2550 msgr2=0x7f96700d2960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:45:45.459 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:45.456+0000 7f9674a5c640 1 -- 172.21.15.150:0/3001774486 shutdown_connections 2024-09-17T05:45:45.459 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:45.456+0000 7f9674a5c640 1 -- 172.21.15.150:0/3001774486 wait complete. 2024-09-17T05:45:45.460 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:45.459+0000 7f9674a5c640 1 Processor -- start 2024-09-17T05:45:45.460 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:45.459+0000 7f9674a5c640 1 -- start start 2024-09-17T05:45:45.463 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:45.460+0000 7f9674a5c640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f965c004d40 0x7f96701d5fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:45:45.463 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:45.460+0000 7f9674a5c640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f96701d6980 0x7f967009f660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:45:45.463 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:45.460+0000 7f9674a5c640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f967009fba0 0x7f96701f6ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:45:45.463 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:45.460+0000 7f9674a5c640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f96700ced90 con 0x7f965c004d40 2024-09-17T05:45:45.463 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:45.460+0000 7f9674a5c640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f96700cec10 con 0x7f967009fba0 2024-09-17T05:45:45.463 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:45.460+0000 7f9674a5c640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f96700b6450 con 0x7f96701d6980 2024-09-17T05:45:45.463 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:45.460+0000 7f966e59c640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f965c004d40 0x7f96701d5fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:45:45.464 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:45.460+0000 7f966e59c640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f965c004d40 0x7f96701d5fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:38290/0 (socket says 172.21.15.150:38290) 2024-09-17T05:45:45.464 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:45.460+0000 7f966e59c640 1 -- 172.21.15.150:0/1349562417 learned_addr learned my addr 172.21.15.150:0/1349562417 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:45:45.464 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:45.460+0000 7f9665d9b640 1 --2- 172.21.15.150:0/1349562417 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f96701d6980 0x7f967009f660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:45:45.464 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:45.460+0000 7f966ed9d640 1 --2- 172.21.15.150:0/1349562417 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f967009fba0 0x7f96701f6ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:45:45.464 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:45.460+0000 7f966e59c640 1 -- 172.21.15.150:0/1349562417 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f96701d6980 msgr2=0x7f967009f660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:45:45.464 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:45.460+0000 7f966e59c640 1 --2- 172.21.15.150:0/1349562417 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f96701d6980 0x7f967009f660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:45.464 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:45.460+0000 7f966e59c640 1 -- 172.21.15.150:0/1349562417 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f967009fba0 msgr2=0x7f96701f6ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:45:45.464 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:45.460+0000 7f966e59c640 1 --2- 172.21.15.150:0/1349562417 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f967009fba0 0x7f96701f6ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:45.465 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:45.460+0000 7f966e59c640 1 -- 172.21.15.150:0/1349562417 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f967009e8a0 con 0x7f965c004d40 2024-09-17T05:45:45.465 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:45.460+0000 7f966ed9d640 1 --2- 172.21.15.150:0/1349562417 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f967009fba0 0x7f96701f6ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T05:45:45.465 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:45.460+0000 7f966e59c640 1 --2- 172.21.15.150:0/1349562417 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f965c004d40 0x7f96701d5fe0 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7f9660004650 tx=0x7f966000bac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:45:45.465 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:45.461+0000 7f96677fe640 1 -- 172.21.15.150:0/1349562417 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9660010b10 con 0x7f965c004d40 2024-09-17T05:45:45.465 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:45.461+0000 7f96677fe640 1 -- 172.21.15.150:0/1349562417 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9660015070 con 0x7f965c004d40 2024-09-17T05:45:45.465 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:45.461+0000 7f9674a5c640 1 -- 172.21.15.150:0/1349562417 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f967009eb80 con 0x7f965c004d40 2024-09-17T05:45:45.465 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:45.461+0000 7f96677fe640 1 -- 172.21.15.150:0/1349562417 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f966001a470 con 0x7f965c004d40 2024-09-17T05:45:45.465 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:45.461+0000 7f9674a5c640 1 -- 172.21.15.150:0/1349562417 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f967009ffb0 con 0x7f965c004d40 2024-09-17T05:45:45.466 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:45.462+0000 7f9674a5c640 1 -- 172.21.15.150:0/1349562417 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f96700ccdc0 con 0x7f965c004d40 2024-09-17T05:45:45.466 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:45.463+0000 7f96677fe640 1 -- 172.21.15.150:0/1349562417 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 15) ==== 102257+0+0 (secure 0 0 0) 0x7f966001a610 con 0x7f965c004d40 2024-09-17T05:45:45.466 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:45.463+0000 7f96677fe640 1 --2- 172.21.15.150:0/1349562417 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f9650079490 0x7f965007b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:45:45.466 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:45.463+0000 7f96677fe640 1 -- 172.21.15.150:0/1349562417 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(60..60 src has 1..60) ==== 5737+0+0 (secure 0 0 0) 0x7f966009a720 con 0x7f965c004d40 2024-09-17T05:45:45.466 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:45.463+0000 7f9665d9b640 1 --2- 172.21.15.150:0/1349562417 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f9650079490 0x7f965007b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:45:45.466 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:45.464+0000 7f9665d9b640 1 --2- 172.21.15.150:0/1349562417 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f9650079490 0x7f965007b9a0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f96700cb890 tx=0x7f965800b260 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:45:45.468 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:45.467+0000 7f96677fe640 1 -- 172.21.15.150:0/1349562417 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f96600645f0 con 0x7f965c004d40 2024-09-17T05:45:45.643 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:45.641+0000 7f9674a5c640 1 -- 172.21.15.150:0/1349562417 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) -- 0x7f96700d04e0 con 0x7f965c004d40 2024-09-17T05:45:45.643 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:45.641+0000 7f96677fe640 1 -- 172.21.15.150:0/1349562417 <== mon.0 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v38)=0 v38) ==== 122+0+0 (secure 0 0 0) 0x7f9660063ef0 con 0x7f965c004d40 2024-09-17T05:45:45.645 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:45.643+0000 7f9674a5c640 1 -- 172.21.15.150:0/1349562417 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f9650079490 msgr2=0x7f965007b9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:45:45.645 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:45.643+0000 7f9674a5c640 1 --2- 172.21.15.150:0/1349562417 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f9650079490 0x7f965007b9a0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f96700cb890 tx=0x7f965800b260 comp rx=0 tx=0).stop 2024-09-17T05:45:45.645 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:45.643+0000 7f9674a5c640 1 -- 172.21.15.150:0/1349562417 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f965c004d40 msgr2=0x7f96701d5fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:45:45.646 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:45.643+0000 7f9674a5c640 1 --2- 172.21.15.150:0/1349562417 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f965c004d40 0x7f96701d5fe0 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7f9660004650 tx=0x7f966000bac0 comp rx=0 tx=0).stop 2024-09-17T05:45:45.646 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:45.643+0000 7f9674a5c640 1 -- 172.21.15.150:0/1349562417 shutdown_connections 2024-09-17T05:45:45.646 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:45.643+0000 7f9674a5c640 1 --2- 172.21.15.150:0/1349562417 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f967009fba0 0x7f96701f6ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:45.646 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:45.643+0000 7f9674a5c640 1 --2- 172.21.15.150:0/1349562417 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f9650079490 0x7f965007b9a0 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:45.646 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:45.643+0000 7f9674a5c640 1 --2- 172.21.15.150:0/1349562417 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f96701d6980 0x7f967009f660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:45.646 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:45.643+0000 7f9674a5c640 1 --2- 172.21.15.150:0/1349562417 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f965c004d40 0x7f96701d5fe0 unknown :-1 s=CLOSED pgs=668 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:45.646 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:45.643+0000 7f9674a5c640 1 -- 172.21.15.150:0/1349562417 >> 172.21.15.150:0/1349562417 conn(0x7f96700d2550 msgr2=0x7f96700ca2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:45:45.646 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:45.644+0000 7f9674a5c640 1 -- 172.21.15.150:0/1349562417 shutdown_connections 2024-09-17T05:45:45.646 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:45.644+0000 7f9674a5c640 1 -- 172.21.15.150:0/1349562417 wait complete. 2024-09-17T05:45:45.657 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config get mgr mgr/volumes/max_concurrent_clones 2024-09-17T05:45:45.773 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:45.771+0000 7efe06e3f640 1 -- 172.21.15.150:0/1901485810 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7efdec003a50 msgr2=0x7efdec003ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:45:45.773 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:45.771+0000 7efe06e3f640 1 --2- 172.21.15.150:0/1901485810 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7efdec003a50 0x7efdec003ec0 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7efdf00019a0 tx=0x7efdec005830 comp rx=0 tx=0).stop 2024-09-17T05:45:45.773 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:45.771+0000 7efe06e3f640 1 -- 172.21.15.150:0/1901485810 shutdown_connections 2024-09-17T05:45:45.773 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:45.771+0000 7efe06e3f640 1 --2- 172.21.15.150:0/1901485810 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7efdec003a50 0x7efdec003ec0 unknown :-1 s=CLOSED pgs=670 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:45.773 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:45.771+0000 7efe06e3f640 1 -- 172.21.15.150:0/1901485810 >> 172.21.15.150:0/1901485810 conn(0x7efe000cefb0 msgr2=0x7efe000cf3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:45:45.773 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:45.771+0000 7efe06e3f640 1 -- 172.21.15.150:0/1901485810 shutdown_connections 2024-09-17T05:45:45.773 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:45.771+0000 7efe06e3f640 1 -- 172.21.15.150:0/1901485810 wait complete. 2024-09-17T05:45:45.774 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:45.773+0000 7efe06e3f640 1 Processor -- start 2024-09-17T05:45:45.774 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:45.773+0000 7efe06e3f640 1 -- start start 2024-09-17T05:45:45.777 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:45.774+0000 7efe06e3f640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7efdec003a50 0x7efe0014c080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:45:45.777 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:45.774+0000 7efe06e3f640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7efe000c8340 0x7efe001f4e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:45:45.777 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:45.774+0000 7efe06e3f640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7efe001f53b0 0x7efe001f57c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:45:45.777 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:45.774+0000 7efe06e3f640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7efe000d1450 con 0x7efdec003a50 2024-09-17T05:45:45.777 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:45.774+0000 7efe06e3f640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7efe000d12d0 con 0x7efe001f53b0 2024-09-17T05:45:45.777 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:45.774+0000 7efe06e3f640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7efe000d0980 con 0x7efe000c8340 2024-09-17T05:45:45.778 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:45.774+0000 7efe04bdb640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7efdec003a50 0x7efe0014c080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:45:45.778 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:45.774+0000 7efe04bdb640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7efdec003a50 0x7efe0014c080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:38294/0 (socket says 172.21.15.150:38294) 2024-09-17T05:45:45.778 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:45.774+0000 7efe04bdb640 1 -- 172.21.15.150:0/1295196986 learned_addr learned my addr 172.21.15.150:0/1295196986 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:45:45.778 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:45.774+0000 7efe053dc640 1 --2- 172.21.15.150:0/1295196986 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7efe001f53b0 0x7efe001f57c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:45:45.778 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:45.774+0000 7efdfffff640 1 --2- 172.21.15.150:0/1295196986 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7efe000c8340 0x7efe001f4e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:45:45.778 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:45.774+0000 7efe04bdb640 1 -- 172.21.15.150:0/1295196986 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7efe000c8340 msgr2=0x7efe001f4e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:45:45.779 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:45.774+0000 7efe04bdb640 1 --2- 172.21.15.150:0/1295196986 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7efe000c8340 0x7efe001f4e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:45.779 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:45.774+0000 7efe04bdb640 1 -- 172.21.15.150:0/1295196986 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7efe001f53b0 msgr2=0x7efe001f57c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:45:45.779 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:45.774+0000 7efe04bdb640 1 --2- 172.21.15.150:0/1295196986 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7efe001f53b0 0x7efe001f57c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:45.779 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:45.774+0000 7efe04bdb640 1 -- 172.21.15.150:0/1295196986 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efe0014c5c0 con 0x7efdec003a50 2024-09-17T05:45:45.779 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:45.775+0000 7efdfffff640 1 --2- 172.21.15.150:0/1295196986 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7efe000c8340 0x7efe001f4e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T05:45:45.779 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:45.775+0000 7efe04bdb640 1 --2- 172.21.15.150:0/1295196986 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7efdec003a50 0x7efe0014c080 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7efdf0001eb0 tx=0x7efdf0006290 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:45:45.779 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:45.775+0000 7efdfd7fa640 1 -- 172.21.15.150:0/1295196986 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efdf0006890 con 0x7efdec003a50 2024-09-17T05:45:45.779 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:45.775+0000 7efdfd7fa640 1 -- 172.21.15.150:0/1295196986 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7efdf0041030 con 0x7efdec003a50 2024-09-17T05:45:45.779 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:45.775+0000 7efe06e3f640 1 -- 172.21.15.150:0/1295196986 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efe000c8ac0 con 0x7efdec003a50 2024-09-17T05:45:45.779 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:45.775+0000 7efdfd7fa640 1 -- 172.21.15.150:0/1295196986 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efdf00327d0 con 0x7efdec003a50 2024-09-17T05:45:45.779 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:45.775+0000 7efe06e3f640 1 -- 172.21.15.150:0/1295196986 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efe000c9080 con 0x7efdec003a50 2024-09-17T05:45:45.779 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:45.776+0000 7efe06e3f640 1 -- 172.21.15.150:0/1295196986 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efe000ce4c0 con 0x7efdec003a50 2024-09-17T05:45:45.780 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:45.777+0000 7efdfd7fa640 1 -- 172.21.15.150:0/1295196986 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 15) ==== 102257+0+0 (secure 0 0 0) 0x7efdf003a070 con 0x7efdec003a50 2024-09-17T05:45:45.780 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:45.777+0000 7efdfd7fa640 1 --2- 172.21.15.150:0/1295196986 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7efde00794c0 0x7efde007b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:45:45.780 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:45.777+0000 7efdfd7fa640 1 -- 172.21.15.150:0/1295196986 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(60..60 src has 1..60) ==== 5737+0+0 (secure 0 0 0) 0x7efdf00be290 con 0x7efdec003a50 2024-09-17T05:45:45.780 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:45.777+0000 7efdfffff640 1 --2- 172.21.15.150:0/1295196986 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7efde00794c0 0x7efde007b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:45:45.780 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:45.778+0000 7efdfffff640 1 --2- 172.21.15.150:0/1295196986 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7efde00794c0 0x7efde007b9d0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7efde8005eb0 tx=0x7efde8005f90 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:45:45.783 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:45.781+0000 7efdfd7fa640 1 -- 172.21.15.150:0/1295196986 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7efdf0088210 con 0x7efdec003a50 2024-09-17T05:45:45.958 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:45.957+0000 7efe06e3f640 1 -- 172.21.15.150:0/1295196986 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "config get", "who": "mgr", "key": "mgr/volumes/max_concurrent_clones"} v 0) -- 0x7efe00071eb0 con 0x7efdec003a50 2024-09-17T05:45:45.959 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:45.957+0000 7efdfd7fa640 1 -- 172.21.15.150:0/1295196986 <== mon.0 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "config get", "who": "mgr", "key": "mgr/volumes/max_concurrent_clones"}]=0 v38) ==== 116+0+2 (secure 0 0 0) 0x7efdf0087b10 con 0x7efdec003a50 2024-09-17T05:45:45.959 INFO:teuthology.orchestra.run.smithi150.stdout:4 2024-09-17T05:45:45.961 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:45.959+0000 7efe06e3f640 1 -- 172.21.15.150:0/1295196986 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7efde00794c0 msgr2=0x7efde007b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:45:45.961 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:45.959+0000 7efe06e3f640 1 --2- 172.21.15.150:0/1295196986 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7efde00794c0 0x7efde007b9d0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7efde8005eb0 tx=0x7efde8005f90 comp rx=0 tx=0).stop 2024-09-17T05:45:45.961 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:45.959+0000 7efe06e3f640 1 -- 172.21.15.150:0/1295196986 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7efdec003a50 msgr2=0x7efe0014c080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:45:45.961 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:45.959+0000 7efe06e3f640 1 --2- 172.21.15.150:0/1295196986 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7efdec003a50 0x7efe0014c080 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7efdf0001eb0 tx=0x7efdf0006290 comp rx=0 tx=0).stop 2024-09-17T05:45:45.962 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:45.960+0000 7efe06e3f640 1 -- 172.21.15.150:0/1295196986 shutdown_connections 2024-09-17T05:45:45.962 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:45.960+0000 7efe06e3f640 1 --2- 172.21.15.150:0/1295196986 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7efe001f53b0 0x7efe001f57c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:45.962 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:45.960+0000 7efe06e3f640 1 --2- 172.21.15.150:0/1295196986 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7efde00794c0 0x7efde007b9d0 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:45.962 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:45.960+0000 7efe06e3f640 1 --2- 172.21.15.150:0/1295196986 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7efe000c8340 0x7efe001f4e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:45.962 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:45.960+0000 7efe06e3f640 1 --2- 172.21.15.150:0/1295196986 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7efdec003a50 0x7efe0014c080 unknown :-1 s=CLOSED pgs=671 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:45.962 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:45.960+0000 7efe06e3f640 1 -- 172.21.15.150:0/1295196986 >> 172.21.15.150:0/1295196986 conn(0x7efe000cefb0 msgr2=0x7efe0015de50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:45:45.962 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:45.960+0000 7efe06e3f640 1 -- 172.21.15.150:0/1295196986 shutdown_connections 2024-09-17T05:45:45.962 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:45.960+0000 7efe06e3f640 1 -- 172.21.15.150:0/1295196986 wait complete. 2024-09-17T05:45:45.973 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mgr mgr/volumes/max_concurrent_clones 4 2024-09-17T05:45:46.090 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:46.088+0000 7fb4e52de640 1 -- 172.21.15.150:0/1087589303 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb4cc003a00 msgr2=0x7fb4cc003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:45:46.091 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:46.089+0000 7fb4e52de640 1 --2- 172.21.15.150:0/1087589303 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb4cc003a00 0x7fb4cc003e70 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7fb4d0009b80 tx=0x7fb4cc005830 comp rx=0 tx=0).stop 2024-09-17T05:45:46.091 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:46.089+0000 7fb4df7fe640 1 -- 172.21.15.150:0/1087589303 reap_dead start 2024-09-17T05:45:46.091 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:46.089+0000 7fb4e52de640 1 -- 172.21.15.150:0/1087589303 shutdown_connections 2024-09-17T05:45:46.091 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:46.089+0000 7fb4e52de640 1 -- 172.21.15.150:0/1087589303 >> 172.21.15.150:0/1087589303 conn(0x7fb4e006d1c0 msgr2=0x7fb4e006d5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:45:46.091 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:46.089+0000 7fb4e52de640 1 -- 172.21.15.150:0/1087589303 shutdown_connections 2024-09-17T05:45:46.091 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:46.089+0000 7fb4e52de640 1 -- 172.21.15.150:0/1087589303 wait complete. 2024-09-17T05:45:46.092 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:46.090+0000 7fb4e52de640 1 Processor -- start 2024-09-17T05:45:46.092 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:46.091+0000 7fb4e52de640 1 -- start start 2024-09-17T05:45:46.095 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:46.092+0000 7fb4e52de640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb4cc003a00 0x7fb4e01f04c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:45:46.095 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:46.092+0000 7fb4e52de640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb4e01f67b0 0x7fb4e01f6bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:45:46.095 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:46.092+0000 7fb4e52de640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb4e006f180 0x7fb4e006f590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:45:46.095 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:46.092+0000 7fb4e52de640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7fb4e015d080 con 0x7fb4cc003a00 2024-09-17T05:45:46.095 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:46.092+0000 7fb4e52de640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fb4e015cf00 con 0x7fb4e01f67b0 2024-09-17T05:45:46.095 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:46.092+0000 7fb4e52de640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fb4e015d200 con 0x7fb4e006f180 2024-09-17T05:45:46.095 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:46.092+0000 7fb4deffd640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb4cc003a00 0x7fb4e01f04c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:45:46.095 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:46.092+0000 7fb4deffd640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb4cc003a00 0x7fb4e01f04c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:38306/0 (socket says 172.21.15.150:38306) 2024-09-17T05:45:46.095 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:46.092+0000 7fb4deffd640 1 -- 172.21.15.150:0/4050835848 learned_addr learned my addr 172.21.15.150:0/4050835848 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:45:46.095 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:46.092+0000 7fb4df7fe640 1 --2- 172.21.15.150:0/4050835848 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb4e006f180 0x7fb4e006f590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:45:46.095 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:46.092+0000 7fb4d67fc640 1 --2- 172.21.15.150:0/4050835848 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb4e01f67b0 0x7fb4e01f6bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:45:46.095 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:46.092+0000 7fb4deffd640 1 -- 172.21.15.150:0/4050835848 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb4e006f180 msgr2=0x7fb4e006f590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:45:46.096 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:46.092+0000 7fb4deffd640 1 --2- 172.21.15.150:0/4050835848 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb4e006f180 0x7fb4e006f590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:46.096 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:46.092+0000 7fb4deffd640 1 -- 172.21.15.150:0/4050835848 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb4e01f67b0 msgr2=0x7fb4e01f6bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:45:46.096 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:46.092+0000 7fb4deffd640 1 --2- 172.21.15.150:0/4050835848 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb4e01f67b0 0x7fb4e01f6bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:46.096 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:46.092+0000 7fb4deffd640 1 -- 172.21.15.150:0/4050835848 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb4e01f7520 con 0x7fb4cc003a00 2024-09-17T05:45:46.096 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:46.092+0000 7fb4d67fc640 1 --2- 172.21.15.150:0/4050835848 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb4e01f67b0 0x7fb4e01f6bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:45:46.096 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:46.092+0000 7fb4df7fe640 1 --2- 172.21.15.150:0/4050835848 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb4e006f180 0x7fb4e006f590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:45:46.096 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:46.092+0000 7fb4deffd640 1 --2- 172.21.15.150:0/4050835848 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb4cc003a00 0x7fb4e01f04c0 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7fb4d002b530 tx=0x7fb4d0033b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:45:46.096 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:46.093+0000 7fb4d7fff640 1 -- 172.21.15.150:0/4050835848 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb4d0038040 con 0x7fb4cc003a00 2024-09-17T05:45:46.096 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:46.093+0000 7fb4d7fff640 1 -- 172.21.15.150:0/4050835848 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb4d0033ca0 con 0x7fb4cc003a00 2024-09-17T05:45:46.096 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:46.093+0000 7fb4e52de640 1 -- 172.21.15.150:0/4050835848 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb4e006fad0 con 0x7fb4cc003a00 2024-09-17T05:45:46.096 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:46.093+0000 7fb4d7fff640 1 -- 172.21.15.150:0/4050835848 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb4d0004280 con 0x7fb4cc003a00 2024-09-17T05:45:46.096 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:46.093+0000 7fb4e52de640 1 -- 172.21.15.150:0/4050835848 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb4e013fb10 con 0x7fb4cc003a00 2024-09-17T05:45:46.097 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:46.094+0000 7fb4e52de640 1 -- 172.21.15.150:0/4050835848 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb4e00cf570 con 0x7fb4cc003a00 2024-09-17T05:45:46.097 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:46.094+0000 7fb4d7fff640 1 -- 172.21.15.150:0/4050835848 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 15) ==== 102257+0+0 (secure 0 0 0) 0x7fb4d0045020 con 0x7fb4cc003a00 2024-09-17T05:45:46.097 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:46.095+0000 7fb4d7fff640 1 --2- 172.21.15.150:0/4050835848 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fb4c0079490 0x7fb4c007b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:45:46.098 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:46.095+0000 7fb4d7fff640 1 -- 172.21.15.150:0/4050835848 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(60..60 src has 1..60) ==== 5737+0+0 (secure 0 0 0) 0x7fb4d00ba3c0 con 0x7fb4cc003a00 2024-09-17T05:45:46.098 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:46.095+0000 7fb4d67fc640 1 --2- 172.21.15.150:0/4050835848 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fb4c0079490 0x7fb4c007b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:45:46.098 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:46.096+0000 7fb4d67fc640 1 --2- 172.21.15.150:0/4050835848 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fb4c0079490 0x7fb4c007b9a0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7fb4c8001860 tx=0x7fb4c8001cc0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:45:46.101 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:46.099+0000 7fb4d7fff640 1 -- 172.21.15.150:0/4050835848 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fb4e006fad0 con 0x7fb4cc003a00 2024-09-17T05:45:46.279 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:46.277+0000 7fb4e52de640 1 -- 172.21.15.150:0/4050835848 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command([{prefix=config set, name=mgr/volumes/max_concurrent_clones}] v 0) -- 0x7fb4e0152da0 con 0x7fb4cc003a00 2024-09-17T05:45:46.282 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:46.281+0000 7fb4d7fff640 1 -- 172.21.15.150:0/4050835848 <== mon.0 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/volumes/max_concurrent_clones}]=0 v39)=0 v39) ==== 131+0+0 (secure 0 0 0) 0x7fb4e01f7520 con 0x7fb4cc003a00 2024-09-17T05:45:46.285 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:46.283+0000 7fb4e52de640 1 -- 172.21.15.150:0/4050835848 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fb4c0079490 msgr2=0x7fb4c007b9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:45:46.285 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:46.284+0000 7fb4e52de640 1 --2- 172.21.15.150:0/4050835848 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fb4c0079490 0x7fb4c007b9a0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7fb4c8001860 tx=0x7fb4c8001cc0 comp rx=0 tx=0).stop 2024-09-17T05:45:46.286 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:46.284+0000 7fb4e52de640 1 -- 172.21.15.150:0/4050835848 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb4cc003a00 msgr2=0x7fb4e01f04c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:45:46.286 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:46.284+0000 7fb4e52de640 1 --2- 172.21.15.150:0/4050835848 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb4cc003a00 0x7fb4e01f04c0 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7fb4d002b530 tx=0x7fb4d0033b30 comp rx=0 tx=0).stop 2024-09-17T05:45:46.286 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:46.284+0000 7fb4e52de640 1 -- 172.21.15.150:0/4050835848 shutdown_connections 2024-09-17T05:45:46.286 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:46.284+0000 7fb4e52de640 1 --2- 172.21.15.150:0/4050835848 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb4e01f67b0 0x7fb4e01f6bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:46.286 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:46.284+0000 7fb4e52de640 1 --2- 172.21.15.150:0/4050835848 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fb4c0079490 0x7fb4c007b9a0 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:46.286 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:46.284+0000 7fb4e52de640 1 --2- 172.21.15.150:0/4050835848 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb4e006f180 0x7fb4e006f590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:46.286 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:46.284+0000 7fb4e52de640 1 --2- 172.21.15.150:0/4050835848 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb4cc003a00 0x7fb4e01f04c0 unknown :-1 s=CLOSED pgs=674 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:46.286 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:46.284+0000 7fb4e52de640 1 -- 172.21.15.150:0/4050835848 >> 172.21.15.150:0/4050835848 conn(0x7fb4e006d1c0 msgr2=0x7fb4e015e940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:45:46.286 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:46.284+0000 7fb4e52de640 1 -- 172.21.15.150:0/4050835848 shutdown_connections 2024-09-17T05:45:46.286 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:46.284+0000 7fb4e52de640 1 -- 172.21.15.150:0/4050835848 wait complete. 2024-09-17T05:45:46.297 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume create cephfs sv1 --mode=777 2024-09-17T05:45:46.301 INFO:tasks.ceph.mgr.x.smithi176.stderr:2024-09-17T05:45:46.300+0000 7f33da720640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-17T05:45:46.301 INFO:tasks.ceph.mgr.x.smithi176.stderr:2024-09-17T05:45:46.300+0000 7f33da720640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-17T05:45:46.301 INFO:tasks.ceph.mgr.x.smithi176.stderr:2024-09-17T05:45:46.300+0000 7f33da720640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-17T05:45:46.301 INFO:tasks.ceph.mgr.x.smithi176.stderr:2024-09-17T05:45:46.300+0000 7f33da720640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-17T05:45:46.301 INFO:tasks.ceph.mgr.x.smithi176.stderr:2024-09-17T05:45:46.300+0000 7f33da720640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-17T05:45:46.415 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:46.413+0000 7f48b3ede640 1 -- 172.21.15.150:0/2591980616 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f48ac15f140 msgr2=0x7f48ac0ae7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:45:46.415 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:46.413+0000 7f48b3ede640 1 --2- 172.21.15.150:0/2591980616 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f48ac15f140 0x7f48ac0ae7d0 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7f48a4005fd0 tx=0x7f48a402aa00 comp rx=0 tx=0).stop 2024-09-17T05:45:46.416 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:46.413+0000 7f48b3ede640 1 -- 172.21.15.150:0/2591980616 shutdown_connections 2024-09-17T05:45:46.416 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:46.413+0000 7f48b3ede640 1 --2- 172.21.15.150:0/2591980616 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f48ac15f140 0x7f48ac0ae7d0 unknown :-1 s=CLOSED pgs=676 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:46.416 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:46.413+0000 7f48b3ede640 1 --2- 172.21.15.150:0/2591980616 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f48ac0b4a00 0x7f48ac06d7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:46.416 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:46.413+0000 7f48b3ede640 1 -- 172.21.15.150:0/2591980616 >> 172.21.15.150:0/2591980616 conn(0x7f48ac09aa50 msgr2=0x7f48ac0b2ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:45:46.416 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:46.414+0000 7f48b3ede640 1 -- 172.21.15.150:0/2591980616 shutdown_connections 2024-09-17T05:45:46.416 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:46.414+0000 7f48b3ede640 1 -- 172.21.15.150:0/2591980616 wait complete. 2024-09-17T05:45:46.417 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:46.415+0000 7f48b3ede640 1 Processor -- start 2024-09-17T05:45:46.417 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:46.415+0000 7f48b3ede640 1 -- start start 2024-09-17T05:45:46.420 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:46.417+0000 7f48b3ede640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f48ac0d0ea0 0x7f48ac145920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:45:46.420 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:46.417+0000 7f48b3ede640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f48ac15f140 0x7f48ac09f020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:45:46.420 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:46.417+0000 7f48b3ede640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f48ac1f9e00 0x7f48ac09bd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:45:46.420 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:46.417+0000 7f48b3ede640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f48ac0af240 con 0x7f48ac0d0ea0 2024-09-17T05:45:46.420 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:46.417+0000 7f48b3ede640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f48ac0af0c0 con 0x7f48ac15f140 2024-09-17T05:45:46.420 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:46.417+0000 7f48b3ede640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f48ac0af3c0 con 0x7f48ac1f9e00 2024-09-17T05:45:46.420 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:46.417+0000 7f48b1c7a640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f48ac0d0ea0 0x7f48ac145920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:45:46.420 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:46.417+0000 7f48b1c7a640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f48ac0d0ea0 0x7f48ac145920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:38320/0 (socket says 172.21.15.150:38320) 2024-09-17T05:45:46.420 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:46.417+0000 7f48b1c7a640 1 -- 172.21.15.150:0/174254724 learned_addr learned my addr 172.21.15.150:0/174254724 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:45:46.421 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:46.417+0000 7f48b247b640 1 --2- 172.21.15.150:0/174254724 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f48ac1f9e00 0x7f48ac09bd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:45:46.421 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:46.417+0000 7f48b1479640 1 --2- 172.21.15.150:0/174254724 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f48ac15f140 0x7f48ac09f020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:45:46.421 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:46.417+0000 7f48b1c7a640 1 -- 172.21.15.150:0/174254724 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f48ac1f9e00 msgr2=0x7f48ac09bd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:45:46.421 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:46.417+0000 7f48b1c7a640 1 --2- 172.21.15.150:0/174254724 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f48ac1f9e00 0x7f48ac09bd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:46.421 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:46.417+0000 7f48b1c7a640 1 -- 172.21.15.150:0/174254724 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f48ac15f140 msgr2=0x7f48ac09f020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:45:46.421 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:46.417+0000 7f48b1c7a640 1 --2- 172.21.15.150:0/174254724 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f48ac15f140 0x7f48ac09f020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:46.421 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:46.417+0000 7f48b1c7a640 1 -- 172.21.15.150:0/174254724 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f48ac09f560 con 0x7f48ac0d0ea0 2024-09-17T05:45:46.421 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:46.417+0000 7f48b1479640 1 --2- 172.21.15.150:0/174254724 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f48ac15f140 0x7f48ac09f020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T05:45:46.421 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:46.417+0000 7f48b1c7a640 1 --2- 172.21.15.150:0/174254724 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f48ac0d0ea0 0x7f48ac145920 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7f48a800b420 tx=0x7f48a800b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:45:46.421 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:46.417+0000 7f48a27fc640 1 -- 172.21.15.150:0/174254724 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48a8011830 con 0x7f48ac0d0ea0 2024-09-17T05:45:46.421 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:46.417+0000 7f48a27fc640 1 -- 172.21.15.150:0/174254724 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f48a8016070 con 0x7f48ac0d0ea0 2024-09-17T05:45:46.422 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:46.417+0000 7f48b3ede640 1 -- 172.21.15.150:0/174254724 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f48ac09c7d0 con 0x7f48ac0d0ea0 2024-09-17T05:45:46.422 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:46.417+0000 7f48a27fc640 1 -- 172.21.15.150:0/174254724 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48a8011d60 con 0x7f48ac0d0ea0 2024-09-17T05:45:46.422 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:46.417+0000 7f48b3ede640 1 -- 172.21.15.150:0/174254724 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f48ac09b580 con 0x7f48ac0d0ea0 2024-09-17T05:45:46.422 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:46.418+0000 7f48b3ede640 1 -- 172.21.15.150:0/174254724 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f48ac0af8b0 con 0x7f48ac0d0ea0 2024-09-17T05:45:46.423 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:46.419+0000 7f48a27fc640 1 -- 172.21.15.150:0/174254724 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 15) ==== 102257+0+0 (secure 0 0 0) 0x7f48a801b460 con 0x7f48ac0d0ea0 2024-09-17T05:45:46.423 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:46.420+0000 7f48a27fc640 1 --2- 172.21.15.150:0/174254724 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f48900794c0 0x7f489007b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:45:46.423 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:46.420+0000 7f48a27fc640 1 -- 172.21.15.150:0/174254724 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(60..60 src has 1..60) ==== 5737+0+0 (secure 0 0 0) 0x7f48a8099070 con 0x7f48ac0d0ea0 2024-09-17T05:45:46.423 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:46.420+0000 7f48b1479640 1 --2- 172.21.15.150:0/174254724 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f48900794c0 0x7f489007b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:45:46.424 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:46.421+0000 7f48b1479640 1 --2- 172.21.15.150:0/174254724 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f48900794c0 0x7f489007b9d0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f48ac06d7b0 tx=0x7f489c005dd0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:45:46.426 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:46.425+0000 7f48a27fc640 1 -- 172.21.15.150:0/174254724 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f48a8020020 con 0x7f48ac0d0ea0 2024-09-17T05:45:46.627 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:46.626+0000 7f48b3ede640 1 -- 172.21.15.150:0/174254724 --> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] -- mgr_command(tid 0: {"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv1", "mode": "777", "target": ["mon-mgr", ""]}) -- 0x7f48ac071900 con 0x7f48900794c0 2024-09-17T05:45:46.636 INFO:tasks.ceph.mgr.x.smithi176.stderr:2024-09-17T05:45:46.635+0000 7f33d771a640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-17T05:45:46.636 INFO:tasks.ceph.mgr.x.smithi176.stderr:2024-09-17T05:45:46.635+0000 7f33d771a640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-17T05:45:46.636 INFO:tasks.ceph.mgr.x.smithi176.stderr:2024-09-17T05:45:46.635+0000 7f33d771a640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-17T05:45:46.636 INFO:tasks.ceph.mgr.x.smithi176.stderr:2024-09-17T05:45:46.635+0000 7f33d771a640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-17T05:45:46.636 INFO:tasks.ceph.mgr.x.smithi176.stderr:2024-09-17T05:45:46.635+0000 7f33d771a640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-17T05:45:46.670 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:46.668+0000 7f48a27fc640 1 -- 172.21.15.150:0/174254724 <== mgr.4108 v2:172.21.15.176:6800/3631216395 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f48ac071900 con 0x7f48900794c0 2024-09-17T05:45:46.672 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:46.670+0000 7f48b3ede640 1 -- 172.21.15.150:0/174254724 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f48900794c0 msgr2=0x7f489007b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:45:46.672 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:46.670+0000 7f48b3ede640 1 --2- 172.21.15.150:0/174254724 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f48900794c0 0x7f489007b9d0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f48ac06d7b0 tx=0x7f489c005dd0 comp rx=0 tx=0).stop 2024-09-17T05:45:46.673 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:46.670+0000 7f48b3ede640 1 -- 172.21.15.150:0/174254724 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f48ac0d0ea0 msgr2=0x7f48ac145920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:45:46.673 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:46.670+0000 7f48b3ede640 1 --2- 172.21.15.150:0/174254724 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f48ac0d0ea0 0x7f48ac145920 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7f48a800b420 tx=0x7f48a800b8e0 comp rx=0 tx=0).stop 2024-09-17T05:45:46.673 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:46.670+0000 7f48b3ede640 1 -- 172.21.15.150:0/174254724 shutdown_connections 2024-09-17T05:45:46.673 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:46.670+0000 7f48b3ede640 1 --2- 172.21.15.150:0/174254724 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f48ac15f140 0x7f48ac09f020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:46.673 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:46.670+0000 7f48b3ede640 1 --2- 172.21.15.150:0/174254724 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f48900794c0 0x7f489007b9d0 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:46.673 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:46.670+0000 7f48b3ede640 1 --2- 172.21.15.150:0/174254724 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f48ac1f9e00 0x7f48ac09bd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:46.673 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:46.670+0000 7f48b3ede640 1 --2- 172.21.15.150:0/174254724 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f48ac0d0ea0 0x7f48ac145920 unknown :-1 s=CLOSED pgs=677 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:46.673 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:46.670+0000 7f48b3ede640 1 -- 172.21.15.150:0/174254724 >> 172.21.15.150:0/174254724 conn(0x7f48ac09aa50 msgr2=0x7f48ac158d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:45:46.673 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:46.671+0000 7f48b3ede640 1 -- 172.21.15.150:0/174254724 shutdown_connections 2024-09-17T05:45:46.673 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:46.671+0000 7f48b3ede640 1 -- 172.21.15.150:0/174254724 wait complete. 2024-09-17T05:45:46.684 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume getpath cephfs sv1 2024-09-17T05:45:46.801 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:46.799+0000 7f2592fc6640 1 -- 172.21.15.150:0/4285803677 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f258c0d10d0 msgr2=0x7f258c0cd010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:45:46.801 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:46.799+0000 7f2592fc6640 1 --2- 172.21.15.150:0/4285803677 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f258c0d10d0 0x7f258c0cd010 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7f2584005fd0 tx=0x7f258402a820 comp rx=0 tx=0).stop 2024-09-17T05:45:46.801 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:46.799+0000 7f2592fc6640 1 -- 172.21.15.150:0/4285803677 shutdown_connections 2024-09-17T05:45:46.801 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:46.799+0000 7f2592fc6640 1 --2- 172.21.15.150:0/4285803677 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f258c0d10d0 0x7f258c0cd010 unknown :-1 s=CLOSED pgs=679 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:46.802 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:46.799+0000 7f2592fc6640 1 --2- 172.21.15.150:0/4285803677 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f258c0af1d0 0x7f258c0b7950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:46.802 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:46.799+0000 7f2592fc6640 1 -- 172.21.15.150:0/4285803677 >> 172.21.15.150:0/4285803677 conn(0x7f258c0cef80 msgr2=0x7f258c0cf390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:45:46.802 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:46.799+0000 7f2592fc6640 1 -- 172.21.15.150:0/4285803677 shutdown_connections 2024-09-17T05:45:46.802 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:46.799+0000 7f2592fc6640 1 -- 172.21.15.150:0/4285803677 wait complete. 2024-09-17T05:45:46.802 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:46.801+0000 7f2592fc6640 1 Processor -- start 2024-09-17T05:45:46.803 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:46.801+0000 7f2592fc6640 1 -- start start 2024-09-17T05:45:46.805 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:46.803+0000 7f2592fc6640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f258c0af1d0 0x7f258c1602a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:45:46.806 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:46.803+0000 7f2592fc6640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f258c0af5e0 0x7f258c09c880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:45:46.806 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:46.803+0000 7f2592fc6640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f258c0d10d0 0x7f258c09cdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:45:46.806 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:46.803+0000 7f2592fc6640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f258c0b19e0 con 0x7f258c0af1d0 2024-09-17T05:45:46.806 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:46.803+0000 7f2592fc6640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f258c0b1860 con 0x7f258c0af5e0 2024-09-17T05:45:46.806 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:46.803+0000 7f2592fc6640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f258c0b7e90 con 0x7f258c0d10d0 2024-09-17T05:45:46.806 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:46.803+0000 7f2590d62640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f258c0af1d0 0x7f258c1602a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:45:46.806 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:46.803+0000 7f2590d62640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f258c0af1d0 0x7f258c1602a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:38332/0 (socket says 172.21.15.150:38332) 2024-09-17T05:45:46.806 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:46.803+0000 7f2590d62640 1 -- 172.21.15.150:0/4203542806 learned_addr learned my addr 172.21.15.150:0/4203542806 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:45:46.806 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:46.803+0000 7f2591563640 1 --2- 172.21.15.150:0/4203542806 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f258c0d10d0 0x7f258c09cdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:45:46.806 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:46.803+0000 7f2590d62640 1 -- 172.21.15.150:0/4203542806 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f258c0d10d0 msgr2=0x7f258c09cdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:45:46.806 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:46.803+0000 7f258bfff640 1 --2- 172.21.15.150:0/4203542806 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f258c0af5e0 0x7f258c09c880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:45:46.806 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:46.803+0000 7f2590d62640 1 --2- 172.21.15.150:0/4203542806 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f258c0d10d0 0x7f258c09cdc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:46.806 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:46.803+0000 7f2590d62640 1 -- 172.21.15.150:0/4203542806 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f258c0af5e0 msgr2=0x7f258c09c880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:45:46.807 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:46.803+0000 7f2590d62640 1 --2- 172.21.15.150:0/4203542806 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f258c0af5e0 0x7f258c09c880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:46.807 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:46.803+0000 7f2590d62640 1 -- 172.21.15.150:0/4203542806 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f258c158560 con 0x7f258c0af1d0 2024-09-17T05:45:46.807 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:46.803+0000 7f258bfff640 1 --2- 172.21.15.150:0/4203542806 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f258c0af5e0 0x7f258c09c880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T05:45:46.807 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:46.803+0000 7f2590d62640 1 --2- 172.21.15.150:0/4203542806 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f258c0af1d0 0x7f258c1602a0 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7f257c00d750 tx=0x7f257c00dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:45:46.807 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:46.803+0000 7f25897fa640 1 -- 172.21.15.150:0/4203542806 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f257c017070 con 0x7f258c0af1d0 2024-09-17T05:45:46.807 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:46.803+0000 7f25897fa640 1 -- 172.21.15.150:0/4203542806 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f257c004310 con 0x7f258c0af1d0 2024-09-17T05:45:46.807 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:46.803+0000 7f2592fc6640 1 -- 172.21.15.150:0/4203542806 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f258c158840 con 0x7f258c0af1d0 2024-09-17T05:45:46.807 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:46.803+0000 7f25897fa640 1 -- 172.21.15.150:0/4203542806 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f257c00de60 con 0x7f258c0af1d0 2024-09-17T05:45:46.807 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:46.804+0000 7f2592fc6640 1 -- 172.21.15.150:0/4203542806 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f258c15d6f0 con 0x7f258c0af1d0 2024-09-17T05:45:46.808 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:46.805+0000 7f2592fc6640 1 -- 172.21.15.150:0/4203542806 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f258c15d950 con 0x7f258c0af1d0 2024-09-17T05:45:46.808 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:46.805+0000 7f25897fa640 1 -- 172.21.15.150:0/4203542806 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 15) ==== 102257+0+0 (secure 0 0 0) 0x7f257c009c30 con 0x7f258c0af1d0 2024-09-17T05:45:46.808 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:46.806+0000 7f25897fa640 1 --2- 172.21.15.150:0/4203542806 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f2578079490 0x7f257807b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:45:46.808 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:46.806+0000 7f25897fa640 1 -- 172.21.15.150:0/4203542806 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(60..60 src has 1..60) ==== 5737+0+0 (secure 0 0 0) 0x7f257c0999b0 con 0x7f258c0af1d0 2024-09-17T05:45:46.808 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:46.806+0000 7f258bfff640 1 --2- 172.21.15.150:0/4203542806 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f2578079490 0x7f257807b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:45:46.809 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:46.807+0000 7f258bfff640 1 --2- 172.21.15.150:0/4203542806 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f2578079490 0x7f257807b9a0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f258c1f6c70 tx=0x7f2580009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:45:46.812 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:46.811+0000 7f25897fa640 1 -- 172.21.15.150:0/4203542806 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f257c020020 con 0x7f258c0af1d0 2024-09-17T05:45:47.013 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:47.011+0000 7f2592fc6640 1 -- 172.21.15.150:0/4203542806 --> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "sub_name": "sv1", "target": ["mon-mgr", ""]}) -- 0x7f258c0b0b30 con 0x7f2578079490 2024-09-17T05:45:47.019 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:47.017+0000 7f25897fa640 1 -- 172.21.15.150:0/4203542806 <== mgr.4108 v2:172.21.15.176:6800/3631216395 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+59 (secure 0 0 0) 0x7f258c0b0b30 con 0x7f2578079490 2024-09-17T05:45:47.019 INFO:teuthology.orchestra.run.smithi150.stdout:/volumes/_nogroup/sv1/298b5319-2472-402c-b6a6-1ca1b54b4570 2024-09-17T05:45:47.021 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:47.019+0000 7f2592fc6640 1 -- 172.21.15.150:0/4203542806 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f2578079490 msgr2=0x7f257807b9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:45:47.021 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:47.019+0000 7f2592fc6640 1 --2- 172.21.15.150:0/4203542806 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f2578079490 0x7f257807b9a0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f258c1f6c70 tx=0x7f2580009040 comp rx=0 tx=0).stop 2024-09-17T05:45:47.022 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:47.019+0000 7f2592fc6640 1 -- 172.21.15.150:0/4203542806 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f258c0af1d0 msgr2=0x7f258c1602a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:45:47.022 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:47.019+0000 7f2592fc6640 1 --2- 172.21.15.150:0/4203542806 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f258c0af1d0 0x7f258c1602a0 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7f257c00d750 tx=0x7f257c00dc10 comp rx=0 tx=0).stop 2024-09-17T05:45:47.022 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:47.020+0000 7f2592fc6640 1 -- 172.21.15.150:0/4203542806 shutdown_connections 2024-09-17T05:45:47.022 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:47.020+0000 7f2592fc6640 1 --2- 172.21.15.150:0/4203542806 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f258c0af5e0 0x7f258c09c880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:47.022 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:47.020+0000 7f2592fc6640 1 --2- 172.21.15.150:0/4203542806 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f2578079490 0x7f257807b9a0 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:47.022 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:47.020+0000 7f2592fc6640 1 --2- 172.21.15.150:0/4203542806 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f258c0d10d0 0x7f258c09cdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:47.022 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:47.020+0000 7f2592fc6640 1 --2- 172.21.15.150:0/4203542806 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f258c0af1d0 0x7f258c1602a0 unknown :-1 s=CLOSED pgs=680 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:47.022 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:47.020+0000 7f2592fc6640 1 -- 172.21.15.150:0/4203542806 >> 172.21.15.150:0/4203542806 conn(0x7f258c0cef80 msgr2=0x7f258c0ce280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:45:47.022 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:47.020+0000 7f2592fc6640 1 -- 172.21.15.150:0/4203542806 shutdown_connections 2024-09-17T05:45:47.022 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:45:47.020+0000 7f2592fc6640 1 -- 172.21.15.150:0/4203542806 wait complete. 2024-09-17T05:45:47.033 DEBUG:tasks.cephfs.test_volumes:filling subvolume sv1 with 10 files each 1024MB size under directory volumes/_nogroup/sv1/298b5319-2472-402c-b6a6-1ca1b54b4570 2024-09-17T05:45:47.033 DEBUG:teuthology.orchestra.run.smithi150:> set -ex 2024-09-17T05:45:47.033 DEBUG:teuthology.orchestra.run.smithi150:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T05:45:47.049 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:45:47.050 DEBUG:teuthology.orchestra.run.smithi150:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/sv1/298b5319-2472-402c-b6a6-1ca1b54b4570/subvolume_file.0 bs=1M conv=fdatasync count=1024 seek=0) 2024-09-17T05:45:50.850 INFO:teuthology.orchestra.run.smithi150.stderr:1024+0 records in 2024-09-17T05:45:50.850 INFO:teuthology.orchestra.run.smithi150.stderr:1024+0 records out 2024-09-17T05:45:50.850 INFO:teuthology.orchestra.run.smithi150.stderr:1073741824 bytes (1.1 GB, 1.0 GiB) copied, 3.73729 s, 287 MB/s 2024-09-17T05:45:50.850 DEBUG:teuthology.orchestra.run.smithi150:> set -ex 2024-09-17T05:45:50.850 DEBUG:teuthology.orchestra.run.smithi150:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T05:45:50.866 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:45:50.867 DEBUG:teuthology.orchestra.run.smithi150:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/sv1/298b5319-2472-402c-b6a6-1ca1b54b4570/subvolume_file.1 bs=1M conv=fdatasync count=1024 seek=0) 2024-09-17T05:45:54.721 INFO:teuthology.orchestra.run.smithi150.stderr:1024+0 records in 2024-09-17T05:45:54.721 INFO:teuthology.orchestra.run.smithi150.stderr:1024+0 records out 2024-09-17T05:45:54.721 INFO:teuthology.orchestra.run.smithi150.stderr:1073741824 bytes (1.1 GB, 1.0 GiB) copied, 3.79688 s, 283 MB/s 2024-09-17T05:45:54.721 DEBUG:teuthology.orchestra.run.smithi150:> set -ex 2024-09-17T05:45:54.721 DEBUG:teuthology.orchestra.run.smithi150:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T05:45:54.738 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:45:54.738 DEBUG:teuthology.orchestra.run.smithi150:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/sv1/298b5319-2472-402c-b6a6-1ca1b54b4570/subvolume_file.2 bs=1M conv=fdatasync count=1024 seek=0) 2024-09-17T05:45:55.075 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-17T05:45:55.309 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-17T05:45:58.579 INFO:teuthology.orchestra.run.smithi150.stderr:1024+0 records in 2024-09-17T05:45:58.579 INFO:teuthology.orchestra.run.smithi150.stderr:1024+0 records out 2024-09-17T05:45:58.579 INFO:teuthology.orchestra.run.smithi150.stderr:1073741824 bytes (1.1 GB, 1.0 GiB) copied, 3.78183 s, 284 MB/s 2024-09-17T05:45:58.580 DEBUG:teuthology.orchestra.run.smithi150:> set -ex 2024-09-17T05:45:58.580 DEBUG:teuthology.orchestra.run.smithi150:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T05:45:58.596 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:45:58.596 DEBUG:teuthology.orchestra.run.smithi150:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/sv1/298b5319-2472-402c-b6a6-1ca1b54b4570/subvolume_file.3 bs=1M conv=fdatasync count=1024 seek=0) 2024-09-17T05:46:02.377 INFO:teuthology.orchestra.run.smithi150.stderr:1024+0 records in 2024-09-17T05:46:02.378 INFO:teuthology.orchestra.run.smithi150.stderr:1024+0 records out 2024-09-17T05:46:02.378 INFO:teuthology.orchestra.run.smithi150.stderr:1073741824 bytes (1.1 GB, 1.0 GiB) copied, 3.72364 s, 288 MB/s 2024-09-17T05:46:02.378 DEBUG:teuthology.orchestra.run.smithi150:> set -ex 2024-09-17T05:46:02.378 DEBUG:teuthology.orchestra.run.smithi150:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T05:46:02.394 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:46:02.394 DEBUG:teuthology.orchestra.run.smithi150:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/sv1/298b5319-2472-402c-b6a6-1ca1b54b4570/subvolume_file.4 bs=1M conv=fdatasync count=1024 seek=0) 2024-09-17T05:46:06.247 INFO:teuthology.orchestra.run.smithi150.stderr:1024+0 records in 2024-09-17T05:46:06.247 INFO:teuthology.orchestra.run.smithi150.stderr:1024+0 records out 2024-09-17T05:46:06.247 INFO:teuthology.orchestra.run.smithi150.stderr:1073741824 bytes (1.1 GB, 1.0 GiB) copied, 3.79593 s, 283 MB/s 2024-09-17T05:46:06.248 DEBUG:teuthology.orchestra.run.smithi150:> set -ex 2024-09-17T05:46:06.248 DEBUG:teuthology.orchestra.run.smithi150:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T05:46:06.264 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:46:06.264 DEBUG:teuthology.orchestra.run.smithi150:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/sv1/298b5319-2472-402c-b6a6-1ca1b54b4570/subvolume_file.5 bs=1M conv=fdatasync count=1024 seek=0) 2024-09-17T05:46:10.139 INFO:teuthology.orchestra.run.smithi150.stderr:1024+0 records in 2024-09-17T05:46:10.139 INFO:teuthology.orchestra.run.smithi150.stderr:1024+0 records out 2024-09-17T05:46:10.140 INFO:teuthology.orchestra.run.smithi150.stderr:1073741824 bytes (1.1 GB, 1.0 GiB) copied, 3.81746 s, 281 MB/s 2024-09-17T05:46:10.140 DEBUG:teuthology.orchestra.run.smithi150:> set -ex 2024-09-17T05:46:10.140 DEBUG:teuthology.orchestra.run.smithi150:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T05:46:10.157 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:46:10.157 DEBUG:teuthology.orchestra.run.smithi150:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/sv1/298b5319-2472-402c-b6a6-1ca1b54b4570/subvolume_file.6 bs=1M conv=fdatasync count=1024 seek=0) 2024-09-17T05:46:14.000 INFO:teuthology.orchestra.run.smithi150.stderr:1024+0 records in 2024-09-17T05:46:14.000 INFO:teuthology.orchestra.run.smithi150.stderr:1024+0 records out 2024-09-17T05:46:14.000 INFO:teuthology.orchestra.run.smithi150.stderr:1073741824 bytes (1.1 GB, 1.0 GiB) copied, 3.78542 s, 284 MB/s 2024-09-17T05:46:14.001 DEBUG:teuthology.orchestra.run.smithi150:> set -ex 2024-09-17T05:46:14.001 DEBUG:teuthology.orchestra.run.smithi150:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T05:46:14.017 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:46:14.017 DEBUG:teuthology.orchestra.run.smithi150:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/sv1/298b5319-2472-402c-b6a6-1ca1b54b4570/subvolume_file.7 bs=1M conv=fdatasync count=1024 seek=0) 2024-09-17T05:46:17.840 INFO:teuthology.orchestra.run.smithi150.stderr:1024+0 records in 2024-09-17T05:46:17.840 INFO:teuthology.orchestra.run.smithi150.stderr:1024+0 records out 2024-09-17T05:46:17.840 INFO:teuthology.orchestra.run.smithi150.stderr:1073741824 bytes (1.1 GB, 1.0 GiB) copied, 3.76552 s, 285 MB/s 2024-09-17T05:46:17.841 DEBUG:teuthology.orchestra.run.smithi150:> set -ex 2024-09-17T05:46:17.841 DEBUG:teuthology.orchestra.run.smithi150:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T05:46:17.856 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:46:17.857 DEBUG:teuthology.orchestra.run.smithi150:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/sv1/298b5319-2472-402c-b6a6-1ca1b54b4570/subvolume_file.8 bs=1M conv=fdatasync count=1024 seek=0) 2024-09-17T05:46:21.688 INFO:teuthology.orchestra.run.smithi150.stderr:1024+0 records in 2024-09-17T05:46:21.689 INFO:teuthology.orchestra.run.smithi150.stderr:1024+0 records out 2024-09-17T05:46:21.689 INFO:teuthology.orchestra.run.smithi150.stderr:1073741824 bytes (1.1 GB, 1.0 GiB) copied, 3.77398 s, 285 MB/s 2024-09-17T05:46:21.689 DEBUG:teuthology.orchestra.run.smithi150:> set -ex 2024-09-17T05:46:21.689 DEBUG:teuthology.orchestra.run.smithi150:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T05:46:21.705 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:46:21.705 DEBUG:teuthology.orchestra.run.smithi150:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/sv1/298b5319-2472-402c-b6a6-1ca1b54b4570/subvolume_file.9 bs=1M conv=fdatasync count=1024 seek=0) 2024-09-17T05:46:25.445 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-17T05:46:25.448 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-17T05:46:25.491 INFO:teuthology.orchestra.run.smithi150.stderr:1024+0 records in 2024-09-17T05:46:25.492 INFO:teuthology.orchestra.run.smithi150.stderr:1024+0 records out 2024-09-17T05:46:25.492 INFO:teuthology.orchestra.run.smithi150.stderr:1073741824 bytes (1.1 GB, 1.0 GiB) copied, 3.73024 s, 288 MB/s 2024-09-17T05:46:25.493 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume snapshot create cephfs sv1 ss1 2024-09-17T05:46:25.612 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:25.610+0000 7f2031c4d640 1 -- 172.21.15.150:0/4108078238 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2014004d90 msgr2=0x7f2014005220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:46:25.612 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:25.610+0000 7f2031c4d640 1 --2- 172.21.15.150:0/4108078238 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2014004d90 0x7f2014005220 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7f2024001ea0 tx=0x7f2014005830 comp rx=0 tx=0).stop 2024-09-17T05:46:25.612 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:25.610+0000 7f202bfff640 1 -- 172.21.15.150:0/4108078238 reap_dead start 2024-09-17T05:46:25.612 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:25.610+0000 7f2031c4d640 1 -- 172.21.15.150:0/4108078238 shutdown_connections 2024-09-17T05:46:25.612 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:25.610+0000 7f2031c4d640 1 -- 172.21.15.150:0/4108078238 >> 172.21.15.150:0/4108078238 conn(0x7f202c0d46f0 msgr2=0x7f202c0d4b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:46:25.612 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:25.610+0000 7f2031c4d640 1 -- 172.21.15.150:0/4108078238 shutdown_connections 2024-09-17T05:46:25.612 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:25.610+0000 7f2031c4d640 1 -- 172.21.15.150:0/4108078238 wait complete. 2024-09-17T05:46:25.613 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:25.612+0000 7f2031c4d640 1 Processor -- start 2024-09-17T05:46:25.613 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:25.612+0000 7f2031c4d640 1 -- start start 2024-09-17T05:46:25.616 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:25.613+0000 7f2031c4d640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2014004d90 0x7f202c0a1020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:46:25.616 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:25.613+0000 7f2031c4d640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f202c0cdf90 0x7f202c0cc9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:46:25.616 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:25.613+0000 7f2031c4d640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f202c0ce3a0 0x7f202c0ccf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:46:25.616 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:25.613+0000 7f2031c4d640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f202c0ba200 con 0x7f202c0ce3a0 2024-09-17T05:46:25.616 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:25.613+0000 7f2031c4d640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f202c0ba080 con 0x7f202c0cdf90 2024-09-17T05:46:25.617 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:25.613+0000 7f2031c4d640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f202c0d1130 con 0x7f2014004d90 2024-09-17T05:46:25.617 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:25.613+0000 7f202bfff640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f202c0ce3a0 0x7f202c0ccf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:46:25.617 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:25.613+0000 7f202bfff640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f202c0ce3a0 0x7f202c0ccf30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:53754/0 (socket says 172.21.15.150:53754) 2024-09-17T05:46:25.617 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:25.613+0000 7f202bfff640 1 -- 172.21.15.150:0/2775224398 learned_addr learned my addr 172.21.15.150:0/2775224398 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:46:25.617 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:25.613+0000 7f202affd640 1 --2- 172.21.15.150:0/2775224398 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f202c0cdf90 0x7f202c0cc9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:46:25.617 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:25.613+0000 7f202b7fe640 1 --2- 172.21.15.150:0/2775224398 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2014004d90 0x7f202c0a1020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:46:25.617 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:25.614+0000 7f202bfff640 1 -- 172.21.15.150:0/2775224398 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2014004d90 msgr2=0x7f202c0a1020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:46:25.617 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:25.614+0000 7f202bfff640 1 --2- 172.21.15.150:0/2775224398 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2014004d90 0x7f202c0a1020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:25.617 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:25.614+0000 7f202bfff640 1 -- 172.21.15.150:0/2775224398 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f202c0cdf90 msgr2=0x7f202c0cc9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:46:25.617 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:25.614+0000 7f202bfff640 1 --2- 172.21.15.150:0/2775224398 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f202c0cdf90 0x7f202c0cc9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:25.617 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:25.614+0000 7f202bfff640 1 -- 172.21.15.150:0/2775224398 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f202c09ff80 con 0x7f202c0ce3a0 2024-09-17T05:46:25.617 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:25.614+0000 7f202affd640 1 --2- 172.21.15.150:0/2775224398 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f202c0cdf90 0x7f202c0cc9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T05:46:25.617 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:25.614+0000 7f202bfff640 1 --2- 172.21.15.150:0/2775224398 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f202c0ce3a0 0x7f202c0ccf30 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7f2024001fc0 tx=0x7f2024001be0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:46:25.618 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:25.614+0000 7f2013fff640 1 -- 172.21.15.150:0/2775224398 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2024037030 con 0x7f202c0ce3a0 2024-09-17T05:46:25.618 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:25.614+0000 7f2013fff640 1 -- 172.21.15.150:0/2775224398 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f2024003d40 con 0x7f202c0ce3a0 2024-09-17T05:46:25.618 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:25.614+0000 7f2031c4d640 1 -- 172.21.15.150:0/2775224398 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f202c0a0260 con 0x7f202c0ce3a0 2024-09-17T05:46:25.618 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:25.614+0000 7f2013fff640 1 -- 172.21.15.150:0/2775224398 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20240062f0 con 0x7f202c0ce3a0 2024-09-17T05:46:25.618 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:25.614+0000 7f2031c4d640 1 -- 172.21.15.150:0/2775224398 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f202c0a0820 con 0x7f202c0ce3a0 2024-09-17T05:46:25.619 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:25.615+0000 7f2031c4d640 1 -- 172.21.15.150:0/2775224398 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f202c0cf300 con 0x7f202c0ce3a0 2024-09-17T05:46:25.619 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:25.616+0000 7f2013fff640 1 -- 172.21.15.150:0/2775224398 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 16) ==== 102359+0+0 (secure 0 0 0) 0x7f20240066a0 con 0x7f202c0ce3a0 2024-09-17T05:46:25.619 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:25.616+0000 7f2013fff640 1 --2- 172.21.15.150:0/2775224398 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f20180795b0 0x7f201807bac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:46:25.619 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:25.616+0000 7f2013fff640 1 -- 172.21.15.150:0/2775224398 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(60..60 src has 1..60) ==== 5737+0+0 (secure 0 0 0) 0x7f20240b9220 con 0x7f202c0ce3a0 2024-09-17T05:46:25.619 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:25.617+0000 7f202b7fe640 1 --2- 172.21.15.150:0/2775224398 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f20180795b0 0x7f201807bac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:46:25.619 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:25.617+0000 7f202b7fe640 1 --2- 172.21.15.150:0/2775224398 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f20180795b0 0x7f201807bac0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f201c009c50 tx=0x7f201c005f90 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:46:25.622 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:25.621+0000 7f2013fff640 1 -- 172.21.15.150:0/2775224398 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f2024082ac0 con 0x7f202c0ce3a0 2024-09-17T05:46:25.827 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:25.825+0000 7f2031c4d640 1 -- 172.21.15.150:0/2775224398 --> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] -- mgr_command(tid 0: {"prefix": "fs subvolume snapshot create", "vol_name": "cephfs", "sub_name": "sv1", "snap_name": "ss1", "target": ["mon-mgr", ""]}) -- 0x7f202c0cfed0 con 0x7f20180795b0 2024-09-17T05:46:25.841 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:25.839+0000 7f2013fff640 1 -- 172.21.15.150:0/2775224398 <== mgr.4108 v2:172.21.15.176:6800/3631216395 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f201c0098a0 con 0x7f20180795b0 2024-09-17T05:46:25.843 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:25.841+0000 7f2031c4d640 1 -- 172.21.15.150:0/2775224398 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f20180795b0 msgr2=0x7f201807bac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:46:25.843 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:25.841+0000 7f2031c4d640 1 --2- 172.21.15.150:0/2775224398 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f20180795b0 0x7f201807bac0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f201c009c50 tx=0x7f201c005f90 comp rx=0 tx=0).stop 2024-09-17T05:46:25.843 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:25.841+0000 7f2031c4d640 1 -- 172.21.15.150:0/2775224398 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f202c0ce3a0 msgr2=0x7f202c0ccf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:46:25.843 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:25.841+0000 7f2031c4d640 1 --2- 172.21.15.150:0/2775224398 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f202c0ce3a0 0x7f202c0ccf30 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7f2024001fc0 tx=0x7f2024001be0 comp rx=0 tx=0).stop 2024-09-17T05:46:25.844 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:25.841+0000 7f2031c4d640 1 -- 172.21.15.150:0/2775224398 shutdown_connections 2024-09-17T05:46:25.844 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:25.841+0000 7f2031c4d640 1 --2- 172.21.15.150:0/2775224398 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f202c0cdf90 0x7f202c0cc9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:25.844 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:25.841+0000 7f2031c4d640 1 --2- 172.21.15.150:0/2775224398 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f20180795b0 0x7f201807bac0 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:25.844 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:25.841+0000 7f2031c4d640 1 --2- 172.21.15.150:0/2775224398 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f202c0ce3a0 0x7f202c0ccf30 unknown :-1 s=CLOSED pgs=683 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:25.844 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:25.841+0000 7f2031c4d640 1 --2- 172.21.15.150:0/2775224398 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2014004d90 0x7f202c0a1020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:25.844 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:25.841+0000 7f2031c4d640 1 -- 172.21.15.150:0/2775224398 >> 172.21.15.150:0/2775224398 conn(0x7f202c0d46f0 msgr2=0x7f202c06f190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:46:25.844 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:25.842+0000 7f2031c4d640 1 -- 172.21.15.150:0/2775224398 shutdown_connections 2024-09-17T05:46:25.844 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:25.842+0000 7f2031c4d640 1 -- 172.21.15.150:0/2775224398 wait complete. 2024-09-17T05:46:25.854 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume getpath cephfs sv1 2024-09-17T05:46:26.017 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:26.015+0000 7f98a5b90640 1 -- 172.21.15.150:0/2789891022 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9888003a00 msgr2=0x7f9888003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:46:26.017 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:26.015+0000 7f98a5b90640 1 --2- 172.21.15.150:0/2789891022 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9888003a00 0x7f9888003e70 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f9890009b70 tx=0x7f9888005830 comp rx=0 tx=0).stop 2024-09-17T05:46:26.018 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:26.015+0000 7f989ffff640 1 -- 172.21.15.150:0/2789891022 reap_dead start 2024-09-17T05:46:26.018 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:26.015+0000 7f98a5b90640 1 -- 172.21.15.150:0/2789891022 shutdown_connections 2024-09-17T05:46:26.018 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:26.015+0000 7f98a5b90640 1 -- 172.21.15.150:0/2789891022 >> 172.21.15.150:0/2789891022 conn(0x7f98a008bfe0 msgr2=0x7f98a00d46e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:46:26.018 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:26.015+0000 7f98a5b90640 1 -- 172.21.15.150:0/2789891022 shutdown_connections 2024-09-17T05:46:26.018 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:26.016+0000 7f98a5b90640 1 -- 172.21.15.150:0/2789891022 wait complete. 2024-09-17T05:46:26.018 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:26.017+0000 7f98a5b90640 1 Processor -- start 2024-09-17T05:46:26.019 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:26.018+0000 7f98a5b90640 1 -- start start 2024-09-17T05:46:26.023 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:26.019+0000 7f98a5b90640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9888003a00 0x7f98a01541b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:46:26.023 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:26.019+0000 7f98a5b90640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f98a0153020 0x7f98a00cd100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:46:26.023 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:26.019+0000 7f98a5b90640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f98a00cd640 0x7f98a01516b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:46:26.023 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:26.019+0000 7f98a5b90640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f98a00ba160 con 0x7f98a0153020 2024-09-17T05:46:26.023 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:26.019+0000 7f98a5b90640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f98a00d3220 con 0x7f9888003a00 2024-09-17T05:46:26.024 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:26.019+0000 7f98a5b90640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f98a006e2b0 con 0x7f98a00cd640 2024-09-17T05:46:26.024 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:26.019+0000 7f989effd640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f98a0153020 0x7f98a00cd100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:46:26.024 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:26.019+0000 7f989effd640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f98a0153020 0x7f98a00cd100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:53780/0 (socket says 172.21.15.150:53780) 2024-09-17T05:46:26.024 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:26.019+0000 7f989effd640 1 -- 172.21.15.150:0/2171722978 learned_addr learned my addr 172.21.15.150:0/2171722978 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:46:26.024 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:26.019+0000 7f989f7fe640 1 --2- 172.21.15.150:0/2171722978 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9888003a00 0x7f98a01541b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:46:26.024 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:26.019+0000 7f989ffff640 1 --2- 172.21.15.150:0/2171722978 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f98a00cd640 0x7f98a01516b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:46:26.024 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:26.019+0000 7f989effd640 1 -- 172.21.15.150:0/2171722978 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f98a00cd640 msgr2=0x7f98a01516b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:46:26.024 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:26.019+0000 7f989effd640 1 --2- 172.21.15.150:0/2171722978 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f98a00cd640 0x7f98a01516b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:26.024 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:26.019+0000 7f989effd640 1 -- 172.21.15.150:0/2171722978 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9888003a00 msgr2=0x7f98a01541b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:46:26.025 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:26.019+0000 7f989effd640 1 --2- 172.21.15.150:0/2171722978 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9888003a00 0x7f98a01541b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:26.025 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:26.019+0000 7f989effd640 1 -- 172.21.15.150:0/2171722978 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f98a00cda50 con 0x7f98a0153020 2024-09-17T05:46:26.025 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:26.019+0000 7f989effd640 1 --2- 172.21.15.150:0/2171722978 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f98a0153020 0x7f98a00cd100 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7f9894001be0 tx=0x7f98940039c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:46:26.025 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:26.020+0000 7f9887fff640 1 -- 172.21.15.150:0/2171722978 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9894015070 con 0x7f98a0153020 2024-09-17T05:46:26.025 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:26.020+0000 7f9887fff640 1 -- 172.21.15.150:0/2171722978 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9894011920 con 0x7f98a0153020 2024-09-17T05:46:26.025 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:26.020+0000 7f98a5b90640 1 -- 172.21.15.150:0/2171722978 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f98a01f9d40 con 0x7f98a0153020 2024-09-17T05:46:26.025 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:26.020+0000 7f9887fff640 1 -- 172.21.15.150:0/2171722978 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9894011d70 con 0x7f98a0153020 2024-09-17T05:46:26.025 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:26.020+0000 7f98a5b90640 1 -- 172.21.15.150:0/2171722978 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f98a01f8f80 con 0x7f98a0153020 2024-09-17T05:46:26.025 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:26.021+0000 7f98a5b90640 1 -- 172.21.15.150:0/2171722978 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f98a00b9b10 con 0x7f98a0153020 2024-09-17T05:46:26.025 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:26.022+0000 7f9887fff640 1 -- 172.21.15.150:0/2171722978 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 16) ==== 102359+0+0 (secure 0 0 0) 0x7f9894018070 con 0x7f98a0153020 2024-09-17T05:46:26.026 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:26.022+0000 7f9887fff640 1 --2- 172.21.15.150:0/2171722978 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f988c0795e0 0x7f988c07baf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:46:26.026 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:26.022+0000 7f9887fff640 1 -- 172.21.15.150:0/2171722978 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(60..60 src has 1..60) ==== 5737+0+0 (secure 0 0 0) 0x7f989409a590 con 0x7f98a0153020 2024-09-17T05:46:26.026 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:26.022+0000 7f989f7fe640 1 --2- 172.21.15.150:0/2171722978 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f988c0795e0 0x7f988c07baf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:46:26.026 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:26.023+0000 7f989f7fe640 1 --2- 172.21.15.150:0/2171722978 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f988c0795e0 0x7f988c07baf0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f9890035000 tx=0x7f98900046c0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:46:26.028 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:26.027+0000 7f9887fff640 1 -- 172.21.15.150:0/2171722978 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f98a00cda50 con 0x7f98a0153020 2024-09-17T05:46:26.230 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:26.229+0000 7f98a5b90640 1 -- 172.21.15.150:0/2171722978 --> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "sub_name": "sv1", "target": ["mon-mgr", ""]}) -- 0x7f98a009fbb0 con 0x7f988c0795e0 2024-09-17T05:46:26.236 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:26.234+0000 7f9887fff640 1 -- 172.21.15.150:0/2171722978 <== mgr.4108 v2:172.21.15.176:6800/3631216395 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+59 (secure 0 0 0) 0x7f98a009fbb0 con 0x7f988c0795e0 2024-09-17T05:46:26.236 INFO:teuthology.orchestra.run.smithi150.stdout:/volumes/_nogroup/sv1/298b5319-2472-402c-b6a6-1ca1b54b4570 2024-09-17T05:46:26.238 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:26.236+0000 7f98a5b90640 1 -- 172.21.15.150:0/2171722978 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f988c0795e0 msgr2=0x7f988c07baf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:46:26.238 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:26.236+0000 7f98a5b90640 1 --2- 172.21.15.150:0/2171722978 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f988c0795e0 0x7f988c07baf0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f9890035000 tx=0x7f98900046c0 comp rx=0 tx=0).stop 2024-09-17T05:46:26.238 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:26.236+0000 7f98a5b90640 1 -- 172.21.15.150:0/2171722978 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f98a0153020 msgr2=0x7f98a00cd100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:46:26.238 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:26.236+0000 7f98a5b90640 1 --2- 172.21.15.150:0/2171722978 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f98a0153020 0x7f98a00cd100 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7f9894001be0 tx=0x7f98940039c0 comp rx=0 tx=0).stop 2024-09-17T05:46:26.239 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:26.236+0000 7f98a5b90640 1 -- 172.21.15.150:0/2171722978 shutdown_connections 2024-09-17T05:46:26.239 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:26.236+0000 7f98a5b90640 1 --2- 172.21.15.150:0/2171722978 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f988c0795e0 0x7f988c07baf0 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:26.239 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:26.236+0000 7f98a5b90640 1 --2- 172.21.15.150:0/2171722978 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f98a00cd640 0x7f98a01516b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:26.239 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:26.236+0000 7f98a5b90640 1 --2- 172.21.15.150:0/2171722978 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f98a0153020 0x7f98a00cd100 unknown :-1 s=CLOSED pgs=685 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:26.239 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:26.236+0000 7f98a5b90640 1 --2- 172.21.15.150:0/2171722978 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9888003a00 0x7f98a01541b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:26.239 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:26.236+0000 7f98a5b90640 1 -- 172.21.15.150:0/2171722978 >> 172.21.15.150:0/2171722978 conn(0x7f98a008bfe0 msgr2=0x7f98a00b8b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:46:26.239 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:26.237+0000 7f98a5b90640 1 -- 172.21.15.150:0/2171722978 shutdown_connections 2024-09-17T05:46:26.239 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:26.237+0000 7f98a5b90640 1 -- 172.21.15.150:0/2171722978 wait complete. 2024-09-17T05:46:26.250 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:46:26.250 DEBUG:teuthology.orchestra.run.smithi150:> (cd /home/ubuntu/cephtest/mnt.0 && exec getfattr -n ceph.dir.rbytes volumes/_nogroup/sv1/298b5319-2472-402c-b6a6-1ca1b54b4570 2024-09-17T05:46:26.250 DEBUG:teuthology.orchestra.run.smithi150:> ) 2024-09-17T05:46:26.266 INFO:teuthology.orchestra.run.smithi150.stdout:# file: volumes/_nogroup/sv1/298b5319-2472-402c-b6a6-1ca1b54b4570 2024-09-17T05:46:26.266 INFO:teuthology.orchestra.run.smithi150.stdout:ceph.dir.rbytes="9990258688" 2024-09-17T05:46:26.266 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-09-17T05:46:26.266 INFO:tasks.cephfs.test_volumes:r_size = 9990258688 exp_size = 10737418240 2024-09-17T05:46:28.267 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:46:28.268 DEBUG:teuthology.orchestra.run.smithi150:> (cd /home/ubuntu/cephtest/mnt.0 && exec getfattr -n ceph.dir.rbytes volumes/_nogroup/sv1/298b5319-2472-402c-b6a6-1ca1b54b4570 2024-09-17T05:46:28.268 DEBUG:teuthology.orchestra.run.smithi150:> ) 2024-09-17T05:46:28.288 INFO:teuthology.orchestra.run.smithi150.stdout:# file: volumes/_nogroup/sv1/298b5319-2472-402c-b6a6-1ca1b54b4570 2024-09-17T05:46:28.288 INFO:teuthology.orchestra.run.smithi150.stdout:ceph.dir.rbytes="10737418240" 2024-09-17T05:46:28.288 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-09-17T05:46:28.288 INFO:tasks.cephfs.test_volumes:r_size = 10737418240 exp_size = 10737418240 2024-09-17T05:46:28.289 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume snapshot clone cephfs sv1 ss1 ss1clone1 2024-09-17T05:46:28.460 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:28.457+0000 7ff5bee9b640 1 -- 172.21.15.150:0/958210872 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff5a0004800 msgr2=0x7ff5a0004c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:46:28.460 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:28.457+0000 7ff5bee9b640 1 --2- 172.21.15.150:0/958210872 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff5a0004800 0x7ff5a0004c10 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7ff5ac001710 tx=0x7ff5a0005830 comp rx=0 tx=0).stop 2024-09-17T05:46:28.460 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:28.457+0000 7ff5bee9b640 1 -- 172.21.15.150:0/958210872 shutdown_connections 2024-09-17T05:46:28.461 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:28.457+0000 7ff5bee9b640 1 --2- 172.21.15.150:0/958210872 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff5a0004800 0x7ff5a0004c10 unknown :-1 s=CLOSED pgs=687 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:28.461 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:28.457+0000 7ff5bee9b640 1 -- 172.21.15.150:0/958210872 >> 172.21.15.150:0/958210872 conn(0x7ff5b80b2ff0 msgr2=0x7ff5b80b3400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:46:28.461 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:28.458+0000 7ff5bee9b640 1 -- 172.21.15.150:0/958210872 shutdown_connections 2024-09-17T05:46:28.461 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:28.458+0000 7ff5bee9b640 1 -- 172.21.15.150:0/958210872 wait complete. 2024-09-17T05:46:28.462 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:28.459+0000 7ff5bee9b640 1 Processor -- start 2024-09-17T05:46:28.462 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:28.459+0000 7ff5bee9b640 1 -- start start 2024-09-17T05:46:28.467 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:28.461+0000 7ff5bee9b640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff5a0004800 0x7ff5b81f3d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:46:28.467 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:28.461+0000 7ff5bee9b640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff5b81dbb20 0x7ff5b80cc030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:46:28.467 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:28.461+0000 7ff5bee9b640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff5b80cc570 0x7ff5b81f68f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:46:28.467 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:28.461+0000 7ff5bee9b640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7ff5b80b1370 con 0x7ff5b81dbb20 2024-09-17T05:46:28.467 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:28.461+0000 7ff5bee9b640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7ff5b80b11f0 con 0x7ff5b80cc570 2024-09-17T05:46:28.468 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:28.461+0000 7ff5bee9b640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7ff5b80b14f0 con 0x7ff5a0004800 2024-09-17T05:46:28.468 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:28.461+0000 7ff5b7fff640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff5b81dbb20 0x7ff5b80cc030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:46:28.468 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:28.461+0000 7ff5b7fff640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff5b81dbb20 0x7ff5b80cc030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:53792/0 (socket says 172.21.15.150:53792) 2024-09-17T05:46:28.468 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:28.461+0000 7ff5b7fff640 1 -- 172.21.15.150:0/2340476367 learned_addr learned my addr 172.21.15.150:0/2340476367 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:46:28.468 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:28.461+0000 7ff5bd438640 1 --2- 172.21.15.150:0/2340476367 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff5b80cc570 0x7ff5b81f68f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:46:28.469 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:28.461+0000 7ff5bcc37640 1 --2- 172.21.15.150:0/2340476367 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff5a0004800 0x7ff5b81f3d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:46:28.469 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:28.461+0000 7ff5b7fff640 1 -- 172.21.15.150:0/2340476367 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff5a0004800 msgr2=0x7ff5b81f3d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:46:28.469 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:28.461+0000 7ff5b7fff640 1 --2- 172.21.15.150:0/2340476367 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff5a0004800 0x7ff5b81f3d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:28.469 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:28.461+0000 7ff5b7fff640 1 -- 172.21.15.150:0/2340476367 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff5b80cc570 msgr2=0x7ff5b81f68f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:46:28.469 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:28.461+0000 7ff5b7fff640 1 --2- 172.21.15.150:0/2340476367 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff5b80cc570 0x7ff5b81f68f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:28.470 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:28.461+0000 7ff5b7fff640 1 -- 172.21.15.150:0/2340476367 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff5b80cc980 con 0x7ff5b81dbb20 2024-09-17T05:46:28.470 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:28.461+0000 7ff5bcc37640 1 --2- 172.21.15.150:0/2340476367 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff5a0004800 0x7ff5b81f3d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:46:28.470 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:28.461+0000 7ff5b7fff640 1 --2- 172.21.15.150:0/2340476367 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff5b81dbb20 0x7ff5b80cc030 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x7ff5ac001830 tx=0x7ff5ac004870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:46:28.470 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:28.462+0000 7ff5b57fa640 1 -- 172.21.15.150:0/2340476367 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff5ac042070 con 0x7ff5b81dbb20 2024-09-17T05:46:28.470 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:28.462+0000 7ff5b57fa640 1 -- 172.21.15.150:0/2340476367 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff5ac039070 con 0x7ff5b81dbb20 2024-09-17T05:46:28.470 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:28.462+0000 7ff5bee9b640 1 -- 172.21.15.150:0/2340476367 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff5b81e2a90 con 0x7ff5b81dbb20 2024-09-17T05:46:28.470 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:28.462+0000 7ff5b57fa640 1 -- 172.21.15.150:0/2340476367 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff5ac0068c0 con 0x7ff5b81dbb20 2024-09-17T05:46:28.470 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:28.462+0000 7ff5bee9b640 1 -- 172.21.15.150:0/2340476367 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff5b80ce800 con 0x7ff5b81dbb20 2024-09-17T05:46:28.471 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:28.463+0000 7ff5bee9b640 1 -- 172.21.15.150:0/2340476367 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff5b80ae630 con 0x7ff5b81dbb20 2024-09-17T05:46:28.471 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:28.463+0000 7ff5b57fa640 1 -- 172.21.15.150:0/2340476367 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 16) ==== 102359+0+0 (secure 0 0 0) 0x7ff5ac03b070 con 0x7ff5b81dbb20 2024-09-17T05:46:28.471 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:28.464+0000 7ff5b57fa640 1 --2- 172.21.15.150:0/2340476367 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7ff5a40795b0 0x7ff5a407bac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:46:28.471 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:28.464+0000 7ff5b57fa640 1 -- 172.21.15.150:0/2340476367 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(60..60 src has 1..60) ==== 5737+0+0 (secure 0 0 0) 0x7ff5ac0b9160 con 0x7ff5b81dbb20 2024-09-17T05:46:28.471 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:28.464+0000 7ff5bcc37640 1 --2- 172.21.15.150:0/2340476367 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7ff5a40795b0 0x7ff5a407bac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:46:28.471 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:28.465+0000 7ff5bcc37640 1 --2- 172.21.15.150:0/2340476367 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7ff5a40795b0 0x7ff5a407bac0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7ff5a8001d30 tx=0x7ff5a8001c40 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:46:28.472 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:28.469+0000 7ff5b57fa640 1 -- 172.21.15.150:0/2340476367 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7ff5b80cc980 con 0x7ff5b81dbb20 2024-09-17T05:46:28.681 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:28.680+0000 7ff5bee9b640 1 -- 172.21.15.150:0/2340476367 --> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] -- mgr_command(tid 0: {"prefix": "fs subvolume snapshot clone", "vol_name": "cephfs", "sub_name": "sv1", "snap_name": "ss1", "target_sub_name": "ss1clone1", "target": ["mon-mgr", ""]}) -- 0x7ff5b80697a0 con 0x7ff5a40795b0 2024-09-17T05:46:28.749 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:28.747+0000 7ff5b57fa640 1 -- 172.21.15.150:0/2340476367 <== mgr.4108 v2:172.21.15.176:6800/3631216395 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7ff5b80697a0 con 0x7ff5a40795b0 2024-09-17T05:46:28.752 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:28.750+0000 7ff5bee9b640 1 -- 172.21.15.150:0/2340476367 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7ff5a40795b0 msgr2=0x7ff5a407bac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:46:28.752 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:28.750+0000 7ff5bee9b640 1 --2- 172.21.15.150:0/2340476367 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7ff5a40795b0 0x7ff5a407bac0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7ff5a8001d30 tx=0x7ff5a8001c40 comp rx=0 tx=0).stop 2024-09-17T05:46:28.752 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:28.750+0000 7ff5bee9b640 1 -- 172.21.15.150:0/2340476367 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff5b81dbb20 msgr2=0x7ff5b80cc030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:46:28.752 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:28.750+0000 7ff5bee9b640 1 --2- 172.21.15.150:0/2340476367 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff5b81dbb20 0x7ff5b80cc030 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x7ff5ac001830 tx=0x7ff5ac004870 comp rx=0 tx=0).stop 2024-09-17T05:46:28.752 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:28.750+0000 7ff5bee9b640 1 -- 172.21.15.150:0/2340476367 shutdown_connections 2024-09-17T05:46:28.752 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:28.750+0000 7ff5bee9b640 1 --2- 172.21.15.150:0/2340476367 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff5b80cc570 0x7ff5b81f68f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:28.752 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:28.750+0000 7ff5bee9b640 1 --2- 172.21.15.150:0/2340476367 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7ff5a40795b0 0x7ff5a407bac0 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:28.752 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:28.750+0000 7ff5bee9b640 1 --2- 172.21.15.150:0/2340476367 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff5b81dbb20 0x7ff5b80cc030 unknown :-1 s=CLOSED pgs=688 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:28.753 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:28.750+0000 7ff5bee9b640 1 --2- 172.21.15.150:0/2340476367 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff5a0004800 0x7ff5b81f3d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:28.753 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:28.750+0000 7ff5bee9b640 1 -- 172.21.15.150:0/2340476367 >> 172.21.15.150:0/2340476367 conn(0x7ff5b80b2ff0 msgr2=0x7ff5b80d0360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:46:28.753 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:28.750+0000 7ff5bee9b640 1 -- 172.21.15.150:0/2340476367 shutdown_connections 2024-09-17T05:46:28.753 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:28.750+0000 7ff5bee9b640 1 -- 172.21.15.150:0/2340476367 wait complete. 2024-09-17T05:46:28.755 INFO:tasks.ceph.mgr.x.smithi176.stderr:2024-09-17T05:46:28.754+0000 7f33dd726640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-17T05:46:28.755 INFO:tasks.ceph.mgr.x.smithi176.stderr:2024-09-17T05:46:28.754+0000 7f33dd726640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-17T05:46:28.755 INFO:tasks.ceph.mgr.x.smithi176.stderr:2024-09-17T05:46:28.754+0000 7f33dd726640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-17T05:46:28.755 INFO:tasks.ceph.mgr.x.smithi176.stderr:2024-09-17T05:46:28.754+0000 7f33dd726640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-17T05:46:28.755 INFO:tasks.ceph.mgr.x.smithi176.stderr:2024-09-17T05:46:28.754+0000 7f33dd726640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-17T05:46:28.764 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format json-pretty 2024-09-17T05:46:28.771 INFO:tasks.ceph.mgr.x.smithi176.stderr:2024-09-17T05:46:28.770+0000 7f33dcf25640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-17T05:46:28.771 INFO:tasks.ceph.mgr.x.smithi176.stderr:2024-09-17T05:46:28.770+0000 7f33dcf25640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-17T05:46:28.771 INFO:tasks.ceph.mgr.x.smithi176.stderr:2024-09-17T05:46:28.770+0000 7f33dcf25640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-17T05:46:28.771 INFO:tasks.ceph.mgr.x.smithi176.stderr:2024-09-17T05:46:28.770+0000 7f33dcf25640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-17T05:46:28.771 INFO:tasks.ceph.mgr.x.smithi176.stderr:2024-09-17T05:46:28.770+0000 7f33dcf25640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-17T05:46:28.878 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:28.877+0000 7fb1b7f2b640 1 -- 172.21.15.150:0/3521006988 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb1b00b6b70 msgr2=0x7fb1b006cda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:46:28.879 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:28.877+0000 7fb1b7f2b640 1 --2- 172.21.15.150:0/3521006988 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb1b00b6b70 0x7fb1b006cda0 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7fb1b00b0c40 tx=0x7fb1a402a560 comp rx=0 tx=0).stop 2024-09-17T05:46:28.879 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:28.877+0000 7fb1b7f2b640 1 -- 172.21.15.150:0/3521006988 shutdown_connections 2024-09-17T05:46:28.879 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:28.877+0000 7fb1b7f2b640 1 --2- 172.21.15.150:0/3521006988 >> v2:172.21.15.176:3300/0 conn(0x7fb1b00ae2d0 0x7fb1b00ae6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:28.879 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:28.877+0000 7fb1b7f2b640 1 --2- 172.21.15.150:0/3521006988 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb1b00b6b70 0x7fb1b006cda0 unknown :-1 s=CLOSED pgs=689 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:28.879 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:28.877+0000 7fb1b7f2b640 1 -- 172.21.15.150:0/3521006988 >> 172.21.15.150:0/3521006988 conn(0x7fb1b00b2ff0 msgr2=0x7fb1b00b3400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:46:28.879 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:28.877+0000 7fb1b7f2b640 1 -- 172.21.15.150:0/3521006988 shutdown_connections 2024-09-17T05:46:28.879 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:28.877+0000 7fb1b7f2b640 1 -- 172.21.15.150:0/3521006988 wait complete. 2024-09-17T05:46:28.880 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:28.878+0000 7fb1b7f2b640 1 Processor -- start 2024-09-17T05:46:28.880 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:28.879+0000 7fb1b7f2b640 1 -- start start 2024-09-17T05:46:28.883 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:28.880+0000 7fb1b7f2b640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb1b00ae2d0 0x7fb1b0157440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:46:28.883 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:28.880+0000 7fb1b7f2b640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb1b00b3b10 0x7fb1b00ce340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:46:28.883 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:28.880+0000 7fb1b7f2b640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb1b00b6b70 0x7fb1b00ce880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:46:28.883 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:28.880+0000 7fb1b7f2b640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7fb1b00ccfa0 con 0x7fb1b00ae2d0 2024-09-17T05:46:28.883 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:28.880+0000 7fb1b7f2b640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fb1b00cce20 con 0x7fb1b00b6b70 2024-09-17T05:46:28.883 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:28.880+0000 7fb1b7f2b640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fb1b00cd120 con 0x7fb1b00b3b10 2024-09-17T05:46:28.883 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:28.880+0000 7fb1b5cc7640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb1b00ae2d0 0x7fb1b0157440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:46:28.884 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:28.880+0000 7fb1b5cc7640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb1b00ae2d0 0x7fb1b0157440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:53808/0 (socket says 172.21.15.150:53808) 2024-09-17T05:46:28.884 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:28.880+0000 7fb1b5cc7640 1 -- 172.21.15.150:0/1136058234 learned_addr learned my addr 172.21.15.150:0/1136058234 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:46:28.884 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:28.880+0000 7fb1b64c8640 1 --2- 172.21.15.150:0/1136058234 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb1b00b6b70 0x7fb1b00ce880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:46:28.884 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:28.880+0000 7fb1b54c6640 1 --2- 172.21.15.150:0/1136058234 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb1b00b3b10 0x7fb1b00ce340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:46:28.884 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:28.880+0000 7fb1b5cc7640 1 -- 172.21.15.150:0/1136058234 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb1b00b3b10 msgr2=0x7fb1b00ce340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:46:28.884 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:28.880+0000 7fb1b5cc7640 1 --2- 172.21.15.150:0/1136058234 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb1b00b3b10 0x7fb1b00ce340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:28.884 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:28.880+0000 7fb1b5cc7640 1 -- 172.21.15.150:0/1136058234 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb1b00b6b70 msgr2=0x7fb1b00ce880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:46:28.884 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:28.880+0000 7fb1b5cc7640 1 --2- 172.21.15.150:0/1136058234 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb1b00b6b70 0x7fb1b00ce880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:28.884 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:28.880+0000 7fb1b5cc7640 1 -- 172.21.15.150:0/1136058234 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb1b015b730 con 0x7fb1b00ae2d0 2024-09-17T05:46:28.884 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:28.880+0000 7fb1b5cc7640 1 --2- 172.21.15.150:0/1136058234 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb1b00ae2d0 0x7fb1b0157440 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7fb1a800c730 tx=0x7fb1a800cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:46:28.884 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:28.881+0000 7fb1ae7fc640 1 -- 172.21.15.150:0/1136058234 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb1a8003b70 con 0x7fb1b00ae2d0 2024-09-17T05:46:28.884 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:28.881+0000 7fb1ae7fc640 1 -- 172.21.15.150:0/1136058234 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb1a8003d30 con 0x7fb1b00ae2d0 2024-09-17T05:46:28.885 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:28.881+0000 7fb1b7f2b640 1 -- 172.21.15.150:0/1136058234 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb1b015a280 con 0x7fb1b00ae2d0 2024-09-17T05:46:28.885 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:28.881+0000 7fb1ae7fc640 1 -- 172.21.15.150:0/1136058234 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb1a800aab0 con 0x7fb1b00ae2d0 2024-09-17T05:46:28.885 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:28.881+0000 7fb1b7f2b640 1 -- 172.21.15.150:0/1136058234 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb1b015a840 con 0x7fb1b00ae2d0 2024-09-17T05:46:28.885 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:28.882+0000 7fb1b7f2b640 1 -- 172.21.15.150:0/1136058234 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb1b00cd5e0 con 0x7fb1b00ae2d0 2024-09-17T05:46:28.886 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:28.883+0000 7fb1ae7fc640 1 -- 172.21.15.150:0/1136058234 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 16) ==== 102359+0+0 (secure 0 0 0) 0x7fb1a800ac50 con 0x7fb1b00ae2d0 2024-09-17T05:46:28.886 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:28.883+0000 7fb1ae7fc640 1 --2- 172.21.15.150:0/1136058234 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fb19c0795b0 0x7fb19c07bac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:46:28.886 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:28.883+0000 7fb1ae7fc640 1 -- 172.21.15.150:0/1136058234 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(60..60 src has 1..60) ==== 5737+0+0 (secure 0 0 0) 0x7fb1a8099fc0 con 0x7fb1b00ae2d0 2024-09-17T05:46:28.886 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:28.883+0000 7fb1b54c6640 1 --2- 172.21.15.150:0/1136058234 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fb19c0795b0 0x7fb19c07bac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:46:28.886 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:28.884+0000 7fb1b54c6640 1 --2- 172.21.15.150:0/1136058234 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fb19c0795b0 0x7fb19c07bac0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7fb1a4033000 tx=0x7fb1a4004730 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:46:28.888 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:28.887+0000 7fb1ae7fc640 1 -- 172.21.15.150:0/1136058234 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fb1a80636b0 con 0x7fb1b00ae2d0 2024-09-17T05:46:29.132 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:29.131+0000 7fb1b7f2b640 1 -- 172.21.15.150:0/1136058234 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) -- 0x7fb1b00cb5c0 con 0x7fb1b00ae2d0 2024-09-17T05:46:29.133 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:29.131+0000 7fb1ae7fc640 1 -- 172.21.15.150:0/1136058234 <== mon.0 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) ==== 79+0+1883 (secure 0 0 0) 0x7fb1a80680e0 con 0x7fb1b00ae2d0 2024-09-17T05:46:29.133 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-09-17T05:46:29.133 INFO:teuthology.orchestra.run.smithi150.stdout:{ 2024-09-17T05:46:29.133 INFO:teuthology.orchestra.run.smithi150.stdout: "fsid": "9f2e05e9-d629-47b3-b26b-1360655b7d20", 2024-09-17T05:46:29.133 INFO:teuthology.orchestra.run.smithi150.stdout: "health": { 2024-09-17T05:46:29.133 INFO:teuthology.orchestra.run.smithi150.stdout: "status": "HEALTH_OK", 2024-09-17T05:46:29.133 INFO:teuthology.orchestra.run.smithi150.stdout: "checks": {}, 2024-09-17T05:46:29.134 INFO:teuthology.orchestra.run.smithi150.stdout: "mutes": [] 2024-09-17T05:46:29.134 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-17T05:46:29.134 INFO:teuthology.orchestra.run.smithi150.stdout: "election_epoch": 4, 2024-09-17T05:46:29.134 INFO:teuthology.orchestra.run.smithi150.stdout: "quorum": [ 2024-09-17T05:46:29.134 INFO:teuthology.orchestra.run.smithi150.stdout: 0, 2024-09-17T05:46:29.134 INFO:teuthology.orchestra.run.smithi150.stdout: 1, 2024-09-17T05:46:29.134 INFO:teuthology.orchestra.run.smithi150.stdout: 2 2024-09-17T05:46:29.134 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2024-09-17T05:46:29.134 INFO:teuthology.orchestra.run.smithi150.stdout: "quorum_names": [ 2024-09-17T05:46:29.134 INFO:teuthology.orchestra.run.smithi150.stdout: "a", 2024-09-17T05:46:29.134 INFO:teuthology.orchestra.run.smithi150.stdout: "b", 2024-09-17T05:46:29.134 INFO:teuthology.orchestra.run.smithi150.stdout: "c" 2024-09-17T05:46:29.134 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2024-09-17T05:46:29.134 INFO:teuthology.orchestra.run.smithi150.stdout: "quorum_age": 296, 2024-09-17T05:46:29.135 INFO:teuthology.orchestra.run.smithi150.stdout: "monmap": { 2024-09-17T05:46:29.135 INFO:teuthology.orchestra.run.smithi150.stdout: "epoch": 1, 2024-09-17T05:46:29.135 INFO:teuthology.orchestra.run.smithi150.stdout: "min_mon_release_name": "squid", 2024-09-17T05:46:29.135 INFO:teuthology.orchestra.run.smithi150.stdout: "num_mons": 3 2024-09-17T05:46:29.135 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-17T05:46:29.135 INFO:teuthology.orchestra.run.smithi150.stdout: "osdmap": { 2024-09-17T05:46:29.135 INFO:teuthology.orchestra.run.smithi150.stdout: "epoch": 60, 2024-09-17T05:46:29.135 INFO:teuthology.orchestra.run.smithi150.stdout: "num_osds": 8, 2024-09-17T05:46:29.135 INFO:teuthology.orchestra.run.smithi150.stdout: "num_up_osds": 8, 2024-09-17T05:46:29.135 INFO:teuthology.orchestra.run.smithi150.stdout: "osd_up_since": 1726551706, 2024-09-17T05:46:29.135 INFO:teuthology.orchestra.run.smithi150.stdout: "num_in_osds": 8, 2024-09-17T05:46:29.135 INFO:teuthology.orchestra.run.smithi150.stdout: "osd_in_since": 1726551696, 2024-09-17T05:46:29.135 INFO:teuthology.orchestra.run.smithi150.stdout: "num_remapped_pgs": 0 2024-09-17T05:46:29.136 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-17T05:46:29.136 INFO:teuthology.orchestra.run.smithi150.stdout: "pgmap": { 2024-09-17T05:46:29.136 INFO:teuthology.orchestra.run.smithi150.stdout: "pgs_by_state": [ 2024-09-17T05:46:29.136 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-09-17T05:46:29.136 INFO:teuthology.orchestra.run.smithi150.stdout: "state_name": "active+clean", 2024-09-17T05:46:29.136 INFO:teuthology.orchestra.run.smithi150.stdout: "count": 97 2024-09-17T05:46:29.136 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-09-17T05:46:29.136 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2024-09-17T05:46:29.136 INFO:teuthology.orchestra.run.smithi150.stdout: "num_pgs": 97, 2024-09-17T05:46:29.136 INFO:teuthology.orchestra.run.smithi150.stdout: "num_pools": 3, 2024-09-17T05:46:29.136 INFO:teuthology.orchestra.run.smithi150.stdout: "num_objects": 2438, 2024-09-17T05:46:29.136 INFO:teuthology.orchestra.run.smithi150.stdout: "data_bytes": 10121915292, 2024-09-17T05:46:29.136 INFO:teuthology.orchestra.run.smithi150.stdout: "bytes_used": 20620075008, 2024-09-17T05:46:29.137 INFO:teuthology.orchestra.run.smithi150.stdout: "bytes_avail": 752474038272, 2024-09-17T05:46:29.137 INFO:teuthology.orchestra.run.smithi150.stdout: "bytes_total": 773094113280, 2024-09-17T05:46:29.137 INFO:teuthology.orchestra.run.smithi150.stdout: "write_bytes_sec": 294226944, 2024-09-17T05:46:29.137 INFO:teuthology.orchestra.run.smithi150.stdout: "read_op_per_sec": 0, 2024-09-17T05:46:29.137 INFO:teuthology.orchestra.run.smithi150.stdout: "write_op_per_sec": 75 2024-09-17T05:46:29.137 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-17T05:46:29.137 INFO:teuthology.orchestra.run.smithi150.stdout: "fsmap": { 2024-09-17T05:46:29.137 INFO:teuthology.orchestra.run.smithi150.stdout: "epoch": 34, 2024-09-17T05:46:29.137 INFO:teuthology.orchestra.run.smithi150.stdout: "btime": "2024-09-17T05:45:44:972475+0000", 2024-09-17T05:46:29.137 INFO:teuthology.orchestra.run.smithi150.stdout: "id": 4, 2024-09-17T05:46:29.137 INFO:teuthology.orchestra.run.smithi150.stdout: "up": 1, 2024-09-17T05:46:29.137 INFO:teuthology.orchestra.run.smithi150.stdout: "in": 1, 2024-09-17T05:46:29.137 INFO:teuthology.orchestra.run.smithi150.stdout: "max": 1, 2024-09-17T05:46:29.138 INFO:teuthology.orchestra.run.smithi150.stdout: "by_rank": [ 2024-09-17T05:46:29.138 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-09-17T05:46:29.138 INFO:teuthology.orchestra.run.smithi150.stdout: "filesystem_id": 4, 2024-09-17T05:46:29.138 INFO:teuthology.orchestra.run.smithi150.stdout: "rank": 0, 2024-09-17T05:46:29.138 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "a", 2024-09-17T05:46:29.138 INFO:teuthology.orchestra.run.smithi150.stdout: "status": "up:active", 2024-09-17T05:46:29.138 INFO:teuthology.orchestra.run.smithi150.stdout: "gid": 6009 2024-09-17T05:46:29.138 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-09-17T05:46:29.138 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2024-09-17T05:46:29.138 INFO:teuthology.orchestra.run.smithi150.stdout: "up:standby": 3 2024-09-17T05:46:29.138 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-17T05:46:29.138 INFO:teuthology.orchestra.run.smithi150.stdout: "mgrmap": { 2024-09-17T05:46:29.138 INFO:teuthology.orchestra.run.smithi150.stdout: "available": true, 2024-09-17T05:46:29.138 INFO:teuthology.orchestra.run.smithi150.stdout: "num_standbys": 1, 2024-09-17T05:46:29.139 INFO:teuthology.orchestra.run.smithi150.stdout: "modules": [ 2024-09-17T05:46:29.139 INFO:teuthology.orchestra.run.smithi150.stdout: "iostat", 2024-09-17T05:46:29.139 INFO:teuthology.orchestra.run.smithi150.stdout: "nfs", 2024-09-17T05:46:29.139 INFO:teuthology.orchestra.run.smithi150.stdout: "restful" 2024-09-17T05:46:29.139 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2024-09-17T05:46:29.139 INFO:teuthology.orchestra.run.smithi150.stdout: "services": {} 2024-09-17T05:46:29.139 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-17T05:46:29.139 INFO:teuthology.orchestra.run.smithi150.stdout: "servicemap": { 2024-09-17T05:46:29.139 INFO:teuthology.orchestra.run.smithi150.stdout: "epoch": 10, 2024-09-17T05:46:29.139 INFO:teuthology.orchestra.run.smithi150.stdout: "modified": "2024-09-17T05:45:10.902513+0000", 2024-09-17T05:46:29.139 INFO:teuthology.orchestra.run.smithi150.stdout: "services": {} 2024-09-17T05:46:29.139 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-17T05:46:29.139 INFO:teuthology.orchestra.run.smithi150.stdout: "progress_events": {} 2024-09-17T05:46:29.140 INFO:teuthology.orchestra.run.smithi150.stdout:} 2024-09-17T05:46:29.140 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:29.133+0000 7fb1b7f2b640 1 -- 172.21.15.150:0/1136058234 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fb19c0795b0 msgr2=0x7fb19c07bac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:46:29.141 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:29.133+0000 7fb1b7f2b640 1 --2- 172.21.15.150:0/1136058234 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fb19c0795b0 0x7fb19c07bac0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7fb1a4033000 tx=0x7fb1a4004730 comp rx=0 tx=0).stop 2024-09-17T05:46:29.141 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:29.133+0000 7fb1b7f2b640 1 -- 172.21.15.150:0/1136058234 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb1b00ae2d0 msgr2=0x7fb1b0157440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:46:29.141 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:29.133+0000 7fb1b7f2b640 1 --2- 172.21.15.150:0/1136058234 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb1b00ae2d0 0x7fb1b0157440 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7fb1a800c730 tx=0x7fb1a800cbf0 comp rx=0 tx=0).stop 2024-09-17T05:46:29.141 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:29.133+0000 7fb1b7f2b640 1 -- 172.21.15.150:0/1136058234 shutdown_connections 2024-09-17T05:46:29.141 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:29.133+0000 7fb1b7f2b640 1 --2- 172.21.15.150:0/1136058234 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb1b00b6b70 0x7fb1b00ce880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:29.141 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:29.133+0000 7fb1b7f2b640 1 --2- 172.21.15.150:0/1136058234 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fb19c0795b0 0x7fb19c07bac0 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:29.141 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:29.133+0000 7fb1b7f2b640 1 --2- 172.21.15.150:0/1136058234 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb1b00b3b10 0x7fb1b00ce340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:29.141 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:29.133+0000 7fb1b7f2b640 1 --2- 172.21.15.150:0/1136058234 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb1b00ae2d0 0x7fb1b0157440 unknown :-1 s=CLOSED pgs=690 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:29.141 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:29.133+0000 7fb1b7f2b640 1 -- 172.21.15.150:0/1136058234 >> 172.21.15.150:0/1136058234 conn(0x7fb1b00b2ff0 msgr2=0x7fb1b00aee70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:46:29.141 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:29.133+0000 7fb1b7f2b640 1 -- 172.21.15.150:0/1136058234 shutdown_connections 2024-09-17T05:46:29.141 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:29.133+0000 7fb1b7f2b640 1 -- 172.21.15.150:0/1136058234 wait complete. 2024-09-17T05:46:29.757 INFO:tasks.ceph.mgr.x.smithi176.stderr:2024-09-17T05:46:29.756+0000 7f33cc684640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-17T05:46:29.757 INFO:tasks.ceph.mgr.x.smithi176.stderr:2024-09-17T05:46:29.756+0000 7f33cc684640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-17T05:46:29.757 INFO:tasks.ceph.mgr.x.smithi176.stderr:2024-09-17T05:46:29.756+0000 7f33cc684640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-17T05:46:29.757 INFO:tasks.ceph.mgr.x.smithi176.stderr:2024-09-17T05:46:29.756+0000 7f33cc684640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-17T05:46:29.757 INFO:tasks.ceph.mgr.x.smithi176.stderr:2024-09-17T05:46:29.756+0000 7f33cc684640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-17T05:46:30.147 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format json-pretty 2024-09-17T05:46:30.332 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:30.330+0000 7faa81d2b640 1 -- 172.21.15.150:0/4252530014 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7faa64004800 msgr2=0x7faa64004c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:46:30.332 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:30.330+0000 7faa81d2b640 1 --2- 172.21.15.150:0/4252530014 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7faa64004800 0x7faa64004c10 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7faa7c15cd60 tx=0x7faa64005830 comp rx=0 tx=0).stop 2024-09-17T05:46:30.332 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:30.330+0000 7faa7bfff640 1 -- 172.21.15.150:0/4252530014 reap_dead start 2024-09-17T05:46:30.333 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:30.330+0000 7faa81d2b640 1 -- 172.21.15.150:0/4252530014 shutdown_connections 2024-09-17T05:46:30.333 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:30.330+0000 7faa81d2b640 1 -- 172.21.15.150:0/4252530014 >> 172.21.15.150:0/4252530014 conn(0x7faa7c06d730 msgr2=0x7faa7c0b1e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:46:30.333 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:30.330+0000 7faa81d2b640 1 -- 172.21.15.150:0/4252530014 shutdown_connections 2024-09-17T05:46:30.333 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:30.330+0000 7faa81d2b640 1 -- 172.21.15.150:0/4252530014 wait complete. 2024-09-17T05:46:30.334 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:30.332+0000 7faa81d2b640 1 Processor -- start 2024-09-17T05:46:30.334 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:30.333+0000 7faa81d2b640 1 -- start start 2024-09-17T05:46:30.336 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:30.334+0000 7faa81d2b640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7faa64004800 0x7faa7c148e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:46:30.336 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:30.334+0000 7faa81d2b640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7faa7c1494d0 0x7faa7c1516c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:46:30.336 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:30.334+0000 7faa81d2b640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7faa7c151c00 0x7faa7c074090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:46:30.336 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:30.334+0000 7faa81d2b640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7faa7c0b4da0 con 0x7faa64004800 2024-09-17T05:46:30.336 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:30.334+0000 7faa81d2b640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7faa7c0b4c20 con 0x7faa7c151c00 2024-09-17T05:46:30.336 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:30.334+0000 7faa81d2b640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7faa7c0b3960 con 0x7faa7c1494d0 2024-09-17T05:46:30.336 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:30.334+0000 7faa7b7fe640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7faa64004800 0x7faa7c148e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:46:30.337 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:30.334+0000 7faa7b7fe640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7faa64004800 0x7faa7c148e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:35090/0 (socket says 172.21.15.150:35090) 2024-09-17T05:46:30.337 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:30.334+0000 7faa7b7fe640 1 -- 172.21.15.150:0/655530767 learned_addr learned my addr 172.21.15.150:0/655530767 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:46:30.338 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:30.335+0000 7faa7bfff640 1 --2- 172.21.15.150:0/655530767 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7faa7c151c00 0x7faa7c074090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:46:30.338 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:30.335+0000 7faa7b7fe640 1 -- 172.21.15.150:0/655530767 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7faa7c1494d0 msgr2=0x7faa7c1516c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:46:30.338 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:30.335+0000 7faa7affd640 1 --2- 172.21.15.150:0/655530767 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7faa7c1494d0 0x7faa7c1516c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:46:30.338 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:30.335+0000 7faa7b7fe640 1 --2- 172.21.15.150:0/655530767 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7faa7c1494d0 0x7faa7c1516c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:30.338 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:30.335+0000 7faa7b7fe640 1 -- 172.21.15.150:0/655530767 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7faa7c151c00 msgr2=0x7faa7c074090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:46:30.338 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:30.335+0000 7faa7b7fe640 1 --2- 172.21.15.150:0/655530767 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7faa7c151c00 0x7faa7c074090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:30.338 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:30.335+0000 7faa7b7fe640 1 -- 172.21.15.150:0/655530767 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faa7c1f1530 con 0x7faa64004800 2024-09-17T05:46:30.338 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:30.335+0000 7faa7bfff640 1 --2- 172.21.15.150:0/655530767 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7faa7c151c00 0x7faa7c074090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T05:46:30.338 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:30.335+0000 7faa7affd640 1 --2- 172.21.15.150:0/655530767 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7faa7c1494d0 0x7faa7c1516c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T05:46:30.338 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:30.335+0000 7faa7b7fe640 1 --2- 172.21.15.150:0/655530767 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7faa64004800 0x7faa7c148e60 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7faa6c00d650 tx=0x7faa6c00db10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:46:30.339 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:30.335+0000 7faa63fff640 1 -- 172.21.15.150:0/655530767 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa6c017070 con 0x7faa64004800 2024-09-17T05:46:30.339 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:30.335+0000 7faa63fff640 1 -- 172.21.15.150:0/655530767 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7faa6c005330 con 0x7faa64004800 2024-09-17T05:46:30.339 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:30.335+0000 7faa63fff640 1 -- 172.21.15.150:0/655530767 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa6c009820 con 0x7faa64004800 2024-09-17T05:46:30.339 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:30.335+0000 7faa81d2b640 1 -- 172.21.15.150:0/655530767 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faa7c152010 con 0x7faa64004800 2024-09-17T05:46:30.339 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:30.336+0000 7faa81d2b640 1 -- 172.21.15.150:0/655530767 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faa7c0b0aa0 con 0x7faa64004800 2024-09-17T05:46:30.340 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:30.337+0000 7faa81d2b640 1 -- 172.21.15.150:0/655530767 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faa7c070100 con 0x7faa64004800 2024-09-17T05:46:30.340 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:30.338+0000 7faa63fff640 1 -- 172.21.15.150:0/655530767 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 17) ==== 102461+0+0 (secure 0 0 0) 0x7faa6c0099c0 con 0x7faa64004800 2024-09-17T05:46:30.341 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:30.340+0000 7faa63fff640 1 --2- 172.21.15.150:0/655530767 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7faa680796d0 0x7faa6807bbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:46:30.341 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:30.340+0000 7faa63fff640 1 -- 172.21.15.150:0/655530767 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(60..60 src has 1..60) ==== 5737+0+0 (secure 0 0 0) 0x7faa6c099a20 con 0x7faa64004800 2024-09-17T05:46:30.342 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:30.341+0000 7faa7affd640 1 --2- 172.21.15.150:0/655530767 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7faa680796d0 0x7faa6807bbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:46:30.345 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:30.344+0000 7faa63fff640 1 -- 172.21.15.150:0/655530767 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7faa7c152010 con 0x7faa64004800 2024-09-17T05:46:30.350 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:30.348+0000 7faa7affd640 1 --2- 172.21.15.150:0/655530767 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7faa680796d0 0x7faa6807bbe0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7faa70033000 tx=0x7faa7c0b5280 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:46:30.709 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:30.707+0000 7faa81d2b640 1 -- 172.21.15.150:0/655530767 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) -- 0x7faa7c06fe20 con 0x7faa64004800 2024-09-17T05:46:30.711 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:30.709+0000 7faa63fff640 1 -- 172.21.15.150:0/655530767 <== mon.0 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) ==== 79+0+2336 (secure 0 0 0) 0x7faa6c063660 con 0x7faa64004800 2024-09-17T05:46:30.711 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-09-17T05:46:30.711 INFO:teuthology.orchestra.run.smithi150.stdout:{ 2024-09-17T05:46:30.711 INFO:teuthology.orchestra.run.smithi150.stdout: "fsid": "9f2e05e9-d629-47b3-b26b-1360655b7d20", 2024-09-17T05:46:30.711 INFO:teuthology.orchestra.run.smithi150.stdout: "health": { 2024-09-17T05:46:30.711 INFO:teuthology.orchestra.run.smithi150.stdout: "status": "HEALTH_OK", 2024-09-17T05:46:30.711 INFO:teuthology.orchestra.run.smithi150.stdout: "checks": {}, 2024-09-17T05:46:30.711 INFO:teuthology.orchestra.run.smithi150.stdout: "mutes": [] 2024-09-17T05:46:30.712 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-17T05:46:30.712 INFO:teuthology.orchestra.run.smithi150.stdout: "election_epoch": 4, 2024-09-17T05:46:30.712 INFO:teuthology.orchestra.run.smithi150.stdout: "quorum": [ 2024-09-17T05:46:30.712 INFO:teuthology.orchestra.run.smithi150.stdout: 0, 2024-09-17T05:46:30.712 INFO:teuthology.orchestra.run.smithi150.stdout: 1, 2024-09-17T05:46:30.712 INFO:teuthology.orchestra.run.smithi150.stdout: 2 2024-09-17T05:46:30.712 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2024-09-17T05:46:30.712 INFO:teuthology.orchestra.run.smithi150.stdout: "quorum_names": [ 2024-09-17T05:46:30.712 INFO:teuthology.orchestra.run.smithi150.stdout: "a", 2024-09-17T05:46:30.712 INFO:teuthology.orchestra.run.smithi150.stdout: "b", 2024-09-17T05:46:30.712 INFO:teuthology.orchestra.run.smithi150.stdout: "c" 2024-09-17T05:46:30.712 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2024-09-17T05:46:30.712 INFO:teuthology.orchestra.run.smithi150.stdout: "quorum_age": 298, 2024-09-17T05:46:30.712 INFO:teuthology.orchestra.run.smithi150.stdout: "monmap": { 2024-09-17T05:46:30.713 INFO:teuthology.orchestra.run.smithi150.stdout: "epoch": 1, 2024-09-17T05:46:30.713 INFO:teuthology.orchestra.run.smithi150.stdout: "min_mon_release_name": "squid", 2024-09-17T05:46:30.713 INFO:teuthology.orchestra.run.smithi150.stdout: "num_mons": 3 2024-09-17T05:46:30.713 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-17T05:46:30.713 INFO:teuthology.orchestra.run.smithi150.stdout: "osdmap": { 2024-09-17T05:46:30.713 INFO:teuthology.orchestra.run.smithi150.stdout: "epoch": 60, 2024-09-17T05:46:30.713 INFO:teuthology.orchestra.run.smithi150.stdout: "num_osds": 8, 2024-09-17T05:46:30.713 INFO:teuthology.orchestra.run.smithi150.stdout: "num_up_osds": 8, 2024-09-17T05:46:30.713 INFO:teuthology.orchestra.run.smithi150.stdout: "osd_up_since": 1726551706, 2024-09-17T05:46:30.713 INFO:teuthology.orchestra.run.smithi150.stdout: "num_in_osds": 8, 2024-09-17T05:46:30.713 INFO:teuthology.orchestra.run.smithi150.stdout: "osd_in_since": 1726551696, 2024-09-17T05:46:30.713 INFO:teuthology.orchestra.run.smithi150.stdout: "num_remapped_pgs": 0 2024-09-17T05:46:30.713 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-17T05:46:30.714 INFO:teuthology.orchestra.run.smithi150.stdout: "pgmap": { 2024-09-17T05:46:30.714 INFO:teuthology.orchestra.run.smithi150.stdout: "pgs_by_state": [ 2024-09-17T05:46:30.714 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-09-17T05:46:30.714 INFO:teuthology.orchestra.run.smithi150.stdout: "state_name": "active+clean", 2024-09-17T05:46:30.714 INFO:teuthology.orchestra.run.smithi150.stdout: "count": 97 2024-09-17T05:46:30.714 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-09-17T05:46:30.714 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2024-09-17T05:46:30.714 INFO:teuthology.orchestra.run.smithi150.stdout: "num_pgs": 97, 2024-09-17T05:46:30.714 INFO:teuthology.orchestra.run.smithi150.stdout: "num_pools": 3, 2024-09-17T05:46:30.714 INFO:teuthology.orchestra.run.smithi150.stdout: "num_objects": 2585, 2024-09-17T05:46:30.714 INFO:teuthology.orchestra.run.smithi150.stdout: "data_bytes": 10738477980, 2024-09-17T05:46:30.714 INFO:teuthology.orchestra.run.smithi150.stdout: "bytes_used": 21932924928, 2024-09-17T05:46:30.714 INFO:teuthology.orchestra.run.smithi150.stdout: "bytes_avail": 751161188352, 2024-09-17T05:46:30.714 INFO:teuthology.orchestra.run.smithi150.stdout: "bytes_total": 773094113280, 2024-09-17T05:46:30.715 INFO:teuthology.orchestra.run.smithi150.stdout: "write_bytes_sec": 307144228, 2024-09-17T05:46:30.715 INFO:teuthology.orchestra.run.smithi150.stdout: "read_op_per_sec": 0, 2024-09-17T05:46:30.715 INFO:teuthology.orchestra.run.smithi150.stdout: "write_op_per_sec": 77 2024-09-17T05:46:30.715 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-17T05:46:30.715 INFO:teuthology.orchestra.run.smithi150.stdout: "fsmap": { 2024-09-17T05:46:30.715 INFO:teuthology.orchestra.run.smithi150.stdout: "epoch": 34, 2024-09-17T05:46:30.715 INFO:teuthology.orchestra.run.smithi150.stdout: "btime": "2024-09-17T05:45:44:972475+0000", 2024-09-17T05:46:30.715 INFO:teuthology.orchestra.run.smithi150.stdout: "id": 4, 2024-09-17T05:46:30.715 INFO:teuthology.orchestra.run.smithi150.stdout: "up": 1, 2024-09-17T05:46:30.715 INFO:teuthology.orchestra.run.smithi150.stdout: "in": 1, 2024-09-17T05:46:30.715 INFO:teuthology.orchestra.run.smithi150.stdout: "max": 1, 2024-09-17T05:46:30.715 INFO:teuthology.orchestra.run.smithi150.stdout: "by_rank": [ 2024-09-17T05:46:30.715 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-09-17T05:46:30.716 INFO:teuthology.orchestra.run.smithi150.stdout: "filesystem_id": 4, 2024-09-17T05:46:30.716 INFO:teuthology.orchestra.run.smithi150.stdout: "rank": 0, 2024-09-17T05:46:30.716 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "a", 2024-09-17T05:46:30.716 INFO:teuthology.orchestra.run.smithi150.stdout: "status": "up:active", 2024-09-17T05:46:30.716 INFO:teuthology.orchestra.run.smithi150.stdout: "gid": 6009 2024-09-17T05:46:30.716 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-09-17T05:46:30.716 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2024-09-17T05:46:30.716 INFO:teuthology.orchestra.run.smithi150.stdout: "up:standby": 3 2024-09-17T05:46:30.716 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-17T05:46:30.716 INFO:teuthology.orchestra.run.smithi150.stdout: "mgrmap": { 2024-09-17T05:46:30.716 INFO:teuthology.orchestra.run.smithi150.stdout: "available": true, 2024-09-17T05:46:30.716 INFO:teuthology.orchestra.run.smithi150.stdout: "num_standbys": 1, 2024-09-17T05:46:30.716 INFO:teuthology.orchestra.run.smithi150.stdout: "modules": [ 2024-09-17T05:46:30.716 INFO:teuthology.orchestra.run.smithi150.stdout: "iostat", 2024-09-17T05:46:30.717 INFO:teuthology.orchestra.run.smithi150.stdout: "nfs", 2024-09-17T05:46:30.717 INFO:teuthology.orchestra.run.smithi150.stdout: "restful" 2024-09-17T05:46:30.717 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2024-09-17T05:46:30.717 INFO:teuthology.orchestra.run.smithi150.stdout: "services": {} 2024-09-17T05:46:30.717 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-17T05:46:30.717 INFO:teuthology.orchestra.run.smithi150.stdout: "servicemap": { 2024-09-17T05:46:30.717 INFO:teuthology.orchestra.run.smithi150.stdout: "epoch": 11, 2024-09-17T05:46:30.717 INFO:teuthology.orchestra.run.smithi150.stdout: "modified": "2024-09-17T05:46:28.924826+0000", 2024-09-17T05:46:30.717 INFO:teuthology.orchestra.run.smithi150.stdout: "services": { 2024-09-17T05:46:30.717 INFO:teuthology.orchestra.run.smithi150.stdout: "mds": { 2024-09-17T05:46:30.717 INFO:teuthology.orchestra.run.smithi150.stdout: "daemons": { 2024-09-17T05:46:30.717 INFO:teuthology.orchestra.run.smithi150.stdout: "summary": "", 2024-09-17T05:46:30.717 INFO:teuthology.orchestra.run.smithi150.stdout: "a": { 2024-09-17T05:46:30.718 INFO:teuthology.orchestra.run.smithi150.stdout: "start_epoch": 0, 2024-09-17T05:46:30.718 INFO:teuthology.orchestra.run.smithi150.stdout: "start_stamp": "0.000000", 2024-09-17T05:46:30.718 INFO:teuthology.orchestra.run.smithi150.stdout: "gid": 0, 2024-09-17T05:46:30.718 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "(unrecognized address family 0)/0", 2024-09-17T05:46:30.718 INFO:teuthology.orchestra.run.smithi150.stdout: "metadata": {}, 2024-09-17T05:46:30.718 INFO:teuthology.orchestra.run.smithi150.stdout: "task_status": {} 2024-09-17T05:46:30.718 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-09-17T05:46:30.718 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-09-17T05:46:30.718 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-09-17T05:46:30.718 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-09-17T05:46:30.718 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-17T05:46:30.718 INFO:teuthology.orchestra.run.smithi150.stdout: "progress_events": {} 2024-09-17T05:46:30.718 INFO:teuthology.orchestra.run.smithi150.stdout:} 2024-09-17T05:46:30.719 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:30.715+0000 7faa81d2b640 1 -- 172.21.15.150:0/655530767 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7faa680796d0 msgr2=0x7faa6807bbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:46:30.719 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:30.715+0000 7faa81d2b640 1 --2- 172.21.15.150:0/655530767 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7faa680796d0 0x7faa6807bbe0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7faa70033000 tx=0x7faa7c0b5280 comp rx=0 tx=0).stop 2024-09-17T05:46:30.719 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:30.715+0000 7faa81d2b640 1 -- 172.21.15.150:0/655530767 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7faa64004800 msgr2=0x7faa7c148e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:46:30.719 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:30.715+0000 7faa81d2b640 1 --2- 172.21.15.150:0/655530767 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7faa64004800 0x7faa7c148e60 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7faa6c00d650 tx=0x7faa6c00db10 comp rx=0 tx=0).stop 2024-09-17T05:46:30.719 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:30.715+0000 7faa81d2b640 1 -- 172.21.15.150:0/655530767 shutdown_connections 2024-09-17T05:46:30.720 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:30.715+0000 7faa81d2b640 1 --2- 172.21.15.150:0/655530767 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7faa7c151c00 0x7faa7c074090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:30.720 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:30.715+0000 7faa81d2b640 1 --2- 172.21.15.150:0/655530767 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7faa680796d0 0x7faa6807bbe0 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:30.720 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:30.715+0000 7faa81d2b640 1 --2- 172.21.15.150:0/655530767 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7faa7c1494d0 0x7faa7c1516c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:30.720 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:30.715+0000 7faa81d2b640 1 --2- 172.21.15.150:0/655530767 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7faa64004800 0x7faa7c148e60 unknown :-1 s=CLOSED pgs=693 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:30.720 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:30.715+0000 7faa81d2b640 1 -- 172.21.15.150:0/655530767 >> 172.21.15.150:0/655530767 conn(0x7faa7c06d730 msgr2=0x7faa7c0703e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:46:30.720 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:30.715+0000 7faa81d2b640 1 -- 172.21.15.150:0/655530767 shutdown_connections 2024-09-17T05:46:30.720 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:30.716+0000 7faa81d2b640 1 -- 172.21.15.150:0/655530767 wait complete. 2024-09-17T05:46:31.737 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format json-pretty 2024-09-17T05:46:31.897 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:31.895+0000 7ff3cfe38640 1 -- 172.21.15.150:0/1198969769 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff3c80b3b10 msgr2=0x7ff3c80b6b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:46:31.897 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:31.895+0000 7ff3cfe38640 1 --2- 172.21.15.150:0/1198969769 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff3c80b3b10 0x7ff3c80b6b70 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x7ff3bc009830 tx=0x7ff3bc02a410 comp rx=0 tx=0).stop 2024-09-17T05:46:31.897 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:31.895+0000 7ff3cfe38640 1 -- 172.21.15.150:0/1198969769 shutdown_connections 2024-09-17T05:46:31.898 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:31.895+0000 7ff3cfe38640 1 --2- 172.21.15.150:0/1198969769 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff3c80ae2d0 0x7ff3c80ae6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:31.898 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:31.895+0000 7ff3cfe38640 1 --2- 172.21.15.150:0/1198969769 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff3c80b3b10 0x7ff3c80b6b70 unknown :-1 s=CLOSED pgs=695 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:31.898 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:31.895+0000 7ff3cfe38640 1 -- 172.21.15.150:0/1198969769 >> 172.21.15.150:0/1198969769 conn(0x7ff3c80b2ff0 msgr2=0x7ff3c80b3400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:46:31.898 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:31.896+0000 7ff3cfe38640 1 -- 172.21.15.150:0/1198969769 shutdown_connections 2024-09-17T05:46:31.898 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:31.896+0000 7ff3cfe38640 1 -- 172.21.15.150:0/1198969769 wait complete. 2024-09-17T05:46:31.899 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:31.898+0000 7ff3cfe38640 1 Processor -- start 2024-09-17T05:46:31.900 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:31.898+0000 7ff3cfe38640 1 -- start start 2024-09-17T05:46:31.902 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:31.900+0000 7ff3cfe38640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff3c806cda0 0x7ff3c809ed20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:46:31.902 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:31.900+0000 7ff3cfe38640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff3c80ae2d0 0x7ff3c8152610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:46:31.902 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:31.900+0000 7ff3cfe38640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff3c80b3b10 0x7ff3c81f68c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:46:31.902 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:31.900+0000 7ff3cfe38640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7ff3c80ccfa0 con 0x7ff3c80b3b10 2024-09-17T05:46:31.902 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:31.900+0000 7ff3cfe38640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7ff3c80cce20 con 0x7ff3c806cda0 2024-09-17T05:46:31.902 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:31.900+0000 7ff3cfe38640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7ff3c80cd120 con 0x7ff3c80ae2d0 2024-09-17T05:46:31.902 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:31.900+0000 7ff3ce3d5640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff3c80b3b10 0x7ff3c81f68c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:46:31.902 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:31.900+0000 7ff3ce3d5640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff3c80b3b10 0x7ff3c81f68c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:35106/0 (socket says 172.21.15.150:35106) 2024-09-17T05:46:31.902 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:31.900+0000 7ff3ce3d5640 1 -- 172.21.15.150:0/634991630 learned_addr learned my addr 172.21.15.150:0/634991630 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:46:31.904 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:31.901+0000 7ff3cdbd4640 1 --2- 172.21.15.150:0/634991630 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff3c806cda0 0x7ff3c809ed20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:46:31.904 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:31.901+0000 7ff3ce3d5640 1 -- 172.21.15.150:0/634991630 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff3c80ae2d0 msgr2=0x7ff3c8152610 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-17T05:46:31.904 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:31.901+0000 7ff3ce3d5640 1 --2- 172.21.15.150:0/634991630 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff3c80ae2d0 0x7ff3c8152610 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:31.904 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:31.901+0000 7ff3ce3d5640 1 -- 172.21.15.150:0/634991630 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff3c806cda0 msgr2=0x7ff3c809ed20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:46:31.904 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:31.901+0000 7ff3ce3d5640 1 --2- 172.21.15.150:0/634991630 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff3c806cda0 0x7ff3c809ed20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:31.904 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:31.901+0000 7ff3ce3d5640 1 -- 172.21.15.150:0/634991630 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff3c8071fd0 con 0x7ff3c80b3b10 2024-09-17T05:46:31.904 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:31.901+0000 7ff3cdbd4640 1 --2- 172.21.15.150:0/634991630 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff3c806cda0 0x7ff3c809ed20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T05:46:31.904 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:31.901+0000 7ff3ce3d5640 1 --2- 172.21.15.150:0/634991630 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff3c80b3b10 0x7ff3c81f68c0 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7ff3c000eab0 tx=0x7ff3c000ef70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:46:31.904 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:31.902+0000 7ff3ba7fc640 1 -- 172.21.15.150:0/634991630 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3c000cea0 con 0x7ff3c80b3b10 2024-09-17T05:46:31.904 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:31.902+0000 7ff3ba7fc640 1 -- 172.21.15.150:0/634991630 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff3c0004b20 con 0x7ff3c80b3b10 2024-09-17T05:46:31.904 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:31.902+0000 7ff3ba7fc640 1 -- 172.21.15.150:0/634991630 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3c0005020 con 0x7ff3c80b3b10 2024-09-17T05:46:31.905 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:31.902+0000 7ff3cfe38640 1 -- 172.21.15.150:0/634991630 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff3c809cf30 con 0x7ff3c80b3b10 2024-09-17T05:46:31.905 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:31.902+0000 7ff3cfe38640 1 -- 172.21.15.150:0/634991630 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff3c8071cf0 con 0x7ff3c80b3b10 2024-09-17T05:46:31.907 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:31.905+0000 7ff3ba7fc640 1 -- 172.21.15.150:0/634991630 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 18) ==== 102512+0+0 (secure 0 0 0) 0x7ff3c00051c0 con 0x7ff3c80b3b10 2024-09-17T05:46:31.907 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:31.905+0000 7ff3cfe38640 1 -- 172.21.15.150:0/634991630 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff3c80cd5e0 con 0x7ff3c80b3b10 2024-09-17T05:46:31.908 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:31.906+0000 7ff3ba7fc640 1 --2- 172.21.15.150:0/634991630 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7ff3ac079790 0x7ff3ac07bca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:46:31.909 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:31.907+0000 7ff3ba7fc640 1 -- 172.21.15.150:0/634991630 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(60..60 src has 1..60) ==== 5737+0+0 (secure 0 0 0) 0x7ff3c009a2d0 con 0x7ff3c80b3b10 2024-09-17T05:46:31.915 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:31.913+0000 7ff3ba7fc640 1 -- 172.21.15.150:0/634991630 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7ff3c0064250 con 0x7ff3c80b3b10 2024-09-17T05:46:31.923 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:31.921+0000 7ff3cdbd4640 1 --2- 172.21.15.150:0/634991630 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7ff3ac079790 0x7ff3ac07bca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:46:31.924 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:31.923+0000 7ff3cdbd4640 1 --2- 172.21.15.150:0/634991630 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7ff3ac079790 0x7ff3ac07bca0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7ff3bc034000 tx=0x7ff3bc004730 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:46:32.261 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:32.259+0000 7ff3cfe38640 1 -- 172.21.15.150:0/634991630 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) -- 0x7ff3c80b37c0 con 0x7ff3c80b3b10 2024-09-17T05:46:32.261 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:32.260+0000 7ff3ba7fc640 1 -- 172.21.15.150:0/634991630 <== mon.0 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) ==== 79+0+2599 (secure 0 0 0) 0x7ff3c0064250 con 0x7ff3c80b3b10 2024-09-17T05:46:32.262 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-09-17T05:46:32.262 INFO:teuthology.orchestra.run.smithi150.stdout:{ 2024-09-17T05:46:32.262 INFO:teuthology.orchestra.run.smithi150.stdout: "fsid": "9f2e05e9-d629-47b3-b26b-1360655b7d20", 2024-09-17T05:46:32.262 INFO:teuthology.orchestra.run.smithi150.stdout: "health": { 2024-09-17T05:46:32.262 INFO:teuthology.orchestra.run.smithi150.stdout: "status": "HEALTH_OK", 2024-09-17T05:46:32.262 INFO:teuthology.orchestra.run.smithi150.stdout: "checks": {}, 2024-09-17T05:46:32.262 INFO:teuthology.orchestra.run.smithi150.stdout: "mutes": [] 2024-09-17T05:46:32.262 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-17T05:46:32.262 INFO:teuthology.orchestra.run.smithi150.stdout: "election_epoch": 4, 2024-09-17T05:46:32.262 INFO:teuthology.orchestra.run.smithi150.stdout: "quorum": [ 2024-09-17T05:46:32.263 INFO:teuthology.orchestra.run.smithi150.stdout: 0, 2024-09-17T05:46:32.263 INFO:teuthology.orchestra.run.smithi150.stdout: 1, 2024-09-17T05:46:32.263 INFO:teuthology.orchestra.run.smithi150.stdout: 2 2024-09-17T05:46:32.263 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2024-09-17T05:46:32.263 INFO:teuthology.orchestra.run.smithi150.stdout: "quorum_names": [ 2024-09-17T05:46:32.263 INFO:teuthology.orchestra.run.smithi150.stdout: "a", 2024-09-17T05:46:32.263 INFO:teuthology.orchestra.run.smithi150.stdout: "b", 2024-09-17T05:46:32.263 INFO:teuthology.orchestra.run.smithi150.stdout: "c" 2024-09-17T05:46:32.263 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2024-09-17T05:46:32.263 INFO:teuthology.orchestra.run.smithi150.stdout: "quorum_age": 299, 2024-09-17T05:46:32.263 INFO:teuthology.orchestra.run.smithi150.stdout: "monmap": { 2024-09-17T05:46:32.263 INFO:teuthology.orchestra.run.smithi150.stdout: "epoch": 1, 2024-09-17T05:46:32.263 INFO:teuthology.orchestra.run.smithi150.stdout: "min_mon_release_name": "squid", 2024-09-17T05:46:32.264 INFO:teuthology.orchestra.run.smithi150.stdout: "num_mons": 3 2024-09-17T05:46:32.264 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-17T05:46:32.264 INFO:teuthology.orchestra.run.smithi150.stdout: "osdmap": { 2024-09-17T05:46:32.264 INFO:teuthology.orchestra.run.smithi150.stdout: "epoch": 60, 2024-09-17T05:46:32.264 INFO:teuthology.orchestra.run.smithi150.stdout: "num_osds": 8, 2024-09-17T05:46:32.264 INFO:teuthology.orchestra.run.smithi150.stdout: "num_up_osds": 8, 2024-09-17T05:46:32.264 INFO:teuthology.orchestra.run.smithi150.stdout: "osd_up_since": 1726551706, 2024-09-17T05:46:32.264 INFO:teuthology.orchestra.run.smithi150.stdout: "num_in_osds": 8, 2024-09-17T05:46:32.264 INFO:teuthology.orchestra.run.smithi150.stdout: "osd_in_since": 1726551696, 2024-09-17T05:46:32.264 INFO:teuthology.orchestra.run.smithi150.stdout: "num_remapped_pgs": 0 2024-09-17T05:46:32.264 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-17T05:46:32.264 INFO:teuthology.orchestra.run.smithi150.stdout: "pgmap": { 2024-09-17T05:46:32.264 INFO:teuthology.orchestra.run.smithi150.stdout: "pgs_by_state": [ 2024-09-17T05:46:32.265 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-09-17T05:46:32.265 INFO:teuthology.orchestra.run.smithi150.stdout: "state_name": "active+clean", 2024-09-17T05:46:32.265 INFO:teuthology.orchestra.run.smithi150.stdout: "count": 97 2024-09-17T05:46:32.265 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-09-17T05:46:32.265 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2024-09-17T05:46:32.265 INFO:teuthology.orchestra.run.smithi150.stdout: "num_pgs": 97, 2024-09-17T05:46:32.265 INFO:teuthology.orchestra.run.smithi150.stdout: "num_pools": 3, 2024-09-17T05:46:32.265 INFO:teuthology.orchestra.run.smithi150.stdout: "num_objects": 2585, 2024-09-17T05:46:32.265 INFO:teuthology.orchestra.run.smithi150.stdout: "data_bytes": 10738477980, 2024-09-17T05:46:32.265 INFO:teuthology.orchestra.run.smithi150.stdout: "bytes_used": 21932924928, 2024-09-17T05:46:32.265 INFO:teuthology.orchestra.run.smithi150.stdout: "bytes_avail": 751161188352, 2024-09-17T05:46:32.265 INFO:teuthology.orchestra.run.smithi150.stdout: "bytes_total": 773094113280, 2024-09-17T05:46:32.266 INFO:teuthology.orchestra.run.smithi150.stdout: "write_bytes_sec": 228178593, 2024-09-17T05:46:32.266 INFO:teuthology.orchestra.run.smithi150.stdout: "read_op_per_sec": 0, 2024-09-17T05:46:32.266 INFO:teuthology.orchestra.run.smithi150.stdout: "write_op_per_sec": 57 2024-09-17T05:46:32.266 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-17T05:46:32.266 INFO:teuthology.orchestra.run.smithi150.stdout: "fsmap": { 2024-09-17T05:46:32.266 INFO:teuthology.orchestra.run.smithi150.stdout: "epoch": 34, 2024-09-17T05:46:32.266 INFO:teuthology.orchestra.run.smithi150.stdout: "btime": "2024-09-17T05:45:44:972475+0000", 2024-09-17T05:46:32.266 INFO:teuthology.orchestra.run.smithi150.stdout: "id": 4, 2024-09-17T05:46:32.266 INFO:teuthology.orchestra.run.smithi150.stdout: "up": 1, 2024-09-17T05:46:32.266 INFO:teuthology.orchestra.run.smithi150.stdout: "in": 1, 2024-09-17T05:46:32.266 INFO:teuthology.orchestra.run.smithi150.stdout: "max": 1, 2024-09-17T05:46:32.266 INFO:teuthology.orchestra.run.smithi150.stdout: "by_rank": [ 2024-09-17T05:46:32.266 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-09-17T05:46:32.267 INFO:teuthology.orchestra.run.smithi150.stdout: "filesystem_id": 4, 2024-09-17T05:46:32.267 INFO:teuthology.orchestra.run.smithi150.stdout: "rank": 0, 2024-09-17T05:46:32.267 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "a", 2024-09-17T05:46:32.267 INFO:teuthology.orchestra.run.smithi150.stdout: "status": "up:active", 2024-09-17T05:46:32.267 INFO:teuthology.orchestra.run.smithi150.stdout: "gid": 6009 2024-09-17T05:46:32.267 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-09-17T05:46:32.267 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2024-09-17T05:46:32.267 INFO:teuthology.orchestra.run.smithi150.stdout: "up:standby": 3 2024-09-17T05:46:32.267 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-17T05:46:32.267 INFO:teuthology.orchestra.run.smithi150.stdout: "mgrmap": { 2024-09-17T05:46:32.267 INFO:teuthology.orchestra.run.smithi150.stdout: "available": true, 2024-09-17T05:46:32.267 INFO:teuthology.orchestra.run.smithi150.stdout: "num_standbys": 1, 2024-09-17T05:46:32.268 INFO:teuthology.orchestra.run.smithi150.stdout: "modules": [ 2024-09-17T05:46:32.268 INFO:teuthology.orchestra.run.smithi150.stdout: "iostat", 2024-09-17T05:46:32.268 INFO:teuthology.orchestra.run.smithi150.stdout: "nfs", 2024-09-17T05:46:32.268 INFO:teuthology.orchestra.run.smithi150.stdout: "restful" 2024-09-17T05:46:32.268 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2024-09-17T05:46:32.268 INFO:teuthology.orchestra.run.smithi150.stdout: "services": {} 2024-09-17T05:46:32.268 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-17T05:46:32.268 INFO:teuthology.orchestra.run.smithi150.stdout: "servicemap": { 2024-09-17T05:46:32.268 INFO:teuthology.orchestra.run.smithi150.stdout: "epoch": 11, 2024-09-17T05:46:32.268 INFO:teuthology.orchestra.run.smithi150.stdout: "modified": "2024-09-17T05:46:28.924826+0000", 2024-09-17T05:46:32.268 INFO:teuthology.orchestra.run.smithi150.stdout: "services": { 2024-09-17T05:46:32.268 INFO:teuthology.orchestra.run.smithi150.stdout: "mds": { 2024-09-17T05:46:32.268 INFO:teuthology.orchestra.run.smithi150.stdout: "daemons": { 2024-09-17T05:46:32.269 INFO:teuthology.orchestra.run.smithi150.stdout: "summary": "", 2024-09-17T05:46:32.269 INFO:teuthology.orchestra.run.smithi150.stdout: "a": { 2024-09-17T05:46:32.269 INFO:teuthology.orchestra.run.smithi150.stdout: "start_epoch": 0, 2024-09-17T05:46:32.269 INFO:teuthology.orchestra.run.smithi150.stdout: "start_stamp": "0.000000", 2024-09-17T05:46:32.269 INFO:teuthology.orchestra.run.smithi150.stdout: "gid": 0, 2024-09-17T05:46:32.269 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "(unrecognized address family 0)/0", 2024-09-17T05:46:32.269 INFO:teuthology.orchestra.run.smithi150.stdout: "metadata": {}, 2024-09-17T05:46:32.269 INFO:teuthology.orchestra.run.smithi150.stdout: "task_status": {} 2024-09-17T05:46:32.269 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-09-17T05:46:32.269 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-09-17T05:46:32.269 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-09-17T05:46:32.269 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-09-17T05:46:32.269 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-17T05:46:32.270 INFO:teuthology.orchestra.run.smithi150.stdout: "progress_events": { 2024-09-17T05:46:32.270 INFO:teuthology.orchestra.run.smithi150.stdout: "mgr-vol-ongoing-clones": { 2024-09-17T05:46:32.270 INFO:teuthology.orchestra.run.smithi150.stdout: "message": "1 ongoing clones - average progress is 4.766% (1s)\n [=...........................] (remaining: 21s)", 2024-09-17T05:46:32.270 INFO:teuthology.orchestra.run.smithi150.stdout: "progress": 0.047660000622272491, 2024-09-17T05:46:32.270 INFO:teuthology.orchestra.run.smithi150.stdout: "add_to_ceph_s": true 2024-09-17T05:46:32.270 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-09-17T05:46:32.270 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-09-17T05:46:32.270 INFO:teuthology.orchestra.run.smithi150.stdout:} 2024-09-17T05:46:32.271 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:32.264+0000 7ff3cfe38640 1 -- 172.21.15.150:0/634991630 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7ff3ac079790 msgr2=0x7ff3ac07bca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:46:32.271 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:32.264+0000 7ff3cfe38640 1 --2- 172.21.15.150:0/634991630 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7ff3ac079790 0x7ff3ac07bca0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7ff3bc034000 tx=0x7ff3bc004730 comp rx=0 tx=0).stop 2024-09-17T05:46:32.271 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:32.264+0000 7ff3cfe38640 1 -- 172.21.15.150:0/634991630 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff3c80b3b10 msgr2=0x7ff3c81f68c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:46:32.271 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:32.264+0000 7ff3cfe38640 1 --2- 172.21.15.150:0/634991630 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff3c80b3b10 0x7ff3c81f68c0 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7ff3c000eab0 tx=0x7ff3c000ef70 comp rx=0 tx=0).stop 2024-09-17T05:46:32.271 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:32.264+0000 7ff3cfe38640 1 -- 172.21.15.150:0/634991630 shutdown_connections 2024-09-17T05:46:32.271 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:32.264+0000 7ff3cfe38640 1 --2- 172.21.15.150:0/634991630 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7ff3ac079790 0x7ff3ac07bca0 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:32.271 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:32.264+0000 7ff3cfe38640 1 --2- 172.21.15.150:0/634991630 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff3c80b3b10 0x7ff3c81f68c0 unknown :-1 s=CLOSED pgs=696 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:32.271 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:32.264+0000 7ff3cfe38640 1 --2- 172.21.15.150:0/634991630 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff3c80ae2d0 0x7ff3c8152610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:32.271 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:32.264+0000 7ff3cfe38640 1 --2- 172.21.15.150:0/634991630 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff3c806cda0 0x7ff3c809ed20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:32.271 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:32.264+0000 7ff3cfe38640 1 -- 172.21.15.150:0/634991630 >> 172.21.15.150:0/634991630 conn(0x7ff3c80b2ff0 msgr2=0x7ff3c815c8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:46:32.272 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:32.265+0000 7ff3cfe38640 1 -- 172.21.15.150:0/634991630 shutdown_connections 2024-09-17T05:46:32.272 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:32.265+0000 7ff3cfe38640 1 -- 172.21.15.150:0/634991630 wait complete. 2024-09-17T05:46:32.285 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs clone cancel cephfs ss1clone1 2024-09-17T05:46:32.475 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:32.473+0000 7f358f59e640 1 -- 172.21.15.150:0/1456440167 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3588056da0 msgr2=0x7f3588057c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:46:32.476 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:32.473+0000 7f358f59e640 1 --2- 172.21.15.150:0/1456440167 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3588056da0 0x7f3588057c80 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7f3588010e80 tx=0x7f358402a4b0 comp rx=0 tx=0).stop 2024-09-17T05:46:32.476 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:32.474+0000 7f358f59e640 1 -- 172.21.15.150:0/1456440167 shutdown_connections 2024-09-17T05:46:32.476 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:32.474+0000 7f358f59e640 1 --2- 172.21.15.150:0/1456440167 >> v2:172.21.15.176:3300/0 conn(0x7f3588054360 0x7f358803c1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:32.476 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:32.474+0000 7f358f59e640 1 --2- 172.21.15.150:0/1456440167 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3588056da0 0x7f3588057c80 unknown :-1 s=CLOSED pgs=697 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:32.476 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:32.474+0000 7f358f59e640 1 -- 172.21.15.150:0/1456440167 >> 172.21.15.150:0/1456440167 conn(0x7f358803a5f0 msgr2=0x7f358803aa00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:46:32.476 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:32.474+0000 7f358f59e640 1 -- 172.21.15.150:0/1456440167 shutdown_connections 2024-09-17T05:46:32.476 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:32.474+0000 7f358f59e640 1 -- 172.21.15.150:0/1456440167 wait complete. 2024-09-17T05:46:32.479 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:32.478+0000 7f358f59e640 1 Processor -- start 2024-09-17T05:46:32.480 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:32.478+0000 7f358f59e640 1 -- start start 2024-09-17T05:46:32.483 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:32.481+0000 7f358f59e640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3588054360 0x7f35880df480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:46:32.483 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:32.481+0000 7f358f59e640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3588056da0 0x7f35880d6a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:46:32.484 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:32.481+0000 7f358f59e640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f35880e2f40 0x7f358804cd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:46:32.484 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:32.481+0000 7f358f59e640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f35880070c0 con 0x7f3588054360 2024-09-17T05:46:32.484 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:32.482+0000 7f358e59c640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3588054360 0x7f35880df480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:46:32.484 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:32.482+0000 7f358e59c640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3588054360 0x7f35880df480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:35130/0 (socket says 172.21.15.150:35130) 2024-09-17T05:46:32.484 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:32.482+0000 7f358e59c640 1 -- 172.21.15.150:0/2812652048 learned_addr learned my addr 172.21.15.150:0/2812652048 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:46:32.484 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:32.482+0000 7f358f59e640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f3588006f40 con 0x7f35880e2f40 2024-09-17T05:46:32.484 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:32.482+0000 7f358f59e640 1 -- 172.21.15.150:0/2812652048 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f3588007240 con 0x7f3588056da0 2024-09-17T05:46:32.484 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:32.482+0000 7f358dd9b640 1 --2- 172.21.15.150:0/2812652048 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3588056da0 0x7f35880d6a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:46:32.485 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:32.482+0000 7f358e59c640 1 -- 172.21.15.150:0/2812652048 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3588056da0 msgr2=0x7f35880d6a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:46:32.486 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:32.482+0000 7f358e59c640 1 --2- 172.21.15.150:0/2812652048 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3588056da0 0x7f35880d6a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:32.486 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:32.482+0000 7f358e59c640 1 -- 172.21.15.150:0/2812652048 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f35880e2f40 msgr2=0x7f358804cd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:46:32.486 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:32.482+0000 7f358e59c640 1 --2- 172.21.15.150:0/2812652048 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f35880e2f40 0x7f358804cd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:32.486 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:32.482+0000 7f358e59c640 1 -- 172.21.15.150:0/2812652048 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f35880dbe70 con 0x7f3588054360 2024-09-17T05:46:32.486 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:32.482+0000 7f358dd9b640 1 --2- 172.21.15.150:0/2812652048 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3588056da0 0x7f35880d6a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:46:32.486 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:32.483+0000 7f358e59c640 1 --2- 172.21.15.150:0/2812652048 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3588054360 0x7f35880df480 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7f3584000c00 tx=0x7f3584003b90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:46:32.486 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:32.483+0000 7f357effd640 1 -- 172.21.15.150:0/2812652048 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f358403e030 con 0x7f3588054360 2024-09-17T05:46:32.486 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:32.483+0000 7f357effd640 1 -- 172.21.15.150:0/2812652048 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f3584005610 con 0x7f3588054360 2024-09-17T05:46:32.486 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:32.483+0000 7f358f59e640 1 -- 172.21.15.150:0/2812652048 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f35880dc150 con 0x7f3588054360 2024-09-17T05:46:32.486 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:32.483+0000 7f357effd640 1 -- 172.21.15.150:0/2812652048 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3584035040 con 0x7f3588054360 2024-09-17T05:46:32.486 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:32.483+0000 7f358f59e640 1 -- 172.21.15.150:0/2812652048 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f358804c840 con 0x7f3588054360 2024-09-17T05:46:32.487 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:32.485+0000 7f358f59e640 1 -- 172.21.15.150:0/2812652048 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f35880dba00 con 0x7f3588054360 2024-09-17T05:46:32.487 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:32.485+0000 7f357effd640 1 -- 172.21.15.150:0/2812652048 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 18) ==== 102512+0+0 (secure 0 0 0) 0x7f3584041030 con 0x7f3588054360 2024-09-17T05:46:32.488 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:32.486+0000 7f357effd640 1 --2- 172.21.15.150:0/2812652048 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f3570079760 0x7f357007bc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:46:32.488 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:32.486+0000 7f357effd640 1 -- 172.21.15.150:0/2812652048 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(60..60 src has 1..60) ==== 5737+0+0 (secure 0 0 0) 0x7f35840ba070 con 0x7f3588054360 2024-09-17T05:46:32.489 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:32.487+0000 7f358dd9b640 1 --2- 172.21.15.150:0/2812652048 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f3570079760 0x7f357007bc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:46:32.491 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:32.490+0000 7f358dd9b640 1 --2- 172.21.15.150:0/2812652048 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f3570079760 0x7f357007bc70 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f3590077030 tx=0x7f3590070040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:46:32.492 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:32.491+0000 7f357effd640 1 -- 172.21.15.150:0/2812652048 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f3584083d90 con 0x7f3588054360 2024-09-17T05:46:32.804 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:32.802+0000 7f358f59e640 1 -- 172.21.15.150:0/2812652048 --> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] -- mgr_command(tid 0: {"prefix": "fs clone cancel", "vol_name": "cephfs", "clone_name": "ss1clone1", "target": ["mon-mgr", ""]}) -- 0x7f3588007770 con 0x7f3570079760 2024-09-17T05:46:32.937 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:32.935+0000 7f357effd640 1 -- 172.21.15.150:0/2812652048 <== mgr.4108 v2:172.21.15.176:6800/3631216395 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f3588007770 con 0x7f3570079760 2024-09-17T05:46:32.939 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:32.938+0000 7f358f59e640 1 -- 172.21.15.150:0/2812652048 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f3570079760 msgr2=0x7f357007bc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:46:32.940 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:32.938+0000 7f358f59e640 1 --2- 172.21.15.150:0/2812652048 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f3570079760 0x7f357007bc70 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f3590077030 tx=0x7f3590070040 comp rx=0 tx=0).stop 2024-09-17T05:46:32.940 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:32.938+0000 7f358f59e640 1 -- 172.21.15.150:0/2812652048 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3588054360 msgr2=0x7f35880df480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:46:32.940 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:32.938+0000 7f358f59e640 1 --2- 172.21.15.150:0/2812652048 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3588054360 0x7f35880df480 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7f3584000c00 tx=0x7f3584003b90 comp rx=0 tx=0).stop 2024-09-17T05:46:32.940 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:32.938+0000 7f358f59e640 1 -- 172.21.15.150:0/2812652048 shutdown_connections 2024-09-17T05:46:32.940 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:32.938+0000 7f358f59e640 1 --2- 172.21.15.150:0/2812652048 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f35880e2f40 0x7f358804cd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:32.940 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:32.938+0000 7f358f59e640 1 --2- 172.21.15.150:0/2812652048 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f3570079760 0x7f357007bc70 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:32.940 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:32.938+0000 7f358f59e640 1 --2- 172.21.15.150:0/2812652048 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3588056da0 0x7f35880d6a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:32.940 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:32.938+0000 7f358f59e640 1 --2- 172.21.15.150:0/2812652048 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3588054360 0x7f35880df480 unknown :-1 s=CLOSED pgs=698 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:32.940 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:32.938+0000 7f358f59e640 1 -- 172.21.15.150:0/2812652048 >> 172.21.15.150:0/2812652048 conn(0x7f358803a5f0 msgr2=0x7f35880d8740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:46:32.940 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:32.938+0000 7f358f59e640 1 -- 172.21.15.150:0/2812652048 shutdown_connections 2024-09-17T05:46:32.940 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:32.938+0000 7f358f59e640 1 -- 172.21.15.150:0/2812652048 wait complete. 2024-09-17T05:46:32.951 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume ls 2024-09-17T05:46:33.064 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:33.062+0000 7f1f80abd640 1 -- 172.21.15.150:0/1493968158 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1f7c15ce30 msgr2=0x7f1f7c15d240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:46:33.064 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:33.062+0000 7f1f80abd640 1 --2- 172.21.15.150:0/1493968158 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1f7c15ce30 0x7f1f7c15d240 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7f1f74005fd0 tx=0x7f1f7402a870 comp rx=0 tx=0).stop 2024-09-17T05:46:33.064 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:33.062+0000 7f1f80abd640 1 -- 172.21.15.150:0/1493968158 shutdown_connections 2024-09-17T05:46:33.064 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:33.062+0000 7f1f80abd640 1 --2- 172.21.15.150:0/1493968158 >> v2:172.21.15.176:3300/0 conn(0x7f1f7c070cc0 0x7f1f7c156e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:33.064 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:33.062+0000 7f1f80abd640 1 --2- 172.21.15.150:0/1493968158 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1f7c15ce30 0x7f1f7c15d240 unknown :-1 s=CLOSED pgs=700 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:33.064 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:33.062+0000 7f1f80abd640 1 -- 172.21.15.150:0/1493968158 >> 172.21.15.150:0/1493968158 conn(0x7f1f7c06d3d0 msgr2=0x7f1f7c0b1ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:46:33.065 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:33.062+0000 7f1f80abd640 1 -- 172.21.15.150:0/1493968158 shutdown_connections 2024-09-17T05:46:33.065 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:33.062+0000 7f1f80abd640 1 -- 172.21.15.150:0/1493968158 wait complete. 2024-09-17T05:46:33.065 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:33.064+0000 7f1f80abd640 1 Processor -- start 2024-09-17T05:46:33.065 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:33.064+0000 7f1f80abd640 1 -- start start 2024-09-17T05:46:33.068 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:33.065+0000 7f1f80abd640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1f7c0cfc80 0x7f1f7c0aedb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:46:33.068 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:33.065+0000 7f1f80abd640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1f7c15ce30 0x7f1f7c1557d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:46:33.068 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:33.065+0000 7f1f80abd640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1f7c1545f0 0x7f1f7c1603b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:46:33.068 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:33.065+0000 7f1f80abd640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f1f7c0cd050 con 0x7f1f7c15ce30 2024-09-17T05:46:33.068 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:33.065+0000 7f1f80abd640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f1f7c0cced0 con 0x7f1f7c0cfc80 2024-09-17T05:46:33.068 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:33.065+0000 7f1f80abd640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f1f7c0cd1d0 con 0x7f1f7c1545f0 2024-09-17T05:46:33.068 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:33.065+0000 7f1f79d9b640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1f7c15ce30 0x7f1f7c1557d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:46:33.069 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:33.065+0000 7f1f79d9b640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1f7c15ce30 0x7f1f7c1557d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:35158/0 (socket says 172.21.15.150:35158) 2024-09-17T05:46:33.069 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:33.065+0000 7f1f79d9b640 1 -- 172.21.15.150:0/3953685709 learned_addr learned my addr 172.21.15.150:0/3953685709 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:46:33.069 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:33.065+0000 7f1f7a59c640 1 --2- 172.21.15.150:0/3953685709 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1f7c0cfc80 0x7f1f7c0aedb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:46:33.069 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:33.066+0000 7f1f7ad9d640 1 --2- 172.21.15.150:0/3953685709 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1f7c1545f0 0x7f1f7c1603b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:46:33.069 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:33.066+0000 7f1f79d9b640 1 -- 172.21.15.150:0/3953685709 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1f7c1545f0 msgr2=0x7f1f7c1603b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:46:33.069 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:33.066+0000 7f1f79d9b640 1 --2- 172.21.15.150:0/3953685709 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1f7c1545f0 0x7f1f7c1603b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:33.069 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:33.066+0000 7f1f79d9b640 1 -- 172.21.15.150:0/3953685709 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1f7c0cfc80 msgr2=0x7f1f7c0aedb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:46:33.069 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:33.066+0000 7f1f79d9b640 1 --2- 172.21.15.150:0/3953685709 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1f7c0cfc80 0x7f1f7c0aedb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:33.069 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:33.066+0000 7f1f79d9b640 1 -- 172.21.15.150:0/3953685709 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1f7c0af2f0 con 0x7f1f7c15ce30 2024-09-17T05:46:33.069 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:33.066+0000 7f1f79d9b640 1 --2- 172.21.15.150:0/3953685709 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1f7c15ce30 0x7f1f7c1557d0 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7f1f7000d700 tx=0x7f1f7000dbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:46:33.069 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:33.066+0000 7f1f6affd640 1 -- 172.21.15.150:0/3953685709 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f70017070 con 0x7f1f7c15ce30 2024-09-17T05:46:33.069 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:33.066+0000 7f1f6affd640 1 -- 172.21.15.150:0/3953685709 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f1f70005330 con 0x7f1f7c15ce30 2024-09-17T05:46:33.069 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:33.066+0000 7f1f80abd640 1 -- 172.21.15.150:0/3953685709 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1f7c0add10 con 0x7f1f7c15ce30 2024-09-17T05:46:33.069 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:33.066+0000 7f1f6affd640 1 -- 172.21.15.150:0/3953685709 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f70009820 con 0x7f1f7c15ce30 2024-09-17T05:46:33.070 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:33.066+0000 7f1f80abd640 1 -- 172.21.15.150:0/3953685709 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1f7c0ae5b0 con 0x7f1f7c15ce30 2024-09-17T05:46:33.070 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:33.067+0000 7f1f80abd640 1 -- 172.21.15.150:0/3953685709 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1f7c0ada80 con 0x7f1f7c15ce30 2024-09-17T05:46:33.070 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:33.068+0000 7f1f6affd640 1 -- 172.21.15.150:0/3953685709 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 18) ==== 102512+0+0 (secure 0 0 0) 0x7f1f700099c0 con 0x7f1f7c15ce30 2024-09-17T05:46:33.070 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:33.068+0000 7f1f6affd640 1 --2- 172.21.15.150:0/3953685709 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f1f5c079790 0x7f1f5c07bca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:46:33.071 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:33.069+0000 7f1f6affd640 1 -- 172.21.15.150:0/3953685709 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(60..60 src has 1..60) ==== 5737+0+0 (secure 0 0 0) 0x7f1f70099910 con 0x7f1f7c15ce30 2024-09-17T05:46:33.071 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:33.069+0000 7f1f7a59c640 1 --2- 172.21.15.150:0/3953685709 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f1f5c079790 0x7f1f5c07bca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:46:33.071 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:33.069+0000 7f1f7a59c640 1 --2- 172.21.15.150:0/3953685709 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f1f5c079790 0x7f1f5c07bca0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f1f6c0046b0 tx=0x7f1f6c007eb0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:46:33.074 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:33.073+0000 7f1f6affd640 1 -- 172.21.15.150:0/3953685709 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f1f70062f50 con 0x7f1f7c15ce30 2024-09-17T05:46:33.275 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:33.273+0000 7f1f80abd640 1 -- 172.21.15.150:0/3953685709 --> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] -- mgr_command(tid 0: {"prefix": "fs volume ls", "target": ["mon-mgr", ""]}) -- 0x7f1f7c0cd6f0 con 0x7f1f5c079790 2024-09-17T05:46:33.276 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:33.276+0000 7f1f6affd640 1 -- 172.21.15.150:0/3953685709 <== mgr.4108 v2:172.21.15.176:6800/3631216395 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+41 (secure 0 0 0) 0x7f1f7c0cd6f0 con 0x7f1f5c079790 2024-09-17T05:46:33.277 INFO:teuthology.orchestra.run.smithi150.stdout:[ 2024-09-17T05:46:33.277 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-09-17T05:46:33.277 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "cephfs" 2024-09-17T05:46:33.277 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-09-17T05:46:33.277 INFO:teuthology.orchestra.run.smithi150.stdout:] 2024-09-17T05:46:33.279 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:33.277+0000 7f1f80abd640 1 -- 172.21.15.150:0/3953685709 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f1f5c079790 msgr2=0x7f1f5c07bca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:46:33.279 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:33.277+0000 7f1f80abd640 1 --2- 172.21.15.150:0/3953685709 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f1f5c079790 0x7f1f5c07bca0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f1f6c0046b0 tx=0x7f1f6c007eb0 comp rx=0 tx=0).stop 2024-09-17T05:46:33.279 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:33.277+0000 7f1f80abd640 1 -- 172.21.15.150:0/3953685709 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1f7c15ce30 msgr2=0x7f1f7c1557d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:46:33.279 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:33.277+0000 7f1f80abd640 1 --2- 172.21.15.150:0/3953685709 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1f7c15ce30 0x7f1f7c1557d0 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7f1f7000d700 tx=0x7f1f7000dbc0 comp rx=0 tx=0).stop 2024-09-17T05:46:33.280 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:33.277+0000 7f1f80abd640 1 -- 172.21.15.150:0/3953685709 shutdown_connections 2024-09-17T05:46:33.280 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:33.277+0000 7f1f80abd640 1 --2- 172.21.15.150:0/3953685709 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f1f5c079790 0x7f1f5c07bca0 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:33.280 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:33.277+0000 7f1f80abd640 1 --2- 172.21.15.150:0/3953685709 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1f7c1545f0 0x7f1f7c1603b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:33.280 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:33.277+0000 7f1f80abd640 1 --2- 172.21.15.150:0/3953685709 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1f7c15ce30 0x7f1f7c1557d0 unknown :-1 s=CLOSED pgs=701 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:33.280 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:33.277+0000 7f1f80abd640 1 --2- 172.21.15.150:0/3953685709 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1f7c0cfc80 0x7f1f7c0aedb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:33.280 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:33.277+0000 7f1f80abd640 1 -- 172.21.15.150:0/3953685709 >> 172.21.15.150:0/3953685709 conn(0x7f1f7c06d3d0 msgr2=0x7f1f7c15ed20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:46:33.280 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:33.277+0000 7f1f80abd640 1 -- 172.21.15.150:0/3953685709 shutdown_connections 2024-09-17T05:46:33.280 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:33.277+0000 7f1f80abd640 1 -- 172.21.15.150:0/3953685709 wait complete. 2024-09-17T05:46:33.290 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume ls cephfs --format json 2024-09-17T05:46:33.406 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:33.404+0000 7f4a14d13640 1 -- 172.21.15.150:0/260424826 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4a100ce800 msgr2=0x7f4a1009aa50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:46:33.406 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:33.404+0000 7f4a14d13640 1 --2- 172.21.15.150:0/260424826 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4a100ce800 0x7f4a1009aa50 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f4a08005fd0 tx=0x7f4a0802a540 comp rx=0 tx=0).stop 2024-09-17T05:46:33.407 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:33.404+0000 7f4a14d13640 1 -- 172.21.15.150:0/260424826 shutdown_connections 2024-09-17T05:46:33.407 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:33.404+0000 7f4a14d13640 1 --2- 172.21.15.150:0/260424826 >> v2:172.21.15.176:3300/0 conn(0x7f4a100b6450 0x7f4a100cd3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:33.407 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:33.404+0000 7f4a14d13640 1 --2- 172.21.15.150:0/260424826 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4a100ce800 0x7f4a1009aa50 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:33.407 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:33.404+0000 7f4a14d13640 1 -- 172.21.15.150:0/260424826 >> 172.21.15.150:0/260424826 conn(0x7f4a100d2550 msgr2=0x7f4a100d2960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:46:33.407 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:33.404+0000 7f4a14d13640 1 -- 172.21.15.150:0/260424826 shutdown_connections 2024-09-17T05:46:33.407 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:33.404+0000 7f4a14d13640 1 -- 172.21.15.150:0/260424826 wait complete. 2024-09-17T05:46:33.408 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:33.406+0000 7f4a14d13640 1 Processor -- start 2024-09-17T05:46:33.408 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:33.406+0000 7f4a14d13640 1 -- start start 2024-09-17T05:46:33.410 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:33.408+0000 7f4a14d13640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4a1009af90 0x7f4a100cb0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:46:33.410 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:33.408+0000 7f4a14d13640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4a100b6450 0x7f4a10155c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:46:33.410 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:33.408+0000 7f4a14d13640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4a100ce800 0x7f4a1015eb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:46:33.411 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:33.408+0000 7f4a14d13640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f4a100cd930 con 0x7f4a1009af90 2024-09-17T05:46:33.411 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:33.408+0000 7f4a14d13640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f4a100cee20 con 0x7f4a100b6450 2024-09-17T05:46:33.411 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:33.408+0000 7f4a14d13640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f4a100cdab0 con 0x7f4a100ce800 2024-09-17T05:46:33.411 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:33.408+0000 7f4a0e59c640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4a1009af90 0x7f4a100cb0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:46:33.411 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:33.408+0000 7f4a0e59c640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4a1009af90 0x7f4a100cb0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:35166/0 (socket says 172.21.15.150:35166) 2024-09-17T05:46:33.411 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:33.408+0000 7f4a0e59c640 1 -- 172.21.15.150:0/1721659429 learned_addr learned my addr 172.21.15.150:0/1721659429 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:46:33.411 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:33.408+0000 7f4a0dd9b640 1 --2- 172.21.15.150:0/1721659429 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4a100b6450 0x7f4a10155c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:46:33.411 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:33.408+0000 7f4a0ed9d640 1 --2- 172.21.15.150:0/1721659429 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4a100ce800 0x7f4a1015eb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:46:33.411 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:33.408+0000 7f4a0e59c640 1 -- 172.21.15.150:0/1721659429 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4a100ce800 msgr2=0x7f4a1015eb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:46:33.411 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:33.408+0000 7f4a0e59c640 1 --2- 172.21.15.150:0/1721659429 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4a100ce800 0x7f4a1015eb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:33.411 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:33.408+0000 7f4a0e59c640 1 -- 172.21.15.150:0/1721659429 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4a100b6450 msgr2=0x7f4a10155c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:46:33.411 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:33.408+0000 7f4a0e59c640 1 --2- 172.21.15.150:0/1721659429 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4a100b6450 0x7f4a10155c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:33.412 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:33.408+0000 7f4a0e59c640 1 -- 172.21.15.150:0/1721659429 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4a10160290 con 0x7f4a1009af90 2024-09-17T05:46:33.412 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:33.408+0000 7f4a0e59c640 1 --2- 172.21.15.150:0/1721659429 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4a1009af90 0x7f4a100cb0d0 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 crypto rx=0x7f4a08000c00 tx=0x7f4a080038a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:46:33.412 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:33.408+0000 7f4a06ffd640 1 -- 172.21.15.150:0/1721659429 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a0803e030 con 0x7f4a1009af90 2024-09-17T05:46:33.412 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:33.408+0000 7f4a06ffd640 1 -- 172.21.15.150:0/1721659429 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f4a08003ca0 con 0x7f4a1009af90 2024-09-17T05:46:33.412 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:33.408+0000 7f4a14d13640 1 -- 172.21.15.150:0/1721659429 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4a1015e630 con 0x7f4a1009af90 2024-09-17T05:46:33.412 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:33.408+0000 7f4a06ffd640 1 -- 172.21.15.150:0/1721659429 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a08035040 con 0x7f4a1009af90 2024-09-17T05:46:33.412 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:33.408+0000 7f4a14d13640 1 -- 172.21.15.150:0/1721659429 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4a1015ffb0 con 0x7f4a1009af90 2024-09-17T05:46:33.413 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:33.409+0000 7f4a14d13640 1 -- 172.21.15.150:0/1721659429 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4a1009aa50 con 0x7f4a1009af90 2024-09-17T05:46:33.413 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:33.410+0000 7f4a06ffd640 1 -- 172.21.15.150:0/1721659429 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 18) ==== 102512+0+0 (secure 0 0 0) 0x7f4a08041030 con 0x7f4a1009af90 2024-09-17T05:46:33.413 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:33.411+0000 7f4a06ffd640 1 --2- 172.21.15.150:0/1721659429 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f49f0079790 0x7f49f007bca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:46:33.413 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:33.411+0000 7f4a06ffd640 1 -- 172.21.15.150:0/1721659429 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(60..60 src has 1..60) ==== 5737+0+0 (secure 0 0 0) 0x7f4a080b9e80 con 0x7f4a1009af90 2024-09-17T05:46:33.413 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:33.411+0000 7f4a0dd9b640 1 --2- 172.21.15.150:0/1721659429 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f49f0079790 0x7f49f007bca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:46:33.413 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:33.411+0000 7f4a0dd9b640 1 --2- 172.21.15.150:0/1721659429 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f49f0079790 0x7f49f007bca0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f4a100b6dc0 tx=0x7f49f8009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:46:33.417 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:33.415+0000 7f4a06ffd640 1 -- 172.21.15.150:0/1721659429 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f4a08083550 con 0x7f4a1009af90 2024-09-17T05:46:33.617 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:33.616+0000 7f4a14d13640 1 -- 172.21.15.150:0/1721659429 --> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] -- mgr_command(tid 0: {"prefix": "fs subvolume ls", "vol_name": "cephfs", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f4a100c93e0 con 0x7f49f0079790 2024-09-17T05:46:33.622 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:33.621+0000 7f4a06ffd640 1 -- 172.21.15.150:0/1721659429 <== mgr.4108 v2:172.21.15.176:6800/3631216395 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+79 (secure 0 0 0) 0x7f4a100c93e0 con 0x7f49f0079790 2024-09-17T05:46:33.623 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-09-17T05:46:33.623 INFO:teuthology.orchestra.run.smithi150.stdout:[ 2024-09-17T05:46:33.623 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-09-17T05:46:33.623 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "sv1" 2024-09-17T05:46:33.623 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-17T05:46:33.623 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-09-17T05:46:33.623 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "ss1clone1" 2024-09-17T05:46:33.623 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-09-17T05:46:33.623 INFO:teuthology.orchestra.run.smithi150.stdout:] 2024-09-17T05:46:33.625 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:33.623+0000 7f4a14d13640 1 -- 172.21.15.150:0/1721659429 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f49f0079790 msgr2=0x7f49f007bca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:46:33.625 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:33.623+0000 7f4a14d13640 1 --2- 172.21.15.150:0/1721659429 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f49f0079790 0x7f49f007bca0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f4a100b6dc0 tx=0x7f49f8009040 comp rx=0 tx=0).stop 2024-09-17T05:46:33.625 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:33.623+0000 7f4a14d13640 1 -- 172.21.15.150:0/1721659429 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4a1009af90 msgr2=0x7f4a100cb0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:46:33.625 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:33.623+0000 7f4a14d13640 1 --2- 172.21.15.150:0/1721659429 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4a1009af90 0x7f4a100cb0d0 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 crypto rx=0x7f4a08000c00 tx=0x7f4a080038a0 comp rx=0 tx=0).stop 2024-09-17T05:46:33.625 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:33.623+0000 7f4a14d13640 1 -- 172.21.15.150:0/1721659429 shutdown_connections 2024-09-17T05:46:33.625 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:33.623+0000 7f4a14d13640 1 --2- 172.21.15.150:0/1721659429 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4a100b6450 0x7f4a10155c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:33.626 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:33.623+0000 7f4a14d13640 1 --2- 172.21.15.150:0/1721659429 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f49f0079790 0x7f49f007bca0 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:33.626 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:33.623+0000 7f4a14d13640 1 --2- 172.21.15.150:0/1721659429 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4a100ce800 0x7f4a1015eb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:33.626 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:33.623+0000 7f4a14d13640 1 --2- 172.21.15.150:0/1721659429 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4a1009af90 0x7f4a100cb0d0 unknown :-1 s=CLOSED pgs=702 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:33.626 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:33.623+0000 7f4a14d13640 1 -- 172.21.15.150:0/1721659429 >> 172.21.15.150:0/1721659429 conn(0x7f4a100d2550 msgr2=0x7f4a100cefd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:46:33.626 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:33.623+0000 7f4a14d13640 1 -- 172.21.15.150:0/1721659429 shutdown_connections 2024-09-17T05:46:33.626 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:33.623+0000 7f4a14d13640 1 -- 172.21.15.150:0/1721659429 wait complete. 2024-09-17T05:46:33.636 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume snapshot ls cephfs sv1 --format json 2024-09-17T05:46:33.754 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:33.752+0000 7f505b09b640 1 -- 172.21.15.150:0/1303571978 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f50540d0ee0 msgr2=0x7f50540d12f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:46:33.754 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:33.752+0000 7f505b09b640 1 --2- 172.21.15.150:0/1303571978 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f50540d0ee0 0x7f50540d12f0 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7f50540b3e60 tx=0x7f504c02a560 comp rx=0 tx=0).stop 2024-09-17T05:46:33.754 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:33.752+0000 7f505b09b640 1 -- 172.21.15.150:0/1303571978 shutdown_connections 2024-09-17T05:46:33.754 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:33.752+0000 7f505b09b640 1 --2- 172.21.15.150:0/1303571978 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f50540d0ee0 0x7f50540d12f0 unknown :-1 s=CLOSED pgs=703 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:33.754 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:33.752+0000 7f505b09b640 1 --2- 172.21.15.150:0/1303571978 >> v2:172.21.15.176:3300/0 conn(0x7f50540b5250 0x7f50540b5660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:33.754 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:33.752+0000 7f505b09b640 1 --2- 172.21.15.150:0/1303571978 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f50540d01b0 0x7f50540d05c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:33.754 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:33.752+0000 7f505b09b640 1 -- 172.21.15.150:0/1303571978 >> 172.21.15.150:0/1303571978 conn(0x7f50540cee80 msgr2=0x7f50540cf290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:46:33.754 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:33.752+0000 7f505b09b640 1 -- 172.21.15.150:0/1303571978 shutdown_connections 2024-09-17T05:46:33.755 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:33.752+0000 7f505b09b640 1 -- 172.21.15.150:0/1303571978 wait complete. 2024-09-17T05:46:33.755 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:33.754+0000 7f505b09b640 1 Processor -- start 2024-09-17T05:46:33.755 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:33.754+0000 7f505b09b640 1 -- start start 2024-09-17T05:46:33.758 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:33.755+0000 7f505b09b640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f50540b5250 0x7f505406f990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:46:33.758 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:33.755+0000 7f505b09b640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f50540d01b0 0x7f505409f800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:46:33.758 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:33.755+0000 7f505b09b640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f50540d0ee0 0x7f5054071b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:46:33.758 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:33.755+0000 7f505b09b640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f505409bc70 con 0x7f50540b5250 2024-09-17T05:46:33.758 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:33.755+0000 7f505b09b640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f505409baf0 con 0x7f50540d0ee0 2024-09-17T05:46:33.758 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:33.755+0000 7f505b09b640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f5054160a30 con 0x7f50540d01b0 2024-09-17T05:46:33.758 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:33.755+0000 7f5058e37640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f50540b5250 0x7f505406f990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:46:33.758 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:33.755+0000 7f5058e37640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f50540b5250 0x7f505406f990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:35186/0 (socket says 172.21.15.150:35186) 2024-09-17T05:46:33.758 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:33.755+0000 7f5058e37640 1 -- 172.21.15.150:0/374286655 learned_addr learned my addr 172.21.15.150:0/374286655 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:46:33.758 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:33.755+0000 7f5053fff640 1 --2- 172.21.15.150:0/374286655 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f50540d01b0 0x7f505409f800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:46:33.759 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:33.755+0000 7f5059638640 1 --2- 172.21.15.150:0/374286655 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f50540d0ee0 0x7f5054071b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:46:33.759 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:33.755+0000 7f5058e37640 1 -- 172.21.15.150:0/374286655 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f50540d01b0 msgr2=0x7f505409f800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:46:33.759 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:33.756+0000 7f5058e37640 1 --2- 172.21.15.150:0/374286655 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f50540d01b0 0x7f505409f800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:33.759 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:33.756+0000 7f5058e37640 1 -- 172.21.15.150:0/374286655 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f50540d0ee0 msgr2=0x7f5054071b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:46:33.759 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:33.756+0000 7f5058e37640 1 --2- 172.21.15.150:0/374286655 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f50540d0ee0 0x7f5054071b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:33.759 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:33.756+0000 7f5058e37640 1 -- 172.21.15.150:0/374286655 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f50541f5cb0 con 0x7f50540b5250 2024-09-17T05:46:33.759 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:33.756+0000 7f5058e37640 1 --2- 172.21.15.150:0/374286655 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f50540b5250 0x7f505406f990 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7f504400b3f0 tx=0x7f504400b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:46:33.759 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:33.756+0000 7f50517fa640 1 -- 172.21.15.150:0/374286655 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5044015030 con 0x7f50540b5250 2024-09-17T05:46:33.759 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:33.756+0000 7f50517fa640 1 -- 172.21.15.150:0/374286655 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f5044005970 con 0x7f50540b5250 2024-09-17T05:46:33.759 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:33.756+0000 7f50517fa640 1 -- 172.21.15.150:0/374286655 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5044005dc0 con 0x7f50540b5250 2024-09-17T05:46:33.759 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:33.756+0000 7f505b09b640 1 -- 172.21.15.150:0/374286655 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f50541f5f90 con 0x7f50540b5250 2024-09-17T05:46:33.759 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:33.756+0000 7f505b09b640 1 -- 172.21.15.150:0/374286655 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f50541f6550 con 0x7f50540b5250 2024-09-17T05:46:33.760 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:33.757+0000 7f505b09b640 1 -- 172.21.15.150:0/374286655 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f50540d05c0 con 0x7f50540b5250 2024-09-17T05:46:33.760 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:33.758+0000 7f50517fa640 1 -- 172.21.15.150:0/374286655 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 18) ==== 102512+0+0 (secure 0 0 0) 0x7f5044018070 con 0x7f50540b5250 2024-09-17T05:46:33.760 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:33.758+0000 7f50517fa640 1 --2- 172.21.15.150:0/374286655 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f5040079760 0x7f504007bc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:46:33.760 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:33.758+0000 7f50517fa640 1 -- 172.21.15.150:0/374286655 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(60..60 src has 1..60) ==== 5737+0+0 (secure 0 0 0) 0x7f50440993d0 con 0x7f50540b5250 2024-09-17T05:46:33.761 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:33.758+0000 7f5053fff640 1 --2- 172.21.15.150:0/374286655 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f5040079760 0x7f504007bc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:46:33.761 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:33.759+0000 7f5053fff640 1 --2- 172.21.15.150:0/374286655 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f5040079760 0x7f504007bc70 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f505409c210 tx=0x7f504800a550 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:46:33.764 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:33.763+0000 7f50517fa640 1 -- 172.21.15.150:0/374286655 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f5044062990 con 0x7f50540b5250 2024-09-17T05:46:33.971 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:33.969+0000 7f505b09b640 1 -- 172.21.15.150:0/374286655 --> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] -- mgr_command(tid 0: {"prefix": "fs subvolume snapshot ls", "vol_name": "cephfs", "sub_name": "sv1", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f50540ce3d0 con 0x7f5040079760 2024-09-17T05:46:33.986 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:33.985+0000 7f50517fa640 1 -- 172.21.15.150:0/374286655 <== mgr.4108 v2:172.21.15.176:6800/3631216395 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+38 (secure 0 0 0) 0x7f50540ce3d0 con 0x7f5040079760 2024-09-17T05:46:33.986 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-09-17T05:46:33.987 INFO:teuthology.orchestra.run.smithi150.stdout:[ 2024-09-17T05:46:33.987 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-09-17T05:46:33.987 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "ss1" 2024-09-17T05:46:33.987 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-09-17T05:46:33.987 INFO:teuthology.orchestra.run.smithi150.stdout:] 2024-09-17T05:46:33.989 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:33.987+0000 7f505b09b640 1 -- 172.21.15.150:0/374286655 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f5040079760 msgr2=0x7f504007bc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:46:33.989 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:33.987+0000 7f505b09b640 1 --2- 172.21.15.150:0/374286655 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f5040079760 0x7f504007bc70 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f505409c210 tx=0x7f504800a550 comp rx=0 tx=0).stop 2024-09-17T05:46:33.989 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:33.987+0000 7f505b09b640 1 -- 172.21.15.150:0/374286655 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f50540b5250 msgr2=0x7f505406f990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:46:33.989 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:33.987+0000 7f505b09b640 1 --2- 172.21.15.150:0/374286655 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f50540b5250 0x7f505406f990 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7f504400b3f0 tx=0x7f504400b8b0 comp rx=0 tx=0).stop 2024-09-17T05:46:33.989 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:33.987+0000 7f505b09b640 1 -- 172.21.15.150:0/374286655 shutdown_connections 2024-09-17T05:46:33.989 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:33.987+0000 7f505b09b640 1 --2- 172.21.15.150:0/374286655 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f50540d0ee0 0x7f5054071b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:33.990 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:33.987+0000 7f505b09b640 1 --2- 172.21.15.150:0/374286655 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f5040079760 0x7f504007bc70 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:33.990 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:33.987+0000 7f505b09b640 1 --2- 172.21.15.150:0/374286655 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f50540d01b0 0x7f505409f800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:33.990 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:33.987+0000 7f505b09b640 1 --2- 172.21.15.150:0/374286655 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f50540b5250 0x7f505406f990 unknown :-1 s=CLOSED pgs=704 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:33.990 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:33.987+0000 7f505b09b640 1 -- 172.21.15.150:0/374286655 >> 172.21.15.150:0/374286655 conn(0x7f50540cee80 msgr2=0x7f505415ccf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:46:33.990 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:33.987+0000 7f505b09b640 1 -- 172.21.15.150:0/374286655 shutdown_connections 2024-09-17T05:46:33.990 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:33.987+0000 7f505b09b640 1 -- 172.21.15.150:0/374286655 wait complete. 2024-09-17T05:46:34.000 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume snapshot rm --force --format json cephfs sv1 ss1 2024-09-17T05:46:34.121 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:34.119+0000 7f478aaec640 1 -- 172.21.15.150:0/1258750204 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f47840b7960 msgr2=0x7f47840af1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:46:34.121 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:34.119+0000 7f478aaec640 1 --2- 172.21.15.150:0/1258750204 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f47840b7960 0x7f47840af1f0 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 crypto rx=0x7f47840cfd70 tx=0x7f477402a440 comp rx=0 tx=0).stop 2024-09-17T05:46:34.121 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:34.119+0000 7f478aaec640 1 -- 172.21.15.150:0/1258750204 shutdown_connections 2024-09-17T05:46:34.121 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:34.119+0000 7f478aaec640 1 --2- 172.21.15.150:0/1258750204 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f47840af730 0x7f47840d0fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:34.121 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:34.119+0000 7f478aaec640 1 --2- 172.21.15.150:0/1258750204 >> v2:172.21.15.176:3300/0 conn(0x7f47840b7d70 0x7f47840d0a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:34.121 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:34.119+0000 7f478aaec640 1 --2- 172.21.15.150:0/1258750204 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f47840b7960 0x7f47840af1f0 unknown :-1 s=CLOSED pgs=705 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:34.121 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:34.119+0000 7f478aaec640 1 -- 172.21.15.150:0/1258750204 >> 172.21.15.150:0/1258750204 conn(0x7f47840cef20 msgr2=0x7f47840cf330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:46:34.121 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:34.119+0000 7f478aaec640 1 -- 172.21.15.150:0/1258750204 shutdown_connections 2024-09-17T05:46:34.122 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:34.119+0000 7f478aaec640 1 -- 172.21.15.150:0/1258750204 wait complete. 2024-09-17T05:46:34.122 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:34.120+0000 7f478aaec640 1 Processor -- start 2024-09-17T05:46:34.122 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:34.120+0000 7f478aaec640 1 -- start start 2024-09-17T05:46:34.129 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:34.122+0000 7f478aaec640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f47840af730 0x7f4784145a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:46:34.129 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:34.122+0000 7f478aaec640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f47840b7960 0x7f478415d640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:46:34.129 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:34.122+0000 7f478aaec640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f47840b7d70 0x7f478415db80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:46:34.129 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:34.122+0000 7f478aaec640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f47840ceb90 con 0x7f47840b7d70 2024-09-17T05:46:34.130 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:34.122+0000 7f478aaec640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f478409bd30 con 0x7f47840af730 2024-09-17T05:46:34.130 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:34.122+0000 7f478aaec640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f47840ced10 con 0x7f47840b7960 2024-09-17T05:46:34.130 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:34.122+0000 7f4789089640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f47840b7d70 0x7f478415db80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:46:34.130 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:34.122+0000 7f4789089640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f47840b7d70 0x7f478415db80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:35204/0 (socket says 172.21.15.150:35204) 2024-09-17T05:46:34.130 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:34.122+0000 7f4789089640 1 -- 172.21.15.150:0/1456975726 learned_addr learned my addr 172.21.15.150:0/1456975726 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:46:34.130 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:34.122+0000 7f4788888640 1 --2- 172.21.15.150:0/1456975726 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f47840af730 0x7f4784145a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:46:34.130 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:34.122+0000 7f4783fff640 1 --2- 172.21.15.150:0/1456975726 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f47840b7960 0x7f478415d640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:46:34.130 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:34.122+0000 7f4789089640 1 -- 172.21.15.150:0/1456975726 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f47840b7960 msgr2=0x7f478415d640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:46:34.130 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:34.122+0000 7f4789089640 1 --2- 172.21.15.150:0/1456975726 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f47840b7960 0x7f478415d640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:34.130 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:34.122+0000 7f4789089640 1 -- 172.21.15.150:0/1456975726 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f47840af730 msgr2=0x7f4784145a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:46:34.130 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:34.122+0000 7f4789089640 1 --2- 172.21.15.150:0/1456975726 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f47840af730 0x7f4784145a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:34.130 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:34.122+0000 7f4789089640 1 -- 172.21.15.150:0/1456975726 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f47841599b0 con 0x7f47840b7d70 2024-09-17T05:46:34.130 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:34.123+0000 7f4789089640 1 --2- 172.21.15.150:0/1456975726 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f47840b7d70 0x7f478415db80 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7f477c00ba10 tx=0x7f477c00bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:46:34.131 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:34.123+0000 7f47817fa640 1 -- 172.21.15.150:0/1456975726 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f477c019070 con 0x7f47840b7d70 2024-09-17T05:46:34.131 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:34.123+0000 7f47817fa640 1 -- 172.21.15.150:0/1456975726 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f477c00cc50 con 0x7f47840b7d70 2024-09-17T05:46:34.131 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:34.123+0000 7f478aaec640 1 -- 172.21.15.150:0/1456975726 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4784158910 con 0x7f47840b7d70 2024-09-17T05:46:34.131 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:34.123+0000 7f47817fa640 1 -- 172.21.15.150:0/1456975726 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f477c0146a0 con 0x7f47840b7d70 2024-09-17T05:46:34.131 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:34.123+0000 7f478aaec640 1 -- 172.21.15.150:0/1456975726 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4784158ed0 con 0x7f47840b7d70 2024-09-17T05:46:34.131 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:34.124+0000 7f478aaec640 1 -- 172.21.15.150:0/1456975726 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f47840af1f0 con 0x7f47840b7d70 2024-09-17T05:46:34.132 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:34.124+0000 7f47817fa640 1 -- 172.21.15.150:0/1456975726 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 18) ==== 102512+0+0 (secure 0 0 0) 0x7f477c01c070 con 0x7f47840b7d70 2024-09-17T05:46:34.132 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:34.125+0000 7f47817fa640 1 --2- 172.21.15.150:0/1456975726 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f4770079790 0x7f477007bca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:46:34.132 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:34.125+0000 7f47817fa640 1 -- 172.21.15.150:0/1456975726 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(60..60 src has 1..60) ==== 5737+0+0 (secure 0 0 0) 0x7f477c0994e0 con 0x7f47840b7d70 2024-09-17T05:46:34.132 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:34.125+0000 7f4788888640 1 --2- 172.21.15.150:0/1456975726 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f4770079790 0x7f477007bca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:46:34.132 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:34.126+0000 7f4788888640 1 --2- 172.21.15.150:0/1456975726 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f4770079790 0x7f477007bca0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f4774034000 tx=0x7f4774004730 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:46:34.132 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:34.130+0000 7f47817fa640 1 -- 172.21.15.150:0/1456975726 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f477c062b20 con 0x7f47840b7d70 2024-09-17T05:46:34.336 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:34.334+0000 7f478aaec640 1 -- 172.21.15.150:0/1456975726 --> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] -- mgr_command(tid 0: {"prefix": "fs subvolume snapshot rm", "force": true, "vol_name": "cephfs", "sub_name": "sv1", "snap_name": "ss1", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f47840760f0 con 0x7f4770079790 2024-09-17T05:46:34.362 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:34.361+0000 7f47817fa640 1 -- 172.21.15.150:0/1456975726 <== mgr.4108 v2:172.21.15.176:6800/3631216395 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f47840760f0 con 0x7f4770079790 2024-09-17T05:46:34.362 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-09-17T05:46:34.365 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:34.363+0000 7f478aaec640 1 -- 172.21.15.150:0/1456975726 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f4770079790 msgr2=0x7f477007bca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:46:34.365 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:34.363+0000 7f478aaec640 1 --2- 172.21.15.150:0/1456975726 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f4770079790 0x7f477007bca0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f4774034000 tx=0x7f4774004730 comp rx=0 tx=0).stop 2024-09-17T05:46:34.366 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:34.363+0000 7f478aaec640 1 -- 172.21.15.150:0/1456975726 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f47840b7d70 msgr2=0x7f478415db80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:46:34.366 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:34.363+0000 7f478aaec640 1 --2- 172.21.15.150:0/1456975726 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f47840b7d70 0x7f478415db80 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7f477c00ba10 tx=0x7f477c00bed0 comp rx=0 tx=0).stop 2024-09-17T05:46:34.366 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:34.363+0000 7f478aaec640 1 -- 172.21.15.150:0/1456975726 shutdown_connections 2024-09-17T05:46:34.366 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:34.363+0000 7f478aaec640 1 --2- 172.21.15.150:0/1456975726 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f4770079790 0x7f477007bca0 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:34.366 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:34.363+0000 7f478aaec640 1 --2- 172.21.15.150:0/1456975726 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f47840b7d70 0x7f478415db80 unknown :-1 s=CLOSED pgs=706 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:34.366 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:34.363+0000 7f478aaec640 1 --2- 172.21.15.150:0/1456975726 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f47840b7960 0x7f478415d640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:34.366 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:34.363+0000 7f478aaec640 1 --2- 172.21.15.150:0/1456975726 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f47840af730 0x7f4784145a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:34.366 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:34.363+0000 7f478aaec640 1 -- 172.21.15.150:0/1456975726 >> 172.21.15.150:0/1456975726 conn(0x7f47840cef20 msgr2=0x7f47840b2a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:46:34.366 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:34.363+0000 7f478aaec640 1 -- 172.21.15.150:0/1456975726 shutdown_connections 2024-09-17T05:46:34.366 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:34.363+0000 7f478aaec640 1 -- 172.21.15.150:0/1456975726 wait complete. 2024-09-17T05:46:34.377 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume rm cephfs sv1 2024-09-17T05:46:34.495 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:34.492+0000 7fd846684640 1 -- 172.21.15.150:0/3744319789 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd828004020 msgr2=0x7fd828004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:46:34.495 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:34.492+0000 7fd846684640 1 --2- 172.21.15.150:0/3744319789 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd828004020 0x7fd828004800 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7fd8400d35a0 tx=0x7fd828005830 comp rx=0 tx=0).stop 2024-09-17T05:46:34.495 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:34.492+0000 7fd844c21640 1 -- 172.21.15.150:0/3744319789 reap_dead start 2024-09-17T05:46:34.495 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:34.492+0000 7fd846684640 1 -- 172.21.15.150:0/3744319789 shutdown_connections 2024-09-17T05:46:34.495 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:34.492+0000 7fd846684640 1 -- 172.21.15.150:0/3744319789 >> 172.21.15.150:0/3744319789 conn(0x7fd8400cef20 msgr2=0x7fd8400cf330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:46:34.496 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:34.492+0000 7fd846684640 1 -- 172.21.15.150:0/3744319789 shutdown_connections 2024-09-17T05:46:34.496 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:34.492+0000 7fd846684640 1 -- 172.21.15.150:0/3744319789 wait complete. 2024-09-17T05:46:34.497 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:34.494+0000 7fd846684640 1 Processor -- start 2024-09-17T05:46:34.497 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:34.494+0000 7fd846684640 1 -- start start 2024-09-17T05:46:34.502 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:34.496+0000 7fd846684640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd828004020 0x7fd84014bea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:46:34.502 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:34.496+0000 7fd846684640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd8400cc150 0x7fd840155440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:46:34.502 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:34.496+0000 7fd846684640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd8400cc560 0x7fd840155980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:46:34.502 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:34.496+0000 7fd846684640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7fd8400ced10 con 0x7fd828004020 2024-09-17T05:46:34.503 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:34.496+0000 7fd846684640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fd8400ceb90 con 0x7fd8400cc150 2024-09-17T05:46:34.503 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:34.496+0000 7fd846684640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fd8400af730 con 0x7fd8400cc560 2024-09-17T05:46:34.503 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:34.496+0000 7fd83ffff640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd828004020 0x7fd84014bea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:46:34.503 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:34.496+0000 7fd83ffff640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd828004020 0x7fd84014bea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:35212/0 (socket says 172.21.15.150:35212) 2024-09-17T05:46:34.503 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:34.496+0000 7fd83ffff640 1 -- 172.21.15.150:0/1076576439 learned_addr learned my addr 172.21.15.150:0/1076576439 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:46:34.503 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:34.496+0000 7fd83f7fe640 1 --2- 172.21.15.150:0/1076576439 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd8400cc150 0x7fd840155440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:46:34.504 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:34.496+0000 7fd844c21640 1 --2- 172.21.15.150:0/1076576439 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd8400cc560 0x7fd840155980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:46:34.504 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:34.496+0000 7fd83ffff640 1 -- 172.21.15.150:0/1076576439 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd8400cc560 msgr2=0x7fd840155980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:46:34.504 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:34.496+0000 7fd83ffff640 1 --2- 172.21.15.150:0/1076576439 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd8400cc560 0x7fd840155980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:34.504 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:34.496+0000 7fd83ffff640 1 -- 172.21.15.150:0/1076576439 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd8400cc150 msgr2=0x7fd840155440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:46:34.504 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:34.496+0000 7fd83ffff640 1 --2- 172.21.15.150:0/1076576439 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd8400cc150 0x7fd840155440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:34.504 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:34.496+0000 7fd83ffff640 1 -- 172.21.15.150:0/1076576439 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd840157850 con 0x7fd828004020 2024-09-17T05:46:34.505 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:34.496+0000 7fd83f7fe640 1 --2- 172.21.15.150:0/1076576439 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd8400cc150 0x7fd840155440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:46:34.505 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:34.496+0000 7fd844c21640 1 --2- 172.21.15.150:0/1076576439 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd8400cc560 0x7fd840155980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:46:34.505 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:34.496+0000 7fd83ffff640 1 --2- 172.21.15.150:0/1076576439 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd828004020 0x7fd84014bea0 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7fd830011a50 tx=0x7fd830011f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:46:34.505 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:34.496+0000 7fd83cff9640 1 -- 172.21.15.150:0/1076576439 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd83000fd90 con 0x7fd828004020 2024-09-17T05:46:34.505 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:34.496+0000 7fd83cff9640 1 -- 172.21.15.150:0/1076576439 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd830016070 con 0x7fd828004020 2024-09-17T05:46:34.506 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:34.496+0000 7fd83cff9640 1 -- 172.21.15.150:0/1076576439 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd830005290 con 0x7fd828004020 2024-09-17T05:46:34.506 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:34.496+0000 7fd846684640 1 -- 172.21.15.150:0/1076576439 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd840157b30 con 0x7fd828004020 2024-09-17T05:46:34.506 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:34.496+0000 7fd846684640 1 -- 172.21.15.150:0/1076576439 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd8401580f0 con 0x7fd828004020 2024-09-17T05:46:34.506 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:34.498+0000 7fd846684640 1 -- 172.21.15.150:0/1076576439 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd8400af1f0 con 0x7fd828004020 2024-09-17T05:46:34.506 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:34.498+0000 7fd83cff9640 1 -- 172.21.15.150:0/1076576439 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 18) ==== 102512+0+0 (secure 0 0 0) 0x7fd830018030 con 0x7fd828004020 2024-09-17T05:46:34.506 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:34.499+0000 7fd83cff9640 1 --2- 172.21.15.150:0/1076576439 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fd82c079790 0x7fd82c07bca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:46:34.507 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:34.499+0000 7fd83cff9640 1 -- 172.21.15.150:0/1076576439 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(60..60 src has 1..60) ==== 5737+0+0 (secure 0 0 0) 0x7fd83009a2b0 con 0x7fd828004020 2024-09-17T05:46:34.507 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:34.499+0000 7fd83f7fe640 1 --2- 172.21.15.150:0/1076576439 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fd82c079790 0x7fd82c07bca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:46:34.507 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:34.500+0000 7fd83f7fe640 1 --2- 172.21.15.150:0/1076576439 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fd82c079790 0x7fd82c07bca0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7fd834033000 tx=0x7fd83402d000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:46:34.508 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:34.503+0000 7fd83cff9640 1 -- 172.21.15.150:0/1076576439 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fd830063f40 con 0x7fd828004020 2024-09-17T05:46:34.708 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:34.706+0000 7fd846684640 1 -- 172.21.15.150:0/1076576439 --> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] -- mgr_command(tid 0: {"prefix": "fs subvolume rm", "vol_name": "cephfs", "sub_name": "sv1", "target": ["mon-mgr", ""]}) -- 0x7fd8400b29a0 con 0x7fd82c079790 2024-09-17T05:46:34.731 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:34.729+0000 7fd83cff9640 1 -- 172.21.15.150:0/1076576439 <== mgr.4108 v2:172.21.15.176:6800/3631216395 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7fd8400b29a0 con 0x7fd82c079790 2024-09-17T05:46:34.733 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:34.731+0000 7fd846684640 1 -- 172.21.15.150:0/1076576439 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fd82c079790 msgr2=0x7fd82c07bca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:46:34.733 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:34.731+0000 7fd846684640 1 --2- 172.21.15.150:0/1076576439 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fd82c079790 0x7fd82c07bca0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7fd834033000 tx=0x7fd83402d000 comp rx=0 tx=0).stop 2024-09-17T05:46:34.733 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:34.731+0000 7fd846684640 1 -- 172.21.15.150:0/1076576439 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd828004020 msgr2=0x7fd84014bea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:46:34.734 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:34.731+0000 7fd846684640 1 --2- 172.21.15.150:0/1076576439 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd828004020 0x7fd84014bea0 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7fd830011a50 tx=0x7fd830011f10 comp rx=0 tx=0).stop 2024-09-17T05:46:34.734 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:34.732+0000 7fd846684640 1 -- 172.21.15.150:0/1076576439 shutdown_connections 2024-09-17T05:46:34.734 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:34.732+0000 7fd846684640 1 --2- 172.21.15.150:0/1076576439 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd8400cc150 0x7fd840155440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:34.734 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:34.732+0000 7fd846684640 1 --2- 172.21.15.150:0/1076576439 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fd82c079790 0x7fd82c07bca0 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:34.734 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:34.732+0000 7fd846684640 1 --2- 172.21.15.150:0/1076576439 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd8400cc560 0x7fd840155980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:34.734 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:34.732+0000 7fd846684640 1 --2- 172.21.15.150:0/1076576439 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd828004020 0x7fd84014bea0 unknown :-1 s=CLOSED pgs=709 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:34.734 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:34.732+0000 7fd846684640 1 -- 172.21.15.150:0/1076576439 >> 172.21.15.150:0/1076576439 conn(0x7fd8400cef20 msgr2=0x7fd8400b08a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:46:34.734 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:34.732+0000 7fd846684640 1 -- 172.21.15.150:0/1076576439 shutdown_connections 2024-09-17T05:46:34.735 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:34.732+0000 7fd846684640 1 -- 172.21.15.150:0/1076576439 wait complete. 2024-09-17T05:46:34.743 INFO:tasks.ceph.mgr.x.smithi176.stderr:2024-09-17T05:46:34.742+0000 7f33d9f1f640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-17T05:46:34.743 INFO:tasks.ceph.mgr.x.smithi176.stderr:2024-09-17T05:46:34.742+0000 7f33d9f1f640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-17T05:46:34.743 INFO:tasks.ceph.mgr.x.smithi176.stderr:2024-09-17T05:46:34.742+0000 7f33d9f1f640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-17T05:46:34.743 INFO:tasks.ceph.mgr.x.smithi176.stderr:2024-09-17T05:46:34.742+0000 7f33d9f1f640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-17T05:46:34.744 INFO:tasks.ceph.mgr.x.smithi176.stderr:2024-09-17T05:46:34.742+0000 7f33d9f1f640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-17T05:46:34.747 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume rm --force cephfs ss1clone1 2024-09-17T05:46:34.867 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:34.865+0000 7f864912b640 1 -- 172.21.15.150:0/1962099341 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8630005250 msgr2=0x7f863000b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:46:34.867 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:34.865+0000 7f864912b640 1 --2- 172.21.15.150:0/1962099341 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8630005250 0x7f863000b9c0 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x7f863c001d90 tx=0x7f8630005830 comp rx=0 tx=0).stop 2024-09-17T05:46:34.867 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:34.865+0000 7f864912b640 1 -- 172.21.15.150:0/1962099341 shutdown_connections 2024-09-17T05:46:34.867 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:34.865+0000 7f864912b640 1 --2- 172.21.15.150:0/1962099341 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8630005250 0x7f863000b9c0 unknown :-1 s=CLOSED pgs=711 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:34.867 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:34.865+0000 7f864912b640 1 -- 172.21.15.150:0/1962099341 >> 172.21.15.150:0/1962099341 conn(0x7f86440cef00 msgr2=0x7f86440cf310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:46:34.867 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:34.865+0000 7f864912b640 1 -- 172.21.15.150:0/1962099341 shutdown_connections 2024-09-17T05:46:34.867 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:34.865+0000 7f864912b640 1 -- 172.21.15.150:0/1962099341 wait complete. 2024-09-17T05:46:34.869 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:34.867+0000 7f864912b640 1 Processor -- start 2024-09-17T05:46:34.869 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:34.867+0000 7f864912b640 1 -- start start 2024-09-17T05:46:34.871 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:34.868+0000 7f864912b640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8630005250 0x7f86440afc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:46:34.871 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:34.868+0000 7f864912b640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f86440b01b0 0x7f86441f45a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:46:34.871 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:34.868+0000 7f864912b640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f86441e6870 0x7f86441f4ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:46:34.872 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:34.868+0000 7f864912b640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f864409bde0 con 0x7f86441e6870 2024-09-17T05:46:34.872 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:34.868+0000 7f864912b640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f864409bc60 con 0x7f86440b01b0 2024-09-17T05:46:34.872 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:34.868+0000 7f864912b640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f86440d0230 con 0x7f8630005250 2024-09-17T05:46:34.872 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:34.868+0000 7f864359e640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f86441e6870 0x7f86441f4ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:46:34.872 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:34.869+0000 7f864359e640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f86441e6870 0x7f86441f4ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:35226/0 (socket says 172.21.15.150:35226) 2024-09-17T05:46:34.872 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:34.869+0000 7f864359e640 1 -- 172.21.15.150:0/3095166502 learned_addr learned my addr 172.21.15.150:0/3095166502 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:46:34.872 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:34.869+0000 7f863bfff640 1 --2- 172.21.15.150:0/3095166502 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f86440b01b0 0x7f86441f45a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:46:34.872 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:34.869+0000 7f8642d9d640 1 --2- 172.21.15.150:0/3095166502 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8630005250 0x7f86440afc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:46:34.872 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:34.869+0000 7f864359e640 1 -- 172.21.15.150:0/3095166502 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8630005250 msgr2=0x7f86440afc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:46:34.872 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:34.869+0000 7f864359e640 1 --2- 172.21.15.150:0/3095166502 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8630005250 0x7f86440afc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:34.872 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:34.869+0000 7f864359e640 1 -- 172.21.15.150:0/3095166502 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f86440b01b0 msgr2=0x7f86441f45a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:46:34.873 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:34.869+0000 7f864359e640 1 --2- 172.21.15.150:0/3095166502 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f86440b01b0 0x7f86441f45a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:34.873 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:34.869+0000 7f864359e640 1 -- 172.21.15.150:0/3095166502 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f86441f37c0 con 0x7f86441e6870 2024-09-17T05:46:34.873 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:34.869+0000 7f864359e640 1 --2- 172.21.15.150:0/3095166502 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f86441e6870 0x7f86441f4ae0 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x7f863c001d90 tx=0x7f863c006d00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:46:34.873 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:34.869+0000 7f863b7fe640 1 -- 172.21.15.150:0/3095166502 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f863c003d80 con 0x7f86441e6870 2024-09-17T05:46:34.873 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:34.869+0000 7f863b7fe640 1 -- 172.21.15.150:0/3095166502 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f863c005ba0 con 0x7f86441e6870 2024-09-17T05:46:34.873 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:34.869+0000 7f864912b640 1 -- 172.21.15.150:0/3095166502 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f86441f3aa0 con 0x7f86441e6870 2024-09-17T05:46:34.873 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:34.869+0000 7f863b7fe640 1 -- 172.21.15.150:0/3095166502 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f863c005ff0 con 0x7f86441e6870 2024-09-17T05:46:34.873 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:34.869+0000 7f864912b640 1 -- 172.21.15.150:0/3095166502 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f86440b09f0 con 0x7f86441e6870 2024-09-17T05:46:34.874 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:34.871+0000 7f864912b640 1 -- 172.21.15.150:0/3095166502 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f86440b10a0 con 0x7f86441e6870 2024-09-17T05:46:34.874 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:34.871+0000 7f863b7fe640 1 -- 172.21.15.150:0/3095166502 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 18) ==== 102512+0+0 (secure 0 0 0) 0x7f863c005030 con 0x7f86441e6870 2024-09-17T05:46:34.874 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:34.872+0000 7f863b7fe640 1 --2- 172.21.15.150:0/3095166502 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f8624079760 0x7f862407bc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:46:34.874 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:34.872+0000 7f863b7fe640 1 -- 172.21.15.150:0/3095166502 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(60..60 src has 1..60) ==== 5737+0+0 (secure 0 0 0) 0x7f863c0b97a0 con 0x7f86441e6870 2024-09-17T05:46:34.874 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:34.872+0000 7f8642d9d640 1 --2- 172.21.15.150:0/3095166502 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f8624079760 0x7f862407bc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:46:34.874 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:34.872+0000 7f8642d9d640 1 --2- 172.21.15.150:0/3095166502 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f8624079760 0x7f862407bc70 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f86340058e0 tx=0x7f8634005f30 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:46:34.880 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:34.878+0000 7f863b7fe640 1 -- 172.21.15.150:0/3095166502 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f863c043060 con 0x7f86441e6870 2024-09-17T05:46:35.101 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:35.100+0000 7f864912b640 1 -- 172.21.15.150:0/3095166502 --> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] -- mgr_command(tid 0: {"prefix": "fs subvolume rm", "force": true, "vol_name": "cephfs", "sub_name": "ss1clone1", "target": ["mon-mgr", ""]}) -- 0x7f86440cc510 con 0x7f8624079760 2024-09-17T05:46:35.383 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:35.381+0000 7f863b7fe640 1 -- 172.21.15.150:0/3095166502 <== mgr.4108 v2:172.21.15.176:6800/3631216395 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f86440cc510 con 0x7f8624079760 2024-09-17T05:46:35.385 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:35.384+0000 7f864912b640 1 -- 172.21.15.150:0/3095166502 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f8624079760 msgr2=0x7f862407bc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:46:35.385 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:35.384+0000 7f864912b640 1 --2- 172.21.15.150:0/3095166502 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f8624079760 0x7f862407bc70 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f86340058e0 tx=0x7f8634005f30 comp rx=0 tx=0).stop 2024-09-17T05:46:35.386 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:35.384+0000 7f864912b640 1 -- 172.21.15.150:0/3095166502 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f86441e6870 msgr2=0x7f86441f4ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:46:35.386 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:35.384+0000 7f864912b640 1 --2- 172.21.15.150:0/3095166502 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f86441e6870 0x7f86441f4ae0 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x7f863c001d90 tx=0x7f863c006d00 comp rx=0 tx=0).stop 2024-09-17T05:46:35.386 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:35.384+0000 7f864912b640 1 -- 172.21.15.150:0/3095166502 shutdown_connections 2024-09-17T05:46:35.386 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:35.384+0000 7f864912b640 1 --2- 172.21.15.150:0/3095166502 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f86440b01b0 0x7f86441f45a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:35.386 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:35.384+0000 7f864912b640 1 --2- 172.21.15.150:0/3095166502 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f8624079760 0x7f862407bc70 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:35.386 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:35.384+0000 7f864912b640 1 --2- 172.21.15.150:0/3095166502 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f86441e6870 0x7f86441f4ae0 unknown :-1 s=CLOSED pgs=712 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:35.386 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:35.384+0000 7f864912b640 1 --2- 172.21.15.150:0/3095166502 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8630005250 0x7f86440afc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:35.386 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:35.384+0000 7f864912b640 1 -- 172.21.15.150:0/3095166502 >> 172.21.15.150:0/3095166502 conn(0x7f86440cef00 msgr2=0x7f86440cd030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:46:35.386 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:35.384+0000 7f864912b640 1 -- 172.21.15.150:0/3095166502 shutdown_connections 2024-09-17T05:46:35.386 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:35.384+0000 7f864912b640 1 -- 172.21.15.150:0/3095166502 wait complete. 2024-09-17T05:46:35.401 DEBUG:teuthology.orchestra.run.smithi150:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'stat -c %h /home/ubuntu/cephtest/mnt.0/./volumes/_deleting') 2024-09-17T05:46:35.450 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:35 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-17T05:46:35.455 INFO:teuthology.orchestra.run.smithi150.stdout:2 2024-09-17T05:46:35.455 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:35 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T05:46:35.461 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mgr mgr/volumes/max_concurrent_clones 4 2024-09-17T05:46:35.581 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:35.579+0000 7fc3c6441640 1 -- 172.21.15.150:0/3621203752 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc3c006dea0 msgr2=0x7fc3c00d0020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:46:35.581 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:35.579+0000 7fc3c6441640 1 --2- 172.21.15.150:0/3621203752 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc3c006dea0 0x7fc3c00d0020 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fc3b4009860 tx=0x7fc3b402a540 comp rx=0 tx=0).stop 2024-09-17T05:46:35.581 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:35.579+0000 7fc3c6441640 1 -- 172.21.15.150:0/3621203752 shutdown_connections 2024-09-17T05:46:35.581 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:35.579+0000 7fc3c6441640 1 --2- 172.21.15.150:0/3621203752 >> v2:172.21.15.176:3300/0 conn(0x7fc3c006e2b0 0x7fc3c00d0560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:35.581 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:35.579+0000 7fc3c6441640 1 --2- 172.21.15.150:0/3621203752 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc3c006dea0 0x7fc3c00d0020 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:35.581 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:35.579+0000 7fc3c6441640 1 -- 172.21.15.150:0/3621203752 >> 172.21.15.150:0/3621203752 conn(0x7fc3c008bfe0 msgr2=0x7fc3c00d46e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:46:35.581 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:35.579+0000 7fc3c6441640 1 -- 172.21.15.150:0/3621203752 shutdown_connections 2024-09-17T05:46:35.581 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:35.579+0000 7fc3c6441640 1 -- 172.21.15.150:0/3621203752 wait complete. 2024-09-17T05:46:35.582 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:35.581+0000 7fc3c6441640 1 Processor -- start 2024-09-17T05:46:35.582 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:35.581+0000 7fc3c6441640 1 -- start start 2024-09-17T05:46:35.585 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:35.582+0000 7fc3c6441640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc3c006dea0 0x7fc3c015c440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:46:35.585 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:35.582+0000 7fc3c6441640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc3c006e2b0 0x7fc3c00cd3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:46:35.585 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:35.582+0000 7fc3c6441640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc3c00d5150 0x7fc3c00cd930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:46:35.585 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:35.582+0000 7fc3c6441640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7fc3c00b6160 con 0x7fc3c00d5150 2024-09-17T05:46:35.585 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:35.582+0000 7fc3c6441640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fc3c00d31e0 con 0x7fc3c006dea0 2024-09-17T05:46:35.585 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:35.582+0000 7fc3c6441640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fc3c00b62e0 con 0x7fc3c006e2b0 2024-09-17T05:46:35.585 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:35.582+0000 7fc3c49de640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc3c00d5150 0x7fc3c00cd930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:46:35.585 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:35.582+0000 7fc3c49de640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc3c00d5150 0x7fc3c00cd930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:35242/0 (socket says 172.21.15.150:35242) 2024-09-17T05:46:35.585 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:35.582+0000 7fc3c49de640 1 -- 172.21.15.150:0/3691482779 learned_addr learned my addr 172.21.15.150:0/3691482779 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:46:35.586 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:35.582+0000 7fc3bffff640 1 --2- 172.21.15.150:0/3691482779 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc3c006dea0 0x7fc3c015c440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:46:35.586 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:35.582+0000 7fc3bf7fe640 1 --2- 172.21.15.150:0/3691482779 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc3c006e2b0 0x7fc3c00cd3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:46:35.586 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:35.583+0000 7fc3c49de640 1 -- 172.21.15.150:0/3691482779 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc3c006e2b0 msgr2=0x7fc3c00cd3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:46:35.586 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:35.583+0000 7fc3c49de640 1 --2- 172.21.15.150:0/3691482779 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc3c006e2b0 0x7fc3c00cd3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:35.586 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:35.583+0000 7fc3c49de640 1 -- 172.21.15.150:0/3691482779 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc3c006dea0 msgr2=0x7fc3c015c440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:46:35.586 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:35.583+0000 7fc3c49de640 1 --2- 172.21.15.150:0/3691482779 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc3c006dea0 0x7fc3c015c440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:35.586 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:35.583+0000 7fc3c49de640 1 -- 172.21.15.150:0/3691482779 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc3c01477a0 con 0x7fc3c00d5150 2024-09-17T05:46:35.586 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:35.583+0000 7fc3c49de640 1 --2- 172.21.15.150:0/3691482779 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc3c00d5150 0x7fc3c00cd930 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 crypto rx=0x7fc3b800efc0 tx=0x7fc3b800c800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:46:35.586 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:35.583+0000 7fc3bcff9640 1 -- 172.21.15.150:0/3691482779 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3b8003970 con 0x7fc3c00d5150 2024-09-17T05:46:35.586 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:35.583+0000 7fc3bcff9640 1 -- 172.21.15.150:0/3691482779 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc3b8003c00 con 0x7fc3c00d5150 2024-09-17T05:46:35.586 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:35.583+0000 7fc3c6441640 1 -- 172.21.15.150:0/3691482779 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc3c01599e0 con 0x7fc3c00d5150 2024-09-17T05:46:35.586 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:35.583+0000 7fc3bcff9640 1 -- 172.21.15.150:0/3691482779 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3b8004020 con 0x7fc3c00d5150 2024-09-17T05:46:35.586 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:35.583+0000 7fc3c6441640 1 -- 172.21.15.150:0/3691482779 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc3c00ccbf0 con 0x7fc3c00d5150 2024-09-17T05:46:35.587 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:35.584+0000 7fc3c6441640 1 -- 172.21.15.150:0/3691482779 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc3c0159750 con 0x7fc3c00d5150 2024-09-17T05:46:35.587 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:35.585+0000 7fc3bcff9640 1 -- 172.21.15.150:0/3691482779 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 19) ==== 102563+0+0 (secure 0 0 0) 0x7fc3b801d020 con 0x7fc3c00d5150 2024-09-17T05:46:35.587 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:35.585+0000 7fc3bcff9640 1 --2- 172.21.15.150:0/3691482779 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fc3ac0797f0 0x7fc3ac07bd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:46:35.588 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:35.585+0000 7fc3bcff9640 1 -- 172.21.15.150:0/3691482779 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(60..60 src has 1..60) ==== 5737+0+0 (secure 0 0 0) 0x7fc3b8099e20 con 0x7fc3c00d5150 2024-09-17T05:46:35.588 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:35.585+0000 7fc3bffff640 1 --2- 172.21.15.150:0/3691482779 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fc3ac0797f0 0x7fc3ac07bd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:46:35.588 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:35.586+0000 7fc3bffff640 1 --2- 172.21.15.150:0/3691482779 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fc3ac0797f0 0x7fc3ac07bd00 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7fc3b0007fd0 tx=0x7fc3b0009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:46:35.591 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:35.590+0000 7fc3bcff9640 1 -- 172.21.15.150:0/3691482779 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fc3b8063450 con 0x7fc3c00d5150 2024-09-17T05:46:35.773 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:35.772+0000 7fc3c6441640 1 -- 172.21.15.150:0/3691482779 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command([{prefix=config set, name=mgr/volumes/max_concurrent_clones}] v 0) -- 0x7fc3c00b67a0 con 0x7fc3c00d5150 2024-09-17T05:46:35.774 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:35.772+0000 7fc3bcff9640 1 -- 172.21.15.150:0/3691482779 <== mon.0 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/volumes/max_concurrent_clones}]=0 v39)=0 v39) ==== 131+0+0 (secure 0 0 0) 0x7fc3b8067e80 con 0x7fc3c00d5150 2024-09-17T05:46:35.776 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:35.774+0000 7fc3c6441640 1 -- 172.21.15.150:0/3691482779 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fc3ac0797f0 msgr2=0x7fc3ac07bd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:46:35.776 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:35.774+0000 7fc3c6441640 1 --2- 172.21.15.150:0/3691482779 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fc3ac0797f0 0x7fc3ac07bd00 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7fc3b0007fd0 tx=0x7fc3b0009040 comp rx=0 tx=0).stop 2024-09-17T05:46:35.776 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:35.774+0000 7fc3c6441640 1 -- 172.21.15.150:0/3691482779 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc3c00d5150 msgr2=0x7fc3c00cd930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:46:35.777 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:35.774+0000 7fc3c6441640 1 --2- 172.21.15.150:0/3691482779 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc3c00d5150 0x7fc3c00cd930 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 crypto rx=0x7fc3b800efc0 tx=0x7fc3b800c800 comp rx=0 tx=0).stop 2024-09-17T05:46:35.777 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:35.774+0000 7fc3c6441640 1 -- 172.21.15.150:0/3691482779 shutdown_connections 2024-09-17T05:46:35.777 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:35.774+0000 7fc3c6441640 1 --2- 172.21.15.150:0/3691482779 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fc3ac0797f0 0x7fc3ac07bd00 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:35.777 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:35.774+0000 7fc3c6441640 1 --2- 172.21.15.150:0/3691482779 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc3c00d5150 0x7fc3c00cd930 unknown :-1 s=CLOSED pgs=713 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:35.777 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:35.774+0000 7fc3c6441640 1 --2- 172.21.15.150:0/3691482779 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc3c006e2b0 0x7fc3c00cd3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:35.777 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:35.774+0000 7fc3c6441640 1 --2- 172.21.15.150:0/3691482779 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc3c006dea0 0x7fc3c015c440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:35.777 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:35.774+0000 7fc3c6441640 1 -- 172.21.15.150:0/3691482779 >> 172.21.15.150:0/3691482779 conn(0x7fc3c008bfe0 msgr2=0x7fc3c00d0d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:46:35.777 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:35.774+0000 7fc3c6441640 1 -- 172.21.15.150:0/3691482779 shutdown_connections 2024-09-17T05:46:35.777 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:35.774+0000 7fc3c6441640 1 -- 172.21.15.150:0/3691482779 wait complete. 2024-09-17T05:46:35.788 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-17T05:46:35.788 DEBUG:teuthology.orchestra.run.smithi150:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-17T05:46:35.837 DEBUG:teuthology.orchestra.run.smithi176:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-17T05:46:35.887 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-17T05:46:35.887 INFO:tasks.cephfs.mount:Terminating background process 2024-09-17T05:46:35.887 DEBUG:teuthology.orchestra.run.smithi150:> set -ex 2024-09-17T05:46:35.887 DEBUG:teuthology.orchestra.run.smithi150:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T05:46:35.903 DEBUG:teuthology.orchestra.run.smithi150:> set -ex 2024-09-17T05:46:35.904 DEBUG:teuthology.orchestra.run.smithi150:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T05:46:35.965 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-17T05:46:36.114 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:36.112+0000 7fcf0aded640 1 -- 172.21.15.150:0/2706152464 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fcf040ce320 msgr2=0x7fcf040ce730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:46:36.114 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:36.112+0000 7fcf0aded640 1 --2- 172.21.15.150:0/2706152464 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fcf040ce320 0x7fcf040ce730 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x7fcef4005fd0 tx=0x7fcef402a530 comp rx=0 tx=0).stop 2024-09-17T05:46:36.114 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:36.112+0000 7fcf0aded640 1 -- 172.21.15.150:0/2706152464 shutdown_connections 2024-09-17T05:46:36.115 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:36.112+0000 7fcf0aded640 1 --2- 172.21.15.150:0/2706152464 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fcf040b43e0 0x7fcf040b47f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:36.115 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:36.112+0000 7fcf0aded640 1 --2- 172.21.15.150:0/2706152464 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fcf040ce320 0x7fcf040ce730 unknown :-1 s=CLOSED pgs=714 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:36.115 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:36.112+0000 7fcf0aded640 1 -- 172.21.15.150:0/2706152464 >> 172.21.15.150:0/2706152464 conn(0x7fcf040b2ef0 msgr2=0x7fcf040b3300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:46:36.115 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:36.112+0000 7fcf0aded640 1 -- 172.21.15.150:0/2706152464 shutdown_connections 2024-09-17T05:46:36.115 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:36.112+0000 7fcf0aded640 1 -- 172.21.15.150:0/2706152464 wait complete. 2024-09-17T05:46:36.115 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:36.114+0000 7fcf0aded640 1 Processor -- start 2024-09-17T05:46:36.116 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:36.114+0000 7fcf0aded640 1 -- start start 2024-09-17T05:46:36.118 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:36.115+0000 7fcf0aded640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fcf040b43e0 0x7fcf041f6460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:46:36.119 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:36.115+0000 7fcf0aded640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fcf040b6530 0x7fcf04160af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:46:36.119 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:36.116+0000 7fcf0aded640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fcf040ce320 0x7fcf04161030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:46:36.119 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:36.116+0000 7fcf0aded640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7fcf040b5280 con 0x7fcf040ce320 2024-09-17T05:46:36.119 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:36.116+0000 7fcf0aded640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fcf040b5100 con 0x7fcf040b6530 2024-09-17T05:46:36.119 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:36.116+0000 7fcf0aded640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fcf040b5400 con 0x7fcf040b43e0 2024-09-17T05:46:36.119 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:36.116+0000 7fcf0938a640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fcf040ce320 0x7fcf04161030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:46:36.119 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:36.116+0000 7fcf0938a640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fcf040ce320 0x7fcf04161030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:35262/0 (socket says 172.21.15.150:35262) 2024-09-17T05:46:36.119 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:36.116+0000 7fcf0938a640 1 -- 172.21.15.150:0/2486666914 learned_addr learned my addr 172.21.15.150:0/2486666914 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:46:36.119 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:36.116+0000 7fcf08b89640 1 --2- 172.21.15.150:0/2486666914 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fcf040b43e0 0x7fcf041f6460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:46:36.119 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:36.116+0000 7fcefbfff640 1 --2- 172.21.15.150:0/2486666914 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fcf040b6530 0x7fcf04160af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:46:36.119 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:36.116+0000 7fcf0938a640 1 -- 172.21.15.150:0/2486666914 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fcf040b43e0 msgr2=0x7fcf041f6460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:46:36.119 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:36.116+0000 7fcf0938a640 1 --2- 172.21.15.150:0/2486666914 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fcf040b43e0 0x7fcf041f6460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:36.120 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:36.116+0000 7fcf0938a640 1 -- 172.21.15.150:0/2486666914 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fcf040b6530 msgr2=0x7fcf04160af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:46:36.120 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:36.116+0000 7fcf0938a640 1 --2- 172.21.15.150:0/2486666914 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fcf040b6530 0x7fcf04160af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:36.120 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:36.116+0000 7fcf0938a640 1 -- 172.21.15.150:0/2486666914 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcf041f6fb0 con 0x7fcf040ce320 2024-09-17T05:46:36.120 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:36.116+0000 7fcf08b89640 1 --2- 172.21.15.150:0/2486666914 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fcf040b43e0 0x7fcf041f6460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T05:46:36.120 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:36.116+0000 7fcefbfff640 1 --2- 172.21.15.150:0/2486666914 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fcf040b6530 0x7fcf04160af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T05:46:36.120 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:36.116+0000 7fcf0938a640 1 --2- 172.21.15.150:0/2486666914 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fcf040ce320 0x7fcf04161030 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 crypto rx=0x7fcefc00c8f0 tx=0x7fcefc00cdb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:46:36.120 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:36.116+0000 7fcef97fa640 1 -- 172.21.15.150:0/2486666914 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcefc007bb0 con 0x7fcf040ce320 2024-09-17T05:46:36.120 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:36.116+0000 7fcef97fa640 1 -- 172.21.15.150:0/2486666914 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fcefc00ae40 con 0x7fcf040ce320 2024-09-17T05:46:36.120 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:36.116+0000 7fcef97fa640 1 -- 172.21.15.150:0/2486666914 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcefc005280 con 0x7fcf040ce320 2024-09-17T05:46:36.120 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:36.116+0000 7fcf0aded640 1 -- 172.21.15.150:0/2486666914 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcf041f7290 con 0x7fcf040ce320 2024-09-17T05:46:36.120 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:36.116+0000 7fcf0aded640 1 -- 172.21.15.150:0/2486666914 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcf041f7850 con 0x7fcf040ce320 2024-09-17T05:46:36.121 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:36.118+0000 7fcf0aded640 1 -- 172.21.15.150:0/2486666914 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcf040b47f0 con 0x7fcf040ce320 2024-09-17T05:46:36.121 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:36.118+0000 7fcef97fa640 1 -- 172.21.15.150:0/2486666914 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 19) ==== 102563+0+0 (secure 0 0 0) 0x7fcefc005420 con 0x7fcf040ce320 2024-09-17T05:46:36.121 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:36.118+0000 7fcef97fa640 1 --2- 172.21.15.150:0/2486666914 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fcef00797f0 0x7fcef007bd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:46:36.121 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:36.119+0000 7fcef97fa640 1 -- 172.21.15.150:0/2486666914 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(60..60 src has 1..60) ==== 5737+0+0 (secure 0 0 0) 0x7fcefc099a50 con 0x7fcf040ce320 2024-09-17T05:46:36.122 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:36.119+0000 7fcf08b89640 1 --2- 172.21.15.150:0/2486666914 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fcef00797f0 0x7fcef007bd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:46:36.122 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:36.119+0000 7fcf08b89640 1 --2- 172.21.15.150:0/2486666914 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fcef00797f0 0x7fcef007bd00 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7fcf040d24c0 tx=0x7fcf000073a0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:46:36.124 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:36.123+0000 7fcef97fa640 1 -- 172.21.15.150:0/2486666914 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fcefc014030 con 0x7fcf040ce320 2024-09-17T05:46:36.310 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:36.308+0000 7fcf0aded640 1 -- 172.21.15.150:0/2486666914 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7fcf040b2cd0 con 0x7fcf040ce320 2024-09-17T05:46:36.310 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:36.309+0000 7fcef97fa640 1 -- 172.21.15.150:0/2486666914 <== mon.0 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v60) ==== 80+0+0 (secure 0 0 0) 0x7fcefc0639d0 con 0x7fcf040ce320 2024-09-17T05:46:36.310 INFO:teuthology.orchestra.run.smithi150.stderr:listed 0 entries 2024-09-17T05:46:36.313 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:36.311+0000 7fcf0aded640 1 -- 172.21.15.150:0/2486666914 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fcef00797f0 msgr2=0x7fcef007bd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:46:36.313 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:36.311+0000 7fcf0aded640 1 --2- 172.21.15.150:0/2486666914 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fcef00797f0 0x7fcef007bd00 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7fcf040d24c0 tx=0x7fcf000073a0 comp rx=0 tx=0).stop 2024-09-17T05:46:36.313 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:36.311+0000 7fcf0aded640 1 -- 172.21.15.150:0/2486666914 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fcf040ce320 msgr2=0x7fcf04161030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:46:36.313 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:36.311+0000 7fcf0aded640 1 --2- 172.21.15.150:0/2486666914 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fcf040ce320 0x7fcf04161030 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 crypto rx=0x7fcefc00c8f0 tx=0x7fcefc00cdb0 comp rx=0 tx=0).stop 2024-09-17T05:46:36.313 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:36.311+0000 7fcf0aded640 1 -- 172.21.15.150:0/2486666914 shutdown_connections 2024-09-17T05:46:36.313 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:36.311+0000 7fcf0aded640 1 --2- 172.21.15.150:0/2486666914 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fcf040b6530 0x7fcf04160af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:36.313 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:36.311+0000 7fcf0aded640 1 --2- 172.21.15.150:0/2486666914 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fcef00797f0 0x7fcef007bd00 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:36.313 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:36.311+0000 7fcf0aded640 1 --2- 172.21.15.150:0/2486666914 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fcf040ce320 0x7fcf04161030 unknown :-1 s=CLOSED pgs=715 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:36.313 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:36.311+0000 7fcf0aded640 1 --2- 172.21.15.150:0/2486666914 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fcf040b43e0 0x7fcf041f6460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:36.314 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:36.311+0000 7fcf0aded640 1 -- 172.21.15.150:0/2486666914 >> 172.21.15.150:0/2486666914 conn(0x7fcf040b2ef0 msgr2=0x7fcf040cc3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:46:36.314 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:36.311+0000 7fcf0aded640 1 -- 172.21.15.150:0/2486666914 shutdown_connections 2024-09-17T05:46:36.314 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:36.311+0000 7fcf0aded640 1 -- 172.21.15.150:0/2486666914 wait complete. 2024-09-17T05:46:36.324 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-09-17T05:46:36.325 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:46:36.325 DEBUG:teuthology.orchestra.run.smithi150:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-09-17T05:46:36.376 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi150.front.sepia.ceph.com 2024-09-17T05:46:36.377 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:46:36.377 DEBUG:teuthology.orchestra.run.smithi150:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-17T05:46:36.409 INFO:tasks.cephfs.mount:Terminating background process 2024-09-17T05:46:36.409 DEBUG:teuthology.orchestra.run.smithi176:> set -ex 2024-09-17T05:46:36.409 DEBUG:teuthology.orchestra.run.smithi176:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T05:46:36.426 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056030,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497468k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=3379 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248732k,nr_inodes=812183,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497468k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-17T05:46:36.426 INFO:tasks.cephfs.mount:Terminating background process 2024-09-17T05:46:36.426 DEBUG:teuthology.orchestra.run.smithi150:> set -ex 2024-09-17T05:46:36.426 DEBUG:teuthology.orchestra.run.smithi150:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T05:46:36.466 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056027,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497464k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=18693 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248728k,nr_inodes=812182,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497464k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-17T05:46:36.466 INFO:tasks.cephfs.mount:Terminating background process 2024-09-17T05:46:36.466 DEBUG:teuthology.orchestra.run.smithi176:> set -ex 2024-09-17T05:46:36.467 DEBUG:teuthology.orchestra.run.smithi176:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T05:46:36.483 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056030,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497468k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=3379 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248732k,nr_inodes=812183,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497468k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-17T05:46:36.484 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T05:46:36.620 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:36.618+0000 7fde51894640 1 -- 172.21.15.150:0/2319680629 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fde4c0d1790 msgr2=0x7fde4c0d2780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:46:36.620 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:36.618+0000 7fde51894640 1 --2- 172.21.15.150:0/2319680629 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fde4c0d1790 0x7fde4c0d2780 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 crypto rx=0x7fde4c08c5a0 tx=0x7fde3402a560 comp rx=0 tx=0).stop 2024-09-17T05:46:36.620 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:36.618+0000 7fde51894640 1 -- 172.21.15.150:0/2319680629 shutdown_connections 2024-09-17T05:46:36.620 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:36.618+0000 7fde51894640 1 --2- 172.21.15.150:0/2319680629 >> v2:172.21.15.176:3300/0 conn(0x7fde4c0d4f90 0x7fde4c0d0400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:36.620 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:36.618+0000 7fde51894640 1 --2- 172.21.15.150:0/2319680629 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fde4c0d1790 0x7fde4c0d2780 unknown :-1 s=CLOSED pgs=716 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:36.620 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:36.618+0000 7fde51894640 1 -- 172.21.15.150:0/2319680629 >> 172.21.15.150:0/2319680629 conn(0x7fde4c08bfe0 msgr2=0x7fde4c0d4670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:46:36.620 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:36.618+0000 7fde51894640 1 -- 172.21.15.150:0/2319680629 shutdown_connections 2024-09-17T05:46:36.621 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:36.618+0000 7fde51894640 1 -- 172.21.15.150:0/2319680629 wait complete. 2024-09-17T05:46:36.621 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:36.619+0000 7fde51894640 1 Processor -- start 2024-09-17T05:46:36.621 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:36.620+0000 7fde51894640 1 -- start start 2024-09-17T05:46:36.624 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:36.621+0000 7fde51894640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fde4c0b5d50 0x7fde4c0ce660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:46:36.624 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:36.621+0000 7fde51894640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fde4c0d4f90 0x7fde4c154a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:46:36.625 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:36.621+0000 7fde51894640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fde4c1f99c0 0x7fde4c1f9dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:46:36.625 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:36.621+0000 7fde51894640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7fde4c0b7ac0 con 0x7fde4c0d4f90 2024-09-17T05:46:36.625 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:36.621+0000 7fde51894640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fde4c0b7940 con 0x7fde4c1f99c0 2024-09-17T05:46:36.625 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:36.621+0000 7fde51894640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fde4c0b7c40 con 0x7fde4c0b5d50 2024-09-17T05:46:36.625 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:36.621+0000 7fde4a7fc640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fde4c0d4f90 0x7fde4c154a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:46:36.625 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:36.621+0000 7fde4a7fc640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fde4c0d4f90 0x7fde4c154a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:35278/0 (socket says 172.21.15.150:35278) 2024-09-17T05:46:36.625 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:36.621+0000 7fde4a7fc640 1 -- 172.21.15.150:0/1714349887 learned_addr learned my addr 172.21.15.150:0/1714349887 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:46:36.626 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:36.621+0000 7fde4affd640 1 --2- 172.21.15.150:0/1714349887 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fde4c0b5d50 0x7fde4c0ce660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:46:36.626 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:36.621+0000 7fde4b7fe640 1 --2- 172.21.15.150:0/1714349887 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fde4c1f99c0 0x7fde4c1f9dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:46:36.626 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:36.621+0000 7fde4a7fc640 1 -- 172.21.15.150:0/1714349887 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fde4c0b5d50 msgr2=0x7fde4c0ce660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:46:36.626 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:36.621+0000 7fde4a7fc640 1 --2- 172.21.15.150:0/1714349887 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fde4c0b5d50 0x7fde4c0ce660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:36.626 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:36.621+0000 7fde4a7fc640 1 -- 172.21.15.150:0/1714349887 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fde4c1f99c0 msgr2=0x7fde4c1f9dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:46:36.626 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:36.621+0000 7fde4a7fc640 1 --2- 172.21.15.150:0/1714349887 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fde4c1f99c0 0x7fde4c1f9dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:36.626 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:36.621+0000 7fde4a7fc640 1 -- 172.21.15.150:0/1714349887 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fde4c1fa310 con 0x7fde4c0d4f90 2024-09-17T05:46:36.626 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:36.621+0000 7fde4b7fe640 1 --2- 172.21.15.150:0/1714349887 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fde4c1f99c0 0x7fde4c1f9dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:46:36.626 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:36.622+0000 7fde4a7fc640 1 --2- 172.21.15.150:0/1714349887 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fde4c0d4f90 0x7fde4c154a10 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 crypto rx=0x7fde34034040 tx=0x7fde340039e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:46:36.626 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:36.622+0000 7fde43fff640 1 -- 172.21.15.150:0/1714349887 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde3403e030 con 0x7fde4c0d4f90 2024-09-17T05:46:36.626 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:36.622+0000 7fde43fff640 1 -- 172.21.15.150:0/1714349887 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fde340047a0 con 0x7fde4c0d4f90 2024-09-17T05:46:36.626 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:36.622+0000 7fde51894640 1 -- 172.21.15.150:0/1714349887 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fde4c158060 con 0x7fde4c0d4f90 2024-09-17T05:46:36.627 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:36.622+0000 7fde43fff640 1 -- 172.21.15.150:0/1714349887 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde34035040 con 0x7fde4c0d4f90 2024-09-17T05:46:36.627 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:36.622+0000 7fde51894640 1 -- 172.21.15.150:0/1714349887 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fde4c1fa790 con 0x7fde4c0d4f90 2024-09-17T05:46:36.627 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:36.623+0000 7fde51894640 1 -- 172.21.15.150:0/1714349887 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fde4c158230 con 0x7fde4c0d4f90 2024-09-17T05:46:36.627 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:36.623+0000 7fde43fff640 1 -- 172.21.15.150:0/1714349887 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 19) ==== 102563+0+0 (secure 0 0 0) 0x7fde34041030 con 0x7fde4c0d4f90 2024-09-17T05:46:36.628 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:36.624+0000 7fde43fff640 1 --2- 172.21.15.150:0/1714349887 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fde2c0797f0 0x7fde2c07bd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:46:36.628 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:36.624+0000 7fde43fff640 1 -- 172.21.15.150:0/1714349887 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(60..60 src has 1..60) ==== 5737+0+0 (secure 0 0 0) 0x7fde340b9f10 con 0x7fde4c0d4f90 2024-09-17T05:46:36.628 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:36.624+0000 7fde4affd640 1 --2- 172.21.15.150:0/1714349887 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fde2c0797f0 0x7fde2c07bd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:46:36.628 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:36.625+0000 7fde4affd640 1 --2- 172.21.15.150:0/1714349887 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fde2c0797f0 0x7fde2c07bd00 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7fde3c009fd0 tx=0x7fde3c00d040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:46:36.630 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:36.629+0000 7fde43fff640 1 -- 172.21.15.150:0/1714349887 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fde4c158230 con 0x7fde4c0d4f90 2024-09-17T05:46:37.004 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:37.002+0000 7fde51894640 1 -- 172.21.15.150:0/1714349887 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fde4c0d2780 con 0x7fde4c0d4f90 2024-09-17T05:46:37.004 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:37.003+0000 7fde43fff640 1 -- 172.21.15.150:0/1714349887 <== mon.0 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 34 v34) ==== 94+0+5235 (secure 0 0 0) 0x7fde4c1fa310 con 0x7fde4c0d4f90 2024-09-17T05:46:37.005 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-09-17T05:46:37.005 INFO:teuthology.orchestra.run.smithi150.stdout:{"epoch":34,"btime":"2024-09-17T05:45:44:972475+0000","default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5692,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6836/2204030245","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6834","nonce":2204030245},{"type":"v1","addr":"172.21.15.176:6836","nonce":2204030245}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":29},{"gid":5695,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6837/4065519712","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6835","nonce":4065519712},{"type":"v1","addr":"172.21.15.176:6837","nonce":4065519712}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":29},{"gid":6006,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6834/3602763503","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6832","nonce":3602763503},{"type":"v1","addr":"172.21.15.150:6834","nonce":3602763503}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":29}],"filesystems":[{"mdsmap":{"epoch":33,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T05:45:31.989014+0000","modified":"2024-09-17T05:45:35.004451+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6009},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6009":{"gid":6009,"name":"a","rank":0,"incarnation":30,"state":"up:active","state_seq":3,"addr":"172.21.15.150:6835/3434025708","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6833","nonce":3434025708},{"type":"v1","addr":"172.21.15.150:6835","nonce":3434025708}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6009,"qdb_cluster":[6009]},"id":4}]} 2024-09-17T05:46:37.005 INFO:teuthology.orchestra.run.smithi150.stderr:dumped fsmap epoch 34 2024-09-17T05:46:37.009 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:37.007+0000 7fde51894640 1 -- 172.21.15.150:0/1714349887 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fde2c0797f0 msgr2=0x7fde2c07bd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:46:37.009 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:37.007+0000 7fde51894640 1 --2- 172.21.15.150:0/1714349887 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fde2c0797f0 0x7fde2c07bd00 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7fde3c009fd0 tx=0x7fde3c00d040 comp rx=0 tx=0).stop 2024-09-17T05:46:37.009 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:37.007+0000 7fde51894640 1 -- 172.21.15.150:0/1714349887 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fde4c0d4f90 msgr2=0x7fde4c154a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:46:37.009 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:37.007+0000 7fde51894640 1 --2- 172.21.15.150:0/1714349887 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fde4c0d4f90 0x7fde4c154a10 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 crypto rx=0x7fde34034040 tx=0x7fde340039e0 comp rx=0 tx=0).stop 2024-09-17T05:46:37.009 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:37.007+0000 7fde51894640 1 -- 172.21.15.150:0/1714349887 shutdown_connections 2024-09-17T05:46:37.009 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:37.007+0000 7fde51894640 1 --2- 172.21.15.150:0/1714349887 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fde4c1f99c0 0x7fde4c1f9dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:37.009 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:37.007+0000 7fde51894640 1 --2- 172.21.15.150:0/1714349887 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fde2c0797f0 0x7fde2c07bd00 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:37.009 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:37.007+0000 7fde51894640 1 --2- 172.21.15.150:0/1714349887 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fde4c0d4f90 0x7fde4c154a10 unknown :-1 s=CLOSED pgs=717 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:37.010 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:37.007+0000 7fde51894640 1 --2- 172.21.15.150:0/1714349887 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fde4c0b5d50 0x7fde4c0ce660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:37.010 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:37.007+0000 7fde51894640 1 -- 172.21.15.150:0/1714349887 >> 172.21.15.150:0/1714349887 conn(0x7fde4c08bfe0 msgr2=0x7fde4c06dfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:46:37.010 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:37.008+0000 7fde51894640 1 -- 172.21.15.150:0/1714349887 shutdown_connections 2024-09-17T05:46:37.010 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:37.008+0000 7fde51894640 1 -- 172.21.15.150:0/1714349887 wait complete. 2024-09-17T05:46:37.027 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T05:46:37.211 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:37.209+0000 7fc8a22f5640 1 -- 172.21.15.150:0/1343289682 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc8940ec770 msgr2=0x7fc8940eeb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:46:37.211 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:37.209+0000 7fc8a22f5640 1 --2- 172.21.15.150:0/1343289682 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc8940ec770 0x7fc8940eeb90 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 crypto rx=0x7fc8940374b0 tx=0x7fc89c0a66e0 comp rx=0 tx=0).stop 2024-09-17T05:46:37.211 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:37.210+0000 7fc8a22f5640 1 -- 172.21.15.150:0/1343289682 shutdown_connections 2024-09-17T05:46:37.211 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:37.210+0000 7fc8a22f5640 1 --2- 172.21.15.150:0/1343289682 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc8940ec770 0x7fc8940eeb90 unknown :-1 s=CLOSED pgs=719 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:37.211 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:37.210+0000 7fc8a22f5640 1 -- 172.21.15.150:0/1343289682 >> 172.21.15.150:0/1343289682 conn(0x7fc89401e280 msgr2=0x7fc894039ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:46:37.212 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:37.210+0000 7fc8a22f5640 1 -- 172.21.15.150:0/1343289682 shutdown_connections 2024-09-17T05:46:37.212 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:37.210+0000 7fc8a22f5640 1 -- 172.21.15.150:0/1343289682 wait complete. 2024-09-17T05:46:37.214 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:37.213+0000 7fc8a22f5640 1 Processor -- start 2024-09-17T05:46:37.215 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:37.213+0000 7fc8a22f5640 1 -- start start 2024-09-17T05:46:37.218 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:37.215+0000 7fc8a22f5640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc894054a90 0x7fc89417e470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:46:37.218 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:37.215+0000 7fc8a22f5640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc8940e6c10 0x7fc8940339b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:46:37.219 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:37.215+0000 7fc8a22f5640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc8940ec770 0x7fc894033ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:46:37.219 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:37.215+0000 7fc8a22f5640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7fc894036490 con 0x7fc8940e6c10 2024-09-17T05:46:37.219 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:37.215+0000 7fc8a22f5640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fc8940379d0 con 0x7fc894054a90 2024-09-17T05:46:37.219 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:37.215+0000 7fc8a22f5640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fc8940e3330 con 0x7fc8940ec770 2024-09-17T05:46:37.219 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:37.216+0000 7fc8a12f3640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc894054a90 0x7fc89417e470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:46:37.219 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:37.216+0000 7fc8a12f3640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc894054a90 0x7fc89417e470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3300/0 says I am v2:172.21.15.150:53580/0 (socket says 172.21.15.150:53580) 2024-09-17T05:46:37.219 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:37.216+0000 7fc8a12f3640 1 -- 172.21.15.150:0/3130307633 learned_addr learned my addr 172.21.15.150:0/3130307633 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:46:37.219 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:37.216+0000 7fc8a1af4640 1 --2- 172.21.15.150:0/3130307633 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc8940ec770 0x7fc894033ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:46:37.219 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:37.216+0000 7fc8a0af2640 1 --2- 172.21.15.150:0/3130307633 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc8940e6c10 0x7fc8940339b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:46:37.219 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:37.216+0000 7fc8a12f3640 1 -- 172.21.15.150:0/3130307633 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc8940ec770 msgr2=0x7fc894033ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:46:37.219 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:37.216+0000 7fc8a12f3640 1 --2- 172.21.15.150:0/3130307633 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc8940ec770 0x7fc894033ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:37.219 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:37.216+0000 7fc8a12f3640 1 -- 172.21.15.150:0/3130307633 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc8940e6c10 msgr2=0x7fc8940339b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:46:37.219 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:37.216+0000 7fc8a12f3640 1 --2- 172.21.15.150:0/3130307633 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc8940e6c10 0x7fc8940339b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:37.220 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:37.216+0000 7fc8a12f3640 1 -- 172.21.15.150:0/3130307633 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc89404c540 con 0x7fc894054a90 2024-09-17T05:46:37.220 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:37.216+0000 7fc8a1af4640 1 --2- 172.21.15.150:0/3130307633 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc8940ec770 0x7fc894033ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T05:46:37.220 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:37.216+0000 7fc8a12f3640 1 --2- 172.21.15.150:0/3130307633 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc894054a90 0x7fc89417e470 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7fc88c00c430 tx=0x7fc88c00c8f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:46:37.220 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:37.216+0000 7fc891ffb640 1 -- 172.21.15.150:0/3130307633 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc88c011790 con 0x7fc894054a90 2024-09-17T05:46:37.220 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:37.216+0000 7fc891ffb640 1 -- 172.21.15.150:0/3130307633 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc88c017070 con 0x7fc894054a90 2024-09-17T05:46:37.220 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:37.217+0000 7fc891ffb640 1 -- 172.21.15.150:0/3130307633 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc88c011cc0 con 0x7fc894054a90 2024-09-17T05:46:37.220 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:37.217+0000 7fc8a22f5640 1 -- 172.21.15.150:0/3130307633 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc89404c820 con 0x7fc894054a90 2024-09-17T05:46:37.220 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:37.217+0000 7fc8a22f5640 1 -- 172.21.15.150:0/3130307633 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc89404cde0 con 0x7fc894054a90 2024-09-17T05:46:37.221 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:37.219+0000 7fc87f7fe640 1 -- 172.21.15.150:0/3130307633 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc878005290 con 0x7fc894054a90 2024-09-17T05:46:37.224 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:37.223+0000 7fc891ffb640 1 -- 172.21.15.150:0/3130307633 <== mon.1 v2:172.21.15.176:3300/0 4 ==== mgrmap(e 19) ==== 102563+0+0 (secure 0 0 0) 0x7fc88c01c460 con 0x7fc894054a90 2024-09-17T05:46:37.225 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:37.224+0000 7fc891ffb640 1 --2- 172.21.15.150:0/3130307633 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fc8800797f0 0x7fc88007bd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:46:37.226 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:37.224+0000 7fc891ffb640 1 -- 172.21.15.150:0/3130307633 <== mon.1 v2:172.21.15.176:3300/0 5 ==== osd_map(60..60 src has 1..60) ==== 5737+0+0 (secure 0 0 0) 0x7fc88c099ed0 con 0x7fc894054a90 2024-09-17T05:46:37.226 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:37.225+0000 7fc8a0af2640 1 --2- 172.21.15.150:0/3130307633 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fc8800797f0 0x7fc88007bd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:46:37.228 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:37.225+0000 7fc8a0af2640 1 --2- 172.21.15.150:0/3130307633 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fc8800797f0 0x7fc88007bd00 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7fc89400c330 tx=0x7fc898009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:46:37.230 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:37.228+0000 7fc891ffb640 1 -- 172.21.15.150:0/3130307633 <== mon.1 v2:172.21.15.176:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fc88c0637a0 con 0x7fc894054a90 2024-09-17T05:46:37.647 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:37.646+0000 7fc87f7fe640 1 -- 172.21.15.150:0/3130307633 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fc878005580 con 0x7fc894054a90 2024-09-17T05:46:37.648 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:37.646+0000 7fc891ffb640 1 -- 172.21.15.150:0/3130307633 <== mon.1 v2:172.21.15.176:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 34 v34) ==== 94+0+5235 (secure 0 0 0) 0x7fc88c0681d0 con 0x7fc894054a90 2024-09-17T05:46:37.650 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-09-17T05:46:37.650 INFO:teuthology.orchestra.run.smithi150.stdout:{"epoch":34,"btime":"2024-09-17T05:45:44:972475+0000","default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5692,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6836/2204030245","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6834","nonce":2204030245},{"type":"v1","addr":"172.21.15.176:6836","nonce":2204030245}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":29},{"gid":5695,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6837/4065519712","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6835","nonce":4065519712},{"type":"v1","addr":"172.21.15.176:6837","nonce":4065519712}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":29},{"gid":6006,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6834/3602763503","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6832","nonce":3602763503},{"type":"v1","addr":"172.21.15.150:6834","nonce":3602763503}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":29}],"filesystems":[{"mdsmap":{"epoch":33,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T05:45:31.989014+0000","modified":"2024-09-17T05:45:35.004451+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6009},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6009":{"gid":6009,"name":"a","rank":0,"incarnation":30,"state":"up:active","state_seq":3,"addr":"172.21.15.150:6835/3434025708","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6833","nonce":3434025708},{"type":"v1","addr":"172.21.15.150:6835","nonce":3434025708}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6009,"qdb_cluster":[6009]},"id":4}]} 2024-09-17T05:46:37.650 INFO:teuthology.orchestra.run.smithi150.stderr:dumped fsmap epoch 34 2024-09-17T05:46:37.654 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:37.652+0000 7fc87f7fe640 1 -- 172.21.15.150:0/3130307633 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fc8800797f0 msgr2=0x7fc88007bd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:46:37.654 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:37.652+0000 7fc87f7fe640 1 --2- 172.21.15.150:0/3130307633 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fc8800797f0 0x7fc88007bd00 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7fc89400c330 tx=0x7fc898009040 comp rx=0 tx=0).stop 2024-09-17T05:46:37.655 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:37.652+0000 7fc87f7fe640 1 -- 172.21.15.150:0/3130307633 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc894054a90 msgr2=0x7fc89417e470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:46:37.655 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:37.652+0000 7fc87f7fe640 1 --2- 172.21.15.150:0/3130307633 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc894054a90 0x7fc89417e470 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7fc88c00c430 tx=0x7fc88c00c8f0 comp rx=0 tx=0).stop 2024-09-17T05:46:37.655 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:37.652+0000 7fc87f7fe640 1 -- 172.21.15.150:0/3130307633 shutdown_connections 2024-09-17T05:46:37.655 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:37.652+0000 7fc87f7fe640 1 --2- 172.21.15.150:0/3130307633 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fc8800797f0 0x7fc88007bd00 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:37.655 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:37.652+0000 7fc87f7fe640 1 --2- 172.21.15.150:0/3130307633 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc8940ec770 0x7fc894033ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:37.655 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:37.652+0000 7fc87f7fe640 1 --2- 172.21.15.150:0/3130307633 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc8940e6c10 0x7fc8940339b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:37.655 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:37.652+0000 7fc87f7fe640 1 --2- 172.21.15.150:0/3130307633 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc894054a90 0x7fc89417e470 secure :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7fc88c00c430 tx=0x7fc88c00c8f0 comp rx=0 tx=0).stop 2024-09-17T05:46:37.655 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:37.652+0000 7fc87f7fe640 1 -- 172.21.15.150:0/3130307633 >> 172.21.15.150:0/3130307633 conn(0x7fc89401e280 msgr2=0x7fc89400a530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:46:37.655 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:37.653+0000 7fc87f7fe640 1 -- 172.21.15.150:0/3130307633 shutdown_connections 2024-09-17T05:46:37.655 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:37.653+0000 7fc87f7fe640 1 -- 172.21.15.150:0/3130307633 wait complete. 2024-09-17T05:46:37.672 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T05:46:37.858 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:37.856+0000 7f4d04e8b640 1 -- 172.21.15.150:0/2427470530 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4d0015c9a0 msgr2=0x7f4d0006ddb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:46:37.858 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:37.856+0000 7f4d04e8b640 1 --2- 172.21.15.150:0/2427470530 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4d0015c9a0 0x7f4d0006ddb0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f4cf0005fd0 tx=0x7f4cf002a580 comp rx=0 tx=0).stop 2024-09-17T05:46:37.858 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:37.856+0000 7f4d04e8b640 1 -- 172.21.15.150:0/2427470530 shutdown_connections 2024-09-17T05:46:37.858 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:37.856+0000 7f4d04e8b640 1 --2- 172.21.15.150:0/2427470530 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4d0015c9a0 0x7f4d0006ddb0 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:37.858 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:37.856+0000 7f4d04e8b640 1 -- 172.21.15.150:0/2427470530 >> 172.21.15.150:0/2427470530 conn(0x7f4d00073870 msgr2=0x7f4d00073c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:46:37.859 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:37.856+0000 7f4d04e8b640 1 -- 172.21.15.150:0/2427470530 shutdown_connections 2024-09-17T05:46:37.861 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:37.857+0000 7f4d04e8b640 1 -- 172.21.15.150:0/2427470530 wait complete. 2024-09-17T05:46:37.861 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:37.860+0000 7f4d04e8b640 1 Processor -- start 2024-09-17T05:46:37.862 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:37.860+0000 7f4d04e8b640 1 -- start start 2024-09-17T05:46:37.866 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:37.862+0000 7f4d04e8b640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4d0006e2f0 0x7f4d0014e200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:46:37.866 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:37.862+0000 7f4d04e8b640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4d001529b0 0x7f4d001455e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:46:37.867 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:37.862+0000 7f4d04e8b640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4d0015c9a0 0x7f4d00145b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:46:37.867 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:37.862+0000 7f4d04e8b640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f4d000d0200 con 0x7f4d0015c9a0 2024-09-17T05:46:37.867 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:37.862+0000 7f4d04e8b640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f4d000d0080 con 0x7f4d001529b0 2024-09-17T05:46:37.867 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:37.862+0000 7f4d04e8b640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f4d000d0380 con 0x7f4d0006e2f0 2024-09-17T05:46:37.867 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:37.863+0000 7f4cfdd9b640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4d001529b0 0x7f4d001455e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:46:37.867 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:37.863+0000 7f4cfdd9b640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4d001529b0 0x7f4d001455e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3300/0 says I am v2:172.21.15.150:53600/0 (socket says 172.21.15.150:53600) 2024-09-17T05:46:37.867 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:37.863+0000 7f4cfdd9b640 1 -- 172.21.15.150:0/940992095 learned_addr learned my addr 172.21.15.150:0/940992095 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:46:37.867 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:37.863+0000 7f4cfed9d640 1 --2- 172.21.15.150:0/940992095 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4d0015c9a0 0x7f4d00145b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:46:37.867 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:37.863+0000 7f4cfe59c640 1 --2- 172.21.15.150:0/940992095 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4d0006e2f0 0x7f4d0014e200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:46:37.867 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:37.863+0000 7f4cfdd9b640 1 -- 172.21.15.150:0/940992095 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4d0006e2f0 msgr2=0x7f4d0014e200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:46:37.867 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:37.863+0000 7f4cfdd9b640 1 --2- 172.21.15.150:0/940992095 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4d0006e2f0 0x7f4d0014e200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:37.867 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:37.863+0000 7f4cfdd9b640 1 -- 172.21.15.150:0/940992095 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4d0015c9a0 msgr2=0x7f4d00145b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:46:37.867 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:37.863+0000 7f4cfdd9b640 1 --2- 172.21.15.150:0/940992095 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4d0015c9a0 0x7f4d00145b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:37.868 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:37.863+0000 7f4cfdd9b640 1 -- 172.21.15.150:0/940992095 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4d0012db90 con 0x7f4d001529b0 2024-09-17T05:46:37.868 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:37.864+0000 7f4cfed9d640 1 --2- 172.21.15.150:0/940992095 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4d0015c9a0 0x7f4d00145b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T05:46:37.868 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:37.864+0000 7f4cfdd9b640 1 --2- 172.21.15.150:0/940992095 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4d001529b0 0x7f4d001455e0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f4cf0034040 tx=0x7f4cf0003910 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:46:37.868 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:37.864+0000 7f4ceeffd640 1 -- 172.21.15.150:0/940992095 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4cf0035040 con 0x7f4d001529b0 2024-09-17T05:46:37.868 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:37.864+0000 7f4d04e8b640 1 -- 172.21.15.150:0/940992095 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4d0015e5f0 con 0x7f4d001529b0 2024-09-17T05:46:37.868 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:37.864+0000 7f4d04e8b640 1 -- 172.21.15.150:0/940992095 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4d0015e890 con 0x7f4d001529b0 2024-09-17T05:46:37.868 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:37.864+0000 7f4ceeffd640 1 -- 172.21.15.150:0/940992095 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f4cf0003d00 con 0x7f4d001529b0 2024-09-17T05:46:37.868 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:37.865+0000 7f4ceeffd640 1 -- 172.21.15.150:0/940992095 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4cf0040d50 con 0x7f4d001529b0 2024-09-17T05:46:37.868 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:37.866+0000 7f4d04e8b640 1 -- 172.21.15.150:0/940992095 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4ce4005290 con 0x7f4d001529b0 2024-09-17T05:46:37.869 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:37.867+0000 7f4ceeffd640 1 -- 172.21.15.150:0/940992095 <== mon.1 v2:172.21.15.176:3300/0 4 ==== mgrmap(e 19) ==== 102563+0+0 (secure 0 0 0) 0x7f4cf00047a0 con 0x7f4d001529b0 2024-09-17T05:46:37.869 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:37.868+0000 7f4ceeffd640 1 --2- 172.21.15.150:0/940992095 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f4ce00798f0 0x7f4ce007be00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:46:37.870 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:37.868+0000 7f4ceeffd640 1 -- 172.21.15.150:0/940992095 <== mon.1 v2:172.21.15.176:3300/0 5 ==== osd_map(60..60 src has 1..60) ==== 5737+0+0 (secure 0 0 0) 0x7f4cf00c2ad0 con 0x7f4d001529b0 2024-09-17T05:46:37.870 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:37.868+0000 7f4cfe59c640 1 --2- 172.21.15.150:0/940992095 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f4ce00798f0 0x7f4ce007be00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:46:37.871 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:37.869+0000 7f4cfe59c640 1 --2- 172.21.15.150:0/940992095 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f4ce00798f0 0x7f4ce007be00 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f4cf8001e20 tx=0x7f4cf8009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:46:37.877 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:37.876+0000 7f4ceeffd640 1 -- 172.21.15.150:0/940992095 <== mon.1 v2:172.21.15.176:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f4cf008c090 con 0x7f4d001529b0 2024-09-17T05:46:38.106 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:38.105+0000 7f4d04e8b640 1 -- 172.21.15.150:0/940992095 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f4ce4005850 con 0x7f4d001529b0 2024-09-17T05:46:38.108 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:38.106+0000 7f4ceeffd640 1 -- 172.21.15.150:0/940992095 <== mon.1 v2:172.21.15.176:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v61) ==== 74+0+16913 (secure 0 0 0) 0x7f4cf0090ac0 con 0x7f4d001529b0 2024-09-17T05:46:38.108 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-09-17T05:46:38.108 INFO:teuthology.orchestra.run.smithi150.stdout:{"epoch":61,"fsid":"9f2e05e9-d629-47b3-b26b-1360655b7d20","created":"2024-09-17T05:41:32.502979+0000","modified":"2024-09-17T05:46:37.893684+0000","last_up_change":"2024-09-17T05:41:46.150225+0000","last_in_change":"2024-09-17T05:41:36.120274+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T05:41:46.860779+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2024-09-17T05:45:29.646151+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"59","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_data","create_time":"2024-09-17T05:45:30.948666+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"61","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":3,"snap_epoch":61,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"4f31c018-c8a4-4d6d-b0c2-a597c47aae4a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6800","nonce":479374392},{"type":"v1","addr":"172.21.15.150:6801","nonce":479374392}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6802","nonce":479374392},{"type":"v1","addr":"172.21.15.150:6803","nonce":479374392}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6806","nonce":479374392},{"type":"v1","addr":"172.21.15.150:6807","nonce":479374392}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6804","nonce":479374392},{"type":"v1","addr":"172.21.15.150:6805","nonce":479374392}]},"public_addr":"172.21.15.150:6801/479374392","cluster_addr":"172.21.15.150:6803/479374392","heartbeat_back_addr":"172.21.15.150:6807/479374392","heartbeat_front_addr":"172.21.15.150:6805/479374392","state":["exists","up"]},{"osd":1,"uuid":"6ff4a573-500b-4e04-9de3-39265ead78b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6824","nonce":913899800},{"type":"v1","addr":"172.21.15.150:6825","nonce":913899800}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6826","nonce":913899800},{"type":"v1","addr":"172.21.15.150:6827","nonce":913899800}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6830","nonce":913899800},{"type":"v1","addr":"172.21.15.150:6831","nonce":913899800}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6828","nonce":913899800},{"type":"v1","addr":"172.21.15.150:6829","nonce":913899800}]},"public_addr":"172.21.15.150:6825/913899800","cluster_addr":"172.21.15.150:6827/913899800","heartbeat_back_addr":"172.21.15.150:6831/913899800","heartbeat_front_addr":"172.21.15.150:6829/913899800","state":["exists","up"]},{"osd":2,"uuid":"bffea6f9-2465-4182-b205-00436c41ac1c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6816","nonce":363718461},{"type":"v1","addr":"172.21.15.150:6817","nonce":363718461}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6818","nonce":363718461},{"type":"v1","addr":"172.21.15.150:6819","nonce":363718461}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6822","nonce":363718461},{"type":"v1","addr":"172.21.15.150:6823","nonce":363718461}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6820","nonce":363718461},{"type":"v1","addr":"172.21.15.150:6821","nonce":363718461}]},"public_addr":"172.21.15.150:6817/363718461","cluster_addr":"172.21.15.150:6819/363718461","heartbeat_back_addr":"172.21.15.150:6823/363718461","heartbeat_front_addr":"172.21.15.150:6821/363718461","state":["exists","up"]},{"osd":3,"uuid":"cda70430-d1e1-427e-b04e-56db4031d078","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6808","nonce":3550994626},{"type":"v1","addr":"172.21.15.150:6809","nonce":3550994626}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6810","nonce":3550994626},{"type":"v1","addr":"172.21.15.150:6811","nonce":3550994626}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6814","nonce":3550994626},{"type":"v1","addr":"172.21.15.150:6815","nonce":3550994626}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6812","nonce":3550994626},{"type":"v1","addr":"172.21.15.150:6813","nonce":3550994626}]},"public_addr":"172.21.15.150:6809/3550994626","cluster_addr":"172.21.15.150:6811/3550994626","heartbeat_back_addr":"172.21.15.150:6815/3550994626","heartbeat_front_addr":"172.21.15.150:6813/3550994626","state":["exists","up"]},{"osd":4,"uuid":"3a0277fb-5e1e-4f68-bb2d-9a8a0152f64a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6810","nonce":2718261497},{"type":"v1","addr":"172.21.15.176:6811","nonce":2718261497}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6812","nonce":2718261497},{"type":"v1","addr":"172.21.15.176:6813","nonce":2718261497}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6816","nonce":2718261497},{"type":"v1","addr":"172.21.15.176:6817","nonce":2718261497}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6814","nonce":2718261497},{"type":"v1","addr":"172.21.15.176:6815","nonce":2718261497}]},"public_addr":"172.21.15.176:6811/2718261497","cluster_addr":"172.21.15.176:6813/2718261497","heartbeat_back_addr":"172.21.15.176:6817/2718261497","heartbeat_front_addr":"172.21.15.176:6815/2718261497","state":["exists","up"]},{"osd":5,"uuid":"33aebee6-0315-40b7-a11c-6702f0be494d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6818","nonce":2049295774},{"type":"v1","addr":"172.21.15.176:6819","nonce":2049295774}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6820","nonce":2049295774},{"type":"v1","addr":"172.21.15.176:6821","nonce":2049295774}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6824","nonce":2049295774},{"type":"v1","addr":"172.21.15.176:6825","nonce":2049295774}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6822","nonce":2049295774},{"type":"v1","addr":"172.21.15.176:6823","nonce":2049295774}]},"public_addr":"172.21.15.176:6819/2049295774","cluster_addr":"172.21.15.176:6821/2049295774","heartbeat_back_addr":"172.21.15.176:6825/2049295774","heartbeat_front_addr":"172.21.15.176:6823/2049295774","state":["exists","up"]},{"osd":6,"uuid":"4d24f360-6751-4263-841b-d77793d33540","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6826","nonce":2164458476},{"type":"v1","addr":"172.21.15.176:6827","nonce":2164458476}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6828","nonce":2164458476},{"type":"v1","addr":"172.21.15.176:6829","nonce":2164458476}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6832","nonce":2164458476},{"type":"v1","addr":"172.21.15.176:6833","nonce":2164458476}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6830","nonce":2164458476},{"type":"v1","addr":"172.21.15.176:6831","nonce":2164458476}]},"public_addr":"172.21.15.176:6827/2164458476","cluster_addr":"172.21.15.176:6829/2164458476","heartbeat_back_addr":"172.21.15.176:6833/2164458476","heartbeat_front_addr":"172.21.15.176:6831/2164458476","state":["exists","up"]},{"osd":7,"uuid":"c8594fda-c74a-4ba9-8277-caf101d58ca1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6802","nonce":3239587708},{"type":"v1","addr":"172.21.15.176:6803","nonce":3239587708}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6804","nonce":3239587708},{"type":"v1","addr":"172.21.15.176:6805","nonce":3239587708}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6808","nonce":3239587708},{"type":"v1","addr":"172.21.15.176:6809","nonce":3239587708}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6806","nonce":3239587708},{"type":"v1","addr":"172.21.15.176:6807","nonce":3239587708}]},"public_addr":"172.21.15.176:6803/3239587708","cluster_addr":"172.21.15.176:6805/3239587708","heartbeat_back_addr":"172.21.15.176:6809/3239587708","heartbeat_front_addr":"172.21.15.176:6807/3239587708","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:41:41.905151+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:41:42.705679+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:41:42.459673+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:41:42.440819+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:41:42.668428+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:41:42.694972+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:41:43.078535+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:41:42.363539+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":7,"snaps":[{"begin":2,"length":2}]},{"pool":9,"snaps":[{"begin":2,"length":2}]}],"new_removed_snaps":[{"pool":9,"snaps":[{"begin":2,"length":2}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T05:46:38.110 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:38.108+0000 7f4d04e8b640 1 -- 172.21.15.150:0/940992095 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f4ce00798f0 msgr2=0x7f4ce007be00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:46:38.110 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:38.108+0000 7f4d04e8b640 1 --2- 172.21.15.150:0/940992095 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f4ce00798f0 0x7f4ce007be00 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f4cf8001e20 tx=0x7f4cf8009040 comp rx=0 tx=0).stop 2024-09-17T05:46:38.111 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:38.108+0000 7f4d04e8b640 1 -- 172.21.15.150:0/940992095 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4d001529b0 msgr2=0x7f4d001455e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:46:38.111 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:38.108+0000 7f4d04e8b640 1 --2- 172.21.15.150:0/940992095 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4d001529b0 0x7f4d001455e0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f4cf0034040 tx=0x7f4cf0003910 comp rx=0 tx=0).stop 2024-09-17T05:46:38.111 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:38.109+0000 7f4d04e8b640 1 -- 172.21.15.150:0/940992095 shutdown_connections 2024-09-17T05:46:38.111 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:38.109+0000 7f4d04e8b640 1 --2- 172.21.15.150:0/940992095 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4d001529b0 0x7f4d001455e0 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:38.111 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:38.109+0000 7f4d04e8b640 1 --2- 172.21.15.150:0/940992095 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f4ce00798f0 0x7f4ce007be00 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:38.111 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:38.109+0000 7f4d04e8b640 1 --2- 172.21.15.150:0/940992095 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4d0015c9a0 0x7f4d00145b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:38.111 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:38.109+0000 7f4d04e8b640 1 --2- 172.21.15.150:0/940992095 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4d0006e2f0 0x7f4d0014e200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:38.111 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:38.109+0000 7f4d04e8b640 1 -- 172.21.15.150:0/940992095 >> 172.21.15.150:0/940992095 conn(0x7f4d00073870 msgr2=0x7f4d00143f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:46:38.111 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:38.109+0000 7f4d04e8b640 1 -- 172.21.15.150:0/940992095 shutdown_connections 2024-09-17T05:46:38.111 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:38.109+0000 7f4d04e8b640 1 -- 172.21.15.150:0/940992095 wait complete. 2024-09-17T05:46:38.122 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-09-17T05:46:38.123 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T05:46:38.237 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:38.236+0000 7fbb7724d640 1 -- 172.21.15.150:0/3208500583 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbb58003fb0 msgr2=0x7fbb58004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:46:38.238 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:38.236+0000 7fbb7724d640 1 --2- 172.21.15.150:0/3208500583 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbb58003fb0 0x7fbb58004800 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x7fbb64009d20 tx=0x7fbb58005830 comp rx=0 tx=0).stop 2024-09-17T05:46:38.238 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:38.236+0000 7fbb757ea640 1 -- 172.21.15.150:0/3208500583 reap_dead start 2024-09-17T05:46:38.238 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:38.236+0000 7fbb7724d640 1 -- 172.21.15.150:0/3208500583 shutdown_connections 2024-09-17T05:46:38.238 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:38.236+0000 7fbb7724d640 1 -- 172.21.15.150:0/3208500583 >> 172.21.15.150:0/3208500583 conn(0x7fbb700b2fd0 msgr2=0x7fbb700b33e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:46:38.238 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:38.236+0000 7fbb7724d640 1 -- 172.21.15.150:0/3208500583 shutdown_connections 2024-09-17T05:46:38.238 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:38.236+0000 7fbb7724d640 1 -- 172.21.15.150:0/3208500583 wait complete. 2024-09-17T05:46:38.239 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:38.237+0000 7fbb7724d640 1 Processor -- start 2024-09-17T05:46:38.239 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:38.237+0000 7fbb7724d640 1 -- start start 2024-09-17T05:46:38.241 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:38.239+0000 7fbb7724d640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fbb58003fb0 0x7fbb701553e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:46:38.242 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:38.239+0000 7fbb7724d640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbb700cb1a0 0x7fbb701e8860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:46:38.242 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:38.239+0000 7fbb7724d640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fbb700cb5b0 0x7fbb701e8da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:46:38.242 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:38.239+0000 7fbb7724d640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7fbb7015cbd0 con 0x7fbb700cb1a0 2024-09-17T05:46:38.242 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:38.239+0000 7fbb7724d640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fbb7015ca50 con 0x7fbb58003fb0 2024-09-17T05:46:38.242 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:38.239+0000 7fbb7724d640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fbb7015cd50 con 0x7fbb700cb5b0 2024-09-17T05:46:38.242 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:38.239+0000 7fbb6ffff640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbb700cb1a0 0x7fbb701e8860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:46:38.242 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:38.239+0000 7fbb6ffff640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbb700cb1a0 0x7fbb701e8860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:35326/0 (socket says 172.21.15.150:35326) 2024-09-17T05:46:38.242 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:38.239+0000 7fbb6ffff640 1 -- 172.21.15.150:0/3594709275 learned_addr learned my addr 172.21.15.150:0/3594709275 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:46:38.242 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:38.239+0000 7fbb757ea640 1 --2- 172.21.15.150:0/3594709275 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fbb700cb5b0 0x7fbb701e8da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:46:38.243 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:38.239+0000 7fbb74fe9640 1 --2- 172.21.15.150:0/3594709275 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fbb58003fb0 0x7fbb701553e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:46:38.243 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:38.239+0000 7fbb6ffff640 1 -- 172.21.15.150:0/3594709275 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fbb700cb5b0 msgr2=0x7fbb701e8da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:46:38.243 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:38.239+0000 7fbb6ffff640 1 --2- 172.21.15.150:0/3594709275 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fbb700cb5b0 0x7fbb701e8da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:38.243 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:38.239+0000 7fbb6ffff640 1 -- 172.21.15.150:0/3594709275 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fbb58003fb0 msgr2=0x7fbb701553e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:46:38.243 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:38.239+0000 7fbb6ffff640 1 --2- 172.21.15.150:0/3594709275 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fbb58003fb0 0x7fbb701553e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:38.243 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:38.239+0000 7fbb6ffff640 1 -- 172.21.15.150:0/3594709275 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbb701e60d0 con 0x7fbb700cb1a0 2024-09-17T05:46:38.243 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:38.239+0000 7fbb6ffff640 1 --2- 172.21.15.150:0/3594709275 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbb700cb1a0 0x7fbb701e8860 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 crypto rx=0x7fbb6402b6b0 tx=0x7fbb64003820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:46:38.243 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:38.240+0000 7fbb6d7fa640 1 -- 172.21.15.150:0/3594709275 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb64042030 con 0x7fbb700cb1a0 2024-09-17T05:46:38.243 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:38.240+0000 7fbb6d7fa640 1 -- 172.21.15.150:0/3594709275 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fbb6402ba80 con 0x7fbb700cb1a0 2024-09-17T05:46:38.243 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:38.240+0000 7fbb7724d640 1 -- 172.21.15.150:0/3594709275 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbb701f3550 con 0x7fbb700cb1a0 2024-09-17T05:46:38.243 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:38.240+0000 7fbb6d7fa640 1 -- 172.21.15.150:0/3594709275 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb64003c20 con 0x7fbb700cb1a0 2024-09-17T05:46:38.243 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:38.240+0000 7fbb7724d640 1 -- 172.21.15.150:0/3594709275 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbb701f3b10 con 0x7fbb700cb1a0 2024-09-17T05:46:38.244 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:38.241+0000 7fbb7724d640 1 -- 172.21.15.150:0/3594709275 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbb7015c060 con 0x7fbb700cb1a0 2024-09-17T05:46:38.244 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:38.241+0000 7fbb6d7fa640 1 -- 172.21.15.150:0/3594709275 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 19) ==== 102563+0+0 (secure 0 0 0) 0x7fbb64045070 con 0x7fbb700cb1a0 2024-09-17T05:46:38.244 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:38.242+0000 7fbb6d7fa640 1 --2- 172.21.15.150:0/3594709275 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fbb5c0797f0 0x7fbb5c07bd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:46:38.245 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:38.242+0000 7fbb6d7fa640 1 -- 172.21.15.150:0/3594709275 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(61..61 src has 1..61) ==== 5793+0+0 (secure 0 0 0) 0x7fbb640ba340 con 0x7fbb700cb1a0 2024-09-17T05:46:38.245 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:38.242+0000 7fbb74fe9640 1 --2- 172.21.15.150:0/3594709275 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fbb5c0797f0 0x7fbb5c07bd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:46:38.245 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:38.243+0000 7fbb74fe9640 1 --2- 172.21.15.150:0/3594709275 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fbb5c0797f0 0x7fbb5c07bd00 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7fbb60001eb0 tx=0x7fbb60000ed0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:46:38.248 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:38.247+0000 7fbb6d7fa640 1 -- 172.21.15.150:0/3594709275 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fbb6404c060 con 0x7fbb700cb1a0 2024-09-17T05:46:38.457 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:38.455+0000 7fbb7724d640 1 -- 172.21.15.150:0/3594709275 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fbb70156530 con 0x7fbb700cb1a0 2024-09-17T05:46:38.458 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:38.456+0000 7fbb6d7fa640 1 -- 172.21.15.150:0/3594709275 <== mon.0 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 34 v34) ==== 94+0+5235 (secure 0 0 0) 0x7fbb64084230 con 0x7fbb700cb1a0 2024-09-17T05:46:38.458 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-09-17T05:46:38.458 INFO:teuthology.orchestra.run.smithi150.stdout:{"epoch":34,"btime":"2024-09-17T05:45:44:972475+0000","default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5692,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6836/2204030245","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6834","nonce":2204030245},{"type":"v1","addr":"172.21.15.176:6836","nonce":2204030245}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":29},{"gid":5695,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6837/4065519712","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6835","nonce":4065519712},{"type":"v1","addr":"172.21.15.176:6837","nonce":4065519712}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":29},{"gid":6006,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6834/3602763503","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6832","nonce":3602763503},{"type":"v1","addr":"172.21.15.150:6834","nonce":3602763503}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":29}],"filesystems":[{"mdsmap":{"epoch":33,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T05:45:31.989014+0000","modified":"2024-09-17T05:45:35.004451+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6009},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6009":{"gid":6009,"name":"a","rank":0,"incarnation":30,"state":"up:active","state_seq":3,"addr":"172.21.15.150:6835/3434025708","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6833","nonce":3434025708},{"type":"v1","addr":"172.21.15.150:6835","nonce":3434025708}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6009,"qdb_cluster":[6009]},"id":4}]} 2024-09-17T05:46:38.458 INFO:teuthology.orchestra.run.smithi150.stderr:dumped fsmap epoch 34 2024-09-17T05:46:38.460 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:38.458+0000 7fbb7724d640 1 -- 172.21.15.150:0/3594709275 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fbb5c0797f0 msgr2=0x7fbb5c07bd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:46:38.460 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:38.458+0000 7fbb7724d640 1 --2- 172.21.15.150:0/3594709275 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fbb5c0797f0 0x7fbb5c07bd00 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7fbb60001eb0 tx=0x7fbb60000ed0 comp rx=0 tx=0).stop 2024-09-17T05:46:38.461 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:38.458+0000 7fbb7724d640 1 -- 172.21.15.150:0/3594709275 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbb700cb1a0 msgr2=0x7fbb701e8860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:46:38.461 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:38.458+0000 7fbb7724d640 1 --2- 172.21.15.150:0/3594709275 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbb700cb1a0 0x7fbb701e8860 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 crypto rx=0x7fbb6402b6b0 tx=0x7fbb64003820 comp rx=0 tx=0).stop 2024-09-17T05:46:38.461 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:38.458+0000 7fbb7724d640 1 -- 172.21.15.150:0/3594709275 shutdown_connections 2024-09-17T05:46:38.461 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:38.458+0000 7fbb7724d640 1 --2- 172.21.15.150:0/3594709275 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fbb5c0797f0 0x7fbb5c07bd00 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:38.461 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:38.458+0000 7fbb7724d640 1 --2- 172.21.15.150:0/3594709275 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fbb700cb5b0 0x7fbb701e8da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:38.461 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:38.458+0000 7fbb7724d640 1 --2- 172.21.15.150:0/3594709275 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbb700cb1a0 0x7fbb701e8860 unknown :-1 s=CLOSED pgs=723 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:38.461 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:38.458+0000 7fbb7724d640 1 --2- 172.21.15.150:0/3594709275 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fbb58003fb0 0x7fbb701553e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:38.461 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:38.458+0000 7fbb7724d640 1 -- 172.21.15.150:0/3594709275 >> 172.21.15.150:0/3594709275 conn(0x7fbb700b2fd0 msgr2=0x7fbb700b15e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:46:38.461 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:38.459+0000 7fbb7724d640 1 -- 172.21.15.150:0/3594709275 shutdown_connections 2024-09-17T05:46:38.461 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:38.459+0000 7fbb7724d640 1 -- 172.21.15.150:0/3594709275 wait complete. 2024-09-17T05:46:38.473 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T05:46:38.589 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:38.587+0000 7f01ef04d640 1 -- 172.21.15.150:0/3765107783 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f01e80b9780 msgr2=0x7f01e80b3720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:46:38.589 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:38.587+0000 7f01ef04d640 1 --2- 172.21.15.150:0/3765107783 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f01e80b9780 0x7f01e80b3720 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 crypto rx=0x7f01e80d5740 tx=0x7f01d802a4a0 comp rx=0 tx=0).stop 2024-09-17T05:46:38.589 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:38.587+0000 7f01ef04d640 1 -- 172.21.15.150:0/3765107783 shutdown_connections 2024-09-17T05:46:38.589 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:38.587+0000 7f01ef04d640 1 --2- 172.21.15.150:0/3765107783 >> v2:172.21.15.176:3300/0 conn(0x7f01e80d17a0 0x7f01e80cf470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:38.589 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:38.587+0000 7f01ef04d640 1 --2- 172.21.15.150:0/3765107783 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f01e80b9780 0x7f01e80b3720 unknown :-1 s=CLOSED pgs=725 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:38.589 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:38.587+0000 7f01ef04d640 1 -- 172.21.15.150:0/3765107783 >> 172.21.15.150:0/3765107783 conn(0x7f01e80d4680 msgr2=0x7f01e80d4a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:46:38.589 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:38.587+0000 7f01ef04d640 1 -- 172.21.15.150:0/3765107783 shutdown_connections 2024-09-17T05:46:38.590 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:38.587+0000 7f01ef04d640 1 -- 172.21.15.150:0/3765107783 wait complete. 2024-09-17T05:46:38.590 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:38.589+0000 7f01ef04d640 1 Processor -- start 2024-09-17T05:46:38.590 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:38.589+0000 7f01ef04d640 1 -- start start 2024-09-17T05:46:38.593 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:38.590+0000 7f01ef04d640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f01e80b9780 0x7f01e81546f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:46:38.594 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:38.590+0000 7f01ef04d640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f01e815ee50 0x7f01e80b24d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:46:38.594 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:38.590+0000 7f01ef04d640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f01e81447a0 0x7f01e80b2a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:46:38.594 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:38.590+0000 7f01ef04d640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f01e80cfd40 con 0x7f01e81447a0 2024-09-17T05:46:38.594 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:38.590+0000 7f01ef04d640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f01e80cfbc0 con 0x7f01e815ee50 2024-09-17T05:46:38.594 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:38.590+0000 7f01ef04d640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f01e80cfec0 con 0x7f01e80b9780 2024-09-17T05:46:38.594 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:38.590+0000 7f01ed5ea640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f01e81447a0 0x7f01e80b2a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:46:38.594 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:38.590+0000 7f01ed5ea640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f01e81447a0 0x7f01e80b2a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:35344/0 (socket says 172.21.15.150:35344) 2024-09-17T05:46:38.594 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:38.590+0000 7f01ed5ea640 1 -- 172.21.15.150:0/2970092496 learned_addr learned my addr 172.21.15.150:0/2970092496 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:46:38.594 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:38.590+0000 7f01e7fff640 1 --2- 172.21.15.150:0/2970092496 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f01e815ee50 0x7f01e80b24d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:46:38.594 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:38.590+0000 7f01ecde9640 1 --2- 172.21.15.150:0/2970092496 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f01e80b9780 0x7f01e81546f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:46:38.594 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:38.590+0000 7f01ed5ea640 1 -- 172.21.15.150:0/2970092496 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f01e80b9780 msgr2=0x7f01e81546f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:46:38.594 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:38.590+0000 7f01ed5ea640 1 --2- 172.21.15.150:0/2970092496 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f01e80b9780 0x7f01e81546f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:38.594 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:38.590+0000 7f01ed5ea640 1 -- 172.21.15.150:0/2970092496 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f01e815ee50 msgr2=0x7f01e80b24d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:46:38.595 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:38.590+0000 7f01ed5ea640 1 --2- 172.21.15.150:0/2970092496 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f01e815ee50 0x7f01e80b24d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:38.595 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:38.590+0000 7f01ed5ea640 1 -- 172.21.15.150:0/2970092496 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f01e80b1450 con 0x7f01e81447a0 2024-09-17T05:46:38.595 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:38.590+0000 7f01e7fff640 1 --2- 172.21.15.150:0/2970092496 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f01e815ee50 0x7f01e80b24d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:46:38.595 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:38.591+0000 7f01ed5ea640 1 --2- 172.21.15.150:0/2970092496 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f01e81447a0 0x7f01e80b2a10 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 crypto rx=0x7f01e000cab0 tx=0x7f01e000cf70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:46:38.595 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:38.591+0000 7f01e57fa640 1 -- 172.21.15.150:0/2970092496 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01e0007d90 con 0x7f01e81447a0 2024-09-17T05:46:38.595 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:38.591+0000 7f01e57fa640 1 -- 172.21.15.150:0/2970092496 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f01e000f560 con 0x7f01e81447a0 2024-09-17T05:46:38.595 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:38.591+0000 7f01ef04d640 1 -- 172.21.15.150:0/2970092496 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f01e81f5b20 con 0x7f01e81447a0 2024-09-17T05:46:38.595 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:38.591+0000 7f01e57fa640 1 -- 172.21.15.150:0/2970092496 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01e000f9b0 con 0x7f01e81447a0 2024-09-17T05:46:38.595 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:38.591+0000 7f01ef04d640 1 -- 172.21.15.150:0/2970092496 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f01e80b19f0 con 0x7f01e81447a0 2024-09-17T05:46:38.595 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:38.592+0000 7f01ef04d640 1 -- 172.21.15.150:0/2970092496 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f01e808d100 con 0x7f01e81447a0 2024-09-17T05:46:38.596 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:38.592+0000 7f01e57fa640 1 -- 172.21.15.150:0/2970092496 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 19) ==== 102563+0+0 (secure 0 0 0) 0x7f01e000fb50 con 0x7f01e81447a0 2024-09-17T05:46:38.596 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:38.593+0000 7f01e57fa640 1 --2- 172.21.15.150:0/2970092496 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f01d4079820 0x7f01d407bd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:46:38.596 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:38.593+0000 7f01e57fa640 1 -- 172.21.15.150:0/2970092496 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(61..61 src has 1..61) ==== 5793+0+0 (secure 0 0 0) 0x7f01e009a130 con 0x7f01e81447a0 2024-09-17T05:46:38.596 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:38.593+0000 7f01ecde9640 1 --2- 172.21.15.150:0/2970092496 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f01d4079820 0x7f01d407bd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:46:38.596 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:38.594+0000 7f01ecde9640 1 --2- 172.21.15.150:0/2970092496 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f01d4079820 0x7f01d407bd30 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f01d8034000 tx=0x7f01d8004730 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:46:38.599 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:38.597+0000 7f01e57fa640 1 -- 172.21.15.150:0/2970092496 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f01e808d100 con 0x7f01e81447a0 2024-09-17T05:46:38.813 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:38.811+0000 7f01ef04d640 1 -- 172.21.15.150:0/2970092496 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f01e80d1e90 con 0x7f01e81447a0 2024-09-17T05:46:38.814 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:38.812+0000 7f01e57fa640 1 -- 172.21.15.150:0/2970092496 <== mon.0 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 34 v34) ==== 94+0+5235 (secure 0 0 0) 0x7f01e0014070 con 0x7f01e81447a0 2024-09-17T05:46:38.814 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-09-17T05:46:38.814 INFO:teuthology.orchestra.run.smithi150.stdout:{"epoch":34,"btime":"2024-09-17T05:45:44:972475+0000","default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5692,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6836/2204030245","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6834","nonce":2204030245},{"type":"v1","addr":"172.21.15.176:6836","nonce":2204030245}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":29},{"gid":5695,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6837/4065519712","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6835","nonce":4065519712},{"type":"v1","addr":"172.21.15.176:6837","nonce":4065519712}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":29},{"gid":6006,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6834/3602763503","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6832","nonce":3602763503},{"type":"v1","addr":"172.21.15.150:6834","nonce":3602763503}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":29}],"filesystems":[{"mdsmap":{"epoch":33,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T05:45:31.989014+0000","modified":"2024-09-17T05:45:35.004451+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6009},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6009":{"gid":6009,"name":"a","rank":0,"incarnation":30,"state":"up:active","state_seq":3,"addr":"172.21.15.150:6835/3434025708","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6833","nonce":3434025708},{"type":"v1","addr":"172.21.15.150:6835","nonce":3434025708}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6009,"qdb_cluster":[6009]},"id":4}]} 2024-09-17T05:46:38.814 INFO:teuthology.orchestra.run.smithi150.stderr:dumped fsmap epoch 34 2024-09-17T05:46:38.816 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:38.814+0000 7f01ef04d640 1 -- 172.21.15.150:0/2970092496 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f01d4079820 msgr2=0x7f01d407bd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:46:38.817 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:38.815+0000 7f01ef04d640 1 --2- 172.21.15.150:0/2970092496 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f01d4079820 0x7f01d407bd30 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f01d8034000 tx=0x7f01d8004730 comp rx=0 tx=0).stop 2024-09-17T05:46:38.817 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:38.815+0000 7f01ef04d640 1 -- 172.21.15.150:0/2970092496 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f01e81447a0 msgr2=0x7f01e80b2a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:46:38.817 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:38.815+0000 7f01ef04d640 1 --2- 172.21.15.150:0/2970092496 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f01e81447a0 0x7f01e80b2a10 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 crypto rx=0x7f01e000cab0 tx=0x7f01e000cf70 comp rx=0 tx=0).stop 2024-09-17T05:46:38.817 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:38.815+0000 7f01ef04d640 1 -- 172.21.15.150:0/2970092496 shutdown_connections 2024-09-17T05:46:38.817 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:38.815+0000 7f01ef04d640 1 --2- 172.21.15.150:0/2970092496 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f01e815ee50 0x7f01e80b24d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:38.817 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:38.815+0000 7f01ef04d640 1 --2- 172.21.15.150:0/2970092496 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f01d4079820 0x7f01d407bd30 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:38.817 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:38.815+0000 7f01ef04d640 1 --2- 172.21.15.150:0/2970092496 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f01e81447a0 0x7f01e80b2a10 unknown :-1 s=CLOSED pgs=726 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:38.817 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:38.815+0000 7f01ef04d640 1 --2- 172.21.15.150:0/2970092496 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f01e80b9780 0x7f01e81546f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:38.817 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:38.815+0000 7f01ef04d640 1 -- 172.21.15.150:0/2970092496 >> 172.21.15.150:0/2970092496 conn(0x7f01e80d4680 msgr2=0x7f01e815a0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:46:38.817 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:38.815+0000 7f01ef04d640 1 -- 172.21.15.150:0/2970092496 shutdown_connections 2024-09-17T05:46:38.818 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:38.815+0000 7f01ef04d640 1 -- 172.21.15.150:0/2970092496 wait complete. 2024-09-17T05:46:38.828 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T05:46:38.944 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:38.942+0000 7ff59ba30640 1 -- 172.21.15.150:0/3799066090 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff580003a30 msgr2=0x7ff580003ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:46:38.944 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:38.942+0000 7ff59ba30640 1 --2- 172.21.15.150:0/3799066090 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff580003a30 0x7ff580003ea0 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 crypto rx=0x7ff590009b40 tx=0x7ff580005830 comp rx=0 tx=0).stop 2024-09-17T05:46:38.945 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:38.942+0000 7ff599fcd640 1 -- 172.21.15.150:0/3799066090 reap_dead start 2024-09-17T05:46:38.945 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:38.942+0000 7ff59ba30640 1 -- 172.21.15.150:0/3799066090 shutdown_connections 2024-09-17T05:46:38.945 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:38.942+0000 7ff59ba30640 1 -- 172.21.15.150:0/3799066090 >> 172.21.15.150:0/3799066090 conn(0x7ff5940cee90 msgr2=0x7ff5940cf2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:46:38.945 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:38.942+0000 7ff59ba30640 1 -- 172.21.15.150:0/3799066090 shutdown_connections 2024-09-17T05:46:38.945 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:38.942+0000 7ff59ba30640 1 -- 172.21.15.150:0/3799066090 wait complete. 2024-09-17T05:46:38.945 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:38.944+0000 7ff59ba30640 1 Processor -- start 2024-09-17T05:46:38.946 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:38.944+0000 7ff59ba30640 1 -- start start 2024-09-17T05:46:38.949 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:38.945+0000 7ff59ba30640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff580003a30 0x7ff5941f7130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:46:38.949 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:38.945+0000 7ff59ba30640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff594151390 0x7ff5940b27e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:46:38.949 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:38.945+0000 7ff59ba30640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff594150dd0 0x7ff5940b2d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:46:38.949 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:38.945+0000 7ff59ba30640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7ff5940b74b0 con 0x7ff594150dd0 2024-09-17T05:46:38.949 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:38.945+0000 7ff59ba30640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7ff5940b7330 con 0x7ff580003a30 2024-09-17T05:46:38.949 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:38.945+0000 7ff59ba30640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7ff5940b7630 con 0x7ff594151390 2024-09-17T05:46:38.949 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:38.946+0000 7ff599fcd640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff594150dd0 0x7ff5940b2d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:46:38.949 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:38.946+0000 7ff599fcd640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff594150dd0 0x7ff5940b2d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:35360/0 (socket says 172.21.15.150:35360) 2024-09-17T05:46:38.949 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:38.946+0000 7ff599fcd640 1 -- 172.21.15.150:0/1423817213 learned_addr learned my addr 172.21.15.150:0/1423817213 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:46:38.950 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:38.946+0000 7ff598fcb640 1 --2- 172.21.15.150:0/1423817213 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff594151390 0x7ff5940b27e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:46:38.950 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:38.946+0000 7ff5997cc640 1 --2- 172.21.15.150:0/1423817213 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff580003a30 0x7ff5941f7130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:46:38.950 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:38.946+0000 7ff599fcd640 1 -- 172.21.15.150:0/1423817213 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff594151390 msgr2=0x7ff5940b27e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:46:38.950 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:38.946+0000 7ff599fcd640 1 --2- 172.21.15.150:0/1423817213 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff594151390 0x7ff5940b27e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:38.950 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:38.946+0000 7ff599fcd640 1 -- 172.21.15.150:0/1423817213 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff580003a30 msgr2=0x7ff5941f7130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:46:38.950 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:38.946+0000 7ff599fcd640 1 --2- 172.21.15.150:0/1423817213 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff580003a30 0x7ff5941f7130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:38.950 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:38.946+0000 7ff599fcd640 1 -- 172.21.15.150:0/1423817213 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff5941f7c10 con 0x7ff594150dd0 2024-09-17T05:46:38.950 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:38.946+0000 7ff599fcd640 1 --2- 172.21.15.150:0/1423817213 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff594150dd0 0x7ff5940b2d20 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x7ff59406a060 tx=0x7ff58c0064f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:46:38.950 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:38.946+0000 7ff589ffb640 1 -- 172.21.15.150:0/1423817213 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff58c011900 con 0x7ff594150dd0 2024-09-17T05:46:38.950 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:38.946+0000 7ff589ffb640 1 -- 172.21.15.150:0/1423817213 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff58c011aa0 con 0x7ff594150dd0 2024-09-17T05:46:38.950 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:38.946+0000 7ff59ba30640 1 -- 172.21.15.150:0/1423817213 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff5941e6fa0 con 0x7ff594150dd0 2024-09-17T05:46:38.951 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:38.946+0000 7ff589ffb640 1 -- 172.21.15.150:0/1423817213 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff58c0103c0 con 0x7ff594150dd0 2024-09-17T05:46:38.951 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:38.946+0000 7ff59ba30640 1 -- 172.21.15.150:0/1423817213 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff5941e7560 con 0x7ff594150dd0 2024-09-17T05:46:38.951 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:38.948+0000 7ff59ba30640 1 -- 172.21.15.150:0/1423817213 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff5940cffe0 con 0x7ff594150dd0 2024-09-17T05:46:38.951 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:38.948+0000 7ff589ffb640 1 -- 172.21.15.150:0/1423817213 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 19) ==== 102563+0+0 (secure 0 0 0) 0x7ff58c010560 con 0x7ff594150dd0 2024-09-17T05:46:38.952 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:38.949+0000 7ff589ffb640 1 --2- 172.21.15.150:0/1423817213 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7ff5780797f0 0x7ff57807bd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:46:38.952 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:38.949+0000 7ff589ffb640 1 -- 172.21.15.150:0/1423817213 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(61..61 src has 1..61) ==== 5793+0+0 (secure 0 0 0) 0x7ff58c099d70 con 0x7ff594150dd0 2024-09-17T05:46:38.952 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:38.949+0000 7ff5997cc640 1 --2- 172.21.15.150:0/1423817213 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7ff5780797f0 0x7ff57807bd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:46:38.952 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:38.950+0000 7ff5997cc640 1 --2- 172.21.15.150:0/1423817213 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7ff5780797f0 0x7ff57807bd00 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7ff590035000 tx=0x7ff59002d040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:46:38.955 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:38.954+0000 7ff589ffb640 1 -- 172.21.15.150:0/1423817213 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7ff58c063620 con 0x7ff594150dd0 2024-09-17T05:46:39.134 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:39.132+0000 7ff59ba30640 1 -- 172.21.15.150:0/1423817213 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7ff5941f79a0 con 0x7ff594150dd0 2024-09-17T05:46:39.134 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:39.133+0000 7ff589ffb640 1 -- 172.21.15.150:0/1423817213 <== mon.0 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v61) ==== 74+0+16913 (secure 0 0 0) 0x7ff58c068050 con 0x7ff594150dd0 2024-09-17T05:46:39.135 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-09-17T05:46:39.135 INFO:teuthology.orchestra.run.smithi150.stdout:{"epoch":61,"fsid":"9f2e05e9-d629-47b3-b26b-1360655b7d20","created":"2024-09-17T05:41:32.502979+0000","modified":"2024-09-17T05:46:37.893684+0000","last_up_change":"2024-09-17T05:41:46.150225+0000","last_in_change":"2024-09-17T05:41:36.120274+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T05:41:46.860779+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2024-09-17T05:45:29.646151+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"59","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_data","create_time":"2024-09-17T05:45:30.948666+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"61","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":3,"snap_epoch":61,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"4f31c018-c8a4-4d6d-b0c2-a597c47aae4a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6800","nonce":479374392},{"type":"v1","addr":"172.21.15.150:6801","nonce":479374392}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6802","nonce":479374392},{"type":"v1","addr":"172.21.15.150:6803","nonce":479374392}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6806","nonce":479374392},{"type":"v1","addr":"172.21.15.150:6807","nonce":479374392}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6804","nonce":479374392},{"type":"v1","addr":"172.21.15.150:6805","nonce":479374392}]},"public_addr":"172.21.15.150:6801/479374392","cluster_addr":"172.21.15.150:6803/479374392","heartbeat_back_addr":"172.21.15.150:6807/479374392","heartbeat_front_addr":"172.21.15.150:6805/479374392","state":["exists","up"]},{"osd":1,"uuid":"6ff4a573-500b-4e04-9de3-39265ead78b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6824","nonce":913899800},{"type":"v1","addr":"172.21.15.150:6825","nonce":913899800}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6826","nonce":913899800},{"type":"v1","addr":"172.21.15.150:6827","nonce":913899800}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6830","nonce":913899800},{"type":"v1","addr":"172.21.15.150:6831","nonce":913899800}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6828","nonce":913899800},{"type":"v1","addr":"172.21.15.150:6829","nonce":913899800}]},"public_addr":"172.21.15.150:6825/913899800","cluster_addr":"172.21.15.150:6827/913899800","heartbeat_back_addr":"172.21.15.150:6831/913899800","heartbeat_front_addr":"172.21.15.150:6829/913899800","state":["exists","up"]},{"osd":2,"uuid":"bffea6f9-2465-4182-b205-00436c41ac1c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6816","nonce":363718461},{"type":"v1","addr":"172.21.15.150:6817","nonce":363718461}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6818","nonce":363718461},{"type":"v1","addr":"172.21.15.150:6819","nonce":363718461}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6822","nonce":363718461},{"type":"v1","addr":"172.21.15.150:6823","nonce":363718461}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6820","nonce":363718461},{"type":"v1","addr":"172.21.15.150:6821","nonce":363718461}]},"public_addr":"172.21.15.150:6817/363718461","cluster_addr":"172.21.15.150:6819/363718461","heartbeat_back_addr":"172.21.15.150:6823/363718461","heartbeat_front_addr":"172.21.15.150:6821/363718461","state":["exists","up"]},{"osd":3,"uuid":"cda70430-d1e1-427e-b04e-56db4031d078","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6808","nonce":3550994626},{"type":"v1","addr":"172.21.15.150:6809","nonce":3550994626}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6810","nonce":3550994626},{"type":"v1","addr":"172.21.15.150:6811","nonce":3550994626}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6814","nonce":3550994626},{"type":"v1","addr":"172.21.15.150:6815","nonce":3550994626}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6812","nonce":3550994626},{"type":"v1","addr":"172.21.15.150:6813","nonce":3550994626}]},"public_addr":"172.21.15.150:6809/3550994626","cluster_addr":"172.21.15.150:6811/3550994626","heartbeat_back_addr":"172.21.15.150:6815/3550994626","heartbeat_front_addr":"172.21.15.150:6813/3550994626","state":["exists","up"]},{"osd":4,"uuid":"3a0277fb-5e1e-4f68-bb2d-9a8a0152f64a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6810","nonce":2718261497},{"type":"v1","addr":"172.21.15.176:6811","nonce":2718261497}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6812","nonce":2718261497},{"type":"v1","addr":"172.21.15.176:6813","nonce":2718261497}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6816","nonce":2718261497},{"type":"v1","addr":"172.21.15.176:6817","nonce":2718261497}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6814","nonce":2718261497},{"type":"v1","addr":"172.21.15.176:6815","nonce":2718261497}]},"public_addr":"172.21.15.176:6811/2718261497","cluster_addr":"172.21.15.176:6813/2718261497","heartbeat_back_addr":"172.21.15.176:6817/2718261497","heartbeat_front_addr":"172.21.15.176:6815/2718261497","state":["exists","up"]},{"osd":5,"uuid":"33aebee6-0315-40b7-a11c-6702f0be494d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6818","nonce":2049295774},{"type":"v1","addr":"172.21.15.176:6819","nonce":2049295774}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6820","nonce":2049295774},{"type":"v1","addr":"172.21.15.176:6821","nonce":2049295774}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6824","nonce":2049295774},{"type":"v1","addr":"172.21.15.176:6825","nonce":2049295774}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6822","nonce":2049295774},{"type":"v1","addr":"172.21.15.176:6823","nonce":2049295774}]},"public_addr":"172.21.15.176:6819/2049295774","cluster_addr":"172.21.15.176:6821/2049295774","heartbeat_back_addr":"172.21.15.176:6825/2049295774","heartbeat_front_addr":"172.21.15.176:6823/2049295774","state":["exists","up"]},{"osd":6,"uuid":"4d24f360-6751-4263-841b-d77793d33540","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6826","nonce":2164458476},{"type":"v1","addr":"172.21.15.176:6827","nonce":2164458476}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6828","nonce":2164458476},{"type":"v1","addr":"172.21.15.176:6829","nonce":2164458476}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6832","nonce":2164458476},{"type":"v1","addr":"172.21.15.176:6833","nonce":2164458476}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6830","nonce":2164458476},{"type":"v1","addr":"172.21.15.176:6831","nonce":2164458476}]},"public_addr":"172.21.15.176:6827/2164458476","cluster_addr":"172.21.15.176:6829/2164458476","heartbeat_back_addr":"172.21.15.176:6833/2164458476","heartbeat_front_addr":"172.21.15.176:6831/2164458476","state":["exists","up"]},{"osd":7,"uuid":"c8594fda-c74a-4ba9-8277-caf101d58ca1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6802","nonce":3239587708},{"type":"v1","addr":"172.21.15.176:6803","nonce":3239587708}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6804","nonce":3239587708},{"type":"v1","addr":"172.21.15.176:6805","nonce":3239587708}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6808","nonce":3239587708},{"type":"v1","addr":"172.21.15.176:6809","nonce":3239587708}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6806","nonce":3239587708},{"type":"v1","addr":"172.21.15.176:6807","nonce":3239587708}]},"public_addr":"172.21.15.176:6803/3239587708","cluster_addr":"172.21.15.176:6805/3239587708","heartbeat_back_addr":"172.21.15.176:6809/3239587708","heartbeat_front_addr":"172.21.15.176:6807/3239587708","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:41:41.905151+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:41:42.705679+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:41:42.459673+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:41:42.440819+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:41:42.668428+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:41:42.694972+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:41:43.078535+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:41:42.363539+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":7,"snaps":[{"begin":2,"length":2}]},{"pool":9,"snaps":[{"begin":2,"length":2}]}],"new_removed_snaps":[{"pool":9,"snaps":[{"begin":2,"length":2}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T05:46:39.137 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:39.135+0000 7ff59ba30640 1 -- 172.21.15.150:0/1423817213 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7ff5780797f0 msgr2=0x7ff57807bd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:46:39.137 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:39.135+0000 7ff59ba30640 1 --2- 172.21.15.150:0/1423817213 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7ff5780797f0 0x7ff57807bd00 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7ff590035000 tx=0x7ff59002d040 comp rx=0 tx=0).stop 2024-09-17T05:46:39.137 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:39.135+0000 7ff59ba30640 1 -- 172.21.15.150:0/1423817213 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff594150dd0 msgr2=0x7ff5940b2d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:46:39.137 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:39.135+0000 7ff59ba30640 1 --2- 172.21.15.150:0/1423817213 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff594150dd0 0x7ff5940b2d20 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x7ff59406a060 tx=0x7ff58c0064f0 comp rx=0 tx=0).stop 2024-09-17T05:46:39.137 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:39.135+0000 7ff59ba30640 1 -- 172.21.15.150:0/1423817213 shutdown_connections 2024-09-17T05:46:39.138 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:39.135+0000 7ff59ba30640 1 --2- 172.21.15.150:0/1423817213 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7ff5780797f0 0x7ff57807bd00 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:39.138 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:39.135+0000 7ff59ba30640 1 --2- 172.21.15.150:0/1423817213 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff594150dd0 0x7ff5940b2d20 unknown :-1 s=CLOSED pgs=729 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:39.138 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:39.135+0000 7ff59ba30640 1 --2- 172.21.15.150:0/1423817213 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff594151390 0x7ff5940b27e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:39.138 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:39.135+0000 7ff59ba30640 1 --2- 172.21.15.150:0/1423817213 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff580003a30 0x7ff5941f7130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:39.138 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:39.135+0000 7ff59ba30640 1 -- 172.21.15.150:0/1423817213 >> 172.21.15.150:0/1423817213 conn(0x7ff5940cee90 msgr2=0x7ff594072b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:46:39.138 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:39.135+0000 7ff59ba30640 1 -- 172.21.15.150:0/1423817213 shutdown_connections 2024-09-17T05:46:39.138 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:39.135+0000 7ff59ba30640 1 -- 172.21.15.150:0/1423817213 wait complete. 2024-09-17T05:46:39.149 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-09-17T05:46:39.264 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:39.262+0000 7fe33d5a9640 1 -- 172.21.15.150:0/1152786705 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe320004d40 msgr2=0x7fe320005150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:46:39.264 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:39.262+0000 7fe33d5a9640 1 --2- 172.21.15.150:0/1152786705 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe320004d40 0x7fe320005150 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 crypto rx=0x7fe33000c610 tx=0x7fe320005830 comp rx=0 tx=0).stop 2024-09-17T05:46:39.264 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:39.262+0000 7fe3377fe640 1 -- 172.21.15.150:0/1152786705 reap_dead start 2024-09-17T05:46:39.264 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:39.262+0000 7fe33d5a9640 1 -- 172.21.15.150:0/1152786705 shutdown_connections 2024-09-17T05:46:39.264 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:39.262+0000 7fe33d5a9640 1 -- 172.21.15.150:0/1152786705 >> 172.21.15.150:0/1152786705 conn(0x7fe3380b2ef0 msgr2=0x7fe3380b3300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:46:39.264 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:39.262+0000 7fe33d5a9640 1 -- 172.21.15.150:0/1152786705 shutdown_connections 2024-09-17T05:46:39.264 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:39.262+0000 7fe33d5a9640 1 -- 172.21.15.150:0/1152786705 wait complete. 2024-09-17T05:46:39.265 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:39.264+0000 7fe33d5a9640 1 Processor -- start 2024-09-17T05:46:39.265 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:39.264+0000 7fe33d5a9640 1 -- start start 2024-09-17T05:46:39.268 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:39.265+0000 7fe33d5a9640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe320004d40 0x7fe3381d4e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:46:39.268 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:39.265+0000 7fe33d5a9640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe3381f5ef0 0x7fe3381f6300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:46:39.268 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:39.265+0000 7fe33d5a9640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe3380b1440 0x7fe3380b1850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:46:39.268 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:39.265+0000 7fe33d5a9640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7fe3380ccbb0 con 0x7fe3380b1440 2024-09-17T05:46:39.268 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:39.265+0000 7fe33d5a9640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fe3380cca30 con 0x7fe320004d40 2024-09-17T05:46:39.269 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:39.265+0000 7fe33d5a9640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fe3380ccd30 con 0x7fe3381f5ef0 2024-09-17T05:46:39.269 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:39.265+0000 7fe3377fe640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe3380b1440 0x7fe3380b1850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:46:39.269 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:39.265+0000 7fe3377fe640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe3380b1440 0x7fe3380b1850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:35378/0 (socket says 172.21.15.150:35378) 2024-09-17T05:46:39.269 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:39.265+0000 7fe3377fe640 1 -- 172.21.15.150:0/2325279855 learned_addr learned my addr 172.21.15.150:0/2325279855 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:46:39.269 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:39.266+0000 7fe3367fc640 1 --2- 172.21.15.150:0/2325279855 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe3381f5ef0 0x7fe3381f6300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:46:39.269 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:39.266+0000 7fe336ffd640 1 --2- 172.21.15.150:0/2325279855 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe320004d40 0x7fe3381d4e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:46:39.269 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:39.266+0000 7fe3377fe640 1 -- 172.21.15.150:0/2325279855 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe3381f5ef0 msgr2=0x7fe3381f6300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:46:39.269 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:39.266+0000 7fe3377fe640 1 --2- 172.21.15.150:0/2325279855 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe3381f5ef0 0x7fe3381f6300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:39.269 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:39.266+0000 7fe3377fe640 1 -- 172.21.15.150:0/2325279855 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe320004d40 msgr2=0x7fe3381d4e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:46:39.269 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:39.266+0000 7fe3377fe640 1 --2- 172.21.15.150:0/2325279855 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe320004d40 0x7fe3381d4e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:39.269 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:39.266+0000 7fe3377fe640 1 -- 172.21.15.150:0/2325279855 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe3381f6c20 con 0x7fe3380b1440 2024-09-17T05:46:39.270 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:39.266+0000 7fe3367fc640 1 --2- 172.21.15.150:0/2325279855 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe3381f5ef0 0x7fe3381f6300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:46:39.270 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:39.266+0000 7fe336ffd640 1 --2- 172.21.15.150:0/2325279855 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe320004d40 0x7fe3381d4e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:46:39.270 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:39.266+0000 7fe3377fe640 1 --2- 172.21.15.150:0/2325279855 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe3380b1440 0x7fe3380b1850 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 crypto rx=0x7fe33000c700 tx=0x7fe330001aa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:46:39.270 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:39.266+0000 7fe31f7fe640 1 -- 172.21.15.150:0/2325279855 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe330039070 con 0x7fe3380b1440 2024-09-17T05:46:39.270 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:39.266+0000 7fe31f7fe640 1 -- 172.21.15.150:0/2325279855 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe33002b960 con 0x7fe3380b1440 2024-09-17T05:46:39.270 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:39.266+0000 7fe31f7fe640 1 -- 172.21.15.150:0/2325279855 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe330002030 con 0x7fe3380b1440 2024-09-17T05:46:39.270 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:39.266+0000 7fe33d5a9640 1 -- 172.21.15.150:0/2325279855 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe3380b1d90 con 0x7fe3380b1440 2024-09-17T05:46:39.270 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:39.266+0000 7fe33d5a9640 1 -- 172.21.15.150:0/2325279855 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe3381f2850 con 0x7fe3380b1440 2024-09-17T05:46:39.271 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:39.267+0000 7fe33d5a9640 1 -- 172.21.15.150:0/2325279855 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe3381f6990 con 0x7fe3380b1440 2024-09-17T05:46:39.271 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:39.268+0000 7fe31f7fe640 1 -- 172.21.15.150:0/2325279855 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 19) ==== 102563+0+0 (secure 0 0 0) 0x7fe330034680 con 0x7fe3380b1440 2024-09-17T05:46:39.271 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:39.268+0000 7fe31f7fe640 1 --2- 172.21.15.150:0/2325279855 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fe3240797f0 0x7fe32407bd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:46:39.271 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:39.269+0000 7fe31f7fe640 1 -- 172.21.15.150:0/2325279855 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(61..61 src has 1..61) ==== 5793+0+0 (secure 0 0 0) 0x7fe3300b97d0 con 0x7fe3380b1440 2024-09-17T05:46:39.271 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:39.269+0000 7fe336ffd640 1 --2- 172.21.15.150:0/2325279855 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fe3240797f0 0x7fe32407bd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:46:39.271 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:39.269+0000 7fe336ffd640 1 --2- 172.21.15.150:0/2325279855 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fe3240797f0 0x7fe32407bd00 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7fe3380d24c0 tx=0x7fe328005f90 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:46:39.275 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:39.273+0000 7fe31f7fe640 1 -- 172.21.15.150:0/2325279855 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fe3380b1d90 con 0x7fe3380b1440 2024-09-17T05:46:39.484 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:39.483+0000 7fe33d5a9640 1 -- 172.21.15.150:0/2325279855 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7fe3380cdc10 con 0x7fe3380b1440 2024-09-17T05:46:39.485 INFO:tasks.ceph.mon.a.smithi150.stderr:2024-09-17T05:46:39.484+0000 7f73931ae640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-17T05:46:39.486 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:39.485+0000 7fe31f7fe640 1 -- 172.21.15.150:0/2325279855 <== mon.0 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v35) ==== 161+0+0 (secure 0 0 0) 0x7fe330083750 con 0x7fe3380b1440 2024-09-17T05:46:39.487 INFO:teuthology.orchestra.run.smithi150.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-09-17T05:46:39.489 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:39.487+0000 7fe33d5a9640 1 -- 172.21.15.150:0/2325279855 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fe3240797f0 msgr2=0x7fe32407bd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:46:39.489 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:39.487+0000 7fe33d5a9640 1 --2- 172.21.15.150:0/2325279855 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fe3240797f0 0x7fe32407bd00 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7fe3380d24c0 tx=0x7fe328005f90 comp rx=0 tx=0).stop 2024-09-17T05:46:39.489 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:39.487+0000 7fe33d5a9640 1 -- 172.21.15.150:0/2325279855 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe3380b1440 msgr2=0x7fe3380b1850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:46:39.490 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:39.487+0000 7fe33d5a9640 1 --2- 172.21.15.150:0/2325279855 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe3380b1440 0x7fe3380b1850 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 crypto rx=0x7fe33000c700 tx=0x7fe330001aa0 comp rx=0 tx=0).stop 2024-09-17T05:46:39.490 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:39.488+0000 7fe33d5a9640 1 -- 172.21.15.150:0/2325279855 shutdown_connections 2024-09-17T05:46:39.490 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:39.488+0000 7fe33d5a9640 1 --2- 172.21.15.150:0/2325279855 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fe3240797f0 0x7fe32407bd00 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:39.490 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:39.488+0000 7fe33d5a9640 1 --2- 172.21.15.150:0/2325279855 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe3380b1440 0x7fe3380b1850 unknown :-1 s=CLOSED pgs=732 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:39.490 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:39.488+0000 7fe33d5a9640 1 --2- 172.21.15.150:0/2325279855 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe3381f5ef0 0x7fe3381f6300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:39.490 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:39.488+0000 7fe33d5a9640 1 --2- 172.21.15.150:0/2325279855 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe320004d40 0x7fe3381d4e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:39.490 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:39.488+0000 7fe33d5a9640 1 -- 172.21.15.150:0/2325279855 >> 172.21.15.150:0/2325279855 conn(0x7fe3380b2ef0 msgr2=0x7fe3380b2740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:46:39.490 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:39.488+0000 7fe33d5a9640 1 -- 172.21.15.150:0/2325279855 shutdown_connections 2024-09-17T05:46:39.490 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:39.488+0000 7fe33d5a9640 1 -- 172.21.15.150:0/2325279855 wait complete. 2024-09-17T05:46:39.503 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-09-17T05:46:39.555 INFO:tasks.ceph.mds.a.smithi150.stdout:starting mds.a at 2024-09-17T05:46:39.626 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:39.624+0000 7f7db67a8640 1 -- 172.21.15.150:0/3145665821 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7db00d1190 msgr2=0x7f7db00cd0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:46:39.626 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:39.624+0000 7f7db67a8640 1 --2- 172.21.15.150:0/3145665821 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7db00d1190 0x7f7db00cd0e0 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 crypto rx=0x7f7da8005fd0 tx=0x7f7da802a980 comp rx=0 tx=0).stop 2024-09-17T05:46:39.626 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:39.624+0000 7f7db67a8640 1 -- 172.21.15.150:0/3145665821 shutdown_connections 2024-09-17T05:46:39.626 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:39.624+0000 7f7db67a8640 1 --2- 172.21.15.150:0/3145665821 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7db00d1190 0x7f7db00cd0e0 unknown :-1 s=CLOSED pgs=737 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:39.626 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:39.624+0000 7f7db67a8640 1 --2- 172.21.15.150:0/3145665821 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7db00b7960 0x7f7db00af1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:39.626 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:39.624+0000 7f7db67a8640 1 -- 172.21.15.150:0/3145665821 >> 172.21.15.150:0/3145665821 conn(0x7f7db00cef20 msgr2=0x7f7db00cf330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:46:39.626 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:39.624+0000 7f7db67a8640 1 -- 172.21.15.150:0/3145665821 shutdown_connections 2024-09-17T05:46:39.627 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:39.624+0000 7f7db67a8640 1 -- 172.21.15.150:0/3145665821 wait complete. 2024-09-17T05:46:39.627 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:39.626+0000 7f7db67a8640 1 Processor -- start 2024-09-17T05:46:39.627 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:39.626+0000 7f7db67a8640 1 -- start start 2024-09-17T05:46:39.630 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:39.627+0000 7f7db67a8640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7db00b7960 0x7f7db015a370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:46:39.630 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:39.627+0000 7f7db67a8640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7db00b7d70 0x7f7db015fd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:46:39.630 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:39.627+0000 7f7db67a8640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7db00d1190 0x7f7db0155950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:46:39.630 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:39.627+0000 7f7db67a8640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f7db00ced10 con 0x7f7db00b7d70 2024-09-17T05:46:39.630 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:39.627+0000 7f7db67a8640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f7db00ceb90 con 0x7f7db00b7960 2024-09-17T05:46:39.631 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:39.627+0000 7f7db67a8640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f7db00af730 con 0x7f7db00d1190 2024-09-17T05:46:39.631 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:39.627+0000 7f7da7fff640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7db00b7d70 0x7f7db015fd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:46:39.631 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:39.627+0000 7f7da7fff640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7db00b7d70 0x7f7db015fd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:35408/0 (socket says 172.21.15.150:35408) 2024-09-17T05:46:39.631 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:39.627+0000 7f7da7fff640 1 -- 172.21.15.150:0/611054974 learned_addr learned my addr 172.21.15.150:0/611054974 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:46:39.631 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:39.627+0000 7f7db4d45640 1 --2- 172.21.15.150:0/611054974 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7db00d1190 0x7f7db0155950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:46:39.631 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:39.627+0000 7f7daffff640 1 --2- 172.21.15.150:0/611054974 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7db00b7960 0x7f7db015a370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:46:39.631 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:39.627+0000 7f7da7fff640 1 -- 172.21.15.150:0/611054974 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7db00d1190 msgr2=0x7f7db0155950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:46:39.631 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:39.627+0000 7f7da7fff640 1 --2- 172.21.15.150:0/611054974 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7db00d1190 0x7f7db0155950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:39.631 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:39.627+0000 7f7da7fff640 1 -- 172.21.15.150:0/611054974 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7db00b7960 msgr2=0x7f7db015a370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:46:39.631 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:39.627+0000 7f7da7fff640 1 --2- 172.21.15.150:0/611054974 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7db00b7960 0x7f7db015a370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:39.631 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:39.627+0000 7f7da7fff640 1 -- 172.21.15.150:0/611054974 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7db01f3a40 con 0x7f7db00b7d70 2024-09-17T05:46:39.631 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:39.627+0000 7f7daffff640 1 --2- 172.21.15.150:0/611054974 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7db00b7960 0x7f7db015a370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T05:46:39.631 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:39.628+0000 7f7da7fff640 1 --2- 172.21.15.150:0/611054974 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7db00b7d70 0x7f7db015fd30 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 crypto rx=0x7f7d9800c420 tx=0x7f7d9800c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:46:39.632 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:39.628+0000 7f7dad7fa640 1 -- 172.21.15.150:0/611054974 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d98017070 con 0x7f7db00b7d70 2024-09-17T05:46:39.632 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:39.628+0000 7f7dad7fa640 1 -- 172.21.15.150:0/611054974 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f7d980035f0 con 0x7f7db00b7d70 2024-09-17T05:46:39.632 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:39.628+0000 7f7db67a8640 1 -- 172.21.15.150:0/611054974 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7db01607f0 con 0x7f7db00b7d70 2024-09-17T05:46:39.632 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:39.628+0000 7f7dad7fa640 1 -- 172.21.15.150:0/611054974 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d98003a40 con 0x7f7db00b7d70 2024-09-17T05:46:39.632 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:39.628+0000 7f7db67a8640 1 -- 172.21.15.150:0/611054974 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7db01f3fe0 con 0x7f7db00b7d70 2024-09-17T05:46:39.632 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:39.629+0000 7f7db67a8640 1 -- 172.21.15.150:0/611054974 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7db0160560 con 0x7f7db00b7d70 2024-09-17T05:46:39.633 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:39.629+0000 7f7dad7fa640 1 -- 172.21.15.150:0/611054974 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 19) ==== 102563+0+0 (secure 0 0 0) 0x7f7d9801a070 con 0x7f7db00b7d70 2024-09-17T05:46:39.633 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:39.630+0000 7f7dad7fa640 1 --2- 172.21.15.150:0/611054974 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f7d90079820 0x7f7d9007bd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:46:39.633 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:39.630+0000 7f7dad7fa640 1 -- 172.21.15.150:0/611054974 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(62..62 src has 1..62) ==== 5851+0+0 (secure 0 0 0) 0x7f7d98098b50 con 0x7f7db00b7d70 2024-09-17T05:46:39.633 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:39.630+0000 7f7daffff640 1 --2- 172.21.15.150:0/611054974 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f7d90079820 0x7f7d9007bd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:46:39.633 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:39.631+0000 7f7daffff640 1 --2- 172.21.15.150:0/611054974 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f7d90079820 0x7f7d9007bd30 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f7db00d2470 tx=0x7f7da0005c80 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:46:39.636 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:39.634+0000 7f7dad7fa640 1 -- 172.21.15.150:0/611054974 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f7d98062910 con 0x7f7db00b7d70 2024-09-17T05:46:39.848 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:39.846+0000 7f7db67a8640 1 -- 172.21.15.150:0/611054974 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7f7db00d0a80 con 0x7f7db00b7d70 2024-09-17T05:46:40.488 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:40.487+0000 7f7dad7fa640 1 -- 172.21.15.150:0/611054974 <== mon.0 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v36) ==== 104+0+0 (secure 0 0 0) 0x7f7db00d0a80 con 0x7f7db00b7d70 2024-09-17T05:46:40.491 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:40.490+0000 7f7db67a8640 1 -- 172.21.15.150:0/611054974 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f7d90079820 msgr2=0x7f7d9007bd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:46:40.491 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:40.490+0000 7f7db67a8640 1 --2- 172.21.15.150:0/611054974 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f7d90079820 0x7f7d9007bd30 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f7db00d2470 tx=0x7f7da0005c80 comp rx=0 tx=0).stop 2024-09-17T05:46:40.491 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:40.490+0000 7f7db67a8640 1 -- 172.21.15.150:0/611054974 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7db00b7d70 msgr2=0x7f7db015fd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:46:40.492 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:40.490+0000 7f7db67a8640 1 --2- 172.21.15.150:0/611054974 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7db00b7d70 0x7f7db015fd30 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 crypto rx=0x7f7d9800c420 tx=0x7f7d9800c8e0 comp rx=0 tx=0).stop 2024-09-17T05:46:40.492 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:40.490+0000 7f7db67a8640 1 -- 172.21.15.150:0/611054974 shutdown_connections 2024-09-17T05:46:40.492 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:40.490+0000 7f7db67a8640 1 --2- 172.21.15.150:0/611054974 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f7d90079820 0x7f7d9007bd30 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:40.492 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:40.490+0000 7f7db67a8640 1 --2- 172.21.15.150:0/611054974 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7db00d1190 0x7f7db0155950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:40.492 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:40.490+0000 7f7db67a8640 1 --2- 172.21.15.150:0/611054974 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7db00b7d70 0x7f7db015fd30 unknown :-1 s=CLOSED pgs=738 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:40.492 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:40.490+0000 7f7db67a8640 1 --2- 172.21.15.150:0/611054974 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7db00b7960 0x7f7db015a370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:40.492 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:40.490+0000 7f7db67a8640 1 -- 172.21.15.150:0/611054974 >> 172.21.15.150:0/611054974 conn(0x7f7db00cef20 msgr2=0x7f7db00ce240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:46:40.493 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:40.490+0000 7f7db67a8640 1 -- 172.21.15.150:0/611054974 shutdown_connections 2024-09-17T05:46:40.493 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:40.490+0000 7f7db67a8640 1 -- 172.21.15.150:0/611054974 wait complete. 2024-09-17T05:46:40.504 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-09-17T05:46:40.622 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:40.621+0000 7f64541b0640 1 -- 172.21.15.150:0/1845171163 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f644c15d190 msgr2=0x7f644c15d5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:46:40.622 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:40.621+0000 7f64541b0640 1 --2- 172.21.15.150:0/1845171163 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f644c15d190 0x7f644c15d5a0 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 crypto rx=0x7f6448005fd0 tx=0x7f644802a980 comp rx=0 tx=0).stop 2024-09-17T05:46:40.622 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:40.621+0000 7f64541b0640 1 -- 172.21.15.150:0/1845171163 shutdown_connections 2024-09-17T05:46:40.622 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:40.621+0000 7f64541b0640 1 --2- 172.21.15.150:0/1845171163 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f644c15d190 0x7f644c15d5a0 unknown :-1 s=CLOSED pgs=740 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:40.623 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:40.621+0000 7f64541b0640 1 -- 172.21.15.150:0/1845171163 >> 172.21.15.150:0/1845171163 conn(0x7f644c09aa50 msgr2=0x7f644c0b2ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:46:40.623 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:40.621+0000 7f64541b0640 1 -- 172.21.15.150:0/1845171163 shutdown_connections 2024-09-17T05:46:40.623 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:40.621+0000 7f64541b0640 1 -- 172.21.15.150:0/1845171163 wait complete. 2024-09-17T05:46:40.623 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:40.623+0000 7f64541b0640 1 Processor -- start 2024-09-17T05:46:40.624 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:40.623+0000 7f64541b0640 1 -- start start 2024-09-17T05:46:40.626 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:40.624+0000 7f64541b0640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f644c0af8a0 0x7f644c14bba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:46:40.627 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:40.624+0000 7f64541b0640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f644c0b4a00 0x7f644c158b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:46:40.627 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:40.624+0000 7f64541b0640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f644c15d190 0x7f644c1590a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:46:40.627 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:40.624+0000 7f64541b0640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f644c166d10 con 0x7f644c0b4a00 2024-09-17T05:46:40.627 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:40.624+0000 7f64541b0640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f644c0b00b0 con 0x7f644c15d190 2024-09-17T05:46:40.627 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:40.624+0000 7f64541b0640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f644c166e90 con 0x7f644c0af8a0 2024-09-17T05:46:40.627 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:40.625+0000 7f645174b640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f644c0b4a00 0x7f644c158b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:46:40.627 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:40.625+0000 7f645174b640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f644c0b4a00 0x7f644c158b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:39082/0 (socket says 172.21.15.150:39082) 2024-09-17T05:46:40.627 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:40.625+0000 7f645174b640 1 -- 172.21.15.150:0/1170646312 learned_addr learned my addr 172.21.15.150:0/1170646312 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:46:40.627 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:40.625+0000 7f645274d640 1 --2- 172.21.15.150:0/1170646312 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f644c15d190 0x7f644c1590a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:46:40.627 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:40.625+0000 7f645174b640 1 -- 172.21.15.150:0/1170646312 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f644c0af8a0 msgr2=0x7f644c14bba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:46:40.627 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:40.625+0000 7f6451f4c640 1 --2- 172.21.15.150:0/1170646312 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f644c0af8a0 0x7f644c14bba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:46:40.627 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:40.625+0000 7f645174b640 1 --2- 172.21.15.150:0/1170646312 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f644c0af8a0 0x7f644c14bba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:40.627 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:40.625+0000 7f645174b640 1 -- 172.21.15.150:0/1170646312 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f644c15d190 msgr2=0x7f644c1590a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:46:40.628 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:40.625+0000 7f645174b640 1 --2- 172.21.15.150:0/1170646312 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f644c15d190 0x7f644c1590a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:40.628 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:40.625+0000 7f645174b640 1 -- 172.21.15.150:0/1170646312 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f644c1f2aa0 con 0x7f644c0b4a00 2024-09-17T05:46:40.628 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:40.625+0000 7f645274d640 1 --2- 172.21.15.150:0/1170646312 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f644c15d190 0x7f644c1590a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T05:46:40.628 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:40.625+0000 7f645174b640 1 --2- 172.21.15.150:0/1170646312 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f644c0b4a00 0x7f644c158b60 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 crypto rx=0x7f643c00e6e0 tx=0x7f643c00eba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:46:40.628 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:40.625+0000 7f64427fc640 1 -- 172.21.15.150:0/1170646312 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f643c015070 con 0x7f644c0b4a00 2024-09-17T05:46:40.628 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:40.625+0000 7f64427fc640 1 -- 172.21.15.150:0/1170646312 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f643c005380 con 0x7f644c0b4a00 2024-09-17T05:46:40.628 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:40.625+0000 7f64541b0640 1 -- 172.21.15.150:0/1170646312 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f644c1f2d80 con 0x7f644c0b4a00 2024-09-17T05:46:40.628 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:40.625+0000 7f64427fc640 1 -- 172.21.15.150:0/1170646312 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f643c0018c0 con 0x7f644c0b4a00 2024-09-17T05:46:40.628 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:40.625+0000 7f64541b0640 1 -- 172.21.15.150:0/1170646312 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f644c1f3340 con 0x7f644c0b4a00 2024-09-17T05:46:40.628 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:40.626+0000 7f64541b0640 1 -- 172.21.15.150:0/1170646312 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f644c15d5a0 con 0x7f644c0b4a00 2024-09-17T05:46:40.629 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:40.627+0000 7f64427fc640 1 -- 172.21.15.150:0/1170646312 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 19) ==== 102563+0+0 (secure 0 0 0) 0x7f643c018070 con 0x7f644c0b4a00 2024-09-17T05:46:40.629 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:40.628+0000 7f64427fc640 1 --2- 172.21.15.150:0/1170646312 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f64300797f0 0x7f643007bd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:46:40.629 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:40.628+0000 7f64427fc640 1 -- 172.21.15.150:0/1170646312 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(62..62 src has 1..62) ==== 5851+0+0 (secure 0 0 0) 0x7f643c09b890 con 0x7f644c0b4a00 2024-09-17T05:46:40.629 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:40.628+0000 7f6451f4c640 1 --2- 172.21.15.150:0/1170646312 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f64300797f0 0x7f643007bd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:46:40.629 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:40.629+0000 7f6451f4c640 1 --2- 172.21.15.150:0/1170646312 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f64300797f0 0x7f643007bd00 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f6448035000 tx=0x7f6448004ab0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:46:40.633 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:40.632+0000 7f64427fc640 1 -- 172.21.15.150:0/1170646312 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f643c065810 con 0x7f644c0b4a00 2024-09-17T05:46:40.808 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:40.807+0000 7f64541b0640 1 -- 172.21.15.150:0/1170646312 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7f644c166af0 con 0x7f644c0b4a00 2024-09-17T05:46:41.490 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:41.489+0000 7f64427fc640 1 -- 172.21.15.150:0/1170646312 <== mon.0 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v63) ==== 181+0+0 (secure 0 0 0) 0x7f643c065110 con 0x7f644c0b4a00 2024-09-17T05:46:41.490 INFO:teuthology.orchestra.run.smithi150.stderr:pool 'cephfs_metadata' removed 2024-09-17T05:46:41.493 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:41.492+0000 7f64541b0640 1 -- 172.21.15.150:0/1170646312 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f64300797f0 msgr2=0x7f643007bd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:46:41.493 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:41.492+0000 7f64541b0640 1 --2- 172.21.15.150:0/1170646312 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f64300797f0 0x7f643007bd00 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f6448035000 tx=0x7f6448004ab0 comp rx=0 tx=0).stop 2024-09-17T05:46:41.493 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:41.492+0000 7f64541b0640 1 -- 172.21.15.150:0/1170646312 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f644c0b4a00 msgr2=0x7f644c158b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:46:41.493 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:41.492+0000 7f64541b0640 1 --2- 172.21.15.150:0/1170646312 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f644c0b4a00 0x7f644c158b60 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 crypto rx=0x7f643c00e6e0 tx=0x7f643c00eba0 comp rx=0 tx=0).stop 2024-09-17T05:46:41.493 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:41.492+0000 7f64541b0640 1 -- 172.21.15.150:0/1170646312 shutdown_connections 2024-09-17T05:46:41.493 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:41.492+0000 7f64541b0640 1 --2- 172.21.15.150:0/1170646312 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f644c15d190 0x7f644c1590a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:41.493 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:41.492+0000 7f64541b0640 1 --2- 172.21.15.150:0/1170646312 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f64300797f0 0x7f643007bd00 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:41.493 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:41.492+0000 7f64541b0640 1 --2- 172.21.15.150:0/1170646312 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f644c0b4a00 0x7f644c158b60 unknown :-1 s=CLOSED pgs=741 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:41.493 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:41.492+0000 7f64541b0640 1 --2- 172.21.15.150:0/1170646312 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f644c0af8a0 0x7f644c14bba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:41.493 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:41.492+0000 7f64541b0640 1 -- 172.21.15.150:0/1170646312 >> 172.21.15.150:0/1170646312 conn(0x7f644c09aa50 msgr2=0x7f644c070dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:46:41.493 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:41.492+0000 7f64541b0640 1 -- 172.21.15.150:0/1170646312 shutdown_connections 2024-09-17T05:46:41.493 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:41.492+0000 7f64541b0640 1 -- 172.21.15.150:0/1170646312 wait complete. 2024-09-17T05:46:41.507 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-09-17T05:46:41.627 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:41.625+0000 7f3caeebd640 1 -- 172.21.15.150:0/3268218288 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3ca80b2190 msgr2=0x7f3ca80cd2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:46:41.627 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:41.626+0000 7f3caeebd640 1 --2- 172.21.15.150:0/3268218288 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3ca80b2190 0x7f3ca80cd2e0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f3ca80b1b40 tx=0x7f3ca002a590 comp rx=0 tx=0).stop 2024-09-17T05:46:41.627 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:41.626+0000 7f3caeebd640 1 -- 172.21.15.150:0/3268218288 shutdown_connections 2024-09-17T05:46:41.627 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:41.626+0000 7f3caeebd640 1 --2- 172.21.15.150:0/3268218288 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3ca80b2190 0x7f3ca80cd2e0 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:41.627 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:41.626+0000 7f3caeebd640 1 --2- 172.21.15.150:0/3268218288 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3ca80d0520 0x7f3ca80b7a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:41.627 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:41.626+0000 7f3caeebd640 1 -- 172.21.15.150:0/3268218288 >> 172.21.15.150:0/3268218288 conn(0x7f3ca80cef30 msgr2=0x7f3ca80cf340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:46:41.627 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:41.626+0000 7f3caeebd640 1 -- 172.21.15.150:0/3268218288 shutdown_connections 2024-09-17T05:46:41.627 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:41.626+0000 7f3caeebd640 1 -- 172.21.15.150:0/3268218288 wait complete. 2024-09-17T05:46:41.628 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:41.627+0000 7f3caeebd640 1 Processor -- start 2024-09-17T05:46:41.628 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:41.627+0000 7f3caeebd640 1 -- start start 2024-09-17T05:46:41.632 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:41.629+0000 7f3caeebd640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3ca80b1d80 0x7f3ca809c2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:46:41.632 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:41.629+0000 7f3caeebd640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3ca80b2190 0x7f3ca81f3ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:46:41.632 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:41.629+0000 7f3caeebd640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3ca80d0520 0x7f3ca81f6e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:46:41.632 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:41.629+0000 7f3caeebd640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f3ca80d3310 con 0x7f3ca80d0520 2024-09-17T05:46:41.632 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:41.629+0000 7f3caeebd640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f3ca8074ae0 con 0x7f3ca80b1d80 2024-09-17T05:46:41.632 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:41.629+0000 7f3caeebd640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f3ca8070f20 con 0x7f3ca80b2190 2024-09-17T05:46:41.632 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:41.629+0000 7f3cad45a640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3ca80d0520 0x7f3ca81f6e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:46:41.632 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:41.629+0000 7f3cad45a640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3ca80d0520 0x7f3ca81f6e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:39088/0 (socket says 172.21.15.150:39088) 2024-09-17T05:46:41.632 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:41.629+0000 7f3cad45a640 1 -- 172.21.15.150:0/3644815835 learned_addr learned my addr 172.21.15.150:0/3644815835 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:46:41.632 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:41.629+0000 7f3cacc59640 1 --2- 172.21.15.150:0/3644815835 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3ca80b1d80 0x7f3ca809c2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:46:41.632 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:41.629+0000 7f3ca7fff640 1 --2- 172.21.15.150:0/3644815835 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3ca80b2190 0x7f3ca81f3ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:46:41.633 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:41.629+0000 7f3cad45a640 1 -- 172.21.15.150:0/3644815835 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3ca80b2190 msgr2=0x7f3ca81f3ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:46:41.633 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:41.629+0000 7f3cad45a640 1 --2- 172.21.15.150:0/3644815835 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3ca80b2190 0x7f3ca81f3ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:41.633 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:41.629+0000 7f3cad45a640 1 -- 172.21.15.150:0/3644815835 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3ca80b1d80 msgr2=0x7f3ca809c2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:46:41.633 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:41.629+0000 7f3cad45a640 1 --2- 172.21.15.150:0/3644815835 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3ca80b1d80 0x7f3ca809c2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:41.633 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:41.629+0000 7f3cad45a640 1 -- 172.21.15.150:0/3644815835 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3ca81f7c60 con 0x7f3ca80d0520 2024-09-17T05:46:41.633 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:41.630+0000 7f3cad45a640 1 --2- 172.21.15.150:0/3644815835 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3ca80d0520 0x7f3ca81f6e20 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 crypto rx=0x7f3ca00098f0 tx=0x7f3ca0033c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:46:41.633 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:41.630+0000 7f3ca57fa640 1 -- 172.21.15.150:0/3644815835 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ca0005c90 con 0x7f3ca80d0520 2024-09-17T05:46:41.633 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:41.630+0000 7f3ca57fa640 1 -- 172.21.15.150:0/3644815835 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f3ca0031e50 con 0x7f3ca80d0520 2024-09-17T05:46:41.633 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:41.630+0000 7f3caeebd640 1 -- 172.21.15.150:0/3644815835 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3ca815df70 con 0x7f3ca80d0520 2024-09-17T05:46:41.633 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:41.630+0000 7f3ca57fa640 1 -- 172.21.15.150:0/3644815835 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ca0005240 con 0x7f3ca80d0520 2024-09-17T05:46:41.633 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:41.630+0000 7f3caeebd640 1 -- 172.21.15.150:0/3644815835 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3ca81e6fb0 con 0x7f3ca80d0520 2024-09-17T05:46:41.633 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:41.631+0000 7f3caeebd640 1 -- 172.21.15.150:0/3644815835 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3ca81e6ae0 con 0x7f3ca80d0520 2024-09-17T05:46:41.634 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:41.632+0000 7f3ca57fa640 1 -- 172.21.15.150:0/3644815835 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 19) ==== 102563+0+0 (secure 0 0 0) 0x7f3ca00053e0 con 0x7f3ca80d0520 2024-09-17T05:46:41.634 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:41.632+0000 7f3ca57fa640 1 --2- 172.21.15.150:0/3644815835 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f3c940797f0 0x7f3c9407bd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:46:41.634 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:41.632+0000 7f3ca57fa640 1 -- 172.21.15.150:0/3644815835 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(63..63 src has 1..63) ==== 5413+0+0 (secure 0 0 0) 0x7f3ca00ba9e0 con 0x7f3ca80d0520 2024-09-17T05:46:41.634 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:41.633+0000 7f3cacc59640 1 --2- 172.21.15.150:0/3644815835 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f3c940797f0 0x7f3c9407bd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:46:41.635 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:41.633+0000 7f3cacc59640 1 --2- 172.21.15.150:0/3644815835 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f3c940797f0 0x7f3c9407bd00 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f3c98009530 tx=0x7f3c98009260 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:46:41.637 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:41.637+0000 7f3ca57fa640 1 -- 172.21.15.150:0/3644815835 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f3ca003f030 con 0x7f3ca80d0520 2024-09-17T05:46:41.820 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:41.819+0000 7f3caeebd640 1 -- 172.21.15.150:0/3644815835 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7f3ca80716c0 con 0x7f3ca80d0520 2024-09-17T05:46:42.491 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:42.490+0000 7f3ca57fa640 1 -- 172.21.15.150:0/3644815835 <== mon.0 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v64) ==== 169+0+0 (secure 0 0 0) 0x7f3ca0084090 con 0x7f3ca80d0520 2024-09-17T05:46:42.491 INFO:teuthology.orchestra.run.smithi150.stderr:pool 'cephfs_data' removed 2024-09-17T05:46:42.496 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:42.495+0000 7f3caeebd640 1 -- 172.21.15.150:0/3644815835 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f3c940797f0 msgr2=0x7f3c9407bd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:46:42.496 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:42.495+0000 7f3caeebd640 1 --2- 172.21.15.150:0/3644815835 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f3c940797f0 0x7f3c9407bd00 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f3c98009530 tx=0x7f3c98009260 comp rx=0 tx=0).stop 2024-09-17T05:46:42.497 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:42.495+0000 7f3caeebd640 1 -- 172.21.15.150:0/3644815835 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3ca80d0520 msgr2=0x7f3ca81f6e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:46:42.497 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:42.495+0000 7f3caeebd640 1 --2- 172.21.15.150:0/3644815835 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3ca80d0520 0x7f3ca81f6e20 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 crypto rx=0x7f3ca00098f0 tx=0x7f3ca0033c20 comp rx=0 tx=0).stop 2024-09-17T05:46:42.497 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:42.495+0000 7f3caeebd640 1 -- 172.21.15.150:0/3644815835 shutdown_connections 2024-09-17T05:46:42.497 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:42.495+0000 7f3caeebd640 1 --2- 172.21.15.150:0/3644815835 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f3c940797f0 0x7f3c9407bd00 secure :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f3c98009530 tx=0x7f3c98009260 comp rx=0 tx=0).stop 2024-09-17T05:46:42.497 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:42.495+0000 7f3caeebd640 1 --2- 172.21.15.150:0/3644815835 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3ca80d0520 0x7f3ca81f6e20 unknown :-1 s=CLOSED pgs=742 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:42.497 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:42.495+0000 7f3caeebd640 1 --2- 172.21.15.150:0/3644815835 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3ca80b2190 0x7f3ca81f3ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:42.497 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:42.495+0000 7f3caeebd640 1 --2- 172.21.15.150:0/3644815835 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3ca80b1d80 0x7f3ca809c2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:42.497 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:42.496+0000 7f3caeebd640 1 -- 172.21.15.150:0/3644815835 >> 172.21.15.150:0/3644815835 conn(0x7f3ca80cef30 msgr2=0x7f3ca815ca10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:46:42.497 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:42.496+0000 7f3caeebd640 1 -- 172.21.15.150:0/3644815835 shutdown_connections 2024-09-17T05:46:42.497 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:42.496+0000 7f3caeebd640 1 -- 172.21.15.150:0/3644815835 wait complete. 2024-09-17T05:46:42.512 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config reset 31 2024-09-17T05:46:42.629 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:42.628+0000 7f5b2d294640 1 -- 172.21.15.150:0/1957026494 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5b280b6320 msgr2=0x7f5b280b6730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:46:42.629 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:42.628+0000 7f5b2d294640 1 --2- 172.21.15.150:0/1957026494 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5b280b6320 0x7f5b280b6730 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 crypto rx=0x7f5b280b6e50 tx=0x7f5b2002a970 comp rx=0 tx=0).stop 2024-09-17T05:46:42.630 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:42.628+0000 7f5b2d294640 1 -- 172.21.15.150:0/1957026494 shutdown_connections 2024-09-17T05:46:42.630 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:42.628+0000 7f5b2d294640 1 --2- 172.21.15.150:0/1957026494 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5b280b6320 0x7f5b280b6730 unknown :-1 s=CLOSED pgs=743 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:42.630 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:42.628+0000 7f5b2d294640 1 --2- 172.21.15.150:0/1957026494 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5b280d2e50 0x7f5b280d3260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:42.630 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:42.628+0000 7f5b2d294640 1 --2- 172.21.15.150:0/1957026494 >> v2:172.21.15.176:3300/0 conn(0x7f5b280b74b0 0x7f5b280b78c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:42.630 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:42.628+0000 7f5b2d294640 1 -- 172.21.15.150:0/1957026494 >> 172.21.15.150:0/1957026494 conn(0x7f5b2808bfe0 msgr2=0x7f5b280d4660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:46:42.630 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:42.628+0000 7f5b2d294640 1 -- 172.21.15.150:0/1957026494 shutdown_connections 2024-09-17T05:46:42.630 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:42.628+0000 7f5b2d294640 1 -- 172.21.15.150:0/1957026494 wait complete. 2024-09-17T05:46:42.630 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:42.630+0000 7f5b2d294640 1 Processor -- start 2024-09-17T05:46:42.631 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:42.630+0000 7f5b2d294640 1 -- start start 2024-09-17T05:46:42.634 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:42.632+0000 7f5b2d294640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5b280b6320 0x7f5b281fa130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:46:42.634 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:42.632+0000 7f5b2d294640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5b280b74b0 0x7f5b281e9350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:46:42.634 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:42.632+0000 7f5b2d294640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5b280d2e50 0x7f5b281dd330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:46:42.634 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:42.632+0000 7f5b2d294640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f5b280cf6b0 con 0x7f5b280d2e50 2024-09-17T05:46:42.634 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:42.632+0000 7f5b2d294640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f5b280cf530 con 0x7f5b280b74b0 2024-09-17T05:46:42.634 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:42.632+0000 7f5b2d294640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f5b280cf830 con 0x7f5b280b6320 2024-09-17T05:46:42.634 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:42.632+0000 7f5b277fe640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5b280d2e50 0x7f5b281dd330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:46:42.634 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:42.632+0000 7f5b277fe640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5b280d2e50 0x7f5b281dd330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:39106/0 (socket says 172.21.15.150:39106) 2024-09-17T05:46:42.634 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:42.632+0000 7f5b277fe640 1 -- 172.21.15.150:0/2152850262 learned_addr learned my addr 172.21.15.150:0/2152850262 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:46:42.634 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:42.632+0000 7f5b1e7fc640 1 --2- 172.21.15.150:0/2152850262 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5b280b74b0 0x7f5b281e9350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:46:42.634 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:42.632+0000 7f5b26ffd640 1 --2- 172.21.15.150:0/2152850262 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5b280b6320 0x7f5b281fa130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:46:42.635 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:42.632+0000 7f5b277fe640 1 -- 172.21.15.150:0/2152850262 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5b280b6320 msgr2=0x7f5b281fa130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:46:42.635 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:42.632+0000 7f5b277fe640 1 --2- 172.21.15.150:0/2152850262 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5b280b6320 0x7f5b281fa130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:42.635 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:42.632+0000 7f5b277fe640 1 -- 172.21.15.150:0/2152850262 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5b280b74b0 msgr2=0x7f5b281e9350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:46:42.635 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:42.632+0000 7f5b277fe640 1 --2- 172.21.15.150:0/2152850262 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5b280b74b0 0x7f5b281e9350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:42.635 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:42.632+0000 7f5b277fe640 1 -- 172.21.15.150:0/2152850262 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5b281fa670 con 0x7f5b280d2e50 2024-09-17T05:46:42.635 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:42.632+0000 7f5b1e7fc640 1 --2- 172.21.15.150:0/2152850262 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5b280b74b0 0x7f5b281e9350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T05:46:42.635 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:42.632+0000 7f5b26ffd640 1 --2- 172.21.15.150:0/2152850262 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5b280b6320 0x7f5b281fa130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T05:46:42.635 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:42.632+0000 7f5b277fe640 1 --2- 172.21.15.150:0/2152850262 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5b280d2e50 0x7f5b281dd330 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 crypto rx=0x7f5b20005fd0 tx=0x7f5b20003f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:46:42.635 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:42.632+0000 7f5b1ffff640 1 -- 172.21.15.150:0/2152850262 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b20034040 con 0x7f5b280d2e50 2024-09-17T05:46:42.635 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:42.633+0000 7f5b1ffff640 1 -- 172.21.15.150:0/2152850262 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f5b200046e0 con 0x7f5b280d2e50 2024-09-17T05:46:42.635 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:42.633+0000 7f5b2d294640 1 -- 172.21.15.150:0/2152850262 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5b281e9890 con 0x7f5b280d2e50 2024-09-17T05:46:42.635 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:42.633+0000 7f5b1ffff640 1 -- 172.21.15.150:0/2152850262 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b200456e0 con 0x7f5b280d2e50 2024-09-17T05:46:42.635 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:42.633+0000 7f5b2d294640 1 -- 172.21.15.150:0/2152850262 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5b281e8870 con 0x7f5b280d2e50 2024-09-17T05:46:42.637 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:42.634+0000 7f5b2d294640 1 -- 172.21.15.150:0/2152850262 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5b280d3d00 con 0x7f5b280d2e50 2024-09-17T05:46:42.637 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:42.634+0000 7f5b1ffff640 1 -- 172.21.15.150:0/2152850262 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 19) ==== 102563+0+0 (secure 0 0 0) 0x7f5b20037020 con 0x7f5b280d2e50 2024-09-17T05:46:42.637 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:42.635+0000 7f5b1ffff640 1 --2- 172.21.15.150:0/2152850262 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f5b08079820 0x7f5b0807bd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:46:42.637 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:42.635+0000 7f5b1ffff640 1 -- 172.21.15.150:0/2152850262 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(64..64 src has 1..64) ==== 4999+0+0 (secure 0 0 0) 0x7f5b200bb2c0 con 0x7f5b280d2e50 2024-09-17T05:46:42.637 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:42.635+0000 7f5b26ffd640 1 --2- 172.21.15.150:0/2152850262 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f5b08079820 0x7f5b0807bd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:46:42.637 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:42.636+0000 7f5b26ffd640 1 --2- 172.21.15.150:0/2152850262 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f5b08079820 0x7f5b0807bd30 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f5b1800b9e0 tx=0x7f5b18005c70 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:46:42.640 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:42.640+0000 7f5b1ffff640 1 -- 172.21.15.150:0/2152850262 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f5b280d3d00 con 0x7f5b280d2e50 2024-09-17T05:46:42.814 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:42.813+0000 7f5b2d294640 1 -- 172.21.15.150:0/2152850262 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "config reset", "num": 31} v 0) -- 0x7f5b280b78c0 con 0x7f5b280d2e50 2024-09-17T05:46:42.817 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:42.817+0000 7f5b1ffff640 1 -- 172.21.15.150:0/2152850262 <== mon.0 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "config reset", "num": 31}]=0 v40) ==== 71+0+0 (secure 0 0 0) 0x7f5b281fa670 con 0x7f5b280d2e50 2024-09-17T05:46:42.820 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:42.819+0000 7f5b2d294640 1 -- 172.21.15.150:0/2152850262 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f5b08079820 msgr2=0x7f5b0807bd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:46:42.820 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:42.819+0000 7f5b2d294640 1 --2- 172.21.15.150:0/2152850262 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f5b08079820 0x7f5b0807bd30 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f5b1800b9e0 tx=0x7f5b18005c70 comp rx=0 tx=0).stop 2024-09-17T05:46:42.820 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:42.819+0000 7f5b2d294640 1 -- 172.21.15.150:0/2152850262 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5b280d2e50 msgr2=0x7f5b281dd330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:46:42.820 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:42.819+0000 7f5b2d294640 1 --2- 172.21.15.150:0/2152850262 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5b280d2e50 0x7f5b281dd330 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 crypto rx=0x7f5b20005fd0 tx=0x7f5b20003f90 comp rx=0 tx=0).stop 2024-09-17T05:46:42.820 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:42.819+0000 7f5b2d294640 1 -- 172.21.15.150:0/2152850262 shutdown_connections 2024-09-17T05:46:42.821 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:42.819+0000 7f5b2d294640 1 --2- 172.21.15.150:0/2152850262 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5b280b74b0 0x7f5b281e9350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:42.821 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:42.819+0000 7f5b2d294640 1 --2- 172.21.15.150:0/2152850262 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f5b08079820 0x7f5b0807bd30 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:42.821 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:42.819+0000 7f5b2d294640 1 --2- 172.21.15.150:0/2152850262 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5b280d2e50 0x7f5b281dd330 unknown :-1 s=CLOSED pgs=744 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:42.821 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:42.819+0000 7f5b2d294640 1 --2- 172.21.15.150:0/2152850262 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5b280b6320 0x7f5b281fa130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:42.821 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:42.819+0000 7f5b2d294640 1 -- 172.21.15.150:0/2152850262 >> 172.21.15.150:0/2152850262 conn(0x7f5b2808bfe0 msgr2=0x7f5b280b7ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:46:42.821 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:42.819+0000 7f5b2d294640 1 -- 172.21.15.150:0/2152850262 shutdown_connections 2024-09-17T05:46:42.821 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:42.819+0000 7f5b2d294640 1 -- 172.21.15.150:0/2152850262 wait complete. 2024-09-17T05:46:42.831 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_volumes.TestCloneProgressReporter.test_clones_less_than_cloner_threads' 2024-09-17T05:46:42.950 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:42.950+0000 7f36eef32640 1 -- 172.21.15.150:0/4157685670 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f36d0004d40 msgr2=0x7f36d0005190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:46:42.951 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:42.950+0000 7f36eef32640 1 --2- 172.21.15.150:0/4157685670 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f36d0004d40 0x7f36d0005190 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 crypto rx=0x7f36e0002230 tx=0x7f36d0005830 comp rx=0 tx=0).stop 2024-09-17T05:46:42.951 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:42.950+0000 7f36ed4cf640 1 -- 172.21.15.150:0/4157685670 reap_dead start 2024-09-17T05:46:42.951 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:42.950+0000 7f36eef32640 1 -- 172.21.15.150:0/4157685670 shutdown_connections 2024-09-17T05:46:42.951 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:42.950+0000 7f36eef32640 1 -- 172.21.15.150:0/4157685670 >> 172.21.15.150:0/4157685670 conn(0x7f36e80cef30 msgr2=0x7f36e80cf340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:46:42.951 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:42.950+0000 7f36eef32640 1 -- 172.21.15.150:0/4157685670 shutdown_connections 2024-09-17T05:46:42.951 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:42.950+0000 7f36eef32640 1 -- 172.21.15.150:0/4157685670 wait complete. 2024-09-17T05:46:42.952 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:42.951+0000 7f36eef32640 1 Processor -- start 2024-09-17T05:46:42.952 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:42.951+0000 7f36eef32640 1 -- start start 2024-09-17T05:46:42.955 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:42.953+0000 7f36eef32640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f36e81f3400 0x7f36e80b2df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:46:42.955 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:42.953+0000 7f36eef32640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f36e81f73e0 0x7f36e81d6480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:46:42.955 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:42.953+0000 7f36eef32640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f36e81d8ad0 0x7f36e81d8ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:46:42.955 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:42.953+0000 7f36eef32640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f36e80cecf0 con 0x7f36e81d8ad0 2024-09-17T05:46:42.956 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:42.953+0000 7f36eef32640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f36e80ceb70 con 0x7f36e81f3400 2024-09-17T05:46:42.956 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:42.953+0000 7f36eef32640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f36e80cd180 con 0x7f36e81f73e0 2024-09-17T05:46:42.956 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:42.953+0000 7f36ed4cf640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f36e81d8ad0 0x7f36e81d8ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:46:42.956 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:42.953+0000 7f36ed4cf640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f36e81d8ad0 0x7f36e81d8ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:39132/0 (socket says 172.21.15.150:39132) 2024-09-17T05:46:42.956 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:42.953+0000 7f36ed4cf640 1 -- 172.21.15.150:0/474980478 learned_addr learned my addr 172.21.15.150:0/474980478 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:46:42.956 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:42.953+0000 7f36eccce640 1 --2- 172.21.15.150:0/474980478 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f36e81f3400 0x7f36e80b2df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:46:42.956 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:42.953+0000 7f36dffff640 1 --2- 172.21.15.150:0/474980478 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f36e81f73e0 0x7f36e81d6480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:46:42.956 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:42.953+0000 7f36ed4cf640 1 -- 172.21.15.150:0/474980478 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f36e81f73e0 msgr2=0x7f36e81d6480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:46:42.956 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:42.953+0000 7f36ed4cf640 1 --2- 172.21.15.150:0/474980478 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f36e81f73e0 0x7f36e81d6480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:42.956 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:42.953+0000 7f36ed4cf640 1 -- 172.21.15.150:0/474980478 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f36e81f3400 msgr2=0x7f36e80b2df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:46:42.956 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:42.953+0000 7f36ed4cf640 1 --2- 172.21.15.150:0/474980478 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f36e81f3400 0x7f36e80b2df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:42.956 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:42.953+0000 7f36ed4cf640 1 -- 172.21.15.150:0/474980478 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f36e81d9420 con 0x7f36e81d8ad0 2024-09-17T05:46:42.956 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:42.953+0000 7f36eccce640 1 --2- 172.21.15.150:0/474980478 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f36e81f3400 0x7f36e80b2df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:46:42.956 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:42.954+0000 7f36ed4cf640 1 --2- 172.21.15.150:0/474980478 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f36e81d8ad0 0x7f36e81d8ee0 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 crypto rx=0x7f36e002b450 tx=0x7f36e0004c90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:46:42.957 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:42.954+0000 7f36dd7fa640 1 -- 172.21.15.150:0/474980478 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36e002b9b0 con 0x7f36e81d8ad0 2024-09-17T05:46:42.957 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:42.954+0000 7f36dd7fa640 1 -- 172.21.15.150:0/474980478 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f36e002bc40 con 0x7f36e81d8ad0 2024-09-17T05:46:42.957 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:42.954+0000 7f36eef32640 1 -- 172.21.15.150:0/474980478 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f36e81f39d0 con 0x7f36e81d8ad0 2024-09-17T05:46:42.957 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:42.954+0000 7f36dd7fa640 1 -- 172.21.15.150:0/474980478 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36e00062d0 con 0x7f36e81d8ad0 2024-09-17T05:46:42.957 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:42.954+0000 7f36eef32640 1 -- 172.21.15.150:0/474980478 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f36e81f3f90 con 0x7f36e81d8ad0 2024-09-17T05:46:42.957 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:42.955+0000 7f36eef32640 1 -- 172.21.15.150:0/474980478 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f36e80d0590 con 0x7f36e81d8ad0 2024-09-17T05:46:42.958 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:42.955+0000 7f36dd7fa640 1 -- 172.21.15.150:0/474980478 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 19) ==== 102563+0+0 (secure 0 0 0) 0x7f36e0006470 con 0x7f36e81d8ad0 2024-09-17T05:46:42.958 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:42.956+0000 7f36dd7fa640 1 --2- 172.21.15.150:0/474980478 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f36d40797f0 0x7f36d407bd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:46:42.958 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:42.956+0000 7f36dd7fa640 1 -- 172.21.15.150:0/474980478 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(64..64 src has 1..64) ==== 4999+0+0 (secure 0 0 0) 0x7f36e00b9840 con 0x7f36e81d8ad0 2024-09-17T05:46:42.959 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:42.956+0000 7f36eccce640 1 --2- 172.21.15.150:0/474980478 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f36d40797f0 0x7f36d407bd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:46:42.959 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:42.957+0000 7f36eccce640 1 --2- 172.21.15.150:0/474980478 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f36d40797f0 0x7f36d407bd00 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f36e80cb580 tx=0x7f36e400b2e0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:46:42.961 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:42.960+0000 7f36dd7fa640 1 -- 172.21.15.150:0/474980478 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f36e0083730 con 0x7f36e81d8ad0 2024-09-17T05:46:43.206 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:43.206+0000 7f36eef32640 1 -- 172.21.15.150:0/474980478 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_volumes.TestCloneProgressReporter.test_clones_less_than_cloner_threads"]} v 0) -- 0x7f36e80c5b40 con 0x7f36e81d8ad0 2024-09-17T05:46:43.502 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:43.501+0000 7f36dd7fa640 1 -- 172.21.15.150:0/474980478 <== mon.0 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_volumes.TestCloneProgressReporter.test_clones_less_than_cloner_threads"]}]=0 v238) ==== 167+0+0 (secure 0 0 0) 0x7f36e0083030 con 0x7f36e81d8ad0 2024-09-17T05:46:43.504 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:43.503+0000 7f36eef32640 1 -- 172.21.15.150:0/474980478 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f36d40797f0 msgr2=0x7f36d407bd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:46:43.504 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:43.504+0000 7f36eef32640 1 --2- 172.21.15.150:0/474980478 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f36d40797f0 0x7f36d407bd00 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f36e80cb580 tx=0x7f36e400b2e0 comp rx=0 tx=0).stop 2024-09-17T05:46:43.505 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:43.504+0000 7f36eef32640 1 -- 172.21.15.150:0/474980478 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f36e81d8ad0 msgr2=0x7f36e81d8ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:46:43.505 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:43.504+0000 7f36eef32640 1 --2- 172.21.15.150:0/474980478 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f36e81d8ad0 0x7f36e81d8ee0 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 crypto rx=0x7f36e002b450 tx=0x7f36e0004c90 comp rx=0 tx=0).stop 2024-09-17T05:46:43.505 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:43.504+0000 7f36eef32640 1 -- 172.21.15.150:0/474980478 shutdown_connections 2024-09-17T05:46:43.505 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:43.504+0000 7f36eef32640 1 --2- 172.21.15.150:0/474980478 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f36d40797f0 0x7f36d407bd00 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:43.505 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:43.504+0000 7f36eef32640 1 --2- 172.21.15.150:0/474980478 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f36e81d8ad0 0x7f36e81d8ee0 unknown :-1 s=CLOSED pgs=747 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:43.505 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:43.504+0000 7f36eef32640 1 --2- 172.21.15.150:0/474980478 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f36e81f73e0 0x7f36e81d6480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:43.505 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:43.504+0000 7f36eef32640 1 --2- 172.21.15.150:0/474980478 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f36e81f3400 0x7f36e80b2df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:43.505 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:43.504+0000 7f36eef32640 1 -- 172.21.15.150:0/474980478 >> 172.21.15.150:0/474980478 conn(0x7f36e80cef30 msgr2=0x7f36e809d060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:46:43.505 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:43.504+0000 7f36eef32640 1 -- 172.21.15.150:0/474980478 shutdown_connections 2024-09-17T05:46:43.506 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:43.504+0000 7f36eef32640 1 -- 172.21.15.150:0/474980478 wait complete. 2024-09-17T05:46:43.516 INFO:tasks.cephfs_test_runner:Test that one progress bar is printed in output of "ceph status" output ... ok 2024-09-17T05:46:43.517 INFO:tasks.cephfs_test_runner:Starting test: test_clones_more_than_cloner_threads (tasks.cephfs.test_volumes.TestCloneProgressReporter) Test that 2 progress bars are printed in output of "ceph status" 2024-09-17T05:46:43.517 INFO:tasks.cephfs_test_runner:test_clones_more_than_cloner_threads (tasks.cephfs.test_volumes.TestCloneProgressReporter) 2024-09-17T05:46:43.517 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T05:46:43.630 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:43.629+0000 7f8aca0f9640 1 -- 172.21.15.150:0/3284559179 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8ac415f910 msgr2=0x7f8ac40b3750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:46:43.630 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:43.629+0000 7f8aca0f9640 1 --2- 172.21.15.150:0/3284559179 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8ac415f910 0x7f8ac40b3750 secure :-1 s=READY pgs=748 cs=0 l=1 rev1=1 crypto rx=0x7f8ac406f3c0 tx=0x7f8abc02a980 comp rx=0 tx=0).stop 2024-09-17T05:46:43.630 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:43.629+0000 7f8aca0f9640 1 -- 172.21.15.150:0/3284559179 shutdown_connections 2024-09-17T05:46:43.630 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:43.629+0000 7f8aca0f9640 1 --2- 172.21.15.150:0/3284559179 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8ac415f910 0x7f8ac40b3750 unknown :-1 s=CLOSED pgs=748 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:43.630 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:43.629+0000 7f8aca0f9640 1 --2- 172.21.15.150:0/3284559179 >> v2:172.21.15.176:3300/0 conn(0x7f8ac4152920 0x7f8ac415f3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:43.630 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:43.629+0000 7f8aca0f9640 1 -- 172.21.15.150:0/3284559179 >> 172.21.15.150:0/3284559179 conn(0x7f8ac406d730 msgr2=0x7f8ac40b1e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:46:43.630 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:43.629+0000 7f8aca0f9640 1 -- 172.21.15.150:0/3284559179 shutdown_connections 2024-09-17T05:46:43.631 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:43.629+0000 7f8aca0f9640 1 -- 172.21.15.150:0/3284559179 wait complete. 2024-09-17T05:46:43.631 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:43.631+0000 7f8aca0f9640 1 Processor -- start 2024-09-17T05:46:43.631 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:43.631+0000 7f8aca0f9640 1 -- start start 2024-09-17T05:46:43.634 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:43.632+0000 7f8aca0f9640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8ac40aebc0 0x7f8ac40cc9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:46:43.634 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:43.632+0000 7f8aca0f9640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8ac4152920 0x7f8ac4141a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:46:43.634 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:43.632+0000 7f8aca0f9640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8ac415f910 0x7f8ac4141fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:46:43.634 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:43.632+0000 7f8aca0f9640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f8ac40b40d0 con 0x7f8ac415f910 2024-09-17T05:46:43.634 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:43.632+0000 7f8aca0f9640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f8ac40b3f50 con 0x7f8ac40aebc0 2024-09-17T05:46:43.634 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:43.632+0000 7f8aca0f9640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f8ac40b4250 con 0x7f8ac4152920 2024-09-17T05:46:43.634 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:43.632+0000 7f8ac3fff640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8ac415f910 0x7f8ac4141fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:46:43.635 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:43.632+0000 7f8ac3fff640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8ac415f910 0x7f8ac4141fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:39152/0 (socket says 172.21.15.150:39152) 2024-09-17T05:46:43.635 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:43.632+0000 7f8ac3fff640 1 -- 172.21.15.150:0/2541153658 learned_addr learned my addr 172.21.15.150:0/2541153658 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:46:43.635 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:43.632+0000 7f8ac37fe640 1 --2- 172.21.15.150:0/2541153658 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8ac40aebc0 0x7f8ac40cc9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:46:43.635 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:43.632+0000 7f8ac2ffd640 1 --2- 172.21.15.150:0/2541153658 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8ac4152920 0x7f8ac4141a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:46:43.635 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:43.633+0000 7f8ac3fff640 1 -- 172.21.15.150:0/2541153658 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8ac4152920 msgr2=0x7f8ac4141a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:46:43.635 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:43.633+0000 7f8ac3fff640 1 --2- 172.21.15.150:0/2541153658 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8ac4152920 0x7f8ac4141a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:43.635 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:43.633+0000 7f8ac3fff640 1 -- 172.21.15.150:0/2541153658 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8ac40aebc0 msgr2=0x7f8ac40cc9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:46:43.635 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:43.633+0000 7f8ac3fff640 1 --2- 172.21.15.150:0/2541153658 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8ac40aebc0 0x7f8ac40cc9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:43.635 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:43.633+0000 7f8ac3fff640 1 -- 172.21.15.150:0/2541153658 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8ac41f36b0 con 0x7f8ac415f910 2024-09-17T05:46:43.635 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:43.633+0000 7f8ac3fff640 1 --2- 172.21.15.150:0/2541153658 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8ac415f910 0x7f8ac4141fb0 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 crypto rx=0x7f8abc009d60 tx=0x7f8abc003ef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:46:43.635 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:43.633+0000 7f8aabfff640 1 -- 172.21.15.150:0/2541153658 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8abc034040 con 0x7f8ac415f910 2024-09-17T05:46:43.635 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:43.633+0000 7f8aabfff640 1 -- 172.21.15.150:0/2541153658 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8abc004640 con 0x7f8ac415f910 2024-09-17T05:46:43.636 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:43.633+0000 7f8aca0f9640 1 -- 172.21.15.150:0/2541153658 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8ac40ce920 con 0x7f8ac415f910 2024-09-17T05:46:43.636 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:43.633+0000 7f8aabfff640 1 -- 172.21.15.150:0/2541153658 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8abc045480 con 0x7f8ac415f910 2024-09-17T05:46:43.636 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:43.633+0000 7f8aca0f9640 1 -- 172.21.15.150:0/2541153658 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8ac40ceee0 con 0x7f8ac415f910 2024-09-17T05:46:43.637 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:43.634+0000 7f8aca0f9640 1 -- 172.21.15.150:0/2541153658 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8ac414dd50 con 0x7f8ac415f910 2024-09-17T05:46:43.637 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:43.635+0000 7f8aabfff640 1 -- 172.21.15.150:0/2541153658 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 19) ==== 102563+0+0 (secure 0 0 0) 0x7f8abc037020 con 0x7f8ac415f910 2024-09-17T05:46:43.637 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:43.635+0000 7f8aabfff640 1 --2- 172.21.15.150:0/2541153658 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f8ab00797f0 0x7f8ab007bd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:46:43.637 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:43.635+0000 7f8aabfff640 1 -- 172.21.15.150:0/2541153658 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(64..64 src has 1..64) ==== 4999+0+0 (secure 0 0 0) 0x7f8abc0baf70 con 0x7f8ac415f910 2024-09-17T05:46:43.637 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:43.636+0000 7f8ac37fe640 1 --2- 172.21.15.150:0/2541153658 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f8ab00797f0 0x7f8ab007bd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:46:43.637 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:43.636+0000 7f8ac37fe640 1 --2- 172.21.15.150:0/2541153658 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f8ab00797f0 0x7f8ab007bd00 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f8ab4006fd0 tx=0x7f8ab4009060 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:46:43.640 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:43.640+0000 7f8aabfff640 1 -- 172.21.15.150:0/2541153658 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f8ac415fd20 con 0x7f8ac415f910 2024-09-17T05:46:43.817 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:43.817+0000 7f8aca0f9640 1 -- 172.21.15.150:0/2541153658 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f8ac40b4840 con 0x7f8ac415f910 2024-09-17T05:46:43.818 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:43.818+0000 7f8aabfff640 1 -- 172.21.15.150:0/2541153658 <== mon.0 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v64) ==== 74+0+13157 (secure 0 0 0) 0x7f8abc084820 con 0x7f8ac415f910 2024-09-17T05:46:43.818 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-09-17T05:46:43.818 INFO:teuthology.orchestra.run.smithi150.stdout:{"epoch":64,"fsid":"9f2e05e9-d629-47b3-b26b-1360655b7d20","created":"2024-09-17T05:41:32.502979+0000","modified":"2024-09-17T05:46:42.489956+0000","last_up_change":"2024-09-17T05:41:46.150225+0000","last_in_change":"2024-09-17T05:41:36.120274+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T05:41:46.860779+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"4f31c018-c8a4-4d6d-b0c2-a597c47aae4a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6800","nonce":479374392},{"type":"v1","addr":"172.21.15.150:6801","nonce":479374392}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6802","nonce":479374392},{"type":"v1","addr":"172.21.15.150:6803","nonce":479374392}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6806","nonce":479374392},{"type":"v1","addr":"172.21.15.150:6807","nonce":479374392}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6804","nonce":479374392},{"type":"v1","addr":"172.21.15.150:6805","nonce":479374392}]},"public_addr":"172.21.15.150:6801/479374392","cluster_addr":"172.21.15.150:6803/479374392","heartbeat_back_addr":"172.21.15.150:6807/479374392","heartbeat_front_addr":"172.21.15.150:6805/479374392","state":["exists","up"]},{"osd":1,"uuid":"6ff4a573-500b-4e04-9de3-39265ead78b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6824","nonce":913899800},{"type":"v1","addr":"172.21.15.150:6825","nonce":913899800}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6826","nonce":913899800},{"type":"v1","addr":"172.21.15.150:6827","nonce":913899800}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6830","nonce":913899800},{"type":"v1","addr":"172.21.15.150:6831","nonce":913899800}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6828","nonce":913899800},{"type":"v1","addr":"172.21.15.150:6829","nonce":913899800}]},"public_addr":"172.21.15.150:6825/913899800","cluster_addr":"172.21.15.150:6827/913899800","heartbeat_back_addr":"172.21.15.150:6831/913899800","heartbeat_front_addr":"172.21.15.150:6829/913899800","state":["exists","up"]},{"osd":2,"uuid":"bffea6f9-2465-4182-b205-00436c41ac1c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6816","nonce":363718461},{"type":"v1","addr":"172.21.15.150:6817","nonce":363718461}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6818","nonce":363718461},{"type":"v1","addr":"172.21.15.150:6819","nonce":363718461}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6822","nonce":363718461},{"type":"v1","addr":"172.21.15.150:6823","nonce":363718461}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6820","nonce":363718461},{"type":"v1","addr":"172.21.15.150:6821","nonce":363718461}]},"public_addr":"172.21.15.150:6817/363718461","cluster_addr":"172.21.15.150:6819/363718461","heartbeat_back_addr":"172.21.15.150:6823/363718461","heartbeat_front_addr":"172.21.15.150:6821/363718461","state":["exists","up"]},{"osd":3,"uuid":"cda70430-d1e1-427e-b04e-56db4031d078","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6808","nonce":3550994626},{"type":"v1","addr":"172.21.15.150:6809","nonce":3550994626}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6810","nonce":3550994626},{"type":"v1","addr":"172.21.15.150:6811","nonce":3550994626}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6814","nonce":3550994626},{"type":"v1","addr":"172.21.15.150:6815","nonce":3550994626}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6812","nonce":3550994626},{"type":"v1","addr":"172.21.15.150:6813","nonce":3550994626}]},"public_addr":"172.21.15.150:6809/3550994626","cluster_addr":"172.21.15.150:6811/3550994626","heartbeat_back_addr":"172.21.15.150:6815/3550994626","heartbeat_front_addr":"172.21.15.150:6813/3550994626","state":["exists","up"]},{"osd":4,"uuid":"3a0277fb-5e1e-4f68-bb2d-9a8a0152f64a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6810","nonce":2718261497},{"type":"v1","addr":"172.21.15.176:6811","nonce":2718261497}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6812","nonce":2718261497},{"type":"v1","addr":"172.21.15.176:6813","nonce":2718261497}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6816","nonce":2718261497},{"type":"v1","addr":"172.21.15.176:6817","nonce":2718261497}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6814","nonce":2718261497},{"type":"v1","addr":"172.21.15.176:6815","nonce":2718261497}]},"public_addr":"172.21.15.176:6811/2718261497","cluster_addr":"172.21.15.176:6813/2718261497","heartbeat_back_addr":"172.21.15.176:6817/2718261497","heartbeat_front_addr":"172.21.15.176:6815/2718261497","state":["exists","up"]},{"osd":5,"uuid":"33aebee6-0315-40b7-a11c-6702f0be494d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6818","nonce":2049295774},{"type":"v1","addr":"172.21.15.176:6819","nonce":2049295774}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6820","nonce":2049295774},{"type":"v1","addr":"172.21.15.176:6821","nonce":2049295774}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6824","nonce":2049295774},{"type":"v1","addr":"172.21.15.176:6825","nonce":2049295774}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6822","nonce":2049295774},{"type":"v1","addr":"172.21.15.176:6823","nonce":2049295774}]},"public_addr":"172.21.15.176:6819/2049295774","cluster_addr":"172.21.15.176:6821/2049295774","heartbeat_back_addr":"172.21.15.176:6825/2049295774","heartbeat_front_addr":"172.21.15.176:6823/2049295774","state":["exists","up"]},{"osd":6,"uuid":"4d24f360-6751-4263-841b-d77793d33540","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6826","nonce":2164458476},{"type":"v1","addr":"172.21.15.176:6827","nonce":2164458476}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6828","nonce":2164458476},{"type":"v1","addr":"172.21.15.176:6829","nonce":2164458476}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6832","nonce":2164458476},{"type":"v1","addr":"172.21.15.176:6833","nonce":2164458476}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6830","nonce":2164458476},{"type":"v1","addr":"172.21.15.176:6831","nonce":2164458476}]},"public_addr":"172.21.15.176:6827/2164458476","cluster_addr":"172.21.15.176:6829/2164458476","heartbeat_back_addr":"172.21.15.176:6833/2164458476","heartbeat_front_addr":"172.21.15.176:6831/2164458476","state":["exists","up"]},{"osd":7,"uuid":"c8594fda-c74a-4ba9-8277-caf101d58ca1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6802","nonce":3239587708},{"type":"v1","addr":"172.21.15.176:6803","nonce":3239587708}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6804","nonce":3239587708},{"type":"v1","addr":"172.21.15.176:6805","nonce":3239587708}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6808","nonce":3239587708},{"type":"v1","addr":"172.21.15.176:6809","nonce":3239587708}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6806","nonce":3239587708},{"type":"v1","addr":"172.21.15.176:6807","nonce":3239587708}]},"public_addr":"172.21.15.176:6803/3239587708","cluster_addr":"172.21.15.176:6805/3239587708","heartbeat_back_addr":"172.21.15.176:6809/3239587708","heartbeat_front_addr":"172.21.15.176:6807/3239587708","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:41:41.905151+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:41:42.705679+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:41:42.459673+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:41:42.440819+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:41:42.668428+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:41:42.694972+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:41:43.078535+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:41:42.363539+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.150:6835/3434025708":"2024-09-18T05:46:39.485249+0000","172.21.15.150:6833/3434025708":"2024-09-18T05:46:39.485249+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":7,"snaps":[{"begin":2,"length":2}]},{"pool":9,"snaps":[{"begin":2,"length":2}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T05:46:43.821 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:43.820+0000 7f8aca0f9640 1 -- 172.21.15.150:0/2541153658 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f8ab00797f0 msgr2=0x7f8ab007bd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:46:43.821 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:43.820+0000 7f8aca0f9640 1 --2- 172.21.15.150:0/2541153658 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f8ab00797f0 0x7f8ab007bd00 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f8ab4006fd0 tx=0x7f8ab4009060 comp rx=0 tx=0).stop 2024-09-17T05:46:43.821 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:43.820+0000 7f8aca0f9640 1 -- 172.21.15.150:0/2541153658 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8ac415f910 msgr2=0x7f8ac4141fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:46:43.821 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:43.820+0000 7f8aca0f9640 1 --2- 172.21.15.150:0/2541153658 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8ac415f910 0x7f8ac4141fb0 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 crypto rx=0x7f8abc009d60 tx=0x7f8abc003ef0 comp rx=0 tx=0).stop 2024-09-17T05:46:43.821 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:43.820+0000 7f8aca0f9640 1 -- 172.21.15.150:0/2541153658 shutdown_connections 2024-09-17T05:46:43.821 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:43.820+0000 7f8aca0f9640 1 --2- 172.21.15.150:0/2541153658 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f8ab00797f0 0x7f8ab007bd00 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:43.822 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:43.820+0000 7f8aca0f9640 1 --2- 172.21.15.150:0/2541153658 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8ac415f910 0x7f8ac4141fb0 unknown :-1 s=CLOSED pgs=749 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:43.822 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:43.820+0000 7f8aca0f9640 1 --2- 172.21.15.150:0/2541153658 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8ac4152920 0x7f8ac4141a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:43.822 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:43.820+0000 7f8aca0f9640 1 --2- 172.21.15.150:0/2541153658 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8ac40aebc0 0x7f8ac40cc9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:43.822 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:43.820+0000 7f8aca0f9640 1 -- 172.21.15.150:0/2541153658 >> 172.21.15.150:0/2541153658 conn(0x7f8ac406d730 msgr2=0x7f8ac415f1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:46:43.822 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:43.820+0000 7f8aca0f9640 1 -- 172.21.15.150:0/2541153658 shutdown_connections 2024-09-17T05:46:43.822 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:43.820+0000 7f8aca0f9640 1 -- 172.21.15.150:0/2541153658 wait complete. 2024-09-17T05:46:43.832 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-17T05:41:46.860779+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-17T05:46:43.833 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-17T05:46:43.951 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:43.950+0000 7fb09044d640 1 -- 172.21.15.150:0/2112265444 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb074004800 msgr2=0x7fb074004c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:46:43.951 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:43.950+0000 7fb09044d640 1 --2- 172.21.15.150:0/2112265444 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb074004800 0x7fb074004c10 secure :-1 s=READY pgs=751 cs=0 l=1 rev1=1 crypto rx=0x7fb078009d00 tx=0x7fb074005830 comp rx=0 tx=0).stop 2024-09-17T05:46:43.951 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:43.950+0000 7fb09044d640 1 -- 172.21.15.150:0/2112265444 shutdown_connections 2024-09-17T05:46:43.951 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:43.950+0000 7fb09044d640 1 --2- 172.21.15.150:0/2112265444 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb074004800 0x7fb074004c10 unknown :-1 s=CLOSED pgs=751 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:43.951 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:43.950+0000 7fb09044d640 1 -- 172.21.15.150:0/2112265444 >> 172.21.15.150:0/2112265444 conn(0x7fb0880d4680 msgr2=0x7fb0880d4a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:46:43.951 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:43.950+0000 7fb09044d640 1 -- 172.21.15.150:0/2112265444 shutdown_connections 2024-09-17T05:46:43.951 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:43.950+0000 7fb09044d640 1 -- 172.21.15.150:0/2112265444 wait complete. 2024-09-17T05:46:43.952 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:43.952+0000 7fb09044d640 1 Processor -- start 2024-09-17T05:46:43.952 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:43.952+0000 7fb09044d640 1 -- start start 2024-09-17T05:46:43.955 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:43.953+0000 7fb09044d640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb074004800 0x7fb08815aea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:46:43.955 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:43.953+0000 7fb09044d640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb08815b6a0 0x7fb0880b4ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:46:43.955 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:43.953+0000 7fb09044d640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb0880b5530 0x7fb088165990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:46:43.955 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:43.953+0000 7fb09044d640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7fb088162c50 con 0x7fb08815b6a0 2024-09-17T05:46:43.955 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:43.953+0000 7fb09044d640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fb088162ad0 con 0x7fb0880b5530 2024-09-17T05:46:43.955 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:43.953+0000 7fb09044d640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fb088162dd0 con 0x7fb074004800 2024-09-17T05:46:43.955 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:43.953+0000 7fb08d9e8640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb08815b6a0 0x7fb0880b4ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:46:43.956 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:43.953+0000 7fb08d9e8640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb08815b6a0 0x7fb0880b4ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:39178/0 (socket says 172.21.15.150:39178) 2024-09-17T05:46:43.956 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:43.953+0000 7fb08d9e8640 1 -- 172.21.15.150:0/87993331 learned_addr learned my addr 172.21.15.150:0/87993331 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:46:43.956 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:43.953+0000 7fb08e1e9640 1 --2- 172.21.15.150:0/87993331 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb074004800 0x7fb08815aea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:46:43.956 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:43.953+0000 7fb08e9ea640 1 --2- 172.21.15.150:0/87993331 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb0880b5530 0x7fb088165990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:46:43.956 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:43.953+0000 7fb08d9e8640 1 -- 172.21.15.150:0/87993331 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb074004800 msgr2=0x7fb08815aea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:46:43.956 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:43.953+0000 7fb08d9e8640 1 --2- 172.21.15.150:0/87993331 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb074004800 0x7fb08815aea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:43.956 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:43.953+0000 7fb08d9e8640 1 -- 172.21.15.150:0/87993331 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb0880b5530 msgr2=0x7fb088165990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:46:43.956 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:43.953+0000 7fb08d9e8640 1 --2- 172.21.15.150:0/87993331 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb0880b5530 0x7fb088165990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:43.956 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:43.953+0000 7fb08d9e8640 1 -- 172.21.15.150:0/87993331 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb0880b5940 con 0x7fb08815b6a0 2024-09-17T05:46:43.956 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:43.954+0000 7fb08d9e8640 1 --2- 172.21.15.150:0/87993331 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb08815b6a0 0x7fb0880b4ff0 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 crypto rx=0x7fb078009c20 tx=0x7fb0780038a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:46:43.956 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:43.954+0000 7fb07effd640 1 -- 172.21.15.150:0/87993331 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb078038040 con 0x7fb08815b6a0 2024-09-17T05:46:43.957 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:43.954+0000 7fb07effd640 1 -- 172.21.15.150:0/87993331 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb07802b9f0 con 0x7fb08815b6a0 2024-09-17T05:46:43.957 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:43.954+0000 7fb09044d640 1 -- 172.21.15.150:0/87993331 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb0880cafc0 con 0x7fb08815b6a0 2024-09-17T05:46:43.957 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:43.954+0000 7fb07effd640 1 -- 172.21.15.150:0/87993331 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb078003cf0 con 0x7fb08815b6a0 2024-09-17T05:46:43.957 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:43.954+0000 7fb09044d640 1 -- 172.21.15.150:0/87993331 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb088164eb0 con 0x7fb08815b6a0 2024-09-17T05:46:43.958 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:43.955+0000 7fb09044d640 1 -- 172.21.15.150:0/87993331 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb0880cad30 con 0x7fb08815b6a0 2024-09-17T05:46:43.958 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:43.956+0000 7fb07effd640 1 -- 172.21.15.150:0/87993331 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 19) ==== 102563+0+0 (secure 0 0 0) 0x7fb078043020 con 0x7fb08815b6a0 2024-09-17T05:46:43.958 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:43.956+0000 7fb07effd640 1 --2- 172.21.15.150:0/87993331 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fb06c079820 0x7fb06c07bd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:46:43.958 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:43.956+0000 7fb07effd640 1 -- 172.21.15.150:0/87993331 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(64..64 src has 1..64) ==== 4999+0+0 (secure 0 0 0) 0x7fb0780ba620 con 0x7fb08815b6a0 2024-09-17T05:46:43.958 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:43.957+0000 7fb08e1e9640 1 --2- 172.21.15.150:0/87993331 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fb06c079820 0x7fb06c07bd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:46:43.958 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:43.957+0000 7fb08e1e9640 1 --2- 172.21.15.150:0/87993331 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fb06c079820 0x7fb06c07bd30 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7fb084006fd0 tx=0x7fb084006bc0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:46:43.960 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:43.960+0000 7fb07effd640 1 -- 172.21.15.150:0/87993331 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fb07804a020 con 0x7fb08815b6a0 2024-09-17T05:46:44.136 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:44.136+0000 7fb09044d640 1 -- 172.21.15.150:0/87993331 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fb08808d090 con 0x7fb08815b6a0 2024-09-17T05:46:44.137 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:44.136+0000 7fb07effd640 1 -- 172.21.15.150:0/87993331 <== mon.0 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v64) ==== 93+0+10 (secure 0 0 0) 0x7fb08808d090 con 0x7fb08815b6a0 2024-09-17T05:46:44.137 INFO:teuthology.orchestra.run.smithi150.stdout:pg_num: 1 2024-09-17T05:46:44.139 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:44.138+0000 7fb09044d640 1 -- 172.21.15.150:0/87993331 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fb06c079820 msgr2=0x7fb06c07bd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:46:44.139 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:44.138+0000 7fb09044d640 1 --2- 172.21.15.150:0/87993331 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fb06c079820 0x7fb06c07bd30 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7fb084006fd0 tx=0x7fb084006bc0 comp rx=0 tx=0).stop 2024-09-17T05:46:44.139 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:44.138+0000 7fb09044d640 1 -- 172.21.15.150:0/87993331 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb08815b6a0 msgr2=0x7fb0880b4ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:46:44.139 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:44.138+0000 7fb09044d640 1 --2- 172.21.15.150:0/87993331 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb08815b6a0 0x7fb0880b4ff0 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 crypto rx=0x7fb078009c20 tx=0x7fb0780038a0 comp rx=0 tx=0).stop 2024-09-17T05:46:44.140 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:44.138+0000 7fb09044d640 1 -- 172.21.15.150:0/87993331 shutdown_connections 2024-09-17T05:46:44.140 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:44.138+0000 7fb09044d640 1 --2- 172.21.15.150:0/87993331 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb0880b5530 0x7fb088165990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:44.140 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:44.138+0000 7fb09044d640 1 --2- 172.21.15.150:0/87993331 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fb06c079820 0x7fb06c07bd30 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:44.140 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:44.138+0000 7fb09044d640 1 --2- 172.21.15.150:0/87993331 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb08815b6a0 0x7fb0880b4ff0 unknown :-1 s=CLOSED pgs=752 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:44.140 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:44.138+0000 7fb09044d640 1 --2- 172.21.15.150:0/87993331 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb074004800 0x7fb08815aea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:44.140 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:44.138+0000 7fb09044d640 1 -- 172.21.15.150:0/87993331 >> 172.21.15.150:0/87993331 conn(0x7fb0880d4680 msgr2=0x7fb0880b25c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:46:44.140 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:44.138+0000 7fb09044d640 1 -- 172.21.15.150:0/87993331 shutdown_connections 2024-09-17T05:46:44.140 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:44.138+0000 7fb09044d640 1 -- 172.21.15.150:0/87993331 wait complete. 2024-09-17T05:46:44.151 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_volumes.TestCloneProgressReporter.test_clones_more_than_cloner_threads' 2024-09-17T05:46:44.265 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:44.264+0000 7fcc9ccf2640 1 -- 172.21.15.150:0/3125675314 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fcc980b3550 msgr2=0x7fcc980b3960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:46:44.265 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:44.264+0000 7fcc9ccf2640 1 --2- 172.21.15.150:0/3125675314 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fcc980b3550 0x7fcc980b3960 secure :-1 s=READY pgs=754 cs=0 l=1 rev1=1 crypto rx=0x7fcc98072d60 tx=0x7fcc9002a820 comp rx=0 tx=0).stop 2024-09-17T05:46:44.265 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:44.264+0000 7fcc9ccf2640 1 -- 172.21.15.150:0/3125675314 shutdown_connections 2024-09-17T05:46:44.265 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:44.264+0000 7fcc9ccf2640 1 --2- 172.21.15.150:0/3125675314 >> v2:172.21.15.176:3300/0 conn(0x7fcc980ad0e0 0x7fcc980ad4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:44.265 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:44.264+0000 7fcc9ccf2640 1 --2- 172.21.15.150:0/3125675314 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fcc980b3550 0x7fcc980b3960 unknown :-1 s=CLOSED pgs=754 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:44.265 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:44.264+0000 7fcc9ccf2640 1 -- 172.21.15.150:0/3125675314 >> 172.21.15.150:0/3125675314 conn(0x7fcc9806d730 msgr2=0x7fcc980b1e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:46:44.266 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:44.264+0000 7fcc9ccf2640 1 -- 172.21.15.150:0/3125675314 shutdown_connections 2024-09-17T05:46:44.266 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:44.264+0000 7fcc9ccf2640 1 -- 172.21.15.150:0/3125675314 wait complete. 2024-09-17T05:46:44.266 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:44.266+0000 7fcc9ccf2640 1 Processor -- start 2024-09-17T05:46:44.266 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:44.266+0000 7fcc9ccf2640 1 -- start start 2024-09-17T05:46:44.270 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:44.267+0000 7fcc9ccf2640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fcc980ad0e0 0x7fcc9815be40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:46:44.270 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:44.267+0000 7fcc9ccf2640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fcc980b3550 0x7fcc981443a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:46:44.270 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:44.267+0000 7fcc9ccf2640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fcc9815d760 0x7fcc981448e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:46:44.270 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:44.267+0000 7fcc9ccf2640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7fcc980b4da0 con 0x7fcc9815d760 2024-09-17T05:46:44.270 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:44.267+0000 7fcc9ccf2640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fcc980b4c20 con 0x7fcc980ad0e0 2024-09-17T05:46:44.270 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:44.267+0000 7fcc9ccf2640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fcc980b3ea0 con 0x7fcc980b3550 2024-09-17T05:46:44.270 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:44.267+0000 7fcc96d9d640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fcc9815d760 0x7fcc981448e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:46:44.270 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:44.267+0000 7fcc96d9d640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fcc9815d760 0x7fcc981448e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:39192/0 (socket says 172.21.15.150:39192) 2024-09-17T05:46:44.270 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:44.267+0000 7fcc96d9d640 1 -- 172.21.15.150:0/956093409 learned_addr learned my addr 172.21.15.150:0/956093409 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:46:44.270 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:44.268+0000 7fcc9659c640 1 --2- 172.21.15.150:0/956093409 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fcc980ad0e0 0x7fcc9815be40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:46:44.271 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:44.268+0000 7fcc95d9b640 1 --2- 172.21.15.150:0/956093409 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fcc980b3550 0x7fcc981443a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:46:44.271 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:44.268+0000 7fcc96d9d640 1 -- 172.21.15.150:0/956093409 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fcc980b3550 msgr2=0x7fcc981443a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:46:44.271 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:44.268+0000 7fcc96d9d640 1 --2- 172.21.15.150:0/956093409 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fcc980b3550 0x7fcc981443a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:44.271 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:44.268+0000 7fcc96d9d640 1 -- 172.21.15.150:0/956093409 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fcc980ad0e0 msgr2=0x7fcc9815be40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:46:44.271 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:44.268+0000 7fcc96d9d640 1 --2- 172.21.15.150:0/956093409 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fcc980ad0e0 0x7fcc9815be40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:44.271 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:44.268+0000 7fcc96d9d640 1 -- 172.21.15.150:0/956093409 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcc981f47e0 con 0x7fcc9815d760 2024-09-17T05:46:44.271 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:44.268+0000 7fcc9659c640 1 --2- 172.21.15.150:0/956093409 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fcc980ad0e0 0x7fcc9815be40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:46:44.271 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:44.268+0000 7fcc95d9b640 1 --2- 172.21.15.150:0/956093409 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fcc980b3550 0x7fcc981443a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:46:44.271 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:44.268+0000 7fcc96d9d640 1 --2- 172.21.15.150:0/956093409 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fcc9815d760 0x7fcc981448e0 secure :-1 s=READY pgs=755 cs=0 l=1 rev1=1 crypto rx=0x7fcc90009ca0 tx=0x7fcc90032c90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:46:44.271 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:44.268+0000 7fcc86ffd640 1 -- 172.21.15.150:0/956093409 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc9003f020 con 0x7fcc9815d760 2024-09-17T05:46:44.271 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:44.268+0000 7fcc86ffd640 1 -- 172.21.15.150:0/956093409 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fcc90004040 con 0x7fcc9815d760 2024-09-17T05:46:44.271 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:44.268+0000 7fcc9ccf2640 1 -- 172.21.15.150:0/956093409 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcc981f3c60 con 0x7fcc9815d760 2024-09-17T05:46:44.271 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:44.268+0000 7fcc86ffd640 1 -- 172.21.15.150:0/956093409 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc90037040 con 0x7fcc9815d760 2024-09-17T05:46:44.272 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:44.268+0000 7fcc9ccf2640 1 -- 172.21.15.150:0/956093409 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcc981f4220 con 0x7fcc9815d760 2024-09-17T05:46:44.272 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:44.269+0000 7fcc9ccf2640 1 -- 172.21.15.150:0/956093409 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcc981f39d0 con 0x7fcc9815d760 2024-09-17T05:46:44.272 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:44.270+0000 7fcc86ffd640 1 -- 172.21.15.150:0/956093409 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 19) ==== 102563+0+0 (secure 0 0 0) 0x7fcc90042020 con 0x7fcc9815d760 2024-09-17T05:46:44.272 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:44.270+0000 7fcc86ffd640 1 --2- 172.21.15.150:0/956093409 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fcc780797f0 0x7fcc7807bd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:46:44.273 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:44.271+0000 7fcc86ffd640 1 -- 172.21.15.150:0/956093409 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(64..64 src has 1..64) ==== 4999+0+0 (secure 0 0 0) 0x7fcc900b9f50 con 0x7fcc9815d760 2024-09-17T05:46:44.273 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:44.271+0000 7fcc9659c640 1 --2- 172.21.15.150:0/956093409 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fcc780797f0 0x7fcc7807bd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:46:44.273 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:44.271+0000 7fcc9659c640 1 --2- 172.21.15.150:0/956093409 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fcc780797f0 0x7fcc7807bd00 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7fcc88000f60 tx=0x7fcc88009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:46:44.275 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:44.275+0000 7fcc86ffd640 1 -- 172.21.15.150:0/956093409 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fcc90049030 con 0x7fcc9815d760 2024-09-17T05:46:44.521 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:44.520+0000 7fcc9ccf2640 1 -- 172.21.15.150:0/956093409 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_volumes.TestCloneProgressReporter.test_clones_more_than_cloner_threads"]} v 0) -- 0x7fcc980b4370 con 0x7fcc9815d760 2024-09-17T05:46:45.510 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:45.509+0000 7fcc86ffd640 1 -- 172.21.15.150:0/956093409 <== mon.0 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_volumes.TestCloneProgressReporter.test_clones_more_than_cloner_threads"]}]=0 v240) ==== 170+0+0 (secure 0 0 0) 0x7fcc90083ed0 con 0x7fcc9815d760 2024-09-17T05:46:45.514 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:45.513+0000 7fcc9ccf2640 1 -- 172.21.15.150:0/956093409 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fcc780797f0 msgr2=0x7fcc7807bd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:46:45.514 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:45.513+0000 7fcc9ccf2640 1 --2- 172.21.15.150:0/956093409 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fcc780797f0 0x7fcc7807bd00 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7fcc88000f60 tx=0x7fcc88009040 comp rx=0 tx=0).stop 2024-09-17T05:46:45.514 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:45.513+0000 7fcc9ccf2640 1 -- 172.21.15.150:0/956093409 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fcc9815d760 msgr2=0x7fcc981448e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:46:45.515 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:45.513+0000 7fcc9ccf2640 1 --2- 172.21.15.150:0/956093409 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fcc9815d760 0x7fcc981448e0 secure :-1 s=READY pgs=755 cs=0 l=1 rev1=1 crypto rx=0x7fcc90009ca0 tx=0x7fcc90032c90 comp rx=0 tx=0).stop 2024-09-17T05:46:45.515 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:45.513+0000 7fcc9ccf2640 1 -- 172.21.15.150:0/956093409 shutdown_connections 2024-09-17T05:46:45.515 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:45.513+0000 7fcc9ccf2640 1 --2- 172.21.15.150:0/956093409 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fcc780797f0 0x7fcc7807bd00 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:45.515 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:45.513+0000 7fcc9ccf2640 1 --2- 172.21.15.150:0/956093409 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fcc9815d760 0x7fcc981448e0 unknown :-1 s=CLOSED pgs=755 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:45.515 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:45.513+0000 7fcc9ccf2640 1 --2- 172.21.15.150:0/956093409 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fcc980b3550 0x7fcc981443a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:45.515 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:45.513+0000 7fcc9ccf2640 1 --2- 172.21.15.150:0/956093409 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fcc980ad0e0 0x7fcc9815be40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:45.515 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:45.513+0000 7fcc9ccf2640 1 -- 172.21.15.150:0/956093409 >> 172.21.15.150:0/956093409 conn(0x7fcc9806d730 msgr2=0x7fcc980b1d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:46:45.515 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:45.514+0000 7fcc9ccf2640 1 -- 172.21.15.150:0/956093409 shutdown_connections 2024-09-17T05:46:45.515 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:45.514+0000 7fcc9ccf2640 1 -- 172.21.15.150:0/956093409 wait complete. 2024-09-17T05:46:45.528 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config dump 2024-09-17T05:46:45.648 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:45.647+0000 7f921c05c640 1 -- 172.21.15.150:0/1020100497 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f92140aebc0 msgr2=0x7f9214152920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:46:45.648 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:45.647+0000 7f921c05c640 1 --2- 172.21.15.150:0/1020100497 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f92140aebc0 0x7f9214152920 secure :-1 s=READY pgs=757 cs=0 l=1 rev1=1 crypto rx=0x7f9214160420 tx=0x7f921002a4a0 comp rx=0 tx=0).stop 2024-09-17T05:46:45.648 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:45.647+0000 7f921c05c640 1 -- 172.21.15.150:0/1020100497 shutdown_connections 2024-09-17T05:46:45.649 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:45.647+0000 7f921c05c640 1 --2- 172.21.15.150:0/1020100497 >> v2:172.21.15.176:3300/0 conn(0x7f921415fae0 0x7f92140b3750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:45.649 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:45.647+0000 7f921c05c640 1 --2- 172.21.15.150:0/1020100497 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f92140aebc0 0x7f9214152920 unknown :-1 s=CLOSED pgs=757 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:45.649 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:45.647+0000 7f921c05c640 1 -- 172.21.15.150:0/1020100497 >> 172.21.15.150:0/1020100497 conn(0x7f921406d730 msgr2=0x7f92140b1e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:46:45.649 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:45.647+0000 7f921c05c640 1 -- 172.21.15.150:0/1020100497 shutdown_connections 2024-09-17T05:46:45.649 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:45.647+0000 7f921c05c640 1 -- 172.21.15.150:0/1020100497 wait complete. 2024-09-17T05:46:45.649 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:45.649+0000 7f921c05c640 1 Processor -- start 2024-09-17T05:46:45.649 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:45.649+0000 7f921c05c640 1 -- start start 2024-09-17T05:46:45.652 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:45.650+0000 7f921c05c640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f92140aebc0 0x7f9214150670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:46:45.652 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:45.650+0000 7f921c05c640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f92140b2750 0x7f9214150bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:46:45.652 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:45.650+0000 7f921c05c640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9214140260 0x7f92141f3870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:46:45.652 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:45.650+0000 7f921c05c640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f92140b40d0 con 0x7f92140b2750 2024-09-17T05:46:45.652 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:45.650+0000 7f921c05c640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f92140b3f50 con 0x7f9214140260 2024-09-17T05:46:45.653 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:45.650+0000 7f921c05c640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f92140b4250 con 0x7f92140aebc0 2024-09-17T05:46:45.653 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:45.650+0000 7f92195f7640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f92140b2750 0x7f9214150bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:46:45.653 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:45.650+0000 7f92195f7640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f92140b2750 0x7f9214150bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:39208/0 (socket says 172.21.15.150:39208) 2024-09-17T05:46:45.653 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:45.651+0000 7f92195f7640 1 -- 172.21.15.150:0/324152573 learned_addr learned my addr 172.21.15.150:0/324152573 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:46:45.653 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:45.651+0000 7f921a5f9640 1 --2- 172.21.15.150:0/324152573 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9214140260 0x7f92141f3870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:46:45.653 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:45.651+0000 7f9219df8640 1 --2- 172.21.15.150:0/324152573 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f92140aebc0 0x7f9214150670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:46:45.653 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:45.651+0000 7f92195f7640 1 -- 172.21.15.150:0/324152573 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f92140aebc0 msgr2=0x7f9214150670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:46:45.653 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:45.651+0000 7f92195f7640 1 --2- 172.21.15.150:0/324152573 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f92140aebc0 0x7f9214150670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:45.653 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:45.651+0000 7f92195f7640 1 -- 172.21.15.150:0/324152573 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9214140260 msgr2=0x7f92141f3870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:46:45.653 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:45.651+0000 7f92195f7640 1 --2- 172.21.15.150:0/324152573 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9214140260 0x7f92141f3870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:45.653 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:45.651+0000 7f92195f7640 1 -- 172.21.15.150:0/324152573 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9214142890 con 0x7f92140b2750 2024-09-17T05:46:45.653 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:45.651+0000 7f92195f7640 1 --2- 172.21.15.150:0/324152573 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f92140b2750 0x7f9214150bb0 secure :-1 s=READY pgs=758 cs=0 l=1 rev1=1 crypto rx=0x7f920400c3f0 tx=0x7f920400c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:46:45.653 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:45.651+0000 7f920a7fc640 1 -- 172.21.15.150:0/324152573 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9204017070 con 0x7f92140b2750 2024-09-17T05:46:45.654 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:45.651+0000 7f920a7fc640 1 -- 172.21.15.150:0/324152573 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f92040035f0 con 0x7f92140b2750 2024-09-17T05:46:45.654 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:45.651+0000 7f921c05c640 1 -- 172.21.15.150:0/324152573 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9214142b70 con 0x7f92140b2750 2024-09-17T05:46:45.654 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:45.651+0000 7f920a7fc640 1 -- 172.21.15.150:0/324152573 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9204003a40 con 0x7f92140b2750 2024-09-17T05:46:45.654 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:45.651+0000 7f921c05c640 1 -- 172.21.15.150:0/324152573 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9214143130 con 0x7f92140b2750 2024-09-17T05:46:45.655 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:45.652+0000 7f921c05c640 1 -- 172.21.15.150:0/324152573 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9214142600 con 0x7f92140b2750 2024-09-17T05:46:45.655 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:45.653+0000 7f920a7fc640 1 -- 172.21.15.150:0/324152573 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 19) ==== 102563+0+0 (secure 0 0 0) 0x7f920401a070 con 0x7f92140b2750 2024-09-17T05:46:45.655 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:45.654+0000 7f920a7fc640 1 --2- 172.21.15.150:0/324152573 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f91f8079850 0x7f91f807bd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:46:45.655 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:45.654+0000 7f920a7fc640 1 -- 172.21.15.150:0/324152573 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(64..64 src has 1..64) ==== 4999+0+0 (secure 0 0 0) 0x7f9204098c10 con 0x7f92140b2750 2024-09-17T05:46:45.655 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:45.654+0000 7f9219df8640 1 --2- 172.21.15.150:0/324152573 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f91f8079850 0x7f91f807bd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:46:45.655 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:45.655+0000 7f9219df8640 1 --2- 172.21.15.150:0/324152573 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f91f8079850 0x7f91f807bd60 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f9210034000 tx=0x7f9210004730 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:46:45.659 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:45.658+0000 7f920a7fc640 1 -- 172.21.15.150:0/324152573 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f9204062230 con 0x7f92140b2750 2024-09-17T05:46:45.833 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:45.832+0000 7f921c05c640 1 -- 172.21.15.150:0/324152573 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "config dump"} v 0) -- 0x7f9214069840 con 0x7f92140b2750 2024-09-17T05:46:45.833 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:45.833+0000 7f920a7fc640 1 -- 172.21.15.150:0/324152573 <== mon.0 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "config dump"}]=0 v40) ==== 59+0+2294 (secure 0 0 0) 0x7f9214069840 con 0x7f92140b2750 2024-09-17T05:46:45.834 INFO:teuthology.orchestra.run.smithi150.stdout:WHO MASK LEVEL OPTION VALUE RO 2024-09-17T05:46:45.834 INFO:teuthology.orchestra.run.smithi150.stdout:mon advanced mon_op_complaint_time 120 2024-09-17T05:46:45.834 INFO:teuthology.orchestra.run.smithi150.stdout:mgr advanced client_mount_timeout 30 2024-09-17T05:46:45.834 INFO:teuthology.orchestra.run.smithi150.stdout:mgr advanced debug_client 20/20 2024-09-17T05:46:45.834 INFO:teuthology.orchestra.run.smithi150.stdout:mgr advanced debug_mgr 20/20 2024-09-17T05:46:45.834 INFO:teuthology.orchestra.run.smithi150.stdout:mgr advanced debug_ms 1/1 2024-09-17T05:46:45.834 INFO:teuthology.orchestra.run.smithi150.stdout:mgr dev mon_warn_on_pool_no_app false 2024-09-17T05:46:45.834 INFO:teuthology.orchestra.run.smithi150.stdout:osd advanced osd_op_complaint_time 180.000000 2024-09-17T05:46:45.834 INFO:teuthology.orchestra.run.smithi150.stdout:osd.0 basic osd_mclock_max_capacity_iops_ssd 6764.239331 2024-09-17T05:46:45.834 INFO:teuthology.orchestra.run.smithi150.stdout:osd.1 basic osd_mclock_max_capacity_iops_ssd 4956.769289 2024-09-17T05:46:45.835 INFO:teuthology.orchestra.run.smithi150.stdout:osd.2 basic osd_mclock_max_capacity_iops_ssd 5099.704467 2024-09-17T05:46:45.835 INFO:teuthology.orchestra.run.smithi150.stdout:osd.3 basic osd_mclock_max_capacity_iops_ssd 4681.616196 2024-09-17T05:46:45.835 INFO:teuthology.orchestra.run.smithi150.stdout:osd.4 basic osd_mclock_max_capacity_iops_ssd 4723.364425 2024-09-17T05:46:45.835 INFO:teuthology.orchestra.run.smithi150.stdout:osd.5 basic osd_mclock_max_capacity_iops_ssd 4509.722124 2024-09-17T05:46:45.835 INFO:teuthology.orchestra.run.smithi150.stdout:osd.6 basic osd_mclock_max_capacity_iops_ssd 6380.664158 2024-09-17T05:46:45.835 INFO:teuthology.orchestra.run.smithi150.stdout:osd.7 basic osd_mclock_max_capacity_iops_ssd 4303.333825 2024-09-17T05:46:45.835 INFO:teuthology.orchestra.run.smithi150.stdout:mds advanced debug_mds 20/20 2024-09-17T05:46:45.835 INFO:teuthology.orchestra.run.smithi150.stdout:mds advanced debug_mds_balancer 20/20 2024-09-17T05:46:45.835 INFO:teuthology.orchestra.run.smithi150.stdout:mds advanced debug_ms 2/2 2024-09-17T05:46:45.835 INFO:teuthology.orchestra.run.smithi150.stdout:mds dev mds_debug_frag true 2024-09-17T05:46:45.835 INFO:teuthology.orchestra.run.smithi150.stdout:mds dev mds_debug_scatterstat true 2024-09-17T05:46:45.835 INFO:teuthology.orchestra.run.smithi150.stdout:mds advanced mds_op_complaint_time 180.000000 2024-09-17T05:46:45.835 INFO:teuthology.orchestra.run.smithi150.stdout:mds dev mds_verify_scatter true 2024-09-17T05:46:45.836 INFO:teuthology.orchestra.run.smithi150.stdout:mds advanced osd_op_complaint_time 180.000000 2024-09-17T05:46:45.836 INFO:teuthology.orchestra.run.smithi150.stdout:mds advanced rados_mon_op_timeout 900 2024-09-17T05:46:45.836 INFO:teuthology.orchestra.run.smithi150.stdout:mds advanced rados_osd_op_timeout 900 2024-09-17T05:46:45.836 INFO:teuthology.orchestra.run.smithi150.stdout:client advanced client_mount_timeout 600 2024-09-17T05:46:45.836 INFO:teuthology.orchestra.run.smithi150.stdout:client advanced debug_client 20/20 2024-09-17T05:46:45.836 INFO:teuthology.orchestra.run.smithi150.stdout:client advanced debug_ms 1/1 2024-09-17T05:46:45.836 INFO:teuthology.orchestra.run.smithi150.stdout:client advanced rados_mon_op_timeout 900 2024-09-17T05:46:45.836 INFO:teuthology.orchestra.run.smithi150.stdout:client advanced rados_osd_op_timeout 900 2024-09-17T05:46:45.837 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:45.835+0000 7f921c05c640 1 -- 172.21.15.150:0/324152573 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f91f8079850 msgr2=0x7f91f807bd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:46:45.837 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:45.835+0000 7f921c05c640 1 --2- 172.21.15.150:0/324152573 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f91f8079850 0x7f91f807bd60 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f9210034000 tx=0x7f9210004730 comp rx=0 tx=0).stop 2024-09-17T05:46:45.837 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:45.835+0000 7f921c05c640 1 -- 172.21.15.150:0/324152573 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f92140b2750 msgr2=0x7f9214150bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:46:45.837 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:45.835+0000 7f921c05c640 1 --2- 172.21.15.150:0/324152573 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f92140b2750 0x7f9214150bb0 secure :-1 s=READY pgs=758 cs=0 l=1 rev1=1 crypto rx=0x7f920400c3f0 tx=0x7f920400c8b0 comp rx=0 tx=0).stop 2024-09-17T05:46:45.837 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:45.835+0000 7f921c05c640 1 -- 172.21.15.150:0/324152573 shutdown_connections 2024-09-17T05:46:45.837 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:45.835+0000 7f921c05c640 1 --2- 172.21.15.150:0/324152573 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9214140260 0x7f92141f3870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:45.838 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:45.835+0000 7f921c05c640 1 --2- 172.21.15.150:0/324152573 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f91f8079850 0x7f91f807bd60 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:45.838 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:45.835+0000 7f921c05c640 1 --2- 172.21.15.150:0/324152573 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f92140b2750 0x7f9214150bb0 unknown :-1 s=CLOSED pgs=758 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:45.838 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:45.835+0000 7f921c05c640 1 --2- 172.21.15.150:0/324152573 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f92140aebc0 0x7f9214150670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:45.838 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:45.835+0000 7f921c05c640 1 -- 172.21.15.150:0/324152573 >> 172.21.15.150:0/324152573 conn(0x7f921406d730 msgr2=0x7f921406f930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:46:45.838 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:45.835+0000 7f921c05c640 1 -- 172.21.15.150:0/324152573 shutdown_connections 2024-09-17T05:46:45.838 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:45.835+0000 7f921c05c640 1 -- 172.21.15.150:0/324152573 wait complete. 2024-09-17T05:46:45.847 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-09-17T05:46:45.965 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:45.964+0000 7fbcf0c0e640 1 -- 172.21.15.150:0/3538333786 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbcec1628c0 msgr2=0x7fbcec162cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:46:45.965 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:45.964+0000 7fbcf0c0e640 1 --2- 172.21.15.150:0/3538333786 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbcec1628c0 0x7fbcec162cd0 secure :-1 s=READY pgs=760 cs=0 l=1 rev1=1 crypto rx=0x7fbcec0b9d60 tx=0x7fbce002a530 comp rx=0 tx=0).stop 2024-09-17T05:46:45.965 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:45.964+0000 7fbcf0c0e640 1 -- 172.21.15.150:0/3538333786 shutdown_connections 2024-09-17T05:46:45.965 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:45.964+0000 7fbcf0c0e640 1 --2- 172.21.15.150:0/3538333786 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbcec1628c0 0x7fbcec162cd0 unknown :-1 s=CLOSED pgs=760 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:45.965 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:45.964+0000 7fbcf0c0e640 1 --2- 172.21.15.150:0/3538333786 >> v2:172.21.15.176:3300/0 conn(0x7fbcec0b3ae0 0x7fbcec0d2370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:45.965 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:45.964+0000 7fbcf0c0e640 1 -- 172.21.15.150:0/3538333786 >> 172.21.15.150:0/3538333786 conn(0x7fbcec0d4680 msgr2=0x7fbcec0d4a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:46:45.966 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:45.964+0000 7fbcf0c0e640 1 -- 172.21.15.150:0/3538333786 shutdown_connections 2024-09-17T05:46:45.966 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:45.964+0000 7fbcf0c0e640 1 -- 172.21.15.150:0/3538333786 wait complete. 2024-09-17T05:46:45.966 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:45.966+0000 7fbcf0c0e640 1 Processor -- start 2024-09-17T05:46:45.966 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:45.966+0000 7fbcf0c0e640 1 -- start start 2024-09-17T05:46:45.970 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:45.967+0000 7fbcf0c0e640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbcec0b3ae0 0x7fbcec0b5aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:46:45.970 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:45.967+0000 7fbcf0c0e640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fbcec1628c0 0x7fbcec15b470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:46:45.970 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:45.967+0000 7fbcf0c0e640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fbcec163210 0x7fbcec15d420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:46:45.970 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:45.967+0000 7fbcf0c0e640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7fbcec0cfd50 con 0x7fbcec0b3ae0 2024-09-17T05:46:45.970 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:45.967+0000 7fbcf0c0e640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fbcec0cfbd0 con 0x7fbcec1628c0 2024-09-17T05:46:45.970 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:45.967+0000 7fbcf0c0e640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fbcec0cfed0 con 0x7fbcec163210 2024-09-17T05:46:45.970 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:45.967+0000 7fbcea59c640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbcec0b3ae0 0x7fbcec0b5aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:46:45.970 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:45.967+0000 7fbcea59c640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbcec0b3ae0 0x7fbcec0b5aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:39226/0 (socket says 172.21.15.150:39226) 2024-09-17T05:46:45.970 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:45.967+0000 7fbcea59c640 1 -- 172.21.15.150:0/2870837503 learned_addr learned my addr 172.21.15.150:0/2870837503 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:46:45.970 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:45.967+0000 7fbcead9d640 1 --2- 172.21.15.150:0/2870837503 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fbcec163210 0x7fbcec15d420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:46:45.971 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:45.967+0000 7fbce9d9b640 1 --2- 172.21.15.150:0/2870837503 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fbcec1628c0 0x7fbcec15b470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:46:45.971 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:45.968+0000 7fbcea59c640 1 -- 172.21.15.150:0/2870837503 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fbcec163210 msgr2=0x7fbcec15d420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:46:45.971 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:45.968+0000 7fbcea59c640 1 --2- 172.21.15.150:0/2870837503 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fbcec163210 0x7fbcec15d420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:45.971 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:45.968+0000 7fbcea59c640 1 -- 172.21.15.150:0/2870837503 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fbcec1628c0 msgr2=0x7fbcec15b470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:46:45.971 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:45.968+0000 7fbcea59c640 1 --2- 172.21.15.150:0/2870837503 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fbcec1628c0 0x7fbcec15b470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:45.971 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:45.968+0000 7fbcea59c640 1 -- 172.21.15.150:0/2870837503 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbcec160af0 con 0x7fbcec0b3ae0 2024-09-17T05:46:45.971 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:45.968+0000 7fbce9d9b640 1 --2- 172.21.15.150:0/2870837503 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fbcec1628c0 0x7fbcec15b470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T05:46:45.971 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:45.968+0000 7fbcea59c640 1 --2- 172.21.15.150:0/2870837503 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbcec0b3ae0 0x7fbcec0b5aa0 secure :-1 s=READY pgs=761 cs=0 l=1 rev1=1 crypto rx=0x7fbcdc00d750 tx=0x7fbcdc00dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:46:45.971 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:45.968+0000 7fbcdaffd640 1 -- 172.21.15.150:0/2870837503 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbcdc009c30 con 0x7fbcec0b3ae0 2024-09-17T05:46:45.971 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:45.968+0000 7fbcdaffd640 1 -- 172.21.15.150:0/2870837503 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fbcdc00de60 con 0x7fbcec0b3ae0 2024-09-17T05:46:45.971 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:45.968+0000 7fbcdaffd640 1 -- 172.21.15.150:0/2870837503 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbcdc004280 con 0x7fbcec0b3ae0 2024-09-17T05:46:45.972 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:45.968+0000 7fbcf0c0e640 1 -- 172.21.15.150:0/2870837503 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbcec14a810 con 0x7fbcec0b3ae0 2024-09-17T05:46:45.972 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:45.968+0000 7fbcf0c0e640 1 -- 172.21.15.150:0/2870837503 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbcec147a00 con 0x7fbcec0b3ae0 2024-09-17T05:46:45.972 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:45.969+0000 7fbcf0c0e640 1 -- 172.21.15.150:0/2870837503 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbcec08d090 con 0x7fbcec0b3ae0 2024-09-17T05:46:45.973 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:45.970+0000 7fbcdaffd640 1 -- 172.21.15.150:0/2870837503 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 19) ==== 102563+0+0 (secure 0 0 0) 0x7fbcdc005030 con 0x7fbcec0b3ae0 2024-09-17T05:46:45.973 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:45.970+0000 7fbcdaffd640 1 --2- 172.21.15.150:0/2870837503 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fbccc079820 0x7fbccc07bd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:46:45.973 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:45.970+0000 7fbcdaffd640 1 -- 172.21.15.150:0/2870837503 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(64..64 src has 1..64) ==== 4999+0+0 (secure 0 0 0) 0x7fbcdc099fb0 con 0x7fbcec0b3ae0 2024-09-17T05:46:45.973 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:45.971+0000 7fbce9d9b640 1 --2- 172.21.15.150:0/2870837503 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fbccc079820 0x7fbccc07bd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:46:45.973 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:45.971+0000 7fbce9d9b640 1 --2- 172.21.15.150:0/2870837503 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fbccc079820 0x7fbccc07bd30 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7fbce0034000 tx=0x7fbce0004730 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:46:45.975 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:45.975+0000 7fbcdaffd640 1 -- 172.21.15.150:0/2870837503 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fbcec08d090 con 0x7fbcec0b3ae0 2024-09-17T05:46:46.152 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:46.151+0000 7fbcf0c0e640 1 -- 172.21.15.150:0/2870837503 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) -- 0x7fbcec15ee90 con 0x7fbcec0b3ae0 2024-09-17T05:46:46.156 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:46.155+0000 7fbcdaffd640 1 -- 172.21.15.150:0/2870837503 <== mon.0 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v41)=0 v41) ==== 122+0+0 (secure 0 0 0) 0x7fbcdc020020 con 0x7fbcec0b3ae0 2024-09-17T05:46:46.159 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:46.158+0000 7fbcf0c0e640 1 -- 172.21.15.150:0/2870837503 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fbccc079820 msgr2=0x7fbccc07bd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:46:46.159 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:46.158+0000 7fbcf0c0e640 1 --2- 172.21.15.150:0/2870837503 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fbccc079820 0x7fbccc07bd30 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7fbce0034000 tx=0x7fbce0004730 comp rx=0 tx=0).stop 2024-09-17T05:46:46.159 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:46.158+0000 7fbcf0c0e640 1 -- 172.21.15.150:0/2870837503 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbcec0b3ae0 msgr2=0x7fbcec0b5aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:46:46.159 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:46.158+0000 7fbcf0c0e640 1 --2- 172.21.15.150:0/2870837503 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbcec0b3ae0 0x7fbcec0b5aa0 secure :-1 s=READY pgs=761 cs=0 l=1 rev1=1 crypto rx=0x7fbcdc00d750 tx=0x7fbcdc00dc10 comp rx=0 tx=0).stop 2024-09-17T05:46:46.159 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:46.158+0000 7fbcf0c0e640 1 -- 172.21.15.150:0/2870837503 shutdown_connections 2024-09-17T05:46:46.159 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:46.158+0000 7fbcf0c0e640 1 --2- 172.21.15.150:0/2870837503 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fbcec1628c0 0x7fbcec15b470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:46.159 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:46.158+0000 7fbcf0c0e640 1 --2- 172.21.15.150:0/2870837503 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fbccc079820 0x7fbccc07bd30 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:46.160 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:46.158+0000 7fbcf0c0e640 1 --2- 172.21.15.150:0/2870837503 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fbcec163210 0x7fbcec15d420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:46.160 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:46.158+0000 7fbcf0c0e640 1 --2- 172.21.15.150:0/2870837503 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbcec0b3ae0 0x7fbcec0b5aa0 unknown :-1 s=CLOSED pgs=761 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:46.160 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:46.158+0000 7fbcf0c0e640 1 -- 172.21.15.150:0/2870837503 >> 172.21.15.150:0/2870837503 conn(0x7fbcec0d4680 msgr2=0x7fbcec068e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:46:46.160 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:46.158+0000 7fbcf0c0e640 1 -- 172.21.15.150:0/2870837503 shutdown_connections 2024-09-17T05:46:46.160 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:46.158+0000 7fbcf0c0e640 1 -- 172.21.15.150:0/2870837503 wait complete. 2024-09-17T05:46:46.170 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-17T05:46:46.171 DEBUG:teuthology.orchestra.run.smithi150:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-17T05:46:46.220 DEBUG:teuthology.orchestra.run.smithi176:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-17T05:46:46.269 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-17T05:46:46.269 DEBUG:teuthology.orchestra.run.smithi150:> set -ex 2024-09-17T05:46:46.269 DEBUG:teuthology.orchestra.run.smithi150:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T05:46:46.286 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056027,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497464k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=18693 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248728k,nr_inodes=812182,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497464k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-17T05:46:46.286 DEBUG:teuthology.orchestra.run.smithi176:> set -ex 2024-09-17T05:46:46.286 DEBUG:teuthology.orchestra.run.smithi176:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T05:46:46.304 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056030,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497468k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=3379 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248732k,nr_inodes=812183,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497468k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-17T05:46:46.304 DEBUG:teuthology.orchestra.run.smithi150:> set -ex 2024-09-17T05:46:46.304 DEBUG:teuthology.orchestra.run.smithi150:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T05:46:46.342 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056027,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497464k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=18693 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248728k,nr_inodes=812182,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497464k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-17T05:46:46.342 DEBUG:teuthology.orchestra.run.smithi176:> set -ex 2024-09-17T05:46:46.342 DEBUG:teuthology.orchestra.run.smithi176:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T05:46:46.363 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056030,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497468k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=3379 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248732k,nr_inodes=812183,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497468k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-17T05:46:46.363 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-09-17T05:46:46.363 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T05:46:46.496 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:46.495+0000 7f3f0f638640 1 -- 172.21.15.150:0/3532386509 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3f080b5d50 msgr2=0x7f3f080d2780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:46:46.497 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:46.495+0000 7f3f0f638640 1 --2- 172.21.15.150:0/3532386509 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3f080b5d50 0x7f3f080d2780 secure :-1 s=READY pgs=762 cs=0 l=1 rev1=1 crypto rx=0x7f3f0808c5a0 tx=0x7f3f0402a560 comp rx=0 tx=0).stop 2024-09-17T05:46:46.497 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:46.495+0000 7f3f0f638640 1 -- 172.21.15.150:0/3532386509 shutdown_connections 2024-09-17T05:46:46.497 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:46.495+0000 7f3f0f638640 1 --2- 172.21.15.150:0/3532386509 >> v2:172.21.15.176:3300/0 conn(0x7f3f080d1790 0x7f3f080d0400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:46.497 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:46.495+0000 7f3f0f638640 1 --2- 172.21.15.150:0/3532386509 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3f080b5d50 0x7f3f080d2780 unknown :-1 s=CLOSED pgs=762 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:46.497 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:46.495+0000 7f3f0f638640 1 -- 172.21.15.150:0/3532386509 >> 172.21.15.150:0/3532386509 conn(0x7f3f0808bfe0 msgr2=0x7f3f080d4670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:46:46.497 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:46.495+0000 7f3f0f638640 1 -- 172.21.15.150:0/3532386509 shutdown_connections 2024-09-17T05:46:46.497 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:46.495+0000 7f3f0f638640 1 -- 172.21.15.150:0/3532386509 wait complete. 2024-09-17T05:46:46.498 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:46.497+0000 7f3f0f638640 1 Processor -- start 2024-09-17T05:46:46.498 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:46.497+0000 7f3f0f638640 1 -- start start 2024-09-17T05:46:46.500 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:46.498+0000 7f3f0f638640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3f080b5d50 0x7f3f080ce420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:46:46.500 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:46.498+0000 7f3f0f638640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3f080d4f90 0x7f3f081589b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:46:46.500 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:46.498+0000 7f3f0f638640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3f08158ef0 0x7f3f08157680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:46:46.500 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:46.498+0000 7f3f0f638640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f3f080b7aa0 con 0x7f3f080d4f90 2024-09-17T05:46:46.500 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:46.498+0000 7f3f0f638640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f3f080b7920 con 0x7f3f080b5d50 2024-09-17T05:46:46.501 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:46.498+0000 7f3f0f638640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f3f080b7c20 con 0x7f3f08158ef0 2024-09-17T05:46:46.501 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:46.499+0000 7f3f0cbd3640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3f080d4f90 0x7f3f081589b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:46:46.501 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:46.499+0000 7f3f0cbd3640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3f080d4f90 0x7f3f081589b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:39250/0 (socket says 172.21.15.150:39250) 2024-09-17T05:46:46.501 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:46.499+0000 7f3f0cbd3640 1 -- 172.21.15.150:0/4163273066 learned_addr learned my addr 172.21.15.150:0/4163273066 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:46:46.501 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:46.499+0000 7f3f0d3d4640 1 --2- 172.21.15.150:0/4163273066 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3f080b5d50 0x7f3f080ce420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:46:46.501 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:46.499+0000 7f3f0dbd5640 1 --2- 172.21.15.150:0/4163273066 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3f08158ef0 0x7f3f08157680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:46:46.501 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:46.499+0000 7f3f0cbd3640 1 -- 172.21.15.150:0/4163273066 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3f08158ef0 msgr2=0x7f3f08157680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:46:46.501 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:46.499+0000 7f3f0cbd3640 1 --2- 172.21.15.150:0/4163273066 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3f08158ef0 0x7f3f08157680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:46.501 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:46.499+0000 7f3f0cbd3640 1 -- 172.21.15.150:0/4163273066 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3f080b5d50 msgr2=0x7f3f080ce420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:46:46.501 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:46.499+0000 7f3f0cbd3640 1 --2- 172.21.15.150:0/4163273066 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3f080b5d50 0x7f3f080ce420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:46.501 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:46.499+0000 7f3f0cbd3640 1 -- 172.21.15.150:0/4163273066 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3f081596a0 con 0x7f3f080d4f90 2024-09-17T05:46:46.502 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:46.499+0000 7f3f0cbd3640 1 --2- 172.21.15.150:0/4163273066 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3f080d4f90 0x7f3f081589b0 secure :-1 s=READY pgs=763 cs=0 l=1 rev1=1 crypto rx=0x7f3ef800b3f0 tx=0x7f3ef800b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:46:46.502 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:46.499+0000 7f3efdffb640 1 -- 172.21.15.150:0/4163273066 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ef8015020 con 0x7f3f080d4f90 2024-09-17T05:46:46.502 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:46.499+0000 7f3efdffb640 1 -- 172.21.15.150:0/4163273066 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f3ef8011920 con 0x7f3f080d4f90 2024-09-17T05:46:46.502 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:46.499+0000 7f3f0f638640 1 -- 172.21.15.150:0/4163273066 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3f08159980 con 0x7f3f080d4f90 2024-09-17T05:46:46.502 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:46.499+0000 7f3efdffb640 1 -- 172.21.15.150:0/4163273066 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ef8011d70 con 0x7f3f080d4f90 2024-09-17T05:46:46.502 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:46.500+0000 7f3f0f638640 1 -- 172.21.15.150:0/4163273066 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3f08155430 con 0x7f3f080d4f90 2024-09-17T05:46:46.503 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:46.500+0000 7f3f0f638640 1 -- 172.21.15.150:0/4163273066 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3f080b8140 con 0x7f3f080d4f90 2024-09-17T05:46:46.503 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:46.501+0000 7f3efdffb640 1 -- 172.21.15.150:0/4163273066 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 19) ==== 102563+0+0 (secure 0 0 0) 0x7f3ef8018020 con 0x7f3f080d4f90 2024-09-17T05:46:46.503 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:46.501+0000 7f3efdffb640 1 --2- 172.21.15.150:0/4163273066 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f3eec0797f0 0x7f3eec07bd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:46:46.503 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:46.502+0000 7f3efdffb640 1 -- 172.21.15.150:0/4163273066 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(64..64 src has 1..64) ==== 4999+0+0 (secure 0 0 0) 0x7f3ef8099410 con 0x7f3f080d4f90 2024-09-17T05:46:46.503 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:46.502+0000 7f3f0d3d4640 1 --2- 172.21.15.150:0/4163273066 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f3eec0797f0 0x7f3eec07bd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:46:46.503 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:46.502+0000 7f3f0d3d4640 1 --2- 172.21.15.150:0/4163273066 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f3eec0797f0 0x7f3eec07bd00 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f3f04033000 tx=0x7f3f04004730 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:46:46.506 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:46.506+0000 7f3efdffb640 1 -- 172.21.15.150:0/4163273066 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f3ef801f030 con 0x7f3f080d4f90 2024-09-17T05:46:46.716 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:46.716+0000 7f3f0f638640 1 -- 172.21.15.150:0/4163273066 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f3f08162070 con 0x7f3f080d4f90 2024-09-17T05:46:46.717 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:46.716+0000 7f3efdffb640 1 -- 172.21.15.150:0/4163273066 <== mon.0 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 36 v36) ==== 94+0+3923 (secure 0 0 0) 0x7f3ef8062ac0 con 0x7f3f080d4f90 2024-09-17T05:46:46.717 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-09-17T05:46:46.718 INFO:teuthology.orchestra.run.smithi150.stdout:{"epoch":36,"btime":"2024-09-17T05:46:40:487017+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5692,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6836/2204030245","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6834","nonce":2204030245},{"type":"v1","addr":"172.21.15.176:6836","nonce":2204030245}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":29},{"gid":5695,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6837/4065519712","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6835","nonce":4065519712},{"type":"v1","addr":"172.21.15.176:6837","nonce":4065519712}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":29},{"gid":6006,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6834/3602763503","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6832","nonce":3602763503},{"type":"v1","addr":"172.21.15.150:6834","nonce":3602763503}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":29},{"gid":6408,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6835/1764484987","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6833","nonce":1764484987},{"type":"v1","addr":"172.21.15.150:6835","nonce":1764484987}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":36}],"filesystems":[]} 2024-09-17T05:46:46.718 INFO:teuthology.orchestra.run.smithi150.stderr:dumped fsmap epoch 36 2024-09-17T05:46:46.719 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:46.718+0000 7f3f0f638640 1 -- 172.21.15.150:0/4163273066 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f3eec0797f0 msgr2=0x7f3eec07bd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:46:46.719 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:46.718+0000 7f3f0f638640 1 --2- 172.21.15.150:0/4163273066 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f3eec0797f0 0x7f3eec07bd00 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f3f04033000 tx=0x7f3f04004730 comp rx=0 tx=0).stop 2024-09-17T05:46:46.720 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:46.718+0000 7f3f0f638640 1 -- 172.21.15.150:0/4163273066 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3f080d4f90 msgr2=0x7f3f081589b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:46:46.720 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:46.718+0000 7f3f0f638640 1 --2- 172.21.15.150:0/4163273066 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3f080d4f90 0x7f3f081589b0 secure :-1 s=READY pgs=763 cs=0 l=1 rev1=1 crypto rx=0x7f3ef800b3f0 tx=0x7f3ef800b8b0 comp rx=0 tx=0).stop 2024-09-17T05:46:46.720 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:46.719+0000 7f3f0f638640 1 -- 172.21.15.150:0/4163273066 shutdown_connections 2024-09-17T05:46:46.720 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:46.719+0000 7f3f0f638640 1 --2- 172.21.15.150:0/4163273066 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f3eec0797f0 0x7f3eec07bd00 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:46.720 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:46.719+0000 7f3f0f638640 1 --2- 172.21.15.150:0/4163273066 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3f08158ef0 0x7f3f08157680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:46.720 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:46.719+0000 7f3f0f638640 1 --2- 172.21.15.150:0/4163273066 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3f080d4f90 0x7f3f081589b0 unknown :-1 s=CLOSED pgs=763 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:46.720 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:46.719+0000 7f3f0f638640 1 --2- 172.21.15.150:0/4163273066 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3f080b5d50 0x7f3f080ce420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:46.720 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:46.719+0000 7f3f0f638640 1 -- 172.21.15.150:0/4163273066 >> 172.21.15.150:0/4163273066 conn(0x7f3f0808bfe0 msgr2=0x7f3f080b5460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:46:46.720 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:46.719+0000 7f3f0f638640 1 -- 172.21.15.150:0/4163273066 shutdown_connections 2024-09-17T05:46:46.720 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:46.719+0000 7f3f0f638640 1 -- 172.21.15.150:0/4163273066 wait complete. 2024-09-17T05:46:46.731 INFO:tasks.ceph.mds.a:Restarting daemon 2024-09-17T05:46:46.731 INFO:tasks.ceph.mds.a:Stopping old one... 2024-09-17T05:46:46.731 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-09-17T05:46:46.731 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T05:46:46.732 INFO:tasks.ceph.mds.c:Restarting daemon 2024-09-17T05:46:46.732 INFO:tasks.ceph.mds.c:Stopping old one... 2024-09-17T05:46:46.732 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-09-17T05:46:46.732 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T05:46:46.732 INFO:tasks.ceph.mds.b:Restarting daemon 2024-09-17T05:46:46.732 INFO:tasks.ceph.mds.b:Stopping old one... 2024-09-17T05:46:46.733 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-09-17T05:46:46.733 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T05:46:46.733 INFO:tasks.ceph.mds.d:Restarting daemon 2024-09-17T05:46:46.733 INFO:tasks.ceph.mds.d:Stopping old one... 2024-09-17T05:46:46.733 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-09-17T05:46:46.733 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T05:46:46.742 INFO:tasks.ceph.mds.c:Stopped 2024-09-17T05:46:46.742 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-09-17T05:46:46.745 INFO:tasks.ceph.mds.a:Stopped 2024-09-17T05:46:46.745 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-09-17T05:46:46.749 INFO:tasks.ceph.mds.b:Stopped 2024-09-17T05:46:46.750 DEBUG:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-09-17T05:46:46.750 INFO:tasks.ceph.mds.d:Stopped 2024-09-17T05:46:46.751 DEBUG:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-09-17T05:46:46.787 INFO:tasks.ceph.mds.c:Started 2024-09-17T05:46:46.788 DEBUG:teuthology.parallel:result is None 2024-09-17T05:46:46.790 INFO:tasks.ceph.mds.a:Started 2024-09-17T05:46:46.790 DEBUG:teuthology.parallel:result is None 2024-09-17T05:46:46.793 INFO:tasks.ceph.mds.b:Started 2024-09-17T05:46:46.793 DEBUG:teuthology.parallel:result is None 2024-09-17T05:46:46.793 INFO:tasks.ceph.mds.d:Started 2024-09-17T05:46:46.794 DEBUG:teuthology.parallel:result is None 2024-09-17T05:46:46.794 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-09-17T05:46:46.876 INFO:tasks.ceph.mds.c.smithi150.stdout:starting mds.c at 2024-09-17T05:46:46.876 INFO:tasks.ceph.mds.a.smithi150.stdout:starting mds.a at 2024-09-17T05:46:46.888 INFO:tasks.ceph.mds.b.smithi176.stdout:starting mds.b at 2024-09-17T05:46:46.889 INFO:tasks.ceph.mds.d.smithi176.stdout:starting mds.d at 2024-09-17T05:46:46.916 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:46.915+0000 7ff89447e640 1 -- 172.21.15.150:0/4172124907 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff88c0b74f0 msgr2=0x7ff88c15ec50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:46:46.916 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:46.915+0000 7ff89447e640 1 --2- 172.21.15.150:0/4172124907 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff88c0b74f0 0x7ff88c15ec50 secure :-1 s=READY pgs=770 cs=0 l=1 rev1=1 crypto rx=0x7ff8880098e0 tx=0x7ff88802a540 comp rx=0 tx=0).stop 2024-09-17T05:46:46.916 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:46.915+0000 7ff89447e640 1 -- 172.21.15.150:0/4172124907 shutdown_connections 2024-09-17T05:46:46.916 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:46.915+0000 7ff89447e640 1 --2- 172.21.15.150:0/4172124907 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff88c0d0270 0x7ff88c0b27f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:46.916 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:46.915+0000 7ff89447e640 1 --2- 172.21.15.150:0/4172124907 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff88c0b74f0 0x7ff88c15ec50 unknown :-1 s=CLOSED pgs=770 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:46.917 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:46.915+0000 7ff89447e640 1 -- 172.21.15.150:0/4172124907 >> 172.21.15.150:0/4172124907 conn(0x7ff88c08bfe0 msgr2=0x7ff88c0d46a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:46:46.917 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:46.915+0000 7ff89447e640 1 -- 172.21.15.150:0/4172124907 shutdown_connections 2024-09-17T05:46:46.917 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:46.915+0000 7ff89447e640 1 -- 172.21.15.150:0/4172124907 wait complete. 2024-09-17T05:46:46.918 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:46.917+0000 7ff89447e640 1 Processor -- start 2024-09-17T05:46:46.918 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:46.917+0000 7ff89447e640 1 -- start start 2024-09-17T05:46:46.920 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:46.918+0000 7ff89447e640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff88c0b74f0 0x7ff88c152a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:46:46.920 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:46.918+0000 7ff89447e640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff88c0d0270 0x7ff88c0ce370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:46:46.920 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:46.918+0000 7ff89447e640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff88c0d2510 0x7ff88c0b95d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:46:46.921 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:46.919+0000 7ff89447e640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7ff88c0d0800 con 0x7ff88c0d2510 2024-09-17T05:46:46.921 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:46.919+0000 7ff89447e640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7ff88c0d0680 con 0x7ff88c0d0270 2024-09-17T05:46:46.921 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:46.919+0000 7ff89447e640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7ff88c0b2d30 con 0x7ff88c0b74f0 2024-09-17T05:46:46.921 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:46.919+0000 7ff892a1b640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff88c0d2510 0x7ff88c0b95d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:46:46.921 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:46.919+0000 7ff892a1b640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff88c0d2510 0x7ff88c0b95d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:39308/0 (socket says 172.21.15.150:39308) 2024-09-17T05:46:46.921 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:46.919+0000 7ff892a1b640 1 -- 172.21.15.150:0/2796927341 learned_addr learned my addr 172.21.15.150:0/2796927341 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:46:46.921 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:46.919+0000 7ff89221a640 1 --2- 172.21.15.150:0/2796927341 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff88c0b74f0 0x7ff88c152a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:46:46.921 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:46.919+0000 7ff891a19640 1 --2- 172.21.15.150:0/2796927341 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff88c0d0270 0x7ff88c0ce370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:46:46.921 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:46.919+0000 7ff892a1b640 1 -- 172.21.15.150:0/2796927341 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff88c0b74f0 msgr2=0x7ff88c152a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:46:46.921 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:46.919+0000 7ff892a1b640 1 --2- 172.21.15.150:0/2796927341 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff88c0b74f0 0x7ff88c152a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:46.921 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:46.919+0000 7ff892a1b640 1 -- 172.21.15.150:0/2796927341 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff88c0d0270 msgr2=0x7ff88c0ce370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:46:46.921 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:46.919+0000 7ff892a1b640 1 --2- 172.21.15.150:0/2796927341 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff88c0d0270 0x7ff88c0ce370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:46.921 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:46.919+0000 7ff892a1b640 1 -- 172.21.15.150:0/2796927341 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff88c0b57a0 con 0x7ff88c0d2510 2024-09-17T05:46:46.922 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:46.919+0000 7ff89221a640 1 --2- 172.21.15.150:0/2796927341 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff88c0b74f0 0x7ff88c152a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:46:46.922 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:46.919+0000 7ff891a19640 1 --2- 172.21.15.150:0/2796927341 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff88c0d0270 0x7ff88c0ce370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:46:46.922 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:46.919+0000 7ff892a1b640 1 --2- 172.21.15.150:0/2796927341 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff88c0d2510 0x7ff88c0b95d0 secure :-1 s=READY pgs=771 cs=0 l=1 rev1=1 crypto rx=0x7ff88400e960 tx=0x7ff88400ee20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:46:46.922 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:46.919+0000 7ff882ffd640 1 -- 172.21.15.150:0/2796927341 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff884004d20 con 0x7ff88c0d2510 2024-09-17T05:46:46.922 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:46.919+0000 7ff882ffd640 1 -- 172.21.15.150:0/2796927341 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff88400cac0 con 0x7ff88c0d2510 2024-09-17T05:46:46.922 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:46.919+0000 7ff89447e640 1 -- 172.21.15.150:0/2796927341 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff88c1f5b70 con 0x7ff88c0d2510 2024-09-17T05:46:46.922 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:46.919+0000 7ff882ffd640 1 -- 172.21.15.150:0/2796927341 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff884005020 con 0x7ff88c0d2510 2024-09-17T05:46:46.922 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:46.920+0000 7ff89447e640 1 -- 172.21.15.150:0/2796927341 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff88c1f6130 con 0x7ff88c0d2510 2024-09-17T05:46:46.923 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:46.921+0000 7ff89447e640 1 -- 172.21.15.150:0/2796927341 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff88c15ec50 con 0x7ff88c0d2510 2024-09-17T05:46:46.923 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:46.921+0000 7ff882ffd640 1 -- 172.21.15.150:0/2796927341 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 19) ==== 102563+0+0 (secure 0 0 0) 0x7ff8840051c0 con 0x7ff88c0d2510 2024-09-17T05:46:46.924 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:46.921+0000 7ff882ffd640 1 --2- 172.21.15.150:0/2796927341 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7ff8700797f0 0x7ff87007bd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:46:46.924 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:46.922+0000 7ff882ffd640 1 -- 172.21.15.150:0/2796927341 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(64..64 src has 1..64) ==== 4999+0+0 (secure 0 0 0) 0x7ff88409a3b0 con 0x7ff88c0d2510 2024-09-17T05:46:46.924 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:46.922+0000 7ff89221a640 1 --2- 172.21.15.150:0/2796927341 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7ff8700797f0 0x7ff87007bd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:46:46.924 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:46.922+0000 7ff89221a640 1 --2- 172.21.15.150:0/2796927341 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7ff8700797f0 0x7ff87007bd00 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7ff888034000 tx=0x7ff888004730 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:46:46.926 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:46.926+0000 7ff882ffd640 1 -- 172.21.15.150:0/2796927341 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7ff884016030 con 0x7ff88c0d2510 2024-09-17T05:46:47.113 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:47.112+0000 7ff89447e640 1 -- 172.21.15.150:0/2796927341 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) -- 0x7ff88c0d2ac0 con 0x7ff88c0d2510 2024-09-17T05:46:47.525 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:47.524+0000 7ff882ffd640 1 -- 172.21.15.150:0/2796927341 <== mon.0 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v66) ==== 97+0+0 (secure 0 0 0) 0x7ff8840642a0 con 0x7ff88c0d2510 2024-09-17T05:46:47.525 INFO:teuthology.orchestra.run.smithi150.stderr: removed all blocklist entries 2024-09-17T05:46:47.528 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:47.527+0000 7ff89447e640 1 -- 172.21.15.150:0/2796927341 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7ff8700797f0 msgr2=0x7ff87007bd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:46:47.528 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:47.527+0000 7ff89447e640 1 --2- 172.21.15.150:0/2796927341 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7ff8700797f0 0x7ff87007bd00 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7ff888034000 tx=0x7ff888004730 comp rx=0 tx=0).stop 2024-09-17T05:46:47.528 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:47.527+0000 7ff89447e640 1 -- 172.21.15.150:0/2796927341 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff88c0d2510 msgr2=0x7ff88c0b95d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:46:47.528 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:47.527+0000 7ff89447e640 1 --2- 172.21.15.150:0/2796927341 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff88c0d2510 0x7ff88c0b95d0 secure :-1 s=READY pgs=771 cs=0 l=1 rev1=1 crypto rx=0x7ff88400e960 tx=0x7ff88400ee20 comp rx=0 tx=0).stop 2024-09-17T05:46:47.528 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:47.527+0000 7ff89447e640 1 -- 172.21.15.150:0/2796927341 shutdown_connections 2024-09-17T05:46:47.528 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:47.527+0000 7ff89447e640 1 --2- 172.21.15.150:0/2796927341 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff88c0d0270 0x7ff88c0ce370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:47.528 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:47.527+0000 7ff89447e640 1 --2- 172.21.15.150:0/2796927341 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7ff8700797f0 0x7ff87007bd00 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:47.528 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:47.527+0000 7ff89447e640 1 --2- 172.21.15.150:0/2796927341 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff88c0d2510 0x7ff88c0b95d0 unknown :-1 s=CLOSED pgs=771 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:47.528 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:47.527+0000 7ff89447e640 1 --2- 172.21.15.150:0/2796927341 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff88c0b74f0 0x7ff88c152a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:47.529 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:47.527+0000 7ff89447e640 1 -- 172.21.15.150:0/2796927341 >> 172.21.15.150:0/2796927341 conn(0x7ff88c08bfe0 msgr2=0x7ff88c1613b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:46:47.529 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:47.527+0000 7ff89447e640 1 -- 172.21.15.150:0/2796927341 shutdown_connections 2024-09-17T05:46:47.529 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:47.527+0000 7ff89447e640 1 -- 172.21.15.150:0/2796927341 wait complete. 2024-09-17T05:46:47.540 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-09-17T05:46:47.654 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:47.653+0000 7ff89fdc3640 1 -- 172.21.15.150:0/464365126 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff884004800 msgr2=0x7ff884004c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:46:47.655 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:47.653+0000 7ff89fdc3640 1 --2- 172.21.15.150:0/464365126 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff884004800 0x7ff884004c10 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 crypto rx=0x7ff888001690 tx=0x7ff884005830 comp rx=0 tx=0).stop 2024-09-17T05:46:47.655 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:47.653+0000 7ff89e360640 1 -- 172.21.15.150:0/464365126 reap_dead start 2024-09-17T05:46:47.655 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:47.653+0000 7ff89fdc3640 1 -- 172.21.15.150:0/464365126 shutdown_connections 2024-09-17T05:46:47.655 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:47.653+0000 7ff89fdc3640 1 -- 172.21.15.150:0/464365126 >> 172.21.15.150:0/464365126 conn(0x7ff8980d0b50 msgr2=0x7ff8980d0f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:46:47.655 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:47.654+0000 7ff89fdc3640 1 -- 172.21.15.150:0/464365126 shutdown_connections 2024-09-17T05:46:47.655 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:47.654+0000 7ff89fdc3640 1 -- 172.21.15.150:0/464365126 wait complete. 2024-09-17T05:46:47.656 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:47.655+0000 7ff89fdc3640 1 Processor -- start 2024-09-17T05:46:47.656 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:47.655+0000 7ff89fdc3640 1 -- start start 2024-09-17T05:46:47.658 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:47.657+0000 7ff89fdc3640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff884004800 0x7ff89814f720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:46:47.659 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:47.657+0000 7ff89fdc3640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff8980c9f20 0x7ff898150300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:46:47.659 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:47.657+0000 7ff89fdc3640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff898150840 0x7ff89815e000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:46:47.659 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:47.657+0000 7ff89fdc3640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7ff8980762c0 con 0x7ff884004800 2024-09-17T05:46:47.659 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:47.657+0000 7ff89fdc3640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7ff898076140 con 0x7ff8980c9f20 2024-09-17T05:46:47.659 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:47.657+0000 7ff89fdc3640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7ff8980712b0 con 0x7ff898150840 2024-09-17T05:46:47.659 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:47.657+0000 7ff89db5f640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff884004800 0x7ff89814f720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:46:47.659 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:47.657+0000 7ff89db5f640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff884004800 0x7ff89814f720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:39336/0 (socket says 172.21.15.150:39336) 2024-09-17T05:46:47.659 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:47.657+0000 7ff89db5f640 1 -- 172.21.15.150:0/244244633 learned_addr learned my addr 172.21.15.150:0/244244633 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:46:47.659 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:47.657+0000 7ff89e360640 1 --2- 172.21.15.150:0/244244633 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff898150840 0x7ff89815e000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:46:47.659 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:47.657+0000 7ff89d35e640 1 --2- 172.21.15.150:0/244244633 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff8980c9f20 0x7ff898150300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:46:47.659 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:47.657+0000 7ff89db5f640 1 -- 172.21.15.150:0/244244633 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff898150840 msgr2=0x7ff89815e000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:46:47.659 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:47.657+0000 7ff89db5f640 1 --2- 172.21.15.150:0/244244633 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff898150840 0x7ff89815e000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:47.660 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:47.657+0000 7ff89db5f640 1 -- 172.21.15.150:0/244244633 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff8980c9f20 msgr2=0x7ff898150300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:46:47.660 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:47.657+0000 7ff89db5f640 1 --2- 172.21.15.150:0/244244633 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff8980c9f20 0x7ff898150300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:47.660 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:47.657+0000 7ff89db5f640 1 -- 172.21.15.150:0/244244633 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff898150c50 con 0x7ff884004800 2024-09-17T05:46:47.660 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:47.657+0000 7ff89db5f640 1 --2- 172.21.15.150:0/244244633 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff884004800 0x7ff89814f720 secure :-1 s=READY pgs=774 cs=0 l=1 rev1=1 crypto rx=0x7ff89400fa00 tx=0x7ff89400fec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:46:47.660 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:47.657+0000 7ff88e7fc640 1 -- 172.21.15.150:0/244244633 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff89400bcb0 con 0x7ff884004800 2024-09-17T05:46:47.660 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:47.657+0000 7ff88e7fc640 1 -- 172.21.15.150:0/244244633 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff894011440 con 0x7ff884004800 2024-09-17T05:46:47.660 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:47.657+0000 7ff89fdc3640 1 -- 172.21.15.150:0/244244633 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff89815d240 con 0x7ff884004800 2024-09-17T05:46:47.661 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:47.657+0000 7ff88e7fc640 1 -- 172.21.15.150:0/244244633 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff894011870 con 0x7ff884004800 2024-09-17T05:46:47.661 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:47.658+0000 7ff89fdc3640 1 -- 172.21.15.150:0/244244633 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff89815d800 con 0x7ff884004800 2024-09-17T05:46:47.662 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:47.658+0000 7ff89fdc3640 1 -- 172.21.15.150:0/244244633 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff8980717c0 con 0x7ff884004800 2024-09-17T05:46:47.662 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:47.659+0000 7ff88e7fc640 1 -- 172.21.15.150:0/244244633 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 19) ==== 102563+0+0 (secure 0 0 0) 0x7ff894019020 con 0x7ff884004800 2024-09-17T05:46:47.662 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:47.660+0000 7ff88e7fc640 1 --2- 172.21.15.150:0/244244633 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7ff87c079820 0x7ff87c07bd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:46:47.662 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:47.660+0000 7ff88e7fc640 1 -- 172.21.15.150:0/244244633 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(68..68 src has 1..68) ==== 4913+0+0 (secure 0 0 0) 0x7ff89409a130 con 0x7ff884004800 2024-09-17T05:46:47.662 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:47.660+0000 7ff89d35e640 1 --2- 172.21.15.150:0/244244633 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7ff87c079820 0x7ff87c07bd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:46:47.662 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:47.660+0000 7ff89d35e640 1 --2- 172.21.15.150:0/244244633 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7ff87c079820 0x7ff87c07bd30 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7ff888032000 tx=0x7ff888001190 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:46:47.664 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:47.664+0000 7ff88e7fc640 1 -- 172.21.15.150:0/244244633 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7ff898150c50 con 0x7ff884004800 2024-09-17T05:46:47.905 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:47.905+0000 7ff89fdc3640 1 -- 172.21.15.150:0/244244633 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) -- 0x7ff89814db00 con 0x7ff884004800 2024-09-17T05:46:47.906 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:47.905+0000 7ff88e7fc640 1 -- 172.21.15.150:0/244244633 <== mon.0 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v13) ==== 80+0+5304 (secure 0 0 0) 0x7ff8940640b0 con 0x7ff884004800 2024-09-17T05:46:47.906 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-09-17T05:46:47.906 INFO:teuthology.orchestra.run.smithi150.stdout:{ 2024-09-17T05:46:47.906 INFO:teuthology.orchestra.run.smithi150.stdout: "auth_dump": [ 2024-09-17T05:46:47.906 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-09-17T05:46:47.906 INFO:teuthology.orchestra.run.smithi150.stdout: "entity": "mds.a", 2024-09-17T05:46:47.907 INFO:teuthology.orchestra.run.smithi150.stdout: "key": "AQBoFulmMHALAxAAEO+QBgzbd+BNfhyY2qPiqw==", 2024-09-17T05:46:47.907 INFO:teuthology.orchestra.run.smithi150.stdout: "caps": { 2024-09-17T05:46:47.907 INFO:teuthology.orchestra.run.smithi150.stdout: "mds": "allow", 2024-09-17T05:46:47.907 INFO:teuthology.orchestra.run.smithi150.stdout: "mgr": "allow *", 2024-09-17T05:46:47.907 INFO:teuthology.orchestra.run.smithi150.stdout: "mon": "allow *", 2024-09-17T05:46:47.907 INFO:teuthology.orchestra.run.smithi150.stdout: "osd": "allow *" 2024-09-17T05:46:47.907 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-09-17T05:46:47.907 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-17T05:46:47.907 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-09-17T05:46:47.907 INFO:teuthology.orchestra.run.smithi150.stdout: "entity": "mds.b", 2024-09-17T05:46:47.907 INFO:teuthology.orchestra.run.smithi150.stdout: "key": "AQBoFulmtutmEBAAhKJEJQm181pL1lPmSSdYRQ==", 2024-09-17T05:46:47.907 INFO:teuthology.orchestra.run.smithi150.stdout: "caps": { 2024-09-17T05:46:47.907 INFO:teuthology.orchestra.run.smithi150.stdout: "mds": "allow", 2024-09-17T05:46:47.908 INFO:teuthology.orchestra.run.smithi150.stdout: "mgr": "allow *", 2024-09-17T05:46:47.908 INFO:teuthology.orchestra.run.smithi150.stdout: "mon": "allow *", 2024-09-17T05:46:47.908 INFO:teuthology.orchestra.run.smithi150.stdout: "osd": "allow *" 2024-09-17T05:46:47.908 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-09-17T05:46:47.908 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-17T05:46:47.908 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-09-17T05:46:47.908 INFO:teuthology.orchestra.run.smithi150.stdout: "entity": "mds.c", 2024-09-17T05:46:47.908 INFO:teuthology.orchestra.run.smithi150.stdout: "key": "AQBoFulmHTKsChAA4/fUb2NC+fMhR+xIYIDjgQ==", 2024-09-17T05:46:47.908 INFO:teuthology.orchestra.run.smithi150.stdout: "caps": { 2024-09-17T05:46:47.908 INFO:teuthology.orchestra.run.smithi150.stdout: "mds": "allow", 2024-09-17T05:46:47.908 INFO:teuthology.orchestra.run.smithi150.stdout: "mgr": "allow *", 2024-09-17T05:46:47.908 INFO:teuthology.orchestra.run.smithi150.stdout: "mon": "allow *", 2024-09-17T05:46:47.908 INFO:teuthology.orchestra.run.smithi150.stdout: "osd": "allow *" 2024-09-17T05:46:47.909 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-09-17T05:46:47.909 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-17T05:46:47.909 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-09-17T05:46:47.909 INFO:teuthology.orchestra.run.smithi150.stdout: "entity": "mds.d", 2024-09-17T05:46:47.909 INFO:teuthology.orchestra.run.smithi150.stdout: "key": "AQBoFulmr2s3GBAAhXzLVtObF/LwTpDIrY8MIQ==", 2024-09-17T05:46:47.909 INFO:teuthology.orchestra.run.smithi150.stdout: "caps": { 2024-09-17T05:46:47.909 INFO:teuthology.orchestra.run.smithi150.stdout: "mds": "allow", 2024-09-17T05:46:47.909 INFO:teuthology.orchestra.run.smithi150.stdout: "mgr": "allow *", 2024-09-17T05:46:47.909 INFO:teuthology.orchestra.run.smithi150.stdout: "mon": "allow *", 2024-09-17T05:46:47.909 INFO:teuthology.orchestra.run.smithi150.stdout: "osd": "allow *" 2024-09-17T05:46:47.909 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-09-17T05:46:47.909 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-17T05:46:47.909 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-09-17T05:46:47.910 INFO:teuthology.orchestra.run.smithi150.stdout: "entity": "osd.0", 2024-09-17T05:46:47.910 INFO:teuthology.orchestra.run.smithi150.stdout: "key": "AQBrFulm9eU0NRAAqgc1CtMOz+jDCHBn8coaVw==", 2024-09-17T05:46:47.910 INFO:teuthology.orchestra.run.smithi150.stdout: "caps": { 2024-09-17T05:46:47.910 INFO:teuthology.orchestra.run.smithi150.stdout: "mgr": "allow profile osd", 2024-09-17T05:46:47.910 INFO:teuthology.orchestra.run.smithi150.stdout: "mon": "allow profile osd", 2024-09-17T05:46:47.910 INFO:teuthology.orchestra.run.smithi150.stdout: "osd": "allow *" 2024-09-17T05:46:47.910 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-09-17T05:46:47.910 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-17T05:46:47.910 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-09-17T05:46:47.910 INFO:teuthology.orchestra.run.smithi150.stdout: "entity": "osd.1", 2024-09-17T05:46:47.910 INFO:teuthology.orchestra.run.smithi150.stdout: "key": "AQBvFulmlFL6CxAA8ByBraZue2FLfyZeOIpj3A==", 2024-09-17T05:46:47.910 INFO:teuthology.orchestra.run.smithi150.stdout: "caps": { 2024-09-17T05:46:47.910 INFO:teuthology.orchestra.run.smithi150.stdout: "mgr": "allow profile osd", 2024-09-17T05:46:47.910 INFO:teuthology.orchestra.run.smithi150.stdout: "mon": "allow profile osd", 2024-09-17T05:46:47.911 INFO:teuthology.orchestra.run.smithi150.stdout: "osd": "allow *" 2024-09-17T05:46:47.911 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-09-17T05:46:47.911 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-17T05:46:47.911 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-09-17T05:46:47.911 INFO:teuthology.orchestra.run.smithi150.stdout: "entity": "osd.2", 2024-09-17T05:46:47.911 INFO:teuthology.orchestra.run.smithi150.stdout: "key": "AQByFulmMQF5LBAAB4rbdIL6Zd+l4I4LDC/r3Q==", 2024-09-17T05:46:47.911 INFO:teuthology.orchestra.run.smithi150.stdout: "caps": { 2024-09-17T05:46:47.911 INFO:teuthology.orchestra.run.smithi150.stdout: "mgr": "allow profile osd", 2024-09-17T05:46:47.911 INFO:teuthology.orchestra.run.smithi150.stdout: "mon": "allow profile osd", 2024-09-17T05:46:47.911 INFO:teuthology.orchestra.run.smithi150.stdout: "osd": "allow *" 2024-09-17T05:46:47.911 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-09-17T05:46:47.911 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-17T05:46:47.911 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-09-17T05:46:47.912 INFO:teuthology.orchestra.run.smithi150.stdout: "entity": "osd.3", 2024-09-17T05:46:47.912 INFO:teuthology.orchestra.run.smithi150.stdout: "key": "AQB2Fulm5fjaAhAASnkpgsW79Sr9IIiy4HMm4g==", 2024-09-17T05:46:47.912 INFO:teuthology.orchestra.run.smithi150.stdout: "caps": { 2024-09-17T05:46:47.912 INFO:teuthology.orchestra.run.smithi150.stdout: "mgr": "allow profile osd", 2024-09-17T05:46:47.912 INFO:teuthology.orchestra.run.smithi150.stdout: "mon": "allow profile osd", 2024-09-17T05:46:47.912 INFO:teuthology.orchestra.run.smithi150.stdout: "osd": "allow *" 2024-09-17T05:46:47.912 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-09-17T05:46:47.912 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-17T05:46:47.912 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-09-17T05:46:47.912 INFO:teuthology.orchestra.run.smithi150.stdout: "entity": "osd.4", 2024-09-17T05:46:47.912 INFO:teuthology.orchestra.run.smithi150.stdout: "key": "AQB8Fulm9fWPGhAA9nNf+0znlS0Z7rqOvC47xQ==", 2024-09-17T05:46:47.912 INFO:teuthology.orchestra.run.smithi150.stdout: "caps": { 2024-09-17T05:46:47.912 INFO:teuthology.orchestra.run.smithi150.stdout: "mgr": "allow profile osd", 2024-09-17T05:46:47.912 INFO:teuthology.orchestra.run.smithi150.stdout: "mon": "allow profile osd", 2024-09-17T05:46:47.913 INFO:teuthology.orchestra.run.smithi150.stdout: "osd": "allow *" 2024-09-17T05:46:47.913 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-09-17T05:46:47.913 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-17T05:46:47.913 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-09-17T05:46:47.913 INFO:teuthology.orchestra.run.smithi150.stdout: "entity": "osd.5", 2024-09-17T05:46:47.913 INFO:teuthology.orchestra.run.smithi150.stdout: "key": "AQB/FulmeHakHRAASlnmKa0UTqVX+NSbmiHEBw==", 2024-09-17T05:46:47.913 INFO:teuthology.orchestra.run.smithi150.stdout: "caps": { 2024-09-17T05:46:47.913 INFO:teuthology.orchestra.run.smithi150.stdout: "mgr": "allow profile osd", 2024-09-17T05:46:47.913 INFO:teuthology.orchestra.run.smithi150.stdout: "mon": "allow profile osd", 2024-09-17T05:46:47.913 INFO:teuthology.orchestra.run.smithi150.stdout: "osd": "allow *" 2024-09-17T05:46:47.913 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-09-17T05:46:47.913 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-17T05:46:47.913 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-09-17T05:46:47.914 INFO:teuthology.orchestra.run.smithi150.stdout: "entity": "osd.6", 2024-09-17T05:46:47.914 INFO:teuthology.orchestra.run.smithi150.stdout: "key": "AQCCFulmEZF3IBAAhtpCanI6m8Kb3hyi+sRyyQ==", 2024-09-17T05:46:47.914 INFO:teuthology.orchestra.run.smithi150.stdout: "caps": { 2024-09-17T05:46:47.914 INFO:teuthology.orchestra.run.smithi150.stdout: "mgr": "allow profile osd", 2024-09-17T05:46:47.914 INFO:teuthology.orchestra.run.smithi150.stdout: "mon": "allow profile osd", 2024-09-17T05:46:47.914 INFO:teuthology.orchestra.run.smithi150.stdout: "osd": "allow *" 2024-09-17T05:46:47.914 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-09-17T05:46:47.914 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-17T05:46:47.914 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-09-17T05:46:47.914 INFO:teuthology.orchestra.run.smithi150.stdout: "entity": "osd.7", 2024-09-17T05:46:47.914 INFO:teuthology.orchestra.run.smithi150.stdout: "key": "AQCGFulmdcs7BRAAxsctes949cbkGkivdGpoYw==", 2024-09-17T05:46:47.914 INFO:teuthology.orchestra.run.smithi150.stdout: "caps": { 2024-09-17T05:46:47.914 INFO:teuthology.orchestra.run.smithi150.stdout: "mgr": "allow profile osd", 2024-09-17T05:46:47.914 INFO:teuthology.orchestra.run.smithi150.stdout: "mon": "allow profile osd", 2024-09-17T05:46:47.915 INFO:teuthology.orchestra.run.smithi150.stdout: "osd": "allow *" 2024-09-17T05:46:47.915 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-09-17T05:46:47.915 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-17T05:46:47.915 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-09-17T05:46:47.915 INFO:teuthology.orchestra.run.smithi150.stdout: "entity": "client.0", 2024-09-17T05:46:47.915 INFO:teuthology.orchestra.run.smithi150.stdout: "key": "AQBoFulmfF/1HBAAMezEjZDeoHTJ+uFfDXNWHQ==", 2024-09-17T05:46:47.915 INFO:teuthology.orchestra.run.smithi150.stdout: "caps": { 2024-09-17T05:46:47.915 INFO:teuthology.orchestra.run.smithi150.stdout: "mds": "allow", 2024-09-17T05:46:47.915 INFO:teuthology.orchestra.run.smithi150.stdout: "mon": "allow r", 2024-09-17T05:46:47.915 INFO:teuthology.orchestra.run.smithi150.stdout: "osd": "allow rw tag cephfs data=cephfs" 2024-09-17T05:46:47.915 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-09-17T05:46:47.915 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-17T05:46:47.915 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-09-17T05:46:47.915 INFO:teuthology.orchestra.run.smithi150.stdout: "entity": "client.1", 2024-09-17T05:46:47.916 INFO:teuthology.orchestra.run.smithi150.stdout: "key": "AQBoFulmv3GQJBAANlgjLqiCwzNfmBh8uClJ9A==", 2024-09-17T05:46:47.916 INFO:teuthology.orchestra.run.smithi150.stdout: "caps": { 2024-09-17T05:46:47.916 INFO:teuthology.orchestra.run.smithi150.stdout: "mds": "allow", 2024-09-17T05:46:47.916 INFO:teuthology.orchestra.run.smithi150.stdout: "mgr": "allow r", 2024-09-17T05:46:47.916 INFO:teuthology.orchestra.run.smithi150.stdout: "mon": "allow rw", 2024-09-17T05:46:47.916 INFO:teuthology.orchestra.run.smithi150.stdout: "osd": "allow rwx" 2024-09-17T05:46:47.916 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-09-17T05:46:47.916 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-17T05:46:47.916 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-09-17T05:46:47.916 INFO:teuthology.orchestra.run.smithi150.stdout: "entity": "client.2", 2024-09-17T05:46:47.916 INFO:teuthology.orchestra.run.smithi150.stdout: "key": "AQBoFulm1O/BIBAA8kfQL3/13SmZO1+y2tOZvw==", 2024-09-17T05:46:47.916 INFO:teuthology.orchestra.run.smithi150.stdout: "caps": { 2024-09-17T05:46:47.916 INFO:teuthology.orchestra.run.smithi150.stdout: "mds": "allow", 2024-09-17T05:46:47.917 INFO:teuthology.orchestra.run.smithi150.stdout: "mgr": "allow r", 2024-09-17T05:46:47.917 INFO:teuthology.orchestra.run.smithi150.stdout: "mon": "allow rw", 2024-09-17T05:46:47.917 INFO:teuthology.orchestra.run.smithi150.stdout: "osd": "allow rwx" 2024-09-17T05:46:47.917 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-09-17T05:46:47.917 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-17T05:46:47.917 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-09-17T05:46:47.917 INFO:teuthology.orchestra.run.smithi150.stdout: "entity": "client.3", 2024-09-17T05:46:47.917 INFO:teuthology.orchestra.run.smithi150.stdout: "key": "AQBoFulmF4hVKBAAZ5FGapBLLLtez3t8kON9dg==", 2024-09-17T05:46:47.917 INFO:teuthology.orchestra.run.smithi150.stdout: "caps": { 2024-09-17T05:46:47.917 INFO:teuthology.orchestra.run.smithi150.stdout: "mds": "allow", 2024-09-17T05:46:47.917 INFO:teuthology.orchestra.run.smithi150.stdout: "mgr": "allow r", 2024-09-17T05:46:47.917 INFO:teuthology.orchestra.run.smithi150.stdout: "mon": "allow rw", 2024-09-17T05:46:47.917 INFO:teuthology.orchestra.run.smithi150.stdout: "osd": "allow rwx" 2024-09-17T05:46:47.917 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-09-17T05:46:47.918 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-17T05:46:47.918 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-09-17T05:46:47.918 INFO:teuthology.orchestra.run.smithi150.stdout: "entity": "client.admin", 2024-09-17T05:46:47.918 INFO:teuthology.orchestra.run.smithi150.stdout: "key": "AQBnFulmaU9+IBAA7ZmXWZ44s0IpQ+C+Zw2V1g==", 2024-09-17T05:46:47.918 INFO:teuthology.orchestra.run.smithi150.stdout: "caps": { 2024-09-17T05:46:47.918 INFO:teuthology.orchestra.run.smithi150.stdout: "mds": "allow *", 2024-09-17T05:46:47.918 INFO:teuthology.orchestra.run.smithi150.stdout: "mgr": "allow *", 2024-09-17T05:46:47.918 INFO:teuthology.orchestra.run.smithi150.stdout: "mon": "allow *", 2024-09-17T05:46:47.918 INFO:teuthology.orchestra.run.smithi150.stdout: "osd": "allow *" 2024-09-17T05:46:47.918 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-09-17T05:46:47.918 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-17T05:46:47.918 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-09-17T05:46:47.918 INFO:teuthology.orchestra.run.smithi150.stdout: "entity": "mgr.x", 2024-09-17T05:46:47.919 INFO:teuthology.orchestra.run.smithi150.stdout: "key": "AQBnFulmEjvROhAAn3GZxCEtqPYLWopR1AcSFA==", 2024-09-17T05:46:47.919 INFO:teuthology.orchestra.run.smithi150.stdout: "caps": { 2024-09-17T05:46:47.919 INFO:teuthology.orchestra.run.smithi150.stdout: "mds": "allow *", 2024-09-17T05:46:47.919 INFO:teuthology.orchestra.run.smithi150.stdout: "mon": "allow profile mgr", 2024-09-17T05:46:47.919 INFO:teuthology.orchestra.run.smithi150.stdout: "osd": "allow *" 2024-09-17T05:46:47.919 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-09-17T05:46:47.919 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-17T05:46:47.919 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-09-17T05:46:47.919 INFO:teuthology.orchestra.run.smithi150.stdout: "entity": "mgr.y", 2024-09-17T05:46:47.919 INFO:teuthology.orchestra.run.smithi150.stdout: "key": "AQBnFulm9IkENhAA4uf1vzhYOepmovspN5/v1w==", 2024-09-17T05:46:47.919 INFO:teuthology.orchestra.run.smithi150.stdout: "caps": { 2024-09-17T05:46:47.919 INFO:teuthology.orchestra.run.smithi150.stdout: "mds": "allow *", 2024-09-17T05:46:47.919 INFO:teuthology.orchestra.run.smithi150.stdout: "mon": "allow profile mgr", 2024-09-17T05:46:47.919 INFO:teuthology.orchestra.run.smithi150.stdout: "osd": "allow *" 2024-09-17T05:46:47.920 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-09-17T05:46:47.920 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-09-17T05:46:47.920 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2024-09-17T05:46:47.920 INFO:teuthology.orchestra.run.smithi150.stdout:} 2024-09-17T05:46:47.921 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:47.907+0000 7ff89fdc3640 1 -- 172.21.15.150:0/244244633 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7ff87c079820 msgr2=0x7ff87c07bd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:46:47.921 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:47.907+0000 7ff89fdc3640 1 --2- 172.21.15.150:0/244244633 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7ff87c079820 0x7ff87c07bd30 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7ff888032000 tx=0x7ff888001190 comp rx=0 tx=0).stop 2024-09-17T05:46:47.921 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:47.907+0000 7ff89fdc3640 1 -- 172.21.15.150:0/244244633 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff884004800 msgr2=0x7ff89814f720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:46:47.922 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:47.907+0000 7ff89fdc3640 1 --2- 172.21.15.150:0/244244633 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff884004800 0x7ff89814f720 secure :-1 s=READY pgs=774 cs=0 l=1 rev1=1 crypto rx=0x7ff89400fa00 tx=0x7ff89400fec0 comp rx=0 tx=0).stop 2024-09-17T05:46:47.922 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:47.907+0000 7ff89fdc3640 1 -- 172.21.15.150:0/244244633 shutdown_connections 2024-09-17T05:46:47.922 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:47.907+0000 7ff89fdc3640 1 --2- 172.21.15.150:0/244244633 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff8980c9f20 0x7ff898150300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:47.922 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:47.907+0000 7ff89fdc3640 1 --2- 172.21.15.150:0/244244633 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7ff87c079820 0x7ff87c07bd30 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:47.922 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:47.907+0000 7ff89fdc3640 1 --2- 172.21.15.150:0/244244633 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff898150840 0x7ff89815e000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:47.922 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:47.907+0000 7ff89fdc3640 1 --2- 172.21.15.150:0/244244633 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff884004800 0x7ff89814f720 unknown :-1 s=CLOSED pgs=774 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:47.922 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:47.907+0000 7ff89fdc3640 1 -- 172.21.15.150:0/244244633 >> 172.21.15.150:0/244244633 conn(0x7ff8980d0b50 msgr2=0x7ff89806d400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:46:47.922 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:47.907+0000 7ff89fdc3640 1 -- 172.21.15.150:0/244244633 shutdown_connections 2024-09-17T05:46:47.922 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:47.907+0000 7ff89fdc3640 1 -- 172.21.15.150:0/244244633 wait complete. 2024-09-17T05:46:47.923 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-09-17T05:46:48.036 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:48.035+0000 7f42c6884640 1 -- 172.21.15.150:0/1446221193 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f42c00b3550 msgr2=0x7f42c00b3960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:46:48.037 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:48.035+0000 7f42c6884640 1 --2- 172.21.15.150:0/1446221193 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f42c00b3550 0x7f42c00b3960 secure :-1 s=READY pgs=776 cs=0 l=1 rev1=1 crypto rx=0x7f42c0072d60 tx=0x7f42b802a820 comp rx=0 tx=0).stop 2024-09-17T05:46:48.037 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:48.035+0000 7f42c6884640 1 -- 172.21.15.150:0/1446221193 shutdown_connections 2024-09-17T05:46:48.037 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:48.035+0000 7f42c6884640 1 --2- 172.21.15.150:0/1446221193 >> v2:172.21.15.176:3300/0 conn(0x7f42c00ad0e0 0x7f42c00ad4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:48.037 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:48.035+0000 7f42c6884640 1 --2- 172.21.15.150:0/1446221193 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f42c00b3550 0x7f42c00b3960 unknown :-1 s=CLOSED pgs=776 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:48.037 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:48.035+0000 7f42c6884640 1 -- 172.21.15.150:0/1446221193 >> 172.21.15.150:0/1446221193 conn(0x7f42c006d730 msgr2=0x7f42c00b1e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:46:48.037 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:48.036+0000 7f42c6884640 1 -- 172.21.15.150:0/1446221193 shutdown_connections 2024-09-17T05:46:48.037 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:48.036+0000 7f42c6884640 1 -- 172.21.15.150:0/1446221193 wait complete. 2024-09-17T05:46:48.038 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:48.037+0000 7f42c6884640 1 Processor -- start 2024-09-17T05:46:48.038 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:48.037+0000 7f42c6884640 1 -- start start 2024-09-17T05:46:48.041 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:48.039+0000 7f42c6884640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f42c00ad0e0 0x7f42c00994c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:46:48.041 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:48.039+0000 7f42c6884640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f42c00b3550 0x7f42c01e6bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:46:48.041 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:48.039+0000 7f42c6884640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f42c015d760 0x7f42c01e7130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:46:48.042 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:48.039+0000 7f42c6884640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f42c00b4da0 con 0x7f42c00b3550 2024-09-17T05:46:48.042 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:48.039+0000 7f42c6884640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f42c00b4c20 con 0x7f42c015d760 2024-09-17T05:46:48.042 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:48.039+0000 7f42c6884640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f42c00b3ea0 con 0x7f42c00ad0e0 2024-09-17T05:46:48.042 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:48.039+0000 7f42bf7fe640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f42c00b3550 0x7f42c01e6bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:46:48.042 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:48.039+0000 7f42bf7fe640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f42c00b3550 0x7f42c01e6bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:39346/0 (socket says 172.21.15.150:39346) 2024-09-17T05:46:48.042 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:48.039+0000 7f42bf7fe640 1 -- 172.21.15.150:0/2652645616 learned_addr learned my addr 172.21.15.150:0/2652645616 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:46:48.044 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:48.039+0000 7f42c4e21640 1 --2- 172.21.15.150:0/2652645616 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f42c015d760 0x7f42c01e7130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:46:48.044 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:48.039+0000 7f42bffff640 1 --2- 172.21.15.150:0/2652645616 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f42c00ad0e0 0x7f42c00994c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:46:48.044 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:48.039+0000 7f42bf7fe640 1 -- 172.21.15.150:0/2652645616 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f42c00ad0e0 msgr2=0x7f42c00994c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:46:48.044 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:48.039+0000 7f42bf7fe640 1 --2- 172.21.15.150:0/2652645616 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f42c00ad0e0 0x7f42c00994c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:48.044 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:48.039+0000 7f42bf7fe640 1 -- 172.21.15.150:0/2652645616 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f42c015d760 msgr2=0x7f42c01e7130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:46:48.044 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:48.039+0000 7f42bf7fe640 1 --2- 172.21.15.150:0/2652645616 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f42c015d760 0x7f42c01e7130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:48.044 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:48.039+0000 7f42bf7fe640 1 -- 172.21.15.150:0/2652645616 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f42c01e7970 con 0x7f42c00b3550 2024-09-17T05:46:48.044 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:48.039+0000 7f42c4e21640 1 --2- 172.21.15.150:0/2652645616 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f42c015d760 0x7f42c01e7130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:46:48.044 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:48.039+0000 7f42bf7fe640 1 --2- 172.21.15.150:0/2652645616 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f42c00b3550 0x7f42c01e6bf0 secure :-1 s=READY pgs=777 cs=0 l=1 rev1=1 crypto rx=0x7f42b400d6d0 tx=0x7f42b400db90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:46:48.045 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:48.039+0000 7f42bcff9640 1 -- 172.21.15.150:0/2652645616 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42b4017070 con 0x7f42c00b3550 2024-09-17T05:46:48.045 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:48.039+0000 7f42bcff9640 1 -- 172.21.15.150:0/2652645616 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f42b4004310 con 0x7f42c00b3550 2024-09-17T05:46:48.045 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:48.039+0000 7f42c6884640 1 -- 172.21.15.150:0/2652645616 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f42c01e7c50 con 0x7f42c00b3550 2024-09-17T05:46:48.045 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:48.040+0000 7f42bcff9640 1 -- 172.21.15.150:0/2652645616 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42b4009a80 con 0x7f42c00b3550 2024-09-17T05:46:48.045 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:48.040+0000 7f42c6884640 1 -- 172.21.15.150:0/2652645616 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f42c01e8210 con 0x7f42c00b3550 2024-09-17T05:46:48.045 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:48.041+0000 7f42c6884640 1 -- 172.21.15.150:0/2652645616 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f42c00719e0 con 0x7f42c00b3550 2024-09-17T05:46:48.046 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:48.041+0000 7f42bcff9640 1 -- 172.21.15.150:0/2652645616 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 19) ==== 102563+0+0 (secure 0 0 0) 0x7f42b4009c20 con 0x7f42c00b3550 2024-09-17T05:46:48.046 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:48.042+0000 7f42bcff9640 1 --2- 172.21.15.150:0/2652645616 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f42ac0797f0 0x7f42ac07bd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:46:48.046 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:48.042+0000 7f42bcff9640 1 -- 172.21.15.150:0/2652645616 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(68..68 src has 1..68) ==== 4913+0+0 (secure 0 0 0) 0x7f42b4099910 con 0x7f42c00b3550 2024-09-17T05:46:48.046 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:48.042+0000 7f42bffff640 1 --2- 172.21.15.150:0/2652645616 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f42ac0797f0 0x7f42ac07bd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:46:48.046 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:48.043+0000 7f42bffff640 1 --2- 172.21.15.150:0/2652645616 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f42ac0797f0 0x7f42ac07bd00 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f42b0001720 tx=0x7f42b0007e90 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:46:48.047 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:48.047+0000 7f42bcff9640 1 -- 172.21.15.150:0/2652645616 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f42c00719e0 con 0x7f42c00b3550 2024-09-17T05:46:48.225 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:48.224+0000 7f42c6884640 1 -- 172.21.15.150:0/2652645616 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7f42c01e7700 con 0x7f42c00b3550 2024-09-17T05:46:48.225 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:48.225+0000 7f42bcff9640 1 -- 172.21.15.150:0/2652645616 <== mon.0 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v68) ==== 84+0+65 (secure 0 0 0) 0x7f42b4062fc0 con 0x7f42c00b3550 2024-09-17T05:46:48.225 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-09-17T05:46:48.226 INFO:teuthology.orchestra.run.smithi150.stdout:[ 2024-09-17T05:46:48.226 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-09-17T05:46:48.226 INFO:teuthology.orchestra.run.smithi150.stdout: "poolnum": 1, 2024-09-17T05:46:48.226 INFO:teuthology.orchestra.run.smithi150.stdout: "poolname": ".mgr" 2024-09-17T05:46:48.226 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-09-17T05:46:48.226 INFO:teuthology.orchestra.run.smithi150.stdout:] 2024-09-17T05:46:48.228 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:48.227+0000 7f42c6884640 1 -- 172.21.15.150:0/2652645616 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f42ac0797f0 msgr2=0x7f42ac07bd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:46:48.228 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:48.227+0000 7f42c6884640 1 --2- 172.21.15.150:0/2652645616 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f42ac0797f0 0x7f42ac07bd00 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f42b0001720 tx=0x7f42b0007e90 comp rx=0 tx=0).stop 2024-09-17T05:46:48.228 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:48.227+0000 7f42c6884640 1 -- 172.21.15.150:0/2652645616 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f42c00b3550 msgr2=0x7f42c01e6bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:46:48.228 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:48.227+0000 7f42c6884640 1 --2- 172.21.15.150:0/2652645616 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f42c00b3550 0x7f42c01e6bf0 secure :-1 s=READY pgs=777 cs=0 l=1 rev1=1 crypto rx=0x7f42b400d6d0 tx=0x7f42b400db90 comp rx=0 tx=0).stop 2024-09-17T05:46:48.228 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:48.227+0000 7f42c6884640 1 -- 172.21.15.150:0/2652645616 shutdown_connections 2024-09-17T05:46:48.228 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:48.227+0000 7f42c6884640 1 --2- 172.21.15.150:0/2652645616 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f42c015d760 0x7f42c01e7130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:48.228 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:48.227+0000 7f42c6884640 1 --2- 172.21.15.150:0/2652645616 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f42ac0797f0 0x7f42ac07bd00 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:48.228 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:48.227+0000 7f42c6884640 1 --2- 172.21.15.150:0/2652645616 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f42c00b3550 0x7f42c01e6bf0 unknown :-1 s=CLOSED pgs=777 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:48.228 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:48.227+0000 7f42c6884640 1 --2- 172.21.15.150:0/2652645616 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f42c00ad0e0 0x7f42c00994c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:48.228 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:48.227+0000 7f42c6884640 1 -- 172.21.15.150:0/2652645616 >> 172.21.15.150:0/2652645616 conn(0x7f42c006d730 msgr2=0x7f42c0152bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:46:48.228 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:48.227+0000 7f42c6884640 1 -- 172.21.15.150:0/2652645616 shutdown_connections 2024-09-17T05:46:48.229 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:48.227+0000 7f42c6884640 1 -- 172.21.15.150:0/2652645616 wait complete. 2024-09-17T05:46:48.239 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-09-17T05:46:48.240 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-09-17T05:46:48.358 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:48.357+0000 7f39deac5640 1 -- 172.21.15.150:0/1282014884 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f39d80d0d20 msgr2=0x7f39d80d1130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:46:48.358 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:48.357+0000 7f39deac5640 1 --2- 172.21.15.150:0/1282014884 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f39d80d0d20 0x7f39d80d1130 secure :-1 s=READY pgs=779 cs=0 l=1 rev1=1 crypto rx=0x7f39d4009830 tx=0x7f39d402a510 comp rx=0 tx=0).stop 2024-09-17T05:46:48.358 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:48.357+0000 7f39deac5640 1 -- 172.21.15.150:0/1282014884 shutdown_connections 2024-09-17T05:46:48.358 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:48.357+0000 7f39deac5640 1 --2- 172.21.15.150:0/1282014884 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f39d80d0d20 0x7f39d80d1130 unknown :-1 s=CLOSED pgs=779 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:48.358 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:48.357+0000 7f39deac5640 1 -- 172.21.15.150:0/1282014884 >> 172.21.15.150:0/1282014884 conn(0x7f39d80d46f0 msgr2=0x7f39d80d4b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:46:48.359 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:48.357+0000 7f39deac5640 1 -- 172.21.15.150:0/1282014884 shutdown_connections 2024-09-17T05:46:48.359 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:48.357+0000 7f39deac5640 1 -- 172.21.15.150:0/1282014884 wait complete. 2024-09-17T05:46:48.359 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:48.359+0000 7f39deac5640 1 Processor -- start 2024-09-17T05:46:48.360 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:48.359+0000 7f39deac5640 1 -- start start 2024-09-17T05:46:48.363 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:48.360+0000 7f39deac5640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f39d80d0310 0x7f39d81e8ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:46:48.363 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:48.360+0000 7f39deac5640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f39d80d0d20 0x7f39d814da00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:46:48.363 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:48.360+0000 7f39deac5640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f39d80d1670 0x7f39d8159480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:46:48.363 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:48.360+0000 7f39deac5640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f39d80ba200 con 0x7f39d80d0310 2024-09-17T05:46:48.363 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:48.360+0000 7f39deac5640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f39d80ba080 con 0x7f39d80d0d20 2024-09-17T05:46:48.363 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:48.360+0000 7f39deac5640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f39d806f1b0 con 0x7f39d80d1670 2024-09-17T05:46:48.363 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:48.361+0000 7f39dc861640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f39d80d0310 0x7f39d81e8ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:46:48.363 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:48.361+0000 7f39dc861640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f39d80d0310 0x7f39d81e8ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:39368/0 (socket says 172.21.15.150:39368) 2024-09-17T05:46:48.363 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:48.361+0000 7f39dc861640 1 -- 172.21.15.150:0/4187627949 learned_addr learned my addr 172.21.15.150:0/4187627949 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:46:48.363 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:48.361+0000 7f39dd062640 1 --2- 172.21.15.150:0/4187627949 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f39d80d1670 0x7f39d8159480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:46:48.363 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:48.361+0000 7f39dc861640 1 -- 172.21.15.150:0/4187627949 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f39d80d1670 msgr2=0x7f39d8159480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:46:48.364 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:48.361+0000 7f39cffff640 1 --2- 172.21.15.150:0/4187627949 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f39d80d0d20 0x7f39d814da00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:46:48.364 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:48.361+0000 7f39dc861640 1 --2- 172.21.15.150:0/4187627949 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f39d80d1670 0x7f39d8159480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:48.364 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:48.361+0000 7f39dc861640 1 -- 172.21.15.150:0/4187627949 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f39d80d0d20 msgr2=0x7f39d814da00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:46:48.364 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:48.361+0000 7f39dc861640 1 --2- 172.21.15.150:0/4187627949 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f39d80d0d20 0x7f39d814da00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:48.364 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:48.361+0000 7f39dc861640 1 -- 172.21.15.150:0/4187627949 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f39d815f080 con 0x7f39d80d0310 2024-09-17T05:46:48.364 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:48.361+0000 7f39dc861640 1 --2- 172.21.15.150:0/4187627949 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f39d80d0310 0x7f39d81e8ef0 secure :-1 s=READY pgs=780 cs=0 l=1 rev1=1 crypto rx=0x7f39d4009950 tx=0x7f39d4033c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:46:48.364 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:48.361+0000 7f39cd7fa640 1 -- 172.21.15.150:0/4187627949 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39d4031d60 con 0x7f39d80d0310 2024-09-17T05:46:48.364 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:48.361+0000 7f39cd7fa640 1 -- 172.21.15.150:0/4187627949 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f39d4033e10 con 0x7f39d80d0310 2024-09-17T05:46:48.364 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:48.361+0000 7f39deac5640 1 -- 172.21.15.150:0/4187627949 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f39d81e8410 con 0x7f39d80d0310 2024-09-17T05:46:48.364 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:48.361+0000 7f39cd7fa640 1 -- 172.21.15.150:0/4187627949 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39d4005260 con 0x7f39d80d0310 2024-09-17T05:46:48.365 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:48.361+0000 7f39deac5640 1 -- 172.21.15.150:0/4187627949 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f39d81e89d0 con 0x7f39d80d0310 2024-09-17T05:46:48.365 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:48.362+0000 7f39deac5640 1 -- 172.21.15.150:0/4187627949 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f39d80d1130 con 0x7f39d80d0310 2024-09-17T05:46:48.366 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:48.363+0000 7f39cd7fa640 1 -- 172.21.15.150:0/4187627949 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 19) ==== 102563+0+0 (secure 0 0 0) 0x7f39d4005400 con 0x7f39d80d0310 2024-09-17T05:46:48.366 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:48.364+0000 7f39cd7fa640 1 --2- 172.21.15.150:0/4187627949 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f39c40797f0 0x7f39c407bd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:46:48.366 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:48.364+0000 7f39cd7fa640 1 -- 172.21.15.150:0/4187627949 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(68..68 src has 1..68) ==== 4913+0+0 (secure 0 0 0) 0x7f39d40bac20 con 0x7f39d80d0310 2024-09-17T05:46:48.366 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:48.364+0000 7f39cffff640 1 --2- 172.21.15.150:0/4187627949 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f39c40797f0 0x7f39c407bd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:46:48.366 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:48.364+0000 7f39cffff640 1 --2- 172.21.15.150:0/4187627949 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f39c40797f0 0x7f39c407bd00 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f39d815fc30 tx=0x7f39c8009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:46:48.368 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:48.368+0000 7f39cd7fa640 1 -- 172.21.15.150:0/4187627949 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f39d403f030 con 0x7f39d80d0310 2024-09-17T05:46:48.545 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:48.545+0000 7f39deac5640 1 -- 172.21.15.150:0/4187627949 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7f39d81e81f0 con 0x7f39d80d0310 2024-09-17T05:46:49.534 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:49.533+0000 7f39cd7fa640 1 -- 172.21.15.150:0/4187627949 <== mon.0 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v69) ==== 138+0+0 (secure 0 0 0) 0x7f39d4084920 con 0x7f39d80d0310 2024-09-17T05:46:49.534 INFO:teuthology.orchestra.run.smithi150.stderr:pool 'cephfs_metadata' created 2024-09-17T05:46:49.537 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:49.537+0000 7f39deac5640 1 -- 172.21.15.150:0/4187627949 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f39c40797f0 msgr2=0x7f39c407bd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:46:49.537 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:49.537+0000 7f39deac5640 1 --2- 172.21.15.150:0/4187627949 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f39c40797f0 0x7f39c407bd00 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f39d815fc30 tx=0x7f39c8009040 comp rx=0 tx=0).stop 2024-09-17T05:46:49.537 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:49.537+0000 7f39deac5640 1 -- 172.21.15.150:0/4187627949 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f39d80d0310 msgr2=0x7f39d81e8ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:46:49.537 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:49.537+0000 7f39deac5640 1 --2- 172.21.15.150:0/4187627949 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f39d80d0310 0x7f39d81e8ef0 secure :-1 s=READY pgs=780 cs=0 l=1 rev1=1 crypto rx=0x7f39d4009950 tx=0x7f39d4033c20 comp rx=0 tx=0).stop 2024-09-17T05:46:49.538 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:49.537+0000 7f39deac5640 1 -- 172.21.15.150:0/4187627949 shutdown_connections 2024-09-17T05:46:49.538 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:49.537+0000 7f39deac5640 1 --2- 172.21.15.150:0/4187627949 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f39d80d0d20 0x7f39d814da00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:49.538 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:49.537+0000 7f39deac5640 1 --2- 172.21.15.150:0/4187627949 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f39c40797f0 0x7f39c407bd00 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:49.538 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:49.537+0000 7f39deac5640 1 --2- 172.21.15.150:0/4187627949 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f39d80d1670 0x7f39d8159480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:49.538 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:49.537+0000 7f39deac5640 1 --2- 172.21.15.150:0/4187627949 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f39d80d0310 0x7f39d81e8ef0 unknown :-1 s=CLOSED pgs=780 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:49.538 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:49.537+0000 7f39deac5640 1 -- 172.21.15.150:0/4187627949 >> 172.21.15.150:0/4187627949 conn(0x7f39d80d46f0 msgr2=0x7f39d80b1260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:46:49.538 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:49.537+0000 7f39deac5640 1 -- 172.21.15.150:0/4187627949 shutdown_connections 2024-09-17T05:46:49.538 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:49.537+0000 7f39deac5640 1 -- 172.21.15.150:0/4187627949 wait complete. 2024-09-17T05:46:49.553 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-09-17T05:46:49.677 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:49.676+0000 7f242d77b640 1 -- 172.21.15.150:0/2722479901 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f24280d5150 msgr2=0x7f24280b9b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:46:49.677 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:49.676+0000 7f242d77b640 1 --2- 172.21.15.150:0/2722479901 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f24280d5150 0x7f24280b9b10 secure :-1 s=READY pgs=782 cs=0 l=1 rev1=1 crypto rx=0x7f24280cfd10 tx=0x7f241802a5a0 comp rx=0 tx=0).stop 2024-09-17T05:46:49.677 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:49.676+0000 7f242d77b640 1 -- 172.21.15.150:0/2722479901 shutdown_connections 2024-09-17T05:46:49.677 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:49.676+0000 7f242d77b640 1 --2- 172.21.15.150:0/2722479901 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f24280d5150 0x7f24280b9b10 unknown :-1 s=CLOSED pgs=782 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:49.677 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:49.676+0000 7f242d77b640 1 -- 172.21.15.150:0/2722479901 >> 172.21.15.150:0/2722479901 conn(0x7f242808bfe0 msgr2=0x7f24280d46e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:46:49.677 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:49.676+0000 7f242d77b640 1 -- 172.21.15.150:0/2722479901 shutdown_connections 2024-09-17T05:46:49.677 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:49.676+0000 7f242d77b640 1 -- 172.21.15.150:0/2722479901 wait complete. 2024-09-17T05:46:49.679 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:49.678+0000 7f242d77b640 1 Processor -- start 2024-09-17T05:46:49.679 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:49.678+0000 7f242d77b640 1 -- start start 2024-09-17T05:46:49.685 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:49.679+0000 7f242d77b640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f242806dea0 0x7f242815c8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:46:49.685 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:49.679+0000 7f242d77b640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f24280d0730 0x7f24280cd850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:46:49.685 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:49.679+0000 7f242d77b640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f24280d5150 0x7f242815ced0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:46:49.686 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:49.679+0000 7f242d77b640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f24280b6870 con 0x7f242806dea0 2024-09-17T05:46:49.686 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:49.679+0000 7f242d77b640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f24280d31e0 con 0x7f24280d0730 2024-09-17T05:46:49.686 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:49.679+0000 7f242d77b640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f24280b69f0 con 0x7f24280d5150 2024-09-17T05:46:49.686 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:49.679+0000 7f2426ffd640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f242806dea0 0x7f242815c8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:46:49.686 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:49.679+0000 7f2426ffd640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f242806dea0 0x7f242815c8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:39382/0 (socket says 172.21.15.150:39382) 2024-09-17T05:46:49.687 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:49.679+0000 7f2426ffd640 1 -- 172.21.15.150:0/1449383985 learned_addr learned my addr 172.21.15.150:0/1449383985 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:46:49.687 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:49.679+0000 7f24267fc640 1 --2- 172.21.15.150:0/1449383985 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f24280d0730 0x7f24280cd850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:46:49.687 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:49.679+0000 7f24277fe640 1 --2- 172.21.15.150:0/1449383985 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f24280d5150 0x7f242815ced0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:46:49.687 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:49.679+0000 7f2426ffd640 1 -- 172.21.15.150:0/1449383985 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f24280d5150 msgr2=0x7f242815ced0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:46:49.687 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:49.679+0000 7f2426ffd640 1 --2- 172.21.15.150:0/1449383985 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f24280d5150 0x7f242815ced0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:49.688 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:49.679+0000 7f2426ffd640 1 -- 172.21.15.150:0/1449383985 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f24280d0730 msgr2=0x7f24280cd850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:46:49.688 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:49.679+0000 7f2426ffd640 1 --2- 172.21.15.150:0/1449383985 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f24280d0730 0x7f24280cd850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:49.688 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:49.680+0000 7f2426ffd640 1 -- 172.21.15.150:0/1449383985 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f24280ccb00 con 0x7f242806dea0 2024-09-17T05:46:49.688 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:49.680+0000 7f2426ffd640 1 --2- 172.21.15.150:0/1449383985 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f242806dea0 0x7f242815c8e0 secure :-1 s=READY pgs=783 cs=0 l=1 rev1=1 crypto rx=0x7f241802ab90 tx=0x7f2418004b90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:46:49.688 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:49.680+0000 7f240f7fe640 1 -- 172.21.15.150:0/1449383985 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2418031d60 con 0x7f242806dea0 2024-09-17T05:46:49.689 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:49.680+0000 7f240f7fe640 1 -- 172.21.15.150:0/1449383985 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f24180330d0 con 0x7f242806dea0 2024-09-17T05:46:49.689 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:49.680+0000 7f242d77b640 1 -- 172.21.15.150:0/1449383985 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f24280cdd90 con 0x7f242806dea0 2024-09-17T05:46:49.689 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:49.680+0000 7f240f7fe640 1 -- 172.21.15.150:0/1449383985 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2418033520 con 0x7f242806dea0 2024-09-17T05:46:49.690 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:49.680+0000 7f242d77b640 1 -- 172.21.15.150:0/1449383985 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f24280cd050 con 0x7f242806dea0 2024-09-17T05:46:49.690 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:49.681+0000 7f242d77b640 1 -- 172.21.15.150:0/1449383985 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f242806e3e0 con 0x7f242806dea0 2024-09-17T05:46:49.690 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:49.682+0000 7f240f7fe640 1 -- 172.21.15.150:0/1449383985 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 19) ==== 102563+0+0 (secure 0 0 0) 0x7f2418004d80 con 0x7f242806dea0 2024-09-17T05:46:49.690 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:49.682+0000 7f240f7fe640 1 --2- 172.21.15.150:0/1449383985 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f24140797f0 0x7f241407bd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:46:49.690 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:49.683+0000 7f240f7fe640 1 -- 172.21.15.150:0/1449383985 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(69..69 src has 1..69) ==== 5283+0+0 (secure 0 0 0) 0x7f24180baee0 con 0x7f242806dea0 2024-09-17T05:46:49.691 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:49.683+0000 7f24267fc640 1 --2- 172.21.15.150:0/1449383985 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f24140797f0 0x7f241407bd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:46:49.691 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:49.683+0000 7f24267fc640 1 --2- 172.21.15.150:0/1449383985 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f24140797f0 0x7f241407bd00 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f2428159fa0 tx=0x7f241c009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:46:49.693 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:49.687+0000 7f240f7fe640 1 -- 172.21.15.150:0/1449383985 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f241803f030 con 0x7f242806dea0 2024-09-17T05:46:49.864 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:49.863+0000 7f242d77b640 1 -- 172.21.15.150:0/1449383985 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7f24280b6650 con 0x7f242806dea0 2024-09-17T05:46:50.536 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:50.536+0000 7f240f7fe640 1 -- 172.21.15.150:0/1449383985 <== mon.0 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v70) ==== 170+0+0 (secure 0 0 0) 0x7f2418031770 con 0x7f242806dea0 2024-09-17T05:46:50.536 INFO:teuthology.orchestra.run.smithi150.stderr:pool 'cephfs_data' created 2024-09-17T05:46:50.540 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:50.539+0000 7f242d77b640 1 -- 172.21.15.150:0/1449383985 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f24140797f0 msgr2=0x7f241407bd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:46:50.540 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:50.539+0000 7f242d77b640 1 --2- 172.21.15.150:0/1449383985 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f24140797f0 0x7f241407bd00 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f2428159fa0 tx=0x7f241c009040 comp rx=0 tx=0).stop 2024-09-17T05:46:50.541 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:50.539+0000 7f242d77b640 1 -- 172.21.15.150:0/1449383985 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f242806dea0 msgr2=0x7f242815c8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:46:50.541 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:50.539+0000 7f242d77b640 1 --2- 172.21.15.150:0/1449383985 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f242806dea0 0x7f242815c8e0 secure :-1 s=READY pgs=783 cs=0 l=1 rev1=1 crypto rx=0x7f241802ab90 tx=0x7f2418004b90 comp rx=0 tx=0).stop 2024-09-17T05:46:50.541 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:50.539+0000 7f242d77b640 1 -- 172.21.15.150:0/1449383985 shutdown_connections 2024-09-17T05:46:50.541 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:50.539+0000 7f242d77b640 1 --2- 172.21.15.150:0/1449383985 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f24280d0730 0x7f24280cd850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:50.541 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:50.539+0000 7f242d77b640 1 --2- 172.21.15.150:0/1449383985 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f24140797f0 0x7f241407bd00 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:50.541 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:50.539+0000 7f242d77b640 1 --2- 172.21.15.150:0/1449383985 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f24280d5150 0x7f242815ced0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:50.541 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:50.539+0000 7f242d77b640 1 --2- 172.21.15.150:0/1449383985 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f242806dea0 0x7f242815c8e0 unknown :-1 s=CLOSED pgs=783 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:50.541 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:50.539+0000 7f242d77b640 1 -- 172.21.15.150:0/1449383985 >> 172.21.15.150:0/1449383985 conn(0x7f242808bfe0 msgr2=0x7f24280b24a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:46:50.541 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:50.539+0000 7f242d77b640 1 -- 172.21.15.150:0/1449383985 shutdown_connections 2024-09-17T05:46:50.541 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:50.540+0000 7f242d77b640 1 -- 172.21.15.150:0/1449383985 wait complete. 2024-09-17T05:46:50.569 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-09-17T05:46:50.687 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:50.686+0000 7fb3b24a2640 1 -- 172.21.15.150:0/831934055 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb3ac0b3ae0 msgr2=0x7fb3ac0d2370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:46:50.687 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:50.686+0000 7fb3b24a2640 1 --2- 172.21.15.150:0/831934055 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb3ac0b3ae0 0x7fb3ac0d2370 secure :-1 s=READY pgs=784 cs=0 l=1 rev1=1 crypto rx=0x7fb3ac08dac0 tx=0x7fb39c02a540 comp rx=0 tx=0).stop 2024-09-17T05:46:50.687 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:50.686+0000 7fb3b24a2640 1 -- 172.21.15.150:0/831934055 shutdown_connections 2024-09-17T05:46:50.688 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:50.686+0000 7fb3b24a2640 1 --2- 172.21.15.150:0/831934055 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb3ac163210 0x7fb3ac0cf4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:50.688 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:50.686+0000 7fb3b24a2640 1 --2- 172.21.15.150:0/831934055 >> v2:172.21.15.176:3300/0 conn(0x7fb3ac1628c0 0x7fb3ac162cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:50.688 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:50.686+0000 7fb3b24a2640 1 --2- 172.21.15.150:0/831934055 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb3ac0b3ae0 0x7fb3ac0d2370 unknown :-1 s=CLOSED pgs=784 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:50.688 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:50.686+0000 7fb3b24a2640 1 -- 172.21.15.150:0/831934055 >> 172.21.15.150:0/831934055 conn(0x7fb3ac0d4680 msgr2=0x7fb3ac0d4a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:46:50.688 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:50.686+0000 7fb3b24a2640 1 -- 172.21.15.150:0/831934055 shutdown_connections 2024-09-17T05:46:50.688 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:50.686+0000 7fb3b24a2640 1 -- 172.21.15.150:0/831934055 wait complete. 2024-09-17T05:46:50.688 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:50.688+0000 7fb3b24a2640 1 Processor -- start 2024-09-17T05:46:50.688 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:50.688+0000 7fb3b24a2640 1 -- start start 2024-09-17T05:46:50.692 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:50.689+0000 7fb3b24a2640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb3ac0b3ae0 0x7fb3ac15fdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:46:50.693 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:50.689+0000 7fb3b24a2640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb3ac1628c0 0x7fb3ac154970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:46:50.693 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:50.689+0000 7fb3b24a2640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb3ac163210 0x7fb3ac0ce140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:46:50.693 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:50.689+0000 7fb3b24a2640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7fb3ac0cfb80 con 0x7fb3ac1628c0 2024-09-17T05:46:50.693 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:50.689+0000 7fb3b24a2640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fb3ac0cfa00 con 0x7fb3ac163210 2024-09-17T05:46:50.694 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:50.689+0000 7fb3b24a2640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fb3ac0cfd00 con 0x7fb3ac0b3ae0 2024-09-17T05:46:50.694 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:50.689+0000 7fb3ab7fe640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb3ac1628c0 0x7fb3ac154970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:46:50.694 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:50.689+0000 7fb3ab7fe640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb3ac1628c0 0x7fb3ac154970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:59656/0 (socket says 172.21.15.150:59656) 2024-09-17T05:46:50.694 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:50.689+0000 7fb3ab7fe640 1 -- 172.21.15.150:0/2875943734 learned_addr learned my addr 172.21.15.150:0/2875943734 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:46:50.694 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:50.690+0000 7fb3abfff640 1 --2- 172.21.15.150:0/2875943734 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb3ac0b3ae0 0x7fb3ac15fdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:46:50.694 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:50.690+0000 7fb3b0a3f640 1 --2- 172.21.15.150:0/2875943734 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb3ac163210 0x7fb3ac0ce140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:46:50.694 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:50.690+0000 7fb3ab7fe640 1 -- 172.21.15.150:0/2875943734 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb3ac0b3ae0 msgr2=0x7fb3ac15fdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:46:50.694 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:50.690+0000 7fb3ab7fe640 1 --2- 172.21.15.150:0/2875943734 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb3ac0b3ae0 0x7fb3ac15fdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:50.695 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:50.690+0000 7fb3ab7fe640 1 -- 172.21.15.150:0/2875943734 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb3ac163210 msgr2=0x7fb3ac0ce140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:46:50.695 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:50.690+0000 7fb3ab7fe640 1 --2- 172.21.15.150:0/2875943734 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb3ac163210 0x7fb3ac0ce140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:50.695 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:50.690+0000 7fb3ab7fe640 1 -- 172.21.15.150:0/2875943734 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb3ac154eb0 con 0x7fb3ac1628c0 2024-09-17T05:46:50.695 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:50.690+0000 7fb3abfff640 1 --2- 172.21.15.150:0/2875943734 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb3ac0b3ae0 0x7fb3ac15fdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:46:50.695 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:50.690+0000 7fb3ab7fe640 1 --2- 172.21.15.150:0/2875943734 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb3ac1628c0 0x7fb3ac154970 secure :-1 s=READY pgs=785 cs=0 l=1 rev1=1 crypto rx=0x7fb3a000d720 tx=0x7fb3a000dbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:46:50.695 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:50.690+0000 7fb3a8ff9640 1 -- 172.21.15.150:0/2875943734 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3a0017070 con 0x7fb3ac1628c0 2024-09-17T05:46:50.695 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:50.690+0000 7fb3a8ff9640 1 -- 172.21.15.150:0/2875943734 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb3a0009ab0 con 0x7fb3ac1628c0 2024-09-17T05:46:50.695 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:50.690+0000 7fb3b24a2640 1 -- 172.21.15.150:0/2875943734 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb3ac0c97b0 con 0x7fb3ac1628c0 2024-09-17T05:46:50.696 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:50.690+0000 7fb3a8ff9640 1 -- 172.21.15.150:0/2875943734 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3a0010460 con 0x7fb3ac1628c0 2024-09-17T05:46:50.696 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:50.690+0000 7fb3b24a2640 1 -- 172.21.15.150:0/2875943734 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb3ac0c9d70 con 0x7fb3ac1628c0 2024-09-17T05:46:50.696 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:50.691+0000 7fb3b24a2640 1 -- 172.21.15.150:0/2875943734 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb3ac0ce930 con 0x7fb3ac1628c0 2024-09-17T05:46:50.696 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:50.692+0000 7fb3a8ff9640 1 -- 172.21.15.150:0/2875943734 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 19) ==== 102563+0+0 (secure 0 0 0) 0x7fb3a001a070 con 0x7fb3ac1628c0 2024-09-17T05:46:50.697 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:50.693+0000 7fb3a8ff9640 1 --2- 172.21.15.150:0/2875943734 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fb3980797f0 0x7fb39807bd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:46:50.698 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:50.693+0000 7fb3a8ff9640 1 -- 172.21.15.150:0/2875943734 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(70..70 src has 1..70) ==== 5665+0+0 (secure 0 0 0) 0x7fb3a0099f50 con 0x7fb3ac1628c0 2024-09-17T05:46:50.698 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:50.693+0000 7fb3abfff640 1 --2- 172.21.15.150:0/2875943734 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fb3980797f0 0x7fb39807bd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:46:50.698 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:50.694+0000 7fb3abfff640 1 --2- 172.21.15.150:0/2875943734 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fb3980797f0 0x7fb39807bd00 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7fb39c034000 tx=0x7fb39c004730 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:46:50.698 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:50.697+0000 7fb3a8ff9640 1 -- 172.21.15.150:0/2875943734 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fb3a0063ba0 con 0x7fb3ac1628c0 2024-09-17T05:46:50.910 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:50.909+0000 7fb3b24a2640 1 -- 172.21.15.150:0/2875943734 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7fb3ac08d090 con 0x7fb3ac1628c0 2024-09-17T05:46:51.561 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:51.561+0000 7fb3a8ff9640 1 -- 172.21.15.150:0/2875943734 <== mon.0 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 10 and data pool 11 v39) ==== 174+0+0 (secure 0 0 0) 0x7fb3ac08d090 con 0x7fb3ac1628c0 2024-09-17T05:46:51.562 INFO:teuthology.orchestra.run.smithi150.stderr:new fs with metadata pool 10 and data pool 11 2024-09-17T05:46:51.569 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:51.565+0000 7fb3b24a2640 1 -- 172.21.15.150:0/2875943734 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fb3980797f0 msgr2=0x7fb39807bd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:46:51.570 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:51.565+0000 7fb3b24a2640 1 --2- 172.21.15.150:0/2875943734 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fb3980797f0 0x7fb39807bd00 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7fb39c034000 tx=0x7fb39c004730 comp rx=0 tx=0).stop 2024-09-17T05:46:51.570 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:51.565+0000 7fb3b24a2640 1 -- 172.21.15.150:0/2875943734 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb3ac1628c0 msgr2=0x7fb3ac154970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:46:51.570 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:51.565+0000 7fb3b24a2640 1 --2- 172.21.15.150:0/2875943734 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb3ac1628c0 0x7fb3ac154970 secure :-1 s=READY pgs=785 cs=0 l=1 rev1=1 crypto rx=0x7fb3a000d720 tx=0x7fb3a000dbe0 comp rx=0 tx=0).stop 2024-09-17T05:46:51.570 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:51.567+0000 7fb3b24a2640 1 -- 172.21.15.150:0/2875943734 shutdown_connections 2024-09-17T05:46:51.570 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:51.567+0000 7fb3b24a2640 1 --2- 172.21.15.150:0/2875943734 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb3ac163210 0x7fb3ac0ce140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:51.570 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:51.567+0000 7fb3b24a2640 1 --2- 172.21.15.150:0/2875943734 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fb3980797f0 0x7fb39807bd00 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:51.570 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:51.567+0000 7fb3b24a2640 1 --2- 172.21.15.150:0/2875943734 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb3ac1628c0 0x7fb3ac154970 unknown :-1 s=CLOSED pgs=785 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:51.570 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:51.567+0000 7fb3b24a2640 1 --2- 172.21.15.150:0/2875943734 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb3ac0b3ae0 0x7fb3ac15fdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:51.570 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:51.567+0000 7fb3b24a2640 1 -- 172.21.15.150:0/2875943734 >> 172.21.15.150:0/2875943734 conn(0x7fb3ac0d4680 msgr2=0x7fb3ac06eee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:46:51.570 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:51.568+0000 7fb3b24a2640 1 -- 172.21.15.150:0/2875943734 shutdown_connections 2024-09-17T05:46:51.570 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:51.568+0000 7fb3b24a2640 1 -- 172.21.15.150:0/2875943734 wait complete. 2024-09-17T05:46:51.588 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T05:46:51.702 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:51.701+0000 7f43877c3640 1 -- 172.21.15.150:0/3393190831 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f43800b6bd0 msgr2=0x7f438006d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:46:51.702 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:51.701+0000 7f43877c3640 1 --2- 172.21.15.150:0/3393190831 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f43800b6bd0 0x7f438006d1a0 secure :-1 s=READY pgs=787 cs=0 l=1 rev1=1 crypto rx=0x7f4370009830 tx=0x7f437002a510 comp rx=0 tx=0).stop 2024-09-17T05:46:51.702 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:51.701+0000 7f43877c3640 1 -- 172.21.15.150:0/3393190831 shutdown_connections 2024-09-17T05:46:51.702 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:51.701+0000 7f43877c3640 1 --2- 172.21.15.150:0/3393190831 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f43800b6bd0 0x7f438006d1a0 unknown :-1 s=CLOSED pgs=787 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:51.703 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:51.701+0000 7f43877c3640 1 --2- 172.21.15.150:0/3393190831 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f43800c4a00 0x7f43800b09f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:51.703 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:51.701+0000 7f43877c3640 1 -- 172.21.15.150:0/3393190831 >> 172.21.15.150:0/3393190831 conn(0x7f43800b2e80 msgr2=0x7f43800b3290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:46:51.703 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:51.701+0000 7f43877c3640 1 -- 172.21.15.150:0/3393190831 shutdown_connections 2024-09-17T05:46:51.703 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:51.701+0000 7f43877c3640 1 -- 172.21.15.150:0/3393190831 wait complete. 2024-09-17T05:46:51.703 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:51.703+0000 7f43877c3640 1 Processor -- start 2024-09-17T05:46:51.704 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:51.703+0000 7f43877c3640 1 -- start start 2024-09-17T05:46:51.706 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:51.704+0000 7f43877c3640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f438006d6e0 0x7f43801507e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:46:51.706 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:51.704+0000 7f43877c3640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f43800b6bd0 0x7f43800c90f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:46:51.707 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:51.704+0000 7f43877c3640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f43800c4a00 0x7f43800c9630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:46:51.707 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:51.704+0000 7f43877c3640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f438006dd00 con 0x7f438006d6e0 2024-09-17T05:46:51.707 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:51.704+0000 7f43877c3640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f4380161060 con 0x7f43800b6bd0 2024-09-17T05:46:51.707 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:51.704+0000 7f43877c3640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f438015c6e0 con 0x7f43800c4a00 2024-09-17T05:46:51.707 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:51.704+0000 7f438555f640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f438006d6e0 0x7f43801507e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:46:51.707 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:51.705+0000 7f438555f640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f438006d6e0 0x7f43801507e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:59678/0 (socket says 172.21.15.150:59678) 2024-09-17T05:46:51.707 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:51.705+0000 7f438555f640 1 -- 172.21.15.150:0/2323888625 learned_addr learned my addr 172.21.15.150:0/2323888625 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:46:51.707 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:51.705+0000 7f4385d60640 1 --2- 172.21.15.150:0/2323888625 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f43800c4a00 0x7f43800c9630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:46:51.707 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:51.705+0000 7f4384d5e640 1 --2- 172.21.15.150:0/2323888625 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f43800b6bd0 0x7f43800c90f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:46:51.707 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:51.705+0000 7f438555f640 1 -- 172.21.15.150:0/2323888625 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f43800c4a00 msgr2=0x7f43800c9630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:46:51.707 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:51.705+0000 7f438555f640 1 --2- 172.21.15.150:0/2323888625 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f43800c4a00 0x7f43800c9630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:51.707 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:51.705+0000 7f438555f640 1 -- 172.21.15.150:0/2323888625 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f43800b6bd0 msgr2=0x7f43800c90f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:46:51.707 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:51.705+0000 7f438555f640 1 --2- 172.21.15.150:0/2323888625 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f43800b6bd0 0x7f43800c90f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:51.708 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:51.705+0000 7f438555f640 1 -- 172.21.15.150:0/2323888625 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f43800cb0e0 con 0x7f438006d6e0 2024-09-17T05:46:51.708 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:51.705+0000 7f4384d5e640 1 --2- 172.21.15.150:0/2323888625 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f43800b6bd0 0x7f43800c90f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:46:51.708 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:51.705+0000 7f438555f640 1 --2- 172.21.15.150:0/2323888625 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f438006d6e0 0x7f43801507e0 secure :-1 s=READY pgs=788 cs=0 l=1 rev1=1 crypto rx=0x7f437c00c970 tx=0x7f437c00ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:46:51.708 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:51.705+0000 7f4375ffb640 1 -- 172.21.15.150:0/2323888625 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f437c007bb0 con 0x7f438006d6e0 2024-09-17T05:46:51.708 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:51.705+0000 7f4375ffb640 1 -- 172.21.15.150:0/2323888625 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f437c007e40 con 0x7f438006d6e0 2024-09-17T05:46:51.708 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:51.705+0000 7f43877c3640 1 -- 172.21.15.150:0/2323888625 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f43800c8610 con 0x7f438006d6e0 2024-09-17T05:46:51.708 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:51.705+0000 7f4375ffb640 1 -- 172.21.15.150:0/2323888625 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f437c00f690 con 0x7f438006d6e0 2024-09-17T05:46:51.708 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:51.705+0000 7f43877c3640 1 -- 172.21.15.150:0/2323888625 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f43800c8bd0 con 0x7f438006d6e0 2024-09-17T05:46:51.709 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:51.706+0000 7f43877c3640 1 -- 172.21.15.150:0/2323888625 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f438015cc70 con 0x7f438006d6e0 2024-09-17T05:46:51.709 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:51.707+0000 7f4375ffb640 1 -- 172.21.15.150:0/2323888625 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 19) ==== 102563+0+0 (secure 0 0 0) 0x7f437c00f830 con 0x7f438006d6e0 2024-09-17T05:46:51.709 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:51.708+0000 7f4375ffb640 1 --2- 172.21.15.150:0/2323888625 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f43640797f0 0x7f436407bd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:46:51.709 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:51.708+0000 7f4375ffb640 1 -- 172.21.15.150:0/2323888625 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(71..71 src has 1..71) ==== 5765+0+0 (secure 0 0 0) 0x7f437c099fa0 con 0x7f438006d6e0 2024-09-17T05:46:51.709 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:51.708+0000 7f4384d5e640 1 --2- 172.21.15.150:0/2323888625 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f43640797f0 0x7f436407bd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:46:51.709 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:51.709+0000 7f4384d5e640 1 --2- 172.21.15.150:0/2323888625 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f43640797f0 0x7f436407bd00 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f4370034000 tx=0x7f4370004730 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:46:51.713 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:51.712+0000 7f4375ffb640 1 -- 172.21.15.150:0/2323888625 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f437c014030 con 0x7f438006d6e0 2024-09-17T05:46:51.892 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:51.892+0000 7f43877c3640 1 -- 172.21.15.150:0/2323888625 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f43800cd190 con 0x7f438006d6e0 2024-09-17T05:46:51.893 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:51.893+0000 7f4375ffb640 1 -- 172.21.15.150:0/2323888625 <== mon.0 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v71) ==== 74+0+16864 (secure 0 0 0) 0x7f437c063e10 con 0x7f438006d6e0 2024-09-17T05:46:51.893 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-09-17T05:46:51.894 INFO:teuthology.orchestra.run.smithi150.stdout:{"epoch":71,"fsid":"9f2e05e9-d629-47b3-b26b-1360655b7d20","created":"2024-09-17T05:41:32.502979+0000","modified":"2024-09-17T05:46:50.910883+0000","last_up_change":"2024-09-17T05:41:46.150225+0000","last_in_change":"2024-09-17T05:41:36.120274+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T05:41:46.860779+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_metadata","create_time":"2024-09-17T05:46:48.549801+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"71","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs_data","create_time":"2024-09-17T05:46:49.868230+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"71","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"4f31c018-c8a4-4d6d-b0c2-a597c47aae4a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6800","nonce":479374392},{"type":"v1","addr":"172.21.15.150:6801","nonce":479374392}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6802","nonce":479374392},{"type":"v1","addr":"172.21.15.150:6803","nonce":479374392}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6806","nonce":479374392},{"type":"v1","addr":"172.21.15.150:6807","nonce":479374392}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6804","nonce":479374392},{"type":"v1","addr":"172.21.15.150:6805","nonce":479374392}]},"public_addr":"172.21.15.150:6801/479374392","cluster_addr":"172.21.15.150:6803/479374392","heartbeat_back_addr":"172.21.15.150:6807/479374392","heartbeat_front_addr":"172.21.15.150:6805/479374392","state":["exists","up"]},{"osd":1,"uuid":"6ff4a573-500b-4e04-9de3-39265ead78b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6824","nonce":913899800},{"type":"v1","addr":"172.21.15.150:6825","nonce":913899800}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6826","nonce":913899800},{"type":"v1","addr":"172.21.15.150:6827","nonce":913899800}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6830","nonce":913899800},{"type":"v1","addr":"172.21.15.150:6831","nonce":913899800}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6828","nonce":913899800},{"type":"v1","addr":"172.21.15.150:6829","nonce":913899800}]},"public_addr":"172.21.15.150:6825/913899800","cluster_addr":"172.21.15.150:6827/913899800","heartbeat_back_addr":"172.21.15.150:6831/913899800","heartbeat_front_addr":"172.21.15.150:6829/913899800","state":["exists","up"]},{"osd":2,"uuid":"bffea6f9-2465-4182-b205-00436c41ac1c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6816","nonce":363718461},{"type":"v1","addr":"172.21.15.150:6817","nonce":363718461}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6818","nonce":363718461},{"type":"v1","addr":"172.21.15.150:6819","nonce":363718461}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6822","nonce":363718461},{"type":"v1","addr":"172.21.15.150:6823","nonce":363718461}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6820","nonce":363718461},{"type":"v1","addr":"172.21.15.150:6821","nonce":363718461}]},"public_addr":"172.21.15.150:6817/363718461","cluster_addr":"172.21.15.150:6819/363718461","heartbeat_back_addr":"172.21.15.150:6823/363718461","heartbeat_front_addr":"172.21.15.150:6821/363718461","state":["exists","up"]},{"osd":3,"uuid":"cda70430-d1e1-427e-b04e-56db4031d078","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6808","nonce":3550994626},{"type":"v1","addr":"172.21.15.150:6809","nonce":3550994626}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6810","nonce":3550994626},{"type":"v1","addr":"172.21.15.150:6811","nonce":3550994626}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6814","nonce":3550994626},{"type":"v1","addr":"172.21.15.150:6815","nonce":3550994626}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6812","nonce":3550994626},{"type":"v1","addr":"172.21.15.150:6813","nonce":3550994626}]},"public_addr":"172.21.15.150:6809/3550994626","cluster_addr":"172.21.15.150:6811/3550994626","heartbeat_back_addr":"172.21.15.150:6815/3550994626","heartbeat_front_addr":"172.21.15.150:6813/3550994626","state":["exists","up"]},{"osd":4,"uuid":"3a0277fb-5e1e-4f68-bb2d-9a8a0152f64a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6810","nonce":2718261497},{"type":"v1","addr":"172.21.15.176:6811","nonce":2718261497}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6812","nonce":2718261497},{"type":"v1","addr":"172.21.15.176:6813","nonce":2718261497}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6816","nonce":2718261497},{"type":"v1","addr":"172.21.15.176:6817","nonce":2718261497}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6814","nonce":2718261497},{"type":"v1","addr":"172.21.15.176:6815","nonce":2718261497}]},"public_addr":"172.21.15.176:6811/2718261497","cluster_addr":"172.21.15.176:6813/2718261497","heartbeat_back_addr":"172.21.15.176:6817/2718261497","heartbeat_front_addr":"172.21.15.176:6815/2718261497","state":["exists","up"]},{"osd":5,"uuid":"33aebee6-0315-40b7-a11c-6702f0be494d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6818","nonce":2049295774},{"type":"v1","addr":"172.21.15.176:6819","nonce":2049295774}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6820","nonce":2049295774},{"type":"v1","addr":"172.21.15.176:6821","nonce":2049295774}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6824","nonce":2049295774},{"type":"v1","addr":"172.21.15.176:6825","nonce":2049295774}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6822","nonce":2049295774},{"type":"v1","addr":"172.21.15.176:6823","nonce":2049295774}]},"public_addr":"172.21.15.176:6819/2049295774","cluster_addr":"172.21.15.176:6821/2049295774","heartbeat_back_addr":"172.21.15.176:6825/2049295774","heartbeat_front_addr":"172.21.15.176:6823/2049295774","state":["exists","up"]},{"osd":6,"uuid":"4d24f360-6751-4263-841b-d77793d33540","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6826","nonce":2164458476},{"type":"v1","addr":"172.21.15.176:6827","nonce":2164458476}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6828","nonce":2164458476},{"type":"v1","addr":"172.21.15.176:6829","nonce":2164458476}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6832","nonce":2164458476},{"type":"v1","addr":"172.21.15.176:6833","nonce":2164458476}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6830","nonce":2164458476},{"type":"v1","addr":"172.21.15.176:6831","nonce":2164458476}]},"public_addr":"172.21.15.176:6827/2164458476","cluster_addr":"172.21.15.176:6829/2164458476","heartbeat_back_addr":"172.21.15.176:6833/2164458476","heartbeat_front_addr":"172.21.15.176:6831/2164458476","state":["exists","up"]},{"osd":7,"uuid":"c8594fda-c74a-4ba9-8277-caf101d58ca1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6802","nonce":3239587708},{"type":"v1","addr":"172.21.15.176:6803","nonce":3239587708}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6804","nonce":3239587708},{"type":"v1","addr":"172.21.15.176:6805","nonce":3239587708}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6808","nonce":3239587708},{"type":"v1","addr":"172.21.15.176:6809","nonce":3239587708}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6806","nonce":3239587708},{"type":"v1","addr":"172.21.15.176:6807","nonce":3239587708}]},"public_addr":"172.21.15.176:6803/3239587708","cluster_addr":"172.21.15.176:6805/3239587708","heartbeat_back_addr":"172.21.15.176:6809/3239587708","heartbeat_front_addr":"172.21.15.176:6807/3239587708","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:41:41.905151+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:41:42.705679+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:41:42.459673+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:41:42.440819+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:41:42.668428+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:41:42.694972+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:41:43.078535+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:41:42.363539+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":7,"snaps":[{"begin":2,"length":2}]},{"pool":9,"snaps":[{"begin":2,"length":2}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T05:46:51.896 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:51.895+0000 7f43877c3640 1 -- 172.21.15.150:0/2323888625 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f43640797f0 msgr2=0x7f436407bd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:46:51.896 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:51.895+0000 7f43877c3640 1 --2- 172.21.15.150:0/2323888625 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f43640797f0 0x7f436407bd00 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f4370034000 tx=0x7f4370004730 comp rx=0 tx=0).stop 2024-09-17T05:46:51.896 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:51.895+0000 7f43877c3640 1 -- 172.21.15.150:0/2323888625 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f438006d6e0 msgr2=0x7f43801507e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:46:51.896 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:51.895+0000 7f43877c3640 1 --2- 172.21.15.150:0/2323888625 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f438006d6e0 0x7f43801507e0 secure :-1 s=READY pgs=788 cs=0 l=1 rev1=1 crypto rx=0x7f437c00c970 tx=0x7f437c00ce30 comp rx=0 tx=0).stop 2024-09-17T05:46:51.896 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:51.895+0000 7f43877c3640 1 -- 172.21.15.150:0/2323888625 shutdown_connections 2024-09-17T05:46:51.896 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:51.895+0000 7f43877c3640 1 --2- 172.21.15.150:0/2323888625 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f43800b6bd0 0x7f43800c90f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:51.896 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:51.895+0000 7f43877c3640 1 --2- 172.21.15.150:0/2323888625 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f43640797f0 0x7f436407bd00 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:51.896 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:51.895+0000 7f43877c3640 1 --2- 172.21.15.150:0/2323888625 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f43800c4a00 0x7f43800c9630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:51.897 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:51.895+0000 7f43877c3640 1 --2- 172.21.15.150:0/2323888625 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f438006d6e0 0x7f43801507e0 unknown :-1 s=CLOSED pgs=788 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:51.897 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:51.895+0000 7f43877c3640 1 -- 172.21.15.150:0/2323888625 >> 172.21.15.150:0/2323888625 conn(0x7f43800b2e80 msgr2=0x7f43800ce0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:46:51.897 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:51.895+0000 7f43877c3640 1 -- 172.21.15.150:0/2323888625 shutdown_connections 2024-09-17T05:46:51.897 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:51.895+0000 7f43877c3640 1 -- 172.21.15.150:0/2323888625 wait complete. 2024-09-17T05:46:51.908 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T05:46:52.020 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:52.019+0000 7feebccec640 1 -- 172.21.15.150:0/426376085 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7feeb8071f70 msgr2=0x7feeb8075d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:46:52.021 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:52.019+0000 7feebccec640 1 --2- 172.21.15.150:0/426376085 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7feeb8071f70 0x7feeb8075d20 secure :-1 s=READY pgs=789 cs=0 l=1 rev1=1 crypto rx=0x7feeb8156240 tx=0x7feea802a560 comp rx=0 tx=0).stop 2024-09-17T05:46:52.021 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:52.019+0000 7feebccec640 1 -- 172.21.15.150:0/426376085 shutdown_connections 2024-09-17T05:46:52.021 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:52.019+0000 7feebccec640 1 --2- 172.21.15.150:0/426376085 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7feeb80b54e0 0x7feeb8151da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:52.021 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:52.019+0000 7feebccec640 1 --2- 172.21.15.150:0/426376085 >> v2:172.21.15.176:3300/0 conn(0x7feeb815c6d0 0x7feeb80b4fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:52.021 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:52.019+0000 7feebccec640 1 --2- 172.21.15.150:0/426376085 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7feeb8071f70 0x7feeb8075d20 unknown :-1 s=CLOSED pgs=789 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:52.021 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:52.020+0000 7feebccec640 1 -- 172.21.15.150:0/426376085 >> 172.21.15.150:0/426376085 conn(0x7feeb80d0b50 msgr2=0x7feeb80d0f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:46:52.021 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:52.020+0000 7feebccec640 1 -- 172.21.15.150:0/426376085 shutdown_connections 2024-09-17T05:46:52.021 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:52.020+0000 7feebccec640 1 -- 172.21.15.150:0/426376085 wait complete. 2024-09-17T05:46:52.022 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:52.021+0000 7feebccec640 1 Processor -- start 2024-09-17T05:46:52.022 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:52.022+0000 7feebccec640 1 -- start start 2024-09-17T05:46:52.025 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:52.023+0000 7feebccec640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7feeb8071f70 0x7feeb81f2d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:46:52.025 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:52.023+0000 7feebccec640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7feeb80b54e0 0x7feeb81e5a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:46:52.025 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:52.023+0000 7feebccec640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7feeb815c6d0 0x7feeb81f3430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:46:52.025 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:52.023+0000 7feebccec640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7feeb8152460 con 0x7feeb8071f70 2024-09-17T05:46:52.025 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:52.023+0000 7feebccec640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7feeb81522e0 con 0x7feeb815c6d0 2024-09-17T05:46:52.026 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:52.023+0000 7feebccec640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7feeb81525e0 con 0x7feeb80b54e0 2024-09-17T05:46:52.026 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:52.023+0000 7feeb659c640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7feeb8071f70 0x7feeb81f2d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:46:52.026 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:52.023+0000 7feeb659c640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7feeb8071f70 0x7feeb81f2d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:59694/0 (socket says 172.21.15.150:59694) 2024-09-17T05:46:52.026 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:52.023+0000 7feeb659c640 1 -- 172.21.15.150:0/702391560 learned_addr learned my addr 172.21.15.150:0/702391560 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:46:52.026 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:52.023+0000 7feeb6d9d640 1 --2- 172.21.15.150:0/702391560 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7feeb815c6d0 0x7feeb81f3430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:46:52.026 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:52.023+0000 7feeaffff640 1 --2- 172.21.15.150:0/702391560 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7feeb80b54e0 0x7feeb81e5a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:46:52.026 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:52.023+0000 7feeb659c640 1 -- 172.21.15.150:0/702391560 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7feeb80b54e0 msgr2=0x7feeb81e5a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:46:52.026 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:52.023+0000 7feeb659c640 1 --2- 172.21.15.150:0/702391560 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7feeb80b54e0 0x7feeb81e5a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:52.026 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:52.023+0000 7feeb659c640 1 -- 172.21.15.150:0/702391560 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7feeb815c6d0 msgr2=0x7feeb81f3430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:46:52.026 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:52.023+0000 7feeb659c640 1 --2- 172.21.15.150:0/702391560 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7feeb815c6d0 0x7feeb81f3430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:52.026 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:52.023+0000 7feeb659c640 1 -- 172.21.15.150:0/702391560 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feeb80c6240 con 0x7feeb8071f70 2024-09-17T05:46:52.026 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:52.024+0000 7feeb659c640 1 --2- 172.21.15.150:0/702391560 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7feeb8071f70 0x7feeb81f2d80 secure :-1 s=READY pgs=790 cs=0 l=1 rev1=1 crypto rx=0x7feea8034040 tx=0x7feea80038a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:46:52.026 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:52.024+0000 7feeaeffd640 1 -- 172.21.15.150:0/702391560 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feea803e030 con 0x7feeb8071f70 2024-09-17T05:46:52.027 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:52.024+0000 7feeaeffd640 1 -- 172.21.15.150:0/702391560 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7feea8003ca0 con 0x7feeb8071f70 2024-09-17T05:46:52.027 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:52.024+0000 7feebccec640 1 -- 172.21.15.150:0/702391560 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feeb80c6520 con 0x7feeb8071f70 2024-09-17T05:46:52.027 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:52.024+0000 7feeaeffd640 1 -- 172.21.15.150:0/702391560 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feea8035040 con 0x7feeb8071f70 2024-09-17T05:46:52.027 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:52.024+0000 7feebccec640 1 -- 172.21.15.150:0/702391560 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feeb81e5540 con 0x7feeb8071f70 2024-09-17T05:46:52.027 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:52.025+0000 7feebccec640 1 -- 172.21.15.150:0/702391560 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7feeb8151da0 con 0x7feeb8071f70 2024-09-17T05:46:52.028 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:52.026+0000 7feeaeffd640 1 -- 172.21.15.150:0/702391560 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 19) ==== 102563+0+0 (secure 0 0 0) 0x7feea8041030 con 0x7feeb8071f70 2024-09-17T05:46:52.028 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:52.026+0000 7feeaeffd640 1 --2- 172.21.15.150:0/702391560 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fee980797f0 0x7fee9807bd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:46:52.028 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:52.026+0000 7feeaeffd640 1 -- 172.21.15.150:0/702391560 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(71..71 src has 1..71) ==== 5765+0+0 (secure 0 0 0) 0x7feea80ba070 con 0x7feeb8071f70 2024-09-17T05:46:52.028 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:52.027+0000 7feeaffff640 1 --2- 172.21.15.150:0/702391560 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fee980797f0 0x7fee9807bd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:46:52.028 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:52.027+0000 7feeaffff640 1 --2- 172.21.15.150:0/702391560 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fee980797f0 0x7fee9807bd00 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7feeb815b4b0 tx=0x7feea0005f90 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:46:52.031 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:52.031+0000 7feeaeffd640 1 -- 172.21.15.150:0/702391560 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7feea8083910 con 0x7feeb8071f70 2024-09-17T05:46:52.207 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:52.206+0000 7feebccec640 1 -- 172.21.15.150:0/702391560 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7feeb80c66f0 con 0x7feeb8071f70 2024-09-17T05:46:52.208 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:52.207+0000 7feeaeffd640 1 -- 172.21.15.150:0/702391560 <== mon.0 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v71) ==== 74+0+16864 (secure 0 0 0) 0x7feea8088340 con 0x7feeb8071f70 2024-09-17T05:46:52.208 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-09-17T05:46:52.208 INFO:teuthology.orchestra.run.smithi150.stdout:{"epoch":71,"fsid":"9f2e05e9-d629-47b3-b26b-1360655b7d20","created":"2024-09-17T05:41:32.502979+0000","modified":"2024-09-17T05:46:50.910883+0000","last_up_change":"2024-09-17T05:41:46.150225+0000","last_in_change":"2024-09-17T05:41:36.120274+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T05:41:46.860779+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_metadata","create_time":"2024-09-17T05:46:48.549801+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"71","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs_data","create_time":"2024-09-17T05:46:49.868230+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"71","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"4f31c018-c8a4-4d6d-b0c2-a597c47aae4a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6800","nonce":479374392},{"type":"v1","addr":"172.21.15.150:6801","nonce":479374392}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6802","nonce":479374392},{"type":"v1","addr":"172.21.15.150:6803","nonce":479374392}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6806","nonce":479374392},{"type":"v1","addr":"172.21.15.150:6807","nonce":479374392}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6804","nonce":479374392},{"type":"v1","addr":"172.21.15.150:6805","nonce":479374392}]},"public_addr":"172.21.15.150:6801/479374392","cluster_addr":"172.21.15.150:6803/479374392","heartbeat_back_addr":"172.21.15.150:6807/479374392","heartbeat_front_addr":"172.21.15.150:6805/479374392","state":["exists","up"]},{"osd":1,"uuid":"6ff4a573-500b-4e04-9de3-39265ead78b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6824","nonce":913899800},{"type":"v1","addr":"172.21.15.150:6825","nonce":913899800}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6826","nonce":913899800},{"type":"v1","addr":"172.21.15.150:6827","nonce":913899800}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6830","nonce":913899800},{"type":"v1","addr":"172.21.15.150:6831","nonce":913899800}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6828","nonce":913899800},{"type":"v1","addr":"172.21.15.150:6829","nonce":913899800}]},"public_addr":"172.21.15.150:6825/913899800","cluster_addr":"172.21.15.150:6827/913899800","heartbeat_back_addr":"172.21.15.150:6831/913899800","heartbeat_front_addr":"172.21.15.150:6829/913899800","state":["exists","up"]},{"osd":2,"uuid":"bffea6f9-2465-4182-b205-00436c41ac1c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6816","nonce":363718461},{"type":"v1","addr":"172.21.15.150:6817","nonce":363718461}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6818","nonce":363718461},{"type":"v1","addr":"172.21.15.150:6819","nonce":363718461}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6822","nonce":363718461},{"type":"v1","addr":"172.21.15.150:6823","nonce":363718461}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6820","nonce":363718461},{"type":"v1","addr":"172.21.15.150:6821","nonce":363718461}]},"public_addr":"172.21.15.150:6817/363718461","cluster_addr":"172.21.15.150:6819/363718461","heartbeat_back_addr":"172.21.15.150:6823/363718461","heartbeat_front_addr":"172.21.15.150:6821/363718461","state":["exists","up"]},{"osd":3,"uuid":"cda70430-d1e1-427e-b04e-56db4031d078","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6808","nonce":3550994626},{"type":"v1","addr":"172.21.15.150:6809","nonce":3550994626}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6810","nonce":3550994626},{"type":"v1","addr":"172.21.15.150:6811","nonce":3550994626}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6814","nonce":3550994626},{"type":"v1","addr":"172.21.15.150:6815","nonce":3550994626}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6812","nonce":3550994626},{"type":"v1","addr":"172.21.15.150:6813","nonce":3550994626}]},"public_addr":"172.21.15.150:6809/3550994626","cluster_addr":"172.21.15.150:6811/3550994626","heartbeat_back_addr":"172.21.15.150:6815/3550994626","heartbeat_front_addr":"172.21.15.150:6813/3550994626","state":["exists","up"]},{"osd":4,"uuid":"3a0277fb-5e1e-4f68-bb2d-9a8a0152f64a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6810","nonce":2718261497},{"type":"v1","addr":"172.21.15.176:6811","nonce":2718261497}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6812","nonce":2718261497},{"type":"v1","addr":"172.21.15.176:6813","nonce":2718261497}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6816","nonce":2718261497},{"type":"v1","addr":"172.21.15.176:6817","nonce":2718261497}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6814","nonce":2718261497},{"type":"v1","addr":"172.21.15.176:6815","nonce":2718261497}]},"public_addr":"172.21.15.176:6811/2718261497","cluster_addr":"172.21.15.176:6813/2718261497","heartbeat_back_addr":"172.21.15.176:6817/2718261497","heartbeat_front_addr":"172.21.15.176:6815/2718261497","state":["exists","up"]},{"osd":5,"uuid":"33aebee6-0315-40b7-a11c-6702f0be494d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6818","nonce":2049295774},{"type":"v1","addr":"172.21.15.176:6819","nonce":2049295774}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6820","nonce":2049295774},{"type":"v1","addr":"172.21.15.176:6821","nonce":2049295774}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6824","nonce":2049295774},{"type":"v1","addr":"172.21.15.176:6825","nonce":2049295774}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6822","nonce":2049295774},{"type":"v1","addr":"172.21.15.176:6823","nonce":2049295774}]},"public_addr":"172.21.15.176:6819/2049295774","cluster_addr":"172.21.15.176:6821/2049295774","heartbeat_back_addr":"172.21.15.176:6825/2049295774","heartbeat_front_addr":"172.21.15.176:6823/2049295774","state":["exists","up"]},{"osd":6,"uuid":"4d24f360-6751-4263-841b-d77793d33540","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6826","nonce":2164458476},{"type":"v1","addr":"172.21.15.176:6827","nonce":2164458476}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6828","nonce":2164458476},{"type":"v1","addr":"172.21.15.176:6829","nonce":2164458476}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6832","nonce":2164458476},{"type":"v1","addr":"172.21.15.176:6833","nonce":2164458476}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6830","nonce":2164458476},{"type":"v1","addr":"172.21.15.176:6831","nonce":2164458476}]},"public_addr":"172.21.15.176:6827/2164458476","cluster_addr":"172.21.15.176:6829/2164458476","heartbeat_back_addr":"172.21.15.176:6833/2164458476","heartbeat_front_addr":"172.21.15.176:6831/2164458476","state":["exists","up"]},{"osd":7,"uuid":"c8594fda-c74a-4ba9-8277-caf101d58ca1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6802","nonce":3239587708},{"type":"v1","addr":"172.21.15.176:6803","nonce":3239587708}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6804","nonce":3239587708},{"type":"v1","addr":"172.21.15.176:6805","nonce":3239587708}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6808","nonce":3239587708},{"type":"v1","addr":"172.21.15.176:6809","nonce":3239587708}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6806","nonce":3239587708},{"type":"v1","addr":"172.21.15.176:6807","nonce":3239587708}]},"public_addr":"172.21.15.176:6803/3239587708","cluster_addr":"172.21.15.176:6805/3239587708","heartbeat_back_addr":"172.21.15.176:6809/3239587708","heartbeat_front_addr":"172.21.15.176:6807/3239587708","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:41:41.905151+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:41:42.705679+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:41:42.459673+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:41:42.440819+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:41:42.668428+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:41:42.694972+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:41:43.078535+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:41:42.363539+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":7,"snaps":[{"begin":2,"length":2}]},{"pool":9,"snaps":[{"begin":2,"length":2}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T05:46:52.211 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:52.210+0000 7feebccec640 1 -- 172.21.15.150:0/702391560 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fee980797f0 msgr2=0x7fee9807bd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:46:52.211 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:52.210+0000 7feebccec640 1 --2- 172.21.15.150:0/702391560 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fee980797f0 0x7fee9807bd00 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7feeb815b4b0 tx=0x7feea0005f90 comp rx=0 tx=0).stop 2024-09-17T05:46:52.211 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:52.210+0000 7feebccec640 1 -- 172.21.15.150:0/702391560 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7feeb8071f70 msgr2=0x7feeb81f2d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:46:52.211 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:52.210+0000 7feebccec640 1 --2- 172.21.15.150:0/702391560 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7feeb8071f70 0x7feeb81f2d80 secure :-1 s=READY pgs=790 cs=0 l=1 rev1=1 crypto rx=0x7feea8034040 tx=0x7feea80038a0 comp rx=0 tx=0).stop 2024-09-17T05:46:52.211 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:52.210+0000 7feebccec640 1 -- 172.21.15.150:0/702391560 shutdown_connections 2024-09-17T05:46:52.211 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:52.210+0000 7feebccec640 1 --2- 172.21.15.150:0/702391560 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7feeb815c6d0 0x7feeb81f3430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:52.211 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:52.210+0000 7feebccec640 1 --2- 172.21.15.150:0/702391560 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fee980797f0 0x7fee9807bd00 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:52.211 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:52.210+0000 7feebccec640 1 --2- 172.21.15.150:0/702391560 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7feeb80b54e0 0x7feeb81e5a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:52.211 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:52.210+0000 7feebccec640 1 --2- 172.21.15.150:0/702391560 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7feeb8071f70 0x7feeb81f2d80 unknown :-1 s=CLOSED pgs=790 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:52.211 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:52.210+0000 7feebccec640 1 -- 172.21.15.150:0/702391560 >> 172.21.15.150:0/702391560 conn(0x7feeb80d0b50 msgr2=0x7feeb80d0f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:46:52.211 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:52.210+0000 7feebccec640 1 -- 172.21.15.150:0/702391560 shutdown_connections 2024-09-17T05:46:52.212 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:52.210+0000 7feebccec640 1 -- 172.21.15.150:0/702391560 wait complete. 2024-09-17T05:46:52.223 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-09-17T05:46:52.340 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:52.339+0000 7ff90ac20640 1 -- 172.21.15.150:0/1542142158 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff8f4003a30 msgr2=0x7ff8f4003ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:46:52.340 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:52.339+0000 7ff90ac20640 1 --2- 172.21.15.150:0/1542142158 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff8f4003a30 0x7ff8f4003ea0 secure :-1 s=READY pgs=792 cs=0 l=1 rev1=1 crypto rx=0x7ff8f800c290 tx=0x7ff8f4005830 comp rx=0 tx=0).stop 2024-09-17T05:46:52.340 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:52.339+0000 7ff9091bd640 1 -- 172.21.15.150:0/1542142158 reap_dead start 2024-09-17T05:46:52.340 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:52.339+0000 7ff90ac20640 1 -- 172.21.15.150:0/1542142158 shutdown_connections 2024-09-17T05:46:52.340 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:52.339+0000 7ff90ac20640 1 -- 172.21.15.150:0/1542142158 >> 172.21.15.150:0/1542142158 conn(0x7ff90408bfe0 msgr2=0x7ff9040d46e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:46:52.340 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:52.339+0000 7ff90ac20640 1 -- 172.21.15.150:0/1542142158 shutdown_connections 2024-09-17T05:46:52.340 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:52.339+0000 7ff90ac20640 1 -- 172.21.15.150:0/1542142158 wait complete. 2024-09-17T05:46:52.341 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:52.341+0000 7ff90ac20640 1 Processor -- start 2024-09-17T05:46:52.341 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:52.341+0000 7ff90ac20640 1 -- start start 2024-09-17T05:46:52.344 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:52.342+0000 7ff90ac20640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff8f4003a30 0x7ff904154470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:46:52.344 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:52.342+0000 7ff90ac20640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff90415b540 0x7ff90415d6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:46:52.344 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:52.342+0000 7ff90ac20640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff90415b950 0x7ff90415dc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:46:52.344 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:52.342+0000 7ff90ac20640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7ff9040b69f0 con 0x7ff8f4003a30 2024-09-17T05:46:52.344 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:52.342+0000 7ff90ac20640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7ff9040b6870 con 0x7ff90415b950 2024-09-17T05:46:52.345 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:52.342+0000 7ff90ac20640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7ff9040d0020 con 0x7ff90415b540 2024-09-17T05:46:52.345 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:52.342+0000 7ff9089bc640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff8f4003a30 0x7ff904154470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:46:52.345 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:52.342+0000 7ff9089bc640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff8f4003a30 0x7ff904154470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:59706/0 (socket says 172.21.15.150:59706) 2024-09-17T05:46:52.345 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:52.342+0000 7ff9089bc640 1 -- 172.21.15.150:0/3189293073 learned_addr learned my addr 172.21.15.150:0/3189293073 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:46:52.345 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:52.342+0000 7ff903fff640 1 --2- 172.21.15.150:0/3189293073 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff90415b540 0x7ff90415d6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:46:52.345 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:52.342+0000 7ff9091bd640 1 --2- 172.21.15.150:0/3189293073 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff90415b950 0x7ff90415dc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:46:52.345 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:52.343+0000 7ff9089bc640 1 -- 172.21.15.150:0/3189293073 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff90415b540 msgr2=0x7ff90415d6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:46:52.345 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:52.343+0000 7ff9089bc640 1 --2- 172.21.15.150:0/3189293073 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff90415b540 0x7ff90415d6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:52.345 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:52.343+0000 7ff9089bc640 1 -- 172.21.15.150:0/3189293073 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff90415b950 msgr2=0x7ff90415dc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:46:52.345 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:52.343+0000 7ff9089bc640 1 --2- 172.21.15.150:0/3189293073 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff90415b950 0x7ff90415dc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:52.345 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:52.343+0000 7ff9089bc640 1 -- 172.21.15.150:0/3189293073 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff9040cd590 con 0x7ff8f4003a30 2024-09-17T05:46:52.345 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:52.343+0000 7ff903fff640 1 --2- 172.21.15.150:0/3189293073 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff90415b540 0x7ff90415d6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:46:52.345 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:52.343+0000 7ff9089bc640 1 --2- 172.21.15.150:0/3189293073 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff8f4003a30 0x7ff904154470 secure :-1 s=READY pgs=793 cs=0 l=1 rev1=1 crypto rx=0x7ff8f8030040 tx=0x7ff8f8006360 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:46:52.346 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:52.343+0000 7ff9017fa640 1 -- 172.21.15.150:0/3189293073 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8f8031050 con 0x7ff8f4003a30 2024-09-17T05:46:52.346 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:52.343+0000 7ff9017fa640 1 -- 172.21.15.150:0/3189293073 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff8f8003af0 con 0x7ff8f4003a30 2024-09-17T05:46:52.346 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:52.343+0000 7ff90ac20640 1 -- 172.21.15.150:0/3189293073 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff9040c8f10 con 0x7ff8f4003a30 2024-09-17T05:46:52.346 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:52.343+0000 7ff9017fa640 1 -- 172.21.15.150:0/3189293073 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8f8006550 con 0x7ff8f4003a30 2024-09-17T05:46:52.346 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:52.343+0000 7ff90ac20640 1 -- 172.21.15.150:0/3189293073 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff9040c8430 con 0x7ff8f4003a30 2024-09-17T05:46:52.347 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:52.344+0000 7ff90ac20640 1 -- 172.21.15.150:0/3189293073 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff9040d4f30 con 0x7ff8f4003a30 2024-09-17T05:46:52.347 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:52.345+0000 7ff9017fa640 1 -- 172.21.15.150:0/3189293073 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 19) ==== 102563+0+0 (secure 0 0 0) 0x7ff8f8041440 con 0x7ff8f4003a30 2024-09-17T05:46:52.347 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:52.345+0000 7ff9017fa640 1 --2- 172.21.15.150:0/3189293073 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7ff8e8079820 0x7ff8e807bd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:46:52.347 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:52.346+0000 7ff9017fa640 1 -- 172.21.15.150:0/3189293073 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(71..71 src has 1..71) ==== 5765+0+0 (secure 0 0 0) 0x7ff8f80b9de0 con 0x7ff8f4003a30 2024-09-17T05:46:52.347 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:52.346+0000 7ff903fff640 1 --2- 172.21.15.150:0/3189293073 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7ff8e8079820 0x7ff8e807bd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:46:52.347 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:52.346+0000 7ff903fff640 1 --2- 172.21.15.150:0/3189293073 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7ff8e8079820 0x7ff8e807bd30 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7ff9040c9a90 tx=0x7ff8f0005f90 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:46:52.350 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:52.350+0000 7ff9017fa640 1 -- 172.21.15.150:0/3189293073 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7ff8f8046060 con 0x7ff8f4003a30 2024-09-17T05:46:52.565 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:52.564+0000 7ff90ac20640 1 -- 172.21.15.150:0/3189293073 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7ff9040b80b0 con 0x7ff8f4003a30 2024-09-17T05:46:53.533 INFO:tasks.ceph.mds.a.smithi150.stderr:2024-09-17T05:46:53.532+0000 7f1765cab640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-17T05:46:53.570 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:53.569+0000 7ff9017fa640 1 -- 172.21.15.150:0/3189293073 <== mon.0 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v41) ==== 118+0+0 (secure 0 0 0) 0x7ff8f8083d60 con 0x7ff8f4003a30 2024-09-17T05:46:53.573 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:53.572+0000 7ff90ac20640 1 -- 172.21.15.150:0/3189293073 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7ff8e8079820 msgr2=0x7ff8e807bd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:46:53.573 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:53.572+0000 7ff90ac20640 1 --2- 172.21.15.150:0/3189293073 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7ff8e8079820 0x7ff8e807bd30 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7ff9040c9a90 tx=0x7ff8f0005f90 comp rx=0 tx=0).stop 2024-09-17T05:46:53.573 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:53.572+0000 7ff90ac20640 1 -- 172.21.15.150:0/3189293073 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff8f4003a30 msgr2=0x7ff904154470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:46:53.573 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:53.572+0000 7ff90ac20640 1 --2- 172.21.15.150:0/3189293073 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff8f4003a30 0x7ff904154470 secure :-1 s=READY pgs=793 cs=0 l=1 rev1=1 crypto rx=0x7ff8f8030040 tx=0x7ff8f8006360 comp rx=0 tx=0).stop 2024-09-17T05:46:53.573 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:53.572+0000 7ff90ac20640 1 -- 172.21.15.150:0/3189293073 shutdown_connections 2024-09-17T05:46:53.573 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:53.572+0000 7ff90ac20640 1 --2- 172.21.15.150:0/3189293073 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff90415b950 0x7ff90415dc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:53.574 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:53.572+0000 7ff90ac20640 1 --2- 172.21.15.150:0/3189293073 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7ff8e8079820 0x7ff8e807bd30 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:53.574 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:53.572+0000 7ff90ac20640 1 --2- 172.21.15.150:0/3189293073 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff90415b540 0x7ff90415d6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:53.574 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:53.572+0000 7ff90ac20640 1 --2- 172.21.15.150:0/3189293073 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff8f4003a30 0x7ff904154470 unknown :-1 s=CLOSED pgs=793 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:53.574 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:53.572+0000 7ff90ac20640 1 -- 172.21.15.150:0/3189293073 >> 172.21.15.150:0/3189293073 conn(0x7ff90408bfe0 msgr2=0x7ff90406f810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:46:53.574 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:53.572+0000 7ff90ac20640 1 -- 172.21.15.150:0/3189293073 shutdown_connections 2024-09-17T05:46:53.574 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:53.572+0000 7ff90ac20640 1 -- 172.21.15.150:0/3189293073 wait complete. 2024-09-17T05:46:53.586 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-09-17T05:46:53.586 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-09-17T05:46:53.705 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:53.704+0000 7f41835a8640 1 -- 172.21.15.150:0/901301412 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f417c0b4150 msgr2=0x7f417c0b4560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:46:53.705 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:53.704+0000 7f41835a8640 1 --2- 172.21.15.150:0/901301412 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f417c0b4150 0x7f417c0b4560 secure :-1 s=READY pgs=795 cs=0 l=1 rev1=1 crypto rx=0x7f4174005fd0 tx=0x7f417402a8b0 comp rx=0 tx=0).stop 2024-09-17T05:46:53.705 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:53.704+0000 7f41835a8640 1 -- 172.21.15.150:0/901301412 shutdown_connections 2024-09-17T05:46:53.705 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:53.704+0000 7f41835a8640 1 --2- 172.21.15.150:0/901301412 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f417c0cf550 0x7f417c15f940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:53.706 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:53.704+0000 7f41835a8640 1 --2- 172.21.15.150:0/901301412 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f417c0b4150 0x7f417c0b4560 unknown :-1 s=CLOSED pgs=795 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:53.706 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:53.704+0000 7f41835a8640 1 -- 172.21.15.150:0/901301412 >> 172.21.15.150:0/901301412 conn(0x7f417c0b2400 msgr2=0x7f417c0b2810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:46:53.706 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:53.704+0000 7f41835a8640 1 -- 172.21.15.150:0/901301412 shutdown_connections 2024-09-17T05:46:53.706 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:53.704+0000 7f41835a8640 1 -- 172.21.15.150:0/901301412 wait complete. 2024-09-17T05:46:53.706 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:53.706+0000 7f41835a8640 1 Processor -- start 2024-09-17T05:46:53.706 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:53.706+0000 7f41835a8640 1 -- start start 2024-09-17T05:46:53.709 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:53.707+0000 7f41835a8640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f417c0b4150 0x7f417c14ca90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:46:53.709 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:53.707+0000 7f41835a8640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f417c0cf550 0x7f417c14fb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:46:53.709 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:53.707+0000 7f41835a8640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f417c15b740 0x7f417c1f30b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:46:53.709 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:53.707+0000 7f41835a8640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f417c0b4c20 con 0x7f417c0cf550 2024-09-17T05:46:53.709 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:53.707+0000 7f41835a8640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f417c0b4aa0 con 0x7f417c0b4150 2024-09-17T05:46:53.709 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:53.707+0000 7f41835a8640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f417c0b4da0 con 0x7f417c15b740 2024-09-17T05:46:53.709 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:53.707+0000 7f4180b43640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f417c0cf550 0x7f417c14fb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:46:53.709 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:53.707+0000 7f4180b43640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f417c0cf550 0x7f417c14fb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:59718/0 (socket says 172.21.15.150:59718) 2024-09-17T05:46:53.710 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:53.707+0000 7f4180b43640 1 -- 172.21.15.150:0/763256040 learned_addr learned my addr 172.21.15.150:0/763256040 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:46:53.710 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:53.707+0000 7f4181b45640 1 --2- 172.21.15.150:0/763256040 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f417c15b740 0x7f417c1f30b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:46:53.710 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:53.707+0000 7f4181344640 1 --2- 172.21.15.150:0/763256040 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f417c0b4150 0x7f417c14ca90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:46:53.710 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:53.708+0000 7f4180b43640 1 -- 172.21.15.150:0/763256040 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f417c15b740 msgr2=0x7f417c1f30b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:46:53.710 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:53.708+0000 7f4180b43640 1 --2- 172.21.15.150:0/763256040 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f417c15b740 0x7f417c1f30b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:53.710 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:53.708+0000 7f4180b43640 1 -- 172.21.15.150:0/763256040 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f417c0b4150 msgr2=0x7f417c14ca90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:46:53.710 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:53.708+0000 7f4180b43640 1 --2- 172.21.15.150:0/763256040 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f417c0b4150 0x7f417c14ca90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:53.710 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:53.708+0000 7f4180b43640 1 -- 172.21.15.150:0/763256040 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f417c1f1e00 con 0x7f417c0cf550 2024-09-17T05:46:53.710 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:53.708+0000 7f4181b45640 1 --2- 172.21.15.150:0/763256040 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f417c15b740 0x7f417c1f30b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:46:53.710 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:53.708+0000 7f4180b43640 1 --2- 172.21.15.150:0/763256040 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f417c0cf550 0x7f417c14fb70 secure :-1 s=READY pgs=796 cs=0 l=1 rev1=1 crypto rx=0x7f416c00c940 tx=0x7f416c00ce00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:46:53.710 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:53.708+0000 7f4171ffb640 1 -- 172.21.15.150:0/763256040 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f416c004220 con 0x7f417c0cf550 2024-09-17T05:46:53.710 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:53.708+0000 7f4171ffb640 1 -- 172.21.15.150:0/763256040 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f416c0079b0 con 0x7f417c0cf550 2024-09-17T05:46:53.710 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:53.708+0000 7f41835a8640 1 -- 172.21.15.150:0/763256040 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f417c152ee0 con 0x7f417c0cf550 2024-09-17T05:46:53.711 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:53.708+0000 7f4171ffb640 1 -- 172.21.15.150:0/763256040 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f416c007de0 con 0x7f417c0cf550 2024-09-17T05:46:53.711 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:53.708+0000 7f41835a8640 1 -- 172.21.15.150:0/763256040 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f417c152920 con 0x7f417c0cf550 2024-09-17T05:46:53.711 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:53.709+0000 7f41835a8640 1 -- 172.21.15.150:0/763256040 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f417c0b4560 con 0x7f417c0cf550 2024-09-17T05:46:53.712 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:53.710+0000 7f4171ffb640 1 -- 172.21.15.150:0/763256040 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 19) ==== 102563+0+0 (secure 0 0 0) 0x7f416c005020 con 0x7f417c0cf550 2024-09-17T05:46:53.712 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:53.710+0000 7f4171ffb640 1 --2- 172.21.15.150:0/763256040 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f41600797f0 0x7f416007bd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:46:53.712 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:53.710+0000 7f4171ffb640 1 -- 172.21.15.150:0/763256040 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 5765+0+0 (secure 0 0 0) 0x7f416c099b60 con 0x7f417c0cf550 2024-09-17T05:46:53.712 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:53.710+0000 7f4181344640 1 --2- 172.21.15.150:0/763256040 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f41600797f0 0x7f416007bd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:46:53.712 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:53.711+0000 7f4181344640 1 --2- 172.21.15.150:0/763256040 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f41600797f0 0x7f416007bd00 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f41780046b0 tx=0x7f4178009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:46:53.715 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:53.715+0000 7f4171ffb640 1 -- 172.21.15.150:0/763256040 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f416c014030 con 0x7f417c0cf550 2024-09-17T05:46:53.929 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:53.929+0000 7f41835a8640 1 -- 172.21.15.150:0/763256040 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7f417c152360 con 0x7f417c0cf550 2024-09-17T05:46:54.572 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:54.571+0000 7f4171ffb640 1 -- 172.21.15.150:0/763256040 <== mon.0 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v42) ==== 122+0+0 (secure 0 0 0) 0x7f416c0639d0 con 0x7f417c0cf550 2024-09-17T05:46:54.574 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:54.574+0000 7f41835a8640 1 -- 172.21.15.150:0/763256040 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f41600797f0 msgr2=0x7f416007bd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:46:54.575 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:54.574+0000 7f41835a8640 1 --2- 172.21.15.150:0/763256040 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f41600797f0 0x7f416007bd00 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f41780046b0 tx=0x7f4178009040 comp rx=0 tx=0).stop 2024-09-17T05:46:54.575 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:54.574+0000 7f41835a8640 1 -- 172.21.15.150:0/763256040 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f417c0cf550 msgr2=0x7f417c14fb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:46:54.575 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:54.574+0000 7f41835a8640 1 --2- 172.21.15.150:0/763256040 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f417c0cf550 0x7f417c14fb70 secure :-1 s=READY pgs=796 cs=0 l=1 rev1=1 crypto rx=0x7f416c00c940 tx=0x7f416c00ce00 comp rx=0 tx=0).stop 2024-09-17T05:46:54.575 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:54.574+0000 7f41835a8640 1 -- 172.21.15.150:0/763256040 shutdown_connections 2024-09-17T05:46:54.575 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:54.574+0000 7f41835a8640 1 --2- 172.21.15.150:0/763256040 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f41600797f0 0x7f416007bd00 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:54.575 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:54.574+0000 7f41835a8640 1 --2- 172.21.15.150:0/763256040 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f417c15b740 0x7f417c1f30b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:54.575 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:54.574+0000 7f41835a8640 1 --2- 172.21.15.150:0/763256040 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f417c0cf550 0x7f417c14fb70 unknown :-1 s=CLOSED pgs=796 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:54.575 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:54.574+0000 7f41835a8640 1 --2- 172.21.15.150:0/763256040 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f417c0b4150 0x7f417c14ca90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:54.575 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:54.574+0000 7f41835a8640 1 -- 172.21.15.150:0/763256040 >> 172.21.15.150:0/763256040 conn(0x7f417c0b2400 msgr2=0x7f417c070340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:46:54.575 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:54.574+0000 7f41835a8640 1 -- 172.21.15.150:0/763256040 shutdown_connections 2024-09-17T05:46:54.575 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:54.574+0000 7f41835a8640 1 -- 172.21.15.150:0/763256040 wait complete. 2024-09-17T05:46:54.588 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-09-17T05:46:54.588 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T05:46:54.705 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:54.704+0000 7f0f930a9640 1 -- 172.21.15.150:0/3827778225 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0f8c0d0c50 msgr2=0x7f0f8c0d0010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:46:54.705 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:54.704+0000 7f0f930a9640 1 --2- 172.21.15.150:0/3827778225 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0f8c0d0c50 0x7f0f8c0d0010 secure :-1 s=READY pgs=798 cs=0 l=1 rev1=1 crypto rx=0x7f0f8c073f30 tx=0x7f0f7402a5d0 comp rx=0 tx=0).stop 2024-09-17T05:46:54.705 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:54.704+0000 7f0f930a9640 1 -- 172.21.15.150:0/3827778225 shutdown_connections 2024-09-17T05:46:54.706 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:54.704+0000 7f0f930a9640 1 --2- 172.21.15.150:0/3827778225 >> v2:172.21.15.176:3300/0 conn(0x7f0f8c0d0550 0x7f0f8c0b18c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:54.706 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:54.704+0000 7f0f930a9640 1 --2- 172.21.15.150:0/3827778225 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0f8c0d0c50 0x7f0f8c0d0010 unknown :-1 s=CLOSED pgs=798 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:54.706 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:54.704+0000 7f0f930a9640 1 -- 172.21.15.150:0/3827778225 >> 172.21.15.150:0/3827778225 conn(0x7f0f8c0b3fc0 msgr2=0x7f0f8c0b43d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:46:54.706 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:54.704+0000 7f0f930a9640 1 -- 172.21.15.150:0/3827778225 shutdown_connections 2024-09-17T05:46:54.706 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:54.704+0000 7f0f930a9640 1 -- 172.21.15.150:0/3827778225 wait complete. 2024-09-17T05:46:54.706 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:54.706+0000 7f0f930a9640 1 Processor -- start 2024-09-17T05:46:54.707 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:54.706+0000 7f0f930a9640 1 -- start start 2024-09-17T05:46:54.710 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:54.708+0000 7f0f930a9640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0f8c0d0550 0x7f0f8c14e8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:46:54.710 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:54.708+0000 7f0f930a9640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0f8c0d0c50 0x7f0f8c15b560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:46:54.710 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:54.708+0000 7f0f930a9640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0f8c0d1060 0x7f0f8c0c74d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:46:54.710 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:54.708+0000 7f0f930a9640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f0f8c0ced30 con 0x7f0f8c0d1060 2024-09-17T05:46:54.710 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:54.708+0000 7f0f930a9640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f0f8c0cebb0 con 0x7f0f8c0d0c50 2024-09-17T05:46:54.710 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:54.708+0000 7f0f930a9640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f0f8c0cd130 con 0x7f0f8c0d0550 2024-09-17T05:46:54.710 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:54.708+0000 7f0f91646640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0f8c0d1060 0x7f0f8c0c74d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:46:54.710 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:54.708+0000 7f0f91646640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0f8c0d1060 0x7f0f8c0c74d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:59746/0 (socket says 172.21.15.150:59746) 2024-09-17T05:46:54.710 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:54.708+0000 7f0f91646640 1 -- 172.21.15.150:0/3084224972 learned_addr learned my addr 172.21.15.150:0/3084224972 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:46:54.710 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:54.708+0000 7f0f90e45640 1 --2- 172.21.15.150:0/3084224972 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0f8c0d0550 0x7f0f8c14e8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:46:54.710 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:54.708+0000 7f0f8bfff640 1 --2- 172.21.15.150:0/3084224972 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0f8c0d0c50 0x7f0f8c15b560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:46:54.710 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:54.708+0000 7f0f91646640 1 -- 172.21.15.150:0/3084224972 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0f8c0d0550 msgr2=0x7f0f8c14e8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:46:54.711 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:54.708+0000 7f0f91646640 1 --2- 172.21.15.150:0/3084224972 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0f8c0d0550 0x7f0f8c14e8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:54.711 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:54.708+0000 7f0f91646640 1 -- 172.21.15.150:0/3084224972 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0f8c0d0c50 msgr2=0x7f0f8c15b560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:46:54.711 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:54.708+0000 7f0f91646640 1 --2- 172.21.15.150:0/3084224972 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0f8c0d0c50 0x7f0f8c15b560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:54.711 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:54.708+0000 7f0f91646640 1 -- 172.21.15.150:0/3084224972 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0f8c14ee30 con 0x7f0f8c0d1060 2024-09-17T05:46:54.711 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:54.708+0000 7f0f91646640 1 --2- 172.21.15.150:0/3084224972 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0f8c0d1060 0x7f0f8c0c74d0 secure :-1 s=READY pgs=799 cs=0 l=1 rev1=1 crypto rx=0x7f0f8400c3c0 tx=0x7f0f8400c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:46:54.711 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:54.709+0000 7f0f897fa640 1 -- 172.21.15.150:0/3084224972 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f84011790 con 0x7f0f8c0d1060 2024-09-17T05:46:54.711 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:54.709+0000 7f0f897fa640 1 -- 172.21.15.150:0/3084224972 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0f84017070 con 0x7f0f8c0d1060 2024-09-17T05:46:54.711 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:54.709+0000 7f0f930a9640 1 -- 172.21.15.150:0/3084224972 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0f8c15c220 con 0x7f0f8c0d1060 2024-09-17T05:46:54.711 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:54.709+0000 7f0f897fa640 1 -- 172.21.15.150:0/3084224972 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f84011cc0 con 0x7f0f8c0d1060 2024-09-17T05:46:54.711 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:54.709+0000 7f0f930a9640 1 -- 172.21.15.150:0/3084224972 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0f8c15c7e0 con 0x7f0f8c0d1060 2024-09-17T05:46:54.712 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:54.710+0000 7f0f930a9640 1 -- 172.21.15.150:0/3084224972 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0f8c15bf90 con 0x7f0f8c0d1060 2024-09-17T05:46:54.712 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:54.710+0000 7f0f897fa640 1 -- 172.21.15.150:0/3084224972 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 19) ==== 102563+0+0 (secure 0 0 0) 0x7f0f8401c460 con 0x7f0f8c0d1060 2024-09-17T05:46:54.712 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:54.711+0000 7f0f897fa640 1 --2- 172.21.15.150:0/3084224972 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f0f6c079820 0x7f0f6c07bd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:46:54.712 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:54.711+0000 7f0f897fa640 1 -- 172.21.15.150:0/3084224972 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 5765+0+0 (secure 0 0 0) 0x7f0f84099280 con 0x7f0f8c0d1060 2024-09-17T05:46:54.712 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:54.711+0000 7f0f90e45640 1 --2- 172.21.15.150:0/3084224972 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f0f6c079820 0x7f0f6c07bd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:46:54.712 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:54.712+0000 7f0f90e45640 1 --2- 172.21.15.150:0/3084224972 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f0f6c079820 0x7f0f6c07bd30 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f0f74034000 tx=0x7f0f74004730 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:46:54.716 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:54.715+0000 7f0f897fa640 1 -- 172.21.15.150:0/3084224972 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f0f84062bb0 con 0x7f0f8c0d1060 2024-09-17T05:46:54.926 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:54.925+0000 7f0f930a9640 1 -- 172.21.15.150:0/3084224972 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f0f8c0d0010 con 0x7f0f8c0d1060 2024-09-17T05:46:54.926 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:54.926+0000 7f0f897fa640 1 -- 172.21.15.150:0/3084224972 <== mon.0 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 42 v42) ==== 94+0+5237 (secure 0 0 0) 0x7f0f8409c0c0 con 0x7f0f8c0d1060 2024-09-17T05:46:54.926 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-09-17T05:46:54.927 INFO:teuthology.orchestra.run.smithi150.stdout:{"epoch":42,"btime":"2024-09-17T05:46:54:570307+0000","default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5639,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6836/3422557079","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6834","nonce":3422557079},{"type":"v1","addr":"172.21.15.176:6836","nonce":3422557079}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":38},{"gid":6070,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6837/2283556368","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6835","nonce":2283556368},{"type":"v1","addr":"172.21.15.176:6837","nonce":2283556368}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":38},{"gid":6495,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6834/4130242651","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6832","nonce":4130242651},{"type":"v1","addr":"172.21.15.150:6834","nonce":4130242651}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":37}],"filesystems":[{"mdsmap":{"epoch":42,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T05:46:50.910842+0000","modified":"2024-09-17T05:46:53.930100+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6498},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6498":{"gid":6498,"name":"a","rank":0,"incarnation":39,"state":"up:active","state_seq":3,"addr":"172.21.15.150:6835/4215563116","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6833","nonce":4215563116},{"type":"v1","addr":"172.21.15.150:6835","nonce":4215563116}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6498,"qdb_cluster":[6498]},"id":5}]} 2024-09-17T05:46:54.927 INFO:teuthology.orchestra.run.smithi150.stderr:dumped fsmap epoch 42 2024-09-17T05:46:54.929 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:54.928+0000 7f0f930a9640 1 -- 172.21.15.150:0/3084224972 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f0f6c079820 msgr2=0x7f0f6c07bd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:46:54.929 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:54.928+0000 7f0f930a9640 1 --2- 172.21.15.150:0/3084224972 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f0f6c079820 0x7f0f6c07bd30 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f0f74034000 tx=0x7f0f74004730 comp rx=0 tx=0).stop 2024-09-17T05:46:54.929 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:54.928+0000 7f0f930a9640 1 -- 172.21.15.150:0/3084224972 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0f8c0d1060 msgr2=0x7f0f8c0c74d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:46:54.929 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:54.928+0000 7f0f930a9640 1 --2- 172.21.15.150:0/3084224972 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0f8c0d1060 0x7f0f8c0c74d0 secure :-1 s=READY pgs=799 cs=0 l=1 rev1=1 crypto rx=0x7f0f8400c3c0 tx=0x7f0f8400c880 comp rx=0 tx=0).stop 2024-09-17T05:46:54.929 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:54.928+0000 7f0f930a9640 1 -- 172.21.15.150:0/3084224972 shutdown_connections 2024-09-17T05:46:54.929 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:54.928+0000 7f0f930a9640 1 --2- 172.21.15.150:0/3084224972 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0f8c0d0c50 0x7f0f8c15b560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:54.929 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:54.928+0000 7f0f930a9640 1 --2- 172.21.15.150:0/3084224972 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f0f6c079820 0x7f0f6c07bd30 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:54.929 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:54.928+0000 7f0f930a9640 1 --2- 172.21.15.150:0/3084224972 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0f8c0d1060 0x7f0f8c0c74d0 unknown :-1 s=CLOSED pgs=799 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:54.929 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:54.928+0000 7f0f930a9640 1 --2- 172.21.15.150:0/3084224972 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0f8c0d0550 0x7f0f8c14e8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:54.929 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:54.928+0000 7f0f930a9640 1 -- 172.21.15.150:0/3084224972 >> 172.21.15.150:0/3084224972 conn(0x7f0f8c0b3fc0 msgr2=0x7f0f8c071280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:46:54.929 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:54.928+0000 7f0f930a9640 1 -- 172.21.15.150:0/3084224972 shutdown_connections 2024-09-17T05:46:54.930 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:54.928+0000 7f0f930a9640 1 -- 172.21.15.150:0/3084224972 wait complete. 2024-09-17T05:46:54.941 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T05:46:55.054 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:55.053+0000 7fdea274a640 1 -- 172.21.15.150:0/1234048765 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fde9c09ba60 msgr2=0x7fde9c0b7330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:46:55.054 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:55.053+0000 7fdea274a640 1 --2- 172.21.15.150:0/1234048765 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fde9c09ba60 0x7fde9c0b7330 secure :-1 s=READY pgs=801 cs=0 l=1 rev1=1 crypto rx=0x7fde8c009820 tx=0x7fde8c02a510 comp rx=0 tx=0).stop 2024-09-17T05:46:55.054 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:55.053+0000 7fdea274a640 1 -- 172.21.15.150:0/1234048765 shutdown_connections 2024-09-17T05:46:55.054 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:55.053+0000 7fdea274a640 1 --2- 172.21.15.150:0/1234048765 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fde9c0cd440 0x7fde9c0cd850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:55.054 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:55.053+0000 7fdea274a640 1 --2- 172.21.15.150:0/1234048765 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fde9c09ba60 0x7fde9c0b7330 unknown :-1 s=CLOSED pgs=801 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:55.054 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:55.053+0000 7fdea274a640 1 -- 172.21.15.150:0/1234048765 >> 172.21.15.150:0/1234048765 conn(0x7fde9c0cee90 msgr2=0x7fde9c0cf2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:46:55.054 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:55.053+0000 7fdea274a640 1 -- 172.21.15.150:0/1234048765 shutdown_connections 2024-09-17T05:46:55.054 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:55.053+0000 7fdea274a640 1 -- 172.21.15.150:0/1234048765 wait complete. 2024-09-17T05:46:55.055 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:55.055+0000 7fdea274a640 1 Processor -- start 2024-09-17T05:46:55.055 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:55.055+0000 7fdea274a640 1 -- start start 2024-09-17T05:46:55.058 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:55.056+0000 7fdea274a640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fde9c09ba60 0x7fde9c148100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:46:55.058 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:55.056+0000 7fdea274a640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fde9c0cd440 0x7fde9c1663e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:46:55.058 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:55.056+0000 7fdea274a640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fde9c0cffe0 0x7fde9c166920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:46:55.058 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:55.056+0000 7fdea274a640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7fde9c0d0e90 con 0x7fde9c0cffe0 2024-09-17T05:46:55.058 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:55.056+0000 7fdea274a640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fde9c0d0d10 con 0x7fde9c09ba60 2024-09-17T05:46:55.058 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:55.056+0000 7fdea274a640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fde9c1670e0 con 0x7fde9c0cd440 2024-09-17T05:46:55.058 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:55.056+0000 7fdea0ce7640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fde9c0cffe0 0x7fde9c166920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:46:55.058 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:55.056+0000 7fdea0ce7640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fde9c0cffe0 0x7fde9c166920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:59770/0 (socket says 172.21.15.150:59770) 2024-09-17T05:46:55.058 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:55.056+0000 7fdea0ce7640 1 -- 172.21.15.150:0/2418398644 learned_addr learned my addr 172.21.15.150:0/2418398644 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:46:55.059 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:55.056+0000 7fde9b7fe640 1 --2- 172.21.15.150:0/2418398644 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fde9c0cd440 0x7fde9c1663e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:46:55.059 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:55.056+0000 7fde9bfff640 1 --2- 172.21.15.150:0/2418398644 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fde9c09ba60 0x7fde9c148100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:46:55.059 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:55.057+0000 7fdea0ce7640 1 -- 172.21.15.150:0/2418398644 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fde9c0cd440 msgr2=0x7fde9c1663e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:46:55.059 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:55.057+0000 7fdea0ce7640 1 --2- 172.21.15.150:0/2418398644 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fde9c0cd440 0x7fde9c1663e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:55.059 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:55.057+0000 7fdea0ce7640 1 -- 172.21.15.150:0/2418398644 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fde9c09ba60 msgr2=0x7fde9c148100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:46:55.059 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:55.057+0000 7fdea0ce7640 1 --2- 172.21.15.150:0/2418398644 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fde9c09ba60 0x7fde9c148100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:55.059 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:55.057+0000 7fdea0ce7640 1 -- 172.21.15.150:0/2418398644 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fde9c148640 con 0x7fde9c0cffe0 2024-09-17T05:46:55.059 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:55.057+0000 7fdea0ce7640 1 --2- 172.21.15.150:0/2418398644 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fde9c0cffe0 0x7fde9c166920 secure :-1 s=READY pgs=802 cs=0 l=1 rev1=1 crypto rx=0x7fde9400c730 tx=0x7fde9400cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:46:55.059 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:55.057+0000 7fde98ff9640 1 -- 172.21.15.150:0/2418398644 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde94003b70 con 0x7fde9c0cffe0 2024-09-17T05:46:55.059 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:55.057+0000 7fde98ff9640 1 -- 172.21.15.150:0/2418398644 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fde94003d30 con 0x7fde9c0cffe0 2024-09-17T05:46:55.059 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:55.057+0000 7fdea274a640 1 -- 172.21.15.150:0/2418398644 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fde9c1f7610 con 0x7fde9c0cffe0 2024-09-17T05:46:55.059 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:55.057+0000 7fde98ff9640 1 -- 172.21.15.150:0/2418398644 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde940052d0 con 0x7fde9c0cffe0 2024-09-17T05:46:55.059 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:55.057+0000 7fdea274a640 1 -- 172.21.15.150:0/2418398644 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fde9c1f7bd0 con 0x7fde9c0cffe0 2024-09-17T05:46:55.060 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:55.058+0000 7fdea274a640 1 -- 172.21.15.150:0/2418398644 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fde9c1f7380 con 0x7fde9c0cffe0 2024-09-17T05:46:55.060 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:55.059+0000 7fde98ff9640 1 -- 172.21.15.150:0/2418398644 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 19) ==== 102563+0+0 (secure 0 0 0) 0x7fde94005470 con 0x7fde9c0cffe0 2024-09-17T05:46:55.060 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:55.059+0000 7fde98ff9640 1 --2- 172.21.15.150:0/2418398644 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fde88079820 0x7fde8807bd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:46:55.060 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:55.060+0000 7fde98ff9640 1 -- 172.21.15.150:0/2418398644 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 5765+0+0 (secure 0 0 0) 0x7fde940992f0 con 0x7fde9c0cffe0 2024-09-17T05:46:55.061 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:55.060+0000 7fde9bfff640 1 --2- 172.21.15.150:0/2418398644 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fde88079820 0x7fde8807bd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:46:55.061 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:55.060+0000 7fde9bfff640 1 --2- 172.21.15.150:0/2418398644 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fde88079820 0x7fde8807bd30 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7fde8c034000 tx=0x7fde8c004730 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:46:55.064 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:55.064+0000 7fde98ff9640 1 -- 172.21.15.150:0/2418398644 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fde94062b90 con 0x7fde9c0cffe0 2024-09-17T05:46:55.240 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:55.240+0000 7fdea274a640 1 -- 172.21.15.150:0/2418398644 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fde9c0b7330 con 0x7fde9c0cffe0 2024-09-17T05:46:55.241 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:55.241+0000 7fde98ff9640 1 -- 172.21.15.150:0/2418398644 <== mon.0 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v72) ==== 74+0+16851 (secure 0 0 0) 0x7fde940675c0 con 0x7fde9c0cffe0 2024-09-17T05:46:55.242 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-09-17T05:46:55.242 INFO:teuthology.orchestra.run.smithi150.stdout:{"epoch":72,"fsid":"9f2e05e9-d629-47b3-b26b-1360655b7d20","created":"2024-09-17T05:41:32.502979+0000","modified":"2024-09-17T05:46:52.548706+0000","last_up_change":"2024-09-17T05:41:46.150225+0000","last_in_change":"2024-09-17T05:41:36.120274+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T05:41:46.860779+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_metadata","create_time":"2024-09-17T05:46:48.549801+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"71","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs_data","create_time":"2024-09-17T05:46:49.868230+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"72","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"4f31c018-c8a4-4d6d-b0c2-a597c47aae4a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6800","nonce":479374392},{"type":"v1","addr":"172.21.15.150:6801","nonce":479374392}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6802","nonce":479374392},{"type":"v1","addr":"172.21.15.150:6803","nonce":479374392}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6806","nonce":479374392},{"type":"v1","addr":"172.21.15.150:6807","nonce":479374392}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6804","nonce":479374392},{"type":"v1","addr":"172.21.15.150:6805","nonce":479374392}]},"public_addr":"172.21.15.150:6801/479374392","cluster_addr":"172.21.15.150:6803/479374392","heartbeat_back_addr":"172.21.15.150:6807/479374392","heartbeat_front_addr":"172.21.15.150:6805/479374392","state":["exists","up"]},{"osd":1,"uuid":"6ff4a573-500b-4e04-9de3-39265ead78b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6824","nonce":913899800},{"type":"v1","addr":"172.21.15.150:6825","nonce":913899800}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6826","nonce":913899800},{"type":"v1","addr":"172.21.15.150:6827","nonce":913899800}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6830","nonce":913899800},{"type":"v1","addr":"172.21.15.150:6831","nonce":913899800}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6828","nonce":913899800},{"type":"v1","addr":"172.21.15.150:6829","nonce":913899800}]},"public_addr":"172.21.15.150:6825/913899800","cluster_addr":"172.21.15.150:6827/913899800","heartbeat_back_addr":"172.21.15.150:6831/913899800","heartbeat_front_addr":"172.21.15.150:6829/913899800","state":["exists","up"]},{"osd":2,"uuid":"bffea6f9-2465-4182-b205-00436c41ac1c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6816","nonce":363718461},{"type":"v1","addr":"172.21.15.150:6817","nonce":363718461}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6818","nonce":363718461},{"type":"v1","addr":"172.21.15.150:6819","nonce":363718461}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6822","nonce":363718461},{"type":"v1","addr":"172.21.15.150:6823","nonce":363718461}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6820","nonce":363718461},{"type":"v1","addr":"172.21.15.150:6821","nonce":363718461}]},"public_addr":"172.21.15.150:6817/363718461","cluster_addr":"172.21.15.150:6819/363718461","heartbeat_back_addr":"172.21.15.150:6823/363718461","heartbeat_front_addr":"172.21.15.150:6821/363718461","state":["exists","up"]},{"osd":3,"uuid":"cda70430-d1e1-427e-b04e-56db4031d078","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6808","nonce":3550994626},{"type":"v1","addr":"172.21.15.150:6809","nonce":3550994626}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6810","nonce":3550994626},{"type":"v1","addr":"172.21.15.150:6811","nonce":3550994626}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6814","nonce":3550994626},{"type":"v1","addr":"172.21.15.150:6815","nonce":3550994626}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6812","nonce":3550994626},{"type":"v1","addr":"172.21.15.150:6813","nonce":3550994626}]},"public_addr":"172.21.15.150:6809/3550994626","cluster_addr":"172.21.15.150:6811/3550994626","heartbeat_back_addr":"172.21.15.150:6815/3550994626","heartbeat_front_addr":"172.21.15.150:6813/3550994626","state":["exists","up"]},{"osd":4,"uuid":"3a0277fb-5e1e-4f68-bb2d-9a8a0152f64a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6810","nonce":2718261497},{"type":"v1","addr":"172.21.15.176:6811","nonce":2718261497}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6812","nonce":2718261497},{"type":"v1","addr":"172.21.15.176:6813","nonce":2718261497}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6816","nonce":2718261497},{"type":"v1","addr":"172.21.15.176:6817","nonce":2718261497}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6814","nonce":2718261497},{"type":"v1","addr":"172.21.15.176:6815","nonce":2718261497}]},"public_addr":"172.21.15.176:6811/2718261497","cluster_addr":"172.21.15.176:6813/2718261497","heartbeat_back_addr":"172.21.15.176:6817/2718261497","heartbeat_front_addr":"172.21.15.176:6815/2718261497","state":["exists","up"]},{"osd":5,"uuid":"33aebee6-0315-40b7-a11c-6702f0be494d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6818","nonce":2049295774},{"type":"v1","addr":"172.21.15.176:6819","nonce":2049295774}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6820","nonce":2049295774},{"type":"v1","addr":"172.21.15.176:6821","nonce":2049295774}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6824","nonce":2049295774},{"type":"v1","addr":"172.21.15.176:6825","nonce":2049295774}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6822","nonce":2049295774},{"type":"v1","addr":"172.21.15.176:6823","nonce":2049295774}]},"public_addr":"172.21.15.176:6819/2049295774","cluster_addr":"172.21.15.176:6821/2049295774","heartbeat_back_addr":"172.21.15.176:6825/2049295774","heartbeat_front_addr":"172.21.15.176:6823/2049295774","state":["exists","up"]},{"osd":6,"uuid":"4d24f360-6751-4263-841b-d77793d33540","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6826","nonce":2164458476},{"type":"v1","addr":"172.21.15.176:6827","nonce":2164458476}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6828","nonce":2164458476},{"type":"v1","addr":"172.21.15.176:6829","nonce":2164458476}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6832","nonce":2164458476},{"type":"v1","addr":"172.21.15.176:6833","nonce":2164458476}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6830","nonce":2164458476},{"type":"v1","addr":"172.21.15.176:6831","nonce":2164458476}]},"public_addr":"172.21.15.176:6827/2164458476","cluster_addr":"172.21.15.176:6829/2164458476","heartbeat_back_addr":"172.21.15.176:6833/2164458476","heartbeat_front_addr":"172.21.15.176:6831/2164458476","state":["exists","up"]},{"osd":7,"uuid":"c8594fda-c74a-4ba9-8277-caf101d58ca1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6802","nonce":3239587708},{"type":"v1","addr":"172.21.15.176:6803","nonce":3239587708}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6804","nonce":3239587708},{"type":"v1","addr":"172.21.15.176:6805","nonce":3239587708}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6808","nonce":3239587708},{"type":"v1","addr":"172.21.15.176:6809","nonce":3239587708}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6806","nonce":3239587708},{"type":"v1","addr":"172.21.15.176:6807","nonce":3239587708}]},"public_addr":"172.21.15.176:6803/3239587708","cluster_addr":"172.21.15.176:6805/3239587708","heartbeat_back_addr":"172.21.15.176:6809/3239587708","heartbeat_front_addr":"172.21.15.176:6807/3239587708","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:41:41.905151+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:41:42.705679+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:41:42.459673+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:41:42.440819+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:41:42.668428+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:41:42.694972+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:41:43.078535+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:41:42.363539+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":7,"snaps":[{"begin":2,"length":2}]},{"pool":9,"snaps":[{"begin":2,"length":2}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T05:46:55.245 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:55.243+0000 7fdea274a640 1 -- 172.21.15.150:0/2418398644 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fde88079820 msgr2=0x7fde8807bd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:46:55.245 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:55.243+0000 7fdea274a640 1 --2- 172.21.15.150:0/2418398644 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fde88079820 0x7fde8807bd30 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7fde8c034000 tx=0x7fde8c004730 comp rx=0 tx=0).stop 2024-09-17T05:46:55.245 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:55.243+0000 7fdea274a640 1 -- 172.21.15.150:0/2418398644 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fde9c0cffe0 msgr2=0x7fde9c166920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:46:55.245 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:55.243+0000 7fdea274a640 1 --2- 172.21.15.150:0/2418398644 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fde9c0cffe0 0x7fde9c166920 secure :-1 s=READY pgs=802 cs=0 l=1 rev1=1 crypto rx=0x7fde9400c730 tx=0x7fde9400cbf0 comp rx=0 tx=0).stop 2024-09-17T05:46:55.245 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:55.243+0000 7fdea274a640 1 -- 172.21.15.150:0/2418398644 shutdown_connections 2024-09-17T05:46:55.245 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:55.243+0000 7fdea274a640 1 --2- 172.21.15.150:0/2418398644 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fde88079820 0x7fde8807bd30 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:55.245 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:55.243+0000 7fdea274a640 1 --2- 172.21.15.150:0/2418398644 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fde9c0cffe0 0x7fde9c166920 unknown :-1 s=CLOSED pgs=802 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:55.245 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:55.243+0000 7fdea274a640 1 --2- 172.21.15.150:0/2418398644 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fde9c0cd440 0x7fde9c1663e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:55.246 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:55.243+0000 7fdea274a640 1 --2- 172.21.15.150:0/2418398644 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fde9c09ba60 0x7fde9c148100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:55.246 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:55.243+0000 7fdea274a640 1 -- 172.21.15.150:0/2418398644 >> 172.21.15.150:0/2418398644 conn(0x7fde9c0cee90 msgr2=0x7fde9c0cc1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:46:55.246 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:55.243+0000 7fdea274a640 1 -- 172.21.15.150:0/2418398644 shutdown_connections 2024-09-17T05:46:55.246 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:55.243+0000 7fdea274a640 1 -- 172.21.15.150:0/2418398644 wait complete. 2024-09-17T05:46:55.256 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-17T05:46:55.256 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-17T05:46:55.375 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:55.368+0000 7ff3e3dc6640 1 -- 172.21.15.150:0/2924395189 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff3dc0ad0e0 msgr2=0x7ff3dc0ad4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:46:55.375 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:55.368+0000 7ff3e3dc6640 1 --2- 172.21.15.150:0/2924395189 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff3dc0ad0e0 0x7ff3dc0ad4f0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7ff3cc009830 tx=0x7ff3cc02a480 comp rx=0 tx=0).stop 2024-09-17T05:46:55.375 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:55.368+0000 7ff3e3dc6640 1 -- 172.21.15.150:0/2924395189 shutdown_connections 2024-09-17T05:46:55.375 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:55.368+0000 7ff3e3dc6640 1 --2- 172.21.15.150:0/2924395189 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff3dc0ad0e0 0x7ff3dc0ad4f0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:55.375 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:55.368+0000 7ff3e3dc6640 1 --2- 172.21.15.150:0/2924395189 >> v2:172.21.15.176:3300/0 conn(0x7ff3dc15d760 0x7ff3dc1535c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:55.375 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:55.368+0000 7ff3e3dc6640 1 -- 172.21.15.150:0/2924395189 >> 172.21.15.150:0/2924395189 conn(0x7ff3dc06d730 msgr2=0x7ff3dc0b1e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:46:55.375 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:55.368+0000 7ff3e3dc6640 1 -- 172.21.15.150:0/2924395189 shutdown_connections 2024-09-17T05:46:55.375 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:55.368+0000 7ff3e3dc6640 1 -- 172.21.15.150:0/2924395189 wait complete. 2024-09-17T05:46:55.376 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:55.370+0000 7ff3e3dc6640 1 Processor -- start 2024-09-17T05:46:55.376 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:55.370+0000 7ff3e3dc6640 1 -- start start 2024-09-17T05:46:55.376 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:55.371+0000 7ff3e3dc6640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff3dc0ad0e0 0x7ff3dc159fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:46:55.376 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:55.371+0000 7ff3e3dc6640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff3dc15d760 0x7ff3dc1523f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:46:55.376 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:55.371+0000 7ff3e3dc6640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff3dc160310 0x7ff3dc099590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:46:55.376 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:55.371+0000 7ff3e3dc6640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7ff3dc06f220 con 0x7ff3dc160310 2024-09-17T05:46:55.376 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:55.371+0000 7ff3e3dc6640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7ff3dc06f0a0 con 0x7ff3dc0ad0e0 2024-09-17T05:46:55.376 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:55.371+0000 7ff3e3dc6640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7ff3dc0b4c20 con 0x7ff3dc15d760 2024-09-17T05:46:55.376 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:55.371+0000 7ff3e2363640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff3dc160310 0x7ff3dc099590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:46:55.376 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:55.371+0000 7ff3e2363640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff3dc160310 0x7ff3dc099590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:59782/0 (socket says 172.21.15.150:59782) 2024-09-17T05:46:55.376 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:55.371+0000 7ff3e2363640 1 -- 172.21.15.150:0/3695202687 learned_addr learned my addr 172.21.15.150:0/3695202687 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:46:55.376 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:55.371+0000 7ff3e1361640 1 --2- 172.21.15.150:0/3695202687 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff3dc15d760 0x7ff3dc1523f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:46:55.376 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:55.371+0000 7ff3e1b62640 1 --2- 172.21.15.150:0/3695202687 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff3dc0ad0e0 0x7ff3dc159fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:46:55.377 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:55.372+0000 7ff3e2363640 1 -- 172.21.15.150:0/3695202687 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff3dc15d760 msgr2=0x7ff3dc1523f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:46:55.377 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:55.372+0000 7ff3e2363640 1 --2- 172.21.15.150:0/3695202687 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff3dc15d760 0x7ff3dc1523f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:55.377 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:55.372+0000 7ff3e2363640 1 -- 172.21.15.150:0/3695202687 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff3dc0ad0e0 msgr2=0x7ff3dc159fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:46:55.377 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:55.372+0000 7ff3e2363640 1 --2- 172.21.15.150:0/3695202687 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff3dc0ad0e0 0x7ff3dc159fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:55.377 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:55.372+0000 7ff3e2363640 1 -- 172.21.15.150:0/3695202687 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff3dc158a10 con 0x7ff3dc160310 2024-09-17T05:46:55.377 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:55.372+0000 7ff3e2363640 1 --2- 172.21.15.150:0/3695202687 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff3dc160310 0x7ff3dc099590 secure :-1 s=READY pgs=804 cs=0 l=1 rev1=1 crypto rx=0x7ff3d400caa0 tx=0x7ff3d400cf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:46:55.377 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:55.372+0000 7ff3d27fc640 1 -- 172.21.15.150:0/3695202687 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3d4016020 con 0x7ff3dc160310 2024-09-17T05:46:55.377 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:55.372+0000 7ff3d27fc640 1 -- 172.21.15.150:0/3695202687 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff3d400acf0 con 0x7ff3dc160310 2024-09-17T05:46:55.377 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:55.372+0000 7ff3d27fc640 1 -- 172.21.15.150:0/3695202687 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3d4012680 con 0x7ff3dc160310 2024-09-17T05:46:55.377 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:55.372+0000 7ff3e3dc6640 1 -- 172.21.15.150:0/3695202687 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff3dc158cf0 con 0x7ff3dc160310 2024-09-17T05:46:55.377 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:55.372+0000 7ff3e3dc6640 1 -- 172.21.15.150:0/3695202687 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff3dc1592b0 con 0x7ff3dc160310 2024-09-17T05:46:55.377 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:55.373+0000 7ff3e3dc6640 1 -- 172.21.15.150:0/3695202687 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff3dc160fa0 con 0x7ff3dc160310 2024-09-17T05:46:55.377 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:55.374+0000 7ff3d27fc640 1 -- 172.21.15.150:0/3695202687 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 19) ==== 102563+0+0 (secure 0 0 0) 0x7ff3d4019020 con 0x7ff3dc160310 2024-09-17T05:46:55.378 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:55.374+0000 7ff3d27fc640 1 --2- 172.21.15.150:0/3695202687 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7ff3c0079820 0x7ff3c007bd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:46:55.378 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:55.374+0000 7ff3d27fc640 1 -- 172.21.15.150:0/3695202687 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 5765+0+0 (secure 0 0 0) 0x7ff3d4099ed0 con 0x7ff3dc160310 2024-09-17T05:46:55.378 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:55.374+0000 7ff3e1b62640 1 --2- 172.21.15.150:0/3695202687 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7ff3c0079820 0x7ff3c007bd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:46:55.378 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:55.375+0000 7ff3e1b62640 1 --2- 172.21.15.150:0/3695202687 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7ff3c0079820 0x7ff3c007bd30 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7ff3d8009b30 tx=0x7ff3d8005f90 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:46:55.379 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:55.379+0000 7ff3d27fc640 1 -- 172.21.15.150:0/3695202687 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7ff3d4020020 con 0x7ff3dc160310 2024-09-17T05:46:55.552 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:55.551+0000 7ff3e3dc6640 1 -- 172.21.15.150:0/3695202687 --> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7ff3dc1587a0 con 0x7ff3c0079820 2024-09-17T05:46:55.556 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:55.556+0000 7ff3d27fc640 1 -- 172.21.15.150:0/3695202687 <== mgr.4108 v2:172.21.15.176:6800/3631216395 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+249839 (secure 0 0 0) 0x7ff3dc1587a0 con 0x7ff3c0079820 2024-09-17T05:46:55.560 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-09-17T05:46:55.561 INFO:teuthology.orchestra.run.smithi150.stderr:dumped all 2024-09-17T05:46:55.563 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:55.559+0000 7ff3e3dc6640 1 -- 172.21.15.150:0/3695202687 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7ff3c0079820 msgr2=0x7ff3c007bd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:46:55.563 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:55.559+0000 7ff3e3dc6640 1 --2- 172.21.15.150:0/3695202687 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7ff3c0079820 0x7ff3c007bd30 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7ff3d8009b30 tx=0x7ff3d8005f90 comp rx=0 tx=0).stop 2024-09-17T05:46:55.563 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:55.559+0000 7ff3e3dc6640 1 -- 172.21.15.150:0/3695202687 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff3dc160310 msgr2=0x7ff3dc099590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:46:55.563 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:55.559+0000 7ff3e3dc6640 1 --2- 172.21.15.150:0/3695202687 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff3dc160310 0x7ff3dc099590 secure :-1 s=READY pgs=804 cs=0 l=1 rev1=1 crypto rx=0x7ff3d400caa0 tx=0x7ff3d400cf60 comp rx=0 tx=0).stop 2024-09-17T05:46:55.563 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:55.559+0000 7ff3e3dc6640 1 -- 172.21.15.150:0/3695202687 shutdown_connections 2024-09-17T05:46:55.563 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:55.559+0000 7ff3e3dc6640 1 --2- 172.21.15.150:0/3695202687 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7ff3c0079820 0x7ff3c007bd30 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:55.563 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:55.559+0000 7ff3e3dc6640 1 --2- 172.21.15.150:0/3695202687 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff3dc160310 0x7ff3dc099590 unknown :-1 s=CLOSED pgs=804 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:55.563 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:55.559+0000 7ff3e3dc6640 1 --2- 172.21.15.150:0/3695202687 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff3dc15d760 0x7ff3dc1523f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:55.563 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:55.559+0000 7ff3e3dc6640 1 --2- 172.21.15.150:0/3695202687 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff3dc0ad0e0 0x7ff3dc159fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:55.563 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:55.559+0000 7ff3e3dc6640 1 -- 172.21.15.150:0/3695202687 >> 172.21.15.150:0/3695202687 conn(0x7ff3dc06d730 msgr2=0x7ff3dc0cfb40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:46:55.563 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:55.559+0000 7ff3e3dc6640 1 -- 172.21.15.150:0/3695202687 shutdown_connections 2024-09-17T05:46:55.564 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:55.559+0000 7ff3e3dc6640 1 -- 172.21.15.150:0/3695202687 wait complete. 2024-09-17T05:46:55.572 INFO:teuthology.orchestra.run.smithi150.stdout:{"pg_ready":true,"pg_map":{"version":221,"stamp":"2024-09-17T05:46:54.931253+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592196,"num_objects":15,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":123,"num_write_kb":1641,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":94,"ondisk_log_size":94,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":45,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":455880,"kb_used_data":7872,"kb_used_omap":12,"kb_used_meta":447795,"kb_avail":754518840,"statfs":{"total":773094113280,"available":772627292160,"internally_reserved":0,"allocated":8060928,"data_stored":4046851,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":458542640},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":13,"apply_latency_ms":13,"commit_latency_ns":13000000,"apply_latency_ns":13000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":1828,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.396089"},"pg_stats":[{"pgid":"11.3f","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2024-09-17T05:46:50.548739+0000","last_change":"2024-09-17T05:46:50.548739+0000","last_active":"2024-09-17T05:46:50.533972+0000","last_peered":"2024-09-17T05:46:50.533972+0000","last_clean":"2024-09-17T05:46:50.533972+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:46:50.548739+0000","last_undegraded":"2024-09-17T05:46:50.548739+0000","last_fullsized":"2024-09-17T05:46:50.548739+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:46:50.533972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:46:50.533972+0000","last_clean_scrub_stamp":"2024-09-17T05:46:50.533972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.3e","version":"0'0","reported_seq":10,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-17T05:46:51.575067+0000","last_change":"2024-09-17T05:46:51.574207+0000","last_active":"2024-09-17T05:46:51.575067+0000","last_peered":"2024-09-17T05:46:51.575067+0000","last_clean":"2024-09-17T05:46:51.575067+0000","last_became_active":"2024-09-17T05:46:51.573715+0000","last_became_peered":"2024-09-17T05:46:51.573715+0000","last_unstale":"2024-09-17T05:46:51.575067+0000","last_undegraded":"2024-09-17T05:46:51.575067+0000","last_fullsized":"2024-09-17T05:46:51.575067+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:46:50.533972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:46:50.533972+0000","last_clean_scrub_stamp":"2024-09-17T05:46:50.533972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:25:21.675189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.3d","version":"0'0","reported_seq":10,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-17T05:46:51.567520+0000","last_change":"2024-09-17T05:46:51.562710+0000","last_active":"2024-09-17T05:46:51.567520+0000","last_peered":"2024-09-17T05:46:51.567520+0000","last_clean":"2024-09-17T05:46:51.567520+0000","last_became_active":"2024-09-17T05:46:51.562411+0000","last_became_peered":"2024-09-17T05:46:51.562411+0000","last_unstale":"2024-09-17T05:46:51.567520+0000","last_undegraded":"2024-09-17T05:46:51.567520+0000","last_fullsized":"2024-09-17T05:46:51.567520+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:46:50.533972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:46:50.533972+0000","last_clean_scrub_stamp":"2024-09-17T05:46:50.533972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:00:47.705389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.3c","version":"0'0","reported_seq":10,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-17T05:46:51.578548+0000","last_change":"2024-09-17T05:46:51.578009+0000","last_active":"2024-09-17T05:46:51.578548+0000","last_peered":"2024-09-17T05:46:51.578548+0000","last_clean":"2024-09-17T05:46:51.578548+0000","last_became_active":"2024-09-17T05:46:51.577250+0000","last_became_peered":"2024-09-17T05:46:51.577250+0000","last_unstale":"2024-09-17T05:46:51.578548+0000","last_undegraded":"2024-09-17T05:46:51.578548+0000","last_fullsized":"2024-09-17T05:46:51.578548+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:46:50.533972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:46:50.533972+0000","last_clean_scrub_stamp":"2024-09-17T05:46:50.533972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:54:01.737244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.3b","version":"0'0","reported_seq":10,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-17T05:46:51.569883+0000","last_change":"2024-09-17T05:46:51.568927+0000","last_active":"2024-09-17T05:46:51.569883+0000","last_peered":"2024-09-17T05:46:51.569883+0000","last_clean":"2024-09-17T05:46:51.569883+0000","last_became_active":"2024-09-17T05:46:51.568639+0000","last_became_peered":"2024-09-17T05:46:51.568639+0000","last_unstale":"2024-09-17T05:46:51.569883+0000","last_undegraded":"2024-09-17T05:46:51.569883+0000","last_fullsized":"2024-09-17T05:46:51.569883+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:46:50.533972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:46:50.533972+0000","last_clean_scrub_stamp":"2024-09-17T05:46:50.533972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:42:03.102311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.3a","version":"0'0","reported_seq":10,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-17T05:46:51.581154+0000","last_change":"2024-09-17T05:46:51.578128+0000","last_active":"2024-09-17T05:46:51.581154+0000","last_peered":"2024-09-17T05:46:51.581154+0000","last_clean":"2024-09-17T05:46:51.581154+0000","last_became_active":"2024-09-17T05:46:51.577539+0000","last_became_peered":"2024-09-17T05:46:51.577539+0000","last_unstale":"2024-09-17T05:46:51.581154+0000","last_undegraded":"2024-09-17T05:46:51.581154+0000","last_fullsized":"2024-09-17T05:46:51.581154+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:46:50.533972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:46:50.533972+0000","last_clean_scrub_stamp":"2024-09-17T05:46:50.533972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:30:58.672623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.39","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2024-09-17T05:46:50.540980+0000","last_change":"2024-09-17T05:46:50.540980+0000","last_active":"2024-09-17T05:46:50.533972+0000","last_peered":"2024-09-17T05:46:50.533972+0000","last_clean":"2024-09-17T05:46:50.533972+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:46:50.540980+0000","last_undegraded":"2024-09-17T05:46:50.540980+0000","last_fullsized":"2024-09-17T05:46:50.540980+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:46:50.533972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:46:50.533972+0000","last_clean_scrub_stamp":"2024-09-17T05:46:50.533972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.38","version":"0'0","reported_seq":10,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-17T05:46:51.582069+0000","last_change":"2024-09-17T05:46:51.578199+0000","last_active":"2024-09-17T05:46:51.582069+0000","last_peered":"2024-09-17T05:46:51.582069+0000","last_clean":"2024-09-17T05:46:51.582069+0000","last_became_active":"2024-09-17T05:46:51.576847+0000","last_became_peered":"2024-09-17T05:46:51.576847+0000","last_unstale":"2024-09-17T05:46:51.582069+0000","last_undegraded":"2024-09-17T05:46:51.582069+0000","last_fullsized":"2024-09-17T05:46:51.582069+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:46:50.533972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:46:50.533972+0000","last_clean_scrub_stamp":"2024-09-17T05:46:50.533972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:44:40.981285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.37","version":"0'0","reported_seq":10,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-17T05:46:51.565649+0000","last_change":"2024-09-17T05:46:51.563153+0000","last_active":"2024-09-17T05:46:51.565649+0000","last_peered":"2024-09-17T05:46:51.565649+0000","last_clean":"2024-09-17T05:46:51.565649+0000","last_became_active":"2024-09-17T05:46:51.562497+0000","last_became_peered":"2024-09-17T05:46:51.562497+0000","last_unstale":"2024-09-17T05:46:51.565649+0000","last_undegraded":"2024-09-17T05:46:51.565649+0000","last_fullsized":"2024-09-17T05:46:51.565649+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:46:50.533972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:46:50.533972+0000","last_clean_scrub_stamp":"2024-09-17T05:46:50.533972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:01:14.364335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.36","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2024-09-17T05:46:50.541245+0000","last_change":"2024-09-17T05:46:50.541245+0000","last_active":"2024-09-17T05:46:50.533972+0000","last_peered":"2024-09-17T05:46:50.533972+0000","last_clean":"2024-09-17T05:46:50.533972+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:46:50.541245+0000","last_undegraded":"2024-09-17T05:46:50.541245+0000","last_fullsized":"2024-09-17T05:46:50.541245+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:46:50.533972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:46:50.533972+0000","last_clean_scrub_stamp":"2024-09-17T05:46:50.533972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.35","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2024-09-17T05:46:50.552725+0000","last_change":"2024-09-17T05:46:50.552725+0000","last_active":"2024-09-17T05:46:50.533972+0000","last_peered":"2024-09-17T05:46:50.533972+0000","last_clean":"2024-09-17T05:46:50.533972+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:46:50.552725+0000","last_undegraded":"2024-09-17T05:46:50.552725+0000","last_fullsized":"2024-09-17T05:46:50.552725+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:46:50.533972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:46:50.533972+0000","last_clean_scrub_stamp":"2024-09-17T05:46:50.533972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.34","version":"0'0","reported_seq":10,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-17T05:46:51.558821+0000","last_change":"2024-09-17T05:46:51.556088+0000","last_active":"2024-09-17T05:46:51.558821+0000","last_peered":"2024-09-17T05:46:51.558821+0000","last_clean":"2024-09-17T05:46:51.558821+0000","last_became_active":"2024-09-17T05:46:51.555380+0000","last_became_peered":"2024-09-17T05:46:51.555380+0000","last_unstale":"2024-09-17T05:46:51.558821+0000","last_undegraded":"2024-09-17T05:46:51.558821+0000","last_fullsized":"2024-09-17T05:46:51.558821+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:46:50.533972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:46:50.533972+0000","last_clean_scrub_stamp":"2024-09-17T05:46:50.533972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:18:33.728461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.33","version":"0'0","reported_seq":13,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-17T05:46:52.574767+0000","last_change":"2024-09-17T05:46:51.570802+0000","last_active":"2024-09-17T05:46:52.574767+0000","last_peered":"2024-09-17T05:46:52.574767+0000","last_clean":"2024-09-17T05:46:52.574767+0000","last_became_active":"2024-09-17T05:46:51.570412+0000","last_became_peered":"2024-09-17T05:46:51.570412+0000","last_unstale":"2024-09-17T05:46:52.574767+0000","last_undegraded":"2024-09-17T05:46:52.574767+0000","last_fullsized":"2024-09-17T05:46:52.574767+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:46:50.533972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:46:50.533972+0000","last_clean_scrub_stamp":"2024-09-17T05:46:50.533972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:31:15.619388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.32","version":"0'0","reported_seq":10,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-17T05:46:51.567612+0000","last_change":"2024-09-17T05:46:51.565282+0000","last_active":"2024-09-17T05:46:51.567612+0000","last_peered":"2024-09-17T05:46:51.567612+0000","last_clean":"2024-09-17T05:46:51.567612+0000","last_became_active":"2024-09-17T05:46:51.564899+0000","last_became_peered":"2024-09-17T05:46:51.564899+0000","last_unstale":"2024-09-17T05:46:51.567612+0000","last_undegraded":"2024-09-17T05:46:51.567612+0000","last_fullsized":"2024-09-17T05:46:51.567612+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:46:50.533972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:46:50.533972+0000","last_clean_scrub_stamp":"2024-09-17T05:46:50.533972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:50:16.046843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.31","version":"0'0","reported_seq":13,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-17T05:46:52.574510+0000","last_change":"2024-09-17T05:46:51.561117+0000","last_active":"2024-09-17T05:46:52.574510+0000","last_peered":"2024-09-17T05:46:52.574510+0000","last_clean":"2024-09-17T05:46:52.574510+0000","last_became_active":"2024-09-17T05:46:51.560823+0000","last_became_peered":"2024-09-17T05:46:51.560823+0000","last_unstale":"2024-09-17T05:46:52.574510+0000","last_undegraded":"2024-09-17T05:46:52.574510+0000","last_fullsized":"2024-09-17T05:46:52.574510+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:46:50.533972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:46:50.533972+0000","last_clean_scrub_stamp":"2024-09-17T05:46:50.533972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:47:50.985506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.30","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2024-09-17T05:46:50.540400+0000","last_change":"2024-09-17T05:46:50.540400+0000","last_active":"2024-09-17T05:46:50.533972+0000","last_peered":"2024-09-17T05:46:50.533972+0000","last_clean":"2024-09-17T05:46:50.533972+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:46:50.540400+0000","last_undegraded":"2024-09-17T05:46:50.540400+0000","last_fullsized":"2024-09-17T05:46:50.540400+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:46:50.533972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:46:50.533972+0000","last_clean_scrub_stamp":"2024-09-17T05:46:50.533972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.2f","version":"0'0","reported_seq":10,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-17T05:46:51.565674+0000","last_change":"2024-09-17T05:46:51.563745+0000","last_active":"2024-09-17T05:46:51.565674+0000","last_peered":"2024-09-17T05:46:51.565674+0000","last_clean":"2024-09-17T05:46:51.565674+0000","last_became_active":"2024-09-17T05:46:51.562341+0000","last_became_peered":"2024-09-17T05:46:51.562341+0000","last_unstale":"2024-09-17T05:46:51.565674+0000","last_undegraded":"2024-09-17T05:46:51.565674+0000","last_fullsized":"2024-09-17T05:46:51.565674+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:46:50.533972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:46:50.533972+0000","last_clean_scrub_stamp":"2024-09-17T05:46:50.533972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:08:34.355357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.2e","version":"0'0","reported_seq":10,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-17T05:46:51.576447+0000","last_change":"2024-09-17T05:46:51.575409+0000","last_active":"2024-09-17T05:46:51.576447+0000","last_peered":"2024-09-17T05:46:51.576447+0000","last_clean":"2024-09-17T05:46:51.576447+0000","last_became_active":"2024-09-17T05:46:51.575064+0000","last_became_peered":"2024-09-17T05:46:51.575064+0000","last_unstale":"2024-09-17T05:46:51.576447+0000","last_undegraded":"2024-09-17T05:46:51.576447+0000","last_fullsized":"2024-09-17T05:46:51.576447+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:46:50.533972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:46:50.533972+0000","last_clean_scrub_stamp":"2024-09-17T05:46:50.533972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:15:23.712248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.2d","version":"0'0","reported_seq":10,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-17T05:46:51.583515+0000","last_change":"2024-09-17T05:46:51.578864+0000","last_active":"2024-09-17T05:46:51.583515+0000","last_peered":"2024-09-17T05:46:51.583515+0000","last_clean":"2024-09-17T05:46:51.583515+0000","last_became_active":"2024-09-17T05:46:51.578508+0000","last_became_peered":"2024-09-17T05:46:51.578508+0000","last_unstale":"2024-09-17T05:46:51.583515+0000","last_undegraded":"2024-09-17T05:46:51.583515+0000","last_fullsized":"2024-09-17T05:46:51.583515+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:46:50.533972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:46:50.533972+0000","last_clean_scrub_stamp":"2024-09-17T05:46:50.533972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:36:16.964919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.2c","version":"0'0","reported_seq":13,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-17T05:46:52.574643+0000","last_change":"2024-09-17T05:46:51.564642+0000","last_active":"2024-09-17T05:46:52.574643+0000","last_peered":"2024-09-17T05:46:52.574643+0000","last_clean":"2024-09-17T05:46:52.574643+0000","last_became_active":"2024-09-17T05:46:51.564341+0000","last_became_peered":"2024-09-17T05:46:51.564341+0000","last_unstale":"2024-09-17T05:46:52.574643+0000","last_undegraded":"2024-09-17T05:46:52.574643+0000","last_fullsized":"2024-09-17T05:46:52.574643+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:46:50.533972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:46:50.533972+0000","last_clean_scrub_stamp":"2024-09-17T05:46:50.533972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:32:36.148692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.2b","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2024-09-17T05:46:50.541483+0000","last_change":"2024-09-17T05:46:50.541483+0000","last_active":"2024-09-17T05:46:50.533972+0000","last_peered":"2024-09-17T05:46:50.533972+0000","last_clean":"2024-09-17T05:46:50.533972+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:46:50.541483+0000","last_undegraded":"2024-09-17T05:46:50.541483+0000","last_fullsized":"2024-09-17T05:46:50.541483+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:46:50.533972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:46:50.533972+0000","last_clean_scrub_stamp":"2024-09-17T05:46:50.533972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.2a","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2024-09-17T05:46:50.542828+0000","last_change":"2024-09-17T05:46:50.542828+0000","last_active":"2024-09-17T05:46:50.533972+0000","last_peered":"2024-09-17T05:46:50.533972+0000","last_clean":"2024-09-17T05:46:50.533972+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:46:50.542828+0000","last_undegraded":"2024-09-17T05:46:50.542828+0000","last_fullsized":"2024-09-17T05:46:50.542828+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:46:50.533972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:46:50.533972+0000","last_clean_scrub_stamp":"2024-09-17T05:46:50.533972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.29","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2024-09-17T05:46:50.545977+0000","last_change":"2024-09-17T05:46:50.545977+0000","last_active":"2024-09-17T05:46:50.533972+0000","last_peered":"2024-09-17T05:46:50.533972+0000","last_clean":"2024-09-17T05:46:50.533972+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:46:50.545977+0000","last_undegraded":"2024-09-17T05:46:50.545977+0000","last_fullsized":"2024-09-17T05:46:50.545977+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:46:50.533972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:46:50.533972+0000","last_clean_scrub_stamp":"2024-09-17T05:46:50.533972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.28","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2024-09-17T05:46:50.550694+0000","last_change":"2024-09-17T05:46:50.550694+0000","last_active":"2024-09-17T05:46:50.533972+0000","last_peered":"2024-09-17T05:46:50.533972+0000","last_clean":"2024-09-17T05:46:50.533972+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:46:50.550694+0000","last_undegraded":"2024-09-17T05:46:50.550694+0000","last_fullsized":"2024-09-17T05:46:50.550694+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:46:50.533972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:46:50.533972+0000","last_clean_scrub_stamp":"2024-09-17T05:46:50.533972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.27","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2024-09-17T05:46:50.543035+0000","last_change":"2024-09-17T05:46:50.543035+0000","last_active":"2024-09-17T05:46:50.533972+0000","last_peered":"2024-09-17T05:46:50.533972+0000","last_clean":"2024-09-17T05:46:50.533972+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:46:50.543035+0000","last_undegraded":"2024-09-17T05:46:50.543035+0000","last_fullsized":"2024-09-17T05:46:50.543035+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:46:50.533972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:46:50.533972+0000","last_clean_scrub_stamp":"2024-09-17T05:46:50.533972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.26","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2024-09-17T05:46:50.541785+0000","last_change":"2024-09-17T05:46:50.541785+0000","last_active":"2024-09-17T05:46:50.533972+0000","last_peered":"2024-09-17T05:46:50.533972+0000","last_clean":"2024-09-17T05:46:50.533972+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:46:50.541785+0000","last_undegraded":"2024-09-17T05:46:50.541785+0000","last_fullsized":"2024-09-17T05:46:50.541785+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:46:50.533972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:46:50.533972+0000","last_clean_scrub_stamp":"2024-09-17T05:46:50.533972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.25","version":"0'0","reported_seq":10,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-17T05:46:51.568180+0000","last_change":"2024-09-17T05:46:51.566344+0000","last_active":"2024-09-17T05:46:51.568180+0000","last_peered":"2024-09-17T05:46:51.568180+0000","last_clean":"2024-09-17T05:46:51.568180+0000","last_became_active":"2024-09-17T05:46:51.564652+0000","last_became_peered":"2024-09-17T05:46:51.564652+0000","last_unstale":"2024-09-17T05:46:51.568180+0000","last_undegraded":"2024-09-17T05:46:51.568180+0000","last_fullsized":"2024-09-17T05:46:51.568180+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:46:50.533972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:46:50.533972+0000","last_clean_scrub_stamp":"2024-09-17T05:46:50.533972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:27:02.406829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.24","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2024-09-17T05:46:50.542382+0000","last_change":"2024-09-17T05:46:50.542382+0000","last_active":"2024-09-17T05:46:50.533972+0000","last_peered":"2024-09-17T05:46:50.533972+0000","last_clean":"2024-09-17T05:46:50.533972+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:46:50.542382+0000","last_undegraded":"2024-09-17T05:46:50.542382+0000","last_fullsized":"2024-09-17T05:46:50.542382+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:46:50.533972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:46:50.533972+0000","last_clean_scrub_stamp":"2024-09-17T05:46:50.533972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.23","version":"0'0","reported_seq":10,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-17T05:46:51.567854+0000","last_change":"2024-09-17T05:46:51.564915+0000","last_active":"2024-09-17T05:46:51.567854+0000","last_peered":"2024-09-17T05:46:51.567854+0000","last_clean":"2024-09-17T05:46:51.567854+0000","last_became_active":"2024-09-17T05:46:51.564611+0000","last_became_peered":"2024-09-17T05:46:51.564611+0000","last_unstale":"2024-09-17T05:46:51.567854+0000","last_undegraded":"2024-09-17T05:46:51.567854+0000","last_fullsized":"2024-09-17T05:46:51.567854+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:46:50.533972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:46:50.533972+0000","last_clean_scrub_stamp":"2024-09-17T05:46:50.533972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:09:33.099629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.22","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2024-09-17T05:46:50.541871+0000","last_change":"2024-09-17T05:46:50.541871+0000","last_active":"2024-09-17T05:46:50.533972+0000","last_peered":"2024-09-17T05:46:50.533972+0000","last_clean":"2024-09-17T05:46:50.533972+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:46:50.541871+0000","last_undegraded":"2024-09-17T05:46:50.541871+0000","last_fullsized":"2024-09-17T05:46:50.541871+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:46:50.533972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:46:50.533972+0000","last_clean_scrub_stamp":"2024-09-17T05:46:50.533972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.21","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2024-09-17T05:46:50.539907+0000","last_change":"2024-09-17T05:46:50.539907+0000","last_active":"2024-09-17T05:46:50.533972+0000","last_peered":"2024-09-17T05:46:50.533972+0000","last_clean":"2024-09-17T05:46:50.533972+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:46:50.539907+0000","last_undegraded":"2024-09-17T05:46:50.539907+0000","last_fullsized":"2024-09-17T05:46:50.539907+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:46:50.533972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:46:50.533972+0000","last_clean_scrub_stamp":"2024-09-17T05:46:50.533972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.20","version":"0'0","reported_seq":10,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-17T05:46:51.580457+0000","last_change":"2024-09-17T05:46:51.577607+0000","last_active":"2024-09-17T05:46:51.580457+0000","last_peered":"2024-09-17T05:46:51.580457+0000","last_clean":"2024-09-17T05:46:51.580457+0000","last_became_active":"2024-09-17T05:46:51.576279+0000","last_became_peered":"2024-09-17T05:46:51.576279+0000","last_unstale":"2024-09-17T05:46:51.580457+0000","last_undegraded":"2024-09-17T05:46:51.580457+0000","last_fullsized":"2024-09-17T05:46:51.580457+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:46:50.533972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:46:50.533972+0000","last_clean_scrub_stamp":"2024-09-17T05:46:50.533972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:35:43.534736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.1e","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2024-09-17T05:46:50.546452+0000","last_change":"2024-09-17T05:46:50.546452+0000","last_active":"2024-09-17T05:46:50.533972+0000","last_peered":"2024-09-17T05:46:50.533972+0000","last_clean":"2024-09-17T05:46:50.533972+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:46:50.546452+0000","last_undegraded":"2024-09-17T05:46:50.546452+0000","last_fullsized":"2024-09-17T05:46:50.546452+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:46:50.533972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:46:50.533972+0000","last_clean_scrub_stamp":"2024-09-17T05:46:50.533972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1f","version":"0'0","reported_seq":10,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-09-17T05:46:50.559376+0000","last_change":"2024-09-17T05:46:50.558694+0000","last_active":"2024-09-17T05:46:50.559376+0000","last_peered":"2024-09-17T05:46:50.559376+0000","last_clean":"2024-09-17T05:46:50.559376+0000","last_became_active":"2024-09-17T05:46:50.557228+0000","last_became_peered":"2024-09-17T05:46:50.557228+0000","last_unstale":"2024-09-17T05:46:50.559376+0000","last_undegraded":"2024-09-17T05:46:50.559376+0000","last_fullsized":"2024-09-17T05:46:50.559376+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:46:49.528019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:46:49.528019+0000","last_clean_scrub_stamp":"2024-09-17T05:46:49.528019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:31:03.053588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.1f","version":"0'0","reported_seq":10,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-17T05:46:51.565606+0000","last_change":"2024-09-17T05:46:51.562813+0000","last_active":"2024-09-17T05:46:51.565606+0000","last_peered":"2024-09-17T05:46:51.565606+0000","last_clean":"2024-09-17T05:46:51.565606+0000","last_became_active":"2024-09-17T05:46:51.562079+0000","last_became_peered":"2024-09-17T05:46:51.562079+0000","last_unstale":"2024-09-17T05:46:51.565606+0000","last_undegraded":"2024-09-17T05:46:51.565606+0000","last_fullsized":"2024-09-17T05:46:51.565606+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:46:50.533972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:46:50.533972+0000","last_clean_scrub_stamp":"2024-09-17T05:46:50.533972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:05:18.413938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.1e","version":"71'1","reported_seq":16,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-17T05:46:52.574660+0000","last_change":"2024-09-17T05:46:50.552744+0000","last_active":"2024-09-17T05:46:52.574660+0000","last_peered":"2024-09-17T05:46:52.574660+0000","last_clean":"2024-09-17T05:46:52.574660+0000","last_became_active":"2024-09-17T05:46:50.551757+0000","last_became_peered":"2024-09-17T05:46:50.551757+0000","last_unstale":"2024-09-17T05:46:52.574660+0000","last_undegraded":"2024-09-17T05:46:52.574660+0000","last_fullsized":"2024-09-17T05:46:52.574660+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:46:49.528019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:46:49.528019+0000","last_clean_scrub_stamp":"2024-09-17T05:46:49.528019+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:10:23.845161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1c","version":"0'0","reported_seq":10,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-17T05:46:51.582656+0000","last_change":"2024-09-17T05:46:51.581452+0000","last_active":"2024-09-17T05:46:51.582656+0000","last_peered":"2024-09-17T05:46:51.582656+0000","last_clean":"2024-09-17T05:46:51.582656+0000","last_became_active":"2024-09-17T05:46:51.581056+0000","last_became_peered":"2024-09-17T05:46:51.581056+0000","last_unstale":"2024-09-17T05:46:51.582656+0000","last_undegraded":"2024-09-17T05:46:51.582656+0000","last_fullsized":"2024-09-17T05:46:51.582656+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:46:50.533972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:46:50.533972+0000","last_clean_scrub_stamp":"2024-09-17T05:46:50.533972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:49:54.442500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.1d","version":"0'0","reported_seq":10,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-09-17T05:46:50.559325+0000","last_change":"2024-09-17T05:46:50.558321+0000","last_active":"2024-09-17T05:46:50.559325+0000","last_peered":"2024-09-17T05:46:50.559325+0000","last_clean":"2024-09-17T05:46:50.559325+0000","last_became_active":"2024-09-17T05:46:50.557997+0000","last_became_peered":"2024-09-17T05:46:50.557997+0000","last_unstale":"2024-09-17T05:46:50.559325+0000","last_undegraded":"2024-09-17T05:46:50.559325+0000","last_fullsized":"2024-09-17T05:46:50.559325+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:46:49.528019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:46:49.528019+0000","last_clean_scrub_stamp":"2024-09-17T05:46:49.528019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:48:03.906981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1d","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2024-09-17T05:46:50.552264+0000","last_change":"2024-09-17T05:46:50.552264+0000","last_active":"2024-09-17T05:46:50.533972+0000","last_peered":"2024-09-17T05:46:50.533972+0000","last_clean":"2024-09-17T05:46:50.533972+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:46:50.552264+0000","last_undegraded":"2024-09-17T05:46:50.552264+0000","last_fullsized":"2024-09-17T05:46:50.552264+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:46:50.533972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:46:50.533972+0000","last_clean_scrub_stamp":"2024-09-17T05:46:50.533972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1c","version":"71'2","reported_seq":15,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-17T05:46:51.586077+0000","last_change":"2024-09-17T05:46:50.555340+0000","last_active":"2024-09-17T05:46:51.586077+0000","last_peered":"2024-09-17T05:46:51.586077+0000","last_clean":"2024-09-17T05:46:51.586077+0000","last_became_active":"2024-09-17T05:46:50.554957+0000","last_became_peered":"2024-09-17T05:46:50.554957+0000","last_unstale":"2024-09-17T05:46:51.586077+0000","last_undegraded":"2024-09-17T05:46:51.586077+0000","last_fullsized":"2024-09-17T05:46:51.586077+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:46:49.528019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:46:49.528019+0000","last_clean_scrub_stamp":"2024-09-17T05:46:49.528019+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:39:19.804580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.1a","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2024-09-17T05:46:50.541001+0000","last_change":"2024-09-17T05:46:50.541001+0000","last_active":"2024-09-17T05:46:50.533972+0000","last_peered":"2024-09-17T05:46:50.533972+0000","last_clean":"2024-09-17T05:46:50.533972+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:46:50.541001+0000","last_undegraded":"2024-09-17T05:46:50.541001+0000","last_fullsized":"2024-09-17T05:46:50.541001+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:46:50.533972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:46:50.533972+0000","last_clean_scrub_stamp":"2024-09-17T05:46:50.533972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.1b","version":"71'1","reported_seq":14,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-17T05:46:51.583973+0000","last_change":"2024-09-17T05:46:50.554024+0000","last_active":"2024-09-17T05:46:51.583973+0000","last_peered":"2024-09-17T05:46:51.583973+0000","last_clean":"2024-09-17T05:46:51.583973+0000","last_became_active":"2024-09-17T05:46:50.553651+0000","last_became_peered":"2024-09-17T05:46:50.553651+0000","last_unstale":"2024-09-17T05:46:51.583973+0000","last_undegraded":"2024-09-17T05:46:51.583973+0000","last_fullsized":"2024-09-17T05:46:51.583973+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:46:49.528019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:46:49.528019+0000","last_clean_scrub_stamp":"2024-09-17T05:46:49.528019+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:08:30.756585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.1b","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2024-09-17T05:46:50.541004+0000","last_change":"2024-09-17T05:46:50.541004+0000","last_active":"2024-09-17T05:46:50.533972+0000","last_peered":"2024-09-17T05:46:50.533972+0000","last_clean":"2024-09-17T05:46:50.533972+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:46:50.541004+0000","last_undegraded":"2024-09-17T05:46:50.541004+0000","last_fullsized":"2024-09-17T05:46:50.541004+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:46:50.533972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:46:50.533972+0000","last_clean_scrub_stamp":"2024-09-17T05:46:50.533972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.1a","version":"71'1","reported_seq":14,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-17T05:46:51.585449+0000","last_change":"2024-09-17T05:46:50.561274+0000","last_active":"2024-09-17T05:46:51.585449+0000","last_peered":"2024-09-17T05:46:51.585449+0000","last_clean":"2024-09-17T05:46:51.585449+0000","last_became_active":"2024-09-17T05:46:50.560729+0000","last_became_peered":"2024-09-17T05:46:50.560729+0000","last_unstale":"2024-09-17T05:46:51.585449+0000","last_undegraded":"2024-09-17T05:46:51.585449+0000","last_fullsized":"2024-09-17T05:46:51.585449+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:46:49.528019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:46:49.528019+0000","last_clean_scrub_stamp":"2024-09-17T05:46:49.528019+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:46:48.701238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.18","version":"0'0","reported_seq":10,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-17T05:46:51.569374+0000","last_change":"2024-09-17T05:46:51.568431+0000","last_active":"2024-09-17T05:46:51.569374+0000","last_peered":"2024-09-17T05:46:51.569374+0000","last_clean":"2024-09-17T05:46:51.569374+0000","last_became_active":"2024-09-17T05:46:51.568066+0000","last_became_peered":"2024-09-17T05:46:51.568066+0000","last_unstale":"2024-09-17T05:46:51.569374+0000","last_undegraded":"2024-09-17T05:46:51.569374+0000","last_fullsized":"2024-09-17T05:46:51.569374+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:46:50.533972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:46:50.533972+0000","last_clean_scrub_stamp":"2024-09-17T05:46:50.533972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:12:15.570105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.19","version":"0'0","reported_seq":13,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-17T05:46:51.550635+0000","last_change":"2024-09-17T05:46:50.552167+0000","last_active":"2024-09-17T05:46:51.550635+0000","last_peered":"2024-09-17T05:46:51.550635+0000","last_clean":"2024-09-17T05:46:51.550635+0000","last_became_active":"2024-09-17T05:46:50.551856+0000","last_became_peered":"2024-09-17T05:46:50.551856+0000","last_unstale":"2024-09-17T05:46:51.550635+0000","last_undegraded":"2024-09-17T05:46:51.550635+0000","last_fullsized":"2024-09-17T05:46:51.550635+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:46:49.528019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:46:49.528019+0000","last_clean_scrub_stamp":"2024-09-17T05:46:49.528019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:23:08.023320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.19","version":"0'0","reported_seq":13,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-17T05:46:52.574533+0000","last_change":"2024-09-17T05:46:51.569311+0000","last_active":"2024-09-17T05:46:52.574533+0000","last_peered":"2024-09-17T05:46:52.574533+0000","last_clean":"2024-09-17T05:46:52.574533+0000","last_became_active":"2024-09-17T05:46:51.569013+0000","last_became_peered":"2024-09-17T05:46:51.569013+0000","last_unstale":"2024-09-17T05:46:52.574533+0000","last_undegraded":"2024-09-17T05:46:52.574533+0000","last_fullsized":"2024-09-17T05:46:52.574533+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:46:50.533972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:46:50.533972+0000","last_clean_scrub_stamp":"2024-09-17T05:46:50.533972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:28:30.156588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.18","version":"0'0","reported_seq":13,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-17T05:46:51.552307+0000","last_change":"2024-09-17T05:46:50.552379+0000","last_active":"2024-09-17T05:46:51.552307+0000","last_peered":"2024-09-17T05:46:51.552307+0000","last_clean":"2024-09-17T05:46:51.552307+0000","last_became_active":"2024-09-17T05:46:50.552079+0000","last_became_peered":"2024-09-17T05:46:50.552079+0000","last_unstale":"2024-09-17T05:46:51.552307+0000","last_undegraded":"2024-09-17T05:46:51.552307+0000","last_fullsized":"2024-09-17T05:46:51.552307+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:46:49.528019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:46:49.528019+0000","last_clean_scrub_stamp":"2024-09-17T05:46:49.528019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:56:26.674599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.16","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2024-09-17T05:46:50.540731+0000","last_change":"2024-09-17T05:46:50.540731+0000","last_active":"2024-09-17T05:46:50.533972+0000","last_peered":"2024-09-17T05:46:50.533972+0000","last_clean":"2024-09-17T05:46:50.533972+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:46:50.540731+0000","last_undegraded":"2024-09-17T05:46:50.540731+0000","last_fullsized":"2024-09-17T05:46:50.540731+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:46:50.533972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:46:50.533972+0000","last_clean_scrub_stamp":"2024-09-17T05:46:50.533972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.17","version":"0'0","reported_seq":10,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-09-17T05:46:50.557304+0000","last_change":"2024-09-17T05:46:50.550428+0000","last_active":"2024-09-17T05:46:50.557304+0000","last_peered":"2024-09-17T05:46:50.557304+0000","last_clean":"2024-09-17T05:46:50.557304+0000","last_became_active":"2024-09-17T05:46:50.549751+0000","last_became_peered":"2024-09-17T05:46:50.549751+0000","last_unstale":"2024-09-17T05:46:50.557304+0000","last_undegraded":"2024-09-17T05:46:50.557304+0000","last_fullsized":"2024-09-17T05:46:50.557304+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:46:49.528019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:46:49.528019+0000","last_clean_scrub_stamp":"2024-09-17T05:46:49.528019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:03:27.946146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.17","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2024-09-17T05:46:50.546958+0000","last_change":"2024-09-17T05:46:50.546958+0000","last_active":"2024-09-17T05:46:50.533972+0000","last_peered":"2024-09-17T05:46:50.533972+0000","last_clean":"2024-09-17T05:46:50.533972+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:46:50.546958+0000","last_undegraded":"2024-09-17T05:46:50.546958+0000","last_fullsized":"2024-09-17T05:46:50.546958+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:46:50.533972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:46:50.533972+0000","last_clean_scrub_stamp":"2024-09-17T05:46:50.533972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.16","version":"0'0","reported_seq":13,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-17T05:46:51.565295+0000","last_change":"2024-09-17T05:46:50.556469+0000","last_active":"2024-09-17T05:46:51.565295+0000","last_peered":"2024-09-17T05:46:51.565295+0000","last_clean":"2024-09-17T05:46:51.565295+0000","last_became_active":"2024-09-17T05:46:50.555925+0000","last_became_peered":"2024-09-17T05:46:50.555925+0000","last_unstale":"2024-09-17T05:46:51.565295+0000","last_undegraded":"2024-09-17T05:46:51.565295+0000","last_fullsized":"2024-09-17T05:46:51.565295+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:46:49.528019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:46:49.528019+0000","last_clean_scrub_stamp":"2024-09-17T05:46:49.528019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:11:55.261702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.14","version":"0'0","reported_seq":10,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-17T05:46:51.581701+0000","last_change":"2024-09-17T05:46:51.579751+0000","last_active":"2024-09-17T05:46:51.581701+0000","last_peered":"2024-09-17T05:46:51.581701+0000","last_clean":"2024-09-17T05:46:51.581701+0000","last_became_active":"2024-09-17T05:46:51.579430+0000","last_became_peered":"2024-09-17T05:46:51.579430+0000","last_unstale":"2024-09-17T05:46:51.581701+0000","last_undegraded":"2024-09-17T05:46:51.581701+0000","last_fullsized":"2024-09-17T05:46:51.581701+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:46:50.533972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:46:50.533972+0000","last_clean_scrub_stamp":"2024-09-17T05:46:50.533972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:59:19.488416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.15","version":"71'3","reported_seq":16,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-17T05:46:51.579084+0000","last_change":"2024-09-17T05:46:50.552409+0000","last_active":"2024-09-17T05:46:51.579084+0000","last_peered":"2024-09-17T05:46:51.579084+0000","last_clean":"2024-09-17T05:46:51.579084+0000","last_became_active":"2024-09-17T05:46:50.551178+0000","last_became_peered":"2024-09-17T05:46:50.551178+0000","last_unstale":"2024-09-17T05:46:51.579084+0000","last_undegraded":"2024-09-17T05:46:51.579084+0000","last_fullsized":"2024-09-17T05:46:51.579084+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:46:49.528019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:46:49.528019+0000","last_clean_scrub_stamp":"2024-09-17T05:46:49.528019+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:29:57.514758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.15","version":"0'0","reported_seq":10,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-17T05:46:51.557879+0000","last_change":"2024-09-17T05:46:51.555771+0000","last_active":"2024-09-17T05:46:51.557879+0000","last_peered":"2024-09-17T05:46:51.557879+0000","last_clean":"2024-09-17T05:46:51.557879+0000","last_became_active":"2024-09-17T05:46:51.555470+0000","last_became_peered":"2024-09-17T05:46:51.555470+0000","last_unstale":"2024-09-17T05:46:51.557879+0000","last_undegraded":"2024-09-17T05:46:51.557879+0000","last_fullsized":"2024-09-17T05:46:51.557879+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:46:50.533972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:46:50.533972+0000","last_clean_scrub_stamp":"2024-09-17T05:46:50.533972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:14:34.283104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.14","version":"71'6","reported_seq":19,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-17T05:46:51.586126+0000","last_change":"2024-09-17T05:46:50.553143+0000","last_active":"2024-09-17T05:46:51.586126+0000","last_peered":"2024-09-17T05:46:51.586126+0000","last_clean":"2024-09-17T05:46:51.586126+0000","last_became_active":"2024-09-17T05:46:50.552549+0000","last_became_peered":"2024-09-17T05:46:50.552549+0000","last_unstale":"2024-09-17T05:46:51.586126+0000","last_undegraded":"2024-09-17T05:46:51.586126+0000","last_fullsized":"2024-09-17T05:46:51.586126+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:46:49.528019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:46:49.528019+0000","last_clean_scrub_stamp":"2024-09-17T05:46:49.528019+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:04:38.547894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.12","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2024-09-17T05:46:50.545558+0000","last_change":"2024-09-17T05:46:50.545558+0000","last_active":"2024-09-17T05:46:50.533972+0000","last_peered":"2024-09-17T05:46:50.533972+0000","last_clean":"2024-09-17T05:46:50.533972+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:46:50.545558+0000","last_undegraded":"2024-09-17T05:46:50.545558+0000","last_fullsized":"2024-09-17T05:46:50.545558+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:46:50.533972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:46:50.533972+0000","last_clean_scrub_stamp":"2024-09-17T05:46:50.533972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.13","version":"71'2","reported_seq":15,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-17T05:46:51.577782+0000","last_change":"2024-09-17T05:46:50.553892+0000","last_active":"2024-09-17T05:46:51.577782+0000","last_peered":"2024-09-17T05:46:51.577782+0000","last_clean":"2024-09-17T05:46:51.577782+0000","last_became_active":"2024-09-17T05:46:50.553567+0000","last_became_peered":"2024-09-17T05:46:50.553567+0000","last_unstale":"2024-09-17T05:46:51.577782+0000","last_undegraded":"2024-09-17T05:46:51.577782+0000","last_fullsized":"2024-09-17T05:46:51.577782+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:46:49.528019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:46:49.528019+0000","last_clean_scrub_stamp":"2024-09-17T05:46:49.528019+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:16:32.532491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.13","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2024-09-17T05:46:50.541871+0000","last_change":"2024-09-17T05:46:50.541871+0000","last_active":"2024-09-17T05:46:50.533972+0000","last_peered":"2024-09-17T05:46:50.533972+0000","last_clean":"2024-09-17T05:46:50.533972+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:46:50.541871+0000","last_undegraded":"2024-09-17T05:46:50.541871+0000","last_fullsized":"2024-09-17T05:46:50.541871+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:46:50.533972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:46:50.533972+0000","last_clean_scrub_stamp":"2024-09-17T05:46:50.533972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.12","version":"0'0","reported_seq":13,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-17T05:46:51.567763+0000","last_change":"2024-09-17T05:46:50.557441+0000","last_active":"2024-09-17T05:46:51.567763+0000","last_peered":"2024-09-17T05:46:51.567763+0000","last_clean":"2024-09-17T05:46:51.567763+0000","last_became_active":"2024-09-17T05:46:50.557121+0000","last_became_peered":"2024-09-17T05:46:50.557121+0000","last_unstale":"2024-09-17T05:46:51.567763+0000","last_undegraded":"2024-09-17T05:46:51.567763+0000","last_fullsized":"2024-09-17T05:46:51.567763+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:46:49.528019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:46:49.528019+0000","last_clean_scrub_stamp":"2024-09-17T05:46:49.528019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:52:52.514589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.10","version":"0'0","reported_seq":13,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-17T05:46:52.574474+0000","last_change":"2024-09-17T05:46:51.580220+0000","last_active":"2024-09-17T05:46:52.574474+0000","last_peered":"2024-09-17T05:46:52.574474+0000","last_clean":"2024-09-17T05:46:52.574474+0000","last_became_active":"2024-09-17T05:46:51.579877+0000","last_became_peered":"2024-09-17T05:46:51.579877+0000","last_unstale":"2024-09-17T05:46:52.574474+0000","last_undegraded":"2024-09-17T05:46:52.574474+0000","last_fullsized":"2024-09-17T05:46:52.574474+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:46:50.533972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:46:50.533972+0000","last_clean_scrub_stamp":"2024-09-17T05:46:50.533972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:07:06.372655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.11","version":"0'0","reported_seq":10,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-09-17T05:46:50.550575+0000","last_change":"2024-09-17T05:46:50.549371+0000","last_active":"2024-09-17T05:46:50.550575+0000","last_peered":"2024-09-17T05:46:50.550575+0000","last_clean":"2024-09-17T05:46:50.550575+0000","last_became_active":"2024-09-17T05:46:50.548998+0000","last_became_peered":"2024-09-17T05:46:50.548998+0000","last_unstale":"2024-09-17T05:46:50.550575+0000","last_undegraded":"2024-09-17T05:46:50.550575+0000","last_fullsized":"2024-09-17T05:46:50.550575+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:46:49.528019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:46:49.528019+0000","last_clean_scrub_stamp":"2024-09-17T05:46:49.528019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:12:18.888931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.11","version":"0'0","reported_seq":10,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-17T05:46:51.564902+0000","last_change":"2024-09-17T05:46:51.562481+0000","last_active":"2024-09-17T05:46:51.564902+0000","last_peered":"2024-09-17T05:46:51.564902+0000","last_clean":"2024-09-17T05:46:51.564902+0000","last_became_active":"2024-09-17T05:46:51.562122+0000","last_became_peered":"2024-09-17T05:46:51.562122+0000","last_unstale":"2024-09-17T05:46:51.564902+0000","last_undegraded":"2024-09-17T05:46:51.564902+0000","last_fullsized":"2024-09-17T05:46:51.564902+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:46:50.533972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:46:50.533972+0000","last_clean_scrub_stamp":"2024-09-17T05:46:50.533972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:28:26.034113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.10","version":"0'0","reported_seq":10,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-09-17T05:46:50.557348+0000","last_change":"2024-09-17T05:46:50.552842+0000","last_active":"2024-09-17T05:46:50.557348+0000","last_peered":"2024-09-17T05:46:50.557348+0000","last_clean":"2024-09-17T05:46:50.557348+0000","last_became_active":"2024-09-17T05:46:50.552520+0000","last_became_peered":"2024-09-17T05:46:50.552520+0000","last_unstale":"2024-09-17T05:46:50.557348+0000","last_undegraded":"2024-09-17T05:46:50.557348+0000","last_fullsized":"2024-09-17T05:46:50.557348+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:46:49.528019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:46:49.528019+0000","last_clean_scrub_stamp":"2024-09-17T05:46:49.528019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:09:14.458610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.e","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2024-09-17T05:46:50.540783+0000","last_change":"2024-09-17T05:46:50.540783+0000","last_active":"2024-09-17T05:46:50.533972+0000","last_peered":"2024-09-17T05:46:50.533972+0000","last_clean":"2024-09-17T05:46:50.533972+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:46:50.540783+0000","last_undegraded":"2024-09-17T05:46:50.540783+0000","last_fullsized":"2024-09-17T05:46:50.540783+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:46:50.533972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:46:50.533972+0000","last_clean_scrub_stamp":"2024-09-17T05:46:50.533972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.f","version":"71'1","reported_seq":14,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-17T05:46:51.586405+0000","last_change":"2024-09-17T05:46:50.555496+0000","last_active":"2024-09-17T05:46:51.586405+0000","last_peered":"2024-09-17T05:46:51.586405+0000","last_clean":"2024-09-17T05:46:51.586405+0000","last_became_active":"2024-09-17T05:46:50.555176+0000","last_became_peered":"2024-09-17T05:46:50.555176+0000","last_unstale":"2024-09-17T05:46:51.586405+0000","last_undegraded":"2024-09-17T05:46:51.586405+0000","last_fullsized":"2024-09-17T05:46:51.586405+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:46:49.528019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:46:49.528019+0000","last_clean_scrub_stamp":"2024-09-17T05:46:49.528019+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:22:31.843476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.f","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2024-09-17T05:46:50.546409+0000","last_change":"2024-09-17T05:46:50.546409+0000","last_active":"2024-09-17T05:46:50.533972+0000","last_peered":"2024-09-17T05:46:50.533972+0000","last_clean":"2024-09-17T05:46:50.533972+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:46:50.546409+0000","last_undegraded":"2024-09-17T05:46:50.546409+0000","last_fullsized":"2024-09-17T05:46:50.546409+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:46:50.533972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:46:50.533972+0000","last_clean_scrub_stamp":"2024-09-17T05:46:50.533972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.e","version":"0'0","reported_seq":10,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-09-17T05:46:50.559698+0000","last_change":"2024-09-17T05:46:50.558925+0000","last_active":"2024-09-17T05:46:50.559698+0000","last_peered":"2024-09-17T05:46:50.559698+0000","last_clean":"2024-09-17T05:46:50.559698+0000","last_became_active":"2024-09-17T05:46:50.558622+0000","last_became_peered":"2024-09-17T05:46:50.558622+0000","last_unstale":"2024-09-17T05:46:50.559698+0000","last_undegraded":"2024-09-17T05:46:50.559698+0000","last_fullsized":"2024-09-17T05:46:50.559698+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:46:49.528019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:46:49.528019+0000","last_clean_scrub_stamp":"2024-09-17T05:46:49.528019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:06:48.504471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.c","version":"0'0","reported_seq":10,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-17T05:46:51.558979+0000","last_change":"2024-09-17T05:46:51.556516+0000","last_active":"2024-09-17T05:46:51.558979+0000","last_peered":"2024-09-17T05:46:51.558979+0000","last_clean":"2024-09-17T05:46:51.558979+0000","last_became_active":"2024-09-17T05:46:51.555785+0000","last_became_peered":"2024-09-17T05:46:51.555785+0000","last_unstale":"2024-09-17T05:46:51.558979+0000","last_undegraded":"2024-09-17T05:46:51.558979+0000","last_fullsized":"2024-09-17T05:46:51.558979+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:46:50.533972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:46:50.533972+0000","last_clean_scrub_stamp":"2024-09-17T05:46:50.533972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:09:00.267194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.d","version":"71'1","reported_seq":14,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-17T05:46:51.586143+0000","last_change":"2024-09-17T05:46:50.560558+0000","last_active":"2024-09-17T05:46:51.586143+0000","last_peered":"2024-09-17T05:46:51.586143+0000","last_clean":"2024-09-17T05:46:51.586143+0000","last_became_active":"2024-09-17T05:46:50.560242+0000","last_became_peered":"2024-09-17T05:46:50.560242+0000","last_unstale":"2024-09-17T05:46:51.586143+0000","last_undegraded":"2024-09-17T05:46:51.586143+0000","last_fullsized":"2024-09-17T05:46:51.586143+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:46:49.528019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:46:49.528019+0000","last_clean_scrub_stamp":"2024-09-17T05:46:49.528019+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:30:56.705724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.d","version":"0'0","reported_seq":10,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-17T05:46:51.558964+0000","last_change":"2024-09-17T05:46:51.557975+0000","last_active":"2024-09-17T05:46:51.558964+0000","last_peered":"2024-09-17T05:46:51.558964+0000","last_clean":"2024-09-17T05:46:51.558964+0000","last_became_active":"2024-09-17T05:46:51.557674+0000","last_became_peered":"2024-09-17T05:46:51.557674+0000","last_unstale":"2024-09-17T05:46:51.558964+0000","last_undegraded":"2024-09-17T05:46:51.558964+0000","last_fullsized":"2024-09-17T05:46:51.558964+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:46:50.533972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:46:50.533972+0000","last_clean_scrub_stamp":"2024-09-17T05:46:50.533972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:47:53.991131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.c","version":"0'0","reported_seq":10,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-09-17T05:46:50.559371+0000","last_change":"2024-09-17T05:46:50.558154+0000","last_active":"2024-09-17T05:46:50.559371+0000","last_peered":"2024-09-17T05:46:50.559371+0000","last_clean":"2024-09-17T05:46:50.559371+0000","last_became_active":"2024-09-17T05:46:50.557830+0000","last_became_peered":"2024-09-17T05:46:50.557830+0000","last_unstale":"2024-09-17T05:46:50.559371+0000","last_undegraded":"2024-09-17T05:46:50.559371+0000","last_fullsized":"2024-09-17T05:46:50.559371+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:46:49.528019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:46:49.528019+0000","last_clean_scrub_stamp":"2024-09-17T05:46:49.528019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:55:56.754700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.b","version":"0'0","reported_seq":10,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-17T05:46:51.566491+0000","last_change":"2024-09-17T05:46:51.559821+0000","last_active":"2024-09-17T05:46:51.566491+0000","last_peered":"2024-09-17T05:46:51.566491+0000","last_clean":"2024-09-17T05:46:51.566491+0000","last_became_active":"2024-09-17T05:46:51.559470+0000","last_became_peered":"2024-09-17T05:46:51.559470+0000","last_unstale":"2024-09-17T05:46:51.566491+0000","last_undegraded":"2024-09-17T05:46:51.566491+0000","last_fullsized":"2024-09-17T05:46:51.566491+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:46:50.533972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:46:50.533972+0000","last_clean_scrub_stamp":"2024-09-17T05:46:50.533972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:29:39.351334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.a","version":"0'0","reported_seq":13,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-17T05:46:51.568046+0000","last_change":"2024-09-17T05:46:50.561013+0000","last_active":"2024-09-17T05:46:51.568046+0000","last_peered":"2024-09-17T05:46:51.568046+0000","last_clean":"2024-09-17T05:46:51.568046+0000","last_became_active":"2024-09-17T05:46:50.560656+0000","last_became_peered":"2024-09-17T05:46:50.560656+0000","last_unstale":"2024-09-17T05:46:51.568046+0000","last_undegraded":"2024-09-17T05:46:51.568046+0000","last_fullsized":"2024-09-17T05:46:51.568046+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:46:49.528019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:46:49.528019+0000","last_clean_scrub_stamp":"2024-09-17T05:46:49.528019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:12:32.519550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.8","version":"0'0","reported_seq":10,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-17T05:46:51.581523+0000","last_change":"2024-09-17T05:46:51.579266+0000","last_active":"2024-09-17T05:46:51.581523+0000","last_peered":"2024-09-17T05:46:51.581523+0000","last_clean":"2024-09-17T05:46:51.581523+0000","last_became_active":"2024-09-17T05:46:51.578937+0000","last_became_peered":"2024-09-17T05:46:51.578937+0000","last_unstale":"2024-09-17T05:46:51.581523+0000","last_undegraded":"2024-09-17T05:46:51.581523+0000","last_fullsized":"2024-09-17T05:46:51.581523+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:46:50.533972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:46:50.533972+0000","last_clean_scrub_stamp":"2024-09-17T05:46:50.533972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:16:21.255512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.9","version":"0'0","reported_seq":10,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-09-17T05:46:50.556732+0000","last_change":"2024-09-17T05:46:50.555771+0000","last_active":"2024-09-17T05:46:50.556732+0000","last_peered":"2024-09-17T05:46:50.556732+0000","last_clean":"2024-09-17T05:46:50.556732+0000","last_became_active":"2024-09-17T05:46:50.555434+0000","last_became_peered":"2024-09-17T05:46:50.555434+0000","last_unstale":"2024-09-17T05:46:50.556732+0000","last_undegraded":"2024-09-17T05:46:50.556732+0000","last_fullsized":"2024-09-17T05:46:50.556732+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:46:49.528019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:46:49.528019+0000","last_clean_scrub_stamp":"2024-09-17T05:46:49.528019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:55:23.341829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.9","version":"0'0","reported_seq":10,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-17T05:46:51.579051+0000","last_change":"2024-09-17T05:46:51.576821+0000","last_active":"2024-09-17T05:46:51.579051+0000","last_peered":"2024-09-17T05:46:51.579051+0000","last_clean":"2024-09-17T05:46:51.579051+0000","last_became_active":"2024-09-17T05:46:51.576334+0000","last_became_peered":"2024-09-17T05:46:51.576334+0000","last_unstale":"2024-09-17T05:46:51.579051+0000","last_undegraded":"2024-09-17T05:46:51.579051+0000","last_fullsized":"2024-09-17T05:46:51.579051+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:46:50.533972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:46:50.533972+0000","last_clean_scrub_stamp":"2024-09-17T05:46:50.533972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:39:07.753207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.8","version":"0'0","reported_seq":15,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-17T05:46:52.574325+0000","last_change":"2024-09-17T05:46:50.554397+0000","last_active":"2024-09-17T05:46:52.574325+0000","last_peered":"2024-09-17T05:46:52.574325+0000","last_clean":"2024-09-17T05:46:52.574325+0000","last_became_active":"2024-09-17T05:46:50.554006+0000","last_became_peered":"2024-09-17T05:46:50.554006+0000","last_unstale":"2024-09-17T05:46:52.574325+0000","last_undegraded":"2024-09-17T05:46:52.574325+0000","last_fullsized":"2024-09-17T05:46:52.574325+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:46:49.528019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:46:49.528019+0000","last_clean_scrub_stamp":"2024-09-17T05:46:49.528019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:20:01.660902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.6","version":"0'0","reported_seq":13,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-17T05:46:52.574697+0000","last_change":"2024-09-17T05:46:51.563526+0000","last_active":"2024-09-17T05:46:52.574697+0000","last_peered":"2024-09-17T05:46:52.574697+0000","last_clean":"2024-09-17T05:46:52.574697+0000","last_became_active":"2024-09-17T05:46:51.562568+0000","last_became_peered":"2024-09-17T05:46:51.562568+0000","last_unstale":"2024-09-17T05:46:52.574697+0000","last_undegraded":"2024-09-17T05:46:52.574697+0000","last_fullsized":"2024-09-17T05:46:52.574697+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:46:50.533972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:46:50.533972+0000","last_clean_scrub_stamp":"2024-09-17T05:46:50.533972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:38:37.039701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.7","version":"71'2","reported_seq":15,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-17T05:46:51.586400+0000","last_change":"2024-09-17T05:46:50.556372+0000","last_active":"2024-09-17T05:46:51.586400+0000","last_peered":"2024-09-17T05:46:51.586400+0000","last_clean":"2024-09-17T05:46:51.586400+0000","last_became_active":"2024-09-17T05:46:50.556058+0000","last_became_peered":"2024-09-17T05:46:50.556058+0000","last_unstale":"2024-09-17T05:46:51.586400+0000","last_undegraded":"2024-09-17T05:46:51.586400+0000","last_fullsized":"2024-09-17T05:46:51.586400+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:46:49.528019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:46:49.528019+0000","last_clean_scrub_stamp":"2024-09-17T05:46:49.528019+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:32:09.112921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.7","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2024-09-17T05:46:50.539919+0000","last_change":"2024-09-17T05:46:50.539919+0000","last_active":"2024-09-17T05:46:50.533972+0000","last_peered":"2024-09-17T05:46:50.533972+0000","last_clean":"2024-09-17T05:46:50.533972+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:46:50.539919+0000","last_undegraded":"2024-09-17T05:46:50.539919+0000","last_fullsized":"2024-09-17T05:46:50.539919+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:46:50.533972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:46:50.533972+0000","last_clean_scrub_stamp":"2024-09-17T05:46:50.533972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.6","version":"0'0","reported_seq":10,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-09-17T05:46:50.547911+0000","last_change":"2024-09-17T05:46:50.544381+0000","last_active":"2024-09-17T05:46:50.547911+0000","last_peered":"2024-09-17T05:46:50.547911+0000","last_clean":"2024-09-17T05:46:50.547911+0000","last_became_active":"2024-09-17T05:46:50.543986+0000","last_became_peered":"2024-09-17T05:46:50.543986+0000","last_unstale":"2024-09-17T05:46:50.547911+0000","last_undegraded":"2024-09-17T05:46:50.547911+0000","last_fullsized":"2024-09-17T05:46:50.547911+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:46:49.528019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:46:49.528019+0000","last_clean_scrub_stamp":"2024-09-17T05:46:49.528019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:28:08.120187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.4","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2024-09-17T05:46:50.546088+0000","last_change":"2024-09-17T05:46:50.546088+0000","last_active":"2024-09-17T05:46:50.533972+0000","last_peered":"2024-09-17T05:46:50.533972+0000","last_clean":"2024-09-17T05:46:50.533972+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:46:50.546088+0000","last_undegraded":"2024-09-17T05:46:50.546088+0000","last_fullsized":"2024-09-17T05:46:50.546088+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:46:50.533972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:46:50.533972+0000","last_clean_scrub_stamp":"2024-09-17T05:46:50.533972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.5","version":"0'0","reported_seq":13,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-17T05:46:51.552653+0000","last_change":"2024-09-17T05:46:50.549973+0000","last_active":"2024-09-17T05:46:51.552653+0000","last_peered":"2024-09-17T05:46:51.552653+0000","last_clean":"2024-09-17T05:46:51.552653+0000","last_became_active":"2024-09-17T05:46:50.549694+0000","last_became_peered":"2024-09-17T05:46:50.549694+0000","last_unstale":"2024-09-17T05:46:51.552653+0000","last_undegraded":"2024-09-17T05:46:51.552653+0000","last_fullsized":"2024-09-17T05:46:51.552653+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:46:49.528019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:46:49.528019+0000","last_clean_scrub_stamp":"2024-09-17T05:46:49.528019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:31:19.308660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.5","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2024-09-17T05:46:50.547618+0000","last_change":"2024-09-17T05:46:50.547618+0000","last_active":"2024-09-17T05:46:50.533972+0000","last_peered":"2024-09-17T05:46:50.533972+0000","last_clean":"2024-09-17T05:46:50.533972+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:46:50.547618+0000","last_undegraded":"2024-09-17T05:46:50.547618+0000","last_fullsized":"2024-09-17T05:46:50.547618+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:46:50.533972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:46:50.533972+0000","last_clean_scrub_stamp":"2024-09-17T05:46:50.533972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.4","version":"0'0","reported_seq":15,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-17T05:46:52.574697+0000","last_change":"2024-09-17T05:46:50.547993+0000","last_active":"2024-09-17T05:46:52.574697+0000","last_peered":"2024-09-17T05:46:52.574697+0000","last_clean":"2024-09-17T05:46:52.574697+0000","last_became_active":"2024-09-17T05:46:50.547677+0000","last_became_peered":"2024-09-17T05:46:50.547677+0000","last_unstale":"2024-09-17T05:46:52.574697+0000","last_undegraded":"2024-09-17T05:46:52.574697+0000","last_fullsized":"2024-09-17T05:46:52.574697+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:46:49.528019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:46:49.528019+0000","last_clean_scrub_stamp":"2024-09-17T05:46:49.528019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:26:15.799059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.2","version":"0'0","reported_seq":10,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-17T05:46:51.565532+0000","last_change":"2024-09-17T05:46:51.563537+0000","last_active":"2024-09-17T05:46:51.565532+0000","last_peered":"2024-09-17T05:46:51.565532+0000","last_clean":"2024-09-17T05:46:51.565532+0000","last_became_active":"2024-09-17T05:46:51.563188+0000","last_became_peered":"2024-09-17T05:46:51.563188+0000","last_unstale":"2024-09-17T05:46:51.565532+0000","last_undegraded":"2024-09-17T05:46:51.565532+0000","last_fullsized":"2024-09-17T05:46:51.565532+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:46:50.533972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:46:50.533972+0000","last_clean_scrub_stamp":"2024-09-17T05:46:50.533972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:29:52.002441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.3","version":"0'0","reported_seq":13,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-17T05:46:51.553448+0000","last_change":"2024-09-17T05:46:50.556229+0000","last_active":"2024-09-17T05:46:51.553448+0000","last_peered":"2024-09-17T05:46:51.553448+0000","last_clean":"2024-09-17T05:46:51.553448+0000","last_became_active":"2024-09-17T05:46:50.555876+0000","last_became_peered":"2024-09-17T05:46:50.555876+0000","last_unstale":"2024-09-17T05:46:51.553448+0000","last_undegraded":"2024-09-17T05:46:51.553448+0000","last_fullsized":"2024-09-17T05:46:51.553448+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:46:49.528019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:46:49.528019+0000","last_clean_scrub_stamp":"2024-09-17T05:46:49.528019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:04:36.653508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.3","version":"0'0","reported_seq":10,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-17T05:46:51.576711+0000","last_change":"2024-09-17T05:46:51.575439+0000","last_active":"2024-09-17T05:46:51.576711+0000","last_peered":"2024-09-17T05:46:51.576711+0000","last_clean":"2024-09-17T05:46:51.576711+0000","last_became_active":"2024-09-17T05:46:51.575141+0000","last_became_peered":"2024-09-17T05:46:51.575141+0000","last_unstale":"2024-09-17T05:46:51.576711+0000","last_undegraded":"2024-09-17T05:46:51.576711+0000","last_fullsized":"2024-09-17T05:46:51.576711+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:46:50.533972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:46:50.533972+0000","last_clean_scrub_stamp":"2024-09-17T05:46:50.533972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:57:37.513949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.2","version":"0'0","reported_seq":13,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-17T05:46:51.550642+0000","last_change":"2024-09-17T05:46:50.552938+0000","last_active":"2024-09-17T05:46:51.550642+0000","last_peered":"2024-09-17T05:46:51.550642+0000","last_clean":"2024-09-17T05:46:51.550642+0000","last_became_active":"2024-09-17T05:46:50.552636+0000","last_became_peered":"2024-09-17T05:46:50.552636+0000","last_unstale":"2024-09-17T05:46:51.550642+0000","last_undegraded":"2024-09-17T05:46:51.550642+0000","last_fullsized":"2024-09-17T05:46:51.550642+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:46:49.528019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:46:49.528019+0000","last_clean_scrub_stamp":"2024-09-17T05:46:49.528019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:24:36.778807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.0","version":"0'0","reported_seq":10,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-17T05:46:51.568417+0000","last_change":"2024-09-17T05:46:51.566304+0000","last_active":"2024-09-17T05:46:51.568417+0000","last_peered":"2024-09-17T05:46:51.568417+0000","last_clean":"2024-09-17T05:46:51.568417+0000","last_became_active":"2024-09-17T05:46:51.565283+0000","last_became_peered":"2024-09-17T05:46:51.565283+0000","last_unstale":"2024-09-17T05:46:51.568417+0000","last_undegraded":"2024-09-17T05:46:51.568417+0000","last_fullsized":"2024-09-17T05:46:51.568417+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:46:50.533972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:46:50.533972+0000","last_clean_scrub_stamp":"2024-09-17T05:46:50.533972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:46:16.006152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.1","version":"0'0","reported_seq":10,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-09-17T05:46:50.557384+0000","last_change":"2024-09-17T05:46:50.552458+0000","last_active":"2024-09-17T05:46:50.557384+0000","last_peered":"2024-09-17T05:46:50.557384+0000","last_clean":"2024-09-17T05:46:50.557384+0000","last_became_active":"2024-09-17T05:46:50.552107+0000","last_became_peered":"2024-09-17T05:46:50.552107+0000","last_unstale":"2024-09-17T05:46:50.557384+0000","last_undegraded":"2024-09-17T05:46:50.557384+0000","last_fullsized":"2024-09-17T05:46:50.557384+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:46:49.528019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:46:49.528019+0000","last_clean_scrub_stamp":"2024-09-17T05:46:49.528019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:24:45.137886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1","version":"0'0","reported_seq":10,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-17T05:46:51.575017+0000","last_change":"2024-09-17T05:46:51.573577+0000","last_active":"2024-09-17T05:46:51.575017+0000","last_peered":"2024-09-17T05:46:51.575017+0000","last_clean":"2024-09-17T05:46:51.575017+0000","last_became_active":"2024-09-17T05:46:51.569489+0000","last_became_peered":"2024-09-17T05:46:51.569489+0000","last_unstale":"2024-09-17T05:46:51.575017+0000","last_undegraded":"2024-09-17T05:46:51.575017+0000","last_fullsized":"2024-09-17T05:46:51.575017+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:46:50.533972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:46:50.533972+0000","last_clean_scrub_stamp":"2024-09-17T05:46:50.533972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:26:30.678628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.0","version":"0'0","reported_seq":13,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-17T05:46:51.567574+0000","last_change":"2024-09-17T05:46:50.558270+0000","last_active":"2024-09-17T05:46:51.567574+0000","last_peered":"2024-09-17T05:46:51.567574+0000","last_clean":"2024-09-17T05:46:51.567574+0000","last_became_active":"2024-09-17T05:46:50.557754+0000","last_became_peered":"2024-09-17T05:46:50.557754+0000","last_unstale":"2024-09-17T05:46:51.567574+0000","last_undegraded":"2024-09-17T05:46:51.567574+0000","last_fullsized":"2024-09-17T05:46:51.567574+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:46:49.528019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:46:49.528019+0000","last_clean_scrub_stamp":"2024-09-17T05:46:49.528019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:05:59.732974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.a","version":"0'0","reported_seq":10,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-17T05:46:51.572200+0000","last_change":"2024-09-17T05:46:51.570833+0000","last_active":"2024-09-17T05:46:51.572200+0000","last_peered":"2024-09-17T05:46:51.572200+0000","last_clean":"2024-09-17T05:46:51.572200+0000","last_became_active":"2024-09-17T05:46:51.570468+0000","last_became_peered":"2024-09-17T05:46:51.570468+0000","last_unstale":"2024-09-17T05:46:51.572200+0000","last_undegraded":"2024-09-17T05:46:51.572200+0000","last_fullsized":"2024-09-17T05:46:51.572200+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:46:50.533972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:46:50.533972+0000","last_clean_scrub_stamp":"2024-09-17T05:46:50.533972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:08:52.597158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.b","version":"71'2","reported_seq":15,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-17T05:46:51.586102+0000","last_change":"2024-09-17T05:46:50.559144+0000","last_active":"2024-09-17T05:46:51.586102+0000","last_peered":"2024-09-17T05:46:51.586102+0000","last_clean":"2024-09-17T05:46:51.586102+0000","last_became_active":"2024-09-17T05:46:50.558856+0000","last_became_peered":"2024-09-17T05:46:50.558856+0000","last_unstale":"2024-09-17T05:46:51.586102+0000","last_undegraded":"2024-09-17T05:46:51.586102+0000","last_fullsized":"2024-09-17T05:46:51.586102+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:46:49.528019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:46:49.528019+0000","last_clean_scrub_stamp":"2024-09-17T05:46:49.528019+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:33:50.200522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"19'72","reported_seq":196,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-09-17T05:46:50.551827+0000","last_change":"2024-09-17T05:41:48.539830+0000","last_active":"2024-09-17T05:46:50.551827+0000","last_peered":"2024-09-17T05:46:50.551827+0000","last_clean":"2024-09-17T05:46:50.551827+0000","last_became_active":"2024-09-17T05:41:48.538743+0000","last_became_peered":"2024-09-17T05:41:48.538743+0000","last_unstale":"2024-09-17T05:46:50.551827+0000","last_undegraded":"2024-09-17T05:46:50.551827+0000","last_fullsized":"2024-09-17T05:46:50.551827+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:47.152539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:47.152539+0000","last_clean_scrub_stamp":"2024-09-17T05:41:47.152539+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:08:02.952016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":11,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":10,"num_pg":32,"stat_sum":{"num_bytes":1828,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":4044,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":22,"ondisk_log_size":22,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":16,"seq":68719476802,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":58408,"kb_used_data":844,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94313432,"statfs":{"total":96636764160,"available":96576954368,"internally_reserved":0,"allocated":864256,"data_stored":359618,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":58915270},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":7,"up_from":15,"seq":64424509506,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":58964,"kb_used_data":1404,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94312876,"statfs":{"total":96636764160,"available":96576385024,"internally_reserved":0,"allocated":1437696,"data_stored":943063,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":58915274},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509505,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":58384,"kb_used_data":824,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94313456,"statfs":{"total":96636764160,"available":96576978944,"internally_reserved":0,"allocated":843776,"data_stored":352695,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":58915269},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509505,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":58384,"kb_used_data":824,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94313456,"statfs":{"total":96636764160,"available":96576978944,"internally_reserved":0,"allocated":843776,"data_stored":352695,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":58915269},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509505,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":58408,"kb_used_data":844,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94313432,"statfs":{"total":96636764160,"available":96576954368,"internally_reserved":0,"allocated":864256,"data_stored":359638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":58915271},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509505,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":58408,"kb_used_data":848,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94313432,"statfs":{"total":96636764160,"available":96576954368,"internally_reserved":0,"allocated":868352,"data_stored":361138,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":58915269},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509505,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":58420,"kb_used_data":856,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94313420,"statfs":{"total":96636764160,"available":96576942080,"internally_reserved":0,"allocated":876544,"data_stored":361754,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":58915269},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574913,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":46504,"kb_used_data":1428,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94325336,"statfs":{"total":96636764160,"available":96589144064,"internally_reserved":0,"allocated":1462272,"data_stored":956250,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":46135749},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2228,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-17T05:46:55.576 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-17T05:46:55.594 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-17T05:46:55.616 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-17T05:46:55.728 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:55.727+0000 7f9ab42de640 1 -- 172.21.15.150:0/4274418952 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9a98003fd0 msgr2=0x7f9a98004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:46:55.729 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:55.727+0000 7f9ab42de640 1 --2- 172.21.15.150:0/4274418952 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9a98003fd0 0x7f9a98004800 secure :-1 s=READY pgs=806 cs=0 l=1 rev1=1 crypto rx=0x7f9aac09c000 tx=0x7f9a98005830 comp rx=0 tx=0).stop 2024-09-17T05:46:55.729 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:55.727+0000 7f9ab287b640 1 -- 172.21.15.150:0/4274418952 reap_dead start 2024-09-17T05:46:55.729 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:55.728+0000 7f9ab42de640 1 -- 172.21.15.150:0/4274418952 shutdown_connections 2024-09-17T05:46:55.729 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:55.728+0000 7f9ab42de640 1 -- 172.21.15.150:0/4274418952 >> 172.21.15.150:0/4274418952 conn(0x7f9aac0cee90 msgr2=0x7f9aac0cf2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:46:55.729 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:55.728+0000 7f9ab42de640 1 -- 172.21.15.150:0/4274418952 shutdown_connections 2024-09-17T05:46:55.729 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:55.728+0000 7f9ab42de640 1 -- 172.21.15.150:0/4274418952 wait complete. 2024-09-17T05:46:55.730 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:55.729+0000 7f9ab42de640 1 Processor -- start 2024-09-17T05:46:55.730 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:55.729+0000 7f9ab42de640 1 -- start start 2024-09-17T05:46:55.733 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:55.731+0000 7f9ab42de640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9a98003fd0 0x7f9aac1d66b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:46:55.733 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:55.731+0000 7f9ab42de640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9aac1dd080 0x7f9aac0b2410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:46:55.733 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:55.731+0000 7f9ab42de640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9aac1dcac0 0x7f9aac0b2950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:46:55.733 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:55.731+0000 7f9ab42de640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f9aac0d0db0 con 0x7f9aac1dcac0 2024-09-17T05:46:55.733 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:55.731+0000 7f9ab42de640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f9aac0d0c30 con 0x7f9aac1dd080 2024-09-17T05:46:55.733 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:55.731+0000 7f9ab42de640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f9aac0d0f30 con 0x7f9a98003fd0 2024-09-17T05:46:55.733 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:55.731+0000 7f9ab287b640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9aac1dcac0 0x7f9aac0b2950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:46:55.733 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:55.731+0000 7f9ab287b640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9aac1dcac0 0x7f9aac0b2950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:59798/0 (socket says 172.21.15.150:59798) 2024-09-17T05:46:55.733 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:55.731+0000 7f9ab287b640 1 -- 172.21.15.150:0/2337399445 learned_addr learned my addr 172.21.15.150:0/2337399445 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:46:55.734 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:55.731+0000 7f9ab1879640 1 --2- 172.21.15.150:0/2337399445 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9aac1dd080 0x7f9aac0b2410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:46:55.734 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:55.731+0000 7f9ab207a640 1 --2- 172.21.15.150:0/2337399445 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9a98003fd0 0x7f9aac1d66b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:46:55.734 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:55.731+0000 7f9ab287b640 1 -- 172.21.15.150:0/2337399445 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9a98003fd0 msgr2=0x7f9aac1d66b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:46:55.734 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:55.731+0000 7f9ab287b640 1 --2- 172.21.15.150:0/2337399445 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9a98003fd0 0x7f9aac1d66b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:55.734 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:55.731+0000 7f9ab287b640 1 -- 172.21.15.150:0/2337399445 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9aac1dd080 msgr2=0x7f9aac0b2410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:46:55.734 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:55.731+0000 7f9ab287b640 1 --2- 172.21.15.150:0/2337399445 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9aac1dd080 0x7f9aac0b2410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:55.734 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:55.731+0000 7f9ab287b640 1 -- 172.21.15.150:0/2337399445 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9aac1f8520 con 0x7f9aac1dcac0 2024-09-17T05:46:55.734 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:55.731+0000 7f9ab287b640 1 --2- 172.21.15.150:0/2337399445 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9aac1dcac0 0x7f9aac0b2950 secure :-1 s=READY pgs=807 cs=0 l=1 rev1=1 crypto rx=0x7f9aac06a060 tx=0x7f9aa4011bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:46:55.734 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:55.731+0000 7f9aa2ffd640 1 -- 172.21.15.150:0/2337399445 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9aa4004440 con 0x7f9aac1dcac0 2024-09-17T05:46:55.734 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:55.732+0000 7f9aa2ffd640 1 -- 172.21.15.150:0/2337399445 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9aa400f920 con 0x7f9aac1dcac0 2024-09-17T05:46:55.734 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:55.732+0000 7f9ab42de640 1 -- 172.21.15.150:0/2337399445 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9aac1f79a0 con 0x7f9aac1dcac0 2024-09-17T05:46:55.734 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:55.732+0000 7f9aa2ffd640 1 -- 172.21.15.150:0/2337399445 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9aa400fd70 con 0x7f9aac1dcac0 2024-09-17T05:46:55.734 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:55.732+0000 7f9ab42de640 1 -- 172.21.15.150:0/2337399445 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9aac1f7f60 con 0x7f9aac1dcac0 2024-09-17T05:46:55.735 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:55.732+0000 7f9ab42de640 1 -- 172.21.15.150:0/2337399445 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9aac1f7710 con 0x7f9aac1dcac0 2024-09-17T05:46:55.735 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:55.733+0000 7f9aa2ffd640 1 -- 172.21.15.150:0/2337399445 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 19) ==== 102563+0+0 (secure 0 0 0) 0x7f9aa40035f0 con 0x7f9aac1dcac0 2024-09-17T05:46:55.735 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:55.734+0000 7f9aa2ffd640 1 --2- 172.21.15.150:0/2337399445 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f9a900797f0 0x7f9a9007bd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:46:55.735 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:55.734+0000 7f9aa2ffd640 1 -- 172.21.15.150:0/2337399445 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 5765+0+0 (secure 0 0 0) 0x7f9aa4099f50 con 0x7f9aac1dcac0 2024-09-17T05:46:55.735 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:55.734+0000 7f9ab207a640 1 --2- 172.21.15.150:0/2337399445 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f9a900797f0 0x7f9a9007bd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:46:55.736 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:55.735+0000 7f9ab207a640 1 --2- 172.21.15.150:0/2337399445 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f9a900797f0 0x7f9a9007bd00 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f9aa8005fd0 tx=0x7f9aa80094a0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:46:55.739 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:55.738+0000 7f9aa2ffd640 1 -- 172.21.15.150:0/2337399445 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f9aa4011e20 con 0x7f9aac1dcac0 2024-09-17T05:46:55.910 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:55.910+0000 7f9ab42de640 1 -- 172.21.15.150:0/2337399445 --> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f9aac0cffe0 con 0x7f9a900797f0 2024-09-17T05:46:55.915 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:55.914+0000 7f9aa2ffd640 1 -- 172.21.15.150:0/2337399445 <== mgr.4108 v2:172.21.15.176:6800/3631216395 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+249839 (secure 0 0 0) 0x7f9aac0cffe0 con 0x7f9a900797f0 2024-09-17T05:46:55.917 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-09-17T05:46:55.919 INFO:teuthology.orchestra.run.smithi150.stderr:dumped all 2024-09-17T05:46:55.920 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:55.917+0000 7f9ab42de640 1 -- 172.21.15.150:0/2337399445 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f9a900797f0 msgr2=0x7f9a9007bd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:46:55.920 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:55.917+0000 7f9ab42de640 1 --2- 172.21.15.150:0/2337399445 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f9a900797f0 0x7f9a9007bd00 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f9aa8005fd0 tx=0x7f9aa80094a0 comp rx=0 tx=0).stop 2024-09-17T05:46:55.920 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:55.918+0000 7f9ab42de640 1 -- 172.21.15.150:0/2337399445 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9aac1dcac0 msgr2=0x7f9aac0b2950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:46:55.920 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:55.918+0000 7f9ab42de640 1 --2- 172.21.15.150:0/2337399445 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9aac1dcac0 0x7f9aac0b2950 secure :-1 s=READY pgs=807 cs=0 l=1 rev1=1 crypto rx=0x7f9aac06a060 tx=0x7f9aa4011bd0 comp rx=0 tx=0).stop 2024-09-17T05:46:55.921 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:55.918+0000 7f9ab42de640 1 -- 172.21.15.150:0/2337399445 shutdown_connections 2024-09-17T05:46:55.921 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:55.918+0000 7f9ab42de640 1 --2- 172.21.15.150:0/2337399445 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9aac1dd080 0x7f9aac0b2410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:55.921 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:55.918+0000 7f9ab42de640 1 --2- 172.21.15.150:0/2337399445 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f9a900797f0 0x7f9a9007bd00 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:55.921 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:55.918+0000 7f9ab42de640 1 --2- 172.21.15.150:0/2337399445 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9aac1dcac0 0x7f9aac0b2950 unknown :-1 s=CLOSED pgs=807 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:55.921 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:55.918+0000 7f9ab42de640 1 --2- 172.21.15.150:0/2337399445 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9a98003fd0 0x7f9aac1d66b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:55.921 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:55.918+0000 7f9ab42de640 1 -- 172.21.15.150:0/2337399445 >> 172.21.15.150:0/2337399445 conn(0x7f9aac0cee90 msgr2=0x7f9aac0cdd90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:46:55.921 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:55.918+0000 7f9ab42de640 1 -- 172.21.15.150:0/2337399445 shutdown_connections 2024-09-17T05:46:55.921 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:55.918+0000 7f9ab42de640 1 -- 172.21.15.150:0/2337399445 wait complete. 2024-09-17T05:46:55.930 INFO:teuthology.orchestra.run.smithi150.stdout:{"pg_ready":true,"pg_map":{"version":221,"stamp":"2024-09-17T05:46:54.931253+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592196,"num_objects":15,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":123,"num_write_kb":1641,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":94,"ondisk_log_size":94,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":45,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":455880,"kb_used_data":7872,"kb_used_omap":12,"kb_used_meta":447795,"kb_avail":754518840,"statfs":{"total":773094113280,"available":772627292160,"internally_reserved":0,"allocated":8060928,"data_stored":4046851,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":458542640},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":13,"apply_latency_ms":13,"commit_latency_ns":13000000,"apply_latency_ns":13000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":1828,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.396089"},"pg_stats":[{"pgid":"11.3f","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2024-09-17T05:46:50.548739+0000","last_change":"2024-09-17T05:46:50.548739+0000","last_active":"2024-09-17T05:46:50.533972+0000","last_peered":"2024-09-17T05:46:50.533972+0000","last_clean":"2024-09-17T05:46:50.533972+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:46:50.548739+0000","last_undegraded":"2024-09-17T05:46:50.548739+0000","last_fullsized":"2024-09-17T05:46:50.548739+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:46:50.533972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:46:50.533972+0000","last_clean_scrub_stamp":"2024-09-17T05:46:50.533972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.3e","version":"0'0","reported_seq":10,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-17T05:46:51.575067+0000","last_change":"2024-09-17T05:46:51.574207+0000","last_active":"2024-09-17T05:46:51.575067+0000","last_peered":"2024-09-17T05:46:51.575067+0000","last_clean":"2024-09-17T05:46:51.575067+0000","last_became_active":"2024-09-17T05:46:51.573715+0000","last_became_peered":"2024-09-17T05:46:51.573715+0000","last_unstale":"2024-09-17T05:46:51.575067+0000","last_undegraded":"2024-09-17T05:46:51.575067+0000","last_fullsized":"2024-09-17T05:46:51.575067+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:46:50.533972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:46:50.533972+0000","last_clean_scrub_stamp":"2024-09-17T05:46:50.533972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:25:21.675189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.3d","version":"0'0","reported_seq":10,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-17T05:46:51.567520+0000","last_change":"2024-09-17T05:46:51.562710+0000","last_active":"2024-09-17T05:46:51.567520+0000","last_peered":"2024-09-17T05:46:51.567520+0000","last_clean":"2024-09-17T05:46:51.567520+0000","last_became_active":"2024-09-17T05:46:51.562411+0000","last_became_peered":"2024-09-17T05:46:51.562411+0000","last_unstale":"2024-09-17T05:46:51.567520+0000","last_undegraded":"2024-09-17T05:46:51.567520+0000","last_fullsized":"2024-09-17T05:46:51.567520+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:46:50.533972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:46:50.533972+0000","last_clean_scrub_stamp":"2024-09-17T05:46:50.533972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:00:47.705389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.3c","version":"0'0","reported_seq":10,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-17T05:46:51.578548+0000","last_change":"2024-09-17T05:46:51.578009+0000","last_active":"2024-09-17T05:46:51.578548+0000","last_peered":"2024-09-17T05:46:51.578548+0000","last_clean":"2024-09-17T05:46:51.578548+0000","last_became_active":"2024-09-17T05:46:51.577250+0000","last_became_peered":"2024-09-17T05:46:51.577250+0000","last_unstale":"2024-09-17T05:46:51.578548+0000","last_undegraded":"2024-09-17T05:46:51.578548+0000","last_fullsized":"2024-09-17T05:46:51.578548+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:46:50.533972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:46:50.533972+0000","last_clean_scrub_stamp":"2024-09-17T05:46:50.533972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:54:01.737244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.3b","version":"0'0","reported_seq":10,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-17T05:46:51.569883+0000","last_change":"2024-09-17T05:46:51.568927+0000","last_active":"2024-09-17T05:46:51.569883+0000","last_peered":"2024-09-17T05:46:51.569883+0000","last_clean":"2024-09-17T05:46:51.569883+0000","last_became_active":"2024-09-17T05:46:51.568639+0000","last_became_peered":"2024-09-17T05:46:51.568639+0000","last_unstale":"2024-09-17T05:46:51.569883+0000","last_undegraded":"2024-09-17T05:46:51.569883+0000","last_fullsized":"2024-09-17T05:46:51.569883+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:46:50.533972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:46:50.533972+0000","last_clean_scrub_stamp":"2024-09-17T05:46:50.533972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:42:03.102311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.3a","version":"0'0","reported_seq":10,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-17T05:46:51.581154+0000","last_change":"2024-09-17T05:46:51.578128+0000","last_active":"2024-09-17T05:46:51.581154+0000","last_peered":"2024-09-17T05:46:51.581154+0000","last_clean":"2024-09-17T05:46:51.581154+0000","last_became_active":"2024-09-17T05:46:51.577539+0000","last_became_peered":"2024-09-17T05:46:51.577539+0000","last_unstale":"2024-09-17T05:46:51.581154+0000","last_undegraded":"2024-09-17T05:46:51.581154+0000","last_fullsized":"2024-09-17T05:46:51.581154+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:46:50.533972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:46:50.533972+0000","last_clean_scrub_stamp":"2024-09-17T05:46:50.533972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:30:58.672623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.39","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2024-09-17T05:46:50.540980+0000","last_change":"2024-09-17T05:46:50.540980+0000","last_active":"2024-09-17T05:46:50.533972+0000","last_peered":"2024-09-17T05:46:50.533972+0000","last_clean":"2024-09-17T05:46:50.533972+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:46:50.540980+0000","last_undegraded":"2024-09-17T05:46:50.540980+0000","last_fullsized":"2024-09-17T05:46:50.540980+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:46:50.533972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:46:50.533972+0000","last_clean_scrub_stamp":"2024-09-17T05:46:50.533972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.38","version":"0'0","reported_seq":10,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-17T05:46:51.582069+0000","last_change":"2024-09-17T05:46:51.578199+0000","last_active":"2024-09-17T05:46:51.582069+0000","last_peered":"2024-09-17T05:46:51.582069+0000","last_clean":"2024-09-17T05:46:51.582069+0000","last_became_active":"2024-09-17T05:46:51.576847+0000","last_became_peered":"2024-09-17T05:46:51.576847+0000","last_unstale":"2024-09-17T05:46:51.582069+0000","last_undegraded":"2024-09-17T05:46:51.582069+0000","last_fullsized":"2024-09-17T05:46:51.582069+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:46:50.533972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:46:50.533972+0000","last_clean_scrub_stamp":"2024-09-17T05:46:50.533972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:44:40.981285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.37","version":"0'0","reported_seq":10,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-17T05:46:51.565649+0000","last_change":"2024-09-17T05:46:51.563153+0000","last_active":"2024-09-17T05:46:51.565649+0000","last_peered":"2024-09-17T05:46:51.565649+0000","last_clean":"2024-09-17T05:46:51.565649+0000","last_became_active":"2024-09-17T05:46:51.562497+0000","last_became_peered":"2024-09-17T05:46:51.562497+0000","last_unstale":"2024-09-17T05:46:51.565649+0000","last_undegraded":"2024-09-17T05:46:51.565649+0000","last_fullsized":"2024-09-17T05:46:51.565649+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:46:50.533972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:46:50.533972+0000","last_clean_scrub_stamp":"2024-09-17T05:46:50.533972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:01:14.364335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.36","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2024-09-17T05:46:50.541245+0000","last_change":"2024-09-17T05:46:50.541245+0000","last_active":"2024-09-17T05:46:50.533972+0000","last_peered":"2024-09-17T05:46:50.533972+0000","last_clean":"2024-09-17T05:46:50.533972+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:46:50.541245+0000","last_undegraded":"2024-09-17T05:46:50.541245+0000","last_fullsized":"2024-09-17T05:46:50.541245+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:46:50.533972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:46:50.533972+0000","last_clean_scrub_stamp":"2024-09-17T05:46:50.533972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.35","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2024-09-17T05:46:50.552725+0000","last_change":"2024-09-17T05:46:50.552725+0000","last_active":"2024-09-17T05:46:50.533972+0000","last_peered":"2024-09-17T05:46:50.533972+0000","last_clean":"2024-09-17T05:46:50.533972+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:46:50.552725+0000","last_undegraded":"2024-09-17T05:46:50.552725+0000","last_fullsized":"2024-09-17T05:46:50.552725+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:46:50.533972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:46:50.533972+0000","last_clean_scrub_stamp":"2024-09-17T05:46:50.533972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.34","version":"0'0","reported_seq":10,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-17T05:46:51.558821+0000","last_change":"2024-09-17T05:46:51.556088+0000","last_active":"2024-09-17T05:46:51.558821+0000","last_peered":"2024-09-17T05:46:51.558821+0000","last_clean":"2024-09-17T05:46:51.558821+0000","last_became_active":"2024-09-17T05:46:51.555380+0000","last_became_peered":"2024-09-17T05:46:51.555380+0000","last_unstale":"2024-09-17T05:46:51.558821+0000","last_undegraded":"2024-09-17T05:46:51.558821+0000","last_fullsized":"2024-09-17T05:46:51.558821+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:46:50.533972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:46:50.533972+0000","last_clean_scrub_stamp":"2024-09-17T05:46:50.533972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:18:33.728461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.33","version":"0'0","reported_seq":13,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-17T05:46:52.574767+0000","last_change":"2024-09-17T05:46:51.570802+0000","last_active":"2024-09-17T05:46:52.574767+0000","last_peered":"2024-09-17T05:46:52.574767+0000","last_clean":"2024-09-17T05:46:52.574767+0000","last_became_active":"2024-09-17T05:46:51.570412+0000","last_became_peered":"2024-09-17T05:46:51.570412+0000","last_unstale":"2024-09-17T05:46:52.574767+0000","last_undegraded":"2024-09-17T05:46:52.574767+0000","last_fullsized":"2024-09-17T05:46:52.574767+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:46:50.533972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:46:50.533972+0000","last_clean_scrub_stamp":"2024-09-17T05:46:50.533972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:31:15.619388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.32","version":"0'0","reported_seq":10,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-17T05:46:51.567612+0000","last_change":"2024-09-17T05:46:51.565282+0000","last_active":"2024-09-17T05:46:51.567612+0000","last_peered":"2024-09-17T05:46:51.567612+0000","last_clean":"2024-09-17T05:46:51.567612+0000","last_became_active":"2024-09-17T05:46:51.564899+0000","last_became_peered":"2024-09-17T05:46:51.564899+0000","last_unstale":"2024-09-17T05:46:51.567612+0000","last_undegraded":"2024-09-17T05:46:51.567612+0000","last_fullsized":"2024-09-17T05:46:51.567612+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:46:50.533972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:46:50.533972+0000","last_clean_scrub_stamp":"2024-09-17T05:46:50.533972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:50:16.046843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.31","version":"0'0","reported_seq":13,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-17T05:46:52.574510+0000","last_change":"2024-09-17T05:46:51.561117+0000","last_active":"2024-09-17T05:46:52.574510+0000","last_peered":"2024-09-17T05:46:52.574510+0000","last_clean":"2024-09-17T05:46:52.574510+0000","last_became_active":"2024-09-17T05:46:51.560823+0000","last_became_peered":"2024-09-17T05:46:51.560823+0000","last_unstale":"2024-09-17T05:46:52.574510+0000","last_undegraded":"2024-09-17T05:46:52.574510+0000","last_fullsized":"2024-09-17T05:46:52.574510+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:46:50.533972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:46:50.533972+0000","last_clean_scrub_stamp":"2024-09-17T05:46:50.533972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:47:50.985506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.30","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2024-09-17T05:46:50.540400+0000","last_change":"2024-09-17T05:46:50.540400+0000","last_active":"2024-09-17T05:46:50.533972+0000","last_peered":"2024-09-17T05:46:50.533972+0000","last_clean":"2024-09-17T05:46:50.533972+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:46:50.540400+0000","last_undegraded":"2024-09-17T05:46:50.540400+0000","last_fullsized":"2024-09-17T05:46:50.540400+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:46:50.533972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:46:50.533972+0000","last_clean_scrub_stamp":"2024-09-17T05:46:50.533972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.2f","version":"0'0","reported_seq":10,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-17T05:46:51.565674+0000","last_change":"2024-09-17T05:46:51.563745+0000","last_active":"2024-09-17T05:46:51.565674+0000","last_peered":"2024-09-17T05:46:51.565674+0000","last_clean":"2024-09-17T05:46:51.565674+0000","last_became_active":"2024-09-17T05:46:51.562341+0000","last_became_peered":"2024-09-17T05:46:51.562341+0000","last_unstale":"2024-09-17T05:46:51.565674+0000","last_undegraded":"2024-09-17T05:46:51.565674+0000","last_fullsized":"2024-09-17T05:46:51.565674+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:46:50.533972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:46:50.533972+0000","last_clean_scrub_stamp":"2024-09-17T05:46:50.533972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:08:34.355357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.2e","version":"0'0","reported_seq":10,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-17T05:46:51.576447+0000","last_change":"2024-09-17T05:46:51.575409+0000","last_active":"2024-09-17T05:46:51.576447+0000","last_peered":"2024-09-17T05:46:51.576447+0000","last_clean":"2024-09-17T05:46:51.576447+0000","last_became_active":"2024-09-17T05:46:51.575064+0000","last_became_peered":"2024-09-17T05:46:51.575064+0000","last_unstale":"2024-09-17T05:46:51.576447+0000","last_undegraded":"2024-09-17T05:46:51.576447+0000","last_fullsized":"2024-09-17T05:46:51.576447+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:46:50.533972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:46:50.533972+0000","last_clean_scrub_stamp":"2024-09-17T05:46:50.533972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:15:23.712248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.2d","version":"0'0","reported_seq":10,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-17T05:46:51.583515+0000","last_change":"2024-09-17T05:46:51.578864+0000","last_active":"2024-09-17T05:46:51.583515+0000","last_peered":"2024-09-17T05:46:51.583515+0000","last_clean":"2024-09-17T05:46:51.583515+0000","last_became_active":"2024-09-17T05:46:51.578508+0000","last_became_peered":"2024-09-17T05:46:51.578508+0000","last_unstale":"2024-09-17T05:46:51.583515+0000","last_undegraded":"2024-09-17T05:46:51.583515+0000","last_fullsized":"2024-09-17T05:46:51.583515+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:46:50.533972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:46:50.533972+0000","last_clean_scrub_stamp":"2024-09-17T05:46:50.533972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:36:16.964919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.2c","version":"0'0","reported_seq":13,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-17T05:46:52.574643+0000","last_change":"2024-09-17T05:46:51.564642+0000","last_active":"2024-09-17T05:46:52.574643+0000","last_peered":"2024-09-17T05:46:52.574643+0000","last_clean":"2024-09-17T05:46:52.574643+0000","last_became_active":"2024-09-17T05:46:51.564341+0000","last_became_peered":"2024-09-17T05:46:51.564341+0000","last_unstale":"2024-09-17T05:46:52.574643+0000","last_undegraded":"2024-09-17T05:46:52.574643+0000","last_fullsized":"2024-09-17T05:46:52.574643+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:46:50.533972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:46:50.533972+0000","last_clean_scrub_stamp":"2024-09-17T05:46:50.533972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:32:36.148692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.2b","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2024-09-17T05:46:50.541483+0000","last_change":"2024-09-17T05:46:50.541483+0000","last_active":"2024-09-17T05:46:50.533972+0000","last_peered":"2024-09-17T05:46:50.533972+0000","last_clean":"2024-09-17T05:46:50.533972+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:46:50.541483+0000","last_undegraded":"2024-09-17T05:46:50.541483+0000","last_fullsized":"2024-09-17T05:46:50.541483+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:46:50.533972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:46:50.533972+0000","last_clean_scrub_stamp":"2024-09-17T05:46:50.533972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.2a","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2024-09-17T05:46:50.542828+0000","last_change":"2024-09-17T05:46:50.542828+0000","last_active":"2024-09-17T05:46:50.533972+0000","last_peered":"2024-09-17T05:46:50.533972+0000","last_clean":"2024-09-17T05:46:50.533972+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:46:50.542828+0000","last_undegraded":"2024-09-17T05:46:50.542828+0000","last_fullsized":"2024-09-17T05:46:50.542828+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:46:50.533972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:46:50.533972+0000","last_clean_scrub_stamp":"2024-09-17T05:46:50.533972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.29","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2024-09-17T05:46:50.545977+0000","last_change":"2024-09-17T05:46:50.545977+0000","last_active":"2024-09-17T05:46:50.533972+0000","last_peered":"2024-09-17T05:46:50.533972+0000","last_clean":"2024-09-17T05:46:50.533972+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:46:50.545977+0000","last_undegraded":"2024-09-17T05:46:50.545977+0000","last_fullsized":"2024-09-17T05:46:50.545977+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:46:50.533972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:46:50.533972+0000","last_clean_scrub_stamp":"2024-09-17T05:46:50.533972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.28","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2024-09-17T05:46:50.550694+0000","last_change":"2024-09-17T05:46:50.550694+0000","last_active":"2024-09-17T05:46:50.533972+0000","last_peered":"2024-09-17T05:46:50.533972+0000","last_clean":"2024-09-17T05:46:50.533972+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:46:50.550694+0000","last_undegraded":"2024-09-17T05:46:50.550694+0000","last_fullsized":"2024-09-17T05:46:50.550694+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:46:50.533972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:46:50.533972+0000","last_clean_scrub_stamp":"2024-09-17T05:46:50.533972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.27","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2024-09-17T05:46:50.543035+0000","last_change":"2024-09-17T05:46:50.543035+0000","last_active":"2024-09-17T05:46:50.533972+0000","last_peered":"2024-09-17T05:46:50.533972+0000","last_clean":"2024-09-17T05:46:50.533972+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:46:50.543035+0000","last_undegraded":"2024-09-17T05:46:50.543035+0000","last_fullsized":"2024-09-17T05:46:50.543035+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:46:50.533972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:46:50.533972+0000","last_clean_scrub_stamp":"2024-09-17T05:46:50.533972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.26","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2024-09-17T05:46:50.541785+0000","last_change":"2024-09-17T05:46:50.541785+0000","last_active":"2024-09-17T05:46:50.533972+0000","last_peered":"2024-09-17T05:46:50.533972+0000","last_clean":"2024-09-17T05:46:50.533972+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:46:50.541785+0000","last_undegraded":"2024-09-17T05:46:50.541785+0000","last_fullsized":"2024-09-17T05:46:50.541785+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:46:50.533972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:46:50.533972+0000","last_clean_scrub_stamp":"2024-09-17T05:46:50.533972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.25","version":"0'0","reported_seq":10,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-17T05:46:51.568180+0000","last_change":"2024-09-17T05:46:51.566344+0000","last_active":"2024-09-17T05:46:51.568180+0000","last_peered":"2024-09-17T05:46:51.568180+0000","last_clean":"2024-09-17T05:46:51.568180+0000","last_became_active":"2024-09-17T05:46:51.564652+0000","last_became_peered":"2024-09-17T05:46:51.564652+0000","last_unstale":"2024-09-17T05:46:51.568180+0000","last_undegraded":"2024-09-17T05:46:51.568180+0000","last_fullsized":"2024-09-17T05:46:51.568180+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:46:50.533972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:46:50.533972+0000","last_clean_scrub_stamp":"2024-09-17T05:46:50.533972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:27:02.406829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.24","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2024-09-17T05:46:50.542382+0000","last_change":"2024-09-17T05:46:50.542382+0000","last_active":"2024-09-17T05:46:50.533972+0000","last_peered":"2024-09-17T05:46:50.533972+0000","last_clean":"2024-09-17T05:46:50.533972+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:46:50.542382+0000","last_undegraded":"2024-09-17T05:46:50.542382+0000","last_fullsized":"2024-09-17T05:46:50.542382+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:46:50.533972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:46:50.533972+0000","last_clean_scrub_stamp":"2024-09-17T05:46:50.533972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.23","version":"0'0","reported_seq":10,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-17T05:46:51.567854+0000","last_change":"2024-09-17T05:46:51.564915+0000","last_active":"2024-09-17T05:46:51.567854+0000","last_peered":"2024-09-17T05:46:51.567854+0000","last_clean":"2024-09-17T05:46:51.567854+0000","last_became_active":"2024-09-17T05:46:51.564611+0000","last_became_peered":"2024-09-17T05:46:51.564611+0000","last_unstale":"2024-09-17T05:46:51.567854+0000","last_undegraded":"2024-09-17T05:46:51.567854+0000","last_fullsized":"2024-09-17T05:46:51.567854+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:46:50.533972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:46:50.533972+0000","last_clean_scrub_stamp":"2024-09-17T05:46:50.533972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:09:33.099629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.22","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2024-09-17T05:46:50.541871+0000","last_change":"2024-09-17T05:46:50.541871+0000","last_active":"2024-09-17T05:46:50.533972+0000","last_peered":"2024-09-17T05:46:50.533972+0000","last_clean":"2024-09-17T05:46:50.533972+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:46:50.541871+0000","last_undegraded":"2024-09-17T05:46:50.541871+0000","last_fullsized":"2024-09-17T05:46:50.541871+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:46:50.533972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:46:50.533972+0000","last_clean_scrub_stamp":"2024-09-17T05:46:50.533972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.21","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2024-09-17T05:46:50.539907+0000","last_change":"2024-09-17T05:46:50.539907+0000","last_active":"2024-09-17T05:46:50.533972+0000","last_peered":"2024-09-17T05:46:50.533972+0000","last_clean":"2024-09-17T05:46:50.533972+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:46:50.539907+0000","last_undegraded":"2024-09-17T05:46:50.539907+0000","last_fullsized":"2024-09-17T05:46:50.539907+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:46:50.533972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:46:50.533972+0000","last_clean_scrub_stamp":"2024-09-17T05:46:50.533972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.20","version":"0'0","reported_seq":10,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-17T05:46:51.580457+0000","last_change":"2024-09-17T05:46:51.577607+0000","last_active":"2024-09-17T05:46:51.580457+0000","last_peered":"2024-09-17T05:46:51.580457+0000","last_clean":"2024-09-17T05:46:51.580457+0000","last_became_active":"2024-09-17T05:46:51.576279+0000","last_became_peered":"2024-09-17T05:46:51.576279+0000","last_unstale":"2024-09-17T05:46:51.580457+0000","last_undegraded":"2024-09-17T05:46:51.580457+0000","last_fullsized":"2024-09-17T05:46:51.580457+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:46:50.533972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:46:50.533972+0000","last_clean_scrub_stamp":"2024-09-17T05:46:50.533972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:35:43.534736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.1e","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2024-09-17T05:46:50.546452+0000","last_change":"2024-09-17T05:46:50.546452+0000","last_active":"2024-09-17T05:46:50.533972+0000","last_peered":"2024-09-17T05:46:50.533972+0000","last_clean":"2024-09-17T05:46:50.533972+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:46:50.546452+0000","last_undegraded":"2024-09-17T05:46:50.546452+0000","last_fullsized":"2024-09-17T05:46:50.546452+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:46:50.533972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:46:50.533972+0000","last_clean_scrub_stamp":"2024-09-17T05:46:50.533972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1f","version":"0'0","reported_seq":10,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-09-17T05:46:50.559376+0000","last_change":"2024-09-17T05:46:50.558694+0000","last_active":"2024-09-17T05:46:50.559376+0000","last_peered":"2024-09-17T05:46:50.559376+0000","last_clean":"2024-09-17T05:46:50.559376+0000","last_became_active":"2024-09-17T05:46:50.557228+0000","last_became_peered":"2024-09-17T05:46:50.557228+0000","last_unstale":"2024-09-17T05:46:50.559376+0000","last_undegraded":"2024-09-17T05:46:50.559376+0000","last_fullsized":"2024-09-17T05:46:50.559376+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:46:49.528019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:46:49.528019+0000","last_clean_scrub_stamp":"2024-09-17T05:46:49.528019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:31:03.053588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.1f","version":"0'0","reported_seq":10,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-17T05:46:51.565606+0000","last_change":"2024-09-17T05:46:51.562813+0000","last_active":"2024-09-17T05:46:51.565606+0000","last_peered":"2024-09-17T05:46:51.565606+0000","last_clean":"2024-09-17T05:46:51.565606+0000","last_became_active":"2024-09-17T05:46:51.562079+0000","last_became_peered":"2024-09-17T05:46:51.562079+0000","last_unstale":"2024-09-17T05:46:51.565606+0000","last_undegraded":"2024-09-17T05:46:51.565606+0000","last_fullsized":"2024-09-17T05:46:51.565606+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:46:50.533972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:46:50.533972+0000","last_clean_scrub_stamp":"2024-09-17T05:46:50.533972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:05:18.413938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.1e","version":"71'1","reported_seq":16,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-17T05:46:52.574660+0000","last_change":"2024-09-17T05:46:50.552744+0000","last_active":"2024-09-17T05:46:52.574660+0000","last_peered":"2024-09-17T05:46:52.574660+0000","last_clean":"2024-09-17T05:46:52.574660+0000","last_became_active":"2024-09-17T05:46:50.551757+0000","last_became_peered":"2024-09-17T05:46:50.551757+0000","last_unstale":"2024-09-17T05:46:52.574660+0000","last_undegraded":"2024-09-17T05:46:52.574660+0000","last_fullsized":"2024-09-17T05:46:52.574660+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:46:49.528019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:46:49.528019+0000","last_clean_scrub_stamp":"2024-09-17T05:46:49.528019+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:10:23.845161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1c","version":"0'0","reported_seq":10,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-17T05:46:51.582656+0000","last_change":"2024-09-17T05:46:51.581452+0000","last_active":"2024-09-17T05:46:51.582656+0000","last_peered":"2024-09-17T05:46:51.582656+0000","last_clean":"2024-09-17T05:46:51.582656+0000","last_became_active":"2024-09-17T05:46:51.581056+0000","last_became_peered":"2024-09-17T05:46:51.581056+0000","last_unstale":"2024-09-17T05:46:51.582656+0000","last_undegraded":"2024-09-17T05:46:51.582656+0000","last_fullsized":"2024-09-17T05:46:51.582656+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:46:50.533972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:46:50.533972+0000","last_clean_scrub_stamp":"2024-09-17T05:46:50.533972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:49:54.442500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.1d","version":"0'0","reported_seq":10,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-09-17T05:46:50.559325+0000","last_change":"2024-09-17T05:46:50.558321+0000","last_active":"2024-09-17T05:46:50.559325+0000","last_peered":"2024-09-17T05:46:50.559325+0000","last_clean":"2024-09-17T05:46:50.559325+0000","last_became_active":"2024-09-17T05:46:50.557997+0000","last_became_peered":"2024-09-17T05:46:50.557997+0000","last_unstale":"2024-09-17T05:46:50.559325+0000","last_undegraded":"2024-09-17T05:46:50.559325+0000","last_fullsized":"2024-09-17T05:46:50.559325+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:46:49.528019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:46:49.528019+0000","last_clean_scrub_stamp":"2024-09-17T05:46:49.528019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:48:03.906981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1d","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2024-09-17T05:46:50.552264+0000","last_change":"2024-09-17T05:46:50.552264+0000","last_active":"2024-09-17T05:46:50.533972+0000","last_peered":"2024-09-17T05:46:50.533972+0000","last_clean":"2024-09-17T05:46:50.533972+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:46:50.552264+0000","last_undegraded":"2024-09-17T05:46:50.552264+0000","last_fullsized":"2024-09-17T05:46:50.552264+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:46:50.533972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:46:50.533972+0000","last_clean_scrub_stamp":"2024-09-17T05:46:50.533972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1c","version":"71'2","reported_seq":15,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-17T05:46:51.586077+0000","last_change":"2024-09-17T05:46:50.555340+0000","last_active":"2024-09-17T05:46:51.586077+0000","last_peered":"2024-09-17T05:46:51.586077+0000","last_clean":"2024-09-17T05:46:51.586077+0000","last_became_active":"2024-09-17T05:46:50.554957+0000","last_became_peered":"2024-09-17T05:46:50.554957+0000","last_unstale":"2024-09-17T05:46:51.586077+0000","last_undegraded":"2024-09-17T05:46:51.586077+0000","last_fullsized":"2024-09-17T05:46:51.586077+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:46:49.528019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:46:49.528019+0000","last_clean_scrub_stamp":"2024-09-17T05:46:49.528019+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:39:19.804580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.1a","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2024-09-17T05:46:50.541001+0000","last_change":"2024-09-17T05:46:50.541001+0000","last_active":"2024-09-17T05:46:50.533972+0000","last_peered":"2024-09-17T05:46:50.533972+0000","last_clean":"2024-09-17T05:46:50.533972+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:46:50.541001+0000","last_undegraded":"2024-09-17T05:46:50.541001+0000","last_fullsized":"2024-09-17T05:46:50.541001+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:46:50.533972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:46:50.533972+0000","last_clean_scrub_stamp":"2024-09-17T05:46:50.533972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.1b","version":"71'1","reported_seq":14,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-17T05:46:51.583973+0000","last_change":"2024-09-17T05:46:50.554024+0000","last_active":"2024-09-17T05:46:51.583973+0000","last_peered":"2024-09-17T05:46:51.583973+0000","last_clean":"2024-09-17T05:46:51.583973+0000","last_became_active":"2024-09-17T05:46:50.553651+0000","last_became_peered":"2024-09-17T05:46:50.553651+0000","last_unstale":"2024-09-17T05:46:51.583973+0000","last_undegraded":"2024-09-17T05:46:51.583973+0000","last_fullsized":"2024-09-17T05:46:51.583973+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:46:49.528019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:46:49.528019+0000","last_clean_scrub_stamp":"2024-09-17T05:46:49.528019+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:08:30.756585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.1b","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2024-09-17T05:46:50.541004+0000","last_change":"2024-09-17T05:46:50.541004+0000","last_active":"2024-09-17T05:46:50.533972+0000","last_peered":"2024-09-17T05:46:50.533972+0000","last_clean":"2024-09-17T05:46:50.533972+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:46:50.541004+0000","last_undegraded":"2024-09-17T05:46:50.541004+0000","last_fullsized":"2024-09-17T05:46:50.541004+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:46:50.533972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:46:50.533972+0000","last_clean_scrub_stamp":"2024-09-17T05:46:50.533972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.1a","version":"71'1","reported_seq":14,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-17T05:46:51.585449+0000","last_change":"2024-09-17T05:46:50.561274+0000","last_active":"2024-09-17T05:46:51.585449+0000","last_peered":"2024-09-17T05:46:51.585449+0000","last_clean":"2024-09-17T05:46:51.585449+0000","last_became_active":"2024-09-17T05:46:50.560729+0000","last_became_peered":"2024-09-17T05:46:50.560729+0000","last_unstale":"2024-09-17T05:46:51.585449+0000","last_undegraded":"2024-09-17T05:46:51.585449+0000","last_fullsized":"2024-09-17T05:46:51.585449+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:46:49.528019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:46:49.528019+0000","last_clean_scrub_stamp":"2024-09-17T05:46:49.528019+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:46:48.701238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.18","version":"0'0","reported_seq":10,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-17T05:46:51.569374+0000","last_change":"2024-09-17T05:46:51.568431+0000","last_active":"2024-09-17T05:46:51.569374+0000","last_peered":"2024-09-17T05:46:51.569374+0000","last_clean":"2024-09-17T05:46:51.569374+0000","last_became_active":"2024-09-17T05:46:51.568066+0000","last_became_peered":"2024-09-17T05:46:51.568066+0000","last_unstale":"2024-09-17T05:46:51.569374+0000","last_undegraded":"2024-09-17T05:46:51.569374+0000","last_fullsized":"2024-09-17T05:46:51.569374+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:46:50.533972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:46:50.533972+0000","last_clean_scrub_stamp":"2024-09-17T05:46:50.533972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:12:15.570105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.19","version":"0'0","reported_seq":13,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-17T05:46:51.550635+0000","last_change":"2024-09-17T05:46:50.552167+0000","last_active":"2024-09-17T05:46:51.550635+0000","last_peered":"2024-09-17T05:46:51.550635+0000","last_clean":"2024-09-17T05:46:51.550635+0000","last_became_active":"2024-09-17T05:46:50.551856+0000","last_became_peered":"2024-09-17T05:46:50.551856+0000","last_unstale":"2024-09-17T05:46:51.550635+0000","last_undegraded":"2024-09-17T05:46:51.550635+0000","last_fullsized":"2024-09-17T05:46:51.550635+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:46:49.528019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:46:49.528019+0000","last_clean_scrub_stamp":"2024-09-17T05:46:49.528019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:23:08.023320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.19","version":"0'0","reported_seq":13,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-17T05:46:52.574533+0000","last_change":"2024-09-17T05:46:51.569311+0000","last_active":"2024-09-17T05:46:52.574533+0000","last_peered":"2024-09-17T05:46:52.574533+0000","last_clean":"2024-09-17T05:46:52.574533+0000","last_became_active":"2024-09-17T05:46:51.569013+0000","last_became_peered":"2024-09-17T05:46:51.569013+0000","last_unstale":"2024-09-17T05:46:52.574533+0000","last_undegraded":"2024-09-17T05:46:52.574533+0000","last_fullsized":"2024-09-17T05:46:52.574533+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:46:50.533972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:46:50.533972+0000","last_clean_scrub_stamp":"2024-09-17T05:46:50.533972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:28:30.156588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.18","version":"0'0","reported_seq":13,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-17T05:46:51.552307+0000","last_change":"2024-09-17T05:46:50.552379+0000","last_active":"2024-09-17T05:46:51.552307+0000","last_peered":"2024-09-17T05:46:51.552307+0000","last_clean":"2024-09-17T05:46:51.552307+0000","last_became_active":"2024-09-17T05:46:50.552079+0000","last_became_peered":"2024-09-17T05:46:50.552079+0000","last_unstale":"2024-09-17T05:46:51.552307+0000","last_undegraded":"2024-09-17T05:46:51.552307+0000","last_fullsized":"2024-09-17T05:46:51.552307+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:46:49.528019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:46:49.528019+0000","last_clean_scrub_stamp":"2024-09-17T05:46:49.528019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:56:26.674599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.16","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2024-09-17T05:46:50.540731+0000","last_change":"2024-09-17T05:46:50.540731+0000","last_active":"2024-09-17T05:46:50.533972+0000","last_peered":"2024-09-17T05:46:50.533972+0000","last_clean":"2024-09-17T05:46:50.533972+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:46:50.540731+0000","last_undegraded":"2024-09-17T05:46:50.540731+0000","last_fullsized":"2024-09-17T05:46:50.540731+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:46:50.533972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:46:50.533972+0000","last_clean_scrub_stamp":"2024-09-17T05:46:50.533972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.17","version":"0'0","reported_seq":10,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-09-17T05:46:50.557304+0000","last_change":"2024-09-17T05:46:50.550428+0000","last_active":"2024-09-17T05:46:50.557304+0000","last_peered":"2024-09-17T05:46:50.557304+0000","last_clean":"2024-09-17T05:46:50.557304+0000","last_became_active":"2024-09-17T05:46:50.549751+0000","last_became_peered":"2024-09-17T05:46:50.549751+0000","last_unstale":"2024-09-17T05:46:50.557304+0000","last_undegraded":"2024-09-17T05:46:50.557304+0000","last_fullsized":"2024-09-17T05:46:50.557304+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:46:49.528019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:46:49.528019+0000","last_clean_scrub_stamp":"2024-09-17T05:46:49.528019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:03:27.946146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.17","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2024-09-17T05:46:50.546958+0000","last_change":"2024-09-17T05:46:50.546958+0000","last_active":"2024-09-17T05:46:50.533972+0000","last_peered":"2024-09-17T05:46:50.533972+0000","last_clean":"2024-09-17T05:46:50.533972+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:46:50.546958+0000","last_undegraded":"2024-09-17T05:46:50.546958+0000","last_fullsized":"2024-09-17T05:46:50.546958+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:46:50.533972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:46:50.533972+0000","last_clean_scrub_stamp":"2024-09-17T05:46:50.533972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.16","version":"0'0","reported_seq":13,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-17T05:46:51.565295+0000","last_change":"2024-09-17T05:46:50.556469+0000","last_active":"2024-09-17T05:46:51.565295+0000","last_peered":"2024-09-17T05:46:51.565295+0000","last_clean":"2024-09-17T05:46:51.565295+0000","last_became_active":"2024-09-17T05:46:50.555925+0000","last_became_peered":"2024-09-17T05:46:50.555925+0000","last_unstale":"2024-09-17T05:46:51.565295+0000","last_undegraded":"2024-09-17T05:46:51.565295+0000","last_fullsized":"2024-09-17T05:46:51.565295+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:46:49.528019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:46:49.528019+0000","last_clean_scrub_stamp":"2024-09-17T05:46:49.528019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:11:55.261702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.14","version":"0'0","reported_seq":10,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-17T05:46:51.581701+0000","last_change":"2024-09-17T05:46:51.579751+0000","last_active":"2024-09-17T05:46:51.581701+0000","last_peered":"2024-09-17T05:46:51.581701+0000","last_clean":"2024-09-17T05:46:51.581701+0000","last_became_active":"2024-09-17T05:46:51.579430+0000","last_became_peered":"2024-09-17T05:46:51.579430+0000","last_unstale":"2024-09-17T05:46:51.581701+0000","last_undegraded":"2024-09-17T05:46:51.581701+0000","last_fullsized":"2024-09-17T05:46:51.581701+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:46:50.533972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:46:50.533972+0000","last_clean_scrub_stamp":"2024-09-17T05:46:50.533972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:59:19.488416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.15","version":"71'3","reported_seq":16,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-17T05:46:51.579084+0000","last_change":"2024-09-17T05:46:50.552409+0000","last_active":"2024-09-17T05:46:51.579084+0000","last_peered":"2024-09-17T05:46:51.579084+0000","last_clean":"2024-09-17T05:46:51.579084+0000","last_became_active":"2024-09-17T05:46:50.551178+0000","last_became_peered":"2024-09-17T05:46:50.551178+0000","last_unstale":"2024-09-17T05:46:51.579084+0000","last_undegraded":"2024-09-17T05:46:51.579084+0000","last_fullsized":"2024-09-17T05:46:51.579084+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:46:49.528019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:46:49.528019+0000","last_clean_scrub_stamp":"2024-09-17T05:46:49.528019+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:29:57.514758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.15","version":"0'0","reported_seq":10,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-17T05:46:51.557879+0000","last_change":"2024-09-17T05:46:51.555771+0000","last_active":"2024-09-17T05:46:51.557879+0000","last_peered":"2024-09-17T05:46:51.557879+0000","last_clean":"2024-09-17T05:46:51.557879+0000","last_became_active":"2024-09-17T05:46:51.555470+0000","last_became_peered":"2024-09-17T05:46:51.555470+0000","last_unstale":"2024-09-17T05:46:51.557879+0000","last_undegraded":"2024-09-17T05:46:51.557879+0000","last_fullsized":"2024-09-17T05:46:51.557879+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:46:50.533972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:46:50.533972+0000","last_clean_scrub_stamp":"2024-09-17T05:46:50.533972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:14:34.283104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.14","version":"71'6","reported_seq":19,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-17T05:46:51.586126+0000","last_change":"2024-09-17T05:46:50.553143+0000","last_active":"2024-09-17T05:46:51.586126+0000","last_peered":"2024-09-17T05:46:51.586126+0000","last_clean":"2024-09-17T05:46:51.586126+0000","last_became_active":"2024-09-17T05:46:50.552549+0000","last_became_peered":"2024-09-17T05:46:50.552549+0000","last_unstale":"2024-09-17T05:46:51.586126+0000","last_undegraded":"2024-09-17T05:46:51.586126+0000","last_fullsized":"2024-09-17T05:46:51.586126+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:46:49.528019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:46:49.528019+0000","last_clean_scrub_stamp":"2024-09-17T05:46:49.528019+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:04:38.547894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.12","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2024-09-17T05:46:50.545558+0000","last_change":"2024-09-17T05:46:50.545558+0000","last_active":"2024-09-17T05:46:50.533972+0000","last_peered":"2024-09-17T05:46:50.533972+0000","last_clean":"2024-09-17T05:46:50.533972+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:46:50.545558+0000","last_undegraded":"2024-09-17T05:46:50.545558+0000","last_fullsized":"2024-09-17T05:46:50.545558+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:46:50.533972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:46:50.533972+0000","last_clean_scrub_stamp":"2024-09-17T05:46:50.533972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.13","version":"71'2","reported_seq":15,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-17T05:46:51.577782+0000","last_change":"2024-09-17T05:46:50.553892+0000","last_active":"2024-09-17T05:46:51.577782+0000","last_peered":"2024-09-17T05:46:51.577782+0000","last_clean":"2024-09-17T05:46:51.577782+0000","last_became_active":"2024-09-17T05:46:50.553567+0000","last_became_peered":"2024-09-17T05:46:50.553567+0000","last_unstale":"2024-09-17T05:46:51.577782+0000","last_undegraded":"2024-09-17T05:46:51.577782+0000","last_fullsized":"2024-09-17T05:46:51.577782+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:46:49.528019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:46:49.528019+0000","last_clean_scrub_stamp":"2024-09-17T05:46:49.528019+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:16:32.532491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.13","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2024-09-17T05:46:50.541871+0000","last_change":"2024-09-17T05:46:50.541871+0000","last_active":"2024-09-17T05:46:50.533972+0000","last_peered":"2024-09-17T05:46:50.533972+0000","last_clean":"2024-09-17T05:46:50.533972+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:46:50.541871+0000","last_undegraded":"2024-09-17T05:46:50.541871+0000","last_fullsized":"2024-09-17T05:46:50.541871+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:46:50.533972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:46:50.533972+0000","last_clean_scrub_stamp":"2024-09-17T05:46:50.533972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.12","version":"0'0","reported_seq":13,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-17T05:46:51.567763+0000","last_change":"2024-09-17T05:46:50.557441+0000","last_active":"2024-09-17T05:46:51.567763+0000","last_peered":"2024-09-17T05:46:51.567763+0000","last_clean":"2024-09-17T05:46:51.567763+0000","last_became_active":"2024-09-17T05:46:50.557121+0000","last_became_peered":"2024-09-17T05:46:50.557121+0000","last_unstale":"2024-09-17T05:46:51.567763+0000","last_undegraded":"2024-09-17T05:46:51.567763+0000","last_fullsized":"2024-09-17T05:46:51.567763+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:46:49.528019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:46:49.528019+0000","last_clean_scrub_stamp":"2024-09-17T05:46:49.528019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:52:52.514589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.10","version":"0'0","reported_seq":13,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-17T05:46:52.574474+0000","last_change":"2024-09-17T05:46:51.580220+0000","last_active":"2024-09-17T05:46:52.574474+0000","last_peered":"2024-09-17T05:46:52.574474+0000","last_clean":"2024-09-17T05:46:52.574474+0000","last_became_active":"2024-09-17T05:46:51.579877+0000","last_became_peered":"2024-09-17T05:46:51.579877+0000","last_unstale":"2024-09-17T05:46:52.574474+0000","last_undegraded":"2024-09-17T05:46:52.574474+0000","last_fullsized":"2024-09-17T05:46:52.574474+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:46:50.533972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:46:50.533972+0000","last_clean_scrub_stamp":"2024-09-17T05:46:50.533972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:07:06.372655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.11","version":"0'0","reported_seq":10,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-09-17T05:46:50.550575+0000","last_change":"2024-09-17T05:46:50.549371+0000","last_active":"2024-09-17T05:46:50.550575+0000","last_peered":"2024-09-17T05:46:50.550575+0000","last_clean":"2024-09-17T05:46:50.550575+0000","last_became_active":"2024-09-17T05:46:50.548998+0000","last_became_peered":"2024-09-17T05:46:50.548998+0000","last_unstale":"2024-09-17T05:46:50.550575+0000","last_undegraded":"2024-09-17T05:46:50.550575+0000","last_fullsized":"2024-09-17T05:46:50.550575+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:46:49.528019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:46:49.528019+0000","last_clean_scrub_stamp":"2024-09-17T05:46:49.528019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:12:18.888931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.11","version":"0'0","reported_seq":10,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-17T05:46:51.564902+0000","last_change":"2024-09-17T05:46:51.562481+0000","last_active":"2024-09-17T05:46:51.564902+0000","last_peered":"2024-09-17T05:46:51.564902+0000","last_clean":"2024-09-17T05:46:51.564902+0000","last_became_active":"2024-09-17T05:46:51.562122+0000","last_became_peered":"2024-09-17T05:46:51.562122+0000","last_unstale":"2024-09-17T05:46:51.564902+0000","last_undegraded":"2024-09-17T05:46:51.564902+0000","last_fullsized":"2024-09-17T05:46:51.564902+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:46:50.533972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:46:50.533972+0000","last_clean_scrub_stamp":"2024-09-17T05:46:50.533972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:28:26.034113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.10","version":"0'0","reported_seq":10,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-09-17T05:46:50.557348+0000","last_change":"2024-09-17T05:46:50.552842+0000","last_active":"2024-09-17T05:46:50.557348+0000","last_peered":"2024-09-17T05:46:50.557348+0000","last_clean":"2024-09-17T05:46:50.557348+0000","last_became_active":"2024-09-17T05:46:50.552520+0000","last_became_peered":"2024-09-17T05:46:50.552520+0000","last_unstale":"2024-09-17T05:46:50.557348+0000","last_undegraded":"2024-09-17T05:46:50.557348+0000","last_fullsized":"2024-09-17T05:46:50.557348+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:46:49.528019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:46:49.528019+0000","last_clean_scrub_stamp":"2024-09-17T05:46:49.528019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:09:14.458610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.e","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2024-09-17T05:46:50.540783+0000","last_change":"2024-09-17T05:46:50.540783+0000","last_active":"2024-09-17T05:46:50.533972+0000","last_peered":"2024-09-17T05:46:50.533972+0000","last_clean":"2024-09-17T05:46:50.533972+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:46:50.540783+0000","last_undegraded":"2024-09-17T05:46:50.540783+0000","last_fullsized":"2024-09-17T05:46:50.540783+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:46:50.533972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:46:50.533972+0000","last_clean_scrub_stamp":"2024-09-17T05:46:50.533972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.f","version":"71'1","reported_seq":14,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-17T05:46:51.586405+0000","last_change":"2024-09-17T05:46:50.555496+0000","last_active":"2024-09-17T05:46:51.586405+0000","last_peered":"2024-09-17T05:46:51.586405+0000","last_clean":"2024-09-17T05:46:51.586405+0000","last_became_active":"2024-09-17T05:46:50.555176+0000","last_became_peered":"2024-09-17T05:46:50.555176+0000","last_unstale":"2024-09-17T05:46:51.586405+0000","last_undegraded":"2024-09-17T05:46:51.586405+0000","last_fullsized":"2024-09-17T05:46:51.586405+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:46:49.528019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:46:49.528019+0000","last_clean_scrub_stamp":"2024-09-17T05:46:49.528019+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:22:31.843476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.f","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2024-09-17T05:46:50.546409+0000","last_change":"2024-09-17T05:46:50.546409+0000","last_active":"2024-09-17T05:46:50.533972+0000","last_peered":"2024-09-17T05:46:50.533972+0000","last_clean":"2024-09-17T05:46:50.533972+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:46:50.546409+0000","last_undegraded":"2024-09-17T05:46:50.546409+0000","last_fullsized":"2024-09-17T05:46:50.546409+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:46:50.533972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:46:50.533972+0000","last_clean_scrub_stamp":"2024-09-17T05:46:50.533972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.e","version":"0'0","reported_seq":10,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-09-17T05:46:50.559698+0000","last_change":"2024-09-17T05:46:50.558925+0000","last_active":"2024-09-17T05:46:50.559698+0000","last_peered":"2024-09-17T05:46:50.559698+0000","last_clean":"2024-09-17T05:46:50.559698+0000","last_became_active":"2024-09-17T05:46:50.558622+0000","last_became_peered":"2024-09-17T05:46:50.558622+0000","last_unstale":"2024-09-17T05:46:50.559698+0000","last_undegraded":"2024-09-17T05:46:50.559698+0000","last_fullsized":"2024-09-17T05:46:50.559698+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:46:49.528019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:46:49.528019+0000","last_clean_scrub_stamp":"2024-09-17T05:46:49.528019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:06:48.504471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.c","version":"0'0","reported_seq":10,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-17T05:46:51.558979+0000","last_change":"2024-09-17T05:46:51.556516+0000","last_active":"2024-09-17T05:46:51.558979+0000","last_peered":"2024-09-17T05:46:51.558979+0000","last_clean":"2024-09-17T05:46:51.558979+0000","last_became_active":"2024-09-17T05:46:51.555785+0000","last_became_peered":"2024-09-17T05:46:51.555785+0000","last_unstale":"2024-09-17T05:46:51.558979+0000","last_undegraded":"2024-09-17T05:46:51.558979+0000","last_fullsized":"2024-09-17T05:46:51.558979+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:46:50.533972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:46:50.533972+0000","last_clean_scrub_stamp":"2024-09-17T05:46:50.533972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:09:00.267194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.d","version":"71'1","reported_seq":14,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-17T05:46:51.586143+0000","last_change":"2024-09-17T05:46:50.560558+0000","last_active":"2024-09-17T05:46:51.586143+0000","last_peered":"2024-09-17T05:46:51.586143+0000","last_clean":"2024-09-17T05:46:51.586143+0000","last_became_active":"2024-09-17T05:46:50.560242+0000","last_became_peered":"2024-09-17T05:46:50.560242+0000","last_unstale":"2024-09-17T05:46:51.586143+0000","last_undegraded":"2024-09-17T05:46:51.586143+0000","last_fullsized":"2024-09-17T05:46:51.586143+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:46:49.528019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:46:49.528019+0000","last_clean_scrub_stamp":"2024-09-17T05:46:49.528019+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:30:56.705724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.d","version":"0'0","reported_seq":10,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-17T05:46:51.558964+0000","last_change":"2024-09-17T05:46:51.557975+0000","last_active":"2024-09-17T05:46:51.558964+0000","last_peered":"2024-09-17T05:46:51.558964+0000","last_clean":"2024-09-17T05:46:51.558964+0000","last_became_active":"2024-09-17T05:46:51.557674+0000","last_became_peered":"2024-09-17T05:46:51.557674+0000","last_unstale":"2024-09-17T05:46:51.558964+0000","last_undegraded":"2024-09-17T05:46:51.558964+0000","last_fullsized":"2024-09-17T05:46:51.558964+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:46:50.533972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:46:50.533972+0000","last_clean_scrub_stamp":"2024-09-17T05:46:50.533972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:47:53.991131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.c","version":"0'0","reported_seq":10,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-09-17T05:46:50.559371+0000","last_change":"2024-09-17T05:46:50.558154+0000","last_active":"2024-09-17T05:46:50.559371+0000","last_peered":"2024-09-17T05:46:50.559371+0000","last_clean":"2024-09-17T05:46:50.559371+0000","last_became_active":"2024-09-17T05:46:50.557830+0000","last_became_peered":"2024-09-17T05:46:50.557830+0000","last_unstale":"2024-09-17T05:46:50.559371+0000","last_undegraded":"2024-09-17T05:46:50.559371+0000","last_fullsized":"2024-09-17T05:46:50.559371+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:46:49.528019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:46:49.528019+0000","last_clean_scrub_stamp":"2024-09-17T05:46:49.528019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:55:56.754700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.b","version":"0'0","reported_seq":10,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-17T05:46:51.566491+0000","last_change":"2024-09-17T05:46:51.559821+0000","last_active":"2024-09-17T05:46:51.566491+0000","last_peered":"2024-09-17T05:46:51.566491+0000","last_clean":"2024-09-17T05:46:51.566491+0000","last_became_active":"2024-09-17T05:46:51.559470+0000","last_became_peered":"2024-09-17T05:46:51.559470+0000","last_unstale":"2024-09-17T05:46:51.566491+0000","last_undegraded":"2024-09-17T05:46:51.566491+0000","last_fullsized":"2024-09-17T05:46:51.566491+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:46:50.533972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:46:50.533972+0000","last_clean_scrub_stamp":"2024-09-17T05:46:50.533972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:29:39.351334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.a","version":"0'0","reported_seq":13,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-17T05:46:51.568046+0000","last_change":"2024-09-17T05:46:50.561013+0000","last_active":"2024-09-17T05:46:51.568046+0000","last_peered":"2024-09-17T05:46:51.568046+0000","last_clean":"2024-09-17T05:46:51.568046+0000","last_became_active":"2024-09-17T05:46:50.560656+0000","last_became_peered":"2024-09-17T05:46:50.560656+0000","last_unstale":"2024-09-17T05:46:51.568046+0000","last_undegraded":"2024-09-17T05:46:51.568046+0000","last_fullsized":"2024-09-17T05:46:51.568046+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:46:49.528019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:46:49.528019+0000","last_clean_scrub_stamp":"2024-09-17T05:46:49.528019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:12:32.519550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.8","version":"0'0","reported_seq":10,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-17T05:46:51.581523+0000","last_change":"2024-09-17T05:46:51.579266+0000","last_active":"2024-09-17T05:46:51.581523+0000","last_peered":"2024-09-17T05:46:51.581523+0000","last_clean":"2024-09-17T05:46:51.581523+0000","last_became_active":"2024-09-17T05:46:51.578937+0000","last_became_peered":"2024-09-17T05:46:51.578937+0000","last_unstale":"2024-09-17T05:46:51.581523+0000","last_undegraded":"2024-09-17T05:46:51.581523+0000","last_fullsized":"2024-09-17T05:46:51.581523+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:46:50.533972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:46:50.533972+0000","last_clean_scrub_stamp":"2024-09-17T05:46:50.533972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:16:21.255512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.9","version":"0'0","reported_seq":10,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-09-17T05:46:50.556732+0000","last_change":"2024-09-17T05:46:50.555771+0000","last_active":"2024-09-17T05:46:50.556732+0000","last_peered":"2024-09-17T05:46:50.556732+0000","last_clean":"2024-09-17T05:46:50.556732+0000","last_became_active":"2024-09-17T05:46:50.555434+0000","last_became_peered":"2024-09-17T05:46:50.555434+0000","last_unstale":"2024-09-17T05:46:50.556732+0000","last_undegraded":"2024-09-17T05:46:50.556732+0000","last_fullsized":"2024-09-17T05:46:50.556732+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:46:49.528019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:46:49.528019+0000","last_clean_scrub_stamp":"2024-09-17T05:46:49.528019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:55:23.341829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.9","version":"0'0","reported_seq":10,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-17T05:46:51.579051+0000","last_change":"2024-09-17T05:46:51.576821+0000","last_active":"2024-09-17T05:46:51.579051+0000","last_peered":"2024-09-17T05:46:51.579051+0000","last_clean":"2024-09-17T05:46:51.579051+0000","last_became_active":"2024-09-17T05:46:51.576334+0000","last_became_peered":"2024-09-17T05:46:51.576334+0000","last_unstale":"2024-09-17T05:46:51.579051+0000","last_undegraded":"2024-09-17T05:46:51.579051+0000","last_fullsized":"2024-09-17T05:46:51.579051+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:46:50.533972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:46:50.533972+0000","last_clean_scrub_stamp":"2024-09-17T05:46:50.533972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:39:07.753207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.8","version":"0'0","reported_seq":15,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-17T05:46:52.574325+0000","last_change":"2024-09-17T05:46:50.554397+0000","last_active":"2024-09-17T05:46:52.574325+0000","last_peered":"2024-09-17T05:46:52.574325+0000","last_clean":"2024-09-17T05:46:52.574325+0000","last_became_active":"2024-09-17T05:46:50.554006+0000","last_became_peered":"2024-09-17T05:46:50.554006+0000","last_unstale":"2024-09-17T05:46:52.574325+0000","last_undegraded":"2024-09-17T05:46:52.574325+0000","last_fullsized":"2024-09-17T05:46:52.574325+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:46:49.528019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:46:49.528019+0000","last_clean_scrub_stamp":"2024-09-17T05:46:49.528019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:20:01.660902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.6","version":"0'0","reported_seq":13,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-17T05:46:52.574697+0000","last_change":"2024-09-17T05:46:51.563526+0000","last_active":"2024-09-17T05:46:52.574697+0000","last_peered":"2024-09-17T05:46:52.574697+0000","last_clean":"2024-09-17T05:46:52.574697+0000","last_became_active":"2024-09-17T05:46:51.562568+0000","last_became_peered":"2024-09-17T05:46:51.562568+0000","last_unstale":"2024-09-17T05:46:52.574697+0000","last_undegraded":"2024-09-17T05:46:52.574697+0000","last_fullsized":"2024-09-17T05:46:52.574697+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:46:50.533972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:46:50.533972+0000","last_clean_scrub_stamp":"2024-09-17T05:46:50.533972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:38:37.039701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.7","version":"71'2","reported_seq":15,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-17T05:46:51.586400+0000","last_change":"2024-09-17T05:46:50.556372+0000","last_active":"2024-09-17T05:46:51.586400+0000","last_peered":"2024-09-17T05:46:51.586400+0000","last_clean":"2024-09-17T05:46:51.586400+0000","last_became_active":"2024-09-17T05:46:50.556058+0000","last_became_peered":"2024-09-17T05:46:50.556058+0000","last_unstale":"2024-09-17T05:46:51.586400+0000","last_undegraded":"2024-09-17T05:46:51.586400+0000","last_fullsized":"2024-09-17T05:46:51.586400+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:46:49.528019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:46:49.528019+0000","last_clean_scrub_stamp":"2024-09-17T05:46:49.528019+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:32:09.112921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.7","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2024-09-17T05:46:50.539919+0000","last_change":"2024-09-17T05:46:50.539919+0000","last_active":"2024-09-17T05:46:50.533972+0000","last_peered":"2024-09-17T05:46:50.533972+0000","last_clean":"2024-09-17T05:46:50.533972+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:46:50.539919+0000","last_undegraded":"2024-09-17T05:46:50.539919+0000","last_fullsized":"2024-09-17T05:46:50.539919+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:46:50.533972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:46:50.533972+0000","last_clean_scrub_stamp":"2024-09-17T05:46:50.533972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.6","version":"0'0","reported_seq":10,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-09-17T05:46:50.547911+0000","last_change":"2024-09-17T05:46:50.544381+0000","last_active":"2024-09-17T05:46:50.547911+0000","last_peered":"2024-09-17T05:46:50.547911+0000","last_clean":"2024-09-17T05:46:50.547911+0000","last_became_active":"2024-09-17T05:46:50.543986+0000","last_became_peered":"2024-09-17T05:46:50.543986+0000","last_unstale":"2024-09-17T05:46:50.547911+0000","last_undegraded":"2024-09-17T05:46:50.547911+0000","last_fullsized":"2024-09-17T05:46:50.547911+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:46:49.528019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:46:49.528019+0000","last_clean_scrub_stamp":"2024-09-17T05:46:49.528019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:28:08.120187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.4","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2024-09-17T05:46:50.546088+0000","last_change":"2024-09-17T05:46:50.546088+0000","last_active":"2024-09-17T05:46:50.533972+0000","last_peered":"2024-09-17T05:46:50.533972+0000","last_clean":"2024-09-17T05:46:50.533972+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:46:50.546088+0000","last_undegraded":"2024-09-17T05:46:50.546088+0000","last_fullsized":"2024-09-17T05:46:50.546088+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:46:50.533972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:46:50.533972+0000","last_clean_scrub_stamp":"2024-09-17T05:46:50.533972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.5","version":"0'0","reported_seq":13,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-17T05:46:51.552653+0000","last_change":"2024-09-17T05:46:50.549973+0000","last_active":"2024-09-17T05:46:51.552653+0000","last_peered":"2024-09-17T05:46:51.552653+0000","last_clean":"2024-09-17T05:46:51.552653+0000","last_became_active":"2024-09-17T05:46:50.549694+0000","last_became_peered":"2024-09-17T05:46:50.549694+0000","last_unstale":"2024-09-17T05:46:51.552653+0000","last_undegraded":"2024-09-17T05:46:51.552653+0000","last_fullsized":"2024-09-17T05:46:51.552653+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:46:49.528019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:46:49.528019+0000","last_clean_scrub_stamp":"2024-09-17T05:46:49.528019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:31:19.308660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.5","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2024-09-17T05:46:50.547618+0000","last_change":"2024-09-17T05:46:50.547618+0000","last_active":"2024-09-17T05:46:50.533972+0000","last_peered":"2024-09-17T05:46:50.533972+0000","last_clean":"2024-09-17T05:46:50.533972+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:46:50.547618+0000","last_undegraded":"2024-09-17T05:46:50.547618+0000","last_fullsized":"2024-09-17T05:46:50.547618+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:46:50.533972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:46:50.533972+0000","last_clean_scrub_stamp":"2024-09-17T05:46:50.533972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.4","version":"0'0","reported_seq":15,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-17T05:46:52.574697+0000","last_change":"2024-09-17T05:46:50.547993+0000","last_active":"2024-09-17T05:46:52.574697+0000","last_peered":"2024-09-17T05:46:52.574697+0000","last_clean":"2024-09-17T05:46:52.574697+0000","last_became_active":"2024-09-17T05:46:50.547677+0000","last_became_peered":"2024-09-17T05:46:50.547677+0000","last_unstale":"2024-09-17T05:46:52.574697+0000","last_undegraded":"2024-09-17T05:46:52.574697+0000","last_fullsized":"2024-09-17T05:46:52.574697+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:46:49.528019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:46:49.528019+0000","last_clean_scrub_stamp":"2024-09-17T05:46:49.528019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:26:15.799059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.2","version":"0'0","reported_seq":10,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-17T05:46:51.565532+0000","last_change":"2024-09-17T05:46:51.563537+0000","last_active":"2024-09-17T05:46:51.565532+0000","last_peered":"2024-09-17T05:46:51.565532+0000","last_clean":"2024-09-17T05:46:51.565532+0000","last_became_active":"2024-09-17T05:46:51.563188+0000","last_became_peered":"2024-09-17T05:46:51.563188+0000","last_unstale":"2024-09-17T05:46:51.565532+0000","last_undegraded":"2024-09-17T05:46:51.565532+0000","last_fullsized":"2024-09-17T05:46:51.565532+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:46:50.533972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:46:50.533972+0000","last_clean_scrub_stamp":"2024-09-17T05:46:50.533972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:29:52.002441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.3","version":"0'0","reported_seq":13,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-17T05:46:51.553448+0000","last_change":"2024-09-17T05:46:50.556229+0000","last_active":"2024-09-17T05:46:51.553448+0000","last_peered":"2024-09-17T05:46:51.553448+0000","last_clean":"2024-09-17T05:46:51.553448+0000","last_became_active":"2024-09-17T05:46:50.555876+0000","last_became_peered":"2024-09-17T05:46:50.555876+0000","last_unstale":"2024-09-17T05:46:51.553448+0000","last_undegraded":"2024-09-17T05:46:51.553448+0000","last_fullsized":"2024-09-17T05:46:51.553448+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:46:49.528019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:46:49.528019+0000","last_clean_scrub_stamp":"2024-09-17T05:46:49.528019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:04:36.653508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.3","version":"0'0","reported_seq":10,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-17T05:46:51.576711+0000","last_change":"2024-09-17T05:46:51.575439+0000","last_active":"2024-09-17T05:46:51.576711+0000","last_peered":"2024-09-17T05:46:51.576711+0000","last_clean":"2024-09-17T05:46:51.576711+0000","last_became_active":"2024-09-17T05:46:51.575141+0000","last_became_peered":"2024-09-17T05:46:51.575141+0000","last_unstale":"2024-09-17T05:46:51.576711+0000","last_undegraded":"2024-09-17T05:46:51.576711+0000","last_fullsized":"2024-09-17T05:46:51.576711+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:46:50.533972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:46:50.533972+0000","last_clean_scrub_stamp":"2024-09-17T05:46:50.533972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:57:37.513949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.2","version":"0'0","reported_seq":13,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-17T05:46:51.550642+0000","last_change":"2024-09-17T05:46:50.552938+0000","last_active":"2024-09-17T05:46:51.550642+0000","last_peered":"2024-09-17T05:46:51.550642+0000","last_clean":"2024-09-17T05:46:51.550642+0000","last_became_active":"2024-09-17T05:46:50.552636+0000","last_became_peered":"2024-09-17T05:46:50.552636+0000","last_unstale":"2024-09-17T05:46:51.550642+0000","last_undegraded":"2024-09-17T05:46:51.550642+0000","last_fullsized":"2024-09-17T05:46:51.550642+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:46:49.528019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:46:49.528019+0000","last_clean_scrub_stamp":"2024-09-17T05:46:49.528019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:24:36.778807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.0","version":"0'0","reported_seq":10,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-17T05:46:51.568417+0000","last_change":"2024-09-17T05:46:51.566304+0000","last_active":"2024-09-17T05:46:51.568417+0000","last_peered":"2024-09-17T05:46:51.568417+0000","last_clean":"2024-09-17T05:46:51.568417+0000","last_became_active":"2024-09-17T05:46:51.565283+0000","last_became_peered":"2024-09-17T05:46:51.565283+0000","last_unstale":"2024-09-17T05:46:51.568417+0000","last_undegraded":"2024-09-17T05:46:51.568417+0000","last_fullsized":"2024-09-17T05:46:51.568417+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:46:50.533972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:46:50.533972+0000","last_clean_scrub_stamp":"2024-09-17T05:46:50.533972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:46:16.006152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.1","version":"0'0","reported_seq":10,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-09-17T05:46:50.557384+0000","last_change":"2024-09-17T05:46:50.552458+0000","last_active":"2024-09-17T05:46:50.557384+0000","last_peered":"2024-09-17T05:46:50.557384+0000","last_clean":"2024-09-17T05:46:50.557384+0000","last_became_active":"2024-09-17T05:46:50.552107+0000","last_became_peered":"2024-09-17T05:46:50.552107+0000","last_unstale":"2024-09-17T05:46:50.557384+0000","last_undegraded":"2024-09-17T05:46:50.557384+0000","last_fullsized":"2024-09-17T05:46:50.557384+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:46:49.528019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:46:49.528019+0000","last_clean_scrub_stamp":"2024-09-17T05:46:49.528019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:24:45.137886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1","version":"0'0","reported_seq":10,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-17T05:46:51.575017+0000","last_change":"2024-09-17T05:46:51.573577+0000","last_active":"2024-09-17T05:46:51.575017+0000","last_peered":"2024-09-17T05:46:51.575017+0000","last_clean":"2024-09-17T05:46:51.575017+0000","last_became_active":"2024-09-17T05:46:51.569489+0000","last_became_peered":"2024-09-17T05:46:51.569489+0000","last_unstale":"2024-09-17T05:46:51.575017+0000","last_undegraded":"2024-09-17T05:46:51.575017+0000","last_fullsized":"2024-09-17T05:46:51.575017+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:46:50.533972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:46:50.533972+0000","last_clean_scrub_stamp":"2024-09-17T05:46:50.533972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:26:30.678628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.0","version":"0'0","reported_seq":13,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-17T05:46:51.567574+0000","last_change":"2024-09-17T05:46:50.558270+0000","last_active":"2024-09-17T05:46:51.567574+0000","last_peered":"2024-09-17T05:46:51.567574+0000","last_clean":"2024-09-17T05:46:51.567574+0000","last_became_active":"2024-09-17T05:46:50.557754+0000","last_became_peered":"2024-09-17T05:46:50.557754+0000","last_unstale":"2024-09-17T05:46:51.567574+0000","last_undegraded":"2024-09-17T05:46:51.567574+0000","last_fullsized":"2024-09-17T05:46:51.567574+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:46:49.528019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:46:49.528019+0000","last_clean_scrub_stamp":"2024-09-17T05:46:49.528019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:05:59.732974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.a","version":"0'0","reported_seq":10,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-17T05:46:51.572200+0000","last_change":"2024-09-17T05:46:51.570833+0000","last_active":"2024-09-17T05:46:51.572200+0000","last_peered":"2024-09-17T05:46:51.572200+0000","last_clean":"2024-09-17T05:46:51.572200+0000","last_became_active":"2024-09-17T05:46:51.570468+0000","last_became_peered":"2024-09-17T05:46:51.570468+0000","last_unstale":"2024-09-17T05:46:51.572200+0000","last_undegraded":"2024-09-17T05:46:51.572200+0000","last_fullsized":"2024-09-17T05:46:51.572200+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:46:50.533972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:46:50.533972+0000","last_clean_scrub_stamp":"2024-09-17T05:46:50.533972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:08:52.597158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.b","version":"71'2","reported_seq":15,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-17T05:46:51.586102+0000","last_change":"2024-09-17T05:46:50.559144+0000","last_active":"2024-09-17T05:46:51.586102+0000","last_peered":"2024-09-17T05:46:51.586102+0000","last_clean":"2024-09-17T05:46:51.586102+0000","last_became_active":"2024-09-17T05:46:50.558856+0000","last_became_peered":"2024-09-17T05:46:50.558856+0000","last_unstale":"2024-09-17T05:46:51.586102+0000","last_undegraded":"2024-09-17T05:46:51.586102+0000","last_fullsized":"2024-09-17T05:46:51.586102+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:46:49.528019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:46:49.528019+0000","last_clean_scrub_stamp":"2024-09-17T05:46:49.528019+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:33:50.200522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"19'72","reported_seq":196,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-09-17T05:46:50.551827+0000","last_change":"2024-09-17T05:41:48.539830+0000","last_active":"2024-09-17T05:46:50.551827+0000","last_peered":"2024-09-17T05:46:50.551827+0000","last_clean":"2024-09-17T05:46:50.551827+0000","last_became_active":"2024-09-17T05:41:48.538743+0000","last_became_peered":"2024-09-17T05:41:48.538743+0000","last_unstale":"2024-09-17T05:46:50.551827+0000","last_undegraded":"2024-09-17T05:46:50.551827+0000","last_fullsized":"2024-09-17T05:46:50.551827+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:47.152539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:47.152539+0000","last_clean_scrub_stamp":"2024-09-17T05:41:47.152539+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:08:02.952016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":11,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":10,"num_pg":32,"stat_sum":{"num_bytes":1828,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":4044,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":22,"ondisk_log_size":22,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":16,"seq":68719476802,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":58408,"kb_used_data":844,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94313432,"statfs":{"total":96636764160,"available":96576954368,"internally_reserved":0,"allocated":864256,"data_stored":359618,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":58915270},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":7,"up_from":15,"seq":64424509506,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":58964,"kb_used_data":1404,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94312876,"statfs":{"total":96636764160,"available":96576385024,"internally_reserved":0,"allocated":1437696,"data_stored":943063,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":58915274},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509505,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":58384,"kb_used_data":824,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94313456,"statfs":{"total":96636764160,"available":96576978944,"internally_reserved":0,"allocated":843776,"data_stored":352695,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":58915269},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509505,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":58384,"kb_used_data":824,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94313456,"statfs":{"total":96636764160,"available":96576978944,"internally_reserved":0,"allocated":843776,"data_stored":352695,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":58915269},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509505,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":58408,"kb_used_data":844,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94313432,"statfs":{"total":96636764160,"available":96576954368,"internally_reserved":0,"allocated":864256,"data_stored":359638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":58915271},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509505,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":58408,"kb_used_data":848,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94313432,"statfs":{"total":96636764160,"available":96576954368,"internally_reserved":0,"allocated":868352,"data_stored":361138,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":58915269},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509505,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":58420,"kb_used_data":856,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94313420,"statfs":{"total":96636764160,"available":96576942080,"internally_reserved":0,"allocated":876544,"data_stored":361754,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":58915269},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574913,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":46504,"kb_used_data":1428,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94325336,"statfs":{"total":96636764160,"available":96589144064,"internally_reserved":0,"allocated":1462272,"data_stored":956250,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":46135749},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2228,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-17T05:46:55.934 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-17T05:46:56.086 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:56.085+0000 7f4b8d68b640 1 -- 172.21.15.150:0/3435054177 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4b74003a00 msgr2=0x7f4b74003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:46:56.086 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:56.085+0000 7f4b8d68b640 1 --2- 172.21.15.150:0/3435054177 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4b74003a00 0x7f4b74003e70 secure :-1 s=READY pgs=809 cs=0 l=1 rev1=1 crypto rx=0x7f4b8000c290 tx=0x7f4b74005830 comp rx=0 tx=0).stop 2024-09-17T05:46:56.086 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:56.085+0000 7f4b877fe640 1 -- 172.21.15.150:0/3435054177 reap_dead start 2024-09-17T05:46:56.086 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:56.085+0000 7f4b8d68b640 1 -- 172.21.15.150:0/3435054177 shutdown_connections 2024-09-17T05:46:56.086 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:56.085+0000 7f4b8d68b640 1 -- 172.21.15.150:0/3435054177 >> 172.21.15.150:0/3435054177 conn(0x7f4b880b2e80 msgr2=0x7f4b880b3290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:46:56.086 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:56.085+0000 7f4b8d68b640 1 -- 172.21.15.150:0/3435054177 shutdown_connections 2024-09-17T05:46:56.086 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:56.085+0000 7f4b8d68b640 1 -- 172.21.15.150:0/3435054177 wait complete. 2024-09-17T05:46:56.087 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:56.087+0000 7f4b8d68b640 1 Processor -- start 2024-09-17T05:46:56.087 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:56.087+0000 7f4b8d68b640 1 -- start start 2024-09-17T05:46:56.090 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:56.088+0000 7f4b8d68b640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4b74003a00 0x7f4b88159890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:46:56.090 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:56.088+0000 7f4b8d68b640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4b880c72b0 0x7f4b8809e8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:46:56.090 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:56.088+0000 7f4b8d68b640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4b880c8da0 0x7f4b8809ee20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:46:56.090 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:56.088+0000 7f4b8d68b640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f4b880b4820 con 0x7f4b74003a00 2024-09-17T05:46:56.090 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:56.088+0000 7f4b8d68b640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f4b880b46a0 con 0x7f4b880c72b0 2024-09-17T05:46:56.090 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:56.088+0000 7f4b8d68b640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f4b880b49a0 con 0x7f4b880c8da0 2024-09-17T05:46:56.090 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:56.088+0000 7f4b86ffd640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4b74003a00 0x7f4b88159890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:46:56.090 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:56.088+0000 7f4b86ffd640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4b74003a00 0x7f4b88159890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:59806/0 (socket says 172.21.15.150:59806) 2024-09-17T05:46:56.090 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:56.088+0000 7f4b86ffd640 1 -- 172.21.15.150:0/4085939255 learned_addr learned my addr 172.21.15.150:0/4085939255 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:46:56.090 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:56.088+0000 7f4b867fc640 1 --2- 172.21.15.150:0/4085939255 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4b880c72b0 0x7f4b8809e8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:46:56.090 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:56.088+0000 7f4b877fe640 1 --2- 172.21.15.150:0/4085939255 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4b880c8da0 0x7f4b8809ee20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:46:56.091 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:56.088+0000 7f4b86ffd640 1 -- 172.21.15.150:0/4085939255 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4b880c8da0 msgr2=0x7f4b8809ee20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:46:56.091 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:56.088+0000 7f4b86ffd640 1 --2- 172.21.15.150:0/4085939255 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4b880c8da0 0x7f4b8809ee20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:56.091 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:56.088+0000 7f4b86ffd640 1 -- 172.21.15.150:0/4085939255 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4b880c72b0 msgr2=0x7f4b8809e8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:46:56.091 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:56.088+0000 7f4b86ffd640 1 --2- 172.21.15.150:0/4085939255 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4b880c72b0 0x7f4b8809e8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:56.091 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:56.088+0000 7f4b86ffd640 1 -- 172.21.15.150:0/4085939255 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4b8809d2f0 con 0x7f4b74003a00 2024-09-17T05:46:56.091 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:56.089+0000 7f4b86ffd640 1 --2- 172.21.15.150:0/4085939255 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4b74003a00 0x7f4b88159890 secure :-1 s=READY pgs=810 cs=0 l=1 rev1=1 crypto rx=0x7f4b8000c290 tx=0x7f4b80006d70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:46:56.091 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:56.089+0000 7f4b7f7fe640 1 -- 172.21.15.150:0/4085939255 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b80031040 con 0x7f4b74003a00 2024-09-17T05:46:56.091 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:56.089+0000 7f4b7f7fe640 1 -- 172.21.15.150:0/4085939255 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f4b800035f0 con 0x7f4b74003a00 2024-09-17T05:46:56.091 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:56.089+0000 7f4b7f7fe640 1 -- 172.21.15.150:0/4085939255 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b80003a00 con 0x7f4b74003a00 2024-09-17T05:46:56.091 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:56.089+0000 7f4b8d68b640 1 -- 172.21.15.150:0/4085939255 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4b881f6300 con 0x7f4b74003a00 2024-09-17T05:46:56.091 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:56.089+0000 7f4b8d68b640 1 -- 172.21.15.150:0/4085939255 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4b881f6020 con 0x7f4b74003a00 2024-09-17T05:46:56.092 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:56.090+0000 7f4b8d68b640 1 -- 172.21.15.150:0/4085939255 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4b8809d4c0 con 0x7f4b74003a00 2024-09-17T05:46:56.092 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:56.091+0000 7f4b7f7fe640 1 -- 172.21.15.150:0/4085939255 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 19) ==== 102563+0+0 (secure 0 0 0) 0x7f4b80034070 con 0x7f4b74003a00 2024-09-17T05:46:56.092 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:56.091+0000 7f4b7f7fe640 1 --2- 172.21.15.150:0/4085939255 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f4b68079820 0x7f4b6807bd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:46:56.092 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:56.091+0000 7f4b7f7fe640 1 -- 172.21.15.150:0/4085939255 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 5765+0+0 (secure 0 0 0) 0x7f4b800b9950 con 0x7f4b74003a00 2024-09-17T05:46:56.092 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:56.091+0000 7f4b867fc640 1 --2- 172.21.15.150:0/4085939255 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f4b68079820 0x7f4b6807bd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:46:56.093 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:56.092+0000 7f4b867fc640 1 --2- 172.21.15.150:0/4085939255 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f4b68079820 0x7f4b6807bd30 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f4b8815eef0 tx=0x7f4b700096f0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:46:56.096 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:56.096+0000 7f4b7f7fe640 1 -- 172.21.15.150:0/4085939255 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f4b80083000 con 0x7f4b74003a00 2024-09-17T05:46:56.269 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:56.268+0000 7f4b8d68b640 1 -- 172.21.15.150:0/4085939255 --> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f4b881f5da0 con 0x7f4b68079820 2024-09-17T05:46:56.273 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:56.273+0000 7f4b7f7fe640 1 -- 172.21.15.150:0/4085939255 <== mgr.4108 v2:172.21.15.176:6800/3631216395 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+249839 (secure 0 0 0) 0x7f4b7001c410 con 0x7f4b68079820 2024-09-17T05:46:56.276 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-09-17T05:46:56.277 INFO:teuthology.orchestra.run.smithi150.stderr:dumped all 2024-09-17T05:46:56.279 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:56.276+0000 7f4b8d68b640 1 -- 172.21.15.150:0/4085939255 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f4b68079820 msgr2=0x7f4b6807bd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:46:56.279 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:56.276+0000 7f4b8d68b640 1 --2- 172.21.15.150:0/4085939255 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f4b68079820 0x7f4b6807bd30 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f4b8815eef0 tx=0x7f4b700096f0 comp rx=0 tx=0).stop 2024-09-17T05:46:56.279 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:56.276+0000 7f4b8d68b640 1 -- 172.21.15.150:0/4085939255 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4b74003a00 msgr2=0x7f4b88159890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:46:56.279 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:56.276+0000 7f4b8d68b640 1 --2- 172.21.15.150:0/4085939255 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4b74003a00 0x7f4b88159890 secure :-1 s=READY pgs=810 cs=0 l=1 rev1=1 crypto rx=0x7f4b8000c290 tx=0x7f4b80006d70 comp rx=0 tx=0).stop 2024-09-17T05:46:56.279 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:56.276+0000 7f4b8d68b640 1 -- 172.21.15.150:0/4085939255 shutdown_connections 2024-09-17T05:46:56.279 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:56.276+0000 7f4b8d68b640 1 --2- 172.21.15.150:0/4085939255 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4b880c72b0 0x7f4b8809e8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:56.279 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:56.276+0000 7f4b8d68b640 1 --2- 172.21.15.150:0/4085939255 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f4b68079820 0x7f4b6807bd30 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:56.279 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:56.276+0000 7f4b8d68b640 1 --2- 172.21.15.150:0/4085939255 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4b880c8da0 0x7f4b8809ee20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:56.279 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:56.276+0000 7f4b8d68b640 1 --2- 172.21.15.150:0/4085939255 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4b74003a00 0x7f4b88159890 unknown :-1 s=CLOSED pgs=810 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:56.279 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:56.276+0000 7f4b8d68b640 1 -- 172.21.15.150:0/4085939255 >> 172.21.15.150:0/4085939255 conn(0x7f4b880b2e80 msgr2=0x7f4b880cac80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:46:56.279 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:56.276+0000 7f4b8d68b640 1 -- 172.21.15.150:0/4085939255 shutdown_connections 2024-09-17T05:46:56.279 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:56.276+0000 7f4b8d68b640 1 -- 172.21.15.150:0/4085939255 wait complete. 2024-09-17T05:46:56.288 INFO:teuthology.orchestra.run.smithi150.stdout:{"pg_ready":true,"pg_map":{"version":221,"stamp":"2024-09-17T05:46:54.931253+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592196,"num_objects":15,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":123,"num_write_kb":1641,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":94,"ondisk_log_size":94,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":45,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":455880,"kb_used_data":7872,"kb_used_omap":12,"kb_used_meta":447795,"kb_avail":754518840,"statfs":{"total":773094113280,"available":772627292160,"internally_reserved":0,"allocated":8060928,"data_stored":4046851,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":458542640},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":13,"apply_latency_ms":13,"commit_latency_ns":13000000,"apply_latency_ns":13000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":1828,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.396089"},"pg_stats":[{"pgid":"11.3f","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2024-09-17T05:46:50.548739+0000","last_change":"2024-09-17T05:46:50.548739+0000","last_active":"2024-09-17T05:46:50.533972+0000","last_peered":"2024-09-17T05:46:50.533972+0000","last_clean":"2024-09-17T05:46:50.533972+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:46:50.548739+0000","last_undegraded":"2024-09-17T05:46:50.548739+0000","last_fullsized":"2024-09-17T05:46:50.548739+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:46:50.533972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:46:50.533972+0000","last_clean_scrub_stamp":"2024-09-17T05:46:50.533972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.3e","version":"0'0","reported_seq":10,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-17T05:46:51.575067+0000","last_change":"2024-09-17T05:46:51.574207+0000","last_active":"2024-09-17T05:46:51.575067+0000","last_peered":"2024-09-17T05:46:51.575067+0000","last_clean":"2024-09-17T05:46:51.575067+0000","last_became_active":"2024-09-17T05:46:51.573715+0000","last_became_peered":"2024-09-17T05:46:51.573715+0000","last_unstale":"2024-09-17T05:46:51.575067+0000","last_undegraded":"2024-09-17T05:46:51.575067+0000","last_fullsized":"2024-09-17T05:46:51.575067+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:46:50.533972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:46:50.533972+0000","last_clean_scrub_stamp":"2024-09-17T05:46:50.533972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:25:21.675189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.3d","version":"0'0","reported_seq":10,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-17T05:46:51.567520+0000","last_change":"2024-09-17T05:46:51.562710+0000","last_active":"2024-09-17T05:46:51.567520+0000","last_peered":"2024-09-17T05:46:51.567520+0000","last_clean":"2024-09-17T05:46:51.567520+0000","last_became_active":"2024-09-17T05:46:51.562411+0000","last_became_peered":"2024-09-17T05:46:51.562411+0000","last_unstale":"2024-09-17T05:46:51.567520+0000","last_undegraded":"2024-09-17T05:46:51.567520+0000","last_fullsized":"2024-09-17T05:46:51.567520+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:46:50.533972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:46:50.533972+0000","last_clean_scrub_stamp":"2024-09-17T05:46:50.533972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:00:47.705389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.3c","version":"0'0","reported_seq":10,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-17T05:46:51.578548+0000","last_change":"2024-09-17T05:46:51.578009+0000","last_active":"2024-09-17T05:46:51.578548+0000","last_peered":"2024-09-17T05:46:51.578548+0000","last_clean":"2024-09-17T05:46:51.578548+0000","last_became_active":"2024-09-17T05:46:51.577250+0000","last_became_peered":"2024-09-17T05:46:51.577250+0000","last_unstale":"2024-09-17T05:46:51.578548+0000","last_undegraded":"2024-09-17T05:46:51.578548+0000","last_fullsized":"2024-09-17T05:46:51.578548+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:46:50.533972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:46:50.533972+0000","last_clean_scrub_stamp":"2024-09-17T05:46:50.533972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:54:01.737244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.3b","version":"0'0","reported_seq":10,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-17T05:46:51.569883+0000","last_change":"2024-09-17T05:46:51.568927+0000","last_active":"2024-09-17T05:46:51.569883+0000","last_peered":"2024-09-17T05:46:51.569883+0000","last_clean":"2024-09-17T05:46:51.569883+0000","last_became_active":"2024-09-17T05:46:51.568639+0000","last_became_peered":"2024-09-17T05:46:51.568639+0000","last_unstale":"2024-09-17T05:46:51.569883+0000","last_undegraded":"2024-09-17T05:46:51.569883+0000","last_fullsized":"2024-09-17T05:46:51.569883+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:46:50.533972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:46:50.533972+0000","last_clean_scrub_stamp":"2024-09-17T05:46:50.533972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:42:03.102311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.3a","version":"0'0","reported_seq":10,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-17T05:46:51.581154+0000","last_change":"2024-09-17T05:46:51.578128+0000","last_active":"2024-09-17T05:46:51.581154+0000","last_peered":"2024-09-17T05:46:51.581154+0000","last_clean":"2024-09-17T05:46:51.581154+0000","last_became_active":"2024-09-17T05:46:51.577539+0000","last_became_peered":"2024-09-17T05:46:51.577539+0000","last_unstale":"2024-09-17T05:46:51.581154+0000","last_undegraded":"2024-09-17T05:46:51.581154+0000","last_fullsized":"2024-09-17T05:46:51.581154+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:46:50.533972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:46:50.533972+0000","last_clean_scrub_stamp":"2024-09-17T05:46:50.533972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:30:58.672623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.39","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2024-09-17T05:46:50.540980+0000","last_change":"2024-09-17T05:46:50.540980+0000","last_active":"2024-09-17T05:46:50.533972+0000","last_peered":"2024-09-17T05:46:50.533972+0000","last_clean":"2024-09-17T05:46:50.533972+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:46:50.540980+0000","last_undegraded":"2024-09-17T05:46:50.540980+0000","last_fullsized":"2024-09-17T05:46:50.540980+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:46:50.533972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:46:50.533972+0000","last_clean_scrub_stamp":"2024-09-17T05:46:50.533972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.38","version":"0'0","reported_seq":10,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-17T05:46:51.582069+0000","last_change":"2024-09-17T05:46:51.578199+0000","last_active":"2024-09-17T05:46:51.582069+0000","last_peered":"2024-09-17T05:46:51.582069+0000","last_clean":"2024-09-17T05:46:51.582069+0000","last_became_active":"2024-09-17T05:46:51.576847+0000","last_became_peered":"2024-09-17T05:46:51.576847+0000","last_unstale":"2024-09-17T05:46:51.582069+0000","last_undegraded":"2024-09-17T05:46:51.582069+0000","last_fullsized":"2024-09-17T05:46:51.582069+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:46:50.533972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:46:50.533972+0000","last_clean_scrub_stamp":"2024-09-17T05:46:50.533972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:44:40.981285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.37","version":"0'0","reported_seq":10,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-17T05:46:51.565649+0000","last_change":"2024-09-17T05:46:51.563153+0000","last_active":"2024-09-17T05:46:51.565649+0000","last_peered":"2024-09-17T05:46:51.565649+0000","last_clean":"2024-09-17T05:46:51.565649+0000","last_became_active":"2024-09-17T05:46:51.562497+0000","last_became_peered":"2024-09-17T05:46:51.562497+0000","last_unstale":"2024-09-17T05:46:51.565649+0000","last_undegraded":"2024-09-17T05:46:51.565649+0000","last_fullsized":"2024-09-17T05:46:51.565649+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:46:50.533972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:46:50.533972+0000","last_clean_scrub_stamp":"2024-09-17T05:46:50.533972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:01:14.364335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.36","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2024-09-17T05:46:50.541245+0000","last_change":"2024-09-17T05:46:50.541245+0000","last_active":"2024-09-17T05:46:50.533972+0000","last_peered":"2024-09-17T05:46:50.533972+0000","last_clean":"2024-09-17T05:46:50.533972+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:46:50.541245+0000","last_undegraded":"2024-09-17T05:46:50.541245+0000","last_fullsized":"2024-09-17T05:46:50.541245+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:46:50.533972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:46:50.533972+0000","last_clean_scrub_stamp":"2024-09-17T05:46:50.533972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.35","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2024-09-17T05:46:50.552725+0000","last_change":"2024-09-17T05:46:50.552725+0000","last_active":"2024-09-17T05:46:50.533972+0000","last_peered":"2024-09-17T05:46:50.533972+0000","last_clean":"2024-09-17T05:46:50.533972+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:46:50.552725+0000","last_undegraded":"2024-09-17T05:46:50.552725+0000","last_fullsized":"2024-09-17T05:46:50.552725+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:46:50.533972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:46:50.533972+0000","last_clean_scrub_stamp":"2024-09-17T05:46:50.533972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.34","version":"0'0","reported_seq":10,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-17T05:46:51.558821+0000","last_change":"2024-09-17T05:46:51.556088+0000","last_active":"2024-09-17T05:46:51.558821+0000","last_peered":"2024-09-17T05:46:51.558821+0000","last_clean":"2024-09-17T05:46:51.558821+0000","last_became_active":"2024-09-17T05:46:51.555380+0000","last_became_peered":"2024-09-17T05:46:51.555380+0000","last_unstale":"2024-09-17T05:46:51.558821+0000","last_undegraded":"2024-09-17T05:46:51.558821+0000","last_fullsized":"2024-09-17T05:46:51.558821+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:46:50.533972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:46:50.533972+0000","last_clean_scrub_stamp":"2024-09-17T05:46:50.533972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:18:33.728461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.33","version":"0'0","reported_seq":13,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-17T05:46:52.574767+0000","last_change":"2024-09-17T05:46:51.570802+0000","last_active":"2024-09-17T05:46:52.574767+0000","last_peered":"2024-09-17T05:46:52.574767+0000","last_clean":"2024-09-17T05:46:52.574767+0000","last_became_active":"2024-09-17T05:46:51.570412+0000","last_became_peered":"2024-09-17T05:46:51.570412+0000","last_unstale":"2024-09-17T05:46:52.574767+0000","last_undegraded":"2024-09-17T05:46:52.574767+0000","last_fullsized":"2024-09-17T05:46:52.574767+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:46:50.533972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:46:50.533972+0000","last_clean_scrub_stamp":"2024-09-17T05:46:50.533972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:31:15.619388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.32","version":"0'0","reported_seq":10,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-17T05:46:51.567612+0000","last_change":"2024-09-17T05:46:51.565282+0000","last_active":"2024-09-17T05:46:51.567612+0000","last_peered":"2024-09-17T05:46:51.567612+0000","last_clean":"2024-09-17T05:46:51.567612+0000","last_became_active":"2024-09-17T05:46:51.564899+0000","last_became_peered":"2024-09-17T05:46:51.564899+0000","last_unstale":"2024-09-17T05:46:51.567612+0000","last_undegraded":"2024-09-17T05:46:51.567612+0000","last_fullsized":"2024-09-17T05:46:51.567612+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:46:50.533972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:46:50.533972+0000","last_clean_scrub_stamp":"2024-09-17T05:46:50.533972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:50:16.046843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.31","version":"0'0","reported_seq":13,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-17T05:46:52.574510+0000","last_change":"2024-09-17T05:46:51.561117+0000","last_active":"2024-09-17T05:46:52.574510+0000","last_peered":"2024-09-17T05:46:52.574510+0000","last_clean":"2024-09-17T05:46:52.574510+0000","last_became_active":"2024-09-17T05:46:51.560823+0000","last_became_peered":"2024-09-17T05:46:51.560823+0000","last_unstale":"2024-09-17T05:46:52.574510+0000","last_undegraded":"2024-09-17T05:46:52.574510+0000","last_fullsized":"2024-09-17T05:46:52.574510+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:46:50.533972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:46:50.533972+0000","last_clean_scrub_stamp":"2024-09-17T05:46:50.533972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:47:50.985506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.30","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2024-09-17T05:46:50.540400+0000","last_change":"2024-09-17T05:46:50.540400+0000","last_active":"2024-09-17T05:46:50.533972+0000","last_peered":"2024-09-17T05:46:50.533972+0000","last_clean":"2024-09-17T05:46:50.533972+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:46:50.540400+0000","last_undegraded":"2024-09-17T05:46:50.540400+0000","last_fullsized":"2024-09-17T05:46:50.540400+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:46:50.533972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:46:50.533972+0000","last_clean_scrub_stamp":"2024-09-17T05:46:50.533972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.2f","version":"0'0","reported_seq":10,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-17T05:46:51.565674+0000","last_change":"2024-09-17T05:46:51.563745+0000","last_active":"2024-09-17T05:46:51.565674+0000","last_peered":"2024-09-17T05:46:51.565674+0000","last_clean":"2024-09-17T05:46:51.565674+0000","last_became_active":"2024-09-17T05:46:51.562341+0000","last_became_peered":"2024-09-17T05:46:51.562341+0000","last_unstale":"2024-09-17T05:46:51.565674+0000","last_undegraded":"2024-09-17T05:46:51.565674+0000","last_fullsized":"2024-09-17T05:46:51.565674+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:46:50.533972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:46:50.533972+0000","last_clean_scrub_stamp":"2024-09-17T05:46:50.533972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:08:34.355357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.2e","version":"0'0","reported_seq":10,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-17T05:46:51.576447+0000","last_change":"2024-09-17T05:46:51.575409+0000","last_active":"2024-09-17T05:46:51.576447+0000","last_peered":"2024-09-17T05:46:51.576447+0000","last_clean":"2024-09-17T05:46:51.576447+0000","last_became_active":"2024-09-17T05:46:51.575064+0000","last_became_peered":"2024-09-17T05:46:51.575064+0000","last_unstale":"2024-09-17T05:46:51.576447+0000","last_undegraded":"2024-09-17T05:46:51.576447+0000","last_fullsized":"2024-09-17T05:46:51.576447+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:46:50.533972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:46:50.533972+0000","last_clean_scrub_stamp":"2024-09-17T05:46:50.533972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:15:23.712248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.2d","version":"0'0","reported_seq":10,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-17T05:46:51.583515+0000","last_change":"2024-09-17T05:46:51.578864+0000","last_active":"2024-09-17T05:46:51.583515+0000","last_peered":"2024-09-17T05:46:51.583515+0000","last_clean":"2024-09-17T05:46:51.583515+0000","last_became_active":"2024-09-17T05:46:51.578508+0000","last_became_peered":"2024-09-17T05:46:51.578508+0000","last_unstale":"2024-09-17T05:46:51.583515+0000","last_undegraded":"2024-09-17T05:46:51.583515+0000","last_fullsized":"2024-09-17T05:46:51.583515+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:46:50.533972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:46:50.533972+0000","last_clean_scrub_stamp":"2024-09-17T05:46:50.533972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:36:16.964919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.2c","version":"0'0","reported_seq":13,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-17T05:46:52.574643+0000","last_change":"2024-09-17T05:46:51.564642+0000","last_active":"2024-09-17T05:46:52.574643+0000","last_peered":"2024-09-17T05:46:52.574643+0000","last_clean":"2024-09-17T05:46:52.574643+0000","last_became_active":"2024-09-17T05:46:51.564341+0000","last_became_peered":"2024-09-17T05:46:51.564341+0000","last_unstale":"2024-09-17T05:46:52.574643+0000","last_undegraded":"2024-09-17T05:46:52.574643+0000","last_fullsized":"2024-09-17T05:46:52.574643+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:46:50.533972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:46:50.533972+0000","last_clean_scrub_stamp":"2024-09-17T05:46:50.533972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:32:36.148692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.2b","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2024-09-17T05:46:50.541483+0000","last_change":"2024-09-17T05:46:50.541483+0000","last_active":"2024-09-17T05:46:50.533972+0000","last_peered":"2024-09-17T05:46:50.533972+0000","last_clean":"2024-09-17T05:46:50.533972+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:46:50.541483+0000","last_undegraded":"2024-09-17T05:46:50.541483+0000","last_fullsized":"2024-09-17T05:46:50.541483+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:46:50.533972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:46:50.533972+0000","last_clean_scrub_stamp":"2024-09-17T05:46:50.533972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.2a","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2024-09-17T05:46:50.542828+0000","last_change":"2024-09-17T05:46:50.542828+0000","last_active":"2024-09-17T05:46:50.533972+0000","last_peered":"2024-09-17T05:46:50.533972+0000","last_clean":"2024-09-17T05:46:50.533972+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:46:50.542828+0000","last_undegraded":"2024-09-17T05:46:50.542828+0000","last_fullsized":"2024-09-17T05:46:50.542828+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:46:50.533972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:46:50.533972+0000","last_clean_scrub_stamp":"2024-09-17T05:46:50.533972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.29","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2024-09-17T05:46:50.545977+0000","last_change":"2024-09-17T05:46:50.545977+0000","last_active":"2024-09-17T05:46:50.533972+0000","last_peered":"2024-09-17T05:46:50.533972+0000","last_clean":"2024-09-17T05:46:50.533972+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:46:50.545977+0000","last_undegraded":"2024-09-17T05:46:50.545977+0000","last_fullsized":"2024-09-17T05:46:50.545977+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:46:50.533972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:46:50.533972+0000","last_clean_scrub_stamp":"2024-09-17T05:46:50.533972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.28","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2024-09-17T05:46:50.550694+0000","last_change":"2024-09-17T05:46:50.550694+0000","last_active":"2024-09-17T05:46:50.533972+0000","last_peered":"2024-09-17T05:46:50.533972+0000","last_clean":"2024-09-17T05:46:50.533972+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:46:50.550694+0000","last_undegraded":"2024-09-17T05:46:50.550694+0000","last_fullsized":"2024-09-17T05:46:50.550694+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:46:50.533972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:46:50.533972+0000","last_clean_scrub_stamp":"2024-09-17T05:46:50.533972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.27","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2024-09-17T05:46:50.543035+0000","last_change":"2024-09-17T05:46:50.543035+0000","last_active":"2024-09-17T05:46:50.533972+0000","last_peered":"2024-09-17T05:46:50.533972+0000","last_clean":"2024-09-17T05:46:50.533972+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:46:50.543035+0000","last_undegraded":"2024-09-17T05:46:50.543035+0000","last_fullsized":"2024-09-17T05:46:50.543035+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:46:50.533972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:46:50.533972+0000","last_clean_scrub_stamp":"2024-09-17T05:46:50.533972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.26","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2024-09-17T05:46:50.541785+0000","last_change":"2024-09-17T05:46:50.541785+0000","last_active":"2024-09-17T05:46:50.533972+0000","last_peered":"2024-09-17T05:46:50.533972+0000","last_clean":"2024-09-17T05:46:50.533972+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:46:50.541785+0000","last_undegraded":"2024-09-17T05:46:50.541785+0000","last_fullsized":"2024-09-17T05:46:50.541785+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:46:50.533972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:46:50.533972+0000","last_clean_scrub_stamp":"2024-09-17T05:46:50.533972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.25","version":"0'0","reported_seq":10,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-17T05:46:51.568180+0000","last_change":"2024-09-17T05:46:51.566344+0000","last_active":"2024-09-17T05:46:51.568180+0000","last_peered":"2024-09-17T05:46:51.568180+0000","last_clean":"2024-09-17T05:46:51.568180+0000","last_became_active":"2024-09-17T05:46:51.564652+0000","last_became_peered":"2024-09-17T05:46:51.564652+0000","last_unstale":"2024-09-17T05:46:51.568180+0000","last_undegraded":"2024-09-17T05:46:51.568180+0000","last_fullsized":"2024-09-17T05:46:51.568180+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:46:50.533972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:46:50.533972+0000","last_clean_scrub_stamp":"2024-09-17T05:46:50.533972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:27:02.406829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.24","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2024-09-17T05:46:50.542382+0000","last_change":"2024-09-17T05:46:50.542382+0000","last_active":"2024-09-17T05:46:50.533972+0000","last_peered":"2024-09-17T05:46:50.533972+0000","last_clean":"2024-09-17T05:46:50.533972+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:46:50.542382+0000","last_undegraded":"2024-09-17T05:46:50.542382+0000","last_fullsized":"2024-09-17T05:46:50.542382+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:46:50.533972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:46:50.533972+0000","last_clean_scrub_stamp":"2024-09-17T05:46:50.533972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.23","version":"0'0","reported_seq":10,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-17T05:46:51.567854+0000","last_change":"2024-09-17T05:46:51.564915+0000","last_active":"2024-09-17T05:46:51.567854+0000","last_peered":"2024-09-17T05:46:51.567854+0000","last_clean":"2024-09-17T05:46:51.567854+0000","last_became_active":"2024-09-17T05:46:51.564611+0000","last_became_peered":"2024-09-17T05:46:51.564611+0000","last_unstale":"2024-09-17T05:46:51.567854+0000","last_undegraded":"2024-09-17T05:46:51.567854+0000","last_fullsized":"2024-09-17T05:46:51.567854+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:46:50.533972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:46:50.533972+0000","last_clean_scrub_stamp":"2024-09-17T05:46:50.533972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:09:33.099629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.22","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2024-09-17T05:46:50.541871+0000","last_change":"2024-09-17T05:46:50.541871+0000","last_active":"2024-09-17T05:46:50.533972+0000","last_peered":"2024-09-17T05:46:50.533972+0000","last_clean":"2024-09-17T05:46:50.533972+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:46:50.541871+0000","last_undegraded":"2024-09-17T05:46:50.541871+0000","last_fullsized":"2024-09-17T05:46:50.541871+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:46:50.533972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:46:50.533972+0000","last_clean_scrub_stamp":"2024-09-17T05:46:50.533972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.21","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2024-09-17T05:46:50.539907+0000","last_change":"2024-09-17T05:46:50.539907+0000","last_active":"2024-09-17T05:46:50.533972+0000","last_peered":"2024-09-17T05:46:50.533972+0000","last_clean":"2024-09-17T05:46:50.533972+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:46:50.539907+0000","last_undegraded":"2024-09-17T05:46:50.539907+0000","last_fullsized":"2024-09-17T05:46:50.539907+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:46:50.533972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:46:50.533972+0000","last_clean_scrub_stamp":"2024-09-17T05:46:50.533972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.20","version":"0'0","reported_seq":10,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-17T05:46:51.580457+0000","last_change":"2024-09-17T05:46:51.577607+0000","last_active":"2024-09-17T05:46:51.580457+0000","last_peered":"2024-09-17T05:46:51.580457+0000","last_clean":"2024-09-17T05:46:51.580457+0000","last_became_active":"2024-09-17T05:46:51.576279+0000","last_became_peered":"2024-09-17T05:46:51.576279+0000","last_unstale":"2024-09-17T05:46:51.580457+0000","last_undegraded":"2024-09-17T05:46:51.580457+0000","last_fullsized":"2024-09-17T05:46:51.580457+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:46:50.533972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:46:50.533972+0000","last_clean_scrub_stamp":"2024-09-17T05:46:50.533972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:35:43.534736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.1e","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2024-09-17T05:46:50.546452+0000","last_change":"2024-09-17T05:46:50.546452+0000","last_active":"2024-09-17T05:46:50.533972+0000","last_peered":"2024-09-17T05:46:50.533972+0000","last_clean":"2024-09-17T05:46:50.533972+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:46:50.546452+0000","last_undegraded":"2024-09-17T05:46:50.546452+0000","last_fullsized":"2024-09-17T05:46:50.546452+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:46:50.533972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:46:50.533972+0000","last_clean_scrub_stamp":"2024-09-17T05:46:50.533972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1f","version":"0'0","reported_seq":10,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-09-17T05:46:50.559376+0000","last_change":"2024-09-17T05:46:50.558694+0000","last_active":"2024-09-17T05:46:50.559376+0000","last_peered":"2024-09-17T05:46:50.559376+0000","last_clean":"2024-09-17T05:46:50.559376+0000","last_became_active":"2024-09-17T05:46:50.557228+0000","last_became_peered":"2024-09-17T05:46:50.557228+0000","last_unstale":"2024-09-17T05:46:50.559376+0000","last_undegraded":"2024-09-17T05:46:50.559376+0000","last_fullsized":"2024-09-17T05:46:50.559376+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:46:49.528019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:46:49.528019+0000","last_clean_scrub_stamp":"2024-09-17T05:46:49.528019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:31:03.053588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.1f","version":"0'0","reported_seq":10,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-17T05:46:51.565606+0000","last_change":"2024-09-17T05:46:51.562813+0000","last_active":"2024-09-17T05:46:51.565606+0000","last_peered":"2024-09-17T05:46:51.565606+0000","last_clean":"2024-09-17T05:46:51.565606+0000","last_became_active":"2024-09-17T05:46:51.562079+0000","last_became_peered":"2024-09-17T05:46:51.562079+0000","last_unstale":"2024-09-17T05:46:51.565606+0000","last_undegraded":"2024-09-17T05:46:51.565606+0000","last_fullsized":"2024-09-17T05:46:51.565606+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:46:50.533972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:46:50.533972+0000","last_clean_scrub_stamp":"2024-09-17T05:46:50.533972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:05:18.413938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.1e","version":"71'1","reported_seq":16,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-17T05:46:52.574660+0000","last_change":"2024-09-17T05:46:50.552744+0000","last_active":"2024-09-17T05:46:52.574660+0000","last_peered":"2024-09-17T05:46:52.574660+0000","last_clean":"2024-09-17T05:46:52.574660+0000","last_became_active":"2024-09-17T05:46:50.551757+0000","last_became_peered":"2024-09-17T05:46:50.551757+0000","last_unstale":"2024-09-17T05:46:52.574660+0000","last_undegraded":"2024-09-17T05:46:52.574660+0000","last_fullsized":"2024-09-17T05:46:52.574660+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:46:49.528019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:46:49.528019+0000","last_clean_scrub_stamp":"2024-09-17T05:46:49.528019+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:10:23.845161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1c","version":"0'0","reported_seq":10,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-17T05:46:51.582656+0000","last_change":"2024-09-17T05:46:51.581452+0000","last_active":"2024-09-17T05:46:51.582656+0000","last_peered":"2024-09-17T05:46:51.582656+0000","last_clean":"2024-09-17T05:46:51.582656+0000","last_became_active":"2024-09-17T05:46:51.581056+0000","last_became_peered":"2024-09-17T05:46:51.581056+0000","last_unstale":"2024-09-17T05:46:51.582656+0000","last_undegraded":"2024-09-17T05:46:51.582656+0000","last_fullsized":"2024-09-17T05:46:51.582656+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:46:50.533972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:46:50.533972+0000","last_clean_scrub_stamp":"2024-09-17T05:46:50.533972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:49:54.442500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.1d","version":"0'0","reported_seq":10,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-09-17T05:46:50.559325+0000","last_change":"2024-09-17T05:46:50.558321+0000","last_active":"2024-09-17T05:46:50.559325+0000","last_peered":"2024-09-17T05:46:50.559325+0000","last_clean":"2024-09-17T05:46:50.559325+0000","last_became_active":"2024-09-17T05:46:50.557997+0000","last_became_peered":"2024-09-17T05:46:50.557997+0000","last_unstale":"2024-09-17T05:46:50.559325+0000","last_undegraded":"2024-09-17T05:46:50.559325+0000","last_fullsized":"2024-09-17T05:46:50.559325+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:46:49.528019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:46:49.528019+0000","last_clean_scrub_stamp":"2024-09-17T05:46:49.528019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:48:03.906981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1d","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2024-09-17T05:46:50.552264+0000","last_change":"2024-09-17T05:46:50.552264+0000","last_active":"2024-09-17T05:46:50.533972+0000","last_peered":"2024-09-17T05:46:50.533972+0000","last_clean":"2024-09-17T05:46:50.533972+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:46:50.552264+0000","last_undegraded":"2024-09-17T05:46:50.552264+0000","last_fullsized":"2024-09-17T05:46:50.552264+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:46:50.533972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:46:50.533972+0000","last_clean_scrub_stamp":"2024-09-17T05:46:50.533972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1c","version":"71'2","reported_seq":15,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-17T05:46:51.586077+0000","last_change":"2024-09-17T05:46:50.555340+0000","last_active":"2024-09-17T05:46:51.586077+0000","last_peered":"2024-09-17T05:46:51.586077+0000","last_clean":"2024-09-17T05:46:51.586077+0000","last_became_active":"2024-09-17T05:46:50.554957+0000","last_became_peered":"2024-09-17T05:46:50.554957+0000","last_unstale":"2024-09-17T05:46:51.586077+0000","last_undegraded":"2024-09-17T05:46:51.586077+0000","last_fullsized":"2024-09-17T05:46:51.586077+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:46:49.528019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:46:49.528019+0000","last_clean_scrub_stamp":"2024-09-17T05:46:49.528019+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:39:19.804580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.1a","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2024-09-17T05:46:50.541001+0000","last_change":"2024-09-17T05:46:50.541001+0000","last_active":"2024-09-17T05:46:50.533972+0000","last_peered":"2024-09-17T05:46:50.533972+0000","last_clean":"2024-09-17T05:46:50.533972+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:46:50.541001+0000","last_undegraded":"2024-09-17T05:46:50.541001+0000","last_fullsized":"2024-09-17T05:46:50.541001+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:46:50.533972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:46:50.533972+0000","last_clean_scrub_stamp":"2024-09-17T05:46:50.533972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.1b","version":"71'1","reported_seq":14,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-17T05:46:51.583973+0000","last_change":"2024-09-17T05:46:50.554024+0000","last_active":"2024-09-17T05:46:51.583973+0000","last_peered":"2024-09-17T05:46:51.583973+0000","last_clean":"2024-09-17T05:46:51.583973+0000","last_became_active":"2024-09-17T05:46:50.553651+0000","last_became_peered":"2024-09-17T05:46:50.553651+0000","last_unstale":"2024-09-17T05:46:51.583973+0000","last_undegraded":"2024-09-17T05:46:51.583973+0000","last_fullsized":"2024-09-17T05:46:51.583973+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:46:49.528019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:46:49.528019+0000","last_clean_scrub_stamp":"2024-09-17T05:46:49.528019+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:08:30.756585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.1b","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2024-09-17T05:46:50.541004+0000","last_change":"2024-09-17T05:46:50.541004+0000","last_active":"2024-09-17T05:46:50.533972+0000","last_peered":"2024-09-17T05:46:50.533972+0000","last_clean":"2024-09-17T05:46:50.533972+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:46:50.541004+0000","last_undegraded":"2024-09-17T05:46:50.541004+0000","last_fullsized":"2024-09-17T05:46:50.541004+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:46:50.533972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:46:50.533972+0000","last_clean_scrub_stamp":"2024-09-17T05:46:50.533972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.1a","version":"71'1","reported_seq":14,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-17T05:46:51.585449+0000","last_change":"2024-09-17T05:46:50.561274+0000","last_active":"2024-09-17T05:46:51.585449+0000","last_peered":"2024-09-17T05:46:51.585449+0000","last_clean":"2024-09-17T05:46:51.585449+0000","last_became_active":"2024-09-17T05:46:50.560729+0000","last_became_peered":"2024-09-17T05:46:50.560729+0000","last_unstale":"2024-09-17T05:46:51.585449+0000","last_undegraded":"2024-09-17T05:46:51.585449+0000","last_fullsized":"2024-09-17T05:46:51.585449+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:46:49.528019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:46:49.528019+0000","last_clean_scrub_stamp":"2024-09-17T05:46:49.528019+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:46:48.701238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.18","version":"0'0","reported_seq":10,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-17T05:46:51.569374+0000","last_change":"2024-09-17T05:46:51.568431+0000","last_active":"2024-09-17T05:46:51.569374+0000","last_peered":"2024-09-17T05:46:51.569374+0000","last_clean":"2024-09-17T05:46:51.569374+0000","last_became_active":"2024-09-17T05:46:51.568066+0000","last_became_peered":"2024-09-17T05:46:51.568066+0000","last_unstale":"2024-09-17T05:46:51.569374+0000","last_undegraded":"2024-09-17T05:46:51.569374+0000","last_fullsized":"2024-09-17T05:46:51.569374+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:46:50.533972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:46:50.533972+0000","last_clean_scrub_stamp":"2024-09-17T05:46:50.533972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:12:15.570105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.19","version":"0'0","reported_seq":13,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-17T05:46:51.550635+0000","last_change":"2024-09-17T05:46:50.552167+0000","last_active":"2024-09-17T05:46:51.550635+0000","last_peered":"2024-09-17T05:46:51.550635+0000","last_clean":"2024-09-17T05:46:51.550635+0000","last_became_active":"2024-09-17T05:46:50.551856+0000","last_became_peered":"2024-09-17T05:46:50.551856+0000","last_unstale":"2024-09-17T05:46:51.550635+0000","last_undegraded":"2024-09-17T05:46:51.550635+0000","last_fullsized":"2024-09-17T05:46:51.550635+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:46:49.528019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:46:49.528019+0000","last_clean_scrub_stamp":"2024-09-17T05:46:49.528019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:23:08.023320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.19","version":"0'0","reported_seq":13,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-17T05:46:52.574533+0000","last_change":"2024-09-17T05:46:51.569311+0000","last_active":"2024-09-17T05:46:52.574533+0000","last_peered":"2024-09-17T05:46:52.574533+0000","last_clean":"2024-09-17T05:46:52.574533+0000","last_became_active":"2024-09-17T05:46:51.569013+0000","last_became_peered":"2024-09-17T05:46:51.569013+0000","last_unstale":"2024-09-17T05:46:52.574533+0000","last_undegraded":"2024-09-17T05:46:52.574533+0000","last_fullsized":"2024-09-17T05:46:52.574533+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:46:50.533972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:46:50.533972+0000","last_clean_scrub_stamp":"2024-09-17T05:46:50.533972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:28:30.156588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.18","version":"0'0","reported_seq":13,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-17T05:46:51.552307+0000","last_change":"2024-09-17T05:46:50.552379+0000","last_active":"2024-09-17T05:46:51.552307+0000","last_peered":"2024-09-17T05:46:51.552307+0000","last_clean":"2024-09-17T05:46:51.552307+0000","last_became_active":"2024-09-17T05:46:50.552079+0000","last_became_peered":"2024-09-17T05:46:50.552079+0000","last_unstale":"2024-09-17T05:46:51.552307+0000","last_undegraded":"2024-09-17T05:46:51.552307+0000","last_fullsized":"2024-09-17T05:46:51.552307+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:46:49.528019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:46:49.528019+0000","last_clean_scrub_stamp":"2024-09-17T05:46:49.528019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:56:26.674599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.16","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2024-09-17T05:46:50.540731+0000","last_change":"2024-09-17T05:46:50.540731+0000","last_active":"2024-09-17T05:46:50.533972+0000","last_peered":"2024-09-17T05:46:50.533972+0000","last_clean":"2024-09-17T05:46:50.533972+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:46:50.540731+0000","last_undegraded":"2024-09-17T05:46:50.540731+0000","last_fullsized":"2024-09-17T05:46:50.540731+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:46:50.533972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:46:50.533972+0000","last_clean_scrub_stamp":"2024-09-17T05:46:50.533972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.17","version":"0'0","reported_seq":10,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-09-17T05:46:50.557304+0000","last_change":"2024-09-17T05:46:50.550428+0000","last_active":"2024-09-17T05:46:50.557304+0000","last_peered":"2024-09-17T05:46:50.557304+0000","last_clean":"2024-09-17T05:46:50.557304+0000","last_became_active":"2024-09-17T05:46:50.549751+0000","last_became_peered":"2024-09-17T05:46:50.549751+0000","last_unstale":"2024-09-17T05:46:50.557304+0000","last_undegraded":"2024-09-17T05:46:50.557304+0000","last_fullsized":"2024-09-17T05:46:50.557304+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:46:49.528019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:46:49.528019+0000","last_clean_scrub_stamp":"2024-09-17T05:46:49.528019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:03:27.946146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.17","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2024-09-17T05:46:50.546958+0000","last_change":"2024-09-17T05:46:50.546958+0000","last_active":"2024-09-17T05:46:50.533972+0000","last_peered":"2024-09-17T05:46:50.533972+0000","last_clean":"2024-09-17T05:46:50.533972+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:46:50.546958+0000","last_undegraded":"2024-09-17T05:46:50.546958+0000","last_fullsized":"2024-09-17T05:46:50.546958+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:46:50.533972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:46:50.533972+0000","last_clean_scrub_stamp":"2024-09-17T05:46:50.533972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.16","version":"0'0","reported_seq":13,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-17T05:46:51.565295+0000","last_change":"2024-09-17T05:46:50.556469+0000","last_active":"2024-09-17T05:46:51.565295+0000","last_peered":"2024-09-17T05:46:51.565295+0000","last_clean":"2024-09-17T05:46:51.565295+0000","last_became_active":"2024-09-17T05:46:50.555925+0000","last_became_peered":"2024-09-17T05:46:50.555925+0000","last_unstale":"2024-09-17T05:46:51.565295+0000","last_undegraded":"2024-09-17T05:46:51.565295+0000","last_fullsized":"2024-09-17T05:46:51.565295+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:46:49.528019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:46:49.528019+0000","last_clean_scrub_stamp":"2024-09-17T05:46:49.528019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:11:55.261702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.14","version":"0'0","reported_seq":10,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-17T05:46:51.581701+0000","last_change":"2024-09-17T05:46:51.579751+0000","last_active":"2024-09-17T05:46:51.581701+0000","last_peered":"2024-09-17T05:46:51.581701+0000","last_clean":"2024-09-17T05:46:51.581701+0000","last_became_active":"2024-09-17T05:46:51.579430+0000","last_became_peered":"2024-09-17T05:46:51.579430+0000","last_unstale":"2024-09-17T05:46:51.581701+0000","last_undegraded":"2024-09-17T05:46:51.581701+0000","last_fullsized":"2024-09-17T05:46:51.581701+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:46:50.533972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:46:50.533972+0000","last_clean_scrub_stamp":"2024-09-17T05:46:50.533972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:59:19.488416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.15","version":"71'3","reported_seq":16,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-17T05:46:51.579084+0000","last_change":"2024-09-17T05:46:50.552409+0000","last_active":"2024-09-17T05:46:51.579084+0000","last_peered":"2024-09-17T05:46:51.579084+0000","last_clean":"2024-09-17T05:46:51.579084+0000","last_became_active":"2024-09-17T05:46:50.551178+0000","last_became_peered":"2024-09-17T05:46:50.551178+0000","last_unstale":"2024-09-17T05:46:51.579084+0000","last_undegraded":"2024-09-17T05:46:51.579084+0000","last_fullsized":"2024-09-17T05:46:51.579084+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:46:49.528019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:46:49.528019+0000","last_clean_scrub_stamp":"2024-09-17T05:46:49.528019+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:29:57.514758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.15","version":"0'0","reported_seq":10,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-17T05:46:51.557879+0000","last_change":"2024-09-17T05:46:51.555771+0000","last_active":"2024-09-17T05:46:51.557879+0000","last_peered":"2024-09-17T05:46:51.557879+0000","last_clean":"2024-09-17T05:46:51.557879+0000","last_became_active":"2024-09-17T05:46:51.555470+0000","last_became_peered":"2024-09-17T05:46:51.555470+0000","last_unstale":"2024-09-17T05:46:51.557879+0000","last_undegraded":"2024-09-17T05:46:51.557879+0000","last_fullsized":"2024-09-17T05:46:51.557879+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:46:50.533972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:46:50.533972+0000","last_clean_scrub_stamp":"2024-09-17T05:46:50.533972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:14:34.283104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.14","version":"71'6","reported_seq":19,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-17T05:46:51.586126+0000","last_change":"2024-09-17T05:46:50.553143+0000","last_active":"2024-09-17T05:46:51.586126+0000","last_peered":"2024-09-17T05:46:51.586126+0000","last_clean":"2024-09-17T05:46:51.586126+0000","last_became_active":"2024-09-17T05:46:50.552549+0000","last_became_peered":"2024-09-17T05:46:50.552549+0000","last_unstale":"2024-09-17T05:46:51.586126+0000","last_undegraded":"2024-09-17T05:46:51.586126+0000","last_fullsized":"2024-09-17T05:46:51.586126+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:46:49.528019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:46:49.528019+0000","last_clean_scrub_stamp":"2024-09-17T05:46:49.528019+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:04:38.547894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.12","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2024-09-17T05:46:50.545558+0000","last_change":"2024-09-17T05:46:50.545558+0000","last_active":"2024-09-17T05:46:50.533972+0000","last_peered":"2024-09-17T05:46:50.533972+0000","last_clean":"2024-09-17T05:46:50.533972+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:46:50.545558+0000","last_undegraded":"2024-09-17T05:46:50.545558+0000","last_fullsized":"2024-09-17T05:46:50.545558+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:46:50.533972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:46:50.533972+0000","last_clean_scrub_stamp":"2024-09-17T05:46:50.533972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.13","version":"71'2","reported_seq":15,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-17T05:46:51.577782+0000","last_change":"2024-09-17T05:46:50.553892+0000","last_active":"2024-09-17T05:46:51.577782+0000","last_peered":"2024-09-17T05:46:51.577782+0000","last_clean":"2024-09-17T05:46:51.577782+0000","last_became_active":"2024-09-17T05:46:50.553567+0000","last_became_peered":"2024-09-17T05:46:50.553567+0000","last_unstale":"2024-09-17T05:46:51.577782+0000","last_undegraded":"2024-09-17T05:46:51.577782+0000","last_fullsized":"2024-09-17T05:46:51.577782+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:46:49.528019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:46:49.528019+0000","last_clean_scrub_stamp":"2024-09-17T05:46:49.528019+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:16:32.532491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.13","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2024-09-17T05:46:50.541871+0000","last_change":"2024-09-17T05:46:50.541871+0000","last_active":"2024-09-17T05:46:50.533972+0000","last_peered":"2024-09-17T05:46:50.533972+0000","last_clean":"2024-09-17T05:46:50.533972+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:46:50.541871+0000","last_undegraded":"2024-09-17T05:46:50.541871+0000","last_fullsized":"2024-09-17T05:46:50.541871+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:46:50.533972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:46:50.533972+0000","last_clean_scrub_stamp":"2024-09-17T05:46:50.533972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.12","version":"0'0","reported_seq":13,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-17T05:46:51.567763+0000","last_change":"2024-09-17T05:46:50.557441+0000","last_active":"2024-09-17T05:46:51.567763+0000","last_peered":"2024-09-17T05:46:51.567763+0000","last_clean":"2024-09-17T05:46:51.567763+0000","last_became_active":"2024-09-17T05:46:50.557121+0000","last_became_peered":"2024-09-17T05:46:50.557121+0000","last_unstale":"2024-09-17T05:46:51.567763+0000","last_undegraded":"2024-09-17T05:46:51.567763+0000","last_fullsized":"2024-09-17T05:46:51.567763+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:46:49.528019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:46:49.528019+0000","last_clean_scrub_stamp":"2024-09-17T05:46:49.528019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:52:52.514589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.10","version":"0'0","reported_seq":13,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-17T05:46:52.574474+0000","last_change":"2024-09-17T05:46:51.580220+0000","last_active":"2024-09-17T05:46:52.574474+0000","last_peered":"2024-09-17T05:46:52.574474+0000","last_clean":"2024-09-17T05:46:52.574474+0000","last_became_active":"2024-09-17T05:46:51.579877+0000","last_became_peered":"2024-09-17T05:46:51.579877+0000","last_unstale":"2024-09-17T05:46:52.574474+0000","last_undegraded":"2024-09-17T05:46:52.574474+0000","last_fullsized":"2024-09-17T05:46:52.574474+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:46:50.533972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:46:50.533972+0000","last_clean_scrub_stamp":"2024-09-17T05:46:50.533972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:07:06.372655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.11","version":"0'0","reported_seq":10,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-09-17T05:46:50.550575+0000","last_change":"2024-09-17T05:46:50.549371+0000","last_active":"2024-09-17T05:46:50.550575+0000","last_peered":"2024-09-17T05:46:50.550575+0000","last_clean":"2024-09-17T05:46:50.550575+0000","last_became_active":"2024-09-17T05:46:50.548998+0000","last_became_peered":"2024-09-17T05:46:50.548998+0000","last_unstale":"2024-09-17T05:46:50.550575+0000","last_undegraded":"2024-09-17T05:46:50.550575+0000","last_fullsized":"2024-09-17T05:46:50.550575+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:46:49.528019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:46:49.528019+0000","last_clean_scrub_stamp":"2024-09-17T05:46:49.528019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:12:18.888931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.11","version":"0'0","reported_seq":10,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-17T05:46:51.564902+0000","last_change":"2024-09-17T05:46:51.562481+0000","last_active":"2024-09-17T05:46:51.564902+0000","last_peered":"2024-09-17T05:46:51.564902+0000","last_clean":"2024-09-17T05:46:51.564902+0000","last_became_active":"2024-09-17T05:46:51.562122+0000","last_became_peered":"2024-09-17T05:46:51.562122+0000","last_unstale":"2024-09-17T05:46:51.564902+0000","last_undegraded":"2024-09-17T05:46:51.564902+0000","last_fullsized":"2024-09-17T05:46:51.564902+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:46:50.533972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:46:50.533972+0000","last_clean_scrub_stamp":"2024-09-17T05:46:50.533972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:28:26.034113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.10","version":"0'0","reported_seq":10,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-09-17T05:46:50.557348+0000","last_change":"2024-09-17T05:46:50.552842+0000","last_active":"2024-09-17T05:46:50.557348+0000","last_peered":"2024-09-17T05:46:50.557348+0000","last_clean":"2024-09-17T05:46:50.557348+0000","last_became_active":"2024-09-17T05:46:50.552520+0000","last_became_peered":"2024-09-17T05:46:50.552520+0000","last_unstale":"2024-09-17T05:46:50.557348+0000","last_undegraded":"2024-09-17T05:46:50.557348+0000","last_fullsized":"2024-09-17T05:46:50.557348+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:46:49.528019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:46:49.528019+0000","last_clean_scrub_stamp":"2024-09-17T05:46:49.528019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:09:14.458610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.e","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2024-09-17T05:46:50.540783+0000","last_change":"2024-09-17T05:46:50.540783+0000","last_active":"2024-09-17T05:46:50.533972+0000","last_peered":"2024-09-17T05:46:50.533972+0000","last_clean":"2024-09-17T05:46:50.533972+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:46:50.540783+0000","last_undegraded":"2024-09-17T05:46:50.540783+0000","last_fullsized":"2024-09-17T05:46:50.540783+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:46:50.533972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:46:50.533972+0000","last_clean_scrub_stamp":"2024-09-17T05:46:50.533972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.f","version":"71'1","reported_seq":14,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-17T05:46:51.586405+0000","last_change":"2024-09-17T05:46:50.555496+0000","last_active":"2024-09-17T05:46:51.586405+0000","last_peered":"2024-09-17T05:46:51.586405+0000","last_clean":"2024-09-17T05:46:51.586405+0000","last_became_active":"2024-09-17T05:46:50.555176+0000","last_became_peered":"2024-09-17T05:46:50.555176+0000","last_unstale":"2024-09-17T05:46:51.586405+0000","last_undegraded":"2024-09-17T05:46:51.586405+0000","last_fullsized":"2024-09-17T05:46:51.586405+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:46:49.528019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:46:49.528019+0000","last_clean_scrub_stamp":"2024-09-17T05:46:49.528019+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:22:31.843476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.f","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2024-09-17T05:46:50.546409+0000","last_change":"2024-09-17T05:46:50.546409+0000","last_active":"2024-09-17T05:46:50.533972+0000","last_peered":"2024-09-17T05:46:50.533972+0000","last_clean":"2024-09-17T05:46:50.533972+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:46:50.546409+0000","last_undegraded":"2024-09-17T05:46:50.546409+0000","last_fullsized":"2024-09-17T05:46:50.546409+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:46:50.533972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:46:50.533972+0000","last_clean_scrub_stamp":"2024-09-17T05:46:50.533972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.e","version":"0'0","reported_seq":10,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-09-17T05:46:50.559698+0000","last_change":"2024-09-17T05:46:50.558925+0000","last_active":"2024-09-17T05:46:50.559698+0000","last_peered":"2024-09-17T05:46:50.559698+0000","last_clean":"2024-09-17T05:46:50.559698+0000","last_became_active":"2024-09-17T05:46:50.558622+0000","last_became_peered":"2024-09-17T05:46:50.558622+0000","last_unstale":"2024-09-17T05:46:50.559698+0000","last_undegraded":"2024-09-17T05:46:50.559698+0000","last_fullsized":"2024-09-17T05:46:50.559698+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:46:49.528019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:46:49.528019+0000","last_clean_scrub_stamp":"2024-09-17T05:46:49.528019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:06:48.504471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.c","version":"0'0","reported_seq":10,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-17T05:46:51.558979+0000","last_change":"2024-09-17T05:46:51.556516+0000","last_active":"2024-09-17T05:46:51.558979+0000","last_peered":"2024-09-17T05:46:51.558979+0000","last_clean":"2024-09-17T05:46:51.558979+0000","last_became_active":"2024-09-17T05:46:51.555785+0000","last_became_peered":"2024-09-17T05:46:51.555785+0000","last_unstale":"2024-09-17T05:46:51.558979+0000","last_undegraded":"2024-09-17T05:46:51.558979+0000","last_fullsized":"2024-09-17T05:46:51.558979+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:46:50.533972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:46:50.533972+0000","last_clean_scrub_stamp":"2024-09-17T05:46:50.533972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:09:00.267194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.d","version":"71'1","reported_seq":14,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-17T05:46:51.586143+0000","last_change":"2024-09-17T05:46:50.560558+0000","last_active":"2024-09-17T05:46:51.586143+0000","last_peered":"2024-09-17T05:46:51.586143+0000","last_clean":"2024-09-17T05:46:51.586143+0000","last_became_active":"2024-09-17T05:46:50.560242+0000","last_became_peered":"2024-09-17T05:46:50.560242+0000","last_unstale":"2024-09-17T05:46:51.586143+0000","last_undegraded":"2024-09-17T05:46:51.586143+0000","last_fullsized":"2024-09-17T05:46:51.586143+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:46:49.528019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:46:49.528019+0000","last_clean_scrub_stamp":"2024-09-17T05:46:49.528019+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:30:56.705724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.d","version":"0'0","reported_seq":10,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-17T05:46:51.558964+0000","last_change":"2024-09-17T05:46:51.557975+0000","last_active":"2024-09-17T05:46:51.558964+0000","last_peered":"2024-09-17T05:46:51.558964+0000","last_clean":"2024-09-17T05:46:51.558964+0000","last_became_active":"2024-09-17T05:46:51.557674+0000","last_became_peered":"2024-09-17T05:46:51.557674+0000","last_unstale":"2024-09-17T05:46:51.558964+0000","last_undegraded":"2024-09-17T05:46:51.558964+0000","last_fullsized":"2024-09-17T05:46:51.558964+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:46:50.533972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:46:50.533972+0000","last_clean_scrub_stamp":"2024-09-17T05:46:50.533972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:47:53.991131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.c","version":"0'0","reported_seq":10,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-09-17T05:46:50.559371+0000","last_change":"2024-09-17T05:46:50.558154+0000","last_active":"2024-09-17T05:46:50.559371+0000","last_peered":"2024-09-17T05:46:50.559371+0000","last_clean":"2024-09-17T05:46:50.559371+0000","last_became_active":"2024-09-17T05:46:50.557830+0000","last_became_peered":"2024-09-17T05:46:50.557830+0000","last_unstale":"2024-09-17T05:46:50.559371+0000","last_undegraded":"2024-09-17T05:46:50.559371+0000","last_fullsized":"2024-09-17T05:46:50.559371+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:46:49.528019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:46:49.528019+0000","last_clean_scrub_stamp":"2024-09-17T05:46:49.528019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:55:56.754700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.b","version":"0'0","reported_seq":10,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-17T05:46:51.566491+0000","last_change":"2024-09-17T05:46:51.559821+0000","last_active":"2024-09-17T05:46:51.566491+0000","last_peered":"2024-09-17T05:46:51.566491+0000","last_clean":"2024-09-17T05:46:51.566491+0000","last_became_active":"2024-09-17T05:46:51.559470+0000","last_became_peered":"2024-09-17T05:46:51.559470+0000","last_unstale":"2024-09-17T05:46:51.566491+0000","last_undegraded":"2024-09-17T05:46:51.566491+0000","last_fullsized":"2024-09-17T05:46:51.566491+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:46:50.533972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:46:50.533972+0000","last_clean_scrub_stamp":"2024-09-17T05:46:50.533972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:29:39.351334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.a","version":"0'0","reported_seq":13,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-17T05:46:51.568046+0000","last_change":"2024-09-17T05:46:50.561013+0000","last_active":"2024-09-17T05:46:51.568046+0000","last_peered":"2024-09-17T05:46:51.568046+0000","last_clean":"2024-09-17T05:46:51.568046+0000","last_became_active":"2024-09-17T05:46:50.560656+0000","last_became_peered":"2024-09-17T05:46:50.560656+0000","last_unstale":"2024-09-17T05:46:51.568046+0000","last_undegraded":"2024-09-17T05:46:51.568046+0000","last_fullsized":"2024-09-17T05:46:51.568046+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:46:49.528019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:46:49.528019+0000","last_clean_scrub_stamp":"2024-09-17T05:46:49.528019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:12:32.519550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.8","version":"0'0","reported_seq":10,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-17T05:46:51.581523+0000","last_change":"2024-09-17T05:46:51.579266+0000","last_active":"2024-09-17T05:46:51.581523+0000","last_peered":"2024-09-17T05:46:51.581523+0000","last_clean":"2024-09-17T05:46:51.581523+0000","last_became_active":"2024-09-17T05:46:51.578937+0000","last_became_peered":"2024-09-17T05:46:51.578937+0000","last_unstale":"2024-09-17T05:46:51.581523+0000","last_undegraded":"2024-09-17T05:46:51.581523+0000","last_fullsized":"2024-09-17T05:46:51.581523+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:46:50.533972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:46:50.533972+0000","last_clean_scrub_stamp":"2024-09-17T05:46:50.533972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:16:21.255512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.9","version":"0'0","reported_seq":10,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-09-17T05:46:50.556732+0000","last_change":"2024-09-17T05:46:50.555771+0000","last_active":"2024-09-17T05:46:50.556732+0000","last_peered":"2024-09-17T05:46:50.556732+0000","last_clean":"2024-09-17T05:46:50.556732+0000","last_became_active":"2024-09-17T05:46:50.555434+0000","last_became_peered":"2024-09-17T05:46:50.555434+0000","last_unstale":"2024-09-17T05:46:50.556732+0000","last_undegraded":"2024-09-17T05:46:50.556732+0000","last_fullsized":"2024-09-17T05:46:50.556732+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:46:49.528019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:46:49.528019+0000","last_clean_scrub_stamp":"2024-09-17T05:46:49.528019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:55:23.341829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.9","version":"0'0","reported_seq":10,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-17T05:46:51.579051+0000","last_change":"2024-09-17T05:46:51.576821+0000","last_active":"2024-09-17T05:46:51.579051+0000","last_peered":"2024-09-17T05:46:51.579051+0000","last_clean":"2024-09-17T05:46:51.579051+0000","last_became_active":"2024-09-17T05:46:51.576334+0000","last_became_peered":"2024-09-17T05:46:51.576334+0000","last_unstale":"2024-09-17T05:46:51.579051+0000","last_undegraded":"2024-09-17T05:46:51.579051+0000","last_fullsized":"2024-09-17T05:46:51.579051+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:46:50.533972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:46:50.533972+0000","last_clean_scrub_stamp":"2024-09-17T05:46:50.533972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:39:07.753207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.8","version":"0'0","reported_seq":15,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-17T05:46:52.574325+0000","last_change":"2024-09-17T05:46:50.554397+0000","last_active":"2024-09-17T05:46:52.574325+0000","last_peered":"2024-09-17T05:46:52.574325+0000","last_clean":"2024-09-17T05:46:52.574325+0000","last_became_active":"2024-09-17T05:46:50.554006+0000","last_became_peered":"2024-09-17T05:46:50.554006+0000","last_unstale":"2024-09-17T05:46:52.574325+0000","last_undegraded":"2024-09-17T05:46:52.574325+0000","last_fullsized":"2024-09-17T05:46:52.574325+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:46:49.528019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:46:49.528019+0000","last_clean_scrub_stamp":"2024-09-17T05:46:49.528019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:20:01.660902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.6","version":"0'0","reported_seq":13,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-17T05:46:52.574697+0000","last_change":"2024-09-17T05:46:51.563526+0000","last_active":"2024-09-17T05:46:52.574697+0000","last_peered":"2024-09-17T05:46:52.574697+0000","last_clean":"2024-09-17T05:46:52.574697+0000","last_became_active":"2024-09-17T05:46:51.562568+0000","last_became_peered":"2024-09-17T05:46:51.562568+0000","last_unstale":"2024-09-17T05:46:52.574697+0000","last_undegraded":"2024-09-17T05:46:52.574697+0000","last_fullsized":"2024-09-17T05:46:52.574697+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:46:50.533972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:46:50.533972+0000","last_clean_scrub_stamp":"2024-09-17T05:46:50.533972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:38:37.039701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.7","version":"71'2","reported_seq":15,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-17T05:46:51.586400+0000","last_change":"2024-09-17T05:46:50.556372+0000","last_active":"2024-09-17T05:46:51.586400+0000","last_peered":"2024-09-17T05:46:51.586400+0000","last_clean":"2024-09-17T05:46:51.586400+0000","last_became_active":"2024-09-17T05:46:50.556058+0000","last_became_peered":"2024-09-17T05:46:50.556058+0000","last_unstale":"2024-09-17T05:46:51.586400+0000","last_undegraded":"2024-09-17T05:46:51.586400+0000","last_fullsized":"2024-09-17T05:46:51.586400+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:46:49.528019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:46:49.528019+0000","last_clean_scrub_stamp":"2024-09-17T05:46:49.528019+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:32:09.112921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.7","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2024-09-17T05:46:50.539919+0000","last_change":"2024-09-17T05:46:50.539919+0000","last_active":"2024-09-17T05:46:50.533972+0000","last_peered":"2024-09-17T05:46:50.533972+0000","last_clean":"2024-09-17T05:46:50.533972+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:46:50.539919+0000","last_undegraded":"2024-09-17T05:46:50.539919+0000","last_fullsized":"2024-09-17T05:46:50.539919+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:46:50.533972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:46:50.533972+0000","last_clean_scrub_stamp":"2024-09-17T05:46:50.533972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.6","version":"0'0","reported_seq":10,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-09-17T05:46:50.547911+0000","last_change":"2024-09-17T05:46:50.544381+0000","last_active":"2024-09-17T05:46:50.547911+0000","last_peered":"2024-09-17T05:46:50.547911+0000","last_clean":"2024-09-17T05:46:50.547911+0000","last_became_active":"2024-09-17T05:46:50.543986+0000","last_became_peered":"2024-09-17T05:46:50.543986+0000","last_unstale":"2024-09-17T05:46:50.547911+0000","last_undegraded":"2024-09-17T05:46:50.547911+0000","last_fullsized":"2024-09-17T05:46:50.547911+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:46:49.528019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:46:49.528019+0000","last_clean_scrub_stamp":"2024-09-17T05:46:49.528019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:28:08.120187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.4","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2024-09-17T05:46:50.546088+0000","last_change":"2024-09-17T05:46:50.546088+0000","last_active":"2024-09-17T05:46:50.533972+0000","last_peered":"2024-09-17T05:46:50.533972+0000","last_clean":"2024-09-17T05:46:50.533972+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:46:50.546088+0000","last_undegraded":"2024-09-17T05:46:50.546088+0000","last_fullsized":"2024-09-17T05:46:50.546088+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:46:50.533972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:46:50.533972+0000","last_clean_scrub_stamp":"2024-09-17T05:46:50.533972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.5","version":"0'0","reported_seq":13,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-17T05:46:51.552653+0000","last_change":"2024-09-17T05:46:50.549973+0000","last_active":"2024-09-17T05:46:51.552653+0000","last_peered":"2024-09-17T05:46:51.552653+0000","last_clean":"2024-09-17T05:46:51.552653+0000","last_became_active":"2024-09-17T05:46:50.549694+0000","last_became_peered":"2024-09-17T05:46:50.549694+0000","last_unstale":"2024-09-17T05:46:51.552653+0000","last_undegraded":"2024-09-17T05:46:51.552653+0000","last_fullsized":"2024-09-17T05:46:51.552653+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:46:49.528019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:46:49.528019+0000","last_clean_scrub_stamp":"2024-09-17T05:46:49.528019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:31:19.308660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.5","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2024-09-17T05:46:50.547618+0000","last_change":"2024-09-17T05:46:50.547618+0000","last_active":"2024-09-17T05:46:50.533972+0000","last_peered":"2024-09-17T05:46:50.533972+0000","last_clean":"2024-09-17T05:46:50.533972+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:46:50.547618+0000","last_undegraded":"2024-09-17T05:46:50.547618+0000","last_fullsized":"2024-09-17T05:46:50.547618+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:46:50.533972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:46:50.533972+0000","last_clean_scrub_stamp":"2024-09-17T05:46:50.533972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.4","version":"0'0","reported_seq":15,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-17T05:46:52.574697+0000","last_change":"2024-09-17T05:46:50.547993+0000","last_active":"2024-09-17T05:46:52.574697+0000","last_peered":"2024-09-17T05:46:52.574697+0000","last_clean":"2024-09-17T05:46:52.574697+0000","last_became_active":"2024-09-17T05:46:50.547677+0000","last_became_peered":"2024-09-17T05:46:50.547677+0000","last_unstale":"2024-09-17T05:46:52.574697+0000","last_undegraded":"2024-09-17T05:46:52.574697+0000","last_fullsized":"2024-09-17T05:46:52.574697+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:46:49.528019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:46:49.528019+0000","last_clean_scrub_stamp":"2024-09-17T05:46:49.528019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:26:15.799059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.2","version":"0'0","reported_seq":10,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-17T05:46:51.565532+0000","last_change":"2024-09-17T05:46:51.563537+0000","last_active":"2024-09-17T05:46:51.565532+0000","last_peered":"2024-09-17T05:46:51.565532+0000","last_clean":"2024-09-17T05:46:51.565532+0000","last_became_active":"2024-09-17T05:46:51.563188+0000","last_became_peered":"2024-09-17T05:46:51.563188+0000","last_unstale":"2024-09-17T05:46:51.565532+0000","last_undegraded":"2024-09-17T05:46:51.565532+0000","last_fullsized":"2024-09-17T05:46:51.565532+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:46:50.533972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:46:50.533972+0000","last_clean_scrub_stamp":"2024-09-17T05:46:50.533972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:29:52.002441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.3","version":"0'0","reported_seq":13,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-17T05:46:51.553448+0000","last_change":"2024-09-17T05:46:50.556229+0000","last_active":"2024-09-17T05:46:51.553448+0000","last_peered":"2024-09-17T05:46:51.553448+0000","last_clean":"2024-09-17T05:46:51.553448+0000","last_became_active":"2024-09-17T05:46:50.555876+0000","last_became_peered":"2024-09-17T05:46:50.555876+0000","last_unstale":"2024-09-17T05:46:51.553448+0000","last_undegraded":"2024-09-17T05:46:51.553448+0000","last_fullsized":"2024-09-17T05:46:51.553448+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:46:49.528019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:46:49.528019+0000","last_clean_scrub_stamp":"2024-09-17T05:46:49.528019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:04:36.653508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.3","version":"0'0","reported_seq":10,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-17T05:46:51.576711+0000","last_change":"2024-09-17T05:46:51.575439+0000","last_active":"2024-09-17T05:46:51.576711+0000","last_peered":"2024-09-17T05:46:51.576711+0000","last_clean":"2024-09-17T05:46:51.576711+0000","last_became_active":"2024-09-17T05:46:51.575141+0000","last_became_peered":"2024-09-17T05:46:51.575141+0000","last_unstale":"2024-09-17T05:46:51.576711+0000","last_undegraded":"2024-09-17T05:46:51.576711+0000","last_fullsized":"2024-09-17T05:46:51.576711+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:46:50.533972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:46:50.533972+0000","last_clean_scrub_stamp":"2024-09-17T05:46:50.533972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:57:37.513949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.2","version":"0'0","reported_seq":13,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-17T05:46:51.550642+0000","last_change":"2024-09-17T05:46:50.552938+0000","last_active":"2024-09-17T05:46:51.550642+0000","last_peered":"2024-09-17T05:46:51.550642+0000","last_clean":"2024-09-17T05:46:51.550642+0000","last_became_active":"2024-09-17T05:46:50.552636+0000","last_became_peered":"2024-09-17T05:46:50.552636+0000","last_unstale":"2024-09-17T05:46:51.550642+0000","last_undegraded":"2024-09-17T05:46:51.550642+0000","last_fullsized":"2024-09-17T05:46:51.550642+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:46:49.528019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:46:49.528019+0000","last_clean_scrub_stamp":"2024-09-17T05:46:49.528019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:24:36.778807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.0","version":"0'0","reported_seq":10,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-17T05:46:51.568417+0000","last_change":"2024-09-17T05:46:51.566304+0000","last_active":"2024-09-17T05:46:51.568417+0000","last_peered":"2024-09-17T05:46:51.568417+0000","last_clean":"2024-09-17T05:46:51.568417+0000","last_became_active":"2024-09-17T05:46:51.565283+0000","last_became_peered":"2024-09-17T05:46:51.565283+0000","last_unstale":"2024-09-17T05:46:51.568417+0000","last_undegraded":"2024-09-17T05:46:51.568417+0000","last_fullsized":"2024-09-17T05:46:51.568417+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:46:50.533972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:46:50.533972+0000","last_clean_scrub_stamp":"2024-09-17T05:46:50.533972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:46:16.006152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.1","version":"0'0","reported_seq":10,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-09-17T05:46:50.557384+0000","last_change":"2024-09-17T05:46:50.552458+0000","last_active":"2024-09-17T05:46:50.557384+0000","last_peered":"2024-09-17T05:46:50.557384+0000","last_clean":"2024-09-17T05:46:50.557384+0000","last_became_active":"2024-09-17T05:46:50.552107+0000","last_became_peered":"2024-09-17T05:46:50.552107+0000","last_unstale":"2024-09-17T05:46:50.557384+0000","last_undegraded":"2024-09-17T05:46:50.557384+0000","last_fullsized":"2024-09-17T05:46:50.557384+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:46:49.528019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:46:49.528019+0000","last_clean_scrub_stamp":"2024-09-17T05:46:49.528019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:24:45.137886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1","version":"0'0","reported_seq":10,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-17T05:46:51.575017+0000","last_change":"2024-09-17T05:46:51.573577+0000","last_active":"2024-09-17T05:46:51.575017+0000","last_peered":"2024-09-17T05:46:51.575017+0000","last_clean":"2024-09-17T05:46:51.575017+0000","last_became_active":"2024-09-17T05:46:51.569489+0000","last_became_peered":"2024-09-17T05:46:51.569489+0000","last_unstale":"2024-09-17T05:46:51.575017+0000","last_undegraded":"2024-09-17T05:46:51.575017+0000","last_fullsized":"2024-09-17T05:46:51.575017+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:46:50.533972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:46:50.533972+0000","last_clean_scrub_stamp":"2024-09-17T05:46:50.533972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:26:30.678628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.0","version":"0'0","reported_seq":13,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-17T05:46:51.567574+0000","last_change":"2024-09-17T05:46:50.558270+0000","last_active":"2024-09-17T05:46:51.567574+0000","last_peered":"2024-09-17T05:46:51.567574+0000","last_clean":"2024-09-17T05:46:51.567574+0000","last_became_active":"2024-09-17T05:46:50.557754+0000","last_became_peered":"2024-09-17T05:46:50.557754+0000","last_unstale":"2024-09-17T05:46:51.567574+0000","last_undegraded":"2024-09-17T05:46:51.567574+0000","last_fullsized":"2024-09-17T05:46:51.567574+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:46:49.528019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:46:49.528019+0000","last_clean_scrub_stamp":"2024-09-17T05:46:49.528019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:05:59.732974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.a","version":"0'0","reported_seq":10,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-17T05:46:51.572200+0000","last_change":"2024-09-17T05:46:51.570833+0000","last_active":"2024-09-17T05:46:51.572200+0000","last_peered":"2024-09-17T05:46:51.572200+0000","last_clean":"2024-09-17T05:46:51.572200+0000","last_became_active":"2024-09-17T05:46:51.570468+0000","last_became_peered":"2024-09-17T05:46:51.570468+0000","last_unstale":"2024-09-17T05:46:51.572200+0000","last_undegraded":"2024-09-17T05:46:51.572200+0000","last_fullsized":"2024-09-17T05:46:51.572200+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:46:50.533972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:46:50.533972+0000","last_clean_scrub_stamp":"2024-09-17T05:46:50.533972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:08:52.597158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.b","version":"71'2","reported_seq":15,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-17T05:46:51.586102+0000","last_change":"2024-09-17T05:46:50.559144+0000","last_active":"2024-09-17T05:46:51.586102+0000","last_peered":"2024-09-17T05:46:51.586102+0000","last_clean":"2024-09-17T05:46:51.586102+0000","last_became_active":"2024-09-17T05:46:50.558856+0000","last_became_peered":"2024-09-17T05:46:50.558856+0000","last_unstale":"2024-09-17T05:46:51.586102+0000","last_undegraded":"2024-09-17T05:46:51.586102+0000","last_fullsized":"2024-09-17T05:46:51.586102+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:46:49.528019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:46:49.528019+0000","last_clean_scrub_stamp":"2024-09-17T05:46:49.528019+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:33:50.200522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"19'72","reported_seq":196,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-09-17T05:46:50.551827+0000","last_change":"2024-09-17T05:41:48.539830+0000","last_active":"2024-09-17T05:46:50.551827+0000","last_peered":"2024-09-17T05:46:50.551827+0000","last_clean":"2024-09-17T05:46:50.551827+0000","last_became_active":"2024-09-17T05:41:48.538743+0000","last_became_peered":"2024-09-17T05:41:48.538743+0000","last_unstale":"2024-09-17T05:46:50.551827+0000","last_undegraded":"2024-09-17T05:46:50.551827+0000","last_fullsized":"2024-09-17T05:46:50.551827+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:47.152539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:47.152539+0000","last_clean_scrub_stamp":"2024-09-17T05:41:47.152539+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:08:02.952016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":11,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":10,"num_pg":32,"stat_sum":{"num_bytes":1828,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":4044,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":22,"ondisk_log_size":22,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":16,"seq":68719476802,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":58408,"kb_used_data":844,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94313432,"statfs":{"total":96636764160,"available":96576954368,"internally_reserved":0,"allocated":864256,"data_stored":359618,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":58915270},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":7,"up_from":15,"seq":64424509506,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":58964,"kb_used_data":1404,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94312876,"statfs":{"total":96636764160,"available":96576385024,"internally_reserved":0,"allocated":1437696,"data_stored":943063,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":58915274},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509505,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":58384,"kb_used_data":824,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94313456,"statfs":{"total":96636764160,"available":96576978944,"internally_reserved":0,"allocated":843776,"data_stored":352695,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":58915269},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509505,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":58384,"kb_used_data":824,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94313456,"statfs":{"total":96636764160,"available":96576978944,"internally_reserved":0,"allocated":843776,"data_stored":352695,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":58915269},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509505,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":58408,"kb_used_data":844,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94313432,"statfs":{"total":96636764160,"available":96576954368,"internally_reserved":0,"allocated":864256,"data_stored":359638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":58915271},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509505,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":58408,"kb_used_data":848,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94313432,"statfs":{"total":96636764160,"available":96576954368,"internally_reserved":0,"allocated":868352,"data_stored":361138,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":58915269},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509505,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":58420,"kb_used_data":856,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94313420,"statfs":{"total":96636764160,"available":96576942080,"internally_reserved":0,"allocated":876544,"data_stored":361754,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":58915269},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574913,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":46504,"kb_used_data":1428,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94325336,"statfs":{"total":96636764160,"available":96589144064,"internally_reserved":0,"allocated":1462272,"data_stored":956250,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":46135749},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2228,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-17T05:46:56.292 INFO:tasks.ceph.ceph_manager.ceph:PG 11.3f is not active+clean 2024-09-17T05:46:56.292 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '11.3f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 70, 'state': 'creating+peering', 'last_fresh': '2024-09-17T05:46:50.548739+0000', 'last_change': '2024-09-17T05:46:50.548739+0000', 'last_active': '2024-09-17T05:46:50.533972+0000', 'last_peered': '2024-09-17T05:46:50.533972+0000', 'last_clean': '2024-09-17T05:46:50.533972+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:46:50.548739+0000', 'last_undegraded': '2024-09-17T05:46:50.548739+0000', 'last_fullsized': '2024-09-17T05:46:50.548739+0000', 'mapping_epoch': 70, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 70, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:46:50.533972+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:46:50.533972+0000', 'last_clean_scrub_stamp': '2024-09-17T05:46:50.533972+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 2], 'acting': [7, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-17T05:46:56.292 INFO:tasks.ceph.ceph_manager.ceph:PG 11.39 is not active+clean 2024-09-17T05:46:56.292 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '11.39', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 70, 'state': 'creating+peering', 'last_fresh': '2024-09-17T05:46:50.540980+0000', 'last_change': '2024-09-17T05:46:50.540980+0000', 'last_active': '2024-09-17T05:46:50.533972+0000', 'last_peered': '2024-09-17T05:46:50.533972+0000', 'last_clean': '2024-09-17T05:46:50.533972+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:46:50.540980+0000', 'last_undegraded': '2024-09-17T05:46:50.540980+0000', 'last_fullsized': '2024-09-17T05:46:50.540980+0000', 'mapping_epoch': 70, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 70, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:46:50.533972+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:46:50.533972+0000', 'last_clean_scrub_stamp': '2024-09-17T05:46:50.533972+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 1], 'acting': [5, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-17T05:46:56.293 INFO:tasks.ceph.ceph_manager.ceph:PG 11.36 is not active+clean 2024-09-17T05:46:56.293 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '11.36', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 70, 'state': 'creating+peering', 'last_fresh': '2024-09-17T05:46:50.541245+0000', 'last_change': '2024-09-17T05:46:50.541245+0000', 'last_active': '2024-09-17T05:46:50.533972+0000', 'last_peered': '2024-09-17T05:46:50.533972+0000', 'last_clean': '2024-09-17T05:46:50.533972+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:46:50.541245+0000', 'last_undegraded': '2024-09-17T05:46:50.541245+0000', 'last_fullsized': '2024-09-17T05:46:50.541245+0000', 'mapping_epoch': 70, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 70, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:46:50.533972+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:46:50.533972+0000', 'last_clean_scrub_stamp': '2024-09-17T05:46:50.533972+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 2], 'acting': [4, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-17T05:46:56.293 INFO:tasks.ceph.ceph_manager.ceph:PG 11.35 is not active+clean 2024-09-17T05:46:56.293 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '11.35', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 70, 'state': 'creating+peering', 'last_fresh': '2024-09-17T05:46:50.552725+0000', 'last_change': '2024-09-17T05:46:50.552725+0000', 'last_active': '2024-09-17T05:46:50.533972+0000', 'last_peered': '2024-09-17T05:46:50.533972+0000', 'last_clean': '2024-09-17T05:46:50.533972+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:46:50.552725+0000', 'last_undegraded': '2024-09-17T05:46:50.552725+0000', 'last_fullsized': '2024-09-17T05:46:50.552725+0000', 'mapping_epoch': 70, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 70, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:46:50.533972+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:46:50.533972+0000', 'last_clean_scrub_stamp': '2024-09-17T05:46:50.533972+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 3], 'acting': [7, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-17T05:46:56.293 INFO:tasks.ceph.ceph_manager.ceph:PG 11.30 is not active+clean 2024-09-17T05:46:56.293 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '11.30', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 70, 'state': 'creating+peering', 'last_fresh': '2024-09-17T05:46:50.540400+0000', 'last_change': '2024-09-17T05:46:50.540400+0000', 'last_active': '2024-09-17T05:46:50.533972+0000', 'last_peered': '2024-09-17T05:46:50.533972+0000', 'last_clean': '2024-09-17T05:46:50.533972+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:46:50.540400+0000', 'last_undegraded': '2024-09-17T05:46:50.540400+0000', 'last_fullsized': '2024-09-17T05:46:50.540400+0000', 'mapping_epoch': 70, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 70, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:46:50.533972+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:46:50.533972+0000', 'last_clean_scrub_stamp': '2024-09-17T05:46:50.533972+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 6], 'acting': [4, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-17T05:46:56.293 INFO:tasks.ceph.ceph_manager.ceph:PG 11.2b is not active+clean 2024-09-17T05:46:56.293 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '11.2b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 70, 'state': 'creating+peering', 'last_fresh': '2024-09-17T05:46:50.541483+0000', 'last_change': '2024-09-17T05:46:50.541483+0000', 'last_active': '2024-09-17T05:46:50.533972+0000', 'last_peered': '2024-09-17T05:46:50.533972+0000', 'last_clean': '2024-09-17T05:46:50.533972+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:46:50.541483+0000', 'last_undegraded': '2024-09-17T05:46:50.541483+0000', 'last_fullsized': '2024-09-17T05:46:50.541483+0000', 'mapping_epoch': 70, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 70, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:46:50.533972+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:46:50.533972+0000', 'last_clean_scrub_stamp': '2024-09-17T05:46:50.533972+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 0], 'acting': [4, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-17T05:46:56.293 INFO:tasks.ceph.ceph_manager.ceph:PG 11.2a is not active+clean 2024-09-17T05:46:56.294 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '11.2a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 70, 'state': 'creating+peering', 'last_fresh': '2024-09-17T05:46:50.542828+0000', 'last_change': '2024-09-17T05:46:50.542828+0000', 'last_active': '2024-09-17T05:46:50.533972+0000', 'last_peered': '2024-09-17T05:46:50.533972+0000', 'last_clean': '2024-09-17T05:46:50.533972+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:46:50.542828+0000', 'last_undegraded': '2024-09-17T05:46:50.542828+0000', 'last_fullsized': '2024-09-17T05:46:50.542828+0000', 'mapping_epoch': 70, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 70, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:46:50.533972+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:46:50.533972+0000', 'last_clean_scrub_stamp': '2024-09-17T05:46:50.533972+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 2], 'acting': [4, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-17T05:46:56.294 INFO:tasks.ceph.ceph_manager.ceph:PG 11.29 is not active+clean 2024-09-17T05:46:56.294 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '11.29', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 70, 'state': 'creating+peering', 'last_fresh': '2024-09-17T05:46:50.545977+0000', 'last_change': '2024-09-17T05:46:50.545977+0000', 'last_active': '2024-09-17T05:46:50.533972+0000', 'last_peered': '2024-09-17T05:46:50.533972+0000', 'last_clean': '2024-09-17T05:46:50.533972+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:46:50.545977+0000', 'last_undegraded': '2024-09-17T05:46:50.545977+0000', 'last_fullsized': '2024-09-17T05:46:50.545977+0000', 'mapping_epoch': 70, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 70, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:46:50.533972+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:46:50.533972+0000', 'last_clean_scrub_stamp': '2024-09-17T05:46:50.533972+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 5], 'acting': [7, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-17T05:46:56.294 INFO:tasks.ceph.ceph_manager.ceph:PG 11.28 is not active+clean 2024-09-17T05:46:56.294 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '11.28', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 70, 'state': 'creating+peering', 'last_fresh': '2024-09-17T05:46:50.550694+0000', 'last_change': '2024-09-17T05:46:50.550694+0000', 'last_active': '2024-09-17T05:46:50.533972+0000', 'last_peered': '2024-09-17T05:46:50.533972+0000', 'last_clean': '2024-09-17T05:46:50.533972+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:46:50.550694+0000', 'last_undegraded': '2024-09-17T05:46:50.550694+0000', 'last_fullsized': '2024-09-17T05:46:50.550694+0000', 'mapping_epoch': 70, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 70, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:46:50.533972+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:46:50.533972+0000', 'last_clean_scrub_stamp': '2024-09-17T05:46:50.533972+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 6], 'acting': [7, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-17T05:46:56.294 INFO:tasks.ceph.ceph_manager.ceph:PG 11.27 is not active+clean 2024-09-17T05:46:56.294 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '11.27', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 70, 'state': 'creating+peering', 'last_fresh': '2024-09-17T05:46:50.543035+0000', 'last_change': '2024-09-17T05:46:50.543035+0000', 'last_active': '2024-09-17T05:46:50.533972+0000', 'last_peered': '2024-09-17T05:46:50.533972+0000', 'last_clean': '2024-09-17T05:46:50.533972+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:46:50.543035+0000', 'last_undegraded': '2024-09-17T05:46:50.543035+0000', 'last_fullsized': '2024-09-17T05:46:50.543035+0000', 'mapping_epoch': 70, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 70, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:46:50.533972+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:46:50.533972+0000', 'last_clean_scrub_stamp': '2024-09-17T05:46:50.533972+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 7], 'acting': [4, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-17T05:46:56.294 INFO:tasks.ceph.ceph_manager.ceph:PG 11.26 is not active+clean 2024-09-17T05:46:56.294 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '11.26', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 70, 'state': 'creating+peering', 'last_fresh': '2024-09-17T05:46:50.541785+0000', 'last_change': '2024-09-17T05:46:50.541785+0000', 'last_active': '2024-09-17T05:46:50.533972+0000', 'last_peered': '2024-09-17T05:46:50.533972+0000', 'last_clean': '2024-09-17T05:46:50.533972+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:46:50.541785+0000', 'last_undegraded': '2024-09-17T05:46:50.541785+0000', 'last_fullsized': '2024-09-17T05:46:50.541785+0000', 'mapping_epoch': 70, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 70, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:46:50.533972+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:46:50.533972+0000', 'last_clean_scrub_stamp': '2024-09-17T05:46:50.533972+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 6], 'acting': [5, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-17T05:46:56.294 INFO:tasks.ceph.ceph_manager.ceph:PG 11.24 is not active+clean 2024-09-17T05:46:56.295 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '11.24', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 70, 'state': 'creating+peering', 'last_fresh': '2024-09-17T05:46:50.542382+0000', 'last_change': '2024-09-17T05:46:50.542382+0000', 'last_active': '2024-09-17T05:46:50.533972+0000', 'last_peered': '2024-09-17T05:46:50.533972+0000', 'last_clean': '2024-09-17T05:46:50.533972+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:46:50.542382+0000', 'last_undegraded': '2024-09-17T05:46:50.542382+0000', 'last_fullsized': '2024-09-17T05:46:50.542382+0000', 'mapping_epoch': 70, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 70, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:46:50.533972+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:46:50.533972+0000', 'last_clean_scrub_stamp': '2024-09-17T05:46:50.533972+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 2], 'acting': [4, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-17T05:46:56.295 INFO:tasks.ceph.ceph_manager.ceph:PG 11.22 is not active+clean 2024-09-17T05:46:56.295 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '11.22', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 70, 'state': 'creating+peering', 'last_fresh': '2024-09-17T05:46:50.541871+0000', 'last_change': '2024-09-17T05:46:50.541871+0000', 'last_active': '2024-09-17T05:46:50.533972+0000', 'last_peered': '2024-09-17T05:46:50.533972+0000', 'last_clean': '2024-09-17T05:46:50.533972+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:46:50.541871+0000', 'last_undegraded': '2024-09-17T05:46:50.541871+0000', 'last_fullsized': '2024-09-17T05:46:50.541871+0000', 'mapping_epoch': 70, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 70, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:46:50.533972+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:46:50.533972+0000', 'last_clean_scrub_stamp': '2024-09-17T05:46:50.533972+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 6], 'acting': [5, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-17T05:46:56.295 INFO:tasks.ceph.ceph_manager.ceph:PG 11.21 is not active+clean 2024-09-17T05:46:56.295 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '11.21', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 70, 'state': 'creating+peering', 'last_fresh': '2024-09-17T05:46:50.539907+0000', 'last_change': '2024-09-17T05:46:50.539907+0000', 'last_active': '2024-09-17T05:46:50.533972+0000', 'last_peered': '2024-09-17T05:46:50.533972+0000', 'last_clean': '2024-09-17T05:46:50.533972+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:46:50.539907+0000', 'last_undegraded': '2024-09-17T05:46:50.539907+0000', 'last_fullsized': '2024-09-17T05:46:50.539907+0000', 'mapping_epoch': 70, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 70, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:46:50.533972+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:46:50.533972+0000', 'last_clean_scrub_stamp': '2024-09-17T05:46:50.533972+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 2], 'acting': [5, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-17T05:46:56.295 INFO:tasks.ceph.ceph_manager.ceph:PG 11.1e is not active+clean 2024-09-17T05:46:56.295 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '11.1e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 70, 'state': 'creating+peering', 'last_fresh': '2024-09-17T05:46:50.546452+0000', 'last_change': '2024-09-17T05:46:50.546452+0000', 'last_active': '2024-09-17T05:46:50.533972+0000', 'last_peered': '2024-09-17T05:46:50.533972+0000', 'last_clean': '2024-09-17T05:46:50.533972+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:46:50.546452+0000', 'last_undegraded': '2024-09-17T05:46:50.546452+0000', 'last_fullsized': '2024-09-17T05:46:50.546452+0000', 'mapping_epoch': 70, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 70, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:46:50.533972+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:46:50.533972+0000', 'last_clean_scrub_stamp': '2024-09-17T05:46:50.533972+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 6], 'acting': [7, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-17T05:46:56.295 INFO:tasks.ceph.ceph_manager.ceph:PG 11.1d is not active+clean 2024-09-17T05:46:56.295 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '11.1d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 70, 'state': 'creating+peering', 'last_fresh': '2024-09-17T05:46:50.552264+0000', 'last_change': '2024-09-17T05:46:50.552264+0000', 'last_active': '2024-09-17T05:46:50.533972+0000', 'last_peered': '2024-09-17T05:46:50.533972+0000', 'last_clean': '2024-09-17T05:46:50.533972+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:46:50.552264+0000', 'last_undegraded': '2024-09-17T05:46:50.552264+0000', 'last_fullsized': '2024-09-17T05:46:50.552264+0000', 'mapping_epoch': 70, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 70, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:46:50.533972+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:46:50.533972+0000', 'last_clean_scrub_stamp': '2024-09-17T05:46:50.533972+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 0], 'acting': [7, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-17T05:46:56.295 INFO:tasks.ceph.ceph_manager.ceph:PG 11.1a is not active+clean 2024-09-17T05:46:56.296 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '11.1a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 70, 'state': 'creating+peering', 'last_fresh': '2024-09-17T05:46:50.541001+0000', 'last_change': '2024-09-17T05:46:50.541001+0000', 'last_active': '2024-09-17T05:46:50.533972+0000', 'last_peered': '2024-09-17T05:46:50.533972+0000', 'last_clean': '2024-09-17T05:46:50.533972+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:46:50.541001+0000', 'last_undegraded': '2024-09-17T05:46:50.541001+0000', 'last_fullsized': '2024-09-17T05:46:50.541001+0000', 'mapping_epoch': 70, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 70, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:46:50.533972+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:46:50.533972+0000', 'last_clean_scrub_stamp': '2024-09-17T05:46:50.533972+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 3], 'acting': [5, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-17T05:46:56.296 INFO:tasks.ceph.ceph_manager.ceph:PG 11.1b is not active+clean 2024-09-17T05:46:56.296 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '11.1b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 70, 'state': 'creating+peering', 'last_fresh': '2024-09-17T05:46:50.541004+0000', 'last_change': '2024-09-17T05:46:50.541004+0000', 'last_active': '2024-09-17T05:46:50.533972+0000', 'last_peered': '2024-09-17T05:46:50.533972+0000', 'last_clean': '2024-09-17T05:46:50.533972+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:46:50.541004+0000', 'last_undegraded': '2024-09-17T05:46:50.541004+0000', 'last_fullsized': '2024-09-17T05:46:50.541004+0000', 'mapping_epoch': 70, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 70, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:46:50.533972+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:46:50.533972+0000', 'last_clean_scrub_stamp': '2024-09-17T05:46:50.533972+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 7], 'acting': [4, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-17T05:46:56.296 INFO:tasks.ceph.ceph_manager.ceph:PG 11.16 is not active+clean 2024-09-17T05:46:56.296 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '11.16', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 70, 'state': 'creating+peering', 'last_fresh': '2024-09-17T05:46:50.540731+0000', 'last_change': '2024-09-17T05:46:50.540731+0000', 'last_active': '2024-09-17T05:46:50.533972+0000', 'last_peered': '2024-09-17T05:46:50.533972+0000', 'last_clean': '2024-09-17T05:46:50.533972+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:46:50.540731+0000', 'last_undegraded': '2024-09-17T05:46:50.540731+0000', 'last_fullsized': '2024-09-17T05:46:50.540731+0000', 'mapping_epoch': 70, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 70, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:46:50.533972+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:46:50.533972+0000', 'last_clean_scrub_stamp': '2024-09-17T05:46:50.533972+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 7], 'acting': [5, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-17T05:46:56.296 INFO:tasks.ceph.ceph_manager.ceph:PG 11.17 is not active+clean 2024-09-17T05:46:56.296 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '11.17', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 70, 'state': 'creating+peering', 'last_fresh': '2024-09-17T05:46:50.546958+0000', 'last_change': '2024-09-17T05:46:50.546958+0000', 'last_active': '2024-09-17T05:46:50.533972+0000', 'last_peered': '2024-09-17T05:46:50.533972+0000', 'last_clean': '2024-09-17T05:46:50.533972+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:46:50.546958+0000', 'last_undegraded': '2024-09-17T05:46:50.546958+0000', 'last_fullsized': '2024-09-17T05:46:50.546958+0000', 'mapping_epoch': 70, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 70, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:46:50.533972+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:46:50.533972+0000', 'last_clean_scrub_stamp': '2024-09-17T05:46:50.533972+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 6], 'acting': [7, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-17T05:46:56.296 INFO:tasks.ceph.ceph_manager.ceph:PG 11.12 is not active+clean 2024-09-17T05:46:56.296 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '11.12', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 70, 'state': 'creating+peering', 'last_fresh': '2024-09-17T05:46:50.545558+0000', 'last_change': '2024-09-17T05:46:50.545558+0000', 'last_active': '2024-09-17T05:46:50.533972+0000', 'last_peered': '2024-09-17T05:46:50.533972+0000', 'last_clean': '2024-09-17T05:46:50.533972+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:46:50.545558+0000', 'last_undegraded': '2024-09-17T05:46:50.545558+0000', 'last_fullsized': '2024-09-17T05:46:50.545558+0000', 'mapping_epoch': 70, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 70, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:46:50.533972+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:46:50.533972+0000', 'last_clean_scrub_stamp': '2024-09-17T05:46:50.533972+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 2], 'acting': [7, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-17T05:46:56.296 INFO:tasks.ceph.ceph_manager.ceph:PG 11.13 is not active+clean 2024-09-17T05:46:56.297 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '11.13', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 70, 'state': 'creating+peering', 'last_fresh': '2024-09-17T05:46:50.541871+0000', 'last_change': '2024-09-17T05:46:50.541871+0000', 'last_active': '2024-09-17T05:46:50.533972+0000', 'last_peered': '2024-09-17T05:46:50.533972+0000', 'last_clean': '2024-09-17T05:46:50.533972+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:46:50.541871+0000', 'last_undegraded': '2024-09-17T05:46:50.541871+0000', 'last_fullsized': '2024-09-17T05:46:50.541871+0000', 'mapping_epoch': 70, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 70, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:46:50.533972+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:46:50.533972+0000', 'last_clean_scrub_stamp': '2024-09-17T05:46:50.533972+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 4], 'acting': [5, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-17T05:46:56.297 INFO:tasks.ceph.ceph_manager.ceph:PG 11.e is not active+clean 2024-09-17T05:46:56.297 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '11.e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 70, 'state': 'creating+peering', 'last_fresh': '2024-09-17T05:46:50.540783+0000', 'last_change': '2024-09-17T05:46:50.540783+0000', 'last_active': '2024-09-17T05:46:50.533972+0000', 'last_peered': '2024-09-17T05:46:50.533972+0000', 'last_clean': '2024-09-17T05:46:50.533972+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:46:50.540783+0000', 'last_undegraded': '2024-09-17T05:46:50.540783+0000', 'last_fullsized': '2024-09-17T05:46:50.540783+0000', 'mapping_epoch': 70, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 70, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:46:50.533972+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:46:50.533972+0000', 'last_clean_scrub_stamp': '2024-09-17T05:46:50.533972+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 1], 'acting': [4, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-17T05:46:56.297 INFO:tasks.ceph.ceph_manager.ceph:PG 11.f is not active+clean 2024-09-17T05:46:56.297 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '11.f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 70, 'state': 'creating+peering', 'last_fresh': '2024-09-17T05:46:50.546409+0000', 'last_change': '2024-09-17T05:46:50.546409+0000', 'last_active': '2024-09-17T05:46:50.533972+0000', 'last_peered': '2024-09-17T05:46:50.533972+0000', 'last_clean': '2024-09-17T05:46:50.533972+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:46:50.546409+0000', 'last_undegraded': '2024-09-17T05:46:50.546409+0000', 'last_fullsized': '2024-09-17T05:46:50.546409+0000', 'mapping_epoch': 70, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 70, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:46:50.533972+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:46:50.533972+0000', 'last_clean_scrub_stamp': '2024-09-17T05:46:50.533972+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 1], 'acting': [7, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-17T05:46:56.297 INFO:tasks.ceph.ceph_manager.ceph:PG 11.7 is not active+clean 2024-09-17T05:46:56.297 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '11.7', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 70, 'state': 'creating+peering', 'last_fresh': '2024-09-17T05:46:50.539919+0000', 'last_change': '2024-09-17T05:46:50.539919+0000', 'last_active': '2024-09-17T05:46:50.533972+0000', 'last_peered': '2024-09-17T05:46:50.533972+0000', 'last_clean': '2024-09-17T05:46:50.533972+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:46:50.539919+0000', 'last_undegraded': '2024-09-17T05:46:50.539919+0000', 'last_fullsized': '2024-09-17T05:46:50.539919+0000', 'mapping_epoch': 70, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 70, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:46:50.533972+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:46:50.533972+0000', 'last_clean_scrub_stamp': '2024-09-17T05:46:50.533972+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 1], 'acting': [5, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-17T05:46:56.297 INFO:tasks.ceph.ceph_manager.ceph:PG 11.4 is not active+clean 2024-09-17T05:46:56.297 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '11.4', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 70, 'state': 'creating+peering', 'last_fresh': '2024-09-17T05:46:50.546088+0000', 'last_change': '2024-09-17T05:46:50.546088+0000', 'last_active': '2024-09-17T05:46:50.533972+0000', 'last_peered': '2024-09-17T05:46:50.533972+0000', 'last_clean': '2024-09-17T05:46:50.533972+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:46:50.546088+0000', 'last_undegraded': '2024-09-17T05:46:50.546088+0000', 'last_fullsized': '2024-09-17T05:46:50.546088+0000', 'mapping_epoch': 70, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 70, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:46:50.533972+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:46:50.533972+0000', 'last_clean_scrub_stamp': '2024-09-17T05:46:50.533972+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 6], 'acting': [7, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-17T05:46:56.297 INFO:tasks.ceph.ceph_manager.ceph:PG 11.5 is not active+clean 2024-09-17T05:46:56.297 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '11.5', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 70, 'state': 'creating+peering', 'last_fresh': '2024-09-17T05:46:50.547618+0000', 'last_change': '2024-09-17T05:46:50.547618+0000', 'last_active': '2024-09-17T05:46:50.533972+0000', 'last_peered': '2024-09-17T05:46:50.533972+0000', 'last_clean': '2024-09-17T05:46:50.533972+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:46:50.547618+0000', 'last_undegraded': '2024-09-17T05:46:50.547618+0000', 'last_fullsized': '2024-09-17T05:46:50.547618+0000', 'mapping_epoch': 70, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 70, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:46:50.533972+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:46:50.533972+0000', 'last_clean_scrub_stamp': '2024-09-17T05:46:50.533972+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 5], 'acting': [7, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-17T05:46:56.298 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-09-17T05:46:56.442 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:56.441+0000 7f0ef24dd640 1 -- 172.21.15.150:0/591860777 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0ed4003fd0 msgr2=0x7f0ed4004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:46:56.443 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:56.441+0000 7f0ef24dd640 1 --2- 172.21.15.150:0/591860777 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0ed4003fd0 0x7f0ed4004800 secure :-1 s=READY pgs=812 cs=0 l=1 rev1=1 crypto rx=0x7f0ee000c2e0 tx=0x7f0ed4005830 comp rx=0 tx=0).stop 2024-09-17T05:46:56.443 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:56.442+0000 7f0ef0a7a640 1 -- 172.21.15.150:0/591860777 reap_dead start 2024-09-17T05:46:56.443 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:56.442+0000 7f0ef24dd640 1 -- 172.21.15.150:0/591860777 shutdown_connections 2024-09-17T05:46:56.443 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:56.442+0000 7f0ef24dd640 1 -- 172.21.15.150:0/591860777 >> 172.21.15.150:0/591860777 conn(0x7f0eec0cee90 msgr2=0x7f0eec0cf2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:46:56.443 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:56.442+0000 7f0ef24dd640 1 -- 172.21.15.150:0/591860777 shutdown_connections 2024-09-17T05:46:56.443 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:56.442+0000 7f0ef24dd640 1 -- 172.21.15.150:0/591860777 wait complete. 2024-09-17T05:46:56.444 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:56.443+0000 7f0ef24dd640 1 Processor -- start 2024-09-17T05:46:56.444 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:56.444+0000 7f0ef24dd640 1 -- start start 2024-09-17T05:46:56.447 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:56.445+0000 7f0ef24dd640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0ed4003fd0 0x7f0eec0ca110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:46:56.447 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:56.445+0000 7f0ef24dd640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0eec0b28f0 0x7f0eec0b2d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:46:56.447 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:56.445+0000 7f0ef24dd640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0eec1d5f80 0x7f0eec1d6390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:46:56.447 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:56.445+0000 7f0ef24dd640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f0eec0d0870 con 0x7f0eec0b28f0 2024-09-17T05:46:56.447 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:56.445+0000 7f0ef24dd640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f0eec0d06f0 con 0x7f0eec1d5f80 2024-09-17T05:46:56.447 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:56.445+0000 7f0ef24dd640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f0eec0d09f0 con 0x7f0ed4003fd0 2024-09-17T05:46:56.447 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:56.445+0000 7f0eeb7fe640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0eec0b28f0 0x7f0eec0b2d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:46:56.447 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:56.445+0000 7f0eeb7fe640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0eec0b28f0 0x7f0eec0b2d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:59818/0 (socket says 172.21.15.150:59818) 2024-09-17T05:46:56.447 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:56.445+0000 7f0eeb7fe640 1 -- 172.21.15.150:0/1215595530 learned_addr learned my addr 172.21.15.150:0/1215595530 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:46:56.447 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:56.445+0000 7f0eebfff640 1 --2- 172.21.15.150:0/1215595530 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0ed4003fd0 0x7f0eec0ca110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:46:56.447 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:56.445+0000 7f0ef0a7a640 1 --2- 172.21.15.150:0/1215595530 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0eec1d5f80 0x7f0eec1d6390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:46:56.447 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:56.445+0000 7f0eeb7fe640 1 -- 172.21.15.150:0/1215595530 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0ed4003fd0 msgr2=0x7f0eec0ca110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:46:56.448 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:56.445+0000 7f0eeb7fe640 1 --2- 172.21.15.150:0/1215595530 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0ed4003fd0 0x7f0eec0ca110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:56.448 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:56.445+0000 7f0eeb7fe640 1 -- 172.21.15.150:0/1215595530 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0eec1d5f80 msgr2=0x7f0eec1d6390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:46:56.448 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:56.445+0000 7f0eeb7fe640 1 --2- 172.21.15.150:0/1215595530 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0eec1d5f80 0x7f0eec1d6390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:56.448 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:56.445+0000 7f0eeb7fe640 1 -- 172.21.15.150:0/1215595530 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0eec1d6c30 con 0x7f0eec0b28f0 2024-09-17T05:46:56.448 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:56.446+0000 7f0eeb7fe640 1 --2- 172.21.15.150:0/1215595530 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0eec0b28f0 0x7f0eec0b2d00 secure :-1 s=READY pgs=813 cs=0 l=1 rev1=1 crypto rx=0x7f0ee002b130 tx=0x7f0ee0006cc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:46:56.448 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:56.446+0000 7f0ee8ff9640 1 -- 172.21.15.150:0/1215595530 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ee0031040 con 0x7f0eec0b28f0 2024-09-17T05:46:56.448 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:56.446+0000 7f0ee8ff9640 1 -- 172.21.15.150:0/1215595530 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0ee00035f0 con 0x7f0eec0b28f0 2024-09-17T05:46:56.448 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:56.446+0000 7f0ef24dd640 1 -- 172.21.15.150:0/1215595530 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0eec1d8d60 con 0x7f0eec0b28f0 2024-09-17T05:46:56.448 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:56.446+0000 7f0ee8ff9640 1 -- 172.21.15.150:0/1215595530 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ee0003a60 con 0x7f0eec0b28f0 2024-09-17T05:46:56.448 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:56.446+0000 7f0ef24dd640 1 -- 172.21.15.150:0/1215595530 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0eec1d9320 con 0x7f0eec0b28f0 2024-09-17T05:46:56.449 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:56.447+0000 7f0ef24dd640 1 -- 172.21.15.150:0/1215595530 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0eec1d9a40 con 0x7f0eec0b28f0 2024-09-17T05:46:56.449 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:56.448+0000 7f0ee8ff9640 1 -- 172.21.15.150:0/1215595530 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 19) ==== 102563+0+0 (secure 0 0 0) 0x7f0ee0034070 con 0x7f0eec0b28f0 2024-09-17T05:46:56.449 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:56.448+0000 7f0ee8ff9640 1 --2- 172.21.15.150:0/1215595530 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f0ed80797f0 0x7f0ed807bd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:46:56.449 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:56.449+0000 7f0ee8ff9640 1 -- 172.21.15.150:0/1215595530 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 5765+0+0 (secure 0 0 0) 0x7f0ee00b98b0 con 0x7f0eec0b28f0 2024-09-17T05:46:56.449 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:56.449+0000 7f0eebfff640 1 --2- 172.21.15.150:0/1215595530 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f0ed80797f0 0x7f0ed807bd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:46:56.450 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:56.449+0000 7f0eebfff640 1 --2- 172.21.15.150:0/1215595530 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f0ed80797f0 0x7f0ed807bd00 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f0edc009cc0 tx=0x7f0edc005f30 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:46:56.453 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:56.453+0000 7f0ee8ff9640 1 -- 172.21.15.150:0/1215595530 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f0ee0083520 con 0x7f0eec0b28f0 2024-09-17T05:46:56.698 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:56.697+0000 7f0ef24dd640 1 -- 172.21.15.150:0/1215595530 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) -- 0x7f0eec0ca880 con 0x7f0eec0b28f0 2024-09-17T05:46:56.699 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:56.698+0000 7f0ee8ff9640 1 -- 172.21.15.150:0/1215595530 <== mon.0 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) ==== 72+0+1142 (secure 0 0 0) 0x7f0ee0082e20 con 0x7f0eec0b28f0 2024-09-17T05:46:56.699 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-09-17T05:46:56.699 INFO:teuthology.orchestra.run.smithi150.stdout:{"fsid":"9f2e05e9-d629-47b3-b26b-1360655b7d20","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":324,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":72,"num_osds":8,"num_up_osds":8,"osd_up_since":1726551706,"num_in_osds":8,"osd_in_since":1726551696,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":70},{"state_name":"creating+peering","count":27}],"num_pgs":97,"num_pools":3,"num_objects":15,"data_bytes":592196,"bytes_used":466821120,"bytes_avail":772627292160,"bytes_total":773094113280,"inactive_pgs_ratio":0.27835050225257874,"write_bytes_sec":2466,"read_op_per_sec":0,"write_op_per_sec":4},"fsmap":{"epoch":42,"btime":"2024-09-17T05:46:54:570307+0000","id":5,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":5,"rank":0,"name":"a","status":"up:active","gid":6498}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":12,"modified":"2024-09-17T05:46:38.927436+0000","services":{}},"progress_events":{}} 2024-09-17T05:46:56.701 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:56.700+0000 7f0ef24dd640 1 -- 172.21.15.150:0/1215595530 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f0ed80797f0 msgr2=0x7f0ed807bd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:46:56.701 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:56.700+0000 7f0ef24dd640 1 --2- 172.21.15.150:0/1215595530 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f0ed80797f0 0x7f0ed807bd00 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f0edc009cc0 tx=0x7f0edc005f30 comp rx=0 tx=0).stop 2024-09-17T05:46:56.701 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:56.700+0000 7f0ef24dd640 1 -- 172.21.15.150:0/1215595530 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0eec0b28f0 msgr2=0x7f0eec0b2d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:46:56.701 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:56.700+0000 7f0ef24dd640 1 --2- 172.21.15.150:0/1215595530 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0eec0b28f0 0x7f0eec0b2d00 secure :-1 s=READY pgs=813 cs=0 l=1 rev1=1 crypto rx=0x7f0ee002b130 tx=0x7f0ee0006cc0 comp rx=0 tx=0).stop 2024-09-17T05:46:56.702 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:56.700+0000 7f0ef24dd640 1 -- 172.21.15.150:0/1215595530 shutdown_connections 2024-09-17T05:46:56.702 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:56.700+0000 7f0ef24dd640 1 --2- 172.21.15.150:0/1215595530 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0eec1d5f80 0x7f0eec1d6390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:56.702 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:56.700+0000 7f0ef24dd640 1 --2- 172.21.15.150:0/1215595530 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f0ed80797f0 0x7f0ed807bd00 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:56.702 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:56.700+0000 7f0ef24dd640 1 --2- 172.21.15.150:0/1215595530 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0eec0b28f0 0x7f0eec0b2d00 unknown :-1 s=CLOSED pgs=813 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:56.702 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:56.700+0000 7f0ef24dd640 1 --2- 172.21.15.150:0/1215595530 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0ed4003fd0 0x7f0eec0ca110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:56.702 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:56.700+0000 7f0ef24dd640 1 -- 172.21.15.150:0/1215595530 >> 172.21.15.150:0/1215595530 conn(0x7f0eec0cee90 msgr2=0x7f0eec0b5240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:46:56.702 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:56.700+0000 7f0ef24dd640 1 -- 172.21.15.150:0/1215595530 shutdown_connections 2024-09-17T05:46:56.702 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:56.700+0000 7f0ef24dd640 1 -- 172.21.15.150:0/1215595530 wait complete. 2024-09-17T05:46:56.712 INFO:tasks.ceph.ceph_manager.ceph:no progress seen, keeping timeout for now 2024-09-17T05:46:56.713 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-17T05:46:56.827 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:56.826+0000 7ffb88464640 1 -- 172.21.15.150:0/832222341 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ffb8015f330 msgr2=0x7ffb8015f740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:46:56.827 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:56.826+0000 7ffb88464640 1 --2- 172.21.15.150:0/832222341 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ffb8015f330 0x7ffb8015f740 secure :-1 s=READY pgs=815 cs=0 l=1 rev1=1 crypto rx=0x7ffb80072850 tx=0x7ffb7002a5f0 comp rx=0 tx=0).stop 2024-09-17T05:46:56.827 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:56.826+0000 7ffb88464640 1 -- 172.21.15.150:0/832222341 shutdown_connections 2024-09-17T05:46:56.827 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:56.826+0000 7ffb88464640 1 --2- 172.21.15.150:0/832222341 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ffb8015f330 0x7ffb8015f740 unknown :-1 s=CLOSED pgs=815 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:56.827 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:56.826+0000 7ffb88464640 1 --2- 172.21.15.150:0/832222341 >> v2:172.21.15.176:3300/0 conn(0x7ffb800cd040 0x7ffb801528b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:56.827 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:56.826+0000 7ffb88464640 1 -- 172.21.15.150:0/832222341 >> 172.21.15.150:0/832222341 conn(0x7ffb800d0b50 msgr2=0x7ffb800d0f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:46:56.828 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:56.826+0000 7ffb88464640 1 -- 172.21.15.150:0/832222341 shutdown_connections 2024-09-17T05:46:56.828 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:56.826+0000 7ffb88464640 1 -- 172.21.15.150:0/832222341 wait complete. 2024-09-17T05:46:56.828 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:56.828+0000 7ffb88464640 1 Processor -- start 2024-09-17T05:46:56.828 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:56.828+0000 7ffb88464640 1 -- start start 2024-09-17T05:46:56.831 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:56.829+0000 7ffb88464640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ffb800cd040 0x7ffb80141460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:46:56.831 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:56.829+0000 7ffb88464640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ffb8015f330 0x7ffb80156400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:46:56.831 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:56.829+0000 7ffb88464640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ffb8015fc80 0x7ffb80156940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:46:56.831 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:56.829+0000 7ffb88464640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7ffb8015c450 con 0x7ffb8015fc80 2024-09-17T05:46:56.831 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:56.829+0000 7ffb88464640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7ffb80071890 con 0x7ffb800cd040 2024-09-17T05:46:56.831 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:56.829+0000 7ffb88464640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7ffb8015c5d0 con 0x7ffb8015f330 2024-09-17T05:46:56.831 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:56.829+0000 7ffb86a01640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ffb8015fc80 0x7ffb80156940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:46:56.831 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:56.829+0000 7ffb86a01640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ffb8015fc80 0x7ffb80156940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:59836/0 (socket says 172.21.15.150:59836) 2024-09-17T05:46:56.831 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:56.829+0000 7ffb86a01640 1 -- 172.21.15.150:0/614911806 learned_addr learned my addr 172.21.15.150:0/614911806 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:46:56.832 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:56.830+0000 7ffb859ff640 1 --2- 172.21.15.150:0/614911806 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ffb8015f330 0x7ffb80156400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:46:56.832 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:56.830+0000 7ffb86200640 1 --2- 172.21.15.150:0/614911806 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ffb800cd040 0x7ffb80141460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:46:56.832 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:56.830+0000 7ffb86a01640 1 -- 172.21.15.150:0/614911806 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ffb8015f330 msgr2=0x7ffb80156400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:46:56.832 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:56.830+0000 7ffb86a01640 1 --2- 172.21.15.150:0/614911806 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ffb8015f330 0x7ffb80156400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:56.832 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:56.830+0000 7ffb86a01640 1 -- 172.21.15.150:0/614911806 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ffb800cd040 msgr2=0x7ffb80141460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:46:56.832 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:56.830+0000 7ffb86a01640 1 --2- 172.21.15.150:0/614911806 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ffb800cd040 0x7ffb80141460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:56.832 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:56.830+0000 7ffb86a01640 1 -- 172.21.15.150:0/614911806 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffb8014b5f0 con 0x7ffb8015fc80 2024-09-17T05:46:56.832 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:56.830+0000 7ffb86200640 1 --2- 172.21.15.150:0/614911806 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ffb800cd040 0x7ffb80141460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:46:56.832 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:56.830+0000 7ffb86a01640 1 --2- 172.21.15.150:0/614911806 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ffb8015fc80 0x7ffb80156940 secure :-1 s=READY pgs=816 cs=0 l=1 rev1=1 crypto rx=0x7ffb7800c370 tx=0x7ffb7800c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:46:56.832 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:56.830+0000 7ffb76ffd640 1 -- 172.21.15.150:0/614911806 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb78017070 con 0x7ffb8015fc80 2024-09-17T05:46:56.832 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:56.830+0000 7ffb76ffd640 1 -- 172.21.15.150:0/614911806 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ffb780035f0 con 0x7ffb8015fc80 2024-09-17T05:46:56.832 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:56.830+0000 7ffb76ffd640 1 -- 172.21.15.150:0/614911806 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb78003a40 con 0x7ffb8015fc80 2024-09-17T05:46:56.832 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:56.830+0000 7ffb88464640 1 -- 172.21.15.150:0/614911806 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffb8014b8d0 con 0x7ffb8015fc80 2024-09-17T05:46:56.833 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:56.830+0000 7ffb88464640 1 -- 172.21.15.150:0/614911806 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffb8014be90 con 0x7ffb8015fc80 2024-09-17T05:46:56.833 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:56.831+0000 7ffb88464640 1 -- 172.21.15.150:0/614911806 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffb8014b360 con 0x7ffb8015fc80 2024-09-17T05:46:56.833 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:56.832+0000 7ffb76ffd640 1 -- 172.21.15.150:0/614911806 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 19) ==== 102563+0+0 (secure 0 0 0) 0x7ffb7801a070 con 0x7ffb8015fc80 2024-09-17T05:46:56.834 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:56.832+0000 7ffb76ffd640 1 --2- 172.21.15.150:0/614911806 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7ffb64079820 0x7ffb6407bd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:46:56.834 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:56.832+0000 7ffb76ffd640 1 -- 172.21.15.150:0/614911806 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 5765+0+0 (secure 0 0 0) 0x7ffb78098bd0 con 0x7ffb8015fc80 2024-09-17T05:46:56.834 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:56.832+0000 7ffb86200640 1 --2- 172.21.15.150:0/614911806 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7ffb64079820 0x7ffb6407bd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:46:56.834 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:56.833+0000 7ffb86200640 1 --2- 172.21.15.150:0/614911806 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7ffb64079820 0x7ffb6407bd30 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7ffb7c005fd0 tx=0x7ffb7c009500 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:46:56.837 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:56.837+0000 7ffb76ffd640 1 -- 172.21.15.150:0/614911806 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7ffb78062840 con 0x7ffb8015fc80 2024-09-17T05:46:57.010 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:57.009+0000 7ffb88464640 1 -- 172.21.15.150:0/614911806 --> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7ffb800ce840 con 0x7ffb64079820 2024-09-17T05:46:57.014 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:57.014+0000 7ffb76ffd640 1 -- 172.21.15.150:0/614911806 <== mgr.4108 v2:172.21.15.176:6800/3631216395 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+252053 (secure 0 0 0) 0x7ffb800ce840 con 0x7ffb64079820 2024-09-17T05:46:57.017 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-09-17T05:46:57.018 INFO:teuthology.orchestra.run.smithi150.stderr:dumped all 2024-09-17T05:46:57.020 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:57.017+0000 7ffb88464640 1 -- 172.21.15.150:0/614911806 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7ffb64079820 msgr2=0x7ffb6407bd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:46:57.020 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:57.017+0000 7ffb88464640 1 --2- 172.21.15.150:0/614911806 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7ffb64079820 0x7ffb6407bd30 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7ffb7c005fd0 tx=0x7ffb7c009500 comp rx=0 tx=0).stop 2024-09-17T05:46:57.020 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:57.017+0000 7ffb88464640 1 -- 172.21.15.150:0/614911806 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ffb8015fc80 msgr2=0x7ffb80156940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:46:57.020 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:57.017+0000 7ffb88464640 1 --2- 172.21.15.150:0/614911806 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ffb8015fc80 0x7ffb80156940 secure :-1 s=READY pgs=816 cs=0 l=1 rev1=1 crypto rx=0x7ffb7800c370 tx=0x7ffb7800c830 comp rx=0 tx=0).stop 2024-09-17T05:46:57.020 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:57.017+0000 7ffb88464640 1 -- 172.21.15.150:0/614911806 shutdown_connections 2024-09-17T05:46:57.020 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:57.017+0000 7ffb88464640 1 --2- 172.21.15.150:0/614911806 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7ffb64079820 0x7ffb6407bd30 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:57.020 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:57.017+0000 7ffb88464640 1 --2- 172.21.15.150:0/614911806 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ffb8015fc80 0x7ffb80156940 unknown :-1 s=CLOSED pgs=816 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:57.020 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:57.017+0000 7ffb88464640 1 --2- 172.21.15.150:0/614911806 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ffb8015f330 0x7ffb80156400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:57.020 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:57.017+0000 7ffb88464640 1 --2- 172.21.15.150:0/614911806 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ffb800cd040 0x7ffb80141460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:57.020 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:57.017+0000 7ffb88464640 1 -- 172.21.15.150:0/614911806 >> 172.21.15.150:0/614911806 conn(0x7ffb800d0b50 msgr2=0x7ffb800b4b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:46:57.020 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:57.017+0000 7ffb88464640 1 -- 172.21.15.150:0/614911806 shutdown_connections 2024-09-17T05:46:57.021 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:46:57.017+0000 7ffb88464640 1 -- 172.21.15.150:0/614911806 wait complete. 2024-09-17T05:46:57.029 INFO:teuthology.orchestra.run.smithi150.stdout:{"pg_ready":true,"pg_map":{"version":222,"stamp":"2024-09-17T05:46:56.931688+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":146,"num_write_kb":1642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":111,"ondisk_log_size":111,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":70,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":455968,"kb_used_data":7960,"kb_used_omap":12,"kb_used_meta":447795,"kb_avail":754518752,"statfs":{"total":773094113280,"available":772627202048,"internally_reserved":0,"allocated":8151040,"data_stored":4087188,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":458542640},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":15,"apply_latency_ms":15,"commit_latency_ns":15000000,"apply_latency_ns":15000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.394009"},"pg_stats":[{"pgid":"11.3f","version":"0'0","reported_seq":13,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-17T05:46:52.866778+0000","last_change":"2024-09-17T05:46:51.567034+0000","last_active":"2024-09-17T05:46:52.866778+0000","last_peered":"2024-09-17T05:46:52.866778+0000","last_clean":"2024-09-17T05:46:52.866778+0000","last_became_active":"2024-09-17T05:46:51.566233+0000","last_became_peered":"2024-09-17T05:46:51.566233+0000","last_unstale":"2024-09-17T05:46:52.866778+0000","last_undegraded":"2024-09-17T05:46:52.866778+0000","last_fullsized":"2024-09-17T05:46:52.866778+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:46:50.533972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:46:50.533972+0000","last_clean_scrub_stamp":"2024-09-17T05:46:50.533972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:08:34.270358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.3e","version":"0'0","reported_seq":10,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-17T05:46:51.575067+0000","last_change":"2024-09-17T05:46:51.574207+0000","last_active":"2024-09-17T05:46:51.575067+0000","last_peered":"2024-09-17T05:46:51.575067+0000","last_clean":"2024-09-17T05:46:51.575067+0000","last_became_active":"2024-09-17T05:46:51.573715+0000","last_became_peered":"2024-09-17T05:46:51.573715+0000","last_unstale":"2024-09-17T05:46:51.575067+0000","last_undegraded":"2024-09-17T05:46:51.575067+0000","last_fullsized":"2024-09-17T05:46:51.575067+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:46:50.533972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:46:50.533972+0000","last_clean_scrub_stamp":"2024-09-17T05:46:50.533972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:25:21.675189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.3d","version":"0'0","reported_seq":10,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-17T05:46:51.567520+0000","last_change":"2024-09-17T05:46:51.562710+0000","last_active":"2024-09-17T05:46:51.567520+0000","last_peered":"2024-09-17T05:46:51.567520+0000","last_clean":"2024-09-17T05:46:51.567520+0000","last_became_active":"2024-09-17T05:46:51.562411+0000","last_became_peered":"2024-09-17T05:46:51.562411+0000","last_unstale":"2024-09-17T05:46:51.567520+0000","last_undegraded":"2024-09-17T05:46:51.567520+0000","last_fullsized":"2024-09-17T05:46:51.567520+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:46:50.533972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:46:50.533972+0000","last_clean_scrub_stamp":"2024-09-17T05:46:50.533972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:00:47.705389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.3c","version":"0'0","reported_seq":10,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-17T05:46:51.578548+0000","last_change":"2024-09-17T05:46:51.578009+0000","last_active":"2024-09-17T05:46:51.578548+0000","last_peered":"2024-09-17T05:46:51.578548+0000","last_clean":"2024-09-17T05:46:51.578548+0000","last_became_active":"2024-09-17T05:46:51.577250+0000","last_became_peered":"2024-09-17T05:46:51.577250+0000","last_unstale":"2024-09-17T05:46:51.578548+0000","last_undegraded":"2024-09-17T05:46:51.578548+0000","last_fullsized":"2024-09-17T05:46:51.578548+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:46:50.533972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:46:50.533972+0000","last_clean_scrub_stamp":"2024-09-17T05:46:50.533972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:54:01.737244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.3b","version":"0'0","reported_seq":10,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-17T05:46:51.569883+0000","last_change":"2024-09-17T05:46:51.568927+0000","last_active":"2024-09-17T05:46:51.569883+0000","last_peered":"2024-09-17T05:46:51.569883+0000","last_clean":"2024-09-17T05:46:51.569883+0000","last_became_active":"2024-09-17T05:46:51.568639+0000","last_became_peered":"2024-09-17T05:46:51.568639+0000","last_unstale":"2024-09-17T05:46:51.569883+0000","last_undegraded":"2024-09-17T05:46:51.569883+0000","last_fullsized":"2024-09-17T05:46:51.569883+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:46:50.533972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:46:50.533972+0000","last_clean_scrub_stamp":"2024-09-17T05:46:50.533972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:42:03.102311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.3a","version":"0'0","reported_seq":10,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-17T05:46:51.581154+0000","last_change":"2024-09-17T05:46:51.578128+0000","last_active":"2024-09-17T05:46:51.581154+0000","last_peered":"2024-09-17T05:46:51.581154+0000","last_clean":"2024-09-17T05:46:51.581154+0000","last_became_active":"2024-09-17T05:46:51.577539+0000","last_became_peered":"2024-09-17T05:46:51.577539+0000","last_unstale":"2024-09-17T05:46:51.581154+0000","last_undegraded":"2024-09-17T05:46:51.581154+0000","last_fullsized":"2024-09-17T05:46:51.581154+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:46:50.533972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:46:50.533972+0000","last_clean_scrub_stamp":"2024-09-17T05:46:50.533972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:30:58.672623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.39","version":"0'0","reported_seq":13,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-17T05:46:52.571912+0000","last_change":"2024-09-17T05:46:51.562524+0000","last_active":"2024-09-17T05:46:52.571912+0000","last_peered":"2024-09-17T05:46:52.571912+0000","last_clean":"2024-09-17T05:46:52.571912+0000","last_became_active":"2024-09-17T05:46:51.562182+0000","last_became_peered":"2024-09-17T05:46:51.562182+0000","last_unstale":"2024-09-17T05:46:52.571912+0000","last_undegraded":"2024-09-17T05:46:52.571912+0000","last_fullsized":"2024-09-17T05:46:52.571912+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:46:50.533972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:46:50.533972+0000","last_clean_scrub_stamp":"2024-09-17T05:46:50.533972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:59:05.231923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.38","version":"0'0","reported_seq":10,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-17T05:46:51.582069+0000","last_change":"2024-09-17T05:46:51.578199+0000","last_active":"2024-09-17T05:46:51.582069+0000","last_peered":"2024-09-17T05:46:51.582069+0000","last_clean":"2024-09-17T05:46:51.582069+0000","last_became_active":"2024-09-17T05:46:51.576847+0000","last_became_peered":"2024-09-17T05:46:51.576847+0000","last_unstale":"2024-09-17T05:46:51.582069+0000","last_undegraded":"2024-09-17T05:46:51.582069+0000","last_fullsized":"2024-09-17T05:46:51.582069+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:46:50.533972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:46:50.533972+0000","last_clean_scrub_stamp":"2024-09-17T05:46:50.533972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:44:40.981285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.37","version":"0'0","reported_seq":10,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-17T05:46:51.565649+0000","last_change":"2024-09-17T05:46:51.563153+0000","last_active":"2024-09-17T05:46:51.565649+0000","last_peered":"2024-09-17T05:46:51.565649+0000","last_clean":"2024-09-17T05:46:51.565649+0000","last_became_active":"2024-09-17T05:46:51.562497+0000","last_became_peered":"2024-09-17T05:46:51.562497+0000","last_unstale":"2024-09-17T05:46:51.565649+0000","last_undegraded":"2024-09-17T05:46:51.565649+0000","last_fullsized":"2024-09-17T05:46:51.565649+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:46:50.533972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:46:50.533972+0000","last_clean_scrub_stamp":"2024-09-17T05:46:50.533972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:01:14.364335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.36","version":"0'0","reported_seq":13,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-17T05:46:52.555484+0000","last_change":"2024-09-17T05:46:51.570143+0000","last_active":"2024-09-17T05:46:52.555484+0000","last_peered":"2024-09-17T05:46:52.555484+0000","last_clean":"2024-09-17T05:46:52.555484+0000","last_became_active":"2024-09-17T05:46:51.569479+0000","last_became_peered":"2024-09-17T05:46:51.569479+0000","last_unstale":"2024-09-17T05:46:52.555484+0000","last_undegraded":"2024-09-17T05:46:52.555484+0000","last_fullsized":"2024-09-17T05:46:52.555484+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:46:50.533972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:46:50.533972+0000","last_clean_scrub_stamp":"2024-09-17T05:46:50.533972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:57:51.972604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.35","version":"0'0","reported_seq":13,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-17T05:46:52.867376+0000","last_change":"2024-09-17T05:46:51.563682+0000","last_active":"2024-09-17T05:46:52.867376+0000","last_peered":"2024-09-17T05:46:52.867376+0000","last_clean":"2024-09-17T05:46:52.867376+0000","last_became_active":"2024-09-17T05:46:51.562694+0000","last_became_peered":"2024-09-17T05:46:51.562694+0000","last_unstale":"2024-09-17T05:46:52.867376+0000","last_undegraded":"2024-09-17T05:46:52.867376+0000","last_fullsized":"2024-09-17T05:46:52.867376+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:46:50.533972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:46:50.533972+0000","last_clean_scrub_stamp":"2024-09-17T05:46:50.533972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:15:36.113980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.34","version":"0'0","reported_seq":10,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-17T05:46:51.558821+0000","last_change":"2024-09-17T05:46:51.556088+0000","last_active":"2024-09-17T05:46:51.558821+0000","last_peered":"2024-09-17T05:46:51.558821+0000","last_clean":"2024-09-17T05:46:51.558821+0000","last_became_active":"2024-09-17T05:46:51.555380+0000","last_became_peered":"2024-09-17T05:46:51.555380+0000","last_unstale":"2024-09-17T05:46:51.558821+0000","last_undegraded":"2024-09-17T05:46:51.558821+0000","last_fullsized":"2024-09-17T05:46:51.558821+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:46:50.533972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:46:50.533972+0000","last_clean_scrub_stamp":"2024-09-17T05:46:50.533972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:18:33.728461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.33","version":"0'0","reported_seq":13,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-17T05:46:52.574767+0000","last_change":"2024-09-17T05:46:51.570802+0000","last_active":"2024-09-17T05:46:52.574767+0000","last_peered":"2024-09-17T05:46:52.574767+0000","last_clean":"2024-09-17T05:46:52.574767+0000","last_became_active":"2024-09-17T05:46:51.570412+0000","last_became_peered":"2024-09-17T05:46:51.570412+0000","last_unstale":"2024-09-17T05:46:52.574767+0000","last_undegraded":"2024-09-17T05:46:52.574767+0000","last_fullsized":"2024-09-17T05:46:52.574767+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:46:50.533972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:46:50.533972+0000","last_clean_scrub_stamp":"2024-09-17T05:46:50.533972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:31:15.619388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.32","version":"0'0","reported_seq":10,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-17T05:46:51.567612+0000","last_change":"2024-09-17T05:46:51.565282+0000","last_active":"2024-09-17T05:46:51.567612+0000","last_peered":"2024-09-17T05:46:51.567612+0000","last_clean":"2024-09-17T05:46:51.567612+0000","last_became_active":"2024-09-17T05:46:51.564899+0000","last_became_peered":"2024-09-17T05:46:51.564899+0000","last_unstale":"2024-09-17T05:46:51.567612+0000","last_undegraded":"2024-09-17T05:46:51.567612+0000","last_fullsized":"2024-09-17T05:46:51.567612+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:46:50.533972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:46:50.533972+0000","last_clean_scrub_stamp":"2024-09-17T05:46:50.533972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:50:16.046843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.31","version":"0'0","reported_seq":13,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-17T05:46:52.574510+0000","last_change":"2024-09-17T05:46:51.561117+0000","last_active":"2024-09-17T05:46:52.574510+0000","last_peered":"2024-09-17T05:46:52.574510+0000","last_clean":"2024-09-17T05:46:52.574510+0000","last_became_active":"2024-09-17T05:46:51.560823+0000","last_became_peered":"2024-09-17T05:46:51.560823+0000","last_unstale":"2024-09-17T05:46:52.574510+0000","last_undegraded":"2024-09-17T05:46:52.574510+0000","last_fullsized":"2024-09-17T05:46:52.574510+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:46:50.533972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:46:50.533972+0000","last_clean_scrub_stamp":"2024-09-17T05:46:50.533972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:47:50.985506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.30","version":"0'0","reported_seq":13,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-17T05:46:52.554955+0000","last_change":"2024-09-17T05:46:51.581980+0000","last_active":"2024-09-17T05:46:52.554955+0000","last_peered":"2024-09-17T05:46:52.554955+0000","last_clean":"2024-09-17T05:46:52.554955+0000","last_became_active":"2024-09-17T05:46:51.580838+0000","last_became_peered":"2024-09-17T05:46:51.580838+0000","last_unstale":"2024-09-17T05:46:52.554955+0000","last_undegraded":"2024-09-17T05:46:52.554955+0000","last_fullsized":"2024-09-17T05:46:52.554955+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:46:50.533972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:46:50.533972+0000","last_clean_scrub_stamp":"2024-09-17T05:46:50.533972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:39:55.633112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.2f","version":"0'0","reported_seq":10,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-17T05:46:51.565674+0000","last_change":"2024-09-17T05:46:51.563745+0000","last_active":"2024-09-17T05:46:51.565674+0000","last_peered":"2024-09-17T05:46:51.565674+0000","last_clean":"2024-09-17T05:46:51.565674+0000","last_became_active":"2024-09-17T05:46:51.562341+0000","last_became_peered":"2024-09-17T05:46:51.562341+0000","last_unstale":"2024-09-17T05:46:51.565674+0000","last_undegraded":"2024-09-17T05:46:51.565674+0000","last_fullsized":"2024-09-17T05:46:51.565674+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:46:50.533972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:46:50.533972+0000","last_clean_scrub_stamp":"2024-09-17T05:46:50.533972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:08:34.355357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.2e","version":"0'0","reported_seq":10,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-17T05:46:51.576447+0000","last_change":"2024-09-17T05:46:51.575409+0000","last_active":"2024-09-17T05:46:51.576447+0000","last_peered":"2024-09-17T05:46:51.576447+0000","last_clean":"2024-09-17T05:46:51.576447+0000","last_became_active":"2024-09-17T05:46:51.575064+0000","last_became_peered":"2024-09-17T05:46:51.575064+0000","last_unstale":"2024-09-17T05:46:51.576447+0000","last_undegraded":"2024-09-17T05:46:51.576447+0000","last_fullsized":"2024-09-17T05:46:51.576447+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:46:50.533972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:46:50.533972+0000","last_clean_scrub_stamp":"2024-09-17T05:46:50.533972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:15:23.712248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.2d","version":"0'0","reported_seq":10,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-17T05:46:51.583515+0000","last_change":"2024-09-17T05:46:51.578864+0000","last_active":"2024-09-17T05:46:51.583515+0000","last_peered":"2024-09-17T05:46:51.583515+0000","last_clean":"2024-09-17T05:46:51.583515+0000","last_became_active":"2024-09-17T05:46:51.578508+0000","last_became_peered":"2024-09-17T05:46:51.578508+0000","last_unstale":"2024-09-17T05:46:51.583515+0000","last_undegraded":"2024-09-17T05:46:51.583515+0000","last_fullsized":"2024-09-17T05:46:51.583515+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:46:50.533972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:46:50.533972+0000","last_clean_scrub_stamp":"2024-09-17T05:46:50.533972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:36:16.964919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.2c","version":"0'0","reported_seq":13,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-17T05:46:52.574643+0000","last_change":"2024-09-17T05:46:51.564642+0000","last_active":"2024-09-17T05:46:52.574643+0000","last_peered":"2024-09-17T05:46:52.574643+0000","last_clean":"2024-09-17T05:46:52.574643+0000","last_became_active":"2024-09-17T05:46:51.564341+0000","last_became_peered":"2024-09-17T05:46:51.564341+0000","last_unstale":"2024-09-17T05:46:52.574643+0000","last_undegraded":"2024-09-17T05:46:52.574643+0000","last_fullsized":"2024-09-17T05:46:52.574643+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:46:50.533972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:46:50.533972+0000","last_clean_scrub_stamp":"2024-09-17T05:46:50.533972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:32:36.148692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.2b","version":"0'0","reported_seq":13,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-17T05:46:52.555065+0000","last_change":"2024-09-17T05:46:51.563753+0000","last_active":"2024-09-17T05:46:52.555065+0000","last_peered":"2024-09-17T05:46:52.555065+0000","last_clean":"2024-09-17T05:46:52.555065+0000","last_became_active":"2024-09-17T05:46:51.563438+0000","last_became_peered":"2024-09-17T05:46:51.563438+0000","last_unstale":"2024-09-17T05:46:52.555065+0000","last_undegraded":"2024-09-17T05:46:52.555065+0000","last_fullsized":"2024-09-17T05:46:52.555065+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:46:50.533972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:46:50.533972+0000","last_clean_scrub_stamp":"2024-09-17T05:46:50.533972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:39:57.587613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.2a","version":"0'0","reported_seq":13,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-17T05:46:52.555039+0000","last_change":"2024-09-17T05:46:51.568497+0000","last_active":"2024-09-17T05:46:52.555039+0000","last_peered":"2024-09-17T05:46:52.555039+0000","last_clean":"2024-09-17T05:46:52.555039+0000","last_became_active":"2024-09-17T05:46:51.568180+0000","last_became_peered":"2024-09-17T05:46:51.568180+0000","last_unstale":"2024-09-17T05:46:52.555039+0000","last_undegraded":"2024-09-17T05:46:52.555039+0000","last_fullsized":"2024-09-17T05:46:52.555039+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:46:50.533972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:46:50.533972+0000","last_clean_scrub_stamp":"2024-09-17T05:46:50.533972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:19:56.656681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.29","version":"0'0","reported_seq":13,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-17T05:46:52.866541+0000","last_change":"2024-09-17T05:46:51.564064+0000","last_active":"2024-09-17T05:46:52.866541+0000","last_peered":"2024-09-17T05:46:52.866541+0000","last_clean":"2024-09-17T05:46:52.866541+0000","last_became_active":"2024-09-17T05:46:51.563708+0000","last_became_peered":"2024-09-17T05:46:51.563708+0000","last_unstale":"2024-09-17T05:46:52.866541+0000","last_undegraded":"2024-09-17T05:46:52.866541+0000","last_fullsized":"2024-09-17T05:46:52.866541+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:46:50.533972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:46:50.533972+0000","last_clean_scrub_stamp":"2024-09-17T05:46:50.533972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:57:55.991216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.28","version":"0'0","reported_seq":13,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-17T05:46:52.866244+0000","last_change":"2024-09-17T05:46:51.581502+0000","last_active":"2024-09-17T05:46:52.866244+0000","last_peered":"2024-09-17T05:46:52.866244+0000","last_clean":"2024-09-17T05:46:52.866244+0000","last_became_active":"2024-09-17T05:46:51.580574+0000","last_became_peered":"2024-09-17T05:46:51.580574+0000","last_unstale":"2024-09-17T05:46:52.866244+0000","last_undegraded":"2024-09-17T05:46:52.866244+0000","last_fullsized":"2024-09-17T05:46:52.866244+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:46:50.533972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:46:50.533972+0000","last_clean_scrub_stamp":"2024-09-17T05:46:50.533972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:46:03.571664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.27","version":"0'0","reported_seq":13,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-17T05:46:52.555631+0000","last_change":"2024-09-17T05:46:51.573130+0000","last_active":"2024-09-17T05:46:52.555631+0000","last_peered":"2024-09-17T05:46:52.555631+0000","last_clean":"2024-09-17T05:46:52.555631+0000","last_became_active":"2024-09-17T05:46:51.572210+0000","last_became_peered":"2024-09-17T05:46:51.572210+0000","last_unstale":"2024-09-17T05:46:52.555631+0000","last_undegraded":"2024-09-17T05:46:52.555631+0000","last_fullsized":"2024-09-17T05:46:52.555631+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:46:50.533972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:46:50.533972+0000","last_clean_scrub_stamp":"2024-09-17T05:46:50.533972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:59:58.114229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.26","version":"0'0","reported_seq":13,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-17T05:46:52.572277+0000","last_change":"2024-09-17T05:46:51.575585+0000","last_active":"2024-09-17T05:46:52.572277+0000","last_peered":"2024-09-17T05:46:52.572277+0000","last_clean":"2024-09-17T05:46:52.572277+0000","last_became_active":"2024-09-17T05:46:51.575272+0000","last_became_peered":"2024-09-17T05:46:51.575272+0000","last_unstale":"2024-09-17T05:46:52.572277+0000","last_undegraded":"2024-09-17T05:46:52.572277+0000","last_fullsized":"2024-09-17T05:46:52.572277+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:46:50.533972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:46:50.533972+0000","last_clean_scrub_stamp":"2024-09-17T05:46:50.533972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:06:36.217986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.25","version":"0'0","reported_seq":10,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-17T05:46:51.568180+0000","last_change":"2024-09-17T05:46:51.566344+0000","last_active":"2024-09-17T05:46:51.568180+0000","last_peered":"2024-09-17T05:46:51.568180+0000","last_clean":"2024-09-17T05:46:51.568180+0000","last_became_active":"2024-09-17T05:46:51.564652+0000","last_became_peered":"2024-09-17T05:46:51.564652+0000","last_unstale":"2024-09-17T05:46:51.568180+0000","last_undegraded":"2024-09-17T05:46:51.568180+0000","last_fullsized":"2024-09-17T05:46:51.568180+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:46:50.533972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:46:50.533972+0000","last_clean_scrub_stamp":"2024-09-17T05:46:50.533972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:27:02.406829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.24","version":"0'0","reported_seq":13,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-17T05:46:52.555323+0000","last_change":"2024-09-17T05:46:51.568790+0000","last_active":"2024-09-17T05:46:52.555323+0000","last_peered":"2024-09-17T05:46:52.555323+0000","last_clean":"2024-09-17T05:46:52.555323+0000","last_became_active":"2024-09-17T05:46:51.568328+0000","last_became_peered":"2024-09-17T05:46:51.568328+0000","last_unstale":"2024-09-17T05:46:52.555323+0000","last_undegraded":"2024-09-17T05:46:52.555323+0000","last_fullsized":"2024-09-17T05:46:52.555323+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:46:50.533972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:46:50.533972+0000","last_clean_scrub_stamp":"2024-09-17T05:46:50.533972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:37:41.860352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.23","version":"0'0","reported_seq":10,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-17T05:46:51.567854+0000","last_change":"2024-09-17T05:46:51.564915+0000","last_active":"2024-09-17T05:46:51.567854+0000","last_peered":"2024-09-17T05:46:51.567854+0000","last_clean":"2024-09-17T05:46:51.567854+0000","last_became_active":"2024-09-17T05:46:51.564611+0000","last_became_peered":"2024-09-17T05:46:51.564611+0000","last_unstale":"2024-09-17T05:46:51.567854+0000","last_undegraded":"2024-09-17T05:46:51.567854+0000","last_fullsized":"2024-09-17T05:46:51.567854+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:46:50.533972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:46:50.533972+0000","last_clean_scrub_stamp":"2024-09-17T05:46:50.533972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:09:33.099629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.22","version":"0'0","reported_seq":13,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-17T05:46:52.572040+0000","last_change":"2024-09-17T05:46:51.576081+0000","last_active":"2024-09-17T05:46:52.572040+0000","last_peered":"2024-09-17T05:46:52.572040+0000","last_clean":"2024-09-17T05:46:52.572040+0000","last_became_active":"2024-09-17T05:46:51.575249+0000","last_became_peered":"2024-09-17T05:46:51.575249+0000","last_unstale":"2024-09-17T05:46:52.572040+0000","last_undegraded":"2024-09-17T05:46:52.572040+0000","last_fullsized":"2024-09-17T05:46:52.572040+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:46:50.533972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:46:50.533972+0000","last_clean_scrub_stamp":"2024-09-17T05:46:50.533972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:06:57.020798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.21","version":"0'0","reported_seq":13,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-17T05:46:52.572230+0000","last_change":"2024-09-17T05:46:51.566511+0000","last_active":"2024-09-17T05:46:52.572230+0000","last_peered":"2024-09-17T05:46:52.572230+0000","last_clean":"2024-09-17T05:46:52.572230+0000","last_became_active":"2024-09-17T05:46:51.566168+0000","last_became_peered":"2024-09-17T05:46:51.566168+0000","last_unstale":"2024-09-17T05:46:52.572230+0000","last_undegraded":"2024-09-17T05:46:52.572230+0000","last_fullsized":"2024-09-17T05:46:52.572230+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:46:50.533972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:46:50.533972+0000","last_clean_scrub_stamp":"2024-09-17T05:46:50.533972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:53:47.928972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.20","version":"0'0","reported_seq":10,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-17T05:46:51.580457+0000","last_change":"2024-09-17T05:46:51.577607+0000","last_active":"2024-09-17T05:46:51.580457+0000","last_peered":"2024-09-17T05:46:51.580457+0000","last_clean":"2024-09-17T05:46:51.580457+0000","last_became_active":"2024-09-17T05:46:51.576279+0000","last_became_peered":"2024-09-17T05:46:51.576279+0000","last_unstale":"2024-09-17T05:46:51.580457+0000","last_undegraded":"2024-09-17T05:46:51.580457+0000","last_fullsized":"2024-09-17T05:46:51.580457+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:46:50.533972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:46:50.533972+0000","last_clean_scrub_stamp":"2024-09-17T05:46:50.533972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:35:43.534736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.1e","version":"0'0","reported_seq":13,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-17T05:46:52.866783+0000","last_change":"2024-09-17T05:46:51.575936+0000","last_active":"2024-09-17T05:46:52.866783+0000","last_peered":"2024-09-17T05:46:52.866783+0000","last_clean":"2024-09-17T05:46:52.866783+0000","last_became_active":"2024-09-17T05:46:51.575628+0000","last_became_peered":"2024-09-17T05:46:51.575628+0000","last_unstale":"2024-09-17T05:46:52.866783+0000","last_undegraded":"2024-09-17T05:46:52.866783+0000","last_fullsized":"2024-09-17T05:46:52.866783+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:46:50.533972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:46:50.533972+0000","last_clean_scrub_stamp":"2024-09-17T05:46:50.533972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:49:57.789658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1f","version":"71'4","reported_seq":19,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-17T05:46:52.867558+0000","last_change":"2024-09-17T05:46:50.558694+0000","last_active":"2024-09-17T05:46:52.867558+0000","last_peered":"2024-09-17T05:46:52.867558+0000","last_clean":"2024-09-17T05:46:52.867558+0000","last_became_active":"2024-09-17T05:46:50.557228+0000","last_became_peered":"2024-09-17T05:46:50.557228+0000","last_unstale":"2024-09-17T05:46:52.867558+0000","last_undegraded":"2024-09-17T05:46:52.867558+0000","last_fullsized":"2024-09-17T05:46:52.867558+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:46:49.528019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:46:49.528019+0000","last_clean_scrub_stamp":"2024-09-17T05:46:49.528019+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:59:04.225971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.1f","version":"0'0","reported_seq":10,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-17T05:46:51.565606+0000","last_change":"2024-09-17T05:46:51.562813+0000","last_active":"2024-09-17T05:46:51.565606+0000","last_peered":"2024-09-17T05:46:51.565606+0000","last_clean":"2024-09-17T05:46:51.565606+0000","last_became_active":"2024-09-17T05:46:51.562079+0000","last_became_peered":"2024-09-17T05:46:51.562079+0000","last_unstale":"2024-09-17T05:46:51.565606+0000","last_undegraded":"2024-09-17T05:46:51.565606+0000","last_fullsized":"2024-09-17T05:46:51.565606+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:46:50.533972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:46:50.533972+0000","last_clean_scrub_stamp":"2024-09-17T05:46:50.533972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:05:18.413938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.1e","version":"71'1","reported_seq":16,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-17T05:46:52.574660+0000","last_change":"2024-09-17T05:46:50.552744+0000","last_active":"2024-09-17T05:46:52.574660+0000","last_peered":"2024-09-17T05:46:52.574660+0000","last_clean":"2024-09-17T05:46:52.574660+0000","last_became_active":"2024-09-17T05:46:50.551757+0000","last_became_peered":"2024-09-17T05:46:50.551757+0000","last_unstale":"2024-09-17T05:46:52.574660+0000","last_undegraded":"2024-09-17T05:46:52.574660+0000","last_fullsized":"2024-09-17T05:46:52.574660+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:46:49.528019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:46:49.528019+0000","last_clean_scrub_stamp":"2024-09-17T05:46:49.528019+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:10:23.845161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1c","version":"0'0","reported_seq":10,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-17T05:46:51.582656+0000","last_change":"2024-09-17T05:46:51.581452+0000","last_active":"2024-09-17T05:46:51.582656+0000","last_peered":"2024-09-17T05:46:51.582656+0000","last_clean":"2024-09-17T05:46:51.582656+0000","last_became_active":"2024-09-17T05:46:51.581056+0000","last_became_peered":"2024-09-17T05:46:51.581056+0000","last_unstale":"2024-09-17T05:46:51.582656+0000","last_undegraded":"2024-09-17T05:46:51.582656+0000","last_fullsized":"2024-09-17T05:46:51.582656+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:46:50.533972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:46:50.533972+0000","last_clean_scrub_stamp":"2024-09-17T05:46:50.533972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:49:54.442500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.1d","version":"71'2","reported_seq":17,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-17T05:46:52.555133+0000","last_change":"2024-09-17T05:46:50.558321+0000","last_active":"2024-09-17T05:46:52.555133+0000","last_peered":"2024-09-17T05:46:52.555133+0000","last_clean":"2024-09-17T05:46:52.555133+0000","last_became_active":"2024-09-17T05:46:50.557997+0000","last_became_peered":"2024-09-17T05:46:50.557997+0000","last_unstale":"2024-09-17T05:46:52.555133+0000","last_undegraded":"2024-09-17T05:46:52.555133+0000","last_fullsized":"2024-09-17T05:46:52.555133+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:46:49.528019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:46:49.528019+0000","last_clean_scrub_stamp":"2024-09-17T05:46:49.528019+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:14:18.759730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1d","version":"0'0","reported_seq":13,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-17T05:46:52.867404+0000","last_change":"2024-09-17T05:46:51.563338+0000","last_active":"2024-09-17T05:46:52.867404+0000","last_peered":"2024-09-17T05:46:52.867404+0000","last_clean":"2024-09-17T05:46:52.867404+0000","last_became_active":"2024-09-17T05:46:51.562937+0000","last_became_peered":"2024-09-17T05:46:51.562937+0000","last_unstale":"2024-09-17T05:46:52.867404+0000","last_undegraded":"2024-09-17T05:46:52.867404+0000","last_fullsized":"2024-09-17T05:46:52.867404+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:46:50.533972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:46:50.533972+0000","last_clean_scrub_stamp":"2024-09-17T05:46:50.533972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:36:59.027650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1c","version":"71'2","reported_seq":15,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-17T05:46:51.586077+0000","last_change":"2024-09-17T05:46:50.555340+0000","last_active":"2024-09-17T05:46:51.586077+0000","last_peered":"2024-09-17T05:46:51.586077+0000","last_clean":"2024-09-17T05:46:51.586077+0000","last_became_active":"2024-09-17T05:46:50.554957+0000","last_became_peered":"2024-09-17T05:46:50.554957+0000","last_unstale":"2024-09-17T05:46:51.586077+0000","last_undegraded":"2024-09-17T05:46:51.586077+0000","last_fullsized":"2024-09-17T05:46:51.586077+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:46:49.528019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:46:49.528019+0000","last_clean_scrub_stamp":"2024-09-17T05:46:49.528019+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:39:19.804580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.1a","version":"0'0","reported_seq":13,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-17T05:46:52.572126+0000","last_change":"2024-09-17T05:46:51.571241+0000","last_active":"2024-09-17T05:46:52.572126+0000","last_peered":"2024-09-17T05:46:52.572126+0000","last_clean":"2024-09-17T05:46:52.572126+0000","last_became_active":"2024-09-17T05:46:51.570889+0000","last_became_peered":"2024-09-17T05:46:51.570889+0000","last_unstale":"2024-09-17T05:46:52.572126+0000","last_undegraded":"2024-09-17T05:46:52.572126+0000","last_fullsized":"2024-09-17T05:46:52.572126+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:46:50.533972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:46:50.533972+0000","last_clean_scrub_stamp":"2024-09-17T05:46:50.533972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:40:24.996136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.1b","version":"71'1","reported_seq":14,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-17T05:46:51.583973+0000","last_change":"2024-09-17T05:46:50.554024+0000","last_active":"2024-09-17T05:46:51.583973+0000","last_peered":"2024-09-17T05:46:51.583973+0000","last_clean":"2024-09-17T05:46:51.583973+0000","last_became_active":"2024-09-17T05:46:50.553651+0000","last_became_peered":"2024-09-17T05:46:50.553651+0000","last_unstale":"2024-09-17T05:46:51.583973+0000","last_undegraded":"2024-09-17T05:46:51.583973+0000","last_fullsized":"2024-09-17T05:46:51.583973+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:46:49.528019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:46:49.528019+0000","last_clean_scrub_stamp":"2024-09-17T05:46:49.528019+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:08:30.756585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.1b","version":"0'0","reported_seq":13,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-17T05:46:52.555389+0000","last_change":"2024-09-17T05:46:51.571637+0000","last_active":"2024-09-17T05:46:52.555389+0000","last_peered":"2024-09-17T05:46:52.555389+0000","last_clean":"2024-09-17T05:46:52.555389+0000","last_became_active":"2024-09-17T05:46:51.571168+0000","last_became_peered":"2024-09-17T05:46:51.571168+0000","last_unstale":"2024-09-17T05:46:52.555389+0000","last_undegraded":"2024-09-17T05:46:52.555389+0000","last_fullsized":"2024-09-17T05:46:52.555389+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:46:50.533972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:46:50.533972+0000","last_clean_scrub_stamp":"2024-09-17T05:46:50.533972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:53:12.121398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.1a","version":"71'1","reported_seq":14,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-17T05:46:51.585449+0000","last_change":"2024-09-17T05:46:50.561274+0000","last_active":"2024-09-17T05:46:51.585449+0000","last_peered":"2024-09-17T05:46:51.585449+0000","last_clean":"2024-09-17T05:46:51.585449+0000","last_became_active":"2024-09-17T05:46:50.560729+0000","last_became_peered":"2024-09-17T05:46:50.560729+0000","last_unstale":"2024-09-17T05:46:51.585449+0000","last_undegraded":"2024-09-17T05:46:51.585449+0000","last_fullsized":"2024-09-17T05:46:51.585449+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:46:49.528019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:46:49.528019+0000","last_clean_scrub_stamp":"2024-09-17T05:46:49.528019+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:46:48.701238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.18","version":"0'0","reported_seq":10,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-17T05:46:51.569374+0000","last_change":"2024-09-17T05:46:51.568431+0000","last_active":"2024-09-17T05:46:51.569374+0000","last_peered":"2024-09-17T05:46:51.569374+0000","last_clean":"2024-09-17T05:46:51.569374+0000","last_became_active":"2024-09-17T05:46:51.568066+0000","last_became_peered":"2024-09-17T05:46:51.568066+0000","last_unstale":"2024-09-17T05:46:51.569374+0000","last_undegraded":"2024-09-17T05:46:51.569374+0000","last_fullsized":"2024-09-17T05:46:51.569374+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:46:50.533972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:46:50.533972+0000","last_clean_scrub_stamp":"2024-09-17T05:46:50.533972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:12:15.570105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.19","version":"0'0","reported_seq":13,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-17T05:46:51.550635+0000","last_change":"2024-09-17T05:46:50.552167+0000","last_active":"2024-09-17T05:46:51.550635+0000","last_peered":"2024-09-17T05:46:51.550635+0000","last_clean":"2024-09-17T05:46:51.550635+0000","last_became_active":"2024-09-17T05:46:50.551856+0000","last_became_peered":"2024-09-17T05:46:50.551856+0000","last_unstale":"2024-09-17T05:46:51.550635+0000","last_undegraded":"2024-09-17T05:46:51.550635+0000","last_fullsized":"2024-09-17T05:46:51.550635+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:46:49.528019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:46:49.528019+0000","last_clean_scrub_stamp":"2024-09-17T05:46:49.528019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:23:08.023320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.19","version":"0'0","reported_seq":13,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-17T05:46:52.574533+0000","last_change":"2024-09-17T05:46:51.569311+0000","last_active":"2024-09-17T05:46:52.574533+0000","last_peered":"2024-09-17T05:46:52.574533+0000","last_clean":"2024-09-17T05:46:52.574533+0000","last_became_active":"2024-09-17T05:46:51.569013+0000","last_became_peered":"2024-09-17T05:46:51.569013+0000","last_unstale":"2024-09-17T05:46:52.574533+0000","last_undegraded":"2024-09-17T05:46:52.574533+0000","last_fullsized":"2024-09-17T05:46:52.574533+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:46:50.533972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:46:50.533972+0000","last_clean_scrub_stamp":"2024-09-17T05:46:50.533972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:28:30.156588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.18","version":"0'0","reported_seq":13,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-17T05:46:51.552307+0000","last_change":"2024-09-17T05:46:50.552379+0000","last_active":"2024-09-17T05:46:51.552307+0000","last_peered":"2024-09-17T05:46:51.552307+0000","last_clean":"2024-09-17T05:46:51.552307+0000","last_became_active":"2024-09-17T05:46:50.552079+0000","last_became_peered":"2024-09-17T05:46:50.552079+0000","last_unstale":"2024-09-17T05:46:51.552307+0000","last_undegraded":"2024-09-17T05:46:51.552307+0000","last_fullsized":"2024-09-17T05:46:51.552307+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:46:49.528019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:46:49.528019+0000","last_clean_scrub_stamp":"2024-09-17T05:46:49.528019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:56:26.674599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.16","version":"0'0","reported_seq":13,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-17T05:46:52.572384+0000","last_change":"2024-09-17T05:46:51.563684+0000","last_active":"2024-09-17T05:46:52.572384+0000","last_peered":"2024-09-17T05:46:52.572384+0000","last_clean":"2024-09-17T05:46:52.572384+0000","last_became_active":"2024-09-17T05:46:51.563368+0000","last_became_peered":"2024-09-17T05:46:51.563368+0000","last_unstale":"2024-09-17T05:46:52.572384+0000","last_undegraded":"2024-09-17T05:46:52.572384+0000","last_fullsized":"2024-09-17T05:46:52.572384+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:46:50.533972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:46:50.533972+0000","last_clean_scrub_stamp":"2024-09-17T05:46:50.533972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:10:39.211711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.17","version":"0'0","reported_seq":15,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-17T05:46:52.555372+0000","last_change":"2024-09-17T05:46:50.550428+0000","last_active":"2024-09-17T05:46:52.555372+0000","last_peered":"2024-09-17T05:46:52.555372+0000","last_clean":"2024-09-17T05:46:52.555372+0000","last_became_active":"2024-09-17T05:46:50.549751+0000","last_became_peered":"2024-09-17T05:46:50.549751+0000","last_unstale":"2024-09-17T05:46:52.555372+0000","last_undegraded":"2024-09-17T05:46:52.555372+0000","last_fullsized":"2024-09-17T05:46:52.555372+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:46:49.528019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:46:49.528019+0000","last_clean_scrub_stamp":"2024-09-17T05:46:49.528019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:07:41.263112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.17","version":"0'0","reported_seq":13,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-17T05:46:52.867107+0000","last_change":"2024-09-17T05:46:51.577181+0000","last_active":"2024-09-17T05:46:52.867107+0000","last_peered":"2024-09-17T05:46:52.867107+0000","last_clean":"2024-09-17T05:46:52.867107+0000","last_became_active":"2024-09-17T05:46:51.576829+0000","last_became_peered":"2024-09-17T05:46:51.576829+0000","last_unstale":"2024-09-17T05:46:52.867107+0000","last_undegraded":"2024-09-17T05:46:52.867107+0000","last_fullsized":"2024-09-17T05:46:52.867107+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:46:50.533972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:46:50.533972+0000","last_clean_scrub_stamp":"2024-09-17T05:46:50.533972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:15:31.665358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.16","version":"0'0","reported_seq":13,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-17T05:46:51.565295+0000","last_change":"2024-09-17T05:46:50.556469+0000","last_active":"2024-09-17T05:46:51.565295+0000","last_peered":"2024-09-17T05:46:51.565295+0000","last_clean":"2024-09-17T05:46:51.565295+0000","last_became_active":"2024-09-17T05:46:50.555925+0000","last_became_peered":"2024-09-17T05:46:50.555925+0000","last_unstale":"2024-09-17T05:46:51.565295+0000","last_undegraded":"2024-09-17T05:46:51.565295+0000","last_fullsized":"2024-09-17T05:46:51.565295+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:46:49.528019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:46:49.528019+0000","last_clean_scrub_stamp":"2024-09-17T05:46:49.528019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:11:55.261702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.14","version":"0'0","reported_seq":10,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-17T05:46:51.581701+0000","last_change":"2024-09-17T05:46:51.579751+0000","last_active":"2024-09-17T05:46:51.581701+0000","last_peered":"2024-09-17T05:46:51.581701+0000","last_clean":"2024-09-17T05:46:51.581701+0000","last_became_active":"2024-09-17T05:46:51.579430+0000","last_became_peered":"2024-09-17T05:46:51.579430+0000","last_unstale":"2024-09-17T05:46:51.581701+0000","last_undegraded":"2024-09-17T05:46:51.581701+0000","last_fullsized":"2024-09-17T05:46:51.581701+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:46:50.533972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:46:50.533972+0000","last_clean_scrub_stamp":"2024-09-17T05:46:50.533972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:59:19.488416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.15","version":"71'3","reported_seq":16,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-17T05:46:51.579084+0000","last_change":"2024-09-17T05:46:50.552409+0000","last_active":"2024-09-17T05:46:51.579084+0000","last_peered":"2024-09-17T05:46:51.579084+0000","last_clean":"2024-09-17T05:46:51.579084+0000","last_became_active":"2024-09-17T05:46:50.551178+0000","last_became_peered":"2024-09-17T05:46:50.551178+0000","last_unstale":"2024-09-17T05:46:51.579084+0000","last_undegraded":"2024-09-17T05:46:51.579084+0000","last_fullsized":"2024-09-17T05:46:51.579084+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:46:49.528019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:46:49.528019+0000","last_clean_scrub_stamp":"2024-09-17T05:46:49.528019+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:29:57.514758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.15","version":"0'0","reported_seq":10,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-17T05:46:51.557879+0000","last_change":"2024-09-17T05:46:51.555771+0000","last_active":"2024-09-17T05:46:51.557879+0000","last_peered":"2024-09-17T05:46:51.557879+0000","last_clean":"2024-09-17T05:46:51.557879+0000","last_became_active":"2024-09-17T05:46:51.555470+0000","last_became_peered":"2024-09-17T05:46:51.555470+0000","last_unstale":"2024-09-17T05:46:51.557879+0000","last_undegraded":"2024-09-17T05:46:51.557879+0000","last_fullsized":"2024-09-17T05:46:51.557879+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:46:50.533972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:46:50.533972+0000","last_clean_scrub_stamp":"2024-09-17T05:46:50.533972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:14:34.283104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.14","version":"71'6","reported_seq":19,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-17T05:46:51.586126+0000","last_change":"2024-09-17T05:46:50.553143+0000","last_active":"2024-09-17T05:46:51.586126+0000","last_peered":"2024-09-17T05:46:51.586126+0000","last_clean":"2024-09-17T05:46:51.586126+0000","last_became_active":"2024-09-17T05:46:50.552549+0000","last_became_peered":"2024-09-17T05:46:50.552549+0000","last_unstale":"2024-09-17T05:46:51.586126+0000","last_undegraded":"2024-09-17T05:46:51.586126+0000","last_fullsized":"2024-09-17T05:46:51.586126+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:46:49.528019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:46:49.528019+0000","last_clean_scrub_stamp":"2024-09-17T05:46:49.528019+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:04:38.547894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.12","version":"0'0","reported_seq":13,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-17T05:46:52.866378+0000","last_change":"2024-09-17T05:46:51.561258+0000","last_active":"2024-09-17T05:46:52.866378+0000","last_peered":"2024-09-17T05:46:52.866378+0000","last_clean":"2024-09-17T05:46:52.866378+0000","last_became_active":"2024-09-17T05:46:51.560943+0000","last_became_peered":"2024-09-17T05:46:51.560943+0000","last_unstale":"2024-09-17T05:46:52.866378+0000","last_undegraded":"2024-09-17T05:46:52.866378+0000","last_fullsized":"2024-09-17T05:46:52.866378+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:46:50.533972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:46:50.533972+0000","last_clean_scrub_stamp":"2024-09-17T05:46:50.533972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:41:21.338178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.13","version":"71'2","reported_seq":15,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-17T05:46:51.577782+0000","last_change":"2024-09-17T05:46:50.553892+0000","last_active":"2024-09-17T05:46:51.577782+0000","last_peered":"2024-09-17T05:46:51.577782+0000","last_clean":"2024-09-17T05:46:51.577782+0000","last_became_active":"2024-09-17T05:46:50.553567+0000","last_became_peered":"2024-09-17T05:46:50.553567+0000","last_unstale":"2024-09-17T05:46:51.577782+0000","last_undegraded":"2024-09-17T05:46:51.577782+0000","last_fullsized":"2024-09-17T05:46:51.577782+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:46:49.528019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:46:49.528019+0000","last_clean_scrub_stamp":"2024-09-17T05:46:49.528019+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:16:32.532491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.13","version":"0'0","reported_seq":13,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-17T05:46:52.572333+0000","last_change":"2024-09-17T05:46:51.571401+0000","last_active":"2024-09-17T05:46:52.572333+0000","last_peered":"2024-09-17T05:46:52.572333+0000","last_clean":"2024-09-17T05:46:52.572333+0000","last_became_active":"2024-09-17T05:46:51.571041+0000","last_became_peered":"2024-09-17T05:46:51.571041+0000","last_unstale":"2024-09-17T05:46:52.572333+0000","last_undegraded":"2024-09-17T05:46:52.572333+0000","last_fullsized":"2024-09-17T05:46:52.572333+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:46:50.533972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:46:50.533972+0000","last_clean_scrub_stamp":"2024-09-17T05:46:50.533972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:15:17.799084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.12","version":"0'0","reported_seq":13,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-17T05:46:51.567763+0000","last_change":"2024-09-17T05:46:50.557441+0000","last_active":"2024-09-17T05:46:51.567763+0000","last_peered":"2024-09-17T05:46:51.567763+0000","last_clean":"2024-09-17T05:46:51.567763+0000","last_became_active":"2024-09-17T05:46:50.557121+0000","last_became_peered":"2024-09-17T05:46:50.557121+0000","last_unstale":"2024-09-17T05:46:51.567763+0000","last_undegraded":"2024-09-17T05:46:51.567763+0000","last_fullsized":"2024-09-17T05:46:51.567763+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:46:49.528019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:46:49.528019+0000","last_clean_scrub_stamp":"2024-09-17T05:46:49.528019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:52:52.514589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.10","version":"0'0","reported_seq":13,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-17T05:46:52.574474+0000","last_change":"2024-09-17T05:46:51.580220+0000","last_active":"2024-09-17T05:46:52.574474+0000","last_peered":"2024-09-17T05:46:52.574474+0000","last_clean":"2024-09-17T05:46:52.574474+0000","last_became_active":"2024-09-17T05:46:51.579877+0000","last_became_peered":"2024-09-17T05:46:51.579877+0000","last_unstale":"2024-09-17T05:46:52.574474+0000","last_undegraded":"2024-09-17T05:46:52.574474+0000","last_fullsized":"2024-09-17T05:46:52.574474+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:46:50.533972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:46:50.533972+0000","last_clean_scrub_stamp":"2024-09-17T05:46:50.533972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:07:06.372655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.11","version":"0'0","reported_seq":15,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-17T05:46:52.571916+0000","last_change":"2024-09-17T05:46:50.549371+0000","last_active":"2024-09-17T05:46:52.571916+0000","last_peered":"2024-09-17T05:46:52.571916+0000","last_clean":"2024-09-17T05:46:52.571916+0000","last_became_active":"2024-09-17T05:46:50.548998+0000","last_became_peered":"2024-09-17T05:46:50.548998+0000","last_unstale":"2024-09-17T05:46:52.571916+0000","last_undegraded":"2024-09-17T05:46:52.571916+0000","last_fullsized":"2024-09-17T05:46:52.571916+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:46:49.528019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:46:49.528019+0000","last_clean_scrub_stamp":"2024-09-17T05:46:49.528019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:39:56.581660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.11","version":"0'0","reported_seq":10,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-17T05:46:51.564902+0000","last_change":"2024-09-17T05:46:51.562481+0000","last_active":"2024-09-17T05:46:51.564902+0000","last_peered":"2024-09-17T05:46:51.564902+0000","last_clean":"2024-09-17T05:46:51.564902+0000","last_became_active":"2024-09-17T05:46:51.562122+0000","last_became_peered":"2024-09-17T05:46:51.562122+0000","last_unstale":"2024-09-17T05:46:51.564902+0000","last_undegraded":"2024-09-17T05:46:51.564902+0000","last_fullsized":"2024-09-17T05:46:51.564902+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:46:50.533972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:46:50.533972+0000","last_clean_scrub_stamp":"2024-09-17T05:46:50.533972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:28:26.034113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.10","version":"71'8","reported_seq":23,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-17T05:46:52.554886+0000","last_change":"2024-09-17T05:46:50.552842+0000","last_active":"2024-09-17T05:46:52.554886+0000","last_peered":"2024-09-17T05:46:52.554886+0000","last_clean":"2024-09-17T05:46:52.554886+0000","last_became_active":"2024-09-17T05:46:50.552520+0000","last_became_peered":"2024-09-17T05:46:50.552520+0000","last_unstale":"2024-09-17T05:46:52.554886+0000","last_undegraded":"2024-09-17T05:46:52.554886+0000","last_fullsized":"2024-09-17T05:46:52.554886+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:46:49.528019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:46:49.528019+0000","last_clean_scrub_stamp":"2024-09-17T05:46:49.528019+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:34:12.748494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.e","version":"0'0","reported_seq":13,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-17T05:46:52.555536+0000","last_change":"2024-09-17T05:46:51.570496+0000","last_active":"2024-09-17T05:46:52.555536+0000","last_peered":"2024-09-17T05:46:52.555536+0000","last_clean":"2024-09-17T05:46:52.555536+0000","last_became_active":"2024-09-17T05:46:51.569814+0000","last_became_peered":"2024-09-17T05:46:51.569814+0000","last_unstale":"2024-09-17T05:46:52.555536+0000","last_undegraded":"2024-09-17T05:46:52.555536+0000","last_fullsized":"2024-09-17T05:46:52.555536+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:46:50.533972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:46:50.533972+0000","last_clean_scrub_stamp":"2024-09-17T05:46:50.533972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:23:48.119361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.f","version":"71'1","reported_seq":14,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-17T05:46:51.586405+0000","last_change":"2024-09-17T05:46:50.555496+0000","last_active":"2024-09-17T05:46:51.586405+0000","last_peered":"2024-09-17T05:46:51.586405+0000","last_clean":"2024-09-17T05:46:51.586405+0000","last_became_active":"2024-09-17T05:46:50.555176+0000","last_became_peered":"2024-09-17T05:46:50.555176+0000","last_unstale":"2024-09-17T05:46:51.586405+0000","last_undegraded":"2024-09-17T05:46:51.586405+0000","last_fullsized":"2024-09-17T05:46:51.586405+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:46:49.528019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:46:49.528019+0000","last_clean_scrub_stamp":"2024-09-17T05:46:49.528019+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:22:31.843476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.f","version":"0'0","reported_seq":13,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-17T05:46:52.867096+0000","last_change":"2024-09-17T05:46:51.567158+0000","last_active":"2024-09-17T05:46:52.867096+0000","last_peered":"2024-09-17T05:46:52.867096+0000","last_clean":"2024-09-17T05:46:52.867096+0000","last_became_active":"2024-09-17T05:46:51.566686+0000","last_became_peered":"2024-09-17T05:46:51.566686+0000","last_unstale":"2024-09-17T05:46:52.867096+0000","last_undegraded":"2024-09-17T05:46:52.867096+0000","last_fullsized":"2024-09-17T05:46:52.867096+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:46:50.533972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:46:50.533972+0000","last_clean_scrub_stamp":"2024-09-17T05:46:50.533972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:28:31.739331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.e","version":"71'2","reported_seq":17,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-17T05:46:52.555652+0000","last_change":"2024-09-17T05:46:50.558925+0000","last_active":"2024-09-17T05:46:52.555652+0000","last_peered":"2024-09-17T05:46:52.555652+0000","last_clean":"2024-09-17T05:46:52.555652+0000","last_became_active":"2024-09-17T05:46:50.558622+0000","last_became_peered":"2024-09-17T05:46:50.558622+0000","last_unstale":"2024-09-17T05:46:52.555652+0000","last_undegraded":"2024-09-17T05:46:52.555652+0000","last_fullsized":"2024-09-17T05:46:52.555652+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:46:49.528019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:46:49.528019+0000","last_clean_scrub_stamp":"2024-09-17T05:46:49.528019+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:57:01.346586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.c","version":"0'0","reported_seq":10,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-17T05:46:51.558979+0000","last_change":"2024-09-17T05:46:51.556516+0000","last_active":"2024-09-17T05:46:51.558979+0000","last_peered":"2024-09-17T05:46:51.558979+0000","last_clean":"2024-09-17T05:46:51.558979+0000","last_became_active":"2024-09-17T05:46:51.555785+0000","last_became_peered":"2024-09-17T05:46:51.555785+0000","last_unstale":"2024-09-17T05:46:51.558979+0000","last_undegraded":"2024-09-17T05:46:51.558979+0000","last_fullsized":"2024-09-17T05:46:51.558979+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:46:50.533972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:46:50.533972+0000","last_clean_scrub_stamp":"2024-09-17T05:46:50.533972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:09:00.267194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.d","version":"71'1","reported_seq":14,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-17T05:46:51.586143+0000","last_change":"2024-09-17T05:46:50.560558+0000","last_active":"2024-09-17T05:46:51.586143+0000","last_peered":"2024-09-17T05:46:51.586143+0000","last_clean":"2024-09-17T05:46:51.586143+0000","last_became_active":"2024-09-17T05:46:50.560242+0000","last_became_peered":"2024-09-17T05:46:50.560242+0000","last_unstale":"2024-09-17T05:46:51.586143+0000","last_undegraded":"2024-09-17T05:46:51.586143+0000","last_fullsized":"2024-09-17T05:46:51.586143+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:46:49.528019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:46:49.528019+0000","last_clean_scrub_stamp":"2024-09-17T05:46:49.528019+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:30:56.705724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.d","version":"0'0","reported_seq":10,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-17T05:46:51.558964+0000","last_change":"2024-09-17T05:46:51.557975+0000","last_active":"2024-09-17T05:46:51.558964+0000","last_peered":"2024-09-17T05:46:51.558964+0000","last_clean":"2024-09-17T05:46:51.558964+0000","last_became_active":"2024-09-17T05:46:51.557674+0000","last_became_peered":"2024-09-17T05:46:51.557674+0000","last_unstale":"2024-09-17T05:46:51.558964+0000","last_undegraded":"2024-09-17T05:46:51.558964+0000","last_fullsized":"2024-09-17T05:46:51.558964+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:46:50.533972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:46:50.533972+0000","last_clean_scrub_stamp":"2024-09-17T05:46:50.533972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:47:53.991131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.c","version":"0'0","reported_seq":15,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-17T05:46:52.866863+0000","last_change":"2024-09-17T05:46:50.558154+0000","last_active":"2024-09-17T05:46:52.866863+0000","last_peered":"2024-09-17T05:46:52.866863+0000","last_clean":"2024-09-17T05:46:52.866863+0000","last_became_active":"2024-09-17T05:46:50.557830+0000","last_became_peered":"2024-09-17T05:46:50.557830+0000","last_unstale":"2024-09-17T05:46:52.866863+0000","last_undegraded":"2024-09-17T05:46:52.866863+0000","last_fullsized":"2024-09-17T05:46:52.866863+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:46:49.528019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:46:49.528019+0000","last_clean_scrub_stamp":"2024-09-17T05:46:49.528019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:27:20.878247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.b","version":"0'0","reported_seq":10,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-17T05:46:51.566491+0000","last_change":"2024-09-17T05:46:51.559821+0000","last_active":"2024-09-17T05:46:51.566491+0000","last_peered":"2024-09-17T05:46:51.566491+0000","last_clean":"2024-09-17T05:46:51.566491+0000","last_became_active":"2024-09-17T05:46:51.559470+0000","last_became_peered":"2024-09-17T05:46:51.559470+0000","last_unstale":"2024-09-17T05:46:51.566491+0000","last_undegraded":"2024-09-17T05:46:51.566491+0000","last_fullsized":"2024-09-17T05:46:51.566491+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:46:50.533972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:46:50.533972+0000","last_clean_scrub_stamp":"2024-09-17T05:46:50.533972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:29:39.351334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.a","version":"0'0","reported_seq":13,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-17T05:46:51.568046+0000","last_change":"2024-09-17T05:46:50.561013+0000","last_active":"2024-09-17T05:46:51.568046+0000","last_peered":"2024-09-17T05:46:51.568046+0000","last_clean":"2024-09-17T05:46:51.568046+0000","last_became_active":"2024-09-17T05:46:50.560656+0000","last_became_peered":"2024-09-17T05:46:50.560656+0000","last_unstale":"2024-09-17T05:46:51.568046+0000","last_undegraded":"2024-09-17T05:46:51.568046+0000","last_fullsized":"2024-09-17T05:46:51.568046+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:46:49.528019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:46:49.528019+0000","last_clean_scrub_stamp":"2024-09-17T05:46:49.528019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:12:32.519550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.8","version":"0'0","reported_seq":10,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-17T05:46:51.581523+0000","last_change":"2024-09-17T05:46:51.579266+0000","last_active":"2024-09-17T05:46:51.581523+0000","last_peered":"2024-09-17T05:46:51.581523+0000","last_clean":"2024-09-17T05:46:51.581523+0000","last_became_active":"2024-09-17T05:46:51.578937+0000","last_became_peered":"2024-09-17T05:46:51.578937+0000","last_unstale":"2024-09-17T05:46:51.581523+0000","last_undegraded":"2024-09-17T05:46:51.581523+0000","last_fullsized":"2024-09-17T05:46:51.581523+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:46:50.533972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:46:50.533972+0000","last_clean_scrub_stamp":"2024-09-17T05:46:50.533972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:16:21.255512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.9","version":"0'0","reported_seq":15,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-17T05:46:52.572199+0000","last_change":"2024-09-17T05:46:50.555771+0000","last_active":"2024-09-17T05:46:52.572199+0000","last_peered":"2024-09-17T05:46:52.572199+0000","last_clean":"2024-09-17T05:46:52.572199+0000","last_became_active":"2024-09-17T05:46:50.555434+0000","last_became_peered":"2024-09-17T05:46:50.555434+0000","last_unstale":"2024-09-17T05:46:52.572199+0000","last_undegraded":"2024-09-17T05:46:52.572199+0000","last_fullsized":"2024-09-17T05:46:52.572199+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:46:49.528019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:46:49.528019+0000","last_clean_scrub_stamp":"2024-09-17T05:46:49.528019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:37:40.854399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.9","version":"0'0","reported_seq":10,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-17T05:46:51.579051+0000","last_change":"2024-09-17T05:46:51.576821+0000","last_active":"2024-09-17T05:46:51.579051+0000","last_peered":"2024-09-17T05:46:51.579051+0000","last_clean":"2024-09-17T05:46:51.579051+0000","last_became_active":"2024-09-17T05:46:51.576334+0000","last_became_peered":"2024-09-17T05:46:51.576334+0000","last_unstale":"2024-09-17T05:46:51.579051+0000","last_undegraded":"2024-09-17T05:46:51.579051+0000","last_fullsized":"2024-09-17T05:46:51.579051+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:46:50.533972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:46:50.533972+0000","last_clean_scrub_stamp":"2024-09-17T05:46:50.533972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:39:07.753207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.8","version":"0'0","reported_seq":15,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-17T05:46:52.574325+0000","last_change":"2024-09-17T05:46:50.554397+0000","last_active":"2024-09-17T05:46:52.574325+0000","last_peered":"2024-09-17T05:46:52.574325+0000","last_clean":"2024-09-17T05:46:52.574325+0000","last_became_active":"2024-09-17T05:46:50.554006+0000","last_became_peered":"2024-09-17T05:46:50.554006+0000","last_unstale":"2024-09-17T05:46:52.574325+0000","last_undegraded":"2024-09-17T05:46:52.574325+0000","last_fullsized":"2024-09-17T05:46:52.574325+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:46:49.528019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:46:49.528019+0000","last_clean_scrub_stamp":"2024-09-17T05:46:49.528019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:20:01.660902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.6","version":"0'0","reported_seq":13,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-17T05:46:52.574697+0000","last_change":"2024-09-17T05:46:51.563526+0000","last_active":"2024-09-17T05:46:52.574697+0000","last_peered":"2024-09-17T05:46:52.574697+0000","last_clean":"2024-09-17T05:46:52.574697+0000","last_became_active":"2024-09-17T05:46:51.562568+0000","last_became_peered":"2024-09-17T05:46:51.562568+0000","last_unstale":"2024-09-17T05:46:52.574697+0000","last_undegraded":"2024-09-17T05:46:52.574697+0000","last_fullsized":"2024-09-17T05:46:52.574697+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:46:50.533972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:46:50.533972+0000","last_clean_scrub_stamp":"2024-09-17T05:46:50.533972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:38:37.039701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.7","version":"71'2","reported_seq":15,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-17T05:46:51.586400+0000","last_change":"2024-09-17T05:46:50.556372+0000","last_active":"2024-09-17T05:46:51.586400+0000","last_peered":"2024-09-17T05:46:51.586400+0000","last_clean":"2024-09-17T05:46:51.586400+0000","last_became_active":"2024-09-17T05:46:50.556058+0000","last_became_peered":"2024-09-17T05:46:50.556058+0000","last_unstale":"2024-09-17T05:46:51.586400+0000","last_undegraded":"2024-09-17T05:46:51.586400+0000","last_fullsized":"2024-09-17T05:46:51.586400+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:46:49.528019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:46:49.528019+0000","last_clean_scrub_stamp":"2024-09-17T05:46:49.528019+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:32:09.112921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.7","version":"0'0","reported_seq":13,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-17T05:46:52.572289+0000","last_change":"2024-09-17T05:46:51.564893+0000","last_active":"2024-09-17T05:46:52.572289+0000","last_peered":"2024-09-17T05:46:52.572289+0000","last_clean":"2024-09-17T05:46:52.572289+0000","last_became_active":"2024-09-17T05:46:51.564548+0000","last_became_peered":"2024-09-17T05:46:51.564548+0000","last_unstale":"2024-09-17T05:46:52.572289+0000","last_undegraded":"2024-09-17T05:46:52.572289+0000","last_fullsized":"2024-09-17T05:46:52.572289+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:46:50.533972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:46:50.533972+0000","last_clean_scrub_stamp":"2024-09-17T05:46:50.533972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:26:50.557199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.6","version":"72'1","reported_seq":16,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-17T05:46:52.572552+0000","last_change":"2024-09-17T05:46:50.544381+0000","last_active":"2024-09-17T05:46:52.572552+0000","last_peered":"2024-09-17T05:46:52.572552+0000","last_clean":"2024-09-17T05:46:52.572552+0000","last_became_active":"2024-09-17T05:46:50.543986+0000","last_became_peered":"2024-09-17T05:46:50.543986+0000","last_unstale":"2024-09-17T05:46:52.572552+0000","last_undegraded":"2024-09-17T05:46:52.572552+0000","last_fullsized":"2024-09-17T05:46:52.572552+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:46:49.528019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:46:49.528019+0000","last_clean_scrub_stamp":"2024-09-17T05:46:49.528019+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:35:16.769924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.4","version":"0'0","reported_seq":13,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-17T05:46:52.866676+0000","last_change":"2024-09-17T05:46:51.577022+0000","last_active":"2024-09-17T05:46:52.866676+0000","last_peered":"2024-09-17T05:46:52.866676+0000","last_clean":"2024-09-17T05:46:52.866676+0000","last_became_active":"2024-09-17T05:46:51.576540+0000","last_became_peered":"2024-09-17T05:46:51.576540+0000","last_unstale":"2024-09-17T05:46:52.866676+0000","last_undegraded":"2024-09-17T05:46:52.866676+0000","last_fullsized":"2024-09-17T05:46:52.866676+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:46:50.533972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:46:50.533972+0000","last_clean_scrub_stamp":"2024-09-17T05:46:50.533972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:38:59.186959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.5","version":"0'0","reported_seq":13,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-17T05:46:51.552653+0000","last_change":"2024-09-17T05:46:50.549973+0000","last_active":"2024-09-17T05:46:51.552653+0000","last_peered":"2024-09-17T05:46:51.552653+0000","last_clean":"2024-09-17T05:46:51.552653+0000","last_became_active":"2024-09-17T05:46:50.549694+0000","last_became_peered":"2024-09-17T05:46:50.549694+0000","last_unstale":"2024-09-17T05:46:51.552653+0000","last_undegraded":"2024-09-17T05:46:51.552653+0000","last_fullsized":"2024-09-17T05:46:51.552653+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:46:49.528019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:46:49.528019+0000","last_clean_scrub_stamp":"2024-09-17T05:46:49.528019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:31:19.308660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.5","version":"0'0","reported_seq":13,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-17T05:46:52.867639+0000","last_change":"2024-09-17T05:46:51.567055+0000","last_active":"2024-09-17T05:46:52.867639+0000","last_peered":"2024-09-17T05:46:52.867639+0000","last_clean":"2024-09-17T05:46:52.867639+0000","last_became_active":"2024-09-17T05:46:51.566737+0000","last_became_peered":"2024-09-17T05:46:51.566737+0000","last_unstale":"2024-09-17T05:46:52.867639+0000","last_undegraded":"2024-09-17T05:46:52.867639+0000","last_fullsized":"2024-09-17T05:46:52.867639+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:46:50.533972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:46:50.533972+0000","last_clean_scrub_stamp":"2024-09-17T05:46:50.533972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:40:35.531124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.4","version":"0'0","reported_seq":15,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-17T05:46:52.574697+0000","last_change":"2024-09-17T05:46:50.547993+0000","last_active":"2024-09-17T05:46:52.574697+0000","last_peered":"2024-09-17T05:46:52.574697+0000","last_clean":"2024-09-17T05:46:52.574697+0000","last_became_active":"2024-09-17T05:46:50.547677+0000","last_became_peered":"2024-09-17T05:46:50.547677+0000","last_unstale":"2024-09-17T05:46:52.574697+0000","last_undegraded":"2024-09-17T05:46:52.574697+0000","last_fullsized":"2024-09-17T05:46:52.574697+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:46:49.528019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:46:49.528019+0000","last_clean_scrub_stamp":"2024-09-17T05:46:49.528019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:26:15.799059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.2","version":"0'0","reported_seq":10,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-17T05:46:51.565532+0000","last_change":"2024-09-17T05:46:51.563537+0000","last_active":"2024-09-17T05:46:51.565532+0000","last_peered":"2024-09-17T05:46:51.565532+0000","last_clean":"2024-09-17T05:46:51.565532+0000","last_became_active":"2024-09-17T05:46:51.563188+0000","last_became_peered":"2024-09-17T05:46:51.563188+0000","last_unstale":"2024-09-17T05:46:51.565532+0000","last_undegraded":"2024-09-17T05:46:51.565532+0000","last_fullsized":"2024-09-17T05:46:51.565532+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:46:50.533972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:46:50.533972+0000","last_clean_scrub_stamp":"2024-09-17T05:46:50.533972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:29:52.002441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.3","version":"0'0","reported_seq":13,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-17T05:46:51.553448+0000","last_change":"2024-09-17T05:46:50.556229+0000","last_active":"2024-09-17T05:46:51.553448+0000","last_peered":"2024-09-17T05:46:51.553448+0000","last_clean":"2024-09-17T05:46:51.553448+0000","last_became_active":"2024-09-17T05:46:50.555876+0000","last_became_peered":"2024-09-17T05:46:50.555876+0000","last_unstale":"2024-09-17T05:46:51.553448+0000","last_undegraded":"2024-09-17T05:46:51.553448+0000","last_fullsized":"2024-09-17T05:46:51.553448+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:46:49.528019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:46:49.528019+0000","last_clean_scrub_stamp":"2024-09-17T05:46:49.528019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:04:36.653508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.3","version":"0'0","reported_seq":10,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-17T05:46:51.576711+0000","last_change":"2024-09-17T05:46:51.575439+0000","last_active":"2024-09-17T05:46:51.576711+0000","last_peered":"2024-09-17T05:46:51.576711+0000","last_clean":"2024-09-17T05:46:51.576711+0000","last_became_active":"2024-09-17T05:46:51.575141+0000","last_became_peered":"2024-09-17T05:46:51.575141+0000","last_unstale":"2024-09-17T05:46:51.576711+0000","last_undegraded":"2024-09-17T05:46:51.576711+0000","last_fullsized":"2024-09-17T05:46:51.576711+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:46:50.533972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:46:50.533972+0000","last_clean_scrub_stamp":"2024-09-17T05:46:50.533972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:57:37.513949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.2","version":"0'0","reported_seq":13,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-17T05:46:51.550642+0000","last_change":"2024-09-17T05:46:50.552938+0000","last_active":"2024-09-17T05:46:51.550642+0000","last_peered":"2024-09-17T05:46:51.550642+0000","last_clean":"2024-09-17T05:46:51.550642+0000","last_became_active":"2024-09-17T05:46:50.552636+0000","last_became_peered":"2024-09-17T05:46:50.552636+0000","last_unstale":"2024-09-17T05:46:51.550642+0000","last_undegraded":"2024-09-17T05:46:51.550642+0000","last_fullsized":"2024-09-17T05:46:51.550642+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:46:49.528019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:46:49.528019+0000","last_clean_scrub_stamp":"2024-09-17T05:46:49.528019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:24:36.778807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.0","version":"0'0","reported_seq":10,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-17T05:46:51.568417+0000","last_change":"2024-09-17T05:46:51.566304+0000","last_active":"2024-09-17T05:46:51.568417+0000","last_peered":"2024-09-17T05:46:51.568417+0000","last_clean":"2024-09-17T05:46:51.568417+0000","last_became_active":"2024-09-17T05:46:51.565283+0000","last_became_peered":"2024-09-17T05:46:51.565283+0000","last_unstale":"2024-09-17T05:46:51.568417+0000","last_undegraded":"2024-09-17T05:46:51.568417+0000","last_fullsized":"2024-09-17T05:46:51.568417+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:46:50.533972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:46:50.533972+0000","last_clean_scrub_stamp":"2024-09-17T05:46:50.533972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:46:16.006152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.1","version":"0'0","reported_seq":15,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-17T05:46:52.554763+0000","last_change":"2024-09-17T05:46:50.552458+0000","last_active":"2024-09-17T05:46:52.554763+0000","last_peered":"2024-09-17T05:46:52.554763+0000","last_clean":"2024-09-17T05:46:52.554763+0000","last_became_active":"2024-09-17T05:46:50.552107+0000","last_became_peered":"2024-09-17T05:46:50.552107+0000","last_unstale":"2024-09-17T05:46:52.554763+0000","last_undegraded":"2024-09-17T05:46:52.554763+0000","last_fullsized":"2024-09-17T05:46:52.554763+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:46:49.528019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:46:49.528019+0000","last_clean_scrub_stamp":"2024-09-17T05:46:49.528019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:53:43.698741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1","version":"0'0","reported_seq":10,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-17T05:46:51.575017+0000","last_change":"2024-09-17T05:46:51.573577+0000","last_active":"2024-09-17T05:46:51.575017+0000","last_peered":"2024-09-17T05:46:51.575017+0000","last_clean":"2024-09-17T05:46:51.575017+0000","last_became_active":"2024-09-17T05:46:51.569489+0000","last_became_peered":"2024-09-17T05:46:51.569489+0000","last_unstale":"2024-09-17T05:46:51.575017+0000","last_undegraded":"2024-09-17T05:46:51.575017+0000","last_fullsized":"2024-09-17T05:46:51.575017+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:46:50.533972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:46:50.533972+0000","last_clean_scrub_stamp":"2024-09-17T05:46:50.533972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:26:30.678628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.0","version":"0'0","reported_seq":13,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-17T05:46:51.567574+0000","last_change":"2024-09-17T05:46:50.558270+0000","last_active":"2024-09-17T05:46:51.567574+0000","last_peered":"2024-09-17T05:46:51.567574+0000","last_clean":"2024-09-17T05:46:51.567574+0000","last_became_active":"2024-09-17T05:46:50.557754+0000","last_became_peered":"2024-09-17T05:46:50.557754+0000","last_unstale":"2024-09-17T05:46:51.567574+0000","last_undegraded":"2024-09-17T05:46:51.567574+0000","last_fullsized":"2024-09-17T05:46:51.567574+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:46:49.528019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:46:49.528019+0000","last_clean_scrub_stamp":"2024-09-17T05:46:49.528019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:05:59.732974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.a","version":"0'0","reported_seq":10,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-17T05:46:51.572200+0000","last_change":"2024-09-17T05:46:51.570833+0000","last_active":"2024-09-17T05:46:51.572200+0000","last_peered":"2024-09-17T05:46:51.572200+0000","last_clean":"2024-09-17T05:46:51.572200+0000","last_became_active":"2024-09-17T05:46:51.570468+0000","last_became_peered":"2024-09-17T05:46:51.570468+0000","last_unstale":"2024-09-17T05:46:51.572200+0000","last_undegraded":"2024-09-17T05:46:51.572200+0000","last_fullsized":"2024-09-17T05:46:51.572200+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:46:50.533972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:46:50.533972+0000","last_clean_scrub_stamp":"2024-09-17T05:46:50.533972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:08:52.597158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.b","version":"71'2","reported_seq":15,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-17T05:46:51.586102+0000","last_change":"2024-09-17T05:46:50.559144+0000","last_active":"2024-09-17T05:46:51.586102+0000","last_peered":"2024-09-17T05:46:51.586102+0000","last_clean":"2024-09-17T05:46:51.586102+0000","last_became_active":"2024-09-17T05:46:50.558856+0000","last_became_peered":"2024-09-17T05:46:50.558856+0000","last_unstale":"2024-09-17T05:46:51.586102+0000","last_undegraded":"2024-09-17T05:46:51.586102+0000","last_fullsized":"2024-09-17T05:46:51.586102+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:46:49.528019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:46:49.528019+0000","last_clean_scrub_stamp":"2024-09-17T05:46:49.528019+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:33:50.200522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"19'72","reported_seq":200,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-17T05:46:52.866220+0000","last_change":"2024-09-17T05:41:48.539830+0000","last_active":"2024-09-17T05:46:52.866220+0000","last_peered":"2024-09-17T05:46:52.866220+0000","last_clean":"2024-09-17T05:46:52.866220+0000","last_became_active":"2024-09-17T05:41:48.538743+0000","last_became_peered":"2024-09-17T05:41:48.538743+0000","last_unstale":"2024-09-17T05:46:52.866220+0000","last_undegraded":"2024-09-17T05:46:52.866220+0000","last_fullsized":"2024-09-17T05:46:52.866220+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:47.152539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:47.152539+0000","last_clean_scrub_stamp":"2024-09-17T05:41:47.152539+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:08:02.952016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":11,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":10,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":16,"seq":68719476802,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":58408,"kb_used_data":844,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94313432,"statfs":{"total":96636764160,"available":96576954368,"internally_reserved":0,"allocated":864256,"data_stored":359618,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":58915270},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":7,"up_from":15,"seq":64424509507,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":58996,"kb_used_data":1436,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94312844,"statfs":{"total":96636764160,"available":96576352256,"internally_reserved":0,"allocated":1470464,"data_stored":956866,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":58915274},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509506,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":58412,"kb_used_data":852,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94313428,"statfs":{"total":96636764160,"available":96576950272,"internally_reserved":0,"allocated":872448,"data_stored":365972,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":58915269},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509506,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":58412,"kb_used_data":852,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94313428,"statfs":{"total":96636764160,"available":96576950272,"internally_reserved":0,"allocated":872448,"data_stored":365952,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":58915269},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509505,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":58408,"kb_used_data":844,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94313432,"statfs":{"total":96636764160,"available":96576954368,"internally_reserved":0,"allocated":864256,"data_stored":359638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":58915271},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509505,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":58408,"kb_used_data":848,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94313432,"statfs":{"total":96636764160,"available":96576954368,"internally_reserved":0,"allocated":868352,"data_stored":361138,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":58915269},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509505,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":58420,"kb_used_data":856,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94313420,"statfs":{"total":96636764160,"available":96576942080,"internally_reserved":0,"allocated":876544,"data_stored":361754,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":58915269},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574913,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":46504,"kb_used_data":1428,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94325336,"statfs":{"total":96636764160,"available":96589144064,"internally_reserved":0,"allocated":1462272,"data_stored":956250,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":46135749},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2228,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-17T05:47:00.034 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-17T05:47:00.161 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:00.160+0000 7f766e686640 1 -- 172.21.15.150:0/3293290712 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f76680cd040 msgr2=0x7f76681528b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:47:00.161 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:00.160+0000 7f766e686640 1 --2- 172.21.15.150:0/3293290712 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f76680cd040 0x7f76681528b0 secure :-1 s=READY pgs=817 cs=0 l=1 rev1=1 crypto rx=0x7f7658005fd0 tx=0x7f765802a5d0 comp rx=0 tx=0).stop 2024-09-17T05:47:00.162 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:00.160+0000 7f766e686640 1 -- 172.21.15.150:0/3293290712 shutdown_connections 2024-09-17T05:47:00.162 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:00.160+0000 7f766e686640 1 --2- 172.21.15.150:0/3293290712 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f766815f330 0x7f766815f740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:47:00.162 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:00.160+0000 7f766e686640 1 --2- 172.21.15.150:0/3293290712 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f76680cd040 0x7f76681528b0 unknown :-1 s=CLOSED pgs=817 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:47:00.162 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:00.160+0000 7f766e686640 1 -- 172.21.15.150:0/3293290712 >> 172.21.15.150:0/3293290712 conn(0x7f76680d0b50 msgr2=0x7f76680d0f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:47:00.162 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:00.160+0000 7f766e686640 1 -- 172.21.15.150:0/3293290712 shutdown_connections 2024-09-17T05:47:00.162 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:00.160+0000 7f766e686640 1 -- 172.21.15.150:0/3293290712 wait complete. 2024-09-17T05:47:00.162 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:00.162+0000 7f766e686640 1 Processor -- start 2024-09-17T05:47:00.163 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:00.162+0000 7f766e686640 1 -- start start 2024-09-17T05:47:00.167 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:00.163+0000 7f766e686640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f76680cd040 0x7f7668155930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:47:00.167 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:00.163+0000 7f766e686640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f766815f330 0x7f766814dc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:47:00.167 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:00.163+0000 7f766e686640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f766815fc80 0x7f76681f6340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:47:00.167 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:00.163+0000 7f766e686640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f766815c450 con 0x7f766815f330 2024-09-17T05:47:00.167 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:00.164+0000 7f766e686640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f76680718f0 con 0x7f76680cd040 2024-09-17T05:47:00.167 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:00.164+0000 7f766e686640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f766815c5d0 con 0x7f766815fc80 2024-09-17T05:47:00.167 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:00.164+0000 7f76677fe640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f766815f330 0x7f766814dc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:47:00.167 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:00.164+0000 7f76677fe640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f766815f330 0x7f766814dc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:59858/0 (socket says 172.21.15.150:59858) 2024-09-17T05:47:00.168 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:00.164+0000 7f76677fe640 1 -- 172.21.15.150:0/1074276755 learned_addr learned my addr 172.21.15.150:0/1074276755 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:47:00.168 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:00.164+0000 7f7667fff640 1 --2- 172.21.15.150:0/1074276755 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f76680cd040 0x7f7668155930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:47:00.168 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:00.164+0000 7f766cc23640 1 --2- 172.21.15.150:0/1074276755 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f766815fc80 0x7f76681f6340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:47:00.168 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:00.164+0000 7f76677fe640 1 -- 172.21.15.150:0/1074276755 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f766815fc80 msgr2=0x7f76681f6340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:47:00.168 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:00.164+0000 7f76677fe640 1 --2- 172.21.15.150:0/1074276755 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f766815fc80 0x7f76681f6340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:47:00.168 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:00.164+0000 7f76677fe640 1 -- 172.21.15.150:0/1074276755 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f76680cd040 msgr2=0x7f7668155930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:47:00.168 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:00.164+0000 7f76677fe640 1 --2- 172.21.15.150:0/1074276755 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f76680cd040 0x7f7668155930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:47:00.168 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:00.164+0000 7f76677fe640 1 -- 172.21.15.150:0/1074276755 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f76681f3d00 con 0x7f766815f330 2024-09-17T05:47:00.168 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:00.164+0000 7f76677fe640 1 --2- 172.21.15.150:0/1074276755 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f766815f330 0x7f766814dc00 secure :-1 s=READY pgs=818 cs=0 l=1 rev1=1 crypto rx=0x7f765c00d6d0 tx=0x7f765c00db90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:47:00.168 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:00.164+0000 7f7664ff9640 1 -- 172.21.15.150:0/1074276755 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f765c017070 con 0x7f766815f330 2024-09-17T05:47:00.168 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:00.164+0000 7f7664ff9640 1 -- 172.21.15.150:0/1074276755 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f765c005330 con 0x7f766815f330 2024-09-17T05:47:00.168 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:00.164+0000 7f766e686640 1 -- 172.21.15.150:0/1074276755 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f76681f2f40 con 0x7f766815f330 2024-09-17T05:47:00.168 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:00.164+0000 7f7664ff9640 1 -- 172.21.15.150:0/1074276755 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f765c009820 con 0x7f766815f330 2024-09-17T05:47:00.169 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:00.164+0000 7f766e686640 1 -- 172.21.15.150:0/1074276755 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f76681f3500 con 0x7f766815f330 2024-09-17T05:47:00.169 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:00.166+0000 7f766e686640 1 -- 172.21.15.150:0/1074276755 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f766815ca80 con 0x7f766815f330 2024-09-17T05:47:00.169 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:00.166+0000 7f7664ff9640 1 -- 172.21.15.150:0/1074276755 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 19) ==== 102563+0+0 (secure 0 0 0) 0x7f765c0099c0 con 0x7f766815f330 2024-09-17T05:47:00.169 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:00.167+0000 7f7664ff9640 1 --2- 172.21.15.150:0/1074276755 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f76540797f0 0x7f765407bd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:47:00.169 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:00.167+0000 7f7664ff9640 1 -- 172.21.15.150:0/1074276755 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 5765+0+0 (secure 0 0 0) 0x7f765c099990 con 0x7f766815f330 2024-09-17T05:47:00.170 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:00.167+0000 7f7667fff640 1 --2- 172.21.15.150:0/1074276755 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f76540797f0 0x7f765407bd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:47:00.170 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:00.168+0000 7f7667fff640 1 --2- 172.21.15.150:0/1074276755 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f76540797f0 0x7f765407bd00 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f7658033000 tx=0x7f7658004730 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:47:00.172 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:00.171+0000 7f7664ff9640 1 -- 172.21.15.150:0/1074276755 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f765c062fc0 con 0x7f766815f330 2024-09-17T05:47:00.343 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:00.342+0000 7f766e686640 1 -- 172.21.15.150:0/1074276755 --> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f7668155460 con 0x7f76540797f0 2024-09-17T05:47:00.348 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:00.347+0000 7f7664ff9640 1 -- 172.21.15.150:0/1074276755 <== mgr.4108 v2:172.21.15.176:6800/3631216395 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+252006 (secure 0 0 0) 0x7f7668155460 con 0x7f76540797f0 2024-09-17T05:47:00.351 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-09-17T05:47:00.353 INFO:teuthology.orchestra.run.smithi150.stderr:dumped all 2024-09-17T05:47:00.354 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:00.350+0000 7f766e686640 1 -- 172.21.15.150:0/1074276755 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f76540797f0 msgr2=0x7f765407bd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:47:00.354 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:00.350+0000 7f766e686640 1 --2- 172.21.15.150:0/1074276755 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f76540797f0 0x7f765407bd00 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f7658033000 tx=0x7f7658004730 comp rx=0 tx=0).stop 2024-09-17T05:47:00.354 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:00.350+0000 7f766e686640 1 -- 172.21.15.150:0/1074276755 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f766815f330 msgr2=0x7f766814dc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:47:00.354 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:00.350+0000 7f766e686640 1 --2- 172.21.15.150:0/1074276755 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f766815f330 0x7f766814dc00 secure :-1 s=READY pgs=818 cs=0 l=1 rev1=1 crypto rx=0x7f765c00d6d0 tx=0x7f765c00db90 comp rx=0 tx=0).stop 2024-09-17T05:47:00.355 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:00.350+0000 7f766e686640 1 -- 172.21.15.150:0/1074276755 shutdown_connections 2024-09-17T05:47:00.355 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:00.350+0000 7f766e686640 1 --2- 172.21.15.150:0/1074276755 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f76540797f0 0x7f765407bd00 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:47:00.355 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:00.350+0000 7f766e686640 1 --2- 172.21.15.150:0/1074276755 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f766815fc80 0x7f76681f6340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:47:00.355 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:00.350+0000 7f766e686640 1 --2- 172.21.15.150:0/1074276755 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f766815f330 0x7f766814dc00 unknown :-1 s=CLOSED pgs=818 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:47:00.355 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:00.350+0000 7f766e686640 1 --2- 172.21.15.150:0/1074276755 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f76680cd040 0x7f7668155930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:47:00.355 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:00.350+0000 7f766e686640 1 -- 172.21.15.150:0/1074276755 >> 172.21.15.150:0/1074276755 conn(0x7f76680d0b50 msgr2=0x7f7668068e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:47:00.355 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:00.351+0000 7f766e686640 1 -- 172.21.15.150:0/1074276755 shutdown_connections 2024-09-17T05:47:00.355 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:00.351+0000 7f766e686640 1 -- 172.21.15.150:0/1074276755 wait complete. 2024-09-17T05:47:00.363 INFO:teuthology.orchestra.run.smithi150.stdout:{"pg_ready":true,"pg_map":{"version":223,"stamp":"2024-09-17T05:46:58.932390+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":146,"num_write_kb":1642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":111,"ondisk_log_size":111,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":181,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":455996,"kb_used_data":8008,"kb_used_omap":12,"kb_used_meta":447795,"kb_avail":754518724,"statfs":{"total":773094113280,"available":772627173376,"internally_reserved":0,"allocated":8200192,"data_stored":4112612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":458542640},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.002105"},"pg_stats":[{"pgid":"11.3f","version":"0'0","reported_seq":13,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-17T05:46:52.866778+0000","last_change":"2024-09-17T05:46:51.567034+0000","last_active":"2024-09-17T05:46:52.866778+0000","last_peered":"2024-09-17T05:46:52.866778+0000","last_clean":"2024-09-17T05:46:52.866778+0000","last_became_active":"2024-09-17T05:46:51.566233+0000","last_became_peered":"2024-09-17T05:46:51.566233+0000","last_unstale":"2024-09-17T05:46:52.866778+0000","last_undegraded":"2024-09-17T05:46:52.866778+0000","last_fullsized":"2024-09-17T05:46:52.866778+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:46:50.533972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:46:50.533972+0000","last_clean_scrub_stamp":"2024-09-17T05:46:50.533972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:08:34.270358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.3e","version":"0'0","reported_seq":13,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-17T05:46:52.867627+0000","last_change":"2024-09-17T05:46:51.574207+0000","last_active":"2024-09-17T05:46:52.867627+0000","last_peered":"2024-09-17T05:46:52.867627+0000","last_clean":"2024-09-17T05:46:52.867627+0000","last_became_active":"2024-09-17T05:46:51.573715+0000","last_became_peered":"2024-09-17T05:46:51.573715+0000","last_unstale":"2024-09-17T05:46:52.867627+0000","last_undegraded":"2024-09-17T05:46:52.867627+0000","last_fullsized":"2024-09-17T05:46:52.867627+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:46:50.533972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:46:50.533972+0000","last_clean_scrub_stamp":"2024-09-17T05:46:50.533972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:18:51.154897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.3d","version":"0'0","reported_seq":13,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-17T05:46:52.813777+0000","last_change":"2024-09-17T05:46:51.562710+0000","last_active":"2024-09-17T05:46:52.813777+0000","last_peered":"2024-09-17T05:46:52.813777+0000","last_clean":"2024-09-17T05:46:52.813777+0000","last_became_active":"2024-09-17T05:46:51.562411+0000","last_became_peered":"2024-09-17T05:46:51.562411+0000","last_unstale":"2024-09-17T05:46:52.813777+0000","last_undegraded":"2024-09-17T05:46:52.813777+0000","last_fullsized":"2024-09-17T05:46:52.813777+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:46:50.533972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:46:50.533972+0000","last_clean_scrub_stamp":"2024-09-17T05:46:50.533972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:37:28.240547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.3c","version":"0'0","reported_seq":13,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-17T05:46:52.556591+0000","last_change":"2024-09-17T05:46:51.578009+0000","last_active":"2024-09-17T05:46:52.556591+0000","last_peered":"2024-09-17T05:46:52.556591+0000","last_clean":"2024-09-17T05:46:52.556591+0000","last_became_active":"2024-09-17T05:46:51.577250+0000","last_became_peered":"2024-09-17T05:46:51.577250+0000","last_unstale":"2024-09-17T05:46:52.556591+0000","last_undegraded":"2024-09-17T05:46:52.556591+0000","last_fullsized":"2024-09-17T05:46:52.556591+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:46:50.533972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:46:50.533972+0000","last_clean_scrub_stamp":"2024-09-17T05:46:50.533972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:38:06.460377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.3b","version":"0'0","reported_seq":13,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-17T05:46:52.555650+0000","last_change":"2024-09-17T05:46:51.568927+0000","last_active":"2024-09-17T05:46:52.555650+0000","last_peered":"2024-09-17T05:46:52.555650+0000","last_clean":"2024-09-17T05:46:52.555650+0000","last_became_active":"2024-09-17T05:46:51.568639+0000","last_became_peered":"2024-09-17T05:46:51.568639+0000","last_unstale":"2024-09-17T05:46:52.555650+0000","last_undegraded":"2024-09-17T05:46:52.555650+0000","last_fullsized":"2024-09-17T05:46:52.555650+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:46:50.533972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:46:50.533972+0000","last_clean_scrub_stamp":"2024-09-17T05:46:50.533972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:15:23.869814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.3a","version":"0'0","reported_seq":13,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-17T05:46:52.867964+0000","last_change":"2024-09-17T05:46:51.578128+0000","last_active":"2024-09-17T05:46:52.867964+0000","last_peered":"2024-09-17T05:46:52.867964+0000","last_clean":"2024-09-17T05:46:52.867964+0000","last_became_active":"2024-09-17T05:46:51.577539+0000","last_became_peered":"2024-09-17T05:46:51.577539+0000","last_unstale":"2024-09-17T05:46:52.867964+0000","last_undegraded":"2024-09-17T05:46:52.867964+0000","last_fullsized":"2024-09-17T05:46:52.867964+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:46:50.533972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:46:50.533972+0000","last_clean_scrub_stamp":"2024-09-17T05:46:50.533972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:12:24.058849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.39","version":"0'0","reported_seq":13,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-17T05:46:52.571912+0000","last_change":"2024-09-17T05:46:51.562524+0000","last_active":"2024-09-17T05:46:52.571912+0000","last_peered":"2024-09-17T05:46:52.571912+0000","last_clean":"2024-09-17T05:46:52.571912+0000","last_became_active":"2024-09-17T05:46:51.562182+0000","last_became_peered":"2024-09-17T05:46:51.562182+0000","last_unstale":"2024-09-17T05:46:52.571912+0000","last_undegraded":"2024-09-17T05:46:52.571912+0000","last_fullsized":"2024-09-17T05:46:52.571912+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:46:50.533972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:46:50.533972+0000","last_clean_scrub_stamp":"2024-09-17T05:46:50.533972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:59:05.231923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.38","version":"0'0","reported_seq":13,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-17T05:46:52.867309+0000","last_change":"2024-09-17T05:46:51.578199+0000","last_active":"2024-09-17T05:46:52.867309+0000","last_peered":"2024-09-17T05:46:52.867309+0000","last_clean":"2024-09-17T05:46:52.867309+0000","last_became_active":"2024-09-17T05:46:51.576847+0000","last_became_peered":"2024-09-17T05:46:51.576847+0000","last_unstale":"2024-09-17T05:46:52.867309+0000","last_undegraded":"2024-09-17T05:46:52.867309+0000","last_fullsized":"2024-09-17T05:46:52.867309+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:46:50.533972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:46:50.533972+0000","last_clean_scrub_stamp":"2024-09-17T05:46:50.533972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:56:49.068236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.37","version":"0'0","reported_seq":13,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-17T05:46:52.555980+0000","last_change":"2024-09-17T05:46:51.563153+0000","last_active":"2024-09-17T05:46:52.555980+0000","last_peered":"2024-09-17T05:46:52.555980+0000","last_clean":"2024-09-17T05:46:52.555980+0000","last_became_active":"2024-09-17T05:46:51.562497+0000","last_became_peered":"2024-09-17T05:46:51.562497+0000","last_unstale":"2024-09-17T05:46:52.555980+0000","last_undegraded":"2024-09-17T05:46:52.555980+0000","last_fullsized":"2024-09-17T05:46:52.555980+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:46:50.533972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:46:50.533972+0000","last_clean_scrub_stamp":"2024-09-17T05:46:50.533972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:43:49.272053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.36","version":"0'0","reported_seq":13,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-17T05:46:52.555484+0000","last_change":"2024-09-17T05:46:51.570143+0000","last_active":"2024-09-17T05:46:52.555484+0000","last_peered":"2024-09-17T05:46:52.555484+0000","last_clean":"2024-09-17T05:46:52.555484+0000","last_became_active":"2024-09-17T05:46:51.569479+0000","last_became_peered":"2024-09-17T05:46:51.569479+0000","last_unstale":"2024-09-17T05:46:52.555484+0000","last_undegraded":"2024-09-17T05:46:52.555484+0000","last_fullsized":"2024-09-17T05:46:52.555484+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:46:50.533972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:46:50.533972+0000","last_clean_scrub_stamp":"2024-09-17T05:46:50.533972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:57:51.972604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.35","version":"0'0","reported_seq":13,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-17T05:46:52.867376+0000","last_change":"2024-09-17T05:46:51.563682+0000","last_active":"2024-09-17T05:46:52.867376+0000","last_peered":"2024-09-17T05:46:52.867376+0000","last_clean":"2024-09-17T05:46:52.867376+0000","last_became_active":"2024-09-17T05:46:51.562694+0000","last_became_peered":"2024-09-17T05:46:51.562694+0000","last_unstale":"2024-09-17T05:46:52.867376+0000","last_undegraded":"2024-09-17T05:46:52.867376+0000","last_fullsized":"2024-09-17T05:46:52.867376+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:46:50.533972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:46:50.533972+0000","last_clean_scrub_stamp":"2024-09-17T05:46:50.533972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:15:36.113980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.34","version":"0'0","reported_seq":13,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-17T05:46:52.556829+0000","last_change":"2024-09-17T05:46:51.556088+0000","last_active":"2024-09-17T05:46:52.556829+0000","last_peered":"2024-09-17T05:46:52.556829+0000","last_clean":"2024-09-17T05:46:52.556829+0000","last_became_active":"2024-09-17T05:46:51.555380+0000","last_became_peered":"2024-09-17T05:46:51.555380+0000","last_unstale":"2024-09-17T05:46:52.556829+0000","last_undegraded":"2024-09-17T05:46:52.556829+0000","last_fullsized":"2024-09-17T05:46:52.556829+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:46:50.533972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:46:50.533972+0000","last_clean_scrub_stamp":"2024-09-17T05:46:50.533972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:14:51.520543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.33","version":"0'0","reported_seq":13,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-17T05:46:52.574767+0000","last_change":"2024-09-17T05:46:51.570802+0000","last_active":"2024-09-17T05:46:52.574767+0000","last_peered":"2024-09-17T05:46:52.574767+0000","last_clean":"2024-09-17T05:46:52.574767+0000","last_became_active":"2024-09-17T05:46:51.570412+0000","last_became_peered":"2024-09-17T05:46:51.570412+0000","last_unstale":"2024-09-17T05:46:52.574767+0000","last_undegraded":"2024-09-17T05:46:52.574767+0000","last_fullsized":"2024-09-17T05:46:52.574767+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:46:50.533972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:46:50.533972+0000","last_clean_scrub_stamp":"2024-09-17T05:46:50.533972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:31:15.619388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.32","version":"0'0","reported_seq":13,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-17T05:46:52.556423+0000","last_change":"2024-09-17T05:46:51.565282+0000","last_active":"2024-09-17T05:46:52.556423+0000","last_peered":"2024-09-17T05:46:52.556423+0000","last_clean":"2024-09-17T05:46:52.556423+0000","last_became_active":"2024-09-17T05:46:51.564899+0000","last_became_peered":"2024-09-17T05:46:51.564899+0000","last_unstale":"2024-09-17T05:46:52.556423+0000","last_undegraded":"2024-09-17T05:46:52.556423+0000","last_fullsized":"2024-09-17T05:46:52.556423+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:46:50.533972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:46:50.533972+0000","last_clean_scrub_stamp":"2024-09-17T05:46:50.533972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:33:30.217453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.31","version":"0'0","reported_seq":13,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-17T05:46:52.574510+0000","last_change":"2024-09-17T05:46:51.561117+0000","last_active":"2024-09-17T05:46:52.574510+0000","last_peered":"2024-09-17T05:46:52.574510+0000","last_clean":"2024-09-17T05:46:52.574510+0000","last_became_active":"2024-09-17T05:46:51.560823+0000","last_became_peered":"2024-09-17T05:46:51.560823+0000","last_unstale":"2024-09-17T05:46:52.574510+0000","last_undegraded":"2024-09-17T05:46:52.574510+0000","last_fullsized":"2024-09-17T05:46:52.574510+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:46:50.533972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:46:50.533972+0000","last_clean_scrub_stamp":"2024-09-17T05:46:50.533972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:47:50.985506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.30","version":"0'0","reported_seq":13,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-17T05:46:52.554955+0000","last_change":"2024-09-17T05:46:51.581980+0000","last_active":"2024-09-17T05:46:52.554955+0000","last_peered":"2024-09-17T05:46:52.554955+0000","last_clean":"2024-09-17T05:46:52.554955+0000","last_became_active":"2024-09-17T05:46:51.580838+0000","last_became_peered":"2024-09-17T05:46:51.580838+0000","last_unstale":"2024-09-17T05:46:52.554955+0000","last_undegraded":"2024-09-17T05:46:52.554955+0000","last_fullsized":"2024-09-17T05:46:52.554955+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:46:50.533972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:46:50.533972+0000","last_clean_scrub_stamp":"2024-09-17T05:46:50.533972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:39:55.633112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.2f","version":"0'0","reported_seq":13,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-17T05:46:52.556080+0000","last_change":"2024-09-17T05:46:51.563745+0000","last_active":"2024-09-17T05:46:52.556080+0000","last_peered":"2024-09-17T05:46:52.556080+0000","last_clean":"2024-09-17T05:46:52.556080+0000","last_became_active":"2024-09-17T05:46:51.562341+0000","last_became_peered":"2024-09-17T05:46:51.562341+0000","last_unstale":"2024-09-17T05:46:52.556080+0000","last_undegraded":"2024-09-17T05:46:52.556080+0000","last_fullsized":"2024-09-17T05:46:52.556080+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:46:50.533972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:46:50.533972+0000","last_clean_scrub_stamp":"2024-09-17T05:46:50.533972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:56:25.909345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.2e","version":"0'0","reported_seq":13,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-17T05:46:52.556764+0000","last_change":"2024-09-17T05:46:51.575409+0000","last_active":"2024-09-17T05:46:52.556764+0000","last_peered":"2024-09-17T05:46:52.556764+0000","last_clean":"2024-09-17T05:46:52.556764+0000","last_became_active":"2024-09-17T05:46:51.575064+0000","last_became_peered":"2024-09-17T05:46:51.575064+0000","last_unstale":"2024-09-17T05:46:52.556764+0000","last_undegraded":"2024-09-17T05:46:52.556764+0000","last_fullsized":"2024-09-17T05:46:52.556764+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:46:50.533972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:46:50.533972+0000","last_clean_scrub_stamp":"2024-09-17T05:46:50.533972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:08:50.976726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.2d","version":"0'0","reported_seq":13,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-17T05:46:52.866682+0000","last_change":"2024-09-17T05:46:51.578864+0000","last_active":"2024-09-17T05:46:52.866682+0000","last_peered":"2024-09-17T05:46:52.866682+0000","last_clean":"2024-09-17T05:46:52.866682+0000","last_became_active":"2024-09-17T05:46:51.578508+0000","last_became_peered":"2024-09-17T05:46:51.578508+0000","last_unstale":"2024-09-17T05:46:52.866682+0000","last_undegraded":"2024-09-17T05:46:52.866682+0000","last_fullsized":"2024-09-17T05:46:52.866682+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:46:50.533972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:46:50.533972+0000","last_clean_scrub_stamp":"2024-09-17T05:46:50.533972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:08:45.211497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.2c","version":"0'0","reported_seq":13,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-17T05:46:52.574643+0000","last_change":"2024-09-17T05:46:51.564642+0000","last_active":"2024-09-17T05:46:52.574643+0000","last_peered":"2024-09-17T05:46:52.574643+0000","last_clean":"2024-09-17T05:46:52.574643+0000","last_became_active":"2024-09-17T05:46:51.564341+0000","last_became_peered":"2024-09-17T05:46:51.564341+0000","last_unstale":"2024-09-17T05:46:52.574643+0000","last_undegraded":"2024-09-17T05:46:52.574643+0000","last_fullsized":"2024-09-17T05:46:52.574643+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:46:50.533972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:46:50.533972+0000","last_clean_scrub_stamp":"2024-09-17T05:46:50.533972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:32:36.148692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.2b","version":"0'0","reported_seq":13,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-17T05:46:52.555065+0000","last_change":"2024-09-17T05:46:51.563753+0000","last_active":"2024-09-17T05:46:52.555065+0000","last_peered":"2024-09-17T05:46:52.555065+0000","last_clean":"2024-09-17T05:46:52.555065+0000","last_became_active":"2024-09-17T05:46:51.563438+0000","last_became_peered":"2024-09-17T05:46:51.563438+0000","last_unstale":"2024-09-17T05:46:52.555065+0000","last_undegraded":"2024-09-17T05:46:52.555065+0000","last_fullsized":"2024-09-17T05:46:52.555065+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:46:50.533972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:46:50.533972+0000","last_clean_scrub_stamp":"2024-09-17T05:46:50.533972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:39:57.587613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.2a","version":"0'0","reported_seq":13,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-17T05:46:52.555039+0000","last_change":"2024-09-17T05:46:51.568497+0000","last_active":"2024-09-17T05:46:52.555039+0000","last_peered":"2024-09-17T05:46:52.555039+0000","last_clean":"2024-09-17T05:46:52.555039+0000","last_became_active":"2024-09-17T05:46:51.568180+0000","last_became_peered":"2024-09-17T05:46:51.568180+0000","last_unstale":"2024-09-17T05:46:52.555039+0000","last_undegraded":"2024-09-17T05:46:52.555039+0000","last_fullsized":"2024-09-17T05:46:52.555039+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:46:50.533972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:46:50.533972+0000","last_clean_scrub_stamp":"2024-09-17T05:46:50.533972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:19:56.656681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.29","version":"0'0","reported_seq":13,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-17T05:46:52.866541+0000","last_change":"2024-09-17T05:46:51.564064+0000","last_active":"2024-09-17T05:46:52.866541+0000","last_peered":"2024-09-17T05:46:52.866541+0000","last_clean":"2024-09-17T05:46:52.866541+0000","last_became_active":"2024-09-17T05:46:51.563708+0000","last_became_peered":"2024-09-17T05:46:51.563708+0000","last_unstale":"2024-09-17T05:46:52.866541+0000","last_undegraded":"2024-09-17T05:46:52.866541+0000","last_fullsized":"2024-09-17T05:46:52.866541+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:46:50.533972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:46:50.533972+0000","last_clean_scrub_stamp":"2024-09-17T05:46:50.533972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:57:55.991216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.28","version":"0'0","reported_seq":13,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-17T05:46:52.866244+0000","last_change":"2024-09-17T05:46:51.581502+0000","last_active":"2024-09-17T05:46:52.866244+0000","last_peered":"2024-09-17T05:46:52.866244+0000","last_clean":"2024-09-17T05:46:52.866244+0000","last_became_active":"2024-09-17T05:46:51.580574+0000","last_became_peered":"2024-09-17T05:46:51.580574+0000","last_unstale":"2024-09-17T05:46:52.866244+0000","last_undegraded":"2024-09-17T05:46:52.866244+0000","last_fullsized":"2024-09-17T05:46:52.866244+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:46:50.533972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:46:50.533972+0000","last_clean_scrub_stamp":"2024-09-17T05:46:50.533972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:46:03.571664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.27","version":"0'0","reported_seq":13,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-17T05:46:52.555631+0000","last_change":"2024-09-17T05:46:51.573130+0000","last_active":"2024-09-17T05:46:52.555631+0000","last_peered":"2024-09-17T05:46:52.555631+0000","last_clean":"2024-09-17T05:46:52.555631+0000","last_became_active":"2024-09-17T05:46:51.572210+0000","last_became_peered":"2024-09-17T05:46:51.572210+0000","last_unstale":"2024-09-17T05:46:52.555631+0000","last_undegraded":"2024-09-17T05:46:52.555631+0000","last_fullsized":"2024-09-17T05:46:52.555631+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:46:50.533972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:46:50.533972+0000","last_clean_scrub_stamp":"2024-09-17T05:46:50.533972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:59:58.114229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.26","version":"0'0","reported_seq":13,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-17T05:46:52.572277+0000","last_change":"2024-09-17T05:46:51.575585+0000","last_active":"2024-09-17T05:46:52.572277+0000","last_peered":"2024-09-17T05:46:52.572277+0000","last_clean":"2024-09-17T05:46:52.572277+0000","last_became_active":"2024-09-17T05:46:51.575272+0000","last_became_peered":"2024-09-17T05:46:51.575272+0000","last_unstale":"2024-09-17T05:46:52.572277+0000","last_undegraded":"2024-09-17T05:46:52.572277+0000","last_fullsized":"2024-09-17T05:46:52.572277+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:46:50.533972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:46:50.533972+0000","last_clean_scrub_stamp":"2024-09-17T05:46:50.533972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:06:36.217986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.25","version":"0'0","reported_seq":13,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-17T05:46:52.813659+0000","last_change":"2024-09-17T05:46:51.566344+0000","last_active":"2024-09-17T05:46:52.813659+0000","last_peered":"2024-09-17T05:46:52.813659+0000","last_clean":"2024-09-17T05:46:52.813659+0000","last_became_active":"2024-09-17T05:46:51.564652+0000","last_became_peered":"2024-09-17T05:46:51.564652+0000","last_unstale":"2024-09-17T05:46:52.813659+0000","last_undegraded":"2024-09-17T05:46:52.813659+0000","last_fullsized":"2024-09-17T05:46:52.813659+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:46:50.533972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:46:50.533972+0000","last_clean_scrub_stamp":"2024-09-17T05:46:50.533972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:48:31.807973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.24","version":"0'0","reported_seq":13,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-17T05:46:52.555323+0000","last_change":"2024-09-17T05:46:51.568790+0000","last_active":"2024-09-17T05:46:52.555323+0000","last_peered":"2024-09-17T05:46:52.555323+0000","last_clean":"2024-09-17T05:46:52.555323+0000","last_became_active":"2024-09-17T05:46:51.568328+0000","last_became_peered":"2024-09-17T05:46:51.568328+0000","last_unstale":"2024-09-17T05:46:52.555323+0000","last_undegraded":"2024-09-17T05:46:52.555323+0000","last_fullsized":"2024-09-17T05:46:52.555323+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:46:50.533972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:46:50.533972+0000","last_clean_scrub_stamp":"2024-09-17T05:46:50.533972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:37:41.860352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.23","version":"0'0","reported_seq":13,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-17T05:46:52.813471+0000","last_change":"2024-09-17T05:46:51.564915+0000","last_active":"2024-09-17T05:46:52.813471+0000","last_peered":"2024-09-17T05:46:52.813471+0000","last_clean":"2024-09-17T05:46:52.813471+0000","last_became_active":"2024-09-17T05:46:51.564611+0000","last_became_peered":"2024-09-17T05:46:51.564611+0000","last_unstale":"2024-09-17T05:46:52.813471+0000","last_undegraded":"2024-09-17T05:46:52.813471+0000","last_fullsized":"2024-09-17T05:46:52.813471+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:46:50.533972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:46:50.533972+0000","last_clean_scrub_stamp":"2024-09-17T05:46:50.533972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:13:12.410248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.22","version":"0'0","reported_seq":13,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-17T05:46:52.572040+0000","last_change":"2024-09-17T05:46:51.576081+0000","last_active":"2024-09-17T05:46:52.572040+0000","last_peered":"2024-09-17T05:46:52.572040+0000","last_clean":"2024-09-17T05:46:52.572040+0000","last_became_active":"2024-09-17T05:46:51.575249+0000","last_became_peered":"2024-09-17T05:46:51.575249+0000","last_unstale":"2024-09-17T05:46:52.572040+0000","last_undegraded":"2024-09-17T05:46:52.572040+0000","last_fullsized":"2024-09-17T05:46:52.572040+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:46:50.533972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:46:50.533972+0000","last_clean_scrub_stamp":"2024-09-17T05:46:50.533972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:06:57.020798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.21","version":"0'0","reported_seq":13,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-17T05:46:52.572230+0000","last_change":"2024-09-17T05:46:51.566511+0000","last_active":"2024-09-17T05:46:52.572230+0000","last_peered":"2024-09-17T05:46:52.572230+0000","last_clean":"2024-09-17T05:46:52.572230+0000","last_became_active":"2024-09-17T05:46:51.566168+0000","last_became_peered":"2024-09-17T05:46:51.566168+0000","last_unstale":"2024-09-17T05:46:52.572230+0000","last_undegraded":"2024-09-17T05:46:52.572230+0000","last_fullsized":"2024-09-17T05:46:52.572230+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:46:50.533972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:46:50.533972+0000","last_clean_scrub_stamp":"2024-09-17T05:46:50.533972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:53:47.928972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.20","version":"0'0","reported_seq":13,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-17T05:46:52.867565+0000","last_change":"2024-09-17T05:46:51.577607+0000","last_active":"2024-09-17T05:46:52.867565+0000","last_peered":"2024-09-17T05:46:52.867565+0000","last_clean":"2024-09-17T05:46:52.867565+0000","last_became_active":"2024-09-17T05:46:51.576279+0000","last_became_peered":"2024-09-17T05:46:51.576279+0000","last_unstale":"2024-09-17T05:46:52.867565+0000","last_undegraded":"2024-09-17T05:46:52.867565+0000","last_fullsized":"2024-09-17T05:46:52.867565+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:46:50.533972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:46:50.533972+0000","last_clean_scrub_stamp":"2024-09-17T05:46:50.533972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:56:29.109148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.1e","version":"0'0","reported_seq":13,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-17T05:46:52.866783+0000","last_change":"2024-09-17T05:46:51.575936+0000","last_active":"2024-09-17T05:46:52.866783+0000","last_peered":"2024-09-17T05:46:52.866783+0000","last_clean":"2024-09-17T05:46:52.866783+0000","last_became_active":"2024-09-17T05:46:51.575628+0000","last_became_peered":"2024-09-17T05:46:51.575628+0000","last_unstale":"2024-09-17T05:46:52.866783+0000","last_undegraded":"2024-09-17T05:46:52.866783+0000","last_fullsized":"2024-09-17T05:46:52.866783+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:46:50.533972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:46:50.533972+0000","last_clean_scrub_stamp":"2024-09-17T05:46:50.533972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:49:57.789658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1f","version":"71'4","reported_seq":19,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-17T05:46:52.867558+0000","last_change":"2024-09-17T05:46:50.558694+0000","last_active":"2024-09-17T05:46:52.867558+0000","last_peered":"2024-09-17T05:46:52.867558+0000","last_clean":"2024-09-17T05:46:52.867558+0000","last_became_active":"2024-09-17T05:46:50.557228+0000","last_became_peered":"2024-09-17T05:46:50.557228+0000","last_unstale":"2024-09-17T05:46:52.867558+0000","last_undegraded":"2024-09-17T05:46:52.867558+0000","last_fullsized":"2024-09-17T05:46:52.867558+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:46:49.528019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:46:49.528019+0000","last_clean_scrub_stamp":"2024-09-17T05:46:49.528019+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:59:04.225971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.1f","version":"0'0","reported_seq":13,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-17T05:46:52.556292+0000","last_change":"2024-09-17T05:46:51.562813+0000","last_active":"2024-09-17T05:46:52.556292+0000","last_peered":"2024-09-17T05:46:52.556292+0000","last_clean":"2024-09-17T05:46:52.556292+0000","last_became_active":"2024-09-17T05:46:51.562079+0000","last_became_peered":"2024-09-17T05:46:51.562079+0000","last_unstale":"2024-09-17T05:46:52.556292+0000","last_undegraded":"2024-09-17T05:46:52.556292+0000","last_fullsized":"2024-09-17T05:46:52.556292+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:46:50.533972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:46:50.533972+0000","last_clean_scrub_stamp":"2024-09-17T05:46:50.533972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:15:01.213750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.1e","version":"71'1","reported_seq":16,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-17T05:46:52.574660+0000","last_change":"2024-09-17T05:46:50.552744+0000","last_active":"2024-09-17T05:46:52.574660+0000","last_peered":"2024-09-17T05:46:52.574660+0000","last_clean":"2024-09-17T05:46:52.574660+0000","last_became_active":"2024-09-17T05:46:50.551757+0000","last_became_peered":"2024-09-17T05:46:50.551757+0000","last_unstale":"2024-09-17T05:46:52.574660+0000","last_undegraded":"2024-09-17T05:46:52.574660+0000","last_fullsized":"2024-09-17T05:46:52.574660+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:46:49.528019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:46:49.528019+0000","last_clean_scrub_stamp":"2024-09-17T05:46:49.528019+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:10:23.845161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1c","version":"0'0","reported_seq":13,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-17T05:46:52.867110+0000","last_change":"2024-09-17T05:46:51.581452+0000","last_active":"2024-09-17T05:46:52.867110+0000","last_peered":"2024-09-17T05:46:52.867110+0000","last_clean":"2024-09-17T05:46:52.867110+0000","last_became_active":"2024-09-17T05:46:51.581056+0000","last_became_peered":"2024-09-17T05:46:51.581056+0000","last_unstale":"2024-09-17T05:46:52.867110+0000","last_undegraded":"2024-09-17T05:46:52.867110+0000","last_fullsized":"2024-09-17T05:46:52.867110+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:46:50.533972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:46:50.533972+0000","last_clean_scrub_stamp":"2024-09-17T05:46:50.533972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:07:48.769165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.1d","version":"71'2","reported_seq":17,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-17T05:46:52.555133+0000","last_change":"2024-09-17T05:46:50.558321+0000","last_active":"2024-09-17T05:46:52.555133+0000","last_peered":"2024-09-17T05:46:52.555133+0000","last_clean":"2024-09-17T05:46:52.555133+0000","last_became_active":"2024-09-17T05:46:50.557997+0000","last_became_peered":"2024-09-17T05:46:50.557997+0000","last_unstale":"2024-09-17T05:46:52.555133+0000","last_undegraded":"2024-09-17T05:46:52.555133+0000","last_fullsized":"2024-09-17T05:46:52.555133+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:46:49.528019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:46:49.528019+0000","last_clean_scrub_stamp":"2024-09-17T05:46:49.528019+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:14:18.759730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1d","version":"0'0","reported_seq":13,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-17T05:46:52.867404+0000","last_change":"2024-09-17T05:46:51.563338+0000","last_active":"2024-09-17T05:46:52.867404+0000","last_peered":"2024-09-17T05:46:52.867404+0000","last_clean":"2024-09-17T05:46:52.867404+0000","last_became_active":"2024-09-17T05:46:51.562937+0000","last_became_peered":"2024-09-17T05:46:51.562937+0000","last_unstale":"2024-09-17T05:46:52.867404+0000","last_undegraded":"2024-09-17T05:46:52.867404+0000","last_fullsized":"2024-09-17T05:46:52.867404+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:46:50.533972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:46:50.533972+0000","last_clean_scrub_stamp":"2024-09-17T05:46:50.533972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:36:59.027650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1c","version":"71'2","reported_seq":17,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-17T05:46:52.867516+0000","last_change":"2024-09-17T05:46:50.555340+0000","last_active":"2024-09-17T05:46:52.867516+0000","last_peered":"2024-09-17T05:46:52.867516+0000","last_clean":"2024-09-17T05:46:52.867516+0000","last_became_active":"2024-09-17T05:46:50.554957+0000","last_became_peered":"2024-09-17T05:46:50.554957+0000","last_unstale":"2024-09-17T05:46:52.867516+0000","last_undegraded":"2024-09-17T05:46:52.867516+0000","last_fullsized":"2024-09-17T05:46:52.867516+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:46:49.528019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:46:49.528019+0000","last_clean_scrub_stamp":"2024-09-17T05:46:49.528019+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:39:19.804580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.1a","version":"0'0","reported_seq":13,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-17T05:46:52.572126+0000","last_change":"2024-09-17T05:46:51.571241+0000","last_active":"2024-09-17T05:46:52.572126+0000","last_peered":"2024-09-17T05:46:52.572126+0000","last_clean":"2024-09-17T05:46:52.572126+0000","last_became_active":"2024-09-17T05:46:51.570889+0000","last_became_peered":"2024-09-17T05:46:51.570889+0000","last_unstale":"2024-09-17T05:46:52.572126+0000","last_undegraded":"2024-09-17T05:46:52.572126+0000","last_fullsized":"2024-09-17T05:46:52.572126+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:46:50.533972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:46:50.533972+0000","last_clean_scrub_stamp":"2024-09-17T05:46:50.533972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:40:24.996136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.1b","version":"71'1","reported_seq":16,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-17T05:46:52.813696+0000","last_change":"2024-09-17T05:46:50.554024+0000","last_active":"2024-09-17T05:46:52.813696+0000","last_peered":"2024-09-17T05:46:52.813696+0000","last_clean":"2024-09-17T05:46:52.813696+0000","last_became_active":"2024-09-17T05:46:50.553651+0000","last_became_peered":"2024-09-17T05:46:50.553651+0000","last_unstale":"2024-09-17T05:46:52.813696+0000","last_undegraded":"2024-09-17T05:46:52.813696+0000","last_fullsized":"2024-09-17T05:46:52.813696+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:46:49.528019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:46:49.528019+0000","last_clean_scrub_stamp":"2024-09-17T05:46:49.528019+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:08:30.756585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.1b","version":"0'0","reported_seq":13,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-17T05:46:52.555389+0000","last_change":"2024-09-17T05:46:51.571637+0000","last_active":"2024-09-17T05:46:52.555389+0000","last_peered":"2024-09-17T05:46:52.555389+0000","last_clean":"2024-09-17T05:46:52.555389+0000","last_became_active":"2024-09-17T05:46:51.571168+0000","last_became_peered":"2024-09-17T05:46:51.571168+0000","last_unstale":"2024-09-17T05:46:52.555389+0000","last_undegraded":"2024-09-17T05:46:52.555389+0000","last_fullsized":"2024-09-17T05:46:52.555389+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:46:50.533972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:46:50.533972+0000","last_clean_scrub_stamp":"2024-09-17T05:46:50.533972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:53:12.121398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.1a","version":"71'1","reported_seq":16,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-17T05:46:52.867979+0000","last_change":"2024-09-17T05:46:50.561274+0000","last_active":"2024-09-17T05:46:52.867979+0000","last_peered":"2024-09-17T05:46:52.867979+0000","last_clean":"2024-09-17T05:46:52.867979+0000","last_became_active":"2024-09-17T05:46:50.560729+0000","last_became_peered":"2024-09-17T05:46:50.560729+0000","last_unstale":"2024-09-17T05:46:52.867979+0000","last_undegraded":"2024-09-17T05:46:52.867979+0000","last_fullsized":"2024-09-17T05:46:52.867979+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:46:49.528019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:46:49.528019+0000","last_clean_scrub_stamp":"2024-09-17T05:46:49.528019+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:46:48.701238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.18","version":"0'0","reported_seq":13,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-17T05:46:52.555158+0000","last_change":"2024-09-17T05:46:51.568431+0000","last_active":"2024-09-17T05:46:52.555158+0000","last_peered":"2024-09-17T05:46:52.555158+0000","last_clean":"2024-09-17T05:46:52.555158+0000","last_became_active":"2024-09-17T05:46:51.568066+0000","last_became_peered":"2024-09-17T05:46:51.568066+0000","last_unstale":"2024-09-17T05:46:52.555158+0000","last_undegraded":"2024-09-17T05:46:52.555158+0000","last_fullsized":"2024-09-17T05:46:52.555158+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:46:50.533972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:46:50.533972+0000","last_clean_scrub_stamp":"2024-09-17T05:46:50.533972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:26:35.502737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.19","version":"0'0","reported_seq":15,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-17T05:46:52.556443+0000","last_change":"2024-09-17T05:46:50.552167+0000","last_active":"2024-09-17T05:46:52.556443+0000","last_peered":"2024-09-17T05:46:52.556443+0000","last_clean":"2024-09-17T05:46:52.556443+0000","last_became_active":"2024-09-17T05:46:50.551856+0000","last_became_peered":"2024-09-17T05:46:50.551856+0000","last_unstale":"2024-09-17T05:46:52.556443+0000","last_undegraded":"2024-09-17T05:46:52.556443+0000","last_fullsized":"2024-09-17T05:46:52.556443+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:46:49.528019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:46:49.528019+0000","last_clean_scrub_stamp":"2024-09-17T05:46:49.528019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:23:08.023320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.19","version":"0'0","reported_seq":13,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-17T05:46:52.574533+0000","last_change":"2024-09-17T05:46:51.569311+0000","last_active":"2024-09-17T05:46:52.574533+0000","last_peered":"2024-09-17T05:46:52.574533+0000","last_clean":"2024-09-17T05:46:52.574533+0000","last_became_active":"2024-09-17T05:46:51.569013+0000","last_became_peered":"2024-09-17T05:46:51.569013+0000","last_unstale":"2024-09-17T05:46:52.574533+0000","last_undegraded":"2024-09-17T05:46:52.574533+0000","last_fullsized":"2024-09-17T05:46:52.574533+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:46:50.533972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:46:50.533972+0000","last_clean_scrub_stamp":"2024-09-17T05:46:50.533972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:28:30.156588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.18","version":"0'0","reported_seq":15,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-17T05:46:52.555166+0000","last_change":"2024-09-17T05:46:50.552379+0000","last_active":"2024-09-17T05:46:52.555166+0000","last_peered":"2024-09-17T05:46:52.555166+0000","last_clean":"2024-09-17T05:46:52.555166+0000","last_became_active":"2024-09-17T05:46:50.552079+0000","last_became_peered":"2024-09-17T05:46:50.552079+0000","last_unstale":"2024-09-17T05:46:52.555166+0000","last_undegraded":"2024-09-17T05:46:52.555166+0000","last_fullsized":"2024-09-17T05:46:52.555166+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:46:49.528019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:46:49.528019+0000","last_clean_scrub_stamp":"2024-09-17T05:46:49.528019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:56:26.674599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.16","version":"0'0","reported_seq":13,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-17T05:46:52.572384+0000","last_change":"2024-09-17T05:46:51.563684+0000","last_active":"2024-09-17T05:46:52.572384+0000","last_peered":"2024-09-17T05:46:52.572384+0000","last_clean":"2024-09-17T05:46:52.572384+0000","last_became_active":"2024-09-17T05:46:51.563368+0000","last_became_peered":"2024-09-17T05:46:51.563368+0000","last_unstale":"2024-09-17T05:46:52.572384+0000","last_undegraded":"2024-09-17T05:46:52.572384+0000","last_fullsized":"2024-09-17T05:46:52.572384+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:46:50.533972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:46:50.533972+0000","last_clean_scrub_stamp":"2024-09-17T05:46:50.533972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:10:39.211711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.17","version":"0'0","reported_seq":15,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-17T05:46:52.555372+0000","last_change":"2024-09-17T05:46:50.550428+0000","last_active":"2024-09-17T05:46:52.555372+0000","last_peered":"2024-09-17T05:46:52.555372+0000","last_clean":"2024-09-17T05:46:52.555372+0000","last_became_active":"2024-09-17T05:46:50.549751+0000","last_became_peered":"2024-09-17T05:46:50.549751+0000","last_unstale":"2024-09-17T05:46:52.555372+0000","last_undegraded":"2024-09-17T05:46:52.555372+0000","last_fullsized":"2024-09-17T05:46:52.555372+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:46:49.528019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:46:49.528019+0000","last_clean_scrub_stamp":"2024-09-17T05:46:49.528019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:07:41.263112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.17","version":"0'0","reported_seq":13,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-17T05:46:52.867107+0000","last_change":"2024-09-17T05:46:51.577181+0000","last_active":"2024-09-17T05:46:52.867107+0000","last_peered":"2024-09-17T05:46:52.867107+0000","last_clean":"2024-09-17T05:46:52.867107+0000","last_became_active":"2024-09-17T05:46:51.576829+0000","last_became_peered":"2024-09-17T05:46:51.576829+0000","last_unstale":"2024-09-17T05:46:52.867107+0000","last_undegraded":"2024-09-17T05:46:52.867107+0000","last_fullsized":"2024-09-17T05:46:52.867107+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:46:50.533972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:46:50.533972+0000","last_clean_scrub_stamp":"2024-09-17T05:46:50.533972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:15:31.665358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.16","version":"0'0","reported_seq":15,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-17T05:46:52.867767+0000","last_change":"2024-09-17T05:46:50.556469+0000","last_active":"2024-09-17T05:46:52.867767+0000","last_peered":"2024-09-17T05:46:52.867767+0000","last_clean":"2024-09-17T05:46:52.867767+0000","last_became_active":"2024-09-17T05:46:50.555925+0000","last_became_peered":"2024-09-17T05:46:50.555925+0000","last_unstale":"2024-09-17T05:46:52.867767+0000","last_undegraded":"2024-09-17T05:46:52.867767+0000","last_fullsized":"2024-09-17T05:46:52.867767+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:46:49.528019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:46:49.528019+0000","last_clean_scrub_stamp":"2024-09-17T05:46:49.528019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:11:55.261702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.14","version":"0'0","reported_seq":13,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-17T05:46:52.867615+0000","last_change":"2024-09-17T05:46:51.579751+0000","last_active":"2024-09-17T05:46:52.867615+0000","last_peered":"2024-09-17T05:46:52.867615+0000","last_clean":"2024-09-17T05:46:52.867615+0000","last_became_active":"2024-09-17T05:46:51.579430+0000","last_became_peered":"2024-09-17T05:46:51.579430+0000","last_unstale":"2024-09-17T05:46:52.867615+0000","last_undegraded":"2024-09-17T05:46:52.867615+0000","last_fullsized":"2024-09-17T05:46:52.867615+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:46:50.533972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:46:50.533972+0000","last_clean_scrub_stamp":"2024-09-17T05:46:50.533972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:15:38.973972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.15","version":"71'3","reported_seq":18,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-17T05:46:52.813833+0000","last_change":"2024-09-17T05:46:50.552409+0000","last_active":"2024-09-17T05:46:52.813833+0000","last_peered":"2024-09-17T05:46:52.813833+0000","last_clean":"2024-09-17T05:46:52.813833+0000","last_became_active":"2024-09-17T05:46:50.551178+0000","last_became_peered":"2024-09-17T05:46:50.551178+0000","last_unstale":"2024-09-17T05:46:52.813833+0000","last_undegraded":"2024-09-17T05:46:52.813833+0000","last_fullsized":"2024-09-17T05:46:52.813833+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:46:49.528019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:46:49.528019+0000","last_clean_scrub_stamp":"2024-09-17T05:46:49.528019+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:29:57.514758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.15","version":"0'0","reported_seq":13,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-17T05:46:52.555718+0000","last_change":"2024-09-17T05:46:51.555771+0000","last_active":"2024-09-17T05:46:52.555718+0000","last_peered":"2024-09-17T05:46:52.555718+0000","last_clean":"2024-09-17T05:46:52.555718+0000","last_became_active":"2024-09-17T05:46:51.555470+0000","last_became_peered":"2024-09-17T05:46:51.555470+0000","last_unstale":"2024-09-17T05:46:52.555718+0000","last_undegraded":"2024-09-17T05:46:52.555718+0000","last_fullsized":"2024-09-17T05:46:52.555718+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:46:50.533972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:46:50.533972+0000","last_clean_scrub_stamp":"2024-09-17T05:46:50.533972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:06:21.963141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.14","version":"71'6","reported_seq":21,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-17T05:46:52.556962+0000","last_change":"2024-09-17T05:46:50.553143+0000","last_active":"2024-09-17T05:46:52.556962+0000","last_peered":"2024-09-17T05:46:52.556962+0000","last_clean":"2024-09-17T05:46:52.556962+0000","last_became_active":"2024-09-17T05:46:50.552549+0000","last_became_peered":"2024-09-17T05:46:50.552549+0000","last_unstale":"2024-09-17T05:46:52.556962+0000","last_undegraded":"2024-09-17T05:46:52.556962+0000","last_fullsized":"2024-09-17T05:46:52.556962+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:46:49.528019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:46:49.528019+0000","last_clean_scrub_stamp":"2024-09-17T05:46:49.528019+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:04:38.547894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.12","version":"0'0","reported_seq":13,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-17T05:46:52.866378+0000","last_change":"2024-09-17T05:46:51.561258+0000","last_active":"2024-09-17T05:46:52.866378+0000","last_peered":"2024-09-17T05:46:52.866378+0000","last_clean":"2024-09-17T05:46:52.866378+0000","last_became_active":"2024-09-17T05:46:51.560943+0000","last_became_peered":"2024-09-17T05:46:51.560943+0000","last_unstale":"2024-09-17T05:46:52.866378+0000","last_undegraded":"2024-09-17T05:46:52.866378+0000","last_fullsized":"2024-09-17T05:46:52.866378+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:46:50.533972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:46:50.533972+0000","last_clean_scrub_stamp":"2024-09-17T05:46:50.533972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:41:21.338178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.13","version":"71'2","reported_seq":17,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-17T05:46:52.556708+0000","last_change":"2024-09-17T05:46:50.553892+0000","last_active":"2024-09-17T05:46:52.556708+0000","last_peered":"2024-09-17T05:46:52.556708+0000","last_clean":"2024-09-17T05:46:52.556708+0000","last_became_active":"2024-09-17T05:46:50.553567+0000","last_became_peered":"2024-09-17T05:46:50.553567+0000","last_unstale":"2024-09-17T05:46:52.556708+0000","last_undegraded":"2024-09-17T05:46:52.556708+0000","last_fullsized":"2024-09-17T05:46:52.556708+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:46:49.528019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:46:49.528019+0000","last_clean_scrub_stamp":"2024-09-17T05:46:49.528019+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:16:32.532491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.13","version":"0'0","reported_seq":13,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-17T05:46:52.572333+0000","last_change":"2024-09-17T05:46:51.571401+0000","last_active":"2024-09-17T05:46:52.572333+0000","last_peered":"2024-09-17T05:46:52.572333+0000","last_clean":"2024-09-17T05:46:52.572333+0000","last_became_active":"2024-09-17T05:46:51.571041+0000","last_became_peered":"2024-09-17T05:46:51.571041+0000","last_unstale":"2024-09-17T05:46:52.572333+0000","last_undegraded":"2024-09-17T05:46:52.572333+0000","last_fullsized":"2024-09-17T05:46:52.572333+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:46:50.533972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:46:50.533972+0000","last_clean_scrub_stamp":"2024-09-17T05:46:50.533972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:15:17.799084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.12","version":"0'0","reported_seq":15,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-17T05:46:52.868061+0000","last_change":"2024-09-17T05:46:50.557441+0000","last_active":"2024-09-17T05:46:52.868061+0000","last_peered":"2024-09-17T05:46:52.868061+0000","last_clean":"2024-09-17T05:46:52.868061+0000","last_became_active":"2024-09-17T05:46:50.557121+0000","last_became_peered":"2024-09-17T05:46:50.557121+0000","last_unstale":"2024-09-17T05:46:52.868061+0000","last_undegraded":"2024-09-17T05:46:52.868061+0000","last_fullsized":"2024-09-17T05:46:52.868061+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:46:49.528019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:46:49.528019+0000","last_clean_scrub_stamp":"2024-09-17T05:46:49.528019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:52:52.514589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.10","version":"0'0","reported_seq":13,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-17T05:46:52.574474+0000","last_change":"2024-09-17T05:46:51.580220+0000","last_active":"2024-09-17T05:46:52.574474+0000","last_peered":"2024-09-17T05:46:52.574474+0000","last_clean":"2024-09-17T05:46:52.574474+0000","last_became_active":"2024-09-17T05:46:51.579877+0000","last_became_peered":"2024-09-17T05:46:51.579877+0000","last_unstale":"2024-09-17T05:46:52.574474+0000","last_undegraded":"2024-09-17T05:46:52.574474+0000","last_fullsized":"2024-09-17T05:46:52.574474+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:46:50.533972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:46:50.533972+0000","last_clean_scrub_stamp":"2024-09-17T05:46:50.533972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:07:06.372655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.11","version":"0'0","reported_seq":15,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-17T05:46:52.571916+0000","last_change":"2024-09-17T05:46:50.549371+0000","last_active":"2024-09-17T05:46:52.571916+0000","last_peered":"2024-09-17T05:46:52.571916+0000","last_clean":"2024-09-17T05:46:52.571916+0000","last_became_active":"2024-09-17T05:46:50.548998+0000","last_became_peered":"2024-09-17T05:46:50.548998+0000","last_unstale":"2024-09-17T05:46:52.571916+0000","last_undegraded":"2024-09-17T05:46:52.571916+0000","last_fullsized":"2024-09-17T05:46:52.571916+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:46:49.528019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:46:49.528019+0000","last_clean_scrub_stamp":"2024-09-17T05:46:49.528019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:39:56.581660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.11","version":"0'0","reported_seq":13,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-17T05:46:52.555301+0000","last_change":"2024-09-17T05:46:51.562481+0000","last_active":"2024-09-17T05:46:52.555301+0000","last_peered":"2024-09-17T05:46:52.555301+0000","last_clean":"2024-09-17T05:46:52.555301+0000","last_became_active":"2024-09-17T05:46:51.562122+0000","last_became_peered":"2024-09-17T05:46:51.562122+0000","last_unstale":"2024-09-17T05:46:52.555301+0000","last_undegraded":"2024-09-17T05:46:52.555301+0000","last_fullsized":"2024-09-17T05:46:52.555301+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:46:50.533972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:46:50.533972+0000","last_clean_scrub_stamp":"2024-09-17T05:46:50.533972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:08:15.325067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.10","version":"71'8","reported_seq":23,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-17T05:46:52.554886+0000","last_change":"2024-09-17T05:46:50.552842+0000","last_active":"2024-09-17T05:46:52.554886+0000","last_peered":"2024-09-17T05:46:52.554886+0000","last_clean":"2024-09-17T05:46:52.554886+0000","last_became_active":"2024-09-17T05:46:50.552520+0000","last_became_peered":"2024-09-17T05:46:50.552520+0000","last_unstale":"2024-09-17T05:46:52.554886+0000","last_undegraded":"2024-09-17T05:46:52.554886+0000","last_fullsized":"2024-09-17T05:46:52.554886+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:46:49.528019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:46:49.528019+0000","last_clean_scrub_stamp":"2024-09-17T05:46:49.528019+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:34:12.748494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.e","version":"0'0","reported_seq":13,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-17T05:46:52.555536+0000","last_change":"2024-09-17T05:46:51.570496+0000","last_active":"2024-09-17T05:46:52.555536+0000","last_peered":"2024-09-17T05:46:52.555536+0000","last_clean":"2024-09-17T05:46:52.555536+0000","last_became_active":"2024-09-17T05:46:51.569814+0000","last_became_peered":"2024-09-17T05:46:51.569814+0000","last_unstale":"2024-09-17T05:46:52.555536+0000","last_undegraded":"2024-09-17T05:46:52.555536+0000","last_fullsized":"2024-09-17T05:46:52.555536+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:46:50.533972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:46:50.533972+0000","last_clean_scrub_stamp":"2024-09-17T05:46:50.533972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:23:48.119361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.f","version":"71'1","reported_seq":16,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-17T05:46:52.867224+0000","last_change":"2024-09-17T05:46:50.555496+0000","last_active":"2024-09-17T05:46:52.867224+0000","last_peered":"2024-09-17T05:46:52.867224+0000","last_clean":"2024-09-17T05:46:52.867224+0000","last_became_active":"2024-09-17T05:46:50.555176+0000","last_became_peered":"2024-09-17T05:46:50.555176+0000","last_unstale":"2024-09-17T05:46:52.867224+0000","last_undegraded":"2024-09-17T05:46:52.867224+0000","last_fullsized":"2024-09-17T05:46:52.867224+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:46:49.528019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:46:49.528019+0000","last_clean_scrub_stamp":"2024-09-17T05:46:49.528019+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:22:31.843476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.f","version":"0'0","reported_seq":13,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-17T05:46:52.867096+0000","last_change":"2024-09-17T05:46:51.567158+0000","last_active":"2024-09-17T05:46:52.867096+0000","last_peered":"2024-09-17T05:46:52.867096+0000","last_clean":"2024-09-17T05:46:52.867096+0000","last_became_active":"2024-09-17T05:46:51.566686+0000","last_became_peered":"2024-09-17T05:46:51.566686+0000","last_unstale":"2024-09-17T05:46:52.867096+0000","last_undegraded":"2024-09-17T05:46:52.867096+0000","last_fullsized":"2024-09-17T05:46:52.867096+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:46:50.533972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:46:50.533972+0000","last_clean_scrub_stamp":"2024-09-17T05:46:50.533972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:28:31.739331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.e","version":"71'2","reported_seq":17,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-17T05:46:52.555652+0000","last_change":"2024-09-17T05:46:50.558925+0000","last_active":"2024-09-17T05:46:52.555652+0000","last_peered":"2024-09-17T05:46:52.555652+0000","last_clean":"2024-09-17T05:46:52.555652+0000","last_became_active":"2024-09-17T05:46:50.558622+0000","last_became_peered":"2024-09-17T05:46:50.558622+0000","last_unstale":"2024-09-17T05:46:52.555652+0000","last_undegraded":"2024-09-17T05:46:52.555652+0000","last_fullsized":"2024-09-17T05:46:52.555652+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:46:49.528019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:46:49.528019+0000","last_clean_scrub_stamp":"2024-09-17T05:46:49.528019+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:57:01.346586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.c","version":"0'0","reported_seq":13,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-17T05:46:52.556916+0000","last_change":"2024-09-17T05:46:51.556516+0000","last_active":"2024-09-17T05:46:52.556916+0000","last_peered":"2024-09-17T05:46:52.556916+0000","last_clean":"2024-09-17T05:46:52.556916+0000","last_became_active":"2024-09-17T05:46:51.555785+0000","last_became_peered":"2024-09-17T05:46:51.555785+0000","last_unstale":"2024-09-17T05:46:52.556916+0000","last_undegraded":"2024-09-17T05:46:52.556916+0000","last_fullsized":"2024-09-17T05:46:52.556916+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:46:50.533972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:46:50.533972+0000","last_clean_scrub_stamp":"2024-09-17T05:46:50.533972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:54:27.295769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.d","version":"71'1","reported_seq":16,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-17T05:46:52.866691+0000","last_change":"2024-09-17T05:46:50.560558+0000","last_active":"2024-09-17T05:46:52.866691+0000","last_peered":"2024-09-17T05:46:52.866691+0000","last_clean":"2024-09-17T05:46:52.866691+0000","last_became_active":"2024-09-17T05:46:50.560242+0000","last_became_peered":"2024-09-17T05:46:50.560242+0000","last_unstale":"2024-09-17T05:46:52.866691+0000","last_undegraded":"2024-09-17T05:46:52.866691+0000","last_fullsized":"2024-09-17T05:46:52.866691+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:46:49.528019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:46:49.528019+0000","last_clean_scrub_stamp":"2024-09-17T05:46:49.528019+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:30:56.705724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.d","version":"0'0","reported_seq":13,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-17T05:46:52.555981+0000","last_change":"2024-09-17T05:46:51.557975+0000","last_active":"2024-09-17T05:46:52.555981+0000","last_peered":"2024-09-17T05:46:52.555981+0000","last_clean":"2024-09-17T05:46:52.555981+0000","last_became_active":"2024-09-17T05:46:51.557674+0000","last_became_peered":"2024-09-17T05:46:51.557674+0000","last_unstale":"2024-09-17T05:46:52.555981+0000","last_undegraded":"2024-09-17T05:46:52.555981+0000","last_fullsized":"2024-09-17T05:46:52.555981+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:46:50.533972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:46:50.533972+0000","last_clean_scrub_stamp":"2024-09-17T05:46:50.533972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:53:13.143563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.c","version":"0'0","reported_seq":15,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-17T05:46:52.866863+0000","last_change":"2024-09-17T05:46:50.558154+0000","last_active":"2024-09-17T05:46:52.866863+0000","last_peered":"2024-09-17T05:46:52.866863+0000","last_clean":"2024-09-17T05:46:52.866863+0000","last_became_active":"2024-09-17T05:46:50.557830+0000","last_became_peered":"2024-09-17T05:46:50.557830+0000","last_unstale":"2024-09-17T05:46:52.866863+0000","last_undegraded":"2024-09-17T05:46:52.866863+0000","last_fullsized":"2024-09-17T05:46:52.866863+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:46:49.528019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:46:49.528019+0000","last_clean_scrub_stamp":"2024-09-17T05:46:49.528019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:27:20.878247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.b","version":"0'0","reported_seq":13,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-17T05:46:52.813550+0000","last_change":"2024-09-17T05:46:51.559821+0000","last_active":"2024-09-17T05:46:52.813550+0000","last_peered":"2024-09-17T05:46:52.813550+0000","last_clean":"2024-09-17T05:46:52.813550+0000","last_became_active":"2024-09-17T05:46:51.559470+0000","last_became_peered":"2024-09-17T05:46:51.559470+0000","last_unstale":"2024-09-17T05:46:52.813550+0000","last_undegraded":"2024-09-17T05:46:52.813550+0000","last_fullsized":"2024-09-17T05:46:52.813550+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:46:50.533972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:46:50.533972+0000","last_clean_scrub_stamp":"2024-09-17T05:46:50.533972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:34:05.806622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.a","version":"0'0","reported_seq":15,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-17T05:46:52.868138+0000","last_change":"2024-09-17T05:46:50.561013+0000","last_active":"2024-09-17T05:46:52.868138+0000","last_peered":"2024-09-17T05:46:52.868138+0000","last_clean":"2024-09-17T05:46:52.868138+0000","last_became_active":"2024-09-17T05:46:50.560656+0000","last_became_peered":"2024-09-17T05:46:50.560656+0000","last_unstale":"2024-09-17T05:46:52.868138+0000","last_undegraded":"2024-09-17T05:46:52.868138+0000","last_fullsized":"2024-09-17T05:46:52.868138+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:46:49.528019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:46:49.528019+0000","last_clean_scrub_stamp":"2024-09-17T05:46:49.528019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:12:32.519550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.8","version":"0'0","reported_seq":13,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-17T05:46:52.813516+0000","last_change":"2024-09-17T05:46:51.579266+0000","last_active":"2024-09-17T05:46:52.813516+0000","last_peered":"2024-09-17T05:46:52.813516+0000","last_clean":"2024-09-17T05:46:52.813516+0000","last_became_active":"2024-09-17T05:46:51.578937+0000","last_became_peered":"2024-09-17T05:46:51.578937+0000","last_unstale":"2024-09-17T05:46:52.813516+0000","last_undegraded":"2024-09-17T05:46:52.813516+0000","last_fullsized":"2024-09-17T05:46:52.813516+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:46:50.533972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:46:50.533972+0000","last_clean_scrub_stamp":"2024-09-17T05:46:50.533972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:29:42.013841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.9","version":"0'0","reported_seq":15,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-17T05:46:52.572199+0000","last_change":"2024-09-17T05:46:50.555771+0000","last_active":"2024-09-17T05:46:52.572199+0000","last_peered":"2024-09-17T05:46:52.572199+0000","last_clean":"2024-09-17T05:46:52.572199+0000","last_became_active":"2024-09-17T05:46:50.555434+0000","last_became_peered":"2024-09-17T05:46:50.555434+0000","last_unstale":"2024-09-17T05:46:52.572199+0000","last_undegraded":"2024-09-17T05:46:52.572199+0000","last_fullsized":"2024-09-17T05:46:52.572199+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:46:49.528019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:46:49.528019+0000","last_clean_scrub_stamp":"2024-09-17T05:46:49.528019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:37:40.854399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.9","version":"0'0","reported_seq":13,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-17T05:46:52.813683+0000","last_change":"2024-09-17T05:46:51.576821+0000","last_active":"2024-09-17T05:46:52.813683+0000","last_peered":"2024-09-17T05:46:52.813683+0000","last_clean":"2024-09-17T05:46:52.813683+0000","last_became_active":"2024-09-17T05:46:51.576334+0000","last_became_peered":"2024-09-17T05:46:51.576334+0000","last_unstale":"2024-09-17T05:46:52.813683+0000","last_undegraded":"2024-09-17T05:46:52.813683+0000","last_fullsized":"2024-09-17T05:46:52.813683+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:46:50.533972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:46:50.533972+0000","last_clean_scrub_stamp":"2024-09-17T05:46:50.533972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:26:57.433236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.8","version":"0'0","reported_seq":15,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-17T05:46:52.574325+0000","last_change":"2024-09-17T05:46:50.554397+0000","last_active":"2024-09-17T05:46:52.574325+0000","last_peered":"2024-09-17T05:46:52.574325+0000","last_clean":"2024-09-17T05:46:52.574325+0000","last_became_active":"2024-09-17T05:46:50.554006+0000","last_became_peered":"2024-09-17T05:46:50.554006+0000","last_unstale":"2024-09-17T05:46:52.574325+0000","last_undegraded":"2024-09-17T05:46:52.574325+0000","last_fullsized":"2024-09-17T05:46:52.574325+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:46:49.528019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:46:49.528019+0000","last_clean_scrub_stamp":"2024-09-17T05:46:49.528019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:20:01.660902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.6","version":"0'0","reported_seq":13,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-17T05:46:52.574697+0000","last_change":"2024-09-17T05:46:51.563526+0000","last_active":"2024-09-17T05:46:52.574697+0000","last_peered":"2024-09-17T05:46:52.574697+0000","last_clean":"2024-09-17T05:46:52.574697+0000","last_became_active":"2024-09-17T05:46:51.562568+0000","last_became_peered":"2024-09-17T05:46:51.562568+0000","last_unstale":"2024-09-17T05:46:52.574697+0000","last_undegraded":"2024-09-17T05:46:52.574697+0000","last_fullsized":"2024-09-17T05:46:52.574697+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:46:50.533972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:46:50.533972+0000","last_clean_scrub_stamp":"2024-09-17T05:46:50.533972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:38:37.039701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.7","version":"71'2","reported_seq":17,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-17T05:46:52.867436+0000","last_change":"2024-09-17T05:46:50.556372+0000","last_active":"2024-09-17T05:46:52.867436+0000","last_peered":"2024-09-17T05:46:52.867436+0000","last_clean":"2024-09-17T05:46:52.867436+0000","last_became_active":"2024-09-17T05:46:50.556058+0000","last_became_peered":"2024-09-17T05:46:50.556058+0000","last_unstale":"2024-09-17T05:46:52.867436+0000","last_undegraded":"2024-09-17T05:46:52.867436+0000","last_fullsized":"2024-09-17T05:46:52.867436+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:46:49.528019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:46:49.528019+0000","last_clean_scrub_stamp":"2024-09-17T05:46:49.528019+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:32:09.112921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.7","version":"0'0","reported_seq":13,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-17T05:46:52.572289+0000","last_change":"2024-09-17T05:46:51.564893+0000","last_active":"2024-09-17T05:46:52.572289+0000","last_peered":"2024-09-17T05:46:52.572289+0000","last_clean":"2024-09-17T05:46:52.572289+0000","last_became_active":"2024-09-17T05:46:51.564548+0000","last_became_peered":"2024-09-17T05:46:51.564548+0000","last_unstale":"2024-09-17T05:46:52.572289+0000","last_undegraded":"2024-09-17T05:46:52.572289+0000","last_fullsized":"2024-09-17T05:46:52.572289+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:46:50.533972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:46:50.533972+0000","last_clean_scrub_stamp":"2024-09-17T05:46:50.533972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:26:50.557199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.6","version":"72'1","reported_seq":16,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-17T05:46:52.572552+0000","last_change":"2024-09-17T05:46:50.544381+0000","last_active":"2024-09-17T05:46:52.572552+0000","last_peered":"2024-09-17T05:46:52.572552+0000","last_clean":"2024-09-17T05:46:52.572552+0000","last_became_active":"2024-09-17T05:46:50.543986+0000","last_became_peered":"2024-09-17T05:46:50.543986+0000","last_unstale":"2024-09-17T05:46:52.572552+0000","last_undegraded":"2024-09-17T05:46:52.572552+0000","last_fullsized":"2024-09-17T05:46:52.572552+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:46:49.528019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:46:49.528019+0000","last_clean_scrub_stamp":"2024-09-17T05:46:49.528019+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:35:16.769924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.4","version":"0'0","reported_seq":13,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-17T05:46:52.866676+0000","last_change":"2024-09-17T05:46:51.577022+0000","last_active":"2024-09-17T05:46:52.866676+0000","last_peered":"2024-09-17T05:46:52.866676+0000","last_clean":"2024-09-17T05:46:52.866676+0000","last_became_active":"2024-09-17T05:46:51.576540+0000","last_became_peered":"2024-09-17T05:46:51.576540+0000","last_unstale":"2024-09-17T05:46:52.866676+0000","last_undegraded":"2024-09-17T05:46:52.866676+0000","last_fullsized":"2024-09-17T05:46:52.866676+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:46:50.533972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:46:50.533972+0000","last_clean_scrub_stamp":"2024-09-17T05:46:50.533972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:38:59.186959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.5","version":"0'0","reported_seq":15,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-17T05:46:52.556252+0000","last_change":"2024-09-17T05:46:50.549973+0000","last_active":"2024-09-17T05:46:52.556252+0000","last_peered":"2024-09-17T05:46:52.556252+0000","last_clean":"2024-09-17T05:46:52.556252+0000","last_became_active":"2024-09-17T05:46:50.549694+0000","last_became_peered":"2024-09-17T05:46:50.549694+0000","last_unstale":"2024-09-17T05:46:52.556252+0000","last_undegraded":"2024-09-17T05:46:52.556252+0000","last_fullsized":"2024-09-17T05:46:52.556252+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:46:49.528019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:46:49.528019+0000","last_clean_scrub_stamp":"2024-09-17T05:46:49.528019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:31:19.308660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.5","version":"0'0","reported_seq":13,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-17T05:46:52.867639+0000","last_change":"2024-09-17T05:46:51.567055+0000","last_active":"2024-09-17T05:46:52.867639+0000","last_peered":"2024-09-17T05:46:52.867639+0000","last_clean":"2024-09-17T05:46:52.867639+0000","last_became_active":"2024-09-17T05:46:51.566737+0000","last_became_peered":"2024-09-17T05:46:51.566737+0000","last_unstale":"2024-09-17T05:46:52.867639+0000","last_undegraded":"2024-09-17T05:46:52.867639+0000","last_fullsized":"2024-09-17T05:46:52.867639+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:46:50.533972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:46:50.533972+0000","last_clean_scrub_stamp":"2024-09-17T05:46:50.533972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:40:35.531124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.4","version":"0'0","reported_seq":15,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-17T05:46:52.574697+0000","last_change":"2024-09-17T05:46:50.547993+0000","last_active":"2024-09-17T05:46:52.574697+0000","last_peered":"2024-09-17T05:46:52.574697+0000","last_clean":"2024-09-17T05:46:52.574697+0000","last_became_active":"2024-09-17T05:46:50.547677+0000","last_became_peered":"2024-09-17T05:46:50.547677+0000","last_unstale":"2024-09-17T05:46:52.574697+0000","last_undegraded":"2024-09-17T05:46:52.574697+0000","last_fullsized":"2024-09-17T05:46:52.574697+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:46:49.528019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:46:49.528019+0000","last_clean_scrub_stamp":"2024-09-17T05:46:49.528019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:26:15.799059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.2","version":"0'0","reported_seq":13,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-17T05:46:52.555950+0000","last_change":"2024-09-17T05:46:51.563537+0000","last_active":"2024-09-17T05:46:52.555950+0000","last_peered":"2024-09-17T05:46:52.555950+0000","last_clean":"2024-09-17T05:46:52.555950+0000","last_became_active":"2024-09-17T05:46:51.563188+0000","last_became_peered":"2024-09-17T05:46:51.563188+0000","last_unstale":"2024-09-17T05:46:52.555950+0000","last_undegraded":"2024-09-17T05:46:52.555950+0000","last_fullsized":"2024-09-17T05:46:52.555950+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:46:50.533972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:46:50.533972+0000","last_clean_scrub_stamp":"2024-09-17T05:46:50.533972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:25:29.394451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.3","version":"0'0","reported_seq":15,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-17T05:46:52.555642+0000","last_change":"2024-09-17T05:46:50.556229+0000","last_active":"2024-09-17T05:46:52.555642+0000","last_peered":"2024-09-17T05:46:52.555642+0000","last_clean":"2024-09-17T05:46:52.555642+0000","last_became_active":"2024-09-17T05:46:50.555876+0000","last_became_peered":"2024-09-17T05:46:50.555876+0000","last_unstale":"2024-09-17T05:46:52.555642+0000","last_undegraded":"2024-09-17T05:46:52.555642+0000","last_fullsized":"2024-09-17T05:46:52.555642+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:46:49.528019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:46:49.528019+0000","last_clean_scrub_stamp":"2024-09-17T05:46:49.528019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:04:36.653508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.3","version":"0'0","reported_seq":13,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-17T05:46:52.867980+0000","last_change":"2024-09-17T05:46:51.575439+0000","last_active":"2024-09-17T05:46:52.867980+0000","last_peered":"2024-09-17T05:46:52.867980+0000","last_clean":"2024-09-17T05:46:52.867980+0000","last_became_active":"2024-09-17T05:46:51.575141+0000","last_became_peered":"2024-09-17T05:46:51.575141+0000","last_unstale":"2024-09-17T05:46:52.867980+0000","last_undegraded":"2024-09-17T05:46:52.867980+0000","last_fullsized":"2024-09-17T05:46:52.867980+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:46:50.533972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:46:50.533972+0000","last_clean_scrub_stamp":"2024-09-17T05:46:50.533972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:15:54.597328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.2","version":"0'0","reported_seq":15,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-17T05:46:52.556555+0000","last_change":"2024-09-17T05:46:50.552938+0000","last_active":"2024-09-17T05:46:52.556555+0000","last_peered":"2024-09-17T05:46:52.556555+0000","last_clean":"2024-09-17T05:46:52.556555+0000","last_became_active":"2024-09-17T05:46:50.552636+0000","last_became_peered":"2024-09-17T05:46:50.552636+0000","last_unstale":"2024-09-17T05:46:52.556555+0000","last_undegraded":"2024-09-17T05:46:52.556555+0000","last_fullsized":"2024-09-17T05:46:52.556555+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:46:49.528019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:46:49.528019+0000","last_clean_scrub_stamp":"2024-09-17T05:46:49.528019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:24:36.778807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.0","version":"0'0","reported_seq":13,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-17T05:46:52.556391+0000","last_change":"2024-09-17T05:46:51.566304+0000","last_active":"2024-09-17T05:46:52.556391+0000","last_peered":"2024-09-17T05:46:52.556391+0000","last_clean":"2024-09-17T05:46:52.556391+0000","last_became_active":"2024-09-17T05:46:51.565283+0000","last_became_peered":"2024-09-17T05:46:51.565283+0000","last_unstale":"2024-09-17T05:46:52.556391+0000","last_undegraded":"2024-09-17T05:46:52.556391+0000","last_fullsized":"2024-09-17T05:46:52.556391+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:46:50.533972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:46:50.533972+0000","last_clean_scrub_stamp":"2024-09-17T05:46:50.533972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:06:30.214037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.1","version":"0'0","reported_seq":15,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-17T05:46:52.554763+0000","last_change":"2024-09-17T05:46:50.552458+0000","last_active":"2024-09-17T05:46:52.554763+0000","last_peered":"2024-09-17T05:46:52.554763+0000","last_clean":"2024-09-17T05:46:52.554763+0000","last_became_active":"2024-09-17T05:46:50.552107+0000","last_became_peered":"2024-09-17T05:46:50.552107+0000","last_unstale":"2024-09-17T05:46:52.554763+0000","last_undegraded":"2024-09-17T05:46:52.554763+0000","last_fullsized":"2024-09-17T05:46:52.554763+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:46:49.528019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:46:49.528019+0000","last_clean_scrub_stamp":"2024-09-17T05:46:49.528019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:53:43.698741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1","version":"0'0","reported_seq":13,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-17T05:46:52.867108+0000","last_change":"2024-09-17T05:46:51.573577+0000","last_active":"2024-09-17T05:46:52.867108+0000","last_peered":"2024-09-17T05:46:52.867108+0000","last_clean":"2024-09-17T05:46:52.867108+0000","last_became_active":"2024-09-17T05:46:51.569489+0000","last_became_peered":"2024-09-17T05:46:51.569489+0000","last_unstale":"2024-09-17T05:46:52.867108+0000","last_undegraded":"2024-09-17T05:46:52.867108+0000","last_fullsized":"2024-09-17T05:46:52.867108+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:46:50.533972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:46:50.533972+0000","last_clean_scrub_stamp":"2024-09-17T05:46:50.533972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:43:04.635502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.0","version":"0'0","reported_seq":15,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-17T05:46:52.867869+0000","last_change":"2024-09-17T05:46:50.558270+0000","last_active":"2024-09-17T05:46:52.867869+0000","last_peered":"2024-09-17T05:46:52.867869+0000","last_clean":"2024-09-17T05:46:52.867869+0000","last_became_active":"2024-09-17T05:46:50.557754+0000","last_became_peered":"2024-09-17T05:46:50.557754+0000","last_unstale":"2024-09-17T05:46:52.867869+0000","last_undegraded":"2024-09-17T05:46:52.867869+0000","last_fullsized":"2024-09-17T05:46:52.867869+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:46:49.528019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:46:49.528019+0000","last_clean_scrub_stamp":"2024-09-17T05:46:49.528019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:05:59.732974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.a","version":"0'0","reported_seq":13,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-17T05:46:52.813526+0000","last_change":"2024-09-17T05:46:51.570833+0000","last_active":"2024-09-17T05:46:52.813526+0000","last_peered":"2024-09-17T05:46:52.813526+0000","last_clean":"2024-09-17T05:46:52.813526+0000","last_became_active":"2024-09-17T05:46:51.570468+0000","last_became_peered":"2024-09-17T05:46:51.570468+0000","last_unstale":"2024-09-17T05:46:52.813526+0000","last_undegraded":"2024-09-17T05:46:52.813526+0000","last_fullsized":"2024-09-17T05:46:52.813526+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:46:50.533972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:46:50.533972+0000","last_clean_scrub_stamp":"2024-09-17T05:46:50.533972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:36:32.565443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.b","version":"71'2","reported_seq":17,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-17T05:46:52.867972+0000","last_change":"2024-09-17T05:46:50.559144+0000","last_active":"2024-09-17T05:46:52.867972+0000","last_peered":"2024-09-17T05:46:52.867972+0000","last_clean":"2024-09-17T05:46:52.867972+0000","last_became_active":"2024-09-17T05:46:50.558856+0000","last_became_peered":"2024-09-17T05:46:50.558856+0000","last_unstale":"2024-09-17T05:46:52.867972+0000","last_undegraded":"2024-09-17T05:46:52.867972+0000","last_fullsized":"2024-09-17T05:46:52.867972+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:46:49.528019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:46:49.528019+0000","last_clean_scrub_stamp":"2024-09-17T05:46:49.528019+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:33:50.200522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"19'72","reported_seq":200,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-17T05:46:52.866220+0000","last_change":"2024-09-17T05:41:48.539830+0000","last_active":"2024-09-17T05:46:52.866220+0000","last_peered":"2024-09-17T05:46:52.866220+0000","last_clean":"2024-09-17T05:46:52.866220+0000","last_became_active":"2024-09-17T05:41:48.538743+0000","last_became_peered":"2024-09-17T05:41:48.538743+0000","last_unstale":"2024-09-17T05:46:52.866220+0000","last_undegraded":"2024-09-17T05:46:52.866220+0000","last_fullsized":"2024-09-17T05:46:52.866220+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:47.152539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:47.152539+0000","last_clean_scrub_stamp":"2024-09-17T05:41:47.152539+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:08:02.952016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":11,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":10,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":16,"seq":68719476803,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":58412,"kb_used_data":856,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94313428,"statfs":{"total":96636764160,"available":96576950272,"internally_reserved":0,"allocated":876544,"data_stored":365974,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":58915270},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":15,"seq":64424509507,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":58996,"kb_used_data":1436,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94312844,"statfs":{"total":96636764160,"available":96576352256,"internally_reserved":0,"allocated":1470464,"data_stored":956866,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":58915274},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509506,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":58412,"kb_used_data":852,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94313428,"statfs":{"total":96636764160,"available":96576950272,"internally_reserved":0,"allocated":872448,"data_stored":365972,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":58915269},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509506,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":58412,"kb_used_data":852,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94313428,"statfs":{"total":96636764160,"available":96576950272,"internally_reserved":0,"allocated":872448,"data_stored":365952,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":58915269},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509506,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":58412,"kb_used_data":856,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94313428,"statfs":{"total":96636764160,"available":96576950272,"internally_reserved":0,"allocated":876544,"data_stored":365994,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":58915271},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509506,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":58424,"kb_used_data":860,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94313416,"statfs":{"total":96636764160,"available":96576937984,"internally_reserved":0,"allocated":880640,"data_stored":367494,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":58915269},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509506,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":58424,"kb_used_data":868,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94313416,"statfs":{"total":96636764160,"available":96576937984,"internally_reserved":0,"allocated":888832,"data_stored":368110,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":58915269},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574914,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":46504,"kb_used_data":1428,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94325336,"statfs":{"total":96636764160,"available":96589144064,"internally_reserved":0,"allocated":1462272,"data_stored":956250,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":46135749},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2228,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-17T05:47:00.371 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-17T05:47:00.371 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-09-17T05:47:00.524 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:00.523+0000 7f1356fcc640 1 -- 172.21.15.150:0/1389158709 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f13500b25e0 msgr2=0x7f13500b1ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:47:00.525 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:00.523+0000 7f1356fcc640 1 --2- 172.21.15.150:0/1389158709 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f13500b25e0 0x7f13500b1ec0 secure :-1 s=READY pgs=820 cs=0 l=1 rev1=1 crypto rx=0x7f134c009830 tx=0x7f134c02a3f0 comp rx=0 tx=0).stop 2024-09-17T05:47:00.525 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:00.524+0000 7f1356fcc640 1 -- 172.21.15.150:0/1389158709 shutdown_connections 2024-09-17T05:47:00.525 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:00.524+0000 7f1356fcc640 1 --2- 172.21.15.150:0/1389158709 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f13500b0fe0 0x7f13500b13f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:47:00.525 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:00.524+0000 7f1356fcc640 1 --2- 172.21.15.150:0/1389158709 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f13500b25e0 0x7f13500b1ec0 unknown :-1 s=CLOSED pgs=820 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:47:00.525 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:00.524+0000 7f1356fcc640 1 -- 172.21.15.150:0/1389158709 >> 172.21.15.150:0/1389158709 conn(0x7f13500b2ff0 msgr2=0x7f13500b3400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:47:00.525 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:00.524+0000 7f1356fcc640 1 -- 172.21.15.150:0/1389158709 shutdown_connections 2024-09-17T05:47:00.525 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:00.524+0000 7f1356fcc640 1 -- 172.21.15.150:0/1389158709 wait complete. 2024-09-17T05:47:00.526 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:00.525+0000 7f1356fcc640 1 Processor -- start 2024-09-17T05:47:00.526 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:00.525+0000 7f1356fcc640 1 -- start start 2024-09-17T05:47:00.529 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:00.527+0000 7f1356fcc640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f13500b0fe0 0x7f13501f89d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:47:00.529 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:00.527+0000 7f1356fcc640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f13500b25e0 0x7f135014dec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:47:00.532 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:00.527+0000 7f1356fcc640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f135015fa30 0x7f135015b2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:47:00.532 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:00.527+0000 7f1356fcc640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f13500ae740 con 0x7f135015fa30 2024-09-17T05:47:00.532 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:00.527+0000 7f1356fcc640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f13500ae5c0 con 0x7f13500b0fe0 2024-09-17T05:47:00.533 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:00.527+0000 7f1356fcc640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f13500ae8c0 con 0x7f13500b25e0 2024-09-17T05:47:00.533 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:00.527+0000 7f1355569640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f135015fa30 0x7f135015b2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:47:00.533 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:00.527+0000 7f1355569640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f135015fa30 0x7f135015b2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:37816/0 (socket says 172.21.15.150:37816) 2024-09-17T05:47:00.533 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:00.527+0000 7f1355569640 1 -- 172.21.15.150:0/2825029551 learned_addr learned my addr 172.21.15.150:0/2825029551 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:47:00.533 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:00.527+0000 7f1354d68640 1 --2- 172.21.15.150:0/2825029551 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f13500b0fe0 0x7f13501f89d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:47:00.533 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:00.527+0000 7f1347fff640 1 --2- 172.21.15.150:0/2825029551 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f13500b25e0 0x7f135014dec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:47:00.533 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:00.527+0000 7f1355569640 1 -- 172.21.15.150:0/2825029551 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f13500b25e0 msgr2=0x7f135014dec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:47:00.533 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:00.527+0000 7f1355569640 1 --2- 172.21.15.150:0/2825029551 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f13500b25e0 0x7f135014dec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:47:00.533 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:00.527+0000 7f1355569640 1 -- 172.21.15.150:0/2825029551 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f13500b0fe0 msgr2=0x7f13501f89d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:47:00.533 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:00.527+0000 7f1355569640 1 --2- 172.21.15.150:0/2825029551 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f13500b0fe0 0x7f13501f89d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:47:00.533 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:00.527+0000 7f1355569640 1 -- 172.21.15.150:0/2825029551 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f13500ccc80 con 0x7f135015fa30 2024-09-17T05:47:00.533 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:00.527+0000 7f1355569640 1 --2- 172.21.15.150:0/2825029551 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f135015fa30 0x7f135015b2a0 secure :-1 s=READY pgs=821 cs=0 l=1 rev1=1 crypto rx=0x7f134800c6f0 tx=0x7f134800cbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:47:00.533 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:00.528+0000 7f13457fa640 1 -- 172.21.15.150:0/2825029551 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1348017070 con 0x7f135015fa30 2024-09-17T05:47:00.534 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:00.528+0000 7f13457fa640 1 -- 172.21.15.150:0/2825029551 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f1348003c90 con 0x7f135015fa30 2024-09-17T05:47:00.534 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:00.528+0000 7f1356fcc640 1 -- 172.21.15.150:0/2825029551 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f13501f9220 con 0x7f135015fa30 2024-09-17T05:47:00.534 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:00.528+0000 7f13457fa640 1 -- 172.21.15.150:0/2825029551 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1348003e60 con 0x7f135015fa30 2024-09-17T05:47:00.534 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:00.528+0000 7f1356fcc640 1 -- 172.21.15.150:0/2825029551 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f13501f97e0 con 0x7f135015fa30 2024-09-17T05:47:00.535 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:00.529+0000 7f1356fcc640 1 -- 172.21.15.150:0/2825029551 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f13501f8f90 con 0x7f135015fa30 2024-09-17T05:47:00.535 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:00.530+0000 7f13457fa640 1 -- 172.21.15.150:0/2825029551 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 19) ==== 102563+0+0 (secure 0 0 0) 0x7f134801a070 con 0x7f135015fa30 2024-09-17T05:47:00.535 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:00.530+0000 7f13457fa640 1 --2- 172.21.15.150:0/2825029551 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f133c079820 0x7f133c07bd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:47:00.535 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:00.530+0000 7f13457fa640 1 -- 172.21.15.150:0/2825029551 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 5765+0+0 (secure 0 0 0) 0x7f1348098e60 con 0x7f135015fa30 2024-09-17T05:47:00.535 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:00.531+0000 7f1354d68640 1 --2- 172.21.15.150:0/2825029551 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f133c079820 0x7f133c07bd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:47:00.535 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:00.531+0000 7f1354d68640 1 --2- 172.21.15.150:0/2825029551 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f133c079820 0x7f133c07bd30 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f134c034000 tx=0x7f134c004730 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:47:00.535 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:00.535+0000 7f13457fa640 1 -- 172.21.15.150:0/2825029551 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f1348062490 con 0x7f135015fa30 2024-09-17T05:47:00.782 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:00.782+0000 7f1356fcc640 1 -- 172.21.15.150:0/2825029551 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) -- 0x7f13500af2f0 con 0x7f135015fa30 2024-09-17T05:47:00.785 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:00.784+0000 7f13457fa640 1 -- 172.21.15.150:0/2825029551 <== mon.0 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v14) ==== 190+0+147 (secure 0 0 0) 0x7f134806b020 con 0x7f135015fa30 2024-09-17T05:47:00.785 INFO:teuthology.orchestra.run.smithi150.stdout:[client.0] 2024-09-17T05:47:00.785 INFO:teuthology.orchestra.run.smithi150.stdout: key = AQBoFulmfF/1HBAAMezEjZDeoHTJ+uFfDXNWHQ== 2024-09-17T05:47:00.785 INFO:teuthology.orchestra.run.smithi150.stdout: caps mds = "allow" 2024-09-17T05:47:00.785 INFO:teuthology.orchestra.run.smithi150.stdout: caps mon = "allow r" 2024-09-17T05:47:00.785 INFO:teuthology.orchestra.run.smithi150.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2024-09-17T05:47:00.786 INFO:teuthology.orchestra.run.smithi150.stderr:updated caps for client.0 2024-09-17T05:47:00.788 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:00.788+0000 7f1356fcc640 1 -- 172.21.15.150:0/2825029551 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f133c079820 msgr2=0x7f133c07bd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:47:00.789 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:00.788+0000 7f1356fcc640 1 --2- 172.21.15.150:0/2825029551 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f133c079820 0x7f133c07bd30 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f134c034000 tx=0x7f134c004730 comp rx=0 tx=0).stop 2024-09-17T05:47:00.789 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:00.788+0000 7f1356fcc640 1 -- 172.21.15.150:0/2825029551 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f135015fa30 msgr2=0x7f135015b2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:47:00.789 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:00.788+0000 7f1356fcc640 1 --2- 172.21.15.150:0/2825029551 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f135015fa30 0x7f135015b2a0 secure :-1 s=READY pgs=821 cs=0 l=1 rev1=1 crypto rx=0x7f134800c6f0 tx=0x7f134800cbb0 comp rx=0 tx=0).stop 2024-09-17T05:47:00.789 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:00.788+0000 7f1356fcc640 1 -- 172.21.15.150:0/2825029551 shutdown_connections 2024-09-17T05:47:00.789 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:00.788+0000 7f1356fcc640 1 --2- 172.21.15.150:0/2825029551 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f133c079820 0x7f133c07bd30 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:47:00.789 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:00.788+0000 7f1356fcc640 1 --2- 172.21.15.150:0/2825029551 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f135015fa30 0x7f135015b2a0 unknown :-1 s=CLOSED pgs=821 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:47:00.789 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:00.788+0000 7f1356fcc640 1 --2- 172.21.15.150:0/2825029551 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f13500b25e0 0x7f135014dec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:47:00.789 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:00.788+0000 7f1356fcc640 1 --2- 172.21.15.150:0/2825029551 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f13500b0fe0 0x7f13501f89d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:47:00.789 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:00.788+0000 7f1356fcc640 1 -- 172.21.15.150:0/2825029551 >> 172.21.15.150:0/2825029551 conn(0x7f13500b2ff0 msgr2=0x7f135006cda0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:47:00.789 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:00.788+0000 7f1356fcc640 1 -- 172.21.15.150:0/2825029551 shutdown_connections 2024-09-17T05:47:00.789 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:00.788+0000 7f1356fcc640 1 -- 172.21.15.150:0/2825029551 wait complete. 2024-09-17T05:47:00.800 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T05:47:00.914 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:00.913+0000 7f0b618f9640 1 -- 172.21.15.150:0/3445884002 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0b48003c10 msgr2=0x7f0b48004060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:47:00.914 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:00.913+0000 7f0b618f9640 1 --2- 172.21.15.150:0/3445884002 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0b48003c10 0x7f0b48004060 secure :-1 s=READY pgs=823 cs=0 l=1 rev1=1 crypto rx=0x7f0b4c009b50 tx=0x7f0b48005830 comp rx=0 tx=0).stop 2024-09-17T05:47:00.915 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:00.913+0000 7f0b5b7fe640 1 -- 172.21.15.150:0/3445884002 reap_dead start 2024-09-17T05:47:00.915 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:00.913+0000 7f0b618f9640 1 -- 172.21.15.150:0/3445884002 shutdown_connections 2024-09-17T05:47:00.915 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:00.913+0000 7f0b618f9640 1 -- 172.21.15.150:0/3445884002 >> 172.21.15.150:0/3445884002 conn(0x7f0b5c08bfe0 msgr2=0x7f0b5c0d4670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:47:00.915 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:00.913+0000 7f0b618f9640 1 -- 172.21.15.150:0/3445884002 shutdown_connections 2024-09-17T05:47:00.915 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:00.913+0000 7f0b618f9640 1 -- 172.21.15.150:0/3445884002 wait complete. 2024-09-17T05:47:00.915 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:00.915+0000 7f0b618f9640 1 Processor -- start 2024-09-17T05:47:00.916 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:00.915+0000 7f0b618f9640 1 -- start start 2024-09-17T05:47:00.918 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:00.917+0000 7f0b618f9640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0b48003c10 0x7f0b5c15b2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:47:00.918 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:00.917+0000 7f0b618f9640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0b5c1f4ff0 0x7f0b5c161480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:47:00.919 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:00.917+0000 7f0b618f9640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0b5c1f5400 0x7f0b5c1619c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:47:00.919 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:00.917+0000 7f0b618f9640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f0b5c0d0790 con 0x7f0b5c1f4ff0 2024-09-17T05:47:00.919 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:00.917+0000 7f0b618f9640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f0b5c0d0610 con 0x7f0b5c1f5400 2024-09-17T05:47:00.919 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:00.917+0000 7f0b618f9640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f0b5c0d2b90 con 0x7f0b48003c10 2024-09-17T05:47:00.919 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:00.917+0000 7f0b527fc640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0b5c1f4ff0 0x7f0b5c161480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:47:00.919 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:00.917+0000 7f0b527fc640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0b5c1f4ff0 0x7f0b5c161480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:37838/0 (socket says 172.21.15.150:37838) 2024-09-17T05:47:00.919 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:00.917+0000 7f0b527fc640 1 -- 172.21.15.150:0/2290742023 learned_addr learned my addr 172.21.15.150:0/2290742023 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:47:00.919 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:00.917+0000 7f0b5affd640 1 --2- 172.21.15.150:0/2290742023 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0b48003c10 0x7f0b5c15b2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:47:00.919 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:00.917+0000 7f0b5b7fe640 1 --2- 172.21.15.150:0/2290742023 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0b5c1f5400 0x7f0b5c1619c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:47:00.919 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:00.917+0000 7f0b527fc640 1 -- 172.21.15.150:0/2290742023 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0b48003c10 msgr2=0x7f0b5c15b2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:47:00.919 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:00.917+0000 7f0b527fc640 1 --2- 172.21.15.150:0/2290742023 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0b48003c10 0x7f0b5c15b2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:47:00.919 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:00.917+0000 7f0b527fc640 1 -- 172.21.15.150:0/2290742023 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0b5c1f5400 msgr2=0x7f0b5c1619c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:47:00.919 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:00.917+0000 7f0b527fc640 1 --2- 172.21.15.150:0/2290742023 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0b5c1f5400 0x7f0b5c1619c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:47:00.919 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:00.917+0000 7f0b527fc640 1 -- 172.21.15.150:0/2290742023 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0b5c1f59f0 con 0x7f0b5c1f4ff0 2024-09-17T05:47:00.920 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:00.917+0000 7f0b527fc640 1 --2- 172.21.15.150:0/2290742023 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0b5c1f4ff0 0x7f0b5c161480 secure :-1 s=READY pgs=824 cs=0 l=1 rev1=1 crypto rx=0x7f0b44004db0 tx=0x7f0b44001800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:47:00.920 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:00.917+0000 7f0b58ff9640 1 -- 172.21.15.150:0/2290742023 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b44010950 con 0x7f0b5c1f4ff0 2024-09-17T05:47:00.920 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:00.917+0000 7f0b58ff9640 1 -- 172.21.15.150:0/2290742023 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0b44016070 con 0x7f0b5c1f4ff0 2024-09-17T05:47:00.920 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:00.917+0000 7f0b618f9640 1 -- 172.21.15.150:0/2290742023 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0b5c1f5cd0 con 0x7f0b5c1f4ff0 2024-09-17T05:47:00.920 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:00.918+0000 7f0b58ff9640 1 -- 172.21.15.150:0/2290742023 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b44010e40 con 0x7f0b5c1f4ff0 2024-09-17T05:47:00.920 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:00.918+0000 7f0b618f9640 1 -- 172.21.15.150:0/2290742023 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0b5c1f6290 con 0x7f0b5c1f4ff0 2024-09-17T05:47:00.921 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:00.918+0000 7f0b618f9640 1 -- 172.21.15.150:0/2290742023 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0b5c0b7ec0 con 0x7f0b5c1f4ff0 2024-09-17T05:47:00.921 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:00.919+0000 7f0b58ff9640 1 -- 172.21.15.150:0/2290742023 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 19) ==== 102563+0+0 (secure 0 0 0) 0x7f0b4401b460 con 0x7f0b5c1f4ff0 2024-09-17T05:47:00.921 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:00.920+0000 7f0b58ff9640 1 --2- 172.21.15.150:0/2290742023 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f0b3c079820 0x7f0b3c07bd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:47:00.921 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:00.920+0000 7f0b58ff9640 1 -- 172.21.15.150:0/2290742023 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 5765+0+0 (secure 0 0 0) 0x7f0b44099fd0 con 0x7f0b5c1f4ff0 2024-09-17T05:47:00.921 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:00.920+0000 7f0b5affd640 1 --2- 172.21.15.150:0/2290742023 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f0b3c079820 0x7f0b3c07bd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:47:00.921 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:00.921+0000 7f0b5affd640 1 --2- 172.21.15.150:0/2290742023 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f0b3c079820 0x7f0b3c07bd30 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f0b4c035000 tx=0x7f0b4c02d040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:47:00.924 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:00.924+0000 7f0b58ff9640 1 -- 172.21.15.150:0/2290742023 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f0b44063f50 con 0x7f0b5c1f4ff0 2024-09-17T05:47:01.135 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:01.134+0000 7f0b618f9640 1 -- 172.21.15.150:0/2290742023 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f0b5c0d2d60 con 0x7f0b5c1f4ff0 2024-09-17T05:47:01.135 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:01.135+0000 7f0b58ff9640 1 -- 172.21.15.150:0/2290742023 <== mon.0 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 42 v42) ==== 94+0+5237 (secure 0 0 0) 0x7f0b44063850 con 0x7f0b5c1f4ff0 2024-09-17T05:47:01.136 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-09-17T05:47:01.136 INFO:teuthology.orchestra.run.smithi150.stdout:{"epoch":42,"btime":"2024-09-17T05:46:54:570307+0000","default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5639,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6836/3422557079","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6834","nonce":3422557079},{"type":"v1","addr":"172.21.15.176:6836","nonce":3422557079}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":38},{"gid":6070,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6837/2283556368","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6835","nonce":2283556368},{"type":"v1","addr":"172.21.15.176:6837","nonce":2283556368}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":38},{"gid":6495,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6834/4130242651","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6832","nonce":4130242651},{"type":"v1","addr":"172.21.15.150:6834","nonce":4130242651}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":37}],"filesystems":[{"mdsmap":{"epoch":42,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T05:46:50.910842+0000","modified":"2024-09-17T05:46:53.930100+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6498},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6498":{"gid":6498,"name":"a","rank":0,"incarnation":39,"state":"up:active","state_seq":3,"addr":"172.21.15.150:6835/4215563116","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6833","nonce":4215563116},{"type":"v1","addr":"172.21.15.150:6835","nonce":4215563116}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6498,"qdb_cluster":[6498]},"id":5}]} 2024-09-17T05:47:01.136 INFO:teuthology.orchestra.run.smithi150.stderr:dumped fsmap epoch 42 2024-09-17T05:47:01.138 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:01.137+0000 7f0b618f9640 1 -- 172.21.15.150:0/2290742023 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f0b3c079820 msgr2=0x7f0b3c07bd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:47:01.138 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:01.137+0000 7f0b618f9640 1 --2- 172.21.15.150:0/2290742023 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f0b3c079820 0x7f0b3c07bd30 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f0b4c035000 tx=0x7f0b4c02d040 comp rx=0 tx=0).stop 2024-09-17T05:47:01.138 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:01.137+0000 7f0b618f9640 1 -- 172.21.15.150:0/2290742023 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0b5c1f4ff0 msgr2=0x7f0b5c161480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:47:01.138 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:01.137+0000 7f0b618f9640 1 --2- 172.21.15.150:0/2290742023 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0b5c1f4ff0 0x7f0b5c161480 secure :-1 s=READY pgs=824 cs=0 l=1 rev1=1 crypto rx=0x7f0b44004db0 tx=0x7f0b44001800 comp rx=0 tx=0).stop 2024-09-17T05:47:01.138 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:01.137+0000 7f0b618f9640 1 -- 172.21.15.150:0/2290742023 shutdown_connections 2024-09-17T05:47:01.138 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:01.137+0000 7f0b618f9640 1 --2- 172.21.15.150:0/2290742023 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0b5c1f5400 0x7f0b5c1619c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:47:01.138 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:01.137+0000 7f0b618f9640 1 --2- 172.21.15.150:0/2290742023 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f0b3c079820 0x7f0b3c07bd30 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:47:01.138 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:01.137+0000 7f0b618f9640 1 --2- 172.21.15.150:0/2290742023 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0b5c1f4ff0 0x7f0b5c161480 unknown :-1 s=CLOSED pgs=824 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:47:01.138 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:01.137+0000 7f0b618f9640 1 --2- 172.21.15.150:0/2290742023 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0b48003c10 0x7f0b5c15b2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:47:01.138 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:01.137+0000 7f0b618f9640 1 -- 172.21.15.150:0/2290742023 >> 172.21.15.150:0/2290742023 conn(0x7f0b5c08bfe0 msgr2=0x7f0b5c0b80d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:47:01.138 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:01.137+0000 7f0b618f9640 1 -- 172.21.15.150:0/2290742023 shutdown_connections 2024-09-17T05:47:01.138 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:01.137+0000 7f0b618f9640 1 -- 172.21.15.150:0/2290742023 wait complete. 2024-09-17T05:47:01.553 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 42, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-17T05:46:50.910842+0000', 'modified': '2024-09-17T05:46:53.930100+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 6498}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_6498': {'gid': 6498, 'name': 'a', 'rank': 0, 'incarnation': 39, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.150:6835/4215563116', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.150:6833', 'nonce': 4215563116}, {'type': 'v1', 'addr': '172.21.15.150:6835', 'nonce': 4215563116}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [11], 'metadata_pool': 10, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 6498, 'qdb_cluster': [6498]} 2024-09-17T05:47:01.553 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-17T05:47:01.554 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2024-09-17T05:47:01.669 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:01.669+0000 7f8b40e0e640 1 -- 172.21.15.150:0/2648941701 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8b3c0c5b90 msgr2=0x7f8b3c0d02b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:47:01.670 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:01.669+0000 7f8b40e0e640 1 --2- 172.21.15.150:0/2648941701 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8b3c0c5b90 0x7f8b3c0d02b0 secure :-1 s=READY pgs=825 cs=0 l=1 rev1=1 crypto rx=0x7f8b3c09bf90 tx=0x7f8b2c02a530 comp rx=0 tx=0).stop 2024-09-17T05:47:01.670 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:01.669+0000 7f8b40e0e640 1 -- 172.21.15.150:0/2648941701 shutdown_connections 2024-09-17T05:47:01.670 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:01.669+0000 7f8b40e0e640 1 --2- 172.21.15.150:0/2648941701 >> v2:172.21.15.176:3300/0 conn(0x7f8b3c0d07f0 0x7f8b3c0b1da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:47:01.670 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:01.669+0000 7f8b40e0e640 1 --2- 172.21.15.150:0/2648941701 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8b3c0c5b90 0x7f8b3c0d02b0 unknown :-1 s=CLOSED pgs=825 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:47:01.670 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:01.669+0000 7f8b40e0e640 1 -- 172.21.15.150:0/2648941701 >> 172.21.15.150:0/2648941701 conn(0x7f8b3c0cef80 msgr2=0x7f8b3c0cf390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:47:01.670 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:01.669+0000 7f8b40e0e640 1 -- 172.21.15.150:0/2648941701 shutdown_connections 2024-09-17T05:47:01.670 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:01.669+0000 7f8b40e0e640 1 -- 172.21.15.150:0/2648941701 wait complete. 2024-09-17T05:47:01.671 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:01.671+0000 7f8b40e0e640 1 Processor -- start 2024-09-17T05:47:01.671 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:01.671+0000 7f8b40e0e640 1 -- start start 2024-09-17T05:47:01.674 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:01.672+0000 7f8b40e0e640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8b3c09ba60 0x7f8b3c0b6670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:47:01.674 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:01.672+0000 7f8b40e0e640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8b3c0c5b90 0x7f8b3c1571c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:47:01.674 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:01.672+0000 7f8b40e0e640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8b3c0d07f0 0x7f8b3c162330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:47:01.674 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:01.672+0000 7f8b40e0e640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f8b3c0b2b70 con 0x7f8b3c09ba60 2024-09-17T05:47:01.674 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:01.672+0000 7f8b40e0e640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f8b3c0b29f0 con 0x7f8b3c0c5b90 2024-09-17T05:47:01.674 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:01.672+0000 7f8b40e0e640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f8b3c0b2cf0 con 0x7f8b3c0d07f0 2024-09-17T05:47:01.674 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:01.672+0000 7f8b3a59c640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8b3c09ba60 0x7f8b3c0b6670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:47:01.674 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:01.672+0000 7f8b3a59c640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8b3c09ba60 0x7f8b3c0b6670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:37850/0 (socket says 172.21.15.150:37850) 2024-09-17T05:47:01.674 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:01.672+0000 7f8b3a59c640 1 -- 172.21.15.150:0/2097218418 learned_addr learned my addr 172.21.15.150:0/2097218418 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:47:01.674 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:01.672+0000 7f8b31d9b640 1 --2- 172.21.15.150:0/2097218418 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8b3c0c5b90 0x7f8b3c1571c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:47:01.675 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:01.672+0000 7f8b3ad9d640 1 --2- 172.21.15.150:0/2097218418 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8b3c0d07f0 0x7f8b3c162330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:47:01.675 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:01.672+0000 7f8b3a59c640 1 -- 172.21.15.150:0/2097218418 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8b3c0d07f0 msgr2=0x7f8b3c162330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:47:01.675 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:01.672+0000 7f8b3a59c640 1 --2- 172.21.15.150:0/2097218418 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8b3c0d07f0 0x7f8b3c162330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:47:01.675 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:01.672+0000 7f8b3a59c640 1 -- 172.21.15.150:0/2097218418 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8b3c0c5b90 msgr2=0x7f8b3c1571c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:47:01.675 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:01.672+0000 7f8b3a59c640 1 --2- 172.21.15.150:0/2097218418 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8b3c0c5b90 0x7f8b3c1571c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:47:01.675 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:01.672+0000 7f8b3a59c640 1 -- 172.21.15.150:0/2097218418 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8b3c15e6d0 con 0x7f8b3c09ba60 2024-09-17T05:47:01.675 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:01.672+0000 7f8b3ad9d640 1 --2- 172.21.15.150:0/2097218418 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8b3c0d07f0 0x7f8b3c162330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:47:01.675 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:01.673+0000 7f8b3a59c640 1 --2- 172.21.15.150:0/2097218418 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8b3c09ba60 0x7f8b3c0b6670 secure :-1 s=READY pgs=826 cs=0 l=1 rev1=1 crypto rx=0x7f8b2c0099a0 tx=0x7f8b2c0052f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:47:01.675 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:01.673+0000 7f8b337fe640 1 -- 172.21.15.150:0/2097218418 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b2c031b50 con 0x7f8b3c09ba60 2024-09-17T05:47:01.675 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:01.673+0000 7f8b337fe640 1 -- 172.21.15.150:0/2097218418 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8b2c031de0 con 0x7f8b3c09ba60 2024-09-17T05:47:01.676 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:01.673+0000 7f8b40e0e640 1 -- 172.21.15.150:0/2097218418 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8b3c159b20 con 0x7f8b3c09ba60 2024-09-17T05:47:01.676 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:01.673+0000 7f8b337fe640 1 -- 172.21.15.150:0/2097218418 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b2c033330 con 0x7f8b3c09ba60 2024-09-17T05:47:01.676 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:01.673+0000 7f8b40e0e640 1 -- 172.21.15.150:0/2097218418 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8b3c15a0e0 con 0x7f8b3c09ba60 2024-09-17T05:47:01.677 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:01.675+0000 7f8b337fe640 1 -- 172.21.15.150:0/2097218418 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 19) ==== 102563+0+0 (secure 0 0 0) 0x7f8b2c0334d0 con 0x7f8b3c09ba60 2024-09-17T05:47:01.677 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:01.675+0000 7f8b337fe640 1 --2- 172.21.15.150:0/2097218418 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f8b1c0797f0 0x7f8b1c07bd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:47:01.677 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:01.675+0000 7f8b337fe640 1 -- 172.21.15.150:0/2097218418 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 5765+0+0 (secure 0 0 0) 0x7f8b2c0bada0 con 0x7f8b3c09ba60 2024-09-17T05:47:01.677 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:01.675+0000 7f8b31d9b640 1 --2- 172.21.15.150:0/2097218418 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f8b1c0797f0 0x7f8b1c07bd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:47:01.677 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:01.676+0000 7f8b31d9b640 1 --2- 172.21.15.150:0/2097218418 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f8b1c0797f0 0x7f8b1c07bd00 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f8b240058c0 tx=0x7f8b24005f60 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:47:01.677 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:01.676+0000 7f8b47e55740 1 Processor -- start 2024-09-17T05:47:01.677 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:01.676+0000 7f8b47e55740 1 -- start start 2024-09-17T05:47:01.679 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:01.677+0000 7f8b47e55740 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5576c3149270 0x5576c351afa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:47:01.679 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:01.678+0000 7f8b47e55740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5576c31203b0 0x5576c351b4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:47:01.679 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:01.678+0000 7f8b47e55740 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x5576c3128590 0x5576c35383e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:47:01.679 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:01.678+0000 7f8b47e55740 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x5576c3463820 con 0x5576c3149270 2024-09-17T05:47:01.679 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:01.678+0000 7f8b47e55740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x5576c3452c50 con 0x5576c31203b0 2024-09-17T05:47:01.680 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:01.678+0000 7f8b47e55740 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x5576c3456a60 con 0x5576c3128590 2024-09-17T05:47:01.680 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:01.678+0000 7f8b3a59c640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5576c3149270 0x5576c351afa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:47:01.680 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:01.678+0000 7f8b3a59c640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5576c3149270 0x5576c351afa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:37866/0 (socket says 172.21.15.150:37866) 2024-09-17T05:47:01.680 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:01.678+0000 7f8b3a59c640 1 -- 172.21.15.150:0/2371446967 learned_addr learned my addr 172.21.15.150:0/2371446967 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:47:01.680 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:01.678+0000 7f8b3ad9d640 1 --2- 172.21.15.150:0/2371446967 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x5576c3128590 0x5576c35383e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:47:01.680 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:01.678+0000 7f8b31d9b640 1 --2- 172.21.15.150:0/2371446967 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5576c31203b0 0x5576c351b4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:47:01.680 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:01.678+0000 7f8b3a59c640 1 -- 172.21.15.150:0/2371446967 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x5576c3128590 msgr2=0x5576c35383e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:47:01.680 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:01.678+0000 7f8b3a59c640 1 --2- 172.21.15.150:0/2371446967 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x5576c3128590 0x5576c35383e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:47:01.680 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:01.678+0000 7f8b3a59c640 1 -- 172.21.15.150:0/2371446967 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5576c31203b0 msgr2=0x5576c351b4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:47:01.680 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:01.678+0000 7f8b3a59c640 1 --2- 172.21.15.150:0/2371446967 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5576c31203b0 0x5576c351b4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:47:01.680 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:01.678+0000 7f8b3a59c640 1 -- 172.21.15.150:0/2371446967 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5576c31b4850 con 0x5576c3149270 2024-09-17T05:47:01.680 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:01.678+0000 7f8b3ad9d640 1 --2- 172.21.15.150:0/2371446967 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x5576c3128590 0x5576c35383e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T05:47:01.680 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:01.678+0000 7f8b31d9b640 1 --2- 172.21.15.150:0/2371446967 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5576c31203b0 0x5576c351b4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T05:47:01.681 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:01.678+0000 7f8b3a59c640 1 --2- 172.21.15.150:0/2371446967 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5576c3149270 0x5576c351afa0 secure :-1 s=READY pgs=827 cs=0 l=1 rev1=1 crypto rx=0x7f8b2c0bb180 tx=0x7f8b2c083e00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a5bf027c277ee30c server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:47:01.681 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:01.678+0000 7f8b1bfff640 1 -- 172.21.15.150:0/2371446967 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b2c08d040 con 0x5576c3149270 2024-09-17T05:47:01.681 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:01.678+0000 7f8b1bfff640 1 -- 172.21.15.150:0/2371446967 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8b2c084800 con 0x5576c3149270 2024-09-17T05:47:01.681 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:01.678+0000 7f8b1bfff640 1 -- 172.21.15.150:0/2371446967 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b2c08db00 con 0x5576c3149270 2024-09-17T05:47:01.684 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:01.679+0000 7f8b47e55740 1 -- 172.21.15.150:0/2371446967 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5576c3149270 msgr2=0x5576c351afa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:47:01.684 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:01.679+0000 7f8b47e55740 1 --2- 172.21.15.150:0/2371446967 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5576c3149270 0x5576c351afa0 secure :-1 s=READY pgs=827 cs=0 l=1 rev1=1 crypto rx=0x7f8b2c0bb180 tx=0x7f8b2c083e00 comp rx=0 tx=0).stop 2024-09-17T05:47:01.684 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:01.679+0000 7f8b47e55740 1 -- 172.21.15.150:0/2371446967 shutdown_connections 2024-09-17T05:47:01.684 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:01.679+0000 7f8b47e55740 1 --2- 172.21.15.150:0/2371446967 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5576c31203b0 0x5576c351b4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:47:01.684 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:01.679+0000 7f8b47e55740 1 --2- 172.21.15.150:0/2371446967 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x5576c3128590 0x5576c35383e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:47:01.685 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:01.679+0000 7f8b47e55740 1 --2- 172.21.15.150:0/2371446967 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5576c3149270 0x5576c351afa0 unknown :-1 s=CLOSED pgs=827 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:47:01.685 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:01.679+0000 7f8b47e55740 1 -- 172.21.15.150:0/2371446967 >> 172.21.15.150:0/2371446967 conn(0x5576c313d3c0 msgr2=0x5576c34f1260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:47:01.685 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:01.679+0000 7f8b47e55740 1 -- 172.21.15.150:0/2371446967 shutdown_connections 2024-09-17T05:47:01.685 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:01.679+0000 7f8b47e55740 1 -- 172.21.15.150:0/2371446967 wait complete. 2024-09-17T05:47:01.685 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:01.680+0000 7f8b47e55740 1 -- start start 2024-09-17T05:47:01.685 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:01.680+0000 7f8b47e55740 1 Processor -- start 2024-09-17T05:47:01.685 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:01.682+0000 7f8b47e55740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5576c31203b0 0x5576c35491a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:47:01.685 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:01.682+0000 7f8b47e55740 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5576c3128590 0x5576c35365b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:47:01.685 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:01.682+0000 7f8b47e55740 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x5576c3149270 0x5576c3509830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:47:01.685 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:01.682+0000 7f8b47e55740 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x5576c31c3620 con 0x5576c3128590 2024-09-17T05:47:01.685 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:01.682+0000 7f8b47e55740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x5576c33f85f0 con 0x5576c31203b0 2024-09-17T05:47:01.685 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:01.682+0000 7f8b47e55740 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x5576c3463820 con 0x5576c3149270 2024-09-17T05:47:01.685 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:01.682+0000 7f8b47e55740 10 client.0 _ll_register_callbacks cb 0x5576c33fc0a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T05:47:01.686 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:01.682+0000 7f8b31d9b640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5576c3128590 0x5576c35365b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:47:01.686 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:01.682+0000 7f8b31d9b640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5576c3128590 0x5576c35365b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:37872/0 (socket says 172.21.15.150:37872) 2024-09-17T05:47:01.686 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:01.682+0000 7f8b31d9b640 1 -- 172.21.15.150:0/2795279321 learned_addr learned my addr 172.21.15.150:0/2795279321 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:47:01.686 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:01.682+0000 7f8b3ad9d640 1 --2- 172.21.15.150:0/2795279321 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x5576c3149270 0x5576c3509830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:47:01.686 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:01.682+0000 7f8b3a59c640 1 --2- 172.21.15.150:0/2795279321 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5576c31203b0 0x5576c35491a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:47:01.686 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:01.682+0000 7f8b31d9b640 1 -- 172.21.15.150:0/2795279321 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x5576c3149270 msgr2=0x5576c3509830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:47:01.686 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:01.682+0000 7f8b31d9b640 1 --2- 172.21.15.150:0/2795279321 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x5576c3149270 0x5576c3509830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:47:01.686 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:01.682+0000 7f8b31d9b640 1 -- 172.21.15.150:0/2795279321 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5576c31203b0 msgr2=0x5576c35491a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:47:01.686 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:01.682+0000 7f8b31d9b640 1 --2- 172.21.15.150:0/2795279321 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5576c31203b0 0x5576c35491a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:47:01.686 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:01.682+0000 7f8b31d9b640 1 -- 172.21.15.150:0/2795279321 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5576c322b6b0 con 0x5576c3128590 2024-09-17T05:47:01.686 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:01.682+0000 7f8b3a59c640 1 --2- 172.21.15.150:0/2795279321 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5576c31203b0 0x5576c35491a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:47:01.686 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:01.682+0000 7f8b31d9b640 1 --2- 172.21.15.150:0/2795279321 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5576c3128590 0x5576c35365b0 secure :-1 s=READY pgs=828 cs=0 l=1 rev1=1 crypto rx=0x7f8b240109e0 tx=0x7f8b24004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c1681a02ad6a2319 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:47:01.686 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:01.682+0000 7f8b197fa640 10 client.0 ms_handle_connect on v2:172.21.15.150:3300/0 2024-09-17T05:47:01.686 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:01.683+0000 7f8b197fa640 1 -- 172.21.15.150:0/2795279321 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b24029060 con 0x5576c3128590 2024-09-17T05:47:01.687 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:01.683+0000 7f8b197fa640 1 -- 172.21.15.150:0/2795279321 <== mon.0 v2:172.21.15.150:3300/0 2 ==== osd_map(72..72 src has 1..72) ==== 5765+0+0 (secure 0 0 0) 0x7f8b2401c8f0 con 0x5576c3128590 2024-09-17T05:47:01.687 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:01.683+0000 7f8b47e55740 1 -- 172.21.15.150:0/2795279321 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8b2c084800 con 0x5576c3128590 2024-09-17T05:47:01.687 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:01.683+0000 7f8b197fa640 1 -- 172.21.15.150:0/2795279321 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_get_version_reply(handle=1 version=42) ==== 24+0+0 (secure 0 0 0) 0x7f8b2402f050 con 0x5576c3128590 2024-09-17T05:47:01.687 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:01.683+0000 7f8b47e55740 10 client.6669 fetch_fsmap learned FSMap version 42 2024-09-17T05:47:01.687 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:01.683+0000 7f8b47e55740 1 -- 172.21.15.150:0/2795279321 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,fsmap=42,monmap=2+}) -- 0x5576c352f6c0 con 0x5576c3128590 2024-09-17T05:47:01.687 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:01.683+0000 7f8b197fa640 1 -- 172.21.15.150:0/2795279321 <== mon.0 v2:172.21.15.150:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8b2c084800 con 0x5576c3128590 2024-09-17T05:47:01.687 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:01.683+0000 7f8b197fa640 1 -- 172.21.15.150:0/2795279321 <== mon.0 v2:172.21.15.150:3300/0 5 ==== fsmap(e 42) ==== 3502+0+0 (secure 0 0 0) 0x7f8b24032020 con 0x5576c3128590 2024-09-17T05:47:01.687 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:01.683+0000 7f8b47e55740 10 client.6669 fetch_fsmap finished waiting for FSMap version 42 2024-09-17T05:47:01.687 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:01.683+0000 7f8b47e55740 10 client.6669 resolve_mds: resolved name 'a' to daemon mds.a 2024-09-17T05:47:01.687 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:01.683+0000 7f8b47e55740 20 client.6669 populate_metadata read hostname 'smithi150' 2024-09-17T05:47:01.687 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:01.683+0000 7f8b47e55740 1 --2- 172.21.15.150:0/2795279321 >> [v2:172.21.15.150:6833/4215563116,v1:172.21.15.150:6835/4215563116] conn(0x5576c3107e40 0x5576c352e660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:47:01.687 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:01.683+0000 7f8b47e55740 4 client.6669 mds_command: new command op to 6498 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-17T05:47:01.687 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:01.683+0000 7f8b47e55740 1 -- 172.21.15.150:0/2795279321 --> [v2:172.21.15.150:6833/4215563116,v1:172.21.15.150:6835/4215563116] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5576c3465770 con 0x5576c3107e40 2024-09-17T05:47:01.687 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:01.683+0000 7f8b3a59c640 1 --2- 172.21.15.150:0/2795279321 >> [v2:172.21.15.150:6833/4215563116,v1:172.21.15.150:6835/4215563116] conn(0x5576c3107e40 0x5576c352e660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:47:01.688 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:01.684+0000 7f8b197fa640 10 client.6669 ms_handle_connect on v2:172.21.15.150:6833/4215563116 2024-09-17T05:47:01.688 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:01.684+0000 7f8b3a59c640 1 --2- 172.21.15.150:0/2795279321 >> [v2:172.21.15.150:6833/4215563116,v1:172.21.15.150:6835/4215563116] conn(0x5576c3107e40 0x5576c352e660 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=60d94288abdac08b server_cookie=c31e9bf010a83c02 in_seq=0 out_seq=0 2024-09-17T05:47:01.689 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:01.684+0000 7f8b197fa640 1 -- 172.21.15.150:0/2795279321 <== mds.0 v2:172.21.15.150:6833/4215563116 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5576c3465770 con 0x5576c3107e40 2024-09-17T05:47:01.689 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:01.684+0000 7f8b197fa640 10 client.6669 handle_command_reply: tid=0 2024-09-17T05:47:01.689 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:01.684+0000 7f8b47e55740 1 client.6669 shutdown 2024-09-17T05:47:01.689 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:01.684+0000 7f8b47e55740 1 -- 172.21.15.150:0/2795279321 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5576c3128590 msgr2=0x5576c35365b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:47:01.689 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:01.684+0000 7f8b47e55740 1 --2- 172.21.15.150:0/2795279321 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5576c3128590 0x5576c35365b0 secure :-1 s=READY pgs=828 cs=0 l=1 rev1=1 crypto rx=0x7f8b240109e0 tx=0x7f8b24004730 comp rx=0 tx=0).stop 2024-09-17T05:47:01.689 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:01.685+0000 7f8b47e55740 1 -- 172.21.15.150:0/2795279321 shutdown_connections 2024-09-17T05:47:01.689 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:01.685+0000 7f8b47e55740 1 --2- 172.21.15.150:0/2795279321 >> [v2:172.21.15.150:6833/4215563116,v1:172.21.15.150:6835/4215563116] conn(0x5576c3107e40 0x5576c352e660 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:47:01.689 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:01.685+0000 7f8b47e55740 1 --2- 172.21.15.150:0/2795279321 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x5576c3149270 0x5576c3509830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:47:01.689 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:01.685+0000 7f8b47e55740 1 --2- 172.21.15.150:0/2795279321 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5576c3128590 0x5576c35365b0 unknown :-1 s=CLOSED pgs=828 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:47:01.690 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:01.685+0000 7f8b47e55740 1 --2- 172.21.15.150:0/2795279321 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5576c31203b0 0x5576c35491a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:47:01.690 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:01.685+0000 7f8b197fa640 0 client.6669 ms_handle_reset on v2:172.21.15.150:6833/4215563116 2024-09-17T05:47:01.690 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:01.685+0000 7f8b47e55740 1 -- 172.21.15.150:0/2795279321 >> 172.21.15.150:0/2795279321 conn(0x5576c313d3c0 msgr2=0x5576c350b090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:47:01.690 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:01.685+0000 7f8b47e55740 1 -- 172.21.15.150:0/2795279321 shutdown_connections 2024-09-17T05:47:01.690 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:01.685+0000 7f8b47e55740 1 -- 172.21.15.150:0/2795279321 wait complete. 2024-09-17T05:47:01.690 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:01.685+0000 7f8b47e55740 20 client.6669 trim_cache size 0 max 16384 2024-09-17T05:47:01.704 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:01.703+0000 7f8b47e55740 1 Processor -- start 2024-09-17T05:47:01.704 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:01.703+0000 7f8b47e55740 1 -- start start 2024-09-17T05:47:01.706 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:01.704+0000 7f8b47e55740 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5576c31203b0 0x5576c35361b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:47:01.706 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:01.704+0000 7f8b47e55740 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x5576c3128590 0x5576c3558df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:47:01.706 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:01.704+0000 7f8b47e55740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5576c3149270 0x5576c3559330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:47:01.706 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:01.704+0000 7f8b47e55740 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f8b3c15fe20 con 0x5576c31203b0 2024-09-17T05:47:01.706 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:01.704+0000 7f8b47e55740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f8b3c0b6000 con 0x5576c3149270 2024-09-17T05:47:01.706 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:01.704+0000 7f8b47e55740 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f8b3c15f7d0 con 0x5576c3128590 2024-09-17T05:47:01.706 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:01.704+0000 7f8b3a59c640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5576c31203b0 0x5576c35361b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:47:01.706 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:01.704+0000 7f8b3a59c640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5576c31203b0 0x5576c35361b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:37886/0 (socket says 172.21.15.150:37886) 2024-09-17T05:47:01.706 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:01.704+0000 7f8b3a59c640 1 -- 172.21.15.150:0/3559798112 learned_addr learned my addr 172.21.15.150:0/3559798112 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:47:01.706 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:01.705+0000 7f8b3a59c640 1 -- 172.21.15.150:0/3559798112 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x5576c3128590 msgr2=0x5576c3558df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:47:01.706 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:01.705+0000 7f8b3a59c640 1 --2- 172.21.15.150:0/3559798112 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x5576c3128590 0x5576c3558df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:47:01.707 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:01.705+0000 7f8b3a59c640 1 -- 172.21.15.150:0/3559798112 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5576c3149270 msgr2=0x5576c3559330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:47:01.707 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:01.705+0000 7f8b3a59c640 1 --2- 172.21.15.150:0/3559798112 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5576c3149270 0x5576c3559330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:47:01.707 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:01.705+0000 7f8b3a59c640 1 -- 172.21.15.150:0/3559798112 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5576c352f890 con 0x5576c31203b0 2024-09-17T05:47:01.707 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:01.705+0000 7f8b3a59c640 1 --2- 172.21.15.150:0/3559798112 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5576c31203b0 0x5576c35361b0 secure :-1 s=READY pgs=829 cs=0 l=1 rev1=1 crypto rx=0x7f8b2c0840a0 tx=0x7f8b2c06d040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=44dd10dc87890279 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:47:01.707 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:01.705+0000 7f8b1b7fe640 1 -- 172.21.15.150:0/3559798112 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b2c0a3070 con 0x5576c31203b0 2024-09-17T05:47:01.707 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:01.705+0000 7f8b1b7fe640 1 -- 172.21.15.150:0/3559798112 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8b2c09e030 con 0x5576c31203b0 2024-09-17T05:47:01.707 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:01.705+0000 7f8b1b7fe640 1 -- 172.21.15.150:0/3559798112 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b2c08d040 con 0x5576c31203b0 2024-09-17T05:47:01.708 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:01.706+0000 7f8b47e55740 1 -- 172.21.15.150:0/3559798112 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5576c31203b0 msgr2=0x5576c35361b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:47:01.708 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:01.706+0000 7f8b47e55740 1 --2- 172.21.15.150:0/3559798112 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5576c31203b0 0x5576c35361b0 secure :-1 s=READY pgs=829 cs=0 l=1 rev1=1 crypto rx=0x7f8b2c0840a0 tx=0x7f8b2c06d040 comp rx=0 tx=0).stop 2024-09-17T05:47:01.708 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:01.706+0000 7f8b47e55740 1 -- 172.21.15.150:0/3559798112 shutdown_connections 2024-09-17T05:47:01.708 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:01.706+0000 7f8b47e55740 1 --2- 172.21.15.150:0/3559798112 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5576c3149270 0x5576c3559330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:47:01.708 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:01.706+0000 7f8b47e55740 1 --2- 172.21.15.150:0/3559798112 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x5576c3128590 0x5576c3558df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:47:01.708 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:01.706+0000 7f8b47e55740 1 --2- 172.21.15.150:0/3559798112 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5576c31203b0 0x5576c35361b0 unknown :-1 s=CLOSED pgs=829 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:47:01.708 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:01.706+0000 7f8b47e55740 1 -- 172.21.15.150:0/3559798112 >> 172.21.15.150:0/3559798112 conn(0x5576c313d3c0 msgr2=0x5576c34e6990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:47:01.709 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:01.706+0000 7f8b47e55740 1 -- 172.21.15.150:0/3559798112 shutdown_connections 2024-09-17T05:47:01.709 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:01.706+0000 7f8b47e55740 1 -- 172.21.15.150:0/3559798112 wait complete. 2024-09-17T05:47:01.709 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:01.707+0000 7f8b47e55740 1 -- start start 2024-09-17T05:47:01.709 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:01.707+0000 7f8b47e55740 1 Processor -- start 2024-09-17T05:47:01.712 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:01.708+0000 7f8b47e55740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5576c31203b0 0x5576c35b5160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:47:01.713 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:01.708+0000 7f8b47e55740 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5576c3128590 0x5576c3508c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:47:01.713 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:01.708+0000 7f8b47e55740 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x5576c3149270 0x5576c35091b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:47:01.713 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:01.708+0000 7f8b47e55740 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x5576c3538940 con 0x5576c3128590 2024-09-17T05:47:01.713 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:01.708+0000 7f8b47e55740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x5576c3509e80 con 0x5576c31203b0 2024-09-17T05:47:01.713 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:01.708+0000 7f8b47e55740 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x5576c352cef0 con 0x5576c3149270 2024-09-17T05:47:01.713 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:01.708+0000 7f8b47e55740 10 client.0 _ll_register_callbacks cb 0x7f8b24005c80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T05:47:01.714 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:01.708+0000 7f8b31d9b640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5576c3128590 0x5576c3508c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:47:01.714 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:01.708+0000 7f8b31d9b640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5576c3128590 0x5576c3508c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:37894/0 (socket says 172.21.15.150:37894) 2024-09-17T05:47:01.714 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:01.708+0000 7f8b31d9b640 1 -- 172.21.15.150:0/2743079268 learned_addr learned my addr 172.21.15.150:0/2743079268 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:47:01.714 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:01.708+0000 7f8b3ad9d640 1 --2- 172.21.15.150:0/2743079268 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x5576c3149270 0x5576c35091b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:47:01.715 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:01.708+0000 7f8b3a59c640 1 --2- 172.21.15.150:0/2743079268 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5576c31203b0 0x5576c35b5160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:47:01.715 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:01.709+0000 7f8b31d9b640 1 -- 172.21.15.150:0/2743079268 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x5576c3149270 msgr2=0x5576c35091b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:47:01.715 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:01.709+0000 7f8b31d9b640 1 --2- 172.21.15.150:0/2743079268 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x5576c3149270 0x5576c35091b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:47:01.715 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:01.709+0000 7f8b31d9b640 1 -- 172.21.15.150:0/2743079268 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5576c31203b0 msgr2=0x5576c35b5160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:47:01.715 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:01.709+0000 7f8b31d9b640 1 --2- 172.21.15.150:0/2743079268 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5576c31203b0 0x5576c35b5160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:47:01.715 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:01.709+0000 7f8b31d9b640 1 -- 172.21.15.150:0/2743079268 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5576c34e6f20 con 0x5576c3128590 2024-09-17T05:47:01.715 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:01.709+0000 7f8b31d9b640 1 --2- 172.21.15.150:0/2743079268 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5576c3128590 0x5576c3508c70 secure :-1 s=READY pgs=830 cs=0 l=1 rev1=1 crypto rx=0x7f8b240109b0 tx=0x7f8b2401a6e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=df359bbff435baf2 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:47:01.715 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:01.709+0000 7f8b197fa640 10 client.0 ms_handle_connect on v2:172.21.15.150:3300/0 2024-09-17T05:47:01.715 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:01.709+0000 7f8b197fa640 1 -- 172.21.15.150:0/2743079268 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b24016070 con 0x5576c3128590 2024-09-17T05:47:01.715 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:01.709+0000 7f8b197fa640 1 -- 172.21.15.150:0/2743079268 <== mon.0 v2:172.21.15.150:3300/0 2 ==== osd_map(72..72 src has 1..72) ==== 5765+0+0 (secure 0 0 0) 0x7f8b2401ace0 con 0x5576c3128590 2024-09-17T05:47:01.716 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:01.709+0000 7f8b47e55740 1 -- 172.21.15.150:0/2743079268 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8b2c09e030 con 0x5576c3128590 2024-09-17T05:47:01.716 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:01.709+0000 7f8b197fa640 1 -- 172.21.15.150:0/2743079268 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_get_version_reply(handle=1 version=42) ==== 24+0+0 (secure 0 0 0) 0x7f8b24040050 con 0x5576c3128590 2024-09-17T05:47:01.716 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:01.709+0000 7f8b47e55740 10 client.6675 fetch_fsmap learned FSMap version 42 2024-09-17T05:47:01.716 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:01.709+0000 7f8b47e55740 1 -- 172.21.15.150:0/2743079268 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,fsmap=42,monmap=2+}) -- 0x5576c35444e0 con 0x5576c3128590 2024-09-17T05:47:01.716 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:01.709+0000 7f8b197fa640 1 -- 172.21.15.150:0/2743079268 <== mon.0 v2:172.21.15.150:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8b2c09e030 con 0x5576c3128590 2024-09-17T05:47:01.716 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:01.709+0000 7f8b197fa640 1 -- 172.21.15.150:0/2743079268 <== mon.0 v2:172.21.15.150:3300/0 5 ==== fsmap(e 42) ==== 3502+0+0 (secure 0 0 0) 0x7f8b24043020 con 0x5576c3128590 2024-09-17T05:47:01.716 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:01.709+0000 7f8b47e55740 10 client.6675 fetch_fsmap finished waiting for FSMap version 42 2024-09-17T05:47:01.716 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:01.709+0000 7f8b47e55740 10 client.6675 resolve_mds: resolved name 'a' to daemon mds.a 2024-09-17T05:47:01.716 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:01.709+0000 7f8b47e55740 20 client.6675 populate_metadata read hostname 'smithi150' 2024-09-17T05:47:01.716 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:01.709+0000 7f8b47e55740 1 --2- 172.21.15.150:0/2743079268 >> [v2:172.21.15.150:6833/4215563116,v1:172.21.15.150:6835/4215563116] conn(0x5576c352e5e0 0x5576c352e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:47:01.716 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:01.709+0000 7f8b47e55740 4 client.6675 mds_command: new command op to 6498 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-17T05:47:01.717 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:01.709+0000 7f8b47e55740 1 -- 172.21.15.150:0/2743079268 --> [v2:172.21.15.150:6833/4215563116,v1:172.21.15.150:6835/4215563116] -- command(tid 0: {"prefix": "status"}) -- 0x5576c3532640 con 0x5576c352e5e0 2024-09-17T05:47:01.717 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:01.710+0000 7f8b3a59c640 1 --2- 172.21.15.150:0/2743079268 >> [v2:172.21.15.150:6833/4215563116,v1:172.21.15.150:6835/4215563116] conn(0x5576c352e5e0 0x5576c352e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:47:01.717 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:01.710+0000 7f8b197fa640 10 client.6675 ms_handle_connect on v2:172.21.15.150:6833/4215563116 2024-09-17T05:47:01.717 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:01.710+0000 7f8b3a59c640 1 --2- 172.21.15.150:0/2743079268 >> [v2:172.21.15.150:6833/4215563116,v1:172.21.15.150:6835/4215563116] conn(0x5576c352e5e0 0x5576c352e9f0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1db6cf7823030277 server_cookie=e54cc0dd8ee4d5de in_seq=0 out_seq=0 2024-09-17T05:47:01.717 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:01.710+0000 7f8b197fa640 1 -- 172.21.15.150:0/2743079268 <== mds.0 v2:172.21.15.150:6833/4215563116 1 ==== command_reply(tid 0: 0 ) ==== 8+0+325 (crc 0 0 0) 0x5576c3532640 con 0x5576c352e5e0 2024-09-17T05:47:01.717 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:01.710+0000 7f8b197fa640 10 client.6675 handle_command_reply: tid=0 2024-09-17T05:47:01.717 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:01.710+0000 7f8b47e55740 1 client.6675 shutdown 2024-09-17T05:47:01.717 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:01.710+0000 7f8b47e55740 1 -- 172.21.15.150:0/2743079268 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5576c3128590 msgr2=0x5576c3508c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:47:01.717 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:01.710+0000 7f8b47e55740 1 --2- 172.21.15.150:0/2743079268 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5576c3128590 0x5576c3508c70 secure :-1 s=READY pgs=830 cs=0 l=1 rev1=1 crypto rx=0x7f8b240109b0 tx=0x7f8b2401a6e0 comp rx=0 tx=0).stop 2024-09-17T05:47:01.717 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:01.711+0000 7f8b47e55740 1 -- 172.21.15.150:0/2743079268 shutdown_connections 2024-09-17T05:47:01.718 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:01.711+0000 7f8b47e55740 1 --2- 172.21.15.150:0/2743079268 >> [v2:172.21.15.150:6833/4215563116,v1:172.21.15.150:6835/4215563116] conn(0x5576c352e5e0 0x5576c352e9f0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:47:01.718 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:01.711+0000 7f8b47e55740 1 --2- 172.21.15.150:0/2743079268 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x5576c3149270 0x5576c35091b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:47:01.718 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:01.711+0000 7f8b47e55740 1 --2- 172.21.15.150:0/2743079268 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5576c3128590 0x5576c3508c70 unknown :-1 s=CLOSED pgs=830 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:47:01.718 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:01.711+0000 7f8b197fa640 0 client.6675 ms_handle_reset on v2:172.21.15.150:6833/4215563116 2024-09-17T05:47:01.718 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:01.711+0000 7f8b47e55740 1 --2- 172.21.15.150:0/2743079268 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5576c31203b0 0x5576c35b5160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:47:01.718 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:01.711+0000 7f8b47e55740 1 -- 172.21.15.150:0/2743079268 >> 172.21.15.150:0/2743079268 conn(0x5576c313d3c0 msgr2=0x5576c351afe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:47:01.718 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:01.711+0000 7f8b47e55740 1 -- 172.21.15.150:0/2743079268 shutdown_connections 2024-09-17T05:47:01.718 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:01.711+0000 7f8b47e55740 1 -- 172.21.15.150:0/2743079268 wait complete. 2024-09-17T05:47:01.718 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:01.711+0000 7f8b47e55740 20 client.6675 trim_cache size 0 max 16384 2024-09-17T05:47:01.719 INFO:teuthology.orchestra.run.smithi150.stdout:{ 2024-09-17T05:47:01.719 INFO:teuthology.orchestra.run.smithi150.stdout: "cluster_fsid": "9f2e05e9-d629-47b3-b26b-1360655b7d20", 2024-09-17T05:47:01.719 INFO:teuthology.orchestra.run.smithi150.stdout: "whoami": 0, 2024-09-17T05:47:01.719 INFO:teuthology.orchestra.run.smithi150.stdout: "id": 6498, 2024-09-17T05:47:01.719 INFO:teuthology.orchestra.run.smithi150.stdout: "want_state": "up:active", 2024-09-17T05:47:01.719 INFO:teuthology.orchestra.run.smithi150.stdout: "state": "up:active", 2024-09-17T05:47:01.719 INFO:teuthology.orchestra.run.smithi150.stdout: "fs_name": "cephfs", 2024-09-17T05:47:01.720 INFO:teuthology.orchestra.run.smithi150.stdout: "rank_uptime": 10.150411909000001, 2024-09-17T05:47:01.720 INFO:teuthology.orchestra.run.smithi150.stdout: "mdsmap_epoch": 42, 2024-09-17T05:47:01.720 INFO:teuthology.orchestra.run.smithi150.stdout: "osdmap_epoch": 72, 2024-09-17T05:47:01.720 INFO:teuthology.orchestra.run.smithi150.stdout: "osdmap_epoch_barrier": 72, 2024-09-17T05:47:01.720 INFO:teuthology.orchestra.run.smithi150.stdout: "uptime": 14.833191864 2024-09-17T05:47:01.720 INFO:teuthology.orchestra.run.smithi150.stdout:} 2024-09-17T05:47:01.721 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:01.711+0000 7f8b40e0e640 1 -- 172.21.15.150:0/2097218418 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f8b1c0797f0 msgr2=0x7f8b1c07bd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:47:01.721 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:01.711+0000 7f8b40e0e640 1 --2- 172.21.15.150:0/2097218418 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f8b1c0797f0 0x7f8b1c07bd00 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f8b240058c0 tx=0x7f8b24005f60 comp rx=0 tx=0).stop 2024-09-17T05:47:01.721 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:01.711+0000 7f8b40e0e640 1 -- 172.21.15.150:0/2097218418 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8b3c09ba60 msgr2=0x7f8b3c0b6670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:47:01.721 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:01.711+0000 7f8b40e0e640 1 --2- 172.21.15.150:0/2097218418 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8b3c09ba60 0x7f8b3c0b6670 secure :-1 s=READY pgs=826 cs=0 l=1 rev1=1 crypto rx=0x7f8b2c0099a0 tx=0x7f8b2c0052f0 comp rx=0 tx=0).stop 2024-09-17T05:47:01.721 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:01.711+0000 7f8b40e0e640 1 -- 172.21.15.150:0/2097218418 shutdown_connections 2024-09-17T05:47:01.721 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:01.711+0000 7f8b40e0e640 1 --2- 172.21.15.150:0/2097218418 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8b3c0c5b90 0x7f8b3c1571c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:47:01.721 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:01.711+0000 7f8b40e0e640 1 --2- 172.21.15.150:0/2097218418 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f8b1c0797f0 0x7f8b1c07bd00 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:47:01.722 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:01.711+0000 7f8b40e0e640 1 --2- 172.21.15.150:0/2097218418 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8b3c0d07f0 0x7f8b3c162330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:47:01.722 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:01.711+0000 7f8b40e0e640 1 --2- 172.21.15.150:0/2097218418 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8b3c09ba60 0x7f8b3c0b6670 unknown :-1 s=CLOSED pgs=826 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:47:01.722 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:01.711+0000 7f8b40e0e640 1 -- 172.21.15.150:0/2097218418 >> 172.21.15.150:0/2097218418 conn(0x7f8b3c0cef80 msgr2=0x7f8b3c0cd0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:47:01.722 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:01.711+0000 7f8b40e0e640 1 -- 172.21.15.150:0/2097218418 shutdown_connections 2024-09-17T05:47:01.722 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:01.711+0000 7f8b40e0e640 1 -- 172.21.15.150:0/2097218418 wait complete. 2024-09-17T05:47:01.723 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-17T05:47:01.838 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:01.836+0000 7fa60f962640 1 -- 172.21.15.150:0/636107959 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa5f4003a50 msgr2=0x7fa5f4003ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:47:01.838 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:01.836+0000 7fa60f962640 1 --2- 172.21.15.150:0/636107959 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa5f4003a50 0x7fa5f4003ec0 secure :-1 s=READY pgs=832 cs=0 l=1 rev1=1 crypto rx=0x7fa604009cf0 tx=0x7fa5f4005830 comp rx=0 tx=0).stop 2024-09-17T05:47:01.838 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:01.837+0000 7fa60f962640 1 -- 172.21.15.150:0/636107959 shutdown_connections 2024-09-17T05:47:01.838 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:01.837+0000 7fa60f962640 1 --2- 172.21.15.150:0/636107959 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa5f4003a50 0x7fa5f4003ec0 unknown :-1 s=CLOSED pgs=832 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:47:01.838 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:01.837+0000 7fa60f962640 1 -- 172.21.15.150:0/636107959 >> 172.21.15.150:0/636107959 conn(0x7fa6080cee90 msgr2=0x7fa6080cf2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:47:01.838 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:01.837+0000 7fa60f962640 1 -- 172.21.15.150:0/636107959 shutdown_connections 2024-09-17T05:47:01.839 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:01.837+0000 7fa60f962640 1 -- 172.21.15.150:0/636107959 wait complete. 2024-09-17T05:47:01.839 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:01.838+0000 7fa60f962640 1 Processor -- start 2024-09-17T05:47:01.839 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:01.839+0000 7fa60f962640 1 -- start start 2024-09-17T05:47:01.842 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:01.840+0000 7fa60f962640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa5f4003a50 0x7fa6080b29b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:47:01.842 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:01.840+0000 7fa60f962640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa6081f72b0 0x7fa6081f76c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:47:01.842 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:01.840+0000 7fa60f962640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa60809f4c0 0x7fa60809f8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:47:01.842 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:01.840+0000 7fa60f962640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7fa6080b76c0 con 0x7fa60809f4c0 2024-09-17T05:47:01.842 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:01.840+0000 7fa60f962640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fa6080b7540 con 0x7fa5f4003a50 2024-09-17T05:47:01.842 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:01.840+0000 7fa60f962640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fa6080d1590 con 0x7fa6081f72b0 2024-09-17T05:47:01.842 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:01.840+0000 7fa60deff640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa60809f4c0 0x7fa60809f8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:47:01.843 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:01.840+0000 7fa60deff640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa60809f4c0 0x7fa60809f8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:37914/0 (socket says 172.21.15.150:37914) 2024-09-17T05:47:01.843 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:01.840+0000 7fa60deff640 1 -- 172.21.15.150:0/3720613079 learned_addr learned my addr 172.21.15.150:0/3720613079 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:47:01.843 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:01.840+0000 7fa60cefd640 1 --2- 172.21.15.150:0/3720613079 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa6081f72b0 0x7fa6081f76c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:47:01.843 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:01.840+0000 7fa60d6fe640 1 --2- 172.21.15.150:0/3720613079 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa5f4003a50 0x7fa6080b29b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:47:01.843 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:01.840+0000 7fa60deff640 1 -- 172.21.15.150:0/3720613079 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa6081f72b0 msgr2=0x7fa6081f76c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:47:01.843 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:01.840+0000 7fa60deff640 1 --2- 172.21.15.150:0/3720613079 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa6081f72b0 0x7fa6081f76c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:47:01.843 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:01.840+0000 7fa60deff640 1 -- 172.21.15.150:0/3720613079 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa5f4003a50 msgr2=0x7fa6080b29b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:47:01.843 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:01.840+0000 7fa60deff640 1 --2- 172.21.15.150:0/3720613079 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa5f4003a50 0x7fa6080b29b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:47:01.843 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:01.840+0000 7fa60deff640 1 -- 172.21.15.150:0/3720613079 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa60809fe10 con 0x7fa60809f4c0 2024-09-17T05:47:01.843 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:01.840+0000 7fa60deff640 1 --2- 172.21.15.150:0/3720613079 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa60809f4c0 0x7fa60809f8d0 secure :-1 s=READY pgs=833 cs=0 l=1 rev1=1 crypto rx=0x7fa608073d80 tx=0x7fa600006720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:47:01.843 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:01.841+0000 7fa5fdffb640 1 -- 172.21.15.150:0/3720613079 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa60000fa80 con 0x7fa60809f4c0 2024-09-17T05:47:01.843 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:01.841+0000 7fa5fdffb640 1 -- 172.21.15.150:0/3720613079 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa60000fc40 con 0x7fa60809f4c0 2024-09-17T05:47:01.843 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:01.841+0000 7fa60f962640 1 -- 172.21.15.150:0/3720613079 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa6080b2ef0 con 0x7fa60809f4c0 2024-09-17T05:47:01.844 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:01.841+0000 7fa5fdffb640 1 -- 172.21.15.150:0/3720613079 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa600011430 con 0x7fa60809f4c0 2024-09-17T05:47:01.844 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:01.841+0000 7fa60f962640 1 -- 172.21.15.150:0/3720613079 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa6081f3f90 con 0x7fa60809f4c0 2024-09-17T05:47:01.844 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:01.842+0000 7fa60f962640 1 -- 172.21.15.150:0/3720613079 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa6081f7df0 con 0x7fa60809f4c0 2024-09-17T05:47:01.844 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:01.842+0000 7fa5fdffb640 1 -- 172.21.15.150:0/3720613079 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 19) ==== 102563+0+0 (secure 0 0 0) 0x7fa6000115d0 con 0x7fa60809f4c0 2024-09-17T05:47:01.845 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:01.843+0000 7fa5fdffb640 1 --2- 172.21.15.150:0/3720613079 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fa5ec0797f0 0x7fa5ec07bd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:47:01.845 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:01.843+0000 7fa5fdffb640 1 -- 172.21.15.150:0/3720613079 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 5765+0+0 (secure 0 0 0) 0x7fa60009a000 con 0x7fa60809f4c0 2024-09-17T05:47:01.845 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:01.843+0000 7fa60d6fe640 1 --2- 172.21.15.150:0/3720613079 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fa5ec0797f0 0x7fa5ec07bd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:47:01.845 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:01.844+0000 7fa60d6fe640 1 --2- 172.21.15.150:0/3720613079 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fa5ec0797f0 0x7fa5ec07bd00 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7fa604035000 tx=0x7fa6040046c0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:47:01.848 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:01.847+0000 7fa5fdffb640 1 -- 172.21.15.150:0/3720613079 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fa60809fe10 con 0x7fa60809f4c0 2024-09-17T05:47:02.057 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:02.057+0000 7fa60f962640 1 -- 172.21.15.150:0/3720613079 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7fa6080d03c0 con 0x7fa60809f4c0 2024-09-17T05:47:02.058 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:02.057+0000 7fa5fdffb640 1 -- 172.21.15.150:0/3720613079 <== mon.0 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v42) ==== 53+0+73 (secure 0 0 0) 0x7fa600063f80 con 0x7fa60809f4c0 2024-09-17T05:47:02.058 INFO:teuthology.orchestra.run.smithi150.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-17T05:47:02.060 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:02.059+0000 7fa60f962640 1 -- 172.21.15.150:0/3720613079 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fa5ec0797f0 msgr2=0x7fa5ec07bd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:47:02.061 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:02.059+0000 7fa60f962640 1 --2- 172.21.15.150:0/3720613079 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fa5ec0797f0 0x7fa5ec07bd00 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7fa604035000 tx=0x7fa6040046c0 comp rx=0 tx=0).stop 2024-09-17T05:47:02.061 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:02.060+0000 7fa60f962640 1 -- 172.21.15.150:0/3720613079 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa60809f4c0 msgr2=0x7fa60809f8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:47:02.061 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:02.060+0000 7fa60f962640 1 --2- 172.21.15.150:0/3720613079 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa60809f4c0 0x7fa60809f8d0 secure :-1 s=READY pgs=833 cs=0 l=1 rev1=1 crypto rx=0x7fa608073d80 tx=0x7fa600006720 comp rx=0 tx=0).stop 2024-09-17T05:47:02.061 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:02.060+0000 7fa60f962640 1 -- 172.21.15.150:0/3720613079 shutdown_connections 2024-09-17T05:47:02.061 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:02.060+0000 7fa60f962640 1 --2- 172.21.15.150:0/3720613079 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fa5ec0797f0 0x7fa5ec07bd00 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:47:02.061 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:02.060+0000 7fa60f962640 1 --2- 172.21.15.150:0/3720613079 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa60809f4c0 0x7fa60809f8d0 unknown :-1 s=CLOSED pgs=833 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:47:02.061 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:02.060+0000 7fa60f962640 1 --2- 172.21.15.150:0/3720613079 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa6081f72b0 0x7fa6081f76c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:47:02.061 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:02.060+0000 7fa60f962640 1 --2- 172.21.15.150:0/3720613079 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa5f4003a50 0x7fa6080b29b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:47:02.061 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:02.060+0000 7fa60f962640 1 -- 172.21.15.150:0/3720613079 >> 172.21.15.150:0/3720613079 conn(0x7fa6080cee90 msgr2=0x7fa6081e60c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:47:02.061 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:02.060+0000 7fa60f962640 1 -- 172.21.15.150:0/3720613079 shutdown_connections 2024-09-17T05:47:02.061 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:02.060+0000 7fa60f962640 1 -- 172.21.15.150:0/3720613079 wait complete. 2024-09-17T05:47:02.072 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-09-17T05:47:02.072 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-17T05:47:02.072 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi150.front.sepia.ceph.com 2024-09-17T05:47:02.072 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-17T05:47:02.072 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-17T05:47:02.072 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-09-17T05:47:02.073 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-09-17T05:47:02.073 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-17T05:47:02.073 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-17T05:47:02.073 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:47:02.073 DEBUG:teuthology.orchestra.run.smithi150:> ip addr 2024-09-17T05:47:02.089 INFO:teuthology.orchestra.run.smithi150.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-17T05:47:02.089 INFO:teuthology.orchestra.run.smithi150.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-17T05:47:02.090 INFO:teuthology.orchestra.run.smithi150.stdout: inet 127.0.0.1/8 scope host lo 2024-09-17T05:47:02.090 INFO:teuthology.orchestra.run.smithi150.stdout: valid_lft forever preferred_lft forever 2024-09-17T05:47:02.090 INFO:teuthology.orchestra.run.smithi150.stdout: inet6 ::1/128 scope host 2024-09-17T05:47:02.090 INFO:teuthology.orchestra.run.smithi150.stdout: valid_lft forever preferred_lft forever 2024-09-17T05:47:02.090 INFO:teuthology.orchestra.run.smithi150.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-17T05:47:02.090 INFO:teuthology.orchestra.run.smithi150.stdout: link/ether 0c:c4:7a:d9:da:bc brd ff:ff:ff:ff:ff:ff 2024-09-17T05:47:02.090 INFO:teuthology.orchestra.run.smithi150.stdout: altname enp7s0f0 2024-09-17T05:47:02.090 INFO:teuthology.orchestra.run.smithi150.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-17T05:47:02.090 INFO:teuthology.orchestra.run.smithi150.stdout: link/ether 0c:c4:7a:d9:da:bd brd ff:ff:ff:ff:ff:ff 2024-09-17T05:47:02.090 INFO:teuthology.orchestra.run.smithi150.stdout: altname enp7s0f1 2024-09-17T05:47:02.090 INFO:teuthology.orchestra.run.smithi150.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-17T05:47:02.090 INFO:teuthology.orchestra.run.smithi150.stdout: link/ether 0c:c4:7a:88:6e:34 brd ff:ff:ff:ff:ff:ff 2024-09-17T05:47:02.091 INFO:teuthology.orchestra.run.smithi150.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-17T05:47:02.091 INFO:teuthology.orchestra.run.smithi150.stdout: link/ether 0c:c4:7a:88:6e:35 brd ff:ff:ff:ff:ff:ff 2024-09-17T05:47:02.091 INFO:teuthology.orchestra.run.smithi150.stdout: inet 172.21.15.150/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-09-17T05:47:02.091 INFO:teuthology.orchestra.run.smithi150.stdout: valid_lft 42493sec preferred_lft 42493sec 2024-09-17T05:47:02.091 INFO:teuthology.orchestra.run.smithi150.stdout: inet6 fe80::ec4:7aff:fe88:6e35/64 scope link noprefixroute 2024-09-17T05:47:02.091 INFO:teuthology.orchestra.run.smithi150.stdout: valid_lft forever preferred_lft forever 2024-09-17T05:47:02.091 INFO:teuthology.orchestra.run.smithi150.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-17T05:47:02.091 INFO:teuthology.orchestra.run.smithi150.stdout: link/ether 1a:d2:4c:31:46:82 brd ff:ff:ff:ff:ff:ff 2024-09-17T05:47:02.091 INFO:teuthology.orchestra.run.smithi150.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-17T05:47:02.091 INFO:teuthology.orchestra.run.smithi150.stdout: valid_lft forever preferred_lft forever 2024-09-17T05:47:02.091 INFO:teuthology.orchestra.run.smithi150.stdout: inet6 fe80::70b6:c6ff:fe60:62a2/64 scope link 2024-09-17T05:47:02.091 INFO:teuthology.orchestra.run.smithi150.stdout: valid_lft forever preferred_lft forever 2024-09-17T05:47:02.091 INFO:teuthology.orchestra.run.smithi150.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-17T05:47:02.092 INFO:teuthology.orchestra.run.smithi150.stdout: link/ether 32:e1:8b:37:8c:b3 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-17T05:47:02.092 INFO:teuthology.orchestra.run.smithi150.stdout: inet6 fe80::30e1:8bff:fe37:8cb3/64 scope link 2024-09-17T05:47:02.092 INFO:teuthology.orchestra.run.smithi150.stdout: valid_lft forever preferred_lft forever 2024-09-17T05:47:02.092 INFO:teuthology.orchestra.run.smithi150.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-17T05:47:02.092 INFO:teuthology.orchestra.run.smithi150.stdout: link/ether 1a:d2:4c:31:46:82 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-17T05:47:02.092 INFO:teuthology.orchestra.run.smithi150.stdout: inet6 fe80::18d2:4cff:fe31:4682/64 scope link 2024-09-17T05:47:02.092 INFO:teuthology.orchestra.run.smithi150.stdout: valid_lft forever preferred_lft forever 2024-09-17T05:47:02.092 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:47:02.092 DEBUG:teuthology.orchestra.run.smithi150:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-17T05:47:02.153 INFO:teuthology.orchestra.run.smithi150.stdout:1 2024-09-17T05:47:02.154 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:47:02.154 DEBUG:teuthology.orchestra.run.smithi150:> route 2024-09-17T05:47:02.211 INFO:teuthology.orchestra.run.smithi150.stdout:Kernel IP routing table 2024-09-17T05:47:02.211 INFO:teuthology.orchestra.run.smithi150.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-17T05:47:02.211 INFO:teuthology.orchestra.run.smithi150.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-17T05:47:02.211 INFO:teuthology.orchestra.run.smithi150.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-17T05:47:02.211 INFO:teuthology.orchestra.run.smithi150.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-17T05:47:02.212 DEBUG:teuthology.orchestra.run.smithi150:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-17T05:47:02.212 DEBUG:teuthology.orchestra.run.smithi150:> set -e 2024-09-17T05:47:02.212 DEBUG:teuthology.orchestra.run.smithi150:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-17T05:47:02.212 DEBUG:teuthology.orchestra.run.smithi150:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-17T05:47:02.212 DEBUG:teuthology.orchestra.run.smithi150:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-17T05:47:02.212 DEBUG:teuthology.orchestra.run.smithi150:> ') 2024-09-17T05:47:02.299 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:02 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-17T05:47:02.331 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:02 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T05:47:02.337 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:47:02.338 DEBUG:teuthology.orchestra.run.smithi150:> ip netns list 2024-09-17T05:47:02.353 INFO:teuthology.orchestra.run.smithi150.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-09-17T05:47:02.353 INFO:teuthology.orchestra.run.smithi150.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-17T05:47:02.353 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-17T05:47:02.354 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:47:02.354 DEBUG:teuthology.orchestra.run.smithi150:> sudo ip link set brx.0 up 2024-09-17T05:47:02.418 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-17T05:47:02.418 DEBUG:teuthology.orchestra.run.smithi150:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-17T05:47:02.474 INFO:teuthology.orchestra.run.smithi150.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-17T05:47:02.474 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-17T05:47:02.474 DEBUG:teuthology.orchestra.run.smithi150:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-17T05:47:02.529 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-09-17T05:47:02.530 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:47:02.530 DEBUG:teuthology.orchestra.run.smithi150:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-17T05:47:02.624 INFO:teuthology.orchestra.run.smithi150.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-17T05:47:02.624 INFO:teuthology.orchestra.run.smithi150.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-17T05:47:02.624 INFO:teuthology.orchestra.run.smithi150.stdout:invalid new device string format 2024-09-17T05:47:02.635 INFO:teuthology.orchestra.run.smithi150.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-17T05:47:02.635 INFO:teuthology.orchestra.run.smithi150.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-17T05:47:02.635 INFO:teuthology.orchestra.run.smithi150.stdout:invalid new device string format 2024-09-17T05:47:02.635 INFO:teuthology.orchestra.run.smithi150.stdout:mount.ceph: resolved to: "172.21.15.150:3300,172.21.15.176:3300,172.21.15.176:3301" 2024-09-17T05:47:02.635 INFO:teuthology.orchestra.run.smithi150.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-17T05:47:02.641 INFO:teuthology.orchestra.run.smithi150.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-17T05:47:02.641 INFO:teuthology.orchestra.run.smithi150.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-17T05:47:02.641 INFO:teuthology.orchestra.run.smithi150.stdout:invalid new device string format 2024-09-17T05:47:02.641 INFO:teuthology.orchestra.run.smithi150.stdout:mount.ceph: resolved to: "172.21.15.150:3300,172.21.15.176:3300,172.21.15.176:3301" 2024-09-17T05:47:02.641 INFO:teuthology.orchestra.run.smithi150.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-17T05:47:02.641 INFO:teuthology.orchestra.run.smithi150.stdout:mount.ceph: resolved to: "172.21.15.150:6789,172.21.15.176:6789,172.21.15.176:6790" 2024-09-17T05:47:02.641 INFO:teuthology.orchestra.run.smithi150.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.150:6789,172.21.15.176:6789,172.21.15.176:6790:/ 2024-09-17T05:47:02.641 INFO:teuthology.orchestra.run.smithi150.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=9f2e05e9-d629-47b3-b26b-1360655b7d20" will pass to kernel 2024-09-17T05:47:02.642 INFO:teuthology.orchestra.run.smithi150.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-09-17T05:47:02.642 INFO:teuthology.orchestra.run.smithi150.stdout: You just mounted a file system that supports labels which does not 2024-09-17T05:47:02.642 INFO:teuthology.orchestra.run.smithi150.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-09-17T05:47:02.642 INFO:teuthology.orchestra.run.smithi150.stdout: applications will generate AVC messages and not be allowed access to 2024-09-17T05:47:02.642 INFO:teuthology.orchestra.run.smithi150.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-09-17T05:47:02.643 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-17T05:47:02.644 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:47:02.644 DEBUG:teuthology.orchestra.run.smithi150:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-17T05:47:02.669 DEBUG:teuthology.orchestra.run.smithi150:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-17T05:47:02.759 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:02 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-17T05:47:02.763 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:02 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T05:47:02.769 INFO:teuthology.orchestra.run.smithi150.stdout:client6684 2024-09-17T05:47:02.770 DEBUG:teuthology.orchestra.run.smithi150:> set -ex 2024-09-17T05:47:02.770 DEBUG:teuthology.orchestra.run.smithi150:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T05:47:02.786 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs flag set enable_multiple true --yes-i-really-mean-it 2024-09-17T05:47:02.945 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:02.944+0000 7feac9dad640 1 -- 172.21.15.150:0/1361040758 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7feac40b25a0 msgr2=0x7feac40b29b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:47:02.945 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:02.944+0000 7feac9dad640 1 --2- 172.21.15.150:0/1361040758 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7feac40b25a0 0x7feac40b29b0 secure :-1 s=READY pgs=835 cs=0 l=1 rev1=1 crypto rx=0x7feabc005fd0 tx=0x7feabc02aa90 comp rx=0 tx=0).stop 2024-09-17T05:47:02.946 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:02.944+0000 7feac9dad640 1 -- 172.21.15.150:0/1361040758 shutdown_connections 2024-09-17T05:47:02.946 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:02.944+0000 7feac9dad640 1 --2- 172.21.15.150:0/1361040758 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7feac40b25a0 0x7feac40b29b0 unknown :-1 s=CLOSED pgs=835 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:47:02.946 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:02.944+0000 7feac9dad640 1 --2- 172.21.15.150:0/1361040758 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7feac40b1c50 0x7feac40b2060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:47:02.946 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:02.944+0000 7feac9dad640 1 -- 172.21.15.150:0/1361040758 >> 172.21.15.150:0/1361040758 conn(0x7feac40cef00 msgr2=0x7feac40cf310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:47:02.946 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:02.944+0000 7feac9dad640 1 -- 172.21.15.150:0/1361040758 shutdown_connections 2024-09-17T05:47:02.946 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:02.944+0000 7feac9dad640 1 -- 172.21.15.150:0/1361040758 wait complete. 2024-09-17T05:47:02.947 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:02.946+0000 7feac9dad640 1 Processor -- start 2024-09-17T05:47:02.947 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:02.946+0000 7feac9dad640 1 -- start start 2024-09-17T05:47:02.949 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:02.947+0000 7feac9dad640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7feac40b1c50 0x7feac40b7280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:47:02.949 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:02.947+0000 7feac9dad640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7feac40b25a0 0x7feac409f8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:47:02.950 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:02.947+0000 7feac9dad640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7feac40c5b10 0x7feac41f6e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:47:02.950 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:02.948+0000 7feac9dad640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7feac40b7b30 con 0x7feac40b25a0 2024-09-17T05:47:02.950 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:02.948+0000 7feac9dad640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7feac40b79b0 con 0x7feac40b1c50 2024-09-17T05:47:02.950 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:02.948+0000 7feac9dad640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7feac409bc60 con 0x7feac40c5b10 2024-09-17T05:47:02.950 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:02.948+0000 7feac2ffd640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7feac40b25a0 0x7feac409f8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:47:02.950 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:02.948+0000 7feac2ffd640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7feac40b25a0 0x7feac409f8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:37940/0 (socket says 172.21.15.150:37940) 2024-09-17T05:47:02.950 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:02.948+0000 7feac2ffd640 1 -- 172.21.15.150:0/2437570929 learned_addr learned my addr 172.21.15.150:0/2437570929 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:47:02.950 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:02.948+0000 7feac3fff640 1 --2- 172.21.15.150:0/2437570929 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7feac40c5b10 0x7feac41f6e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:47:02.950 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:02.948+0000 7feac37fe640 1 --2- 172.21.15.150:0/2437570929 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7feac40b1c50 0x7feac40b7280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:47:02.950 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:02.948+0000 7feac2ffd640 1 -- 172.21.15.150:0/2437570929 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7feac40c5b10 msgr2=0x7feac41f6e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:47:02.950 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:02.948+0000 7feac2ffd640 1 --2- 172.21.15.150:0/2437570929 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7feac40c5b10 0x7feac41f6e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:47:02.951 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:02.948+0000 7feac2ffd640 1 -- 172.21.15.150:0/2437570929 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7feac40b1c50 msgr2=0x7feac40b7280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:47:02.951 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:02.948+0000 7feac2ffd640 1 --2- 172.21.15.150:0/2437570929 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7feac40b1c50 0x7feac40b7280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:47:02.951 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:02.948+0000 7feac2ffd640 1 -- 172.21.15.150:0/2437570929 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feac409fe10 con 0x7feac40b25a0 2024-09-17T05:47:02.951 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:02.948+0000 7feac2ffd640 1 --2- 172.21.15.150:0/2437570929 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7feac40b25a0 0x7feac409f8d0 secure :-1 s=READY pgs=836 cs=0 l=1 rev1=1 crypto rx=0x7feab800c9a0 tx=0x7feab800ce60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:47:02.951 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:02.948+0000 7feaabfff640 1 -- 172.21.15.150:0/2437570929 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feab8007bb0 con 0x7feac40b25a0 2024-09-17T05:47:02.951 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:02.948+0000 7feaabfff640 1 -- 172.21.15.150:0/2437570929 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7feab8007e40 con 0x7feac40b25a0 2024-09-17T05:47:02.951 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:02.948+0000 7feac9dad640 1 -- 172.21.15.150:0/2437570929 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feac415d0d0 con 0x7feac40b25a0 2024-09-17T05:47:02.951 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:02.948+0000 7feaabfff640 1 -- 172.21.15.150:0/2437570929 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feab8005280 con 0x7feac40b25a0 2024-09-17T05:47:02.951 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:02.948+0000 7feac9dad640 1 -- 172.21.15.150:0/2437570929 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feac415d690 con 0x7feac40b25a0 2024-09-17T05:47:02.952 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:02.949+0000 7feac9dad640 1 -- 172.21.15.150:0/2437570929 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7feac415ce40 con 0x7feac40b25a0 2024-09-17T05:47:02.953 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:02.950+0000 7feaabfff640 1 -- 172.21.15.150:0/2437570929 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 19) ==== 102563+0+0 (secure 0 0 0) 0x7feab8005420 con 0x7feac40b25a0 2024-09-17T05:47:02.953 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:02.951+0000 7feaabfff640 1 --2- 172.21.15.150:0/2437570929 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7feab00797f0 0x7feab007bd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:47:02.953 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:02.951+0000 7feaabfff640 1 -- 172.21.15.150:0/2437570929 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 5765+0+0 (secure 0 0 0) 0x7feab8099bb0 con 0x7feac40b25a0 2024-09-17T05:47:02.953 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:02.951+0000 7feac37fe640 1 --2- 172.21.15.150:0/2437570929 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7feab00797f0 0x7feab007bd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:47:02.953 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:02.952+0000 7feac37fe640 1 --2- 172.21.15.150:0/2437570929 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7feab00797f0 0x7feab007bd00 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7feab400b7f0 tx=0x7feab4008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:47:02.956 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:02.956+0000 7feaabfff640 1 -- 172.21.15.150:0/2437570929 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7feab8014030 con 0x7feac40b25a0 2024-09-17T05:47:03.166 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:03.165+0000 7feac9dad640 1 -- 172.21.15.150:0/2437570929 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "fs flag set", "flag_name": "enable_multiple", "val": "true", "yes_i_really_mean_it": true} v 0) -- 0x7feac40b2060 con 0x7feac40b25a0 2024-09-17T05:47:03.795 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:03.794+0000 7feaabfff640 1 -- 172.21.15.150:0/2437570929 <== mon.0 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "fs flag set", "flag_name": "enable_multiple", "val": "true", "yes_i_really_mean_it": true}]=0 v43) ==== 136+0+0 (secure 0 0 0) 0x7feab8063b60 con 0x7feac40b25a0 2024-09-17T05:47:03.798 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:03.797+0000 7feac9dad640 1 -- 172.21.15.150:0/2437570929 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7feab00797f0 msgr2=0x7feab007bd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:47:03.798 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:03.797+0000 7feac9dad640 1 --2- 172.21.15.150:0/2437570929 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7feab00797f0 0x7feab007bd00 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7feab400b7f0 tx=0x7feab4008040 comp rx=0 tx=0).stop 2024-09-17T05:47:03.798 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:03.797+0000 7feac9dad640 1 -- 172.21.15.150:0/2437570929 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7feac40b25a0 msgr2=0x7feac409f8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:47:03.798 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:03.797+0000 7feac9dad640 1 --2- 172.21.15.150:0/2437570929 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7feac40b25a0 0x7feac409f8d0 secure :-1 s=READY pgs=836 cs=0 l=1 rev1=1 crypto rx=0x7feab800c9a0 tx=0x7feab800ce60 comp rx=0 tx=0).stop 2024-09-17T05:47:03.798 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:03.797+0000 7feac9dad640 1 -- 172.21.15.150:0/2437570929 shutdown_connections 2024-09-17T05:47:03.798 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:03.797+0000 7feac9dad640 1 --2- 172.21.15.150:0/2437570929 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7feab00797f0 0x7feab007bd00 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:47:03.799 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:03.797+0000 7feac9dad640 1 --2- 172.21.15.150:0/2437570929 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7feac40c5b10 0x7feac41f6e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:47:03.799 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:03.797+0000 7feac9dad640 1 --2- 172.21.15.150:0/2437570929 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7feac40b25a0 0x7feac409f8d0 unknown :-1 s=CLOSED pgs=836 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:47:03.799 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:03.797+0000 7feac9dad640 1 --2- 172.21.15.150:0/2437570929 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7feac40b1c50 0x7feac40b7280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:47:03.799 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:03.797+0000 7feac9dad640 1 -- 172.21.15.150:0/2437570929 >> 172.21.15.150:0/2437570929 conn(0x7feac40cef00 msgr2=0x7feac40b0a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:47:03.799 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:03.797+0000 7feac9dad640 1 -- 172.21.15.150:0/2437570929 shutdown_connections 2024-09-17T05:47:03.799 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:03.797+0000 7feac9dad640 1 -- 172.21.15.150:0/2437570929 wait complete. 2024-09-17T05:47:03.811 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume ls 2024-09-17T05:47:03.929 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:03.928+0000 7f97254be640 1 -- 172.21.15.150:0/2209308259 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9708004d40 msgr2=0x7f9708005150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:47:03.929 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:03.928+0000 7f97254be640 1 --2- 172.21.15.150:0/2209308259 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9708004d40 0x7f9708005150 secure :-1 s=READY pgs=838 cs=0 l=1 rev1=1 crypto rx=0x7f97200b5840 tx=0x7f9708005830 comp rx=0 tx=0).stop 2024-09-17T05:47:03.929 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:03.928+0000 7f971f7fe640 1 -- 172.21.15.150:0/2209308259 reap_dead start 2024-09-17T05:47:03.929 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:03.928+0000 7f97254be640 1 -- 172.21.15.150:0/2209308259 shutdown_connections 2024-09-17T05:47:03.929 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:03.928+0000 7f97254be640 1 -- 172.21.15.150:0/2209308259 >> 172.21.15.150:0/2209308259 conn(0x7f972008bfe0 msgr2=0x7f97200d4660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:47:03.930 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:03.928+0000 7f97254be640 1 -- 172.21.15.150:0/2209308259 shutdown_connections 2024-09-17T05:47:03.930 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:03.928+0000 7f97254be640 1 -- 172.21.15.150:0/2209308259 wait complete. 2024-09-17T05:47:03.931 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:03.930+0000 7f97254be640 1 Processor -- start 2024-09-17T05:47:03.931 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:03.930+0000 7f97254be640 1 -- start start 2024-09-17T05:47:03.933 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:03.931+0000 7f97254be640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f97200cd7d0 0x7f97200b3ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:47:03.933 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:03.931+0000 7f97254be640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f97200cdbe0 0x7f97200cc8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:47:03.934 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:03.931+0000 7f97254be640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f97200b4220 0x7f97200cce00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:47:03.934 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:03.931+0000 7f97254be640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f97200b54e0 con 0x7f97200b4220 2024-09-17T05:47:03.934 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:03.931+0000 7f97254be640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f97200b5360 con 0x7f97200cdbe0 2024-09-17T05:47:03.934 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:03.931+0000 7f97254be640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f97200b6730 con 0x7f97200cd7d0 2024-09-17T05:47:03.934 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:03.932+0000 7f971f7fe640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f97200b4220 0x7f97200cce00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:47:03.934 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:03.932+0000 7f971f7fe640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f97200b4220 0x7f97200cce00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:37948/0 (socket says 172.21.15.150:37948) 2024-09-17T05:47:03.934 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:03.932+0000 7f971f7fe640 1 -- 172.21.15.150:0/2869491253 learned_addr learned my addr 172.21.15.150:0/2869491253 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:47:03.934 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:03.932+0000 7f971effd640 1 --2- 172.21.15.150:0/2869491253 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f97200cd7d0 0x7f97200b3ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:47:03.934 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:03.932+0000 7f971e7fc640 1 --2- 172.21.15.150:0/2869491253 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f97200cdbe0 0x7f97200cc8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:47:03.934 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:03.932+0000 7f971f7fe640 1 -- 172.21.15.150:0/2869491253 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f97200cd7d0 msgr2=0x7f97200b3ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:47:03.934 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:03.932+0000 7f971f7fe640 1 --2- 172.21.15.150:0/2869491253 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f97200cd7d0 0x7f97200b3ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:47:03.934 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:03.932+0000 7f971f7fe640 1 -- 172.21.15.150:0/2869491253 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f97200cdbe0 msgr2=0x7f97200cc8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:47:03.935 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:03.932+0000 7f971f7fe640 1 --2- 172.21.15.150:0/2869491253 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f97200cdbe0 0x7f97200cc8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:47:03.935 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:03.932+0000 7f971f7fe640 1 -- 172.21.15.150:0/2869491253 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f97200cc2c0 con 0x7f97200b4220 2024-09-17T05:47:03.935 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:03.932+0000 7f971effd640 1 --2- 172.21.15.150:0/2869491253 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f97200cd7d0 0x7f97200b3ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:47:03.935 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:03.932+0000 7f971e7fc640 1 --2- 172.21.15.150:0/2869491253 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f97200cdbe0 0x7f97200cc8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:47:03.935 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:03.932+0000 7f971f7fe640 1 --2- 172.21.15.150:0/2869491253 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f97200b4220 0x7f97200cce00 secure :-1 s=READY pgs=839 cs=0 l=1 rev1=1 crypto rx=0x7f9718036040 tx=0x7f9718033670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:47:03.935 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:03.932+0000 7f97077fe640 1 -- 172.21.15.150:0/2869491253 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9718043070 con 0x7f97200b4220 2024-09-17T05:47:03.935 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:03.932+0000 7f97077fe640 1 -- 172.21.15.150:0/2869491253 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9718004030 con 0x7f97200b4220 2024-09-17T05:47:03.935 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:03.932+0000 7f97077fe640 1 -- 172.21.15.150:0/2869491253 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9718038040 con 0x7f97200b4220 2024-09-17T05:47:03.935 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:03.932+0000 7f97254be640 1 -- 172.21.15.150:0/2869491253 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f97200cc5a0 con 0x7f97200b4220 2024-09-17T05:47:03.935 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:03.933+0000 7f97254be640 1 -- 172.21.15.150:0/2869491253 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f97200b37c0 con 0x7f97200b4220 2024-09-17T05:47:03.936 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:03.934+0000 7f97254be640 1 -- 172.21.15.150:0/2869491253 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f972008caf0 con 0x7f97200b4220 2024-09-17T05:47:03.936 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:03.934+0000 7f97077fe640 1 -- 172.21.15.150:0/2869491253 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 19) ==== 102563+0+0 (secure 0 0 0) 0x7f9718033760 con 0x7f97200b4220 2024-09-17T05:47:03.936 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:03.935+0000 7f97077fe640 1 --2- 172.21.15.150:0/2869491253 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f970c0797f0 0x7f970c07bd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:47:03.937 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:03.935+0000 7f97077fe640 1 -- 172.21.15.150:0/2869491253 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 5765+0+0 (secure 0 0 0) 0x7f97180b9230 con 0x7f97200b4220 2024-09-17T05:47:03.937 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:03.935+0000 7f971effd640 1 --2- 172.21.15.150:0/2869491253 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f970c0797f0 0x7f970c07bd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:47:03.937 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:03.936+0000 7f971effd640 1 --2- 172.21.15.150:0/2869491253 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f970c0797f0 0x7f970c07bd00 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f97200cbee0 tx=0x7f9710006ac0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:47:03.940 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:03.939+0000 7f97077fe640 1 -- 172.21.15.150:0/2869491253 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f972008caf0 con 0x7f97200b4220 2024-09-17T05:47:04.139 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:04.138+0000 7f97254be640 1 -- 172.21.15.150:0/2869491253 --> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] -- mgr_command(tid 0: {"prefix": "fs volume ls", "target": ["mon-mgr", ""]}) -- 0x7f97200d2e50 con 0x7f970c0797f0 2024-09-17T05:47:04.141 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:04.141+0000 7f97077fe640 1 -- 172.21.15.150:0/2869491253 <== mgr.4108 v2:172.21.15.176:6800/3631216395 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+41 (secure 0 0 0) 0x7f97200d2e50 con 0x7f970c0797f0 2024-09-17T05:47:04.141 INFO:teuthology.orchestra.run.smithi150.stdout:[ 2024-09-17T05:47:04.141 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-09-17T05:47:04.141 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "cephfs" 2024-09-17T05:47:04.141 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-09-17T05:47:04.141 INFO:teuthology.orchestra.run.smithi150.stdout:] 2024-09-17T05:47:04.143 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:04.142+0000 7f97254be640 1 -- 172.21.15.150:0/2869491253 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f970c0797f0 msgr2=0x7f970c07bd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:47:04.143 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:04.142+0000 7f97254be640 1 --2- 172.21.15.150:0/2869491253 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f970c0797f0 0x7f970c07bd00 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f97200cbee0 tx=0x7f9710006ac0 comp rx=0 tx=0).stop 2024-09-17T05:47:04.143 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:04.142+0000 7f97254be640 1 -- 172.21.15.150:0/2869491253 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f97200b4220 msgr2=0x7f97200cce00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:47:04.143 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:04.142+0000 7f97254be640 1 --2- 172.21.15.150:0/2869491253 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f97200b4220 0x7f97200cce00 secure :-1 s=READY pgs=839 cs=0 l=1 rev1=1 crypto rx=0x7f9718036040 tx=0x7f9718033670 comp rx=0 tx=0).stop 2024-09-17T05:47:04.143 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:04.142+0000 7f97254be640 1 -- 172.21.15.150:0/2869491253 shutdown_connections 2024-09-17T05:47:04.143 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:04.142+0000 7f97254be640 1 --2- 172.21.15.150:0/2869491253 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f97200cdbe0 0x7f97200cc8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:47:04.144 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:04.142+0000 7f97254be640 1 --2- 172.21.15.150:0/2869491253 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f970c0797f0 0x7f970c07bd00 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:47:04.144 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:04.142+0000 7f97254be640 1 --2- 172.21.15.150:0/2869491253 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f97200b4220 0x7f97200cce00 unknown :-1 s=CLOSED pgs=839 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:47:04.144 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:04.142+0000 7f97254be640 1 --2- 172.21.15.150:0/2869491253 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f97200cd7d0 0x7f97200b3ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:47:04.144 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:04.142+0000 7f97254be640 1 -- 172.21.15.150:0/2869491253 >> 172.21.15.150:0/2869491253 conn(0x7f972008bfe0 msgr2=0x7f972006e6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:47:04.144 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:04.142+0000 7f97254be640 1 -- 172.21.15.150:0/2869491253 shutdown_connections 2024-09-17T05:47:04.144 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:04.142+0000 7f97254be640 1 -- 172.21.15.150:0/2869491253 wait complete. 2024-09-17T05:47:04.155 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-09-17T05:47:04.272 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:04.271+0000 7f1c705a8640 1 -- 172.21.15.150:0/508410017 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1c680cfab0 msgr2=0x7f1c68073630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:47:04.272 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:04.271+0000 7f1c705a8640 1 --2- 172.21.15.150:0/508410017 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1c680cfab0 0x7f1c68073630 secure :-1 s=READY pgs=841 cs=0 l=1 rev1=1 crypto rx=0x7f1c68072bd0 tx=0x7f1c5802a560 comp rx=0 tx=0).stop 2024-09-17T05:47:04.272 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:04.271+0000 7f1c705a8640 1 -- 172.21.15.150:0/508410017 shutdown_connections 2024-09-17T05:47:04.273 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:04.271+0000 7f1c705a8640 1 --2- 172.21.15.150:0/508410017 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1c680cfab0 0x7f1c68073630 unknown :-1 s=CLOSED pgs=841 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:47:04.273 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:04.271+0000 7f1c705a8640 1 --2- 172.21.15.150:0/508410017 >> v2:172.21.15.176:3300/0 conn(0x7f1c680ccc50 0x7f1c680cf570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:47:04.273 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:04.271+0000 7f1c705a8640 1 -- 172.21.15.150:0/508410017 >> 172.21.15.150:0/508410017 conn(0x7f1c6806d1c0 msgr2=0x7f1c6806d5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:47:04.273 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:04.271+0000 7f1c705a8640 1 -- 172.21.15.150:0/508410017 shutdown_connections 2024-09-17T05:47:04.273 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:04.271+0000 7f1c705a8640 1 -- 172.21.15.150:0/508410017 wait complete. 2024-09-17T05:47:04.273 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:04.273+0000 7f1c705a8640 1 Processor -- start 2024-09-17T05:47:04.273 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:04.273+0000 7f1c705a8640 1 -- start start 2024-09-17T05:47:04.276 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:04.274+0000 7f1c705a8640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1c68073b70 0x7f1c681407e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:47:04.276 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:04.274+0000 7f1c705a8640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1c680ccc50 0x7f1c681f1700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:47:04.276 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:04.274+0000 7f1c705a8640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1c680cfab0 0x7f1c6814d470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:47:04.276 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:04.274+0000 7f1c705a8640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f1c6815fa00 con 0x7f1c680ccc50 2024-09-17T05:47:04.276 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:04.274+0000 7f1c705a8640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f1c6815f880 con 0x7f1c68073b70 2024-09-17T05:47:04.276 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:04.274+0000 7f1c705a8640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f1c6815fb80 con 0x7f1c680cfab0 2024-09-17T05:47:04.277 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:04.274+0000 7f1c6db43640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1c680ccc50 0x7f1c681f1700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:47:04.277 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:04.274+0000 7f1c6db43640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1c680ccc50 0x7f1c681f1700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:37976/0 (socket says 172.21.15.150:37976) 2024-09-17T05:47:04.277 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:04.274+0000 7f1c6db43640 1 -- 172.21.15.150:0/933852289 learned_addr learned my addr 172.21.15.150:0/933852289 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:47:04.277 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:04.274+0000 7f1c6eb45640 1 --2- 172.21.15.150:0/933852289 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1c680cfab0 0x7f1c6814d470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:47:04.277 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:04.275+0000 7f1c6e344640 1 --2- 172.21.15.150:0/933852289 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1c68073b70 0x7f1c681407e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:47:04.277 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:04.275+0000 7f1c6db43640 1 -- 172.21.15.150:0/933852289 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1c680cfab0 msgr2=0x7f1c6814d470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:47:04.277 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:04.275+0000 7f1c6db43640 1 --2- 172.21.15.150:0/933852289 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1c680cfab0 0x7f1c6814d470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:47:04.277 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:04.275+0000 7f1c6db43640 1 -- 172.21.15.150:0/933852289 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1c68073b70 msgr2=0x7f1c681407e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:47:04.277 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:04.275+0000 7f1c6db43640 1 --2- 172.21.15.150:0/933852289 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1c68073b70 0x7f1c681407e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:47:04.277 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:04.275+0000 7f1c6db43640 1 -- 172.21.15.150:0/933852289 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1c6814ede0 con 0x7f1c680ccc50 2024-09-17T05:47:04.277 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:04.275+0000 7f1c6e344640 1 --2- 172.21.15.150:0/933852289 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1c68073b70 0x7f1c681407e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:47:04.277 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:04.275+0000 7f1c6db43640 1 --2- 172.21.15.150:0/933852289 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1c680ccc50 0x7f1c681f1700 secure :-1 s=READY pgs=842 cs=0 l=1 rev1=1 crypto rx=0x7f1c58034040 tx=0x7f1c58003910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:47:04.277 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:04.275+0000 7f1c5effd640 1 -- 172.21.15.150:0/933852289 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c5803e030 con 0x7f1c680ccc50 2024-09-17T05:47:04.278 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:04.275+0000 7f1c5effd640 1 -- 172.21.15.150:0/933852289 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f1c58003e00 con 0x7f1c680ccc50 2024-09-17T05:47:04.278 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:04.275+0000 7f1c705a8640 1 -- 172.21.15.150:0/933852289 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1c6814f0c0 con 0x7f1c680ccc50 2024-09-17T05:47:04.278 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:04.275+0000 7f1c5effd640 1 -- 172.21.15.150:0/933852289 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c58035040 con 0x7f1c680ccc50 2024-09-17T05:47:04.278 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:04.275+0000 7f1c705a8640 1 -- 172.21.15.150:0/933852289 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1c6814f680 con 0x7f1c680ccc50 2024-09-17T05:47:04.279 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:04.276+0000 7f1c705a8640 1 -- 172.21.15.150:0/933852289 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1c6814eb50 con 0x7f1c680ccc50 2024-09-17T05:47:04.279 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:04.277+0000 7f1c5effd640 1 -- 172.21.15.150:0/933852289 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 19) ==== 102563+0+0 (secure 0 0 0) 0x7f1c58041030 con 0x7f1c680ccc50 2024-09-17T05:47:04.279 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:04.277+0000 7f1c5effd640 1 --2- 172.21.15.150:0/933852289 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f1c4c0797f0 0x7f1c4c07bd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:47:04.279 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:04.278+0000 7f1c5effd640 1 -- 172.21.15.150:0/933852289 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 5765+0+0 (secure 0 0 0) 0x7f1c580b9df0 con 0x7f1c680ccc50 2024-09-17T05:47:04.279 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:04.278+0000 7f1c6e344640 1 --2- 172.21.15.150:0/933852289 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f1c4c0797f0 0x7f1c4c07bd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:47:04.280 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:04.278+0000 7f1c6e344640 1 --2- 172.21.15.150:0/933852289 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f1c4c0797f0 0x7f1c4c07bd00 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f1c64005fd0 tx=0x7f1c64009480 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:47:04.282 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:04.282+0000 7f1c5effd640 1 -- 172.21.15.150:0/933852289 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f1c58083720 con 0x7f1c680ccc50 2024-09-17T05:47:04.457 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:04.456+0000 7f1c705a8640 1 -- 172.21.15.150:0/933852289 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) -- 0x7f1c680cf570 con 0x7f1c680ccc50 2024-09-17T05:47:04.457 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:04.456+0000 7f1c5effd640 1 -- 172.21.15.150:0/933852289 <== mon.0 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v41)=0 v41) ==== 122+0+0 (secure 0 0 0) 0x7f1c58088150 con 0x7f1c680ccc50 2024-09-17T05:47:04.460 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:04.459+0000 7f1c705a8640 1 -- 172.21.15.150:0/933852289 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f1c4c0797f0 msgr2=0x7f1c4c07bd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:47:04.460 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:04.459+0000 7f1c705a8640 1 --2- 172.21.15.150:0/933852289 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f1c4c0797f0 0x7f1c4c07bd00 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f1c64005fd0 tx=0x7f1c64009480 comp rx=0 tx=0).stop 2024-09-17T05:47:04.460 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:04.459+0000 7f1c705a8640 1 -- 172.21.15.150:0/933852289 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1c680ccc50 msgr2=0x7f1c681f1700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:47:04.460 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:04.459+0000 7f1c705a8640 1 --2- 172.21.15.150:0/933852289 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1c680ccc50 0x7f1c681f1700 secure :-1 s=READY pgs=842 cs=0 l=1 rev1=1 crypto rx=0x7f1c58034040 tx=0x7f1c58003910 comp rx=0 tx=0).stop 2024-09-17T05:47:04.460 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:04.459+0000 7f1c705a8640 1 -- 172.21.15.150:0/933852289 shutdown_connections 2024-09-17T05:47:04.460 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:04.459+0000 7f1c705a8640 1 --2- 172.21.15.150:0/933852289 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f1c4c0797f0 0x7f1c4c07bd00 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:47:04.460 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:04.459+0000 7f1c705a8640 1 --2- 172.21.15.150:0/933852289 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1c680cfab0 0x7f1c6814d470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:47:04.460 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:04.459+0000 7f1c705a8640 1 --2- 172.21.15.150:0/933852289 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1c680ccc50 0x7f1c681f1700 unknown :-1 s=CLOSED pgs=842 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:47:04.460 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:04.459+0000 7f1c705a8640 1 --2- 172.21.15.150:0/933852289 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1c68073b70 0x7f1c681407e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:47:04.460 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:04.459+0000 7f1c705a8640 1 -- 172.21.15.150:0/933852289 >> 172.21.15.150:0/933852289 conn(0x7f1c6806d1c0 msgr2=0x7f1c681547b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:47:04.461 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:04.459+0000 7f1c705a8640 1 -- 172.21.15.150:0/933852289 shutdown_connections 2024-09-17T05:47:04.461 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:04.459+0000 7f1c705a8640 1 -- 172.21.15.150:0/933852289 wait complete. 2024-09-17T05:47:04.471 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config get mgr mgr/volumes/max_concurrent_clones 2024-09-17T05:47:04.589 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:04.588+0000 7f2e0dbe4640 1 -- 172.21.15.150:0/483235938 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2df4003a50 msgr2=0x7f2df4003ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:47:04.589 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:04.588+0000 7f2e0dbe4640 1 --2- 172.21.15.150:0/483235938 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2df4003a50 0x7f2df4003ec0 secure :-1 s=READY pgs=844 cs=0 l=1 rev1=1 crypto rx=0x7f2df800c290 tx=0x7f2df4005830 comp rx=0 tx=0).stop 2024-09-17T05:47:04.589 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:04.588+0000 7f2e07fff640 1 -- 172.21.15.150:0/483235938 reap_dead start 2024-09-17T05:47:04.589 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:04.588+0000 7f2e0dbe4640 1 -- 172.21.15.150:0/483235938 shutdown_connections 2024-09-17T05:47:04.589 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:04.588+0000 7f2e0dbe4640 1 -- 172.21.15.150:0/483235938 >> 172.21.15.150:0/483235938 conn(0x7f2e080d4680 msgr2=0x7f2e080d4a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:47:04.589 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:04.588+0000 7f2e0dbe4640 1 -- 172.21.15.150:0/483235938 shutdown_connections 2024-09-17T05:47:04.589 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:04.588+0000 7f2e0dbe4640 1 -- 172.21.15.150:0/483235938 wait complete. 2024-09-17T05:47:04.590 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:04.589+0000 7f2e0dbe4640 1 Processor -- start 2024-09-17T05:47:04.590 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:04.590+0000 7f2e0dbe4640 1 -- start start 2024-09-17T05:47:04.593 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:04.591+0000 7f2e0dbe4640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2df4003a50 0x7f2e081f5900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:47:04.594 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:04.591+0000 7f2e0dbe4640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2e0814d690 0x7f2e081f95d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:47:04.594 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:04.591+0000 7f2e0dbe4640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2e0814dbe0 0x7f2e081f9b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:47:04.594 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:04.591+0000 7f2e0dbe4640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f2e08163690 con 0x7f2e0814dbe0 2024-09-17T05:47:04.594 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:04.591+0000 7f2e0dbe4640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f2e08163510 con 0x7f2df4003a50 2024-09-17T05:47:04.594 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:04.591+0000 7f2e0dbe4640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f2e08166ff0 con 0x7f2e0814d690 2024-09-17T05:47:04.594 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:04.591+0000 7f2e07fff640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2e0814dbe0 0x7f2e081f9b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:47:04.594 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:04.591+0000 7f2e07fff640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2e0814dbe0 0x7f2e081f9b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:38006/0 (socket says 172.21.15.150:38006) 2024-09-17T05:47:04.595 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:04.591+0000 7f2e07fff640 1 -- 172.21.15.150:0/680860891 learned_addr learned my addr 172.21.15.150:0/680860891 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:47:04.595 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:04.591+0000 7f2e06ffd640 1 --2- 172.21.15.150:0/680860891 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2e0814d690 0x7f2e081f95d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:47:04.595 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:04.591+0000 7f2e077fe640 1 --2- 172.21.15.150:0/680860891 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2df4003a50 0x7f2e081f5900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:47:04.595 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:04.591+0000 7f2e07fff640 1 -- 172.21.15.150:0/680860891 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2e0814d690 msgr2=0x7f2e081f95d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:47:04.595 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:04.591+0000 7f2e07fff640 1 --2- 172.21.15.150:0/680860891 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2e0814d690 0x7f2e081f95d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:47:04.595 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:04.591+0000 7f2e07fff640 1 -- 172.21.15.150:0/680860891 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2df4003a50 msgr2=0x7f2e081f5900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:47:04.595 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:04.591+0000 7f2e07fff640 1 --2- 172.21.15.150:0/680860891 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2df4003a50 0x7f2e081f5900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:47:04.595 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:04.591+0000 7f2e07fff640 1 -- 172.21.15.150:0/680860891 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2e08164930 con 0x7f2e0814dbe0 2024-09-17T05:47:04.595 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:04.592+0000 7f2e07fff640 1 --2- 172.21.15.150:0/680860891 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2e0814dbe0 0x7f2e081f9b10 secure :-1 s=READY pgs=845 cs=0 l=1 rev1=1 crypto rx=0x7f2e080d2320 tx=0x7f2e0000f3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:47:04.596 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:04.592+0000 7f2dfffff640 1 -- 172.21.15.150:0/680860891 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e00003970 con 0x7f2e0814dbe0 2024-09-17T05:47:04.596 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:04.592+0000 7f2dfffff640 1 -- 172.21.15.150:0/680860891 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f2e00003b10 con 0x7f2e0814dbe0 2024-09-17T05:47:04.596 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:04.592+0000 7f2e0dbe4640 1 -- 172.21.15.150:0/680860891 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2e081f5e40 con 0x7f2e0814dbe0 2024-09-17T05:47:04.596 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:04.592+0000 7f2dfffff640 1 -- 172.21.15.150:0/680860891 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e00004030 con 0x7f2e0814dbe0 2024-09-17T05:47:04.596 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:04.592+0000 7f2e0dbe4640 1 -- 172.21.15.150:0/680860891 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2e08161cb0 con 0x7f2e0814dbe0 2024-09-17T05:47:04.596 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:04.593+0000 7f2e0dbe4640 1 -- 172.21.15.150:0/680860891 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2e081fa1e0 con 0x7f2e0814dbe0 2024-09-17T05:47:04.597 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:04.594+0000 7f2dfffff640 1 -- 172.21.15.150:0/680860891 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 19) ==== 102563+0+0 (secure 0 0 0) 0x7f2e000041d0 con 0x7f2e0814dbe0 2024-09-17T05:47:04.597 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:04.594+0000 7f2dfffff640 1 --2- 172.21.15.150:0/680860891 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f2de8079820 0x7f2de807bd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:47:04.597 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:04.594+0000 7f2dfffff640 1 -- 172.21.15.150:0/680860891 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 5765+0+0 (secure 0 0 0) 0x7f2e00099ed0 con 0x7f2e0814dbe0 2024-09-17T05:47:04.597 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:04.594+0000 7f2e077fe640 1 --2- 172.21.15.150:0/680860891 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f2de8079820 0x7f2de807bd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:47:04.597 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:04.595+0000 7f2e077fe640 1 --2- 172.21.15.150:0/680860891 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f2de8079820 0x7f2de807bd30 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f2df8033000 tx=0x7f2df802d000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:47:04.599 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:04.599+0000 7f2dfffff640 1 -- 172.21.15.150:0/680860891 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f2e08164930 con 0x7f2e0814dbe0 2024-09-17T05:47:04.774 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:04.774+0000 7f2e0dbe4640 1 -- 172.21.15.150:0/680860891 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "config get", "who": "mgr", "key": "mgr/volumes/max_concurrent_clones"} v 0) -- 0x7f2e0808d090 con 0x7f2e0814dbe0 2024-09-17T05:47:04.775 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:04.774+0000 7f2dfffff640 1 -- 172.21.15.150:0/680860891 <== mon.0 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "config get", "who": "mgr", "key": "mgr/volumes/max_concurrent_clones"}]=0 v41) ==== 116+0+2 (secure 0 0 0) 0x7f2e0808d090 con 0x7f2e0814dbe0 2024-09-17T05:47:04.775 INFO:teuthology.orchestra.run.smithi150.stdout:4 2024-09-17T05:47:04.777 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:04.776+0000 7f2e0dbe4640 1 -- 172.21.15.150:0/680860891 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f2de8079820 msgr2=0x7f2de807bd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:47:04.777 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:04.776+0000 7f2e0dbe4640 1 --2- 172.21.15.150:0/680860891 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f2de8079820 0x7f2de807bd30 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f2df8033000 tx=0x7f2df802d000 comp rx=0 tx=0).stop 2024-09-17T05:47:04.777 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:04.776+0000 7f2e0dbe4640 1 -- 172.21.15.150:0/680860891 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2e0814dbe0 msgr2=0x7f2e081f9b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:47:04.778 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:04.776+0000 7f2e0dbe4640 1 --2- 172.21.15.150:0/680860891 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2e0814dbe0 0x7f2e081f9b10 secure :-1 s=READY pgs=845 cs=0 l=1 rev1=1 crypto rx=0x7f2e080d2320 tx=0x7f2e0000f3c0 comp rx=0 tx=0).stop 2024-09-17T05:47:04.778 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:04.776+0000 7f2e0dbe4640 1 -- 172.21.15.150:0/680860891 shutdown_connections 2024-09-17T05:47:04.778 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:04.776+0000 7f2e0dbe4640 1 --2- 172.21.15.150:0/680860891 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f2de8079820 0x7f2de807bd30 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:47:04.778 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:04.776+0000 7f2e0dbe4640 1 --2- 172.21.15.150:0/680860891 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2e0814dbe0 0x7f2e081f9b10 unknown :-1 s=CLOSED pgs=845 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:47:04.778 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:04.776+0000 7f2e0dbe4640 1 --2- 172.21.15.150:0/680860891 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2e0814d690 0x7f2e081f95d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:47:04.778 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:04.776+0000 7f2e0dbe4640 1 --2- 172.21.15.150:0/680860891 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2df4003a50 0x7f2e081f5900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:47:04.778 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:04.776+0000 7f2e0dbe4640 1 -- 172.21.15.150:0/680860891 >> 172.21.15.150:0/680860891 conn(0x7f2e080d4680 msgr2=0x7f2e0806f470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:47:04.778 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:04.776+0000 7f2e0dbe4640 1 -- 172.21.15.150:0/680860891 shutdown_connections 2024-09-17T05:47:04.778 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:04.776+0000 7f2e0dbe4640 1 -- 172.21.15.150:0/680860891 wait complete. 2024-09-17T05:47:04.789 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mgr mgr/volumes/max_concurrent_clones 4 2024-09-17T05:47:04.905 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:04.904+0000 7fe8bbda1640 1 -- 172.21.15.150:0/3112796507 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe8a0003a00 msgr2=0x7fe8a0003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:47:04.905 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:04.904+0000 7fe8bbda1640 1 --2- 172.21.15.150:0/3112796507 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe8a0003a00 0x7fe8a0003e70 secure :-1 s=READY pgs=847 cs=0 l=1 rev1=1 crypto rx=0x7fe8b0009b40 tx=0x7fe8a0005830 comp rx=0 tx=0).stop 2024-09-17T05:47:04.905 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:04.904+0000 7fe8ba33e640 1 -- 172.21.15.150:0/3112796507 reap_dead start 2024-09-17T05:47:04.905 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:04.904+0000 7fe8bbda1640 1 -- 172.21.15.150:0/3112796507 shutdown_connections 2024-09-17T05:47:04.905 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:04.904+0000 7fe8bbda1640 1 -- 172.21.15.150:0/3112796507 >> 172.21.15.150:0/3112796507 conn(0x7fe8b408bfe0 msgr2=0x7fe8b40d46e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:47:04.905 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:04.904+0000 7fe8bbda1640 1 -- 172.21.15.150:0/3112796507 shutdown_connections 2024-09-17T05:47:04.906 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:04.904+0000 7fe8bbda1640 1 -- 172.21.15.150:0/3112796507 wait complete. 2024-09-17T05:47:04.906 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:04.906+0000 7fe8bbda1640 1 Processor -- start 2024-09-17T05:47:04.906 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:04.906+0000 7fe8bbda1640 1 -- start start 2024-09-17T05:47:04.912 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:04.907+0000 7fe8bbda1640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe8a0003a00 0x7fe8b4151ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:47:04.912 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:04.907+0000 7fe8bbda1640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe8b41f5830 0x7fe8b41f8e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:47:04.912 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:04.907+0000 7fe8bbda1640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe8b41f9360 0x7fe8b41f9770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:47:04.912 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:04.907+0000 7fe8bbda1640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7fe8b40ba160 con 0x7fe8b41f9360 2024-09-17T05:47:04.912 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:04.907+0000 7fe8bbda1640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fe8b40d3220 con 0x7fe8a0003a00 2024-09-17T05:47:04.912 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:04.907+0000 7fe8bbda1640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fe8b406e2b0 con 0x7fe8b41f5830 2024-09-17T05:47:04.912 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:04.907+0000 7fe8ba33e640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe8b41f9360 0x7fe8b41f9770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:47:04.912 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:04.907+0000 7fe8ba33e640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe8b41f9360 0x7fe8b41f9770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:38024/0 (socket says 172.21.15.150:38024) 2024-09-17T05:47:04.912 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:04.907+0000 7fe8ba33e640 1 -- 172.21.15.150:0/2717058957 learned_addr learned my addr 172.21.15.150:0/2717058957 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:47:04.913 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:04.907+0000 7fe8b9b3d640 1 --2- 172.21.15.150:0/2717058957 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe8a0003a00 0x7fe8b4151ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:47:04.913 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:04.907+0000 7fe8b933c640 1 --2- 172.21.15.150:0/2717058957 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe8b41f5830 0x7fe8b41f8e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:47:04.913 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:04.908+0000 7fe8ba33e640 1 -- 172.21.15.150:0/2717058957 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe8b41f5830 msgr2=0x7fe8b41f8e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:47:04.913 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:04.908+0000 7fe8ba33e640 1 --2- 172.21.15.150:0/2717058957 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe8b41f5830 0x7fe8b41f8e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:47:04.913 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:04.908+0000 7fe8ba33e640 1 -- 172.21.15.150:0/2717058957 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe8a0003a00 msgr2=0x7fe8b4151ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:47:04.913 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:04.908+0000 7fe8ba33e640 1 --2- 172.21.15.150:0/2717058957 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe8a0003a00 0x7fe8b4151ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:47:04.913 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:04.908+0000 7fe8ba33e640 1 -- 172.21.15.150:0/2717058957 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe8b41f6010 con 0x7fe8b41f9360 2024-09-17T05:47:04.913 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:04.908+0000 7fe8ba33e640 1 --2- 172.21.15.150:0/2717058957 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe8b41f9360 0x7fe8b41f9770 secure :-1 s=READY pgs=848 cs=0 l=1 rev1=1 crypto rx=0x7fe8b40cb6d0 tx=0x7fe8ac00f3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:47:04.913 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:04.908+0000 7fe8aa7fc640 1 -- 172.21.15.150:0/2717058957 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8ac004b20 con 0x7fe8b41f9360 2024-09-17T05:47:04.913 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:04.908+0000 7fe8aa7fc640 1 -- 172.21.15.150:0/2717058957 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe8ac004cc0 con 0x7fe8b41f9360 2024-09-17T05:47:04.913 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:04.908+0000 7fe8aa7fc640 1 -- 172.21.15.150:0/2717058957 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8ac003bd0 con 0x7fe8b41f9360 2024-09-17T05:47:04.913 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:04.908+0000 7fe8bbda1640 1 -- 172.21.15.150:0/2717058957 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe8b41f62f0 con 0x7fe8b41f9360 2024-09-17T05:47:04.913 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:04.908+0000 7fe8bbda1640 1 -- 172.21.15.150:0/2717058957 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe8b4152000 con 0x7fe8b41f9360 2024-09-17T05:47:04.914 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:04.909+0000 7fe8bbda1640 1 -- 172.21.15.150:0/2717058957 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe8b41f5d80 con 0x7fe8b41f9360 2024-09-17T05:47:04.914 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:04.910+0000 7fe8aa7fc640 1 -- 172.21.15.150:0/2717058957 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 19) ==== 102563+0+0 (secure 0 0 0) 0x7fe8ac004030 con 0x7fe8b41f9360 2024-09-17T05:47:04.914 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:04.910+0000 7fe8aa7fc640 1 --2- 172.21.15.150:0/2717058957 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fe8980797f0 0x7fe89807bd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:47:04.914 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:04.911+0000 7fe8aa7fc640 1 -- 172.21.15.150:0/2717058957 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 5765+0+0 (secure 0 0 0) 0x7fe8ac099be0 con 0x7fe8b41f9360 2024-09-17T05:47:04.914 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:04.911+0000 7fe8b9b3d640 1 --2- 172.21.15.150:0/2717058957 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fe8980797f0 0x7fe89807bd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:47:04.914 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:04.911+0000 7fe8b9b3d640 1 --2- 172.21.15.150:0/2717058957 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fe8980797f0 0x7fe89807bd00 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7fe8b0009b40 tx=0x7fe8b002d040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:47:04.915 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:04.915+0000 7fe8aa7fc640 1 -- 172.21.15.150:0/2717058957 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fe8ac063470 con 0x7fe8b41f9360 2024-09-17T05:47:05.093 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:05.093+0000 7fe8bbda1640 1 -- 172.21.15.150:0/2717058957 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command([{prefix=config set, name=mgr/volumes/max_concurrent_clones}] v 0) -- 0x7fe8b40cc770 con 0x7fe8b41f9360 2024-09-17T05:47:05.099 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:05.099+0000 7fe8aa7fc640 1 -- 172.21.15.150:0/2717058957 <== mon.0 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/volumes/max_concurrent_clones}]=0 v42)=0 v42) ==== 131+0+0 (secure 0 0 0) 0x7fe8ac067ea0 con 0x7fe8b41f9360 2024-09-17T05:47:05.102 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:05.101+0000 7fe8bbda1640 1 -- 172.21.15.150:0/2717058957 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fe8980797f0 msgr2=0x7fe89807bd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:47:05.102 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:05.101+0000 7fe8bbda1640 1 --2- 172.21.15.150:0/2717058957 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fe8980797f0 0x7fe89807bd00 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7fe8b0009b40 tx=0x7fe8b002d040 comp rx=0 tx=0).stop 2024-09-17T05:47:05.102 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:05.101+0000 7fe8bbda1640 1 -- 172.21.15.150:0/2717058957 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe8b41f9360 msgr2=0x7fe8b41f9770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:47:05.102 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:05.101+0000 7fe8bbda1640 1 --2- 172.21.15.150:0/2717058957 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe8b41f9360 0x7fe8b41f9770 secure :-1 s=READY pgs=848 cs=0 l=1 rev1=1 crypto rx=0x7fe8b40cb6d0 tx=0x7fe8ac00f3c0 comp rx=0 tx=0).stop 2024-09-17T05:47:05.102 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:05.101+0000 7fe8bbda1640 1 -- 172.21.15.150:0/2717058957 shutdown_connections 2024-09-17T05:47:05.103 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:05.101+0000 7fe8bbda1640 1 --2- 172.21.15.150:0/2717058957 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fe8980797f0 0x7fe89807bd00 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:47:05.103 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:05.101+0000 7fe8bbda1640 1 --2- 172.21.15.150:0/2717058957 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe8b41f9360 0x7fe8b41f9770 unknown :-1 s=CLOSED pgs=848 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:47:05.103 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:05.101+0000 7fe8bbda1640 1 --2- 172.21.15.150:0/2717058957 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe8b41f5830 0x7fe8b41f8e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:47:05.103 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:05.101+0000 7fe8bbda1640 1 --2- 172.21.15.150:0/2717058957 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe8a0003a00 0x7fe8b4151ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:47:05.103 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:05.101+0000 7fe8bbda1640 1 -- 172.21.15.150:0/2717058957 >> 172.21.15.150:0/2717058957 conn(0x7fe8b408bfe0 msgr2=0x7fe8b40d2250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:47:05.103 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:05.101+0000 7fe8bbda1640 1 -- 172.21.15.150:0/2717058957 shutdown_connections 2024-09-17T05:47:05.103 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:05.101+0000 7fe8bbda1640 1 -- 172.21.15.150:0/2717058957 wait complete. 2024-09-17T05:47:05.114 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mgr mgr/volumes/snapshot_clone_no_wait false 2024-09-17T05:47:05.119 INFO:tasks.ceph.mgr.x.smithi176.stderr:2024-09-17T05:47:05.118+0000 7f33d8f1d640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-17T05:47:05.119 INFO:tasks.ceph.mgr.x.smithi176.stderr:2024-09-17T05:47:05.118+0000 7f33d8f1d640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-17T05:47:05.119 INFO:tasks.ceph.mgr.x.smithi176.stderr:2024-09-17T05:47:05.118+0000 7f33d8f1d640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-17T05:47:05.119 INFO:tasks.ceph.mgr.x.smithi176.stderr:2024-09-17T05:47:05.118+0000 7f33d8f1d640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-17T05:47:05.119 INFO:tasks.ceph.mgr.x.smithi176.stderr:2024-09-17T05:47:05.118+0000 7f33d8f1d640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-17T05:47:05.231 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:05.231+0000 7f564b798640 1 -- 172.21.15.150:0/3253720444 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f562c005250 msgr2=0x7f562c00b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:47:05.232 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:05.231+0000 7f564b798640 1 --2- 172.21.15.150:0/3253720444 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f562c005250 0x7f562c00b9c0 secure :-1 s=READY pgs=850 cs=0 l=1 rev1=1 crypto rx=0x7f56440b0070 tx=0x7f562c005830 comp rx=0 tx=0).stop 2024-09-17T05:47:05.232 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:05.231+0000 7f564b798640 1 -- 172.21.15.150:0/3253720444 shutdown_connections 2024-09-17T05:47:05.232 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:05.231+0000 7f564b798640 1 --2- 172.21.15.150:0/3253720444 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f562c005250 0x7f562c00b9c0 unknown :-1 s=CLOSED pgs=850 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:47:05.232 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:05.231+0000 7f564b798640 1 -- 172.21.15.150:0/3253720444 >> 172.21.15.150:0/3253720444 conn(0x7f564406d1c0 msgr2=0x7f564406d5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:47:05.232 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:05.231+0000 7f564b798640 1 -- 172.21.15.150:0/3253720444 shutdown_connections 2024-09-17T05:47:05.232 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:05.231+0000 7f564b798640 1 -- 172.21.15.150:0/3253720444 wait complete. 2024-09-17T05:47:05.233 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:05.233+0000 7f564b798640 1 Processor -- start 2024-09-17T05:47:05.233 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:05.233+0000 7f564b798640 1 -- start start 2024-09-17T05:47:05.239 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:05.234+0000 7f564b798640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f562c005250 0x7f56441f2f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:47:05.239 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:05.234+0000 7f564b798640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f564413a7d0 0x7f56441393f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:47:05.239 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:05.234+0000 7f564b798640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f564413abe0 0x7f564413d510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:47:05.239 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:05.234+0000 7f564b798640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f5644073540 con 0x7f564413abe0 2024-09-17T05:47:05.239 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:05.234+0000 7f564b798640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f5644070180 con 0x7f562c005250 2024-09-17T05:47:05.239 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:05.234+0000 7f564b798640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f56440736c0 con 0x7f564413a7d0 2024-09-17T05:47:05.239 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:05.234+0000 7f5649d35640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f564413abe0 0x7f564413d510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:47:05.239 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:05.234+0000 7f5649d35640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f564413abe0 0x7f564413d510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:38036/0 (socket says 172.21.15.150:38036) 2024-09-17T05:47:05.240 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:05.234+0000 7f5649d35640 1 -- 172.21.15.150:0/2955676212 learned_addr learned my addr 172.21.15.150:0/2955676212 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:47:05.240 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:05.234+0000 7f5649534640 1 --2- 172.21.15.150:0/2955676212 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f562c005250 0x7f56441f2f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:47:05.240 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:05.234+0000 7f5648d33640 1 --2- 172.21.15.150:0/2955676212 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f564413a7d0 0x7f56441393f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:47:05.240 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:05.234+0000 7f5649d35640 1 -- 172.21.15.150:0/2955676212 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f564413a7d0 msgr2=0x7f56441393f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:47:05.240 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:05.234+0000 7f5649d35640 1 --2- 172.21.15.150:0/2955676212 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f564413a7d0 0x7f56441393f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:47:05.240 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:05.234+0000 7f5649d35640 1 -- 172.21.15.150:0/2955676212 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f562c005250 msgr2=0x7f56441f2f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:47:05.240 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:05.234+0000 7f5649d35640 1 --2- 172.21.15.150:0/2955676212 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f562c005250 0x7f56441f2f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:47:05.240 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:05.234+0000 7f5649d35640 1 -- 172.21.15.150:0/2955676212 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f56441f3830 con 0x7f564413abe0 2024-09-17T05:47:05.240 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:05.234+0000 7f5649d35640 1 --2- 172.21.15.150:0/2955676212 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f564413abe0 0x7f564413d510 secure :-1 s=READY pgs=851 cs=0 l=1 rev1=1 crypto rx=0x7f563c000ff0 tx=0x7f563c006380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:47:05.240 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:05.235+0000 7f5641ffb640 1 -- 172.21.15.150:0/2955676212 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f563c037070 con 0x7f564413abe0 2024-09-17T05:47:05.240 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:05.235+0000 7f5641ffb640 1 -- 172.21.15.150:0/2955676212 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f563c003af0 con 0x7f564413abe0 2024-09-17T05:47:05.240 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:05.235+0000 7f564b798640 1 -- 172.21.15.150:0/2955676212 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f56441f3b10 con 0x7f564413abe0 2024-09-17T05:47:05.240 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:05.235+0000 7f5641ffb640 1 -- 172.21.15.150:0/2955676212 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f563c032410 con 0x7f564413abe0 2024-09-17T05:47:05.241 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:05.235+0000 7f564b798640 1 -- 172.21.15.150:0/2955676212 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5644139930 con 0x7f564413abe0 2024-09-17T05:47:05.241 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:05.236+0000 7f564b798640 1 -- 172.21.15.150:0/2955676212 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f56441f35a0 con 0x7f564413abe0 2024-09-17T05:47:05.241 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:05.237+0000 7f5641ffb640 1 -- 172.21.15.150:0/2955676212 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 19) ==== 102563+0+0 (secure 0 0 0) 0x7f563c030020 con 0x7f564413abe0 2024-09-17T05:47:05.241 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:05.237+0000 7f5641ffb640 1 --2- 172.21.15.150:0/2955676212 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f56300797f0 0x7f563007bd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:47:05.241 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:05.237+0000 7f5641ffb640 1 -- 172.21.15.150:0/2955676212 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 5765+0+0 (secure 0 0 0) 0x7f563c0b8b40 con 0x7f564413abe0 2024-09-17T05:47:05.241 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:05.237+0000 7f5649534640 1 --2- 172.21.15.150:0/2955676212 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f56300797f0 0x7f563007bd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:47:05.241 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:05.238+0000 7f5649534640 1 --2- 172.21.15.150:0/2955676212 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f56300797f0 0x7f563007bd00 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f5634005fd0 tx=0x7f5634009500 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:47:05.242 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:05.241+0000 7f5641ffb640 1 -- 172.21.15.150:0/2955676212 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f563c0821f0 con 0x7f564413abe0 2024-09-17T05:47:05.418 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:05.418+0000 7f564b798640 1 -- 172.21.15.150:0/2955676212 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command([{prefix=config set, name=mgr/volumes/snapshot_clone_no_wait}] v 0) -- 0x7f5644073c20 con 0x7f564413abe0 2024-09-17T05:47:05.422 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:05.422+0000 7f5641ffb640 1 -- 172.21.15.150:0/2955676212 <== mon.0 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/volumes/snapshot_clone_no_wait}]=0 v43)=0 v43) ==== 136+0+0 (secure 0 0 0) 0x7f563c086c20 con 0x7f564413abe0 2024-09-17T05:47:05.425 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:05.424+0000 7f564b798640 1 -- 172.21.15.150:0/2955676212 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f56300797f0 msgr2=0x7f563007bd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:47:05.425 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:05.424+0000 7f564b798640 1 --2- 172.21.15.150:0/2955676212 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f56300797f0 0x7f563007bd00 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f5634005fd0 tx=0x7f5634009500 comp rx=0 tx=0).stop 2024-09-17T05:47:05.425 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:05.424+0000 7f564b798640 1 -- 172.21.15.150:0/2955676212 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f564413abe0 msgr2=0x7f564413d510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:47:05.426 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:05.424+0000 7f564b798640 1 --2- 172.21.15.150:0/2955676212 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f564413abe0 0x7f564413d510 secure :-1 s=READY pgs=851 cs=0 l=1 rev1=1 crypto rx=0x7f563c000ff0 tx=0x7f563c006380 comp rx=0 tx=0).stop 2024-09-17T05:47:05.426 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:05.424+0000 7f564b798640 1 -- 172.21.15.150:0/2955676212 shutdown_connections 2024-09-17T05:47:05.426 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:05.424+0000 7f564b798640 1 --2- 172.21.15.150:0/2955676212 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f56300797f0 0x7f563007bd00 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:47:05.426 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:05.424+0000 7f564b798640 1 --2- 172.21.15.150:0/2955676212 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f564413abe0 0x7f564413d510 unknown :-1 s=CLOSED pgs=851 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:47:05.426 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:05.424+0000 7f564b798640 1 --2- 172.21.15.150:0/2955676212 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f564413a7d0 0x7f56441393f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:47:05.426 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:05.424+0000 7f564b798640 1 --2- 172.21.15.150:0/2955676212 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f562c005250 0x7f56441f2f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:47:05.426 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:05.424+0000 7f564b798640 1 -- 172.21.15.150:0/2955676212 >> 172.21.15.150:0/2955676212 conn(0x7f564406d1c0 msgr2=0x7f5644141aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:47:05.426 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:05.424+0000 7f564b798640 1 -- 172.21.15.150:0/2955676212 shutdown_connections 2024-09-17T05:47:05.426 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:05.425+0000 7f564b798640 1 -- 172.21.15.150:0/2955676212 wait complete. 2024-09-17T05:47:05.437 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume create cephfs sv1 --mode=777 2024-09-17T05:47:05.555 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:05.554+0000 7f5dff277640 1 -- 172.21.15.150:0/2602044834 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5df80b3580 msgr2=0x7f5df80d2c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:47:05.555 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:05.554+0000 7f5dff277640 1 --2- 172.21.15.150:0/2602044834 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5df80b3580 0x7f5df80d2c10 secure :-1 s=READY pgs=852 cs=0 l=1 rev1=1 crypto rx=0x7f5df808cc20 tx=0x7f5df402a4b0 comp rx=0 tx=0).stop 2024-09-17T05:47:05.555 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:05.554+0000 7f5dff277640 1 -- 172.21.15.150:0/2602044834 shutdown_connections 2024-09-17T05:47:05.555 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:05.554+0000 7f5dff277640 1 --2- 172.21.15.150:0/2602044834 >> v2:172.21.15.176:3300/0 conn(0x7f5df80b6160 0x7f5df80b6570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:47:05.555 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:05.554+0000 7f5dff277640 1 --2- 172.21.15.150:0/2602044834 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5df80b3ad0 0x7f5df80d3150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:47:05.555 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:05.554+0000 7f5dff277640 1 --2- 172.21.15.150:0/2602044834 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5df80b3580 0x7f5df80d2c10 unknown :-1 s=CLOSED pgs=852 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:47:05.555 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:05.554+0000 7f5dff277640 1 -- 172.21.15.150:0/2602044834 >> 172.21.15.150:0/2602044834 conn(0x7f5df80d46e0 msgr2=0x7f5df80d4af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:47:05.555 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:05.554+0000 7f5dff277640 1 -- 172.21.15.150:0/2602044834 shutdown_connections 2024-09-17T05:47:05.556 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:05.554+0000 7f5dff277640 1 -- 172.21.15.150:0/2602044834 wait complete. 2024-09-17T05:47:05.556 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:05.556+0000 7f5dff277640 1 Processor -- start 2024-09-17T05:47:05.556 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:05.556+0000 7f5dff277640 1 -- start start 2024-09-17T05:47:05.559 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:05.557+0000 7f5dff277640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5df80b3580 0x7f5df8156210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:47:05.559 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:05.557+0000 7f5dff277640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5df80b3ad0 0x7f5df814dba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:47:05.559 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:05.557+0000 7f5dff277640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5df80b6160 0x7f5df80b5150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:47:05.559 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:05.557+0000 7f5dff277640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f5df80ba1c0 con 0x7f5df80b6160 2024-09-17T05:47:05.559 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:05.557+0000 7f5dff277640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f5df80ba040 con 0x7f5df80b3ad0 2024-09-17T05:47:05.559 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:05.557+0000 7f5dff277640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f5df80b6ab0 con 0x7f5df80b3580 2024-09-17T05:47:05.559 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:05.557+0000 7f5dfd814640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5df80b6160 0x7f5df80b5150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:47:05.559 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:05.557+0000 7f5dfd814640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5df80b6160 0x7f5df80b5150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:38052/0 (socket says 172.21.15.150:38052) 2024-09-17T05:47:05.559 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:05.557+0000 7f5dfd814640 1 -- 172.21.15.150:0/3541804204 learned_addr learned my addr 172.21.15.150:0/3541804204 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:47:05.559 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:05.557+0000 7f5dfd013640 1 --2- 172.21.15.150:0/3541804204 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5df80b3580 0x7f5df8156210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:47:05.559 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:05.557+0000 7f5dfc812640 1 --2- 172.21.15.150:0/3541804204 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5df80b3ad0 0x7f5df814dba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:47:05.560 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:05.557+0000 7f5dfd814640 1 -- 172.21.15.150:0/3541804204 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5df80b3580 msgr2=0x7f5df8156210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:47:05.560 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:05.557+0000 7f5dfd814640 1 --2- 172.21.15.150:0/3541804204 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5df80b3580 0x7f5df8156210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:47:05.560 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:05.557+0000 7f5dfd814640 1 -- 172.21.15.150:0/3541804204 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5df80b3ad0 msgr2=0x7f5df814dba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:47:05.560 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:05.557+0000 7f5dfd814640 1 --2- 172.21.15.150:0/3541804204 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5df80b3ad0 0x7f5df814dba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:47:05.560 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:05.557+0000 7f5dfd814640 1 -- 172.21.15.150:0/3541804204 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5df80c97f0 con 0x7f5df80b6160 2024-09-17T05:47:05.560 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:05.557+0000 7f5dfc812640 1 --2- 172.21.15.150:0/3541804204 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5df80b3ad0 0x7f5df814dba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T05:47:05.560 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:05.558+0000 7f5dfd814640 1 --2- 172.21.15.150:0/3541804204 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5df80b6160 0x7f5df80b5150 secure :-1 s=READY pgs=853 cs=0 l=1 rev1=1 crypto rx=0x7f5df000e990 tx=0x7f5df000ee50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:47:05.560 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:05.558+0000 7f5dedffb640 1 -- 172.21.15.150:0/3541804204 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5df0004d20 con 0x7f5df80b6160 2024-09-17T05:47:05.560 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:05.558+0000 7f5dedffb640 1 -- 172.21.15.150:0/3541804204 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f5df000caa0 con 0x7f5df80b6160 2024-09-17T05:47:05.560 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:05.558+0000 7f5dedffb640 1 -- 172.21.15.150:0/3541804204 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5df0005020 con 0x7f5df80b6160 2024-09-17T05:47:05.560 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:05.558+0000 7f5dff277640 1 -- 172.21.15.150:0/3541804204 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5df80c9ad0 con 0x7f5df80b6160 2024-09-17T05:47:05.560 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:05.558+0000 7f5dff277640 1 -- 172.21.15.150:0/3541804204 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5df80ca090 con 0x7f5df80b6160 2024-09-17T05:47:05.561 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:05.559+0000 7f5dff277640 1 -- 172.21.15.150:0/3541804204 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5df808d090 con 0x7f5df80b6160 2024-09-17T05:47:05.561 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:05.560+0000 7f5dedffb640 1 -- 172.21.15.150:0/3541804204 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 19) ==== 102563+0+0 (secure 0 0 0) 0x7f5df00051c0 con 0x7f5df80b6160 2024-09-17T05:47:05.561 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:05.560+0000 7f5dedffb640 1 --2- 172.21.15.150:0/3541804204 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f5ddc079820 0x7f5ddc07bd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:47:05.561 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:05.560+0000 7f5dedffb640 1 -- 172.21.15.150:0/3541804204 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 5765+0+0 (secure 0 0 0) 0x7f5df0099f80 con 0x7f5df80b6160 2024-09-17T05:47:05.561 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:05.560+0000 7f5dfd013640 1 --2- 172.21.15.150:0/3541804204 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f5ddc079820 0x7f5ddc07bd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:47:05.562 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:05.561+0000 7f5dfd013640 1 --2- 172.21.15.150:0/3541804204 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f5ddc079820 0x7f5ddc07bd30 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f5df4034000 tx=0x7f5df4004730 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:47:05.565 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:05.565+0000 7f5dedffb640 1 -- 172.21.15.150:0/3541804204 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f5df808d090 con 0x7f5df80b6160 2024-09-17T05:47:05.769 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:05.768+0000 7f5dff277640 1 -- 172.21.15.150:0/3541804204 --> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] -- mgr_command(tid 0: {"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv1", "mode": "777", "target": ["mon-mgr", ""]}) -- 0x7f5df80b6570 con 0x7f5ddc079820 2024-09-17T05:47:05.777 INFO:tasks.ceph.mgr.x.smithi176.stderr:2024-09-17T05:47:05.776+0000 7f33d771a640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-17T05:47:05.777 INFO:tasks.ceph.mgr.x.smithi176.stderr:2024-09-17T05:47:05.776+0000 7f33d771a640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-17T05:47:05.778 INFO:tasks.ceph.mgr.x.smithi176.stderr:2024-09-17T05:47:05.776+0000 7f33d771a640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-17T05:47:05.778 INFO:tasks.ceph.mgr.x.smithi176.stderr:2024-09-17T05:47:05.776+0000 7f33d771a640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-17T05:47:05.778 INFO:tasks.ceph.mgr.x.smithi176.stderr:2024-09-17T05:47:05.776+0000 7f33d771a640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-17T05:47:05.809 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:05.809+0000 7f5dedffb640 1 -- 172.21.15.150:0/3541804204 <== mgr.4108 v2:172.21.15.176:6800/3631216395 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f5df80b6570 con 0x7f5ddc079820 2024-09-17T05:47:05.812 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:05.811+0000 7f5dff277640 1 -- 172.21.15.150:0/3541804204 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f5ddc079820 msgr2=0x7f5ddc07bd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:47:05.813 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:05.811+0000 7f5dff277640 1 --2- 172.21.15.150:0/3541804204 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f5ddc079820 0x7f5ddc07bd30 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f5df4034000 tx=0x7f5df4004730 comp rx=0 tx=0).stop 2024-09-17T05:47:05.813 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:05.811+0000 7f5dff277640 1 -- 172.21.15.150:0/3541804204 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5df80b6160 msgr2=0x7f5df80b5150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:47:05.813 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:05.811+0000 7f5dff277640 1 --2- 172.21.15.150:0/3541804204 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5df80b6160 0x7f5df80b5150 secure :-1 s=READY pgs=853 cs=0 l=1 rev1=1 crypto rx=0x7f5df000e990 tx=0x7f5df000ee50 comp rx=0 tx=0).stop 2024-09-17T05:47:05.813 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:05.811+0000 7f5dff277640 1 -- 172.21.15.150:0/3541804204 shutdown_connections 2024-09-17T05:47:05.813 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:05.811+0000 7f5dff277640 1 --2- 172.21.15.150:0/3541804204 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5df80b3ad0 0x7f5df814dba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:47:05.813 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:05.811+0000 7f5dff277640 1 --2- 172.21.15.150:0/3541804204 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f5ddc079820 0x7f5ddc07bd30 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:47:05.813 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:05.811+0000 7f5dff277640 1 --2- 172.21.15.150:0/3541804204 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5df80b6160 0x7f5df80b5150 unknown :-1 s=CLOSED pgs=853 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:47:05.813 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:05.811+0000 7f5dff277640 1 --2- 172.21.15.150:0/3541804204 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5df80b3580 0x7f5df8156210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:47:05.813 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:05.812+0000 7f5dff277640 1 -- 172.21.15.150:0/3541804204 >> 172.21.15.150:0/3541804204 conn(0x7f5df80d46e0 msgr2=0x7f5df80b7530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:47:05.813 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:05.812+0000 7f5dff277640 1 -- 172.21.15.150:0/3541804204 shutdown_connections 2024-09-17T05:47:05.813 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:05.812+0000 7f5dff277640 1 -- 172.21.15.150:0/3541804204 wait complete. 2024-09-17T05:47:05.824 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume getpath cephfs sv1 2024-09-17T05:47:05.941 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:05.940+0000 7f2284a15640 1 -- 172.21.15.150:0/2147820724 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f226c004800 msgr2=0x7f226c004c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:47:05.941 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:05.940+0000 7f2284a15640 1 --2- 172.21.15.150:0/2147820724 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f226c004800 0x7f226c004c10 secure :-1 s=READY pgs=855 cs=0 l=1 rev1=1 crypto rx=0x7f2268009b50 tx=0x7f226c005830 comp rx=0 tx=0).stop 2024-09-17T05:47:05.941 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:05.940+0000 7f227ed9d640 1 -- 172.21.15.150:0/2147820724 reap_dead start 2024-09-17T05:47:05.941 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:05.940+0000 7f2284a15640 1 -- 172.21.15.150:0/2147820724 shutdown_connections 2024-09-17T05:47:05.941 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:05.940+0000 7f2284a15640 1 -- 172.21.15.150:0/2147820724 >> 172.21.15.150:0/2147820724 conn(0x7f228006d1c0 msgr2=0x7f228006d5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:47:05.941 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:05.940+0000 7f2284a15640 1 -- 172.21.15.150:0/2147820724 shutdown_connections 2024-09-17T05:47:05.941 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:05.940+0000 7f2284a15640 1 -- 172.21.15.150:0/2147820724 wait complete. 2024-09-17T05:47:05.942 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:05.942+0000 7f2284a15640 1 Processor -- start 2024-09-17T05:47:05.943 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:05.942+0000 7f2284a15640 1 -- start start 2024-09-17T05:47:05.945 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:05.943+0000 7f2284a15640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f226c004800 0x7f22801f6cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:47:05.945 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:05.943+0000 7f2284a15640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f22801575b0 0x7f2280156210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:47:05.945 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:05.943+0000 7f2284a15640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2280156750 0x7f228013b860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:47:05.946 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:05.943+0000 7f2284a15640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f22800cf6f0 con 0x7f2280156750 2024-09-17T05:47:05.946 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:05.943+0000 7f2284a15640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f22800cf570 con 0x7f226c004800 2024-09-17T05:47:05.946 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:05.943+0000 7f2284a15640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f22800cf870 con 0x7f22801575b0 2024-09-17T05:47:05.946 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:05.943+0000 7f227ed9d640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2280156750 0x7f228013b860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:47:05.946 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:05.943+0000 7f227ed9d640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2280156750 0x7f228013b860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:38078/0 (socket says 172.21.15.150:38078) 2024-09-17T05:47:05.946 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:05.943+0000 7f227ed9d640 1 -- 172.21.15.150:0/3477068767 learned_addr learned my addr 172.21.15.150:0/3477068767 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:47:05.946 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:05.944+0000 7f227e59c640 1 --2- 172.21.15.150:0/3477068767 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f226c004800 0x7f22801f6cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:47:05.946 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:05.944+0000 7f2275d9b640 1 --2- 172.21.15.150:0/3477068767 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f22801575b0 0x7f2280156210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:47:05.946 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:05.944+0000 7f227ed9d640 1 -- 172.21.15.150:0/3477068767 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f22801575b0 msgr2=0x7f2280156210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:47:05.946 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:05.944+0000 7f227ed9d640 1 --2- 172.21.15.150:0/3477068767 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f22801575b0 0x7f2280156210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:47:05.946 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:05.944+0000 7f227ed9d640 1 -- 172.21.15.150:0/3477068767 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f226c004800 msgr2=0x7f22801f6cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:47:05.946 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:05.944+0000 7f227ed9d640 1 --2- 172.21.15.150:0/3477068767 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f226c004800 0x7f22801f6cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:47:05.946 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:05.944+0000 7f227ed9d640 1 -- 172.21.15.150:0/3477068767 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f22801f6220 con 0x7f2280156750 2024-09-17T05:47:05.947 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:05.944+0000 7f2275d9b640 1 --2- 172.21.15.150:0/3477068767 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f22801575b0 0x7f2280156210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T05:47:05.947 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:05.944+0000 7f227ed9d640 1 --2- 172.21.15.150:0/3477068767 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2280156750 0x7f228013b860 secure :-1 s=READY pgs=856 cs=0 l=1 rev1=1 crypto rx=0x7f2280070ff0 tx=0x7f2278006710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:47:05.947 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:05.944+0000 7f22777fe640 1 -- 172.21.15.150:0/3477068767 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f227800e7b0 con 0x7f2280156750 2024-09-17T05:47:05.947 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:05.944+0000 7f22777fe640 1 -- 172.21.15.150:0/3477068767 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f227800ea40 con 0x7f2280156750 2024-09-17T05:47:05.947 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:05.944+0000 7f2284a15640 1 -- 172.21.15.150:0/3477068767 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f22801590f0 con 0x7f2280156750 2024-09-17T05:47:05.947 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:05.944+0000 7f22777fe640 1 -- 172.21.15.150:0/3477068767 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f227800ee90 con 0x7f2280156750 2024-09-17T05:47:05.947 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:05.944+0000 7f2284a15640 1 -- 172.21.15.150:0/3477068767 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f22801f64c0 con 0x7f2280156750 2024-09-17T05:47:05.948 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:05.945+0000 7f2284a15640 1 -- 172.21.15.150:0/3477068767 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f22800b5990 con 0x7f2280156750 2024-09-17T05:47:05.948 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:05.946+0000 7f22777fe640 1 -- 172.21.15.150:0/3477068767 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 19) ==== 102563+0+0 (secure 0 0 0) 0x7f2278019020 con 0x7f2280156750 2024-09-17T05:47:05.948 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:05.947+0000 7f22777fe640 1 --2- 172.21.15.150:0/3477068767 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f22600799c0 0x7f226007bed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:47:05.948 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:05.947+0000 7f22777fe640 1 -- 172.21.15.150:0/3477068767 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 5765+0+0 (secure 0 0 0) 0x7f2278099650 con 0x7f2280156750 2024-09-17T05:47:05.948 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:05.947+0000 7f227e59c640 1 --2- 172.21.15.150:0/3477068767 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f22600799c0 0x7f226007bed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:47:05.948 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:05.948+0000 7f227e59c640 1 --2- 172.21.15.150:0/3477068767 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f22600799c0 0x7f226007bed0 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f2270009a00 tx=0x7f2270005f90 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:47:05.952 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:05.951+0000 7f22777fe640 1 -- 172.21.15.150:0/3477068767 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f22800b5990 con 0x7f2280156750 2024-09-17T05:47:06.155 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:06.155+0000 7f2284a15640 1 -- 172.21.15.150:0/3477068767 --> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "sub_name": "sv1", "target": ["mon-mgr", ""]}) -- 0x7f2280073630 con 0x7f22600799c0 2024-09-17T05:47:06.161 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:06.161+0000 7f22777fe640 1 -- 172.21.15.150:0/3477068767 <== mgr.4108 v2:172.21.15.176:6800/3631216395 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+59 (secure 0 0 0) 0x7f2280073630 con 0x7f22600799c0 2024-09-17T05:47:06.161 INFO:teuthology.orchestra.run.smithi150.stdout:/volumes/_nogroup/sv1/bbc2e0d1-5f85-4b0d-a1bb-96e9f9d44967 2024-09-17T05:47:06.164 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:06.163+0000 7f2284a15640 1 -- 172.21.15.150:0/3477068767 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f22600799c0 msgr2=0x7f226007bed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:47:06.164 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:06.163+0000 7f2284a15640 1 --2- 172.21.15.150:0/3477068767 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f22600799c0 0x7f226007bed0 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f2270009a00 tx=0x7f2270005f90 comp rx=0 tx=0).stop 2024-09-17T05:47:06.164 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:06.163+0000 7f2284a15640 1 -- 172.21.15.150:0/3477068767 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2280156750 msgr2=0x7f228013b860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:47:06.164 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:06.163+0000 7f2284a15640 1 --2- 172.21.15.150:0/3477068767 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2280156750 0x7f228013b860 secure :-1 s=READY pgs=856 cs=0 l=1 rev1=1 crypto rx=0x7f2280070ff0 tx=0x7f2278006710 comp rx=0 tx=0).stop 2024-09-17T05:47:06.164 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:06.163+0000 7f2284a15640 1 -- 172.21.15.150:0/3477068767 shutdown_connections 2024-09-17T05:47:06.164 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:06.163+0000 7f2284a15640 1 --2- 172.21.15.150:0/3477068767 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f22600799c0 0x7f226007bed0 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:47:06.164 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:06.163+0000 7f2284a15640 1 --2- 172.21.15.150:0/3477068767 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2280156750 0x7f228013b860 unknown :-1 s=CLOSED pgs=856 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:47:06.164 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:06.163+0000 7f2284a15640 1 --2- 172.21.15.150:0/3477068767 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f22801575b0 0x7f2280156210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:47:06.165 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:06.163+0000 7f2284a15640 1 --2- 172.21.15.150:0/3477068767 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f226c004800 0x7f22801f6cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:47:06.165 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:06.163+0000 7f2284a15640 1 -- 172.21.15.150:0/3477068767 >> 172.21.15.150:0/3477068767 conn(0x7f228006d1c0 msgr2=0x7f22800b3af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:47:06.165 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:06.163+0000 7f2284a15640 1 -- 172.21.15.150:0/3477068767 shutdown_connections 2024-09-17T05:47:06.165 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:06.163+0000 7f2284a15640 1 -- 172.21.15.150:0/3477068767 wait complete. 2024-09-17T05:47:06.176 DEBUG:tasks.cephfs.test_volumes:filling subvolume sv1 with 3 files each 1024MB size under directory volumes/_nogroup/sv1/bbc2e0d1-5f85-4b0d-a1bb-96e9f9d44967 2024-09-17T05:47:06.176 DEBUG:teuthology.orchestra.run.smithi150:> set -ex 2024-09-17T05:47:06.176 DEBUG:teuthology.orchestra.run.smithi150:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T05:47:06.192 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:47:06.192 DEBUG:teuthology.orchestra.run.smithi150:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/sv1/bbc2e0d1-5f85-4b0d-a1bb-96e9f9d44967/subvolume_file.0 bs=1M conv=fdatasync count=1024 seek=0) 2024-09-17T05:47:10.021 INFO:teuthology.orchestra.run.smithi150.stderr:1024+0 records in 2024-09-17T05:47:10.021 INFO:teuthology.orchestra.run.smithi150.stderr:1024+0 records out 2024-09-17T05:47:10.021 INFO:teuthology.orchestra.run.smithi150.stderr:1073741824 bytes (1.1 GB, 1.0 GiB) copied, 3.76672 s, 285 MB/s 2024-09-17T05:47:10.021 DEBUG:teuthology.orchestra.run.smithi150:> set -ex 2024-09-17T05:47:10.022 DEBUG:teuthology.orchestra.run.smithi150:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T05:47:10.037 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:47:10.038 DEBUG:teuthology.orchestra.run.smithi150:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/sv1/bbc2e0d1-5f85-4b0d-a1bb-96e9f9d44967/subvolume_file.1 bs=1M conv=fdatasync count=1024 seek=0) 2024-09-17T05:47:13.878 INFO:teuthology.orchestra.run.smithi150.stderr:1024+0 records in 2024-09-17T05:47:13.878 INFO:teuthology.orchestra.run.smithi150.stderr:1024+0 records out 2024-09-17T05:47:13.878 INFO:teuthology.orchestra.run.smithi150.stderr:1073741824 bytes (1.1 GB, 1.0 GiB) copied, 3.78254 s, 284 MB/s 2024-09-17T05:47:13.878 DEBUG:teuthology.orchestra.run.smithi150:> set -ex 2024-09-17T05:47:13.879 DEBUG:teuthology.orchestra.run.smithi150:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T05:47:13.894 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:47:13.895 DEBUG:teuthology.orchestra.run.smithi150:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/sv1/bbc2e0d1-5f85-4b0d-a1bb-96e9f9d44967/subvolume_file.2 bs=1M conv=fdatasync count=1024 seek=0) 2024-09-17T05:47:17.732 INFO:teuthology.orchestra.run.smithi150.stderr:1024+0 records in 2024-09-17T05:47:17.732 INFO:teuthology.orchestra.run.smithi150.stderr:1024+0 records out 2024-09-17T05:47:17.732 INFO:teuthology.orchestra.run.smithi150.stderr:1073741824 bytes (1.1 GB, 1.0 GiB) copied, 3.78034 s, 284 MB/s 2024-09-17T05:47:17.733 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume snapshot create cephfs sv1 ss1 2024-09-17T05:47:17.853 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:17.850+0000 7f7b4496e640 1 -- 172.21.15.150:0/723229820 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7b28003a00 msgr2=0x7f7b28003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:47:17.853 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:17.850+0000 7f7b4496e640 1 --2- 172.21.15.150:0/723229820 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7b28003a00 0x7f7b28003e70 secure :-1 s=READY pgs=858 cs=0 l=1 rev1=1 crypto rx=0x7f7b3000c290 tx=0x7f7b28005830 comp rx=0 tx=0).stop 2024-09-17T05:47:17.853 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:17.851+0000 7f7b3ed9d640 1 -- 172.21.15.150:0/723229820 reap_dead start 2024-09-17T05:47:17.853 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:17.851+0000 7f7b4496e640 1 -- 172.21.15.150:0/723229820 shutdown_connections 2024-09-17T05:47:17.853 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:17.851+0000 7f7b4496e640 1 -- 172.21.15.150:0/723229820 >> 172.21.15.150:0/723229820 conn(0x7f7b400cee80 msgr2=0x7f7b400cf290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:47:17.853 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:17.851+0000 7f7b4496e640 1 -- 172.21.15.150:0/723229820 shutdown_connections 2024-09-17T05:47:17.853 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:17.851+0000 7f7b4496e640 1 -- 172.21.15.150:0/723229820 wait complete. 2024-09-17T05:47:17.854 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:17.853+0000 7f7b4496e640 1 Processor -- start 2024-09-17T05:47:17.854 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:17.853+0000 7f7b4496e640 1 -- start start 2024-09-17T05:47:17.857 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:17.854+0000 7f7b4496e640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7b28003a00 0x7f7b401529a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:47:17.857 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:17.854+0000 7f7b4496e640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7b4015ae80 0x7f7b401f7ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:47:17.857 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:17.854+0000 7f7b4496e640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7b401f45d0 0x7f7b4009e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:47:17.857 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:17.854+0000 7f7b4496e640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f7b4009baf0 con 0x7f7b28003a00 2024-09-17T05:47:17.857 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:17.854+0000 7f7b4496e640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f7b400b5960 con 0x7f7b401f45d0 2024-09-17T05:47:17.858 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:17.854+0000 7f7b4496e640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f7b4009bc70 con 0x7f7b4015ae80 2024-09-17T05:47:17.858 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:17.854+0000 7f7b3e59c640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7b28003a00 0x7f7b401529a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:47:17.858 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:17.854+0000 7f7b3e59c640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7b28003a00 0x7f7b401529a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:39342/0 (socket says 172.21.15.150:39342) 2024-09-17T05:47:17.858 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:17.854+0000 7f7b3e59c640 1 -- 172.21.15.150:0/3497228559 learned_addr learned my addr 172.21.15.150:0/3497228559 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:47:17.858 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:17.854+0000 7f7b3dd9b640 1 --2- 172.21.15.150:0/3497228559 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7b4015ae80 0x7f7b401f7ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:47:17.858 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:17.854+0000 7f7b3ed9d640 1 --2- 172.21.15.150:0/3497228559 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7b401f45d0 0x7f7b4009e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:47:17.858 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:17.854+0000 7f7b3e59c640 1 -- 172.21.15.150:0/3497228559 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7b4015ae80 msgr2=0x7f7b401f7ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:47:17.858 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:17.854+0000 7f7b3e59c640 1 --2- 172.21.15.150:0/3497228559 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7b4015ae80 0x7f7b401f7ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:47:17.858 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:17.854+0000 7f7b3e59c640 1 -- 172.21.15.150:0/3497228559 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7b401f45d0 msgr2=0x7f7b4009e770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:47:17.858 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:17.854+0000 7f7b3e59c640 1 --2- 172.21.15.150:0/3497228559 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7b401f45d0 0x7f7b4009e770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:47:17.858 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:17.854+0000 7f7b3e59c640 1 -- 172.21.15.150:0/3497228559 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7b401f7310 con 0x7f7b28003a00 2024-09-17T05:47:17.858 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:17.855+0000 7f7b3e59c640 1 --2- 172.21.15.150:0/3497228559 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7b28003a00 0x7f7b401529a0 secure :-1 s=READY pgs=859 cs=0 l=1 rev1=1 crypto rx=0x7f7b3000c3b0 tx=0x7f7b30006380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:47:17.858 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:17.855+0000 7f7b2effd640 1 -- 172.21.15.150:0/3497228559 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b30031050 con 0x7f7b28003a00 2024-09-17T05:47:17.859 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:17.855+0000 7f7b2effd640 1 -- 172.21.15.150:0/3497228559 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f7b30003a20 con 0x7f7b28003a00 2024-09-17T05:47:17.859 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:17.855+0000 7f7b4496e640 1 -- 172.21.15.150:0/3497228559 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7b4009d1d0 con 0x7f7b28003a00 2024-09-17T05:47:17.859 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:17.855+0000 7f7b2effd640 1 -- 172.21.15.150:0/3497228559 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b30000f20 con 0x7f7b28003a00 2024-09-17T05:47:17.859 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:17.855+0000 7f7b4496e640 1 -- 172.21.15.150:0/3497228559 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7b4009cef0 con 0x7f7b28003a00 2024-09-17T05:47:17.859 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:17.856+0000 7f7b4496e640 1 -- 172.21.15.150:0/3497228559 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7b400ccc60 con 0x7f7b28003a00 2024-09-17T05:47:17.860 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:17.857+0000 7f7b2effd640 1 -- 172.21.15.150:0/3497228559 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 20) ==== 102665+0+0 (secure 0 0 0) 0x7f7b3002c490 con 0x7f7b28003a00 2024-09-17T05:47:17.860 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:17.857+0000 7f7b2effd640 1 --2- 172.21.15.150:0/3497228559 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f7b20079910 0x7f7b2007be20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:47:17.860 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:17.857+0000 7f7b2effd640 1 -- 172.21.15.150:0/3497228559 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 5765+0+0 (secure 0 0 0) 0x7f7b300b9e20 con 0x7f7b28003a00 2024-09-17T05:47:17.860 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:17.857+0000 7f7b3dd9b640 1 --2- 172.21.15.150:0/3497228559 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f7b20079910 0x7f7b2007be20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:47:17.860 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:17.858+0000 7f7b3dd9b640 1 --2- 172.21.15.150:0/3497228559 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f7b20079910 0x7f7b2007be20 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f7b4009b3a0 tx=0x7f7b34005f90 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:47:17.863 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:17.862+0000 7f7b2effd640 1 -- 172.21.15.150:0/3497228559 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f7b400ccc60 con 0x7f7b28003a00 2024-09-17T05:47:18.065 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:18.063+0000 7f7b4496e640 1 -- 172.21.15.150:0/3497228559 --> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] -- mgr_command(tid 0: {"prefix": "fs subvolume snapshot create", "vol_name": "cephfs", "sub_name": "sv1", "snap_name": "ss1", "target": ["mon-mgr", ""]}) -- 0x7f7b400d0ee0 con 0x7f7b20079910 2024-09-17T05:47:18.079 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:18.077+0000 7f7b2effd640 1 -- 172.21.15.150:0/3497228559 <== mgr.4108 v2:172.21.15.176:6800/3631216395 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f7b400d0ee0 con 0x7f7b20079910 2024-09-17T05:47:18.081 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:18.079+0000 7f7b4496e640 1 -- 172.21.15.150:0/3497228559 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f7b20079910 msgr2=0x7f7b2007be20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:47:18.081 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:18.079+0000 7f7b4496e640 1 --2- 172.21.15.150:0/3497228559 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f7b20079910 0x7f7b2007be20 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f7b4009b3a0 tx=0x7f7b34005f90 comp rx=0 tx=0).stop 2024-09-17T05:47:18.081 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:18.079+0000 7f7b4496e640 1 -- 172.21.15.150:0/3497228559 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7b28003a00 msgr2=0x7f7b401529a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:47:18.081 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:18.079+0000 7f7b4496e640 1 --2- 172.21.15.150:0/3497228559 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7b28003a00 0x7f7b401529a0 secure :-1 s=READY pgs=859 cs=0 l=1 rev1=1 crypto rx=0x7f7b3000c3b0 tx=0x7f7b30006380 comp rx=0 tx=0).stop 2024-09-17T05:47:18.081 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:18.079+0000 7f7b4496e640 1 -- 172.21.15.150:0/3497228559 shutdown_connections 2024-09-17T05:47:18.082 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:18.079+0000 7f7b4496e640 1 --2- 172.21.15.150:0/3497228559 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7b401f45d0 0x7f7b4009e770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:47:18.082 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:18.079+0000 7f7b4496e640 1 --2- 172.21.15.150:0/3497228559 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f7b20079910 0x7f7b2007be20 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:47:18.082 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:18.079+0000 7f7b4496e640 1 --2- 172.21.15.150:0/3497228559 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7b4015ae80 0x7f7b401f7ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:47:18.082 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:18.079+0000 7f7b4496e640 1 --2- 172.21.15.150:0/3497228559 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7b28003a00 0x7f7b401529a0 unknown :-1 s=CLOSED pgs=859 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:47:18.082 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:18.079+0000 7f7b4496e640 1 -- 172.21.15.150:0/3497228559 >> 172.21.15.150:0/3497228559 conn(0x7f7b400cee80 msgr2=0x7f7b4015ca40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:47:18.082 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:18.079+0000 7f7b4496e640 1 -- 172.21.15.150:0/3497228559 shutdown_connections 2024-09-17T05:47:18.082 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:18.079+0000 7f7b4496e640 1 -- 172.21.15.150:0/3497228559 wait complete. 2024-09-17T05:47:18.092 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume getpath cephfs sv1 2024-09-17T05:47:18.209 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:18.207+0000 7fc5755a8640 1 -- 172.21.15.150:0/3287468931 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc5700d5150 msgr2=0x7fc5700b9b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:47:18.210 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:18.207+0000 7fc5755a8640 1 --2- 172.21.15.150:0/3287468931 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc5700d5150 0x7fc5700b9b10 secure :-1 s=READY pgs=861 cs=0 l=1 rev1=1 crypto rx=0x7fc5700cfd10 tx=0x7fc56002a5c0 comp rx=0 tx=0).stop 2024-09-17T05:47:18.210 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:18.207+0000 7fc5755a8640 1 -- 172.21.15.150:0/3287468931 shutdown_connections 2024-09-17T05:47:18.210 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:18.207+0000 7fc5755a8640 1 --2- 172.21.15.150:0/3287468931 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc57006dea0 0x7fc5700d0020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:47:18.210 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:18.207+0000 7fc5755a8640 1 --2- 172.21.15.150:0/3287468931 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc5700d5150 0x7fc5700b9b10 unknown :-1 s=CLOSED pgs=861 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:47:18.210 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:18.207+0000 7fc5755a8640 1 -- 172.21.15.150:0/3287468931 >> 172.21.15.150:0/3287468931 conn(0x7fc57008bfe0 msgr2=0x7fc5700d46e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:47:18.210 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:18.207+0000 7fc5755a8640 1 -- 172.21.15.150:0/3287468931 shutdown_connections 2024-09-17T05:47:18.210 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:18.207+0000 7fc5755a8640 1 -- 172.21.15.150:0/3287468931 wait complete. 2024-09-17T05:47:18.211 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:18.209+0000 7fc5755a8640 1 Processor -- start 2024-09-17T05:47:18.211 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:18.209+0000 7fc5755a8640 1 -- start start 2024-09-17T05:47:18.214 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:18.211+0000 7fc5755a8640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc57006dea0 0x7fc57015b030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:47:18.214 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:18.211+0000 7fc5755a8640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc57006e2b0 0x7fc5701ea6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:47:18.214 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:18.211+0000 7fc5755a8640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc5700d5150 0x7fc5701eac00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:47:18.214 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:18.211+0000 7fc5755a8640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7fc5700ba1a0 con 0x7fc5700d5150 2024-09-17T05:47:18.214 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:18.211+0000 7fc5755a8640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fc5700d31e0 con 0x7fc57006dea0 2024-09-17T05:47:18.214 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:18.211+0000 7fc5755a8640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fc5700b6870 con 0x7fc57006e2b0 2024-09-17T05:47:18.214 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:18.211+0000 7fc56f7fe640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc5700d5150 0x7fc5701eac00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:47:18.214 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:18.211+0000 7fc56f7fe640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc5700d5150 0x7fc5701eac00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:39370/0 (socket says 172.21.15.150:39370) 2024-09-17T05:47:18.214 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:18.211+0000 7fc56f7fe640 1 -- 172.21.15.150:0/3751981620 learned_addr learned my addr 172.21.15.150:0/3751981620 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:47:18.214 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:18.211+0000 7fc5667fc640 1 --2- 172.21.15.150:0/3751981620 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc57006e2b0 0x7fc5701ea6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:47:18.215 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:18.211+0000 7fc56effd640 1 --2- 172.21.15.150:0/3751981620 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc57006dea0 0x7fc57015b030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:47:18.215 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:18.211+0000 7fc56f7fe640 1 -- 172.21.15.150:0/3751981620 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc57006e2b0 msgr2=0x7fc5701ea6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:47:18.215 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:18.211+0000 7fc56f7fe640 1 --2- 172.21.15.150:0/3751981620 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc57006e2b0 0x7fc5701ea6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:47:18.215 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:18.211+0000 7fc56f7fe640 1 -- 172.21.15.150:0/3751981620 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc57006dea0 msgr2=0x7fc57015b030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:47:18.215 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:18.211+0000 7fc56f7fe640 1 --2- 172.21.15.150:0/3751981620 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc57006dea0 0x7fc57015b030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:47:18.215 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:18.211+0000 7fc56f7fe640 1 -- 172.21.15.150:0/3751981620 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc5701f5e80 con 0x7fc5700d5150 2024-09-17T05:47:18.215 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:18.211+0000 7fc56f7fe640 1 --2- 172.21.15.150:0/3751981620 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc5700d5150 0x7fc5701eac00 secure :-1 s=READY pgs=862 cs=0 l=1 rev1=1 crypto rx=0x7fc56800c730 tx=0x7fc56800cb30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:47:18.215 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:18.211+0000 7fc567fff640 1 -- 172.21.15.150:0/3751981620 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc568003b70 con 0x7fc5700d5150 2024-09-17T05:47:18.215 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:18.211+0000 7fc567fff640 1 -- 172.21.15.150:0/3751981620 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc568003d10 con 0x7fc5700d5150 2024-09-17T05:47:18.215 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:18.211+0000 7fc5755a8640 1 -- 172.21.15.150:0/3751981620 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc5700cb0d0 con 0x7fc5700d5150 2024-09-17T05:47:18.215 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:18.211+0000 7fc567fff640 1 -- 172.21.15.150:0/3751981620 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc5680052d0 con 0x7fc5700d5150 2024-09-17T05:47:18.215 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:18.211+0000 7fc5755a8640 1 -- 172.21.15.150:0/3751981620 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc5700ccff0 con 0x7fc5700d5150 2024-09-17T05:47:18.216 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:18.213+0000 7fc5755a8640 1 -- 172.21.15.150:0/3751981620 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc5700cae40 con 0x7fc5700d5150 2024-09-17T05:47:18.216 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:18.213+0000 7fc567fff640 1 -- 172.21.15.150:0/3751981620 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 20) ==== 102665+0+0 (secure 0 0 0) 0x7fc568005470 con 0x7fc5700d5150 2024-09-17T05:47:18.216 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:18.214+0000 7fc567fff640 1 --2- 172.21.15.150:0/3751981620 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fc550079910 0x7fc55007be20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:47:18.216 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:18.214+0000 7fc567fff640 1 -- 172.21.15.150:0/3751981620 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 5765+0+0 (secure 0 0 0) 0x7fc568099690 con 0x7fc5700d5150 2024-09-17T05:47:18.217 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:18.214+0000 7fc56effd640 1 --2- 172.21.15.150:0/3751981620 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fc550079910 0x7fc55007be20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:47:18.217 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:18.214+0000 7fc56effd640 1 --2- 172.21.15.150:0/3751981620 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fc550079910 0x7fc55007be20 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7fc560034000 tx=0x7fc560004730 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:47:18.220 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:18.218+0000 7fc567fff640 1 -- 172.21.15.150:0/3751981620 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fc568062c50 con 0x7fc5700d5150 2024-09-17T05:47:18.422 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:18.420+0000 7fc5755a8640 1 -- 172.21.15.150:0/3751981620 --> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "sub_name": "sv1", "target": ["mon-mgr", ""]}) -- 0x7fc5700d0020 con 0x7fc550079910 2024-09-17T05:47:18.428 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:18.426+0000 7fc567fff640 1 -- 172.21.15.150:0/3751981620 <== mgr.4108 v2:172.21.15.176:6800/3631216395 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+59 (secure 0 0 0) 0x7fc5700d0020 con 0x7fc550079910 2024-09-17T05:47:18.428 INFO:teuthology.orchestra.run.smithi150.stdout:/volumes/_nogroup/sv1/bbc2e0d1-5f85-4b0d-a1bb-96e9f9d44967 2024-09-17T05:47:18.430 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:18.428+0000 7fc5755a8640 1 -- 172.21.15.150:0/3751981620 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fc550079910 msgr2=0x7fc55007be20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:47:18.430 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:18.428+0000 7fc5755a8640 1 --2- 172.21.15.150:0/3751981620 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fc550079910 0x7fc55007be20 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7fc560034000 tx=0x7fc560004730 comp rx=0 tx=0).stop 2024-09-17T05:47:18.430 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:18.428+0000 7fc5755a8640 1 -- 172.21.15.150:0/3751981620 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc5700d5150 msgr2=0x7fc5701eac00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:47:18.431 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:18.428+0000 7fc5755a8640 1 --2- 172.21.15.150:0/3751981620 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc5700d5150 0x7fc5701eac00 secure :-1 s=READY pgs=862 cs=0 l=1 rev1=1 crypto rx=0x7fc56800c730 tx=0x7fc56800cb30 comp rx=0 tx=0).stop 2024-09-17T05:47:18.431 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:18.428+0000 7fc5755a8640 1 -- 172.21.15.150:0/3751981620 shutdown_connections 2024-09-17T05:47:18.431 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:18.428+0000 7fc5755a8640 1 --2- 172.21.15.150:0/3751981620 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fc550079910 0x7fc55007be20 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:47:18.431 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:18.428+0000 7fc5755a8640 1 --2- 172.21.15.150:0/3751981620 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc5700d5150 0x7fc5701eac00 unknown :-1 s=CLOSED pgs=862 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:47:18.431 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:18.428+0000 7fc5755a8640 1 --2- 172.21.15.150:0/3751981620 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc57006e2b0 0x7fc5701ea6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:47:18.431 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:18.428+0000 7fc5755a8640 1 --2- 172.21.15.150:0/3751981620 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc57006dea0 0x7fc57015b030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:47:18.431 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:18.428+0000 7fc5755a8640 1 -- 172.21.15.150:0/3751981620 >> 172.21.15.150:0/3751981620 conn(0x7fc57008bfe0 msgr2=0x7fc57015eb10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:47:18.431 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:18.428+0000 7fc5755a8640 1 -- 172.21.15.150:0/3751981620 shutdown_connections 2024-09-17T05:47:18.431 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:18.429+0000 7fc5755a8640 1 -- 172.21.15.150:0/3751981620 wait complete. 2024-09-17T05:47:18.441 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:47:18.442 DEBUG:teuthology.orchestra.run.smithi150:> (cd /home/ubuntu/cephtest/mnt.0 && exec getfattr -n ceph.dir.rbytes volumes/_nogroup/sv1/bbc2e0d1-5f85-4b0d-a1bb-96e9f9d44967 2024-09-17T05:47:18.442 DEBUG:teuthology.orchestra.run.smithi150:> ) 2024-09-17T05:47:18.457 INFO:teuthology.orchestra.run.smithi150.stdout:# file: volumes/_nogroup/sv1/bbc2e0d1-5f85-4b0d-a1bb-96e9f9d44967 2024-09-17T05:47:18.457 INFO:teuthology.orchestra.run.smithi150.stdout:ceph.dir.rbytes="2972172288" 2024-09-17T05:47:18.457 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-09-17T05:47:18.458 INFO:tasks.cephfs.test_volumes:r_size = 2972172288 exp_size = 3221225472 2024-09-17T05:47:20.458 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:47:20.458 DEBUG:teuthology.orchestra.run.smithi150:> (cd /home/ubuntu/cephtest/mnt.0 && exec getfattr -n ceph.dir.rbytes volumes/_nogroup/sv1/bbc2e0d1-5f85-4b0d-a1bb-96e9f9d44967 2024-09-17T05:47:20.459 DEBUG:teuthology.orchestra.run.smithi150:> ) 2024-09-17T05:47:20.479 INFO:teuthology.orchestra.run.smithi150.stdout:# file: volumes/_nogroup/sv1/bbc2e0d1-5f85-4b0d-a1bb-96e9f9d44967 2024-09-17T05:47:20.479 INFO:teuthology.orchestra.run.smithi150.stdout:ceph.dir.rbytes="2972172288" 2024-09-17T05:47:20.479 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-09-17T05:47:20.479 INFO:tasks.cephfs.test_volumes:r_size = 2972172288 exp_size = 3221225472 2024-09-17T05:47:22.480 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:47:22.480 DEBUG:teuthology.orchestra.run.smithi150:> (cd /home/ubuntu/cephtest/mnt.0 && exec getfattr -n ceph.dir.rbytes volumes/_nogroup/sv1/bbc2e0d1-5f85-4b0d-a1bb-96e9f9d44967 2024-09-17T05:47:22.481 DEBUG:teuthology.orchestra.run.smithi150:> ) 2024-09-17T05:47:22.501 INFO:teuthology.orchestra.run.smithi150.stdout:# file: volumes/_nogroup/sv1/bbc2e0d1-5f85-4b0d-a1bb-96e9f9d44967 2024-09-17T05:47:22.502 INFO:teuthology.orchestra.run.smithi150.stdout:ceph.dir.rbytes="3221225472" 2024-09-17T05:47:22.502 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-09-17T05:47:22.502 INFO:tasks.cephfs.test_volumes:r_size = 3221225472 exp_size = 3221225472 2024-09-17T05:47:22.502 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume snapshot clone cephfs sv1 ss1 subvol_clone51670 2024-09-17T05:47:22.673 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:22.671+0000 7f264a990640 1 -- 172.21.15.150:0/3539227005 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f26440d0ec0 msgr2=0x7f26440cd040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:47:22.674 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:22.671+0000 7f264a990640 1 --2- 172.21.15.150:0/3539227005 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f26440d0ec0 0x7f26440cd040 secure :-1 s=READY pgs=863 cs=0 l=1 rev1=1 crypto rx=0x7f263c005fd0 tx=0x7f263c02a980 comp rx=0 tx=0).stop 2024-09-17T05:47:22.674 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:22.671+0000 7f264a990640 1 -- 172.21.15.150:0/3539227005 shutdown_connections 2024-09-17T05:47:22.674 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:22.671+0000 7f264a990640 1 --2- 172.21.15.150:0/3539227005 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f26440d0ec0 0x7f26440cd040 unknown :-1 s=CLOSED pgs=863 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:47:22.674 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:22.671+0000 7f264a990640 1 --2- 172.21.15.150:0/3539227005 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f26440af570 0x7f26440d0980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:47:22.674 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:22.671+0000 7f264a990640 1 -- 172.21.15.150:0/3539227005 >> 172.21.15.150:0/3539227005 conn(0x7f26440cefb0 msgr2=0x7f26440cf3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:47:22.674 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:22.672+0000 7f264a990640 1 -- 172.21.15.150:0/3539227005 shutdown_connections 2024-09-17T05:47:22.674 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:22.672+0000 7f264a990640 1 -- 172.21.15.150:0/3539227005 wait complete. 2024-09-17T05:47:22.674 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:22.673+0000 7f264a990640 1 Processor -- start 2024-09-17T05:47:22.675 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:22.673+0000 7f264a990640 1 -- start start 2024-09-17T05:47:22.678 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:22.675+0000 7f264a990640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f26440af160 0x7f26441e83c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:47:22.678 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:22.675+0000 7f264a990640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f26440af570 0x7f264409fc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:47:22.678 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:22.675+0000 7f264a990640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f26440d0ec0 0x7f264414b4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:47:22.678 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:22.675+0000 7f264a990640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f26440ced50 con 0x7f26440d0ec0 2024-09-17T05:47:22.678 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:22.675+0000 7f264a990640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f26440cebd0 con 0x7f26440af160 2024-09-17T05:47:22.678 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:22.675+0000 7f264a990640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f26440d12d0 con 0x7f26440af570 2024-09-17T05:47:22.678 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:22.675+0000 7f2648f2d640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f26440d0ec0 0x7f264414b4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:47:22.678 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:22.675+0000 7f2648f2d640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f26440d0ec0 0x7f264414b4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:37962/0 (socket says 172.21.15.150:37962) 2024-09-17T05:47:22.678 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:22.675+0000 7f2648f2d640 1 -- 172.21.15.150:0/2459191379 learned_addr learned my addr 172.21.15.150:0/2459191379 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:47:22.679 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:22.675+0000 7f2643fff640 1 --2- 172.21.15.150:0/2459191379 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f26440af160 0x7f26441e83c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:47:22.679 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:22.675+0000 7f26437fe640 1 --2- 172.21.15.150:0/2459191379 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f26440af570 0x7f264409fc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:47:22.679 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:22.675+0000 7f2648f2d640 1 -- 172.21.15.150:0/2459191379 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f26440af570 msgr2=0x7f264409fc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:47:22.679 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:22.675+0000 7f2648f2d640 1 --2- 172.21.15.150:0/2459191379 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f26440af570 0x7f264409fc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:47:22.679 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:22.675+0000 7f2648f2d640 1 -- 172.21.15.150:0/2459191379 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f26440af160 msgr2=0x7f26441e83c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:47:22.679 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:22.675+0000 7f2648f2d640 1 --2- 172.21.15.150:0/2459191379 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f26440af160 0x7f26441e83c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:47:22.679 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:22.675+0000 7f2648f2d640 1 -- 172.21.15.150:0/2459191379 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f26441e6b40 con 0x7f26440d0ec0 2024-09-17T05:47:22.679 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:22.675+0000 7f2643fff640 1 --2- 172.21.15.150:0/2459191379 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f26440af160 0x7f26441e83c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:47:22.679 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:22.675+0000 7f2648f2d640 1 --2- 172.21.15.150:0/2459191379 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f26440d0ec0 0x7f264414b4c0 secure :-1 s=READY pgs=864 cs=0 l=1 rev1=1 crypto rx=0x7f263c033040 tx=0x7f263c003f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:47:22.679 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:22.676+0000 7f2640ff9640 1 -- 172.21.15.150:0/2459191379 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f263c034040 con 0x7f26440d0ec0 2024-09-17T05:47:22.679 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:22.676+0000 7f2640ff9640 1 -- 172.21.15.150:0/2459191379 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f263c004540 con 0x7f26440d0ec0 2024-09-17T05:47:22.679 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:22.676+0000 7f264a990640 1 -- 172.21.15.150:0/2459191379 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f26441e6e20 con 0x7f26440d0ec0 2024-09-17T05:47:22.679 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:22.676+0000 7f2640ff9640 1 -- 172.21.15.150:0/2459191379 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f263c045480 con 0x7f26440d0ec0 2024-09-17T05:47:22.680 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:22.676+0000 7f264a990640 1 -- 172.21.15.150:0/2459191379 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f26441e73e0 con 0x7f26440d0ec0 2024-09-17T05:47:22.680 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:22.677+0000 7f264a990640 1 -- 172.21.15.150:0/2459191379 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f26441e68b0 con 0x7f26440d0ec0 2024-09-17T05:47:22.680 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:22.678+0000 7f2640ff9640 1 -- 172.21.15.150:0/2459191379 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 20) ==== 102665+0+0 (secure 0 0 0) 0x7f263c037020 con 0x7f26440d0ec0 2024-09-17T05:47:22.681 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:22.678+0000 7f2640ff9640 1 --2- 172.21.15.150:0/2459191379 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f2630079910 0x7f263007be20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:47:22.681 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:22.678+0000 7f2640ff9640 1 -- 172.21.15.150:0/2459191379 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 5765+0+0 (secure 0 0 0) 0x7f263c0bafb0 con 0x7f26440d0ec0 2024-09-17T05:47:22.681 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:22.678+0000 7f2643fff640 1 --2- 172.21.15.150:0/2459191379 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f2630079910 0x7f263007be20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:47:22.681 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:22.679+0000 7f2643fff640 1 --2- 172.21.15.150:0/2459191379 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f2630079910 0x7f263007be20 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f2634007fd0 tx=0x7f2634009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:47:22.684 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:22.683+0000 7f2640ff9640 1 -- 172.21.15.150:0/2459191379 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f263c084eb0 con 0x7f26440d0ec0 2024-09-17T05:47:22.893 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:22.891+0000 7f264a990640 1 -- 172.21.15.150:0/2459191379 --> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] -- mgr_command(tid 0: {"prefix": "fs subvolume snapshot clone", "vol_name": "cephfs", "sub_name": "sv1", "snap_name": "ss1", "target_sub_name": "subvol_clone51670", "target": ["mon-mgr", ""]}) -- 0x7f264409b720 con 0x7f2630079910 2024-09-17T05:47:22.949 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:22.947+0000 7f2640ff9640 1 -- 172.21.15.150:0/2459191379 <== mgr.4108 v2:172.21.15.176:6800/3631216395 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f264409b720 con 0x7f2630079910 2024-09-17T05:47:22.952 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:22.950+0000 7f264a990640 1 -- 172.21.15.150:0/2459191379 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f2630079910 msgr2=0x7f263007be20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:47:22.952 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:22.950+0000 7f264a990640 1 --2- 172.21.15.150:0/2459191379 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f2630079910 0x7f263007be20 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f2634007fd0 tx=0x7f2634009040 comp rx=0 tx=0).stop 2024-09-17T05:47:22.952 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:22.950+0000 7f264a990640 1 -- 172.21.15.150:0/2459191379 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f26440d0ec0 msgr2=0x7f264414b4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:47:22.952 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:22.950+0000 7f264a990640 1 --2- 172.21.15.150:0/2459191379 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f26440d0ec0 0x7f264414b4c0 secure :-1 s=READY pgs=864 cs=0 l=1 rev1=1 crypto rx=0x7f263c033040 tx=0x7f263c003f10 comp rx=0 tx=0).stop 2024-09-17T05:47:22.952 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:22.950+0000 7f264a990640 1 -- 172.21.15.150:0/2459191379 shutdown_connections 2024-09-17T05:47:22.952 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:22.950+0000 7f264a990640 1 --2- 172.21.15.150:0/2459191379 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f2630079910 0x7f263007be20 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:47:22.952 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:22.950+0000 7f264a990640 1 --2- 172.21.15.150:0/2459191379 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f26440d0ec0 0x7f264414b4c0 unknown :-1 s=CLOSED pgs=864 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:47:22.953 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:22.950+0000 7f264a990640 1 --2- 172.21.15.150:0/2459191379 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f26440af570 0x7f264409fc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:47:22.953 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:22.950+0000 7f264a990640 1 --2- 172.21.15.150:0/2459191379 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f26440af160 0x7f26441e83c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:47:22.953 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:22.950+0000 7f264a990640 1 -- 172.21.15.150:0/2459191379 >> 172.21.15.150:0/2459191379 conn(0x7f26440cefb0 msgr2=0x7f26440cf3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:47:22.953 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:22.950+0000 7f264a990640 1 -- 172.21.15.150:0/2459191379 shutdown_connections 2024-09-17T05:47:22.953 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:22.950+0000 7f264a990640 1 -- 172.21.15.150:0/2459191379 wait complete. 2024-09-17T05:47:22.954 INFO:tasks.ceph.mgr.x.smithi176.stderr:2024-09-17T05:47:22.953+0000 7f33dcf25640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-17T05:47:22.954 INFO:tasks.ceph.mgr.x.smithi176.stderr:2024-09-17T05:47:22.953+0000 7f33dcf25640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-17T05:47:22.954 INFO:tasks.ceph.mgr.x.smithi176.stderr:2024-09-17T05:47:22.953+0000 7f33dcf25640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-17T05:47:22.954 INFO:tasks.ceph.mgr.x.smithi176.stderr:2024-09-17T05:47:22.953+0000 7f33dcf25640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-17T05:47:22.954 INFO:tasks.ceph.mgr.x.smithi176.stderr:2024-09-17T05:47:22.953+0000 7f33dcf25640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-17T05:47:22.964 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume snapshot clone cephfs sv1 ss1 subvol_clone19001 2024-09-17T05:47:22.968 INFO:tasks.ceph.mgr.x.smithi176.stderr:2024-09-17T05:47:22.967+0000 7f33dc724640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-17T05:47:22.968 INFO:tasks.ceph.mgr.x.smithi176.stderr:2024-09-17T05:47:22.967+0000 7f33dc724640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-17T05:47:22.968 INFO:tasks.ceph.mgr.x.smithi176.stderr:2024-09-17T05:47:22.967+0000 7f33dc724640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-17T05:47:22.968 INFO:tasks.ceph.mgr.x.smithi176.stderr:2024-09-17T05:47:22.967+0000 7f33dc724640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-17T05:47:22.968 INFO:tasks.ceph.mgr.x.smithi176.stderr:2024-09-17T05:47:22.967+0000 7f33dc724640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-17T05:47:23.090 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:23.088+0000 7fcb7d64d640 1 -- 172.21.15.150:0/3617642847 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fcb64005350 msgr2=0x7fcb6400b9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:47:23.091 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:23.088+0000 7fcb7d64d640 1 --2- 172.21.15.150:0/3617642847 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fcb64005350 0x7fcb6400b9e0 secure :-1 s=READY pgs=866 cs=0 l=1 rev1=1 crypto rx=0x7fcb68001d90 tx=0x7fcb64005830 comp rx=0 tx=0).stop 2024-09-17T05:47:23.091 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:23.088+0000 7fcb7d64d640 1 -- 172.21.15.150:0/3617642847 shutdown_connections 2024-09-17T05:47:23.091 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:23.088+0000 7fcb7d64d640 1 --2- 172.21.15.150:0/3617642847 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fcb64005350 0x7fcb6400b9e0 unknown :-1 s=CLOSED pgs=866 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:47:23.091 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:23.088+0000 7fcb7d64d640 1 -- 172.21.15.150:0/3617642847 >> 172.21.15.150:0/3617642847 conn(0x7fcb780d2550 msgr2=0x7fcb780d2960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:47:23.091 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:23.088+0000 7fcb7d64d640 1 -- 172.21.15.150:0/3617642847 shutdown_connections 2024-09-17T05:47:23.091 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:23.088+0000 7fcb7d64d640 1 -- 172.21.15.150:0/3617642847 wait complete. 2024-09-17T05:47:23.092 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:23.090+0000 7fcb7d64d640 1 Processor -- start 2024-09-17T05:47:23.092 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:23.090+0000 7fcb7d64d640 1 -- start start 2024-09-17T05:47:23.094 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:23.092+0000 7fcb7d64d640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fcb64005350 0x7fcb781df9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:47:23.094 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:23.092+0000 7fcb7d64d640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fcb781e67f0 0x7fcb781e8a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:47:23.095 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:23.092+0000 7fcb7d64d640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fcb781e8f40 0x7fcb781e9350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:47:23.095 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:23.092+0000 7fcb7d64d640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7fcb780b5440 con 0x7fcb781e8f40 2024-09-17T05:47:23.095 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:23.092+0000 7fcb7d64d640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fcb780cee20 con 0x7fcb781e67f0 2024-09-17T05:47:23.095 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:23.092+0000 7fcb7d64d640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fcb780b55c0 con 0x7fcb64005350 2024-09-17T05:47:23.095 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:23.092+0000 7fcb777fe640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fcb781e8f40 0x7fcb781e9350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:47:23.095 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:23.092+0000 7fcb777fe640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fcb781e8f40 0x7fcb781e9350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:37978/0 (socket says 172.21.15.150:37978) 2024-09-17T05:47:23.095 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:23.092+0000 7fcb777fe640 1 -- 172.21.15.150:0/3564634875 learned_addr learned my addr 172.21.15.150:0/3564634875 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:47:23.095 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:23.092+0000 7fcb76ffd640 1 --2- 172.21.15.150:0/3564634875 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fcb64005350 0x7fcb781df9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:47:23.095 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:23.092+0000 7fcb767fc640 1 --2- 172.21.15.150:0/3564634875 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fcb781e67f0 0x7fcb781e8a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:47:23.095 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:23.092+0000 7fcb777fe640 1 -- 172.21.15.150:0/3564634875 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fcb64005350 msgr2=0x7fcb781df9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:47:23.095 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:23.092+0000 7fcb777fe640 1 --2- 172.21.15.150:0/3564634875 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fcb64005350 0x7fcb781df9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:47:23.095 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:23.092+0000 7fcb777fe640 1 -- 172.21.15.150:0/3564634875 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fcb781e67f0 msgr2=0x7fcb781e8a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:47:23.096 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:23.092+0000 7fcb777fe640 1 --2- 172.21.15.150:0/3564634875 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fcb781e67f0 0x7fcb781e8a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:47:23.096 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:23.092+0000 7fcb777fe640 1 -- 172.21.15.150:0/3564634875 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcb781f6720 con 0x7fcb781e8f40 2024-09-17T05:47:23.096 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:23.092+0000 7fcb777fe640 1 --2- 172.21.15.150:0/3564634875 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fcb781e8f40 0x7fcb781e9350 secure :-1 s=READY pgs=867 cs=0 l=1 rev1=1 crypto rx=0x7fcb68001d90 tx=0x7fcb68006d40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:47:23.096 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:23.092+0000 7fcb6f7fe640 1 -- 172.21.15.150:0/3564634875 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb68003d80 con 0x7fcb781e8f40 2024-09-17T05:47:23.096 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:23.093+0000 7fcb6f7fe640 1 -- 172.21.15.150:0/3564634875 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fcb68005b80 con 0x7fcb781e8f40 2024-09-17T05:47:23.096 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:23.093+0000 7fcb7d64d640 1 -- 172.21.15.150:0/3564634875 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcb781f6a00 con 0x7fcb781e8f40 2024-09-17T05:47:23.096 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:23.093+0000 7fcb6f7fe640 1 -- 172.21.15.150:0/3564634875 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb68005fd0 con 0x7fcb781e8f40 2024-09-17T05:47:23.096 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:23.093+0000 7fcb7d64d640 1 -- 172.21.15.150:0/3564634875 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcb780c5810 con 0x7fcb781e8f40 2024-09-17T05:47:23.097 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:23.094+0000 7fcb7d64d640 1 -- 172.21.15.150:0/3564634875 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcb7809ac10 con 0x7fcb781e8f40 2024-09-17T05:47:23.097 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:23.094+0000 7fcb6f7fe640 1 -- 172.21.15.150:0/3564634875 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 21) ==== 102716+0+0 (secure 0 0 0) 0x7fcb68005030 con 0x7fcb781e8f40 2024-09-17T05:47:23.097 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:23.095+0000 7fcb6f7fe640 1 --2- 172.21.15.150:0/3564634875 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fcb580799a0 0x7fcb5807beb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:47:23.097 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:23.095+0000 7fcb6f7fe640 1 -- 172.21.15.150:0/3564634875 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 5765+0+0 (secure 0 0 0) 0x7fcb680b9750 con 0x7fcb781e8f40 2024-09-17T05:47:23.097 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:23.095+0000 7fcb76ffd640 1 --2- 172.21.15.150:0/3564634875 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fcb580799a0 0x7fcb5807beb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:47:23.097 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:23.095+0000 7fcb76ffd640 1 --2- 172.21.15.150:0/3564634875 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fcb580799a0 0x7fcb5807beb0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7fcb780b8600 tx=0x7fcb700067d0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:47:23.101 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:23.099+0000 7fcb6f7fe640 1 -- 172.21.15.150:0/3564634875 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fcb68043060 con 0x7fcb781e8f40 2024-09-17T05:47:23.312 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:23.310+0000 7fcb7d64d640 1 -- 172.21.15.150:0/3564634875 --> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] -- mgr_command(tid 0: {"prefix": "fs subvolume snapshot clone", "vol_name": "cephfs", "sub_name": "sv1", "snap_name": "ss1", "target_sub_name": "subvol_clone19001", "target": ["mon-mgr", ""]}) -- 0x7fcb780d04e0 con 0x7fcb580799a0 2024-09-17T05:47:23.954 INFO:tasks.ceph.mgr.x.smithi176.stderr:2024-09-17T05:47:23.952+0000 7f33a0ded640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-17T05:47:23.954 INFO:tasks.ceph.mgr.x.smithi176.stderr:2024-09-17T05:47:23.952+0000 7f33a0ded640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-17T05:47:23.954 INFO:tasks.ceph.mgr.x.smithi176.stderr:2024-09-17T05:47:23.952+0000 7f33a0ded640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-17T05:47:23.954 INFO:tasks.ceph.mgr.x.smithi176.stderr:2024-09-17T05:47:23.952+0000 7f33a0ded640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-17T05:47:23.954 INFO:tasks.ceph.mgr.x.smithi176.stderr:2024-09-17T05:47:23.952+0000 7f33a0ded640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-17T05:47:24.037 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:24.036+0000 7fcb6f7fe640 1 -- 172.21.15.150:0/3564634875 <== mgr.4108 v2:172.21.15.176:6800/3631216395 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7fcb780d04e0 con 0x7fcb580799a0 2024-09-17T05:47:24.040 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:24.039+0000 7fcb7d64d640 1 -- 172.21.15.150:0/3564634875 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fcb580799a0 msgr2=0x7fcb5807beb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:47:24.040 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:24.039+0000 7fcb7d64d640 1 --2- 172.21.15.150:0/3564634875 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fcb580799a0 0x7fcb5807beb0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7fcb780b8600 tx=0x7fcb700067d0 comp rx=0 tx=0).stop 2024-09-17T05:47:24.040 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:24.039+0000 7fcb7d64d640 1 -- 172.21.15.150:0/3564634875 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fcb781e8f40 msgr2=0x7fcb781e9350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:47:24.040 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:24.039+0000 7fcb7d64d640 1 --2- 172.21.15.150:0/3564634875 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fcb781e8f40 0x7fcb781e9350 secure :-1 s=READY pgs=867 cs=0 l=1 rev1=1 crypto rx=0x7fcb68001d90 tx=0x7fcb68006d40 comp rx=0 tx=0).stop 2024-09-17T05:47:24.041 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:24.039+0000 7fcb7d64d640 1 -- 172.21.15.150:0/3564634875 shutdown_connections 2024-09-17T05:47:24.041 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:24.039+0000 7fcb7d64d640 1 --2- 172.21.15.150:0/3564634875 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fcb781e67f0 0x7fcb781e8a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:47:24.041 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:24.039+0000 7fcb7d64d640 1 --2- 172.21.15.150:0/3564634875 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fcb580799a0 0x7fcb5807beb0 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:47:24.041 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:24.039+0000 7fcb7d64d640 1 --2- 172.21.15.150:0/3564634875 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fcb781e8f40 0x7fcb781e9350 unknown :-1 s=CLOSED pgs=867 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:47:24.041 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:24.039+0000 7fcb7d64d640 1 --2- 172.21.15.150:0/3564634875 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fcb64005350 0x7fcb781df9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:47:24.042 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:24.039+0000 7fcb7d64d640 1 -- 172.21.15.150:0/3564634875 >> 172.21.15.150:0/3564634875 conn(0x7fcb780d2550 msgr2=0x7fcb78072c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:47:24.042 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:24.039+0000 7fcb7d64d640 1 -- 172.21.15.150:0/3564634875 shutdown_connections 2024-09-17T05:47:24.042 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:24.039+0000 7fcb7d64d640 1 -- 172.21.15.150:0/3564634875 wait complete. 2024-09-17T05:47:24.069 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume snapshot clone cephfs sv1 ss1 subvol_clone72832 2024-09-17T05:47:24.242 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:24.240+0000 7f08774a9640 1 -- 172.21.15.150:0/1026685604 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f08700afe90 msgr2=0x7f08700b5350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:47:24.243 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:24.240+0000 7f08774a9640 1 --2- 172.21.15.150:0/1026685604 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f08700afe90 0x7f08700b5350 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f08700749a0 tx=0x7f086c02a4d0 comp rx=0 tx=0).stop 2024-09-17T05:47:24.243 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:24.240+0000 7f08774a9640 1 -- 172.21.15.150:0/1026685604 shutdown_connections 2024-09-17T05:47:24.243 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:24.240+0000 7f08774a9640 1 --2- 172.21.15.150:0/1026685604 >> v2:172.21.15.150:3300/0 conn(0x7f08700742d0 0x7f08700b3770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:47:24.243 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:24.240+0000 7f08774a9640 1 --2- 172.21.15.150:0/1026685604 >> v2:172.21.15.176:3300/0 conn(0x7f087015ac80 0x7f0870073d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:47:24.243 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:24.240+0000 7f08774a9640 1 --2- 172.21.15.150:0/1026685604 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f08700afe90 0x7f08700b5350 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:47:24.243 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:24.240+0000 7f08774a9640 1 -- 172.21.15.150:0/1026685604 >> 172.21.15.150:0/1026685604 conn(0x7f08700b2470 msgr2=0x7f08700b2880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:47:24.243 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:24.240+0000 7f08774a9640 1 -- 172.21.15.150:0/1026685604 shutdown_connections 2024-09-17T05:47:24.243 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:24.240+0000 7f08774a9640 1 -- 172.21.15.150:0/1026685604 wait complete. 2024-09-17T05:47:24.245 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:24.243+0000 7f08774a9640 1 Processor -- start 2024-09-17T05:47:24.245 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:24.243+0000 7f08774a9640 1 -- start start 2024-09-17T05:47:24.248 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:24.245+0000 7f08774a9640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f08700742d0 0x7f087014e0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:47:24.248 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:24.245+0000 7f08774a9640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f08700afe90 0x7f0870154fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:47:24.248 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:24.245+0000 7f08774a9640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f087015ac80 0x7f08700ce8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:47:24.248 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:24.245+0000 7f08774a9640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f0870073680 con 0x7f087015ac80 2024-09-17T05:47:24.248 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:24.245+0000 7f08774a9640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f0870073500 con 0x7f08700742d0 2024-09-17T05:47:24.248 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:24.245+0000 7f08774a9640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f0870073800 con 0x7f08700afe90 2024-09-17T05:47:24.248 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:24.245+0000 7f0875a46640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f087015ac80 0x7f08700ce8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:47:24.248 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:24.245+0000 7f0875a46640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f087015ac80 0x7f08700ce8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:38000/0 (socket says 172.21.15.150:38000) 2024-09-17T05:47:24.248 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:24.245+0000 7f0875a46640 1 -- 172.21.15.150:0/2297357318 learned_addr learned my addr 172.21.15.150:0/2297357318 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:47:24.248 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:24.246+0000 7f0875245640 1 --2- 172.21.15.150:0/2297357318 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f08700742d0 0x7f087014e0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:47:24.248 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:24.246+0000 7f0875a46640 1 -- 172.21.15.150:0/2297357318 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f08700afe90 msgr2=0x7f0870154fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:47:24.249 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:24.246+0000 7f0875a46640 1 --2- 172.21.15.150:0/2297357318 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f08700afe90 0x7f0870154fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:47:24.249 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:24.246+0000 7f0875a46640 1 -- 172.21.15.150:0/2297357318 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f08700742d0 msgr2=0x7f087014e0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:47:24.249 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:24.246+0000 7f0875a46640 1 --2- 172.21.15.150:0/2297357318 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f08700742d0 0x7f087014e0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:47:24.249 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:24.246+0000 7f0875a46640 1 -- 172.21.15.150:0/2297357318 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f08701f6f30 con 0x7f087015ac80 2024-09-17T05:47:24.249 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:24.246+0000 7f0875245640 1 --2- 172.21.15.150:0/2297357318 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f08700742d0 0x7f087014e0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T05:47:24.249 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:24.246+0000 7f0875a46640 1 --2- 172.21.15.150:0/2297357318 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f087015ac80 0x7f08700ce8b0 secure :-1 s=READY pgs=868 cs=0 l=1 rev1=1 crypto rx=0x7f086800b970 tx=0x7f086800be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:47:24.250 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:24.246+0000 7f0865ffb640 1 -- 172.21.15.150:0/2297357318 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0868019070 con 0x7f087015ac80 2024-09-17T05:47:24.250 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:24.246+0000 7f0865ffb640 1 -- 172.21.15.150:0/2297357318 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f086800cc50 con 0x7f087015ac80 2024-09-17T05:47:24.250 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:24.246+0000 7f0865ffb640 1 -- 172.21.15.150:0/2297357318 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f08680146a0 con 0x7f087015ac80 2024-09-17T05:47:24.250 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:24.246+0000 7f08774a9640 1 -- 172.21.15.150:0/2297357318 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f08701f7210 con 0x7f087015ac80 2024-09-17T05:47:24.250 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:24.247+0000 7f08774a9640 1 -- 172.21.15.150:0/2297357318 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f08701f77d0 con 0x7f087015ac80 2024-09-17T05:47:24.250 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:24.248+0000 7f08774a9640 1 -- 172.21.15.150:0/2297357318 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f08700b5350 con 0x7f087015ac80 2024-09-17T05:47:24.250 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:24.249+0000 7f0865ffb640 1 -- 172.21.15.150:0/2297357318 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 21) ==== 102716+0+0 (secure 0 0 0) 0x7f086801c070 con 0x7f087015ac80 2024-09-17T05:47:24.251 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:24.249+0000 7f0865ffb640 1 --2- 172.21.15.150:0/2297357318 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f08540799d0 0x7f085407bee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:47:24.251 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:24.250+0000 7f0865ffb640 1 -- 172.21.15.150:0/2297357318 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 5765+0+0 (secure 0 0 0) 0x7f0868099770 con 0x7f087015ac80 2024-09-17T05:47:24.251 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:24.250+0000 7f0875245640 1 --2- 172.21.15.150:0/2297357318 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f08540799d0 0x7f085407bee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:47:24.252 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:24.251+0000 7f0875245640 1 --2- 172.21.15.150:0/2297357318 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f08540799d0 0x7f085407bee0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f086c033000 tx=0x7f086c004730 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:47:24.256 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:24.254+0000 7f0865ffb640 1 -- 172.21.15.150:0/2297357318 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f08680633a0 con 0x7f087015ac80 2024-09-17T05:47:24.549 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:24.547+0000 7f08774a9640 1 -- 172.21.15.150:0/2297357318 --> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] -- mgr_command(tid 0: {"prefix": "fs subvolume snapshot clone", "vol_name": "cephfs", "sub_name": "sv1", "snap_name": "ss1", "target_sub_name": "subvol_clone72832", "target": ["mon-mgr", ""]}) -- 0x7f08701539e0 con 0x7f08540799d0 2024-09-17T05:47:24.900 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:24.899+0000 7f0865ffb640 1 -- 172.21.15.150:0/2297357318 <== mgr.4108 v2:172.21.15.176:6800/3631216395 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f08701539e0 con 0x7f08540799d0 2024-09-17T05:47:24.905 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:24.901+0000 7f08774a9640 1 -- 172.21.15.150:0/2297357318 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f08540799d0 msgr2=0x7f085407bee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:47:24.905 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:24.901+0000 7f08774a9640 1 --2- 172.21.15.150:0/2297357318 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f08540799d0 0x7f085407bee0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f086c033000 tx=0x7f086c004730 comp rx=0 tx=0).stop 2024-09-17T05:47:24.905 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:24.901+0000 7f08774a9640 1 -- 172.21.15.150:0/2297357318 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f087015ac80 msgr2=0x7f08700ce8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:47:24.905 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:24.901+0000 7f08774a9640 1 --2- 172.21.15.150:0/2297357318 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f087015ac80 0x7f08700ce8b0 secure :-1 s=READY pgs=868 cs=0 l=1 rev1=1 crypto rx=0x7f086800b970 tx=0x7f086800be30 comp rx=0 tx=0).stop 2024-09-17T05:47:24.905 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:24.901+0000 7f08774a9640 1 -- 172.21.15.150:0/2297357318 shutdown_connections 2024-09-17T05:47:24.905 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:24.901+0000 7f08774a9640 1 --2- 172.21.15.150:0/2297357318 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f08540799d0 0x7f085407bee0 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:47:24.905 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:24.901+0000 7f08774a9640 1 --2- 172.21.15.150:0/2297357318 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f087015ac80 0x7f08700ce8b0 unknown :-1 s=CLOSED pgs=868 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:47:24.905 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:24.901+0000 7f08774a9640 1 --2- 172.21.15.150:0/2297357318 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f08700afe90 0x7f0870154fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:47:24.905 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:24.902+0000 7f08774a9640 1 --2- 172.21.15.150:0/2297357318 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f08700742d0 0x7f087014e0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:47:24.905 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:24.902+0000 7f08774a9640 1 -- 172.21.15.150:0/2297357318 >> 172.21.15.150:0/2297357318 conn(0x7f08700b2470 msgr2=0x7f0870159e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:47:24.906 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:24.902+0000 7f08774a9640 1 -- 172.21.15.150:0/2297357318 shutdown_connections 2024-09-17T05:47:24.906 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:24.902+0000 7f08774a9640 1 -- 172.21.15.150:0/2297357318 wait complete. 2024-09-17T05:47:24.918 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume snapshot clone cephfs sv1 ss1 subvol_clone94333 2024-09-17T05:47:24.923 INFO:tasks.ceph.mgr.x.smithi176.stderr:2024-09-17T05:47:24.922+0000 7f33dd726640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-17T05:47:24.923 INFO:tasks.ceph.mgr.x.smithi176.stderr:2024-09-17T05:47:24.922+0000 7f33dd726640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-17T05:47:24.924 INFO:tasks.ceph.mgr.x.smithi176.stderr:2024-09-17T05:47:24.922+0000 7f33dd726640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-17T05:47:24.924 INFO:tasks.ceph.mgr.x.smithi176.stderr:2024-09-17T05:47:24.922+0000 7f33dd726640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-17T05:47:24.924 INFO:tasks.ceph.mgr.x.smithi176.stderr:2024-09-17T05:47:24.922+0000 7f33dd726640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-17T05:47:25.082 INFO:tasks.ceph.mgr.x.smithi176.stderr:2024-09-17T05:47:25.082+0000 7f33dbf23640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-17T05:47:25.082 INFO:tasks.ceph.mgr.x.smithi176.stderr:2024-09-17T05:47:25.082+0000 7f33dbf23640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-17T05:47:25.082 INFO:tasks.ceph.mgr.x.smithi176.stderr:2024-09-17T05:47:25.082+0000 7f33dbf23640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-17T05:47:25.082 INFO:tasks.ceph.mgr.x.smithi176.stderr:2024-09-17T05:47:25.082+0000 7f33dbf23640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-17T05:47:25.083 INFO:tasks.ceph.mgr.x.smithi176.stderr:2024-09-17T05:47:25.082+0000 7f33dbf23640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-17T05:47:25.094 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:25.092+0000 7fee16a4d640 1 -- 172.21.15.150:0/2081130294 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fedf8003a30 msgr2=0x7fedf8003ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:47:25.094 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:25.092+0000 7fee16a4d640 1 --2- 172.21.15.150:0/2081130294 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fedf8003a30 0x7fedf8003ea0 secure :-1 s=READY pgs=870 cs=0 l=1 rev1=1 crypto rx=0x7fee000016c0 tx=0x7fedf8005830 comp rx=0 tx=0).stop 2024-09-17T05:47:25.094 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:25.092+0000 7fee14fea640 1 -- 172.21.15.150:0/2081130294 reap_dead start 2024-09-17T05:47:25.094 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:25.092+0000 7fee16a4d640 1 -- 172.21.15.150:0/2081130294 shutdown_connections 2024-09-17T05:47:25.094 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:25.092+0000 7fee16a4d640 1 -- 172.21.15.150:0/2081130294 >> 172.21.15.150:0/2081130294 conn(0x7fee10073890 msgr2=0x7fee10073ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:47:25.094 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:25.092+0000 7fee16a4d640 1 -- 172.21.15.150:0/2081130294 shutdown_connections 2024-09-17T05:47:25.094 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:25.092+0000 7fee16a4d640 1 -- 172.21.15.150:0/2081130294 wait complete. 2024-09-17T05:47:25.096 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:25.095+0000 7fee16a4d640 1 Processor -- start 2024-09-17T05:47:25.096 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:25.095+0000 7fee16a4d640 1 -- start start 2024-09-17T05:47:25.103 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:25.097+0000 7fee16a4d640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fedf8003a30 0x7fee100c8380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:47:25.103 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:25.097+0000 7fee16a4d640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fee1014fc30 0x7fee100c6f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:47:25.103 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:25.097+0000 7fee16a4d640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fee100c74a0 0x7fee100c78b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:47:25.103 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:25.097+0000 7fee16a4d640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7fee1006e640 con 0x7fee100c74a0 2024-09-17T05:47:25.103 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:25.097+0000 7fee16a4d640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fee1006e4c0 con 0x7fee1014fc30 2024-09-17T05:47:25.103 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:25.097+0000 7fee16a4d640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fee10152800 con 0x7fedf8003a30 2024-09-17T05:47:25.103 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:25.097+0000 7fee14fea640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fee100c74a0 0x7fee100c78b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:47:25.103 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:25.098+0000 7fee14fea640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fee100c74a0 0x7fee100c78b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:38016/0 (socket says 172.21.15.150:38016) 2024-09-17T05:47:25.103 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:25.098+0000 7fee14fea640 1 -- 172.21.15.150:0/3852762391 learned_addr learned my addr 172.21.15.150:0/3852762391 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:47:25.104 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:25.098+0000 7fee14fea640 1 -- 172.21.15.150:0/3852762391 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fedf8003a30 msgr2=0x7fee100c8380 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-17T05:47:25.104 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:25.098+0000 7fee14fea640 1 --2- 172.21.15.150:0/3852762391 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fedf8003a30 0x7fee100c8380 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:47:25.104 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:25.098+0000 7fee14fea640 1 -- 172.21.15.150:0/3852762391 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fee1014fc30 msgr2=0x7fee100c6f60 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-17T05:47:25.104 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:25.098+0000 7fee14fea640 1 --2- 172.21.15.150:0/3852762391 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fee1014fc30 0x7fee100c6f60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:47:25.104 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:25.098+0000 7fee14fea640 1 -- 172.21.15.150:0/3852762391 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fee100cc680 con 0x7fee100c74a0 2024-09-17T05:47:25.104 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:25.098+0000 7fee14fea640 1 --2- 172.21.15.150:0/3852762391 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fee100c74a0 0x7fee100c78b0 secure :-1 s=READY pgs=871 cs=0 l=1 rev1=1 crypto rx=0x7fee100727e0 tx=0x7fee0800a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:47:25.104 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:25.098+0000 7fee0cff9640 1 -- 172.21.15.150:0/3852762391 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee08017070 con 0x7fee100c74a0 2024-09-17T05:47:25.104 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:25.098+0000 7fee0cff9640 1 -- 172.21.15.150:0/3852762391 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fee0800ae20 con 0x7fee100c74a0 2024-09-17T05:47:25.104 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:25.098+0000 7fee0cff9640 1 -- 172.21.15.150:0/3852762391 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee08007330 con 0x7fee100c74a0 2024-09-17T05:47:25.104 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:25.098+0000 7fee16a4d640 1 -- 172.21.15.150:0/3852762391 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fee100cc960 con 0x7fee100c74a0 2024-09-17T05:47:25.104 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:25.098+0000 7fee16a4d640 1 -- 172.21.15.150:0/3852762391 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fee100c9e90 con 0x7fee100c74a0 2024-09-17T05:47:25.104 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:25.100+0000 7fee16a4d640 1 -- 172.21.15.150:0/3852762391 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fee1006ddb0 con 0x7fee100c74a0 2024-09-17T05:47:25.104 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:25.100+0000 7fee0cff9640 1 -- 172.21.15.150:0/3852762391 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 21) ==== 102716+0+0 (secure 0 0 0) 0x7fee0801a070 con 0x7fee100c74a0 2024-09-17T05:47:25.104 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:25.101+0000 7fee0cff9640 1 --2- 172.21.15.150:0/3852762391 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fedfc0799d0 0x7fedfc07bee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:47:25.105 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:25.101+0000 7fee0cff9640 1 -- 172.21.15.150:0/3852762391 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 5765+0+0 (secure 0 0 0) 0x7fee08099870 con 0x7fee100c74a0 2024-09-17T05:47:25.109 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:25.107+0000 7fee0ffff640 1 --2- 172.21.15.150:0/3852762391 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fedfc0799d0 0x7fedfc07bee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:47:25.111 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:25.110+0000 7fee0cff9640 1 -- 172.21.15.150:0/3852762391 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fee08063420 con 0x7fee100c74a0 2024-09-17T05:47:25.120 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:25.118+0000 7fee0ffff640 1 --2- 172.21.15.150:0/3852762391 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fedfc0799d0 0x7fedfc07bee0 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7fee00032000 tx=0x7fee00001190 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:47:25.228 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:25.226+0000 7fee0cff9640 1 -- 172.21.15.150:0/3852762391 <== mon.0 v2:172.21.15.150:3300/0 7 ==== mgrmap(e 22) ==== 102818+0+0 (secure 0 0 0) 0x7fee0805ef90 con 0x7fee100c74a0 2024-09-17T05:47:25.437 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:25.435+0000 7fee16a4d640 1 -- 172.21.15.150:0/3852762391 --> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] -- mgr_command(tid 0: {"prefix": "fs subvolume snapshot clone", "vol_name": "cephfs", "sub_name": "sv1", "snap_name": "ss1", "target_sub_name": "subvol_clone94333", "target": ["mon-mgr", ""]}) -- 0x7fee100ccb30 con 0x7fedfc0799d0 2024-09-17T05:47:25.761 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-17T05:47:25.764 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-17T05:47:26.875 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:26.873+0000 7fee0cff9640 1 -- 172.21.15.150:0/3852762391 <== mgr.4108 v2:172.21.15.176:6800/3631216395 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7fee100ccb30 con 0x7fedfc0799d0 2024-09-17T05:47:26.878 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:26.876+0000 7fee16a4d640 1 -- 172.21.15.150:0/3852762391 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fedfc0799d0 msgr2=0x7fedfc07bee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:47:26.878 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:26.876+0000 7fee16a4d640 1 --2- 172.21.15.150:0/3852762391 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fedfc0799d0 0x7fedfc07bee0 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7fee00032000 tx=0x7fee00001190 comp rx=0 tx=0).stop 2024-09-17T05:47:26.878 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:26.876+0000 7fee16a4d640 1 -- 172.21.15.150:0/3852762391 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fee100c74a0 msgr2=0x7fee100c78b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:47:26.878 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:26.876+0000 7fee16a4d640 1 --2- 172.21.15.150:0/3852762391 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fee100c74a0 0x7fee100c78b0 secure :-1 s=READY pgs=871 cs=0 l=1 rev1=1 crypto rx=0x7fee100727e0 tx=0x7fee0800a430 comp rx=0 tx=0).stop 2024-09-17T05:47:26.878 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:26.876+0000 7fee16a4d640 1 -- 172.21.15.150:0/3852762391 shutdown_connections 2024-09-17T05:47:26.878 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:26.876+0000 7fee16a4d640 1 --2- 172.21.15.150:0/3852762391 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fee1014fc30 0x7fee100c6f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:47:26.878 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:26.876+0000 7fee16a4d640 1 --2- 172.21.15.150:0/3852762391 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fedfc0799d0 0x7fedfc07bee0 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:47:26.878 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:26.876+0000 7fee16a4d640 1 --2- 172.21.15.150:0/3852762391 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fee100c74a0 0x7fee100c78b0 unknown :-1 s=CLOSED pgs=871 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:47:26.879 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:26.876+0000 7fee16a4d640 1 --2- 172.21.15.150:0/3852762391 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fedf8003a30 0x7fee100c8380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:47:26.879 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:26.876+0000 7fee16a4d640 1 -- 172.21.15.150:0/3852762391 >> 172.21.15.150:0/3852762391 conn(0x7fee10073890 msgr2=0x7fee1015d4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:47:26.879 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:26.876+0000 7fee16a4d640 1 -- 172.21.15.150:0/3852762391 shutdown_connections 2024-09-17T05:47:26.879 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:26.876+0000 7fee16a4d640 1 -- 172.21.15.150:0/3852762391 wait complete. 2024-09-17T05:47:26.899 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume snapshot clone cephfs sv1 ss1 subvol_clone62874 2024-09-17T05:47:27.065 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:27.063+0000 7f80953ba640 1 -- 172.21.15.150:0/4066808947 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f80900cc610 msgr2=0x7f80900cdbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:47:27.065 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:27.063+0000 7f80953ba640 1 --2- 172.21.15.150:0/4066808947 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f80900cc610 0x7f80900cdbd0 secure :-1 s=READY pgs=872 cs=0 l=1 rev1=1 crypto rx=0x7f8090073bc0 tx=0x7f808802aa30 comp rx=0 tx=0).stop 2024-09-17T05:47:27.065 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:27.063+0000 7f80953ba640 1 -- 172.21.15.150:0/4066808947 shutdown_connections 2024-09-17T05:47:27.065 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:27.063+0000 7f80953ba640 1 --2- 172.21.15.150:0/4066808947 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f80900cc610 0x7f80900cdbd0 unknown :-1 s=CLOSED pgs=872 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:47:27.065 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:27.063+0000 7f80953ba640 1 --2- 172.21.15.150:0/4066808947 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f80900cbcc0 0x7f80900cc0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:47:27.066 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:27.063+0000 7f80953ba640 1 --2- 172.21.15.150:0/4066808947 >> v2:172.21.15.176:3300/0 conn(0x7f80900b6300 0x7f80900b6710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:47:27.066 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:27.063+0000 7f80953ba640 1 -- 172.21.15.150:0/4066808947 >> 172.21.15.150:0/4066808947 conn(0x7f80900b2ff0 msgr2=0x7f80900b3400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:47:27.066 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:27.063+0000 7f80953ba640 1 -- 172.21.15.150:0/4066808947 shutdown_connections 2024-09-17T05:47:27.066 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:27.063+0000 7f80953ba640 1 -- 172.21.15.150:0/4066808947 wait complete. 2024-09-17T05:47:27.067 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:27.066+0000 7f80953ba640 1 Processor -- start 2024-09-17T05:47:27.068 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:27.066+0000 7f80953ba640 1 -- start start 2024-09-17T05:47:27.071 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:27.068+0000 7f80953ba640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f80900b6300 0x7f8090159c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:47:27.071 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:27.068+0000 7f80953ba640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f80900cbcc0 0x7f8090154b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:47:27.071 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:27.068+0000 7f80953ba640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f80900cc610 0x7f80901516c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:47:27.071 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:27.068+0000 7f80867fc640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f80900cbcc0 0x7f8090154b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:47:27.072 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:27.068+0000 7f80953ba640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f80900ce5b0 con 0x7f80900cbcc0 2024-09-17T05:47:27.072 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:27.068+0000 7f80953ba640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f80900ce430 con 0x7f80900b6300 2024-09-17T05:47:27.072 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:27.068+0000 7f80953ba640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f80900ce730 con 0x7f80900cc610 2024-09-17T05:47:27.072 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:27.068+0000 7f80867fc640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f80900cbcc0 0x7f8090154b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:38042/0 (socket says 172.21.15.150:38042) 2024-09-17T05:47:27.072 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:27.068+0000 7f80867fc640 1 -- 172.21.15.150:0/3037275368 learned_addr learned my addr 172.21.15.150:0/3037275368 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:47:27.072 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:27.069+0000 7f80867fc640 1 -- 172.21.15.150:0/3037275368 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f80900cc610 msgr2=0x7f80901516c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:47:27.072 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:27.069+0000 7f80867fc640 1 --2- 172.21.15.150:0/3037275368 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f80900cc610 0x7f80901516c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:47:27.072 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:27.069+0000 7f80867fc640 1 -- 172.21.15.150:0/3037275368 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f80900b6300 msgr2=0x7f8090159c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:47:27.072 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:27.069+0000 7f80867fc640 1 --2- 172.21.15.150:0/3037275368 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f80900b6300 0x7f8090159c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:47:27.072 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:27.069+0000 7f80867fc640 1 -- 172.21.15.150:0/3037275368 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f809015ba80 con 0x7f80900cbcc0 2024-09-17T05:47:27.072 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:27.069+0000 7f80867fc640 1 --2- 172.21.15.150:0/3037275368 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f80900cbcc0 0x7f8090154b20 secure :-1 s=READY pgs=873 cs=0 l=1 rev1=1 crypto rx=0x7f807800b410 tx=0x7f807800b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:47:27.072 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:27.069+0000 7f8087fff640 1 -- 172.21.15.150:0/3037275368 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8078015020 con 0x7f80900cbcc0 2024-09-17T05:47:27.072 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:27.069+0000 7f8087fff640 1 -- 172.21.15.150:0/3037275368 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8078011920 con 0x7f80900cbcc0 2024-09-17T05:47:27.073 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:27.069+0000 7f8087fff640 1 -- 172.21.15.150:0/3037275368 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8078011d70 con 0x7f80900cbcc0 2024-09-17T05:47:27.073 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:27.069+0000 7f80953ba640 1 -- 172.21.15.150:0/3037275368 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f809015bd60 con 0x7f80900cbcc0 2024-09-17T05:47:27.073 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:27.069+0000 7f80953ba640 1 -- 172.21.15.150:0/3037275368 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f809015c320 con 0x7f80900cbcc0 2024-09-17T05:47:27.073 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:27.070+0000 7f80953ba640 1 -- 172.21.15.150:0/3037275368 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f80900b3400 con 0x7f80900cbcc0 2024-09-17T05:47:27.074 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:27.072+0000 7f8087fff640 1 -- 172.21.15.150:0/3037275368 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 22) ==== 102818+0+0 (secure 0 0 0) 0x7f8078018020 con 0x7f80900cbcc0 2024-09-17T05:47:27.075 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:27.073+0000 7f8087fff640 1 --2- 172.21.15.150:0/3037275368 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f8070079ac0 0x7f807007bfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:47:27.075 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:27.073+0000 7f8087fff640 1 -- 172.21.15.150:0/3037275368 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 5765+0+0 (secure 0 0 0) 0x7f8078099f20 con 0x7f80900cbcc0 2024-09-17T05:47:27.078 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:27.077+0000 7f8087fff640 1 -- 172.21.15.150:0/3037275368 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f80900b3400 con 0x7f80900cbcc0 2024-09-17T05:47:27.091 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:27.089+0000 7f808effd640 1 --2- 172.21.15.150:0/3037275368 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f8070079ac0 0x7f807007bfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:47:27.098 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:27.096+0000 7f808effd640 1 --2- 172.21.15.150:0/3037275368 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f8070079ac0 0x7f807007bfd0 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f80900735d0 tx=0x7f808000b370 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:47:27.354 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:27.351+0000 7f8087fff640 1 -- 172.21.15.150:0/3037275368 <== mon.0 v2:172.21.15.150:3300/0 7 ==== mgrmap(e 23) ==== 102920+0+0 (secure 0 0 0) 0x7f8078099ac0 con 0x7f80900cbcc0 2024-09-17T05:47:27.381 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:27.379+0000 7f80953ba640 1 -- 172.21.15.150:0/3037275368 --> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] -- mgr_command(tid 0: {"prefix": "fs subvolume snapshot clone", "vol_name": "cephfs", "sub_name": "sv1", "snap_name": "ss1", "target_sub_name": "subvol_clone62874", "target": ["mon-mgr", ""]}) -- 0x7f80900cec20 con 0x7f8070079ac0 2024-09-17T05:47:28.789 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:28.787+0000 7f8087fff640 1 -- 172.21.15.150:0/3037275368 <== mgr.4108 v2:172.21.15.176:6800/3631216395 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f80900cec20 con 0x7f8070079ac0 2024-09-17T05:47:28.794 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:28.792+0000 7f80953ba640 1 -- 172.21.15.150:0/3037275368 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f8070079ac0 msgr2=0x7f807007bfd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:47:28.794 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:28.792+0000 7f80953ba640 1 --2- 172.21.15.150:0/3037275368 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f8070079ac0 0x7f807007bfd0 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f80900735d0 tx=0x7f808000b370 comp rx=0 tx=0).stop 2024-09-17T05:47:28.794 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:28.792+0000 7f80953ba640 1 -- 172.21.15.150:0/3037275368 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f80900cbcc0 msgr2=0x7f8090154b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:47:28.794 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:28.792+0000 7f80953ba640 1 --2- 172.21.15.150:0/3037275368 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f80900cbcc0 0x7f8090154b20 secure :-1 s=READY pgs=873 cs=0 l=1 rev1=1 crypto rx=0x7f807800b410 tx=0x7f807800b8d0 comp rx=0 tx=0).stop 2024-09-17T05:47:28.794 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:28.793+0000 7f80953ba640 1 -- 172.21.15.150:0/3037275368 shutdown_connections 2024-09-17T05:47:28.794 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:28.793+0000 7f80953ba640 1 --2- 172.21.15.150:0/3037275368 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f8070079ac0 0x7f807007bfd0 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:47:28.794 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:28.793+0000 7f80953ba640 1 --2- 172.21.15.150:0/3037275368 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f80900cc610 0x7f80901516c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:47:28.795 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:28.793+0000 7f80953ba640 1 --2- 172.21.15.150:0/3037275368 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f80900cbcc0 0x7f8090154b20 unknown :-1 s=CLOSED pgs=873 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:47:28.795 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:28.793+0000 7f80953ba640 1 --2- 172.21.15.150:0/3037275368 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f80900b6300 0x7f8090159c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:47:28.795 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:28.793+0000 7f80953ba640 1 -- 172.21.15.150:0/3037275368 >> 172.21.15.150:0/3037275368 conn(0x7f80900b2ff0 msgr2=0x7f80900d1b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:47:28.795 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:28.794+0000 7f80953ba640 1 -- 172.21.15.150:0/3037275368 shutdown_connections 2024-09-17T05:47:28.795 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:28.794+0000 7f80953ba640 1 -- 172.21.15.150:0/3037275368 wait complete. 2024-09-17T05:47:28.824 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume snapshot clone cephfs sv1 ss1 subvol_clone43985 2024-09-17T05:47:28.983 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:28.981+0000 7f3a44fda640 1 -- 172.21.15.150:0/3149991464 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3a4006dea0 msgr2=0x7f3a400d0020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:47:28.983 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:28.981+0000 7f3a44fda640 1 --2- 172.21.15.150:0/3149991464 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3a4006dea0 0x7f3a400d0020 secure :-1 s=READY pgs=874 cs=0 l=1 rev1=1 crypto rx=0x7f3a4008d600 tx=0x7f3a2802a560 comp rx=0 tx=0).stop 2024-09-17T05:47:28.983 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:28.981+0000 7f3a44fda640 1 -- 172.21.15.150:0/3149991464 shutdown_connections 2024-09-17T05:47:28.983 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:28.981+0000 7f3a44fda640 1 --2- 172.21.15.150:0/3149991464 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3a4006e2b0 0x7f3a400d0560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:47:28.983 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:28.981+0000 7f3a44fda640 1 --2- 172.21.15.150:0/3149991464 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3a4006dea0 0x7f3a400d0020 unknown :-1 s=CLOSED pgs=874 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:47:28.983 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:28.981+0000 7f3a44fda640 1 --2- 172.21.15.150:0/3149991464 >> v2:172.21.15.176:3300/0 conn(0x7f3a400d5150 0x7f3a400b9b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:47:28.983 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:28.981+0000 7f3a44fda640 1 -- 172.21.15.150:0/3149991464 >> 172.21.15.150:0/3149991464 conn(0x7f3a4008bfe0 msgr2=0x7f3a400d46e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:47:28.983 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:28.981+0000 7f3a44fda640 1 -- 172.21.15.150:0/3149991464 shutdown_connections 2024-09-17T05:47:28.983 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:28.981+0000 7f3a44fda640 1 -- 172.21.15.150:0/3149991464 wait complete. 2024-09-17T05:47:28.984 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:28.983+0000 7f3a44fda640 1 Processor -- start 2024-09-17T05:47:28.984 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:28.983+0000 7f3a44fda640 1 -- start start 2024-09-17T05:47:28.986 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:28.985+0000 7f3a44fda640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3a4006dea0 0x7f3a400cc200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:47:28.986 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:28.985+0000 7f3a44fda640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3a4006e2b0 0x7f3a401f99b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:47:28.987 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:28.985+0000 7f3a44fda640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3a400d5150 0x7f3a400cd330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:47:28.987 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:28.985+0000 7f3a44fda640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f3a400d3150 con 0x7f3a4006e2b0 2024-09-17T05:47:28.987 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:28.985+0000 7f3a44fda640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f3a400d2fd0 con 0x7f3a400d5150 2024-09-17T05:47:28.987 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:28.985+0000 7f3a44fda640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f3a400b6160 con 0x7f3a4006dea0 2024-09-17T05:47:28.987 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:28.985+0000 7f3a37fff640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3a4006e2b0 0x7f3a401f99b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:47:28.987 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:28.985+0000 7f3a37fff640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3a4006e2b0 0x7f3a401f99b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:38066/0 (socket says 172.21.15.150:38066) 2024-09-17T05:47:28.987 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:28.985+0000 7f3a37fff640 1 -- 172.21.15.150:0/3770263750 learned_addr learned my addr 172.21.15.150:0/3770263750 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:47:28.988 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:28.985+0000 7f3a37fff640 1 -- 172.21.15.150:0/3770263750 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3a4006dea0 msgr2=0x7f3a400cc200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:47:28.988 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:28.985+0000 7f3a37fff640 1 --2- 172.21.15.150:0/3770263750 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3a4006dea0 0x7f3a400cc200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:47:28.988 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:28.985+0000 7f3a37fff640 1 -- 172.21.15.150:0/3770263750 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3a400d5150 msgr2=0x7f3a400cd330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:47:28.989 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:28.985+0000 7f3a37fff640 1 --2- 172.21.15.150:0/3770263750 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3a400d5150 0x7f3a400cd330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:47:28.989 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:28.985+0000 7f3a37fff640 1 -- 172.21.15.150:0/3770263750 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3a401f93a0 con 0x7f3a4006e2b0 2024-09-17T05:47:28.989 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:28.986+0000 7f3a37fff640 1 --2- 172.21.15.150:0/3770263750 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3a4006e2b0 0x7f3a401f99b0 secure :-1 s=READY pgs=875 cs=0 l=1 rev1=1 crypto rx=0x7f3a280099c0 tx=0x7f3a280039e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:47:28.989 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:28.986+0000 7f3a36ffd640 1 -- 172.21.15.150:0/3770263750 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a2803e030 con 0x7f3a4006e2b0 2024-09-17T05:47:28.989 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:28.986+0000 7f3a36ffd640 1 -- 172.21.15.150:0/3770263750 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f3a280047a0 con 0x7f3a4006e2b0 2024-09-17T05:47:28.989 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:28.986+0000 7f3a36ffd640 1 -- 172.21.15.150:0/3770263750 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a28035040 con 0x7f3a4006e2b0 2024-09-17T05:47:28.989 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:28.986+0000 7f3a44fda640 1 -- 172.21.15.150:0/3770263750 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3a401f66d0 con 0x7f3a4006e2b0 2024-09-17T05:47:28.989 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:28.986+0000 7f3a44fda640 1 -- 172.21.15.150:0/3770263750 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3a400cb720 con 0x7f3a4006e2b0 2024-09-17T05:47:28.989 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:28.988+0000 7f3a44fda640 1 -- 172.21.15.150:0/3770263750 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3a400b9b10 con 0x7f3a4006e2b0 2024-09-17T05:47:28.990 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:28.988+0000 7f3a36ffd640 1 -- 172.21.15.150:0/3770263750 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 23) ==== 102920+0+0 (secure 0 0 0) 0x7f3a28041030 con 0x7f3a4006e2b0 2024-09-17T05:47:28.990 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:28.989+0000 7f3a36ffd640 1 --2- 172.21.15.150:0/3770263750 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f3a20079c10 0x7f3a2007c120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:47:28.991 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:28.989+0000 7f3a36ffd640 1 -- 172.21.15.150:0/3770263750 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 5765+0+0 (secure 0 0 0) 0x7f3a280ba4a0 con 0x7f3a4006e2b0 2024-09-17T05:47:28.999 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:28.997+0000 7f3a36ffd640 1 -- 172.21.15.150:0/3770263750 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f3a28083ff0 con 0x7f3a4006e2b0 2024-09-17T05:47:29.024 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:29.023+0000 7f3a3e59c640 1 --2- 172.21.15.150:0/3770263750 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f3a20079c10 0x7f3a2007c120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:47:29.075 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:29.074+0000 7f3a3e59c640 1 --2- 172.21.15.150:0/3770263750 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f3a20079c10 0x7f3a2007c120 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f3a30009670 tx=0x7f3a30006be0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:47:29.274 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:29.272+0000 7f3a44fda640 1 -- 172.21.15.150:0/3770263750 --> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] -- mgr_command(tid 0: {"prefix": "fs subvolume snapshot clone", "vol_name": "cephfs", "sub_name": "sv1", "snap_name": "ss1", "target_sub_name": "subvol_clone43985", "target": ["mon-mgr", ""]}) -- 0x7f3a401f6460 con 0x7f3a20079c10 2024-09-17T05:47:31.002 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:31.001+0000 7f3a36ffd640 1 -- 172.21.15.150:0/3770263750 <== mgr.4108 v2:172.21.15.176:6800/3631216395 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f3a401f6460 con 0x7f3a20079c10 2024-09-17T05:47:31.005 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:31.003+0000 7f3a44fda640 1 -- 172.21.15.150:0/3770263750 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f3a20079c10 msgr2=0x7f3a2007c120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:47:31.005 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:31.003+0000 7f3a44fda640 1 --2- 172.21.15.150:0/3770263750 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f3a20079c10 0x7f3a2007c120 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f3a30009670 tx=0x7f3a30006be0 comp rx=0 tx=0).stop 2024-09-17T05:47:31.005 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:31.003+0000 7f3a44fda640 1 -- 172.21.15.150:0/3770263750 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3a4006e2b0 msgr2=0x7f3a401f99b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:47:31.005 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:31.003+0000 7f3a44fda640 1 --2- 172.21.15.150:0/3770263750 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3a4006e2b0 0x7f3a401f99b0 secure :-1 s=READY pgs=875 cs=0 l=1 rev1=1 crypto rx=0x7f3a280099c0 tx=0x7f3a280039e0 comp rx=0 tx=0).stop 2024-09-17T05:47:31.005 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:31.003+0000 7f3a44fda640 1 -- 172.21.15.150:0/3770263750 shutdown_connections 2024-09-17T05:47:31.005 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:31.003+0000 7f3a44fda640 1 --2- 172.21.15.150:0/3770263750 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3a400d5150 0x7f3a400cd330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:47:31.006 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:31.003+0000 7f3a44fda640 1 --2- 172.21.15.150:0/3770263750 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f3a20079c10 0x7f3a2007c120 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:47:31.006 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:31.003+0000 7f3a44fda640 1 --2- 172.21.15.150:0/3770263750 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3a4006e2b0 0x7f3a401f99b0 unknown :-1 s=CLOSED pgs=875 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:47:31.006 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:31.003+0000 7f3a44fda640 1 --2- 172.21.15.150:0/3770263750 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3a4006dea0 0x7f3a400cc200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:47:31.006 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:31.003+0000 7f3a44fda640 1 -- 172.21.15.150:0/3770263750 >> 172.21.15.150:0/3770263750 conn(0x7f3a4008bfe0 msgr2=0x7f3a40068e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:47:31.006 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:31.003+0000 7f3a44fda640 1 -- 172.21.15.150:0/3770263750 shutdown_connections 2024-09-17T05:47:31.006 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:31.003+0000 7f3a44fda640 1 -- 172.21.15.150:0/3770263750 wait complete. 2024-09-17T05:47:31.022 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume snapshot clone cephfs sv1 ss1 subvol_clone37686 2024-09-17T05:47:31.187 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:31.185+0000 7f1ceeabd640 1 -- 172.21.15.150:0/4041628437 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1ce815c820 msgr2=0x7f1ce80d0530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:47:31.188 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:31.185+0000 7f1ceeabd640 1 --2- 172.21.15.150:0/4041628437 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1ce815c820 0x7f1ce80d0530 secure :-1 s=READY pgs=876 cs=0 l=1 rev1=1 crypto rx=0x7f1ce815bcf0 tx=0x7f1cd802a4d0 comp rx=0 tx=0).stop 2024-09-17T05:47:31.188 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:31.185+0000 7f1ceeabd640 1 -- 172.21.15.150:0/4041628437 shutdown_connections 2024-09-17T05:47:31.188 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:31.185+0000 7f1ceeabd640 1 --2- 172.21.15.150:0/4041628437 >> v2:172.21.15.176:3300/0 conn(0x7f1ce806ddb0 0x7f1ce806e1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:47:31.188 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:31.185+0000 7f1ceeabd640 1 --2- 172.21.15.150:0/4041628437 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1ce815c820 0x7f1ce80d0530 unknown :-1 s=CLOSED pgs=876 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:47:31.188 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:31.185+0000 7f1ceeabd640 1 -- 172.21.15.150:0/4041628437 >> 172.21.15.150:0/4041628437 conn(0x7f1ce8073890 msgr2=0x7f1ce8073ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:47:31.188 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:31.185+0000 7f1ceeabd640 1 -- 172.21.15.150:0/4041628437 shutdown_connections 2024-09-17T05:47:31.188 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:31.185+0000 7f1ceeabd640 1 -- 172.21.15.150:0/4041628437 wait complete. 2024-09-17T05:47:31.189 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:31.187+0000 7f1ceeabd640 1 Processor -- start 2024-09-17T05:47:31.189 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:31.187+0000 7f1ceeabd640 1 -- start start 2024-09-17T05:47:31.192 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:31.189+0000 7f1ceeabd640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1ce806ddb0 0x7f1ce8144620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:47:31.192 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:31.189+0000 7f1ceeabd640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1ce80cd380 0x7f1ce81f9060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:47:31.192 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:31.189+0000 7f1ceeabd640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1ce815c820 0x7f1ce8154010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:47:31.192 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:31.189+0000 7f1ceeabd640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f1ce80cf8e0 con 0x7f1ce806ddb0 2024-09-17T05:47:31.192 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:31.189+0000 7f1ceeabd640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f1ce80cf760 con 0x7f1ce80cd380 2024-09-17T05:47:31.192 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:31.189+0000 7f1ceeabd640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f1ce80cfa60 con 0x7f1ce815c820 2024-09-17T05:47:31.192 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:31.189+0000 7f1cec859640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1ce806ddb0 0x7f1ce8144620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:47:31.193 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:31.189+0000 7f1cec859640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1ce806ddb0 0x7f1ce8144620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:50588/0 (socket says 172.21.15.150:50588) 2024-09-17T05:47:31.193 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:31.189+0000 7f1cec859640 1 -- 172.21.15.150:0/2191152748 learned_addr learned my addr 172.21.15.150:0/2191152748 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:47:31.193 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:31.189+0000 7f1cec859640 1 -- 172.21.15.150:0/2191152748 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1ce815c820 msgr2=0x7f1ce8154010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:47:31.193 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:31.189+0000 7f1cec859640 1 --2- 172.21.15.150:0/2191152748 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1ce815c820 0x7f1ce8154010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:47:31.193 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:31.189+0000 7f1cec859640 1 -- 172.21.15.150:0/2191152748 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1ce80cd380 msgr2=0x7f1ce81f9060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:47:31.193 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:31.189+0000 7f1cec859640 1 --2- 172.21.15.150:0/2191152748 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1ce80cd380 0x7f1ce81f9060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:47:31.193 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:31.189+0000 7f1cec859640 1 -- 172.21.15.150:0/2191152748 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1ce81f9d00 con 0x7f1ce806ddb0 2024-09-17T05:47:31.193 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:31.189+0000 7f1cec859640 1 --2- 172.21.15.150:0/2191152748 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1ce806ddb0 0x7f1ce8144620 secure :-1 s=READY pgs=877 cs=0 l=1 rev1=1 crypto rx=0x7f1cd80099c0 tx=0x7f1cd80039e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:47:31.193 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:31.190+0000 7f1ce57fa640 1 -- 172.21.15.150:0/2191152748 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1cd803e030 con 0x7f1ce806ddb0 2024-09-17T05:47:31.193 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:31.190+0000 7f1ceeabd640 1 -- 172.21.15.150:0/2191152748 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1ce8152120 con 0x7f1ce806ddb0 2024-09-17T05:47:31.194 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:31.190+0000 7f1ceeabd640 1 -- 172.21.15.150:0/2191152748 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1ce81526e0 con 0x7f1ce806ddb0 2024-09-17T05:47:31.194 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:31.190+0000 7f1ce57fa640 1 -- 172.21.15.150:0/2191152748 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f1cd80047a0 con 0x7f1ce806ddb0 2024-09-17T05:47:31.194 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:31.190+0000 7f1ce57fa640 1 -- 172.21.15.150:0/2191152748 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1cd8048060 con 0x7f1ce806ddb0 2024-09-17T05:47:31.194 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:31.191+0000 7f1ceeabd640 1 -- 172.21.15.150:0/2191152748 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1ce80d0000 con 0x7f1ce806ddb0 2024-09-17T05:47:31.194 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:31.192+0000 7f1ce57fa640 1 -- 172.21.15.150:0/2191152748 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 23) ==== 102920+0+0 (secure 0 0 0) 0x7f1cd8041030 con 0x7f1ce806ddb0 2024-09-17T05:47:31.195 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:31.192+0000 7f1ce57fa640 1 --2- 172.21.15.150:0/2191152748 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f1cd4079c10 0x7f1cd407c120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:47:31.195 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:31.192+0000 7f1ce57fa640 1 -- 172.21.15.150:0/2191152748 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 5765+0+0 (secure 0 0 0) 0x7f1cd80ba440 con 0x7f1ce806ddb0 2024-09-17T05:47:31.200 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:31.198+0000 7f1ce57fa640 1 -- 172.21.15.150:0/2191152748 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f1ce80d0a70 con 0x7f1ce806ddb0 2024-09-17T05:47:31.233 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:31.230+0000 7f1ce7fff640 1 --2- 172.21.15.150:0/2191152748 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f1cd4079c10 0x7f1cd407c120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:47:31.344 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:31.342+0000 7f1ce7fff640 1 --2- 172.21.15.150:0/2191152748 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f1cd4079c10 0x7f1cd407c120 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f1ce81f0050 tx=0x7f1cdc006ba0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:47:31.523 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:31.522+0000 7f1ceeabd640 1 -- 172.21.15.150:0/2191152748 --> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] -- mgr_command(tid 0: {"prefix": "fs subvolume snapshot clone", "vol_name": "cephfs", "sub_name": "sv1", "snap_name": "ss1", "target_sub_name": "subvol_clone37686", "target": ["mon-mgr", ""]}) -- 0x7f1ce80b11b0 con 0x7f1cd4079c10 2024-09-17T05:47:32.222 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:32.221+0000 7f1ce57fa640 1 -- 172.21.15.150:0/2191152748 <== mgr.4108 v2:172.21.15.176:6800/3631216395 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f1ce80b11b0 con 0x7f1cd4079c10 2024-09-17T05:47:32.225 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:32.224+0000 7f1ceeabd640 1 -- 172.21.15.150:0/2191152748 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f1cd4079c10 msgr2=0x7f1cd407c120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:47:32.226 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:32.224+0000 7f1ceeabd640 1 --2- 172.21.15.150:0/2191152748 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f1cd4079c10 0x7f1cd407c120 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f1ce81f0050 tx=0x7f1cdc006ba0 comp rx=0 tx=0).stop 2024-09-17T05:47:32.226 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:32.224+0000 7f1ceeabd640 1 -- 172.21.15.150:0/2191152748 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1ce806ddb0 msgr2=0x7f1ce8144620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:47:32.226 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:32.224+0000 7f1ceeabd640 1 --2- 172.21.15.150:0/2191152748 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1ce806ddb0 0x7f1ce8144620 secure :-1 s=READY pgs=877 cs=0 l=1 rev1=1 crypto rx=0x7f1cd80099c0 tx=0x7f1cd80039e0 comp rx=0 tx=0).stop 2024-09-17T05:47:32.226 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:32.225+0000 7f1ceeabd640 1 -- 172.21.15.150:0/2191152748 shutdown_connections 2024-09-17T05:47:32.226 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:32.225+0000 7f1ceeabd640 1 --2- 172.21.15.150:0/2191152748 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1ce80cd380 0x7f1ce81f9060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:47:32.226 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:32.225+0000 7f1ceeabd640 1 --2- 172.21.15.150:0/2191152748 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f1cd4079c10 0x7f1cd407c120 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:47:32.226 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:32.225+0000 7f1ceeabd640 1 --2- 172.21.15.150:0/2191152748 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1ce815c820 0x7f1ce8154010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:47:32.226 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:32.225+0000 7f1ceeabd640 1 --2- 172.21.15.150:0/2191152748 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1ce806ddb0 0x7f1ce8144620 unknown :-1 s=CLOSED pgs=877 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:47:32.226 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:32.225+0000 7f1ceeabd640 1 -- 172.21.15.150:0/2191152748 >> 172.21.15.150:0/2191152748 conn(0x7f1ce8073890 msgr2=0x7f1ce80b5d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:47:32.226 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:32.225+0000 7f1ceeabd640 1 -- 172.21.15.150:0/2191152748 shutdown_connections 2024-09-17T05:47:32.226 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:32.225+0000 7f1ceeabd640 1 -- 172.21.15.150:0/2191152748 wait complete. 2024-09-17T05:47:32.247 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format json-pretty 2024-09-17T05:47:32.422 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:32.421+0000 7f1ab4ea9640 1 -- 172.21.15.150:0/3496265525 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1ab00d1080 msgr2=0x7f1ab00d1490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:47:32.422 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:32.421+0000 7f1ab4ea9640 1 --2- 172.21.15.150:0/3496265525 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1ab00d1080 0x7f1ab00d1490 secure :-1 s=READY pgs=878 cs=0 l=1 rev1=1 crypto rx=0x7f1ab00b71d0 tx=0x7f1aa802aa30 comp rx=0 tx=0).stop 2024-09-17T05:47:32.423 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:32.421+0000 7f1ab4ea9640 1 -- 172.21.15.150:0/3496265525 shutdown_connections 2024-09-17T05:47:32.423 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:32.421+0000 7f1ab4ea9640 1 --2- 172.21.15.150:0/3496265525 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1ab00d1080 0x7f1ab00d1490 unknown :-1 s=CLOSED pgs=878 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:47:32.423 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:32.421+0000 7f1ab4ea9640 1 --2- 172.21.15.150:0/3496265525 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1ab00d4f90 0x7f1ab00d0400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:47:32.423 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:32.421+0000 7f1ab4ea9640 1 --2- 172.21.15.150:0/3496265525 >> v2:172.21.15.176:3300/0 conn(0x7f1ab00b5d50 0x7f1ab00d2780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:47:32.423 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:32.421+0000 7f1ab4ea9640 1 -- 172.21.15.150:0/3496265525 >> 172.21.15.150:0/3496265525 conn(0x7f1ab008bfe0 msgr2=0x7f1ab00d4670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:47:32.423 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:32.421+0000 7f1ab4ea9640 1 -- 172.21.15.150:0/3496265525 shutdown_connections 2024-09-17T05:47:32.423 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:32.421+0000 7f1ab4ea9640 1 -- 172.21.15.150:0/3496265525 wait complete. 2024-09-17T05:47:32.424 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:32.423+0000 7f1ab4ea9640 1 Processor -- start 2024-09-17T05:47:32.424 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:32.423+0000 7f1ab4ea9640 1 -- start start 2024-09-17T05:47:32.426 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:32.425+0000 7f1ab4ea9640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1ab00b5d50 0x7f1ab00b1220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:47:32.426 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:32.425+0000 7f1ab4ea9640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1ab00d1080 0x7f1ab00b1760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:47:32.426 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:32.425+0000 7f1ab4ea9640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1ab00d4f90 0x7f1ab0152630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:47:32.426 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:32.425+0000 7f1ab4ea9640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f1ab00b7850 con 0x7f1ab00b5d50 2024-09-17T05:47:32.426 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:32.425+0000 7f1ab4ea9640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f1ab00b76d0 con 0x7f1ab00d4f90 2024-09-17T05:47:32.426 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:32.425+0000 7f1ab4ea9640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f1ab00b79d0 con 0x7f1ab00d1080 2024-09-17T05:47:32.426 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:32.425+0000 7f1aae59c640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1ab00b5d50 0x7f1ab00b1220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:47:32.426 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:32.425+0000 7f1aae59c640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1ab00b5d50 0x7f1ab00b1220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:50616/0 (socket says 172.21.15.150:50616) 2024-09-17T05:47:32.427 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:32.425+0000 7f1aae59c640 1 -- 172.21.15.150:0/3022211396 learned_addr learned my addr 172.21.15.150:0/3022211396 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:47:32.427 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:32.426+0000 7f1aae59c640 1 -- 172.21.15.150:0/3022211396 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1ab00d1080 msgr2=0x7f1ab00b1760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:47:32.428 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:32.426+0000 7f1aae59c640 1 --2- 172.21.15.150:0/3022211396 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1ab00d1080 0x7f1ab00b1760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:47:32.428 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:32.426+0000 7f1aae59c640 1 -- 172.21.15.150:0/3022211396 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1ab00d4f90 msgr2=0x7f1ab0152630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:47:32.428 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:32.426+0000 7f1aae59c640 1 --2- 172.21.15.150:0/3022211396 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1ab00d4f90 0x7f1ab0152630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:47:32.428 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:32.426+0000 7f1aae59c640 1 -- 172.21.15.150:0/3022211396 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1ab00b3e90 con 0x7f1ab00b5d50 2024-09-17T05:47:32.428 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:32.426+0000 7f1aae59c640 1 --2- 172.21.15.150:0/3022211396 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1ab00b5d50 0x7f1ab00b1220 secure :-1 s=READY pgs=879 cs=0 l=1 rev1=1 crypto rx=0x7f1a9800b410 tx=0x7f1a9800b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:47:32.428 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:32.426+0000 7f1aa6ffd640 1 -- 172.21.15.150:0/3022211396 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a98015020 con 0x7f1ab00b5d50 2024-09-17T05:47:32.428 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:32.426+0000 7f1aa6ffd640 1 -- 172.21.15.150:0/3022211396 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f1a98011940 con 0x7f1ab00b5d50 2024-09-17T05:47:32.428 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:32.426+0000 7f1aa6ffd640 1 -- 172.21.15.150:0/3022211396 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a98011d90 con 0x7f1ab00b5d50 2024-09-17T05:47:32.428 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:32.427+0000 7f1ab4ea9640 1 -- 172.21.15.150:0/3022211396 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1ab00b4170 con 0x7f1ab00b5d50 2024-09-17T05:47:32.428 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:32.427+0000 7f1ab4ea9640 1 -- 172.21.15.150:0/3022211396 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1ab00b4730 con 0x7f1ab00b5d50 2024-09-17T05:47:32.429 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:32.428+0000 7f1ab4ea9640 1 -- 172.21.15.150:0/3022211396 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1ab00b9120 con 0x7f1ab00b5d50 2024-09-17T05:47:32.429 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:32.428+0000 7f1aa6ffd640 1 -- 172.21.15.150:0/3022211396 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 23) ==== 102920+0+0 (secure 0 0 0) 0x7f1a98018020 con 0x7f1ab00b5d50 2024-09-17T05:47:32.429 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:32.429+0000 7f1aa6ffd640 1 --2- 172.21.15.150:0/3022211396 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f1a90079be0 0x7f1a9007c0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:47:32.429 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:32.429+0000 7f1aa6ffd640 1 -- 172.21.15.150:0/3022211396 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 5765+0+0 (secure 0 0 0) 0x7f1a98099b50 con 0x7f1ab00b5d50 2024-09-17T05:47:32.435 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:32.434+0000 7f1aa6ffd640 1 -- 172.21.15.150:0/3022211396 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f1a9801f020 con 0x7f1ab00b5d50 2024-09-17T05:47:32.472 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:32.472+0000 7f1aa7fff640 1 --2- 172.21.15.150:0/3022211396 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f1a90079be0 0x7f1a9007c0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:47:32.489 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:32.488+0000 7f1aa7fff640 1 --2- 172.21.15.150:0/3022211396 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f1a90079be0 0x7f1a9007c0f0 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f1ab00b3670 tx=0x7f1aa0006bf0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:47:32.780 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:32.779+0000 7f1ab4ea9640 1 -- 172.21.15.150:0/3022211396 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) -- 0x7f1ab00d2d60 con 0x7f1ab00b5d50 2024-09-17T05:47:32.781 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:32.780+0000 7f1aa6ffd640 1 -- 172.21.15.150:0/3022211396 <== mon.0 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) ==== 79+0+2182 (secure 0 0 0) 0x7f1a98063730 con 0x7f1ab00b5d50 2024-09-17T05:47:32.781 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-09-17T05:47:32.781 INFO:teuthology.orchestra.run.smithi150.stdout:{ 2024-09-17T05:47:32.782 INFO:teuthology.orchestra.run.smithi150.stdout: "fsid": "9f2e05e9-d629-47b3-b26b-1360655b7d20", 2024-09-17T05:47:32.782 INFO:teuthology.orchestra.run.smithi150.stdout: "health": { 2024-09-17T05:47:32.782 INFO:teuthology.orchestra.run.smithi150.stdout: "status": "HEALTH_OK", 2024-09-17T05:47:32.782 INFO:teuthology.orchestra.run.smithi150.stdout: "checks": {}, 2024-09-17T05:47:32.782 INFO:teuthology.orchestra.run.smithi150.stdout: "mutes": [] 2024-09-17T05:47:32.782 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-17T05:47:32.782 INFO:teuthology.orchestra.run.smithi150.stdout: "election_epoch": 4, 2024-09-17T05:47:32.782 INFO:teuthology.orchestra.run.smithi150.stdout: "quorum": [ 2024-09-17T05:47:32.782 INFO:teuthology.orchestra.run.smithi150.stdout: 0, 2024-09-17T05:47:32.782 INFO:teuthology.orchestra.run.smithi150.stdout: 1, 2024-09-17T05:47:32.782 INFO:teuthology.orchestra.run.smithi150.stdout: 2 2024-09-17T05:47:32.782 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2024-09-17T05:47:32.782 INFO:teuthology.orchestra.run.smithi150.stdout: "quorum_names": [ 2024-09-17T05:47:32.783 INFO:teuthology.orchestra.run.smithi150.stdout: "a", 2024-09-17T05:47:32.783 INFO:teuthology.orchestra.run.smithi150.stdout: "b", 2024-09-17T05:47:32.783 INFO:teuthology.orchestra.run.smithi150.stdout: "c" 2024-09-17T05:47:32.783 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2024-09-17T05:47:32.783 INFO:teuthology.orchestra.run.smithi150.stdout: "quorum_age": 360, 2024-09-17T05:47:32.783 INFO:teuthology.orchestra.run.smithi150.stdout: "monmap": { 2024-09-17T05:47:32.783 INFO:teuthology.orchestra.run.smithi150.stdout: "epoch": 1, 2024-09-17T05:47:32.783 INFO:teuthology.orchestra.run.smithi150.stdout: "min_mon_release_name": "squid", 2024-09-17T05:47:32.783 INFO:teuthology.orchestra.run.smithi150.stdout: "num_mons": 3 2024-09-17T05:47:32.783 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-17T05:47:32.783 INFO:teuthology.orchestra.run.smithi150.stdout: "osdmap": { 2024-09-17T05:47:32.783 INFO:teuthology.orchestra.run.smithi150.stdout: "epoch": 72, 2024-09-17T05:47:32.783 INFO:teuthology.orchestra.run.smithi150.stdout: "num_osds": 8, 2024-09-17T05:47:32.784 INFO:teuthology.orchestra.run.smithi150.stdout: "num_up_osds": 8, 2024-09-17T05:47:32.784 INFO:teuthology.orchestra.run.smithi150.stdout: "osd_up_since": 1726551706, 2024-09-17T05:47:32.784 INFO:teuthology.orchestra.run.smithi150.stdout: "num_in_osds": 8, 2024-09-17T05:47:32.784 INFO:teuthology.orchestra.run.smithi150.stdout: "osd_in_since": 1726551696, 2024-09-17T05:47:32.784 INFO:teuthology.orchestra.run.smithi150.stdout: "num_remapped_pgs": 0 2024-09-17T05:47:32.784 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-17T05:47:32.784 INFO:teuthology.orchestra.run.smithi150.stdout: "pgmap": { 2024-09-17T05:47:32.784 INFO:teuthology.orchestra.run.smithi150.stdout: "pgs_by_state": [ 2024-09-17T05:47:32.784 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-09-17T05:47:32.784 INFO:teuthology.orchestra.run.smithi150.stdout: "state_name": "active+clean", 2024-09-17T05:47:32.784 INFO:teuthology.orchestra.run.smithi150.stdout: "count": 97 2024-09-17T05:47:32.784 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-09-17T05:47:32.784 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2024-09-17T05:47:32.785 INFO:teuthology.orchestra.run.smithi150.stdout: "num_pgs": 97, 2024-09-17T05:47:32.785 INFO:teuthology.orchestra.run.smithi150.stdout: "num_pools": 3, 2024-09-17T05:47:32.785 INFO:teuthology.orchestra.run.smithi150.stdout: "num_objects": 1359, 2024-09-17T05:47:32.785 INFO:teuthology.orchestra.run.smithi150.stdout: "data_bytes": 5554345447, 2024-09-17T05:47:32.785 INFO:teuthology.orchestra.run.smithi150.stdout: "bytes_used": 11146629120, 2024-09-17T05:47:32.785 INFO:teuthology.orchestra.run.smithi150.stdout: "bytes_avail": 761947484160, 2024-09-17T05:47:32.785 INFO:teuthology.orchestra.run.smithi150.stdout: "bytes_total": 773094113280, 2024-09-17T05:47:32.785 INFO:teuthology.orchestra.run.smithi150.stdout: "read_bytes_sec": 199839764, 2024-09-17T05:47:32.785 INFO:teuthology.orchestra.run.smithi150.stdout: "write_bytes_sec": 241446660, 2024-09-17T05:47:32.785 INFO:teuthology.orchestra.run.smithi150.stdout: "read_op_per_sec": 48, 2024-09-17T05:47:32.785 INFO:teuthology.orchestra.run.smithi150.stdout: "write_op_per_sec": 67 2024-09-17T05:47:32.785 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-17T05:47:32.785 INFO:teuthology.orchestra.run.smithi150.stdout: "fsmap": { 2024-09-17T05:47:32.786 INFO:teuthology.orchestra.run.smithi150.stdout: "epoch": 43, 2024-09-17T05:47:32.786 INFO:teuthology.orchestra.run.smithi150.stdout: "btime": "2024-09-17T05:47:03:788551+0000", 2024-09-17T05:47:32.786 INFO:teuthology.orchestra.run.smithi150.stdout: "id": 5, 2024-09-17T05:47:32.786 INFO:teuthology.orchestra.run.smithi150.stdout: "up": 1, 2024-09-17T05:47:32.786 INFO:teuthology.orchestra.run.smithi150.stdout: "in": 1, 2024-09-17T05:47:32.786 INFO:teuthology.orchestra.run.smithi150.stdout: "max": 1, 2024-09-17T05:47:32.786 INFO:teuthology.orchestra.run.smithi150.stdout: "by_rank": [ 2024-09-17T05:47:32.786 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-09-17T05:47:32.786 INFO:teuthology.orchestra.run.smithi150.stdout: "filesystem_id": 5, 2024-09-17T05:47:32.786 INFO:teuthology.orchestra.run.smithi150.stdout: "rank": 0, 2024-09-17T05:47:32.786 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "a", 2024-09-17T05:47:32.786 INFO:teuthology.orchestra.run.smithi150.stdout: "status": "up:active", 2024-09-17T05:47:32.786 INFO:teuthology.orchestra.run.smithi150.stdout: "gid": 6498 2024-09-17T05:47:32.787 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-09-17T05:47:32.787 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2024-09-17T05:47:32.787 INFO:teuthology.orchestra.run.smithi150.stdout: "up:standby": 3 2024-09-17T05:47:32.787 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-17T05:47:32.787 INFO:teuthology.orchestra.run.smithi150.stdout: "mgrmap": { 2024-09-17T05:47:32.787 INFO:teuthology.orchestra.run.smithi150.stdout: "available": true, 2024-09-17T05:47:32.787 INFO:teuthology.orchestra.run.smithi150.stdout: "num_standbys": 1, 2024-09-17T05:47:32.787 INFO:teuthology.orchestra.run.smithi150.stdout: "modules": [ 2024-09-17T05:47:32.787 INFO:teuthology.orchestra.run.smithi150.stdout: "iostat", 2024-09-17T05:47:32.787 INFO:teuthology.orchestra.run.smithi150.stdout: "nfs", 2024-09-17T05:47:32.787 INFO:teuthology.orchestra.run.smithi150.stdout: "restful" 2024-09-17T05:47:32.787 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2024-09-17T05:47:32.787 INFO:teuthology.orchestra.run.smithi150.stdout: "services": {} 2024-09-17T05:47:32.787 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-17T05:47:32.788 INFO:teuthology.orchestra.run.smithi150.stdout: "servicemap": { 2024-09-17T05:47:32.788 INFO:teuthology.orchestra.run.smithi150.stdout: "epoch": 12, 2024-09-17T05:47:32.788 INFO:teuthology.orchestra.run.smithi150.stdout: "modified": "2024-09-17T05:46:38.927436+0000", 2024-09-17T05:47:32.788 INFO:teuthology.orchestra.run.smithi150.stdout: "services": {} 2024-09-17T05:47:32.788 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-17T05:47:32.788 INFO:teuthology.orchestra.run.smithi150.stdout: "progress_events": { 2024-09-17T05:47:32.788 INFO:teuthology.orchestra.run.smithi150.stdout: "mgr-vol-ongoing-clones": { 2024-09-17T05:47:32.788 INFO:teuthology.orchestra.run.smithi150.stdout: "message": "3 ongoing clones - average progress is 24.826% (3s)\n [======......................] (remaining: 10s)", 2024-09-17T05:47:32.788 INFO:teuthology.orchestra.run.smithi150.stdout: "progress": 0.2482600063085556, 2024-09-17T05:47:32.788 INFO:teuthology.orchestra.run.smithi150.stdout: "add_to_ceph_s": true 2024-09-17T05:47:32.788 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-09-17T05:47:32.788 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-09-17T05:47:32.789 INFO:teuthology.orchestra.run.smithi150.stdout:} 2024-09-17T05:47:32.789 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:32.785+0000 7f1ab4ea9640 1 -- 172.21.15.150:0/3022211396 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f1a90079be0 msgr2=0x7f1a9007c0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:47:32.789 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:32.785+0000 7f1ab4ea9640 1 --2- 172.21.15.150:0/3022211396 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f1a90079be0 0x7f1a9007c0f0 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f1ab00b3670 tx=0x7f1aa0006bf0 comp rx=0 tx=0).stop 2024-09-17T05:47:32.789 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:32.785+0000 7f1ab4ea9640 1 -- 172.21.15.150:0/3022211396 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1ab00b5d50 msgr2=0x7f1ab00b1220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:47:32.790 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:32.785+0000 7f1ab4ea9640 1 --2- 172.21.15.150:0/3022211396 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1ab00b5d50 0x7f1ab00b1220 secure :-1 s=READY pgs=879 cs=0 l=1 rev1=1 crypto rx=0x7f1a9800b410 tx=0x7f1a9800b8d0 comp rx=0 tx=0).stop 2024-09-17T05:47:32.790 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:32.785+0000 7f1ab4ea9640 1 -- 172.21.15.150:0/3022211396 shutdown_connections 2024-09-17T05:47:32.790 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:32.785+0000 7f1ab4ea9640 1 --2- 172.21.15.150:0/3022211396 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1ab00d4f90 0x7f1ab0152630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:47:32.790 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:32.785+0000 7f1ab4ea9640 1 --2- 172.21.15.150:0/3022211396 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f1a90079be0 0x7f1a9007c0f0 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:47:32.790 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:32.785+0000 7f1ab4ea9640 1 --2- 172.21.15.150:0/3022211396 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1ab00d1080 0x7f1ab00b1760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:47:32.790 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:32.785+0000 7f1ab4ea9640 1 --2- 172.21.15.150:0/3022211396 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1ab00b5d50 0x7f1ab00b1220 unknown :-1 s=CLOSED pgs=879 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:47:32.790 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:32.785+0000 7f1ab4ea9640 1 -- 172.21.15.150:0/3022211396 >> 172.21.15.150:0/3022211396 conn(0x7f1ab008bfe0 msgr2=0x7f1ab0160030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:47:32.790 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:32.785+0000 7f1ab4ea9640 1 -- 172.21.15.150:0/3022211396 shutdown_connections 2024-09-17T05:47:32.790 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:32.785+0000 7f1ab4ea9640 1 -- 172.21.15.150:0/3022211396 wait complete. 2024-09-17T05:47:33.799 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format json-pretty 2024-09-17T05:47:33.988 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:33.986+0000 7fbe53ab6640 1 -- 172.21.15.150:0/2154491718 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbe38005910 msgr2=0x7fbe38005d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:47:33.988 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:33.986+0000 7fbe53ab6640 1 --2- 172.21.15.150:0/2154491718 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbe38005910 0x7fbe38005d20 secure :-1 s=READY pgs=881 cs=0 l=1 rev1=1 crypto rx=0x7fbe3c0099d0 tx=0x7fbe38006940 comp rx=0 tx=0).stop 2024-09-17T05:47:33.988 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:33.986+0000 7fbe52053640 1 -- 172.21.15.150:0/2154491718 reap_dead start 2024-09-17T05:47:33.988 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:33.987+0000 7fbe53ab6640 1 -- 172.21.15.150:0/2154491718 shutdown_connections 2024-09-17T05:47:33.988 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:33.987+0000 7fbe53ab6640 1 -- 172.21.15.150:0/2154491718 >> 172.21.15.150:0/2154491718 conn(0x7fbe4c073890 msgr2=0x7fbe4c073ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:47:33.988 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:33.987+0000 7fbe53ab6640 1 -- 172.21.15.150:0/2154491718 shutdown_connections 2024-09-17T05:47:33.988 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:33.987+0000 7fbe53ab6640 1 -- 172.21.15.150:0/2154491718 wait complete. 2024-09-17T05:47:33.989 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:33.989+0000 7fbe53ab6640 1 Processor -- start 2024-09-17T05:47:33.989 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:33.989+0000 7fbe53ab6640 1 -- start start 2024-09-17T05:47:33.991 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:33.990+0000 7fbe53ab6640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fbe38005910 0x7fbe4c13fe10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:47:33.992 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:33.990+0000 7fbe53ab6640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbe4c157e30 0x7fbe4c158520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:47:33.992 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:33.990+0000 7fbe53ab6640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fbe4c1f8cb0 0x7fbe4c1f90c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:47:33.992 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:33.990+0000 7fbe53ab6640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7fbe4c06ddb0 con 0x7fbe4c157e30 2024-09-17T05:47:33.992 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:33.990+0000 7fbe53ab6640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fbe4c0b5b60 con 0x7fbe38005910 2024-09-17T05:47:33.992 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:33.990+0000 7fbe53ab6640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fbe4c06df30 con 0x7fbe4c1f8cb0 2024-09-17T05:47:33.992 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:33.990+0000 7fbe51051640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbe4c157e30 0x7fbe4c158520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:47:33.992 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:33.991+0000 7fbe51051640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbe4c157e30 0x7fbe4c158520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:50636/0 (socket says 172.21.15.150:50636) 2024-09-17T05:47:33.992 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:33.991+0000 7fbe51051640 1 -- 172.21.15.150:0/2603370246 learned_addr learned my addr 172.21.15.150:0/2603370246 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:47:33.992 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:33.991+0000 7fbe51051640 1 -- 172.21.15.150:0/2603370246 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fbe4c1f8cb0 msgr2=0x7fbe4c1f90c0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-17T05:47:33.992 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:33.991+0000 7fbe51051640 1 --2- 172.21.15.150:0/2603370246 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fbe4c1f8cb0 0x7fbe4c1f90c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:47:33.992 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:33.991+0000 7fbe51051640 1 -- 172.21.15.150:0/2603370246 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fbe38005910 msgr2=0x7fbe4c13fe10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:47:33.992 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:33.991+0000 7fbe51051640 1 --2- 172.21.15.150:0/2603370246 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fbe38005910 0x7fbe4c13fe10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:47:33.992 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:33.991+0000 7fbe51051640 1 -- 172.21.15.150:0/2603370246 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbe4c1f9600 con 0x7fbe4c157e30 2024-09-17T05:47:33.993 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:33.991+0000 7fbe51051640 1 --2- 172.21.15.150:0/2603370246 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbe4c157e30 0x7fbe4c158520 secure :-1 s=READY pgs=882 cs=0 l=1 rev1=1 crypto rx=0x7fbe3c000c00 tx=0x7fbe3c0038c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:47:33.993 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:33.992+0000 7fbe427fc640 1 -- 172.21.15.150:0/2603370246 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe3c037050 con 0x7fbe4c157e30 2024-09-17T05:47:33.993 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:33.992+0000 7fbe427fc640 1 -- 172.21.15.150:0/2603370246 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fbe3c038040 con 0x7fbe4c157e30 2024-09-17T05:47:33.994 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:33.992+0000 7fbe53ab6640 1 -- 172.21.15.150:0/2603370246 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbe4c140350 con 0x7fbe4c157e30 2024-09-17T05:47:33.994 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:33.992+0000 7fbe427fc640 1 -- 172.21.15.150:0/2603370246 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe3c0325f0 con 0x7fbe4c157e30 2024-09-17T05:47:33.994 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:33.992+0000 7fbe53ab6640 1 -- 172.21.15.150:0/2603370246 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbe4c157070 con 0x7fbe4c157e30 2024-09-17T05:47:33.994 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:33.993+0000 7fbe53ab6640 1 -- 172.21.15.150:0/2603370246 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbe4c074830 con 0x7fbe4c157e30 2024-09-17T05:47:33.994 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:33.994+0000 7fbe427fc640 1 -- 172.21.15.150:0/2603370246 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 23) ==== 102920+0+0 (secure 0 0 0) 0x7fbe3c045020 con 0x7fbe4c157e30 2024-09-17T05:47:33.996 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:33.996+0000 7fbe427fc640 1 --2- 172.21.15.150:0/2603370246 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fbe30079c10 0x7fbe3007c120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:47:33.997 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:33.996+0000 7fbe427fc640 1 -- 172.21.15.150:0/2603370246 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 5765+0+0 (secure 0 0 0) 0x7fbe3c0b9dd0 con 0x7fbe4c157e30 2024-09-17T05:47:34.001 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:34.001+0000 7fbe427fc640 1 -- 172.21.15.150:0/2603370246 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fbe3c04c020 con 0x7fbe4c157e30 2024-09-17T05:47:34.064 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:34.063+0000 7fbe51852640 1 --2- 172.21.15.150:0/2603370246 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fbe30079c10 0x7fbe3007c120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:47:34.174 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:34.174+0000 7fbe51852640 1 --2- 172.21.15.150:0/2603370246 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fbe30079c10 0x7fbe3007c120 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7fbe48001330 tx=0x7fbe480012a0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:47:34.360 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:34.359+0000 7fbe53ab6640 1 -- 172.21.15.150:0/2603370246 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) -- 0x7fbe4c0b0ce0 con 0x7fbe4c157e30 2024-09-17T05:47:34.360 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:34.360+0000 7fbe427fc640 1 -- 172.21.15.150:0/2603370246 <== mon.0 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) ==== 79+0+2424 (secure 0 0 0) 0x7fbe4c1f9600 con 0x7fbe4c157e30 2024-09-17T05:47:34.361 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-09-17T05:47:34.361 INFO:teuthology.orchestra.run.smithi150.stdout:{ 2024-09-17T05:47:34.361 INFO:teuthology.orchestra.run.smithi150.stdout: "fsid": "9f2e05e9-d629-47b3-b26b-1360655b7d20", 2024-09-17T05:47:34.361 INFO:teuthology.orchestra.run.smithi150.stdout: "health": { 2024-09-17T05:47:34.361 INFO:teuthology.orchestra.run.smithi150.stdout: "status": "HEALTH_OK", 2024-09-17T05:47:34.361 INFO:teuthology.orchestra.run.smithi150.stdout: "checks": {}, 2024-09-17T05:47:34.361 INFO:teuthology.orchestra.run.smithi150.stdout: "mutes": [] 2024-09-17T05:47:34.361 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-17T05:47:34.362 INFO:teuthology.orchestra.run.smithi150.stdout: "election_epoch": 4, 2024-09-17T05:47:34.362 INFO:teuthology.orchestra.run.smithi150.stdout: "quorum": [ 2024-09-17T05:47:34.362 INFO:teuthology.orchestra.run.smithi150.stdout: 0, 2024-09-17T05:47:34.362 INFO:teuthology.orchestra.run.smithi150.stdout: 1, 2024-09-17T05:47:34.362 INFO:teuthology.orchestra.run.smithi150.stdout: 2 2024-09-17T05:47:34.362 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2024-09-17T05:47:34.362 INFO:teuthology.orchestra.run.smithi150.stdout: "quorum_names": [ 2024-09-17T05:47:34.362 INFO:teuthology.orchestra.run.smithi150.stdout: "a", 2024-09-17T05:47:34.362 INFO:teuthology.orchestra.run.smithi150.stdout: "b", 2024-09-17T05:47:34.362 INFO:teuthology.orchestra.run.smithi150.stdout: "c" 2024-09-17T05:47:34.362 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2024-09-17T05:47:34.362 INFO:teuthology.orchestra.run.smithi150.stdout: "quorum_age": 361, 2024-09-17T05:47:34.363 INFO:teuthology.orchestra.run.smithi150.stdout: "monmap": { 2024-09-17T05:47:34.363 INFO:teuthology.orchestra.run.smithi150.stdout: "epoch": 1, 2024-09-17T05:47:34.363 INFO:teuthology.orchestra.run.smithi150.stdout: "min_mon_release_name": "squid", 2024-09-17T05:47:34.363 INFO:teuthology.orchestra.run.smithi150.stdout: "num_mons": 3 2024-09-17T05:47:34.363 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-17T05:47:34.363 INFO:teuthology.orchestra.run.smithi150.stdout: "osdmap": { 2024-09-17T05:47:34.363 INFO:teuthology.orchestra.run.smithi150.stdout: "epoch": 72, 2024-09-17T05:47:34.363 INFO:teuthology.orchestra.run.smithi150.stdout: "num_osds": 8, 2024-09-17T05:47:34.363 INFO:teuthology.orchestra.run.smithi150.stdout: "num_up_osds": 8, 2024-09-17T05:47:34.363 INFO:teuthology.orchestra.run.smithi150.stdout: "osd_up_since": 1726551706, 2024-09-17T05:47:34.363 INFO:teuthology.orchestra.run.smithi150.stdout: "num_in_osds": 8, 2024-09-17T05:47:34.363 INFO:teuthology.orchestra.run.smithi150.stdout: "osd_in_since": 1726551696, 2024-09-17T05:47:34.363 INFO:teuthology.orchestra.run.smithi150.stdout: "num_remapped_pgs": 0 2024-09-17T05:47:34.364 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-17T05:47:34.364 INFO:teuthology.orchestra.run.smithi150.stdout: "pgmap": { 2024-09-17T05:47:34.364 INFO:teuthology.orchestra.run.smithi150.stdout: "pgs_by_state": [ 2024-09-17T05:47:34.364 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-09-17T05:47:34.364 INFO:teuthology.orchestra.run.smithi150.stdout: "state_name": "active+clean", 2024-09-17T05:47:34.364 INFO:teuthology.orchestra.run.smithi150.stdout: "count": 97 2024-09-17T05:47:34.364 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-09-17T05:47:34.364 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2024-09-17T05:47:34.364 INFO:teuthology.orchestra.run.smithi150.stdout: "num_pgs": 97, 2024-09-17T05:47:34.364 INFO:teuthology.orchestra.run.smithi150.stdout: "num_pools": 3, 2024-09-17T05:47:34.364 INFO:teuthology.orchestra.run.smithi150.stdout: "num_objects": 2165, 2024-09-17T05:47:34.364 INFO:teuthology.orchestra.run.smithi150.stdout: "data_bytes": 8926840485, 2024-09-17T05:47:34.365 INFO:teuthology.orchestra.run.smithi150.stdout: "bytes_used": 17995681792, 2024-09-17T05:47:34.365 INFO:teuthology.orchestra.run.smithi150.stdout: "bytes_avail": 755098431488, 2024-09-17T05:47:34.365 INFO:teuthology.orchestra.run.smithi150.stdout: "bytes_total": 773094113280, 2024-09-17T05:47:34.365 INFO:teuthology.orchestra.run.smithi150.stdout: "read_bytes_sec": 494603959, 2024-09-17T05:47:34.365 INFO:teuthology.orchestra.run.smithi150.stdout: "write_bytes_sec": 522256003, 2024-09-17T05:47:34.365 INFO:teuthology.orchestra.run.smithi150.stdout: "read_op_per_sec": 120, 2024-09-17T05:47:34.365 INFO:teuthology.orchestra.run.smithi150.stdout: "write_op_per_sec": 142 2024-09-17T05:47:34.365 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-17T05:47:34.365 INFO:teuthology.orchestra.run.smithi150.stdout: "fsmap": { 2024-09-17T05:47:34.365 INFO:teuthology.orchestra.run.smithi150.stdout: "epoch": 43, 2024-09-17T05:47:34.365 INFO:teuthology.orchestra.run.smithi150.stdout: "btime": "2024-09-17T05:47:03:788551+0000", 2024-09-17T05:47:34.365 INFO:teuthology.orchestra.run.smithi150.stdout: "id": 5, 2024-09-17T05:47:34.365 INFO:teuthology.orchestra.run.smithi150.stdout: "up": 1, 2024-09-17T05:47:34.366 INFO:teuthology.orchestra.run.smithi150.stdout: "in": 1, 2024-09-17T05:47:34.366 INFO:teuthology.orchestra.run.smithi150.stdout: "max": 1, 2024-09-17T05:47:34.366 INFO:teuthology.orchestra.run.smithi150.stdout: "by_rank": [ 2024-09-17T05:47:34.366 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-09-17T05:47:34.366 INFO:teuthology.orchestra.run.smithi150.stdout: "filesystem_id": 5, 2024-09-17T05:47:34.366 INFO:teuthology.orchestra.run.smithi150.stdout: "rank": 0, 2024-09-17T05:47:34.366 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "a", 2024-09-17T05:47:34.366 INFO:teuthology.orchestra.run.smithi150.stdout: "status": "up:active", 2024-09-17T05:47:34.366 INFO:teuthology.orchestra.run.smithi150.stdout: "gid": 6498 2024-09-17T05:47:34.366 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-09-17T05:47:34.366 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2024-09-17T05:47:34.366 INFO:teuthology.orchestra.run.smithi150.stdout: "up:standby": 3 2024-09-17T05:47:34.366 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-17T05:47:34.366 INFO:teuthology.orchestra.run.smithi150.stdout: "mgrmap": { 2024-09-17T05:47:34.367 INFO:teuthology.orchestra.run.smithi150.stdout: "available": true, 2024-09-17T05:47:34.367 INFO:teuthology.orchestra.run.smithi150.stdout: "num_standbys": 1, 2024-09-17T05:47:34.367 INFO:teuthology.orchestra.run.smithi150.stdout: "modules": [ 2024-09-17T05:47:34.367 INFO:teuthology.orchestra.run.smithi150.stdout: "iostat", 2024-09-17T05:47:34.367 INFO:teuthology.orchestra.run.smithi150.stdout: "nfs", 2024-09-17T05:47:34.367 INFO:teuthology.orchestra.run.smithi150.stdout: "restful" 2024-09-17T05:47:34.367 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2024-09-17T05:47:34.367 INFO:teuthology.orchestra.run.smithi150.stdout: "services": {} 2024-09-17T05:47:34.367 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-17T05:47:34.367 INFO:teuthology.orchestra.run.smithi150.stdout: "servicemap": { 2024-09-17T05:47:34.367 INFO:teuthology.orchestra.run.smithi150.stdout: "epoch": 12, 2024-09-17T05:47:34.367 INFO:teuthology.orchestra.run.smithi150.stdout: "modified": "2024-09-17T05:46:38.927436+0000", 2024-09-17T05:47:34.367 INFO:teuthology.orchestra.run.smithi150.stdout: "services": {} 2024-09-17T05:47:34.368 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-17T05:47:34.368 INFO:teuthology.orchestra.run.smithi150.stdout: "progress_events": { 2024-09-17T05:47:34.368 INFO:teuthology.orchestra.run.smithi150.stdout: "mgr-vol-ongoing-clones": { 2024-09-17T05:47:34.368 INFO:teuthology.orchestra.run.smithi150.stdout: "message": "4 ongoing clones - average progress is 38.737% (7s)\n [==========..................] (remaining: 11s)", 2024-09-17T05:47:34.368 INFO:teuthology.orchestra.run.smithi150.stdout: "progress": 0.38736999034881592, 2024-09-17T05:47:34.368 INFO:teuthology.orchestra.run.smithi150.stdout: "add_to_ceph_s": true 2024-09-17T05:47:34.368 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-17T05:47:34.368 INFO:teuthology.orchestra.run.smithi150.stdout: "mgr-vol-total-clones": { 2024-09-17T05:47:34.368 INFO:teuthology.orchestra.run.smithi150.stdout: "message": "Total 5 clones - average progress is 34.167% (0s)\n [=========...................] ", 2024-09-17T05:47:34.368 INFO:teuthology.orchestra.run.smithi150.stdout: "progress": 0.34167000651359558, 2024-09-17T05:47:34.368 INFO:teuthology.orchestra.run.smithi150.stdout: "add_to_ceph_s": true 2024-09-17T05:47:34.368 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-09-17T05:47:34.368 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-09-17T05:47:34.369 INFO:teuthology.orchestra.run.smithi150.stdout:} 2024-09-17T05:47:34.369 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:34.363+0000 7fbe53ab6640 1 -- 172.21.15.150:0/2603370246 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fbe30079c10 msgr2=0x7fbe3007c120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:47:34.369 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:34.363+0000 7fbe53ab6640 1 --2- 172.21.15.150:0/2603370246 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fbe30079c10 0x7fbe3007c120 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7fbe48001330 tx=0x7fbe480012a0 comp rx=0 tx=0).stop 2024-09-17T05:47:34.369 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:34.363+0000 7fbe53ab6640 1 -- 172.21.15.150:0/2603370246 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbe4c157e30 msgr2=0x7fbe4c158520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:47:34.370 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:34.363+0000 7fbe53ab6640 1 --2- 172.21.15.150:0/2603370246 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbe4c157e30 0x7fbe4c158520 secure :-1 s=READY pgs=882 cs=0 l=1 rev1=1 crypto rx=0x7fbe3c000c00 tx=0x7fbe3c0038c0 comp rx=0 tx=0).stop 2024-09-17T05:47:34.370 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:34.363+0000 7fbe53ab6640 1 -- 172.21.15.150:0/2603370246 shutdown_connections 2024-09-17T05:47:34.370 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:34.363+0000 7fbe53ab6640 1 --2- 172.21.15.150:0/2603370246 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fbe30079c10 0x7fbe3007c120 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:47:34.370 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:34.363+0000 7fbe53ab6640 1 --2- 172.21.15.150:0/2603370246 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fbe4c1f8cb0 0x7fbe4c1f90c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:47:34.370 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:34.363+0000 7fbe53ab6640 1 --2- 172.21.15.150:0/2603370246 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbe4c157e30 0x7fbe4c158520 unknown :-1 s=CLOSED pgs=882 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:47:34.370 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:34.363+0000 7fbe53ab6640 1 --2- 172.21.15.150:0/2603370246 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fbe38005910 0x7fbe4c13fe10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:47:34.370 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:34.363+0000 7fbe53ab6640 1 -- 172.21.15.150:0/2603370246 >> 172.21.15.150:0/2603370246 conn(0x7fbe4c073890 msgr2=0x7fbe4c0b14e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:47:34.370 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:34.363+0000 7fbe53ab6640 1 -- 172.21.15.150:0/2603370246 shutdown_connections 2024-09-17T05:47:34.370 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:34.363+0000 7fbe53ab6640 1 -- 172.21.15.150:0/2603370246 wait complete. 2024-09-17T05:47:34.380 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs clone cancel cephfs subvol_clone51670 2024-09-17T05:47:34.538 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:34.537+0000 7ffa3215e640 1 -- 172.21.15.150:0/328733906 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ffa2c162dc0 msgr2=0x7ffa2c06f440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:47:34.538 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:34.537+0000 7ffa3215e640 1 --2- 172.21.15.150:0/328733906 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ffa2c162dc0 0x7ffa2c06f440 secure :-1 s=READY pgs=884 cs=0 l=1 rev1=1 crypto rx=0x7ffa20009830 tx=0x7ffa2002a3f0 comp rx=0 tx=0).stop 2024-09-17T05:47:34.538 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:34.537+0000 7ffa3215e640 1 -- 172.21.15.150:0/328733906 shutdown_connections 2024-09-17T05:47:34.539 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:34.537+0000 7ffa3215e640 1 --2- 172.21.15.150:0/328733906 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ffa2c0d0750 0x7ffa2c071b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:47:34.539 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:34.537+0000 7ffa3215e640 1 --2- 172.21.15.150:0/328733906 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ffa2c162dc0 0x7ffa2c06f440 unknown :-1 s=CLOSED pgs=884 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:47:34.539 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:34.537+0000 7ffa3215e640 1 -- 172.21.15.150:0/328733906 >> 172.21.15.150:0/328733906 conn(0x7ffa2c0d2520 msgr2=0x7ffa2c0d2930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:47:34.539 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:34.537+0000 7ffa3215e640 1 -- 172.21.15.150:0/328733906 shutdown_connections 2024-09-17T05:47:34.539 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:34.537+0000 7ffa3215e640 1 -- 172.21.15.150:0/328733906 wait complete. 2024-09-17T05:47:34.541 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:34.541+0000 7ffa3215e640 1 Processor -- start 2024-09-17T05:47:34.542 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:34.541+0000 7ffa3215e640 1 -- start start 2024-09-17T05:47:34.544 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:34.543+0000 7ffa3215e640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ffa2c0b1790 0x7ffa2c0ce780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:47:34.544 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:34.543+0000 7ffa3215e640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ffa2c0d0750 0x7ffa2c1f8f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:47:34.544 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:34.543+0000 7ffa3215e640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ffa2c155810 0x7ffa2c1f94a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:47:34.545 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:34.543+0000 7ffa3215e640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7ffa2c072090 con 0x7ffa2c155810 2024-09-17T05:47:34.545 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:34.543+0000 7ffa3215e640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7ffa2c0b7f70 con 0x7ffa2c0b1790 2024-09-17T05:47:34.545 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:34.543+0000 7ffa3215e640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7ffa2c072210 con 0x7ffa2c0d0750 2024-09-17T05:47:34.545 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:34.544+0000 7ffa2bfff640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ffa2c155810 0x7ffa2c1f94a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:47:34.545 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:34.544+0000 7ffa2bfff640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ffa2c155810 0x7ffa2c1f94a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:50654/0 (socket says 172.21.15.150:50654) 2024-09-17T05:47:34.545 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:34.544+0000 7ffa2bfff640 1 -- 172.21.15.150:0/2441028738 learned_addr learned my addr 172.21.15.150:0/2441028738 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:47:34.546 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:34.544+0000 7ffa2bfff640 1 -- 172.21.15.150:0/2441028738 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ffa2c0d0750 msgr2=0x7ffa2c1f8f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:47:34.546 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:34.544+0000 7ffa2bfff640 1 --2- 172.21.15.150:0/2441028738 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ffa2c0d0750 0x7ffa2c1f8f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:47:34.546 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:34.544+0000 7ffa2bfff640 1 -- 172.21.15.150:0/2441028738 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ffa2c0b1790 msgr2=0x7ffa2c0ce780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:47:34.546 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:34.544+0000 7ffa2bfff640 1 --2- 172.21.15.150:0/2441028738 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ffa2c0b1790 0x7ffa2c0ce780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:47:34.546 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:34.544+0000 7ffa2bfff640 1 -- 172.21.15.150:0/2441028738 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffa2c0cc8b0 con 0x7ffa2c155810 2024-09-17T05:47:34.546 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:34.545+0000 7ffa2bfff640 1 --2- 172.21.15.150:0/2441028738 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ffa2c155810 0x7ffa2c1f94a0 secure :-1 s=READY pgs=885 cs=0 l=1 rev1=1 crypto rx=0x7ffa2400b9a0 tx=0x7ffa2400be60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:47:34.547 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:34.545+0000 7ffa13fff640 1 -- 172.21.15.150:0/2441028738 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa24019070 con 0x7ffa2c155810 2024-09-17T05:47:34.547 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:34.545+0000 7ffa13fff640 1 -- 172.21.15.150:0/2441028738 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ffa2400ccb0 con 0x7ffa2c155810 2024-09-17T05:47:34.547 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:34.545+0000 7ffa3215e640 1 -- 172.21.15.150:0/2441028738 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffa2c1f9c30 con 0x7ffa2c155810 2024-09-17T05:47:34.547 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:34.545+0000 7ffa13fff640 1 -- 172.21.15.150:0/2441028738 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa240146a0 con 0x7ffa2c155810 2024-09-17T05:47:34.547 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:34.545+0000 7ffa3215e640 1 -- 172.21.15.150:0/2441028738 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffa2c15cd90 con 0x7ffa2c155810 2024-09-17T05:47:34.548 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:34.548+0000 7ffa13fff640 1 -- 172.21.15.150:0/2441028738 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 23) ==== 102920+0+0 (secure 0 0 0) 0x7ffa2401c070 con 0x7ffa2c155810 2024-09-17T05:47:34.549 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:34.548+0000 7ffa3215e640 1 -- 172.21.15.150:0/2441028738 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffa2c072600 con 0x7ffa2c155810 2024-09-17T05:47:34.549 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:34.549+0000 7ffa13fff640 1 --2- 172.21.15.150:0/2441028738 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7ffa18079c10 0x7ffa1807c120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:47:34.549 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:34.549+0000 7ffa13fff640 1 -- 172.21.15.150:0/2441028738 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 5765+0+0 (secure 0 0 0) 0x7ffa24099920 con 0x7ffa2c155810 2024-09-17T05:47:34.557 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:34.557+0000 7ffa13fff640 1 -- 172.21.15.150:0/2441028738 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7ffa24063580 con 0x7ffa2c155810 2024-09-17T05:47:34.571 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:34.571+0000 7ffa2b7fe640 1 --2- 172.21.15.150:0/2441028738 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7ffa18079c10 0x7ffa1807c120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:47:34.578 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:34.578+0000 7ffa2b7fe640 1 --2- 172.21.15.150:0/2441028738 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7ffa18079c10 0x7ffa1807c120 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7ffa1c001500 tx=0x7ffa1c007a30 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:47:34.878 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:34.878+0000 7ffa3215e640 1 -- 172.21.15.150:0/2441028738 --> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] -- mgr_command(tid 0: {"prefix": "fs clone cancel", "vol_name": "cephfs", "clone_name": "subvol_clone51670", "target": ["mon-mgr", ""]}) -- 0x7ffa2c0b0870 con 0x7ffa18079c10 2024-09-17T05:47:35.063 INFO:tasks.ceph.mgr.x.smithi176.stderr:2024-09-17T05:47:35.063+0000 7f33d771a640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-17T05:47:35.063 INFO:tasks.ceph.mgr.x.smithi176.stderr:2024-09-17T05:47:35.063+0000 7f33d771a640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-17T05:47:35.064 INFO:tasks.ceph.mgr.x.smithi176.stderr:2024-09-17T05:47:35.063+0000 7f33d771a640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-17T05:47:35.064 INFO:tasks.ceph.mgr.x.smithi176.stderr:2024-09-17T05:47:35.063+0000 7f33d771a640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-17T05:47:35.064 INFO:tasks.ceph.mgr.x.smithi176.stderr:2024-09-17T05:47:35.063+0000 7f33d771a640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-17T05:47:36.419 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:36.419+0000 7ffa13fff640 1 -- 172.21.15.150:0/2441028738 <== mgr.4108 v2:172.21.15.176:6800/3631216395 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7ffa2c0b0870 con 0x7ffa18079c10 2024-09-17T05:47:36.422 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:36.422+0000 7ffa3215e640 1 -- 172.21.15.150:0/2441028738 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7ffa18079c10 msgr2=0x7ffa1807c120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:47:36.423 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:36.422+0000 7ffa3215e640 1 --2- 172.21.15.150:0/2441028738 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7ffa18079c10 0x7ffa1807c120 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7ffa1c001500 tx=0x7ffa1c007a30 comp rx=0 tx=0).stop 2024-09-17T05:47:36.423 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:36.422+0000 7ffa3215e640 1 -- 172.21.15.150:0/2441028738 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ffa2c155810 msgr2=0x7ffa2c1f94a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:47:36.423 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:36.422+0000 7ffa3215e640 1 --2- 172.21.15.150:0/2441028738 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ffa2c155810 0x7ffa2c1f94a0 secure :-1 s=READY pgs=885 cs=0 l=1 rev1=1 crypto rx=0x7ffa2400b9a0 tx=0x7ffa2400be60 comp rx=0 tx=0).stop 2024-09-17T05:47:36.423 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:36.422+0000 7ffa3215e640 1 -- 172.21.15.150:0/2441028738 shutdown_connections 2024-09-17T05:47:36.423 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:36.422+0000 7ffa3215e640 1 --2- 172.21.15.150:0/2441028738 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7ffa18079c10 0x7ffa1807c120 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:47:36.423 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:36.422+0000 7ffa3215e640 1 --2- 172.21.15.150:0/2441028738 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ffa2c155810 0x7ffa2c1f94a0 unknown :-1 s=CLOSED pgs=885 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:47:36.423 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:36.422+0000 7ffa3215e640 1 --2- 172.21.15.150:0/2441028738 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ffa2c0d0750 0x7ffa2c1f8f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:47:36.423 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:36.422+0000 7ffa3215e640 1 --2- 172.21.15.150:0/2441028738 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ffa2c0b1790 0x7ffa2c0ce780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:47:36.423 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:36.422+0000 7ffa3215e640 1 -- 172.21.15.150:0/2441028738 >> 172.21.15.150:0/2441028738 conn(0x7ffa2c0d2520 msgr2=0x7ffa2c0af1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:47:36.423 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:36.422+0000 7ffa3215e640 1 -- 172.21.15.150:0/2441028738 shutdown_connections 2024-09-17T05:47:36.423 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:36.422+0000 7ffa3215e640 1 -- 172.21.15.150:0/2441028738 wait complete. 2024-09-17T05:47:36.438 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs clone cancel cephfs subvol_clone19001 2024-09-17T05:47:36.620 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:36.619+0000 7f08fd16e640 1 -- 172.21.15.150:0/1001681236 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f08f80b0c50 msgr2=0x7f08f80b1060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:47:36.620 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:36.619+0000 7f08fd16e640 1 --2- 172.21.15.150:0/1001681236 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f08f80b0c50 0x7f08f80b1060 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f08e0009860 tx=0x7f08e002a5a0 comp rx=0 tx=0).stop 2024-09-17T05:47:36.621 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:36.620+0000 7f08fd16e640 1 -- 172.21.15.150:0/1001681236 shutdown_connections 2024-09-17T05:47:36.621 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:36.620+0000 7f08fd16e640 1 --2- 172.21.15.150:0/1001681236 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f08f80b0c50 0x7f08f80b1060 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:47:36.621 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:36.620+0000 7f08fd16e640 1 -- 172.21.15.150:0/1001681236 >> 172.21.15.150:0/1001681236 conn(0x7f08f80b2e80 msgr2=0x7f08f80b3290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:47:36.623 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:36.622+0000 7f08fd16e640 1 -- 172.21.15.150:0/1001681236 shutdown_connections 2024-09-17T05:47:36.623 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:36.623+0000 7f08fd16e640 1 -- 172.21.15.150:0/1001681236 wait complete. 2024-09-17T05:47:36.628 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:36.627+0000 7f08fd16e640 1 Processor -- start 2024-09-17T05:47:36.629 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:36.628+0000 7f08fd16e640 1 -- start start 2024-09-17T05:47:36.631 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:36.630+0000 7f08fd16e640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f08f80ae160 0x7f08f81f0cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:47:36.631 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:36.630+0000 7f08fd16e640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f08f80b0c50 0x7f08f815cf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:47:36.631 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:36.630+0000 7f08fd16e640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f08f80b15a0 0x7f08f814d340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:47:36.631 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:36.630+0000 7f08fd16e640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f08f80b5e60 con 0x7f08f80b0c50 2024-09-17T05:47:36.631 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:36.630+0000 7f08fd16e640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f08f80b2230 con 0x7f08f80b15a0 2024-09-17T05:47:36.631 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:36.630+0000 7f08fd16e640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f08f80b5fe0 con 0x7f08f80ae160 2024-09-17T05:47:36.632 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:36.630+0000 7f08effff640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f08f80b0c50 0x7f08f815cf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:47:36.632 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:36.630+0000 7f08effff640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f08f80b0c50 0x7f08f815cf30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:50662/0 (socket says 172.21.15.150:50662) 2024-09-17T05:47:36.632 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:36.630+0000 7f08effff640 1 -- 172.21.15.150:0/3287512257 learned_addr learned my addr 172.21.15.150:0/3287512257 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:47:36.633 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:36.631+0000 7f08f6d9d640 1 --2- 172.21.15.150:0/3287512257 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f08f80ae160 0x7f08f81f0cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:47:36.633 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:36.631+0000 7f08f759e640 1 --2- 172.21.15.150:0/3287512257 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f08f80b15a0 0x7f08f814d340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:47:36.633 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:36.631+0000 7f08f6d9d640 1 -- 172.21.15.150:0/3287512257 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f08f80b15a0 msgr2=0x7f08f814d340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:47:36.633 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:36.631+0000 7f08f6d9d640 1 --2- 172.21.15.150:0/3287512257 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f08f80b15a0 0x7f08f814d340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:47:36.633 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:36.631+0000 7f08f6d9d640 1 -- 172.21.15.150:0/3287512257 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f08f80b0c50 msgr2=0x7f08f815cf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:47:36.633 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:36.631+0000 7f08f6d9d640 1 --2- 172.21.15.150:0/3287512257 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f08f80b0c50 0x7f08f815cf30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:47:36.633 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:36.631+0000 7f08f6d9d640 1 -- 172.21.15.150:0/3287512257 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f08f815dca0 con 0x7f08f80ae160 2024-09-17T05:47:36.634 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:36.632+0000 7f08f6d9d640 1 --2- 172.21.15.150:0/3287512257 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f08f80ae160 0x7f08f81f0cf0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f08e800c340 tx=0x7f08e800c800 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:47:36.634 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:36.632+0000 7f08ef7fe640 1 -- 172.21.15.150:0/3287512257 <== mon.2 v2:172.21.15.176:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f08e8017070 con 0x7f08f80ae160 2024-09-17T05:47:36.634 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:36.632+0000 7f08ef7fe640 1 -- 172.21.15.150:0/3287512257 <== mon.2 v2:172.21.15.176:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f08e80053c0 con 0x7f08f80ae160 2024-09-17T05:47:36.634 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:36.632+0000 7f08ef7fe640 1 -- 172.21.15.150:0/3287512257 <== mon.2 v2:172.21.15.176:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f08e8003850 con 0x7f08f80ae160 2024-09-17T05:47:36.634 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:36.633+0000 7f08fd16e640 1 -- 172.21.15.150:0/3287512257 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f08f815df80 con 0x7f08f80ae160 2024-09-17T05:47:36.634 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:36.633+0000 7f08fd16e640 1 -- 172.21.15.150:0/3287512257 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f08f815e540 con 0x7f08f80ae160 2024-09-17T05:47:36.636 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:36.635+0000 7f08fd16e640 1 -- 172.21.15.150:0/3287512257 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f08f80b1060 con 0x7f08f80ae160 2024-09-17T05:47:36.638 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:36.637+0000 7f08ef7fe640 1 -- 172.21.15.150:0/3287512257 <== mon.2 v2:172.21.15.176:3301/0 4 ==== mgrmap(e 23) ==== 102920+0+0 (secure 0 0 0) 0x7f08e801a070 con 0x7f08f80ae160 2024-09-17T05:47:36.639 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:36.638+0000 7f08ef7fe640 1 --2- 172.21.15.150:0/3287512257 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f08d8079c30 0x7f08d807c140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:47:36.639 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:36.639+0000 7f08ef7fe640 1 -- 172.21.15.150:0/3287512257 <== mon.2 v2:172.21.15.176:3301/0 5 ==== osd_map(72..72 src has 1..72) ==== 5765+0+0 (secure 0 0 0) 0x7f08e8098dc0 con 0x7f08f80ae160 2024-09-17T05:47:36.642 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:36.642+0000 7f08effff640 1 --2- 172.21.15.150:0/3287512257 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f08d8079c30 0x7f08d807c140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:47:36.645 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:36.645+0000 7f08effff640 1 --2- 172.21.15.150:0/3287512257 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f08d8079c30 0x7f08d807c140 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f08e0009860 tx=0x7f08e0004730 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:47:36.646 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:36.646+0000 7f08ef7fe640 1 -- 172.21.15.150:0/3287512257 <== mon.2 v2:172.21.15.176:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f08e80623b0 con 0x7f08f80ae160 2024-09-17T05:47:36.943 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:36.943+0000 7f08fd16e640 1 -- 172.21.15.150:0/3287512257 --> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] -- mgr_command(tid 0: {"prefix": "fs clone cancel", "vol_name": "cephfs", "clone_name": "subvol_clone19001", "target": ["mon-mgr", ""]}) -- 0x7f08f80cfc60 con 0x7f08d8079c30 2024-09-17T05:47:37.810 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:37.809+0000 7f08ef7fe640 1 -- 172.21.15.150:0/3287512257 <== mon.2 v2:172.21.15.176:3301/0 7 ==== mgrmap(e 24) ==== 102971+0+0 (secure 0 0 0) 0x7f08e805e620 con 0x7f08f80ae160 2024-09-17T05:47:37.951 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:37.951+0000 7f08ef7fe640 1 -- 172.21.15.150:0/3287512257 <== mgr.4108 v2:172.21.15.176:6800/3631216395 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f08f80cfc60 con 0x7f08d8079c30 2024-09-17T05:47:37.954 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:37.953+0000 7f08fd16e640 1 -- 172.21.15.150:0/3287512257 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f08d8079c30 msgr2=0x7f08d807c140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:47:37.954 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:37.953+0000 7f08fd16e640 1 --2- 172.21.15.150:0/3287512257 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f08d8079c30 0x7f08d807c140 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f08e0009860 tx=0x7f08e0004730 comp rx=0 tx=0).stop 2024-09-17T05:47:37.954 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:37.953+0000 7f08fd16e640 1 -- 172.21.15.150:0/3287512257 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f08f80ae160 msgr2=0x7f08f81f0cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:47:37.954 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:37.953+0000 7f08fd16e640 1 --2- 172.21.15.150:0/3287512257 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f08f80ae160 0x7f08f81f0cf0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f08e800c340 tx=0x7f08e800c800 comp rx=0 tx=0).stop 2024-09-17T05:47:37.955 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:37.953+0000 7f08fd16e640 1 -- 172.21.15.150:0/3287512257 shutdown_connections 2024-09-17T05:47:37.955 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:37.953+0000 7f08fd16e640 1 --2- 172.21.15.150:0/3287512257 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f08f80b15a0 0x7f08f814d340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:47:37.955 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:37.953+0000 7f08fd16e640 1 --2- 172.21.15.150:0/3287512257 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f08d8079c30 0x7f08d807c140 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:47:37.955 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:37.953+0000 7f08fd16e640 1 --2- 172.21.15.150:0/3287512257 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f08f80b0c50 0x7f08f815cf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:47:37.955 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:37.953+0000 7f08fd16e640 1 --2- 172.21.15.150:0/3287512257 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f08f80ae160 0x7f08f81f0cf0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:47:37.955 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:37.953+0000 7f08fd16e640 1 -- 172.21.15.150:0/3287512257 >> 172.21.15.150:0/3287512257 conn(0x7f08f80b2e80 msgr2=0x7f08f815b7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:47:37.955 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:37.953+0000 7f08fd16e640 1 -- 172.21.15.150:0/3287512257 shutdown_connections 2024-09-17T05:47:37.955 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:37.954+0000 7f08fd16e640 1 -- 172.21.15.150:0/3287512257 wait complete. 2024-09-17T05:47:37.967 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs clone cancel cephfs subvol_clone72832 2024-09-17T05:47:38.101 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:38.100+0000 7ff22149b640 1 -- 172.21.15.150:0/132640317 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff21c0af570 msgr2=0x7ff21c0d0980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:47:38.101 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:38.100+0000 7ff22149b640 1 --2- 172.21.15.150:0/132640317 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff21c0af570 0x7ff21c0d0980 secure :-1 s=READY pgs=887 cs=0 l=1 rev1=1 crypto rx=0x7ff21c0b1b20 tx=0x7ff20402a440 comp rx=0 tx=0).stop 2024-09-17T05:47:38.101 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:38.100+0000 7ff22149b640 1 -- 172.21.15.150:0/132640317 shutdown_connections 2024-09-17T05:47:38.101 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:38.100+0000 7ff22149b640 1 --2- 172.21.15.150:0/132640317 >> v2:172.21.15.176:3300/0 conn(0x7ff21c0d0ec0 0x7ff21c0cd040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:47:38.101 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:38.100+0000 7ff22149b640 1 --2- 172.21.15.150:0/132640317 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff21c0af570 0x7ff21c0d0980 unknown :-1 s=CLOSED pgs=887 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:47:38.101 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:38.100+0000 7ff22149b640 1 -- 172.21.15.150:0/132640317 >> 172.21.15.150:0/132640317 conn(0x7ff21c0cefb0 msgr2=0x7ff21c0cf3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:47:38.102 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:38.100+0000 7ff22149b640 1 -- 172.21.15.150:0/132640317 shutdown_connections 2024-09-17T05:47:38.102 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:38.100+0000 7ff22149b640 1 -- 172.21.15.150:0/132640317 wait complete. 2024-09-17T05:47:38.102 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:38.102+0000 7ff22149b640 1 Processor -- start 2024-09-17T05:47:38.102 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:38.102+0000 7ff22149b640 1 -- start start 2024-09-17T05:47:38.105 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:38.103+0000 7ff22149b640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff21c0af160 0x7ff21c15bed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:47:38.105 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:38.103+0000 7ff22149b640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff21c0af570 0x7ff21c1519a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:47:38.105 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:38.103+0000 7ff22149b640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff21c0d0ec0 0x7ff21c15f850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:47:38.105 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:38.103+0000 7ff22149b640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7ff21c0b1920 con 0x7ff21c0d0ec0 2024-09-17T05:47:38.105 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:38.103+0000 7ff22149b640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7ff21c0cede0 con 0x7ff21c0af570 2024-09-17T05:47:38.106 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:38.103+0000 7ff22149b640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7ff21c0d12d0 con 0x7ff21c0af160 2024-09-17T05:47:38.106 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:38.103+0000 7ff21b7fe640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff21c0d0ec0 0x7ff21c15f850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:47:38.106 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:38.103+0000 7ff21b7fe640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff21c0d0ec0 0x7ff21c15f850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:50690/0 (socket says 172.21.15.150:50690) 2024-09-17T05:47:38.106 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:38.103+0000 7ff21b7fe640 1 -- 172.21.15.150:0/1899152580 learned_addr learned my addr 172.21.15.150:0/1899152580 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:47:38.106 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:38.103+0000 7ff2127fc640 1 --2- 172.21.15.150:0/1899152580 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff21c0af570 0x7ff21c1519a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:47:38.106 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:38.103+0000 7ff21affd640 1 --2- 172.21.15.150:0/1899152580 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff21c0af160 0x7ff21c15bed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:47:38.106 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:38.104+0000 7ff21b7fe640 1 -- 172.21.15.150:0/1899152580 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff21c0af160 msgr2=0x7ff21c15bed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:47:38.106 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:38.104+0000 7ff21b7fe640 1 --2- 172.21.15.150:0/1899152580 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff21c0af160 0x7ff21c15bed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:47:38.106 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:38.104+0000 7ff21b7fe640 1 -- 172.21.15.150:0/1899152580 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff21c0af570 msgr2=0x7ff21c1519a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:47:38.106 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:38.104+0000 7ff21b7fe640 1 --2- 172.21.15.150:0/1899152580 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff21c0af570 0x7ff21c1519a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:47:38.106 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:38.104+0000 7ff21b7fe640 1 -- 172.21.15.150:0/1899152580 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff21c151ee0 con 0x7ff21c0d0ec0 2024-09-17T05:47:38.106 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:38.104+0000 7ff21b7fe640 1 --2- 172.21.15.150:0/1899152580 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff21c0d0ec0 0x7ff21c15f850 secure :-1 s=READY pgs=888 cs=0 l=1 rev1=1 crypto rx=0x7ff21400b9e0 tx=0x7ff21400bea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:47:38.107 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:38.104+0000 7ff213fff640 1 -- 172.21.15.150:0/1899152580 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff214019070 con 0x7ff21c0d0ec0 2024-09-17T05:47:38.107 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:38.104+0000 7ff213fff640 1 -- 172.21.15.150:0/1899152580 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff21400cc30 con 0x7ff21c0d0ec0 2024-09-17T05:47:38.107 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:38.104+0000 7ff22149b640 1 -- 172.21.15.150:0/1899152580 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff21c15a4b0 con 0x7ff21c0d0ec0 2024-09-17T05:47:38.107 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:38.104+0000 7ff213fff640 1 -- 172.21.15.150:0/1899152580 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2140146a0 con 0x7ff21c0d0ec0 2024-09-17T05:47:38.107 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:38.104+0000 7ff22149b640 1 -- 172.21.15.150:0/1899152580 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff21c15aa70 con 0x7ff21c0d0ec0 2024-09-17T05:47:38.108 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:38.105+0000 7ff22149b640 1 -- 172.21.15.150:0/1899152580 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff21c0d0980 con 0x7ff21c0d0ec0 2024-09-17T05:47:38.108 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:38.106+0000 7ff213fff640 1 -- 172.21.15.150:0/1899152580 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 24) ==== 102971+0+0 (secure 0 0 0) 0x7ff21401c070 con 0x7ff21c0d0ec0 2024-09-17T05:47:38.108 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:38.106+0000 7ff213fff640 1 --2- 172.21.15.150:0/1899152580 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7ff1fc079ca0 0x7ff1fc07c1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:47:38.108 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:38.106+0000 7ff213fff640 1 -- 172.21.15.150:0/1899152580 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 5881+0+0 (secure 0 0 0) 0x7ff2140997a0 con 0x7ff21c0d0ec0 2024-09-17T05:47:38.108 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:38.107+0000 7ff21affd640 1 --2- 172.21.15.150:0/1899152580 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7ff1fc079ca0 0x7ff1fc07c1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:47:38.108 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:38.107+0000 7ff21affd640 1 --2- 172.21.15.150:0/1899152580 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7ff1fc079ca0 0x7ff1fc07c1b0 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7ff20c006fd0 tx=0x7ff20c009060 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:47:38.111 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:38.111+0000 7ff213fff640 1 -- 172.21.15.150:0/1899152580 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7ff21400ce20 con 0x7ff21c0d0ec0 2024-09-17T05:47:38.327 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:38.326+0000 7ff22149b640 1 -- 172.21.15.150:0/1899152580 --> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] -- mgr_command(tid 0: {"prefix": "fs clone cancel", "vol_name": "cephfs", "clone_name": "subvol_clone72832", "target": ["mon-mgr", ""]}) -- 0x7ff21c0ce760 con 0x7ff1fc079ca0 2024-09-17T05:47:39.404 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:39.403+0000 7ff213fff640 1 -- 172.21.15.150:0/1899152580 <== mgr.4108 v2:172.21.15.176:6800/3631216395 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7ff21c0ce760 con 0x7ff1fc079ca0 2024-09-17T05:47:39.407 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:39.406+0000 7ff22149b640 1 -- 172.21.15.150:0/1899152580 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7ff1fc079ca0 msgr2=0x7ff1fc07c1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:47:39.408 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:39.406+0000 7ff22149b640 1 --2- 172.21.15.150:0/1899152580 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7ff1fc079ca0 0x7ff1fc07c1b0 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7ff20c006fd0 tx=0x7ff20c009060 comp rx=0 tx=0).stop 2024-09-17T05:47:39.408 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:39.406+0000 7ff22149b640 1 -- 172.21.15.150:0/1899152580 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff21c0d0ec0 msgr2=0x7ff21c15f850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:47:39.408 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:39.406+0000 7ff22149b640 1 --2- 172.21.15.150:0/1899152580 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff21c0d0ec0 0x7ff21c15f850 secure :-1 s=READY pgs=888 cs=0 l=1 rev1=1 crypto rx=0x7ff21400b9e0 tx=0x7ff21400bea0 comp rx=0 tx=0).stop 2024-09-17T05:47:39.408 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:39.407+0000 7ff22149b640 1 -- 172.21.15.150:0/1899152580 shutdown_connections 2024-09-17T05:47:39.408 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:39.407+0000 7ff22149b640 1 --2- 172.21.15.150:0/1899152580 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff21c0af570 0x7ff21c1519a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:47:39.408 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:39.407+0000 7ff22149b640 1 --2- 172.21.15.150:0/1899152580 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7ff1fc079ca0 0x7ff1fc07c1b0 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:47:39.408 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:39.407+0000 7ff22149b640 1 --2- 172.21.15.150:0/1899152580 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff21c0d0ec0 0x7ff21c15f850 unknown :-1 s=CLOSED pgs=888 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:47:39.408 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:39.407+0000 7ff22149b640 1 --2- 172.21.15.150:0/1899152580 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff21c0af160 0x7ff21c15bed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:47:39.408 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:39.407+0000 7ff22149b640 1 -- 172.21.15.150:0/1899152580 >> 172.21.15.150:0/1899152580 conn(0x7ff21c0cefb0 msgr2=0x7ff21c0b6e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:47:39.408 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:39.407+0000 7ff22149b640 1 -- 172.21.15.150:0/1899152580 shutdown_connections 2024-09-17T05:47:39.408 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:39.407+0000 7ff22149b640 1 -- 172.21.15.150:0/1899152580 wait complete. 2024-09-17T05:47:39.426 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs clone cancel cephfs subvol_clone94333 2024-09-17T05:47:39.612 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:39.611+0000 7fafdadda640 1 -- 172.21.15.150:0/4019425246 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fafd40cd380 msgr2=0x7fafd415ceb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:47:39.613 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:39.611+0000 7fafdadda640 1 --2- 172.21.15.150:0/4019425246 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fafd40cd380 0x7fafd415ceb0 secure :-1 s=READY pgs=889 cs=0 l=1 rev1=1 crypto rx=0x7fafd4074690 tx=0x7fafc002a4f0 comp rx=0 tx=0).stop 2024-09-17T05:47:39.613 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:39.611+0000 7fafdadda640 1 -- 172.21.15.150:0/4019425246 shutdown_connections 2024-09-17T05:47:39.613 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:39.611+0000 7fafdadda640 1 --2- 172.21.15.150:0/4019425246 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fafd40cd380 0x7fafd415ceb0 unknown :-1 s=CLOSED pgs=889 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:47:39.613 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:39.611+0000 7fafdadda640 1 --2- 172.21.15.150:0/4019425246 >> v2:172.21.15.176:3300/0 conn(0x7fafd415c820 0x7fafd40d0530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:47:39.613 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:39.611+0000 7fafdadda640 1 -- 172.21.15.150:0/4019425246 >> 172.21.15.150:0/4019425246 conn(0x7fafd4073890 msgr2=0x7fafd4073ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:47:39.613 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:39.611+0000 7fafdadda640 1 -- 172.21.15.150:0/4019425246 shutdown_connections 2024-09-17T05:47:39.613 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:39.611+0000 7fafdadda640 1 -- 172.21.15.150:0/4019425246 wait complete. 2024-09-17T05:47:39.615 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:39.615+0000 7fafdadda640 1 Processor -- start 2024-09-17T05:47:39.615 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:39.615+0000 7fafdadda640 1 -- start start 2024-09-17T05:47:39.618 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:39.617+0000 7fafdadda640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fafd40cd380 0x7fafd415aec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:47:39.618 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:39.617+0000 7fafdadda640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fafd415c820 0x7fafd4157f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:47:39.618 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:39.617+0000 7fafdadda640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fafd415d3f0 0x7fafd4142570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:47:39.618 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:39.617+0000 7fafdadda640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7fafd40cf8e0 con 0x7fafd415d3f0 2024-09-17T05:47:39.619 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:39.617+0000 7fafdadda640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fafd40cf760 con 0x7fafd415c820 2024-09-17T05:47:39.619 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:39.617+0000 7fafdadda640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fafd40cfa60 con 0x7fafd40cd380 2024-09-17T05:47:39.620 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:39.618+0000 7fafd9377640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fafd415d3f0 0x7fafd4142570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:47:39.620 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:39.618+0000 7fafd9377640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fafd415d3f0 0x7fafd4142570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:50716/0 (socket says 172.21.15.150:50716) 2024-09-17T05:47:39.620 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:39.618+0000 7fafd9377640 1 -- 172.21.15.150:0/354506020 learned_addr learned my addr 172.21.15.150:0/354506020 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:47:39.620 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:39.618+0000 7fafd9377640 1 -- 172.21.15.150:0/354506020 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fafd40cd380 msgr2=0x7fafd415aec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:47:39.620 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:39.618+0000 7fafd9377640 1 --2- 172.21.15.150:0/354506020 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fafd40cd380 0x7fafd415aec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:47:39.620 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:39.618+0000 7fafd9377640 1 -- 172.21.15.150:0/354506020 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fafd415c820 msgr2=0x7fafd4157f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:47:39.620 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:39.618+0000 7fafd9377640 1 --2- 172.21.15.150:0/354506020 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fafd415c820 0x7fafd4157f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:47:39.620 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:39.618+0000 7fafd9377640 1 -- 172.21.15.150:0/354506020 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fafd41e3e50 con 0x7fafd415d3f0 2024-09-17T05:47:39.620 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:39.618+0000 7fafd9377640 1 --2- 172.21.15.150:0/354506020 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fafd415d3f0 0x7fafd4142570 secure :-1 s=READY pgs=890 cs=0 l=1 rev1=1 crypto rx=0x7fafcc00b9e0 tx=0x7fafcc00bea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:47:39.621 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:39.618+0000 7fafd17fa640 1 -- 172.21.15.150:0/354506020 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fafcc019070 con 0x7fafd415d3f0 2024-09-17T05:47:39.621 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:39.619+0000 7fafd17fa640 1 -- 172.21.15.150:0/354506020 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fafcc00cc10 con 0x7fafd415d3f0 2024-09-17T05:47:39.621 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:39.619+0000 7fafdadda640 1 -- 172.21.15.150:0/354506020 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fafd41e4130 con 0x7fafd415d3f0 2024-09-17T05:47:39.621 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:39.619+0000 7fafd17fa640 1 -- 172.21.15.150:0/354506020 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fafcc014440 con 0x7fafd415d3f0 2024-09-17T05:47:39.621 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:39.619+0000 7fafdadda640 1 -- 172.21.15.150:0/354506020 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fafd41e46f0 con 0x7fafd415d3f0 2024-09-17T05:47:39.621 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:39.620+0000 7fafdadda640 1 -- 172.21.15.150:0/354506020 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fafd40d0000 con 0x7fafd415d3f0 2024-09-17T05:47:39.622 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:39.621+0000 7fafd17fa640 1 -- 172.21.15.150:0/354506020 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 24) ==== 102971+0+0 (secure 0 0 0) 0x7fafcc01c070 con 0x7fafd415d3f0 2024-09-17T05:47:39.623 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:39.623+0000 7fafd17fa640 1 --2- 172.21.15.150:0/354506020 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fafb8079c70 0x7fafb807c180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:47:39.624 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:39.623+0000 7fafd17fa640 1 -- 172.21.15.150:0/354506020 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 5881+0+0 (secure 0 0 0) 0x7fafcc0995e0 con 0x7fafd415d3f0 2024-09-17T05:47:39.629 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:39.629+0000 7fafd17fa640 1 -- 172.21.15.150:0/354506020 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fafcc0634d0 con 0x7fafd415d3f0 2024-09-17T05:47:39.631 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:39.631+0000 7fafd8b76640 1 --2- 172.21.15.150:0/354506020 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fafb8079c70 0x7fafb807c180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:47:39.657 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:39.656+0000 7fafd8b76640 1 --2- 172.21.15.150:0/354506020 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fafb8079c70 0x7fafb807c180 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7fafc8009650 tx=0x7fafc8006ba0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:47:39.980 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:39.979+0000 7fafdadda640 1 -- 172.21.15.150:0/354506020 --> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] -- mgr_command(tid 0: {"prefix": "fs clone cancel", "vol_name": "cephfs", "clone_name": "subvol_clone94333", "target": ["mon-mgr", ""]}) -- 0x7fafd40d0740 con 0x7fafb8079c70 2024-09-17T05:47:42.277 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:42.276+0000 7fafd17fa640 1 -- 172.21.15.150:0/354506020 <== mgr.4108 v2:172.21.15.176:6800/3631216395 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7fafd40d0740 con 0x7fafb8079c70 2024-09-17T05:47:42.280 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:42.279+0000 7fafdadda640 1 -- 172.21.15.150:0/354506020 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fafb8079c70 msgr2=0x7fafb807c180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:47:42.280 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:42.279+0000 7fafdadda640 1 --2- 172.21.15.150:0/354506020 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fafb8079c70 0x7fafb807c180 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7fafc8009650 tx=0x7fafc8006ba0 comp rx=0 tx=0).stop 2024-09-17T05:47:42.280 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:42.279+0000 7fafdadda640 1 -- 172.21.15.150:0/354506020 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fafd415d3f0 msgr2=0x7fafd4142570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:47:42.280 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:42.279+0000 7fafdadda640 1 --2- 172.21.15.150:0/354506020 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fafd415d3f0 0x7fafd4142570 secure :-1 s=READY pgs=890 cs=0 l=1 rev1=1 crypto rx=0x7fafcc00b9e0 tx=0x7fafcc00bea0 comp rx=0 tx=0).stop 2024-09-17T05:47:42.280 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:42.279+0000 7fafdadda640 1 -- 172.21.15.150:0/354506020 shutdown_connections 2024-09-17T05:47:42.280 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:42.279+0000 7fafdadda640 1 --2- 172.21.15.150:0/354506020 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fafd415c820 0x7fafd4157f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:47:42.280 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:42.279+0000 7fafdadda640 1 --2- 172.21.15.150:0/354506020 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fafb8079c70 0x7fafb807c180 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:47:42.280 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:42.279+0000 7fafdadda640 1 --2- 172.21.15.150:0/354506020 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fafd415d3f0 0x7fafd4142570 unknown :-1 s=CLOSED pgs=890 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:47:42.280 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:42.279+0000 7fafdadda640 1 --2- 172.21.15.150:0/354506020 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fafd40cd380 0x7fafd415aec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:47:42.280 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:42.279+0000 7fafdadda640 1 -- 172.21.15.150:0/354506020 >> 172.21.15.150:0/354506020 conn(0x7fafd4073890 msgr2=0x7fafd4154370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:47:42.281 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:42.279+0000 7fafdadda640 1 -- 172.21.15.150:0/354506020 shutdown_connections 2024-09-17T05:47:42.281 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:42.279+0000 7fafdadda640 1 -- 172.21.15.150:0/354506020 wait complete. 2024-09-17T05:47:42.297 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs clone cancel cephfs subvol_clone62874 2024-09-17T05:47:42.486 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:42.484+0000 7f4bc3294640 1 -- 172.21.15.150:0/2073709280 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4bbc0b9f20 msgr2=0x7f4bbc0cf850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:47:42.486 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:42.484+0000 7f4bc3294640 1 --2- 172.21.15.150:0/2073709280 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4bbc0b9f20 0x7f4bbc0cf850 secure :-1 s=READY pgs=892 cs=0 l=1 rev1=1 crypto rx=0x7f4bbc0ba770 tx=0x7f4bb402a420 comp rx=0 tx=0).stop 2024-09-17T05:47:42.486 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:42.485+0000 7f4bc3294640 1 -- 172.21.15.150:0/2073709280 shutdown_connections 2024-09-17T05:47:42.486 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:42.485+0000 7f4bc3294640 1 --2- 172.21.15.150:0/2073709280 >> v2:172.21.15.176:3300/0 conn(0x7f4bbc0b23d0 0x7f4bbc0cf310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:47:42.486 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:42.485+0000 7f4bc3294640 1 --2- 172.21.15.150:0/2073709280 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4bbc0b9f20 0x7f4bbc0cf850 unknown :-1 s=CLOSED pgs=892 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:47:42.486 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:42.485+0000 7f4bc3294640 1 -- 172.21.15.150:0/2073709280 >> 172.21.15.150:0/2073709280 conn(0x7f4bbc0d46e0 msgr2=0x7f4bbc0d4af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:47:42.486 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:42.485+0000 7f4bc3294640 1 -- 172.21.15.150:0/2073709280 shutdown_connections 2024-09-17T05:47:42.486 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:42.485+0000 7f4bc3294640 1 -- 172.21.15.150:0/2073709280 wait complete. 2024-09-17T05:47:42.491 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:42.490+0000 7f4bc3294640 1 Processor -- start 2024-09-17T05:47:42.491 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:42.491+0000 7f4bc3294640 1 -- start start 2024-09-17T05:47:42.495 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:42.493+0000 7f4bc3294640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4bbc0b23d0 0x7f4bbc158b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:47:42.495 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:42.494+0000 7f4bc3294640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4bbc0b3510 0x7f4bbc1f6040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:47:42.495 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:42.494+0000 7f4bc3294640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4bbc0b9f20 0x7f4bbc15caf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:47:42.495 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:42.494+0000 7f4bc3294640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f4bbc0cff10 con 0x7f4bbc0b3510 2024-09-17T05:47:42.495 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:42.494+0000 7f4bc3294640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f4bbc0cfd90 con 0x7f4bbc0b9f20 2024-09-17T05:47:42.495 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:42.494+0000 7f4bc082f640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4bbc0b3510 0x7f4bbc1f6040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:47:42.495 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:42.494+0000 7f4bc082f640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4bbc0b3510 0x7f4bbc1f6040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:60612/0 (socket says 172.21.15.150:60612) 2024-09-17T05:47:42.495 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:42.494+0000 7f4bc082f640 1 -- 172.21.15.150:0/733519920 learned_addr learned my addr 172.21.15.150:0/733519920 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:47:42.495 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:42.494+0000 7f4bc3294640 1 -- 172.21.15.150:0/733519920 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f4bbc0d0090 con 0x7f4bbc0b23d0 2024-09-17T05:47:42.497 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:42.495+0000 7f4bc082f640 1 -- 172.21.15.150:0/733519920 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4bbc0b23d0 msgr2=0x7f4bbc158b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:47:42.497 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:42.495+0000 7f4bc082f640 1 --2- 172.21.15.150:0/733519920 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4bbc0b23d0 0x7f4bbc158b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:47:42.497 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:42.495+0000 7f4bc1831640 1 --2- 172.21.15.150:0/733519920 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4bbc0b9f20 0x7f4bbc15caf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:47:42.497 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:42.495+0000 7f4bc082f640 1 -- 172.21.15.150:0/733519920 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4bbc0b9f20 msgr2=0x7f4bbc15caf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:47:42.497 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:42.495+0000 7f4bc082f640 1 --2- 172.21.15.150:0/733519920 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4bbc0b9f20 0x7f4bbc15caf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:47:42.497 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:42.495+0000 7f4bc082f640 1 -- 172.21.15.150:0/733519920 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4bbc1f6ad0 con 0x7f4bbc0b3510 2024-09-17T05:47:42.497 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:42.495+0000 7f4bc1831640 1 --2- 172.21.15.150:0/733519920 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4bbc0b9f20 0x7f4bbc15caf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T05:47:42.497 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:42.495+0000 7f4bc082f640 1 --2- 172.21.15.150:0/733519920 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4bbc0b3510 0x7f4bbc1f6040 secure :-1 s=READY pgs=893 cs=0 l=1 rev1=1 crypto rx=0x7f4bb000b3f0 tx=0x7f4bb000b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:47:42.497 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:42.495+0000 7f4bb9ffb640 1 -- 172.21.15.150:0/733519920 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4bb0015030 con 0x7f4bbc0b3510 2024-09-17T05:47:42.498 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:42.495+0000 7f4bb9ffb640 1 -- 172.21.15.150:0/733519920 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f4bb0005920 con 0x7f4bbc0b3510 2024-09-17T05:47:42.498 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:42.495+0000 7f4bc3294640 1 -- 172.21.15.150:0/733519920 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4bbc1f6db0 con 0x7f4bbc0b3510 2024-09-17T05:47:42.498 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:42.495+0000 7f4bb9ffb640 1 -- 172.21.15.150:0/733519920 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4bb0005d90 con 0x7f4bbc0b3510 2024-09-17T05:47:42.498 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:42.496+0000 7f4bc3294640 1 -- 172.21.15.150:0/733519920 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4bbc1f6580 con 0x7f4bbc0b3510 2024-09-17T05:47:42.500 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:42.499+0000 7f4bb9ffb640 1 -- 172.21.15.150:0/733519920 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 24) ==== 102971+0+0 (secure 0 0 0) 0x7f4bb0018070 con 0x7f4bbc0b3510 2024-09-17T05:47:42.500 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:42.499+0000 7f4bc3294640 1 -- 172.21.15.150:0/733519920 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4bbc0d05b0 con 0x7f4bbc0b3510 2024-09-17T05:47:42.501 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:42.501+0000 7f4bb9ffb640 1 --2- 172.21.15.150:0/733519920 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f4ba8079c70 0x7f4ba807c180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:47:42.502 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:42.501+0000 7f4bb9ffb640 1 -- 172.21.15.150:0/733519920 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 5881+0+0 (secure 0 0 0) 0x7f4bb00996c0 con 0x7f4bbc0b3510 2024-09-17T05:47:42.505 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:42.504+0000 7f4bc1030640 1 --2- 172.21.15.150:0/733519920 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f4ba8079c70 0x7f4ba807c180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:47:42.508 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:42.508+0000 7f4bc1030640 1 --2- 172.21.15.150:0/733519920 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f4ba8079c70 0x7f4ba807c180 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f4bac001c10 tx=0x7f4bac007cb0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:47:42.509 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:42.508+0000 7f4bb9ffb640 1 -- 172.21.15.150:0/733519920 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f4bb0063300 con 0x7f4bbc0b3510 2024-09-17T05:47:42.842 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:42.841+0000 7f4bc3294640 1 -- 172.21.15.150:0/733519920 --> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] -- mgr_command(tid 0: {"prefix": "fs clone cancel", "vol_name": "cephfs", "clone_name": "subvol_clone62874", "target": ["mon-mgr", ""]}) -- 0x7f4bbc1f6860 con 0x7f4ba8079c70 2024-09-17T05:47:43.710 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:43.709+0000 7f4bb9ffb640 1 -- 172.21.15.150:0/733519920 <== mgr.4108 v2:172.21.15.176:6800/3631216395 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f4bbc1f6860 con 0x7f4ba8079c70 2024-09-17T05:47:43.717 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:43.716+0000 7f4bc3294640 1 -- 172.21.15.150:0/733519920 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f4ba8079c70 msgr2=0x7f4ba807c180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:47:43.717 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:43.716+0000 7f4bc3294640 1 --2- 172.21.15.150:0/733519920 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f4ba8079c70 0x7f4ba807c180 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f4bac001c10 tx=0x7f4bac007cb0 comp rx=0 tx=0).stop 2024-09-17T05:47:43.717 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:43.716+0000 7f4bc3294640 1 -- 172.21.15.150:0/733519920 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4bbc0b3510 msgr2=0x7f4bbc1f6040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:47:43.717 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:43.716+0000 7f4bc3294640 1 --2- 172.21.15.150:0/733519920 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4bbc0b3510 0x7f4bbc1f6040 secure :-1 s=READY pgs=893 cs=0 l=1 rev1=1 crypto rx=0x7f4bb000b3f0 tx=0x7f4bb000b8b0 comp rx=0 tx=0).stop 2024-09-17T05:47:43.717 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:43.716+0000 7f4bc3294640 1 -- 172.21.15.150:0/733519920 shutdown_connections 2024-09-17T05:47:43.718 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:43.716+0000 7f4bc3294640 1 --2- 172.21.15.150:0/733519920 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4bbc0b9f20 0x7f4bbc15caf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:47:43.718 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:43.716+0000 7f4bc3294640 1 --2- 172.21.15.150:0/733519920 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f4ba8079c70 0x7f4ba807c180 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:47:43.718 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:43.716+0000 7f4bc3294640 1 --2- 172.21.15.150:0/733519920 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4bbc0b3510 0x7f4bbc1f6040 unknown :-1 s=CLOSED pgs=893 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:47:43.718 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:43.716+0000 7f4bc3294640 1 --2- 172.21.15.150:0/733519920 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4bbc0b23d0 0x7f4bbc158b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:47:43.718 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:43.716+0000 7f4bc3294640 1 -- 172.21.15.150:0/733519920 >> 172.21.15.150:0/733519920 conn(0x7f4bbc0d46e0 msgr2=0x7f4bbc068e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:47:43.718 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:43.716+0000 7f4bc3294640 1 -- 172.21.15.150:0/733519920 shutdown_connections 2024-09-17T05:47:43.718 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:43.716+0000 7f4bc3294640 1 -- 172.21.15.150:0/733519920 wait complete. 2024-09-17T05:47:43.733 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs clone cancel cephfs subvol_clone43985 2024-09-17T05:47:43.907 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:43.906+0000 7f774da9b640 1 -- 172.21.15.150:0/1393959197 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f774806e4c0 msgr2=0x7f77480cf330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:47:43.908 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:43.906+0000 7f774da9b640 1 --2- 172.21.15.150:0/1393959197 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f774806e4c0 0x7f77480cf330 secure :-1 s=READY pgs=894 cs=0 l=1 rev1=1 crypto rx=0x7f7748073360 tx=0x7f774002aa30 comp rx=0 tx=0).stop 2024-09-17T05:47:43.908 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:43.906+0000 7f774da9b640 1 -- 172.21.15.150:0/1393959197 shutdown_connections 2024-09-17T05:47:43.908 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:43.906+0000 7f774da9b640 1 --2- 172.21.15.150:0/1393959197 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f774806e4c0 0x7f77480cf330 unknown :-1 s=CLOSED pgs=894 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:47:43.908 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:43.906+0000 7f774da9b640 1 --2- 172.21.15.150:0/1393959197 >> v2:172.21.15.176:3300/0 conn(0x7f774815ce20 0x7f7748152800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:47:43.908 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:43.906+0000 7f774da9b640 1 -- 172.21.15.150:0/1393959197 >> 172.21.15.150:0/1393959197 conn(0x7f7748073890 msgr2=0x7f7748073ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:47:43.908 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:43.906+0000 7f774da9b640 1 -- 172.21.15.150:0/1393959197 shutdown_connections 2024-09-17T05:47:43.908 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:43.906+0000 7f774da9b640 1 -- 172.21.15.150:0/1393959197 wait complete. 2024-09-17T05:47:43.909 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:43.908+0000 7f774da9b640 1 Processor -- start 2024-09-17T05:47:43.909 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:43.909+0000 7f774da9b640 1 -- start start 2024-09-17T05:47:43.912 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:43.910+0000 7f774da9b640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7748071230 0x7f77481e6bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:47:43.912 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:43.910+0000 7f774da9b640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f774815ce20 0x7f77480afa30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:47:43.912 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:43.910+0000 7f774da9b640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f77480b1940 0x7f774815a770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:47:43.912 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:43.910+0000 7f774da9b640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f77480cf9f0 con 0x7f7748071230 2024-09-17T05:47:43.912 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:43.910+0000 7f774da9b640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f77480cf870 con 0x7f774815ce20 2024-09-17T05:47:43.912 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:43.910+0000 7f774da9b640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f77480cfb70 con 0x7f77480b1940 2024-09-17T05:47:43.912 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:43.910+0000 7f77477fe640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7748071230 0x7f77481e6bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:47:43.912 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:43.910+0000 7f77477fe640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7748071230 0x7f77481e6bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:60632/0 (socket says 172.21.15.150:60632) 2024-09-17T05:47:43.912 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:43.910+0000 7f77477fe640 1 -- 172.21.15.150:0/1427441308 learned_addr learned my addr 172.21.15.150:0/1427441308 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:47:43.912 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:43.911+0000 7f7746ffd640 1 --2- 172.21.15.150:0/1427441308 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f774815ce20 0x7f77480afa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:47:43.913 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:43.911+0000 7f7747fff640 1 --2- 172.21.15.150:0/1427441308 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f77480b1940 0x7f774815a770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:47:43.913 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:43.911+0000 7f77477fe640 1 -- 172.21.15.150:0/1427441308 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f77480b1940 msgr2=0x7f774815a770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:47:43.913 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:43.911+0000 7f77477fe640 1 --2- 172.21.15.150:0/1427441308 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f77480b1940 0x7f774815a770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:47:43.913 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:43.911+0000 7f77477fe640 1 -- 172.21.15.150:0/1427441308 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f774815ce20 msgr2=0x7f77480afa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:47:43.913 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:43.911+0000 7f77477fe640 1 --2- 172.21.15.150:0/1427441308 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f774815ce20 0x7f77480afa30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:47:43.913 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:43.911+0000 7f77477fe640 1 -- 172.21.15.150:0/1427441308 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f77480aff70 con 0x7f7748071230 2024-09-17T05:47:43.913 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:43.911+0000 7f77477fe640 1 --2- 172.21.15.150:0/1427441308 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7748071230 0x7f77481e6bc0 secure :-1 s=READY pgs=895 cs=0 l=1 rev1=1 crypto rx=0x7f773800b410 tx=0x7f773800b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:47:43.914 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:43.911+0000 7f772ffff640 1 -- 172.21.15.150:0/1427441308 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7738015020 con 0x7f7748071230 2024-09-17T05:47:43.914 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:43.911+0000 7f774da9b640 1 -- 172.21.15.150:0/1427441308 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f77481f5ca0 con 0x7f7748071230 2024-09-17T05:47:43.914 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:43.911+0000 7f772ffff640 1 -- 172.21.15.150:0/1427441308 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f7738011940 con 0x7f7748071230 2024-09-17T05:47:43.914 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:43.911+0000 7f772ffff640 1 -- 172.21.15.150:0/1427441308 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7738011d90 con 0x7f7748071230 2024-09-17T05:47:43.914 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:43.912+0000 7f774da9b640 1 -- 172.21.15.150:0/1427441308 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f77481f6260 con 0x7f7748071230 2024-09-17T05:47:43.914 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:43.913+0000 7f774da9b640 1 -- 172.21.15.150:0/1427441308 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f77480cf330 con 0x7f7748071230 2024-09-17T05:47:43.915 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:43.914+0000 7f772ffff640 1 -- 172.21.15.150:0/1427441308 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 24) ==== 102971+0+0 (secure 0 0 0) 0x7f7738018020 con 0x7f7748071230 2024-09-17T05:47:43.916 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:43.915+0000 7f772ffff640 1 --2- 172.21.15.150:0/1427441308 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f7734079c70 0x7f773407c180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:47:43.916 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:43.915+0000 7f772ffff640 1 -- 172.21.15.150:0/1427441308 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 5881+0+0 (secure 0 0 0) 0x7f7738099800 con 0x7f7748071230 2024-09-17T05:47:43.920 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:43.920+0000 7f772ffff640 1 -- 172.21.15.150:0/1427441308 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f773801f020 con 0x7f7748071230 2024-09-17T05:47:43.921 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:43.921+0000 7f7746ffd640 1 --2- 172.21.15.150:0/1427441308 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f7734079c70 0x7f773407c180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:47:43.929 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:43.928+0000 7f7746ffd640 1 --2- 172.21.15.150:0/1427441308 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f7734079c70 0x7f773407c180 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f773c006fd0 tx=0x7f773c008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:47:44.249 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:44.248+0000 7f774da9b640 1 -- 172.21.15.150:0/1427441308 --> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] -- mgr_command(tid 0: {"prefix": "fs clone cancel", "vol_name": "cephfs", "clone_name": "subvol_clone43985", "target": ["mon-mgr", ""]}) -- 0x7f774815b6e0 con 0x7f7734079c70 2024-09-17T05:47:44.740 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:44.739+0000 7f772ffff640 1 -- 172.21.15.150:0/1427441308 <== mgr.4108 v2:172.21.15.176:6800/3631216395 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f774815b6e0 con 0x7f7734079c70 2024-09-17T05:47:44.744 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:44.743+0000 7f774da9b640 1 -- 172.21.15.150:0/1427441308 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f7734079c70 msgr2=0x7f773407c180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:47:44.744 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:44.743+0000 7f774da9b640 1 --2- 172.21.15.150:0/1427441308 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f7734079c70 0x7f773407c180 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f773c006fd0 tx=0x7f773c008040 comp rx=0 tx=0).stop 2024-09-17T05:47:44.744 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:44.743+0000 7f774da9b640 1 -- 172.21.15.150:0/1427441308 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7748071230 msgr2=0x7f77481e6bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:47:44.744 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:44.743+0000 7f774da9b640 1 --2- 172.21.15.150:0/1427441308 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7748071230 0x7f77481e6bc0 secure :-1 s=READY pgs=895 cs=0 l=1 rev1=1 crypto rx=0x7f773800b410 tx=0x7f773800b8d0 comp rx=0 tx=0).stop 2024-09-17T05:47:44.744 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:44.743+0000 7f774da9b640 1 -- 172.21.15.150:0/1427441308 shutdown_connections 2024-09-17T05:47:44.744 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:44.743+0000 7f774da9b640 1 --2- 172.21.15.150:0/1427441308 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f774815ce20 0x7f77480afa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:47:44.744 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:44.743+0000 7f774da9b640 1 --2- 172.21.15.150:0/1427441308 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f7734079c70 0x7f773407c180 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:47:44.744 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:44.743+0000 7f774da9b640 1 --2- 172.21.15.150:0/1427441308 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f77480b1940 0x7f774815a770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:47:44.744 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:44.743+0000 7f774da9b640 1 --2- 172.21.15.150:0/1427441308 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7748071230 0x7f77481e6bc0 unknown :-1 s=CLOSED pgs=895 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:47:44.744 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:44.743+0000 7f774da9b640 1 -- 172.21.15.150:0/1427441308 >> 172.21.15.150:0/1427441308 conn(0x7f7748073890 msgr2=0x7f774815fac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:47:44.744 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:44.743+0000 7f774da9b640 1 -- 172.21.15.150:0/1427441308 shutdown_connections 2024-09-17T05:47:44.745 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:44.743+0000 7f774da9b640 1 -- 172.21.15.150:0/1427441308 wait complete. 2024-09-17T05:47:44.758 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs clone cancel cephfs subvol_clone37686 2024-09-17T05:47:44.925 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:44.924+0000 7f212796e640 1 -- 172.21.15.150:0/4067104135 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f212006f940 msgr2=0x7f212006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:47:44.925 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:44.924+0000 7f212796e640 1 --2- 172.21.15.150:0/4067104135 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f212006f940 0x7f212006e2f0 secure :-1 s=READY pgs=897 cs=0 l=1 rev1=1 crypto rx=0x7f2120074d50 tx=0x7f211802aac0 comp rx=0 tx=0).stop 2024-09-17T05:47:44.925 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:44.924+0000 7f212796e640 1 -- 172.21.15.150:0/4067104135 shutdown_connections 2024-09-17T05:47:44.925 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:44.924+0000 7f212796e640 1 --2- 172.21.15.150:0/4067104135 >> v2:172.21.15.176:3300/0 conn(0x7f21200b6800 0x7f212006ddb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:47:44.925 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:44.924+0000 7f212796e640 1 --2- 172.21.15.150:0/4067104135 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f212006f940 0x7f212006e2f0 unknown :-1 s=CLOSED pgs=897 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:47:44.925 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:44.924+0000 7f212796e640 1 -- 172.21.15.150:0/4067104135 >> 172.21.15.150:0/4067104135 conn(0x7f2120073890 msgr2=0x7f2120073ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:47:44.926 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:44.924+0000 7f212796e640 1 -- 172.21.15.150:0/4067104135 shutdown_connections 2024-09-17T05:47:44.926 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:44.924+0000 7f212796e640 1 -- 172.21.15.150:0/4067104135 wait complete. 2024-09-17T05:47:44.927 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:44.926+0000 7f212796e640 1 Processor -- start 2024-09-17T05:47:44.927 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:44.926+0000 7f212796e640 1 -- start start 2024-09-17T05:47:44.929 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:44.927+0000 7f212796e640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f212006f940 0x7f212015be20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:47:44.929 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:44.927+0000 7f212796e640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2120071490 0x7f2120142db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:47:44.929 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:44.927+0000 7f212796e640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f21200b6800 0x7f212015f740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:47:44.929 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:44.927+0000 7f212796e640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f212015d430 con 0x7f212006f940 2024-09-17T05:47:44.929 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:44.927+0000 7f212796e640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f212015d2b0 con 0x7f21200b6800 2024-09-17T05:47:44.929 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:44.927+0000 7f212796e640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f212015d5b0 con 0x7f2120071490 2024-09-17T05:47:44.930 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:44.927+0000 7f212570a640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f212006f940 0x7f212015be20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:47:44.930 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:44.927+0000 7f212570a640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f212006f940 0x7f212015be20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:60644/0 (socket says 172.21.15.150:60644) 2024-09-17T05:47:44.930 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:44.927+0000 7f212570a640 1 -- 172.21.15.150:0/2754328892 learned_addr learned my addr 172.21.15.150:0/2754328892 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:47:44.930 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:44.927+0000 7f2124f09640 1 --2- 172.21.15.150:0/2754328892 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2120071490 0x7f2120142db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:47:44.930 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:44.927+0000 7f2125f0b640 1 --2- 172.21.15.150:0/2754328892 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f21200b6800 0x7f212015f740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:47:44.930 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:44.928+0000 7f212570a640 1 -- 172.21.15.150:0/2754328892 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2120071490 msgr2=0x7f2120142db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:47:44.930 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:44.928+0000 7f212570a640 1 --2- 172.21.15.150:0/2754328892 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2120071490 0x7f2120142db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:47:44.931 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:44.928+0000 7f212570a640 1 -- 172.21.15.150:0/2754328892 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f21200b6800 msgr2=0x7f212015f740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:47:44.932 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:44.928+0000 7f212570a640 1 --2- 172.21.15.150:0/2754328892 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f21200b6800 0x7f212015f740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:47:44.932 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:44.928+0000 7f212570a640 1 -- 172.21.15.150:0/2754328892 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2120145750 con 0x7f212006f940 2024-09-17T05:47:44.932 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:44.928+0000 7f212570a640 1 --2- 172.21.15.150:0/2754328892 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f212006f940 0x7f212015be20 secure :-1 s=READY pgs=898 cs=0 l=1 rev1=1 crypto rx=0x7f211c00c370 tx=0x7f211c00c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:47:44.932 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:44.928+0000 7f2115ffb640 1 -- 172.21.15.150:0/2754328892 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f211c0052d0 con 0x7f212006f940 2024-09-17T05:47:44.932 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:44.928+0000 7f2115ffb640 1 -- 172.21.15.150:0/2754328892 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f211c007020 con 0x7f212006f940 2024-09-17T05:47:44.932 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:44.928+0000 7f2115ffb640 1 -- 172.21.15.150:0/2754328892 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f211c007470 con 0x7f212006f940 2024-09-17T05:47:44.932 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:44.928+0000 7f212796e640 1 -- 172.21.15.150:0/2754328892 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f21201f4360 con 0x7f212006f940 2024-09-17T05:47:44.932 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:44.929+0000 7f212796e640 1 -- 172.21.15.150:0/2754328892 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2120145cf0 con 0x7f212006f940 2024-09-17T05:47:44.933 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:44.929+0000 7f212796e640 1 -- 172.21.15.150:0/2754328892 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f212015dad0 con 0x7f212006f940 2024-09-17T05:47:44.934 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:44.930+0000 7f2115ffb640 1 -- 172.21.15.150:0/2754328892 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 24) ==== 102971+0+0 (secure 0 0 0) 0x7f211c0067d0 con 0x7f212006f940 2024-09-17T05:47:44.934 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:44.930+0000 7f2115ffb640 1 --2- 172.21.15.150:0/2754328892 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f2104079c70 0x7f210407c180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:47:44.934 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:44.931+0000 7f2115ffb640 1 -- 172.21.15.150:0/2754328892 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 5881+0+0 (secure 0 0 0) 0x7f211c098c20 con 0x7f212006f940 2024-09-17T05:47:44.934 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:44.931+0000 7f2124f09640 1 --2- 172.21.15.150:0/2754328892 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f2104079c70 0x7f210407c180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:47:44.934 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:44.931+0000 7f2124f09640 1 --2- 172.21.15.150:0/2754328892 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f2104079c70 0x7f210407c180 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f2110009b30 tx=0x7f2110005f90 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:47:44.936 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:44.936+0000 7f2115ffb640 1 -- 172.21.15.150:0/2754328892 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f211c062550 con 0x7f212006f940 2024-09-17T05:47:45.249 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:45.248+0000 7f212796e640 1 -- 172.21.15.150:0/2754328892 --> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] -- mgr_command(tid 0: {"prefix": "fs clone cancel", "vol_name": "cephfs", "clone_name": "subvol_clone37686", "target": ["mon-mgr", ""]}) -- 0x7f21200b0d60 con 0x7f2104079c70 2024-09-17T05:47:45.421 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:45.421+0000 7f2115ffb640 1 -- 172.21.15.150:0/2754328892 <== mgr.4108 v2:172.21.15.176:6800/3631216395 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f21200b0d60 con 0x7f2104079c70 2024-09-17T05:47:45.424 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:45.423+0000 7f212796e640 1 -- 172.21.15.150:0/2754328892 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f2104079c70 msgr2=0x7f210407c180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:47:45.424 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:45.423+0000 7f212796e640 1 --2- 172.21.15.150:0/2754328892 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f2104079c70 0x7f210407c180 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f2110009b30 tx=0x7f2110005f90 comp rx=0 tx=0).stop 2024-09-17T05:47:45.425 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:45.423+0000 7f212796e640 1 -- 172.21.15.150:0/2754328892 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f212006f940 msgr2=0x7f212015be20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:47:45.425 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:45.423+0000 7f212796e640 1 --2- 172.21.15.150:0/2754328892 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f212006f940 0x7f212015be20 secure :-1 s=READY pgs=898 cs=0 l=1 rev1=1 crypto rx=0x7f211c00c370 tx=0x7f211c00c830 comp rx=0 tx=0).stop 2024-09-17T05:47:45.425 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:45.423+0000 7f212796e640 1 -- 172.21.15.150:0/2754328892 shutdown_connections 2024-09-17T05:47:45.425 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:45.423+0000 7f212796e640 1 --2- 172.21.15.150:0/2754328892 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f21200b6800 0x7f212015f740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:47:45.425 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:45.423+0000 7f212796e640 1 --2- 172.21.15.150:0/2754328892 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f2104079c70 0x7f210407c180 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:47:45.425 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:45.423+0000 7f212796e640 1 --2- 172.21.15.150:0/2754328892 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2120071490 0x7f2120142db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:47:45.425 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:45.423+0000 7f212796e640 1 --2- 172.21.15.150:0/2754328892 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f212006f940 0x7f212015be20 unknown :-1 s=CLOSED pgs=898 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:47:45.425 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:45.423+0000 7f212796e640 1 -- 172.21.15.150:0/2754328892 >> 172.21.15.150:0/2754328892 conn(0x7f2120073890 msgr2=0x7f2120073ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:47:45.425 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:45.424+0000 7f212796e640 1 -- 172.21.15.150:0/2754328892 shutdown_connections 2024-09-17T05:47:45.425 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:45.424+0000 7f212796e640 1 -- 172.21.15.150:0/2754328892 wait complete. 2024-09-17T05:47:45.436 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume ls 2024-09-17T05:47:45.551 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:45.550+0000 7f3bbcc5c640 1 -- 172.21.15.150:0/3849802543 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3ba4003a00 msgr2=0x7f3ba4003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:47:45.551 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:45.550+0000 7f3bbcc5c640 1 --2- 172.21.15.150:0/3849802543 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3ba4003a00 0x7f3ba4003e70 secure :-1 s=READY pgs=900 cs=0 l=1 rev1=1 crypto rx=0x7f3ba8009b50 tx=0x7f3ba4005830 comp rx=0 tx=0).stop 2024-09-17T05:47:45.551 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:45.550+0000 7f3bb6d9d640 1 -- 172.21.15.150:0/3849802543 reap_dead start 2024-09-17T05:47:45.552 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:45.550+0000 7f3bbcc5c640 1 -- 172.21.15.150:0/3849802543 shutdown_connections 2024-09-17T05:47:45.552 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:45.550+0000 7f3bbcc5c640 1 -- 172.21.15.150:0/3849802543 >> 172.21.15.150:0/3849802543 conn(0x7f3bb80b6880 msgr2=0x7f3bb80b3060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:47:45.552 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:45.550+0000 7f3bbcc5c640 1 -- 172.21.15.150:0/3849802543 shutdown_connections 2024-09-17T05:47:45.552 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:45.550+0000 7f3bbcc5c640 1 -- 172.21.15.150:0/3849802543 wait complete. 2024-09-17T05:47:45.552 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:45.552+0000 7f3bbcc5c640 1 Processor -- start 2024-09-17T05:47:45.553 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:45.552+0000 7f3bbcc5c640 1 -- start start 2024-09-17T05:47:45.555 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:45.553+0000 7f3bbcc5c640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3ba4003a00 0x7f3bb81f7670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:47:45.555 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:45.553+0000 7f3bbcc5c640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3bb8154c40 0x7f3bb806cf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:47:45.555 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:45.553+0000 7f3bbcc5c640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3bb806d4c0 0x7f3bb8070960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:47:45.556 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:45.553+0000 7f3bbcc5c640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f3bb81636f0 con 0x7f3bb806d4c0 2024-09-17T05:47:45.556 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:45.553+0000 7f3bbcc5c640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f3bb8163570 con 0x7f3ba4003a00 2024-09-17T05:47:45.556 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:45.553+0000 7f3bbcc5c640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f3bb8163870 con 0x7f3bb8154c40 2024-09-17T05:47:45.556 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:45.553+0000 7f3bb6d9d640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3bb806d4c0 0x7f3bb8070960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:47:45.556 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:45.553+0000 7f3bb6d9d640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3bb806d4c0 0x7f3bb8070960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:60660/0 (socket says 172.21.15.150:60660) 2024-09-17T05:47:45.556 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:45.553+0000 7f3badd9b640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3bb8154c40 0x7f3bb806cf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:47:45.556 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:45.553+0000 7f3bb6d9d640 1 -- 172.21.15.150:0/2962588172 learned_addr learned my addr 172.21.15.150:0/2962588172 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:47:45.556 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:45.554+0000 7f3bb659c640 1 --2- 172.21.15.150:0/2962588172 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3ba4003a00 0x7f3bb81f7670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:47:45.556 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:45.554+0000 7f3bb6d9d640 1 -- 172.21.15.150:0/2962588172 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3bb8154c40 msgr2=0x7f3bb806cf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:47:45.556 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:45.554+0000 7f3bb6d9d640 1 --2- 172.21.15.150:0/2962588172 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3bb8154c40 0x7f3bb806cf80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:47:45.556 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:45.554+0000 7f3bb6d9d640 1 -- 172.21.15.150:0/2962588172 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3ba4003a00 msgr2=0x7f3bb81f7670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:47:45.556 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:45.554+0000 7f3bb6d9d640 1 --2- 172.21.15.150:0/2962588172 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3ba4003a00 0x7f3bb81f7670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:47:45.557 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:45.554+0000 7f3bb6d9d640 1 -- 172.21.15.150:0/2962588172 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3bb81f3680 con 0x7f3bb806d4c0 2024-09-17T05:47:45.557 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:45.554+0000 7f3bb6d9d640 1 --2- 172.21.15.150:0/2962588172 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3bb806d4c0 0x7f3bb8070960 secure :-1 s=READY pgs=901 cs=0 l=1 rev1=1 crypto rx=0x7f3bb8074100 tx=0x7f3bb0010ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:47:45.557 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:45.554+0000 7f3baf7fe640 1 -- 172.21.15.150:0/2962588172 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3bb000edb0 con 0x7f3bb806d4c0 2024-09-17T05:47:45.557 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:45.554+0000 7f3baf7fe640 1 -- 172.21.15.150:0/2962588172 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f3bb0004b20 con 0x7f3bb806d4c0 2024-09-17T05:47:45.557 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:45.554+0000 7f3bbcc5c640 1 -- 172.21.15.150:0/2962588172 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3bb81f38f0 con 0x7f3bb806d4c0 2024-09-17T05:47:45.557 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:45.554+0000 7f3baf7fe640 1 -- 172.21.15.150:0/2962588172 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3bb0003970 con 0x7f3bb806d4c0 2024-09-17T05:47:45.557 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:45.554+0000 7f3bbcc5c640 1 -- 172.21.15.150:0/2962588172 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3bb80716d0 con 0x7f3bb806d4c0 2024-09-17T05:47:45.558 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:45.555+0000 7f3bbcc5c640 1 -- 172.21.15.150:0/2962588172 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3bb8071930 con 0x7f3bb806d4c0 2024-09-17T05:47:45.558 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:45.556+0000 7f3baf7fe640 1 -- 172.21.15.150:0/2962588172 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 24) ==== 102971+0+0 (secure 0 0 0) 0x7f3bb001a070 con 0x7f3bb806d4c0 2024-09-17T05:47:45.558 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:45.556+0000 7f3baf7fe640 1 --2- 172.21.15.150:0/2962588172 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f3b98079c70 0x7f3b9807c180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:47:45.558 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:45.557+0000 7f3baf7fe640 1 -- 172.21.15.150:0/2962588172 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 5881+0+0 (secure 0 0 0) 0x7f3bb009a760 con 0x7f3bb806d4c0 2024-09-17T05:47:45.558 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:45.557+0000 7f3bb659c640 1 --2- 172.21.15.150:0/2962588172 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f3b98079c70 0x7f3b9807c180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:47:45.558 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:45.557+0000 7f3bb659c640 1 --2- 172.21.15.150:0/2962588172 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f3b98079c70 0x7f3b9807c180 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f3ba8035000 tx=0x7f3ba802d040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:47:45.562 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:45.561+0000 7f3baf7fe640 1 -- 172.21.15.150:0/2962588172 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f3bb0063d50 con 0x7f3bb806d4c0 2024-09-17T05:47:45.763 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:45.762+0000 7f3bbcc5c640 1 -- 172.21.15.150:0/2962588172 --> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] -- mgr_command(tid 0: {"prefix": "fs volume ls", "target": ["mon-mgr", ""]}) -- 0x7f3bb80d0cd0 con 0x7f3b98079c70 2024-09-17T05:47:45.764 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:45.764+0000 7f3baf7fe640 1 -- 172.21.15.150:0/2962588172 <== mgr.4108 v2:172.21.15.176:6800/3631216395 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+41 (secure 0 0 0) 0x7f3bb80d0cd0 con 0x7f3b98079c70 2024-09-17T05:47:45.764 INFO:teuthology.orchestra.run.smithi150.stdout:[ 2024-09-17T05:47:45.764 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-09-17T05:47:45.765 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "cephfs" 2024-09-17T05:47:45.765 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-09-17T05:47:45.765 INFO:teuthology.orchestra.run.smithi150.stdout:] 2024-09-17T05:47:45.767 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:45.766+0000 7f3bbcc5c640 1 -- 172.21.15.150:0/2962588172 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f3b98079c70 msgr2=0x7f3b9807c180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:47:45.767 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:45.766+0000 7f3bbcc5c640 1 --2- 172.21.15.150:0/2962588172 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f3b98079c70 0x7f3b9807c180 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f3ba8035000 tx=0x7f3ba802d040 comp rx=0 tx=0).stop 2024-09-17T05:47:45.767 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:45.766+0000 7f3bbcc5c640 1 -- 172.21.15.150:0/2962588172 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3bb806d4c0 msgr2=0x7f3bb8070960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:47:45.767 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:45.766+0000 7f3bbcc5c640 1 --2- 172.21.15.150:0/2962588172 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3bb806d4c0 0x7f3bb8070960 secure :-1 s=READY pgs=901 cs=0 l=1 rev1=1 crypto rx=0x7f3bb8074100 tx=0x7f3bb0010ee0 comp rx=0 tx=0).stop 2024-09-17T05:47:45.767 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:45.766+0000 7f3bbcc5c640 1 -- 172.21.15.150:0/2962588172 shutdown_connections 2024-09-17T05:47:45.767 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:45.766+0000 7f3bbcc5c640 1 --2- 172.21.15.150:0/2962588172 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f3b98079c70 0x7f3b9807c180 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:47:45.767 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:45.766+0000 7f3bbcc5c640 1 --2- 172.21.15.150:0/2962588172 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3bb806d4c0 0x7f3bb8070960 unknown :-1 s=CLOSED pgs=901 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:47:45.767 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:45.766+0000 7f3bbcc5c640 1 --2- 172.21.15.150:0/2962588172 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3bb8154c40 0x7f3bb806cf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:47:45.767 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:45.766+0000 7f3bbcc5c640 1 --2- 172.21.15.150:0/2962588172 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3ba4003a00 0x7f3bb81f7670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:47:45.768 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:45.766+0000 7f3bbcc5c640 1 -- 172.21.15.150:0/2962588172 >> 172.21.15.150:0/2962588172 conn(0x7f3bb80b6880 msgr2=0x7f3bb8150f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:47:45.768 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:45.766+0000 7f3bbcc5c640 1 -- 172.21.15.150:0/2962588172 shutdown_connections 2024-09-17T05:47:45.768 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:45.766+0000 7f3bbcc5c640 1 -- 172.21.15.150:0/2962588172 wait complete. 2024-09-17T05:47:45.779 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume ls cephfs --format json 2024-09-17T05:47:45.895 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:45.894+0000 7f80c4415640 1 -- 172.21.15.150:0/4133097900 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f80bc160200 msgr2=0x7f80bc0b4e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:47:45.895 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:45.894+0000 7f80c4415640 1 --2- 172.21.15.150:0/4133097900 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f80bc160200 0x7f80bc0b4e50 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f80b4005fd0 tx=0x7f80b402aa10 comp rx=0 tx=0).stop 2024-09-17T05:47:45.895 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:45.894+0000 7f80c4415640 1 -- 172.21.15.150:0/4133097900 shutdown_connections 2024-09-17T05:47:45.895 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:45.894+0000 7f80c4415640 1 --2- 172.21.15.150:0/4133097900 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f80bc160200 0x7f80bc0b4e50 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:47:45.895 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:45.894+0000 7f80c4415640 1 --2- 172.21.15.150:0/4133097900 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f80bc0b6550 0x7f80bc0b24c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:47:45.895 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:45.894+0000 7f80c4415640 1 -- 172.21.15.150:0/4133097900 >> 172.21.15.150:0/4133097900 conn(0x7f80bc0b2e80 msgr2=0x7f80bc0b3290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:47:45.896 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:45.894+0000 7f80c4415640 1 -- 172.21.15.150:0/4133097900 shutdown_connections 2024-09-17T05:47:45.896 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:45.894+0000 7f80c4415640 1 -- 172.21.15.150:0/4133097900 wait complete. 2024-09-17T05:47:45.896 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:45.896+0000 7f80c4415640 1 Processor -- start 2024-09-17T05:47:45.896 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:45.896+0000 7f80c4415640 1 -- start start 2024-09-17T05:47:45.899 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:45.897+0000 7f80c4415640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f80bc0b2a00 0x7f80bc15e430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:47:45.899 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:45.897+0000 7f80c4415640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f80bc0b6550 0x7f80bc0af620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:47:45.899 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:45.897+0000 7f80c4415640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f80bc160200 0x7f80bc1e7b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:47:45.899 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:45.897+0000 7f80c4415640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f80bc160820 con 0x7f80bc0b2a00 2024-09-17T05:47:45.899 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:45.897+0000 7f80c4415640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f80bc0b5390 con 0x7f80bc0b6550 2024-09-17T05:47:45.899 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:45.897+0000 7f80c4415640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f80bc0aeff0 con 0x7f80bc160200 2024-09-17T05:47:45.899 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:45.897+0000 7f80c21b1640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f80bc0b2a00 0x7f80bc15e430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:47:45.899 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:45.897+0000 7f80c21b1640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f80bc0b2a00 0x7f80bc15e430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:60670/0 (socket says 172.21.15.150:60670) 2024-09-17T05:47:45.899 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:45.897+0000 7f80c21b1640 1 -- 172.21.15.150:0/126777533 learned_addr learned my addr 172.21.15.150:0/126777533 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:47:45.900 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:45.897+0000 7f80c19b0640 1 --2- 172.21.15.150:0/126777533 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f80bc0b6550 0x7f80bc0af620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:47:45.900 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:45.897+0000 7f80c29b2640 1 --2- 172.21.15.150:0/126777533 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f80bc160200 0x7f80bc1e7b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:47:45.900 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:45.897+0000 7f80c21b1640 1 -- 172.21.15.150:0/126777533 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f80bc160200 msgr2=0x7f80bc1e7b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:47:45.900 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:45.897+0000 7f80c21b1640 1 --2- 172.21.15.150:0/126777533 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f80bc160200 0x7f80bc1e7b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:47:45.900 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:45.897+0000 7f80c21b1640 1 -- 172.21.15.150:0/126777533 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f80bc0b6550 msgr2=0x7f80bc0af620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:47:45.900 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:45.897+0000 7f80c21b1640 1 --2- 172.21.15.150:0/126777533 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f80bc0b6550 0x7f80bc0af620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:47:45.900 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:45.897+0000 7f80c21b1640 1 -- 172.21.15.150:0/126777533 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f80bc1f70c0 con 0x7f80bc0b2a00 2024-09-17T05:47:45.900 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:45.898+0000 7f80c29b2640 1 --2- 172.21.15.150:0/126777533 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f80bc160200 0x7f80bc1e7b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:47:45.900 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:45.898+0000 7f80c21b1640 1 --2- 172.21.15.150:0/126777533 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f80bc0b2a00 0x7f80bc15e430 secure :-1 s=READY pgs=902 cs=0 l=1 rev1=1 crypto rx=0x7f80ac00ea20 tx=0x7f80ac00eee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:47:45.900 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:45.898+0000 7f80b2ffd640 1 -- 172.21.15.150:0/126777533 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80ac00ce40 con 0x7f80bc0b2a00 2024-09-17T05:47:45.900 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:45.898+0000 7f80b2ffd640 1 -- 172.21.15.150:0/126777533 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f80ac004020 con 0x7f80bc0b2a00 2024-09-17T05:47:45.900 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:45.898+0000 7f80b2ffd640 1 -- 172.21.15.150:0/126777533 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80ac004470 con 0x7f80bc0b2a00 2024-09-17T05:47:45.900 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:45.898+0000 7f80c4415640 1 -- 172.21.15.150:0/126777533 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f80bc1f3c40 con 0x7f80bc0b2a00 2024-09-17T05:47:45.901 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:45.898+0000 7f80c4415640 1 -- 172.21.15.150:0/126777533 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f80bc1f4200 con 0x7f80bc0b2a00 2024-09-17T05:47:45.901 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:45.899+0000 7f80c4415640 1 -- 172.21.15.150:0/126777533 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f80bc1f3a30 con 0x7f80bc0b2a00 2024-09-17T05:47:45.902 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:45.900+0000 7f80b2ffd640 1 -- 172.21.15.150:0/126777533 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 24) ==== 102971+0+0 (secure 0 0 0) 0x7f80ac0035f0 con 0x7f80bc0b2a00 2024-09-17T05:47:45.902 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:45.900+0000 7f80b2ffd640 1 --2- 172.21.15.150:0/126777533 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f80a0079ca0 0x7f80a007c1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:47:45.902 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:45.900+0000 7f80b2ffd640 1 -- 172.21.15.150:0/126777533 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 5881+0+0 (secure 0 0 0) 0x7f80ac09a6a0 con 0x7f80bc0b2a00 2024-09-17T05:47:45.902 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:45.900+0000 7f80c19b0640 1 --2- 172.21.15.150:0/126777533 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f80a0079ca0 0x7f80a007c1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:47:45.902 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:45.901+0000 7f80c19b0640 1 --2- 172.21.15.150:0/126777533 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f80a0079ca0 0x7f80a007c1b0 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f80bc15fa50 tx=0x7f80b8009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:47:45.905 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:45.905+0000 7f80b2ffd640 1 -- 172.21.15.150:0/126777533 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f80ac0641d0 con 0x7f80bc0b2a00 2024-09-17T05:47:46.105 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:46.104+0000 7f80c4415640 1 -- 172.21.15.150:0/126777533 --> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] -- mgr_command(tid 0: {"prefix": "fs subvolume ls", "vol_name": "cephfs", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f80bc0b3dd0 con 0x7f80a0079ca0 2024-09-17T05:47:46.112 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:46.111+0000 7f80b2ffd640 1 -- 172.21.15.150:0/126777533 <== mgr.4108 v2:172.21.15.176:6800/3631216395 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+381 (secure 0 0 0) 0x7f80b8001cd0 con 0x7f80a0079ca0 2024-09-17T05:47:46.112 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-09-17T05:47:46.112 INFO:teuthology.orchestra.run.smithi150.stdout:[ 2024-09-17T05:47:46.112 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-09-17T05:47:46.113 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "subvol_clone94333" 2024-09-17T05:47:46.113 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-17T05:47:46.113 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-09-17T05:47:46.113 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "subvol_clone72832" 2024-09-17T05:47:46.113 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-17T05:47:46.113 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-09-17T05:47:46.113 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "sv1" 2024-09-17T05:47:46.113 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-17T05:47:46.113 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-09-17T05:47:46.113 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "subvol_clone37686" 2024-09-17T05:47:46.113 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-17T05:47:46.113 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-09-17T05:47:46.113 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "subvol_clone62874" 2024-09-17T05:47:46.114 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-17T05:47:46.114 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-09-17T05:47:46.114 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "subvol_clone51670" 2024-09-17T05:47:46.114 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-17T05:47:46.114 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-09-17T05:47:46.114 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "subvol_clone43985" 2024-09-17T05:47:46.114 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-17T05:47:46.114 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-09-17T05:47:46.114 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "subvol_clone19001" 2024-09-17T05:47:46.114 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-09-17T05:47:46.114 INFO:teuthology.orchestra.run.smithi150.stdout:] 2024-09-17T05:47:46.116 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:46.113+0000 7f80c4415640 1 -- 172.21.15.150:0/126777533 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f80a0079ca0 msgr2=0x7f80a007c1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:47:46.116 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:46.113+0000 7f80c4415640 1 --2- 172.21.15.150:0/126777533 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f80a0079ca0 0x7f80a007c1b0 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f80bc15fa50 tx=0x7f80b8009040 comp rx=0 tx=0).stop 2024-09-17T05:47:46.116 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:46.113+0000 7f80c4415640 1 -- 172.21.15.150:0/126777533 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f80bc0b2a00 msgr2=0x7f80bc15e430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:47:46.116 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:46.113+0000 7f80c4415640 1 --2- 172.21.15.150:0/126777533 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f80bc0b2a00 0x7f80bc15e430 secure :-1 s=READY pgs=902 cs=0 l=1 rev1=1 crypto rx=0x7f80ac00ea20 tx=0x7f80ac00eee0 comp rx=0 tx=0).stop 2024-09-17T05:47:46.116 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:46.113+0000 7f80c4415640 1 -- 172.21.15.150:0/126777533 shutdown_connections 2024-09-17T05:47:46.116 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:46.113+0000 7f80c4415640 1 --2- 172.21.15.150:0/126777533 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f80bc0b6550 0x7f80bc0af620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:47:46.116 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:46.113+0000 7f80c4415640 1 --2- 172.21.15.150:0/126777533 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f80a0079ca0 0x7f80a007c1b0 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:47:46.116 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:46.113+0000 7f80c4415640 1 --2- 172.21.15.150:0/126777533 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f80bc160200 0x7f80bc1e7b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:47:46.116 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:46.113+0000 7f80c4415640 1 --2- 172.21.15.150:0/126777533 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f80bc0b2a00 0x7f80bc15e430 unknown :-1 s=CLOSED pgs=902 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:47:46.116 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:46.113+0000 7f80c4415640 1 -- 172.21.15.150:0/126777533 >> 172.21.15.150:0/126777533 conn(0x7f80bc0b2e80 msgr2=0x7f80bc15b9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:47:46.116 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:46.114+0000 7f80c4415640 1 -- 172.21.15.150:0/126777533 shutdown_connections 2024-09-17T05:47:46.116 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:46.114+0000 7f80c4415640 1 -- 172.21.15.150:0/126777533 wait complete. 2024-09-17T05:47:46.128 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume rm --force cephfs subvol_clone94333 2024-09-17T05:47:46.245 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:46.244+0000 7fdd40c9b640 1 -- 172.21.15.150:0/1101917224 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fdd3c0b4a00 msgr2=0x7fdd3c166600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:47:46.245 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:46.244+0000 7fdd40c9b640 1 --2- 172.21.15.150:0/1101917224 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fdd3c0b4a00 0x7fdd3c166600 secure :-1 s=READY pgs=904 cs=0 l=1 rev1=1 crypto rx=0x7fdd34005fd0 tx=0x7fdd3402a980 comp rx=0 tx=0).stop 2024-09-17T05:47:46.245 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:46.244+0000 7fdd40c9b640 1 -- 172.21.15.150:0/1101917224 shutdown_connections 2024-09-17T05:47:46.245 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:46.244+0000 7fdd40c9b640 1 --2- 172.21.15.150:0/1101917224 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fdd3c0b4a00 0x7fdd3c166600 unknown :-1 s=CLOSED pgs=904 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:47:46.245 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:46.244+0000 7fdd40c9b640 1 -- 172.21.15.150:0/1101917224 >> 172.21.15.150:0/1101917224 conn(0x7fdd3c09aa50 msgr2=0x7fdd3c0b2ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:47:46.246 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:46.244+0000 7fdd40c9b640 1 -- 172.21.15.150:0/1101917224 shutdown_connections 2024-09-17T05:47:46.246 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:46.244+0000 7fdd40c9b640 1 -- 172.21.15.150:0/1101917224 wait complete. 2024-09-17T05:47:46.246 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:46.246+0000 7fdd40c9b640 1 Processor -- start 2024-09-17T05:47:46.246 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:46.246+0000 7fdd40c9b640 1 -- start start 2024-09-17T05:47:46.249 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:46.247+0000 7fdd40c9b640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fdd3c0b4a00 0x7fdd3c141ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:47:46.249 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:46.247+0000 7fdd40c9b640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fdd3c15d190 0x7fdd3c06cda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:47:46.249 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:46.247+0000 7fdd40c9b640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fdd3c15d5a0 0x7fdd3c06d2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:47:46.250 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:46.247+0000 7fdd40c9b640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7fdd3c166cc0 con 0x7fdd3c0b4a00 2024-09-17T05:47:46.250 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:46.247+0000 7fdd40c9b640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fdd3c166b40 con 0x7fdd3c15d5a0 2024-09-17T05:47:46.250 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:46.247+0000 7fdd40c9b640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fdd3c166e40 con 0x7fdd3c15d190 2024-09-17T05:47:46.250 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:46.247+0000 7fdd3a59c640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fdd3c0b4a00 0x7fdd3c141ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:47:46.250 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:46.247+0000 7fdd3a59c640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fdd3c0b4a00 0x7fdd3c141ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:60684/0 (socket says 172.21.15.150:60684) 2024-09-17T05:47:46.250 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:46.247+0000 7fdd3a59c640 1 -- 172.21.15.150:0/2060927343 learned_addr learned my addr 172.21.15.150:0/2060927343 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:47:46.250 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:46.248+0000 7fdd3ad9d640 1 --2- 172.21.15.150:0/2060927343 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fdd3c15d5a0 0x7fdd3c06d2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:47:46.250 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:46.248+0000 7fdd31d9b640 1 --2- 172.21.15.150:0/2060927343 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fdd3c15d190 0x7fdd3c06cda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:47:46.250 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:46.248+0000 7fdd3a59c640 1 -- 172.21.15.150:0/2060927343 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fdd3c15d190 msgr2=0x7fdd3c06cda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:47:46.250 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:46.248+0000 7fdd3a59c640 1 --2- 172.21.15.150:0/2060927343 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fdd3c15d190 0x7fdd3c06cda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:47:46.250 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:46.248+0000 7fdd3a59c640 1 -- 172.21.15.150:0/2060927343 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fdd3c15d5a0 msgr2=0x7fdd3c06d2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:47:46.251 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:46.248+0000 7fdd3a59c640 1 --2- 172.21.15.150:0/2060927343 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fdd3c15d5a0 0x7fdd3c06d2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:47:46.251 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:46.248+0000 7fdd3a59c640 1 -- 172.21.15.150:0/2060927343 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdd3c0cd790 con 0x7fdd3c0b4a00 2024-09-17T05:47:46.251 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:46.248+0000 7fdd3ad9d640 1 --2- 172.21.15.150:0/2060927343 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fdd3c15d5a0 0x7fdd3c06d2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:47:46.251 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:46.248+0000 7fdd3a59c640 1 --2- 172.21.15.150:0/2060927343 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fdd3c0b4a00 0x7fdd3c141ec0 secure :-1 s=READY pgs=905 cs=0 l=1 rev1=1 crypto rx=0x7fdd2c00b3f0 tx=0x7fdd2c00b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:47:46.251 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:46.248+0000 7fdd337fe640 1 -- 172.21.15.150:0/2060927343 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd2c015020 con 0x7fdd3c0b4a00 2024-09-17T05:47:46.251 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:46.248+0000 7fdd337fe640 1 -- 172.21.15.150:0/2060927343 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fdd2c011920 con 0x7fdd3c0b4a00 2024-09-17T05:47:46.251 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:46.248+0000 7fdd337fe640 1 -- 172.21.15.150:0/2060927343 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd2c011d70 con 0x7fdd3c0b4a00 2024-09-17T05:47:46.251 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:46.248+0000 7fdd40c9b640 1 -- 172.21.15.150:0/2060927343 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdd3c0b07b0 con 0x7fdd3c0b4a00 2024-09-17T05:47:46.251 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:46.248+0000 7fdd40c9b640 1 -- 172.21.15.150:0/2060927343 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdd3c150270 con 0x7fdd3c0b4a00 2024-09-17T05:47:46.252 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:46.249+0000 7fdd40c9b640 1 -- 172.21.15.150:0/2060927343 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdd3c0af8a0 con 0x7fdd3c0b4a00 2024-09-17T05:47:46.252 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:46.250+0000 7fdd337fe640 1 -- 172.21.15.150:0/2060927343 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 24) ==== 102971+0+0 (secure 0 0 0) 0x7fdd2c018020 con 0x7fdd3c0b4a00 2024-09-17T05:47:46.252 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:46.250+0000 7fdd337fe640 1 --2- 172.21.15.150:0/2060927343 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fdd1c079c70 0x7fdd1c07c180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:47:46.253 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:46.251+0000 7fdd337fe640 1 -- 172.21.15.150:0/2060927343 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 5881+0+0 (secure 0 0 0) 0x7fdd2c099500 con 0x7fdd3c0b4a00 2024-09-17T05:47:46.253 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:46.251+0000 7fdd31d9b640 1 --2- 172.21.15.150:0/2060927343 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fdd1c079c70 0x7fdd1c07c180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:47:46.253 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:46.251+0000 7fdd31d9b640 1 --2- 172.21.15.150:0/2060927343 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fdd1c079c70 0x7fdd1c07c180 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7fdd3c0d06f0 tx=0x7fdd24009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:47:46.255 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:46.255+0000 7fdd337fe640 1 -- 172.21.15.150:0/2060927343 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fdd2c01f030 con 0x7fdd3c0b4a00 2024-09-17T05:47:46.455 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:46.454+0000 7fdd40c9b640 1 -- 172.21.15.150:0/2060927343 --> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] -- mgr_command(tid 0: {"prefix": "fs subvolume rm", "force": true, "vol_name": "cephfs", "sub_name": "subvol_clone94333", "target": ["mon-mgr", ""]}) -- 0x7fdd3c0b0560 con 0x7fdd1c079c70 2024-09-17T05:47:46.473 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:46.472+0000 7fdd337fe640 1 -- 172.21.15.150:0/2060927343 <== mgr.4108 v2:172.21.15.176:6800/3631216395 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7fdd3c0b0560 con 0x7fdd1c079c70 2024-09-17T05:47:46.476 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:46.475+0000 7fdd40c9b640 1 -- 172.21.15.150:0/2060927343 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fdd1c079c70 msgr2=0x7fdd1c07c180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:47:46.476 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:46.475+0000 7fdd40c9b640 1 --2- 172.21.15.150:0/2060927343 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fdd1c079c70 0x7fdd1c07c180 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7fdd3c0d06f0 tx=0x7fdd24009040 comp rx=0 tx=0).stop 2024-09-17T05:47:46.476 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:46.475+0000 7fdd40c9b640 1 -- 172.21.15.150:0/2060927343 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fdd3c0b4a00 msgr2=0x7fdd3c141ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:47:46.476 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:46.475+0000 7fdd40c9b640 1 --2- 172.21.15.150:0/2060927343 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fdd3c0b4a00 0x7fdd3c141ec0 secure :-1 s=READY pgs=905 cs=0 l=1 rev1=1 crypto rx=0x7fdd2c00b3f0 tx=0x7fdd2c00b8b0 comp rx=0 tx=0).stop 2024-09-17T05:47:46.476 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:46.475+0000 7fdd40c9b640 1 -- 172.21.15.150:0/2060927343 shutdown_connections 2024-09-17T05:47:46.476 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:46.475+0000 7fdd40c9b640 1 --2- 172.21.15.150:0/2060927343 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fdd3c15d5a0 0x7fdd3c06d2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:47:46.476 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:46.475+0000 7fdd40c9b640 1 --2- 172.21.15.150:0/2060927343 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fdd1c079c70 0x7fdd1c07c180 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:47:46.477 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:46.475+0000 7fdd40c9b640 1 --2- 172.21.15.150:0/2060927343 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fdd3c15d190 0x7fdd3c06cda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:47:46.477 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:46.475+0000 7fdd40c9b640 1 --2- 172.21.15.150:0/2060927343 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fdd3c0b4a00 0x7fdd3c141ec0 unknown :-1 s=CLOSED pgs=905 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:47:46.477 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:46.475+0000 7fdd40c9b640 1 -- 172.21.15.150:0/2060927343 >> 172.21.15.150:0/2060927343 conn(0x7fdd3c09aa50 msgr2=0x7fdd3c0b42f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:47:46.477 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:46.475+0000 7fdd40c9b640 1 -- 172.21.15.150:0/2060927343 shutdown_connections 2024-09-17T05:47:46.477 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:46.475+0000 7fdd40c9b640 1 -- 172.21.15.150:0/2060927343 wait complete. 2024-09-17T05:47:46.486 INFO:tasks.ceph.mgr.x.smithi176.stderr:2024-09-17T05:47:46.485+0000 7f33d9f1f640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-17T05:47:46.486 INFO:tasks.ceph.mgr.x.smithi176.stderr:2024-09-17T05:47:46.485+0000 7f33d9f1f640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-17T05:47:46.486 INFO:tasks.ceph.mgr.x.smithi176.stderr:2024-09-17T05:47:46.485+0000 7f33d9f1f640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-17T05:47:46.486 INFO:tasks.ceph.mgr.x.smithi176.stderr:2024-09-17T05:47:46.485+0000 7f33d9f1f640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-17T05:47:46.486 INFO:tasks.ceph.mgr.x.smithi176.stderr:2024-09-17T05:47:46.485+0000 7f33d9f1f640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-17T05:47:46.489 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume rm --force cephfs subvol_clone72832 2024-09-17T05:47:46.610 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:46.609+0000 7f5a40863640 1 -- 172.21.15.150:0/2959402741 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5a3c0c5b10 msgr2=0x7f5a3c0d0230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:47:46.610 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:46.609+0000 7f5a40863640 1 --2- 172.21.15.150:0/2959402741 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5a3c0c5b10 0x7f5a3c0d0230 secure :-1 s=READY pgs=906 cs=0 l=1 rev1=1 crypto rx=0x7f5a3c0b7960 tx=0x7f5a2c02a5d0 comp rx=0 tx=0).stop 2024-09-17T05:47:46.610 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:46.609+0000 7f5a40863640 1 -- 172.21.15.150:0/2959402741 shutdown_connections 2024-09-17T05:47:46.610 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:46.609+0000 7f5a40863640 1 --2- 172.21.15.150:0/2959402741 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5a3c0cd690 0x7f5a3c0cdaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:47:46.610 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:46.609+0000 7f5a40863640 1 --2- 172.21.15.150:0/2959402741 >> v2:172.21.15.176:3300/0 conn(0x7f5a3c0d0770 0x7f5a3c0cd150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:47:46.610 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:46.609+0000 7f5a40863640 1 --2- 172.21.15.150:0/2959402741 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5a3c0c5b10 0x7f5a3c0d0230 unknown :-1 s=CLOSED pgs=906 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:47:46.610 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:46.609+0000 7f5a40863640 1 -- 172.21.15.150:0/2959402741 >> 172.21.15.150:0/2959402741 conn(0x7f5a3c0cef00 msgr2=0x7f5a3c0cf310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:47:46.610 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:46.609+0000 7f5a40863640 1 -- 172.21.15.150:0/2959402741 shutdown_connections 2024-09-17T05:47:46.610 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:46.609+0000 7f5a40863640 1 -- 172.21.15.150:0/2959402741 wait complete. 2024-09-17T05:47:46.611 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:46.611+0000 7f5a40863640 1 Processor -- start 2024-09-17T05:47:46.611 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:46.611+0000 7f5a40863640 1 -- start start 2024-09-17T05:47:46.615 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:46.612+0000 7f5a40863640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5a3c0c5b10 0x7f5a3c1e5fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:47:46.615 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:46.612+0000 7f5a40863640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5a3c0cd690 0x7f5a3c1dc980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:47:46.615 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:46.612+0000 7f5a40863640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5a3c0d0770 0x7f5a3c1e66a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:47:46.615 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:46.612+0000 7f5a40863640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f5a3c09bde0 con 0x7f5a3c0d0770 2024-09-17T05:47:46.615 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:46.612+0000 7f5a40863640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f5a3c09bc60 con 0x7f5a3c0c5b10 2024-09-17T05:47:46.615 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:46.612+0000 7f5a40863640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f5a3c0b1c50 con 0x7f5a3c0cd690 2024-09-17T05:47:46.615 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:46.612+0000 7f5a3ad9d640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5a3c0d0770 0x7f5a3c1e66a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:47:46.615 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:46.612+0000 7f5a3ad9d640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5a3c0d0770 0x7f5a3c1e66a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:60704/0 (socket says 172.21.15.150:60704) 2024-09-17T05:47:46.615 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:46.612+0000 7f5a3ad9d640 1 -- 172.21.15.150:0/133393634 learned_addr learned my addr 172.21.15.150:0/133393634 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:47:46.615 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:46.612+0000 7f5a3a59c640 1 --2- 172.21.15.150:0/133393634 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5a3c0c5b10 0x7f5a3c1e5fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:47:46.616 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:46.612+0000 7f5a31d9b640 1 --2- 172.21.15.150:0/133393634 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5a3c0cd690 0x7f5a3c1dc980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:47:46.616 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:46.613+0000 7f5a3ad9d640 1 -- 172.21.15.150:0/133393634 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5a3c0cd690 msgr2=0x7f5a3c1dc980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:47:46.616 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:46.613+0000 7f5a3ad9d640 1 --2- 172.21.15.150:0/133393634 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5a3c0cd690 0x7f5a3c1dc980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:47:46.616 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:46.613+0000 7f5a3ad9d640 1 -- 172.21.15.150:0/133393634 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5a3c0c5b10 msgr2=0x7f5a3c1e5fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:47:46.616 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:46.613+0000 7f5a3ad9d640 1 --2- 172.21.15.150:0/133393634 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5a3c0c5b10 0x7f5a3c1e5fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:47:46.616 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:46.613+0000 7f5a3ad9d640 1 -- 172.21.15.150:0/133393634 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5a3c1ded40 con 0x7f5a3c0d0770 2024-09-17T05:47:46.616 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:46.613+0000 7f5a3a59c640 1 --2- 172.21.15.150:0/133393634 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5a3c0c5b10 0x7f5a3c1e5fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:47:46.616 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:46.613+0000 7f5a31d9b640 1 --2- 172.21.15.150:0/133393634 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5a3c0cd690 0x7f5a3c1dc980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:47:46.616 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:46.613+0000 7f5a3ad9d640 1 --2- 172.21.15.150:0/133393634 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5a3c0d0770 0x7f5a3c1e66a0 secure :-1 s=READY pgs=907 cs=0 l=1 rev1=1 crypto rx=0x7f5a3400e990 tx=0x7f5a3400ee50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:47:46.616 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:46.613+0000 7f5a337fe640 1 -- 172.21.15.150:0/133393634 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a34004d20 con 0x7f5a3c0d0770 2024-09-17T05:47:46.617 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:46.613+0000 7f5a337fe640 1 -- 172.21.15.150:0/133393634 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f5a3400caa0 con 0x7f5a3c0d0770 2024-09-17T05:47:46.617 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:46.613+0000 7f5a40863640 1 -- 172.21.15.150:0/133393634 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5a3c1df020 con 0x7f5a3c0d0770 2024-09-17T05:47:46.617 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:46.613+0000 7f5a337fe640 1 -- 172.21.15.150:0/133393634 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a34005020 con 0x7f5a3c0d0770 2024-09-17T05:47:46.617 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:46.613+0000 7f5a40863640 1 -- 172.21.15.150:0/133393634 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5a3c1e5aa0 con 0x7f5a3c0d0770 2024-09-17T05:47:46.617 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:46.614+0000 7f5a40863640 1 -- 172.21.15.150:0/133393634 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5a3c0745f0 con 0x7f5a3c0d0770 2024-09-17T05:47:46.618 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:46.615+0000 7f5a337fe640 1 -- 172.21.15.150:0/133393634 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 24) ==== 102971+0+0 (secure 0 0 0) 0x7f5a340051c0 con 0x7f5a3c0d0770 2024-09-17T05:47:46.618 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:46.615+0000 7f5a337fe640 1 --2- 172.21.15.150:0/133393634 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f5a1c079ca0 0x7f5a1c07c1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:47:46.619 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:46.616+0000 7f5a337fe640 1 -- 172.21.15.150:0/133393634 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 5881+0+0 (secure 0 0 0) 0x7f5a3409a050 con 0x7f5a3c0d0770 2024-09-17T05:47:46.619 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:46.616+0000 7f5a3a59c640 1 --2- 172.21.15.150:0/133393634 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f5a1c079ca0 0x7f5a1c07c1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:47:46.619 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:46.616+0000 7f5a3a59c640 1 --2- 172.21.15.150:0/133393634 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f5a1c079ca0 0x7f5a1c07c1b0 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f5a2c034000 tx=0x7f5a2c004730 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:47:46.620 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:46.620+0000 7f5a337fe640 1 -- 172.21.15.150:0/133393634 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f5a3c0745f0 con 0x7f5a3c0d0770 2024-09-17T05:47:46.820 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:46.820+0000 7f5a40863640 1 -- 172.21.15.150:0/133393634 --> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] -- mgr_command(tid 0: {"prefix": "fs subvolume rm", "force": true, "vol_name": "cephfs", "sub_name": "subvol_clone72832", "target": ["mon-mgr", ""]}) -- 0x7f5a3c0cdaa0 con 0x7f5a1c079ca0 2024-09-17T05:47:46.836 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:46.836+0000 7f5a337fe640 1 -- 172.21.15.150:0/133393634 <== mgr.4108 v2:172.21.15.176:6800/3631216395 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f5a3c0cdaa0 con 0x7f5a1c079ca0 2024-09-17T05:47:46.839 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:46.838+0000 7f5a40863640 1 -- 172.21.15.150:0/133393634 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f5a1c079ca0 msgr2=0x7f5a1c07c1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:47:46.839 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:46.838+0000 7f5a40863640 1 --2- 172.21.15.150:0/133393634 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f5a1c079ca0 0x7f5a1c07c1b0 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f5a2c034000 tx=0x7f5a2c004730 comp rx=0 tx=0).stop 2024-09-17T05:47:46.839 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:46.838+0000 7f5a40863640 1 -- 172.21.15.150:0/133393634 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5a3c0d0770 msgr2=0x7f5a3c1e66a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:47:46.839 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:46.838+0000 7f5a40863640 1 --2- 172.21.15.150:0/133393634 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5a3c0d0770 0x7f5a3c1e66a0 secure :-1 s=READY pgs=907 cs=0 l=1 rev1=1 crypto rx=0x7f5a3400e990 tx=0x7f5a3400ee50 comp rx=0 tx=0).stop 2024-09-17T05:47:46.840 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:46.838+0000 7f5a40863640 1 -- 172.21.15.150:0/133393634 shutdown_connections 2024-09-17T05:47:46.840 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:46.838+0000 7f5a40863640 1 --2- 172.21.15.150:0/133393634 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f5a1c079ca0 0x7f5a1c07c1b0 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:47:46.840 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:46.838+0000 7f5a40863640 1 --2- 172.21.15.150:0/133393634 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5a3c0d0770 0x7f5a3c1e66a0 unknown :-1 s=CLOSED pgs=907 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:47:46.840 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:46.838+0000 7f5a40863640 1 --2- 172.21.15.150:0/133393634 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5a3c0cd690 0x7f5a3c1dc980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:47:46.840 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:46.838+0000 7f5a40863640 1 --2- 172.21.15.150:0/133393634 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5a3c0c5b10 0x7f5a3c1e5fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:47:46.840 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:46.838+0000 7f5a40863640 1 -- 172.21.15.150:0/133393634 >> 172.21.15.150:0/133393634 conn(0x7f5a3c0cef00 msgr2=0x7f5a3c071310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:47:46.840 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:46.838+0000 7f5a40863640 1 -- 172.21.15.150:0/133393634 shutdown_connections 2024-09-17T05:47:46.840 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:46.838+0000 7f5a40863640 1 -- 172.21.15.150:0/133393634 wait complete. 2024-09-17T05:47:46.851 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume snapshot ls cephfs sv1 --format json 2024-09-17T05:47:46.973 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:46.972+0000 7f2958d69640 1 -- 172.21.15.150:0/1480289213 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2940003c10 msgr2=0x7f2940004060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:47:46.974 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:46.972+0000 7f2958d69640 1 --2- 172.21.15.150:0/1480289213 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2940003c10 0x7f2940004060 secure :-1 s=READY pgs=909 cs=0 l=1 rev1=1 crypto rx=0x7f2944009b50 tx=0x7f2940005830 comp rx=0 tx=0).stop 2024-09-17T05:47:46.974 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:46.972+0000 7f2952d9d640 1 -- 172.21.15.150:0/1480289213 reap_dead start 2024-09-17T05:47:46.974 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:46.972+0000 7f2958d69640 1 -- 172.21.15.150:0/1480289213 shutdown_connections 2024-09-17T05:47:46.974 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:46.972+0000 7f2958d69640 1 -- 172.21.15.150:0/1480289213 >> 172.21.15.150:0/1480289213 conn(0x7f29540cef30 msgr2=0x7f29540cf340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:47:46.974 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:46.972+0000 7f2958d69640 1 -- 172.21.15.150:0/1480289213 shutdown_connections 2024-09-17T05:47:46.974 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:46.972+0000 7f2958d69640 1 -- 172.21.15.150:0/1480289213 wait complete. 2024-09-17T05:47:46.976 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:46.975+0000 7f2958d69640 1 Processor -- start 2024-09-17T05:47:46.976 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:46.975+0000 7f2958d69640 1 -- start start 2024-09-17T05:47:46.978 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:46.976+0000 7f2958d69640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2940003c10 0x7f295414a610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:47:46.978 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:46.976+0000 7f2958d69640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f29541e5f20 0x7f29540b5730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:47:46.978 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:46.976+0000 7f2958d69640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f29540b5c70 0x7f295409c480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:47:46.978 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:46.976+0000 7f2958d69640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f2954070f20 con 0x7f29541e5f20 2024-09-17T05:47:46.978 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:46.976+0000 7f2958d69640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f29540d3310 con 0x7f29540b5c70 2024-09-17T05:47:46.978 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:46.976+0000 7f2958d69640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f29540b7a50 con 0x7f2940003c10 2024-09-17T05:47:46.978 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:46.976+0000 7f2949d9b640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f29541e5f20 0x7f29540b5730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:47:46.978 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:46.976+0000 7f2949d9b640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f29541e5f20 0x7f29540b5730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:60716/0 (socket says 172.21.15.150:60716) 2024-09-17T05:47:46.979 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:46.976+0000 7f2949d9b640 1 -- 172.21.15.150:0/4097029404 learned_addr learned my addr 172.21.15.150:0/4097029404 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:47:46.979 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:46.976+0000 7f295259c640 1 --2- 172.21.15.150:0/4097029404 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2940003c10 0x7f295414a610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:47:46.979 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:46.976+0000 7f2952d9d640 1 --2- 172.21.15.150:0/4097029404 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f29540b5c70 0x7f295409c480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:47:46.979 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:46.976+0000 7f2949d9b640 1 -- 172.21.15.150:0/4097029404 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2940003c10 msgr2=0x7f295414a610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:47:46.979 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:46.976+0000 7f2949d9b640 1 --2- 172.21.15.150:0/4097029404 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2940003c10 0x7f295414a610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:47:46.979 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:46.976+0000 7f2949d9b640 1 -- 172.21.15.150:0/4097029404 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f29540b5c70 msgr2=0x7f295409c480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:47:46.979 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:46.976+0000 7f2949d9b640 1 --2- 172.21.15.150:0/4097029404 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f29540b5c70 0x7f295409c480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:47:46.979 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:46.976+0000 7f2949d9b640 1 -- 172.21.15.150:0/4097029404 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f29540b6080 con 0x7f29541e5f20 2024-09-17T05:47:46.979 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:46.977+0000 7f2949d9b640 1 --2- 172.21.15.150:0/4097029404 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f29541e5f20 0x7f29540b5730 secure :-1 s=READY pgs=910 cs=0 l=1 rev1=1 crypto rx=0x7f293c006600 tx=0x7f293c0039c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:47:46.979 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:46.977+0000 7f294b7fe640 1 -- 172.21.15.150:0/4097029404 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f293c015070 con 0x7f29541e5f20 2024-09-17T05:47:46.979 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:46.977+0000 7f294b7fe640 1 -- 172.21.15.150:0/4097029404 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f293c011900 con 0x7f29541e5f20 2024-09-17T05:47:46.979 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:46.977+0000 7f2958d69640 1 -- 172.21.15.150:0/4097029404 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f29541f3780 con 0x7f29541e5f20 2024-09-17T05:47:46.979 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:46.977+0000 7f294b7fe640 1 -- 172.21.15.150:0/4097029404 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f293c011d50 con 0x7f29541e5f20 2024-09-17T05:47:46.980 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:46.977+0000 7f2958d69640 1 -- 172.21.15.150:0/4097029404 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f29541f3d20 con 0x7f29541e5f20 2024-09-17T05:47:46.980 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:46.978+0000 7f2958d69640 1 -- 172.21.15.150:0/4097029404 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f29541f46c0 con 0x7f29541e5f20 2024-09-17T05:47:46.981 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:46.979+0000 7f294b7fe640 1 -- 172.21.15.150:0/4097029404 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 24) ==== 102971+0+0 (secure 0 0 0) 0x7f293c018070 con 0x7f29541e5f20 2024-09-17T05:47:46.981 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:46.979+0000 7f294b7fe640 1 --2- 172.21.15.150:0/4097029404 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f2934079c70 0x7f293407c180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:47:46.981 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:46.980+0000 7f295259c640 1 --2- 172.21.15.150:0/4097029404 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f2934079c70 0x7f293407c180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:47:46.981 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:46.980+0000 7f294b7fe640 1 -- 172.21.15.150:0/4097029404 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 5881+0+0 (secure 0 0 0) 0x7f293c09a8c0 con 0x7f29541e5f20 2024-09-17T05:47:46.981 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:46.980+0000 7f295259c640 1 --2- 172.21.15.150:0/4097029404 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f2934079c70 0x7f293407c180 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f2944035000 tx=0x7f294402d040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:47:46.985 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:46.984+0000 7f294b7fe640 1 -- 172.21.15.150:0/4097029404 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f29541f46c0 con 0x7f29541e5f20 2024-09-17T05:47:47.192 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:47.191+0000 7f2958d69640 1 -- 172.21.15.150:0/4097029404 --> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] -- mgr_command(tid 0: {"prefix": "fs subvolume snapshot ls", "vol_name": "cephfs", "sub_name": "sv1", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f29540d0c90 con 0x7f2934079c70 2024-09-17T05:47:47.204 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:47.203+0000 7f294b7fe640 1 -- 172.21.15.150:0/4097029404 <== mgr.4108 v2:172.21.15.176:6800/3631216395 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+38 (secure 0 0 0) 0x7f29540d0c90 con 0x7f2934079c70 2024-09-17T05:47:47.204 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-09-17T05:47:47.204 INFO:teuthology.orchestra.run.smithi150.stdout:[ 2024-09-17T05:47:47.204 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-09-17T05:47:47.204 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "ss1" 2024-09-17T05:47:47.204 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-09-17T05:47:47.205 INFO:teuthology.orchestra.run.smithi150.stdout:] 2024-09-17T05:47:47.206 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:47.205+0000 7f2958d69640 1 -- 172.21.15.150:0/4097029404 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f2934079c70 msgr2=0x7f293407c180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:47:47.207 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:47.205+0000 7f2958d69640 1 --2- 172.21.15.150:0/4097029404 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f2934079c70 0x7f293407c180 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f2944035000 tx=0x7f294402d040 comp rx=0 tx=0).stop 2024-09-17T05:47:47.207 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:47.205+0000 7f2958d69640 1 -- 172.21.15.150:0/4097029404 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f29541e5f20 msgr2=0x7f29540b5730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:47:47.207 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:47.205+0000 7f2958d69640 1 --2- 172.21.15.150:0/4097029404 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f29541e5f20 0x7f29540b5730 secure :-1 s=READY pgs=910 cs=0 l=1 rev1=1 crypto rx=0x7f293c006600 tx=0x7f293c0039c0 comp rx=0 tx=0).stop 2024-09-17T05:47:47.207 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:47.205+0000 7f2958d69640 1 -- 172.21.15.150:0/4097029404 shutdown_connections 2024-09-17T05:47:47.207 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:47.205+0000 7f2958d69640 1 --2- 172.21.15.150:0/4097029404 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f29540b5c70 0x7f295409c480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:47:47.207 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:47.205+0000 7f2958d69640 1 --2- 172.21.15.150:0/4097029404 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f2934079c70 0x7f293407c180 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:47:47.207 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:47.205+0000 7f2958d69640 1 --2- 172.21.15.150:0/4097029404 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f29541e5f20 0x7f29540b5730 unknown :-1 s=CLOSED pgs=910 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:47:47.207 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:47.205+0000 7f2958d69640 1 --2- 172.21.15.150:0/4097029404 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2940003c10 0x7f295414a610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:47:47.207 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:47.205+0000 7f2958d69640 1 -- 172.21.15.150:0/4097029404 >> 172.21.15.150:0/4097029404 conn(0x7f29540cef30 msgr2=0x7f2954072240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:47:47.207 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:47.205+0000 7f2958d69640 1 -- 172.21.15.150:0/4097029404 shutdown_connections 2024-09-17T05:47:47.207 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:47.205+0000 7f2958d69640 1 -- 172.21.15.150:0/4097029404 wait complete. 2024-09-17T05:47:47.218 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume snapshot rm --force --format json cephfs sv1 ss1 2024-09-17T05:47:47.337 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:47.336+0000 7f692a094640 1 -- 172.21.15.150:0/3065235348 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f69240ce4c0 msgr2=0x7f69240ce8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:47:47.338 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:47.336+0000 7f692a094640 1 --2- 172.21.15.150:0/3065235348 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f69240ce4c0 0x7f69240ce8d0 secure :-1 s=READY pgs=911 cs=0 l=1 rev1=1 crypto rx=0x7f69240c9590 tx=0x7f691802a440 comp rx=0 tx=0).stop 2024-09-17T05:47:47.338 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:47.336+0000 7f692a094640 1 -- 172.21.15.150:0/3065235348 shutdown_connections 2024-09-17T05:47:47.338 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:47.336+0000 7f692a094640 1 --2- 172.21.15.150:0/3065235348 >> v2:172.21.15.176:3300/0 conn(0x7f69240d0980 0x7f69240d0d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:47:47.338 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:47.336+0000 7f692a094640 1 --2- 172.21.15.150:0/3065235348 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f69240ce4c0 0x7f69240ce8d0 unknown :-1 s=CLOSED pgs=911 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:47:47.338 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:47.336+0000 7f692a094640 1 --2- 172.21.15.150:0/3065235348 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f69240af160 0x7f69240af570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:47:47.338 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:47.336+0000 7f692a094640 1 -- 172.21.15.150:0/3065235348 >> 172.21.15.150:0/3065235348 conn(0x7f69240cefb0 msgr2=0x7f69240cf3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:47:47.338 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:47.336+0000 7f692a094640 1 -- 172.21.15.150:0/3065235348 shutdown_connections 2024-09-17T05:47:47.338 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:47.336+0000 7f692a094640 1 -- 172.21.15.150:0/3065235348 wait complete. 2024-09-17T05:47:47.339 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:47.338+0000 7f692a094640 1 Processor -- start 2024-09-17T05:47:47.339 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:47.338+0000 7f692a094640 1 -- start start 2024-09-17T05:47:47.342 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:47.339+0000 7f692a094640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f69240af160 0x7f69240cbb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:47:47.342 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:47.339+0000 7f692a094640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f69240ce4c0 0x7f692414d270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:47:47.342 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:47.340+0000 7f692a094640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f69240d0980 0x7f692414d7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:47:47.342 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:47.340+0000 7f692a094640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f69240d1450 con 0x7f69240ce4c0 2024-09-17T05:47:47.342 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:47.340+0000 7f692a094640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f69240d12d0 con 0x7f69240d0980 2024-09-17T05:47:47.342 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:47.340+0000 7f692a094640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f6924160cb0 con 0x7f69240af160 2024-09-17T05:47:47.342 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:47.340+0000 7f6922ffd640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f69240ce4c0 0x7f692414d270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:47:47.342 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:47.340+0000 7f6922ffd640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f69240ce4c0 0x7f692414d270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:60738/0 (socket says 172.21.15.150:60738) 2024-09-17T05:47:47.343 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:47.340+0000 7f6922ffd640 1 -- 172.21.15.150:0/2995879206 learned_addr learned my addr 172.21.15.150:0/2995879206 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:47:47.343 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:47.340+0000 7f69237fe640 1 --2- 172.21.15.150:0/2995879206 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f69240af160 0x7f69240cbb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:47:47.343 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:47.340+0000 7f6923fff640 1 --2- 172.21.15.150:0/2995879206 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f69240d0980 0x7f692414d7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:47:47.343 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:47.340+0000 7f6922ffd640 1 -- 172.21.15.150:0/2995879206 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f69240af160 msgr2=0x7f69240cbb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:47:47.343 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:47.340+0000 7f6922ffd640 1 --2- 172.21.15.150:0/2995879206 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f69240af160 0x7f69240cbb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:47:47.343 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:47.340+0000 7f6922ffd640 1 -- 172.21.15.150:0/2995879206 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f69240d0980 msgr2=0x7f692414d7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:47:47.343 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:47.340+0000 7f6922ffd640 1 --2- 172.21.15.150:0/2995879206 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f69240d0980 0x7f692414d7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:47:47.343 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:47.340+0000 7f6922ffd640 1 -- 172.21.15.150:0/2995879206 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f692414c800 con 0x7f69240ce4c0 2024-09-17T05:47:47.343 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:47.340+0000 7f6923fff640 1 --2- 172.21.15.150:0/2995879206 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f69240d0980 0x7f692414d7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:47:47.343 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:47.340+0000 7f6922ffd640 1 --2- 172.21.15.150:0/2995879206 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f69240ce4c0 0x7f692414d270 secure :-1 s=READY pgs=912 cs=0 l=1 rev1=1 crypto rx=0x7f6918034040 tx=0x7f69180038a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:47:47.343 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:47.340+0000 7f690bfff640 1 -- 172.21.15.150:0/2995879206 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f691803e030 con 0x7f69240ce4c0 2024-09-17T05:47:47.343 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:47.340+0000 7f690bfff640 1 -- 172.21.15.150:0/2995879206 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f6918003ca0 con 0x7f69240ce4c0 2024-09-17T05:47:47.343 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:47.340+0000 7f692a094640 1 -- 172.21.15.150:0/2995879206 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f692409ec30 con 0x7f69240ce4c0 2024-09-17T05:47:47.344 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:47.340+0000 7f690bfff640 1 -- 172.21.15.150:0/2995879206 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6918035040 con 0x7f69240ce4c0 2024-09-17T05:47:47.344 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:47.340+0000 7f692a094640 1 -- 172.21.15.150:0/2995879206 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f692414e2f0 con 0x7f69240ce4c0 2024-09-17T05:47:47.344 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:47.341+0000 7f692a094640 1 -- 172.21.15.150:0/2995879206 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f69240ce8d0 con 0x7f69240ce4c0 2024-09-17T05:47:47.345 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:47.342+0000 7f690bfff640 1 -- 172.21.15.150:0/2995879206 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 24) ==== 102971+0+0 (secure 0 0 0) 0x7f6918041030 con 0x7f69240ce4c0 2024-09-17T05:47:47.345 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:47.343+0000 7f690bfff640 1 --2- 172.21.15.150:0/2995879206 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f6910079c70 0x7f691007c180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:47:47.345 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:47.343+0000 7f690bfff640 1 -- 172.21.15.150:0/2995879206 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 5881+0+0 (secure 0 0 0) 0x7f69180ba170 con 0x7f69240ce4c0 2024-09-17T05:47:47.345 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:47.343+0000 7f69237fe640 1 --2- 172.21.15.150:0/2995879206 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f6910079c70 0x7f691007c180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:47:47.345 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:47.343+0000 7f69237fe640 1 --2- 172.21.15.150:0/2995879206 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f6910079c70 0x7f691007c180 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f6914009ab0 tx=0x7f6914005f90 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:47:47.347 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:47.347+0000 7f690bfff640 1 -- 172.21.15.150:0/2995879206 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f69180836d0 con 0x7f69240ce4c0 2024-09-17T05:47:47.555 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:47.554+0000 7f692a094640 1 -- 172.21.15.150:0/2995879206 --> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] -- mgr_command(tid 0: {"prefix": "fs subvolume snapshot rm", "force": true, "vol_name": "cephfs", "sub_name": "sv1", "snap_name": "ss1", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f692409e9c0 con 0x7f6910079c70 2024-09-17T05:47:47.581 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:47.580+0000 7f690bfff640 1 -- 172.21.15.150:0/2995879206 <== mgr.4108 v2:172.21.15.176:6800/3631216395 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f692409e9c0 con 0x7f6910079c70 2024-09-17T05:47:47.581 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-09-17T05:47:47.584 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:47.583+0000 7f692a094640 1 -- 172.21.15.150:0/2995879206 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f6910079c70 msgr2=0x7f691007c180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:47:47.584 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:47.583+0000 7f692a094640 1 --2- 172.21.15.150:0/2995879206 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f6910079c70 0x7f691007c180 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f6914009ab0 tx=0x7f6914005f90 comp rx=0 tx=0).stop 2024-09-17T05:47:47.584 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:47.583+0000 7f692a094640 1 -- 172.21.15.150:0/2995879206 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f69240ce4c0 msgr2=0x7f692414d270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:47:47.584 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:47.583+0000 7f692a094640 1 --2- 172.21.15.150:0/2995879206 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f69240ce4c0 0x7f692414d270 secure :-1 s=READY pgs=912 cs=0 l=1 rev1=1 crypto rx=0x7f6918034040 tx=0x7f69180038a0 comp rx=0 tx=0).stop 2024-09-17T05:47:47.584 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:47.583+0000 7f692a094640 1 -- 172.21.15.150:0/2995879206 shutdown_connections 2024-09-17T05:47:47.584 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:47.583+0000 7f692a094640 1 --2- 172.21.15.150:0/2995879206 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f69240d0980 0x7f692414d7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:47:47.584 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:47.583+0000 7f692a094640 1 --2- 172.21.15.150:0/2995879206 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f6910079c70 0x7f691007c180 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:47:47.584 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:47.583+0000 7f692a094640 1 --2- 172.21.15.150:0/2995879206 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f69240ce4c0 0x7f692414d270 unknown :-1 s=CLOSED pgs=912 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:47:47.585 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:47.583+0000 7f692a094640 1 --2- 172.21.15.150:0/2995879206 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f69240af160 0x7f69240cbb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:47:47.585 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:47.583+0000 7f692a094640 1 -- 172.21.15.150:0/2995879206 >> 172.21.15.150:0/2995879206 conn(0x7f69240cefb0 msgr2=0x7f69240afb00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:47:47.585 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:47.583+0000 7f692a094640 1 -- 172.21.15.150:0/2995879206 shutdown_connections 2024-09-17T05:47:47.585 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:47.583+0000 7f692a094640 1 -- 172.21.15.150:0/2995879206 wait complete. 2024-09-17T05:47:47.596 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume rm cephfs sv1 2024-09-17T05:47:47.714 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:47.713+0000 7fd6d054a640 1 -- 172.21.15.150:0/2259640848 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd6b4003a00 msgr2=0x7fd6b4003e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:47:47.714 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:47.713+0000 7fd6d054a640 1 --2- 172.21.15.150:0/2259640848 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd6b4003a00 0x7fd6b4003e30 secure :-1 s=READY pgs=914 cs=0 l=1 rev1=1 crypto rx=0x7fd6c400c290 tx=0x7fd6b4005830 comp rx=0 tx=0).stop 2024-09-17T05:47:47.714 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:47.713+0000 7fd6d054a640 1 -- 172.21.15.150:0/2259640848 shutdown_connections 2024-09-17T05:47:47.714 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:47.713+0000 7fd6d054a640 1 --2- 172.21.15.150:0/2259640848 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd6b4003a00 0x7fd6b4003e30 unknown :-1 s=CLOSED pgs=914 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:47:47.714 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:47.713+0000 7fd6d054a640 1 -- 172.21.15.150:0/2259640848 >> 172.21.15.150:0/2259640848 conn(0x7fd6c80b2ff0 msgr2=0x7fd6c80b3400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:47:47.714 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:47.713+0000 7fd6d054a640 1 -- 172.21.15.150:0/2259640848 shutdown_connections 2024-09-17T05:47:47.714 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:47.713+0000 7fd6d054a640 1 -- 172.21.15.150:0/2259640848 wait complete. 2024-09-17T05:47:47.715 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:47.715+0000 7fd6d054a640 1 Processor -- start 2024-09-17T05:47:47.715 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:47.715+0000 7fd6d054a640 1 -- start start 2024-09-17T05:47:47.718 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:47.716+0000 7fd6d054a640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd6b4003a00 0x7fd6c815b460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:47:47.718 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:47.716+0000 7fd6d054a640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd6c80c9c80 0x7fd6c81586f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:47:47.718 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:47.716+0000 7fd6d054a640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd6c8158c30 0x7fd6c814d600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:47:47.718 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:47.716+0000 7fd6d054a640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7fd6c815e0a0 con 0x7fd6c8158c30 2024-09-17T05:47:47.719 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:47.716+0000 7fd6d054a640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fd6c815df20 con 0x7fd6c80c9c80 2024-09-17T05:47:47.719 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:47.716+0000 7fd6d054a640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fd6c81592e0 con 0x7fd6b4003a00 2024-09-17T05:47:47.719 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:47.716+0000 7fd6ceae7640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd6c8158c30 0x7fd6c814d600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:47:47.719 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:47.716+0000 7fd6ceae7640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd6c8158c30 0x7fd6c814d600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:60760/0 (socket says 172.21.15.150:60760) 2024-09-17T05:47:47.719 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:47.716+0000 7fd6ceae7640 1 -- 172.21.15.150:0/1306476629 learned_addr learned my addr 172.21.15.150:0/1306476629 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:47:47.719 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:47.716+0000 7fd6cdae5640 1 --2- 172.21.15.150:0/1306476629 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd6c80c9c80 0x7fd6c81586f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:47:47.719 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:47.716+0000 7fd6ce2e6640 1 --2- 172.21.15.150:0/1306476629 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd6b4003a00 0x7fd6c815b460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:47:47.719 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:47.716+0000 7fd6ceae7640 1 -- 172.21.15.150:0/1306476629 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd6b4003a00 msgr2=0x7fd6c815b460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:47:47.720 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:47.716+0000 7fd6ceae7640 1 --2- 172.21.15.150:0/1306476629 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd6b4003a00 0x7fd6c815b460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:47:47.720 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:47.716+0000 7fd6ceae7640 1 -- 172.21.15.150:0/1306476629 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd6c80c9c80 msgr2=0x7fd6c81586f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:47:47.720 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:47.716+0000 7fd6ceae7640 1 --2- 172.21.15.150:0/1306476629 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd6c80c9c80 0x7fd6c81586f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:47:47.720 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:47.716+0000 7fd6ceae7640 1 -- 172.21.15.150:0/1306476629 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd6c815b9a0 con 0x7fd6c8158c30 2024-09-17T05:47:47.720 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:47.716+0000 7fd6ceae7640 1 --2- 172.21.15.150:0/1306476629 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd6c8158c30 0x7fd6c814d600 secure :-1 s=READY pgs=915 cs=0 l=1 rev1=1 crypto rx=0x7fd6c80700e0 tx=0x7fd6c000f790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:47:47.720 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:47.717+0000 7fd6beffd640 1 -- 172.21.15.150:0/1306476629 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6c0003d80 con 0x7fd6c8158c30 2024-09-17T05:47:47.720 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:47.717+0000 7fd6beffd640 1 -- 172.21.15.150:0/1306476629 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd6c0004b20 con 0x7fd6c8158c30 2024-09-17T05:47:47.720 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:47.717+0000 7fd6d054a640 1 -- 172.21.15.150:0/1306476629 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd6c815a9a0 con 0x7fd6c8158c30 2024-09-17T05:47:47.720 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:47.717+0000 7fd6beffd640 1 -- 172.21.15.150:0/1306476629 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6c0004030 con 0x7fd6c8158c30 2024-09-17T05:47:47.720 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:47.717+0000 7fd6d054a640 1 -- 172.21.15.150:0/1306476629 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd6c81f3fe0 con 0x7fd6c8158c30 2024-09-17T05:47:47.720 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:47.718+0000 7fd6d054a640 1 -- 172.21.15.150:0/1306476629 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd6c815cf90 con 0x7fd6c8158c30 2024-09-17T05:47:47.721 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:47.718+0000 7fd6beffd640 1 -- 172.21.15.150:0/1306476629 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 24) ==== 102971+0+0 (secure 0 0 0) 0x7fd6c00041d0 con 0x7fd6c8158c30 2024-09-17T05:47:47.721 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:47.719+0000 7fd6beffd640 1 --2- 172.21.15.150:0/1306476629 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fd6ac079ca0 0x7fd6ac07c1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:47:47.721 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:47.719+0000 7fd6beffd640 1 -- 172.21.15.150:0/1306476629 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 5881+0+0 (secure 0 0 0) 0x7fd6c009a970 con 0x7fd6c8158c30 2024-09-17T05:47:47.721 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:47.719+0000 7fd6ce2e6640 1 --2- 172.21.15.150:0/1306476629 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fd6ac079ca0 0x7fd6ac07c1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:47:47.722 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:47.720+0000 7fd6ce2e6640 1 --2- 172.21.15.150:0/1306476629 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fd6ac079ca0 0x7fd6ac07c1b0 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7fd6c4033000 tx=0x7fd6c4038040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:47:47.724 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:47.723+0000 7fd6beffd640 1 -- 172.21.15.150:0/1306476629 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fd6c0063ed0 con 0x7fd6c8158c30 2024-09-17T05:47:47.925 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:47.924+0000 7fd6d054a640 1 -- 172.21.15.150:0/1306476629 --> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] -- mgr_command(tid 0: {"prefix": "fs subvolume rm", "vol_name": "cephfs", "sub_name": "sv1", "target": ["mon-mgr", ""]}) -- 0x7fd6c81f3d70 con 0x7fd6ac079ca0 2024-09-17T05:47:47.927 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:47.927+0000 7fd6beffd640 1 -- 172.21.15.150:0/1306476629 <== mon.0 v2:172.21.15.150:3300/0 7 ==== mgrmap(e 25) ==== 103022+0+0 (secure 0 0 0) 0x7fd6c0060140 con 0x7fd6c8158c30 2024-09-17T05:47:47.946 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:47.946+0000 7fd6beffd640 1 -- 172.21.15.150:0/1306476629 <== mgr.4108 v2:172.21.15.176:6800/3631216395 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7fd6c81f3d70 con 0x7fd6ac079ca0 2024-09-17T05:47:47.949 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:47.948+0000 7fd6d054a640 1 -- 172.21.15.150:0/1306476629 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fd6ac079ca0 msgr2=0x7fd6ac07c1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:47:47.949 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:47.948+0000 7fd6d054a640 1 --2- 172.21.15.150:0/1306476629 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fd6ac079ca0 0x7fd6ac07c1b0 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7fd6c4033000 tx=0x7fd6c4038040 comp rx=0 tx=0).stop 2024-09-17T05:47:47.950 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:47.948+0000 7fd6d054a640 1 -- 172.21.15.150:0/1306476629 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd6c8158c30 msgr2=0x7fd6c814d600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:47:47.950 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:47.948+0000 7fd6d054a640 1 --2- 172.21.15.150:0/1306476629 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd6c8158c30 0x7fd6c814d600 secure :-1 s=READY pgs=915 cs=0 l=1 rev1=1 crypto rx=0x7fd6c80700e0 tx=0x7fd6c000f790 comp rx=0 tx=0).stop 2024-09-17T05:47:47.950 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:47.948+0000 7fd6d054a640 1 -- 172.21.15.150:0/1306476629 shutdown_connections 2024-09-17T05:47:47.950 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:47.948+0000 7fd6d054a640 1 --2- 172.21.15.150:0/1306476629 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd6c80c9c80 0x7fd6c81586f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:47:47.950 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:47.948+0000 7fd6d054a640 1 --2- 172.21.15.150:0/1306476629 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fd6ac079ca0 0x7fd6ac07c1b0 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:47:47.950 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:47.948+0000 7fd6d054a640 1 --2- 172.21.15.150:0/1306476629 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd6c8158c30 0x7fd6c814d600 unknown :-1 s=CLOSED pgs=915 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:47:47.950 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:47.948+0000 7fd6d054a640 1 --2- 172.21.15.150:0/1306476629 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd6b4003a00 0x7fd6c815b460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:47:47.950 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:47.948+0000 7fd6d054a640 1 -- 172.21.15.150:0/1306476629 >> 172.21.15.150:0/1306476629 conn(0x7fd6c80b2ff0 msgr2=0x7fd6c80cd5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:47:47.950 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:47.949+0000 7fd6d054a640 1 -- 172.21.15.150:0/1306476629 shutdown_connections 2024-09-17T05:47:47.950 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:47.949+0000 7fd6d054a640 1 -- 172.21.15.150:0/1306476629 wait complete. 2024-09-17T05:47:47.964 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume rm --force cephfs subvol_clone37686 2024-09-17T05:47:48.088 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:48.087+0000 7fbfacb71640 1 -- 172.21.15.150:0/717958131 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbfa80ae6e0 msgr2=0x7fbfa806d2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:47:48.088 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:48.087+0000 7fbfacb71640 1 --2- 172.21.15.150:0/717958131 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbfa80ae6e0 0x7fbfa806d2e0 secure :-1 s=READY pgs=916 cs=0 l=1 rev1=1 crypto rx=0x7fbfa8073850 tx=0x7fbfa002aa30 comp rx=0 tx=0).stop 2024-09-17T05:47:48.088 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:48.087+0000 7fbfacb71640 1 -- 172.21.15.150:0/717958131 shutdown_connections 2024-09-17T05:47:48.088 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:48.087+0000 7fbfacb71640 1 --2- 172.21.15.150:0/717958131 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbfa80ae6e0 0x7fbfa806d2e0 unknown :-1 s=CLOSED pgs=916 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:47:48.088 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:48.087+0000 7fbfacb71640 1 --2- 172.21.15.150:0/717958131 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fbfa80ae2d0 0x7fbfa806cda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:47:48.088 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:48.087+0000 7fbfacb71640 1 --2- 172.21.15.150:0/717958131 >> v2:172.21.15.176:3300/0 conn(0x7fbfa815ca70 0x7fbfa815d8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:47:48.088 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:48.087+0000 7fbfacb71640 1 -- 172.21.15.150:0/717958131 >> 172.21.15.150:0/717958131 conn(0x7fbfa809aa50 msgr2=0x7fbfa80b2ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:47:48.089 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:48.087+0000 7fbfacb71640 1 -- 172.21.15.150:0/717958131 shutdown_connections 2024-09-17T05:47:48.089 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:48.087+0000 7fbfacb71640 1 -- 172.21.15.150:0/717958131 wait complete. 2024-09-17T05:47:48.089 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:48.089+0000 7fbfacb71640 1 Processor -- start 2024-09-17T05:47:48.089 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:48.089+0000 7fbfacb71640 1 -- start start 2024-09-17T05:47:48.092 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:48.090+0000 7fbfacb71640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fbfa80ae2d0 0x7fbfa81f7450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:47:48.092 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:48.090+0000 7fbfacb71640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbfa80ae6e0 0x7fbfa80cca90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:47:48.092 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:48.090+0000 7fbfacb71640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fbfa815ca70 0x7fbfa80b2110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:47:48.092 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:48.090+0000 7fbfacb71640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7fbfa815e260 con 0x7fbfa80ae6e0 2024-09-17T05:47:48.092 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:48.090+0000 7fbfacb71640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fbfa815e0e0 con 0x7fbfa80ae2d0 2024-09-17T05:47:48.092 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:48.090+0000 7fbfacb71640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fbfa815e3e0 con 0x7fbfa815ca70 2024-09-17T05:47:48.093 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:48.090+0000 7fbfa5d9b640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbfa80ae6e0 0x7fbfa80cca90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:47:48.093 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:48.090+0000 7fbfa5d9b640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbfa80ae6e0 0x7fbfa80cca90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:60788/0 (socket says 172.21.15.150:60788) 2024-09-17T05:47:48.093 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:48.090+0000 7fbfa5d9b640 1 -- 172.21.15.150:0/2927378726 learned_addr learned my addr 172.21.15.150:0/2927378726 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:47:48.093 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:48.090+0000 7fbfa659c640 1 --2- 172.21.15.150:0/2927378726 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fbfa80ae2d0 0x7fbfa81f7450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:47:48.093 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:48.090+0000 7fbfa6d9d640 1 --2- 172.21.15.150:0/2927378726 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fbfa815ca70 0x7fbfa80b2110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:47:48.093 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:48.091+0000 7fbfa5d9b640 1 -- 172.21.15.150:0/2927378726 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fbfa815ca70 msgr2=0x7fbfa80b2110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:47:48.093 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:48.091+0000 7fbfa5d9b640 1 --2- 172.21.15.150:0/2927378726 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fbfa815ca70 0x7fbfa80b2110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:47:48.093 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:48.091+0000 7fbfa5d9b640 1 -- 172.21.15.150:0/2927378726 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fbfa80ae2d0 msgr2=0x7fbfa81f7450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:47:48.093 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:48.091+0000 7fbfa5d9b640 1 --2- 172.21.15.150:0/2927378726 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fbfa80ae2d0 0x7fbfa81f7450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:47:48.094 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:48.091+0000 7fbfa5d9b640 1 -- 172.21.15.150:0/2927378726 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbfa81f4220 con 0x7fbfa80ae6e0 2024-09-17T05:47:48.094 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:48.091+0000 7fbfa5d9b640 1 --2- 172.21.15.150:0/2927378726 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbfa80ae6e0 0x7fbfa80cca90 secure :-1 s=READY pgs=917 cs=0 l=1 rev1=1 crypto rx=0x7fbf9c00d650 tx=0x7fbf9c00db10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:47:48.094 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:48.091+0000 7fbf96ffd640 1 -- 172.21.15.150:0/2927378726 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf9c017070 con 0x7fbfa80ae6e0 2024-09-17T05:47:48.094 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:48.091+0000 7fbfacb71640 1 -- 172.21.15.150:0/2927378726 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbfa81f3460 con 0x7fbfa80ae6e0 2024-09-17T05:47:48.094 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:48.091+0000 7fbf96ffd640 1 -- 172.21.15.150:0/2927378726 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fbf9c005310 con 0x7fbfa80ae6e0 2024-09-17T05:47:48.094 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:48.091+0000 7fbf96ffd640 1 -- 172.21.15.150:0/2927378726 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf9c009820 con 0x7fbfa80ae6e0 2024-09-17T05:47:48.095 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:48.091+0000 7fbfacb71640 1 -- 172.21.15.150:0/2927378726 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbfa81f3a20 con 0x7fbfa80ae6e0 2024-09-17T05:47:48.095 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:48.092+0000 7fbfacb71640 1 -- 172.21.15.150:0/2927378726 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbfa815e8e0 con 0x7fbfa80ae6e0 2024-09-17T05:47:48.096 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:48.093+0000 7fbf96ffd640 1 -- 172.21.15.150:0/2927378726 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 25) ==== 103022+0+0 (secure 0 0 0) 0x7fbf9c0099c0 con 0x7fbfa80ae6e0 2024-09-17T05:47:48.096 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:48.093+0000 7fbf96ffd640 1 --2- 172.21.15.150:0/2927378726 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fbf88079d00 0x7fbf8807c210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:47:48.096 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:48.094+0000 7fbf96ffd640 1 -- 172.21.15.150:0/2927378726 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 5881+0+0 (secure 0 0 0) 0x7fbf9c099b80 con 0x7fbfa80ae6e0 2024-09-17T05:47:48.096 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:48.094+0000 7fbfa659c640 1 --2- 172.21.15.150:0/2927378726 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fbf88079d00 0x7fbf8807c210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:47:48.096 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:48.094+0000 7fbfa659c640 1 --2- 172.21.15.150:0/2927378726 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fbf88079d00 0x7fbf8807c210 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7fbfa80af860 tx=0x7fbf9800b2e0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:47:48.098 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:48.098+0000 7fbf96ffd640 1 -- 172.21.15.150:0/2927378726 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fbf9c0630e0 con 0x7fbfa80ae6e0 2024-09-17T05:47:48.359 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:48.358+0000 7fbfacb71640 1 -- 172.21.15.150:0/2927378726 --> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] -- mgr_command(tid 0: {"prefix": "fs subvolume rm", "force": true, "vol_name": "cephfs", "sub_name": "subvol_clone37686", "target": ["mon-mgr", ""]}) -- 0x7fbfa815b7b0 con 0x7fbf88079d00 2024-09-17T05:47:49.252 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:49.251+0000 7fbf96ffd640 1 -- 172.21.15.150:0/2927378726 <== mgr.4108 v2:172.21.15.176:6800/3631216395 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7fbfa815b7b0 con 0x7fbf88079d00 2024-09-17T05:47:49.255 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:49.254+0000 7fbfacb71640 1 -- 172.21.15.150:0/2927378726 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fbf88079d00 msgr2=0x7fbf8807c210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:47:49.255 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:49.254+0000 7fbfacb71640 1 --2- 172.21.15.150:0/2927378726 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fbf88079d00 0x7fbf8807c210 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7fbfa80af860 tx=0x7fbf9800b2e0 comp rx=0 tx=0).stop 2024-09-17T05:47:49.255 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:49.254+0000 7fbfacb71640 1 -- 172.21.15.150:0/2927378726 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbfa80ae6e0 msgr2=0x7fbfa80cca90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:47:49.255 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:49.254+0000 7fbfacb71640 1 --2- 172.21.15.150:0/2927378726 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbfa80ae6e0 0x7fbfa80cca90 secure :-1 s=READY pgs=917 cs=0 l=1 rev1=1 crypto rx=0x7fbf9c00d650 tx=0x7fbf9c00db10 comp rx=0 tx=0).stop 2024-09-17T05:47:49.255 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:49.254+0000 7fbfacb71640 1 -- 172.21.15.150:0/2927378726 shutdown_connections 2024-09-17T05:47:49.255 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:49.254+0000 7fbfacb71640 1 --2- 172.21.15.150:0/2927378726 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fbf88079d00 0x7fbf8807c210 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:47:49.255 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:49.254+0000 7fbfacb71640 1 --2- 172.21.15.150:0/2927378726 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fbfa815ca70 0x7fbfa80b2110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:47:49.255 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:49.254+0000 7fbfacb71640 1 --2- 172.21.15.150:0/2927378726 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbfa80ae6e0 0x7fbfa80cca90 unknown :-1 s=CLOSED pgs=917 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:47:49.255 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:49.254+0000 7fbfacb71640 1 --2- 172.21.15.150:0/2927378726 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fbfa80ae2d0 0x7fbfa81f7450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:47:49.255 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:49.254+0000 7fbfacb71640 1 -- 172.21.15.150:0/2927378726 >> 172.21.15.150:0/2927378726 conn(0x7fbfa809aa50 msgr2=0x7fbfa80ce010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:47:49.255 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:49.254+0000 7fbfacb71640 1 -- 172.21.15.150:0/2927378726 shutdown_connections 2024-09-17T05:47:49.256 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:49.254+0000 7fbfacb71640 1 -- 172.21.15.150:0/2927378726 wait complete. 2024-09-17T05:47:49.267 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume rm --force cephfs subvol_clone62874 2024-09-17T05:47:49.387 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:49.386+0000 7f9b4107e640 1 -- 172.21.15.150:0/12963938 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9b3c15d190 msgr2=0x7f9b3c15d5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:47:49.388 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:49.386+0000 7f9b4107e640 1 --2- 172.21.15.150:0/12963938 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9b3c15d190 0x7f9b3c15d5a0 secure :-1 s=READY pgs=919 cs=0 l=1 rev1=1 crypto rx=0x7f9b34005fd0 tx=0x7f9b3402aa10 comp rx=0 tx=0).stop 2024-09-17T05:47:49.388 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:49.387+0000 7f9b4107e640 1 -- 172.21.15.150:0/12963938 shutdown_connections 2024-09-17T05:47:49.388 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:49.387+0000 7f9b4107e640 1 --2- 172.21.15.150:0/12963938 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9b3c15d190 0x7f9b3c15d5a0 unknown :-1 s=CLOSED pgs=919 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:47:49.388 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:49.387+0000 7f9b4107e640 1 -- 172.21.15.150:0/12963938 >> 172.21.15.150:0/12963938 conn(0x7f9b3c09aa50 msgr2=0x7f9b3c0b2ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:47:49.388 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:49.387+0000 7f9b4107e640 1 -- 172.21.15.150:0/12963938 shutdown_connections 2024-09-17T05:47:49.388 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:49.387+0000 7f9b4107e640 1 -- 172.21.15.150:0/12963938 wait complete. 2024-09-17T05:47:49.389 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:49.389+0000 7f9b4107e640 1 Processor -- start 2024-09-17T05:47:49.389 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:49.389+0000 7f9b4107e640 1 -- start start 2024-09-17T05:47:49.392 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:49.390+0000 7f9b4107e640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9b3c0af8a0 0x7f9b3c14e6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:47:49.392 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:49.390+0000 7f9b4107e640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9b3c0b4a00 0x7f9b3c14ec10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:47:49.392 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:49.390+0000 7f9b4107e640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9b3c15d190 0x7f9b3c0b0320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:47:49.392 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:49.390+0000 7f9b4107e640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f9b3c166d10 con 0x7f9b3c0af8a0 2024-09-17T05:47:49.392 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:49.390+0000 7f9b4107e640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f9b3c0b00b0 con 0x7f9b3c15d190 2024-09-17T05:47:49.392 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:49.390+0000 7f9b4107e640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f9b3c166e90 con 0x7f9b3c0b4a00 2024-09-17T05:47:49.392 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:49.390+0000 7f9b3ad9d640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9b3c0af8a0 0x7f9b3c14e6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:47:49.392 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:49.390+0000 7f9b3ad9d640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9b3c0af8a0 0x7f9b3c14e6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:60796/0 (socket says 172.21.15.150:60796) 2024-09-17T05:47:49.392 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:49.390+0000 7f9b3ad9d640 1 -- 172.21.15.150:0/4232544078 learned_addr learned my addr 172.21.15.150:0/4232544078 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:47:49.393 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:49.390+0000 7f9b3b59e640 1 --2- 172.21.15.150:0/4232544078 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9b3c15d190 0x7f9b3c0b0320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:47:49.393 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:49.390+0000 7f9b3a59c640 1 --2- 172.21.15.150:0/4232544078 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9b3c0b4a00 0x7f9b3c14ec10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:47:49.393 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:49.390+0000 7f9b3ad9d640 1 -- 172.21.15.150:0/4232544078 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9b3c0b4a00 msgr2=0x7f9b3c14ec10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:47:49.393 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:49.390+0000 7f9b3ad9d640 1 --2- 172.21.15.150:0/4232544078 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9b3c0b4a00 0x7f9b3c14ec10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:47:49.393 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:49.390+0000 7f9b3ad9d640 1 -- 172.21.15.150:0/4232544078 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9b3c15d190 msgr2=0x7f9b3c0b0320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:47:49.393 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:49.390+0000 7f9b3ad9d640 1 --2- 172.21.15.150:0/4232544078 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9b3c15d190 0x7f9b3c0b0320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:47:49.393 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:49.390+0000 7f9b3ad9d640 1 -- 172.21.15.150:0/4232544078 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9b3c14ac40 con 0x7f9b3c0af8a0 2024-09-17T05:47:49.393 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:49.391+0000 7f9b3ad9d640 1 --2- 172.21.15.150:0/4232544078 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9b3c0af8a0 0x7f9b3c14e6d0 secure :-1 s=READY pgs=920 cs=0 l=1 rev1=1 crypto rx=0x7f9b34000f80 tx=0x7f9b34003f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:47:49.393 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:49.391+0000 7f9b337fe640 1 -- 172.21.15.150:0/4232544078 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b34033050 con 0x7f9b3c0af8a0 2024-09-17T05:47:49.393 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:49.391+0000 7f9b337fe640 1 -- 172.21.15.150:0/4232544078 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9b340045d0 con 0x7f9b3c0af8a0 2024-09-17T05:47:49.393 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:49.391+0000 7f9b337fe640 1 -- 172.21.15.150:0/4232544078 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b34038450 con 0x7f9b3c0af8a0 2024-09-17T05:47:49.393 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:49.391+0000 7f9b4107e640 1 -- 172.21.15.150:0/4232544078 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9b3c14af20 con 0x7f9b3c0af8a0 2024-09-17T05:47:49.393 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:49.391+0000 7f9b4107e640 1 -- 172.21.15.150:0/4232544078 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9b3c14b4e0 con 0x7f9b3c0af8a0 2024-09-17T05:47:49.394 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:49.392+0000 7f9b4107e640 1 -- 172.21.15.150:0/4232544078 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9b3c15d5a0 con 0x7f9b3c0af8a0 2024-09-17T05:47:49.394 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:49.393+0000 7f9b337fe640 1 -- 172.21.15.150:0/4232544078 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 25) ==== 103022+0+0 (secure 0 0 0) 0x7f9b34036070 con 0x7f9b3c0af8a0 2024-09-17T05:47:49.394 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:49.393+0000 7f9b337fe640 1 --2- 172.21.15.150:0/4232544078 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f9b1c079d00 0x7f9b1c07c210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:47:49.395 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:49.393+0000 7f9b337fe640 1 -- 172.21.15.150:0/4232544078 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 5881+0+0 (secure 0 0 0) 0x7f9b340baf50 con 0x7f9b3c0af8a0 2024-09-17T05:47:49.395 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:49.393+0000 7f9b3a59c640 1 --2- 172.21.15.150:0/4232544078 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f9b1c079d00 0x7f9b1c07c210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:47:49.395 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:49.394+0000 7f9b3a59c640 1 --2- 172.21.15.150:0/4232544078 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f9b1c079d00 0x7f9b1c07c210 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f9b3c09f830 tx=0x7f9b24009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:47:49.398 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:49.398+0000 7f9b337fe640 1 -- 172.21.15.150:0/4232544078 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f9b34084530 con 0x7f9b3c0af8a0 2024-09-17T05:47:49.604 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:49.603+0000 7f9b4107e640 1 -- 172.21.15.150:0/4232544078 --> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] -- mgr_command(tid 0: {"prefix": "fs subvolume rm", "force": true, "vol_name": "cephfs", "sub_name": "subvol_clone62874", "target": ["mon-mgr", ""]}) -- 0x7f9b3c0b2440 con 0x7f9b1c079d00 2024-09-17T05:47:49.634 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:49.632+0000 7f9b337fe640 1 -- 172.21.15.150:0/4232544078 <== mgr.4108 v2:172.21.15.176:6800/3631216395 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f9b3c0b2440 con 0x7f9b1c079d00 2024-09-17T05:47:49.637 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:49.637+0000 7f9b4107e640 1 -- 172.21.15.150:0/4232544078 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f9b1c079d00 msgr2=0x7f9b1c07c210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:47:49.637 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:49.637+0000 7f9b4107e640 1 --2- 172.21.15.150:0/4232544078 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f9b1c079d00 0x7f9b1c07c210 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f9b3c09f830 tx=0x7f9b24009040 comp rx=0 tx=0).stop 2024-09-17T05:47:49.637 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:49.637+0000 7f9b4107e640 1 -- 172.21.15.150:0/4232544078 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9b3c0af8a0 msgr2=0x7f9b3c14e6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:47:49.637 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:49.637+0000 7f9b4107e640 1 --2- 172.21.15.150:0/4232544078 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9b3c0af8a0 0x7f9b3c14e6d0 secure :-1 s=READY pgs=920 cs=0 l=1 rev1=1 crypto rx=0x7f9b34000f80 tx=0x7f9b34003f90 comp rx=0 tx=0).stop 2024-09-17T05:47:49.638 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:49.637+0000 7f9b4107e640 1 -- 172.21.15.150:0/4232544078 shutdown_connections 2024-09-17T05:47:49.638 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:49.637+0000 7f9b4107e640 1 --2- 172.21.15.150:0/4232544078 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9b3c15d190 0x7f9b3c0b0320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:47:49.638 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:49.637+0000 7f9b4107e640 1 --2- 172.21.15.150:0/4232544078 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f9b1c079d00 0x7f9b1c07c210 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:47:49.638 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:49.637+0000 7f9b4107e640 1 --2- 172.21.15.150:0/4232544078 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9b3c0b4a00 0x7f9b3c14ec10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:47:49.638 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:49.637+0000 7f9b4107e640 1 --2- 172.21.15.150:0/4232544078 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9b3c0af8a0 0x7f9b3c14e6d0 unknown :-1 s=CLOSED pgs=920 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:47:49.639 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:49.637+0000 7f9b4107e640 1 -- 172.21.15.150:0/4232544078 >> 172.21.15.150:0/4232544078 conn(0x7f9b3c09aa50 msgr2=0x7f9b3c15e2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:47:49.640 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:49.639+0000 7f9b4107e640 1 -- 172.21.15.150:0/4232544078 shutdown_connections 2024-09-17T05:47:49.641 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:49.640+0000 7f9b4107e640 1 -- 172.21.15.150:0/4232544078 wait complete. 2024-09-17T05:47:49.662 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume rm --force cephfs subvol_clone51670 2024-09-17T05:47:49.850 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:49.849+0000 7fa594339640 1 -- 172.21.15.150:0/2570393399 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa58c0b6c20 msgr2=0x7fa58c06d180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:47:49.850 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:49.849+0000 7fa594339640 1 --2- 172.21.15.150:0/2570393399 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa58c0b6c20 0x7fa58c06d180 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7fa584005fd0 tx=0x7fa58402a830 comp rx=0 tx=0).stop 2024-09-17T05:47:49.851 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:49.849+0000 7fa594339640 1 -- 172.21.15.150:0/2570393399 shutdown_connections 2024-09-17T05:47:49.851 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:49.849+0000 7fa594339640 1 --2- 172.21.15.150:0/2570393399 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa58c0b6c20 0x7fa58c06d180 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:47:49.851 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:49.849+0000 7fa594339640 1 --2- 172.21.15.150:0/2570393399 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa58c15a570 0x7fa58c15e3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:47:49.851 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:49.849+0000 7fa594339640 1 -- 172.21.15.150:0/2570393399 >> 172.21.15.150:0/2570393399 conn(0x7fa58c0b6810 msgr2=0x7fa58c0b2ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:47:49.851 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:49.849+0000 7fa594339640 1 -- 172.21.15.150:0/2570393399 shutdown_connections 2024-09-17T05:47:49.851 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:49.849+0000 7fa594339640 1 -- 172.21.15.150:0/2570393399 wait complete. 2024-09-17T05:47:49.853 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:49.852+0000 7fa594339640 1 Processor -- start 2024-09-17T05:47:49.853 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:49.852+0000 7fa594339640 1 -- start start 2024-09-17T05:47:49.855 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:49.854+0000 7fa594339640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa58c0b3700 0x7fa58c159440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:47:49.856 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:49.855+0000 7fa5920d5640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa58c0b3700 0x7fa58c159440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:47:49.856 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:49.855+0000 7fa5920d5640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa58c0b3700 0x7fa58c159440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:60810/0 (socket says 172.21.15.150:60810) 2024-09-17T05:47:49.856 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:49.855+0000 7fa5920d5640 1 -- 172.21.15.150:0/2378817147 learned_addr learned my addr 172.21.15.150:0/2378817147 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:47:49.856 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:49.855+0000 7fa594339640 1 --2- 172.21.15.150:0/2378817147 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa58c0b6c20 0x7fa58c1f8dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:47:49.856 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:49.855+0000 7fa594339640 1 --2- 172.21.15.150:0/2378817147 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa58c15a570 0x7fa58c1f9300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:47:49.856 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:49.855+0000 7fa594339640 1 -- 172.21.15.150:0/2378817147 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7fa58c06d6c0 con 0x7fa58c0b3700 2024-09-17T05:47:49.856 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:49.855+0000 7fa594339640 1 -- 172.21.15.150:0/2378817147 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fa58c0b0630 con 0x7fa58c15a570 2024-09-17T05:47:49.856 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:49.855+0000 7fa594339640 1 -- 172.21.15.150:0/2378817147 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fa58c06d840 con 0x7fa58c0b6c20 2024-09-17T05:47:49.857 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:49.856+0000 7fa5920d5640 1 -- 172.21.15.150:0/2378817147 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa58c0b6c20 msgr2=0x7fa58c1f8dc0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-17T05:47:49.857 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:49.856+0000 7fa5920d5640 1 --2- 172.21.15.150:0/2378817147 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa58c0b6c20 0x7fa58c1f8dc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:47:49.857 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:49.856+0000 7fa5920d5640 1 -- 172.21.15.150:0/2378817147 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa58c15a570 msgr2=0x7fa58c1f9300 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-17T05:47:49.857 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:49.856+0000 7fa5920d5640 1 --2- 172.21.15.150:0/2378817147 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa58c15a570 0x7fa58c1f9300 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:47:49.857 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:49.856+0000 7fa5920d5640 1 -- 172.21.15.150:0/2378817147 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa58c159980 con 0x7fa58c0b3700 2024-09-17T05:47:49.857 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:49.856+0000 7fa5920d5640 1 --2- 172.21.15.150:0/2378817147 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa58c0b3700 0x7fa58c159440 secure :-1 s=READY pgs=922 cs=0 l=1 rev1=1 crypto rx=0x7fa58800ea20 tx=0x7fa58800eee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:47:49.857 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:49.856+0000 7fa582ffd640 1 -- 172.21.15.150:0/2378817147 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa58800cbd0 con 0x7fa58c0b3700 2024-09-17T05:47:49.857 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:49.856+0000 7fa582ffd640 1 -- 172.21.15.150:0/2378817147 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa58800ce60 con 0x7fa58c0b3700 2024-09-17T05:47:49.858 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:49.856+0000 7fa582ffd640 1 -- 172.21.15.150:0/2378817147 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa588010690 con 0x7fa58c0b3700 2024-09-17T05:47:49.858 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:49.856+0000 7fa594339640 1 -- 172.21.15.150:0/2378817147 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa58c0d0b90 con 0x7fa58c0b3700 2024-09-17T05:47:49.858 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:49.858+0000 7fa594339640 1 -- 172.21.15.150:0/2378817147 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa58c0d1150 con 0x7fa58c0b3700 2024-09-17T05:47:49.860 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:49.860+0000 7fa594339640 1 -- 172.21.15.150:0/2378817147 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa58c160180 con 0x7fa58c0b3700 2024-09-17T05:47:49.860 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:49.860+0000 7fa582ffd640 1 -- 172.21.15.150:0/2378817147 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 25) ==== 103022+0+0 (secure 0 0 0) 0x7fa588010830 con 0x7fa58c0b3700 2024-09-17T05:47:49.861 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:49.860+0000 7fa582ffd640 1 --2- 172.21.15.150:0/2378817147 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fa570079d50 0x7fa57007c260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:47:49.861 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:49.860+0000 7fa582ffd640 1 -- 172.21.15.150:0/2378817147 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 5881+0+0 (secure 0 0 0) 0x7fa58809a690 con 0x7fa58c0b3700 2024-09-17T05:47:49.861 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:49.861+0000 7fa5918d4640 1 --2- 172.21.15.150:0/2378817147 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fa570079d50 0x7fa57007c260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:47:49.865 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:49.864+0000 7fa5918d4640 1 --2- 172.21.15.150:0/2378817147 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fa570079d50 0x7fa57007c260 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7fa58c13e780 tx=0x7fa57c001130 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:47:49.869 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:49.869+0000 7fa582ffd640 1 -- 172.21.15.150:0/2378817147 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fa58c160180 con 0x7fa58c0b3700 2024-09-17T05:47:50.098 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:50.098+0000 7fa594339640 1 -- 172.21.15.150:0/2378817147 --> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] -- mgr_command(tid 0: {"prefix": "fs subvolume rm", "force": true, "vol_name": "cephfs", "sub_name": "subvol_clone51670", "target": ["mon-mgr", ""]}) -- 0x7fa58c0af8f0 con 0x7fa570079d50 2024-09-17T05:47:50.118 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:50.117+0000 7fa582ffd640 1 -- 172.21.15.150:0/2378817147 <== mgr.4108 v2:172.21.15.176:6800/3631216395 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7fa58c0af8f0 con 0x7fa570079d50 2024-09-17T05:47:50.121 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:50.120+0000 7fa594339640 1 -- 172.21.15.150:0/2378817147 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fa570079d50 msgr2=0x7fa57007c260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:47:50.121 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:50.120+0000 7fa594339640 1 --2- 172.21.15.150:0/2378817147 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fa570079d50 0x7fa57007c260 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7fa58c13e780 tx=0x7fa57c001130 comp rx=0 tx=0).stop 2024-09-17T05:47:50.121 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:50.120+0000 7fa594339640 1 -- 172.21.15.150:0/2378817147 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa58c0b3700 msgr2=0x7fa58c159440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:47:50.121 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:50.120+0000 7fa594339640 1 --2- 172.21.15.150:0/2378817147 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa58c0b3700 0x7fa58c159440 secure :-1 s=READY pgs=922 cs=0 l=1 rev1=1 crypto rx=0x7fa58800ea20 tx=0x7fa58800eee0 comp rx=0 tx=0).stop 2024-09-17T05:47:50.121 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:50.120+0000 7fa594339640 1 -- 172.21.15.150:0/2378817147 shutdown_connections 2024-09-17T05:47:50.121 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:50.120+0000 7fa594339640 1 --2- 172.21.15.150:0/2378817147 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa58c15a570 0x7fa58c1f9300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:47:50.121 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:50.120+0000 7fa594339640 1 --2- 172.21.15.150:0/2378817147 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fa570079d50 0x7fa57007c260 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:47:50.121 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:50.120+0000 7fa594339640 1 --2- 172.21.15.150:0/2378817147 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa58c0b6c20 0x7fa58c1f8dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:47:50.121 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:50.120+0000 7fa594339640 1 --2- 172.21.15.150:0/2378817147 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa58c0b3700 0x7fa58c159440 unknown :-1 s=CLOSED pgs=922 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:47:50.121 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:50.120+0000 7fa594339640 1 -- 172.21.15.150:0/2378817147 >> 172.21.15.150:0/2378817147 conn(0x7fa58c0b6810 msgr2=0x7fa58c145ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:47:50.121 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:50.120+0000 7fa594339640 1 -- 172.21.15.150:0/2378817147 shutdown_connections 2024-09-17T05:47:50.121 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:50.120+0000 7fa594339640 1 -- 172.21.15.150:0/2378817147 wait complete. 2024-09-17T05:47:50.133 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume rm --force cephfs subvol_clone43985 2024-09-17T05:47:50.253 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:50.252+0000 7f9f68c27640 1 -- 172.21.15.150:0/371076705 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9f640cc7d0 msgr2=0x7f9f640b3120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:47:50.253 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:50.252+0000 7f9f68c27640 1 --2- 172.21.15.150:0/371076705 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9f640cc7d0 0x7f9f640b3120 secure :-1 s=READY pgs=923 cs=0 l=1 rev1=1 crypto rx=0x7f9f6406dee0 tx=0x7f9f5402a9a0 comp rx=0 tx=0).stop 2024-09-17T05:47:50.256 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:50.252+0000 7f9f68c27640 1 -- 172.21.15.150:0/371076705 shutdown_connections 2024-09-17T05:47:50.256 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:50.252+0000 7f9f68c27640 1 --2- 172.21.15.150:0/371076705 >> v2:172.21.15.176:3300/0 conn(0x7f9f640b36f0 0x7f9f640cb930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:47:50.256 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:50.252+0000 7f9f68c27640 1 --2- 172.21.15.150:0/371076705 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9f640cc7d0 0x7f9f640b3120 unknown :-1 s=CLOSED pgs=923 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:47:50.256 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:50.252+0000 7f9f68c27640 1 -- 172.21.15.150:0/371076705 >> 172.21.15.150:0/371076705 conn(0x7f9f640b2540 msgr2=0x7f9f640d02d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:47:50.256 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:50.252+0000 7f9f68c27640 1 -- 172.21.15.150:0/371076705 shutdown_connections 2024-09-17T05:47:50.256 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:50.252+0000 7f9f68c27640 1 -- 172.21.15.150:0/371076705 wait complete. 2024-09-17T05:47:50.259 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:50.254+0000 7f9f68c27640 1 Processor -- start 2024-09-17T05:47:50.259 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:50.254+0000 7f9f68c27640 1 -- start start 2024-09-17T05:47:50.259 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:50.255+0000 7f9f68c27640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9f640b36f0 0x7f9f6415e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:47:50.260 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:50.255+0000 7f9f68c27640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9f640cc7d0 0x7f9f641f3930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:47:50.261 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:50.255+0000 7f9f68c27640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9f6415ba50 0x7f9f641f5d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:47:50.261 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:50.255+0000 7f9f68c27640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f9f6406f8a0 con 0x7f9f640b36f0 2024-09-17T05:47:50.261 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:50.255+0000 7f9f68c27640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f9f6406f720 con 0x7f9f640cc7d0 2024-09-17T05:47:50.262 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:50.255+0000 7f9f68c27640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f9f6406fa20 con 0x7f9f6415ba50 2024-09-17T05:47:50.262 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:50.255+0000 7f9f6259c640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9f640b36f0 0x7f9f6415e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:47:50.262 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:50.255+0000 7f9f6259c640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9f640b36f0 0x7f9f6415e9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:43052/0 (socket says 172.21.15.150:43052) 2024-09-17T05:47:50.262 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:50.255+0000 7f9f6259c640 1 -- 172.21.15.150:0/897062145 learned_addr learned my addr 172.21.15.150:0/897062145 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:47:50.262 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:50.255+0000 7f9f61d9b640 1 --2- 172.21.15.150:0/897062145 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9f640cc7d0 0x7f9f641f3930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:47:50.262 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:50.255+0000 7f9f62d9d640 1 --2- 172.21.15.150:0/897062145 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9f6415ba50 0x7f9f641f5d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:47:50.262 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:50.256+0000 7f9f6259c640 1 -- 172.21.15.150:0/897062145 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9f6415ba50 msgr2=0x7f9f641f5d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:47:50.262 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:50.256+0000 7f9f6259c640 1 --2- 172.21.15.150:0/897062145 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9f6415ba50 0x7f9f641f5d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:47:50.262 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:50.256+0000 7f9f6259c640 1 -- 172.21.15.150:0/897062145 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9f640cc7d0 msgr2=0x7f9f641f3930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:47:50.263 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:50.256+0000 7f9f6259c640 1 --2- 172.21.15.150:0/897062145 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9f640cc7d0 0x7f9f641f3930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:47:50.263 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:50.256+0000 7f9f6259c640 1 -- 172.21.15.150:0/897062145 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9f6415d4e0 con 0x7f9f640b36f0 2024-09-17T05:47:50.264 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:50.256+0000 7f9f6259c640 1 --2- 172.21.15.150:0/897062145 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9f640b36f0 0x7f9f6415e9f0 secure :-1 s=READY pgs=924 cs=0 l=1 rev1=1 crypto rx=0x7f9f54009d60 tx=0x7f9f54003f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:47:50.264 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:50.256+0000 7f9f52ffd640 1 -- 172.21.15.150:0/897062145 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f54033050 con 0x7f9f640b36f0 2024-09-17T05:47:50.264 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:50.256+0000 7f9f52ffd640 1 -- 172.21.15.150:0/897062145 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9f540044d0 con 0x7f9f640b36f0 2024-09-17T05:47:50.264 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:50.256+0000 7f9f68c27640 1 -- 172.21.15.150:0/897062145 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9f6415d950 con 0x7f9f640b36f0 2024-09-17T05:47:50.264 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:50.256+0000 7f9f52ffd640 1 -- 172.21.15.150:0/897062145 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f54038450 con 0x7f9f640b36f0 2024-09-17T05:47:50.264 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:50.256+0000 7f9f68c27640 1 -- 172.21.15.150:0/897062145 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9f6415df10 con 0x7f9f640b36f0 2024-09-17T05:47:50.264 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:50.257+0000 7f9f68c27640 1 -- 172.21.15.150:0/897062145 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9f6406ff10 con 0x7f9f640b36f0 2024-09-17T05:47:50.264 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:50.258+0000 7f9f52ffd640 1 -- 172.21.15.150:0/897062145 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 25) ==== 103022+0+0 (secure 0 0 0) 0x7f9f54036070 con 0x7f9f640b36f0 2024-09-17T05:47:50.264 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:50.258+0000 7f9f52ffd640 1 --2- 172.21.15.150:0/897062145 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f9f44079d30 0x7f9f4407c240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:47:50.264 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:50.259+0000 7f9f52ffd640 1 -- 172.21.15.150:0/897062145 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 5881+0+0 (secure 0 0 0) 0x7f9f540bad60 con 0x7f9f640b36f0 2024-09-17T05:47:50.264 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:50.259+0000 7f9f61d9b640 1 --2- 172.21.15.150:0/897062145 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f9f44079d30 0x7f9f4407c240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:47:50.265 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:50.259+0000 7f9f61d9b640 1 --2- 172.21.15.150:0/897062145 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f9f44079d30 0x7f9f4407c240 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f9f6415b260 tx=0x7f9f58009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:47:50.265 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:50.263+0000 7f9f52ffd640 1 -- 172.21.15.150:0/897062145 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f9f54084340 con 0x7f9f640b36f0 2024-09-17T05:47:50.467 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:50.467+0000 7f9f68c27640 1 -- 172.21.15.150:0/897062145 --> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] -- mgr_command(tid 0: {"prefix": "fs subvolume rm", "force": true, "vol_name": "cephfs", "sub_name": "subvol_clone43985", "target": ["mon-mgr", ""]}) -- 0x7f9f640af0f0 con 0x7f9f44079d30 2024-09-17T05:47:50.482 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:50.482+0000 7f9f52ffd640 1 -- 172.21.15.150:0/897062145 <== mgr.4108 v2:172.21.15.176:6800/3631216395 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f9f640af0f0 con 0x7f9f44079d30 2024-09-17T05:47:50.485 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:50.484+0000 7f9f68c27640 1 -- 172.21.15.150:0/897062145 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f9f44079d30 msgr2=0x7f9f4407c240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:47:50.485 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:50.484+0000 7f9f68c27640 1 --2- 172.21.15.150:0/897062145 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f9f44079d30 0x7f9f4407c240 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f9f6415b260 tx=0x7f9f58009040 comp rx=0 tx=0).stop 2024-09-17T05:47:50.485 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:50.484+0000 7f9f68c27640 1 -- 172.21.15.150:0/897062145 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9f640b36f0 msgr2=0x7f9f6415e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:47:50.485 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:50.484+0000 7f9f68c27640 1 --2- 172.21.15.150:0/897062145 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9f640b36f0 0x7f9f6415e9f0 secure :-1 s=READY pgs=924 cs=0 l=1 rev1=1 crypto rx=0x7f9f54009d60 tx=0x7f9f54003f90 comp rx=0 tx=0).stop 2024-09-17T05:47:50.485 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:50.484+0000 7f9f68c27640 1 -- 172.21.15.150:0/897062145 shutdown_connections 2024-09-17T05:47:50.485 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:50.484+0000 7f9f68c27640 1 --2- 172.21.15.150:0/897062145 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9f640cc7d0 0x7f9f641f3930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:47:50.486 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:50.484+0000 7f9f68c27640 1 --2- 172.21.15.150:0/897062145 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f9f44079d30 0x7f9f4407c240 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:47:50.486 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:50.484+0000 7f9f68c27640 1 --2- 172.21.15.150:0/897062145 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9f6415ba50 0x7f9f641f5d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:47:50.486 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:50.484+0000 7f9f68c27640 1 --2- 172.21.15.150:0/897062145 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9f640b36f0 0x7f9f6415e9f0 unknown :-1 s=CLOSED pgs=924 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:47:50.486 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:50.484+0000 7f9f68c27640 1 -- 172.21.15.150:0/897062145 >> 172.21.15.150:0/897062145 conn(0x7f9f640b2540 msgr2=0x7f9f64073170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:47:50.486 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:50.484+0000 7f9f68c27640 1 -- 172.21.15.150:0/897062145 shutdown_connections 2024-09-17T05:47:50.486 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:50.484+0000 7f9f68c27640 1 -- 172.21.15.150:0/897062145 wait complete. 2024-09-17T05:47:50.500 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume rm --force cephfs subvol_clone19001 2024-09-17T05:47:50.620 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:50.619+0000 7fae7f3da640 1 -- 172.21.15.150:0/3249506438 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fae780c5b10 msgr2=0x7fae780d0230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:47:50.621 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:50.619+0000 7fae7f3da640 1 --2- 172.21.15.150:0/3249506438 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fae780c5b10 0x7fae780d0230 secure :-1 s=READY pgs=926 cs=0 l=1 rev1=1 crypto rx=0x7fae74009820 tx=0x7fae7402a5a0 comp rx=0 tx=0).stop 2024-09-17T05:47:50.621 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:50.619+0000 7fae7f3da640 1 -- 172.21.15.150:0/3249506438 shutdown_connections 2024-09-17T05:47:50.621 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:50.619+0000 7fae7f3da640 1 --2- 172.21.15.150:0/3249506438 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fae780d0770 0x7fae780cd150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:47:50.621 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:50.619+0000 7fae7f3da640 1 --2- 172.21.15.150:0/3249506438 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fae780c5b10 0x7fae780d0230 unknown :-1 s=CLOSED pgs=926 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:47:50.621 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:50.619+0000 7fae7f3da640 1 -- 172.21.15.150:0/3249506438 >> 172.21.15.150:0/3249506438 conn(0x7fae780cef00 msgr2=0x7fae780cf310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:47:50.622 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:50.619+0000 7fae7f3da640 1 -- 172.21.15.150:0/3249506438 shutdown_connections 2024-09-17T05:47:50.622 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:50.619+0000 7fae7f3da640 1 -- 172.21.15.150:0/3249506438 wait complete. 2024-09-17T05:47:50.627 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:50.621+0000 7fae7f3da640 1 Processor -- start 2024-09-17T05:47:50.627 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:50.621+0000 7fae7f3da640 1 -- start start 2024-09-17T05:47:50.627 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:50.622+0000 7fae7f3da640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fae780c5b10 0x7fae781599a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:47:50.627 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:50.622+0000 7fae7f3da640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fae780cd690 0x7fae7814b820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:47:50.627 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:50.622+0000 7fae7f3da640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fae780d0770 0x7fae7815f970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:47:50.627 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:50.622+0000 7fae7f3da640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7fae780b2de0 con 0x7fae780c5b10 2024-09-17T05:47:50.627 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:50.622+0000 7fae7f3da640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fae780b2c60 con 0x7fae780d0770 2024-09-17T05:47:50.627 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:50.622+0000 7fae7f3da640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fae780b2f60 con 0x7fae780cd690 2024-09-17T05:47:50.627 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:50.622+0000 7fae7d176640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fae780c5b10 0x7fae781599a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:47:50.628 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:50.622+0000 7fae7d176640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fae780c5b10 0x7fae781599a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:43078/0 (socket says 172.21.15.150:43078) 2024-09-17T05:47:50.628 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:50.622+0000 7fae7d176640 1 -- 172.21.15.150:0/1606674735 learned_addr learned my addr 172.21.15.150:0/1606674735 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:47:50.628 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:50.622+0000 7fae7c975640 1 --2- 172.21.15.150:0/1606674735 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fae780cd690 0x7fae7814b820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:47:50.628 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:50.622+0000 7fae7d977640 1 --2- 172.21.15.150:0/1606674735 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fae780d0770 0x7fae7815f970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:47:50.628 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:50.622+0000 7fae7d176640 1 -- 172.21.15.150:0/1606674735 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fae780cd690 msgr2=0x7fae7814b820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:47:50.628 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:50.622+0000 7fae7d176640 1 --2- 172.21.15.150:0/1606674735 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fae780cd690 0x7fae7814b820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:47:50.628 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:50.622+0000 7fae7d176640 1 -- 172.21.15.150:0/1606674735 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fae780d0770 msgr2=0x7fae7815f970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:47:50.628 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:50.622+0000 7fae7d176640 1 --2- 172.21.15.150:0/1606674735 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fae780d0770 0x7fae7815f970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:47:50.628 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:50.623+0000 7fae7d176640 1 -- 172.21.15.150:0/1606674735 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fae7815a1f0 con 0x7fae780c5b10 2024-09-17T05:47:50.628 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:50.623+0000 7fae7d176640 1 --2- 172.21.15.150:0/1606674735 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fae780c5b10 0x7fae781599a0 secure :-1 s=READY pgs=927 cs=0 l=1 rev1=1 crypto rx=0x7fae74000c00 tx=0x7fae74005360 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:47:50.628 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:50.623+0000 7fae6dffb640 1 -- 172.21.15.150:0/1606674735 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae7403f070 con 0x7fae780c5b10 2024-09-17T05:47:50.628 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:50.623+0000 7fae6dffb640 1 -- 172.21.15.150:0/1606674735 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fae74004340 con 0x7fae780c5b10 2024-09-17T05:47:50.628 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:50.623+0000 7fae7f3da640 1 -- 172.21.15.150:0/1606674735 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fae7815a4d0 con 0x7fae780c5b10 2024-09-17T05:47:50.628 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:50.623+0000 7fae6dffb640 1 -- 172.21.15.150:0/1606674735 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae74031bb0 con 0x7fae780c5b10 2024-09-17T05:47:50.629 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:50.623+0000 7fae7f3da640 1 -- 172.21.15.150:0/1606674735 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fae7815aa90 con 0x7fae780c5b10 2024-09-17T05:47:50.629 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:50.624+0000 7fae7f3da640 1 -- 172.21.15.150:0/1606674735 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fae7815acd0 con 0x7fae780c5b10 2024-09-17T05:47:50.629 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:50.625+0000 7fae6dffb640 1 -- 172.21.15.150:0/1606674735 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 25) ==== 103022+0+0 (secure 0 0 0) 0x7fae74042070 con 0x7fae780c5b10 2024-09-17T05:47:50.629 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:50.625+0000 7fae6dffb640 1 --2- 172.21.15.150:0/1606674735 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fae5c079d00 0x7fae5c07c210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:47:50.629 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:50.626+0000 7fae6dffb640 1 -- 172.21.15.150:0/1606674735 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 5881+0+0 (secure 0 0 0) 0x7fae740ba850 con 0x7fae780c5b10 2024-09-17T05:47:50.629 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:50.626+0000 7fae7c975640 1 --2- 172.21.15.150:0/1606674735 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fae5c079d00 0x7fae5c07c210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:47:50.629 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:50.626+0000 7fae7c975640 1 --2- 172.21.15.150:0/1606674735 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fae5c079d00 0x7fae5c07c210 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7fae780cc6c0 tx=0x7fae68009060 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:47:50.631 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:50.630+0000 7fae6dffb640 1 -- 172.21.15.150:0/1606674735 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fae7815acd0 con 0x7fae780c5b10 2024-09-17T05:47:50.836 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:50.835+0000 7fae7f3da640 1 -- 172.21.15.150:0/1606674735 --> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] -- mgr_command(tid 0: {"prefix": "fs subvolume rm", "force": true, "vol_name": "cephfs", "sub_name": "subvol_clone19001", "target": ["mon-mgr", ""]}) -- 0x7fae780d0230 con 0x7fae5c079d00 2024-09-17T05:47:50.856 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:50.855+0000 7fae6dffb640 1 -- 172.21.15.150:0/1606674735 <== mgr.4108 v2:172.21.15.176:6800/3631216395 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7fae780d0230 con 0x7fae5c079d00 2024-09-17T05:47:50.859 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:50.858+0000 7fae7f3da640 1 -- 172.21.15.150:0/1606674735 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fae5c079d00 msgr2=0x7fae5c07c210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:47:50.859 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:50.858+0000 7fae7f3da640 1 --2- 172.21.15.150:0/1606674735 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fae5c079d00 0x7fae5c07c210 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7fae780cc6c0 tx=0x7fae68009060 comp rx=0 tx=0).stop 2024-09-17T05:47:50.859 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:50.858+0000 7fae7f3da640 1 -- 172.21.15.150:0/1606674735 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fae780c5b10 msgr2=0x7fae781599a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:47:50.859 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:50.858+0000 7fae7f3da640 1 --2- 172.21.15.150:0/1606674735 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fae780c5b10 0x7fae781599a0 secure :-1 s=READY pgs=927 cs=0 l=1 rev1=1 crypto rx=0x7fae74000c00 tx=0x7fae74005360 comp rx=0 tx=0).stop 2024-09-17T05:47:50.859 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:50.858+0000 7fae7f3da640 1 -- 172.21.15.150:0/1606674735 shutdown_connections 2024-09-17T05:47:50.859 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:50.858+0000 7fae7f3da640 1 --2- 172.21.15.150:0/1606674735 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fae780d0770 0x7fae7815f970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:47:50.859 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:50.858+0000 7fae7f3da640 1 --2- 172.21.15.150:0/1606674735 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fae5c079d00 0x7fae5c07c210 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:47:50.859 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:50.858+0000 7fae7f3da640 1 --2- 172.21.15.150:0/1606674735 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fae780cd690 0x7fae7814b820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:47:50.859 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:50.858+0000 7fae7f3da640 1 --2- 172.21.15.150:0/1606674735 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fae780c5b10 0x7fae781599a0 unknown :-1 s=CLOSED pgs=927 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:47:50.859 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:50.858+0000 7fae7f3da640 1 -- 172.21.15.150:0/1606674735 >> 172.21.15.150:0/1606674735 conn(0x7fae780cef00 msgr2=0x7fae780b35c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:47:50.859 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:50.858+0000 7fae7f3da640 1 -- 172.21.15.150:0/1606674735 shutdown_connections 2024-09-17T05:47:50.860 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:50.858+0000 7fae7f3da640 1 -- 172.21.15.150:0/1606674735 wait complete. 2024-09-17T05:47:50.874 DEBUG:teuthology.orchestra.run.smithi150:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'stat -c %h /home/ubuntu/cephtest/mnt.0/./volumes/_deleting') 2024-09-17T05:47:50.925 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:50 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-17T05:47:50.930 INFO:teuthology.orchestra.run.smithi150.stdout:2 2024-09-17T05:47:50.930 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:50 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T05:47:50.936 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mgr mgr/volumes/max_concurrent_clones 4 2024-09-17T05:47:51.054 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:51.053+0000 7ff23780a640 1 -- 172.21.15.150:0/2899266343 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff2300af3c0 msgr2=0x7ff2300b1ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:47:51.054 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:51.053+0000 7ff23780a640 1 --2- 172.21.15.150:0/2899266343 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff2300af3c0 0x7ff2300b1ec0 secure :-1 s=READY pgs=929 cs=0 l=1 rev1=1 crypto rx=0x7ff228005fd0 tx=0x7ff22802a820 comp rx=0 tx=0).stop 2024-09-17T05:47:51.054 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:51.053+0000 7ff23780a640 1 -- 172.21.15.150:0/2899266343 shutdown_connections 2024-09-17T05:47:51.054 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:51.053+0000 7ff23780a640 1 --2- 172.21.15.150:0/2899266343 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff2300af3c0 0x7ff2300b1ec0 unknown :-1 s=CLOSED pgs=929 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:47:51.054 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:51.053+0000 7ff23780a640 1 -- 172.21.15.150:0/2899266343 >> 172.21.15.150:0/2899266343 conn(0x7ff2300b2ff0 msgr2=0x7ff2300b3400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:47:51.054 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:51.053+0000 7ff23780a640 1 -- 172.21.15.150:0/2899266343 shutdown_connections 2024-09-17T05:47:51.054 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:51.053+0000 7ff23780a640 1 -- 172.21.15.150:0/2899266343 wait complete. 2024-09-17T05:47:51.055 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:51.055+0000 7ff23780a640 1 Processor -- start 2024-09-17T05:47:51.055 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:51.055+0000 7ff23780a640 1 -- start start 2024-09-17T05:47:51.058 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:51.056+0000 7ff23780a640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff2300af3c0 0x7ff230161050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:47:51.058 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:51.056+0000 7ff23780a640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff2300b16f0 0x7ff230161590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:47:51.058 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:51.056+0000 7ff23780a640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff2300b25e0 0x7ff2301f39a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:47:51.058 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:51.056+0000 7ff23780a640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7ff230166cf0 con 0x7ff2300af3c0 2024-09-17T05:47:51.058 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:51.056+0000 7ff23780a640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7ff2300d0260 con 0x7ff2300b16f0 2024-09-17T05:47:51.058 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:51.056+0000 7ff23780a640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7ff230166e70 con 0x7ff2300b25e0 2024-09-17T05:47:51.058 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:51.056+0000 7ff2355a6640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff2300af3c0 0x7ff230161050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:47:51.058 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:51.056+0000 7ff2355a6640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff2300af3c0 0x7ff230161050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:43100/0 (socket says 172.21.15.150:43100) 2024-09-17T05:47:51.058 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:51.056+0000 7ff2355a6640 1 -- 172.21.15.150:0/2072138654 learned_addr learned my addr 172.21.15.150:0/2072138654 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:47:51.059 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:51.056+0000 7ff2355a6640 1 -- 172.21.15.150:0/2072138654 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff2300b25e0 msgr2=0x7ff2301f39a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:47:51.059 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:51.056+0000 7ff235da7640 1 --2- 172.21.15.150:0/2072138654 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff2300b25e0 0x7ff2301f39a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:47:51.059 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:51.056+0000 7ff234da5640 1 --2- 172.21.15.150:0/2072138654 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff2300b16f0 0x7ff230161590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:47:51.059 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:51.056+0000 7ff2355a6640 1 --2- 172.21.15.150:0/2072138654 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff2300b25e0 0x7ff2301f39a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:47:51.059 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:51.056+0000 7ff2355a6640 1 -- 172.21.15.150:0/2072138654 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff2300b16f0 msgr2=0x7ff230161590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:47:51.059 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:51.056+0000 7ff2355a6640 1 --2- 172.21.15.150:0/2072138654 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff2300b16f0 0x7ff230161590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:47:51.059 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:51.056+0000 7ff2355a6640 1 -- 172.21.15.150:0/2072138654 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff230145a80 con 0x7ff2300af3c0 2024-09-17T05:47:51.059 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:51.056+0000 7ff235da7640 1 --2- 172.21.15.150:0/2072138654 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff2300b25e0 0x7ff2301f39a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T05:47:51.059 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:51.056+0000 7ff234da5640 1 --2- 172.21.15.150:0/2072138654 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff2300b16f0 0x7ff230161590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T05:47:51.059 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:51.057+0000 7ff2355a6640 1 --2- 172.21.15.150:0/2072138654 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff2300af3c0 0x7ff230161050 secure :-1 s=READY pgs=930 cs=0 l=1 rev1=1 crypto rx=0x7ff22c00c400 tx=0x7ff22c00c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:47:51.059 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:51.057+0000 7ff225ffb640 1 -- 172.21.15.150:0/2072138654 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff22c017070 con 0x7ff2300af3c0 2024-09-17T05:47:51.059 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:51.057+0000 7ff225ffb640 1 -- 172.21.15.150:0/2072138654 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff22c0053c0 con 0x7ff2300af3c0 2024-09-17T05:47:51.059 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:51.057+0000 7ff23780a640 1 -- 172.21.15.150:0/2072138654 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff230145d40 con 0x7ff2300af3c0 2024-09-17T05:47:51.060 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:51.057+0000 7ff225ffb640 1 -- 172.21.15.150:0/2072138654 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff22c003850 con 0x7ff2300af3c0 2024-09-17T05:47:51.060 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:51.057+0000 7ff23780a640 1 -- 172.21.15.150:0/2072138654 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff230146300 con 0x7ff2300af3c0 2024-09-17T05:47:51.060 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:51.058+0000 7ff23780a640 1 -- 172.21.15.150:0/2072138654 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff2300b1ec0 con 0x7ff2300af3c0 2024-09-17T05:47:51.061 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:51.059+0000 7ff225ffb640 1 -- 172.21.15.150:0/2072138654 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 25) ==== 103022+0+0 (secure 0 0 0) 0x7ff22c01a070 con 0x7ff2300af3c0 2024-09-17T05:47:51.061 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:51.059+0000 7ff225ffb640 1 --2- 172.21.15.150:0/2072138654 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7ff214079d30 0x7ff21407c240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:47:51.061 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:51.060+0000 7ff225ffb640 1 -- 172.21.15.150:0/2072138654 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 5881+0+0 (secure 0 0 0) 0x7ff22c098f70 con 0x7ff2300af3c0 2024-09-17T05:47:51.061 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:51.060+0000 7ff234da5640 1 --2- 172.21.15.150:0/2072138654 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7ff214079d30 0x7ff21407c240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:47:51.061 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:51.060+0000 7ff234da5640 1 --2- 172.21.15.150:0/2072138654 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7ff214079d30 0x7ff21407c240 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7ff230159010 tx=0x7ff220009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:47:51.064 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:51.064+0000 7ff225ffb640 1 -- 172.21.15.150:0/2072138654 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7ff22c062ba0 con 0x7ff2300af3c0 2024-09-17T05:47:51.244 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:51.244+0000 7ff23780a640 1 -- 172.21.15.150:0/2072138654 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command([{prefix=config set, name=mgr/volumes/max_concurrent_clones}] v 0) -- 0x7ff2300b6940 con 0x7ff2300af3c0 2024-09-17T05:47:51.245 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:51.244+0000 7ff225ffb640 1 -- 172.21.15.150:0/2072138654 <== mon.0 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/volumes/max_concurrent_clones}]=0 v43)=0 v43) ==== 131+0+0 (secure 0 0 0) 0x7ff22c0624a0 con 0x7ff2300af3c0 2024-09-17T05:47:51.247 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:51.246+0000 7ff23780a640 1 -- 172.21.15.150:0/2072138654 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7ff214079d30 msgr2=0x7ff21407c240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:47:51.247 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:51.246+0000 7ff23780a640 1 --2- 172.21.15.150:0/2072138654 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7ff214079d30 0x7ff21407c240 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7ff230159010 tx=0x7ff220009040 comp rx=0 tx=0).stop 2024-09-17T05:47:51.247 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:51.246+0000 7ff23780a640 1 -- 172.21.15.150:0/2072138654 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff2300af3c0 msgr2=0x7ff230161050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:47:51.247 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:51.246+0000 7ff23780a640 1 --2- 172.21.15.150:0/2072138654 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff2300af3c0 0x7ff230161050 secure :-1 s=READY pgs=930 cs=0 l=1 rev1=1 crypto rx=0x7ff22c00c400 tx=0x7ff22c00c8c0 comp rx=0 tx=0).stop 2024-09-17T05:47:51.247 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:51.246+0000 7ff23780a640 1 -- 172.21.15.150:0/2072138654 shutdown_connections 2024-09-17T05:47:51.248 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:51.246+0000 7ff23780a640 1 --2- 172.21.15.150:0/2072138654 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff2300b16f0 0x7ff230161590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:47:51.248 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:51.246+0000 7ff23780a640 1 --2- 172.21.15.150:0/2072138654 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7ff214079d30 0x7ff21407c240 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:47:51.248 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:51.246+0000 7ff23780a640 1 --2- 172.21.15.150:0/2072138654 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff2300b25e0 0x7ff2301f39a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:47:51.248 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:51.246+0000 7ff23780a640 1 --2- 172.21.15.150:0/2072138654 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff2300af3c0 0x7ff230161050 unknown :-1 s=CLOSED pgs=930 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:47:51.248 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:51.246+0000 7ff23780a640 1 -- 172.21.15.150:0/2072138654 >> 172.21.15.150:0/2072138654 conn(0x7ff2300b2ff0 msgr2=0x7ff230070870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:47:51.248 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:51.246+0000 7ff23780a640 1 -- 172.21.15.150:0/2072138654 shutdown_connections 2024-09-17T05:47:51.248 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:51.246+0000 7ff23780a640 1 -- 172.21.15.150:0/2072138654 wait complete. 2024-09-17T05:47:51.258 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-17T05:47:51.259 DEBUG:teuthology.orchestra.run.smithi150:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-17T05:47:51.299 DEBUG:teuthology.orchestra.run.smithi176:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-17T05:47:51.343 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-17T05:47:51.343 INFO:tasks.cephfs.mount:Terminating background process 2024-09-17T05:47:51.343 DEBUG:teuthology.orchestra.run.smithi150:> set -ex 2024-09-17T05:47:51.343 DEBUG:teuthology.orchestra.run.smithi150:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T05:47:51.359 DEBUG:teuthology.orchestra.run.smithi150:> set -ex 2024-09-17T05:47:51.359 DEBUG:teuthology.orchestra.run.smithi150:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T05:47:51.415 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-17T05:47:51.570 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:51.569+0000 7fddb3a38640 1 -- 172.21.15.150:0/2200014936 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fddac156130 msgr2=0x7fddac0d0cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:47:51.571 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:51.569+0000 7fddb3a38640 1 --2- 172.21.15.150:0/2200014936 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fddac156130 0x7fddac0d0cd0 secure :-1 s=READY pgs=932 cs=0 l=1 rev1=1 crypto rx=0x7fddac073a30 tx=0x7fdda802a5f0 comp rx=0 tx=0).stop 2024-09-17T05:47:51.571 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:51.569+0000 7fddb3a38640 1 -- 172.21.15.150:0/2200014936 shutdown_connections 2024-09-17T05:47:51.571 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:51.569+0000 7fddb3a38640 1 --2- 172.21.15.150:0/2200014936 >> v2:172.21.15.176:3300/0 conn(0x7fddac0cec30 0x7fddac165580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:47:51.571 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:51.569+0000 7fddb3a38640 1 --2- 172.21.15.150:0/2200014936 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fddac156130 0x7fddac0d0cd0 unknown :-1 s=CLOSED pgs=932 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:47:51.571 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:51.569+0000 7fddb3a38640 1 -- 172.21.15.150:0/2200014936 >> 172.21.15.150:0/2200014936 conn(0x7fddac0b6880 msgr2=0x7fddac0b3060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:47:51.571 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:51.569+0000 7fddb3a38640 1 -- 172.21.15.150:0/2200014936 shutdown_connections 2024-09-17T05:47:51.571 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:51.569+0000 7fddb3a38640 1 -- 172.21.15.150:0/2200014936 wait complete. 2024-09-17T05:47:51.572 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:51.571+0000 7fddb3a38640 1 Processor -- start 2024-09-17T05:47:51.572 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:51.571+0000 7fddb3a38640 1 -- start start 2024-09-17T05:47:51.576 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:51.572+0000 7fddb3a38640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fddac0ce820 0x7fddac0701f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:47:51.576 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:51.572+0000 7fddb3a38640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fddac0cec30 0x7fddac149b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:47:51.576 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:51.572+0000 7fddb3a38640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fddac156130 0x7fddac14d210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:47:51.576 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:51.572+0000 7fddb3a38640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7fddac165c40 con 0x7fddac156130 2024-09-17T05:47:51.577 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:51.572+0000 7fddb3a38640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fddac165ac0 con 0x7fddac0cec30 2024-09-17T05:47:51.577 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:51.572+0000 7fddb3a38640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fddac165dc0 con 0x7fddac0ce820 2024-09-17T05:47:51.577 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:51.572+0000 7fddb1fd5640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fddac156130 0x7fddac14d210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:47:51.577 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:51.572+0000 7fddb1fd5640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fddac156130 0x7fddac14d210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:43118/0 (socket says 172.21.15.150:43118) 2024-09-17T05:47:51.577 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:51.572+0000 7fddb1fd5640 1 -- 172.21.15.150:0/2086690316 learned_addr learned my addr 172.21.15.150:0/2086690316 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:47:51.577 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:51.572+0000 7fddb0fd3640 1 --2- 172.21.15.150:0/2086690316 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fddac0cec30 0x7fddac149b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:47:51.578 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:51.572+0000 7fddb17d4640 1 --2- 172.21.15.150:0/2086690316 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fddac0ce820 0x7fddac0701f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:47:51.578 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:51.573+0000 7fddb1fd5640 1 -- 172.21.15.150:0/2086690316 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fddac0ce820 msgr2=0x7fddac0701f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:47:51.578 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:51.573+0000 7fddb1fd5640 1 --2- 172.21.15.150:0/2086690316 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fddac0ce820 0x7fddac0701f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:47:51.578 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:51.573+0000 7fddb1fd5640 1 -- 172.21.15.150:0/2086690316 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fddac0cec30 msgr2=0x7fddac149b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:47:51.578 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:51.573+0000 7fddb1fd5640 1 --2- 172.21.15.150:0/2086690316 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fddac0cec30 0x7fddac149b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:47:51.578 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:51.573+0000 7fddb1fd5640 1 -- 172.21.15.150:0/2086690316 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fddac070a20 con 0x7fddac156130 2024-09-17T05:47:51.578 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:51.573+0000 7fddb0fd3640 1 --2- 172.21.15.150:0/2086690316 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fddac0cec30 0x7fddac149b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:47:51.578 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:51.573+0000 7fddb1fd5640 1 --2- 172.21.15.150:0/2086690316 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fddac156130 0x7fddac14d210 secure :-1 s=READY pgs=933 cs=0 l=1 rev1=1 crypto rx=0x7fdda400cab0 tx=0x7fdda400cf70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:47:51.578 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:51.573+0000 7fdda1ffb640 1 -- 172.21.15.150:0/2086690316 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdda4007d30 con 0x7fddac156130 2024-09-17T05:47:51.578 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:51.573+0000 7fdda1ffb640 1 -- 172.21.15.150:0/2086690316 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fdda400f450 con 0x7fddac156130 2024-09-17T05:47:51.578 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:51.573+0000 7fddb3a38640 1 -- 172.21.15.150:0/2086690316 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fddac070d00 con 0x7fddac156130 2024-09-17T05:47:51.578 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:51.573+0000 7fdda1ffb640 1 -- 172.21.15.150:0/2086690316 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdda400f8a0 con 0x7fddac156130 2024-09-17T05:47:51.579 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:51.573+0000 7fddb3a38640 1 -- 172.21.15.150:0/2086690316 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fddac137920 con 0x7fddac156130 2024-09-17T05:47:51.579 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:51.574+0000 7fddb3a38640 1 -- 172.21.15.150:0/2086690316 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fddac137b80 con 0x7fddac156130 2024-09-17T05:47:51.579 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:51.575+0000 7fdda1ffb640 1 -- 172.21.15.150:0/2086690316 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 25) ==== 103022+0+0 (secure 0 0 0) 0x7fdda400fa40 con 0x7fddac156130 2024-09-17T05:47:51.579 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:51.575+0000 7fdda1ffb640 1 --2- 172.21.15.150:0/2086690316 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fdd90079d00 0x7fdd9007c210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:47:51.579 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:51.575+0000 7fdda1ffb640 1 -- 172.21.15.150:0/2086690316 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 5881+0+0 (secure 0 0 0) 0x7fdda409a5e0 con 0x7fddac156130 2024-09-17T05:47:51.579 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:51.576+0000 7fddb17d4640 1 --2- 172.21.15.150:0/2086690316 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fdd90079d00 0x7fdd9007c210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:47:51.580 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:51.576+0000 7fddb17d4640 1 --2- 172.21.15.150:0/2086690316 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fdd90079d00 0x7fdd9007c210 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7fdda8033000 tx=0x7fdda8004730 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:47:51.580 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:51.580+0000 7fdda1ffb640 1 -- 172.21.15.150:0/2086690316 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fdda4014070 con 0x7fddac156130 2024-09-17T05:47:51.884 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:51.883+0000 7fddb3a38640 1 -- 172.21.15.150:0/2086690316 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7fddac0707b0 con 0x7fddac156130 2024-09-17T05:47:51.885 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:51.884+0000 7fdda1ffb640 1 -- 172.21.15.150:0/2086690316 <== mon.0 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v74) ==== 80+0+0 (secure 0 0 0) 0x7fdda4064210 con 0x7fddac156130 2024-09-17T05:47:51.885 INFO:teuthology.orchestra.run.smithi150.stderr:listed 0 entries 2024-09-17T05:47:51.888 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:51.887+0000 7fddb3a38640 1 -- 172.21.15.150:0/2086690316 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fdd90079d00 msgr2=0x7fdd9007c210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:47:51.888 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:51.887+0000 7fddb3a38640 1 --2- 172.21.15.150:0/2086690316 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fdd90079d00 0x7fdd9007c210 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7fdda8033000 tx=0x7fdda8004730 comp rx=0 tx=0).stop 2024-09-17T05:47:51.888 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:51.887+0000 7fddb3a38640 1 -- 172.21.15.150:0/2086690316 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fddac156130 msgr2=0x7fddac14d210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:47:51.888 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:51.887+0000 7fddb3a38640 1 --2- 172.21.15.150:0/2086690316 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fddac156130 0x7fddac14d210 secure :-1 s=READY pgs=933 cs=0 l=1 rev1=1 crypto rx=0x7fdda400cab0 tx=0x7fdda400cf70 comp rx=0 tx=0).stop 2024-09-17T05:47:51.888 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:51.887+0000 7fddb3a38640 1 -- 172.21.15.150:0/2086690316 shutdown_connections 2024-09-17T05:47:51.888 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:51.887+0000 7fddb3a38640 1 --2- 172.21.15.150:0/2086690316 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fddac0cec30 0x7fddac149b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:47:51.889 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:51.887+0000 7fddb3a38640 1 --2- 172.21.15.150:0/2086690316 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fdd90079d00 0x7fdd9007c210 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:47:51.889 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:51.887+0000 7fddb3a38640 1 --2- 172.21.15.150:0/2086690316 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fddac156130 0x7fddac14d210 unknown :-1 s=CLOSED pgs=933 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:47:51.889 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:51.887+0000 7fddb3a38640 1 --2- 172.21.15.150:0/2086690316 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fddac0ce820 0x7fddac0701f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:47:51.889 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:51.887+0000 7fddb3a38640 1 -- 172.21.15.150:0/2086690316 >> 172.21.15.150:0/2086690316 conn(0x7fddac0b6880 msgr2=0x7fddac14ffd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:47:51.889 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:51.887+0000 7fddb3a38640 1 -- 172.21.15.150:0/2086690316 shutdown_connections 2024-09-17T05:47:51.889 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:51.887+0000 7fddb3a38640 1 -- 172.21.15.150:0/2086690316 wait complete. 2024-09-17T05:47:51.901 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-09-17T05:47:51.901 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:47:51.901 DEBUG:teuthology.orchestra.run.smithi150:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-09-17T05:47:51.949 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi150.front.sepia.ceph.com 2024-09-17T05:47:51.949 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:47:51.949 DEBUG:teuthology.orchestra.run.smithi150:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-17T05:47:51.978 INFO:tasks.cephfs.mount:Terminating background process 2024-09-17T05:47:51.978 DEBUG:teuthology.orchestra.run.smithi176:> set -ex 2024-09-17T05:47:51.978 DEBUG:teuthology.orchestra.run.smithi176:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T05:47:51.995 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056030,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497468k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=3379 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248732k,nr_inodes=812183,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497468k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-17T05:47:51.995 INFO:tasks.cephfs.mount:Terminating background process 2024-09-17T05:47:51.995 DEBUG:teuthology.orchestra.run.smithi150:> set -ex 2024-09-17T05:47:51.995 DEBUG:teuthology.orchestra.run.smithi150:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T05:47:52.033 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056027,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497464k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=18693 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248728k,nr_inodes=812182,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497464k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-17T05:47:52.034 INFO:tasks.cephfs.mount:Terminating background process 2024-09-17T05:47:52.034 DEBUG:teuthology.orchestra.run.smithi176:> set -ex 2024-09-17T05:47:52.034 DEBUG:teuthology.orchestra.run.smithi176:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T05:47:52.052 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056030,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497468k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=3379 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248732k,nr_inodes=812183,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497468k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-17T05:47:52.052 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T05:47:52.190 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:52.189+0000 7f600c64d640 1 -- 172.21.15.150:0/2441729780 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f60040b7330 msgr2=0x7f60040b5260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:47:52.190 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:52.189+0000 7f600c64d640 1 --2- 172.21.15.150:0/2441729780 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f60040b7330 0x7f60040b5260 secure :-1 s=READY pgs=934 cs=0 l=1 rev1=1 crypto rx=0x7f5ff4005fd0 tx=0x7f5ff402a530 comp rx=0 tx=0).stop 2024-09-17T05:47:52.190 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:52.189+0000 7f600c64d640 1 -- 172.21.15.150:0/2441729780 shutdown_connections 2024-09-17T05:47:52.191 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:52.189+0000 7f600c64d640 1 --2- 172.21.15.150:0/2441729780 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f60040b57a0 0x7f60040b5bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:47:52.191 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:52.189+0000 7f600c64d640 1 --2- 172.21.15.150:0/2441729780 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f60040b7330 0x7f60040b5260 unknown :-1 s=CLOSED pgs=934 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:47:52.191 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:52.189+0000 7f600c64d640 1 -- 172.21.15.150:0/2441729780 >> 172.21.15.150:0/2441729780 conn(0x7f60040cee90 msgr2=0x7f60040cf2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:47:52.191 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:52.189+0000 7f600c64d640 1 -- 172.21.15.150:0/2441729780 shutdown_connections 2024-09-17T05:47:52.191 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:52.189+0000 7f600c64d640 1 -- 172.21.15.150:0/2441729780 wait complete. 2024-09-17T05:47:52.191 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:52.191+0000 7f600c64d640 1 Processor -- start 2024-09-17T05:47:52.191 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:52.191+0000 7f600c64d640 1 -- start start 2024-09-17T05:47:52.194 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:52.192+0000 7f600c64d640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f600409ba60 0x7f600409ef80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:47:52.195 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:52.192+0000 7f600c64d640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f60040b57a0 0x7f60041f7bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:47:52.195 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:52.192+0000 7f600c64d640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f60040b7330 0x7f60041566d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:47:52.195 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:52.192+0000 7f600c64d640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f60040d1550 con 0x7f600409ba60 2024-09-17T05:47:52.195 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:52.192+0000 7f600c64d640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f60040d13d0 con 0x7f60040b7330 2024-09-17T05:47:52.195 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:52.192+0000 7f600c64d640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f60041670e0 con 0x7f60040b57a0 2024-09-17T05:47:52.195 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:52.192+0000 7f600a3e9640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f600409ba60 0x7f600409ef80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:47:52.195 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:52.192+0000 7f600a3e9640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f600409ba60 0x7f600409ef80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:43136/0 (socket says 172.21.15.150:43136) 2024-09-17T05:47:52.195 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:52.192+0000 7f600a3e9640 1 -- 172.21.15.150:0/1280921744 learned_addr learned my addr 172.21.15.150:0/1280921744 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:47:52.195 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:52.193+0000 7f600abea640 1 --2- 172.21.15.150:0/1280921744 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f60040b7330 0x7f60041566d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:47:52.195 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:52.193+0000 7f6009be8640 1 --2- 172.21.15.150:0/1280921744 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f60040b57a0 0x7f60041f7bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:47:52.195 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:52.193+0000 7f600a3e9640 1 -- 172.21.15.150:0/1280921744 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f60040b57a0 msgr2=0x7f60041f7bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:47:52.196 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:52.193+0000 7f600a3e9640 1 --2- 172.21.15.150:0/1280921744 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f60040b57a0 0x7f60041f7bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:47:52.196 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:52.193+0000 7f600a3e9640 1 -- 172.21.15.150:0/1280921744 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f60040b7330 msgr2=0x7f60041566d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:47:52.196 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:52.193+0000 7f600a3e9640 1 --2- 172.21.15.150:0/1280921744 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f60040b7330 0x7f60041566d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:47:52.196 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:52.193+0000 7f600a3e9640 1 -- 172.21.15.150:0/1280921744 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f60041f7130 con 0x7f600409ba60 2024-09-17T05:47:52.196 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:52.193+0000 7f600abea640 1 --2- 172.21.15.150:0/1280921744 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f60040b7330 0x7f60041566d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T05:47:52.196 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:52.193+0000 7f600a3e9640 1 --2- 172.21.15.150:0/1280921744 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f600409ba60 0x7f600409ef80 secure :-1 s=READY pgs=935 cs=0 l=1 rev1=1 crypto rx=0x7f600000b410 tx=0x7f600000b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:47:52.196 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:52.193+0000 7f5ffaffd640 1 -- 172.21.15.150:0/1280921744 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6000015020 con 0x7f600409ba60 2024-09-17T05:47:52.196 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:52.193+0000 7f5ffaffd640 1 -- 172.21.15.150:0/1280921744 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f6000011920 con 0x7f600409ba60 2024-09-17T05:47:52.196 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:52.193+0000 7f600c64d640 1 -- 172.21.15.150:0/1280921744 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f600409f810 con 0x7f600409ba60 2024-09-17T05:47:52.196 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:52.193+0000 7f5ffaffd640 1 -- 172.21.15.150:0/1280921744 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6000011d70 con 0x7f600409ba60 2024-09-17T05:47:52.196 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:52.193+0000 7f600c64d640 1 -- 172.21.15.150:0/1280921744 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f60041f73f0 con 0x7f600409ba60 2024-09-17T05:47:52.196 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:52.194+0000 7f600c64d640 1 -- 172.21.15.150:0/1280921744 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f60040b5bb0 con 0x7f600409ba60 2024-09-17T05:47:52.197 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:52.195+0000 7f5ffaffd640 1 -- 172.21.15.150:0/1280921744 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 25) ==== 103022+0+0 (secure 0 0 0) 0x7f6000018020 con 0x7f600409ba60 2024-09-17T05:47:52.197 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:52.195+0000 7f5ffaffd640 1 --2- 172.21.15.150:0/1280921744 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f5fe8079d30 0x7f5fe807c240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:47:52.197 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:52.195+0000 7f5ffaffd640 1 -- 172.21.15.150:0/1280921744 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 5937+0+0 (secure 0 0 0) 0x7f6000099a30 con 0x7f600409ba60 2024-09-17T05:47:52.197 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:52.196+0000 7f6009be8640 1 --2- 172.21.15.150:0/1280921744 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f5fe8079d30 0x7f5fe807c240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:47:52.198 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:52.196+0000 7f6009be8640 1 --2- 172.21.15.150:0/1280921744 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f5fe8079d30 0x7f5fe807c240 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f5ff4033000 tx=0x7f5ff4004730 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:47:52.201 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:52.200+0000 7f5ffaffd640 1 -- 172.21.15.150:0/1280921744 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f6000063550 con 0x7f600409ba60 2024-09-17T05:47:52.410 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:52.409+0000 7f600c64d640 1 -- 172.21.15.150:0/1280921744 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f60040718f0 con 0x7f600409ba60 2024-09-17T05:47:52.411 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:52.410+0000 7f5ffaffd640 1 -- 172.21.15.150:0/1280921744 <== mon.0 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 43 v43) ==== 94+0+5237 (secure 0 0 0) 0x7f6000062e50 con 0x7f600409ba60 2024-09-17T05:47:52.412 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-09-17T05:47:52.412 INFO:teuthology.orchestra.run.smithi150.stdout:{"epoch":43,"btime":"2024-09-17T05:47:03:788551+0000","default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5639,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6836/3422557079","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6834","nonce":3422557079},{"type":"v1","addr":"172.21.15.176:6836","nonce":3422557079}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":38},{"gid":6070,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6837/2283556368","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6835","nonce":2283556368},{"type":"v1","addr":"172.21.15.176:6837","nonce":2283556368}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":38},{"gid":6495,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6834/4130242651","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6832","nonce":4130242651},{"type":"v1","addr":"172.21.15.150:6834","nonce":4130242651}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":37}],"filesystems":[{"mdsmap":{"epoch":42,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T05:46:50.910842+0000","modified":"2024-09-17T05:46:53.930100+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6498},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6498":{"gid":6498,"name":"a","rank":0,"incarnation":39,"state":"up:active","state_seq":3,"addr":"172.21.15.150:6835/4215563116","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6833","nonce":4215563116},{"type":"v1","addr":"172.21.15.150:6835","nonce":4215563116}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6498,"qdb_cluster":[6498]},"id":5}]} 2024-09-17T05:47:52.412 INFO:teuthology.orchestra.run.smithi150.stderr:dumped fsmap epoch 43 2024-09-17T05:47:52.414 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:52.412+0000 7f600c64d640 1 -- 172.21.15.150:0/1280921744 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f5fe8079d30 msgr2=0x7f5fe807c240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:47:52.414 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:52.412+0000 7f600c64d640 1 --2- 172.21.15.150:0/1280921744 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f5fe8079d30 0x7f5fe807c240 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f5ff4033000 tx=0x7f5ff4004730 comp rx=0 tx=0).stop 2024-09-17T05:47:52.414 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:52.412+0000 7f600c64d640 1 -- 172.21.15.150:0/1280921744 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f600409ba60 msgr2=0x7f600409ef80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:47:52.415 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:52.412+0000 7f600c64d640 1 --2- 172.21.15.150:0/1280921744 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f600409ba60 0x7f600409ef80 secure :-1 s=READY pgs=935 cs=0 l=1 rev1=1 crypto rx=0x7f600000b410 tx=0x7f600000b8d0 comp rx=0 tx=0).stop 2024-09-17T05:47:52.415 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:52.412+0000 7f600c64d640 1 -- 172.21.15.150:0/1280921744 shutdown_connections 2024-09-17T05:47:52.415 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:52.412+0000 7f600c64d640 1 --2- 172.21.15.150:0/1280921744 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f60040b7330 0x7f60041566d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:47:52.415 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:52.412+0000 7f600c64d640 1 --2- 172.21.15.150:0/1280921744 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f5fe8079d30 0x7f5fe807c240 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:47:52.415 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:52.412+0000 7f600c64d640 1 --2- 172.21.15.150:0/1280921744 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f60040b57a0 0x7f60041f7bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:47:52.415 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:52.412+0000 7f600c64d640 1 --2- 172.21.15.150:0/1280921744 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f600409ba60 0x7f600409ef80 unknown :-1 s=CLOSED pgs=935 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:47:52.415 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:52.412+0000 7f600c64d640 1 -- 172.21.15.150:0/1280921744 >> 172.21.15.150:0/1280921744 conn(0x7f60040cee90 msgr2=0x7f60040cc230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:47:52.416 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:52.412+0000 7f600c64d640 1 -- 172.21.15.150:0/1280921744 shutdown_connections 2024-09-17T05:47:52.416 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:52.412+0000 7f600c64d640 1 -- 172.21.15.150:0/1280921744 wait complete. 2024-09-17T05:47:52.426 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T05:47:52.540 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:52.539+0000 7fb8b645c640 1 -- 172.21.15.150:0/2152758723 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb8b00b9b40 msgr2=0x7fb8b00d51a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:47:52.540 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:52.539+0000 7fb8b645c640 1 --2- 172.21.15.150:0/2152758723 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb8b00b9b40 0x7fb8b00d51a0 secure :-1 s=READY pgs=936 cs=0 l=1 rev1=1 crypto rx=0x7fb8b008cd30 tx=0x7fb8a002a560 comp rx=0 tx=0).stop 2024-09-17T05:47:52.541 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:52.539+0000 7fb8b645c640 1 -- 172.21.15.150:0/2152758723 shutdown_connections 2024-09-17T05:47:52.541 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:52.539+0000 7fb8b645c640 1 --2- 172.21.15.150:0/2152758723 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb8b00d12f0 0x7fb8b00cf290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:47:52.541 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:52.539+0000 7fb8b645c640 1 --2- 172.21.15.150:0/2152758723 >> v2:172.21.15.176:3300/0 conn(0x7fb8b00d31e0 0x7fb8b00d0db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:47:52.541 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:52.539+0000 7fb8b645c640 1 --2- 172.21.15.150:0/2152758723 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb8b00b9b40 0x7fb8b00d51a0 unknown :-1 s=CLOSED pgs=936 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:47:52.541 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:52.539+0000 7fb8b645c640 1 -- 172.21.15.150:0/2152758723 >> 172.21.15.150:0/2152758723 conn(0x7fb8b00d4680 msgr2=0x7fb8b00d4a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:47:52.541 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:52.539+0000 7fb8b645c640 1 -- 172.21.15.150:0/2152758723 shutdown_connections 2024-09-17T05:47:52.541 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:52.539+0000 7fb8b645c640 1 -- 172.21.15.150:0/2152758723 wait complete. 2024-09-17T05:47:52.541 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:52.541+0000 7fb8b645c640 1 Processor -- start 2024-09-17T05:47:52.542 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:52.541+0000 7fb8b645c640 1 -- start start 2024-09-17T05:47:52.544 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:52.542+0000 7fb8b645c640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb8b00b9b40 0x7fb8b00a1bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:47:52.544 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:52.543+0000 7fb8b645c640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb8b00d12f0 0x7fb8b0156bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:47:52.545 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:52.543+0000 7fb8b645c640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb8b00d31e0 0x7fb8b00b62d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:47:52.545 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:52.543+0000 7fb8b645c640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7fb8b00b3c50 con 0x7fb8b00d31e0 2024-09-17T05:47:52.545 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:52.543+0000 7fb8b645c640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fb8b00b3ad0 con 0x7fb8b00b9b40 2024-09-17T05:47:52.545 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:52.543+0000 7fb8b645c640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fb8b00cf7d0 con 0x7fb8b00d12f0 2024-09-17T05:47:52.545 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:52.543+0000 7fb8b49f9640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb8b00d31e0 0x7fb8b00b62d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:47:52.545 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:52.543+0000 7fb8b49f9640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb8b00d31e0 0x7fb8b00b62d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:43158/0 (socket says 172.21.15.150:43158) 2024-09-17T05:47:52.545 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:52.543+0000 7fb8b49f9640 1 -- 172.21.15.150:0/453862157 learned_addr learned my addr 172.21.15.150:0/453862157 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:47:52.545 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:52.543+0000 7fb8af7fe640 1 --2- 172.21.15.150:0/453862157 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb8b00d12f0 0x7fb8b0156bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:47:52.545 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:52.543+0000 7fb8affff640 1 --2- 172.21.15.150:0/453862157 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb8b00b9b40 0x7fb8b00a1bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:47:52.545 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:52.543+0000 7fb8b49f9640 1 -- 172.21.15.150:0/453862157 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb8b00d12f0 msgr2=0x7fb8b0156bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:47:52.545 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:52.543+0000 7fb8b49f9640 1 --2- 172.21.15.150:0/453862157 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb8b00d12f0 0x7fb8b0156bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:47:52.545 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:52.543+0000 7fb8b49f9640 1 -- 172.21.15.150:0/453862157 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb8b00b9b40 msgr2=0x7fb8b00a1bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:47:52.545 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:52.543+0000 7fb8b49f9640 1 --2- 172.21.15.150:0/453862157 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb8b00b9b40 0x7fb8b00a1bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:47:52.546 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:52.543+0000 7fb8b49f9640 1 -- 172.21.15.150:0/453862157 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb8b009f5f0 con 0x7fb8b00d31e0 2024-09-17T05:47:52.546 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:52.543+0000 7fb8af7fe640 1 --2- 172.21.15.150:0/453862157 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb8b00d12f0 0x7fb8b0156bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:47:52.546 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:52.543+0000 7fb8b49f9640 1 --2- 172.21.15.150:0/453862157 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb8b00d31e0 0x7fb8b00b62d0 secure :-1 s=READY pgs=937 cs=0 l=1 rev1=1 crypto rx=0x7fb8a800e9c0 tx=0x7fb8a800ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:47:52.546 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:52.543+0000 7fb8acff9640 1 -- 172.21.15.150:0/453862157 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb8a8004d20 con 0x7fb8b00d31e0 2024-09-17T05:47:52.546 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:52.543+0000 7fb8acff9640 1 -- 172.21.15.150:0/453862157 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb8a800cb20 con 0x7fb8b00d31e0 2024-09-17T05:47:52.546 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:52.543+0000 7fb8acff9640 1 -- 172.21.15.150:0/453862157 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb8a8005020 con 0x7fb8b00d31e0 2024-09-17T05:47:52.546 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:52.543+0000 7fb8b645c640 1 -- 172.21.15.150:0/453862157 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb8b009e550 con 0x7fb8b00d31e0 2024-09-17T05:47:52.546 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:52.543+0000 7fb8b645c640 1 -- 172.21.15.150:0/453862157 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb8b009eb10 con 0x7fb8b00d31e0 2024-09-17T05:47:52.547 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:52.545+0000 7fb8b645c640 1 -- 172.21.15.150:0/453862157 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb8b00cfcf0 con 0x7fb8b00d31e0 2024-09-17T05:47:52.547 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:52.545+0000 7fb8acff9640 1 -- 172.21.15.150:0/453862157 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 25) ==== 103022+0+0 (secure 0 0 0) 0x7fb8a80051c0 con 0x7fb8b00d31e0 2024-09-17T05:47:52.547 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:52.546+0000 7fb8acff9640 1 --2- 172.21.15.150:0/453862157 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fb89c079d00 0x7fb89c07c210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:47:52.547 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:52.546+0000 7fb8acff9640 1 -- 172.21.15.150:0/453862157 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 5937+0+0 (secure 0 0 0) 0x7fb8a809a4c0 con 0x7fb8b00d31e0 2024-09-17T05:47:52.547 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:52.546+0000 7fb8affff640 1 --2- 172.21.15.150:0/453862157 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fb89c079d00 0x7fb89c07c210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:47:52.548 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:52.546+0000 7fb8affff640 1 --2- 172.21.15.150:0/453862157 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fb89c079d00 0x7fb89c07c210 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7fb8a0033000 tx=0x7fb8a0004730 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:47:52.551 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:52.550+0000 7fb8acff9640 1 -- 172.21.15.150:0/453862157 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fb8a8016030 con 0x7fb8b00d31e0 2024-09-17T05:47:52.912 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:52.911+0000 7fb8b645c640 1 -- 172.21.15.150:0/453862157 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fb8b00d1d30 con 0x7fb8b00d31e0 2024-09-17T05:47:52.913 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:52.912+0000 7fb8acff9640 1 -- 172.21.15.150:0/453862157 <== mon.0 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 43 v43) ==== 94+0+5237 (secure 0 0 0) 0x7fb8a8063a10 con 0x7fb8b00d31e0 2024-09-17T05:47:52.913 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-09-17T05:47:52.914 INFO:teuthology.orchestra.run.smithi150.stdout:{"epoch":43,"btime":"2024-09-17T05:47:03:788551+0000","default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5639,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6836/3422557079","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6834","nonce":3422557079},{"type":"v1","addr":"172.21.15.176:6836","nonce":3422557079}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":38},{"gid":6070,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6837/2283556368","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6835","nonce":2283556368},{"type":"v1","addr":"172.21.15.176:6837","nonce":2283556368}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":38},{"gid":6495,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6834/4130242651","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6832","nonce":4130242651},{"type":"v1","addr":"172.21.15.150:6834","nonce":4130242651}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":37}],"filesystems":[{"mdsmap":{"epoch":42,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T05:46:50.910842+0000","modified":"2024-09-17T05:46:53.930100+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6498},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6498":{"gid":6498,"name":"a","rank":0,"incarnation":39,"state":"up:active","state_seq":3,"addr":"172.21.15.150:6835/4215563116","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6833","nonce":4215563116},{"type":"v1","addr":"172.21.15.150:6835","nonce":4215563116}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6498,"qdb_cluster":[6498]},"id":5}]} 2024-09-17T05:47:52.914 INFO:teuthology.orchestra.run.smithi150.stderr:dumped fsmap epoch 43 2024-09-17T05:47:52.917 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:52.916+0000 7fb8b645c640 1 -- 172.21.15.150:0/453862157 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fb89c079d00 msgr2=0x7fb89c07c210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:47:52.917 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:52.916+0000 7fb8b645c640 1 --2- 172.21.15.150:0/453862157 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fb89c079d00 0x7fb89c07c210 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7fb8a0033000 tx=0x7fb8a0004730 comp rx=0 tx=0).stop 2024-09-17T05:47:52.917 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:52.916+0000 7fb8b645c640 1 -- 172.21.15.150:0/453862157 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb8b00d31e0 msgr2=0x7fb8b00b62d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:47:52.917 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:52.916+0000 7fb8b645c640 1 --2- 172.21.15.150:0/453862157 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb8b00d31e0 0x7fb8b00b62d0 secure :-1 s=READY pgs=937 cs=0 l=1 rev1=1 crypto rx=0x7fb8a800e9c0 tx=0x7fb8a800ee80 comp rx=0 tx=0).stop 2024-09-17T05:47:52.920 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:52.917+0000 7fb8b645c640 1 -- 172.21.15.150:0/453862157 shutdown_connections 2024-09-17T05:47:52.920 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:52.917+0000 7fb8b645c640 1 --2- 172.21.15.150:0/453862157 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fb89c079d00 0x7fb89c07c210 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:47:52.920 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:52.917+0000 7fb8b645c640 1 --2- 172.21.15.150:0/453862157 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb8b00d31e0 0x7fb8b00b62d0 unknown :-1 s=CLOSED pgs=937 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:47:52.920 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:52.917+0000 7fb8b645c640 1 --2- 172.21.15.150:0/453862157 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb8b00d12f0 0x7fb8b0156bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:47:52.920 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:52.917+0000 7fb8b645c640 1 --2- 172.21.15.150:0/453862157 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb8b00b9b40 0x7fb8b00a1bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:47:52.920 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:52.917+0000 7fb8b645c640 1 -- 172.21.15.150:0/453862157 >> 172.21.15.150:0/453862157 conn(0x7fb8b00d4680 msgr2=0x7fb8b0068e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:47:52.921 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:52.917+0000 7fb8b645c640 1 -- 172.21.15.150:0/453862157 shutdown_connections 2024-09-17T05:47:52.921 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:52.917+0000 7fb8b645c640 1 -- 172.21.15.150:0/453862157 wait complete. 2024-09-17T05:47:52.936 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T05:47:53.110 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:53.109+0000 7f5fc8b69640 1 -- 172.21.15.150:0/3405323221 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5fc406ddb0 msgr2=0x7f5fc406e1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:47:53.111 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:53.109+0000 7f5fc8b69640 1 --2- 172.21.15.150:0/3405323221 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5fc406ddb0 0x7f5fc406e1c0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f5fbc005fd0 tx=0x7f5fbc02aa90 comp rx=0 tx=0).stop 2024-09-17T05:47:53.111 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:53.110+0000 7f5fc8b69640 1 -- 172.21.15.150:0/3405323221 shutdown_connections 2024-09-17T05:47:53.111 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:53.110+0000 7f5fc8b69640 1 --2- 172.21.15.150:0/3405323221 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5fc406ddb0 0x7f5fc406e1c0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:47:53.111 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:53.110+0000 7f5fc8b69640 1 --2- 172.21.15.150:0/3405323221 >> v2:172.21.15.150:3300/0 conn(0x7f5fc40ce450 0x7f5fc40b3af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:47:53.111 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:53.110+0000 7f5fc8b69640 1 -- 172.21.15.150:0/3405323221 >> 172.21.15.150:0/3405323221 conn(0x7f5fc40738b0 msgr2=0x7f5fc4073cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:47:53.111 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:53.110+0000 7f5fc8b69640 1 -- 172.21.15.150:0/3405323221 shutdown_connections 2024-09-17T05:47:53.111 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:53.110+0000 7f5fc8b69640 1 -- 172.21.15.150:0/3405323221 wait complete. 2024-09-17T05:47:53.114 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:53.113+0000 7f5fc8b69640 1 Processor -- start 2024-09-17T05:47:53.114 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:53.113+0000 7f5fc8b69640 1 -- start start 2024-09-17T05:47:53.116 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:53.115+0000 7f5fc8b69640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5fc406ddb0 0x7f5fc4137350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:47:53.118 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:53.116+0000 7f5fc8b69640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5fc40ce450 0x7f5fc415d940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:47:53.118 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:53.116+0000 7f5fc259c640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5fc406ddb0 0x7f5fc4137350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:47:53.118 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:53.116+0000 7f5fc8b69640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5fc4143af0 0x7f5fc415de80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:47:53.118 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:53.116+0000 7f5fc1d9b640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5fc40ce450 0x7f5fc415d940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:47:53.118 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:53.116+0000 7f5fc1d9b640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5fc40ce450 0x7f5fc415d940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3301/0 says I am v2:172.21.15.150:50866/0 (socket says 172.21.15.150:50866) 2024-09-17T05:47:53.119 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:53.116+0000 7f5fc2d9d640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5fc4143af0 0x7f5fc415de80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:47:53.119 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:53.116+0000 7f5fc2d9d640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5fc4143af0 0x7f5fc415de80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:43182/0 (socket says 172.21.15.150:43182) 2024-09-17T05:47:53.119 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:53.116+0000 7f5fc8b69640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f5fc4076410 con 0x7f5fc4143af0 2024-09-17T05:47:53.119 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:53.116+0000 7f5fc8b69640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f5fc4076290 con 0x7f5fc406ddb0 2024-09-17T05:47:53.120 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:53.116+0000 7f5fc8b69640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f5fc406fe50 con 0x7f5fc40ce450 2024-09-17T05:47:53.120 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:53.116+0000 7f5fc259c640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5fc406ddb0 0x7f5fc4137350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3300/0 says I am v2:172.21.15.150:42736/0 (socket says 172.21.15.150:42736) 2024-09-17T05:47:53.120 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:53.116+0000 7f5fc259c640 1 -- 172.21.15.150:0/1153393643 learned_addr learned my addr 172.21.15.150:0/1153393643 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:47:53.120 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:53.117+0000 7f5fc2d9d640 1 -- 172.21.15.150:0/1153393643 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5fc40ce450 msgr2=0x7f5fc415d940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:47:53.120 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:53.117+0000 7f5fc2d9d640 1 --2- 172.21.15.150:0/1153393643 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5fc40ce450 0x7f5fc415d940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:47:53.120 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:53.117+0000 7f5fc2d9d640 1 -- 172.21.15.150:0/1153393643 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5fc406ddb0 msgr2=0x7f5fc4137350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:47:53.120 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:53.117+0000 7f5fc2d9d640 1 --2- 172.21.15.150:0/1153393643 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5fc406ddb0 0x7f5fc4137350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:47:53.120 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:53.117+0000 7f5fc2d9d640 1 -- 172.21.15.150:0/1153393643 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5fc41539e0 con 0x7f5fc4143af0 2024-09-17T05:47:53.120 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:53.117+0000 7f5fc2d9d640 1 --2- 172.21.15.150:0/1153393643 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5fc4143af0 0x7f5fc415de80 secure :-1 s=READY pgs=938 cs=0 l=1 rev1=1 crypto rx=0x7f5fbc032000 tx=0x7f5fbc003e20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:47:53.122 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:53.118+0000 7f5fb2ffd640 1 -- 172.21.15.150:0/1153393643 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5fbc004680 con 0x7f5fc4143af0 2024-09-17T05:47:53.122 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:53.118+0000 7f5fb2ffd640 1 -- 172.21.15.150:0/1153393643 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f5fbc041070 con 0x7f5fc4143af0 2024-09-17T05:47:53.122 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:53.118+0000 7f5fc8b69640 1 -- 172.21.15.150:0/1153393643 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5fc4159590 con 0x7f5fc4143af0 2024-09-17T05:47:53.122 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:53.118+0000 7f5fb2ffd640 1 -- 172.21.15.150:0/1153393643 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5fbc03d730 con 0x7f5fc4143af0 2024-09-17T05:47:53.122 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:53.118+0000 7f5fc8b69640 1 -- 172.21.15.150:0/1153393643 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5fc4153700 con 0x7f5fc4143af0 2024-09-17T05:47:53.122 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:53.119+0000 7f5fc8b69640 1 -- 172.21.15.150:0/1153393643 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5fc4159760 con 0x7f5fc4143af0 2024-09-17T05:47:53.122 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:53.120+0000 7f5fb2ffd640 1 -- 172.21.15.150:0/1153393643 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 25) ==== 103022+0+0 (secure 0 0 0) 0x7f5fbc03d8d0 con 0x7f5fc4143af0 2024-09-17T05:47:53.122 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:53.121+0000 7f5fb2ffd640 1 --2- 172.21.15.150:0/1153393643 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f5fa4079dd0 0x7f5fa407c2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:47:53.123 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:53.121+0000 7f5fb2ffd640 1 -- 172.21.15.150:0/1153393643 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 5937+0+0 (secure 0 0 0) 0x7f5fbc0bf0c0 con 0x7f5fc4143af0 2024-09-17T05:47:53.124 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:53.123+0000 7f5fc259c640 1 --2- 172.21.15.150:0/1153393643 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f5fa4079dd0 0x7f5fa407c2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:47:53.124 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:53.124+0000 7f5fc259c640 1 --2- 172.21.15.150:0/1153393643 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f5fa4079dd0 0x7f5fa407c2e0 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f5fb40099a0 tx=0x7f5fb4006f90 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:47:53.130 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:53.129+0000 7f5fb2ffd640 1 -- 172.21.15.150:0/1153393643 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f5fbc032030 con 0x7f5fc4143af0 2024-09-17T05:47:53.408 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:53.408+0000 7f5fc8b69640 1 -- 172.21.15.150:0/1153393643 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f5fc4153490 con 0x7f5fc4143af0 2024-09-17T05:47:53.409 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:53.409+0000 7f5fb2ffd640 1 -- 172.21.15.150:0/1153393643 <== mon.0 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v75) ==== 74+0+17155 (secure 0 0 0) 0x7f5fbc088900 con 0x7f5fc4143af0 2024-09-17T05:47:53.410 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-09-17T05:47:53.410 INFO:teuthology.orchestra.run.smithi150.stdout:{"epoch":75,"fsid":"9f2e05e9-d629-47b3-b26b-1360655b7d20","created":"2024-09-17T05:41:32.502979+0000","modified":"2024-09-17T05:47:52.132588+0000","last_up_change":"2024-09-17T05:41:46.150225+0000","last_in_change":"2024-09-17T05:41:36.120274+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T05:41:46.860779+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_metadata","create_time":"2024-09-17T05:46:48.549801+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"71","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs_data","create_time":"2024-09-17T05:46:49.868230+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"75","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":3,"snap_epoch":75,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"4f31c018-c8a4-4d6d-b0c2-a597c47aae4a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6800","nonce":479374392},{"type":"v1","addr":"172.21.15.150:6801","nonce":479374392}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6802","nonce":479374392},{"type":"v1","addr":"172.21.15.150:6803","nonce":479374392}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6806","nonce":479374392},{"type":"v1","addr":"172.21.15.150:6807","nonce":479374392}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6804","nonce":479374392},{"type":"v1","addr":"172.21.15.150:6805","nonce":479374392}]},"public_addr":"172.21.15.150:6801/479374392","cluster_addr":"172.21.15.150:6803/479374392","heartbeat_back_addr":"172.21.15.150:6807/479374392","heartbeat_front_addr":"172.21.15.150:6805/479374392","state":["exists","up"]},{"osd":1,"uuid":"6ff4a573-500b-4e04-9de3-39265ead78b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6824","nonce":913899800},{"type":"v1","addr":"172.21.15.150:6825","nonce":913899800}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6826","nonce":913899800},{"type":"v1","addr":"172.21.15.150:6827","nonce":913899800}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6830","nonce":913899800},{"type":"v1","addr":"172.21.15.150:6831","nonce":913899800}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6828","nonce":913899800},{"type":"v1","addr":"172.21.15.150:6829","nonce":913899800}]},"public_addr":"172.21.15.150:6825/913899800","cluster_addr":"172.21.15.150:6827/913899800","heartbeat_back_addr":"172.21.15.150:6831/913899800","heartbeat_front_addr":"172.21.15.150:6829/913899800","state":["exists","up"]},{"osd":2,"uuid":"bffea6f9-2465-4182-b205-00436c41ac1c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6816","nonce":363718461},{"type":"v1","addr":"172.21.15.150:6817","nonce":363718461}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6818","nonce":363718461},{"type":"v1","addr":"172.21.15.150:6819","nonce":363718461}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6822","nonce":363718461},{"type":"v1","addr":"172.21.15.150:6823","nonce":363718461}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6820","nonce":363718461},{"type":"v1","addr":"172.21.15.150:6821","nonce":363718461}]},"public_addr":"172.21.15.150:6817/363718461","cluster_addr":"172.21.15.150:6819/363718461","heartbeat_back_addr":"172.21.15.150:6823/363718461","heartbeat_front_addr":"172.21.15.150:6821/363718461","state":["exists","up"]},{"osd":3,"uuid":"cda70430-d1e1-427e-b04e-56db4031d078","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6808","nonce":3550994626},{"type":"v1","addr":"172.21.15.150:6809","nonce":3550994626}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6810","nonce":3550994626},{"type":"v1","addr":"172.21.15.150:6811","nonce":3550994626}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6814","nonce":3550994626},{"type":"v1","addr":"172.21.15.150:6815","nonce":3550994626}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6812","nonce":3550994626},{"type":"v1","addr":"172.21.15.150:6813","nonce":3550994626}]},"public_addr":"172.21.15.150:6809/3550994626","cluster_addr":"172.21.15.150:6811/3550994626","heartbeat_back_addr":"172.21.15.150:6815/3550994626","heartbeat_front_addr":"172.21.15.150:6813/3550994626","state":["exists","up"]},{"osd":4,"uuid":"3a0277fb-5e1e-4f68-bb2d-9a8a0152f64a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6810","nonce":2718261497},{"type":"v1","addr":"172.21.15.176:6811","nonce":2718261497}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6812","nonce":2718261497},{"type":"v1","addr":"172.21.15.176:6813","nonce":2718261497}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6816","nonce":2718261497},{"type":"v1","addr":"172.21.15.176:6817","nonce":2718261497}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6814","nonce":2718261497},{"type":"v1","addr":"172.21.15.176:6815","nonce":2718261497}]},"public_addr":"172.21.15.176:6811/2718261497","cluster_addr":"172.21.15.176:6813/2718261497","heartbeat_back_addr":"172.21.15.176:6817/2718261497","heartbeat_front_addr":"172.21.15.176:6815/2718261497","state":["exists","up"]},{"osd":5,"uuid":"33aebee6-0315-40b7-a11c-6702f0be494d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6818","nonce":2049295774},{"type":"v1","addr":"172.21.15.176:6819","nonce":2049295774}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6820","nonce":2049295774},{"type":"v1","addr":"172.21.15.176:6821","nonce":2049295774}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6824","nonce":2049295774},{"type":"v1","addr":"172.21.15.176:6825","nonce":2049295774}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6822","nonce":2049295774},{"type":"v1","addr":"172.21.15.176:6823","nonce":2049295774}]},"public_addr":"172.21.15.176:6819/2049295774","cluster_addr":"172.21.15.176:6821/2049295774","heartbeat_back_addr":"172.21.15.176:6825/2049295774","heartbeat_front_addr":"172.21.15.176:6823/2049295774","state":["exists","up"]},{"osd":6,"uuid":"4d24f360-6751-4263-841b-d77793d33540","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6826","nonce":2164458476},{"type":"v1","addr":"172.21.15.176:6827","nonce":2164458476}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6828","nonce":2164458476},{"type":"v1","addr":"172.21.15.176:6829","nonce":2164458476}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6832","nonce":2164458476},{"type":"v1","addr":"172.21.15.176:6833","nonce":2164458476}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6830","nonce":2164458476},{"type":"v1","addr":"172.21.15.176:6831","nonce":2164458476}]},"public_addr":"172.21.15.176:6827/2164458476","cluster_addr":"172.21.15.176:6829/2164458476","heartbeat_back_addr":"172.21.15.176:6833/2164458476","heartbeat_front_addr":"172.21.15.176:6831/2164458476","state":["exists","up"]},{"osd":7,"uuid":"c8594fda-c74a-4ba9-8277-caf101d58ca1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6802","nonce":3239587708},{"type":"v1","addr":"172.21.15.176:6803","nonce":3239587708}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6804","nonce":3239587708},{"type":"v1","addr":"172.21.15.176:6805","nonce":3239587708}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6808","nonce":3239587708},{"type":"v1","addr":"172.21.15.176:6809","nonce":3239587708}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6806","nonce":3239587708},{"type":"v1","addr":"172.21.15.176:6807","nonce":3239587708}]},"public_addr":"172.21.15.176:6803/3239587708","cluster_addr":"172.21.15.176:6805/3239587708","heartbeat_back_addr":"172.21.15.176:6809/3239587708","heartbeat_front_addr":"172.21.15.176:6807/3239587708","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:41:41.905151+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:41:42.705679+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:41:42.459673+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:41:42.440819+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:41:42.668428+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:41:42.694972+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:41:43.078535+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:41:42.363539+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"11.3","mappings":[{"from":6,"to":0}]},{"pgid":"11.10","mappings":[{"from":6,"to":1}]},{"pgid":"11.17","mappings":[{"from":6,"to":5}]},{"pgid":"11.30","mappings":[{"from":6,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":7,"snaps":[{"begin":2,"length":2}]},{"pool":9,"snaps":[{"begin":2,"length":2}]},{"pool":11,"snaps":[{"begin":2,"length":2}]}],"new_removed_snaps":[{"pool":11,"snaps":[{"begin":2,"length":2}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T05:47:53.412 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:53.411+0000 7f5fc8b69640 1 -- 172.21.15.150:0/1153393643 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f5fa4079dd0 msgr2=0x7f5fa407c2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:47:53.412 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:53.411+0000 7f5fc8b69640 1 --2- 172.21.15.150:0/1153393643 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f5fa4079dd0 0x7f5fa407c2e0 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f5fb40099a0 tx=0x7f5fb4006f90 comp rx=0 tx=0).stop 2024-09-17T05:47:53.412 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:53.411+0000 7f5fc8b69640 1 -- 172.21.15.150:0/1153393643 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5fc4143af0 msgr2=0x7f5fc415de80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:47:53.412 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:53.411+0000 7f5fc8b69640 1 --2- 172.21.15.150:0/1153393643 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5fc4143af0 0x7f5fc415de80 secure :-1 s=READY pgs=938 cs=0 l=1 rev1=1 crypto rx=0x7f5fbc032000 tx=0x7f5fbc003e20 comp rx=0 tx=0).stop 2024-09-17T05:47:53.412 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:53.411+0000 7f5fc8b69640 1 -- 172.21.15.150:0/1153393643 shutdown_connections 2024-09-17T05:47:53.412 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:53.411+0000 7f5fc8b69640 1 --2- 172.21.15.150:0/1153393643 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f5fa4079dd0 0x7f5fa407c2e0 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:47:53.413 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:53.411+0000 7f5fc8b69640 1 --2- 172.21.15.150:0/1153393643 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5fc4143af0 0x7f5fc415de80 unknown :-1 s=CLOSED pgs=938 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:47:53.413 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:53.411+0000 7f5fc8b69640 1 --2- 172.21.15.150:0/1153393643 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5fc40ce450 0x7f5fc415d940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:47:53.413 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:53.411+0000 7f5fc8b69640 1 --2- 172.21.15.150:0/1153393643 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5fc406ddb0 0x7f5fc4137350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:47:53.413 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:53.411+0000 7f5fc8b69640 1 -- 172.21.15.150:0/1153393643 >> 172.21.15.150:0/1153393643 conn(0x7f5fc40738b0 msgr2=0x7f5fc41441f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:47:53.413 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:53.411+0000 7f5fc8b69640 1 -- 172.21.15.150:0/1153393643 shutdown_connections 2024-09-17T05:47:53.413 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:53.411+0000 7f5fc8b69640 1 -- 172.21.15.150:0/1153393643 wait complete. 2024-09-17T05:47:53.424 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-09-17T05:47:53.424 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T05:47:53.538 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:53.537+0000 7feb3fdc3640 1 -- 172.21.15.150:0/3653507719 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7feb20003a50 msgr2=0x7feb20003ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:47:53.539 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:53.537+0000 7feb3fdc3640 1 --2- 172.21.15.150:0/3653507719 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7feb20003a50 0x7feb20003ec0 secure :-1 s=READY pgs=940 cs=0 l=1 rev1=1 crypto rx=0x7feb28009b50 tx=0x7feb20005830 comp rx=0 tx=0).stop 2024-09-17T05:47:53.539 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:53.537+0000 7feb3fdc3640 1 -- 172.21.15.150:0/3653507719 shutdown_connections 2024-09-17T05:47:53.539 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:53.537+0000 7feb3fdc3640 1 --2- 172.21.15.150:0/3653507719 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7feb20003a50 0x7feb20003ec0 unknown :-1 s=CLOSED pgs=940 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:47:53.539 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:53.537+0000 7feb3fdc3640 1 -- 172.21.15.150:0/3653507719 >> 172.21.15.150:0/3653507719 conn(0x7feb3806d730 msgr2=0x7feb380b1e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:47:53.539 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:53.538+0000 7feb3fdc3640 1 -- 172.21.15.150:0/3653507719 shutdown_connections 2024-09-17T05:47:53.539 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:53.538+0000 7feb3fdc3640 1 -- 172.21.15.150:0/3653507719 wait complete. 2024-09-17T05:47:53.540 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:53.539+0000 7feb3fdc3640 1 Processor -- start 2024-09-17T05:47:53.540 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:53.539+0000 7feb3fdc3640 1 -- start start 2024-09-17T05:47:53.542 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:53.541+0000 7feb3fdc3640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7feb20003a50 0x7feb3815b5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:47:53.543 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:53.541+0000 7feb3fdc3640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7feb381f5ca0 0x7feb3809c4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:47:53.543 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:53.541+0000 7feb3fdc3640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7feb3809c9e0 0x7feb3809cdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:47:53.543 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:53.541+0000 7feb3fdc3640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7feb3815f490 con 0x7feb381f5ca0 2024-09-17T05:47:53.543 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:53.541+0000 7feb3fdc3640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7feb3815f310 con 0x7feb20003a50 2024-09-17T05:47:53.543 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:53.541+0000 7feb3fdc3640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7feb3815f610 con 0x7feb3809c9e0 2024-09-17T05:47:53.543 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:53.541+0000 7feb3d35e640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7feb381f5ca0 0x7feb3809c4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:47:53.543 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:53.541+0000 7feb3d35e640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7feb381f5ca0 0x7feb3809c4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:43210/0 (socket says 172.21.15.150:43210) 2024-09-17T05:47:53.543 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:53.541+0000 7feb3d35e640 1 -- 172.21.15.150:0/2292118314 learned_addr learned my addr 172.21.15.150:0/2292118314 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:47:53.543 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:53.541+0000 7feb3e360640 1 --2- 172.21.15.150:0/2292118314 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7feb3809c9e0 0x7feb3809cdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:47:53.543 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:53.541+0000 7feb3db5f640 1 --2- 172.21.15.150:0/2292118314 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7feb20003a50 0x7feb3815b5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:47:53.543 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:53.541+0000 7feb3d35e640 1 -- 172.21.15.150:0/2292118314 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7feb3809c9e0 msgr2=0x7feb3809cdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:47:53.543 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:53.541+0000 7feb3d35e640 1 --2- 172.21.15.150:0/2292118314 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7feb3809c9e0 0x7feb3809cdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:47:53.543 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:53.541+0000 7feb3d35e640 1 -- 172.21.15.150:0/2292118314 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7feb20003a50 msgr2=0x7feb3815b5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:47:53.544 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:53.541+0000 7feb3d35e640 1 --2- 172.21.15.150:0/2292118314 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7feb20003a50 0x7feb3815b5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:47:53.544 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:53.541+0000 7feb3d35e640 1 -- 172.21.15.150:0/2292118314 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feb38153760 con 0x7feb381f5ca0 2024-09-17T05:47:53.544 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:53.541+0000 7feb3e360640 1 --2- 172.21.15.150:0/2292118314 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7feb3809c9e0 0x7feb3809cdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T05:47:53.544 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:53.541+0000 7feb3db5f640 1 --2- 172.21.15.150:0/2292118314 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7feb20003a50 0x7feb3815b5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T05:47:53.544 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:53.541+0000 7feb3d35e640 1 --2- 172.21.15.150:0/2292118314 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7feb381f5ca0 0x7feb3809c4a0 secure :-1 s=READY pgs=941 cs=0 l=1 rev1=1 crypto rx=0x7feb2c003ed0 tx=0x7feb2c001630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:47:53.544 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:53.541+0000 7feb367fc640 1 -- 172.21.15.150:0/2292118314 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb2c015070 con 0x7feb381f5ca0 2024-09-17T05:47:53.544 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:53.541+0000 7feb367fc640 1 -- 172.21.15.150:0/2292118314 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7feb2c011840 con 0x7feb381f5ca0 2024-09-17T05:47:53.544 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:53.541+0000 7feb3fdc3640 1 -- 172.21.15.150:0/2292118314 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feb38154790 con 0x7feb381f5ca0 2024-09-17T05:47:53.544 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:53.541+0000 7feb367fc640 1 -- 172.21.15.150:0/2292118314 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb2c011c50 con 0x7feb381f5ca0 2024-09-17T05:47:53.544 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:53.541+0000 7feb3fdc3640 1 -- 172.21.15.150:0/2292118314 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feb38153cb0 con 0x7feb381f5ca0 2024-09-17T05:47:53.545 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:53.542+0000 7feb3fdc3640 1 -- 172.21.15.150:0/2292118314 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7feb3815fb70 con 0x7feb381f5ca0 2024-09-17T05:47:53.545 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:53.543+0000 7feb367fc640 1 -- 172.21.15.150:0/2292118314 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 25) ==== 103022+0+0 (secure 0 0 0) 0x7feb2c018070 con 0x7feb381f5ca0 2024-09-17T05:47:53.545 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:53.544+0000 7feb367fc640 1 --2- 172.21.15.150:0/2292118314 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7feb24079d00 0x7feb2407c210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:47:53.545 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:53.544+0000 7feb367fc640 1 -- 172.21.15.150:0/2292118314 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 5937+0+0 (secure 0 0 0) 0x7feb2c09a740 con 0x7feb381f5ca0 2024-09-17T05:47:53.546 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:53.544+0000 7feb3db5f640 1 --2- 172.21.15.150:0/2292118314 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7feb24079d00 0x7feb2407c210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:47:53.546 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:53.545+0000 7feb3db5f640 1 --2- 172.21.15.150:0/2292118314 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7feb24079d00 0x7feb2407c210 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7feb28035000 tx=0x7feb280046c0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:47:53.549 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:53.548+0000 7feb367fc640 1 -- 172.21.15.150:0/2292118314 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7feb2c064370 con 0x7feb381f5ca0 2024-09-17T05:47:53.760 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:53.760+0000 7feb3fdc3640 1 -- 172.21.15.150:0/2292118314 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7feb380cfcf0 con 0x7feb381f5ca0 2024-09-17T05:47:53.761 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:53.760+0000 7feb367fc640 1 -- 172.21.15.150:0/2292118314 <== mon.0 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 43 v43) ==== 94+0+5237 (secure 0 0 0) 0x7feb2c063c70 con 0x7feb381f5ca0 2024-09-17T05:47:53.761 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-09-17T05:47:53.761 INFO:teuthology.orchestra.run.smithi150.stdout:{"epoch":43,"btime":"2024-09-17T05:47:03:788551+0000","default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5639,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6836/3422557079","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6834","nonce":3422557079},{"type":"v1","addr":"172.21.15.176:6836","nonce":3422557079}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":38},{"gid":6070,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6837/2283556368","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6835","nonce":2283556368},{"type":"v1","addr":"172.21.15.176:6837","nonce":2283556368}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":38},{"gid":6495,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6834/4130242651","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6832","nonce":4130242651},{"type":"v1","addr":"172.21.15.150:6834","nonce":4130242651}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":37}],"filesystems":[{"mdsmap":{"epoch":42,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T05:46:50.910842+0000","modified":"2024-09-17T05:46:53.930100+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6498},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6498":{"gid":6498,"name":"a","rank":0,"incarnation":39,"state":"up:active","state_seq":3,"addr":"172.21.15.150:6835/4215563116","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6833","nonce":4215563116},{"type":"v1","addr":"172.21.15.150:6835","nonce":4215563116}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6498,"qdb_cluster":[6498]},"id":5}]} 2024-09-17T05:47:53.761 INFO:teuthology.orchestra.run.smithi150.stderr:dumped fsmap epoch 43 2024-09-17T05:47:53.763 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:53.762+0000 7feb3fdc3640 1 -- 172.21.15.150:0/2292118314 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7feb24079d00 msgr2=0x7feb2407c210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:47:53.763 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:53.762+0000 7feb3fdc3640 1 --2- 172.21.15.150:0/2292118314 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7feb24079d00 0x7feb2407c210 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7feb28035000 tx=0x7feb280046c0 comp rx=0 tx=0).stop 2024-09-17T05:47:53.763 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:53.762+0000 7feb3fdc3640 1 -- 172.21.15.150:0/2292118314 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7feb381f5ca0 msgr2=0x7feb3809c4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:47:53.764 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:53.762+0000 7feb3fdc3640 1 --2- 172.21.15.150:0/2292118314 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7feb381f5ca0 0x7feb3809c4a0 secure :-1 s=READY pgs=941 cs=0 l=1 rev1=1 crypto rx=0x7feb2c003ed0 tx=0x7feb2c001630 comp rx=0 tx=0).stop 2024-09-17T05:47:53.764 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:53.762+0000 7feb3fdc3640 1 -- 172.21.15.150:0/2292118314 shutdown_connections 2024-09-17T05:47:53.764 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:53.762+0000 7feb3fdc3640 1 --2- 172.21.15.150:0/2292118314 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7feb24079d00 0x7feb2407c210 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:47:53.764 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:53.762+0000 7feb3fdc3640 1 --2- 172.21.15.150:0/2292118314 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7feb3809c9e0 0x7feb3809cdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:47:53.764 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:53.762+0000 7feb3fdc3640 1 --2- 172.21.15.150:0/2292118314 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7feb381f5ca0 0x7feb3809c4a0 unknown :-1 s=CLOSED pgs=941 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:47:53.764 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:53.762+0000 7feb3fdc3640 1 --2- 172.21.15.150:0/2292118314 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7feb20003a50 0x7feb3815b5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:47:53.764 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:53.762+0000 7feb3fdc3640 1 -- 172.21.15.150:0/2292118314 >> 172.21.15.150:0/2292118314 conn(0x7feb3806d730 msgr2=0x7feb38150030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:47:53.764 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:53.762+0000 7feb3fdc3640 1 -- 172.21.15.150:0/2292118314 shutdown_connections 2024-09-17T05:47:53.764 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:53.762+0000 7feb3fdc3640 1 -- 172.21.15.150:0/2292118314 wait complete. 2024-09-17T05:47:53.775 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T05:47:53.889 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:53.887+0000 7f61c76bd640 1 -- 172.21.15.150:0/3204920956 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f61c00d15d0 msgr2=0x7f61c00cf470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:47:53.889 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:53.887+0000 7f61c76bd640 1 --2- 172.21.15.150:0/3204920956 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f61c00d15d0 0x7f61c00cf470 secure :-1 s=READY pgs=942 cs=0 l=1 rev1=1 crypto rx=0x7f61c008e360 tx=0x7f61b802a560 comp rx=0 tx=0).stop 2024-09-17T05:47:53.889 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:53.887+0000 7f61c76bd640 1 -- 172.21.15.150:0/3204920956 shutdown_connections 2024-09-17T05:47:53.889 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:53.887+0000 7f61c76bd640 1 --2- 172.21.15.150:0/3204920956 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f61c00d15d0 0x7f61c00cf470 unknown :-1 s=CLOSED pgs=942 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:47:53.889 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:53.887+0000 7f61c76bd640 1 --2- 172.21.15.150:0/3204920956 >> v2:172.21.15.176:3300/0 conn(0x7f61c00b3720 0x7f61c00d1090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:47:53.889 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:53.887+0000 7f61c76bd640 1 -- 172.21.15.150:0/3204920956 >> 172.21.15.150:0/3204920956 conn(0x7f61c00d4680 msgr2=0x7f61c00d4a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:47:53.889 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:53.887+0000 7f61c76bd640 1 -- 172.21.15.150:0/3204920956 shutdown_connections 2024-09-17T05:47:53.889 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:53.887+0000 7f61c76bd640 1 -- 172.21.15.150:0/3204920956 wait complete. 2024-09-17T05:47:53.890 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:53.889+0000 7f61c76bd640 1 Processor -- start 2024-09-17T05:47:53.890 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:53.889+0000 7f61c76bd640 1 -- start start 2024-09-17T05:47:53.892 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:53.890+0000 7f61c76bd640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f61c00b3720 0x7f61c014c8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:47:53.892 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:53.890+0000 7f61c76bd640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f61c00b9780 0x7f61c00a0250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:47:53.892 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:53.890+0000 7f61c76bd640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f61c00d15d0 0x7f61c0159b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:47:53.892 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:53.890+0000 7f61c76bd640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f61c00cfd40 con 0x7f61c00b9780 2024-09-17T05:47:53.892 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:53.890+0000 7f61c76bd640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f61c00cfbc0 con 0x7f61c00b3720 2024-09-17T05:47:53.892 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:53.890+0000 7f61c76bd640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f61c00cfec0 con 0x7f61c00d15d0 2024-09-17T05:47:53.892 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:53.890+0000 7f61c4c58640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f61c00b9780 0x7f61c00a0250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:47:53.892 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:53.890+0000 7f61c4c58640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f61c00b9780 0x7f61c00a0250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:43234/0 (socket says 172.21.15.150:43234) 2024-09-17T05:47:53.892 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:53.890+0000 7f61c4c58640 1 -- 172.21.15.150:0/3270942583 learned_addr learned my addr 172.21.15.150:0/3270942583 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:47:53.892 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:53.890+0000 7f61c5459640 1 --2- 172.21.15.150:0/3270942583 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f61c00b3720 0x7f61c014c8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:47:53.892 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:53.890+0000 7f61c5c5a640 1 --2- 172.21.15.150:0/3270942583 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f61c00d15d0 0x7f61c0159b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:47:53.892 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:53.890+0000 7f61c4c58640 1 -- 172.21.15.150:0/3270942583 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f61c00d15d0 msgr2=0x7f61c0159b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:47:53.893 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:53.890+0000 7f61c4c58640 1 --2- 172.21.15.150:0/3270942583 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f61c00d15d0 0x7f61c0159b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:47:53.893 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:53.890+0000 7f61c4c58640 1 -- 172.21.15.150:0/3270942583 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f61c00b3720 msgr2=0x7f61c014c8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:47:53.893 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:53.890+0000 7f61c4c58640 1 --2- 172.21.15.150:0/3270942583 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f61c00b3720 0x7f61c014c8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:47:53.893 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:53.890+0000 7f61c4c58640 1 -- 172.21.15.150:0/3270942583 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f61c01f98f0 con 0x7f61c00b9780 2024-09-17T05:47:53.893 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:53.890+0000 7f61c5c5a640 1 --2- 172.21.15.150:0/3270942583 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f61c00d15d0 0x7f61c0159b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T05:47:53.893 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:53.891+0000 7f61c5459640 1 --2- 172.21.15.150:0/3270942583 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f61c00b3720 0x7f61c014c8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T05:47:53.893 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:53.891+0000 7f61c4c58640 1 --2- 172.21.15.150:0/3270942583 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f61c00b9780 0x7f61c00a0250 secure :-1 s=READY pgs=943 cs=0 l=1 rev1=1 crypto rx=0x7f61b000e790 tx=0x7f61b000ec50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:47:53.893 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:53.891+0000 7f61b5ffb640 1 -- 172.21.15.150:0/3270942583 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61b000eea0 con 0x7f61c00b9780 2024-09-17T05:47:53.893 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:53.891+0000 7f61b5ffb640 1 -- 172.21.15.150:0/3270942583 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f61b000cdb0 con 0x7f61c00b9780 2024-09-17T05:47:53.893 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:53.891+0000 7f61c76bd640 1 -- 172.21.15.150:0/3270942583 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f61c01f9bd0 con 0x7f61c00b9780 2024-09-17T05:47:53.893 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:53.891+0000 7f61b5ffb640 1 -- 172.21.15.150:0/3270942583 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61b0010690 con 0x7f61c00b9780 2024-09-17T05:47:53.893 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:53.891+0000 7f61c76bd640 1 -- 172.21.15.150:0/3270942583 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f61c01fa190 con 0x7f61c00b9780 2024-09-17T05:47:53.894 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:53.892+0000 7f61c76bd640 1 -- 172.21.15.150:0/3270942583 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f61c008d100 con 0x7f61c00b9780 2024-09-17T05:47:53.894 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:53.893+0000 7f61b5ffb640 1 -- 172.21.15.150:0/3270942583 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 25) ==== 103022+0+0 (secure 0 0 0) 0x7f61b0010830 con 0x7f61c00b9780 2024-09-17T05:47:53.894 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:53.893+0000 7f61b5ffb640 1 --2- 172.21.15.150:0/3270942583 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f61a4079d00 0x7f61a407c210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:47:53.894 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:53.894+0000 7f61b5ffb640 1 -- 172.21.15.150:0/3270942583 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 5937+0+0 (secure 0 0 0) 0x7f61b009a560 con 0x7f61c00b9780 2024-09-17T05:47:53.894 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:53.894+0000 7f61c5459640 1 --2- 172.21.15.150:0/3270942583 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f61a4079d00 0x7f61a407c210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:47:53.895 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:53.894+0000 7f61c5459640 1 --2- 172.21.15.150:0/3270942583 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f61a4079d00 0x7f61a407c210 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f61bc007fd0 tx=0x7f61bc009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:47:53.898 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:53.898+0000 7f61b5ffb640 1 -- 172.21.15.150:0/3270942583 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f61c008d100 con 0x7f61c00b9780 2024-09-17T05:47:54.106 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:54.106+0000 7f61c76bd640 1 -- 172.21.15.150:0/3270942583 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f61c00d1090 con 0x7f61c00b9780 2024-09-17T05:47:54.107 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:54.106+0000 7f61b5ffb640 1 -- 172.21.15.150:0/3270942583 <== mon.0 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 43 v43) ==== 94+0+5237 (secure 0 0 0) 0x7f61b0064190 con 0x7f61c00b9780 2024-09-17T05:47:54.107 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-09-17T05:47:54.107 INFO:teuthology.orchestra.run.smithi150.stdout:{"epoch":43,"btime":"2024-09-17T05:47:03:788551+0000","default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5639,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6836/3422557079","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6834","nonce":3422557079},{"type":"v1","addr":"172.21.15.176:6836","nonce":3422557079}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":38},{"gid":6070,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6837/2283556368","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6835","nonce":2283556368},{"type":"v1","addr":"172.21.15.176:6837","nonce":2283556368}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":38},{"gid":6495,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6834/4130242651","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6832","nonce":4130242651},{"type":"v1","addr":"172.21.15.150:6834","nonce":4130242651}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":37}],"filesystems":[{"mdsmap":{"epoch":42,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T05:46:50.910842+0000","modified":"2024-09-17T05:46:53.930100+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6498},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6498":{"gid":6498,"name":"a","rank":0,"incarnation":39,"state":"up:active","state_seq":3,"addr":"172.21.15.150:6835/4215563116","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6833","nonce":4215563116},{"type":"v1","addr":"172.21.15.150:6835","nonce":4215563116}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6498,"qdb_cluster":[6498]},"id":5}]} 2024-09-17T05:47:54.107 INFO:teuthology.orchestra.run.smithi150.stderr:dumped fsmap epoch 43 2024-09-17T05:47:54.110 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:54.109+0000 7f61c76bd640 1 -- 172.21.15.150:0/3270942583 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f61a4079d00 msgr2=0x7f61a407c210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:47:54.110 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:54.109+0000 7f61c76bd640 1 --2- 172.21.15.150:0/3270942583 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f61a4079d00 0x7f61a407c210 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f61bc007fd0 tx=0x7f61bc009040 comp rx=0 tx=0).stop 2024-09-17T05:47:54.110 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:54.109+0000 7f61c76bd640 1 -- 172.21.15.150:0/3270942583 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f61c00b9780 msgr2=0x7f61c00a0250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:47:54.110 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:54.109+0000 7f61c76bd640 1 --2- 172.21.15.150:0/3270942583 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f61c00b9780 0x7f61c00a0250 secure :-1 s=READY pgs=943 cs=0 l=1 rev1=1 crypto rx=0x7f61b000e790 tx=0x7f61b000ec50 comp rx=0 tx=0).stop 2024-09-17T05:47:54.110 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:54.109+0000 7f61c76bd640 1 -- 172.21.15.150:0/3270942583 shutdown_connections 2024-09-17T05:47:54.110 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:54.109+0000 7f61c76bd640 1 --2- 172.21.15.150:0/3270942583 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f61a4079d00 0x7f61a407c210 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:47:54.110 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:54.109+0000 7f61c76bd640 1 --2- 172.21.15.150:0/3270942583 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f61c00d15d0 0x7f61c0159b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:47:54.110 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:54.109+0000 7f61c76bd640 1 --2- 172.21.15.150:0/3270942583 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f61c00b9780 0x7f61c00a0250 unknown :-1 s=CLOSED pgs=943 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:47:54.110 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:54.109+0000 7f61c76bd640 1 --2- 172.21.15.150:0/3270942583 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f61c00b3720 0x7f61c014c8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:47:54.110 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:54.109+0000 7f61c76bd640 1 -- 172.21.15.150:0/3270942583 >> 172.21.15.150:0/3270942583 conn(0x7f61c00d4680 msgr2=0x7f61c00ce520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:47:54.110 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:54.109+0000 7f61c76bd640 1 -- 172.21.15.150:0/3270942583 shutdown_connections 2024-09-17T05:47:54.110 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:54.109+0000 7f61c76bd640 1 -- 172.21.15.150:0/3270942583 wait complete. 2024-09-17T05:47:54.121 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T05:47:54.236 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:54.235+0000 7fd29f3da640 1 -- 172.21.15.150:0/81201790 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd284004800 msgr2=0x7fd284004c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:47:54.237 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:54.235+0000 7fd29f3da640 1 --2- 172.21.15.150:0/81201790 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd284004800 0x7fd284004c10 secure :-1 s=READY pgs=945 cs=0 l=1 rev1=1 crypto rx=0x7fd28800bb20 tx=0x7fd284005830 comp rx=0 tx=0).stop 2024-09-17T05:47:54.237 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:54.235+0000 7fd29d977640 1 -- 172.21.15.150:0/81201790 reap_dead start 2024-09-17T05:47:54.237 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:54.235+0000 7fd29f3da640 1 -- 172.21.15.150:0/81201790 shutdown_connections 2024-09-17T05:47:54.237 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:54.235+0000 7fd29f3da640 1 -- 172.21.15.150:0/81201790 >> 172.21.15.150:0/81201790 conn(0x7fd2980cee90 msgr2=0x7fd2980cf2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:47:54.237 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:54.236+0000 7fd29f3da640 1 -- 172.21.15.150:0/81201790 shutdown_connections 2024-09-17T05:47:54.237 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:54.236+0000 7fd29f3da640 1 -- 172.21.15.150:0/81201790 wait complete. 2024-09-17T05:47:54.238 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:54.237+0000 7fd29f3da640 1 Processor -- start 2024-09-17T05:47:54.238 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:54.237+0000 7fd29f3da640 1 -- start start 2024-09-17T05:47:54.240 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:54.239+0000 7fd29f3da640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd284004800 0x7fd2981d2280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:47:54.241 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:54.239+0000 7fd29f3da640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd2981d4270 0x7fd29809f190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:47:54.241 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:54.239+0000 7fd29f3da640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd29809f6d0 0x7fd2980cb440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:47:54.241 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:54.239+0000 7fd29f3da640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7fd2980b5d30 con 0x7fd2981d4270 2024-09-17T05:47:54.241 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:54.239+0000 7fd29f3da640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fd2980b5bb0 con 0x7fd29809f6d0 2024-09-17T05:47:54.241 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:54.239+0000 7fd29f3da640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fd2980b5eb0 con 0x7fd284004800 2024-09-17T05:47:54.241 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:54.239+0000 7fd29c975640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd2981d4270 0x7fd29809f190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:47:54.241 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:54.239+0000 7fd29c975640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd2981d4270 0x7fd29809f190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:43240/0 (socket says 172.21.15.150:43240) 2024-09-17T05:47:54.241 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:54.239+0000 7fd29c975640 1 -- 172.21.15.150:0/2399359689 learned_addr learned my addr 172.21.15.150:0/2399359689 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:47:54.241 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:54.239+0000 7fd29d977640 1 --2- 172.21.15.150:0/2399359689 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd29809f6d0 0x7fd2980cb440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:47:54.241 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:54.239+0000 7fd29d176640 1 --2- 172.21.15.150:0/2399359689 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd284004800 0x7fd2981d2280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:47:54.241 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:54.239+0000 7fd29c975640 1 -- 172.21.15.150:0/2399359689 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd284004800 msgr2=0x7fd2981d2280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:47:54.241 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:54.239+0000 7fd29c975640 1 --2- 172.21.15.150:0/2399359689 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd284004800 0x7fd2981d2280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:47:54.241 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:54.239+0000 7fd29c975640 1 -- 172.21.15.150:0/2399359689 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd29809f6d0 msgr2=0x7fd2980cb440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:47:54.242 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:54.239+0000 7fd29c975640 1 --2- 172.21.15.150:0/2399359689 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd29809f6d0 0x7fd2980cb440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:47:54.242 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:54.239+0000 7fd29c975640 1 -- 172.21.15.150:0/2399359689 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd2981d4a10 con 0x7fd2981d4270 2024-09-17T05:47:54.242 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:54.239+0000 7fd29c975640 1 --2- 172.21.15.150:0/2399359689 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd2981d4270 0x7fd29809f190 secure :-1 s=READY pgs=946 cs=0 l=1 rev1=1 crypto rx=0x7fd288034040 tx=0x7fd288031430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:47:54.242 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:54.239+0000 7fd28dffb640 1 -- 172.21.15.150:0/2399359689 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd288040070 con 0x7fd2981d4270 2024-09-17T05:47:54.242 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:54.239+0000 7fd28dffb640 1 -- 172.21.15.150:0/2399359689 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd288004230 con 0x7fd2981d4270 2024-09-17T05:47:54.242 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:54.239+0000 7fd29f3da640 1 -- 172.21.15.150:0/2399359689 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd2981d4cf0 con 0x7fd2981d4270 2024-09-17T05:47:54.242 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:54.239+0000 7fd28dffb640 1 -- 172.21.15.150:0/2399359689 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd288035040 con 0x7fd2981d4270 2024-09-17T05:47:54.242 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:54.240+0000 7fd29f3da640 1 -- 172.21.15.150:0/2399359689 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd2980af260 con 0x7fd2981d4270 2024-09-17T05:47:54.243 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:54.241+0000 7fd29f3da640 1 -- 172.21.15.150:0/2399359689 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd2981d4780 con 0x7fd2981d4270 2024-09-17T05:47:54.243 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:54.241+0000 7fd28dffb640 1 -- 172.21.15.150:0/2399359689 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 25) ==== 103022+0+0 (secure 0 0 0) 0x7fd288038020 con 0x7fd2981d4270 2024-09-17T05:47:54.243 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:54.242+0000 7fd28dffb640 1 --2- 172.21.15.150:0/2399359689 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fd27c079d00 0x7fd27c07c210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:47:54.243 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:54.242+0000 7fd28dffb640 1 -- 172.21.15.150:0/2399359689 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 5937+0+0 (secure 0 0 0) 0x7fd2880ba8e0 con 0x7fd2981d4270 2024-09-17T05:47:54.243 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:54.242+0000 7fd29d176640 1 --2- 172.21.15.150:0/2399359689 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fd27c079d00 0x7fd27c07c210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:47:54.243 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:54.243+0000 7fd29d176640 1 --2- 172.21.15.150:0/2399359689 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fd27c079d00 0x7fd27c07c210 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7fd294001460 tx=0x7fd294001250 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:47:54.247 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:54.246+0000 7fd28dffb640 1 -- 172.21.15.150:0/2399359689 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fd288083ec0 con 0x7fd2981d4270 2024-09-17T05:47:54.422 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:54.421+0000 7fd29f3da640 1 -- 172.21.15.150:0/2399359689 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fd2981d5210 con 0x7fd2981d4270 2024-09-17T05:47:54.423 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:54.423+0000 7fd28dffb640 1 -- 172.21.15.150:0/2399359689 <== mon.0 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v75) ==== 74+0+17155 (secure 0 0 0) 0x7fd2981d5210 con 0x7fd2981d4270 2024-09-17T05:47:54.423 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-09-17T05:47:54.424 INFO:teuthology.orchestra.run.smithi150.stdout:{"epoch":75,"fsid":"9f2e05e9-d629-47b3-b26b-1360655b7d20","created":"2024-09-17T05:41:32.502979+0000","modified":"2024-09-17T05:47:52.132588+0000","last_up_change":"2024-09-17T05:41:46.150225+0000","last_in_change":"2024-09-17T05:41:36.120274+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T05:41:46.860779+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_metadata","create_time":"2024-09-17T05:46:48.549801+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"71","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs_data","create_time":"2024-09-17T05:46:49.868230+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"75","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":3,"snap_epoch":75,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"4f31c018-c8a4-4d6d-b0c2-a597c47aae4a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6800","nonce":479374392},{"type":"v1","addr":"172.21.15.150:6801","nonce":479374392}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6802","nonce":479374392},{"type":"v1","addr":"172.21.15.150:6803","nonce":479374392}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6806","nonce":479374392},{"type":"v1","addr":"172.21.15.150:6807","nonce":479374392}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6804","nonce":479374392},{"type":"v1","addr":"172.21.15.150:6805","nonce":479374392}]},"public_addr":"172.21.15.150:6801/479374392","cluster_addr":"172.21.15.150:6803/479374392","heartbeat_back_addr":"172.21.15.150:6807/479374392","heartbeat_front_addr":"172.21.15.150:6805/479374392","state":["exists","up"]},{"osd":1,"uuid":"6ff4a573-500b-4e04-9de3-39265ead78b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6824","nonce":913899800},{"type":"v1","addr":"172.21.15.150:6825","nonce":913899800}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6826","nonce":913899800},{"type":"v1","addr":"172.21.15.150:6827","nonce":913899800}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6830","nonce":913899800},{"type":"v1","addr":"172.21.15.150:6831","nonce":913899800}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6828","nonce":913899800},{"type":"v1","addr":"172.21.15.150:6829","nonce":913899800}]},"public_addr":"172.21.15.150:6825/913899800","cluster_addr":"172.21.15.150:6827/913899800","heartbeat_back_addr":"172.21.15.150:6831/913899800","heartbeat_front_addr":"172.21.15.150:6829/913899800","state":["exists","up"]},{"osd":2,"uuid":"bffea6f9-2465-4182-b205-00436c41ac1c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6816","nonce":363718461},{"type":"v1","addr":"172.21.15.150:6817","nonce":363718461}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6818","nonce":363718461},{"type":"v1","addr":"172.21.15.150:6819","nonce":363718461}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6822","nonce":363718461},{"type":"v1","addr":"172.21.15.150:6823","nonce":363718461}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6820","nonce":363718461},{"type":"v1","addr":"172.21.15.150:6821","nonce":363718461}]},"public_addr":"172.21.15.150:6817/363718461","cluster_addr":"172.21.15.150:6819/363718461","heartbeat_back_addr":"172.21.15.150:6823/363718461","heartbeat_front_addr":"172.21.15.150:6821/363718461","state":["exists","up"]},{"osd":3,"uuid":"cda70430-d1e1-427e-b04e-56db4031d078","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6808","nonce":3550994626},{"type":"v1","addr":"172.21.15.150:6809","nonce":3550994626}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6810","nonce":3550994626},{"type":"v1","addr":"172.21.15.150:6811","nonce":3550994626}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6814","nonce":3550994626},{"type":"v1","addr":"172.21.15.150:6815","nonce":3550994626}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6812","nonce":3550994626},{"type":"v1","addr":"172.21.15.150:6813","nonce":3550994626}]},"public_addr":"172.21.15.150:6809/3550994626","cluster_addr":"172.21.15.150:6811/3550994626","heartbeat_back_addr":"172.21.15.150:6815/3550994626","heartbeat_front_addr":"172.21.15.150:6813/3550994626","state":["exists","up"]},{"osd":4,"uuid":"3a0277fb-5e1e-4f68-bb2d-9a8a0152f64a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6810","nonce":2718261497},{"type":"v1","addr":"172.21.15.176:6811","nonce":2718261497}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6812","nonce":2718261497},{"type":"v1","addr":"172.21.15.176:6813","nonce":2718261497}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6816","nonce":2718261497},{"type":"v1","addr":"172.21.15.176:6817","nonce":2718261497}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6814","nonce":2718261497},{"type":"v1","addr":"172.21.15.176:6815","nonce":2718261497}]},"public_addr":"172.21.15.176:6811/2718261497","cluster_addr":"172.21.15.176:6813/2718261497","heartbeat_back_addr":"172.21.15.176:6817/2718261497","heartbeat_front_addr":"172.21.15.176:6815/2718261497","state":["exists","up"]},{"osd":5,"uuid":"33aebee6-0315-40b7-a11c-6702f0be494d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6818","nonce":2049295774},{"type":"v1","addr":"172.21.15.176:6819","nonce":2049295774}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6820","nonce":2049295774},{"type":"v1","addr":"172.21.15.176:6821","nonce":2049295774}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6824","nonce":2049295774},{"type":"v1","addr":"172.21.15.176:6825","nonce":2049295774}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6822","nonce":2049295774},{"type":"v1","addr":"172.21.15.176:6823","nonce":2049295774}]},"public_addr":"172.21.15.176:6819/2049295774","cluster_addr":"172.21.15.176:6821/2049295774","heartbeat_back_addr":"172.21.15.176:6825/2049295774","heartbeat_front_addr":"172.21.15.176:6823/2049295774","state":["exists","up"]},{"osd":6,"uuid":"4d24f360-6751-4263-841b-d77793d33540","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6826","nonce":2164458476},{"type":"v1","addr":"172.21.15.176:6827","nonce":2164458476}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6828","nonce":2164458476},{"type":"v1","addr":"172.21.15.176:6829","nonce":2164458476}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6832","nonce":2164458476},{"type":"v1","addr":"172.21.15.176:6833","nonce":2164458476}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6830","nonce":2164458476},{"type":"v1","addr":"172.21.15.176:6831","nonce":2164458476}]},"public_addr":"172.21.15.176:6827/2164458476","cluster_addr":"172.21.15.176:6829/2164458476","heartbeat_back_addr":"172.21.15.176:6833/2164458476","heartbeat_front_addr":"172.21.15.176:6831/2164458476","state":["exists","up"]},{"osd":7,"uuid":"c8594fda-c74a-4ba9-8277-caf101d58ca1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6802","nonce":3239587708},{"type":"v1","addr":"172.21.15.176:6803","nonce":3239587708}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6804","nonce":3239587708},{"type":"v1","addr":"172.21.15.176:6805","nonce":3239587708}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6808","nonce":3239587708},{"type":"v1","addr":"172.21.15.176:6809","nonce":3239587708}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6806","nonce":3239587708},{"type":"v1","addr":"172.21.15.176:6807","nonce":3239587708}]},"public_addr":"172.21.15.176:6803/3239587708","cluster_addr":"172.21.15.176:6805/3239587708","heartbeat_back_addr":"172.21.15.176:6809/3239587708","heartbeat_front_addr":"172.21.15.176:6807/3239587708","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:41:41.905151+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:41:42.705679+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:41:42.459673+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:41:42.440819+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:41:42.668428+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:41:42.694972+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:41:43.078535+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:41:42.363539+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"11.3","mappings":[{"from":6,"to":0}]},{"pgid":"11.10","mappings":[{"from":6,"to":1}]},{"pgid":"11.17","mappings":[{"from":6,"to":5}]},{"pgid":"11.30","mappings":[{"from":6,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":7,"snaps":[{"begin":2,"length":2}]},{"pool":9,"snaps":[{"begin":2,"length":2}]},{"pool":11,"snaps":[{"begin":2,"length":2}]}],"new_removed_snaps":[{"pool":11,"snaps":[{"begin":2,"length":2}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T05:47:54.426 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:54.425+0000 7fd29f3da640 1 -- 172.21.15.150:0/2399359689 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fd27c079d00 msgr2=0x7fd27c07c210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:47:54.426 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:54.425+0000 7fd29f3da640 1 --2- 172.21.15.150:0/2399359689 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fd27c079d00 0x7fd27c07c210 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7fd294001460 tx=0x7fd294001250 comp rx=0 tx=0).stop 2024-09-17T05:47:54.426 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:54.425+0000 7fd29f3da640 1 -- 172.21.15.150:0/2399359689 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd2981d4270 msgr2=0x7fd29809f190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:47:54.426 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:54.425+0000 7fd29f3da640 1 --2- 172.21.15.150:0/2399359689 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd2981d4270 0x7fd29809f190 secure :-1 s=READY pgs=946 cs=0 l=1 rev1=1 crypto rx=0x7fd288034040 tx=0x7fd288031430 comp rx=0 tx=0).stop 2024-09-17T05:47:54.426 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:54.425+0000 7fd29f3da640 1 -- 172.21.15.150:0/2399359689 shutdown_connections 2024-09-17T05:47:54.426 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:54.425+0000 7fd29f3da640 1 --2- 172.21.15.150:0/2399359689 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd29809f6d0 0x7fd2980cb440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:47:54.426 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:54.425+0000 7fd29f3da640 1 --2- 172.21.15.150:0/2399359689 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fd27c079d00 0x7fd27c07c210 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:47:54.426 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:54.425+0000 7fd29f3da640 1 --2- 172.21.15.150:0/2399359689 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd2981d4270 0x7fd29809f190 unknown :-1 s=CLOSED pgs=946 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:47:54.426 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:54.425+0000 7fd29f3da640 1 --2- 172.21.15.150:0/2399359689 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd284004800 0x7fd2981d2280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:47:54.426 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:54.425+0000 7fd29f3da640 1 -- 172.21.15.150:0/2399359689 >> 172.21.15.150:0/2399359689 conn(0x7fd2980cee90 msgr2=0x7fd298072b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:47:54.426 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:54.425+0000 7fd29f3da640 1 -- 172.21.15.150:0/2399359689 shutdown_connections 2024-09-17T05:47:54.426 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:54.425+0000 7fd29f3da640 1 -- 172.21.15.150:0/2399359689 wait complete. 2024-09-17T05:47:54.438 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-09-17T05:47:54.552 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:54.552+0000 7f89fd0a9640 1 -- 172.21.15.150:0/1036071632 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f89f80d17a0 msgr2=0x7f89f80cf470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:47:54.553 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:54.552+0000 7f89fd0a9640 1 --2- 172.21.15.150:0/1036071632 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f89f80d17a0 0x7f89f80cf470 secure :-1 s=READY pgs=947 cs=0 l=1 rev1=1 crypto rx=0x7f89f80ba730 tx=0x7f89f002aa30 comp rx=0 tx=0).stop 2024-09-17T05:47:54.553 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:54.552+0000 7f89fd0a9640 1 -- 172.21.15.150:0/1036071632 shutdown_connections 2024-09-17T05:47:54.553 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:54.552+0000 7f89fd0a9640 1 --2- 172.21.15.150:0/1036071632 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f89f80d17a0 0x7f89f80cf470 unknown :-1 s=CLOSED pgs=947 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:47:54.553 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:54.552+0000 7f89fd0a9640 1 --2- 172.21.15.150:0/1036071632 >> v2:172.21.15.176:3300/0 conn(0x7f89f80b9780 0x7f89f80b3720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:47:54.553 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:54.552+0000 7f89fd0a9640 1 -- 172.21.15.150:0/1036071632 >> 172.21.15.150:0/1036071632 conn(0x7f89f80d4680 msgr2=0x7f89f80d4a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:47:54.553 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:54.552+0000 7f89fd0a9640 1 -- 172.21.15.150:0/1036071632 shutdown_connections 2024-09-17T05:47:54.553 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:54.552+0000 7f89fd0a9640 1 -- 172.21.15.150:0/1036071632 wait complete. 2024-09-17T05:47:54.555 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:54.554+0000 7f89fd0a9640 1 Processor -- start 2024-09-17T05:47:54.555 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:54.554+0000 7f89fd0a9640 1 -- start start 2024-09-17T05:47:54.557 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:54.555+0000 7f89fd0a9640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f89f80b9780 0x7f89f80a1e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:47:54.557 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:54.555+0000 7f89fd0a9640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f89f815ee50 0x7f89f81f9080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:47:54.557 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:54.555+0000 7f89fd0a9640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f89f81f95c0 0x7f89f814f630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:47:54.557 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:54.555+0000 7f89fd0a9640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f89f80cfd40 con 0x7f89f815ee50 2024-09-17T05:47:54.557 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:54.555+0000 7f89fd0a9640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f89f80cfbc0 con 0x7f89f80b9780 2024-09-17T05:47:54.560 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:54.555+0000 7f89fd0a9640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f89f80cfec0 con 0x7f89f81f95c0 2024-09-17T05:47:54.560 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:54.555+0000 7f89f659c640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f89f815ee50 0x7f89f81f9080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:47:54.560 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:54.556+0000 7f89f659c640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f89f815ee50 0x7f89f81f9080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:43260/0 (socket says 172.21.15.150:43260) 2024-09-17T05:47:54.560 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:54.556+0000 7f89f659c640 1 -- 172.21.15.150:0/3872521302 learned_addr learned my addr 172.21.15.150:0/3872521302 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:47:54.560 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:54.556+0000 7f89f759e640 1 --2- 172.21.15.150:0/3872521302 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f89f81f95c0 0x7f89f814f630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:47:54.560 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:54.556+0000 7f89f6d9d640 1 --2- 172.21.15.150:0/3872521302 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f89f80b9780 0x7f89f80a1e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:47:54.560 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:54.556+0000 7f89f659c640 1 -- 172.21.15.150:0/3872521302 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f89f81f95c0 msgr2=0x7f89f814f630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:47:54.560 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:54.556+0000 7f89f659c640 1 --2- 172.21.15.150:0/3872521302 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f89f81f95c0 0x7f89f814f630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:47:54.560 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:54.556+0000 7f89f659c640 1 -- 172.21.15.150:0/3872521302 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f89f80b9780 msgr2=0x7f89f80a1e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:47:54.560 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:54.556+0000 7f89f659c640 1 --2- 172.21.15.150:0/3872521302 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f89f80b9780 0x7f89f80a1e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:47:54.561 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:54.556+0000 7f89f659c640 1 -- 172.21.15.150:0/3872521302 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f89f80b6a70 con 0x7f89f815ee50 2024-09-17T05:47:54.561 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:54.556+0000 7f89f659c640 1 --2- 172.21.15.150:0/3872521302 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f89f815ee50 0x7f89f81f9080 secure :-1 s=READY pgs=948 cs=0 l=1 rev1=1 crypto rx=0x7f89ec00c3a0 tx=0x7f89ec00c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:47:54.561 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:54.556+0000 7f89df7fe640 1 -- 172.21.15.150:0/3872521302 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89ec017070 con 0x7f89f815ee50 2024-09-17T05:47:54.561 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:54.556+0000 7f89fd0a9640 1 -- 172.21.15.150:0/3872521302 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f89f80b6d50 con 0x7f89f815ee50 2024-09-17T05:47:54.561 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:54.556+0000 7f89df7fe640 1 -- 172.21.15.150:0/3872521302 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f89ec0053c0 con 0x7f89f815ee50 2024-09-17T05:47:54.561 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:54.556+0000 7f89df7fe640 1 -- 172.21.15.150:0/3872521302 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89ec003850 con 0x7f89f815ee50 2024-09-17T05:47:54.561 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:54.556+0000 7f89fd0a9640 1 -- 172.21.15.150:0/3872521302 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f89f80b44c0 con 0x7f89f815ee50 2024-09-17T05:47:54.562 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:54.558+0000 7f89fd0a9640 1 -- 172.21.15.150:0/3872521302 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f89f808d100 con 0x7f89f815ee50 2024-09-17T05:47:54.562 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:54.558+0000 7f89df7fe640 1 -- 172.21.15.150:0/3872521302 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 25) ==== 103022+0+0 (secure 0 0 0) 0x7f89ec01a070 con 0x7f89f815ee50 2024-09-17T05:47:54.562 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:54.559+0000 7f89df7fe640 1 --2- 172.21.15.150:0/3872521302 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f89e4079d00 0x7f89e407c210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:47:54.562 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:54.559+0000 7f89df7fe640 1 -- 172.21.15.150:0/3872521302 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 5937+0+0 (secure 0 0 0) 0x7f89ec098f90 con 0x7f89f815ee50 2024-09-17T05:47:54.562 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:54.559+0000 7f89f6d9d640 1 --2- 172.21.15.150:0/3872521302 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f89e4079d00 0x7f89e407c210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:47:54.562 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:54.559+0000 7f89f6d9d640 1 --2- 172.21.15.150:0/3872521302 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f89e4079d00 0x7f89e407c210 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f89e8009c00 tx=0x7f89e8005f30 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:47:54.564 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:54.563+0000 7f89df7fe640 1 -- 172.21.15.150:0/3872521302 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f89f808d100 con 0x7f89f815ee50 2024-09-17T05:47:54.776 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:54.775+0000 7f89fd0a9640 1 -- 172.21.15.150:0/3872521302 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7f89f80b6800 con 0x7f89f815ee50 2024-09-17T05:47:54.776 INFO:tasks.ceph.mon.a.smithi150.stderr:2024-09-17T05:47:54.776+0000 7f73931ae640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-17T05:47:54.778 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:54.777+0000 7f89df7fe640 1 -- 172.21.15.150:0/3872521302 <== mon.0 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v44) ==== 161+0+0 (secure 0 0 0) 0x7f89ec062460 con 0x7f89f815ee50 2024-09-17T05:47:54.778 INFO:teuthology.orchestra.run.smithi150.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-09-17T05:47:54.782 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:54.781+0000 7f89fd0a9640 1 -- 172.21.15.150:0/3872521302 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f89e4079d00 msgr2=0x7f89e407c210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:47:54.782 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:54.781+0000 7f89fd0a9640 1 --2- 172.21.15.150:0/3872521302 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f89e4079d00 0x7f89e407c210 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f89e8009c00 tx=0x7f89e8005f30 comp rx=0 tx=0).stop 2024-09-17T05:47:54.782 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:54.781+0000 7f89fd0a9640 1 -- 172.21.15.150:0/3872521302 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f89f815ee50 msgr2=0x7f89f81f9080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:47:54.782 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:54.781+0000 7f89fd0a9640 1 --2- 172.21.15.150:0/3872521302 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f89f815ee50 0x7f89f81f9080 secure :-1 s=READY pgs=948 cs=0 l=1 rev1=1 crypto rx=0x7f89ec00c3a0 tx=0x7f89ec00c860 comp rx=0 tx=0).stop 2024-09-17T05:47:54.782 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:54.781+0000 7f89fd0a9640 1 -- 172.21.15.150:0/3872521302 shutdown_connections 2024-09-17T05:47:54.782 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:54.781+0000 7f89fd0a9640 1 --2- 172.21.15.150:0/3872521302 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f89e4079d00 0x7f89e407c210 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:47:54.782 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:54.781+0000 7f89fd0a9640 1 --2- 172.21.15.150:0/3872521302 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f89f81f95c0 0x7f89f814f630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:47:54.783 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:54.781+0000 7f89fd0a9640 1 --2- 172.21.15.150:0/3872521302 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f89f815ee50 0x7f89f81f9080 unknown :-1 s=CLOSED pgs=948 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:47:54.783 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:54.781+0000 7f89fd0a9640 1 --2- 172.21.15.150:0/3872521302 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f89f80b9780 0x7f89f80a1e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:47:54.783 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:54.781+0000 7f89fd0a9640 1 -- 172.21.15.150:0/3872521302 >> 172.21.15.150:0/3872521302 conn(0x7f89f80d4680 msgr2=0x7f89f815ab70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:47:54.783 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:54.781+0000 7f89fd0a9640 1 -- 172.21.15.150:0/3872521302 shutdown_connections 2024-09-17T05:47:54.783 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:54.781+0000 7f89fd0a9640 1 -- 172.21.15.150:0/3872521302 wait complete. 2024-09-17T05:47:54.796 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-09-17T05:47:54.846 INFO:tasks.ceph.mds.a.smithi150.stdout:starting mds.a at 2024-09-17T05:47:54.915 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:54.914+0000 7f82cd357640 1 -- 172.21.15.150:0/681527514 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f82c80d0730 msgr2=0x7f82c80b6160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:47:54.915 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:54.914+0000 7f82cd357640 1 --2- 172.21.15.150:0/681527514 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f82c80d0730 0x7f82c80b6160 secure :-1 s=READY pgs=952 cs=0 l=1 rev1=1 crypto rx=0x7f82c808d600 tx=0x7f82c002aa30 comp rx=0 tx=0).stop 2024-09-17T05:47:54.915 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:54.914+0000 7f82cd357640 1 -- 172.21.15.150:0/681527514 shutdown_connections 2024-09-17T05:47:54.915 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:54.914+0000 7f82cd357640 1 --2- 172.21.15.150:0/681527514 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f82c80d0730 0x7f82c80b6160 unknown :-1 s=CLOSED pgs=952 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:47:54.915 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:54.914+0000 7f82cd357640 1 --2- 172.21.15.150:0/681527514 >> v2:172.21.15.176:3300/0 conn(0x7f82c80d5150 0x7f82c80b9b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:47:54.915 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:54.914+0000 7f82cd357640 1 -- 172.21.15.150:0/681527514 >> 172.21.15.150:0/681527514 conn(0x7f82c808bfe0 msgr2=0x7f82c80d46e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:47:54.915 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:54.914+0000 7f82cd357640 1 -- 172.21.15.150:0/681527514 shutdown_connections 2024-09-17T05:47:54.915 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:54.914+0000 7f82cd357640 1 -- 172.21.15.150:0/681527514 wait complete. 2024-09-17T05:47:54.916 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:54.916+0000 7f82cd357640 1 Processor -- start 2024-09-17T05:47:54.916 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:54.916+0000 7f82cd357640 1 -- start start 2024-09-17T05:47:54.919 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:54.917+0000 7f82cd357640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f82c806dea0 0x7f82c80b51e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:47:54.919 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:54.917+0000 7f82cd357640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f82c80d0730 0x7f82c80b3e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:47:54.919 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:54.917+0000 7f82cd357640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f82c80d5150 0x7f82c80b4380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:47:54.919 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:54.917+0000 7f82cd357640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f82c806e2b0 con 0x7f82c80d0730 2024-09-17T05:47:54.919 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:54.917+0000 7f82cd357640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f82c80d31e0 con 0x7f82c806dea0 2024-09-17T05:47:54.919 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:54.917+0000 7f82cd357640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f82c806e430 con 0x7f82c80d5150 2024-09-17T05:47:54.919 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:54.917+0000 7f82c67fc640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f82c80d0730 0x7f82c80b3e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:47:54.919 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:54.917+0000 7f82c67fc640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f82c80d0730 0x7f82c80b3e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:43284/0 (socket says 172.21.15.150:43284) 2024-09-17T05:47:54.919 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:54.917+0000 7f82c6ffd640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f82c806dea0 0x7f82c80b51e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:47:54.919 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:54.917+0000 7f82c67fc640 1 -- 172.21.15.150:0/549458972 learned_addr learned my addr 172.21.15.150:0/549458972 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:47:54.920 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:54.917+0000 7f82c77fe640 1 --2- 172.21.15.150:0/549458972 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f82c80d5150 0x7f82c80b4380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:47:54.920 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:54.917+0000 7f82c67fc640 1 -- 172.21.15.150:0/549458972 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f82c80d5150 msgr2=0x7f82c80b4380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:47:54.920 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:54.917+0000 7f82c67fc640 1 --2- 172.21.15.150:0/549458972 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f82c80d5150 0x7f82c80b4380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:47:54.920 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:54.917+0000 7f82c67fc640 1 -- 172.21.15.150:0/549458972 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f82c806dea0 msgr2=0x7f82c80b51e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:47:54.920 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:54.917+0000 7f82c67fc640 1 --2- 172.21.15.150:0/549458972 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f82c806dea0 0x7f82c80b51e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:47:54.920 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:54.917+0000 7f82c67fc640 1 -- 172.21.15.150:0/549458972 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f82c815b590 con 0x7f82c80d0730 2024-09-17T05:47:54.920 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:54.918+0000 7f82c67fc640 1 --2- 172.21.15.150:0/549458972 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f82c80d0730 0x7f82c80b3e40 secure :-1 s=READY pgs=953 cs=0 l=1 rev1=1 crypto rx=0x7f82bc00b3f0 tx=0x7f82bc00b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:47:54.920 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:54.918+0000 7f82af7fe640 1 -- 172.21.15.150:0/549458972 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82bc015020 con 0x7f82c80d0730 2024-09-17T05:47:54.920 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:54.918+0000 7f82af7fe640 1 -- 172.21.15.150:0/549458972 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f82bc011920 con 0x7f82c80d0730 2024-09-17T05:47:54.920 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:54.918+0000 7f82cd357640 1 -- 172.21.15.150:0/549458972 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f82c815b850 con 0x7f82c80d0730 2024-09-17T05:47:54.920 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:54.918+0000 7f82af7fe640 1 -- 172.21.15.150:0/549458972 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82bc011d70 con 0x7f82c80d0730 2024-09-17T05:47:54.920 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:54.918+0000 7f82cd357640 1 -- 172.21.15.150:0/549458972 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f82c815df80 con 0x7f82c80d0730 2024-09-17T05:47:54.921 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:54.919+0000 7f82cd357640 1 -- 172.21.15.150:0/549458972 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f82c80b6160 con 0x7f82c80d0730 2024-09-17T05:47:54.922 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:54.919+0000 7f82af7fe640 1 -- 172.21.15.150:0/549458972 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 25) ==== 103022+0+0 (secure 0 0 0) 0x7f82bc018020 con 0x7f82c80d0730 2024-09-17T05:47:54.922 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:54.920+0000 7f82af7fe640 1 --2- 172.21.15.150:0/549458972 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f82b4079d30 0x7f82b407c240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:47:54.922 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:54.920+0000 7f82af7fe640 1 -- 172.21.15.150:0/549458972 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 5995+0+0 (secure 0 0 0) 0x7f82bc099630 con 0x7f82c80d0730 2024-09-17T05:47:54.922 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:54.920+0000 7f82c6ffd640 1 --2- 172.21.15.150:0/549458972 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f82b4079d30 0x7f82b407c240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:47:54.922 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:54.921+0000 7f82c6ffd640 1 --2- 172.21.15.150:0/549458972 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f82b4079d30 0x7f82b407c240 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f82b800bb30 tx=0x7f82b800b2e0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:47:54.925 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:54.925+0000 7f82af7fe640 1 -- 172.21.15.150:0/549458972 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f82bc01f030 con 0x7f82c80d0730 2024-09-17T05:47:55.139 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:55.138+0000 7f82cd357640 1 -- 172.21.15.150:0/549458972 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7f82c80d4f30 con 0x7f82c80d0730 2024-09-17T05:47:55.784 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:55.784+0000 7f82af7fe640 1 -- 172.21.15.150:0/549458972 <== mon.0 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v45) ==== 104+0+0 (secure 0 0 0) 0x7f82bc062c10 con 0x7f82c80d0730 2024-09-17T05:47:55.788 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:55.787+0000 7f82cd357640 1 -- 172.21.15.150:0/549458972 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f82b4079d30 msgr2=0x7f82b407c240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:47:55.789 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:55.787+0000 7f82cd357640 1 --2- 172.21.15.150:0/549458972 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f82b4079d30 0x7f82b407c240 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f82b800bb30 tx=0x7f82b800b2e0 comp rx=0 tx=0).stop 2024-09-17T05:47:55.789 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:55.787+0000 7f82cd357640 1 -- 172.21.15.150:0/549458972 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f82c80d0730 msgr2=0x7f82c80b3e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:47:55.789 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:55.787+0000 7f82cd357640 1 --2- 172.21.15.150:0/549458972 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f82c80d0730 0x7f82c80b3e40 secure :-1 s=READY pgs=953 cs=0 l=1 rev1=1 crypto rx=0x7f82bc00b3f0 tx=0x7f82bc00b8b0 comp rx=0 tx=0).stop 2024-09-17T05:47:55.789 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:55.787+0000 7f82cd357640 1 -- 172.21.15.150:0/549458972 shutdown_connections 2024-09-17T05:47:55.789 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:55.787+0000 7f82cd357640 1 --2- 172.21.15.150:0/549458972 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f82b4079d30 0x7f82b407c240 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:47:55.789 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:55.787+0000 7f82cd357640 1 --2- 172.21.15.150:0/549458972 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f82c80d5150 0x7f82c80b4380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:47:55.789 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:55.787+0000 7f82cd357640 1 --2- 172.21.15.150:0/549458972 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f82c80d0730 0x7f82c80b3e40 unknown :-1 s=CLOSED pgs=953 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:47:55.789 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:55.787+0000 7f82cd357640 1 --2- 172.21.15.150:0/549458972 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f82c806dea0 0x7f82c80b51e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:47:55.789 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:55.787+0000 7f82cd357640 1 -- 172.21.15.150:0/549458972 >> 172.21.15.150:0/549458972 conn(0x7f82c808bfe0 msgr2=0x7f82c80b1e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:47:55.789 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:55.787+0000 7f82cd357640 1 -- 172.21.15.150:0/549458972 shutdown_connections 2024-09-17T05:47:55.789 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:55.787+0000 7f82cd357640 1 -- 172.21.15.150:0/549458972 wait complete. 2024-09-17T05:47:55.800 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-09-17T05:47:55.899 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-17T05:47:55.904 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-17T05:47:55.921 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:55.920+0000 7ff03c5df640 1 -- 172.21.15.150:0/3591296803 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff0340b2e50 msgr2=0x7ff0340d0660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:47:55.921 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:55.920+0000 7ff03c5df640 1 --2- 172.21.15.150:0/3591296803 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff0340b2e50 0x7ff0340d0660 secure :-1 s=READY pgs=954 cs=0 l=1 rev1=1 crypto rx=0x7ff034074070 tx=0x7ff02c02aac0 comp rx=0 tx=0).stop 2024-09-17T05:47:55.921 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:55.920+0000 7ff03c5df640 1 -- 172.21.15.150:0/3591296803 shutdown_connections 2024-09-17T05:47:55.922 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:55.920+0000 7ff03c5df640 1 --2- 172.21.15.150:0/3591296803 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff0340b2e50 0x7ff0340d0660 unknown :-1 s=CLOSED pgs=954 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:47:55.922 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:55.920+0000 7ff03c5df640 1 --2- 172.21.15.150:0/3591296803 >> v2:172.21.15.176:3300/0 conn(0x7ff0340c5be0 0x7ff0340d0120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:47:55.922 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:55.920+0000 7ff03c5df640 1 -- 172.21.15.150:0/3591296803 >> 172.21.15.150:0/3591296803 conn(0x7ff0340cefd0 msgr2=0x7ff0340cf3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:47:55.922 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:55.920+0000 7ff03c5df640 1 -- 172.21.15.150:0/3591296803 shutdown_connections 2024-09-17T05:47:55.922 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:55.920+0000 7ff03c5df640 1 -- 172.21.15.150:0/3591296803 wait complete. 2024-09-17T05:47:55.923 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:55.922+0000 7ff03c5df640 1 Processor -- start 2024-09-17T05:47:55.923 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:55.922+0000 7ff03c5df640 1 -- start start 2024-09-17T05:47:55.925 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:55.923+0000 7ff03c5df640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff0340b2e50 0x7ff0340cbec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:47:55.925 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:55.923+0000 7ff03c5df640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff0340b7a30 0x7ff0341d4df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:47:55.925 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:55.923+0000 7ff03c5df640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff0340c5be0 0x7ff03409e440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:47:55.925 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:55.923+0000 7ff03c5df640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7ff0340cde50 con 0x7ff0340c5be0 2024-09-17T05:47:55.925 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:55.923+0000 7ff03c5df640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7ff0340cdcd0 con 0x7ff0340b2e50 2024-09-17T05:47:55.925 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:55.923+0000 7ff03c5df640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7ff0340cdfd0 con 0x7ff0340b7a30 2024-09-17T05:47:55.926 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:55.923+0000 7ff03ab7c640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff0340c5be0 0x7ff03409e440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:47:55.926 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:55.923+0000 7ff03ab7c640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff0340c5be0 0x7ff03409e440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:43308/0 (socket says 172.21.15.150:43308) 2024-09-17T05:47:55.926 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:55.923+0000 7ff03ab7c640 1 -- 172.21.15.150:0/1325317884 learned_addr learned my addr 172.21.15.150:0/1325317884 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:47:55.926 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:55.923+0000 7ff03a37b640 1 --2- 172.21.15.150:0/1325317884 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff0340b2e50 0x7ff0340cbec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:47:55.926 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:55.923+0000 7ff039b7a640 1 --2- 172.21.15.150:0/1325317884 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff0340b7a30 0x7ff0341d4df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:47:55.926 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:55.924+0000 7ff03ab7c640 1 -- 172.21.15.150:0/1325317884 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff0340b7a30 msgr2=0x7ff0341d4df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:47:55.926 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:55.924+0000 7ff03ab7c640 1 --2- 172.21.15.150:0/1325317884 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff0340b7a30 0x7ff0341d4df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:47:55.926 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:55.924+0000 7ff03ab7c640 1 -- 172.21.15.150:0/1325317884 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff0340b2e50 msgr2=0x7ff0340cbec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:47:55.926 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:55.924+0000 7ff03ab7c640 1 --2- 172.21.15.150:0/1325317884 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff0340b2e50 0x7ff0340cbec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:47:55.926 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:55.924+0000 7ff03ab7c640 1 -- 172.21.15.150:0/1325317884 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff0340ca980 con 0x7ff0340c5be0 2024-09-17T05:47:55.926 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:55.924+0000 7ff03ab7c640 1 --2- 172.21.15.150:0/1325317884 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff0340c5be0 0x7ff03409e440 secure :-1 s=READY pgs=955 cs=0 l=1 rev1=1 crypto rx=0x7ff02c009d60 tx=0x7ff02c003ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:47:55.926 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:55.924+0000 7ff02affd640 1 -- 172.21.15.150:0/1325317884 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff02c044070 con 0x7ff0340c5be0 2024-09-17T05:47:55.926 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:55.924+0000 7ff02affd640 1 -- 172.21.15.150:0/1325317884 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff02c003e50 con 0x7ff0340c5be0 2024-09-17T05:47:55.927 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:55.924+0000 7ff03c5df640 1 -- 172.21.15.150:0/1325317884 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff0340cae20 con 0x7ff0340c5be0 2024-09-17T05:47:55.927 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:55.924+0000 7ff02affd640 1 -- 172.21.15.150:0/1325317884 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff02c0044b0 con 0x7ff0340c5be0 2024-09-17T05:47:55.927 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:55.924+0000 7ff03c5df640 1 -- 172.21.15.150:0/1325317884 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff0340cb3e0 con 0x7ff0340c5be0 2024-09-17T05:47:55.927 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:55.925+0000 7ff03c5df640 1 -- 172.21.15.150:0/1325317884 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff0340cd240 con 0x7ff0340c5be0 2024-09-17T05:47:55.928 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:55.926+0000 7ff02affd640 1 -- 172.21.15.150:0/1325317884 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 25) ==== 103022+0+0 (secure 0 0 0) 0x7ff02c004650 con 0x7ff0340c5be0 2024-09-17T05:47:55.928 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:55.926+0000 7ff02affd640 1 --2- 172.21.15.150:0/1325317884 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7ff018079d30 0x7ff01807c240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:47:55.928 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:55.927+0000 7ff02affd640 1 -- 172.21.15.150:0/1325317884 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 5995+0+0 (secure 0 0 0) 0x7ff02c0ba130 con 0x7ff0340c5be0 2024-09-17T05:47:55.928 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:55.927+0000 7ff03a37b640 1 --2- 172.21.15.150:0/1325317884 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7ff018079d30 0x7ff01807c240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:47:55.928 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:55.927+0000 7ff03a37b640 1 --2- 172.21.15.150:0/1325317884 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7ff018079d30 0x7ff01807c240 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7ff030009b30 tx=0x7ff030005f90 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:47:55.931 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:55.931+0000 7ff02affd640 1 -- 172.21.15.150:0/1325317884 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7ff02c032030 con 0x7ff0340c5be0 2024-09-17T05:47:56.108 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:56.108+0000 7ff03c5df640 1 -- 172.21.15.150:0/1325317884 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7ff0340cc400 con 0x7ff0340c5be0 2024-09-17T05:47:56.786 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:56.785+0000 7ff02affd640 1 -- 172.21.15.150:0/1325317884 <== mon.0 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v77) ==== 181+0+0 (secure 0 0 0) 0x7ff02c083710 con 0x7ff0340c5be0 2024-09-17T05:47:56.787 INFO:teuthology.orchestra.run.smithi150.stderr:pool 'cephfs_metadata' removed 2024-09-17T05:47:56.789 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:56.788+0000 7ff03c5df640 1 -- 172.21.15.150:0/1325317884 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7ff018079d30 msgr2=0x7ff01807c240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:47:56.790 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:56.788+0000 7ff03c5df640 1 --2- 172.21.15.150:0/1325317884 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7ff018079d30 0x7ff01807c240 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7ff030009b30 tx=0x7ff030005f90 comp rx=0 tx=0).stop 2024-09-17T05:47:56.790 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:56.788+0000 7ff03c5df640 1 -- 172.21.15.150:0/1325317884 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff0340c5be0 msgr2=0x7ff03409e440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:47:56.790 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:56.788+0000 7ff03c5df640 1 --2- 172.21.15.150:0/1325317884 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff0340c5be0 0x7ff03409e440 secure :-1 s=READY pgs=955 cs=0 l=1 rev1=1 crypto rx=0x7ff02c009d60 tx=0x7ff02c003ce0 comp rx=0 tx=0).stop 2024-09-17T05:47:56.790 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:56.789+0000 7ff03c5df640 1 -- 172.21.15.150:0/1325317884 shutdown_connections 2024-09-17T05:47:56.790 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:56.789+0000 7ff03c5df640 1 --2- 172.21.15.150:0/1325317884 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7ff018079d30 0x7ff01807c240 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:47:56.790 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:56.789+0000 7ff03c5df640 1 --2- 172.21.15.150:0/1325317884 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff0340c5be0 0x7ff03409e440 unknown :-1 s=CLOSED pgs=955 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:47:56.790 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:56.789+0000 7ff03c5df640 1 --2- 172.21.15.150:0/1325317884 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff0340b7a30 0x7ff0341d4df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:47:56.790 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:56.789+0000 7ff03c5df640 1 --2- 172.21.15.150:0/1325317884 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff0340b2e50 0x7ff0340cbec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:47:56.790 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:56.789+0000 7ff03c5df640 1 -- 172.21.15.150:0/1325317884 >> 172.21.15.150:0/1325317884 conn(0x7ff0340cefd0 msgr2=0x7ff03409aa50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:47:56.790 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:56.789+0000 7ff03c5df640 1 -- 172.21.15.150:0/1325317884 shutdown_connections 2024-09-17T05:47:56.790 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:56.789+0000 7ff03c5df640 1 -- 172.21.15.150:0/1325317884 wait complete. 2024-09-17T05:47:56.809 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-09-17T05:47:56.933 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:56.932+0000 7f5e8b6b6640 1 -- 172.21.15.150:0/2318892892 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5e700040b0 msgr2=0x7f5e70004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:47:56.934 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:56.932+0000 7f5e8b6b6640 1 --2- 172.21.15.150:0/2318892892 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5e700040b0 0x7f5e70004800 secure :-1 s=READY pgs=957 cs=0 l=1 rev1=1 crypto rx=0x7f5e74001690 tx=0x7f5e70005830 comp rx=0 tx=0).stop 2024-09-17T05:47:56.934 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:56.933+0000 7f5e89c53640 1 -- 172.21.15.150:0/2318892892 reap_dead start 2024-09-17T05:47:56.934 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:56.933+0000 7f5e8b6b6640 1 -- 172.21.15.150:0/2318892892 shutdown_connections 2024-09-17T05:47:56.934 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:56.933+0000 7f5e8b6b6640 1 -- 172.21.15.150:0/2318892892 >> 172.21.15.150:0/2318892892 conn(0x7f5e840cee80 msgr2=0x7f5e840cf290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:47:56.934 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:56.933+0000 7f5e8b6b6640 1 -- 172.21.15.150:0/2318892892 shutdown_connections 2024-09-17T05:47:56.934 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:56.933+0000 7f5e8b6b6640 1 -- 172.21.15.150:0/2318892892 wait complete. 2024-09-17T05:47:56.935 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:56.934+0000 7f5e8b6b6640 1 Processor -- start 2024-09-17T05:47:56.935 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:56.934+0000 7f5e8b6b6640 1 -- start start 2024-09-17T05:47:56.938 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:56.936+0000 7f5e8b6b6640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5e700040b0 0x7f5e8406fb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:47:56.938 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:56.936+0000 7f5e8b6b6640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5e841f6d90 0x7f5e840c5270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:47:56.938 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:56.936+0000 7f5e8b6b6640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5e840cbd90 0x7f5e840cc1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:47:56.938 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:56.936+0000 7f5e8b6b6640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f5e840d1770 con 0x7f5e841f6d90 2024-09-17T05:47:56.938 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:56.936+0000 7f5e8b6b6640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f5e840d15f0 con 0x7f5e700040b0 2024-09-17T05:47:56.938 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:56.936+0000 7f5e8b6b6640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f5e8409baf0 con 0x7f5e840cbd90 2024-09-17T05:47:56.938 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:56.936+0000 7f5e88c51640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5e841f6d90 0x7f5e840c5270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:47:56.938 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:56.936+0000 7f5e88c51640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5e841f6d90 0x7f5e840c5270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:43320/0 (socket says 172.21.15.150:43320) 2024-09-17T05:47:56.939 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:56.936+0000 7f5e88c51640 1 -- 172.21.15.150:0/421304128 learned_addr learned my addr 172.21.15.150:0/421304128 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:47:56.939 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:56.936+0000 7f5e89c53640 1 --2- 172.21.15.150:0/421304128 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5e840cbd90 0x7f5e840cc1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:47:56.939 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:56.936+0000 7f5e89452640 1 --2- 172.21.15.150:0/421304128 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5e700040b0 0x7f5e8406fb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:47:56.939 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:56.936+0000 7f5e88c51640 1 -- 172.21.15.150:0/421304128 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5e840cbd90 msgr2=0x7f5e840cc1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:47:56.939 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:56.936+0000 7f5e88c51640 1 --2- 172.21.15.150:0/421304128 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5e840cbd90 0x7f5e840cc1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:47:56.939 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:56.936+0000 7f5e88c51640 1 -- 172.21.15.150:0/421304128 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5e700040b0 msgr2=0x7f5e8406fb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:47:56.939 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:56.936+0000 7f5e88c51640 1 --2- 172.21.15.150:0/421304128 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5e700040b0 0x7f5e8406fb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:47:56.939 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:56.936+0000 7f5e88c51640 1 -- 172.21.15.150:0/421304128 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5e840c57b0 con 0x7f5e841f6d90 2024-09-17T05:47:56.939 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:56.936+0000 7f5e88c51640 1 --2- 172.21.15.150:0/421304128 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5e841f6d90 0x7f5e840c5270 secure :-1 s=READY pgs=958 cs=0 l=1 rev1=1 crypto rx=0x7f5e7402a910 tx=0x7f5e740063a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:47:56.939 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:56.937+0000 7f5e79ffb640 1 -- 172.21.15.150:0/421304128 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e74038070 con 0x7f5e841f6d90 2024-09-17T05:47:56.939 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:56.937+0000 7f5e79ffb640 1 -- 172.21.15.150:0/421304128 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f5e74003af0 con 0x7f5e841f6d90 2024-09-17T05:47:56.939 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:56.937+0000 7f5e8b6b6640 1 -- 172.21.15.150:0/421304128 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5e840cc6e0 con 0x7f5e841f6d90 2024-09-17T05:47:56.940 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:56.937+0000 7f5e79ffb640 1 -- 172.21.15.150:0/421304128 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e74033420 con 0x7f5e841f6d90 2024-09-17T05:47:56.940 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:56.937+0000 7f5e8b6b6640 1 -- 172.21.15.150:0/421304128 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5e840cad30 con 0x7f5e841f6d90 2024-09-17T05:47:56.941 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:56.938+0000 7f5e8b6b6640 1 -- 172.21.15.150:0/421304128 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5e840d0730 con 0x7f5e841f6d90 2024-09-17T05:47:56.941 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:56.939+0000 7f5e79ffb640 1 -- 172.21.15.150:0/421304128 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 25) ==== 103022+0+0 (secure 0 0 0) 0x7f5e74043020 con 0x7f5e841f6d90 2024-09-17T05:47:56.941 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:56.939+0000 7f5e79ffb640 1 --2- 172.21.15.150:0/421304128 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f5e68079d00 0x7f5e6807c210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:47:56.941 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:56.939+0000 7f5e79ffb640 1 -- 172.21.15.150:0/421304128 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 5557+0+0 (secure 0 0 0) 0x7f5e740b95b0 con 0x7f5e841f6d90 2024-09-17T05:47:56.941 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:56.940+0000 7f5e89452640 1 --2- 172.21.15.150:0/421304128 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f5e68079d00 0x7f5e6807c210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:47:56.941 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:56.940+0000 7f5e89452640 1 --2- 172.21.15.150:0/421304128 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f5e68079d00 0x7f5e6807c210 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f5e800057a0 tx=0x7f5e80005f90 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:47:56.943 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:56.943+0000 7f5e79ffb640 1 -- 172.21.15.150:0/421304128 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f5e7404a020 con 0x7f5e841f6d90 2024-09-17T05:47:57.124 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:57.124+0000 7f5e8b6b6640 1 -- 172.21.15.150:0/421304128 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7f5e8406f940 con 0x7f5e841f6d90 2024-09-17T05:47:57.933 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:57.932+0000 7f5e79ffb640 1 -- 172.21.15.150:0/421304128 <== mon.0 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v78) ==== 169+0+0 (secure 0 0 0) 0x7f5e840cc6e0 con 0x7f5e841f6d90 2024-09-17T05:47:57.933 INFO:teuthology.orchestra.run.smithi150.stderr:pool 'cephfs_data' removed 2024-09-17T05:47:57.936 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:57.935+0000 7f5e8b6b6640 1 -- 172.21.15.150:0/421304128 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f5e68079d00 msgr2=0x7f5e6807c210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:47:57.936 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:57.935+0000 7f5e8b6b6640 1 --2- 172.21.15.150:0/421304128 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f5e68079d00 0x7f5e6807c210 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f5e800057a0 tx=0x7f5e80005f90 comp rx=0 tx=0).stop 2024-09-17T05:47:57.936 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:57.935+0000 7f5e8b6b6640 1 -- 172.21.15.150:0/421304128 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5e841f6d90 msgr2=0x7f5e840c5270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:47:57.936 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:57.935+0000 7f5e8b6b6640 1 --2- 172.21.15.150:0/421304128 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5e841f6d90 0x7f5e840c5270 secure :-1 s=READY pgs=958 cs=0 l=1 rev1=1 crypto rx=0x7f5e7402a910 tx=0x7f5e740063a0 comp rx=0 tx=0).stop 2024-09-17T05:47:57.936 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:57.935+0000 7f5e8b6b6640 1 -- 172.21.15.150:0/421304128 shutdown_connections 2024-09-17T05:47:57.937 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:57.935+0000 7f5e8b6b6640 1 --2- 172.21.15.150:0/421304128 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f5e68079d00 0x7f5e6807c210 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:47:57.937 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:57.935+0000 7f5e8b6b6640 1 --2- 172.21.15.150:0/421304128 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5e840cbd90 0x7f5e840cc1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:47:57.937 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:57.935+0000 7f5e8b6b6640 1 --2- 172.21.15.150:0/421304128 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5e841f6d90 0x7f5e840c5270 unknown :-1 s=CLOSED pgs=958 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:47:57.937 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:57.935+0000 7f5e8b6b6640 1 --2- 172.21.15.150:0/421304128 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5e700040b0 0x7f5e8406fb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:47:57.937 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:57.935+0000 7f5e8b6b6640 1 -- 172.21.15.150:0/421304128 >> 172.21.15.150:0/421304128 conn(0x7f5e840cee80 msgr2=0x7f5e840b6f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:47:57.937 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:57.935+0000 7f5e8b6b6640 1 -- 172.21.15.150:0/421304128 shutdown_connections 2024-09-17T05:47:57.937 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:57.935+0000 7f5e8b6b6640 1 -- 172.21.15.150:0/421304128 wait complete. 2024-09-17T05:47:57.954 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config reset 31 2024-09-17T05:47:58.074 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:58.073+0000 7ff17ad19640 1 -- 172.21.15.150:0/4219250066 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff1740b5960 msgr2=0x7ff1740b5d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:47:58.074 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:58.073+0000 7ff17ad19640 1 --2- 172.21.15.150:0/4219250066 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff1740b5960 0x7ff1740b5d70 secure :-1 s=READY pgs=960 cs=0 l=1 rev1=1 crypto rx=0x7ff16c005fd0 tx=0x7ff16c02a940 comp rx=0 tx=0).stop 2024-09-17T05:47:58.074 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:58.073+0000 7ff17ad19640 1 -- 172.21.15.150:0/4219250066 shutdown_connections 2024-09-17T05:47:58.074 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:58.073+0000 7ff17ad19640 1 --2- 172.21.15.150:0/4219250066 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff1740b5960 0x7ff1740b5d70 unknown :-1 s=CLOSED pgs=960 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:47:58.074 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:58.073+0000 7ff17ad19640 1 -- 172.21.15.150:0/4219250066 >> 172.21.15.150:0/4219250066 conn(0x7ff1740cee80 msgr2=0x7ff1740cf290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:47:58.074 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:58.073+0000 7ff17ad19640 1 -- 172.21.15.150:0/4219250066 shutdown_connections 2024-09-17T05:47:58.074 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:58.073+0000 7ff17ad19640 1 -- 172.21.15.150:0/4219250066 wait complete. 2024-09-17T05:47:58.075 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:58.074+0000 7ff17ad19640 1 Processor -- start 2024-09-17T05:47:58.075 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:58.074+0000 7ff17ad19640 1 -- start start 2024-09-17T05:47:58.078 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:58.076+0000 7ff17ad19640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff1740b5960 0x7ff1740ca340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:47:58.078 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:58.076+0000 7ff17ad19640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff1740c5a90 0x7ff174152350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:47:58.078 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:58.076+0000 7ff17ad19640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff1740cea50 0x7ff1741f8fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:47:58.078 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:58.076+0000 7ff17ad19640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7ff174167ec0 con 0x7ff1740c5a90 2024-09-17T05:47:58.078 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:58.076+0000 7ff17ad19640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7ff174167d40 con 0x7ff1740cea50 2024-09-17T05:47:58.078 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:58.076+0000 7ff17ad19640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7ff174168040 con 0x7ff1740b5960 2024-09-17T05:47:58.078 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:58.076+0000 7ff173fff640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff1740c5a90 0x7ff174152350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:47:58.079 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:58.076+0000 7ff173fff640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff1740c5a90 0x7ff174152350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:43340/0 (socket says 172.21.15.150:43340) 2024-09-17T05:47:58.079 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:58.076+0000 7ff173fff640 1 -- 172.21.15.150:0/541397721 learned_addr learned my addr 172.21.15.150:0/541397721 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:47:58.079 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:58.076+0000 7ff1792b6640 1 --2- 172.21.15.150:0/541397721 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff1740cea50 0x7ff1741f8fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:47:58.079 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:58.076+0000 7ff178ab5640 1 --2- 172.21.15.150:0/541397721 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff1740b5960 0x7ff1740ca340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:47:58.079 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:58.076+0000 7ff173fff640 1 -- 172.21.15.150:0/541397721 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff1740b5960 msgr2=0x7ff1740ca340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:47:58.079 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:58.076+0000 7ff173fff640 1 --2- 172.21.15.150:0/541397721 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff1740b5960 0x7ff1740ca340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:47:58.079 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:58.076+0000 7ff173fff640 1 -- 172.21.15.150:0/541397721 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff1740cea50 msgr2=0x7ff1741f8fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:47:58.079 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:58.076+0000 7ff173fff640 1 --2- 172.21.15.150:0/541397721 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff1740cea50 0x7ff1741f8fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:47:58.079 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:58.076+0000 7ff173fff640 1 -- 172.21.15.150:0/541397721 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff17406f950 con 0x7ff1740c5a90 2024-09-17T05:47:58.079 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:58.076+0000 7ff173fff640 1 --2- 172.21.15.150:0/541397721 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff1740c5a90 0x7ff174152350 secure :-1 s=READY pgs=961 cs=0 l=1 rev1=1 crypto rx=0x7ff16800c370 tx=0x7ff16800c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:47:58.079 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:58.077+0000 7ff1717fa640 1 -- 172.21.15.150:0/541397721 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff168017070 con 0x7ff1740c5a90 2024-09-17T05:47:58.079 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:58.077+0000 7ff1717fa640 1 -- 172.21.15.150:0/541397721 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff1680035f0 con 0x7ff1740c5a90 2024-09-17T05:47:58.079 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:58.077+0000 7ff1717fa640 1 -- 172.21.15.150:0/541397721 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff168003a40 con 0x7ff1740c5a90 2024-09-17T05:47:58.080 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:58.077+0000 7ff17ad19640 1 -- 172.21.15.150:0/541397721 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff17406fc30 con 0x7ff1740c5a90 2024-09-17T05:47:58.080 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:58.077+0000 7ff17ad19640 1 -- 172.21.15.150:0/541397721 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff17406e230 con 0x7ff1740c5a90 2024-09-17T05:47:58.080 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:58.078+0000 7ff17ad19640 1 -- 172.21.15.150:0/541397721 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff1740b5d70 con 0x7ff1740c5a90 2024-09-17T05:47:58.081 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:58.078+0000 7ff1717fa640 1 -- 172.21.15.150:0/541397721 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 25) ==== 103022+0+0 (secure 0 0 0) 0x7ff16801a070 con 0x7ff1740c5a90 2024-09-17T05:47:58.081 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:58.079+0000 7ff1717fa640 1 --2- 172.21.15.150:0/541397721 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7ff160079d00 0x7ff16007c210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:47:58.081 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:58.079+0000 7ff1717fa640 1 -- 172.21.15.150:0/541397721 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 5027+0+0 (secure 0 0 0) 0x7ff168098db0 con 0x7ff1740c5a90 2024-09-17T05:47:58.081 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:58.079+0000 7ff178ab5640 1 --2- 172.21.15.150:0/541397721 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7ff160079d00 0x7ff16007c210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:47:58.081 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:58.080+0000 7ff178ab5640 1 --2- 172.21.15.150:0/541397721 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7ff160079d00 0x7ff16007c210 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7ff164000fb0 tx=0x7ff164009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:47:58.084 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:58.083+0000 7ff1717fa640 1 -- 172.21.15.150:0/541397721 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7ff168062300 con 0x7ff1740c5a90 2024-09-17T05:47:58.259 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:58.259+0000 7ff17ad19640 1 -- 172.21.15.150:0/541397721 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "config reset", "num": 31} v 0) -- 0x7ff1740cd1b0 con 0x7ff1740c5a90 2024-09-17T05:47:58.263 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:58.263+0000 7ff1717fa640 1 -- 172.21.15.150:0/541397721 <== mon.0 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "config reset", "num": 31}]=0 v44) ==== 71+0+0 (secure 0 0 0) 0x7ff168066d30 con 0x7ff1740c5a90 2024-09-17T05:47:58.266 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:58.265+0000 7ff17ad19640 1 -- 172.21.15.150:0/541397721 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7ff160079d00 msgr2=0x7ff16007c210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:47:58.266 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:58.265+0000 7ff17ad19640 1 --2- 172.21.15.150:0/541397721 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7ff160079d00 0x7ff16007c210 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7ff164000fb0 tx=0x7ff164009040 comp rx=0 tx=0).stop 2024-09-17T05:47:58.266 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:58.265+0000 7ff17ad19640 1 -- 172.21.15.150:0/541397721 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff1740c5a90 msgr2=0x7ff174152350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:47:58.266 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:58.265+0000 7ff17ad19640 1 --2- 172.21.15.150:0/541397721 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff1740c5a90 0x7ff174152350 secure :-1 s=READY pgs=961 cs=0 l=1 rev1=1 crypto rx=0x7ff16800c370 tx=0x7ff16800c830 comp rx=0 tx=0).stop 2024-09-17T05:47:58.267 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:58.265+0000 7ff17ad19640 1 -- 172.21.15.150:0/541397721 shutdown_connections 2024-09-17T05:47:58.267 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:58.265+0000 7ff17ad19640 1 --2- 172.21.15.150:0/541397721 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff1740cea50 0x7ff1741f8fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:47:58.267 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:58.265+0000 7ff17ad19640 1 --2- 172.21.15.150:0/541397721 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7ff160079d00 0x7ff16007c210 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:47:58.267 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:58.265+0000 7ff17ad19640 1 --2- 172.21.15.150:0/541397721 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff1740c5a90 0x7ff174152350 unknown :-1 s=CLOSED pgs=961 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:47:58.267 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:58.265+0000 7ff17ad19640 1 --2- 172.21.15.150:0/541397721 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff1740b5960 0x7ff1740ca340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:47:58.267 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:58.265+0000 7ff17ad19640 1 -- 172.21.15.150:0/541397721 >> 172.21.15.150:0/541397721 conn(0x7ff1740cee80 msgr2=0x7ff1740cd6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:47:58.267 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:58.265+0000 7ff17ad19640 1 -- 172.21.15.150:0/541397721 shutdown_connections 2024-09-17T05:47:58.267 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:58.265+0000 7ff17ad19640 1 -- 172.21.15.150:0/541397721 wait complete. 2024-09-17T05:47:58.277 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_volumes.TestCloneProgressReporter.test_clones_more_than_cloner_threads' 2024-09-17T05:47:58.391 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:58.390+0000 7f7183bc6640 1 -- 172.21.15.150:0/1036427135 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f717c0b5410 msgr2=0x7f717c0b5820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:47:58.391 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:58.390+0000 7f7183bc6640 1 --2- 172.21.15.150:0/1036427135 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f717c0b5410 0x7f717c0b5820 secure :-1 s=READY pgs=962 cs=0 l=1 rev1=1 crypto rx=0x7f717c075540 tx=0x7f717402aac0 comp rx=0 tx=0).stop 2024-09-17T05:47:58.391 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:58.390+0000 7f7183bc6640 1 -- 172.21.15.150:0/1036427135 shutdown_connections 2024-09-17T05:47:58.391 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:58.390+0000 7f7183bc6640 1 --2- 172.21.15.150:0/1036427135 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f717c0b5410 0x7f717c0b5820 unknown :-1 s=CLOSED pgs=962 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:47:58.391 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:58.390+0000 7f7183bc6640 1 --2- 172.21.15.150:0/1036427135 >> v2:172.21.15.176:3300/0 conn(0x7f717c0cf7c0 0x7f717c0cfbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:47:58.392 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:58.390+0000 7f7183bc6640 1 -- 172.21.15.150:0/1036427135 >> 172.21.15.150:0/1036427135 conn(0x7f717c0b2fd0 msgr2=0x7f717c0b33e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:47:58.392 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:58.390+0000 7f7183bc6640 1 -- 172.21.15.150:0/1036427135 shutdown_connections 2024-09-17T05:47:58.392 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:58.390+0000 7f7183bc6640 1 -- 172.21.15.150:0/1036427135 wait complete. 2024-09-17T05:47:58.392 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:58.392+0000 7f7183bc6640 1 Processor -- start 2024-09-17T05:47:58.393 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:58.392+0000 7f7183bc6640 1 -- start start 2024-09-17T05:47:58.395 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:58.393+0000 7f7183bc6640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f717c0b5410 0x7f717c0c5be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:47:58.395 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:58.393+0000 7f7183bc6640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f717c0cf7c0 0x7f717c15a780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:47:58.395 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:58.393+0000 7f7183bc6640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f717c15ee30 0x7f717c06cda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:47:58.395 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:58.393+0000 7f7183bc6640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f717c0b61a0 con 0x7f717c15ee30 2024-09-17T05:47:58.396 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:58.393+0000 7f7183bc6640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f717c0b6020 con 0x7f717c0cf7c0 2024-09-17T05:47:58.396 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:58.393+0000 7f7183bc6640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f717c0b6320 con 0x7f717c0b5410 2024-09-17T05:47:58.396 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:58.393+0000 7f7182163640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f717c15ee30 0x7f717c06cda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:47:58.396 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:58.393+0000 7f7182163640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f717c15ee30 0x7f717c06cda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:43356/0 (socket says 172.21.15.150:43356) 2024-09-17T05:47:58.396 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:58.394+0000 7f7182163640 1 -- 172.21.15.150:0/1015549967 learned_addr learned my addr 172.21.15.150:0/1015549967 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:47:58.396 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:58.394+0000 7f7181962640 1 --2- 172.21.15.150:0/1015549967 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f717c0b5410 0x7f717c0c5be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:47:58.396 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:58.394+0000 7f7181161640 1 --2- 172.21.15.150:0/1015549967 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f717c0cf7c0 0x7f717c15a780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:47:58.396 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:58.394+0000 7f7182163640 1 -- 172.21.15.150:0/1015549967 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f717c0b5410 msgr2=0x7f717c0c5be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:47:58.396 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:58.394+0000 7f7182163640 1 --2- 172.21.15.150:0/1015549967 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f717c0b5410 0x7f717c0c5be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:47:58.396 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:58.394+0000 7f7182163640 1 -- 172.21.15.150:0/1015549967 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f717c0cf7c0 msgr2=0x7f717c15a780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:47:58.396 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:58.394+0000 7f7182163640 1 --2- 172.21.15.150:0/1015549967 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f717c0cf7c0 0x7f717c15a780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:47:58.396 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:58.394+0000 7f7182163640 1 -- 172.21.15.150:0/1015549967 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f717c1f36a0 con 0x7f717c15ee30 2024-09-17T05:47:58.397 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:58.394+0000 7f7181161640 1 --2- 172.21.15.150:0/1015549967 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f717c0cf7c0 0x7f717c15a780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:47:58.397 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:58.394+0000 7f7182163640 1 --2- 172.21.15.150:0/1015549967 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f717c15ee30 0x7f717c06cda0 secure :-1 s=READY pgs=963 cs=0 l=1 rev1=1 crypto rx=0x7f7174009d60 tx=0x7f7174003ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:47:58.397 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:58.394+0000 7f71727fc640 1 -- 172.21.15.150:0/1015549967 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7174044070 con 0x7f717c15ee30 2024-09-17T05:47:58.397 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:58.394+0000 7f71727fc640 1 -- 172.21.15.150:0/1015549967 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f7174003e50 con 0x7f717c15ee30 2024-09-17T05:47:58.397 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:58.394+0000 7f7183bc6640 1 -- 172.21.15.150:0/1015549967 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f717c1f3910 con 0x7f717c15ee30 2024-09-17T05:47:58.397 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:58.394+0000 7f71727fc640 1 -- 172.21.15.150:0/1015549967 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71740044b0 con 0x7f717c15ee30 2024-09-17T05:47:58.397 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:58.394+0000 7f7183bc6640 1 -- 172.21.15.150:0/1015549967 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f717c1f3ed0 con 0x7f717c15ee30 2024-09-17T05:47:58.398 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:58.395+0000 7f7183bc6640 1 -- 172.21.15.150:0/1015549967 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f717c0b6860 con 0x7f717c15ee30 2024-09-17T05:47:58.398 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:58.396+0000 7f71727fc640 1 -- 172.21.15.150:0/1015549967 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 25) ==== 103022+0+0 (secure 0 0 0) 0x7f7174004650 con 0x7f717c15ee30 2024-09-17T05:47:58.398 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:58.397+0000 7f71727fc640 1 --2- 172.21.15.150:0/1015549967 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f7160079d30 0x7f716007c240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:47:58.398 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:58.397+0000 7f71727fc640 1 -- 172.21.15.150:0/1015549967 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 5027+0+0 (secure 0 0 0) 0x7f71740ba130 con 0x7f717c15ee30 2024-09-17T05:47:58.398 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:58.397+0000 7f7181962640 1 --2- 172.21.15.150:0/1015549967 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f7160079d30 0x7f716007c240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:47:58.398 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:58.397+0000 7f7181962640 1 --2- 172.21.15.150:0/1015549967 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f7160079d30 0x7f716007c240 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f717c0d0de0 tx=0x7f7178009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:47:58.402 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:58.401+0000 7f71727fc640 1 -- 172.21.15.150:0/1015549967 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f7174032030 con 0x7f717c15ee30 2024-09-17T05:47:58.644 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:58.643+0000 7f7183bc6640 1 -- 172.21.15.150:0/1015549967 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_volumes.TestCloneProgressReporter.test_clones_more_than_cloner_threads"]} v 0) -- 0x7f717c15beb0 con 0x7f717c15ee30 2024-09-17T05:47:58.935 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:58.934+0000 7f71727fc640 1 -- 172.21.15.150:0/1015549967 <== mon.0 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_volumes.TestCloneProgressReporter.test_clones_more_than_cloner_threads"]}]=0 v299) ==== 167+0+0 (secure 0 0 0) 0x7f7174083710 con 0x7f717c15ee30 2024-09-17T05:47:58.937 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:58.936+0000 7f7183bc6640 1 -- 172.21.15.150:0/1015549967 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f7160079d30 msgr2=0x7f716007c240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:47:58.937 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:58.936+0000 7f7183bc6640 1 --2- 172.21.15.150:0/1015549967 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f7160079d30 0x7f716007c240 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f717c0d0de0 tx=0x7f7178009040 comp rx=0 tx=0).stop 2024-09-17T05:47:58.938 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:58.936+0000 7f7183bc6640 1 -- 172.21.15.150:0/1015549967 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f717c15ee30 msgr2=0x7f717c06cda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:47:58.938 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:58.936+0000 7f7183bc6640 1 --2- 172.21.15.150:0/1015549967 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f717c15ee30 0x7f717c06cda0 secure :-1 s=READY pgs=963 cs=0 l=1 rev1=1 crypto rx=0x7f7174009d60 tx=0x7f7174003ce0 comp rx=0 tx=0).stop 2024-09-17T05:47:58.938 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:58.936+0000 7f7183bc6640 1 -- 172.21.15.150:0/1015549967 shutdown_connections 2024-09-17T05:47:58.938 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:58.936+0000 7f7183bc6640 1 --2- 172.21.15.150:0/1015549967 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f717c0cf7c0 0x7f717c15a780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:47:58.938 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:58.936+0000 7f7183bc6640 1 --2- 172.21.15.150:0/1015549967 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f7160079d30 0x7f716007c240 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:47:58.938 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:58.936+0000 7f7183bc6640 1 --2- 172.21.15.150:0/1015549967 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f717c15ee30 0x7f717c06cda0 unknown :-1 s=CLOSED pgs=963 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:47:58.938 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:58.936+0000 7f7183bc6640 1 --2- 172.21.15.150:0/1015549967 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f717c0b5410 0x7f717c0c5be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:47:58.938 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:58.936+0000 7f7183bc6640 1 -- 172.21.15.150:0/1015549967 >> 172.21.15.150:0/1015549967 conn(0x7f717c0b2fd0 msgr2=0x7f717c0b0430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:47:58.938 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:58.936+0000 7f7183bc6640 1 -- 172.21.15.150:0/1015549967 shutdown_connections 2024-09-17T05:47:58.938 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:58.936+0000 7f7183bc6640 1 -- 172.21.15.150:0/1015549967 wait complete. 2024-09-17T05:47:58.949 INFO:tasks.cephfs_test_runner:Test that 2 progress bars are printed in output of "ceph status" ... ok 2024-09-17T05:47:58.949 INFO:tasks.cephfs_test_runner:Starting test: test_progress_drops_when_new_jobs_are_added (tasks.cephfs.test_volumes.TestCloneProgressReporter) Test that progress indicated by progress bar for ongoing+pending clones 2024-09-17T05:47:58.949 INFO:tasks.cephfs_test_runner:test_progress_drops_when_new_jobs_are_added (tasks.cephfs.test_volumes.TestCloneProgressReporter) 2024-09-17T05:47:58.950 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T05:47:59.064 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:59.062+0000 7faeb029b640 1 -- 172.21.15.150:0/2769389628 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7faea80b3720 msgr2=0x7faea80d1090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:47:59.064 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:59.062+0000 7faeb029b640 1 --2- 172.21.15.150:0/2769389628 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7faea80b3720 0x7faea80d1090 secure :-1 s=READY pgs=965 cs=0 l=1 rev1=1 crypto rx=0x7faea80d5740 tx=0x7fae9802a560 comp rx=0 tx=0).stop 2024-09-17T05:47:59.064 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:59.062+0000 7faeb029b640 1 -- 172.21.15.150:0/2769389628 shutdown_connections 2024-09-17T05:47:59.064 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:59.062+0000 7faeb029b640 1 --2- 172.21.15.150:0/2769389628 >> v2:172.21.15.176:3300/0 conn(0x7faea80d15d0 0x7faea80cf470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:47:59.064 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:59.062+0000 7faeb029b640 1 --2- 172.21.15.150:0/2769389628 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7faea80b3720 0x7faea80d1090 unknown :-1 s=CLOSED pgs=965 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:47:59.065 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:59.062+0000 7faeb029b640 1 -- 172.21.15.150:0/2769389628 >> 172.21.15.150:0/2769389628 conn(0x7faea80d4680 msgr2=0x7faea80d4a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:47:59.065 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:59.062+0000 7faeb029b640 1 -- 172.21.15.150:0/2769389628 shutdown_connections 2024-09-17T05:47:59.065 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:59.062+0000 7faeb029b640 1 -- 172.21.15.150:0/2769389628 wait complete. 2024-09-17T05:47:59.069 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:59.064+0000 7faeb029b640 1 Processor -- start 2024-09-17T05:47:59.070 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:59.064+0000 7faeb029b640 1 -- start start 2024-09-17T05:47:59.070 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:59.065+0000 7faeb029b640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7faea80b3720 0x7faea81fa060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:47:59.070 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:59.065+0000 7faeb029b640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7faea80b9780 0x7faea81f7220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:47:59.070 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:59.065+0000 7faeb029b640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7faea80d15d0 0x7faea8151af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:47:59.070 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:59.065+0000 7faeb029b640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7faea80cfd40 con 0x7faea80d15d0 2024-09-17T05:47:59.070 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:59.065+0000 7faeb029b640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7faea80cfbc0 con 0x7faea80b3720 2024-09-17T05:47:59.070 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:59.065+0000 7faeb029b640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7faea80cfec0 con 0x7faea80b9780 2024-09-17T05:47:59.071 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:59.065+0000 7faeae838640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7faea80d15d0 0x7faea8151af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:47:59.071 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:59.065+0000 7faeae838640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7faea80d15d0 0x7faea8151af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:43366/0 (socket says 172.21.15.150:43366) 2024-09-17T05:47:59.071 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:59.065+0000 7faeae838640 1 -- 172.21.15.150:0/1224170270 learned_addr learned my addr 172.21.15.150:0/1224170270 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:47:59.071 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:59.066+0000 7faeae037640 1 --2- 172.21.15.150:0/1224170270 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7faea80b3720 0x7faea81fa060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:47:59.071 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:59.066+0000 7faead836640 1 --2- 172.21.15.150:0/1224170270 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7faea80b9780 0x7faea81f7220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:47:59.071 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:59.066+0000 7faeae838640 1 -- 172.21.15.150:0/1224170270 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7faea80b9780 msgr2=0x7faea81f7220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:47:59.071 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:59.066+0000 7faeae838640 1 --2- 172.21.15.150:0/1224170270 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7faea80b9780 0x7faea81f7220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:47:59.071 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:59.066+0000 7faeae838640 1 -- 172.21.15.150:0/1224170270 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7faea80b3720 msgr2=0x7faea81fa060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:47:59.071 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:59.066+0000 7faeae838640 1 --2- 172.21.15.150:0/1224170270 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7faea80b3720 0x7faea81fa060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:47:59.071 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:59.066+0000 7faeae838640 1 -- 172.21.15.150:0/1224170270 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faea81fa5a0 con 0x7faea80d15d0 2024-09-17T05:47:59.071 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:59.066+0000 7faeae037640 1 --2- 172.21.15.150:0/1224170270 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7faea80b3720 0x7faea81fa060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T05:47:59.072 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:59.066+0000 7faeae838640 1 --2- 172.21.15.150:0/1224170270 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7faea80d15d0 0x7faea8151af0 secure :-1 s=READY pgs=966 cs=0 l=1 rev1=1 crypto rx=0x7faea000e9c0 tx=0x7faea000ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:47:59.072 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:59.066+0000 7fae9effd640 1 -- 172.21.15.150:0/1224170270 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faea0004d20 con 0x7faea80d15d0 2024-09-17T05:47:59.072 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:59.066+0000 7fae9effd640 1 -- 172.21.15.150:0/1224170270 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7faea000cb20 con 0x7faea80d15d0 2024-09-17T05:47:59.072 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:59.066+0000 7faeb029b640 1 -- 172.21.15.150:0/1224170270 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faea8161110 con 0x7faea80d15d0 2024-09-17T05:47:59.072 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:59.066+0000 7fae9effd640 1 -- 172.21.15.150:0/1224170270 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faea0005020 con 0x7faea80d15d0 2024-09-17T05:47:59.072 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:59.066+0000 7faeb029b640 1 -- 172.21.15.150:0/1224170270 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faea81616d0 con 0x7faea80d15d0 2024-09-17T05:47:59.072 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:59.067+0000 7faeb029b640 1 -- 172.21.15.150:0/1224170270 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faea808d100 con 0x7faea80d15d0 2024-09-17T05:47:59.072 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:59.068+0000 7fae9effd640 1 -- 172.21.15.150:0/1224170270 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 25) ==== 103022+0+0 (secure 0 0 0) 0x7faea00051c0 con 0x7faea80d15d0 2024-09-17T05:47:59.072 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:59.068+0000 7fae9effd640 1 --2- 172.21.15.150:0/1224170270 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fae8c079d00 0x7fae8c07c210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:47:59.073 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:59.068+0000 7fae9effd640 1 -- 172.21.15.150:0/1224170270 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 5027+0+0 (secure 0 0 0) 0x7faea009a5f0 con 0x7faea80d15d0 2024-09-17T05:47:59.073 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:59.068+0000 7faeae037640 1 --2- 172.21.15.150:0/1224170270 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fae8c079d00 0x7fae8c07c210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:47:59.073 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:59.069+0000 7faeae037640 1 --2- 172.21.15.150:0/1224170270 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fae8c079d00 0x7fae8c07c210 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7faea4007fd0 tx=0x7faea4009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:47:59.074 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:59.073+0000 7fae9effd640 1 -- 172.21.15.150:0/1224170270 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7faea808d100 con 0x7faea80d15d0 2024-09-17T05:47:59.249 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:59.248+0000 7faeb029b640 1 -- 172.21.15.150:0/1224170270 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7faea8160e70 con 0x7faea80d15d0 2024-09-17T05:47:59.249 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:59.249+0000 7fae9effd640 1 -- 172.21.15.150:0/1224170270 <== mon.0 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v78) ==== 74+0+13203 (secure 0 0 0) 0x7faea81fa5a0 con 0x7faea80d15d0 2024-09-17T05:47:59.250 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-09-17T05:47:59.250 INFO:teuthology.orchestra.run.smithi150.stdout:{"epoch":78,"fsid":"9f2e05e9-d629-47b3-b26b-1360655b7d20","created":"2024-09-17T05:41:32.502979+0000","modified":"2024-09-17T05:47:57.923336+0000","last_up_change":"2024-09-17T05:41:46.150225+0000","last_in_change":"2024-09-17T05:41:36.120274+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T05:41:46.860779+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"4f31c018-c8a4-4d6d-b0c2-a597c47aae4a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6800","nonce":479374392},{"type":"v1","addr":"172.21.15.150:6801","nonce":479374392}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6802","nonce":479374392},{"type":"v1","addr":"172.21.15.150:6803","nonce":479374392}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6806","nonce":479374392},{"type":"v1","addr":"172.21.15.150:6807","nonce":479374392}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6804","nonce":479374392},{"type":"v1","addr":"172.21.15.150:6805","nonce":479374392}]},"public_addr":"172.21.15.150:6801/479374392","cluster_addr":"172.21.15.150:6803/479374392","heartbeat_back_addr":"172.21.15.150:6807/479374392","heartbeat_front_addr":"172.21.15.150:6805/479374392","state":["exists","up"]},{"osd":1,"uuid":"6ff4a573-500b-4e04-9de3-39265ead78b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6824","nonce":913899800},{"type":"v1","addr":"172.21.15.150:6825","nonce":913899800}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6826","nonce":913899800},{"type":"v1","addr":"172.21.15.150:6827","nonce":913899800}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6830","nonce":913899800},{"type":"v1","addr":"172.21.15.150:6831","nonce":913899800}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6828","nonce":913899800},{"type":"v1","addr":"172.21.15.150:6829","nonce":913899800}]},"public_addr":"172.21.15.150:6825/913899800","cluster_addr":"172.21.15.150:6827/913899800","heartbeat_back_addr":"172.21.15.150:6831/913899800","heartbeat_front_addr":"172.21.15.150:6829/913899800","state":["exists","up"]},{"osd":2,"uuid":"bffea6f9-2465-4182-b205-00436c41ac1c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6816","nonce":363718461},{"type":"v1","addr":"172.21.15.150:6817","nonce":363718461}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6818","nonce":363718461},{"type":"v1","addr":"172.21.15.150:6819","nonce":363718461}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6822","nonce":363718461},{"type":"v1","addr":"172.21.15.150:6823","nonce":363718461}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6820","nonce":363718461},{"type":"v1","addr":"172.21.15.150:6821","nonce":363718461}]},"public_addr":"172.21.15.150:6817/363718461","cluster_addr":"172.21.15.150:6819/363718461","heartbeat_back_addr":"172.21.15.150:6823/363718461","heartbeat_front_addr":"172.21.15.150:6821/363718461","state":["exists","up"]},{"osd":3,"uuid":"cda70430-d1e1-427e-b04e-56db4031d078","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6808","nonce":3550994626},{"type":"v1","addr":"172.21.15.150:6809","nonce":3550994626}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6810","nonce":3550994626},{"type":"v1","addr":"172.21.15.150:6811","nonce":3550994626}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6814","nonce":3550994626},{"type":"v1","addr":"172.21.15.150:6815","nonce":3550994626}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6812","nonce":3550994626},{"type":"v1","addr":"172.21.15.150:6813","nonce":3550994626}]},"public_addr":"172.21.15.150:6809/3550994626","cluster_addr":"172.21.15.150:6811/3550994626","heartbeat_back_addr":"172.21.15.150:6815/3550994626","heartbeat_front_addr":"172.21.15.150:6813/3550994626","state":["exists","up"]},{"osd":4,"uuid":"3a0277fb-5e1e-4f68-bb2d-9a8a0152f64a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6810","nonce":2718261497},{"type":"v1","addr":"172.21.15.176:6811","nonce":2718261497}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6812","nonce":2718261497},{"type":"v1","addr":"172.21.15.176:6813","nonce":2718261497}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6816","nonce":2718261497},{"type":"v1","addr":"172.21.15.176:6817","nonce":2718261497}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6814","nonce":2718261497},{"type":"v1","addr":"172.21.15.176:6815","nonce":2718261497}]},"public_addr":"172.21.15.176:6811/2718261497","cluster_addr":"172.21.15.176:6813/2718261497","heartbeat_back_addr":"172.21.15.176:6817/2718261497","heartbeat_front_addr":"172.21.15.176:6815/2718261497","state":["exists","up"]},{"osd":5,"uuid":"33aebee6-0315-40b7-a11c-6702f0be494d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6818","nonce":2049295774},{"type":"v1","addr":"172.21.15.176:6819","nonce":2049295774}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6820","nonce":2049295774},{"type":"v1","addr":"172.21.15.176:6821","nonce":2049295774}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6824","nonce":2049295774},{"type":"v1","addr":"172.21.15.176:6825","nonce":2049295774}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6822","nonce":2049295774},{"type":"v1","addr":"172.21.15.176:6823","nonce":2049295774}]},"public_addr":"172.21.15.176:6819/2049295774","cluster_addr":"172.21.15.176:6821/2049295774","heartbeat_back_addr":"172.21.15.176:6825/2049295774","heartbeat_front_addr":"172.21.15.176:6823/2049295774","state":["exists","up"]},{"osd":6,"uuid":"4d24f360-6751-4263-841b-d77793d33540","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6826","nonce":2164458476},{"type":"v1","addr":"172.21.15.176:6827","nonce":2164458476}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6828","nonce":2164458476},{"type":"v1","addr":"172.21.15.176:6829","nonce":2164458476}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6832","nonce":2164458476},{"type":"v1","addr":"172.21.15.176:6833","nonce":2164458476}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6830","nonce":2164458476},{"type":"v1","addr":"172.21.15.176:6831","nonce":2164458476}]},"public_addr":"172.21.15.176:6827/2164458476","cluster_addr":"172.21.15.176:6829/2164458476","heartbeat_back_addr":"172.21.15.176:6833/2164458476","heartbeat_front_addr":"172.21.15.176:6831/2164458476","state":["exists","up"]},{"osd":7,"uuid":"c8594fda-c74a-4ba9-8277-caf101d58ca1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6802","nonce":3239587708},{"type":"v1","addr":"172.21.15.176:6803","nonce":3239587708}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6804","nonce":3239587708},{"type":"v1","addr":"172.21.15.176:6805","nonce":3239587708}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6808","nonce":3239587708},{"type":"v1","addr":"172.21.15.176:6809","nonce":3239587708}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6806","nonce":3239587708},{"type":"v1","addr":"172.21.15.176:6807","nonce":3239587708}]},"public_addr":"172.21.15.176:6803/3239587708","cluster_addr":"172.21.15.176:6805/3239587708","heartbeat_back_addr":"172.21.15.176:6809/3239587708","heartbeat_front_addr":"172.21.15.176:6807/3239587708","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:41:41.905151+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:41:42.705679+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:41:42.459673+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:41:42.440819+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:41:42.668428+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:41:42.694972+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:41:43.078535+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:41:42.363539+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.150:6835/4215563116":"2024-09-18T05:47:54.776474+0000","172.21.15.150:6833/4215563116":"2024-09-18T05:47:54.776474+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":7,"snaps":[{"begin":2,"length":2}]},{"pool":9,"snaps":[{"begin":2,"length":2}]},{"pool":11,"snaps":[{"begin":2,"length":2}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T05:47:59.252 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:59.251+0000 7faeb029b640 1 -- 172.21.15.150:0/1224170270 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fae8c079d00 msgr2=0x7fae8c07c210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:47:59.252 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:59.251+0000 7faeb029b640 1 --2- 172.21.15.150:0/1224170270 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fae8c079d00 0x7fae8c07c210 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7faea4007fd0 tx=0x7faea4009040 comp rx=0 tx=0).stop 2024-09-17T05:47:59.252 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:59.251+0000 7faeb029b640 1 -- 172.21.15.150:0/1224170270 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7faea80d15d0 msgr2=0x7faea8151af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:47:59.252 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:59.251+0000 7faeb029b640 1 --2- 172.21.15.150:0/1224170270 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7faea80d15d0 0x7faea8151af0 secure :-1 s=READY pgs=966 cs=0 l=1 rev1=1 crypto rx=0x7faea000e9c0 tx=0x7faea000ee80 comp rx=0 tx=0).stop 2024-09-17T05:47:59.252 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:59.251+0000 7faeb029b640 1 -- 172.21.15.150:0/1224170270 shutdown_connections 2024-09-17T05:47:59.253 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:59.251+0000 7faeb029b640 1 --2- 172.21.15.150:0/1224170270 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fae8c079d00 0x7fae8c07c210 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:47:59.253 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:59.251+0000 7faeb029b640 1 --2- 172.21.15.150:0/1224170270 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7faea80d15d0 0x7faea8151af0 unknown :-1 s=CLOSED pgs=966 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:47:59.253 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:59.251+0000 7faeb029b640 1 --2- 172.21.15.150:0/1224170270 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7faea80b9780 0x7faea81f7220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:47:59.253 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:59.251+0000 7faeb029b640 1 --2- 172.21.15.150:0/1224170270 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7faea80b3720 0x7faea81fa060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:47:59.253 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:59.251+0000 7faeb029b640 1 -- 172.21.15.150:0/1224170270 >> 172.21.15.150:0/1224170270 conn(0x7faea80d4680 msgr2=0x7faea80b8970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:47:59.253 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:59.251+0000 7faeb029b640 1 -- 172.21.15.150:0/1224170270 shutdown_connections 2024-09-17T05:47:59.253 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:59.251+0000 7faeb029b640 1 -- 172.21.15.150:0/1224170270 wait complete. 2024-09-17T05:47:59.264 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-17T05:41:46.860779+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-17T05:47:59.264 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-17T05:47:59.381 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:59.380+0000 7f8e60ac4640 1 -- 172.21.15.150:0/280384952 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8e5c0b0fe0 msgr2=0x7f8e5c0b13f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:47:59.381 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:59.380+0000 7f8e60ac4640 1 --2- 172.21.15.150:0/280384952 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8e5c0b0fe0 0x7f8e5c0b13f0 secure :-1 s=READY pgs=968 cs=0 l=1 rev1=1 crypto rx=0x7f8e44005fd0 tx=0x7f8e4402a4b0 comp rx=0 tx=0).stop 2024-09-17T05:47:59.381 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:59.380+0000 7f8e60ac4640 1 -- 172.21.15.150:0/280384952 shutdown_connections 2024-09-17T05:47:59.381 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:59.380+0000 7f8e60ac4640 1 --2- 172.21.15.150:0/280384952 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8e5c0b0fe0 0x7f8e5c0b13f0 unknown :-1 s=CLOSED pgs=968 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:47:59.381 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:59.380+0000 7f8e60ac4640 1 --2- 172.21.15.150:0/280384952 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8e5c0b25e0 0x7f8e5c0b1ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:47:59.381 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:59.380+0000 7f8e60ac4640 1 -- 172.21.15.150:0/280384952 >> 172.21.15.150:0/280384952 conn(0x7f8e5c0b2ff0 msgr2=0x7f8e5c0b3400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:47:59.382 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:59.380+0000 7f8e60ac4640 1 -- 172.21.15.150:0/280384952 shutdown_connections 2024-09-17T05:47:59.382 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:59.380+0000 7f8e60ac4640 1 -- 172.21.15.150:0/280384952 wait complete. 2024-09-17T05:47:59.382 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:59.382+0000 7f8e60ac4640 1 Processor -- start 2024-09-17T05:47:59.382 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:59.382+0000 7f8e60ac4640 1 -- start start 2024-09-17T05:47:59.385 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:59.383+0000 7f8e60ac4640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8e5c0b0fe0 0x7f8e5c0cb020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:47:59.385 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:59.383+0000 7f8e60ac4640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8e5c0b25e0 0x7f8e5c06cda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:47:59.385 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:59.383+0000 7f8e60ac4640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8e5c15fa30 0x7f8e5c06d2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:47:59.385 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:59.383+0000 7f8e60ac4640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f8e5c0ae740 con 0x7f8e5c0b0fe0 2024-09-17T05:47:59.386 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:59.383+0000 7f8e60ac4640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f8e5c0ae5c0 con 0x7f8e5c15fa30 2024-09-17T05:47:59.386 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:59.383+0000 7f8e60ac4640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f8e5c0ae8c0 con 0x7f8e5c0b25e0 2024-09-17T05:47:59.386 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:59.383+0000 7f8e5a59c640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8e5c0b0fe0 0x7f8e5c0cb020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:47:59.386 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:59.383+0000 7f8e5a59c640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8e5c0b0fe0 0x7f8e5c0cb020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:43384/0 (socket says 172.21.15.150:43384) 2024-09-17T05:47:59.386 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:59.383+0000 7f8e5a59c640 1 -- 172.21.15.150:0/3662236311 learned_addr learned my addr 172.21.15.150:0/3662236311 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:47:59.386 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:59.383+0000 7f8e51d9b640 1 --2- 172.21.15.150:0/3662236311 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8e5c0b25e0 0x7f8e5c06cda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:47:59.386 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:59.383+0000 7f8e5ad9d640 1 --2- 172.21.15.150:0/3662236311 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8e5c15fa30 0x7f8e5c06d2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:47:59.386 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:59.383+0000 7f8e5a59c640 1 -- 172.21.15.150:0/3662236311 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8e5c0b25e0 msgr2=0x7f8e5c06cda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:47:59.387 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:59.383+0000 7f8e5a59c640 1 --2- 172.21.15.150:0/3662236311 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8e5c0b25e0 0x7f8e5c06cda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:47:59.387 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:59.383+0000 7f8e5a59c640 1 -- 172.21.15.150:0/3662236311 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8e5c15fa30 msgr2=0x7f8e5c06d2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:47:59.387 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:59.383+0000 7f8e5a59c640 1 --2- 172.21.15.150:0/3662236311 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8e5c15fa30 0x7f8e5c06d2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:47:59.387 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:59.383+0000 7f8e5a59c640 1 -- 172.21.15.150:0/3662236311 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8e5c1f71a0 con 0x7f8e5c0b0fe0 2024-09-17T05:47:59.387 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:59.383+0000 7f8e51d9b640 1 --2- 172.21.15.150:0/3662236311 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8e5c0b25e0 0x7f8e5c06cda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:47:59.387 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:59.384+0000 7f8e5a59c640 1 --2- 172.21.15.150:0/3662236311 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8e5c0b0fe0 0x7f8e5c0cb020 secure :-1 s=READY pgs=969 cs=0 l=1 rev1=1 crypto rx=0x7f8e4c00b440 tx=0x7f8e4c00b900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:47:59.387 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:59.384+0000 7f8e537fe640 1 -- 172.21.15.150:0/3662236311 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e4c015020 con 0x7f8e5c0b0fe0 2024-09-17T05:47:59.387 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:59.384+0000 7f8e537fe640 1 -- 172.21.15.150:0/3662236311 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8e4c011920 con 0x7f8e5c0b0fe0 2024-09-17T05:47:59.388 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:59.384+0000 7f8e537fe640 1 -- 172.21.15.150:0/3662236311 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e4c011d70 con 0x7f8e5c0b0fe0 2024-09-17T05:47:59.388 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:59.384+0000 7f8e60ac4640 1 -- 172.21.15.150:0/3662236311 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8e5c0cb9d0 con 0x7f8e5c0b0fe0 2024-09-17T05:47:59.388 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:59.384+0000 7f8e60ac4640 1 -- 172.21.15.150:0/3662236311 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8e5c0cc440 con 0x7f8e5c0b0fe0 2024-09-17T05:47:59.389 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:59.385+0000 7f8e60ac4640 1 -- 172.21.15.150:0/3662236311 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8e5c1f7370 con 0x7f8e5c0b0fe0 2024-09-17T05:47:59.389 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:59.386+0000 7f8e537fe640 1 -- 172.21.15.150:0/3662236311 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 25) ==== 103022+0+0 (secure 0 0 0) 0x7f8e4c018020 con 0x7f8e5c0b0fe0 2024-09-17T05:47:59.389 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:59.386+0000 7f8e537fe640 1 --2- 172.21.15.150:0/3662236311 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f8e3c079d30 0x7f8e3c07c240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:47:59.389 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:59.386+0000 7f8e537fe640 1 -- 172.21.15.150:0/3662236311 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 5027+0+0 (secure 0 0 0) 0x7f8e4c0999a0 con 0x7f8e5c0b0fe0 2024-09-17T05:47:59.390 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:59.386+0000 7f8e51d9b640 1 --2- 172.21.15.150:0/3662236311 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f8e3c079d30 0x7f8e3c07c240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:47:59.390 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:59.387+0000 7f8e51d9b640 1 --2- 172.21.15.150:0/3662236311 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f8e3c079d30 0x7f8e3c07c240 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f8e44033000 tx=0x7f8e44004730 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:47:59.391 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:59.391+0000 7f8e537fe640 1 -- 172.21.15.150:0/3662236311 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f8e4c01f020 con 0x7f8e5c0b0fe0 2024-09-17T05:47:59.575 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:59.574+0000 7f8e60ac4640 1 -- 172.21.15.150:0/3662236311 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f8e5c0af560 con 0x7f8e5c0b0fe0 2024-09-17T05:47:59.575 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:59.575+0000 7f8e537fe640 1 -- 172.21.15.150:0/3662236311 <== mon.0 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v78) ==== 93+0+10 (secure 0 0 0) 0x7f8e5c0af560 con 0x7f8e5c0b0fe0 2024-09-17T05:47:59.576 INFO:teuthology.orchestra.run.smithi150.stdout:pg_num: 1 2024-09-17T05:47:59.579 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:59.578+0000 7f8e60ac4640 1 -- 172.21.15.150:0/3662236311 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f8e3c079d30 msgr2=0x7f8e3c07c240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:47:59.579 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:59.578+0000 7f8e60ac4640 1 --2- 172.21.15.150:0/3662236311 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f8e3c079d30 0x7f8e3c07c240 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f8e44033000 tx=0x7f8e44004730 comp rx=0 tx=0).stop 2024-09-17T05:47:59.579 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:59.578+0000 7f8e60ac4640 1 -- 172.21.15.150:0/3662236311 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8e5c0b0fe0 msgr2=0x7f8e5c0cb020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:47:59.579 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:59.578+0000 7f8e60ac4640 1 --2- 172.21.15.150:0/3662236311 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8e5c0b0fe0 0x7f8e5c0cb020 secure :-1 s=READY pgs=969 cs=0 l=1 rev1=1 crypto rx=0x7f8e4c00b440 tx=0x7f8e4c00b900 comp rx=0 tx=0).stop 2024-09-17T05:47:59.579 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:59.578+0000 7f8e60ac4640 1 -- 172.21.15.150:0/3662236311 shutdown_connections 2024-09-17T05:47:59.579 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:59.578+0000 7f8e60ac4640 1 --2- 172.21.15.150:0/3662236311 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8e5c15fa30 0x7f8e5c06d2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:47:59.580 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:59.578+0000 7f8e60ac4640 1 --2- 172.21.15.150:0/3662236311 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f8e3c079d30 0x7f8e3c07c240 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:47:59.580 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:59.578+0000 7f8e60ac4640 1 --2- 172.21.15.150:0/3662236311 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8e5c0b25e0 0x7f8e5c06cda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:47:59.580 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:59.578+0000 7f8e60ac4640 1 --2- 172.21.15.150:0/3662236311 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8e5c0b0fe0 0x7f8e5c0cb020 unknown :-1 s=CLOSED pgs=969 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:47:59.580 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:59.578+0000 7f8e60ac4640 1 -- 172.21.15.150:0/3662236311 >> 172.21.15.150:0/3662236311 conn(0x7f8e5c0b2ff0 msgr2=0x7f8e5c15e640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:47:59.580 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:59.579+0000 7f8e60ac4640 1 -- 172.21.15.150:0/3662236311 shutdown_connections 2024-09-17T05:47:59.580 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:59.579+0000 7f8e60ac4640 1 -- 172.21.15.150:0/3662236311 wait complete. 2024-09-17T05:47:59.593 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_volumes.TestCloneProgressReporter.test_progress_drops_when_new_jobs_are_added' 2024-09-17T05:47:59.708 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:59.707+0000 7f7c89d6e640 1 -- 172.21.15.150:0/506133187 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7c840b0e20 msgr2=0x7f7c840b1230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:47:59.709 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:59.707+0000 7f7c89d6e640 1 --2- 172.21.15.150:0/506133187 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7c840b0e20 0x7f7c840b1230 secure :-1 s=READY pgs=970 cs=0 l=1 rev1=1 crypto rx=0x7f7c84072a20 tx=0x7f7c7c02a560 comp rx=0 tx=0).stop 2024-09-17T05:47:59.709 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:59.707+0000 7f7c89d6e640 1 -- 172.21.15.150:0/506133187 shutdown_connections 2024-09-17T05:47:59.709 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:59.707+0000 7f7c89d6e640 1 --2- 172.21.15.150:0/506133187 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7c840b0e20 0x7f7c840b1230 unknown :-1 s=CLOSED pgs=970 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:47:59.709 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:59.707+0000 7f7c89d6e640 1 --2- 172.21.15.150:0/506133187 >> v2:172.21.15.176:3300/0 conn(0x7f7c840cf7c0 0x7f7c840cfbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:47:59.710 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:59.707+0000 7f7c89d6e640 1 --2- 172.21.15.150:0/506133187 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7c8415ee30 0x7f7c840b2840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:47:59.710 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:59.707+0000 7f7c89d6e640 1 -- 172.21.15.150:0/506133187 >> 172.21.15.150:0/506133187 conn(0x7f7c840b2fd0 msgr2=0x7f7c840b33e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:47:59.710 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:59.707+0000 7f7c89d6e640 1 -- 172.21.15.150:0/506133187 shutdown_connections 2024-09-17T05:47:59.710 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:59.707+0000 7f7c89d6e640 1 -- 172.21.15.150:0/506133187 wait complete. 2024-09-17T05:47:59.716 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:59.709+0000 7f7c89d6e640 1 Processor -- start 2024-09-17T05:47:59.716 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:59.709+0000 7f7c89d6e640 1 -- start start 2024-09-17T05:47:59.716 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:59.710+0000 7f7c89d6e640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7c840b0e20 0x7f7c84158c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:47:59.716 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:59.710+0000 7f7c89d6e640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7c840cf7c0 0x7f7c840ce170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:47:59.717 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:59.710+0000 7f7c89d6e640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7c8415ee30 0x7f7c840ce6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:47:59.717 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:59.710+0000 7f7c89d6e640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f7c840b18f0 con 0x7f7c840cf7c0 2024-09-17T05:47:59.717 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:59.710+0000 7f7c89d6e640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f7c840b1770 con 0x7f7c8415ee30 2024-09-17T05:47:59.717 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:59.710+0000 7f7c89d6e640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f7c840b1a70 con 0x7f7c840b0e20 2024-09-17T05:47:59.717 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:59.710+0000 7f7c82ffd640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7c840cf7c0 0x7f7c840ce170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:47:59.718 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:59.710+0000 7f7c82ffd640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7c840cf7c0 0x7f7c840ce170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:43406/0 (socket says 172.21.15.150:43406) 2024-09-17T05:47:59.718 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:59.710+0000 7f7c82ffd640 1 -- 172.21.15.150:0/2702091690 learned_addr learned my addr 172.21.15.150:0/2702091690 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:47:59.718 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:59.711+0000 7f7c82ffd640 1 -- 172.21.15.150:0/2702091690 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7c840b0e20 msgr2=0x7f7c84158c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:47:59.718 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:59.711+0000 7f7c837fe640 1 --2- 172.21.15.150:0/2702091690 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7c840b0e20 0x7f7c84158c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:47:59.718 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:59.711+0000 7f7c83fff640 1 --2- 172.21.15.150:0/2702091690 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7c8415ee30 0x7f7c840ce6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:47:59.718 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:59.711+0000 7f7c82ffd640 1 --2- 172.21.15.150:0/2702091690 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7c840b0e20 0x7f7c84158c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:47:59.719 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:59.711+0000 7f7c82ffd640 1 -- 172.21.15.150:0/2702091690 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7c8415ee30 msgr2=0x7f7c840ce6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:47:59.719 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:59.711+0000 7f7c82ffd640 1 --2- 172.21.15.150:0/2702091690 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7c8415ee30 0x7f7c840ce6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:47:59.719 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:59.711+0000 7f7c82ffd640 1 -- 172.21.15.150:0/2702091690 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7c841f5d60 con 0x7f7c840cf7c0 2024-09-17T05:47:59.719 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:59.711+0000 7f7c82ffd640 1 --2- 172.21.15.150:0/2702091690 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7c840cf7c0 0x7f7c840ce170 secure :-1 s=READY pgs=971 cs=0 l=1 rev1=1 crypto rx=0x7f7c780078a0 tx=0x7f7c78007d60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:47:59.719 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:59.711+0000 7f7c6bfff640 1 -- 172.21.15.150:0/2702091690 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c78019020 con 0x7f7c840cf7c0 2024-09-17T05:47:59.719 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:59.711+0000 7f7c6bfff640 1 -- 172.21.15.150:0/2702091690 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f7c78005020 con 0x7f7c840cf7c0 2024-09-17T05:47:59.720 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:59.711+0000 7f7c89d6e640 1 -- 172.21.15.150:0/2702091690 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7c841f6040 con 0x7f7c840cf7c0 2024-09-17T05:47:59.720 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:59.711+0000 7f7c6bfff640 1 -- 172.21.15.150:0/2702091690 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c78005470 con 0x7f7c840cf7c0 2024-09-17T05:47:59.720 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:59.711+0000 7f7c89d6e640 1 -- 172.21.15.150:0/2702091690 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7c841f6600 con 0x7f7c840cf7c0 2024-09-17T05:47:59.720 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:59.712+0000 7f7c89d6e640 1 -- 172.21.15.150:0/2702091690 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7c841f5ad0 con 0x7f7c840cf7c0 2024-09-17T05:47:59.720 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:59.713+0000 7f7c6bfff640 1 -- 172.21.15.150:0/2702091690 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 25) ==== 103022+0+0 (secure 0 0 0) 0x7f7c780047a0 con 0x7f7c840cf7c0 2024-09-17T05:47:59.720 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:59.713+0000 7f7c6bfff640 1 --2- 172.21.15.150:0/2702091690 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f7c70079d00 0x7f7c7007c210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:47:59.720 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:59.714+0000 7f7c6bfff640 1 -- 172.21.15.150:0/2702091690 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 5027+0+0 (secure 0 0 0) 0x7f7c7809b7d0 con 0x7f7c840cf7c0 2024-09-17T05:47:59.721 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:59.714+0000 7f7c837fe640 1 --2- 172.21.15.150:0/2702091690 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f7c70079d00 0x7f7c7007c210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:47:59.721 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:59.714+0000 7f7c837fe640 1 --2- 172.21.15.150:0/2702091690 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f7c70079d00 0x7f7c7007c210 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f7c840d0de0 tx=0x7f7c740072f0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:47:59.721 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:59.718+0000 7f7c6bfff640 1 -- 172.21.15.150:0/2702091690 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f7c78023020 con 0x7f7c840cf7c0 2024-09-17T05:47:59.967 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:47:59.966+0000 7f7c89d6e640 1 -- 172.21.15.150:0/2702091690 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_volumes.TestCloneProgressReporter.test_progress_drops_when_new_jobs_are_added"]} v 0) -- 0x7f7c840cfbd0 con 0x7f7c840cf7c0 2024-09-17T05:48:00.943 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:00.941+0000 7f7c6bfff640 1 -- 172.21.15.150:0/2702091690 <== mon.0 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_volumes.TestCloneProgressReporter.test_progress_drops_when_new_jobs_are_added"]}]=0 v301) ==== 177+0+0 (secure 0 0 0) 0x7f7c78065400 con 0x7f7c840cf7c0 2024-09-17T05:48:00.947 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:00.944+0000 7f7c89d6e640 1 -- 172.21.15.150:0/2702091690 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f7c70079d00 msgr2=0x7f7c7007c210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:48:00.947 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:00.944+0000 7f7c89d6e640 1 --2- 172.21.15.150:0/2702091690 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f7c70079d00 0x7f7c7007c210 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f7c840d0de0 tx=0x7f7c740072f0 comp rx=0 tx=0).stop 2024-09-17T05:48:00.947 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:00.945+0000 7f7c89d6e640 1 -- 172.21.15.150:0/2702091690 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7c840cf7c0 msgr2=0x7f7c840ce170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:48:00.948 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:00.945+0000 7f7c89d6e640 1 --2- 172.21.15.150:0/2702091690 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7c840cf7c0 0x7f7c840ce170 secure :-1 s=READY pgs=971 cs=0 l=1 rev1=1 crypto rx=0x7f7c780078a0 tx=0x7f7c78007d60 comp rx=0 tx=0).stop 2024-09-17T05:48:00.948 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:00.945+0000 7f7c89d6e640 1 -- 172.21.15.150:0/2702091690 shutdown_connections 2024-09-17T05:48:00.948 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:00.945+0000 7f7c89d6e640 1 --2- 172.21.15.150:0/2702091690 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7c8415ee30 0x7f7c840ce6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:48:00.948 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:00.945+0000 7f7c89d6e640 1 --2- 172.21.15.150:0/2702091690 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f7c70079d00 0x7f7c7007c210 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:48:00.948 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:00.945+0000 7f7c89d6e640 1 --2- 172.21.15.150:0/2702091690 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7c840cf7c0 0x7f7c840ce170 unknown :-1 s=CLOSED pgs=971 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:48:00.948 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:00.945+0000 7f7c89d6e640 1 --2- 172.21.15.150:0/2702091690 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7c840b0e20 0x7f7c84158c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:48:00.949 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:00.945+0000 7f7c89d6e640 1 -- 172.21.15.150:0/2702091690 >> 172.21.15.150:0/2702091690 conn(0x7f7c840b2fd0 msgr2=0x7f7c8415ba60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:48:00.949 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:00.945+0000 7f7c89d6e640 1 -- 172.21.15.150:0/2702091690 shutdown_connections 2024-09-17T05:48:00.949 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:00.945+0000 7f7c89d6e640 1 -- 172.21.15.150:0/2702091690 wait complete. 2024-09-17T05:48:00.961 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config dump 2024-09-17T05:48:01.080 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:01.078+0000 7f9dee541640 1 -- 172.21.15.150:0/3083844081 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9de80b5c50 msgr2=0x7f9de8167180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:48:01.080 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:01.078+0000 7f9dee541640 1 --2- 172.21.15.150:0/3083844081 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9de80b5c50 0x7f9de8167180 secure :-1 s=READY pgs=973 cs=0 l=1 rev1=1 crypto rx=0x7f9de0005fd0 tx=0x7f9de002a8b0 comp rx=0 tx=0).stop 2024-09-17T05:48:01.080 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:01.078+0000 7f9dee541640 1 -- 172.21.15.150:0/3083844081 shutdown_connections 2024-09-17T05:48:01.080 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:01.078+0000 7f9dee541640 1 --2- 172.21.15.150:0/3083844081 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9de80b5300 0x7f9de80b5710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:48:01.080 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:01.078+0000 7f9dee541640 1 --2- 172.21.15.150:0/3083844081 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9de80b5c50 0x7f9de8167180 unknown :-1 s=CLOSED pgs=973 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:48:01.081 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:01.078+0000 7f9dee541640 1 -- 172.21.15.150:0/3083844081 >> 172.21.15.150:0/3083844081 conn(0x7f9de80cef30 msgr2=0x7f9de80cf340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:48:01.081 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:01.078+0000 7f9dee541640 1 -- 172.21.15.150:0/3083844081 shutdown_connections 2024-09-17T05:48:01.081 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:01.078+0000 7f9dee541640 1 -- 172.21.15.150:0/3083844081 wait complete. 2024-09-17T05:48:01.081 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:01.080+0000 7f9dee541640 1 Processor -- start 2024-09-17T05:48:01.081 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:01.080+0000 7f9dee541640 1 -- start start 2024-09-17T05:48:01.084 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:01.081+0000 7f9dee541640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9de80b5300 0x7f9de81dcb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:48:01.084 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:01.081+0000 7f9dee541640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9de80b5c50 0x7f9de809f390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:48:01.085 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:01.081+0000 7f9dee541640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9de80b7490 0x7f9de809f8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:48:01.085 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:01.081+0000 7f9dee541640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f9de80d15e0 con 0x7f9de80b5300 2024-09-17T05:48:01.085 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:01.081+0000 7f9dee541640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f9de80d1460 con 0x7f9de80b5c50 2024-09-17T05:48:01.085 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:01.081+0000 7f9dee541640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f9de80ceb70 con 0x7f9de80b7490 2024-09-17T05:48:01.085 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:01.081+0000 7f9de7fff640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9de80b5300 0x7f9de81dcb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:48:01.085 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:01.081+0000 7f9de7fff640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9de80b5300 0x7f9de81dcb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:60112/0 (socket says 172.21.15.150:60112) 2024-09-17T05:48:01.085 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:01.081+0000 7f9de7fff640 1 -- 172.21.15.150:0/1910442716 learned_addr learned my addr 172.21.15.150:0/1910442716 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:48:01.085 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:01.081+0000 7f9ddffff640 1 --2- 172.21.15.150:0/1910442716 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9de80b5c50 0x7f9de809f390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:48:01.085 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:01.082+0000 7f9decade640 1 --2- 172.21.15.150:0/1910442716 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9de80b7490 0x7f9de809f8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:48:01.085 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:01.082+0000 7f9de7fff640 1 -- 172.21.15.150:0/1910442716 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9de80b7490 msgr2=0x7f9de809f8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:48:01.085 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:01.082+0000 7f9de7fff640 1 --2- 172.21.15.150:0/1910442716 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9de80b7490 0x7f9de809f8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:48:01.085 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:01.082+0000 7f9de7fff640 1 -- 172.21.15.150:0/1910442716 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9de80b5c50 msgr2=0x7f9de809f390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:48:01.085 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:01.082+0000 7f9de7fff640 1 --2- 172.21.15.150:0/1910442716 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9de80b5c50 0x7f9de809f390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:48:01.086 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:01.082+0000 7f9de7fff640 1 -- 172.21.15.150:0/1910442716 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9de81ddcb0 con 0x7f9de80b5300 2024-09-17T05:48:01.086 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:01.082+0000 7f9de7fff640 1 --2- 172.21.15.150:0/1910442716 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9de80b5300 0x7f9de81dcb70 secure :-1 s=READY pgs=974 cs=0 l=1 rev1=1 crypto rx=0x7f9dd800c3c0 tx=0x7f9dd800c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:48:01.086 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:01.082+0000 7f9de57fa640 1 -- 172.21.15.150:0/1910442716 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9dd8017070 con 0x7f9de80b5300 2024-09-17T05:48:01.086 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:01.082+0000 7f9de57fa640 1 -- 172.21.15.150:0/1910442716 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9dd80035f0 con 0x7f9de80b5300 2024-09-17T05:48:01.086 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:01.082+0000 7f9de57fa640 1 -- 172.21.15.150:0/1910442716 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9dd8003a40 con 0x7f9de80b5300 2024-09-17T05:48:01.086 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:01.082+0000 7f9dee541640 1 -- 172.21.15.150:0/1910442716 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9de81e15b0 con 0x7f9de80b5300 2024-09-17T05:48:01.086 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:01.082+0000 7f9dee541640 1 -- 172.21.15.150:0/1910442716 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9de81e1b70 con 0x7f9de80b5300 2024-09-17T05:48:01.086 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:01.083+0000 7f9dee541640 1 -- 172.21.15.150:0/1910442716 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9de806a610 con 0x7f9de80b5300 2024-09-17T05:48:01.087 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:01.084+0000 7f9de57fa640 1 -- 172.21.15.150:0/1910442716 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 25) ==== 103022+0+0 (secure 0 0 0) 0x7f9dd801a070 con 0x7f9de80b5300 2024-09-17T05:48:01.087 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:01.084+0000 7f9de57fa640 1 --2- 172.21.15.150:0/1910442716 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f9dc8079d00 0x7f9dc807c210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:48:01.087 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:01.084+0000 7f9de57fa640 1 -- 172.21.15.150:0/1910442716 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 5027+0+0 (secure 0 0 0) 0x7f9dd8098e60 con 0x7f9de80b5300 2024-09-17T05:48:01.087 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:01.084+0000 7f9ddffff640 1 --2- 172.21.15.150:0/1910442716 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f9dc8079d00 0x7f9dc807c210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:48:01.087 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:01.085+0000 7f9ddffff640 1 --2- 172.21.15.150:0/1910442716 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f9dc8079d00 0x7f9dc807c210 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f9dd0005fd0 tx=0x7f9dd0005850 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:48:01.090 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:01.089+0000 7f9de57fa640 1 -- 172.21.15.150:0/1910442716 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f9de806a610 con 0x7f9de80b5300 2024-09-17T05:48:01.264 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:01.263+0000 7f9dee541640 1 -- 172.21.15.150:0/1910442716 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "config dump"} v 0) -- 0x7f9de80b6220 con 0x7f9de80b5300 2024-09-17T05:48:01.265 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:01.263+0000 7f9de57fa640 1 -- 172.21.15.150:0/1910442716 <== mon.0 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "config dump"}]=0 v44) ==== 59+0+2294 (secure 0 0 0) 0x7f9de81ddcb0 con 0x7f9de80b5300 2024-09-17T05:48:01.265 INFO:teuthology.orchestra.run.smithi150.stdout:WHO MASK LEVEL OPTION VALUE RO 2024-09-17T05:48:01.265 INFO:teuthology.orchestra.run.smithi150.stdout:mon advanced mon_op_complaint_time 120 2024-09-17T05:48:01.265 INFO:teuthology.orchestra.run.smithi150.stdout:mgr advanced client_mount_timeout 30 2024-09-17T05:48:01.265 INFO:teuthology.orchestra.run.smithi150.stdout:mgr advanced debug_client 20/20 2024-09-17T05:48:01.265 INFO:teuthology.orchestra.run.smithi150.stdout:mgr advanced debug_mgr 20/20 2024-09-17T05:48:01.266 INFO:teuthology.orchestra.run.smithi150.stdout:mgr advanced debug_ms 1/1 2024-09-17T05:48:01.266 INFO:teuthology.orchestra.run.smithi150.stdout:mgr dev mon_warn_on_pool_no_app false 2024-09-17T05:48:01.266 INFO:teuthology.orchestra.run.smithi150.stdout:osd advanced osd_op_complaint_time 180.000000 2024-09-17T05:48:01.266 INFO:teuthology.orchestra.run.smithi150.stdout:osd.0 basic osd_mclock_max_capacity_iops_ssd 6764.239331 2024-09-17T05:48:01.266 INFO:teuthology.orchestra.run.smithi150.stdout:osd.1 basic osd_mclock_max_capacity_iops_ssd 4956.769289 2024-09-17T05:48:01.266 INFO:teuthology.orchestra.run.smithi150.stdout:osd.2 basic osd_mclock_max_capacity_iops_ssd 5099.704467 2024-09-17T05:48:01.266 INFO:teuthology.orchestra.run.smithi150.stdout:osd.3 basic osd_mclock_max_capacity_iops_ssd 4681.616196 2024-09-17T05:48:01.266 INFO:teuthology.orchestra.run.smithi150.stdout:osd.4 basic osd_mclock_max_capacity_iops_ssd 4723.364425 2024-09-17T05:48:01.266 INFO:teuthology.orchestra.run.smithi150.stdout:osd.5 basic osd_mclock_max_capacity_iops_ssd 4509.722124 2024-09-17T05:48:01.266 INFO:teuthology.orchestra.run.smithi150.stdout:osd.6 basic osd_mclock_max_capacity_iops_ssd 6380.664158 2024-09-17T05:48:01.266 INFO:teuthology.orchestra.run.smithi150.stdout:osd.7 basic osd_mclock_max_capacity_iops_ssd 4303.333825 2024-09-17T05:48:01.266 INFO:teuthology.orchestra.run.smithi150.stdout:mds advanced debug_mds 20/20 2024-09-17T05:48:01.266 INFO:teuthology.orchestra.run.smithi150.stdout:mds advanced debug_mds_balancer 20/20 2024-09-17T05:48:01.267 INFO:teuthology.orchestra.run.smithi150.stdout:mds advanced debug_ms 2/2 2024-09-17T05:48:01.267 INFO:teuthology.orchestra.run.smithi150.stdout:mds dev mds_debug_frag true 2024-09-17T05:48:01.267 INFO:teuthology.orchestra.run.smithi150.stdout:mds dev mds_debug_scatterstat true 2024-09-17T05:48:01.267 INFO:teuthology.orchestra.run.smithi150.stdout:mds advanced mds_op_complaint_time 180.000000 2024-09-17T05:48:01.267 INFO:teuthology.orchestra.run.smithi150.stdout:mds dev mds_verify_scatter true 2024-09-17T05:48:01.267 INFO:teuthology.orchestra.run.smithi150.stdout:mds advanced osd_op_complaint_time 180.000000 2024-09-17T05:48:01.267 INFO:teuthology.orchestra.run.smithi150.stdout:mds advanced rados_mon_op_timeout 900 2024-09-17T05:48:01.267 INFO:teuthology.orchestra.run.smithi150.stdout:mds advanced rados_osd_op_timeout 900 2024-09-17T05:48:01.267 INFO:teuthology.orchestra.run.smithi150.stdout:client advanced client_mount_timeout 600 2024-09-17T05:48:01.267 INFO:teuthology.orchestra.run.smithi150.stdout:client advanced debug_client 20/20 2024-09-17T05:48:01.267 INFO:teuthology.orchestra.run.smithi150.stdout:client advanced debug_ms 1/1 2024-09-17T05:48:01.267 INFO:teuthology.orchestra.run.smithi150.stdout:client advanced rados_mon_op_timeout 900 2024-09-17T05:48:01.267 INFO:teuthology.orchestra.run.smithi150.stdout:client advanced rados_osd_op_timeout 900 2024-09-17T05:48:01.268 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:01.265+0000 7f9dee541640 1 -- 172.21.15.150:0/1910442716 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f9dc8079d00 msgr2=0x7f9dc807c210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:48:01.268 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:01.265+0000 7f9dee541640 1 --2- 172.21.15.150:0/1910442716 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f9dc8079d00 0x7f9dc807c210 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f9dd0005fd0 tx=0x7f9dd0005850 comp rx=0 tx=0).stop 2024-09-17T05:48:01.269 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:01.265+0000 7f9dee541640 1 -- 172.21.15.150:0/1910442716 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9de80b5300 msgr2=0x7f9de81dcb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:48:01.269 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:01.265+0000 7f9dee541640 1 --2- 172.21.15.150:0/1910442716 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9de80b5300 0x7f9de81dcb70 secure :-1 s=READY pgs=974 cs=0 l=1 rev1=1 crypto rx=0x7f9dd800c3c0 tx=0x7f9dd800c880 comp rx=0 tx=0).stop 2024-09-17T05:48:01.269 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:01.265+0000 7f9dee541640 1 -- 172.21.15.150:0/1910442716 shutdown_connections 2024-09-17T05:48:01.269 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:01.265+0000 7f9dee541640 1 --2- 172.21.15.150:0/1910442716 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9de80b5c50 0x7f9de809f390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:48:01.269 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:01.265+0000 7f9dee541640 1 --2- 172.21.15.150:0/1910442716 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f9dc8079d00 0x7f9dc807c210 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:48:01.269 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:01.265+0000 7f9dee541640 1 --2- 172.21.15.150:0/1910442716 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9de80b7490 0x7f9de809f8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:48:01.269 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:01.265+0000 7f9dee541640 1 --2- 172.21.15.150:0/1910442716 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9de80b5300 0x7f9de81dcb70 unknown :-1 s=CLOSED pgs=974 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:48:01.269 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:01.265+0000 7f9dee541640 1 -- 172.21.15.150:0/1910442716 >> 172.21.15.150:0/1910442716 conn(0x7f9de80cef30 msgr2=0x7f9de809ca30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:48:01.269 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:01.266+0000 7f9dee541640 1 -- 172.21.15.150:0/1910442716 shutdown_connections 2024-09-17T05:48:01.269 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:01.266+0000 7f9dee541640 1 -- 172.21.15.150:0/1910442716 wait complete. 2024-09-17T05:48:01.279 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-09-17T05:48:01.396 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:01.394+0000 7f5997a93640 1 -- 172.21.15.150:0/59173470 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5990073a80 msgr2=0x7f5990160320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:48:01.396 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:01.394+0000 7f5997a93640 1 --2- 172.21.15.150:0/59173470 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5990073a80 0x7f5990160320 secure :-1 s=READY pgs=975 cs=0 l=1 rev1=1 crypto rx=0x7f5990072bd0 tx=0x7f598802aac0 comp rx=0 tx=0).stop 2024-09-17T05:48:01.396 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:01.394+0000 7f5997a93640 1 -- 172.21.15.150:0/59173470 shutdown_connections 2024-09-17T05:48:01.397 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:01.394+0000 7f5997a93640 1 --2- 172.21.15.150:0/59173470 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5990073a80 0x7f5990160320 unknown :-1 s=CLOSED pgs=975 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:48:01.397 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:01.394+0000 7f5997a93640 1 --2- 172.21.15.150:0/59173470 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5990145a40 0x7f5990073540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:48:01.397 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:01.394+0000 7f5997a93640 1 --2- 172.21.15.150:0/59173470 >> v2:172.21.15.176:3300/0 conn(0x7f5990145550 0x7f599006fb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:48:01.397 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:01.394+0000 7f5997a93640 1 -- 172.21.15.150:0/59173470 >> 172.21.15.150:0/59173470 conn(0x7f599006d1c0 msgr2=0x7f599006d5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:48:01.397 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:01.394+0000 7f5997a93640 1 -- 172.21.15.150:0/59173470 shutdown_connections 2024-09-17T05:48:01.397 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:01.394+0000 7f5997a93640 1 -- 172.21.15.150:0/59173470 wait complete. 2024-09-17T05:48:01.397 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:01.396+0000 7f5997a93640 1 Processor -- start 2024-09-17T05:48:01.398 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:01.396+0000 7f5997a93640 1 -- start start 2024-09-17T05:48:01.400 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:01.397+0000 7f5997a93640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5990073a80 0x7f59900b2980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:48:01.400 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:01.397+0000 7f5997a93640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5990145550 0x7f599014ea10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:48:01.400 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:01.397+0000 7f5997a93640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5990145a40 0x7f59901e6360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:48:01.400 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:01.397+0000 7f5997a93640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f5990160bf0 con 0x7f5990073a80 2024-09-17T05:48:01.400 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:01.397+0000 7f5997a93640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f5990160a70 con 0x7f5990145550 2024-09-17T05:48:01.400 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:01.397+0000 7f5997a93640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f5990160d70 con 0x7f5990145a40 2024-09-17T05:48:01.401 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:01.397+0000 7f599582f640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5990073a80 0x7f59900b2980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:48:01.401 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:01.397+0000 7f599582f640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5990073a80 0x7f59900b2980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:60130/0 (socket says 172.21.15.150:60130) 2024-09-17T05:48:01.401 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:01.397+0000 7f599582f640 1 -- 172.21.15.150:0/2237418006 learned_addr learned my addr 172.21.15.150:0/2237418006 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:48:01.401 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:01.398+0000 7f5996030640 1 --2- 172.21.15.150:0/2237418006 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5990145a40 0x7f59901e6360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:48:01.401 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:01.398+0000 7f599502e640 1 --2- 172.21.15.150:0/2237418006 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5990145550 0x7f599014ea10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:48:01.401 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:01.398+0000 7f599582f640 1 -- 172.21.15.150:0/2237418006 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5990145a40 msgr2=0x7f59901e6360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:48:01.401 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:01.398+0000 7f599582f640 1 --2- 172.21.15.150:0/2237418006 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5990145a40 0x7f59901e6360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:48:01.401 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:01.398+0000 7f599582f640 1 -- 172.21.15.150:0/2237418006 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5990145550 msgr2=0x7f599014ea10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:48:01.401 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:01.398+0000 7f599582f640 1 --2- 172.21.15.150:0/2237418006 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5990145550 0x7f599014ea10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:48:01.401 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:01.398+0000 7f599582f640 1 -- 172.21.15.150:0/2237418006 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f599014ef50 con 0x7f5990073a80 2024-09-17T05:48:01.401 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:01.398+0000 7f599582f640 1 --2- 172.21.15.150:0/2237418006 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5990073a80 0x7f59900b2980 secure :-1 s=READY pgs=976 cs=0 l=1 rev1=1 crypto rx=0x7f598c00c970 tx=0x7f598c00ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:48:01.401 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:01.398+0000 7f59867fc640 1 -- 172.21.15.150:0/2237418006 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f598c004220 con 0x7f5990073a80 2024-09-17T05:48:01.402 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:01.398+0000 7f59867fc640 1 -- 172.21.15.150:0/2237418006 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f598c0079b0 con 0x7f5990073a80 2024-09-17T05:48:01.402 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:01.398+0000 7f5997a93640 1 -- 172.21.15.150:0/2237418006 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5990143c30 con 0x7f5990073a80 2024-09-17T05:48:01.402 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:01.398+0000 7f59867fc640 1 -- 172.21.15.150:0/2237418006 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f598c007de0 con 0x7f5990073a80 2024-09-17T05:48:01.402 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:01.398+0000 7f5997a93640 1 -- 172.21.15.150:0/2237418006 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f59901441f0 con 0x7f5990073a80 2024-09-17T05:48:01.403 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:01.399+0000 7f5997a93640 1 -- 172.21.15.150:0/2237418006 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f599006fb40 con 0x7f5990073a80 2024-09-17T05:48:01.403 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:01.400+0000 7f59867fc640 1 -- 172.21.15.150:0/2237418006 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 25) ==== 103022+0+0 (secure 0 0 0) 0x7f598c005020 con 0x7f5990073a80 2024-09-17T05:48:01.403 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:01.401+0000 7f59867fc640 1 --2- 172.21.15.150:0/2237418006 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f5974079d00 0x7f597407c210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:48:01.403 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:01.401+0000 7f59867fc640 1 -- 172.21.15.150:0/2237418006 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 5027+0+0 (secure 0 0 0) 0x7f598c099f40 con 0x7f5990073a80 2024-09-17T05:48:01.403 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:01.401+0000 7f599502e640 1 --2- 172.21.15.150:0/2237418006 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f5974079d00 0x7f597407c210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:48:01.403 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:01.401+0000 7f599502e640 1 --2- 172.21.15.150:0/2237418006 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f5974079d00 0x7f597407c210 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f59800058c0 tx=0x7f5980005f60 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:48:01.406 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:01.405+0000 7f59867fc640 1 -- 172.21.15.150:0/2237418006 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f598c014030 con 0x7f5990073a80 2024-09-17T05:48:01.581 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:01.580+0000 7f5997a93640 1 -- 172.21.15.150:0/2237418006 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) -- 0x7f5990069a10 con 0x7f5990073a80 2024-09-17T05:48:01.585 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:01.583+0000 7f59867fc640 1 -- 172.21.15.150:0/2237418006 <== mon.0 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v45)=0 v45) ==== 122+0+0 (secure 0 0 0) 0x7f598c063490 con 0x7f5990073a80 2024-09-17T05:48:01.587 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:01.586+0000 7f5997a93640 1 -- 172.21.15.150:0/2237418006 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f5974079d00 msgr2=0x7f597407c210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:48:01.588 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:01.586+0000 7f5997a93640 1 --2- 172.21.15.150:0/2237418006 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f5974079d00 0x7f597407c210 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f59800058c0 tx=0x7f5980005f60 comp rx=0 tx=0).stop 2024-09-17T05:48:01.588 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:01.586+0000 7f5997a93640 1 -- 172.21.15.150:0/2237418006 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5990073a80 msgr2=0x7f59900b2980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:48:01.588 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:01.586+0000 7f5997a93640 1 --2- 172.21.15.150:0/2237418006 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5990073a80 0x7f59900b2980 secure :-1 s=READY pgs=976 cs=0 l=1 rev1=1 crypto rx=0x7f598c00c970 tx=0x7f598c00ce30 comp rx=0 tx=0).stop 2024-09-17T05:48:01.588 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:01.586+0000 7f5997a93640 1 -- 172.21.15.150:0/2237418006 shutdown_connections 2024-09-17T05:48:01.588 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:01.586+0000 7f5997a93640 1 --2- 172.21.15.150:0/2237418006 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5990145550 0x7f599014ea10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:48:01.588 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:01.586+0000 7f5997a93640 1 --2- 172.21.15.150:0/2237418006 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f5974079d00 0x7f597407c210 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:48:01.588 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:01.586+0000 7f5997a93640 1 --2- 172.21.15.150:0/2237418006 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5990145a40 0x7f59901e6360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:48:01.588 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:01.586+0000 7f5997a93640 1 --2- 172.21.15.150:0/2237418006 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5990073a80 0x7f59900b2980 unknown :-1 s=CLOSED pgs=976 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:48:01.588 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:01.586+0000 7f5997a93640 1 -- 172.21.15.150:0/2237418006 >> 172.21.15.150:0/2237418006 conn(0x7f599006d1c0 msgr2=0x7f599013d860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:48:01.588 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:01.586+0000 7f5997a93640 1 -- 172.21.15.150:0/2237418006 shutdown_connections 2024-09-17T05:48:01.588 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:01.586+0000 7f5997a93640 1 -- 172.21.15.150:0/2237418006 wait complete. 2024-09-17T05:48:01.599 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-17T05:48:01.599 DEBUG:teuthology.orchestra.run.smithi150:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-17T05:48:01.657 DEBUG:teuthology.orchestra.run.smithi176:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-17T05:48:01.707 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-17T05:48:01.707 DEBUG:teuthology.orchestra.run.smithi150:> set -ex 2024-09-17T05:48:01.707 DEBUG:teuthology.orchestra.run.smithi150:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T05:48:01.724 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056027,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497464k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=18693 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248728k,nr_inodes=812182,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497464k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-17T05:48:01.724 DEBUG:teuthology.orchestra.run.smithi176:> set -ex 2024-09-17T05:48:01.724 DEBUG:teuthology.orchestra.run.smithi176:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T05:48:01.742 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056030,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497468k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=3379 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248732k,nr_inodes=812183,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497468k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-17T05:48:01.742 DEBUG:teuthology.orchestra.run.smithi150:> set -ex 2024-09-17T05:48:01.742 DEBUG:teuthology.orchestra.run.smithi150:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T05:48:01.778 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056027,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497464k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=18693 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248728k,nr_inodes=812182,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497464k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-17T05:48:01.779 DEBUG:teuthology.orchestra.run.smithi176:> set -ex 2024-09-17T05:48:01.779 DEBUG:teuthology.orchestra.run.smithi176:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T05:48:01.801 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056030,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497468k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=3379 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248732k,nr_inodes=812183,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497468k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-17T05:48:01.802 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-09-17T05:48:01.802 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T05:48:01.932 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:01.930+0000 7f911f5df640 1 -- 172.21.15.150:0/2785091151 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9118152920 msgr2=0x7f911815f3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:48:01.932 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:01.930+0000 7f911f5df640 1 --2- 172.21.15.150:0/2785091151 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9118152920 0x7f911815f3d0 secure :-1 s=READY pgs=978 cs=0 l=1 rev1=1 crypto rx=0x7f9108009830 tx=0x7f910802a480 comp rx=0 tx=0).stop 2024-09-17T05:48:01.932 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:01.930+0000 7f911f5df640 1 -- 172.21.15.150:0/2785091151 shutdown_connections 2024-09-17T05:48:01.932 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:01.930+0000 7f911f5df640 1 --2- 172.21.15.150:0/2785091151 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9118152920 0x7f911815f3d0 unknown :-1 s=CLOSED pgs=978 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:48:01.932 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:01.930+0000 7f911f5df640 1 -- 172.21.15.150:0/2785091151 >> 172.21.15.150:0/2785091151 conn(0x7f911806d730 msgr2=0x7f91180b1e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:48:01.932 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:01.930+0000 7f911f5df640 1 -- 172.21.15.150:0/2785091151 shutdown_connections 2024-09-17T05:48:01.933 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:01.930+0000 7f911f5df640 1 -- 172.21.15.150:0/2785091151 wait complete. 2024-09-17T05:48:01.933 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:01.932+0000 7f911f5df640 1 Processor -- start 2024-09-17T05:48:01.933 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:01.932+0000 7f911f5df640 1 -- start start 2024-09-17T05:48:01.936 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:01.933+0000 7f911f5df640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f91180aebc0 0x7f91180afe50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:48:01.936 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:01.933+0000 7f911f5df640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9118152920 0x7f91180b0a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:48:01.936 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:01.933+0000 7f911f5df640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f911815f910 0x7f91180b0fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:48:01.936 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:01.933+0000 7f911f5df640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f91180b4390 con 0x7f9118152920 2024-09-17T05:48:01.936 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:01.933+0000 7f911f5df640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f91180b4210 con 0x7f91180aebc0 2024-09-17T05:48:01.936 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:01.933+0000 7f911f5df640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f91180b4510 con 0x7f911815f910 2024-09-17T05:48:01.936 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:01.933+0000 7f911cb7a640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9118152920 0x7f91180b0a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:48:01.937 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:01.933+0000 7f911cb7a640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9118152920 0x7f91180b0a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:60148/0 (socket says 172.21.15.150:60148) 2024-09-17T05:48:01.937 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:01.933+0000 7f911cb7a640 1 -- 172.21.15.150:0/1012473366 learned_addr learned my addr 172.21.15.150:0/1012473366 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:48:01.937 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:01.933+0000 7f911d37b640 1 --2- 172.21.15.150:0/1012473366 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f91180aebc0 0x7f91180afe50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:48:01.937 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:01.933+0000 7f911db7c640 1 --2- 172.21.15.150:0/1012473366 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f911815f910 0x7f91180b0fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:48:01.937 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:01.933+0000 7f911cb7a640 1 -- 172.21.15.150:0/1012473366 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f911815f910 msgr2=0x7f91180b0fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:48:01.937 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:01.933+0000 7f911cb7a640 1 --2- 172.21.15.150:0/1012473366 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f911815f910 0x7f91180b0fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:48:01.937 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:01.933+0000 7f911cb7a640 1 -- 172.21.15.150:0/1012473366 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f91180aebc0 msgr2=0x7f91180afe50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:48:01.937 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:01.933+0000 7f911cb7a640 1 --2- 172.21.15.150:0/1012473366 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f91180aebc0 0x7f91180afe50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:48:01.937 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:01.933+0000 7f911cb7a640 1 -- 172.21.15.150:0/1012473366 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f911813f390 con 0x7f9118152920 2024-09-17T05:48:01.937 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:01.933+0000 7f911d37b640 1 --2- 172.21.15.150:0/1012473366 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f91180aebc0 0x7f91180afe50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:48:01.937 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:01.934+0000 7f911cb7a640 1 --2- 172.21.15.150:0/1012473366 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9118152920 0x7f91180b0a60 secure :-1 s=READY pgs=979 cs=0 l=1 rev1=1 crypto rx=0x7f910802aa70 tx=0x7f9108033c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:48:01.937 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:01.934+0000 7f910dffb640 1 -- 172.21.15.150:0/1012473366 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9108031d60 con 0x7f9118152920 2024-09-17T05:48:01.937 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:01.934+0000 7f910dffb640 1 -- 172.21.15.150:0/1012473366 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9108033e10 con 0x7f9118152920 2024-09-17T05:48:01.938 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:01.934+0000 7f910dffb640 1 -- 172.21.15.150:0/1012473366 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9108005260 con 0x7f9118152920 2024-09-17T05:48:01.938 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:01.934+0000 7f911f5df640 1 -- 172.21.15.150:0/1012473366 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f91181592c0 con 0x7f9118152920 2024-09-17T05:48:01.938 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:01.934+0000 7f911f5df640 1 -- 172.21.15.150:0/1012473366 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f91180cf0f0 con 0x7f9118152920 2024-09-17T05:48:01.939 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:01.935+0000 7f911f5df640 1 -- 172.21.15.150:0/1012473366 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f91180b49e0 con 0x7f9118152920 2024-09-17T05:48:01.940 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:01.936+0000 7f910dffb640 1 -- 172.21.15.150:0/1012473366 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 25) ==== 103022+0+0 (secure 0 0 0) 0x7f9108005400 con 0x7f9118152920 2024-09-17T05:48:01.940 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:01.936+0000 7f910dffb640 1 --2- 172.21.15.150:0/1012473366 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f90fc079d30 0x7f90fc07c240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:48:01.940 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:01.936+0000 7f910dffb640 1 -- 172.21.15.150:0/1012473366 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 5027+0+0 (secure 0 0 0) 0x7f91080babb0 con 0x7f9118152920 2024-09-17T05:48:01.940 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:01.937+0000 7f911d37b640 1 --2- 172.21.15.150:0/1012473366 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f90fc079d30 0x7f90fc07c240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:48:01.940 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:01.937+0000 7f911d37b640 1 --2- 172.21.15.150:0/1012473366 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f90fc079d30 0x7f90fc07c240 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f9114000f60 tx=0x7f9114009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:48:01.942 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:01.941+0000 7f910dffb640 1 -- 172.21.15.150:0/1012473366 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f910803f030 con 0x7f9118152920 2024-09-17T05:48:02.152 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:02.150+0000 7f911f5df640 1 -- 172.21.15.150:0/1012473366 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f91180d0c50 con 0x7f9118152920 2024-09-17T05:48:02.152 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:02.151+0000 7f910dffb640 1 -- 172.21.15.150:0/1012473366 <== mon.0 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 45 v45) ==== 94+0+3920 (secure 0 0 0) 0x7f911815fd20 con 0x7f9118152920 2024-09-17T05:48:02.153 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-09-17T05:48:02.153 INFO:teuthology.orchestra.run.smithi150.stdout:{"epoch":45,"btime":"2024-09-17T05:47:55:778537+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5639,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6836/3422557079","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6834","nonce":3422557079},{"type":"v1","addr":"172.21.15.176:6836","nonce":3422557079}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":38},{"gid":6070,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6837/2283556368","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6835","nonce":2283556368},{"type":"v1","addr":"172.21.15.176:6837","nonce":2283556368}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":38},{"gid":6495,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6834/4130242651","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6832","nonce":4130242651},{"type":"v1","addr":"172.21.15.150:6834","nonce":4130242651}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":37},{"gid":7041,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6835/976698785","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6833","nonce":976698785},{"type":"v1","addr":"172.21.15.150:6835","nonce":976698785}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":45}],"filesystems":[]} 2024-09-17T05:48:02.153 INFO:teuthology.orchestra.run.smithi150.stderr:dumped fsmap epoch 45 2024-09-17T05:48:02.155 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:02.153+0000 7f911f5df640 1 -- 172.21.15.150:0/1012473366 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f90fc079d30 msgr2=0x7f90fc07c240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:48:02.155 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:02.153+0000 7f911f5df640 1 --2- 172.21.15.150:0/1012473366 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f90fc079d30 0x7f90fc07c240 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f9114000f60 tx=0x7f9114009040 comp rx=0 tx=0).stop 2024-09-17T05:48:02.155 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:02.153+0000 7f911f5df640 1 -- 172.21.15.150:0/1012473366 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9118152920 msgr2=0x7f91180b0a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:48:02.155 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:02.153+0000 7f911f5df640 1 --2- 172.21.15.150:0/1012473366 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9118152920 0x7f91180b0a60 secure :-1 s=READY pgs=979 cs=0 l=1 rev1=1 crypto rx=0x7f910802aa70 tx=0x7f9108033c20 comp rx=0 tx=0).stop 2024-09-17T05:48:02.155 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:02.153+0000 7f911f5df640 1 -- 172.21.15.150:0/1012473366 shutdown_connections 2024-09-17T05:48:02.155 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:02.153+0000 7f911f5df640 1 --2- 172.21.15.150:0/1012473366 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f90fc079d30 0x7f90fc07c240 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:48:02.156 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:02.153+0000 7f911f5df640 1 --2- 172.21.15.150:0/1012473366 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f911815f910 0x7f91180b0fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:48:02.156 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:02.153+0000 7f911f5df640 1 --2- 172.21.15.150:0/1012473366 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9118152920 0x7f91180b0a60 unknown :-1 s=CLOSED pgs=979 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:48:02.156 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:02.153+0000 7f911f5df640 1 --2- 172.21.15.150:0/1012473366 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f91180aebc0 0x7f91180afe50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:48:02.156 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:02.153+0000 7f911f5df640 1 -- 172.21.15.150:0/1012473366 >> 172.21.15.150:0/1012473366 conn(0x7f911806d730 msgr2=0x7f911815cf60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:48:02.156 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:02.153+0000 7f911f5df640 1 -- 172.21.15.150:0/1012473366 shutdown_connections 2024-09-17T05:48:02.156 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:02.153+0000 7f911f5df640 1 -- 172.21.15.150:0/1012473366 wait complete. 2024-09-17T05:48:02.167 INFO:tasks.ceph.mds.a:Restarting daemon 2024-09-17T05:48:02.167 INFO:tasks.ceph.mds.a:Stopping old one... 2024-09-17T05:48:02.167 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-09-17T05:48:02.167 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T05:48:02.167 INFO:tasks.ceph.mds.c:Restarting daemon 2024-09-17T05:48:02.168 INFO:tasks.ceph.mds.c:Stopping old one... 2024-09-17T05:48:02.168 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-09-17T05:48:02.168 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T05:48:02.168 INFO:tasks.ceph.mds.b:Restarting daemon 2024-09-17T05:48:02.168 INFO:tasks.ceph.mds.b:Stopping old one... 2024-09-17T05:48:02.168 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-09-17T05:48:02.168 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T05:48:02.169 INFO:tasks.ceph.mds.d:Restarting daemon 2024-09-17T05:48:02.169 INFO:tasks.ceph.mds.d:Stopping old one... 2024-09-17T05:48:02.169 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-09-17T05:48:02.169 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T05:48:02.178 INFO:tasks.ceph.mds.c:Stopped 2024-09-17T05:48:02.179 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-09-17T05:48:02.181 INFO:tasks.ceph.mds.a:Stopped 2024-09-17T05:48:02.181 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-09-17T05:48:02.182 INFO:tasks.ceph.mds.b:Stopped 2024-09-17T05:48:02.182 DEBUG:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-09-17T05:48:02.183 INFO:tasks.ceph.mds.d:Stopped 2024-09-17T05:48:02.183 DEBUG:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-09-17T05:48:02.222 INFO:tasks.ceph.mds.c:Started 2024-09-17T05:48:02.223 DEBUG:teuthology.parallel:result is None 2024-09-17T05:48:02.224 INFO:tasks.ceph.mds.a:Started 2024-09-17T05:48:02.224 DEBUG:teuthology.parallel:result is None 2024-09-17T05:48:02.225 INFO:tasks.ceph.mds.b:Started 2024-09-17T05:48:02.225 DEBUG:teuthology.parallel:result is None 2024-09-17T05:48:02.226 INFO:tasks.ceph.mds.d:Started 2024-09-17T05:48:02.226 DEBUG:teuthology.parallel:result is None 2024-09-17T05:48:02.227 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-09-17T05:48:02.311 INFO:tasks.ceph.mds.a.smithi150.stdout:starting mds.a at 2024-09-17T05:48:02.311 INFO:tasks.ceph.mds.c.smithi150.stdout:starting mds.c at 2024-09-17T05:48:02.320 INFO:tasks.ceph.mds.b.smithi176.stdout:starting mds.b at 2024-09-17T05:48:02.320 INFO:tasks.ceph.mds.d.smithi176.stdout:starting mds.d at 2024-09-17T05:48:02.349 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:02.347+0000 7fed2ee15640 1 -- 172.21.15.150:0/2846659863 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fed280b78c0 msgr2=0x7fed280d0330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:48:02.349 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:02.347+0000 7fed2ee15640 1 --2- 172.21.15.150:0/2846659863 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fed280b78c0 0x7fed280d0330 secure :-1 s=READY pgs=984 cs=0 l=1 rev1=1 crypto rx=0x7fed280b9c80 tx=0x7fed1802a510 comp rx=0 tx=0).stop 2024-09-17T05:48:02.349 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:02.347+0000 7fed2ee15640 1 -- 172.21.15.150:0/2846659863 shutdown_connections 2024-09-17T05:48:02.350 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:02.347+0000 7fed2ee15640 1 --2- 172.21.15.150:0/2846659863 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fed280b78c0 0x7fed280d0330 unknown :-1 s=CLOSED pgs=984 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:48:02.350 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:02.347+0000 7fed2ee15640 1 -- 172.21.15.150:0/2846659863 >> 172.21.15.150:0/2846659863 conn(0x7fed2808bfe0 msgr2=0x7fed280d4660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:48:02.350 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:02.347+0000 7fed2ee15640 1 -- 172.21.15.150:0/2846659863 shutdown_connections 2024-09-17T05:48:02.350 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:02.347+0000 7fed2ee15640 1 -- 172.21.15.150:0/2846659863 wait complete. 2024-09-17T05:48:02.350 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:02.349+0000 7fed2ee15640 1 Processor -- start 2024-09-17T05:48:02.351 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:02.349+0000 7fed2ee15640 1 -- start start 2024-09-17T05:48:02.353 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:02.350+0000 7fed2ee15640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fed280b6320 0x7fed2815bd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:48:02.354 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:02.351+0000 7fed2ee15640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fed280b74b0 0x7fed280cc9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:48:02.354 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:02.351+0000 7fed2ee15640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fed280b78c0 0x7fed280ccf20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:48:02.354 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:02.351+0000 7fed2ee15640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7fed2816a340 con 0x7fed280b78c0 2024-09-17T05:48:02.354 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:02.351+0000 7fed2ee15640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fed280b5570 con 0x7fed280b74b0 2024-09-17T05:48:02.354 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:02.351+0000 7fed2ee15640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fed2816a4c0 con 0x7fed280b6320 2024-09-17T05:48:02.354 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:02.351+0000 7fed2d3b2640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fed280b78c0 0x7fed280ccf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:48:02.354 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:02.351+0000 7fed27fff640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fed280b74b0 0x7fed280cc9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:48:02.354 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:02.351+0000 7fed2d3b2640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fed280b78c0 0x7fed280ccf20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:60180/0 (socket says 172.21.15.150:60180) 2024-09-17T05:48:02.354 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:02.351+0000 7fed2d3b2640 1 -- 172.21.15.150:0/3495468396 learned_addr learned my addr 172.21.15.150:0/3495468396 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:48:02.354 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:02.351+0000 7fed2cbb1640 1 --2- 172.21.15.150:0/3495468396 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fed280b6320 0x7fed2815bd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:48:02.354 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:02.351+0000 7fed2d3b2640 1 -- 172.21.15.150:0/3495468396 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fed280b6320 msgr2=0x7fed2815bd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:48:02.354 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:02.351+0000 7fed2d3b2640 1 --2- 172.21.15.150:0/3495468396 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fed280b6320 0x7fed2815bd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:48:02.354 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:02.351+0000 7fed2d3b2640 1 -- 172.21.15.150:0/3495468396 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fed280b74b0 msgr2=0x7fed280cc9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:48:02.355 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:02.351+0000 7fed2d3b2640 1 --2- 172.21.15.150:0/3495468396 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fed280b74b0 0x7fed280cc9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:48:02.355 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:02.351+0000 7fed2d3b2640 1 -- 172.21.15.150:0/3495468396 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fed2815f110 con 0x7fed280b78c0 2024-09-17T05:48:02.355 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:02.351+0000 7fed2d3b2640 1 --2- 172.21.15.150:0/3495468396 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fed280b78c0 0x7fed280ccf20 secure :-1 s=READY pgs=985 cs=0 l=1 rev1=1 crypto rx=0x7fed1000c3c0 tx=0x7fed1000c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:48:02.355 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:02.351+0000 7fed257fa640 1 -- 172.21.15.150:0/3495468396 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed10017070 con 0x7fed280b78c0 2024-09-17T05:48:02.355 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:02.351+0000 7fed257fa640 1 -- 172.21.15.150:0/3495468396 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fed100053c0 con 0x7fed280b78c0 2024-09-17T05:48:02.355 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:02.351+0000 7fed2ee15640 1 -- 172.21.15.150:0/3495468396 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fed2815c240 con 0x7fed280b78c0 2024-09-17T05:48:02.355 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:02.351+0000 7fed257fa640 1 -- 172.21.15.150:0/3495468396 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed10003850 con 0x7fed280b78c0 2024-09-17T05:48:02.355 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:02.351+0000 7fed2ee15640 1 -- 172.21.15.150:0/3495468396 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fed280cc260 con 0x7fed280b78c0 2024-09-17T05:48:02.356 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:02.352+0000 7fed2ee15640 1 -- 172.21.15.150:0/3495468396 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fed2808caf0 con 0x7fed280b78c0 2024-09-17T05:48:02.356 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:02.353+0000 7fed257fa640 1 -- 172.21.15.150:0/3495468396 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 25) ==== 103022+0+0 (secure 0 0 0) 0x7fed1001a070 con 0x7fed280b78c0 2024-09-17T05:48:02.356 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:02.354+0000 7fed257fa640 1 --2- 172.21.15.150:0/3495468396 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fed08079d00 0x7fed0807c210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:48:02.356 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:02.354+0000 7fed257fa640 1 -- 172.21.15.150:0/3495468396 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 5027+0+0 (secure 0 0 0) 0x7fed10098ea0 con 0x7fed280b78c0 2024-09-17T05:48:02.356 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:02.354+0000 7fed2cbb1640 1 --2- 172.21.15.150:0/3495468396 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fed08079d00 0x7fed0807c210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:48:02.356 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:02.354+0000 7fed2cbb1640 1 --2- 172.21.15.150:0/3495468396 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fed08079d00 0x7fed0807c210 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7fed20007fd0 tx=0x7fed20009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:48:02.359 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:02.358+0000 7fed257fa640 1 -- 172.21.15.150:0/3495468396 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fed2808caf0 con 0x7fed280b78c0 2024-09-17T05:48:02.546 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:02.544+0000 7fed2ee15640 1 -- 172.21.15.150:0/3495468396 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) -- 0x7fed280cc050 con 0x7fed280b78c0 2024-09-17T05:48:02.958 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:02.956+0000 7fed257fa640 1 -- 172.21.15.150:0/3495468396 <== mon.0 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v80) ==== 97+0+0 (secure 0 0 0) 0x7fed10062540 con 0x7fed280b78c0 2024-09-17T05:48:02.958 INFO:teuthology.orchestra.run.smithi150.stderr: removed all blocklist entries 2024-09-17T05:48:02.961 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:02.959+0000 7fed2ee15640 1 -- 172.21.15.150:0/3495468396 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fed08079d00 msgr2=0x7fed0807c210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:48:02.961 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:02.959+0000 7fed2ee15640 1 --2- 172.21.15.150:0/3495468396 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fed08079d00 0x7fed0807c210 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7fed20007fd0 tx=0x7fed20009040 comp rx=0 tx=0).stop 2024-09-17T05:48:02.961 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:02.959+0000 7fed2ee15640 1 -- 172.21.15.150:0/3495468396 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fed280b78c0 msgr2=0x7fed280ccf20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:48:02.961 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:02.959+0000 7fed2ee15640 1 --2- 172.21.15.150:0/3495468396 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fed280b78c0 0x7fed280ccf20 secure :-1 s=READY pgs=985 cs=0 l=1 rev1=1 crypto rx=0x7fed1000c3c0 tx=0x7fed1000c880 comp rx=0 tx=0).stop 2024-09-17T05:48:02.961 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:02.959+0000 7fed2ee15640 1 -- 172.21.15.150:0/3495468396 shutdown_connections 2024-09-17T05:48:02.961 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:02.959+0000 7fed2ee15640 1 --2- 172.21.15.150:0/3495468396 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fed280b74b0 0x7fed280cc9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:48:02.962 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:02.959+0000 7fed2ee15640 1 --2- 172.21.15.150:0/3495468396 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fed08079d00 0x7fed0807c210 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:48:02.962 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:02.959+0000 7fed2ee15640 1 --2- 172.21.15.150:0/3495468396 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fed280b78c0 0x7fed280ccf20 unknown :-1 s=CLOSED pgs=985 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:48:02.962 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:02.959+0000 7fed2ee15640 1 --2- 172.21.15.150:0/3495468396 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fed280b6320 0x7fed2815bd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:48:02.962 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:02.959+0000 7fed2ee15640 1 -- 172.21.15.150:0/3495468396 >> 172.21.15.150:0/3495468396 conn(0x7fed2808bfe0 msgr2=0x7fed2806e160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:48:02.962 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:02.959+0000 7fed2ee15640 1 -- 172.21.15.150:0/3495468396 shutdown_connections 2024-09-17T05:48:02.962 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:02.959+0000 7fed2ee15640 1 -- 172.21.15.150:0/3495468396 wait complete. 2024-09-17T05:48:02.975 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-09-17T05:48:03.090 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:03.088+0000 7f2465b58640 1 -- 172.21.15.150:0/1960617605 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f24600b5d50 msgr2=0x7f24600d2780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:48:03.090 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:03.088+0000 7f2465b58640 1 --2- 172.21.15.150:0/1960617605 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f24600b5d50 0x7f24600d2780 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f2450005fd0 tx=0x7f245002a840 comp rx=0 tx=0).stop 2024-09-17T05:48:03.091 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:03.088+0000 7f2465b58640 1 -- 172.21.15.150:0/1960617605 shutdown_connections 2024-09-17T05:48:03.091 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:03.088+0000 7f2465b58640 1 --2- 172.21.15.150:0/1960617605 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f24600d1790 0x7f24600d0400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:48:03.091 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:03.088+0000 7f2465b58640 1 --2- 172.21.15.150:0/1960617605 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f24600b5d50 0x7f24600d2780 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:48:03.091 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:03.088+0000 7f2465b58640 1 -- 172.21.15.150:0/1960617605 >> 172.21.15.150:0/1960617605 conn(0x7f246008bfe0 msgr2=0x7f24600d4670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:48:03.091 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:03.089+0000 7f2465b58640 1 -- 172.21.15.150:0/1960617605 shutdown_connections 2024-09-17T05:48:03.091 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:03.089+0000 7f2465b58640 1 -- 172.21.15.150:0/1960617605 wait complete. 2024-09-17T05:48:03.091 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:03.090+0000 7f2465b58640 1 Processor -- start 2024-09-17T05:48:03.092 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:03.090+0000 7f2465b58640 1 -- start start 2024-09-17T05:48:03.095 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:03.092+0000 7f2465b58640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f24600b5d50 0x7f2460157ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:48:03.095 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:03.092+0000 7f2465b58640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f24600d4f90 0x7f24600ce1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:48:03.095 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:03.092+0000 7f2465b58640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2460158530 0x7f24600ce710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:48:03.095 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:03.092+0000 7f2465b58640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f24600b7b00 con 0x7f24600b5d50 2024-09-17T05:48:03.095 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:03.092+0000 7f2465b58640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f24600b7980 con 0x7f2460158530 2024-09-17T05:48:03.095 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:03.092+0000 7f2465b58640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f24600b7c80 con 0x7f24600d4f90 2024-09-17T05:48:03.096 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:03.092+0000 7f245f7fe640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f24600b5d50 0x7f2460157ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:48:03.096 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:03.092+0000 7f245f7fe640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f24600b5d50 0x7f2460157ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:60194/0 (socket says 172.21.15.150:60194) 2024-09-17T05:48:03.096 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:03.092+0000 7f245f7fe640 1 -- 172.21.15.150:0/3374182506 learned_addr learned my addr 172.21.15.150:0/3374182506 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:48:03.096 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:03.092+0000 7f245effd640 1 --2- 172.21.15.150:0/3374182506 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f24600d4f90 0x7f24600ce1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:48:03.096 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:03.092+0000 7f245ffff640 1 --2- 172.21.15.150:0/3374182506 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2460158530 0x7f24600ce710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:48:03.096 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:03.092+0000 7f245f7fe640 1 -- 172.21.15.150:0/3374182506 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f24600d4f90 msgr2=0x7f24600ce1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:48:03.096 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:03.092+0000 7f245f7fe640 1 --2- 172.21.15.150:0/3374182506 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f24600d4f90 0x7f24600ce1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:48:03.096 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:03.092+0000 7f245f7fe640 1 -- 172.21.15.150:0/3374182506 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2460158530 msgr2=0x7f24600ce710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:48:03.096 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:03.092+0000 7f245f7fe640 1 --2- 172.21.15.150:0/3374182506 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2460158530 0x7f24600ce710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:48:03.096 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:03.092+0000 7f245f7fe640 1 -- 172.21.15.150:0/3374182506 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2460159710 con 0x7f24600b5d50 2024-09-17T05:48:03.096 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:03.092+0000 7f245ffff640 1 --2- 172.21.15.150:0/3374182506 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2460158530 0x7f24600ce710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:48:03.096 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:03.092+0000 7f245f7fe640 1 --2- 172.21.15.150:0/3374182506 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f24600b5d50 0x7f2460157ff0 secure :-1 s=READY pgs=987 cs=0 l=1 rev1=1 crypto rx=0x7f2450034040 tx=0x7f2450032cf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:48:03.097 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:03.093+0000 7f2457fff640 1 -- 172.21.15.150:0/3374182506 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2450040070 con 0x7f24600b5d50 2024-09-17T05:48:03.097 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:03.093+0000 7f2457fff640 1 -- 172.21.15.150:0/3374182506 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f2450004560 con 0x7f24600b5d50 2024-09-17T05:48:03.097 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:03.093+0000 7f2457fff640 1 -- 172.21.15.150:0/3374182506 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2450003e60 con 0x7f24600b5d50 2024-09-17T05:48:03.097 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:03.093+0000 7f2465b58640 1 -- 172.21.15.150:0/3374182506 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f24601599f0 con 0x7f24600b5d50 2024-09-17T05:48:03.097 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:03.093+0000 7f2465b58640 1 -- 172.21.15.150:0/3374182506 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2460155680 con 0x7f24600b5d50 2024-09-17T05:48:03.097 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:03.094+0000 7f2465b58640 1 -- 172.21.15.150:0/3374182506 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f24601554a0 con 0x7f24600b5d50 2024-09-17T05:48:03.098 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:03.095+0000 7f2457fff640 1 -- 172.21.15.150:0/3374182506 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 25) ==== 103022+0+0 (secure 0 0 0) 0x7f2450043070 con 0x7f24600b5d50 2024-09-17T05:48:03.098 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:03.095+0000 7f2457fff640 1 --2- 172.21.15.150:0/3374182506 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f2440079d00 0x7f244007c210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:48:03.098 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:03.095+0000 7f2457fff640 1 -- 172.21.15.150:0/3374182506 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 4941+0+0 (secure 0 0 0) 0x7f24500ba990 con 0x7f24600b5d50 2024-09-17T05:48:03.098 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:03.095+0000 7f245effd640 1 --2- 172.21.15.150:0/3374182506 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f2440079d00 0x7f244007c210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:48:03.098 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:03.096+0000 7f245effd640 1 --2- 172.21.15.150:0/3374182506 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f2440079d00 0x7f244007c210 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f24600b94d0 tx=0x7f2448001d50 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:48:03.101 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:03.100+0000 7f2457fff640 1 -- 172.21.15.150:0/3374182506 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f24601554a0 con 0x7f24600b5d50 2024-09-17T05:48:03.343 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:03.341+0000 7f2465b58640 1 -- 172.21.15.150:0/3374182506 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) -- 0x7f24600d2780 con 0x7f24600b5d50 2024-09-17T05:48:03.343 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:03.342+0000 7f2457fff640 1 -- 172.21.15.150:0/3374182506 <== mon.0 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v14) ==== 80+0+5304 (secure 0 0 0) 0x7f24500842c0 con 0x7f24600b5d50 2024-09-17T05:48:03.344 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-09-17T05:48:03.344 INFO:teuthology.orchestra.run.smithi150.stdout:{ 2024-09-17T05:48:03.344 INFO:teuthology.orchestra.run.smithi150.stdout: "auth_dump": [ 2024-09-17T05:48:03.344 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-09-17T05:48:03.344 INFO:teuthology.orchestra.run.smithi150.stdout: "entity": "mds.a", 2024-09-17T05:48:03.344 INFO:teuthology.orchestra.run.smithi150.stdout: "key": "AQBoFulmMHALAxAAEO+QBgzbd+BNfhyY2qPiqw==", 2024-09-17T05:48:03.344 INFO:teuthology.orchestra.run.smithi150.stdout: "caps": { 2024-09-17T05:48:03.344 INFO:teuthology.orchestra.run.smithi150.stdout: "mds": "allow", 2024-09-17T05:48:03.344 INFO:teuthology.orchestra.run.smithi150.stdout: "mgr": "allow *", 2024-09-17T05:48:03.344 INFO:teuthology.orchestra.run.smithi150.stdout: "mon": "allow *", 2024-09-17T05:48:03.344 INFO:teuthology.orchestra.run.smithi150.stdout: "osd": "allow *" 2024-09-17T05:48:03.344 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-09-17T05:48:03.345 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-17T05:48:03.345 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-09-17T05:48:03.345 INFO:teuthology.orchestra.run.smithi150.stdout: "entity": "mds.b", 2024-09-17T05:48:03.345 INFO:teuthology.orchestra.run.smithi150.stdout: "key": "AQBoFulmtutmEBAAhKJEJQm181pL1lPmSSdYRQ==", 2024-09-17T05:48:03.345 INFO:teuthology.orchestra.run.smithi150.stdout: "caps": { 2024-09-17T05:48:03.345 INFO:teuthology.orchestra.run.smithi150.stdout: "mds": "allow", 2024-09-17T05:48:03.345 INFO:teuthology.orchestra.run.smithi150.stdout: "mgr": "allow *", 2024-09-17T05:48:03.345 INFO:teuthology.orchestra.run.smithi150.stdout: "mon": "allow *", 2024-09-17T05:48:03.345 INFO:teuthology.orchestra.run.smithi150.stdout: "osd": "allow *" 2024-09-17T05:48:03.345 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-09-17T05:48:03.345 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-17T05:48:03.345 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-09-17T05:48:03.345 INFO:teuthology.orchestra.run.smithi150.stdout: "entity": "mds.c", 2024-09-17T05:48:03.346 INFO:teuthology.orchestra.run.smithi150.stdout: "key": "AQBoFulmHTKsChAA4/fUb2NC+fMhR+xIYIDjgQ==", 2024-09-17T05:48:03.346 INFO:teuthology.orchestra.run.smithi150.stdout: "caps": { 2024-09-17T05:48:03.346 INFO:teuthology.orchestra.run.smithi150.stdout: "mds": "allow", 2024-09-17T05:48:03.346 INFO:teuthology.orchestra.run.smithi150.stdout: "mgr": "allow *", 2024-09-17T05:48:03.346 INFO:teuthology.orchestra.run.smithi150.stdout: "mon": "allow *", 2024-09-17T05:48:03.346 INFO:teuthology.orchestra.run.smithi150.stdout: "osd": "allow *" 2024-09-17T05:48:03.346 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-09-17T05:48:03.346 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-17T05:48:03.346 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-09-17T05:48:03.346 INFO:teuthology.orchestra.run.smithi150.stdout: "entity": "mds.d", 2024-09-17T05:48:03.346 INFO:teuthology.orchestra.run.smithi150.stdout: "key": "AQBoFulmr2s3GBAAhXzLVtObF/LwTpDIrY8MIQ==", 2024-09-17T05:48:03.346 INFO:teuthology.orchestra.run.smithi150.stdout: "caps": { 2024-09-17T05:48:03.346 INFO:teuthology.orchestra.run.smithi150.stdout: "mds": "allow", 2024-09-17T05:48:03.346 INFO:teuthology.orchestra.run.smithi150.stdout: "mgr": "allow *", 2024-09-17T05:48:03.347 INFO:teuthology.orchestra.run.smithi150.stdout: "mon": "allow *", 2024-09-17T05:48:03.347 INFO:teuthology.orchestra.run.smithi150.stdout: "osd": "allow *" 2024-09-17T05:48:03.347 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-09-17T05:48:03.347 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-17T05:48:03.347 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-09-17T05:48:03.347 INFO:teuthology.orchestra.run.smithi150.stdout: "entity": "osd.0", 2024-09-17T05:48:03.347 INFO:teuthology.orchestra.run.smithi150.stdout: "key": "AQBrFulm9eU0NRAAqgc1CtMOz+jDCHBn8coaVw==", 2024-09-17T05:48:03.347 INFO:teuthology.orchestra.run.smithi150.stdout: "caps": { 2024-09-17T05:48:03.347 INFO:teuthology.orchestra.run.smithi150.stdout: "mgr": "allow profile osd", 2024-09-17T05:48:03.347 INFO:teuthology.orchestra.run.smithi150.stdout: "mon": "allow profile osd", 2024-09-17T05:48:03.348 INFO:teuthology.orchestra.run.smithi150.stdout: "osd": "allow *" 2024-09-17T05:48:03.348 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-09-17T05:48:03.348 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-17T05:48:03.348 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-09-17T05:48:03.348 INFO:teuthology.orchestra.run.smithi150.stdout: "entity": "osd.1", 2024-09-17T05:48:03.348 INFO:teuthology.orchestra.run.smithi150.stdout: "key": "AQBvFulmlFL6CxAA8ByBraZue2FLfyZeOIpj3A==", 2024-09-17T05:48:03.348 INFO:teuthology.orchestra.run.smithi150.stdout: "caps": { 2024-09-17T05:48:03.348 INFO:teuthology.orchestra.run.smithi150.stdout: "mgr": "allow profile osd", 2024-09-17T05:48:03.348 INFO:teuthology.orchestra.run.smithi150.stdout: "mon": "allow profile osd", 2024-09-17T05:48:03.348 INFO:teuthology.orchestra.run.smithi150.stdout: "osd": "allow *" 2024-09-17T05:48:03.348 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-09-17T05:48:03.348 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-17T05:48:03.348 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-09-17T05:48:03.349 INFO:teuthology.orchestra.run.smithi150.stdout: "entity": "osd.2", 2024-09-17T05:48:03.349 INFO:teuthology.orchestra.run.smithi150.stdout: "key": "AQByFulmMQF5LBAAB4rbdIL6Zd+l4I4LDC/r3Q==", 2024-09-17T05:48:03.349 INFO:teuthology.orchestra.run.smithi150.stdout: "caps": { 2024-09-17T05:48:03.349 INFO:teuthology.orchestra.run.smithi150.stdout: "mgr": "allow profile osd", 2024-09-17T05:48:03.349 INFO:teuthology.orchestra.run.smithi150.stdout: "mon": "allow profile osd", 2024-09-17T05:48:03.349 INFO:teuthology.orchestra.run.smithi150.stdout: "osd": "allow *" 2024-09-17T05:48:03.349 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-09-17T05:48:03.349 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-17T05:48:03.349 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-09-17T05:48:03.349 INFO:teuthology.orchestra.run.smithi150.stdout: "entity": "osd.3", 2024-09-17T05:48:03.349 INFO:teuthology.orchestra.run.smithi150.stdout: "key": "AQB2Fulm5fjaAhAASnkpgsW79Sr9IIiy4HMm4g==", 2024-09-17T05:48:03.349 INFO:teuthology.orchestra.run.smithi150.stdout: "caps": { 2024-09-17T05:48:03.349 INFO:teuthology.orchestra.run.smithi150.stdout: "mgr": "allow profile osd", 2024-09-17T05:48:03.350 INFO:teuthology.orchestra.run.smithi150.stdout: "mon": "allow profile osd", 2024-09-17T05:48:03.350 INFO:teuthology.orchestra.run.smithi150.stdout: "osd": "allow *" 2024-09-17T05:48:03.350 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-09-17T05:48:03.350 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-17T05:48:03.350 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-09-17T05:48:03.350 INFO:teuthology.orchestra.run.smithi150.stdout: "entity": "osd.4", 2024-09-17T05:48:03.350 INFO:teuthology.orchestra.run.smithi150.stdout: "key": "AQB8Fulm9fWPGhAA9nNf+0znlS0Z7rqOvC47xQ==", 2024-09-17T05:48:03.350 INFO:teuthology.orchestra.run.smithi150.stdout: "caps": { 2024-09-17T05:48:03.350 INFO:teuthology.orchestra.run.smithi150.stdout: "mgr": "allow profile osd", 2024-09-17T05:48:03.351 INFO:teuthology.orchestra.run.smithi150.stdout: "mon": "allow profile osd", 2024-09-17T05:48:03.351 INFO:teuthology.orchestra.run.smithi150.stdout: "osd": "allow *" 2024-09-17T05:48:03.351 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-09-17T05:48:03.351 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-17T05:48:03.351 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-09-17T05:48:03.351 INFO:teuthology.orchestra.run.smithi150.stdout: "entity": "osd.5", 2024-09-17T05:48:03.351 INFO:teuthology.orchestra.run.smithi150.stdout: "key": "AQB/FulmeHakHRAASlnmKa0UTqVX+NSbmiHEBw==", 2024-09-17T05:48:03.351 INFO:teuthology.orchestra.run.smithi150.stdout: "caps": { 2024-09-17T05:48:03.351 INFO:teuthology.orchestra.run.smithi150.stdout: "mgr": "allow profile osd", 2024-09-17T05:48:03.351 INFO:teuthology.orchestra.run.smithi150.stdout: "mon": "allow profile osd", 2024-09-17T05:48:03.351 INFO:teuthology.orchestra.run.smithi150.stdout: "osd": "allow *" 2024-09-17T05:48:03.351 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-09-17T05:48:03.351 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-17T05:48:03.352 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-09-17T05:48:03.352 INFO:teuthology.orchestra.run.smithi150.stdout: "entity": "osd.6", 2024-09-17T05:48:03.352 INFO:teuthology.orchestra.run.smithi150.stdout: "key": "AQCCFulmEZF3IBAAhtpCanI6m8Kb3hyi+sRyyQ==", 2024-09-17T05:48:03.352 INFO:teuthology.orchestra.run.smithi150.stdout: "caps": { 2024-09-17T05:48:03.352 INFO:teuthology.orchestra.run.smithi150.stdout: "mgr": "allow profile osd", 2024-09-17T05:48:03.352 INFO:teuthology.orchestra.run.smithi150.stdout: "mon": "allow profile osd", 2024-09-17T05:48:03.352 INFO:teuthology.orchestra.run.smithi150.stdout: "osd": "allow *" 2024-09-17T05:48:03.352 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-09-17T05:48:03.352 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-17T05:48:03.352 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-09-17T05:48:03.352 INFO:teuthology.orchestra.run.smithi150.stdout: "entity": "osd.7", 2024-09-17T05:48:03.352 INFO:teuthology.orchestra.run.smithi150.stdout: "key": "AQCGFulmdcs7BRAAxsctes949cbkGkivdGpoYw==", 2024-09-17T05:48:03.353 INFO:teuthology.orchestra.run.smithi150.stdout: "caps": { 2024-09-17T05:48:03.353 INFO:teuthology.orchestra.run.smithi150.stdout: "mgr": "allow profile osd", 2024-09-17T05:48:03.353 INFO:teuthology.orchestra.run.smithi150.stdout: "mon": "allow profile osd", 2024-09-17T05:48:03.353 INFO:teuthology.orchestra.run.smithi150.stdout: "osd": "allow *" 2024-09-17T05:48:03.353 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-09-17T05:48:03.353 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-17T05:48:03.353 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-09-17T05:48:03.354 INFO:teuthology.orchestra.run.smithi150.stdout: "entity": "client.0", 2024-09-17T05:48:03.354 INFO:teuthology.orchestra.run.smithi150.stdout: "key": "AQBoFulmfF/1HBAAMezEjZDeoHTJ+uFfDXNWHQ==", 2024-09-17T05:48:03.354 INFO:teuthology.orchestra.run.smithi150.stdout: "caps": { 2024-09-17T05:48:03.354 INFO:teuthology.orchestra.run.smithi150.stdout: "mds": "allow", 2024-09-17T05:48:03.354 INFO:teuthology.orchestra.run.smithi150.stdout: "mon": "allow r", 2024-09-17T05:48:03.354 INFO:teuthology.orchestra.run.smithi150.stdout: "osd": "allow rw tag cephfs data=cephfs" 2024-09-17T05:48:03.354 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-09-17T05:48:03.354 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-17T05:48:03.354 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-09-17T05:48:03.354 INFO:teuthology.orchestra.run.smithi150.stdout: "entity": "client.1", 2024-09-17T05:48:03.354 INFO:teuthology.orchestra.run.smithi150.stdout: "key": "AQBoFulmv3GQJBAANlgjLqiCwzNfmBh8uClJ9A==", 2024-09-17T05:48:03.355 INFO:teuthology.orchestra.run.smithi150.stdout: "caps": { 2024-09-17T05:48:03.355 INFO:teuthology.orchestra.run.smithi150.stdout: "mds": "allow", 2024-09-17T05:48:03.355 INFO:teuthology.orchestra.run.smithi150.stdout: "mgr": "allow r", 2024-09-17T05:48:03.355 INFO:teuthology.orchestra.run.smithi150.stdout: "mon": "allow rw", 2024-09-17T05:48:03.355 INFO:teuthology.orchestra.run.smithi150.stdout: "osd": "allow rwx" 2024-09-17T05:48:03.355 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-09-17T05:48:03.355 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-17T05:48:03.355 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-09-17T05:48:03.355 INFO:teuthology.orchestra.run.smithi150.stdout: "entity": "client.2", 2024-09-17T05:48:03.355 INFO:teuthology.orchestra.run.smithi150.stdout: "key": "AQBoFulm1O/BIBAA8kfQL3/13SmZO1+y2tOZvw==", 2024-09-17T05:48:03.355 INFO:teuthology.orchestra.run.smithi150.stdout: "caps": { 2024-09-17T05:48:03.355 INFO:teuthology.orchestra.run.smithi150.stdout: "mds": "allow", 2024-09-17T05:48:03.355 INFO:teuthology.orchestra.run.smithi150.stdout: "mgr": "allow r", 2024-09-17T05:48:03.355 INFO:teuthology.orchestra.run.smithi150.stdout: "mon": "allow rw", 2024-09-17T05:48:03.356 INFO:teuthology.orchestra.run.smithi150.stdout: "osd": "allow rwx" 2024-09-17T05:48:03.356 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-09-17T05:48:03.356 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-17T05:48:03.356 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-09-17T05:48:03.356 INFO:teuthology.orchestra.run.smithi150.stdout: "entity": "client.3", 2024-09-17T05:48:03.356 INFO:teuthology.orchestra.run.smithi150.stdout: "key": "AQBoFulmF4hVKBAAZ5FGapBLLLtez3t8kON9dg==", 2024-09-17T05:48:03.356 INFO:teuthology.orchestra.run.smithi150.stdout: "caps": { 2024-09-17T05:48:03.356 INFO:teuthology.orchestra.run.smithi150.stdout: "mds": "allow", 2024-09-17T05:48:03.356 INFO:teuthology.orchestra.run.smithi150.stdout: "mgr": "allow r", 2024-09-17T05:48:03.356 INFO:teuthology.orchestra.run.smithi150.stdout: "mon": "allow rw", 2024-09-17T05:48:03.356 INFO:teuthology.orchestra.run.smithi150.stdout: "osd": "allow rwx" 2024-09-17T05:48:03.356 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-09-17T05:48:03.356 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-17T05:48:03.357 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-09-17T05:48:03.357 INFO:teuthology.orchestra.run.smithi150.stdout: "entity": "client.admin", 2024-09-17T05:48:03.357 INFO:teuthology.orchestra.run.smithi150.stdout: "key": "AQBnFulmaU9+IBAA7ZmXWZ44s0IpQ+C+Zw2V1g==", 2024-09-17T05:48:03.357 INFO:teuthology.orchestra.run.smithi150.stdout: "caps": { 2024-09-17T05:48:03.357 INFO:teuthology.orchestra.run.smithi150.stdout: "mds": "allow *", 2024-09-17T05:48:03.357 INFO:teuthology.orchestra.run.smithi150.stdout: "mgr": "allow *", 2024-09-17T05:48:03.357 INFO:teuthology.orchestra.run.smithi150.stdout: "mon": "allow *", 2024-09-17T05:48:03.357 INFO:teuthology.orchestra.run.smithi150.stdout: "osd": "allow *" 2024-09-17T05:48:03.357 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-09-17T05:48:03.357 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-17T05:48:03.357 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-09-17T05:48:03.357 INFO:teuthology.orchestra.run.smithi150.stdout: "entity": "mgr.x", 2024-09-17T05:48:03.357 INFO:teuthology.orchestra.run.smithi150.stdout: "key": "AQBnFulmEjvROhAAn3GZxCEtqPYLWopR1AcSFA==", 2024-09-17T05:48:03.358 INFO:teuthology.orchestra.run.smithi150.stdout: "caps": { 2024-09-17T05:48:03.358 INFO:teuthology.orchestra.run.smithi150.stdout: "mds": "allow *", 2024-09-17T05:48:03.358 INFO:teuthology.orchestra.run.smithi150.stdout: "mon": "allow profile mgr", 2024-09-17T05:48:03.358 INFO:teuthology.orchestra.run.smithi150.stdout: "osd": "allow *" 2024-09-17T05:48:03.358 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-09-17T05:48:03.358 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-17T05:48:03.358 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-09-17T05:48:03.358 INFO:teuthology.orchestra.run.smithi150.stdout: "entity": "mgr.y", 2024-09-17T05:48:03.358 INFO:teuthology.orchestra.run.smithi150.stdout: "key": "AQBnFulm9IkENhAA4uf1vzhYOepmovspN5/v1w==", 2024-09-17T05:48:03.358 INFO:teuthology.orchestra.run.smithi150.stdout: "caps": { 2024-09-17T05:48:03.358 INFO:teuthology.orchestra.run.smithi150.stdout: "mds": "allow *", 2024-09-17T05:48:03.358 INFO:teuthology.orchestra.run.smithi150.stdout: "mon": "allow profile mgr", 2024-09-17T05:48:03.358 INFO:teuthology.orchestra.run.smithi150.stdout: "osd": "allow *" 2024-09-17T05:48:03.359 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-09-17T05:48:03.359 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-09-17T05:48:03.359 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2024-09-17T05:48:03.359 INFO:teuthology.orchestra.run.smithi150.stdout:} 2024-09-17T05:48:03.360 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:03.344+0000 7f2465b58640 1 -- 172.21.15.150:0/3374182506 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f2440079d00 msgr2=0x7f244007c210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:48:03.360 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:03.344+0000 7f2465b58640 1 --2- 172.21.15.150:0/3374182506 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f2440079d00 0x7f244007c210 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f24600b94d0 tx=0x7f2448001d50 comp rx=0 tx=0).stop 2024-09-17T05:48:03.360 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:03.344+0000 7f2465b58640 1 -- 172.21.15.150:0/3374182506 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f24600b5d50 msgr2=0x7f2460157ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:48:03.361 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:03.344+0000 7f2465b58640 1 --2- 172.21.15.150:0/3374182506 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f24600b5d50 0x7f2460157ff0 secure :-1 s=READY pgs=987 cs=0 l=1 rev1=1 crypto rx=0x7f2450034040 tx=0x7f2450032cf0 comp rx=0 tx=0).stop 2024-09-17T05:48:03.361 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:03.344+0000 7f2465b58640 1 -- 172.21.15.150:0/3374182506 shutdown_connections 2024-09-17T05:48:03.361 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:03.344+0000 7f2465b58640 1 --2- 172.21.15.150:0/3374182506 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2460158530 0x7f24600ce710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:48:03.361 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:03.344+0000 7f2465b58640 1 --2- 172.21.15.150:0/3374182506 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f2440079d00 0x7f244007c210 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:48:03.361 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:03.344+0000 7f2465b58640 1 --2- 172.21.15.150:0/3374182506 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f24600d4f90 0x7f24600ce1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:48:03.361 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:03.344+0000 7f2465b58640 1 --2- 172.21.15.150:0/3374182506 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f24600b5d50 0x7f2460157ff0 unknown :-1 s=CLOSED pgs=987 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:48:03.361 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:03.344+0000 7f2465b58640 1 -- 172.21.15.150:0/3374182506 >> 172.21.15.150:0/3374182506 conn(0x7f246008bfe0 msgr2=0x7f24600b5460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:48:03.361 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:03.344+0000 7f2465b58640 1 -- 172.21.15.150:0/3374182506 shutdown_connections 2024-09-17T05:48:03.361 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:03.344+0000 7f2465b58640 1 -- 172.21.15.150:0/3374182506 wait complete. 2024-09-17T05:48:03.362 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-09-17T05:48:03.476 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:03.474+0000 7f106483f640 1 -- 172.21.15.150:0/2493280198 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1048004d40 msgr2=0x7f1048005150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:48:03.476 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:03.474+0000 7f106483f640 1 --2- 172.21.15.150:0/2493280198 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1048004d40 0x7f1048005150 secure :-1 s=READY pgs=989 cs=0 l=1 rev1=1 crypto rx=0x7f105800c260 tx=0x7f1048005830 comp rx=0 tx=0).stop 2024-09-17T05:48:03.476 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:03.474+0000 7f105ed9d640 1 -- 172.21.15.150:0/2493280198 reap_dead start 2024-09-17T05:48:03.476 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:03.474+0000 7f106483f640 1 -- 172.21.15.150:0/2493280198 shutdown_connections 2024-09-17T05:48:03.476 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:03.474+0000 7f106483f640 1 -- 172.21.15.150:0/2493280198 >> 172.21.15.150:0/2493280198 conn(0x7f106008bfe0 msgr2=0x7f10600d4670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:48:03.476 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:03.474+0000 7f106483f640 1 -- 172.21.15.150:0/2493280198 shutdown_connections 2024-09-17T05:48:03.476 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:03.474+0000 7f106483f640 1 -- 172.21.15.150:0/2493280198 wait complete. 2024-09-17T05:48:03.477 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:03.476+0000 7f106483f640 1 Processor -- start 2024-09-17T05:48:03.477 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:03.476+0000 7f106483f640 1 -- start start 2024-09-17T05:48:03.480 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:03.477+0000 7f106483f640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1048004d40 0x7f1060154630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:48:03.480 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:03.477+0000 7f106483f640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f10601fa150 0x7f10601f68d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:48:03.480 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:03.477+0000 7f106483f640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f10600b7d00 0x7f10600b8110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:48:03.480 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:03.477+0000 7f106483f640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f10600b7640 con 0x7f10600b7d00 2024-09-17T05:48:03.480 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:03.477+0000 7f106483f640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f10600b74c0 con 0x7f1048004d40 2024-09-17T05:48:03.480 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:03.477+0000 7f106483f640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f10600b77c0 con 0x7f10601fa150 2024-09-17T05:48:03.481 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:03.477+0000 7f105ed9d640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f10600b7d00 0x7f10600b8110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:48:03.481 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:03.477+0000 7f105ed9d640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f10600b7d00 0x7f10600b8110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:60210/0 (socket says 172.21.15.150:60210) 2024-09-17T05:48:03.481 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:03.477+0000 7f105ed9d640 1 -- 172.21.15.150:0/3766282014 learned_addr learned my addr 172.21.15.150:0/3766282014 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:48:03.481 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:03.477+0000 7f105dd9b640 1 --2- 172.21.15.150:0/3766282014 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f10601fa150 0x7f10601f68d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:48:03.481 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:03.477+0000 7f105e59c640 1 --2- 172.21.15.150:0/3766282014 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1048004d40 0x7f1060154630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:48:03.481 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:03.478+0000 7f105ed9d640 1 -- 172.21.15.150:0/3766282014 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f10601fa150 msgr2=0x7f10601f68d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:48:03.481 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:03.478+0000 7f105ed9d640 1 --2- 172.21.15.150:0/3766282014 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f10601fa150 0x7f10601f68d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:48:03.481 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:03.478+0000 7f105ed9d640 1 -- 172.21.15.150:0/3766282014 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1048004d40 msgr2=0x7f1060154630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:48:03.481 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:03.478+0000 7f105ed9d640 1 --2- 172.21.15.150:0/3766282014 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1048004d40 0x7f1060154630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:48:03.481 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:03.478+0000 7f105ed9d640 1 -- 172.21.15.150:0/3766282014 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f10600b8650 con 0x7f10600b7d00 2024-09-17T05:48:03.481 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:03.478+0000 7f105ed9d640 1 --2- 172.21.15.150:0/3766282014 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f10600b7d00 0x7f10600b8110 secure :-1 s=READY pgs=990 cs=0 l=1 rev1=1 crypto rx=0x7f105802b110 tx=0x7f1058036c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:48:03.481 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:03.478+0000 7f104effd640 1 -- 172.21.15.150:0/3766282014 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1058031070 con 0x7f10600b7d00 2024-09-17T05:48:03.482 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:03.478+0000 7f104effd640 1 -- 172.21.15.150:0/3766282014 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f10580014f0 con 0x7f10600b7d00 2024-09-17T05:48:03.482 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:03.478+0000 7f106483f640 1 -- 172.21.15.150:0/3766282014 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f10601f6e10 con 0x7f10600b7d00 2024-09-17T05:48:03.482 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:03.478+0000 7f104effd640 1 -- 172.21.15.150:0/3766282014 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1058006c50 con 0x7f10600b7d00 2024-09-17T05:48:03.482 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:03.478+0000 7f106483f640 1 -- 172.21.15.150:0/3766282014 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f10601f9670 con 0x7f10600b7d00 2024-09-17T05:48:03.483 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:03.479+0000 7f106483f640 1 -- 172.21.15.150:0/3766282014 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f10601f9490 con 0x7f10600b7d00 2024-09-17T05:48:03.483 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:03.480+0000 7f104effd640 1 -- 172.21.15.150:0/3766282014 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 25) ==== 103022+0+0 (secure 0 0 0) 0x7f1058034070 con 0x7f10600b7d00 2024-09-17T05:48:03.483 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:03.480+0000 7f104effd640 1 --2- 172.21.15.150:0/3766282014 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f1040079d00 0x7f104007c210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:48:03.483 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:03.480+0000 7f104effd640 1 -- 172.21.15.150:0/3766282014 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 4941+0+0 (secure 0 0 0) 0x7f10580b9470 con 0x7f10600b7d00 2024-09-17T05:48:03.483 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:03.481+0000 7f105e59c640 1 --2- 172.21.15.150:0/3766282014 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f1040079d00 0x7f104007c210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:48:03.483 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:03.481+0000 7f105e59c640 1 --2- 172.21.15.150:0/3766282014 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f1040079d00 0x7f104007c210 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f1050005fd0 tx=0x7f1050009500 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:48:03.486 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:03.485+0000 7f104effd640 1 -- 172.21.15.150:0/3766282014 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f10601f9490 con 0x7f10600b7d00 2024-09-17T05:48:03.663 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:03.662+0000 7f106483f640 1 -- 172.21.15.150:0/3766282014 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7f10600d0400 con 0x7f10600b7d00 2024-09-17T05:48:03.664 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:03.662+0000 7f104effd640 1 -- 172.21.15.150:0/3766282014 <== mon.0 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v82) ==== 84+0+65 (secure 0 0 0) 0x7f10600b8650 con 0x7f10600b7d00 2024-09-17T05:48:03.664 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-09-17T05:48:03.664 INFO:teuthology.orchestra.run.smithi150.stdout:[ 2024-09-17T05:48:03.664 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-09-17T05:48:03.664 INFO:teuthology.orchestra.run.smithi150.stdout: "poolnum": 1, 2024-09-17T05:48:03.664 INFO:teuthology.orchestra.run.smithi150.stdout: "poolname": ".mgr" 2024-09-17T05:48:03.664 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-09-17T05:48:03.665 INFO:teuthology.orchestra.run.smithi150.stdout:] 2024-09-17T05:48:03.666 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:03.664+0000 7f106483f640 1 -- 172.21.15.150:0/3766282014 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f1040079d00 msgr2=0x7f104007c210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:48:03.666 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:03.664+0000 7f106483f640 1 --2- 172.21.15.150:0/3766282014 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f1040079d00 0x7f104007c210 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f1050005fd0 tx=0x7f1050009500 comp rx=0 tx=0).stop 2024-09-17T05:48:03.666 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:03.664+0000 7f106483f640 1 -- 172.21.15.150:0/3766282014 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f10600b7d00 msgr2=0x7f10600b8110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:48:03.666 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:03.664+0000 7f106483f640 1 --2- 172.21.15.150:0/3766282014 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f10600b7d00 0x7f10600b8110 secure :-1 s=READY pgs=990 cs=0 l=1 rev1=1 crypto rx=0x7f105802b110 tx=0x7f1058036c20 comp rx=0 tx=0).stop 2024-09-17T05:48:03.666 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:03.664+0000 7f106483f640 1 -- 172.21.15.150:0/3766282014 shutdown_connections 2024-09-17T05:48:03.667 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:03.664+0000 7f106483f640 1 --2- 172.21.15.150:0/3766282014 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f1040079d00 0x7f104007c210 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:48:03.667 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:03.664+0000 7f106483f640 1 --2- 172.21.15.150:0/3766282014 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f10600b7d00 0x7f10600b8110 unknown :-1 s=CLOSED pgs=990 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:48:03.667 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:03.664+0000 7f106483f640 1 --2- 172.21.15.150:0/3766282014 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f10601fa150 0x7f10601f68d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:48:03.667 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:03.664+0000 7f106483f640 1 --2- 172.21.15.150:0/3766282014 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1048004d40 0x7f1060154630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:48:03.667 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:03.664+0000 7f106483f640 1 -- 172.21.15.150:0/3766282014 >> 172.21.15.150:0/3766282014 conn(0x7f106008bfe0 msgr2=0x7f106006f5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:48:03.667 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:03.664+0000 7f106483f640 1 -- 172.21.15.150:0/3766282014 shutdown_connections 2024-09-17T05:48:03.667 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:03.664+0000 7f106483f640 1 -- 172.21.15.150:0/3766282014 wait complete. 2024-09-17T05:48:03.678 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-09-17T05:48:03.678 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-09-17T05:48:03.797 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:03.795+0000 7f155cadc640 1 -- 172.21.15.150:0/1122367337 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1558070280 msgr2=0x7f1558070690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:48:03.797 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:03.795+0000 7f155cadc640 1 --2- 172.21.15.150:0/1122367337 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1558070280 0x7f1558070690 secure :-1 s=READY pgs=992 cs=0 l=1 rev1=1 crypto rx=0x7f1550005fd0 tx=0x7f155002a8b0 comp rx=0 tx=0).stop 2024-09-17T05:48:03.797 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:03.795+0000 7f155cadc640 1 -- 172.21.15.150:0/1122367337 shutdown_connections 2024-09-17T05:48:03.797 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:03.795+0000 7f155cadc640 1 --2- 172.21.15.150:0/1122367337 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1558070280 0x7f1558070690 unknown :-1 s=CLOSED pgs=992 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:48:03.798 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:03.795+0000 7f155cadc640 1 -- 172.21.15.150:0/1122367337 >> 172.21.15.150:0/1122367337 conn(0x7f15580b2540 msgr2=0x7f15580d02d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:48:03.798 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:03.795+0000 7f155cadc640 1 -- 172.21.15.150:0/1122367337 shutdown_connections 2024-09-17T05:48:03.798 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:03.795+0000 7f155cadc640 1 -- 172.21.15.150:0/1122367337 wait complete. 2024-09-17T05:48:03.799 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:03.797+0000 7f155cadc640 1 Processor -- start 2024-09-17T05:48:03.799 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:03.797+0000 7f155cadc640 1 -- start start 2024-09-17T05:48:03.802 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:03.799+0000 7f155cadc640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f155806fd40 0x7f15580992a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:48:03.802 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:03.799+0000 7f155cadc640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1558070280 0x7f15581560f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:48:03.802 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:03.799+0000 7f155cadc640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f15580cf7d0 0x7f1558156630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:48:03.802 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:03.799+0000 7f155cadc640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f155806d3b0 con 0x7f155806fd40 2024-09-17T05:48:03.802 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:03.799+0000 7f155cadc640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f155806d230 con 0x7f1558070280 2024-09-17T05:48:03.802 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:03.799+0000 7f155cadc640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f155806d530 con 0x7f15580cf7d0 2024-09-17T05:48:03.802 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:03.799+0000 7f155659c640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f155806fd40 0x7f15580992a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:48:03.802 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:03.799+0000 7f155659c640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f155806fd40 0x7f15580992a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:60238/0 (socket says 172.21.15.150:60238) 2024-09-17T05:48:03.802 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:03.799+0000 7f155659c640 1 -- 172.21.15.150:0/3830801161 learned_addr learned my addr 172.21.15.150:0/3830801161 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:48:03.802 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:03.799+0000 7f1555d9b640 1 --2- 172.21.15.150:0/3830801161 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1558070280 0x7f15581560f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:48:03.803 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:03.799+0000 7f1556d9d640 1 --2- 172.21.15.150:0/3830801161 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f15580cf7d0 0x7f1558156630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:48:03.803 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:03.799+0000 7f155659c640 1 -- 172.21.15.150:0/3830801161 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f15580cf7d0 msgr2=0x7f1558156630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:48:03.803 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:03.799+0000 7f155659c640 1 --2- 172.21.15.150:0/3830801161 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f15580cf7d0 0x7f1558156630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:48:03.803 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:03.799+0000 7f155659c640 1 -- 172.21.15.150:0/3830801161 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1558070280 msgr2=0x7f15581560f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:48:03.803 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:03.799+0000 7f155659c640 1 --2- 172.21.15.150:0/3830801161 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1558070280 0x7f15581560f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:48:03.803 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:03.799+0000 7f155659c640 1 -- 172.21.15.150:0/3830801161 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1558156b70 con 0x7f155806fd40 2024-09-17T05:48:03.803 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:03.799+0000 7f1555d9b640 1 --2- 172.21.15.150:0/3830801161 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1558070280 0x7f15581560f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:48:03.803 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:03.799+0000 7f155659c640 1 --2- 172.21.15.150:0/3830801161 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f155806fd40 0x7f15580992a0 secure :-1 s=READY pgs=993 cs=0 l=1 rev1=1 crypto rx=0x7f154800c3a0 tx=0x7f154800c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:48:03.803 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:03.799+0000 7f1546ffd640 1 -- 172.21.15.150:0/3830801161 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1548017070 con 0x7f155806fd40 2024-09-17T05:48:03.803 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:03.799+0000 7f1546ffd640 1 -- 172.21.15.150:0/3830801161 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f15480035f0 con 0x7f155806fd40 2024-09-17T05:48:03.803 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:03.799+0000 7f155cadc640 1 -- 172.21.15.150:0/3830801161 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f155815bf50 con 0x7f155806fd40 2024-09-17T05:48:03.803 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:03.799+0000 7f1546ffd640 1 -- 172.21.15.150:0/3830801161 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1548003a40 con 0x7f155806fd40 2024-09-17T05:48:03.804 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:03.800+0000 7f155cadc640 1 -- 172.21.15.150:0/3830801161 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f155815c510 con 0x7f155806fd40 2024-09-17T05:48:03.804 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:03.800+0000 7f155cadc640 1 -- 172.21.15.150:0/3830801161 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f15580b1c20 con 0x7f155806fd40 2024-09-17T05:48:03.804 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:03.801+0000 7f1546ffd640 1 -- 172.21.15.150:0/3830801161 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 25) ==== 103022+0+0 (secure 0 0 0) 0x7f154801a070 con 0x7f155806fd40 2024-09-17T05:48:03.804 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:03.802+0000 7f1546ffd640 1 --2- 172.21.15.150:0/3830801161 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f1538079d30 0x7f153807c240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:48:03.805 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:03.802+0000 7f1546ffd640 1 -- 172.21.15.150:0/3830801161 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 4941+0+0 (secure 0 0 0) 0x7f1548099160 con 0x7f155806fd40 2024-09-17T05:48:03.805 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:03.802+0000 7f1555d9b640 1 --2- 172.21.15.150:0/3830801161 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f1538079d30 0x7f153807c240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:48:03.805 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:03.803+0000 7f1555d9b640 1 --2- 172.21.15.150:0/3830801161 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f1538079d30 0x7f153807c240 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f154c007fd0 tx=0x7f154c009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:48:03.807 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:03.805+0000 7f1546ffd640 1 -- 172.21.15.150:0/3830801161 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f15580b1c20 con 0x7f155806fd40 2024-09-17T05:48:03.984 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:03.983+0000 7f155cadc640 1 -- 172.21.15.150:0/3830801161 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7f1558070690 con 0x7f155806fd40 2024-09-17T05:48:04.974 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:04.972+0000 7f1546ffd640 1 -- 172.21.15.150:0/3830801161 <== mon.0 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v83) ==== 138+0+0 (secure 0 0 0) 0x7f1548021020 con 0x7f155806fd40 2024-09-17T05:48:04.974 INFO:teuthology.orchestra.run.smithi150.stderr:pool 'cephfs_metadata' created 2024-09-17T05:48:04.977 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:04.975+0000 7f155cadc640 1 -- 172.21.15.150:0/3830801161 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f1538079d30 msgr2=0x7f153807c240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:48:04.977 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:04.975+0000 7f155cadc640 1 --2- 172.21.15.150:0/3830801161 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f1538079d30 0x7f153807c240 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f154c007fd0 tx=0x7f154c009040 comp rx=0 tx=0).stop 2024-09-17T05:48:04.977 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:04.975+0000 7f155cadc640 1 -- 172.21.15.150:0/3830801161 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f155806fd40 msgr2=0x7f15580992a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:48:04.978 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:04.975+0000 7f155cadc640 1 --2- 172.21.15.150:0/3830801161 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f155806fd40 0x7f15580992a0 secure :-1 s=READY pgs=993 cs=0 l=1 rev1=1 crypto rx=0x7f154800c3a0 tx=0x7f154800c860 comp rx=0 tx=0).stop 2024-09-17T05:48:04.978 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:04.975+0000 7f155cadc640 1 -- 172.21.15.150:0/3830801161 shutdown_connections 2024-09-17T05:48:04.978 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:04.975+0000 7f155cadc640 1 --2- 172.21.15.150:0/3830801161 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1558070280 0x7f15581560f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:48:04.978 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:04.975+0000 7f155cadc640 1 --2- 172.21.15.150:0/3830801161 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f1538079d30 0x7f153807c240 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:48:04.978 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:04.975+0000 7f155cadc640 1 --2- 172.21.15.150:0/3830801161 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f15580cf7d0 0x7f1558156630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:48:04.978 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:04.975+0000 7f155cadc640 1 --2- 172.21.15.150:0/3830801161 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f155806fd40 0x7f15580992a0 unknown :-1 s=CLOSED pgs=993 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:48:04.978 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:04.976+0000 7f155cadc640 1 -- 172.21.15.150:0/3830801161 >> 172.21.15.150:0/3830801161 conn(0x7f15580b2540 msgr2=0x7f15580d02d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:48:04.978 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:04.976+0000 7f155cadc640 1 -- 172.21.15.150:0/3830801161 shutdown_connections 2024-09-17T05:48:04.978 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:04.976+0000 7f155cadc640 1 -- 172.21.15.150:0/3830801161 wait complete. 2024-09-17T05:48:04.995 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-09-17T05:48:05.123 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:05.120+0000 7fdd6c557640 1 -- 172.21.15.150:0/476775674 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fdd640d0730 msgr2=0x7fdd640b6160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:48:05.123 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:05.120+0000 7fdd6c557640 1 --2- 172.21.15.150:0/476775674 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fdd640d0730 0x7fdd640b6160 secure :-1 s=READY pgs=995 cs=0 l=1 rev1=1 crypto rx=0x7fdd5c009ca0 tx=0x7fdd5c02aac0 comp rx=0 tx=0).stop 2024-09-17T05:48:05.123 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:05.121+0000 7fdd6c557640 1 -- 172.21.15.150:0/476775674 shutdown_connections 2024-09-17T05:48:05.123 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:05.121+0000 7fdd6c557640 1 --2- 172.21.15.150:0/476775674 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fdd640d0730 0x7fdd640b6160 unknown :-1 s=CLOSED pgs=995 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:48:05.123 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:05.121+0000 7fdd6c557640 1 --2- 172.21.15.150:0/476775674 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fdd640d5150 0x7fdd640b9b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:48:05.123 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:05.121+0000 7fdd6c557640 1 -- 172.21.15.150:0/476775674 >> 172.21.15.150:0/476775674 conn(0x7fdd6408bfe0 msgr2=0x7fdd640d46e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:48:05.123 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:05.121+0000 7fdd6c557640 1 -- 172.21.15.150:0/476775674 shutdown_connections 2024-09-17T05:48:05.123 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:05.121+0000 7fdd6c557640 1 -- 172.21.15.150:0/476775674 wait complete. 2024-09-17T05:48:05.124 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:05.122+0000 7fdd6c557640 1 Processor -- start 2024-09-17T05:48:05.124 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:05.122+0000 7fdd6c557640 1 -- start start 2024-09-17T05:48:05.127 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:05.124+0000 7fdd6c557640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fdd6406dea0 0x7fdd6415cc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:48:05.127 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:05.124+0000 7fdd6c557640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fdd640d0730 0x7fdd640c95c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:48:05.127 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:05.124+0000 7fdd6c557640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fdd640d5150 0x7fdd640c9b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:48:05.127 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:05.124+0000 7fdd6c557640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7fdd6406e2b0 con 0x7fdd6406dea0 2024-09-17T05:48:05.127 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:05.124+0000 7fdd6c557640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fdd640d31e0 con 0x7fdd640d0730 2024-09-17T05:48:05.128 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:05.124+0000 7fdd6c557640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fdd6406e430 con 0x7fdd640d5150 2024-09-17T05:48:05.128 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:05.124+0000 7fdd6a2f3640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fdd6406dea0 0x7fdd6415cc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:48:05.128 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:05.124+0000 7fdd6a2f3640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fdd6406dea0 0x7fdd6415cc70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:60264/0 (socket says 172.21.15.150:60264) 2024-09-17T05:48:05.128 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:05.124+0000 7fdd6a2f3640 1 -- 172.21.15.150:0/4176114681 learned_addr learned my addr 172.21.15.150:0/4176114681 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:48:05.128 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:05.124+0000 7fdd6aaf4640 1 --2- 172.21.15.150:0/4176114681 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fdd640d5150 0x7fdd640c9b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:48:05.128 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:05.124+0000 7fdd69af2640 1 --2- 172.21.15.150:0/4176114681 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fdd640d0730 0x7fdd640c95c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:48:05.128 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:05.124+0000 7fdd6a2f3640 1 -- 172.21.15.150:0/4176114681 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fdd640d5150 msgr2=0x7fdd640c9b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:48:05.128 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:05.124+0000 7fdd6a2f3640 1 --2- 172.21.15.150:0/4176114681 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fdd640d5150 0x7fdd640c9b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:48:05.128 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:05.124+0000 7fdd6a2f3640 1 -- 172.21.15.150:0/4176114681 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fdd640d0730 msgr2=0x7fdd640c95c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:48:05.128 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:05.124+0000 7fdd6a2f3640 1 --2- 172.21.15.150:0/4176114681 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fdd640d0730 0x7fdd640c95c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:48:05.129 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:05.124+0000 7fdd6a2f3640 1 -- 172.21.15.150:0/4176114681 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdd640a17e0 con 0x7fdd6406dea0 2024-09-17T05:48:05.129 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:05.124+0000 7fdd69af2640 1 --2- 172.21.15.150:0/4176114681 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fdd640d0730 0x7fdd640c95c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:48:05.129 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:05.124+0000 7fdd6a2f3640 1 --2- 172.21.15.150:0/4176114681 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fdd6406dea0 0x7fdd6415cc70 secure :-1 s=READY pgs=996 cs=0 l=1 rev1=1 crypto rx=0x7fdd5800d720 tx=0x7fdd5800dbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:48:05.129 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:05.124+0000 7fdd56ffd640 1 -- 172.21.15.150:0/4176114681 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd58004220 con 0x7fdd6406dea0 2024-09-17T05:48:05.129 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:05.125+0000 7fdd56ffd640 1 -- 172.21.15.150:0/4176114681 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fdd5800de30 con 0x7fdd6406dea0 2024-09-17T05:48:05.129 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:05.125+0000 7fdd6c557640 1 -- 172.21.15.150:0/4176114681 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdd640a1ac0 con 0x7fdd6406dea0 2024-09-17T05:48:05.129 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:05.125+0000 7fdd56ffd640 1 -- 172.21.15.150:0/4176114681 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd58009c10 con 0x7fdd6406dea0 2024-09-17T05:48:05.129 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:05.125+0000 7fdd6c557640 1 -- 172.21.15.150:0/4176114681 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdd641f6c80 con 0x7fdd6406dea0 2024-09-17T05:48:05.129 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:05.126+0000 7fdd6c557640 1 -- 172.21.15.150:0/4176114681 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdd640b6830 con 0x7fdd6406dea0 2024-09-17T05:48:05.130 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:05.127+0000 7fdd56ffd640 1 -- 172.21.15.150:0/4176114681 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 25) ==== 103022+0+0 (secure 0 0 0) 0x7fdd58005030 con 0x7fdd6406dea0 2024-09-17T05:48:05.130 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:05.127+0000 7fdd56ffd640 1 --2- 172.21.15.150:0/4176114681 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fdd48079d00 0x7fdd4807c210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:48:05.130 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:05.128+0000 7fdd56ffd640 1 -- 172.21.15.150:0/4176114681 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 5311+0+0 (secure 0 0 0) 0x7fdd5809a090 con 0x7fdd6406dea0 2024-09-17T05:48:05.130 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:05.128+0000 7fdd69af2640 1 --2- 172.21.15.150:0/4176114681 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fdd48079d00 0x7fdd4807c210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:48:05.130 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:05.128+0000 7fdd69af2640 1 --2- 172.21.15.150:0/4176114681 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fdd48079d00 0x7fdd4807c210 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7fdd640cad30 tx=0x7fdd60009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:48:05.134 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:05.132+0000 7fdd56ffd640 1 -- 172.21.15.150:0/4176114681 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fdd58020020 con 0x7fdd6406dea0 2024-09-17T05:48:05.310 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:05.308+0000 7fdd6c557640 1 -- 172.21.15.150:0/4176114681 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7fdd640d4f30 con 0x7fdd6406dea0 2024-09-17T05:48:05.976 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:05.974+0000 7fdd56ffd640 1 -- 172.21.15.150:0/4176114681 <== mon.0 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v84) ==== 170+0+0 (secure 0 0 0) 0x7fdd58017030 con 0x7fdd6406dea0 2024-09-17T05:48:05.976 INFO:teuthology.orchestra.run.smithi150.stderr:pool 'cephfs_data' created 2024-09-17T05:48:05.979 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:05.977+0000 7fdd6c557640 1 -- 172.21.15.150:0/4176114681 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fdd48079d00 msgr2=0x7fdd4807c210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:48:05.979 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:05.977+0000 7fdd6c557640 1 --2- 172.21.15.150:0/4176114681 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fdd48079d00 0x7fdd4807c210 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7fdd640cad30 tx=0x7fdd60009040 comp rx=0 tx=0).stop 2024-09-17T05:48:05.979 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:05.977+0000 7fdd6c557640 1 -- 172.21.15.150:0/4176114681 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fdd6406dea0 msgr2=0x7fdd6415cc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:48:05.980 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:05.977+0000 7fdd6c557640 1 --2- 172.21.15.150:0/4176114681 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fdd6406dea0 0x7fdd6415cc70 secure :-1 s=READY pgs=996 cs=0 l=1 rev1=1 crypto rx=0x7fdd5800d720 tx=0x7fdd5800dbe0 comp rx=0 tx=0).stop 2024-09-17T05:48:05.980 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:05.977+0000 7fdd6c557640 1 -- 172.21.15.150:0/4176114681 shutdown_connections 2024-09-17T05:48:05.980 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:05.977+0000 7fdd6c557640 1 --2- 172.21.15.150:0/4176114681 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fdd640d0730 0x7fdd640c95c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:48:05.980 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:05.977+0000 7fdd6c557640 1 --2- 172.21.15.150:0/4176114681 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fdd48079d00 0x7fdd4807c210 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:48:05.980 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:05.977+0000 7fdd6c557640 1 --2- 172.21.15.150:0/4176114681 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fdd640d5150 0x7fdd640c9b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:48:05.980 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:05.977+0000 7fdd6c557640 1 --2- 172.21.15.150:0/4176114681 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fdd6406dea0 0x7fdd6415cc70 unknown :-1 s=CLOSED pgs=996 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:48:05.980 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:05.977+0000 7fdd6c557640 1 -- 172.21.15.150:0/4176114681 >> 172.21.15.150:0/4176114681 conn(0x7fdd6408bfe0 msgr2=0x7fdd640b8370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:48:05.980 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:05.978+0000 7fdd6c557640 1 -- 172.21.15.150:0/4176114681 shutdown_connections 2024-09-17T05:48:05.980 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:05.978+0000 7fdd6c557640 1 -- 172.21.15.150:0/4176114681 wait complete. 2024-09-17T05:48:06.007 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-09-17T05:48:06.127 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:06.125+0000 7fabd7ab2640 1 -- 172.21.15.150:0/3597170563 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fabb8005270 msgr2=0x7fabb800b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:48:06.127 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:06.125+0000 7fabd7ab2640 1 --2- 172.21.15.150:0/3597170563 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fabb8005270 0x7fabb800b9c0 secure :-1 s=READY pgs=998 cs=0 l=1 rev1=1 crypto rx=0x7fabc80016c0 tx=0x7fabb8005830 comp rx=0 tx=0).stop 2024-09-17T05:48:06.127 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:06.125+0000 7fabd7ab2640 1 -- 172.21.15.150:0/3597170563 shutdown_connections 2024-09-17T05:48:06.127 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:06.125+0000 7fabd7ab2640 1 --2- 172.21.15.150:0/3597170563 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fabb8005270 0x7fabb800b9c0 unknown :-1 s=CLOSED pgs=998 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:48:06.127 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:06.125+0000 7fabd7ab2640 1 -- 172.21.15.150:0/3597170563 >> 172.21.15.150:0/3597170563 conn(0x7fabd008bfe0 msgr2=0x7fabd00d46e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:48:06.127 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:06.125+0000 7fabd7ab2640 1 -- 172.21.15.150:0/3597170563 shutdown_connections 2024-09-17T05:48:06.127 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:06.125+0000 7fabd7ab2640 1 -- 172.21.15.150:0/3597170563 wait complete. 2024-09-17T05:48:06.128 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:06.126+0000 7fabd7ab2640 1 Processor -- start 2024-09-17T05:48:06.128 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:06.127+0000 7fabd7ab2640 1 -- start start 2024-09-17T05:48:06.131 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:06.128+0000 7fabd7ab2640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fabb8005270 0x7fabd00cd090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:48:06.131 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:06.128+0000 7fabd7ab2640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fabd01f8ef0 0x7fabd01589b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:48:06.131 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:06.128+0000 7fabd7ab2640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fabd00b5d40 0x7fabd01f60e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:48:06.131 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:06.128+0000 7fabd7ab2640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7fabd006e430 con 0x7fabd01f8ef0 2024-09-17T05:48:06.131 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:06.128+0000 7fabd7ab2640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fabd006e2b0 con 0x7fabd00b5d40 2024-09-17T05:48:06.131 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:06.128+0000 7fabd7ab2640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fabd006e5b0 con 0x7fabb8005270 2024-09-17T05:48:06.131 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:06.128+0000 7fabd504d640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fabd01f8ef0 0x7fabd01589b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:48:06.131 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:06.128+0000 7fabd504d640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fabd01f8ef0 0x7fabd01589b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:60286/0 (socket says 172.21.15.150:60286) 2024-09-17T05:48:06.131 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:06.128+0000 7fabd504d640 1 -- 172.21.15.150:0/4202339487 learned_addr learned my addr 172.21.15.150:0/4202339487 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:48:06.132 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:06.128+0000 7fabd584e640 1 --2- 172.21.15.150:0/4202339487 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fabb8005270 0x7fabd00cd090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:48:06.132 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:06.128+0000 7fabd604f640 1 --2- 172.21.15.150:0/4202339487 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fabd00b5d40 0x7fabd01f60e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:48:06.132 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:06.128+0000 7fabd504d640 1 -- 172.21.15.150:0/4202339487 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fabb8005270 msgr2=0x7fabd00cd090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:48:06.132 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:06.128+0000 7fabd504d640 1 --2- 172.21.15.150:0/4202339487 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fabb8005270 0x7fabd00cd090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:48:06.132 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:06.128+0000 7fabd504d640 1 -- 172.21.15.150:0/4202339487 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fabd00b5d40 msgr2=0x7fabd01f60e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:48:06.132 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:06.128+0000 7fabd504d640 1 --2- 172.21.15.150:0/4202339487 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fabd00b5d40 0x7fabd01f60e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:48:06.132 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:06.128+0000 7fabd504d640 1 -- 172.21.15.150:0/4202339487 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fabd00cd5d0 con 0x7fabd01f8ef0 2024-09-17T05:48:06.132 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:06.128+0000 7fabd604f640 1 --2- 172.21.15.150:0/4202339487 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fabd00b5d40 0x7fabd01f60e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T05:48:06.132 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:06.128+0000 7fabd504d640 1 --2- 172.21.15.150:0/4202339487 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fabd01f8ef0 0x7fabd01589b0 secure :-1 s=READY pgs=999 cs=0 l=1 rev1=1 crypto rx=0x7fabc4001860 tx=0x7fabc400ea20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:48:06.132 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:06.129+0000 7fabce7fc640 1 -- 172.21.15.150:0/4202339487 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fabc4015070 con 0x7fabd01f8ef0 2024-09-17T05:48:06.132 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:06.129+0000 7fabce7fc640 1 -- 172.21.15.150:0/4202339487 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fabc400c9e0 con 0x7fabd01f8ef0 2024-09-17T05:48:06.132 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:06.129+0000 7fabd7ab2640 1 -- 172.21.15.150:0/4202339487 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fabd0158ef0 con 0x7fabd01f8ef0 2024-09-17T05:48:06.132 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:06.129+0000 7fabce7fc640 1 -- 172.21.15.150:0/4202339487 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fabc400cdb0 con 0x7fabd01f8ef0 2024-09-17T05:48:06.133 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:06.129+0000 7fabd7ab2640 1 -- 172.21.15.150:0/4202339487 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fabd01f9660 con 0x7fabd01f8ef0 2024-09-17T05:48:06.133 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:06.130+0000 7fabd7ab2640 1 -- 172.21.15.150:0/4202339487 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fabd00d02e0 con 0x7fabd01f8ef0 2024-09-17T05:48:06.133 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:06.131+0000 7fabce7fc640 1 -- 172.21.15.150:0/4202339487 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 25) ==== 103022+0+0 (secure 0 0 0) 0x7fabc4018070 con 0x7fabd01f8ef0 2024-09-17T05:48:06.134 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:06.131+0000 7fabce7fc640 1 --2- 172.21.15.150:0/4202339487 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fabbc079d00 0x7fabbc07c210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:48:06.134 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:06.131+0000 7fabce7fc640 1 -- 172.21.15.150:0/4202339487 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 5693+0+0 (secure 0 0 0) 0x7fabc4099f90 con 0x7fabd01f8ef0 2024-09-17T05:48:06.134 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:06.131+0000 7fabd584e640 1 --2- 172.21.15.150:0/4202339487 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fabbc079d00 0x7fabbc07c210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:48:06.134 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:06.132+0000 7fabd584e640 1 --2- 172.21.15.150:0/4202339487 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fabbc079d00 0x7fabbc07c210 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7fabc0005fd0 tx=0x7fabc00094a0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:48:06.137 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:06.136+0000 7fabce7fc640 1 -- 172.21.15.150:0/4202339487 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fabd00cd5d0 con 0x7fabd01f8ef0 2024-09-17T05:48:06.348 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:06.346+0000 7fabd7ab2640 1 -- 172.21.15.150:0/4202339487 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7fabd00d4f30 con 0x7fabd01f8ef0 2024-09-17T05:48:07.007 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:07.005+0000 7fabce7fc640 1 -- 172.21.15.150:0/4202339487 <== mon.0 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 12 and data pool 13 v48) ==== 174+0+0 (secure 0 0 0) 0x7fabc4063bc0 con 0x7fabd01f8ef0 2024-09-17T05:48:07.007 INFO:teuthology.orchestra.run.smithi150.stderr:new fs with metadata pool 12 and data pool 13 2024-09-17T05:48:07.013 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:07.011+0000 7fabd7ab2640 1 -- 172.21.15.150:0/4202339487 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fabbc079d00 msgr2=0x7fabbc07c210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:48:07.014 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:07.011+0000 7fabd7ab2640 1 --2- 172.21.15.150:0/4202339487 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fabbc079d00 0x7fabbc07c210 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7fabc0005fd0 tx=0x7fabc00094a0 comp rx=0 tx=0).stop 2024-09-17T05:48:07.014 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:07.011+0000 7fabd7ab2640 1 -- 172.21.15.150:0/4202339487 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fabd01f8ef0 msgr2=0x7fabd01589b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:48:07.014 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:07.011+0000 7fabd7ab2640 1 --2- 172.21.15.150:0/4202339487 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fabd01f8ef0 0x7fabd01589b0 secure :-1 s=READY pgs=999 cs=0 l=1 rev1=1 crypto rx=0x7fabc4001860 tx=0x7fabc400ea20 comp rx=0 tx=0).stop 2024-09-17T05:48:07.014 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:07.012+0000 7fabd7ab2640 1 -- 172.21.15.150:0/4202339487 shutdown_connections 2024-09-17T05:48:07.014 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:07.012+0000 7fabd7ab2640 1 --2- 172.21.15.150:0/4202339487 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fabd00b5d40 0x7fabd01f60e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:48:07.014 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:07.012+0000 7fabd7ab2640 1 --2- 172.21.15.150:0/4202339487 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fabbc079d00 0x7fabbc07c210 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:48:07.014 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:07.012+0000 7fabd7ab2640 1 --2- 172.21.15.150:0/4202339487 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fabd01f8ef0 0x7fabd01589b0 unknown :-1 s=CLOSED pgs=999 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:48:07.014 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:07.012+0000 7fabd7ab2640 1 --2- 172.21.15.150:0/4202339487 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fabb8005270 0x7fabd00cd090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:48:07.014 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:07.012+0000 7fabd7ab2640 1 -- 172.21.15.150:0/4202339487 >> 172.21.15.150:0/4202339487 conn(0x7fabd008bfe0 msgr2=0x7fabd00d2130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:48:07.014 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:07.012+0000 7fabd7ab2640 1 -- 172.21.15.150:0/4202339487 shutdown_connections 2024-09-17T05:48:07.014 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:07.012+0000 7fabd7ab2640 1 -- 172.21.15.150:0/4202339487 wait complete. 2024-09-17T05:48:07.031 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T05:48:07.146 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:07.144+0000 7fd5e4f12640 1 -- 172.21.15.150:0/1021698292 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd5e009ba60 msgr2=0x7fd5e00b7330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:48:07.146 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:07.144+0000 7fd5e4f12640 1 --2- 172.21.15.150:0/1021698292 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd5e009ba60 0x7fd5e00b7330 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7fd5d0009bb0 tx=0x7fd5d002a8b0 comp rx=0 tx=0).stop 2024-09-17T05:48:07.147 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:07.144+0000 7fd5e4f12640 1 -- 172.21.15.150:0/1021698292 shutdown_connections 2024-09-17T05:48:07.147 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:07.144+0000 7fd5e4f12640 1 --2- 172.21.15.150:0/1021698292 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd5e00cd850 0x7fd5e00d06f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:48:07.147 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:07.144+0000 7fd5e4f12640 1 --2- 172.21.15.150:0/1021698292 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd5e009ba60 0x7fd5e00b7330 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:48:07.147 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:07.144+0000 7fd5e4f12640 1 -- 172.21.15.150:0/1021698292 >> 172.21.15.150:0/1021698292 conn(0x7fd5e00cee90 msgr2=0x7fd5e00cf2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:48:07.147 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:07.144+0000 7fd5e4f12640 1 -- 172.21.15.150:0/1021698292 shutdown_connections 2024-09-17T05:48:07.147 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:07.144+0000 7fd5e4f12640 1 -- 172.21.15.150:0/1021698292 wait complete. 2024-09-17T05:48:07.148 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:07.146+0000 7fd5e4f12640 1 Processor -- start 2024-09-17T05:48:07.148 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:07.146+0000 7fd5e4f12640 1 -- start start 2024-09-17T05:48:07.151 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:07.147+0000 7fd5e4f12640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd5e009ba60 0x7fd5e0154710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:48:07.151 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:07.147+0000 7fd5e4f12640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd5e00cd440 0x7fd5e015a0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:48:07.151 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:07.147+0000 7fd5e4f12640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd5e00cd850 0x7fd5e0155900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:48:07.151 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:07.147+0000 7fd5e4f12640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7fd5e00d0db0 con 0x7fd5e009ba60 2024-09-17T05:48:07.151 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:07.147+0000 7fd5e4f12640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fd5e00d0c30 con 0x7fd5e00cd850 2024-09-17T05:48:07.151 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:07.147+0000 7fd5e4f12640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fd5e00d0f30 con 0x7fd5e00cd440 2024-09-17T05:48:07.151 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:07.148+0000 7fd5de59c640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd5e009ba60 0x7fd5e0154710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:48:07.151 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:07.148+0000 7fd5de59c640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd5e009ba60 0x7fd5e0154710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:60300/0 (socket says 172.21.15.150:60300) 2024-09-17T05:48:07.151 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:07.148+0000 7fd5de59c640 1 -- 172.21.15.150:0/3439333572 learned_addr learned my addr 172.21.15.150:0/3439333572 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:48:07.151 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:07.148+0000 7fd5ded9d640 1 --2- 172.21.15.150:0/3439333572 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd5e00cd850 0x7fd5e0155900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:48:07.152 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:07.148+0000 7fd5ddd9b640 1 --2- 172.21.15.150:0/3439333572 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd5e00cd440 0x7fd5e015a0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:48:07.152 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:07.148+0000 7fd5de59c640 1 -- 172.21.15.150:0/3439333572 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd5e00cd440 msgr2=0x7fd5e015a0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:48:07.152 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:07.148+0000 7fd5de59c640 1 --2- 172.21.15.150:0/3439333572 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd5e00cd440 0x7fd5e015a0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:48:07.152 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:07.148+0000 7fd5de59c640 1 -- 172.21.15.150:0/3439333572 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd5e00cd850 msgr2=0x7fd5e0155900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:48:07.152 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:07.148+0000 7fd5de59c640 1 --2- 172.21.15.150:0/3439333572 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd5e00cd850 0x7fd5e0155900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:48:07.152 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:07.148+0000 7fd5de59c640 1 -- 172.21.15.150:0/3439333572 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd5e015a5f0 con 0x7fd5e009ba60 2024-09-17T05:48:07.152 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:07.148+0000 7fd5ded9d640 1 --2- 172.21.15.150:0/3439333572 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd5e00cd850 0x7fd5e0155900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T05:48:07.152 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:07.148+0000 7fd5de59c640 1 --2- 172.21.15.150:0/3439333572 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd5e009ba60 0x7fd5e0154710 secure :-1 s=READY pgs=1000 cs=0 l=1 rev1=1 crypto rx=0x7fd5d002aea0 tx=0x7fd5d0004360 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:48:07.152 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:07.148+0000 7fd5ceffd640 1 -- 172.21.15.150:0/3439333572 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5d003f070 con 0x7fd5e009ba60 2024-09-17T05:48:07.152 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:07.148+0000 7fd5e4f12640 1 -- 172.21.15.150:0/3439333572 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd5e015b020 con 0x7fd5e009ba60 2024-09-17T05:48:07.152 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:07.148+0000 7fd5ceffd640 1 -- 172.21.15.150:0/3439333572 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd5d0031440 con 0x7fd5e009ba60 2024-09-17T05:48:07.152 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:07.148+0000 7fd5ceffd640 1 -- 172.21.15.150:0/3439333572 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5d0031890 con 0x7fd5e009ba60 2024-09-17T05:48:07.152 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:07.149+0000 7fd5e4f12640 1 -- 172.21.15.150:0/3439333572 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd5e0154e20 con 0x7fd5e009ba60 2024-09-17T05:48:07.153 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:07.150+0000 7fd5e4f12640 1 -- 172.21.15.150:0/3439333572 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd5e00b7330 con 0x7fd5e009ba60 2024-09-17T05:48:07.153 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:07.150+0000 7fd5ceffd640 1 -- 172.21.15.150:0/3439333572 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 25) ==== 103022+0+0 (secure 0 0 0) 0x7fd5d0042070 con 0x7fd5e009ba60 2024-09-17T05:48:07.154 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:07.151+0000 7fd5ceffd640 1 --2- 172.21.15.150:0/3439333572 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fd5c0079d00 0x7fd5c007c210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:48:07.154 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:07.151+0000 7fd5ceffd640 1 -- 172.21.15.150:0/3439333572 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 5793+0+0 (secure 0 0 0) 0x7fd5d00ba990 con 0x7fd5e009ba60 2024-09-17T05:48:07.154 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:07.151+0000 7fd5ddd9b640 1 --2- 172.21.15.150:0/3439333572 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fd5c0079d00 0x7fd5c007c210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:48:07.154 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:07.151+0000 7fd5ddd9b640 1 --2- 172.21.15.150:0/3439333572 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fd5c0079d00 0x7fd5c007c210 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7fd5e015cb20 tx=0x7fd5d4009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:48:07.157 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:07.155+0000 7fd5ceffd640 1 -- 172.21.15.150:0/3439333572 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fd5d00841b0 con 0x7fd5e009ba60 2024-09-17T05:48:07.330 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:07.328+0000 7fd5e4f12640 1 -- 172.21.15.150:0/3439333572 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fd5e0164340 con 0x7fd5e009ba60 2024-09-17T05:48:07.331 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:07.329+0000 7fd5ceffd640 1 -- 172.21.15.150:0/3439333572 <== mon.0 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v85) ==== 74+0+16901 (secure 0 0 0) 0x7fd5d0088be0 con 0x7fd5e009ba60 2024-09-17T05:48:07.331 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-09-17T05:48:07.332 INFO:teuthology.orchestra.run.smithi150.stdout:{"epoch":85,"fsid":"9f2e05e9-d629-47b3-b26b-1360655b7d20","created":"2024-09-17T05:41:32.502979+0000","modified":"2024-09-17T05:48:06.348663+0000","last_up_change":"2024-09-17T05:41:46.150225+0000","last_in_change":"2024-09-17T05:41:36.120274+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":13,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T05:41:46.860779+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_metadata","create_time":"2024-09-17T05:48:03.989113+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_data","create_time":"2024-09-17T05:48:05.314806+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"4f31c018-c8a4-4d6d-b0c2-a597c47aae4a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6800","nonce":479374392},{"type":"v1","addr":"172.21.15.150:6801","nonce":479374392}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6802","nonce":479374392},{"type":"v1","addr":"172.21.15.150:6803","nonce":479374392}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6806","nonce":479374392},{"type":"v1","addr":"172.21.15.150:6807","nonce":479374392}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6804","nonce":479374392},{"type":"v1","addr":"172.21.15.150:6805","nonce":479374392}]},"public_addr":"172.21.15.150:6801/479374392","cluster_addr":"172.21.15.150:6803/479374392","heartbeat_back_addr":"172.21.15.150:6807/479374392","heartbeat_front_addr":"172.21.15.150:6805/479374392","state":["exists","up"]},{"osd":1,"uuid":"6ff4a573-500b-4e04-9de3-39265ead78b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6824","nonce":913899800},{"type":"v1","addr":"172.21.15.150:6825","nonce":913899800}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6826","nonce":913899800},{"type":"v1","addr":"172.21.15.150:6827","nonce":913899800}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6830","nonce":913899800},{"type":"v1","addr":"172.21.15.150:6831","nonce":913899800}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6828","nonce":913899800},{"type":"v1","addr":"172.21.15.150:6829","nonce":913899800}]},"public_addr":"172.21.15.150:6825/913899800","cluster_addr":"172.21.15.150:6827/913899800","heartbeat_back_addr":"172.21.15.150:6831/913899800","heartbeat_front_addr":"172.21.15.150:6829/913899800","state":["exists","up"]},{"osd":2,"uuid":"bffea6f9-2465-4182-b205-00436c41ac1c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6816","nonce":363718461},{"type":"v1","addr":"172.21.15.150:6817","nonce":363718461}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6818","nonce":363718461},{"type":"v1","addr":"172.21.15.150:6819","nonce":363718461}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6822","nonce":363718461},{"type":"v1","addr":"172.21.15.150:6823","nonce":363718461}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6820","nonce":363718461},{"type":"v1","addr":"172.21.15.150:6821","nonce":363718461}]},"public_addr":"172.21.15.150:6817/363718461","cluster_addr":"172.21.15.150:6819/363718461","heartbeat_back_addr":"172.21.15.150:6823/363718461","heartbeat_front_addr":"172.21.15.150:6821/363718461","state":["exists","up"]},{"osd":3,"uuid":"cda70430-d1e1-427e-b04e-56db4031d078","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6808","nonce":3550994626},{"type":"v1","addr":"172.21.15.150:6809","nonce":3550994626}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6810","nonce":3550994626},{"type":"v1","addr":"172.21.15.150:6811","nonce":3550994626}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6814","nonce":3550994626},{"type":"v1","addr":"172.21.15.150:6815","nonce":3550994626}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6812","nonce":3550994626},{"type":"v1","addr":"172.21.15.150:6813","nonce":3550994626}]},"public_addr":"172.21.15.150:6809/3550994626","cluster_addr":"172.21.15.150:6811/3550994626","heartbeat_back_addr":"172.21.15.150:6815/3550994626","heartbeat_front_addr":"172.21.15.150:6813/3550994626","state":["exists","up"]},{"osd":4,"uuid":"3a0277fb-5e1e-4f68-bb2d-9a8a0152f64a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6810","nonce":2718261497},{"type":"v1","addr":"172.21.15.176:6811","nonce":2718261497}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6812","nonce":2718261497},{"type":"v1","addr":"172.21.15.176:6813","nonce":2718261497}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6816","nonce":2718261497},{"type":"v1","addr":"172.21.15.176:6817","nonce":2718261497}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6814","nonce":2718261497},{"type":"v1","addr":"172.21.15.176:6815","nonce":2718261497}]},"public_addr":"172.21.15.176:6811/2718261497","cluster_addr":"172.21.15.176:6813/2718261497","heartbeat_back_addr":"172.21.15.176:6817/2718261497","heartbeat_front_addr":"172.21.15.176:6815/2718261497","state":["exists","up"]},{"osd":5,"uuid":"33aebee6-0315-40b7-a11c-6702f0be494d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6818","nonce":2049295774},{"type":"v1","addr":"172.21.15.176:6819","nonce":2049295774}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6820","nonce":2049295774},{"type":"v1","addr":"172.21.15.176:6821","nonce":2049295774}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6824","nonce":2049295774},{"type":"v1","addr":"172.21.15.176:6825","nonce":2049295774}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6822","nonce":2049295774},{"type":"v1","addr":"172.21.15.176:6823","nonce":2049295774}]},"public_addr":"172.21.15.176:6819/2049295774","cluster_addr":"172.21.15.176:6821/2049295774","heartbeat_back_addr":"172.21.15.176:6825/2049295774","heartbeat_front_addr":"172.21.15.176:6823/2049295774","state":["exists","up"]},{"osd":6,"uuid":"4d24f360-6751-4263-841b-d77793d33540","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6826","nonce":2164458476},{"type":"v1","addr":"172.21.15.176:6827","nonce":2164458476}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6828","nonce":2164458476},{"type":"v1","addr":"172.21.15.176:6829","nonce":2164458476}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6832","nonce":2164458476},{"type":"v1","addr":"172.21.15.176:6833","nonce":2164458476}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6830","nonce":2164458476},{"type":"v1","addr":"172.21.15.176:6831","nonce":2164458476}]},"public_addr":"172.21.15.176:6827/2164458476","cluster_addr":"172.21.15.176:6829/2164458476","heartbeat_back_addr":"172.21.15.176:6833/2164458476","heartbeat_front_addr":"172.21.15.176:6831/2164458476","state":["exists","up"]},{"osd":7,"uuid":"c8594fda-c74a-4ba9-8277-caf101d58ca1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6802","nonce":3239587708},{"type":"v1","addr":"172.21.15.176:6803","nonce":3239587708}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6804","nonce":3239587708},{"type":"v1","addr":"172.21.15.176:6805","nonce":3239587708}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6808","nonce":3239587708},{"type":"v1","addr":"172.21.15.176:6809","nonce":3239587708}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6806","nonce":3239587708},{"type":"v1","addr":"172.21.15.176:6807","nonce":3239587708}]},"public_addr":"172.21.15.176:6803/3239587708","cluster_addr":"172.21.15.176:6805/3239587708","heartbeat_back_addr":"172.21.15.176:6809/3239587708","heartbeat_front_addr":"172.21.15.176:6807/3239587708","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:41:41.905151+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:41:42.705679+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:41:42.459673+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:41:42.440819+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:41:42.668428+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:41:42.694972+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:41:43.078535+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:41:42.363539+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":7,"snaps":[{"begin":2,"length":2}]},{"pool":9,"snaps":[{"begin":2,"length":2}]},{"pool":11,"snaps":[{"begin":2,"length":2}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T05:48:07.333 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:07.331+0000 7fd5e4f12640 1 -- 172.21.15.150:0/3439333572 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fd5c0079d00 msgr2=0x7fd5c007c210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:48:07.333 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:07.331+0000 7fd5e4f12640 1 --2- 172.21.15.150:0/3439333572 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fd5c0079d00 0x7fd5c007c210 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7fd5e015cb20 tx=0x7fd5d4009040 comp rx=0 tx=0).stop 2024-09-17T05:48:07.334 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:07.331+0000 7fd5e4f12640 1 -- 172.21.15.150:0/3439333572 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd5e009ba60 msgr2=0x7fd5e0154710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:48:07.334 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:07.331+0000 7fd5e4f12640 1 --2- 172.21.15.150:0/3439333572 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd5e009ba60 0x7fd5e0154710 secure :-1 s=READY pgs=1000 cs=0 l=1 rev1=1 crypto rx=0x7fd5d002aea0 tx=0x7fd5d0004360 comp rx=0 tx=0).stop 2024-09-17T05:48:07.334 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:07.332+0000 7fd5e4f12640 1 -- 172.21.15.150:0/3439333572 shutdown_connections 2024-09-17T05:48:07.334 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:07.332+0000 7fd5e4f12640 1 --2- 172.21.15.150:0/3439333572 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd5e00cd850 0x7fd5e0155900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:48:07.334 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:07.332+0000 7fd5e4f12640 1 --2- 172.21.15.150:0/3439333572 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fd5c0079d00 0x7fd5c007c210 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:48:07.334 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:07.332+0000 7fd5e4f12640 1 --2- 172.21.15.150:0/3439333572 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd5e00cd440 0x7fd5e015a0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:48:07.334 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:07.332+0000 7fd5e4f12640 1 --2- 172.21.15.150:0/3439333572 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd5e009ba60 0x7fd5e0154710 unknown :-1 s=CLOSED pgs=1000 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:48:07.334 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:07.332+0000 7fd5e4f12640 1 -- 172.21.15.150:0/3439333572 >> 172.21.15.150:0/3439333572 conn(0x7fd5e00cee90 msgr2=0x7fd5e01601a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:48:07.334 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:07.332+0000 7fd5e4f12640 1 -- 172.21.15.150:0/3439333572 shutdown_connections 2024-09-17T05:48:07.334 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:07.332+0000 7fd5e4f12640 1 -- 172.21.15.150:0/3439333572 wait complete. 2024-09-17T05:48:07.345 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T05:48:07.461 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:07.459+0000 7fdf4d8d5640 1 -- 172.21.15.150:0/533885717 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fdf480d1790 msgr2=0x7fdf480d0400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:48:07.461 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:07.459+0000 7fdf4d8d5640 1 --2- 172.21.15.150:0/533885717 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fdf480d1790 0x7fdf480d0400 secure :-1 s=READY pgs=1001 cs=0 l=1 rev1=1 crypto rx=0x7fdf480b71d0 tx=0x7fdf4002aac0 comp rx=0 tx=0).stop 2024-09-17T05:48:07.461 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:07.459+0000 7fdf4d8d5640 1 -- 172.21.15.150:0/533885717 shutdown_connections 2024-09-17T05:48:07.461 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:07.459+0000 7fdf4d8d5640 1 --2- 172.21.15.150:0/533885717 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fdf480d1790 0x7fdf480d0400 unknown :-1 s=CLOSED pgs=1001 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:48:07.461 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:07.459+0000 7fdf4d8d5640 1 --2- 172.21.15.150:0/533885717 >> v2:172.21.15.176:3300/0 conn(0x7fdf480b5d50 0x7fdf480d2780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:48:07.461 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:07.459+0000 7fdf4d8d5640 1 -- 172.21.15.150:0/533885717 >> 172.21.15.150:0/533885717 conn(0x7fdf4808bfe0 msgr2=0x7fdf480d4670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:48:07.461 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:07.459+0000 7fdf4d8d5640 1 -- 172.21.15.150:0/533885717 shutdown_connections 2024-09-17T05:48:07.461 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:07.459+0000 7fdf4d8d5640 1 -- 172.21.15.150:0/533885717 wait complete. 2024-09-17T05:48:07.466 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:07.460+0000 7fdf4d8d5640 1 Processor -- start 2024-09-17T05:48:07.466 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:07.461+0000 7fdf4d8d5640 1 -- start start 2024-09-17T05:48:07.467 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:07.462+0000 7fdf4d8d5640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fdf480b5d50 0x7fdf481f9670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:48:07.467 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:07.462+0000 7fdf4d8d5640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fdf480d4f90 0x7fdf481f69e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:48:07.467 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:07.462+0000 7fdf4d8d5640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fdf480b26d0 0x7fdf4815a680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:48:07.467 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:07.462+0000 7fdf4d8d5640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7fdf480b7af0 con 0x7fdf480b26d0 2024-09-17T05:48:07.467 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:07.462+0000 7fdf4d8d5640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fdf480b7970 con 0x7fdf480b5d50 2024-09-17T05:48:07.467 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:07.462+0000 7fdf4d8d5640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fdf480b7c70 con 0x7fdf480d4f90 2024-09-17T05:48:07.467 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:07.462+0000 7fdf477fe640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fdf480b26d0 0x7fdf4815a680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:48:07.467 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:07.462+0000 7fdf477fe640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fdf480b26d0 0x7fdf4815a680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:60328/0 (socket says 172.21.15.150:60328) 2024-09-17T05:48:07.467 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:07.462+0000 7fdf477fe640 1 -- 172.21.15.150:0/3501765906 learned_addr learned my addr 172.21.15.150:0/3501765906 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:48:07.468 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:07.462+0000 7fdf46ffd640 1 --2- 172.21.15.150:0/3501765906 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fdf480b5d50 0x7fdf481f9670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:48:07.468 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:07.462+0000 7fdf467fc640 1 --2- 172.21.15.150:0/3501765906 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fdf480d4f90 0x7fdf481f69e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:48:07.468 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:07.462+0000 7fdf477fe640 1 -- 172.21.15.150:0/3501765906 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fdf480d4f90 msgr2=0x7fdf481f69e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:48:07.468 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:07.462+0000 7fdf477fe640 1 --2- 172.21.15.150:0/3501765906 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fdf480d4f90 0x7fdf481f69e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:48:07.468 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:07.462+0000 7fdf477fe640 1 -- 172.21.15.150:0/3501765906 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fdf480b5d50 msgr2=0x7fdf481f9670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:48:07.468 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:07.462+0000 7fdf477fe640 1 --2- 172.21.15.150:0/3501765906 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fdf480b5d50 0x7fdf481f9670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:48:07.468 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:07.462+0000 7fdf477fe640 1 -- 172.21.15.150:0/3501765906 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdf481f9bb0 con 0x7fdf480b26d0 2024-09-17T05:48:07.468 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:07.462+0000 7fdf46ffd640 1 --2- 172.21.15.150:0/3501765906 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fdf480b5d50 0x7fdf481f9670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:48:07.468 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:07.463+0000 7fdf477fe640 1 --2- 172.21.15.150:0/3501765906 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fdf480b26d0 0x7fdf4815a680 secure :-1 s=READY pgs=1002 cs=0 l=1 rev1=1 crypto rx=0x7fdf4002b0b0 tx=0x7fdf40003f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:48:07.468 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:07.463+0000 7fdf2ffff640 1 -- 172.21.15.150:0/3501765906 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf40004250 con 0x7fdf480b26d0 2024-09-17T05:48:07.468 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:07.463+0000 7fdf2ffff640 1 -- 172.21.15.150:0/3501765906 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fdf400043f0 con 0x7fdf480b26d0 2024-09-17T05:48:07.468 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:07.463+0000 7fdf2ffff640 1 -- 172.21.15.150:0/3501765906 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf40004820 con 0x7fdf480b26d0 2024-09-17T05:48:07.469 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:07.463+0000 7fdf4d8d5640 1 -- 172.21.15.150:0/3501765906 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdf481fa5b0 con 0x7fdf480b26d0 2024-09-17T05:48:07.469 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:07.463+0000 7fdf4d8d5640 1 -- 172.21.15.150:0/3501765906 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdf481f9ff0 con 0x7fdf480b26d0 2024-09-17T05:48:07.469 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:07.464+0000 7fdf4d8d5640 1 -- 172.21.15.150:0/3501765906 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdf480d2780 con 0x7fdf480b26d0 2024-09-17T05:48:07.469 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:07.465+0000 7fdf2ffff640 1 -- 172.21.15.150:0/3501765906 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 25) ==== 103022+0+0 (secure 0 0 0) 0x7fdf40049430 con 0x7fdf480b26d0 2024-09-17T05:48:07.469 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:07.465+0000 7fdf2ffff640 1 --2- 172.21.15.150:0/3501765906 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fdf34079d30 0x7fdf3407c240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:48:07.470 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:07.466+0000 7fdf2ffff640 1 -- 172.21.15.150:0/3501765906 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 5793+0+0 (secure 0 0 0) 0x7fdf400ba9f0 con 0x7fdf480b26d0 2024-09-17T05:48:07.470 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:07.466+0000 7fdf46ffd640 1 --2- 172.21.15.150:0/3501765906 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fdf34079d30 0x7fdf3407c240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:48:07.470 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:07.466+0000 7fdf46ffd640 1 --2- 172.21.15.150:0/3501765906 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fdf34079d30 0x7fdf3407c240 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7fdf38005fd0 tx=0x7fdf3800f360 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:48:07.472 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:07.470+0000 7fdf2ffff640 1 -- 172.21.15.150:0/3501765906 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fdf40032030 con 0x7fdf480b26d0 2024-09-17T05:48:07.648 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:07.646+0000 7fdf4d8d5640 1 -- 172.21.15.150:0/3501765906 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fdf481f9d80 con 0x7fdf480b26d0 2024-09-17T05:48:07.649 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:07.647+0000 7fdf2ffff640 1 -- 172.21.15.150:0/3501765906 <== mon.0 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v85) ==== 74+0+16901 (secure 0 0 0) 0x7fdf40084620 con 0x7fdf480b26d0 2024-09-17T05:48:07.649 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-09-17T05:48:07.649 INFO:teuthology.orchestra.run.smithi150.stdout:{"epoch":85,"fsid":"9f2e05e9-d629-47b3-b26b-1360655b7d20","created":"2024-09-17T05:41:32.502979+0000","modified":"2024-09-17T05:48:06.348663+0000","last_up_change":"2024-09-17T05:41:46.150225+0000","last_in_change":"2024-09-17T05:41:36.120274+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":13,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T05:41:46.860779+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_metadata","create_time":"2024-09-17T05:48:03.989113+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_data","create_time":"2024-09-17T05:48:05.314806+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"4f31c018-c8a4-4d6d-b0c2-a597c47aae4a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6800","nonce":479374392},{"type":"v1","addr":"172.21.15.150:6801","nonce":479374392}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6802","nonce":479374392},{"type":"v1","addr":"172.21.15.150:6803","nonce":479374392}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6806","nonce":479374392},{"type":"v1","addr":"172.21.15.150:6807","nonce":479374392}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6804","nonce":479374392},{"type":"v1","addr":"172.21.15.150:6805","nonce":479374392}]},"public_addr":"172.21.15.150:6801/479374392","cluster_addr":"172.21.15.150:6803/479374392","heartbeat_back_addr":"172.21.15.150:6807/479374392","heartbeat_front_addr":"172.21.15.150:6805/479374392","state":["exists","up"]},{"osd":1,"uuid":"6ff4a573-500b-4e04-9de3-39265ead78b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6824","nonce":913899800},{"type":"v1","addr":"172.21.15.150:6825","nonce":913899800}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6826","nonce":913899800},{"type":"v1","addr":"172.21.15.150:6827","nonce":913899800}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6830","nonce":913899800},{"type":"v1","addr":"172.21.15.150:6831","nonce":913899800}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6828","nonce":913899800},{"type":"v1","addr":"172.21.15.150:6829","nonce":913899800}]},"public_addr":"172.21.15.150:6825/913899800","cluster_addr":"172.21.15.150:6827/913899800","heartbeat_back_addr":"172.21.15.150:6831/913899800","heartbeat_front_addr":"172.21.15.150:6829/913899800","state":["exists","up"]},{"osd":2,"uuid":"bffea6f9-2465-4182-b205-00436c41ac1c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6816","nonce":363718461},{"type":"v1","addr":"172.21.15.150:6817","nonce":363718461}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6818","nonce":363718461},{"type":"v1","addr":"172.21.15.150:6819","nonce":363718461}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6822","nonce":363718461},{"type":"v1","addr":"172.21.15.150:6823","nonce":363718461}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6820","nonce":363718461},{"type":"v1","addr":"172.21.15.150:6821","nonce":363718461}]},"public_addr":"172.21.15.150:6817/363718461","cluster_addr":"172.21.15.150:6819/363718461","heartbeat_back_addr":"172.21.15.150:6823/363718461","heartbeat_front_addr":"172.21.15.150:6821/363718461","state":["exists","up"]},{"osd":3,"uuid":"cda70430-d1e1-427e-b04e-56db4031d078","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6808","nonce":3550994626},{"type":"v1","addr":"172.21.15.150:6809","nonce":3550994626}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6810","nonce":3550994626},{"type":"v1","addr":"172.21.15.150:6811","nonce":3550994626}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6814","nonce":3550994626},{"type":"v1","addr":"172.21.15.150:6815","nonce":3550994626}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6812","nonce":3550994626},{"type":"v1","addr":"172.21.15.150:6813","nonce":3550994626}]},"public_addr":"172.21.15.150:6809/3550994626","cluster_addr":"172.21.15.150:6811/3550994626","heartbeat_back_addr":"172.21.15.150:6815/3550994626","heartbeat_front_addr":"172.21.15.150:6813/3550994626","state":["exists","up"]},{"osd":4,"uuid":"3a0277fb-5e1e-4f68-bb2d-9a8a0152f64a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6810","nonce":2718261497},{"type":"v1","addr":"172.21.15.176:6811","nonce":2718261497}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6812","nonce":2718261497},{"type":"v1","addr":"172.21.15.176:6813","nonce":2718261497}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6816","nonce":2718261497},{"type":"v1","addr":"172.21.15.176:6817","nonce":2718261497}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6814","nonce":2718261497},{"type":"v1","addr":"172.21.15.176:6815","nonce":2718261497}]},"public_addr":"172.21.15.176:6811/2718261497","cluster_addr":"172.21.15.176:6813/2718261497","heartbeat_back_addr":"172.21.15.176:6817/2718261497","heartbeat_front_addr":"172.21.15.176:6815/2718261497","state":["exists","up"]},{"osd":5,"uuid":"33aebee6-0315-40b7-a11c-6702f0be494d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6818","nonce":2049295774},{"type":"v1","addr":"172.21.15.176:6819","nonce":2049295774}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6820","nonce":2049295774},{"type":"v1","addr":"172.21.15.176:6821","nonce":2049295774}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6824","nonce":2049295774},{"type":"v1","addr":"172.21.15.176:6825","nonce":2049295774}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6822","nonce":2049295774},{"type":"v1","addr":"172.21.15.176:6823","nonce":2049295774}]},"public_addr":"172.21.15.176:6819/2049295774","cluster_addr":"172.21.15.176:6821/2049295774","heartbeat_back_addr":"172.21.15.176:6825/2049295774","heartbeat_front_addr":"172.21.15.176:6823/2049295774","state":["exists","up"]},{"osd":6,"uuid":"4d24f360-6751-4263-841b-d77793d33540","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6826","nonce":2164458476},{"type":"v1","addr":"172.21.15.176:6827","nonce":2164458476}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6828","nonce":2164458476},{"type":"v1","addr":"172.21.15.176:6829","nonce":2164458476}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6832","nonce":2164458476},{"type":"v1","addr":"172.21.15.176:6833","nonce":2164458476}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6830","nonce":2164458476},{"type":"v1","addr":"172.21.15.176:6831","nonce":2164458476}]},"public_addr":"172.21.15.176:6827/2164458476","cluster_addr":"172.21.15.176:6829/2164458476","heartbeat_back_addr":"172.21.15.176:6833/2164458476","heartbeat_front_addr":"172.21.15.176:6831/2164458476","state":["exists","up"]},{"osd":7,"uuid":"c8594fda-c74a-4ba9-8277-caf101d58ca1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6802","nonce":3239587708},{"type":"v1","addr":"172.21.15.176:6803","nonce":3239587708}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6804","nonce":3239587708},{"type":"v1","addr":"172.21.15.176:6805","nonce":3239587708}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6808","nonce":3239587708},{"type":"v1","addr":"172.21.15.176:6809","nonce":3239587708}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6806","nonce":3239587708},{"type":"v1","addr":"172.21.15.176:6807","nonce":3239587708}]},"public_addr":"172.21.15.176:6803/3239587708","cluster_addr":"172.21.15.176:6805/3239587708","heartbeat_back_addr":"172.21.15.176:6809/3239587708","heartbeat_front_addr":"172.21.15.176:6807/3239587708","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:41:41.905151+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:41:42.705679+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:41:42.459673+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:41:42.440819+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:41:42.668428+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:41:42.694972+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:41:43.078535+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:41:42.363539+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":7,"snaps":[{"begin":2,"length":2}]},{"pool":9,"snaps":[{"begin":2,"length":2}]},{"pool":11,"snaps":[{"begin":2,"length":2}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T05:48:07.651 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:07.649+0000 7fdf4d8d5640 1 -- 172.21.15.150:0/3501765906 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fdf34079d30 msgr2=0x7fdf3407c240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:48:07.651 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:07.649+0000 7fdf4d8d5640 1 --2- 172.21.15.150:0/3501765906 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fdf34079d30 0x7fdf3407c240 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7fdf38005fd0 tx=0x7fdf3800f360 comp rx=0 tx=0).stop 2024-09-17T05:48:07.651 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:07.649+0000 7fdf4d8d5640 1 -- 172.21.15.150:0/3501765906 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fdf480b26d0 msgr2=0x7fdf4815a680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:48:07.651 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:07.649+0000 7fdf4d8d5640 1 --2- 172.21.15.150:0/3501765906 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fdf480b26d0 0x7fdf4815a680 secure :-1 s=READY pgs=1002 cs=0 l=1 rev1=1 crypto rx=0x7fdf4002b0b0 tx=0x7fdf40003f10 comp rx=0 tx=0).stop 2024-09-17T05:48:07.651 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:07.649+0000 7fdf4d8d5640 1 -- 172.21.15.150:0/3501765906 shutdown_connections 2024-09-17T05:48:07.651 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:07.649+0000 7fdf4d8d5640 1 --2- 172.21.15.150:0/3501765906 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fdf34079d30 0x7fdf3407c240 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:48:07.652 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:07.649+0000 7fdf4d8d5640 1 --2- 172.21.15.150:0/3501765906 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fdf480b26d0 0x7fdf4815a680 unknown :-1 s=CLOSED pgs=1002 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:48:07.652 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:07.649+0000 7fdf4d8d5640 1 --2- 172.21.15.150:0/3501765906 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fdf480d4f90 0x7fdf481f69e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:48:07.652 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:07.649+0000 7fdf4d8d5640 1 --2- 172.21.15.150:0/3501765906 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fdf480b5d50 0x7fdf481f9670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:48:07.652 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:07.649+0000 7fdf4d8d5640 1 -- 172.21.15.150:0/3501765906 >> 172.21.15.150:0/3501765906 conn(0x7fdf4808bfe0 msgr2=0x7fdf48068e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:48:07.652 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:07.649+0000 7fdf4d8d5640 1 -- 172.21.15.150:0/3501765906 shutdown_connections 2024-09-17T05:48:07.652 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:07.649+0000 7fdf4d8d5640 1 -- 172.21.15.150:0/3501765906 wait complete. 2024-09-17T05:48:07.663 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-09-17T05:48:07.779 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:07.777+0000 7fe76d28c640 1 -- 172.21.15.150:0/2491601783 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe7680cec90 msgr2=0x7fe7680cf0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:48:07.780 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:07.777+0000 7fe76d28c640 1 --2- 172.21.15.150:0/2491601783 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe7680cec90 0x7fe7680cf0a0 secure :-1 s=READY pgs=1003 cs=0 l=1 rev1=1 crypto rx=0x7fe7680ccb00 tx=0x7fe75802a4d0 comp rx=0 tx=0).stop 2024-09-17T05:48:07.780 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:07.777+0000 7fe76d28c640 1 -- 172.21.15.150:0/2491601783 shutdown_connections 2024-09-17T05:48:07.780 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:07.777+0000 7fe76d28c640 1 --2- 172.21.15.150:0/2491601783 >> v2:172.21.15.176:3300/0 conn(0x7fe768161050 0x7fe768167650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:48:07.780 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:07.777+0000 7fe76d28c640 1 --2- 172.21.15.150:0/2491601783 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe7680cec90 0x7fe7680cf0a0 unknown :-1 s=CLOSED pgs=1003 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:48:07.780 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:07.777+0000 7fe76d28c640 1 -- 172.21.15.150:0/2491601783 >> 172.21.15.150:0/2491601783 conn(0x7fe7680d2520 msgr2=0x7fe7680d2930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:48:07.780 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:07.778+0000 7fe76d28c640 1 -- 172.21.15.150:0/2491601783 shutdown_connections 2024-09-17T05:48:07.780 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:07.778+0000 7fe76d28c640 1 -- 172.21.15.150:0/2491601783 wait complete. 2024-09-17T05:48:07.781 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:07.779+0000 7fe76d28c640 1 Processor -- start 2024-09-17T05:48:07.781 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:07.779+0000 7fe76d28c640 1 -- start start 2024-09-17T05:48:07.784 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:07.781+0000 7fe76d28c640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe7680cec90 0x7fe7680caf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:48:07.784 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:07.781+0000 7fe76d28c640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe768160530 0x7fe7680c95d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:48:07.784 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:07.781+0000 7fe76d28c640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe768161050 0x7fe7680c8df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:48:07.784 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:07.781+0000 7fe76d28c640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7fe7680cfe60 con 0x7fe768160530 2024-09-17T05:48:07.784 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:07.781+0000 7fe76d28c640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fe7680cfce0 con 0x7fe768161050 2024-09-17T05:48:07.784 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:07.781+0000 7fe76d28c640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fe7680b7c70 con 0x7fe7680cec90 2024-09-17T05:48:07.784 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:07.781+0000 7fe7667fc640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe768160530 0x7fe7680c95d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:48:07.784 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:07.781+0000 7fe7667fc640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe768160530 0x7fe7680c95d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:60346/0 (socket says 172.21.15.150:60346) 2024-09-17T05:48:07.784 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:07.781+0000 7fe7667fc640 1 -- 172.21.15.150:0/3203621119 learned_addr learned my addr 172.21.15.150:0/3203621119 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:48:07.785 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:07.781+0000 7fe7667fc640 1 -- 172.21.15.150:0/3203621119 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe7680cec90 msgr2=0x7fe7680caf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:48:07.785 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:07.781+0000 7fe766ffd640 1 --2- 172.21.15.150:0/3203621119 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe7680cec90 0x7fe7680caf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:48:07.785 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:07.781+0000 7fe7677fe640 1 --2- 172.21.15.150:0/3203621119 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe768161050 0x7fe7680c8df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:48:07.785 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:07.781+0000 7fe7667fc640 1 --2- 172.21.15.150:0/3203621119 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe7680cec90 0x7fe7680caf80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:48:07.785 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:07.781+0000 7fe7667fc640 1 -- 172.21.15.150:0/3203621119 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe768161050 msgr2=0x7fe7680c8df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:48:07.785 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:07.781+0000 7fe7667fc640 1 --2- 172.21.15.150:0/3203621119 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe768161050 0x7fe7680c8df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:48:07.785 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:07.781+0000 7fe7667fc640 1 -- 172.21.15.150:0/3203621119 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe7680b2fc0 con 0x7fe768160530 2024-09-17T05:48:07.785 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:07.781+0000 7fe7677fe640 1 --2- 172.21.15.150:0/3203621119 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe768161050 0x7fe7680c8df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T05:48:07.785 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:07.781+0000 7fe766ffd640 1 --2- 172.21.15.150:0/3203621119 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe7680cec90 0x7fe7680caf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T05:48:07.785 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:07.781+0000 7fe7667fc640 1 --2- 172.21.15.150:0/3203621119 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe768160530 0x7fe7680c95d0 secure :-1 s=READY pgs=1004 cs=0 l=1 rev1=1 crypto rx=0x7fe75c00b420 tx=0x7fe75c00b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:48:07.785 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:07.781+0000 7fe74f7fe640 1 -- 172.21.15.150:0/3203621119 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe75c011830 con 0x7fe768160530 2024-09-17T05:48:07.785 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:07.781+0000 7fe74f7fe640 1 -- 172.21.15.150:0/3203621119 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe75c016070 con 0x7fe768160530 2024-09-17T05:48:07.785 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:07.782+0000 7fe76d28c640 1 -- 172.21.15.150:0/3203621119 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe7680b32a0 con 0x7fe768160530 2024-09-17T05:48:07.786 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:07.782+0000 7fe74f7fe640 1 -- 172.21.15.150:0/3203621119 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe75c011d60 con 0x7fe768160530 2024-09-17T05:48:07.786 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:07.782+0000 7fe76d28c640 1 -- 172.21.15.150:0/3203621119 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe7680b3860 con 0x7fe768160530 2024-09-17T05:48:07.786 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:07.783+0000 7fe76d28c640 1 -- 172.21.15.150:0/3203621119 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe76814f490 con 0x7fe768160530 2024-09-17T05:48:07.787 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:07.784+0000 7fe74f7fe640 1 -- 172.21.15.150:0/3203621119 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 25) ==== 103022+0+0 (secure 0 0 0) 0x7fe75c01b460 con 0x7fe768160530 2024-09-17T05:48:07.787 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:07.784+0000 7fe74f7fe640 1 --2- 172.21.15.150:0/3203621119 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fe754079d00 0x7fe75407c210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:48:07.787 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:07.784+0000 7fe74f7fe640 1 -- 172.21.15.150:0/3203621119 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 5793+0+0 (secure 0 0 0) 0x7fe75c099960 con 0x7fe768160530 2024-09-17T05:48:07.787 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:07.784+0000 7fe766ffd640 1 --2- 172.21.15.150:0/3203621119 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fe754079d00 0x7fe75407c210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:48:07.787 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:07.785+0000 7fe766ffd640 1 --2- 172.21.15.150:0/3203621119 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fe754079d00 0x7fe75407c210 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7fe758033000 tx=0x7fe758004730 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:48:07.790 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:07.789+0000 7fe74f7fe640 1 -- 172.21.15.150:0/3203621119 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fe75c063590 con 0x7fe768160530 2024-09-17T05:48:08.003 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:08.002+0000 7fe76d28c640 1 -- 172.21.15.150:0/3203621119 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7fe7680b1bc0 con 0x7fe768160530 2024-09-17T05:48:08.970 INFO:tasks.ceph.mds.d.smithi176.stderr:2024-09-17T05:48:08.969+0000 7fb8d1dc1640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-17T05:48:08.992 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:08.991+0000 7fe74f7fe640 1 -- 172.21.15.150:0/3203621119 <== mon.0 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v50) ==== 118+0+0 (secure 0 0 0) 0x7fe75c062e90 con 0x7fe768160530 2024-09-17T05:48:08.996 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:08.994+0000 7fe76d28c640 1 -- 172.21.15.150:0/3203621119 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fe754079d00 msgr2=0x7fe75407c210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:48:08.996 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:08.994+0000 7fe76d28c640 1 --2- 172.21.15.150:0/3203621119 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fe754079d00 0x7fe75407c210 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7fe758033000 tx=0x7fe758004730 comp rx=0 tx=0).stop 2024-09-17T05:48:08.996 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:08.994+0000 7fe76d28c640 1 -- 172.21.15.150:0/3203621119 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe768160530 msgr2=0x7fe7680c95d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:48:08.996 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:08.994+0000 7fe76d28c640 1 --2- 172.21.15.150:0/3203621119 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe768160530 0x7fe7680c95d0 secure :-1 s=READY pgs=1004 cs=0 l=1 rev1=1 crypto rx=0x7fe75c00b420 tx=0x7fe75c00b8e0 comp rx=0 tx=0).stop 2024-09-17T05:48:08.996 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:08.994+0000 7fe76d28c640 1 -- 172.21.15.150:0/3203621119 shutdown_connections 2024-09-17T05:48:08.996 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:08.994+0000 7fe76d28c640 1 --2- 172.21.15.150:0/3203621119 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe768161050 0x7fe7680c8df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:48:08.996 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:08.994+0000 7fe76d28c640 1 --2- 172.21.15.150:0/3203621119 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fe754079d00 0x7fe75407c210 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:48:08.996 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:08.994+0000 7fe76d28c640 1 --2- 172.21.15.150:0/3203621119 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe768160530 0x7fe7680c95d0 unknown :-1 s=CLOSED pgs=1004 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:48:08.996 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:08.994+0000 7fe76d28c640 1 --2- 172.21.15.150:0/3203621119 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe7680cec90 0x7fe7680caf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:48:08.996 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:08.994+0000 7fe76d28c640 1 -- 172.21.15.150:0/3203621119 >> 172.21.15.150:0/3203621119 conn(0x7fe7680d2520 msgr2=0x7fe76815d010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:48:08.996 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:08.994+0000 7fe76d28c640 1 -- 172.21.15.150:0/3203621119 shutdown_connections 2024-09-17T05:48:08.997 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:08.994+0000 7fe76d28c640 1 -- 172.21.15.150:0/3203621119 wait complete. 2024-09-17T05:48:09.010 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-09-17T05:48:09.011 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-09-17T05:48:09.134 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:09.131+0000 7fa0d7638640 1 -- 172.21.15.150:0/1302559183 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa0d00d0320 msgr2=0x7fa0d0162c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:48:09.134 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:09.131+0000 7fa0d7638640 1 --2- 172.21.15.150:0/1302559183 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa0d00d0320 0x7fa0d0162c30 secure :-1 s=READY pgs=1006 cs=0 l=1 rev1=1 crypto rx=0x7fa0d008d350 tx=0x7fa0c802a820 comp rx=0 tx=0).stop 2024-09-17T05:48:09.134 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:09.131+0000 7fa0d7638640 1 -- 172.21.15.150:0/1302559183 shutdown_connections 2024-09-17T05:48:09.134 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:09.131+0000 7fa0d7638640 1 --2- 172.21.15.150:0/1302559183 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa0d00d0320 0x7fa0d0162c30 unknown :-1 s=CLOSED pgs=1006 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:48:09.134 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:09.131+0000 7fa0d7638640 1 --2- 172.21.15.150:0/1302559183 >> v2:172.21.15.176:3300/0 conn(0x7fa0d00b3510 0x7fa0d01626f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:48:09.134 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:09.131+0000 7fa0d7638640 1 -- 172.21.15.150:0/1302559183 >> 172.21.15.150:0/1302559183 conn(0x7fa0d00d46e0 msgr2=0x7fa0d00d4af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:48:09.134 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:09.132+0000 7fa0d7638640 1 -- 172.21.15.150:0/1302559183 shutdown_connections 2024-09-17T05:48:09.134 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:09.132+0000 7fa0d7638640 1 -- 172.21.15.150:0/1302559183 wait complete. 2024-09-17T05:48:09.135 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:09.133+0000 7fa0d7638640 1 Processor -- start 2024-09-17T05:48:09.135 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:09.133+0000 7fa0d7638640 1 -- start start 2024-09-17T05:48:09.137 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:09.134+0000 7fa0d7638640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa0d00b3510 0x7fa0d00cd3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:48:09.138 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:09.134+0000 7fa0d7638640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa0d00b9f20 0x7fa0d0152c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:48:09.138 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:09.135+0000 7fa0d7638640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa0d00d0320 0x7fa0d01f5ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:48:09.138 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:09.135+0000 7fa0d7638640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7fa0d00b1e60 con 0x7fa0d00b3510 2024-09-17T05:48:09.138 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:09.135+0000 7fa0d7638640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fa0d00b1ce0 con 0x7fa0d00d0320 2024-09-17T05:48:09.138 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:09.135+0000 7fa0d7638640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fa0d00b1fe0 con 0x7fa0d00b9f20 2024-09-17T05:48:09.138 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:09.135+0000 7fa0d53d4640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa0d00b3510 0x7fa0d00cd3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:48:09.138 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:09.135+0000 7fa0d53d4640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa0d00b3510 0x7fa0d00cd3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:60364/0 (socket says 172.21.15.150:60364) 2024-09-17T05:48:09.138 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:09.135+0000 7fa0d53d4640 1 -- 172.21.15.150:0/2943744039 learned_addr learned my addr 172.21.15.150:0/2943744039 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:48:09.138 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:09.135+0000 7fa0d5bd5640 1 --2- 172.21.15.150:0/2943744039 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa0d00d0320 0x7fa0d01f5ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:48:09.138 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:09.135+0000 7fa0d4bd3640 1 --2- 172.21.15.150:0/2943744039 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa0d00b9f20 0x7fa0d0152c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:48:09.138 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:09.135+0000 7fa0d53d4640 1 -- 172.21.15.150:0/2943744039 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa0d00b9f20 msgr2=0x7fa0d0152c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:48:09.138 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:09.135+0000 7fa0d53d4640 1 --2- 172.21.15.150:0/2943744039 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa0d00b9f20 0x7fa0d0152c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:48:09.139 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:09.135+0000 7fa0d53d4640 1 -- 172.21.15.150:0/2943744039 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa0d00d0320 msgr2=0x7fa0d01f5ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:48:09.139 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:09.135+0000 7fa0d53d4640 1 --2- 172.21.15.150:0/2943744039 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa0d00d0320 0x7fa0d01f5ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:48:09.139 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:09.135+0000 7fa0d53d4640 1 -- 172.21.15.150:0/2943744039 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa0d01531a0 con 0x7fa0d00b3510 2024-09-17T05:48:09.139 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:09.135+0000 7fa0d4bd3640 1 --2- 172.21.15.150:0/2943744039 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa0d00b9f20 0x7fa0d0152c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T05:48:09.139 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:09.135+0000 7fa0d53d4640 1 --2- 172.21.15.150:0/2943744039 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa0d00b3510 0x7fa0d00cd3c0 secure :-1 s=READY pgs=1007 cs=0 l=1 rev1=1 crypto rx=0x7fa0cc00d770 tx=0x7fa0cc00dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:48:09.139 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:09.135+0000 7fa0c5ffb640 1 -- 172.21.15.150:0/2943744039 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0cc017070 con 0x7fa0d00b3510 2024-09-17T05:48:09.139 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:09.135+0000 7fa0c5ffb640 1 -- 172.21.15.150:0/2943744039 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa0cc009d20 con 0x7fa0d00b3510 2024-09-17T05:48:09.139 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:09.135+0000 7fa0d7638640 1 -- 172.21.15.150:0/2943744039 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa0d00cdc10 con 0x7fa0d00b3510 2024-09-17T05:48:09.139 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:09.135+0000 7fa0c5ffb640 1 -- 172.21.15.150:0/2943744039 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0cc0106c0 con 0x7fa0d00b3510 2024-09-17T05:48:09.139 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:09.136+0000 7fa0d7638640 1 -- 172.21.15.150:0/2943744039 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa0d00ce1d0 con 0x7fa0d00b3510 2024-09-17T05:48:09.140 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:09.136+0000 7fa0d7638640 1 -- 172.21.15.150:0/2943744039 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa0d00b2500 con 0x7fa0d00b3510 2024-09-17T05:48:09.140 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:09.137+0000 7fa0c5ffb640 1 -- 172.21.15.150:0/2943744039 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 25) ==== 103022+0+0 (secure 0 0 0) 0x7fa0cc01a070 con 0x7fa0d00b3510 2024-09-17T05:48:09.140 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:09.138+0000 7fa0c5ffb640 1 --2- 172.21.15.150:0/2943744039 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fa0b4079d30 0x7fa0b407c240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:48:09.140 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:09.138+0000 7fa0c5ffb640 1 -- 172.21.15.150:0/2943744039 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 5793+0+0 (secure 0 0 0) 0x7fa0cc099ca0 con 0x7fa0d00b3510 2024-09-17T05:48:09.140 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:09.138+0000 7fa0d4bd3640 1 --2- 172.21.15.150:0/2943744039 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fa0b4079d30 0x7fa0b407c240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:48:09.140 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:09.139+0000 7fa0d4bd3640 1 --2- 172.21.15.150:0/2943744039 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fa0b4079d30 0x7fa0b407c240 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7fa0d00cb1a0 tx=0x7fa0c0009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:48:09.144 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:09.142+0000 7fa0c5ffb640 1 -- 172.21.15.150:0/2943744039 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fa0cc0638d0 con 0x7fa0d00b3510 2024-09-17T05:48:09.356 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:09.354+0000 7fa0d7638640 1 -- 172.21.15.150:0/2943744039 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7fa0d00b93a0 con 0x7fa0d00b3510 2024-09-17T05:48:10.023 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:10.021+0000 7fa0c5ffb640 1 -- 172.21.15.150:0/2943744039 <== mon.0 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v51) ==== 122+0+0 (secure 0 0 0) 0x7fa0cc0631d0 con 0x7fa0d00b3510 2024-09-17T05:48:10.026 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:10.024+0000 7fa0d7638640 1 -- 172.21.15.150:0/2943744039 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fa0b4079d30 msgr2=0x7fa0b407c240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:48:10.027 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:10.024+0000 7fa0d7638640 1 --2- 172.21.15.150:0/2943744039 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fa0b4079d30 0x7fa0b407c240 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7fa0d00cb1a0 tx=0x7fa0c0009040 comp rx=0 tx=0).stop 2024-09-17T05:48:10.027 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:10.024+0000 7fa0d7638640 1 -- 172.21.15.150:0/2943744039 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa0d00b3510 msgr2=0x7fa0d00cd3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:48:10.027 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:10.024+0000 7fa0d7638640 1 --2- 172.21.15.150:0/2943744039 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa0d00b3510 0x7fa0d00cd3c0 secure :-1 s=READY pgs=1007 cs=0 l=1 rev1=1 crypto rx=0x7fa0cc00d770 tx=0x7fa0cc00dc30 comp rx=0 tx=0).stop 2024-09-17T05:48:10.027 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:10.024+0000 7fa0d7638640 1 -- 172.21.15.150:0/2943744039 shutdown_connections 2024-09-17T05:48:10.027 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:10.024+0000 7fa0d7638640 1 --2- 172.21.15.150:0/2943744039 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa0d00d0320 0x7fa0d01f5ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:48:10.027 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:10.024+0000 7fa0d7638640 1 --2- 172.21.15.150:0/2943744039 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fa0b4079d30 0x7fa0b407c240 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:48:10.027 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:10.024+0000 7fa0d7638640 1 --2- 172.21.15.150:0/2943744039 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa0d00b9f20 0x7fa0d0152c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:48:10.027 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:10.024+0000 7fa0d7638640 1 --2- 172.21.15.150:0/2943744039 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa0d00b3510 0x7fa0d00cd3c0 unknown :-1 s=CLOSED pgs=1007 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:48:10.028 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:10.024+0000 7fa0d7638640 1 -- 172.21.15.150:0/2943744039 >> 172.21.15.150:0/2943744039 conn(0x7fa0d00d46e0 msgr2=0x7fa0d006dfa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:48:10.028 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:10.024+0000 7fa0d7638640 1 -- 172.21.15.150:0/2943744039 shutdown_connections 2024-09-17T05:48:10.028 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:10.024+0000 7fa0d7638640 1 -- 172.21.15.150:0/2943744039 wait complete. 2024-09-17T05:48:10.039 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-09-17T05:48:10.039 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T05:48:10.156 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:10.154+0000 7f3e1baf2640 1 -- 172.21.15.150:0/239010432 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3dfc004800 msgr2=0x7f3dfc004c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:48:10.156 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:10.154+0000 7f3e1baf2640 1 --2- 172.21.15.150:0/239010432 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3dfc004800 0x7f3dfc004c10 secure :-1 s=READY pgs=1009 cs=0 l=1 rev1=1 crypto rx=0x7f3e0800c310 tx=0x7f3dfc005830 comp rx=0 tx=0).stop 2024-09-17T05:48:10.156 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:10.154+0000 7f3e1baf2640 1 -- 172.21.15.150:0/239010432 shutdown_connections 2024-09-17T05:48:10.156 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:10.154+0000 7f3e1baf2640 1 --2- 172.21.15.150:0/239010432 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3dfc004800 0x7f3dfc004c10 unknown :-1 s=CLOSED pgs=1009 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:48:10.157 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:10.154+0000 7f3e1baf2640 1 -- 172.21.15.150:0/239010432 >> 172.21.15.150:0/239010432 conn(0x7f3e1408bfe0 msgr2=0x7f3e140d4670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:48:10.157 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:10.154+0000 7f3e1baf2640 1 -- 172.21.15.150:0/239010432 shutdown_connections 2024-09-17T05:48:10.157 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:10.154+0000 7f3e1baf2640 1 -- 172.21.15.150:0/239010432 wait complete. 2024-09-17T05:48:10.157 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:10.156+0000 7f3e1baf2640 1 Processor -- start 2024-09-17T05:48:10.157 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:10.156+0000 7f3e1baf2640 1 -- start start 2024-09-17T05:48:10.161 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:10.157+0000 7f3e1baf2640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3dfc004800 0x7f3e1415b340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:48:10.161 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:10.157+0000 7f3e1baf2640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3e141f6960 0x7f3e140b4880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:48:10.161 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:10.157+0000 7f3e1baf2640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3e141f5dd0 0x7f3e141f61e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:48:10.161 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:10.157+0000 7f3e1baf2640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f3e140d0580 con 0x7f3dfc004800 2024-09-17T05:48:10.161 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:10.157+0000 7f3e1baf2640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f3e140d0400 con 0x7f3e141f5dd0 2024-09-17T05:48:10.162 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:10.157+0000 7f3e1baf2640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f3e140d0700 con 0x7f3e141f6960 2024-09-17T05:48:10.162 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:10.157+0000 7f3e1988e640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3dfc004800 0x7f3e1415b340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:48:10.162 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:10.157+0000 7f3e1988e640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3dfc004800 0x7f3e1415b340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:60396/0 (socket says 172.21.15.150:60396) 2024-09-17T05:48:10.162 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:10.157+0000 7f3e1988e640 1 -- 172.21.15.150:0/1554195677 learned_addr learned my addr 172.21.15.150:0/1554195677 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:48:10.162 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:10.157+0000 7f3e1908d640 1 --2- 172.21.15.150:0/1554195677 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3e141f6960 0x7f3e140b4880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:48:10.162 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:10.157+0000 7f3e1a08f640 1 --2- 172.21.15.150:0/1554195677 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3e141f5dd0 0x7f3e141f61e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:48:10.162 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:10.157+0000 7f3e1988e640 1 -- 172.21.15.150:0/1554195677 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3e141f6960 msgr2=0x7f3e140b4880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:48:10.163 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:10.157+0000 7f3e1988e640 1 --2- 172.21.15.150:0/1554195677 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3e141f6960 0x7f3e140b4880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:48:10.163 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:10.157+0000 7f3e1988e640 1 -- 172.21.15.150:0/1554195677 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3e141f5dd0 msgr2=0x7f3e141f61e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:48:10.163 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:10.157+0000 7f3e1988e640 1 --2- 172.21.15.150:0/1554195677 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3e141f5dd0 0x7f3e141f61e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:48:10.164 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:10.157+0000 7f3e1988e640 1 -- 172.21.15.150:0/1554195677 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3e141f6720 con 0x7f3dfc004800 2024-09-17T05:48:10.164 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:10.157+0000 7f3e1908d640 1 --2- 172.21.15.150:0/1554195677 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3e141f6960 0x7f3e140b4880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T05:48:10.164 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:10.157+0000 7f3e1a08f640 1 --2- 172.21.15.150:0/1554195677 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3e141f5dd0 0x7f3e141f61e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T05:48:10.164 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:10.158+0000 7f3e1988e640 1 --2- 172.21.15.150:0/1554195677 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3dfc004800 0x7f3e1415b340 secure :-1 s=READY pgs=1010 cs=0 l=1 rev1=1 crypto rx=0x7f3e0c004d60 tx=0x7f3e0c001630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:48:10.164 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:10.158+0000 7f3e127fc640 1 -- 172.21.15.150:0/1554195677 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e0c017070 con 0x7f3dfc004800 2024-09-17T05:48:10.165 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:10.158+0000 7f3e127fc640 1 -- 172.21.15.150:0/1554195677 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f3e0c004e50 con 0x7f3dfc004800 2024-09-17T05:48:10.165 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:10.158+0000 7f3e1baf2640 1 -- 172.21.15.150:0/1554195677 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3e1415b880 con 0x7f3dfc004800 2024-09-17T05:48:10.165 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:10.158+0000 7f3e127fc640 1 -- 172.21.15.150:0/1554195677 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e0c010b00 con 0x7f3dfc004800 2024-09-17T05:48:10.165 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:10.158+0000 7f3e1baf2640 1 -- 172.21.15.150:0/1554195677 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3e141577c0 con 0x7f3dfc004800 2024-09-17T05:48:10.165 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:10.159+0000 7f3e1baf2640 1 -- 172.21.15.150:0/1554195677 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3e140d11f0 con 0x7f3dfc004800 2024-09-17T05:48:10.166 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:10.160+0000 7f3e127fc640 1 -- 172.21.15.150:0/1554195677 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 25) ==== 103022+0+0 (secure 0 0 0) 0x7f3e0c01a070 con 0x7f3dfc004800 2024-09-17T05:48:10.166 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:10.160+0000 7f3e127fc640 1 --2- 172.21.15.150:0/1554195677 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f3e00079d00 0x7f3e0007c210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:48:10.166 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:10.160+0000 7f3e127fc640 1 -- 172.21.15.150:0/1554195677 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 5793+0+0 (secure 0 0 0) 0x7f3e0c099de0 con 0x7f3dfc004800 2024-09-17T05:48:10.166 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:10.161+0000 7f3e1908d640 1 --2- 172.21.15.150:0/1554195677 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f3e00079d00 0x7f3e0007c210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:48:10.167 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:10.161+0000 7f3e1908d640 1 --2- 172.21.15.150:0/1554195677 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f3e00079d00 0x7f3e0007c210 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f3e08033000 tx=0x7f3e080019f0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:48:10.167 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:10.164+0000 7f3e127fc640 1 -- 172.21.15.150:0/1554195677 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f3e0c021020 con 0x7f3dfc004800 2024-09-17T05:48:10.374 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:10.372+0000 7f3e1baf2640 1 -- 172.21.15.150:0/1554195677 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f3e140d2d60 con 0x7f3dfc004800 2024-09-17T05:48:10.374 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:10.373+0000 7f3e127fc640 1 -- 172.21.15.150:0/1554195677 <== mon.0 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 51 v51) ==== 94+0+5237 (secure 0 0 0) 0x7f3e1415b880 con 0x7f3dfc004800 2024-09-17T05:48:10.375 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-09-17T05:48:10.375 INFO:teuthology.orchestra.run.smithi150.stdout:{"epoch":51,"btime":"2024-09-17T05:48:10:016435+0000","default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5993,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6835/1590564966","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6833","nonce":1590564966},{"type":"v1","addr":"172.21.15.150:6835","nonce":1590564966}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":47},{"gid":6008,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6837/3094459008","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6835","nonce":3094459008},{"type":"v1","addr":"172.21.15.176:6837","nonce":3094459008}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":47},{"gid":6484,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6834/1586974380","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6832","nonce":1586974380},{"type":"v1","addr":"172.21.15.150:6834","nonce":1586974380}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":46}],"filesystems":[{"mdsmap":{"epoch":51,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T05:48:06.348623+0000","modified":"2024-09-17T05:48:09.356798+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6496},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6496":{"gid":6496,"name":"d","rank":0,"incarnation":48,"state":"up:active","state_seq":3,"addr":"172.21.15.176:6836/4093204117","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6834","nonce":4093204117},{"type":"v1","addr":"172.21.15.176:6836","nonce":4093204117}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6496,"qdb_cluster":[6496]},"id":6}]} 2024-09-17T05:48:10.375 INFO:teuthology.orchestra.run.smithi150.stderr:dumped fsmap epoch 51 2024-09-17T05:48:10.377 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:10.375+0000 7f3e1baf2640 1 -- 172.21.15.150:0/1554195677 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f3e00079d00 msgr2=0x7f3e0007c210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:48:10.377 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:10.375+0000 7f3e1baf2640 1 --2- 172.21.15.150:0/1554195677 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f3e00079d00 0x7f3e0007c210 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f3e08033000 tx=0x7f3e080019f0 comp rx=0 tx=0).stop 2024-09-17T05:48:10.377 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:10.375+0000 7f3e1baf2640 1 -- 172.21.15.150:0/1554195677 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3dfc004800 msgr2=0x7f3e1415b340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:48:10.377 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:10.375+0000 7f3e1baf2640 1 --2- 172.21.15.150:0/1554195677 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3dfc004800 0x7f3e1415b340 secure :-1 s=READY pgs=1010 cs=0 l=1 rev1=1 crypto rx=0x7f3e0c004d60 tx=0x7f3e0c001630 comp rx=0 tx=0).stop 2024-09-17T05:48:10.377 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:10.375+0000 7f3e1baf2640 1 -- 172.21.15.150:0/1554195677 shutdown_connections 2024-09-17T05:48:10.377 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:10.375+0000 7f3e1baf2640 1 --2- 172.21.15.150:0/1554195677 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3e141f5dd0 0x7f3e141f61e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:48:10.377 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:10.375+0000 7f3e1baf2640 1 --2- 172.21.15.150:0/1554195677 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f3e00079d00 0x7f3e0007c210 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:48:10.377 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:10.375+0000 7f3e1baf2640 1 --2- 172.21.15.150:0/1554195677 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3e141f6960 0x7f3e140b4880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:48:10.377 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:10.375+0000 7f3e1baf2640 1 --2- 172.21.15.150:0/1554195677 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3dfc004800 0x7f3e1415b340 unknown :-1 s=CLOSED pgs=1010 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:48:10.378 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:10.375+0000 7f3e1baf2640 1 -- 172.21.15.150:0/1554195677 >> 172.21.15.150:0/1554195677 conn(0x7f3e1408bfe0 msgr2=0x7f3e140b5460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:48:10.378 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:10.375+0000 7f3e1baf2640 1 -- 172.21.15.150:0/1554195677 shutdown_connections 2024-09-17T05:48:10.378 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:10.375+0000 7f3e1baf2640 1 -- 172.21.15.150:0/1554195677 wait complete. 2024-09-17T05:48:10.389 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T05:48:10.502 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:10.500+0000 7f4274684640 1 -- 172.21.15.150:0/2981155295 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f426c0b5d50 msgr2=0x7f426c0d2780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:48:10.502 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:10.500+0000 7f4274684640 1 --2- 172.21.15.150:0/2981155295 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f426c0b5d50 0x7f426c0d2780 secure :-1 s=READY pgs=1011 cs=0 l=1 rev1=1 crypto rx=0x7f425c005fd0 tx=0x7f425c02aa90 comp rx=0 tx=0).stop 2024-09-17T05:48:10.502 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:10.500+0000 7f4274684640 1 -- 172.21.15.150:0/2981155295 shutdown_connections 2024-09-17T05:48:10.502 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:10.500+0000 7f4274684640 1 --2- 172.21.15.150:0/2981155295 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f426c0d4f90 0x7f426c0d0400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:48:10.503 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:10.500+0000 7f4274684640 1 --2- 172.21.15.150:0/2981155295 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f426c0b5d50 0x7f426c0d2780 unknown :-1 s=CLOSED pgs=1011 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:48:10.503 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:10.500+0000 7f4274684640 1 -- 172.21.15.150:0/2981155295 >> 172.21.15.150:0/2981155295 conn(0x7f426c08bfe0 msgr2=0x7f426c0d4670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:48:10.503 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:10.500+0000 7f4274684640 1 -- 172.21.15.150:0/2981155295 shutdown_connections 2024-09-17T05:48:10.503 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:10.500+0000 7f4274684640 1 -- 172.21.15.150:0/2981155295 wait complete. 2024-09-17T05:48:10.503 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:10.502+0000 7f4274684640 1 Processor -- start 2024-09-17T05:48:10.504 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:10.502+0000 7f4274684640 1 -- start start 2024-09-17T05:48:10.506 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:10.503+0000 7f4274684640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f426c0b5d50 0x7f426c0b4d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:48:10.507 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:10.503+0000 7f4274684640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f426c0d1080 0x7f426c09e3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:48:10.507 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:10.503+0000 7f4274684640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f426c0d4f90 0x7f426c1f9800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:48:10.507 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:10.503+0000 7f4274684640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f426c0b7b50 con 0x7f426c0b5d50 2024-09-17T05:48:10.507 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:10.503+0000 7f4274684640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f426c0b79d0 con 0x7f426c0d4f90 2024-09-17T05:48:10.507 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:10.503+0000 7f4274684640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f426c0b7cd0 con 0x7f426c0d1080 2024-09-17T05:48:10.507 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:10.503+0000 7f4272420640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f426c0b5d50 0x7f426c0b4d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:48:10.507 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:10.503+0000 7f4272420640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f426c0b5d50 0x7f426c0b4d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:34144/0 (socket says 172.21.15.150:34144) 2024-09-17T05:48:10.507 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:10.504+0000 7f4272420640 1 -- 172.21.15.150:0/1184707621 learned_addr learned my addr 172.21.15.150:0/1184707621 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:48:10.507 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:10.504+0000 7f4272c21640 1 --2- 172.21.15.150:0/1184707621 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f426c0d4f90 0x7f426c1f9800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:48:10.508 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:10.504+0000 7f4271c1f640 1 --2- 172.21.15.150:0/1184707621 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f426c0d1080 0x7f426c09e3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:48:10.508 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:10.504+0000 7f4272420640 1 -- 172.21.15.150:0/1184707621 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f426c0d1080 msgr2=0x7f426c09e3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:48:10.508 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:10.504+0000 7f4272420640 1 --2- 172.21.15.150:0/1184707621 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f426c0d1080 0x7f426c09e3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:48:10.508 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:10.504+0000 7f4272420640 1 -- 172.21.15.150:0/1184707621 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f426c0d4f90 msgr2=0x7f426c1f9800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:48:10.508 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:10.504+0000 7f4272420640 1 --2- 172.21.15.150:0/1184707621 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f426c0d4f90 0x7f426c1f9800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:48:10.508 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:10.504+0000 7f4272420640 1 -- 172.21.15.150:0/1184707621 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f426c0a0fa0 con 0x7f426c0b5d50 2024-09-17T05:48:10.508 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:10.504+0000 7f4272420640 1 --2- 172.21.15.150:0/1184707621 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f426c0b5d50 0x7f426c0b4d30 secure :-1 s=READY pgs=1012 cs=0 l=1 rev1=1 crypto rx=0x7f425c000f80 tx=0x7f425c003f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:48:10.508 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:10.504+0000 7f426affd640 1 -- 172.21.15.150:0/1184707621 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f425c044070 con 0x7f426c0b5d50 2024-09-17T05:48:10.508 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:10.504+0000 7f426affd640 1 -- 172.21.15.150:0/1184707621 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f425c004250 con 0x7f426c0b5d50 2024-09-17T05:48:10.508 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:10.504+0000 7f4274684640 1 -- 172.21.15.150:0/1184707621 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f426c0a1410 con 0x7f426c0b5d50 2024-09-17T05:48:10.508 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:10.504+0000 7f426affd640 1 -- 172.21.15.150:0/1184707621 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f425c004660 con 0x7f426c0b5d50 2024-09-17T05:48:10.508 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:10.504+0000 7f4274684640 1 -- 172.21.15.150:0/1184707621 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f426c0a19d0 con 0x7f426c0b5d50 2024-09-17T05:48:10.509 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:10.505+0000 7f4274684640 1 -- 172.21.15.150:0/1184707621 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f426c1622b0 con 0x7f426c0b5d50 2024-09-17T05:48:10.509 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:10.506+0000 7f426affd640 1 -- 172.21.15.150:0/1184707621 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 25) ==== 103022+0+0 (secure 0 0 0) 0x7f425c047070 con 0x7f426c0b5d50 2024-09-17T05:48:10.509 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:10.507+0000 7f426affd640 1 --2- 172.21.15.150:0/1184707621 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f4258079d00 0x7f425807c210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:48:10.510 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:10.507+0000 7f426affd640 1 -- 172.21.15.150:0/1184707621 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 5793+0+0 (secure 0 0 0) 0x7f425c0ba880 con 0x7f426c0b5d50 2024-09-17T05:48:10.510 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:10.507+0000 7f4271c1f640 1 --2- 172.21.15.150:0/1184707621 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f4258079d00 0x7f425807c210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:48:10.510 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:10.507+0000 7f4271c1f640 1 --2- 172.21.15.150:0/1184707621 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f4258079d00 0x7f425807c210 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f426c159ef0 tx=0x7f426000b2e0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:48:10.513 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:10.511+0000 7f426affd640 1 -- 172.21.15.150:0/1184707621 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f426c1622b0 con 0x7f426c0b5d50 2024-09-17T05:48:10.689 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:10.687+0000 7f4274684640 1 -- 172.21.15.150:0/1184707621 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f426c0cef10 con 0x7f426c0b5d50 2024-09-17T05:48:10.690 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:10.689+0000 7f426affd640 1 -- 172.21.15.150:0/1184707621 <== mon.0 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v86) ==== 74+0+16888 (secure 0 0 0) 0x7f426c0cef10 con 0x7f426c0b5d50 2024-09-17T05:48:10.690 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-09-17T05:48:10.691 INFO:teuthology.orchestra.run.smithi150.stdout:{"epoch":86,"fsid":"9f2e05e9-d629-47b3-b26b-1360655b7d20","created":"2024-09-17T05:41:32.502979+0000","modified":"2024-09-17T05:48:07.989015+0000","last_up_change":"2024-09-17T05:41:46.150225+0000","last_in_change":"2024-09-17T05:41:36.120274+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":13,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T05:41:46.860779+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_metadata","create_time":"2024-09-17T05:48:03.989113+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_data","create_time":"2024-09-17T05:48:05.314806+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"86","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"4f31c018-c8a4-4d6d-b0c2-a597c47aae4a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6800","nonce":479374392},{"type":"v1","addr":"172.21.15.150:6801","nonce":479374392}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6802","nonce":479374392},{"type":"v1","addr":"172.21.15.150:6803","nonce":479374392}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6806","nonce":479374392},{"type":"v1","addr":"172.21.15.150:6807","nonce":479374392}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6804","nonce":479374392},{"type":"v1","addr":"172.21.15.150:6805","nonce":479374392}]},"public_addr":"172.21.15.150:6801/479374392","cluster_addr":"172.21.15.150:6803/479374392","heartbeat_back_addr":"172.21.15.150:6807/479374392","heartbeat_front_addr":"172.21.15.150:6805/479374392","state":["exists","up"]},{"osd":1,"uuid":"6ff4a573-500b-4e04-9de3-39265ead78b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6824","nonce":913899800},{"type":"v1","addr":"172.21.15.150:6825","nonce":913899800}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6826","nonce":913899800},{"type":"v1","addr":"172.21.15.150:6827","nonce":913899800}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6830","nonce":913899800},{"type":"v1","addr":"172.21.15.150:6831","nonce":913899800}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6828","nonce":913899800},{"type":"v1","addr":"172.21.15.150:6829","nonce":913899800}]},"public_addr":"172.21.15.150:6825/913899800","cluster_addr":"172.21.15.150:6827/913899800","heartbeat_back_addr":"172.21.15.150:6831/913899800","heartbeat_front_addr":"172.21.15.150:6829/913899800","state":["exists","up"]},{"osd":2,"uuid":"bffea6f9-2465-4182-b205-00436c41ac1c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6816","nonce":363718461},{"type":"v1","addr":"172.21.15.150:6817","nonce":363718461}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6818","nonce":363718461},{"type":"v1","addr":"172.21.15.150:6819","nonce":363718461}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6822","nonce":363718461},{"type":"v1","addr":"172.21.15.150:6823","nonce":363718461}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6820","nonce":363718461},{"type":"v1","addr":"172.21.15.150:6821","nonce":363718461}]},"public_addr":"172.21.15.150:6817/363718461","cluster_addr":"172.21.15.150:6819/363718461","heartbeat_back_addr":"172.21.15.150:6823/363718461","heartbeat_front_addr":"172.21.15.150:6821/363718461","state":["exists","up"]},{"osd":3,"uuid":"cda70430-d1e1-427e-b04e-56db4031d078","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6808","nonce":3550994626},{"type":"v1","addr":"172.21.15.150:6809","nonce":3550994626}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6810","nonce":3550994626},{"type":"v1","addr":"172.21.15.150:6811","nonce":3550994626}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6814","nonce":3550994626},{"type":"v1","addr":"172.21.15.150:6815","nonce":3550994626}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6812","nonce":3550994626},{"type":"v1","addr":"172.21.15.150:6813","nonce":3550994626}]},"public_addr":"172.21.15.150:6809/3550994626","cluster_addr":"172.21.15.150:6811/3550994626","heartbeat_back_addr":"172.21.15.150:6815/3550994626","heartbeat_front_addr":"172.21.15.150:6813/3550994626","state":["exists","up"]},{"osd":4,"uuid":"3a0277fb-5e1e-4f68-bb2d-9a8a0152f64a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6810","nonce":2718261497},{"type":"v1","addr":"172.21.15.176:6811","nonce":2718261497}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6812","nonce":2718261497},{"type":"v1","addr":"172.21.15.176:6813","nonce":2718261497}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6816","nonce":2718261497},{"type":"v1","addr":"172.21.15.176:6817","nonce":2718261497}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6814","nonce":2718261497},{"type":"v1","addr":"172.21.15.176:6815","nonce":2718261497}]},"public_addr":"172.21.15.176:6811/2718261497","cluster_addr":"172.21.15.176:6813/2718261497","heartbeat_back_addr":"172.21.15.176:6817/2718261497","heartbeat_front_addr":"172.21.15.176:6815/2718261497","state":["exists","up"]},{"osd":5,"uuid":"33aebee6-0315-40b7-a11c-6702f0be494d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6818","nonce":2049295774},{"type":"v1","addr":"172.21.15.176:6819","nonce":2049295774}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6820","nonce":2049295774},{"type":"v1","addr":"172.21.15.176:6821","nonce":2049295774}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6824","nonce":2049295774},{"type":"v1","addr":"172.21.15.176:6825","nonce":2049295774}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6822","nonce":2049295774},{"type":"v1","addr":"172.21.15.176:6823","nonce":2049295774}]},"public_addr":"172.21.15.176:6819/2049295774","cluster_addr":"172.21.15.176:6821/2049295774","heartbeat_back_addr":"172.21.15.176:6825/2049295774","heartbeat_front_addr":"172.21.15.176:6823/2049295774","state":["exists","up"]},{"osd":6,"uuid":"4d24f360-6751-4263-841b-d77793d33540","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6826","nonce":2164458476},{"type":"v1","addr":"172.21.15.176:6827","nonce":2164458476}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6828","nonce":2164458476},{"type":"v1","addr":"172.21.15.176:6829","nonce":2164458476}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6832","nonce":2164458476},{"type":"v1","addr":"172.21.15.176:6833","nonce":2164458476}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6830","nonce":2164458476},{"type":"v1","addr":"172.21.15.176:6831","nonce":2164458476}]},"public_addr":"172.21.15.176:6827/2164458476","cluster_addr":"172.21.15.176:6829/2164458476","heartbeat_back_addr":"172.21.15.176:6833/2164458476","heartbeat_front_addr":"172.21.15.176:6831/2164458476","state":["exists","up"]},{"osd":7,"uuid":"c8594fda-c74a-4ba9-8277-caf101d58ca1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6802","nonce":3239587708},{"type":"v1","addr":"172.21.15.176:6803","nonce":3239587708}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6804","nonce":3239587708},{"type":"v1","addr":"172.21.15.176:6805","nonce":3239587708}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6808","nonce":3239587708},{"type":"v1","addr":"172.21.15.176:6809","nonce":3239587708}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6806","nonce":3239587708},{"type":"v1","addr":"172.21.15.176:6807","nonce":3239587708}]},"public_addr":"172.21.15.176:6803/3239587708","cluster_addr":"172.21.15.176:6805/3239587708","heartbeat_back_addr":"172.21.15.176:6809/3239587708","heartbeat_front_addr":"172.21.15.176:6807/3239587708","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:41:41.905151+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:41:42.705679+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:41:42.459673+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:41:42.440819+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:41:42.668428+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:41:42.694972+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:41:43.078535+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:41:42.363539+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":7,"snaps":[{"begin":2,"length":2}]},{"pool":9,"snaps":[{"begin":2,"length":2}]},{"pool":11,"snaps":[{"begin":2,"length":2}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T05:48:10.692 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:10.691+0000 7f4274684640 1 -- 172.21.15.150:0/1184707621 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f4258079d00 msgr2=0x7f425807c210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:48:10.693 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:10.691+0000 7f4274684640 1 --2- 172.21.15.150:0/1184707621 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f4258079d00 0x7f425807c210 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f426c159ef0 tx=0x7f426000b2e0 comp rx=0 tx=0).stop 2024-09-17T05:48:10.693 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:10.691+0000 7f4274684640 1 -- 172.21.15.150:0/1184707621 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f426c0b5d50 msgr2=0x7f426c0b4d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:48:10.693 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:10.691+0000 7f4274684640 1 --2- 172.21.15.150:0/1184707621 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f426c0b5d50 0x7f426c0b4d30 secure :-1 s=READY pgs=1012 cs=0 l=1 rev1=1 crypto rx=0x7f425c000f80 tx=0x7f425c003f10 comp rx=0 tx=0).stop 2024-09-17T05:48:10.693 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:10.691+0000 7f4274684640 1 -- 172.21.15.150:0/1184707621 shutdown_connections 2024-09-17T05:48:10.693 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:10.691+0000 7f4274684640 1 --2- 172.21.15.150:0/1184707621 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f426c0d4f90 0x7f426c1f9800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:48:10.693 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:10.691+0000 7f4274684640 1 --2- 172.21.15.150:0/1184707621 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f4258079d00 0x7f425807c210 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:48:10.693 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:10.691+0000 7f4274684640 1 --2- 172.21.15.150:0/1184707621 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f426c0d1080 0x7f426c09e3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:48:10.693 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:10.691+0000 7f4274684640 1 --2- 172.21.15.150:0/1184707621 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f426c0b5d50 0x7f426c0b4d30 unknown :-1 s=CLOSED pgs=1012 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:48:10.693 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:10.691+0000 7f4274684640 1 -- 172.21.15.150:0/1184707621 >> 172.21.15.150:0/1184707621 conn(0x7f426c08bfe0 msgr2=0x7f426c06f540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:48:10.693 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:10.691+0000 7f4274684640 1 -- 172.21.15.150:0/1184707621 shutdown_connections 2024-09-17T05:48:10.693 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:10.691+0000 7f4274684640 1 -- 172.21.15.150:0/1184707621 wait complete. 2024-09-17T05:48:10.705 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-17T05:48:10.705 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-17T05:48:10.819 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:10.817+0000 7f825c939640 1 -- 172.21.15.150:0/1439945975 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f82580cd040 msgr2=0x7f82581528b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:48:10.819 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:10.817+0000 7f825c939640 1 --2- 172.21.15.150:0/1439945975 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f82580cd040 0x7f82581528b0 secure :-1 s=READY pgs=1014 cs=0 l=1 rev1=1 crypto rx=0x7f82580b07c0 tx=0x7f824802a8b0 comp rx=0 tx=0).stop 2024-09-17T05:48:10.819 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:10.817+0000 7f825c939640 1 -- 172.21.15.150:0/1439945975 shutdown_connections 2024-09-17T05:48:10.819 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:10.817+0000 7f825c939640 1 --2- 172.21.15.150:0/1439945975 >> v2:172.21.15.176:3300/0 conn(0x7f825815fe50 0x7f82580705b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:48:10.819 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:10.817+0000 7f825c939640 1 --2- 172.21.15.150:0/1439945975 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f82580cd040 0x7f82581528b0 unknown :-1 s=CLOSED pgs=1014 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:48:10.819 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:10.817+0000 7f825c939640 1 -- 172.21.15.150:0/1439945975 >> 172.21.15.150:0/1439945975 conn(0x7f82580d0b50 msgr2=0x7f82580d0f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:48:10.820 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:10.817+0000 7f825c939640 1 -- 172.21.15.150:0/1439945975 shutdown_connections 2024-09-17T05:48:10.820 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:10.817+0000 7f825c939640 1 -- 172.21.15.150:0/1439945975 wait complete. 2024-09-17T05:48:10.820 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:10.819+0000 7f825c939640 1 Processor -- start 2024-09-17T05:48:10.820 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:10.819+0000 7f825c939640 1 -- start start 2024-09-17T05:48:10.823 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:10.820+0000 7f825c939640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f82580cd040 0x7f8258155d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:48:10.823 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:10.820+0000 7f825c939640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f825815f330 0x7f82581f3ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:48:10.823 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:10.820+0000 7f825c939640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f825815fe50 0x7f82580b47b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:48:10.823 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:10.820+0000 7f825c939640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f82580710d0 con 0x7f825815fe50 2024-09-17T05:48:10.824 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:10.820+0000 7f825c939640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f8258070f50 con 0x7f825815f330 2024-09-17T05:48:10.824 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:10.820+0000 7f825c939640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f8258071250 con 0x7f82580cd040 2024-09-17T05:48:10.824 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:10.820+0000 7f8256d9d640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f825815fe50 0x7f82580b47b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:48:10.824 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:10.820+0000 7f8256d9d640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f825815fe50 0x7f82580b47b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:34154/0 (socket says 172.21.15.150:34154) 2024-09-17T05:48:10.824 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:10.820+0000 7f8256d9d640 1 -- 172.21.15.150:0/1251700283 learned_addr learned my addr 172.21.15.150:0/1251700283 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:48:10.824 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:10.820+0000 7f825659c640 1 --2- 172.21.15.150:0/1251700283 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f82580cd040 0x7f8258155d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:48:10.824 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:10.820+0000 7f8255d9b640 1 --2- 172.21.15.150:0/1251700283 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f825815f330 0x7f82581f3ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:48:10.824 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:10.821+0000 7f8256d9d640 1 -- 172.21.15.150:0/1251700283 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f82580cd040 msgr2=0x7f8258155d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:48:10.824 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:10.821+0000 7f8256d9d640 1 --2- 172.21.15.150:0/1251700283 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f82580cd040 0x7f8258155d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:48:10.824 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:10.821+0000 7f8256d9d640 1 -- 172.21.15.150:0/1251700283 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f825815f330 msgr2=0x7f82581f3ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:48:10.824 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:10.821+0000 7f8256d9d640 1 --2- 172.21.15.150:0/1251700283 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f825815f330 0x7f82581f3ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:48:10.824 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:10.821+0000 7f8256d9d640 1 -- 172.21.15.150:0/1251700283 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8258153090 con 0x7f825815fe50 2024-09-17T05:48:10.824 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:10.821+0000 7f8256d9d640 1 --2- 172.21.15.150:0/1251700283 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f825815fe50 0x7f82580b47b0 secure :-1 s=READY pgs=1015 cs=0 l=1 rev1=1 crypto rx=0x7f825000c9a0 tx=0x7f825000ce60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:48:10.825 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:10.821+0000 7f824effd640 1 -- 172.21.15.150:0/1251700283 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8250007bb0 con 0x7f825815fe50 2024-09-17T05:48:10.825 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:10.821+0000 7f824effd640 1 -- 172.21.15.150:0/1251700283 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f825000f450 con 0x7f825815fe50 2024-09-17T05:48:10.825 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:10.821+0000 7f825c939640 1 -- 172.21.15.150:0/1251700283 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8258153370 con 0x7f825815fe50 2024-09-17T05:48:10.825 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:10.821+0000 7f824effd640 1 -- 172.21.15.150:0/1251700283 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8250007e60 con 0x7f825815fe50 2024-09-17T05:48:10.825 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:10.821+0000 7f825c939640 1 -- 172.21.15.150:0/1251700283 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8258153930 con 0x7f825815fe50 2024-09-17T05:48:10.826 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:10.822+0000 7f825c939640 1 -- 172.21.15.150:0/1251700283 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f82581f4420 con 0x7f825815fe50 2024-09-17T05:48:10.826 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:10.823+0000 7f824effd640 1 -- 172.21.15.150:0/1251700283 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 25) ==== 103022+0+0 (secure 0 0 0) 0x7f825000f8a0 con 0x7f825815fe50 2024-09-17T05:48:10.826 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:10.824+0000 7f824effd640 1 --2- 172.21.15.150:0/1251700283 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f8238079d00 0x7f823807c210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:48:10.826 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:10.824+0000 7f824effd640 1 -- 172.21.15.150:0/1251700283 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 5793+0+0 (secure 0 0 0) 0x7f825009a210 con 0x7f825815fe50 2024-09-17T05:48:10.826 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:10.824+0000 7f825659c640 1 --2- 172.21.15.150:0/1251700283 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f8238079d00 0x7f823807c210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:48:10.826 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:10.825+0000 7f825659c640 1 --2- 172.21.15.150:0/1251700283 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f8238079d00 0x7f823807c210 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f8248034000 tx=0x7f8248004ab0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:48:10.830 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:10.828+0000 7f824effd640 1 -- 172.21.15.150:0/1251700283 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f8250014030 con 0x7f825815fe50 2024-09-17T05:48:11.003 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:11.002+0000 7f825c939640 1 -- 172.21.15.150:0/1251700283 --> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f8258152e40 con 0x7f8238079d00 2024-09-17T05:48:11.008 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:11.006+0000 7f824effd640 1 -- 172.21.15.150:0/1251700283 <== mgr.4108 v2:172.21.15.176:6800/3631216395 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+249856 (secure 0 0 0) 0x7f8258152e40 con 0x7f8238079d00 2024-09-17T05:48:11.011 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-09-17T05:48:11.012 INFO:teuthology.orchestra.run.smithi150.stderr:dumped all 2024-09-17T05:48:11.014 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:11.009+0000 7f825c939640 1 -- 172.21.15.150:0/1251700283 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f8238079d00 msgr2=0x7f823807c210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:48:11.014 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:11.009+0000 7f825c939640 1 --2- 172.21.15.150:0/1251700283 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f8238079d00 0x7f823807c210 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f8248034000 tx=0x7f8248004ab0 comp rx=0 tx=0).stop 2024-09-17T05:48:11.014 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:11.009+0000 7f825c939640 1 -- 172.21.15.150:0/1251700283 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f825815fe50 msgr2=0x7f82580b47b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:48:11.014 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:11.009+0000 7f825c939640 1 --2- 172.21.15.150:0/1251700283 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f825815fe50 0x7f82580b47b0 secure :-1 s=READY pgs=1015 cs=0 l=1 rev1=1 crypto rx=0x7f825000c9a0 tx=0x7f825000ce60 comp rx=0 tx=0).stop 2024-09-17T05:48:11.014 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:11.009+0000 7f825c939640 1 -- 172.21.15.150:0/1251700283 shutdown_connections 2024-09-17T05:48:11.014 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:11.009+0000 7f825c939640 1 --2- 172.21.15.150:0/1251700283 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f825815f330 0x7f82581f3ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:48:11.014 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:11.009+0000 7f825c939640 1 --2- 172.21.15.150:0/1251700283 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f8238079d00 0x7f823807c210 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:48:11.015 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:11.009+0000 7f825c939640 1 --2- 172.21.15.150:0/1251700283 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f825815fe50 0x7f82580b47b0 unknown :-1 s=CLOSED pgs=1015 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:48:11.015 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:11.009+0000 7f825c939640 1 --2- 172.21.15.150:0/1251700283 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f82580cd040 0x7f8258155d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:48:11.015 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:11.009+0000 7f825c939640 1 -- 172.21.15.150:0/1251700283 >> 172.21.15.150:0/1251700283 conn(0x7f82580d0b50 msgr2=0x7f825814e5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:48:11.015 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:11.010+0000 7f825c939640 1 -- 172.21.15.150:0/1251700283 shutdown_connections 2024-09-17T05:48:11.015 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:11.010+0000 7f825c939640 1 -- 172.21.15.150:0/1251700283 wait complete. 2024-09-17T05:48:11.023 INFO:teuthology.orchestra.run.smithi150.stdout:{"pg_ready":true,"pg_map":{"version":273,"stamp":"2024-09-17T05:48:10.964995+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":591096,"num_objects":18,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":138,"num_write_kb":1638,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":12,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":100,"ondisk_log_size":100,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":65,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":455720,"kb_used_data":9200,"kb_used_omap":12,"kb_used_meta":446323,"kb_avail":754519000,"statfs":{"total":773094113280,"available":772627456000,"internally_reserved":0,"allocated":9420800,"data_stored":4676910,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":457035312},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":16,"apply_latency_ms":16,"commit_latency_ns":16000000,"apply_latency_ns":16000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":728,"num_objects":16,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":37,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":12,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.990092"},"pg_stats":[{"pgid":"13.3f","version":"0'0","reported_seq":10,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T05:48:07.021662+0000","last_change":"2024-09-17T05:48:07.019629+0000","last_active":"2024-09-17T05:48:07.021662+0000","last_peered":"2024-09-17T05:48:07.021662+0000","last_clean":"2024-09-17T05:48:07.021662+0000","last_became_active":"2024-09-17T05:48:07.019293+0000","last_became_peered":"2024-09-17T05:48:07.019293+0000","last_unstale":"2024-09-17T05:48:07.021662+0000","last_undegraded":"2024-09-17T05:48:07.021662+0000","last_fullsized":"2024-09-17T05:48:07.021662+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:48:05.973792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:48:05.973792+0000","last_clean_scrub_stamp":"2024-09-17T05:48:05.973792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:25:55.495958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.3e","version":"0'0","reported_seq":10,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T05:48:07.009336+0000","last_change":"2024-09-17T05:48:07.008371+0000","last_active":"2024-09-17T05:48:07.009336+0000","last_peered":"2024-09-17T05:48:07.009336+0000","last_clean":"2024-09-17T05:48:07.009336+0000","last_became_active":"2024-09-17T05:48:07.008069+0000","last_became_peered":"2024-09-17T05:48:07.008069+0000","last_unstale":"2024-09-17T05:48:07.009336+0000","last_undegraded":"2024-09-17T05:48:07.009336+0000","last_fullsized":"2024-09-17T05:48:07.009336+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:48:05.973792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:48:05.973792+0000","last_clean_scrub_stamp":"2024-09-17T05:48:05.973792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:17:03.542296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.3d","version":"0'0","reported_seq":1,"reported_epoch":84,"state":"creating+peering","last_fresh":"2024-09-17T05:48:05.981187+0000","last_change":"2024-09-17T05:48:05.981187+0000","last_active":"2024-09-17T05:48:05.973792+0000","last_peered":"2024-09-17T05:48:05.973792+0000","last_clean":"2024-09-17T05:48:05.973792+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:48:05.981187+0000","last_undegraded":"2024-09-17T05:48:05.981187+0000","last_fullsized":"2024-09-17T05:48:05.981187+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:48:05.973792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:48:05.973792+0000","last_clean_scrub_stamp":"2024-09-17T05:48:05.973792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.3c","version":"0'0","reported_seq":10,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T05:48:06.998187+0000","last_change":"2024-09-17T05:48:06.997015+0000","last_active":"2024-09-17T05:48:06.998187+0000","last_peered":"2024-09-17T05:48:06.998187+0000","last_clean":"2024-09-17T05:48:06.998187+0000","last_became_active":"2024-09-17T05:48:06.996664+0000","last_became_peered":"2024-09-17T05:48:06.996664+0000","last_unstale":"2024-09-17T05:48:06.998187+0000","last_undegraded":"2024-09-17T05:48:06.998187+0000","last_fullsized":"2024-09-17T05:48:06.998187+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:48:05.973792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:48:05.973792+0000","last_clean_scrub_stamp":"2024-09-17T05:48:05.973792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:29:24.565960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.3b","version":"0'0","reported_seq":1,"reported_epoch":84,"state":"creating+peering","last_fresh":"2024-09-17T05:48:05.990716+0000","last_change":"2024-09-17T05:48:05.990716+0000","last_active":"2024-09-17T05:48:05.973792+0000","last_peered":"2024-09-17T05:48:05.973792+0000","last_clean":"2024-09-17T05:48:05.973792+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:48:05.990716+0000","last_undegraded":"2024-09-17T05:48:05.990716+0000","last_fullsized":"2024-09-17T05:48:05.990716+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:48:05.973792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:48:05.973792+0000","last_clean_scrub_stamp":"2024-09-17T05:48:05.973792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.3a","version":"0'0","reported_seq":1,"reported_epoch":84,"state":"creating+peering","last_fresh":"2024-09-17T05:48:05.986085+0000","last_change":"2024-09-17T05:48:05.986085+0000","last_active":"2024-09-17T05:48:05.973792+0000","last_peered":"2024-09-17T05:48:05.973792+0000","last_clean":"2024-09-17T05:48:05.973792+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:48:05.986085+0000","last_undegraded":"2024-09-17T05:48:05.986085+0000","last_fullsized":"2024-09-17T05:48:05.986085+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:48:05.973792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:48:05.973792+0000","last_clean_scrub_stamp":"2024-09-17T05:48:05.973792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.39","version":"0'0","reported_seq":10,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T05:48:07.007609+0000","last_change":"2024-09-17T05:48:07.004879+0000","last_active":"2024-09-17T05:48:07.007609+0000","last_peered":"2024-09-17T05:48:07.007609+0000","last_clean":"2024-09-17T05:48:07.007609+0000","last_became_active":"2024-09-17T05:48:07.004432+0000","last_became_peered":"2024-09-17T05:48:07.004432+0000","last_unstale":"2024-09-17T05:48:07.007609+0000","last_undegraded":"2024-09-17T05:48:07.007609+0000","last_fullsized":"2024-09-17T05:48:07.007609+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:48:05.973792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:48:05.973792+0000","last_clean_scrub_stamp":"2024-09-17T05:48:05.973792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:41:11.072932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.38","version":"0'0","reported_seq":1,"reported_epoch":84,"state":"creating+peering","last_fresh":"2024-09-17T05:48:05.984329+0000","last_change":"2024-09-17T05:48:05.984329+0000","last_active":"2024-09-17T05:48:05.973792+0000","last_peered":"2024-09-17T05:48:05.973792+0000","last_clean":"2024-09-17T05:48:05.973792+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:48:05.984329+0000","last_undegraded":"2024-09-17T05:48:05.984329+0000","last_fullsized":"2024-09-17T05:48:05.984329+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:48:05.973792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:48:05.973792+0000","last_clean_scrub_stamp":"2024-09-17T05:48:05.973792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.37","version":"0'0","reported_seq":1,"reported_epoch":84,"state":"creating+peering","last_fresh":"2024-09-17T05:48:05.986183+0000","last_change":"2024-09-17T05:48:05.986183+0000","last_active":"2024-09-17T05:48:05.973792+0000","last_peered":"2024-09-17T05:48:05.973792+0000","last_clean":"2024-09-17T05:48:05.973792+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:48:05.986183+0000","last_undegraded":"2024-09-17T05:48:05.986183+0000","last_fullsized":"2024-09-17T05:48:05.986183+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:48:05.973792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:48:05.973792+0000","last_clean_scrub_stamp":"2024-09-17T05:48:05.973792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.36","version":"0'0","reported_seq":10,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T05:48:07.008314+0000","last_change":"2024-09-17T05:48:07.006474+0000","last_active":"2024-09-17T05:48:07.008314+0000","last_peered":"2024-09-17T05:48:07.008314+0000","last_clean":"2024-09-17T05:48:07.008314+0000","last_became_active":"2024-09-17T05:48:07.006080+0000","last_became_peered":"2024-09-17T05:48:07.006080+0000","last_unstale":"2024-09-17T05:48:07.008314+0000","last_undegraded":"2024-09-17T05:48:07.008314+0000","last_fullsized":"2024-09-17T05:48:07.008314+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:48:05.973792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:48:05.973792+0000","last_clean_scrub_stamp":"2024-09-17T05:48:05.973792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:11:43.970133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.35","version":"0'0","reported_seq":10,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T05:48:07.009233+0000","last_change":"2024-09-17T05:48:07.007493+0000","last_active":"2024-09-17T05:48:07.009233+0000","last_peered":"2024-09-17T05:48:07.009233+0000","last_clean":"2024-09-17T05:48:07.009233+0000","last_became_active":"2024-09-17T05:48:07.007110+0000","last_became_peered":"2024-09-17T05:48:07.007110+0000","last_unstale":"2024-09-17T05:48:07.009233+0000","last_undegraded":"2024-09-17T05:48:07.009233+0000","last_fullsized":"2024-09-17T05:48:07.009233+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:48:05.973792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:48:05.973792+0000","last_clean_scrub_stamp":"2024-09-17T05:48:05.973792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:02:09.211126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.34","version":"0'0","reported_seq":10,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T05:48:07.016908+0000","last_change":"2024-09-17T05:48:07.010311+0000","last_active":"2024-09-17T05:48:07.016908+0000","last_peered":"2024-09-17T05:48:07.016908+0000","last_clean":"2024-09-17T05:48:07.016908+0000","last_became_active":"2024-09-17T05:48:07.008909+0000","last_became_peered":"2024-09-17T05:48:07.008909+0000","last_unstale":"2024-09-17T05:48:07.016908+0000","last_undegraded":"2024-09-17T05:48:07.016908+0000","last_fullsized":"2024-09-17T05:48:07.016908+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:48:05.973792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:48:05.973792+0000","last_clean_scrub_stamp":"2024-09-17T05:48:05.973792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:45:16.917183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.33","version":"0'0","reported_seq":1,"reported_epoch":84,"state":"creating+peering","last_fresh":"2024-09-17T05:48:05.980666+0000","last_change":"2024-09-17T05:48:05.980666+0000","last_active":"2024-09-17T05:48:05.973792+0000","last_peered":"2024-09-17T05:48:05.973792+0000","last_clean":"2024-09-17T05:48:05.973792+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:48:05.980666+0000","last_undegraded":"2024-09-17T05:48:05.980666+0000","last_fullsized":"2024-09-17T05:48:05.980666+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:48:05.973792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:48:05.973792+0000","last_clean_scrub_stamp":"2024-09-17T05:48:05.973792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.32","version":"0'0","reported_seq":10,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T05:48:07.004126+0000","last_change":"2024-09-17T05:48:06.999966+0000","last_active":"2024-09-17T05:48:07.004126+0000","last_peered":"2024-09-17T05:48:07.004126+0000","last_clean":"2024-09-17T05:48:07.004126+0000","last_became_active":"2024-09-17T05:48:06.999522+0000","last_became_peered":"2024-09-17T05:48:06.999522+0000","last_unstale":"2024-09-17T05:48:07.004126+0000","last_undegraded":"2024-09-17T05:48:07.004126+0000","last_fullsized":"2024-09-17T05:48:07.004126+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:48:05.973792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:48:05.973792+0000","last_clean_scrub_stamp":"2024-09-17T05:48:05.973792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:56:39.787601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.31","version":"0'0","reported_seq":10,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T05:48:07.008515+0000","last_change":"2024-09-17T05:48:07.006783+0000","last_active":"2024-09-17T05:48:07.008515+0000","last_peered":"2024-09-17T05:48:07.008515+0000","last_clean":"2024-09-17T05:48:07.008515+0000","last_became_active":"2024-09-17T05:48:07.006179+0000","last_became_peered":"2024-09-17T05:48:07.006179+0000","last_unstale":"2024-09-17T05:48:07.008515+0000","last_undegraded":"2024-09-17T05:48:07.008515+0000","last_fullsized":"2024-09-17T05:48:07.008515+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:48:05.973792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:48:05.973792+0000","last_clean_scrub_stamp":"2024-09-17T05:48:05.973792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:25:14.968274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.30","version":"0'0","reported_seq":1,"reported_epoch":84,"state":"creating+peering","last_fresh":"2024-09-17T05:48:05.986337+0000","last_change":"2024-09-17T05:48:05.986337+0000","last_active":"2024-09-17T05:48:05.973792+0000","last_peered":"2024-09-17T05:48:05.973792+0000","last_clean":"2024-09-17T05:48:05.973792+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:48:05.986337+0000","last_undegraded":"2024-09-17T05:48:05.986337+0000","last_fullsized":"2024-09-17T05:48:05.986337+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:48:05.973792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:48:05.973792+0000","last_clean_scrub_stamp":"2024-09-17T05:48:05.973792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.2f","version":"0'0","reported_seq":1,"reported_epoch":84,"state":"creating+peering","last_fresh":"2024-09-17T05:48:05.983346+0000","last_change":"2024-09-17T05:48:05.983346+0000","last_active":"2024-09-17T05:48:05.973792+0000","last_peered":"2024-09-17T05:48:05.973792+0000","last_clean":"2024-09-17T05:48:05.973792+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:48:05.983346+0000","last_undegraded":"2024-09-17T05:48:05.983346+0000","last_fullsized":"2024-09-17T05:48:05.983346+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:48:05.973792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:48:05.973792+0000","last_clean_scrub_stamp":"2024-09-17T05:48:05.973792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.2e","version":"0'0","reported_seq":10,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T05:48:07.013532+0000","last_change":"2024-09-17T05:48:07.012645+0000","last_active":"2024-09-17T05:48:07.013532+0000","last_peered":"2024-09-17T05:48:07.013532+0000","last_clean":"2024-09-17T05:48:07.013532+0000","last_became_active":"2024-09-17T05:48:07.012337+0000","last_became_peered":"2024-09-17T05:48:07.012337+0000","last_unstale":"2024-09-17T05:48:07.013532+0000","last_undegraded":"2024-09-17T05:48:07.013532+0000","last_fullsized":"2024-09-17T05:48:07.013532+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:48:05.973792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:48:05.973792+0000","last_clean_scrub_stamp":"2024-09-17T05:48:05.973792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:04:39.379785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2d","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-17T05:48:08.017801+0000","last_change":"2024-09-17T05:48:07.003509+0000","last_active":"2024-09-17T05:48:08.017801+0000","last_peered":"2024-09-17T05:48:08.017801+0000","last_clean":"2024-09-17T05:48:08.017801+0000","last_became_active":"2024-09-17T05:48:07.003226+0000","last_became_peered":"2024-09-17T05:48:07.003226+0000","last_unstale":"2024-09-17T05:48:08.017801+0000","last_undegraded":"2024-09-17T05:48:08.017801+0000","last_fullsized":"2024-09-17T05:48:08.017801+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:48:05.973792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:48:05.973792+0000","last_clean_scrub_stamp":"2024-09-17T05:48:05.973792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:30:08.358108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.2c","version":"0'0","reported_seq":10,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T05:48:07.011887+0000","last_change":"2024-09-17T05:48:07.010456+0000","last_active":"2024-09-17T05:48:07.011887+0000","last_peered":"2024-09-17T05:48:07.011887+0000","last_clean":"2024-09-17T05:48:07.011887+0000","last_became_active":"2024-09-17T05:48:07.010136+0000","last_became_peered":"2024-09-17T05:48:07.010136+0000","last_unstale":"2024-09-17T05:48:07.011887+0000","last_undegraded":"2024-09-17T05:48:07.011887+0000","last_fullsized":"2024-09-17T05:48:07.011887+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:48:05.973792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:48:05.973792+0000","last_clean_scrub_stamp":"2024-09-17T05:48:05.973792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:02:04.762505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2b","version":"0'0","reported_seq":10,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T05:48:07.013497+0000","last_change":"2024-09-17T05:48:07.011524+0000","last_active":"2024-09-17T05:48:07.013497+0000","last_peered":"2024-09-17T05:48:07.013497+0000","last_clean":"2024-09-17T05:48:07.013497+0000","last_became_active":"2024-09-17T05:48:07.011186+0000","last_became_peered":"2024-09-17T05:48:07.011186+0000","last_unstale":"2024-09-17T05:48:07.013497+0000","last_undegraded":"2024-09-17T05:48:07.013497+0000","last_fullsized":"2024-09-17T05:48:07.013497+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:48:05.973792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:48:05.973792+0000","last_clean_scrub_stamp":"2024-09-17T05:48:05.973792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:06:26.531883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2a","version":"0'0","reported_seq":10,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T05:48:07.012966+0000","last_change":"2024-09-17T05:48:07.011513+0000","last_active":"2024-09-17T05:48:07.012966+0000","last_peered":"2024-09-17T05:48:07.012966+0000","last_clean":"2024-09-17T05:48:07.012966+0000","last_became_active":"2024-09-17T05:48:07.011207+0000","last_became_peered":"2024-09-17T05:48:07.011207+0000","last_unstale":"2024-09-17T05:48:07.012966+0000","last_undegraded":"2024-09-17T05:48:07.012966+0000","last_fullsized":"2024-09-17T05:48:07.012966+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:48:05.973792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:48:05.973792+0000","last_clean_scrub_stamp":"2024-09-17T05:48:05.973792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:25:04.204546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.29","version":"0'0","reported_seq":10,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T05:48:07.018768+0000","last_change":"2024-09-17T05:48:07.016145+0000","last_active":"2024-09-17T05:48:07.018768+0000","last_peered":"2024-09-17T05:48:07.018768+0000","last_clean":"2024-09-17T05:48:07.018768+0000","last_became_active":"2024-09-17T05:48:07.015802+0000","last_became_peered":"2024-09-17T05:48:07.015802+0000","last_unstale":"2024-09-17T05:48:07.018768+0000","last_undegraded":"2024-09-17T05:48:07.018768+0000","last_fullsized":"2024-09-17T05:48:07.018768+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:48:05.973792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:48:05.973792+0000","last_clean_scrub_stamp":"2024-09-17T05:48:05.973792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:38:27.328456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.28","version":"0'0","reported_seq":10,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T05:48:07.013189+0000","last_change":"2024-09-17T05:48:07.010500+0000","last_active":"2024-09-17T05:48:07.013189+0000","last_peered":"2024-09-17T05:48:07.013189+0000","last_clean":"2024-09-17T05:48:07.013189+0000","last_became_active":"2024-09-17T05:48:07.010182+0000","last_became_peered":"2024-09-17T05:48:07.010182+0000","last_unstale":"2024-09-17T05:48:07.013189+0000","last_undegraded":"2024-09-17T05:48:07.013189+0000","last_fullsized":"2024-09-17T05:48:07.013189+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:48:05.973792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:48:05.973792+0000","last_clean_scrub_stamp":"2024-09-17T05:48:05.973792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:43:27.386419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.27","version":"0'0","reported_seq":10,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T05:48:07.007625+0000","last_change":"2024-09-17T05:48:07.004954+0000","last_active":"2024-09-17T05:48:07.007625+0000","last_peered":"2024-09-17T05:48:07.007625+0000","last_clean":"2024-09-17T05:48:07.007625+0000","last_became_active":"2024-09-17T05:48:07.004656+0000","last_became_peered":"2024-09-17T05:48:07.004656+0000","last_unstale":"2024-09-17T05:48:07.007625+0000","last_undegraded":"2024-09-17T05:48:07.007625+0000","last_fullsized":"2024-09-17T05:48:07.007625+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:48:05.973792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:48:05.973792+0000","last_clean_scrub_stamp":"2024-09-17T05:48:05.973792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:07:51.657806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.26","version":"0'0","reported_seq":1,"reported_epoch":84,"state":"creating+peering","last_fresh":"2024-09-17T05:48:05.981443+0000","last_change":"2024-09-17T05:48:05.981443+0000","last_active":"2024-09-17T05:48:05.973792+0000","last_peered":"2024-09-17T05:48:05.973792+0000","last_clean":"2024-09-17T05:48:05.973792+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:48:05.981443+0000","last_undegraded":"2024-09-17T05:48:05.981443+0000","last_fullsized":"2024-09-17T05:48:05.981443+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:48:05.973792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:48:05.973792+0000","last_clean_scrub_stamp":"2024-09-17T05:48:05.973792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.25","version":"0'0","reported_seq":1,"reported_epoch":84,"state":"creating+peering","last_fresh":"2024-09-17T05:48:05.988800+0000","last_change":"2024-09-17T05:48:05.988800+0000","last_active":"2024-09-17T05:48:05.973792+0000","last_peered":"2024-09-17T05:48:05.973792+0000","last_clean":"2024-09-17T05:48:05.973792+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:48:05.988800+0000","last_undegraded":"2024-09-17T05:48:05.988800+0000","last_fullsized":"2024-09-17T05:48:05.988800+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:48:05.973792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:48:05.973792+0000","last_clean_scrub_stamp":"2024-09-17T05:48:05.973792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.24","version":"0'0","reported_seq":10,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T05:48:07.021931+0000","last_change":"2024-09-17T05:48:07.021372+0000","last_active":"2024-09-17T05:48:07.021931+0000","last_peered":"2024-09-17T05:48:07.021931+0000","last_clean":"2024-09-17T05:48:07.021931+0000","last_became_active":"2024-09-17T05:48:07.019410+0000","last_became_peered":"2024-09-17T05:48:07.019410+0000","last_unstale":"2024-09-17T05:48:07.021931+0000","last_undegraded":"2024-09-17T05:48:07.021931+0000","last_fullsized":"2024-09-17T05:48:07.021931+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:48:05.973792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:48:05.973792+0000","last_clean_scrub_stamp":"2024-09-17T05:48:05.973792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:16:14.965629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.23","version":"0'0","reported_seq":10,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T05:48:07.006158+0000","last_change":"2024-09-17T05:48:07.002555+0000","last_active":"2024-09-17T05:48:07.006158+0000","last_peered":"2024-09-17T05:48:07.006158+0000","last_clean":"2024-09-17T05:48:07.006158+0000","last_became_active":"2024-09-17T05:48:07.002263+0000","last_became_peered":"2024-09-17T05:48:07.002263+0000","last_unstale":"2024-09-17T05:48:07.006158+0000","last_undegraded":"2024-09-17T05:48:07.006158+0000","last_fullsized":"2024-09-17T05:48:07.006158+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:48:05.973792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:48:05.973792+0000","last_clean_scrub_stamp":"2024-09-17T05:48:05.973792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:08:12.460618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.22","version":"0'0","reported_seq":10,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T05:48:07.008627+0000","last_change":"2024-09-17T05:48:07.003556+0000","last_active":"2024-09-17T05:48:07.008627+0000","last_peered":"2024-09-17T05:48:07.008627+0000","last_clean":"2024-09-17T05:48:07.008627+0000","last_became_active":"2024-09-17T05:48:07.003232+0000","last_became_peered":"2024-09-17T05:48:07.003232+0000","last_unstale":"2024-09-17T05:48:07.008627+0000","last_undegraded":"2024-09-17T05:48:07.008627+0000","last_fullsized":"2024-09-17T05:48:07.008627+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:48:05.973792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:48:05.973792+0000","last_clean_scrub_stamp":"2024-09-17T05:48:05.973792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:55:03.368792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.21","version":"0'0","reported_seq":1,"reported_epoch":84,"state":"creating+peering","last_fresh":"2024-09-17T05:48:05.982834+0000","last_change":"2024-09-17T05:48:05.982834+0000","last_active":"2024-09-17T05:48:05.973792+0000","last_peered":"2024-09-17T05:48:05.973792+0000","last_clean":"2024-09-17T05:48:05.973792+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:48:05.982834+0000","last_undegraded":"2024-09-17T05:48:05.982834+0000","last_fullsized":"2024-09-17T05:48:05.982834+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:48:05.973792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:48:05.973792+0000","last_clean_scrub_stamp":"2024-09-17T05:48:05.973792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.20","version":"0'0","reported_seq":10,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T05:48:07.015971+0000","last_change":"2024-09-17T05:48:07.009478+0000","last_active":"2024-09-17T05:48:07.015971+0000","last_peered":"2024-09-17T05:48:07.015971+0000","last_clean":"2024-09-17T05:48:07.015971+0000","last_became_active":"2024-09-17T05:48:07.009198+0000","last_became_peered":"2024-09-17T05:48:07.009198+0000","last_unstale":"2024-09-17T05:48:07.015971+0000","last_undegraded":"2024-09-17T05:48:07.015971+0000","last_fullsized":"2024-09-17T05:48:07.015971+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:48:05.973792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:48:05.973792+0000","last_clean_scrub_stamp":"2024-09-17T05:48:05.973792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:54:11.908409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1e","version":"0'0","reported_seq":1,"reported_epoch":84,"state":"creating+peering","last_fresh":"2024-09-17T05:48:05.989512+0000","last_change":"2024-09-17T05:48:05.989512+0000","last_active":"2024-09-17T05:48:05.973792+0000","last_peered":"2024-09-17T05:48:05.973792+0000","last_clean":"2024-09-17T05:48:05.973792+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:48:05.989512+0000","last_undegraded":"2024-09-17T05:48:05.989512+0000","last_fullsized":"2024-09-17T05:48:05.989512+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:48:05.973792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:48:05.973792+0000","last_clean_scrub_stamp":"2024-09-17T05:48:05.973792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1f","version":"85'4","reported_seq":17,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T05:48:07.027168+0000","last_change":"2024-09-17T05:48:05.997338+0000","last_active":"2024-09-17T05:48:07.027168+0000","last_peered":"2024-09-17T05:48:07.027168+0000","last_clean":"2024-09-17T05:48:07.027168+0000","last_became_active":"2024-09-17T05:48:05.996975+0000","last_became_peered":"2024-09-17T05:48:05.996975+0000","last_unstale":"2024-09-17T05:48:07.027168+0000","last_undegraded":"2024-09-17T05:48:07.027168+0000","last_fullsized":"2024-09-17T05:48:07.027168+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:48:04.965082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:48:04.965082+0000","last_clean_scrub_stamp":"2024-09-17T05:48:04.965082+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:18:51.809325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1f","version":"0'0","reported_seq":10,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T05:48:07.017293+0000","last_change":"2024-09-17T05:48:07.013038+0000","last_active":"2024-09-17T05:48:07.017293+0000","last_peered":"2024-09-17T05:48:07.017293+0000","last_clean":"2024-09-17T05:48:07.017293+0000","last_became_active":"2024-09-17T05:48:07.012730+0000","last_became_peered":"2024-09-17T05:48:07.012730+0000","last_unstale":"2024-09-17T05:48:07.017293+0000","last_undegraded":"2024-09-17T05:48:07.017293+0000","last_fullsized":"2024-09-17T05:48:07.017293+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:48:05.973792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:48:05.973792+0000","last_clean_scrub_stamp":"2024-09-17T05:48:05.973792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:25:22.303460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.1e","version":"0'0","reported_seq":10,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-17T05:48:05.997003+0000","last_change":"2024-09-17T05:48:05.995823+0000","last_active":"2024-09-17T05:48:05.997003+0000","last_peered":"2024-09-17T05:48:05.997003+0000","last_clean":"2024-09-17T05:48:05.997003+0000","last_became_active":"2024-09-17T05:48:05.995488+0000","last_became_peered":"2024-09-17T05:48:05.995488+0000","last_unstale":"2024-09-17T05:48:05.997003+0000","last_undegraded":"2024-09-17T05:48:05.997003+0000","last_fullsized":"2024-09-17T05:48:05.997003+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:48:04.965082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:48:04.965082+0000","last_clean_scrub_stamp":"2024-09-17T05:48:04.965082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:09:48.701468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.1c","version":"0'0","reported_seq":10,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T05:48:07.016959+0000","last_change":"2024-09-17T05:48:07.011380+0000","last_active":"2024-09-17T05:48:07.016959+0000","last_peered":"2024-09-17T05:48:07.016959+0000","last_clean":"2024-09-17T05:48:07.016959+0000","last_became_active":"2024-09-17T05:48:07.011078+0000","last_became_peered":"2024-09-17T05:48:07.011078+0000","last_unstale":"2024-09-17T05:48:07.016959+0000","last_undegraded":"2024-09-17T05:48:07.016959+0000","last_fullsized":"2024-09-17T05:48:07.016959+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:48:05.973792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:48:05.973792+0000","last_clean_scrub_stamp":"2024-09-17T05:48:05.973792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:45:26.386010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.1d","version":"85'2","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-17T05:48:08.017837+0000","last_change":"2024-09-17T05:48:05.995146+0000","last_active":"2024-09-17T05:48:08.017837+0000","last_peered":"2024-09-17T05:48:08.017837+0000","last_clean":"2024-09-17T05:48:08.017837+0000","last_became_active":"2024-09-17T05:48:05.994843+0000","last_became_peered":"2024-09-17T05:48:05.994843+0000","last_unstale":"2024-09-17T05:48:08.017837+0000","last_undegraded":"2024-09-17T05:48:08.017837+0000","last_fullsized":"2024-09-17T05:48:08.017837+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:48:04.965082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:48:04.965082+0000","last_clean_scrub_stamp":"2024-09-17T05:48:04.965082+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:08:12.896308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1d","version":"0'0","reported_seq":1,"reported_epoch":84,"state":"creating+peering","last_fresh":"2024-09-17T05:48:05.980180+0000","last_change":"2024-09-17T05:48:05.980180+0000","last_active":"2024-09-17T05:48:05.973792+0000","last_peered":"2024-09-17T05:48:05.973792+0000","last_clean":"2024-09-17T05:48:05.973792+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:48:05.980180+0000","last_undegraded":"2024-09-17T05:48:05.980180+0000","last_fullsized":"2024-09-17T05:48:05.980180+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:48:05.973792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:48:05.973792+0000","last_clean_scrub_stamp":"2024-09-17T05:48:05.973792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1c","version":"85'2","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-17T05:48:08.017546+0000","last_change":"2024-09-17T05:48:05.996138+0000","last_active":"2024-09-17T05:48:08.017546+0000","last_peered":"2024-09-17T05:48:08.017546+0000","last_clean":"2024-09-17T05:48:08.017546+0000","last_became_active":"2024-09-17T05:48:05.995742+0000","last_became_peered":"2024-09-17T05:48:05.995742+0000","last_unstale":"2024-09-17T05:48:08.017546+0000","last_undegraded":"2024-09-17T05:48:08.017546+0000","last_fullsized":"2024-09-17T05:48:08.017546+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:48:04.965082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:48:04.965082+0000","last_clean_scrub_stamp":"2024-09-17T05:48:04.965082+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:07:07.086219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1a","version":"0'0","reported_seq":10,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T05:48:07.008594+0000","last_change":"2024-09-17T05:48:07.003430+0000","last_active":"2024-09-17T05:48:07.008594+0000","last_peered":"2024-09-17T05:48:07.008594+0000","last_clean":"2024-09-17T05:48:07.008594+0000","last_became_active":"2024-09-17T05:48:07.002894+0000","last_became_peered":"2024-09-17T05:48:07.002894+0000","last_unstale":"2024-09-17T05:48:07.008594+0000","last_undegraded":"2024-09-17T05:48:07.008594+0000","last_fullsized":"2024-09-17T05:48:07.008594+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:48:05.973792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:48:05.973792+0000","last_clean_scrub_stamp":"2024-09-17T05:48:05.973792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:41:40.435956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.1b","version":"0'0","reported_seq":10,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-17T05:48:06.000918+0000","last_change":"2024-09-17T05:48:06.000106+0000","last_active":"2024-09-17T05:48:06.000918+0000","last_peered":"2024-09-17T05:48:06.000918+0000","last_clean":"2024-09-17T05:48:06.000918+0000","last_became_active":"2024-09-17T05:48:05.999798+0000","last_became_peered":"2024-09-17T05:48:05.999798+0000","last_unstale":"2024-09-17T05:48:06.000918+0000","last_undegraded":"2024-09-17T05:48:06.000918+0000","last_fullsized":"2024-09-17T05:48:06.000918+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:48:04.965082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:48:04.965082+0000","last_clean_scrub_stamp":"2024-09-17T05:48:04.965082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:16:50.545089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.1b","version":"0'0","reported_seq":1,"reported_epoch":84,"state":"creating+peering","last_fresh":"2024-09-17T05:48:05.989943+0000","last_change":"2024-09-17T05:48:05.989943+0000","last_active":"2024-09-17T05:48:05.973792+0000","last_peered":"2024-09-17T05:48:05.973792+0000","last_clean":"2024-09-17T05:48:05.973792+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:48:05.989943+0000","last_undegraded":"2024-09-17T05:48:05.989943+0000","last_fullsized":"2024-09-17T05:48:05.989943+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:48:05.973792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:48:05.973792+0000","last_clean_scrub_stamp":"2024-09-17T05:48:05.973792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1a","version":"0'0","reported_seq":10,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-17T05:48:05.998331+0000","last_change":"2024-09-17T05:48:05.996177+0000","last_active":"2024-09-17T05:48:05.998331+0000","last_peered":"2024-09-17T05:48:05.998331+0000","last_clean":"2024-09-17T05:48:05.998331+0000","last_became_active":"2024-09-17T05:48:05.995803+0000","last_became_peered":"2024-09-17T05:48:05.995803+0000","last_unstale":"2024-09-17T05:48:05.998331+0000","last_undegraded":"2024-09-17T05:48:05.998331+0000","last_fullsized":"2024-09-17T05:48:05.998331+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:48:04.965082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:48:04.965082+0000","last_clean_scrub_stamp":"2024-09-17T05:48:04.965082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:29:46.170441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.18","version":"0'0","reported_seq":1,"reported_epoch":84,"state":"creating+peering","last_fresh":"2024-09-17T05:48:05.980690+0000","last_change":"2024-09-17T05:48:05.980690+0000","last_active":"2024-09-17T05:48:05.973792+0000","last_peered":"2024-09-17T05:48:05.973792+0000","last_clean":"2024-09-17T05:48:05.973792+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:48:05.980690+0000","last_undegraded":"2024-09-17T05:48:05.980690+0000","last_fullsized":"2024-09-17T05:48:05.980690+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:48:05.973792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:48:05.973792+0000","last_clean_scrub_stamp":"2024-09-17T05:48:05.973792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.19","version":"0'0","reported_seq":15,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-17T05:48:08.017351+0000","last_change":"2024-09-17T05:48:05.994519+0000","last_active":"2024-09-17T05:48:08.017351+0000","last_peered":"2024-09-17T05:48:08.017351+0000","last_clean":"2024-09-17T05:48:08.017351+0000","last_became_active":"2024-09-17T05:48:05.994089+0000","last_became_peered":"2024-09-17T05:48:05.994089+0000","last_unstale":"2024-09-17T05:48:08.017351+0000","last_undegraded":"2024-09-17T05:48:08.017351+0000","last_fullsized":"2024-09-17T05:48:08.017351+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:48:04.965082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:48:04.965082+0000","last_clean_scrub_stamp":"2024-09-17T05:48:04.965082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:10:49.729836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.19","version":"0'0","reported_seq":10,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T05:48:07.008542+0000","last_change":"2024-09-17T05:48:07.006952+0000","last_active":"2024-09-17T05:48:07.008542+0000","last_peered":"2024-09-17T05:48:07.008542+0000","last_clean":"2024-09-17T05:48:07.008542+0000","last_became_active":"2024-09-17T05:48:07.006627+0000","last_became_peered":"2024-09-17T05:48:07.006627+0000","last_unstale":"2024-09-17T05:48:07.008542+0000","last_undegraded":"2024-09-17T05:48:07.008542+0000","last_fullsized":"2024-09-17T05:48:07.008542+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:48:05.973792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:48:05.973792+0000","last_clean_scrub_stamp":"2024-09-17T05:48:05.973792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:01:24.000485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.18","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T05:48:06.991703+0000","last_change":"2024-09-17T05:48:05.999386+0000","last_active":"2024-09-17T05:48:06.991703+0000","last_peered":"2024-09-17T05:48:06.991703+0000","last_clean":"2024-09-17T05:48:06.991703+0000","last_became_active":"2024-09-17T05:48:05.999075+0000","last_became_peered":"2024-09-17T05:48:05.999075+0000","last_unstale":"2024-09-17T05:48:06.991703+0000","last_undegraded":"2024-09-17T05:48:06.991703+0000","last_fullsized":"2024-09-17T05:48:06.991703+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:48:04.965082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:48:04.965082+0000","last_clean_scrub_stamp":"2024-09-17T05:48:04.965082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:02:12.685719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.16","version":"0'0","reported_seq":10,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T05:48:07.007163+0000","last_change":"2024-09-17T05:48:07.004229+0000","last_active":"2024-09-17T05:48:07.007163+0000","last_peered":"2024-09-17T05:48:07.007163+0000","last_clean":"2024-09-17T05:48:07.007163+0000","last_became_active":"2024-09-17T05:48:07.003931+0000","last_became_peered":"2024-09-17T05:48:07.003931+0000","last_unstale":"2024-09-17T05:48:07.007163+0000","last_undegraded":"2024-09-17T05:48:07.007163+0000","last_fullsized":"2024-09-17T05:48:07.007163+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:48:05.973792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:48:05.973792+0000","last_clean_scrub_stamp":"2024-09-17T05:48:05.973792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:40:53.536640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.17","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T05:48:07.000319+0000","last_change":"2024-09-17T05:48:05.994108+0000","last_active":"2024-09-17T05:48:07.000319+0000","last_peered":"2024-09-17T05:48:07.000319+0000","last_clean":"2024-09-17T05:48:07.000319+0000","last_became_active":"2024-09-17T05:48:05.993676+0000","last_became_peered":"2024-09-17T05:48:05.993676+0000","last_unstale":"2024-09-17T05:48:07.000319+0000","last_undegraded":"2024-09-17T05:48:07.000319+0000","last_fullsized":"2024-09-17T05:48:07.000319+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:48:04.965082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:48:04.965082+0000","last_clean_scrub_stamp":"2024-09-17T05:48:04.965082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:36:21.212798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.17","version":"0'0","reported_seq":1,"reported_epoch":84,"state":"creating+peering","last_fresh":"2024-09-17T05:48:05.985621+0000","last_change":"2024-09-17T05:48:05.985621+0000","last_active":"2024-09-17T05:48:05.973792+0000","last_peered":"2024-09-17T05:48:05.973792+0000","last_clean":"2024-09-17T05:48:05.973792+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:48:05.985621+0000","last_undegraded":"2024-09-17T05:48:05.985621+0000","last_fullsized":"2024-09-17T05:48:05.985621+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:48:05.973792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:48:05.973792+0000","last_clean_scrub_stamp":"2024-09-17T05:48:05.973792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.16","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T05:48:07.005218+0000","last_change":"2024-09-17T05:48:05.998132+0000","last_active":"2024-09-17T05:48:07.005218+0000","last_peered":"2024-09-17T05:48:07.005218+0000","last_clean":"2024-09-17T05:48:07.005218+0000","last_became_active":"2024-09-17T05:48:05.997479+0000","last_became_peered":"2024-09-17T05:48:05.997479+0000","last_unstale":"2024-09-17T05:48:07.005218+0000","last_undegraded":"2024-09-17T05:48:07.005218+0000","last_fullsized":"2024-09-17T05:48:07.005218+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:48:04.965082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:48:04.965082+0000","last_clean_scrub_stamp":"2024-09-17T05:48:04.965082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:30:29.544066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.14","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-17T05:48:08.017612+0000","last_change":"2024-09-17T05:48:07.010434+0000","last_active":"2024-09-17T05:48:08.017612+0000","last_peered":"2024-09-17T05:48:08.017612+0000","last_clean":"2024-09-17T05:48:08.017612+0000","last_became_active":"2024-09-17T05:48:07.009605+0000","last_became_peered":"2024-09-17T05:48:07.009605+0000","last_unstale":"2024-09-17T05:48:08.017612+0000","last_undegraded":"2024-09-17T05:48:08.017612+0000","last_fullsized":"2024-09-17T05:48:08.017612+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:48:05.973792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:48:05.973792+0000","last_clean_scrub_stamp":"2024-09-17T05:48:05.973792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:46:18.050983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.15","version":"85'3","reported_seq":16,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T05:48:07.027048+0000","last_change":"2024-09-17T05:48:05.999363+0000","last_active":"2024-09-17T05:48:07.027048+0000","last_peered":"2024-09-17T05:48:07.027048+0000","last_clean":"2024-09-17T05:48:07.027048+0000","last_became_active":"2024-09-17T05:48:05.998976+0000","last_became_peered":"2024-09-17T05:48:05.998976+0000","last_unstale":"2024-09-17T05:48:07.027048+0000","last_undegraded":"2024-09-17T05:48:07.027048+0000","last_fullsized":"2024-09-17T05:48:07.027048+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:48:04.965082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:48:04.965082+0000","last_clean_scrub_stamp":"2024-09-17T05:48:04.965082+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:03:18.092299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.15","version":"0'0","reported_seq":1,"reported_epoch":84,"state":"creating+peering","last_fresh":"2024-09-17T05:48:05.988352+0000","last_change":"2024-09-17T05:48:05.988352+0000","last_active":"2024-09-17T05:48:05.973792+0000","last_peered":"2024-09-17T05:48:05.973792+0000","last_clean":"2024-09-17T05:48:05.973792+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:48:05.988352+0000","last_undegraded":"2024-09-17T05:48:05.988352+0000","last_fullsized":"2024-09-17T05:48:05.988352+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:48:05.973792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:48:05.973792+0000","last_clean_scrub_stamp":"2024-09-17T05:48:05.973792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.14","version":"0'0","reported_seq":10,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-17T05:48:05.998686+0000","last_change":"2024-09-17T05:48:05.997721+0000","last_active":"2024-09-17T05:48:05.998686+0000","last_peered":"2024-09-17T05:48:05.998686+0000","last_clean":"2024-09-17T05:48:05.998686+0000","last_became_active":"2024-09-17T05:48:05.997375+0000","last_became_peered":"2024-09-17T05:48:05.997375+0000","last_unstale":"2024-09-17T05:48:05.998686+0000","last_undegraded":"2024-09-17T05:48:05.998686+0000","last_fullsized":"2024-09-17T05:48:05.998686+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:48:04.965082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:48:04.965082+0000","last_clean_scrub_stamp":"2024-09-17T05:48:04.965082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:17:35.686622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.12","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-17T05:48:08.017527+0000","last_change":"2024-09-17T05:48:07.014653+0000","last_active":"2024-09-17T05:48:08.017527+0000","last_peered":"2024-09-17T05:48:08.017527+0000","last_clean":"2024-09-17T05:48:08.017527+0000","last_became_active":"2024-09-17T05:48:07.014227+0000","last_became_peered":"2024-09-17T05:48:07.014227+0000","last_unstale":"2024-09-17T05:48:08.017527+0000","last_undegraded":"2024-09-17T05:48:08.017527+0000","last_fullsized":"2024-09-17T05:48:08.017527+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:48:05.973792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:48:05.973792+0000","last_clean_scrub_stamp":"2024-09-17T05:48:05.973792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:47:25.975838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.13","version":"85'2","reported_seq":15,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T05:48:07.025656+0000","last_change":"2024-09-17T05:48:05.998280+0000","last_active":"2024-09-17T05:48:07.025656+0000","last_peered":"2024-09-17T05:48:07.025656+0000","last_clean":"2024-09-17T05:48:07.025656+0000","last_became_active":"2024-09-17T05:48:05.998002+0000","last_became_peered":"2024-09-17T05:48:05.998002+0000","last_unstale":"2024-09-17T05:48:07.025656+0000","last_undegraded":"2024-09-17T05:48:07.025656+0000","last_fullsized":"2024-09-17T05:48:07.025656+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:48:04.965082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:48:04.965082+0000","last_clean_scrub_stamp":"2024-09-17T05:48:04.965082+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:47:24.665134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.13","version":"0'0","reported_seq":1,"reported_epoch":84,"state":"creating+peering","last_fresh":"2024-09-17T05:48:05.979811+0000","last_change":"2024-09-17T05:48:05.979811+0000","last_active":"2024-09-17T05:48:05.973792+0000","last_peered":"2024-09-17T05:48:05.973792+0000","last_clean":"2024-09-17T05:48:05.973792+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:48:05.979811+0000","last_undegraded":"2024-09-17T05:48:05.979811+0000","last_fullsized":"2024-09-17T05:48:05.979811+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:48:05.973792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:48:05.973792+0000","last_clean_scrub_stamp":"2024-09-17T05:48:05.973792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.12","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T05:48:06.998518+0000","last_change":"2024-09-17T05:48:05.992907+0000","last_active":"2024-09-17T05:48:06.998518+0000","last_peered":"2024-09-17T05:48:06.998518+0000","last_clean":"2024-09-17T05:48:06.998518+0000","last_became_active":"2024-09-17T05:48:05.992511+0000","last_became_peered":"2024-09-17T05:48:05.992511+0000","last_unstale":"2024-09-17T05:48:06.998518+0000","last_undegraded":"2024-09-17T05:48:06.998518+0000","last_fullsized":"2024-09-17T05:48:06.998518+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:48:04.965082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:48:04.965082+0000","last_clean_scrub_stamp":"2024-09-17T05:48:04.965082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:50:06.270397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.10","version":"0'0","reported_seq":10,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T05:48:07.001747+0000","last_change":"2024-09-17T05:48:07.000184+0000","last_active":"2024-09-17T05:48:07.001747+0000","last_peered":"2024-09-17T05:48:07.001747+0000","last_clean":"2024-09-17T05:48:07.001747+0000","last_became_active":"2024-09-17T05:48:06.998794+0000","last_became_peered":"2024-09-17T05:48:06.998794+0000","last_unstale":"2024-09-17T05:48:07.001747+0000","last_undegraded":"2024-09-17T05:48:07.001747+0000","last_fullsized":"2024-09-17T05:48:07.001747+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:48:05.973792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:48:05.973792+0000","last_clean_scrub_stamp":"2024-09-17T05:48:05.973792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:00:20.671743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.11","version":"0'0","reported_seq":10,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-17T05:48:06.000120+0000","last_change":"2024-09-17T05:48:05.999329+0000","last_active":"2024-09-17T05:48:06.000120+0000","last_peered":"2024-09-17T05:48:06.000120+0000","last_clean":"2024-09-17T05:48:06.000120+0000","last_became_active":"2024-09-17T05:48:05.998937+0000","last_became_peered":"2024-09-17T05:48:05.998937+0000","last_unstale":"2024-09-17T05:48:06.000120+0000","last_undegraded":"2024-09-17T05:48:06.000120+0000","last_fullsized":"2024-09-17T05:48:06.000120+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:48:04.965082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:48:04.965082+0000","last_clean_scrub_stamp":"2024-09-17T05:48:04.965082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:14:55.111111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.11","version":"0'0","reported_seq":10,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T05:48:07.006789+0000","last_change":"2024-09-17T05:48:07.004159+0000","last_active":"2024-09-17T05:48:07.006789+0000","last_peered":"2024-09-17T05:48:07.006789+0000","last_clean":"2024-09-17T05:48:07.006789+0000","last_became_active":"2024-09-17T05:48:07.003830+0000","last_became_peered":"2024-09-17T05:48:07.003830+0000","last_unstale":"2024-09-17T05:48:07.006789+0000","last_undegraded":"2024-09-17T05:48:07.006789+0000","last_fullsized":"2024-09-17T05:48:07.006789+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:48:05.973792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:48:05.973792+0000","last_clean_scrub_stamp":"2024-09-17T05:48:05.973792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:28:05.997018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.10","version":"85'8","reported_seq":23,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-17T05:48:08.017251+0000","last_change":"2024-09-17T05:48:05.994461+0000","last_active":"2024-09-17T05:48:08.017251+0000","last_peered":"2024-09-17T05:48:08.017251+0000","last_clean":"2024-09-17T05:48:08.017251+0000","last_became_active":"2024-09-17T05:48:05.994138+0000","last_became_peered":"2024-09-17T05:48:05.994138+0000","last_unstale":"2024-09-17T05:48:08.017251+0000","last_undegraded":"2024-09-17T05:48:08.017251+0000","last_fullsized":"2024-09-17T05:48:08.017251+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:48:04.965082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:48:04.965082+0000","last_clean_scrub_stamp":"2024-09-17T05:48:04.965082+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:49:16.263159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.e","version":"0'0","reported_seq":1,"reported_epoch":84,"state":"creating+peering","last_fresh":"2024-09-17T05:48:05.980418+0000","last_change":"2024-09-17T05:48:05.980418+0000","last_active":"2024-09-17T05:48:05.973792+0000","last_peered":"2024-09-17T05:48:05.973792+0000","last_clean":"2024-09-17T05:48:05.973792+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:48:05.980418+0000","last_undegraded":"2024-09-17T05:48:05.980418+0000","last_fullsized":"2024-09-17T05:48:05.980418+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:48:05.973792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:48:05.973792+0000","last_clean_scrub_stamp":"2024-09-17T05:48:05.973792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.f","version":"85'1","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T05:48:07.027049+0000","last_change":"2024-09-17T05:48:05.993133+0000","last_active":"2024-09-17T05:48:07.027049+0000","last_peered":"2024-09-17T05:48:07.027049+0000","last_clean":"2024-09-17T05:48:07.027049+0000","last_became_active":"2024-09-17T05:48:05.992787+0000","last_became_peered":"2024-09-17T05:48:05.992787+0000","last_unstale":"2024-09-17T05:48:07.027049+0000","last_undegraded":"2024-09-17T05:48:07.027049+0000","last_fullsized":"2024-09-17T05:48:07.027049+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:48:04.965082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:48:04.965082+0000","last_clean_scrub_stamp":"2024-09-17T05:48:04.965082+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:44:05.587367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.f","version":"0'0","reported_seq":10,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T05:48:07.015835+0000","last_change":"2024-09-17T05:48:07.009405+0000","last_active":"2024-09-17T05:48:07.015835+0000","last_peered":"2024-09-17T05:48:07.015835+0000","last_clean":"2024-09-17T05:48:07.015835+0000","last_became_active":"2024-09-17T05:48:07.009088+0000","last_became_peered":"2024-09-17T05:48:07.009088+0000","last_unstale":"2024-09-17T05:48:07.015835+0000","last_undegraded":"2024-09-17T05:48:07.015835+0000","last_fullsized":"2024-09-17T05:48:07.015835+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:48:05.973792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:48:05.973792+0000","last_clean_scrub_stamp":"2024-09-17T05:48:05.973792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:38:46.247147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.e","version":"85'2","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-17T05:48:08.017601+0000","last_change":"2024-09-17T05:48:05.995547+0000","last_active":"2024-09-17T05:48:08.017601+0000","last_peered":"2024-09-17T05:48:08.017601+0000","last_clean":"2024-09-17T05:48:08.017601+0000","last_became_active":"2024-09-17T05:48:05.995233+0000","last_became_peered":"2024-09-17T05:48:05.995233+0000","last_unstale":"2024-09-17T05:48:08.017601+0000","last_undegraded":"2024-09-17T05:48:08.017601+0000","last_fullsized":"2024-09-17T05:48:08.017601+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:48:04.965082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:48:04.965082+0000","last_clean_scrub_stamp":"2024-09-17T05:48:04.965082+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:45:54.436107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.d","version":"0'0","reported_seq":1,"reported_epoch":84,"state":"creating+peering","last_fresh":"2024-09-17T05:48:05.987698+0000","last_change":"2024-09-17T05:48:05.987698+0000","last_active":"2024-09-17T05:48:05.973792+0000","last_peered":"2024-09-17T05:48:05.973792+0000","last_clean":"2024-09-17T05:48:05.973792+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:48:05.987698+0000","last_undegraded":"2024-09-17T05:48:05.987698+0000","last_fullsized":"2024-09-17T05:48:05.987698+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:48:05.973792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:48:05.973792+0000","last_clean_scrub_stamp":"2024-09-17T05:48:05.973792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.c","version":"0'0","reported_seq":15,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-17T05:48:08.017659+0000","last_change":"2024-09-17T05:48:05.993828+0000","last_active":"2024-09-17T05:48:08.017659+0000","last_peered":"2024-09-17T05:48:08.017659+0000","last_clean":"2024-09-17T05:48:08.017659+0000","last_became_active":"2024-09-17T05:48:05.992893+0000","last_became_peered":"2024-09-17T05:48:05.992893+0000","last_unstale":"2024-09-17T05:48:08.017659+0000","last_undegraded":"2024-09-17T05:48:08.017659+0000","last_fullsized":"2024-09-17T05:48:08.017659+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:48:04.965082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:48:04.965082+0000","last_clean_scrub_stamp":"2024-09-17T05:48:04.965082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:19:19.306307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.a","version":"0'0","reported_seq":10,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T05:48:07.000656+0000","last_change":"2024-09-17T05:48:06.999976+0000","last_active":"2024-09-17T05:48:07.000656+0000","last_peered":"2024-09-17T05:48:07.000656+0000","last_clean":"2024-09-17T05:48:07.000656+0000","last_became_active":"2024-09-17T05:48:06.999669+0000","last_became_peered":"2024-09-17T05:48:06.999669+0000","last_unstale":"2024-09-17T05:48:07.000656+0000","last_undegraded":"2024-09-17T05:48:07.000656+0000","last_fullsized":"2024-09-17T05:48:07.000656+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:48:05.973792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:48:05.973792+0000","last_clean_scrub_stamp":"2024-09-17T05:48:05.973792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:13:35.334703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.b","version":"85'2","reported_seq":15,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T05:48:07.024635+0000","last_change":"2024-09-17T05:48:05.990062+0000","last_active":"2024-09-17T05:48:07.024635+0000","last_peered":"2024-09-17T05:48:07.024635+0000","last_clean":"2024-09-17T05:48:07.024635+0000","last_became_active":"2024-09-17T05:48:05.989770+0000","last_became_peered":"2024-09-17T05:48:05.989770+0000","last_unstale":"2024-09-17T05:48:07.024635+0000","last_undegraded":"2024-09-17T05:48:07.024635+0000","last_fullsized":"2024-09-17T05:48:07.024635+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:48:04.965082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:48:04.965082+0000","last_clean_scrub_stamp":"2024-09-17T05:48:04.965082+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:54:27.978918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.b","version":"0'0","reported_seq":1,"reported_epoch":84,"state":"creating+peering","last_fresh":"2024-09-17T05:48:05.987891+0000","last_change":"2024-09-17T05:48:05.987891+0000","last_active":"2024-09-17T05:48:05.973792+0000","last_peered":"2024-09-17T05:48:05.973792+0000","last_clean":"2024-09-17T05:48:05.973792+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:48:05.987891+0000","last_undegraded":"2024-09-17T05:48:05.987891+0000","last_fullsized":"2024-09-17T05:48:05.987891+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:48:05.973792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:48:05.973792+0000","last_clean_scrub_stamp":"2024-09-17T05:48:05.973792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.a","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T05:48:06.994828+0000","last_change":"2024-09-17T05:48:05.997773+0000","last_active":"2024-09-17T05:48:06.994828+0000","last_peered":"2024-09-17T05:48:06.994828+0000","last_clean":"2024-09-17T05:48:06.994828+0000","last_became_active":"2024-09-17T05:48:05.997035+0000","last_became_peered":"2024-09-17T05:48:05.997035+0000","last_unstale":"2024-09-17T05:48:06.994828+0000","last_undegraded":"2024-09-17T05:48:06.994828+0000","last_fullsized":"2024-09-17T05:48:06.994828+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:48:04.965082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:48:04.965082+0000","last_clean_scrub_stamp":"2024-09-17T05:48:04.965082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:12:13.405546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.8","version":"0'0","reported_seq":10,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T05:48:07.007881+0000","last_change":"2024-09-17T05:48:07.004667+0000","last_active":"2024-09-17T05:48:07.007881+0000","last_peered":"2024-09-17T05:48:07.007881+0000","last_clean":"2024-09-17T05:48:07.007881+0000","last_became_active":"2024-09-17T05:48:07.002420+0000","last_became_peered":"2024-09-17T05:48:07.002420+0000","last_unstale":"2024-09-17T05:48:07.007881+0000","last_undegraded":"2024-09-17T05:48:07.007881+0000","last_fullsized":"2024-09-17T05:48:07.007881+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:48:05.973792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:48:05.973792+0000","last_clean_scrub_stamp":"2024-09-17T05:48:05.973792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:58:39.931473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.9","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T05:48:06.994209+0000","last_change":"2024-09-17T05:48:05.999798+0000","last_active":"2024-09-17T05:48:06.994209+0000","last_peered":"2024-09-17T05:48:06.994209+0000","last_clean":"2024-09-17T05:48:06.994209+0000","last_became_active":"2024-09-17T05:48:05.999476+0000","last_became_peered":"2024-09-17T05:48:05.999476+0000","last_unstale":"2024-09-17T05:48:06.994209+0000","last_undegraded":"2024-09-17T05:48:06.994209+0000","last_fullsized":"2024-09-17T05:48:06.994209+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:48:04.965082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:48:04.965082+0000","last_clean_scrub_stamp":"2024-09-17T05:48:04.965082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:44:22.789741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.9","version":"0'0","reported_seq":1,"reported_epoch":84,"state":"creating+peering","last_fresh":"2024-09-17T05:48:05.984632+0000","last_change":"2024-09-17T05:48:05.984632+0000","last_active":"2024-09-17T05:48:05.973792+0000","last_peered":"2024-09-17T05:48:05.973792+0000","last_clean":"2024-09-17T05:48:05.973792+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:48:05.984632+0000","last_undegraded":"2024-09-17T05:48:05.984632+0000","last_fullsized":"2024-09-17T05:48:05.984632+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:48:05.973792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:48:05.973792+0000","last_clean_scrub_stamp":"2024-09-17T05:48:05.973792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.8","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T05:48:06.998203+0000","last_change":"2024-09-17T05:48:05.990918+0000","last_active":"2024-09-17T05:48:06.998203+0000","last_peered":"2024-09-17T05:48:06.998203+0000","last_clean":"2024-09-17T05:48:06.998203+0000","last_became_active":"2024-09-17T05:48:05.990644+0000","last_became_peered":"2024-09-17T05:48:05.990644+0000","last_unstale":"2024-09-17T05:48:06.998203+0000","last_undegraded":"2024-09-17T05:48:06.998203+0000","last_fullsized":"2024-09-17T05:48:06.998203+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:48:04.965082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:48:04.965082+0000","last_clean_scrub_stamp":"2024-09-17T05:48:04.965082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:32:32.045706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.6","version":"0'0","reported_seq":1,"reported_epoch":84,"state":"creating+peering","last_fresh":"2024-09-17T05:48:05.984822+0000","last_change":"2024-09-17T05:48:05.984822+0000","last_active":"2024-09-17T05:48:05.973792+0000","last_peered":"2024-09-17T05:48:05.973792+0000","last_clean":"2024-09-17T05:48:05.973792+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:48:05.984822+0000","last_undegraded":"2024-09-17T05:48:05.984822+0000","last_fullsized":"2024-09-17T05:48:05.984822+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:48:05.973792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:48:05.973792+0000","last_clean_scrub_stamp":"2024-09-17T05:48:05.973792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.7","version":"85'2","reported_seq":15,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T05:48:07.026024+0000","last_change":"2024-09-17T05:48:05.996277+0000","last_active":"2024-09-17T05:48:07.026024+0000","last_peered":"2024-09-17T05:48:07.026024+0000","last_clean":"2024-09-17T05:48:07.026024+0000","last_became_active":"2024-09-17T05:48:05.995979+0000","last_became_peered":"2024-09-17T05:48:05.995979+0000","last_unstale":"2024-09-17T05:48:07.026024+0000","last_undegraded":"2024-09-17T05:48:07.026024+0000","last_fullsized":"2024-09-17T05:48:07.026024+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:48:04.965082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:48:04.965082+0000","last_clean_scrub_stamp":"2024-09-17T05:48:04.965082+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:25:07.468281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.7","version":"0'0","reported_seq":1,"reported_epoch":84,"state":"creating+peering","last_fresh":"2024-09-17T05:48:05.979914+0000","last_change":"2024-09-17T05:48:05.979914+0000","last_active":"2024-09-17T05:48:05.973792+0000","last_peered":"2024-09-17T05:48:05.973792+0000","last_clean":"2024-09-17T05:48:05.973792+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:48:05.979914+0000","last_undegraded":"2024-09-17T05:48:05.979914+0000","last_fullsized":"2024-09-17T05:48:05.979914+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:48:05.973792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:48:05.973792+0000","last_clean_scrub_stamp":"2024-09-17T05:48:05.973792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.6","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T05:48:06.992144+0000","last_change":"2024-09-17T05:48:05.997590+0000","last_active":"2024-09-17T05:48:06.992144+0000","last_peered":"2024-09-17T05:48:06.992144+0000","last_clean":"2024-09-17T05:48:06.992144+0000","last_became_active":"2024-09-17T05:48:05.997301+0000","last_became_peered":"2024-09-17T05:48:05.997301+0000","last_unstale":"2024-09-17T05:48:06.992144+0000","last_undegraded":"2024-09-17T05:48:06.992144+0000","last_fullsized":"2024-09-17T05:48:06.992144+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:48:04.965082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:48:04.965082+0000","last_clean_scrub_stamp":"2024-09-17T05:48:04.965082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:28:36.315309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.4","version":"0'0","reported_seq":10,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T05:48:07.017376+0000","last_change":"2024-09-17T05:48:07.014783+0000","last_active":"2024-09-17T05:48:07.017376+0000","last_peered":"2024-09-17T05:48:07.017376+0000","last_clean":"2024-09-17T05:48:07.017376+0000","last_became_active":"2024-09-17T05:48:07.013864+0000","last_became_peered":"2024-09-17T05:48:07.013864+0000","last_unstale":"2024-09-17T05:48:07.017376+0000","last_undegraded":"2024-09-17T05:48:07.017376+0000","last_fullsized":"2024-09-17T05:48:07.017376+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:48:05.973792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:48:05.973792+0000","last_clean_scrub_stamp":"2024-09-17T05:48:05.973792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:55:17.823783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.5","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T05:48:06.997381+0000","last_change":"2024-09-17T05:48:05.995722+0000","last_active":"2024-09-17T05:48:06.997381+0000","last_peered":"2024-09-17T05:48:06.997381+0000","last_clean":"2024-09-17T05:48:06.997381+0000","last_became_active":"2024-09-17T05:48:05.995345+0000","last_became_peered":"2024-09-17T05:48:05.995345+0000","last_unstale":"2024-09-17T05:48:06.997381+0000","last_undegraded":"2024-09-17T05:48:06.997381+0000","last_fullsized":"2024-09-17T05:48:06.997381+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:48:04.965082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:48:04.965082+0000","last_clean_scrub_stamp":"2024-09-17T05:48:04.965082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:28:33.210082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.5","version":"0'0","reported_seq":1,"reported_epoch":84,"state":"creating+peering","last_fresh":"2024-09-17T05:48:05.983735+0000","last_change":"2024-09-17T05:48:05.983735+0000","last_active":"2024-09-17T05:48:05.973792+0000","last_peered":"2024-09-17T05:48:05.973792+0000","last_clean":"2024-09-17T05:48:05.973792+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:48:05.983735+0000","last_undegraded":"2024-09-17T05:48:05.983735+0000","last_fullsized":"2024-09-17T05:48:05.983735+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:48:05.973792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:48:05.973792+0000","last_clean_scrub_stamp":"2024-09-17T05:48:05.973792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.4","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T05:48:07.006446+0000","last_change":"2024-09-17T05:48:05.995600+0000","last_active":"2024-09-17T05:48:07.006446+0000","last_peered":"2024-09-17T05:48:07.006446+0000","last_clean":"2024-09-17T05:48:07.006446+0000","last_became_active":"2024-09-17T05:48:05.993437+0000","last_became_peered":"2024-09-17T05:48:05.993437+0000","last_unstale":"2024-09-17T05:48:07.006446+0000","last_undegraded":"2024-09-17T05:48:07.006446+0000","last_fullsized":"2024-09-17T05:48:07.006446+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:48:04.965082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:48:04.965082+0000","last_clean_scrub_stamp":"2024-09-17T05:48:04.965082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:34:01.741103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.2","version":"0'0","reported_seq":1,"reported_epoch":84,"state":"creating+peering","last_fresh":"2024-09-17T05:48:05.984825+0000","last_change":"2024-09-17T05:48:05.984825+0000","last_active":"2024-09-17T05:48:05.973792+0000","last_peered":"2024-09-17T05:48:05.973792+0000","last_clean":"2024-09-17T05:48:05.973792+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:48:05.984825+0000","last_undegraded":"2024-09-17T05:48:05.984825+0000","last_fullsized":"2024-09-17T05:48:05.984825+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:48:05.973792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:48:05.973792+0000","last_clean_scrub_stamp":"2024-09-17T05:48:05.973792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.3","version":"0'0","reported_seq":15,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-17T05:48:08.017675+0000","last_change":"2024-09-17T05:48:05.993443+0000","last_active":"2024-09-17T05:48:08.017675+0000","last_peered":"2024-09-17T05:48:08.017675+0000","last_clean":"2024-09-17T05:48:08.017675+0000","last_became_active":"2024-09-17T05:48:05.993128+0000","last_became_peered":"2024-09-17T05:48:05.993128+0000","last_unstale":"2024-09-17T05:48:08.017675+0000","last_undegraded":"2024-09-17T05:48:08.017675+0000","last_fullsized":"2024-09-17T05:48:08.017675+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:48:04.965082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:48:04.965082+0000","last_clean_scrub_stamp":"2024-09-17T05:48:04.965082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:20:42.632458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.3","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-17T05:48:08.017609+0000","last_change":"2024-09-17T05:48:07.019471+0000","last_active":"2024-09-17T05:48:08.017609+0000","last_peered":"2024-09-17T05:48:08.017609+0000","last_clean":"2024-09-17T05:48:08.017609+0000","last_became_active":"2024-09-17T05:48:07.019107+0000","last_became_peered":"2024-09-17T05:48:07.019107+0000","last_unstale":"2024-09-17T05:48:08.017609+0000","last_undegraded":"2024-09-17T05:48:08.017609+0000","last_fullsized":"2024-09-17T05:48:08.017609+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:48:05.973792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:48:05.973792+0000","last_clean_scrub_stamp":"2024-09-17T05:48:05.973792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:30:20.891839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.2","version":"0'0","reported_seq":10,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-17T05:48:05.998302+0000","last_change":"2024-09-17T05:48:05.995790+0000","last_active":"2024-09-17T05:48:05.998302+0000","last_peered":"2024-09-17T05:48:05.998302+0000","last_clean":"2024-09-17T05:48:05.998302+0000","last_became_active":"2024-09-17T05:48:05.995430+0000","last_became_peered":"2024-09-17T05:48:05.995430+0000","last_unstale":"2024-09-17T05:48:05.998302+0000","last_undegraded":"2024-09-17T05:48:05.998302+0000","last_fullsized":"2024-09-17T05:48:05.998302+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:48:04.965082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:48:04.965082+0000","last_clean_scrub_stamp":"2024-09-17T05:48:04.965082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:51:12.220768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.0","version":"0'0","reported_seq":1,"reported_epoch":84,"state":"creating+peering","last_fresh":"2024-09-17T05:48:05.979780+0000","last_change":"2024-09-17T05:48:05.979780+0000","last_active":"2024-09-17T05:48:05.973792+0000","last_peered":"2024-09-17T05:48:05.973792+0000","last_clean":"2024-09-17T05:48:05.973792+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:48:05.979780+0000","last_undegraded":"2024-09-17T05:48:05.979780+0000","last_fullsized":"2024-09-17T05:48:05.979780+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:48:05.973792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:48:05.973792+0000","last_clean_scrub_stamp":"2024-09-17T05:48:05.973792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T05:48:07.000198+0000","last_change":"2024-09-17T05:48:05.994404+0000","last_active":"2024-09-17T05:48:07.000198+0000","last_peered":"2024-09-17T05:48:07.000198+0000","last_clean":"2024-09-17T05:48:07.000198+0000","last_became_active":"2024-09-17T05:48:05.993984+0000","last_became_peered":"2024-09-17T05:48:05.993984+0000","last_unstale":"2024-09-17T05:48:07.000198+0000","last_undegraded":"2024-09-17T05:48:07.000198+0000","last_fullsized":"2024-09-17T05:48:07.000198+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:48:04.965082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:48:04.965082+0000","last_clean_scrub_stamp":"2024-09-17T05:48:04.965082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:59:41.841128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1","version":"0'0","reported_seq":10,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T05:48:07.018798+0000","last_change":"2024-09-17T05:48:07.016257+0000","last_active":"2024-09-17T05:48:07.018798+0000","last_peered":"2024-09-17T05:48:07.018798+0000","last_clean":"2024-09-17T05:48:07.018798+0000","last_became_active":"2024-09-17T05:48:07.015950+0000","last_became_peered":"2024-09-17T05:48:07.015950+0000","last_unstale":"2024-09-17T05:48:07.018798+0000","last_undegraded":"2024-09-17T05:48:07.018798+0000","last_fullsized":"2024-09-17T05:48:07.018798+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:48:05.973792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:48:05.973792+0000","last_clean_scrub_stamp":"2024-09-17T05:48:05.973792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:09:18.062866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.0","version":"0'0","reported_seq":10,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-17T05:48:06.000943+0000","last_change":"2024-09-17T05:48:06.000083+0000","last_active":"2024-09-17T05:48:06.000943+0000","last_peered":"2024-09-17T05:48:06.000943+0000","last_clean":"2024-09-17T05:48:06.000943+0000","last_became_active":"2024-09-17T05:48:05.999770+0000","last_became_peered":"2024-09-17T05:48:05.999770+0000","last_unstale":"2024-09-17T05:48:06.000943+0000","last_undegraded":"2024-09-17T05:48:06.000943+0000","last_fullsized":"2024-09-17T05:48:06.000943+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:48:04.965082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:48:04.965082+0000","last_clean_scrub_stamp":"2024-09-17T05:48:04.965082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:11:27.267806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.c","version":"0'0","reported_seq":10,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T05:48:07.009303+0000","last_change":"2024-09-17T05:48:07.007210+0000","last_active":"2024-09-17T05:48:07.009303+0000","last_peered":"2024-09-17T05:48:07.009303+0000","last_clean":"2024-09-17T05:48:07.009303+0000","last_became_active":"2024-09-17T05:48:07.006278+0000","last_became_peered":"2024-09-17T05:48:07.006278+0000","last_unstale":"2024-09-17T05:48:07.009303+0000","last_undegraded":"2024-09-17T05:48:07.009303+0000","last_fullsized":"2024-09-17T05:48:07.009303+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:48:05.973792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:48:05.973792+0000","last_clean_scrub_stamp":"2024-09-17T05:48:05.973792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:11:54.651531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.d","version":"0'0","reported_seq":10,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-17T05:48:05.996883+0000","last_change":"2024-09-17T05:48:05.995764+0000","last_active":"2024-09-17T05:48:05.996883+0000","last_peered":"2024-09-17T05:48:05.996883+0000","last_clean":"2024-09-17T05:48:05.996883+0000","last_became_active":"2024-09-17T05:48:05.995439+0000","last_became_peered":"2024-09-17T05:48:05.995439+0000","last_unstale":"2024-09-17T05:48:05.996883+0000","last_undegraded":"2024-09-17T05:48:05.996883+0000","last_fullsized":"2024-09-17T05:48:05.996883+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:48:04.965082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:48:04.965082+0000","last_clean_scrub_stamp":"2024-09-17T05:48:04.965082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:59:39.032133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"19'72","reported_seq":223,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-17T05:48:05.984920+0000","last_change":"2024-09-17T05:41:48.539830+0000","last_active":"2024-09-17T05:48:05.984920+0000","last_peered":"2024-09-17T05:48:05.984920+0000","last_clean":"2024-09-17T05:48:05.984920+0000","last_became_active":"2024-09-17T05:41:48.538743+0000","last_became_peered":"2024-09-17T05:41:48.538743+0000","last_unstale":"2024-09-17T05:48:05.984920+0000","last_undegraded":"2024-09-17T05:48:05.984920+0000","last_fullsized":"2024-09-17T05:48:05.984920+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:47.152539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:47.152539+0000","last_clean_scrub_stamp":"2024-09-17T05:41:47.152539+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:08:02.952016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":13,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":12,"num_pg":32,"stat_sum":{"num_bytes":728,"num_objects":16,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":37,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":12,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":3116,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":28,"ondisk_log_size":28,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":16,"seq":68719476817,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":54424,"kb_used_data":1024,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94317416,"statfs":{"total":96636764160,"available":96581033984,"internally_reserved":0,"allocated":1048576,"data_stored":443474,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":54655430},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":7,"up_from":15,"seq":64424509521,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":50808,"kb_used_data":1568,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94321032,"statfs":{"total":96636764160,"available":96584736768,"internally_reserved":0,"allocated":1605632,"data_stored":1019930,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":50395594},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509520,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":50224,"kb_used_data":988,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94321616,"statfs":{"total":96636764160,"available":96585334784,"internally_reserved":0,"allocated":1011712,"data_stored":429562,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509520,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":50224,"kb_used_data":988,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94321616,"statfs":{"total":96636764160,"available":96585334784,"internally_reserved":0,"allocated":1011712,"data_stored":429562,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509520,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":72384,"kb_used_data":1000,"kb_used_omap":1,"kb_used_meta":71358,"kb_avail":94299456,"statfs":{"total":96636764160,"available":96562642944,"internally_reserved":0,"allocated":1024000,"data_stored":435921,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":73071047},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509520,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":50240,"kb_used_data":1000,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94321600,"statfs":{"total":96636764160,"available":96585318400,"internally_reserved":0,"allocated":1024000,"data_stored":435921,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509520,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":72412,"kb_used_data":1024,"kb_used_omap":1,"kb_used_meta":71358,"kb_avail":94299428,"statfs":{"total":96636764160,"available":96562614272,"internally_reserved":0,"allocated":1048576,"data_stored":442974,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":73071045},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574928,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55004,"kb_used_data":1608,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94316836,"statfs":{"total":96636764160,"available":96580440064,"internally_reserved":0,"allocated":1646592,"data_stored":1039566,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":194,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":694,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-17T05:48:11.028 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-17T05:48:11.177 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:11.175+0000 7f06c4120640 1 -- 172.21.15.150:0/2123678115 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f06bc15f350 msgr2=0x7f06bc15f760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:48:11.177 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:11.175+0000 7f06c4120640 1 --2- 172.21.15.150:0/2123678115 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f06bc15f350 0x7f06bc15f760 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f06ac009830 tx=0x7f06ac02a510 comp rx=0 tx=0).stop 2024-09-17T05:48:11.177 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:11.175+0000 7f06c4120640 1 -- 172.21.15.150:0/2123678115 shutdown_connections 2024-09-17T05:48:11.177 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:11.175+0000 7f06c4120640 1 --2- 172.21.15.150:0/2123678115 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f06bc15f350 0x7f06bc15f760 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:48:11.178 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:11.175+0000 7f06c4120640 1 --2- 172.21.15.150:0/2123678115 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f06bc152890 0x7f06bc075f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:48:11.178 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:11.175+0000 7f06c4120640 1 -- 172.21.15.150:0/2123678115 >> 172.21.15.150:0/2123678115 conn(0x7f06bc0d0b50 msgr2=0x7f06bc0d0f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:48:11.178 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:11.175+0000 7f06c4120640 1 -- 172.21.15.150:0/2123678115 shutdown_connections 2024-09-17T05:48:11.178 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:11.175+0000 7f06c4120640 1 -- 172.21.15.150:0/2123678115 wait complete. 2024-09-17T05:48:11.178 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:11.177+0000 7f06c4120640 1 Processor -- start 2024-09-17T05:48:11.178 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:11.177+0000 7f06c4120640 1 -- start start 2024-09-17T05:48:11.181 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:11.178+0000 7f06c4120640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f06bc152890 0x7f06bc0ae2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:48:11.181 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:11.178+0000 7f06c4120640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f06bc15bd10 0x7f06bc150490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:48:11.181 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:11.178+0000 7f06c4120640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f06bc15f350 0x7f06bc06cda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:48:11.182 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:11.178+0000 7f06c4120640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f06bc071920 con 0x7f06bc152890 2024-09-17T05:48:11.182 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:11.178+0000 7f06c4120640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f06bc0717a0 con 0x7f06bc15f350 2024-09-17T05:48:11.182 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:11.178+0000 7f06c4120640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f06bc071aa0 con 0x7f06bc15bd10 2024-09-17T05:48:11.182 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:11.179+0000 7f06c1ebc640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f06bc152890 0x7f06bc0ae2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:48:11.182 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:11.179+0000 7f06c1ebc640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f06bc152890 0x7f06bc0ae2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:34170/0 (socket says 172.21.15.150:34170) 2024-09-17T05:48:11.182 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:11.179+0000 7f06c1ebc640 1 -- 172.21.15.150:0/2268386681 learned_addr learned my addr 172.21.15.150:0/2268386681 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:48:11.182 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:11.179+0000 7f06c16bb640 1 --2- 172.21.15.150:0/2268386681 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f06bc15bd10 0x7f06bc150490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:48:11.182 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:11.179+0000 7f06c26bd640 1 --2- 172.21.15.150:0/2268386681 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f06bc15f350 0x7f06bc06cda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:48:11.182 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:11.179+0000 7f06c1ebc640 1 -- 172.21.15.150:0/2268386681 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f06bc15bd10 msgr2=0x7f06bc150490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:48:11.182 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:11.179+0000 7f06c1ebc640 1 --2- 172.21.15.150:0/2268386681 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f06bc15bd10 0x7f06bc150490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:48:11.182 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:11.179+0000 7f06c1ebc640 1 -- 172.21.15.150:0/2268386681 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f06bc15f350 msgr2=0x7f06bc06cda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:48:11.183 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:11.179+0000 7f06c1ebc640 1 --2- 172.21.15.150:0/2268386681 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f06bc15f350 0x7f06bc06cda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:48:11.183 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:11.179+0000 7f06c1ebc640 1 -- 172.21.15.150:0/2268386681 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f06bc0af480 con 0x7f06bc152890 2024-09-17T05:48:11.183 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:11.179+0000 7f06c1ebc640 1 --2- 172.21.15.150:0/2268386681 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f06bc152890 0x7f06bc0ae2d0 secure :-1 s=READY pgs=1016 cs=0 l=1 rev1=1 crypto rx=0x7f06b800e9c0 tx=0x7f06b800ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:48:11.183 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:11.179+0000 7f06b27fc640 1 -- 172.21.15.150:0/2268386681 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06b800cd20 con 0x7f06bc152890 2024-09-17T05:48:11.183 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:11.179+0000 7f06b27fc640 1 -- 172.21.15.150:0/2268386681 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f06b8004020 con 0x7f06bc152890 2024-09-17T05:48:11.183 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:11.179+0000 7f06b27fc640 1 -- 172.21.15.150:0/2268386681 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06b8004450 con 0x7f06bc152890 2024-09-17T05:48:11.183 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:11.179+0000 7f06c4120640 1 -- 172.21.15.150:0/2268386681 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f06bc0b0520 con 0x7f06bc152890 2024-09-17T05:48:11.183 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:11.179+0000 7f06c4120640 1 -- 172.21.15.150:0/2268386681 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f06bc0afa40 con 0x7f06bc152890 2024-09-17T05:48:11.184 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:11.180+0000 7f06c4120640 1 -- 172.21.15.150:0/2268386681 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f06bc15cb40 con 0x7f06bc152890 2024-09-17T05:48:11.184 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:11.181+0000 7f06b27fc640 1 -- 172.21.15.150:0/2268386681 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 25) ==== 103022+0+0 (secure 0 0 0) 0x7f06b80035f0 con 0x7f06bc152890 2024-09-17T05:48:11.184 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:11.182+0000 7f06b27fc640 1 --2- 172.21.15.150:0/2268386681 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f06a0079d00 0x7f06a007c210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:48:11.184 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:11.182+0000 7f06b27fc640 1 -- 172.21.15.150:0/2268386681 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 5793+0+0 (secure 0 0 0) 0x7f06b809a530 con 0x7f06bc152890 2024-09-17T05:48:11.184 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:11.182+0000 7f06c16bb640 1 --2- 172.21.15.150:0/2268386681 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f06a0079d00 0x7f06a007c210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:48:11.184 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:11.182+0000 7f06c16bb640 1 --2- 172.21.15.150:0/2268386681 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f06a0079d00 0x7f06a007c210 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f06ac034000 tx=0x7f06ac004730 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:48:11.188 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:11.186+0000 7f06b27fc640 1 -- 172.21.15.150:0/2268386681 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f06b8063a00 con 0x7f06bc152890 2024-09-17T05:48:11.359 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:11.357+0000 7f06c4120640 1 -- 172.21.15.150:0/2268386681 --> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f06bc0af230 con 0x7f06a0079d00 2024-09-17T05:48:11.363 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:11.362+0000 7f06b27fc640 1 -- 172.21.15.150:0/2268386681 <== mgr.4108 v2:172.21.15.176:6800/3631216395 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+249856 (secure 0 0 0) 0x7f06bc0af230 con 0x7f06a0079d00 2024-09-17T05:48:11.366 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-09-17T05:48:11.367 INFO:teuthology.orchestra.run.smithi150.stderr:dumped all 2024-09-17T05:48:11.369 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:11.365+0000 7f06c4120640 1 -- 172.21.15.150:0/2268386681 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f06a0079d00 msgr2=0x7f06a007c210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:48:11.369 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:11.365+0000 7f06c4120640 1 --2- 172.21.15.150:0/2268386681 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f06a0079d00 0x7f06a007c210 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f06ac034000 tx=0x7f06ac004730 comp rx=0 tx=0).stop 2024-09-17T05:48:11.369 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:11.365+0000 7f06c4120640 1 -- 172.21.15.150:0/2268386681 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f06bc152890 msgr2=0x7f06bc0ae2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:48:11.369 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:11.365+0000 7f06c4120640 1 --2- 172.21.15.150:0/2268386681 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f06bc152890 0x7f06bc0ae2d0 secure :-1 s=READY pgs=1016 cs=0 l=1 rev1=1 crypto rx=0x7f06b800e9c0 tx=0x7f06b800ee80 comp rx=0 tx=0).stop 2024-09-17T05:48:11.369 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:11.365+0000 7f06c4120640 1 -- 172.21.15.150:0/2268386681 shutdown_connections 2024-09-17T05:48:11.369 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:11.365+0000 7f06c4120640 1 --2- 172.21.15.150:0/2268386681 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f06bc15f350 0x7f06bc06cda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:48:11.369 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:11.365+0000 7f06c4120640 1 --2- 172.21.15.150:0/2268386681 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f06a0079d00 0x7f06a007c210 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:48:11.370 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:11.365+0000 7f06c4120640 1 --2- 172.21.15.150:0/2268386681 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f06bc15bd10 0x7f06bc150490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:48:11.370 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:11.365+0000 7f06c4120640 1 --2- 172.21.15.150:0/2268386681 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f06bc152890 0x7f06bc0ae2d0 unknown :-1 s=CLOSED pgs=1016 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:48:11.370 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:11.365+0000 7f06c4120640 1 -- 172.21.15.150:0/2268386681 >> 172.21.15.150:0/2268386681 conn(0x7f06bc0d0b50 msgr2=0x7f06bc15d600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:48:11.370 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:11.365+0000 7f06c4120640 1 -- 172.21.15.150:0/2268386681 shutdown_connections 2024-09-17T05:48:11.370 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:11.365+0000 7f06c4120640 1 -- 172.21.15.150:0/2268386681 wait complete. 2024-09-17T05:48:11.379 INFO:teuthology.orchestra.run.smithi150.stdout:{"pg_ready":true,"pg_map":{"version":273,"stamp":"2024-09-17T05:48:10.964995+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":591096,"num_objects":18,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":138,"num_write_kb":1638,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":12,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":100,"ondisk_log_size":100,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":65,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":455720,"kb_used_data":9200,"kb_used_omap":12,"kb_used_meta":446323,"kb_avail":754519000,"statfs":{"total":773094113280,"available":772627456000,"internally_reserved":0,"allocated":9420800,"data_stored":4676910,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":457035312},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":16,"apply_latency_ms":16,"commit_latency_ns":16000000,"apply_latency_ns":16000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":728,"num_objects":16,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":37,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":12,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.990092"},"pg_stats":[{"pgid":"13.3f","version":"0'0","reported_seq":10,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T05:48:07.021662+0000","last_change":"2024-09-17T05:48:07.019629+0000","last_active":"2024-09-17T05:48:07.021662+0000","last_peered":"2024-09-17T05:48:07.021662+0000","last_clean":"2024-09-17T05:48:07.021662+0000","last_became_active":"2024-09-17T05:48:07.019293+0000","last_became_peered":"2024-09-17T05:48:07.019293+0000","last_unstale":"2024-09-17T05:48:07.021662+0000","last_undegraded":"2024-09-17T05:48:07.021662+0000","last_fullsized":"2024-09-17T05:48:07.021662+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:48:05.973792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:48:05.973792+0000","last_clean_scrub_stamp":"2024-09-17T05:48:05.973792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:25:55.495958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.3e","version":"0'0","reported_seq":10,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T05:48:07.009336+0000","last_change":"2024-09-17T05:48:07.008371+0000","last_active":"2024-09-17T05:48:07.009336+0000","last_peered":"2024-09-17T05:48:07.009336+0000","last_clean":"2024-09-17T05:48:07.009336+0000","last_became_active":"2024-09-17T05:48:07.008069+0000","last_became_peered":"2024-09-17T05:48:07.008069+0000","last_unstale":"2024-09-17T05:48:07.009336+0000","last_undegraded":"2024-09-17T05:48:07.009336+0000","last_fullsized":"2024-09-17T05:48:07.009336+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:48:05.973792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:48:05.973792+0000","last_clean_scrub_stamp":"2024-09-17T05:48:05.973792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:17:03.542296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.3d","version":"0'0","reported_seq":1,"reported_epoch":84,"state":"creating+peering","last_fresh":"2024-09-17T05:48:05.981187+0000","last_change":"2024-09-17T05:48:05.981187+0000","last_active":"2024-09-17T05:48:05.973792+0000","last_peered":"2024-09-17T05:48:05.973792+0000","last_clean":"2024-09-17T05:48:05.973792+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:48:05.981187+0000","last_undegraded":"2024-09-17T05:48:05.981187+0000","last_fullsized":"2024-09-17T05:48:05.981187+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:48:05.973792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:48:05.973792+0000","last_clean_scrub_stamp":"2024-09-17T05:48:05.973792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.3c","version":"0'0","reported_seq":10,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T05:48:06.998187+0000","last_change":"2024-09-17T05:48:06.997015+0000","last_active":"2024-09-17T05:48:06.998187+0000","last_peered":"2024-09-17T05:48:06.998187+0000","last_clean":"2024-09-17T05:48:06.998187+0000","last_became_active":"2024-09-17T05:48:06.996664+0000","last_became_peered":"2024-09-17T05:48:06.996664+0000","last_unstale":"2024-09-17T05:48:06.998187+0000","last_undegraded":"2024-09-17T05:48:06.998187+0000","last_fullsized":"2024-09-17T05:48:06.998187+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:48:05.973792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:48:05.973792+0000","last_clean_scrub_stamp":"2024-09-17T05:48:05.973792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:29:24.565960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.3b","version":"0'0","reported_seq":1,"reported_epoch":84,"state":"creating+peering","last_fresh":"2024-09-17T05:48:05.990716+0000","last_change":"2024-09-17T05:48:05.990716+0000","last_active":"2024-09-17T05:48:05.973792+0000","last_peered":"2024-09-17T05:48:05.973792+0000","last_clean":"2024-09-17T05:48:05.973792+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:48:05.990716+0000","last_undegraded":"2024-09-17T05:48:05.990716+0000","last_fullsized":"2024-09-17T05:48:05.990716+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:48:05.973792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:48:05.973792+0000","last_clean_scrub_stamp":"2024-09-17T05:48:05.973792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.3a","version":"0'0","reported_seq":1,"reported_epoch":84,"state":"creating+peering","last_fresh":"2024-09-17T05:48:05.986085+0000","last_change":"2024-09-17T05:48:05.986085+0000","last_active":"2024-09-17T05:48:05.973792+0000","last_peered":"2024-09-17T05:48:05.973792+0000","last_clean":"2024-09-17T05:48:05.973792+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:48:05.986085+0000","last_undegraded":"2024-09-17T05:48:05.986085+0000","last_fullsized":"2024-09-17T05:48:05.986085+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:48:05.973792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:48:05.973792+0000","last_clean_scrub_stamp":"2024-09-17T05:48:05.973792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.39","version":"0'0","reported_seq":10,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T05:48:07.007609+0000","last_change":"2024-09-17T05:48:07.004879+0000","last_active":"2024-09-17T05:48:07.007609+0000","last_peered":"2024-09-17T05:48:07.007609+0000","last_clean":"2024-09-17T05:48:07.007609+0000","last_became_active":"2024-09-17T05:48:07.004432+0000","last_became_peered":"2024-09-17T05:48:07.004432+0000","last_unstale":"2024-09-17T05:48:07.007609+0000","last_undegraded":"2024-09-17T05:48:07.007609+0000","last_fullsized":"2024-09-17T05:48:07.007609+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:48:05.973792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:48:05.973792+0000","last_clean_scrub_stamp":"2024-09-17T05:48:05.973792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:41:11.072932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.38","version":"0'0","reported_seq":1,"reported_epoch":84,"state":"creating+peering","last_fresh":"2024-09-17T05:48:05.984329+0000","last_change":"2024-09-17T05:48:05.984329+0000","last_active":"2024-09-17T05:48:05.973792+0000","last_peered":"2024-09-17T05:48:05.973792+0000","last_clean":"2024-09-17T05:48:05.973792+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:48:05.984329+0000","last_undegraded":"2024-09-17T05:48:05.984329+0000","last_fullsized":"2024-09-17T05:48:05.984329+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:48:05.973792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:48:05.973792+0000","last_clean_scrub_stamp":"2024-09-17T05:48:05.973792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.37","version":"0'0","reported_seq":1,"reported_epoch":84,"state":"creating+peering","last_fresh":"2024-09-17T05:48:05.986183+0000","last_change":"2024-09-17T05:48:05.986183+0000","last_active":"2024-09-17T05:48:05.973792+0000","last_peered":"2024-09-17T05:48:05.973792+0000","last_clean":"2024-09-17T05:48:05.973792+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:48:05.986183+0000","last_undegraded":"2024-09-17T05:48:05.986183+0000","last_fullsized":"2024-09-17T05:48:05.986183+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:48:05.973792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:48:05.973792+0000","last_clean_scrub_stamp":"2024-09-17T05:48:05.973792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.36","version":"0'0","reported_seq":10,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T05:48:07.008314+0000","last_change":"2024-09-17T05:48:07.006474+0000","last_active":"2024-09-17T05:48:07.008314+0000","last_peered":"2024-09-17T05:48:07.008314+0000","last_clean":"2024-09-17T05:48:07.008314+0000","last_became_active":"2024-09-17T05:48:07.006080+0000","last_became_peered":"2024-09-17T05:48:07.006080+0000","last_unstale":"2024-09-17T05:48:07.008314+0000","last_undegraded":"2024-09-17T05:48:07.008314+0000","last_fullsized":"2024-09-17T05:48:07.008314+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:48:05.973792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:48:05.973792+0000","last_clean_scrub_stamp":"2024-09-17T05:48:05.973792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:11:43.970133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.35","version":"0'0","reported_seq":10,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T05:48:07.009233+0000","last_change":"2024-09-17T05:48:07.007493+0000","last_active":"2024-09-17T05:48:07.009233+0000","last_peered":"2024-09-17T05:48:07.009233+0000","last_clean":"2024-09-17T05:48:07.009233+0000","last_became_active":"2024-09-17T05:48:07.007110+0000","last_became_peered":"2024-09-17T05:48:07.007110+0000","last_unstale":"2024-09-17T05:48:07.009233+0000","last_undegraded":"2024-09-17T05:48:07.009233+0000","last_fullsized":"2024-09-17T05:48:07.009233+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:48:05.973792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:48:05.973792+0000","last_clean_scrub_stamp":"2024-09-17T05:48:05.973792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:02:09.211126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.34","version":"0'0","reported_seq":10,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T05:48:07.016908+0000","last_change":"2024-09-17T05:48:07.010311+0000","last_active":"2024-09-17T05:48:07.016908+0000","last_peered":"2024-09-17T05:48:07.016908+0000","last_clean":"2024-09-17T05:48:07.016908+0000","last_became_active":"2024-09-17T05:48:07.008909+0000","last_became_peered":"2024-09-17T05:48:07.008909+0000","last_unstale":"2024-09-17T05:48:07.016908+0000","last_undegraded":"2024-09-17T05:48:07.016908+0000","last_fullsized":"2024-09-17T05:48:07.016908+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:48:05.973792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:48:05.973792+0000","last_clean_scrub_stamp":"2024-09-17T05:48:05.973792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:45:16.917183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.33","version":"0'0","reported_seq":1,"reported_epoch":84,"state":"creating+peering","last_fresh":"2024-09-17T05:48:05.980666+0000","last_change":"2024-09-17T05:48:05.980666+0000","last_active":"2024-09-17T05:48:05.973792+0000","last_peered":"2024-09-17T05:48:05.973792+0000","last_clean":"2024-09-17T05:48:05.973792+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:48:05.980666+0000","last_undegraded":"2024-09-17T05:48:05.980666+0000","last_fullsized":"2024-09-17T05:48:05.980666+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:48:05.973792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:48:05.973792+0000","last_clean_scrub_stamp":"2024-09-17T05:48:05.973792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.32","version":"0'0","reported_seq":10,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T05:48:07.004126+0000","last_change":"2024-09-17T05:48:06.999966+0000","last_active":"2024-09-17T05:48:07.004126+0000","last_peered":"2024-09-17T05:48:07.004126+0000","last_clean":"2024-09-17T05:48:07.004126+0000","last_became_active":"2024-09-17T05:48:06.999522+0000","last_became_peered":"2024-09-17T05:48:06.999522+0000","last_unstale":"2024-09-17T05:48:07.004126+0000","last_undegraded":"2024-09-17T05:48:07.004126+0000","last_fullsized":"2024-09-17T05:48:07.004126+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:48:05.973792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:48:05.973792+0000","last_clean_scrub_stamp":"2024-09-17T05:48:05.973792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:56:39.787601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.31","version":"0'0","reported_seq":10,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T05:48:07.008515+0000","last_change":"2024-09-17T05:48:07.006783+0000","last_active":"2024-09-17T05:48:07.008515+0000","last_peered":"2024-09-17T05:48:07.008515+0000","last_clean":"2024-09-17T05:48:07.008515+0000","last_became_active":"2024-09-17T05:48:07.006179+0000","last_became_peered":"2024-09-17T05:48:07.006179+0000","last_unstale":"2024-09-17T05:48:07.008515+0000","last_undegraded":"2024-09-17T05:48:07.008515+0000","last_fullsized":"2024-09-17T05:48:07.008515+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:48:05.973792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:48:05.973792+0000","last_clean_scrub_stamp":"2024-09-17T05:48:05.973792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:25:14.968274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.30","version":"0'0","reported_seq":1,"reported_epoch":84,"state":"creating+peering","last_fresh":"2024-09-17T05:48:05.986337+0000","last_change":"2024-09-17T05:48:05.986337+0000","last_active":"2024-09-17T05:48:05.973792+0000","last_peered":"2024-09-17T05:48:05.973792+0000","last_clean":"2024-09-17T05:48:05.973792+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:48:05.986337+0000","last_undegraded":"2024-09-17T05:48:05.986337+0000","last_fullsized":"2024-09-17T05:48:05.986337+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:48:05.973792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:48:05.973792+0000","last_clean_scrub_stamp":"2024-09-17T05:48:05.973792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.2f","version":"0'0","reported_seq":1,"reported_epoch":84,"state":"creating+peering","last_fresh":"2024-09-17T05:48:05.983346+0000","last_change":"2024-09-17T05:48:05.983346+0000","last_active":"2024-09-17T05:48:05.973792+0000","last_peered":"2024-09-17T05:48:05.973792+0000","last_clean":"2024-09-17T05:48:05.973792+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:48:05.983346+0000","last_undegraded":"2024-09-17T05:48:05.983346+0000","last_fullsized":"2024-09-17T05:48:05.983346+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:48:05.973792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:48:05.973792+0000","last_clean_scrub_stamp":"2024-09-17T05:48:05.973792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.2e","version":"0'0","reported_seq":10,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T05:48:07.013532+0000","last_change":"2024-09-17T05:48:07.012645+0000","last_active":"2024-09-17T05:48:07.013532+0000","last_peered":"2024-09-17T05:48:07.013532+0000","last_clean":"2024-09-17T05:48:07.013532+0000","last_became_active":"2024-09-17T05:48:07.012337+0000","last_became_peered":"2024-09-17T05:48:07.012337+0000","last_unstale":"2024-09-17T05:48:07.013532+0000","last_undegraded":"2024-09-17T05:48:07.013532+0000","last_fullsized":"2024-09-17T05:48:07.013532+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:48:05.973792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:48:05.973792+0000","last_clean_scrub_stamp":"2024-09-17T05:48:05.973792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:04:39.379785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2d","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-17T05:48:08.017801+0000","last_change":"2024-09-17T05:48:07.003509+0000","last_active":"2024-09-17T05:48:08.017801+0000","last_peered":"2024-09-17T05:48:08.017801+0000","last_clean":"2024-09-17T05:48:08.017801+0000","last_became_active":"2024-09-17T05:48:07.003226+0000","last_became_peered":"2024-09-17T05:48:07.003226+0000","last_unstale":"2024-09-17T05:48:08.017801+0000","last_undegraded":"2024-09-17T05:48:08.017801+0000","last_fullsized":"2024-09-17T05:48:08.017801+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:48:05.973792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:48:05.973792+0000","last_clean_scrub_stamp":"2024-09-17T05:48:05.973792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:30:08.358108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.2c","version":"0'0","reported_seq":10,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T05:48:07.011887+0000","last_change":"2024-09-17T05:48:07.010456+0000","last_active":"2024-09-17T05:48:07.011887+0000","last_peered":"2024-09-17T05:48:07.011887+0000","last_clean":"2024-09-17T05:48:07.011887+0000","last_became_active":"2024-09-17T05:48:07.010136+0000","last_became_peered":"2024-09-17T05:48:07.010136+0000","last_unstale":"2024-09-17T05:48:07.011887+0000","last_undegraded":"2024-09-17T05:48:07.011887+0000","last_fullsized":"2024-09-17T05:48:07.011887+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:48:05.973792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:48:05.973792+0000","last_clean_scrub_stamp":"2024-09-17T05:48:05.973792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:02:04.762505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2b","version":"0'0","reported_seq":10,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T05:48:07.013497+0000","last_change":"2024-09-17T05:48:07.011524+0000","last_active":"2024-09-17T05:48:07.013497+0000","last_peered":"2024-09-17T05:48:07.013497+0000","last_clean":"2024-09-17T05:48:07.013497+0000","last_became_active":"2024-09-17T05:48:07.011186+0000","last_became_peered":"2024-09-17T05:48:07.011186+0000","last_unstale":"2024-09-17T05:48:07.013497+0000","last_undegraded":"2024-09-17T05:48:07.013497+0000","last_fullsized":"2024-09-17T05:48:07.013497+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:48:05.973792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:48:05.973792+0000","last_clean_scrub_stamp":"2024-09-17T05:48:05.973792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:06:26.531883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2a","version":"0'0","reported_seq":10,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T05:48:07.012966+0000","last_change":"2024-09-17T05:48:07.011513+0000","last_active":"2024-09-17T05:48:07.012966+0000","last_peered":"2024-09-17T05:48:07.012966+0000","last_clean":"2024-09-17T05:48:07.012966+0000","last_became_active":"2024-09-17T05:48:07.011207+0000","last_became_peered":"2024-09-17T05:48:07.011207+0000","last_unstale":"2024-09-17T05:48:07.012966+0000","last_undegraded":"2024-09-17T05:48:07.012966+0000","last_fullsized":"2024-09-17T05:48:07.012966+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:48:05.973792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:48:05.973792+0000","last_clean_scrub_stamp":"2024-09-17T05:48:05.973792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:25:04.204546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.29","version":"0'0","reported_seq":10,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T05:48:07.018768+0000","last_change":"2024-09-17T05:48:07.016145+0000","last_active":"2024-09-17T05:48:07.018768+0000","last_peered":"2024-09-17T05:48:07.018768+0000","last_clean":"2024-09-17T05:48:07.018768+0000","last_became_active":"2024-09-17T05:48:07.015802+0000","last_became_peered":"2024-09-17T05:48:07.015802+0000","last_unstale":"2024-09-17T05:48:07.018768+0000","last_undegraded":"2024-09-17T05:48:07.018768+0000","last_fullsized":"2024-09-17T05:48:07.018768+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:48:05.973792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:48:05.973792+0000","last_clean_scrub_stamp":"2024-09-17T05:48:05.973792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:38:27.328456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.28","version":"0'0","reported_seq":10,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T05:48:07.013189+0000","last_change":"2024-09-17T05:48:07.010500+0000","last_active":"2024-09-17T05:48:07.013189+0000","last_peered":"2024-09-17T05:48:07.013189+0000","last_clean":"2024-09-17T05:48:07.013189+0000","last_became_active":"2024-09-17T05:48:07.010182+0000","last_became_peered":"2024-09-17T05:48:07.010182+0000","last_unstale":"2024-09-17T05:48:07.013189+0000","last_undegraded":"2024-09-17T05:48:07.013189+0000","last_fullsized":"2024-09-17T05:48:07.013189+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:48:05.973792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:48:05.973792+0000","last_clean_scrub_stamp":"2024-09-17T05:48:05.973792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:43:27.386419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.27","version":"0'0","reported_seq":10,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T05:48:07.007625+0000","last_change":"2024-09-17T05:48:07.004954+0000","last_active":"2024-09-17T05:48:07.007625+0000","last_peered":"2024-09-17T05:48:07.007625+0000","last_clean":"2024-09-17T05:48:07.007625+0000","last_became_active":"2024-09-17T05:48:07.004656+0000","last_became_peered":"2024-09-17T05:48:07.004656+0000","last_unstale":"2024-09-17T05:48:07.007625+0000","last_undegraded":"2024-09-17T05:48:07.007625+0000","last_fullsized":"2024-09-17T05:48:07.007625+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:48:05.973792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:48:05.973792+0000","last_clean_scrub_stamp":"2024-09-17T05:48:05.973792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:07:51.657806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.26","version":"0'0","reported_seq":1,"reported_epoch":84,"state":"creating+peering","last_fresh":"2024-09-17T05:48:05.981443+0000","last_change":"2024-09-17T05:48:05.981443+0000","last_active":"2024-09-17T05:48:05.973792+0000","last_peered":"2024-09-17T05:48:05.973792+0000","last_clean":"2024-09-17T05:48:05.973792+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:48:05.981443+0000","last_undegraded":"2024-09-17T05:48:05.981443+0000","last_fullsized":"2024-09-17T05:48:05.981443+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:48:05.973792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:48:05.973792+0000","last_clean_scrub_stamp":"2024-09-17T05:48:05.973792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.25","version":"0'0","reported_seq":1,"reported_epoch":84,"state":"creating+peering","last_fresh":"2024-09-17T05:48:05.988800+0000","last_change":"2024-09-17T05:48:05.988800+0000","last_active":"2024-09-17T05:48:05.973792+0000","last_peered":"2024-09-17T05:48:05.973792+0000","last_clean":"2024-09-17T05:48:05.973792+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:48:05.988800+0000","last_undegraded":"2024-09-17T05:48:05.988800+0000","last_fullsized":"2024-09-17T05:48:05.988800+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:48:05.973792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:48:05.973792+0000","last_clean_scrub_stamp":"2024-09-17T05:48:05.973792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.24","version":"0'0","reported_seq":10,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T05:48:07.021931+0000","last_change":"2024-09-17T05:48:07.021372+0000","last_active":"2024-09-17T05:48:07.021931+0000","last_peered":"2024-09-17T05:48:07.021931+0000","last_clean":"2024-09-17T05:48:07.021931+0000","last_became_active":"2024-09-17T05:48:07.019410+0000","last_became_peered":"2024-09-17T05:48:07.019410+0000","last_unstale":"2024-09-17T05:48:07.021931+0000","last_undegraded":"2024-09-17T05:48:07.021931+0000","last_fullsized":"2024-09-17T05:48:07.021931+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:48:05.973792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:48:05.973792+0000","last_clean_scrub_stamp":"2024-09-17T05:48:05.973792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:16:14.965629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.23","version":"0'0","reported_seq":10,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T05:48:07.006158+0000","last_change":"2024-09-17T05:48:07.002555+0000","last_active":"2024-09-17T05:48:07.006158+0000","last_peered":"2024-09-17T05:48:07.006158+0000","last_clean":"2024-09-17T05:48:07.006158+0000","last_became_active":"2024-09-17T05:48:07.002263+0000","last_became_peered":"2024-09-17T05:48:07.002263+0000","last_unstale":"2024-09-17T05:48:07.006158+0000","last_undegraded":"2024-09-17T05:48:07.006158+0000","last_fullsized":"2024-09-17T05:48:07.006158+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:48:05.973792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:48:05.973792+0000","last_clean_scrub_stamp":"2024-09-17T05:48:05.973792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:08:12.460618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.22","version":"0'0","reported_seq":10,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T05:48:07.008627+0000","last_change":"2024-09-17T05:48:07.003556+0000","last_active":"2024-09-17T05:48:07.008627+0000","last_peered":"2024-09-17T05:48:07.008627+0000","last_clean":"2024-09-17T05:48:07.008627+0000","last_became_active":"2024-09-17T05:48:07.003232+0000","last_became_peered":"2024-09-17T05:48:07.003232+0000","last_unstale":"2024-09-17T05:48:07.008627+0000","last_undegraded":"2024-09-17T05:48:07.008627+0000","last_fullsized":"2024-09-17T05:48:07.008627+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:48:05.973792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:48:05.973792+0000","last_clean_scrub_stamp":"2024-09-17T05:48:05.973792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:55:03.368792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.21","version":"0'0","reported_seq":1,"reported_epoch":84,"state":"creating+peering","last_fresh":"2024-09-17T05:48:05.982834+0000","last_change":"2024-09-17T05:48:05.982834+0000","last_active":"2024-09-17T05:48:05.973792+0000","last_peered":"2024-09-17T05:48:05.973792+0000","last_clean":"2024-09-17T05:48:05.973792+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:48:05.982834+0000","last_undegraded":"2024-09-17T05:48:05.982834+0000","last_fullsized":"2024-09-17T05:48:05.982834+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:48:05.973792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:48:05.973792+0000","last_clean_scrub_stamp":"2024-09-17T05:48:05.973792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.20","version":"0'0","reported_seq":10,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T05:48:07.015971+0000","last_change":"2024-09-17T05:48:07.009478+0000","last_active":"2024-09-17T05:48:07.015971+0000","last_peered":"2024-09-17T05:48:07.015971+0000","last_clean":"2024-09-17T05:48:07.015971+0000","last_became_active":"2024-09-17T05:48:07.009198+0000","last_became_peered":"2024-09-17T05:48:07.009198+0000","last_unstale":"2024-09-17T05:48:07.015971+0000","last_undegraded":"2024-09-17T05:48:07.015971+0000","last_fullsized":"2024-09-17T05:48:07.015971+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:48:05.973792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:48:05.973792+0000","last_clean_scrub_stamp":"2024-09-17T05:48:05.973792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:54:11.908409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1e","version":"0'0","reported_seq":1,"reported_epoch":84,"state":"creating+peering","last_fresh":"2024-09-17T05:48:05.989512+0000","last_change":"2024-09-17T05:48:05.989512+0000","last_active":"2024-09-17T05:48:05.973792+0000","last_peered":"2024-09-17T05:48:05.973792+0000","last_clean":"2024-09-17T05:48:05.973792+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:48:05.989512+0000","last_undegraded":"2024-09-17T05:48:05.989512+0000","last_fullsized":"2024-09-17T05:48:05.989512+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:48:05.973792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:48:05.973792+0000","last_clean_scrub_stamp":"2024-09-17T05:48:05.973792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1f","version":"85'4","reported_seq":17,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T05:48:07.027168+0000","last_change":"2024-09-17T05:48:05.997338+0000","last_active":"2024-09-17T05:48:07.027168+0000","last_peered":"2024-09-17T05:48:07.027168+0000","last_clean":"2024-09-17T05:48:07.027168+0000","last_became_active":"2024-09-17T05:48:05.996975+0000","last_became_peered":"2024-09-17T05:48:05.996975+0000","last_unstale":"2024-09-17T05:48:07.027168+0000","last_undegraded":"2024-09-17T05:48:07.027168+0000","last_fullsized":"2024-09-17T05:48:07.027168+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:48:04.965082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:48:04.965082+0000","last_clean_scrub_stamp":"2024-09-17T05:48:04.965082+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:18:51.809325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1f","version":"0'0","reported_seq":10,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T05:48:07.017293+0000","last_change":"2024-09-17T05:48:07.013038+0000","last_active":"2024-09-17T05:48:07.017293+0000","last_peered":"2024-09-17T05:48:07.017293+0000","last_clean":"2024-09-17T05:48:07.017293+0000","last_became_active":"2024-09-17T05:48:07.012730+0000","last_became_peered":"2024-09-17T05:48:07.012730+0000","last_unstale":"2024-09-17T05:48:07.017293+0000","last_undegraded":"2024-09-17T05:48:07.017293+0000","last_fullsized":"2024-09-17T05:48:07.017293+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:48:05.973792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:48:05.973792+0000","last_clean_scrub_stamp":"2024-09-17T05:48:05.973792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:25:22.303460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.1e","version":"0'0","reported_seq":10,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-17T05:48:05.997003+0000","last_change":"2024-09-17T05:48:05.995823+0000","last_active":"2024-09-17T05:48:05.997003+0000","last_peered":"2024-09-17T05:48:05.997003+0000","last_clean":"2024-09-17T05:48:05.997003+0000","last_became_active":"2024-09-17T05:48:05.995488+0000","last_became_peered":"2024-09-17T05:48:05.995488+0000","last_unstale":"2024-09-17T05:48:05.997003+0000","last_undegraded":"2024-09-17T05:48:05.997003+0000","last_fullsized":"2024-09-17T05:48:05.997003+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:48:04.965082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:48:04.965082+0000","last_clean_scrub_stamp":"2024-09-17T05:48:04.965082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:09:48.701468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.1c","version":"0'0","reported_seq":10,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T05:48:07.016959+0000","last_change":"2024-09-17T05:48:07.011380+0000","last_active":"2024-09-17T05:48:07.016959+0000","last_peered":"2024-09-17T05:48:07.016959+0000","last_clean":"2024-09-17T05:48:07.016959+0000","last_became_active":"2024-09-17T05:48:07.011078+0000","last_became_peered":"2024-09-17T05:48:07.011078+0000","last_unstale":"2024-09-17T05:48:07.016959+0000","last_undegraded":"2024-09-17T05:48:07.016959+0000","last_fullsized":"2024-09-17T05:48:07.016959+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:48:05.973792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:48:05.973792+0000","last_clean_scrub_stamp":"2024-09-17T05:48:05.973792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:45:26.386010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.1d","version":"85'2","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-17T05:48:08.017837+0000","last_change":"2024-09-17T05:48:05.995146+0000","last_active":"2024-09-17T05:48:08.017837+0000","last_peered":"2024-09-17T05:48:08.017837+0000","last_clean":"2024-09-17T05:48:08.017837+0000","last_became_active":"2024-09-17T05:48:05.994843+0000","last_became_peered":"2024-09-17T05:48:05.994843+0000","last_unstale":"2024-09-17T05:48:08.017837+0000","last_undegraded":"2024-09-17T05:48:08.017837+0000","last_fullsized":"2024-09-17T05:48:08.017837+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:48:04.965082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:48:04.965082+0000","last_clean_scrub_stamp":"2024-09-17T05:48:04.965082+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:08:12.896308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1d","version":"0'0","reported_seq":1,"reported_epoch":84,"state":"creating+peering","last_fresh":"2024-09-17T05:48:05.980180+0000","last_change":"2024-09-17T05:48:05.980180+0000","last_active":"2024-09-17T05:48:05.973792+0000","last_peered":"2024-09-17T05:48:05.973792+0000","last_clean":"2024-09-17T05:48:05.973792+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:48:05.980180+0000","last_undegraded":"2024-09-17T05:48:05.980180+0000","last_fullsized":"2024-09-17T05:48:05.980180+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:48:05.973792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:48:05.973792+0000","last_clean_scrub_stamp":"2024-09-17T05:48:05.973792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1c","version":"85'2","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-17T05:48:08.017546+0000","last_change":"2024-09-17T05:48:05.996138+0000","last_active":"2024-09-17T05:48:08.017546+0000","last_peered":"2024-09-17T05:48:08.017546+0000","last_clean":"2024-09-17T05:48:08.017546+0000","last_became_active":"2024-09-17T05:48:05.995742+0000","last_became_peered":"2024-09-17T05:48:05.995742+0000","last_unstale":"2024-09-17T05:48:08.017546+0000","last_undegraded":"2024-09-17T05:48:08.017546+0000","last_fullsized":"2024-09-17T05:48:08.017546+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:48:04.965082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:48:04.965082+0000","last_clean_scrub_stamp":"2024-09-17T05:48:04.965082+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:07:07.086219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1a","version":"0'0","reported_seq":10,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T05:48:07.008594+0000","last_change":"2024-09-17T05:48:07.003430+0000","last_active":"2024-09-17T05:48:07.008594+0000","last_peered":"2024-09-17T05:48:07.008594+0000","last_clean":"2024-09-17T05:48:07.008594+0000","last_became_active":"2024-09-17T05:48:07.002894+0000","last_became_peered":"2024-09-17T05:48:07.002894+0000","last_unstale":"2024-09-17T05:48:07.008594+0000","last_undegraded":"2024-09-17T05:48:07.008594+0000","last_fullsized":"2024-09-17T05:48:07.008594+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:48:05.973792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:48:05.973792+0000","last_clean_scrub_stamp":"2024-09-17T05:48:05.973792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:41:40.435956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.1b","version":"0'0","reported_seq":10,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-17T05:48:06.000918+0000","last_change":"2024-09-17T05:48:06.000106+0000","last_active":"2024-09-17T05:48:06.000918+0000","last_peered":"2024-09-17T05:48:06.000918+0000","last_clean":"2024-09-17T05:48:06.000918+0000","last_became_active":"2024-09-17T05:48:05.999798+0000","last_became_peered":"2024-09-17T05:48:05.999798+0000","last_unstale":"2024-09-17T05:48:06.000918+0000","last_undegraded":"2024-09-17T05:48:06.000918+0000","last_fullsized":"2024-09-17T05:48:06.000918+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:48:04.965082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:48:04.965082+0000","last_clean_scrub_stamp":"2024-09-17T05:48:04.965082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:16:50.545089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.1b","version":"0'0","reported_seq":1,"reported_epoch":84,"state":"creating+peering","last_fresh":"2024-09-17T05:48:05.989943+0000","last_change":"2024-09-17T05:48:05.989943+0000","last_active":"2024-09-17T05:48:05.973792+0000","last_peered":"2024-09-17T05:48:05.973792+0000","last_clean":"2024-09-17T05:48:05.973792+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:48:05.989943+0000","last_undegraded":"2024-09-17T05:48:05.989943+0000","last_fullsized":"2024-09-17T05:48:05.989943+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:48:05.973792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:48:05.973792+0000","last_clean_scrub_stamp":"2024-09-17T05:48:05.973792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1a","version":"0'0","reported_seq":10,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-17T05:48:05.998331+0000","last_change":"2024-09-17T05:48:05.996177+0000","last_active":"2024-09-17T05:48:05.998331+0000","last_peered":"2024-09-17T05:48:05.998331+0000","last_clean":"2024-09-17T05:48:05.998331+0000","last_became_active":"2024-09-17T05:48:05.995803+0000","last_became_peered":"2024-09-17T05:48:05.995803+0000","last_unstale":"2024-09-17T05:48:05.998331+0000","last_undegraded":"2024-09-17T05:48:05.998331+0000","last_fullsized":"2024-09-17T05:48:05.998331+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:48:04.965082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:48:04.965082+0000","last_clean_scrub_stamp":"2024-09-17T05:48:04.965082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:29:46.170441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.18","version":"0'0","reported_seq":1,"reported_epoch":84,"state":"creating+peering","last_fresh":"2024-09-17T05:48:05.980690+0000","last_change":"2024-09-17T05:48:05.980690+0000","last_active":"2024-09-17T05:48:05.973792+0000","last_peered":"2024-09-17T05:48:05.973792+0000","last_clean":"2024-09-17T05:48:05.973792+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:48:05.980690+0000","last_undegraded":"2024-09-17T05:48:05.980690+0000","last_fullsized":"2024-09-17T05:48:05.980690+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:48:05.973792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:48:05.973792+0000","last_clean_scrub_stamp":"2024-09-17T05:48:05.973792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.19","version":"0'0","reported_seq":15,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-17T05:48:08.017351+0000","last_change":"2024-09-17T05:48:05.994519+0000","last_active":"2024-09-17T05:48:08.017351+0000","last_peered":"2024-09-17T05:48:08.017351+0000","last_clean":"2024-09-17T05:48:08.017351+0000","last_became_active":"2024-09-17T05:48:05.994089+0000","last_became_peered":"2024-09-17T05:48:05.994089+0000","last_unstale":"2024-09-17T05:48:08.017351+0000","last_undegraded":"2024-09-17T05:48:08.017351+0000","last_fullsized":"2024-09-17T05:48:08.017351+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:48:04.965082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:48:04.965082+0000","last_clean_scrub_stamp":"2024-09-17T05:48:04.965082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:10:49.729836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.19","version":"0'0","reported_seq":10,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T05:48:07.008542+0000","last_change":"2024-09-17T05:48:07.006952+0000","last_active":"2024-09-17T05:48:07.008542+0000","last_peered":"2024-09-17T05:48:07.008542+0000","last_clean":"2024-09-17T05:48:07.008542+0000","last_became_active":"2024-09-17T05:48:07.006627+0000","last_became_peered":"2024-09-17T05:48:07.006627+0000","last_unstale":"2024-09-17T05:48:07.008542+0000","last_undegraded":"2024-09-17T05:48:07.008542+0000","last_fullsized":"2024-09-17T05:48:07.008542+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:48:05.973792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:48:05.973792+0000","last_clean_scrub_stamp":"2024-09-17T05:48:05.973792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:01:24.000485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.18","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T05:48:06.991703+0000","last_change":"2024-09-17T05:48:05.999386+0000","last_active":"2024-09-17T05:48:06.991703+0000","last_peered":"2024-09-17T05:48:06.991703+0000","last_clean":"2024-09-17T05:48:06.991703+0000","last_became_active":"2024-09-17T05:48:05.999075+0000","last_became_peered":"2024-09-17T05:48:05.999075+0000","last_unstale":"2024-09-17T05:48:06.991703+0000","last_undegraded":"2024-09-17T05:48:06.991703+0000","last_fullsized":"2024-09-17T05:48:06.991703+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:48:04.965082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:48:04.965082+0000","last_clean_scrub_stamp":"2024-09-17T05:48:04.965082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:02:12.685719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.16","version":"0'0","reported_seq":10,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T05:48:07.007163+0000","last_change":"2024-09-17T05:48:07.004229+0000","last_active":"2024-09-17T05:48:07.007163+0000","last_peered":"2024-09-17T05:48:07.007163+0000","last_clean":"2024-09-17T05:48:07.007163+0000","last_became_active":"2024-09-17T05:48:07.003931+0000","last_became_peered":"2024-09-17T05:48:07.003931+0000","last_unstale":"2024-09-17T05:48:07.007163+0000","last_undegraded":"2024-09-17T05:48:07.007163+0000","last_fullsized":"2024-09-17T05:48:07.007163+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:48:05.973792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:48:05.973792+0000","last_clean_scrub_stamp":"2024-09-17T05:48:05.973792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:40:53.536640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.17","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T05:48:07.000319+0000","last_change":"2024-09-17T05:48:05.994108+0000","last_active":"2024-09-17T05:48:07.000319+0000","last_peered":"2024-09-17T05:48:07.000319+0000","last_clean":"2024-09-17T05:48:07.000319+0000","last_became_active":"2024-09-17T05:48:05.993676+0000","last_became_peered":"2024-09-17T05:48:05.993676+0000","last_unstale":"2024-09-17T05:48:07.000319+0000","last_undegraded":"2024-09-17T05:48:07.000319+0000","last_fullsized":"2024-09-17T05:48:07.000319+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:48:04.965082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:48:04.965082+0000","last_clean_scrub_stamp":"2024-09-17T05:48:04.965082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:36:21.212798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.17","version":"0'0","reported_seq":1,"reported_epoch":84,"state":"creating+peering","last_fresh":"2024-09-17T05:48:05.985621+0000","last_change":"2024-09-17T05:48:05.985621+0000","last_active":"2024-09-17T05:48:05.973792+0000","last_peered":"2024-09-17T05:48:05.973792+0000","last_clean":"2024-09-17T05:48:05.973792+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:48:05.985621+0000","last_undegraded":"2024-09-17T05:48:05.985621+0000","last_fullsized":"2024-09-17T05:48:05.985621+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:48:05.973792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:48:05.973792+0000","last_clean_scrub_stamp":"2024-09-17T05:48:05.973792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.16","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T05:48:07.005218+0000","last_change":"2024-09-17T05:48:05.998132+0000","last_active":"2024-09-17T05:48:07.005218+0000","last_peered":"2024-09-17T05:48:07.005218+0000","last_clean":"2024-09-17T05:48:07.005218+0000","last_became_active":"2024-09-17T05:48:05.997479+0000","last_became_peered":"2024-09-17T05:48:05.997479+0000","last_unstale":"2024-09-17T05:48:07.005218+0000","last_undegraded":"2024-09-17T05:48:07.005218+0000","last_fullsized":"2024-09-17T05:48:07.005218+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:48:04.965082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:48:04.965082+0000","last_clean_scrub_stamp":"2024-09-17T05:48:04.965082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:30:29.544066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.14","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-17T05:48:08.017612+0000","last_change":"2024-09-17T05:48:07.010434+0000","last_active":"2024-09-17T05:48:08.017612+0000","last_peered":"2024-09-17T05:48:08.017612+0000","last_clean":"2024-09-17T05:48:08.017612+0000","last_became_active":"2024-09-17T05:48:07.009605+0000","last_became_peered":"2024-09-17T05:48:07.009605+0000","last_unstale":"2024-09-17T05:48:08.017612+0000","last_undegraded":"2024-09-17T05:48:08.017612+0000","last_fullsized":"2024-09-17T05:48:08.017612+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:48:05.973792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:48:05.973792+0000","last_clean_scrub_stamp":"2024-09-17T05:48:05.973792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:46:18.050983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.15","version":"85'3","reported_seq":16,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T05:48:07.027048+0000","last_change":"2024-09-17T05:48:05.999363+0000","last_active":"2024-09-17T05:48:07.027048+0000","last_peered":"2024-09-17T05:48:07.027048+0000","last_clean":"2024-09-17T05:48:07.027048+0000","last_became_active":"2024-09-17T05:48:05.998976+0000","last_became_peered":"2024-09-17T05:48:05.998976+0000","last_unstale":"2024-09-17T05:48:07.027048+0000","last_undegraded":"2024-09-17T05:48:07.027048+0000","last_fullsized":"2024-09-17T05:48:07.027048+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:48:04.965082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:48:04.965082+0000","last_clean_scrub_stamp":"2024-09-17T05:48:04.965082+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:03:18.092299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.15","version":"0'0","reported_seq":1,"reported_epoch":84,"state":"creating+peering","last_fresh":"2024-09-17T05:48:05.988352+0000","last_change":"2024-09-17T05:48:05.988352+0000","last_active":"2024-09-17T05:48:05.973792+0000","last_peered":"2024-09-17T05:48:05.973792+0000","last_clean":"2024-09-17T05:48:05.973792+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:48:05.988352+0000","last_undegraded":"2024-09-17T05:48:05.988352+0000","last_fullsized":"2024-09-17T05:48:05.988352+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:48:05.973792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:48:05.973792+0000","last_clean_scrub_stamp":"2024-09-17T05:48:05.973792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.14","version":"0'0","reported_seq":10,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-17T05:48:05.998686+0000","last_change":"2024-09-17T05:48:05.997721+0000","last_active":"2024-09-17T05:48:05.998686+0000","last_peered":"2024-09-17T05:48:05.998686+0000","last_clean":"2024-09-17T05:48:05.998686+0000","last_became_active":"2024-09-17T05:48:05.997375+0000","last_became_peered":"2024-09-17T05:48:05.997375+0000","last_unstale":"2024-09-17T05:48:05.998686+0000","last_undegraded":"2024-09-17T05:48:05.998686+0000","last_fullsized":"2024-09-17T05:48:05.998686+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:48:04.965082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:48:04.965082+0000","last_clean_scrub_stamp":"2024-09-17T05:48:04.965082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:17:35.686622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.12","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-17T05:48:08.017527+0000","last_change":"2024-09-17T05:48:07.014653+0000","last_active":"2024-09-17T05:48:08.017527+0000","last_peered":"2024-09-17T05:48:08.017527+0000","last_clean":"2024-09-17T05:48:08.017527+0000","last_became_active":"2024-09-17T05:48:07.014227+0000","last_became_peered":"2024-09-17T05:48:07.014227+0000","last_unstale":"2024-09-17T05:48:08.017527+0000","last_undegraded":"2024-09-17T05:48:08.017527+0000","last_fullsized":"2024-09-17T05:48:08.017527+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:48:05.973792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:48:05.973792+0000","last_clean_scrub_stamp":"2024-09-17T05:48:05.973792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:47:25.975838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.13","version":"85'2","reported_seq":15,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T05:48:07.025656+0000","last_change":"2024-09-17T05:48:05.998280+0000","last_active":"2024-09-17T05:48:07.025656+0000","last_peered":"2024-09-17T05:48:07.025656+0000","last_clean":"2024-09-17T05:48:07.025656+0000","last_became_active":"2024-09-17T05:48:05.998002+0000","last_became_peered":"2024-09-17T05:48:05.998002+0000","last_unstale":"2024-09-17T05:48:07.025656+0000","last_undegraded":"2024-09-17T05:48:07.025656+0000","last_fullsized":"2024-09-17T05:48:07.025656+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:48:04.965082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:48:04.965082+0000","last_clean_scrub_stamp":"2024-09-17T05:48:04.965082+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:47:24.665134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.13","version":"0'0","reported_seq":1,"reported_epoch":84,"state":"creating+peering","last_fresh":"2024-09-17T05:48:05.979811+0000","last_change":"2024-09-17T05:48:05.979811+0000","last_active":"2024-09-17T05:48:05.973792+0000","last_peered":"2024-09-17T05:48:05.973792+0000","last_clean":"2024-09-17T05:48:05.973792+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:48:05.979811+0000","last_undegraded":"2024-09-17T05:48:05.979811+0000","last_fullsized":"2024-09-17T05:48:05.979811+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:48:05.973792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:48:05.973792+0000","last_clean_scrub_stamp":"2024-09-17T05:48:05.973792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.12","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T05:48:06.998518+0000","last_change":"2024-09-17T05:48:05.992907+0000","last_active":"2024-09-17T05:48:06.998518+0000","last_peered":"2024-09-17T05:48:06.998518+0000","last_clean":"2024-09-17T05:48:06.998518+0000","last_became_active":"2024-09-17T05:48:05.992511+0000","last_became_peered":"2024-09-17T05:48:05.992511+0000","last_unstale":"2024-09-17T05:48:06.998518+0000","last_undegraded":"2024-09-17T05:48:06.998518+0000","last_fullsized":"2024-09-17T05:48:06.998518+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:48:04.965082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:48:04.965082+0000","last_clean_scrub_stamp":"2024-09-17T05:48:04.965082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:50:06.270397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.10","version":"0'0","reported_seq":10,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T05:48:07.001747+0000","last_change":"2024-09-17T05:48:07.000184+0000","last_active":"2024-09-17T05:48:07.001747+0000","last_peered":"2024-09-17T05:48:07.001747+0000","last_clean":"2024-09-17T05:48:07.001747+0000","last_became_active":"2024-09-17T05:48:06.998794+0000","last_became_peered":"2024-09-17T05:48:06.998794+0000","last_unstale":"2024-09-17T05:48:07.001747+0000","last_undegraded":"2024-09-17T05:48:07.001747+0000","last_fullsized":"2024-09-17T05:48:07.001747+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:48:05.973792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:48:05.973792+0000","last_clean_scrub_stamp":"2024-09-17T05:48:05.973792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:00:20.671743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.11","version":"0'0","reported_seq":10,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-17T05:48:06.000120+0000","last_change":"2024-09-17T05:48:05.999329+0000","last_active":"2024-09-17T05:48:06.000120+0000","last_peered":"2024-09-17T05:48:06.000120+0000","last_clean":"2024-09-17T05:48:06.000120+0000","last_became_active":"2024-09-17T05:48:05.998937+0000","last_became_peered":"2024-09-17T05:48:05.998937+0000","last_unstale":"2024-09-17T05:48:06.000120+0000","last_undegraded":"2024-09-17T05:48:06.000120+0000","last_fullsized":"2024-09-17T05:48:06.000120+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:48:04.965082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:48:04.965082+0000","last_clean_scrub_stamp":"2024-09-17T05:48:04.965082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:14:55.111111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.11","version":"0'0","reported_seq":10,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T05:48:07.006789+0000","last_change":"2024-09-17T05:48:07.004159+0000","last_active":"2024-09-17T05:48:07.006789+0000","last_peered":"2024-09-17T05:48:07.006789+0000","last_clean":"2024-09-17T05:48:07.006789+0000","last_became_active":"2024-09-17T05:48:07.003830+0000","last_became_peered":"2024-09-17T05:48:07.003830+0000","last_unstale":"2024-09-17T05:48:07.006789+0000","last_undegraded":"2024-09-17T05:48:07.006789+0000","last_fullsized":"2024-09-17T05:48:07.006789+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:48:05.973792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:48:05.973792+0000","last_clean_scrub_stamp":"2024-09-17T05:48:05.973792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:28:05.997018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.10","version":"85'8","reported_seq":23,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-17T05:48:08.017251+0000","last_change":"2024-09-17T05:48:05.994461+0000","last_active":"2024-09-17T05:48:08.017251+0000","last_peered":"2024-09-17T05:48:08.017251+0000","last_clean":"2024-09-17T05:48:08.017251+0000","last_became_active":"2024-09-17T05:48:05.994138+0000","last_became_peered":"2024-09-17T05:48:05.994138+0000","last_unstale":"2024-09-17T05:48:08.017251+0000","last_undegraded":"2024-09-17T05:48:08.017251+0000","last_fullsized":"2024-09-17T05:48:08.017251+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:48:04.965082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:48:04.965082+0000","last_clean_scrub_stamp":"2024-09-17T05:48:04.965082+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:49:16.263159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.e","version":"0'0","reported_seq":1,"reported_epoch":84,"state":"creating+peering","last_fresh":"2024-09-17T05:48:05.980418+0000","last_change":"2024-09-17T05:48:05.980418+0000","last_active":"2024-09-17T05:48:05.973792+0000","last_peered":"2024-09-17T05:48:05.973792+0000","last_clean":"2024-09-17T05:48:05.973792+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:48:05.980418+0000","last_undegraded":"2024-09-17T05:48:05.980418+0000","last_fullsized":"2024-09-17T05:48:05.980418+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:48:05.973792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:48:05.973792+0000","last_clean_scrub_stamp":"2024-09-17T05:48:05.973792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.f","version":"85'1","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T05:48:07.027049+0000","last_change":"2024-09-17T05:48:05.993133+0000","last_active":"2024-09-17T05:48:07.027049+0000","last_peered":"2024-09-17T05:48:07.027049+0000","last_clean":"2024-09-17T05:48:07.027049+0000","last_became_active":"2024-09-17T05:48:05.992787+0000","last_became_peered":"2024-09-17T05:48:05.992787+0000","last_unstale":"2024-09-17T05:48:07.027049+0000","last_undegraded":"2024-09-17T05:48:07.027049+0000","last_fullsized":"2024-09-17T05:48:07.027049+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:48:04.965082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:48:04.965082+0000","last_clean_scrub_stamp":"2024-09-17T05:48:04.965082+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:44:05.587367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.f","version":"0'0","reported_seq":10,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T05:48:07.015835+0000","last_change":"2024-09-17T05:48:07.009405+0000","last_active":"2024-09-17T05:48:07.015835+0000","last_peered":"2024-09-17T05:48:07.015835+0000","last_clean":"2024-09-17T05:48:07.015835+0000","last_became_active":"2024-09-17T05:48:07.009088+0000","last_became_peered":"2024-09-17T05:48:07.009088+0000","last_unstale":"2024-09-17T05:48:07.015835+0000","last_undegraded":"2024-09-17T05:48:07.015835+0000","last_fullsized":"2024-09-17T05:48:07.015835+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:48:05.973792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:48:05.973792+0000","last_clean_scrub_stamp":"2024-09-17T05:48:05.973792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:38:46.247147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.e","version":"85'2","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-17T05:48:08.017601+0000","last_change":"2024-09-17T05:48:05.995547+0000","last_active":"2024-09-17T05:48:08.017601+0000","last_peered":"2024-09-17T05:48:08.017601+0000","last_clean":"2024-09-17T05:48:08.017601+0000","last_became_active":"2024-09-17T05:48:05.995233+0000","last_became_peered":"2024-09-17T05:48:05.995233+0000","last_unstale":"2024-09-17T05:48:08.017601+0000","last_undegraded":"2024-09-17T05:48:08.017601+0000","last_fullsized":"2024-09-17T05:48:08.017601+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:48:04.965082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:48:04.965082+0000","last_clean_scrub_stamp":"2024-09-17T05:48:04.965082+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:45:54.436107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.d","version":"0'0","reported_seq":1,"reported_epoch":84,"state":"creating+peering","last_fresh":"2024-09-17T05:48:05.987698+0000","last_change":"2024-09-17T05:48:05.987698+0000","last_active":"2024-09-17T05:48:05.973792+0000","last_peered":"2024-09-17T05:48:05.973792+0000","last_clean":"2024-09-17T05:48:05.973792+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:48:05.987698+0000","last_undegraded":"2024-09-17T05:48:05.987698+0000","last_fullsized":"2024-09-17T05:48:05.987698+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:48:05.973792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:48:05.973792+0000","last_clean_scrub_stamp":"2024-09-17T05:48:05.973792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.c","version":"0'0","reported_seq":15,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-17T05:48:08.017659+0000","last_change":"2024-09-17T05:48:05.993828+0000","last_active":"2024-09-17T05:48:08.017659+0000","last_peered":"2024-09-17T05:48:08.017659+0000","last_clean":"2024-09-17T05:48:08.017659+0000","last_became_active":"2024-09-17T05:48:05.992893+0000","last_became_peered":"2024-09-17T05:48:05.992893+0000","last_unstale":"2024-09-17T05:48:08.017659+0000","last_undegraded":"2024-09-17T05:48:08.017659+0000","last_fullsized":"2024-09-17T05:48:08.017659+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:48:04.965082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:48:04.965082+0000","last_clean_scrub_stamp":"2024-09-17T05:48:04.965082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:19:19.306307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.a","version":"0'0","reported_seq":10,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T05:48:07.000656+0000","last_change":"2024-09-17T05:48:06.999976+0000","last_active":"2024-09-17T05:48:07.000656+0000","last_peered":"2024-09-17T05:48:07.000656+0000","last_clean":"2024-09-17T05:48:07.000656+0000","last_became_active":"2024-09-17T05:48:06.999669+0000","last_became_peered":"2024-09-17T05:48:06.999669+0000","last_unstale":"2024-09-17T05:48:07.000656+0000","last_undegraded":"2024-09-17T05:48:07.000656+0000","last_fullsized":"2024-09-17T05:48:07.000656+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:48:05.973792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:48:05.973792+0000","last_clean_scrub_stamp":"2024-09-17T05:48:05.973792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:13:35.334703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.b","version":"85'2","reported_seq":15,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T05:48:07.024635+0000","last_change":"2024-09-17T05:48:05.990062+0000","last_active":"2024-09-17T05:48:07.024635+0000","last_peered":"2024-09-17T05:48:07.024635+0000","last_clean":"2024-09-17T05:48:07.024635+0000","last_became_active":"2024-09-17T05:48:05.989770+0000","last_became_peered":"2024-09-17T05:48:05.989770+0000","last_unstale":"2024-09-17T05:48:07.024635+0000","last_undegraded":"2024-09-17T05:48:07.024635+0000","last_fullsized":"2024-09-17T05:48:07.024635+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:48:04.965082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:48:04.965082+0000","last_clean_scrub_stamp":"2024-09-17T05:48:04.965082+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:54:27.978918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.b","version":"0'0","reported_seq":1,"reported_epoch":84,"state":"creating+peering","last_fresh":"2024-09-17T05:48:05.987891+0000","last_change":"2024-09-17T05:48:05.987891+0000","last_active":"2024-09-17T05:48:05.973792+0000","last_peered":"2024-09-17T05:48:05.973792+0000","last_clean":"2024-09-17T05:48:05.973792+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:48:05.987891+0000","last_undegraded":"2024-09-17T05:48:05.987891+0000","last_fullsized":"2024-09-17T05:48:05.987891+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:48:05.973792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:48:05.973792+0000","last_clean_scrub_stamp":"2024-09-17T05:48:05.973792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.a","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T05:48:06.994828+0000","last_change":"2024-09-17T05:48:05.997773+0000","last_active":"2024-09-17T05:48:06.994828+0000","last_peered":"2024-09-17T05:48:06.994828+0000","last_clean":"2024-09-17T05:48:06.994828+0000","last_became_active":"2024-09-17T05:48:05.997035+0000","last_became_peered":"2024-09-17T05:48:05.997035+0000","last_unstale":"2024-09-17T05:48:06.994828+0000","last_undegraded":"2024-09-17T05:48:06.994828+0000","last_fullsized":"2024-09-17T05:48:06.994828+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:48:04.965082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:48:04.965082+0000","last_clean_scrub_stamp":"2024-09-17T05:48:04.965082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:12:13.405546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.8","version":"0'0","reported_seq":10,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T05:48:07.007881+0000","last_change":"2024-09-17T05:48:07.004667+0000","last_active":"2024-09-17T05:48:07.007881+0000","last_peered":"2024-09-17T05:48:07.007881+0000","last_clean":"2024-09-17T05:48:07.007881+0000","last_became_active":"2024-09-17T05:48:07.002420+0000","last_became_peered":"2024-09-17T05:48:07.002420+0000","last_unstale":"2024-09-17T05:48:07.007881+0000","last_undegraded":"2024-09-17T05:48:07.007881+0000","last_fullsized":"2024-09-17T05:48:07.007881+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:48:05.973792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:48:05.973792+0000","last_clean_scrub_stamp":"2024-09-17T05:48:05.973792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:58:39.931473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.9","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T05:48:06.994209+0000","last_change":"2024-09-17T05:48:05.999798+0000","last_active":"2024-09-17T05:48:06.994209+0000","last_peered":"2024-09-17T05:48:06.994209+0000","last_clean":"2024-09-17T05:48:06.994209+0000","last_became_active":"2024-09-17T05:48:05.999476+0000","last_became_peered":"2024-09-17T05:48:05.999476+0000","last_unstale":"2024-09-17T05:48:06.994209+0000","last_undegraded":"2024-09-17T05:48:06.994209+0000","last_fullsized":"2024-09-17T05:48:06.994209+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:48:04.965082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:48:04.965082+0000","last_clean_scrub_stamp":"2024-09-17T05:48:04.965082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:44:22.789741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.9","version":"0'0","reported_seq":1,"reported_epoch":84,"state":"creating+peering","last_fresh":"2024-09-17T05:48:05.984632+0000","last_change":"2024-09-17T05:48:05.984632+0000","last_active":"2024-09-17T05:48:05.973792+0000","last_peered":"2024-09-17T05:48:05.973792+0000","last_clean":"2024-09-17T05:48:05.973792+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:48:05.984632+0000","last_undegraded":"2024-09-17T05:48:05.984632+0000","last_fullsized":"2024-09-17T05:48:05.984632+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:48:05.973792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:48:05.973792+0000","last_clean_scrub_stamp":"2024-09-17T05:48:05.973792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.8","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T05:48:06.998203+0000","last_change":"2024-09-17T05:48:05.990918+0000","last_active":"2024-09-17T05:48:06.998203+0000","last_peered":"2024-09-17T05:48:06.998203+0000","last_clean":"2024-09-17T05:48:06.998203+0000","last_became_active":"2024-09-17T05:48:05.990644+0000","last_became_peered":"2024-09-17T05:48:05.990644+0000","last_unstale":"2024-09-17T05:48:06.998203+0000","last_undegraded":"2024-09-17T05:48:06.998203+0000","last_fullsized":"2024-09-17T05:48:06.998203+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:48:04.965082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:48:04.965082+0000","last_clean_scrub_stamp":"2024-09-17T05:48:04.965082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:32:32.045706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.6","version":"0'0","reported_seq":1,"reported_epoch":84,"state":"creating+peering","last_fresh":"2024-09-17T05:48:05.984822+0000","last_change":"2024-09-17T05:48:05.984822+0000","last_active":"2024-09-17T05:48:05.973792+0000","last_peered":"2024-09-17T05:48:05.973792+0000","last_clean":"2024-09-17T05:48:05.973792+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:48:05.984822+0000","last_undegraded":"2024-09-17T05:48:05.984822+0000","last_fullsized":"2024-09-17T05:48:05.984822+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:48:05.973792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:48:05.973792+0000","last_clean_scrub_stamp":"2024-09-17T05:48:05.973792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.7","version":"85'2","reported_seq":15,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T05:48:07.026024+0000","last_change":"2024-09-17T05:48:05.996277+0000","last_active":"2024-09-17T05:48:07.026024+0000","last_peered":"2024-09-17T05:48:07.026024+0000","last_clean":"2024-09-17T05:48:07.026024+0000","last_became_active":"2024-09-17T05:48:05.995979+0000","last_became_peered":"2024-09-17T05:48:05.995979+0000","last_unstale":"2024-09-17T05:48:07.026024+0000","last_undegraded":"2024-09-17T05:48:07.026024+0000","last_fullsized":"2024-09-17T05:48:07.026024+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:48:04.965082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:48:04.965082+0000","last_clean_scrub_stamp":"2024-09-17T05:48:04.965082+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:25:07.468281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.7","version":"0'0","reported_seq":1,"reported_epoch":84,"state":"creating+peering","last_fresh":"2024-09-17T05:48:05.979914+0000","last_change":"2024-09-17T05:48:05.979914+0000","last_active":"2024-09-17T05:48:05.973792+0000","last_peered":"2024-09-17T05:48:05.973792+0000","last_clean":"2024-09-17T05:48:05.973792+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:48:05.979914+0000","last_undegraded":"2024-09-17T05:48:05.979914+0000","last_fullsized":"2024-09-17T05:48:05.979914+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:48:05.973792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:48:05.973792+0000","last_clean_scrub_stamp":"2024-09-17T05:48:05.973792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.6","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T05:48:06.992144+0000","last_change":"2024-09-17T05:48:05.997590+0000","last_active":"2024-09-17T05:48:06.992144+0000","last_peered":"2024-09-17T05:48:06.992144+0000","last_clean":"2024-09-17T05:48:06.992144+0000","last_became_active":"2024-09-17T05:48:05.997301+0000","last_became_peered":"2024-09-17T05:48:05.997301+0000","last_unstale":"2024-09-17T05:48:06.992144+0000","last_undegraded":"2024-09-17T05:48:06.992144+0000","last_fullsized":"2024-09-17T05:48:06.992144+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:48:04.965082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:48:04.965082+0000","last_clean_scrub_stamp":"2024-09-17T05:48:04.965082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:28:36.315309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.4","version":"0'0","reported_seq":10,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T05:48:07.017376+0000","last_change":"2024-09-17T05:48:07.014783+0000","last_active":"2024-09-17T05:48:07.017376+0000","last_peered":"2024-09-17T05:48:07.017376+0000","last_clean":"2024-09-17T05:48:07.017376+0000","last_became_active":"2024-09-17T05:48:07.013864+0000","last_became_peered":"2024-09-17T05:48:07.013864+0000","last_unstale":"2024-09-17T05:48:07.017376+0000","last_undegraded":"2024-09-17T05:48:07.017376+0000","last_fullsized":"2024-09-17T05:48:07.017376+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:48:05.973792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:48:05.973792+0000","last_clean_scrub_stamp":"2024-09-17T05:48:05.973792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:55:17.823783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.5","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T05:48:06.997381+0000","last_change":"2024-09-17T05:48:05.995722+0000","last_active":"2024-09-17T05:48:06.997381+0000","last_peered":"2024-09-17T05:48:06.997381+0000","last_clean":"2024-09-17T05:48:06.997381+0000","last_became_active":"2024-09-17T05:48:05.995345+0000","last_became_peered":"2024-09-17T05:48:05.995345+0000","last_unstale":"2024-09-17T05:48:06.997381+0000","last_undegraded":"2024-09-17T05:48:06.997381+0000","last_fullsized":"2024-09-17T05:48:06.997381+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:48:04.965082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:48:04.965082+0000","last_clean_scrub_stamp":"2024-09-17T05:48:04.965082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:28:33.210082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.5","version":"0'0","reported_seq":1,"reported_epoch":84,"state":"creating+peering","last_fresh":"2024-09-17T05:48:05.983735+0000","last_change":"2024-09-17T05:48:05.983735+0000","last_active":"2024-09-17T05:48:05.973792+0000","last_peered":"2024-09-17T05:48:05.973792+0000","last_clean":"2024-09-17T05:48:05.973792+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:48:05.983735+0000","last_undegraded":"2024-09-17T05:48:05.983735+0000","last_fullsized":"2024-09-17T05:48:05.983735+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:48:05.973792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:48:05.973792+0000","last_clean_scrub_stamp":"2024-09-17T05:48:05.973792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.4","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T05:48:07.006446+0000","last_change":"2024-09-17T05:48:05.995600+0000","last_active":"2024-09-17T05:48:07.006446+0000","last_peered":"2024-09-17T05:48:07.006446+0000","last_clean":"2024-09-17T05:48:07.006446+0000","last_became_active":"2024-09-17T05:48:05.993437+0000","last_became_peered":"2024-09-17T05:48:05.993437+0000","last_unstale":"2024-09-17T05:48:07.006446+0000","last_undegraded":"2024-09-17T05:48:07.006446+0000","last_fullsized":"2024-09-17T05:48:07.006446+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:48:04.965082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:48:04.965082+0000","last_clean_scrub_stamp":"2024-09-17T05:48:04.965082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:34:01.741103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.2","version":"0'0","reported_seq":1,"reported_epoch":84,"state":"creating+peering","last_fresh":"2024-09-17T05:48:05.984825+0000","last_change":"2024-09-17T05:48:05.984825+0000","last_active":"2024-09-17T05:48:05.973792+0000","last_peered":"2024-09-17T05:48:05.973792+0000","last_clean":"2024-09-17T05:48:05.973792+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:48:05.984825+0000","last_undegraded":"2024-09-17T05:48:05.984825+0000","last_fullsized":"2024-09-17T05:48:05.984825+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:48:05.973792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:48:05.973792+0000","last_clean_scrub_stamp":"2024-09-17T05:48:05.973792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.3","version":"0'0","reported_seq":15,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-17T05:48:08.017675+0000","last_change":"2024-09-17T05:48:05.993443+0000","last_active":"2024-09-17T05:48:08.017675+0000","last_peered":"2024-09-17T05:48:08.017675+0000","last_clean":"2024-09-17T05:48:08.017675+0000","last_became_active":"2024-09-17T05:48:05.993128+0000","last_became_peered":"2024-09-17T05:48:05.993128+0000","last_unstale":"2024-09-17T05:48:08.017675+0000","last_undegraded":"2024-09-17T05:48:08.017675+0000","last_fullsized":"2024-09-17T05:48:08.017675+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:48:04.965082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:48:04.965082+0000","last_clean_scrub_stamp":"2024-09-17T05:48:04.965082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:20:42.632458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.3","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-17T05:48:08.017609+0000","last_change":"2024-09-17T05:48:07.019471+0000","last_active":"2024-09-17T05:48:08.017609+0000","last_peered":"2024-09-17T05:48:08.017609+0000","last_clean":"2024-09-17T05:48:08.017609+0000","last_became_active":"2024-09-17T05:48:07.019107+0000","last_became_peered":"2024-09-17T05:48:07.019107+0000","last_unstale":"2024-09-17T05:48:08.017609+0000","last_undegraded":"2024-09-17T05:48:08.017609+0000","last_fullsized":"2024-09-17T05:48:08.017609+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:48:05.973792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:48:05.973792+0000","last_clean_scrub_stamp":"2024-09-17T05:48:05.973792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:30:20.891839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.2","version":"0'0","reported_seq":10,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-17T05:48:05.998302+0000","last_change":"2024-09-17T05:48:05.995790+0000","last_active":"2024-09-17T05:48:05.998302+0000","last_peered":"2024-09-17T05:48:05.998302+0000","last_clean":"2024-09-17T05:48:05.998302+0000","last_became_active":"2024-09-17T05:48:05.995430+0000","last_became_peered":"2024-09-17T05:48:05.995430+0000","last_unstale":"2024-09-17T05:48:05.998302+0000","last_undegraded":"2024-09-17T05:48:05.998302+0000","last_fullsized":"2024-09-17T05:48:05.998302+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:48:04.965082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:48:04.965082+0000","last_clean_scrub_stamp":"2024-09-17T05:48:04.965082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:51:12.220768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.0","version":"0'0","reported_seq":1,"reported_epoch":84,"state":"creating+peering","last_fresh":"2024-09-17T05:48:05.979780+0000","last_change":"2024-09-17T05:48:05.979780+0000","last_active":"2024-09-17T05:48:05.973792+0000","last_peered":"2024-09-17T05:48:05.973792+0000","last_clean":"2024-09-17T05:48:05.973792+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:48:05.979780+0000","last_undegraded":"2024-09-17T05:48:05.979780+0000","last_fullsized":"2024-09-17T05:48:05.979780+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:48:05.973792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:48:05.973792+0000","last_clean_scrub_stamp":"2024-09-17T05:48:05.973792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T05:48:07.000198+0000","last_change":"2024-09-17T05:48:05.994404+0000","last_active":"2024-09-17T05:48:07.000198+0000","last_peered":"2024-09-17T05:48:07.000198+0000","last_clean":"2024-09-17T05:48:07.000198+0000","last_became_active":"2024-09-17T05:48:05.993984+0000","last_became_peered":"2024-09-17T05:48:05.993984+0000","last_unstale":"2024-09-17T05:48:07.000198+0000","last_undegraded":"2024-09-17T05:48:07.000198+0000","last_fullsized":"2024-09-17T05:48:07.000198+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:48:04.965082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:48:04.965082+0000","last_clean_scrub_stamp":"2024-09-17T05:48:04.965082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:59:41.841128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1","version":"0'0","reported_seq":10,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T05:48:07.018798+0000","last_change":"2024-09-17T05:48:07.016257+0000","last_active":"2024-09-17T05:48:07.018798+0000","last_peered":"2024-09-17T05:48:07.018798+0000","last_clean":"2024-09-17T05:48:07.018798+0000","last_became_active":"2024-09-17T05:48:07.015950+0000","last_became_peered":"2024-09-17T05:48:07.015950+0000","last_unstale":"2024-09-17T05:48:07.018798+0000","last_undegraded":"2024-09-17T05:48:07.018798+0000","last_fullsized":"2024-09-17T05:48:07.018798+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:48:05.973792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:48:05.973792+0000","last_clean_scrub_stamp":"2024-09-17T05:48:05.973792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:09:18.062866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.0","version":"0'0","reported_seq":10,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-17T05:48:06.000943+0000","last_change":"2024-09-17T05:48:06.000083+0000","last_active":"2024-09-17T05:48:06.000943+0000","last_peered":"2024-09-17T05:48:06.000943+0000","last_clean":"2024-09-17T05:48:06.000943+0000","last_became_active":"2024-09-17T05:48:05.999770+0000","last_became_peered":"2024-09-17T05:48:05.999770+0000","last_unstale":"2024-09-17T05:48:06.000943+0000","last_undegraded":"2024-09-17T05:48:06.000943+0000","last_fullsized":"2024-09-17T05:48:06.000943+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:48:04.965082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:48:04.965082+0000","last_clean_scrub_stamp":"2024-09-17T05:48:04.965082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:11:27.267806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.c","version":"0'0","reported_seq":10,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T05:48:07.009303+0000","last_change":"2024-09-17T05:48:07.007210+0000","last_active":"2024-09-17T05:48:07.009303+0000","last_peered":"2024-09-17T05:48:07.009303+0000","last_clean":"2024-09-17T05:48:07.009303+0000","last_became_active":"2024-09-17T05:48:07.006278+0000","last_became_peered":"2024-09-17T05:48:07.006278+0000","last_unstale":"2024-09-17T05:48:07.009303+0000","last_undegraded":"2024-09-17T05:48:07.009303+0000","last_fullsized":"2024-09-17T05:48:07.009303+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:48:05.973792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:48:05.973792+0000","last_clean_scrub_stamp":"2024-09-17T05:48:05.973792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:11:54.651531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.d","version":"0'0","reported_seq":10,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-17T05:48:05.996883+0000","last_change":"2024-09-17T05:48:05.995764+0000","last_active":"2024-09-17T05:48:05.996883+0000","last_peered":"2024-09-17T05:48:05.996883+0000","last_clean":"2024-09-17T05:48:05.996883+0000","last_became_active":"2024-09-17T05:48:05.995439+0000","last_became_peered":"2024-09-17T05:48:05.995439+0000","last_unstale":"2024-09-17T05:48:05.996883+0000","last_undegraded":"2024-09-17T05:48:05.996883+0000","last_fullsized":"2024-09-17T05:48:05.996883+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:48:04.965082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:48:04.965082+0000","last_clean_scrub_stamp":"2024-09-17T05:48:04.965082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:59:39.032133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"19'72","reported_seq":223,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-17T05:48:05.984920+0000","last_change":"2024-09-17T05:41:48.539830+0000","last_active":"2024-09-17T05:48:05.984920+0000","last_peered":"2024-09-17T05:48:05.984920+0000","last_clean":"2024-09-17T05:48:05.984920+0000","last_became_active":"2024-09-17T05:41:48.538743+0000","last_became_peered":"2024-09-17T05:41:48.538743+0000","last_unstale":"2024-09-17T05:48:05.984920+0000","last_undegraded":"2024-09-17T05:48:05.984920+0000","last_fullsized":"2024-09-17T05:48:05.984920+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:47.152539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:47.152539+0000","last_clean_scrub_stamp":"2024-09-17T05:41:47.152539+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:08:02.952016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":13,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":12,"num_pg":32,"stat_sum":{"num_bytes":728,"num_objects":16,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":37,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":12,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":3116,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":28,"ondisk_log_size":28,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":16,"seq":68719476817,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":54424,"kb_used_data":1024,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94317416,"statfs":{"total":96636764160,"available":96581033984,"internally_reserved":0,"allocated":1048576,"data_stored":443474,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":54655430},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":7,"up_from":15,"seq":64424509521,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":50808,"kb_used_data":1568,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94321032,"statfs":{"total":96636764160,"available":96584736768,"internally_reserved":0,"allocated":1605632,"data_stored":1019930,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":50395594},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509520,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":50224,"kb_used_data":988,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94321616,"statfs":{"total":96636764160,"available":96585334784,"internally_reserved":0,"allocated":1011712,"data_stored":429562,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509520,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":50224,"kb_used_data":988,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94321616,"statfs":{"total":96636764160,"available":96585334784,"internally_reserved":0,"allocated":1011712,"data_stored":429562,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509520,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":72384,"kb_used_data":1000,"kb_used_omap":1,"kb_used_meta":71358,"kb_avail":94299456,"statfs":{"total":96636764160,"available":96562642944,"internally_reserved":0,"allocated":1024000,"data_stored":435921,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":73071047},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509520,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":50240,"kb_used_data":1000,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94321600,"statfs":{"total":96636764160,"available":96585318400,"internally_reserved":0,"allocated":1024000,"data_stored":435921,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509520,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":72412,"kb_used_data":1024,"kb_used_omap":1,"kb_used_meta":71358,"kb_avail":94299428,"statfs":{"total":96636764160,"available":96562614272,"internally_reserved":0,"allocated":1048576,"data_stored":442974,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":73071045},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574928,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55004,"kb_used_data":1608,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94316836,"statfs":{"total":96636764160,"available":96580440064,"internally_reserved":0,"allocated":1646592,"data_stored":1039566,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":194,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":694,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-17T05:48:11.383 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-17T05:48:11.533 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:11.531+0000 7f835c20a640 1 -- 172.21.15.150:0/721877205 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f835406d7b0 msgr2=0x7f83540b67d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:48:11.533 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:11.531+0000 7f835c20a640 1 --2- 172.21.15.150:0/721877205 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f835406d7b0 0x7f83540b67d0 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f8350005fd0 tx=0x7f835002a540 comp rx=0 tx=0).stop 2024-09-17T05:48:11.533 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:11.531+0000 7f835c20a640 1 -- 172.21.15.150:0/721877205 shutdown_connections 2024-09-17T05:48:11.533 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:11.531+0000 7f835c20a640 1 --2- 172.21.15.150:0/721877205 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f83540d0560 0x7f83540d0970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:48:11.533 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:11.531+0000 7f835c20a640 1 --2- 172.21.15.150:0/721877205 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f835406d7b0 0x7f83540b67d0 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:48:11.533 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:11.531+0000 7f835c20a640 1 -- 172.21.15.150:0/721877205 >> 172.21.15.150:0/721877205 conn(0x7f83540b2fd0 msgr2=0x7f83540b33e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:48:11.533 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:11.531+0000 7f835c20a640 1 -- 172.21.15.150:0/721877205 shutdown_connections 2024-09-17T05:48:11.534 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:11.531+0000 7f835c20a640 1 -- 172.21.15.150:0/721877205 wait complete. 2024-09-17T05:48:11.534 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:11.533+0000 7f835c20a640 1 Processor -- start 2024-09-17T05:48:11.534 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:11.533+0000 7f835c20a640 1 -- start start 2024-09-17T05:48:11.537 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:11.534+0000 7f835c20a640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f835406d7b0 0x7f83540c6f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:48:11.537 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:11.534+0000 7f835c20a640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f83540cde10 0x7f8354150b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:48:11.537 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:11.534+0000 7f835c20a640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f83540d0560 0x7f835414d840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:48:11.537 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:11.534+0000 7f835c20a640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f83540cd260 con 0x7f83540d0560 2024-09-17T05:48:11.537 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:11.534+0000 7f835c20a640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f83540cd0e0 con 0x7f83540cde10 2024-09-17T05:48:11.537 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:11.534+0000 7f835c20a640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f83540cd3e0 con 0x7f835406d7b0 2024-09-17T05:48:11.537 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:11.534+0000 7f835a7a7640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f83540d0560 0x7f835414d840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:48:11.537 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:11.534+0000 7f835a7a7640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f83540d0560 0x7f835414d840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:34182/0 (socket says 172.21.15.150:34182) 2024-09-17T05:48:11.537 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:11.534+0000 7f835a7a7640 1 -- 172.21.15.150:0/1418126132 learned_addr learned my addr 172.21.15.150:0/1418126132 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:48:11.537 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:11.534+0000 7f8359fa6640 1 --2- 172.21.15.150:0/1418126132 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f835406d7b0 0x7f83540c6f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:48:11.538 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:11.534+0000 7f83597a5640 1 --2- 172.21.15.150:0/1418126132 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f83540cde10 0x7f8354150b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:48:11.538 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:11.534+0000 7f835a7a7640 1 -- 172.21.15.150:0/1418126132 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f835406d7b0 msgr2=0x7f83540c6f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:48:11.538 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:11.534+0000 7f835a7a7640 1 --2- 172.21.15.150:0/1418126132 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f835406d7b0 0x7f83540c6f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:48:11.538 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:11.534+0000 7f835a7a7640 1 -- 172.21.15.150:0/1418126132 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f83540cde10 msgr2=0x7f8354150b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:48:11.538 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:11.534+0000 7f835a7a7640 1 --2- 172.21.15.150:0/1418126132 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f83540cde10 0x7f8354150b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:48:11.538 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:11.534+0000 7f835a7a7640 1 -- 172.21.15.150:0/1418126132 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f835414dd80 con 0x7f83540d0560 2024-09-17T05:48:11.538 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:11.535+0000 7f835a7a7640 1 --2- 172.21.15.150:0/1418126132 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f83540d0560 0x7f835414d840 secure :-1 s=READY pgs=1017 cs=0 l=1 rev1=1 crypto rx=0x7f834c00c6b0 tx=0x7f834c00cb70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:48:11.538 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:11.535+0000 7f834a7fc640 1 -- 172.21.15.150:0/1418126132 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f834c003b70 con 0x7f83540d0560 2024-09-17T05:48:11.538 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:11.535+0000 7f834a7fc640 1 -- 172.21.15.150:0/1418126132 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f834c003d10 con 0x7f83540d0560 2024-09-17T05:48:11.538 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:11.535+0000 7f835c20a640 1 -- 172.21.15.150:0/1418126132 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f83540c7570 con 0x7f83540d0560 2024-09-17T05:48:11.538 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:11.535+0000 7f834a7fc640 1 -- 172.21.15.150:0/1418126132 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f834c005330 con 0x7f83540d0560 2024-09-17T05:48:11.538 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:11.535+0000 7f835c20a640 1 -- 172.21.15.150:0/1418126132 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f83540c7b30 con 0x7f83540d0560 2024-09-17T05:48:11.539 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:11.536+0000 7f835c20a640 1 -- 172.21.15.150:0/1418126132 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f83540cebe0 con 0x7f83540d0560 2024-09-17T05:48:11.539 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:11.536+0000 7f834a7fc640 1 -- 172.21.15.150:0/1418126132 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 25) ==== 103022+0+0 (secure 0 0 0) 0x7f834c0054d0 con 0x7f83540d0560 2024-09-17T05:48:11.539 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:11.537+0000 7f834a7fc640 1 --2- 172.21.15.150:0/1418126132 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f8338079d30 0x7f833807c240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:48:11.539 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:11.537+0000 7f834a7fc640 1 -- 172.21.15.150:0/1418126132 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 5793+0+0 (secure 0 0 0) 0x7f834c099850 con 0x7f83540d0560 2024-09-17T05:48:11.540 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:11.537+0000 7f8359fa6640 1 --2- 172.21.15.150:0/1418126132 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f8338079d30 0x7f833807c240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:48:11.540 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:11.538+0000 7f8359fa6640 1 --2- 172.21.15.150:0/1418126132 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f8338079d30 0x7f833807c240 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f8350033000 tx=0x7f8350004730 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:48:11.543 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:11.541+0000 7f834a7fc640 1 -- 172.21.15.150:0/1418126132 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f834c062db0 con 0x7f83540d0560 2024-09-17T05:48:11.714 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:11.712+0000 7f835c20a640 1 -- 172.21.15.150:0/1418126132 --> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f8354151060 con 0x7f8338079d30 2024-09-17T05:48:11.719 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:11.717+0000 7f834a7fc640 1 -- 172.21.15.150:0/1418126132 <== mgr.4108 v2:172.21.15.176:6800/3631216395 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+249856 (secure 0 0 0) 0x7f83500055e0 con 0x7f8338079d30 2024-09-17T05:48:11.722 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-09-17T05:48:11.723 INFO:teuthology.orchestra.run.smithi150.stderr:dumped all 2024-09-17T05:48:11.724 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:11.721+0000 7f835c20a640 1 -- 172.21.15.150:0/1418126132 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f8338079d30 msgr2=0x7f833807c240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:48:11.724 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:11.721+0000 7f835c20a640 1 --2- 172.21.15.150:0/1418126132 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f8338079d30 0x7f833807c240 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f8350033000 tx=0x7f8350004730 comp rx=0 tx=0).stop 2024-09-17T05:48:11.724 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:11.721+0000 7f835c20a640 1 -- 172.21.15.150:0/1418126132 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f83540d0560 msgr2=0x7f835414d840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:48:11.725 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:11.721+0000 7f835c20a640 1 --2- 172.21.15.150:0/1418126132 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f83540d0560 0x7f835414d840 secure :-1 s=READY pgs=1017 cs=0 l=1 rev1=1 crypto rx=0x7f834c00c6b0 tx=0x7f834c00cb70 comp rx=0 tx=0).stop 2024-09-17T05:48:11.725 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:11.721+0000 7f835c20a640 1 -- 172.21.15.150:0/1418126132 shutdown_connections 2024-09-17T05:48:11.725 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:11.721+0000 7f835c20a640 1 --2- 172.21.15.150:0/1418126132 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f83540cde10 0x7f8354150b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:48:11.725 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:11.721+0000 7f835c20a640 1 --2- 172.21.15.150:0/1418126132 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f8338079d30 0x7f833807c240 unknown :-1 s=CLOSED pgs=443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:48:11.725 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:11.721+0000 7f835c20a640 1 --2- 172.21.15.150:0/1418126132 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f83540d0560 0x7f835414d840 unknown :-1 s=CLOSED pgs=1017 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:48:11.725 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:11.721+0000 7f835c20a640 1 --2- 172.21.15.150:0/1418126132 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f835406d7b0 0x7f83540c6f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:48:11.725 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:11.721+0000 7f835c20a640 1 -- 172.21.15.150:0/1418126132 >> 172.21.15.150:0/1418126132 conn(0x7f83540b2fd0 msgr2=0x7f83540b33e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:48:11.725 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:11.721+0000 7f835c20a640 1 -- 172.21.15.150:0/1418126132 shutdown_connections 2024-09-17T05:48:11.725 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:11.721+0000 7f835c20a640 1 -- 172.21.15.150:0/1418126132 wait complete. 2024-09-17T05:48:11.734 INFO:teuthology.orchestra.run.smithi150.stdout:{"pg_ready":true,"pg_map":{"version":273,"stamp":"2024-09-17T05:48:10.964995+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":591096,"num_objects":18,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":138,"num_write_kb":1638,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":12,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":100,"ondisk_log_size":100,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":65,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":455720,"kb_used_data":9200,"kb_used_omap":12,"kb_used_meta":446323,"kb_avail":754519000,"statfs":{"total":773094113280,"available":772627456000,"internally_reserved":0,"allocated":9420800,"data_stored":4676910,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":457035312},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":16,"apply_latency_ms":16,"commit_latency_ns":16000000,"apply_latency_ns":16000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":728,"num_objects":16,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":37,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":12,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.990092"},"pg_stats":[{"pgid":"13.3f","version":"0'0","reported_seq":10,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T05:48:07.021662+0000","last_change":"2024-09-17T05:48:07.019629+0000","last_active":"2024-09-17T05:48:07.021662+0000","last_peered":"2024-09-17T05:48:07.021662+0000","last_clean":"2024-09-17T05:48:07.021662+0000","last_became_active":"2024-09-17T05:48:07.019293+0000","last_became_peered":"2024-09-17T05:48:07.019293+0000","last_unstale":"2024-09-17T05:48:07.021662+0000","last_undegraded":"2024-09-17T05:48:07.021662+0000","last_fullsized":"2024-09-17T05:48:07.021662+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:48:05.973792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:48:05.973792+0000","last_clean_scrub_stamp":"2024-09-17T05:48:05.973792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:25:55.495958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.3e","version":"0'0","reported_seq":10,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T05:48:07.009336+0000","last_change":"2024-09-17T05:48:07.008371+0000","last_active":"2024-09-17T05:48:07.009336+0000","last_peered":"2024-09-17T05:48:07.009336+0000","last_clean":"2024-09-17T05:48:07.009336+0000","last_became_active":"2024-09-17T05:48:07.008069+0000","last_became_peered":"2024-09-17T05:48:07.008069+0000","last_unstale":"2024-09-17T05:48:07.009336+0000","last_undegraded":"2024-09-17T05:48:07.009336+0000","last_fullsized":"2024-09-17T05:48:07.009336+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:48:05.973792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:48:05.973792+0000","last_clean_scrub_stamp":"2024-09-17T05:48:05.973792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:17:03.542296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.3d","version":"0'0","reported_seq":1,"reported_epoch":84,"state":"creating+peering","last_fresh":"2024-09-17T05:48:05.981187+0000","last_change":"2024-09-17T05:48:05.981187+0000","last_active":"2024-09-17T05:48:05.973792+0000","last_peered":"2024-09-17T05:48:05.973792+0000","last_clean":"2024-09-17T05:48:05.973792+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:48:05.981187+0000","last_undegraded":"2024-09-17T05:48:05.981187+0000","last_fullsized":"2024-09-17T05:48:05.981187+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:48:05.973792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:48:05.973792+0000","last_clean_scrub_stamp":"2024-09-17T05:48:05.973792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.3c","version":"0'0","reported_seq":10,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T05:48:06.998187+0000","last_change":"2024-09-17T05:48:06.997015+0000","last_active":"2024-09-17T05:48:06.998187+0000","last_peered":"2024-09-17T05:48:06.998187+0000","last_clean":"2024-09-17T05:48:06.998187+0000","last_became_active":"2024-09-17T05:48:06.996664+0000","last_became_peered":"2024-09-17T05:48:06.996664+0000","last_unstale":"2024-09-17T05:48:06.998187+0000","last_undegraded":"2024-09-17T05:48:06.998187+0000","last_fullsized":"2024-09-17T05:48:06.998187+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:48:05.973792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:48:05.973792+0000","last_clean_scrub_stamp":"2024-09-17T05:48:05.973792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:29:24.565960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.3b","version":"0'0","reported_seq":1,"reported_epoch":84,"state":"creating+peering","last_fresh":"2024-09-17T05:48:05.990716+0000","last_change":"2024-09-17T05:48:05.990716+0000","last_active":"2024-09-17T05:48:05.973792+0000","last_peered":"2024-09-17T05:48:05.973792+0000","last_clean":"2024-09-17T05:48:05.973792+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:48:05.990716+0000","last_undegraded":"2024-09-17T05:48:05.990716+0000","last_fullsized":"2024-09-17T05:48:05.990716+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:48:05.973792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:48:05.973792+0000","last_clean_scrub_stamp":"2024-09-17T05:48:05.973792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.3a","version":"0'0","reported_seq":1,"reported_epoch":84,"state":"creating+peering","last_fresh":"2024-09-17T05:48:05.986085+0000","last_change":"2024-09-17T05:48:05.986085+0000","last_active":"2024-09-17T05:48:05.973792+0000","last_peered":"2024-09-17T05:48:05.973792+0000","last_clean":"2024-09-17T05:48:05.973792+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:48:05.986085+0000","last_undegraded":"2024-09-17T05:48:05.986085+0000","last_fullsized":"2024-09-17T05:48:05.986085+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:48:05.973792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:48:05.973792+0000","last_clean_scrub_stamp":"2024-09-17T05:48:05.973792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.39","version":"0'0","reported_seq":10,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T05:48:07.007609+0000","last_change":"2024-09-17T05:48:07.004879+0000","last_active":"2024-09-17T05:48:07.007609+0000","last_peered":"2024-09-17T05:48:07.007609+0000","last_clean":"2024-09-17T05:48:07.007609+0000","last_became_active":"2024-09-17T05:48:07.004432+0000","last_became_peered":"2024-09-17T05:48:07.004432+0000","last_unstale":"2024-09-17T05:48:07.007609+0000","last_undegraded":"2024-09-17T05:48:07.007609+0000","last_fullsized":"2024-09-17T05:48:07.007609+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:48:05.973792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:48:05.973792+0000","last_clean_scrub_stamp":"2024-09-17T05:48:05.973792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:41:11.072932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.38","version":"0'0","reported_seq":1,"reported_epoch":84,"state":"creating+peering","last_fresh":"2024-09-17T05:48:05.984329+0000","last_change":"2024-09-17T05:48:05.984329+0000","last_active":"2024-09-17T05:48:05.973792+0000","last_peered":"2024-09-17T05:48:05.973792+0000","last_clean":"2024-09-17T05:48:05.973792+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:48:05.984329+0000","last_undegraded":"2024-09-17T05:48:05.984329+0000","last_fullsized":"2024-09-17T05:48:05.984329+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:48:05.973792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:48:05.973792+0000","last_clean_scrub_stamp":"2024-09-17T05:48:05.973792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.37","version":"0'0","reported_seq":1,"reported_epoch":84,"state":"creating+peering","last_fresh":"2024-09-17T05:48:05.986183+0000","last_change":"2024-09-17T05:48:05.986183+0000","last_active":"2024-09-17T05:48:05.973792+0000","last_peered":"2024-09-17T05:48:05.973792+0000","last_clean":"2024-09-17T05:48:05.973792+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:48:05.986183+0000","last_undegraded":"2024-09-17T05:48:05.986183+0000","last_fullsized":"2024-09-17T05:48:05.986183+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:48:05.973792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:48:05.973792+0000","last_clean_scrub_stamp":"2024-09-17T05:48:05.973792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.36","version":"0'0","reported_seq":10,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T05:48:07.008314+0000","last_change":"2024-09-17T05:48:07.006474+0000","last_active":"2024-09-17T05:48:07.008314+0000","last_peered":"2024-09-17T05:48:07.008314+0000","last_clean":"2024-09-17T05:48:07.008314+0000","last_became_active":"2024-09-17T05:48:07.006080+0000","last_became_peered":"2024-09-17T05:48:07.006080+0000","last_unstale":"2024-09-17T05:48:07.008314+0000","last_undegraded":"2024-09-17T05:48:07.008314+0000","last_fullsized":"2024-09-17T05:48:07.008314+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:48:05.973792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:48:05.973792+0000","last_clean_scrub_stamp":"2024-09-17T05:48:05.973792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:11:43.970133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.35","version":"0'0","reported_seq":10,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T05:48:07.009233+0000","last_change":"2024-09-17T05:48:07.007493+0000","last_active":"2024-09-17T05:48:07.009233+0000","last_peered":"2024-09-17T05:48:07.009233+0000","last_clean":"2024-09-17T05:48:07.009233+0000","last_became_active":"2024-09-17T05:48:07.007110+0000","last_became_peered":"2024-09-17T05:48:07.007110+0000","last_unstale":"2024-09-17T05:48:07.009233+0000","last_undegraded":"2024-09-17T05:48:07.009233+0000","last_fullsized":"2024-09-17T05:48:07.009233+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:48:05.973792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:48:05.973792+0000","last_clean_scrub_stamp":"2024-09-17T05:48:05.973792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:02:09.211126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.34","version":"0'0","reported_seq":10,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T05:48:07.016908+0000","last_change":"2024-09-17T05:48:07.010311+0000","last_active":"2024-09-17T05:48:07.016908+0000","last_peered":"2024-09-17T05:48:07.016908+0000","last_clean":"2024-09-17T05:48:07.016908+0000","last_became_active":"2024-09-17T05:48:07.008909+0000","last_became_peered":"2024-09-17T05:48:07.008909+0000","last_unstale":"2024-09-17T05:48:07.016908+0000","last_undegraded":"2024-09-17T05:48:07.016908+0000","last_fullsized":"2024-09-17T05:48:07.016908+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:48:05.973792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:48:05.973792+0000","last_clean_scrub_stamp":"2024-09-17T05:48:05.973792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:45:16.917183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.33","version":"0'0","reported_seq":1,"reported_epoch":84,"state":"creating+peering","last_fresh":"2024-09-17T05:48:05.980666+0000","last_change":"2024-09-17T05:48:05.980666+0000","last_active":"2024-09-17T05:48:05.973792+0000","last_peered":"2024-09-17T05:48:05.973792+0000","last_clean":"2024-09-17T05:48:05.973792+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:48:05.980666+0000","last_undegraded":"2024-09-17T05:48:05.980666+0000","last_fullsized":"2024-09-17T05:48:05.980666+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:48:05.973792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:48:05.973792+0000","last_clean_scrub_stamp":"2024-09-17T05:48:05.973792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.32","version":"0'0","reported_seq":10,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T05:48:07.004126+0000","last_change":"2024-09-17T05:48:06.999966+0000","last_active":"2024-09-17T05:48:07.004126+0000","last_peered":"2024-09-17T05:48:07.004126+0000","last_clean":"2024-09-17T05:48:07.004126+0000","last_became_active":"2024-09-17T05:48:06.999522+0000","last_became_peered":"2024-09-17T05:48:06.999522+0000","last_unstale":"2024-09-17T05:48:07.004126+0000","last_undegraded":"2024-09-17T05:48:07.004126+0000","last_fullsized":"2024-09-17T05:48:07.004126+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:48:05.973792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:48:05.973792+0000","last_clean_scrub_stamp":"2024-09-17T05:48:05.973792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:56:39.787601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.31","version":"0'0","reported_seq":10,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T05:48:07.008515+0000","last_change":"2024-09-17T05:48:07.006783+0000","last_active":"2024-09-17T05:48:07.008515+0000","last_peered":"2024-09-17T05:48:07.008515+0000","last_clean":"2024-09-17T05:48:07.008515+0000","last_became_active":"2024-09-17T05:48:07.006179+0000","last_became_peered":"2024-09-17T05:48:07.006179+0000","last_unstale":"2024-09-17T05:48:07.008515+0000","last_undegraded":"2024-09-17T05:48:07.008515+0000","last_fullsized":"2024-09-17T05:48:07.008515+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:48:05.973792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:48:05.973792+0000","last_clean_scrub_stamp":"2024-09-17T05:48:05.973792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:25:14.968274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.30","version":"0'0","reported_seq":1,"reported_epoch":84,"state":"creating+peering","last_fresh":"2024-09-17T05:48:05.986337+0000","last_change":"2024-09-17T05:48:05.986337+0000","last_active":"2024-09-17T05:48:05.973792+0000","last_peered":"2024-09-17T05:48:05.973792+0000","last_clean":"2024-09-17T05:48:05.973792+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:48:05.986337+0000","last_undegraded":"2024-09-17T05:48:05.986337+0000","last_fullsized":"2024-09-17T05:48:05.986337+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:48:05.973792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:48:05.973792+0000","last_clean_scrub_stamp":"2024-09-17T05:48:05.973792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.2f","version":"0'0","reported_seq":1,"reported_epoch":84,"state":"creating+peering","last_fresh":"2024-09-17T05:48:05.983346+0000","last_change":"2024-09-17T05:48:05.983346+0000","last_active":"2024-09-17T05:48:05.973792+0000","last_peered":"2024-09-17T05:48:05.973792+0000","last_clean":"2024-09-17T05:48:05.973792+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:48:05.983346+0000","last_undegraded":"2024-09-17T05:48:05.983346+0000","last_fullsized":"2024-09-17T05:48:05.983346+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:48:05.973792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:48:05.973792+0000","last_clean_scrub_stamp":"2024-09-17T05:48:05.973792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.2e","version":"0'0","reported_seq":10,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T05:48:07.013532+0000","last_change":"2024-09-17T05:48:07.012645+0000","last_active":"2024-09-17T05:48:07.013532+0000","last_peered":"2024-09-17T05:48:07.013532+0000","last_clean":"2024-09-17T05:48:07.013532+0000","last_became_active":"2024-09-17T05:48:07.012337+0000","last_became_peered":"2024-09-17T05:48:07.012337+0000","last_unstale":"2024-09-17T05:48:07.013532+0000","last_undegraded":"2024-09-17T05:48:07.013532+0000","last_fullsized":"2024-09-17T05:48:07.013532+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:48:05.973792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:48:05.973792+0000","last_clean_scrub_stamp":"2024-09-17T05:48:05.973792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:04:39.379785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2d","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-17T05:48:08.017801+0000","last_change":"2024-09-17T05:48:07.003509+0000","last_active":"2024-09-17T05:48:08.017801+0000","last_peered":"2024-09-17T05:48:08.017801+0000","last_clean":"2024-09-17T05:48:08.017801+0000","last_became_active":"2024-09-17T05:48:07.003226+0000","last_became_peered":"2024-09-17T05:48:07.003226+0000","last_unstale":"2024-09-17T05:48:08.017801+0000","last_undegraded":"2024-09-17T05:48:08.017801+0000","last_fullsized":"2024-09-17T05:48:08.017801+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:48:05.973792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:48:05.973792+0000","last_clean_scrub_stamp":"2024-09-17T05:48:05.973792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:30:08.358108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.2c","version":"0'0","reported_seq":10,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T05:48:07.011887+0000","last_change":"2024-09-17T05:48:07.010456+0000","last_active":"2024-09-17T05:48:07.011887+0000","last_peered":"2024-09-17T05:48:07.011887+0000","last_clean":"2024-09-17T05:48:07.011887+0000","last_became_active":"2024-09-17T05:48:07.010136+0000","last_became_peered":"2024-09-17T05:48:07.010136+0000","last_unstale":"2024-09-17T05:48:07.011887+0000","last_undegraded":"2024-09-17T05:48:07.011887+0000","last_fullsized":"2024-09-17T05:48:07.011887+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:48:05.973792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:48:05.973792+0000","last_clean_scrub_stamp":"2024-09-17T05:48:05.973792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:02:04.762505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2b","version":"0'0","reported_seq":10,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T05:48:07.013497+0000","last_change":"2024-09-17T05:48:07.011524+0000","last_active":"2024-09-17T05:48:07.013497+0000","last_peered":"2024-09-17T05:48:07.013497+0000","last_clean":"2024-09-17T05:48:07.013497+0000","last_became_active":"2024-09-17T05:48:07.011186+0000","last_became_peered":"2024-09-17T05:48:07.011186+0000","last_unstale":"2024-09-17T05:48:07.013497+0000","last_undegraded":"2024-09-17T05:48:07.013497+0000","last_fullsized":"2024-09-17T05:48:07.013497+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:48:05.973792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:48:05.973792+0000","last_clean_scrub_stamp":"2024-09-17T05:48:05.973792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:06:26.531883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2a","version":"0'0","reported_seq":10,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T05:48:07.012966+0000","last_change":"2024-09-17T05:48:07.011513+0000","last_active":"2024-09-17T05:48:07.012966+0000","last_peered":"2024-09-17T05:48:07.012966+0000","last_clean":"2024-09-17T05:48:07.012966+0000","last_became_active":"2024-09-17T05:48:07.011207+0000","last_became_peered":"2024-09-17T05:48:07.011207+0000","last_unstale":"2024-09-17T05:48:07.012966+0000","last_undegraded":"2024-09-17T05:48:07.012966+0000","last_fullsized":"2024-09-17T05:48:07.012966+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:48:05.973792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:48:05.973792+0000","last_clean_scrub_stamp":"2024-09-17T05:48:05.973792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:25:04.204546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.29","version":"0'0","reported_seq":10,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T05:48:07.018768+0000","last_change":"2024-09-17T05:48:07.016145+0000","last_active":"2024-09-17T05:48:07.018768+0000","last_peered":"2024-09-17T05:48:07.018768+0000","last_clean":"2024-09-17T05:48:07.018768+0000","last_became_active":"2024-09-17T05:48:07.015802+0000","last_became_peered":"2024-09-17T05:48:07.015802+0000","last_unstale":"2024-09-17T05:48:07.018768+0000","last_undegraded":"2024-09-17T05:48:07.018768+0000","last_fullsized":"2024-09-17T05:48:07.018768+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:48:05.973792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:48:05.973792+0000","last_clean_scrub_stamp":"2024-09-17T05:48:05.973792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:38:27.328456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.28","version":"0'0","reported_seq":10,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T05:48:07.013189+0000","last_change":"2024-09-17T05:48:07.010500+0000","last_active":"2024-09-17T05:48:07.013189+0000","last_peered":"2024-09-17T05:48:07.013189+0000","last_clean":"2024-09-17T05:48:07.013189+0000","last_became_active":"2024-09-17T05:48:07.010182+0000","last_became_peered":"2024-09-17T05:48:07.010182+0000","last_unstale":"2024-09-17T05:48:07.013189+0000","last_undegraded":"2024-09-17T05:48:07.013189+0000","last_fullsized":"2024-09-17T05:48:07.013189+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:48:05.973792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:48:05.973792+0000","last_clean_scrub_stamp":"2024-09-17T05:48:05.973792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:43:27.386419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.27","version":"0'0","reported_seq":10,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T05:48:07.007625+0000","last_change":"2024-09-17T05:48:07.004954+0000","last_active":"2024-09-17T05:48:07.007625+0000","last_peered":"2024-09-17T05:48:07.007625+0000","last_clean":"2024-09-17T05:48:07.007625+0000","last_became_active":"2024-09-17T05:48:07.004656+0000","last_became_peered":"2024-09-17T05:48:07.004656+0000","last_unstale":"2024-09-17T05:48:07.007625+0000","last_undegraded":"2024-09-17T05:48:07.007625+0000","last_fullsized":"2024-09-17T05:48:07.007625+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:48:05.973792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:48:05.973792+0000","last_clean_scrub_stamp":"2024-09-17T05:48:05.973792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:07:51.657806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.26","version":"0'0","reported_seq":1,"reported_epoch":84,"state":"creating+peering","last_fresh":"2024-09-17T05:48:05.981443+0000","last_change":"2024-09-17T05:48:05.981443+0000","last_active":"2024-09-17T05:48:05.973792+0000","last_peered":"2024-09-17T05:48:05.973792+0000","last_clean":"2024-09-17T05:48:05.973792+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:48:05.981443+0000","last_undegraded":"2024-09-17T05:48:05.981443+0000","last_fullsized":"2024-09-17T05:48:05.981443+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:48:05.973792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:48:05.973792+0000","last_clean_scrub_stamp":"2024-09-17T05:48:05.973792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.25","version":"0'0","reported_seq":1,"reported_epoch":84,"state":"creating+peering","last_fresh":"2024-09-17T05:48:05.988800+0000","last_change":"2024-09-17T05:48:05.988800+0000","last_active":"2024-09-17T05:48:05.973792+0000","last_peered":"2024-09-17T05:48:05.973792+0000","last_clean":"2024-09-17T05:48:05.973792+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:48:05.988800+0000","last_undegraded":"2024-09-17T05:48:05.988800+0000","last_fullsized":"2024-09-17T05:48:05.988800+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:48:05.973792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:48:05.973792+0000","last_clean_scrub_stamp":"2024-09-17T05:48:05.973792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.24","version":"0'0","reported_seq":10,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T05:48:07.021931+0000","last_change":"2024-09-17T05:48:07.021372+0000","last_active":"2024-09-17T05:48:07.021931+0000","last_peered":"2024-09-17T05:48:07.021931+0000","last_clean":"2024-09-17T05:48:07.021931+0000","last_became_active":"2024-09-17T05:48:07.019410+0000","last_became_peered":"2024-09-17T05:48:07.019410+0000","last_unstale":"2024-09-17T05:48:07.021931+0000","last_undegraded":"2024-09-17T05:48:07.021931+0000","last_fullsized":"2024-09-17T05:48:07.021931+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:48:05.973792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:48:05.973792+0000","last_clean_scrub_stamp":"2024-09-17T05:48:05.973792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:16:14.965629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.23","version":"0'0","reported_seq":10,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T05:48:07.006158+0000","last_change":"2024-09-17T05:48:07.002555+0000","last_active":"2024-09-17T05:48:07.006158+0000","last_peered":"2024-09-17T05:48:07.006158+0000","last_clean":"2024-09-17T05:48:07.006158+0000","last_became_active":"2024-09-17T05:48:07.002263+0000","last_became_peered":"2024-09-17T05:48:07.002263+0000","last_unstale":"2024-09-17T05:48:07.006158+0000","last_undegraded":"2024-09-17T05:48:07.006158+0000","last_fullsized":"2024-09-17T05:48:07.006158+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:48:05.973792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:48:05.973792+0000","last_clean_scrub_stamp":"2024-09-17T05:48:05.973792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:08:12.460618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.22","version":"0'0","reported_seq":10,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T05:48:07.008627+0000","last_change":"2024-09-17T05:48:07.003556+0000","last_active":"2024-09-17T05:48:07.008627+0000","last_peered":"2024-09-17T05:48:07.008627+0000","last_clean":"2024-09-17T05:48:07.008627+0000","last_became_active":"2024-09-17T05:48:07.003232+0000","last_became_peered":"2024-09-17T05:48:07.003232+0000","last_unstale":"2024-09-17T05:48:07.008627+0000","last_undegraded":"2024-09-17T05:48:07.008627+0000","last_fullsized":"2024-09-17T05:48:07.008627+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:48:05.973792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:48:05.973792+0000","last_clean_scrub_stamp":"2024-09-17T05:48:05.973792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:55:03.368792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.21","version":"0'0","reported_seq":1,"reported_epoch":84,"state":"creating+peering","last_fresh":"2024-09-17T05:48:05.982834+0000","last_change":"2024-09-17T05:48:05.982834+0000","last_active":"2024-09-17T05:48:05.973792+0000","last_peered":"2024-09-17T05:48:05.973792+0000","last_clean":"2024-09-17T05:48:05.973792+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:48:05.982834+0000","last_undegraded":"2024-09-17T05:48:05.982834+0000","last_fullsized":"2024-09-17T05:48:05.982834+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:48:05.973792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:48:05.973792+0000","last_clean_scrub_stamp":"2024-09-17T05:48:05.973792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.20","version":"0'0","reported_seq":10,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T05:48:07.015971+0000","last_change":"2024-09-17T05:48:07.009478+0000","last_active":"2024-09-17T05:48:07.015971+0000","last_peered":"2024-09-17T05:48:07.015971+0000","last_clean":"2024-09-17T05:48:07.015971+0000","last_became_active":"2024-09-17T05:48:07.009198+0000","last_became_peered":"2024-09-17T05:48:07.009198+0000","last_unstale":"2024-09-17T05:48:07.015971+0000","last_undegraded":"2024-09-17T05:48:07.015971+0000","last_fullsized":"2024-09-17T05:48:07.015971+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:48:05.973792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:48:05.973792+0000","last_clean_scrub_stamp":"2024-09-17T05:48:05.973792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:54:11.908409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1e","version":"0'0","reported_seq":1,"reported_epoch":84,"state":"creating+peering","last_fresh":"2024-09-17T05:48:05.989512+0000","last_change":"2024-09-17T05:48:05.989512+0000","last_active":"2024-09-17T05:48:05.973792+0000","last_peered":"2024-09-17T05:48:05.973792+0000","last_clean":"2024-09-17T05:48:05.973792+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:48:05.989512+0000","last_undegraded":"2024-09-17T05:48:05.989512+0000","last_fullsized":"2024-09-17T05:48:05.989512+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:48:05.973792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:48:05.973792+0000","last_clean_scrub_stamp":"2024-09-17T05:48:05.973792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1f","version":"85'4","reported_seq":17,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T05:48:07.027168+0000","last_change":"2024-09-17T05:48:05.997338+0000","last_active":"2024-09-17T05:48:07.027168+0000","last_peered":"2024-09-17T05:48:07.027168+0000","last_clean":"2024-09-17T05:48:07.027168+0000","last_became_active":"2024-09-17T05:48:05.996975+0000","last_became_peered":"2024-09-17T05:48:05.996975+0000","last_unstale":"2024-09-17T05:48:07.027168+0000","last_undegraded":"2024-09-17T05:48:07.027168+0000","last_fullsized":"2024-09-17T05:48:07.027168+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:48:04.965082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:48:04.965082+0000","last_clean_scrub_stamp":"2024-09-17T05:48:04.965082+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:18:51.809325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1f","version":"0'0","reported_seq":10,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T05:48:07.017293+0000","last_change":"2024-09-17T05:48:07.013038+0000","last_active":"2024-09-17T05:48:07.017293+0000","last_peered":"2024-09-17T05:48:07.017293+0000","last_clean":"2024-09-17T05:48:07.017293+0000","last_became_active":"2024-09-17T05:48:07.012730+0000","last_became_peered":"2024-09-17T05:48:07.012730+0000","last_unstale":"2024-09-17T05:48:07.017293+0000","last_undegraded":"2024-09-17T05:48:07.017293+0000","last_fullsized":"2024-09-17T05:48:07.017293+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:48:05.973792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:48:05.973792+0000","last_clean_scrub_stamp":"2024-09-17T05:48:05.973792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:25:22.303460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.1e","version":"0'0","reported_seq":10,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-17T05:48:05.997003+0000","last_change":"2024-09-17T05:48:05.995823+0000","last_active":"2024-09-17T05:48:05.997003+0000","last_peered":"2024-09-17T05:48:05.997003+0000","last_clean":"2024-09-17T05:48:05.997003+0000","last_became_active":"2024-09-17T05:48:05.995488+0000","last_became_peered":"2024-09-17T05:48:05.995488+0000","last_unstale":"2024-09-17T05:48:05.997003+0000","last_undegraded":"2024-09-17T05:48:05.997003+0000","last_fullsized":"2024-09-17T05:48:05.997003+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:48:04.965082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:48:04.965082+0000","last_clean_scrub_stamp":"2024-09-17T05:48:04.965082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:09:48.701468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.1c","version":"0'0","reported_seq":10,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T05:48:07.016959+0000","last_change":"2024-09-17T05:48:07.011380+0000","last_active":"2024-09-17T05:48:07.016959+0000","last_peered":"2024-09-17T05:48:07.016959+0000","last_clean":"2024-09-17T05:48:07.016959+0000","last_became_active":"2024-09-17T05:48:07.011078+0000","last_became_peered":"2024-09-17T05:48:07.011078+0000","last_unstale":"2024-09-17T05:48:07.016959+0000","last_undegraded":"2024-09-17T05:48:07.016959+0000","last_fullsized":"2024-09-17T05:48:07.016959+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:48:05.973792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:48:05.973792+0000","last_clean_scrub_stamp":"2024-09-17T05:48:05.973792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:45:26.386010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.1d","version":"85'2","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-17T05:48:08.017837+0000","last_change":"2024-09-17T05:48:05.995146+0000","last_active":"2024-09-17T05:48:08.017837+0000","last_peered":"2024-09-17T05:48:08.017837+0000","last_clean":"2024-09-17T05:48:08.017837+0000","last_became_active":"2024-09-17T05:48:05.994843+0000","last_became_peered":"2024-09-17T05:48:05.994843+0000","last_unstale":"2024-09-17T05:48:08.017837+0000","last_undegraded":"2024-09-17T05:48:08.017837+0000","last_fullsized":"2024-09-17T05:48:08.017837+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:48:04.965082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:48:04.965082+0000","last_clean_scrub_stamp":"2024-09-17T05:48:04.965082+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:08:12.896308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1d","version":"0'0","reported_seq":1,"reported_epoch":84,"state":"creating+peering","last_fresh":"2024-09-17T05:48:05.980180+0000","last_change":"2024-09-17T05:48:05.980180+0000","last_active":"2024-09-17T05:48:05.973792+0000","last_peered":"2024-09-17T05:48:05.973792+0000","last_clean":"2024-09-17T05:48:05.973792+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:48:05.980180+0000","last_undegraded":"2024-09-17T05:48:05.980180+0000","last_fullsized":"2024-09-17T05:48:05.980180+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:48:05.973792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:48:05.973792+0000","last_clean_scrub_stamp":"2024-09-17T05:48:05.973792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1c","version":"85'2","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-17T05:48:08.017546+0000","last_change":"2024-09-17T05:48:05.996138+0000","last_active":"2024-09-17T05:48:08.017546+0000","last_peered":"2024-09-17T05:48:08.017546+0000","last_clean":"2024-09-17T05:48:08.017546+0000","last_became_active":"2024-09-17T05:48:05.995742+0000","last_became_peered":"2024-09-17T05:48:05.995742+0000","last_unstale":"2024-09-17T05:48:08.017546+0000","last_undegraded":"2024-09-17T05:48:08.017546+0000","last_fullsized":"2024-09-17T05:48:08.017546+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:48:04.965082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:48:04.965082+0000","last_clean_scrub_stamp":"2024-09-17T05:48:04.965082+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:07:07.086219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1a","version":"0'0","reported_seq":10,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T05:48:07.008594+0000","last_change":"2024-09-17T05:48:07.003430+0000","last_active":"2024-09-17T05:48:07.008594+0000","last_peered":"2024-09-17T05:48:07.008594+0000","last_clean":"2024-09-17T05:48:07.008594+0000","last_became_active":"2024-09-17T05:48:07.002894+0000","last_became_peered":"2024-09-17T05:48:07.002894+0000","last_unstale":"2024-09-17T05:48:07.008594+0000","last_undegraded":"2024-09-17T05:48:07.008594+0000","last_fullsized":"2024-09-17T05:48:07.008594+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:48:05.973792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:48:05.973792+0000","last_clean_scrub_stamp":"2024-09-17T05:48:05.973792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:41:40.435956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.1b","version":"0'0","reported_seq":10,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-17T05:48:06.000918+0000","last_change":"2024-09-17T05:48:06.000106+0000","last_active":"2024-09-17T05:48:06.000918+0000","last_peered":"2024-09-17T05:48:06.000918+0000","last_clean":"2024-09-17T05:48:06.000918+0000","last_became_active":"2024-09-17T05:48:05.999798+0000","last_became_peered":"2024-09-17T05:48:05.999798+0000","last_unstale":"2024-09-17T05:48:06.000918+0000","last_undegraded":"2024-09-17T05:48:06.000918+0000","last_fullsized":"2024-09-17T05:48:06.000918+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:48:04.965082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:48:04.965082+0000","last_clean_scrub_stamp":"2024-09-17T05:48:04.965082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:16:50.545089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.1b","version":"0'0","reported_seq":1,"reported_epoch":84,"state":"creating+peering","last_fresh":"2024-09-17T05:48:05.989943+0000","last_change":"2024-09-17T05:48:05.989943+0000","last_active":"2024-09-17T05:48:05.973792+0000","last_peered":"2024-09-17T05:48:05.973792+0000","last_clean":"2024-09-17T05:48:05.973792+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:48:05.989943+0000","last_undegraded":"2024-09-17T05:48:05.989943+0000","last_fullsized":"2024-09-17T05:48:05.989943+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:48:05.973792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:48:05.973792+0000","last_clean_scrub_stamp":"2024-09-17T05:48:05.973792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1a","version":"0'0","reported_seq":10,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-17T05:48:05.998331+0000","last_change":"2024-09-17T05:48:05.996177+0000","last_active":"2024-09-17T05:48:05.998331+0000","last_peered":"2024-09-17T05:48:05.998331+0000","last_clean":"2024-09-17T05:48:05.998331+0000","last_became_active":"2024-09-17T05:48:05.995803+0000","last_became_peered":"2024-09-17T05:48:05.995803+0000","last_unstale":"2024-09-17T05:48:05.998331+0000","last_undegraded":"2024-09-17T05:48:05.998331+0000","last_fullsized":"2024-09-17T05:48:05.998331+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:48:04.965082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:48:04.965082+0000","last_clean_scrub_stamp":"2024-09-17T05:48:04.965082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:29:46.170441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.18","version":"0'0","reported_seq":1,"reported_epoch":84,"state":"creating+peering","last_fresh":"2024-09-17T05:48:05.980690+0000","last_change":"2024-09-17T05:48:05.980690+0000","last_active":"2024-09-17T05:48:05.973792+0000","last_peered":"2024-09-17T05:48:05.973792+0000","last_clean":"2024-09-17T05:48:05.973792+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:48:05.980690+0000","last_undegraded":"2024-09-17T05:48:05.980690+0000","last_fullsized":"2024-09-17T05:48:05.980690+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:48:05.973792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:48:05.973792+0000","last_clean_scrub_stamp":"2024-09-17T05:48:05.973792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.19","version":"0'0","reported_seq":15,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-17T05:48:08.017351+0000","last_change":"2024-09-17T05:48:05.994519+0000","last_active":"2024-09-17T05:48:08.017351+0000","last_peered":"2024-09-17T05:48:08.017351+0000","last_clean":"2024-09-17T05:48:08.017351+0000","last_became_active":"2024-09-17T05:48:05.994089+0000","last_became_peered":"2024-09-17T05:48:05.994089+0000","last_unstale":"2024-09-17T05:48:08.017351+0000","last_undegraded":"2024-09-17T05:48:08.017351+0000","last_fullsized":"2024-09-17T05:48:08.017351+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:48:04.965082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:48:04.965082+0000","last_clean_scrub_stamp":"2024-09-17T05:48:04.965082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:10:49.729836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.19","version":"0'0","reported_seq":10,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T05:48:07.008542+0000","last_change":"2024-09-17T05:48:07.006952+0000","last_active":"2024-09-17T05:48:07.008542+0000","last_peered":"2024-09-17T05:48:07.008542+0000","last_clean":"2024-09-17T05:48:07.008542+0000","last_became_active":"2024-09-17T05:48:07.006627+0000","last_became_peered":"2024-09-17T05:48:07.006627+0000","last_unstale":"2024-09-17T05:48:07.008542+0000","last_undegraded":"2024-09-17T05:48:07.008542+0000","last_fullsized":"2024-09-17T05:48:07.008542+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:48:05.973792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:48:05.973792+0000","last_clean_scrub_stamp":"2024-09-17T05:48:05.973792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:01:24.000485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.18","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T05:48:06.991703+0000","last_change":"2024-09-17T05:48:05.999386+0000","last_active":"2024-09-17T05:48:06.991703+0000","last_peered":"2024-09-17T05:48:06.991703+0000","last_clean":"2024-09-17T05:48:06.991703+0000","last_became_active":"2024-09-17T05:48:05.999075+0000","last_became_peered":"2024-09-17T05:48:05.999075+0000","last_unstale":"2024-09-17T05:48:06.991703+0000","last_undegraded":"2024-09-17T05:48:06.991703+0000","last_fullsized":"2024-09-17T05:48:06.991703+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:48:04.965082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:48:04.965082+0000","last_clean_scrub_stamp":"2024-09-17T05:48:04.965082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:02:12.685719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.16","version":"0'0","reported_seq":10,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T05:48:07.007163+0000","last_change":"2024-09-17T05:48:07.004229+0000","last_active":"2024-09-17T05:48:07.007163+0000","last_peered":"2024-09-17T05:48:07.007163+0000","last_clean":"2024-09-17T05:48:07.007163+0000","last_became_active":"2024-09-17T05:48:07.003931+0000","last_became_peered":"2024-09-17T05:48:07.003931+0000","last_unstale":"2024-09-17T05:48:07.007163+0000","last_undegraded":"2024-09-17T05:48:07.007163+0000","last_fullsized":"2024-09-17T05:48:07.007163+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:48:05.973792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:48:05.973792+0000","last_clean_scrub_stamp":"2024-09-17T05:48:05.973792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:40:53.536640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.17","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T05:48:07.000319+0000","last_change":"2024-09-17T05:48:05.994108+0000","last_active":"2024-09-17T05:48:07.000319+0000","last_peered":"2024-09-17T05:48:07.000319+0000","last_clean":"2024-09-17T05:48:07.000319+0000","last_became_active":"2024-09-17T05:48:05.993676+0000","last_became_peered":"2024-09-17T05:48:05.993676+0000","last_unstale":"2024-09-17T05:48:07.000319+0000","last_undegraded":"2024-09-17T05:48:07.000319+0000","last_fullsized":"2024-09-17T05:48:07.000319+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:48:04.965082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:48:04.965082+0000","last_clean_scrub_stamp":"2024-09-17T05:48:04.965082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:36:21.212798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.17","version":"0'0","reported_seq":1,"reported_epoch":84,"state":"creating+peering","last_fresh":"2024-09-17T05:48:05.985621+0000","last_change":"2024-09-17T05:48:05.985621+0000","last_active":"2024-09-17T05:48:05.973792+0000","last_peered":"2024-09-17T05:48:05.973792+0000","last_clean":"2024-09-17T05:48:05.973792+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:48:05.985621+0000","last_undegraded":"2024-09-17T05:48:05.985621+0000","last_fullsized":"2024-09-17T05:48:05.985621+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:48:05.973792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:48:05.973792+0000","last_clean_scrub_stamp":"2024-09-17T05:48:05.973792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.16","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T05:48:07.005218+0000","last_change":"2024-09-17T05:48:05.998132+0000","last_active":"2024-09-17T05:48:07.005218+0000","last_peered":"2024-09-17T05:48:07.005218+0000","last_clean":"2024-09-17T05:48:07.005218+0000","last_became_active":"2024-09-17T05:48:05.997479+0000","last_became_peered":"2024-09-17T05:48:05.997479+0000","last_unstale":"2024-09-17T05:48:07.005218+0000","last_undegraded":"2024-09-17T05:48:07.005218+0000","last_fullsized":"2024-09-17T05:48:07.005218+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:48:04.965082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:48:04.965082+0000","last_clean_scrub_stamp":"2024-09-17T05:48:04.965082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:30:29.544066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.14","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-17T05:48:08.017612+0000","last_change":"2024-09-17T05:48:07.010434+0000","last_active":"2024-09-17T05:48:08.017612+0000","last_peered":"2024-09-17T05:48:08.017612+0000","last_clean":"2024-09-17T05:48:08.017612+0000","last_became_active":"2024-09-17T05:48:07.009605+0000","last_became_peered":"2024-09-17T05:48:07.009605+0000","last_unstale":"2024-09-17T05:48:08.017612+0000","last_undegraded":"2024-09-17T05:48:08.017612+0000","last_fullsized":"2024-09-17T05:48:08.017612+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:48:05.973792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:48:05.973792+0000","last_clean_scrub_stamp":"2024-09-17T05:48:05.973792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:46:18.050983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.15","version":"85'3","reported_seq":16,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T05:48:07.027048+0000","last_change":"2024-09-17T05:48:05.999363+0000","last_active":"2024-09-17T05:48:07.027048+0000","last_peered":"2024-09-17T05:48:07.027048+0000","last_clean":"2024-09-17T05:48:07.027048+0000","last_became_active":"2024-09-17T05:48:05.998976+0000","last_became_peered":"2024-09-17T05:48:05.998976+0000","last_unstale":"2024-09-17T05:48:07.027048+0000","last_undegraded":"2024-09-17T05:48:07.027048+0000","last_fullsized":"2024-09-17T05:48:07.027048+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:48:04.965082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:48:04.965082+0000","last_clean_scrub_stamp":"2024-09-17T05:48:04.965082+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:03:18.092299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.15","version":"0'0","reported_seq":1,"reported_epoch":84,"state":"creating+peering","last_fresh":"2024-09-17T05:48:05.988352+0000","last_change":"2024-09-17T05:48:05.988352+0000","last_active":"2024-09-17T05:48:05.973792+0000","last_peered":"2024-09-17T05:48:05.973792+0000","last_clean":"2024-09-17T05:48:05.973792+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:48:05.988352+0000","last_undegraded":"2024-09-17T05:48:05.988352+0000","last_fullsized":"2024-09-17T05:48:05.988352+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:48:05.973792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:48:05.973792+0000","last_clean_scrub_stamp":"2024-09-17T05:48:05.973792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.14","version":"0'0","reported_seq":10,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-17T05:48:05.998686+0000","last_change":"2024-09-17T05:48:05.997721+0000","last_active":"2024-09-17T05:48:05.998686+0000","last_peered":"2024-09-17T05:48:05.998686+0000","last_clean":"2024-09-17T05:48:05.998686+0000","last_became_active":"2024-09-17T05:48:05.997375+0000","last_became_peered":"2024-09-17T05:48:05.997375+0000","last_unstale":"2024-09-17T05:48:05.998686+0000","last_undegraded":"2024-09-17T05:48:05.998686+0000","last_fullsized":"2024-09-17T05:48:05.998686+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:48:04.965082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:48:04.965082+0000","last_clean_scrub_stamp":"2024-09-17T05:48:04.965082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:17:35.686622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.12","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-17T05:48:08.017527+0000","last_change":"2024-09-17T05:48:07.014653+0000","last_active":"2024-09-17T05:48:08.017527+0000","last_peered":"2024-09-17T05:48:08.017527+0000","last_clean":"2024-09-17T05:48:08.017527+0000","last_became_active":"2024-09-17T05:48:07.014227+0000","last_became_peered":"2024-09-17T05:48:07.014227+0000","last_unstale":"2024-09-17T05:48:08.017527+0000","last_undegraded":"2024-09-17T05:48:08.017527+0000","last_fullsized":"2024-09-17T05:48:08.017527+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:48:05.973792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:48:05.973792+0000","last_clean_scrub_stamp":"2024-09-17T05:48:05.973792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:47:25.975838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.13","version":"85'2","reported_seq":15,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T05:48:07.025656+0000","last_change":"2024-09-17T05:48:05.998280+0000","last_active":"2024-09-17T05:48:07.025656+0000","last_peered":"2024-09-17T05:48:07.025656+0000","last_clean":"2024-09-17T05:48:07.025656+0000","last_became_active":"2024-09-17T05:48:05.998002+0000","last_became_peered":"2024-09-17T05:48:05.998002+0000","last_unstale":"2024-09-17T05:48:07.025656+0000","last_undegraded":"2024-09-17T05:48:07.025656+0000","last_fullsized":"2024-09-17T05:48:07.025656+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:48:04.965082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:48:04.965082+0000","last_clean_scrub_stamp":"2024-09-17T05:48:04.965082+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:47:24.665134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.13","version":"0'0","reported_seq":1,"reported_epoch":84,"state":"creating+peering","last_fresh":"2024-09-17T05:48:05.979811+0000","last_change":"2024-09-17T05:48:05.979811+0000","last_active":"2024-09-17T05:48:05.973792+0000","last_peered":"2024-09-17T05:48:05.973792+0000","last_clean":"2024-09-17T05:48:05.973792+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:48:05.979811+0000","last_undegraded":"2024-09-17T05:48:05.979811+0000","last_fullsized":"2024-09-17T05:48:05.979811+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:48:05.973792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:48:05.973792+0000","last_clean_scrub_stamp":"2024-09-17T05:48:05.973792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.12","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T05:48:06.998518+0000","last_change":"2024-09-17T05:48:05.992907+0000","last_active":"2024-09-17T05:48:06.998518+0000","last_peered":"2024-09-17T05:48:06.998518+0000","last_clean":"2024-09-17T05:48:06.998518+0000","last_became_active":"2024-09-17T05:48:05.992511+0000","last_became_peered":"2024-09-17T05:48:05.992511+0000","last_unstale":"2024-09-17T05:48:06.998518+0000","last_undegraded":"2024-09-17T05:48:06.998518+0000","last_fullsized":"2024-09-17T05:48:06.998518+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:48:04.965082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:48:04.965082+0000","last_clean_scrub_stamp":"2024-09-17T05:48:04.965082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:50:06.270397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.10","version":"0'0","reported_seq":10,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T05:48:07.001747+0000","last_change":"2024-09-17T05:48:07.000184+0000","last_active":"2024-09-17T05:48:07.001747+0000","last_peered":"2024-09-17T05:48:07.001747+0000","last_clean":"2024-09-17T05:48:07.001747+0000","last_became_active":"2024-09-17T05:48:06.998794+0000","last_became_peered":"2024-09-17T05:48:06.998794+0000","last_unstale":"2024-09-17T05:48:07.001747+0000","last_undegraded":"2024-09-17T05:48:07.001747+0000","last_fullsized":"2024-09-17T05:48:07.001747+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:48:05.973792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:48:05.973792+0000","last_clean_scrub_stamp":"2024-09-17T05:48:05.973792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:00:20.671743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.11","version":"0'0","reported_seq":10,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-17T05:48:06.000120+0000","last_change":"2024-09-17T05:48:05.999329+0000","last_active":"2024-09-17T05:48:06.000120+0000","last_peered":"2024-09-17T05:48:06.000120+0000","last_clean":"2024-09-17T05:48:06.000120+0000","last_became_active":"2024-09-17T05:48:05.998937+0000","last_became_peered":"2024-09-17T05:48:05.998937+0000","last_unstale":"2024-09-17T05:48:06.000120+0000","last_undegraded":"2024-09-17T05:48:06.000120+0000","last_fullsized":"2024-09-17T05:48:06.000120+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:48:04.965082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:48:04.965082+0000","last_clean_scrub_stamp":"2024-09-17T05:48:04.965082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:14:55.111111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.11","version":"0'0","reported_seq":10,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T05:48:07.006789+0000","last_change":"2024-09-17T05:48:07.004159+0000","last_active":"2024-09-17T05:48:07.006789+0000","last_peered":"2024-09-17T05:48:07.006789+0000","last_clean":"2024-09-17T05:48:07.006789+0000","last_became_active":"2024-09-17T05:48:07.003830+0000","last_became_peered":"2024-09-17T05:48:07.003830+0000","last_unstale":"2024-09-17T05:48:07.006789+0000","last_undegraded":"2024-09-17T05:48:07.006789+0000","last_fullsized":"2024-09-17T05:48:07.006789+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:48:05.973792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:48:05.973792+0000","last_clean_scrub_stamp":"2024-09-17T05:48:05.973792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:28:05.997018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.10","version":"85'8","reported_seq":23,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-17T05:48:08.017251+0000","last_change":"2024-09-17T05:48:05.994461+0000","last_active":"2024-09-17T05:48:08.017251+0000","last_peered":"2024-09-17T05:48:08.017251+0000","last_clean":"2024-09-17T05:48:08.017251+0000","last_became_active":"2024-09-17T05:48:05.994138+0000","last_became_peered":"2024-09-17T05:48:05.994138+0000","last_unstale":"2024-09-17T05:48:08.017251+0000","last_undegraded":"2024-09-17T05:48:08.017251+0000","last_fullsized":"2024-09-17T05:48:08.017251+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:48:04.965082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:48:04.965082+0000","last_clean_scrub_stamp":"2024-09-17T05:48:04.965082+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:49:16.263159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.e","version":"0'0","reported_seq":1,"reported_epoch":84,"state":"creating+peering","last_fresh":"2024-09-17T05:48:05.980418+0000","last_change":"2024-09-17T05:48:05.980418+0000","last_active":"2024-09-17T05:48:05.973792+0000","last_peered":"2024-09-17T05:48:05.973792+0000","last_clean":"2024-09-17T05:48:05.973792+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:48:05.980418+0000","last_undegraded":"2024-09-17T05:48:05.980418+0000","last_fullsized":"2024-09-17T05:48:05.980418+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:48:05.973792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:48:05.973792+0000","last_clean_scrub_stamp":"2024-09-17T05:48:05.973792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.f","version":"85'1","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T05:48:07.027049+0000","last_change":"2024-09-17T05:48:05.993133+0000","last_active":"2024-09-17T05:48:07.027049+0000","last_peered":"2024-09-17T05:48:07.027049+0000","last_clean":"2024-09-17T05:48:07.027049+0000","last_became_active":"2024-09-17T05:48:05.992787+0000","last_became_peered":"2024-09-17T05:48:05.992787+0000","last_unstale":"2024-09-17T05:48:07.027049+0000","last_undegraded":"2024-09-17T05:48:07.027049+0000","last_fullsized":"2024-09-17T05:48:07.027049+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:48:04.965082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:48:04.965082+0000","last_clean_scrub_stamp":"2024-09-17T05:48:04.965082+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:44:05.587367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.f","version":"0'0","reported_seq":10,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T05:48:07.015835+0000","last_change":"2024-09-17T05:48:07.009405+0000","last_active":"2024-09-17T05:48:07.015835+0000","last_peered":"2024-09-17T05:48:07.015835+0000","last_clean":"2024-09-17T05:48:07.015835+0000","last_became_active":"2024-09-17T05:48:07.009088+0000","last_became_peered":"2024-09-17T05:48:07.009088+0000","last_unstale":"2024-09-17T05:48:07.015835+0000","last_undegraded":"2024-09-17T05:48:07.015835+0000","last_fullsized":"2024-09-17T05:48:07.015835+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:48:05.973792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:48:05.973792+0000","last_clean_scrub_stamp":"2024-09-17T05:48:05.973792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:38:46.247147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.e","version":"85'2","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-17T05:48:08.017601+0000","last_change":"2024-09-17T05:48:05.995547+0000","last_active":"2024-09-17T05:48:08.017601+0000","last_peered":"2024-09-17T05:48:08.017601+0000","last_clean":"2024-09-17T05:48:08.017601+0000","last_became_active":"2024-09-17T05:48:05.995233+0000","last_became_peered":"2024-09-17T05:48:05.995233+0000","last_unstale":"2024-09-17T05:48:08.017601+0000","last_undegraded":"2024-09-17T05:48:08.017601+0000","last_fullsized":"2024-09-17T05:48:08.017601+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:48:04.965082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:48:04.965082+0000","last_clean_scrub_stamp":"2024-09-17T05:48:04.965082+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:45:54.436107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.d","version":"0'0","reported_seq":1,"reported_epoch":84,"state":"creating+peering","last_fresh":"2024-09-17T05:48:05.987698+0000","last_change":"2024-09-17T05:48:05.987698+0000","last_active":"2024-09-17T05:48:05.973792+0000","last_peered":"2024-09-17T05:48:05.973792+0000","last_clean":"2024-09-17T05:48:05.973792+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:48:05.987698+0000","last_undegraded":"2024-09-17T05:48:05.987698+0000","last_fullsized":"2024-09-17T05:48:05.987698+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:48:05.973792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:48:05.973792+0000","last_clean_scrub_stamp":"2024-09-17T05:48:05.973792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.c","version":"0'0","reported_seq":15,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-17T05:48:08.017659+0000","last_change":"2024-09-17T05:48:05.993828+0000","last_active":"2024-09-17T05:48:08.017659+0000","last_peered":"2024-09-17T05:48:08.017659+0000","last_clean":"2024-09-17T05:48:08.017659+0000","last_became_active":"2024-09-17T05:48:05.992893+0000","last_became_peered":"2024-09-17T05:48:05.992893+0000","last_unstale":"2024-09-17T05:48:08.017659+0000","last_undegraded":"2024-09-17T05:48:08.017659+0000","last_fullsized":"2024-09-17T05:48:08.017659+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:48:04.965082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:48:04.965082+0000","last_clean_scrub_stamp":"2024-09-17T05:48:04.965082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:19:19.306307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.a","version":"0'0","reported_seq":10,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T05:48:07.000656+0000","last_change":"2024-09-17T05:48:06.999976+0000","last_active":"2024-09-17T05:48:07.000656+0000","last_peered":"2024-09-17T05:48:07.000656+0000","last_clean":"2024-09-17T05:48:07.000656+0000","last_became_active":"2024-09-17T05:48:06.999669+0000","last_became_peered":"2024-09-17T05:48:06.999669+0000","last_unstale":"2024-09-17T05:48:07.000656+0000","last_undegraded":"2024-09-17T05:48:07.000656+0000","last_fullsized":"2024-09-17T05:48:07.000656+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:48:05.973792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:48:05.973792+0000","last_clean_scrub_stamp":"2024-09-17T05:48:05.973792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:13:35.334703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.b","version":"85'2","reported_seq":15,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T05:48:07.024635+0000","last_change":"2024-09-17T05:48:05.990062+0000","last_active":"2024-09-17T05:48:07.024635+0000","last_peered":"2024-09-17T05:48:07.024635+0000","last_clean":"2024-09-17T05:48:07.024635+0000","last_became_active":"2024-09-17T05:48:05.989770+0000","last_became_peered":"2024-09-17T05:48:05.989770+0000","last_unstale":"2024-09-17T05:48:07.024635+0000","last_undegraded":"2024-09-17T05:48:07.024635+0000","last_fullsized":"2024-09-17T05:48:07.024635+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:48:04.965082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:48:04.965082+0000","last_clean_scrub_stamp":"2024-09-17T05:48:04.965082+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:54:27.978918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.b","version":"0'0","reported_seq":1,"reported_epoch":84,"state":"creating+peering","last_fresh":"2024-09-17T05:48:05.987891+0000","last_change":"2024-09-17T05:48:05.987891+0000","last_active":"2024-09-17T05:48:05.973792+0000","last_peered":"2024-09-17T05:48:05.973792+0000","last_clean":"2024-09-17T05:48:05.973792+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:48:05.987891+0000","last_undegraded":"2024-09-17T05:48:05.987891+0000","last_fullsized":"2024-09-17T05:48:05.987891+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:48:05.973792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:48:05.973792+0000","last_clean_scrub_stamp":"2024-09-17T05:48:05.973792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.a","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T05:48:06.994828+0000","last_change":"2024-09-17T05:48:05.997773+0000","last_active":"2024-09-17T05:48:06.994828+0000","last_peered":"2024-09-17T05:48:06.994828+0000","last_clean":"2024-09-17T05:48:06.994828+0000","last_became_active":"2024-09-17T05:48:05.997035+0000","last_became_peered":"2024-09-17T05:48:05.997035+0000","last_unstale":"2024-09-17T05:48:06.994828+0000","last_undegraded":"2024-09-17T05:48:06.994828+0000","last_fullsized":"2024-09-17T05:48:06.994828+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:48:04.965082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:48:04.965082+0000","last_clean_scrub_stamp":"2024-09-17T05:48:04.965082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:12:13.405546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.8","version":"0'0","reported_seq":10,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T05:48:07.007881+0000","last_change":"2024-09-17T05:48:07.004667+0000","last_active":"2024-09-17T05:48:07.007881+0000","last_peered":"2024-09-17T05:48:07.007881+0000","last_clean":"2024-09-17T05:48:07.007881+0000","last_became_active":"2024-09-17T05:48:07.002420+0000","last_became_peered":"2024-09-17T05:48:07.002420+0000","last_unstale":"2024-09-17T05:48:07.007881+0000","last_undegraded":"2024-09-17T05:48:07.007881+0000","last_fullsized":"2024-09-17T05:48:07.007881+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:48:05.973792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:48:05.973792+0000","last_clean_scrub_stamp":"2024-09-17T05:48:05.973792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:58:39.931473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.9","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T05:48:06.994209+0000","last_change":"2024-09-17T05:48:05.999798+0000","last_active":"2024-09-17T05:48:06.994209+0000","last_peered":"2024-09-17T05:48:06.994209+0000","last_clean":"2024-09-17T05:48:06.994209+0000","last_became_active":"2024-09-17T05:48:05.999476+0000","last_became_peered":"2024-09-17T05:48:05.999476+0000","last_unstale":"2024-09-17T05:48:06.994209+0000","last_undegraded":"2024-09-17T05:48:06.994209+0000","last_fullsized":"2024-09-17T05:48:06.994209+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:48:04.965082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:48:04.965082+0000","last_clean_scrub_stamp":"2024-09-17T05:48:04.965082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:44:22.789741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.9","version":"0'0","reported_seq":1,"reported_epoch":84,"state":"creating+peering","last_fresh":"2024-09-17T05:48:05.984632+0000","last_change":"2024-09-17T05:48:05.984632+0000","last_active":"2024-09-17T05:48:05.973792+0000","last_peered":"2024-09-17T05:48:05.973792+0000","last_clean":"2024-09-17T05:48:05.973792+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:48:05.984632+0000","last_undegraded":"2024-09-17T05:48:05.984632+0000","last_fullsized":"2024-09-17T05:48:05.984632+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:48:05.973792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:48:05.973792+0000","last_clean_scrub_stamp":"2024-09-17T05:48:05.973792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.8","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T05:48:06.998203+0000","last_change":"2024-09-17T05:48:05.990918+0000","last_active":"2024-09-17T05:48:06.998203+0000","last_peered":"2024-09-17T05:48:06.998203+0000","last_clean":"2024-09-17T05:48:06.998203+0000","last_became_active":"2024-09-17T05:48:05.990644+0000","last_became_peered":"2024-09-17T05:48:05.990644+0000","last_unstale":"2024-09-17T05:48:06.998203+0000","last_undegraded":"2024-09-17T05:48:06.998203+0000","last_fullsized":"2024-09-17T05:48:06.998203+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:48:04.965082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:48:04.965082+0000","last_clean_scrub_stamp":"2024-09-17T05:48:04.965082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:32:32.045706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.6","version":"0'0","reported_seq":1,"reported_epoch":84,"state":"creating+peering","last_fresh":"2024-09-17T05:48:05.984822+0000","last_change":"2024-09-17T05:48:05.984822+0000","last_active":"2024-09-17T05:48:05.973792+0000","last_peered":"2024-09-17T05:48:05.973792+0000","last_clean":"2024-09-17T05:48:05.973792+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:48:05.984822+0000","last_undegraded":"2024-09-17T05:48:05.984822+0000","last_fullsized":"2024-09-17T05:48:05.984822+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:48:05.973792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:48:05.973792+0000","last_clean_scrub_stamp":"2024-09-17T05:48:05.973792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.7","version":"85'2","reported_seq":15,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T05:48:07.026024+0000","last_change":"2024-09-17T05:48:05.996277+0000","last_active":"2024-09-17T05:48:07.026024+0000","last_peered":"2024-09-17T05:48:07.026024+0000","last_clean":"2024-09-17T05:48:07.026024+0000","last_became_active":"2024-09-17T05:48:05.995979+0000","last_became_peered":"2024-09-17T05:48:05.995979+0000","last_unstale":"2024-09-17T05:48:07.026024+0000","last_undegraded":"2024-09-17T05:48:07.026024+0000","last_fullsized":"2024-09-17T05:48:07.026024+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:48:04.965082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:48:04.965082+0000","last_clean_scrub_stamp":"2024-09-17T05:48:04.965082+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:25:07.468281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.7","version":"0'0","reported_seq":1,"reported_epoch":84,"state":"creating+peering","last_fresh":"2024-09-17T05:48:05.979914+0000","last_change":"2024-09-17T05:48:05.979914+0000","last_active":"2024-09-17T05:48:05.973792+0000","last_peered":"2024-09-17T05:48:05.973792+0000","last_clean":"2024-09-17T05:48:05.973792+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:48:05.979914+0000","last_undegraded":"2024-09-17T05:48:05.979914+0000","last_fullsized":"2024-09-17T05:48:05.979914+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:48:05.973792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:48:05.973792+0000","last_clean_scrub_stamp":"2024-09-17T05:48:05.973792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.6","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T05:48:06.992144+0000","last_change":"2024-09-17T05:48:05.997590+0000","last_active":"2024-09-17T05:48:06.992144+0000","last_peered":"2024-09-17T05:48:06.992144+0000","last_clean":"2024-09-17T05:48:06.992144+0000","last_became_active":"2024-09-17T05:48:05.997301+0000","last_became_peered":"2024-09-17T05:48:05.997301+0000","last_unstale":"2024-09-17T05:48:06.992144+0000","last_undegraded":"2024-09-17T05:48:06.992144+0000","last_fullsized":"2024-09-17T05:48:06.992144+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:48:04.965082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:48:04.965082+0000","last_clean_scrub_stamp":"2024-09-17T05:48:04.965082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:28:36.315309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.4","version":"0'0","reported_seq":10,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T05:48:07.017376+0000","last_change":"2024-09-17T05:48:07.014783+0000","last_active":"2024-09-17T05:48:07.017376+0000","last_peered":"2024-09-17T05:48:07.017376+0000","last_clean":"2024-09-17T05:48:07.017376+0000","last_became_active":"2024-09-17T05:48:07.013864+0000","last_became_peered":"2024-09-17T05:48:07.013864+0000","last_unstale":"2024-09-17T05:48:07.017376+0000","last_undegraded":"2024-09-17T05:48:07.017376+0000","last_fullsized":"2024-09-17T05:48:07.017376+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:48:05.973792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:48:05.973792+0000","last_clean_scrub_stamp":"2024-09-17T05:48:05.973792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:55:17.823783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.5","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T05:48:06.997381+0000","last_change":"2024-09-17T05:48:05.995722+0000","last_active":"2024-09-17T05:48:06.997381+0000","last_peered":"2024-09-17T05:48:06.997381+0000","last_clean":"2024-09-17T05:48:06.997381+0000","last_became_active":"2024-09-17T05:48:05.995345+0000","last_became_peered":"2024-09-17T05:48:05.995345+0000","last_unstale":"2024-09-17T05:48:06.997381+0000","last_undegraded":"2024-09-17T05:48:06.997381+0000","last_fullsized":"2024-09-17T05:48:06.997381+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:48:04.965082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:48:04.965082+0000","last_clean_scrub_stamp":"2024-09-17T05:48:04.965082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:28:33.210082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.5","version":"0'0","reported_seq":1,"reported_epoch":84,"state":"creating+peering","last_fresh":"2024-09-17T05:48:05.983735+0000","last_change":"2024-09-17T05:48:05.983735+0000","last_active":"2024-09-17T05:48:05.973792+0000","last_peered":"2024-09-17T05:48:05.973792+0000","last_clean":"2024-09-17T05:48:05.973792+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:48:05.983735+0000","last_undegraded":"2024-09-17T05:48:05.983735+0000","last_fullsized":"2024-09-17T05:48:05.983735+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:48:05.973792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:48:05.973792+0000","last_clean_scrub_stamp":"2024-09-17T05:48:05.973792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.4","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T05:48:07.006446+0000","last_change":"2024-09-17T05:48:05.995600+0000","last_active":"2024-09-17T05:48:07.006446+0000","last_peered":"2024-09-17T05:48:07.006446+0000","last_clean":"2024-09-17T05:48:07.006446+0000","last_became_active":"2024-09-17T05:48:05.993437+0000","last_became_peered":"2024-09-17T05:48:05.993437+0000","last_unstale":"2024-09-17T05:48:07.006446+0000","last_undegraded":"2024-09-17T05:48:07.006446+0000","last_fullsized":"2024-09-17T05:48:07.006446+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:48:04.965082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:48:04.965082+0000","last_clean_scrub_stamp":"2024-09-17T05:48:04.965082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:34:01.741103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.2","version":"0'0","reported_seq":1,"reported_epoch":84,"state":"creating+peering","last_fresh":"2024-09-17T05:48:05.984825+0000","last_change":"2024-09-17T05:48:05.984825+0000","last_active":"2024-09-17T05:48:05.973792+0000","last_peered":"2024-09-17T05:48:05.973792+0000","last_clean":"2024-09-17T05:48:05.973792+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:48:05.984825+0000","last_undegraded":"2024-09-17T05:48:05.984825+0000","last_fullsized":"2024-09-17T05:48:05.984825+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:48:05.973792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:48:05.973792+0000","last_clean_scrub_stamp":"2024-09-17T05:48:05.973792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.3","version":"0'0","reported_seq":15,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-17T05:48:08.017675+0000","last_change":"2024-09-17T05:48:05.993443+0000","last_active":"2024-09-17T05:48:08.017675+0000","last_peered":"2024-09-17T05:48:08.017675+0000","last_clean":"2024-09-17T05:48:08.017675+0000","last_became_active":"2024-09-17T05:48:05.993128+0000","last_became_peered":"2024-09-17T05:48:05.993128+0000","last_unstale":"2024-09-17T05:48:08.017675+0000","last_undegraded":"2024-09-17T05:48:08.017675+0000","last_fullsized":"2024-09-17T05:48:08.017675+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:48:04.965082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:48:04.965082+0000","last_clean_scrub_stamp":"2024-09-17T05:48:04.965082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:20:42.632458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.3","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-17T05:48:08.017609+0000","last_change":"2024-09-17T05:48:07.019471+0000","last_active":"2024-09-17T05:48:08.017609+0000","last_peered":"2024-09-17T05:48:08.017609+0000","last_clean":"2024-09-17T05:48:08.017609+0000","last_became_active":"2024-09-17T05:48:07.019107+0000","last_became_peered":"2024-09-17T05:48:07.019107+0000","last_unstale":"2024-09-17T05:48:08.017609+0000","last_undegraded":"2024-09-17T05:48:08.017609+0000","last_fullsized":"2024-09-17T05:48:08.017609+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:48:05.973792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:48:05.973792+0000","last_clean_scrub_stamp":"2024-09-17T05:48:05.973792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:30:20.891839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.2","version":"0'0","reported_seq":10,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-17T05:48:05.998302+0000","last_change":"2024-09-17T05:48:05.995790+0000","last_active":"2024-09-17T05:48:05.998302+0000","last_peered":"2024-09-17T05:48:05.998302+0000","last_clean":"2024-09-17T05:48:05.998302+0000","last_became_active":"2024-09-17T05:48:05.995430+0000","last_became_peered":"2024-09-17T05:48:05.995430+0000","last_unstale":"2024-09-17T05:48:05.998302+0000","last_undegraded":"2024-09-17T05:48:05.998302+0000","last_fullsized":"2024-09-17T05:48:05.998302+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:48:04.965082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:48:04.965082+0000","last_clean_scrub_stamp":"2024-09-17T05:48:04.965082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:51:12.220768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.0","version":"0'0","reported_seq":1,"reported_epoch":84,"state":"creating+peering","last_fresh":"2024-09-17T05:48:05.979780+0000","last_change":"2024-09-17T05:48:05.979780+0000","last_active":"2024-09-17T05:48:05.973792+0000","last_peered":"2024-09-17T05:48:05.973792+0000","last_clean":"2024-09-17T05:48:05.973792+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:48:05.979780+0000","last_undegraded":"2024-09-17T05:48:05.979780+0000","last_fullsized":"2024-09-17T05:48:05.979780+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:48:05.973792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:48:05.973792+0000","last_clean_scrub_stamp":"2024-09-17T05:48:05.973792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T05:48:07.000198+0000","last_change":"2024-09-17T05:48:05.994404+0000","last_active":"2024-09-17T05:48:07.000198+0000","last_peered":"2024-09-17T05:48:07.000198+0000","last_clean":"2024-09-17T05:48:07.000198+0000","last_became_active":"2024-09-17T05:48:05.993984+0000","last_became_peered":"2024-09-17T05:48:05.993984+0000","last_unstale":"2024-09-17T05:48:07.000198+0000","last_undegraded":"2024-09-17T05:48:07.000198+0000","last_fullsized":"2024-09-17T05:48:07.000198+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:48:04.965082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:48:04.965082+0000","last_clean_scrub_stamp":"2024-09-17T05:48:04.965082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:59:41.841128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1","version":"0'0","reported_seq":10,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T05:48:07.018798+0000","last_change":"2024-09-17T05:48:07.016257+0000","last_active":"2024-09-17T05:48:07.018798+0000","last_peered":"2024-09-17T05:48:07.018798+0000","last_clean":"2024-09-17T05:48:07.018798+0000","last_became_active":"2024-09-17T05:48:07.015950+0000","last_became_peered":"2024-09-17T05:48:07.015950+0000","last_unstale":"2024-09-17T05:48:07.018798+0000","last_undegraded":"2024-09-17T05:48:07.018798+0000","last_fullsized":"2024-09-17T05:48:07.018798+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:48:05.973792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:48:05.973792+0000","last_clean_scrub_stamp":"2024-09-17T05:48:05.973792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:09:18.062866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.0","version":"0'0","reported_seq":10,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-17T05:48:06.000943+0000","last_change":"2024-09-17T05:48:06.000083+0000","last_active":"2024-09-17T05:48:06.000943+0000","last_peered":"2024-09-17T05:48:06.000943+0000","last_clean":"2024-09-17T05:48:06.000943+0000","last_became_active":"2024-09-17T05:48:05.999770+0000","last_became_peered":"2024-09-17T05:48:05.999770+0000","last_unstale":"2024-09-17T05:48:06.000943+0000","last_undegraded":"2024-09-17T05:48:06.000943+0000","last_fullsized":"2024-09-17T05:48:06.000943+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:48:04.965082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:48:04.965082+0000","last_clean_scrub_stamp":"2024-09-17T05:48:04.965082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:11:27.267806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.c","version":"0'0","reported_seq":10,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T05:48:07.009303+0000","last_change":"2024-09-17T05:48:07.007210+0000","last_active":"2024-09-17T05:48:07.009303+0000","last_peered":"2024-09-17T05:48:07.009303+0000","last_clean":"2024-09-17T05:48:07.009303+0000","last_became_active":"2024-09-17T05:48:07.006278+0000","last_became_peered":"2024-09-17T05:48:07.006278+0000","last_unstale":"2024-09-17T05:48:07.009303+0000","last_undegraded":"2024-09-17T05:48:07.009303+0000","last_fullsized":"2024-09-17T05:48:07.009303+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:48:05.973792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:48:05.973792+0000","last_clean_scrub_stamp":"2024-09-17T05:48:05.973792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:11:54.651531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.d","version":"0'0","reported_seq":10,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-17T05:48:05.996883+0000","last_change":"2024-09-17T05:48:05.995764+0000","last_active":"2024-09-17T05:48:05.996883+0000","last_peered":"2024-09-17T05:48:05.996883+0000","last_clean":"2024-09-17T05:48:05.996883+0000","last_became_active":"2024-09-17T05:48:05.995439+0000","last_became_peered":"2024-09-17T05:48:05.995439+0000","last_unstale":"2024-09-17T05:48:05.996883+0000","last_undegraded":"2024-09-17T05:48:05.996883+0000","last_fullsized":"2024-09-17T05:48:05.996883+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:48:04.965082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:48:04.965082+0000","last_clean_scrub_stamp":"2024-09-17T05:48:04.965082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:59:39.032133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"19'72","reported_seq":223,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-17T05:48:05.984920+0000","last_change":"2024-09-17T05:41:48.539830+0000","last_active":"2024-09-17T05:48:05.984920+0000","last_peered":"2024-09-17T05:48:05.984920+0000","last_clean":"2024-09-17T05:48:05.984920+0000","last_became_active":"2024-09-17T05:41:48.538743+0000","last_became_peered":"2024-09-17T05:41:48.538743+0000","last_unstale":"2024-09-17T05:48:05.984920+0000","last_undegraded":"2024-09-17T05:48:05.984920+0000","last_fullsized":"2024-09-17T05:48:05.984920+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:47.152539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:47.152539+0000","last_clean_scrub_stamp":"2024-09-17T05:41:47.152539+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:08:02.952016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":13,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":12,"num_pg":32,"stat_sum":{"num_bytes":728,"num_objects":16,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":37,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":12,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":3116,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":28,"ondisk_log_size":28,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":16,"seq":68719476817,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":54424,"kb_used_data":1024,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94317416,"statfs":{"total":96636764160,"available":96581033984,"internally_reserved":0,"allocated":1048576,"data_stored":443474,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":54655430},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":7,"up_from":15,"seq":64424509521,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":50808,"kb_used_data":1568,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94321032,"statfs":{"total":96636764160,"available":96584736768,"internally_reserved":0,"allocated":1605632,"data_stored":1019930,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":50395594},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509520,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":50224,"kb_used_data":988,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94321616,"statfs":{"total":96636764160,"available":96585334784,"internally_reserved":0,"allocated":1011712,"data_stored":429562,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509520,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":50224,"kb_used_data":988,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94321616,"statfs":{"total":96636764160,"available":96585334784,"internally_reserved":0,"allocated":1011712,"data_stored":429562,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509520,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":72384,"kb_used_data":1000,"kb_used_omap":1,"kb_used_meta":71358,"kb_avail":94299456,"statfs":{"total":96636764160,"available":96562642944,"internally_reserved":0,"allocated":1024000,"data_stored":435921,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":73071047},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509520,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":50240,"kb_used_data":1000,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94321600,"statfs":{"total":96636764160,"available":96585318400,"internally_reserved":0,"allocated":1024000,"data_stored":435921,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509520,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":72412,"kb_used_data":1024,"kb_used_omap":1,"kb_used_meta":71358,"kb_avail":94299428,"statfs":{"total":96636764160,"available":96562614272,"internally_reserved":0,"allocated":1048576,"data_stored":442974,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":73071045},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574928,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55004,"kb_used_data":1608,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94316836,"statfs":{"total":96636764160,"available":96580440064,"internally_reserved":0,"allocated":1646592,"data_stored":1039566,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":194,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":694,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-17T05:48:11.738 INFO:tasks.ceph.ceph_manager.ceph:PG 13.3d is not active+clean 2024-09-17T05:48:11.738 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '13.3d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 84, 'state': 'creating+peering', 'last_fresh': '2024-09-17T05:48:05.981187+0000', 'last_change': '2024-09-17T05:48:05.981187+0000', 'last_active': '2024-09-17T05:48:05.973792+0000', 'last_peered': '2024-09-17T05:48:05.973792+0000', 'last_clean': '2024-09-17T05:48:05.973792+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:48:05.981187+0000', 'last_undegraded': '2024-09-17T05:48:05.981187+0000', 'last_fullsized': '2024-09-17T05:48:05.981187+0000', 'mapping_epoch': 84, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 84, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:48:05.973792+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:48:05.973792+0000', 'last_clean_scrub_stamp': '2024-09-17T05:48:05.973792+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 6], 'acting': [7, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-17T05:48:11.738 INFO:tasks.ceph.ceph_manager.ceph:PG 13.3b is not active+clean 2024-09-17T05:48:11.738 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '13.3b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 84, 'state': 'creating+peering', 'last_fresh': '2024-09-17T05:48:05.990716+0000', 'last_change': '2024-09-17T05:48:05.990716+0000', 'last_active': '2024-09-17T05:48:05.973792+0000', 'last_peered': '2024-09-17T05:48:05.973792+0000', 'last_clean': '2024-09-17T05:48:05.973792+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:48:05.990716+0000', 'last_undegraded': '2024-09-17T05:48:05.990716+0000', 'last_fullsized': '2024-09-17T05:48:05.990716+0000', 'mapping_epoch': 84, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 84, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:48:05.973792+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:48:05.973792+0000', 'last_clean_scrub_stamp': '2024-09-17T05:48:05.973792+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 1], 'acting': [4, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-17T05:48:11.738 INFO:tasks.ceph.ceph_manager.ceph:PG 13.3a is not active+clean 2024-09-17T05:48:11.738 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '13.3a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 84, 'state': 'creating+peering', 'last_fresh': '2024-09-17T05:48:05.986085+0000', 'last_change': '2024-09-17T05:48:05.986085+0000', 'last_active': '2024-09-17T05:48:05.973792+0000', 'last_peered': '2024-09-17T05:48:05.973792+0000', 'last_clean': '2024-09-17T05:48:05.973792+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:48:05.986085+0000', 'last_undegraded': '2024-09-17T05:48:05.986085+0000', 'last_fullsized': '2024-09-17T05:48:05.986085+0000', 'mapping_epoch': 84, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 84, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:48:05.973792+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:48:05.973792+0000', 'last_clean_scrub_stamp': '2024-09-17T05:48:05.973792+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 2], 'acting': [5, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-17T05:48:11.739 INFO:tasks.ceph.ceph_manager.ceph:PG 13.38 is not active+clean 2024-09-17T05:48:11.739 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '13.38', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 84, 'state': 'creating+peering', 'last_fresh': '2024-09-17T05:48:05.984329+0000', 'last_change': '2024-09-17T05:48:05.984329+0000', 'last_active': '2024-09-17T05:48:05.973792+0000', 'last_peered': '2024-09-17T05:48:05.973792+0000', 'last_clean': '2024-09-17T05:48:05.973792+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:48:05.984329+0000', 'last_undegraded': '2024-09-17T05:48:05.984329+0000', 'last_fullsized': '2024-09-17T05:48:05.984329+0000', 'mapping_epoch': 84, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 84, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:48:05.973792+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:48:05.973792+0000', 'last_clean_scrub_stamp': '2024-09-17T05:48:05.973792+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 1], 'acting': [5, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-17T05:48:11.739 INFO:tasks.ceph.ceph_manager.ceph:PG 13.37 is not active+clean 2024-09-17T05:48:11.739 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '13.37', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 84, 'state': 'creating+peering', 'last_fresh': '2024-09-17T05:48:05.986183+0000', 'last_change': '2024-09-17T05:48:05.986183+0000', 'last_active': '2024-09-17T05:48:05.973792+0000', 'last_peered': '2024-09-17T05:48:05.973792+0000', 'last_clean': '2024-09-17T05:48:05.973792+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:48:05.986183+0000', 'last_undegraded': '2024-09-17T05:48:05.986183+0000', 'last_fullsized': '2024-09-17T05:48:05.986183+0000', 'mapping_epoch': 84, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 84, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:48:05.973792+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:48:05.973792+0000', 'last_clean_scrub_stamp': '2024-09-17T05:48:05.973792+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 0], 'acting': [5, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-17T05:48:11.739 INFO:tasks.ceph.ceph_manager.ceph:PG 13.33 is not active+clean 2024-09-17T05:48:11.739 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '13.33', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 84, 'state': 'creating+peering', 'last_fresh': '2024-09-17T05:48:05.980666+0000', 'last_change': '2024-09-17T05:48:05.980666+0000', 'last_active': '2024-09-17T05:48:05.973792+0000', 'last_peered': '2024-09-17T05:48:05.973792+0000', 'last_clean': '2024-09-17T05:48:05.973792+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:48:05.980666+0000', 'last_undegraded': '2024-09-17T05:48:05.980666+0000', 'last_fullsized': '2024-09-17T05:48:05.980666+0000', 'mapping_epoch': 84, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 84, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:48:05.973792+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:48:05.973792+0000', 'last_clean_scrub_stamp': '2024-09-17T05:48:05.973792+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 4], 'acting': [7, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-17T05:48:11.739 INFO:tasks.ceph.ceph_manager.ceph:PG 13.30 is not active+clean 2024-09-17T05:48:11.739 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '13.30', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 84, 'state': 'creating+peering', 'last_fresh': '2024-09-17T05:48:05.986337+0000', 'last_change': '2024-09-17T05:48:05.986337+0000', 'last_active': '2024-09-17T05:48:05.973792+0000', 'last_peered': '2024-09-17T05:48:05.973792+0000', 'last_clean': '2024-09-17T05:48:05.973792+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:48:05.986337+0000', 'last_undegraded': '2024-09-17T05:48:05.986337+0000', 'last_fullsized': '2024-09-17T05:48:05.986337+0000', 'mapping_epoch': 84, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 84, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:48:05.973792+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:48:05.973792+0000', 'last_clean_scrub_stamp': '2024-09-17T05:48:05.973792+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 6], 'acting': [4, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-17T05:48:11.740 INFO:tasks.ceph.ceph_manager.ceph:PG 13.2f is not active+clean 2024-09-17T05:48:11.740 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '13.2f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 84, 'state': 'creating+peering', 'last_fresh': '2024-09-17T05:48:05.983346+0000', 'last_change': '2024-09-17T05:48:05.983346+0000', 'last_active': '2024-09-17T05:48:05.973792+0000', 'last_peered': '2024-09-17T05:48:05.973792+0000', 'last_clean': '2024-09-17T05:48:05.973792+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:48:05.983346+0000', 'last_undegraded': '2024-09-17T05:48:05.983346+0000', 'last_fullsized': '2024-09-17T05:48:05.983346+0000', 'mapping_epoch': 84, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 84, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:48:05.973792+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:48:05.973792+0000', 'last_clean_scrub_stamp': '2024-09-17T05:48:05.973792+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 2], 'acting': [4, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-17T05:48:11.740 INFO:tasks.ceph.ceph_manager.ceph:PG 13.26 is not active+clean 2024-09-17T05:48:11.740 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '13.26', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 84, 'state': 'creating+peering', 'last_fresh': '2024-09-17T05:48:05.981443+0000', 'last_change': '2024-09-17T05:48:05.981443+0000', 'last_active': '2024-09-17T05:48:05.973792+0000', 'last_peered': '2024-09-17T05:48:05.973792+0000', 'last_clean': '2024-09-17T05:48:05.973792+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:48:05.981443+0000', 'last_undegraded': '2024-09-17T05:48:05.981443+0000', 'last_fullsized': '2024-09-17T05:48:05.981443+0000', 'mapping_epoch': 84, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 84, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:48:05.973792+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:48:05.973792+0000', 'last_clean_scrub_stamp': '2024-09-17T05:48:05.973792+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 1], 'acting': [7, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-17T05:48:11.740 INFO:tasks.ceph.ceph_manager.ceph:PG 13.25 is not active+clean 2024-09-17T05:48:11.740 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '13.25', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 84, 'state': 'creating+peering', 'last_fresh': '2024-09-17T05:48:05.988800+0000', 'last_change': '2024-09-17T05:48:05.988800+0000', 'last_active': '2024-09-17T05:48:05.973792+0000', 'last_peered': '2024-09-17T05:48:05.973792+0000', 'last_clean': '2024-09-17T05:48:05.973792+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:48:05.988800+0000', 'last_undegraded': '2024-09-17T05:48:05.988800+0000', 'last_fullsized': '2024-09-17T05:48:05.988800+0000', 'mapping_epoch': 84, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 84, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:48:05.973792+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:48:05.973792+0000', 'last_clean_scrub_stamp': '2024-09-17T05:48:05.973792+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 3], 'acting': [4, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-17T05:48:11.740 INFO:tasks.ceph.ceph_manager.ceph:PG 13.21 is not active+clean 2024-09-17T05:48:11.740 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '13.21', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 84, 'state': 'creating+peering', 'last_fresh': '2024-09-17T05:48:05.982834+0000', 'last_change': '2024-09-17T05:48:05.982834+0000', 'last_active': '2024-09-17T05:48:05.973792+0000', 'last_peered': '2024-09-17T05:48:05.973792+0000', 'last_clean': '2024-09-17T05:48:05.973792+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:48:05.982834+0000', 'last_undegraded': '2024-09-17T05:48:05.982834+0000', 'last_fullsized': '2024-09-17T05:48:05.982834+0000', 'mapping_epoch': 84, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 84, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:48:05.973792+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:48:05.973792+0000', 'last_clean_scrub_stamp': '2024-09-17T05:48:05.973792+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 0], 'acting': [4, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-17T05:48:11.740 INFO:tasks.ceph.ceph_manager.ceph:PG 13.1e is not active+clean 2024-09-17T05:48:11.740 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '13.1e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 84, 'state': 'creating+peering', 'last_fresh': '2024-09-17T05:48:05.989512+0000', 'last_change': '2024-09-17T05:48:05.989512+0000', 'last_active': '2024-09-17T05:48:05.973792+0000', 'last_peered': '2024-09-17T05:48:05.973792+0000', 'last_clean': '2024-09-17T05:48:05.973792+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:48:05.989512+0000', 'last_undegraded': '2024-09-17T05:48:05.989512+0000', 'last_fullsized': '2024-09-17T05:48:05.989512+0000', 'mapping_epoch': 84, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 84, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:48:05.973792+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:48:05.973792+0000', 'last_clean_scrub_stamp': '2024-09-17T05:48:05.973792+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 6], 'acting': [4, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-17T05:48:11.741 INFO:tasks.ceph.ceph_manager.ceph:PG 13.1d is not active+clean 2024-09-17T05:48:11.741 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '13.1d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 84, 'state': 'creating+peering', 'last_fresh': '2024-09-17T05:48:05.980180+0000', 'last_change': '2024-09-17T05:48:05.980180+0000', 'last_active': '2024-09-17T05:48:05.973792+0000', 'last_peered': '2024-09-17T05:48:05.973792+0000', 'last_clean': '2024-09-17T05:48:05.973792+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:48:05.980180+0000', 'last_undegraded': '2024-09-17T05:48:05.980180+0000', 'last_fullsized': '2024-09-17T05:48:05.980180+0000', 'mapping_epoch': 84, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 84, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:48:05.973792+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:48:05.973792+0000', 'last_clean_scrub_stamp': '2024-09-17T05:48:05.973792+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 2], 'acting': [7, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-17T05:48:11.741 INFO:tasks.ceph.ceph_manager.ceph:PG 13.1b is not active+clean 2024-09-17T05:48:11.741 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '13.1b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 84, 'state': 'creating+peering', 'last_fresh': '2024-09-17T05:48:05.989943+0000', 'last_change': '2024-09-17T05:48:05.989943+0000', 'last_active': '2024-09-17T05:48:05.973792+0000', 'last_peered': '2024-09-17T05:48:05.973792+0000', 'last_clean': '2024-09-17T05:48:05.973792+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:48:05.989943+0000', 'last_undegraded': '2024-09-17T05:48:05.989943+0000', 'last_fullsized': '2024-09-17T05:48:05.989943+0000', 'mapping_epoch': 84, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 84, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:48:05.973792+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:48:05.973792+0000', 'last_clean_scrub_stamp': '2024-09-17T05:48:05.973792+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 2], 'acting': [4, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-17T05:48:11.741 INFO:tasks.ceph.ceph_manager.ceph:PG 13.18 is not active+clean 2024-09-17T05:48:11.741 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '13.18', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 84, 'state': 'creating+peering', 'last_fresh': '2024-09-17T05:48:05.980690+0000', 'last_change': '2024-09-17T05:48:05.980690+0000', 'last_active': '2024-09-17T05:48:05.973792+0000', 'last_peered': '2024-09-17T05:48:05.973792+0000', 'last_clean': '2024-09-17T05:48:05.973792+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:48:05.980690+0000', 'last_undegraded': '2024-09-17T05:48:05.980690+0000', 'last_fullsized': '2024-09-17T05:48:05.980690+0000', 'mapping_epoch': 84, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 84, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:48:05.973792+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:48:05.973792+0000', 'last_clean_scrub_stamp': '2024-09-17T05:48:05.973792+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 0], 'acting': [7, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-17T05:48:11.741 INFO:tasks.ceph.ceph_manager.ceph:PG 13.17 is not active+clean 2024-09-17T05:48:11.741 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '13.17', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 84, 'state': 'creating+peering', 'last_fresh': '2024-09-17T05:48:05.985621+0000', 'last_change': '2024-09-17T05:48:05.985621+0000', 'last_active': '2024-09-17T05:48:05.973792+0000', 'last_peered': '2024-09-17T05:48:05.973792+0000', 'last_clean': '2024-09-17T05:48:05.973792+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:48:05.985621+0000', 'last_undegraded': '2024-09-17T05:48:05.985621+0000', 'last_fullsized': '2024-09-17T05:48:05.985621+0000', 'mapping_epoch': 84, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 84, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:48:05.973792+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:48:05.973792+0000', 'last_clean_scrub_stamp': '2024-09-17T05:48:05.973792+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 2], 'acting': [5, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-17T05:48:11.741 INFO:tasks.ceph.ceph_manager.ceph:PG 13.15 is not active+clean 2024-09-17T05:48:11.741 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '13.15', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 84, 'state': 'creating+peering', 'last_fresh': '2024-09-17T05:48:05.988352+0000', 'last_change': '2024-09-17T05:48:05.988352+0000', 'last_active': '2024-09-17T05:48:05.973792+0000', 'last_peered': '2024-09-17T05:48:05.973792+0000', 'last_clean': '2024-09-17T05:48:05.973792+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:48:05.988352+0000', 'last_undegraded': '2024-09-17T05:48:05.988352+0000', 'last_fullsized': '2024-09-17T05:48:05.988352+0000', 'mapping_epoch': 84, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 84, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:48:05.973792+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:48:05.973792+0000', 'last_clean_scrub_stamp': '2024-09-17T05:48:05.973792+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 0], 'acting': [4, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-17T05:48:11.742 INFO:tasks.ceph.ceph_manager.ceph:PG 13.13 is not active+clean 2024-09-17T05:48:11.742 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '13.13', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 84, 'state': 'creating+peering', 'last_fresh': '2024-09-17T05:48:05.979811+0000', 'last_change': '2024-09-17T05:48:05.979811+0000', 'last_active': '2024-09-17T05:48:05.973792+0000', 'last_peered': '2024-09-17T05:48:05.973792+0000', 'last_clean': '2024-09-17T05:48:05.973792+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:48:05.979811+0000', 'last_undegraded': '2024-09-17T05:48:05.979811+0000', 'last_fullsized': '2024-09-17T05:48:05.979811+0000', 'mapping_epoch': 84, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 84, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:48:05.973792+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:48:05.973792+0000', 'last_clean_scrub_stamp': '2024-09-17T05:48:05.973792+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 0], 'acting': [7, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-17T05:48:11.742 INFO:tasks.ceph.ceph_manager.ceph:PG 13.e is not active+clean 2024-09-17T05:48:11.742 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '13.e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 84, 'state': 'creating+peering', 'last_fresh': '2024-09-17T05:48:05.980418+0000', 'last_change': '2024-09-17T05:48:05.980418+0000', 'last_active': '2024-09-17T05:48:05.973792+0000', 'last_peered': '2024-09-17T05:48:05.973792+0000', 'last_clean': '2024-09-17T05:48:05.973792+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:48:05.980418+0000', 'last_undegraded': '2024-09-17T05:48:05.980418+0000', 'last_fullsized': '2024-09-17T05:48:05.980418+0000', 'mapping_epoch': 84, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 84, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:48:05.973792+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:48:05.973792+0000', 'last_clean_scrub_stamp': '2024-09-17T05:48:05.973792+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 5], 'acting': [7, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-17T05:48:11.742 INFO:tasks.ceph.ceph_manager.ceph:PG 13.d is not active+clean 2024-09-17T05:48:11.742 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '13.d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 84, 'state': 'creating+peering', 'last_fresh': '2024-09-17T05:48:05.987698+0000', 'last_change': '2024-09-17T05:48:05.987698+0000', 'last_active': '2024-09-17T05:48:05.973792+0000', 'last_peered': '2024-09-17T05:48:05.973792+0000', 'last_clean': '2024-09-17T05:48:05.973792+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:48:05.987698+0000', 'last_undegraded': '2024-09-17T05:48:05.987698+0000', 'last_fullsized': '2024-09-17T05:48:05.987698+0000', 'mapping_epoch': 84, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 84, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:48:05.973792+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:48:05.973792+0000', 'last_clean_scrub_stamp': '2024-09-17T05:48:05.973792+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 1], 'acting': [4, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-17T05:48:11.742 INFO:tasks.ceph.ceph_manager.ceph:PG 13.b is not active+clean 2024-09-17T05:48:11.742 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '13.b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 84, 'state': 'creating+peering', 'last_fresh': '2024-09-17T05:48:05.987891+0000', 'last_change': '2024-09-17T05:48:05.987891+0000', 'last_active': '2024-09-17T05:48:05.973792+0000', 'last_peered': '2024-09-17T05:48:05.973792+0000', 'last_clean': '2024-09-17T05:48:05.973792+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:48:05.987891+0000', 'last_undegraded': '2024-09-17T05:48:05.987891+0000', 'last_fullsized': '2024-09-17T05:48:05.987891+0000', 'mapping_epoch': 84, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 84, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:48:05.973792+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:48:05.973792+0000', 'last_clean_scrub_stamp': '2024-09-17T05:48:05.973792+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 3], 'acting': [5, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-17T05:48:11.742 INFO:tasks.ceph.ceph_manager.ceph:PG 13.9 is not active+clean 2024-09-17T05:48:11.742 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '13.9', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 84, 'state': 'creating+peering', 'last_fresh': '2024-09-17T05:48:05.984632+0000', 'last_change': '2024-09-17T05:48:05.984632+0000', 'last_active': '2024-09-17T05:48:05.973792+0000', 'last_peered': '2024-09-17T05:48:05.973792+0000', 'last_clean': '2024-09-17T05:48:05.973792+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:48:05.984632+0000', 'last_undegraded': '2024-09-17T05:48:05.984632+0000', 'last_fullsized': '2024-09-17T05:48:05.984632+0000', 'mapping_epoch': 84, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 84, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:48:05.973792+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:48:05.973792+0000', 'last_clean_scrub_stamp': '2024-09-17T05:48:05.973792+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 0], 'acting': [5, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-17T05:48:11.742 INFO:tasks.ceph.ceph_manager.ceph:PG 13.6 is not active+clean 2024-09-17T05:48:11.742 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '13.6', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 84, 'state': 'creating+peering', 'last_fresh': '2024-09-17T05:48:05.984822+0000', 'last_change': '2024-09-17T05:48:05.984822+0000', 'last_active': '2024-09-17T05:48:05.973792+0000', 'last_peered': '2024-09-17T05:48:05.973792+0000', 'last_clean': '2024-09-17T05:48:05.973792+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:48:05.984822+0000', 'last_undegraded': '2024-09-17T05:48:05.984822+0000', 'last_fullsized': '2024-09-17T05:48:05.984822+0000', 'mapping_epoch': 84, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 84, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:48:05.973792+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:48:05.973792+0000', 'last_clean_scrub_stamp': '2024-09-17T05:48:05.973792+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 5], 'acting': [4, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-17T05:48:11.743 INFO:tasks.ceph.ceph_manager.ceph:PG 13.7 is not active+clean 2024-09-17T05:48:11.743 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '13.7', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 84, 'state': 'creating+peering', 'last_fresh': '2024-09-17T05:48:05.979914+0000', 'last_change': '2024-09-17T05:48:05.979914+0000', 'last_active': '2024-09-17T05:48:05.973792+0000', 'last_peered': '2024-09-17T05:48:05.973792+0000', 'last_clean': '2024-09-17T05:48:05.973792+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:48:05.979914+0000', 'last_undegraded': '2024-09-17T05:48:05.979914+0000', 'last_fullsized': '2024-09-17T05:48:05.979914+0000', 'mapping_epoch': 84, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 84, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:48:05.973792+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:48:05.973792+0000', 'last_clean_scrub_stamp': '2024-09-17T05:48:05.973792+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 6], 'acting': [7, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-17T05:48:11.743 INFO:tasks.ceph.ceph_manager.ceph:PG 13.5 is not active+clean 2024-09-17T05:48:11.743 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '13.5', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 84, 'state': 'creating+peering', 'last_fresh': '2024-09-17T05:48:05.983735+0000', 'last_change': '2024-09-17T05:48:05.983735+0000', 'last_active': '2024-09-17T05:48:05.973792+0000', 'last_peered': '2024-09-17T05:48:05.973792+0000', 'last_clean': '2024-09-17T05:48:05.973792+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:48:05.983735+0000', 'last_undegraded': '2024-09-17T05:48:05.983735+0000', 'last_fullsized': '2024-09-17T05:48:05.983735+0000', 'mapping_epoch': 84, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 84, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:48:05.973792+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:48:05.973792+0000', 'last_clean_scrub_stamp': '2024-09-17T05:48:05.973792+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 0], 'acting': [4, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-17T05:48:11.743 INFO:tasks.ceph.ceph_manager.ceph:PG 13.2 is not active+clean 2024-09-17T05:48:11.743 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '13.2', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 84, 'state': 'creating+peering', 'last_fresh': '2024-09-17T05:48:05.984825+0000', 'last_change': '2024-09-17T05:48:05.984825+0000', 'last_active': '2024-09-17T05:48:05.973792+0000', 'last_peered': '2024-09-17T05:48:05.973792+0000', 'last_clean': '2024-09-17T05:48:05.973792+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:48:05.984825+0000', 'last_undegraded': '2024-09-17T05:48:05.984825+0000', 'last_fullsized': '2024-09-17T05:48:05.984825+0000', 'mapping_epoch': 84, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 84, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:48:05.973792+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:48:05.973792+0000', 'last_clean_scrub_stamp': '2024-09-17T05:48:05.973792+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 3], 'acting': [5, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-17T05:48:11.743 INFO:tasks.ceph.ceph_manager.ceph:PG 13.0 is not active+clean 2024-09-17T05:48:11.743 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '13.0', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 84, 'state': 'creating+peering', 'last_fresh': '2024-09-17T05:48:05.979780+0000', 'last_change': '2024-09-17T05:48:05.979780+0000', 'last_active': '2024-09-17T05:48:05.973792+0000', 'last_peered': '2024-09-17T05:48:05.973792+0000', 'last_clean': '2024-09-17T05:48:05.973792+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:48:05.979780+0000', 'last_undegraded': '2024-09-17T05:48:05.979780+0000', 'last_fullsized': '2024-09-17T05:48:05.979780+0000', 'mapping_epoch': 84, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 84, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:48:05.973792+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:48:05.973792+0000', 'last_clean_scrub_stamp': '2024-09-17T05:48:05.973792+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 1], 'acting': [7, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-17T05:48:11.744 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-09-17T05:48:11.887 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:11.885+0000 7f2e05582640 1 -- 172.21.15.150:0/4127319697 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2e000cd890 msgr2=0x7f2e00167180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:48:11.887 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:11.885+0000 7f2e05582640 1 --2- 172.21.15.150:0/4127319697 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2e000cd890 0x7f2e00167180 secure :-1 s=READY pgs=1019 cs=0 l=1 rev1=1 crypto rx=0x7f2df8005fd0 tx=0x7f2df802a8b0 comp rx=0 tx=0).stop 2024-09-17T05:48:11.887 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:11.885+0000 7f2e05582640 1 -- 172.21.15.150:0/4127319697 shutdown_connections 2024-09-17T05:48:11.887 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:11.885+0000 7f2e05582640 1 --2- 172.21.15.150:0/4127319697 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2e000cd890 0x7f2e00167180 unknown :-1 s=CLOSED pgs=1019 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:48:11.887 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:11.885+0000 7f2e05582640 1 --2- 172.21.15.150:0/4127319697 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2e000b7490 0x7f2e000d0590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:48:11.887 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:11.885+0000 7f2e05582640 1 -- 172.21.15.150:0/4127319697 >> 172.21.15.150:0/4127319697 conn(0x7f2e000cef30 msgr2=0x7f2e000cf340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:48:11.887 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:11.885+0000 7f2e05582640 1 -- 172.21.15.150:0/4127319697 shutdown_connections 2024-09-17T05:48:11.887 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:11.885+0000 7f2e05582640 1 -- 172.21.15.150:0/4127319697 wait complete. 2024-09-17T05:48:11.888 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:11.887+0000 7f2e05582640 1 Processor -- start 2024-09-17T05:48:11.888 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:11.887+0000 7f2e05582640 1 -- start start 2024-09-17T05:48:11.891 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:11.888+0000 7f2e05582640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2e000b7490 0x7f2e001e29a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:48:11.891 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:11.888+0000 7f2e05582640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2e000cd890 0x7f2e0009e820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:48:11.891 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:11.888+0000 7f2e05582640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2e000d0ad0 0x7f2e000b0860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:48:11.891 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:11.888+0000 7f2e05582640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f2e000d15e0 con 0x7f2e000b7490 2024-09-17T05:48:11.892 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:11.888+0000 7f2e05582640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f2e000d1460 con 0x7f2e000cd890 2024-09-17T05:48:11.892 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:11.888+0000 7f2e05582640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f2e000ceb70 con 0x7f2e000d0ad0 2024-09-17T05:48:11.892 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:11.888+0000 7f2dfeffd640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2e000b7490 0x7f2e001e29a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:48:11.892 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:11.888+0000 7f2dfeffd640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2e000b7490 0x7f2e001e29a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:34186/0 (socket says 172.21.15.150:34186) 2024-09-17T05:48:11.892 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:11.888+0000 7f2dfeffd640 1 -- 172.21.15.150:0/256650250 learned_addr learned my addr 172.21.15.150:0/256650250 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:48:11.892 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:11.889+0000 7f2dff7fe640 1 --2- 172.21.15.150:0/256650250 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2e000d0ad0 0x7f2e000b0860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:48:11.892 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:11.889+0000 7f2dfe7fc640 1 --2- 172.21.15.150:0/256650250 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2e000cd890 0x7f2e0009e820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:48:11.892 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:11.889+0000 7f2dfeffd640 1 -- 172.21.15.150:0/256650250 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2e000d0ad0 msgr2=0x7f2e000b0860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:48:11.892 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:11.889+0000 7f2dfeffd640 1 --2- 172.21.15.150:0/256650250 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2e000d0ad0 0x7f2e000b0860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:48:11.892 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:11.889+0000 7f2dfeffd640 1 -- 172.21.15.150:0/256650250 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2e000cd890 msgr2=0x7f2e0009e820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:48:11.892 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:11.889+0000 7f2dfeffd640 1 --2- 172.21.15.150:0/256650250 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2e000cd890 0x7f2e0009e820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:48:11.892 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:11.889+0000 7f2dfeffd640 1 -- 172.21.15.150:0/256650250 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2e001f6e00 con 0x7f2e000b7490 2024-09-17T05:48:11.893 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:11.889+0000 7f2dfe7fc640 1 --2- 172.21.15.150:0/256650250 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2e000cd890 0x7f2e0009e820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:48:11.893 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:11.889+0000 7f2dfeffd640 1 --2- 172.21.15.150:0/256650250 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2e000b7490 0x7f2e001e29a0 secure :-1 s=READY pgs=1020 cs=0 l=1 rev1=1 crypto rx=0x7f2df000d730 tx=0x7f2df000dbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:48:11.893 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:11.889+0000 7f2de77fe640 1 -- 172.21.15.150:0/256650250 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2df0017070 con 0x7f2e000b7490 2024-09-17T05:48:11.893 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:11.889+0000 7f2de77fe640 1 -- 172.21.15.150:0/256650250 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f2df0009a30 con 0x7f2e000b7490 2024-09-17T05:48:11.893 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:11.889+0000 7f2e05582640 1 -- 172.21.15.150:0/256650250 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2e001f70e0 con 0x7f2e000b7490 2024-09-17T05:48:11.893 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:11.889+0000 7f2de77fe640 1 -- 172.21.15.150:0/256650250 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2df0010460 con 0x7f2e000b7490 2024-09-17T05:48:11.893 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:11.889+0000 7f2e05582640 1 -- 172.21.15.150:0/256650250 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2e001f76a0 con 0x7f2e000b7490 2024-09-17T05:48:11.894 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:11.890+0000 7f2e05582640 1 -- 172.21.15.150:0/256650250 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2e000cde60 con 0x7f2e000b7490 2024-09-17T05:48:11.894 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:11.891+0000 7f2de77fe640 1 -- 172.21.15.150:0/256650250 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 25) ==== 103022+0+0 (secure 0 0 0) 0x7f2df001a070 con 0x7f2e000b7490 2024-09-17T05:48:11.894 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:11.891+0000 7f2de77fe640 1 --2- 172.21.15.150:0/256650250 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f2dec079d00 0x7f2dec07c210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:48:11.894 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:11.892+0000 7f2de77fe640 1 -- 172.21.15.150:0/256650250 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 5793+0+0 (secure 0 0 0) 0x7f2df0099c70 con 0x7f2e000b7490 2024-09-17T05:48:11.895 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:11.892+0000 7f2dfe7fc640 1 --2- 172.21.15.150:0/256650250 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f2dec079d00 0x7f2dec07c210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:48:11.895 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:11.892+0000 7f2dfe7fc640 1 --2- 172.21.15.150:0/256650250 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f2dec079d00 0x7f2dec07c210 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f2df4007a50 tx=0x7f2df4009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:48:11.898 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:11.896+0000 7f2de77fe640 1 -- 172.21.15.150:0/256650250 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f2df0063250 con 0x7f2e000b7490 2024-09-17T05:48:12.143 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:12.141+0000 7f2e05582640 1 -- 172.21.15.150:0/256650250 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) -- 0x7f2e001e94c0 con 0x7f2e000b7490 2024-09-17T05:48:12.143 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:12.142+0000 7f2de77fe640 1 -- 172.21.15.150:0/256650250 <== mon.0 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) ==== 72+0+1142 (secure 0 0 0) 0x7f2df0067c80 con 0x7f2e000b7490 2024-09-17T05:48:12.143 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-09-17T05:48:12.144 INFO:teuthology.orchestra.run.smithi150.stdout:{"fsid":"9f2e05e9-d629-47b3-b26b-1360655b7d20","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":399,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":86,"num_osds":8,"num_up_osds":8,"osd_up_since":1726551706,"num_in_osds":8,"osd_in_since":1726551696,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":70},{"state_name":"creating+peering","count":27}],"num_pgs":97,"num_pools":3,"num_objects":18,"data_bytes":591096,"bytes_used":466657280,"bytes_avail":772627456000,"bytes_total":773094113280,"inactive_pgs_ratio":0.27835050225257874,"write_bytes_sec":1709,"read_op_per_sec":0,"write_op_per_sec":6},"fsmap":{"epoch":51,"btime":"2024-09-17T05:48:10:016435+0000","id":6,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":6,"rank":0,"name":"d","status":"up:active","gid":6496}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":14,"modified":"2024-09-17T05:47:54.961326+0000","services":{}},"progress_events":{}} 2024-09-17T05:48:12.146 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:12.144+0000 7f2e05582640 1 -- 172.21.15.150:0/256650250 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f2dec079d00 msgr2=0x7f2dec07c210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:48:12.146 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:12.144+0000 7f2e05582640 1 --2- 172.21.15.150:0/256650250 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f2dec079d00 0x7f2dec07c210 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f2df4007a50 tx=0x7f2df4009040 comp rx=0 tx=0).stop 2024-09-17T05:48:12.146 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:12.144+0000 7f2e05582640 1 -- 172.21.15.150:0/256650250 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2e000b7490 msgr2=0x7f2e001e29a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:48:12.146 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:12.144+0000 7f2e05582640 1 --2- 172.21.15.150:0/256650250 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2e000b7490 0x7f2e001e29a0 secure :-1 s=READY pgs=1020 cs=0 l=1 rev1=1 crypto rx=0x7f2df000d730 tx=0x7f2df000dbf0 comp rx=0 tx=0).stop 2024-09-17T05:48:12.146 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:12.144+0000 7f2e05582640 1 -- 172.21.15.150:0/256650250 shutdown_connections 2024-09-17T05:48:12.146 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:12.144+0000 7f2e05582640 1 --2- 172.21.15.150:0/256650250 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2e000cd890 0x7f2e0009e820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:48:12.146 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:12.144+0000 7f2e05582640 1 --2- 172.21.15.150:0/256650250 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f2dec079d00 0x7f2dec07c210 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:48:12.146 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:12.144+0000 7f2e05582640 1 --2- 172.21.15.150:0/256650250 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2e000d0ad0 0x7f2e000b0860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:48:12.146 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:12.144+0000 7f2e05582640 1 --2- 172.21.15.150:0/256650250 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2e000b7490 0x7f2e001e29a0 unknown :-1 s=CLOSED pgs=1020 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:48:12.146 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:12.144+0000 7f2e05582640 1 -- 172.21.15.150:0/256650250 >> 172.21.15.150:0/256650250 conn(0x7f2e000cef30 msgr2=0x7f2e00072280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:48:12.146 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:12.144+0000 7f2e05582640 1 -- 172.21.15.150:0/256650250 shutdown_connections 2024-09-17T05:48:12.147 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:12.144+0000 7f2e05582640 1 -- 172.21.15.150:0/256650250 wait complete. 2024-09-17T05:48:12.157 INFO:tasks.ceph.ceph_manager.ceph:no progress seen, keeping timeout for now 2024-09-17T05:48:12.158 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-17T05:48:12.272 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:12.269+0000 7f4ffcf3a640 1 -- 172.21.15.150:0/3311246664 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4ff80b4110 msgr2=0x7f4ff806fe70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:48:12.272 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:12.269+0000 7f4ffcf3a640 1 --2- 172.21.15.150:0/3311246664 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4ff80b4110 0x7f4ff806fe70 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f4ff0005fd0 tx=0x7f4ff002a820 comp rx=0 tx=0).stop 2024-09-17T05:48:12.272 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:12.269+0000 7f4ffcf3a640 1 -- 172.21.15.150:0/3311246664 shutdown_connections 2024-09-17T05:48:12.272 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:12.269+0000 7f4ffcf3a640 1 --2- 172.21.15.150:0/3311246664 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4ff80b4110 0x7f4ff806fe70 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:48:12.272 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:12.269+0000 7f4ffcf3a640 1 --2- 172.21.15.150:0/3311246664 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4ff80707b0 0x7f4ff806f930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:48:12.272 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:12.270+0000 7f4ffcf3a640 1 -- 172.21.15.150:0/3311246664 >> 172.21.15.150:0/3311246664 conn(0x7f4ff806d730 msgr2=0x7f4ff80b1e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:48:12.272 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:12.270+0000 7f4ffcf3a640 1 -- 172.21.15.150:0/3311246664 shutdown_connections 2024-09-17T05:48:12.272 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:12.270+0000 7f4ffcf3a640 1 -- 172.21.15.150:0/3311246664 wait complete. 2024-09-17T05:48:12.273 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:12.272+0000 7f4ffcf3a640 1 Processor -- start 2024-09-17T05:48:12.273 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:12.272+0000 7f4ffcf3a640 1 -- start start 2024-09-17T05:48:12.276 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:12.273+0000 7f4ffcf3a640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4ff80707b0 0x7f4ff8099880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:48:12.276 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:12.273+0000 7f4ffcf3a640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4ff80730b0 0x7f4ff80aff60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:48:12.276 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:12.273+0000 7f4ffcf3a640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4ff80b4110 0x7f4ff80b04a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:48:12.276 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:12.273+0000 7f4ffcf3a640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f4ff806f0a0 con 0x7f4ff80b4110 2024-09-17T05:48:12.276 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:12.273+0000 7f4ffcf3a640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f4ff815b240 con 0x7f4ff80707b0 2024-09-17T05:48:12.276 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:12.273+0000 7f4ffcf3a640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f4ff806f220 con 0x7f4ff80730b0 2024-09-17T05:48:12.276 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:12.273+0000 7f4ff6d9d640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4ff80b4110 0x7f4ff80b04a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:48:12.277 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:12.273+0000 7f4ff6d9d640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4ff80b4110 0x7f4ff80b04a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:34198/0 (socket says 172.21.15.150:34198) 2024-09-17T05:48:12.277 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:12.273+0000 7f4ff6d9d640 1 -- 172.21.15.150:0/2526159056 learned_addr learned my addr 172.21.15.150:0/2526159056 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:48:12.277 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:12.273+0000 7f4ff659c640 1 --2- 172.21.15.150:0/2526159056 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4ff80707b0 0x7f4ff8099880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:48:12.277 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:12.273+0000 7f4fedd9b640 1 --2- 172.21.15.150:0/2526159056 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4ff80730b0 0x7f4ff80aff60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:48:12.277 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:12.274+0000 7f4ff6d9d640 1 -- 172.21.15.150:0/2526159056 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4ff80730b0 msgr2=0x7f4ff80aff60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:48:12.277 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:12.274+0000 7f4ff6d9d640 1 --2- 172.21.15.150:0/2526159056 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4ff80730b0 0x7f4ff80aff60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:48:12.277 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:12.274+0000 7f4ff6d9d640 1 -- 172.21.15.150:0/2526159056 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4ff80707b0 msgr2=0x7f4ff8099880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:48:12.277 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:12.274+0000 7f4ff6d9d640 1 --2- 172.21.15.150:0/2526159056 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4ff80707b0 0x7f4ff8099880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:48:12.277 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:12.274+0000 7f4ff6d9d640 1 -- 172.21.15.150:0/2526159056 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4ff8151920 con 0x7f4ff80b4110 2024-09-17T05:48:12.277 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:12.274+0000 7f4ff6d9d640 1 --2- 172.21.15.150:0/2526159056 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4ff80b4110 0x7f4ff80b04a0 secure :-1 s=READY pgs=1021 cs=0 l=1 rev1=1 crypto rx=0x7f4ff0006010 tx=0x7f4ff0032d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:48:12.277 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:12.274+0000 7f4fef7fe640 1 -- 172.21.15.150:0/2526159056 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ff0037040 con 0x7f4ff80b4110 2024-09-17T05:48:12.277 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:12.274+0000 7f4fef7fe640 1 -- 172.21.15.150:0/2526159056 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f4ff0042070 con 0x7f4ff80b4110 2024-09-17T05:48:12.277 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:12.274+0000 7f4ffcf3a640 1 -- 172.21.15.150:0/2526159056 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4ff814e140 con 0x7f4ff80b4110 2024-09-17T05:48:12.278 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:12.274+0000 7f4fef7fe640 1 -- 172.21.15.150:0/2526159056 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ff0003e60 con 0x7f4ff80b4110 2024-09-17T05:48:12.278 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:12.274+0000 7f4ffcf3a640 1 -- 172.21.15.150:0/2526159056 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4ff81599b0 con 0x7f4ff80b4110 2024-09-17T05:48:12.279 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:12.275+0000 7f4ffcf3a640 1 -- 172.21.15.150:0/2526159056 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4ff81597a0 con 0x7f4ff80b4110 2024-09-17T05:48:12.279 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:12.276+0000 7f4fef7fe640 1 -- 172.21.15.150:0/2526159056 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 25) ==== 103022+0+0 (secure 0 0 0) 0x7f4ff0004280 con 0x7f4ff80b4110 2024-09-17T05:48:12.279 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:12.277+0000 7f4fef7fe640 1 --2- 172.21.15.150:0/2526159056 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f4fd8079d00 0x7f4fd807c210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:48:12.280 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:12.277+0000 7f4fef7fe640 1 -- 172.21.15.150:0/2526159056 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 5793+0+0 (secure 0 0 0) 0x7f4ff00bb470 con 0x7f4ff80b4110 2024-09-17T05:48:12.280 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:12.277+0000 7f4ff659c640 1 --2- 172.21.15.150:0/2526159056 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f4fd8079d00 0x7f4fd807c210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:48:12.280 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:12.278+0000 7f4ff659c640 1 --2- 172.21.15.150:0/2526159056 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f4fd8079d00 0x7f4fd807c210 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f4ff80b4630 tx=0x7f4fe8005f90 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:48:12.282 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:12.281+0000 7f4fef7fe640 1 -- 172.21.15.150:0/2526159056 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f4ff00849a0 con 0x7f4ff80b4110 2024-09-17T05:48:12.455 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:12.453+0000 7f4ffcf3a640 1 -- 172.21.15.150:0/2526159056 --> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f4ff806f6a0 con 0x7f4fd8079d00 2024-09-17T05:48:12.459 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:12.458+0000 7f4fef7fe640 1 -- 172.21.15.150:0/2526159056 <== mgr.4108 v2:172.21.15.176:6800/3631216395 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+249856 (secure 0 0 0) 0x7f4ff806f6a0 con 0x7f4fd8079d00 2024-09-17T05:48:12.462 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-09-17T05:48:12.463 INFO:teuthology.orchestra.run.smithi150.stderr:dumped all 2024-09-17T05:48:12.465 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:12.461+0000 7f4ffcf3a640 1 -- 172.21.15.150:0/2526159056 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f4fd8079d00 msgr2=0x7f4fd807c210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:48:12.465 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:12.461+0000 7f4ffcf3a640 1 --2- 172.21.15.150:0/2526159056 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f4fd8079d00 0x7f4fd807c210 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f4ff80b4630 tx=0x7f4fe8005f90 comp rx=0 tx=0).stop 2024-09-17T05:48:12.465 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:12.461+0000 7f4ffcf3a640 1 -- 172.21.15.150:0/2526159056 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4ff80b4110 msgr2=0x7f4ff80b04a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:48:12.465 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:12.461+0000 7f4ffcf3a640 1 --2- 172.21.15.150:0/2526159056 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4ff80b4110 0x7f4ff80b04a0 secure :-1 s=READY pgs=1021 cs=0 l=1 rev1=1 crypto rx=0x7f4ff0006010 tx=0x7f4ff0032d10 comp rx=0 tx=0).stop 2024-09-17T05:48:12.465 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:12.461+0000 7f4ffcf3a640 1 -- 172.21.15.150:0/2526159056 shutdown_connections 2024-09-17T05:48:12.465 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:12.461+0000 7f4ffcf3a640 1 --2- 172.21.15.150:0/2526159056 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f4fd8079d00 0x7f4fd807c210 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:48:12.465 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:12.461+0000 7f4ffcf3a640 1 --2- 172.21.15.150:0/2526159056 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4ff80b4110 0x7f4ff80b04a0 unknown :-1 s=CLOSED pgs=1021 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:48:12.465 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:12.461+0000 7f4ffcf3a640 1 --2- 172.21.15.150:0/2526159056 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4ff80730b0 0x7f4ff80aff60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:48:12.465 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:12.461+0000 7f4ffcf3a640 1 --2- 172.21.15.150:0/2526159056 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4ff80707b0 0x7f4ff8099880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:48:12.465 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:12.461+0000 7f4ffcf3a640 1 -- 172.21.15.150:0/2526159056 >> 172.21.15.150:0/2526159056 conn(0x7f4ff806d730 msgr2=0x7f4ff80af1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:48:12.466 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:12.461+0000 7f4ffcf3a640 1 -- 172.21.15.150:0/2526159056 shutdown_connections 2024-09-17T05:48:12.466 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:12.461+0000 7f4ffcf3a640 1 -- 172.21.15.150:0/2526159056 wait complete. 2024-09-17T05:48:12.474 INFO:teuthology.orchestra.run.smithi150.stdout:{"pg_ready":true,"pg_map":{"version":273,"stamp":"2024-09-17T05:48:10.964995+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":591096,"num_objects":18,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":138,"num_write_kb":1638,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":12,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":100,"ondisk_log_size":100,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":65,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":455720,"kb_used_data":9200,"kb_used_omap":12,"kb_used_meta":446323,"kb_avail":754519000,"statfs":{"total":773094113280,"available":772627456000,"internally_reserved":0,"allocated":9420800,"data_stored":4676910,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":457035312},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":16,"apply_latency_ms":16,"commit_latency_ns":16000000,"apply_latency_ns":16000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":728,"num_objects":16,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":37,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":12,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.990092"},"pg_stats":[{"pgid":"13.3f","version":"0'0","reported_seq":10,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T05:48:07.021662+0000","last_change":"2024-09-17T05:48:07.019629+0000","last_active":"2024-09-17T05:48:07.021662+0000","last_peered":"2024-09-17T05:48:07.021662+0000","last_clean":"2024-09-17T05:48:07.021662+0000","last_became_active":"2024-09-17T05:48:07.019293+0000","last_became_peered":"2024-09-17T05:48:07.019293+0000","last_unstale":"2024-09-17T05:48:07.021662+0000","last_undegraded":"2024-09-17T05:48:07.021662+0000","last_fullsized":"2024-09-17T05:48:07.021662+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:48:05.973792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:48:05.973792+0000","last_clean_scrub_stamp":"2024-09-17T05:48:05.973792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:25:55.495958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.3e","version":"0'0","reported_seq":10,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T05:48:07.009336+0000","last_change":"2024-09-17T05:48:07.008371+0000","last_active":"2024-09-17T05:48:07.009336+0000","last_peered":"2024-09-17T05:48:07.009336+0000","last_clean":"2024-09-17T05:48:07.009336+0000","last_became_active":"2024-09-17T05:48:07.008069+0000","last_became_peered":"2024-09-17T05:48:07.008069+0000","last_unstale":"2024-09-17T05:48:07.009336+0000","last_undegraded":"2024-09-17T05:48:07.009336+0000","last_fullsized":"2024-09-17T05:48:07.009336+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:48:05.973792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:48:05.973792+0000","last_clean_scrub_stamp":"2024-09-17T05:48:05.973792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:17:03.542296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.3d","version":"0'0","reported_seq":1,"reported_epoch":84,"state":"creating+peering","last_fresh":"2024-09-17T05:48:05.981187+0000","last_change":"2024-09-17T05:48:05.981187+0000","last_active":"2024-09-17T05:48:05.973792+0000","last_peered":"2024-09-17T05:48:05.973792+0000","last_clean":"2024-09-17T05:48:05.973792+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:48:05.981187+0000","last_undegraded":"2024-09-17T05:48:05.981187+0000","last_fullsized":"2024-09-17T05:48:05.981187+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:48:05.973792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:48:05.973792+0000","last_clean_scrub_stamp":"2024-09-17T05:48:05.973792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.3c","version":"0'0","reported_seq":10,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T05:48:06.998187+0000","last_change":"2024-09-17T05:48:06.997015+0000","last_active":"2024-09-17T05:48:06.998187+0000","last_peered":"2024-09-17T05:48:06.998187+0000","last_clean":"2024-09-17T05:48:06.998187+0000","last_became_active":"2024-09-17T05:48:06.996664+0000","last_became_peered":"2024-09-17T05:48:06.996664+0000","last_unstale":"2024-09-17T05:48:06.998187+0000","last_undegraded":"2024-09-17T05:48:06.998187+0000","last_fullsized":"2024-09-17T05:48:06.998187+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:48:05.973792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:48:05.973792+0000","last_clean_scrub_stamp":"2024-09-17T05:48:05.973792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:29:24.565960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.3b","version":"0'0","reported_seq":1,"reported_epoch":84,"state":"creating+peering","last_fresh":"2024-09-17T05:48:05.990716+0000","last_change":"2024-09-17T05:48:05.990716+0000","last_active":"2024-09-17T05:48:05.973792+0000","last_peered":"2024-09-17T05:48:05.973792+0000","last_clean":"2024-09-17T05:48:05.973792+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:48:05.990716+0000","last_undegraded":"2024-09-17T05:48:05.990716+0000","last_fullsized":"2024-09-17T05:48:05.990716+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:48:05.973792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:48:05.973792+0000","last_clean_scrub_stamp":"2024-09-17T05:48:05.973792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.3a","version":"0'0","reported_seq":1,"reported_epoch":84,"state":"creating+peering","last_fresh":"2024-09-17T05:48:05.986085+0000","last_change":"2024-09-17T05:48:05.986085+0000","last_active":"2024-09-17T05:48:05.973792+0000","last_peered":"2024-09-17T05:48:05.973792+0000","last_clean":"2024-09-17T05:48:05.973792+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:48:05.986085+0000","last_undegraded":"2024-09-17T05:48:05.986085+0000","last_fullsized":"2024-09-17T05:48:05.986085+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:48:05.973792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:48:05.973792+0000","last_clean_scrub_stamp":"2024-09-17T05:48:05.973792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.39","version":"0'0","reported_seq":10,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T05:48:07.007609+0000","last_change":"2024-09-17T05:48:07.004879+0000","last_active":"2024-09-17T05:48:07.007609+0000","last_peered":"2024-09-17T05:48:07.007609+0000","last_clean":"2024-09-17T05:48:07.007609+0000","last_became_active":"2024-09-17T05:48:07.004432+0000","last_became_peered":"2024-09-17T05:48:07.004432+0000","last_unstale":"2024-09-17T05:48:07.007609+0000","last_undegraded":"2024-09-17T05:48:07.007609+0000","last_fullsized":"2024-09-17T05:48:07.007609+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:48:05.973792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:48:05.973792+0000","last_clean_scrub_stamp":"2024-09-17T05:48:05.973792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:41:11.072932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.38","version":"0'0","reported_seq":1,"reported_epoch":84,"state":"creating+peering","last_fresh":"2024-09-17T05:48:05.984329+0000","last_change":"2024-09-17T05:48:05.984329+0000","last_active":"2024-09-17T05:48:05.973792+0000","last_peered":"2024-09-17T05:48:05.973792+0000","last_clean":"2024-09-17T05:48:05.973792+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:48:05.984329+0000","last_undegraded":"2024-09-17T05:48:05.984329+0000","last_fullsized":"2024-09-17T05:48:05.984329+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:48:05.973792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:48:05.973792+0000","last_clean_scrub_stamp":"2024-09-17T05:48:05.973792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.37","version":"0'0","reported_seq":1,"reported_epoch":84,"state":"creating+peering","last_fresh":"2024-09-17T05:48:05.986183+0000","last_change":"2024-09-17T05:48:05.986183+0000","last_active":"2024-09-17T05:48:05.973792+0000","last_peered":"2024-09-17T05:48:05.973792+0000","last_clean":"2024-09-17T05:48:05.973792+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:48:05.986183+0000","last_undegraded":"2024-09-17T05:48:05.986183+0000","last_fullsized":"2024-09-17T05:48:05.986183+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:48:05.973792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:48:05.973792+0000","last_clean_scrub_stamp":"2024-09-17T05:48:05.973792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.36","version":"0'0","reported_seq":10,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T05:48:07.008314+0000","last_change":"2024-09-17T05:48:07.006474+0000","last_active":"2024-09-17T05:48:07.008314+0000","last_peered":"2024-09-17T05:48:07.008314+0000","last_clean":"2024-09-17T05:48:07.008314+0000","last_became_active":"2024-09-17T05:48:07.006080+0000","last_became_peered":"2024-09-17T05:48:07.006080+0000","last_unstale":"2024-09-17T05:48:07.008314+0000","last_undegraded":"2024-09-17T05:48:07.008314+0000","last_fullsized":"2024-09-17T05:48:07.008314+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:48:05.973792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:48:05.973792+0000","last_clean_scrub_stamp":"2024-09-17T05:48:05.973792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:11:43.970133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.35","version":"0'0","reported_seq":10,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T05:48:07.009233+0000","last_change":"2024-09-17T05:48:07.007493+0000","last_active":"2024-09-17T05:48:07.009233+0000","last_peered":"2024-09-17T05:48:07.009233+0000","last_clean":"2024-09-17T05:48:07.009233+0000","last_became_active":"2024-09-17T05:48:07.007110+0000","last_became_peered":"2024-09-17T05:48:07.007110+0000","last_unstale":"2024-09-17T05:48:07.009233+0000","last_undegraded":"2024-09-17T05:48:07.009233+0000","last_fullsized":"2024-09-17T05:48:07.009233+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:48:05.973792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:48:05.973792+0000","last_clean_scrub_stamp":"2024-09-17T05:48:05.973792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:02:09.211126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.34","version":"0'0","reported_seq":10,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T05:48:07.016908+0000","last_change":"2024-09-17T05:48:07.010311+0000","last_active":"2024-09-17T05:48:07.016908+0000","last_peered":"2024-09-17T05:48:07.016908+0000","last_clean":"2024-09-17T05:48:07.016908+0000","last_became_active":"2024-09-17T05:48:07.008909+0000","last_became_peered":"2024-09-17T05:48:07.008909+0000","last_unstale":"2024-09-17T05:48:07.016908+0000","last_undegraded":"2024-09-17T05:48:07.016908+0000","last_fullsized":"2024-09-17T05:48:07.016908+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:48:05.973792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:48:05.973792+0000","last_clean_scrub_stamp":"2024-09-17T05:48:05.973792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:45:16.917183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.33","version":"0'0","reported_seq":1,"reported_epoch":84,"state":"creating+peering","last_fresh":"2024-09-17T05:48:05.980666+0000","last_change":"2024-09-17T05:48:05.980666+0000","last_active":"2024-09-17T05:48:05.973792+0000","last_peered":"2024-09-17T05:48:05.973792+0000","last_clean":"2024-09-17T05:48:05.973792+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:48:05.980666+0000","last_undegraded":"2024-09-17T05:48:05.980666+0000","last_fullsized":"2024-09-17T05:48:05.980666+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:48:05.973792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:48:05.973792+0000","last_clean_scrub_stamp":"2024-09-17T05:48:05.973792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.32","version":"0'0","reported_seq":10,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T05:48:07.004126+0000","last_change":"2024-09-17T05:48:06.999966+0000","last_active":"2024-09-17T05:48:07.004126+0000","last_peered":"2024-09-17T05:48:07.004126+0000","last_clean":"2024-09-17T05:48:07.004126+0000","last_became_active":"2024-09-17T05:48:06.999522+0000","last_became_peered":"2024-09-17T05:48:06.999522+0000","last_unstale":"2024-09-17T05:48:07.004126+0000","last_undegraded":"2024-09-17T05:48:07.004126+0000","last_fullsized":"2024-09-17T05:48:07.004126+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:48:05.973792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:48:05.973792+0000","last_clean_scrub_stamp":"2024-09-17T05:48:05.973792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:56:39.787601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.31","version":"0'0","reported_seq":10,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T05:48:07.008515+0000","last_change":"2024-09-17T05:48:07.006783+0000","last_active":"2024-09-17T05:48:07.008515+0000","last_peered":"2024-09-17T05:48:07.008515+0000","last_clean":"2024-09-17T05:48:07.008515+0000","last_became_active":"2024-09-17T05:48:07.006179+0000","last_became_peered":"2024-09-17T05:48:07.006179+0000","last_unstale":"2024-09-17T05:48:07.008515+0000","last_undegraded":"2024-09-17T05:48:07.008515+0000","last_fullsized":"2024-09-17T05:48:07.008515+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:48:05.973792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:48:05.973792+0000","last_clean_scrub_stamp":"2024-09-17T05:48:05.973792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:25:14.968274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.30","version":"0'0","reported_seq":1,"reported_epoch":84,"state":"creating+peering","last_fresh":"2024-09-17T05:48:05.986337+0000","last_change":"2024-09-17T05:48:05.986337+0000","last_active":"2024-09-17T05:48:05.973792+0000","last_peered":"2024-09-17T05:48:05.973792+0000","last_clean":"2024-09-17T05:48:05.973792+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:48:05.986337+0000","last_undegraded":"2024-09-17T05:48:05.986337+0000","last_fullsized":"2024-09-17T05:48:05.986337+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:48:05.973792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:48:05.973792+0000","last_clean_scrub_stamp":"2024-09-17T05:48:05.973792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.2f","version":"0'0","reported_seq":1,"reported_epoch":84,"state":"creating+peering","last_fresh":"2024-09-17T05:48:05.983346+0000","last_change":"2024-09-17T05:48:05.983346+0000","last_active":"2024-09-17T05:48:05.973792+0000","last_peered":"2024-09-17T05:48:05.973792+0000","last_clean":"2024-09-17T05:48:05.973792+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:48:05.983346+0000","last_undegraded":"2024-09-17T05:48:05.983346+0000","last_fullsized":"2024-09-17T05:48:05.983346+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:48:05.973792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:48:05.973792+0000","last_clean_scrub_stamp":"2024-09-17T05:48:05.973792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.2e","version":"0'0","reported_seq":10,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T05:48:07.013532+0000","last_change":"2024-09-17T05:48:07.012645+0000","last_active":"2024-09-17T05:48:07.013532+0000","last_peered":"2024-09-17T05:48:07.013532+0000","last_clean":"2024-09-17T05:48:07.013532+0000","last_became_active":"2024-09-17T05:48:07.012337+0000","last_became_peered":"2024-09-17T05:48:07.012337+0000","last_unstale":"2024-09-17T05:48:07.013532+0000","last_undegraded":"2024-09-17T05:48:07.013532+0000","last_fullsized":"2024-09-17T05:48:07.013532+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:48:05.973792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:48:05.973792+0000","last_clean_scrub_stamp":"2024-09-17T05:48:05.973792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:04:39.379785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2d","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-17T05:48:08.017801+0000","last_change":"2024-09-17T05:48:07.003509+0000","last_active":"2024-09-17T05:48:08.017801+0000","last_peered":"2024-09-17T05:48:08.017801+0000","last_clean":"2024-09-17T05:48:08.017801+0000","last_became_active":"2024-09-17T05:48:07.003226+0000","last_became_peered":"2024-09-17T05:48:07.003226+0000","last_unstale":"2024-09-17T05:48:08.017801+0000","last_undegraded":"2024-09-17T05:48:08.017801+0000","last_fullsized":"2024-09-17T05:48:08.017801+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:48:05.973792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:48:05.973792+0000","last_clean_scrub_stamp":"2024-09-17T05:48:05.973792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:30:08.358108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.2c","version":"0'0","reported_seq":10,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T05:48:07.011887+0000","last_change":"2024-09-17T05:48:07.010456+0000","last_active":"2024-09-17T05:48:07.011887+0000","last_peered":"2024-09-17T05:48:07.011887+0000","last_clean":"2024-09-17T05:48:07.011887+0000","last_became_active":"2024-09-17T05:48:07.010136+0000","last_became_peered":"2024-09-17T05:48:07.010136+0000","last_unstale":"2024-09-17T05:48:07.011887+0000","last_undegraded":"2024-09-17T05:48:07.011887+0000","last_fullsized":"2024-09-17T05:48:07.011887+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:48:05.973792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:48:05.973792+0000","last_clean_scrub_stamp":"2024-09-17T05:48:05.973792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:02:04.762505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2b","version":"0'0","reported_seq":10,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T05:48:07.013497+0000","last_change":"2024-09-17T05:48:07.011524+0000","last_active":"2024-09-17T05:48:07.013497+0000","last_peered":"2024-09-17T05:48:07.013497+0000","last_clean":"2024-09-17T05:48:07.013497+0000","last_became_active":"2024-09-17T05:48:07.011186+0000","last_became_peered":"2024-09-17T05:48:07.011186+0000","last_unstale":"2024-09-17T05:48:07.013497+0000","last_undegraded":"2024-09-17T05:48:07.013497+0000","last_fullsized":"2024-09-17T05:48:07.013497+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:48:05.973792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:48:05.973792+0000","last_clean_scrub_stamp":"2024-09-17T05:48:05.973792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:06:26.531883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2a","version":"0'0","reported_seq":10,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T05:48:07.012966+0000","last_change":"2024-09-17T05:48:07.011513+0000","last_active":"2024-09-17T05:48:07.012966+0000","last_peered":"2024-09-17T05:48:07.012966+0000","last_clean":"2024-09-17T05:48:07.012966+0000","last_became_active":"2024-09-17T05:48:07.011207+0000","last_became_peered":"2024-09-17T05:48:07.011207+0000","last_unstale":"2024-09-17T05:48:07.012966+0000","last_undegraded":"2024-09-17T05:48:07.012966+0000","last_fullsized":"2024-09-17T05:48:07.012966+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:48:05.973792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:48:05.973792+0000","last_clean_scrub_stamp":"2024-09-17T05:48:05.973792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:25:04.204546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.29","version":"0'0","reported_seq":10,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T05:48:07.018768+0000","last_change":"2024-09-17T05:48:07.016145+0000","last_active":"2024-09-17T05:48:07.018768+0000","last_peered":"2024-09-17T05:48:07.018768+0000","last_clean":"2024-09-17T05:48:07.018768+0000","last_became_active":"2024-09-17T05:48:07.015802+0000","last_became_peered":"2024-09-17T05:48:07.015802+0000","last_unstale":"2024-09-17T05:48:07.018768+0000","last_undegraded":"2024-09-17T05:48:07.018768+0000","last_fullsized":"2024-09-17T05:48:07.018768+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:48:05.973792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:48:05.973792+0000","last_clean_scrub_stamp":"2024-09-17T05:48:05.973792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:38:27.328456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.28","version":"0'0","reported_seq":10,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T05:48:07.013189+0000","last_change":"2024-09-17T05:48:07.010500+0000","last_active":"2024-09-17T05:48:07.013189+0000","last_peered":"2024-09-17T05:48:07.013189+0000","last_clean":"2024-09-17T05:48:07.013189+0000","last_became_active":"2024-09-17T05:48:07.010182+0000","last_became_peered":"2024-09-17T05:48:07.010182+0000","last_unstale":"2024-09-17T05:48:07.013189+0000","last_undegraded":"2024-09-17T05:48:07.013189+0000","last_fullsized":"2024-09-17T05:48:07.013189+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:48:05.973792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:48:05.973792+0000","last_clean_scrub_stamp":"2024-09-17T05:48:05.973792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:43:27.386419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.27","version":"0'0","reported_seq":10,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T05:48:07.007625+0000","last_change":"2024-09-17T05:48:07.004954+0000","last_active":"2024-09-17T05:48:07.007625+0000","last_peered":"2024-09-17T05:48:07.007625+0000","last_clean":"2024-09-17T05:48:07.007625+0000","last_became_active":"2024-09-17T05:48:07.004656+0000","last_became_peered":"2024-09-17T05:48:07.004656+0000","last_unstale":"2024-09-17T05:48:07.007625+0000","last_undegraded":"2024-09-17T05:48:07.007625+0000","last_fullsized":"2024-09-17T05:48:07.007625+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:48:05.973792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:48:05.973792+0000","last_clean_scrub_stamp":"2024-09-17T05:48:05.973792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:07:51.657806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.26","version":"0'0","reported_seq":1,"reported_epoch":84,"state":"creating+peering","last_fresh":"2024-09-17T05:48:05.981443+0000","last_change":"2024-09-17T05:48:05.981443+0000","last_active":"2024-09-17T05:48:05.973792+0000","last_peered":"2024-09-17T05:48:05.973792+0000","last_clean":"2024-09-17T05:48:05.973792+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:48:05.981443+0000","last_undegraded":"2024-09-17T05:48:05.981443+0000","last_fullsized":"2024-09-17T05:48:05.981443+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:48:05.973792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:48:05.973792+0000","last_clean_scrub_stamp":"2024-09-17T05:48:05.973792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.25","version":"0'0","reported_seq":1,"reported_epoch":84,"state":"creating+peering","last_fresh":"2024-09-17T05:48:05.988800+0000","last_change":"2024-09-17T05:48:05.988800+0000","last_active":"2024-09-17T05:48:05.973792+0000","last_peered":"2024-09-17T05:48:05.973792+0000","last_clean":"2024-09-17T05:48:05.973792+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:48:05.988800+0000","last_undegraded":"2024-09-17T05:48:05.988800+0000","last_fullsized":"2024-09-17T05:48:05.988800+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:48:05.973792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:48:05.973792+0000","last_clean_scrub_stamp":"2024-09-17T05:48:05.973792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.24","version":"0'0","reported_seq":10,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T05:48:07.021931+0000","last_change":"2024-09-17T05:48:07.021372+0000","last_active":"2024-09-17T05:48:07.021931+0000","last_peered":"2024-09-17T05:48:07.021931+0000","last_clean":"2024-09-17T05:48:07.021931+0000","last_became_active":"2024-09-17T05:48:07.019410+0000","last_became_peered":"2024-09-17T05:48:07.019410+0000","last_unstale":"2024-09-17T05:48:07.021931+0000","last_undegraded":"2024-09-17T05:48:07.021931+0000","last_fullsized":"2024-09-17T05:48:07.021931+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:48:05.973792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:48:05.973792+0000","last_clean_scrub_stamp":"2024-09-17T05:48:05.973792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:16:14.965629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.23","version":"0'0","reported_seq":10,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T05:48:07.006158+0000","last_change":"2024-09-17T05:48:07.002555+0000","last_active":"2024-09-17T05:48:07.006158+0000","last_peered":"2024-09-17T05:48:07.006158+0000","last_clean":"2024-09-17T05:48:07.006158+0000","last_became_active":"2024-09-17T05:48:07.002263+0000","last_became_peered":"2024-09-17T05:48:07.002263+0000","last_unstale":"2024-09-17T05:48:07.006158+0000","last_undegraded":"2024-09-17T05:48:07.006158+0000","last_fullsized":"2024-09-17T05:48:07.006158+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:48:05.973792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:48:05.973792+0000","last_clean_scrub_stamp":"2024-09-17T05:48:05.973792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:08:12.460618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.22","version":"0'0","reported_seq":10,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T05:48:07.008627+0000","last_change":"2024-09-17T05:48:07.003556+0000","last_active":"2024-09-17T05:48:07.008627+0000","last_peered":"2024-09-17T05:48:07.008627+0000","last_clean":"2024-09-17T05:48:07.008627+0000","last_became_active":"2024-09-17T05:48:07.003232+0000","last_became_peered":"2024-09-17T05:48:07.003232+0000","last_unstale":"2024-09-17T05:48:07.008627+0000","last_undegraded":"2024-09-17T05:48:07.008627+0000","last_fullsized":"2024-09-17T05:48:07.008627+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:48:05.973792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:48:05.973792+0000","last_clean_scrub_stamp":"2024-09-17T05:48:05.973792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:55:03.368792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.21","version":"0'0","reported_seq":1,"reported_epoch":84,"state":"creating+peering","last_fresh":"2024-09-17T05:48:05.982834+0000","last_change":"2024-09-17T05:48:05.982834+0000","last_active":"2024-09-17T05:48:05.973792+0000","last_peered":"2024-09-17T05:48:05.973792+0000","last_clean":"2024-09-17T05:48:05.973792+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:48:05.982834+0000","last_undegraded":"2024-09-17T05:48:05.982834+0000","last_fullsized":"2024-09-17T05:48:05.982834+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:48:05.973792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:48:05.973792+0000","last_clean_scrub_stamp":"2024-09-17T05:48:05.973792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.20","version":"0'0","reported_seq":10,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T05:48:07.015971+0000","last_change":"2024-09-17T05:48:07.009478+0000","last_active":"2024-09-17T05:48:07.015971+0000","last_peered":"2024-09-17T05:48:07.015971+0000","last_clean":"2024-09-17T05:48:07.015971+0000","last_became_active":"2024-09-17T05:48:07.009198+0000","last_became_peered":"2024-09-17T05:48:07.009198+0000","last_unstale":"2024-09-17T05:48:07.015971+0000","last_undegraded":"2024-09-17T05:48:07.015971+0000","last_fullsized":"2024-09-17T05:48:07.015971+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:48:05.973792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:48:05.973792+0000","last_clean_scrub_stamp":"2024-09-17T05:48:05.973792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:54:11.908409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1e","version":"0'0","reported_seq":1,"reported_epoch":84,"state":"creating+peering","last_fresh":"2024-09-17T05:48:05.989512+0000","last_change":"2024-09-17T05:48:05.989512+0000","last_active":"2024-09-17T05:48:05.973792+0000","last_peered":"2024-09-17T05:48:05.973792+0000","last_clean":"2024-09-17T05:48:05.973792+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:48:05.989512+0000","last_undegraded":"2024-09-17T05:48:05.989512+0000","last_fullsized":"2024-09-17T05:48:05.989512+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:48:05.973792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:48:05.973792+0000","last_clean_scrub_stamp":"2024-09-17T05:48:05.973792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1f","version":"85'4","reported_seq":17,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T05:48:07.027168+0000","last_change":"2024-09-17T05:48:05.997338+0000","last_active":"2024-09-17T05:48:07.027168+0000","last_peered":"2024-09-17T05:48:07.027168+0000","last_clean":"2024-09-17T05:48:07.027168+0000","last_became_active":"2024-09-17T05:48:05.996975+0000","last_became_peered":"2024-09-17T05:48:05.996975+0000","last_unstale":"2024-09-17T05:48:07.027168+0000","last_undegraded":"2024-09-17T05:48:07.027168+0000","last_fullsized":"2024-09-17T05:48:07.027168+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:48:04.965082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:48:04.965082+0000","last_clean_scrub_stamp":"2024-09-17T05:48:04.965082+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:18:51.809325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1f","version":"0'0","reported_seq":10,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T05:48:07.017293+0000","last_change":"2024-09-17T05:48:07.013038+0000","last_active":"2024-09-17T05:48:07.017293+0000","last_peered":"2024-09-17T05:48:07.017293+0000","last_clean":"2024-09-17T05:48:07.017293+0000","last_became_active":"2024-09-17T05:48:07.012730+0000","last_became_peered":"2024-09-17T05:48:07.012730+0000","last_unstale":"2024-09-17T05:48:07.017293+0000","last_undegraded":"2024-09-17T05:48:07.017293+0000","last_fullsized":"2024-09-17T05:48:07.017293+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:48:05.973792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:48:05.973792+0000","last_clean_scrub_stamp":"2024-09-17T05:48:05.973792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:25:22.303460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.1e","version":"0'0","reported_seq":10,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-17T05:48:05.997003+0000","last_change":"2024-09-17T05:48:05.995823+0000","last_active":"2024-09-17T05:48:05.997003+0000","last_peered":"2024-09-17T05:48:05.997003+0000","last_clean":"2024-09-17T05:48:05.997003+0000","last_became_active":"2024-09-17T05:48:05.995488+0000","last_became_peered":"2024-09-17T05:48:05.995488+0000","last_unstale":"2024-09-17T05:48:05.997003+0000","last_undegraded":"2024-09-17T05:48:05.997003+0000","last_fullsized":"2024-09-17T05:48:05.997003+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:48:04.965082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:48:04.965082+0000","last_clean_scrub_stamp":"2024-09-17T05:48:04.965082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:09:48.701468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.1c","version":"0'0","reported_seq":10,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T05:48:07.016959+0000","last_change":"2024-09-17T05:48:07.011380+0000","last_active":"2024-09-17T05:48:07.016959+0000","last_peered":"2024-09-17T05:48:07.016959+0000","last_clean":"2024-09-17T05:48:07.016959+0000","last_became_active":"2024-09-17T05:48:07.011078+0000","last_became_peered":"2024-09-17T05:48:07.011078+0000","last_unstale":"2024-09-17T05:48:07.016959+0000","last_undegraded":"2024-09-17T05:48:07.016959+0000","last_fullsized":"2024-09-17T05:48:07.016959+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:48:05.973792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:48:05.973792+0000","last_clean_scrub_stamp":"2024-09-17T05:48:05.973792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:45:26.386010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.1d","version":"85'2","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-17T05:48:08.017837+0000","last_change":"2024-09-17T05:48:05.995146+0000","last_active":"2024-09-17T05:48:08.017837+0000","last_peered":"2024-09-17T05:48:08.017837+0000","last_clean":"2024-09-17T05:48:08.017837+0000","last_became_active":"2024-09-17T05:48:05.994843+0000","last_became_peered":"2024-09-17T05:48:05.994843+0000","last_unstale":"2024-09-17T05:48:08.017837+0000","last_undegraded":"2024-09-17T05:48:08.017837+0000","last_fullsized":"2024-09-17T05:48:08.017837+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:48:04.965082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:48:04.965082+0000","last_clean_scrub_stamp":"2024-09-17T05:48:04.965082+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:08:12.896308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1d","version":"0'0","reported_seq":1,"reported_epoch":84,"state":"creating+peering","last_fresh":"2024-09-17T05:48:05.980180+0000","last_change":"2024-09-17T05:48:05.980180+0000","last_active":"2024-09-17T05:48:05.973792+0000","last_peered":"2024-09-17T05:48:05.973792+0000","last_clean":"2024-09-17T05:48:05.973792+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:48:05.980180+0000","last_undegraded":"2024-09-17T05:48:05.980180+0000","last_fullsized":"2024-09-17T05:48:05.980180+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:48:05.973792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:48:05.973792+0000","last_clean_scrub_stamp":"2024-09-17T05:48:05.973792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1c","version":"85'2","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-17T05:48:08.017546+0000","last_change":"2024-09-17T05:48:05.996138+0000","last_active":"2024-09-17T05:48:08.017546+0000","last_peered":"2024-09-17T05:48:08.017546+0000","last_clean":"2024-09-17T05:48:08.017546+0000","last_became_active":"2024-09-17T05:48:05.995742+0000","last_became_peered":"2024-09-17T05:48:05.995742+0000","last_unstale":"2024-09-17T05:48:08.017546+0000","last_undegraded":"2024-09-17T05:48:08.017546+0000","last_fullsized":"2024-09-17T05:48:08.017546+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:48:04.965082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:48:04.965082+0000","last_clean_scrub_stamp":"2024-09-17T05:48:04.965082+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:07:07.086219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1a","version":"0'0","reported_seq":10,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T05:48:07.008594+0000","last_change":"2024-09-17T05:48:07.003430+0000","last_active":"2024-09-17T05:48:07.008594+0000","last_peered":"2024-09-17T05:48:07.008594+0000","last_clean":"2024-09-17T05:48:07.008594+0000","last_became_active":"2024-09-17T05:48:07.002894+0000","last_became_peered":"2024-09-17T05:48:07.002894+0000","last_unstale":"2024-09-17T05:48:07.008594+0000","last_undegraded":"2024-09-17T05:48:07.008594+0000","last_fullsized":"2024-09-17T05:48:07.008594+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:48:05.973792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:48:05.973792+0000","last_clean_scrub_stamp":"2024-09-17T05:48:05.973792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:41:40.435956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.1b","version":"0'0","reported_seq":10,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-17T05:48:06.000918+0000","last_change":"2024-09-17T05:48:06.000106+0000","last_active":"2024-09-17T05:48:06.000918+0000","last_peered":"2024-09-17T05:48:06.000918+0000","last_clean":"2024-09-17T05:48:06.000918+0000","last_became_active":"2024-09-17T05:48:05.999798+0000","last_became_peered":"2024-09-17T05:48:05.999798+0000","last_unstale":"2024-09-17T05:48:06.000918+0000","last_undegraded":"2024-09-17T05:48:06.000918+0000","last_fullsized":"2024-09-17T05:48:06.000918+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:48:04.965082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:48:04.965082+0000","last_clean_scrub_stamp":"2024-09-17T05:48:04.965082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:16:50.545089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.1b","version":"0'0","reported_seq":1,"reported_epoch":84,"state":"creating+peering","last_fresh":"2024-09-17T05:48:05.989943+0000","last_change":"2024-09-17T05:48:05.989943+0000","last_active":"2024-09-17T05:48:05.973792+0000","last_peered":"2024-09-17T05:48:05.973792+0000","last_clean":"2024-09-17T05:48:05.973792+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:48:05.989943+0000","last_undegraded":"2024-09-17T05:48:05.989943+0000","last_fullsized":"2024-09-17T05:48:05.989943+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:48:05.973792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:48:05.973792+0000","last_clean_scrub_stamp":"2024-09-17T05:48:05.973792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1a","version":"0'0","reported_seq":10,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-17T05:48:05.998331+0000","last_change":"2024-09-17T05:48:05.996177+0000","last_active":"2024-09-17T05:48:05.998331+0000","last_peered":"2024-09-17T05:48:05.998331+0000","last_clean":"2024-09-17T05:48:05.998331+0000","last_became_active":"2024-09-17T05:48:05.995803+0000","last_became_peered":"2024-09-17T05:48:05.995803+0000","last_unstale":"2024-09-17T05:48:05.998331+0000","last_undegraded":"2024-09-17T05:48:05.998331+0000","last_fullsized":"2024-09-17T05:48:05.998331+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:48:04.965082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:48:04.965082+0000","last_clean_scrub_stamp":"2024-09-17T05:48:04.965082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:29:46.170441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.18","version":"0'0","reported_seq":1,"reported_epoch":84,"state":"creating+peering","last_fresh":"2024-09-17T05:48:05.980690+0000","last_change":"2024-09-17T05:48:05.980690+0000","last_active":"2024-09-17T05:48:05.973792+0000","last_peered":"2024-09-17T05:48:05.973792+0000","last_clean":"2024-09-17T05:48:05.973792+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:48:05.980690+0000","last_undegraded":"2024-09-17T05:48:05.980690+0000","last_fullsized":"2024-09-17T05:48:05.980690+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:48:05.973792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:48:05.973792+0000","last_clean_scrub_stamp":"2024-09-17T05:48:05.973792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.19","version":"0'0","reported_seq":15,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-17T05:48:08.017351+0000","last_change":"2024-09-17T05:48:05.994519+0000","last_active":"2024-09-17T05:48:08.017351+0000","last_peered":"2024-09-17T05:48:08.017351+0000","last_clean":"2024-09-17T05:48:08.017351+0000","last_became_active":"2024-09-17T05:48:05.994089+0000","last_became_peered":"2024-09-17T05:48:05.994089+0000","last_unstale":"2024-09-17T05:48:08.017351+0000","last_undegraded":"2024-09-17T05:48:08.017351+0000","last_fullsized":"2024-09-17T05:48:08.017351+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:48:04.965082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:48:04.965082+0000","last_clean_scrub_stamp":"2024-09-17T05:48:04.965082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:10:49.729836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.19","version":"0'0","reported_seq":10,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T05:48:07.008542+0000","last_change":"2024-09-17T05:48:07.006952+0000","last_active":"2024-09-17T05:48:07.008542+0000","last_peered":"2024-09-17T05:48:07.008542+0000","last_clean":"2024-09-17T05:48:07.008542+0000","last_became_active":"2024-09-17T05:48:07.006627+0000","last_became_peered":"2024-09-17T05:48:07.006627+0000","last_unstale":"2024-09-17T05:48:07.008542+0000","last_undegraded":"2024-09-17T05:48:07.008542+0000","last_fullsized":"2024-09-17T05:48:07.008542+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:48:05.973792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:48:05.973792+0000","last_clean_scrub_stamp":"2024-09-17T05:48:05.973792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:01:24.000485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.18","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T05:48:06.991703+0000","last_change":"2024-09-17T05:48:05.999386+0000","last_active":"2024-09-17T05:48:06.991703+0000","last_peered":"2024-09-17T05:48:06.991703+0000","last_clean":"2024-09-17T05:48:06.991703+0000","last_became_active":"2024-09-17T05:48:05.999075+0000","last_became_peered":"2024-09-17T05:48:05.999075+0000","last_unstale":"2024-09-17T05:48:06.991703+0000","last_undegraded":"2024-09-17T05:48:06.991703+0000","last_fullsized":"2024-09-17T05:48:06.991703+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:48:04.965082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:48:04.965082+0000","last_clean_scrub_stamp":"2024-09-17T05:48:04.965082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:02:12.685719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.16","version":"0'0","reported_seq":10,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T05:48:07.007163+0000","last_change":"2024-09-17T05:48:07.004229+0000","last_active":"2024-09-17T05:48:07.007163+0000","last_peered":"2024-09-17T05:48:07.007163+0000","last_clean":"2024-09-17T05:48:07.007163+0000","last_became_active":"2024-09-17T05:48:07.003931+0000","last_became_peered":"2024-09-17T05:48:07.003931+0000","last_unstale":"2024-09-17T05:48:07.007163+0000","last_undegraded":"2024-09-17T05:48:07.007163+0000","last_fullsized":"2024-09-17T05:48:07.007163+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:48:05.973792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:48:05.973792+0000","last_clean_scrub_stamp":"2024-09-17T05:48:05.973792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:40:53.536640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.17","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T05:48:07.000319+0000","last_change":"2024-09-17T05:48:05.994108+0000","last_active":"2024-09-17T05:48:07.000319+0000","last_peered":"2024-09-17T05:48:07.000319+0000","last_clean":"2024-09-17T05:48:07.000319+0000","last_became_active":"2024-09-17T05:48:05.993676+0000","last_became_peered":"2024-09-17T05:48:05.993676+0000","last_unstale":"2024-09-17T05:48:07.000319+0000","last_undegraded":"2024-09-17T05:48:07.000319+0000","last_fullsized":"2024-09-17T05:48:07.000319+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:48:04.965082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:48:04.965082+0000","last_clean_scrub_stamp":"2024-09-17T05:48:04.965082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:36:21.212798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.17","version":"0'0","reported_seq":1,"reported_epoch":84,"state":"creating+peering","last_fresh":"2024-09-17T05:48:05.985621+0000","last_change":"2024-09-17T05:48:05.985621+0000","last_active":"2024-09-17T05:48:05.973792+0000","last_peered":"2024-09-17T05:48:05.973792+0000","last_clean":"2024-09-17T05:48:05.973792+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:48:05.985621+0000","last_undegraded":"2024-09-17T05:48:05.985621+0000","last_fullsized":"2024-09-17T05:48:05.985621+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:48:05.973792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:48:05.973792+0000","last_clean_scrub_stamp":"2024-09-17T05:48:05.973792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.16","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T05:48:07.005218+0000","last_change":"2024-09-17T05:48:05.998132+0000","last_active":"2024-09-17T05:48:07.005218+0000","last_peered":"2024-09-17T05:48:07.005218+0000","last_clean":"2024-09-17T05:48:07.005218+0000","last_became_active":"2024-09-17T05:48:05.997479+0000","last_became_peered":"2024-09-17T05:48:05.997479+0000","last_unstale":"2024-09-17T05:48:07.005218+0000","last_undegraded":"2024-09-17T05:48:07.005218+0000","last_fullsized":"2024-09-17T05:48:07.005218+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:48:04.965082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:48:04.965082+0000","last_clean_scrub_stamp":"2024-09-17T05:48:04.965082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:30:29.544066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.14","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-17T05:48:08.017612+0000","last_change":"2024-09-17T05:48:07.010434+0000","last_active":"2024-09-17T05:48:08.017612+0000","last_peered":"2024-09-17T05:48:08.017612+0000","last_clean":"2024-09-17T05:48:08.017612+0000","last_became_active":"2024-09-17T05:48:07.009605+0000","last_became_peered":"2024-09-17T05:48:07.009605+0000","last_unstale":"2024-09-17T05:48:08.017612+0000","last_undegraded":"2024-09-17T05:48:08.017612+0000","last_fullsized":"2024-09-17T05:48:08.017612+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:48:05.973792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:48:05.973792+0000","last_clean_scrub_stamp":"2024-09-17T05:48:05.973792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:46:18.050983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.15","version":"85'3","reported_seq":16,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T05:48:07.027048+0000","last_change":"2024-09-17T05:48:05.999363+0000","last_active":"2024-09-17T05:48:07.027048+0000","last_peered":"2024-09-17T05:48:07.027048+0000","last_clean":"2024-09-17T05:48:07.027048+0000","last_became_active":"2024-09-17T05:48:05.998976+0000","last_became_peered":"2024-09-17T05:48:05.998976+0000","last_unstale":"2024-09-17T05:48:07.027048+0000","last_undegraded":"2024-09-17T05:48:07.027048+0000","last_fullsized":"2024-09-17T05:48:07.027048+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:48:04.965082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:48:04.965082+0000","last_clean_scrub_stamp":"2024-09-17T05:48:04.965082+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:03:18.092299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.15","version":"0'0","reported_seq":1,"reported_epoch":84,"state":"creating+peering","last_fresh":"2024-09-17T05:48:05.988352+0000","last_change":"2024-09-17T05:48:05.988352+0000","last_active":"2024-09-17T05:48:05.973792+0000","last_peered":"2024-09-17T05:48:05.973792+0000","last_clean":"2024-09-17T05:48:05.973792+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:48:05.988352+0000","last_undegraded":"2024-09-17T05:48:05.988352+0000","last_fullsized":"2024-09-17T05:48:05.988352+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:48:05.973792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:48:05.973792+0000","last_clean_scrub_stamp":"2024-09-17T05:48:05.973792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.14","version":"0'0","reported_seq":10,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-17T05:48:05.998686+0000","last_change":"2024-09-17T05:48:05.997721+0000","last_active":"2024-09-17T05:48:05.998686+0000","last_peered":"2024-09-17T05:48:05.998686+0000","last_clean":"2024-09-17T05:48:05.998686+0000","last_became_active":"2024-09-17T05:48:05.997375+0000","last_became_peered":"2024-09-17T05:48:05.997375+0000","last_unstale":"2024-09-17T05:48:05.998686+0000","last_undegraded":"2024-09-17T05:48:05.998686+0000","last_fullsized":"2024-09-17T05:48:05.998686+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:48:04.965082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:48:04.965082+0000","last_clean_scrub_stamp":"2024-09-17T05:48:04.965082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:17:35.686622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.12","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-17T05:48:08.017527+0000","last_change":"2024-09-17T05:48:07.014653+0000","last_active":"2024-09-17T05:48:08.017527+0000","last_peered":"2024-09-17T05:48:08.017527+0000","last_clean":"2024-09-17T05:48:08.017527+0000","last_became_active":"2024-09-17T05:48:07.014227+0000","last_became_peered":"2024-09-17T05:48:07.014227+0000","last_unstale":"2024-09-17T05:48:08.017527+0000","last_undegraded":"2024-09-17T05:48:08.017527+0000","last_fullsized":"2024-09-17T05:48:08.017527+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:48:05.973792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:48:05.973792+0000","last_clean_scrub_stamp":"2024-09-17T05:48:05.973792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:47:25.975838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.13","version":"85'2","reported_seq":15,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T05:48:07.025656+0000","last_change":"2024-09-17T05:48:05.998280+0000","last_active":"2024-09-17T05:48:07.025656+0000","last_peered":"2024-09-17T05:48:07.025656+0000","last_clean":"2024-09-17T05:48:07.025656+0000","last_became_active":"2024-09-17T05:48:05.998002+0000","last_became_peered":"2024-09-17T05:48:05.998002+0000","last_unstale":"2024-09-17T05:48:07.025656+0000","last_undegraded":"2024-09-17T05:48:07.025656+0000","last_fullsized":"2024-09-17T05:48:07.025656+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:48:04.965082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:48:04.965082+0000","last_clean_scrub_stamp":"2024-09-17T05:48:04.965082+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:47:24.665134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.13","version":"0'0","reported_seq":1,"reported_epoch":84,"state":"creating+peering","last_fresh":"2024-09-17T05:48:05.979811+0000","last_change":"2024-09-17T05:48:05.979811+0000","last_active":"2024-09-17T05:48:05.973792+0000","last_peered":"2024-09-17T05:48:05.973792+0000","last_clean":"2024-09-17T05:48:05.973792+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:48:05.979811+0000","last_undegraded":"2024-09-17T05:48:05.979811+0000","last_fullsized":"2024-09-17T05:48:05.979811+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:48:05.973792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:48:05.973792+0000","last_clean_scrub_stamp":"2024-09-17T05:48:05.973792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.12","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T05:48:06.998518+0000","last_change":"2024-09-17T05:48:05.992907+0000","last_active":"2024-09-17T05:48:06.998518+0000","last_peered":"2024-09-17T05:48:06.998518+0000","last_clean":"2024-09-17T05:48:06.998518+0000","last_became_active":"2024-09-17T05:48:05.992511+0000","last_became_peered":"2024-09-17T05:48:05.992511+0000","last_unstale":"2024-09-17T05:48:06.998518+0000","last_undegraded":"2024-09-17T05:48:06.998518+0000","last_fullsized":"2024-09-17T05:48:06.998518+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:48:04.965082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:48:04.965082+0000","last_clean_scrub_stamp":"2024-09-17T05:48:04.965082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:50:06.270397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.10","version":"0'0","reported_seq":10,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T05:48:07.001747+0000","last_change":"2024-09-17T05:48:07.000184+0000","last_active":"2024-09-17T05:48:07.001747+0000","last_peered":"2024-09-17T05:48:07.001747+0000","last_clean":"2024-09-17T05:48:07.001747+0000","last_became_active":"2024-09-17T05:48:06.998794+0000","last_became_peered":"2024-09-17T05:48:06.998794+0000","last_unstale":"2024-09-17T05:48:07.001747+0000","last_undegraded":"2024-09-17T05:48:07.001747+0000","last_fullsized":"2024-09-17T05:48:07.001747+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:48:05.973792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:48:05.973792+0000","last_clean_scrub_stamp":"2024-09-17T05:48:05.973792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:00:20.671743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.11","version":"0'0","reported_seq":10,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-17T05:48:06.000120+0000","last_change":"2024-09-17T05:48:05.999329+0000","last_active":"2024-09-17T05:48:06.000120+0000","last_peered":"2024-09-17T05:48:06.000120+0000","last_clean":"2024-09-17T05:48:06.000120+0000","last_became_active":"2024-09-17T05:48:05.998937+0000","last_became_peered":"2024-09-17T05:48:05.998937+0000","last_unstale":"2024-09-17T05:48:06.000120+0000","last_undegraded":"2024-09-17T05:48:06.000120+0000","last_fullsized":"2024-09-17T05:48:06.000120+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:48:04.965082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:48:04.965082+0000","last_clean_scrub_stamp":"2024-09-17T05:48:04.965082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:14:55.111111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.11","version":"0'0","reported_seq":10,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T05:48:07.006789+0000","last_change":"2024-09-17T05:48:07.004159+0000","last_active":"2024-09-17T05:48:07.006789+0000","last_peered":"2024-09-17T05:48:07.006789+0000","last_clean":"2024-09-17T05:48:07.006789+0000","last_became_active":"2024-09-17T05:48:07.003830+0000","last_became_peered":"2024-09-17T05:48:07.003830+0000","last_unstale":"2024-09-17T05:48:07.006789+0000","last_undegraded":"2024-09-17T05:48:07.006789+0000","last_fullsized":"2024-09-17T05:48:07.006789+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:48:05.973792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:48:05.973792+0000","last_clean_scrub_stamp":"2024-09-17T05:48:05.973792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:28:05.997018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.10","version":"85'8","reported_seq":23,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-17T05:48:08.017251+0000","last_change":"2024-09-17T05:48:05.994461+0000","last_active":"2024-09-17T05:48:08.017251+0000","last_peered":"2024-09-17T05:48:08.017251+0000","last_clean":"2024-09-17T05:48:08.017251+0000","last_became_active":"2024-09-17T05:48:05.994138+0000","last_became_peered":"2024-09-17T05:48:05.994138+0000","last_unstale":"2024-09-17T05:48:08.017251+0000","last_undegraded":"2024-09-17T05:48:08.017251+0000","last_fullsized":"2024-09-17T05:48:08.017251+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:48:04.965082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:48:04.965082+0000","last_clean_scrub_stamp":"2024-09-17T05:48:04.965082+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:49:16.263159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.e","version":"0'0","reported_seq":1,"reported_epoch":84,"state":"creating+peering","last_fresh":"2024-09-17T05:48:05.980418+0000","last_change":"2024-09-17T05:48:05.980418+0000","last_active":"2024-09-17T05:48:05.973792+0000","last_peered":"2024-09-17T05:48:05.973792+0000","last_clean":"2024-09-17T05:48:05.973792+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:48:05.980418+0000","last_undegraded":"2024-09-17T05:48:05.980418+0000","last_fullsized":"2024-09-17T05:48:05.980418+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:48:05.973792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:48:05.973792+0000","last_clean_scrub_stamp":"2024-09-17T05:48:05.973792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.f","version":"85'1","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T05:48:07.027049+0000","last_change":"2024-09-17T05:48:05.993133+0000","last_active":"2024-09-17T05:48:07.027049+0000","last_peered":"2024-09-17T05:48:07.027049+0000","last_clean":"2024-09-17T05:48:07.027049+0000","last_became_active":"2024-09-17T05:48:05.992787+0000","last_became_peered":"2024-09-17T05:48:05.992787+0000","last_unstale":"2024-09-17T05:48:07.027049+0000","last_undegraded":"2024-09-17T05:48:07.027049+0000","last_fullsized":"2024-09-17T05:48:07.027049+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:48:04.965082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:48:04.965082+0000","last_clean_scrub_stamp":"2024-09-17T05:48:04.965082+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:44:05.587367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.f","version":"0'0","reported_seq":10,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T05:48:07.015835+0000","last_change":"2024-09-17T05:48:07.009405+0000","last_active":"2024-09-17T05:48:07.015835+0000","last_peered":"2024-09-17T05:48:07.015835+0000","last_clean":"2024-09-17T05:48:07.015835+0000","last_became_active":"2024-09-17T05:48:07.009088+0000","last_became_peered":"2024-09-17T05:48:07.009088+0000","last_unstale":"2024-09-17T05:48:07.015835+0000","last_undegraded":"2024-09-17T05:48:07.015835+0000","last_fullsized":"2024-09-17T05:48:07.015835+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:48:05.973792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:48:05.973792+0000","last_clean_scrub_stamp":"2024-09-17T05:48:05.973792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:38:46.247147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.e","version":"85'2","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-17T05:48:08.017601+0000","last_change":"2024-09-17T05:48:05.995547+0000","last_active":"2024-09-17T05:48:08.017601+0000","last_peered":"2024-09-17T05:48:08.017601+0000","last_clean":"2024-09-17T05:48:08.017601+0000","last_became_active":"2024-09-17T05:48:05.995233+0000","last_became_peered":"2024-09-17T05:48:05.995233+0000","last_unstale":"2024-09-17T05:48:08.017601+0000","last_undegraded":"2024-09-17T05:48:08.017601+0000","last_fullsized":"2024-09-17T05:48:08.017601+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:48:04.965082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:48:04.965082+0000","last_clean_scrub_stamp":"2024-09-17T05:48:04.965082+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:45:54.436107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.d","version":"0'0","reported_seq":1,"reported_epoch":84,"state":"creating+peering","last_fresh":"2024-09-17T05:48:05.987698+0000","last_change":"2024-09-17T05:48:05.987698+0000","last_active":"2024-09-17T05:48:05.973792+0000","last_peered":"2024-09-17T05:48:05.973792+0000","last_clean":"2024-09-17T05:48:05.973792+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:48:05.987698+0000","last_undegraded":"2024-09-17T05:48:05.987698+0000","last_fullsized":"2024-09-17T05:48:05.987698+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:48:05.973792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:48:05.973792+0000","last_clean_scrub_stamp":"2024-09-17T05:48:05.973792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.c","version":"0'0","reported_seq":15,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-17T05:48:08.017659+0000","last_change":"2024-09-17T05:48:05.993828+0000","last_active":"2024-09-17T05:48:08.017659+0000","last_peered":"2024-09-17T05:48:08.017659+0000","last_clean":"2024-09-17T05:48:08.017659+0000","last_became_active":"2024-09-17T05:48:05.992893+0000","last_became_peered":"2024-09-17T05:48:05.992893+0000","last_unstale":"2024-09-17T05:48:08.017659+0000","last_undegraded":"2024-09-17T05:48:08.017659+0000","last_fullsized":"2024-09-17T05:48:08.017659+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:48:04.965082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:48:04.965082+0000","last_clean_scrub_stamp":"2024-09-17T05:48:04.965082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:19:19.306307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.a","version":"0'0","reported_seq":10,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T05:48:07.000656+0000","last_change":"2024-09-17T05:48:06.999976+0000","last_active":"2024-09-17T05:48:07.000656+0000","last_peered":"2024-09-17T05:48:07.000656+0000","last_clean":"2024-09-17T05:48:07.000656+0000","last_became_active":"2024-09-17T05:48:06.999669+0000","last_became_peered":"2024-09-17T05:48:06.999669+0000","last_unstale":"2024-09-17T05:48:07.000656+0000","last_undegraded":"2024-09-17T05:48:07.000656+0000","last_fullsized":"2024-09-17T05:48:07.000656+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:48:05.973792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:48:05.973792+0000","last_clean_scrub_stamp":"2024-09-17T05:48:05.973792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:13:35.334703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.b","version":"85'2","reported_seq":15,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T05:48:07.024635+0000","last_change":"2024-09-17T05:48:05.990062+0000","last_active":"2024-09-17T05:48:07.024635+0000","last_peered":"2024-09-17T05:48:07.024635+0000","last_clean":"2024-09-17T05:48:07.024635+0000","last_became_active":"2024-09-17T05:48:05.989770+0000","last_became_peered":"2024-09-17T05:48:05.989770+0000","last_unstale":"2024-09-17T05:48:07.024635+0000","last_undegraded":"2024-09-17T05:48:07.024635+0000","last_fullsized":"2024-09-17T05:48:07.024635+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:48:04.965082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:48:04.965082+0000","last_clean_scrub_stamp":"2024-09-17T05:48:04.965082+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:54:27.978918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.b","version":"0'0","reported_seq":1,"reported_epoch":84,"state":"creating+peering","last_fresh":"2024-09-17T05:48:05.987891+0000","last_change":"2024-09-17T05:48:05.987891+0000","last_active":"2024-09-17T05:48:05.973792+0000","last_peered":"2024-09-17T05:48:05.973792+0000","last_clean":"2024-09-17T05:48:05.973792+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:48:05.987891+0000","last_undegraded":"2024-09-17T05:48:05.987891+0000","last_fullsized":"2024-09-17T05:48:05.987891+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:48:05.973792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:48:05.973792+0000","last_clean_scrub_stamp":"2024-09-17T05:48:05.973792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.a","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T05:48:06.994828+0000","last_change":"2024-09-17T05:48:05.997773+0000","last_active":"2024-09-17T05:48:06.994828+0000","last_peered":"2024-09-17T05:48:06.994828+0000","last_clean":"2024-09-17T05:48:06.994828+0000","last_became_active":"2024-09-17T05:48:05.997035+0000","last_became_peered":"2024-09-17T05:48:05.997035+0000","last_unstale":"2024-09-17T05:48:06.994828+0000","last_undegraded":"2024-09-17T05:48:06.994828+0000","last_fullsized":"2024-09-17T05:48:06.994828+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:48:04.965082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:48:04.965082+0000","last_clean_scrub_stamp":"2024-09-17T05:48:04.965082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:12:13.405546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.8","version":"0'0","reported_seq":10,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T05:48:07.007881+0000","last_change":"2024-09-17T05:48:07.004667+0000","last_active":"2024-09-17T05:48:07.007881+0000","last_peered":"2024-09-17T05:48:07.007881+0000","last_clean":"2024-09-17T05:48:07.007881+0000","last_became_active":"2024-09-17T05:48:07.002420+0000","last_became_peered":"2024-09-17T05:48:07.002420+0000","last_unstale":"2024-09-17T05:48:07.007881+0000","last_undegraded":"2024-09-17T05:48:07.007881+0000","last_fullsized":"2024-09-17T05:48:07.007881+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:48:05.973792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:48:05.973792+0000","last_clean_scrub_stamp":"2024-09-17T05:48:05.973792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:58:39.931473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.9","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T05:48:06.994209+0000","last_change":"2024-09-17T05:48:05.999798+0000","last_active":"2024-09-17T05:48:06.994209+0000","last_peered":"2024-09-17T05:48:06.994209+0000","last_clean":"2024-09-17T05:48:06.994209+0000","last_became_active":"2024-09-17T05:48:05.999476+0000","last_became_peered":"2024-09-17T05:48:05.999476+0000","last_unstale":"2024-09-17T05:48:06.994209+0000","last_undegraded":"2024-09-17T05:48:06.994209+0000","last_fullsized":"2024-09-17T05:48:06.994209+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:48:04.965082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:48:04.965082+0000","last_clean_scrub_stamp":"2024-09-17T05:48:04.965082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:44:22.789741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.9","version":"0'0","reported_seq":1,"reported_epoch":84,"state":"creating+peering","last_fresh":"2024-09-17T05:48:05.984632+0000","last_change":"2024-09-17T05:48:05.984632+0000","last_active":"2024-09-17T05:48:05.973792+0000","last_peered":"2024-09-17T05:48:05.973792+0000","last_clean":"2024-09-17T05:48:05.973792+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:48:05.984632+0000","last_undegraded":"2024-09-17T05:48:05.984632+0000","last_fullsized":"2024-09-17T05:48:05.984632+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:48:05.973792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:48:05.973792+0000","last_clean_scrub_stamp":"2024-09-17T05:48:05.973792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.8","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T05:48:06.998203+0000","last_change":"2024-09-17T05:48:05.990918+0000","last_active":"2024-09-17T05:48:06.998203+0000","last_peered":"2024-09-17T05:48:06.998203+0000","last_clean":"2024-09-17T05:48:06.998203+0000","last_became_active":"2024-09-17T05:48:05.990644+0000","last_became_peered":"2024-09-17T05:48:05.990644+0000","last_unstale":"2024-09-17T05:48:06.998203+0000","last_undegraded":"2024-09-17T05:48:06.998203+0000","last_fullsized":"2024-09-17T05:48:06.998203+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:48:04.965082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:48:04.965082+0000","last_clean_scrub_stamp":"2024-09-17T05:48:04.965082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:32:32.045706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.6","version":"0'0","reported_seq":1,"reported_epoch":84,"state":"creating+peering","last_fresh":"2024-09-17T05:48:05.984822+0000","last_change":"2024-09-17T05:48:05.984822+0000","last_active":"2024-09-17T05:48:05.973792+0000","last_peered":"2024-09-17T05:48:05.973792+0000","last_clean":"2024-09-17T05:48:05.973792+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:48:05.984822+0000","last_undegraded":"2024-09-17T05:48:05.984822+0000","last_fullsized":"2024-09-17T05:48:05.984822+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:48:05.973792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:48:05.973792+0000","last_clean_scrub_stamp":"2024-09-17T05:48:05.973792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.7","version":"85'2","reported_seq":15,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T05:48:07.026024+0000","last_change":"2024-09-17T05:48:05.996277+0000","last_active":"2024-09-17T05:48:07.026024+0000","last_peered":"2024-09-17T05:48:07.026024+0000","last_clean":"2024-09-17T05:48:07.026024+0000","last_became_active":"2024-09-17T05:48:05.995979+0000","last_became_peered":"2024-09-17T05:48:05.995979+0000","last_unstale":"2024-09-17T05:48:07.026024+0000","last_undegraded":"2024-09-17T05:48:07.026024+0000","last_fullsized":"2024-09-17T05:48:07.026024+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:48:04.965082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:48:04.965082+0000","last_clean_scrub_stamp":"2024-09-17T05:48:04.965082+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:25:07.468281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.7","version":"0'0","reported_seq":1,"reported_epoch":84,"state":"creating+peering","last_fresh":"2024-09-17T05:48:05.979914+0000","last_change":"2024-09-17T05:48:05.979914+0000","last_active":"2024-09-17T05:48:05.973792+0000","last_peered":"2024-09-17T05:48:05.973792+0000","last_clean":"2024-09-17T05:48:05.973792+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:48:05.979914+0000","last_undegraded":"2024-09-17T05:48:05.979914+0000","last_fullsized":"2024-09-17T05:48:05.979914+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:48:05.973792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:48:05.973792+0000","last_clean_scrub_stamp":"2024-09-17T05:48:05.973792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.6","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T05:48:06.992144+0000","last_change":"2024-09-17T05:48:05.997590+0000","last_active":"2024-09-17T05:48:06.992144+0000","last_peered":"2024-09-17T05:48:06.992144+0000","last_clean":"2024-09-17T05:48:06.992144+0000","last_became_active":"2024-09-17T05:48:05.997301+0000","last_became_peered":"2024-09-17T05:48:05.997301+0000","last_unstale":"2024-09-17T05:48:06.992144+0000","last_undegraded":"2024-09-17T05:48:06.992144+0000","last_fullsized":"2024-09-17T05:48:06.992144+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:48:04.965082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:48:04.965082+0000","last_clean_scrub_stamp":"2024-09-17T05:48:04.965082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:28:36.315309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.4","version":"0'0","reported_seq":10,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T05:48:07.017376+0000","last_change":"2024-09-17T05:48:07.014783+0000","last_active":"2024-09-17T05:48:07.017376+0000","last_peered":"2024-09-17T05:48:07.017376+0000","last_clean":"2024-09-17T05:48:07.017376+0000","last_became_active":"2024-09-17T05:48:07.013864+0000","last_became_peered":"2024-09-17T05:48:07.013864+0000","last_unstale":"2024-09-17T05:48:07.017376+0000","last_undegraded":"2024-09-17T05:48:07.017376+0000","last_fullsized":"2024-09-17T05:48:07.017376+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:48:05.973792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:48:05.973792+0000","last_clean_scrub_stamp":"2024-09-17T05:48:05.973792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:55:17.823783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.5","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T05:48:06.997381+0000","last_change":"2024-09-17T05:48:05.995722+0000","last_active":"2024-09-17T05:48:06.997381+0000","last_peered":"2024-09-17T05:48:06.997381+0000","last_clean":"2024-09-17T05:48:06.997381+0000","last_became_active":"2024-09-17T05:48:05.995345+0000","last_became_peered":"2024-09-17T05:48:05.995345+0000","last_unstale":"2024-09-17T05:48:06.997381+0000","last_undegraded":"2024-09-17T05:48:06.997381+0000","last_fullsized":"2024-09-17T05:48:06.997381+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:48:04.965082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:48:04.965082+0000","last_clean_scrub_stamp":"2024-09-17T05:48:04.965082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:28:33.210082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.5","version":"0'0","reported_seq":1,"reported_epoch":84,"state":"creating+peering","last_fresh":"2024-09-17T05:48:05.983735+0000","last_change":"2024-09-17T05:48:05.983735+0000","last_active":"2024-09-17T05:48:05.973792+0000","last_peered":"2024-09-17T05:48:05.973792+0000","last_clean":"2024-09-17T05:48:05.973792+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:48:05.983735+0000","last_undegraded":"2024-09-17T05:48:05.983735+0000","last_fullsized":"2024-09-17T05:48:05.983735+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:48:05.973792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:48:05.973792+0000","last_clean_scrub_stamp":"2024-09-17T05:48:05.973792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.4","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T05:48:07.006446+0000","last_change":"2024-09-17T05:48:05.995600+0000","last_active":"2024-09-17T05:48:07.006446+0000","last_peered":"2024-09-17T05:48:07.006446+0000","last_clean":"2024-09-17T05:48:07.006446+0000","last_became_active":"2024-09-17T05:48:05.993437+0000","last_became_peered":"2024-09-17T05:48:05.993437+0000","last_unstale":"2024-09-17T05:48:07.006446+0000","last_undegraded":"2024-09-17T05:48:07.006446+0000","last_fullsized":"2024-09-17T05:48:07.006446+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:48:04.965082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:48:04.965082+0000","last_clean_scrub_stamp":"2024-09-17T05:48:04.965082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:34:01.741103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.2","version":"0'0","reported_seq":1,"reported_epoch":84,"state":"creating+peering","last_fresh":"2024-09-17T05:48:05.984825+0000","last_change":"2024-09-17T05:48:05.984825+0000","last_active":"2024-09-17T05:48:05.973792+0000","last_peered":"2024-09-17T05:48:05.973792+0000","last_clean":"2024-09-17T05:48:05.973792+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:48:05.984825+0000","last_undegraded":"2024-09-17T05:48:05.984825+0000","last_fullsized":"2024-09-17T05:48:05.984825+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:48:05.973792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:48:05.973792+0000","last_clean_scrub_stamp":"2024-09-17T05:48:05.973792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.3","version":"0'0","reported_seq":15,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-17T05:48:08.017675+0000","last_change":"2024-09-17T05:48:05.993443+0000","last_active":"2024-09-17T05:48:08.017675+0000","last_peered":"2024-09-17T05:48:08.017675+0000","last_clean":"2024-09-17T05:48:08.017675+0000","last_became_active":"2024-09-17T05:48:05.993128+0000","last_became_peered":"2024-09-17T05:48:05.993128+0000","last_unstale":"2024-09-17T05:48:08.017675+0000","last_undegraded":"2024-09-17T05:48:08.017675+0000","last_fullsized":"2024-09-17T05:48:08.017675+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:48:04.965082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:48:04.965082+0000","last_clean_scrub_stamp":"2024-09-17T05:48:04.965082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:20:42.632458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.3","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-17T05:48:08.017609+0000","last_change":"2024-09-17T05:48:07.019471+0000","last_active":"2024-09-17T05:48:08.017609+0000","last_peered":"2024-09-17T05:48:08.017609+0000","last_clean":"2024-09-17T05:48:08.017609+0000","last_became_active":"2024-09-17T05:48:07.019107+0000","last_became_peered":"2024-09-17T05:48:07.019107+0000","last_unstale":"2024-09-17T05:48:08.017609+0000","last_undegraded":"2024-09-17T05:48:08.017609+0000","last_fullsized":"2024-09-17T05:48:08.017609+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:48:05.973792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:48:05.973792+0000","last_clean_scrub_stamp":"2024-09-17T05:48:05.973792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:30:20.891839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.2","version":"0'0","reported_seq":10,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-17T05:48:05.998302+0000","last_change":"2024-09-17T05:48:05.995790+0000","last_active":"2024-09-17T05:48:05.998302+0000","last_peered":"2024-09-17T05:48:05.998302+0000","last_clean":"2024-09-17T05:48:05.998302+0000","last_became_active":"2024-09-17T05:48:05.995430+0000","last_became_peered":"2024-09-17T05:48:05.995430+0000","last_unstale":"2024-09-17T05:48:05.998302+0000","last_undegraded":"2024-09-17T05:48:05.998302+0000","last_fullsized":"2024-09-17T05:48:05.998302+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:48:04.965082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:48:04.965082+0000","last_clean_scrub_stamp":"2024-09-17T05:48:04.965082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:51:12.220768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.0","version":"0'0","reported_seq":1,"reported_epoch":84,"state":"creating+peering","last_fresh":"2024-09-17T05:48:05.979780+0000","last_change":"2024-09-17T05:48:05.979780+0000","last_active":"2024-09-17T05:48:05.973792+0000","last_peered":"2024-09-17T05:48:05.973792+0000","last_clean":"2024-09-17T05:48:05.973792+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:48:05.979780+0000","last_undegraded":"2024-09-17T05:48:05.979780+0000","last_fullsized":"2024-09-17T05:48:05.979780+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:48:05.973792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:48:05.973792+0000","last_clean_scrub_stamp":"2024-09-17T05:48:05.973792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T05:48:07.000198+0000","last_change":"2024-09-17T05:48:05.994404+0000","last_active":"2024-09-17T05:48:07.000198+0000","last_peered":"2024-09-17T05:48:07.000198+0000","last_clean":"2024-09-17T05:48:07.000198+0000","last_became_active":"2024-09-17T05:48:05.993984+0000","last_became_peered":"2024-09-17T05:48:05.993984+0000","last_unstale":"2024-09-17T05:48:07.000198+0000","last_undegraded":"2024-09-17T05:48:07.000198+0000","last_fullsized":"2024-09-17T05:48:07.000198+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:48:04.965082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:48:04.965082+0000","last_clean_scrub_stamp":"2024-09-17T05:48:04.965082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:59:41.841128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1","version":"0'0","reported_seq":10,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T05:48:07.018798+0000","last_change":"2024-09-17T05:48:07.016257+0000","last_active":"2024-09-17T05:48:07.018798+0000","last_peered":"2024-09-17T05:48:07.018798+0000","last_clean":"2024-09-17T05:48:07.018798+0000","last_became_active":"2024-09-17T05:48:07.015950+0000","last_became_peered":"2024-09-17T05:48:07.015950+0000","last_unstale":"2024-09-17T05:48:07.018798+0000","last_undegraded":"2024-09-17T05:48:07.018798+0000","last_fullsized":"2024-09-17T05:48:07.018798+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:48:05.973792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:48:05.973792+0000","last_clean_scrub_stamp":"2024-09-17T05:48:05.973792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:09:18.062866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.0","version":"0'0","reported_seq":10,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-17T05:48:06.000943+0000","last_change":"2024-09-17T05:48:06.000083+0000","last_active":"2024-09-17T05:48:06.000943+0000","last_peered":"2024-09-17T05:48:06.000943+0000","last_clean":"2024-09-17T05:48:06.000943+0000","last_became_active":"2024-09-17T05:48:05.999770+0000","last_became_peered":"2024-09-17T05:48:05.999770+0000","last_unstale":"2024-09-17T05:48:06.000943+0000","last_undegraded":"2024-09-17T05:48:06.000943+0000","last_fullsized":"2024-09-17T05:48:06.000943+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:48:04.965082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:48:04.965082+0000","last_clean_scrub_stamp":"2024-09-17T05:48:04.965082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:11:27.267806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.c","version":"0'0","reported_seq":10,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T05:48:07.009303+0000","last_change":"2024-09-17T05:48:07.007210+0000","last_active":"2024-09-17T05:48:07.009303+0000","last_peered":"2024-09-17T05:48:07.009303+0000","last_clean":"2024-09-17T05:48:07.009303+0000","last_became_active":"2024-09-17T05:48:07.006278+0000","last_became_peered":"2024-09-17T05:48:07.006278+0000","last_unstale":"2024-09-17T05:48:07.009303+0000","last_undegraded":"2024-09-17T05:48:07.009303+0000","last_fullsized":"2024-09-17T05:48:07.009303+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:48:05.973792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:48:05.973792+0000","last_clean_scrub_stamp":"2024-09-17T05:48:05.973792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:11:54.651531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.d","version":"0'0","reported_seq":10,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-17T05:48:05.996883+0000","last_change":"2024-09-17T05:48:05.995764+0000","last_active":"2024-09-17T05:48:05.996883+0000","last_peered":"2024-09-17T05:48:05.996883+0000","last_clean":"2024-09-17T05:48:05.996883+0000","last_became_active":"2024-09-17T05:48:05.995439+0000","last_became_peered":"2024-09-17T05:48:05.995439+0000","last_unstale":"2024-09-17T05:48:05.996883+0000","last_undegraded":"2024-09-17T05:48:05.996883+0000","last_fullsized":"2024-09-17T05:48:05.996883+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:48:04.965082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:48:04.965082+0000","last_clean_scrub_stamp":"2024-09-17T05:48:04.965082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:59:39.032133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"19'72","reported_seq":223,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-17T05:48:05.984920+0000","last_change":"2024-09-17T05:41:48.539830+0000","last_active":"2024-09-17T05:48:05.984920+0000","last_peered":"2024-09-17T05:48:05.984920+0000","last_clean":"2024-09-17T05:48:05.984920+0000","last_became_active":"2024-09-17T05:41:48.538743+0000","last_became_peered":"2024-09-17T05:41:48.538743+0000","last_unstale":"2024-09-17T05:48:05.984920+0000","last_undegraded":"2024-09-17T05:48:05.984920+0000","last_fullsized":"2024-09-17T05:48:05.984920+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:47.152539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:47.152539+0000","last_clean_scrub_stamp":"2024-09-17T05:41:47.152539+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:08:02.952016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":13,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":12,"num_pg":32,"stat_sum":{"num_bytes":728,"num_objects":16,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":37,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":12,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":3116,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":28,"ondisk_log_size":28,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":16,"seq":68719476817,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":54424,"kb_used_data":1024,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94317416,"statfs":{"total":96636764160,"available":96581033984,"internally_reserved":0,"allocated":1048576,"data_stored":443474,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":54655430},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":7,"up_from":15,"seq":64424509521,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":50808,"kb_used_data":1568,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94321032,"statfs":{"total":96636764160,"available":96584736768,"internally_reserved":0,"allocated":1605632,"data_stored":1019930,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":50395594},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509520,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":50224,"kb_used_data":988,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94321616,"statfs":{"total":96636764160,"available":96585334784,"internally_reserved":0,"allocated":1011712,"data_stored":429562,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509520,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":50224,"kb_used_data":988,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94321616,"statfs":{"total":96636764160,"available":96585334784,"internally_reserved":0,"allocated":1011712,"data_stored":429562,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509520,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":72384,"kb_used_data":1000,"kb_used_omap":1,"kb_used_meta":71358,"kb_avail":94299456,"statfs":{"total":96636764160,"available":96562642944,"internally_reserved":0,"allocated":1024000,"data_stored":435921,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":73071047},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509520,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":50240,"kb_used_data":1000,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94321600,"statfs":{"total":96636764160,"available":96585318400,"internally_reserved":0,"allocated":1024000,"data_stored":435921,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509520,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":72412,"kb_used_data":1024,"kb_used_omap":1,"kb_used_meta":71358,"kb_avail":94299428,"statfs":{"total":96636764160,"available":96562614272,"internally_reserved":0,"allocated":1048576,"data_stored":442974,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":73071045},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574928,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55004,"kb_used_data":1608,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94316836,"statfs":{"total":96636764160,"available":96580440064,"internally_reserved":0,"allocated":1646592,"data_stored":1039566,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":194,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":694,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-17T05:48:15.479 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-17T05:48:15.609 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:15.607+0000 7f50d6025640 1 -- 172.21.15.150:0/763877915 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f50b8004800 msgr2=0x7f50b8004c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:48:15.609 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:15.607+0000 7f50d6025640 1 --2- 172.21.15.150:0/763877915 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f50b8004800 0x7f50b8004c10 secure :-1 s=READY pgs=1023 cs=0 l=1 rev1=1 crypto rx=0x7f50d01629c0 tx=0x7f50b8005830 comp rx=0 tx=0).stop 2024-09-17T05:48:15.609 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:15.607+0000 7f50cffff640 1 -- 172.21.15.150:0/763877915 reap_dead start 2024-09-17T05:48:15.609 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:15.607+0000 7f50d6025640 1 -- 172.21.15.150:0/763877915 shutdown_connections 2024-09-17T05:48:15.609 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:15.607+0000 7f50d6025640 1 -- 172.21.15.150:0/763877915 >> 172.21.15.150:0/763877915 conn(0x7f50d00d4680 msgr2=0x7f50d00d4a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:48:15.609 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:15.607+0000 7f50d6025640 1 -- 172.21.15.150:0/763877915 shutdown_connections 2024-09-17T05:48:15.609 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:15.607+0000 7f50d6025640 1 -- 172.21.15.150:0/763877915 wait complete. 2024-09-17T05:48:15.610 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:15.609+0000 7f50d6025640 1 Processor -- start 2024-09-17T05:48:15.610 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:15.609+0000 7f50d6025640 1 -- start start 2024-09-17T05:48:15.614 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:15.610+0000 7f50d6025640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f50b8004800 0x7f50d01f8d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:48:15.614 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:15.610+0000 7f50d6025640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f50d00b5f50 0x7f50d00c1410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:48:15.614 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:15.610+0000 7f50d6025640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f50d00c1950 0x7f50d00c1d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:48:15.614 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:15.610+0000 7f50d6025640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f50d00cfb80 con 0x7f50d00c1950 2024-09-17T05:48:15.614 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:15.610+0000 7f50d6025640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f50d00b3b50 con 0x7f50d00b5f50 2024-09-17T05:48:15.614 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:15.610+0000 7f50d6025640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f50d00cfd00 con 0x7f50b8004800 2024-09-17T05:48:15.614 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:15.610+0000 7f50cffff640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f50d00c1950 0x7f50d00c1d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:48:15.614 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:15.611+0000 7f50cffff640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f50d00c1950 0x7f50d00c1d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:34216/0 (socket says 172.21.15.150:34216) 2024-09-17T05:48:15.614 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:15.611+0000 7f50cffff640 1 -- 172.21.15.150:0/3069147865 learned_addr learned my addr 172.21.15.150:0/3069147865 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:48:15.614 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:15.611+0000 7f50ceffd640 1 --2- 172.21.15.150:0/3069147865 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f50d00b5f50 0x7f50d00c1410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:48:15.614 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:15.611+0000 7f50cf7fe640 1 --2- 172.21.15.150:0/3069147865 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f50b8004800 0x7f50d01f8d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:48:15.614 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:15.611+0000 7f50cffff640 1 -- 172.21.15.150:0/3069147865 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f50b8004800 msgr2=0x7f50d01f8d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:48:15.615 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:15.611+0000 7f50cffff640 1 --2- 172.21.15.150:0/3069147865 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f50b8004800 0x7f50d01f8d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:48:15.615 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:15.611+0000 7f50cffff640 1 -- 172.21.15.150:0/3069147865 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f50d00b5f50 msgr2=0x7f50d00c1410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:48:15.615 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:15.611+0000 7f50cffff640 1 --2- 172.21.15.150:0/3069147865 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f50d00b5f50 0x7f50d00c1410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:48:15.615 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:15.611+0000 7f50cffff640 1 -- 172.21.15.150:0/3069147865 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f50d00b66a0 con 0x7f50d00c1950 2024-09-17T05:48:15.615 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:15.611+0000 7f50cffff640 1 --2- 172.21.15.150:0/3069147865 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f50d00c1950 0x7f50d00c1d60 secure :-1 s=READY pgs=1024 cs=0 l=1 rev1=1 crypto rx=0x7f50c8002110 tx=0x7f50c8006430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:48:15.615 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:15.611+0000 7f50b7fff640 1 -- 172.21.15.150:0/3069147865 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50c8015070 con 0x7f50d00c1950 2024-09-17T05:48:15.615 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:15.611+0000 7f50b7fff640 1 -- 172.21.15.150:0/3069147865 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f50c8011900 con 0x7f50d00c1950 2024-09-17T05:48:15.615 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:15.611+0000 7f50d6025640 1 -- 172.21.15.150:0/3069147865 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f50d00b6980 con 0x7f50d00c1950 2024-09-17T05:48:15.615 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:15.611+0000 7f50b7fff640 1 -- 172.21.15.150:0/3069147865 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50c8011cd0 con 0x7f50d00c1950 2024-09-17T05:48:15.615 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:15.611+0000 7f50d6025640 1 -- 172.21.15.150:0/3069147865 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f50d00b6f40 con 0x7f50d00c1950 2024-09-17T05:48:15.616 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:15.612+0000 7f50d6025640 1 -- 172.21.15.150:0/3069147865 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f50d008d100 con 0x7f50d00c1950 2024-09-17T05:48:15.616 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:15.613+0000 7f50b7fff640 1 -- 172.21.15.150:0/3069147865 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 25) ==== 103022+0+0 (secure 0 0 0) 0x7f50c8018070 con 0x7f50d00c1950 2024-09-17T05:48:15.616 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:15.614+0000 7f50b7fff640 1 --2- 172.21.15.150:0/3069147865 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f50bc079d30 0x7f50bc07c240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:48:15.617 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:15.614+0000 7f50b7fff640 1 -- 172.21.15.150:0/3069147865 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 5793+0+0 (secure 0 0 0) 0x7f50c809a700 con 0x7f50d00c1950 2024-09-17T05:48:15.617 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:15.614+0000 7f50cf7fe640 1 --2- 172.21.15.150:0/3069147865 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f50bc079d30 0x7f50bc07c240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:48:15.617 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:15.614+0000 7f50cf7fe640 1 --2- 172.21.15.150:0/3069147865 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f50bc079d30 0x7f50bc07c240 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f50c0009ba0 tx=0x7f50c0005f30 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:48:15.620 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:15.618+0000 7f50b7fff640 1 -- 172.21.15.150:0/3069147865 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f50d008d100 con 0x7f50d00c1950 2024-09-17T05:48:15.796 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:15.794+0000 7f50d6025640 1 -- 172.21.15.150:0/3069147865 --> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f50d01f92b0 con 0x7f50bc079d30 2024-09-17T05:48:15.801 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:15.800+0000 7f50b7fff640 1 -- 172.21.15.150:0/3069147865 <== mgr.4108 v2:172.21.15.176:6800/3631216395 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+252010 (secure 0 0 0) 0x7f50c0012bd0 con 0x7f50bc079d30 2024-09-17T05:48:15.803 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-09-17T05:48:15.805 INFO:teuthology.orchestra.run.smithi150.stderr:dumped all 2024-09-17T05:48:15.806 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:15.803+0000 7f50d6025640 1 -- 172.21.15.150:0/3069147865 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f50bc079d30 msgr2=0x7f50bc07c240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:48:15.806 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:15.803+0000 7f50d6025640 1 --2- 172.21.15.150:0/3069147865 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f50bc079d30 0x7f50bc07c240 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f50c0009ba0 tx=0x7f50c0005f30 comp rx=0 tx=0).stop 2024-09-17T05:48:15.806 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:15.803+0000 7f50d6025640 1 -- 172.21.15.150:0/3069147865 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f50d00c1950 msgr2=0x7f50d00c1d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:48:15.806 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:15.803+0000 7f50d6025640 1 --2- 172.21.15.150:0/3069147865 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f50d00c1950 0x7f50d00c1d60 secure :-1 s=READY pgs=1024 cs=0 l=1 rev1=1 crypto rx=0x7f50c8002110 tx=0x7f50c8006430 comp rx=0 tx=0).stop 2024-09-17T05:48:15.807 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:15.803+0000 7f50d6025640 1 -- 172.21.15.150:0/3069147865 shutdown_connections 2024-09-17T05:48:15.807 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:15.803+0000 7f50d6025640 1 --2- 172.21.15.150:0/3069147865 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f50d00b5f50 0x7f50d00c1410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:48:15.807 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:15.803+0000 7f50d6025640 1 --2- 172.21.15.150:0/3069147865 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f50bc079d30 0x7f50bc07c240 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:48:15.807 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:15.803+0000 7f50d6025640 1 --2- 172.21.15.150:0/3069147865 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f50d00c1950 0x7f50d00c1d60 unknown :-1 s=CLOSED pgs=1024 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:48:15.807 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:15.803+0000 7f50d6025640 1 --2- 172.21.15.150:0/3069147865 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f50b8004800 0x7f50d01f8d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:48:15.807 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:15.803+0000 7f50d6025640 1 -- 172.21.15.150:0/3069147865 >> 172.21.15.150:0/3069147865 conn(0x7f50d00d4680 msgr2=0x7f50d006f7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:48:15.807 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:15.803+0000 7f50d6025640 1 -- 172.21.15.150:0/3069147865 shutdown_connections 2024-09-17T05:48:15.807 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:15.803+0000 7f50d6025640 1 -- 172.21.15.150:0/3069147865 wait complete. 2024-09-17T05:48:15.816 INFO:teuthology.orchestra.run.smithi150.stdout:{"pg_ready":true,"pg_map":{"version":275,"stamp":"2024-09-17T05:48:14.966284+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":146,"num_write_kb":1642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":111,"ondisk_log_size":111,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":180,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":455932,"kb_used_data":9416,"kb_used_omap":12,"kb_used_meta":446323,"kb_avail":754518788,"statfs":{"total":773094113280,"available":772627238912,"internally_reserved":0,"allocated":9641984,"data_stored":4778868,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":457035312},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.002307"},"pg_stats":[{"pgid":"13.3f","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-17T05:48:08.081980+0000","last_change":"2024-09-17T05:48:07.019629+0000","last_active":"2024-09-17T05:48:08.081980+0000","last_peered":"2024-09-17T05:48:08.081980+0000","last_clean":"2024-09-17T05:48:08.081980+0000","last_became_active":"2024-09-17T05:48:07.019293+0000","last_became_peered":"2024-09-17T05:48:07.019293+0000","last_unstale":"2024-09-17T05:48:08.081980+0000","last_undegraded":"2024-09-17T05:48:08.081980+0000","last_fullsized":"2024-09-17T05:48:08.081980+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:48:05.973792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:48:05.973792+0000","last_clean_scrub_stamp":"2024-09-17T05:48:05.973792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:31:28.113555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.3e","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-17T05:48:08.015603+0000","last_change":"2024-09-17T05:48:07.008371+0000","last_active":"2024-09-17T05:48:08.015603+0000","last_peered":"2024-09-17T05:48:08.015603+0000","last_clean":"2024-09-17T05:48:08.015603+0000","last_became_active":"2024-09-17T05:48:07.008069+0000","last_became_peered":"2024-09-17T05:48:07.008069+0000","last_unstale":"2024-09-17T05:48:08.015603+0000","last_undegraded":"2024-09-17T05:48:08.015603+0000","last_fullsized":"2024-09-17T05:48:08.015603+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:48:05.973792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:48:05.973792+0000","last_clean_scrub_stamp":"2024-09-17T05:48:05.973792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:11:26.129007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.3d","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-17T05:48:07.994754+0000","last_change":"2024-09-17T05:48:07.005983+0000","last_active":"2024-09-17T05:48:07.994754+0000","last_peered":"2024-09-17T05:48:07.994754+0000","last_clean":"2024-09-17T05:48:07.994754+0000","last_became_active":"2024-09-17T05:48:07.005572+0000","last_became_peered":"2024-09-17T05:48:07.005572+0000","last_unstale":"2024-09-17T05:48:07.994754+0000","last_undegraded":"2024-09-17T05:48:07.994754+0000","last_fullsized":"2024-09-17T05:48:07.994754+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:48:05.973792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:48:05.973792+0000","last_clean_scrub_stamp":"2024-09-17T05:48:05.973792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:25:00.288646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.3c","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-17T05:48:08.080655+0000","last_change":"2024-09-17T05:48:06.997015+0000","last_active":"2024-09-17T05:48:08.080655+0000","last_peered":"2024-09-17T05:48:08.080655+0000","last_clean":"2024-09-17T05:48:08.080655+0000","last_became_active":"2024-09-17T05:48:06.996664+0000","last_became_peered":"2024-09-17T05:48:06.996664+0000","last_unstale":"2024-09-17T05:48:08.080655+0000","last_undegraded":"2024-09-17T05:48:08.080655+0000","last_fullsized":"2024-09-17T05:48:08.080655+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:48:05.973792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:48:05.973792+0000","last_clean_scrub_stamp":"2024-09-17T05:48:05.973792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:00:20.671743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.3b","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-17T05:48:07.995804+0000","last_change":"2024-09-17T05:48:07.012743+0000","last_active":"2024-09-17T05:48:07.995804+0000","last_peered":"2024-09-17T05:48:07.995804+0000","last_clean":"2024-09-17T05:48:07.995804+0000","last_became_active":"2024-09-17T05:48:07.012408+0000","last_became_peered":"2024-09-17T05:48:07.012408+0000","last_unstale":"2024-09-17T05:48:07.995804+0000","last_undegraded":"2024-09-17T05:48:07.995804+0000","last_fullsized":"2024-09-17T05:48:07.995804+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:48:05.973792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:48:05.973792+0000","last_clean_scrub_stamp":"2024-09-17T05:48:05.973792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:40:52.803481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.3a","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-17T05:48:08.080828+0000","last_change":"2024-09-17T05:48:07.003082+0000","last_active":"2024-09-17T05:48:08.080828+0000","last_peered":"2024-09-17T05:48:08.080828+0000","last_clean":"2024-09-17T05:48:08.080828+0000","last_became_active":"2024-09-17T05:48:07.001905+0000","last_became_peered":"2024-09-17T05:48:07.001905+0000","last_unstale":"2024-09-17T05:48:08.080828+0000","last_undegraded":"2024-09-17T05:48:08.080828+0000","last_fullsized":"2024-09-17T05:48:08.080828+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:48:05.973792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:48:05.973792+0000","last_clean_scrub_stamp":"2024-09-17T05:48:05.973792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:31:36.633229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.39","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-17T05:48:08.080270+0000","last_change":"2024-09-17T05:48:07.004879+0000","last_active":"2024-09-17T05:48:08.080270+0000","last_peered":"2024-09-17T05:48:08.080270+0000","last_clean":"2024-09-17T05:48:08.080270+0000","last_became_active":"2024-09-17T05:48:07.004432+0000","last_became_peered":"2024-09-17T05:48:07.004432+0000","last_unstale":"2024-09-17T05:48:08.080270+0000","last_undegraded":"2024-09-17T05:48:08.080270+0000","last_fullsized":"2024-09-17T05:48:08.080270+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:48:05.973792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:48:05.973792+0000","last_clean_scrub_stamp":"2024-09-17T05:48:05.973792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:05:50.319662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.38","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-17T05:48:08.080748+0000","last_change":"2024-09-17T05:48:07.004569+0000","last_active":"2024-09-17T05:48:08.080748+0000","last_peered":"2024-09-17T05:48:08.080748+0000","last_clean":"2024-09-17T05:48:08.080748+0000","last_became_active":"2024-09-17T05:48:07.004139+0000","last_became_peered":"2024-09-17T05:48:07.004139+0000","last_unstale":"2024-09-17T05:48:08.080748+0000","last_undegraded":"2024-09-17T05:48:08.080748+0000","last_fullsized":"2024-09-17T05:48:08.080748+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:48:05.973792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:48:05.973792+0000","last_clean_scrub_stamp":"2024-09-17T05:48:05.973792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:43:00.912530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.37","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-17T05:48:08.081509+0000","last_change":"2024-09-17T05:48:07.011661+0000","last_active":"2024-09-17T05:48:08.081509+0000","last_peered":"2024-09-17T05:48:08.081509+0000","last_clean":"2024-09-17T05:48:08.081509+0000","last_became_active":"2024-09-17T05:48:07.011357+0000","last_became_peered":"2024-09-17T05:48:07.011357+0000","last_unstale":"2024-09-17T05:48:08.081509+0000","last_undegraded":"2024-09-17T05:48:08.081509+0000","last_fullsized":"2024-09-17T05:48:08.081509+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:48:05.973792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:48:05.973792+0000","last_clean_scrub_stamp":"2024-09-17T05:48:05.973792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:48:56.457803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.36","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-17T05:48:08.081583+0000","last_change":"2024-09-17T05:48:07.006474+0000","last_active":"2024-09-17T05:48:08.081583+0000","last_peered":"2024-09-17T05:48:08.081583+0000","last_clean":"2024-09-17T05:48:08.081583+0000","last_became_active":"2024-09-17T05:48:07.006080+0000","last_became_peered":"2024-09-17T05:48:07.006080+0000","last_unstale":"2024-09-17T05:48:08.081583+0000","last_undegraded":"2024-09-17T05:48:08.081583+0000","last_fullsized":"2024-09-17T05:48:08.081583+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:48:05.973792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:48:05.973792+0000","last_clean_scrub_stamp":"2024-09-17T05:48:05.973792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:00:21.372467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.35","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-17T05:48:08.015926+0000","last_change":"2024-09-17T05:48:07.007493+0000","last_active":"2024-09-17T05:48:08.015926+0000","last_peered":"2024-09-17T05:48:08.015926+0000","last_clean":"2024-09-17T05:48:08.015926+0000","last_became_active":"2024-09-17T05:48:07.007110+0000","last_became_peered":"2024-09-17T05:48:07.007110+0000","last_unstale":"2024-09-17T05:48:08.015926+0000","last_undegraded":"2024-09-17T05:48:08.015926+0000","last_fullsized":"2024-09-17T05:48:08.015926+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:48:05.973792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:48:05.973792+0000","last_clean_scrub_stamp":"2024-09-17T05:48:05.973792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:44:47.691663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.34","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-17T05:48:08.081148+0000","last_change":"2024-09-17T05:48:07.010311+0000","last_active":"2024-09-17T05:48:08.081148+0000","last_peered":"2024-09-17T05:48:08.081148+0000","last_clean":"2024-09-17T05:48:08.081148+0000","last_became_active":"2024-09-17T05:48:07.008909+0000","last_became_peered":"2024-09-17T05:48:07.008909+0000","last_unstale":"2024-09-17T05:48:08.081148+0000","last_undegraded":"2024-09-17T05:48:08.081148+0000","last_fullsized":"2024-09-17T05:48:08.081148+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:48:05.973792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:48:05.973792+0000","last_clean_scrub_stamp":"2024-09-17T05:48:05.973792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:47:57.574763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.33","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-17T05:48:07.994124+0000","last_change":"2024-09-17T05:48:07.006185+0000","last_active":"2024-09-17T05:48:07.994124+0000","last_peered":"2024-09-17T05:48:07.994124+0000","last_clean":"2024-09-17T05:48:07.994124+0000","last_became_active":"2024-09-17T05:48:07.005656+0000","last_became_peered":"2024-09-17T05:48:07.005656+0000","last_unstale":"2024-09-17T05:48:07.994124+0000","last_undegraded":"2024-09-17T05:48:07.994124+0000","last_fullsized":"2024-09-17T05:48:07.994124+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:48:05.973792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:48:05.973792+0000","last_clean_scrub_stamp":"2024-09-17T05:48:05.973792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:40:53.536640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.32","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-17T05:48:08.080621+0000","last_change":"2024-09-17T05:48:06.999966+0000","last_active":"2024-09-17T05:48:08.080621+0000","last_peered":"2024-09-17T05:48:08.080621+0000","last_clean":"2024-09-17T05:48:08.080621+0000","last_became_active":"2024-09-17T05:48:06.999522+0000","last_became_peered":"2024-09-17T05:48:06.999522+0000","last_unstale":"2024-09-17T05:48:08.080621+0000","last_undegraded":"2024-09-17T05:48:08.080621+0000","last_fullsized":"2024-09-17T05:48:08.080621+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:48:05.973792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:48:05.973792+0000","last_clean_scrub_stamp":"2024-09-17T05:48:05.973792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:28:37.324020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.31","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-17T05:48:07.992381+0000","last_change":"2024-09-17T05:48:07.006783+0000","last_active":"2024-09-17T05:48:07.992381+0000","last_peered":"2024-09-17T05:48:07.992381+0000","last_clean":"2024-09-17T05:48:07.992381+0000","last_became_active":"2024-09-17T05:48:07.006179+0000","last_became_peered":"2024-09-17T05:48:07.006179+0000","last_unstale":"2024-09-17T05:48:07.992381+0000","last_undegraded":"2024-09-17T05:48:07.992381+0000","last_fullsized":"2024-09-17T05:48:07.992381+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:48:05.973792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:48:05.973792+0000","last_clean_scrub_stamp":"2024-09-17T05:48:05.973792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:25:00.288646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.30","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-17T05:48:07.993879+0000","last_change":"2024-09-17T05:48:07.013701+0000","last_active":"2024-09-17T05:48:07.993879+0000","last_peered":"2024-09-17T05:48:07.993879+0000","last_clean":"2024-09-17T05:48:07.993879+0000","last_became_active":"2024-09-17T05:48:07.013327+0000","last_became_peered":"2024-09-17T05:48:07.013327+0000","last_unstale":"2024-09-17T05:48:07.993879+0000","last_undegraded":"2024-09-17T05:48:07.993879+0000","last_fullsized":"2024-09-17T05:48:07.993879+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:48:05.973792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:48:05.973792+0000","last_clean_scrub_stamp":"2024-09-17T05:48:05.973792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:39:47.270426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.2f","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-17T05:48:07.994509+0000","last_change":"2024-09-17T05:48:07.000900+0000","last_active":"2024-09-17T05:48:07.994509+0000","last_peered":"2024-09-17T05:48:07.994509+0000","last_clean":"2024-09-17T05:48:07.994509+0000","last_became_active":"2024-09-17T05:48:07.000471+0000","last_became_peered":"2024-09-17T05:48:07.000471+0000","last_unstale":"2024-09-17T05:48:07.994509+0000","last_undegraded":"2024-09-17T05:48:07.994509+0000","last_fullsized":"2024-09-17T05:48:07.994509+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:48:05.973792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:48:05.973792+0000","last_clean_scrub_stamp":"2024-09-17T05:48:05.973792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:12:45.100025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.2e","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-17T05:48:08.080680+0000","last_change":"2024-09-17T05:48:07.012645+0000","last_active":"2024-09-17T05:48:08.080680+0000","last_peered":"2024-09-17T05:48:08.080680+0000","last_clean":"2024-09-17T05:48:08.080680+0000","last_became_active":"2024-09-17T05:48:07.012337+0000","last_became_peered":"2024-09-17T05:48:07.012337+0000","last_unstale":"2024-09-17T05:48:08.080680+0000","last_undegraded":"2024-09-17T05:48:08.080680+0000","last_fullsized":"2024-09-17T05:48:08.080680+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:48:05.973792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:48:05.973792+0000","last_clean_scrub_stamp":"2024-09-17T05:48:05.973792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:46:29.554982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2d","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-17T05:48:08.017801+0000","last_change":"2024-09-17T05:48:07.003509+0000","last_active":"2024-09-17T05:48:08.017801+0000","last_peered":"2024-09-17T05:48:08.017801+0000","last_clean":"2024-09-17T05:48:08.017801+0000","last_became_active":"2024-09-17T05:48:07.003226+0000","last_became_peered":"2024-09-17T05:48:07.003226+0000","last_unstale":"2024-09-17T05:48:08.017801+0000","last_undegraded":"2024-09-17T05:48:08.017801+0000","last_fullsized":"2024-09-17T05:48:08.017801+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:48:05.973792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:48:05.973792+0000","last_clean_scrub_stamp":"2024-09-17T05:48:05.973792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:30:08.358108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.2c","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-17T05:48:08.080834+0000","last_change":"2024-09-17T05:48:07.010456+0000","last_active":"2024-09-17T05:48:08.080834+0000","last_peered":"2024-09-17T05:48:08.080834+0000","last_clean":"2024-09-17T05:48:08.080834+0000","last_became_active":"2024-09-17T05:48:07.010136+0000","last_became_peered":"2024-09-17T05:48:07.010136+0000","last_unstale":"2024-09-17T05:48:08.080834+0000","last_undegraded":"2024-09-17T05:48:08.080834+0000","last_fullsized":"2024-09-17T05:48:08.080834+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:48:05.973792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:48:05.973792+0000","last_clean_scrub_stamp":"2024-09-17T05:48:05.973792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:55:03.368792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2b","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-17T05:48:08.080400+0000","last_change":"2024-09-17T05:48:07.011524+0000","last_active":"2024-09-17T05:48:08.080400+0000","last_peered":"2024-09-17T05:48:08.080400+0000","last_clean":"2024-09-17T05:48:08.080400+0000","last_became_active":"2024-09-17T05:48:07.011186+0000","last_became_peered":"2024-09-17T05:48:07.011186+0000","last_unstale":"2024-09-17T05:48:08.080400+0000","last_undegraded":"2024-09-17T05:48:08.080400+0000","last_fullsized":"2024-09-17T05:48:08.080400+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:48:05.973792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:48:05.973792+0000","last_clean_scrub_stamp":"2024-09-17T05:48:05.973792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:02:13.694429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2a","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-17T05:48:08.015427+0000","last_change":"2024-09-17T05:48:07.011513+0000","last_active":"2024-09-17T05:48:08.015427+0000","last_peered":"2024-09-17T05:48:08.015427+0000","last_clean":"2024-09-17T05:48:08.015427+0000","last_became_active":"2024-09-17T05:48:07.011207+0000","last_became_peered":"2024-09-17T05:48:07.011207+0000","last_unstale":"2024-09-17T05:48:08.015427+0000","last_undegraded":"2024-09-17T05:48:08.015427+0000","last_fullsized":"2024-09-17T05:48:08.015427+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:48:05.973792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:48:05.973792+0000","last_clean_scrub_stamp":"2024-09-17T05:48:05.973792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:42:36.777998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.29","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-17T05:48:08.081075+0000","last_change":"2024-09-17T05:48:07.016145+0000","last_active":"2024-09-17T05:48:08.081075+0000","last_peered":"2024-09-17T05:48:08.081075+0000","last_clean":"2024-09-17T05:48:08.081075+0000","last_became_active":"2024-09-17T05:48:07.015802+0000","last_became_peered":"2024-09-17T05:48:07.015802+0000","last_unstale":"2024-09-17T05:48:08.081075+0000","last_undegraded":"2024-09-17T05:48:08.081075+0000","last_fullsized":"2024-09-17T05:48:08.081075+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:48:05.973792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:48:05.973792+0000","last_clean_scrub_stamp":"2024-09-17T05:48:05.973792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:54:56.625429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.28","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-17T05:48:08.080268+0000","last_change":"2024-09-17T05:48:07.010500+0000","last_active":"2024-09-17T05:48:08.080268+0000","last_peered":"2024-09-17T05:48:08.080268+0000","last_clean":"2024-09-17T05:48:08.080268+0000","last_became_active":"2024-09-17T05:48:07.010182+0000","last_became_peered":"2024-09-17T05:48:07.010182+0000","last_unstale":"2024-09-17T05:48:08.080268+0000","last_undegraded":"2024-09-17T05:48:08.080268+0000","last_fullsized":"2024-09-17T05:48:08.080268+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:48:05.973792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:48:05.973792+0000","last_clean_scrub_stamp":"2024-09-17T05:48:05.973792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:01:13.554049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.27","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-17T05:48:08.015574+0000","last_change":"2024-09-17T05:48:07.004954+0000","last_active":"2024-09-17T05:48:08.015574+0000","last_peered":"2024-09-17T05:48:08.015574+0000","last_clean":"2024-09-17T05:48:08.015574+0000","last_became_active":"2024-09-17T05:48:07.004656+0000","last_became_peered":"2024-09-17T05:48:07.004656+0000","last_unstale":"2024-09-17T05:48:08.015574+0000","last_undegraded":"2024-09-17T05:48:08.015574+0000","last_fullsized":"2024-09-17T05:48:08.015574+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:48:05.973792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:48:05.973792+0000","last_clean_scrub_stamp":"2024-09-17T05:48:05.973792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:23:08.128226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.26","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-17T05:48:07.994830+0000","last_change":"2024-09-17T05:48:07.003007+0000","last_active":"2024-09-17T05:48:07.994830+0000","last_peered":"2024-09-17T05:48:07.994830+0000","last_clean":"2024-09-17T05:48:07.994830+0000","last_became_active":"2024-09-17T05:48:07.002528+0000","last_became_peered":"2024-09-17T05:48:07.002528+0000","last_unstale":"2024-09-17T05:48:07.994830+0000","last_undegraded":"2024-09-17T05:48:07.994830+0000","last_fullsized":"2024-09-17T05:48:07.994830+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:48:05.973792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:48:05.973792+0000","last_clean_scrub_stamp":"2024-09-17T05:48:05.973792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:58:03.900303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.25","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-17T05:48:07.994073+0000","last_change":"2024-09-17T05:48:07.004124+0000","last_active":"2024-09-17T05:48:07.994073+0000","last_peered":"2024-09-17T05:48:07.994073+0000","last_clean":"2024-09-17T05:48:07.994073+0000","last_became_active":"2024-09-17T05:48:07.003814+0000","last_became_peered":"2024-09-17T05:48:07.003814+0000","last_unstale":"2024-09-17T05:48:07.994073+0000","last_undegraded":"2024-09-17T05:48:07.994073+0000","last_fullsized":"2024-09-17T05:48:07.994073+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:48:05.973792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:48:05.973792+0000","last_clean_scrub_stamp":"2024-09-17T05:48:05.973792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:42:49.345461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.24","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-17T05:48:08.081398+0000","last_change":"2024-09-17T05:48:07.021372+0000","last_active":"2024-09-17T05:48:08.081398+0000","last_peered":"2024-09-17T05:48:08.081398+0000","last_clean":"2024-09-17T05:48:08.081398+0000","last_became_active":"2024-09-17T05:48:07.019410+0000","last_became_peered":"2024-09-17T05:48:07.019410+0000","last_unstale":"2024-09-17T05:48:08.081398+0000","last_undegraded":"2024-09-17T05:48:08.081398+0000","last_fullsized":"2024-09-17T05:48:08.081398+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:48:05.973792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:48:05.973792+0000","last_clean_scrub_stamp":"2024-09-17T05:48:05.973792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:37:26.176973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.23","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-17T05:48:08.015501+0000","last_change":"2024-09-17T05:48:07.002555+0000","last_active":"2024-09-17T05:48:08.015501+0000","last_peered":"2024-09-17T05:48:08.015501+0000","last_clean":"2024-09-17T05:48:08.015501+0000","last_became_active":"2024-09-17T05:48:07.002263+0000","last_became_peered":"2024-09-17T05:48:07.002263+0000","last_unstale":"2024-09-17T05:48:08.015501+0000","last_undegraded":"2024-09-17T05:48:08.015501+0000","last_fullsized":"2024-09-17T05:48:08.015501+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:48:05.973792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:48:05.973792+0000","last_clean_scrub_stamp":"2024-09-17T05:48:05.973792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:11:05.173569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.22","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-17T05:48:08.015454+0000","last_change":"2024-09-17T05:48:07.003556+0000","last_active":"2024-09-17T05:48:08.015454+0000","last_peered":"2024-09-17T05:48:08.015454+0000","last_clean":"2024-09-17T05:48:08.015454+0000","last_became_active":"2024-09-17T05:48:07.003232+0000","last_became_peered":"2024-09-17T05:48:07.003232+0000","last_unstale":"2024-09-17T05:48:08.015454+0000","last_undegraded":"2024-09-17T05:48:08.015454+0000","last_fullsized":"2024-09-17T05:48:08.015454+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:48:05.973792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:48:05.973792+0000","last_clean_scrub_stamp":"2024-09-17T05:48:05.973792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:58:23.252429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.21","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-17T05:48:07.995159+0000","last_change":"2024-09-17T05:48:07.014828+0000","last_active":"2024-09-17T05:48:07.995159+0000","last_peered":"2024-09-17T05:48:07.995159+0000","last_clean":"2024-09-17T05:48:07.995159+0000","last_became_active":"2024-09-17T05:48:07.014101+0000","last_became_peered":"2024-09-17T05:48:07.014101+0000","last_unstale":"2024-09-17T05:48:07.995159+0000","last_undegraded":"2024-09-17T05:48:07.995159+0000","last_fullsized":"2024-09-17T05:48:07.995159+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:48:05.973792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:48:05.973792+0000","last_clean_scrub_stamp":"2024-09-17T05:48:05.973792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:23:01.190816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.20","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-17T05:48:08.080986+0000","last_change":"2024-09-17T05:48:07.009478+0000","last_active":"2024-09-17T05:48:08.080986+0000","last_peered":"2024-09-17T05:48:08.080986+0000","last_clean":"2024-09-17T05:48:08.080986+0000","last_became_active":"2024-09-17T05:48:07.009198+0000","last_became_peered":"2024-09-17T05:48:07.009198+0000","last_unstale":"2024-09-17T05:48:08.080986+0000","last_undegraded":"2024-09-17T05:48:08.080986+0000","last_fullsized":"2024-09-17T05:48:08.080986+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:48:05.973792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:48:05.973792+0000","last_clean_scrub_stamp":"2024-09-17T05:48:05.973792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:04:31.213345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1e","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-17T05:48:07.994873+0000","last_change":"2024-09-17T05:48:07.017685+0000","last_active":"2024-09-17T05:48:07.994873+0000","last_peered":"2024-09-17T05:48:07.994873+0000","last_clean":"2024-09-17T05:48:07.994873+0000","last_became_active":"2024-09-17T05:48:07.015300+0000","last_became_peered":"2024-09-17T05:48:07.015300+0000","last_unstale":"2024-09-17T05:48:07.994873+0000","last_undegraded":"2024-09-17T05:48:07.994873+0000","last_fullsized":"2024-09-17T05:48:07.994873+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:48:05.973792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:48:05.973792+0000","last_clean_scrub_stamp":"2024-09-17T05:48:05.973792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:53:38.696415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1f","version":"85'4","reported_seq":19,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-17T05:48:08.082224+0000","last_change":"2024-09-17T05:48:05.997338+0000","last_active":"2024-09-17T05:48:08.082224+0000","last_peered":"2024-09-17T05:48:08.082224+0000","last_clean":"2024-09-17T05:48:08.082224+0000","last_became_active":"2024-09-17T05:48:05.996975+0000","last_became_peered":"2024-09-17T05:48:05.996975+0000","last_unstale":"2024-09-17T05:48:08.082224+0000","last_undegraded":"2024-09-17T05:48:08.082224+0000","last_fullsized":"2024-09-17T05:48:08.082224+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:48:04.965082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:48:04.965082+0000","last_clean_scrub_stamp":"2024-09-17T05:48:04.965082+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:18:51.809325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1f","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-17T05:48:08.082016+0000","last_change":"2024-09-17T05:48:07.013038+0000","last_active":"2024-09-17T05:48:08.082016+0000","last_peered":"2024-09-17T05:48:08.082016+0000","last_clean":"2024-09-17T05:48:08.082016+0000","last_became_active":"2024-09-17T05:48:07.012730+0000","last_became_peered":"2024-09-17T05:48:07.012730+0000","last_unstale":"2024-09-17T05:48:08.082016+0000","last_undegraded":"2024-09-17T05:48:08.082016+0000","last_fullsized":"2024-09-17T05:48:08.082016+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:48:05.973792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:48:05.973792+0000","last_clean_scrub_stamp":"2024-09-17T05:48:05.973792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:19:03.613541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.1e","version":"85'1","reported_seq":16,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-17T05:48:07.995523+0000","last_change":"2024-09-17T05:48:05.995823+0000","last_active":"2024-09-17T05:48:07.995523+0000","last_peered":"2024-09-17T05:48:07.995523+0000","last_clean":"2024-09-17T05:48:07.995523+0000","last_became_active":"2024-09-17T05:48:05.995488+0000","last_became_peered":"2024-09-17T05:48:05.995488+0000","last_unstale":"2024-09-17T05:48:07.995523+0000","last_undegraded":"2024-09-17T05:48:07.995523+0000","last_fullsized":"2024-09-17T05:48:07.995523+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:48:04.965082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:48:04.965082+0000","last_clean_scrub_stamp":"2024-09-17T05:48:04.965082+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:28:16.837939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.1c","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-17T05:48:08.081581+0000","last_change":"2024-09-17T05:48:07.011380+0000","last_active":"2024-09-17T05:48:08.081581+0000","last_peered":"2024-09-17T05:48:08.081581+0000","last_clean":"2024-09-17T05:48:08.081581+0000","last_became_active":"2024-09-17T05:48:07.011078+0000","last_became_peered":"2024-09-17T05:48:07.011078+0000","last_unstale":"2024-09-17T05:48:08.081581+0000","last_undegraded":"2024-09-17T05:48:08.081581+0000","last_fullsized":"2024-09-17T05:48:08.081581+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:48:05.973792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:48:05.973792+0000","last_clean_scrub_stamp":"2024-09-17T05:48:05.973792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:01:36.231844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.1d","version":"85'2","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-17T05:48:08.017837+0000","last_change":"2024-09-17T05:48:05.995146+0000","last_active":"2024-09-17T05:48:08.017837+0000","last_peered":"2024-09-17T05:48:08.017837+0000","last_clean":"2024-09-17T05:48:08.017837+0000","last_became_active":"2024-09-17T05:48:05.994843+0000","last_became_peered":"2024-09-17T05:48:05.994843+0000","last_unstale":"2024-09-17T05:48:08.017837+0000","last_undegraded":"2024-09-17T05:48:08.017837+0000","last_fullsized":"2024-09-17T05:48:08.017837+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:48:04.965082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:48:04.965082+0000","last_clean_scrub_stamp":"2024-09-17T05:48:04.965082+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:08:12.896308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1d","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-17T05:48:07.995030+0000","last_change":"2024-09-17T05:48:07.012084+0000","last_active":"2024-09-17T05:48:07.995030+0000","last_peered":"2024-09-17T05:48:07.995030+0000","last_clean":"2024-09-17T05:48:07.995030+0000","last_became_active":"2024-09-17T05:48:07.011773+0000","last_became_peered":"2024-09-17T05:48:07.011773+0000","last_unstale":"2024-09-17T05:48:07.995030+0000","last_undegraded":"2024-09-17T05:48:07.995030+0000","last_fullsized":"2024-09-17T05:48:07.995030+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:48:05.973792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:48:05.973792+0000","last_clean_scrub_stamp":"2024-09-17T05:48:05.973792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:01:47.507164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1c","version":"85'2","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-17T05:48:08.017546+0000","last_change":"2024-09-17T05:48:05.996138+0000","last_active":"2024-09-17T05:48:08.017546+0000","last_peered":"2024-09-17T05:48:08.017546+0000","last_clean":"2024-09-17T05:48:08.017546+0000","last_became_active":"2024-09-17T05:48:05.995742+0000","last_became_peered":"2024-09-17T05:48:05.995742+0000","last_unstale":"2024-09-17T05:48:08.017546+0000","last_undegraded":"2024-09-17T05:48:08.017546+0000","last_fullsized":"2024-09-17T05:48:08.017546+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:48:04.965082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:48:04.965082+0000","last_clean_scrub_stamp":"2024-09-17T05:48:04.965082+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:07:07.086219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1a","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-17T05:48:08.016180+0000","last_change":"2024-09-17T05:48:07.003430+0000","last_active":"2024-09-17T05:48:08.016180+0000","last_peered":"2024-09-17T05:48:08.016180+0000","last_clean":"2024-09-17T05:48:08.016180+0000","last_became_active":"2024-09-17T05:48:07.002894+0000","last_became_peered":"2024-09-17T05:48:07.002894+0000","last_unstale":"2024-09-17T05:48:08.016180+0000","last_undegraded":"2024-09-17T05:48:08.016180+0000","last_fullsized":"2024-09-17T05:48:08.016180+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:48:05.973792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:48:05.973792+0000","last_clean_scrub_stamp":"2024-09-17T05:48:05.973792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:09:47.202358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.1b","version":"85'1","reported_seq":16,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-17T05:48:07.995983+0000","last_change":"2024-09-17T05:48:06.000106+0000","last_active":"2024-09-17T05:48:07.995983+0000","last_peered":"2024-09-17T05:48:07.995983+0000","last_clean":"2024-09-17T05:48:07.995983+0000","last_became_active":"2024-09-17T05:48:05.999798+0000","last_became_peered":"2024-09-17T05:48:05.999798+0000","last_unstale":"2024-09-17T05:48:07.995983+0000","last_undegraded":"2024-09-17T05:48:07.995983+0000","last_fullsized":"2024-09-17T05:48:07.995983+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:48:04.965082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:48:04.965082+0000","last_clean_scrub_stamp":"2024-09-17T05:48:04.965082+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:36:52.252850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.1b","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-17T05:48:07.995841+0000","last_change":"2024-09-17T05:48:07.001170+0000","last_active":"2024-09-17T05:48:07.995841+0000","last_peered":"2024-09-17T05:48:07.995841+0000","last_clean":"2024-09-17T05:48:07.995841+0000","last_became_active":"2024-09-17T05:48:07.000287+0000","last_became_peered":"2024-09-17T05:48:07.000287+0000","last_unstale":"2024-09-17T05:48:07.995841+0000","last_undegraded":"2024-09-17T05:48:07.995841+0000","last_fullsized":"2024-09-17T05:48:07.995841+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:48:05.973792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:48:05.973792+0000","last_clean_scrub_stamp":"2024-09-17T05:48:05.973792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:59:40.040843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1a","version":"85'1","reported_seq":16,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-17T05:48:07.995458+0000","last_change":"2024-09-17T05:48:05.996177+0000","last_active":"2024-09-17T05:48:07.995458+0000","last_peered":"2024-09-17T05:48:07.995458+0000","last_clean":"2024-09-17T05:48:07.995458+0000","last_became_active":"2024-09-17T05:48:05.995803+0000","last_became_peered":"2024-09-17T05:48:05.995803+0000","last_unstale":"2024-09-17T05:48:07.995458+0000","last_undegraded":"2024-09-17T05:48:07.995458+0000","last_fullsized":"2024-09-17T05:48:07.995458+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:48:04.965082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:48:04.965082+0000","last_clean_scrub_stamp":"2024-09-17T05:48:04.965082+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:41:49.962234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.18","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-17T05:48:07.993852+0000","last_change":"2024-09-17T05:48:07.015514+0000","last_active":"2024-09-17T05:48:07.993852+0000","last_peered":"2024-09-17T05:48:07.993852+0000","last_clean":"2024-09-17T05:48:07.993852+0000","last_became_active":"2024-09-17T05:48:07.015185+0000","last_became_peered":"2024-09-17T05:48:07.015185+0000","last_unstale":"2024-09-17T05:48:07.993852+0000","last_undegraded":"2024-09-17T05:48:07.993852+0000","last_fullsized":"2024-09-17T05:48:07.993852+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:48:05.973792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:48:05.973792+0000","last_clean_scrub_stamp":"2024-09-17T05:48:05.973792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:01:24.000485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.19","version":"0'0","reported_seq":15,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-17T05:48:08.017351+0000","last_change":"2024-09-17T05:48:05.994519+0000","last_active":"2024-09-17T05:48:08.017351+0000","last_peered":"2024-09-17T05:48:08.017351+0000","last_clean":"2024-09-17T05:48:08.017351+0000","last_became_active":"2024-09-17T05:48:05.994089+0000","last_became_peered":"2024-09-17T05:48:05.994089+0000","last_unstale":"2024-09-17T05:48:08.017351+0000","last_undegraded":"2024-09-17T05:48:08.017351+0000","last_fullsized":"2024-09-17T05:48:08.017351+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:48:04.965082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:48:04.965082+0000","last_clean_scrub_stamp":"2024-09-17T05:48:04.965082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:10:49.729836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.19","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-17T05:48:07.992452+0000","last_change":"2024-09-17T05:48:07.006952+0000","last_active":"2024-09-17T05:48:07.992452+0000","last_peered":"2024-09-17T05:48:07.992452+0000","last_clean":"2024-09-17T05:48:07.992452+0000","last_became_active":"2024-09-17T05:48:07.006627+0000","last_became_peered":"2024-09-17T05:48:07.006627+0000","last_unstale":"2024-09-17T05:48:07.992452+0000","last_undegraded":"2024-09-17T05:48:07.992452+0000","last_fullsized":"2024-09-17T05:48:07.992452+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:48:05.973792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:48:05.973792+0000","last_clean_scrub_stamp":"2024-09-17T05:48:05.973792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:58:03.900303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.18","version":"0'0","reported_seq":15,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-17T05:48:08.015872+0000","last_change":"2024-09-17T05:48:05.999386+0000","last_active":"2024-09-17T05:48:08.015872+0000","last_peered":"2024-09-17T05:48:08.015872+0000","last_clean":"2024-09-17T05:48:08.015872+0000","last_became_active":"2024-09-17T05:48:05.999075+0000","last_became_peered":"2024-09-17T05:48:05.999075+0000","last_unstale":"2024-09-17T05:48:08.015872+0000","last_undegraded":"2024-09-17T05:48:08.015872+0000","last_fullsized":"2024-09-17T05:48:08.015872+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:48:04.965082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:48:04.965082+0000","last_clean_scrub_stamp":"2024-09-17T05:48:04.965082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:02:12.685719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.16","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-17T05:48:07.992799+0000","last_change":"2024-09-17T05:48:07.004229+0000","last_active":"2024-09-17T05:48:07.992799+0000","last_peered":"2024-09-17T05:48:07.992799+0000","last_clean":"2024-09-17T05:48:07.992799+0000","last_became_active":"2024-09-17T05:48:07.003931+0000","last_became_peered":"2024-09-17T05:48:07.003931+0000","last_unstale":"2024-09-17T05:48:07.992799+0000","last_undegraded":"2024-09-17T05:48:07.992799+0000","last_fullsized":"2024-09-17T05:48:07.992799+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:48:05.973792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:48:05.973792+0000","last_clean_scrub_stamp":"2024-09-17T05:48:05.973792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:26:13.408609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.17","version":"0'0","reported_seq":15,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-17T05:48:08.082317+0000","last_change":"2024-09-17T05:48:05.994108+0000","last_active":"2024-09-17T05:48:08.082317+0000","last_peered":"2024-09-17T05:48:08.082317+0000","last_clean":"2024-09-17T05:48:08.082317+0000","last_became_active":"2024-09-17T05:48:05.993676+0000","last_became_peered":"2024-09-17T05:48:05.993676+0000","last_unstale":"2024-09-17T05:48:08.082317+0000","last_undegraded":"2024-09-17T05:48:08.082317+0000","last_fullsized":"2024-09-17T05:48:08.082317+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:48:04.965082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:48:04.965082+0000","last_clean_scrub_stamp":"2024-09-17T05:48:04.965082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:36:21.212798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.17","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-17T05:48:08.081975+0000","last_change":"2024-09-17T05:48:07.010638+0000","last_active":"2024-09-17T05:48:08.081975+0000","last_peered":"2024-09-17T05:48:08.081975+0000","last_clean":"2024-09-17T05:48:08.081975+0000","last_became_active":"2024-09-17T05:48:07.010323+0000","last_became_peered":"2024-09-17T05:48:07.010323+0000","last_unstale":"2024-09-17T05:48:08.081975+0000","last_undegraded":"2024-09-17T05:48:08.081975+0000","last_fullsized":"2024-09-17T05:48:08.081975+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:48:05.973792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:48:05.973792+0000","last_clean_scrub_stamp":"2024-09-17T05:48:05.973792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:05:52.670665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.16","version":"0'0","reported_seq":15,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-17T05:48:08.081663+0000","last_change":"2024-09-17T05:48:05.998132+0000","last_active":"2024-09-17T05:48:08.081663+0000","last_peered":"2024-09-17T05:48:08.081663+0000","last_clean":"2024-09-17T05:48:08.081663+0000","last_became_active":"2024-09-17T05:48:05.997479+0000","last_became_peered":"2024-09-17T05:48:05.997479+0000","last_unstale":"2024-09-17T05:48:08.081663+0000","last_undegraded":"2024-09-17T05:48:08.081663+0000","last_fullsized":"2024-09-17T05:48:08.081663+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:48:04.965082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:48:04.965082+0000","last_clean_scrub_stamp":"2024-09-17T05:48:04.965082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:30:29.544066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.14","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-17T05:48:08.017612+0000","last_change":"2024-09-17T05:48:07.010434+0000","last_active":"2024-09-17T05:48:08.017612+0000","last_peered":"2024-09-17T05:48:08.017612+0000","last_clean":"2024-09-17T05:48:08.017612+0000","last_became_active":"2024-09-17T05:48:07.009605+0000","last_became_peered":"2024-09-17T05:48:07.009605+0000","last_unstale":"2024-09-17T05:48:08.017612+0000","last_undegraded":"2024-09-17T05:48:08.017612+0000","last_fullsized":"2024-09-17T05:48:08.017612+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:48:05.973792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:48:05.973792+0000","last_clean_scrub_stamp":"2024-09-17T05:48:05.973792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:46:18.050983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.15","version":"85'3","reported_seq":18,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-17T05:48:08.081231+0000","last_change":"2024-09-17T05:48:05.999363+0000","last_active":"2024-09-17T05:48:08.081231+0000","last_peered":"2024-09-17T05:48:08.081231+0000","last_clean":"2024-09-17T05:48:08.081231+0000","last_became_active":"2024-09-17T05:48:05.998976+0000","last_became_peered":"2024-09-17T05:48:05.998976+0000","last_unstale":"2024-09-17T05:48:08.081231+0000","last_undegraded":"2024-09-17T05:48:08.081231+0000","last_fullsized":"2024-09-17T05:48:08.081231+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:48:04.965082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:48:04.965082+0000","last_clean_scrub_stamp":"2024-09-17T05:48:04.965082+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:03:18.092299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.15","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-17T05:48:07.994799+0000","last_change":"2024-09-17T05:48:07.011388+0000","last_active":"2024-09-17T05:48:07.994799+0000","last_peered":"2024-09-17T05:48:07.994799+0000","last_clean":"2024-09-17T05:48:07.994799+0000","last_became_active":"2024-09-17T05:48:07.011120+0000","last_became_peered":"2024-09-17T05:48:07.011120+0000","last_unstale":"2024-09-17T05:48:07.994799+0000","last_undegraded":"2024-09-17T05:48:07.994799+0000","last_fullsized":"2024-09-17T05:48:07.994799+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:48:05.973792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:48:05.973792+0000","last_clean_scrub_stamp":"2024-09-17T05:48:05.973792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:23:12.785407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.14","version":"85'6","reported_seq":21,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-17T05:48:08.081737+0000","last_change":"2024-09-17T05:48:05.997721+0000","last_active":"2024-09-17T05:48:08.081737+0000","last_peered":"2024-09-17T05:48:08.081737+0000","last_clean":"2024-09-17T05:48:08.081737+0000","last_became_active":"2024-09-17T05:48:05.997375+0000","last_became_peered":"2024-09-17T05:48:05.997375+0000","last_unstale":"2024-09-17T05:48:08.081737+0000","last_undegraded":"2024-09-17T05:48:08.081737+0000","last_fullsized":"2024-09-17T05:48:08.081737+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:48:04.965082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:48:04.965082+0000","last_clean_scrub_stamp":"2024-09-17T05:48:04.965082+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:53:04.521212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.12","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-17T05:48:08.017527+0000","last_change":"2024-09-17T05:48:07.014653+0000","last_active":"2024-09-17T05:48:08.017527+0000","last_peered":"2024-09-17T05:48:08.017527+0000","last_clean":"2024-09-17T05:48:08.017527+0000","last_became_active":"2024-09-17T05:48:07.014227+0000","last_became_peered":"2024-09-17T05:48:07.014227+0000","last_unstale":"2024-09-17T05:48:08.017527+0000","last_undegraded":"2024-09-17T05:48:08.017527+0000","last_fullsized":"2024-09-17T05:48:08.017527+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:48:05.973792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:48:05.973792+0000","last_clean_scrub_stamp":"2024-09-17T05:48:05.973792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:47:25.975838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.13","version":"85'2","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-17T05:48:08.015708+0000","last_change":"2024-09-17T05:48:05.998280+0000","last_active":"2024-09-17T05:48:08.015708+0000","last_peered":"2024-09-17T05:48:08.015708+0000","last_clean":"2024-09-17T05:48:08.015708+0000","last_became_active":"2024-09-17T05:48:05.998002+0000","last_became_peered":"2024-09-17T05:48:05.998002+0000","last_unstale":"2024-09-17T05:48:08.015708+0000","last_undegraded":"2024-09-17T05:48:08.015708+0000","last_fullsized":"2024-09-17T05:48:08.015708+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:48:04.965082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:48:04.965082+0000","last_clean_scrub_stamp":"2024-09-17T05:48:04.965082+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:47:24.665134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.13","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-17T05:48:07.994315+0000","last_change":"2024-09-17T05:48:07.011777+0000","last_active":"2024-09-17T05:48:07.994315+0000","last_peered":"2024-09-17T05:48:07.994315+0000","last_clean":"2024-09-17T05:48:07.994315+0000","last_became_active":"2024-09-17T05:48:07.011442+0000","last_became_peered":"2024-09-17T05:48:07.011442+0000","last_unstale":"2024-09-17T05:48:07.994315+0000","last_undegraded":"2024-09-17T05:48:07.994315+0000","last_fullsized":"2024-09-17T05:48:07.994315+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:48:05.973792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:48:05.973792+0000","last_clean_scrub_stamp":"2024-09-17T05:48:05.973792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:25:14.968274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.12","version":"0'0","reported_seq":15,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-17T05:48:07.992537+0000","last_change":"2024-09-17T05:48:05.992907+0000","last_active":"2024-09-17T05:48:07.992537+0000","last_peered":"2024-09-17T05:48:07.992537+0000","last_clean":"2024-09-17T05:48:07.992537+0000","last_became_active":"2024-09-17T05:48:05.992511+0000","last_became_peered":"2024-09-17T05:48:05.992511+0000","last_unstale":"2024-09-17T05:48:07.992537+0000","last_undegraded":"2024-09-17T05:48:07.992537+0000","last_fullsized":"2024-09-17T05:48:07.992537+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:48:04.965082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:48:04.965082+0000","last_clean_scrub_stamp":"2024-09-17T05:48:04.965082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:50:06.270397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.10","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-17T05:48:08.015422+0000","last_change":"2024-09-17T05:48:07.000184+0000","last_active":"2024-09-17T05:48:08.015422+0000","last_peered":"2024-09-17T05:48:08.015422+0000","last_clean":"2024-09-17T05:48:08.015422+0000","last_became_active":"2024-09-17T05:48:06.998794+0000","last_became_peered":"2024-09-17T05:48:06.998794+0000","last_unstale":"2024-09-17T05:48:08.015422+0000","last_undegraded":"2024-09-17T05:48:08.015422+0000","last_fullsized":"2024-09-17T05:48:08.015422+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:48:05.973792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:48:05.973792+0000","last_clean_scrub_stamp":"2024-09-17T05:48:05.973792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:00:21.113605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.11","version":"0'0","reported_seq":15,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-17T05:48:08.081057+0000","last_change":"2024-09-17T05:48:05.999329+0000","last_active":"2024-09-17T05:48:08.081057+0000","last_peered":"2024-09-17T05:48:08.081057+0000","last_clean":"2024-09-17T05:48:08.081057+0000","last_became_active":"2024-09-17T05:48:05.998937+0000","last_became_peered":"2024-09-17T05:48:05.998937+0000","last_unstale":"2024-09-17T05:48:08.081057+0000","last_undegraded":"2024-09-17T05:48:08.081057+0000","last_fullsized":"2024-09-17T05:48:08.081057+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:48:04.965082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:48:04.965082+0000","last_clean_scrub_stamp":"2024-09-17T05:48:04.965082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:14:26.841358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.11","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-17T05:48:08.015333+0000","last_change":"2024-09-17T05:48:07.004159+0000","last_active":"2024-09-17T05:48:08.015333+0000","last_peered":"2024-09-17T05:48:08.015333+0000","last_clean":"2024-09-17T05:48:08.015333+0000","last_became_active":"2024-09-17T05:48:07.003830+0000","last_became_peered":"2024-09-17T05:48:07.003830+0000","last_unstale":"2024-09-17T05:48:08.015333+0000","last_undegraded":"2024-09-17T05:48:08.015333+0000","last_fullsized":"2024-09-17T05:48:08.015333+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:48:05.973792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:48:05.973792+0000","last_clean_scrub_stamp":"2024-09-17T05:48:05.973792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:38:11.784803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.10","version":"85'8","reported_seq":23,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-17T05:48:08.017251+0000","last_change":"2024-09-17T05:48:05.994461+0000","last_active":"2024-09-17T05:48:08.017251+0000","last_peered":"2024-09-17T05:48:08.017251+0000","last_clean":"2024-09-17T05:48:08.017251+0000","last_became_active":"2024-09-17T05:48:05.994138+0000","last_became_peered":"2024-09-17T05:48:05.994138+0000","last_unstale":"2024-09-17T05:48:08.017251+0000","last_undegraded":"2024-09-17T05:48:08.017251+0000","last_fullsized":"2024-09-17T05:48:08.017251+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:48:04.965082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:48:04.965082+0000","last_clean_scrub_stamp":"2024-09-17T05:48:04.965082+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:49:16.263159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.e","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-17T05:48:07.994858+0000","last_change":"2024-09-17T05:48:07.007320+0000","last_active":"2024-09-17T05:48:07.994858+0000","last_peered":"2024-09-17T05:48:07.994858+0000","last_clean":"2024-09-17T05:48:07.994858+0000","last_became_active":"2024-09-17T05:48:07.006982+0000","last_became_peered":"2024-09-17T05:48:07.006982+0000","last_unstale":"2024-09-17T05:48:07.994858+0000","last_undegraded":"2024-09-17T05:48:07.994858+0000","last_fullsized":"2024-09-17T05:48:07.994858+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:48:05.973792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:48:05.973792+0000","last_clean_scrub_stamp":"2024-09-17T05:48:05.973792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:26:13.408609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.f","version":"85'1","reported_seq":16,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-17T05:48:08.082381+0000","last_change":"2024-09-17T05:48:05.993133+0000","last_active":"2024-09-17T05:48:08.082381+0000","last_peered":"2024-09-17T05:48:08.082381+0000","last_clean":"2024-09-17T05:48:08.082381+0000","last_became_active":"2024-09-17T05:48:05.992787+0000","last_became_peered":"2024-09-17T05:48:05.992787+0000","last_unstale":"2024-09-17T05:48:08.082381+0000","last_undegraded":"2024-09-17T05:48:08.082381+0000","last_fullsized":"2024-09-17T05:48:08.082381+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:48:04.965082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:48:04.965082+0000","last_clean_scrub_stamp":"2024-09-17T05:48:04.965082+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:44:05.587367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.f","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-17T05:48:08.082216+0000","last_change":"2024-09-17T05:48:07.009405+0000","last_active":"2024-09-17T05:48:08.082216+0000","last_peered":"2024-09-17T05:48:08.082216+0000","last_clean":"2024-09-17T05:48:08.082216+0000","last_became_active":"2024-09-17T05:48:07.009088+0000","last_became_peered":"2024-09-17T05:48:07.009088+0000","last_unstale":"2024-09-17T05:48:08.082216+0000","last_undegraded":"2024-09-17T05:48:08.082216+0000","last_fullsized":"2024-09-17T05:48:08.082216+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:48:05.973792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:48:05.973792+0000","last_clean_scrub_stamp":"2024-09-17T05:48:05.973792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:30:02.190214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.e","version":"85'2","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-17T05:48:08.017601+0000","last_change":"2024-09-17T05:48:05.995547+0000","last_active":"2024-09-17T05:48:08.017601+0000","last_peered":"2024-09-17T05:48:08.017601+0000","last_clean":"2024-09-17T05:48:08.017601+0000","last_became_active":"2024-09-17T05:48:05.995233+0000","last_became_peered":"2024-09-17T05:48:05.995233+0000","last_unstale":"2024-09-17T05:48:08.017601+0000","last_undegraded":"2024-09-17T05:48:08.017601+0000","last_fullsized":"2024-09-17T05:48:08.017601+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:48:04.965082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:48:04.965082+0000","last_clean_scrub_stamp":"2024-09-17T05:48:04.965082+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:45:54.436107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.d","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-17T05:48:07.995040+0000","last_change":"2024-09-17T05:48:07.009916+0000","last_active":"2024-09-17T05:48:07.995040+0000","last_peered":"2024-09-17T05:48:07.995040+0000","last_clean":"2024-09-17T05:48:07.995040+0000","last_became_active":"2024-09-17T05:48:07.009573+0000","last_became_peered":"2024-09-17T05:48:07.009573+0000","last_unstale":"2024-09-17T05:48:07.995040+0000","last_undegraded":"2024-09-17T05:48:07.995040+0000","last_fullsized":"2024-09-17T05:48:07.995040+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:48:05.973792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:48:05.973792+0000","last_clean_scrub_stamp":"2024-09-17T05:48:05.973792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:33:40.038791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.c","version":"0'0","reported_seq":15,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-17T05:48:08.017659+0000","last_change":"2024-09-17T05:48:05.993828+0000","last_active":"2024-09-17T05:48:08.017659+0000","last_peered":"2024-09-17T05:48:08.017659+0000","last_clean":"2024-09-17T05:48:08.017659+0000","last_became_active":"2024-09-17T05:48:05.992893+0000","last_became_peered":"2024-09-17T05:48:05.992893+0000","last_unstale":"2024-09-17T05:48:08.017659+0000","last_undegraded":"2024-09-17T05:48:08.017659+0000","last_fullsized":"2024-09-17T05:48:08.017659+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:48:04.965082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:48:04.965082+0000","last_clean_scrub_stamp":"2024-09-17T05:48:04.965082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:19:19.306307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.a","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-17T05:48:08.080690+0000","last_change":"2024-09-17T05:48:06.999976+0000","last_active":"2024-09-17T05:48:08.080690+0000","last_peered":"2024-09-17T05:48:08.080690+0000","last_clean":"2024-09-17T05:48:08.080690+0000","last_became_active":"2024-09-17T05:48:06.999669+0000","last_became_peered":"2024-09-17T05:48:06.999669+0000","last_unstale":"2024-09-17T05:48:08.080690+0000","last_undegraded":"2024-09-17T05:48:08.080690+0000","last_fullsized":"2024-09-17T05:48:08.080690+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:48:05.973792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:48:05.973792+0000","last_clean_scrub_stamp":"2024-09-17T05:48:05.973792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:16:11.075064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.b","version":"85'2","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-17T05:48:07.992538+0000","last_change":"2024-09-17T05:48:05.990062+0000","last_active":"2024-09-17T05:48:07.992538+0000","last_peered":"2024-09-17T05:48:07.992538+0000","last_clean":"2024-09-17T05:48:07.992538+0000","last_became_active":"2024-09-17T05:48:05.989770+0000","last_became_peered":"2024-09-17T05:48:05.989770+0000","last_unstale":"2024-09-17T05:48:07.992538+0000","last_undegraded":"2024-09-17T05:48:07.992538+0000","last_fullsized":"2024-09-17T05:48:07.992538+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:48:04.965082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:48:04.965082+0000","last_clean_scrub_stamp":"2024-09-17T05:48:04.965082+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:54:27.978918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.b","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-17T05:48:08.081494+0000","last_change":"2024-09-17T05:48:07.001464+0000","last_active":"2024-09-17T05:48:08.081494+0000","last_peered":"2024-09-17T05:48:08.081494+0000","last_clean":"2024-09-17T05:48:08.081494+0000","last_became_active":"2024-09-17T05:48:07.001114+0000","last_became_peered":"2024-09-17T05:48:07.001114+0000","last_unstale":"2024-09-17T05:48:08.081494+0000","last_undegraded":"2024-09-17T05:48:08.081494+0000","last_fullsized":"2024-09-17T05:48:08.081494+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:48:05.973792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:48:05.973792+0000","last_clean_scrub_stamp":"2024-09-17T05:48:05.973792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:25:58.038239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.a","version":"0'0","reported_seq":15,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-17T05:48:08.080781+0000","last_change":"2024-09-17T05:48:05.997773+0000","last_active":"2024-09-17T05:48:08.080781+0000","last_peered":"2024-09-17T05:48:08.080781+0000","last_clean":"2024-09-17T05:48:08.080781+0000","last_became_active":"2024-09-17T05:48:05.997035+0000","last_became_peered":"2024-09-17T05:48:05.997035+0000","last_unstale":"2024-09-17T05:48:08.080781+0000","last_undegraded":"2024-09-17T05:48:08.080781+0000","last_fullsized":"2024-09-17T05:48:08.080781+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:48:04.965082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:48:04.965082+0000","last_clean_scrub_stamp":"2024-09-17T05:48:04.965082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:12:13.405546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.8","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-17T05:48:08.080362+0000","last_change":"2024-09-17T05:48:07.004667+0000","last_active":"2024-09-17T05:48:08.080362+0000","last_peered":"2024-09-17T05:48:08.080362+0000","last_clean":"2024-09-17T05:48:08.080362+0000","last_became_active":"2024-09-17T05:48:07.002420+0000","last_became_peered":"2024-09-17T05:48:07.002420+0000","last_unstale":"2024-09-17T05:48:08.080362+0000","last_undegraded":"2024-09-17T05:48:08.080362+0000","last_fullsized":"2024-09-17T05:48:08.080362+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:48:05.973792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:48:05.973792+0000","last_clean_scrub_stamp":"2024-09-17T05:48:05.973792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:57:13.200472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.9","version":"0'0","reported_seq":15,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-17T05:48:08.080274+0000","last_change":"2024-09-17T05:48:05.999798+0000","last_active":"2024-09-17T05:48:08.080274+0000","last_peered":"2024-09-17T05:48:08.080274+0000","last_clean":"2024-09-17T05:48:08.080274+0000","last_became_active":"2024-09-17T05:48:05.999476+0000","last_became_peered":"2024-09-17T05:48:05.999476+0000","last_unstale":"2024-09-17T05:48:08.080274+0000","last_undegraded":"2024-09-17T05:48:08.080274+0000","last_fullsized":"2024-09-17T05:48:08.080274+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:48:04.965082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:48:04.965082+0000","last_clean_scrub_stamp":"2024-09-17T05:48:04.965082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:44:22.789741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.9","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-17T05:48:08.080851+0000","last_change":"2024-09-17T05:48:07.011574+0000","last_active":"2024-09-17T05:48:08.080851+0000","last_peered":"2024-09-17T05:48:08.080851+0000","last_clean":"2024-09-17T05:48:08.080851+0000","last_became_active":"2024-09-17T05:48:07.011264+0000","last_became_peered":"2024-09-17T05:48:07.011264+0000","last_unstale":"2024-09-17T05:48:08.080851+0000","last_undegraded":"2024-09-17T05:48:08.080851+0000","last_fullsized":"2024-09-17T05:48:08.080851+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:48:05.973792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:48:05.973792+0000","last_clean_scrub_stamp":"2024-09-17T05:48:05.973792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:41:22.819536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.8","version":"0'0","reported_seq":15,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-17T05:48:07.992275+0000","last_change":"2024-09-17T05:48:05.990918+0000","last_active":"2024-09-17T05:48:07.992275+0000","last_peered":"2024-09-17T05:48:07.992275+0000","last_clean":"2024-09-17T05:48:07.992275+0000","last_became_active":"2024-09-17T05:48:05.990644+0000","last_became_peered":"2024-09-17T05:48:05.990644+0000","last_unstale":"2024-09-17T05:48:07.992275+0000","last_undegraded":"2024-09-17T05:48:07.992275+0000","last_fullsized":"2024-09-17T05:48:07.992275+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:48:04.965082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:48:04.965082+0000","last_clean_scrub_stamp":"2024-09-17T05:48:04.965082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:32:32.045706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.6","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-17T05:48:07.995566+0000","last_change":"2024-09-17T05:48:07.010766+0000","last_active":"2024-09-17T05:48:07.995566+0000","last_peered":"2024-09-17T05:48:07.995566+0000","last_clean":"2024-09-17T05:48:07.995566+0000","last_became_active":"2024-09-17T05:48:07.010128+0000","last_became_peered":"2024-09-17T05:48:07.010128+0000","last_unstale":"2024-09-17T05:48:07.995566+0000","last_undegraded":"2024-09-17T05:48:07.995566+0000","last_fullsized":"2024-09-17T05:48:07.995566+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:48:05.973792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:48:05.973792+0000","last_clean_scrub_stamp":"2024-09-17T05:48:05.973792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:15:18.334059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.7","version":"85'2","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-17T05:48:08.015699+0000","last_change":"2024-09-17T05:48:05.996277+0000","last_active":"2024-09-17T05:48:08.015699+0000","last_peered":"2024-09-17T05:48:08.015699+0000","last_clean":"2024-09-17T05:48:08.015699+0000","last_became_active":"2024-09-17T05:48:05.995979+0000","last_became_peered":"2024-09-17T05:48:05.995979+0000","last_unstale":"2024-09-17T05:48:08.015699+0000","last_undegraded":"2024-09-17T05:48:08.015699+0000","last_fullsized":"2024-09-17T05:48:08.015699+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:48:04.965082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:48:04.965082+0000","last_clean_scrub_stamp":"2024-09-17T05:48:04.965082+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:25:07.468281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.7","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-17T05:48:07.995143+0000","last_change":"2024-09-17T05:48:07.016742+0000","last_active":"2024-09-17T05:48:07.995143+0000","last_peered":"2024-09-17T05:48:07.995143+0000","last_clean":"2024-09-17T05:48:07.995143+0000","last_became_active":"2024-09-17T05:48:07.016153+0000","last_became_peered":"2024-09-17T05:48:07.016153+0000","last_unstale":"2024-09-17T05:48:07.995143+0000","last_undegraded":"2024-09-17T05:48:07.995143+0000","last_fullsized":"2024-09-17T05:48:07.995143+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:48:05.973792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:48:05.973792+0000","last_clean_scrub_stamp":"2024-09-17T05:48:05.973792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:06:38.767535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.6","version":"86'1","reported_seq":16,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-17T05:48:08.015609+0000","last_change":"2024-09-17T05:48:05.997590+0000","last_active":"2024-09-17T05:48:08.015609+0000","last_peered":"2024-09-17T05:48:08.015609+0000","last_clean":"2024-09-17T05:48:08.015609+0000","last_became_active":"2024-09-17T05:48:05.997301+0000","last_became_peered":"2024-09-17T05:48:05.997301+0000","last_unstale":"2024-09-17T05:48:08.015609+0000","last_undegraded":"2024-09-17T05:48:08.015609+0000","last_fullsized":"2024-09-17T05:48:08.015609+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:48:04.965082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:48:04.965082+0000","last_clean_scrub_stamp":"2024-09-17T05:48:04.965082+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:28:36.315309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.4","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-17T05:48:08.081651+0000","last_change":"2024-09-17T05:48:07.014783+0000","last_active":"2024-09-17T05:48:08.081651+0000","last_peered":"2024-09-17T05:48:08.081651+0000","last_clean":"2024-09-17T05:48:08.081651+0000","last_became_active":"2024-09-17T05:48:07.013864+0000","last_became_peered":"2024-09-17T05:48:07.013864+0000","last_unstale":"2024-09-17T05:48:08.081651+0000","last_undegraded":"2024-09-17T05:48:08.081651+0000","last_fullsized":"2024-09-17T05:48:08.081651+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:48:05.973792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:48:05.973792+0000","last_clean_scrub_stamp":"2024-09-17T05:48:05.973792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:07:03.462729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.5","version":"0'0","reported_seq":15,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-17T05:48:08.081087+0000","last_change":"2024-09-17T05:48:05.995722+0000","last_active":"2024-09-17T05:48:08.081087+0000","last_peered":"2024-09-17T05:48:08.081087+0000","last_clean":"2024-09-17T05:48:08.081087+0000","last_became_active":"2024-09-17T05:48:05.995345+0000","last_became_peered":"2024-09-17T05:48:05.995345+0000","last_unstale":"2024-09-17T05:48:08.081087+0000","last_undegraded":"2024-09-17T05:48:08.081087+0000","last_fullsized":"2024-09-17T05:48:08.081087+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:48:04.965082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:48:04.965082+0000","last_clean_scrub_stamp":"2024-09-17T05:48:04.965082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:28:33.210082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.5","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-17T05:48:07.995279+0000","last_change":"2024-09-17T05:48:07.010707+0000","last_active":"2024-09-17T05:48:07.995279+0000","last_peered":"2024-09-17T05:48:07.995279+0000","last_clean":"2024-09-17T05:48:07.995279+0000","last_became_active":"2024-09-17T05:48:07.010254+0000","last_became_peered":"2024-09-17T05:48:07.010254+0000","last_unstale":"2024-09-17T05:48:07.995279+0000","last_undegraded":"2024-09-17T05:48:07.995279+0000","last_fullsized":"2024-09-17T05:48:07.995279+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:48:05.973792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:48:05.973792+0000","last_clean_scrub_stamp":"2024-09-17T05:48:05.973792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:52:48.184269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.4","version":"0'0","reported_seq":15,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-17T05:48:08.081803+0000","last_change":"2024-09-17T05:48:05.995600+0000","last_active":"2024-09-17T05:48:08.081803+0000","last_peered":"2024-09-17T05:48:08.081803+0000","last_clean":"2024-09-17T05:48:08.081803+0000","last_became_active":"2024-09-17T05:48:05.993437+0000","last_became_peered":"2024-09-17T05:48:05.993437+0000","last_unstale":"2024-09-17T05:48:08.081803+0000","last_undegraded":"2024-09-17T05:48:08.081803+0000","last_fullsized":"2024-09-17T05:48:08.081803+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:48:04.965082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:48:04.965082+0000","last_clean_scrub_stamp":"2024-09-17T05:48:04.965082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:34:01.741103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.2","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-17T05:48:08.081298+0000","last_change":"2024-09-17T05:48:07.002766+0000","last_active":"2024-09-17T05:48:08.081298+0000","last_peered":"2024-09-17T05:48:08.081298+0000","last_clean":"2024-09-17T05:48:08.081298+0000","last_became_active":"2024-09-17T05:48:07.002270+0000","last_became_peered":"2024-09-17T05:48:07.002270+0000","last_unstale":"2024-09-17T05:48:08.081298+0000","last_undegraded":"2024-09-17T05:48:08.081298+0000","last_fullsized":"2024-09-17T05:48:08.081298+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:48:05.973792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:48:05.973792+0000","last_clean_scrub_stamp":"2024-09-17T05:48:05.973792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:53:30.469256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.3","version":"0'0","reported_seq":15,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-17T05:48:08.017675+0000","last_change":"2024-09-17T05:48:05.993443+0000","last_active":"2024-09-17T05:48:08.017675+0000","last_peered":"2024-09-17T05:48:08.017675+0000","last_clean":"2024-09-17T05:48:08.017675+0000","last_became_active":"2024-09-17T05:48:05.993128+0000","last_became_peered":"2024-09-17T05:48:05.993128+0000","last_unstale":"2024-09-17T05:48:08.017675+0000","last_undegraded":"2024-09-17T05:48:08.017675+0000","last_fullsized":"2024-09-17T05:48:08.017675+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:48:04.965082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:48:04.965082+0000","last_clean_scrub_stamp":"2024-09-17T05:48:04.965082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:20:42.632458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.3","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-17T05:48:08.017609+0000","last_change":"2024-09-17T05:48:07.019471+0000","last_active":"2024-09-17T05:48:08.017609+0000","last_peered":"2024-09-17T05:48:08.017609+0000","last_clean":"2024-09-17T05:48:08.017609+0000","last_became_active":"2024-09-17T05:48:07.019107+0000","last_became_peered":"2024-09-17T05:48:07.019107+0000","last_unstale":"2024-09-17T05:48:08.017609+0000","last_undegraded":"2024-09-17T05:48:08.017609+0000","last_fullsized":"2024-09-17T05:48:08.017609+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:48:05.973792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:48:05.973792+0000","last_clean_scrub_stamp":"2024-09-17T05:48:05.973792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:30:20.891839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.2","version":"0'0","reported_seq":15,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-17T05:48:07.995459+0000","last_change":"2024-09-17T05:48:05.995790+0000","last_active":"2024-09-17T05:48:07.995459+0000","last_peered":"2024-09-17T05:48:07.995459+0000","last_clean":"2024-09-17T05:48:07.995459+0000","last_became_active":"2024-09-17T05:48:05.995430+0000","last_became_peered":"2024-09-17T05:48:05.995430+0000","last_unstale":"2024-09-17T05:48:07.995459+0000","last_undegraded":"2024-09-17T05:48:07.995459+0000","last_fullsized":"2024-09-17T05:48:07.995459+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:48:04.965082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:48:04.965082+0000","last_clean_scrub_stamp":"2024-09-17T05:48:04.965082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:38:13.458759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.0","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-17T05:48:07.993932+0000","last_change":"2024-09-17T05:48:07.008154+0000","last_active":"2024-09-17T05:48:07.993932+0000","last_peered":"2024-09-17T05:48:07.993932+0000","last_clean":"2024-09-17T05:48:07.993932+0000","last_became_active":"2024-09-17T05:48:07.007783+0000","last_became_peered":"2024-09-17T05:48:07.007783+0000","last_unstale":"2024-09-17T05:48:07.993932+0000","last_undegraded":"2024-09-17T05:48:07.993932+0000","last_fullsized":"2024-09-17T05:48:07.993932+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:48:05.973792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:48:05.973792+0000","last_clean_scrub_stamp":"2024-09-17T05:48:05.973792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:50:07.279107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1","version":"0'0","reported_seq":15,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-17T05:48:08.081273+0000","last_change":"2024-09-17T05:48:05.994404+0000","last_active":"2024-09-17T05:48:08.081273+0000","last_peered":"2024-09-17T05:48:08.081273+0000","last_clean":"2024-09-17T05:48:08.081273+0000","last_became_active":"2024-09-17T05:48:05.993984+0000","last_became_peered":"2024-09-17T05:48:05.993984+0000","last_unstale":"2024-09-17T05:48:08.081273+0000","last_undegraded":"2024-09-17T05:48:08.081273+0000","last_fullsized":"2024-09-17T05:48:08.081273+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:48:04.965082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:48:04.965082+0000","last_clean_scrub_stamp":"2024-09-17T05:48:04.965082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:59:41.841128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-17T05:48:08.081209+0000","last_change":"2024-09-17T05:48:07.016257+0000","last_active":"2024-09-17T05:48:08.081209+0000","last_peered":"2024-09-17T05:48:08.081209+0000","last_clean":"2024-09-17T05:48:08.081209+0000","last_became_active":"2024-09-17T05:48:07.015950+0000","last_became_peered":"2024-09-17T05:48:07.015950+0000","last_unstale":"2024-09-17T05:48:08.081209+0000","last_undegraded":"2024-09-17T05:48:08.081209+0000","last_fullsized":"2024-09-17T05:48:08.081209+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:48:05.973792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:48:05.973792+0000","last_clean_scrub_stamp":"2024-09-17T05:48:05.973792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:59:13.433276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.0","version":"0'0","reported_seq":15,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-17T05:48:07.994249+0000","last_change":"2024-09-17T05:48:06.000083+0000","last_active":"2024-09-17T05:48:07.994249+0000","last_peered":"2024-09-17T05:48:07.994249+0000","last_clean":"2024-09-17T05:48:07.994249+0000","last_became_active":"2024-09-17T05:48:05.999770+0000","last_became_peered":"2024-09-17T05:48:05.999770+0000","last_unstale":"2024-09-17T05:48:07.994249+0000","last_undegraded":"2024-09-17T05:48:07.994249+0000","last_fullsized":"2024-09-17T05:48:07.994249+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:48:04.965082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:48:04.965082+0000","last_clean_scrub_stamp":"2024-09-17T05:48:04.965082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:51:18.607205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.c","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-17T05:48:08.015946+0000","last_change":"2024-09-17T05:48:07.007210+0000","last_active":"2024-09-17T05:48:08.015946+0000","last_peered":"2024-09-17T05:48:08.015946+0000","last_clean":"2024-09-17T05:48:08.015946+0000","last_became_active":"2024-09-17T05:48:07.006278+0000","last_became_peered":"2024-09-17T05:48:07.006278+0000","last_unstale":"2024-09-17T05:48:08.015946+0000","last_undegraded":"2024-09-17T05:48:08.015946+0000","last_fullsized":"2024-09-17T05:48:08.015946+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:48:05.973792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:48:05.973792+0000","last_clean_scrub_stamp":"2024-09-17T05:48:05.973792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:16:47.105178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.d","version":"85'1","reported_seq":16,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-17T05:48:07.994972+0000","last_change":"2024-09-17T05:48:05.995764+0000","last_active":"2024-09-17T05:48:07.994972+0000","last_peered":"2024-09-17T05:48:07.994972+0000","last_clean":"2024-09-17T05:48:07.994972+0000","last_became_active":"2024-09-17T05:48:05.995439+0000","last_became_peered":"2024-09-17T05:48:05.995439+0000","last_unstale":"2024-09-17T05:48:07.994972+0000","last_undegraded":"2024-09-17T05:48:07.994972+0000","last_fullsized":"2024-09-17T05:48:07.994972+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:48:04.965082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:48:04.965082+0000","last_clean_scrub_stamp":"2024-09-17T05:48:04.965082+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:16:25.124718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"19'72","reported_seq":227,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-17T05:48:07.994147+0000","last_change":"2024-09-17T05:41:48.539830+0000","last_active":"2024-09-17T05:48:07.994147+0000","last_peered":"2024-09-17T05:48:07.994147+0000","last_clean":"2024-09-17T05:48:07.994147+0000","last_became_active":"2024-09-17T05:41:48.538743+0000","last_became_peered":"2024-09-17T05:41:48.538743+0000","last_unstale":"2024-09-17T05:48:07.994147+0000","last_undegraded":"2024-09-17T05:48:07.994147+0000","last_fullsized":"2024-09-17T05:48:07.994147+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:47.152539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:47.152539+0000","last_clean_scrub_stamp":"2024-09-17T05:41:47.152539+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:08:02.952016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":13,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":12,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":16,"seq":68719476818,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":54440,"kb_used_data":1036,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94317400,"statfs":{"total":96636764160,"available":96581017600,"internally_reserved":0,"allocated":1060864,"data_stored":449858,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":54655430},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":15,"seq":64424509522,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":50848,"kb_used_data":1608,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94320992,"statfs":{"total":96636764160,"available":96584695808,"internally_reserved":0,"allocated":1646592,"data_stored":1039602,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":50395594},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509521,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":50280,"kb_used_data":1040,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94321560,"statfs":{"total":96636764160,"available":96585277440,"internally_reserved":0,"allocated":1064960,"data_stored":450798,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509521,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":50264,"kb_used_data":1024,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94321576,"statfs":{"total":96636764160,"available":96585293824,"internally_reserved":0,"allocated":1048576,"data_stored":449164,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509521,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":72416,"kb_used_data":1036,"kb_used_omap":1,"kb_used_meta":71358,"kb_avail":94299424,"statfs":{"total":96636764160,"available":96562610176,"internally_reserved":0,"allocated":1060864,"data_stored":450776,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":73071047},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509521,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":50264,"kb_used_data":1028,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94321576,"statfs":{"total":96636764160,"available":96585293824,"internally_reserved":0,"allocated":1052672,"data_stored":449746,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509521,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":72416,"kb_used_data":1036,"kb_used_omap":1,"kb_used_meta":71358,"kb_avail":94299424,"statfs":{"total":96636764160,"available":96562610176,"internally_reserved":0,"allocated":1060864,"data_stored":449358,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":73071045},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574929,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55004,"kb_used_data":1608,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94316836,"statfs":{"total":96636764160,"available":96580440064,"internally_reserved":0,"allocated":1646592,"data_stored":1039566,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":194,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":694,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-17T05:48:15.820 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-17T05:48:15.821 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-09-17T05:48:15.978 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:15.976+0000 7f06f378b640 1 -- 172.21.15.150:0/766222251 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f06ec1628c0 msgr2=0x7f06ec162cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:48:15.979 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:15.976+0000 7f06f378b640 1 --2- 172.21.15.150:0/766222251 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f06ec1628c0 0x7f06ec162cd0 secure :-1 s=READY pgs=1026 cs=0 l=1 rev1=1 crypto rx=0x7f06ec0b9d60 tx=0x7f06dc02a530 comp rx=0 tx=0).stop 2024-09-17T05:48:15.979 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:15.976+0000 7f06f378b640 1 -- 172.21.15.150:0/766222251 shutdown_connections 2024-09-17T05:48:15.979 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:15.976+0000 7f06f378b640 1 --2- 172.21.15.150:0/766222251 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f06ec1628c0 0x7f06ec162cd0 unknown :-1 s=CLOSED pgs=1026 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:48:15.979 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:15.976+0000 7f06f378b640 1 --2- 172.21.15.150:0/766222251 >> v2:172.21.15.176:3300/0 conn(0x7f06ec0b3ae0 0x7f06ec0d2370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:48:15.979 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:15.976+0000 7f06f378b640 1 -- 172.21.15.150:0/766222251 >> 172.21.15.150:0/766222251 conn(0x7f06ec0d4680 msgr2=0x7f06ec0d4a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:48:15.979 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:15.976+0000 7f06f378b640 1 -- 172.21.15.150:0/766222251 shutdown_connections 2024-09-17T05:48:15.979 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:15.976+0000 7f06f378b640 1 -- 172.21.15.150:0/766222251 wait complete. 2024-09-17T05:48:15.980 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:15.978+0000 7f06f378b640 1 Processor -- start 2024-09-17T05:48:15.980 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:15.978+0000 7f06f378b640 1 -- start start 2024-09-17T05:48:15.982 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:15.979+0000 7f06f378b640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f06ec0b3ae0 0x7f06ec15b020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:48:15.982 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:15.979+0000 7f06f378b640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f06ec1628c0 0x7f06ec15d4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:48:15.982 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:15.979+0000 7f06f378b640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f06ec163210 0x7f06ec15d9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:48:15.982 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:15.979+0000 7f06f378b640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f06ec0cfd50 con 0x7f06ec0b3ae0 2024-09-17T05:48:15.983 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:15.979+0000 7f06f378b640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f06ec0cfbd0 con 0x7f06ec1628c0 2024-09-17T05:48:15.983 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:15.979+0000 7f06f378b640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f06ec0cfed0 con 0x7f06ec163210 2024-09-17T05:48:15.983 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:15.979+0000 7f06f1527640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f06ec0b3ae0 0x7f06ec15b020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:48:15.983 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:15.979+0000 7f06f1527640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f06ec0b3ae0 0x7f06ec15b020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:34234/0 (socket says 172.21.15.150:34234) 2024-09-17T05:48:15.983 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:15.979+0000 7f06f1527640 1 -- 172.21.15.150:0/1182450384 learned_addr learned my addr 172.21.15.150:0/1182450384 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:48:15.983 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:15.980+0000 7f06f1d28640 1 --2- 172.21.15.150:0/1182450384 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f06ec163210 0x7f06ec15d9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:48:15.983 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:15.980+0000 7f06f0d26640 1 --2- 172.21.15.150:0/1182450384 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f06ec1628c0 0x7f06ec15d4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:48:15.983 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:15.980+0000 7f06f1527640 1 -- 172.21.15.150:0/1182450384 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f06ec163210 msgr2=0x7f06ec15d9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:48:15.984 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:15.980+0000 7f06f1527640 1 --2- 172.21.15.150:0/1182450384 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f06ec163210 0x7f06ec15d9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:48:15.984 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:15.980+0000 7f06f1527640 1 -- 172.21.15.150:0/1182450384 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f06ec1628c0 msgr2=0x7f06ec15d4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:48:15.984 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:15.980+0000 7f06f1527640 1 --2- 172.21.15.150:0/1182450384 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f06ec1628c0 0x7f06ec15d4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:48:15.984 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:15.980+0000 7f06f1527640 1 -- 172.21.15.150:0/1182450384 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f06ec0cb120 con 0x7f06ec0b3ae0 2024-09-17T05:48:15.984 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:15.980+0000 7f06f1527640 1 --2- 172.21.15.150:0/1182450384 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f06ec0b3ae0 0x7f06ec15b020 secure :-1 s=READY pgs=1027 cs=0 l=1 rev1=1 crypto rx=0x7f06e800d700 tx=0x7f06e800dbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:48:15.984 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:15.980+0000 7f06e1ffb640 1 -- 172.21.15.150:0/1182450384 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06e8017070 con 0x7f06ec0b3ae0 2024-09-17T05:48:15.984 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:15.980+0000 7f06e1ffb640 1 -- 172.21.15.150:0/1182450384 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f06e8009d20 con 0x7f06ec0b3ae0 2024-09-17T05:48:15.984 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:15.980+0000 7f06f378b640 1 -- 172.21.15.150:0/1182450384 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f06ec0ccd10 con 0x7f06ec0b3ae0 2024-09-17T05:48:15.984 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:15.980+0000 7f06e1ffb640 1 -- 172.21.15.150:0/1182450384 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06e80106c0 con 0x7f06ec0b3ae0 2024-09-17T05:48:15.984 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:15.980+0000 7f06f378b640 1 -- 172.21.15.150:0/1182450384 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f06ec15f0c0 con 0x7f06ec0b3ae0 2024-09-17T05:48:15.985 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:15.981+0000 7f06f378b640 1 -- 172.21.15.150:0/1182450384 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f06ec08d090 con 0x7f06ec0b3ae0 2024-09-17T05:48:15.985 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:15.982+0000 7f06e1ffb640 1 -- 172.21.15.150:0/1182450384 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 25) ==== 103022+0+0 (secure 0 0 0) 0x7f06e801a070 con 0x7f06ec0b3ae0 2024-09-17T05:48:15.986 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:15.982+0000 7f06e1ffb640 1 --2- 172.21.15.150:0/1182450384 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f06d0079d30 0x7f06d007c240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:48:15.986 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:15.983+0000 7f06e1ffb640 1 -- 172.21.15.150:0/1182450384 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 5793+0+0 (secure 0 0 0) 0x7f06e8099cc0 con 0x7f06ec0b3ae0 2024-09-17T05:48:15.986 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:15.983+0000 7f06f0d26640 1 --2- 172.21.15.150:0/1182450384 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f06d0079d30 0x7f06d007c240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:48:15.986 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:15.983+0000 7f06f0d26640 1 --2- 172.21.15.150:0/1182450384 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f06d0079d30 0x7f06d007c240 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f06dc034000 tx=0x7f06dc004730 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:48:15.988 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:15.987+0000 7f06e1ffb640 1 -- 172.21.15.150:0/1182450384 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f06ec08d090 con 0x7f06ec0b3ae0 2024-09-17T05:48:16.232 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:16.231+0000 7f06f378b640 1 -- 172.21.15.150:0/1182450384 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) -- 0x7f06ec162cd0 con 0x7f06ec0b3ae0 2024-09-17T05:48:16.235 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:16.233+0000 7f06e1ffb640 1 -- 172.21.15.150:0/1182450384 <== mon.0 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v15) ==== 190+0+147 (secure 0 0 0) 0x7f06e80638f0 con 0x7f06ec0b3ae0 2024-09-17T05:48:16.235 INFO:teuthology.orchestra.run.smithi150.stdout:[client.0] 2024-09-17T05:48:16.235 INFO:teuthology.orchestra.run.smithi150.stdout: key = AQBoFulmfF/1HBAAMezEjZDeoHTJ+uFfDXNWHQ== 2024-09-17T05:48:16.235 INFO:teuthology.orchestra.run.smithi150.stdout: caps mds = "allow" 2024-09-17T05:48:16.235 INFO:teuthology.orchestra.run.smithi150.stdout: caps mon = "allow r" 2024-09-17T05:48:16.236 INFO:teuthology.orchestra.run.smithi150.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2024-09-17T05:48:16.236 INFO:teuthology.orchestra.run.smithi150.stderr:updated caps for client.0 2024-09-17T05:48:16.238 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:16.236+0000 7f06f378b640 1 -- 172.21.15.150:0/1182450384 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f06d0079d30 msgr2=0x7f06d007c240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:48:16.238 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:16.236+0000 7f06f378b640 1 --2- 172.21.15.150:0/1182450384 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f06d0079d30 0x7f06d007c240 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f06dc034000 tx=0x7f06dc004730 comp rx=0 tx=0).stop 2024-09-17T05:48:16.238 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:16.236+0000 7f06f378b640 1 -- 172.21.15.150:0/1182450384 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f06ec0b3ae0 msgr2=0x7f06ec15b020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:48:16.238 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:16.236+0000 7f06f378b640 1 --2- 172.21.15.150:0/1182450384 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f06ec0b3ae0 0x7f06ec15b020 secure :-1 s=READY pgs=1027 cs=0 l=1 rev1=1 crypto rx=0x7f06e800d700 tx=0x7f06e800dbc0 comp rx=0 tx=0).stop 2024-09-17T05:48:16.238 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:16.236+0000 7f06f378b640 1 -- 172.21.15.150:0/1182450384 shutdown_connections 2024-09-17T05:48:16.238 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:16.236+0000 7f06f378b640 1 --2- 172.21.15.150:0/1182450384 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f06ec1628c0 0x7f06ec15d4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:48:16.238 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:16.236+0000 7f06f378b640 1 --2- 172.21.15.150:0/1182450384 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f06d0079d30 0x7f06d007c240 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:48:16.238 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:16.236+0000 7f06f378b640 1 --2- 172.21.15.150:0/1182450384 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f06ec163210 0x7f06ec15d9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:48:16.239 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:16.236+0000 7f06f378b640 1 --2- 172.21.15.150:0/1182450384 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f06ec0b3ae0 0x7f06ec15b020 unknown :-1 s=CLOSED pgs=1027 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:48:16.239 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:16.236+0000 7f06f378b640 1 -- 172.21.15.150:0/1182450384 >> 172.21.15.150:0/1182450384 conn(0x7f06ec0d4680 msgr2=0x7f06ec0cf4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:48:16.239 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:16.236+0000 7f06f378b640 1 -- 172.21.15.150:0/1182450384 shutdown_connections 2024-09-17T05:48:16.239 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:16.236+0000 7f06f378b640 1 -- 172.21.15.150:0/1182450384 wait complete. 2024-09-17T05:48:16.249 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T05:48:16.362 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:16.360+0000 7f9a0b9eb640 1 -- 172.21.15.150:0/3738463205 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9a040b5410 msgr2=0x7f9a040b5820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:48:16.363 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:16.360+0000 7f9a0b9eb640 1 --2- 172.21.15.150:0/3738463205 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9a040b5410 0x7f9a040b5820 secure :-1 s=READY pgs=1029 cs=0 l=1 rev1=1 crypto rx=0x7f99fc009830 tx=0x7f99fc02a510 comp rx=0 tx=0).stop 2024-09-17T05:48:16.363 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:16.361+0000 7f9a0b9eb640 1 -- 172.21.15.150:0/3738463205 shutdown_connections 2024-09-17T05:48:16.363 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:16.361+0000 7f9a0b9eb640 1 --2- 172.21.15.150:0/3738463205 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9a040b5410 0x7f9a040b5820 unknown :-1 s=CLOSED pgs=1029 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:48:16.363 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:16.361+0000 7f9a0b9eb640 1 --2- 172.21.15.150:0/3738463205 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9a0415ee30 0x7f9a040b2840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:48:16.363 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:16.361+0000 7f9a0b9eb640 1 -- 172.21.15.150:0/3738463205 >> 172.21.15.150:0/3738463205 conn(0x7f9a040b2fd0 msgr2=0x7f9a040b33e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:48:16.363 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:16.361+0000 7f9a0b9eb640 1 -- 172.21.15.150:0/3738463205 shutdown_connections 2024-09-17T05:48:16.363 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:16.361+0000 7f9a0b9eb640 1 -- 172.21.15.150:0/3738463205 wait complete. 2024-09-17T05:48:16.364 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:16.362+0000 7f9a0b9eb640 1 Processor -- start 2024-09-17T05:48:16.364 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:16.362+0000 7f9a0b9eb640 1 -- start start 2024-09-17T05:48:16.367 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:16.364+0000 7f9a0b9eb640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9a040b5410 0x7f9a04154020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:48:16.367 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:16.364+0000 7f9a0b9eb640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9a040cf7c0 0x7f9a04153650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:48:16.367 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:16.364+0000 7f9a0b9eb640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9a0415ee30 0x7f9a041f3b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:48:16.367 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:16.364+0000 7f9a0b9eb640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f9a040b6170 con 0x7f9a0415ee30 2024-09-17T05:48:16.367 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:16.364+0000 7f9a0b9eb640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f9a040b5ff0 con 0x7f9a040cf7c0 2024-09-17T05:48:16.367 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:16.364+0000 7f9a0b9eb640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f9a040b62f0 con 0x7f9a040b5410 2024-09-17T05:48:16.367 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:16.364+0000 7f9a09f88640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9a0415ee30 0x7f9a041f3b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:48:16.368 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:16.364+0000 7f9a09f88640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9a0415ee30 0x7f9a041f3b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:34250/0 (socket says 172.21.15.150:34250) 2024-09-17T05:48:16.368 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:16.364+0000 7f9a09f88640 1 -- 172.21.15.150:0/636927198 learned_addr learned my addr 172.21.15.150:0/636927198 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:48:16.368 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:16.364+0000 7f9a08f86640 1 --2- 172.21.15.150:0/636927198 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9a040cf7c0 0x7f9a04153650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:48:16.368 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:16.364+0000 7f9a09787640 1 --2- 172.21.15.150:0/636927198 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9a040b5410 0x7f9a04154020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:48:16.368 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:16.364+0000 7f9a09f88640 1 -- 172.21.15.150:0/636927198 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9a040b5410 msgr2=0x7f9a04154020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:48:16.368 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:16.364+0000 7f9a09f88640 1 --2- 172.21.15.150:0/636927198 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9a040b5410 0x7f9a04154020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:48:16.368 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:16.364+0000 7f9a09f88640 1 -- 172.21.15.150:0/636927198 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9a040cf7c0 msgr2=0x7f9a04153650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:48:16.368 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:16.364+0000 7f9a09f88640 1 --2- 172.21.15.150:0/636927198 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9a040cf7c0 0x7f9a04153650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:48:16.368 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:16.364+0000 7f9a09f88640 1 -- 172.21.15.150:0/636927198 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9a040c53d0 con 0x7f9a0415ee30 2024-09-17T05:48:16.368 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:16.364+0000 7f9a09f88640 1 --2- 172.21.15.150:0/636927198 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9a0415ee30 0x7f9a041f3b70 secure :-1 s=READY pgs=1030 cs=0 l=1 rev1=1 crypto rx=0x7f99fc02ab00 tx=0x7f99fc033c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:48:16.368 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:16.364+0000 7f9a01ffb640 1 -- 172.21.15.150:0/636927198 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99fc031d60 con 0x7f9a0415ee30 2024-09-17T05:48:16.368 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:16.364+0000 7f9a01ffb640 1 -- 172.21.15.150:0/636927198 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f99fc033e10 con 0x7f9a0415ee30 2024-09-17T05:48:16.369 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:16.365+0000 7f9a0b9eb640 1 -- 172.21.15.150:0/636927198 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9a0409b610 con 0x7f9a0415ee30 2024-09-17T05:48:16.369 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:16.365+0000 7f9a01ffb640 1 -- 172.21.15.150:0/636927198 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99fc005240 con 0x7f9a0415ee30 2024-09-17T05:48:16.369 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:16.365+0000 7f9a0b9eb640 1 -- 172.21.15.150:0/636927198 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9a0409bbd0 con 0x7f9a0415ee30 2024-09-17T05:48:16.369 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:16.366+0000 7f9a0b9eb640 1 -- 172.21.15.150:0/636927198 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9a040c5140 con 0x7f9a0415ee30 2024-09-17T05:48:16.370 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:16.366+0000 7f9a01ffb640 1 -- 172.21.15.150:0/636927198 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 25) ==== 103022+0+0 (secure 0 0 0) 0x7f99fc0053e0 con 0x7f9a0415ee30 2024-09-17T05:48:16.370 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:16.367+0000 7f9a01ffb640 1 --2- 172.21.15.150:0/636927198 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f99f0079d30 0x7f99f007c240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:48:16.370 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:16.367+0000 7f9a01ffb640 1 -- 172.21.15.150:0/636927198 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 5793+0+0 (secure 0 0 0) 0x7f99fc0ba9f0 con 0x7f9a0415ee30 2024-09-17T05:48:16.370 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:16.367+0000 7f9a09787640 1 --2- 172.21.15.150:0/636927198 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f99f0079d30 0x7f99f007c240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:48:16.370 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:16.368+0000 7f9a09787640 1 --2- 172.21.15.150:0/636927198 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f99f0079d30 0x7f99f007c240 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f99f4005c40 tx=0x7f99f4005bd0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:48:16.373 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:16.372+0000 7f9a01ffb640 1 -- 172.21.15.150:0/636927198 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f99fc03f030 con 0x7f9a0415ee30 2024-09-17T05:48:16.580 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:16.579+0000 7f9a0b9eb640 1 -- 172.21.15.150:0/636927198 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f9a040b5820 con 0x7f9a0415ee30 2024-09-17T05:48:16.581 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:16.580+0000 7f9a01ffb640 1 -- 172.21.15.150:0/636927198 <== mon.0 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 51 v51) ==== 94+0+5237 (secure 0 0 0) 0x7f99fc084320 con 0x7f9a0415ee30 2024-09-17T05:48:16.581 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-09-17T05:48:16.581 INFO:teuthology.orchestra.run.smithi150.stdout:{"epoch":51,"btime":"2024-09-17T05:48:10:016435+0000","default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5993,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6835/1590564966","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6833","nonce":1590564966},{"type":"v1","addr":"172.21.15.150:6835","nonce":1590564966}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":47},{"gid":6008,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6837/3094459008","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6835","nonce":3094459008},{"type":"v1","addr":"172.21.15.176:6837","nonce":3094459008}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":47},{"gid":6484,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6834/1586974380","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6832","nonce":1586974380},{"type":"v1","addr":"172.21.15.150:6834","nonce":1586974380}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":46}],"filesystems":[{"mdsmap":{"epoch":51,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T05:48:06.348623+0000","modified":"2024-09-17T05:48:09.356798+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6496},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6496":{"gid":6496,"name":"d","rank":0,"incarnation":48,"state":"up:active","state_seq":3,"addr":"172.21.15.176:6836/4093204117","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6834","nonce":4093204117},{"type":"v1","addr":"172.21.15.176:6836","nonce":4093204117}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6496,"qdb_cluster":[6496]},"id":6}]} 2024-09-17T05:48:16.582 INFO:teuthology.orchestra.run.smithi150.stderr:dumped fsmap epoch 51 2024-09-17T05:48:16.584 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:16.582+0000 7f9a0b9eb640 1 -- 172.21.15.150:0/636927198 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f99f0079d30 msgr2=0x7f99f007c240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:48:16.584 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:16.582+0000 7f9a0b9eb640 1 --2- 172.21.15.150:0/636927198 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f99f0079d30 0x7f99f007c240 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f99f4005c40 tx=0x7f99f4005bd0 comp rx=0 tx=0).stop 2024-09-17T05:48:16.584 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:16.582+0000 7f9a0b9eb640 1 -- 172.21.15.150:0/636927198 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9a0415ee30 msgr2=0x7f9a041f3b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:48:16.584 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:16.582+0000 7f9a0b9eb640 1 --2- 172.21.15.150:0/636927198 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9a0415ee30 0x7f9a041f3b70 secure :-1 s=READY pgs=1030 cs=0 l=1 rev1=1 crypto rx=0x7f99fc02ab00 tx=0x7f99fc033c20 comp rx=0 tx=0).stop 2024-09-17T05:48:16.584 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:16.582+0000 7f9a0b9eb640 1 -- 172.21.15.150:0/636927198 shutdown_connections 2024-09-17T05:48:16.584 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:16.582+0000 7f9a0b9eb640 1 --2- 172.21.15.150:0/636927198 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9a040cf7c0 0x7f9a04153650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:48:16.584 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:16.582+0000 7f9a0b9eb640 1 --2- 172.21.15.150:0/636927198 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f99f0079d30 0x7f99f007c240 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:48:16.584 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:16.582+0000 7f9a0b9eb640 1 --2- 172.21.15.150:0/636927198 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9a0415ee30 0x7f9a041f3b70 unknown :-1 s=CLOSED pgs=1030 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:48:16.585 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:16.582+0000 7f9a0b9eb640 1 --2- 172.21.15.150:0/636927198 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9a040b5410 0x7f9a04154020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:48:16.585 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:16.582+0000 7f9a0b9eb640 1 -- 172.21.15.150:0/636927198 >> 172.21.15.150:0/636927198 conn(0x7f9a040b2fd0 msgr2=0x7f9a040d1bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:48:16.585 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:16.582+0000 7f9a0b9eb640 1 -- 172.21.15.150:0/636927198 shutdown_connections 2024-09-17T05:48:16.585 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:16.582+0000 7f9a0b9eb640 1 -- 172.21.15.150:0/636927198 wait complete. 2024-09-17T05:48:16.999 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 51, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-17T05:48:06.348623+0000', 'modified': '2024-09-17T05:48:09.356798+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 6496}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_6496': {'gid': 6496, 'name': 'd', 'rank': 0, 'incarnation': 48, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.176:6836/4093204117', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.176:6834', 'nonce': 4093204117}, {'type': 'v1', 'addr': '172.21.15.176:6836', 'nonce': 4093204117}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [13], 'metadata_pool': 12, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 6496, 'qdb_cluster': [6496]} 2024-09-17T05:48:16.999 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-17T05:48:16.999 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.d status 2024-09-17T05:48:17.115 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:17.113+0000 7f06d9569640 1 -- 172.21.15.150:0/2097303678 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f06d40d15d0 msgr2=0x7f06d4162a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:48:17.115 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:17.113+0000 7f06d9569640 1 --2- 172.21.15.150:0/2097303678 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f06d40d15d0 0x7f06d4162a60 secure :-1 s=READY pgs=1031 cs=0 l=1 rev1=1 crypto rx=0x7f06d40ba730 tx=0x7f06cc02a4f0 comp rx=0 tx=0).stop 2024-09-17T05:48:17.115 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:17.113+0000 7f06d9569640 1 -- 172.21.15.150:0/2097303678 shutdown_connections 2024-09-17T05:48:17.115 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:17.113+0000 7f06d9569640 1 --2- 172.21.15.150:0/2097303678 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f06d40d15d0 0x7f06d4162a60 unknown :-1 s=CLOSED pgs=1031 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:48:17.115 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:17.113+0000 7f06d9569640 1 --2- 172.21.15.150:0/2097303678 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f06d415ee50 0x7f06d40d1090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:48:17.115 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:17.113+0000 7f06d9569640 1 --2- 172.21.15.150:0/2097303678 >> v2:172.21.15.176:3300/0 conn(0x7f06d40b9780 0x7f06d40b3720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:48:17.115 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:17.113+0000 7f06d9569640 1 -- 172.21.15.150:0/2097303678 >> 172.21.15.150:0/2097303678 conn(0x7f06d40d4680 msgr2=0x7f06d40d4a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:48:17.115 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:17.113+0000 7f06d9569640 1 -- 172.21.15.150:0/2097303678 shutdown_connections 2024-09-17T05:48:17.116 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:17.113+0000 7f06d9569640 1 -- 172.21.15.150:0/2097303678 wait complete. 2024-09-17T05:48:17.116 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:17.115+0000 7f06d9569640 1 Processor -- start 2024-09-17T05:48:17.116 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:17.115+0000 7f06d9569640 1 -- start start 2024-09-17T05:48:17.119 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:17.116+0000 7f06d9569640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f06d40b9780 0x7f06d4149390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:48:17.119 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:17.116+0000 7f06d9569640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f06d40d15d0 0x7f06d4157bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:48:17.119 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:17.116+0000 7f06d9569640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f06d415ee50 0x7f06d415daf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:48:17.119 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:17.116+0000 7f06d9569640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f06d4163330 con 0x7f06d40d15d0 2024-09-17T05:48:17.119 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:17.116+0000 7f06d9569640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f06d41631b0 con 0x7f06d40b9780 2024-09-17T05:48:17.119 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:17.116+0000 7f06d9569640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f06d41634b0 con 0x7f06d415ee50 2024-09-17T05:48:17.119 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:17.116+0000 7f06d27fc640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f06d40d15d0 0x7f06d4157bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:48:17.119 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:17.116+0000 7f06d27fc640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f06d40d15d0 0x7f06d4157bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:34266/0 (socket says 172.21.15.150:34266) 2024-09-17T05:48:17.119 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:17.116+0000 7f06d27fc640 1 -- 172.21.15.150:0/1717911763 learned_addr learned my addr 172.21.15.150:0/1717911763 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:48:17.119 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:17.116+0000 7f06d2ffd640 1 --2- 172.21.15.150:0/1717911763 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f06d40b9780 0x7f06d4149390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:48:17.120 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:17.116+0000 7f06d37fe640 1 --2- 172.21.15.150:0/1717911763 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f06d415ee50 0x7f06d415daf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:48:17.120 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:17.117+0000 7f06d27fc640 1 -- 172.21.15.150:0/1717911763 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f06d415ee50 msgr2=0x7f06d415daf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:48:17.120 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:17.117+0000 7f06d27fc640 1 --2- 172.21.15.150:0/1717911763 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f06d415ee50 0x7f06d415daf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:48:17.120 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:17.117+0000 7f06d27fc640 1 -- 172.21.15.150:0/1717911763 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f06d40b9780 msgr2=0x7f06d4149390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:48:17.120 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:17.117+0000 7f06d27fc640 1 --2- 172.21.15.150:0/1717911763 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f06d40b9780 0x7f06d4149390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:48:17.120 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:17.117+0000 7f06d27fc640 1 -- 172.21.15.150:0/1717911763 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f06d41498d0 con 0x7f06d40d15d0 2024-09-17T05:48:17.120 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:17.117+0000 7f06d27fc640 1 --2- 172.21.15.150:0/1717911763 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f06d40d15d0 0x7f06d4157bf0 secure :-1 s=READY pgs=1032 cs=0 l=1 rev1=1 crypto rx=0x7f06c800b410 tx=0x7f06c8009f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:48:17.120 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:17.117+0000 7f06bb7fe640 1 -- 172.21.15.150:0/1717911763 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06c8015020 con 0x7f06d40d15d0 2024-09-17T05:48:17.120 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:17.117+0000 7f06bb7fe640 1 -- 172.21.15.150:0/1717911763 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f06c8011920 con 0x7f06d40d15d0 2024-09-17T05:48:17.120 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:17.117+0000 7f06d9569640 1 -- 172.21.15.150:0/1717911763 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f06d4155c50 con 0x7f06d40d15d0 2024-09-17T05:48:17.120 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:17.117+0000 7f06bb7fe640 1 -- 172.21.15.150:0/1717911763 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06c8011d70 con 0x7f06d40d15d0 2024-09-17T05:48:17.120 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:17.117+0000 7f06d9569640 1 -- 172.21.15.150:0/1717911763 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f06d41f9aa0 con 0x7f06d40d15d0 2024-09-17T05:48:17.121 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:17.119+0000 7f06bb7fe640 1 -- 172.21.15.150:0/1717911763 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 25) ==== 103022+0+0 (secure 0 0 0) 0x7f06c8018020 con 0x7f06d40d15d0 2024-09-17T05:48:17.121 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:17.120+0000 7f06bb7fe640 1 --2- 172.21.15.150:0/1717911763 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f06c0079d30 0x7f06c007c240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:48:17.121 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:17.120+0000 7f06bb7fe640 1 -- 172.21.15.150:0/1717911763 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 5793+0+0 (secure 0 0 0) 0x7f06c8099940 con 0x7f06d40d15d0 2024-09-17T05:48:17.122 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:17.120+0000 7f06d2ffd640 1 --2- 172.21.15.150:0/1717911763 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f06c0079d30 0x7f06c007c240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:48:17.122 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:17.120+0000 7f06e04d7740 1 Processor -- start 2024-09-17T05:48:17.122 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:17.121+0000 7f06d2ffd640 1 --2- 172.21.15.150:0/1717911763 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f06c0079d30 0x7f06c007c240 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f06c4005be0 tx=0x7f06c400a550 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:48:17.122 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:17.121+0000 7f06e04d7740 1 -- start start 2024-09-17T05:48:17.124 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:17.122+0000 7f06e04d7740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x556325dbe270 0x55632618ffa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:48:17.125 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:17.122+0000 7f06e04d7740 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x556325d953b0 0x5563261904e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:48:17.125 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:17.122+0000 7f06e04d7740 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x556325d9d590 0x5563261ad3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:48:17.125 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:17.122+0000 7f06e04d7740 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x5563260d8820 con 0x556325d953b0 2024-09-17T05:48:17.125 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:17.122+0000 7f06e04d7740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x5563260c7c50 con 0x556325dbe270 2024-09-17T05:48:17.125 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:17.122+0000 7f06e04d7740 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x5563260cba60 con 0x556325d9d590 2024-09-17T05:48:17.125 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:17.122+0000 7f06d27fc640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x556325d953b0 0x5563261904e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:48:17.125 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:17.122+0000 7f06d27fc640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x556325d953b0 0x5563261904e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:34268/0 (socket says 172.21.15.150:34268) 2024-09-17T05:48:17.125 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:17.122+0000 7f06d27fc640 1 -- 172.21.15.150:0/393886518 learned_addr learned my addr 172.21.15.150:0/393886518 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:48:17.125 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:17.122+0000 7f06d2ffd640 1 --2- 172.21.15.150:0/393886518 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x556325dbe270 0x55632618ffa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:48:17.125 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:17.122+0000 7f06d37fe640 1 --2- 172.21.15.150:0/393886518 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x556325d9d590 0x5563261ad3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:48:17.125 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:17.122+0000 7f06d27fc640 1 -- 172.21.15.150:0/393886518 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x556325d9d590 msgr2=0x5563261ad3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:48:17.126 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:17.122+0000 7f06d27fc640 1 --2- 172.21.15.150:0/393886518 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x556325d9d590 0x5563261ad3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:48:17.126 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:17.122+0000 7f06d27fc640 1 -- 172.21.15.150:0/393886518 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x556325dbe270 msgr2=0x55632618ffa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:48:17.126 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:17.122+0000 7f06d27fc640 1 --2- 172.21.15.150:0/393886518 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x556325dbe270 0x55632618ffa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:48:17.126 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:17.122+0000 7f06d27fc640 1 -- 172.21.15.150:0/393886518 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556325e29850 con 0x556325d953b0 2024-09-17T05:48:17.126 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:17.123+0000 7f06d27fc640 1 --2- 172.21.15.150:0/393886518 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x556325d953b0 0x5563261904e0 secure :-1 s=READY pgs=1033 cs=0 l=1 rev1=1 crypto rx=0x7f06c800b3e0 tx=0x7f06c8062720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=70bbe4cabc657dea server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:48:17.126 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:17.123+0000 7f06b8ff9640 1 -- 172.21.15.150:0/393886518 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06c80679e0 con 0x556325d953b0 2024-09-17T05:48:17.126 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:17.123+0000 7f06b8ff9640 1 -- 172.21.15.150:0/393886518 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f06c806c800 con 0x556325d953b0 2024-09-17T05:48:17.126 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:17.123+0000 7f06b8ff9640 1 -- 172.21.15.150:0/393886518 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06c8062470 con 0x556325d953b0 2024-09-17T05:48:17.130 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:17.124+0000 7f06e04d7740 1 -- 172.21.15.150:0/393886518 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x556325d953b0 msgr2=0x5563261904e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:48:17.130 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:17.124+0000 7f06e04d7740 1 --2- 172.21.15.150:0/393886518 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x556325d953b0 0x5563261904e0 secure :-1 s=READY pgs=1033 cs=0 l=1 rev1=1 crypto rx=0x7f06c800b3e0 tx=0x7f06c8062720 comp rx=0 tx=0).stop 2024-09-17T05:48:17.130 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:17.124+0000 7f06e04d7740 1 -- 172.21.15.150:0/393886518 shutdown_connections 2024-09-17T05:48:17.130 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:17.124+0000 7f06e04d7740 1 --2- 172.21.15.150:0/393886518 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x556325d9d590 0x5563261ad3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:48:17.130 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:17.124+0000 7f06e04d7740 1 --2- 172.21.15.150:0/393886518 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x556325d953b0 0x5563261904e0 unknown :-1 s=CLOSED pgs=1033 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:48:17.130 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:17.124+0000 7f06e04d7740 1 --2- 172.21.15.150:0/393886518 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x556325dbe270 0x55632618ffa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:48:17.130 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:17.124+0000 7f06e04d7740 1 -- 172.21.15.150:0/393886518 >> 172.21.15.150:0/393886518 conn(0x556325db23c0 msgr2=0x556326166260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:48:17.130 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:17.124+0000 7f06e04d7740 1 -- 172.21.15.150:0/393886518 shutdown_connections 2024-09-17T05:48:17.130 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:17.124+0000 7f06e04d7740 1 -- 172.21.15.150:0/393886518 wait complete. 2024-09-17T05:48:17.130 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:17.125+0000 7f06e04d7740 1 -- start start 2024-09-17T05:48:17.130 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:17.125+0000 7f06e04d7740 1 Processor -- start 2024-09-17T05:48:17.131 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:17.126+0000 7f06e04d7740 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x556325d953b0 0x5563261ba820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:48:17.131 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:17.126+0000 7f06e04d7740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x556325d9d590 0x556326179490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:48:17.131 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:17.126+0000 7f06e04d7740 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x556325dbe270 0x5563261bd2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:48:17.131 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:17.126+0000 7f06e04d7740 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x556325e38620 con 0x556325d953b0 2024-09-17T05:48:17.131 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:17.126+0000 7f06e04d7740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x55632606d5f0 con 0x556325d9d590 2024-09-17T05:48:17.131 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:17.126+0000 7f06e04d7740 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x556326190a20 con 0x556325dbe270 2024-09-17T05:48:17.131 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:17.126+0000 7f06e04d7740 10 client.0 _ll_register_callbacks cb 0x5563260710a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T05:48:17.131 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:17.126+0000 7f06d2ffd640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x556325d953b0 0x5563261ba820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:48:17.131 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:17.126+0000 7f06d2ffd640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x556325d953b0 0x5563261ba820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:34270/0 (socket says 172.21.15.150:34270) 2024-09-17T05:48:17.131 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:17.126+0000 7f06d2ffd640 1 -- 172.21.15.150:0/3882731666 learned_addr learned my addr 172.21.15.150:0/3882731666 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:48:17.131 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:17.126+0000 7f06d27fc640 1 --2- 172.21.15.150:0/3882731666 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x556325d9d590 0x556326179490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:48:17.131 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:17.126+0000 7f06d37fe640 1 --2- 172.21.15.150:0/3882731666 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x556325dbe270 0x5563261bd2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:48:17.131 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:17.126+0000 7f06d2ffd640 1 -- 172.21.15.150:0/3882731666 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x556325dbe270 msgr2=0x5563261bd2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:48:17.131 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:17.126+0000 7f06d2ffd640 1 --2- 172.21.15.150:0/3882731666 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x556325dbe270 0x5563261bd2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:48:17.132 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:17.126+0000 7f06d2ffd640 1 -- 172.21.15.150:0/3882731666 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x556325d9d590 msgr2=0x556326179490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:48:17.132 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:17.126+0000 7f06d2ffd640 1 --2- 172.21.15.150:0/3882731666 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x556325d9d590 0x556326179490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:48:17.132 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:17.126+0000 7f06d2ffd640 1 -- 172.21.15.150:0/3882731666 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556325ea06b0 con 0x556325d953b0 2024-09-17T05:48:17.132 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:17.126+0000 7f06d37fe640 1 --2- 172.21.15.150:0/3882731666 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x556325dbe270 0x5563261bd2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T05:48:17.132 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:17.126+0000 7f06d27fc640 1 --2- 172.21.15.150:0/3882731666 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x556325d9d590 0x556326179490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T05:48:17.132 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:17.127+0000 7f06d2ffd640 1 --2- 172.21.15.150:0/3882731666 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x556325d953b0 0x5563261ba820 secure :-1 s=READY pgs=1034 cs=0 l=1 rev1=1 crypto rx=0x7f06c400ac40 tx=0x7f06c4004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6d69dd234cc4cf3d server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:48:17.132 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:17.127+0000 7f06b1ffb640 10 client.0 ms_handle_connect on v2:172.21.15.150:3300/0 2024-09-17T05:48:17.132 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:17.127+0000 7f06b1ffb640 1 -- 172.21.15.150:0/3882731666 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06c4016070 con 0x556325d953b0 2024-09-17T05:48:17.132 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:17.127+0000 7f06b1ffb640 1 -- 172.21.15.150:0/3882731666 <== mon.0 v2:172.21.15.150:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 5793+0+0 (secure 0 0 0) 0x7f06c4028b50 con 0x556325d953b0 2024-09-17T05:48:17.132 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:17.127+0000 7f06e04d7740 1 -- 172.21.15.150:0/3882731666 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f06c806c800 con 0x556325d953b0 2024-09-17T05:48:17.132 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:17.127+0000 7f06b1ffb640 1 -- 172.21.15.150:0/3882731666 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_get_version_reply(handle=1 version=51) ==== 24+0+0 (secure 0 0 0) 0x7f06c4028d90 con 0x556325d953b0 2024-09-17T05:48:17.132 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:17.127+0000 7f06e04d7740 10 client.7290 fetch_fsmap learned FSMap version 51 2024-09-17T05:48:17.133 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:17.127+0000 7f06e04d7740 1 -- 172.21.15.150:0/3882731666 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,fsmap=51,monmap=2+}) -- 0x556326179eb0 con 0x556325d953b0 2024-09-17T05:48:17.133 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:17.127+0000 7f06b1ffb640 1 -- 172.21.15.150:0/3882731666 <== mon.0 v2:172.21.15.150:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f06c806c800 con 0x556325d953b0 2024-09-17T05:48:17.133 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:17.127+0000 7f06b1ffb640 1 -- 172.21.15.150:0/3882731666 <== mon.0 v2:172.21.15.150:3300/0 5 ==== fsmap(e 51) ==== 3502+0+0 (secure 0 0 0) 0x7f06c4025020 con 0x556325d953b0 2024-09-17T05:48:17.133 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:17.127+0000 7f06e04d7740 10 client.7290 fetch_fsmap finished waiting for FSMap version 51 2024-09-17T05:48:17.133 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:17.127+0000 7f06e04d7740 10 client.7290 resolve_mds: resolved name 'd' to daemon mds.d 2024-09-17T05:48:17.133 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:17.127+0000 7f06e04d7740 20 client.7290 populate_metadata read hostname 'smithi150' 2024-09-17T05:48:17.133 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:17.127+0000 7f06e04d7740 1 --2- 172.21.15.150:0/3882731666 >> [v2:172.21.15.176:6834/4093204117,v1:172.21.15.176:6836/4093204117] conn(0x556325d7ce40 0x55632617d7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:48:17.133 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:17.127+0000 7f06e04d7740 4 client.7290 mds_command: new command op to 6496 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-17T05:48:17.133 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:17.127+0000 7f06e04d7740 1 -- 172.21.15.150:0/3882731666 --> [v2:172.21.15.176:6834/4093204117,v1:172.21.15.176:6836/4093204117] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5563260da770 con 0x556325d7ce40 2024-09-17T05:48:17.133 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:17.128+0000 7f06d27fc640 1 --2- 172.21.15.150:0/3882731666 >> [v2:172.21.15.176:6834/4093204117,v1:172.21.15.176:6836/4093204117] conn(0x556325d7ce40 0x55632617d7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:48:17.133 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:17.128+0000 7f06b1ffb640 10 client.7290 ms_handle_connect on v2:172.21.15.176:6834/4093204117 2024-09-17T05:48:17.133 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:17.128+0000 7f06d27fc640 1 --2- 172.21.15.150:0/3882731666 >> [v2:172.21.15.176:6834/4093204117,v1:172.21.15.176:6836/4093204117] conn(0x556325d7ce40 0x55632617d7b0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=50b85e39ad840284 server_cookie=3024d31142a7ac3e in_seq=0 out_seq=0 2024-09-17T05:48:17.135 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:17.129+0000 7f06b1ffb640 1 -- 172.21.15.150:0/3882731666 <== mds.0 v2:172.21.15.176:6834/4093204117 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5563260da770 con 0x556325d7ce40 2024-09-17T05:48:17.135 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:17.129+0000 7f06b1ffb640 10 client.7290 handle_command_reply: tid=0 2024-09-17T05:48:17.135 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:17.129+0000 7f06e04d7740 1 client.7290 shutdown 2024-09-17T05:48:17.135 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:17.129+0000 7f06e04d7740 1 -- 172.21.15.150:0/3882731666 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x556325d953b0 msgr2=0x5563261ba820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:48:17.135 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:17.129+0000 7f06e04d7740 1 --2- 172.21.15.150:0/3882731666 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x556325d953b0 0x5563261ba820 secure :-1 s=READY pgs=1034 cs=0 l=1 rev1=1 crypto rx=0x7f06c400ac40 tx=0x7f06c4004ab0 comp rx=0 tx=0).stop 2024-09-17T05:48:17.135 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:17.129+0000 7f06e04d7740 1 -- 172.21.15.150:0/3882731666 shutdown_connections 2024-09-17T05:48:17.135 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:17.129+0000 7f06e04d7740 1 --2- 172.21.15.150:0/3882731666 >> [v2:172.21.15.176:6834/4093204117,v1:172.21.15.176:6836/4093204117] conn(0x556325d7ce40 0x55632617d7b0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:48:17.135 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:17.129+0000 7f06e04d7740 1 --2- 172.21.15.150:0/3882731666 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x556325d9d590 0x556326179490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:48:17.135 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:17.129+0000 7f06e04d7740 1 --2- 172.21.15.150:0/3882731666 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x556325dbe270 0x5563261bd2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:48:17.135 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:17.129+0000 7f06b1ffb640 0 client.7290 ms_handle_reset on v2:172.21.15.176:6834/4093204117 2024-09-17T05:48:17.136 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:17.129+0000 7f06e04d7740 1 --2- 172.21.15.150:0/3882731666 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x556325d953b0 0x5563261ba820 unknown :-1 s=CLOSED pgs=1034 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:48:17.136 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:17.129+0000 7f06e04d7740 1 -- 172.21.15.150:0/3882731666 >> 172.21.15.150:0/3882731666 conn(0x556325db23c0 msgr2=0x55632617fed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:48:17.136 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:17.129+0000 7f06e04d7740 1 -- 172.21.15.150:0/3882731666 shutdown_connections 2024-09-17T05:48:17.136 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:17.129+0000 7f06e04d7740 1 -- 172.21.15.150:0/3882731666 wait complete. 2024-09-17T05:48:17.136 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:17.129+0000 7f06e04d7740 20 client.7290 trim_cache size 0 max 16384 2024-09-17T05:48:17.149 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:17.147+0000 7f06e04d7740 1 Processor -- start 2024-09-17T05:48:17.149 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:17.147+0000 7f06e04d7740 1 -- start start 2024-09-17T05:48:17.151 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:17.149+0000 7f06e04d7740 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x556325d7ce40 0x5563261662e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:48:17.151 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:17.149+0000 7f06e04d7740 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x556325d953b0 0x5563261b6ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:48:17.151 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:17.149+0000 7f06e04d7740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x556325d9d590 0x5563261b70e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:48:17.151 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:17.149+0000 7f06e04d7740 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f06d40b6db0 con 0x556325d953b0 2024-09-17T05:48:17.151 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:17.149+0000 7f06e04d7740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f06d40b6110 con 0x556325d9d590 2024-09-17T05:48:17.151 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:17.149+0000 7f06e04d7740 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f06d40b6760 con 0x556325d7ce40 2024-09-17T05:48:17.151 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:17.149+0000 7f06d27fc640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x556325d953b0 0x5563261b6ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:48:17.151 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:17.149+0000 7f06d27fc640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x556325d953b0 0x5563261b6ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:34286/0 (socket says 172.21.15.150:34286) 2024-09-17T05:48:17.151 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:17.149+0000 7f06d27fc640 1 -- 172.21.15.150:0/2519276628 learned_addr learned my addr 172.21.15.150:0/2519276628 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:48:17.152 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:17.149+0000 7f06d37fe640 1 --2- 172.21.15.150:0/2519276628 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x556325d9d590 0x5563261b70e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:48:17.152 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:17.149+0000 7f06d2ffd640 1 --2- 172.21.15.150:0/2519276628 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x556325d7ce40 0x5563261662e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:48:17.152 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:17.149+0000 7f06d27fc640 1 -- 172.21.15.150:0/2519276628 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x556325d7ce40 msgr2=0x5563261662e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:48:17.152 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:17.149+0000 7f06d27fc640 1 --2- 172.21.15.150:0/2519276628 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x556325d7ce40 0x5563261662e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:48:17.152 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:17.149+0000 7f06d27fc640 1 -- 172.21.15.150:0/2519276628 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x556325d9d590 msgr2=0x5563261b70e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:48:17.152 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:17.149+0000 7f06d27fc640 1 --2- 172.21.15.150:0/2519276628 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x556325d9d590 0x5563261b70e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:48:17.152 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:17.149+0000 7f06d27fc640 1 -- 172.21.15.150:0/2519276628 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55632617c290 con 0x556325d953b0 2024-09-17T05:48:17.152 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:17.149+0000 7f06d2ffd640 1 --2- 172.21.15.150:0/2519276628 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x556325d7ce40 0x5563261662e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T05:48:17.152 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:17.149+0000 7f06d27fc640 1 --2- 172.21.15.150:0/2519276628 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x556325d953b0 0x5563261b6ba0 secure :-1 s=READY pgs=1035 cs=0 l=1 rev1=1 crypto rx=0x7f06c800b3e0 tx=0x7f06c8078f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1959f0b4da2c8efa server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:48:17.152 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:17.149+0000 7f06b3fff640 1 -- 172.21.15.150:0/2519276628 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06c80679e0 con 0x556325d953b0 2024-09-17T05:48:17.152 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:17.149+0000 7f06b3fff640 1 -- 172.21.15.150:0/2519276628 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f06c805f220 con 0x556325d953b0 2024-09-17T05:48:17.152 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:17.149+0000 7f06b3fff640 1 -- 172.21.15.150:0/2519276628 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06c8085320 con 0x556325d953b0 2024-09-17T05:48:17.157 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:17.150+0000 7f06e04d7740 1 -- 172.21.15.150:0/2519276628 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x556325d953b0 msgr2=0x5563261b6ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:48:17.157 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:17.150+0000 7f06e04d7740 1 --2- 172.21.15.150:0/2519276628 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x556325d953b0 0x5563261b6ba0 secure :-1 s=READY pgs=1035 cs=0 l=1 rev1=1 crypto rx=0x7f06c800b3e0 tx=0x7f06c8078f90 comp rx=0 tx=0).stop 2024-09-17T05:48:17.157 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:17.150+0000 7f06e04d7740 1 -- 172.21.15.150:0/2519276628 shutdown_connections 2024-09-17T05:48:17.157 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:17.150+0000 7f06e04d7740 1 --2- 172.21.15.150:0/2519276628 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x556325d9d590 0x5563261b70e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:48:17.157 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:17.150+0000 7f06e04d7740 1 --2- 172.21.15.150:0/2519276628 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x556325d953b0 0x5563261b6ba0 unknown :-1 s=CLOSED pgs=1035 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:48:17.157 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:17.150+0000 7f06e04d7740 1 --2- 172.21.15.150:0/2519276628 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x556325d7ce40 0x5563261662e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:48:17.157 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:17.150+0000 7f06e04d7740 1 -- 172.21.15.150:0/2519276628 >> 172.21.15.150:0/2519276628 conn(0x556325db23c0 msgr2=0x5563261a0d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:48:17.157 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:17.150+0000 7f06e04d7740 1 -- 172.21.15.150:0/2519276628 shutdown_connections 2024-09-17T05:48:17.158 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:17.150+0000 7f06e04d7740 1 -- 172.21.15.150:0/2519276628 wait complete. 2024-09-17T05:48:17.158 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:17.151+0000 7f06e04d7740 1 -- start start 2024-09-17T05:48:17.158 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:17.151+0000 7f06e04d7740 1 Processor -- start 2024-09-17T05:48:17.158 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:17.152+0000 7f06e04d7740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x556325d7ce40 0x5563262209f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:48:17.158 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:17.152+0000 7f06e04d7740 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x556325d953b0 0x55632622d6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:48:17.158 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:17.152+0000 7f06e04d7740 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x556325d9d590 0x5563261c3b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:48:17.158 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:17.152+0000 7f06e04d7740 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x5563261bda80 con 0x556325d953b0 2024-09-17T05:48:17.158 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:17.152+0000 7f06e04d7740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x5563261b9d80 con 0x556325d7ce40 2024-09-17T05:48:17.158 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:17.152+0000 7f06e04d7740 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x55632617be50 con 0x556325d9d590 2024-09-17T05:48:17.158 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:17.152+0000 7f06e04d7740 10 client.0 _ll_register_callbacks cb 0x7f06c400aab0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T05:48:17.158 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:17.152+0000 7f06d27fc640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x556325d953b0 0x55632622d6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:48:17.158 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:17.152+0000 7f06d27fc640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x556325d953b0 0x55632622d6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:34300/0 (socket says 172.21.15.150:34300) 2024-09-17T05:48:17.158 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:17.152+0000 7f06d27fc640 1 -- 172.21.15.150:0/3537409066 learned_addr learned my addr 172.21.15.150:0/3537409066 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:48:17.158 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:17.153+0000 7f06d37fe640 1 --2- 172.21.15.150:0/3537409066 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x556325d9d590 0x5563261c3b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:48:17.159 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:17.153+0000 7f06d2ffd640 1 --2- 172.21.15.150:0/3537409066 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x556325d7ce40 0x5563262209f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:48:17.159 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:17.153+0000 7f06d27fc640 1 -- 172.21.15.150:0/3537409066 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x556325d9d590 msgr2=0x5563261c3b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:48:17.159 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:17.153+0000 7f06d27fc640 1 --2- 172.21.15.150:0/3537409066 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x556325d9d590 0x5563261c3b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:48:17.159 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:17.153+0000 7f06d27fc640 1 -- 172.21.15.150:0/3537409066 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x556325d7ce40 msgr2=0x5563262209f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:48:17.159 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:17.153+0000 7f06d27fc640 1 --2- 172.21.15.150:0/3537409066 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x556325d7ce40 0x5563262209f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:48:17.159 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:17.153+0000 7f06d27fc640 1 -- 172.21.15.150:0/3537409066 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556326220f30 con 0x556325d953b0 2024-09-17T05:48:17.159 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:17.153+0000 7f06d2ffd640 1 --2- 172.21.15.150:0/3537409066 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x556325d7ce40 0x5563262209f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T05:48:17.159 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:17.153+0000 7f06d27fc640 1 --2- 172.21.15.150:0/3537409066 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x556325d953b0 0x55632622d6b0 secure :-1 s=READY pgs=1036 cs=0 l=1 rev1=1 crypto rx=0x7f06c8062cb0 tx=0x7f06c8099c90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=290ca4fed6169a78 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:48:17.159 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:17.153+0000 7f06b1ffb640 10 client.0 ms_handle_connect on v2:172.21.15.150:3300/0 2024-09-17T05:48:17.159 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:17.153+0000 7f06b1ffb640 1 -- 172.21.15.150:0/3537409066 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06c8085310 con 0x556325d953b0 2024-09-17T05:48:17.159 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:17.153+0000 7f06b1ffb640 1 -- 172.21.15.150:0/3537409066 <== mon.0 v2:172.21.15.150:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 5793+0+0 (secure 0 0 0) 0x7f06c8062210 con 0x556325d953b0 2024-09-17T05:48:17.159 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:17.153+0000 7f06e04d7740 1 -- 172.21.15.150:0/3537409066 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f06c805f220 con 0x556325d953b0 2024-09-17T05:48:17.159 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:17.153+0000 7f06b1ffb640 1 -- 172.21.15.150:0/3537409066 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_get_version_reply(handle=1 version=51) ==== 24+0+0 (secure 0 0 0) 0x7f06c806c800 con 0x556325d953b0 2024-09-17T05:48:17.160 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:17.153+0000 7f06e04d7740 10 client.7296 fetch_fsmap learned FSMap version 51 2024-09-17T05:48:17.160 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:17.153+0000 7f06e04d7740 1 -- 172.21.15.150:0/3537409066 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,fsmap=51,monmap=2+}) -- 0x55632622dfa0 con 0x556325d953b0 2024-09-17T05:48:17.160 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:17.153+0000 7f06b1ffb640 1 -- 172.21.15.150:0/3537409066 <== mon.0 v2:172.21.15.150:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f06c805f220 con 0x556325d953b0 2024-09-17T05:48:17.160 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:17.153+0000 7f06b1ffb640 1 -- 172.21.15.150:0/3537409066 <== mon.0 v2:172.21.15.150:3300/0 5 ==== fsmap(e 51) ==== 3502+0+0 (secure 0 0 0) 0x7f06c805e900 con 0x556325d953b0 2024-09-17T05:48:17.160 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:17.153+0000 7f06e04d7740 10 client.7296 fetch_fsmap finished waiting for FSMap version 51 2024-09-17T05:48:17.160 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:17.153+0000 7f06e04d7740 10 client.7296 resolve_mds: resolved name 'd' to daemon mds.d 2024-09-17T05:48:17.160 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:17.153+0000 7f06e04d7740 20 client.7296 populate_metadata read hostname 'smithi150' 2024-09-17T05:48:17.160 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:17.153+0000 7f06e04d7740 1 --2- 172.21.15.150:0/3537409066 >> [v2:172.21.15.176:6834/4093204117,v1:172.21.15.176:6836/4093204117] conn(0x556325d52280 0x5563261bd150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:48:17.160 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:17.153+0000 7f06e04d7740 4 client.7296 mds_command: new command op to 6496 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-17T05:48:17.160 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:17.153+0000 7f06e04d7740 1 -- 172.21.15.150:0/3537409066 --> [v2:172.21.15.176:6834/4093204117,v1:172.21.15.176:6836/4093204117] -- command(tid 0: {"prefix": "status"}) -- 0x5563260d6220 con 0x556325d52280 2024-09-17T05:48:17.160 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:17.154+0000 7f06d2ffd640 1 --2- 172.21.15.150:0/3537409066 >> [v2:172.21.15.176:6834/4093204117,v1:172.21.15.176:6836/4093204117] conn(0x556325d52280 0x5563261bd150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:48:17.160 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:17.154+0000 7f06b1ffb640 10 client.7296 ms_handle_connect on v2:172.21.15.176:6834/4093204117 2024-09-17T05:48:17.160 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:17.154+0000 7f06d2ffd640 1 --2- 172.21.15.150:0/3537409066 >> [v2:172.21.15.176:6834/4093204117,v1:172.21.15.176:6836/4093204117] conn(0x556325d52280 0x5563261bd150 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=828642c86f00462 server_cookie=3a18ca537ab5c12 in_seq=0 out_seq=0 2024-09-17T05:48:17.161 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:17.154+0000 7f06b1ffb640 1 -- 172.21.15.150:0/3537409066 <== mds.0 v2:172.21.15.176:6834/4093204117 1 ==== command_reply(tid 0: 0 ) ==== 8+0+331 (crc 0 0 0) 0x5563260d6220 con 0x556325d52280 2024-09-17T05:48:17.161 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:17.154+0000 7f06b1ffb640 10 client.7296 handle_command_reply: tid=0 2024-09-17T05:48:17.161 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:17.154+0000 7f06e04d7740 1 client.7296 shutdown 2024-09-17T05:48:17.161 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:17.154+0000 7f06e04d7740 1 -- 172.21.15.150:0/3537409066 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x556325d953b0 msgr2=0x55632622d6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:48:17.161 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:17.154+0000 7f06e04d7740 1 --2- 172.21.15.150:0/3537409066 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x556325d953b0 0x55632622d6b0 secure :-1 s=READY pgs=1036 cs=0 l=1 rev1=1 crypto rx=0x7f06c8062cb0 tx=0x7f06c8099c90 comp rx=0 tx=0).stop 2024-09-17T05:48:17.161 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:17.154+0000 7f06e04d7740 1 -- 172.21.15.150:0/3537409066 shutdown_connections 2024-09-17T05:48:17.161 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:17.154+0000 7f06e04d7740 1 --2- 172.21.15.150:0/3537409066 >> [v2:172.21.15.176:6834/4093204117,v1:172.21.15.176:6836/4093204117] conn(0x556325d52280 0x5563261bd150 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:48:17.161 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:17.154+0000 7f06e04d7740 1 --2- 172.21.15.150:0/3537409066 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x556325d9d590 0x5563261c3b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:48:17.161 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:17.154+0000 7f06e04d7740 1 --2- 172.21.15.150:0/3537409066 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x556325d953b0 0x55632622d6b0 unknown :-1 s=CLOSED pgs=1036 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:48:17.161 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:17.154+0000 7f06b1ffb640 0 client.7296 ms_handle_reset on v2:172.21.15.176:6834/4093204117 2024-09-17T05:48:17.161 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:17.154+0000 7f06e04d7740 1 --2- 172.21.15.150:0/3537409066 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x556325d7ce40 0x5563262209f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:48:17.161 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:17.155+0000 7f06e04d7740 1 -- 172.21.15.150:0/3537409066 >> 172.21.15.150:0/3537409066 conn(0x556325db23c0 msgr2=0x556326160b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:48:17.161 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:17.155+0000 7f06e04d7740 1 -- 172.21.15.150:0/3537409066 shutdown_connections 2024-09-17T05:48:17.161 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:17.155+0000 7f06e04d7740 1 -- 172.21.15.150:0/3537409066 wait complete. 2024-09-17T05:48:17.162 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:17.155+0000 7f06e04d7740 20 client.7296 trim_cache size 0 max 16384 2024-09-17T05:48:17.162 INFO:teuthology.orchestra.run.smithi150.stdout:{ 2024-09-17T05:48:17.162 INFO:teuthology.orchestra.run.smithi150.stdout: "cluster_fsid": "9f2e05e9-d629-47b3-b26b-1360655b7d20", 2024-09-17T05:48:17.162 INFO:teuthology.orchestra.run.smithi150.stdout: "whoami": 0, 2024-09-17T05:48:17.162 INFO:teuthology.orchestra.run.smithi150.stdout: "id": 6496, 2024-09-17T05:48:17.162 INFO:teuthology.orchestra.run.smithi150.stdout: "want_state": "up:active", 2024-09-17T05:48:17.162 INFO:teuthology.orchestra.run.smithi150.stdout: "state": "up:active", 2024-09-17T05:48:17.162 INFO:teuthology.orchestra.run.smithi150.stdout: "fs_name": "cephfs", 2024-09-17T05:48:17.162 INFO:teuthology.orchestra.run.smithi150.stdout: "rank_uptime": 10.149484041999999, 2024-09-17T05:48:17.162 INFO:teuthology.orchestra.run.smithi150.stdout: "mdsmap_epoch": 51, 2024-09-17T05:48:17.163 INFO:teuthology.orchestra.run.smithi150.stdout: "osdmap_epoch": 86, 2024-09-17T05:48:17.163 INFO:teuthology.orchestra.run.smithi150.stdout: "osdmap_epoch_barrier": 86, 2024-09-17T05:48:17.163 INFO:teuthology.orchestra.run.smithi150.stdout: "uptime": 14.834621003000001 2024-09-17T05:48:17.163 INFO:teuthology.orchestra.run.smithi150.stdout:} 2024-09-17T05:48:17.164 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:17.155+0000 7f06d9569640 1 -- 172.21.15.150:0/1717911763 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f06c0079d30 msgr2=0x7f06c007c240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:48:17.164 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:17.155+0000 7f06d9569640 1 --2- 172.21.15.150:0/1717911763 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f06c0079d30 0x7f06c007c240 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f06c4005be0 tx=0x7f06c400a550 comp rx=0 tx=0).stop 2024-09-17T05:48:17.164 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:17.155+0000 7f06d9569640 1 -- 172.21.15.150:0/1717911763 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f06d40d15d0 msgr2=0x7f06d4157bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:48:17.164 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:17.155+0000 7f06d9569640 1 --2- 172.21.15.150:0/1717911763 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f06d40d15d0 0x7f06d4157bf0 secure :-1 s=READY pgs=1032 cs=0 l=1 rev1=1 crypto rx=0x7f06c800b410 tx=0x7f06c8009f90 comp rx=0 tx=0).stop 2024-09-17T05:48:17.164 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:17.155+0000 7f06d9569640 1 -- 172.21.15.150:0/1717911763 shutdown_connections 2024-09-17T05:48:17.164 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:17.155+0000 7f06d9569640 1 --2- 172.21.15.150:0/1717911763 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f06c0079d30 0x7f06c007c240 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:48:17.164 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:17.155+0000 7f06d9569640 1 --2- 172.21.15.150:0/1717911763 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f06d415ee50 0x7f06d415daf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:48:17.164 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:17.155+0000 7f06d9569640 1 --2- 172.21.15.150:0/1717911763 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f06d40d15d0 0x7f06d4157bf0 unknown :-1 s=CLOSED pgs=1032 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:48:17.164 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:17.155+0000 7f06d9569640 1 --2- 172.21.15.150:0/1717911763 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f06d40b9780 0x7f06d4149390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:48:17.164 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:17.155+0000 7f06d9569640 1 -- 172.21.15.150:0/1717911763 >> 172.21.15.150:0/1717911763 conn(0x7f06d40d4680 msgr2=0x7f06d40b8ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:48:17.164 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:17.155+0000 7f06d9569640 1 -- 172.21.15.150:0/1717911763 shutdown_connections 2024-09-17T05:48:17.165 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:17.155+0000 7f06d9569640 1 -- 172.21.15.150:0/1717911763 wait complete. 2024-09-17T05:48:17.168 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-17T05:48:17.282 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:17.280+0000 7fbecd2bd640 1 -- 172.21.15.150:0/298595131 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbec80b1fd0 msgr2=0x7fbec8167d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:48:17.282 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:17.280+0000 7fbecd2bd640 1 --2- 172.21.15.150:0/298595131 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbec80b1fd0 0x7fbec8167d50 secure :-1 s=READY pgs=1038 cs=0 l=1 rev1=1 crypto rx=0x7fbec0005fd0 tx=0x7fbec002a9d0 comp rx=0 tx=0).stop 2024-09-17T05:48:17.282 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:17.280+0000 7fbecd2bd640 1 -- 172.21.15.150:0/298595131 shutdown_connections 2024-09-17T05:48:17.282 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:17.280+0000 7fbecd2bd640 1 --2- 172.21.15.150:0/298595131 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbec80b1fd0 0x7fbec8167d50 unknown :-1 s=CLOSED pgs=1038 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:48:17.282 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:17.280+0000 7fbecd2bd640 1 -- 172.21.15.150:0/298595131 >> 172.21.15.150:0/298595131 conn(0x7fbec80b3fc0 msgr2=0x7fbec80b43d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:48:17.282 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:17.280+0000 7fbecd2bd640 1 -- 172.21.15.150:0/298595131 shutdown_connections 2024-09-17T05:48:17.283 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:17.280+0000 7fbecd2bd640 1 -- 172.21.15.150:0/298595131 wait complete. 2024-09-17T05:48:17.283 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:17.282+0000 7fbecd2bd640 1 Processor -- start 2024-09-17T05:48:17.283 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:17.282+0000 7fbecd2bd640 1 -- start start 2024-09-17T05:48:17.289 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:17.283+0000 7fbecd2bd640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fbec80b1fd0 0x7fbec81496e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:48:17.289 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:17.283+0000 7fbecd2bd640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbec80d0c50 0x7fbec81f71a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:48:17.289 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:17.283+0000 7fbecd2bd640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fbec80d1060 0x7fbec81f76e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:48:17.289 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:17.283+0000 7fbecd2bd640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7fbec80ceb70 con 0x7fbec80d0c50 2024-09-17T05:48:17.289 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:17.283+0000 7fbecd2bd640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fbec8070a80 con 0x7fbec80b1fd0 2024-09-17T05:48:17.289 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:17.283+0000 7fbecd2bd640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fbec80cecf0 con 0x7fbec80d1060 2024-09-17T05:48:17.289 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:17.283+0000 7fbebe7fc640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbec80d0c50 0x7fbec81f71a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:48:17.290 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:17.283+0000 7fbebe7fc640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbec80d0c50 0x7fbec81f71a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:34316/0 (socket says 172.21.15.150:34316) 2024-09-17T05:48:17.290 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:17.283+0000 7fbebe7fc640 1 -- 172.21.15.150:0/261178437 learned_addr learned my addr 172.21.15.150:0/261178437 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:48:17.290 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:17.284+0000 7fbec6ffd640 1 --2- 172.21.15.150:0/261178437 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fbec80b1fd0 0x7fbec81496e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:48:17.290 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:17.284+0000 7fbec77fe640 1 --2- 172.21.15.150:0/261178437 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fbec80d1060 0x7fbec81f76e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:48:17.290 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:17.284+0000 7fbebe7fc640 1 -- 172.21.15.150:0/261178437 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fbec80d1060 msgr2=0x7fbec81f76e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:48:17.290 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:17.284+0000 7fbebe7fc640 1 --2- 172.21.15.150:0/261178437 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fbec80d1060 0x7fbec81f76e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:48:17.290 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:17.284+0000 7fbebe7fc640 1 -- 172.21.15.150:0/261178437 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fbec80b1fd0 msgr2=0x7fbec81496e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:48:17.290 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:17.284+0000 7fbebe7fc640 1 --2- 172.21.15.150:0/261178437 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fbec80b1fd0 0x7fbec81496e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:48:17.290 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:17.284+0000 7fbebe7fc640 1 -- 172.21.15.150:0/261178437 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbec80c60a0 con 0x7fbec80d0c50 2024-09-17T05:48:17.290 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:17.284+0000 7fbec77fe640 1 --2- 172.21.15.150:0/261178437 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fbec80d1060 0x7fbec81f76e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T05:48:17.290 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:17.284+0000 7fbebe7fc640 1 --2- 172.21.15.150:0/261178437 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbec80d0c50 0x7fbec81f71a0 secure :-1 s=READY pgs=1039 cs=0 l=1 rev1=1 crypto rx=0x7fbeb000c3c0 tx=0x7fbeb000c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:48:17.290 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:17.284+0000 7fbebffff640 1 -- 172.21.15.150:0/261178437 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbeb0017070 con 0x7fbec80d0c50 2024-09-17T05:48:17.290 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:17.284+0000 7fbebffff640 1 -- 172.21.15.150:0/261178437 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fbeb00035f0 con 0x7fbec80d0c50 2024-09-17T05:48:17.290 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:17.284+0000 7fbecd2bd640 1 -- 172.21.15.150:0/261178437 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbec80c6380 con 0x7fbec80d0c50 2024-09-17T05:48:17.291 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:17.284+0000 7fbebffff640 1 -- 172.21.15.150:0/261178437 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbeb0003a40 con 0x7fbec80d0c50 2024-09-17T05:48:17.291 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:17.284+0000 7fbecd2bd640 1 -- 172.21.15.150:0/261178437 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbec80c6940 con 0x7fbec80d0c50 2024-09-17T05:48:17.291 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:17.285+0000 7fbecd2bd640 1 -- 172.21.15.150:0/261178437 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbec81f7cb0 con 0x7fbec80d0c50 2024-09-17T05:48:17.291 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:17.287+0000 7fbebffff640 1 -- 172.21.15.150:0/261178437 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 25) ==== 103022+0+0 (secure 0 0 0) 0x7fbeb001a070 con 0x7fbec80d0c50 2024-09-17T05:48:17.291 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:17.287+0000 7fbebffff640 1 --2- 172.21.15.150:0/261178437 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fbea8079d30 0x7fbea807c240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:48:17.291 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:17.287+0000 7fbebffff640 1 -- 172.21.15.150:0/261178437 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 5793+0+0 (secure 0 0 0) 0x7fbeb0099210 con 0x7fbec80d0c50 2024-09-17T05:48:17.291 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:17.287+0000 7fbec6ffd640 1 --2- 172.21.15.150:0/261178437 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fbea8079d30 0x7fbea807c240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:48:17.291 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:17.288+0000 7fbec6ffd640 1 --2- 172.21.15.150:0/261178437 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fbea8079d30 0x7fbea807c240 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7fbeb8000f60 tx=0x7fbeb8009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:48:17.292 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:17.291+0000 7fbebffff640 1 -- 172.21.15.150:0/261178437 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fbeb0021020 con 0x7fbec80d0c50 2024-09-17T05:48:17.504 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:17.502+0000 7fbecd2bd640 1 -- 172.21.15.150:0/261178437 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7fbec80d17b0 con 0x7fbec80d0c50 2024-09-17T05:48:17.504 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:17.503+0000 7fbebffff640 1 -- 172.21.15.150:0/261178437 <== mon.0 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v51) ==== 53+0+73 (secure 0 0 0) 0x7fbec80d17b0 con 0x7fbec80d0c50 2024-09-17T05:48:17.504 INFO:teuthology.orchestra.run.smithi150.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-17T05:48:17.507 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:17.505+0000 7fbecd2bd640 1 -- 172.21.15.150:0/261178437 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fbea8079d30 msgr2=0x7fbea807c240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:48:17.507 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:17.505+0000 7fbecd2bd640 1 --2- 172.21.15.150:0/261178437 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fbea8079d30 0x7fbea807c240 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7fbeb8000f60 tx=0x7fbeb8009040 comp rx=0 tx=0).stop 2024-09-17T05:48:17.507 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:17.505+0000 7fbecd2bd640 1 -- 172.21.15.150:0/261178437 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbec80d0c50 msgr2=0x7fbec81f71a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:48:17.507 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:17.505+0000 7fbecd2bd640 1 --2- 172.21.15.150:0/261178437 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbec80d0c50 0x7fbec81f71a0 secure :-1 s=READY pgs=1039 cs=0 l=1 rev1=1 crypto rx=0x7fbeb000c3c0 tx=0x7fbeb000c880 comp rx=0 tx=0).stop 2024-09-17T05:48:17.507 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:17.505+0000 7fbecd2bd640 1 -- 172.21.15.150:0/261178437 shutdown_connections 2024-09-17T05:48:17.507 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:17.505+0000 7fbecd2bd640 1 --2- 172.21.15.150:0/261178437 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fbea8079d30 0x7fbea807c240 unknown :-1 s=CLOSED pgs=450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:48:17.507 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:17.505+0000 7fbecd2bd640 1 --2- 172.21.15.150:0/261178437 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fbec80d1060 0x7fbec81f76e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:48:17.507 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:17.505+0000 7fbecd2bd640 1 --2- 172.21.15.150:0/261178437 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbec80d0c50 0x7fbec81f71a0 unknown :-1 s=CLOSED pgs=1039 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:48:17.507 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:17.505+0000 7fbecd2bd640 1 --2- 172.21.15.150:0/261178437 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fbec80b1fd0 0x7fbec81496e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:48:17.507 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:17.505+0000 7fbecd2bd640 1 -- 172.21.15.150:0/261178437 >> 172.21.15.150:0/261178437 conn(0x7fbec80b3fc0 msgr2=0x7fbec80b2580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:48:17.507 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:17.505+0000 7fbecd2bd640 1 -- 172.21.15.150:0/261178437 shutdown_connections 2024-09-17T05:48:17.508 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:17.505+0000 7fbecd2bd640 1 -- 172.21.15.150:0/261178437 wait complete. 2024-09-17T05:48:17.518 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-09-17T05:48:17.518 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-17T05:48:17.519 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi150.front.sepia.ceph.com 2024-09-17T05:48:17.519 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-17T05:48:17.519 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-17T05:48:17.519 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-09-17T05:48:17.519 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-09-17T05:48:17.519 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-17T05:48:17.519 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-17T05:48:17.519 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:48:17.519 DEBUG:teuthology.orchestra.run.smithi150:> ip addr 2024-09-17T05:48:17.535 INFO:teuthology.orchestra.run.smithi150.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-17T05:48:17.535 INFO:teuthology.orchestra.run.smithi150.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-17T05:48:17.535 INFO:teuthology.orchestra.run.smithi150.stdout: inet 127.0.0.1/8 scope host lo 2024-09-17T05:48:17.536 INFO:teuthology.orchestra.run.smithi150.stdout: valid_lft forever preferred_lft forever 2024-09-17T05:48:17.536 INFO:teuthology.orchestra.run.smithi150.stdout: inet6 ::1/128 scope host 2024-09-17T05:48:17.536 INFO:teuthology.orchestra.run.smithi150.stdout: valid_lft forever preferred_lft forever 2024-09-17T05:48:17.536 INFO:teuthology.orchestra.run.smithi150.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-17T05:48:17.536 INFO:teuthology.orchestra.run.smithi150.stdout: link/ether 0c:c4:7a:d9:da:bc brd ff:ff:ff:ff:ff:ff 2024-09-17T05:48:17.536 INFO:teuthology.orchestra.run.smithi150.stdout: altname enp7s0f0 2024-09-17T05:48:17.536 INFO:teuthology.orchestra.run.smithi150.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-17T05:48:17.536 INFO:teuthology.orchestra.run.smithi150.stdout: link/ether 0c:c4:7a:d9:da:bd brd ff:ff:ff:ff:ff:ff 2024-09-17T05:48:17.536 INFO:teuthology.orchestra.run.smithi150.stdout: altname enp7s0f1 2024-09-17T05:48:17.536 INFO:teuthology.orchestra.run.smithi150.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-17T05:48:17.537 INFO:teuthology.orchestra.run.smithi150.stdout: link/ether 0c:c4:7a:88:6e:34 brd ff:ff:ff:ff:ff:ff 2024-09-17T05:48:17.537 INFO:teuthology.orchestra.run.smithi150.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-17T05:48:17.537 INFO:teuthology.orchestra.run.smithi150.stdout: link/ether 0c:c4:7a:88:6e:35 brd ff:ff:ff:ff:ff:ff 2024-09-17T05:48:17.537 INFO:teuthology.orchestra.run.smithi150.stdout: inet 172.21.15.150/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-09-17T05:48:17.537 INFO:teuthology.orchestra.run.smithi150.stdout: valid_lft 42417sec preferred_lft 42417sec 2024-09-17T05:48:17.537 INFO:teuthology.orchestra.run.smithi150.stdout: inet6 fe80::ec4:7aff:fe88:6e35/64 scope link noprefixroute 2024-09-17T05:48:17.537 INFO:teuthology.orchestra.run.smithi150.stdout: valid_lft forever preferred_lft forever 2024-09-17T05:48:17.537 INFO:teuthology.orchestra.run.smithi150.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-17T05:48:17.537 INFO:teuthology.orchestra.run.smithi150.stdout: link/ether 1a:d2:4c:31:46:82 brd ff:ff:ff:ff:ff:ff 2024-09-17T05:48:17.537 INFO:teuthology.orchestra.run.smithi150.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-17T05:48:17.537 INFO:teuthology.orchestra.run.smithi150.stdout: valid_lft forever preferred_lft forever 2024-09-17T05:48:17.537 INFO:teuthology.orchestra.run.smithi150.stdout: inet6 fe80::70b6:c6ff:fe60:62a2/64 scope link 2024-09-17T05:48:17.537 INFO:teuthology.orchestra.run.smithi150.stdout: valid_lft forever preferred_lft forever 2024-09-17T05:48:17.538 INFO:teuthology.orchestra.run.smithi150.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-17T05:48:17.538 INFO:teuthology.orchestra.run.smithi150.stdout: link/ether 32:e1:8b:37:8c:b3 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-17T05:48:17.538 INFO:teuthology.orchestra.run.smithi150.stdout: inet6 fe80::30e1:8bff:fe37:8cb3/64 scope link 2024-09-17T05:48:17.538 INFO:teuthology.orchestra.run.smithi150.stdout: valid_lft forever preferred_lft forever 2024-09-17T05:48:17.538 INFO:teuthology.orchestra.run.smithi150.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-17T05:48:17.538 INFO:teuthology.orchestra.run.smithi150.stdout: link/ether 1a:d2:4c:31:46:82 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-17T05:48:17.538 INFO:teuthology.orchestra.run.smithi150.stdout: inet6 fe80::18d2:4cff:fe31:4682/64 scope link 2024-09-17T05:48:17.538 INFO:teuthology.orchestra.run.smithi150.stdout: valid_lft forever preferred_lft forever 2024-09-17T05:48:17.538 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:48:17.539 DEBUG:teuthology.orchestra.run.smithi150:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-17T05:48:17.599 INFO:teuthology.orchestra.run.smithi150.stdout:1 2024-09-17T05:48:17.600 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:48:17.601 DEBUG:teuthology.orchestra.run.smithi150:> route 2024-09-17T05:48:17.657 INFO:teuthology.orchestra.run.smithi150.stdout:Kernel IP routing table 2024-09-17T05:48:17.657 INFO:teuthology.orchestra.run.smithi150.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-17T05:48:17.657 INFO:teuthology.orchestra.run.smithi150.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-17T05:48:17.657 INFO:teuthology.orchestra.run.smithi150.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-17T05:48:17.657 INFO:teuthology.orchestra.run.smithi150.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-17T05:48:17.657 DEBUG:teuthology.orchestra.run.smithi150:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-17T05:48:17.658 DEBUG:teuthology.orchestra.run.smithi150:> set -e 2024-09-17T05:48:17.658 DEBUG:teuthology.orchestra.run.smithi150:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-17T05:48:17.658 DEBUG:teuthology.orchestra.run.smithi150:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-17T05:48:17.658 DEBUG:teuthology.orchestra.run.smithi150:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-17T05:48:17.658 DEBUG:teuthology.orchestra.run.smithi150:> ') 2024-09-17T05:48:17.748 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:17 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-17T05:48:17.781 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:17 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T05:48:17.787 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:48:17.787 DEBUG:teuthology.orchestra.run.smithi150:> ip netns list 2024-09-17T05:48:17.803 INFO:teuthology.orchestra.run.smithi150.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-09-17T05:48:17.803 INFO:teuthology.orchestra.run.smithi150.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-17T05:48:17.803 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-17T05:48:17.803 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:48:17.803 DEBUG:teuthology.orchestra.run.smithi150:> sudo ip link set brx.0 up 2024-09-17T05:48:17.868 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-17T05:48:17.869 DEBUG:teuthology.orchestra.run.smithi150:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-17T05:48:17.924 INFO:teuthology.orchestra.run.smithi150.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-17T05:48:17.924 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-17T05:48:17.924 DEBUG:teuthology.orchestra.run.smithi150:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-17T05:48:17.980 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-09-17T05:48:17.980 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:48:17.981 DEBUG:teuthology.orchestra.run.smithi150:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-17T05:48:18.074 INFO:teuthology.orchestra.run.smithi150.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-17T05:48:18.075 INFO:teuthology.orchestra.run.smithi150.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-17T05:48:18.075 INFO:teuthology.orchestra.run.smithi150.stdout:invalid new device string format 2024-09-17T05:48:18.085 INFO:teuthology.orchestra.run.smithi150.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-17T05:48:18.086 INFO:teuthology.orchestra.run.smithi150.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-17T05:48:18.086 INFO:teuthology.orchestra.run.smithi150.stdout:invalid new device string format 2024-09-17T05:48:18.086 INFO:teuthology.orchestra.run.smithi150.stdout:mount.ceph: resolved to: "172.21.15.150:3300,172.21.15.176:3300,172.21.15.176:3301" 2024-09-17T05:48:18.086 INFO:teuthology.orchestra.run.smithi150.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-17T05:48:18.092 INFO:teuthology.orchestra.run.smithi150.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-17T05:48:18.092 INFO:teuthology.orchestra.run.smithi150.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-17T05:48:18.092 INFO:teuthology.orchestra.run.smithi150.stdout:invalid new device string format 2024-09-17T05:48:18.092 INFO:teuthology.orchestra.run.smithi150.stdout:mount.ceph: resolved to: "172.21.15.150:3300,172.21.15.176:3300,172.21.15.176:3301" 2024-09-17T05:48:18.092 INFO:teuthology.orchestra.run.smithi150.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-17T05:48:18.092 INFO:teuthology.orchestra.run.smithi150.stdout:mount.ceph: resolved to: "172.21.15.150:6789,172.21.15.176:6789,172.21.15.176:6790" 2024-09-17T05:48:18.092 INFO:teuthology.orchestra.run.smithi150.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.150:6789,172.21.15.176:6789,172.21.15.176:6790:/ 2024-09-17T05:48:18.092 INFO:teuthology.orchestra.run.smithi150.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=9f2e05e9-d629-47b3-b26b-1360655b7d20" will pass to kernel 2024-09-17T05:48:18.093 INFO:teuthology.orchestra.run.smithi150.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-09-17T05:48:18.093 INFO:teuthology.orchestra.run.smithi150.stdout: You just mounted a file system that supports labels which does not 2024-09-17T05:48:18.093 INFO:teuthology.orchestra.run.smithi150.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-09-17T05:48:18.093 INFO:teuthology.orchestra.run.smithi150.stdout: applications will generate AVC messages and not be allowed access to 2024-09-17T05:48:18.093 INFO:teuthology.orchestra.run.smithi150.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-09-17T05:48:18.095 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-17T05:48:18.095 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:48:18.095 DEBUG:teuthology.orchestra.run.smithi150:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-17T05:48:18.120 DEBUG:teuthology.orchestra.run.smithi150:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-17T05:48:18.213 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:18 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-17T05:48:18.223 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:18 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T05:48:18.229 INFO:teuthology.orchestra.run.smithi150.stdout:client7308 2024-09-17T05:48:18.230 DEBUG:teuthology.orchestra.run.smithi150:> set -ex 2024-09-17T05:48:18.230 DEBUG:teuthology.orchestra.run.smithi150:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T05:48:18.245 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs flag set enable_multiple true --yes-i-really-mean-it 2024-09-17T05:48:18.404 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:18.402+0000 7f5f58b72640 1 -- 172.21.15.150:0/88469973 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5f3c004d40 msgr2=0x7f5f3c005150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:48:18.405 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:18.402+0000 7f5f58b72640 1 --2- 172.21.15.150:0/88469973 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5f3c004d40 0x7f5f3c005150 secure :-1 s=READY pgs=1042 cs=0 l=1 rev1=1 crypto rx=0x7f5f54074d30 tx=0x7f5f3c005830 comp rx=0 tx=0).stop 2024-09-17T05:48:18.405 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:18.402+0000 7f5f52d9d640 1 -- 172.21.15.150:0/88469973 reap_dead start 2024-09-17T05:48:18.405 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:18.402+0000 7f5f58b72640 1 -- 172.21.15.150:0/88469973 shutdown_connections 2024-09-17T05:48:18.405 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:18.402+0000 7f5f58b72640 1 -- 172.21.15.150:0/88469973 >> 172.21.15.150:0/88469973 conn(0x7f5f54073890 msgr2=0x7f5f54073ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:48:18.405 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:18.402+0000 7f5f58b72640 1 -- 172.21.15.150:0/88469973 shutdown_connections 2024-09-17T05:48:18.405 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:18.402+0000 7f5f58b72640 1 -- 172.21.15.150:0/88469973 wait complete. 2024-09-17T05:48:18.406 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:18.404+0000 7f5f58b72640 1 Processor -- start 2024-09-17T05:48:18.406 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:18.404+0000 7f5f58b72640 1 -- start start 2024-09-17T05:48:18.408 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:18.406+0000 7f5f58b72640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5f3c004d40 0x7f5f541f5d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:48:18.408 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:18.406+0000 7f5f58b72640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5f540c9e70 0x7f5f54146420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:48:18.408 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:18.406+0000 7f5f58b72640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5f540cbf90 0x7f5f540cc3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:48:18.408 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:18.406+0000 7f5f58b72640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f5f540b5930 con 0x7f5f540cbf90 2024-09-17T05:48:18.409 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:18.406+0000 7f5f58b72640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f5f540b57b0 con 0x7f5f540c9e70 2024-09-17T05:48:18.409 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:18.406+0000 7f5f58b72640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f5f540b5ab0 con 0x7f5f3c004d40 2024-09-17T05:48:18.409 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:18.406+0000 7f5f52d9d640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5f540cbf90 0x7f5f540cc3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:48:18.409 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:18.406+0000 7f5f52d9d640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5f540cbf90 0x7f5f540cc3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:34338/0 (socket says 172.21.15.150:34338) 2024-09-17T05:48:18.409 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:18.406+0000 7f5f52d9d640 1 -- 172.21.15.150:0/1450033107 learned_addr learned my addr 172.21.15.150:0/1450033107 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:48:18.409 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:18.406+0000 7f5f5259c640 1 --2- 172.21.15.150:0/1450033107 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5f3c004d40 0x7f5f541f5d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:48:18.409 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:18.406+0000 7f5f51d9b640 1 --2- 172.21.15.150:0/1450033107 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5f540c9e70 0x7f5f54146420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:48:18.409 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:18.406+0000 7f5f52d9d640 1 -- 172.21.15.150:0/1450033107 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5f3c004d40 msgr2=0x7f5f541f5d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:48:18.409 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:18.406+0000 7f5f52d9d640 1 --2- 172.21.15.150:0/1450033107 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5f3c004d40 0x7f5f541f5d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:48:18.409 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:18.406+0000 7f5f52d9d640 1 -- 172.21.15.150:0/1450033107 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5f540c9e70 msgr2=0x7f5f54146420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:48:18.409 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:18.406+0000 7f5f52d9d640 1 --2- 172.21.15.150:0/1450033107 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5f540c9e70 0x7f5f54146420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:48:18.410 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:18.406+0000 7f5f52d9d640 1 -- 172.21.15.150:0/1450033107 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5f540cc8e0 con 0x7f5f540cbf90 2024-09-17T05:48:18.410 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:18.406+0000 7f5f52d9d640 1 --2- 172.21.15.150:0/1450033107 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5f540cbf90 0x7f5f540cc3a0 secure :-1 s=READY pgs=1043 cs=0 l=1 rev1=1 crypto rx=0x7f5f4c00c320 tx=0x7f5f4c006650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:48:18.410 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:18.406+0000 7f5f42ffd640 1 -- 172.21.15.150:0/1450033107 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f4c031050 con 0x7f5f540cbf90 2024-09-17T05:48:18.410 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:18.406+0000 7f5f42ffd640 1 -- 172.21.15.150:0/1450033107 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f5f4c036660 con 0x7f5f540cbf90 2024-09-17T05:48:18.410 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:18.407+0000 7f5f42ffd640 1 -- 172.21.15.150:0/1450033107 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f4c006c50 con 0x7f5f540cbf90 2024-09-17T05:48:18.410 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:18.407+0000 7f5f58b72640 1 -- 172.21.15.150:0/1450033107 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5f541f62d0 con 0x7f5f540cbf90 2024-09-17T05:48:18.410 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:18.407+0000 7f5f58b72640 1 -- 172.21.15.150:0/1450033107 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5f540cef30 con 0x7f5f540cbf90 2024-09-17T05:48:18.411 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:18.408+0000 7f5f58b72640 1 -- 172.21.15.150:0/1450033107 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5f5415c740 con 0x7f5f540cbf90 2024-09-17T05:48:18.411 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:18.408+0000 7f5f42ffd640 1 -- 172.21.15.150:0/1450033107 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 25) ==== 103022+0+0 (secure 0 0 0) 0x7f5f4c034070 con 0x7f5f540cbf90 2024-09-17T05:48:18.411 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:18.409+0000 7f5f42ffd640 1 --2- 172.21.15.150:0/1450033107 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f5f34079d00 0x7f5f3407c210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:48:18.411 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:18.409+0000 7f5f42ffd640 1 -- 172.21.15.150:0/1450033107 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 5793+0+0 (secure 0 0 0) 0x7f5f4c0b9560 con 0x7f5f540cbf90 2024-09-17T05:48:18.411 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:18.409+0000 7f5f5259c640 1 --2- 172.21.15.150:0/1450033107 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f5f34079d00 0x7f5f3407c210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:48:18.411 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:18.410+0000 7f5f5259c640 1 --2- 172.21.15.150:0/1450033107 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f5f34079d00 0x7f5f3407c210 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f5f44005fd0 tx=0x7f5f44009500 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:48:18.415 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:18.414+0000 7f5f42ffd640 1 -- 172.21.15.150:0/1450033107 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f5f4c045020 con 0x7f5f540cbf90 2024-09-17T05:48:18.625 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:18.623+0000 7f5f58b72640 1 -- 172.21.15.150:0/1450033107 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "fs flag set", "flag_name": "enable_multiple", "val": "true", "yes_i_really_mean_it": true} v 0) -- 0x7f5f5415cfa0 con 0x7f5f540cbf90 2024-09-17T05:48:19.245 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:19.243+0000 7f5f42ffd640 1 -- 172.21.15.150:0/1450033107 <== mon.0 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "fs flag set", "flag_name": "enable_multiple", "val": "true", "yes_i_really_mean_it": true}]=0 v52) ==== 136+0+0 (secure 0 0 0) 0x7f5f540cc8e0 con 0x7f5f540cbf90 2024-09-17T05:48:19.248 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:19.245+0000 7f5f58b72640 1 -- 172.21.15.150:0/1450033107 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f5f34079d00 msgr2=0x7f5f3407c210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:48:19.248 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:19.245+0000 7f5f58b72640 1 --2- 172.21.15.150:0/1450033107 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f5f34079d00 0x7f5f3407c210 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f5f44005fd0 tx=0x7f5f44009500 comp rx=0 tx=0).stop 2024-09-17T05:48:19.248 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:19.245+0000 7f5f58b72640 1 -- 172.21.15.150:0/1450033107 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5f540cbf90 msgr2=0x7f5f540cc3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:48:19.248 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:19.245+0000 7f5f58b72640 1 --2- 172.21.15.150:0/1450033107 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5f540cbf90 0x7f5f540cc3a0 secure :-1 s=READY pgs=1043 cs=0 l=1 rev1=1 crypto rx=0x7f5f4c00c320 tx=0x7f5f4c006650 comp rx=0 tx=0).stop 2024-09-17T05:48:19.248 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:19.245+0000 7f5f58b72640 1 -- 172.21.15.150:0/1450033107 shutdown_connections 2024-09-17T05:48:19.249 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:19.245+0000 7f5f58b72640 1 --2- 172.21.15.150:0/1450033107 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5f540c9e70 0x7f5f54146420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:48:19.249 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:19.245+0000 7f5f58b72640 1 --2- 172.21.15.150:0/1450033107 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f5f34079d00 0x7f5f3407c210 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:48:19.249 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:19.245+0000 7f5f58b72640 1 --2- 172.21.15.150:0/1450033107 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5f540cbf90 0x7f5f540cc3a0 unknown :-1 s=CLOSED pgs=1043 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:48:19.249 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:19.245+0000 7f5f58b72640 1 --2- 172.21.15.150:0/1450033107 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5f3c004d40 0x7f5f541f5d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:48:19.249 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:19.246+0000 7f5f58b72640 1 -- 172.21.15.150:0/1450033107 >> 172.21.15.150:0/1450033107 conn(0x7f5f54073890 msgr2=0x7f5f5415d560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:48:19.250 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:19.246+0000 7f5f58b72640 1 -- 172.21.15.150:0/1450033107 shutdown_connections 2024-09-17T05:48:19.250 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:19.246+0000 7f5f58b72640 1 -- 172.21.15.150:0/1450033107 wait complete. 2024-09-17T05:48:19.260 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume ls 2024-09-17T05:48:19.377 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:19.375+0000 7f88cde0e640 1 -- 172.21.15.150:0/2678277908 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f88b0004d40 msgr2=0x7f88b0005150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:48:19.377 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:19.375+0000 7f88cde0e640 1 --2- 172.21.15.150:0/2678277908 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f88b0004d40 0x7f88b0005150 secure :-1 s=READY pgs=1045 cs=0 l=1 rev1=1 crypto rx=0x7f88c0009ed0 tx=0x7f88b0005830 comp rx=0 tx=0).stop 2024-09-17T05:48:19.377 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:19.375+0000 7f88c7fff640 1 -- 172.21.15.150:0/2678277908 reap_dead start 2024-09-17T05:48:19.377 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:19.375+0000 7f88cde0e640 1 -- 172.21.15.150:0/2678277908 shutdown_connections 2024-09-17T05:48:19.377 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:19.375+0000 7f88cde0e640 1 -- 172.21.15.150:0/2678277908 >> 172.21.15.150:0/2678277908 conn(0x7f88c80b2ef0 msgr2=0x7f88c80b3300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:48:19.378 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:19.375+0000 7f88cde0e640 1 -- 172.21.15.150:0/2678277908 shutdown_connections 2024-09-17T05:48:19.378 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:19.375+0000 7f88cde0e640 1 -- 172.21.15.150:0/2678277908 wait complete. 2024-09-17T05:48:19.378 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:19.377+0000 7f88cde0e640 1 Processor -- start 2024-09-17T05:48:19.378 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:19.377+0000 7f88cde0e640 1 -- start start 2024-09-17T05:48:19.381 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:19.378+0000 7f88cde0e640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f88b0004d40 0x7f88c80af730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:48:19.381 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:19.378+0000 7f88cde0e640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f88c81e4420 0x7f88c80b0cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:48:19.382 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:19.378+0000 7f88cde0e640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f88c80ae1d0 0x7f88c80ae5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:48:19.382 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:19.378+0000 7f88cde0e640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f88c80b4c30 con 0x7f88c80ae1d0 2024-09-17T05:48:19.382 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:19.378+0000 7f88cde0e640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f88c80b4ab0 con 0x7f88c81e4420 2024-09-17T05:48:19.382 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:19.378+0000 7f88cde0e640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f88c80b4db0 con 0x7f88b0004d40 2024-09-17T05:48:19.382 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:19.378+0000 7f88c7fff640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f88c80ae1d0 0x7f88c80ae5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:48:19.382 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:19.378+0000 7f88c7fff640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f88c80ae1d0 0x7f88c80ae5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:34346/0 (socket says 172.21.15.150:34346) 2024-09-17T05:48:19.382 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:19.378+0000 7f88c7fff640 1 -- 172.21.15.150:0/2867671493 learned_addr learned my addr 172.21.15.150:0/2867671493 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:48:19.382 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:19.378+0000 7f88c77fe640 1 --2- 172.21.15.150:0/2867671493 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f88b0004d40 0x7f88c80af730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:48:19.382 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:19.378+0000 7f88c6ffd640 1 --2- 172.21.15.150:0/2867671493 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f88c81e4420 0x7f88c80b0cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:48:19.382 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:19.379+0000 7f88c7fff640 1 -- 172.21.15.150:0/2867671493 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f88b0004d40 msgr2=0x7f88c80af730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:48:19.382 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:19.379+0000 7f88c7fff640 1 --2- 172.21.15.150:0/2867671493 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f88b0004d40 0x7f88c80af730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:48:19.382 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:19.379+0000 7f88c7fff640 1 -- 172.21.15.150:0/2867671493 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f88c81e4420 msgr2=0x7f88c80b0cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:48:19.383 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:19.379+0000 7f88c7fff640 1 --2- 172.21.15.150:0/2867671493 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f88c81e4420 0x7f88c80b0cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:48:19.383 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:19.379+0000 7f88c7fff640 1 -- 172.21.15.150:0/2867671493 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f88c80c52d0 con 0x7f88c80ae1d0 2024-09-17T05:48:19.383 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:19.379+0000 7f88c7fff640 1 --2- 172.21.15.150:0/2867671493 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f88c80ae1d0 0x7f88c80ae5e0 secure :-1 s=READY pgs=1046 cs=0 l=1 rev1=1 crypto rx=0x7f88c002aed0 tx=0x7f88c0033bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:48:19.383 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:19.379+0000 7f88affff640 1 -- 172.21.15.150:0/2867671493 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88c0042070 con 0x7f88c80ae1d0 2024-09-17T05:48:19.383 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:19.379+0000 7f88affff640 1 -- 172.21.15.150:0/2867671493 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f88c0003970 con 0x7f88c80ae1d0 2024-09-17T05:48:19.383 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:19.379+0000 7f88cde0e640 1 -- 172.21.15.150:0/2867671493 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f88c80cb200 con 0x7f88c80ae1d0 2024-09-17T05:48:19.383 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:19.379+0000 7f88affff640 1 -- 172.21.15.150:0/2867671493 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88c0038040 con 0x7f88c80ae1d0 2024-09-17T05:48:19.383 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:19.379+0000 7f88cde0e640 1 -- 172.21.15.150:0/2867671493 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f88c80afc70 con 0x7f88c80ae1d0 2024-09-17T05:48:19.383 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:19.380+0000 7f88cde0e640 1 -- 172.21.15.150:0/2867671493 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f88c80b5340 con 0x7f88c80ae1d0 2024-09-17T05:48:19.384 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:19.381+0000 7f88affff640 1 -- 172.21.15.150:0/2867671493 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 25) ==== 103022+0+0 (secure 0 0 0) 0x7f88c0004030 con 0x7f88c80ae1d0 2024-09-17T05:48:19.384 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:19.381+0000 7f88affff640 1 --2- 172.21.15.150:0/2867671493 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f88b4079d00 0x7f88b407c210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:48:19.384 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:19.381+0000 7f88affff640 1 -- 172.21.15.150:0/2867671493 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 5793+0+0 (secure 0 0 0) 0x7f88c00b9f70 con 0x7f88c80ae1d0 2024-09-17T05:48:19.384 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:19.382+0000 7f88c77fe640 1 --2- 172.21.15.150:0/2867671493 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f88b4079d00 0x7f88b407c210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:48:19.384 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:19.382+0000 7f88c77fe640 1 --2- 172.21.15.150:0/2867671493 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f88b4079d00 0x7f88b407c210 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f88b8000fb0 tx=0x7f88b8001710 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:48:19.388 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:19.386+0000 7f88affff640 1 -- 172.21.15.150:0/2867671493 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f88c00834c0 con 0x7f88c80ae1d0 2024-09-17T05:48:19.586 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:19.584+0000 7f88cde0e640 1 -- 172.21.15.150:0/2867671493 --> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] -- mgr_command(tid 0: {"prefix": "fs volume ls", "target": ["mon-mgr", ""]}) -- 0x7f88c809edb0 con 0x7f88b4079d00 2024-09-17T05:48:19.587 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:19.587+0000 7f88affff640 1 -- 172.21.15.150:0/2867671493 <== mgr.4108 v2:172.21.15.176:6800/3631216395 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+41 (secure 0 0 0) 0x7f88c809edb0 con 0x7f88b4079d00 2024-09-17T05:48:19.588 INFO:teuthology.orchestra.run.smithi150.stdout:[ 2024-09-17T05:48:19.588 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-09-17T05:48:19.588 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "cephfs" 2024-09-17T05:48:19.588 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-09-17T05:48:19.588 INFO:teuthology.orchestra.run.smithi150.stdout:] 2024-09-17T05:48:19.590 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:19.588+0000 7f88cde0e640 1 -- 172.21.15.150:0/2867671493 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f88b4079d00 msgr2=0x7f88b407c210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:48:19.590 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:19.588+0000 7f88cde0e640 1 --2- 172.21.15.150:0/2867671493 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f88b4079d00 0x7f88b407c210 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f88b8000fb0 tx=0x7f88b8001710 comp rx=0 tx=0).stop 2024-09-17T05:48:19.590 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:19.588+0000 7f88cde0e640 1 -- 172.21.15.150:0/2867671493 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f88c80ae1d0 msgr2=0x7f88c80ae5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:48:19.590 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:19.588+0000 7f88cde0e640 1 --2- 172.21.15.150:0/2867671493 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f88c80ae1d0 0x7f88c80ae5e0 secure :-1 s=READY pgs=1046 cs=0 l=1 rev1=1 crypto rx=0x7f88c002aed0 tx=0x7f88c0033bf0 comp rx=0 tx=0).stop 2024-09-17T05:48:19.590 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:19.588+0000 7f88cde0e640 1 -- 172.21.15.150:0/2867671493 shutdown_connections 2024-09-17T05:48:19.590 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:19.588+0000 7f88cde0e640 1 --2- 172.21.15.150:0/2867671493 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f88c81e4420 0x7f88c80b0cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:48:19.590 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:19.588+0000 7f88cde0e640 1 --2- 172.21.15.150:0/2867671493 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f88b4079d00 0x7f88b407c210 unknown :-1 s=CLOSED pgs=452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:48:19.590 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:19.588+0000 7f88cde0e640 1 --2- 172.21.15.150:0/2867671493 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f88c80ae1d0 0x7f88c80ae5e0 unknown :-1 s=CLOSED pgs=1046 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:48:19.590 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:19.588+0000 7f88cde0e640 1 --2- 172.21.15.150:0/2867671493 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f88b0004d40 0x7f88c80af730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:48:19.590 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:19.588+0000 7f88cde0e640 1 -- 172.21.15.150:0/2867671493 >> 172.21.15.150:0/2867671493 conn(0x7f88c80b2ef0 msgr2=0x7f88c809dec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:48:19.591 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:19.588+0000 7f88cde0e640 1 -- 172.21.15.150:0/2867671493 shutdown_connections 2024-09-17T05:48:19.591 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:19.588+0000 7f88cde0e640 1 -- 172.21.15.150:0/2867671493 wait complete. 2024-09-17T05:48:19.601 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-09-17T05:48:19.719 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:19.717+0000 7f0452741640 1 -- 172.21.15.150:0/3756878409 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f044c073630 msgr2=0x7f044c073a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:48:19.719 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:19.717+0000 7f0452741640 1 --2- 172.21.15.150:0/3756878409 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f044c073630 0x7f044c073a40 secure :-1 s=READY pgs=1047 cs=0 l=1 rev1=1 crypto rx=0x7f044c0ceaf0 tx=0x7f044002a560 comp rx=0 tx=0).stop 2024-09-17T05:48:19.719 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:19.717+0000 7f0452741640 1 -- 172.21.15.150:0/3756878409 shutdown_connections 2024-09-17T05:48:19.719 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:19.717+0000 7f0452741640 1 --2- 172.21.15.150:0/3756878409 >> v2:172.21.15.176:3300/0 conn(0x7f044c15ccf0 0x7f044c15d100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:48:19.719 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:19.717+0000 7f0452741640 1 --2- 172.21.15.150:0/3756878409 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f044c073630 0x7f044c073a40 unknown :-1 s=CLOSED pgs=1047 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:48:19.719 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:19.717+0000 7f0452741640 1 -- 172.21.15.150:0/3756878409 >> 172.21.15.150:0/3756878409 conn(0x7f044c06d1c0 msgr2=0x7f044c06d5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:48:19.720 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:19.717+0000 7f0452741640 1 -- 172.21.15.150:0/3756878409 shutdown_connections 2024-09-17T05:48:19.720 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:19.717+0000 7f0452741640 1 -- 172.21.15.150:0/3756878409 wait complete. 2024-09-17T05:48:19.720 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:19.719+0000 7f0452741640 1 Processor -- start 2024-09-17T05:48:19.720 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:19.719+0000 7f0452741640 1 -- start start 2024-09-17T05:48:19.723 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:19.720+0000 7f0452741640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f044c073630 0x7f044c13c7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:48:19.723 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:19.720+0000 7f0452741640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f044c0ccc50 0x7f044c150370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:48:19.723 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:19.720+0000 7f0452741640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f044c15ccf0 0x7f044c1f6150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:48:19.723 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:19.720+0000 7f0452741640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f044c15d7c0 con 0x7f044c15ccf0 2024-09-17T05:48:19.723 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:19.720+0000 7f0452741640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f044c15d640 con 0x7f044c073630 2024-09-17T05:48:19.723 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:19.720+0000 7f0452741640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f044c15d940 con 0x7f044c0ccc50 2024-09-17T05:48:19.723 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:19.720+0000 7f0450cde640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f044c15ccf0 0x7f044c1f6150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:48:19.724 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:19.720+0000 7f0450cde640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f044c15ccf0 0x7f044c1f6150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:34364/0 (socket says 172.21.15.150:34364) 2024-09-17T05:48:19.724 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:19.720+0000 7f0450cde640 1 -- 172.21.15.150:0/3511492777 learned_addr learned my addr 172.21.15.150:0/3511492777 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:48:19.724 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:19.720+0000 7f044b7fe640 1 --2- 172.21.15.150:0/3511492777 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f044c0ccc50 0x7f044c150370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:48:19.724 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:19.721+0000 7f044bfff640 1 --2- 172.21.15.150:0/3511492777 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f044c073630 0x7f044c13c7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:48:19.724 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:19.721+0000 7f0450cde640 1 -- 172.21.15.150:0/3511492777 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f044c0ccc50 msgr2=0x7f044c150370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:48:19.724 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:19.721+0000 7f0450cde640 1 --2- 172.21.15.150:0/3511492777 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f044c0ccc50 0x7f044c150370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:48:19.724 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:19.721+0000 7f0450cde640 1 -- 172.21.15.150:0/3511492777 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f044c073630 msgr2=0x7f044c13c7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:48:19.724 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:19.721+0000 7f0450cde640 1 --2- 172.21.15.150:0/3511492777 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f044c073630 0x7f044c13c7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:48:19.724 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:19.721+0000 7f0450cde640 1 -- 172.21.15.150:0/3511492777 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f044c13cce0 con 0x7f044c15ccf0 2024-09-17T05:48:19.724 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:19.721+0000 7f0450cde640 1 --2- 172.21.15.150:0/3511492777 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f044c15ccf0 0x7f044c1f6150 secure :-1 s=READY pgs=1048 cs=0 l=1 rev1=1 crypto rx=0x7f044400ea80 tx=0x7f044400ef40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:48:19.724 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:19.721+0000 7f0448ff9640 1 -- 172.21.15.150:0/3511492777 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0444004b20 con 0x7f044c15ccf0 2024-09-17T05:48:19.724 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:19.721+0000 7f0448ff9640 1 -- 172.21.15.150:0/3511492777 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0444004ce0 con 0x7f044c15ccf0 2024-09-17T05:48:19.724 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:19.721+0000 7f0452741640 1 -- 172.21.15.150:0/3511492777 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f044c1f31c0 con 0x7f044c15ccf0 2024-09-17T05:48:19.725 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:19.721+0000 7f0448ff9640 1 -- 172.21.15.150:0/3511492777 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0444005280 con 0x7f044c15ccf0 2024-09-17T05:48:19.725 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:19.721+0000 7f0452741640 1 -- 172.21.15.150:0/3511492777 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f044c1f3780 con 0x7f044c15ccf0 2024-09-17T05:48:19.725 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:19.722+0000 7f0452741640 1 -- 172.21.15.150:0/3511492777 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f044c1f2f10 con 0x7f044c15ccf0 2024-09-17T05:48:19.725 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:19.723+0000 7f0448ff9640 1 -- 172.21.15.150:0/3511492777 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 25) ==== 103022+0+0 (secure 0 0 0) 0x7f0444005420 con 0x7f044c15ccf0 2024-09-17T05:48:19.726 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:19.724+0000 7f0448ff9640 1 --2- 172.21.15.150:0/3511492777 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f0438079d00 0x7f043807c210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:48:19.726 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:19.724+0000 7f0448ff9640 1 -- 172.21.15.150:0/3511492777 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 5793+0+0 (secure 0 0 0) 0x7f044409a6e0 con 0x7f044c15ccf0 2024-09-17T05:48:19.726 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:19.724+0000 7f044bfff640 1 --2- 172.21.15.150:0/3511492777 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f0438079d00 0x7f043807c210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:48:19.726 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:19.724+0000 7f044bfff640 1 --2- 172.21.15.150:0/3511492777 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f0438079d00 0x7f043807c210 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f043c001720 tx=0x7f043c009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:48:19.730 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:19.728+0000 7f0448ff9640 1 -- 172.21.15.150:0/3511492777 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f044c13cce0 con 0x7f044c15ccf0 2024-09-17T05:48:19.905 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:19.903+0000 7f0452741640 1 -- 172.21.15.150:0/3511492777 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) -- 0x7f044c073a40 con 0x7f044c15ccf0 2024-09-17T05:48:19.905 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:19.904+0000 7f0448ff9640 1 -- 172.21.15.150:0/3511492777 <== mon.0 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v45)=0 v45) ==== 122+0+0 (secure 0 0 0) 0x7f0444063cc0 con 0x7f044c15ccf0 2024-09-17T05:48:19.908 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:19.906+0000 7f0452741640 1 -- 172.21.15.150:0/3511492777 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f0438079d00 msgr2=0x7f043807c210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:48:19.908 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:19.906+0000 7f0452741640 1 --2- 172.21.15.150:0/3511492777 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f0438079d00 0x7f043807c210 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f043c001720 tx=0x7f043c009040 comp rx=0 tx=0).stop 2024-09-17T05:48:19.908 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:19.906+0000 7f0452741640 1 -- 172.21.15.150:0/3511492777 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f044c15ccf0 msgr2=0x7f044c1f6150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:48:19.908 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:19.906+0000 7f0452741640 1 --2- 172.21.15.150:0/3511492777 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f044c15ccf0 0x7f044c1f6150 secure :-1 s=READY pgs=1048 cs=0 l=1 rev1=1 crypto rx=0x7f044400ea80 tx=0x7f044400ef40 comp rx=0 tx=0).stop 2024-09-17T05:48:19.908 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:19.906+0000 7f0452741640 1 -- 172.21.15.150:0/3511492777 shutdown_connections 2024-09-17T05:48:19.908 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:19.906+0000 7f0452741640 1 --2- 172.21.15.150:0/3511492777 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f0438079d00 0x7f043807c210 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:48:19.908 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:19.906+0000 7f0452741640 1 --2- 172.21.15.150:0/3511492777 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f044c15ccf0 0x7f044c1f6150 unknown :-1 s=CLOSED pgs=1048 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:48:19.908 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:19.906+0000 7f0452741640 1 --2- 172.21.15.150:0/3511492777 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f044c0ccc50 0x7f044c150370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:48:19.909 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:19.906+0000 7f0452741640 1 --2- 172.21.15.150:0/3511492777 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f044c073630 0x7f044c13c7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:48:19.909 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:19.906+0000 7f0452741640 1 -- 172.21.15.150:0/3511492777 >> 172.21.15.150:0/3511492777 conn(0x7f044c06d1c0 msgr2=0x7f044c0b48c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:48:19.909 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:19.906+0000 7f0452741640 1 -- 172.21.15.150:0/3511492777 shutdown_connections 2024-09-17T05:48:19.909 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:19.906+0000 7f0452741640 1 -- 172.21.15.150:0/3511492777 wait complete. 2024-09-17T05:48:19.919 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config get mgr mgr/volumes/max_concurrent_clones 2024-09-17T05:48:20.036 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:20.033+0000 7f1723c5c640 1 -- 172.21.15.150:0/702838794 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f171c06e4c0 msgr2=0x7f171c0b3d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:48:20.036 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:20.033+0000 7f1723c5c640 1 --2- 172.21.15.150:0/702838794 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f171c06e4c0 0x7f171c0b3d80 secure :-1 s=READY pgs=1049 cs=0 l=1 rev1=1 crypto rx=0x7f1714005fd0 tx=0x7f171402aa90 comp rx=0 tx=0).stop 2024-09-17T05:48:20.036 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:20.033+0000 7f1723c5c640 1 -- 172.21.15.150:0/702838794 shutdown_connections 2024-09-17T05:48:20.036 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:20.033+0000 7f1723c5c640 1 --2- 172.21.15.150:0/702838794 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f171c06e4c0 0x7f171c0b3d80 unknown :-1 s=CLOSED pgs=1049 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:48:20.036 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:20.033+0000 7f1723c5c640 1 --2- 172.21.15.150:0/702838794 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f171c13e540 0x7f171c0b5310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:48:20.036 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:20.033+0000 7f1723c5c640 1 -- 172.21.15.150:0/702838794 >> 172.21.15.150:0/702838794 conn(0x7f171c073920 msgr2=0x7f171c073d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:48:20.037 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:20.033+0000 7f1723c5c640 1 -- 172.21.15.150:0/702838794 shutdown_connections 2024-09-17T05:48:20.037 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:20.033+0000 7f1723c5c640 1 -- 172.21.15.150:0/702838794 wait complete. 2024-09-17T05:48:20.037 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:20.035+0000 7f1723c5c640 1 Processor -- start 2024-09-17T05:48:20.037 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:20.035+0000 7f1723c5c640 1 -- start start 2024-09-17T05:48:20.039 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:20.036+0000 7f1723c5c640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f171c13dc80 0x7f171c13d560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:48:20.039 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:20.036+0000 7f1723c5c640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f171c13e540 0x7f171c0ae2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:48:20.039 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:20.036+0000 7f1723c5c640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f171c13eb80 0x7f171c13ef90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:48:20.039 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:20.036+0000 7f1723c5c640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f171c13e210 con 0x7f171c13e540 2024-09-17T05:48:20.040 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:20.036+0000 7f1723c5c640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f171c13e090 con 0x7f171c13dc80 2024-09-17T05:48:20.040 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:20.036+0000 7f1723c5c640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f171c0b42c0 con 0x7f171c13eb80 2024-09-17T05:48:20.040 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:20.037+0000 7f17211f7640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f171c13e540 0x7f171c0ae2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:48:20.040 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:20.037+0000 7f17211f7640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f171c13e540 0x7f171c0ae2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:34376/0 (socket says 172.21.15.150:34376) 2024-09-17T05:48:20.040 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:20.037+0000 7f17211f7640 1 -- 172.21.15.150:0/2270875387 learned_addr learned my addr 172.21.15.150:0/2270875387 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:48:20.040 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:20.037+0000 7f17219f8640 1 --2- 172.21.15.150:0/2270875387 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f171c13dc80 0x7f171c13d560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:48:20.040 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:20.037+0000 7f17221f9640 1 --2- 172.21.15.150:0/2270875387 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f171c13eb80 0x7f171c13ef90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:48:20.040 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:20.037+0000 7f17211f7640 1 -- 172.21.15.150:0/2270875387 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f171c13eb80 msgr2=0x7f171c13ef90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:48:20.040 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:20.037+0000 7f17211f7640 1 --2- 172.21.15.150:0/2270875387 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f171c13eb80 0x7f171c13ef90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:48:20.040 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:20.037+0000 7f17211f7640 1 -- 172.21.15.150:0/2270875387 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f171c13dc80 msgr2=0x7f171c13d560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:48:20.040 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:20.037+0000 7f17211f7640 1 --2- 172.21.15.150:0/2270875387 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f171c13dc80 0x7f171c13d560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:48:20.040 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:20.037+0000 7f17211f7640 1 -- 172.21.15.150:0/2270875387 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f171c13daa0 con 0x7f171c13e540 2024-09-17T05:48:20.041 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:20.037+0000 7f17211f7640 1 --2- 172.21.15.150:0/2270875387 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f171c13e540 0x7f171c0ae2d0 secure :-1 s=READY pgs=1050 cs=0 l=1 rev1=1 crypto rx=0x7f170c00c3d0 tx=0x7f170c00c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:48:20.041 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:20.037+0000 7f17127fc640 1 -- 172.21.15.150:0/2270875387 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f170c017070 con 0x7f171c13e540 2024-09-17T05:48:20.041 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:20.037+0000 7f17127fc640 1 -- 172.21.15.150:0/2270875387 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f170c0053c0 con 0x7f171c13e540 2024-09-17T05:48:20.041 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:20.037+0000 7f17127fc640 1 -- 172.21.15.150:0/2270875387 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f170c003850 con 0x7f171c13e540 2024-09-17T05:48:20.041 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:20.037+0000 7f1723c5c640 1 -- 172.21.15.150:0/2270875387 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f171c0adad0 con 0x7f171c13e540 2024-09-17T05:48:20.041 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:20.037+0000 7f1723c5c640 1 -- 172.21.15.150:0/2270875387 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f171c13f4d0 con 0x7f171c13e540 2024-09-17T05:48:20.042 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:20.038+0000 7f1723c5c640 1 -- 172.21.15.150:0/2270875387 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f171c0b47b0 con 0x7f171c13e540 2024-09-17T05:48:20.042 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:20.039+0000 7f17127fc640 1 -- 172.21.15.150:0/2270875387 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 25) ==== 103022+0+0 (secure 0 0 0) 0x7f170c01a070 con 0x7f171c13e540 2024-09-17T05:48:20.042 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:20.040+0000 7f17127fc640 1 --2- 172.21.15.150:0/2270875387 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f1700079d30 0x7f170007c240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:48:20.043 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:20.040+0000 7f17127fc640 1 -- 172.21.15.150:0/2270875387 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 5793+0+0 (secure 0 0 0) 0x7f170c098ea0 con 0x7f171c13e540 2024-09-17T05:48:20.043 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:20.040+0000 7f17219f8640 1 --2- 172.21.15.150:0/2270875387 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f1700079d30 0x7f170007c240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:48:20.043 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:20.040+0000 7f17219f8640 1 --2- 172.21.15.150:0/2270875387 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f1700079d30 0x7f170007c240 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f171800bb50 tx=0x7f171800b2e0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:48:20.046 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:20.044+0000 7f17127fc640 1 -- 172.21.15.150:0/2270875387 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f171c13daa0 con 0x7f171c13e540 2024-09-17T05:48:20.220 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:20.219+0000 7f1723c5c640 1 -- 172.21.15.150:0/2270875387 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "config get", "who": "mgr", "key": "mgr/volumes/max_concurrent_clones"} v 0) -- 0x7f171c0add90 con 0x7f171c13e540 2024-09-17T05:48:20.221 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:20.219+0000 7f17127fc640 1 -- 172.21.15.150:0/2270875387 <== mon.0 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "config get", "who": "mgr", "key": "mgr/volumes/max_concurrent_clones"}]=0 v45) ==== 116+0+2 (secure 0 0 0) 0x7f170c062480 con 0x7f171c13e540 2024-09-17T05:48:20.221 INFO:teuthology.orchestra.run.smithi150.stdout:4 2024-09-17T05:48:20.223 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:20.221+0000 7f1723c5c640 1 -- 172.21.15.150:0/2270875387 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f1700079d30 msgr2=0x7f170007c240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:48:20.223 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:20.221+0000 7f1723c5c640 1 --2- 172.21.15.150:0/2270875387 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f1700079d30 0x7f170007c240 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f171800bb50 tx=0x7f171800b2e0 comp rx=0 tx=0).stop 2024-09-17T05:48:20.223 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:20.221+0000 7f1723c5c640 1 -- 172.21.15.150:0/2270875387 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f171c13e540 msgr2=0x7f171c0ae2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:48:20.223 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:20.221+0000 7f1723c5c640 1 --2- 172.21.15.150:0/2270875387 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f171c13e540 0x7f171c0ae2d0 secure :-1 s=READY pgs=1050 cs=0 l=1 rev1=1 crypto rx=0x7f170c00c3d0 tx=0x7f170c00c890 comp rx=0 tx=0).stop 2024-09-17T05:48:20.224 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:20.221+0000 7f1723c5c640 1 -- 172.21.15.150:0/2270875387 shutdown_connections 2024-09-17T05:48:20.224 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:20.221+0000 7f1723c5c640 1 --2- 172.21.15.150:0/2270875387 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f1700079d30 0x7f170007c240 unknown :-1 s=CLOSED pgs=454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:48:20.224 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:20.221+0000 7f1723c5c640 1 --2- 172.21.15.150:0/2270875387 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f171c13eb80 0x7f171c13ef90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:48:20.224 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:20.221+0000 7f1723c5c640 1 --2- 172.21.15.150:0/2270875387 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f171c13e540 0x7f171c0ae2d0 unknown :-1 s=CLOSED pgs=1050 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:48:20.224 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:20.221+0000 7f1723c5c640 1 --2- 172.21.15.150:0/2270875387 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f171c13dc80 0x7f171c13d560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:48:20.224 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:20.221+0000 7f1723c5c640 1 -- 172.21.15.150:0/2270875387 >> 172.21.15.150:0/2270875387 conn(0x7f171c073920 msgr2=0x7f171c073d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:48:20.224 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:20.222+0000 7f1723c5c640 1 -- 172.21.15.150:0/2270875387 shutdown_connections 2024-09-17T05:48:20.224 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:20.222+0000 7f1723c5c640 1 -- 172.21.15.150:0/2270875387 wait complete. 2024-09-17T05:48:20.235 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mgr mgr/volumes/max_concurrent_clones 4 2024-09-17T05:48:20.352 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:20.350+0000 7f3787ada640 1 -- 172.21.15.150:0/594719241 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f37800b6450 msgr2=0x7f37800cd3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:48:20.352 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:20.350+0000 7f3787ada640 1 --2- 172.21.15.150:0/594719241 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f37800b6450 0x7f37800cd3f0 secure :-1 s=READY pgs=1051 cs=0 l=1 rev1=1 crypto rx=0x7f3778005fd0 tx=0x7f377802aa10 comp rx=0 tx=0).stop 2024-09-17T05:48:20.353 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:20.350+0000 7f3787ada640 1 -- 172.21.15.150:0/594719241 shutdown_connections 2024-09-17T05:48:20.353 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:20.350+0000 7f3787ada640 1 --2- 172.21.15.150:0/594719241 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f37800b6450 0x7f37800cd3f0 unknown :-1 s=CLOSED pgs=1051 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:48:20.353 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:20.350+0000 7f3787ada640 1 --2- 172.21.15.150:0/594719241 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f37800ce800 0x7f378009aa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:48:20.353 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:20.350+0000 7f3787ada640 1 -- 172.21.15.150:0/594719241 >> 172.21.15.150:0/594719241 conn(0x7f37800d2550 msgr2=0x7f37800d2960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:48:20.353 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:20.350+0000 7f3787ada640 1 -- 172.21.15.150:0/594719241 shutdown_connections 2024-09-17T05:48:20.353 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:20.350+0000 7f3787ada640 1 -- 172.21.15.150:0/594719241 wait complete. 2024-09-17T05:48:20.353 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:20.352+0000 7f3787ada640 1 Processor -- start 2024-09-17T05:48:20.353 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:20.352+0000 7f3787ada640 1 -- start start 2024-09-17T05:48:20.356 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:20.353+0000 7f3787ada640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f378009af90 0x7f378015a590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:48:20.356 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:20.353+0000 7f3787ada640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f37800b6450 0x7f378015eda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:48:20.356 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:20.353+0000 7f3787ada640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f37800ce800 0x7f378015f2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:48:20.356 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:20.353+0000 7f3787ada640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f37800cd930 con 0x7f37800ce800 2024-09-17T05:48:20.356 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:20.353+0000 7f3787ada640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f37800cee20 con 0x7f378009af90 2024-09-17T05:48:20.356 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:20.353+0000 7f3787ada640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f37800cdab0 con 0x7f37800b6450 2024-09-17T05:48:20.356 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:20.353+0000 7f3786077640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f37800ce800 0x7f378015f2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:48:20.356 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:20.353+0000 7f3786077640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f37800ce800 0x7f378015f2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:47304/0 (socket says 172.21.15.150:47304) 2024-09-17T05:48:20.356 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:20.353+0000 7f3786077640 1 -- 172.21.15.150:0/4290452454 learned_addr learned my addr 172.21.15.150:0/4290452454 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:48:20.356 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:20.353+0000 7f3785075640 1 --2- 172.21.15.150:0/4290452454 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f37800b6450 0x7f378015eda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:48:20.357 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:20.353+0000 7f3785876640 1 --2- 172.21.15.150:0/4290452454 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f378009af90 0x7f378015a590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:48:20.357 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:20.353+0000 7f3786077640 1 -- 172.21.15.150:0/4290452454 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f37800b6450 msgr2=0x7f378015eda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:48:20.357 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:20.353+0000 7f3786077640 1 --2- 172.21.15.150:0/4290452454 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f37800b6450 0x7f378015eda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:48:20.357 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:20.353+0000 7f3786077640 1 -- 172.21.15.150:0/4290452454 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f378009af90 msgr2=0x7f378015a590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:48:20.357 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:20.353+0000 7f3786077640 1 --2- 172.21.15.150:0/4290452454 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f378009af90 0x7f378015a590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:48:20.357 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:20.353+0000 7f3786077640 1 -- 172.21.15.150:0/4290452454 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3780160960 con 0x7f37800ce800 2024-09-17T05:48:20.357 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:20.353+0000 7f3786077640 1 --2- 172.21.15.150:0/4290452454 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f37800ce800 0x7f378015f2e0 secure :-1 s=READY pgs=1052 cs=0 l=1 rev1=1 crypto rx=0x7f3778006010 tx=0x7f3778003f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:48:20.357 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:20.354+0000 7f37767fc640 1 -- 172.21.15.150:0/4290452454 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3778046070 con 0x7f37800ce800 2024-09-17T05:48:20.357 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:20.354+0000 7f37767fc640 1 -- 172.21.15.150:0/4290452454 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f3778004540 con 0x7f37800ce800 2024-09-17T05:48:20.357 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:20.354+0000 7f3787ada640 1 -- 172.21.15.150:0/4290452454 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f378015f820 con 0x7f37800ce800 2024-09-17T05:48:20.357 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:20.354+0000 7f37767fc640 1 -- 172.21.15.150:0/4290452454 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3778033070 con 0x7f37800ce800 2024-09-17T05:48:20.357 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:20.354+0000 7f3787ada640 1 -- 172.21.15.150:0/4290452454 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f378006e900 con 0x7f37800ce800 2024-09-17T05:48:20.358 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:20.355+0000 7f3787ada640 1 -- 172.21.15.150:0/4290452454 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f378009aa50 con 0x7f37800ce800 2024-09-17T05:48:20.358 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:20.355+0000 7f37767fc640 1 -- 172.21.15.150:0/4290452454 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 25) ==== 103022+0+0 (secure 0 0 0) 0x7f3778049070 con 0x7f37800ce800 2024-09-17T05:48:20.358 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:20.356+0000 7f37767fc640 1 --2- 172.21.15.150:0/4290452454 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f3764079d00 0x7f376407c210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:48:20.359 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:20.356+0000 7f37767fc640 1 -- 172.21.15.150:0/4290452454 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 5793+0+0 (secure 0 0 0) 0x7f37780bac70 con 0x7f37800ce800 2024-09-17T05:48:20.359 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:20.356+0000 7f3785876640 1 --2- 172.21.15.150:0/4290452454 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f3764079d00 0x7f376407c210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:48:20.359 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:20.357+0000 7f3785876640 1 --2- 172.21.15.150:0/4290452454 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f3764079d00 0x7f376407c210 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f377c009b30 tx=0x7f377c005f90 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:48:20.362 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:20.361+0000 7f37767fc640 1 -- 172.21.15.150:0/4290452454 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f377803e070 con 0x7f37800ce800 2024-09-17T05:48:20.539 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:20.537+0000 7f3787ada640 1 -- 172.21.15.150:0/4290452454 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command([{prefix=config set, name=mgr/volumes/max_concurrent_clones}] v 0) -- 0x7f378006e3b0 con 0x7f37800ce800 2024-09-17T05:48:20.543 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:20.542+0000 7f37767fc640 1 -- 172.21.15.150:0/4290452454 <== mon.0 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/volumes/max_concurrent_clones}]=0 v46)=0 v46) ==== 131+0+0 (secure 0 0 0) 0x7f3778084250 con 0x7f37800ce800 2024-09-17T05:48:20.546 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:20.544+0000 7f3787ada640 1 -- 172.21.15.150:0/4290452454 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f3764079d00 msgr2=0x7f376407c210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:48:20.546 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:20.544+0000 7f3787ada640 1 --2- 172.21.15.150:0/4290452454 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f3764079d00 0x7f376407c210 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f377c009b30 tx=0x7f377c005f90 comp rx=0 tx=0).stop 2024-09-17T05:48:20.546 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:20.544+0000 7f3787ada640 1 -- 172.21.15.150:0/4290452454 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f37800ce800 msgr2=0x7f378015f2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:48:20.547 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:20.544+0000 7f3787ada640 1 --2- 172.21.15.150:0/4290452454 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f37800ce800 0x7f378015f2e0 secure :-1 s=READY pgs=1052 cs=0 l=1 rev1=1 crypto rx=0x7f3778006010 tx=0x7f3778003f10 comp rx=0 tx=0).stop 2024-09-17T05:48:20.547 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:20.544+0000 7f3787ada640 1 -- 172.21.15.150:0/4290452454 shutdown_connections 2024-09-17T05:48:20.547 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:20.544+0000 7f3787ada640 1 --2- 172.21.15.150:0/4290452454 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f3764079d00 0x7f376407c210 unknown :-1 s=CLOSED pgs=455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:48:20.547 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:20.544+0000 7f3787ada640 1 --2- 172.21.15.150:0/4290452454 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f37800ce800 0x7f378015f2e0 unknown :-1 s=CLOSED pgs=1052 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:48:20.547 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:20.544+0000 7f3787ada640 1 --2- 172.21.15.150:0/4290452454 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f37800b6450 0x7f378015eda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:48:20.547 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:20.544+0000 7f3787ada640 1 --2- 172.21.15.150:0/4290452454 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f378009af90 0x7f378015a590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:48:20.547 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:20.544+0000 7f3787ada640 1 -- 172.21.15.150:0/4290452454 >> 172.21.15.150:0/4290452454 conn(0x7f37800d2550 msgr2=0x7f3780072600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:48:20.547 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:20.545+0000 7f3787ada640 1 -- 172.21.15.150:0/4290452454 shutdown_connections 2024-09-17T05:48:20.547 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:20.545+0000 7f3787ada640 1 -- 172.21.15.150:0/4290452454 wait complete. 2024-09-17T05:48:20.559 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mgr mgr/volumes/snapshot_clone_no_wait false 2024-09-17T05:48:20.562 INFO:tasks.ceph.mgr.x.smithi176.stderr:2024-09-17T05:48:20.561+0000 7f33da720640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-17T05:48:20.563 INFO:tasks.ceph.mgr.x.smithi176.stderr:2024-09-17T05:48:20.561+0000 7f33da720640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-17T05:48:20.563 INFO:tasks.ceph.mgr.x.smithi176.stderr:2024-09-17T05:48:20.561+0000 7f33da720640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-17T05:48:20.563 INFO:tasks.ceph.mgr.x.smithi176.stderr:2024-09-17T05:48:20.561+0000 7f33da720640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-17T05:48:20.563 INFO:tasks.ceph.mgr.x.smithi176.stderr:2024-09-17T05:48:20.561+0000 7f33da720640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-17T05:48:20.677 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:20.675+0000 7f318288b640 1 -- 172.21.15.150:0/1623105371 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f317c06ddb0 msgr2=0x7f317c06e1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:48:20.677 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:20.675+0000 7f318288b640 1 --2- 172.21.15.150:0/1623105371 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f317c06ddb0 0x7f317c06e1c0 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f3174005fd0 tx=0x7f317402a7a0 comp rx=0 tx=0).stop 2024-09-17T05:48:20.678 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:20.675+0000 7f318288b640 1 -- 172.21.15.150:0/1623105371 shutdown_connections 2024-09-17T05:48:20.678 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:20.675+0000 7f318288b640 1 --2- 172.21.15.150:0/1623105371 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f317c06ddb0 0x7f317c06e1c0 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:48:20.678 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:20.675+0000 7f318288b640 1 --2- 172.21.15.150:0/1623105371 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f317c06f960 0x7f317c0747e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:48:20.678 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:20.675+0000 7f318288b640 1 -- 172.21.15.150:0/1623105371 >> 172.21.15.150:0/1623105371 conn(0x7f317c073920 msgr2=0x7f317c073d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:48:20.678 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:20.675+0000 7f318288b640 1 -- 172.21.15.150:0/1623105371 shutdown_connections 2024-09-17T05:48:20.678 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:20.675+0000 7f318288b640 1 -- 172.21.15.150:0/1623105371 wait complete. 2024-09-17T05:48:20.678 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:20.677+0000 7f318288b640 1 Processor -- start 2024-09-17T05:48:20.679 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:20.677+0000 7f318288b640 1 -- start start 2024-09-17T05:48:20.682 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:20.679+0000 7f318288b640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f317c06ddb0 0x7f317c148340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:48:20.682 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:20.679+0000 7f318288b640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f317c06f960 0x7f317c1f3ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:48:20.682 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:20.679+0000 7f318288b640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f317c153950 0x7f317c145ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:48:20.682 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:20.679+0000 7f318288b640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f317c15d480 con 0x7f317c06f960 2024-09-17T05:48:20.682 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:20.679+0000 7f318288b640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f317c15d300 con 0x7f317c06ddb0 2024-09-17T05:48:20.682 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:20.679+0000 7f318288b640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f317c15d600 con 0x7f317c153950 2024-09-17T05:48:20.682 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:20.679+0000 7f317b7fe640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f317c06f960 0x7f317c1f3ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:48:20.682 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:20.679+0000 7f317b7fe640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f317c06f960 0x7f317c1f3ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:47320/0 (socket says 172.21.15.150:47320) 2024-09-17T05:48:20.682 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:20.679+0000 7f317b7fe640 1 -- 172.21.15.150:0/643672366 learned_addr learned my addr 172.21.15.150:0/643672366 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:48:20.683 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:20.679+0000 7f3180e28640 1 --2- 172.21.15.150:0/643672366 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f317c153950 0x7f317c145ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:48:20.683 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:20.679+0000 7f317bfff640 1 --2- 172.21.15.150:0/643672366 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f317c06ddb0 0x7f317c148340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:48:20.683 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:20.679+0000 7f317b7fe640 1 -- 172.21.15.150:0/643672366 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f317c153950 msgr2=0x7f317c145ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:48:20.683 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:20.679+0000 7f317b7fe640 1 --2- 172.21.15.150:0/643672366 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f317c153950 0x7f317c145ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:48:20.683 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:20.679+0000 7f317b7fe640 1 -- 172.21.15.150:0/643672366 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f317c06ddb0 msgr2=0x7f317c148340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:48:20.683 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:20.679+0000 7f317b7fe640 1 --2- 172.21.15.150:0/643672366 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f317c06ddb0 0x7f317c148340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:48:20.683 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:20.679+0000 7f317b7fe640 1 -- 172.21.15.150:0/643672366 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f317c1f4530 con 0x7f317c06f960 2024-09-17T05:48:20.683 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:20.679+0000 7f317b7fe640 1 --2- 172.21.15.150:0/643672366 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f317c06f960 0x7f317c1f3ff0 secure :-1 s=READY pgs=1054 cs=0 l=1 rev1=1 crypto rx=0x7f317000c500 tx=0x7f317000c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:48:20.683 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:20.679+0000 7f3178ff9640 1 -- 172.21.15.150:0/643672366 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3170016020 con 0x7f317c06f960 2024-09-17T05:48:20.684 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:20.680+0000 7f3178ff9640 1 -- 172.21.15.150:0/643672366 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f3170012920 con 0x7f317c06f960 2024-09-17T05:48:20.684 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:20.680+0000 7f318288b640 1 -- 172.21.15.150:0/643672366 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f317c1460e0 con 0x7f317c06f960 2024-09-17T05:48:20.684 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:20.680+0000 7f3178ff9640 1 -- 172.21.15.150:0/643672366 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3170012d70 con 0x7f317c06f960 2024-09-17T05:48:20.684 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:20.680+0000 7f318288b640 1 -- 172.21.15.150:0/643672366 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f317c0b1310 con 0x7f317c06f960 2024-09-17T05:48:20.685 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:20.681+0000 7f318288b640 1 -- 172.21.15.150:0/643672366 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f317c0b0d90 con 0x7f317c06f960 2024-09-17T05:48:20.685 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:20.681+0000 7f3178ff9640 1 -- 172.21.15.150:0/643672366 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 25) ==== 103022+0+0 (secure 0 0 0) 0x7f3170019020 con 0x7f317c06f960 2024-09-17T05:48:20.685 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:20.682+0000 7f3178ff9640 1 --2- 172.21.15.150:0/643672366 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f3168079d00 0x7f316807c210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:48:20.685 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:20.682+0000 7f3178ff9640 1 -- 172.21.15.150:0/643672366 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 5793+0+0 (secure 0 0 0) 0x7f3170099ca0 con 0x7f317c06f960 2024-09-17T05:48:20.685 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:20.682+0000 7f317bfff640 1 --2- 172.21.15.150:0/643672366 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f3168079d00 0x7f316807c210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:48:20.685 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:20.683+0000 7f317bfff640 1 --2- 172.21.15.150:0/643672366 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f3168079d00 0x7f316807c210 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f316c009b30 tx=0x7f316c005f90 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:48:20.688 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:20.687+0000 7f3178ff9640 1 -- 172.21.15.150:0/643672366 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f317c0b0d90 con 0x7f317c06f960 2024-09-17T05:48:20.865 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:20.863+0000 7f318288b640 1 -- 172.21.15.150:0/643672366 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command([{prefix=config set, name=mgr/volumes/snapshot_clone_no_wait}] v 0) -- 0x7f317c15db20 con 0x7f317c06f960 2024-09-17T05:48:20.868 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:20.867+0000 7f3178ff9640 1 -- 172.21.15.150:0/643672366 <== mon.0 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/volumes/snapshot_clone_no_wait}]=0 v47)=0 v47) ==== 136+0+0 (secure 0 0 0) 0x7f3170020020 con 0x7f317c06f960 2024-09-17T05:48:20.871 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:20.869+0000 7f318288b640 1 -- 172.21.15.150:0/643672366 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f3168079d00 msgr2=0x7f316807c210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:48:20.872 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:20.869+0000 7f318288b640 1 --2- 172.21.15.150:0/643672366 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f3168079d00 0x7f316807c210 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f316c009b30 tx=0x7f316c005f90 comp rx=0 tx=0).stop 2024-09-17T05:48:20.872 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:20.869+0000 7f318288b640 1 -- 172.21.15.150:0/643672366 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f317c06f960 msgr2=0x7f317c1f3ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:48:20.872 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:20.869+0000 7f318288b640 1 --2- 172.21.15.150:0/643672366 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f317c06f960 0x7f317c1f3ff0 secure :-1 s=READY pgs=1054 cs=0 l=1 rev1=1 crypto rx=0x7f317000c500 tx=0x7f317000c9c0 comp rx=0 tx=0).stop 2024-09-17T05:48:20.872 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:20.869+0000 7f318288b640 1 -- 172.21.15.150:0/643672366 shutdown_connections 2024-09-17T05:48:20.872 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:20.869+0000 7f318288b640 1 --2- 172.21.15.150:0/643672366 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f3168079d00 0x7f316807c210 unknown :-1 s=CLOSED pgs=456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:48:20.872 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:20.869+0000 7f318288b640 1 --2- 172.21.15.150:0/643672366 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f317c153950 0x7f317c145ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:48:20.872 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:20.869+0000 7f318288b640 1 --2- 172.21.15.150:0/643672366 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f317c06f960 0x7f317c1f3ff0 unknown :-1 s=CLOSED pgs=1054 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:48:20.872 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:20.869+0000 7f318288b640 1 --2- 172.21.15.150:0/643672366 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f317c06ddb0 0x7f317c148340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:48:20.872 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:20.870+0000 7f318288b640 1 -- 172.21.15.150:0/643672366 >> 172.21.15.150:0/643672366 conn(0x7f317c073920 msgr2=0x7f317c14ddf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:48:20.872 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:20.870+0000 7f318288b640 1 -- 172.21.15.150:0/643672366 shutdown_connections 2024-09-17T05:48:20.872 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:20.870+0000 7f318288b640 1 -- 172.21.15.150:0/643672366 wait complete. 2024-09-17T05:48:20.883 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume create cephfs sv1 --mode=777 2024-09-17T05:48:21.001 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:20.999+0000 7f7f50f52640 1 -- 172.21.15.150:0/3886225994 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7f4c0d01b0 msgr2=0x7f7f4c0d05c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:48:21.001 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:20.999+0000 7f7f50f52640 1 --2- 172.21.15.150:0/3886225994 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7f4c0d01b0 0x7f7f4c0d05c0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f7f3c009820 tx=0x7f7f3c02a510 comp rx=0 tx=0).stop 2024-09-17T05:48:21.001 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:20.999+0000 7f7f50f52640 1 -- 172.21.15.150:0/3886225994 shutdown_connections 2024-09-17T05:48:21.001 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:20.999+0000 7f7f50f52640 1 --2- 172.21.15.150:0/3886225994 >> v2:172.21.15.176:3300/0 conn(0x7f7f4c0b5250 0x7f7f4c0b5660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:48:21.001 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:20.999+0000 7f7f50f52640 1 --2- 172.21.15.150:0/3886225994 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7f4c0d01b0 0x7f7f4c0d05c0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:48:21.001 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:20.999+0000 7f7f50f52640 1 -- 172.21.15.150:0/3886225994 >> 172.21.15.150:0/3886225994 conn(0x7f7f4c0cee80 msgr2=0x7f7f4c0cf290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:48:21.001 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:20.999+0000 7f7f50f52640 1 -- 172.21.15.150:0/3886225994 shutdown_connections 2024-09-17T05:48:21.001 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:20.999+0000 7f7f50f52640 1 -- 172.21.15.150:0/3886225994 wait complete. 2024-09-17T05:48:21.002 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:21.001+0000 7f7f50f52640 1 Processor -- start 2024-09-17T05:48:21.003 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:21.001+0000 7f7f50f52640 1 -- start start 2024-09-17T05:48:21.005 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:21.002+0000 7f7f50f52640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7f4c0b5250 0x7f7f4c09fb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:48:21.005 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:21.002+0000 7f7f50f52640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7f4c0d01b0 0x7f7f4c15dd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:48:21.005 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:21.002+0000 7f7f50f52640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7f4c0d0ee0 0x7f7f4c15fc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:48:21.005 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:21.002+0000 7f7f50f52640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f7f4c0d12f0 con 0x7f7f4c0b5250 2024-09-17T05:48:21.005 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:21.002+0000 7f7f50f52640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f7f4c09bd00 con 0x7f7f4c0d01b0 2024-09-17T05:48:21.005 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:21.002+0000 7f7f50f52640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f7f4c0d1470 con 0x7f7f4c0d0ee0 2024-09-17T05:48:21.005 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:21.002+0000 7f7f4a59c640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7f4c0b5250 0x7f7f4c09fb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:48:21.006 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:21.002+0000 7f7f4a59c640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7f4c0b5250 0x7f7f4c09fb10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:47328/0 (socket says 172.21.15.150:47328) 2024-09-17T05:48:21.006 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:21.002+0000 7f7f4a59c640 1 -- 172.21.15.150:0/2640112344 learned_addr learned my addr 172.21.15.150:0/2640112344 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:48:21.006 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:21.002+0000 7f7f41d9b640 1 --2- 172.21.15.150:0/2640112344 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7f4c0d01b0 0x7f7f4c15dd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:48:21.006 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:21.003+0000 7f7f4ad9d640 1 --2- 172.21.15.150:0/2640112344 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7f4c0d0ee0 0x7f7f4c15fc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:48:21.006 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:21.003+0000 7f7f4a59c640 1 -- 172.21.15.150:0/2640112344 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7f4c0d0ee0 msgr2=0x7f7f4c15fc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:48:21.006 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:21.003+0000 7f7f4a59c640 1 --2- 172.21.15.150:0/2640112344 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7f4c0d0ee0 0x7f7f4c15fc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:48:21.006 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:21.003+0000 7f7f4a59c640 1 -- 172.21.15.150:0/2640112344 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7f4c0d01b0 msgr2=0x7f7f4c15dd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:48:21.006 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:21.003+0000 7f7f4a59c640 1 --2- 172.21.15.150:0/2640112344 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7f4c0d01b0 0x7f7f4c15dd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:48:21.006 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:21.003+0000 7f7f4a59c640 1 -- 172.21.15.150:0/2640112344 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7f4c15e670 con 0x7f7f4c0b5250 2024-09-17T05:48:21.006 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:21.003+0000 7f7f4a59c640 1 --2- 172.21.15.150:0/2640112344 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7f4c0b5250 0x7f7f4c09fb10 secure :-1 s=READY pgs=1056 cs=0 l=1 rev1=1 crypto rx=0x7f7f3c02ab00 tx=0x7f7f3c004a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:48:21.006 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:21.003+0000 7f7f437fe640 1 -- 172.21.15.150:0/2640112344 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f3c03f070 con 0x7f7f4c0b5250 2024-09-17T05:48:21.006 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:21.003+0000 7f7f437fe640 1 -- 172.21.15.150:0/2640112344 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f7f3c004e50 con 0x7f7f4c0b5250 2024-09-17T05:48:21.006 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:21.003+0000 7f7f50f52640 1 -- 172.21.15.150:0/2640112344 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7f4c1f3b50 con 0x7f7f4c0b5250 2024-09-17T05:48:21.007 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:21.003+0000 7f7f437fe640 1 -- 172.21.15.150:0/2640112344 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f3c005c30 con 0x7f7f4c0b5250 2024-09-17T05:48:21.007 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:21.003+0000 7f7f50f52640 1 -- 172.21.15.150:0/2640112344 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7f4c1e6470 con 0x7f7f4c0b5250 2024-09-17T05:48:21.007 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:21.004+0000 7f7f50f52640 1 -- 172.21.15.150:0/2640112344 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7f4c0ce600 con 0x7f7f4c0b5250 2024-09-17T05:48:21.008 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:21.005+0000 7f7f437fe640 1 -- 172.21.15.150:0/2640112344 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 25) ==== 103022+0+0 (secure 0 0 0) 0x7f7f3c042070 con 0x7f7f4c0b5250 2024-09-17T05:48:21.008 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:21.005+0000 7f7f437fe640 1 --2- 172.21.15.150:0/2640112344 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f7f2c079d00 0x7f7f2c07c210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:48:21.008 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:21.005+0000 7f7f437fe640 1 -- 172.21.15.150:0/2640112344 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 5793+0+0 (secure 0 0 0) 0x7f7f3c0ba760 con 0x7f7f4c0b5250 2024-09-17T05:48:21.008 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:21.005+0000 7f7f41d9b640 1 --2- 172.21.15.150:0/2640112344 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f7f2c079d00 0x7f7f2c07c210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:48:21.008 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:21.006+0000 7f7f41d9b640 1 --2- 172.21.15.150:0/2640112344 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f7f2c079d00 0x7f7f2c07c210 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f7f4c051010 tx=0x7f7f34005f90 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:48:21.011 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:21.010+0000 7f7f437fe640 1 -- 172.21.15.150:0/2640112344 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f7f4c0ce600 con 0x7f7f4c0b5250 2024-09-17T05:48:21.210 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:21.208+0000 7f7f50f52640 1 -- 172.21.15.150:0/2640112344 --> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] -- mgr_command(tid 0: {"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv1", "mode": "777", "target": ["mon-mgr", ""]}) -- 0x7f7f4c09b5b0 con 0x7f7f2c079d00 2024-09-17T05:48:21.219 INFO:tasks.ceph.mgr.x.smithi176.stderr:2024-09-17T05:48:21.218+0000 7f33d771a640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-17T05:48:21.219 INFO:tasks.ceph.mgr.x.smithi176.stderr:2024-09-17T05:48:21.218+0000 7f33d771a640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-17T05:48:21.219 INFO:tasks.ceph.mgr.x.smithi176.stderr:2024-09-17T05:48:21.218+0000 7f33d771a640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-17T05:48:21.219 INFO:tasks.ceph.mgr.x.smithi176.stderr:2024-09-17T05:48:21.218+0000 7f33d771a640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-17T05:48:21.219 INFO:tasks.ceph.mgr.x.smithi176.stderr:2024-09-17T05:48:21.218+0000 7f33d771a640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-17T05:48:21.254 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:21.253+0000 7f7f437fe640 1 -- 172.21.15.150:0/2640112344 <== mgr.4108 v2:172.21.15.176:6800/3631216395 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f7f4c09b5b0 con 0x7f7f2c079d00 2024-09-17T05:48:21.257 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:21.255+0000 7f7f50f52640 1 -- 172.21.15.150:0/2640112344 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f7f2c079d00 msgr2=0x7f7f2c07c210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:48:21.257 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:21.255+0000 7f7f50f52640 1 --2- 172.21.15.150:0/2640112344 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f7f2c079d00 0x7f7f2c07c210 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f7f4c051010 tx=0x7f7f34005f90 comp rx=0 tx=0).stop 2024-09-17T05:48:21.257 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:21.255+0000 7f7f50f52640 1 -- 172.21.15.150:0/2640112344 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7f4c0b5250 msgr2=0x7f7f4c09fb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:48:21.257 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:21.255+0000 7f7f50f52640 1 --2- 172.21.15.150:0/2640112344 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7f4c0b5250 0x7f7f4c09fb10 secure :-1 s=READY pgs=1056 cs=0 l=1 rev1=1 crypto rx=0x7f7f3c02ab00 tx=0x7f7f3c004a50 comp rx=0 tx=0).stop 2024-09-17T05:48:21.257 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:21.255+0000 7f7f50f52640 1 -- 172.21.15.150:0/2640112344 shutdown_connections 2024-09-17T05:48:21.257 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:21.255+0000 7f7f50f52640 1 --2- 172.21.15.150:0/2640112344 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7f4c0d01b0 0x7f7f4c15dd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:48:21.258 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:21.255+0000 7f7f50f52640 1 --2- 172.21.15.150:0/2640112344 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f7f2c079d00 0x7f7f2c07c210 unknown :-1 s=CLOSED pgs=457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:48:21.258 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:21.255+0000 7f7f50f52640 1 --2- 172.21.15.150:0/2640112344 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7f4c0d0ee0 0x7f7f4c15fc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:48:21.258 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:21.255+0000 7f7f50f52640 1 --2- 172.21.15.150:0/2640112344 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7f4c0b5250 0x7f7f4c09fb10 unknown :-1 s=CLOSED pgs=1056 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:48:21.258 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:21.255+0000 7f7f50f52640 1 -- 172.21.15.150:0/2640112344 >> 172.21.15.150:0/2640112344 conn(0x7f7f4c0cee80 msgr2=0x7f7f4c15c980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:48:21.258 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:21.255+0000 7f7f50f52640 1 -- 172.21.15.150:0/2640112344 shutdown_connections 2024-09-17T05:48:21.258 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:21.255+0000 7f7f50f52640 1 -- 172.21.15.150:0/2640112344 wait complete. 2024-09-17T05:48:21.269 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume getpath cephfs sv1 2024-09-17T05:48:21.386 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:21.383+0000 7faa62982640 1 -- 172.21.15.150:0/59421522 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7faa5c0d0fc0 msgr2=0x7faa5c0cd0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:48:21.386 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:21.383+0000 7faa62982640 1 --2- 172.21.15.150:0/59421522 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7faa5c0d0fc0 0x7faa5c0cd0e0 secure :-1 s=READY pgs=1057 cs=0 l=1 rev1=1 crypto rx=0x7faa54005fd0 tx=0x7faa5402a8d0 comp rx=0 tx=0).stop 2024-09-17T05:48:21.386 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:21.383+0000 7faa62982640 1 -- 172.21.15.150:0/59421522 shutdown_connections 2024-09-17T05:48:21.386 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:21.383+0000 7faa62982640 1 --2- 172.21.15.150:0/59421522 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7faa5c0d0fc0 0x7faa5c0cd0e0 unknown :-1 s=CLOSED pgs=1057 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:48:21.386 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:21.383+0000 7faa62982640 1 --2- 172.21.15.150:0/59421522 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7faa5c0b7d70 0x7faa5c0d0a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:48:21.386 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:21.383+0000 7faa62982640 1 -- 172.21.15.150:0/59421522 >> 172.21.15.150:0/59421522 conn(0x7faa5c0cef20 msgr2=0x7faa5c0cf330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:48:21.386 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:21.383+0000 7faa62982640 1 -- 172.21.15.150:0/59421522 shutdown_connections 2024-09-17T05:48:21.386 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:21.383+0000 7faa62982640 1 -- 172.21.15.150:0/59421522 wait complete. 2024-09-17T05:48:21.387 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:21.385+0000 7faa62982640 1 Processor -- start 2024-09-17T05:48:21.387 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:21.385+0000 7faa62982640 1 -- start start 2024-09-17T05:48:21.390 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:21.387+0000 7faa62982640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7faa5c0b7960 0x7faa5c1fa2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:48:21.390 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:21.387+0000 7faa62982640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7faa5c0b7d70 0x7faa5c06f240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:48:21.390 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:21.387+0000 7faa62982640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7faa5c0d0fc0 0x7faa5c15f470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:48:21.390 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:21.387+0000 7faa62982640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7faa5c0af900 con 0x7faa5c0d0fc0 2024-09-17T05:48:21.390 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:21.387+0000 7faa62982640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7faa5c0d1480 con 0x7faa5c0b7960 2024-09-17T05:48:21.390 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:21.387+0000 7faa62982640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7faa5c1f6f30 con 0x7faa5c0b7d70 2024-09-17T05:48:21.391 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:21.387+0000 7faa60f1f640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7faa5c0d0fc0 0x7faa5c15f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:48:21.391 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:21.387+0000 7faa60f1f640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7faa5c0d0fc0 0x7faa5c15f470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:47346/0 (socket says 172.21.15.150:47346) 2024-09-17T05:48:21.391 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:21.387+0000 7faa60f1f640 1 -- 172.21.15.150:0/3120852235 learned_addr learned my addr 172.21.15.150:0/3120852235 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:48:21.391 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:21.387+0000 7faa53fff640 1 --2- 172.21.15.150:0/3120852235 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7faa5c0b7d70 0x7faa5c06f240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:48:21.391 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:21.387+0000 7faa5bfff640 1 --2- 172.21.15.150:0/3120852235 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7faa5c0b7960 0x7faa5c1fa2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:48:21.391 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:21.387+0000 7faa60f1f640 1 -- 172.21.15.150:0/3120852235 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7faa5c0b7d70 msgr2=0x7faa5c06f240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:48:21.391 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:21.387+0000 7faa60f1f640 1 --2- 172.21.15.150:0/3120852235 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7faa5c0b7d70 0x7faa5c06f240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:48:21.391 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:21.387+0000 7faa60f1f640 1 -- 172.21.15.150:0/3120852235 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7faa5c0b7960 msgr2=0x7faa5c1fa2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:48:21.391 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:21.387+0000 7faa60f1f640 1 --2- 172.21.15.150:0/3120852235 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7faa5c0b7960 0x7faa5c1fa2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:48:21.391 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:21.387+0000 7faa60f1f640 1 -- 172.21.15.150:0/3120852235 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faa5c06fe90 con 0x7faa5c0d0fc0 2024-09-17T05:48:21.391 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:21.387+0000 7faa60f1f640 1 --2- 172.21.15.150:0/3120852235 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7faa5c0d0fc0 0x7faa5c15f470 secure :-1 s=READY pgs=1058 cs=0 l=1 rev1=1 crypto rx=0x7faa54006010 tx=0x7faa54003ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:48:21.391 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:21.387+0000 7faa597fa640 1 -- 172.21.15.150:0/3120852235 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa54004040 con 0x7faa5c0d0fc0 2024-09-17T05:48:21.392 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:21.387+0000 7faa597fa640 1 -- 172.21.15.150:0/3120852235 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7faa540041e0 con 0x7faa5c0d0fc0 2024-09-17T05:48:21.392 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:21.387+0000 7faa62982640 1 -- 172.21.15.150:0/3120852235 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faa5c06fbb0 con 0x7faa5c0d0fc0 2024-09-17T05:48:21.392 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:21.387+0000 7faa597fa640 1 -- 172.21.15.150:0/3120852235 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa540045b0 con 0x7faa5c0d0fc0 2024-09-17T05:48:21.392 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:21.387+0000 7faa62982640 1 -- 172.21.15.150:0/3120852235 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faa5c1f9aa0 con 0x7faa5c0d0fc0 2024-09-17T05:48:21.392 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:21.389+0000 7faa62982640 1 -- 172.21.15.150:0/3120852235 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faa5c06f920 con 0x7faa5c0d0fc0 2024-09-17T05:48:21.393 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:21.389+0000 7faa597fa640 1 -- 172.21.15.150:0/3120852235 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 25) ==== 103022+0+0 (secure 0 0 0) 0x7faa54031460 con 0x7faa5c0d0fc0 2024-09-17T05:48:21.393 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:21.390+0000 7faa597fa640 1 --2- 172.21.15.150:0/3120852235 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7faa3c079d30 0x7faa3c07c240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:48:21.393 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:21.390+0000 7faa597fa640 1 -- 172.21.15.150:0/3120852235 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 5793+0+0 (secure 0 0 0) 0x7faa540bb130 con 0x7faa5c0d0fc0 2024-09-17T05:48:21.393 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:21.390+0000 7faa5bfff640 1 --2- 172.21.15.150:0/3120852235 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7faa3c079d30 0x7faa3c07c240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:48:21.393 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:21.391+0000 7faa5bfff640 1 --2- 172.21.15.150:0/3120852235 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7faa3c079d30 0x7faa3c07c240 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7faa5c0d2470 tx=0x7faa4c009060 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:48:21.395 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:21.394+0000 7faa597fa640 1 -- 172.21.15.150:0/3120852235 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7faa540849d0 con 0x7faa5c0d0fc0 2024-09-17T05:48:21.600 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:21.597+0000 7faa62982640 1 -- 172.21.15.150:0/3120852235 --> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "sub_name": "sv1", "target": ["mon-mgr", ""]}) -- 0x7faa5c0d0a80 con 0x7faa3c079d30 2024-09-17T05:48:21.606 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:21.605+0000 7faa597fa640 1 -- 172.21.15.150:0/3120852235 <== mgr.4108 v2:172.21.15.176:6800/3631216395 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+59 (secure 0 0 0) 0x7faa5c0d0a80 con 0x7faa3c079d30 2024-09-17T05:48:21.606 INFO:teuthology.orchestra.run.smithi150.stdout:/volumes/_nogroup/sv1/e79cf100-932a-417e-8f83-2f5b2add65a0 2024-09-17T05:48:21.609 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:21.607+0000 7faa62982640 1 -- 172.21.15.150:0/3120852235 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7faa3c079d30 msgr2=0x7faa3c07c240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:48:21.609 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:21.607+0000 7faa62982640 1 --2- 172.21.15.150:0/3120852235 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7faa3c079d30 0x7faa3c07c240 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7faa5c0d2470 tx=0x7faa4c009060 comp rx=0 tx=0).stop 2024-09-17T05:48:21.609 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:21.607+0000 7faa62982640 1 -- 172.21.15.150:0/3120852235 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7faa5c0d0fc0 msgr2=0x7faa5c15f470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:48:21.609 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:21.607+0000 7faa62982640 1 --2- 172.21.15.150:0/3120852235 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7faa5c0d0fc0 0x7faa5c15f470 secure :-1 s=READY pgs=1058 cs=0 l=1 rev1=1 crypto rx=0x7faa54006010 tx=0x7faa54003ba0 comp rx=0 tx=0).stop 2024-09-17T05:48:21.609 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:21.607+0000 7faa62982640 1 -- 172.21.15.150:0/3120852235 shutdown_connections 2024-09-17T05:48:21.609 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:21.607+0000 7faa62982640 1 --2- 172.21.15.150:0/3120852235 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7faa3c079d30 0x7faa3c07c240 unknown :-1 s=CLOSED pgs=458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:48:21.609 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:21.607+0000 7faa62982640 1 --2- 172.21.15.150:0/3120852235 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7faa5c0d0fc0 0x7faa5c15f470 unknown :-1 s=CLOSED pgs=1058 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:48:21.609 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:21.607+0000 7faa62982640 1 --2- 172.21.15.150:0/3120852235 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7faa5c0b7d70 0x7faa5c06f240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:48:21.610 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:21.607+0000 7faa62982640 1 --2- 172.21.15.150:0/3120852235 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7faa5c0b7960 0x7faa5c1fa2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:48:21.610 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:21.607+0000 7faa62982640 1 -- 172.21.15.150:0/3120852235 >> 172.21.15.150:0/3120852235 conn(0x7faa5c0cef20 msgr2=0x7faa5c0b0b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:48:21.610 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:21.607+0000 7faa62982640 1 -- 172.21.15.150:0/3120852235 shutdown_connections 2024-09-17T05:48:21.610 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:21.607+0000 7faa62982640 1 -- 172.21.15.150:0/3120852235 wait complete. 2024-09-17T05:48:21.620 DEBUG:tasks.cephfs.test_volumes:filling subvolume sv1 with 3 files each 1024MB size under directory volumes/_nogroup/sv1/e79cf100-932a-417e-8f83-2f5b2add65a0 2024-09-17T05:48:21.621 DEBUG:teuthology.orchestra.run.smithi150:> set -ex 2024-09-17T05:48:21.621 DEBUG:teuthology.orchestra.run.smithi150:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T05:48:21.636 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:48:21.636 DEBUG:teuthology.orchestra.run.smithi150:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/sv1/e79cf100-932a-417e-8f83-2f5b2add65a0/subvolume_file.0 bs=1M conv=fdatasync count=1024 seek=0) 2024-09-17T05:48:25.423 INFO:teuthology.orchestra.run.smithi150.stderr:1024+0 records in 2024-09-17T05:48:25.424 INFO:teuthology.orchestra.run.smithi150.stderr:1024+0 records out 2024-09-17T05:48:25.424 INFO:teuthology.orchestra.run.smithi150.stderr:1073741824 bytes (1.1 GB, 1.0 GiB) copied, 3.72273 s, 288 MB/s 2024-09-17T05:48:25.424 DEBUG:teuthology.orchestra.run.smithi150:> set -ex 2024-09-17T05:48:25.424 DEBUG:teuthology.orchestra.run.smithi150:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T05:48:25.439 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:48:25.440 DEBUG:teuthology.orchestra.run.smithi150:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/sv1/e79cf100-932a-417e-8f83-2f5b2add65a0/subvolume_file.1 bs=1M conv=fdatasync count=1024 seek=0) 2024-09-17T05:48:26.034 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-17T05:48:26.036 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-17T05:48:29.247 INFO:teuthology.orchestra.run.smithi150.stderr:1024+0 records in 2024-09-17T05:48:29.247 INFO:teuthology.orchestra.run.smithi150.stderr:1024+0 records out 2024-09-17T05:48:29.247 INFO:teuthology.orchestra.run.smithi150.stderr:1073741824 bytes (1.1 GB, 1.0 GiB) copied, 3.74978 s, 286 MB/s 2024-09-17T05:48:29.248 DEBUG:teuthology.orchestra.run.smithi150:> set -ex 2024-09-17T05:48:29.248 DEBUG:teuthology.orchestra.run.smithi150:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T05:48:29.263 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:48:29.263 DEBUG:teuthology.orchestra.run.smithi150:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/sv1/e79cf100-932a-417e-8f83-2f5b2add65a0/subvolume_file.2 bs=1M conv=fdatasync count=1024 seek=0) 2024-09-17T05:48:33.045 INFO:teuthology.orchestra.run.smithi150.stderr:1024+0 records in 2024-09-17T05:48:33.045 INFO:teuthology.orchestra.run.smithi150.stderr:1024+0 records out 2024-09-17T05:48:33.045 INFO:teuthology.orchestra.run.smithi150.stderr:1073741824 bytes (1.1 GB, 1.0 GiB) copied, 3.72405 s, 288 MB/s 2024-09-17T05:48:33.045 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume snapshot create cephfs sv1 ss1 2024-09-17T05:48:33.165 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:33.164+0000 7f17e0c8b640 1 -- 172.21.15.150:0/4159359303 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f17dc0d1670 msgr2=0x7f17dc06e390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:48:33.165 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:33.164+0000 7f17e0c8b640 1 --2- 172.21.15.150:0/4159359303 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f17dc0d1670 0x7f17dc06e390 secure :-1 s=READY pgs=1059 cs=0 l=1 rev1=1 crypto rx=0x7f17dc0b72b0 tx=0x7f17c402a540 comp rx=0 tx=0).stop 2024-09-17T05:48:33.165 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:33.164+0000 7f17e0c8b640 1 -- 172.21.15.150:0/4159359303 shutdown_connections 2024-09-17T05:48:33.165 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:33.164+0000 7f17e0c8b640 1 --2- 172.21.15.150:0/4159359303 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f17dc06e8d0 0x7f17dc06ece0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:48:33.165 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:33.164+0000 7f17e0c8b640 1 --2- 172.21.15.150:0/4159359303 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f17dc0d1670 0x7f17dc06e390 unknown :-1 s=CLOSED pgs=1059 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:48:33.165 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:33.164+0000 7f17e0c8b640 1 --2- 172.21.15.150:0/4159359303 >> v2:172.21.15.176:3300/0 conn(0x7f17dc0d0d20 0x7f17dc0d1130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:48:33.165 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:33.164+0000 7f17e0c8b640 1 -- 172.21.15.150:0/4159359303 >> 172.21.15.150:0/4159359303 conn(0x7f17dc0d46f0 msgr2=0x7f17dc0d4b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:48:33.165 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:33.164+0000 7f17e0c8b640 1 -- 172.21.15.150:0/4159359303 shutdown_connections 2024-09-17T05:48:33.165 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:33.164+0000 7f17e0c8b640 1 -- 172.21.15.150:0/4159359303 wait complete. 2024-09-17T05:48:33.166 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:33.165+0000 7f17e0c8b640 1 Processor -- start 2024-09-17T05:48:33.166 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:33.166+0000 7f17e0c8b640 1 -- start start 2024-09-17T05:48:33.169 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:33.167+0000 7f17e0c8b640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f17dc06e8d0 0x7f17dc0a1dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:48:33.169 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:33.167+0000 7f17e0c8b640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f17dc0d0d20 0x7f17dc153ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:48:33.169 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:33.167+0000 7f17e0c8b640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f17dc0d1670 0x7f17dc09feb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:48:33.169 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:33.167+0000 7f17e0c8b640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f17dc06f220 con 0x7f17dc0d1670 2024-09-17T05:48:33.170 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:33.167+0000 7f17e0c8b640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f17dc06f3a0 con 0x7f17dc06e8d0 2024-09-17T05:48:33.170 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:33.167+0000 7f17e0c8b640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f17dc06f520 con 0x7f17dc0d0d20 2024-09-17T05:48:33.170 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:33.167+0000 7f17dad9d640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f17dc0d1670 0x7f17dc09feb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:48:33.170 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:33.167+0000 7f17dad9d640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f17dc0d1670 0x7f17dc09feb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:50122/0 (socket says 172.21.15.150:50122) 2024-09-17T05:48:33.170 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:33.167+0000 7f17dad9d640 1 -- 172.21.15.150:0/3817797 learned_addr learned my addr 172.21.15.150:0/3817797 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:48:33.170 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:33.167+0000 7f17da59c640 1 --2- 172.21.15.150:0/3817797 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f17dc06e8d0 0x7f17dc0a1dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:48:33.170 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:33.167+0000 7f17d3fff640 1 --2- 172.21.15.150:0/3817797 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f17dc0d0d20 0x7f17dc153ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:48:33.170 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:33.167+0000 7f17dad9d640 1 -- 172.21.15.150:0/3817797 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f17dc0d0d20 msgr2=0x7f17dc153ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:48:33.170 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:33.167+0000 7f17dad9d640 1 --2- 172.21.15.150:0/3817797 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f17dc0d0d20 0x7f17dc153ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:48:33.170 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:33.167+0000 7f17dad9d640 1 -- 172.21.15.150:0/3817797 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f17dc06e8d0 msgr2=0x7f17dc0a1dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:48:33.170 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:33.167+0000 7f17dad9d640 1 --2- 172.21.15.150:0/3817797 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f17dc06e8d0 0x7f17dc0a1dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:48:33.171 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:33.167+0000 7f17dad9d640 1 -- 172.21.15.150:0/3817797 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f17dc1f5af0 con 0x7f17dc0d1670 2024-09-17T05:48:33.171 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:33.167+0000 7f17da59c640 1 --2- 172.21.15.150:0/3817797 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f17dc06e8d0 0x7f17dc0a1dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T05:48:33.171 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:33.167+0000 7f17d3fff640 1 --2- 172.21.15.150:0/3817797 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f17dc0d0d20 0x7f17dc153ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T05:48:33.171 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:33.167+0000 7f17dad9d640 1 --2- 172.21.15.150:0/3817797 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f17dc0d1670 0x7f17dc09feb0 secure :-1 s=READY pgs=1060 cs=0 l=1 rev1=1 crypto rx=0x7f17d400ea10 tx=0x7f17d400eed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:48:33.171 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:33.168+0000 7f17d2ffd640 1 -- 172.21.15.150:0/3817797 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17d400cde0 con 0x7f17dc0d1670 2024-09-17T05:48:33.171 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:33.168+0000 7f17d2ffd640 1 -- 172.21.15.150:0/3817797 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f17d4004c10 con 0x7f17dc0d1670 2024-09-17T05:48:33.171 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:33.168+0000 7f17e0c8b640 1 -- 172.21.15.150:0/3817797 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f17dc1f5dd0 con 0x7f17dc0d1670 2024-09-17T05:48:33.171 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:33.168+0000 7f17d2ffd640 1 -- 172.21.15.150:0/3817797 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17d4005020 con 0x7f17dc0d1670 2024-09-17T05:48:33.171 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:33.168+0000 7f17e0c8b640 1 -- 172.21.15.150:0/3817797 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f17dc1f6390 con 0x7f17dc0d1670 2024-09-17T05:48:33.171 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:33.169+0000 7f17e0c8b640 1 -- 172.21.15.150:0/3817797 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f17dc06d870 con 0x7f17dc0d1670 2024-09-17T05:48:33.172 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:33.169+0000 7f17d2ffd640 1 -- 172.21.15.150:0/3817797 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 27) ==== 103124+0+0 (secure 0 0 0) 0x7f17d40051c0 con 0x7f17dc0d1670 2024-09-17T05:48:33.172 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:33.170+0000 7f17d2ffd640 1 --2- 172.21.15.150:0/3817797 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f17bc079e20 0x7f17bc07c330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:48:33.172 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:33.170+0000 7f17d2ffd640 1 -- 172.21.15.150:0/3817797 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 5793+0+0 (secure 0 0 0) 0x7f17d409a700 con 0x7f17dc0d1670 2024-09-17T05:48:33.172 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:33.170+0000 7f17da59c640 1 --2- 172.21.15.150:0/3817797 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f17bc079e20 0x7f17bc07c330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:48:33.172 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:33.171+0000 7f17da59c640 1 --2- 172.21.15.150:0/3817797 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f17bc079e20 0x7f17bc07c330 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f17cc009a30 tx=0x7f17cc005f90 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:48:33.175 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:33.174+0000 7f17d2ffd640 1 -- 172.21.15.150:0/3817797 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f17dc06d870 con 0x7f17dc0d1670 2024-09-17T05:48:33.379 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:33.378+0000 7f17e0c8b640 1 -- 172.21.15.150:0/3817797 --> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] -- mgr_command(tid 0: {"prefix": "fs subvolume snapshot create", "vol_name": "cephfs", "sub_name": "sv1", "snap_name": "ss1", "target": ["mon-mgr", ""]}) -- 0x7f17dc0a2400 con 0x7f17bc079e20 2024-09-17T05:48:33.392 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:33.391+0000 7f17d2ffd640 1 -- 172.21.15.150:0/3817797 <== mgr.4108 v2:172.21.15.176:6800/3631216395 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f17dc0a2400 con 0x7f17bc079e20 2024-09-17T05:48:33.394 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:33.393+0000 7f17e0c8b640 1 -- 172.21.15.150:0/3817797 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f17bc079e20 msgr2=0x7f17bc07c330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:48:33.395 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:33.393+0000 7f17e0c8b640 1 --2- 172.21.15.150:0/3817797 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f17bc079e20 0x7f17bc07c330 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f17cc009a30 tx=0x7f17cc005f90 comp rx=0 tx=0).stop 2024-09-17T05:48:33.395 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:33.393+0000 7f17e0c8b640 1 -- 172.21.15.150:0/3817797 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f17dc0d1670 msgr2=0x7f17dc09feb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:48:33.395 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:33.393+0000 7f17e0c8b640 1 --2- 172.21.15.150:0/3817797 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f17dc0d1670 0x7f17dc09feb0 secure :-1 s=READY pgs=1060 cs=0 l=1 rev1=1 crypto rx=0x7f17d400ea10 tx=0x7f17d400eed0 comp rx=0 tx=0).stop 2024-09-17T05:48:33.395 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:33.394+0000 7f17e0c8b640 1 -- 172.21.15.150:0/3817797 shutdown_connections 2024-09-17T05:48:33.395 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:33.394+0000 7f17e0c8b640 1 --2- 172.21.15.150:0/3817797 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f17bc079e20 0x7f17bc07c330 unknown :-1 s=CLOSED pgs=459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:48:33.395 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:33.394+0000 7f17e0c8b640 1 --2- 172.21.15.150:0/3817797 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f17dc0d1670 0x7f17dc09feb0 unknown :-1 s=CLOSED pgs=1060 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:48:33.395 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:33.394+0000 7f17e0c8b640 1 --2- 172.21.15.150:0/3817797 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f17dc0d0d20 0x7f17dc153ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:48:33.395 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:33.394+0000 7f17e0c8b640 1 --2- 172.21.15.150:0/3817797 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f17dc06e8d0 0x7f17dc0a1dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:48:33.395 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:33.394+0000 7f17e0c8b640 1 -- 172.21.15.150:0/3817797 >> 172.21.15.150:0/3817797 conn(0x7f17dc0d46f0 msgr2=0x7f17dc068e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:48:33.395 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:33.394+0000 7f17e0c8b640 1 -- 172.21.15.150:0/3817797 shutdown_connections 2024-09-17T05:48:33.395 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:33.394+0000 7f17e0c8b640 1 -- 172.21.15.150:0/3817797 wait complete. 2024-09-17T05:48:33.406 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume getpath cephfs sv1 2024-09-17T05:48:33.527 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:33.522+0000 7fef250a2640 1 -- 172.21.15.150:0/478681664 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fef200b0990 msgr2=0x7fef200b0da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:48:33.527 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:33.522+0000 7fef250a2640 1 --2- 172.21.15.150:0/478681664 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fef200b0990 0x7fef200b0da0 secure :-1 s=READY pgs=1062 cs=0 l=1 rev1=1 crypto rx=0x7fef08005fd0 tx=0x7fef0802a540 comp rx=0 tx=0).stop 2024-09-17T05:48:33.527 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:33.522+0000 7fef250a2640 1 -- 172.21.15.150:0/478681664 shutdown_connections 2024-09-17T05:48:33.527 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:33.522+0000 7fef250a2640 1 --2- 172.21.15.150:0/478681664 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fef200b12e0 0x7fef200b4e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:48:33.527 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:33.522+0000 7fef250a2640 1 --2- 172.21.15.150:0/478681664 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fef200b0990 0x7fef200b0da0 unknown :-1 s=CLOSED pgs=1062 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:48:33.527 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:33.523+0000 7fef250a2640 1 -- 172.21.15.150:0/478681664 >> 172.21.15.150:0/478681664 conn(0x7fef200b2e80 msgr2=0x7fef200b3290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:48:33.527 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:33.523+0000 7fef250a2640 1 -- 172.21.15.150:0/478681664 shutdown_connections 2024-09-17T05:48:33.527 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:33.523+0000 7fef250a2640 1 -- 172.21.15.150:0/478681664 wait complete. 2024-09-17T05:48:33.527 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:33.526+0000 7fef250a2640 1 Processor -- start 2024-09-17T05:48:33.527 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:33.526+0000 7fef250a2640 1 -- start start 2024-09-17T05:48:33.530 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:33.528+0000 7fef250a2640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fef200b0990 0x7fef2015ea80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:48:33.530 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:33.528+0000 7fef250a2640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fef200b12e0 0x7fef2015efc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:48:33.530 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:33.528+0000 7fef250a2640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fef200b6550 0x7fef201f7340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:48:33.530 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:33.528+0000 7fef250a2640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7fef200b1a80 con 0x7fef200b12e0 2024-09-17T05:48:33.530 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:33.528+0000 7fef250a2640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fef200b1900 con 0x7fef200b6550 2024-09-17T05:48:33.530 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:33.528+0000 7fef250a2640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fef200b5390 con 0x7fef200b0990 2024-09-17T05:48:33.530 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:33.528+0000 7fef1e59c640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fef200b12e0 0x7fef2015efc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:48:33.530 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:33.528+0000 7fef1e59c640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fef200b12e0 0x7fef2015efc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:50150/0 (socket says 172.21.15.150:50150) 2024-09-17T05:48:33.531 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:33.528+0000 7fef1e59c640 1 -- 172.21.15.150:0/2480615783 learned_addr learned my addr 172.21.15.150:0/2480615783 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:48:33.531 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:33.528+0000 7fef1f59e640 1 --2- 172.21.15.150:0/2480615783 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fef200b6550 0x7fef201f7340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:48:33.531 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:33.528+0000 7fef1ed9d640 1 --2- 172.21.15.150:0/2480615783 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fef200b0990 0x7fef2015ea80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:48:33.531 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:33.529+0000 7fef1e59c640 1 -- 172.21.15.150:0/2480615783 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fef200b0990 msgr2=0x7fef2015ea80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:48:33.531 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:33.529+0000 7fef1e59c640 1 --2- 172.21.15.150:0/2480615783 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fef200b0990 0x7fef2015ea80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:48:33.531 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:33.529+0000 7fef1e59c640 1 -- 172.21.15.150:0/2480615783 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fef200b6550 msgr2=0x7fef201f7340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:48:33.531 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:33.529+0000 7fef1e59c640 1 --2- 172.21.15.150:0/2480615783 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fef200b6550 0x7fef201f7340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:48:33.531 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:33.529+0000 7fef1e59c640 1 -- 172.21.15.150:0/2480615783 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fef201f3940 con 0x7fef200b12e0 2024-09-17T05:48:33.531 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:33.529+0000 7fef1e59c640 1 --2- 172.21.15.150:0/2480615783 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fef200b12e0 0x7fef2015efc0 secure :-1 s=READY pgs=1063 cs=0 l=1 rev1=1 crypto rx=0x7fef08034040 tx=0x7fef08003970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:48:33.531 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:33.529+0000 7fef177fe640 1 -- 172.21.15.150:0/2480615783 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef0803e030 con 0x7fef200b12e0 2024-09-17T05:48:33.531 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:33.529+0000 7fef250a2640 1 -- 172.21.15.150:0/2480615783 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fef2014e1f0 con 0x7fef200b12e0 2024-09-17T05:48:33.531 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:33.529+0000 7fef177fe640 1 -- 172.21.15.150:0/2480615783 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fef080047a0 con 0x7fef200b12e0 2024-09-17T05:48:33.531 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:33.529+0000 7fef177fe640 1 -- 172.21.15.150:0/2480615783 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef08035040 con 0x7fef200b12e0 2024-09-17T05:48:33.531 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:33.529+0000 7fef250a2640 1 -- 172.21.15.150:0/2480615783 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fef201f4100 con 0x7fef200b12e0 2024-09-17T05:48:33.532 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:33.530+0000 7fef250a2640 1 -- 172.21.15.150:0/2480615783 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fef2006f9a0 con 0x7fef200b12e0 2024-09-17T05:48:33.532 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:33.531+0000 7fef177fe640 1 -- 172.21.15.150:0/2480615783 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 27) ==== 103124+0+0 (secure 0 0 0) 0x7fef08041030 con 0x7fef200b12e0 2024-09-17T05:48:33.532 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:33.531+0000 7fef177fe640 1 --2- 172.21.15.150:0/2480615783 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fef00079e20 0x7fef0007c330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:48:33.532 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:33.532+0000 7fef177fe640 1 -- 172.21.15.150:0/2480615783 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 5793+0+0 (secure 0 0 0) 0x7fef080ba1c0 con 0x7fef200b12e0 2024-09-17T05:48:33.533 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:33.532+0000 7fef1ed9d640 1 --2- 172.21.15.150:0/2480615783 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fef00079e20 0x7fef0007c330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:48:33.533 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:33.532+0000 7fef1ed9d640 1 --2- 172.21.15.150:0/2480615783 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fef00079e20 0x7fef0007c330 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7fef10001720 tx=0x7fef10009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:48:33.536 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:33.536+0000 7fef177fe640 1 -- 172.21.15.150:0/2480615783 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fef2006f9a0 con 0x7fef200b12e0 2024-09-17T05:48:33.741 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:33.740+0000 7fef250a2640 1 -- 172.21.15.150:0/2480615783 --> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "sub_name": "sv1", "target": ["mon-mgr", ""]}) -- 0x7fef201f3bb0 con 0x7fef00079e20 2024-09-17T05:48:33.745 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:33.745+0000 7fef177fe640 1 -- 172.21.15.150:0/2480615783 <== mgr.4108 v2:172.21.15.176:6800/3631216395 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+59 (secure 0 0 0) 0x7fef201f3bb0 con 0x7fef00079e20 2024-09-17T05:48:33.746 INFO:teuthology.orchestra.run.smithi150.stdout:/volumes/_nogroup/sv1/e79cf100-932a-417e-8f83-2f5b2add65a0 2024-09-17T05:48:33.748 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:33.747+0000 7fef250a2640 1 -- 172.21.15.150:0/2480615783 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fef00079e20 msgr2=0x7fef0007c330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:48:33.748 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:33.747+0000 7fef250a2640 1 --2- 172.21.15.150:0/2480615783 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fef00079e20 0x7fef0007c330 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7fef10001720 tx=0x7fef10009040 comp rx=0 tx=0).stop 2024-09-17T05:48:33.748 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:33.747+0000 7fef250a2640 1 -- 172.21.15.150:0/2480615783 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fef200b12e0 msgr2=0x7fef2015efc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:48:33.748 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:33.747+0000 7fef250a2640 1 --2- 172.21.15.150:0/2480615783 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fef200b12e0 0x7fef2015efc0 secure :-1 s=READY pgs=1063 cs=0 l=1 rev1=1 crypto rx=0x7fef08034040 tx=0x7fef08003970 comp rx=0 tx=0).stop 2024-09-17T05:48:33.749 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:33.747+0000 7fef250a2640 1 -- 172.21.15.150:0/2480615783 shutdown_connections 2024-09-17T05:48:33.749 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:33.747+0000 7fef250a2640 1 --2- 172.21.15.150:0/2480615783 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fef200b6550 0x7fef201f7340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:48:33.749 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:33.747+0000 7fef250a2640 1 --2- 172.21.15.150:0/2480615783 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fef00079e20 0x7fef0007c330 unknown :-1 s=CLOSED pgs=460 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:48:33.749 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:33.747+0000 7fef250a2640 1 --2- 172.21.15.150:0/2480615783 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fef200b12e0 0x7fef2015efc0 unknown :-1 s=CLOSED pgs=1063 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:48:33.749 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:33.747+0000 7fef250a2640 1 --2- 172.21.15.150:0/2480615783 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fef200b0990 0x7fef2015ea80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:48:33.749 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:33.747+0000 7fef250a2640 1 -- 172.21.15.150:0/2480615783 >> 172.21.15.150:0/2480615783 conn(0x7fef200b2e80 msgr2=0x7fef20068e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:48:33.749 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:33.747+0000 7fef250a2640 1 -- 172.21.15.150:0/2480615783 shutdown_connections 2024-09-17T05:48:33.749 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:33.747+0000 7fef250a2640 1 -- 172.21.15.150:0/2480615783 wait complete. 2024-09-17T05:48:33.759 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:48:33.760 DEBUG:teuthology.orchestra.run.smithi150:> (cd /home/ubuntu/cephtest/mnt.0 && exec getfattr -n ceph.dir.rbytes volumes/_nogroup/sv1/e79cf100-932a-417e-8f83-2f5b2add65a0 2024-09-17T05:48:33.760 DEBUG:teuthology.orchestra.run.smithi150:> ) 2024-09-17T05:48:33.775 INFO:teuthology.orchestra.run.smithi150.stdout:# file: volumes/_nogroup/sv1/e79cf100-932a-417e-8f83-2f5b2add65a0 2024-09-17T05:48:33.776 INFO:teuthology.orchestra.run.smithi150.stdout:ceph.dir.rbytes="2972172288" 2024-09-17T05:48:33.776 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-09-17T05:48:33.776 INFO:tasks.cephfs.test_volumes:r_size = 2972172288 exp_size = 3221225472 2024-09-17T05:48:35.777 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:48:35.777 DEBUG:teuthology.orchestra.run.smithi150:> (cd /home/ubuntu/cephtest/mnt.0 && exec getfattr -n ceph.dir.rbytes volumes/_nogroup/sv1/e79cf100-932a-417e-8f83-2f5b2add65a0 2024-09-17T05:48:35.777 DEBUG:teuthology.orchestra.run.smithi150:> ) 2024-09-17T05:48:35.797 INFO:teuthology.orchestra.run.smithi150.stdout:# file: volumes/_nogroup/sv1/e79cf100-932a-417e-8f83-2f5b2add65a0 2024-09-17T05:48:35.797 INFO:teuthology.orchestra.run.smithi150.stdout:ceph.dir.rbytes="2972172288" 2024-09-17T05:48:35.797 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-09-17T05:48:35.798 INFO:tasks.cephfs.test_volumes:r_size = 2972172288 exp_size = 3221225472 2024-09-17T05:48:37.799 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:48:37.799 DEBUG:teuthology.orchestra.run.smithi150:> (cd /home/ubuntu/cephtest/mnt.0 && exec getfattr -n ceph.dir.rbytes volumes/_nogroup/sv1/e79cf100-932a-417e-8f83-2f5b2add65a0 2024-09-17T05:48:37.799 DEBUG:teuthology.orchestra.run.smithi150:> ) 2024-09-17T05:48:37.819 INFO:teuthology.orchestra.run.smithi150.stdout:# file: volumes/_nogroup/sv1/e79cf100-932a-417e-8f83-2f5b2add65a0 2024-09-17T05:48:37.819 INFO:teuthology.orchestra.run.smithi150.stdout:ceph.dir.rbytes="3221225472" 2024-09-17T05:48:37.820 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-09-17T05:48:37.820 INFO:tasks.cephfs.test_volumes:r_size = 3221225472 exp_size = 3221225472 2024-09-17T05:48:37.820 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume snapshot clone cephfs sv1 ss1 subvol_clone3600 2024-09-17T05:48:37.992 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:37.991+0000 7f7fd3750640 1 -- 172.21.15.150:0/855349029 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7fcc070a10 msgr2=0x7f7fcc15ee80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:48:37.992 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:37.991+0000 7f7fd3750640 1 --2- 172.21.15.150:0/855349029 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7fcc070a10 0x7f7fcc15ee80 secure :-1 s=READY pgs=1064 cs=0 l=1 rev1=1 crypto rx=0x7f7fcc072bd0 tx=0x7f7fbc02a560 comp rx=0 tx=0).stop 2024-09-17T05:48:37.992 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:37.991+0000 7f7fd3750640 1 -- 172.21.15.150:0/855349029 shutdown_connections 2024-09-17T05:48:37.992 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:37.991+0000 7f7fd3750640 1 --2- 172.21.15.150:0/855349029 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7fcc070a10 0x7f7fcc15ee80 unknown :-1 s=CLOSED pgs=1064 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:48:37.993 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:37.991+0000 7f7fd3750640 1 --2- 172.21.15.150:0/855349029 >> v2:172.21.15.176:3300/0 conn(0x7f7fcc070600 0x7f7fcc15e940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:48:37.993 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:37.991+0000 7f7fd3750640 1 -- 172.21.15.150:0/855349029 >> 172.21.15.150:0/855349029 conn(0x7f7fcc06d1c0 msgr2=0x7f7fcc06d5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:48:37.993 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:37.991+0000 7f7fd3750640 1 -- 172.21.15.150:0/855349029 shutdown_connections 2024-09-17T05:48:37.993 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:37.991+0000 7f7fd3750640 1 -- 172.21.15.150:0/855349029 wait complete. 2024-09-17T05:48:37.994 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:37.993+0000 7f7fd3750640 1 Processor -- start 2024-09-17T05:48:37.994 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:37.993+0000 7f7fd3750640 1 -- start start 2024-09-17T05:48:37.996 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:37.995+0000 7f7fd3750640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7fcc070600 0x7f7fcc14cb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:48:37.997 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:37.995+0000 7f7fd3750640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7fcc070a10 0x7f7fcc14dfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:48:37.997 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:37.995+0000 7f7fd3750640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7fcc0b3960 0x7f7fcc14af80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:48:37.997 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:37.995+0000 7f7fd3750640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f7fcc0cf790 con 0x7f7fcc0b3960 2024-09-17T05:48:37.997 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:37.995+0000 7f7fd3750640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f7fcc0cf610 con 0x7f7fcc070600 2024-09-17T05:48:37.997 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:37.995+0000 7f7fd3750640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f7fcc0cf910 con 0x7f7fcc070a10 2024-09-17T05:48:37.997 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:37.995+0000 7f7fd1ced640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7fcc0b3960 0x7f7fcc14af80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:48:37.997 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:37.995+0000 7f7fd1ced640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7fcc0b3960 0x7f7fcc14af80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:50156/0 (socket says 172.21.15.150:50156) 2024-09-17T05:48:37.997 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:37.995+0000 7f7fd1ced640 1 -- 172.21.15.150:0/1913726835 learned_addr learned my addr 172.21.15.150:0/1913726835 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:48:37.997 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:37.995+0000 7f7fd14ec640 1 --2- 172.21.15.150:0/1913726835 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7fcc070600 0x7f7fcc14cb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:48:37.997 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:37.995+0000 7f7fd0ceb640 1 --2- 172.21.15.150:0/1913726835 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7fcc070a10 0x7f7fcc14dfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:48:37.997 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:37.995+0000 7f7fd1ced640 1 -- 172.21.15.150:0/1913726835 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7fcc070a10 msgr2=0x7f7fcc14dfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:48:37.997 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:37.995+0000 7f7fd1ced640 1 --2- 172.21.15.150:0/1913726835 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7fcc070a10 0x7f7fcc14dfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:48:37.997 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:37.995+0000 7f7fd1ced640 1 -- 172.21.15.150:0/1913726835 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7fcc070600 msgr2=0x7f7fcc14cb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:48:37.998 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:37.995+0000 7f7fd1ced640 1 --2- 172.21.15.150:0/1913726835 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7fcc070600 0x7f7fcc14cb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:48:37.998 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:37.995+0000 7f7fd1ced640 1 -- 172.21.15.150:0/1913726835 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7fcc0aa7b0 con 0x7f7fcc0b3960 2024-09-17T05:48:37.998 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:37.996+0000 7f7fd1ced640 1 --2- 172.21.15.150:0/1913726835 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7fcc0b3960 0x7f7fcc14af80 secure :-1 s=READY pgs=1065 cs=0 l=1 rev1=1 crypto rx=0x7f7fc400dc30 tx=0x7f7fc400dd20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:48:37.998 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:37.996+0000 7f7fc1ffb640 1 -- 172.21.15.150:0/1913726835 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7fc401b070 con 0x7f7fcc0b3960 2024-09-17T05:48:37.998 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:37.996+0000 7f7fc1ffb640 1 -- 172.21.15.150:0/1913726835 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f7fc4016440 con 0x7f7fcc0b3960 2024-09-17T05:48:37.998 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:37.996+0000 7f7fd3750640 1 -- 172.21.15.150:0/1913726835 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7fcc0aaa90 con 0x7f7fcc0b3960 2024-09-17T05:48:37.998 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:37.996+0000 7f7fc1ffb640 1 -- 172.21.15.150:0/1913726835 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7fc4016890 con 0x7f7fcc0b3960 2024-09-17T05:48:37.998 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:37.996+0000 7f7fd3750640 1 -- 172.21.15.150:0/1913726835 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7fcc14ea00 con 0x7f7fcc0b3960 2024-09-17T05:48:37.999 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:37.997+0000 7f7fd3750640 1 -- 172.21.15.150:0/1913726835 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7fcc14dd50 con 0x7f7fcc0b3960 2024-09-17T05:48:37.999 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:37.998+0000 7f7fc1ffb640 1 -- 172.21.15.150:0/1913726835 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 27) ==== 103124+0+0 (secure 0 0 0) 0x7f7fc401e070 con 0x7f7fcc0b3960 2024-09-17T05:48:37.999 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:37.999+0000 7f7fc1ffb640 1 --2- 172.21.15.150:0/1913726835 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f7fb0079e20 0x7f7fb007c330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:48:37.999 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:37.999+0000 7f7fc1ffb640 1 -- 172.21.15.150:0/1913726835 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 5793+0+0 (secure 0 0 0) 0x7f7fc409ba30 con 0x7f7fcc0b3960 2024-09-17T05:48:38.000 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:37.999+0000 7f7fd14ec640 1 --2- 172.21.15.150:0/1913726835 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f7fb0079e20 0x7f7fb007c330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:48:38.000 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:38.000+0000 7f7fd14ec640 1 --2- 172.21.15.150:0/1913726835 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f7fb0079e20 0x7f7fb007c330 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f7fc800bb50 tx=0x7f7fc800b2e0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:48:38.004 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:38.004+0000 7f7fc1ffb640 1 -- 172.21.15.150:0/1913726835 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f7fc4065360 con 0x7f7fcc0b3960 2024-09-17T05:48:38.214 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:38.213+0000 7f7fd3750640 1 -- 172.21.15.150:0/1913726835 --> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] -- mgr_command(tid 0: {"prefix": "fs subvolume snapshot clone", "vol_name": "cephfs", "sub_name": "sv1", "snap_name": "ss1", "target_sub_name": "subvol_clone3600", "target": ["mon-mgr", ""]}) -- 0x7f7fcc0cfdc0 con 0x7f7fb0079e20 2024-09-17T05:48:38.274 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:38.273+0000 7f7fc1ffb640 1 -- 172.21.15.150:0/1913726835 <== mgr.4108 v2:172.21.15.176:6800/3631216395 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f7fcc0cfdc0 con 0x7f7fb0079e20 2024-09-17T05:48:38.277 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:38.276+0000 7f7fd3750640 1 -- 172.21.15.150:0/1913726835 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f7fb0079e20 msgr2=0x7f7fb007c330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:48:38.277 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:38.276+0000 7f7fd3750640 1 --2- 172.21.15.150:0/1913726835 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f7fb0079e20 0x7f7fb007c330 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f7fc800bb50 tx=0x7f7fc800b2e0 comp rx=0 tx=0).stop 2024-09-17T05:48:38.277 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:38.276+0000 7f7fd3750640 1 -- 172.21.15.150:0/1913726835 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7fcc0b3960 msgr2=0x7f7fcc14af80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:48:38.277 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:38.276+0000 7f7fd3750640 1 --2- 172.21.15.150:0/1913726835 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7fcc0b3960 0x7f7fcc14af80 secure :-1 s=READY pgs=1065 cs=0 l=1 rev1=1 crypto rx=0x7f7fc400dc30 tx=0x7f7fc400dd20 comp rx=0 tx=0).stop 2024-09-17T05:48:38.277 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:38.276+0000 7f7fd3750640 1 -- 172.21.15.150:0/1913726835 shutdown_connections 2024-09-17T05:48:38.277 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:38.276+0000 7f7fd3750640 1 --2- 172.21.15.150:0/1913726835 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f7fb0079e20 0x7f7fb007c330 unknown :-1 s=CLOSED pgs=461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:48:38.277 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:38.276+0000 7f7fd3750640 1 --2- 172.21.15.150:0/1913726835 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7fcc0b3960 0x7f7fcc14af80 unknown :-1 s=CLOSED pgs=1065 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:48:38.277 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:38.276+0000 7f7fd3750640 1 --2- 172.21.15.150:0/1913726835 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7fcc070a10 0x7f7fcc14dfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:48:38.277 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:38.276+0000 7f7fd3750640 1 --2- 172.21.15.150:0/1913726835 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7fcc070600 0x7f7fcc14cb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:48:38.278 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:38.276+0000 7f7fd3750640 1 -- 172.21.15.150:0/1913726835 >> 172.21.15.150:0/1913726835 conn(0x7f7fcc06d1c0 msgr2=0x7f7fcc15a5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:48:38.278 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:38.276+0000 7f7fd3750640 1 -- 172.21.15.150:0/1913726835 shutdown_connections 2024-09-17T05:48:38.278 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:38.276+0000 7f7fd3750640 1 -- 172.21.15.150:0/1913726835 wait complete. 2024-09-17T05:48:38.280 INFO:tasks.ceph.mgr.x.smithi176.stderr:2024-09-17T05:48:38.279+0000 7f33dc724640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-17T05:48:38.280 INFO:tasks.ceph.mgr.x.smithi176.stderr:2024-09-17T05:48:38.279+0000 7f33dc724640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-17T05:48:38.280 INFO:tasks.ceph.mgr.x.smithi176.stderr:2024-09-17T05:48:38.279+0000 7f33dc724640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-17T05:48:38.281 INFO:tasks.ceph.mgr.x.smithi176.stderr:2024-09-17T05:48:38.279+0000 7f33dc724640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-17T05:48:38.281 INFO:tasks.ceph.mgr.x.smithi176.stderr:2024-09-17T05:48:38.279+0000 7f33dc724640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-17T05:48:38.288 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume snapshot clone cephfs sv1 ss1 subvol_clone91801 2024-09-17T05:48:38.295 INFO:tasks.ceph.mgr.x.smithi176.stderr:2024-09-17T05:48:38.294+0000 7f33dbf23640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-17T05:48:38.295 INFO:tasks.ceph.mgr.x.smithi176.stderr:2024-09-17T05:48:38.294+0000 7f33dbf23640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-17T05:48:38.295 INFO:tasks.ceph.mgr.x.smithi176.stderr:2024-09-17T05:48:38.294+0000 7f33dbf23640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-17T05:48:38.295 INFO:tasks.ceph.mgr.x.smithi176.stderr:2024-09-17T05:48:38.294+0000 7f33dbf23640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-17T05:48:38.295 INFO:tasks.ceph.mgr.x.smithi176.stderr:2024-09-17T05:48:38.294+0000 7f33dbf23640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-17T05:48:38.408 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:38.407+0000 7f771f132640 1 -- 172.21.15.150:0/3025501229 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f77180ce4c0 msgr2=0x7f77180ce8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:48:38.408 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:38.407+0000 7f771f132640 1 --2- 172.21.15.150:0/3025501229 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f77180ce4c0 0x7f77180ce8d0 secure :-1 s=READY pgs=1067 cs=0 l=1 rev1=1 crypto rx=0x7f77180c9590 tx=0x7f770002a440 comp rx=0 tx=0).stop 2024-09-17T05:48:38.408 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:38.407+0000 7f771f132640 1 -- 172.21.15.150:0/3025501229 shutdown_connections 2024-09-17T05:48:38.408 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:38.407+0000 7f771f132640 1 --2- 172.21.15.150:0/3025501229 >> v2:172.21.15.176:3300/0 conn(0x7f77180d0980 0x7f77180d0d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:48:38.409 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:38.407+0000 7f771f132640 1 --2- 172.21.15.150:0/3025501229 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f77180ce4c0 0x7f77180ce8d0 unknown :-1 s=CLOSED pgs=1067 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:48:38.409 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:38.407+0000 7f771f132640 1 --2- 172.21.15.150:0/3025501229 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f77180af160 0x7f77180af570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:48:38.409 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:38.407+0000 7f771f132640 1 -- 172.21.15.150:0/3025501229 >> 172.21.15.150:0/3025501229 conn(0x7f77180cefb0 msgr2=0x7f77180cf3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:48:38.409 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:38.407+0000 7f771f132640 1 -- 172.21.15.150:0/3025501229 shutdown_connections 2024-09-17T05:48:38.409 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:38.407+0000 7f771f132640 1 -- 172.21.15.150:0/3025501229 wait complete. 2024-09-17T05:48:38.409 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:38.409+0000 7f771f132640 1 Processor -- start 2024-09-17T05:48:38.409 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:38.409+0000 7f771f132640 1 -- start start 2024-09-17T05:48:38.413 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:38.410+0000 7f771f132640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f77180af160 0x7f771814b280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:48:38.413 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:38.410+0000 7f771f132640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f77180ce4c0 0x7f771809f920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:48:38.413 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:38.410+0000 7f771f132640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f77180d0980 0x7f77181e7c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:48:38.413 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:38.410+0000 7f771f132640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f77180d1450 con 0x7f77180af160 2024-09-17T05:48:38.413 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:38.410+0000 7f771f132640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f77180d12d0 con 0x7f77180d0980 2024-09-17T05:48:38.413 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:38.410+0000 7f771f132640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f7718160cb0 con 0x7f77180ce4c0 2024-09-17T05:48:38.414 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:38.410+0000 7f771cece640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f77180af160 0x7f771814b280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:48:38.414 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:38.411+0000 7f771cece640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f77180af160 0x7f771814b280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:50170/0 (socket says 172.21.15.150:50170) 2024-09-17T05:48:38.414 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:38.411+0000 7f771cece640 1 -- 172.21.15.150:0/1349383082 learned_addr learned my addr 172.21.15.150:0/1349383082 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:48:38.414 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:38.411+0000 7f7717fff640 1 --2- 172.21.15.150:0/1349383082 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f77180ce4c0 0x7f771809f920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:48:38.414 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:38.411+0000 7f771d6cf640 1 --2- 172.21.15.150:0/1349383082 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f77180d0980 0x7f77181e7c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:48:38.414 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:38.411+0000 7f771cece640 1 -- 172.21.15.150:0/1349383082 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f77180ce4c0 msgr2=0x7f771809f920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:48:38.414 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:38.411+0000 7f771cece640 1 --2- 172.21.15.150:0/1349383082 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f77180ce4c0 0x7f771809f920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:48:38.415 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:38.411+0000 7f771cece640 1 -- 172.21.15.150:0/1349383082 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f77180d0980 msgr2=0x7f77181e7c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:48:38.415 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:38.411+0000 7f771cece640 1 --2- 172.21.15.150:0/1349383082 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f77180d0980 0x7f77181e7c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:48:38.415 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:38.411+0000 7f771cece640 1 -- 172.21.15.150:0/1349383082 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f77181e6bf0 con 0x7f77180af160 2024-09-17T05:48:38.415 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:38.411+0000 7f771d6cf640 1 --2- 172.21.15.150:0/1349383082 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f77180d0980 0x7f77181e7c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:48:38.415 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:38.411+0000 7f771cece640 1 --2- 172.21.15.150:0/1349383082 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f77180af160 0x7f771814b280 secure :-1 s=READY pgs=1068 cs=0 l=1 rev1=1 crypto rx=0x7f7708005fd0 tx=0x7f770800a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:48:38.415 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:38.411+0000 7f77157fa640 1 -- 172.21.15.150:0/1349383082 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f770800f450 con 0x7f77180af160 2024-09-17T05:48:38.415 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:38.411+0000 7f77157fa640 1 -- 172.21.15.150:0/1349383082 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f770800f6e0 con 0x7f77180af160 2024-09-17T05:48:38.415 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:38.411+0000 7f771f132640 1 -- 172.21.15.150:0/1349383082 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f77181e6ed0 con 0x7f77180af160 2024-09-17T05:48:38.415 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:38.411+0000 7f77157fa640 1 -- 172.21.15.150:0/1349383082 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f770800fb10 con 0x7f77180af160 2024-09-17T05:48:38.416 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:38.411+0000 7f771f132640 1 -- 172.21.15.150:0/1349383082 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f77181e7490 con 0x7f77180af160 2024-09-17T05:48:38.416 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:38.412+0000 7f771f132640 1 -- 172.21.15.150:0/1349383082 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f77180ce8d0 con 0x7f77180af160 2024-09-17T05:48:38.416 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:38.413+0000 7f77157fa640 1 -- 172.21.15.150:0/1349383082 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 27) ==== 103124+0+0 (secure 0 0 0) 0x7f770800fcb0 con 0x7f77180af160 2024-09-17T05:48:38.417 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:38.414+0000 7f77157fa640 1 --2- 172.21.15.150:0/1349383082 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f76f8079e20 0x7f76f807c330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:48:38.417 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:38.414+0000 7f77157fa640 1 -- 172.21.15.150:0/1349383082 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 5822+0+0 (secure 0 0 0) 0x7f770809a3d0 con 0x7f77180af160 2024-09-17T05:48:38.417 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:38.414+0000 7f7717fff640 1 --2- 172.21.15.150:0/1349383082 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f76f8079e20 0x7f76f807c330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:48:38.417 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:38.414+0000 7f7717fff640 1 --2- 172.21.15.150:0/1349383082 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f76f8079e20 0x7f76f807c330 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f7700033000 tx=0x7f7700004730 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:48:38.419 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:38.418+0000 7f77157fa640 1 -- 172.21.15.150:0/1349383082 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f7708014030 con 0x7f77180af160 2024-09-17T05:48:38.626 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:38.626+0000 7f771f132640 1 -- 172.21.15.150:0/1349383082 --> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] -- mgr_command(tid 0: {"prefix": "fs subvolume snapshot clone", "vol_name": "cephfs", "sub_name": "sv1", "snap_name": "ss1", "target_sub_name": "subvol_clone91801", "target": ["mon-mgr", ""]}) -- 0x7f77180b6200 con 0x7f76f8079e20 2024-09-17T05:48:39.051 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:39.050+0000 7f77157fa640 1 -- 172.21.15.150:0/1349383082 <== mon.0 v2:172.21.15.150:3300/0 7 ==== mgrmap(e 28) ==== 103226+0+0 (secure 0 0 0) 0x7f770805fdb0 con 0x7f77180af160 2024-09-17T05:48:39.278 INFO:tasks.ceph.mgr.x.smithi176.stderr:2024-09-17T05:48:39.276+0000 7f33a05ec640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-17T05:48:39.278 INFO:tasks.ceph.mgr.x.smithi176.stderr:2024-09-17T05:48:39.276+0000 7f33a05ec640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-17T05:48:39.278 INFO:tasks.ceph.mgr.x.smithi176.stderr:2024-09-17T05:48:39.276+0000 7f33a05ec640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-17T05:48:39.278 INFO:tasks.ceph.mgr.x.smithi176.stderr:2024-09-17T05:48:39.276+0000 7f33a05ec640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-17T05:48:39.278 INFO:tasks.ceph.mgr.x.smithi176.stderr:2024-09-17T05:48:39.276+0000 7f33a05ec640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-17T05:48:39.373 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:39.373+0000 7f77157fa640 1 -- 172.21.15.150:0/1349383082 <== mgr.4108 v2:172.21.15.176:6800/3631216395 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f77180b6200 con 0x7f76f8079e20 2024-09-17T05:48:39.376 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:39.375+0000 7f771f132640 1 -- 172.21.15.150:0/1349383082 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f76f8079e20 msgr2=0x7f76f807c330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:48:39.376 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:39.375+0000 7f771f132640 1 --2- 172.21.15.150:0/1349383082 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f76f8079e20 0x7f76f807c330 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f7700033000 tx=0x7f7700004730 comp rx=0 tx=0).stop 2024-09-17T05:48:39.376 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:39.375+0000 7f771f132640 1 -- 172.21.15.150:0/1349383082 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f77180af160 msgr2=0x7f771814b280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:48:39.376 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:39.375+0000 7f771f132640 1 --2- 172.21.15.150:0/1349383082 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f77180af160 0x7f771814b280 secure :-1 s=READY pgs=1068 cs=0 l=1 rev1=1 crypto rx=0x7f7708005fd0 tx=0x7f770800a620 comp rx=0 tx=0).stop 2024-09-17T05:48:39.376 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:39.375+0000 7f771f132640 1 -- 172.21.15.150:0/1349383082 shutdown_connections 2024-09-17T05:48:39.377 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:39.375+0000 7f771f132640 1 --2- 172.21.15.150:0/1349383082 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f77180d0980 0x7f77181e7c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:48:39.377 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:39.375+0000 7f771f132640 1 --2- 172.21.15.150:0/1349383082 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f76f8079e20 0x7f76f807c330 unknown :-1 s=CLOSED pgs=462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:48:39.377 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:39.375+0000 7f771f132640 1 --2- 172.21.15.150:0/1349383082 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f77180ce4c0 0x7f771809f920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:48:39.377 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:39.375+0000 7f771f132640 1 --2- 172.21.15.150:0/1349383082 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f77180af160 0x7f771814b280 unknown :-1 s=CLOSED pgs=1068 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:48:39.377 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:39.375+0000 7f771f132640 1 -- 172.21.15.150:0/1349383082 >> 172.21.15.150:0/1349383082 conn(0x7f77180cefb0 msgr2=0x7f77180cf3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:48:39.377 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:39.375+0000 7f771f132640 1 -- 172.21.15.150:0/1349383082 shutdown_connections 2024-09-17T05:48:39.377 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:39.376+0000 7f771f132640 1 -- 172.21.15.150:0/1349383082 wait complete. 2024-09-17T05:48:39.396 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume snapshot clone cephfs sv1 ss1 subvol_clone73572 2024-09-17T05:48:39.427 INFO:tasks.ceph.mgr.x.smithi176.stderr:2024-09-17T05:48:39.425+0000 7f33dbf23640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-17T05:48:39.427 INFO:tasks.ceph.mgr.x.smithi176.stderr:2024-09-17T05:48:39.425+0000 7f33dbf23640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-17T05:48:39.427 INFO:tasks.ceph.mgr.x.smithi176.stderr:2024-09-17T05:48:39.425+0000 7f33dbf23640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-17T05:48:39.427 INFO:tasks.ceph.mgr.x.smithi176.stderr:2024-09-17T05:48:39.425+0000 7f33dbf23640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-17T05:48:39.427 INFO:tasks.ceph.mgr.x.smithi176.stderr:2024-09-17T05:48:39.425+0000 7f33dbf23640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-17T05:48:39.559 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:39.558+0000 7f3773abd640 1 -- 172.21.15.150:0/1128790218 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f376c15ce40 msgr2=0x7f376c071230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:48:39.559 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:39.558+0000 7f3773abd640 1 --2- 172.21.15.150:0/1128790218 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f376c15ce40 0x7f376c071230 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f3768009860 tx=0x7f376802a440 comp rx=0 tx=0).stop 2024-09-17T05:48:39.559 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:39.558+0000 7f3773abd640 1 -- 172.21.15.150:0/1128790218 shutdown_connections 2024-09-17T05:48:39.559 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:39.558+0000 7f3773abd640 1 --2- 172.21.15.150:0/1128790218 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f376c06e4c0 0x7f376c0cf2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:48:39.559 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:39.558+0000 7f3773abd640 1 --2- 172.21.15.150:0/1128790218 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f376c15ce40 0x7f376c071230 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:48:39.559 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:39.558+0000 7f3773abd640 1 -- 172.21.15.150:0/1128790218 >> 172.21.15.150:0/1128790218 conn(0x7f376c073890 msgr2=0x7f376c073ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:48:39.559 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:39.558+0000 7f3773abd640 1 -- 172.21.15.150:0/1128790218 shutdown_connections 2024-09-17T05:48:39.559 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:39.558+0000 7f3773abd640 1 -- 172.21.15.150:0/1128790218 wait complete. 2024-09-17T05:48:39.560 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:39.560+0000 7f3773abd640 1 Processor -- start 2024-09-17T05:48:39.560 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:39.560+0000 7f3773abd640 1 -- start start 2024-09-17T05:48:39.563 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:39.561+0000 7f3773abd640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f376c152690 0x7f376c142260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:48:39.563 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:39.561+0000 7f3773abd640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f376c15ce40 0x7f376c1f7210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:48:39.563 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:39.561+0000 7f3773abd640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f376c1f3210 0x7f376c0afd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:48:39.563 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:39.561+0000 7f3773abd640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f376c0cf960 con 0x7f376c15ce40 2024-09-17T05:48:39.563 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:39.561+0000 7f3773abd640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f376c0cf7e0 con 0x7f376c1f3210 2024-09-17T05:48:39.563 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:39.561+0000 7f3773abd640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f376c0cfae0 con 0x7f376c152690 2024-09-17T05:48:39.563 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:39.561+0000 7f3771058640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f376c15ce40 0x7f376c1f7210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:48:39.563 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:39.561+0000 7f3771058640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f376c15ce40 0x7f376c1f7210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:50182/0 (socket says 172.21.15.150:50182) 2024-09-17T05:48:39.564 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:39.561+0000 7f3771058640 1 -- 172.21.15.150:0/1158830729 learned_addr learned my addr 172.21.15.150:0/1158830729 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:48:39.564 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:39.562+0000 7f377205a640 1 --2- 172.21.15.150:0/1158830729 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f376c1f3210 0x7f376c0afd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:48:39.564 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:39.562+0000 7f3771859640 1 --2- 172.21.15.150:0/1158830729 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f376c152690 0x7f376c142260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:48:39.564 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:39.562+0000 7f3771058640 1 -- 172.21.15.150:0/1158830729 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f376c152690 msgr2=0x7f376c142260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:48:39.564 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:39.562+0000 7f3771058640 1 --2- 172.21.15.150:0/1158830729 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f376c152690 0x7f376c142260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:48:39.564 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:39.562+0000 7f3771058640 1 -- 172.21.15.150:0/1158830729 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f376c1f3210 msgr2=0x7f376c0afd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:48:39.564 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:39.562+0000 7f3771058640 1 --2- 172.21.15.150:0/1158830729 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f376c1f3210 0x7f376c0afd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:48:39.564 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:39.562+0000 7f3771058640 1 -- 172.21.15.150:0/1158830729 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f376c1f38f0 con 0x7f376c15ce40 2024-09-17T05:48:39.564 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:39.562+0000 7f377205a640 1 --2- 172.21.15.150:0/1158830729 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f376c1f3210 0x7f376c0afd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T05:48:39.564 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:39.562+0000 7f3771058640 1 --2- 172.21.15.150:0/1158830729 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f376c15ce40 0x7f376c1f7210 secure :-1 s=READY pgs=1071 cs=0 l=1 rev1=1 crypto rx=0x7f375c00c500 tx=0x7f375c00c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:48:39.564 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:39.562+0000 7f37627fc640 1 -- 172.21.15.150:0/1158830729 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f375c011790 con 0x7f376c15ce40 2024-09-17T05:48:39.564 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:39.562+0000 7f37627fc640 1 -- 172.21.15.150:0/1158830729 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f375c017070 con 0x7f376c15ce40 2024-09-17T05:48:39.564 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:39.562+0000 7f3773abd640 1 -- 172.21.15.150:0/1158830729 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f376c1f3bd0 con 0x7f376c15ce40 2024-09-17T05:48:39.565 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:39.562+0000 7f37627fc640 1 -- 172.21.15.150:0/1158830729 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f375c011ce0 con 0x7f376c15ce40 2024-09-17T05:48:39.565 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:39.562+0000 7f3773abd640 1 -- 172.21.15.150:0/1158830729 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f376c1428a0 con 0x7f376c15ce40 2024-09-17T05:48:39.565 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:39.563+0000 7f3773abd640 1 -- 172.21.15.150:0/1158830729 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f376c1442c0 con 0x7f376c15ce40 2024-09-17T05:48:39.565 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:39.564+0000 7f37627fc640 1 -- 172.21.15.150:0/1158830729 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 28) ==== 103226+0+0 (secure 0 0 0) 0x7f375c01c460 con 0x7f376c15ce40 2024-09-17T05:48:39.565 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:39.565+0000 7f37627fc640 1 --2- 172.21.15.150:0/1158830729 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f3750079f70 0x7f375007c480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:48:39.566 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:39.565+0000 7f37627fc640 1 -- 172.21.15.150:0/1158830729 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 5822+0+0 (secure 0 0 0) 0x7f375c099840 con 0x7f376c15ce40 2024-09-17T05:48:39.566 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:39.565+0000 7f3771859640 1 --2- 172.21.15.150:0/1158830729 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f3750079f70 0x7f375007c480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:48:39.566 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:39.566+0000 7f3771859640 1 --2- 172.21.15.150:0/1158830729 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f3750079f70 0x7f375007c480 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f3768034000 tx=0x7f376802c040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:48:39.571 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:39.571+0000 7f37627fc640 1 -- 172.21.15.150:0/1158830729 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f375c063740 con 0x7f376c15ce40 2024-09-17T05:48:39.845 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:39.845+0000 7f3773abd640 1 -- 172.21.15.150:0/1158830729 --> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] -- mgr_command(tid 0: {"prefix": "fs subvolume snapshot clone", "vol_name": "cephfs", "sub_name": "sv1", "snap_name": "ss1", "target_sub_name": "subvol_clone73572", "target": ["mon-mgr", ""]}) -- 0x7f376c1f40f0 con 0x7f3750079f70 2024-09-17T05:48:40.374 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:40.373+0000 7f37627fc640 1 -- 172.21.15.150:0/1158830729 <== mgr.4108 v2:172.21.15.176:6800/3631216395 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f376c1f40f0 con 0x7f3750079f70 2024-09-17T05:48:40.379 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:40.378+0000 7f3773abd640 1 -- 172.21.15.150:0/1158830729 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f3750079f70 msgr2=0x7f375007c480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:48:40.379 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:40.378+0000 7f3773abd640 1 --2- 172.21.15.150:0/1158830729 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f3750079f70 0x7f375007c480 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f3768034000 tx=0x7f376802c040 comp rx=0 tx=0).stop 2024-09-17T05:48:40.379 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:40.378+0000 7f3773abd640 1 -- 172.21.15.150:0/1158830729 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f376c15ce40 msgr2=0x7f376c1f7210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:48:40.379 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:40.378+0000 7f3773abd640 1 --2- 172.21.15.150:0/1158830729 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f376c15ce40 0x7f376c1f7210 secure :-1 s=READY pgs=1071 cs=0 l=1 rev1=1 crypto rx=0x7f375c00c500 tx=0x7f375c00c9c0 comp rx=0 tx=0).stop 2024-09-17T05:48:40.379 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:40.378+0000 7f3773abd640 1 -- 172.21.15.150:0/1158830729 shutdown_connections 2024-09-17T05:48:40.379 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:40.378+0000 7f3773abd640 1 --2- 172.21.15.150:0/1158830729 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f376c1f3210 0x7f376c0afd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:48:40.379 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:40.378+0000 7f3773abd640 1 --2- 172.21.15.150:0/1158830729 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f3750079f70 0x7f375007c480 secure :-1 s=CLOSED pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f3768034000 tx=0x7f376802c040 comp rx=0 tx=0).stop 2024-09-17T05:48:40.379 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:40.378+0000 7f3773abd640 1 --2- 172.21.15.150:0/1158830729 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f376c15ce40 0x7f376c1f7210 secure :-1 s=CLOSED pgs=1071 cs=0 l=1 rev1=1 crypto rx=0x7f375c00c500 tx=0x7f375c00c9c0 comp rx=0 tx=0).stop 2024-09-17T05:48:40.379 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:40.378+0000 7f3773abd640 1 --2- 172.21.15.150:0/1158830729 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f376c152690 0x7f376c142260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:48:40.379 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:40.378+0000 7f3773abd640 1 -- 172.21.15.150:0/1158830729 >> 172.21.15.150:0/1158830729 conn(0x7f376c073890 msgr2=0x7f376c0b14e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:48:40.379 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:40.378+0000 7f3773abd640 1 -- 172.21.15.150:0/1158830729 shutdown_connections 2024-09-17T05:48:40.379 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:40.378+0000 7f3773abd640 1 -- 172.21.15.150:0/1158830729 wait complete. 2024-09-17T05:48:40.399 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume snapshot clone cephfs sv1 ss1 subvol_clone17383 2024-09-17T05:48:40.459 INFO:tasks.ceph.mgr.x.smithi176.stderr:2024-09-17T05:48:40.457+0000 7f33dcf25640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-17T05:48:40.459 INFO:tasks.ceph.mgr.x.smithi176.stderr:2024-09-17T05:48:40.457+0000 7f33dcf25640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-17T05:48:40.459 INFO:tasks.ceph.mgr.x.smithi176.stderr:2024-09-17T05:48:40.457+0000 7f33dcf25640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-17T05:48:40.459 INFO:tasks.ceph.mgr.x.smithi176.stderr:2024-09-17T05:48:40.457+0000 7f33dcf25640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-17T05:48:40.459 INFO:tasks.ceph.mgr.x.smithi176.stderr:2024-09-17T05:48:40.457+0000 7f33dcf25640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-17T05:48:40.574 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:40.573+0000 7f7e46071640 1 -- 172.21.15.150:0/283743308 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7e4015eae0 msgr2=0x7f7e4015eef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:48:40.575 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:40.573+0000 7f7e46071640 1 --2- 172.21.15.150:0/283743308 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7e4015eae0 0x7f7e4015eef0 secure :-1 s=READY pgs=1073 cs=0 l=1 rev1=1 crypto rx=0x7f7e40152570 tx=0x7f7e3402b930 comp rx=0 tx=0).stop 2024-09-17T05:48:40.575 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:40.573+0000 7f7e46071640 1 -- 172.21.15.150:0/283743308 shutdown_connections 2024-09-17T05:48:40.575 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:40.573+0000 7f7e46071640 1 --2- 172.21.15.150:0/283743308 >> v2:172.21.15.176:3300/0 conn(0x7f7e4006ddb0 0x7f7e4006e1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:48:40.575 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:40.573+0000 7f7e46071640 1 --2- 172.21.15.150:0/283743308 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7e4015eae0 0x7f7e4015eef0 unknown :-1 s=CLOSED pgs=1073 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:48:40.575 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:40.573+0000 7f7e46071640 1 -- 172.21.15.150:0/283743308 >> 172.21.15.150:0/283743308 conn(0x7f7e40073890 msgr2=0x7f7e40073ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:48:40.575 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:40.573+0000 7f7e46071640 1 -- 172.21.15.150:0/283743308 shutdown_connections 2024-09-17T05:48:40.575 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:40.573+0000 7f7e46071640 1 -- 172.21.15.150:0/283743308 wait complete. 2024-09-17T05:48:40.576 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:40.575+0000 7f7e46071640 1 Processor -- start 2024-09-17T05:48:40.576 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:40.576+0000 7f7e46071640 1 -- start start 2024-09-17T05:48:40.578 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:40.577+0000 7f7e46071640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7e4006ddb0 0x7f7e401f7b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:48:40.578 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:40.577+0000 7f7e46071640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7e4015c130 0x7f7e401f3a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:48:40.578 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:40.577+0000 7f7e46071640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7e4015eae0 0x7f7e4013d810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:48:40.578 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:40.577+0000 7f7e46071640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f7e400760b0 con 0x7f7e4015eae0 2024-09-17T05:48:40.578 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:40.577+0000 7f7e46071640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f7e40075f30 con 0x7f7e4006ddb0 2024-09-17T05:48:40.578 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:40.577+0000 7f7e46071640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f7e40076230 con 0x7f7e4015c130 2024-09-17T05:48:40.578 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:40.577+0000 7f7e3ffff640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7e4015eae0 0x7f7e4013d810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:48:40.578 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:40.577+0000 7f7e3ffff640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7e4015eae0 0x7f7e4013d810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:36756/0 (socket says 172.21.15.150:36756) 2024-09-17T05:48:40.578 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:40.577+0000 7f7e3ffff640 1 -- 172.21.15.150:0/2326905995 learned_addr learned my addr 172.21.15.150:0/2326905995 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:48:40.578 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:40.577+0000 7f7e3f7fe640 1 --2- 172.21.15.150:0/2326905995 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7e4006ddb0 0x7f7e401f7b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:48:40.579 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:40.577+0000 7f7e3effd640 1 --2- 172.21.15.150:0/2326905995 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7e4015c130 0x7f7e401f3a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:48:40.580 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:40.578+0000 7f7e3ffff640 1 -- 172.21.15.150:0/2326905995 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7e4015c130 msgr2=0x7f7e401f3a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:48:40.580 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:40.578+0000 7f7e3ffff640 1 --2- 172.21.15.150:0/2326905995 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7e4015c130 0x7f7e401f3a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:48:40.580 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:40.578+0000 7f7e3ffff640 1 -- 172.21.15.150:0/2326905995 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7e4006ddb0 msgr2=0x7f7e401f7b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:48:40.580 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:40.578+0000 7f7e3ffff640 1 --2- 172.21.15.150:0/2326905995 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7e4006ddb0 0x7f7e401f7b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:48:40.580 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:40.578+0000 7f7e3ffff640 1 -- 172.21.15.150:0/2326905995 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7e401f4320 con 0x7f7e4015eae0 2024-09-17T05:48:40.580 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:40.578+0000 7f7e3ffff640 1 --2- 172.21.15.150:0/2326905995 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7e4015eae0 0x7f7e4013d810 secure :-1 s=READY pgs=1074 cs=0 l=1 rev1=1 crypto rx=0x7f7e3800e990 tx=0x7f7e3800ee50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:48:40.580 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:40.579+0000 7f7e27fff640 1 -- 172.21.15.150:0/2326905995 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e38004d20 con 0x7f7e4015eae0 2024-09-17T05:48:40.580 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:40.579+0000 7f7e27fff640 1 -- 172.21.15.150:0/2326905995 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f7e3800caa0 con 0x7f7e4015eae0 2024-09-17T05:48:40.581 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:40.579+0000 7f7e27fff640 1 -- 172.21.15.150:0/2326905995 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e38005020 con 0x7f7e4015eae0 2024-09-17T05:48:40.581 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:40.579+0000 7f7e46071640 1 -- 172.21.15.150:0/2326905995 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7e401f4600 con 0x7f7e4015eae0 2024-09-17T05:48:40.581 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:40.579+0000 7f7e46071640 1 -- 172.21.15.150:0/2326905995 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7e4013f940 con 0x7f7e4015eae0 2024-09-17T05:48:40.581 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:40.581+0000 7f7e46071640 1 -- 172.21.15.150:0/2326905995 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7e401f4090 con 0x7f7e4015eae0 2024-09-17T05:48:40.582 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:40.582+0000 7f7e27fff640 1 -- 172.21.15.150:0/2326905995 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 28) ==== 103226+0+0 (secure 0 0 0) 0x7f7e380051c0 con 0x7f7e4015eae0 2024-09-17T05:48:40.583 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:40.582+0000 7f7e27fff640 1 --2- 172.21.15.150:0/2326905995 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f7e2c079f70 0x7f7e2c07c480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:48:40.583 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:40.583+0000 7f7e27fff640 1 -- 172.21.15.150:0/2326905995 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 5822+0+0 (secure 0 0 0) 0x7f7e3809a510 con 0x7f7e4015eae0 2024-09-17T05:48:40.584 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:40.583+0000 7f7e3f7fe640 1 --2- 172.21.15.150:0/2326905995 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f7e2c079f70 0x7f7e2c07c480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:48:40.585 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:40.584+0000 7f7e3f7fe640 1 --2- 172.21.15.150:0/2326905995 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f7e2c079f70 0x7f7e2c07c480 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f7e30001720 tx=0x7f7e30009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:48:40.588 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:40.587+0000 7f7e27fff640 1 -- 172.21.15.150:0/2326905995 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f7e38016030 con 0x7f7e4015eae0 2024-09-17T05:48:40.894 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:40.893+0000 7f7e46071640 1 -- 172.21.15.150:0/2326905995 --> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] -- mgr_command(tid 0: {"prefix": "fs subvolume snapshot clone", "vol_name": "cephfs", "sub_name": "sv1", "snap_name": "ss1", "target_sub_name": "subvol_clone17383", "target": ["mon-mgr", ""]}) -- 0x7f7e40154cb0 con 0x7f7e2c079f70 2024-09-17T05:48:41.164 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:41.163+0000 7f7e27fff640 1 -- 172.21.15.150:0/2326905995 <== mon.0 v2:172.21.15.150:3300/0 7 ==== mgrmap(e 29) ==== 103379+0+0 (secure 0 0 0) 0x7f7e3805fd00 con 0x7f7e4015eae0 2024-09-17T05:48:41.809 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:41.803+0000 7f7e27fff640 1 -- 172.21.15.150:0/2326905995 <== mgr.4108 v2:172.21.15.176:6800/3631216395 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f7e40154cb0 con 0x7f7e2c079f70 2024-09-17T05:48:41.809 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:41.808+0000 7f7e46071640 1 -- 172.21.15.150:0/2326905995 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f7e2c079f70 msgr2=0x7f7e2c07c480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:48:41.810 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:41.808+0000 7f7e46071640 1 --2- 172.21.15.150:0/2326905995 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f7e2c079f70 0x7f7e2c07c480 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f7e30001720 tx=0x7f7e30009040 comp rx=0 tx=0).stop 2024-09-17T05:48:41.810 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:41.809+0000 7f7e46071640 1 -- 172.21.15.150:0/2326905995 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7e4015eae0 msgr2=0x7f7e4013d810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:48:41.810 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:41.809+0000 7f7e46071640 1 --2- 172.21.15.150:0/2326905995 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7e4015eae0 0x7f7e4013d810 secure :-1 s=READY pgs=1074 cs=0 l=1 rev1=1 crypto rx=0x7f7e3800e990 tx=0x7f7e3800ee50 comp rx=0 tx=0).stop 2024-09-17T05:48:41.810 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:41.809+0000 7f7e46071640 1 -- 172.21.15.150:0/2326905995 shutdown_connections 2024-09-17T05:48:41.810 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:41.809+0000 7f7e46071640 1 --2- 172.21.15.150:0/2326905995 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f7e2c079f70 0x7f7e2c07c480 unknown :-1 s=CLOSED pgs=464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:48:41.810 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:41.809+0000 7f7e46071640 1 --2- 172.21.15.150:0/2326905995 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7e4015eae0 0x7f7e4013d810 unknown :-1 s=CLOSED pgs=1074 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:48:41.810 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:41.809+0000 7f7e46071640 1 --2- 172.21.15.150:0/2326905995 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7e4015c130 0x7f7e401f3a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:48:41.810 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:41.809+0000 7f7e46071640 1 --2- 172.21.15.150:0/2326905995 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7e4006ddb0 0x7f7e401f7b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:48:41.810 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:41.809+0000 7f7e46071640 1 -- 172.21.15.150:0/2326905995 >> 172.21.15.150:0/2326905995 conn(0x7f7e40073890 msgr2=0x7f7e401551d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:48:41.810 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:41.809+0000 7f7e46071640 1 -- 172.21.15.150:0/2326905995 shutdown_connections 2024-09-17T05:48:41.811 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:41.809+0000 7f7e46071640 1 -- 172.21.15.150:0/2326905995 wait complete. 2024-09-17T05:48:41.824 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume snapshot clone cephfs sv1 ss1 subvol_clone59314 2024-09-17T05:48:41.986 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:41.985+0000 7f6a636e5640 1 -- 172.21.15.150:0/4089877789 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6a480039e0 msgr2=0x7f6a48003e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:48:41.986 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:41.985+0000 7f6a636e5640 1 --2- 172.21.15.150:0/4089877789 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6a480039e0 0x7f6a48003e30 secure :-1 s=READY pgs=1076 cs=0 l=1 rev1=1 crypto rx=0x7f6a5800c340 tx=0x7f6a48005830 comp rx=0 tx=0).stop 2024-09-17T05:48:41.987 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:41.985+0000 7f6a61c82640 1 -- 172.21.15.150:0/4089877789 reap_dead start 2024-09-17T05:48:41.987 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:41.985+0000 7f6a636e5640 1 -- 172.21.15.150:0/4089877789 shutdown_connections 2024-09-17T05:48:41.987 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:41.985+0000 7f6a636e5640 1 -- 172.21.15.150:0/4089877789 >> 172.21.15.150:0/4089877789 conn(0x7f6a5c08bfe0 msgr2=0x7f6a5c0d46e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:48:41.987 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:41.985+0000 7f6a636e5640 1 -- 172.21.15.150:0/4089877789 shutdown_connections 2024-09-17T05:48:41.987 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:41.986+0000 7f6a636e5640 1 -- 172.21.15.150:0/4089877789 wait complete. 2024-09-17T05:48:41.989 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:41.988+0000 7f6a636e5640 1 Processor -- start 2024-09-17T05:48:41.989 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:41.989+0000 7f6a636e5640 1 -- start start 2024-09-17T05:48:41.992 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:41.990+0000 7f6a636e5640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6a480039e0 0x7f6a5c0ccd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:48:41.992 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:41.990+0000 7f6a636e5640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6a5c1548f0 0x7f6a5c14b930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:48:41.993 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:41.990+0000 7f6a636e5640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6a5c1f5a60 0x7f6a5c1f5e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:48:41.993 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:41.990+0000 7f6a636e5640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f6a5c0b69f0 con 0x7f6a5c1f5a60 2024-09-17T05:48:41.993 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:41.990+0000 7f6a636e5640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f6a5c0b6870 con 0x7f6a480039e0 2024-09-17T05:48:41.993 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:41.990+0000 7f6a636e5640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f6a5c0d0020 con 0x7f6a5c1548f0 2024-09-17T05:48:41.993 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:41.990+0000 7f6a61c82640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6a5c1f5a60 0x7f6a5c1f5e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:48:41.993 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:41.990+0000 7f6a61c82640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6a5c1f5a60 0x7f6a5c1f5e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:36784/0 (socket says 172.21.15.150:36784) 2024-09-17T05:48:41.993 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:41.990+0000 7f6a61c82640 1 -- 172.21.15.150:0/3115596222 learned_addr learned my addr 172.21.15.150:0/3115596222 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:48:41.993 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:41.991+0000 7f6a61c82640 1 -- 172.21.15.150:0/3115596222 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6a5c1548f0 msgr2=0x7f6a5c14b930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:48:41.993 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:41.991+0000 7f6a61c82640 1 --2- 172.21.15.150:0/3115596222 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6a5c1548f0 0x7f6a5c14b930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:48:41.993 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:41.991+0000 7f6a61c82640 1 -- 172.21.15.150:0/3115596222 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6a480039e0 msgr2=0x7f6a5c0ccd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:48:41.993 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:41.991+0000 7f6a61c82640 1 --2- 172.21.15.150:0/3115596222 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6a480039e0 0x7f6a5c0ccd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:48:41.993 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:41.991+0000 7f6a61c82640 1 -- 172.21.15.150:0/3115596222 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6a5c14be70 con 0x7f6a5c1f5a60 2024-09-17T05:48:41.994 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:41.991+0000 7f6a61c82640 1 --2- 172.21.15.150:0/3115596222 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6a5c1f5a60 0x7f6a5c1f5e70 secure :-1 s=READY pgs=1077 cs=0 l=1 rev1=1 crypto rx=0x7f6a5c0cb6d0 tx=0x7f6a5400c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:48:41.994 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:41.991+0000 7f6a51ffb640 1 -- 172.21.15.150:0/3115596222 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a54007070 con 0x7f6a5c1f5a60 2024-09-17T05:48:41.994 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:41.991+0000 7f6a51ffb640 1 -- 172.21.15.150:0/3115596222 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f6a54007320 con 0x7f6a5c1f5a60 2024-09-17T05:48:41.994 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:41.991+0000 7f6a636e5640 1 -- 172.21.15.150:0/3115596222 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6a5c0cbc90 con 0x7f6a5c1f5a60 2024-09-17T05:48:41.994 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:41.991+0000 7f6a51ffb640 1 -- 172.21.15.150:0/3115596222 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a54007770 con 0x7f6a5c1f5a60 2024-09-17T05:48:41.994 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:41.992+0000 7f6a636e5640 1 -- 172.21.15.150:0/3115596222 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6a5c0cc250 con 0x7f6a5c1f5a60 2024-09-17T05:48:41.994 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:41.993+0000 7f6a636e5640 1 -- 172.21.15.150:0/3115596222 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6a5c0cba00 con 0x7f6a5c1f5a60 2024-09-17T05:48:41.995 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:41.994+0000 7f6a51ffb640 1 -- 172.21.15.150:0/3115596222 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 29) ==== 103379+0+0 (secure 0 0 0) 0x7f6a5401c3f0 con 0x7f6a5c1f5a60 2024-09-17T05:48:41.995 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:41.995+0000 7f6a51ffb640 1 --2- 172.21.15.150:0/3115596222 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f6a4007a0f0 0x7f6a4007c600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:48:41.996 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:41.995+0000 7f6a51ffb640 1 -- 172.21.15.150:0/3115596222 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 5822+0+0 (secure 0 0 0) 0x7f6a54099470 con 0x7f6a5c1f5a60 2024-09-17T05:48:42.003 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:42.002+0000 7f6a51ffb640 1 -- 172.21.15.150:0/3115596222 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f6a54062ff0 con 0x7f6a5c1f5a60 2024-09-17T05:48:42.009 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:42.008+0000 7f6a61481640 1 --2- 172.21.15.150:0/3115596222 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f6a4007a0f0 0x7f6a4007c600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:48:42.024 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:42.022+0000 7f6a61481640 1 --2- 172.21.15.150:0/3115596222 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f6a4007a0f0 0x7f6a4007c600 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f6a58033000 tx=0x7f6a5c0d3910 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:48:42.333 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:42.333+0000 7f6a636e5640 1 -- 172.21.15.150:0/3115596222 --> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] -- mgr_command(tid 0: {"prefix": "fs subvolume snapshot clone", "vol_name": "cephfs", "sub_name": "sv1", "snap_name": "ss1", "target_sub_name": "subvol_clone59314", "target": ["mon-mgr", ""]}) -- 0x7f6a5c0d4f30 con 0x7f6a4007a0f0 2024-09-17T05:48:43.709 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:43.709+0000 7f6a51ffb640 1 -- 172.21.15.150:0/3115596222 <== mgr.4108 v2:172.21.15.176:6800/3631216395 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f6a5c0d4f30 con 0x7f6a4007a0f0 2024-09-17T05:48:43.716 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:43.715+0000 7f6a636e5640 1 -- 172.21.15.150:0/3115596222 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f6a4007a0f0 msgr2=0x7f6a4007c600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:48:43.716 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:43.715+0000 7f6a636e5640 1 --2- 172.21.15.150:0/3115596222 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f6a4007a0f0 0x7f6a4007c600 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f6a58033000 tx=0x7f6a5c0d3910 comp rx=0 tx=0).stop 2024-09-17T05:48:43.716 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:43.715+0000 7f6a636e5640 1 -- 172.21.15.150:0/3115596222 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6a5c1f5a60 msgr2=0x7f6a5c1f5e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:48:43.716 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:43.715+0000 7f6a636e5640 1 --2- 172.21.15.150:0/3115596222 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6a5c1f5a60 0x7f6a5c1f5e70 secure :-1 s=READY pgs=1077 cs=0 l=1 rev1=1 crypto rx=0x7f6a5c0cb6d0 tx=0x7f6a5400c940 comp rx=0 tx=0).stop 2024-09-17T05:48:43.717 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:43.716+0000 7f6a636e5640 1 -- 172.21.15.150:0/3115596222 shutdown_connections 2024-09-17T05:48:43.717 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:43.716+0000 7f6a636e5640 1 --2- 172.21.15.150:0/3115596222 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f6a4007a0f0 0x7f6a4007c600 unknown :-1 s=CLOSED pgs=465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:48:43.717 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:43.716+0000 7f6a636e5640 1 --2- 172.21.15.150:0/3115596222 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6a5c1f5a60 0x7f6a5c1f5e70 unknown :-1 s=CLOSED pgs=1077 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:48:43.717 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:43.716+0000 7f6a636e5640 1 --2- 172.21.15.150:0/3115596222 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6a5c1548f0 0x7f6a5c14b930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:48:43.717 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:43.716+0000 7f6a636e5640 1 --2- 172.21.15.150:0/3115596222 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6a480039e0 0x7f6a5c0ccd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:48:43.717 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:43.716+0000 7f6a636e5640 1 -- 172.21.15.150:0/3115596222 >> 172.21.15.150:0/3115596222 conn(0x7f6a5c08bfe0 msgr2=0x7f6a5c0b76a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:48:43.717 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:43.716+0000 7f6a636e5640 1 -- 172.21.15.150:0/3115596222 shutdown_connections 2024-09-17T05:48:43.717 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:43.716+0000 7f6a636e5640 1 -- 172.21.15.150:0/3115596222 wait complete. 2024-09-17T05:48:43.742 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format json-pretty 2024-09-17T05:48:43.904 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:43.903+0000 7fb9e60de640 1 -- 172.21.15.150:0/1996945725 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb9e00d1790 msgr2=0x7fb9e00d0400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:48:43.905 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:43.903+0000 7fb9e60de640 1 --2- 172.21.15.150:0/1996945725 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb9e00d1790 0x7fb9e00d0400 secure :-1 s=READY pgs=1079 cs=0 l=1 rev1=1 crypto rx=0x7fb9d8005fd0 tx=0x7fb9d802a7a0 comp rx=0 tx=0).stop 2024-09-17T05:48:43.905 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:43.903+0000 7fb9e60de640 1 -- 172.21.15.150:0/1996945725 shutdown_connections 2024-09-17T05:48:43.905 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:43.903+0000 7fb9e60de640 1 --2- 172.21.15.150:0/1996945725 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb9e00d1790 0x7fb9e00d0400 unknown :-1 s=CLOSED pgs=1079 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:48:43.905 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:43.903+0000 7fb9e60de640 1 --2- 172.21.15.150:0/1996945725 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb9e00b5d50 0x7fb9e00d2780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:48:43.905 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:43.903+0000 7fb9e60de640 1 -- 172.21.15.150:0/1996945725 >> 172.21.15.150:0/1996945725 conn(0x7fb9e008bfe0 msgr2=0x7fb9e00d4670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:48:43.905 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:43.903+0000 7fb9e60de640 1 -- 172.21.15.150:0/1996945725 shutdown_connections 2024-09-17T05:48:43.905 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:43.903+0000 7fb9e60de640 1 -- 172.21.15.150:0/1996945725 wait complete. 2024-09-17T05:48:43.907 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:43.906+0000 7fb9e60de640 1 Processor -- start 2024-09-17T05:48:43.907 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:43.907+0000 7fb9e60de640 1 -- start start 2024-09-17T05:48:43.909 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:43.909+0000 7fb9e60de640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb9e00b5d50 0x7fb9e00b2280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:48:43.909 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:43.909+0000 7fb9e60de640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb9e00d4f90 0x7fb9e015c460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:48:43.910 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:43.909+0000 7fb9e60de640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb9e00b3910 0x7fb9e009f3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:48:43.910 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:43.909+0000 7fb9e60de640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7fb9e00b7b50 con 0x7fb9e00d4f90 2024-09-17T05:48:43.910 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:43.909+0000 7fb9deffd640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb9e00d4f90 0x7fb9e015c460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:48:43.910 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:43.909+0000 7fb9deffd640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb9e00d4f90 0x7fb9e015c460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:36798/0 (socket says 172.21.15.150:36798) 2024-09-17T05:48:43.910 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:43.909+0000 7fb9deffd640 1 -- 172.21.15.150:0/930737836 learned_addr learned my addr 172.21.15.150:0/930737836 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:48:43.910 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:43.909+0000 7fb9e60de640 1 -- 172.21.15.150:0/930737836 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fb9e00b79d0 con 0x7fb9e00b5d50 2024-09-17T05:48:43.910 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:43.909+0000 7fb9e60de640 1 -- 172.21.15.150:0/930737836 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fb9e00b7cd0 con 0x7fb9e00b3910 2024-09-17T05:48:43.911 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:43.910+0000 7fb9deffd640 1 -- 172.21.15.150:0/930737836 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb9e00b3910 msgr2=0x7fb9e009f3f0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-17T05:48:43.911 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:43.910+0000 7fb9deffd640 1 --2- 172.21.15.150:0/930737836 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb9e00b3910 0x7fb9e009f3f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:48:43.912 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:43.910+0000 7fb9deffd640 1 -- 172.21.15.150:0/930737836 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb9e00b5d50 msgr2=0x7fb9e00b2280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:48:43.912 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:43.910+0000 7fb9deffd640 1 --2- 172.21.15.150:0/930737836 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb9e00b5d50 0x7fb9e00b2280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:48:43.912 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:43.910+0000 7fb9deffd640 1 -- 172.21.15.150:0/930737836 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb9e00b1220 con 0x7fb9e00d4f90 2024-09-17T05:48:43.912 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:43.910+0000 7fb9deffd640 1 --2- 172.21.15.150:0/930737836 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb9e00d4f90 0x7fb9e015c460 secure :-1 s=READY pgs=1080 cs=0 l=1 rev1=1 crypto rx=0x7fb9d400c4f0 tx=0x7fb9d400c9b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:48:43.912 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:43.910+0000 7fb9c7fff640 1 -- 172.21.15.150:0/930737836 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9d4017070 con 0x7fb9e00d4f90 2024-09-17T05:48:43.912 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:43.910+0000 7fb9c7fff640 1 -- 172.21.15.150:0/930737836 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb9d40035f0 con 0x7fb9e00d4f90 2024-09-17T05:48:43.912 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:43.910+0000 7fb9c7fff640 1 -- 172.21.15.150:0/930737836 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9d4003a00 con 0x7fb9e00d4f90 2024-09-17T05:48:43.912 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:43.910+0000 7fb9e60de640 1 -- 172.21.15.150:0/930737836 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb9e00b14c0 con 0x7fb9e00d4f90 2024-09-17T05:48:43.912 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:43.911+0000 7fb9e60de640 1 -- 172.21.15.150:0/930737836 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb9e00b1a80 con 0x7fb9e00d4f90 2024-09-17T05:48:43.913 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:43.913+0000 7fb9e60de640 1 -- 172.21.15.150:0/930737836 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb9e00d2780 con 0x7fb9e00d4f90 2024-09-17T05:48:43.914 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:43.913+0000 7fb9c7fff640 1 -- 172.21.15.150:0/930737836 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 29) ==== 103379+0+0 (secure 0 0 0) 0x7fb9d401a070 con 0x7fb9e00d4f90 2024-09-17T05:48:43.914 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:43.914+0000 7fb9c7fff640 1 --2- 172.21.15.150:0/930737836 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fb9cc07a0f0 0x7fb9cc07c600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:48:43.914 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:43.914+0000 7fb9c7fff640 1 -- 172.21.15.150:0/930737836 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 5822+0+0 (secure 0 0 0) 0x7fb9d4099240 con 0x7fb9e00d4f90 2024-09-17T05:48:43.921 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:43.921+0000 7fb9c7fff640 1 -- 172.21.15.150:0/930737836 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fb9d4062d60 con 0x7fb9e00d4f90 2024-09-17T05:48:43.949 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:43.948+0000 7fb9df7fe640 1 --2- 172.21.15.150:0/930737836 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fb9cc07a0f0 0x7fb9cc07c600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:48:43.970 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:43.970+0000 7fb9df7fe640 1 --2- 172.21.15.150:0/930737836 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fb9cc07a0f0 0x7fb9cc07c600 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7fb9d000a8f0 tx=0x7fb9d0005bd0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:48:44.296 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:44.296+0000 7fb9e60de640 1 -- 172.21.15.150:0/930737836 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) -- 0x7fb9e00d2d60 con 0x7fb9e00d4f90 2024-09-17T05:48:44.309 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:44.308+0000 7fb9c7fff640 1 -- 172.21.15.150:0/930737836 <== mon.0 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) ==== 79+0+2418 (secure 0 0 0) 0x7fb9d4062660 con 0x7fb9e00d4f90 2024-09-17T05:48:44.309 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-09-17T05:48:44.309 INFO:teuthology.orchestra.run.smithi150.stdout:{ 2024-09-17T05:48:44.309 INFO:teuthology.orchestra.run.smithi150.stdout: "fsid": "9f2e05e9-d629-47b3-b26b-1360655b7d20", 2024-09-17T05:48:44.309 INFO:teuthology.orchestra.run.smithi150.stdout: "health": { 2024-09-17T05:48:44.310 INFO:teuthology.orchestra.run.smithi150.stdout: "status": "HEALTH_OK", 2024-09-17T05:48:44.310 INFO:teuthology.orchestra.run.smithi150.stdout: "checks": {}, 2024-09-17T05:48:44.310 INFO:teuthology.orchestra.run.smithi150.stdout: "mutes": [] 2024-09-17T05:48:44.310 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-17T05:48:44.310 INFO:teuthology.orchestra.run.smithi150.stdout: "election_epoch": 4, 2024-09-17T05:48:44.310 INFO:teuthology.orchestra.run.smithi150.stdout: "quorum": [ 2024-09-17T05:48:44.310 INFO:teuthology.orchestra.run.smithi150.stdout: 0, 2024-09-17T05:48:44.310 INFO:teuthology.orchestra.run.smithi150.stdout: 1, 2024-09-17T05:48:44.310 INFO:teuthology.orchestra.run.smithi150.stdout: 2 2024-09-17T05:48:44.310 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2024-09-17T05:48:44.310 INFO:teuthology.orchestra.run.smithi150.stdout: "quorum_names": [ 2024-09-17T05:48:44.310 INFO:teuthology.orchestra.run.smithi150.stdout: "a", 2024-09-17T05:48:44.310 INFO:teuthology.orchestra.run.smithi150.stdout: "b", 2024-09-17T05:48:44.311 INFO:teuthology.orchestra.run.smithi150.stdout: "c" 2024-09-17T05:48:44.311 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2024-09-17T05:48:44.311 INFO:teuthology.orchestra.run.smithi150.stdout: "quorum_age": 431, 2024-09-17T05:48:44.311 INFO:teuthology.orchestra.run.smithi150.stdout: "monmap": { 2024-09-17T05:48:44.311 INFO:teuthology.orchestra.run.smithi150.stdout: "epoch": 1, 2024-09-17T05:48:44.311 INFO:teuthology.orchestra.run.smithi150.stdout: "min_mon_release_name": "squid", 2024-09-17T05:48:44.311 INFO:teuthology.orchestra.run.smithi150.stdout: "num_mons": 3 2024-09-17T05:48:44.311 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-17T05:48:44.311 INFO:teuthology.orchestra.run.smithi150.stdout: "osdmap": { 2024-09-17T05:48:44.311 INFO:teuthology.orchestra.run.smithi150.stdout: "epoch": 88, 2024-09-17T05:48:44.311 INFO:teuthology.orchestra.run.smithi150.stdout: "num_osds": 8, 2024-09-17T05:48:44.311 INFO:teuthology.orchestra.run.smithi150.stdout: "num_up_osds": 8, 2024-09-17T05:48:44.311 INFO:teuthology.orchestra.run.smithi150.stdout: "osd_up_since": 1726551706, 2024-09-17T05:48:44.311 INFO:teuthology.orchestra.run.smithi150.stdout: "num_in_osds": 8, 2024-09-17T05:48:44.312 INFO:teuthology.orchestra.run.smithi150.stdout: "osd_in_since": 1726551696, 2024-09-17T05:48:44.312 INFO:teuthology.orchestra.run.smithi150.stdout: "num_remapped_pgs": 0 2024-09-17T05:48:44.312 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-17T05:48:44.312 INFO:teuthology.orchestra.run.smithi150.stdout: "pgmap": { 2024-09-17T05:48:44.312 INFO:teuthology.orchestra.run.smithi150.stdout: "pgs_by_state": [ 2024-09-17T05:48:44.312 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-09-17T05:48:44.312 INFO:teuthology.orchestra.run.smithi150.stdout: "state_name": "active+clean", 2024-09-17T05:48:44.312 INFO:teuthology.orchestra.run.smithi150.stdout: "count": 97 2024-09-17T05:48:44.312 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-09-17T05:48:44.312 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2024-09-17T05:48:44.312 INFO:teuthology.orchestra.run.smithi150.stdout: "num_pgs": 97, 2024-09-17T05:48:44.312 INFO:teuthology.orchestra.run.smithi150.stdout: "num_pools": 3, 2024-09-17T05:48:44.312 INFO:teuthology.orchestra.run.smithi150.stdout: "num_objects": 1261, 2024-09-17T05:48:44.313 INFO:teuthology.orchestra.run.smithi150.stdout: "data_bytes": 5151634109, 2024-09-17T05:48:44.313 INFO:teuthology.orchestra.run.smithi150.stdout: "bytes_used": 10155958272, 2024-09-17T05:48:44.313 INFO:teuthology.orchestra.run.smithi150.stdout: "bytes_avail": 762938155008, 2024-09-17T05:48:44.313 INFO:teuthology.orchestra.run.smithi150.stdout: "bytes_total": 773094113280, 2024-09-17T05:48:44.313 INFO:teuthology.orchestra.run.smithi150.stdout: "recovering_objects_per_sec": 1, 2024-09-17T05:48:44.313 INFO:teuthology.orchestra.run.smithi150.stdout: "recovering_bytes_per_sec": 7335559, 2024-09-17T05:48:44.313 INFO:teuthology.orchestra.run.smithi150.stdout: "recovering_keys_per_sec": 0, 2024-09-17T05:48:44.313 INFO:teuthology.orchestra.run.smithi150.stdout: "num_objects_recovered": 14, 2024-09-17T05:48:44.313 INFO:teuthology.orchestra.run.smithi150.stdout: "num_bytes_recovered": 58720256, 2024-09-17T05:48:44.314 INFO:teuthology.orchestra.run.smithi150.stdout: "num_keys_recovered": 0, 2024-09-17T05:48:44.314 INFO:teuthology.orchestra.run.smithi150.stdout: "read_bytes_sec": 256746378, 2024-09-17T05:48:44.314 INFO:teuthology.orchestra.run.smithi150.stdout: "write_bytes_sec": 315996143, 2024-09-17T05:48:44.314 INFO:teuthology.orchestra.run.smithi150.stdout: "read_op_per_sec": 62, 2024-09-17T05:48:44.314 INFO:teuthology.orchestra.run.smithi150.stdout: "write_op_per_sec": 87 2024-09-17T05:48:44.314 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-17T05:48:44.314 INFO:teuthology.orchestra.run.smithi150.stdout: "fsmap": { 2024-09-17T05:48:44.314 INFO:teuthology.orchestra.run.smithi150.stdout: "epoch": 52, 2024-09-17T05:48:44.314 INFO:teuthology.orchestra.run.smithi150.stdout: "btime": "2024-09-17T05:48:19:238380+0000", 2024-09-17T05:48:44.314 INFO:teuthology.orchestra.run.smithi150.stdout: "id": 6, 2024-09-17T05:48:44.314 INFO:teuthology.orchestra.run.smithi150.stdout: "up": 1, 2024-09-17T05:48:44.314 INFO:teuthology.orchestra.run.smithi150.stdout: "in": 1, 2024-09-17T05:48:44.315 INFO:teuthology.orchestra.run.smithi150.stdout: "max": 1, 2024-09-17T05:48:44.315 INFO:teuthology.orchestra.run.smithi150.stdout: "by_rank": [ 2024-09-17T05:48:44.315 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-09-17T05:48:44.315 INFO:teuthology.orchestra.run.smithi150.stdout: "filesystem_id": 6, 2024-09-17T05:48:44.315 INFO:teuthology.orchestra.run.smithi150.stdout: "rank": 0, 2024-09-17T05:48:44.315 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "d", 2024-09-17T05:48:44.315 INFO:teuthology.orchestra.run.smithi150.stdout: "status": "up:active", 2024-09-17T05:48:44.315 INFO:teuthology.orchestra.run.smithi150.stdout: "gid": 6496 2024-09-17T05:48:44.315 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-09-17T05:48:44.315 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2024-09-17T05:48:44.315 INFO:teuthology.orchestra.run.smithi150.stdout: "up:standby": 3 2024-09-17T05:48:44.315 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-17T05:48:44.315 INFO:teuthology.orchestra.run.smithi150.stdout: "mgrmap": { 2024-09-17T05:48:44.315 INFO:teuthology.orchestra.run.smithi150.stdout: "available": true, 2024-09-17T05:48:44.316 INFO:teuthology.orchestra.run.smithi150.stdout: "num_standbys": 1, 2024-09-17T05:48:44.316 INFO:teuthology.orchestra.run.smithi150.stdout: "modules": [ 2024-09-17T05:48:44.316 INFO:teuthology.orchestra.run.smithi150.stdout: "iostat", 2024-09-17T05:48:44.316 INFO:teuthology.orchestra.run.smithi150.stdout: "nfs", 2024-09-17T05:48:44.316 INFO:teuthology.orchestra.run.smithi150.stdout: "restful" 2024-09-17T05:48:44.316 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2024-09-17T05:48:44.316 INFO:teuthology.orchestra.run.smithi150.stdout: "services": {} 2024-09-17T05:48:44.316 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-17T05:48:44.316 INFO:teuthology.orchestra.run.smithi150.stdout: "servicemap": { 2024-09-17T05:48:44.316 INFO:teuthology.orchestra.run.smithi150.stdout: "epoch": 14, 2024-09-17T05:48:44.316 INFO:teuthology.orchestra.run.smithi150.stdout: "modified": "2024-09-17T05:47:54.961326+0000", 2024-09-17T05:48:44.316 INFO:teuthology.orchestra.run.smithi150.stdout: "services": {} 2024-09-17T05:48:44.316 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-17T05:48:44.317 INFO:teuthology.orchestra.run.smithi150.stdout: "progress_events": { 2024-09-17T05:48:44.317 INFO:teuthology.orchestra.run.smithi150.stdout: "mgr-vol-ongoing-clones": { 2024-09-17T05:48:44.317 INFO:teuthology.orchestra.run.smithi150.stdout: "message": "3 ongoing clones - average progress is 21.354% (3s)\n [=====.......................] (remaining: 11s)", 2024-09-17T05:48:44.317 INFO:teuthology.orchestra.run.smithi150.stdout: "progress": 0.21354000270366669, 2024-09-17T05:48:44.317 INFO:teuthology.orchestra.run.smithi150.stdout: "add_to_ceph_s": true 2024-09-17T05:48:44.317 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-09-17T05:48:44.317 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-09-17T05:48:44.317 INFO:teuthology.orchestra.run.smithi150.stdout:} 2024-09-17T05:48:44.318 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:44.312+0000 7fb9e60de640 1 -- 172.21.15.150:0/930737836 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fb9cc07a0f0 msgr2=0x7fb9cc07c600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:48:44.318 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:44.312+0000 7fb9e60de640 1 --2- 172.21.15.150:0/930737836 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fb9cc07a0f0 0x7fb9cc07c600 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7fb9d000a8f0 tx=0x7fb9d0005bd0 comp rx=0 tx=0).stop 2024-09-17T05:48:44.318 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:44.312+0000 7fb9e60de640 1 -- 172.21.15.150:0/930737836 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb9e00d4f90 msgr2=0x7fb9e015c460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:48:44.318 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:44.312+0000 7fb9e60de640 1 --2- 172.21.15.150:0/930737836 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb9e00d4f90 0x7fb9e015c460 secure :-1 s=READY pgs=1080 cs=0 l=1 rev1=1 crypto rx=0x7fb9d400c4f0 tx=0x7fb9d400c9b0 comp rx=0 tx=0).stop 2024-09-17T05:48:44.318 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:44.312+0000 7fb9e60de640 1 -- 172.21.15.150:0/930737836 shutdown_connections 2024-09-17T05:48:44.318 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:44.312+0000 7fb9e60de640 1 --2- 172.21.15.150:0/930737836 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fb9cc07a0f0 0x7fb9cc07c600 unknown :-1 s=CLOSED pgs=466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:48:44.318 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:44.312+0000 7fb9e60de640 1 --2- 172.21.15.150:0/930737836 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb9e00b3910 0x7fb9e009f3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:48:44.319 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:44.312+0000 7fb9e60de640 1 --2- 172.21.15.150:0/930737836 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb9e00d4f90 0x7fb9e015c460 unknown :-1 s=CLOSED pgs=1080 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:48:44.319 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:44.312+0000 7fb9e60de640 1 --2- 172.21.15.150:0/930737836 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb9e00b5d50 0x7fb9e00b2280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:48:44.319 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:44.312+0000 7fb9e60de640 1 -- 172.21.15.150:0/930737836 >> 172.21.15.150:0/930737836 conn(0x7fb9e008bfe0 msgr2=0x7fb9e0161c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:48:44.319 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:44.312+0000 7fb9e60de640 1 -- 172.21.15.150:0/930737836 shutdown_connections 2024-09-17T05:48:44.319 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:44.312+0000 7fb9e60de640 1 -- 172.21.15.150:0/930737836 wait complete. 2024-09-17T05:48:45.336 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format json-pretty 2024-09-17T05:48:45.484 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:45.483+0000 7fa43e484640 1 -- 172.21.15.150:0/2707361662 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa4380cf9d0 msgr2=0x7fa4380cfde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:48:45.485 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:45.483+0000 7fa43e484640 1 --2- 172.21.15.150:0/2707361662 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa4380cf9d0 0x7fa4380cfde0 secure :-1 s=READY pgs=1082 cs=0 l=1 rev1=1 crypto rx=0x7fa42c009830 tx=0x7fa42c02a510 comp rx=0 tx=0).stop 2024-09-17T05:48:45.485 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:45.483+0000 7fa43e484640 1 -- 172.21.15.150:0/2707361662 shutdown_connections 2024-09-17T05:48:45.485 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:45.483+0000 7fa43e484640 1 --2- 172.21.15.150:0/2707361662 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa4380cf9d0 0x7fa4380cfde0 unknown :-1 s=CLOSED pgs=1082 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:48:45.485 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:45.483+0000 7fa43e484640 1 --2- 172.21.15.150:0/2707361662 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa4380b27a0 0x7fa43815ed90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:48:45.485 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:45.483+0000 7fa43e484640 1 -- 172.21.15.150:0/2707361662 >> 172.21.15.150:0/2707361662 conn(0x7fa4380b2f60 msgr2=0x7fa4380b3370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:48:45.485 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:45.483+0000 7fa43e484640 1 -- 172.21.15.150:0/2707361662 shutdown_connections 2024-09-17T05:48:45.485 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:45.484+0000 7fa43e484640 1 -- 172.21.15.150:0/2707361662 wait complete. 2024-09-17T05:48:45.486 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:45.486+0000 7fa43e484640 1 Processor -- start 2024-09-17T05:48:45.486 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:45.486+0000 7fa43e484640 1 -- start start 2024-09-17T05:48:45.488 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:45.487+0000 7fa43e484640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa4380b0db0 0x7fa4380cdcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:48:45.489 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:45.487+0000 7fa43e484640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa4380b27a0 0x7fa438159020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:48:45.489 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:45.487+0000 7fa43e484640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa4380cf9d0 0x7fa438071100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:48:45.489 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:45.487+0000 7fa43e484640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7fa4380b62d0 con 0x7fa4380cf9d0 2024-09-17T05:48:45.489 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:45.487+0000 7fa43e484640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fa4380b1ae0 con 0x7fa4380b27a0 2024-09-17T05:48:45.489 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:45.487+0000 7fa43e484640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fa4380b6450 con 0x7fa4380b0db0 2024-09-17T05:48:45.489 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:45.487+0000 7fa43ca21640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa4380cf9d0 0x7fa438071100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:48:45.489 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:45.487+0000 7fa43ca21640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa4380cf9d0 0x7fa438071100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:36822/0 (socket says 172.21.15.150:36822) 2024-09-17T05:48:45.489 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:45.487+0000 7fa43ca21640 1 -- 172.21.15.150:0/720515425 learned_addr learned my addr 172.21.15.150:0/720515425 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:48:45.489 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:45.488+0000 7fa43ca21640 1 -- 172.21.15.150:0/720515425 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa4380b0db0 msgr2=0x7fa4380cdcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:48:45.489 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:45.488+0000 7fa43ca21640 1 --2- 172.21.15.150:0/720515425 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa4380b0db0 0x7fa4380cdcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:48:45.489 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:45.488+0000 7fa43ca21640 1 -- 172.21.15.150:0/720515425 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa4380b27a0 msgr2=0x7fa438159020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:48:45.489 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:45.488+0000 7fa43ca21640 1 --2- 172.21.15.150:0/720515425 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa4380b27a0 0x7fa438159020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:48:45.489 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:45.488+0000 7fa43ca21640 1 -- 172.21.15.150:0/720515425 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa4381f78c0 con 0x7fa4380cf9d0 2024-09-17T05:48:45.490 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:45.488+0000 7fa43ca21640 1 --2- 172.21.15.150:0/720515425 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa4380cf9d0 0x7fa438071100 secure :-1 s=READY pgs=1083 cs=0 l=1 rev1=1 crypto rx=0x7fa43000cb10 tx=0x7fa43000a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:48:45.490 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:45.488+0000 7fa434ff9640 1 -- 172.21.15.150:0/720515425 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa430016020 con 0x7fa4380cf9d0 2024-09-17T05:48:45.490 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:45.488+0000 7fa43e484640 1 -- 172.21.15.150:0/720515425 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa43809d770 con 0x7fa4380cf9d0 2024-09-17T05:48:45.491 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:45.488+0000 7fa43e484640 1 -- 172.21.15.150:0/720515425 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa4381f6b00 con 0x7fa4380cf9d0 2024-09-17T05:48:45.491 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:45.489+0000 7fa434ff9640 1 -- 172.21.15.150:0/720515425 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa43000ac70 con 0x7fa4380cf9d0 2024-09-17T05:48:45.491 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:45.489+0000 7fa434ff9640 1 -- 172.21.15.150:0/720515425 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa43000ae60 con 0x7fa4380cf9d0 2024-09-17T05:48:45.491 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:45.490+0000 7fa43e484640 1 -- 172.21.15.150:0/720515425 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa418005290 con 0x7fa4380cf9d0 2024-09-17T05:48:45.491 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:45.490+0000 7fa434ff9640 1 -- 172.21.15.150:0/720515425 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 29) ==== 103379+0+0 (secure 0 0 0) 0x7fa430019020 con 0x7fa4380cf9d0 2024-09-17T05:48:45.492 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:45.491+0000 7fa434ff9640 1 --2- 172.21.15.150:0/720515425 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fa42407a0f0 0x7fa42407c600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:48:45.492 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:45.491+0000 7fa434ff9640 1 -- 172.21.15.150:0/720515425 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 5822+0+0 (secure 0 0 0) 0x7fa43009a2e0 con 0x7fa4380cf9d0 2024-09-17T05:48:45.499 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:45.498+0000 7fa434ff9640 1 -- 172.21.15.150:0/720515425 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fa430020020 con 0x7fa4380cf9d0 2024-09-17T05:48:45.507 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:45.507+0000 7fa437fff640 1 --2- 172.21.15.150:0/720515425 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fa42407a0f0 0x7fa42407c600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:48:45.614 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:45.614+0000 7fa437fff640 1 --2- 172.21.15.150:0/720515425 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fa42407a0f0 0x7fa42407c600 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7fa428009670 tx=0x7fa428006be0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:48:45.867 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:45.867+0000 7fa43e484640 1 -- 172.21.15.150:0/720515425 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) -- 0x7fa418005850 con 0x7fa4380cf9d0 2024-09-17T05:48:45.868 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:45.868+0000 7fa434ff9640 1 -- 172.21.15.150:0/720515425 <== mon.0 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) ==== 79+0+2418 (secure 0 0 0) 0x7fa4380d0320 con 0x7fa4380cf9d0 2024-09-17T05:48:45.868 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-09-17T05:48:45.869 INFO:teuthology.orchestra.run.smithi150.stdout:{ 2024-09-17T05:48:45.869 INFO:teuthology.orchestra.run.smithi150.stdout: "fsid": "9f2e05e9-d629-47b3-b26b-1360655b7d20", 2024-09-17T05:48:45.869 INFO:teuthology.orchestra.run.smithi150.stdout: "health": { 2024-09-17T05:48:45.869 INFO:teuthology.orchestra.run.smithi150.stdout: "status": "HEALTH_OK", 2024-09-17T05:48:45.869 INFO:teuthology.orchestra.run.smithi150.stdout: "checks": {}, 2024-09-17T05:48:45.869 INFO:teuthology.orchestra.run.smithi150.stdout: "mutes": [] 2024-09-17T05:48:45.869 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-17T05:48:45.869 INFO:teuthology.orchestra.run.smithi150.stdout: "election_epoch": 4, 2024-09-17T05:48:45.869 INFO:teuthology.orchestra.run.smithi150.stdout: "quorum": [ 2024-09-17T05:48:45.869 INFO:teuthology.orchestra.run.smithi150.stdout: 0, 2024-09-17T05:48:45.869 INFO:teuthology.orchestra.run.smithi150.stdout: 1, 2024-09-17T05:48:45.869 INFO:teuthology.orchestra.run.smithi150.stdout: 2 2024-09-17T05:48:45.870 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2024-09-17T05:48:45.870 INFO:teuthology.orchestra.run.smithi150.stdout: "quorum_names": [ 2024-09-17T05:48:45.870 INFO:teuthology.orchestra.run.smithi150.stdout: "a", 2024-09-17T05:48:45.870 INFO:teuthology.orchestra.run.smithi150.stdout: "b", 2024-09-17T05:48:45.870 INFO:teuthology.orchestra.run.smithi150.stdout: "c" 2024-09-17T05:48:45.870 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2024-09-17T05:48:45.870 INFO:teuthology.orchestra.run.smithi150.stdout: "quorum_age": 433, 2024-09-17T05:48:45.870 INFO:teuthology.orchestra.run.smithi150.stdout: "monmap": { 2024-09-17T05:48:45.870 INFO:teuthology.orchestra.run.smithi150.stdout: "epoch": 1, 2024-09-17T05:48:45.870 INFO:teuthology.orchestra.run.smithi150.stdout: "min_mon_release_name": "squid", 2024-09-17T05:48:45.870 INFO:teuthology.orchestra.run.smithi150.stdout: "num_mons": 3 2024-09-17T05:48:45.870 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-17T05:48:45.870 INFO:teuthology.orchestra.run.smithi150.stdout: "osdmap": { 2024-09-17T05:48:45.871 INFO:teuthology.orchestra.run.smithi150.stdout: "epoch": 88, 2024-09-17T05:48:45.871 INFO:teuthology.orchestra.run.smithi150.stdout: "num_osds": 8, 2024-09-17T05:48:45.871 INFO:teuthology.orchestra.run.smithi150.stdout: "num_up_osds": 8, 2024-09-17T05:48:45.871 INFO:teuthology.orchestra.run.smithi150.stdout: "osd_up_since": 1726551706, 2024-09-17T05:48:45.871 INFO:teuthology.orchestra.run.smithi150.stdout: "num_in_osds": 8, 2024-09-17T05:48:45.871 INFO:teuthology.orchestra.run.smithi150.stdout: "osd_in_since": 1726551696, 2024-09-17T05:48:45.871 INFO:teuthology.orchestra.run.smithi150.stdout: "num_remapped_pgs": 0 2024-09-17T05:48:45.871 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-17T05:48:45.871 INFO:teuthology.orchestra.run.smithi150.stdout: "pgmap": { 2024-09-17T05:48:45.871 INFO:teuthology.orchestra.run.smithi150.stdout: "pgs_by_state": [ 2024-09-17T05:48:45.871 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-09-17T05:48:45.871 INFO:teuthology.orchestra.run.smithi150.stdout: "state_name": "active+clean", 2024-09-17T05:48:45.871 INFO:teuthology.orchestra.run.smithi150.stdout: "count": 97 2024-09-17T05:48:45.872 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-09-17T05:48:45.872 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2024-09-17T05:48:45.872 INFO:teuthology.orchestra.run.smithi150.stdout: "num_pgs": 97, 2024-09-17T05:48:45.872 INFO:teuthology.orchestra.run.smithi150.stdout: "num_pools": 3, 2024-09-17T05:48:45.872 INFO:teuthology.orchestra.run.smithi150.stdout: "num_objects": 1319, 2024-09-17T05:48:45.872 INFO:teuthology.orchestra.run.smithi150.stdout: "data_bytes": 5390709629, 2024-09-17T05:48:45.872 INFO:teuthology.orchestra.run.smithi150.stdout: "bytes_used": 10910973952, 2024-09-17T05:48:45.872 INFO:teuthology.orchestra.run.smithi150.stdout: "bytes_avail": 762183139328, 2024-09-17T05:48:45.872 INFO:teuthology.orchestra.run.smithi150.stdout: "bytes_total": 773094113280, 2024-09-17T05:48:45.872 INFO:teuthology.orchestra.run.smithi150.stdout: "recovering_objects_per_sec": 1, 2024-09-17T05:48:45.872 INFO:teuthology.orchestra.run.smithi150.stdout: "recovering_bytes_per_sec": 7334704, 2024-09-17T05:48:45.872 INFO:teuthology.orchestra.run.smithi150.stdout: "recovering_keys_per_sec": 0, 2024-09-17T05:48:45.872 INFO:teuthology.orchestra.run.smithi150.stdout: "num_objects_recovered": 14, 2024-09-17T05:48:45.873 INFO:teuthology.orchestra.run.smithi150.stdout: "num_bytes_recovered": 58720256, 2024-09-17T05:48:45.873 INFO:teuthology.orchestra.run.smithi150.stdout: "num_keys_recovered": 0, 2024-09-17T05:48:45.873 INFO:teuthology.orchestra.run.smithi150.stdout: "read_bytes_sec": 286055409, 2024-09-17T05:48:45.873 INFO:teuthology.orchestra.run.smithi150.stdout: "write_bytes_sec": 289238761, 2024-09-17T05:48:45.873 INFO:teuthology.orchestra.run.smithi150.stdout: "read_op_per_sec": 70, 2024-09-17T05:48:45.873 INFO:teuthology.orchestra.run.smithi150.stdout: "write_op_per_sec": 81 2024-09-17T05:48:45.873 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-17T05:48:45.873 INFO:teuthology.orchestra.run.smithi150.stdout: "fsmap": { 2024-09-17T05:48:45.873 INFO:teuthology.orchestra.run.smithi150.stdout: "epoch": 52, 2024-09-17T05:48:45.873 INFO:teuthology.orchestra.run.smithi150.stdout: "btime": "2024-09-17T05:48:19:238380+0000", 2024-09-17T05:48:45.873 INFO:teuthology.orchestra.run.smithi150.stdout: "id": 6, 2024-09-17T05:48:45.873 INFO:teuthology.orchestra.run.smithi150.stdout: "up": 1, 2024-09-17T05:48:45.874 INFO:teuthology.orchestra.run.smithi150.stdout: "in": 1, 2024-09-17T05:48:45.874 INFO:teuthology.orchestra.run.smithi150.stdout: "max": 1, 2024-09-17T05:48:45.874 INFO:teuthology.orchestra.run.smithi150.stdout: "by_rank": [ 2024-09-17T05:48:45.874 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-09-17T05:48:45.874 INFO:teuthology.orchestra.run.smithi150.stdout: "filesystem_id": 6, 2024-09-17T05:48:45.874 INFO:teuthology.orchestra.run.smithi150.stdout: "rank": 0, 2024-09-17T05:48:45.874 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "d", 2024-09-17T05:48:45.874 INFO:teuthology.orchestra.run.smithi150.stdout: "status": "up:active", 2024-09-17T05:48:45.874 INFO:teuthology.orchestra.run.smithi150.stdout: "gid": 6496 2024-09-17T05:48:45.874 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-09-17T05:48:45.874 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2024-09-17T05:48:45.874 INFO:teuthology.orchestra.run.smithi150.stdout: "up:standby": 3 2024-09-17T05:48:45.875 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-17T05:48:45.875 INFO:teuthology.orchestra.run.smithi150.stdout: "mgrmap": { 2024-09-17T05:48:45.875 INFO:teuthology.orchestra.run.smithi150.stdout: "available": true, 2024-09-17T05:48:45.875 INFO:teuthology.orchestra.run.smithi150.stdout: "num_standbys": 1, 2024-09-17T05:48:45.875 INFO:teuthology.orchestra.run.smithi150.stdout: "modules": [ 2024-09-17T05:48:45.875 INFO:teuthology.orchestra.run.smithi150.stdout: "iostat", 2024-09-17T05:48:45.875 INFO:teuthology.orchestra.run.smithi150.stdout: "nfs", 2024-09-17T05:48:45.875 INFO:teuthology.orchestra.run.smithi150.stdout: "restful" 2024-09-17T05:48:45.875 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2024-09-17T05:48:45.876 INFO:teuthology.orchestra.run.smithi150.stdout: "services": {} 2024-09-17T05:48:45.876 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-17T05:48:45.876 INFO:teuthology.orchestra.run.smithi150.stdout: "servicemap": { 2024-09-17T05:48:45.876 INFO:teuthology.orchestra.run.smithi150.stdout: "epoch": 14, 2024-09-17T05:48:45.876 INFO:teuthology.orchestra.run.smithi150.stdout: "modified": "2024-09-17T05:47:54.961326+0000", 2024-09-17T05:48:45.876 INFO:teuthology.orchestra.run.smithi150.stdout: "services": {} 2024-09-17T05:48:45.876 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-17T05:48:45.876 INFO:teuthology.orchestra.run.smithi150.stdout: "progress_events": { 2024-09-17T05:48:45.876 INFO:teuthology.orchestra.run.smithi150.stdout: "mgr-vol-ongoing-clones": { 2024-09-17T05:48:45.876 INFO:teuthology.orchestra.run.smithi150.stdout: "message": "3 ongoing clones - average progress is 21.354% (3s)\n [=====.......................] (remaining: 11s)", 2024-09-17T05:48:45.877 INFO:teuthology.orchestra.run.smithi150.stdout: "progress": 0.21354000270366669, 2024-09-17T05:48:45.877 INFO:teuthology.orchestra.run.smithi150.stdout: "add_to_ceph_s": true 2024-09-17T05:48:45.877 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-09-17T05:48:45.877 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-09-17T05:48:45.877 INFO:teuthology.orchestra.run.smithi150.stdout:} 2024-09-17T05:48:45.878 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:45.873+0000 7fa43e484640 1 -- 172.21.15.150:0/720515425 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fa42407a0f0 msgr2=0x7fa42407c600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:48:45.878 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:45.873+0000 7fa43e484640 1 --2- 172.21.15.150:0/720515425 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fa42407a0f0 0x7fa42407c600 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7fa428009670 tx=0x7fa428006be0 comp rx=0 tx=0).stop 2024-09-17T05:48:45.878 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:45.873+0000 7fa43e484640 1 -- 172.21.15.150:0/720515425 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa4380cf9d0 msgr2=0x7fa438071100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:48:45.878 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:45.873+0000 7fa43e484640 1 --2- 172.21.15.150:0/720515425 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa4380cf9d0 0x7fa438071100 secure :-1 s=READY pgs=1083 cs=0 l=1 rev1=1 crypto rx=0x7fa43000cb10 tx=0x7fa43000a060 comp rx=0 tx=0).stop 2024-09-17T05:48:45.878 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:45.873+0000 7fa43e484640 1 -- 172.21.15.150:0/720515425 shutdown_connections 2024-09-17T05:48:45.878 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:45.873+0000 7fa43e484640 1 --2- 172.21.15.150:0/720515425 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa4380b27a0 0x7fa438159020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:48:45.878 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:45.873+0000 7fa43e484640 1 --2- 172.21.15.150:0/720515425 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fa42407a0f0 0x7fa42407c600 unknown :-1 s=CLOSED pgs=467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:48:45.878 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:45.873+0000 7fa43e484640 1 --2- 172.21.15.150:0/720515425 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa4380cf9d0 0x7fa438071100 unknown :-1 s=CLOSED pgs=1083 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:48:45.878 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:45.873+0000 7fa43e484640 1 --2- 172.21.15.150:0/720515425 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa4380b0db0 0x7fa4380cdcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:48:45.878 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:45.873+0000 7fa43e484640 1 -- 172.21.15.150:0/720515425 >> 172.21.15.150:0/720515425 conn(0x7fa4380b2f60 msgr2=0x7fa4380b11c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:48:45.878 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:45.873+0000 7fa43e484640 1 -- 172.21.15.150:0/720515425 shutdown_connections 2024-09-17T05:48:45.878 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:45.873+0000 7fa43e484640 1 -- 172.21.15.150:0/720515425 wait complete. 2024-09-17T05:48:46.895 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format json-pretty 2024-09-17T05:48:47.082 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:47.080+0000 7f5dd904d640 1 -- 172.21.15.150:0/138727968 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5dd40aebc0 msgr2=0x7f5dd4152920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:48:47.083 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:47.080+0000 7f5dd904d640 1 --2- 172.21.15.150:0/138727968 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5dd40aebc0 0x7f5dd4152920 secure :-1 s=READY pgs=1084 cs=0 l=1 rev1=1 crypto rx=0x7f5dd40b3230 tx=0x7f5dc802e8e0 comp rx=0 tx=0).stop 2024-09-17T05:48:47.084 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:47.081+0000 7f5dd904d640 1 -- 172.21.15.150:0/138727968 shutdown_connections 2024-09-17T05:48:47.084 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:47.081+0000 7f5dd904d640 1 --2- 172.21.15.150:0/138727968 >> v2:172.21.15.176:3300/0 conn(0x7f5dd415f910 0x7f5dd415bd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:48:47.085 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:47.081+0000 7f5dd904d640 1 --2- 172.21.15.150:0/138727968 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5dd40b2750 0x7f5dd415f3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:48:47.085 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:47.081+0000 7f5dd904d640 1 --2- 172.21.15.150:0/138727968 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5dd40aebc0 0x7f5dd4152920 unknown :-1 s=CLOSED pgs=1084 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:48:47.086 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:47.081+0000 7f5dd904d640 1 -- 172.21.15.150:0/138727968 >> 172.21.15.150:0/138727968 conn(0x7f5dd406d730 msgr2=0x7f5dd40b1e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:48:47.086 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:47.081+0000 7f5dd904d640 1 -- 172.21.15.150:0/138727968 shutdown_connections 2024-09-17T05:48:47.087 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:47.081+0000 7f5dd904d640 1 -- 172.21.15.150:0/138727968 wait complete. 2024-09-17T05:48:47.090 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:47.084+0000 7f5dd904d640 1 Processor -- start 2024-09-17T05:48:47.090 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:47.085+0000 7f5dd904d640 1 -- start start 2024-09-17T05:48:47.090 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:47.087+0000 7f5dd904d640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5dd40aebc0 0x7f5dd41477e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:48:47.090 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:47.087+0000 7f5dd904d640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5dd40b2750 0x7f5dd40ce8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:48:47.090 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:47.087+0000 7f5dd904d640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5dd415f910 0x7f5dd40cede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:48:47.090 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:47.087+0000 7f5dd904d640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f5dd415c660 con 0x7f5dd40b2750 2024-09-17T05:48:47.090 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:47.087+0000 7f5dd904d640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f5dd415c4e0 con 0x7f5dd415f910 2024-09-17T05:48:47.090 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:47.087+0000 7f5dd904d640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f5dd415c7e0 con 0x7f5dd40aebc0 2024-09-17T05:48:47.090 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:47.087+0000 7f5dd259c640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5dd40b2750 0x7f5dd40ce8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:48:47.090 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:47.087+0000 7f5dd259c640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5dd40b2750 0x7f5dd40ce8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:36852/0 (socket says 172.21.15.150:36852) 2024-09-17T05:48:47.090 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:47.087+0000 7f5dd259c640 1 -- 172.21.15.150:0/1427780498 learned_addr learned my addr 172.21.15.150:0/1427780498 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:48:47.090 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:47.087+0000 7f5dd359e640 1 --2- 172.21.15.150:0/1427780498 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5dd415f910 0x7f5dd40cede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:48:47.091 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:47.087+0000 7f5dd259c640 1 -- 172.21.15.150:0/1427780498 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5dd40aebc0 msgr2=0x7f5dd41477e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:48:47.091 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:47.087+0000 7f5dd259c640 1 --2- 172.21.15.150:0/1427780498 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5dd40aebc0 0x7f5dd41477e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:48:47.091 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:47.087+0000 7f5dd259c640 1 -- 172.21.15.150:0/1427780498 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5dd415f910 msgr2=0x7f5dd40cede0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:48:47.091 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:47.087+0000 7f5dd259c640 1 --2- 172.21.15.150:0/1427780498 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5dd415f910 0x7f5dd40cede0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:48:47.091 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:47.087+0000 7f5dd259c640 1 -- 172.21.15.150:0/1427780498 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5dd4147d20 con 0x7f5dd40b2750 2024-09-17T05:48:47.091 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:47.087+0000 7f5dd359e640 1 --2- 172.21.15.150:0/1427780498 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5dd415f910 0x7f5dd40cede0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T05:48:47.091 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:47.088+0000 7f5dd259c640 1 --2- 172.21.15.150:0/1427780498 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5dd40b2750 0x7f5dd40ce8a0 secure :-1 s=READY pgs=1085 cs=0 l=1 rev1=1 crypto rx=0x7f5dc400b440 tx=0x7f5dc400b900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:48:47.091 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:47.088+0000 7f5dbb7fe640 1 -- 172.21.15.150:0/1427780498 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5dc4015020 con 0x7f5dd40b2750 2024-09-17T05:48:47.091 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:47.088+0000 7f5dbb7fe640 1 -- 172.21.15.150:0/1427780498 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f5dc4011980 con 0x7f5dd40b2750 2024-09-17T05:48:47.091 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:47.088+0000 7f5dd904d640 1 -- 172.21.15.150:0/1427780498 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5dd40ccc20 con 0x7f5dd40b2750 2024-09-17T05:48:47.091 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:47.088+0000 7f5dbb7fe640 1 -- 172.21.15.150:0/1427780498 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5dc4011dd0 con 0x7f5dd40b2750 2024-09-17T05:48:47.091 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:47.088+0000 7f5dd904d640 1 -- 172.21.15.150:0/1427780498 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5dd40cd1e0 con 0x7f5dd40b2750 2024-09-17T05:48:47.091 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:47.089+0000 7f5dd904d640 1 -- 172.21.15.150:0/1427780498 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5dd415f3d0 con 0x7f5dd40b2750 2024-09-17T05:48:47.092 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:47.090+0000 7f5dbb7fe640 1 -- 172.21.15.150:0/1427780498 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 29) ==== 103379+0+0 (secure 0 0 0) 0x7f5dc4018020 con 0x7f5dd40b2750 2024-09-17T05:48:47.092 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:47.091+0000 7f5dbb7fe640 1 --2- 172.21.15.150:0/1427780498 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f5dc007a0f0 0x7f5dc007c600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:48:47.092 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:47.091+0000 7f5dbb7fe640 1 -- 172.21.15.150:0/1427780498 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 5822+0+0 (secure 0 0 0) 0x7f5dc409a000 con 0x7f5dd40b2750 2024-09-17T05:48:47.096 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:47.095+0000 7f5dbb7fe640 1 -- 172.21.15.150:0/1427780498 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f5dc401f020 con 0x7f5dd40b2750 2024-09-17T05:48:47.123 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:47.122+0000 7f5dd2d9d640 1 --2- 172.21.15.150:0/1427780498 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f5dc007a0f0 0x7f5dc007c600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:48:47.169 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:47.168+0000 7f5dd2d9d640 1 --2- 172.21.15.150:0/1427780498 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f5dc007a0f0 0x7f5dc007c600 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f5dc8038000 tx=0x7f5dc80046c0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:48:47.484 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:47.484+0000 7f5dd904d640 1 -- 172.21.15.150:0/1427780498 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) -- 0x7f5dd40cc9b0 con 0x7f5dd40b2750 2024-09-17T05:48:47.492 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:47.492+0000 7f5dbb7fe640 1 -- 172.21.15.150:0/1427780498 <== mon.0 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) ==== 79+0+2418 (secure 0 0 0) 0x7f5dc400d040 con 0x7f5dd40b2750 2024-09-17T05:48:47.492 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-09-17T05:48:47.492 INFO:teuthology.orchestra.run.smithi150.stdout:{ 2024-09-17T05:48:47.493 INFO:teuthology.orchestra.run.smithi150.stdout: "fsid": "9f2e05e9-d629-47b3-b26b-1360655b7d20", 2024-09-17T05:48:47.493 INFO:teuthology.orchestra.run.smithi150.stdout: "health": { 2024-09-17T05:48:47.493 INFO:teuthology.orchestra.run.smithi150.stdout: "status": "HEALTH_OK", 2024-09-17T05:48:47.493 INFO:teuthology.orchestra.run.smithi150.stdout: "checks": {}, 2024-09-17T05:48:47.493 INFO:teuthology.orchestra.run.smithi150.stdout: "mutes": [] 2024-09-17T05:48:47.493 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-17T05:48:47.493 INFO:teuthology.orchestra.run.smithi150.stdout: "election_epoch": 4, 2024-09-17T05:48:47.493 INFO:teuthology.orchestra.run.smithi150.stdout: "quorum": [ 2024-09-17T05:48:47.493 INFO:teuthology.orchestra.run.smithi150.stdout: 0, 2024-09-17T05:48:47.493 INFO:teuthology.orchestra.run.smithi150.stdout: 1, 2024-09-17T05:48:47.493 INFO:teuthology.orchestra.run.smithi150.stdout: 2 2024-09-17T05:48:47.493 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2024-09-17T05:48:47.494 INFO:teuthology.orchestra.run.smithi150.stdout: "quorum_names": [ 2024-09-17T05:48:47.494 INFO:teuthology.orchestra.run.smithi150.stdout: "a", 2024-09-17T05:48:47.494 INFO:teuthology.orchestra.run.smithi150.stdout: "b", 2024-09-17T05:48:47.494 INFO:teuthology.orchestra.run.smithi150.stdout: "c" 2024-09-17T05:48:47.494 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2024-09-17T05:48:47.494 INFO:teuthology.orchestra.run.smithi150.stdout: "quorum_age": 434, 2024-09-17T05:48:47.494 INFO:teuthology.orchestra.run.smithi150.stdout: "monmap": { 2024-09-17T05:48:47.494 INFO:teuthology.orchestra.run.smithi150.stdout: "epoch": 1, 2024-09-17T05:48:47.494 INFO:teuthology.orchestra.run.smithi150.stdout: "min_mon_release_name": "squid", 2024-09-17T05:48:47.494 INFO:teuthology.orchestra.run.smithi150.stdout: "num_mons": 3 2024-09-17T05:48:47.494 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-17T05:48:47.494 INFO:teuthology.orchestra.run.smithi150.stdout: "osdmap": { 2024-09-17T05:48:47.494 INFO:teuthology.orchestra.run.smithi150.stdout: "epoch": 88, 2024-09-17T05:48:47.495 INFO:teuthology.orchestra.run.smithi150.stdout: "num_osds": 8, 2024-09-17T05:48:47.495 INFO:teuthology.orchestra.run.smithi150.stdout: "num_up_osds": 8, 2024-09-17T05:48:47.495 INFO:teuthology.orchestra.run.smithi150.stdout: "osd_up_since": 1726551706, 2024-09-17T05:48:47.495 INFO:teuthology.orchestra.run.smithi150.stdout: "num_in_osds": 8, 2024-09-17T05:48:47.495 INFO:teuthology.orchestra.run.smithi150.stdout: "osd_in_since": 1726551696, 2024-09-17T05:48:47.495 INFO:teuthology.orchestra.run.smithi150.stdout: "num_remapped_pgs": 0 2024-09-17T05:48:47.495 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-17T05:48:47.495 INFO:teuthology.orchestra.run.smithi150.stdout: "pgmap": { 2024-09-17T05:48:47.495 INFO:teuthology.orchestra.run.smithi150.stdout: "pgs_by_state": [ 2024-09-17T05:48:47.495 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-09-17T05:48:47.495 INFO:teuthology.orchestra.run.smithi150.stdout: "state_name": "active+clean", 2024-09-17T05:48:47.495 INFO:teuthology.orchestra.run.smithi150.stdout: "count": 97 2024-09-17T05:48:47.495 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-09-17T05:48:47.496 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2024-09-17T05:48:47.496 INFO:teuthology.orchestra.run.smithi150.stdout: "num_pgs": 97, 2024-09-17T05:48:47.496 INFO:teuthology.orchestra.run.smithi150.stdout: "num_pools": 3, 2024-09-17T05:48:47.496 INFO:teuthology.orchestra.run.smithi150.stdout: "num_objects": 1319, 2024-09-17T05:48:47.496 INFO:teuthology.orchestra.run.smithi150.stdout: "data_bytes": 5390709629, 2024-09-17T05:48:47.496 INFO:teuthology.orchestra.run.smithi150.stdout: "bytes_used": 10910973952, 2024-09-17T05:48:47.496 INFO:teuthology.orchestra.run.smithi150.stdout: "bytes_avail": 762183139328, 2024-09-17T05:48:47.496 INFO:teuthology.orchestra.run.smithi150.stdout: "bytes_total": 773094113280, 2024-09-17T05:48:47.496 INFO:teuthology.orchestra.run.smithi150.stdout: "recovering_objects_per_sec": 1, 2024-09-17T05:48:47.496 INFO:teuthology.orchestra.run.smithi150.stdout: "recovering_bytes_per_sec": 7334704, 2024-09-17T05:48:47.496 INFO:teuthology.orchestra.run.smithi150.stdout: "recovering_keys_per_sec": 0, 2024-09-17T05:48:47.496 INFO:teuthology.orchestra.run.smithi150.stdout: "num_objects_recovered": 14, 2024-09-17T05:48:47.497 INFO:teuthology.orchestra.run.smithi150.stdout: "num_bytes_recovered": 58720256, 2024-09-17T05:48:47.497 INFO:teuthology.orchestra.run.smithi150.stdout: "num_keys_recovered": 0, 2024-09-17T05:48:47.497 INFO:teuthology.orchestra.run.smithi150.stdout: "read_bytes_sec": 286055409, 2024-09-17T05:48:47.497 INFO:teuthology.orchestra.run.smithi150.stdout: "write_bytes_sec": 289238761, 2024-09-17T05:48:47.497 INFO:teuthology.orchestra.run.smithi150.stdout: "read_op_per_sec": 70, 2024-09-17T05:48:47.497 INFO:teuthology.orchestra.run.smithi150.stdout: "write_op_per_sec": 81 2024-09-17T05:48:47.497 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-17T05:48:47.497 INFO:teuthology.orchestra.run.smithi150.stdout: "fsmap": { 2024-09-17T05:48:47.497 INFO:teuthology.orchestra.run.smithi150.stdout: "epoch": 52, 2024-09-17T05:48:47.497 INFO:teuthology.orchestra.run.smithi150.stdout: "btime": "2024-09-17T05:48:19:238380+0000", 2024-09-17T05:48:47.497 INFO:teuthology.orchestra.run.smithi150.stdout: "id": 6, 2024-09-17T05:48:47.497 INFO:teuthology.orchestra.run.smithi150.stdout: "up": 1, 2024-09-17T05:48:47.498 INFO:teuthology.orchestra.run.smithi150.stdout: "in": 1, 2024-09-17T05:48:47.498 INFO:teuthology.orchestra.run.smithi150.stdout: "max": 1, 2024-09-17T05:48:47.498 INFO:teuthology.orchestra.run.smithi150.stdout: "by_rank": [ 2024-09-17T05:48:47.498 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-09-17T05:48:47.498 INFO:teuthology.orchestra.run.smithi150.stdout: "filesystem_id": 6, 2024-09-17T05:48:47.498 INFO:teuthology.orchestra.run.smithi150.stdout: "rank": 0, 2024-09-17T05:48:47.498 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "d", 2024-09-17T05:48:47.498 INFO:teuthology.orchestra.run.smithi150.stdout: "status": "up:active", 2024-09-17T05:48:47.498 INFO:teuthology.orchestra.run.smithi150.stdout: "gid": 6496 2024-09-17T05:48:47.498 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-09-17T05:48:47.498 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2024-09-17T05:48:47.498 INFO:teuthology.orchestra.run.smithi150.stdout: "up:standby": 3 2024-09-17T05:48:47.498 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-17T05:48:47.499 INFO:teuthology.orchestra.run.smithi150.stdout: "mgrmap": { 2024-09-17T05:48:47.499 INFO:teuthology.orchestra.run.smithi150.stdout: "available": true, 2024-09-17T05:48:47.499 INFO:teuthology.orchestra.run.smithi150.stdout: "num_standbys": 1, 2024-09-17T05:48:47.499 INFO:teuthology.orchestra.run.smithi150.stdout: "modules": [ 2024-09-17T05:48:47.499 INFO:teuthology.orchestra.run.smithi150.stdout: "iostat", 2024-09-17T05:48:47.499 INFO:teuthology.orchestra.run.smithi150.stdout: "nfs", 2024-09-17T05:48:47.499 INFO:teuthology.orchestra.run.smithi150.stdout: "restful" 2024-09-17T05:48:47.499 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2024-09-17T05:48:47.499 INFO:teuthology.orchestra.run.smithi150.stdout: "services": {} 2024-09-17T05:48:47.499 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-17T05:48:47.499 INFO:teuthology.orchestra.run.smithi150.stdout: "servicemap": { 2024-09-17T05:48:47.499 INFO:teuthology.orchestra.run.smithi150.stdout: "epoch": 14, 2024-09-17T05:48:47.500 INFO:teuthology.orchestra.run.smithi150.stdout: "modified": "2024-09-17T05:47:54.961326+0000", 2024-09-17T05:48:47.500 INFO:teuthology.orchestra.run.smithi150.stdout: "services": {} 2024-09-17T05:48:47.500 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-17T05:48:47.500 INFO:teuthology.orchestra.run.smithi150.stdout: "progress_events": { 2024-09-17T05:48:47.500 INFO:teuthology.orchestra.run.smithi150.stdout: "mgr-vol-ongoing-clones": { 2024-09-17T05:48:47.500 INFO:teuthology.orchestra.run.smithi150.stdout: "message": "3 ongoing clones - average progress is 21.354% (3s)\n [=====.......................] (remaining: 11s)", 2024-09-17T05:48:47.500 INFO:teuthology.orchestra.run.smithi150.stdout: "progress": 0.21354000270366669, 2024-09-17T05:48:47.500 INFO:teuthology.orchestra.run.smithi150.stdout: "add_to_ceph_s": true 2024-09-17T05:48:47.500 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-09-17T05:48:47.500 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-09-17T05:48:47.500 INFO:teuthology.orchestra.run.smithi150.stdout:} 2024-09-17T05:48:47.501 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:47.495+0000 7f5dd904d640 1 -- 172.21.15.150:0/1427780498 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f5dc007a0f0 msgr2=0x7f5dc007c600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:48:47.501 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:47.495+0000 7f5dd904d640 1 --2- 172.21.15.150:0/1427780498 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f5dc007a0f0 0x7f5dc007c600 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f5dc8038000 tx=0x7f5dc80046c0 comp rx=0 tx=0).stop 2024-09-17T05:48:47.502 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:47.495+0000 7f5dd904d640 1 -- 172.21.15.150:0/1427780498 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5dd40b2750 msgr2=0x7f5dd40ce8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:48:47.502 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:47.495+0000 7f5dd904d640 1 --2- 172.21.15.150:0/1427780498 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5dd40b2750 0x7f5dd40ce8a0 secure :-1 s=READY pgs=1085 cs=0 l=1 rev1=1 crypto rx=0x7f5dc400b440 tx=0x7f5dc400b900 comp rx=0 tx=0).stop 2024-09-17T05:48:47.502 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:47.495+0000 7f5dd904d640 1 -- 172.21.15.150:0/1427780498 shutdown_connections 2024-09-17T05:48:47.502 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:47.495+0000 7f5dd904d640 1 --2- 172.21.15.150:0/1427780498 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5dd415f910 0x7f5dd40cede0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:48:47.502 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:47.495+0000 7f5dd904d640 1 --2- 172.21.15.150:0/1427780498 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f5dc007a0f0 0x7f5dc007c600 unknown :-1 s=CLOSED pgs=468 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:48:47.502 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:47.495+0000 7f5dd904d640 1 --2- 172.21.15.150:0/1427780498 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5dd40b2750 0x7f5dd40ce8a0 unknown :-1 s=CLOSED pgs=1085 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:48:47.502 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:47.495+0000 7f5dd904d640 1 --2- 172.21.15.150:0/1427780498 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5dd40aebc0 0x7f5dd41477e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:48:47.502 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:47.495+0000 7f5dd904d640 1 -- 172.21.15.150:0/1427780498 >> 172.21.15.150:0/1427780498 conn(0x7f5dd406d730 msgr2=0x7f5dd40b36c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:48:47.502 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:47.495+0000 7f5dd904d640 1 -- 172.21.15.150:0/1427780498 shutdown_connections 2024-09-17T05:48:47.502 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:47.495+0000 7f5dd904d640 1 -- 172.21.15.150:0/1427780498 wait complete. 2024-09-17T05:48:48.513 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format json-pretty 2024-09-17T05:48:48.712 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:48.711+0000 7f2f5f39b640 1 -- 172.21.15.150:0/3393160704 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2f580b1c20 msgr2=0x7f2f580b2030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:48:48.712 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:48.711+0000 7f2f5f39b640 1 --2- 172.21.15.150:0/3393160704 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2f580b1c20 0x7f2f580b2030 secure :-1 s=READY pgs=1087 cs=0 l=1 rev1=1 crypto rx=0x7f2f58073fd0 tx=0x7f2f5002a530 comp rx=0 tx=0).stop 2024-09-17T05:48:48.712 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:48.711+0000 7f2f5f39b640 1 -- 172.21.15.150:0/3393160704 shutdown_connections 2024-09-17T05:48:48.713 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:48.711+0000 7f2f5f39b640 1 --2- 172.21.15.150:0/3393160704 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2f580b1c20 0x7f2f580b2030 unknown :-1 s=CLOSED pgs=1087 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:48:48.713 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:48.711+0000 7f2f5f39b640 1 --2- 172.21.15.150:0/3393160704 >> v2:172.21.15.176:3300/0 conn(0x7f2f580b16d0 0x7f2f580ce7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:48:48.713 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:48.711+0000 7f2f5f39b640 1 -- 172.21.15.150:0/3393160704 >> 172.21.15.150:0/3393160704 conn(0x7f2f580cef60 msgr2=0x7f2f580cf370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:48:48.713 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:48.712+0000 7f2f5f39b640 1 -- 172.21.15.150:0/3393160704 shutdown_connections 2024-09-17T05:48:48.713 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:48.712+0000 7f2f5f39b640 1 -- 172.21.15.150:0/3393160704 wait complete. 2024-09-17T05:48:48.716 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:48.715+0000 7f2f5f39b640 1 Processor -- start 2024-09-17T05:48:48.716 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:48.715+0000 7f2f5f39b640 1 -- start start 2024-09-17T05:48:48.718 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:48.717+0000 7f2f5f39b640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2f580b16d0 0x7f2f58158c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:48:48.719 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:48.717+0000 7f2f5f39b640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2f580b1c20 0x7f2f580ca1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:48:48.719 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:48.717+0000 7f2f5f39b640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2f580d0290 0x7f2f580ca900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:48:48.719 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:48.717+0000 7f2f5f39b640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f2f580b2900 con 0x7f2f580d0290 2024-09-17T05:48:48.719 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:48.717+0000 7f2f5f39b640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f2f580b2780 con 0x7f2f580b1c20 2024-09-17T05:48:48.719 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:48.717+0000 7f2f5f39b640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f2f580cce10 con 0x7f2f580b16d0 2024-09-17T05:48:48.719 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:48.718+0000 7f2f5d938640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2f580d0290 0x7f2f580ca900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:48:48.719 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:48.718+0000 7f2f5d938640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2f580d0290 0x7f2f580ca900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:36882/0 (socket says 172.21.15.150:36882) 2024-09-17T05:48:48.719 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:48.718+0000 7f2f5d938640 1 -- 172.21.15.150:0/4258512662 learned_addr learned my addr 172.21.15.150:0/4258512662 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:48:48.719 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:48.718+0000 7f2f5c936640 1 --2- 172.21.15.150:0/4258512662 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2f580b1c20 0x7f2f580ca1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:48:48.719 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:48.718+0000 7f2f5d137640 1 --2- 172.21.15.150:0/4258512662 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2f580b16d0 0x7f2f58158c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:48:48.720 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:48.718+0000 7f2f5d938640 1 -- 172.21.15.150:0/4258512662 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2f580b16d0 msgr2=0x7f2f58158c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:48:48.720 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:48.718+0000 7f2f5d938640 1 --2- 172.21.15.150:0/4258512662 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2f580b16d0 0x7f2f58158c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:48:48.720 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:48.718+0000 7f2f5d938640 1 -- 172.21.15.150:0/4258512662 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2f580b1c20 msgr2=0x7f2f580ca1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:48:48.720 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:48.718+0000 7f2f5d938640 1 --2- 172.21.15.150:0/4258512662 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2f580b1c20 0x7f2f580ca1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:48:48.720 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:48.718+0000 7f2f5d938640 1 -- 172.21.15.150:0/4258512662 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2f5815e460 con 0x7f2f580d0290 2024-09-17T05:48:48.720 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:48.719+0000 7f2f5d938640 1 --2- 172.21.15.150:0/4258512662 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2f580d0290 0x7f2f580ca900 secure :-1 s=READY pgs=1088 cs=0 l=1 rev1=1 crypto rx=0x7f2f500098f0 tx=0x7f2f50033c90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:48:48.720 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:48.719+0000 7f2f4dffb640 1 -- 172.21.15.150:0/4258512662 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f50031d60 con 0x7f2f580d0290 2024-09-17T05:48:48.721 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:48.719+0000 7f2f4dffb640 1 -- 172.21.15.150:0/4258512662 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f2f50005020 con 0x7f2f580d0290 2024-09-17T05:48:48.721 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:48.719+0000 7f2f4dffb640 1 -- 172.21.15.150:0/4258512662 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f50005450 con 0x7f2f580d0290 2024-09-17T05:48:48.721 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:48.720+0000 7f2f5f39b640 1 -- 172.21.15.150:0/4258512662 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2f580c96f0 con 0x7f2f580d0290 2024-09-17T05:48:48.721 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:48.721+0000 7f2f5f39b640 1 -- 172.21.15.150:0/4258512662 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2f5815def0 con 0x7f2f580d0290 2024-09-17T05:48:48.725 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:48.723+0000 7f2f5f39b640 1 -- 172.21.15.150:0/4258512662 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2f580ce7c0 con 0x7f2f580d0290 2024-09-17T05:48:48.728 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:48.726+0000 7f2f4dffb640 1 -- 172.21.15.150:0/4258512662 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 29) ==== 103379+0+0 (secure 0 0 0) 0x7f2f500047a0 con 0x7f2f580d0290 2024-09-17T05:48:48.728 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:48.728+0000 7f2f4dffb640 1 --2- 172.21.15.150:0/4258512662 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f2f3c07a0f0 0x7f2f3c07c600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:48:48.729 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:48.728+0000 7f2f4dffb640 1 -- 172.21.15.150:0/4258512662 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 5822+0+0 (secure 0 0 0) 0x7f2f500055f0 con 0x7f2f580d0290 2024-09-17T05:48:48.735 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:48.734+0000 7f2f4dffb640 1 -- 172.21.15.150:0/4258512662 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f2f5003f030 con 0x7f2f580d0290 2024-09-17T05:48:48.736 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:48.736+0000 7f2f5d137640 1 --2- 172.21.15.150:0/4258512662 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f2f3c07a0f0 0x7f2f3c07c600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:48:48.753 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:48.752+0000 7f2f5d137640 1 --2- 172.21.15.150:0/4258512662 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f2f3c07a0f0 0x7f2f3c07c600 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f2f54009f20 tx=0x7f2f540094f0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:48:49.111 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:49.110+0000 7f2f5f39b640 1 -- 172.21.15.150:0/4258512662 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) -- 0x7f2f580710d0 con 0x7f2f580d0290 2024-09-17T05:48:49.111 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:49.110+0000 7f2f4dffb640 1 -- 172.21.15.150:0/4258512662 <== mon.0 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) ==== 79+0+2657 (secure 0 0 0) 0x7f2f500850d0 con 0x7f2f580d0290 2024-09-17T05:48:49.111 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-09-17T05:48:49.112 INFO:teuthology.orchestra.run.smithi150.stdout:{ 2024-09-17T05:48:49.112 INFO:teuthology.orchestra.run.smithi150.stdout: "fsid": "9f2e05e9-d629-47b3-b26b-1360655b7d20", 2024-09-17T05:48:49.112 INFO:teuthology.orchestra.run.smithi150.stdout: "health": { 2024-09-17T05:48:49.112 INFO:teuthology.orchestra.run.smithi150.stdout: "status": "HEALTH_OK", 2024-09-17T05:48:49.112 INFO:teuthology.orchestra.run.smithi150.stdout: "checks": {}, 2024-09-17T05:48:49.112 INFO:teuthology.orchestra.run.smithi150.stdout: "mutes": [] 2024-09-17T05:48:49.112 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-17T05:48:49.112 INFO:teuthology.orchestra.run.smithi150.stdout: "election_epoch": 4, 2024-09-17T05:48:49.112 INFO:teuthology.orchestra.run.smithi150.stdout: "quorum": [ 2024-09-17T05:48:49.112 INFO:teuthology.orchestra.run.smithi150.stdout: 0, 2024-09-17T05:48:49.112 INFO:teuthology.orchestra.run.smithi150.stdout: 1, 2024-09-17T05:48:49.112 INFO:teuthology.orchestra.run.smithi150.stdout: 2 2024-09-17T05:48:49.113 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2024-09-17T05:48:49.113 INFO:teuthology.orchestra.run.smithi150.stdout: "quorum_names": [ 2024-09-17T05:48:49.113 INFO:teuthology.orchestra.run.smithi150.stdout: "a", 2024-09-17T05:48:49.113 INFO:teuthology.orchestra.run.smithi150.stdout: "b", 2024-09-17T05:48:49.113 INFO:teuthology.orchestra.run.smithi150.stdout: "c" 2024-09-17T05:48:49.113 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2024-09-17T05:48:49.113 INFO:teuthology.orchestra.run.smithi150.stdout: "quorum_age": 436, 2024-09-17T05:48:49.113 INFO:teuthology.orchestra.run.smithi150.stdout: "monmap": { 2024-09-17T05:48:49.113 INFO:teuthology.orchestra.run.smithi150.stdout: "epoch": 1, 2024-09-17T05:48:49.113 INFO:teuthology.orchestra.run.smithi150.stdout: "min_mon_release_name": "squid", 2024-09-17T05:48:49.113 INFO:teuthology.orchestra.run.smithi150.stdout: "num_mons": 3 2024-09-17T05:48:49.113 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-17T05:48:49.113 INFO:teuthology.orchestra.run.smithi150.stdout: "osdmap": { 2024-09-17T05:48:49.114 INFO:teuthology.orchestra.run.smithi150.stdout: "epoch": 88, 2024-09-17T05:48:49.114 INFO:teuthology.orchestra.run.smithi150.stdout: "num_osds": 8, 2024-09-17T05:48:49.114 INFO:teuthology.orchestra.run.smithi150.stdout: "num_up_osds": 8, 2024-09-17T05:48:49.114 INFO:teuthology.orchestra.run.smithi150.stdout: "osd_up_since": 1726551706, 2024-09-17T05:48:49.114 INFO:teuthology.orchestra.run.smithi150.stdout: "num_in_osds": 8, 2024-09-17T05:48:49.114 INFO:teuthology.orchestra.run.smithi150.stdout: "osd_in_since": 1726551696, 2024-09-17T05:48:49.114 INFO:teuthology.orchestra.run.smithi150.stdout: "num_remapped_pgs": 0 2024-09-17T05:48:49.114 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-17T05:48:49.114 INFO:teuthology.orchestra.run.smithi150.stdout: "pgmap": { 2024-09-17T05:48:49.114 INFO:teuthology.orchestra.run.smithi150.stdout: "pgs_by_state": [ 2024-09-17T05:48:49.114 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-09-17T05:48:49.114 INFO:teuthology.orchestra.run.smithi150.stdout: "state_name": "active+clean", 2024-09-17T05:48:49.114 INFO:teuthology.orchestra.run.smithi150.stdout: "count": 97 2024-09-17T05:48:49.114 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-09-17T05:48:49.115 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2024-09-17T05:48:49.115 INFO:teuthology.orchestra.run.smithi150.stdout: "num_pgs": 97, 2024-09-17T05:48:49.115 INFO:teuthology.orchestra.run.smithi150.stdout: "num_pools": 3, 2024-09-17T05:48:49.115 INFO:teuthology.orchestra.run.smithi150.stdout: "num_objects": 1708, 2024-09-17T05:48:49.115 INFO:teuthology.orchestra.run.smithi150.stdout: "data_bytes": 7022493250, 2024-09-17T05:48:49.115 INFO:teuthology.orchestra.run.smithi150.stdout: "bytes_used": 13370761216, 2024-09-17T05:48:49.115 INFO:teuthology.orchestra.run.smithi150.stdout: "bytes_avail": 759723352064, 2024-09-17T05:48:49.115 INFO:teuthology.orchestra.run.smithi150.stdout: "bytes_total": 773094113280, 2024-09-17T05:48:49.115 INFO:teuthology.orchestra.run.smithi150.stdout: "recovering_objects_per_sec": 1, 2024-09-17T05:48:49.115 INFO:teuthology.orchestra.run.smithi150.stdout: "recovering_bytes_per_sec": 6567354, 2024-09-17T05:48:49.115 INFO:teuthology.orchestra.run.smithi150.stdout: "recovering_keys_per_sec": 0, 2024-09-17T05:48:49.115 INFO:teuthology.orchestra.run.smithi150.stdout: "num_objects_recovered": 14, 2024-09-17T05:48:49.115 INFO:teuthology.orchestra.run.smithi150.stdout: "num_bytes_recovered": 58720256, 2024-09-17T05:48:49.115 INFO:teuthology.orchestra.run.smithi150.stdout: "num_keys_recovered": 0, 2024-09-17T05:48:49.116 INFO:teuthology.orchestra.run.smithi150.stdout: "read_bytes_sec": 438138426, 2024-09-17T05:48:49.116 INFO:teuthology.orchestra.run.smithi150.stdout: "write_bytes_sec": 425063614, 2024-09-17T05:48:49.116 INFO:teuthology.orchestra.run.smithi150.stdout: "read_op_per_sec": 106, 2024-09-17T05:48:49.116 INFO:teuthology.orchestra.run.smithi150.stdout: "write_op_per_sec": 118 2024-09-17T05:48:49.116 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-17T05:48:49.116 INFO:teuthology.orchestra.run.smithi150.stdout: "fsmap": { 2024-09-17T05:48:49.116 INFO:teuthology.orchestra.run.smithi150.stdout: "epoch": 52, 2024-09-17T05:48:49.116 INFO:teuthology.orchestra.run.smithi150.stdout: "btime": "2024-09-17T05:48:19:238380+0000", 2024-09-17T05:48:49.116 INFO:teuthology.orchestra.run.smithi150.stdout: "id": 6, 2024-09-17T05:48:49.116 INFO:teuthology.orchestra.run.smithi150.stdout: "up": 1, 2024-09-17T05:48:49.116 INFO:teuthology.orchestra.run.smithi150.stdout: "in": 1, 2024-09-17T05:48:49.116 INFO:teuthology.orchestra.run.smithi150.stdout: "max": 1, 2024-09-17T05:48:49.116 INFO:teuthology.orchestra.run.smithi150.stdout: "by_rank": [ 2024-09-17T05:48:49.116 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-09-17T05:48:49.117 INFO:teuthology.orchestra.run.smithi150.stdout: "filesystem_id": 6, 2024-09-17T05:48:49.117 INFO:teuthology.orchestra.run.smithi150.stdout: "rank": 0, 2024-09-17T05:48:49.117 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "d", 2024-09-17T05:48:49.117 INFO:teuthology.orchestra.run.smithi150.stdout: "status": "up:active", 2024-09-17T05:48:49.117 INFO:teuthology.orchestra.run.smithi150.stdout: "gid": 6496 2024-09-17T05:48:49.117 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-09-17T05:48:49.117 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2024-09-17T05:48:49.117 INFO:teuthology.orchestra.run.smithi150.stdout: "up:standby": 3 2024-09-17T05:48:49.117 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-17T05:48:49.117 INFO:teuthology.orchestra.run.smithi150.stdout: "mgrmap": { 2024-09-17T05:48:49.117 INFO:teuthology.orchestra.run.smithi150.stdout: "available": true, 2024-09-17T05:48:49.117 INFO:teuthology.orchestra.run.smithi150.stdout: "num_standbys": 1, 2024-09-17T05:48:49.117 INFO:teuthology.orchestra.run.smithi150.stdout: "modules": [ 2024-09-17T05:48:49.118 INFO:teuthology.orchestra.run.smithi150.stdout: "iostat", 2024-09-17T05:48:49.118 INFO:teuthology.orchestra.run.smithi150.stdout: "nfs", 2024-09-17T05:48:49.118 INFO:teuthology.orchestra.run.smithi150.stdout: "restful" 2024-09-17T05:48:49.118 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2024-09-17T05:48:49.118 INFO:teuthology.orchestra.run.smithi150.stdout: "services": {} 2024-09-17T05:48:49.118 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-17T05:48:49.118 INFO:teuthology.orchestra.run.smithi150.stdout: "servicemap": { 2024-09-17T05:48:49.118 INFO:teuthology.orchestra.run.smithi150.stdout: "epoch": 14, 2024-09-17T05:48:49.118 INFO:teuthology.orchestra.run.smithi150.stdout: "modified": "2024-09-17T05:47:54.961326+0000", 2024-09-17T05:48:49.118 INFO:teuthology.orchestra.run.smithi150.stdout: "services": {} 2024-09-17T05:48:49.118 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-17T05:48:49.118 INFO:teuthology.orchestra.run.smithi150.stdout: "progress_events": { 2024-09-17T05:48:49.118 INFO:teuthology.orchestra.run.smithi150.stdout: "mgr-vol-ongoing-clones": { 2024-09-17T05:48:49.119 INFO:teuthology.orchestra.run.smithi150.stdout: "message": "4 ongoing clones - average progress is 26.367% (6s)\n [=======.....................] (remaining: 17s)", 2024-09-17T05:48:49.119 INFO:teuthology.orchestra.run.smithi150.stdout: "progress": 0.26366999745368958, 2024-09-17T05:48:49.119 INFO:teuthology.orchestra.run.smithi150.stdout: "add_to_ceph_s": true 2024-09-17T05:48:49.119 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-17T05:48:49.119 INFO:teuthology.orchestra.run.smithi150.stdout: "mgr-vol-total-clones": { 2024-09-17T05:48:49.119 INFO:teuthology.orchestra.run.smithi150.stdout: "message": "Total 5 clones - average progress is 27.76% (0s)\n [=======.....................] ", 2024-09-17T05:48:49.119 INFO:teuthology.orchestra.run.smithi150.stdout: "progress": 0.2775999903678894, 2024-09-17T05:48:49.119 INFO:teuthology.orchestra.run.smithi150.stdout: "add_to_ceph_s": true 2024-09-17T05:48:49.119 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-09-17T05:48:49.119 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-09-17T05:48:49.119 INFO:teuthology.orchestra.run.smithi150.stdout:} 2024-09-17T05:48:49.120 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:49.113+0000 7f2f5f39b640 1 -- 172.21.15.150:0/4258512662 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f2f3c07a0f0 msgr2=0x7f2f3c07c600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:48:49.120 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:49.113+0000 7f2f5f39b640 1 --2- 172.21.15.150:0/4258512662 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f2f3c07a0f0 0x7f2f3c07c600 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f2f54009f20 tx=0x7f2f540094f0 comp rx=0 tx=0).stop 2024-09-17T05:48:49.120 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:49.113+0000 7f2f5f39b640 1 -- 172.21.15.150:0/4258512662 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2f580d0290 msgr2=0x7f2f580ca900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:48:49.120 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:49.113+0000 7f2f5f39b640 1 --2- 172.21.15.150:0/4258512662 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2f580d0290 0x7f2f580ca900 secure :-1 s=READY pgs=1088 cs=0 l=1 rev1=1 crypto rx=0x7f2f500098f0 tx=0x7f2f50033c90 comp rx=0 tx=0).stop 2024-09-17T05:48:49.121 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:49.113+0000 7f2f5f39b640 1 -- 172.21.15.150:0/4258512662 shutdown_connections 2024-09-17T05:48:49.121 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:49.113+0000 7f2f5f39b640 1 --2- 172.21.15.150:0/4258512662 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2f580b1c20 0x7f2f580ca1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:48:49.121 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:49.113+0000 7f2f5f39b640 1 --2- 172.21.15.150:0/4258512662 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f2f3c07a0f0 0x7f2f3c07c600 unknown :-1 s=CLOSED pgs=469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:48:49.121 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:49.113+0000 7f2f5f39b640 1 --2- 172.21.15.150:0/4258512662 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2f580d0290 0x7f2f580ca900 unknown :-1 s=CLOSED pgs=1088 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:48:49.121 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:49.113+0000 7f2f5f39b640 1 --2- 172.21.15.150:0/4258512662 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2f580b16d0 0x7f2f58158c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:48:49.121 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:49.113+0000 7f2f5f39b640 1 -- 172.21.15.150:0/4258512662 >> 172.21.15.150:0/4258512662 conn(0x7f2f580cef60 msgr2=0x7f2f580cf370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:48:49.121 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:49.113+0000 7f2f5f39b640 1 -- 172.21.15.150:0/4258512662 shutdown_connections 2024-09-17T05:48:49.121 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:49.113+0000 7f2f5f39b640 1 -- 172.21.15.150:0/4258512662 wait complete. 2024-09-17T05:48:49.132 INFO:tasks.cephfs.test_volumes:pevs - {'mgr-vol-ongoing-clones': {'message': '4 ongoing clones - average progress is 26.367% (6s)\n [=======.....................] (remaining: 17s)', 'progress': 0.2636699974536896, 'add_to_ceph_s': True}, 'mgr-vol-total-clones': {'message': 'Total 5 clones - average progress is 27.76% (0s)\n [=======.....................] ', 'progress': 0.2775999903678894, 'add_to_ceph_s': True}} 2024-09-17T05:48:49.132 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume snapshot clone cephfs sv1 ss1 subvol_clone57205 2024-09-17T05:48:49.299 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:49.298+0000 7f6bc63f1640 1 -- 172.21.15.150:0/160277 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6ba8003a50 msgr2=0x7f6ba8003ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:48:49.299 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:49.298+0000 7f6bc63f1640 1 --2- 172.21.15.150:0/160277 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6ba8003a50 0x7f6ba8003ec0 secure :-1 s=READY pgs=1090 cs=0 l=1 rev1=1 crypto rx=0x7f6bb0001690 tx=0x7f6ba8005830 comp rx=0 tx=0).stop 2024-09-17T05:48:49.299 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:49.298+0000 7f6bc63f1640 1 -- 172.21.15.150:0/160277 shutdown_connections 2024-09-17T05:48:49.300 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:49.298+0000 7f6bc63f1640 1 --2- 172.21.15.150:0/160277 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6ba8003a50 0x7f6ba8003ec0 unknown :-1 s=CLOSED pgs=1090 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:48:49.300 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:49.298+0000 7f6bc63f1640 1 -- 172.21.15.150:0/160277 >> 172.21.15.150:0/160277 conn(0x7f6bc00b2ff0 msgr2=0x7f6bc00b3400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:48:49.300 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:49.298+0000 7f6bc63f1640 1 -- 172.21.15.150:0/160277 shutdown_connections 2024-09-17T05:48:49.300 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:49.298+0000 7f6bc63f1640 1 -- 172.21.15.150:0/160277 wait complete. 2024-09-17T05:48:49.300 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:49.300+0000 7f6bc63f1640 1 Processor -- start 2024-09-17T05:48:49.301 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:49.300+0000 7f6bc63f1640 1 -- start start 2024-09-17T05:48:49.302 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:49.302+0000 7f6bc63f1640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6ba8003a50 0x7f6bc01f7440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:48:49.303 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:49.302+0000 7f6bc63f1640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6bc01f2ba0 0x7f6bc014d510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:48:49.303 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:49.302+0000 7f6bc63f1640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6bc01f2fb0 0x7f6bc014b4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:48:49.303 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:49.302+0000 7f6bc63f1640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f6bc00b4ae0 con 0x7f6ba8003a50 2024-09-17T05:48:49.303 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:49.302+0000 7f6bc63f1640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f6bc00b4960 con 0x7f6bc01f2fb0 2024-09-17T05:48:49.303 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:49.302+0000 7f6bc63f1640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f6bc00b4c60 con 0x7f6bc01f2ba0 2024-09-17T05:48:49.303 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:49.302+0000 7f6bbffff640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6ba8003a50 0x7f6bc01f7440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:48:49.303 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:49.302+0000 7f6bbffff640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6ba8003a50 0x7f6bc01f7440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:36894/0 (socket says 172.21.15.150:36894) 2024-09-17T05:48:49.303 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:49.302+0000 7f6bbffff640 1 -- 172.21.15.150:0/3003513871 learned_addr learned my addr 172.21.15.150:0/3003513871 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:48:49.304 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:49.303+0000 7f6bbf7fe640 1 --2- 172.21.15.150:0/3003513871 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6bc01f2ba0 0x7f6bc014d510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:48:49.304 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:49.303+0000 7f6bbffff640 1 -- 172.21.15.150:0/3003513871 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6bc01f2ba0 msgr2=0x7f6bc014d510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:48:49.304 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:49.303+0000 7f6bbffff640 1 --2- 172.21.15.150:0/3003513871 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6bc01f2ba0 0x7f6bc014d510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:48:49.305 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:49.303+0000 7f6bbffff640 1 -- 172.21.15.150:0/3003513871 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6bc01f2fb0 msgr2=0x7f6bc014b4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:48:49.305 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:49.303+0000 7f6bbffff640 1 --2- 172.21.15.150:0/3003513871 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6bc01f2fb0 0x7f6bc014b4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:48:49.305 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:49.303+0000 7f6bbffff640 1 -- 172.21.15.150:0/3003513871 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6bc01f6980 con 0x7f6ba8003a50 2024-09-17T05:48:49.305 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:49.303+0000 7f6bbffff640 1 --2- 172.21.15.150:0/3003513871 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6ba8003a50 0x7f6bc01f7440 secure :-1 s=READY pgs=1091 cs=0 l=1 rev1=1 crypto rx=0x7f6bb00017b0 tx=0x7f6bb00063a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:48:49.305 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:49.303+0000 7f6bbcff9640 1 -- 172.21.15.150:0/3003513871 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6bb0042070 con 0x7f6ba8003a50 2024-09-17T05:48:49.305 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:49.304+0000 7f6bbcff9640 1 -- 172.21.15.150:0/3003513871 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f6bb0039070 con 0x7f6ba8003a50 2024-09-17T05:48:49.305 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:49.304+0000 7f6bc63f1640 1 -- 172.21.15.150:0/3003513871 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6bc0151800 con 0x7f6ba8003a50 2024-09-17T05:48:49.305 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:49.304+0000 7f6bbcff9640 1 -- 172.21.15.150:0/3003513871 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6bb0003d70 con 0x7f6ba8003a50 2024-09-17T05:48:49.305 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:49.304+0000 7f6bc63f1640 1 -- 172.21.15.150:0/3003513871 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6bc014e380 con 0x7f6ba8003a50 2024-09-17T05:48:49.306 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:49.305+0000 7f6bc63f1640 1 -- 172.21.15.150:0/3003513871 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6bc00c4af0 con 0x7f6ba8003a50 2024-09-17T05:48:49.307 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:49.306+0000 7f6bbcff9640 1 -- 172.21.15.150:0/3003513871 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 29) ==== 103379+0+0 (secure 0 0 0) 0x7f6bb003b070 con 0x7f6ba8003a50 2024-09-17T05:48:49.307 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:49.307+0000 7f6bbcff9640 1 --2- 172.21.15.150:0/3003513871 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f6bac07a120 0x7f6bac07c630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:48:49.308 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:49.307+0000 7f6bbcff9640 1 -- 172.21.15.150:0/3003513871 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 5822+0+0 (secure 0 0 0) 0x7f6bb00b9500 con 0x7f6ba8003a50 2024-09-17T05:48:49.315 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:49.315+0000 7f6bbcff9640 1 -- 172.21.15.150:0/3003513871 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f6bb0082f70 con 0x7f6ba8003a50 2024-09-17T05:48:49.335 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:49.334+0000 7f6bbf7fe640 1 --2- 172.21.15.150:0/3003513871 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f6bac07a120 0x7f6bac07c630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:48:49.415 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:49.414+0000 7f6bbf7fe640 1 --2- 172.21.15.150:0/3003513871 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f6bac07a120 0x7f6bac07c630 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f6bb4001220 tx=0x7f6bb4009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:48:49.663 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:49.662+0000 7f6bc63f1640 1 -- 172.21.15.150:0/3003513871 --> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] -- mgr_command(tid 0: {"prefix": "fs subvolume snapshot clone", "vol_name": "cephfs", "sub_name": "sv1", "snap_name": "ss1", "target_sub_name": "subvol_clone57205", "target": ["mon-mgr", ""]}) -- 0x7f6bc00b51c0 con 0x7f6bac07a120 2024-09-17T05:48:51.234 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:51.234+0000 7f6bbcff9640 1 -- 172.21.15.150:0/3003513871 <== mgr.4108 v2:172.21.15.176:6800/3631216395 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f6bc00b51c0 con 0x7f6bac07a120 2024-09-17T05:48:51.238 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:51.237+0000 7f6bc63f1640 1 -- 172.21.15.150:0/3003513871 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f6bac07a120 msgr2=0x7f6bac07c630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:48:51.238 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:51.237+0000 7f6bc63f1640 1 --2- 172.21.15.150:0/3003513871 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f6bac07a120 0x7f6bac07c630 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f6bb4001220 tx=0x7f6bb4009040 comp rx=0 tx=0).stop 2024-09-17T05:48:51.238 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:51.237+0000 7f6bc63f1640 1 -- 172.21.15.150:0/3003513871 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6ba8003a50 msgr2=0x7f6bc01f7440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:48:51.238 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:51.237+0000 7f6bc63f1640 1 --2- 172.21.15.150:0/3003513871 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6ba8003a50 0x7f6bc01f7440 secure :-1 s=READY pgs=1091 cs=0 l=1 rev1=1 crypto rx=0x7f6bb00017b0 tx=0x7f6bb00063a0 comp rx=0 tx=0).stop 2024-09-17T05:48:51.238 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:51.237+0000 7f6bc63f1640 1 -- 172.21.15.150:0/3003513871 shutdown_connections 2024-09-17T05:48:51.238 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:51.237+0000 7f6bc63f1640 1 --2- 172.21.15.150:0/3003513871 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6bc01f2fb0 0x7f6bc014b4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:48:51.238 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:51.237+0000 7f6bc63f1640 1 --2- 172.21.15.150:0/3003513871 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f6bac07a120 0x7f6bac07c630 unknown :-1 s=CLOSED pgs=470 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:48:51.239 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:51.237+0000 7f6bc63f1640 1 --2- 172.21.15.150:0/3003513871 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6bc01f2ba0 0x7f6bc014d510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:48:51.239 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:51.237+0000 7f6bc63f1640 1 --2- 172.21.15.150:0/3003513871 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6ba8003a50 0x7f6bc01f7440 secure :-1 s=CLOSED pgs=1091 cs=0 l=1 rev1=1 crypto rx=0x7f6bb00017b0 tx=0x7f6bb00063a0 comp rx=0 tx=0).stop 2024-09-17T05:48:51.239 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:51.237+0000 7f6bc63f1640 1 -- 172.21.15.150:0/3003513871 >> 172.21.15.150:0/3003513871 conn(0x7f6bc00b2ff0 msgr2=0x7f6bc009b7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:48:51.239 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:51.237+0000 7f6bc63f1640 1 -- 172.21.15.150:0/3003513871 shutdown_connections 2024-09-17T05:48:51.239 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:51.237+0000 7f6bc63f1640 1 -- 172.21.15.150:0/3003513871 wait complete. 2024-09-17T05:48:51.261 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume snapshot clone cephfs sv1 ss1 subvol_clone61996 2024-09-17T05:48:51.442 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:51.441+0000 7fe329438640 1 -- 172.21.15.150:0/1008628256 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe3240d0ec0 msgr2=0x7fe3240cd040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:48:51.442 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:51.441+0000 7fe329438640 1 --2- 172.21.15.150:0/1008628256 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe3240d0ec0 0x7fe3240cd040 secure :-1 s=READY pgs=1093 cs=0 l=1 rev1=1 crypto rx=0x7fe32409bd10 tx=0x7fe31c02a7c0 comp rx=0 tx=0).stop 2024-09-17T05:48:51.442 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:51.441+0000 7fe329438640 1 -- 172.21.15.150:0/1008628256 shutdown_connections 2024-09-17T05:48:51.443 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:51.441+0000 7fe329438640 1 --2- 172.21.15.150:0/1008628256 >> v2:172.21.15.176:3300/0 conn(0x7fe3240af570 0x7fe3240d0980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:48:51.443 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:51.441+0000 7fe329438640 1 --2- 172.21.15.150:0/1008628256 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe3240d0ec0 0x7fe3240cd040 unknown :-1 s=CLOSED pgs=1093 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:48:51.443 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:51.441+0000 7fe329438640 1 -- 172.21.15.150:0/1008628256 >> 172.21.15.150:0/1008628256 conn(0x7fe3240cefb0 msgr2=0x7fe3240cf3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:48:51.443 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:51.441+0000 7fe329438640 1 -- 172.21.15.150:0/1008628256 shutdown_connections 2024-09-17T05:48:51.443 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:51.441+0000 7fe329438640 1 -- 172.21.15.150:0/1008628256 wait complete. 2024-09-17T05:48:51.444 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:51.444+0000 7fe329438640 1 Processor -- start 2024-09-17T05:48:51.444 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:51.444+0000 7fe329438640 1 -- start start 2024-09-17T05:48:51.447 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:51.445+0000 7fe329438640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe3240af160 0x7fe32414ae80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:48:51.447 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:51.445+0000 7fe329438640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe3240af570 0x7fe324071e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:48:51.447 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:51.445+0000 7fe329438640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe3240d0ec0 0x7fe324072350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:48:51.447 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:51.445+0000 7fe329438640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7fe3240ced50 con 0x7fe3240af160 2024-09-17T05:48:51.447 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:51.445+0000 7fe329438640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fe3240cebd0 con 0x7fe3240af570 2024-09-17T05:48:51.447 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:51.445+0000 7fe329438640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fe3240d12d0 con 0x7fe3240d0ec0 2024-09-17T05:48:51.448 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:51.445+0000 7fe322ffd640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe3240af160 0x7fe32414ae80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:48:51.448 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:51.445+0000 7fe322ffd640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe3240af160 0x7fe32414ae80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:47818/0 (socket says 172.21.15.150:47818) 2024-09-17T05:48:51.448 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:51.445+0000 7fe322ffd640 1 -- 172.21.15.150:0/130260352 learned_addr learned my addr 172.21.15.150:0/130260352 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:48:51.448 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:51.445+0000 7fe3237fe640 1 --2- 172.21.15.150:0/130260352 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe3240d0ec0 0x7fe324072350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:48:51.448 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:51.445+0000 7fe3227fc640 1 --2- 172.21.15.150:0/130260352 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe3240af570 0x7fe324071e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:48:51.448 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:51.446+0000 7fe322ffd640 1 -- 172.21.15.150:0/130260352 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe3240d0ec0 msgr2=0x7fe324072350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:48:51.448 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:51.446+0000 7fe322ffd640 1 --2- 172.21.15.150:0/130260352 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe3240d0ec0 0x7fe324072350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:48:51.448 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:51.446+0000 7fe322ffd640 1 -- 172.21.15.150:0/130260352 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe3240af570 msgr2=0x7fe324071e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:48:51.448 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:51.446+0000 7fe322ffd640 1 --2- 172.21.15.150:0/130260352 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe3240af570 0x7fe324071e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:48:51.448 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:51.446+0000 7fe322ffd640 1 -- 172.21.15.150:0/130260352 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe3240b3be0 con 0x7fe3240af160 2024-09-17T05:48:51.449 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:51.446+0000 7fe322ffd640 1 --2- 172.21.15.150:0/130260352 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe3240af160 0x7fe32414ae80 secure :-1 s=READY pgs=1094 cs=0 l=1 rev1=1 crypto rx=0x7fe31400c3a0 tx=0x7fe31400c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:48:51.449 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:51.446+0000 7fe30b7fe640 1 -- 172.21.15.150:0/130260352 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe314011790 con 0x7fe3240af160 2024-09-17T05:48:51.449 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:51.446+0000 7fe30b7fe640 1 -- 172.21.15.150:0/130260352 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe314017070 con 0x7fe3240af160 2024-09-17T05:48:51.449 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:51.446+0000 7fe30b7fe640 1 -- 172.21.15.150:0/130260352 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe314011cc0 con 0x7fe3240af160 2024-09-17T05:48:51.449 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:51.446+0000 7fe329438640 1 -- 172.21.15.150:0/130260352 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe3241521e0 con 0x7fe3240af160 2024-09-17T05:48:51.449 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:51.446+0000 7fe329438640 1 -- 172.21.15.150:0/130260352 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe3240729b0 con 0x7fe3240af160 2024-09-17T05:48:51.450 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:51.448+0000 7fe329438640 1 -- 172.21.15.150:0/130260352 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe3240d0980 con 0x7fe3240af160 2024-09-17T05:48:51.450 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:51.448+0000 7fe30b7fe640 1 -- 172.21.15.150:0/130260352 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 29) ==== 103379+0+0 (secure 0 0 0) 0x7fe31401c460 con 0x7fe3240af160 2024-09-17T05:48:51.450 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:51.449+0000 7fe30b7fe640 1 --2- 172.21.15.150:0/130260352 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fe31007a120 0x7fe31007c630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:48:51.450 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:51.449+0000 7fe30b7fe640 1 -- 172.21.15.150:0/130260352 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 5822+0+0 (secure 0 0 0) 0x7fe314099b00 con 0x7fe3240af160 2024-09-17T05:48:51.454 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:51.454+0000 7fe30b7fe640 1 -- 172.21.15.150:0/130260352 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fe314063680 con 0x7fe3240af160 2024-09-17T05:48:51.465 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:51.464+0000 7fe3227fc640 1 --2- 172.21.15.150:0/130260352 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fe31007a120 0x7fe31007c630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:48:51.501 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:51.501+0000 7fe3227fc640 1 --2- 172.21.15.150:0/130260352 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fe31007a120 0x7fe31007c630 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7fe3240a0460 tx=0x7fe318008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:48:51.752 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:51.751+0000 7fe329438640 1 -- 172.21.15.150:0/130260352 --> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] -- mgr_command(tid 0: {"prefix": "fs subvolume snapshot clone", "vol_name": "cephfs", "sub_name": "sv1", "snap_name": "ss1", "target_sub_name": "subvol_clone61996", "target": ["mon-mgr", ""]}) -- 0x7fe3240b0f80 con 0x7fe31007a120 2024-09-17T05:48:53.180 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:53.177+0000 7fe30b7fe640 1 -- 172.21.15.150:0/130260352 <== mgr.4108 v2:172.21.15.176:6800/3631216395 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7fe3240b0f80 con 0x7fe31007a120 2024-09-17T05:48:53.184 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:53.181+0000 7fe329438640 1 -- 172.21.15.150:0/130260352 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fe31007a120 msgr2=0x7fe31007c630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:48:53.184 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:53.181+0000 7fe329438640 1 --2- 172.21.15.150:0/130260352 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fe31007a120 0x7fe31007c630 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7fe3240a0460 tx=0x7fe318008040 comp rx=0 tx=0).stop 2024-09-17T05:48:53.185 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:53.181+0000 7fe329438640 1 -- 172.21.15.150:0/130260352 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe3240af160 msgr2=0x7fe32414ae80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:48:53.185 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:53.181+0000 7fe329438640 1 --2- 172.21.15.150:0/130260352 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe3240af160 0x7fe32414ae80 secure :-1 s=READY pgs=1094 cs=0 l=1 rev1=1 crypto rx=0x7fe31400c3a0 tx=0x7fe31400c860 comp rx=0 tx=0).stop 2024-09-17T05:48:53.185 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:53.181+0000 7fe329438640 1 -- 172.21.15.150:0/130260352 shutdown_connections 2024-09-17T05:48:53.185 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:53.181+0000 7fe329438640 1 --2- 172.21.15.150:0/130260352 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe3240af570 0x7fe324071e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:48:53.185 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:53.181+0000 7fe329438640 1 --2- 172.21.15.150:0/130260352 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fe31007a120 0x7fe31007c630 unknown :-1 s=CLOSED pgs=471 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:48:53.185 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:53.181+0000 7fe329438640 1 --2- 172.21.15.150:0/130260352 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe3240d0ec0 0x7fe324072350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:48:53.185 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:53.181+0000 7fe329438640 1 --2- 172.21.15.150:0/130260352 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe3240af160 0x7fe32414ae80 unknown :-1 s=CLOSED pgs=1094 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:48:53.186 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:53.182+0000 7fe329438640 1 -- 172.21.15.150:0/130260352 >> 172.21.15.150:0/130260352 conn(0x7fe3240cefb0 msgr2=0x7fe324152960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:48:53.186 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:53.182+0000 7fe329438640 1 -- 172.21.15.150:0/130260352 shutdown_connections 2024-09-17T05:48:53.186 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:53.182+0000 7fe329438640 1 -- 172.21.15.150:0/130260352 wait complete. 2024-09-17T05:48:53.215 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume snapshot clone cephfs sv1 ss1 subvol_clone87607 2024-09-17T05:48:53.421 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:53.419+0000 7f608ce71640 1 -- 172.21.15.150:0/4103141382 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6088071710 msgr2=0x7f60880b4350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:48:53.421 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:53.419+0000 7f608ce71640 1 --2- 172.21.15.150:0/4103141382 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6088071710 0x7f60880b4350 secure :-1 s=READY pgs=1096 cs=0 l=1 rev1=1 crypto rx=0x7f6080005fd0 tx=0x7f608002aa90 comp rx=0 tx=0).stop 2024-09-17T05:48:53.421 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:53.419+0000 7f608ce71640 1 -- 172.21.15.150:0/4103141382 shutdown_connections 2024-09-17T05:48:53.421 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:53.419+0000 7f608ce71640 1 --2- 172.21.15.150:0/4103141382 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6088071710 0x7f60880b4350 unknown :-1 s=CLOSED pgs=1096 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:48:53.421 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:53.419+0000 7f608ce71640 1 -- 172.21.15.150:0/4103141382 >> 172.21.15.150:0/4103141382 conn(0x7f60880d13d0 msgr2=0x7f60880cd460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:48:53.421 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:53.419+0000 7f608ce71640 1 -- 172.21.15.150:0/4103141382 shutdown_connections 2024-09-17T05:48:53.422 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:53.419+0000 7f608ce71640 1 -- 172.21.15.150:0/4103141382 wait complete. 2024-09-17T05:48:53.423 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:53.422+0000 7f608ce71640 1 Processor -- start 2024-09-17T05:48:53.423 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:53.422+0000 7f608ce71640 1 -- start start 2024-09-17T05:48:53.427 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:53.424+0000 7f608ce71640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6088071710 0x7f608814f2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:48:53.427 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:53.424+0000 7f608ce71640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6088141940 0x7f6088135110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:48:53.427 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:53.424+0000 7f608ce71640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6088135650 0x7f60880ce8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:48:53.427 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:53.424+0000 7f608ce71640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f6088166f50 con 0x7f6088071710 2024-09-17T05:48:53.428 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:53.424+0000 7f608ce71640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f6088166dd0 con 0x7f6088135650 2024-09-17T05:48:53.428 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:53.424+0000 7f608ce71640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f60881670d0 con 0x7f6088141940 2024-09-17T05:48:53.428 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:53.425+0000 7f60877fe640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6088071710 0x7f608814f2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:48:53.428 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:53.425+0000 7f60877fe640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6088071710 0x7f608814f2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:47834/0 (socket says 172.21.15.150:47834) 2024-09-17T05:48:53.428 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:53.425+0000 7f60877fe640 1 -- 172.21.15.150:0/1387758407 learned_addr learned my addr 172.21.15.150:0/1387758407 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:48:53.428 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:53.425+0000 7f60877fe640 1 -- 172.21.15.150:0/1387758407 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6088141940 msgr2=0x7f6088135110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:48:53.428 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:53.425+0000 7f60877fe640 1 --2- 172.21.15.150:0/1387758407 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6088141940 0x7f6088135110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:48:53.428 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:53.425+0000 7f60877fe640 1 -- 172.21.15.150:0/1387758407 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6088135650 msgr2=0x7f60880ce8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:48:53.428 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:53.425+0000 7f60877fe640 1 --2- 172.21.15.150:0/1387758407 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6088135650 0x7f60880ce8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:48:53.428 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:53.425+0000 7f60877fe640 1 -- 172.21.15.150:0/1387758407 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6088132c30 con 0x7f6088071710 2024-09-17T05:48:53.428 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:53.425+0000 7f60877fe640 1 --2- 172.21.15.150:0/1387758407 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6088071710 0x7f608814f2e0 secure :-1 s=READY pgs=1097 cs=0 l=1 rev1=1 crypto rx=0x7f607800c3c0 tx=0x7f607800c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:48:53.428 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:53.425+0000 7f606ffff640 1 -- 172.21.15.150:0/1387758407 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6078017070 con 0x7f6088071710 2024-09-17T05:48:53.428 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:53.425+0000 7f606ffff640 1 -- 172.21.15.150:0/1387758407 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f60780035f0 con 0x7f6088071710 2024-09-17T05:48:53.428 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:53.425+0000 7f608ce71640 1 -- 172.21.15.150:0/1387758407 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f608815bde0 con 0x7f6088071710 2024-09-17T05:48:53.429 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:53.425+0000 7f606ffff640 1 -- 172.21.15.150:0/1387758407 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6078003a80 con 0x7f6088071710 2024-09-17T05:48:53.429 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:53.425+0000 7f608ce71640 1 -- 172.21.15.150:0/1387758407 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f608815c3a0 con 0x7f6088071710 2024-09-17T05:48:53.429 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:53.427+0000 7f608ce71640 1 -- 172.21.15.150:0/1387758407 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6088050f60 con 0x7f6088071710 2024-09-17T05:48:53.429 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:53.427+0000 7f606ffff640 1 -- 172.21.15.150:0/1387758407 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 29) ==== 103379+0+0 (secure 0 0 0) 0x7f607801a070 con 0x7f6088071710 2024-09-17T05:48:53.430 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:53.428+0000 7f606ffff640 1 --2- 172.21.15.150:0/1387758407 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f607407c300 0x7f607407e810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:48:53.430 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:53.428+0000 7f606ffff640 1 -- 172.21.15.150:0/1387758407 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 5822+0+0 (secure 0 0 0) 0x7f60780991c0 con 0x7f6088071710 2024-09-17T05:48:53.432 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:53.430+0000 7f6086ffd640 1 --2- 172.21.15.150:0/1387758407 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f607407c300 0x7f607407e810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:48:53.434 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:53.433+0000 7f606ffff640 1 -- 172.21.15.150:0/1387758407 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f6088050f60 con 0x7f6088071710 2024-09-17T05:48:53.458 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:53.456+0000 7f6086ffd640 1 --2- 172.21.15.150:0/1387758407 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f607407c300 0x7f607407e810 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f6088155f80 tx=0x7f607c006ba0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:48:53.730 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:53.729+0000 7f608ce71640 1 -- 172.21.15.150:0/1387758407 --> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] -- mgr_command(tid 0: {"prefix": "fs subvolume snapshot clone", "vol_name": "cephfs", "sub_name": "sv1", "snap_name": "ss1", "target_sub_name": "subvol_clone87607", "target": ["mon-mgr", ""]}) -- 0x7f608814f820 con 0x7f607407c300 2024-09-17T05:48:55.323 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:55.320+0000 7f606ffff640 1 -- 172.21.15.150:0/1387758407 <== mgr.4108 v2:172.21.15.176:6800/3631216395 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f607c009280 con 0x7f607407c300 2024-09-17T05:48:55.329 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:55.327+0000 7f608ce71640 1 -- 172.21.15.150:0/1387758407 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f607407c300 msgr2=0x7f607407e810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:48:55.329 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:55.327+0000 7f608ce71640 1 --2- 172.21.15.150:0/1387758407 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f607407c300 0x7f607407e810 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f6088155f80 tx=0x7f607c006ba0 comp rx=0 tx=0).stop 2024-09-17T05:48:55.330 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:55.327+0000 7f608ce71640 1 -- 172.21.15.150:0/1387758407 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6088071710 msgr2=0x7f608814f2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:48:55.330 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:55.327+0000 7f608ce71640 1 --2- 172.21.15.150:0/1387758407 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6088071710 0x7f608814f2e0 secure :-1 s=READY pgs=1097 cs=0 l=1 rev1=1 crypto rx=0x7f607800c3c0 tx=0x7f607800c880 comp rx=0 tx=0).stop 2024-09-17T05:48:55.330 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:55.328+0000 7f608ce71640 1 -- 172.21.15.150:0/1387758407 shutdown_connections 2024-09-17T05:48:55.330 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:55.328+0000 7f608ce71640 1 --2- 172.21.15.150:0/1387758407 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6088135650 0x7f60880ce8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:48:55.330 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:55.328+0000 7f608ce71640 1 --2- 172.21.15.150:0/1387758407 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f607407c300 0x7f607407e810 unknown :-1 s=CLOSED pgs=472 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:48:55.330 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:55.328+0000 7f608ce71640 1 --2- 172.21.15.150:0/1387758407 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6088141940 0x7f6088135110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:48:55.330 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:55.328+0000 7f608ce71640 1 --2- 172.21.15.150:0/1387758407 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6088071710 0x7f608814f2e0 unknown :-1 s=CLOSED pgs=1097 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:48:55.330 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:55.328+0000 7f608ce71640 1 -- 172.21.15.150:0/1387758407 >> 172.21.15.150:0/1387758407 conn(0x7f60880d13d0 msgr2=0x7f608813e670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:48:55.331 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:55.328+0000 7f608ce71640 1 -- 172.21.15.150:0/1387758407 shutdown_connections 2024-09-17T05:48:55.331 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:55.328+0000 7f608ce71640 1 -- 172.21.15.150:0/1387758407 wait complete. 2024-09-17T05:48:55.352 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume snapshot clone cephfs sv1 ss1 subvol_clone5458 2024-09-17T05:48:55.536 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:55.534+0000 7f2b81750640 1 -- 172.21.15.150:0/2056017671 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2b64004e60 msgr2=0x7f2b640052d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:48:55.537 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:55.534+0000 7f2b81750640 1 --2- 172.21.15.150:0/2056017671 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2b64004e60 0x7f2b640052d0 secure :-1 s=READY pgs=1099 cs=0 l=1 rev1=1 crypto rx=0x7f2b7400c610 tx=0x7f2b64005830 comp rx=0 tx=0).stop 2024-09-17T05:48:55.537 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:55.534+0000 7f2b7b7fe640 1 -- 172.21.15.150:0/2056017671 reap_dead start 2024-09-17T05:48:55.537 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:55.534+0000 7f2b81750640 1 -- 172.21.15.150:0/2056017671 shutdown_connections 2024-09-17T05:48:55.537 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:55.534+0000 7f2b81750640 1 -- 172.21.15.150:0/2056017671 >> 172.21.15.150:0/2056017671 conn(0x7f2b7c0d46e0 msgr2=0x7f2b7c0d4af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:48:55.537 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:55.534+0000 7f2b81750640 1 -- 172.21.15.150:0/2056017671 shutdown_connections 2024-09-17T05:48:55.537 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:55.534+0000 7f2b81750640 1 -- 172.21.15.150:0/2056017671 wait complete. 2024-09-17T05:48:55.538 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:55.537+0000 7f2b81750640 1 Processor -- start 2024-09-17T05:48:55.538 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:55.537+0000 7f2b81750640 1 -- start start 2024-09-17T05:48:55.541 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:55.538+0000 7f2b81750640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2b7c0cb840 0x7f2b7c155d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:48:55.541 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:55.538+0000 7f2b81750640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2b7c0ce1b0 0x7f2b7c0c99d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:48:55.541 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:55.538+0000 7f2b81750640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2b7c0ce5c0 0x7f2b7c0c9f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:48:55.541 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:55.538+0000 7f2b81750640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f2b7c0cf490 con 0x7f2b7c0cb840 2024-09-17T05:48:55.541 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:55.538+0000 7f2b81750640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f2b7c0cf310 con 0x7f2b7c0ce1b0 2024-09-17T05:48:55.541 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:55.538+0000 7f2b81750640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f2b7c0cf610 con 0x7f2b7c0ce5c0 2024-09-17T05:48:55.541 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:55.538+0000 7f2b7affd640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2b7c0cb840 0x7f2b7c155d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:48:55.541 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:55.538+0000 7f2b7affd640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2b7c0cb840 0x7f2b7c155d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:47840/0 (socket says 172.21.15.150:47840) 2024-09-17T05:48:55.541 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:55.538+0000 7f2b7affd640 1 -- 172.21.15.150:0/2482839662 learned_addr learned my addr 172.21.15.150:0/2482839662 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:48:55.541 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:55.538+0000 7f2b7affd640 1 -- 172.21.15.150:0/2482839662 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2b7c0ce5c0 msgr2=0x7f2b7c0c9f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:48:55.541 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:55.538+0000 7f2b7affd640 1 --2- 172.21.15.150:0/2482839662 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2b7c0ce5c0 0x7f2b7c0c9f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:48:55.541 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:55.538+0000 7f2b7affd640 1 -- 172.21.15.150:0/2482839662 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2b7c0ce1b0 msgr2=0x7f2b7c0c99d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:48:55.542 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:55.538+0000 7f2b7affd640 1 --2- 172.21.15.150:0/2482839662 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2b7c0ce1b0 0x7f2b7c0c99d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:48:55.542 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:55.538+0000 7f2b7affd640 1 -- 172.21.15.150:0/2482839662 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2b7c1f6b60 con 0x7f2b7c0cb840 2024-09-17T05:48:55.542 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:55.539+0000 7f2b7affd640 1 --2- 172.21.15.150:0/2482839662 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2b7c0cb840 0x7f2b7c155d20 secure :-1 s=READY pgs=1100 cs=0 l=1 rev1=1 crypto rx=0x7f2b6c004d70 tx=0x7f2b6c001630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:48:55.542 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:55.539+0000 7f2b637fe640 1 -- 172.21.15.150:0/2482839662 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b6c015020 con 0x7f2b7c0cb840 2024-09-17T05:48:55.542 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:55.539+0000 7f2b637fe640 1 -- 172.21.15.150:0/2482839662 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f2b6c011760 con 0x7f2b7c0cb840 2024-09-17T05:48:55.542 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:55.539+0000 7f2b81750640 1 -- 172.21.15.150:0/2482839662 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2b7c1f5da0 con 0x7f2b7c0cb840 2024-09-17T05:48:55.542 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:55.539+0000 7f2b637fe640 1 -- 172.21.15.150:0/2482839662 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b6c011b90 con 0x7f2b7c0cb840 2024-09-17T05:48:55.542 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:55.539+0000 7f2b81750640 1 -- 172.21.15.150:0/2482839662 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2b7c1f6360 con 0x7f2b7c0cb840 2024-09-17T05:48:55.543 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:55.540+0000 7f2b81750640 1 -- 172.21.15.150:0/2482839662 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2b7c06fde0 con 0x7f2b7c0cb840 2024-09-17T05:48:55.543 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:55.541+0000 7f2b637fe640 1 -- 172.21.15.150:0/2482839662 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 29) ==== 103379+0+0 (secure 0 0 0) 0x7f2b6c018020 con 0x7f2b7c0cb840 2024-09-17T05:48:55.543 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:55.541+0000 7f2b637fe640 1 --2- 172.21.15.150:0/2482839662 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f2b6807a0f0 0x7f2b6807c600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:48:55.543 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:55.541+0000 7f2b637fe640 1 -- 172.21.15.150:0/2482839662 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 5822+0+0 (secure 0 0 0) 0x7f2b6c09a770 con 0x7f2b7c0cb840 2024-09-17T05:48:55.545 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:55.543+0000 7f2b7a7fc640 1 --2- 172.21.15.150:0/2482839662 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f2b6807a0f0 0x7f2b6807c600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:48:55.550 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:55.548+0000 7f2b637fe640 1 -- 172.21.15.150:0/2482839662 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f2b7c06fde0 con 0x7f2b7c0cb840 2024-09-17T05:48:55.557 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:55.555+0000 7f2b7a7fc640 1 --2- 172.21.15.150:0/2482839662 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f2b6807a0f0 0x7f2b6807c600 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f2b7c0a23d0 tx=0x7f2b7000d3d0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:48:55.856 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:55.854+0000 7f2b81750640 1 -- 172.21.15.150:0/2482839662 --> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] -- mgr_command(tid 0: {"prefix": "fs subvolume snapshot clone", "vol_name": "cephfs", "sub_name": "sv1", "snap_name": "ss1", "target_sub_name": "subvol_clone5458", "target": ["mon-mgr", ""]}) -- 0x7f2b7c0cea90 con 0x7f2b6807a0f0 2024-09-17T05:48:56.156 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-17T05:48:56.158 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-17T05:48:56.797 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:56.795+0000 7f2b637fe640 1 -- 172.21.15.150:0/2482839662 <== mgr.4108 v2:172.21.15.176:6800/3631216395 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f2b7000fac0 con 0x7f2b6807a0f0 2024-09-17T05:48:56.802 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:56.800+0000 7f2b81750640 1 -- 172.21.15.150:0/2482839662 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f2b6807a0f0 msgr2=0x7f2b6807c600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:48:56.802 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:56.800+0000 7f2b81750640 1 --2- 172.21.15.150:0/2482839662 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f2b6807a0f0 0x7f2b6807c600 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f2b7c0a23d0 tx=0x7f2b7000d3d0 comp rx=0 tx=0).stop 2024-09-17T05:48:56.803 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:56.800+0000 7f2b81750640 1 -- 172.21.15.150:0/2482839662 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2b7c0cb840 msgr2=0x7f2b7c155d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:48:56.803 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:56.800+0000 7f2b81750640 1 --2- 172.21.15.150:0/2482839662 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2b7c0cb840 0x7f2b7c155d20 secure :-1 s=READY pgs=1100 cs=0 l=1 rev1=1 crypto rx=0x7f2b6c004d70 tx=0x7f2b6c001630 comp rx=0 tx=0).stop 2024-09-17T05:48:56.803 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:56.800+0000 7f2b81750640 1 -- 172.21.15.150:0/2482839662 shutdown_connections 2024-09-17T05:48:56.803 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:56.800+0000 7f2b81750640 1 --2- 172.21.15.150:0/2482839662 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2b7c0ce1b0 0x7f2b7c0c99d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:48:56.803 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:56.800+0000 7f2b81750640 1 --2- 172.21.15.150:0/2482839662 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f2b6807a0f0 0x7f2b6807c600 unknown :-1 s=CLOSED pgs=473 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:48:56.803 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:56.800+0000 7f2b81750640 1 --2- 172.21.15.150:0/2482839662 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2b7c0ce5c0 0x7f2b7c0c9f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:48:56.803 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:56.800+0000 7f2b81750640 1 --2- 172.21.15.150:0/2482839662 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2b7c0cb840 0x7f2b7c155d20 unknown :-1 s=CLOSED pgs=1100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:48:56.803 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:56.800+0000 7f2b81750640 1 -- 172.21.15.150:0/2482839662 >> 172.21.15.150:0/2482839662 conn(0x7f2b7c0d46e0 msgr2=0x7f2b7c06f1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:48:56.803 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:56.801+0000 7f2b81750640 1 -- 172.21.15.150:0/2482839662 shutdown_connections 2024-09-17T05:48:56.803 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:56.801+0000 7f2b81750640 1 -- 172.21.15.150:0/2482839662 wait complete. 2024-09-17T05:48:56.827 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume snapshot clone cephfs sv1 ss1 subvol_clone94949 2024-09-17T05:48:57.012 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:57.010+0000 7f4c977fe640 1 -- 172.21.15.150:0/685443620 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c90031bf0 con 0x7f4ca006dea0 2024-09-17T05:48:57.013 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:57.011+0000 7f4ca6bad640 1 -- 172.21.15.150:0/685443620 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4ca006dea0 msgr2=0x7f4ca00d0020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:48:57.013 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:57.011+0000 7f4ca6bad640 1 --2- 172.21.15.150:0/685443620 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4ca006dea0 0x7f4ca00d0020 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f4ca008e950 tx=0x7f4c9002a540 comp rx=0 tx=0).stop 2024-09-17T05:48:57.013 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:57.011+0000 7f4ca6bad640 1 -- 172.21.15.150:0/685443620 shutdown_connections 2024-09-17T05:48:57.013 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:57.011+0000 7f4ca6bad640 1 --2- 172.21.15.150:0/685443620 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4ca006dea0 0x7f4ca00d0020 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:48:57.013 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:57.011+0000 7f4ca6bad640 1 --2- 172.21.15.150:0/685443620 >> v2:172.21.15.150:3300/0 conn(0x7f4ca00d5150 0x7f4ca00b9b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:48:57.013 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:57.011+0000 7f4ca6bad640 1 -- 172.21.15.150:0/685443620 >> 172.21.15.150:0/685443620 conn(0x7f4ca008bfe0 msgr2=0x7f4ca00d46e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:48:57.014 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:57.011+0000 7f4ca6bad640 1 -- 172.21.15.150:0/685443620 shutdown_connections 2024-09-17T05:48:57.014 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:57.011+0000 7f4ca6bad640 1 -- 172.21.15.150:0/685443620 wait complete. 2024-09-17T05:48:57.015 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:57.013+0000 7f4ca6bad640 1 Processor -- start 2024-09-17T05:48:57.015 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:57.013+0000 7f4ca6bad640 1 -- start start 2024-09-17T05:48:57.016 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:57.015+0000 7f4ca6bad640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4ca006dea0 0x7f4ca00b41c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:48:57.017 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:57.015+0000 7f4ca6bad640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4ca006e2b0 0x7f4ca00b4700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:48:57.017 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:57.015+0000 7f4ca6bad640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4ca00d5150 0x7f4ca015cc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:48:57.017 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:57.015+0000 7f4ca6bad640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f4ca00ba190 con 0x7f4ca00d5150 2024-09-17T05:48:57.017 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:57.015+0000 7f4ca6bad640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f4ca00d31e0 con 0x7f4ca006e2b0 2024-09-17T05:48:57.017 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:57.015+0000 7f4ca6bad640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f4ca00b6870 con 0x7f4ca006dea0 2024-09-17T05:48:57.017 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:57.015+0000 7f4ca514a640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4ca00d5150 0x7f4ca015cc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:48:57.017 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:57.015+0000 7f4ca514a640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4ca00d5150 0x7f4ca015cc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:47856/0 (socket says 172.21.15.150:47856) 2024-09-17T05:48:57.017 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:57.015+0000 7f4ca514a640 1 -- 172.21.15.150:0/1222179997 learned_addr learned my addr 172.21.15.150:0/1222179997 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:48:57.018 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:57.015+0000 7f4ca514a640 1 -- 172.21.15.150:0/1222179997 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4ca006dea0 msgr2=0x7f4ca00b41c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:48:57.018 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:57.015+0000 7f4ca514a640 1 --2- 172.21.15.150:0/1222179997 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4ca006dea0 0x7f4ca00b41c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:48:57.018 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:57.015+0000 7f4ca514a640 1 -- 172.21.15.150:0/1222179997 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4ca006e2b0 msgr2=0x7f4ca00b4700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:48:57.018 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:57.015+0000 7f4ca514a640 1 --2- 172.21.15.150:0/1222179997 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4ca006e2b0 0x7f4ca00b4700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:48:57.019 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:57.015+0000 7f4ca514a640 1 -- 172.21.15.150:0/1222179997 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4ca00cc770 con 0x7f4ca00d5150 2024-09-17T05:48:57.019 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:57.016+0000 7f4ca514a640 1 --2- 172.21.15.150:0/1222179997 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4ca00d5150 0x7f4ca015cc00 secure :-1 s=READY pgs=1102 cs=0 l=1 rev1=1 crypto rx=0x7f4c9800c790 tx=0x7f4c9800cc50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:48:57.019 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:57.016+0000 7f4c957fa640 1 -- 172.21.15.150:0/1222179997 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c98003da0 con 0x7f4ca00d5150 2024-09-17T05:48:57.019 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:57.016+0000 7f4c957fa640 1 -- 172.21.15.150:0/1222179997 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f4c9800ce40 con 0x7f4ca00d5150 2024-09-17T05:48:57.019 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:57.016+0000 7f4ca6bad640 1 -- 172.21.15.150:0/1222179997 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4ca00cca50 con 0x7f4ca00d5150 2024-09-17T05:48:57.019 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:57.016+0000 7f4c957fa640 1 -- 172.21.15.150:0/1222179997 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c980052d0 con 0x7f4ca00d5150 2024-09-17T05:48:57.019 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:57.016+0000 7f4ca6bad640 1 -- 172.21.15.150:0/1222179997 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4ca00cd010 con 0x7f4ca00d5150 2024-09-17T05:48:57.019 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:57.017+0000 7f4ca6bad640 1 -- 172.21.15.150:0/1222179997 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4ca00b9b10 con 0x7f4ca00d5150 2024-09-17T05:48:57.020 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:57.018+0000 7f4c957fa640 1 -- 172.21.15.150:0/1222179997 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 29) ==== 103379+0+0 (secure 0 0 0) 0x7f4c98005470 con 0x7f4ca00d5150 2024-09-17T05:48:57.020 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:57.018+0000 7f4c957fa640 1 --2- 172.21.15.150:0/1222179997 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f4c8c07a120 0x7f4c8c07c630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:48:57.020 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:57.019+0000 7f4c957fa640 1 -- 172.21.15.150:0/1222179997 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 5822+0+0 (secure 0 0 0) 0x7f4c98099b60 con 0x7f4ca00d5150 2024-09-17T05:48:57.025 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:57.024+0000 7f4c957fa640 1 -- 172.21.15.150:0/1222179997 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f4c98063650 con 0x7f4ca00d5150 2024-09-17T05:48:57.026 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:57.024+0000 7f4ca4949640 1 --2- 172.21.15.150:0/1222179997 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f4c8c07a120 0x7f4c8c07c630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:48:57.029 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:57.028+0000 7f4ca4949640 1 --2- 172.21.15.150:0/1222179997 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f4c8c07a120 0x7f4c8c07c630 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f4c9c005d00 tx=0x7f4c9c005c50 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:48:57.304 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:57.302+0000 7f4ca6bad640 1 -- 172.21.15.150:0/1222179997 --> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] -- mgr_command(tid 0: {"prefix": "fs subvolume snapshot clone", "vol_name": "cephfs", "sub_name": "sv1", "snap_name": "ss1", "target_sub_name": "subvol_clone94949", "target": ["mon-mgr", ""]}) -- 0x7f4ca00d4f30 con 0x7f4c8c07a120 2024-09-17T05:48:58.177 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:58.175+0000 7f4c957fa640 1 -- 172.21.15.150:0/1222179997 <== mgr.4108 v2:172.21.15.176:6800/3631216395 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f4ca00d4f30 con 0x7f4c8c07a120 2024-09-17T05:48:58.180 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:58.178+0000 7f4ca6bad640 1 -- 172.21.15.150:0/1222179997 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f4c8c07a120 msgr2=0x7f4c8c07c630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:48:58.180 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:58.178+0000 7f4ca6bad640 1 --2- 172.21.15.150:0/1222179997 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f4c8c07a120 0x7f4c8c07c630 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f4c9c005d00 tx=0x7f4c9c005c50 comp rx=0 tx=0).stop 2024-09-17T05:48:58.180 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:58.178+0000 7f4ca6bad640 1 -- 172.21.15.150:0/1222179997 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4ca00d5150 msgr2=0x7f4ca015cc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:48:58.180 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:58.178+0000 7f4ca6bad640 1 --2- 172.21.15.150:0/1222179997 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4ca00d5150 0x7f4ca015cc00 secure :-1 s=READY pgs=1102 cs=0 l=1 rev1=1 crypto rx=0x7f4c9800c790 tx=0x7f4c9800cc50 comp rx=0 tx=0).stop 2024-09-17T05:48:58.180 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:58.178+0000 7f4ca6bad640 1 -- 172.21.15.150:0/1222179997 shutdown_connections 2024-09-17T05:48:58.181 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:58.178+0000 7f4ca6bad640 1 --2- 172.21.15.150:0/1222179997 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4ca006e2b0 0x7f4ca00b4700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:48:58.181 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:58.178+0000 7f4ca6bad640 1 --2- 172.21.15.150:0/1222179997 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f4c8c07a120 0x7f4c8c07c630 unknown :-1 s=CLOSED pgs=474 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:48:58.181 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:58.178+0000 7f4ca6bad640 1 --2- 172.21.15.150:0/1222179997 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4ca00d5150 0x7f4ca015cc00 unknown :-1 s=CLOSED pgs=1102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:48:58.181 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:58.178+0000 7f4ca6bad640 1 --2- 172.21.15.150:0/1222179997 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4ca006dea0 0x7f4ca00b41c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:48:58.181 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:58.178+0000 7f4ca6bad640 1 -- 172.21.15.150:0/1222179997 >> 172.21.15.150:0/1222179997 conn(0x7f4ca008bfe0 msgr2=0x7f4ca00d2380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:48:58.181 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:58.178+0000 7f4ca6bad640 1 -- 172.21.15.150:0/1222179997 shutdown_connections 2024-09-17T05:48:58.181 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:58.178+0000 7f4ca6bad640 1 -- 172.21.15.150:0/1222179997 wait complete. 2024-09-17T05:48:58.196 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume snapshot clone cephfs sv1 ss1 subvol_clone310410 2024-09-17T05:48:58.366 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:58.364+0000 7f4774f98640 1 -- 172.21.15.150:0/664500679 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f47700d0730 msgr2=0x7f47700b6160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:48:58.366 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:58.364+0000 7f4774f98640 1 --2- 172.21.15.150:0/664500679 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f47700d0730 0x7f47700b6160 secure :-1 s=READY pgs=1104 cs=0 l=1 rev1=1 crypto rx=0x7f477008d600 tx=0x7f476802a8b0 comp rx=0 tx=0).stop 2024-09-17T05:48:58.366 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:58.364+0000 7f4774f98640 1 -- 172.21.15.150:0/664500679 shutdown_connections 2024-09-17T05:48:58.366 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:58.364+0000 7f4774f98640 1 --2- 172.21.15.150:0/664500679 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f47700d0730 0x7f47700b6160 unknown :-1 s=CLOSED pgs=1104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:48:58.366 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:58.364+0000 7f4774f98640 1 --2- 172.21.15.150:0/664500679 >> v2:172.21.15.176:3300/0 conn(0x7f47700d5150 0x7f47700b9b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:48:58.366 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:58.364+0000 7f4774f98640 1 -- 172.21.15.150:0/664500679 >> 172.21.15.150:0/664500679 conn(0x7f477008bfe0 msgr2=0x7f47700d46e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:48:58.366 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:58.364+0000 7f4774f98640 1 -- 172.21.15.150:0/664500679 shutdown_connections 2024-09-17T05:48:58.366 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:58.364+0000 7f4774f98640 1 -- 172.21.15.150:0/664500679 wait complete. 2024-09-17T05:48:58.367 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:58.366+0000 7f4774f98640 1 Processor -- start 2024-09-17T05:48:58.368 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:58.366+0000 7f4774f98640 1 -- start start 2024-09-17T05:48:58.370 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:58.367+0000 7f4774f98640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f477006dea0 0x7f47700cd510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:48:58.370 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:58.367+0000 7f4774f98640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f47700d0730 0x7f47701f9840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:48:58.370 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:58.367+0000 7f4774f98640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f47700d5150 0x7f47700b5080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:48:58.370 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:58.367+0000 7f4774f98640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f477006e2b0 con 0x7f47700d5150 2024-09-17T05:48:58.370 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:58.367+0000 7f4774f98640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f47700d31e0 con 0x7f477006dea0 2024-09-17T05:48:58.370 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:58.367+0000 7f4774f98640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f477006e430 con 0x7f47700d0730 2024-09-17T05:48:58.370 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:58.368+0000 7f476ed9d640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f47700d5150 0x7f47700b5080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:48:58.370 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:58.368+0000 7f476ed9d640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f47700d5150 0x7f47700b5080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:47862/0 (socket says 172.21.15.150:47862) 2024-09-17T05:48:58.370 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:58.368+0000 7f476ed9d640 1 -- 172.21.15.150:0/3981789994 learned_addr learned my addr 172.21.15.150:0/3981789994 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:48:58.370 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:58.368+0000 7f476ed9d640 1 -- 172.21.15.150:0/3981789994 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f47700d0730 msgr2=0x7f47701f9840 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-17T05:48:58.370 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:58.368+0000 7f476ed9d640 1 --2- 172.21.15.150:0/3981789994 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f47700d0730 0x7f47701f9840 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:48:58.371 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:58.368+0000 7f476ed9d640 1 -- 172.21.15.150:0/3981789994 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f477006dea0 msgr2=0x7f47700cd510 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-17T05:48:58.371 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:58.368+0000 7f476ed9d640 1 --2- 172.21.15.150:0/3981789994 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f477006dea0 0x7f47700cd510 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:48:58.371 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:58.368+0000 7f476ed9d640 1 -- 172.21.15.150:0/3981789994 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f47701f5f00 con 0x7f47700d5150 2024-09-17T05:48:58.371 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:58.368+0000 7f476ed9d640 1 --2- 172.21.15.150:0/3981789994 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f47700d5150 0x7f47700b5080 secure :-1 s=READY pgs=1105 cs=0 l=1 rev1=1 crypto rx=0x7f4768005fd0 tx=0x7f47680039f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:48:58.372 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:58.368+0000 7f4766ffd640 1 -- 172.21.15.150:0/3981789994 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4768031990 con 0x7f47700d5150 2024-09-17T05:48:58.372 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:58.369+0000 7f4774f98640 1 -- 172.21.15.150:0/3981789994 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f47701f61e0 con 0x7f47700d5150 2024-09-17T05:48:58.372 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:58.369+0000 7f4774f98640 1 -- 172.21.15.150:0/3981789994 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f47701f67a0 con 0x7f47700d5150 2024-09-17T05:48:58.372 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:58.369+0000 7f4766ffd640 1 -- 172.21.15.150:0/3981789994 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f47680317e0 con 0x7f47700d5150 2024-09-17T05:48:58.372 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:58.369+0000 7f4766ffd640 1 -- 172.21.15.150:0/3981789994 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4768031d30 con 0x7f47700d5150 2024-09-17T05:48:58.372 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:58.371+0000 7f4774f98640 1 -- 172.21.15.150:0/3981789994 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4754005290 con 0x7f47700d5150 2024-09-17T05:48:58.373 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:58.372+0000 7f4766ffd640 1 -- 172.21.15.150:0/3981789994 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 29) ==== 103379+0+0 (secure 0 0 0) 0x7f4768033070 con 0x7f47700d5150 2024-09-17T05:48:58.374 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:58.373+0000 7f4766ffd640 1 --2- 172.21.15.150:0/3981789994 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f475007a0f0 0x7f475007c600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:48:58.375 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:58.373+0000 7f4766ffd640 1 -- 172.21.15.150:0/3981789994 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 5822+0+0 (secure 0 0 0) 0x7f47680bb430 con 0x7f47700d5150 2024-09-17T05:48:58.375 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:58.373+0000 7f476e59c640 1 --2- 172.21.15.150:0/3981789994 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f475007a0f0 0x7f475007c600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:48:58.380 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:58.378+0000 7f4766ffd640 1 -- 172.21.15.150:0/3981789994 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f476803f030 con 0x7f47700d5150 2024-09-17T05:48:58.427 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:58.425+0000 7f476e59c640 1 --2- 172.21.15.150:0/3981789994 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f475007a0f0 0x7f475007c600 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f47600095f0 tx=0x7f4760006b70 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:48:58.691 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:48:58.690+0000 7f4774f98640 1 -- 172.21.15.150:0/3981789994 --> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] -- mgr_command(tid 0: {"prefix": "fs subvolume snapshot clone", "vol_name": "cephfs", "sub_name": "sv1", "snap_name": "ss1", "target_sub_name": "subvol_clone310410", "target": ["mon-mgr", ""]}) -- 0x7f4754000c80 con 0x7f475007a0f0 2024-09-17T05:49:00.713 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:00.711+0000 7f4766ffd640 1 -- 172.21.15.150:0/3981789994 <== mgr.4108 v2:172.21.15.176:6800/3631216395 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f4754000c80 con 0x7f475007a0f0 2024-09-17T05:49:00.717 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:00.714+0000 7f4774f98640 1 -- 172.21.15.150:0/3981789994 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f475007a0f0 msgr2=0x7f475007c600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:49:00.717 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:00.714+0000 7f4774f98640 1 --2- 172.21.15.150:0/3981789994 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f475007a0f0 0x7f475007c600 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f47600095f0 tx=0x7f4760006b70 comp rx=0 tx=0).stop 2024-09-17T05:49:00.717 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:00.715+0000 7f4774f98640 1 -- 172.21.15.150:0/3981789994 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f47700d5150 msgr2=0x7f47700b5080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:49:00.717 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:00.715+0000 7f4774f98640 1 --2- 172.21.15.150:0/3981789994 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f47700d5150 0x7f47700b5080 secure :-1 s=READY pgs=1105 cs=0 l=1 rev1=1 crypto rx=0x7f4768005fd0 tx=0x7f47680039f0 comp rx=0 tx=0).stop 2024-09-17T05:49:00.717 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:00.715+0000 7f4774f98640 1 -- 172.21.15.150:0/3981789994 shutdown_connections 2024-09-17T05:49:00.717 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:00.715+0000 7f4774f98640 1 --2- 172.21.15.150:0/3981789994 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f475007a0f0 0x7f475007c600 unknown :-1 s=CLOSED pgs=475 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:49:00.717 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:00.715+0000 7f4774f98640 1 --2- 172.21.15.150:0/3981789994 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f47700d5150 0x7f47700b5080 unknown :-1 s=CLOSED pgs=1105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:49:00.717 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:00.715+0000 7f4774f98640 1 --2- 172.21.15.150:0/3981789994 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f47700d0730 0x7f47701f9840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:49:00.717 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:00.715+0000 7f4774f98640 1 --2- 172.21.15.150:0/3981789994 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f477006dea0 0x7f47700cd510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:49:00.717 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:00.715+0000 7f4774f98640 1 -- 172.21.15.150:0/3981789994 >> 172.21.15.150:0/3981789994 conn(0x7f477008bfe0 msgr2=0x7f477006f910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:49:00.717 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:00.715+0000 7f4774f98640 1 -- 172.21.15.150:0/3981789994 shutdown_connections 2024-09-17T05:49:00.717 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:00.715+0000 7f4774f98640 1 -- 172.21.15.150:0/3981789994 wait complete. 2024-09-17T05:49:00.730 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume snapshot clone cephfs sv1 ss1 subvol_clone627111 2024-09-17T05:49:00.911 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:00.909+0000 7f2f6274a640 1 -- 172.21.15.150:0/2162079082 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2f5c06ddb0 msgr2=0x7f2f5c06e1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:49:00.912 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:00.909+0000 7f2f6274a640 1 --2- 172.21.15.150:0/2162079082 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2f5c06ddb0 0x7f2f5c06e1c0 secure :-1 s=READY pgs=1107 cs=0 l=1 rev1=1 crypto rx=0x7f2f5c0b6a90 tx=0x7f2f5402a8b0 comp rx=0 tx=0).stop 2024-09-17T05:49:00.912 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:00.909+0000 7f2f6274a640 1 -- 172.21.15.150:0/2162079082 shutdown_connections 2024-09-17T05:49:00.912 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:00.909+0000 7f2f6274a640 1 --2- 172.21.15.150:0/2162079082 >> v2:172.21.15.176:3300/0 conn(0x7f2f5c15eae0 0x7f2f5c15eef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:49:00.912 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:00.909+0000 7f2f6274a640 1 --2- 172.21.15.150:0/2162079082 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2f5c06ddb0 0x7f2f5c06e1c0 unknown :-1 s=CLOSED pgs=1107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:49:00.912 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:00.909+0000 7f2f6274a640 1 -- 172.21.15.150:0/2162079082 >> 172.21.15.150:0/2162079082 conn(0x7f2f5c073890 msgr2=0x7f2f5c073ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:49:00.912 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:00.909+0000 7f2f6274a640 1 -- 172.21.15.150:0/2162079082 shutdown_connections 2024-09-17T05:49:00.912 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:00.909+0000 7f2f6274a640 1 -- 172.21.15.150:0/2162079082 wait complete. 2024-09-17T05:49:00.913 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:00.912+0000 7f2f6274a640 1 Processor -- start 2024-09-17T05:49:00.913 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:00.912+0000 7f2f6274a640 1 -- start start 2024-09-17T05:49:00.917 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:00.914+0000 7f2f6274a640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2f5c06ddb0 0x7f2f5c145610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:49:00.917 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:00.914+0000 7f2f6274a640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2f5c15c130 0x7f2f5c0cf9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:49:00.917 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:00.914+0000 7f2f6274a640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2f5c15eae0 0x7f2f5c0cfee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:49:00.917 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:00.914+0000 7f2f6274a640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f2f5c0760b0 con 0x7f2f5c06ddb0 2024-09-17T05:49:00.917 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:00.914+0000 7f2f6274a640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f2f5c075f30 con 0x7f2f5c15eae0 2024-09-17T05:49:00.918 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:00.914+0000 7f2f6274a640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f2f5c076230 con 0x7f2f5c15c130 2024-09-17T05:49:00.918 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:00.915+0000 7f2f5bfff640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2f5c06ddb0 0x7f2f5c145610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:49:00.918 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:00.915+0000 7f2f5bfff640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2f5c06ddb0 0x7f2f5c145610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:49796/0 (socket says 172.21.15.150:49796) 2024-09-17T05:49:00.918 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:00.915+0000 7f2f5bfff640 1 -- 172.21.15.150:0/1835112869 learned_addr learned my addr 172.21.15.150:0/1835112869 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:49:00.918 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:00.915+0000 7f2f5b7fe640 1 --2- 172.21.15.150:0/1835112869 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2f5c15c130 0x7f2f5c0cf9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:49:00.918 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:00.915+0000 7f2f5bfff640 1 -- 172.21.15.150:0/1835112869 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2f5c15c130 msgr2=0x7f2f5c0cf9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:49:00.918 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:00.915+0000 7f2f5bfff640 1 --2- 172.21.15.150:0/1835112869 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2f5c15c130 0x7f2f5c0cf9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:49:00.918 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:00.915+0000 7f2f5bfff640 1 -- 172.21.15.150:0/1835112869 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2f5c15eae0 msgr2=0x7f2f5c0cfee0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-17T05:49:00.918 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:00.915+0000 7f2f5bfff640 1 --2- 172.21.15.150:0/1835112869 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2f5c15eae0 0x7f2f5c0cfee0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:49:00.918 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:00.915+0000 7f2f5bfff640 1 -- 172.21.15.150:0/1835112869 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2f5c154680 con 0x7f2f5c06ddb0 2024-09-17T05:49:00.918 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:00.915+0000 7f2f5bfff640 1 --2- 172.21.15.150:0/1835112869 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2f5c06ddb0 0x7f2f5c145610 secure :-1 s=READY pgs=1108 cs=0 l=1 rev1=1 crypto rx=0x7f2f4c00c3c0 tx=0x7f2f4c00c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:49:00.919 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:00.916+0000 7f2f58ff9640 1 -- 172.21.15.150:0/1835112869 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f4c017070 con 0x7f2f5c06ddb0 2024-09-17T05:49:00.919 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:00.916+0000 7f2f58ff9640 1 -- 172.21.15.150:0/1835112869 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f2f4c0035f0 con 0x7f2f5c06ddb0 2024-09-17T05:49:00.919 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:00.916+0000 7f2f6274a640 1 -- 172.21.15.150:0/1835112869 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2f5c155500 con 0x7f2f5c06ddb0 2024-09-17T05:49:00.919 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:00.916+0000 7f2f6274a640 1 -- 172.21.15.150:0/1835112869 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2f5c158470 con 0x7f2f5c06ddb0 2024-09-17T05:49:00.920 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:00.916+0000 7f2f58ff9640 1 -- 172.21.15.150:0/1835112869 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f4c003a80 con 0x7f2f5c06ddb0 2024-09-17T05:49:00.920 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:00.918+0000 7f2f6274a640 1 -- 172.21.15.150:0/1835112869 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2f3c005290 con 0x7f2f5c06ddb0 2024-09-17T05:49:00.921 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:00.919+0000 7f2f58ff9640 1 -- 172.21.15.150:0/1835112869 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 29) ==== 103379+0+0 (secure 0 0 0) 0x7f2f4c01a070 con 0x7f2f5c06ddb0 2024-09-17T05:49:00.921 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:00.920+0000 7f2f58ff9640 1 --2- 172.21.15.150:0/1835112869 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f2f4807a120 0x7f2f4807c630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:49:00.921 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:00.920+0000 7f2f58ff9640 1 -- 172.21.15.150:0/1835112869 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 5822+0+0 (secure 0 0 0) 0x7f2f4c099080 con 0x7f2f5c06ddb0 2024-09-17T05:49:00.927 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:00.925+0000 7f2f58ff9640 1 -- 172.21.15.150:0/1835112869 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f2f5c155500 con 0x7f2f5c06ddb0 2024-09-17T05:49:00.951 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:00.949+0000 7f2f5b7fe640 1 --2- 172.21.15.150:0/1835112869 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f2f4807a120 0x7f2f4807c630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:49:00.991 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:00.990+0000 7f2f5b7fe640 1 --2- 172.21.15.150:0/1835112869 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f2f4807a120 0x7f2f4807c630 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f2f5c0cd590 tx=0x7f2f50008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:49:01.233 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:01.231+0000 7f2f6274a640 1 -- 172.21.15.150:0/1835112869 --> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] -- mgr_command(tid 0: {"prefix": "fs subvolume snapshot clone", "vol_name": "cephfs", "sub_name": "sv1", "snap_name": "ss1", "target_sub_name": "subvol_clone627111", "target": ["mon-mgr", ""]}) -- 0x7f2f3c000c80 con 0x7f2f4807a120 2024-09-17T05:49:02.029 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:02.027+0000 7f2f58ff9640 1 -- 172.21.15.150:0/1835112869 <== mgr.4108 v2:172.21.15.176:6800/3631216395 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f2f3c000c80 con 0x7f2f4807a120 2024-09-17T05:49:02.036 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:02.034+0000 7f2f6274a640 1 -- 172.21.15.150:0/1835112869 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f2f4807a120 msgr2=0x7f2f4807c630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:49:02.036 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:02.034+0000 7f2f6274a640 1 --2- 172.21.15.150:0/1835112869 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f2f4807a120 0x7f2f4807c630 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f2f5c0cd590 tx=0x7f2f50008040 comp rx=0 tx=0).stop 2024-09-17T05:49:02.036 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:02.034+0000 7f2f6274a640 1 -- 172.21.15.150:0/1835112869 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2f5c06ddb0 msgr2=0x7f2f5c145610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:49:02.036 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:02.034+0000 7f2f6274a640 1 --2- 172.21.15.150:0/1835112869 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2f5c06ddb0 0x7f2f5c145610 secure :-1 s=READY pgs=1108 cs=0 l=1 rev1=1 crypto rx=0x7f2f4c00c3c0 tx=0x7f2f4c00c880 comp rx=0 tx=0).stop 2024-09-17T05:49:02.036 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:02.034+0000 7f2f6274a640 1 -- 172.21.15.150:0/1835112869 shutdown_connections 2024-09-17T05:49:02.037 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:02.034+0000 7f2f6274a640 1 --2- 172.21.15.150:0/1835112869 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2f5c15eae0 0x7f2f5c0cfee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:49:02.037 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:02.034+0000 7f2f6274a640 1 --2- 172.21.15.150:0/1835112869 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f2f4807a120 0x7f2f4807c630 unknown :-1 s=CLOSED pgs=476 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:49:02.037 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:02.034+0000 7f2f6274a640 1 --2- 172.21.15.150:0/1835112869 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2f5c15c130 0x7f2f5c0cf9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:49:02.037 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:02.034+0000 7f2f6274a640 1 --2- 172.21.15.150:0/1835112869 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2f5c06ddb0 0x7f2f5c145610 unknown :-1 s=CLOSED pgs=1108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:49:02.037 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:02.034+0000 7f2f6274a640 1 -- 172.21.15.150:0/1835112869 >> 172.21.15.150:0/1835112869 conn(0x7f2f5c073890 msgr2=0x7f2f5c0b4500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:49:02.037 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:02.034+0000 7f2f6274a640 1 -- 172.21.15.150:0/1835112869 shutdown_connections 2024-09-17T05:49:02.037 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:02.035+0000 7f2f6274a640 1 -- 172.21.15.150:0/1835112869 wait complete. 2024-09-17T05:49:02.054 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume snapshot clone cephfs sv1 ss1 subvol_clone149612 2024-09-17T05:49:02.255 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:02.253+0000 7f983b0a2640 1 -- 172.21.15.150:0/3016982315 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f983415ba60 msgr2=0x7f98340b4590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:49:02.255 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:02.253+0000 7f983b0a2640 1 --2- 172.21.15.150:0/3016982315 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f983415ba60 0x7f98340b4590 secure :-1 s=READY pgs=1110 cs=0 l=1 rev1=1 crypto rx=0x7f982c005fd0 tx=0x7f982c02a930 comp rx=0 tx=0).stop 2024-09-17T05:49:02.255 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:02.253+0000 7f983b0a2640 1 -- 172.21.15.150:0/3016982315 shutdown_connections 2024-09-17T05:49:02.255 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:02.253+0000 7f983b0a2640 1 --2- 172.21.15.150:0/3016982315 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f98340cff80 0x7f98340cbdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:49:02.255 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:02.253+0000 7f983b0a2640 1 --2- 172.21.15.150:0/3016982315 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f983415ba60 0x7f98340b4590 unknown :-1 s=CLOSED pgs=1110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:49:02.255 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:02.253+0000 7f983b0a2640 1 -- 172.21.15.150:0/3016982315 >> 172.21.15.150:0/3016982315 conn(0x7f98340b2ff0 msgr2=0x7f98340b3400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:49:02.255 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:02.253+0000 7f983b0a2640 1 -- 172.21.15.150:0/3016982315 shutdown_connections 2024-09-17T05:49:02.255 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:02.253+0000 7f983b0a2640 1 -- 172.21.15.150:0/3016982315 wait complete. 2024-09-17T05:49:02.257 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:02.255+0000 7f983b0a2640 1 Processor -- start 2024-09-17T05:49:02.257 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:02.256+0000 7f983b0a2640 1 -- start start 2024-09-17T05:49:02.260 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:02.258+0000 7f983b0a2640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f98340cb5b0 0x7f9834150ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:49:02.260 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:02.258+0000 7f983b0a2640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f983415ba60 0x7f98341424e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:49:02.260 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:02.258+0000 7f983b0a2640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9834142a20 0x7f9834142e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:49:02.260 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:02.258+0000 7f983b0a2640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f98340b4f40 con 0x7f983415ba60 2024-09-17T05:49:02.261 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:02.258+0000 7f983b0a2640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f98340b4dc0 con 0x7f9834142a20 2024-09-17T05:49:02.261 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:02.258+0000 7f983b0a2640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f98340b50c0 con 0x7f98340cb5b0 2024-09-17T05:49:02.261 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:02.258+0000 7f9833fff640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f983415ba60 0x7f98341424e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:49:02.261 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:02.258+0000 7f9833fff640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f983415ba60 0x7f98341424e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:49824/0 (socket says 172.21.15.150:49824) 2024-09-17T05:49:02.261 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:02.258+0000 7f9833fff640 1 -- 172.21.15.150:0/1821522251 learned_addr learned my addr 172.21.15.150:0/1821522251 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:49:02.261 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:02.258+0000 7f983963f640 1 --2- 172.21.15.150:0/1821522251 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9834142a20 0x7f9834142e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:49:02.261 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:02.258+0000 7f9838e3e640 1 --2- 172.21.15.150:0/1821522251 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f98340cb5b0 0x7f9834150ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:49:02.261 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:02.258+0000 7f9833fff640 1 -- 172.21.15.150:0/1821522251 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f98340cb5b0 msgr2=0x7f9834150ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:49:02.261 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:02.258+0000 7f9833fff640 1 --2- 172.21.15.150:0/1821522251 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f98340cb5b0 0x7f9834150ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:49:02.261 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:02.258+0000 7f9833fff640 1 -- 172.21.15.150:0/1821522251 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9834142a20 msgr2=0x7f9834142e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:49:02.261 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:02.258+0000 7f9833fff640 1 --2- 172.21.15.150:0/1821522251 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9834142a20 0x7f9834142e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:49:02.261 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:02.258+0000 7f9833fff640 1 -- 172.21.15.150:0/1821522251 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f98341f22d0 con 0x7f983415ba60 2024-09-17T05:49:02.261 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:02.258+0000 7f983963f640 1 --2- 172.21.15.150:0/1821522251 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9834142a20 0x7f9834142e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:49:02.262 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:02.259+0000 7f9833fff640 1 --2- 172.21.15.150:0/1821522251 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f983415ba60 0x7f98341424e0 secure :-1 s=READY pgs=1111 cs=0 l=1 rev1=1 crypto rx=0x7f9834073b20 tx=0x7f982000b820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:49:02.262 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:02.259+0000 7f98317fa640 1 -- 172.21.15.150:0/1821522251 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9820015020 con 0x7f983415ba60 2024-09-17T05:49:02.262 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:02.259+0000 7f98317fa640 1 -- 172.21.15.150:0/1821522251 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9820011920 con 0x7f983415ba60 2024-09-17T05:49:02.262 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:02.259+0000 7f983b0a2640 1 -- 172.21.15.150:0/1821522251 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9834150830 con 0x7f983415ba60 2024-09-17T05:49:02.263 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:02.259+0000 7f98317fa640 1 -- 172.21.15.150:0/1821522251 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9820011d50 con 0x7f983415ba60 2024-09-17T05:49:02.263 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:02.259+0000 7f983b0a2640 1 -- 172.21.15.150:0/1821522251 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f98340c9260 con 0x7f983415ba60 2024-09-17T05:49:02.263 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:02.262+0000 7f983b0a2640 1 -- 172.21.15.150:0/1821522251 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9834145430 con 0x7f983415ba60 2024-09-17T05:49:02.263 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:02.262+0000 7f98317fa640 1 -- 172.21.15.150:0/1821522251 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 29) ==== 103379+0+0 (secure 0 0 0) 0x7f9820018020 con 0x7f983415ba60 2024-09-17T05:49:02.264 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:02.262+0000 7f98317fa640 1 --2- 172.21.15.150:0/1821522251 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f981807a0f0 0x7f981807c600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:49:02.264 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:02.263+0000 7f98317fa640 1 -- 172.21.15.150:0/1821522251 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 5822+0+0 (secure 0 0 0) 0x7f9820099d60 con 0x7f983415ba60 2024-09-17T05:49:02.270 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:02.268+0000 7f98317fa640 1 -- 172.21.15.150:0/1821522251 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f982001f020 con 0x7f983415ba60 2024-09-17T05:49:02.293 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:02.291+0000 7f9838e3e640 1 --2- 172.21.15.150:0/1821522251 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f981807a0f0 0x7f981807c600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:49:02.326 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:02.325+0000 7f9838e3e640 1 --2- 172.21.15.150:0/1821522251 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f981807a0f0 0x7f981807c600 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f9828001940 tx=0x7f9828009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:49:02.574 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:02.572+0000 7f983b0a2640 1 -- 172.21.15.150:0/1821522251 --> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] -- mgr_command(tid 0: {"prefix": "fs subvolume snapshot clone", "vol_name": "cephfs", "sub_name": "sv1", "snap_name": "ss1", "target_sub_name": "subvol_clone149612", "target": ["mon-mgr", ""]}) -- 0x7f98340b55b0 con 0x7f981807a0f0 2024-09-17T05:49:03.734 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:03.732+0000 7f98317fa640 1 -- 172.21.15.150:0/1821522251 <== mgr.4108 v2:172.21.15.176:6800/3631216395 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f98340b55b0 con 0x7f981807a0f0 2024-09-17T05:49:03.738 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:03.736+0000 7f983b0a2640 1 -- 172.21.15.150:0/1821522251 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f981807a0f0 msgr2=0x7f981807c600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:49:03.738 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:03.736+0000 7f983b0a2640 1 --2- 172.21.15.150:0/1821522251 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f981807a0f0 0x7f981807c600 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f9828001940 tx=0x7f9828009040 comp rx=0 tx=0).stop 2024-09-17T05:49:03.738 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:03.736+0000 7f983b0a2640 1 -- 172.21.15.150:0/1821522251 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f983415ba60 msgr2=0x7f98341424e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:49:03.738 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:03.736+0000 7f983b0a2640 1 --2- 172.21.15.150:0/1821522251 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f983415ba60 0x7f98341424e0 secure :-1 s=READY pgs=1111 cs=0 l=1 rev1=1 crypto rx=0x7f9834073b20 tx=0x7f982000b820 comp rx=0 tx=0).stop 2024-09-17T05:49:03.739 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:03.736+0000 7f983b0a2640 1 -- 172.21.15.150:0/1821522251 shutdown_connections 2024-09-17T05:49:03.739 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:03.736+0000 7f983b0a2640 1 --2- 172.21.15.150:0/1821522251 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9834142a20 0x7f9834142e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:49:03.739 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:03.736+0000 7f983b0a2640 1 --2- 172.21.15.150:0/1821522251 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f981807a0f0 0x7f981807c600 unknown :-1 s=CLOSED pgs=477 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:49:03.739 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:03.736+0000 7f983b0a2640 1 --2- 172.21.15.150:0/1821522251 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f983415ba60 0x7f98341424e0 unknown :-1 s=CLOSED pgs=1111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:49:03.739 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:03.736+0000 7f983b0a2640 1 --2- 172.21.15.150:0/1821522251 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f98340cb5b0 0x7f9834150ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:49:03.739 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:03.736+0000 7f983b0a2640 1 -- 172.21.15.150:0/1821522251 >> 172.21.15.150:0/1821522251 conn(0x7f98340b2ff0 msgr2=0x7f983415a0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:49:03.739 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:03.736+0000 7f983b0a2640 1 -- 172.21.15.150:0/1821522251 shutdown_connections 2024-09-17T05:49:03.739 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:03.736+0000 7f983b0a2640 1 -- 172.21.15.150:0/1821522251 wait complete. 2024-09-17T05:49:03.750 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume snapshot clone cephfs sv1 ss1 subvol_clone941013 2024-09-17T05:49:03.922 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:03.919+0000 7fc20e5f1640 1 -- 172.21.15.150:0/4029389526 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc2080d5150 msgr2=0x7fc2080b9b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:49:03.922 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:03.919+0000 7fc20e5f1640 1 --2- 172.21.15.150:0/4029389526 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc2080d5150 0x7fc2080b9b10 secure :-1 s=READY pgs=1112 cs=0 l=1 rev1=1 crypto rx=0x7fc20808e950 tx=0x7fc1f802a540 comp rx=0 tx=0).stop 2024-09-17T05:49:03.922 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:03.919+0000 7fc20e5f1640 1 -- 172.21.15.150:0/4029389526 shutdown_connections 2024-09-17T05:49:03.922 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:03.919+0000 7fc20e5f1640 1 --2- 172.21.15.150:0/4029389526 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc20806e2b0 0x7fc2080d0560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:49:03.922 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:03.919+0000 7fc20e5f1640 1 --2- 172.21.15.150:0/4029389526 >> v2:172.21.15.176:3300/0 conn(0x7fc20806dea0 0x7fc2080d0020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:49:03.922 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:03.919+0000 7fc20e5f1640 1 --2- 172.21.15.150:0/4029389526 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc2080d5150 0x7fc2080b9b10 unknown :-1 s=CLOSED pgs=1112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:49:03.922 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:03.919+0000 7fc20e5f1640 1 -- 172.21.15.150:0/4029389526 >> 172.21.15.150:0/4029389526 conn(0x7fc20808bfe0 msgr2=0x7fc2080d46e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:49:03.922 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:03.919+0000 7fc20e5f1640 1 -- 172.21.15.150:0/4029389526 shutdown_connections 2024-09-17T05:49:03.922 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:03.919+0000 7fc20e5f1640 1 -- 172.21.15.150:0/4029389526 wait complete. 2024-09-17T05:49:03.923 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:03.922+0000 7fc20e5f1640 1 Processor -- start 2024-09-17T05:49:03.923 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:03.922+0000 7fc20e5f1640 1 -- start start 2024-09-17T05:49:03.927 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:03.924+0000 7fc20e5f1640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc20806dea0 0x7fc20815bfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:49:03.927 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:03.924+0000 7fc20e5f1640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc20806e2b0 0x7fc20815cdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:49:03.927 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:03.924+0000 7fc20e5f1640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc2080d5150 0x7fc2080cdfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:49:03.927 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:03.924+0000 7fc20e5f1640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7fc2080d3150 con 0x7fc2080d5150 2024-09-17T05:49:03.927 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:03.924+0000 7fc20e5f1640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fc2080d2fd0 con 0x7fc20806e2b0 2024-09-17T05:49:03.927 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:03.924+0000 7fc20e5f1640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fc2080b6160 con 0x7fc20806dea0 2024-09-17T05:49:03.927 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:03.924+0000 7fc20cb8e640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc2080d5150 0x7fc2080cdfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:49:03.928 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:03.924+0000 7fc20cb8e640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc2080d5150 0x7fc2080cdfb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:49850/0 (socket says 172.21.15.150:49850) 2024-09-17T05:49:03.928 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:03.924+0000 7fc20cb8e640 1 -- 172.21.15.150:0/4289984360 learned_addr learned my addr 172.21.15.150:0/4289984360 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:49:03.928 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:03.924+0000 7fc20cb8e640 1 -- 172.21.15.150:0/4289984360 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc20806dea0 msgr2=0x7fc20815bfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:49:03.928 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:03.924+0000 7fc20cb8e640 1 --2- 172.21.15.150:0/4289984360 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc20806dea0 0x7fc20815bfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:49:03.928 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:03.924+0000 7fc20cb8e640 1 -- 172.21.15.150:0/4289984360 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc20806e2b0 msgr2=0x7fc20815cdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:49:03.928 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:03.925+0000 7fc20cb8e640 1 --2- 172.21.15.150:0/4289984360 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc20806e2b0 0x7fc20815cdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:49:03.928 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:03.925+0000 7fc20cb8e640 1 -- 172.21.15.150:0/4289984360 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc20814ed70 con 0x7fc2080d5150 2024-09-17T05:49:03.928 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:03.925+0000 7fc20cb8e640 1 --2- 172.21.15.150:0/4289984360 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc2080d5150 0x7fc2080cdfb0 secure :-1 s=READY pgs=1113 cs=0 l=1 rev1=1 crypto rx=0x7fc20000b9a0 tx=0x7fc20000be60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:49:03.928 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:03.925+0000 7fc204ff9640 1 -- 172.21.15.150:0/4289984360 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc200019070 con 0x7fc2080d5150 2024-09-17T05:49:03.928 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:03.925+0000 7fc204ff9640 1 -- 172.21.15.150:0/4289984360 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc20000cc50 con 0x7fc2080d5150 2024-09-17T05:49:03.929 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:03.926+0000 7fc204ff9640 1 -- 172.21.15.150:0/4289984360 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2000146a0 con 0x7fc2080d5150 2024-09-17T05:49:03.930 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:03.926+0000 7fc20e5f1640 1 -- 172.21.15.150:0/4289984360 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc2081f9540 con 0x7fc2080d5150 2024-09-17T05:49:03.930 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:03.926+0000 7fc20e5f1640 1 -- 172.21.15.150:0/4289984360 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc2081f9b00 con 0x7fc2080d5150 2024-09-17T05:49:03.930 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:03.927+0000 7fc20e5f1640 1 -- 172.21.15.150:0/4289984360 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc2081f92b0 con 0x7fc2080d5150 2024-09-17T05:49:03.930 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:03.928+0000 7fc204ff9640 1 -- 172.21.15.150:0/4289984360 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 29) ==== 103379+0+0 (secure 0 0 0) 0x7fc20001c070 con 0x7fc2080d5150 2024-09-17T05:49:03.930 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:03.929+0000 7fc204ff9640 1 --2- 172.21.15.150:0/4289984360 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fc1f407a0f0 0x7fc1f407c600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:49:03.930 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:03.929+0000 7fc204ff9640 1 -- 172.21.15.150:0/4289984360 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 5822+0+0 (secure 0 0 0) 0x7fc200099bf0 con 0x7fc2080d5150 2024-09-17T05:49:03.938 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:03.936+0000 7fc204ff9640 1 -- 172.21.15.150:0/4289984360 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fc200063660 con 0x7fc2080d5150 2024-09-17T05:49:03.965 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:03.963+0000 7fc207fff640 1 --2- 172.21.15.150:0/4289984360 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fc1f407a0f0 0x7fc1f407c600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:49:03.988 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:03.986+0000 7fc207fff640 1 --2- 172.21.15.150:0/4289984360 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fc1f407a0f0 0x7fc1f407c600 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7fc1f8034000 tx=0x7fc1f80046c0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:49:04.266 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:04.264+0000 7fc20e5f1640 1 -- 172.21.15.150:0/4289984360 --> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] -- mgr_command(tid 0: {"prefix": "fs subvolume snapshot clone", "vol_name": "cephfs", "sub_name": "sv1", "snap_name": "ss1", "target_sub_name": "subvol_clone941013", "target": ["mon-mgr", ""]}) -- 0x7fc20815d2f0 con 0x7fc1f407a0f0 2024-09-17T05:49:05.770 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:05.768+0000 7fc204ff9640 1 -- 172.21.15.150:0/4289984360 <== mgr.4108 v2:172.21.15.176:6800/3631216395 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7fc1f8005230 con 0x7fc1f407a0f0 2024-09-17T05:49:05.773 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:05.771+0000 7fc20e5f1640 1 -- 172.21.15.150:0/4289984360 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fc1f407a0f0 msgr2=0x7fc1f407c600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:49:05.773 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:05.771+0000 7fc20e5f1640 1 --2- 172.21.15.150:0/4289984360 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fc1f407a0f0 0x7fc1f407c600 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7fc1f8034000 tx=0x7fc1f80046c0 comp rx=0 tx=0).stop 2024-09-17T05:49:05.774 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:05.771+0000 7fc20e5f1640 1 -- 172.21.15.150:0/4289984360 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc2080d5150 msgr2=0x7fc2080cdfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:49:05.774 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:05.771+0000 7fc20e5f1640 1 --2- 172.21.15.150:0/4289984360 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc2080d5150 0x7fc2080cdfb0 secure :-1 s=READY pgs=1113 cs=0 l=1 rev1=1 crypto rx=0x7fc20000b9a0 tx=0x7fc20000be60 comp rx=0 tx=0).stop 2024-09-17T05:49:05.774 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:05.771+0000 7fc20e5f1640 1 -- 172.21.15.150:0/4289984360 shutdown_connections 2024-09-17T05:49:05.774 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:05.771+0000 7fc20e5f1640 1 --2- 172.21.15.150:0/4289984360 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc20806e2b0 0x7fc20815cdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:49:05.774 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:05.771+0000 7fc20e5f1640 1 --2- 172.21.15.150:0/4289984360 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fc1f407a0f0 0x7fc1f407c600 unknown :-1 s=CLOSED pgs=478 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:49:05.774 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:05.771+0000 7fc20e5f1640 1 --2- 172.21.15.150:0/4289984360 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc2080d5150 0x7fc2080cdfb0 unknown :-1 s=CLOSED pgs=1113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:49:05.774 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:05.771+0000 7fc20e5f1640 1 --2- 172.21.15.150:0/4289984360 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc20806dea0 0x7fc20815bfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:49:05.774 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:05.771+0000 7fc20e5f1640 1 -- 172.21.15.150:0/4289984360 >> 172.21.15.150:0/4289984360 conn(0x7fc20808bfe0 msgr2=0x7fc2080b88a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:49:05.774 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:05.771+0000 7fc20e5f1640 1 -- 172.21.15.150:0/4289984360 shutdown_connections 2024-09-17T05:49:05.774 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:05.771+0000 7fc20e5f1640 1 -- 172.21.15.150:0/4289984360 wait complete. 2024-09-17T05:49:05.786 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume snapshot clone cephfs sv1 ss1 subvol_clone818314 2024-09-17T05:49:05.926 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:05.924+0000 7fc032a4d640 1 -- 172.21.15.150:0/2938865825 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc02c0b7d70 msgr2=0x7fc02c0d0a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:49:05.926 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:05.924+0000 7fc032a4d640 1 --2- 172.21.15.150:0/2938865825 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc02c0b7d70 0x7fc02c0d0a80 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fc020009830 tx=0x7fc02002a3f0 comp rx=0 tx=0).stop 2024-09-17T05:49:05.927 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:05.924+0000 7fc032a4d640 1 -- 172.21.15.150:0/2938865825 shutdown_connections 2024-09-17T05:49:05.927 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:05.924+0000 7fc032a4d640 1 --2- 172.21.15.150:0/2938865825 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc02c0b7d70 0x7fc02c0d0a80 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:49:05.927 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:05.924+0000 7fc032a4d640 1 --2- 172.21.15.150:0/2938865825 >> v2:172.21.15.176:3300/0 conn(0x7fc02c0b7960 0x7fc02c0af1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:49:05.927 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:05.924+0000 7fc032a4d640 1 -- 172.21.15.150:0/2938865825 >> 172.21.15.150:0/2938865825 conn(0x7fc02c0cef20 msgr2=0x7fc02c0cf330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:49:05.927 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:05.924+0000 7fc032a4d640 1 -- 172.21.15.150:0/2938865825 shutdown_connections 2024-09-17T05:49:05.927 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:05.924+0000 7fc032a4d640 1 -- 172.21.15.150:0/2938865825 wait complete. 2024-09-17T05:49:05.927 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:05.926+0000 7fc032a4d640 1 Processor -- start 2024-09-17T05:49:05.928 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:05.926+0000 7fc032a4d640 1 -- start start 2024-09-17T05:49:05.930 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:05.927+0000 7fc032a4d640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc02c0af730 0x7fc02c15f240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:49:05.930 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:05.928+0000 7fc032a4d640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc02c0b7960 0x7fc02c155e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:49:05.931 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:05.928+0000 7fc032a4d640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc02c0b7d70 0x7fc02c1563c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:49:05.931 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:05.928+0000 7fc032a4d640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7fc02c0ced10 con 0x7fc02c0b7d70 2024-09-17T05:49:05.931 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:05.928+0000 7fc032a4d640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fc02c0ceb90 con 0x7fc02c0b7960 2024-09-17T05:49:05.931 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:05.928+0000 7fc032a4d640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fc02c0d0fc0 con 0x7fc02c0af730 2024-09-17T05:49:05.931 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:05.928+0000 7fc030fea640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc02c0b7d70 0x7fc02c1563c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:49:05.931 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:05.928+0000 7fc02bfff640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc02c0af730 0x7fc02c15f240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:49:05.931 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:05.928+0000 7fc02bfff640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc02c0af730 0x7fc02c15f240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3301/0 says I am v2:172.21.15.150:45202/0 (socket says 172.21.15.150:45202) 2024-09-17T05:49:05.931 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:05.928+0000 7fc02bfff640 1 -- 172.21.15.150:0/3360115799 learned_addr learned my addr 172.21.15.150:0/3360115799 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:49:05.931 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:05.928+0000 7fc030fea640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc02c0b7d70 0x7fc02c1563c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:49852/0 (socket says 172.21.15.150:49852) 2024-09-17T05:49:05.931 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:05.928+0000 7fc02b7fe640 1 --2- 172.21.15.150:0/3360115799 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc02c0b7960 0x7fc02c155e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:49:05.931 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:05.928+0000 7fc030fea640 1 -- 172.21.15.150:0/3360115799 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc02c0af730 msgr2=0x7fc02c15f240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:49:05.931 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:05.928+0000 7fc030fea640 1 --2- 172.21.15.150:0/3360115799 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc02c0af730 0x7fc02c15f240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:49:05.931 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:05.928+0000 7fc030fea640 1 -- 172.21.15.150:0/3360115799 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc02c0b7960 msgr2=0x7fc02c155e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:49:05.932 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:05.928+0000 7fc030fea640 1 --2- 172.21.15.150:0/3360115799 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc02c0b7960 0x7fc02c155e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:49:05.932 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:05.928+0000 7fc030fea640 1 -- 172.21.15.150:0/3360115799 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc02c1541d0 con 0x7fc02c0b7d70 2024-09-17T05:49:05.932 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:05.928+0000 7fc02bfff640 1 --2- 172.21.15.150:0/3360115799 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc02c0af730 0x7fc02c15f240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T05:49:05.932 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:05.928+0000 7fc030fea640 1 --2- 172.21.15.150:0/3360115799 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc02c0b7d70 0x7fc02c1563c0 secure :-1 s=READY pgs=1115 cs=0 l=1 rev1=1 crypto rx=0x7fc02400ca70 tx=0x7fc02400cf30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:49:05.932 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:05.928+0000 7fc028ff9640 1 -- 172.21.15.150:0/3360115799 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc024016020 con 0x7fc02c0b7d70 2024-09-17T05:49:05.932 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:05.928+0000 7fc028ff9640 1 -- 172.21.15.150:0/3360115799 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc02400ac80 con 0x7fc02c0b7d70 2024-09-17T05:49:05.932 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:05.928+0000 7fc028ff9640 1 -- 172.21.15.150:0/3360115799 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc024012680 con 0x7fc02c0b7d70 2024-09-17T05:49:05.932 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:05.928+0000 7fc032a4d640 1 -- 172.21.15.150:0/3360115799 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc02c1544b0 con 0x7fc02c0b7d70 2024-09-17T05:49:05.932 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:05.928+0000 7fc032a4d640 1 -- 172.21.15.150:0/3360115799 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc02c154a70 con 0x7fc02c0b7d70 2024-09-17T05:49:05.933 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:05.930+0000 7fc032a4d640 1 -- 172.21.15.150:0/3360115799 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc02c0d1450 con 0x7fc02c0b7d70 2024-09-17T05:49:05.933 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:05.930+0000 7fc028ff9640 1 -- 172.21.15.150:0/3360115799 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 29) ==== 103379+0+0 (secure 0 0 0) 0x7fc024019020 con 0x7fc02c0b7d70 2024-09-17T05:49:05.933 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:05.931+0000 7fc028ff9640 1 --2- 172.21.15.150:0/3360115799 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fc01807a0f0 0x7fc01807c600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:49:05.933 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:05.931+0000 7fc028ff9640 1 -- 172.21.15.150:0/3360115799 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 5822+0+0 (secure 0 0 0) 0x7fc02409a240 con 0x7fc02c0b7d70 2024-09-17T05:49:05.933 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:05.931+0000 7fc02bfff640 1 --2- 172.21.15.150:0/3360115799 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fc01807a0f0 0x7fc01807c600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:49:05.933 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:05.931+0000 7fc02bfff640 1 --2- 172.21.15.150:0/3360115799 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fc01807a0f0 0x7fc01807c600 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7fc01c009590 tx=0x7fc01c005f30 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:49:05.937 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:05.935+0000 7fc028ff9640 1 -- 172.21.15.150:0/3360115799 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fc024020020 con 0x7fc02c0b7d70 2024-09-17T05:49:06.227 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:06.225+0000 7fc032a4d640 1 -- 172.21.15.150:0/3360115799 --> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] -- mgr_command(tid 0: {"prefix": "fs subvolume snapshot clone", "vol_name": "cephfs", "sub_name": "sv1", "snap_name": "ss1", "target_sub_name": "subvol_clone818314", "target": ["mon-mgr", ""]}) -- 0x7fc02c0b73e0 con 0x7fc01807a0f0 2024-09-17T05:49:07.569 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:07.567+0000 7fc028ff9640 1 -- 172.21.15.150:0/3360115799 <== mgr.4108 v2:172.21.15.176:6800/3631216395 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7fc02c0b73e0 con 0x7fc01807a0f0 2024-09-17T05:49:07.572 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:07.570+0000 7fc032a4d640 1 -- 172.21.15.150:0/3360115799 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fc01807a0f0 msgr2=0x7fc01807c600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:49:07.572 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:07.570+0000 7fc032a4d640 1 --2- 172.21.15.150:0/3360115799 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fc01807a0f0 0x7fc01807c600 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7fc01c009590 tx=0x7fc01c005f30 comp rx=0 tx=0).stop 2024-09-17T05:49:07.572 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:07.570+0000 7fc032a4d640 1 -- 172.21.15.150:0/3360115799 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc02c0b7d70 msgr2=0x7fc02c1563c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:49:07.572 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:07.570+0000 7fc032a4d640 1 --2- 172.21.15.150:0/3360115799 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc02c0b7d70 0x7fc02c1563c0 secure :-1 s=READY pgs=1115 cs=0 l=1 rev1=1 crypto rx=0x7fc02400ca70 tx=0x7fc02400cf30 comp rx=0 tx=0).stop 2024-09-17T05:49:07.572 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:07.570+0000 7fc032a4d640 1 -- 172.21.15.150:0/3360115799 shutdown_connections 2024-09-17T05:49:07.573 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:07.570+0000 7fc032a4d640 1 --2- 172.21.15.150:0/3360115799 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc02c0b7960 0x7fc02c155e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:49:07.573 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:07.570+0000 7fc032a4d640 1 --2- 172.21.15.150:0/3360115799 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fc01807a0f0 0x7fc01807c600 unknown :-1 s=CLOSED pgs=479 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:49:07.573 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:07.570+0000 7fc032a4d640 1 --2- 172.21.15.150:0/3360115799 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc02c0b7d70 0x7fc02c1563c0 unknown :-1 s=CLOSED pgs=1115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:49:07.573 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:07.570+0000 7fc032a4d640 1 --2- 172.21.15.150:0/3360115799 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc02c0af730 0x7fc02c15f240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:49:07.573 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:07.570+0000 7fc032a4d640 1 -- 172.21.15.150:0/3360115799 >> 172.21.15.150:0/3360115799 conn(0x7fc02c0cef20 msgr2=0x7fc02c0b1ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:49:07.573 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:07.570+0000 7fc032a4d640 1 -- 172.21.15.150:0/3360115799 shutdown_connections 2024-09-17T05:49:07.573 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:07.570+0000 7fc032a4d640 1 -- 172.21.15.150:0/3360115799 wait complete. 2024-09-17T05:49:07.595 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume snapshot clone cephfs sv1 ss1 subvol_clone719215 2024-09-17T05:49:07.802 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:07.799+0000 7f11d760a640 1 -- 172.21.15.150:0/1481179156 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f11bc004800 msgr2=0x7f11bc004c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:49:07.802 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:07.799+0000 7f11d760a640 1 --2- 172.21.15.150:0/1481179156 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f11bc004800 0x7f11bc004c10 secure :-1 s=READY pgs=1117 cs=0 l=1 rev1=1 crypto rx=0x7f11c000baf0 tx=0x7f11bc005830 comp rx=0 tx=0).stop 2024-09-17T05:49:07.803 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:07.799+0000 7f11d5ba7640 1 -- 172.21.15.150:0/1481179156 reap_dead start 2024-09-17T05:49:07.803 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:07.799+0000 7f11d760a640 1 -- 172.21.15.150:0/1481179156 shutdown_connections 2024-09-17T05:49:07.803 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:07.799+0000 7f11d760a640 1 -- 172.21.15.150:0/1481179156 >> 172.21.15.150:0/1481179156 conn(0x7f11d006d1c0 msgr2=0x7f11d006d5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:49:07.803 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:07.799+0000 7f11d760a640 1 -- 172.21.15.150:0/1481179156 shutdown_connections 2024-09-17T05:49:07.803 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:07.799+0000 7f11d760a640 1 -- 172.21.15.150:0/1481179156 wait complete. 2024-09-17T05:49:07.804 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:07.802+0000 7f11d760a640 1 Processor -- start 2024-09-17T05:49:07.804 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:07.802+0000 7f11d760a640 1 -- start start 2024-09-17T05:49:07.806 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:07.803+0000 7f11d760a640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f11d01433a0 0x7f11d01f6f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:49:07.806 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:07.804+0000 7f11d760a640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f11d01549e0 0x7f11d01f7480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:49:07.806 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:07.804+0000 7f11d760a640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f11d0152180 0x7f11d01423c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:49:07.806 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:07.804+0000 7f11d760a640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f11d00b3cf0 con 0x7f11d01549e0 2024-09-17T05:49:07.806 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:07.804+0000 7f11d760a640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f11d00b3b70 con 0x7f11d01433a0 2024-09-17T05:49:07.806 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:07.804+0000 7f11d760a640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f11d00735c0 con 0x7f11d0152180 2024-09-17T05:49:07.807 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:07.804+0000 7f11d4ba5640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f11d01549e0 0x7f11d01f7480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:49:07.807 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:07.804+0000 7f11d4ba5640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f11d01549e0 0x7f11d01f7480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:49858/0 (socket says 172.21.15.150:49858) 2024-09-17T05:49:07.807 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:07.804+0000 7f11d4ba5640 1 -- 172.21.15.150:0/137154520 learned_addr learned my addr 172.21.15.150:0/137154520 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:49:07.807 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:07.804+0000 7f11d4ba5640 1 -- 172.21.15.150:0/137154520 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f11d0152180 msgr2=0x7f11d01423c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:49:07.807 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:07.804+0000 7f11d4ba5640 1 --2- 172.21.15.150:0/137154520 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f11d0152180 0x7f11d01423c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:49:07.807 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:07.804+0000 7f11d4ba5640 1 -- 172.21.15.150:0/137154520 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f11d01433a0 msgr2=0x7f11d01f6f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:49:07.807 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:07.804+0000 7f11d4ba5640 1 --2- 172.21.15.150:0/137154520 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f11d01433a0 0x7f11d01f6f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:49:07.807 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:07.804+0000 7f11d4ba5640 1 -- 172.21.15.150:0/137154520 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f11d0154f60 con 0x7f11d01549e0 2024-09-17T05:49:07.807 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:07.804+0000 7f11d4ba5640 1 --2- 172.21.15.150:0/137154520 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f11d01549e0 0x7f11d01f7480 secure :-1 s=READY pgs=1118 cs=0 l=1 rev1=1 crypto rx=0x7f11c000baf0 tx=0x7f11c0031f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:49:07.808 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:07.805+0000 7f11c5ffb640 1 -- 172.21.15.150:0/137154520 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11c0040070 con 0x7f11d01549e0 2024-09-17T05:49:07.808 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:07.805+0000 7f11d760a640 1 -- 172.21.15.150:0/137154520 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f11d01418e0 con 0x7f11d01549e0 2024-09-17T05:49:07.808 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:07.805+0000 7f11c5ffb640 1 -- 172.21.15.150:0/137154520 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f11c0004030 con 0x7f11d01549e0 2024-09-17T05:49:07.808 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:07.805+0000 7f11c5ffb640 1 -- 172.21.15.150:0/137154520 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11c0035040 con 0x7f11d01549e0 2024-09-17T05:49:07.808 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:07.805+0000 7f11d760a640 1 -- 172.21.15.150:0/137154520 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f11d0155240 con 0x7f11d01549e0 2024-09-17T05:49:07.808 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:07.806+0000 7f11d760a640 1 -- 172.21.15.150:0/137154520 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f11d0073b20 con 0x7f11d01549e0 2024-09-17T05:49:07.809 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:07.807+0000 7f11c5ffb640 1 -- 172.21.15.150:0/137154520 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 29) ==== 103379+0+0 (secure 0 0 0) 0x7f11c0038020 con 0x7f11d01549e0 2024-09-17T05:49:07.810 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:07.808+0000 7f11c5ffb640 1 --2- 172.21.15.150:0/137154520 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f11b407a0f0 0x7f11b407c600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:49:07.810 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:07.808+0000 7f11c5ffb640 1 -- 172.21.15.150:0/137154520 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 5822+0+0 (secure 0 0 0) 0x7f11c00baab0 con 0x7f11d01549e0 2024-09-17T05:49:07.814 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:07.813+0000 7f11c5ffb640 1 -- 172.21.15.150:0/137154520 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f11c00845b0 con 0x7f11d01549e0 2024-09-17T05:49:07.824 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:07.822+0000 7f11d53a6640 1 --2- 172.21.15.150:0/137154520 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f11b407a0f0 0x7f11b407c600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:49:07.907 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:07.905+0000 7f11d53a6640 1 --2- 172.21.15.150:0/137154520 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f11b407a0f0 0x7f11b407c600 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f11cc000fd0 tx=0x7f11cc0015e0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:49:08.136 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:08.135+0000 7f11d760a640 1 -- 172.21.15.150:0/137154520 --> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] -- mgr_command(tid 0: {"prefix": "fs subvolume snapshot clone", "vol_name": "cephfs", "sub_name": "sv1", "snap_name": "ss1", "target_sub_name": "subvol_clone719215", "target": ["mon-mgr", ""]}) -- 0x7f11d0146910 con 0x7f11b407a0f0 2024-09-17T05:49:09.631 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:09.629+0000 7f11c5ffb640 1 -- 172.21.15.150:0/137154520 <== mgr.4108 v2:172.21.15.176:6800/3631216395 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f11d0146910 con 0x7f11b407a0f0 2024-09-17T05:49:09.637 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:09.634+0000 7f11d760a640 1 -- 172.21.15.150:0/137154520 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f11b407a0f0 msgr2=0x7f11b407c600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:49:09.637 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:09.634+0000 7f11d760a640 1 --2- 172.21.15.150:0/137154520 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f11b407a0f0 0x7f11b407c600 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f11cc000fd0 tx=0x7f11cc0015e0 comp rx=0 tx=0).stop 2024-09-17T05:49:09.637 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:09.634+0000 7f11d760a640 1 -- 172.21.15.150:0/137154520 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f11d01549e0 msgr2=0x7f11d01f7480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:49:09.637 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:09.634+0000 7f11d760a640 1 --2- 172.21.15.150:0/137154520 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f11d01549e0 0x7f11d01f7480 secure :-1 s=READY pgs=1118 cs=0 l=1 rev1=1 crypto rx=0x7f11c000baf0 tx=0x7f11c0031f60 comp rx=0 tx=0).stop 2024-09-17T05:49:09.637 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:09.634+0000 7f11d760a640 1 -- 172.21.15.150:0/137154520 shutdown_connections 2024-09-17T05:49:09.637 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:09.634+0000 7f11d760a640 1 --2- 172.21.15.150:0/137154520 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f11b407a0f0 0x7f11b407c600 unknown :-1 s=CLOSED pgs=480 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:49:09.637 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:09.634+0000 7f11d760a640 1 --2- 172.21.15.150:0/137154520 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f11d0152180 0x7f11d01423c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:49:09.637 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:09.634+0000 7f11d760a640 1 --2- 172.21.15.150:0/137154520 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f11d01549e0 0x7f11d01f7480 unknown :-1 s=CLOSED pgs=1118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:49:09.637 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:09.634+0000 7f11d760a640 1 --2- 172.21.15.150:0/137154520 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f11d01433a0 0x7f11d01f6f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:49:09.638 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:09.634+0000 7f11d760a640 1 -- 172.21.15.150:0/137154520 >> 172.21.15.150:0/137154520 conn(0x7f11d006d1c0 msgr2=0x7f11d015b250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:49:09.638 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:09.634+0000 7f11d760a640 1 -- 172.21.15.150:0/137154520 shutdown_connections 2024-09-17T05:49:09.638 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:09.634+0000 7f11d760a640 1 -- 172.21.15.150:0/137154520 wait complete. 2024-09-17T05:49:09.662 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume snapshot clone cephfs sv1 ss1 subvol_clone748216 2024-09-17T05:49:09.844 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:09.842+0000 7fce5affd640 1 -- 172.21.15.150:0/682049720 <== mon.2 v2:172.21.15.176:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce4c0047a0 con 0x7fce5c0af160 2024-09-17T05:49:09.845 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:09.843+0000 7fce62a12640 1 -- 172.21.15.150:0/682049720 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fce5c0af160 msgr2=0x7fce5c0af570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:49:09.845 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:09.843+0000 7fce62a12640 1 --2- 172.21.15.150:0/682049720 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fce5c0af160 0x7fce5c0af570 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fce4c005fd0 tx=0x7fce4c02a4b0 comp rx=0 tx=0).stop 2024-09-17T05:49:09.845 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:09.843+0000 7fce62a12640 1 -- 172.21.15.150:0/682049720 shutdown_connections 2024-09-17T05:49:09.845 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:09.843+0000 7fce62a12640 1 --2- 172.21.15.150:0/682049720 >> v2:172.21.15.176:3300/0 conn(0x7fce5c0d1090 0x7fce5c0ce8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:49:09.845 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:09.843+0000 7fce62a12640 1 --2- 172.21.15.150:0/682049720 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fce5c0af160 0x7fce5c0af570 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:49:09.845 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:09.843+0000 7fce62a12640 1 -- 172.21.15.150:0/682049720 >> 172.21.15.150:0/682049720 conn(0x7fce5c0cefb0 msgr2=0x7fce5c0cf3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:49:09.845 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:09.843+0000 7fce62a12640 1 -- 172.21.15.150:0/682049720 shutdown_connections 2024-09-17T05:49:09.845 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:09.843+0000 7fce62a12640 1 -- 172.21.15.150:0/682049720 wait complete. 2024-09-17T05:49:09.848 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:09.846+0000 7fce62a12640 1 Processor -- start 2024-09-17T05:49:09.848 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:09.847+0000 7fce62a12640 1 -- start start 2024-09-17T05:49:09.851 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:09.849+0000 7fce62a12640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fce5c0af160 0x7fce5c1f6b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:49:09.851 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:09.849+0000 7fce62a12640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fce5c0ce4c0 0x7fce5c1f7070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:49:09.852 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:09.850+0000 7fce62a12640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fce5c0d1090 0x7fce5c0c7070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:49:09.852 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:09.850+0000 7fce5b7fe640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fce5c0ce4c0 0x7fce5c1f7070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:49:09.852 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:09.850+0000 7fce5b7fe640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fce5c0ce4c0 0x7fce5c1f7070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:49862/0 (socket says 172.21.15.150:49862) 2024-09-17T05:49:09.852 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:09.850+0000 7fce62a12640 1 -- 172.21.15.150:0/4032070158 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7fce5c0b18e0 con 0x7fce5c0ce4c0 2024-09-17T05:49:09.852 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:09.850+0000 7fce5b7fe640 1 -- 172.21.15.150:0/4032070158 learned_addr learned my addr 172.21.15.150:0/4032070158 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:49:09.852 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:09.850+0000 7fce62a12640 1 -- 172.21.15.150:0/4032070158 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fce5c0b1760 con 0x7fce5c0d1090 2024-09-17T05:49:09.852 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:09.850+0000 7fce62a12640 1 -- 172.21.15.150:0/4032070158 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fce5c0cd040 con 0x7fce5c0af160 2024-09-17T05:49:09.852 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:09.850+0000 7fce5bfff640 1 --2- 172.21.15.150:0/4032070158 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fce5c0af160 0x7fce5c1f6b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:49:09.853 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:09.851+0000 7fce5b7fe640 1 -- 172.21.15.150:0/4032070158 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fce5c0af160 msgr2=0x7fce5c1f6b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:49:09.853 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:09.851+0000 7fce5b7fe640 1 --2- 172.21.15.150:0/4032070158 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fce5c0af160 0x7fce5c1f6b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:49:09.853 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:09.851+0000 7fce5b7fe640 1 -- 172.21.15.150:0/4032070158 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fce5c0d1090 msgr2=0x7fce5c0c7070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:49:09.853 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:09.851+0000 7fce5b7fe640 1 --2- 172.21.15.150:0/4032070158 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fce5c0d1090 0x7fce5c0c7070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:49:09.853 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:09.851+0000 7fce5b7fe640 1 -- 172.21.15.150:0/4032070158 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fce5c09f5b0 con 0x7fce5c0ce4c0 2024-09-17T05:49:09.853 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:09.851+0000 7fce5b7fe640 1 --2- 172.21.15.150:0/4032070158 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fce5c0ce4c0 0x7fce5c1f7070 secure :-1 s=READY pgs=1119 cs=0 l=1 rev1=1 crypto rx=0x7fce5000c3a0 tx=0x7fce5000c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:49:09.853 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:09.851+0000 7fce58ff9640 1 -- 172.21.15.150:0/4032070158 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce50017070 con 0x7fce5c0ce4c0 2024-09-17T05:49:09.854 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:09.851+0000 7fce58ff9640 1 -- 172.21.15.150:0/4032070158 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fce500053c0 con 0x7fce5c0ce4c0 2024-09-17T05:49:09.854 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:09.851+0000 7fce62a12640 1 -- 172.21.15.150:0/4032070158 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fce5c09f890 con 0x7fce5c0ce4c0 2024-09-17T05:49:09.854 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:09.851+0000 7fce58ff9640 1 -- 172.21.15.150:0/4032070158 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce50003850 con 0x7fce5c0ce4c0 2024-09-17T05:49:09.854 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:09.851+0000 7fce62a12640 1 -- 172.21.15.150:0/4032070158 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fce5c09fe50 con 0x7fce5c0ce4c0 2024-09-17T05:49:09.854 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:09.853+0000 7fce62a12640 1 -- 172.21.15.150:0/4032070158 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fce5c09f320 con 0x7fce5c0ce4c0 2024-09-17T05:49:09.855 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:09.853+0000 7fce58ff9640 1 -- 172.21.15.150:0/4032070158 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 29) ==== 103379+0+0 (secure 0 0 0) 0x7fce5001a070 con 0x7fce5c0ce4c0 2024-09-17T05:49:09.855 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:09.854+0000 7fce58ff9640 1 --2- 172.21.15.150:0/4032070158 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fce4807a0f0 0x7fce4807c600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:49:09.856 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:09.854+0000 7fce58ff9640 1 -- 172.21.15.150:0/4032070158 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 5822+0+0 (secure 0 0 0) 0x7fce50099150 con 0x7fce5c0ce4c0 2024-09-17T05:49:09.860 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:09.859+0000 7fce5bfff640 1 --2- 172.21.15.150:0/4032070158 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fce4807a0f0 0x7fce4807c600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:49:09.861 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:09.860+0000 7fce58ff9640 1 -- 172.21.15.150:0/4032070158 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fce50062600 con 0x7fce5c0ce4c0 2024-09-17T05:49:09.898 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:09.896+0000 7fce5bfff640 1 --2- 172.21.15.150:0/4032070158 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fce4807a0f0 0x7fce4807c600 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7fce4c033000 tx=0x7fce4c004730 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:49:10.164 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:10.162+0000 7fce62a12640 1 -- 172.21.15.150:0/4032070158 --> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] -- mgr_command(tid 0: {"prefix": "fs subvolume snapshot clone", "vol_name": "cephfs", "sub_name": "sv1", "snap_name": "ss1", "target_sub_name": "subvol_clone748216", "target": ["mon-mgr", ""]}) -- 0x7fce5c0af570 con 0x7fce4807a0f0 2024-09-17T05:49:11.668 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:11.667+0000 7fce58ff9640 1 -- 172.21.15.150:0/4032070158 <== mgr.4108 v2:172.21.15.176:6800/3631216395 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7fce5c0af570 con 0x7fce4807a0f0 2024-09-17T05:49:11.674 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:11.673+0000 7fce62a12640 1 -- 172.21.15.150:0/4032070158 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fce4807a0f0 msgr2=0x7fce4807c600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:49:11.675 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:11.673+0000 7fce62a12640 1 --2- 172.21.15.150:0/4032070158 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fce4807a0f0 0x7fce4807c600 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7fce4c033000 tx=0x7fce4c004730 comp rx=0 tx=0).stop 2024-09-17T05:49:11.675 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:11.673+0000 7fce62a12640 1 -- 172.21.15.150:0/4032070158 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fce5c0ce4c0 msgr2=0x7fce5c1f7070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:49:11.675 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:11.673+0000 7fce62a12640 1 --2- 172.21.15.150:0/4032070158 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fce5c0ce4c0 0x7fce5c1f7070 secure :-1 s=READY pgs=1119 cs=0 l=1 rev1=1 crypto rx=0x7fce5000c3a0 tx=0x7fce5000c860 comp rx=0 tx=0).stop 2024-09-17T05:49:11.676 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:11.673+0000 7fce62a12640 1 -- 172.21.15.150:0/4032070158 shutdown_connections 2024-09-17T05:49:11.676 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:11.673+0000 7fce62a12640 1 --2- 172.21.15.150:0/4032070158 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fce5c0d1090 0x7fce5c0c7070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:49:11.676 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:11.673+0000 7fce62a12640 1 --2- 172.21.15.150:0/4032070158 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fce4807a0f0 0x7fce4807c600 unknown :-1 s=CLOSED pgs=481 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:49:11.676 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:11.673+0000 7fce62a12640 1 --2- 172.21.15.150:0/4032070158 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fce5c0ce4c0 0x7fce5c1f7070 unknown :-1 s=CLOSED pgs=1119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:49:11.676 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:11.673+0000 7fce62a12640 1 --2- 172.21.15.150:0/4032070158 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fce5c0af160 0x7fce5c1f6b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:49:11.676 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:11.673+0000 7fce62a12640 1 -- 172.21.15.150:0/4032070158 >> 172.21.15.150:0/4032070158 conn(0x7fce5c0cefb0 msgr2=0x7fce5c072a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:49:11.676 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:11.674+0000 7fce62a12640 1 -- 172.21.15.150:0/4032070158 shutdown_connections 2024-09-17T05:49:11.676 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:11.674+0000 7fce62a12640 1 -- 172.21.15.150:0/4032070158 wait complete. 2024-09-17T05:49:11.702 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume snapshot clone cephfs sv1 ss1 subvol_clone126017 2024-09-17T05:49:11.895 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:11.892+0000 7fad5df4a640 1 -- 172.21.15.150:0/278666168 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fad580b2a00 msgr2=0x7fad5815faf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:49:11.895 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:11.892+0000 7fad5df4a640 1 --2- 172.21.15.150:0/278666168 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fad580b2a00 0x7fad5815faf0 secure :-1 s=READY pgs=1120 cs=0 l=1 rev1=1 crypto rx=0x7fad4c005fd0 tx=0x7fad4c02a4a0 comp rx=0 tx=0).stop 2024-09-17T05:49:11.895 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:11.892+0000 7fad5df4a640 1 -- 172.21.15.150:0/278666168 shutdown_connections 2024-09-17T05:49:11.895 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:11.892+0000 7fad5df4a640 1 --2- 172.21.15.150:0/278666168 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fad580b2a00 0x7fad5815faf0 unknown :-1 s=CLOSED pgs=1120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:49:11.895 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:11.892+0000 7fad5df4a640 1 --2- 172.21.15.150:0/278666168 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fad580b6550 0x7fad580b24c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:49:11.895 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:11.892+0000 7fad5df4a640 1 -- 172.21.15.150:0/278666168 >> 172.21.15.150:0/278666168 conn(0x7fad580b2e80 msgr2=0x7fad580b3290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:49:11.895 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:11.893+0000 7fad5df4a640 1 -- 172.21.15.150:0/278666168 shutdown_connections 2024-09-17T05:49:11.895 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:11.893+0000 7fad5df4a640 1 -- 172.21.15.150:0/278666168 wait complete. 2024-09-17T05:49:11.898 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:11.896+0000 7fad5df4a640 1 Processor -- start 2024-09-17T05:49:11.898 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:11.896+0000 7fad5df4a640 1 -- start start 2024-09-17T05:49:11.900 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:11.898+0000 7fad5df4a640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fad580b2a00 0x7fad5815d870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:49:11.900 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:11.898+0000 7fad5df4a640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fad580b6550 0x7fad58158240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:49:11.900 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:11.898+0000 7fad5df4a640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fad58160030 0x7fad581f7280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:49:11.900 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:11.898+0000 7fad5df4a640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7fad58160440 con 0x7fad580b6550 2024-09-17T05:49:11.901 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:11.898+0000 7fad5df4a640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fad581605c0 con 0x7fad58160030 2024-09-17T05:49:11.901 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:11.898+0000 7fad5df4a640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fad58160740 con 0x7fad580b2a00 2024-09-17T05:49:11.901 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:11.898+0000 7fad56ffd640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fad580b6550 0x7fad58158240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:49:11.901 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:11.898+0000 7fad56ffd640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fad580b6550 0x7fad58158240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:46078/0 (socket says 172.21.15.150:46078) 2024-09-17T05:49:11.901 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:11.898+0000 7fad56ffd640 1 -- 172.21.15.150:0/4033980716 learned_addr learned my addr 172.21.15.150:0/4033980716 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:49:11.901 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:11.898+0000 7fad56ffd640 1 -- 172.21.15.150:0/4033980716 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fad580b2a00 msgr2=0x7fad5815d870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:49:11.901 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:11.898+0000 7fad56ffd640 1 --2- 172.21.15.150:0/4033980716 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fad580b2a00 0x7fad5815d870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:49:11.901 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:11.898+0000 7fad56ffd640 1 -- 172.21.15.150:0/4033980716 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fad58160030 msgr2=0x7fad581f7280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:49:11.901 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:11.898+0000 7fad56ffd640 1 --2- 172.21.15.150:0/4033980716 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fad58160030 0x7fad581f7280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:49:11.901 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:11.898+0000 7fad56ffd640 1 -- 172.21.15.150:0/4033980716 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fad5815e0e0 con 0x7fad580b6550 2024-09-17T05:49:11.901 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:11.899+0000 7fad56ffd640 1 --2- 172.21.15.150:0/4033980716 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fad580b6550 0x7fad58158240 secure :-1 s=READY pgs=1121 cs=0 l=1 rev1=1 crypto rx=0x7fad4c034040 tx=0x7fad4c0039e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:49:11.902 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:11.899+0000 7fad3ffff640 1 -- 172.21.15.150:0/4033980716 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad4c03e030 con 0x7fad580b6550 2024-09-17T05:49:11.902 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:11.899+0000 7fad3ffff640 1 -- 172.21.15.150:0/4033980716 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fad4c0047a0 con 0x7fad580b6550 2024-09-17T05:49:11.902 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:11.899+0000 7fad3ffff640 1 -- 172.21.15.150:0/4033980716 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad4c035040 con 0x7fad580b6550 2024-09-17T05:49:11.902 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:11.899+0000 7fad5df4a640 1 -- 172.21.15.150:0/4033980716 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fad5815e3c0 con 0x7fad580b6550 2024-09-17T05:49:11.902 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:11.900+0000 7fad5df4a640 1 -- 172.21.15.150:0/4033980716 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fad5815e980 con 0x7fad580b6550 2024-09-17T05:49:11.904 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:11.902+0000 7fad5df4a640 1 -- 172.21.15.150:0/4033980716 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fad580d0f30 con 0x7fad580b6550 2024-09-17T05:49:11.904 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:11.903+0000 7fad3ffff640 1 -- 172.21.15.150:0/4033980716 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 29) ==== 103379+0+0 (secure 0 0 0) 0x7fad4c041030 con 0x7fad580b6550 2024-09-17T05:49:11.905 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:11.903+0000 7fad3ffff640 1 --2- 172.21.15.150:0/4033980716 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fad4407a0f0 0x7fad4407c600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:49:11.906 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:11.904+0000 7fad3ffff640 1 -- 172.21.15.150:0/4033980716 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 5822+0+0 (secure 0 0 0) 0x7fad4c0ba740 con 0x7fad580b6550 2024-09-17T05:49:11.907 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:11.905+0000 7fad577fe640 1 --2- 172.21.15.150:0/4033980716 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fad4407a0f0 0x7fad4407c600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:49:11.908 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:11.906+0000 7fad577fe640 1 --2- 172.21.15.150:0/4033980716 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fad4407a0f0 0x7fad4407c600 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7fad48009670 tx=0x7fad48006bf0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:49:11.911 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:11.909+0000 7fad3ffff640 1 -- 172.21.15.150:0/4033980716 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fad580d0f30 con 0x7fad580b6550 2024-09-17T05:49:12.225 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:12.223+0000 7fad5df4a640 1 -- 172.21.15.150:0/4033980716 --> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] -- mgr_command(tid 0: {"prefix": "fs subvolume snapshot clone", "vol_name": "cephfs", "sub_name": "sv1", "snap_name": "ss1", "target_sub_name": "subvol_clone126017", "target": ["mon-mgr", ""]}) -- 0x7fad58074c60 con 0x7fad4407a0f0 2024-09-17T05:49:13.346 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:13.344+0000 7fad3ffff640 1 -- 172.21.15.150:0/4033980716 <== mgr.4108 v2:172.21.15.176:6800/3631216395 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7fad58074c60 con 0x7fad4407a0f0 2024-09-17T05:49:13.352 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:13.350+0000 7fad5df4a640 1 -- 172.21.15.150:0/4033980716 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fad4407a0f0 msgr2=0x7fad4407c600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:49:13.352 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:13.350+0000 7fad5df4a640 1 --2- 172.21.15.150:0/4033980716 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fad4407a0f0 0x7fad4407c600 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7fad48009670 tx=0x7fad48006bf0 comp rx=0 tx=0).stop 2024-09-17T05:49:13.352 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:13.350+0000 7fad5df4a640 1 -- 172.21.15.150:0/4033980716 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fad580b6550 msgr2=0x7fad58158240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:49:13.352 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:13.350+0000 7fad5df4a640 1 --2- 172.21.15.150:0/4033980716 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fad580b6550 0x7fad58158240 secure :-1 s=READY pgs=1121 cs=0 l=1 rev1=1 crypto rx=0x7fad4c034040 tx=0x7fad4c0039e0 comp rx=0 tx=0).stop 2024-09-17T05:49:13.352 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:13.350+0000 7fad5df4a640 1 -- 172.21.15.150:0/4033980716 shutdown_connections 2024-09-17T05:49:13.352 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:13.350+0000 7fad5df4a640 1 --2- 172.21.15.150:0/4033980716 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fad58160030 0x7fad581f7280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:49:13.352 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:13.350+0000 7fad5df4a640 1 --2- 172.21.15.150:0/4033980716 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fad4407a0f0 0x7fad4407c600 unknown :-1 s=CLOSED pgs=482 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:49:13.352 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:13.350+0000 7fad5df4a640 1 --2- 172.21.15.150:0/4033980716 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fad580b6550 0x7fad58158240 unknown :-1 s=CLOSED pgs=1121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:49:13.352 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:13.350+0000 7fad5df4a640 1 --2- 172.21.15.150:0/4033980716 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fad580b2a00 0x7fad5815d870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:49:13.353 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:13.350+0000 7fad5df4a640 1 -- 172.21.15.150:0/4033980716 >> 172.21.15.150:0/4033980716 conn(0x7fad580b2e80 msgr2=0x7fad5815bab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:49:13.353 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:13.350+0000 7fad5df4a640 1 -- 172.21.15.150:0/4033980716 shutdown_connections 2024-09-17T05:49:13.353 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:13.350+0000 7fad5df4a640 1 -- 172.21.15.150:0/4033980716 wait complete. 2024-09-17T05:49:13.384 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume snapshot clone cephfs sv1 ss1 subvol_clone369718 2024-09-17T05:49:13.559 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:13.556+0000 7f591fda8640 1 -- 172.21.15.150:0/3994411211 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f591806e4c0 msgr2=0x7f591815eef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:49:13.559 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:13.556+0000 7f591fda8640 1 --2- 172.21.15.150:0/3994411211 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f591806e4c0 0x7f591815eef0 secure :-1 s=READY pgs=1123 cs=0 l=1 rev1=1 crypto rx=0x7f5910005fd0 tx=0x7f591002a8b0 comp rx=0 tx=0).stop 2024-09-17T05:49:13.559 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:13.557+0000 7f591fda8640 1 -- 172.21.15.150:0/3994411211 shutdown_connections 2024-09-17T05:49:13.559 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:13.557+0000 7f591fda8640 1 --2- 172.21.15.150:0/3994411211 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f591806e4c0 0x7f591815eef0 unknown :-1 s=CLOSED pgs=1123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:49:13.559 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:13.557+0000 7f591fda8640 1 -- 172.21.15.150:0/3994411211 >> 172.21.15.150:0/3994411211 conn(0x7f5918073890 msgr2=0x7f5918073ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:49:13.559 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:13.557+0000 7f591fda8640 1 -- 172.21.15.150:0/3994411211 shutdown_connections 2024-09-17T05:49:13.559 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:13.557+0000 7f591fda8640 1 -- 172.21.15.150:0/3994411211 wait complete. 2024-09-17T05:49:13.561 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:13.559+0000 7f591fda8640 1 Processor -- start 2024-09-17T05:49:13.561 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:13.560+0000 7f591fda8640 1 -- start start 2024-09-17T05:49:13.564 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:13.561+0000 7f591fda8640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f591815c130 0x7f59181508d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:49:13.564 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:13.561+0000 7f591fda8640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f591815eae0 0x7f59181513e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:49:13.564 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:13.561+0000 7f591fda8640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f59181f85b0 0x7f59181f89c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:49:13.564 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:13.561+0000 7f591fda8640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f5918076350 con 0x7f591815c130 2024-09-17T05:49:13.564 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:13.561+0000 7f591fda8640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f59180761d0 con 0x7f59181f85b0 2024-09-17T05:49:13.564 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:13.561+0000 7f591fda8640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f59180b42d0 con 0x7f591815eae0 2024-09-17T05:49:13.564 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:13.561+0000 7f591db44640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f591815c130 0x7f59181508d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:49:13.564 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:13.561+0000 7f591db44640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f591815c130 0x7f59181508d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:46098/0 (socket says 172.21.15.150:46098) 2024-09-17T05:49:13.564 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:13.561+0000 7f591db44640 1 -- 172.21.15.150:0/1574165685 learned_addr learned my addr 172.21.15.150:0/1574165685 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:49:13.564 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:13.561+0000 7f591d343640 1 --2- 172.21.15.150:0/1574165685 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f591815eae0 0x7f59181513e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:49:13.564 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:13.561+0000 7f591e345640 1 --2- 172.21.15.150:0/1574165685 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f59181f85b0 0x7f59181f89c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:49:13.565 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:13.562+0000 7f591db44640 1 -- 172.21.15.150:0/1574165685 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f591815eae0 msgr2=0x7f59181513e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:49:13.565 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:13.562+0000 7f591db44640 1 --2- 172.21.15.150:0/1574165685 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f591815eae0 0x7f59181513e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:49:13.565 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:13.562+0000 7f591db44640 1 -- 172.21.15.150:0/1574165685 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f59181f85b0 msgr2=0x7f59181f89c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:49:13.565 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:13.562+0000 7f591db44640 1 --2- 172.21.15.150:0/1574165685 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f59181f85b0 0x7f59181f89c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:49:13.565 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:13.562+0000 7f591db44640 1 -- 172.21.15.150:0/1574165685 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f59181f8f00 con 0x7f591815c130 2024-09-17T05:49:13.565 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:13.562+0000 7f591db44640 1 --2- 172.21.15.150:0/1574165685 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f591815c130 0x7f59181508d0 secure :-1 s=READY pgs=1124 cs=0 l=1 rev1=1 crypto rx=0x7f591400c460 tx=0x7f591400c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:49:13.566 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:13.562+0000 7f590e7fc640 1 -- 172.21.15.150:0/1574165685 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5914016020 con 0x7f591815c130 2024-09-17T05:49:13.566 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:13.562+0000 7f591fda8640 1 -- 172.21.15.150:0/1574165685 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5918153df0 con 0x7f591815c130 2024-09-17T05:49:13.566 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:13.562+0000 7f590e7fc640 1 -- 172.21.15.150:0/1574165685 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f5914012940 con 0x7f591815c130 2024-09-17T05:49:13.566 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:13.562+0000 7f590e7fc640 1 -- 172.21.15.150:0/1574165685 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5914012d90 con 0x7f591815c130 2024-09-17T05:49:13.566 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:13.563+0000 7f591fda8640 1 -- 172.21.15.150:0/1574165685 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f59181543b0 con 0x7f591815c130 2024-09-17T05:49:13.566 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:13.563+0000 7f591fda8640 1 -- 172.21.15.150:0/1574165685 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f591815eef0 con 0x7f591815c130 2024-09-17T05:49:13.566 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:13.564+0000 7f590e7fc640 1 -- 172.21.15.150:0/1574165685 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 29) ==== 103379+0+0 (secure 0 0 0) 0x7f5914019020 con 0x7f591815c130 2024-09-17T05:49:13.567 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:13.565+0000 7f590e7fc640 1 --2- 172.21.15.150:0/1574165685 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f58fc07a120 0x7f58fc07c630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:49:13.567 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:13.565+0000 7f590e7fc640 1 -- 172.21.15.150:0/1574165685 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 5822+0+0 (secure 0 0 0) 0x7f5914099970 con 0x7f591815c130 2024-09-17T05:49:13.572 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:13.570+0000 7f590e7fc640 1 -- 172.21.15.150:0/1574165685 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f5914020030 con 0x7f591815c130 2024-09-17T05:49:13.593 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:13.591+0000 7f591d343640 1 --2- 172.21.15.150:0/1574165685 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f58fc07a120 0x7f58fc07c630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:49:13.623 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:13.621+0000 7f591d343640 1 --2- 172.21.15.150:0/1574165685 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f58fc07a120 0x7f58fc07c630 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7f59180ca240 tx=0x7f5908009060 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:49:13.863 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:13.861+0000 7f591fda8640 1 -- 172.21.15.150:0/1574165685 --> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] -- mgr_command(tid 0: {"prefix": "fs subvolume snapshot clone", "vol_name": "cephfs", "sub_name": "sv1", "snap_name": "ss1", "target_sub_name": "subvol_clone369718", "target": ["mon-mgr", ""]}) -- 0x7f59181f9400 con 0x7f58fc07a120 2024-09-17T05:49:14.906 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:14.905+0000 7f590e7fc640 1 -- 172.21.15.150:0/1574165685 <== mgr.4108 v2:172.21.15.176:6800/3631216395 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f5908009550 con 0x7f58fc07a120 2024-09-17T05:49:14.909 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:14.908+0000 7f591fda8640 1 -- 172.21.15.150:0/1574165685 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f58fc07a120 msgr2=0x7f58fc07c630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:49:14.909 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:14.908+0000 7f591fda8640 1 --2- 172.21.15.150:0/1574165685 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f58fc07a120 0x7f58fc07c630 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7f59180ca240 tx=0x7f5908009060 comp rx=0 tx=0).stop 2024-09-17T05:49:14.909 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:14.908+0000 7f591fda8640 1 -- 172.21.15.150:0/1574165685 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f591815c130 msgr2=0x7f59181508d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:49:14.909 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:14.908+0000 7f591fda8640 1 --2- 172.21.15.150:0/1574165685 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f591815c130 0x7f59181508d0 secure :-1 s=READY pgs=1124 cs=0 l=1 rev1=1 crypto rx=0x7f591400c460 tx=0x7f591400c920 comp rx=0 tx=0).stop 2024-09-17T05:49:14.909 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:14.908+0000 7f591fda8640 1 -- 172.21.15.150:0/1574165685 shutdown_connections 2024-09-17T05:49:14.909 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:14.908+0000 7f591fda8640 1 --2- 172.21.15.150:0/1574165685 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f59181f85b0 0x7f59181f89c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:49:14.909 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:14.908+0000 7f591fda8640 1 --2- 172.21.15.150:0/1574165685 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f58fc07a120 0x7f58fc07c630 unknown :-1 s=CLOSED pgs=483 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:49:14.909 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:14.908+0000 7f591fda8640 1 --2- 172.21.15.150:0/1574165685 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f591815eae0 0x7f59181513e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:49:14.909 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:14.908+0000 7f591fda8640 1 --2- 172.21.15.150:0/1574165685 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f591815c130 0x7f59181508d0 unknown :-1 s=CLOSED pgs=1124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:49:14.909 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:14.908+0000 7f591fda8640 1 -- 172.21.15.150:0/1574165685 >> 172.21.15.150:0/1574165685 conn(0x7f5918073890 msgr2=0x7f59180cf6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:49:14.909 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:14.908+0000 7f591fda8640 1 -- 172.21.15.150:0/1574165685 shutdown_connections 2024-09-17T05:49:14.909 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:14.908+0000 7f591fda8640 1 -- 172.21.15.150:0/1574165685 wait complete. 2024-09-17T05:49:14.925 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume snapshot clone cephfs sv1 ss1 subvol_clone408019 2024-09-17T05:49:15.116 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:15.115+0000 7fbd040f9640 1 -- 172.21.15.150:0/2383649344 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbcfc06dea0 msgr2=0x7fbcfc0d0020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:49:15.116 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:15.115+0000 7fbd040f9640 1 --2- 172.21.15.150:0/2383649344 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbcfc06dea0 0x7fbcfc0d0020 secure :-1 s=READY pgs=1126 cs=0 l=1 rev1=1 crypto rx=0x7fbcfc0cfd10 tx=0x7fbcec02a510 comp rx=0 tx=0).stop 2024-09-17T05:49:15.116 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:15.115+0000 7fbd040f9640 1 -- 172.21.15.150:0/2383649344 shutdown_connections 2024-09-17T05:49:15.117 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:15.115+0000 7fbd040f9640 1 --2- 172.21.15.150:0/2383649344 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbcfc06dea0 0x7fbcfc0d0020 unknown :-1 s=CLOSED pgs=1126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:49:15.117 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:15.115+0000 7fbd040f9640 1 --2- 172.21.15.150:0/2383649344 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fbcfc0d5150 0x7fbcfc0b9b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:49:15.117 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:15.115+0000 7fbd040f9640 1 -- 172.21.15.150:0/2383649344 >> 172.21.15.150:0/2383649344 conn(0x7fbcfc08bfe0 msgr2=0x7fbcfc0d46e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:49:15.117 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:15.115+0000 7fbd040f9640 1 -- 172.21.15.150:0/2383649344 shutdown_connections 2024-09-17T05:49:15.117 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:15.115+0000 7fbd040f9640 1 -- 172.21.15.150:0/2383649344 wait complete. 2024-09-17T05:49:15.119 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:15.118+0000 7fbd040f9640 1 Processor -- start 2024-09-17T05:49:15.119 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:15.118+0000 7fbd040f9640 1 -- start start 2024-09-17T05:49:15.121 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:15.120+0000 7fbd040f9640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fbcfc06dea0 0x7fbcfc0ce370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:49:15.121 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:15.120+0000 7fbd040f9640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fbcfc06e2b0 0x7fbcfc15ac30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:49:15.121 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:15.120+0000 7fbd040f9640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbcfc0d5150 0x7fbcfc15b170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:49:15.121 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:15.120+0000 7fbd040f9640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7fbcfc0ba1a0 con 0x7fbcfc0d5150 2024-09-17T05:49:15.121 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:15.120+0000 7fbd040f9640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fbcfc0d31e0 con 0x7fbcfc06e2b0 2024-09-17T05:49:15.121 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:15.120+0000 7fbd040f9640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fbcfc0b6870 con 0x7fbcfc06dea0 2024-09-17T05:49:15.121 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:15.120+0000 7fbd02696640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbcfc0d5150 0x7fbcfc15b170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:49:15.121 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:15.120+0000 7fbd02696640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbcfc0d5150 0x7fbcfc15b170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:46116/0 (socket says 172.21.15.150:46116) 2024-09-17T05:49:15.122 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:15.120+0000 7fbd02696640 1 -- 172.21.15.150:0/130783558 learned_addr learned my addr 172.21.15.150:0/130783558 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:49:15.122 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:15.120+0000 7fbd02696640 1 -- 172.21.15.150:0/130783558 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fbcfc06dea0 msgr2=0x7fbcfc0ce370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:49:15.122 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:15.120+0000 7fbd02696640 1 --2- 172.21.15.150:0/130783558 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fbcfc06dea0 0x7fbcfc0ce370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:49:15.122 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:15.120+0000 7fbd02696640 1 -- 172.21.15.150:0/130783558 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fbcfc06e2b0 msgr2=0x7fbcfc15ac30 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-17T05:49:15.122 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:15.120+0000 7fbd02696640 1 --2- 172.21.15.150:0/130783558 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fbcfc06e2b0 0x7fbcfc15ac30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:49:15.122 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:15.120+0000 7fbd02696640 1 -- 172.21.15.150:0/130783558 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbcfc0a1e70 con 0x7fbcfc0d5150 2024-09-17T05:49:15.123 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:15.121+0000 7fbd02696640 1 --2- 172.21.15.150:0/130783558 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbcfc0d5150 0x7fbcfc15b170 secure :-1 s=READY pgs=1127 cs=0 l=1 rev1=1 crypto rx=0x7fbcf400ca80 tx=0x7fbcf400cf40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:49:15.123 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:15.121+0000 7fbcf27fc640 1 -- 172.21.15.150:0/130783558 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbcf4016020 con 0x7fbcfc0d5150 2024-09-17T05:49:15.123 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:15.121+0000 7fbcf27fc640 1 -- 172.21.15.150:0/130783558 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fbcf400acc0 con 0x7fbcfc0d5150 2024-09-17T05:49:15.123 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:15.121+0000 7fbd040f9640 1 -- 172.21.15.150:0/130783558 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbcfc15a150 con 0x7fbcfc0d5150 2024-09-17T05:49:15.123 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:15.121+0000 7fbcf27fc640 1 -- 172.21.15.150:0/130783558 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbcf4012680 con 0x7fbcfc0d5150 2024-09-17T05:49:15.123 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:15.121+0000 7fbd040f9640 1 -- 172.21.15.150:0/130783558 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbcfc15a710 con 0x7fbcfc0d5150 2024-09-17T05:49:15.123 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:15.122+0000 7fbd040f9640 1 -- 172.21.15.150:0/130783558 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbcfc0d0020 con 0x7fbcfc0d5150 2024-09-17T05:49:15.124 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:15.123+0000 7fbcf27fc640 1 -- 172.21.15.150:0/130783558 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 29) ==== 103379+0+0 (secure 0 0 0) 0x7fbcf4019020 con 0x7fbcfc0d5150 2024-09-17T05:49:15.124 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:15.124+0000 7fbcf27fc640 1 --2- 172.21.15.150:0/130783558 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fbce007a0f0 0x7fbce007c600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:49:15.124 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:15.124+0000 7fbcf27fc640 1 -- 172.21.15.150:0/130783558 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 5822+0+0 (secure 0 0 0) 0x7fbcf409a430 con 0x7fbcfc0d5150 2024-09-17T05:49:15.125 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:15.125+0000 7fbd01e95640 1 --2- 172.21.15.150:0/130783558 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fbce007a0f0 0x7fbce007c600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:49:15.131 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:15.130+0000 7fbcf27fc640 1 -- 172.21.15.150:0/130783558 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fbcf4020020 con 0x7fbcfc0d5150 2024-09-17T05:49:15.132 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:15.131+0000 7fbd01e95640 1 --2- 172.21.15.150:0/130783558 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fbce007a0f0 0x7fbce007c600 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7fbcf8005860 tx=0x7fbcf80057f0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:49:15.437 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:15.436+0000 7fbd040f9640 1 -- 172.21.15.150:0/130783558 --> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] -- mgr_command(tid 0: {"prefix": "fs subvolume snapshot clone", "vol_name": "cephfs", "sub_name": "sv1", "snap_name": "ss1", "target_sub_name": "subvol_clone408019", "target": ["mon-mgr", ""]}) -- 0x7fbcfc159d90 con 0x7fbce007a0f0 2024-09-17T05:49:16.747 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:16.747+0000 7fbcf27fc640 1 -- 172.21.15.150:0/130783558 <== mgr.4108 v2:172.21.15.176:6800/3631216395 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7fbcfc159d90 con 0x7fbce007a0f0 2024-09-17T05:49:16.753 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:16.752+0000 7fbd040f9640 1 -- 172.21.15.150:0/130783558 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fbce007a0f0 msgr2=0x7fbce007c600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:49:16.753 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:16.752+0000 7fbd040f9640 1 --2- 172.21.15.150:0/130783558 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fbce007a0f0 0x7fbce007c600 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7fbcf8005860 tx=0x7fbcf80057f0 comp rx=0 tx=0).stop 2024-09-17T05:49:16.753 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:16.752+0000 7fbd040f9640 1 -- 172.21.15.150:0/130783558 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbcfc0d5150 msgr2=0x7fbcfc15b170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:49:16.753 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:16.752+0000 7fbd040f9640 1 --2- 172.21.15.150:0/130783558 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbcfc0d5150 0x7fbcfc15b170 secure :-1 s=READY pgs=1127 cs=0 l=1 rev1=1 crypto rx=0x7fbcf400ca80 tx=0x7fbcf400cf40 comp rx=0 tx=0).stop 2024-09-17T05:49:16.754 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:16.753+0000 7fbd040f9640 1 -- 172.21.15.150:0/130783558 shutdown_connections 2024-09-17T05:49:16.754 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:16.753+0000 7fbd040f9640 1 --2- 172.21.15.150:0/130783558 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fbcfc06e2b0 0x7fbcfc15ac30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:49:16.754 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:16.753+0000 7fbd040f9640 1 --2- 172.21.15.150:0/130783558 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fbce007a0f0 0x7fbce007c600 unknown :-1 s=CLOSED pgs=484 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:49:16.754 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:16.753+0000 7fbd040f9640 1 --2- 172.21.15.150:0/130783558 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbcfc0d5150 0x7fbcfc15b170 unknown :-1 s=CLOSED pgs=1127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:49:16.754 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:16.753+0000 7fbd040f9640 1 --2- 172.21.15.150:0/130783558 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fbcfc06dea0 0x7fbcfc0ce370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:49:16.754 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:16.753+0000 7fbd040f9640 1 -- 172.21.15.150:0/130783558 >> 172.21.15.150:0/130783558 conn(0x7fbcfc08bfe0 msgr2=0x7fbcfc15d060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:49:16.754 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:16.753+0000 7fbd040f9640 1 -- 172.21.15.150:0/130783558 shutdown_connections 2024-09-17T05:49:16.755 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:16.753+0000 7fbd040f9640 1 -- 172.21.15.150:0/130783558 wait complete. 2024-09-17T05:49:18.770 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format json-pretty 2024-09-17T05:49:18.953 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:18.951+0000 7f7029369640 1 -- 172.21.15.150:0/3192012884 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f70240b5d50 msgr2=0x7f70240d2780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:49:18.953 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:18.951+0000 7f7029369640 1 --2- 172.21.15.150:0/3192012884 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f70240b5d50 0x7f70240d2780 secure :-1 s=READY pgs=1129 cs=0 l=1 rev1=1 crypto rx=0x7f7014009830 tx=0x7f701402a510 comp rx=0 tx=0).stop 2024-09-17T05:49:18.953 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:18.952+0000 7f7029369640 1 -- 172.21.15.150:0/3192012884 shutdown_connections 2024-09-17T05:49:18.953 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:18.952+0000 7f7029369640 1 --2- 172.21.15.150:0/3192012884 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f70240d1790 0x7f70240d0400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:49:18.953 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:18.952+0000 7f7029369640 1 --2- 172.21.15.150:0/3192012884 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f70240b5d50 0x7f70240d2780 unknown :-1 s=CLOSED pgs=1129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:49:18.953 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:18.952+0000 7f7029369640 1 -- 172.21.15.150:0/3192012884 >> 172.21.15.150:0/3192012884 conn(0x7f702408bfe0 msgr2=0x7f70240d4670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:49:18.953 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:18.952+0000 7f7029369640 1 -- 172.21.15.150:0/3192012884 shutdown_connections 2024-09-17T05:49:18.953 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:18.952+0000 7f7029369640 1 -- 172.21.15.150:0/3192012884 wait complete. 2024-09-17T05:49:18.955 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:18.954+0000 7f7029369640 1 Processor -- start 2024-09-17T05:49:18.955 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:18.954+0000 7f7029369640 1 -- start start 2024-09-17T05:49:18.957 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:18.955+0000 7f7029369640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f70240b5d50 0x7f7024146b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:49:18.957 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:18.955+0000 7f7029369640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f70240d4f90 0x7f7024153eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:49:18.957 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:18.955+0000 7f7029369640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f702414fa60 0x7f70241543f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:49:18.957 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:18.955+0000 7f7029369640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f70240b7b00 con 0x7f70240d4f90 2024-09-17T05:49:18.957 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:18.955+0000 7f7029369640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f70240b7980 con 0x7f702414fa60 2024-09-17T05:49:18.957 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:18.956+0000 7f7029369640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f70240b7c80 con 0x7f70240b5d50 2024-09-17T05:49:18.958 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:18.956+0000 7f70227fc640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f70240d4f90 0x7f7024153eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:49:18.958 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:18.956+0000 7f70227fc640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f70240d4f90 0x7f7024153eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:46124/0 (socket says 172.21.15.150:46124) 2024-09-17T05:49:18.958 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:18.956+0000 7f70227fc640 1 -- 172.21.15.150:0/235072151 learned_addr learned my addr 172.21.15.150:0/235072151 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:49:18.958 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:18.956+0000 7f70227fc640 1 -- 172.21.15.150:0/235072151 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f70240b5d50 msgr2=0x7f7024146b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:49:18.958 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:18.956+0000 7f70227fc640 1 --2- 172.21.15.150:0/235072151 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f70240b5d50 0x7f7024146b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:49:18.958 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:18.956+0000 7f70227fc640 1 -- 172.21.15.150:0/235072151 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f702414fa60 msgr2=0x7f70241543f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:49:18.958 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:18.956+0000 7f70227fc640 1 --2- 172.21.15.150:0/235072151 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f702414fa60 0x7f70241543f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:49:18.958 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:18.956+0000 7f70227fc640 1 -- 172.21.15.150:0/235072151 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f70241f9cd0 con 0x7f70240d4f90 2024-09-17T05:49:18.959 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:18.956+0000 7f70227fc640 1 --2- 172.21.15.150:0/235072151 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f70240d4f90 0x7f7024153eb0 secure :-1 s=READY pgs=1130 cs=0 l=1 rev1=1 crypto rx=0x7f701800c3a0 tx=0x7f701800c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:49:18.959 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:18.956+0000 7f700b7fe640 1 -- 172.21.15.150:0/235072151 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7018011790 con 0x7f70240d4f90 2024-09-17T05:49:18.959 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:18.956+0000 7f700b7fe640 1 -- 172.21.15.150:0/235072151 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f7018017070 con 0x7f70240d4f90 2024-09-17T05:49:18.959 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:18.956+0000 7f700b7fe640 1 -- 172.21.15.150:0/235072151 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7018011cc0 con 0x7f70240d4f90 2024-09-17T05:49:18.959 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:18.956+0000 7f7029369640 1 -- 172.21.15.150:0/235072151 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f70241f9f70 con 0x7f70240d4f90 2024-09-17T05:49:18.959 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:18.957+0000 7f7029369640 1 -- 172.21.15.150:0/235072151 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7024157b30 con 0x7f70240d4f90 2024-09-17T05:49:18.960 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:18.958+0000 7f7029369640 1 -- 172.21.15.150:0/235072151 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7024157e10 con 0x7f70240d4f90 2024-09-17T05:49:18.960 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:18.959+0000 7f700b7fe640 1 -- 172.21.15.150:0/235072151 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 29) ==== 103379+0+0 (secure 0 0 0) 0x7f701801c460 con 0x7f70240d4f90 2024-09-17T05:49:18.960 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:18.959+0000 7f700b7fe640 1 --2- 172.21.15.150:0/235072151 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f701007a0f0 0x7f701007c600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:49:18.960 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:18.959+0000 7f700b7fe640 1 -- 172.21.15.150:0/235072151 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 5822+0+0 (secure 0 0 0) 0x7f7018099b90 con 0x7f70240d4f90 2024-09-17T05:49:18.964 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:18.964+0000 7f700b7fe640 1 -- 172.21.15.150:0/235072151 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f7018063710 con 0x7f70240d4f90 2024-09-17T05:49:18.968 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:18.968+0000 7f7022ffd640 1 --2- 172.21.15.150:0/235072151 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f701007a0f0 0x7f701007c600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:49:18.986 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:18.986+0000 7f7022ffd640 1 --2- 172.21.15.150:0/235072151 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f701007a0f0 0x7f701007c600 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7f7014034000 tx=0x7f70140046c0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:49:19.353 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:19.352+0000 7f7029369640 1 -- 172.21.15.150:0/235072151 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) -- 0x7f70240d2780 con 0x7f70240d4f90 2024-09-17T05:49:19.353 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:19.353+0000 7f700b7fe640 1 -- 172.21.15.150:0/235072151 <== mon.0 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) ==== 79+0+2406 (secure 0 0 0) 0x7f7018063010 con 0x7f70240d4f90 2024-09-17T05:49:19.353 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-09-17T05:49:19.354 INFO:teuthology.orchestra.run.smithi150.stdout:{ 2024-09-17T05:49:19.354 INFO:teuthology.orchestra.run.smithi150.stdout: "fsid": "9f2e05e9-d629-47b3-b26b-1360655b7d20", 2024-09-17T05:49:19.354 INFO:teuthology.orchestra.run.smithi150.stdout: "health": { 2024-09-17T05:49:19.354 INFO:teuthology.orchestra.run.smithi150.stdout: "status": "HEALTH_OK", 2024-09-17T05:49:19.354 INFO:teuthology.orchestra.run.smithi150.stdout: "checks": {}, 2024-09-17T05:49:19.354 INFO:teuthology.orchestra.run.smithi150.stdout: "mutes": [] 2024-09-17T05:49:19.354 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-17T05:49:19.354 INFO:teuthology.orchestra.run.smithi150.stdout: "election_epoch": 4, 2024-09-17T05:49:19.354 INFO:teuthology.orchestra.run.smithi150.stdout: "quorum": [ 2024-09-17T05:49:19.354 INFO:teuthology.orchestra.run.smithi150.stdout: 0, 2024-09-17T05:49:19.354 INFO:teuthology.orchestra.run.smithi150.stdout: 1, 2024-09-17T05:49:19.355 INFO:teuthology.orchestra.run.smithi150.stdout: 2 2024-09-17T05:49:19.355 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2024-09-17T05:49:19.355 INFO:teuthology.orchestra.run.smithi150.stdout: "quorum_names": [ 2024-09-17T05:49:19.355 INFO:teuthology.orchestra.run.smithi150.stdout: "a", 2024-09-17T05:49:19.355 INFO:teuthology.orchestra.run.smithi150.stdout: "b", 2024-09-17T05:49:19.355 INFO:teuthology.orchestra.run.smithi150.stdout: "c" 2024-09-17T05:49:19.355 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2024-09-17T05:49:19.355 INFO:teuthology.orchestra.run.smithi150.stdout: "quorum_age": 466, 2024-09-17T05:49:19.355 INFO:teuthology.orchestra.run.smithi150.stdout: "monmap": { 2024-09-17T05:49:19.355 INFO:teuthology.orchestra.run.smithi150.stdout: "epoch": 1, 2024-09-17T05:49:19.355 INFO:teuthology.orchestra.run.smithi150.stdout: "min_mon_release_name": "squid", 2024-09-17T05:49:19.355 INFO:teuthology.orchestra.run.smithi150.stdout: "num_mons": 3 2024-09-17T05:49:19.355 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-17T05:49:19.356 INFO:teuthology.orchestra.run.smithi150.stdout: "osdmap": { 2024-09-17T05:49:19.356 INFO:teuthology.orchestra.run.smithi150.stdout: "epoch": 88, 2024-09-17T05:49:19.356 INFO:teuthology.orchestra.run.smithi150.stdout: "num_osds": 8, 2024-09-17T05:49:19.356 INFO:teuthology.orchestra.run.smithi150.stdout: "num_up_osds": 8, 2024-09-17T05:49:19.356 INFO:teuthology.orchestra.run.smithi150.stdout: "osd_up_since": 1726551706, 2024-09-17T05:49:19.356 INFO:teuthology.orchestra.run.smithi150.stdout: "num_in_osds": 8, 2024-09-17T05:49:19.356 INFO:teuthology.orchestra.run.smithi150.stdout: "osd_in_since": 1726551696, 2024-09-17T05:49:19.356 INFO:teuthology.orchestra.run.smithi150.stdout: "num_remapped_pgs": 0 2024-09-17T05:49:19.356 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-17T05:49:19.356 INFO:teuthology.orchestra.run.smithi150.stdout: "pgmap": { 2024-09-17T05:49:19.356 INFO:teuthology.orchestra.run.smithi150.stdout: "pgs_by_state": [ 2024-09-17T05:49:19.356 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-09-17T05:49:19.357 INFO:teuthology.orchestra.run.smithi150.stdout: "state_name": "active+clean", 2024-09-17T05:49:19.357 INFO:teuthology.orchestra.run.smithi150.stdout: "count": 97 2024-09-17T05:49:19.357 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-09-17T05:49:19.357 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2024-09-17T05:49:19.357 INFO:teuthology.orchestra.run.smithi150.stdout: "num_pgs": 97, 2024-09-17T05:49:19.357 INFO:teuthology.orchestra.run.smithi150.stdout: "num_pools": 3, 2024-09-17T05:49:19.357 INFO:teuthology.orchestra.run.smithi150.stdout: "num_objects": 7462, 2024-09-17T05:49:19.357 INFO:teuthology.orchestra.run.smithi150.stdout: "data_bytes": 31074517500, 2024-09-17T05:49:19.357 INFO:teuthology.orchestra.run.smithi150.stdout: "bytes_used": 61690306560, 2024-09-17T05:49:19.357 INFO:teuthology.orchestra.run.smithi150.stdout: "bytes_avail": 711403806720, 2024-09-17T05:49:19.357 INFO:teuthology.orchestra.run.smithi150.stdout: "bytes_total": 773094113280, 2024-09-17T05:49:19.357 INFO:teuthology.orchestra.run.smithi150.stdout: "read_bytes_sec": 758914202, 2024-09-17T05:49:19.357 INFO:teuthology.orchestra.run.smithi150.stdout: "write_bytes_sec": 759330039, 2024-09-17T05:49:19.357 INFO:teuthology.orchestra.run.smithi150.stdout: "read_op_per_sec": 184, 2024-09-17T05:49:19.358 INFO:teuthology.orchestra.run.smithi150.stdout: "write_op_per_sec": 202 2024-09-17T05:49:19.358 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-17T05:49:19.358 INFO:teuthology.orchestra.run.smithi150.stdout: "fsmap": { 2024-09-17T05:49:19.358 INFO:teuthology.orchestra.run.smithi150.stdout: "epoch": 52, 2024-09-17T05:49:19.358 INFO:teuthology.orchestra.run.smithi150.stdout: "btime": "2024-09-17T05:48:19:238380+0000", 2024-09-17T05:49:19.358 INFO:teuthology.orchestra.run.smithi150.stdout: "id": 6, 2024-09-17T05:49:19.358 INFO:teuthology.orchestra.run.smithi150.stdout: "up": 1, 2024-09-17T05:49:19.358 INFO:teuthology.orchestra.run.smithi150.stdout: "in": 1, 2024-09-17T05:49:19.358 INFO:teuthology.orchestra.run.smithi150.stdout: "max": 1, 2024-09-17T05:49:19.358 INFO:teuthology.orchestra.run.smithi150.stdout: "by_rank": [ 2024-09-17T05:49:19.358 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-09-17T05:49:19.358 INFO:teuthology.orchestra.run.smithi150.stdout: "filesystem_id": 6, 2024-09-17T05:49:19.359 INFO:teuthology.orchestra.run.smithi150.stdout: "rank": 0, 2024-09-17T05:49:19.359 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "d", 2024-09-17T05:49:19.359 INFO:teuthology.orchestra.run.smithi150.stdout: "status": "up:active", 2024-09-17T05:49:19.359 INFO:teuthology.orchestra.run.smithi150.stdout: "gid": 6496 2024-09-17T05:49:19.359 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-09-17T05:49:19.359 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2024-09-17T05:49:19.359 INFO:teuthology.orchestra.run.smithi150.stdout: "up:standby": 3 2024-09-17T05:49:19.359 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-17T05:49:19.359 INFO:teuthology.orchestra.run.smithi150.stdout: "mgrmap": { 2024-09-17T05:49:19.359 INFO:teuthology.orchestra.run.smithi150.stdout: "available": true, 2024-09-17T05:49:19.359 INFO:teuthology.orchestra.run.smithi150.stdout: "num_standbys": 1, 2024-09-17T05:49:19.359 INFO:teuthology.orchestra.run.smithi150.stdout: "modules": [ 2024-09-17T05:49:19.359 INFO:teuthology.orchestra.run.smithi150.stdout: "iostat", 2024-09-17T05:49:19.359 INFO:teuthology.orchestra.run.smithi150.stdout: "nfs", 2024-09-17T05:49:19.360 INFO:teuthology.orchestra.run.smithi150.stdout: "restful" 2024-09-17T05:49:19.360 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2024-09-17T05:49:19.360 INFO:teuthology.orchestra.run.smithi150.stdout: "services": {} 2024-09-17T05:49:19.360 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-17T05:49:19.360 INFO:teuthology.orchestra.run.smithi150.stdout: "servicemap": { 2024-09-17T05:49:19.360 INFO:teuthology.orchestra.run.smithi150.stdout: "epoch": 17, 2024-09-17T05:49:19.360 INFO:teuthology.orchestra.run.smithi150.stdout: "modified": "2024-09-17T05:49:15.004587+0000", 2024-09-17T05:49:19.360 INFO:teuthology.orchestra.run.smithi150.stdout: "services": {} 2024-09-17T05:49:19.360 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-17T05:49:19.360 INFO:teuthology.orchestra.run.smithi150.stdout: "progress_events": { 2024-09-17T05:49:19.360 INFO:teuthology.orchestra.run.smithi150.stdout: "mgr-vol-ongoing-clones": { 2024-09-17T05:49:19.360 INFO:teuthology.orchestra.run.smithi150.stdout: "message": "4 ongoing clones - average progress is 0.0% (32s)\n [............................] ", 2024-09-17T05:49:19.360 INFO:teuthology.orchestra.run.smithi150.stdout: "progress": 0, 2024-09-17T05:49:19.360 INFO:teuthology.orchestra.run.smithi150.stdout: "add_to_ceph_s": true 2024-09-17T05:49:19.361 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-17T05:49:19.361 INFO:teuthology.orchestra.run.smithi150.stdout: "mgr-vol-total-clones": { 2024-09-17T05:49:19.361 INFO:teuthology.orchestra.run.smithi150.stdout: "message": "Total 7 clones - average progress is 34.449% (26s)\n [=========...................] (remaining: 49s)", 2024-09-17T05:49:19.361 INFO:teuthology.orchestra.run.smithi150.stdout: "progress": 0.34448999166488647, 2024-09-17T05:49:19.361 INFO:teuthology.orchestra.run.smithi150.stdout: "add_to_ceph_s": true 2024-09-17T05:49:19.361 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-09-17T05:49:19.361 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-09-17T05:49:19.361 INFO:teuthology.orchestra.run.smithi150.stdout:} 2024-09-17T05:49:19.362 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:19.358+0000 7f7029369640 1 -- 172.21.15.150:0/235072151 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f701007a0f0 msgr2=0x7f701007c600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:49:19.362 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:19.358+0000 7f7029369640 1 --2- 172.21.15.150:0/235072151 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f701007a0f0 0x7f701007c600 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7f7014034000 tx=0x7f70140046c0 comp rx=0 tx=0).stop 2024-09-17T05:49:19.362 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:19.358+0000 7f7029369640 1 -- 172.21.15.150:0/235072151 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f70240d4f90 msgr2=0x7f7024153eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:49:19.362 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:19.358+0000 7f7029369640 1 --2- 172.21.15.150:0/235072151 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f70240d4f90 0x7f7024153eb0 secure :-1 s=READY pgs=1130 cs=0 l=1 rev1=1 crypto rx=0x7f701800c3a0 tx=0x7f701800c860 comp rx=0 tx=0).stop 2024-09-17T05:49:19.362 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:19.358+0000 7f7029369640 1 -- 172.21.15.150:0/235072151 shutdown_connections 2024-09-17T05:49:19.362 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:19.358+0000 7f7029369640 1 --2- 172.21.15.150:0/235072151 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f702414fa60 0x7f70241543f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:49:19.362 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:19.358+0000 7f7029369640 1 --2- 172.21.15.150:0/235072151 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f701007a0f0 0x7f701007c600 unknown :-1 s=CLOSED pgs=485 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:49:19.363 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:19.358+0000 7f7029369640 1 --2- 172.21.15.150:0/235072151 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f70240d4f90 0x7f7024153eb0 unknown :-1 s=CLOSED pgs=1130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:49:19.363 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:19.358+0000 7f7029369640 1 --2- 172.21.15.150:0/235072151 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f70240b5d50 0x7f7024146b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:49:19.363 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:19.358+0000 7f7029369640 1 -- 172.21.15.150:0/235072151 >> 172.21.15.150:0/235072151 conn(0x7f702408bfe0 msgr2=0x7f702406deb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:49:19.363 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:19.358+0000 7f7029369640 1 -- 172.21.15.150:0/235072151 shutdown_connections 2024-09-17T05:49:19.363 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:19.358+0000 7f7029369640 1 -- 172.21.15.150:0/235072151 wait complete. 2024-09-17T05:49:19.376 INFO:tasks.cephfs.test_volumes:pevs - {'mgr-vol-ongoing-clones': {'message': '4 ongoing clones - average progress is 0.0% (32s)\n [............................] ', 'progress': 0, 'add_to_ceph_s': True}, 'mgr-vol-total-clones': {'message': 'Total 7 clones - average progress is 34.449% (26s)\n [=========...................] (remaining: 49s)', 'progress': 0.3444899916648865, 'add_to_ceph_s': True}} 2024-09-17T05:49:19.376 INFO:tasks.cephfs.test_volumes:on_p = 0.2636699974536896 new_on_p = 0.0 2024-09-17T05:49:19.376 INFO:tasks.cephfs.test_volumes:onpen_p = 0.2775999903678894 new_onpen_p = 0.3444899916648865 2024-09-17T05:49:19.376 INFO:tasks.cephfs.test_volumes:onpen_count = None new_onpen_count = None 2024-09-17T05:49:19.877 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format json-pretty 2024-09-17T05:49:20.027 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:20.026+0000 7f249a351640 1 -- 172.21.15.150:0/3639921821 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f24940cff20 msgr2=0x7f24940b5670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:49:20.027 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:20.026+0000 7f249a351640 1 --2- 172.21.15.150:0/3639921821 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f24940cff20 0x7f24940b5670 secure :-1 s=READY pgs=1132 cs=0 l=1 rev1=1 crypto rx=0x7f2488009820 tx=0x7f248802a510 comp rx=0 tx=0).stop 2024-09-17T05:49:20.027 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:20.026+0000 7f249a351640 1 -- 172.21.15.150:0/3639921821 shutdown_connections 2024-09-17T05:49:20.027 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:20.026+0000 7f249a351640 1 --2- 172.21.15.150:0/3639921821 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f24940cff20 0x7f24940b5670 unknown :-1 s=CLOSED pgs=1132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:49:20.027 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:20.026+0000 7f249a351640 1 -- 172.21.15.150:0/3639921821 >> 172.21.15.150:0/3639921821 conn(0x7f249408bfe0 msgr2=0x7f24940d46b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:49:20.027 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:20.026+0000 7f249a351640 1 -- 172.21.15.150:0/3639921821 shutdown_connections 2024-09-17T05:49:20.027 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:20.026+0000 7f249a351640 1 -- 172.21.15.150:0/3639921821 wait complete. 2024-09-17T05:49:20.030 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:20.030+0000 7f249a351640 1 Processor -- start 2024-09-17T05:49:20.031 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:20.030+0000 7f249a351640 1 -- start start 2024-09-17T05:49:20.035 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:20.034+0000 7f249a351640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f24940cff20 0x7f2494158d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:49:20.035 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:20.034+0000 7f249a351640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f24940d0330 0x7f24940ca590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:49:20.035 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:20.034+0000 7f249a351640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f24940d17c0 0x7f24940ccf60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:49:20.035 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:20.034+0000 7f249a351640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f24940b5f40 con 0x7f24940d17c0 2024-09-17T05:49:20.035 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:20.034+0000 7f249a351640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f24940b5dc0 con 0x7f24940d0330 2024-09-17T05:49:20.035 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:20.034+0000 7f249a351640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f249416a390 con 0x7f24940cff20 2024-09-17T05:49:20.037 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:20.034+0000 7f24988ee640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f24940d17c0 0x7f24940ccf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:49:20.037 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:20.034+0000 7f24988ee640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f24940d17c0 0x7f24940ccf60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:46140/0 (socket says 172.21.15.150:46140) 2024-09-17T05:49:20.037 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:20.034+0000 7f24988ee640 1 -- 172.21.15.150:0/2120333508 learned_addr learned my addr 172.21.15.150:0/2120333508 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:49:20.037 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:20.035+0000 7f24937fe640 1 --2- 172.21.15.150:0/2120333508 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f24940d0330 0x7f24940ca590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:49:20.037 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:20.035+0000 7f2493fff640 1 --2- 172.21.15.150:0/2120333508 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f24940cff20 0x7f2494158d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:49:20.037 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:20.035+0000 7f24988ee640 1 -- 172.21.15.150:0/2120333508 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f24940cff20 msgr2=0x7f2494158d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:49:20.037 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:20.035+0000 7f24988ee640 1 --2- 172.21.15.150:0/2120333508 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f24940cff20 0x7f2494158d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:49:20.037 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:20.035+0000 7f24988ee640 1 -- 172.21.15.150:0/2120333508 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f24940d0330 msgr2=0x7f24940ca590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:49:20.038 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:20.035+0000 7f24988ee640 1 --2- 172.21.15.150:0/2120333508 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f24940d0330 0x7f24940ca590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:49:20.038 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:20.035+0000 7f24988ee640 1 -- 172.21.15.150:0/2120333508 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f24940c8e40 con 0x7f24940d17c0 2024-09-17T05:49:20.038 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:20.035+0000 7f24988ee640 1 --2- 172.21.15.150:0/2120333508 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f24940d17c0 0x7f24940ccf60 secure :-1 s=READY pgs=1133 cs=0 l=1 rev1=1 crypto rx=0x7f248c00c760 tx=0x7f248c00cb60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:49:20.038 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:20.035+0000 7f2490ff9640 1 -- 172.21.15.150:0/2120333508 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f248c003b70 con 0x7f24940d17c0 2024-09-17T05:49:20.038 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:20.036+0000 7f2490ff9640 1 -- 172.21.15.150:0/2120333508 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f248c003d10 con 0x7f24940d17c0 2024-09-17T05:49:20.038 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:20.036+0000 7f2490ff9640 1 -- 172.21.15.150:0/2120333508 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f248c0052d0 con 0x7f24940d17c0 2024-09-17T05:49:20.038 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:20.036+0000 7f249a351640 1 -- 172.21.15.150:0/2120333508 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f24940c9120 con 0x7f24940d17c0 2024-09-17T05:49:20.042 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:20.036+0000 7f249a351640 1 -- 172.21.15.150:0/2120333508 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f24941592d0 con 0x7f24940d17c0 2024-09-17T05:49:20.042 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:20.041+0000 7f2490ff9640 1 -- 172.21.15.150:0/2120333508 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 29) ==== 103379+0+0 (secure 0 0 0) 0x7f248c005470 con 0x7f24940d17c0 2024-09-17T05:49:20.043 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:20.042+0000 7f249a351640 1 -- 172.21.15.150:0/2120333508 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f24940b8ef0 con 0x7f24940d17c0 2024-09-17T05:49:20.044 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:20.043+0000 7f2490ff9640 1 --2- 172.21.15.150:0/2120333508 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f248007a140 0x7f248007c650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:49:20.044 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:20.043+0000 7f2490ff9640 1 -- 172.21.15.150:0/2120333508 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 5822+0+0 (secure 0 0 0) 0x7f248c099c40 con 0x7f24940d17c0 2024-09-17T05:49:20.051 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:20.050+0000 7f2490ff9640 1 -- 172.21.15.150:0/2120333508 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f248c0637a0 con 0x7f24940d17c0 2024-09-17T05:49:20.054 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:20.053+0000 7f2493fff640 1 --2- 172.21.15.150:0/2120333508 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f248007a140 0x7f248007c650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:49:20.070 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:20.069+0000 7f2493fff640 1 --2- 172.21.15.150:0/2120333508 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f248007a140 0x7f248007c650 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f248400b7f0 tx=0x7f2484008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:49:20.440 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:20.439+0000 7f249a351640 1 -- 172.21.15.150:0/2120333508 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) -- 0x7f24940cb010 con 0x7f24940d17c0 2024-09-17T05:49:20.441 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:20.440+0000 7f2490ff9640 1 -- 172.21.15.150:0/2120333508 <== mon.0 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) ==== 79+0+2406 (secure 0 0 0) 0x7f248c0630a0 con 0x7f24940d17c0 2024-09-17T05:49:20.442 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-09-17T05:49:20.442 INFO:teuthology.orchestra.run.smithi150.stdout:{ 2024-09-17T05:49:20.442 INFO:teuthology.orchestra.run.smithi150.stdout: "fsid": "9f2e05e9-d629-47b3-b26b-1360655b7d20", 2024-09-17T05:49:20.442 INFO:teuthology.orchestra.run.smithi150.stdout: "health": { 2024-09-17T05:49:20.442 INFO:teuthology.orchestra.run.smithi150.stdout: "status": "HEALTH_OK", 2024-09-17T05:49:20.443 INFO:teuthology.orchestra.run.smithi150.stdout: "checks": {}, 2024-09-17T05:49:20.443 INFO:teuthology.orchestra.run.smithi150.stdout: "mutes": [] 2024-09-17T05:49:20.443 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-17T05:49:20.443 INFO:teuthology.orchestra.run.smithi150.stdout: "election_epoch": 4, 2024-09-17T05:49:20.443 INFO:teuthology.orchestra.run.smithi150.stdout: "quorum": [ 2024-09-17T05:49:20.444 INFO:teuthology.orchestra.run.smithi150.stdout: 0, 2024-09-17T05:49:20.444 INFO:teuthology.orchestra.run.smithi150.stdout: 1, 2024-09-17T05:49:20.444 INFO:teuthology.orchestra.run.smithi150.stdout: 2 2024-09-17T05:49:20.444 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2024-09-17T05:49:20.444 INFO:teuthology.orchestra.run.smithi150.stdout: "quorum_names": [ 2024-09-17T05:49:20.444 INFO:teuthology.orchestra.run.smithi150.stdout: "a", 2024-09-17T05:49:20.445 INFO:teuthology.orchestra.run.smithi150.stdout: "b", 2024-09-17T05:49:20.445 INFO:teuthology.orchestra.run.smithi150.stdout: "c" 2024-09-17T05:49:20.445 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2024-09-17T05:49:20.445 INFO:teuthology.orchestra.run.smithi150.stdout: "quorum_age": 467, 2024-09-17T05:49:20.446 INFO:teuthology.orchestra.run.smithi150.stdout: "monmap": { 2024-09-17T05:49:20.446 INFO:teuthology.orchestra.run.smithi150.stdout: "epoch": 1, 2024-09-17T05:49:20.446 INFO:teuthology.orchestra.run.smithi150.stdout: "min_mon_release_name": "squid", 2024-09-17T05:49:20.447 INFO:teuthology.orchestra.run.smithi150.stdout: "num_mons": 3 2024-09-17T05:49:20.447 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-17T05:49:20.447 INFO:teuthology.orchestra.run.smithi150.stdout: "osdmap": { 2024-09-17T05:49:20.447 INFO:teuthology.orchestra.run.smithi150.stdout: "epoch": 88, 2024-09-17T05:49:20.447 INFO:teuthology.orchestra.run.smithi150.stdout: "num_osds": 8, 2024-09-17T05:49:20.447 INFO:teuthology.orchestra.run.smithi150.stdout: "num_up_osds": 8, 2024-09-17T05:49:20.448 INFO:teuthology.orchestra.run.smithi150.stdout: "osd_up_since": 1726551706, 2024-09-17T05:49:20.448 INFO:teuthology.orchestra.run.smithi150.stdout: "num_in_osds": 8, 2024-09-17T05:49:20.448 INFO:teuthology.orchestra.run.smithi150.stdout: "osd_in_since": 1726551696, 2024-09-17T05:49:20.448 INFO:teuthology.orchestra.run.smithi150.stdout: "num_remapped_pgs": 0 2024-09-17T05:49:20.448 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-17T05:49:20.448 INFO:teuthology.orchestra.run.smithi150.stdout: "pgmap": { 2024-09-17T05:49:20.449 INFO:teuthology.orchestra.run.smithi150.stdout: "pgs_by_state": [ 2024-09-17T05:49:20.449 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-09-17T05:49:20.449 INFO:teuthology.orchestra.run.smithi150.stdout: "state_name": "active+clean", 2024-09-17T05:49:20.450 INFO:teuthology.orchestra.run.smithi150.stdout: "count": 97 2024-09-17T05:49:20.450 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-09-17T05:49:20.450 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2024-09-17T05:49:20.450 INFO:teuthology.orchestra.run.smithi150.stdout: "num_pgs": 97, 2024-09-17T05:49:20.450 INFO:teuthology.orchestra.run.smithi150.stdout: "num_pools": 3, 2024-09-17T05:49:20.451 INFO:teuthology.orchestra.run.smithi150.stdout: "num_objects": 7462, 2024-09-17T05:49:20.451 INFO:teuthology.orchestra.run.smithi150.stdout: "data_bytes": 31074517500, 2024-09-17T05:49:20.451 INFO:teuthology.orchestra.run.smithi150.stdout: "bytes_used": 61690306560, 2024-09-17T05:49:20.451 INFO:teuthology.orchestra.run.smithi150.stdout: "bytes_avail": 711403806720, 2024-09-17T05:49:20.451 INFO:teuthology.orchestra.run.smithi150.stdout: "bytes_total": 773094113280, 2024-09-17T05:49:20.451 INFO:teuthology.orchestra.run.smithi150.stdout: "read_bytes_sec": 758914202, 2024-09-17T05:49:20.452 INFO:teuthology.orchestra.run.smithi150.stdout: "write_bytes_sec": 759330039, 2024-09-17T05:49:20.452 INFO:teuthology.orchestra.run.smithi150.stdout: "read_op_per_sec": 184, 2024-09-17T05:49:20.452 INFO:teuthology.orchestra.run.smithi150.stdout: "write_op_per_sec": 202 2024-09-17T05:49:20.452 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-17T05:49:20.452 INFO:teuthology.orchestra.run.smithi150.stdout: "fsmap": { 2024-09-17T05:49:20.453 INFO:teuthology.orchestra.run.smithi150.stdout: "epoch": 52, 2024-09-17T05:49:20.453 INFO:teuthology.orchestra.run.smithi150.stdout: "btime": "2024-09-17T05:48:19:238380+0000", 2024-09-17T05:49:20.453 INFO:teuthology.orchestra.run.smithi150.stdout: "id": 6, 2024-09-17T05:49:20.453 INFO:teuthology.orchestra.run.smithi150.stdout: "up": 1, 2024-09-17T05:49:20.453 INFO:teuthology.orchestra.run.smithi150.stdout: "in": 1, 2024-09-17T05:49:20.453 INFO:teuthology.orchestra.run.smithi150.stdout: "max": 1, 2024-09-17T05:49:20.454 INFO:teuthology.orchestra.run.smithi150.stdout: "by_rank": [ 2024-09-17T05:49:20.454 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-09-17T05:49:20.454 INFO:teuthology.orchestra.run.smithi150.stdout: "filesystem_id": 6, 2024-09-17T05:49:20.454 INFO:teuthology.orchestra.run.smithi150.stdout: "rank": 0, 2024-09-17T05:49:20.454 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "d", 2024-09-17T05:49:20.454 INFO:teuthology.orchestra.run.smithi150.stdout: "status": "up:active", 2024-09-17T05:49:20.455 INFO:teuthology.orchestra.run.smithi150.stdout: "gid": 6496 2024-09-17T05:49:20.455 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-09-17T05:49:20.455 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2024-09-17T05:49:20.455 INFO:teuthology.orchestra.run.smithi150.stdout: "up:standby": 3 2024-09-17T05:49:20.455 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-17T05:49:20.455 INFO:teuthology.orchestra.run.smithi150.stdout: "mgrmap": { 2024-09-17T05:49:20.456 INFO:teuthology.orchestra.run.smithi150.stdout: "available": true, 2024-09-17T05:49:20.456 INFO:teuthology.orchestra.run.smithi150.stdout: "num_standbys": 1, 2024-09-17T05:49:20.456 INFO:teuthology.orchestra.run.smithi150.stdout: "modules": [ 2024-09-17T05:49:20.456 INFO:teuthology.orchestra.run.smithi150.stdout: "iostat", 2024-09-17T05:49:20.456 INFO:teuthology.orchestra.run.smithi150.stdout: "nfs", 2024-09-17T05:49:20.456 INFO:teuthology.orchestra.run.smithi150.stdout: "restful" 2024-09-17T05:49:20.457 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2024-09-17T05:49:20.457 INFO:teuthology.orchestra.run.smithi150.stdout: "services": {} 2024-09-17T05:49:20.457 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-17T05:49:20.457 INFO:teuthology.orchestra.run.smithi150.stdout: "servicemap": { 2024-09-17T05:49:20.457 INFO:teuthology.orchestra.run.smithi150.stdout: "epoch": 17, 2024-09-17T05:49:20.457 INFO:teuthology.orchestra.run.smithi150.stdout: "modified": "2024-09-17T05:49:15.004587+0000", 2024-09-17T05:49:20.458 INFO:teuthology.orchestra.run.smithi150.stdout: "services": {} 2024-09-17T05:49:20.458 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-17T05:49:20.458 INFO:teuthology.orchestra.run.smithi150.stdout: "progress_events": { 2024-09-17T05:49:20.458 INFO:teuthology.orchestra.run.smithi150.stdout: "mgr-vol-ongoing-clones": { 2024-09-17T05:49:20.458 INFO:teuthology.orchestra.run.smithi150.stdout: "message": "4 ongoing clones - average progress is 0.0% (32s)\n [............................] ", 2024-09-17T05:49:20.458 INFO:teuthology.orchestra.run.smithi150.stdout: "progress": 0, 2024-09-17T05:49:20.459 INFO:teuthology.orchestra.run.smithi150.stdout: "add_to_ceph_s": true 2024-09-17T05:49:20.459 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-17T05:49:20.459 INFO:teuthology.orchestra.run.smithi150.stdout: "mgr-vol-total-clones": { 2024-09-17T05:49:20.459 INFO:teuthology.orchestra.run.smithi150.stdout: "message": "Total 7 clones - average progress is 34.449% (26s)\n [=========...................] (remaining: 49s)", 2024-09-17T05:49:20.459 INFO:teuthology.orchestra.run.smithi150.stdout: "progress": 0.34448999166488647, 2024-09-17T05:49:20.459 INFO:teuthology.orchestra.run.smithi150.stdout: "add_to_ceph_s": true 2024-09-17T05:49:20.460 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-09-17T05:49:20.460 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-09-17T05:49:20.460 INFO:teuthology.orchestra.run.smithi150.stdout:} 2024-09-17T05:49:20.462 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:20.445+0000 7f249a351640 1 -- 172.21.15.150:0/2120333508 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f248007a140 msgr2=0x7f248007c650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:49:20.462 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:20.445+0000 7f249a351640 1 --2- 172.21.15.150:0/2120333508 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f248007a140 0x7f248007c650 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f248400b7f0 tx=0x7f2484008040 comp rx=0 tx=0).stop 2024-09-17T05:49:20.462 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:20.445+0000 7f249a351640 1 -- 172.21.15.150:0/2120333508 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f24940d17c0 msgr2=0x7f24940ccf60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:49:20.462 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:20.445+0000 7f249a351640 1 --2- 172.21.15.150:0/2120333508 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f24940d17c0 0x7f24940ccf60 secure :-1 s=READY pgs=1133 cs=0 l=1 rev1=1 crypto rx=0x7f248c00c760 tx=0x7f248c00cb60 comp rx=0 tx=0).stop 2024-09-17T05:49:20.462 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:20.445+0000 7f249a351640 1 -- 172.21.15.150:0/2120333508 shutdown_connections 2024-09-17T05:49:20.463 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:20.445+0000 7f249a351640 1 --2- 172.21.15.150:0/2120333508 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f24940d0330 0x7f24940ca590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:49:20.463 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:20.445+0000 7f249a351640 1 --2- 172.21.15.150:0/2120333508 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f248007a140 0x7f248007c650 unknown :-1 s=CLOSED pgs=486 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:49:20.463 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:20.445+0000 7f249a351640 1 --2- 172.21.15.150:0/2120333508 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f24940d17c0 0x7f24940ccf60 unknown :-1 s=CLOSED pgs=1133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:49:20.463 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:20.445+0000 7f249a351640 1 --2- 172.21.15.150:0/2120333508 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f24940cff20 0x7f2494158d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:49:20.463 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:20.445+0000 7f249a351640 1 -- 172.21.15.150:0/2120333508 >> 172.21.15.150:0/2120333508 conn(0x7f249408bfe0 msgr2=0x7f2494166140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:49:20.463 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:20.445+0000 7f249a351640 1 -- 172.21.15.150:0/2120333508 shutdown_connections 2024-09-17T05:49:20.464 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:20.445+0000 7f249a351640 1 -- 172.21.15.150:0/2120333508 wait complete. 2024-09-17T05:49:20.467 INFO:tasks.cephfs.test_volumes:pevs - {'mgr-vol-ongoing-clones': {'message': '4 ongoing clones - average progress is 0.0% (32s)\n [............................] ', 'progress': 0, 'add_to_ceph_s': True}, 'mgr-vol-total-clones': {'message': 'Total 7 clones - average progress is 34.449% (26s)\n [=========...................] (remaining: 49s)', 'progress': 0.3444899916648865, 'add_to_ceph_s': True}} 2024-09-17T05:49:20.467 INFO:tasks.cephfs.test_volumes:on_p = 0.2636699974536896 new_on_p = 0.0 2024-09-17T05:49:20.467 INFO:tasks.cephfs.test_volumes:onpen_p = 0.2775999903678894 new_onpen_p = 0.3444899916648865 2024-09-17T05:49:20.467 INFO:tasks.cephfs.test_volumes:onpen_count = None new_onpen_count = None 2024-09-17T05:49:20.968 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format json-pretty 2024-09-17T05:49:21.133 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:21.132+0000 7fc6be3ad640 1 -- 172.21.15.150:0/271927537 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc6a0003f70 msgr2=0x7fc6a0004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:49:21.133 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:21.132+0000 7fc6be3ad640 1 --2- 172.21.15.150:0/271927537 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc6a0003f70 0x7fc6a0004800 secure :-1 s=READY pgs=1135 cs=0 l=1 rev1=1 crypto rx=0x7fc6a80016c0 tx=0x7fc6a0005830 comp rx=0 tx=0).stop 2024-09-17T05:49:21.133 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:21.132+0000 7fc6bc94a640 1 -- 172.21.15.150:0/271927537 reap_dead start 2024-09-17T05:49:21.133 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:21.132+0000 7fc6be3ad640 1 -- 172.21.15.150:0/271927537 shutdown_connections 2024-09-17T05:49:21.133 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:21.132+0000 7fc6be3ad640 1 -- 172.21.15.150:0/271927537 >> 172.21.15.150:0/271927537 conn(0x7fc6b806d730 msgr2=0x7fc6b80b1e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:49:21.133 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:21.132+0000 7fc6be3ad640 1 -- 172.21.15.150:0/271927537 shutdown_connections 2024-09-17T05:49:21.134 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:21.132+0000 7fc6be3ad640 1 -- 172.21.15.150:0/271927537 wait complete. 2024-09-17T05:49:21.135 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:21.134+0000 7fc6be3ad640 1 Processor -- start 2024-09-17T05:49:21.135 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:21.134+0000 7fc6be3ad640 1 -- start start 2024-09-17T05:49:21.138 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:21.136+0000 7fc6be3ad640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc6a0003f70 0x7fc6b8153f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:49:21.138 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:21.136+0000 7fc6be3ad640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc6b814f5f0 0x7fc6b81f4810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:49:21.138 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:21.136+0000 7fc6be3ad640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc6b814fa00 0x7fc6b81f4d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:49:21.138 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:21.136+0000 7fc6bc94a640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc6b814fa00 0x7fc6b81f4d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:49:21.138 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:21.136+0000 7fc6bc94a640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc6b814fa00 0x7fc6b81f4d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:53918/0 (socket says 172.21.15.150:53918) 2024-09-17T05:49:21.138 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:21.136+0000 7fc6bc94a640 1 -- 172.21.15.150:0/828322315 learned_addr learned my addr 172.21.15.150:0/828322315 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:49:21.138 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:21.136+0000 7fc6be3ad640 1 -- 172.21.15.150:0/828322315 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7fc6b80b4310 con 0x7fc6b814fa00 2024-09-17T05:49:21.139 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:21.136+0000 7fc6be3ad640 1 -- 172.21.15.150:0/828322315 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fc6b80b4190 con 0x7fc6b814f5f0 2024-09-17T05:49:21.139 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:21.136+0000 7fc6be3ad640 1 -- 172.21.15.150:0/828322315 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fc6b80b4490 con 0x7fc6a0003f70 2024-09-17T05:49:21.139 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:21.137+0000 7fc6bc94a640 1 -- 172.21.15.150:0/828322315 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc6a0003f70 msgr2=0x7fc6b8153f20 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-17T05:49:21.139 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:21.137+0000 7fc6bc94a640 1 --2- 172.21.15.150:0/828322315 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc6a0003f70 0x7fc6b8153f20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:49:21.139 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:21.137+0000 7fc6bc94a640 1 -- 172.21.15.150:0/828322315 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc6b814f5f0 msgr2=0x7fc6b81f4810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:49:21.139 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:21.137+0000 7fc6bc94a640 1 --2- 172.21.15.150:0/828322315 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc6b814f5f0 0x7fc6b81f4810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:49:21.139 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:21.137+0000 7fc6bc94a640 1 -- 172.21.15.150:0/828322315 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc6b81f2560 con 0x7fc6b814fa00 2024-09-17T05:49:21.139 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:21.137+0000 7fc6bc94a640 1 --2- 172.21.15.150:0/828322315 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc6b814fa00 0x7fc6b81f4d50 secure :-1 s=READY pgs=1136 cs=0 l=1 rev1=1 crypto rx=0x7fc6b80ad600 tx=0x7fc6b000a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:49:21.139 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:21.137+0000 7fc6b4ff9640 1 -- 172.21.15.150:0/828322315 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6b0017070 con 0x7fc6b814fa00 2024-09-17T05:49:21.140 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:21.137+0000 7fc6b4ff9640 1 -- 172.21.15.150:0/828322315 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc6b00070d0 con 0x7fc6b814fa00 2024-09-17T05:49:21.140 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:21.138+0000 7fc6b4ff9640 1 -- 172.21.15.150:0/828322315 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6b0007560 con 0x7fc6b814fa00 2024-09-17T05:49:21.140 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:21.138+0000 7fc6be3ad640 1 -- 172.21.15.150:0/828322315 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc6b81f2840 con 0x7fc6b814fa00 2024-09-17T05:49:21.140 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:21.138+0000 7fc6be3ad640 1 -- 172.21.15.150:0/828322315 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc6b81f2e00 con 0x7fc6b814fa00 2024-09-17T05:49:21.141 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:21.140+0000 7fc6be3ad640 1 -- 172.21.15.150:0/828322315 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc6b80b4980 con 0x7fc6b814fa00 2024-09-17T05:49:21.141 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:21.141+0000 7fc6b4ff9640 1 -- 172.21.15.150:0/828322315 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 29) ==== 103379+0+0 (secure 0 0 0) 0x7fc6b001a070 con 0x7fc6b814fa00 2024-09-17T05:49:21.142 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:21.142+0000 7fc6b4ff9640 1 --2- 172.21.15.150:0/828322315 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fc6a407a0f0 0x7fc6a407c600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:49:21.142 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:21.142+0000 7fc6b4ff9640 1 -- 172.21.15.150:0/828322315 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 5822+0+0 (secure 0 0 0) 0x7fc6b0099bf0 con 0x7fc6b814fa00 2024-09-17T05:49:21.147 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:21.146+0000 7fc6b4ff9640 1 -- 172.21.15.150:0/828322315 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fc6b0021020 con 0x7fc6b814fa00 2024-09-17T05:49:21.149 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:21.149+0000 7fc6b7fff640 1 --2- 172.21.15.150:0/828322315 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fc6a407a0f0 0x7fc6a407c600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:49:21.162 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:21.162+0000 7fc6b7fff640 1 --2- 172.21.15.150:0/828322315 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fc6a407a0f0 0x7fc6a407c600 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7fc6ac0057c0 tx=0x7fc6ac005850 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:49:21.517 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:21.516+0000 7fc6be3ad640 1 -- 172.21.15.150:0/828322315 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) -- 0x7fc6b80cfcf0 con 0x7fc6b814fa00 2024-09-17T05:49:21.517 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:21.517+0000 7fc6b4ff9640 1 -- 172.21.15.150:0/828322315 <== mon.0 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) ==== 79+0+2442 (secure 0 0 0) 0x7fc6b0063b50 con 0x7fc6b814fa00 2024-09-17T05:49:21.518 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-09-17T05:49:21.518 INFO:teuthology.orchestra.run.smithi150.stdout:{ 2024-09-17T05:49:21.518 INFO:teuthology.orchestra.run.smithi150.stdout: "fsid": "9f2e05e9-d629-47b3-b26b-1360655b7d20", 2024-09-17T05:49:21.518 INFO:teuthology.orchestra.run.smithi150.stdout: "health": { 2024-09-17T05:49:21.518 INFO:teuthology.orchestra.run.smithi150.stdout: "status": "HEALTH_OK", 2024-09-17T05:49:21.518 INFO:teuthology.orchestra.run.smithi150.stdout: "checks": {}, 2024-09-17T05:49:21.518 INFO:teuthology.orchestra.run.smithi150.stdout: "mutes": [] 2024-09-17T05:49:21.518 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-17T05:49:21.518 INFO:teuthology.orchestra.run.smithi150.stdout: "election_epoch": 4, 2024-09-17T05:49:21.518 INFO:teuthology.orchestra.run.smithi150.stdout: "quorum": [ 2024-09-17T05:49:21.518 INFO:teuthology.orchestra.run.smithi150.stdout: 0, 2024-09-17T05:49:21.518 INFO:teuthology.orchestra.run.smithi150.stdout: 1, 2024-09-17T05:49:21.519 INFO:teuthology.orchestra.run.smithi150.stdout: 2 2024-09-17T05:49:21.519 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2024-09-17T05:49:21.519 INFO:teuthology.orchestra.run.smithi150.stdout: "quorum_names": [ 2024-09-17T05:49:21.519 INFO:teuthology.orchestra.run.smithi150.stdout: "a", 2024-09-17T05:49:21.519 INFO:teuthology.orchestra.run.smithi150.stdout: "b", 2024-09-17T05:49:21.519 INFO:teuthology.orchestra.run.smithi150.stdout: "c" 2024-09-17T05:49:21.519 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2024-09-17T05:49:21.519 INFO:teuthology.orchestra.run.smithi150.stdout: "quorum_age": 469, 2024-09-17T05:49:21.519 INFO:teuthology.orchestra.run.smithi150.stdout: "monmap": { 2024-09-17T05:49:21.519 INFO:teuthology.orchestra.run.smithi150.stdout: "epoch": 1, 2024-09-17T05:49:21.519 INFO:teuthology.orchestra.run.smithi150.stdout: "min_mon_release_name": "squid", 2024-09-17T05:49:21.519 INFO:teuthology.orchestra.run.smithi150.stdout: "num_mons": 3 2024-09-17T05:49:21.519 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-17T05:49:21.520 INFO:teuthology.orchestra.run.smithi150.stdout: "osdmap": { 2024-09-17T05:49:21.520 INFO:teuthology.orchestra.run.smithi150.stdout: "epoch": 88, 2024-09-17T05:49:21.520 INFO:teuthology.orchestra.run.smithi150.stdout: "num_osds": 8, 2024-09-17T05:49:21.520 INFO:teuthology.orchestra.run.smithi150.stdout: "num_up_osds": 8, 2024-09-17T05:49:21.520 INFO:teuthology.orchestra.run.smithi150.stdout: "osd_up_since": 1726551706, 2024-09-17T05:49:21.520 INFO:teuthology.orchestra.run.smithi150.stdout: "num_in_osds": 8, 2024-09-17T05:49:21.520 INFO:teuthology.orchestra.run.smithi150.stdout: "osd_in_since": 1726551696, 2024-09-17T05:49:21.520 INFO:teuthology.orchestra.run.smithi150.stdout: "num_remapped_pgs": 0 2024-09-17T05:49:21.520 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-17T05:49:21.520 INFO:teuthology.orchestra.run.smithi150.stdout: "pgmap": { 2024-09-17T05:49:21.520 INFO:teuthology.orchestra.run.smithi150.stdout: "pgs_by_state": [ 2024-09-17T05:49:21.520 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-09-17T05:49:21.521 INFO:teuthology.orchestra.run.smithi150.stdout: "state_name": "active+clean", 2024-09-17T05:49:21.521 INFO:teuthology.orchestra.run.smithi150.stdout: "count": 97 2024-09-17T05:49:21.521 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-09-17T05:49:21.521 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2024-09-17T05:49:21.521 INFO:teuthology.orchestra.run.smithi150.stdout: "num_pgs": 97, 2024-09-17T05:49:21.521 INFO:teuthology.orchestra.run.smithi150.stdout: "num_pools": 3, 2024-09-17T05:49:21.521 INFO:teuthology.orchestra.run.smithi150.stdout: "num_objects": 7512, 2024-09-17T05:49:21.521 INFO:teuthology.orchestra.run.smithi150.stdout: "data_bytes": 31288426351, 2024-09-17T05:49:21.521 INFO:teuthology.orchestra.run.smithi150.stdout: "bytes_used": 62562709504, 2024-09-17T05:49:21.521 INFO:teuthology.orchestra.run.smithi150.stdout: "bytes_avail": 710531403776, 2024-09-17T05:49:21.521 INFO:teuthology.orchestra.run.smithi150.stdout: "bytes_total": 773094113280, 2024-09-17T05:49:21.521 INFO:teuthology.orchestra.run.smithi150.stdout: "read_bytes_sec": 614771262, 2024-09-17T05:49:21.521 INFO:teuthology.orchestra.run.smithi150.stdout: "write_bytes_sec": 622172311, 2024-09-17T05:49:21.522 INFO:teuthology.orchestra.run.smithi150.stdout: "read_op_per_sec": 149, 2024-09-17T05:49:21.522 INFO:teuthology.orchestra.run.smithi150.stdout: "write_op_per_sec": 167 2024-09-17T05:49:21.522 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-17T05:49:21.522 INFO:teuthology.orchestra.run.smithi150.stdout: "fsmap": { 2024-09-17T05:49:21.522 INFO:teuthology.orchestra.run.smithi150.stdout: "epoch": 52, 2024-09-17T05:49:21.522 INFO:teuthology.orchestra.run.smithi150.stdout: "btime": "2024-09-17T05:48:19:238380+0000", 2024-09-17T05:49:21.522 INFO:teuthology.orchestra.run.smithi150.stdout: "id": 6, 2024-09-17T05:49:21.522 INFO:teuthology.orchestra.run.smithi150.stdout: "up": 1, 2024-09-17T05:49:21.522 INFO:teuthology.orchestra.run.smithi150.stdout: "in": 1, 2024-09-17T05:49:21.523 INFO:teuthology.orchestra.run.smithi150.stdout: "max": 1, 2024-09-17T05:49:21.523 INFO:teuthology.orchestra.run.smithi150.stdout: "by_rank": [ 2024-09-17T05:49:21.523 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-09-17T05:49:21.523 INFO:teuthology.orchestra.run.smithi150.stdout: "filesystem_id": 6, 2024-09-17T05:49:21.523 INFO:teuthology.orchestra.run.smithi150.stdout: "rank": 0, 2024-09-17T05:49:21.523 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "d", 2024-09-17T05:49:21.523 INFO:teuthology.orchestra.run.smithi150.stdout: "status": "up:active", 2024-09-17T05:49:21.523 INFO:teuthology.orchestra.run.smithi150.stdout: "gid": 6496 2024-09-17T05:49:21.524 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-09-17T05:49:21.524 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2024-09-17T05:49:21.524 INFO:teuthology.orchestra.run.smithi150.stdout: "up:standby": 3 2024-09-17T05:49:21.524 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-17T05:49:21.524 INFO:teuthology.orchestra.run.smithi150.stdout: "mgrmap": { 2024-09-17T05:49:21.524 INFO:teuthology.orchestra.run.smithi150.stdout: "available": true, 2024-09-17T05:49:21.524 INFO:teuthology.orchestra.run.smithi150.stdout: "num_standbys": 1, 2024-09-17T05:49:21.524 INFO:teuthology.orchestra.run.smithi150.stdout: "modules": [ 2024-09-17T05:49:21.524 INFO:teuthology.orchestra.run.smithi150.stdout: "iostat", 2024-09-17T05:49:21.524 INFO:teuthology.orchestra.run.smithi150.stdout: "nfs", 2024-09-17T05:49:21.524 INFO:teuthology.orchestra.run.smithi150.stdout: "restful" 2024-09-17T05:49:21.524 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2024-09-17T05:49:21.525 INFO:teuthology.orchestra.run.smithi150.stdout: "services": {} 2024-09-17T05:49:21.525 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-17T05:49:21.525 INFO:teuthology.orchestra.run.smithi150.stdout: "servicemap": { 2024-09-17T05:49:21.525 INFO:teuthology.orchestra.run.smithi150.stdout: "epoch": 17, 2024-09-17T05:49:21.525 INFO:teuthology.orchestra.run.smithi150.stdout: "modified": "2024-09-17T05:49:15.004587+0000", 2024-09-17T05:49:21.525 INFO:teuthology.orchestra.run.smithi150.stdout: "services": {} 2024-09-17T05:49:21.525 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-17T05:49:21.525 INFO:teuthology.orchestra.run.smithi150.stdout: "progress_events": { 2024-09-17T05:49:21.525 INFO:teuthology.orchestra.run.smithi150.stdout: "mgr-vol-ongoing-clones": { 2024-09-17T05:49:21.525 INFO:teuthology.orchestra.run.smithi150.stdout: "message": "4 ongoing clones - average progress is 31.511% (40s)\n [========....................] (remaining: 88s)", 2024-09-17T05:49:21.525 INFO:teuthology.orchestra.run.smithi150.stdout: "progress": 0.31510999798774719, 2024-09-17T05:49:21.525 INFO:teuthology.orchestra.run.smithi150.stdout: "add_to_ceph_s": true 2024-09-17T05:49:21.525 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-17T05:49:21.526 INFO:teuthology.orchestra.run.smithi150.stdout: "mgr-vol-total-clones": { 2024-09-17T05:49:21.526 INFO:teuthology.orchestra.run.smithi150.stdout: "message": "Total 9 clones - average progress is 14.005% (34s)\n [===.........................] (remaining: 3m)", 2024-09-17T05:49:21.526 INFO:teuthology.orchestra.run.smithi150.stdout: "progress": 0.14004999399185181, 2024-09-17T05:49:21.526 INFO:teuthology.orchestra.run.smithi150.stdout: "add_to_ceph_s": true 2024-09-17T05:49:21.526 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-09-17T05:49:21.526 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-09-17T05:49:21.526 INFO:teuthology.orchestra.run.smithi150.stdout:} 2024-09-17T05:49:21.527 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:21.520+0000 7fc6be3ad640 1 -- 172.21.15.150:0/828322315 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fc6a407a0f0 msgr2=0x7fc6a407c600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:49:21.527 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:21.520+0000 7fc6be3ad640 1 --2- 172.21.15.150:0/828322315 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fc6a407a0f0 0x7fc6a407c600 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7fc6ac0057c0 tx=0x7fc6ac005850 comp rx=0 tx=0).stop 2024-09-17T05:49:21.527 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:21.520+0000 7fc6be3ad640 1 -- 172.21.15.150:0/828322315 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc6b814fa00 msgr2=0x7fc6b81f4d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:49:21.527 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:21.520+0000 7fc6be3ad640 1 --2- 172.21.15.150:0/828322315 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc6b814fa00 0x7fc6b81f4d50 secure :-1 s=READY pgs=1136 cs=0 l=1 rev1=1 crypto rx=0x7fc6b80ad600 tx=0x7fc6b000a430 comp rx=0 tx=0).stop 2024-09-17T05:49:21.527 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:21.520+0000 7fc6be3ad640 1 -- 172.21.15.150:0/828322315 shutdown_connections 2024-09-17T05:49:21.527 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:21.520+0000 7fc6be3ad640 1 --2- 172.21.15.150:0/828322315 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc6b814f5f0 0x7fc6b81f4810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:49:21.528 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:21.520+0000 7fc6be3ad640 1 --2- 172.21.15.150:0/828322315 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fc6a407a0f0 0x7fc6a407c600 unknown :-1 s=CLOSED pgs=487 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:49:21.528 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:21.520+0000 7fc6be3ad640 1 --2- 172.21.15.150:0/828322315 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc6b814fa00 0x7fc6b81f4d50 unknown :-1 s=CLOSED pgs=1136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:49:21.528 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:21.520+0000 7fc6be3ad640 1 --2- 172.21.15.150:0/828322315 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc6a0003f70 0x7fc6b8153f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:49:21.528 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:21.520+0000 7fc6be3ad640 1 -- 172.21.15.150:0/828322315 >> 172.21.15.150:0/828322315 conn(0x7fc6b806d730 msgr2=0x7fc6b80b1d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:49:21.528 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:21.520+0000 7fc6be3ad640 1 -- 172.21.15.150:0/828322315 shutdown_connections 2024-09-17T05:49:21.528 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:21.520+0000 7fc6be3ad640 1 -- 172.21.15.150:0/828322315 wait complete. 2024-09-17T05:49:21.547 INFO:tasks.cephfs.test_volumes:pevs - {'mgr-vol-ongoing-clones': {'message': '4 ongoing clones - average progress is 31.511% (40s)\n [========....................] (remaining: 88s)', 'progress': 0.3151099979877472, 'add_to_ceph_s': True}, 'mgr-vol-total-clones': {'message': 'Total 9 clones - average progress is 14.005% (34s)\n [===.........................] (remaining: 3m)', 'progress': 0.1400499939918518, 'add_to_ceph_s': True}} 2024-09-17T05:49:21.547 INFO:tasks.cephfs.test_volumes:new_onpen_p is less than onpen_p. 2024-09-17T05:49:21.547 INFO:tasks.cephfs.test_volumes:new_onpen_p = 0.1400499939918518; onpen_p = 0.2775999903678894 2024-09-17T05:49:21.548 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs clone cancel cephfs subvol_clone3600 2024-09-17T05:49:21.707 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:21.706+0000 7f7ae78fa640 1 -- 172.21.15.150:0/3954861805 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7ae00b1ea0 msgr2=0x7f7ae00b22b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:49:21.707 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:21.706+0000 7f7ae78fa640 1 --2- 172.21.15.150:0/3954861805 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7ae00b1ea0 0x7f7ae00b22b0 secure :-1 s=READY pgs=1137 cs=0 l=1 rev1=1 crypto rx=0x7f7ae00cfcb0 tx=0x7f7ad802a8e0 comp rx=0 tx=0).stop 2024-09-17T05:49:21.707 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:21.706+0000 7f7ae78fa640 1 -- 172.21.15.150:0/3954861805 shutdown_connections 2024-09-17T05:49:21.707 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:21.706+0000 7f7ae78fa640 1 --2- 172.21.15.150:0/3954861805 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7ae00b1ea0 0x7f7ae00b22b0 unknown :-1 s=CLOSED pgs=1137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:49:21.708 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:21.706+0000 7f7ae78fa640 1 --2- 172.21.15.150:0/3954861805 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7ae00d0110 0x7f7ae00d0b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:49:21.708 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:21.706+0000 7f7ae78fa640 1 --2- 172.21.15.150:0/3954861805 >> v2:172.21.15.176:3300/0 conn(0x7f7ae00cd050 0x7f7ae00b7b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:49:21.708 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:21.706+0000 7f7ae78fa640 1 -- 172.21.15.150:0/3954861805 >> 172.21.15.150:0/3954861805 conn(0x7f7ae00cefc0 msgr2=0x7f7ae00cf3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:49:21.708 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:21.706+0000 7f7ae78fa640 1 -- 172.21.15.150:0/3954861805 shutdown_connections 2024-09-17T05:49:21.708 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:21.706+0000 7f7ae78fa640 1 -- 172.21.15.150:0/3954861805 wait complete. 2024-09-17T05:49:21.709 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:21.708+0000 7f7ae78fa640 1 Processor -- start 2024-09-17T05:49:21.709 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:21.708+0000 7f7ae78fa640 1 -- start start 2024-09-17T05:49:21.711 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:21.710+0000 7f7ae78fa640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7ae00b1ea0 0x7f7ae00b5e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:49:21.711 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:21.710+0000 7f7ae78fa640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7ae00cd050 0x7f7ae006ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:49:21.711 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:21.710+0000 7f7ae78fa640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7ae00d0110 0x7f7ae006f130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:49:21.711 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:21.710+0000 7f7ae78fa640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f7ae00c5e70 con 0x7f7ae00d0110 2024-09-17T05:49:21.711 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:21.710+0000 7f7ae78fa640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f7ae00c5cf0 con 0x7f7ae00b1ea0 2024-09-17T05:49:21.711 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:21.710+0000 7f7ae78fa640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f7ae00d1060 con 0x7f7ae00cd050 2024-09-17T05:49:21.711 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:21.710+0000 7f7ae5e97640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7ae00d0110 0x7f7ae006f130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:49:21.711 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:21.710+0000 7f7ae5e97640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7ae00d0110 0x7f7ae006f130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:53942/0 (socket says 172.21.15.150:53942) 2024-09-17T05:49:21.712 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:21.710+0000 7f7ae5e97640 1 -- 172.21.15.150:0/2966607756 learned_addr learned my addr 172.21.15.150:0/2966607756 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:49:21.712 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:21.710+0000 7f7ae5e97640 1 -- 172.21.15.150:0/2966607756 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7ae00cd050 msgr2=0x7f7ae006ebf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:49:21.712 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:21.710+0000 7f7ae5e97640 1 --2- 172.21.15.150:0/2966607756 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7ae00cd050 0x7f7ae006ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:49:21.712 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:21.710+0000 7f7ae5e97640 1 -- 172.21.15.150:0/2966607756 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7ae00b1ea0 msgr2=0x7f7ae00b5e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:49:21.712 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:21.710+0000 7f7ae5e97640 1 --2- 172.21.15.150:0/2966607756 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7ae00b1ea0 0x7f7ae00b5e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:49:21.712 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:21.710+0000 7f7ae5e97640 1 -- 172.21.15.150:0/2966607756 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7ae015e2d0 con 0x7f7ae00d0110 2024-09-17T05:49:21.712 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:21.711+0000 7f7ae5e97640 1 --2- 172.21.15.150:0/2966607756 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7ae00d0110 0x7f7ae006f130 secure :-1 s=READY pgs=1138 cs=0 l=1 rev1=1 crypto rx=0x7f7ad8005fd0 tx=0x7f7ad8030e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:49:21.714 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:21.711+0000 7f7ad5ffb640 1 -- 172.21.15.150:0/2966607756 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ad8004040 con 0x7f7ae00d0110 2024-09-17T05:49:21.714 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:21.711+0000 7f7ad5ffb640 1 -- 172.21.15.150:0/2966607756 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f7ad80041e0 con 0x7f7ae00d0110 2024-09-17T05:49:21.714 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:21.711+0000 7f7ad5ffb640 1 -- 172.21.15.150:0/2966607756 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ad8004610 con 0x7f7ae00d0110 2024-09-17T05:49:21.714 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:21.711+0000 7f7ae78fa640 1 -- 172.21.15.150:0/2966607756 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7ae015e5b0 con 0x7f7ae00d0110 2024-09-17T05:49:21.714 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:21.711+0000 7f7ae78fa640 1 -- 172.21.15.150:0/2966607756 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7ae015eb70 con 0x7f7ae00d0110 2024-09-17T05:49:21.715 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:21.712+0000 7f7ae78fa640 1 -- 172.21.15.150:0/2966607756 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7ae00d0600 con 0x7f7ae00d0110 2024-09-17T05:49:21.716 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:21.714+0000 7f7ad5ffb640 1 -- 172.21.15.150:0/2966607756 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 29) ==== 103379+0+0 (secure 0 0 0) 0x7f7ad8031470 con 0x7f7ae00d0110 2024-09-17T05:49:21.716 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:21.714+0000 7f7ad5ffb640 1 --2- 172.21.15.150:0/2966607756 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f7ac407a0f0 0x7f7ac407c600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:49:21.716 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:21.714+0000 7f7ad5ffb640 1 -- 172.21.15.150:0/2966607756 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 5822+0+0 (secure 0 0 0) 0x7f7ad80bb2f0 con 0x7f7ae00d0110 2024-09-17T05:49:21.719 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:21.719+0000 7f7ad5ffb640 1 -- 172.21.15.150:0/2966607756 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f7ad80851f0 con 0x7f7ae00d0110 2024-09-17T05:49:21.735 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:21.735+0000 7f7ae5696640 1 --2- 172.21.15.150:0/2966607756 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f7ac407a0f0 0x7f7ac407c600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:49:21.865 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:21.864+0000 7f7ae5696640 1 --2- 172.21.15.150:0/2966607756 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f7ac407a0f0 0x7f7ac407c600 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7f7adc005d20 tx=0x7f7adc005c30 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:49:22.023 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:22.022+0000 7f7ae78fa640 1 -- 172.21.15.150:0/2966607756 --> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] -- mgr_command(tid 0: {"prefix": "fs clone cancel", "vol_name": "cephfs", "clone_name": "subvol_clone3600", "target": ["mon-mgr", ""]}) -- 0x7f7ae015e050 con 0x7f7ac407a0f0 2024-09-17T05:49:22.407 INFO:tasks.ceph.mgr.x.smithi176.stderr:2024-09-17T05:49:22.405+0000 7f33d771a640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-17T05:49:22.407 INFO:tasks.ceph.mgr.x.smithi176.stderr:2024-09-17T05:49:22.405+0000 7f33d771a640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-17T05:49:22.407 INFO:tasks.ceph.mgr.x.smithi176.stderr:2024-09-17T05:49:22.405+0000 7f33d771a640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-17T05:49:22.408 INFO:tasks.ceph.mgr.x.smithi176.stderr:2024-09-17T05:49:22.405+0000 7f33d771a640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-17T05:49:22.408 INFO:tasks.ceph.mgr.x.smithi176.stderr:2024-09-17T05:49:22.405+0000 7f33d771a640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-17T05:49:23.017 INFO:tasks.ceph.mgr.x.smithi176.stderr:2024-09-17T05:49:23.013+0000 7f33d771a640 -1 mgr.server reply reply (22) Invalid argument cannot cancel -- clone finished (check clone status) 2024-09-17T05:49:23.051 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:23.050+0000 7f7ad5ffb640 1 -- 172.21.15.150:0/2966607756 <== mgr.4108 v2:172.21.15.176:6800/3631216395 1 ==== mgr_command_reply(tid 0: -22 cannot cancel -- clone finished (check clone status)) ==== 60+0+0 (secure 0 0 0) 0x7f7adc005dc0 con 0x7f7ac407a0f0 2024-09-17T05:49:23.051 INFO:teuthology.orchestra.run.smithi150.stderr:Error EINVAL: cannot cancel -- clone finished (check clone status) 2024-09-17T05:49:23.060 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-17T05:49:23.060 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs clone cancel cephfs subvol_clone91801 2024-09-17T05:49:23.269 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:23.267+0000 7f05d7a94640 1 -- 172.21.15.150:0/3441280498 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f05d015c130 msgr2=0x7f05d00b6380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:49:23.269 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:23.268+0000 7f05d7a94640 1 --2- 172.21.15.150:0/3441280498 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f05d015c130 0x7f05d00b6380 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f05cc009830 tx=0x7f05cc02a510 comp rx=0 tx=0).stop 2024-09-17T05:49:23.269 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:23.268+0000 7f05d7a94640 1 -- 172.21.15.150:0/3441280498 shutdown_connections 2024-09-17T05:49:23.269 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:23.268+0000 7f05d7a94640 1 --2- 172.21.15.150:0/3441280498 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f05d006e4c0 0x7f05d015eef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:49:23.269 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:23.268+0000 7f05d7a94640 1 --2- 172.21.15.150:0/3441280498 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f05d015c130 0x7f05d00b6380 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:49:23.269 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:23.268+0000 7f05d7a94640 1 -- 172.21.15.150:0/3441280498 >> 172.21.15.150:0/3441280498 conn(0x7f05d0073890 msgr2=0x7f05d0073ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:49:23.269 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:23.268+0000 7f05d7a94640 1 -- 172.21.15.150:0/3441280498 shutdown_connections 2024-09-17T05:49:23.269 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:23.268+0000 7f05d7a94640 1 -- 172.21.15.150:0/3441280498 wait complete. 2024-09-17T05:49:23.272 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:23.271+0000 7f05d7a94640 1 Processor -- start 2024-09-17T05:49:23.272 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:23.271+0000 7f05d7a94640 1 -- start start 2024-09-17T05:49:23.274 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:23.273+0000 7f05d7a94640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f05d015c130 0x7f05d014f200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:49:23.274 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:23.273+0000 7f05d7a94640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f05d015eae0 0x7f05d014f740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:49:23.274 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:23.273+0000 7f05d7a94640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f05d0155b70 0x7f05d0155f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:49:23.274 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:23.273+0000 7f05d7a94640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f05d00761c0 con 0x7f05d015eae0 2024-09-17T05:49:23.274 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:23.273+0000 7f05d7a94640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f05d0076040 con 0x7f05d015c130 2024-09-17T05:49:23.274 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:23.273+0000 7f05d7a94640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f05d0076340 con 0x7f05d0155b70 2024-09-17T05:49:23.274 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:23.273+0000 7f05d502f640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f05d015eae0 0x7f05d014f740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:49:23.274 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:23.273+0000 7f05d502f640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f05d015eae0 0x7f05d014f740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:53956/0 (socket says 172.21.15.150:53956) 2024-09-17T05:49:23.274 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:23.273+0000 7f05d502f640 1 -- 172.21.15.150:0/752614137 learned_addr learned my addr 172.21.15.150:0/752614137 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:49:23.275 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:23.273+0000 7f05d502f640 1 -- 172.21.15.150:0/752614137 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f05d0155b70 msgr2=0x7f05d0155f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:49:23.275 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:23.273+0000 7f05d502f640 1 --2- 172.21.15.150:0/752614137 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f05d0155b70 0x7f05d0155f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:49:23.275 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:23.273+0000 7f05d502f640 1 -- 172.21.15.150:0/752614137 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f05d015c130 msgr2=0x7f05d014f200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:49:23.275 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:23.273+0000 7f05d502f640 1 --2- 172.21.15.150:0/752614137 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f05d015c130 0x7f05d014f200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:49:23.275 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:23.273+0000 7f05d502f640 1 -- 172.21.15.150:0/752614137 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f05d0159c20 con 0x7f05d015eae0 2024-09-17T05:49:23.275 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:23.273+0000 7f05d502f640 1 --2- 172.21.15.150:0/752614137 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f05d015eae0 0x7f05d014f740 secure :-1 s=READY pgs=1140 cs=0 l=1 rev1=1 crypto rx=0x7f05c000c400 tx=0x7f05c000c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:49:23.276 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:23.275+0000 7f05c67fc640 1 -- 172.21.15.150:0/752614137 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05c0011790 con 0x7f05d015eae0 2024-09-17T05:49:23.276 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:23.275+0000 7f05c67fc640 1 -- 172.21.15.150:0/752614137 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f05c0017070 con 0x7f05d015eae0 2024-09-17T05:49:23.276 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:23.275+0000 7f05c67fc640 1 -- 172.21.15.150:0/752614137 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05c0011d00 con 0x7f05d015eae0 2024-09-17T05:49:23.276 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:23.275+0000 7f05d7a94640 1 -- 172.21.15.150:0/752614137 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f05d0159f00 con 0x7f05d015eae0 2024-09-17T05:49:23.276 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:23.276+0000 7f05d7a94640 1 -- 172.21.15.150:0/752614137 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f05d015a4c0 con 0x7f05d015eae0 2024-09-17T05:49:23.277 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:23.277+0000 7f05d7a94640 1 -- 172.21.15.150:0/752614137 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f05d015eef0 con 0x7f05d015eae0 2024-09-17T05:49:23.279 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:23.278+0000 7f05c67fc640 1 -- 172.21.15.150:0/752614137 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 29) ==== 103379+0+0 (secure 0 0 0) 0x7f05c001c460 con 0x7f05d015eae0 2024-09-17T05:49:23.280 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:23.279+0000 7f05c67fc640 1 --2- 172.21.15.150:0/752614137 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f05b407a0f0 0x7f05b407c600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:49:23.280 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:23.279+0000 7f05c67fc640 1 -- 172.21.15.150:0/752614137 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 5822+0+0 (secure 0 0 0) 0x7f05c0099b30 con 0x7f05d015eae0 2024-09-17T05:49:23.286 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:23.285+0000 7f05c67fc640 1 -- 172.21.15.150:0/752614137 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f05c00636b0 con 0x7f05d015eae0 2024-09-17T05:49:23.321 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:23.320+0000 7f05d5830640 1 --2- 172.21.15.150:0/752614137 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f05b407a0f0 0x7f05b407c600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:49:23.335 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:23.334+0000 7f05c67fc640 1 -- 172.21.15.150:0/752614137 <== mon.0 v2:172.21.15.150:3300/0 7 ==== mgrmap(e 30) ==== 103430+0+0 (secure 0 0 0) 0x7f05c005f220 con 0x7f05d015eae0 2024-09-17T05:49:23.405 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:23.404+0000 7f05d5830640 1 --2- 172.21.15.150:0/752614137 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f05b407a0f0 0x7f05b407c600 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7f05cc034000 tx=0x7f05cc0046c0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:49:23.606 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:23.605+0000 7f05d7a94640 1 -- 172.21.15.150:0/752614137 --> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] -- mgr_command(tid 0: {"prefix": "fs clone cancel", "vol_name": "cephfs", "clone_name": "subvol_clone91801", "target": ["mon-mgr", ""]}) -- 0x7f05d0151300 con 0x7f05b407a0f0 2024-09-17T05:49:25.302 INFO:tasks.ceph.mgr.x.smithi176.stderr:2024-09-17T05:49:25.300+0000 7f33d771a640 -1 mgr.server reply reply (22) Invalid argument cannot cancel -- clone finished (check clone status) 2024-09-17T05:49:25.302 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:25.301+0000 7f05c67fc640 1 -- 172.21.15.150:0/752614137 <== mgr.4108 v2:172.21.15.176:6800/3631216395 1 ==== mgr_command_reply(tid 0: -22 cannot cancel -- clone finished (check clone status)) ==== 60+0+0 (secure 0 0 0) 0x7f05d0151300 con 0x7f05b407a0f0 2024-09-17T05:49:25.303 INFO:teuthology.orchestra.run.smithi150.stderr:Error EINVAL: cannot cancel -- clone finished (check clone status) 2024-09-17T05:49:25.311 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-17T05:49:25.312 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs clone cancel cephfs subvol_clone73572 2024-09-17T05:49:25.496 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:25.495+0000 7f12ada8c640 1 -- 172.21.15.150:0/2616485534 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f12a806e2f0 msgr2=0x7f12a80cf2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:49:25.496 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:25.495+0000 7f12ada8c640 1 --2- 172.21.15.150:0/2616485534 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f12a806e2f0 0x7f12a80cf2a0 secure :-1 s=READY pgs=1141 cs=0 l=1 rev1=1 crypto rx=0x7f12a81562f0 tx=0x7f12a002a980 comp rx=0 tx=0).stop 2024-09-17T05:49:25.497 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:25.495+0000 7f12ada8c640 1 -- 172.21.15.150:0/2616485534 shutdown_connections 2024-09-17T05:49:25.497 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:25.495+0000 7f12ada8c640 1 --2- 172.21.15.150:0/2616485534 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f12a806e2f0 0x7f12a80cf2a0 unknown :-1 s=CLOSED pgs=1141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:49:25.497 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:25.495+0000 7f12ada8c640 1 --2- 172.21.15.150:0/2616485534 >> v2:172.21.15.176:3300/0 conn(0x7f12a8071230 0x7f12a806ddb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:49:25.497 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:25.495+0000 7f12ada8c640 1 -- 172.21.15.150:0/2616485534 >> 172.21.15.150:0/2616485534 conn(0x7f12a8073890 msgr2=0x7f12a8073ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:49:25.497 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:25.495+0000 7f12ada8c640 1 -- 172.21.15.150:0/2616485534 shutdown_connections 2024-09-17T05:49:25.497 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:25.495+0000 7f12ada8c640 1 -- 172.21.15.150:0/2616485534 wait complete. 2024-09-17T05:49:25.497 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:25.497+0000 7f12ada8c640 1 Processor -- start 2024-09-17T05:49:25.498 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:25.497+0000 7f12ada8c640 1 -- start start 2024-09-17T05:49:25.500 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:25.498+0000 7f12ada8c640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f12a806e2f0 0x7f12a8142670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:49:25.500 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:25.498+0000 7f12ada8c640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f12a8071230 0x7f12a80a9aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:49:25.500 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:25.498+0000 7f12ada8c640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f12a815ce40 0x7f12a80a9fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:49:25.500 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:25.498+0000 7f12ada8c640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f12a80cf960 con 0x7f12a806e2f0 2024-09-17T05:49:25.500 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:25.498+0000 7f12ada8c640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f12a80cf7e0 con 0x7f12a8071230 2024-09-17T05:49:25.500 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:25.499+0000 7f12ada8c640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f12a80cfae0 con 0x7f12a815ce40 2024-09-17T05:49:25.500 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:25.499+0000 7f12a77fe640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f12a806e2f0 0x7f12a8142670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:49:25.500 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:25.499+0000 7f12a77fe640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f12a806e2f0 0x7f12a8142670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:53972/0 (socket says 172.21.15.150:53972) 2024-09-17T05:49:25.500 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:25.499+0000 7f12a77fe640 1 -- 172.21.15.150:0/2964945521 learned_addr learned my addr 172.21.15.150:0/2964945521 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:49:25.500 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:25.499+0000 7f12a77fe640 1 -- 172.21.15.150:0/2964945521 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f12a815ce40 msgr2=0x7f12a80a9fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:49:25.500 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:25.499+0000 7f12a77fe640 1 --2- 172.21.15.150:0/2964945521 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f12a815ce40 0x7f12a80a9fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:49:25.500 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:25.499+0000 7f12a77fe640 1 -- 172.21.15.150:0/2964945521 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f12a8071230 msgr2=0x7f12a80a9aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:49:25.501 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:25.499+0000 7f12a77fe640 1 --2- 172.21.15.150:0/2964945521 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f12a8071230 0x7f12a80a9aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:49:25.501 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:25.499+0000 7f12a77fe640 1 -- 172.21.15.150:0/2964945521 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f12a8142bb0 con 0x7f12a806e2f0 2024-09-17T05:49:25.501 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:25.499+0000 7f12a77fe640 1 --2- 172.21.15.150:0/2964945521 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f12a806e2f0 0x7f12a8142670 secure :-1 s=READY pgs=1142 cs=0 l=1 rev1=1 crypto rx=0x7f129800b410 tx=0x7f129800b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:49:25.501 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:25.499+0000 7f128ffff640 1 -- 172.21.15.150:0/2964945521 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1298012b80 con 0x7f12a806e2f0 2024-09-17T05:49:25.502 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:25.500+0000 7f12ada8c640 1 -- 172.21.15.150:0/2964945521 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f12a814d770 con 0x7f12a806e2f0 2024-09-17T05:49:25.502 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:25.500+0000 7f128ffff640 1 -- 172.21.15.150:0/2964945521 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f1298012e10 con 0x7f12a806e2f0 2024-09-17T05:49:25.502 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:25.500+0000 7f128ffff640 1 -- 172.21.15.150:0/2964945521 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f129801b660 con 0x7f12a806e2f0 2024-09-17T05:49:25.502 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:25.500+0000 7f12ada8c640 1 -- 172.21.15.150:0/2964945521 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f12a81f61f0 con 0x7f12a806e2f0 2024-09-17T05:49:25.502 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:25.501+0000 7f12ada8c640 1 -- 172.21.15.150:0/2964945521 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f12a80d0060 con 0x7f12a806e2f0 2024-09-17T05:49:25.502 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:25.502+0000 7f128ffff640 1 -- 172.21.15.150:0/2964945521 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 30) ==== 103430+0+0 (secure 0 0 0) 0x7f1298004020 con 0x7f12a806e2f0 2024-09-17T05:49:25.503 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:25.502+0000 7f128ffff640 1 --2- 172.21.15.150:0/2964945521 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f129407a1b0 0x7f129407c6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:49:25.503 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:25.503+0000 7f128ffff640 1 -- 172.21.15.150:0/2964945521 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 5822+0+0 (secure 0 0 0) 0x7f129809d960 con 0x7f12a806e2f0 2024-09-17T05:49:25.508 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:25.507+0000 7f128ffff640 1 -- 172.21.15.150:0/2964945521 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f1298017030 con 0x7f12a806e2f0 2024-09-17T05:49:25.524 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:25.523+0000 7f12a6ffd640 1 --2- 172.21.15.150:0/2964945521 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f129407a1b0 0x7f129407c6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:49:25.549 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:25.548+0000 7f12a6ffd640 1 --2- 172.21.15.150:0/2964945521 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f129407a1b0 0x7f129407c6c0 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7f12a81f5e70 tx=0x7f129c005b50 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:49:25.846 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:25.845+0000 7f12ada8c640 1 -- 172.21.15.150:0/2964945521 --> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] -- mgr_command(tid 0: {"prefix": "fs clone cancel", "vol_name": "cephfs", "clone_name": "subvol_clone73572", "target": ["mon-mgr", ""]}) -- 0x7f12a80cf210 con 0x7f129407a1b0 2024-09-17T05:49:25.998 INFO:tasks.ceph.mgr.x.smithi176.stderr:2024-09-17T05:49:25.995+0000 7f33d771a640 -1 mgr.server reply reply (22) Invalid argument cannot cancel -- clone finished (check clone status) 2024-09-17T05:49:26.001 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:26.001+0000 7f128ffff640 1 -- 172.21.15.150:0/2964945521 <== mgr.4108 v2:172.21.15.176:6800/3631216395 1 ==== mgr_command_reply(tid 0: -22 cannot cancel -- clone finished (check clone status)) ==== 60+0+0 (secure 0 0 0) 0x7f12a80cf210 con 0x7f129407a1b0 2024-09-17T05:49:26.001 INFO:teuthology.orchestra.run.smithi150.stderr:Error EINVAL: cannot cancel -- clone finished (check clone status) 2024-09-17T05:49:26.013 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-17T05:49:26.014 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs clone cancel cephfs subvol_clone17383 2024-09-17T05:49:26.182 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:26.181+0000 7f7e4f3ad640 1 -- 172.21.15.150:0/913507425 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7e4815fc70 msgr2=0x7f7e4806ff40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:49:26.182 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:26.181+0000 7f7e4f3ad640 1 --2- 172.21.15.150:0/913507425 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7e4815fc70 0x7f7e4806ff40 secure :-1 s=READY pgs=1143 cs=0 l=1 rev1=1 crypto rx=0x7f7e4806f440 tx=0x7f7e4002a560 comp rx=0 tx=0).stop 2024-09-17T05:49:26.182 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:26.181+0000 7f7e4f3ad640 1 -- 172.21.15.150:0/913507425 shutdown_connections 2024-09-17T05:49:26.182 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:26.181+0000 7f7e4f3ad640 1 --2- 172.21.15.150:0/913507425 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7e4815fc70 0x7f7e4806ff40 unknown :-1 s=CLOSED pgs=1143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:49:26.182 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:26.181+0000 7f7e4f3ad640 1 --2- 172.21.15.150:0/913507425 >> v2:172.21.15.176:3300/0 conn(0x7f7e4815f320 0x7f7e4815f730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:49:26.182 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:26.181+0000 7f7e4f3ad640 1 --2- 172.21.15.150:0/913507425 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7e480ad8c0 0x7f7e480adcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:49:26.183 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:26.181+0000 7f7e4f3ad640 1 -- 172.21.15.150:0/913507425 >> 172.21.15.150:0/913507425 conn(0x7f7e48074840 msgr2=0x7f7e4806cda0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:49:26.183 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:26.181+0000 7f7e4f3ad640 1 -- 172.21.15.150:0/913507425 shutdown_connections 2024-09-17T05:49:26.183 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:26.181+0000 7f7e4f3ad640 1 -- 172.21.15.150:0/913507425 wait complete. 2024-09-17T05:49:26.183 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:26.183+0000 7f7e4f3ad640 1 Processor -- start 2024-09-17T05:49:26.184 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:26.183+0000 7f7e4f3ad640 1 -- start start 2024-09-17T05:49:26.187 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:26.185+0000 7f7e4f3ad640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7e480ad8c0 0x7f7e481f8ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:49:26.187 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:26.185+0000 7f7e4f3ad640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7e4815f320 0x7f7e481e9d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:49:26.187 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:26.185+0000 7f7e4f3ad640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7e4815fc70 0x7f7e48149620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:49:26.187 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:26.185+0000 7f7e4f3ad640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f7e48070810 con 0x7f7e4815f320 2024-09-17T05:49:26.187 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:26.185+0000 7f7e4f3ad640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f7e48070690 con 0x7f7e4815fc70 2024-09-17T05:49:26.187 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:26.185+0000 7f7e4f3ad640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f7e48070990 con 0x7f7e480ad8c0 2024-09-17T05:49:26.187 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:26.185+0000 7f7e4c948640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7e4815f320 0x7f7e481e9d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:49:26.187 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:26.185+0000 7f7e4c948640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7e4815f320 0x7f7e481e9d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:53992/0 (socket says 172.21.15.150:53992) 2024-09-17T05:49:26.187 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:26.185+0000 7f7e4c948640 1 -- 172.21.15.150:0/1419590240 learned_addr learned my addr 172.21.15.150:0/1419590240 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:49:26.187 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:26.185+0000 7f7e4c948640 1 -- 172.21.15.150:0/1419590240 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7e480ad8c0 msgr2=0x7f7e481f8ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:49:26.188 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:26.185+0000 7f7e4c948640 1 --2- 172.21.15.150:0/1419590240 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7e480ad8c0 0x7f7e481f8ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:49:26.188 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:26.185+0000 7f7e4c948640 1 -- 172.21.15.150:0/1419590240 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7e4815fc70 msgr2=0x7f7e48149620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:49:26.188 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:26.185+0000 7f7e4c948640 1 --2- 172.21.15.150:0/1419590240 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7e4815fc70 0x7f7e48149620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:49:26.188 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:26.185+0000 7f7e4c948640 1 -- 172.21.15.150:0/1419590240 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7e481f9420 con 0x7f7e4815f320 2024-09-17T05:49:26.188 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:26.186+0000 7f7e4c948640 1 --2- 172.21.15.150:0/1419590240 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7e4815f320 0x7f7e481e9d40 secure :-1 s=READY pgs=1144 cs=0 l=1 rev1=1 crypto rx=0x7f7e3800b410 tx=0x7f7e3800b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:49:26.188 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:26.186+0000 7f7e3dffb640 1 -- 172.21.15.150:0/1419590240 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e38015020 con 0x7f7e4815f320 2024-09-17T05:49:26.188 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:26.186+0000 7f7e3dffb640 1 -- 172.21.15.150:0/1419590240 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f7e38011940 con 0x7f7e4815f320 2024-09-17T05:49:26.188 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:26.186+0000 7f7e4f3ad640 1 -- 172.21.15.150:0/1419590240 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7e481f9910 con 0x7f7e4815f320 2024-09-17T05:49:26.188 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:26.186+0000 7f7e3dffb640 1 -- 172.21.15.150:0/1419590240 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e38011d90 con 0x7f7e4815f320 2024-09-17T05:49:26.188 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:26.186+0000 7f7e4f3ad640 1 -- 172.21.15.150:0/1419590240 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7e481e9540 con 0x7f7e4815f320 2024-09-17T05:49:26.189 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:26.188+0000 7f7e4f3ad640 1 -- 172.21.15.150:0/1419590240 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7e4806ff40 con 0x7f7e4815f320 2024-09-17T05:49:26.189 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:26.189+0000 7f7e3dffb640 1 -- 172.21.15.150:0/1419590240 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 30) ==== 103430+0+0 (secure 0 0 0) 0x7f7e38018020 con 0x7f7e4815f320 2024-09-17T05:49:26.190 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:26.189+0000 7f7e3dffb640 1 --2- 172.21.15.150:0/1419590240 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f7e2c07a180 0x7f7e2c07c690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:49:26.190 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:26.189+0000 7f7e3dffb640 1 -- 172.21.15.150:0/1419590240 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 5822+0+0 (secure 0 0 0) 0x7f7e38099da0 con 0x7f7e4815f320 2024-09-17T05:49:26.197 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:26.196+0000 7f7e3dffb640 1 -- 172.21.15.150:0/1419590240 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f7e3801f020 con 0x7f7e4815f320 2024-09-17T05:49:26.213 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:26.212+0000 7f7e4d149640 1 --2- 172.21.15.150:0/1419590240 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f7e2c07a180 0x7f7e2c07c690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:49:26.240 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:26.240+0000 7f7e4d149640 1 --2- 172.21.15.150:0/1419590240 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f7e2c07a180 0x7f7e2c07c690 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7f7e4400ab90 tx=0x7f7e44009250 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:49:26.272 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-17T05:49:26.275 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-17T05:49:26.533 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:26.532+0000 7f7e4f3ad640 1 -- 172.21.15.150:0/1419590240 --> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] -- mgr_command(tid 0: {"prefix": "fs clone cancel", "vol_name": "cephfs", "clone_name": "subvol_clone17383", "target": ["mon-mgr", ""]}) -- 0x7f7e481f96a0 con 0x7f7e2c07a180 2024-09-17T05:49:26.764 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:26.763+0000 7f7e3dffb640 1 -- 172.21.15.150:0/1419590240 <== mgr.4108 v2:172.21.15.176:6800/3631216395 1 ==== mgr_command_reply(tid 0: -22 cannot cancel -- clone finished (check clone status)) ==== 60+0+0 (secure 0 0 0) 0x7f7e481f96a0 con 0x7f7e2c07a180 2024-09-17T05:49:26.764 INFO:teuthology.orchestra.run.smithi150.stderr:Error EINVAL: cannot cancel -- clone finished (check clone status) 2024-09-17T05:49:26.765 INFO:tasks.ceph.mgr.x.smithi176.stderr:2024-09-17T05:49:26.757+0000 7f33d771a640 -1 mgr.server reply reply (22) Invalid argument cannot cancel -- clone finished (check clone status) 2024-09-17T05:49:26.778 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-17T05:49:26.779 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs clone cancel cephfs subvol_clone59314 2024-09-17T05:49:26.978 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:26.977+0000 7fac1d1da640 1 -- 172.21.15.150:0/1118896772 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fac04003a50 msgr2=0x7fac04003ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:49:26.979 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:26.977+0000 7fac1d1da640 1 --2- 172.21.15.150:0/1118896772 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fac04003a50 0x7fac04003ec0 secure :-1 s=READY pgs=1146 cs=0 l=1 rev1=1 crypto rx=0x7fac080016e0 tx=0x7fac04005830 comp rx=0 tx=0).stop 2024-09-17T05:49:26.979 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:26.977+0000 7fac1d1da640 1 -- 172.21.15.150:0/1118896772 shutdown_connections 2024-09-17T05:49:26.979 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:26.977+0000 7fac1d1da640 1 --2- 172.21.15.150:0/1118896772 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fac04003a50 0x7fac04003ec0 unknown :-1 s=CLOSED pgs=1146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:49:26.979 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:26.977+0000 7fac1d1da640 1 -- 172.21.15.150:0/1118896772 >> 172.21.15.150:0/1118896772 conn(0x7fac180cef20 msgr2=0x7fac180cf330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:49:26.979 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:26.977+0000 7fac1d1da640 1 -- 172.21.15.150:0/1118896772 shutdown_connections 2024-09-17T05:49:26.979 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:26.978+0000 7fac1d1da640 1 -- 172.21.15.150:0/1118896772 wait complete. 2024-09-17T05:49:26.981 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:26.980+0000 7fac1d1da640 1 Processor -- start 2024-09-17T05:49:26.981 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:26.980+0000 7fac1d1da640 1 -- start start 2024-09-17T05:49:26.984 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:26.982+0000 7fac1d1da640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fac04003a50 0x7fac180b6910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:49:26.984 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:26.982+0000 7fac1d1da640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fac181f5190 0x7fac1815b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:49:26.984 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:26.982+0000 7fac1d1da640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fac181f55a0 0x7fac1815b5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:49:26.984 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:26.982+0000 7fac1d1da640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7fac180ced10 con 0x7fac181f55a0 2024-09-17T05:49:26.984 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:26.982+0000 7fac1d1da640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fac180ceb90 con 0x7fac04003a50 2024-09-17T05:49:26.984 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:26.982+0000 7fac1d1da640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fac180d0a80 con 0x7fac181f5190 2024-09-17T05:49:26.984 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:26.983+0000 7fac1759e640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fac181f55a0 0x7fac1815b5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:49:26.984 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:26.983+0000 7fac1759e640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fac181f55a0 0x7fac1815b5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:54012/0 (socket says 172.21.15.150:54012) 2024-09-17T05:49:26.984 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:26.983+0000 7fac1759e640 1 -- 172.21.15.150:0/3528802396 learned_addr learned my addr 172.21.15.150:0/3528802396 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:49:26.984 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:26.983+0000 7fac1759e640 1 -- 172.21.15.150:0/3528802396 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fac181f5190 msgr2=0x7fac1815b0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:49:26.984 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:26.983+0000 7fac1759e640 1 --2- 172.21.15.150:0/3528802396 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fac181f5190 0x7fac1815b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:49:26.984 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:26.983+0000 7fac1759e640 1 -- 172.21.15.150:0/3528802396 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fac04003a50 msgr2=0x7fac180b6910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:49:26.985 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:26.983+0000 7fac1759e640 1 --2- 172.21.15.150:0/3528802396 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fac04003a50 0x7fac180b6910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:49:26.985 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:26.983+0000 7fac1759e640 1 -- 172.21.15.150:0/3528802396 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fac180b6e50 con 0x7fac181f55a0 2024-09-17T05:49:26.986 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:26.984+0000 7fac1759e640 1 --2- 172.21.15.150:0/3528802396 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fac181f55a0 0x7fac1815b5e0 secure :-1 s=READY pgs=1147 cs=0 l=1 rev1=1 crypto rx=0x7fac180d00b0 tx=0x7fac1000eda0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:49:26.986 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:26.984+0000 7fac0f7fe640 1 -- 172.21.15.150:0/3528802396 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac10004b20 con 0x7fac181f55a0 2024-09-17T05:49:26.986 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:26.984+0000 7fac0f7fe640 1 -- 172.21.15.150:0/3528802396 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fac10004dd0 con 0x7fac181f55a0 2024-09-17T05:49:26.986 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:26.984+0000 7fac0f7fe640 1 -- 172.21.15.150:0/3528802396 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac1000cc90 con 0x7fac181f55a0 2024-09-17T05:49:26.986 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:26.984+0000 7fac1d1da640 1 -- 172.21.15.150:0/3528802396 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fac1815e1e0 con 0x7fac181f55a0 2024-09-17T05:49:26.986 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:26.985+0000 7fac1d1da640 1 -- 172.21.15.150:0/3528802396 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fac1815e7a0 con 0x7fac181f55a0 2024-09-17T05:49:26.988 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:26.987+0000 7fac1d1da640 1 -- 172.21.15.150:0/3528802396 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fac180d0f50 con 0x7fac181f55a0 2024-09-17T05:49:26.989 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:26.989+0000 7fac0f7fe640 1 -- 172.21.15.150:0/3528802396 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 30) ==== 103430+0+0 (secure 0 0 0) 0x7fac1001b020 con 0x7fac181f55a0 2024-09-17T05:49:26.990 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:26.990+0000 7fac0f7fe640 1 --2- 172.21.15.150:0/3528802396 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fabf807a1b0 0x7fabf807c6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:49:26.991 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:26.990+0000 7fac0f7fe640 1 -- 172.21.15.150:0/3528802396 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 5822+0+0 (secure 0 0 0) 0x7fac10099970 con 0x7fac181f55a0 2024-09-17T05:49:27.002 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:27.000+0000 7fac0f7fe640 1 -- 172.21.15.150:0/3528802396 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fac10063800 con 0x7fac181f55a0 2024-09-17T05:49:27.006 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:27.006+0000 7fac16d9d640 1 --2- 172.21.15.150:0/3528802396 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fabf807a1b0 0x7fabf807c6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:49:27.042 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:27.042+0000 7fac16d9d640 1 --2- 172.21.15.150:0/3528802396 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fabf807a1b0 0x7fabf807c6c0 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7fac180d2470 tx=0x7fac08001170 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:49:27.328 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:27.327+0000 7fac1d1da640 1 -- 172.21.15.150:0/3528802396 --> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] -- mgr_command(tid 0: {"prefix": "fs clone cancel", "vol_name": "cephfs", "clone_name": "subvol_clone59314", "target": ["mon-mgr", ""]}) -- 0x7fac1815df00 con 0x7fabf807a1b0 2024-09-17T05:49:28.104 INFO:tasks.ceph.mgr.x.smithi176.stderr:2024-09-17T05:49:28.103+0000 7f33d771a640 -1 mgr.server reply reply (22) Invalid argument cannot cancel -- clone finished (check clone status) 2024-09-17T05:49:28.109 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:28.108+0000 7fac0f7fe640 1 -- 172.21.15.150:0/3528802396 <== mgr.4108 v2:172.21.15.176:6800/3631216395 1 ==== mgr_command_reply(tid 0: -22 cannot cancel -- clone finished (check clone status)) ==== 60+0+0 (secure 0 0 0) 0x7fac1815df00 con 0x7fabf807a1b0 2024-09-17T05:49:28.109 INFO:teuthology.orchestra.run.smithi150.stderr:Error EINVAL: cannot cancel -- clone finished (check clone status) 2024-09-17T05:49:28.121 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-17T05:49:28.121 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs clone cancel cephfs subvol_clone57205 2024-09-17T05:49:28.293 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:28.292+0000 7f35e687e640 1 -- 172.21.15.150:0/2780745450 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f35e0152740 msgr2=0x7f35e00b63a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:49:28.294 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:28.292+0000 7f35e687e640 1 --2- 172.21.15.150:0/2780745450 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f35e0152740 0x7f35e00b63a0 secure :-1 s=READY pgs=1149 cs=0 l=1 rev1=1 crypto rx=0x7f35d4009830 tx=0x7f35d402a410 comp rx=0 tx=0).stop 2024-09-17T05:49:28.294 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:28.292+0000 7f35e687e640 1 -- 172.21.15.150:0/2780745450 shutdown_connections 2024-09-17T05:49:28.294 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:28.293+0000 7f35e687e640 1 --2- 172.21.15.150:0/2780745450 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f35e0152740 0x7f35e00b63a0 unknown :-1 s=CLOSED pgs=1149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:49:28.294 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:28.293+0000 7f35e687e640 1 -- 172.21.15.150:0/2780745450 >> 172.21.15.150:0/2780745450 conn(0x7f35e0074840 msgr2=0x7f35e006cda0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:49:28.294 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:28.294+0000 7f35e687e640 1 -- 172.21.15.150:0/2780745450 shutdown_connections 2024-09-17T05:49:28.294 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:28.294+0000 7f35e687e640 1 -- 172.21.15.150:0/2780745450 wait complete. 2024-09-17T05:49:28.297 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:28.296+0000 7f35e687e640 1 Processor -- start 2024-09-17T05:49:28.298 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:28.297+0000 7f35e687e640 1 -- start start 2024-09-17T05:49:28.299 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:28.298+0000 7f35e687e640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f35e0075f30 0x7f35e014f800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:49:28.299 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:28.298+0000 7f35e687e640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f35e00b68e0 0x7f35e01f3080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:49:28.300 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:28.298+0000 7f35e687e640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f35e01f35c0 0x7f35e01e4c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:49:28.300 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:28.298+0000 7f35e687e640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f35e00cffd0 con 0x7f35e00b68e0 2024-09-17T05:49:28.300 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:28.298+0000 7f35e687e640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f35e00cfe50 con 0x7f35e01f35c0 2024-09-17T05:49:28.300 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:28.298+0000 7f35e687e640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f35e00d0150 con 0x7f35e0075f30 2024-09-17T05:49:28.300 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:28.299+0000 7f35df7fe640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f35e00b68e0 0x7f35e01f3080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:49:28.300 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:28.299+0000 7f35df7fe640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f35e00b68e0 0x7f35e01f3080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:54028/0 (socket says 172.21.15.150:54028) 2024-09-17T05:49:28.301 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:28.299+0000 7f35df7fe640 1 -- 172.21.15.150:0/859821113 learned_addr learned my addr 172.21.15.150:0/859821113 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:49:28.301 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:28.299+0000 7f35df7fe640 1 -- 172.21.15.150:0/859821113 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f35e0075f30 msgr2=0x7f35e014f800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:49:28.301 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:28.299+0000 7f35df7fe640 1 --2- 172.21.15.150:0/859821113 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f35e0075f30 0x7f35e014f800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:49:28.301 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:28.299+0000 7f35df7fe640 1 -- 172.21.15.150:0/859821113 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f35e01f35c0 msgr2=0x7f35e01e4c60 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-17T05:49:28.301 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:28.299+0000 7f35df7fe640 1 --2- 172.21.15.150:0/859821113 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f35e01f35c0 0x7f35e01e4c60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:49:28.301 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:28.299+0000 7f35df7fe640 1 -- 172.21.15.150:0/859821113 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f35e01f7110 con 0x7f35e00b68e0 2024-09-17T05:49:28.301 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:28.299+0000 7f35df7fe640 1 --2- 172.21.15.150:0/859821113 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f35e00b68e0 0x7f35e01f3080 secure :-1 s=READY pgs=1150 cs=0 l=1 rev1=1 crypto rx=0x7f35d4009780 tx=0x7f35d4004620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:49:28.301 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:28.300+0000 7f35dcff9640 1 -- 172.21.15.150:0/859821113 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35d4037040 con 0x7f35e00b68e0 2024-09-17T05:49:28.302 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:28.300+0000 7f35dcff9640 1 -- 172.21.15.150:0/859821113 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f35d4005310 con 0x7f35e00b68e0 2024-09-17T05:49:28.302 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:28.300+0000 7f35dcff9640 1 -- 172.21.15.150:0/859821113 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35d4033e30 con 0x7f35e00b68e0 2024-09-17T05:49:28.302 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:28.300+0000 7f35e687e640 1 -- 172.21.15.150:0/859821113 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f35e01f73b0 con 0x7f35e00b68e0 2024-09-17T05:49:28.302 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:28.300+0000 7f35e687e640 1 -- 172.21.15.150:0/859821113 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f35e01f7970 con 0x7f35e00b68e0 2024-09-17T05:49:28.303 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:28.303+0000 7f35dcff9640 1 -- 172.21.15.150:0/859821113 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 30) ==== 103430+0+0 (secure 0 0 0) 0x7f35d40047a0 con 0x7f35e00b68e0 2024-09-17T05:49:28.303 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:28.303+0000 7f35e687e640 1 -- 172.21.15.150:0/859821113 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f35e00d06d0 con 0x7f35e00b68e0 2024-09-17T05:49:28.304 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:28.303+0000 7f35dcff9640 1 --2- 172.21.15.150:0/859821113 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f35cc07a1b0 0x7f35cc07c6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:49:28.304 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:28.303+0000 7f35dcff9640 1 -- 172.21.15.150:0/859821113 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 5822+0+0 (secure 0 0 0) 0x7f35d40bdbb0 con 0x7f35e00b68e0 2024-09-17T05:49:28.313 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:28.312+0000 7f35dcff9640 1 -- 172.21.15.150:0/859821113 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f35d4087c40 con 0x7f35e00b68e0 2024-09-17T05:49:28.344 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:28.343+0000 7f35dffff640 1 --2- 172.21.15.150:0/859821113 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f35cc07a1b0 0x7f35cc07c6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:49:28.376 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:28.375+0000 7f35dffff640 1 --2- 172.21.15.150:0/859821113 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f35cc07a1b0 0x7f35cc07c6c0 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7f35d80012e0 tx=0x7f35d8007d10 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:49:28.626 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:28.626+0000 7f35e687e640 1 -- 172.21.15.150:0/859821113 --> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] -- mgr_command(tid 0: {"prefix": "fs clone cancel", "vol_name": "cephfs", "clone_name": "subvol_clone57205", "target": ["mon-mgr", ""]}) -- 0x7f35e0155ea0 con 0x7f35cc07a1b0 2024-09-17T05:49:29.753 INFO:tasks.ceph.mgr.x.smithi176.stderr:2024-09-17T05:49:29.752+0000 7f33d771a640 -1 mgr.server reply reply (22) Invalid argument cannot cancel -- clone finished (check clone status) 2024-09-17T05:49:29.754 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:29.753+0000 7f35dcff9640 1 -- 172.21.15.150:0/859821113 <== mgr.4108 v2:172.21.15.176:6800/3631216395 1 ==== mgr_command_reply(tid 0: -22 cannot cancel -- clone finished (check clone status)) ==== 60+0+0 (secure 0 0 0) 0x7f35e0155ea0 con 0x7f35cc07a1b0 2024-09-17T05:49:29.754 INFO:teuthology.orchestra.run.smithi150.stderr:Error EINVAL: cannot cancel -- clone finished (check clone status) 2024-09-17T05:49:29.763 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-17T05:49:29.763 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs clone cancel cephfs subvol_clone61996 2024-09-17T05:49:29.928 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:29.927+0000 7fac38607640 1 -- 172.21.15.150:0/905266179 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fac1c003a00 msgr2=0x7fac1c003e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:49:29.929 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:29.927+0000 7fac38607640 1 --2- 172.21.15.150:0/905266179 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fac1c003a00 0x7fac1c003e50 secure :-1 s=READY pgs=1152 cs=0 l=1 rev1=1 crypto rx=0x7fac2c00c6f0 tx=0x7fac1c005830 comp rx=0 tx=0).stop 2024-09-17T05:49:29.929 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:29.927+0000 7fac38607640 1 -- 172.21.15.150:0/905266179 shutdown_connections 2024-09-17T05:49:29.929 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:29.927+0000 7fac38607640 1 --2- 172.21.15.150:0/905266179 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fac1c003a00 0x7fac1c003e50 unknown :-1 s=CLOSED pgs=1152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:49:29.929 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:29.927+0000 7fac38607640 1 -- 172.21.15.150:0/905266179 >> 172.21.15.150:0/905266179 conn(0x7fac3006d1c0 msgr2=0x7fac3006d5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:49:29.929 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:29.928+0000 7fac38607640 1 -- 172.21.15.150:0/905266179 shutdown_connections 2024-09-17T05:49:29.929 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:29.928+0000 7fac38607640 1 -- 172.21.15.150:0/905266179 wait complete. 2024-09-17T05:49:29.931 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:29.931+0000 7fac38607640 1 Processor -- start 2024-09-17T05:49:29.932 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:29.931+0000 7fac38607640 1 -- start start 2024-09-17T05:49:29.933 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:29.933+0000 7fac38607640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fac1c003a00 0x7fac3014f550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:49:29.934 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:29.933+0000 7fac38607640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fac301f1340 0x7fac301f1750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:49:29.934 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:29.933+0000 7fac38607640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fac301f4770 0x7fac301f4b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:49:29.934 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:29.933+0000 7fac38607640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7fac30073bd0 con 0x7fac301f4770 2024-09-17T05:49:29.934 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:29.933+0000 7fac38607640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fac30073a50 con 0x7fac1c003a00 2024-09-17T05:49:29.934 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:29.933+0000 7fac38607640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fac3015e940 con 0x7fac301f1340 2024-09-17T05:49:29.934 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:29.933+0000 7fac36ba4640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fac301f4770 0x7fac301f4b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:49:29.934 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:29.933+0000 7fac36ba4640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fac301f4770 0x7fac301f4b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:54058/0 (socket says 172.21.15.150:54058) 2024-09-17T05:49:29.934 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:29.933+0000 7fac36ba4640 1 -- 172.21.15.150:0/2838822397 learned_addr learned my addr 172.21.15.150:0/2838822397 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:49:29.934 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:29.933+0000 7fac363a3640 1 --2- 172.21.15.150:0/2838822397 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fac1c003a00 0x7fac3014f550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:49:29.935 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:29.933+0000 7fac36ba4640 1 -- 172.21.15.150:0/2838822397 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fac301f1340 msgr2=0x7fac301f1750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:49:29.935 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:29.933+0000 7fac36ba4640 1 --2- 172.21.15.150:0/2838822397 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fac301f1340 0x7fac301f1750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:49:29.935 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:29.933+0000 7fac36ba4640 1 -- 172.21.15.150:0/2838822397 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fac1c003a00 msgr2=0x7fac3014f550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:49:29.935 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:29.933+0000 7fac36ba4640 1 --2- 172.21.15.150:0/2838822397 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fac1c003a00 0x7fac3014f550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:49:29.936 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:29.933+0000 7fac36ba4640 1 -- 172.21.15.150:0/2838822397 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fac301f50c0 con 0x7fac301f4770 2024-09-17T05:49:29.936 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:29.934+0000 7fac36ba4640 1 --2- 172.21.15.150:0/2838822397 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fac301f4770 0x7fac301f4b80 secure :-1 s=READY pgs=1153 cs=0 l=1 rev1=1 crypto rx=0x7fac300b3720 tx=0x7fac2800d490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:49:29.936 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:29.934+0000 7fac26ffd640 1 -- 172.21.15.150:0/2838822397 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac2801f070 con 0x7fac301f4770 2024-09-17T05:49:29.936 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:29.934+0000 7fac26ffd640 1 -- 172.21.15.150:0/2838822397 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fac2800dd90 con 0x7fac301f4770 2024-09-17T05:49:29.936 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:29.934+0000 7fac38607640 1 -- 172.21.15.150:0/2838822397 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fac301f20b0 con 0x7fac301f4770 2024-09-17T05:49:29.936 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:29.934+0000 7fac26ffd640 1 -- 172.21.15.150:0/2838822397 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac280127a0 con 0x7fac301f4770 2024-09-17T05:49:29.936 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:29.934+0000 7fac38607640 1 -- 172.21.15.150:0/2838822397 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fac30154050 con 0x7fac301f4770 2024-09-17T05:49:29.936 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:29.936+0000 7fac38607640 1 -- 172.21.15.150:0/2838822397 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fac301f1e20 con 0x7fac301f4770 2024-09-17T05:49:29.937 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:29.936+0000 7fac26ffd640 1 -- 172.21.15.150:0/2838822397 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 30) ==== 103430+0+0 (secure 0 0 0) 0x7fac28022070 con 0x7fac301f4770 2024-09-17T05:49:29.937 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:29.937+0000 7fac26ffd640 1 --2- 172.21.15.150:0/2838822397 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fac1407a0c0 0x7fac1407c5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:49:29.938 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:29.937+0000 7fac26ffd640 1 -- 172.21.15.150:0/2838822397 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 5822+0+0 (secure 0 0 0) 0x7fac2809dc20 con 0x7fac301f4770 2024-09-17T05:49:29.943 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:29.942+0000 7fac363a3640 1 --2- 172.21.15.150:0/2838822397 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fac1407a0c0 0x7fac1407c5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:49:29.946 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:29.945+0000 7fac26ffd640 1 -- 172.21.15.150:0/2838822397 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fac301f50c0 con 0x7fac301f4770 2024-09-17T05:49:29.947 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:29.947+0000 7fac363a3640 1 --2- 172.21.15.150:0/2838822397 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fac1407a0c0 0x7fac1407c5d0 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7fac2c032000 tx=0x7fac2c001020 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:49:30.239 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:30.238+0000 7fac38607640 1 -- 172.21.15.150:0/2838822397 --> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] -- mgr_command(tid 0: {"prefix": "fs clone cancel", "vol_name": "cephfs", "clone_name": "subvol_clone61996", "target": ["mon-mgr", ""]}) -- 0x7fac3014fa90 con 0x7fac1407a0c0 2024-09-17T05:49:30.559 INFO:tasks.ceph.mgr.x.smithi176.stderr:2024-09-17T05:49:30.558+0000 7f33d771a640 -1 mgr.server reply reply (22) Invalid argument cannot cancel -- clone finished (check clone status) 2024-09-17T05:49:30.559 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:30.558+0000 7fac26ffd640 1 -- 172.21.15.150:0/2838822397 <== mgr.4108 v2:172.21.15.176:6800/3631216395 1 ==== mgr_command_reply(tid 0: -22 cannot cancel -- clone finished (check clone status)) ==== 60+0+0 (secure 0 0 0) 0x7fac3014fa90 con 0x7fac1407a0c0 2024-09-17T05:49:30.560 INFO:teuthology.orchestra.run.smithi150.stderr:Error EINVAL: cannot cancel -- clone finished (check clone status) 2024-09-17T05:49:30.567 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-17T05:49:30.568 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs clone cancel cephfs subvol_clone87607 2024-09-17T05:49:30.739 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:30.738+0000 7f9ee77fe640 1 -- 172.21.15.150:0/2561451703 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ee0031c30 con 0x7f9ee80cc7e0 2024-09-17T05:49:30.740 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:30.738+0000 7f9eeefda640 1 -- 172.21.15.150:0/2561451703 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9ee80cc7e0 msgr2=0x7f9ee80b43d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:49:30.741 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:30.738+0000 7f9eeefda640 1 --2- 172.21.15.150:0/2561451703 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9ee80cc7e0 0x7f9ee80b43d0 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f9ee0005fd0 tx=0x7f9ee002a8b0 comp rx=0 tx=0).stop 2024-09-17T05:49:30.741 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:30.739+0000 7f9eeefda640 1 -- 172.21.15.150:0/2561451703 shutdown_connections 2024-09-17T05:49:30.741 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:30.739+0000 7f9eeefda640 1 --2- 172.21.15.150:0/2561451703 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9ee80cc7e0 0x7f9ee80b43d0 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:49:30.741 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:30.739+0000 7f9eeefda640 1 --2- 172.21.15.150:0/2561451703 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9ee80b6300 0x7f9ee80b6710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:49:30.741 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:30.739+0000 7f9eeefda640 1 -- 172.21.15.150:0/2561451703 >> 172.21.15.150:0/2561451703 conn(0x7f9ee80b2ff0 msgr2=0x7f9ee80b3400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:49:30.742 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:30.739+0000 7f9eeefda640 1 -- 172.21.15.150:0/2561451703 shutdown_connections 2024-09-17T05:49:30.742 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:30.739+0000 7f9eeefda640 1 -- 172.21.15.150:0/2561451703 wait complete. 2024-09-17T05:49:30.746 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:30.740+0000 7f9eeefda640 1 Processor -- start 2024-09-17T05:49:30.746 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:30.741+0000 7f9eeefda640 1 -- start start 2024-09-17T05:49:30.746 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:30.742+0000 7f9eeefda640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9ee80b6300 0x7f9ee8152920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:49:30.747 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:30.742+0000 7f9eeefda640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9ee80cbcc0 0x7f9ee8155cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:49:30.747 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:30.742+0000 7f9eeefda640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9ee80cc7e0 0x7f9ee806cda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:49:30.747 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:30.742+0000 7f9eeefda640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f9ee80b4dc0 con 0x7f9ee80b6300 2024-09-17T05:49:30.747 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:30.742+0000 7f9eeefda640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f9ee80b4c40 con 0x7f9ee80cc7e0 2024-09-17T05:49:30.747 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:30.742+0000 7f9eeefda640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f9ee80b4f40 con 0x7f9ee80cbcc0 2024-09-17T05:49:30.747 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:30.742+0000 7f9eecd76640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9ee80b6300 0x7f9ee8152920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:49:30.748 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:30.742+0000 7f9eecd76640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9ee80b6300 0x7f9ee8152920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:39076/0 (socket says 172.21.15.150:39076) 2024-09-17T05:49:30.748 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:30.742+0000 7f9eecd76640 1 -- 172.21.15.150:0/3766379332 learned_addr learned my addr 172.21.15.150:0/3766379332 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:49:30.748 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:30.742+0000 7f9ee7fff640 1 --2- 172.21.15.150:0/3766379332 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9ee80cbcc0 0x7f9ee8155cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:49:30.748 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:30.743+0000 7f9eecd76640 1 -- 172.21.15.150:0/3766379332 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9ee80cbcc0 msgr2=0x7f9ee8155cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:49:30.748 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:30.743+0000 7f9eecd76640 1 --2- 172.21.15.150:0/3766379332 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9ee80cbcc0 0x7f9ee8155cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:49:30.748 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:30.743+0000 7f9eecd76640 1 -- 172.21.15.150:0/3766379332 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9ee80cc7e0 msgr2=0x7f9ee806cda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:49:30.748 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:30.743+0000 7f9eecd76640 1 --2- 172.21.15.150:0/3766379332 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9ee80cc7e0 0x7f9ee806cda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:49:30.748 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:30.743+0000 7f9eecd76640 1 -- 172.21.15.150:0/3766379332 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9ee80b19b0 con 0x7f9ee80b6300 2024-09-17T05:49:30.749 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:30.743+0000 7f9eecd76640 1 --2- 172.21.15.150:0/3766379332 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9ee80b6300 0x7f9ee8152920 secure :-1 s=READY pgs=1154 cs=0 l=1 rev1=1 crypto rx=0x7f9edc00e7c0 tx=0x7f9edc00ec80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:49:30.749 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:30.743+0000 7f9ee57fa640 1 -- 172.21.15.150:0/3766379332 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9edc00cc60 con 0x7f9ee80b6300 2024-09-17T05:49:30.749 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:30.743+0000 7f9ee57fa640 1 -- 172.21.15.150:0/3766379332 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9edc00ce00 con 0x7f9ee80b6300 2024-09-17T05:49:30.749 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:30.743+0000 7f9eeefda640 1 -- 172.21.15.150:0/3766379332 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9ee80b1c90 con 0x7f9ee80b6300 2024-09-17T05:49:30.749 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:30.743+0000 7f9ee57fa640 1 -- 172.21.15.150:0/3766379332 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9edc004280 con 0x7f9ee80b6300 2024-09-17T05:49:30.749 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:30.743+0000 7f9eeefda640 1 -- 172.21.15.150:0/3766379332 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9ee8152e60 con 0x7f9ee80b6300 2024-09-17T05:49:30.749 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:30.744+0000 7f9eeefda640 1 -- 172.21.15.150:0/3766379332 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9ee80b53a0 con 0x7f9ee80b6300 2024-09-17T05:49:30.749 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:30.745+0000 7f9ee57fa640 1 -- 172.21.15.150:0/3766379332 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 30) ==== 103430+0+0 (secure 0 0 0) 0x7f9edc0035f0 con 0x7f9ee80b6300 2024-09-17T05:49:30.750 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:30.746+0000 7f9ee57fa640 1 --2- 172.21.15.150:0/3766379332 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f9ecc07a180 0x7f9ecc07c690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:49:30.750 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:30.746+0000 7f9ee57fa640 1 -- 172.21.15.150:0/3766379332 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 5822+0+0 (secure 0 0 0) 0x7f9edc09a8b0 con 0x7f9ee80b6300 2024-09-17T05:49:30.751 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:30.751+0000 7f9ee57fa640 1 -- 172.21.15.150:0/3766379332 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f9edc064310 con 0x7f9ee80b6300 2024-09-17T05:49:30.773 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:30.772+0000 7f9ee7fff640 1 --2- 172.21.15.150:0/3766379332 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f9ecc07a180 0x7f9ecc07c690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:49:30.779 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:30.779+0000 7f9ee7fff640 1 --2- 172.21.15.150:0/3766379332 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f9ecc07a180 0x7f9ecc07c690 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7f9ee80b1560 tx=0x7f9ed4009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:49:31.055 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:31.054+0000 7f9eeefda640 1 -- 172.21.15.150:0/3766379332 --> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] -- mgr_command(tid 0: {"prefix": "fs clone cancel", "vol_name": "cephfs", "clone_name": "subvol_clone87607", "target": ["mon-mgr", ""]}) -- 0x7f9ee80c4af0 con 0x7f9ecc07a180 2024-09-17T05:49:32.022 INFO:tasks.ceph.mgr.x.smithi176.stderr:2024-09-17T05:49:32.021+0000 7f33d771a640 -1 mgr.server reply reply (22) Invalid argument cannot cancel -- clone finished (check clone status) 2024-09-17T05:49:32.023 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:32.023+0000 7f9ee57fa640 1 -- 172.21.15.150:0/3766379332 <== mgr.4108 v2:172.21.15.176:6800/3631216395 1 ==== mgr_command_reply(tid 0: -22 cannot cancel -- clone finished (check clone status)) ==== 60+0+0 (secure 0 0 0) 0x7f9ee80c4af0 con 0x7f9ecc07a180 2024-09-17T05:49:32.023 INFO:teuthology.orchestra.run.smithi150.stderr:Error EINVAL: cannot cancel -- clone finished (check clone status) 2024-09-17T05:49:32.030 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-17T05:49:32.030 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs clone cancel cephfs subvol_clone5458 2024-09-17T05:49:32.214 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:32.213+0000 7ff607590640 1 -- 172.21.15.150:0/2453377258 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff6000b6300 msgr2=0x7ff6000b6710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:49:32.214 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:32.213+0000 7ff607590640 1 --2- 172.21.15.150:0/2453377258 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff6000b6300 0x7ff6000b6710 secure :-1 s=READY pgs=1156 cs=0 l=1 rev1=1 crypto rx=0x7ff5fc005fd0 tx=0x7ff5fc02a5d0 comp rx=0 tx=0).stop 2024-09-17T05:49:32.214 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:32.213+0000 7ff607590640 1 -- 172.21.15.150:0/2453377258 shutdown_connections 2024-09-17T05:49:32.214 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:32.213+0000 7ff607590640 1 --2- 172.21.15.150:0/2453377258 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff6000cbcc0 0x7ff6000cc0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:49:32.214 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:32.213+0000 7ff607590640 1 --2- 172.21.15.150:0/2453377258 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff6000b6300 0x7ff6000b6710 unknown :-1 s=CLOSED pgs=1156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:49:32.214 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:32.213+0000 7ff607590640 1 -- 172.21.15.150:0/2453377258 >> 172.21.15.150:0/2453377258 conn(0x7ff6000b2ff0 msgr2=0x7ff6000b3400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:49:32.215 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:32.213+0000 7ff607590640 1 -- 172.21.15.150:0/2453377258 shutdown_connections 2024-09-17T05:49:32.215 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:32.213+0000 7ff607590640 1 -- 172.21.15.150:0/2453377258 wait complete. 2024-09-17T05:49:32.216 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:32.216+0000 7ff607590640 1 Processor -- start 2024-09-17T05:49:32.217 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:32.216+0000 7ff607590640 1 -- start start 2024-09-17T05:49:32.219 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:32.218+0000 7ff607590640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff6000b6300 0x7ff60009d690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:49:32.219 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:32.218+0000 7ff607590640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff6000cbcc0 0x7ff6000c0000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:49:32.219 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:32.218+0000 7ff607590640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff6000cc610 0x7ff6000c3dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:49:32.220 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:32.219+0000 7ff607590640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7ff6000ce460 con 0x7ff6000b6300 2024-09-17T05:49:32.220 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:32.219+0000 7ff607590640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7ff6000ce2e0 con 0x7ff6000cbcc0 2024-09-17T05:49:32.220 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:32.219+0000 7ff607590640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7ff6000ce5e0 con 0x7ff6000cc610 2024-09-17T05:49:32.220 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:32.219+0000 7ff60532c640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff6000b6300 0x7ff60009d690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:49:32.220 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:32.219+0000 7ff60532c640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff6000b6300 0x7ff60009d690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:39096/0 (socket says 172.21.15.150:39096) 2024-09-17T05:49:32.220 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:32.219+0000 7ff60532c640 1 -- 172.21.15.150:0/3166756425 learned_addr learned my addr 172.21.15.150:0/3166756425 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:49:32.222 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:32.220+0000 7ff60532c640 1 -- 172.21.15.150:0/3166756425 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff6000cc610 msgr2=0x7ff6000c3dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:49:32.222 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:32.220+0000 7ff60532c640 1 --2- 172.21.15.150:0/3166756425 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff6000cc610 0x7ff6000c3dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:49:32.222 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:32.220+0000 7ff60532c640 1 -- 172.21.15.150:0/3166756425 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff6000cbcc0 msgr2=0x7ff6000c0000 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-17T05:49:32.222 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:32.220+0000 7ff60532c640 1 --2- 172.21.15.150:0/3166756425 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff6000cbcc0 0x7ff6000c0000 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:49:32.222 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:32.220+0000 7ff60532c640 1 -- 172.21.15.150:0/3166756425 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff60009c180 con 0x7ff6000b6300 2024-09-17T05:49:32.222 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:32.220+0000 7ff60532c640 1 --2- 172.21.15.150:0/3166756425 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff6000b6300 0x7ff60009d690 secure :-1 s=READY pgs=1157 cs=0 l=1 rev1=1 crypto rx=0x7ff5fc034040 tx=0x7ff5fc0038a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:49:32.223 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:32.220+0000 7ff5f5ffb640 1 -- 172.21.15.150:0/3166756425 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff5fc03e030 con 0x7ff6000b6300 2024-09-17T05:49:32.223 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:32.220+0000 7ff5f5ffb640 1 -- 172.21.15.150:0/3166756425 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff5fc003ca0 con 0x7ff6000b6300 2024-09-17T05:49:32.223 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:32.220+0000 7ff5f5ffb640 1 -- 172.21.15.150:0/3166756425 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff5fc035040 con 0x7ff6000b6300 2024-09-17T05:49:32.223 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:32.220+0000 7ff607590640 1 -- 172.21.15.150:0/3166756425 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff6000c0540 con 0x7ff6000b6300 2024-09-17T05:49:32.223 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:32.221+0000 7ff607590640 1 -- 172.21.15.150:0/3166756425 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff60009c8d0 con 0x7ff6000b6300 2024-09-17T05:49:32.223 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:32.222+0000 7ff607590640 1 -- 172.21.15.150:0/3166756425 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff6000ceaf0 con 0x7ff6000b6300 2024-09-17T05:49:32.224 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:32.222+0000 7ff5f5ffb640 1 -- 172.21.15.150:0/3166756425 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 30) ==== 103430+0+0 (secure 0 0 0) 0x7ff5fc041030 con 0x7ff6000b6300 2024-09-17T05:49:32.224 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:32.223+0000 7ff5f5ffb640 1 --2- 172.21.15.150:0/3166756425 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7ff5e407a1b0 0x7ff5e407c6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:49:32.224 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:32.223+0000 7ff5f5ffb640 1 -- 172.21.15.150:0/3166756425 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 5822+0+0 (secure 0 0 0) 0x7ff5fc0ba470 con 0x7ff6000b6300 2024-09-17T05:49:32.233 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:32.233+0000 7ff5f5ffb640 1 -- 172.21.15.150:0/3166756425 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7ff5fc083fe0 con 0x7ff6000b6300 2024-09-17T05:49:32.244 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:32.243+0000 7ff604b2b640 1 --2- 172.21.15.150:0/3166756425 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7ff5e407a1b0 0x7ff5e407c6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:49:32.267 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:32.267+0000 7ff604b2b640 1 --2- 172.21.15.150:0/3166756425 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7ff5e407a1b0 0x7ff5e407c6c0 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7ff60009dd50 tx=0x7ff5f0006b80 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:49:32.562 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:32.561+0000 7ff607590640 1 -- 172.21.15.150:0/3166756425 --> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] -- mgr_command(tid 0: {"prefix": "fs clone cancel", "vol_name": "cephfs", "clone_name": "subvol_clone5458", "target": ["mon-mgr", ""]}) -- 0x7ff6001fe0d0 con 0x7ff5e407a1b0 2024-09-17T05:49:32.997 INFO:tasks.ceph.mgr.x.smithi176.stderr:2024-09-17T05:49:32.993+0000 7f33d771a640 -1 mgr.server reply reply (22) Invalid argument cannot cancel -- clone finished (check clone status) 2024-09-17T05:49:33.000 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:32.999+0000 7ff5f5ffb640 1 -- 172.21.15.150:0/3166756425 <== mgr.4108 v2:172.21.15.176:6800/3631216395 1 ==== mgr_command_reply(tid 0: -22 cannot cancel -- clone finished (check clone status)) ==== 60+0+0 (secure 0 0 0) 0x7ff5f0013430 con 0x7ff5e407a1b0 2024-09-17T05:49:33.000 INFO:teuthology.orchestra.run.smithi150.stderr:Error EINVAL: cannot cancel -- clone finished (check clone status) 2024-09-17T05:49:33.008 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-17T05:49:33.009 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs clone cancel cephfs subvol_clone94949 2024-09-17T05:49:33.184 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:33.183+0000 7f7f748a4640 1 -- 172.21.15.150:0/2015338397 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7f700cbcc0 msgr2=0x7f7f700cc0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:49:33.184 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:33.183+0000 7f7f748a4640 1 --2- 172.21.15.150:0/2015338397 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7f700cbcc0 0x7f7f700cc0d0 secure :-1 s=READY pgs=1158 cs=0 l=1 rev1=1 crypto rx=0x7f7f70073bc0 tx=0x7f7f6402a560 comp rx=0 tx=0).stop 2024-09-17T05:49:33.184 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:33.183+0000 7f7f748a4640 1 -- 172.21.15.150:0/2015338397 shutdown_connections 2024-09-17T05:49:33.184 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:33.183+0000 7f7f748a4640 1 --2- 172.21.15.150:0/2015338397 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7f700cbcc0 0x7f7f700cc0d0 unknown :-1 s=CLOSED pgs=1158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:49:33.184 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:33.183+0000 7f7f748a4640 1 --2- 172.21.15.150:0/2015338397 >> v2:172.21.15.176:3300/0 conn(0x7f7f700b6300 0x7f7f700b6710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:49:33.184 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:33.183+0000 7f7f748a4640 1 -- 172.21.15.150:0/2015338397 >> 172.21.15.150:0/2015338397 conn(0x7f7f700b2ff0 msgr2=0x7f7f700b3400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:49:33.184 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:33.183+0000 7f7f748a4640 1 -- 172.21.15.150:0/2015338397 shutdown_connections 2024-09-17T05:49:33.184 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:33.183+0000 7f7f748a4640 1 -- 172.21.15.150:0/2015338397 wait complete. 2024-09-17T05:49:33.186 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:33.186+0000 7f7f748a4640 1 Processor -- start 2024-09-17T05:49:33.186 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:33.186+0000 7f7f748a4640 1 -- start start 2024-09-17T05:49:33.189 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:33.188+0000 7f7f748a4640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7f700b6300 0x7f7f700cafa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:49:33.190 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:33.188+0000 7f7f748a4640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7f700cbcc0 0x7f7f70155ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:49:33.190 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:33.188+0000 7f7f748a4640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7f700cc610 0x7f7f701500e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:49:33.190 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:33.188+0000 7f7f748a4640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f7f700ce460 con 0x7f7f700cbcc0 2024-09-17T05:49:33.190 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:33.188+0000 7f7f748a4640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f7f700ce2e0 con 0x7f7f700cc610 2024-09-17T05:49:33.190 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:33.188+0000 7f7f748a4640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f7f700ce5e0 con 0x7f7f700b6300 2024-09-17T05:49:33.190 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:33.188+0000 7f7f6dd9b640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7f700cbcc0 0x7f7f70155ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:49:33.190 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:33.188+0000 7f7f6dd9b640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7f700cbcc0 0x7f7f70155ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:39114/0 (socket says 172.21.15.150:39114) 2024-09-17T05:49:33.190 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:33.188+0000 7f7f6dd9b640 1 -- 172.21.15.150:0/3142041214 learned_addr learned my addr 172.21.15.150:0/3142041214 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:49:33.190 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:33.188+0000 7f7f6e59c640 1 --2- 172.21.15.150:0/3142041214 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7f700b6300 0x7f7f700cafa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:49:33.190 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:33.188+0000 7f7f6ed9d640 1 --2- 172.21.15.150:0/3142041214 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7f700cc610 0x7f7f701500e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:49:33.190 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:33.189+0000 7f7f6dd9b640 1 -- 172.21.15.150:0/3142041214 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7f700b6300 msgr2=0x7f7f700cafa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:49:33.190 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:33.189+0000 7f7f6dd9b640 1 --2- 172.21.15.150:0/3142041214 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7f700b6300 0x7f7f700cafa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:49:33.190 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:33.189+0000 7f7f6dd9b640 1 -- 172.21.15.150:0/3142041214 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7f700cc610 msgr2=0x7f7f701500e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:49:33.191 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:33.189+0000 7f7f6dd9b640 1 --2- 172.21.15.150:0/3142041214 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7f700cc610 0x7f7f701500e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:49:33.191 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:33.189+0000 7f7f6dd9b640 1 -- 172.21.15.150:0/3142041214 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7f700c68a0 con 0x7f7f700cbcc0 2024-09-17T05:49:33.191 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:33.189+0000 7f7f6dd9b640 1 --2- 172.21.15.150:0/3142041214 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7f700cbcc0 0x7f7f70155ac0 secure :-1 s=READY pgs=1159 cs=0 l=1 rev1=1 crypto rx=0x7f7f64034040 tx=0x7f7f640039e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:49:33.191 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:33.190+0000 7f7f5effd640 1 -- 172.21.15.150:0/3142041214 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f6403e030 con 0x7f7f700cbcc0 2024-09-17T05:49:33.191 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:33.190+0000 7f7f5effd640 1 -- 172.21.15.150:0/3142041214 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f7f640047a0 con 0x7f7f700cbcc0 2024-09-17T05:49:33.191 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:33.190+0000 7f7f5effd640 1 -- 172.21.15.150:0/3142041214 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f6403e030 con 0x7f7f700cbcc0 2024-09-17T05:49:33.191 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:33.190+0000 7f7f748a4640 1 -- 172.21.15.150:0/3142041214 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7f700c6b80 con 0x7f7f700cbcc0 2024-09-17T05:49:33.191 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:33.190+0000 7f7f748a4640 1 -- 172.21.15.150:0/3142041214 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7f700c7140 con 0x7f7f700cbcc0 2024-09-17T05:49:33.193 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:33.192+0000 7f7f748a4640 1 -- 172.21.15.150:0/3142041214 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7f700ceb80 con 0x7f7f700cbcc0 2024-09-17T05:49:33.196 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:33.194+0000 7f7f5effd640 1 -- 172.21.15.150:0/3142041214 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 30) ==== 103430+0+0 (secure 0 0 0) 0x7f7f64041030 con 0x7f7f700cbcc0 2024-09-17T05:49:33.196 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:33.195+0000 7f7f5effd640 1 --2- 172.21.15.150:0/3142041214 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f7f5007a5b0 0x7f7f5007cac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:49:33.196 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:33.195+0000 7f7f5effd640 1 -- 172.21.15.150:0/3142041214 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 5822+0+0 (secure 0 0 0) 0x7f7f6403f070 con 0x7f7f700cbcc0 2024-09-17T05:49:33.200 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:33.200+0000 7f7f5effd640 1 -- 172.21.15.150:0/3142041214 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f7f64084040 con 0x7f7f700cbcc0 2024-09-17T05:49:33.237 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:33.236+0000 7f7f6e59c640 1 --2- 172.21.15.150:0/3142041214 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f7f5007a5b0 0x7f7f5007cac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:49:33.288 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:33.288+0000 7f7f6e59c640 1 --2- 172.21.15.150:0/3142041214 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f7f5007a5b0 0x7f7f5007cac0 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7f7f700735d0 tx=0x7f7f60008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:49:33.515 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:33.514+0000 7f7f748a4640 1 -- 172.21.15.150:0/3142041214 --> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] -- mgr_command(tid 0: {"prefix": "fs clone cancel", "vol_name": "cephfs", "clone_name": "subvol_clone94949", "target": ["mon-mgr", ""]}) -- 0x7f7f700b3530 con 0x7f7f5007a5b0 2024-09-17T05:49:34.439 INFO:tasks.ceph.mgr.x.smithi176.stderr:2024-09-17T05:49:34.438+0000 7f33d771a640 -1 mgr.server reply reply (22) Invalid argument cannot cancel -- clone finished (check clone status) 2024-09-17T05:49:34.451 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:34.450+0000 7f7f5effd640 1 -- 172.21.15.150:0/3142041214 <== mgr.4108 v2:172.21.15.176:6800/3631216395 1 ==== mgr_command_reply(tid 0: -22 cannot cancel -- clone finished (check clone status)) ==== 60+0+0 (secure 0 0 0) 0x7f7f700b3530 con 0x7f7f5007a5b0 2024-09-17T05:49:34.451 INFO:teuthology.orchestra.run.smithi150.stderr:Error EINVAL: cannot cancel -- clone finished (check clone status) 2024-09-17T05:49:34.458 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-17T05:49:34.458 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs clone cancel cephfs subvol_clone310410 2024-09-17T05:49:34.661 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:34.659+0000 7f247a0de640 1 -- 172.21.15.150:0/3210204468 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f24740d5150 msgr2=0x7f24740b9b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:49:34.661 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:34.659+0000 7f247a0de640 1 --2- 172.21.15.150:0/3210204468 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f24740d5150 0x7f24740b9b10 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f247408d600 tx=0x7f246402a520 comp rx=0 tx=0).stop 2024-09-17T05:49:34.661 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:34.660+0000 7f247a0de640 1 -- 172.21.15.150:0/3210204468 shutdown_connections 2024-09-17T05:49:34.661 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:34.660+0000 7f247a0de640 1 --2- 172.21.15.150:0/3210204468 >> v2:172.21.15.150:3300/0 conn(0x7f247406dea0 0x7f24740d0020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:49:34.661 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:34.660+0000 7f247a0de640 1 --2- 172.21.15.150:0/3210204468 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f24740d5150 0x7f24740b9b10 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:49:34.661 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:34.660+0000 7f247a0de640 1 -- 172.21.15.150:0/3210204468 >> 172.21.15.150:0/3210204468 conn(0x7f247408bfe0 msgr2=0x7f24740d46e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:49:34.661 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:34.660+0000 7f247a0de640 1 -- 172.21.15.150:0/3210204468 shutdown_connections 2024-09-17T05:49:34.661 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:34.660+0000 7f247a0de640 1 -- 172.21.15.150:0/3210204468 wait complete. 2024-09-17T05:49:34.663 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:34.662+0000 7f247a0de640 1 Processor -- start 2024-09-17T05:49:34.663 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:34.663+0000 7f247a0de640 1 -- start start 2024-09-17T05:49:34.667 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:34.664+0000 7f247a0de640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f247406dea0 0x7f24740b8930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:49:34.667 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:34.664+0000 7f247a0de640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f247406e2b0 0x7f2474148570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:49:34.667 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:34.665+0000 7f247a0de640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f24740d5150 0x7f2474148ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:49:34.667 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:34.665+0000 7f247a0de640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f24740d3150 con 0x7f24740d5150 2024-09-17T05:49:34.667 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:34.665+0000 7f247a0de640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f24740d2fd0 con 0x7f247406dea0 2024-09-17T05:49:34.667 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:34.665+0000 7f247a0de640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f24740b6870 con 0x7f247406e2b0 2024-09-17T05:49:34.667 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:34.665+0000 7f2473fff640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f24740d5150 0x7f2474148ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:49:34.667 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:34.665+0000 7f2473fff640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f24740d5150 0x7f2474148ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:39136/0 (socket says 172.21.15.150:39136) 2024-09-17T05:49:34.667 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:34.665+0000 7f2473fff640 1 -- 172.21.15.150:0/743589152 learned_addr learned my addr 172.21.15.150:0/743589152 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:49:34.667 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:34.665+0000 7f2473fff640 1 -- 172.21.15.150:0/743589152 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f247406e2b0 msgr2=0x7f2474148570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:49:34.668 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:34.665+0000 7f2473fff640 1 --2- 172.21.15.150:0/743589152 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f247406e2b0 0x7f2474148570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:49:34.668 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:34.665+0000 7f2473fff640 1 -- 172.21.15.150:0/743589152 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f247406dea0 msgr2=0x7f24740b8930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:49:34.668 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:34.665+0000 7f2473fff640 1 --2- 172.21.15.150:0/743589152 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f247406dea0 0x7f24740b8930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:49:34.668 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:34.665+0000 7f2473fff640 1 -- 172.21.15.150:0/743589152 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f247415e4c0 con 0x7f24740d5150 2024-09-17T05:49:34.668 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:34.666+0000 7f2473fff640 1 --2- 172.21.15.150:0/743589152 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f24740d5150 0x7f2474148ab0 secure :-1 s=READY pgs=1161 cs=0 l=1 rev1=1 crypto rx=0x7f246c00cae0 tx=0x7f246c00a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:49:34.668 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:34.666+0000 7f245bfff640 1 -- 172.21.15.150:0/743589152 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f246c016020 con 0x7f24740d5150 2024-09-17T05:49:34.668 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:34.666+0000 7f245bfff640 1 -- 172.21.15.150:0/743589152 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f246c00ad30 con 0x7f24740d5150 2024-09-17T05:49:34.668 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:34.666+0000 7f247a0de640 1 -- 172.21.15.150:0/743589152 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f247415e7a0 con 0x7f24740d5150 2024-09-17T05:49:34.668 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:34.666+0000 7f245bfff640 1 -- 172.21.15.150:0/743589152 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f246c016020 con 0x7f24740d5150 2024-09-17T05:49:34.668 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:34.666+0000 7f247a0de640 1 -- 172.21.15.150:0/743589152 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f247415ed60 con 0x7f24740d5150 2024-09-17T05:49:34.669 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:34.668+0000 7f247a0de640 1 -- 172.21.15.150:0/743589152 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f24740b9b10 con 0x7f24740d5150 2024-09-17T05:49:34.669 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:34.668+0000 7f245bfff640 1 -- 172.21.15.150:0/743589152 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 30) ==== 103430+0+0 (secure 0 0 0) 0x7f246c019020 con 0x7f24740d5150 2024-09-17T05:49:34.670 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:34.669+0000 7f245bfff640 1 --2- 172.21.15.150:0/743589152 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f246007a380 0x7f246007c890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:49:34.670 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:34.669+0000 7f245bfff640 1 -- 172.21.15.150:0/743589152 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 5822+0+0 (secure 0 0 0) 0x7f246c09a0a0 con 0x7f24740d5150 2024-09-17T05:49:34.677 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:34.676+0000 7f245bfff640 1 -- 172.21.15.150:0/743589152 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f246c020020 con 0x7f24740d5150 2024-09-17T05:49:34.701 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:34.700+0000 7f24737fe640 1 --2- 172.21.15.150:0/743589152 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f246007a380 0x7f246007c890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:49:34.742 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:34.742+0000 7f24737fe640 1 --2- 172.21.15.150:0/743589152 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f246007a380 0x7f246007c890 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7f2464034000 tx=0x7f24640046c0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:49:35.017 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:35.016+0000 7f247a0de640 1 -- 172.21.15.150:0/743589152 --> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] -- mgr_command(tid 0: {"prefix": "fs clone cancel", "vol_name": "cephfs", "clone_name": "subvol_clone310410", "target": ["mon-mgr", ""]}) -- 0x7f24740d4f30 con 0x7f246007a380 2024-09-17T05:49:35.517 INFO:tasks.ceph.mgr.x.smithi176.stderr:2024-09-17T05:49:35.513+0000 7f33d771a640 -1 mgr.server reply reply (22) Invalid argument cannot cancel -- clone finished (check clone status) 2024-09-17T05:49:35.519 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:35.518+0000 7f245bfff640 1 -- 172.21.15.150:0/743589152 <== mgr.4108 v2:172.21.15.176:6800/3631216395 1 ==== mgr_command_reply(tid 0: -22 cannot cancel -- clone finished (check clone status)) ==== 60+0+0 (secure 0 0 0) 0x7f24740d4f30 con 0x7f246007a380 2024-09-17T05:49:35.519 INFO:teuthology.orchestra.run.smithi150.stderr:Error EINVAL: cannot cancel -- clone finished (check clone status) 2024-09-17T05:49:35.526 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-17T05:49:35.527 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs clone cancel cephfs subvol_clone627111 2024-09-17T05:49:35.711 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:35.710+0000 7f7d3d32b640 1 -- 172.21.15.150:0/2034079395 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7d3806dea0 msgr2=0x7f7d380d0020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:49:35.711 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:35.710+0000 7f7d3d32b640 1 --2- 172.21.15.150:0/2034079395 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7d3806dea0 0x7f7d380d0020 secure :-1 s=READY pgs=1163 cs=0 l=1 rev1=1 crypto rx=0x7f7d2c005fd0 tx=0x7f7d2c02a5d0 comp rx=0 tx=0).stop 2024-09-17T05:49:35.711 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:35.710+0000 7f7d3d32b640 1 -- 172.21.15.150:0/2034079395 shutdown_connections 2024-09-17T05:49:35.712 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:35.710+0000 7f7d3d32b640 1 --2- 172.21.15.150:0/2034079395 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7d3806e2b0 0x7f7d380d0560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:49:35.712 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:35.710+0000 7f7d3d32b640 1 --2- 172.21.15.150:0/2034079395 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7d3806dea0 0x7f7d380d0020 unknown :-1 s=CLOSED pgs=1163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:49:35.712 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:35.710+0000 7f7d3d32b640 1 -- 172.21.15.150:0/2034079395 >> 172.21.15.150:0/2034079395 conn(0x7f7d3808bfe0 msgr2=0x7f7d380d46e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:49:35.712 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:35.710+0000 7f7d3d32b640 1 -- 172.21.15.150:0/2034079395 shutdown_connections 2024-09-17T05:49:35.712 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:35.710+0000 7f7d3d32b640 1 -- 172.21.15.150:0/2034079395 wait complete. 2024-09-17T05:49:35.714 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:35.713+0000 7f7d3d32b640 1 Processor -- start 2024-09-17T05:49:35.714 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:35.713+0000 7f7d3d32b640 1 -- start start 2024-09-17T05:49:35.718 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:35.717+0000 7f7d3d32b640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7d3806dea0 0x7f7d380ce180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:49:35.718 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:35.717+0000 7f7d3d32b640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7d3806e2b0 0x7f7d381f2f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:49:35.718 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:35.718+0000 7f7d3d32b640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7d380d5150 0x7f7d381f90e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:49:35.719 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:35.718+0000 7f7d3d32b640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f7d380b6160 con 0x7f7d3806e2b0 2024-09-17T05:49:35.719 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:35.718+0000 7f7d3d32b640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f7d380d3220 con 0x7f7d3806dea0 2024-09-17T05:49:35.719 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:35.718+0000 7f7d3d32b640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f7d380b62e0 con 0x7f7d380d5150 2024-09-17T05:49:35.720 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:35.719+0000 7f7d377fe640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7d380d5150 0x7f7d381f90e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:49:35.720 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:35.719+0000 7f7d377fe640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7d380d5150 0x7f7d381f90e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3301/0 says I am v2:172.21.15.150:53458/0 (socket says 172.21.15.150:53458) 2024-09-17T05:49:35.720 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:35.719+0000 7f7d377fe640 1 -- 172.21.15.150:0/2400978234 learned_addr learned my addr 172.21.15.150:0/2400978234 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:49:35.721 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:35.720+0000 7f7d36ffd640 1 --2- 172.21.15.150:0/2400978234 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7d3806dea0 0x7f7d380ce180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:49:35.723 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:35.722+0000 7f7d377fe640 1 -- 172.21.15.150:0/2400978234 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7d3806dea0 msgr2=0x7f7d380ce180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:49:35.723 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:35.722+0000 7f7d377fe640 1 --2- 172.21.15.150:0/2400978234 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7d3806dea0 0x7f7d380ce180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:49:35.723 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:35.722+0000 7f7d377fe640 1 -- 172.21.15.150:0/2400978234 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7d3806e2b0 msgr2=0x7f7d381f2f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:49:35.723 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:35.722+0000 7f7d377fe640 1 --2- 172.21.15.150:0/2400978234 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7d3806e2b0 0x7f7d381f2f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:49:35.723 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:35.722+0000 7f7d377fe640 1 -- 172.21.15.150:0/2400978234 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7d381e9ce0 con 0x7f7d380d5150 2024-09-17T05:49:35.726 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:35.725+0000 7f7d377fe640 1 --2- 172.21.15.150:0/2400978234 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7d380d5150 0x7f7d381f90e0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f7d3000b9e0 tx=0x7f7d3000bea0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:49:35.727 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:35.726+0000 7f7d1f7fe640 1 -- 172.21.15.150:0/2400978234 <== mon.2 v2:172.21.15.176:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d30019070 con 0x7f7d380d5150 2024-09-17T05:49:35.727 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:35.726+0000 7f7d3d32b640 1 -- 172.21.15.150:0/2400978234 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7d381e8c40 con 0x7f7d380d5150 2024-09-17T05:49:35.727 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:35.727+0000 7f7d3d32b640 1 -- 172.21.15.150:0/2400978234 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f7d381e9200 con 0x7f7d380d5150 2024-09-17T05:49:35.727 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:35.727+0000 7f7d1f7fe640 1 -- 172.21.15.150:0/2400978234 <== mon.2 v2:172.21.15.176:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f7d3000cb20 con 0x7f7d380d5150 2024-09-17T05:49:35.727 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:35.727+0000 7f7d1f7fe640 1 -- 172.21.15.150:0/2400978234 <== mon.2 v2:172.21.15.176:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d30023060 con 0x7f7d380d5150 2024-09-17T05:49:35.728 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:35.728+0000 7f7d3d32b640 1 -- 172.21.15.150:0/2400978234 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7d18005290 con 0x7f7d380d5150 2024-09-17T05:49:35.734 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:35.733+0000 7f7d1f7fe640 1 -- 172.21.15.150:0/2400978234 <== mon.2 v2:172.21.15.176:3301/0 4 ==== mgrmap(e 30) ==== 103430+0+0 (secure 0 0 0) 0x7f7d3001c070 con 0x7f7d380d5150 2024-09-17T05:49:35.735 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:35.734+0000 7f7d1f7fe640 1 --2- 172.21.15.150:0/2400978234 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f7d2407a180 0x7f7d2407c690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:49:35.735 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:35.734+0000 7f7d1f7fe640 1 -- 172.21.15.150:0/2400978234 <== mon.2 v2:172.21.15.176:3301/0 5 ==== osd_map(88..88 src has 1..88) ==== 5822+0+0 (secure 0 0 0) 0x7f7d30099e20 con 0x7f7d380d5150 2024-09-17T05:49:35.741 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:35.740+0000 7f7d36ffd640 1 --2- 172.21.15.150:0/2400978234 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f7d2407a180 0x7f7d2407c690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:49:35.745 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:35.744+0000 7f7d1f7fe640 1 -- 172.21.15.150:0/2400978234 <== mon.2 v2:172.21.15.176:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f7d30063340 con 0x7f7d380d5150 2024-09-17T05:49:35.758 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:35.758+0000 7f7d36ffd640 1 --2- 172.21.15.150:0/2400978234 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f7d2407a180 0x7f7d2407c690 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7f7d28001760 tx=0x7f7d28009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:49:36.079 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:36.078+0000 7f7d3d32b640 1 -- 172.21.15.150:0/2400978234 --> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] -- mgr_command(tid 0: {"prefix": "fs clone cancel", "vol_name": "cephfs", "clone_name": "subvol_clone627111", "target": ["mon-mgr", ""]}) -- 0x7f7d18000bc0 con 0x7f7d2407a180 2024-09-17T05:49:36.476 INFO:tasks.ceph.mgr.x.smithi176.stderr:2024-09-17T05:49:36.474+0000 7f33d771a640 -1 mgr.server reply reply (22) Invalid argument cannot cancel -- clone finished (check clone status) 2024-09-17T05:49:36.477 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:36.477+0000 7f7d1f7fe640 1 -- 172.21.15.150:0/2400978234 <== mgr.4108 v2:172.21.15.176:6800/3631216395 1 ==== mgr_command_reply(tid 0: -22 cannot cancel -- clone finished (check clone status)) ==== 60+0+0 (secure 0 0 0) 0x7f7d18000bc0 con 0x7f7d2407a180 2024-09-17T05:49:36.477 INFO:teuthology.orchestra.run.smithi150.stderr:Error EINVAL: cannot cancel -- clone finished (check clone status) 2024-09-17T05:49:36.490 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-17T05:49:36.491 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs clone cancel cephfs subvol_clone149612 2024-09-17T05:49:36.666 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:36.664+0000 7f4a2a939640 1 -- 172.21.15.150:0/1297376775 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4a0c004800 msgr2=0x7f4a0c004c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:49:36.666 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:36.664+0000 7f4a2a939640 1 --2- 172.21.15.150:0/1297376775 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4a0c004800 0x7f4a0c004c10 secure :-1 s=READY pgs=1165 cs=0 l=1 rev1=1 crypto rx=0x7f4a1800c4a0 tx=0x7f4a0c005830 comp rx=0 tx=0).stop 2024-09-17T05:49:36.666 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:36.665+0000 7f4a2a939640 1 -- 172.21.15.150:0/1297376775 shutdown_connections 2024-09-17T05:49:36.666 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:36.665+0000 7f4a2a939640 1 --2- 172.21.15.150:0/1297376775 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4a0c004800 0x7f4a0c004c10 unknown :-1 s=CLOSED pgs=1165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:49:36.666 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:36.665+0000 7f4a2a939640 1 -- 172.21.15.150:0/1297376775 >> 172.21.15.150:0/1297376775 conn(0x7f4a24074890 msgr2=0x7f4a2406cda0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:49:36.666 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:36.665+0000 7f4a2a939640 1 -- 172.21.15.150:0/1297376775 shutdown_connections 2024-09-17T05:49:36.666 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:36.665+0000 7f4a2a939640 1 -- 172.21.15.150:0/1297376775 wait complete. 2024-09-17T05:49:36.668 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:36.667+0000 7f4a2a939640 1 Processor -- start 2024-09-17T05:49:36.668 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:36.667+0000 7f4a2a939640 1 -- start start 2024-09-17T05:49:36.670 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:36.669+0000 7f4a2a939640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4a0c004800 0x7f4a2415bcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:49:36.670 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:36.669+0000 7f4a2a939640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4a241f93e0 0x7f4a2406f940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:49:36.670 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:36.669+0000 7f4a2a939640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4a2406fe80 0x7f4a240ad8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:49:36.671 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:36.669+0000 7f4a2a939640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f4a240b6c80 con 0x7f4a241f93e0 2024-09-17T05:49:36.671 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:36.669+0000 7f4a2a939640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f4a240b6b00 con 0x7f4a2406fe80 2024-09-17T05:49:36.671 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:36.669+0000 7f4a2a939640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f4a240b4610 con 0x7f4a0c004800 2024-09-17T05:49:36.671 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:36.669+0000 7f4a237fe640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4a241f93e0 0x7f4a2406f940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:49:36.671 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:36.669+0000 7f4a237fe640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4a241f93e0 0x7f4a2406f940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:39176/0 (socket says 172.21.15.150:39176) 2024-09-17T05:49:36.671 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:36.669+0000 7f4a237fe640 1 -- 172.21.15.150:0/1178101363 learned_addr learned my addr 172.21.15.150:0/1178101363 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:49:36.672 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:36.669+0000 7f4a237fe640 1 -- 172.21.15.150:0/1178101363 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4a0c004800 msgr2=0x7f4a2415bcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:49:36.672 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:36.669+0000 7f4a237fe640 1 --2- 172.21.15.150:0/1178101363 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4a0c004800 0x7f4a2415bcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:49:36.672 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:36.669+0000 7f4a237fe640 1 -- 172.21.15.150:0/1178101363 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4a2406fe80 msgr2=0x7f4a240ad8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:49:36.672 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:36.669+0000 7f4a237fe640 1 --2- 172.21.15.150:0/1178101363 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4a2406fe80 0x7f4a240ad8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:49:36.672 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:36.669+0000 7f4a237fe640 1 -- 172.21.15.150:0/1178101363 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4a24070290 con 0x7f4a241f93e0 2024-09-17T05:49:36.672 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:36.669+0000 7f4a237fe640 1 --2- 172.21.15.150:0/1178101363 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4a241f93e0 0x7f4a2406f940 secure :-1 s=READY pgs=1166 cs=0 l=1 rev1=1 crypto rx=0x7f4a1800c590 tx=0x7f4a18006290 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:49:36.672 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:36.670+0000 7f4a20ff9640 1 -- 172.21.15.150:0/1178101363 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a1802b850 con 0x7f4a241f93e0 2024-09-17T05:49:36.672 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:36.670+0000 7f4a2a939640 1 -- 172.21.15.150:0/1178101363 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4a2413a0b0 con 0x7f4a241f93e0 2024-09-17T05:49:36.672 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:36.670+0000 7f4a2a939640 1 -- 172.21.15.150:0/1178101363 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4a2413a670 con 0x7f4a241f93e0 2024-09-17T05:49:36.672 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:36.670+0000 7f4a20ff9640 1 -- 172.21.15.150:0/1178101363 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f4a1802f030 con 0x7f4a241f93e0 2024-09-17T05:49:36.673 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:36.670+0000 7f4a20ff9640 1 -- 172.21.15.150:0/1178101363 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a1802b9f0 con 0x7f4a241f93e0 2024-09-17T05:49:36.673 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:36.671+0000 7f4a2a939640 1 -- 172.21.15.150:0/1178101363 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4a04005290 con 0x7f4a241f93e0 2024-09-17T05:49:36.673 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:36.672+0000 7f4a20ff9640 1 -- 172.21.15.150:0/1178101363 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 30) ==== 103430+0+0 (secure 0 0 0) 0x7f4a1802bb90 con 0x7f4a241f93e0 2024-09-17T05:49:36.673 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:36.673+0000 7f4a20ff9640 1 --2- 172.21.15.150:0/1178101363 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f4a1007a1b0 0x7f4a1007c6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:49:36.673 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:36.673+0000 7f4a20ff9640 1 -- 172.21.15.150:0/1178101363 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 5822+0+0 (secure 0 0 0) 0x7f4a180b9cf0 con 0x7f4a241f93e0 2024-09-17T05:49:36.679 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:36.678+0000 7f4a20ff9640 1 -- 172.21.15.150:0/1178101363 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f4a24070290 con 0x7f4a241f93e0 2024-09-17T05:49:36.706 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:36.706+0000 7f4a23fff640 1 --2- 172.21.15.150:0/1178101363 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f4a1007a1b0 0x7f4a1007c6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:49:36.764 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:36.764+0000 7f4a23fff640 1 --2- 172.21.15.150:0/1178101363 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f4a1007a1b0 0x7f4a1007c6c0 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7f4a1400ab10 tx=0x7f4a14009250 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:49:36.981 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:36.980+0000 7f4a2a939640 1 -- 172.21.15.150:0/1178101363 --> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] -- mgr_command(tid 0: {"prefix": "fs clone cancel", "vol_name": "cephfs", "clone_name": "subvol_clone149612", "target": ["mon-mgr", ""]}) -- 0x7f4a04000bc0 con 0x7f4a1007a1b0 2024-09-17T05:49:37.899 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:37.898+0000 7f4a20ff9640 1 -- 172.21.15.150:0/1178101363 <== mon.0 v2:172.21.15.150:3300/0 7 ==== mgrmap(e 31) ==== 103379+0+0 (secure 0 0 0) 0x7f4a1807f350 con 0x7f4a241f93e0 2024-09-17T05:49:38.292 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:38.292+0000 7f4a20ff9640 1 -- 172.21.15.150:0/1178101363 <== mgr.4108 v2:172.21.15.176:6800/3631216395 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f4a04000bc0 con 0x7f4a1007a1b0 2024-09-17T05:49:38.296 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:38.295+0000 7f4a2a939640 1 -- 172.21.15.150:0/1178101363 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f4a1007a1b0 msgr2=0x7f4a1007c6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:49:38.297 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:38.295+0000 7f4a2a939640 1 --2- 172.21.15.150:0/1178101363 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f4a1007a1b0 0x7f4a1007c6c0 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7f4a1400ab10 tx=0x7f4a14009250 comp rx=0 tx=0).stop 2024-09-17T05:49:38.297 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:38.295+0000 7f4a2a939640 1 -- 172.21.15.150:0/1178101363 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4a241f93e0 msgr2=0x7f4a2406f940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:49:38.297 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:38.295+0000 7f4a2a939640 1 --2- 172.21.15.150:0/1178101363 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4a241f93e0 0x7f4a2406f940 secure :-1 s=READY pgs=1166 cs=0 l=1 rev1=1 crypto rx=0x7f4a1800c590 tx=0x7f4a18006290 comp rx=0 tx=0).stop 2024-09-17T05:49:38.297 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:38.295+0000 7f4a2a939640 1 -- 172.21.15.150:0/1178101363 shutdown_connections 2024-09-17T05:49:38.297 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:38.295+0000 7f4a2a939640 1 --2- 172.21.15.150:0/1178101363 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4a2406fe80 0x7f4a240ad8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:49:38.297 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:38.295+0000 7f4a2a939640 1 --2- 172.21.15.150:0/1178101363 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f4a1007a1b0 0x7f4a1007c6c0 unknown :-1 s=CLOSED pgs=500 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:49:38.297 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:38.295+0000 7f4a2a939640 1 --2- 172.21.15.150:0/1178101363 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4a241f93e0 0x7f4a2406f940 unknown :-1 s=CLOSED pgs=1166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:49:38.297 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:38.295+0000 7f4a2a939640 1 --2- 172.21.15.150:0/1178101363 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4a0c004800 0x7f4a2415bcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:49:38.297 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:38.296+0000 7f4a2a939640 1 -- 172.21.15.150:0/1178101363 >> 172.21.15.150:0/1178101363 conn(0x7f4a24074890 msgr2=0x7f4a240cfe10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:49:38.297 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:38.296+0000 7f4a2a939640 1 -- 172.21.15.150:0/1178101363 shutdown_connections 2024-09-17T05:49:38.297 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:38.296+0000 7f4a2a939640 1 -- 172.21.15.150:0/1178101363 wait complete. 2024-09-17T05:49:38.311 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs clone cancel cephfs subvol_clone941013 2024-09-17T05:49:38.493 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:38.492+0000 7fb9d362e640 1 -- 172.21.15.150:0/104353035 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb9cc0d5150 msgr2=0x7fb9cc0b9b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:49:38.493 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:38.492+0000 7fb9d362e640 1 --2- 172.21.15.150:0/104353035 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb9cc0d5150 0x7fb9cc0b9b10 secure :-1 s=READY pgs=1167 cs=0 l=1 rev1=1 crypto rx=0x7fb9c80098e0 tx=0x7fb9c802a520 comp rx=0 tx=0).stop 2024-09-17T05:49:38.494 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:38.492+0000 7fb9d362e640 1 -- 172.21.15.150:0/104353035 shutdown_connections 2024-09-17T05:49:38.494 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:38.492+0000 7fb9d362e640 1 --2- 172.21.15.150:0/104353035 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb9cc0d0730 0x7fb9cc0b6160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:49:38.494 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:38.492+0000 7fb9d362e640 1 --2- 172.21.15.150:0/104353035 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb9cc0d5150 0x7fb9cc0b9b10 unknown :-1 s=CLOSED pgs=1167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:49:38.494 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:38.492+0000 7fb9d362e640 1 -- 172.21.15.150:0/104353035 >> 172.21.15.150:0/104353035 conn(0x7fb9cc08bfe0 msgr2=0x7fb9cc0d46e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:49:38.494 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:38.493+0000 7fb9d362e640 1 -- 172.21.15.150:0/104353035 shutdown_connections 2024-09-17T05:49:38.494 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:38.493+0000 7fb9d362e640 1 -- 172.21.15.150:0/104353035 wait complete. 2024-09-17T05:49:38.495 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:38.495+0000 7fb9d362e640 1 Processor -- start 2024-09-17T05:49:38.495 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:38.495+0000 7fb9d362e640 1 -- start start 2024-09-17T05:49:38.498 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:38.496+0000 7fb9d362e640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb9cc06dea0 0x7fb9cc0a1e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:49:38.498 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:38.496+0000 7fb9d362e640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb9cc0d0730 0x7fb9cc09e3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:49:38.498 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:38.496+0000 7fb9d362e640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb9cc0d5150 0x7fb9cc09e8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:49:38.498 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:38.496+0000 7fb9d362e640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7fb9cc06e2b0 con 0x7fb9cc06dea0 2024-09-17T05:49:38.498 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:38.496+0000 7fb9d362e640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fb9cc0d31e0 con 0x7fb9cc0d0730 2024-09-17T05:49:38.499 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:38.496+0000 7fb9d362e640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fb9cc06e430 con 0x7fb9cc0d5150 2024-09-17T05:49:38.499 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:38.497+0000 7fb9d13ca640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb9cc06dea0 0x7fb9cc0a1e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:49:38.499 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:38.497+0000 7fb9d13ca640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb9cc06dea0 0x7fb9cc0a1e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:39200/0 (socket says 172.21.15.150:39200) 2024-09-17T05:49:38.499 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:38.497+0000 7fb9d13ca640 1 -- 172.21.15.150:0/4032113716 learned_addr learned my addr 172.21.15.150:0/4032113716 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:49:38.499 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:38.497+0000 7fb9d0bc9640 1 --2- 172.21.15.150:0/4032113716 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb9cc0d0730 0x7fb9cc09e3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:49:38.499 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:38.497+0000 7fb9d1bcb640 1 --2- 172.21.15.150:0/4032113716 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb9cc0d5150 0x7fb9cc09e8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:49:38.499 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:38.497+0000 7fb9d13ca640 1 -- 172.21.15.150:0/4032113716 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb9cc0d5150 msgr2=0x7fb9cc09e8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:49:38.499 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:38.497+0000 7fb9d13ca640 1 --2- 172.21.15.150:0/4032113716 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb9cc0d5150 0x7fb9cc09e8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:49:38.499 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:38.497+0000 7fb9d13ca640 1 -- 172.21.15.150:0/4032113716 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb9cc0d0730 msgr2=0x7fb9cc09e3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:49:38.499 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:38.497+0000 7fb9d13ca640 1 --2- 172.21.15.150:0/4032113716 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb9cc0d0730 0x7fb9cc09e3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:49:38.499 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:38.497+0000 7fb9d13ca640 1 -- 172.21.15.150:0/4032113716 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb9cc0a2340 con 0x7fb9cc06dea0 2024-09-17T05:49:38.499 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:38.497+0000 7fb9d13ca640 1 --2- 172.21.15.150:0/4032113716 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb9cc06dea0 0x7fb9cc0a1e00 secure :-1 s=READY pgs=1168 cs=0 l=1 rev1=1 crypto rx=0x7fb9c8009a00 tx=0x7fb9c8004ac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:49:38.500 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:38.497+0000 7fb9c1ffb640 1 -- 172.21.15.150:0/4032113716 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9c8031b50 con 0x7fb9cc06dea0 2024-09-17T05:49:38.500 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:38.497+0000 7fb9c1ffb640 1 -- 172.21.15.150:0/4032113716 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb9c8031de0 con 0x7fb9cc06dea0 2024-09-17T05:49:38.500 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:38.497+0000 7fb9c1ffb640 1 -- 172.21.15.150:0/4032113716 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9c8033330 con 0x7fb9cc06dea0 2024-09-17T05:49:38.500 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:38.497+0000 7fb9d362e640 1 -- 172.21.15.150:0/4032113716 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb9cc0a1190 con 0x7fb9cc06dea0 2024-09-17T05:49:38.500 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:38.498+0000 7fb9d362e640 1 -- 172.21.15.150:0/4032113716 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb9cc1f6370 con 0x7fb9cc06dea0 2024-09-17T05:49:38.501 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:38.499+0000 7fb9d362e640 1 -- 172.21.15.150:0/4032113716 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb9cc0a1360 con 0x7fb9cc06dea0 2024-09-17T05:49:38.501 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:38.499+0000 7fb9c1ffb640 1 -- 172.21.15.150:0/4032113716 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 31) ==== 103379+0+0 (secure 0 0 0) 0x7fb9c80334d0 con 0x7fb9cc06dea0 2024-09-17T05:49:38.501 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:38.500+0000 7fb9c1ffb640 1 --2- 172.21.15.150:0/4032113716 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fb9b007a0f0 0x7fb9b007c600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:49:38.501 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:38.500+0000 7fb9c1ffb640 1 -- 172.21.15.150:0/4032113716 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 5822+0+0 (secure 0 0 0) 0x7fb9c80bb2b0 con 0x7fb9cc06dea0 2024-09-17T05:49:38.508 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:38.507+0000 7fb9c1ffb640 1 -- 172.21.15.150:0/4032113716 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fb9c803f030 con 0x7fb9cc06dea0 2024-09-17T05:49:38.529 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:38.529+0000 7fb9d0bc9640 1 --2- 172.21.15.150:0/4032113716 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fb9b007a0f0 0x7fb9b007c600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:49:38.568 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:38.567+0000 7fb9d0bc9640 1 --2- 172.21.15.150:0/4032113716 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fb9b007a0f0 0x7fb9b007c600 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7fb9bc006fd0 tx=0x7fb9bc008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:49:38.807 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:38.806+0000 7fb9d362e640 1 -- 172.21.15.150:0/4032113716 --> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] -- mgr_command(tid 0: {"prefix": "fs clone cancel", "vol_name": "cephfs", "clone_name": "subvol_clone941013", "target": ["mon-mgr", ""]}) -- 0x7fb9cc0b6760 con 0x7fb9b007a0f0 2024-09-17T05:49:40.566 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:40.565+0000 7fb9c1ffb640 1 -- 172.21.15.150:0/4032113716 <== mgr.4108 v2:172.21.15.176:6800/3631216395 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7fb9cc0b6760 con 0x7fb9b007a0f0 2024-09-17T05:49:40.570 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:40.569+0000 7fb9d362e640 1 -- 172.21.15.150:0/4032113716 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fb9b007a0f0 msgr2=0x7fb9b007c600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:49:40.571 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:40.569+0000 7fb9d362e640 1 --2- 172.21.15.150:0/4032113716 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fb9b007a0f0 0x7fb9b007c600 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7fb9bc006fd0 tx=0x7fb9bc008040 comp rx=0 tx=0).stop 2024-09-17T05:49:40.571 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:40.569+0000 7fb9d362e640 1 -- 172.21.15.150:0/4032113716 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb9cc06dea0 msgr2=0x7fb9cc0a1e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:49:40.571 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:40.569+0000 7fb9d362e640 1 --2- 172.21.15.150:0/4032113716 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb9cc06dea0 0x7fb9cc0a1e00 secure :-1 s=READY pgs=1168 cs=0 l=1 rev1=1 crypto rx=0x7fb9c8009a00 tx=0x7fb9c8004ac0 comp rx=0 tx=0).stop 2024-09-17T05:49:40.571 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:40.569+0000 7fb9d362e640 1 -- 172.21.15.150:0/4032113716 shutdown_connections 2024-09-17T05:49:40.571 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:40.569+0000 7fb9d362e640 1 --2- 172.21.15.150:0/4032113716 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb9cc0d0730 0x7fb9cc09e3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:49:40.572 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:40.569+0000 7fb9d362e640 1 --2- 172.21.15.150:0/4032113716 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fb9b007a0f0 0x7fb9b007c600 unknown :-1 s=CLOSED pgs=501 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:49:40.572 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:40.569+0000 7fb9d362e640 1 --2- 172.21.15.150:0/4032113716 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb9cc0d5150 0x7fb9cc09e8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:49:40.572 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:40.569+0000 7fb9d362e640 1 --2- 172.21.15.150:0/4032113716 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb9cc06dea0 0x7fb9cc0a1e00 secure :-1 s=CLOSED pgs=1168 cs=0 l=1 rev1=1 crypto rx=0x7fb9c8009a00 tx=0x7fb9c8004ac0 comp rx=0 tx=0).stop 2024-09-17T05:49:40.572 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:40.569+0000 7fb9d362e640 1 -- 172.21.15.150:0/4032113716 >> 172.21.15.150:0/4032113716 conn(0x7fb9cc08bfe0 msgr2=0x7fb9cc0d1140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:49:40.572 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:40.569+0000 7fb9d362e640 1 -- 172.21.15.150:0/4032113716 shutdown_connections 2024-09-17T05:49:40.573 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:40.570+0000 7fb9d362e640 1 -- 172.21.15.150:0/4032113716 wait complete. 2024-09-17T05:49:40.588 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs clone cancel cephfs subvol_clone818314 2024-09-17T05:49:40.754 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:40.753+0000 7fe9f15f1640 1 -- 172.21.15.150:0/735392822 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe9cc004800 msgr2=0x7fe9cc004c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:49:40.754 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:40.753+0000 7fe9f15f1640 1 --2- 172.21.15.150:0/735392822 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe9cc004800 0x7fe9cc004c10 secure :-1 s=READY pgs=1170 cs=0 l=1 rev1=1 crypto rx=0x7fe9d400c6e0 tx=0x7fe9cc005830 comp rx=0 tx=0).stop 2024-09-17T05:49:40.754 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:40.753+0000 7fe9eb7fe640 1 -- 172.21.15.150:0/735392822 reap_dead start 2024-09-17T05:49:40.755 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:40.753+0000 7fe9f15f1640 1 -- 172.21.15.150:0/735392822 shutdown_connections 2024-09-17T05:49:40.755 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:40.753+0000 7fe9f15f1640 1 -- 172.21.15.150:0/735392822 >> 172.21.15.150:0/735392822 conn(0x7fe9ec073890 msgr2=0x7fe9ec073ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:49:40.755 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:40.753+0000 7fe9f15f1640 1 -- 172.21.15.150:0/735392822 shutdown_connections 2024-09-17T05:49:40.755 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:40.753+0000 7fe9f15f1640 1 -- 172.21.15.150:0/735392822 wait complete. 2024-09-17T05:49:40.756 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:40.756+0000 7fe9f15f1640 1 Processor -- start 2024-09-17T05:49:40.756 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:40.756+0000 7fe9f15f1640 1 -- start start 2024-09-17T05:49:40.759 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:40.758+0000 7fe9f15f1640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe9cc004800 0x7fe9ec13c730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:49:40.759 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:40.758+0000 7fe9f15f1640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe9ec13fcc0 0x7fe9ec1e3f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:49:40.760 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:40.758+0000 7fe9f15f1640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe9ec1e5950 0x7fe9ec1e5d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:49:40.760 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:40.758+0000 7fe9f15f1640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7fe9ec06e550 con 0x7fe9ec13fcc0 2024-09-17T05:49:40.760 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:40.758+0000 7fe9f15f1640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fe9ec06e3d0 con 0x7fe9ec1e5950 2024-09-17T05:49:40.760 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:40.758+0000 7fe9f15f1640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fe9ec0cf760 con 0x7fe9cc004800 2024-09-17T05:49:40.760 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:40.758+0000 7fe9e3fff640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe9ec13fcc0 0x7fe9ec1e3f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:49:40.760 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:40.758+0000 7fe9e3fff640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe9ec13fcc0 0x7fe9ec1e3f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:36962/0 (socket says 172.21.15.150:36962) 2024-09-17T05:49:40.760 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:40.758+0000 7fe9e3fff640 1 -- 172.21.15.150:0/1398380148 learned_addr learned my addr 172.21.15.150:0/1398380148 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:49:40.760 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:40.758+0000 7fe9e3fff640 1 -- 172.21.15.150:0/1398380148 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe9cc004800 msgr2=0x7fe9ec13c730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:49:40.761 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:40.758+0000 7fe9e3fff640 1 --2- 172.21.15.150:0/1398380148 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe9cc004800 0x7fe9ec13c730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:49:40.761 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:40.758+0000 7fe9e3fff640 1 -- 172.21.15.150:0/1398380148 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe9ec1e5950 msgr2=0x7fe9ec1e5d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:49:40.761 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:40.758+0000 7fe9e3fff640 1 --2- 172.21.15.150:0/1398380148 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe9ec1e5950 0x7fe9ec1e5d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:49:40.761 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:40.758+0000 7fe9e3fff640 1 -- 172.21.15.150:0/1398380148 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe9ec1e48b0 con 0x7fe9ec13fcc0 2024-09-17T05:49:40.761 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:40.759+0000 7fe9e3fff640 1 --2- 172.21.15.150:0/1398380148 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe9ec13fcc0 0x7fe9ec1e3f80 secure :-1 s=READY pgs=1171 cs=0 l=1 rev1=1 crypto rx=0x7fe9d400c6e0 tx=0x7fe9d4006030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:49:40.761 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:40.759+0000 7fe9e37fe640 1 -- 172.21.15.150:0/1398380148 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9d4006430 con 0x7fe9ec13fcc0 2024-09-17T05:49:40.761 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:40.759+0000 7fe9e37fe640 1 -- 172.21.15.150:0/1398380148 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe9d40035f0 con 0x7fe9ec13fcc0 2024-09-17T05:49:40.761 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:40.759+0000 7fe9e37fe640 1 -- 172.21.15.150:0/1398380148 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9d40039e0 con 0x7fe9ec13fcc0 2024-09-17T05:49:40.761 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:40.759+0000 7fe9f15f1640 1 -- 172.21.15.150:0/1398380148 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe9ec1e4b90 con 0x7fe9ec13fcc0 2024-09-17T05:49:40.761 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:40.759+0000 7fe9f15f1640 1 -- 172.21.15.150:0/1398380148 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe9ec1e5150 con 0x7fe9ec13fcc0 2024-09-17T05:49:40.762 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:40.760+0000 7fe9f15f1640 1 -- 172.21.15.150:0/1398380148 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe9ec0cfcc0 con 0x7fe9ec13fcc0 2024-09-17T05:49:40.762 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:40.762+0000 7fe9e37fe640 1 -- 172.21.15.150:0/1398380148 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 31) ==== 103379+0+0 (secure 0 0 0) 0x7fe9d4049480 con 0x7fe9ec13fcc0 2024-09-17T05:49:40.763 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:40.762+0000 7fe9e37fe640 1 --2- 172.21.15.150:0/1398380148 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fe9d007a0f0 0x7fe9d007c600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:49:40.763 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:40.763+0000 7fe9e37fe640 1 -- 172.21.15.150:0/1398380148 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 5822+0+0 (secure 0 0 0) 0x7fe9d40b9cc0 con 0x7fe9ec13fcc0 2024-09-17T05:49:40.768 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:40.767+0000 7fe9e37fe640 1 -- 172.21.15.150:0/1398380148 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fe9d40837b0 con 0x7fe9ec13fcc0 2024-09-17T05:49:40.772 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:40.772+0000 7fe9eaffd640 1 --2- 172.21.15.150:0/1398380148 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fe9d007a0f0 0x7fe9d007c600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:49:40.803 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:40.802+0000 7fe9eaffd640 1 --2- 172.21.15.150:0/1398380148 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fe9d007a0f0 0x7fe9d007c600 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7fe9dc007d00 tx=0x7fe9dc001f80 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:49:41.105 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:41.105+0000 7fe9f15f1640 1 -- 172.21.15.150:0/1398380148 --> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] -- mgr_command(tid 0: {"prefix": "fs clone cancel", "vol_name": "cephfs", "clone_name": "subvol_clone818314", "target": ["mon-mgr", ""]}) -- 0x7fe9ec15d3a0 con 0x7fe9d007a0f0 2024-09-17T05:49:42.628 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:42.627+0000 7fe9e37fe640 1 -- 172.21.15.150:0/1398380148 <== mgr.4108 v2:172.21.15.176:6800/3631216395 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7fe9ec15d3a0 con 0x7fe9d007a0f0 2024-09-17T05:49:42.631 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:42.630+0000 7fe9f15f1640 1 -- 172.21.15.150:0/1398380148 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fe9d007a0f0 msgr2=0x7fe9d007c600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:49:42.631 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:42.630+0000 7fe9f15f1640 1 --2- 172.21.15.150:0/1398380148 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fe9d007a0f0 0x7fe9d007c600 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7fe9dc007d00 tx=0x7fe9dc001f80 comp rx=0 tx=0).stop 2024-09-17T05:49:42.631 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:42.630+0000 7fe9f15f1640 1 -- 172.21.15.150:0/1398380148 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe9ec13fcc0 msgr2=0x7fe9ec1e3f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:49:42.631 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:42.630+0000 7fe9f15f1640 1 --2- 172.21.15.150:0/1398380148 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe9ec13fcc0 0x7fe9ec1e3f80 secure :-1 s=READY pgs=1171 cs=0 l=1 rev1=1 crypto rx=0x7fe9d400c6e0 tx=0x7fe9d4006030 comp rx=0 tx=0).stop 2024-09-17T05:49:42.631 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:42.630+0000 7fe9f15f1640 1 -- 172.21.15.150:0/1398380148 shutdown_connections 2024-09-17T05:49:42.631 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:42.630+0000 7fe9f15f1640 1 --2- 172.21.15.150:0/1398380148 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe9ec1e5950 0x7fe9ec1e5d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:49:42.631 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:42.630+0000 7fe9f15f1640 1 --2- 172.21.15.150:0/1398380148 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fe9d007a0f0 0x7fe9d007c600 unknown :-1 s=CLOSED pgs=502 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:49:42.632 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:42.630+0000 7fe9f15f1640 1 --2- 172.21.15.150:0/1398380148 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe9ec13fcc0 0x7fe9ec1e3f80 unknown :-1 s=CLOSED pgs=1171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:49:42.632 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:42.630+0000 7fe9f15f1640 1 --2- 172.21.15.150:0/1398380148 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe9cc004800 0x7fe9ec13c730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:49:42.632 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:42.630+0000 7fe9f15f1640 1 -- 172.21.15.150:0/1398380148 >> 172.21.15.150:0/1398380148 conn(0x7fe9ec073890 msgr2=0x7fe9ec15d7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:49:42.632 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:42.630+0000 7fe9f15f1640 1 -- 172.21.15.150:0/1398380148 shutdown_connections 2024-09-17T05:49:42.632 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:42.630+0000 7fe9f15f1640 1 -- 172.21.15.150:0/1398380148 wait complete. 2024-09-17T05:49:42.647 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs clone cancel cephfs subvol_clone719215 2024-09-17T05:49:42.825 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:42.824+0000 7fe9c4cde640 1 -- 172.21.15.150:0/542718964 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe9c00b6550 msgr2=0x7fe9c00b24c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:49:42.825 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:42.824+0000 7fe9c4cde640 1 --2- 172.21.15.150:0/542718964 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe9c00b6550 0x7fe9c00b24c0 secure :-1 s=READY pgs=1173 cs=0 l=1 rev1=1 crypto rx=0x7fe9b0005fd0 tx=0x7fe9b002a540 comp rx=0 tx=0).stop 2024-09-17T05:49:42.825 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:42.824+0000 7fe9c4cde640 1 -- 172.21.15.150:0/542718964 shutdown_connections 2024-09-17T05:49:42.825 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:42.824+0000 7fe9c4cde640 1 --2- 172.21.15.150:0/542718964 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe9c0160200 0x7fe9c00b4e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:49:42.825 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:42.824+0000 7fe9c4cde640 1 --2- 172.21.15.150:0/542718964 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe9c00b6550 0x7fe9c00b24c0 unknown :-1 s=CLOSED pgs=1173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:49:42.828 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:42.824+0000 7fe9c4cde640 1 -- 172.21.15.150:0/542718964 >> 172.21.15.150:0/542718964 conn(0x7fe9c00b2e80 msgr2=0x7fe9c00b3290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:49:42.828 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:42.824+0000 7fe9c4cde640 1 -- 172.21.15.150:0/542718964 shutdown_connections 2024-09-17T05:49:42.828 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:42.824+0000 7fe9c4cde640 1 -- 172.21.15.150:0/542718964 wait complete. 2024-09-17T05:49:42.829 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:42.826+0000 7fe9c4cde640 1 Processor -- start 2024-09-17T05:49:42.829 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:42.826+0000 7fe9c4cde640 1 -- start start 2024-09-17T05:49:42.829 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:42.828+0000 7fe9c4cde640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe9c00b2a00 0x7fe9c015ed90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:49:42.830 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:42.828+0000 7fe9c4cde640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe9c00b6550 0x7fe9c0159ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:49:42.830 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:42.828+0000 7fe9c4cde640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe9c0160200 0x7fe9c00af960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:49:42.830 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:42.828+0000 7fe9c4cde640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7fe9c00b5390 con 0x7fe9c00b2a00 2024-09-17T05:49:42.830 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:42.828+0000 7fe9c4cde640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fe9c0160820 con 0x7fe9c0160200 2024-09-17T05:49:42.830 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:42.828+0000 7fe9c4cde640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fe9c00b5510 con 0x7fe9c00b6550 2024-09-17T05:49:42.830 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:42.828+0000 7fe9be59c640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe9c00b2a00 0x7fe9c015ed90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:49:42.830 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:42.828+0000 7fe9be59c640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe9c00b2a00 0x7fe9c015ed90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:36986/0 (socket says 172.21.15.150:36986) 2024-09-17T05:49:42.830 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:42.828+0000 7fe9be59c640 1 -- 172.21.15.150:0/744252093 learned_addr learned my addr 172.21.15.150:0/744252093 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:49:42.830 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:42.828+0000 7fe9be59c640 1 -- 172.21.15.150:0/744252093 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe9c00b6550 msgr2=0x7fe9c0159ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:49:42.830 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:42.828+0000 7fe9be59c640 1 --2- 172.21.15.150:0/744252093 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe9c00b6550 0x7fe9c0159ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:49:42.830 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:42.828+0000 7fe9be59c640 1 -- 172.21.15.150:0/744252093 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe9c0160200 msgr2=0x7fe9c00af960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:49:42.830 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:42.828+0000 7fe9be59c640 1 --2- 172.21.15.150:0/744252093 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe9c0160200 0x7fe9c00af960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:49:42.831 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:42.828+0000 7fe9be59c640 1 -- 172.21.15.150:0/744252093 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe9c01f5d40 con 0x7fe9c00b2a00 2024-09-17T05:49:42.831 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:42.829+0000 7fe9be59c640 1 --2- 172.21.15.150:0/744252093 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe9c00b2a00 0x7fe9c015ed90 secure :-1 s=READY pgs=1174 cs=0 l=1 rev1=1 crypto rx=0x7fe9b0034040 tx=0x7fe9b0003970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:49:42.831 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:42.829+0000 7fe9b6ffd640 1 -- 172.21.15.150:0/744252093 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9b003e030 con 0x7fe9c00b2a00 2024-09-17T05:49:42.831 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:42.830+0000 7fe9b6ffd640 1 -- 172.21.15.150:0/744252093 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe9b00047a0 con 0x7fe9c00b2a00 2024-09-17T05:49:42.831 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:42.830+0000 7fe9b6ffd640 1 -- 172.21.15.150:0/744252093 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9b0035040 con 0x7fe9c00b2a00 2024-09-17T05:49:42.832 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:42.830+0000 7fe9c4cde640 1 -- 172.21.15.150:0/744252093 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe9c01f6000 con 0x7fe9c00b2a00 2024-09-17T05:49:42.832 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:42.830+0000 7fe9c4cde640 1 -- 172.21.15.150:0/744252093 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe9c01f65c0 con 0x7fe9c00b2a00 2024-09-17T05:49:42.832 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:42.831+0000 7fe9c4cde640 1 -- 172.21.15.150:0/744252093 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe9c00b24c0 con 0x7fe9c00b2a00 2024-09-17T05:49:42.835 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:42.834+0000 7fe9b6ffd640 1 -- 172.21.15.150:0/744252093 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 31) ==== 103379+0+0 (secure 0 0 0) 0x7fe9b0041030 con 0x7fe9c00b2a00 2024-09-17T05:49:42.835 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:42.835+0000 7fe9b6ffd640 1 --2- 172.21.15.150:0/744252093 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fe9a007a0f0 0x7fe9a007c600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:49:42.835 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:42.835+0000 7fe9b6ffd640 1 -- 172.21.15.150:0/744252093 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 5822+0+0 (secure 0 0 0) 0x7fe9b00bab00 con 0x7fe9c00b2a00 2024-09-17T05:49:42.842 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:42.841+0000 7fe9b6ffd640 1 -- 172.21.15.150:0/744252093 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fe9b0084620 con 0x7fe9c00b2a00 2024-09-17T05:49:42.884 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:42.884+0000 7fe9b7fff640 1 --2- 172.21.15.150:0/744252093 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fe9a007a0f0 0x7fe9a007c600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:49:42.922 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:42.921+0000 7fe9b7fff640 1 --2- 172.21.15.150:0/744252093 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fe9a007a0f0 0x7fe9a007c600 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7fe9c015ed40 tx=0x7fe9a8007930 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:49:43.188 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:43.186+0000 7fe9c4cde640 1 -- 172.21.15.150:0/744252093 --> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] -- mgr_command(tid 0: {"prefix": "fs clone cancel", "vol_name": "cephfs", "clone_name": "subvol_clone719215", "target": ["mon-mgr", ""]}) -- 0x7fe9c00b1440 con 0x7fe9a007a0f0 2024-09-17T05:49:44.636 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:44.634+0000 7fe9b6ffd640 1 -- 172.21.15.150:0/744252093 <== mgr.4108 v2:172.21.15.176:6800/3631216395 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7fe9c00b1440 con 0x7fe9a007a0f0 2024-09-17T05:49:44.638 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:44.636+0000 7fe9c4cde640 1 -- 172.21.15.150:0/744252093 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fe9a007a0f0 msgr2=0x7fe9a007c600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:49:44.638 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:44.636+0000 7fe9c4cde640 1 --2- 172.21.15.150:0/744252093 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fe9a007a0f0 0x7fe9a007c600 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7fe9c015ed40 tx=0x7fe9a8007930 comp rx=0 tx=0).stop 2024-09-17T05:49:44.639 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:44.636+0000 7fe9c4cde640 1 -- 172.21.15.150:0/744252093 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe9c00b2a00 msgr2=0x7fe9c015ed90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:49:44.639 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:44.636+0000 7fe9c4cde640 1 --2- 172.21.15.150:0/744252093 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe9c00b2a00 0x7fe9c015ed90 secure :-1 s=READY pgs=1174 cs=0 l=1 rev1=1 crypto rx=0x7fe9b0034040 tx=0x7fe9b0003970 comp rx=0 tx=0).stop 2024-09-17T05:49:44.639 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:44.636+0000 7fe9c4cde640 1 -- 172.21.15.150:0/744252093 shutdown_connections 2024-09-17T05:49:44.639 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:44.636+0000 7fe9c4cde640 1 --2- 172.21.15.150:0/744252093 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe9c0160200 0x7fe9c00af960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:49:44.639 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:44.636+0000 7fe9c4cde640 1 --2- 172.21.15.150:0/744252093 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fe9a007a0f0 0x7fe9a007c600 unknown :-1 s=CLOSED pgs=503 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:49:44.639 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:44.636+0000 7fe9c4cde640 1 --2- 172.21.15.150:0/744252093 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe9c00b6550 0x7fe9c0159ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:49:44.639 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:44.636+0000 7fe9c4cde640 1 --2- 172.21.15.150:0/744252093 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe9c00b2a00 0x7fe9c015ed90 unknown :-1 s=CLOSED pgs=1174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:49:44.639 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:44.636+0000 7fe9c4cde640 1 -- 172.21.15.150:0/744252093 >> 172.21.15.150:0/744252093 conn(0x7fe9c00b2e80 msgr2=0x7fe9c00cc090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:49:44.639 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:44.637+0000 7fe9c4cde640 1 -- 172.21.15.150:0/744252093 shutdown_connections 2024-09-17T05:49:44.639 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:44.637+0000 7fe9c4cde640 1 -- 172.21.15.150:0/744252093 wait complete. 2024-09-17T05:49:44.653 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs clone cancel cephfs subvol_clone748216 2024-09-17T05:49:44.825 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:44.823+0000 7f63a67fc640 1 -- 172.21.15.150:0/3360232641 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6390031bf0 con 0x7f63a80cd380 2024-09-17T05:49:44.826 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:44.824+0000 7f63ad519640 1 -- 172.21.15.150:0/3360232641 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f63a80cd380 msgr2=0x7f63a815ceb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:49:44.826 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:44.824+0000 7f63ad519640 1 --2- 172.21.15.150:0/3360232641 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f63a80cd380 0x7f63a815ceb0 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f6390009830 tx=0x7f639002a480 comp rx=0 tx=0).stop 2024-09-17T05:49:44.826 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:44.824+0000 7f63ad519640 1 -- 172.21.15.150:0/3360232641 shutdown_connections 2024-09-17T05:49:44.826 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:44.824+0000 7f63ad519640 1 --2- 172.21.15.150:0/3360232641 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f63a815d3f0 0x7f63a806ddb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:49:44.826 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:44.824+0000 7f63ad519640 1 --2- 172.21.15.150:0/3360232641 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f63a80cd380 0x7f63a815ceb0 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:49:44.826 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:44.824+0000 7f63ad519640 1 -- 172.21.15.150:0/3360232641 >> 172.21.15.150:0/3360232641 conn(0x7f63a8073890 msgr2=0x7f63a8073ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:49:44.826 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:44.824+0000 7f63ad519640 1 -- 172.21.15.150:0/3360232641 shutdown_connections 2024-09-17T05:49:44.826 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:44.824+0000 7f63ad519640 1 -- 172.21.15.150:0/3360232641 wait complete. 2024-09-17T05:49:44.827 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:44.826+0000 7f63ad519640 1 Processor -- start 2024-09-17T05:49:44.827 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:44.826+0000 7f63ad519640 1 -- start start 2024-09-17T05:49:44.829 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:44.828+0000 7f63ad519640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f63a80cd380 0x7f63a806fb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:49:44.830 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:44.828+0000 7f63ad519640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f63a815c820 0x7f63a81421d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:49:44.830 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:44.828+0000 7f63ad519640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f63a815d3f0 0x7f63a8142710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:49:44.830 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:44.828+0000 7f63ad519640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f63a80cf8e0 con 0x7f63a815c820 2024-09-17T05:49:44.830 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:44.828+0000 7f63ad519640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f63a80cf760 con 0x7f63a815d3f0 2024-09-17T05:49:44.830 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:44.828+0000 7f63ad519640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f63a80cfa60 con 0x7f63a80cd380 2024-09-17T05:49:44.830 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:44.828+0000 7f639ffff640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f63a815c820 0x7f63a81421d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:49:44.830 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:44.828+0000 7f639ffff640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f63a815c820 0x7f63a81421d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:36992/0 (socket says 172.21.15.150:36992) 2024-09-17T05:49:44.830 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:44.828+0000 7f639ffff640 1 -- 172.21.15.150:0/2284568630 learned_addr learned my addr 172.21.15.150:0/2284568630 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:49:44.830 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:44.828+0000 7f63a6ffd640 1 --2- 172.21.15.150:0/2284568630 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f63a80cd380 0x7f63a806fb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:49:44.832 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:44.828+0000 7f63a77fe640 1 --2- 172.21.15.150:0/2284568630 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f63a815d3f0 0x7f63a8142710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:49:44.832 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:44.828+0000 7f639ffff640 1 -- 172.21.15.150:0/2284568630 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f63a80cd380 msgr2=0x7f63a806fb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:49:44.832 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:44.828+0000 7f639ffff640 1 --2- 172.21.15.150:0/2284568630 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f63a80cd380 0x7f63a806fb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:49:44.832 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:44.828+0000 7f639ffff640 1 -- 172.21.15.150:0/2284568630 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f63a815d3f0 msgr2=0x7f63a8142710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:49:44.832 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:44.828+0000 7f639ffff640 1 --2- 172.21.15.150:0/2284568630 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f63a815d3f0 0x7f63a8142710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:49:44.832 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:44.829+0000 7f639ffff640 1 -- 172.21.15.150:0/2284568630 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f63a81f3910 con 0x7f63a815c820 2024-09-17T05:49:44.832 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:44.829+0000 7f63a6ffd640 1 --2- 172.21.15.150:0/2284568630 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f63a80cd380 0x7f63a806fb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:49:44.833 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:44.829+0000 7f63a77fe640 1 --2- 172.21.15.150:0/2284568630 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f63a815d3f0 0x7f63a8142710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:49:44.833 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:44.829+0000 7f639ffff640 1 --2- 172.21.15.150:0/2284568630 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f63a815c820 0x7f63a81421d0 secure :-1 s=READY pgs=1175 cs=0 l=1 rev1=1 crypto rx=0x7f6390009950 tx=0x7f6390033c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:49:44.833 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:44.829+0000 7f639f7fe640 1 -- 172.21.15.150:0/2284568630 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6390031d60 con 0x7f63a815c820 2024-09-17T05:49:44.833 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:44.830+0000 7f63ad519640 1 -- 172.21.15.150:0/2284568630 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f63a81f3bf0 con 0x7f63a815c820 2024-09-17T05:49:44.833 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:44.830+0000 7f639f7fe640 1 -- 172.21.15.150:0/2284568630 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f6390033e10 con 0x7f63a815c820 2024-09-17T05:49:44.833 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:44.830+0000 7f639f7fe640 1 -- 172.21.15.150:0/2284568630 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6390005260 con 0x7f63a815c820 2024-09-17T05:49:44.833 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:44.830+0000 7f63ad519640 1 -- 172.21.15.150:0/2284568630 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f63a81f41b0 con 0x7f63a815c820 2024-09-17T05:49:44.834 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:44.831+0000 7f63ad519640 1 -- 172.21.15.150:0/2284568630 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f63a80cff30 con 0x7f63a815c820 2024-09-17T05:49:44.834 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:44.832+0000 7f639f7fe640 1 -- 172.21.15.150:0/2284568630 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 31) ==== 103379+0+0 (secure 0 0 0) 0x7f6390005400 con 0x7f63a815c820 2024-09-17T05:49:44.834 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:44.833+0000 7f639f7fe640 1 --2- 172.21.15.150:0/2284568630 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f638807a0f0 0x7f638807c600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:49:44.834 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:44.833+0000 7f639f7fe640 1 -- 172.21.15.150:0/2284568630 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 5822+0+0 (secure 0 0 0) 0x7f63900bb3b0 con 0x7f63a815c820 2024-09-17T05:49:44.840 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:44.839+0000 7f639f7fe640 1 -- 172.21.15.150:0/2284568630 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f639003f030 con 0x7f63a815c820 2024-09-17T05:49:44.845 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:44.843+0000 7f63a6ffd640 1 --2- 172.21.15.150:0/2284568630 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f638807a0f0 0x7f638807c600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:49:44.882 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:44.881+0000 7f63a6ffd640 1 --2- 172.21.15.150:0/2284568630 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f638807a0f0 0x7f638807c600 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7f6398007fd0 tx=0x7f6398009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:49:45.175 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:45.173+0000 7f63ad519640 1 -- 172.21.15.150:0/2284568630 --> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] -- mgr_command(tid 0: {"prefix": "fs clone cancel", "vol_name": "cephfs", "clone_name": "subvol_clone748216", "target": ["mon-mgr", ""]}) -- 0x7f63a815b8b0 con 0x7f638807a0f0 2024-09-17T05:49:45.975 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:45.973+0000 7f639f7fe640 1 -- 172.21.15.150:0/2284568630 <== mgr.4108 v2:172.21.15.176:6800/3631216395 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f63a815b8b0 con 0x7f638807a0f0 2024-09-17T05:49:45.977 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:45.976+0000 7f63ad519640 1 -- 172.21.15.150:0/2284568630 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f638807a0f0 msgr2=0x7f638807c600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:49:45.978 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:45.976+0000 7f63ad519640 1 --2- 172.21.15.150:0/2284568630 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f638807a0f0 0x7f638807c600 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7f6398007fd0 tx=0x7f6398009040 comp rx=0 tx=0).stop 2024-09-17T05:49:45.978 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:45.976+0000 7f63ad519640 1 -- 172.21.15.150:0/2284568630 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f63a815c820 msgr2=0x7f63a81421d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:49:45.978 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:45.976+0000 7f63ad519640 1 --2- 172.21.15.150:0/2284568630 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f63a815c820 0x7f63a81421d0 secure :-1 s=READY pgs=1175 cs=0 l=1 rev1=1 crypto rx=0x7f6390009950 tx=0x7f6390033c20 comp rx=0 tx=0).stop 2024-09-17T05:49:45.978 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:45.976+0000 7f63ad519640 1 -- 172.21.15.150:0/2284568630 shutdown_connections 2024-09-17T05:49:45.978 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:45.976+0000 7f63ad519640 1 --2- 172.21.15.150:0/2284568630 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f63a815d3f0 0x7f63a8142710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:49:45.978 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:45.976+0000 7f63ad519640 1 --2- 172.21.15.150:0/2284568630 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f638807a0f0 0x7f638807c600 unknown :-1 s=CLOSED pgs=504 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:49:45.978 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:45.976+0000 7f63ad519640 1 --2- 172.21.15.150:0/2284568630 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f63a815c820 0x7f63a81421d0 unknown :-1 s=CLOSED pgs=1175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:49:45.978 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:45.976+0000 7f63ad519640 1 --2- 172.21.15.150:0/2284568630 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f63a80cd380 0x7f63a806fb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:49:45.978 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:45.976+0000 7f63ad519640 1 -- 172.21.15.150:0/2284568630 >> 172.21.15.150:0/2284568630 conn(0x7f63a8073890 msgr2=0x7f63a806d760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:49:45.978 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:45.976+0000 7f63ad519640 1 -- 172.21.15.150:0/2284568630 shutdown_connections 2024-09-17T05:49:45.978 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:45.976+0000 7f63ad519640 1 -- 172.21.15.150:0/2284568630 wait complete. 2024-09-17T05:49:45.992 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs clone cancel cephfs subvol_clone126017 2024-09-17T05:49:46.176 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:46.173+0000 7f137cf8b640 1 -- 172.21.15.150:0/482281751 <== mon.2 v2:172.21.15.176:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13680047a0 con 0x7f137806e4c0 2024-09-17T05:49:46.176 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:46.174+0000 7f13801f1640 1 -- 172.21.15.150:0/482281751 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f137806e4c0 msgr2=0x7f137815ec30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:49:46.176 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:46.174+0000 7f13801f1640 1 --2- 172.21.15.150:0/482281751 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f137806e4c0 0x7f137815ec30 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f1368005fd0 tx=0x7f136802a4a0 comp rx=0 tx=0).stop 2024-09-17T05:49:46.176 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:46.174+0000 7f13801f1640 1 -- 172.21.15.150:0/482281751 shutdown_connections 2024-09-17T05:49:46.176 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:46.174+0000 7f13801f1640 1 --2- 172.21.15.150:0/482281751 >> v2:172.21.15.176:3300/0 conn(0x7f137806f980 0x7f137806fd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:49:46.177 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:46.174+0000 7f13801f1640 1 --2- 172.21.15.150:0/482281751 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f137806e4c0 0x7f137815ec30 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:49:46.177 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:46.174+0000 7f13801f1640 1 -- 172.21.15.150:0/482281751 >> 172.21.15.150:0/482281751 conn(0x7f1378073820 msgr2=0x7f1378073c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:49:46.177 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:46.174+0000 7f13801f1640 1 -- 172.21.15.150:0/482281751 shutdown_connections 2024-09-17T05:49:46.177 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:46.174+0000 7f13801f1640 1 -- 172.21.15.150:0/482281751 wait complete. 2024-09-17T05:49:46.178 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:46.176+0000 7f13801f1640 1 Processor -- start 2024-09-17T05:49:46.178 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:46.176+0000 7f13801f1640 1 -- start start 2024-09-17T05:49:46.180 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:46.177+0000 7f13801f1640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f137806f980 0x7f13780cd580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:49:46.180 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:46.177+0000 7f13801f1640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f13780b4550 0x7f13780cfe50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:49:46.180 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:46.177+0000 7f13801f1640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f13781f4d00 0x7f1378150460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:49:46.181 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:46.178+0000 7f13801f1640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f13780ae530 con 0x7f137806f980 2024-09-17T05:49:46.181 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:46.178+0000 7f13801f1640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f13780ae3b0 con 0x7f13781f4d00 2024-09-17T05:49:46.181 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:46.178+0000 7f13801f1640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f13780ae6b0 con 0x7f13780b4550 2024-09-17T05:49:46.181 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:46.178+0000 7f137df8d640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f137806f980 0x7f13780cd580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:49:46.181 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:46.178+0000 7f137df8d640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f137806f980 0x7f13780cd580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:36996/0 (socket says 172.21.15.150:36996) 2024-09-17T05:49:46.181 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:46.178+0000 7f137df8d640 1 -- 172.21.15.150:0/3406604481 learned_addr learned my addr 172.21.15.150:0/3406604481 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:49:46.181 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:46.178+0000 7f137df8d640 1 -- 172.21.15.150:0/3406604481 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f13780b4550 msgr2=0x7f13780cfe50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:49:46.181 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:46.178+0000 7f137df8d640 1 --2- 172.21.15.150:0/3406604481 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f13780b4550 0x7f13780cfe50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:49:46.181 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:46.178+0000 7f137df8d640 1 -- 172.21.15.150:0/3406604481 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f13781f4d00 msgr2=0x7f1378150460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:49:46.181 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:46.178+0000 7f137df8d640 1 --2- 172.21.15.150:0/3406604481 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f13781f4d00 0x7f1378150460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:49:46.181 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:46.178+0000 7f137df8d640 1 -- 172.21.15.150:0/3406604481 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f13780cdac0 con 0x7f137806f980 2024-09-17T05:49:46.181 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:46.178+0000 7f137df8d640 1 --2- 172.21.15.150:0/3406604481 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f137806f980 0x7f13780cd580 secure :-1 s=READY pgs=1176 cs=0 l=1 rev1=1 crypto rx=0x7f137400b3f0 tx=0x7f137400b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:49:46.182 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:46.179+0000 7f136e7fc640 1 -- 172.21.15.150:0/3406604481 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1374015020 con 0x7f137806f980 2024-09-17T05:49:46.182 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:46.179+0000 7f13801f1640 1 -- 172.21.15.150:0/3406604481 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f137815fbb0 con 0x7f137806f980 2024-09-17T05:49:46.182 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:46.179+0000 7f13801f1640 1 -- 172.21.15.150:0/3406604481 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f137814f980 con 0x7f137806f980 2024-09-17T05:49:46.182 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:46.179+0000 7f136e7fc640 1 -- 172.21.15.150:0/3406604481 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f1374011920 con 0x7f137806f980 2024-09-17T05:49:46.182 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:46.179+0000 7f136e7fc640 1 -- 172.21.15.150:0/3406604481 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1374011d70 con 0x7f137806f980 2024-09-17T05:49:46.182 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:46.180+0000 7f13801f1640 1 -- 172.21.15.150:0/3406604481 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1360005290 con 0x7f137806f980 2024-09-17T05:49:46.182 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:46.181+0000 7f136e7fc640 1 -- 172.21.15.150:0/3406604481 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 31) ==== 103379+0+0 (secure 0 0 0) 0x7f1374018020 con 0x7f137806f980 2024-09-17T05:49:46.183 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:46.181+0000 7f136e7fc640 1 --2- 172.21.15.150:0/3406604481 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f135c07a0f0 0x7f135c07c600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:49:46.183 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:46.181+0000 7f136e7fc640 1 -- 172.21.15.150:0/3406604481 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 5822+0+0 (secure 0 0 0) 0x7f1374099c80 con 0x7f137806f980 2024-09-17T05:49:46.192 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:46.190+0000 7f136e7fc640 1 -- 172.21.15.150:0/3406604481 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f137401f020 con 0x7f137806f980 2024-09-17T05:49:46.200 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:46.199+0000 7f137d78c640 1 --2- 172.21.15.150:0/3406604481 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f135c07a0f0 0x7f135c07c600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:49:46.210 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:46.208+0000 7f137d78c640 1 --2- 172.21.15.150:0/3406604481 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f135c07a0f0 0x7f135c07c600 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7f1368033000 tx=0x7f13680046c0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:49:46.512 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:46.510+0000 7f13801f1640 1 -- 172.21.15.150:0/3406604481 --> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] -- mgr_command(tid 0: {"prefix": "fs clone cancel", "vol_name": "cephfs", "clone_name": "subvol_clone126017", "target": ["mon-mgr", ""]}) -- 0x7f1360000bc0 con 0x7f135c07a0f0 2024-09-17T05:49:47.663 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:47.661+0000 7f136e7fc640 1 -- 172.21.15.150:0/3406604481 <== mgr.4108 v2:172.21.15.176:6800/3631216395 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f1360000bc0 con 0x7f135c07a0f0 2024-09-17T05:49:47.666 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:47.664+0000 7f13801f1640 1 -- 172.21.15.150:0/3406604481 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f135c07a0f0 msgr2=0x7f135c07c600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:49:47.666 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:47.664+0000 7f13801f1640 1 --2- 172.21.15.150:0/3406604481 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f135c07a0f0 0x7f135c07c600 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7f1368033000 tx=0x7f13680046c0 comp rx=0 tx=0).stop 2024-09-17T05:49:47.666 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:47.664+0000 7f13801f1640 1 -- 172.21.15.150:0/3406604481 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f137806f980 msgr2=0x7f13780cd580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:49:47.666 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:47.664+0000 7f13801f1640 1 --2- 172.21.15.150:0/3406604481 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f137806f980 0x7f13780cd580 secure :-1 s=READY pgs=1176 cs=0 l=1 rev1=1 crypto rx=0x7f137400b3f0 tx=0x7f137400b8b0 comp rx=0 tx=0).stop 2024-09-17T05:49:47.667 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:47.664+0000 7f13801f1640 1 -- 172.21.15.150:0/3406604481 shutdown_connections 2024-09-17T05:49:47.667 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:47.664+0000 7f13801f1640 1 --2- 172.21.15.150:0/3406604481 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f13781f4d00 0x7f1378150460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:49:47.667 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:47.664+0000 7f13801f1640 1 --2- 172.21.15.150:0/3406604481 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f135c07a0f0 0x7f135c07c600 unknown :-1 s=CLOSED pgs=505 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:49:47.667 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:47.664+0000 7f13801f1640 1 --2- 172.21.15.150:0/3406604481 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f13780b4550 0x7f13780cfe50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:49:47.667 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:47.664+0000 7f13801f1640 1 --2- 172.21.15.150:0/3406604481 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f137806f980 0x7f13780cd580 unknown :-1 s=CLOSED pgs=1176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:49:47.667 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:47.664+0000 7f13801f1640 1 -- 172.21.15.150:0/3406604481 >> 172.21.15.150:0/3406604481 conn(0x7f1378073820 msgr2=0x7f13780b1d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:49:47.667 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:47.664+0000 7f13801f1640 1 -- 172.21.15.150:0/3406604481 shutdown_connections 2024-09-17T05:49:47.667 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:47.664+0000 7f13801f1640 1 -- 172.21.15.150:0/3406604481 wait complete. 2024-09-17T05:49:47.691 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs clone cancel cephfs subvol_clone369718 2024-09-17T05:49:47.881 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:47.879+0000 7f5410630640 1 -- 172.21.15.150:0/3430073145 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f54080cd0f0 msgr2=0x7f54080cd500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:49:47.881 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:47.879+0000 7f5410630640 1 --2- 172.21.15.150:0/3430073145 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f54080cd0f0 0x7f54080cd500 secure :-1 s=READY pgs=1177 cs=0 l=1 rev1=1 crypto rx=0x7f54080ccec0 tx=0x7f53f802a4a0 comp rx=0 tx=0).stop 2024-09-17T05:49:47.881 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:47.879+0000 7f5410630640 1 -- 172.21.15.150:0/3430073145 shutdown_connections 2024-09-17T05:49:47.881 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:47.879+0000 7f5410630640 1 --2- 172.21.15.150:0/3430073145 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f54080cda40 0x7f54080cde50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:49:47.882 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:47.879+0000 7f5410630640 1 --2- 172.21.15.150:0/3430073145 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f54080cd0f0 0x7f54080cd500 unknown :-1 s=CLOSED pgs=1177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:49:47.882 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:47.879+0000 7f5410630640 1 -- 172.21.15.150:0/3430073145 >> 172.21.15.150:0/3430073145 conn(0x7f54080d2520 msgr2=0x7f54080d2930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:49:47.882 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:47.879+0000 7f5410630640 1 -- 172.21.15.150:0/3430073145 shutdown_connections 2024-09-17T05:49:47.882 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:47.879+0000 7f5410630640 1 -- 172.21.15.150:0/3430073145 wait complete. 2024-09-17T05:49:47.883 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:47.881+0000 7f5410630640 1 Processor -- start 2024-09-17T05:49:47.883 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:47.881+0000 7f5410630640 1 -- start start 2024-09-17T05:49:47.886 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:47.883+0000 7f5410630640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f54080cd0f0 0x7f54080b4980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:49:47.886 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:47.883+0000 7f5410630640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f54080cda40 0x7f54080b0200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:49:47.886 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:47.883+0000 7f5410630640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f54080cec90 0x7f54080b0740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:49:47.886 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:47.883+0000 7f5410630640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f54080cfe60 con 0x7f54080cda40 2024-09-17T05:49:47.886 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:47.883+0000 7f5410630640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f54080cfce0 con 0x7f54080cd0f0 2024-09-17T05:49:47.886 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:47.883+0000 7f5410630640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f54080b7c70 con 0x7f54080cec90 2024-09-17T05:49:47.886 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:47.883+0000 7f540dbcb640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f54080cda40 0x7f54080b0200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:49:47.886 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:47.883+0000 7f540dbcb640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f54080cda40 0x7f54080b0200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:37016/0 (socket says 172.21.15.150:37016) 2024-09-17T05:49:47.887 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:47.883+0000 7f540dbcb640 1 -- 172.21.15.150:0/3368537227 learned_addr learned my addr 172.21.15.150:0/3368537227 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:49:47.887 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:47.884+0000 7f540dbcb640 1 -- 172.21.15.150:0/3368537227 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f54080cec90 msgr2=0x7f54080b0740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:49:47.887 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:47.884+0000 7f540dbcb640 1 --2- 172.21.15.150:0/3368537227 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f54080cec90 0x7f54080b0740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:49:47.887 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:47.884+0000 7f540dbcb640 1 -- 172.21.15.150:0/3368537227 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f54080cd0f0 msgr2=0x7f54080b4980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:49:47.887 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:47.884+0000 7f540dbcb640 1 --2- 172.21.15.150:0/3368537227 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f54080cd0f0 0x7f54080b4980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:49:47.887 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:47.884+0000 7f540dbcb640 1 -- 172.21.15.150:0/3368537227 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f54081f5e90 con 0x7f54080cda40 2024-09-17T05:49:47.887 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:47.884+0000 7f540dbcb640 1 --2- 172.21.15.150:0/3368537227 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f54080cda40 0x7f54080b0200 secure :-1 s=READY pgs=1178 cs=0 l=1 rev1=1 crypto rx=0x7f53f8034040 tx=0x7f53f80039e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:49:47.887 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:47.884+0000 7f53feffd640 1 -- 172.21.15.150:0/3368537227 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53f803e030 con 0x7f54080cda40 2024-09-17T05:49:47.887 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:47.884+0000 7f53feffd640 1 -- 172.21.15.150:0/3368537227 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f53f80047a0 con 0x7f54080cda40 2024-09-17T05:49:47.887 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:47.884+0000 7f5410630640 1 -- 172.21.15.150:0/3368537227 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f54081f9910 con 0x7f54080cda40 2024-09-17T05:49:47.887 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:47.884+0000 7f53feffd640 1 -- 172.21.15.150:0/3368537227 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53f8035040 con 0x7f54080cda40 2024-09-17T05:49:47.887 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:47.884+0000 7f5410630640 1 -- 172.21.15.150:0/3368537227 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f54081f9ed0 con 0x7f54080cda40 2024-09-17T05:49:47.888 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:47.885+0000 7f53fcff9640 1 -- 172.21.15.150:0/3368537227 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f53e4005290 con 0x7f54080cda40 2024-09-17T05:49:47.888 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:47.886+0000 7f53feffd640 1 -- 172.21.15.150:0/3368537227 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 31) ==== 103379+0+0 (secure 0 0 0) 0x7f53f8041030 con 0x7f54080cda40 2024-09-17T05:49:47.889 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:47.887+0000 7f53feffd640 1 --2- 172.21.15.150:0/3368537227 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f53ec07a120 0x7f53ec07c630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:49:47.889 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:47.888+0000 7f53feffd640 1 -- 172.21.15.150:0/3368537227 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 5822+0+0 (secure 0 0 0) 0x7f53f80ba5f0 con 0x7f54080cda40 2024-09-17T05:49:47.895 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:47.893+0000 7f53feffd640 1 -- 172.21.15.150:0/3368537227 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f53f8084170 con 0x7f54080cda40 2024-09-17T05:49:47.921 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:47.919+0000 7f540e3cc640 1 --2- 172.21.15.150:0/3368537227 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f53ec07a120 0x7f53ec07c630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:49:47.973 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:47.972+0000 7f540e3cc640 1 --2- 172.21.15.150:0/3368537227 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f53ec07a120 0x7f53ec07c630 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7f5404009650 tx=0x7f5404006ba0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:49:48.206 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:48.204+0000 7f53fcff9640 1 -- 172.21.15.150:0/3368537227 --> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] -- mgr_command(tid 0: {"prefix": "fs clone cancel", "vol_name": "cephfs", "clone_name": "subvol_clone369718", "target": ["mon-mgr", ""]}) -- 0x7f53e4000bc0 con 0x7f53ec07a120 2024-09-17T05:49:48.922 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:48.920+0000 7f53feffd640 1 -- 172.21.15.150:0/3368537227 <== mgr.4108 v2:172.21.15.176:6800/3631216395 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f53e4000bc0 con 0x7f53ec07a120 2024-09-17T05:49:48.925 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:48.923+0000 7f53fcff9640 1 -- 172.21.15.150:0/3368537227 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f53ec07a120 msgr2=0x7f53ec07c630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:49:48.925 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:48.923+0000 7f53fcff9640 1 --2- 172.21.15.150:0/3368537227 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f53ec07a120 0x7f53ec07c630 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7f5404009650 tx=0x7f5404006ba0 comp rx=0 tx=0).stop 2024-09-17T05:49:48.925 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:48.923+0000 7f53fcff9640 1 -- 172.21.15.150:0/3368537227 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f54080cda40 msgr2=0x7f54080b0200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:49:48.925 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:48.923+0000 7f53fcff9640 1 --2- 172.21.15.150:0/3368537227 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f54080cda40 0x7f54080b0200 secure :-1 s=READY pgs=1178 cs=0 l=1 rev1=1 crypto rx=0x7f53f8034040 tx=0x7f53f80039e0 comp rx=0 tx=0).stop 2024-09-17T05:49:48.925 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:48.923+0000 7f53fcff9640 1 -- 172.21.15.150:0/3368537227 shutdown_connections 2024-09-17T05:49:48.925 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:48.923+0000 7f53fcff9640 1 --2- 172.21.15.150:0/3368537227 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f53ec07a120 0x7f53ec07c630 unknown :-1 s=CLOSED pgs=506 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:49:48.925 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:48.923+0000 7f53fcff9640 1 --2- 172.21.15.150:0/3368537227 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f54080cec90 0x7f54080b0740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:49:48.925 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:48.923+0000 7f53fcff9640 1 --2- 172.21.15.150:0/3368537227 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f54080cda40 0x7f54080b0200 unknown :-1 s=CLOSED pgs=1178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:49:48.925 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:48.923+0000 7f53fcff9640 1 --2- 172.21.15.150:0/3368537227 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f54080cd0f0 0x7f54080b4980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:49:48.925 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:48.923+0000 7f53fcff9640 1 -- 172.21.15.150:0/3368537227 >> 172.21.15.150:0/3368537227 conn(0x7f54080d2520 msgr2=0x7f540815c6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:49:48.925 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:48.923+0000 7f53fcff9640 1 -- 172.21.15.150:0/3368537227 shutdown_connections 2024-09-17T05:49:48.925 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:48.923+0000 7f53fcff9640 1 -- 172.21.15.150:0/3368537227 wait complete. 2024-09-17T05:49:48.940 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs clone cancel cephfs subvol_clone408019 2024-09-17T05:49:49.092 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:49.090+0000 7f953ffda640 1 -- 172.21.15.150:0/542414278 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f95380b1700 msgr2=0x7f95380b1b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:49:49.092 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:49.090+0000 7f953ffda640 1 --2- 172.21.15.150:0/542414278 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f95380b1700 0x7f95380b1b10 secure :-1 s=READY pgs=1179 cs=0 l=1 rev1=1 crypto rx=0x7f953808cc20 tx=0x7f953002a980 comp rx=0 tx=0).stop 2024-09-17T05:49:49.092 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:49.090+0000 7f953ffda640 1 -- 172.21.15.150:0/542414278 shutdown_connections 2024-09-17T05:49:49.093 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:49.090+0000 7f953ffda640 1 --2- 172.21.15.150:0/542414278 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f95380b1700 0x7f95380b1b10 unknown :-1 s=CLOSED pgs=1179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:49:49.093 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:49.090+0000 7f953ffda640 1 --2- 172.21.15.150:0/542414278 >> v2:172.21.15.176:3300/0 conn(0x7f95381628b0 0x7f9538162cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:49:49.093 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:49.090+0000 7f953ffda640 1 --2- 172.21.15.150:0/542414278 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f95381634e0 0x7f95380b9d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:49:49.093 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:49.090+0000 7f953ffda640 1 -- 172.21.15.150:0/542414278 >> 172.21.15.150:0/542414278 conn(0x7f95380d46e0 msgr2=0x7f95380d4af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:49:49.093 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:49.090+0000 7f953ffda640 1 -- 172.21.15.150:0/542414278 shutdown_connections 2024-09-17T05:49:49.093 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:49.090+0000 7f953ffda640 1 -- 172.21.15.150:0/542414278 wait complete. 2024-09-17T05:49:49.094 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:49.093+0000 7f953ffda640 1 Processor -- start 2024-09-17T05:49:49.094 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:49.093+0000 7f953ffda640 1 -- start start 2024-09-17T05:49:49.097 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:49.094+0000 7f953ffda640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f95380b1700 0x7f953814e060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:49:49.097 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:49.094+0000 7f953ffda640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f95381628b0 0x7f95380cd610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:49:49.097 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:49.094+0000 7f953ffda640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f95381634e0 0x7f95380cdb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:49:49.097 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:49.094+0000 7f953ffda640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f95380b2580 con 0x7f95381628b0 2024-09-17T05:49:49.098 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:49.094+0000 7f953ffda640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f95380b2400 con 0x7f95381634e0 2024-09-17T05:49:49.098 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:49.094+0000 7f953ffda640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f95380b2700 con 0x7f95380b1700 2024-09-17T05:49:49.098 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:49.094+0000 7f953d575640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f95381628b0 0x7f95380cd610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:49:49.098 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:49.094+0000 7f953d575640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f95381628b0 0x7f95380cd610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:37046/0 (socket says 172.21.15.150:37046) 2024-09-17T05:49:49.098 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:49.094+0000 7f953d575640 1 -- 172.21.15.150:0/3726577998 learned_addr learned my addr 172.21.15.150:0/3726577998 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:49:49.098 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:49.094+0000 7f953dd76640 1 --2- 172.21.15.150:0/3726577998 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f95380b1700 0x7f953814e060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:49:49.098 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:49.094+0000 7f953e577640 1 --2- 172.21.15.150:0/3726577998 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f95381634e0 0x7f95380cdb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:49:49.098 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:49.095+0000 7f953d575640 1 -- 172.21.15.150:0/3726577998 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f95380b1700 msgr2=0x7f953814e060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:49:49.098 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:49.095+0000 7f953d575640 1 --2- 172.21.15.150:0/3726577998 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f95380b1700 0x7f953814e060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:49:49.098 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:49.095+0000 7f953d575640 1 -- 172.21.15.150:0/3726577998 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f95381634e0 msgr2=0x7f95380cdb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:49:49.098 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:49.095+0000 7f953d575640 1 --2- 172.21.15.150:0/3726577998 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f95381634e0 0x7f95380cdb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:49:49.098 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:49.095+0000 7f953d575640 1 -- 172.21.15.150:0/3726577998 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f95380b3760 con 0x7f95381628b0 2024-09-17T05:49:49.099 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:49.095+0000 7f953e577640 1 --2- 172.21.15.150:0/3726577998 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f95381634e0 0x7f95380cdb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:49:49.099 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:49.095+0000 7f953d575640 1 --2- 172.21.15.150:0/3726577998 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f95381628b0 0x7f95380cd610 secure :-1 s=READY pgs=1180 cs=0 l=1 rev1=1 crypto rx=0x7f952800b410 tx=0x7f952800b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:49:49.099 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:49.095+0000 7f952e7fc640 1 -- 172.21.15.150:0/3726577998 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9528015020 con 0x7f95381628b0 2024-09-17T05:49:49.099 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:49.095+0000 7f952e7fc640 1 -- 172.21.15.150:0/3726577998 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9528011940 con 0x7f95381628b0 2024-09-17T05:49:49.099 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:49.095+0000 7f952e7fc640 1 -- 172.21.15.150:0/3726577998 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9528011d90 con 0x7f95381628b0 2024-09-17T05:49:49.099 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:49.095+0000 7f953ffda640 1 -- 172.21.15.150:0/3726577998 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f95380b3a00 con 0x7f95381628b0 2024-09-17T05:49:49.099 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:49.095+0000 7f953ffda640 1 -- 172.21.15.150:0/3726577998 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f95380c9200 con 0x7f95381628b0 2024-09-17T05:49:49.100 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:49.096+0000 7f953ffda640 1 -- 172.21.15.150:0/3726577998 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f95380b3f20 con 0x7f95381628b0 2024-09-17T05:49:49.100 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:49.097+0000 7f952e7fc640 1 -- 172.21.15.150:0/3726577998 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 31) ==== 103379+0+0 (secure 0 0 0) 0x7f9528018020 con 0x7f95381628b0 2024-09-17T05:49:49.100 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:49.098+0000 7f952e7fc640 1 --2- 172.21.15.150:0/3726577998 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f951c07a0f0 0x7f951c07c600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:49:49.100 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:49.098+0000 7f952e7fc640 1 -- 172.21.15.150:0/3726577998 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 5822+0+0 (secure 0 0 0) 0x7f952809a2b0 con 0x7f95381628b0 2024-09-17T05:49:49.104 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:49.102+0000 7f952e7fc640 1 -- 172.21.15.150:0/3726577998 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f95380b3f20 con 0x7f95381628b0 2024-09-17T05:49:49.104 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:49.103+0000 7f953dd76640 1 --2- 172.21.15.150:0/3726577998 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f951c07a0f0 0x7f951c07c600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:49:49.106 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:49.105+0000 7f953dd76640 1 --2- 172.21.15.150:0/3726577998 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f951c07a0f0 0x7f951c07c600 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7f9534005fd0 tx=0x7f9534005cf0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:49:49.390 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:49.388+0000 7f953ffda640 1 -- 172.21.15.150:0/3726577998 --> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] -- mgr_command(tid 0: {"prefix": "fs clone cancel", "vol_name": "cephfs", "clone_name": "subvol_clone408019", "target": ["mon-mgr", ""]}) -- 0x7f9538162cc0 con 0x7f951c07a0f0 2024-09-17T05:49:49.560 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:49.558+0000 7f952e7fc640 1 -- 172.21.15.150:0/3726577998 <== mgr.4108 v2:172.21.15.176:6800/3631216395 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f9538162cc0 con 0x7f951c07a0f0 2024-09-17T05:49:49.562 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:49.560+0000 7f953ffda640 1 -- 172.21.15.150:0/3726577998 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f951c07a0f0 msgr2=0x7f951c07c600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:49:49.563 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:49.560+0000 7f953ffda640 1 --2- 172.21.15.150:0/3726577998 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f951c07a0f0 0x7f951c07c600 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7f9534005fd0 tx=0x7f9534005cf0 comp rx=0 tx=0).stop 2024-09-17T05:49:49.563 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:49.560+0000 7f953ffda640 1 -- 172.21.15.150:0/3726577998 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f95381628b0 msgr2=0x7f95380cd610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:49:49.563 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:49.560+0000 7f953ffda640 1 --2- 172.21.15.150:0/3726577998 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f95381628b0 0x7f95380cd610 secure :-1 s=READY pgs=1180 cs=0 l=1 rev1=1 crypto rx=0x7f952800b410 tx=0x7f952800b8d0 comp rx=0 tx=0).stop 2024-09-17T05:49:49.563 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:49.560+0000 7f953ffda640 1 -- 172.21.15.150:0/3726577998 shutdown_connections 2024-09-17T05:49:49.563 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:49.560+0000 7f953ffda640 1 --2- 172.21.15.150:0/3726577998 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f95381634e0 0x7f95380cdb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:49:49.564 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:49.560+0000 7f953ffda640 1 --2- 172.21.15.150:0/3726577998 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f951c07a0f0 0x7f951c07c600 unknown :-1 s=CLOSED pgs=507 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:49:49.564 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:49.560+0000 7f953ffda640 1 --2- 172.21.15.150:0/3726577998 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f95381628b0 0x7f95380cd610 unknown :-1 s=CLOSED pgs=1180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:49:49.564 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:49.560+0000 7f953ffda640 1 --2- 172.21.15.150:0/3726577998 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f95380b1700 0x7f953814e060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:49:49.564 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:49.560+0000 7f953ffda640 1 -- 172.21.15.150:0/3726577998 >> 172.21.15.150:0/3726577998 conn(0x7f95380d46e0 msgr2=0x7f953806f070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:49:49.564 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:49.560+0000 7f953ffda640 1 -- 172.21.15.150:0/3726577998 shutdown_connections 2024-09-17T05:49:49.565 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:49.560+0000 7f953ffda640 1 -- 172.21.15.150:0/3726577998 wait complete. 2024-09-17T05:49:49.574 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume ls 2024-09-17T05:49:49.689 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:49.687+0000 7feb89939640 1 -- 172.21.15.150:0/4155982328 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7feb840b78c0 msgr2=0x7feb840d0330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:49:49.689 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:49.687+0000 7feb89939640 1 --2- 172.21.15.150:0/4155982328 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7feb840b78c0 0x7feb840d0330 secure :-1 s=READY pgs=1182 cs=0 l=1 rev1=1 crypto rx=0x7feb840b5820 tx=0x7feb6c02a560 comp rx=0 tx=0).stop 2024-09-17T05:49:49.689 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:49.687+0000 7feb89939640 1 -- 172.21.15.150:0/4155982328 shutdown_connections 2024-09-17T05:49:49.689 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:49.687+0000 7feb89939640 1 --2- 172.21.15.150:0/4155982328 >> v2:172.21.15.176:3300/0 conn(0x7feb840b6320 0x7feb840b6730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:49:49.689 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:49.687+0000 7feb89939640 1 --2- 172.21.15.150:0/4155982328 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7feb840b78c0 0x7feb840d0330 unknown :-1 s=CLOSED pgs=1182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:49:49.689 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:49.687+0000 7feb89939640 1 -- 172.21.15.150:0/4155982328 >> 172.21.15.150:0/4155982328 conn(0x7feb8408bfe0 msgr2=0x7feb840d4660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:49:49.689 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:49.687+0000 7feb89939640 1 -- 172.21.15.150:0/4155982328 shutdown_connections 2024-09-17T05:49:49.690 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:49.687+0000 7feb89939640 1 -- 172.21.15.150:0/4155982328 wait complete. 2024-09-17T05:49:49.690 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:49.688+0000 7feb89939640 1 Processor -- start 2024-09-17T05:49:49.690 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:49.689+0000 7feb89939640 1 -- start start 2024-09-17T05:49:49.693 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:49.690+0000 7feb89939640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7feb840b6320 0x7feb840cb6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:49:49.693 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:49.690+0000 7feb89939640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7feb840b74b0 0x7feb841f9340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:49:49.693 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:49.690+0000 7feb89939640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7feb840b78c0 0x7feb84148150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:49:49.693 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:49.690+0000 7feb89939640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7feb840b54e0 con 0x7feb840b6320 2024-09-17T05:49:49.693 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:49.690+0000 7feb89939640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7feb840b5360 con 0x7feb840b78c0 2024-09-17T05:49:49.693 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:49.690+0000 7feb89939640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7feb84169330 con 0x7feb840b74b0 2024-09-17T05:49:49.693 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:49.690+0000 7feb82ffd640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7feb840b6320 0x7feb840cb6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:49:49.693 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:49.690+0000 7feb82ffd640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7feb840b6320 0x7feb840cb6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:37072/0 (socket says 172.21.15.150:37072) 2024-09-17T05:49:49.693 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:49.690+0000 7feb82ffd640 1 -- 172.21.15.150:0/2639577144 learned_addr learned my addr 172.21.15.150:0/2639577144 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:49:49.694 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:49.690+0000 7feb7a7fc640 1 --2- 172.21.15.150:0/2639577144 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7feb840b74b0 0x7feb841f9340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:49:49.694 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:49.690+0000 7feb837fe640 1 --2- 172.21.15.150:0/2639577144 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7feb840b78c0 0x7feb84148150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:49:49.694 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:49.690+0000 7feb82ffd640 1 -- 172.21.15.150:0/2639577144 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7feb840b74b0 msgr2=0x7feb841f9340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:49:49.694 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:49.690+0000 7feb82ffd640 1 --2- 172.21.15.150:0/2639577144 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7feb840b74b0 0x7feb841f9340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:49:49.694 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:49.690+0000 7feb82ffd640 1 -- 172.21.15.150:0/2639577144 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7feb840b78c0 msgr2=0x7feb84148150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:49:49.694 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:49.690+0000 7feb82ffd640 1 --2- 172.21.15.150:0/2639577144 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7feb840b78c0 0x7feb84148150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:49:49.694 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:49.690+0000 7feb82ffd640 1 -- 172.21.15.150:0/2639577144 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feb840cd350 con 0x7feb840b6320 2024-09-17T05:49:49.694 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:49.690+0000 7feb837fe640 1 --2- 172.21.15.150:0/2639577144 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7feb840b78c0 0x7feb84148150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:49:49.694 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:49.691+0000 7feb82ffd640 1 --2- 172.21.15.150:0/2639577144 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7feb840b6320 0x7feb840cb6a0 secure :-1 s=READY pgs=1183 cs=0 l=1 rev1=1 crypto rx=0x7feb7400c390 tx=0x7feb7400c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:49:49.694 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:49.691+0000 7feb80ff9640 1 -- 172.21.15.150:0/2639577144 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb74017070 con 0x7feb840b6320 2024-09-17T05:49:49.694 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:49.691+0000 7feb80ff9640 1 -- 172.21.15.150:0/2639577144 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7feb740035f0 con 0x7feb840b6320 2024-09-17T05:49:49.694 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:49.691+0000 7feb89939640 1 -- 172.21.15.150:0/2639577144 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feb840cd630 con 0x7feb840b6320 2024-09-17T05:49:49.694 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:49.691+0000 7feb80ff9640 1 -- 172.21.15.150:0/2639577144 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb74003a40 con 0x7feb840b6320 2024-09-17T05:49:49.695 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:49.691+0000 7feb89939640 1 -- 172.21.15.150:0/2639577144 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feb840cdbf0 con 0x7feb840b6320 2024-09-17T05:49:49.695 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:49.692+0000 7feb89939640 1 -- 172.21.15.150:0/2639577144 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7feb8408caf0 con 0x7feb840b6320 2024-09-17T05:49:49.695 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:49.693+0000 7feb80ff9640 1 -- 172.21.15.150:0/2639577144 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 31) ==== 103379+0+0 (secure 0 0 0) 0x7feb7401a070 con 0x7feb840b6320 2024-09-17T05:49:49.696 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:49.693+0000 7feb80ff9640 1 --2- 172.21.15.150:0/2639577144 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7feb6407a0f0 0x7feb6407c600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:49:49.696 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:49.693+0000 7feb80ff9640 1 -- 172.21.15.150:0/2639577144 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 5822+0+0 (secure 0 0 0) 0x7feb74098fb0 con 0x7feb840b6320 2024-09-17T05:49:49.696 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:49.693+0000 7feb7a7fc640 1 --2- 172.21.15.150:0/2639577144 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7feb6407a0f0 0x7feb6407c600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:49:49.696 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:49.694+0000 7feb7a7fc640 1 --2- 172.21.15.150:0/2639577144 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7feb6407a0f0 0x7feb6407c600 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7feb6c033000 tx=0x7feb6c004730 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:49:49.699 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:49.697+0000 7feb80ff9640 1 -- 172.21.15.150:0/2639577144 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7feb8408caf0 con 0x7feb840b6320 2024-09-17T05:49:49.897 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:49.895+0000 7feb89939640 1 -- 172.21.15.150:0/2639577144 --> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] -- mgr_command(tid 0: {"prefix": "fs volume ls", "target": ["mon-mgr", ""]}) -- 0x7feb840b6730 con 0x7feb6407a0f0 2024-09-17T05:49:49.899 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:49.897+0000 7feb80ff9640 1 -- 172.21.15.150:0/2639577144 <== mgr.4108 v2:172.21.15.176:6800/3631216395 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+41 (secure 0 0 0) 0x7feb840b6730 con 0x7feb6407a0f0 2024-09-17T05:49:49.899 INFO:teuthology.orchestra.run.smithi150.stdout:[ 2024-09-17T05:49:49.899 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-09-17T05:49:49.899 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "cephfs" 2024-09-17T05:49:49.899 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-09-17T05:49:49.899 INFO:teuthology.orchestra.run.smithi150.stdout:] 2024-09-17T05:49:49.901 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:49.899+0000 7feb89939640 1 -- 172.21.15.150:0/2639577144 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7feb6407a0f0 msgr2=0x7feb6407c600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:49:49.901 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:49.899+0000 7feb89939640 1 --2- 172.21.15.150:0/2639577144 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7feb6407a0f0 0x7feb6407c600 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7feb6c033000 tx=0x7feb6c004730 comp rx=0 tx=0).stop 2024-09-17T05:49:49.901 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:49.899+0000 7feb89939640 1 -- 172.21.15.150:0/2639577144 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7feb840b6320 msgr2=0x7feb840cb6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:49:49.902 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:49.899+0000 7feb89939640 1 --2- 172.21.15.150:0/2639577144 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7feb840b6320 0x7feb840cb6a0 secure :-1 s=READY pgs=1183 cs=0 l=1 rev1=1 crypto rx=0x7feb7400c390 tx=0x7feb7400c850 comp rx=0 tx=0).stop 2024-09-17T05:49:49.902 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:49.899+0000 7feb89939640 1 -- 172.21.15.150:0/2639577144 shutdown_connections 2024-09-17T05:49:49.902 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:49.899+0000 7feb89939640 1 --2- 172.21.15.150:0/2639577144 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7feb840b78c0 0x7feb84148150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:49:49.902 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:49.899+0000 7feb89939640 1 --2- 172.21.15.150:0/2639577144 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7feb6407a0f0 0x7feb6407c600 unknown :-1 s=CLOSED pgs=508 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:49:49.902 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:49.899+0000 7feb89939640 1 --2- 172.21.15.150:0/2639577144 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7feb840b74b0 0x7feb841f9340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:49:49.902 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:49.899+0000 7feb89939640 1 --2- 172.21.15.150:0/2639577144 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7feb840b6320 0x7feb840cb6a0 unknown :-1 s=CLOSED pgs=1183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:49:49.902 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:49.899+0000 7feb89939640 1 -- 172.21.15.150:0/2639577144 >> 172.21.15.150:0/2639577144 conn(0x7feb8408bfe0 msgr2=0x7feb8406e0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:49:49.902 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:49.900+0000 7feb89939640 1 -- 172.21.15.150:0/2639577144 shutdown_connections 2024-09-17T05:49:49.902 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:49.900+0000 7feb89939640 1 -- 172.21.15.150:0/2639577144 wait complete. 2024-09-17T05:49:49.913 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume ls cephfs --format json 2024-09-17T05:49:50.030 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:50.029+0000 7fcf6e87e640 1 -- 172.21.15.150:0/616988779 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fcf54003a50 msgr2=0x7fcf54003ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:49:50.031 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:50.029+0000 7fcf6e87e640 1 --2- 172.21.15.150:0/616988779 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fcf54003a50 0x7fcf54003ec0 secure :-1 s=READY pgs=1185 cs=0 l=1 rev1=1 crypto rx=0x7fcf58006fd0 tx=0x7fcf54005830 comp rx=0 tx=0).stop 2024-09-17T05:49:50.031 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:50.029+0000 7fcf6e87e640 1 -- 172.21.15.150:0/616988779 shutdown_connections 2024-09-17T05:49:50.031 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:50.029+0000 7fcf6e87e640 1 --2- 172.21.15.150:0/616988779 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fcf54003a50 0x7fcf54003ec0 unknown :-1 s=CLOSED pgs=1185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:49:50.031 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:50.029+0000 7fcf6e87e640 1 -- 172.21.15.150:0/616988779 >> 172.21.15.150:0/616988779 conn(0x7fcf68074850 msgr2=0x7fcf6806cda0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:49:50.031 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:50.029+0000 7fcf6e87e640 1 -- 172.21.15.150:0/616988779 shutdown_connections 2024-09-17T05:49:50.031 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:50.029+0000 7fcf6e87e640 1 -- 172.21.15.150:0/616988779 wait complete. 2024-09-17T05:49:50.032 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:50.030+0000 7fcf6e87e640 1 Processor -- start 2024-09-17T05:49:50.032 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:50.031+0000 7fcf6e87e640 1 -- start start 2024-09-17T05:49:50.035 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:50.032+0000 7fcf6e87e640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fcf54003a50 0x7fcf6815e000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:49:50.035 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:50.032+0000 7fcf6e87e640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fcf68144940 0x7fcf68157370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:49:50.035 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:50.032+0000 7fcf6e87e640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fcf68144fe0 0x7fcf68154700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:49:50.035 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:50.032+0000 7fcf6e87e640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7fcf680b6190 con 0x7fcf68144940 2024-09-17T05:49:50.035 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:50.032+0000 7fcf6e87e640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fcf680b6010 con 0x7fcf54003a50 2024-09-17T05:49:50.036 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:50.032+0000 7fcf6e87e640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fcf680b6310 con 0x7fcf68144fe0 2024-09-17T05:49:50.036 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:50.032+0000 7fcf677fe640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fcf68144940 0x7fcf68157370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:49:50.036 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:50.032+0000 7fcf67fff640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fcf54003a50 0x7fcf6815e000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:49:50.036 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:50.032+0000 7fcf677fe640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fcf68144940 0x7fcf68157370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:37084/0 (socket says 172.21.15.150:37084) 2024-09-17T05:49:50.036 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:50.032+0000 7fcf677fe640 1 -- 172.21.15.150:0/1220931742 learned_addr learned my addr 172.21.15.150:0/1220931742 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:49:50.036 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:50.032+0000 7fcf6ce1b640 1 --2- 172.21.15.150:0/1220931742 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fcf68144fe0 0x7fcf68154700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:49:50.036 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:50.032+0000 7fcf677fe640 1 -- 172.21.15.150:0/1220931742 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fcf68144fe0 msgr2=0x7fcf68154700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:49:50.036 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:50.032+0000 7fcf677fe640 1 --2- 172.21.15.150:0/1220931742 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fcf68144fe0 0x7fcf68154700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:49:50.036 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:50.032+0000 7fcf677fe640 1 -- 172.21.15.150:0/1220931742 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fcf54003a50 msgr2=0x7fcf6815e000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:49:50.036 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:50.032+0000 7fcf677fe640 1 --2- 172.21.15.150:0/1220931742 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fcf54003a50 0x7fcf6815e000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:49:50.036 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:50.032+0000 7fcf677fe640 1 -- 172.21.15.150:0/1220931742 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcf6815cf60 con 0x7fcf68144940 2024-09-17T05:49:50.037 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:50.033+0000 7fcf677fe640 1 --2- 172.21.15.150:0/1220931742 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fcf68144940 0x7fcf68157370 secure :-1 s=READY pgs=1186 cs=0 l=1 rev1=1 crypto rx=0x7fcf50011ae0 tx=0x7fcf50009f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:49:50.037 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:50.033+0000 7fcf64ff9640 1 -- 172.21.15.150:0/1220931742 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf5000fcb0 con 0x7fcf68144940 2024-09-17T05:49:50.037 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:50.033+0000 7fcf64ff9640 1 -- 172.21.15.150:0/1220931742 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fcf5000fe50 con 0x7fcf68144940 2024-09-17T05:49:50.037 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:50.033+0000 7fcf6e87e640 1 -- 172.21.15.150:0/1220931742 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcf6815d240 con 0x7fcf68144940 2024-09-17T05:49:50.037 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:50.033+0000 7fcf64ff9640 1 -- 172.21.15.150:0/1220931742 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf50004280 con 0x7fcf68144940 2024-09-17T05:49:50.037 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:50.033+0000 7fcf6e87e640 1 -- 172.21.15.150:0/1220931742 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcf6815d800 con 0x7fcf68144940 2024-09-17T05:49:50.038 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:50.034+0000 7fcf6e87e640 1 -- 172.21.15.150:0/1220931742 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcf6815ccd0 con 0x7fcf68144940 2024-09-17T05:49:50.038 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:50.035+0000 7fcf64ff9640 1 -- 172.21.15.150:0/1220931742 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 31) ==== 103379+0+0 (secure 0 0 0) 0x7fcf500035f0 con 0x7fcf68144940 2024-09-17T05:49:50.038 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:50.035+0000 7fcf64ff9640 1 --2- 172.21.15.150:0/1220931742 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fcf4807a0f0 0x7fcf4807c600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:49:50.038 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:50.035+0000 7fcf64ff9640 1 -- 172.21.15.150:0/1220931742 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 5822+0+0 (secure 0 0 0) 0x7fcf5009a840 con 0x7fcf68144940 2024-09-17T05:49:50.038 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:50.035+0000 7fcf67fff640 1 --2- 172.21.15.150:0/1220931742 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fcf4807a0f0 0x7fcf4807c600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:49:50.039 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:50.036+0000 7fcf67fff640 1 --2- 172.21.15.150:0/1220931742 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fcf4807a0f0 0x7fcf4807c600 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7fcf58033000 tx=0x7fcf58038040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:49:50.041 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:50.040+0000 7fcf64ff9640 1 -- 172.21.15.150:0/1220931742 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fcf50063ce0 con 0x7fcf68144940 2024-09-17T05:49:50.243 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:50.241+0000 7fcf6e87e640 1 -- 172.21.15.150:0/1220931742 --> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] -- mgr_command(tid 0: {"prefix": "fs subvolume ls", "vol_name": "cephfs", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fcf6815caa0 con 0x7fcf4807a0f0 2024-09-17T05:49:50.258 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:50.257+0000 7fcf64ff9640 1 -- 172.21.15.150:0/1220931742 <== mgr.4108 v2:172.21.15.176:6800/3631216395 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+1026 (secure 0 0 0) 0x7fcf58001580 con 0x7fcf4807a0f0 2024-09-17T05:49:50.258 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-09-17T05:49:50.258 INFO:teuthology.orchestra.run.smithi150.stdout:[ 2024-09-17T05:49:50.258 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-09-17T05:49:50.258 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "subvol_clone87607" 2024-09-17T05:49:50.258 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-17T05:49:50.258 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-09-17T05:49:50.258 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "subvol_clone719215" 2024-09-17T05:49:50.258 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-17T05:49:50.258 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-09-17T05:49:50.259 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "subvol_clone61996" 2024-09-17T05:49:50.259 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-17T05:49:50.259 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-09-17T05:49:50.259 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "subvol_clone73572" 2024-09-17T05:49:50.259 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-17T05:49:50.259 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-09-17T05:49:50.259 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "subvol_clone126017" 2024-09-17T05:49:50.259 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-17T05:49:50.259 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-09-17T05:49:50.259 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "subvol_clone17383" 2024-09-17T05:49:50.259 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-17T05:49:50.259 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-09-17T05:49:50.259 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "sv1" 2024-09-17T05:49:50.260 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-17T05:49:50.260 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-09-17T05:49:50.260 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "subvol_clone310410" 2024-09-17T05:49:50.260 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-17T05:49:50.260 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-09-17T05:49:50.260 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "subvol_clone941013" 2024-09-17T05:49:50.260 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-17T05:49:50.260 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-09-17T05:49:50.260 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "subvol_clone149612" 2024-09-17T05:49:50.260 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-17T05:49:50.260 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-09-17T05:49:50.260 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "subvol_clone627111" 2024-09-17T05:49:50.260 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-17T05:49:50.261 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-09-17T05:49:50.261 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "subvol_clone748216" 2024-09-17T05:49:50.261 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-17T05:49:50.261 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-09-17T05:49:50.261 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "subvol_clone5458" 2024-09-17T05:49:50.261 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-17T05:49:50.261 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-09-17T05:49:50.261 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "subvol_clone3600" 2024-09-17T05:49:50.261 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-17T05:49:50.261 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-09-17T05:49:50.261 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "subvol_clone59314" 2024-09-17T05:49:50.261 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-17T05:49:50.261 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-09-17T05:49:50.262 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "subvol_clone91801" 2024-09-17T05:49:50.262 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-17T05:49:50.262 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-09-17T05:49:50.262 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "subvol_clone94949" 2024-09-17T05:49:50.262 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-17T05:49:50.262 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-09-17T05:49:50.262 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "subvol_clone408019" 2024-09-17T05:49:50.262 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-17T05:49:50.262 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-09-17T05:49:50.262 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "subvol_clone57205" 2024-09-17T05:49:50.262 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-17T05:49:50.262 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-09-17T05:49:50.262 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "subvol_clone818314" 2024-09-17T05:49:50.263 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-17T05:49:50.263 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-09-17T05:49:50.263 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "subvol_clone369718" 2024-09-17T05:49:50.263 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-09-17T05:49:50.263 INFO:teuthology.orchestra.run.smithi150.stdout:] 2024-09-17T05:49:50.264 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:50.258+0000 7fcf6e87e640 1 -- 172.21.15.150:0/1220931742 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fcf4807a0f0 msgr2=0x7fcf4807c600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:49:50.264 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:50.258+0000 7fcf6e87e640 1 --2- 172.21.15.150:0/1220931742 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fcf4807a0f0 0x7fcf4807c600 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7fcf58033000 tx=0x7fcf58038040 comp rx=0 tx=0).stop 2024-09-17T05:49:50.264 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:50.258+0000 7fcf6e87e640 1 -- 172.21.15.150:0/1220931742 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fcf68144940 msgr2=0x7fcf68157370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:49:50.264 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:50.258+0000 7fcf6e87e640 1 --2- 172.21.15.150:0/1220931742 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fcf68144940 0x7fcf68157370 secure :-1 s=READY pgs=1186 cs=0 l=1 rev1=1 crypto rx=0x7fcf50011ae0 tx=0x7fcf50009f10 comp rx=0 tx=0).stop 2024-09-17T05:49:50.264 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:50.258+0000 7fcf6e87e640 1 -- 172.21.15.150:0/1220931742 shutdown_connections 2024-09-17T05:49:50.264 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:50.258+0000 7fcf6e87e640 1 --2- 172.21.15.150:0/1220931742 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fcf4807a0f0 0x7fcf4807c600 unknown :-1 s=CLOSED pgs=509 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:49:50.265 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:50.258+0000 7fcf6e87e640 1 --2- 172.21.15.150:0/1220931742 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fcf68144fe0 0x7fcf68154700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:49:50.265 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:50.258+0000 7fcf6e87e640 1 --2- 172.21.15.150:0/1220931742 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fcf68144940 0x7fcf68157370 unknown :-1 s=CLOSED pgs=1186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:49:50.265 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:50.258+0000 7fcf6e87e640 1 --2- 172.21.15.150:0/1220931742 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fcf54003a50 0x7fcf6815e000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:49:50.265 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:50.258+0000 7fcf6e87e640 1 -- 172.21.15.150:0/1220931742 >> 172.21.15.150:0/1220931742 conn(0x7fcf68074850 msgr2=0x7fcf680cd260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:49:50.265 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:50.258+0000 7fcf6e87e640 1 -- 172.21.15.150:0/1220931742 shutdown_connections 2024-09-17T05:49:50.265 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:50.258+0000 7fcf6e87e640 1 -- 172.21.15.150:0/1220931742 wait complete. 2024-09-17T05:49:50.272 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume rm --force cephfs subvol_clone87607 2024-09-17T05:49:50.390 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:50.388+0000 7ff8d0894640 1 -- 172.21.15.150:0/25933908 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff8cc0b0490 msgr2=0x7ff8cc0b6a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:49:50.390 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:50.388+0000 7ff8d0894640 1 --2- 172.21.15.150:0/25933908 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff8cc0b0490 0x7ff8cc0b6a90 secure :-1 s=READY pgs=1188 cs=0 l=1 rev1=1 crypto rx=0x7ff8bc005fd0 tx=0x7ff8bc02a8b0 comp rx=0 tx=0).stop 2024-09-17T05:49:50.390 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:50.388+0000 7ff8d0894640 1 -- 172.21.15.150:0/25933908 shutdown_connections 2024-09-17T05:49:50.390 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:50.388+0000 7ff8d0894640 1 --2- 172.21.15.150:0/25933908 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff8cc0afd10 0x7ff8cc0d04f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:49:50.390 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:50.388+0000 7ff8d0894640 1 --2- 172.21.15.150:0/25933908 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff8cc0b0490 0x7ff8cc0b6a90 unknown :-1 s=CLOSED pgs=1188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:49:50.390 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:50.388+0000 7ff8d0894640 1 -- 172.21.15.150:0/25933908 >> 172.21.15.150:0/25933908 conn(0x7ff8cc0b2f80 msgr2=0x7ff8cc0b3390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:49:50.391 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:50.388+0000 7ff8d0894640 1 -- 172.21.15.150:0/25933908 shutdown_connections 2024-09-17T05:49:50.391 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:50.388+0000 7ff8d0894640 1 -- 172.21.15.150:0/25933908 wait complete. 2024-09-17T05:49:50.391 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:50.390+0000 7ff8d0894640 1 Processor -- start 2024-09-17T05:49:50.391 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:50.390+0000 7ff8d0894640 1 -- start start 2024-09-17T05:49:50.394 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:50.391+0000 7ff8d0894640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff8cc0afd10 0x7ff8cc14cf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:49:50.394 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:50.391+0000 7ff8d0894640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff8cc0b0490 0x7ff8cc14f870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:49:50.394 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:50.391+0000 7ff8d0894640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff8cc0d0a30 0x7ff8cc14fdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:49:50.394 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:50.391+0000 7ff8d0894640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7ff8cc0d0f80 con 0x7ff8cc0d0a30 2024-09-17T05:49:50.395 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:50.391+0000 7ff8d0894640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7ff8cc0b1d20 con 0x7ff8cc0afd10 2024-09-17T05:49:50.395 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:50.391+0000 7ff8d0894640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7ff8cc06d4b0 con 0x7ff8cc0b0490 2024-09-17T05:49:50.395 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:50.391+0000 7ff8cad9d640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff8cc0d0a30 0x7ff8cc14fdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:49:50.395 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:50.391+0000 7ff8cad9d640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff8cc0d0a30 0x7ff8cc14fdb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:60316/0 (socket says 172.21.15.150:60316) 2024-09-17T05:49:50.395 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:50.391+0000 7ff8cad9d640 1 -- 172.21.15.150:0/2334845514 learned_addr learned my addr 172.21.15.150:0/2334845514 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:49:50.395 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:50.392+0000 7ff8ca59c640 1 --2- 172.21.15.150:0/2334845514 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff8cc0afd10 0x7ff8cc14cf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:49:50.395 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:50.392+0000 7ff8c9d9b640 1 --2- 172.21.15.150:0/2334845514 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff8cc0b0490 0x7ff8cc14f870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:49:50.395 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:50.392+0000 7ff8cad9d640 1 -- 172.21.15.150:0/2334845514 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff8cc0b0490 msgr2=0x7ff8cc14f870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:49:50.395 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:50.392+0000 7ff8cad9d640 1 --2- 172.21.15.150:0/2334845514 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff8cc0b0490 0x7ff8cc14f870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:49:50.395 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:50.392+0000 7ff8cad9d640 1 -- 172.21.15.150:0/2334845514 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff8cc0afd10 msgr2=0x7ff8cc14cf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:49:50.395 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:50.392+0000 7ff8cad9d640 1 --2- 172.21.15.150:0/2334845514 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff8cc0afd10 0x7ff8cc14cf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:49:50.395 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:50.392+0000 7ff8cad9d640 1 -- 172.21.15.150:0/2334845514 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff8cc150610 con 0x7ff8cc0d0a30 2024-09-17T05:49:50.395 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:50.392+0000 7ff8cad9d640 1 --2- 172.21.15.150:0/2334845514 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff8cc0d0a30 0x7ff8cc14fdb0 secure :-1 s=READY pgs=1189 cs=0 l=1 rev1=1 crypto rx=0x7ff8c400c3c0 tx=0x7ff8c400c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:49:50.396 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:50.392+0000 7ff8baffd640 1 -- 172.21.15.150:0/2334845514 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8c4017070 con 0x7ff8cc0d0a30 2024-09-17T05:49:50.396 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:50.392+0000 7ff8baffd640 1 -- 172.21.15.150:0/2334845514 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff8c40035f0 con 0x7ff8cc0d0a30 2024-09-17T05:49:50.396 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:50.392+0000 7ff8d0894640 1 -- 172.21.15.150:0/2334845514 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff8cc14d9f0 con 0x7ff8cc0d0a30 2024-09-17T05:49:50.396 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:50.392+0000 7ff8baffd640 1 -- 172.21.15.150:0/2334845514 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8c4003a40 con 0x7ff8cc0d0a30 2024-09-17T05:49:50.396 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:50.392+0000 7ff8d0894640 1 -- 172.21.15.150:0/2334845514 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff8cc14d440 con 0x7ff8cc0d0a30 2024-09-17T05:49:50.397 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:50.393+0000 7ff8d0894640 1 -- 172.21.15.150:0/2334845514 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff8cc09b820 con 0x7ff8cc0d0a30 2024-09-17T05:49:50.397 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:50.394+0000 7ff8baffd640 1 -- 172.21.15.150:0/2334845514 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 31) ==== 103379+0+0 (secure 0 0 0) 0x7ff8c401a070 con 0x7ff8cc0d0a30 2024-09-17T05:49:50.397 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:50.394+0000 7ff8baffd640 1 --2- 172.21.15.150:0/2334845514 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7ff8ac07a0f0 0x7ff8ac07c600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:49:50.397 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:50.394+0000 7ff8baffd640 1 -- 172.21.15.150:0/2334845514 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 5822+0+0 (secure 0 0 0) 0x7ff8c4098f00 con 0x7ff8cc0d0a30 2024-09-17T05:49:50.397 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:50.395+0000 7ff8ca59c640 1 --2- 172.21.15.150:0/2334845514 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7ff8ac07a0f0 0x7ff8ac07c600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:49:50.397 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:50.395+0000 7ff8ca59c640 1 --2- 172.21.15.150:0/2334845514 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7ff8ac07a0f0 0x7ff8ac07c600 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7ff8bc034000 tx=0x7ff8bc004ab0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:49:50.400 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:50.399+0000 7ff8baffd640 1 -- 172.21.15.150:0/2334845514 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7ff8cc09b820 con 0x7ff8cc0d0a30 2024-09-17T05:49:50.602 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:50.600+0000 7ff8d0894640 1 -- 172.21.15.150:0/2334845514 --> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] -- mgr_command(tid 0: {"prefix": "fs subvolume rm", "force": true, "vol_name": "cephfs", "sub_name": "subvol_clone87607", "target": ["mon-mgr", ""]}) -- 0x7ff8cc15eb50 con 0x7ff8ac07a0f0 2024-09-17T05:49:50.623 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:50.622+0000 7ff8baffd640 1 -- 172.21.15.150:0/2334845514 <== mgr.4108 v2:172.21.15.176:6800/3631216395 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7ff8cc15eb50 con 0x7ff8ac07a0f0 2024-09-17T05:49:50.626 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:50.624+0000 7ff8d0894640 1 -- 172.21.15.150:0/2334845514 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7ff8ac07a0f0 msgr2=0x7ff8ac07c600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:49:50.626 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:50.624+0000 7ff8d0894640 1 --2- 172.21.15.150:0/2334845514 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7ff8ac07a0f0 0x7ff8ac07c600 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7ff8bc034000 tx=0x7ff8bc004ab0 comp rx=0 tx=0).stop 2024-09-17T05:49:50.626 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:50.624+0000 7ff8d0894640 1 -- 172.21.15.150:0/2334845514 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff8cc0d0a30 msgr2=0x7ff8cc14fdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:49:50.626 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:50.624+0000 7ff8d0894640 1 --2- 172.21.15.150:0/2334845514 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff8cc0d0a30 0x7ff8cc14fdb0 secure :-1 s=READY pgs=1189 cs=0 l=1 rev1=1 crypto rx=0x7ff8c400c3c0 tx=0x7ff8c400c880 comp rx=0 tx=0).stop 2024-09-17T05:49:50.626 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:50.624+0000 7ff8d0894640 1 -- 172.21.15.150:0/2334845514 shutdown_connections 2024-09-17T05:49:50.626 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:50.624+0000 7ff8d0894640 1 --2- 172.21.15.150:0/2334845514 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7ff8ac07a0f0 0x7ff8ac07c600 unknown :-1 s=CLOSED pgs=510 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:49:50.626 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:50.624+0000 7ff8d0894640 1 --2- 172.21.15.150:0/2334845514 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff8cc0d0a30 0x7ff8cc14fdb0 unknown :-1 s=CLOSED pgs=1189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:49:50.627 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:50.624+0000 7ff8d0894640 1 --2- 172.21.15.150:0/2334845514 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff8cc0b0490 0x7ff8cc14f870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:49:50.627 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:50.624+0000 7ff8d0894640 1 --2- 172.21.15.150:0/2334845514 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff8cc0afd10 0x7ff8cc14cf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:49:50.627 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:50.624+0000 7ff8d0894640 1 -- 172.21.15.150:0/2334845514 >> 172.21.15.150:0/2334845514 conn(0x7ff8cc0b2f80 msgr2=0x7ff8cc0b3390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:49:50.627 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:50.624+0000 7ff8d0894640 1 -- 172.21.15.150:0/2334845514 shutdown_connections 2024-09-17T05:49:50.627 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:50.624+0000 7ff8d0894640 1 -- 172.21.15.150:0/2334845514 wait complete. 2024-09-17T05:49:50.628 INFO:tasks.ceph.mgr.x.smithi176.stderr:2024-09-17T05:49:50.626+0000 7f33da720640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-17T05:49:50.628 INFO:tasks.ceph.mgr.x.smithi176.stderr:2024-09-17T05:49:50.626+0000 7f33da720640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-17T05:49:50.628 INFO:tasks.ceph.mgr.x.smithi176.stderr:2024-09-17T05:49:50.626+0000 7f33da720640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-17T05:49:50.628 INFO:tasks.ceph.mgr.x.smithi176.stderr:2024-09-17T05:49:50.626+0000 7f33da720640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-17T05:49:50.628 INFO:tasks.ceph.mgr.x.smithi176.stderr:2024-09-17T05:49:50.626+0000 7f33da720640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-17T05:49:50.638 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume rm --force cephfs subvol_clone719215 2024-09-17T05:49:50.646 INFO:tasks.ceph.mgr.x.smithi176.stderr:2024-09-17T05:49:50.645+0000 7f33d9f1f640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-17T05:49:50.646 INFO:tasks.ceph.mgr.x.smithi176.stderr:2024-09-17T05:49:50.645+0000 7f33d9f1f640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-17T05:49:50.646 INFO:tasks.ceph.mgr.x.smithi176.stderr:2024-09-17T05:49:50.645+0000 7f33d9f1f640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-17T05:49:50.646 INFO:tasks.ceph.mgr.x.smithi176.stderr:2024-09-17T05:49:50.645+0000 7f33d9f1f640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-17T05:49:50.646 INFO:tasks.ceph.mgr.x.smithi176.stderr:2024-09-17T05:49:50.645+0000 7f33d9f1f640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-17T05:49:50.755 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:50.754+0000 7f5ac634a640 1 -- 172.21.15.150:0/92888553 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5ac00d0520 msgr2=0x7f5ac00b7a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:49:50.756 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:50.754+0000 7f5ac634a640 1 --2- 172.21.15.150:0/92888553 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5ac00d0520 0x7f5ac00b7a50 secure :-1 s=READY pgs=1190 cs=0 l=1 rev1=1 crypto rx=0x7f5ac0074f70 tx=0x7f5ab002a680 comp rx=0 tx=0).stop 2024-09-17T05:49:50.756 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:50.754+0000 7f5ac634a640 1 -- 172.21.15.150:0/92888553 shutdown_connections 2024-09-17T05:49:50.756 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:50.754+0000 7f5ac634a640 1 --2- 172.21.15.150:0/92888553 >> v2:172.21.15.176:3300/0 conn(0x7f5ac00b2190 0x7f5ac00cd2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:49:50.756 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:50.754+0000 7f5ac634a640 1 --2- 172.21.15.150:0/92888553 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5ac00d0520 0x7f5ac00b7a50 unknown :-1 s=CLOSED pgs=1190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:49:50.756 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:50.754+0000 7f5ac634a640 1 -- 172.21.15.150:0/92888553 >> 172.21.15.150:0/92888553 conn(0x7f5ac00cef30 msgr2=0x7f5ac00cf340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:49:50.756 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:50.754+0000 7f5ac634a640 1 -- 172.21.15.150:0/92888553 shutdown_connections 2024-09-17T05:49:50.756 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:50.754+0000 7f5ac634a640 1 -- 172.21.15.150:0/92888553 wait complete. 2024-09-17T05:49:50.757 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:50.755+0000 7f5ac634a640 1 Processor -- start 2024-09-17T05:49:50.757 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:50.756+0000 7f5ac634a640 1 -- start start 2024-09-17T05:49:50.760 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:50.757+0000 7f5ac634a640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5ac00b1d80 0x7f5ac00cdb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:49:50.760 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:50.757+0000 7f5ac634a640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5ac00b2190 0x7f5ac00ce050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:49:50.760 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:50.757+0000 7f5ac634a640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5ac00d0520 0x7f5ac01f40e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:49:50.760 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:50.757+0000 7f5ac634a640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f5ac00d3310 con 0x7f5ac00b1d80 2024-09-17T05:49:50.760 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:50.757+0000 7f5ac634a640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f5ac0074ae0 con 0x7f5ac00b2190 2024-09-17T05:49:50.760 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:50.757+0000 7f5ac634a640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f5ac0070f20 con 0x7f5ac00d0520 2024-09-17T05:49:50.760 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:50.757+0000 7f5abffff640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5ac00b1d80 0x7f5ac00cdb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:49:50.760 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:50.757+0000 7f5abffff640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5ac00b1d80 0x7f5ac00cdb10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:60336/0 (socket says 172.21.15.150:60336) 2024-09-17T05:49:50.760 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:50.757+0000 7f5abffff640 1 -- 172.21.15.150:0/2662383252 learned_addr learned my addr 172.21.15.150:0/2662383252 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:49:50.760 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:50.757+0000 7f5abf7fe640 1 --2- 172.21.15.150:0/2662383252 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5ac00b2190 0x7f5ac00ce050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:49:50.761 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:50.757+0000 7f5ac48e7640 1 --2- 172.21.15.150:0/2662383252 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5ac00d0520 0x7f5ac01f40e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:49:50.761 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:50.757+0000 7f5abffff640 1 -- 172.21.15.150:0/2662383252 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5ac00d0520 msgr2=0x7f5ac01f40e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:49:50.761 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:50.757+0000 7f5abffff640 1 --2- 172.21.15.150:0/2662383252 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5ac00d0520 0x7f5ac01f40e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:49:50.761 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:50.757+0000 7f5abffff640 1 -- 172.21.15.150:0/2662383252 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5ac00b2190 msgr2=0x7f5ac00ce050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:49:50.761 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:50.757+0000 7f5abffff640 1 --2- 172.21.15.150:0/2662383252 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5ac00b2190 0x7f5ac00ce050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:49:50.761 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:50.757+0000 7f5abffff640 1 -- 172.21.15.150:0/2662383252 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5ac014ea50 con 0x7f5ac00b1d80 2024-09-17T05:49:50.761 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:50.757+0000 7f5ac48e7640 1 --2- 172.21.15.150:0/2662383252 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5ac00d0520 0x7f5ac01f40e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:49:50.761 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:50.758+0000 7f5abffff640 1 --2- 172.21.15.150:0/2662383252 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5ac00b1d80 0x7f5ac00cdb10 secure :-1 s=READY pgs=1191 cs=0 l=1 rev1=1 crypto rx=0x7f5ab00099c0 tx=0x7f5ab00038a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:49:50.761 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:50.758+0000 7f5abcff9640 1 -- 172.21.15.150:0/2662383252 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ab003e030 con 0x7f5ac00b1d80 2024-09-17T05:49:50.761 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:50.758+0000 7f5abcff9640 1 -- 172.21.15.150:0/2662383252 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f5ab0003db0 con 0x7f5ac00b1d80 2024-09-17T05:49:50.761 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:50.758+0000 7f5abcff9640 1 -- 172.21.15.150:0/2662383252 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ab0035040 con 0x7f5ac00b1d80 2024-09-17T05:49:50.761 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:50.758+0000 7f5ac634a640 1 -- 172.21.15.150:0/2662383252 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5ac014ed30 con 0x7f5ac00b1d80 2024-09-17T05:49:50.761 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:50.758+0000 7f5ac634a640 1 -- 172.21.15.150:0/2662383252 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5ac014f2f0 con 0x7f5ac00b1d80 2024-09-17T05:49:50.762 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:50.759+0000 7f5ac634a640 1 -- 172.21.15.150:0/2662383252 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5ac00b7a50 con 0x7f5ac00b1d80 2024-09-17T05:49:50.762 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:50.759+0000 7f5abcff9640 1 -- 172.21.15.150:0/2662383252 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 31) ==== 103379+0+0 (secure 0 0 0) 0x7f5ab0041030 con 0x7f5ac00b1d80 2024-09-17T05:49:50.762 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:50.760+0000 7f5abcff9640 1 --2- 172.21.15.150:0/2662383252 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f5aac07a0f0 0x7f5aac07c600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:49:50.763 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:50.760+0000 7f5abcff9640 1 -- 172.21.15.150:0/2662383252 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 5822+0+0 (secure 0 0 0) 0x7f5ab00ba7d0 con 0x7f5ac00b1d80 2024-09-17T05:49:50.763 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:50.760+0000 7f5abf7fe640 1 --2- 172.21.15.150:0/2662383252 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f5aac07a0f0 0x7f5aac07c600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:49:50.763 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:50.761+0000 7f5abf7fe640 1 --2- 172.21.15.150:0/2662383252 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f5aac07a0f0 0x7f5aac07c600 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7f5ac00cd8a0 tx=0x7f5ab4009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:49:50.766 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:50.765+0000 7f5abcff9640 1 -- 172.21.15.150:0/2662383252 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f5ab0083c70 con 0x7f5ac00b1d80 2024-09-17T05:49:50.969 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:50.967+0000 7f5ac634a640 1 -- 172.21.15.150:0/2662383252 --> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] -- mgr_command(tid 0: {"prefix": "fs subvolume rm", "force": true, "vol_name": "cephfs", "sub_name": "subvol_clone719215", "target": ["mon-mgr", ""]}) -- 0x7f5ac015d060 con 0x7f5aac07a0f0 2024-09-17T05:49:50.990 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:50.988+0000 7f5abcff9640 1 -- 172.21.15.150:0/2662383252 <== mgr.4108 v2:172.21.15.176:6800/3631216395 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f5ac015d060 con 0x7f5aac07a0f0 2024-09-17T05:49:50.993 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:50.991+0000 7f5ac634a640 1 -- 172.21.15.150:0/2662383252 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f5aac07a0f0 msgr2=0x7f5aac07c600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:49:50.993 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:50.991+0000 7f5ac634a640 1 --2- 172.21.15.150:0/2662383252 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f5aac07a0f0 0x7f5aac07c600 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7f5ac00cd8a0 tx=0x7f5ab4009040 comp rx=0 tx=0).stop 2024-09-17T05:49:50.993 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:50.991+0000 7f5ac634a640 1 -- 172.21.15.150:0/2662383252 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5ac00b1d80 msgr2=0x7f5ac00cdb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:49:50.993 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:50.991+0000 7f5ac634a640 1 --2- 172.21.15.150:0/2662383252 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5ac00b1d80 0x7f5ac00cdb10 secure :-1 s=READY pgs=1191 cs=0 l=1 rev1=1 crypto rx=0x7f5ab00099c0 tx=0x7f5ab00038a0 comp rx=0 tx=0).stop 2024-09-17T05:49:50.993 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:50.991+0000 7f5ac634a640 1 -- 172.21.15.150:0/2662383252 shutdown_connections 2024-09-17T05:49:50.993 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:50.991+0000 7f5ac634a640 1 --2- 172.21.15.150:0/2662383252 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5ac00b2190 0x7f5ac00ce050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:49:50.993 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:50.991+0000 7f5ac634a640 1 --2- 172.21.15.150:0/2662383252 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f5aac07a0f0 0x7f5aac07c600 unknown :-1 s=CLOSED pgs=511 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:49:50.993 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:50.991+0000 7f5ac634a640 1 --2- 172.21.15.150:0/2662383252 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5ac00d0520 0x7f5ac01f40e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:49:50.994 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:50.991+0000 7f5ac634a640 1 --2- 172.21.15.150:0/2662383252 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5ac00b1d80 0x7f5ac00cdb10 unknown :-1 s=CLOSED pgs=1191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:49:50.994 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:50.991+0000 7f5ac634a640 1 -- 172.21.15.150:0/2662383252 >> 172.21.15.150:0/2662383252 conn(0x7f5ac00cef30 msgr2=0x7f5ac015c950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:49:50.994 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:50.991+0000 7f5ac634a640 1 -- 172.21.15.150:0/2662383252 shutdown_connections 2024-09-17T05:49:50.994 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:50.991+0000 7f5ac634a640 1 -- 172.21.15.150:0/2662383252 wait complete. 2024-09-17T05:49:51.004 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume rm --force cephfs subvol_clone61996 2024-09-17T05:49:51.125 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:51.123+0000 7f56d0307640 1 -- 172.21.15.150:0/242242975 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f56c80b6730 msgr2=0x7f56c80d31a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:49:51.125 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:51.123+0000 7f56d0307640 1 --2- 172.21.15.150:0/242242975 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f56c80b6730 0x7f56c80d31a0 secure :-1 s=READY pgs=1193 cs=0 l=1 rev1=1 crypto rx=0x7f56c0005fd0 tx=0x7f56c002aa10 comp rx=0 tx=0).stop 2024-09-17T05:49:51.125 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:51.123+0000 7f56d0307640 1 -- 172.21.15.150:0/242242975 shutdown_connections 2024-09-17T05:49:51.125 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:51.123+0000 7f56d0307640 1 --2- 172.21.15.150:0/242242975 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f56c80b6730 0x7f56c80d31a0 unknown :-1 s=CLOSED pgs=1193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:49:51.125 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:51.123+0000 7f56d0307640 1 -- 172.21.15.150:0/242242975 >> 172.21.15.150:0/242242975 conn(0x7f56c80d46c0 msgr2=0x7f56c80d4ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:49:51.125 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:51.123+0000 7f56d0307640 1 -- 172.21.15.150:0/242242975 shutdown_connections 2024-09-17T05:49:51.126 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:51.123+0000 7f56d0307640 1 -- 172.21.15.150:0/242242975 wait complete. 2024-09-17T05:49:51.126 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:51.125+0000 7f56d0307640 1 Processor -- start 2024-09-17T05:49:51.126 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:51.125+0000 7f56d0307640 1 -- start start 2024-09-17T05:49:51.129 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:51.126+0000 7f56d0307640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f56c80b6320 0x7f56c8156b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:49:51.129 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:51.126+0000 7f56d0307640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f56c80b6730 0x7f56c81451f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:49:51.129 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:51.126+0000 7f56d0307640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f56c80d5300 0x7f56c8145730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:49:51.129 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:51.126+0000 7f56d0307640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f56c816a480 con 0x7f56c80d5300 2024-09-17T05:49:51.129 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:51.126+0000 7f56d0307640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f56c80d3a60 con 0x7f56c80b6320 2024-09-17T05:49:51.129 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:51.126+0000 7f56d0307640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f56c816a600 con 0x7f56c80b6730 2024-09-17T05:49:51.130 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:51.126+0000 7f56ce8a4640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f56c80d5300 0x7f56c8145730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:49:51.130 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:51.126+0000 7f56ce0a3640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f56c80b6320 0x7f56c8156b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:49:51.130 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:51.126+0000 7f56ce8a4640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f56c80d5300 0x7f56c8145730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:60368/0 (socket says 172.21.15.150:60368) 2024-09-17T05:49:51.130 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:51.126+0000 7f56ce8a4640 1 -- 172.21.15.150:0/3046749003 learned_addr learned my addr 172.21.15.150:0/3046749003 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:49:51.130 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:51.126+0000 7f56cd8a2640 1 --2- 172.21.15.150:0/3046749003 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f56c80b6730 0x7f56c81451f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:49:51.130 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:51.127+0000 7f56ce8a4640 1 -- 172.21.15.150:0/3046749003 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f56c80b6730 msgr2=0x7f56c81451f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:49:51.130 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:51.127+0000 7f56ce8a4640 1 --2- 172.21.15.150:0/3046749003 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f56c80b6730 0x7f56c81451f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:49:51.130 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:51.127+0000 7f56ce8a4640 1 -- 172.21.15.150:0/3046749003 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f56c80b6320 msgr2=0x7f56c8156b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:49:51.130 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:51.127+0000 7f56ce8a4640 1 --2- 172.21.15.150:0/3046749003 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f56c80b6320 0x7f56c8156b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:49:51.130 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:51.127+0000 7f56ce8a4640 1 -- 172.21.15.150:0/3046749003 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f56c8157060 con 0x7f56c80d5300 2024-09-17T05:49:51.130 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:51.127+0000 7f56ce8a4640 1 --2- 172.21.15.150:0/3046749003 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f56c80d5300 0x7f56c8145730 secure :-1 s=READY pgs=1194 cs=0 l=1 rev1=1 crypto rx=0x7f56c0006010 tx=0x7f56c0003f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:49:51.130 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:51.127+0000 7f56beffd640 1 -- 172.21.15.150:0/3046749003 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56c0046070 con 0x7f56c80d5300 2024-09-17T05:49:51.130 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:51.127+0000 7f56beffd640 1 -- 172.21.15.150:0/3046749003 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f56c00045c0 con 0x7f56c80d5300 2024-09-17T05:49:51.131 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:51.127+0000 7f56beffd640 1 -- 172.21.15.150:0/3046749003 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56c0033070 con 0x7f56c80d5300 2024-09-17T05:49:51.131 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:51.127+0000 7f56d0307640 1 -- 172.21.15.150:0/3046749003 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f56c809e320 con 0x7f56c80d5300 2024-09-17T05:49:51.131 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:51.127+0000 7f56d0307640 1 -- 172.21.15.150:0/3046749003 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f56c81460a0 con 0x7f56c80d5300 2024-09-17T05:49:51.131 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:51.128+0000 7f56d0307640 1 -- 172.21.15.150:0/3046749003 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f56c808cd50 con 0x7f56c80d5300 2024-09-17T05:49:51.132 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:51.129+0000 7f56beffd640 1 -- 172.21.15.150:0/3046749003 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 31) ==== 103379+0+0 (secure 0 0 0) 0x7f56c0049070 con 0x7f56c80d5300 2024-09-17T05:49:51.132 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:51.130+0000 7f56beffd640 1 --2- 172.21.15.150:0/3046749003 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f56ac07a0f0 0x7f56ac07c600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:49:51.132 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:51.130+0000 7f56beffd640 1 -- 172.21.15.150:0/3046749003 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 5822+0+0 (secure 0 0 0) 0x7f56c00bb3c0 con 0x7f56c80d5300 2024-09-17T05:49:51.132 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:51.130+0000 7f56ce0a3640 1 --2- 172.21.15.150:0/3046749003 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f56ac07a0f0 0x7f56ac07c600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:49:51.132 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:51.131+0000 7f56ce0a3640 1 --2- 172.21.15.150:0/3046749003 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f56ac07a0f0 0x7f56ac07c600 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f56c4001720 tx=0x7f56c4009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:49:51.135 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:51.134+0000 7f56beffd640 1 -- 172.21.15.150:0/3046749003 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f56c808cd50 con 0x7f56c80d5300 2024-09-17T05:49:51.341 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:51.339+0000 7f56d0307640 1 -- 172.21.15.150:0/3046749003 --> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] -- mgr_command(tid 0: {"prefix": "fs subvolume rm", "force": true, "vol_name": "cephfs", "sub_name": "subvol_clone61996", "target": ["mon-mgr", ""]}) -- 0x7f56c80a2350 con 0x7f56ac07a0f0 2024-09-17T05:49:51.359 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:51.358+0000 7f56beffd640 1 -- 172.21.15.150:0/3046749003 <== mgr.4108 v2:172.21.15.176:6800/3631216395 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f56c80a2350 con 0x7f56ac07a0f0 2024-09-17T05:49:51.362 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:51.360+0000 7f56d0307640 1 -- 172.21.15.150:0/3046749003 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f56ac07a0f0 msgr2=0x7f56ac07c600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:49:51.362 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:51.360+0000 7f56d0307640 1 --2- 172.21.15.150:0/3046749003 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f56ac07a0f0 0x7f56ac07c600 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f56c4001720 tx=0x7f56c4009040 comp rx=0 tx=0).stop 2024-09-17T05:49:51.362 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:51.360+0000 7f56d0307640 1 -- 172.21.15.150:0/3046749003 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f56c80d5300 msgr2=0x7f56c8145730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:49:51.362 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:51.360+0000 7f56d0307640 1 --2- 172.21.15.150:0/3046749003 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f56c80d5300 0x7f56c8145730 secure :-1 s=READY pgs=1194 cs=0 l=1 rev1=1 crypto rx=0x7f56c0006010 tx=0x7f56c0003f10 comp rx=0 tx=0).stop 2024-09-17T05:49:51.362 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:51.360+0000 7f56d0307640 1 -- 172.21.15.150:0/3046749003 shutdown_connections 2024-09-17T05:49:51.362 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:51.360+0000 7f56d0307640 1 --2- 172.21.15.150:0/3046749003 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f56ac07a0f0 0x7f56ac07c600 unknown :-1 s=CLOSED pgs=512 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:49:51.362 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:51.360+0000 7f56d0307640 1 --2- 172.21.15.150:0/3046749003 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f56c80d5300 0x7f56c8145730 unknown :-1 s=CLOSED pgs=1194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:49:51.362 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:51.360+0000 7f56d0307640 1 --2- 172.21.15.150:0/3046749003 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f56c80b6730 0x7f56c81451f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:49:51.362 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:51.360+0000 7f56d0307640 1 --2- 172.21.15.150:0/3046749003 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f56c80b6320 0x7f56c8156b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:49:51.362 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:51.360+0000 7f56d0307640 1 -- 172.21.15.150:0/3046749003 >> 172.21.15.150:0/3046749003 conn(0x7f56c80d46c0 msgr2=0x7f56c815f1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:49:51.362 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:51.360+0000 7f56d0307640 1 -- 172.21.15.150:0/3046749003 shutdown_connections 2024-09-17T05:49:51.362 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:51.360+0000 7f56d0307640 1 -- 172.21.15.150:0/3046749003 wait complete. 2024-09-17T05:49:51.373 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume rm --force cephfs subvol_clone73572 2024-09-17T05:49:51.494 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:51.492+0000 7f7b7b77b640 1 -- 172.21.15.150:0/296522497 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7b740b1d80 msgr2=0x7f7b740d0c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:49:51.494 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:51.492+0000 7f7b7b77b640 1 --2- 172.21.15.150:0/296522497 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7b740b1d80 0x7f7b740d0c90 secure :-1 s=READY pgs=1196 cs=0 l=1 rev1=1 crypto rx=0x7f7b64009830 tx=0x7f7b6402a5a0 comp rx=0 tx=0).stop 2024-09-17T05:49:51.494 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:51.492+0000 7f7b7b77b640 1 -- 172.21.15.150:0/296522497 shutdown_connections 2024-09-17T05:49:51.494 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:51.492+0000 7f7b7b77b640 1 --2- 172.21.15.150:0/296522497 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7b740b1d80 0x7f7b740d0c90 unknown :-1 s=CLOSED pgs=1196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:49:51.495 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:51.492+0000 7f7b7b77b640 1 --2- 172.21.15.150:0/296522497 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7b740d0520 0x7f7b740b7a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:49:51.495 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:51.492+0000 7f7b7b77b640 1 -- 172.21.15.150:0/296522497 >> 172.21.15.150:0/296522497 conn(0x7f7b740cef30 msgr2=0x7f7b740cf340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:49:51.495 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:51.492+0000 7f7b7b77b640 1 -- 172.21.15.150:0/296522497 shutdown_connections 2024-09-17T05:49:51.495 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:51.492+0000 7f7b7b77b640 1 -- 172.21.15.150:0/296522497 wait complete. 2024-09-17T05:49:51.495 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:51.494+0000 7f7b7b77b640 1 Processor -- start 2024-09-17T05:49:51.495 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:51.494+0000 7f7b7b77b640 1 -- start start 2024-09-17T05:49:51.498 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:51.495+0000 7f7b7b77b640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7b740b1d80 0x7f7b741f41b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:49:51.498 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:51.495+0000 7f7b7b77b640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7b740d0520 0x7f7b7415d830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:49:51.499 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:51.495+0000 7f7b7b77b640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7b740d11d0 0x7f7b74153860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:49:51.499 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:51.495+0000 7f7b7b77b640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f7b74070f20 con 0x7f7b740b1d80 2024-09-17T05:49:51.499 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:51.495+0000 7f7b7b77b640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f7b740d3310 con 0x7f7b740d0520 2024-09-17T05:49:51.499 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:51.495+0000 7f7b7b77b640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f7b740b2190 con 0x7f7b740d11d0 2024-09-17T05:49:51.499 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:51.495+0000 7f7b79517640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7b740b1d80 0x7f7b741f41b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:49:51.499 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:51.495+0000 7f7b79517640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7b740b1d80 0x7f7b741f41b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:60378/0 (socket says 172.21.15.150:60378) 2024-09-17T05:49:51.499 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:51.495+0000 7f7b79517640 1 -- 172.21.15.150:0/4206805627 learned_addr learned my addr 172.21.15.150:0/4206805627 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:49:51.499 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:51.495+0000 7f7b78d16640 1 --2- 172.21.15.150:0/4206805627 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7b740d0520 0x7f7b7415d830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:49:51.499 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:51.495+0000 7f7b79d18640 1 --2- 172.21.15.150:0/4206805627 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7b740d11d0 0x7f7b74153860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:49:51.499 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:51.495+0000 7f7b79517640 1 -- 172.21.15.150:0/4206805627 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7b740d11d0 msgr2=0x7f7b74153860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:49:51.499 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:51.495+0000 7f7b79517640 1 --2- 172.21.15.150:0/4206805627 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7b740d11d0 0x7f7b74153860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:49:51.499 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:51.495+0000 7f7b79517640 1 -- 172.21.15.150:0/4206805627 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7b740d0520 msgr2=0x7f7b7415d830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:49:51.499 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:51.495+0000 7f7b79517640 1 --2- 172.21.15.150:0/4206805627 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7b740d0520 0x7f7b7415d830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:49:51.500 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:51.496+0000 7f7b79517640 1 -- 172.21.15.150:0/4206805627 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7b741f3710 con 0x7f7b740b1d80 2024-09-17T05:49:51.500 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:51.496+0000 7f7b79517640 1 --2- 172.21.15.150:0/4206805627 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7b740b1d80 0x7f7b741f41b0 secure :-1 s=READY pgs=1197 cs=0 l=1 rev1=1 crypto rx=0x7f7b7000d740 tx=0x7f7b7000dc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:49:51.500 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:51.496+0000 7f7b69ffb640 1 -- 172.21.15.150:0/4206805627 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b70017070 con 0x7f7b740b1d80 2024-09-17T05:49:51.500 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:51.496+0000 7f7b69ffb640 1 -- 172.21.15.150:0/4206805627 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f7b70009d20 con 0x7f7b740b1d80 2024-09-17T05:49:51.500 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:51.496+0000 7f7b7b77b640 1 -- 172.21.15.150:0/4206805627 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7b741606d0 con 0x7f7b740b1d80 2024-09-17T05:49:51.500 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:51.496+0000 7f7b69ffb640 1 -- 172.21.15.150:0/4206805627 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b700106c0 con 0x7f7b740b1d80 2024-09-17T05:49:51.500 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:51.496+0000 7f7b7b77b640 1 -- 172.21.15.150:0/4206805627 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7b741f3c90 con 0x7f7b740b1d80 2024-09-17T05:49:51.500 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:51.497+0000 7f7b7b77b640 1 -- 172.21.15.150:0/4206805627 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7b740d0c90 con 0x7f7b740b1d80 2024-09-17T05:49:51.501 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:51.498+0000 7f7b69ffb640 1 -- 172.21.15.150:0/4206805627 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 32) ==== 103481+0+0 (secure 0 0 0) 0x7f7b7001a070 con 0x7f7b740b1d80 2024-09-17T05:49:51.501 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:51.498+0000 7f7b69ffb640 1 --2- 172.21.15.150:0/4206805627 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f7b5807a240 0x7f7b5807c750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:49:51.501 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:51.498+0000 7f7b69ffb640 1 -- 172.21.15.150:0/4206805627 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 5822+0+0 (secure 0 0 0) 0x7f7b70099a30 con 0x7f7b740b1d80 2024-09-17T05:49:51.501 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:51.498+0000 7f7b78d16640 1 --2- 172.21.15.150:0/4206805627 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f7b5807a240 0x7f7b5807c750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:49:51.501 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:51.499+0000 7f7b78d16640 1 --2- 172.21.15.150:0/4206805627 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f7b5807a240 0x7f7b5807c750 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f7b64034000 tx=0x7f7b64004730 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:49:51.504 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:51.503+0000 7f7b69ffb640 1 -- 172.21.15.150:0/4206805627 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f7b700633b0 con 0x7f7b740b1d80 2024-09-17T05:49:51.706 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:51.704+0000 7f7b7b77b640 1 -- 172.21.15.150:0/4206805627 --> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] -- mgr_command(tid 0: {"prefix": "fs subvolume rm", "force": true, "vol_name": "cephfs", "sub_name": "subvol_clone73572", "target": ["mon-mgr", ""]}) -- 0x7f7b74072210 con 0x7f7b5807a240 2024-09-17T05:49:51.721 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:51.719+0000 7f7b69ffb640 1 -- 172.21.15.150:0/4206805627 <== mgr.4108 v2:172.21.15.176:6800/3631216395 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f7b74072210 con 0x7f7b5807a240 2024-09-17T05:49:51.724 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:51.722+0000 7f7b7b77b640 1 -- 172.21.15.150:0/4206805627 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f7b5807a240 msgr2=0x7f7b5807c750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:49:51.724 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:51.722+0000 7f7b7b77b640 1 --2- 172.21.15.150:0/4206805627 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f7b5807a240 0x7f7b5807c750 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f7b64034000 tx=0x7f7b64004730 comp rx=0 tx=0).stop 2024-09-17T05:49:51.724 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:51.722+0000 7f7b7b77b640 1 -- 172.21.15.150:0/4206805627 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7b740b1d80 msgr2=0x7f7b741f41b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:49:51.724 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:51.722+0000 7f7b7b77b640 1 --2- 172.21.15.150:0/4206805627 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7b740b1d80 0x7f7b741f41b0 secure :-1 s=READY pgs=1197 cs=0 l=1 rev1=1 crypto rx=0x7f7b7000d740 tx=0x7f7b7000dc00 comp rx=0 tx=0).stop 2024-09-17T05:49:51.724 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:51.722+0000 7f7b7b77b640 1 -- 172.21.15.150:0/4206805627 shutdown_connections 2024-09-17T05:49:51.724 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:51.722+0000 7f7b7b77b640 1 --2- 172.21.15.150:0/4206805627 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7b740d0520 0x7f7b7415d830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:49:51.724 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:51.722+0000 7f7b7b77b640 1 --2- 172.21.15.150:0/4206805627 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f7b5807a240 0x7f7b5807c750 unknown :-1 s=CLOSED pgs=513 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:49:51.724 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:51.722+0000 7f7b7b77b640 1 --2- 172.21.15.150:0/4206805627 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7b740d11d0 0x7f7b74153860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:49:51.724 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:51.722+0000 7f7b7b77b640 1 --2- 172.21.15.150:0/4206805627 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7b740b1d80 0x7f7b741f41b0 unknown :-1 s=CLOSED pgs=1197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:49:51.725 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:51.722+0000 7f7b7b77b640 1 -- 172.21.15.150:0/4206805627 >> 172.21.15.150:0/4206805627 conn(0x7f7b740cef30 msgr2=0x7f7b74071240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:49:51.725 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:51.722+0000 7f7b7b77b640 1 -- 172.21.15.150:0/4206805627 shutdown_connections 2024-09-17T05:49:51.725 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:51.722+0000 7f7b7b77b640 1 -- 172.21.15.150:0/4206805627 wait complete. 2024-09-17T05:49:51.735 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume rm --force cephfs subvol_clone126017 2024-09-17T05:49:51.852 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:51.850+0000 7fcf84bba640 1 -- 172.21.15.150:0/3457211035 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fcf800712a0 msgr2=0x7fcf8006ddb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:49:51.852 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:51.850+0000 7fcf84bba640 1 --2- 172.21.15.150:0/3457211035 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fcf800712a0 0x7fcf8006ddb0 secure :-1 s=READY pgs=1199 cs=0 l=1 rev1=1 crypto rx=0x7fcf74009860 tx=0x7fcf7402a4b0 comp rx=0 tx=0).stop 2024-09-17T05:49:51.853 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:51.850+0000 7fcf84bba640 1 -- 172.21.15.150:0/3457211035 shutdown_connections 2024-09-17T05:49:51.853 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:51.850+0000 7fcf84bba640 1 --2- 172.21.15.150:0/3457211035 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fcf800712a0 0x7fcf8006ddb0 unknown :-1 s=CLOSED pgs=1199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:49:51.853 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:51.850+0000 7fcf84bba640 1 --2- 172.21.15.150:0/3457211035 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fcf80152990 0x7fcf8015c740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:49:51.853 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:51.850+0000 7fcf84bba640 1 -- 172.21.15.150:0/3457211035 >> 172.21.15.150:0/3457211035 conn(0x7fcf80073890 msgr2=0x7fcf80073ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:49:51.853 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:51.850+0000 7fcf84bba640 1 -- 172.21.15.150:0/3457211035 shutdown_connections 2024-09-17T05:49:51.853 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:51.850+0000 7fcf84bba640 1 -- 172.21.15.150:0/3457211035 wait complete. 2024-09-17T05:49:51.854 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:51.852+0000 7fcf84bba640 1 Processor -- start 2024-09-17T05:49:51.854 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:51.852+0000 7fcf84bba640 1 -- start start 2024-09-17T05:49:51.857 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:51.854+0000 7fcf84bba640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fcf800712a0 0x7fcf801f5010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:49:51.857 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:51.854+0000 7fcf84bba640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fcf800716b0 0x7fcf8015a040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:49:51.857 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:51.854+0000 7fcf84bba640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fcf80152990 0x7fcf8015a580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:49:51.857 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:51.854+0000 7fcf84bba640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7fcf800b54f0 con 0x7fcf800716b0 2024-09-17T05:49:51.857 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:51.854+0000 7fcf84bba640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fcf8006e650 con 0x7fcf80152990 2024-09-17T05:49:51.857 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:51.854+0000 7fcf84bba640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fcf800b5670 con 0x7fcf800712a0 2024-09-17T05:49:51.857 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:51.854+0000 7fcf7dd9b640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fcf800716b0 0x7fcf8015a040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:49:51.857 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:51.854+0000 7fcf7dd9b640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fcf800716b0 0x7fcf8015a040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:60390/0 (socket says 172.21.15.150:60390) 2024-09-17T05:49:51.857 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:51.854+0000 7fcf7dd9b640 1 -- 172.21.15.150:0/3716399409 learned_addr learned my addr 172.21.15.150:0/3716399409 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:49:51.858 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:51.854+0000 7fcf7e59c640 1 --2- 172.21.15.150:0/3716399409 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fcf800712a0 0x7fcf801f5010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:49:51.858 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:51.854+0000 7fcf7ed9d640 1 --2- 172.21.15.150:0/3716399409 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fcf80152990 0x7fcf8015a580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:49:51.858 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:51.854+0000 7fcf7dd9b640 1 -- 172.21.15.150:0/3716399409 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fcf800712a0 msgr2=0x7fcf801f5010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:49:51.858 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:51.854+0000 7fcf7dd9b640 1 --2- 172.21.15.150:0/3716399409 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fcf800712a0 0x7fcf801f5010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:49:51.858 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:51.854+0000 7fcf7dd9b640 1 -- 172.21.15.150:0/3716399409 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fcf80152990 msgr2=0x7fcf8015a580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:49:51.858 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:51.854+0000 7fcf7dd9b640 1 --2- 172.21.15.150:0/3716399409 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fcf80152990 0x7fcf8015a580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:49:51.858 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:51.854+0000 7fcf7dd9b640 1 -- 172.21.15.150:0/3716399409 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcf801f5550 con 0x7fcf800716b0 2024-09-17T05:49:51.858 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:51.854+0000 7fcf7dd9b640 1 --2- 172.21.15.150:0/3716399409 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fcf800716b0 0x7fcf8015a040 secure :-1 s=READY pgs=1200 cs=0 l=1 rev1=1 crypto rx=0x7fcf74009980 tx=0x7fcf740043b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:49:51.858 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:51.854+0000 7fcf6effd640 1 -- 172.21.15.150:0/3716399409 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf74003a00 con 0x7fcf800716b0 2024-09-17T05:49:51.858 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:51.854+0000 7fcf6effd640 1 -- 172.21.15.150:0/3716399409 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fcf74003c90 con 0x7fcf800716b0 2024-09-17T05:49:51.858 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:51.854+0000 7fcf6effd640 1 -- 172.21.15.150:0/3716399409 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf7403d690 con 0x7fcf800716b0 2024-09-17T05:49:51.858 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:51.854+0000 7fcf84bba640 1 -- 172.21.15.150:0/3716399409 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcf801e6110 con 0x7fcf800716b0 2024-09-17T05:49:51.858 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:51.854+0000 7fcf84bba640 1 -- 172.21.15.150:0/3716399409 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcf801e66d0 con 0x7fcf800716b0 2024-09-17T05:49:51.859 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:51.855+0000 7fcf84bba640 1 -- 172.21.15.150:0/3716399409 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcf8006ddb0 con 0x7fcf800716b0 2024-09-17T05:49:51.859 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:51.856+0000 7fcf6effd640 1 -- 172.21.15.150:0/3716399409 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 32) ==== 103481+0+0 (secure 0 0 0) 0x7fcf7403d830 con 0x7fcf800716b0 2024-09-17T05:49:51.860 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:51.857+0000 7fcf6effd640 1 --2- 172.21.15.150:0/3716399409 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fcf6007a210 0x7fcf6007c720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:49:51.860 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:51.857+0000 7fcf6effd640 1 -- 172.21.15.150:0/3716399409 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 5822+0+0 (secure 0 0 0) 0x7fcf740bd500 con 0x7fcf800716b0 2024-09-17T05:49:51.860 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:51.857+0000 7fcf7e59c640 1 --2- 172.21.15.150:0/3716399409 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fcf6007a210 0x7fcf6007c720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:49:51.860 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:51.857+0000 7fcf7e59c640 1 --2- 172.21.15.150:0/3716399409 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fcf6007a210 0x7fcf6007c720 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7fcf70009b30 tx=0x7fcf70005f90 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:49:51.863 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:51.861+0000 7fcf6effd640 1 -- 172.21.15.150:0/3716399409 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fcf74041030 con 0x7fcf800716b0 2024-09-17T05:49:52.064 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:52.063+0000 7fcf84bba640 1 -- 172.21.15.150:0/3716399409 --> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] -- mgr_command(tid 0: {"prefix": "fs subvolume rm", "force": true, "vol_name": "cephfs", "sub_name": "subvol_clone126017", "target": ["mon-mgr", ""]}) -- 0x7fcf8014eb80 con 0x7fcf6007a210 2024-09-17T05:49:52.080 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:52.079+0000 7fcf6effd640 1 -- 172.21.15.150:0/3716399409 <== mgr.4108 v2:172.21.15.176:6800/3631216395 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7fcf8014eb80 con 0x7fcf6007a210 2024-09-17T05:49:52.083 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:52.081+0000 7fcf84bba640 1 -- 172.21.15.150:0/3716399409 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fcf6007a210 msgr2=0x7fcf6007c720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:49:52.083 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:52.081+0000 7fcf84bba640 1 --2- 172.21.15.150:0/3716399409 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fcf6007a210 0x7fcf6007c720 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7fcf70009b30 tx=0x7fcf70005f90 comp rx=0 tx=0).stop 2024-09-17T05:49:52.083 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:52.081+0000 7fcf84bba640 1 -- 172.21.15.150:0/3716399409 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fcf800716b0 msgr2=0x7fcf8015a040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:49:52.083 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:52.081+0000 7fcf84bba640 1 --2- 172.21.15.150:0/3716399409 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fcf800716b0 0x7fcf8015a040 secure :-1 s=READY pgs=1200 cs=0 l=1 rev1=1 crypto rx=0x7fcf74009980 tx=0x7fcf740043b0 comp rx=0 tx=0).stop 2024-09-17T05:49:52.083 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:52.081+0000 7fcf84bba640 1 -- 172.21.15.150:0/3716399409 shutdown_connections 2024-09-17T05:49:52.083 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:52.081+0000 7fcf84bba640 1 --2- 172.21.15.150:0/3716399409 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fcf80152990 0x7fcf8015a580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:49:52.083 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:52.081+0000 7fcf84bba640 1 --2- 172.21.15.150:0/3716399409 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fcf6007a210 0x7fcf6007c720 unknown :-1 s=CLOSED pgs=514 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:49:52.084 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:52.081+0000 7fcf84bba640 1 --2- 172.21.15.150:0/3716399409 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fcf800716b0 0x7fcf8015a040 unknown :-1 s=CLOSED pgs=1200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:49:52.084 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:52.081+0000 7fcf84bba640 1 --2- 172.21.15.150:0/3716399409 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fcf800712a0 0x7fcf801f5010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:49:52.084 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:52.081+0000 7fcf84bba640 1 -- 172.21.15.150:0/3716399409 >> 172.21.15.150:0/3716399409 conn(0x7fcf80073890 msgr2=0x7fcf8006cda0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:49:52.084 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:52.081+0000 7fcf84bba640 1 -- 172.21.15.150:0/3716399409 shutdown_connections 2024-09-17T05:49:52.084 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:52.081+0000 7fcf84bba640 1 -- 172.21.15.150:0/3716399409 wait complete. 2024-09-17T05:49:52.094 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume rm --force cephfs subvol_clone17383 2024-09-17T05:49:52.213 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:52.211+0000 7f5f293f1640 1 -- 172.21.15.150:0/4059849977 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5f240d0d20 msgr2=0x7f5f240d1130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:49:52.213 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:52.211+0000 7f5f293f1640 1 --2- 172.21.15.150:0/4059849977 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5f240d0d20 0x7f5f240d1130 secure :-1 s=READY pgs=1201 cs=0 l=1 rev1=1 crypto rx=0x7f5f240b4120 tx=0x7f5f1402a560 comp rx=0 tx=0).stop 2024-09-17T05:49:52.213 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:52.211+0000 7f5f293f1640 1 -- 172.21.15.150:0/4059849977 shutdown_connections 2024-09-17T05:49:52.213 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:52.211+0000 7f5f293f1640 1 --2- 172.21.15.150:0/4059849977 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5f2406e8d0 0x7f5f2406ece0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:49:52.213 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:52.211+0000 7f5f293f1640 1 --2- 172.21.15.150:0/4059849977 >> v2:172.21.15.176:3300/0 conn(0x7f5f240d1670 0x7f5f2406e390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:49:52.213 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:52.211+0000 7f5f293f1640 1 --2- 172.21.15.150:0/4059849977 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5f240d0d20 0x7f5f240d1130 unknown :-1 s=CLOSED pgs=1201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:49:52.213 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:52.211+0000 7f5f293f1640 1 -- 172.21.15.150:0/4059849977 >> 172.21.15.150:0/4059849977 conn(0x7f5f240d46f0 msgr2=0x7f5f240d4b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:49:52.213 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:52.211+0000 7f5f293f1640 1 -- 172.21.15.150:0/4059849977 shutdown_connections 2024-09-17T05:49:52.214 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:52.211+0000 7f5f293f1640 1 -- 172.21.15.150:0/4059849977 wait complete. 2024-09-17T05:49:52.214 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:52.213+0000 7f5f293f1640 1 Processor -- start 2024-09-17T05:49:52.214 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:52.213+0000 7f5f293f1640 1 -- start start 2024-09-17T05:49:52.217 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:52.214+0000 7f5f293f1640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5f2406e8d0 0x7f5f2414c450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:49:52.217 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:52.214+0000 7f5f293f1640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5f240d0d20 0x7f5f2414f130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:49:52.217 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:52.214+0000 7f5f293f1640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5f240d1670 0x7f5f2414f670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:49:52.217 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:52.214+0000 7f5f293f1640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f5f2406f220 con 0x7f5f2406e8d0 2024-09-17T05:49:52.217 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:52.214+0000 7f5f293f1640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f5f2406f3a0 con 0x7f5f240d0d20 2024-09-17T05:49:52.217 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:52.214+0000 7f5f293f1640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f5f2406f520 con 0x7f5f240d1670 2024-09-17T05:49:52.217 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:52.214+0000 7f5f22ffd640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5f2406e8d0 0x7f5f2414c450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:49:52.217 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:52.214+0000 7f5f22ffd640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5f2406e8d0 0x7f5f2414c450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:60408/0 (socket says 172.21.15.150:60408) 2024-09-17T05:49:52.218 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:52.214+0000 7f5f22ffd640 1 -- 172.21.15.150:0/1862554175 learned_addr learned my addr 172.21.15.150:0/1862554175 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:49:52.218 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:52.214+0000 7f5f227fc640 1 --2- 172.21.15.150:0/1862554175 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5f240d0d20 0x7f5f2414f130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:49:52.218 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:52.214+0000 7f5f237fe640 1 --2- 172.21.15.150:0/1862554175 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5f240d1670 0x7f5f2414f670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:49:52.218 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:52.214+0000 7f5f22ffd640 1 -- 172.21.15.150:0/1862554175 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5f240d1670 msgr2=0x7f5f2414f670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:49:52.218 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:52.214+0000 7f5f22ffd640 1 --2- 172.21.15.150:0/1862554175 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5f240d1670 0x7f5f2414f670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:49:52.218 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:52.214+0000 7f5f22ffd640 1 -- 172.21.15.150:0/1862554175 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5f240d0d20 msgr2=0x7f5f2414f130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:49:52.218 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:52.214+0000 7f5f22ffd640 1 --2- 172.21.15.150:0/1862554175 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5f240d0d20 0x7f5f2414f130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:49:52.218 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:52.214+0000 7f5f22ffd640 1 -- 172.21.15.150:0/1862554175 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5f2414fe80 con 0x7f5f2406e8d0 2024-09-17T05:49:52.218 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:52.214+0000 7f5f237fe640 1 --2- 172.21.15.150:0/1862554175 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5f240d1670 0x7f5f2414f670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:49:52.218 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:52.215+0000 7f5f22ffd640 1 --2- 172.21.15.150:0/1862554175 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5f2406e8d0 0x7f5f2414c450 secure :-1 s=READY pgs=1202 cs=0 l=1 rev1=1 crypto rx=0x7f5f14034040 tx=0x7f5f140039e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:49:52.218 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:52.215+0000 7f5f0b7fe640 1 -- 172.21.15.150:0/1862554175 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f1403e030 con 0x7f5f2406e8d0 2024-09-17T05:49:52.218 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:52.215+0000 7f5f0b7fe640 1 -- 172.21.15.150:0/1862554175 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f5f140047a0 con 0x7f5f2406e8d0 2024-09-17T05:49:52.218 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:52.215+0000 7f5f293f1640 1 -- 172.21.15.150:0/1862554175 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5f2414cf80 con 0x7f5f2406e8d0 2024-09-17T05:49:52.219 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:52.215+0000 7f5f0b7fe640 1 -- 172.21.15.150:0/1862554175 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f14035040 con 0x7f5f2406e8d0 2024-09-17T05:49:52.219 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:52.215+0000 7f5f293f1640 1 -- 172.21.15.150:0/1862554175 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5f2414d540 con 0x7f5f2406e8d0 2024-09-17T05:49:52.220 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:52.216+0000 7f5f293f1640 1 -- 172.21.15.150:0/1862554175 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5f240d1130 con 0x7f5f2406e8d0 2024-09-17T05:49:52.220 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:52.217+0000 7f5f0b7fe640 1 -- 172.21.15.150:0/1862554175 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 32) ==== 103481+0+0 (secure 0 0 0) 0x7f5f14041030 con 0x7f5f2406e8d0 2024-09-17T05:49:52.220 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:52.217+0000 7f5f0b7fe640 1 --2- 172.21.15.150:0/1862554175 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f5f1007a210 0x7f5f1007c720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:49:52.220 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:52.217+0000 7f5f0b7fe640 1 -- 172.21.15.150:0/1862554175 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 5822+0+0 (secure 0 0 0) 0x7f5f140ba5a0 con 0x7f5f2406e8d0 2024-09-17T05:49:52.220 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:52.218+0000 7f5f227fc640 1 --2- 172.21.15.150:0/1862554175 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f5f1007a210 0x7f5f1007c720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:49:52.220 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:52.218+0000 7f5f227fc640 1 --2- 172.21.15.150:0/1862554175 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f5f1007a210 0x7f5f1007c720 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7f5f1800da90 tx=0x7f5f1800d470 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:49:52.223 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:52.221+0000 7f5f0b7fe640 1 -- 172.21.15.150:0/1862554175 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f5f14084650 con 0x7f5f2406e8d0 2024-09-17T05:49:52.429 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:52.427+0000 7f5f293f1640 1 -- 172.21.15.150:0/1862554175 --> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] -- mgr_command(tid 0: {"prefix": "fs subvolume rm", "force": true, "vol_name": "cephfs", "sub_name": "subvol_clone17383", "target": ["mon-mgr", ""]}) -- 0x7f5f240b9930 con 0x7f5f1007a210 2024-09-17T05:49:52.445 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:52.443+0000 7f5f0b7fe640 1 -- 172.21.15.150:0/1862554175 <== mgr.4108 v2:172.21.15.176:6800/3631216395 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f5f240b9930 con 0x7f5f1007a210 2024-09-17T05:49:52.447 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:52.445+0000 7f5f293f1640 1 -- 172.21.15.150:0/1862554175 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f5f1007a210 msgr2=0x7f5f1007c720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:49:52.448 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:52.445+0000 7f5f293f1640 1 --2- 172.21.15.150:0/1862554175 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f5f1007a210 0x7f5f1007c720 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7f5f1800da90 tx=0x7f5f1800d470 comp rx=0 tx=0).stop 2024-09-17T05:49:52.448 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:52.446+0000 7f5f293f1640 1 -- 172.21.15.150:0/1862554175 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5f2406e8d0 msgr2=0x7f5f2414c450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:49:52.448 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:52.446+0000 7f5f293f1640 1 --2- 172.21.15.150:0/1862554175 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5f2406e8d0 0x7f5f2414c450 secure :-1 s=READY pgs=1202 cs=0 l=1 rev1=1 crypto rx=0x7f5f14034040 tx=0x7f5f140039e0 comp rx=0 tx=0).stop 2024-09-17T05:49:52.448 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:52.446+0000 7f5f293f1640 1 -- 172.21.15.150:0/1862554175 shutdown_connections 2024-09-17T05:49:52.448 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:52.446+0000 7f5f293f1640 1 --2- 172.21.15.150:0/1862554175 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5f240d0d20 0x7f5f2414f130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:49:52.448 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:52.446+0000 7f5f293f1640 1 --2- 172.21.15.150:0/1862554175 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f5f1007a210 0x7f5f1007c720 unknown :-1 s=CLOSED pgs=515 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:49:52.448 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:52.446+0000 7f5f293f1640 1 --2- 172.21.15.150:0/1862554175 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5f240d1670 0x7f5f2414f670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:49:52.448 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:52.446+0000 7f5f293f1640 1 --2- 172.21.15.150:0/1862554175 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5f2406e8d0 0x7f5f2414c450 unknown :-1 s=CLOSED pgs=1202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:49:52.448 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:52.446+0000 7f5f293f1640 1 -- 172.21.15.150:0/1862554175 >> 172.21.15.150:0/1862554175 conn(0x7f5f240d46f0 msgr2=0x7f5f240b7520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:49:52.448 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:52.446+0000 7f5f293f1640 1 -- 172.21.15.150:0/1862554175 shutdown_connections 2024-09-17T05:49:52.448 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:52.446+0000 7f5f293f1640 1 -- 172.21.15.150:0/1862554175 wait complete. 2024-09-17T05:49:52.459 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume snapshot ls cephfs sv1 --format json 2024-09-17T05:49:52.577 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:52.575+0000 7fa79949d640 1 -- 172.21.15.150:0/3948626868 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa7940b5d20 msgr2=0x7fa7940af3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:49:52.577 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:52.575+0000 7fa79949d640 1 --2- 172.21.15.150:0/3948626868 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa7940b5d20 0x7fa7940af3f0 secure :-1 s=READY pgs=1204 cs=0 l=1 rev1=1 crypto rx=0x7fa78c005fd0 tx=0x7fa78c02a670 comp rx=0 tx=0).stop 2024-09-17T05:49:52.578 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:52.575+0000 7fa79949d640 1 -- 172.21.15.150:0/3948626868 shutdown_connections 2024-09-17T05:49:52.578 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:52.575+0000 7fa79949d640 1 --2- 172.21.15.150:0/3948626868 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa7940b5d20 0x7fa7940af3f0 unknown :-1 s=CLOSED pgs=1204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:49:52.578 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:52.575+0000 7fa79949d640 1 -- 172.21.15.150:0/3948626868 >> 172.21.15.150:0/3948626868 conn(0x7fa79409aa50 msgr2=0x7fa7940b2ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:49:52.578 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:52.575+0000 7fa79949d640 1 -- 172.21.15.150:0/3948626868 shutdown_connections 2024-09-17T05:49:52.578 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:52.575+0000 7fa79949d640 1 -- 172.21.15.150:0/3948626868 wait complete. 2024-09-17T05:49:52.578 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:52.577+0000 7fa79949d640 1 Processor -- start 2024-09-17T05:49:52.579 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:52.577+0000 7fa79949d640 1 -- start start 2024-09-17T05:49:52.582 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:52.579+0000 7fa79949d640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa7940b42f0 0x7fa7941f30a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:49:52.582 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:52.579+0000 7fa79949d640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa79415cfc0 0x7fa794153320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:49:52.582 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:52.579+0000 7fa79949d640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa794154080 0x7fa7940cf3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:49:52.582 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:52.579+0000 7fa79949d640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7fa7940afcc0 con 0x7fa79415cfc0 2024-09-17T05:49:52.582 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:52.579+0000 7fa79949d640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fa7940afb40 con 0x7fa794154080 2024-09-17T05:49:52.582 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:52.579+0000 7fa79949d640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fa7940afe40 con 0x7fa7940b42f0 2024-09-17T05:49:52.582 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:52.579+0000 7fa7927fc640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa79415cfc0 0x7fa794153320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:49:52.582 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:52.579+0000 7fa7927fc640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa79415cfc0 0x7fa794153320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:60414/0 (socket says 172.21.15.150:60414) 2024-09-17T05:49:52.582 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:52.579+0000 7fa7927fc640 1 -- 172.21.15.150:0/2179122476 learned_addr learned my addr 172.21.15.150:0/2179122476 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:49:52.582 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:52.579+0000 7fa792ffd640 1 --2- 172.21.15.150:0/2179122476 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa7940b42f0 0x7fa7941f30a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:49:52.583 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:52.579+0000 7fa7937fe640 1 --2- 172.21.15.150:0/2179122476 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa794154080 0x7fa7940cf3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:49:52.583 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:52.579+0000 7fa7927fc640 1 -- 172.21.15.150:0/2179122476 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa7940b42f0 msgr2=0x7fa7941f30a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:49:52.583 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:52.579+0000 7fa7927fc640 1 --2- 172.21.15.150:0/2179122476 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa7940b42f0 0x7fa7941f30a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:49:52.583 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:52.579+0000 7fa7927fc640 1 -- 172.21.15.150:0/2179122476 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa794154080 msgr2=0x7fa7940cf3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:49:52.583 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:52.579+0000 7fa7927fc640 1 --2- 172.21.15.150:0/2179122476 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa794154080 0x7fa7940cf3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:49:52.583 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:52.579+0000 7fa7927fc640 1 -- 172.21.15.150:0/2179122476 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa7940cd870 con 0x7fa79415cfc0 2024-09-17T05:49:52.583 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:52.579+0000 7fa7927fc640 1 --2- 172.21.15.150:0/2179122476 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa79415cfc0 0x7fa794153320 secure :-1 s=READY pgs=1205 cs=0 l=1 rev1=1 crypto rx=0x7fa78800c3f0 tx=0x7fa78800c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:49:52.583 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:52.579+0000 7fa77b7fe640 1 -- 172.21.15.150:0/2179122476 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa788017070 con 0x7fa79415cfc0 2024-09-17T05:49:52.583 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:52.579+0000 7fa77b7fe640 1 -- 172.21.15.150:0/2179122476 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa7880053e0 con 0x7fa79415cfc0 2024-09-17T05:49:52.583 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:52.579+0000 7fa79949d640 1 -- 172.21.15.150:0/2179122476 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa7940cdb50 con 0x7fa79415cfc0 2024-09-17T05:49:52.583 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:52.580+0000 7fa77b7fe640 1 -- 172.21.15.150:0/2179122476 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa788003870 con 0x7fa79415cfc0 2024-09-17T05:49:52.583 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:52.580+0000 7fa79949d640 1 -- 172.21.15.150:0/2179122476 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa7940ce110 con 0x7fa79415cfc0 2024-09-17T05:49:52.584 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:52.581+0000 7fa79949d640 1 -- 172.21.15.150:0/2179122476 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa7940b39b0 con 0x7fa79415cfc0 2024-09-17T05:49:52.584 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:52.582+0000 7fa77b7fe640 1 -- 172.21.15.150:0/2179122476 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 32) ==== 103481+0+0 (secure 0 0 0) 0x7fa78801a070 con 0x7fa79415cfc0 2024-09-17T05:49:52.585 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:52.582+0000 7fa77b7fe640 1 --2- 172.21.15.150:0/2179122476 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fa78007a210 0x7fa78007c720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:49:52.585 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:52.582+0000 7fa77b7fe640 1 -- 172.21.15.150:0/2179122476 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 5822+0+0 (secure 0 0 0) 0x7fa788098d30 con 0x7fa79415cfc0 2024-09-17T05:49:52.585 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:52.582+0000 7fa792ffd640 1 --2- 172.21.15.150:0/2179122476 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fa78007a210 0x7fa78007c720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:49:52.585 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:52.583+0000 7fa792ffd640 1 --2- 172.21.15.150:0/2179122476 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fa78007a210 0x7fa78007c720 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7fa784001e20 tx=0x7fa784009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:49:52.588 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:52.587+0000 7fa77b7fe640 1 -- 172.21.15.150:0/2179122476 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fa788062620 con 0x7fa79415cfc0 2024-09-17T05:49:52.799 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:52.797+0000 7fa79949d640 1 -- 172.21.15.150:0/2179122476 --> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] -- mgr_command(tid 0: {"prefix": "fs subvolume snapshot ls", "vol_name": "cephfs", "sub_name": "sv1", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fa7940af3d0 con 0x7fa78007a210 2024-09-17T05:49:52.810 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:52.807+0000 7fa77b7fe640 1 -- 172.21.15.150:0/2179122476 <== mgr.4108 v2:172.21.15.176:6800/3631216395 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+38 (secure 0 0 0) 0x7fa7940af3d0 con 0x7fa78007a210 2024-09-17T05:49:52.810 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-09-17T05:49:52.810 INFO:teuthology.orchestra.run.smithi150.stdout:[ 2024-09-17T05:49:52.810 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-09-17T05:49:52.810 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "ss1" 2024-09-17T05:49:52.811 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-09-17T05:49:52.811 INFO:teuthology.orchestra.run.smithi150.stdout:] 2024-09-17T05:49:52.811 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:52.809+0000 7fa79949d640 1 -- 172.21.15.150:0/2179122476 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fa78007a210 msgr2=0x7fa78007c720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:49:52.812 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:52.809+0000 7fa79949d640 1 --2- 172.21.15.150:0/2179122476 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fa78007a210 0x7fa78007c720 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7fa784001e20 tx=0x7fa784009040 comp rx=0 tx=0).stop 2024-09-17T05:49:52.812 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:52.809+0000 7fa79949d640 1 -- 172.21.15.150:0/2179122476 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa79415cfc0 msgr2=0x7fa794153320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:49:52.812 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:52.809+0000 7fa79949d640 1 --2- 172.21.15.150:0/2179122476 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa79415cfc0 0x7fa794153320 secure :-1 s=READY pgs=1205 cs=0 l=1 rev1=1 crypto rx=0x7fa78800c3f0 tx=0x7fa78800c8b0 comp rx=0 tx=0).stop 2024-09-17T05:49:52.812 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:52.809+0000 7fa79949d640 1 -- 172.21.15.150:0/2179122476 shutdown_connections 2024-09-17T05:49:52.812 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:52.809+0000 7fa79949d640 1 --2- 172.21.15.150:0/2179122476 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa794154080 0x7fa7940cf3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:49:52.812 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:52.809+0000 7fa79949d640 1 --2- 172.21.15.150:0/2179122476 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fa78007a210 0x7fa78007c720 unknown :-1 s=CLOSED pgs=516 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:49:52.812 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:52.809+0000 7fa79949d640 1 --2- 172.21.15.150:0/2179122476 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa79415cfc0 0x7fa794153320 unknown :-1 s=CLOSED pgs=1205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:49:52.812 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:52.809+0000 7fa79949d640 1 --2- 172.21.15.150:0/2179122476 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa7940b42f0 0x7fa7941f30a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:49:52.812 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:52.809+0000 7fa79949d640 1 -- 172.21.15.150:0/2179122476 >> 172.21.15.150:0/2179122476 conn(0x7fa79409aa50 msgr2=0x7fa794071540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:49:52.812 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:52.809+0000 7fa79949d640 1 -- 172.21.15.150:0/2179122476 shutdown_connections 2024-09-17T05:49:52.812 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:52.809+0000 7fa79949d640 1 -- 172.21.15.150:0/2179122476 wait complete. 2024-09-17T05:49:52.823 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume snapshot rm --force --format json cephfs sv1 ss1 2024-09-17T05:49:52.942 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:52.940+0000 7fad58739640 1 -- 172.21.15.150:0/1423078176 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fad50160200 msgr2=0x7fad500b4e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:49:52.942 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:52.940+0000 7fad58739640 1 --2- 172.21.15.150:0/1423078176 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fad50160200 0x7fad500b4e50 secure :-1 s=READY pgs=1207 cs=0 l=1 rev1=1 crypto rx=0x7fad500d23c0 tx=0x7fad4802a820 comp rx=0 tx=0).stop 2024-09-17T05:49:52.942 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:52.940+0000 7fad58739640 1 -- 172.21.15.150:0/1423078176 shutdown_connections 2024-09-17T05:49:52.942 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:52.940+0000 7fad58739640 1 --2- 172.21.15.150:0/1423078176 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fad50160200 0x7fad500b4e50 unknown :-1 s=CLOSED pgs=1207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:49:52.943 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:52.940+0000 7fad58739640 1 --2- 172.21.15.150:0/1423078176 >> v2:172.21.15.176:3300/0 conn(0x7fad500b6550 0x7fad500b24c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:49:52.943 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:52.940+0000 7fad58739640 1 -- 172.21.15.150:0/1423078176 >> 172.21.15.150:0/1423078176 conn(0x7fad500b2e80 msgr2=0x7fad500b3290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:49:52.943 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:52.940+0000 7fad58739640 1 -- 172.21.15.150:0/1423078176 shutdown_connections 2024-09-17T05:49:52.943 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:52.940+0000 7fad58739640 1 -- 172.21.15.150:0/1423078176 wait complete. 2024-09-17T05:49:52.943 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:52.942+0000 7fad58739640 1 Processor -- start 2024-09-17T05:49:52.944 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:52.942+0000 7fad58739640 1 -- start start 2024-09-17T05:49:52.946 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:52.943+0000 7fad58739640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fad500b2a00 0x7fad50152110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:49:52.946 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:52.943+0000 7fad58739640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fad500b6550 0x7fad5015e8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:49:52.946 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:52.943+0000 7fad58739640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fad50160200 0x7fad5015ee10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:49:52.947 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:52.943+0000 7fad58739640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7fad50160790 con 0x7fad50160200 2024-09-17T05:49:52.947 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:52.943+0000 7fad58739640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fad50160610 con 0x7fad500b6550 2024-09-17T05:49:52.947 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:52.943+0000 7fad58739640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fad50160910 con 0x7fad500b2a00 2024-09-17T05:49:52.947 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:52.943+0000 7fad56cd6640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fad50160200 0x7fad5015ee10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:49:52.947 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:52.944+0000 7fad56cd6640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fad50160200 0x7fad5015ee10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:60440/0 (socket says 172.21.15.150:60440) 2024-09-17T05:49:52.947 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:52.944+0000 7fad56cd6640 1 -- 172.21.15.150:0/229191681 learned_addr learned my addr 172.21.15.150:0/229191681 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:49:52.947 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:52.944+0000 7fad564d5640 1 --2- 172.21.15.150:0/229191681 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fad500b2a00 0x7fad50152110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:49:52.947 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:52.944+0000 7fad55cd4640 1 --2- 172.21.15.150:0/229191681 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fad500b6550 0x7fad5015e8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:49:52.947 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:52.944+0000 7fad56cd6640 1 -- 172.21.15.150:0/229191681 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fad500b2a00 msgr2=0x7fad50152110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:49:52.947 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:52.944+0000 7fad56cd6640 1 --2- 172.21.15.150:0/229191681 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fad500b2a00 0x7fad50152110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:49:52.947 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:52.944+0000 7fad56cd6640 1 -- 172.21.15.150:0/229191681 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fad500b6550 msgr2=0x7fad5015e8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:49:52.947 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:52.944+0000 7fad56cd6640 1 --2- 172.21.15.150:0/229191681 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fad500b6550 0x7fad5015e8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:49:52.947 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:52.944+0000 7fad56cd6640 1 -- 172.21.15.150:0/229191681 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fad501f5d30 con 0x7fad50160200 2024-09-17T05:49:52.948 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:52.944+0000 7fad564d5640 1 --2- 172.21.15.150:0/229191681 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fad500b2a00 0x7fad50152110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T05:49:52.948 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:52.944+0000 7fad55cd4640 1 --2- 172.21.15.150:0/229191681 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fad500b6550 0x7fad5015e8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T05:49:52.948 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:52.944+0000 7fad56cd6640 1 --2- 172.21.15.150:0/229191681 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fad50160200 0x7fad5015ee10 secure :-1 s=READY pgs=1208 cs=0 l=1 rev1=1 crypto rx=0x7fad48009ca0 tx=0x7fad48032d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:49:52.948 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:52.944+0000 7fad46ffd640 1 -- 172.21.15.150:0/229191681 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad48037040 con 0x7fad50160200 2024-09-17T05:49:52.948 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:52.944+0000 7fad46ffd640 1 -- 172.21.15.150:0/229191681 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fad48042070 con 0x7fad50160200 2024-09-17T05:49:52.948 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:52.944+0000 7fad58739640 1 -- 172.21.15.150:0/229191681 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fad501f6010 con 0x7fad50160200 2024-09-17T05:49:52.948 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:52.944+0000 7fad46ffd640 1 -- 172.21.15.150:0/229191681 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad48003e60 con 0x7fad50160200 2024-09-17T05:49:52.948 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:52.944+0000 7fad58739640 1 -- 172.21.15.150:0/229191681 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fad501f65d0 con 0x7fad50160200 2024-09-17T05:49:52.949 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:52.945+0000 7fad58739640 1 -- 172.21.15.150:0/229191681 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fad5006f9a0 con 0x7fad50160200 2024-09-17T05:49:52.949 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:52.946+0000 7fad46ffd640 1 -- 172.21.15.150:0/229191681 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 32) ==== 103481+0+0 (secure 0 0 0) 0x7fad480042a0 con 0x7fad50160200 2024-09-17T05:49:52.949 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:52.947+0000 7fad46ffd640 1 --2- 172.21.15.150:0/229191681 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fad3407a240 0x7fad3407c750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:49:52.949 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:52.947+0000 7fad46ffd640 1 -- 172.21.15.150:0/229191681 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 5822+0+0 (secure 0 0 0) 0x7fad480ba850 con 0x7fad50160200 2024-09-17T05:49:52.949 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:52.947+0000 7fad564d5640 1 --2- 172.21.15.150:0/229191681 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fad3407a240 0x7fad3407c750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:49:52.949 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:52.947+0000 7fad564d5640 1 --2- 172.21.15.150:0/229191681 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fad3407a240 0x7fad3407c750 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7fad4c009ab0 tx=0x7fad4c005f90 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:49:52.953 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:52.951+0000 7fad46ffd640 1 -- 172.21.15.150:0/229191681 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fad5006f9a0 con 0x7fad50160200 2024-09-17T05:49:53.180 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:53.179+0000 7fad58739640 1 -- 172.21.15.150:0/229191681 --> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] -- mgr_command(tid 0: {"prefix": "fs subvolume snapshot rm", "force": true, "vol_name": "cephfs", "sub_name": "sv1", "snap_name": "ss1", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fad501f5ae0 con 0x7fad3407a240 2024-09-17T05:49:53.232 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:53.230+0000 7fad46ffd640 1 -- 172.21.15.150:0/229191681 <== mgr.4108 v2:172.21.15.176:6800/3631216395 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7fad501f5ae0 con 0x7fad3407a240 2024-09-17T05:49:53.232 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-09-17T05:49:53.235 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:53.233+0000 7fad58739640 1 -- 172.21.15.150:0/229191681 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fad3407a240 msgr2=0x7fad3407c750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:49:53.235 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:53.233+0000 7fad58739640 1 --2- 172.21.15.150:0/229191681 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fad3407a240 0x7fad3407c750 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7fad4c009ab0 tx=0x7fad4c005f90 comp rx=0 tx=0).stop 2024-09-17T05:49:53.235 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:53.233+0000 7fad58739640 1 -- 172.21.15.150:0/229191681 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fad50160200 msgr2=0x7fad5015ee10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:49:53.235 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:53.233+0000 7fad58739640 1 --2- 172.21.15.150:0/229191681 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fad50160200 0x7fad5015ee10 secure :-1 s=READY pgs=1208 cs=0 l=1 rev1=1 crypto rx=0x7fad48009ca0 tx=0x7fad48032d10 comp rx=0 tx=0).stop 2024-09-17T05:49:53.235 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:53.233+0000 7fad58739640 1 -- 172.21.15.150:0/229191681 shutdown_connections 2024-09-17T05:49:53.235 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:53.233+0000 7fad58739640 1 --2- 172.21.15.150:0/229191681 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fad500b6550 0x7fad5015e8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:49:53.235 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:53.233+0000 7fad58739640 1 --2- 172.21.15.150:0/229191681 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fad3407a240 0x7fad3407c750 unknown :-1 s=CLOSED pgs=517 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:49:53.235 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:53.233+0000 7fad58739640 1 --2- 172.21.15.150:0/229191681 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fad50160200 0x7fad5015ee10 unknown :-1 s=CLOSED pgs=1208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:49:53.236 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:53.233+0000 7fad58739640 1 --2- 172.21.15.150:0/229191681 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fad500b2a00 0x7fad50152110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:49:53.236 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:53.233+0000 7fad58739640 1 -- 172.21.15.150:0/229191681 >> 172.21.15.150:0/229191681 conn(0x7fad500b2e80 msgr2=0x7fad500cef40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:49:53.236 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:53.234+0000 7fad58739640 1 -- 172.21.15.150:0/229191681 shutdown_connections 2024-09-17T05:49:53.236 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:53.234+0000 7fad58739640 1 -- 172.21.15.150:0/229191681 wait complete. 2024-09-17T05:49:53.252 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume rm cephfs sv1 2024-09-17T05:49:53.420 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:53.418+0000 7fa34b5df640 1 -- 172.21.15.150:0/1136453700 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa3440cfab0 msgr2=0x7fa344073630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:49:53.421 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:53.418+0000 7fa34b5df640 1 --2- 172.21.15.150:0/1136453700 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa3440cfab0 0x7fa344073630 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7fa334005fd0 tx=0x7fa33402a4a0 comp rx=0 tx=0).stop 2024-09-17T05:49:53.421 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:53.419+0000 7fa34b5df640 1 -- 172.21.15.150:0/1136453700 shutdown_connections 2024-09-17T05:49:53.421 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:53.419+0000 7fa34b5df640 1 --2- 172.21.15.150:0/1136453700 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa3440cfab0 0x7fa344073630 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:49:53.421 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:53.419+0000 7fa34b5df640 1 --2- 172.21.15.150:0/1136453700 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa3440ccc50 0x7fa3440cf570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:49:53.421 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:53.419+0000 7fa34b5df640 1 -- 172.21.15.150:0/1136453700 >> 172.21.15.150:0/1136453700 conn(0x7fa34406d1c0 msgr2=0x7fa34406d5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:49:53.421 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:53.419+0000 7fa34b5df640 1 -- 172.21.15.150:0/1136453700 shutdown_connections 2024-09-17T05:49:53.421 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:53.419+0000 7fa34b5df640 1 -- 172.21.15.150:0/1136453700 wait complete. 2024-09-17T05:49:53.423 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:53.421+0000 7fa34b5df640 1 Processor -- start 2024-09-17T05:49:53.423 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:53.421+0000 7fa34b5df640 1 -- start start 2024-09-17T05:49:53.425 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:53.423+0000 7fa34b5df640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa344073b70 0x7fa344145d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:49:53.425 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:53.423+0000 7fa34b5df640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa3440ccc50 0x7fa3441f9db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:49:53.425 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:53.424+0000 7fa34b5df640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa3440cfab0 0x7fa34406f5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:49:53.425 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:53.424+0000 7fa34937b640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa344073b70 0x7fa344145d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:49:53.425 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:53.424+0000 7fa34937b640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa344073b70 0x7fa344145d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:60444/0 (socket says 172.21.15.150:60444) 2024-09-17T05:49:53.425 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:53.424+0000 7fa348b7a640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa3440ccc50 0x7fa3441f9db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:49:53.426 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:53.424+0000 7fa34937b640 1 -- 172.21.15.150:0/795022121 learned_addr learned my addr 172.21.15.150:0/795022121 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:49:53.426 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:53.424+0000 7fa34b5df640 1 -- 172.21.15.150:0/795022121 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7fa34415fa00 con 0x7fa344073b70 2024-09-17T05:49:53.426 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:53.424+0000 7fa34b5df640 1 -- 172.21.15.150:0/795022121 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fa34415f880 con 0x7fa3440cfab0 2024-09-17T05:49:53.426 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:53.424+0000 7fa34b5df640 1 -- 172.21.15.150:0/795022121 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fa34415fb80 con 0x7fa3440ccc50 2024-09-17T05:49:53.426 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:53.424+0000 7fa349b7c640 1 --2- 172.21.15.150:0/795022121 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa3440cfab0 0x7fa34406f5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:49:53.426 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:53.424+0000 7fa34937b640 1 -- 172.21.15.150:0/795022121 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa3440ccc50 msgr2=0x7fa3441f9db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:49:53.426 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:53.424+0000 7fa34937b640 1 --2- 172.21.15.150:0/795022121 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa3440ccc50 0x7fa3441f9db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:49:53.426 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:53.424+0000 7fa34937b640 1 -- 172.21.15.150:0/795022121 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa3440cfab0 msgr2=0x7fa34406f5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:49:53.427 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:53.424+0000 7fa34937b640 1 --2- 172.21.15.150:0/795022121 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa3440cfab0 0x7fa34406f5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:49:53.427 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:53.424+0000 7fa34937b640 1 -- 172.21.15.150:0/795022121 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa344146560 con 0x7fa344073b70 2024-09-17T05:49:53.427 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:53.424+0000 7fa349b7c640 1 --2- 172.21.15.150:0/795022121 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa3440cfab0 0x7fa34406f5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T05:49:53.427 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:53.425+0000 7fa34937b640 1 --2- 172.21.15.150:0/795022121 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa344073b70 0x7fa344145d00 secure :-1 s=READY pgs=1209 cs=0 l=1 rev1=1 crypto rx=0x7fa34000e790 tx=0x7fa34000ec50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:49:53.427 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:53.425+0000 7fa339ffb640 1 -- 172.21.15.150:0/795022121 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa34000eea0 con 0x7fa344073b70 2024-09-17T05:49:53.427 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:53.425+0000 7fa339ffb640 1 -- 172.21.15.150:0/795022121 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa34000cdb0 con 0x7fa344073b70 2024-09-17T05:49:53.427 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:53.425+0000 7fa34b5df640 1 -- 172.21.15.150:0/795022121 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa344146840 con 0x7fa344073b70 2024-09-17T05:49:53.428 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:53.426+0000 7fa34b5df640 1 -- 172.21.15.150:0/795022121 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa344146e00 con 0x7fa344073b70 2024-09-17T05:49:53.428 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:53.426+0000 7fa339ffb640 1 -- 172.21.15.150:0/795022121 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa340010690 con 0x7fa344073b70 2024-09-17T05:49:53.429 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:53.428+0000 7fa34b5df640 1 -- 172.21.15.150:0/795022121 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa324005290 con 0x7fa344073b70 2024-09-17T05:49:53.430 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:53.429+0000 7fa339ffb640 1 -- 172.21.15.150:0/795022121 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 32) ==== 103481+0+0 (secure 0 0 0) 0x7fa340010830 con 0x7fa344073b70 2024-09-17T05:49:53.431 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:53.429+0000 7fa339ffb640 1 --2- 172.21.15.150:0/795022121 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fa32807a210 0x7fa32807c720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:49:53.431 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:53.430+0000 7fa339ffb640 1 -- 172.21.15.150:0/795022121 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 5822+0+0 (secure 0 0 0) 0x7fa34009a3d0 con 0x7fa344073b70 2024-09-17T05:49:53.432 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:53.430+0000 7fa348b7a640 1 --2- 172.21.15.150:0/795022121 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fa32807a210 0x7fa32807c720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:49:53.433 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:53.431+0000 7fa348b7a640 1 --2- 172.21.15.150:0/795022121 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fa32807a210 0x7fa32807c720 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7fa334033000 tx=0x7fa334004730 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:49:53.439 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:53.437+0000 7fa339ffb640 1 -- 172.21.15.150:0/795022121 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fa340063c20 con 0x7fa344073b70 2024-09-17T05:49:53.787 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:53.785+0000 7fa34b5df640 1 -- 172.21.15.150:0/795022121 --> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] -- mgr_command(tid 0: {"prefix": "fs subvolume rm", "vol_name": "cephfs", "sub_name": "sv1", "target": ["mon-mgr", ""]}) -- 0x7fa324000bc0 con 0x7fa32807a210 2024-09-17T05:49:53.810 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:53.808+0000 7fa339ffb640 1 -- 172.21.15.150:0/795022121 <== mgr.4108 v2:172.21.15.176:6800/3631216395 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7fa324000bc0 con 0x7fa32807a210 2024-09-17T05:49:53.814 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:53.812+0000 7fa34b5df640 1 -- 172.21.15.150:0/795022121 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fa32807a210 msgr2=0x7fa32807c720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:49:53.814 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:53.812+0000 7fa34b5df640 1 --2- 172.21.15.150:0/795022121 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fa32807a210 0x7fa32807c720 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7fa334033000 tx=0x7fa334004730 comp rx=0 tx=0).stop 2024-09-17T05:49:53.814 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:53.812+0000 7fa34b5df640 1 -- 172.21.15.150:0/795022121 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa344073b70 msgr2=0x7fa344145d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:49:53.814 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:53.812+0000 7fa34b5df640 1 --2- 172.21.15.150:0/795022121 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa344073b70 0x7fa344145d00 secure :-1 s=READY pgs=1209 cs=0 l=1 rev1=1 crypto rx=0x7fa34000e790 tx=0x7fa34000ec50 comp rx=0 tx=0).stop 2024-09-17T05:49:53.815 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:53.812+0000 7fa34b5df640 1 -- 172.21.15.150:0/795022121 shutdown_connections 2024-09-17T05:49:53.815 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:53.812+0000 7fa34b5df640 1 --2- 172.21.15.150:0/795022121 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa3440cfab0 0x7fa34406f5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:49:53.815 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:53.812+0000 7fa34b5df640 1 --2- 172.21.15.150:0/795022121 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fa32807a210 0x7fa32807c720 unknown :-1 s=CLOSED pgs=518 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:49:53.815 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:53.812+0000 7fa34b5df640 1 --2- 172.21.15.150:0/795022121 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa3440ccc50 0x7fa3441f9db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:49:53.815 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:53.812+0000 7fa34b5df640 1 --2- 172.21.15.150:0/795022121 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa344073b70 0x7fa344145d00 unknown :-1 s=CLOSED pgs=1209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:49:53.815 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:53.812+0000 7fa34b5df640 1 -- 172.21.15.150:0/795022121 >> 172.21.15.150:0/795022121 conn(0x7fa34406d1c0 msgr2=0x7fa3440b4fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:49:53.815 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:53.812+0000 7fa34b5df640 1 -- 172.21.15.150:0/795022121 shutdown_connections 2024-09-17T05:49:53.815 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:53.812+0000 7fa34b5df640 1 -- 172.21.15.150:0/795022121 wait complete. 2024-09-17T05:49:53.829 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume rm --force cephfs subvol_clone310410 2024-09-17T05:49:53.995 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:53.993+0000 7f0422694640 1 -- 172.21.15.150:0/3878581467 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f041c0b5d20 msgr2=0x7f041c0af3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:49:53.995 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:53.993+0000 7f0422694640 1 --2- 172.21.15.150:0/3878581467 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f041c0b5d20 0x7f041c0af3f0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f0414009ca0 tx=0x7f041402a9e0 comp rx=0 tx=0).stop 2024-09-17T05:49:53.995 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:53.993+0000 7f0422694640 1 -- 172.21.15.150:0/3878581467 shutdown_connections 2024-09-17T05:49:53.996 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:53.993+0000 7f0422694640 1 --2- 172.21.15.150:0/3878581467 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f041c0b5d20 0x7f041c0af3f0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:49:53.996 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:53.993+0000 7f0422694640 1 -- 172.21.15.150:0/3878581467 >> 172.21.15.150:0/3878581467 conn(0x7f041c09aa50 msgr2=0x7f041c0b2ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:49:53.996 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:53.993+0000 7f0422694640 1 -- 172.21.15.150:0/3878581467 shutdown_connections 2024-09-17T05:49:53.996 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:53.993+0000 7f0422694640 1 -- 172.21.15.150:0/3878581467 wait complete. 2024-09-17T05:49:53.997 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:53.996+0000 7f0422694640 1 Processor -- start 2024-09-17T05:49:53.998 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:53.996+0000 7f0422694640 1 -- start start 2024-09-17T05:49:54.001 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:53.998+0000 7f0422694640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f041c0b42f0 0x7f041c145d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:49:54.002 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:53.999+0000 7f0422694640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f041c15cfc0 0x7f041c0b1350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:49:54.002 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:53.999+0000 7f0422694640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f041c14ff40 0x7f041c0b1890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:49:54.002 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:53.999+0000 7f0422694640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f041c0afcc0 con 0x7f041c0b42f0 2024-09-17T05:49:54.002 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:53.999+0000 7f0422694640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f041c0afb40 con 0x7f041c14ff40 2024-09-17T05:49:54.002 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:53.999+0000 7f0422694640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f041c0afe40 con 0x7f041c15cfc0 2024-09-17T05:49:54.002 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:53.999+0000 7f041bfff640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f041c0b42f0 0x7f041c145d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:49:54.002 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:53.999+0000 7f041bfff640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f041c0b42f0 0x7f041c145d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:60454/0 (socket says 172.21.15.150:60454) 2024-09-17T05:49:54.002 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:53.999+0000 7f041bfff640 1 -- 172.21.15.150:0/3218192585 learned_addr learned my addr 172.21.15.150:0/3218192585 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:49:54.002 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:53.999+0000 7f041b7fe640 1 --2- 172.21.15.150:0/3218192585 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f041c15cfc0 0x7f041c0b1350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:49:54.002 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:53.999+0000 7f0420c31640 1 --2- 172.21.15.150:0/3218192585 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f041c14ff40 0x7f041c0b1890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:49:54.002 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:53.999+0000 7f041bfff640 1 -- 172.21.15.150:0/3218192585 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f041c15cfc0 msgr2=0x7f041c0b1350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:49:54.003 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:53.999+0000 7f041bfff640 1 --2- 172.21.15.150:0/3218192585 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f041c15cfc0 0x7f041c0b1350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:49:54.003 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:53.999+0000 7f041bfff640 1 -- 172.21.15.150:0/3218192585 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f041c14ff40 msgr2=0x7f041c0b1890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:49:54.003 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:53.999+0000 7f041bfff640 1 --2- 172.21.15.150:0/3218192585 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f041c14ff40 0x7f041c0b1890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:49:54.003 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:53.999+0000 7f041bfff640 1 -- 172.21.15.150:0/3218192585 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f041c1f1a80 con 0x7f041c0b42f0 2024-09-17T05:49:54.003 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:53.999+0000 7f041bfff640 1 --2- 172.21.15.150:0/3218192585 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f041c0b42f0 0x7f041c145d70 secure :-1 s=READY pgs=1211 cs=0 l=1 rev1=1 crypto rx=0x7f040c00b3f0 tx=0x7f040c00b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:49:54.003 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:54.000+0000 7f0418ff9640 1 -- 172.21.15.150:0/3218192585 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f040c015020 con 0x7f041c0b42f0 2024-09-17T05:49:54.003 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:54.000+0000 7f0418ff9640 1 -- 172.21.15.150:0/3218192585 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f040c011920 con 0x7f041c0b42f0 2024-09-17T05:49:54.003 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:54.000+0000 7f0418ff9640 1 -- 172.21.15.150:0/3218192585 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f040c011d70 con 0x7f041c0b42f0 2024-09-17T05:49:54.004 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:54.001+0000 7f0422694640 1 -- 172.21.15.150:0/3218192585 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f041c154ac0 con 0x7f041c0b42f0 2024-09-17T05:49:54.004 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:54.001+0000 7f0422694640 1 -- 172.21.15.150:0/3218192585 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f041c152030 con 0x7f041c0b42f0 2024-09-17T05:49:54.004 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:54.002+0000 7f0422694640 1 -- 172.21.15.150:0/3218192585 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f041c0b39b0 con 0x7f041c0b42f0 2024-09-17T05:49:54.005 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:54.003+0000 7f0418ff9640 1 -- 172.21.15.150:0/3218192585 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 32) ==== 103481+0+0 (secure 0 0 0) 0x7f040c018020 con 0x7f041c0b42f0 2024-09-17T05:49:54.005 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:54.004+0000 7f0418ff9640 1 --2- 172.21.15.150:0/3218192585 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f040807a240 0x7f040807c750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:49:54.005 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:54.004+0000 7f0418ff9640 1 -- 172.21.15.150:0/3218192585 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 5822+0+0 (secure 0 0 0) 0x7f040c099910 con 0x7f041c0b42f0 2024-09-17T05:49:54.006 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:54.004+0000 7f041b7fe640 1 --2- 172.21.15.150:0/3218192585 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f040807a240 0x7f040807c750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:49:54.006 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:54.005+0000 7f041b7fe640 1 --2- 172.21.15.150:0/3218192585 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f040807a240 0x7f040807c750 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f041c15a180 tx=0x7f0410009060 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:49:54.013 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:54.012+0000 7f0418ff9640 1 -- 172.21.15.150:0/3218192585 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f040c01f020 con 0x7f041c0b42f0 2024-09-17T05:49:54.350 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:54.349+0000 7f0422694640 1 -- 172.21.15.150:0/3218192585 --> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] -- mgr_command(tid 0: {"prefix": "fs subvolume rm", "force": true, "vol_name": "cephfs", "sub_name": "subvol_clone310410", "target": ["mon-mgr", ""]}) -- 0x7f041c154590 con 0x7f040807a240 2024-09-17T05:49:54.376 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:54.375+0000 7f0418ff9640 1 -- 172.21.15.150:0/3218192585 <== mgr.4108 v2:172.21.15.176:6800/3631216395 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f041c154590 con 0x7f040807a240 2024-09-17T05:49:54.379 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:54.377+0000 7f0422694640 1 -- 172.21.15.150:0/3218192585 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f040807a240 msgr2=0x7f040807c750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:49:54.379 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:54.377+0000 7f0422694640 1 --2- 172.21.15.150:0/3218192585 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f040807a240 0x7f040807c750 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f041c15a180 tx=0x7f0410009060 comp rx=0 tx=0).stop 2024-09-17T05:49:54.380 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:54.377+0000 7f0422694640 1 -- 172.21.15.150:0/3218192585 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f041c0b42f0 msgr2=0x7f041c145d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:49:54.380 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:54.377+0000 7f0422694640 1 --2- 172.21.15.150:0/3218192585 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f041c0b42f0 0x7f041c145d70 secure :-1 s=READY pgs=1211 cs=0 l=1 rev1=1 crypto rx=0x7f040c00b3f0 tx=0x7f040c00b8b0 comp rx=0 tx=0).stop 2024-09-17T05:49:54.380 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:54.377+0000 7f0422694640 1 -- 172.21.15.150:0/3218192585 shutdown_connections 2024-09-17T05:49:54.380 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:54.378+0000 7f0422694640 1 --2- 172.21.15.150:0/3218192585 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f041c14ff40 0x7f041c0b1890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:49:54.380 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:54.378+0000 7f0422694640 1 --2- 172.21.15.150:0/3218192585 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f040807a240 0x7f040807c750 unknown :-1 s=CLOSED pgs=519 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:49:54.380 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:54.378+0000 7f0422694640 1 --2- 172.21.15.150:0/3218192585 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f041c15cfc0 0x7f041c0b1350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:49:54.380 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:54.378+0000 7f0422694640 1 --2- 172.21.15.150:0/3218192585 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f041c0b42f0 0x7f041c145d70 unknown :-1 s=CLOSED pgs=1211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:49:54.380 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:54.378+0000 7f0422694640 1 -- 172.21.15.150:0/3218192585 >> 172.21.15.150:0/3218192585 conn(0x7f041c09aa50 msgr2=0x7f041c0b3000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:49:54.380 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:54.378+0000 7f0422694640 1 -- 172.21.15.150:0/3218192585 shutdown_connections 2024-09-17T05:49:54.380 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:54.378+0000 7f0422694640 1 -- 172.21.15.150:0/3218192585 wait complete. 2024-09-17T05:49:54.396 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume rm --force cephfs subvol_clone941013 2024-09-17T05:49:54.565 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:54.563+0000 7f5f1e471640 1 -- 172.21.15.150:0/2262405025 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5f180b5610 msgr2=0x7f5f180b5a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:49:54.565 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:54.563+0000 7f5f1e471640 1 --2- 172.21.15.150:0/2262405025 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5f180b5610 0x7f5f180b5a20 secure :-1 s=READY pgs=1212 cs=0 l=1 rev1=1 crypto rx=0x7f5f180d24a0 tx=0x7f5f1002aa30 comp rx=0 tx=0).stop 2024-09-17T05:49:54.565 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:54.564+0000 7f5f1e471640 1 -- 172.21.15.150:0/2262405025 shutdown_connections 2024-09-17T05:49:54.566 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:54.564+0000 7f5f1e471640 1 --2- 172.21.15.150:0/2262405025 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5f180b5610 0x7f5f180b5a20 unknown :-1 s=CLOSED pgs=1212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:49:54.566 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:54.564+0000 7f5f1e471640 1 --2- 172.21.15.150:0/2262405025 >> v2:172.21.15.176:3300/0 conn(0x7f5f1815ba80 0x7f5f1815be90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:49:54.566 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:54.564+0000 7f5f1e471640 1 --2- 172.21.15.150:0/2262405025 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5f180b42f0 0x7f5f1815cfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:49:54.566 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:54.564+0000 7f5f1e471640 1 -- 172.21.15.150:0/2262405025 >> 172.21.15.150:0/2262405025 conn(0x7f5f1809aa50 msgr2=0x7f5f180b2ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:49:54.566 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:54.564+0000 7f5f1e471640 1 -- 172.21.15.150:0/2262405025 shutdown_connections 2024-09-17T05:49:54.566 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:54.564+0000 7f5f1e471640 1 -- 172.21.15.150:0/2262405025 wait complete. 2024-09-17T05:49:54.568 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:54.567+0000 7f5f1e471640 1 Processor -- start 2024-09-17T05:49:54.569 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:54.567+0000 7f5f1e471640 1 -- start start 2024-09-17T05:49:54.572 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:54.569+0000 7f5f1e471640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5f180b42f0 0x7f5f181541a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:49:54.572 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:54.569+0000 7f5f1e471640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5f180b5610 0x7f5f181fa2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:49:54.572 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:54.569+0000 7f5f1e471640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5f1815ba80 0x7f5f1814de80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:49:54.572 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:54.569+0000 7f5f1e471640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f5f180af890 con 0x7f5f180b42f0 2024-09-17T05:49:54.572 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:54.569+0000 7f5f1e471640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f5f180af710 con 0x7f5f180b5610 2024-09-17T05:49:54.572 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:54.569+0000 7f5f1e471640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f5f180afa10 con 0x7f5f1815ba80 2024-09-17T05:49:54.572 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:54.569+0000 7f5f17fff640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5f180b42f0 0x7f5f181541a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:49:54.572 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:54.569+0000 7f5f17fff640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5f180b42f0 0x7f5f181541a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:60468/0 (socket says 172.21.15.150:60468) 2024-09-17T05:49:54.572 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:54.569+0000 7f5f17fff640 1 -- 172.21.15.150:0/2893281065 learned_addr learned my addr 172.21.15.150:0/2893281065 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:49:54.572 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:54.569+0000 7f5f1ca0e640 1 --2- 172.21.15.150:0/2893281065 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5f1815ba80 0x7f5f1814de80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:49:54.573 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:54.569+0000 7f5f177fe640 1 --2- 172.21.15.150:0/2893281065 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5f180b5610 0x7f5f181fa2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:49:54.573 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:54.570+0000 7f5f17fff640 1 -- 172.21.15.150:0/2893281065 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5f1815ba80 msgr2=0x7f5f1814de80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:49:54.573 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:54.570+0000 7f5f17fff640 1 --2- 172.21.15.150:0/2893281065 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5f1815ba80 0x7f5f1814de80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:49:54.573 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:54.570+0000 7f5f17fff640 1 -- 172.21.15.150:0/2893281065 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5f180b5610 msgr2=0x7f5f181fa2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:49:54.573 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:54.570+0000 7f5f17fff640 1 --2- 172.21.15.150:0/2893281065 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5f180b5610 0x7f5f181fa2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:49:54.573 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:54.570+0000 7f5f17fff640 1 -- 172.21.15.150:0/2893281065 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5f180ceea0 con 0x7f5f180b42f0 2024-09-17T05:49:54.573 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:54.570+0000 7f5f17fff640 1 --2- 172.21.15.150:0/2893281065 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5f180b42f0 0x7f5f181541a0 secure :-1 s=READY pgs=1213 cs=0 l=1 rev1=1 crypto rx=0x7f5f0c00e710 tx=0x7f5f0c00ebd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:49:54.573 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:54.570+0000 7f5f14ff9640 1 -- 172.21.15.150:0/2893281065 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f0c00cab0 con 0x7f5f180b42f0 2024-09-17T05:49:54.573 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:54.570+0000 7f5f14ff9640 1 -- 172.21.15.150:0/2893281065 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f5f0c00cd40 con 0x7f5f180b42f0 2024-09-17T05:49:54.573 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:54.570+0000 7f5f14ff9640 1 -- 172.21.15.150:0/2893281065 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f0c010690 con 0x7f5f180b42f0 2024-09-17T05:49:54.573 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:54.570+0000 7f5f1e471640 1 -- 172.21.15.150:0/2893281065 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5f180cf180 con 0x7f5f180b42f0 2024-09-17T05:49:54.573 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:54.570+0000 7f5f1e471640 1 -- 172.21.15.150:0/2893281065 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5f180cf740 con 0x7f5f180b42f0 2024-09-17T05:49:54.574 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:54.571+0000 7f5f1e471640 1 -- 172.21.15.150:0/2893281065 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5f180b37a0 con 0x7f5f180b42f0 2024-09-17T05:49:54.574 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:54.573+0000 7f5f14ff9640 1 -- 172.21.15.150:0/2893281065 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 32) ==== 103481+0+0 (secure 0 0 0) 0x7f5f0c010a40 con 0x7f5f180b42f0 2024-09-17T05:49:54.575 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:54.573+0000 7f5f14ff9640 1 --2- 172.21.15.150:0/2893281065 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f5f0407a210 0x7f5f0407c720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:49:54.575 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:54.574+0000 7f5f14ff9640 1 -- 172.21.15.150:0/2893281065 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 5822+0+0 (secure 0 0 0) 0x7f5f0c09a540 con 0x7f5f180b42f0 2024-09-17T05:49:54.575 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:54.574+0000 7f5f177fe640 1 --2- 172.21.15.150:0/2893281065 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f5f0407a210 0x7f5f0407c720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:49:54.576 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:54.574+0000 7f5f177fe640 1 --2- 172.21.15.150:0/2893281065 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f5f0407a210 0x7f5f0407c720 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7f5f18154150 tx=0x7f5f0800b2e0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:49:54.583 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:54.581+0000 7f5f14ff9640 1 -- 172.21.15.150:0/2893281065 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f5f180b37a0 con 0x7f5f180b42f0 2024-09-17T05:49:54.947 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:54.945+0000 7f5f1e471640 1 -- 172.21.15.150:0/2893281065 --> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] -- mgr_command(tid 0: {"prefix": "fs subvolume rm", "force": true, "vol_name": "cephfs", "sub_name": "subvol_clone941013", "target": ["mon-mgr", ""]}) -- 0x7f5f180703a0 con 0x7f5f0407a210 2024-09-17T05:49:54.975 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:54.973+0000 7f5f14ff9640 1 -- 172.21.15.150:0/2893281065 <== mgr.4108 v2:172.21.15.176:6800/3631216395 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f5f180703a0 con 0x7f5f0407a210 2024-09-17T05:49:54.978 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:54.977+0000 7f5f1e471640 1 -- 172.21.15.150:0/2893281065 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f5f0407a210 msgr2=0x7f5f0407c720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:49:54.979 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:54.977+0000 7f5f1e471640 1 --2- 172.21.15.150:0/2893281065 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f5f0407a210 0x7f5f0407c720 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7f5f18154150 tx=0x7f5f0800b2e0 comp rx=0 tx=0).stop 2024-09-17T05:49:54.979 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:54.977+0000 7f5f1e471640 1 -- 172.21.15.150:0/2893281065 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5f180b42f0 msgr2=0x7f5f181541a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:49:54.979 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:54.977+0000 7f5f1e471640 1 --2- 172.21.15.150:0/2893281065 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5f180b42f0 0x7f5f181541a0 secure :-1 s=READY pgs=1213 cs=0 l=1 rev1=1 crypto rx=0x7f5f0c00e710 tx=0x7f5f0c00ebd0 comp rx=0 tx=0).stop 2024-09-17T05:49:54.979 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:54.977+0000 7f5f1e471640 1 -- 172.21.15.150:0/2893281065 shutdown_connections 2024-09-17T05:49:54.979 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:54.977+0000 7f5f1e471640 1 --2- 172.21.15.150:0/2893281065 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5f180b5610 0x7f5f181fa2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:49:54.979 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:54.977+0000 7f5f1e471640 1 --2- 172.21.15.150:0/2893281065 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f5f0407a210 0x7f5f0407c720 unknown :-1 s=CLOSED pgs=520 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:49:54.979 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:54.977+0000 7f5f1e471640 1 --2- 172.21.15.150:0/2893281065 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5f1815ba80 0x7f5f1814de80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:49:54.979 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:54.977+0000 7f5f1e471640 1 --2- 172.21.15.150:0/2893281065 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5f180b42f0 0x7f5f181541a0 unknown :-1 s=CLOSED pgs=1213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:49:54.979 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:54.977+0000 7f5f1e471640 1 -- 172.21.15.150:0/2893281065 >> 172.21.15.150:0/2893281065 conn(0x7f5f1809aa50 msgr2=0x7f5f180b2660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:49:54.980 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:54.978+0000 7f5f1e471640 1 -- 172.21.15.150:0/2893281065 shutdown_connections 2024-09-17T05:49:54.980 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:54.978+0000 7f5f1e471640 1 -- 172.21.15.150:0/2893281065 wait complete. 2024-09-17T05:49:54.994 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume rm --force cephfs subvol_clone149612 2024-09-17T05:49:55.161 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:55.159+0000 7f9bbcdf1640 1 -- 172.21.15.150:0/3851759140 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9bb80b6c80 msgr2=0x7f9bb80b42f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:49:55.161 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:55.159+0000 7f9bbcdf1640 1 --2- 172.21.15.150:0/3851759140 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9bb80b6c80 0x7f9bb80b42f0 secure :-1 s=READY pgs=1214 cs=0 l=1 rev1=1 crypto rx=0x7f9bb80c4ee0 tx=0x7f9ba802a560 comp rx=0 tx=0).stop 2024-09-17T05:49:55.161 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:55.159+0000 7f9bbcdf1640 1 -- 172.21.15.150:0/3851759140 shutdown_connections 2024-09-17T05:49:55.161 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:55.159+0000 7f9bbcdf1640 1 --2- 172.21.15.150:0/3851759140 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9bb80ce2c0 0x7f9bb80cd020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:49:55.161 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:55.159+0000 7f9bbcdf1640 1 --2- 172.21.15.150:0/3851759140 >> v2:172.21.15.176:3300/0 conn(0x7f9bb80b6730 0x7f9bb80cdd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:49:55.161 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:55.159+0000 7f9bbcdf1640 1 --2- 172.21.15.150:0/3851759140 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9bb80b6c80 0x7f9bb80b42f0 unknown :-1 s=CLOSED pgs=1214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:49:55.161 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:55.159+0000 7f9bbcdf1640 1 -- 172.21.15.150:0/3851759140 >> 172.21.15.150:0/3851759140 conn(0x7f9bb80b2ff0 msgr2=0x7f9bb80b3400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:49:55.162 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:55.159+0000 7f9bbcdf1640 1 -- 172.21.15.150:0/3851759140 shutdown_connections 2024-09-17T05:49:55.162 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:55.159+0000 7f9bbcdf1640 1 -- 172.21.15.150:0/3851759140 wait complete. 2024-09-17T05:49:55.162 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:55.161+0000 7f9bbcdf1640 1 Processor -- start 2024-09-17T05:49:55.162 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:55.161+0000 7f9bbcdf1640 1 -- start start 2024-09-17T05:49:55.165 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:55.162+0000 7f9bbcdf1640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9bb80b6730 0x7f9bb80ae2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:49:55.165 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:55.162+0000 7f9bbcdf1640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9bb80b6c80 0x7f9bb80af380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:49:55.166 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:55.162+0000 7f9bbcdf1640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9bb80ce2c0 0x7f9bb80b0490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:49:55.166 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:55.162+0000 7f9bbcdf1640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f9bb80cd8f0 con 0x7f9bb80b6c80 2024-09-17T05:49:55.166 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:55.162+0000 7f9bbcdf1640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f9bb80cd770 con 0x7f9bb80b6730 2024-09-17T05:49:55.166 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:55.162+0000 7f9bbcdf1640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f9bb80b49f0 con 0x7f9bb80ce2c0 2024-09-17T05:49:55.166 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:55.162+0000 7f9bb5d9b640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9bb80b6c80 0x7f9bb80af380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:49:55.166 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:55.162+0000 7f9bb5d9b640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9bb80b6c80 0x7f9bb80af380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:60490/0 (socket says 172.21.15.150:60490) 2024-09-17T05:49:55.166 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:55.162+0000 7f9bb5d9b640 1 -- 172.21.15.150:0/3620025121 learned_addr learned my addr 172.21.15.150:0/3620025121 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:49:55.166 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:55.162+0000 7f9bb6d9d640 1 --2- 172.21.15.150:0/3620025121 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9bb80ce2c0 0x7f9bb80b0490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:49:55.166 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:55.162+0000 7f9bb659c640 1 --2- 172.21.15.150:0/3620025121 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9bb80b6730 0x7f9bb80ae2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:49:55.166 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:55.163+0000 7f9bb5d9b640 1 -- 172.21.15.150:0/3620025121 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9bb80ce2c0 msgr2=0x7f9bb80b0490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:49:55.166 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:55.163+0000 7f9bb5d9b640 1 --2- 172.21.15.150:0/3620025121 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9bb80ce2c0 0x7f9bb80b0490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:49:55.166 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:55.163+0000 7f9bb5d9b640 1 -- 172.21.15.150:0/3620025121 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9bb80b6730 msgr2=0x7f9bb80ae2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:49:55.166 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:55.163+0000 7f9bb5d9b640 1 --2- 172.21.15.150:0/3620025121 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9bb80b6730 0x7f9bb80ae2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:49:55.167 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:55.163+0000 7f9bb5d9b640 1 -- 172.21.15.150:0/3620025121 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9bb80ae810 con 0x7f9bb80b6c80 2024-09-17T05:49:55.167 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:55.163+0000 7f9bb6d9d640 1 --2- 172.21.15.150:0/3620025121 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9bb80ce2c0 0x7f9bb80b0490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T05:49:55.167 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:55.163+0000 7f9bb5d9b640 1 --2- 172.21.15.150:0/3620025121 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9bb80b6c80 0x7f9bb80af380 secure :-1 s=READY pgs=1215 cs=0 l=1 rev1=1 crypto rx=0x7f9bac00e6e0 tx=0x7f9bac00eba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:49:55.167 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:55.163+0000 7f9ba6ffd640 1 -- 172.21.15.150:0/3620025121 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9bac00cab0 con 0x7f9bb80b6c80 2024-09-17T05:49:55.167 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:55.163+0000 7f9ba6ffd640 1 -- 172.21.15.150:0/3620025121 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9bac00cc50 con 0x7f9bb80b6c80 2024-09-17T05:49:55.167 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:55.163+0000 7f9bbcdf1640 1 -- 172.21.15.150:0/3620025121 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9bb81f6550 con 0x7f9bb80b6c80 2024-09-17T05:49:55.167 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:55.163+0000 7f9ba6ffd640 1 -- 172.21.15.150:0/3620025121 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9bac005280 con 0x7f9bb80b6c80 2024-09-17T05:49:55.167 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:55.163+0000 7f9bbcdf1640 1 -- 172.21.15.150:0/3620025121 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9bb81f5f90 con 0x7f9bb80b6c80 2024-09-17T05:49:55.168 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:55.164+0000 7f9bbcdf1640 1 -- 172.21.15.150:0/3620025121 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9bb80b42f0 con 0x7f9bb80b6c80 2024-09-17T05:49:55.168 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:55.165+0000 7f9ba6ffd640 1 -- 172.21.15.150:0/3620025121 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 32) ==== 103481+0+0 (secure 0 0 0) 0x7f9bac005420 con 0x7f9bb80b6c80 2024-09-17T05:49:55.168 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:55.165+0000 7f9ba6ffd640 1 --2- 172.21.15.150:0/3620025121 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f9b9807a210 0x7f9b9807c720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:49:55.168 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:55.165+0000 7f9ba6ffd640 1 -- 172.21.15.150:0/3620025121 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 5822+0+0 (secure 0 0 0) 0x7f9bac09a210 con 0x7f9bb80b6c80 2024-09-17T05:49:55.168 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:55.166+0000 7f9bb659c640 1 --2- 172.21.15.150:0/3620025121 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f9b9807a210 0x7f9b9807c720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:49:55.168 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:55.166+0000 7f9bb659c640 1 --2- 172.21.15.150:0/3620025121 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f9b9807a210 0x7f9b9807c720 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7f9ba8033000 tx=0x7f9ba8004730 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:49:55.171 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:55.170+0000 7f9ba6ffd640 1 -- 172.21.15.150:0/3620025121 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f9bac00ce20 con 0x7f9bb80b6c80 2024-09-17T05:49:55.371 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:55.370+0000 7f9bbcdf1640 1 -- 172.21.15.150:0/3620025121 --> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] -- mgr_command(tid 0: {"prefix": "fs subvolume rm", "force": true, "vol_name": "cephfs", "sub_name": "subvol_clone149612", "target": ["mon-mgr", ""]}) -- 0x7f9bb81f5a40 con 0x7f9b9807a210 2024-09-17T05:49:55.389 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:55.388+0000 7f9ba6ffd640 1 -- 172.21.15.150:0/3620025121 <== mgr.4108 v2:172.21.15.176:6800/3631216395 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f9bb81f5a40 con 0x7f9b9807a210 2024-09-17T05:49:55.391 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:55.389+0000 7f9bbcdf1640 1 -- 172.21.15.150:0/3620025121 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f9b9807a210 msgr2=0x7f9b9807c720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:49:55.391 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:55.389+0000 7f9bbcdf1640 1 --2- 172.21.15.150:0/3620025121 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f9b9807a210 0x7f9b9807c720 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7f9ba8033000 tx=0x7f9ba8004730 comp rx=0 tx=0).stop 2024-09-17T05:49:55.392 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:55.389+0000 7f9bbcdf1640 1 -- 172.21.15.150:0/3620025121 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9bb80b6c80 msgr2=0x7f9bb80af380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:49:55.392 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:55.389+0000 7f9bbcdf1640 1 --2- 172.21.15.150:0/3620025121 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9bb80b6c80 0x7f9bb80af380 secure :-1 s=READY pgs=1215 cs=0 l=1 rev1=1 crypto rx=0x7f9bac00e6e0 tx=0x7f9bac00eba0 comp rx=0 tx=0).stop 2024-09-17T05:49:55.392 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:55.390+0000 7f9bbcdf1640 1 -- 172.21.15.150:0/3620025121 shutdown_connections 2024-09-17T05:49:55.392 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:55.390+0000 7f9bbcdf1640 1 --2- 172.21.15.150:0/3620025121 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f9b9807a210 0x7f9b9807c720 unknown :-1 s=CLOSED pgs=521 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:49:55.392 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:55.390+0000 7f9bbcdf1640 1 --2- 172.21.15.150:0/3620025121 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9bb80ce2c0 0x7f9bb80b0490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:49:55.392 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:55.390+0000 7f9bbcdf1640 1 --2- 172.21.15.150:0/3620025121 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9bb80b6c80 0x7f9bb80af380 unknown :-1 s=CLOSED pgs=1215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:49:55.392 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:55.390+0000 7f9bbcdf1640 1 --2- 172.21.15.150:0/3620025121 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9bb80b6730 0x7f9bb80ae2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:49:55.392 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:55.390+0000 7f9bbcdf1640 1 -- 172.21.15.150:0/3620025121 >> 172.21.15.150:0/3620025121 conn(0x7f9bb80b2ff0 msgr2=0x7f9bb80b3400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:49:55.392 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:55.390+0000 7f9bbcdf1640 1 -- 172.21.15.150:0/3620025121 shutdown_connections 2024-09-17T05:49:55.392 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:55.390+0000 7f9bbcdf1640 1 -- 172.21.15.150:0/3620025121 wait complete. 2024-09-17T05:49:55.403 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume rm --force cephfs subvol_clone627111 2024-09-17T05:49:55.522 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:55.519+0000 7f6131324640 1 -- 172.21.15.150:0/3340186496 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f612c0d0d20 msgr2=0x7f612c0d1130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:49:55.522 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:55.519+0000 7f6131324640 1 --2- 172.21.15.150:0/3340186496 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f612c0d0d20 0x7f612c0d1130 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f6124005fd0 tx=0x7f612402a5d0 comp rx=0 tx=0).stop 2024-09-17T05:49:55.522 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:55.519+0000 7f6131324640 1 -- 172.21.15.150:0/3340186496 shutdown_connections 2024-09-17T05:49:55.522 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:55.519+0000 7f6131324640 1 --2- 172.21.15.150:0/3340186496 >> v2:172.21.15.176:3300/0 conn(0x7f612c0d0310 0x7f612c06eaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:49:55.522 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:55.519+0000 7f6131324640 1 --2- 172.21.15.150:0/3340186496 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f612c0d0d20 0x7f612c0d1130 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:49:55.522 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:55.520+0000 7f6131324640 1 -- 172.21.15.150:0/3340186496 >> 172.21.15.150:0/3340186496 conn(0x7f612c0d46f0 msgr2=0x7f612c0d4b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:49:55.522 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:55.520+0000 7f6131324640 1 -- 172.21.15.150:0/3340186496 shutdown_connections 2024-09-17T05:49:55.522 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:55.520+0000 7f6131324640 1 -- 172.21.15.150:0/3340186496 wait complete. 2024-09-17T05:49:55.523 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:55.521+0000 7f6131324640 1 Processor -- start 2024-09-17T05:49:55.523 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:55.522+0000 7f6131324640 1 -- start start 2024-09-17T05:49:55.526 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:55.523+0000 7f6131324640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f612c0d0310 0x7f612c15e8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:49:55.526 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:55.523+0000 7f6131324640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f612c0d0d20 0x7f612c0b6320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:49:55.526 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:55.523+0000 7f6131324640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f612c0d1670 0x7f612c0b6860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:49:55.526 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:55.523+0000 7f6131324640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f612c0ba200 con 0x7f612c0d0d20 2024-09-17T05:49:55.526 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:55.523+0000 7f6131324640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f612c0ba080 con 0x7f612c0d1670 2024-09-17T05:49:55.526 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:55.523+0000 7f6131324640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f612c06efe0 con 0x7f612c0d0310 2024-09-17T05:49:55.526 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:55.523+0000 7f612a7fc640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f612c0d0d20 0x7f612c0b6320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:49:55.526 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:55.523+0000 7f612affd640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f612c0d0310 0x7f612c15e8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:49:55.526 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:55.523+0000 7f612b7fe640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f612c0d1670 0x7f612c0b6860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:49:55.526 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:55.523+0000 7f612affd640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f612c0d0310 0x7f612c15e8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3301/0 says I am v2:172.21.15.150:54460/0 (socket says 172.21.15.150:54460) 2024-09-17T05:49:55.527 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:55.523+0000 7f612affd640 1 -- 172.21.15.150:0/2078650645 learned_addr learned my addr 172.21.15.150:0/2078650645 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:49:55.527 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:55.523+0000 7f612a7fc640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f612c0d0d20 0x7f612c0b6320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:60506/0 (socket says 172.21.15.150:60506) 2024-09-17T05:49:55.527 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:55.523+0000 7f612a7fc640 1 -- 172.21.15.150:0/2078650645 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f612c0d0310 msgr2=0x7f612c15e8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:49:55.527 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:55.523+0000 7f612a7fc640 1 --2- 172.21.15.150:0/2078650645 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f612c0d0310 0x7f612c15e8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:49:55.527 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:55.523+0000 7f612a7fc640 1 -- 172.21.15.150:0/2078650645 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f612c0d1670 msgr2=0x7f612c0b6860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:49:55.527 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:55.523+0000 7f612a7fc640 1 --2- 172.21.15.150:0/2078650645 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f612c0d1670 0x7f612c0b6860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:49:55.527 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:55.523+0000 7f612a7fc640 1 -- 172.21.15.150:0/2078650645 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f612c1f5840 con 0x7f612c0d0d20 2024-09-17T05:49:55.527 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:55.523+0000 7f612affd640 1 --2- 172.21.15.150:0/2078650645 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f612c0d0310 0x7f612c15e8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T05:49:55.527 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:55.523+0000 7f612b7fe640 1 --2- 172.21.15.150:0/2078650645 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f612c0d1670 0x7f612c0b6860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T05:49:55.527 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:55.524+0000 7f612a7fc640 1 --2- 172.21.15.150:0/2078650645 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f612c0d0d20 0x7f612c0b6320 secure :-1 s=READY pgs=1216 cs=0 l=1 rev1=1 crypto rx=0x7f612000c690 tx=0x7f612000ca90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:49:55.527 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:55.524+0000 7f61137fe640 1 -- 172.21.15.150:0/2078650645 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6120003bc0 con 0x7f612c0d0d20 2024-09-17T05:49:55.527 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:55.524+0000 7f6131324640 1 -- 172.21.15.150:0/2078650645 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f612c15ee20 con 0x7f612c0d0d20 2024-09-17T05:49:55.527 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:55.524+0000 7f61137fe640 1 -- 172.21.15.150:0/2078650645 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f6120003d60 con 0x7f612c0d0d20 2024-09-17T05:49:55.527 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:55.524+0000 7f61137fe640 1 -- 172.21.15.150:0/2078650645 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6120005330 con 0x7f612c0d0d20 2024-09-17T05:49:55.528 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:55.524+0000 7f6131324640 1 -- 172.21.15.150:0/2078650645 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f612c1f5b20 con 0x7f612c0d0d20 2024-09-17T05:49:55.528 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:55.525+0000 7f6131324640 1 -- 172.21.15.150:0/2078650645 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f612c1f64c0 con 0x7f612c0d0d20 2024-09-17T05:49:55.528 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:55.525+0000 7f61137fe640 1 -- 172.21.15.150:0/2078650645 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 32) ==== 103481+0+0 (secure 0 0 0) 0x7f61200054d0 con 0x7f612c0d0d20 2024-09-17T05:49:55.529 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:55.526+0000 7f61137fe640 1 --2- 172.21.15.150:0/2078650645 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f611807a240 0x7f611807c750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:49:55.529 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:55.526+0000 7f612affd640 1 --2- 172.21.15.150:0/2078650645 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f611807a240 0x7f611807c750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:49:55.529 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:55.526+0000 7f61137fe640 1 -- 172.21.15.150:0/2078650645 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 5822+0+0 (secure 0 0 0) 0x7f61200996b0 con 0x7f612c0d0d20 2024-09-17T05:49:55.529 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:55.527+0000 7f612affd640 1 --2- 172.21.15.150:0/2078650645 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f611807a240 0x7f611807c750 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7f6124009230 tx=0x7f6124004730 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:49:55.532 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:55.531+0000 7f61137fe640 1 -- 172.21.15.150:0/2078650645 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f612c1f64c0 con 0x7f612c0d0d20 2024-09-17T05:49:55.734 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:55.732+0000 7f6131324640 1 -- 172.21.15.150:0/2078650645 --> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] -- mgr_command(tid 0: {"prefix": "fs subvolume rm", "force": true, "vol_name": "cephfs", "sub_name": "subvol_clone627111", "target": ["mon-mgr", ""]}) -- 0x7f612c06f4b0 con 0x7f611807a240 2024-09-17T05:49:55.749 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:55.747+0000 7f61137fe640 1 -- 172.21.15.150:0/2078650645 <== mgr.4108 v2:172.21.15.176:6800/3631216395 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f612c06f4b0 con 0x7f611807a240 2024-09-17T05:49:55.751 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:55.749+0000 7f6131324640 1 -- 172.21.15.150:0/2078650645 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f611807a240 msgr2=0x7f611807c750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:49:55.752 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:55.749+0000 7f6131324640 1 --2- 172.21.15.150:0/2078650645 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f611807a240 0x7f611807c750 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7f6124009230 tx=0x7f6124004730 comp rx=0 tx=0).stop 2024-09-17T05:49:55.752 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:55.749+0000 7f6131324640 1 -- 172.21.15.150:0/2078650645 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f612c0d0d20 msgr2=0x7f612c0b6320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:49:55.752 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:55.749+0000 7f6131324640 1 --2- 172.21.15.150:0/2078650645 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f612c0d0d20 0x7f612c0b6320 secure :-1 s=READY pgs=1216 cs=0 l=1 rev1=1 crypto rx=0x7f612000c690 tx=0x7f612000ca90 comp rx=0 tx=0).stop 2024-09-17T05:49:55.752 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:55.750+0000 7f6131324640 1 -- 172.21.15.150:0/2078650645 shutdown_connections 2024-09-17T05:49:55.752 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:55.750+0000 7f6131324640 1 --2- 172.21.15.150:0/2078650645 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f612c0d1670 0x7f612c0b6860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:49:55.752 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:55.750+0000 7f6131324640 1 --2- 172.21.15.150:0/2078650645 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f611807a240 0x7f611807c750 unknown :-1 s=CLOSED pgs=522 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:49:55.752 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:55.750+0000 7f6131324640 1 --2- 172.21.15.150:0/2078650645 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f612c0d0d20 0x7f612c0b6320 unknown :-1 s=CLOSED pgs=1216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:49:55.752 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:55.750+0000 7f6131324640 1 --2- 172.21.15.150:0/2078650645 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f612c0d0310 0x7f612c15e8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:49:55.752 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:55.750+0000 7f6131324640 1 -- 172.21.15.150:0/2078650645 >> 172.21.15.150:0/2078650645 conn(0x7f612c0d46f0 msgr2=0x7f612c06e850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:49:55.752 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:55.750+0000 7f6131324640 1 -- 172.21.15.150:0/2078650645 shutdown_connections 2024-09-17T05:49:55.752 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:55.750+0000 7f6131324640 1 -- 172.21.15.150:0/2078650645 wait complete. 2024-09-17T05:49:55.763 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume rm --force cephfs subvol_clone748216 2024-09-17T05:49:55.881 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:55.879+0000 7f61bc762640 1 -- 172.21.15.150:0/941278208 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f61b4165ce0 msgr2=0x7f61b4168100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:49:55.881 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:55.879+0000 7f61bc762640 1 --2- 172.21.15.150:0/941278208 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f61b4165ce0 0x7f61b4168100 secure :-1 s=READY pgs=1218 cs=0 l=1 rev1=1 crypto rx=0x7f61ac005fd0 tx=0x7f61ac02ab40 comp rx=0 tx=0).stop 2024-09-17T05:49:55.881 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:55.879+0000 7f61bc762640 1 -- 172.21.15.150:0/941278208 shutdown_connections 2024-09-17T05:49:55.881 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:55.879+0000 7f61bc762640 1 --2- 172.21.15.150:0/941278208 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f61b4165ce0 0x7f61b4168100 unknown :-1 s=CLOSED pgs=1218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:49:55.882 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:55.879+0000 7f61bc762640 1 -- 172.21.15.150:0/941278208 >> 172.21.15.150:0/941278208 conn(0x7f61b40cee80 msgr2=0x7f61b40cf290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:49:55.882 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:55.879+0000 7f61bc762640 1 -- 172.21.15.150:0/941278208 shutdown_connections 2024-09-17T05:49:55.882 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:55.879+0000 7f61bc762640 1 -- 172.21.15.150:0/941278208 wait complete. 2024-09-17T05:49:55.882 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:55.881+0000 7f61bc762640 1 Processor -- start 2024-09-17T05:49:55.882 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:55.881+0000 7f61bc762640 1 -- start start 2024-09-17T05:49:55.885 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:55.882+0000 7f61bc762640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f61b40d01b0 0x7f61b40b2fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:49:55.885 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:55.882+0000 7f61bc762640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f61b40d05c0 0x7f61b409cb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:49:55.885 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:55.882+0000 7f61bc762640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f61b4165ce0 0x7f61b40c6930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:49:55.885 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:55.882+0000 7f61bc762640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f61b40d15f0 con 0x7f61b40d01b0 2024-09-17T05:49:55.885 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:55.882+0000 7f61bc762640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f61b40c5bd0 con 0x7f61b40d05c0 2024-09-17T05:49:55.885 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:55.882+0000 7f61bc762640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f61b40d1770 con 0x7f61b4165ce0 2024-09-17T05:49:55.886 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:55.882+0000 7f61ba4fe640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f61b40d01b0 0x7f61b40b2fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:49:55.886 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:55.882+0000 7f61ba4fe640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f61b40d01b0 0x7f61b40b2fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:60536/0 (socket says 172.21.15.150:60536) 2024-09-17T05:49:55.886 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:55.882+0000 7f61ba4fe640 1 -- 172.21.15.150:0/2404736857 learned_addr learned my addr 172.21.15.150:0/2404736857 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:49:55.886 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:55.882+0000 7f61b9cfd640 1 --2- 172.21.15.150:0/2404736857 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f61b40d05c0 0x7f61b409cb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:49:55.886 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:55.882+0000 7f61bacff640 1 --2- 172.21.15.150:0/2404736857 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f61b4165ce0 0x7f61b40c6930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:49:55.886 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:55.883+0000 7f61ba4fe640 1 -- 172.21.15.150:0/2404736857 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f61b4165ce0 msgr2=0x7f61b40c6930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:49:55.886 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:55.883+0000 7f61ba4fe640 1 --2- 172.21.15.150:0/2404736857 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f61b4165ce0 0x7f61b40c6930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:49:55.886 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:55.883+0000 7f61ba4fe640 1 -- 172.21.15.150:0/2404736857 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f61b40d05c0 msgr2=0x7f61b409cb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:49:55.886 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:55.883+0000 7f61ba4fe640 1 --2- 172.21.15.150:0/2404736857 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f61b40d05c0 0x7f61b409cb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:49:55.886 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:55.883+0000 7f61ba4fe640 1 -- 172.21.15.150:0/2404736857 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f61b40b3520 con 0x7f61b40d01b0 2024-09-17T05:49:55.886 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:55.883+0000 7f61ba4fe640 1 --2- 172.21.15.150:0/2404736857 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f61b40d01b0 0x7f61b40b2fe0 secure :-1 s=READY pgs=1219 cs=0 l=1 rev1=1 crypto rx=0x7f61b000c400 tx=0x7f61b000c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:49:55.886 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:55.883+0000 7f61aaffd640 1 -- 172.21.15.150:0/2404736857 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61b0017070 con 0x7f61b40d01b0 2024-09-17T05:49:55.886 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:55.883+0000 7f61aaffd640 1 -- 172.21.15.150:0/2404736857 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f61b00053c0 con 0x7f61b40d01b0 2024-09-17T05:49:55.886 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:55.883+0000 7f61bc762640 1 -- 172.21.15.150:0/2404736857 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f61b409d0b0 con 0x7f61b40d01b0 2024-09-17T05:49:55.887 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:55.883+0000 7f61aaffd640 1 -- 172.21.15.150:0/2404736857 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61b00038a0 con 0x7f61b40d01b0 2024-09-17T05:49:55.887 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:55.883+0000 7f61bc762640 1 -- 172.21.15.150:0/2404736857 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f61b409da00 con 0x7f61b40d01b0 2024-09-17T05:49:55.887 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:55.884+0000 7f61bc762640 1 -- 172.21.15.150:0/2404736857 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f61b40b5250 con 0x7f61b40d01b0 2024-09-17T05:49:55.887 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:55.886+0000 7f61aaffd640 1 -- 172.21.15.150:0/2404736857 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 32) ==== 103481+0+0 (secure 0 0 0) 0x7f61b001a070 con 0x7f61b40d01b0 2024-09-17T05:49:55.888 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:55.886+0000 7f61aaffd640 1 --2- 172.21.15.150:0/2404736857 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f619807a240 0x7f619807c750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:49:55.888 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:55.886+0000 7f61aaffd640 1 -- 172.21.15.150:0/2404736857 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 5822+0+0 (secure 0 0 0) 0x7f61b0098fa0 con 0x7f61b40d01b0 2024-09-17T05:49:55.888 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:55.886+0000 7f61b9cfd640 1 --2- 172.21.15.150:0/2404736857 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f619807a240 0x7f619807c750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:49:55.888 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:55.887+0000 7f61b9cfd640 1 --2- 172.21.15.150:0/2404736857 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f619807a240 0x7f619807c750 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7f61b415b1f0 tx=0x7f61a4009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:49:55.891 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:55.890+0000 7f61aaffd640 1 -- 172.21.15.150:0/2404736857 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f61b0021080 con 0x7f61b40d01b0 2024-09-17T05:49:56.097 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:56.095+0000 7f61bc762640 1 -- 172.21.15.150:0/2404736857 --> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] -- mgr_command(tid 0: {"prefix": "fs subvolume rm", "force": true, "vol_name": "cephfs", "sub_name": "subvol_clone748216", "target": ["mon-mgr", ""]}) -- 0x7f61b4074770 con 0x7f619807a240 2024-09-17T05:49:56.111 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:56.110+0000 7f61aaffd640 1 -- 172.21.15.150:0/2404736857 <== mgr.4108 v2:172.21.15.176:6800/3631216395 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f61b4074770 con 0x7f619807a240 2024-09-17T05:49:56.114 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:56.112+0000 7f61bc762640 1 -- 172.21.15.150:0/2404736857 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f619807a240 msgr2=0x7f619807c750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:49:56.114 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:56.112+0000 7f61bc762640 1 --2- 172.21.15.150:0/2404736857 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f619807a240 0x7f619807c750 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7f61b415b1f0 tx=0x7f61a4009040 comp rx=0 tx=0).stop 2024-09-17T05:49:56.114 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:56.112+0000 7f61bc762640 1 -- 172.21.15.150:0/2404736857 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f61b40d01b0 msgr2=0x7f61b40b2fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:49:56.114 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:56.112+0000 7f61bc762640 1 --2- 172.21.15.150:0/2404736857 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f61b40d01b0 0x7f61b40b2fe0 secure :-1 s=READY pgs=1219 cs=0 l=1 rev1=1 crypto rx=0x7f61b000c400 tx=0x7f61b000c8c0 comp rx=0 tx=0).stop 2024-09-17T05:49:56.114 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:56.112+0000 7f61bc762640 1 -- 172.21.15.150:0/2404736857 shutdown_connections 2024-09-17T05:49:56.114 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:56.112+0000 7f61bc762640 1 --2- 172.21.15.150:0/2404736857 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f61b40d05c0 0x7f61b409cb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:49:56.114 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:56.112+0000 7f61bc762640 1 --2- 172.21.15.150:0/2404736857 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f619807a240 0x7f619807c750 unknown :-1 s=CLOSED pgs=523 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:49:56.114 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:56.112+0000 7f61bc762640 1 --2- 172.21.15.150:0/2404736857 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f61b4165ce0 0x7f61b40c6930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:49:56.114 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:56.112+0000 7f61bc762640 1 --2- 172.21.15.150:0/2404736857 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f61b40d01b0 0x7f61b40b2fe0 unknown :-1 s=CLOSED pgs=1219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:49:56.115 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:56.112+0000 7f61bc762640 1 -- 172.21.15.150:0/2404736857 >> 172.21.15.150:0/2404736857 conn(0x7f61b40cee80 msgr2=0x7f61b40b6790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:49:56.115 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:56.112+0000 7f61bc762640 1 -- 172.21.15.150:0/2404736857 shutdown_connections 2024-09-17T05:49:56.115 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:56.112+0000 7f61bc762640 1 -- 172.21.15.150:0/2404736857 wait complete. 2024-09-17T05:49:56.125 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume rm --force cephfs subvol_clone5458 2024-09-17T05:49:56.296 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:56.294+0000 7f84ec520640 1 -- 172.21.15.150:0/366520548 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f84e40b5d20 msgr2=0x7f84e415be90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:49:56.296 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:56.294+0000 7f84ec520640 1 --2- 172.21.15.150:0/366520548 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f84e40b5d20 0x7f84e415be90 secure :-1 s=READY pgs=1220 cs=0 l=1 rev1=1 crypto rx=0x7f84e4072be0 tx=0x7f84dc02a5f0 comp rx=0 tx=0).stop 2024-09-17T05:49:56.296 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:56.295+0000 7f84ec520640 1 -- 172.21.15.150:0/366520548 shutdown_connections 2024-09-17T05:49:56.297 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:56.295+0000 7f84ec520640 1 --2- 172.21.15.150:0/366520548 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f84e40b5d20 0x7f84e415be90 unknown :-1 s=CLOSED pgs=1220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:49:56.297 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:56.295+0000 7f84ec520640 1 --2- 172.21.15.150:0/366520548 >> v2:172.21.15.176:3300/0 conn(0x7f84e40b42f0 0x7f84e415cfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:49:56.297 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:56.295+0000 7f84ec520640 1 -- 172.21.15.150:0/366520548 >> 172.21.15.150:0/366520548 conn(0x7f84e409aa50 msgr2=0x7f84e40b2ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:49:56.297 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:56.295+0000 7f84ec520640 1 -- 172.21.15.150:0/366520548 shutdown_connections 2024-09-17T05:49:56.298 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:56.296+0000 7f84ec520640 1 -- 172.21.15.150:0/366520548 wait complete. 2024-09-17T05:49:56.300 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:56.298+0000 7f84ec520640 1 Processor -- start 2024-09-17T05:49:56.300 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:56.298+0000 7f84ec520640 1 -- start start 2024-09-17T05:49:56.302 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:56.300+0000 7f84ec520640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f84e40b42f0 0x7f84e415b210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:49:56.302 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:56.300+0000 7f84ec520640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f84e415ba80 0x7f84e4153210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:49:56.303 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:56.301+0000 7f84e9abb640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f84e415ba80 0x7f84e4153210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:49:56.303 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:56.301+0000 7f84e9abb640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f84e415ba80 0x7f84e4153210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:60552/0 (socket says 172.21.15.150:60552) 2024-09-17T05:49:56.303 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:56.301+0000 7f84ea2bc640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f84e40b42f0 0x7f84e415b210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:49:56.303 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:56.301+0000 7f84ea2bc640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f84e40b42f0 0x7f84e415b210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3301/0 says I am v2:172.21.15.150:54478/0 (socket says 172.21.15.150:54478) 2024-09-17T05:49:56.303 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:56.301+0000 7f84e9abb640 1 -- 172.21.15.150:0/4213775766 learned_addr learned my addr 172.21.15.150:0/4213775766 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:49:56.304 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:56.301+0000 7f84ec520640 1 --2- 172.21.15.150:0/4213775766 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f84e4153a10 0x7f84e40cd690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:49:56.304 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:56.301+0000 7f84ec520640 1 -- 172.21.15.150:0/4213775766 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f84e40af9f0 con 0x7f84e415ba80 2024-09-17T05:49:56.304 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:56.301+0000 7f84ec520640 1 -- 172.21.15.150:0/4213775766 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f84e40af870 con 0x7f84e4153a10 2024-09-17T05:49:56.304 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:56.301+0000 7f84ec520640 1 -- 172.21.15.150:0/4213775766 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f84e40afb70 con 0x7f84e40b42f0 2024-09-17T05:49:56.304 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:56.301+0000 7f84eaabd640 1 --2- 172.21.15.150:0/4213775766 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f84e4153a10 0x7f84e40cd690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:49:56.305 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:56.302+0000 7f84e9abb640 1 -- 172.21.15.150:0/4213775766 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f84e40b42f0 msgr2=0x7f84e415b210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:49:56.305 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:56.302+0000 7f84e9abb640 1 --2- 172.21.15.150:0/4213775766 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f84e40b42f0 0x7f84e415b210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:49:56.305 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:56.302+0000 7f84e9abb640 1 -- 172.21.15.150:0/4213775766 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f84e4153a10 msgr2=0x7f84e40cd690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:49:56.306 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:56.302+0000 7f84e9abb640 1 --2- 172.21.15.150:0/4213775766 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f84e4153a10 0x7f84e40cd690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:49:56.306 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:56.302+0000 7f84e9abb640 1 -- 172.21.15.150:0/4213775766 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f84e41fa810 con 0x7f84e415ba80 2024-09-17T05:49:56.306 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:56.302+0000 7f84eaabd640 1 --2- 172.21.15.150:0/4213775766 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f84e4153a10 0x7f84e40cd690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T05:49:56.306 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:56.303+0000 7f84e9abb640 1 --2- 172.21.15.150:0/4213775766 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f84e415ba80 0x7f84e4153210 secure :-1 s=READY pgs=1221 cs=0 l=1 rev1=1 crypto rx=0x7f84d400c3a0 tx=0x7f84d400c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:49:56.306 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:56.303+0000 7f84daffd640 1 -- 172.21.15.150:0/4213775766 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84d4017070 con 0x7f84e415ba80 2024-09-17T05:49:56.306 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:56.303+0000 7f84daffd640 1 -- 172.21.15.150:0/4213775766 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f84d40053c0 con 0x7f84e415ba80 2024-09-17T05:49:56.306 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:56.303+0000 7f84ec520640 1 -- 172.21.15.150:0/4213775766 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f84e40b06c0 con 0x7f84e415ba80 2024-09-17T05:49:56.306 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:56.304+0000 7f84ec520640 1 -- 172.21.15.150:0/4213775766 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f84e40cfa10 con 0x7f84e415ba80 2024-09-17T05:49:56.306 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:56.304+0000 7f84daffd640 1 -- 172.21.15.150:0/4213775766 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84d4003850 con 0x7f84e415ba80 2024-09-17T05:49:56.307 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:56.305+0000 7f84ec520640 1 -- 172.21.15.150:0/4213775766 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f84cc005290 con 0x7f84e415ba80 2024-09-17T05:49:56.308 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:56.307+0000 7f84daffd640 1 -- 172.21.15.150:0/4213775766 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 32) ==== 103481+0+0 (secure 0 0 0) 0x7f84d401a070 con 0x7f84e415ba80 2024-09-17T05:49:56.309 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:56.307+0000 7f84daffd640 1 --2- 172.21.15.150:0/4213775766 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f84c807a260 0x7f84c807c770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:49:56.310 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:56.308+0000 7f84ea2bc640 1 --2- 172.21.15.150:0/4213775766 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f84c807a260 0x7f84c807c770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:49:56.310 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:56.308+0000 7f84daffd640 1 -- 172.21.15.150:0/4213775766 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 5822+0+0 (secure 0 0 0) 0x7f84d4098c40 con 0x7f84e415ba80 2024-09-17T05:49:56.311 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:56.309+0000 7f84ea2bc640 1 --2- 172.21.15.150:0/4213775766 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f84c807a260 0x7f84c807c770 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7f84e0005fd0 tx=0x7f84e0009500 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:49:56.317 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:56.316+0000 7f84daffd640 1 -- 172.21.15.150:0/4213775766 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f84e41fa810 con 0x7f84e415ba80 2024-09-17T05:49:56.394 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-17T05:49:56.399 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-17T05:49:56.680 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:56.678+0000 7f84ec520640 1 -- 172.21.15.150:0/4213775766 --> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] -- mgr_command(tid 0: {"prefix": "fs subvolume rm", "force": true, "vol_name": "cephfs", "sub_name": "subvol_clone5458", "target": ["mon-mgr", ""]}) -- 0x7f84cc000bc0 con 0x7f84c807a260 2024-09-17T05:49:56.709 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:56.708+0000 7f84daffd640 1 -- 172.21.15.150:0/4213775766 <== mgr.4108 v2:172.21.15.176:6800/3631216395 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f84cc000bc0 con 0x7f84c807a260 2024-09-17T05:49:56.713 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:56.711+0000 7f84ec520640 1 -- 172.21.15.150:0/4213775766 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f84c807a260 msgr2=0x7f84c807c770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:49:56.713 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:56.711+0000 7f84ec520640 1 --2- 172.21.15.150:0/4213775766 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f84c807a260 0x7f84c807c770 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7f84e0005fd0 tx=0x7f84e0009500 comp rx=0 tx=0).stop 2024-09-17T05:49:56.713 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:56.711+0000 7f84ec520640 1 -- 172.21.15.150:0/4213775766 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f84e415ba80 msgr2=0x7f84e4153210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:49:56.713 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:56.711+0000 7f84ec520640 1 --2- 172.21.15.150:0/4213775766 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f84e415ba80 0x7f84e4153210 secure :-1 s=READY pgs=1221 cs=0 l=1 rev1=1 crypto rx=0x7f84d400c3a0 tx=0x7f84d400c860 comp rx=0 tx=0).stop 2024-09-17T05:49:56.714 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:56.712+0000 7f84ec520640 1 -- 172.21.15.150:0/4213775766 shutdown_connections 2024-09-17T05:49:56.714 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:56.712+0000 7f84ec520640 1 --2- 172.21.15.150:0/4213775766 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f84e4153a10 0x7f84e40cd690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:49:56.714 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:56.712+0000 7f84ec520640 1 --2- 172.21.15.150:0/4213775766 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f84c807a260 0x7f84c807c770 unknown :-1 s=CLOSED pgs=524 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:49:56.714 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:56.712+0000 7f84ec520640 1 --2- 172.21.15.150:0/4213775766 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f84e415ba80 0x7f84e4153210 secure :-1 s=CLOSED pgs=1221 cs=0 l=1 rev1=1 crypto rx=0x7f84d400c3a0 tx=0x7f84d400c860 comp rx=0 tx=0).stop 2024-09-17T05:49:56.714 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:56.712+0000 7f84ec520640 1 --2- 172.21.15.150:0/4213775766 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f84e40b42f0 0x7f84e415b210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:49:56.714 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:56.712+0000 7f84ec520640 1 -- 172.21.15.150:0/4213775766 >> 172.21.15.150:0/4213775766 conn(0x7f84e409aa50 msgr2=0x7f84e4154f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:49:56.714 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:56.713+0000 7f84ec520640 1 -- 172.21.15.150:0/4213775766 shutdown_connections 2024-09-17T05:49:56.715 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:56.714+0000 7f84ec520640 1 -- 172.21.15.150:0/4213775766 wait complete. 2024-09-17T05:49:56.735 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume rm --force cephfs subvol_clone3600 2024-09-17T05:49:56.895 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:56.893+0000 7f84b3d62640 1 -- 172.21.15.150:0/1282328964 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f84ac0af100 msgr2=0x7f84ac0af510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:49:56.895 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:56.893+0000 7f84b3d62640 1 --2- 172.21.15.150:0/1282328964 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f84ac0af100 0x7f84ac0af510 secure :-1 s=READY pgs=1222 cs=0 l=1 rev1=1 crypto rx=0x7f84ac06d8a0 tx=0x7f84a402aa30 comp rx=0 tx=0).stop 2024-09-17T05:49:56.895 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:56.893+0000 7f84b3d62640 1 -- 172.21.15.150:0/1282328964 shutdown_connections 2024-09-17T05:49:56.895 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:56.893+0000 7f84b3d62640 1 --2- 172.21.15.150:0/1282328964 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f84ac0af100 0x7f84ac0af510 unknown :-1 s=CLOSED pgs=1222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:49:56.895 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:56.893+0000 7f84b3d62640 1 --2- 172.21.15.150:0/1282328964 >> v2:172.21.15.176:3300/0 conn(0x7f84ac06cda0 0x7f84ac06d1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:49:56.896 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:56.893+0000 7f84b3d62640 1 --2- 172.21.15.150:0/1282328964 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f84ac0cc830 0x7f84ac0b4620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:49:56.896 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:56.893+0000 7f84b3d62640 1 -- 172.21.15.150:0/1282328964 >> 172.21.15.150:0/1282328964 conn(0x7f84ac0b2540 msgr2=0x7f84ac0d02d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:49:56.896 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:56.893+0000 7f84b3d62640 1 -- 172.21.15.150:0/1282328964 shutdown_connections 2024-09-17T05:49:56.896 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:56.893+0000 7f84b3d62640 1 -- 172.21.15.150:0/1282328964 wait complete. 2024-09-17T05:49:56.896 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:56.895+0000 7f84b3d62640 1 Processor -- start 2024-09-17T05:49:56.897 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:56.895+0000 7f84b3d62640 1 -- start start 2024-09-17T05:49:56.899 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:56.896+0000 7f84b3d62640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f84ac06cda0 0x7f84ac09aec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:49:56.900 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:56.896+0000 7f84b3d62640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f84ac0af100 0x7f84ac15f420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:49:56.900 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:56.896+0000 7f84b3d62640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f84ac0cc830 0x7f84ac15f960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:49:56.900 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:56.896+0000 7f84b3d62640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f84ac0b34b0 con 0x7f84ac06cda0 2024-09-17T05:49:56.900 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:56.896+0000 7f84b3d62640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f84ac0b3330 con 0x7f84ac0cc830 2024-09-17T05:49:56.900 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:56.896+0000 7f84b3d62640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f84ac0b3630 con 0x7f84ac0af100 2024-09-17T05:49:56.900 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:56.896+0000 7f84b1afe640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f84ac06cda0 0x7f84ac09aec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:49:56.900 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:56.896+0000 7f84b1afe640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f84ac06cda0 0x7f84ac09aec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:60570/0 (socket says 172.21.15.150:60570) 2024-09-17T05:49:56.900 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:56.896+0000 7f84b1afe640 1 -- 172.21.15.150:0/3204115447 learned_addr learned my addr 172.21.15.150:0/3204115447 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:49:56.900 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:56.897+0000 7f84b12fd640 1 --2- 172.21.15.150:0/3204115447 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f84ac0af100 0x7f84ac15f420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:49:56.900 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:56.897+0000 7f84b22ff640 1 --2- 172.21.15.150:0/3204115447 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f84ac0cc830 0x7f84ac15f960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:49:56.900 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:56.897+0000 7f84b1afe640 1 -- 172.21.15.150:0/3204115447 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f84ac0af100 msgr2=0x7f84ac15f420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:49:56.900 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:56.897+0000 7f84b1afe640 1 --2- 172.21.15.150:0/3204115447 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f84ac0af100 0x7f84ac15f420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:49:56.901 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:56.897+0000 7f84b1afe640 1 -- 172.21.15.150:0/3204115447 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f84ac0cc830 msgr2=0x7f84ac15f960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:49:56.901 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:56.897+0000 7f84b1afe640 1 --2- 172.21.15.150:0/3204115447 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f84ac0cc830 0x7f84ac15f960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:49:56.901 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:56.897+0000 7f84b1afe640 1 -- 172.21.15.150:0/3204115447 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f84ac15e660 con 0x7f84ac06cda0 2024-09-17T05:49:56.901 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:56.897+0000 7f84b1afe640 1 --2- 172.21.15.150:0/3204115447 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f84ac06cda0 0x7f84ac09aec0 secure :-1 s=READY pgs=1223 cs=0 l=1 rev1=1 crypto rx=0x7f84a800e7f0 tx=0x7f84a800ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:49:56.901 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:56.897+0000 7f84a27fc640 1 -- 172.21.15.150:0/3204115447 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84a800ccc0 con 0x7f84ac06cda0 2024-09-17T05:49:56.901 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:56.897+0000 7f84a27fc640 1 -- 172.21.15.150:0/3204115447 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f84a800ce80 con 0x7f84ac06cda0 2024-09-17T05:49:56.901 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:56.897+0000 7f84b3d62640 1 -- 172.21.15.150:0/3204115447 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f84ac15e940 con 0x7f84ac06cda0 2024-09-17T05:49:56.901 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:56.897+0000 7f84a27fc640 1 -- 172.21.15.150:0/3204115447 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84a8005280 con 0x7f84ac06cda0 2024-09-17T05:49:56.901 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:56.897+0000 7f84b3d62640 1 -- 172.21.15.150:0/3204115447 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f84ac09bb40 con 0x7f84ac06cda0 2024-09-17T05:49:56.901 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:56.898+0000 7f84b3d62640 1 -- 172.21.15.150:0/3204115447 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f84ac0af510 con 0x7f84ac06cda0 2024-09-17T05:49:56.902 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:56.899+0000 7f84a27fc640 1 -- 172.21.15.150:0/3204115447 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 32) ==== 103481+0+0 (secure 0 0 0) 0x7f84a8005420 con 0x7f84ac06cda0 2024-09-17T05:49:56.902 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:56.900+0000 7f84a27fc640 1 --2- 172.21.15.150:0/3204115447 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f849007a210 0x7f849007c720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:49:56.902 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:56.900+0000 7f84a27fc640 1 -- 172.21.15.150:0/3204115447 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 5822+0+0 (secure 0 0 0) 0x7f84a809a300 con 0x7f84ac06cda0 2024-09-17T05:49:56.902 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:56.900+0000 7f84b12fd640 1 --2- 172.21.15.150:0/3204115447 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f849007a210 0x7f849007c720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:49:56.902 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:56.901+0000 7f84b12fd640 1 --2- 172.21.15.150:0/3204115447 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f849007a210 0x7f849007c720 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7f84ac1f74f0 tx=0x7f849c005f90 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:49:56.906 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:56.905+0000 7f84a27fc640 1 -- 172.21.15.150:0/3204115447 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f84a8063bf0 con 0x7f84ac06cda0 2024-09-17T05:49:57.110 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:57.109+0000 7f84b3d62640 1 -- 172.21.15.150:0/3204115447 --> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] -- mgr_command(tid 0: {"prefix": "fs subvolume rm", "force": true, "vol_name": "cephfs", "sub_name": "subvol_clone3600", "target": ["mon-mgr", ""]}) -- 0x7f84ac0d1030 con 0x7f849007a210 2024-09-17T05:49:57.129 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:57.127+0000 7f84a27fc640 1 -- 172.21.15.150:0/3204115447 <== mgr.4108 v2:172.21.15.176:6800/3631216395 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f84ac0d1030 con 0x7f849007a210 2024-09-17T05:49:57.131 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:57.129+0000 7f84b3d62640 1 -- 172.21.15.150:0/3204115447 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f849007a210 msgr2=0x7f849007c720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:49:57.131 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:57.129+0000 7f84b3d62640 1 --2- 172.21.15.150:0/3204115447 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f849007a210 0x7f849007c720 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7f84ac1f74f0 tx=0x7f849c005f90 comp rx=0 tx=0).stop 2024-09-17T05:49:57.131 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:57.129+0000 7f84b3d62640 1 -- 172.21.15.150:0/3204115447 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f84ac06cda0 msgr2=0x7f84ac09aec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:49:57.131 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:57.129+0000 7f84b3d62640 1 --2- 172.21.15.150:0/3204115447 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f84ac06cda0 0x7f84ac09aec0 secure :-1 s=READY pgs=1223 cs=0 l=1 rev1=1 crypto rx=0x7f84a800e7f0 tx=0x7f84a800ecb0 comp rx=0 tx=0).stop 2024-09-17T05:49:57.131 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:57.129+0000 7f84b3d62640 1 -- 172.21.15.150:0/3204115447 shutdown_connections 2024-09-17T05:49:57.131 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:57.129+0000 7f84b3d62640 1 --2- 172.21.15.150:0/3204115447 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f84ac0cc830 0x7f84ac15f960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:49:57.132 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:57.129+0000 7f84b3d62640 1 --2- 172.21.15.150:0/3204115447 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f849007a210 0x7f849007c720 unknown :-1 s=CLOSED pgs=525 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:49:57.132 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:57.129+0000 7f84b3d62640 1 --2- 172.21.15.150:0/3204115447 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f84ac0af100 0x7f84ac15f420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:49:57.132 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:57.129+0000 7f84b3d62640 1 --2- 172.21.15.150:0/3204115447 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f84ac06cda0 0x7f84ac09aec0 unknown :-1 s=CLOSED pgs=1223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:49:57.132 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:57.129+0000 7f84b3d62640 1 -- 172.21.15.150:0/3204115447 >> 172.21.15.150:0/3204115447 conn(0x7f84ac0b2540 msgr2=0x7f84ac0b1230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:49:57.132 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:57.129+0000 7f84b3d62640 1 -- 172.21.15.150:0/3204115447 shutdown_connections 2024-09-17T05:49:57.132 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:57.129+0000 7f84b3d62640 1 -- 172.21.15.150:0/3204115447 wait complete. 2024-09-17T05:49:57.144 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume rm --force cephfs subvol_clone59314 2024-09-17T05:49:57.318 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:57.316+0000 7f38f1c41640 1 -- 172.21.15.150:0/949357295 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f38ec15cfc0 msgr2=0x7f38ec0b5610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:49:57.318 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:57.316+0000 7f38f1c41640 1 --2- 172.21.15.150:0/949357295 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f38ec15cfc0 0x7f38ec0b5610 secure :-1 s=READY pgs=1225 cs=0 l=1 rev1=1 crypto rx=0x7f38ec0aeed0 tx=0x7f38e002a530 comp rx=0 tx=0).stop 2024-09-17T05:49:57.319 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:57.316+0000 7f38f1c41640 1 -- 172.21.15.150:0/949357295 shutdown_connections 2024-09-17T05:49:57.319 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:57.316+0000 7f38f1c41640 1 --2- 172.21.15.150:0/949357295 >> v2:172.21.15.176:3300/0 conn(0x7f38ec0b5b50 0x7f38ec0af3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:49:57.319 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:57.316+0000 7f38f1c41640 1 --2- 172.21.15.150:0/949357295 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f38ec15cfc0 0x7f38ec0b5610 unknown :-1 s=CLOSED pgs=1225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:49:57.319 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:57.316+0000 7f38f1c41640 1 -- 172.21.15.150:0/949357295 >> 172.21.15.150:0/949357295 conn(0x7f38ec09aa50 msgr2=0x7f38ec0b2ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:49:57.319 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:57.316+0000 7f38f1c41640 1 -- 172.21.15.150:0/949357295 shutdown_connections 2024-09-17T05:49:57.319 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:57.316+0000 7f38f1c41640 1 -- 172.21.15.150:0/949357295 wait complete. 2024-09-17T05:49:57.320 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:57.318+0000 7f38f1c41640 1 Processor -- start 2024-09-17T05:49:57.320 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:57.318+0000 7f38f1c41640 1 -- start start 2024-09-17T05:49:57.322 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:57.319+0000 7f38f1c41640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f38ec0b42f0 0x7f38ec0c6260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:49:57.322 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:57.320+0000 7f38f1c41640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f38ec0b5b50 0x7f38ec0cca70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:49:57.323 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:57.320+0000 7f38f1c41640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f38ec15cfc0 0x7f38ec15dfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:49:57.323 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:57.320+0000 7f38f1c41640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f38ec0afab0 con 0x7f38ec15cfc0 2024-09-17T05:49:57.323 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:57.320+0000 7f38f1c41640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f38ec0af930 con 0x7f38ec0b42f0 2024-09-17T05:49:57.323 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:57.320+0000 7f38f1c41640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f38ec0afc30 con 0x7f38ec0b5b50 2024-09-17T05:49:57.323 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:57.320+0000 7f38ebfff640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f38ec15cfc0 0x7f38ec15dfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:49:57.323 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:57.320+0000 7f38ebfff640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f38ec15cfc0 0x7f38ec15dfe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:60590/0 (socket says 172.21.15.150:60590) 2024-09-17T05:49:57.323 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:57.320+0000 7f38ebfff640 1 -- 172.21.15.150:0/2026818742 learned_addr learned my addr 172.21.15.150:0/2026818742 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:49:57.323 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:57.320+0000 7f38eaffd640 1 --2- 172.21.15.150:0/2026818742 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f38ec0b5b50 0x7f38ec0cca70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:49:57.323 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:57.320+0000 7f38eb7fe640 1 --2- 172.21.15.150:0/2026818742 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f38ec0b42f0 0x7f38ec0c6260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:49:57.323 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:57.320+0000 7f38ebfff640 1 -- 172.21.15.150:0/2026818742 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f38ec0b5b50 msgr2=0x7f38ec0cca70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:49:57.323 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:57.320+0000 7f38ebfff640 1 --2- 172.21.15.150:0/2026818742 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f38ec0b5b50 0x7f38ec0cca70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:49:57.323 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:57.320+0000 7f38ebfff640 1 -- 172.21.15.150:0/2026818742 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f38ec0b42f0 msgr2=0x7f38ec0c6260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:49:57.323 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:57.320+0000 7f38ebfff640 1 --2- 172.21.15.150:0/2026818742 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f38ec0b42f0 0x7f38ec0c6260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:49:57.324 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:57.320+0000 7f38ebfff640 1 -- 172.21.15.150:0/2026818742 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f38ec0c6c00 con 0x7f38ec15cfc0 2024-09-17T05:49:57.324 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:57.320+0000 7f38ebfff640 1 --2- 172.21.15.150:0/2026818742 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f38ec15cfc0 0x7f38ec15dfe0 secure :-1 s=READY pgs=1226 cs=0 l=1 rev1=1 crypto rx=0x7f38e400ea40 tx=0x7f38e400ef00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:49:57.324 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:57.320+0000 7f38d3fff640 1 -- 172.21.15.150:0/2026818742 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38e400cde0 con 0x7f38ec15cfc0 2024-09-17T05:49:57.324 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:57.320+0000 7f38d3fff640 1 -- 172.21.15.150:0/2026818742 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f38e4004c10 con 0x7f38ec15cfc0 2024-09-17T05:49:57.324 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:57.320+0000 7f38f1c41640 1 -- 172.21.15.150:0/2026818742 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f38ec1f3930 con 0x7f38ec15cfc0 2024-09-17T05:49:57.324 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:57.320+0000 7f38d3fff640 1 -- 172.21.15.150:0/2026818742 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38e4005020 con 0x7f38ec15cfc0 2024-09-17T05:49:57.324 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:57.320+0000 7f38f1c41640 1 -- 172.21.15.150:0/2026818742 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f38ec0d01c0 con 0x7f38ec15cfc0 2024-09-17T05:49:57.325 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:57.321+0000 7f38f1c41640 1 -- 172.21.15.150:0/2026818742 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f38ec0c6970 con 0x7f38ec15cfc0 2024-09-17T05:49:57.325 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:57.322+0000 7f38d3fff640 1 -- 172.21.15.150:0/2026818742 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 32) ==== 103481+0+0 (secure 0 0 0) 0x7f38e40051c0 con 0x7f38ec15cfc0 2024-09-17T05:49:57.325 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:57.323+0000 7f38d3fff640 1 --2- 172.21.15.150:0/2026818742 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f38d807a210 0x7f38d807c720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:49:57.325 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:57.323+0000 7f38d3fff640 1 -- 172.21.15.150:0/2026818742 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 5822+0+0 (secure 0 0 0) 0x7f38e409a6d0 con 0x7f38ec15cfc0 2024-09-17T05:49:57.325 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:57.323+0000 7f38eb7fe640 1 --2- 172.21.15.150:0/2026818742 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f38d807a210 0x7f38d807c720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:49:57.325 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:57.323+0000 7f38eb7fe640 1 --2- 172.21.15.150:0/2026818742 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f38d807a210 0x7f38d807c720 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7f38dc000f60 tx=0x7f38dc009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:49:57.329 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:57.328+0000 7f38d3fff640 1 -- 172.21.15.150:0/2026818742 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f38e4063f40 con 0x7f38ec15cfc0 2024-09-17T05:49:57.537 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:57.535+0000 7f38f1c41640 1 -- 172.21.15.150:0/2026818742 --> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] -- mgr_command(tid 0: {"prefix": "fs subvolume rm", "force": true, "vol_name": "cephfs", "sub_name": "subvol_clone59314", "target": ["mon-mgr", ""]}) -- 0x7f38ec0d0460 con 0x7f38d807a210 2024-09-17T05:49:57.551 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:57.549+0000 7f38d3fff640 1 -- 172.21.15.150:0/2026818742 <== mgr.4108 v2:172.21.15.176:6800/3631216395 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f38ec0d0460 con 0x7f38d807a210 2024-09-17T05:49:57.555 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:57.553+0000 7f38f1c41640 1 -- 172.21.15.150:0/2026818742 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f38d807a210 msgr2=0x7f38d807c720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:49:57.555 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:57.553+0000 7f38f1c41640 1 --2- 172.21.15.150:0/2026818742 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f38d807a210 0x7f38d807c720 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7f38dc000f60 tx=0x7f38dc009040 comp rx=0 tx=0).stop 2024-09-17T05:49:57.555 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:57.553+0000 7f38f1c41640 1 -- 172.21.15.150:0/2026818742 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f38ec15cfc0 msgr2=0x7f38ec15dfe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:49:57.555 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:57.553+0000 7f38f1c41640 1 --2- 172.21.15.150:0/2026818742 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f38ec15cfc0 0x7f38ec15dfe0 secure :-1 s=READY pgs=1226 cs=0 l=1 rev1=1 crypto rx=0x7f38e400ea40 tx=0x7f38e400ef00 comp rx=0 tx=0).stop 2024-09-17T05:49:57.555 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:57.553+0000 7f38f1c41640 1 -- 172.21.15.150:0/2026818742 shutdown_connections 2024-09-17T05:49:57.555 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:57.553+0000 7f38f1c41640 1 --2- 172.21.15.150:0/2026818742 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f38d807a210 0x7f38d807c720 unknown :-1 s=CLOSED pgs=526 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:49:57.555 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:57.553+0000 7f38f1c41640 1 --2- 172.21.15.150:0/2026818742 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f38ec15cfc0 0x7f38ec15dfe0 unknown :-1 s=CLOSED pgs=1226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:49:57.556 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:57.553+0000 7f38f1c41640 1 --2- 172.21.15.150:0/2026818742 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f38ec0b5b50 0x7f38ec0cca70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:49:57.556 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:57.553+0000 7f38f1c41640 1 --2- 172.21.15.150:0/2026818742 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f38ec0b42f0 0x7f38ec0c6260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:49:57.556 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:57.553+0000 7f38f1c41640 1 -- 172.21.15.150:0/2026818742 >> 172.21.15.150:0/2026818742 conn(0x7f38ec09aa50 msgr2=0x7f38ec09ec60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:49:57.556 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:57.554+0000 7f38f1c41640 1 -- 172.21.15.150:0/2026818742 shutdown_connections 2024-09-17T05:49:57.556 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:57.554+0000 7f38f1c41640 1 -- 172.21.15.150:0/2026818742 wait complete. 2024-09-17T05:49:57.569 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume rm --force cephfs subvol_clone91801 2024-09-17T05:49:57.692 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:57.690+0000 7f3ed9d83640 1 -- 172.21.15.150:0/3190606427 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3ed40cc7d0 msgr2=0x7f3ed40b3120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:49:57.692 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:57.690+0000 7f3ed9d83640 1 --2- 172.21.15.150:0/3190606427 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3ed40cc7d0 0x7f3ed40b3120 secure :-1 s=READY pgs=1228 cs=0 l=1 rev1=1 crypto rx=0x7f3ed40ce2e0 tx=0x7f3ec402a410 comp rx=0 tx=0).stop 2024-09-17T05:49:57.692 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:57.690+0000 7f3ed9d83640 1 -- 172.21.15.150:0/3190606427 shutdown_connections 2024-09-17T05:49:57.692 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:57.690+0000 7f3ed9d83640 1 --2- 172.21.15.150:0/3190606427 >> v2:172.21.15.176:3300/0 conn(0x7f3ed415ba50 0x7f3ed40b36f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:49:57.692 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:57.690+0000 7f3ed9d83640 1 --2- 172.21.15.150:0/3190606427 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3ed40cc7d0 0x7f3ed40b3120 unknown :-1 s=CLOSED pgs=1228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:49:57.692 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:57.690+0000 7f3ed9d83640 1 -- 172.21.15.150:0/3190606427 >> 172.21.15.150:0/3190606427 conn(0x7f3ed40b2540 msgr2=0x7f3ed40d02d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:49:57.692 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:57.690+0000 7f3ed9d83640 1 -- 172.21.15.150:0/3190606427 shutdown_connections 2024-09-17T05:49:57.692 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:57.690+0000 7f3ed9d83640 1 -- 172.21.15.150:0/3190606427 wait complete. 2024-09-17T05:49:57.693 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:57.692+0000 7f3ed9d83640 1 Processor -- start 2024-09-17T05:49:57.693 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:57.692+0000 7f3ed9d83640 1 -- start start 2024-09-17T05:49:57.696 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:57.693+0000 7f3ed9d83640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3ed406f010 0x7f3ed415cf40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:49:57.696 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:57.693+0000 7f3ed9d83640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3ed40cc7d0 0x7f3ed41f5bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:49:57.696 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:57.693+0000 7f3ed9d83640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3ed415ba50 0x7f3ed4158240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:49:57.696 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:57.693+0000 7f3ed9d83640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f3ed4070010 con 0x7f3ed415ba50 2024-09-17T05:49:57.696 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:57.693+0000 7f3ed9d83640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f3ed406fe90 con 0x7f3ed406f010 2024-09-17T05:49:57.696 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:57.693+0000 7f3ed9d83640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f3ed40cb930 con 0x7f3ed40cc7d0 2024-09-17T05:49:57.696 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:57.693+0000 7f3ed3fff640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3ed415ba50 0x7f3ed4158240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:49:57.697 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:57.693+0000 7f3ed3fff640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3ed415ba50 0x7f3ed4158240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:60606/0 (socket says 172.21.15.150:60606) 2024-09-17T05:49:57.697 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:57.693+0000 7f3ed3fff640 1 -- 172.21.15.150:0/713387777 learned_addr learned my addr 172.21.15.150:0/713387777 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:49:57.697 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:57.693+0000 7f3ed37fe640 1 --2- 172.21.15.150:0/713387777 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3ed406f010 0x7f3ed415cf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:49:57.697 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:57.693+0000 7f3ed2ffd640 1 --2- 172.21.15.150:0/713387777 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3ed40cc7d0 0x7f3ed41f5bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:49:57.697 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:57.694+0000 7f3ed3fff640 1 -- 172.21.15.150:0/713387777 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3ed40cc7d0 msgr2=0x7f3ed41f5bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:49:57.697 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:57.694+0000 7f3ed3fff640 1 --2- 172.21.15.150:0/713387777 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3ed40cc7d0 0x7f3ed41f5bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:49:57.697 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:57.694+0000 7f3ed3fff640 1 -- 172.21.15.150:0/713387777 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3ed406f010 msgr2=0x7f3ed415cf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:49:57.697 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:57.694+0000 7f3ed3fff640 1 --2- 172.21.15.150:0/713387777 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3ed406f010 0x7f3ed415cf40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:49:57.697 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:57.694+0000 7f3ed3fff640 1 -- 172.21.15.150:0/713387777 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3ed40c8ea0 con 0x7f3ed415ba50 2024-09-17T05:49:57.697 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:57.694+0000 7f3ed3fff640 1 --2- 172.21.15.150:0/713387777 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3ed415ba50 0x7f3ed4158240 secure :-1 s=READY pgs=1229 cs=0 l=1 rev1=1 crypto rx=0x7f3ecc00cae0 tx=0x7f3ecc00a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:49:57.697 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:57.694+0000 7f3ebbfff640 1 -- 172.21.15.150:0/713387777 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ecc016020 con 0x7f3ed415ba50 2024-09-17T05:49:57.697 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:57.694+0000 7f3ebbfff640 1 -- 172.21.15.150:0/713387777 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f3ecc00ad30 con 0x7f3ed415ba50 2024-09-17T05:49:57.697 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:57.694+0000 7f3ed9d83640 1 -- 172.21.15.150:0/713387777 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3ed40c8210 con 0x7f3ed415ba50 2024-09-17T05:49:57.698 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:57.694+0000 7f3ebbfff640 1 -- 172.21.15.150:0/713387777 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ecc012680 con 0x7f3ed415ba50 2024-09-17T05:49:57.698 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:57.694+0000 7f3ed9d83640 1 -- 172.21.15.150:0/713387777 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3ed40c8790 con 0x7f3ed415ba50 2024-09-17T05:49:57.699 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:57.695+0000 7f3ed9d83640 1 -- 172.21.15.150:0/713387777 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3ed40cbde0 con 0x7f3ed415ba50 2024-09-17T05:49:57.699 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:57.696+0000 7f3ebbfff640 1 -- 172.21.15.150:0/713387777 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 32) ==== 103481+0+0 (secure 0 0 0) 0x7f3ecc019020 con 0x7f3ed415ba50 2024-09-17T05:49:57.699 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:57.696+0000 7f3ebbfff640 1 --2- 172.21.15.150:0/713387777 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f3ec007a240 0x7f3ec007c750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:49:57.699 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:57.696+0000 7f3ebbfff640 1 -- 172.21.15.150:0/713387777 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 5878+0+0 (secure 0 0 0) 0x7f3ecc099bf0 con 0x7f3ed415ba50 2024-09-17T05:49:57.699 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:57.696+0000 7f3ed37fe640 1 --2- 172.21.15.150:0/713387777 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f3ec007a240 0x7f3ec007c750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:49:57.699 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:57.697+0000 7f3ed37fe640 1 --2- 172.21.15.150:0/713387777 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f3ec007a240 0x7f3ec007c750 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7f3ec4034000 tx=0x7f3ec4004730 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:49:57.702 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:57.701+0000 7f3ebbfff640 1 -- 172.21.15.150:0/713387777 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f3ecc020030 con 0x7f3ed415ba50 2024-09-17T05:49:57.903 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:57.901+0000 7f3ed9d83640 1 -- 172.21.15.150:0/713387777 --> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] -- mgr_command(tid 0: {"prefix": "fs subvolume rm", "force": true, "vol_name": "cephfs", "sub_name": "subvol_clone91801", "target": ["mon-mgr", ""]}) -- 0x7f3ed40d0ec0 con 0x7f3ec007a240 2024-09-17T05:49:57.925 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:57.924+0000 7f3ebbfff640 1 -- 172.21.15.150:0/713387777 <== mgr.4108 v2:172.21.15.176:6800/3631216395 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f3ed40d0ec0 con 0x7f3ec007a240 2024-09-17T05:49:57.928 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:57.926+0000 7f3ed9d83640 1 -- 172.21.15.150:0/713387777 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f3ec007a240 msgr2=0x7f3ec007c750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:49:57.928 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:57.926+0000 7f3ed9d83640 1 --2- 172.21.15.150:0/713387777 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f3ec007a240 0x7f3ec007c750 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7f3ec4034000 tx=0x7f3ec4004730 comp rx=0 tx=0).stop 2024-09-17T05:49:57.928 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:57.926+0000 7f3ed9d83640 1 -- 172.21.15.150:0/713387777 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3ed415ba50 msgr2=0x7f3ed4158240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:49:57.928 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:57.926+0000 7f3ed9d83640 1 --2- 172.21.15.150:0/713387777 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3ed415ba50 0x7f3ed4158240 secure :-1 s=READY pgs=1229 cs=0 l=1 rev1=1 crypto rx=0x7f3ecc00cae0 tx=0x7f3ecc00a060 comp rx=0 tx=0).stop 2024-09-17T05:49:57.928 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:57.926+0000 7f3ed9d83640 1 -- 172.21.15.150:0/713387777 shutdown_connections 2024-09-17T05:49:57.929 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:57.926+0000 7f3ed9d83640 1 --2- 172.21.15.150:0/713387777 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f3ec007a240 0x7f3ec007c750 unknown :-1 s=CLOSED pgs=527 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:49:57.929 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:57.926+0000 7f3ed9d83640 1 --2- 172.21.15.150:0/713387777 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3ed415ba50 0x7f3ed4158240 unknown :-1 s=CLOSED pgs=1229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:49:57.929 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:57.926+0000 7f3ed9d83640 1 --2- 172.21.15.150:0/713387777 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3ed40cc7d0 0x7f3ed41f5bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:49:57.929 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:57.926+0000 7f3ed9d83640 1 --2- 172.21.15.150:0/713387777 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3ed406f010 0x7f3ed415cf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:49:57.929 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:57.926+0000 7f3ed9d83640 1 -- 172.21.15.150:0/713387777 >> 172.21.15.150:0/713387777 conn(0x7f3ed40b2540 msgr2=0x7f3ed40b3d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:49:57.929 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:57.926+0000 7f3ed9d83640 1 -- 172.21.15.150:0/713387777 shutdown_connections 2024-09-17T05:49:57.929 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:57.926+0000 7f3ed9d83640 1 -- 172.21.15.150:0/713387777 wait complete. 2024-09-17T05:49:57.940 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume rm --force cephfs subvol_clone94949 2024-09-17T05:49:58.062 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:58.060+0000 7f4713520640 1 -- 172.21.15.150:0/1326088337 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f470c15ba80 msgr2=0x7f470c15be90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:49:58.063 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:58.060+0000 7f4713520640 1 --2- 172.21.15.150:0/1326088337 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f470c15ba80 0x7f470c15be90 secure :-1 s=READY pgs=1230 cs=0 l=1 rev1=1 crypto rx=0x7f470c072be0 tx=0x7f46fc02a560 comp rx=0 tx=0).stop 2024-09-17T05:49:58.063 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:58.060+0000 7f4713520640 1 -- 172.21.15.150:0/1326088337 shutdown_connections 2024-09-17T05:49:58.063 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:58.060+0000 7f4713520640 1 --2- 172.21.15.150:0/1326088337 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f470c0b5610 0x7f470c0b5a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:49:58.063 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:58.060+0000 7f4713520640 1 --2- 172.21.15.150:0/1326088337 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f470c15ba80 0x7f470c15be90 unknown :-1 s=CLOSED pgs=1230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:49:58.063 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:58.060+0000 7f4713520640 1 --2- 172.21.15.150:0/1326088337 >> v2:172.21.15.176:3300/0 conn(0x7f470c0b42f0 0x7f470c15cfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:49:58.063 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:58.060+0000 7f4713520640 1 -- 172.21.15.150:0/1326088337 >> 172.21.15.150:0/1326088337 conn(0x7f470c09aa50 msgr2=0x7f470c0b2ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:49:58.063 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:58.060+0000 7f4713520640 1 -- 172.21.15.150:0/1326088337 shutdown_connections 2024-09-17T05:49:58.063 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:58.060+0000 7f4713520640 1 -- 172.21.15.150:0/1326088337 wait complete. 2024-09-17T05:49:58.064 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:58.062+0000 7f4713520640 1 Processor -- start 2024-09-17T05:49:58.064 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:58.062+0000 7f4713520640 1 -- start start 2024-09-17T05:49:58.066 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:58.063+0000 7f4713520640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f470c0b42f0 0x7f470c151b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:49:58.067 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:58.063+0000 7f4713520640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f470c0b5610 0x7f470c0afd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:49:58.067 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:58.063+0000 7f4713520640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f470c15ba80 0x7f470c0b02c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:49:58.067 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:58.063+0000 7f4713520640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f470c0af780 con 0x7f470c0b42f0 2024-09-17T05:49:58.067 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:58.063+0000 7f4713520640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f470c0af600 con 0x7f470c0b5610 2024-09-17T05:49:58.067 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:58.063+0000 7f4713520640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f470c0af900 con 0x7f470c15ba80 2024-09-17T05:49:58.067 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:58.064+0000 7f47112bc640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f470c0b42f0 0x7f470c151b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:49:58.067 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:58.064+0000 7f47112bc640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f470c0b42f0 0x7f470c151b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:60632/0 (socket says 172.21.15.150:60632) 2024-09-17T05:49:58.067 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:58.064+0000 7f47112bc640 1 -- 172.21.15.150:0/676654101 learned_addr learned my addr 172.21.15.150:0/676654101 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:49:58.067 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:58.064+0000 7f4710abb640 1 --2- 172.21.15.150:0/676654101 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f470c0b5610 0x7f470c0afd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:49:58.067 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:58.064+0000 7f4711abd640 1 --2- 172.21.15.150:0/676654101 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f470c15ba80 0x7f470c0b02c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:49:58.067 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:58.064+0000 7f47112bc640 1 -- 172.21.15.150:0/676654101 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f470c15ba80 msgr2=0x7f470c0b02c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:49:58.067 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:58.064+0000 7f47112bc640 1 --2- 172.21.15.150:0/676654101 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f470c15ba80 0x7f470c0b02c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:49:58.067 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:58.064+0000 7f47112bc640 1 -- 172.21.15.150:0/676654101 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f470c0b5610 msgr2=0x7f470c0afd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:49:58.068 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:58.064+0000 7f47112bc640 1 --2- 172.21.15.150:0/676654101 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f470c0b5610 0x7f470c0afd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:49:58.068 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:58.064+0000 7f47112bc640 1 -- 172.21.15.150:0/676654101 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f470c0b13e0 con 0x7f470c0b42f0 2024-09-17T05:49:58.068 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:58.064+0000 7f47112bc640 1 --2- 172.21.15.150:0/676654101 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f470c0b42f0 0x7f470c151b80 secure :-1 s=READY pgs=1231 cs=0 l=1 rev1=1 crypto rx=0x7f470800c940 tx=0x7f470800ce00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:49:58.068 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:58.064+0000 7f4701ffb640 1 -- 172.21.15.150:0/676654101 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4708004220 con 0x7f470c0b42f0 2024-09-17T05:49:58.068 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:58.064+0000 7f4701ffb640 1 -- 172.21.15.150:0/676654101 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f47080079b0 con 0x7f470c0b42f0 2024-09-17T05:49:58.068 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:58.064+0000 7f4713520640 1 -- 172.21.15.150:0/676654101 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f470c14a9d0 con 0x7f470c0b42f0 2024-09-17T05:49:58.068 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:58.064+0000 7f4701ffb640 1 -- 172.21.15.150:0/676654101 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4708007de0 con 0x7f470c0b42f0 2024-09-17T05:49:58.068 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:58.064+0000 7f4713520640 1 -- 172.21.15.150:0/676654101 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f470c14c530 con 0x7f470c0b42f0 2024-09-17T05:49:58.069 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:58.065+0000 7f4713520640 1 -- 172.21.15.150:0/676654101 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f470c0b5a20 con 0x7f470c0b42f0 2024-09-17T05:49:58.069 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:58.066+0000 7f4701ffb640 1 -- 172.21.15.150:0/676654101 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 32) ==== 103481+0+0 (secure 0 0 0) 0x7f4708005020 con 0x7f470c0b42f0 2024-09-17T05:49:58.069 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:58.067+0000 7f4701ffb640 1 --2- 172.21.15.150:0/676654101 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f46f007a210 0x7f46f007c720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:49:58.069 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:58.067+0000 7f4701ffb640 1 -- 172.21.15.150:0/676654101 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 5878+0+0 (secure 0 0 0) 0x7f4708099d10 con 0x7f470c0b42f0 2024-09-17T05:49:58.069 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:58.067+0000 7f4710abb640 1 --2- 172.21.15.150:0/676654101 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f46f007a210 0x7f46f007c720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:49:58.069 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:58.067+0000 7f4710abb640 1 --2- 172.21.15.150:0/676654101 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f46f007a210 0x7f46f007c720 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7f46fc033000 tx=0x7f46fc004730 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:49:58.073 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:58.071+0000 7f4701ffb640 1 -- 172.21.15.150:0/676654101 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f4708014030 con 0x7f470c0b42f0 2024-09-17T05:49:58.417 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:58.416+0000 7f4713520640 1 -- 172.21.15.150:0/676654101 --> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] -- mgr_command(tid 0: {"prefix": "fs subvolume rm", "force": true, "vol_name": "cephfs", "sub_name": "subvol_clone94949", "target": ["mon-mgr", ""]}) -- 0x7f470c0b16c0 con 0x7f46f007a210 2024-09-17T05:49:58.447 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:58.446+0000 7f4701ffb640 1 -- 172.21.15.150:0/676654101 <== mgr.4108 v2:172.21.15.176:6800/3631216395 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f46fc004040 con 0x7f46f007a210 2024-09-17T05:49:58.451 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:58.449+0000 7f4713520640 1 -- 172.21.15.150:0/676654101 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f46f007a210 msgr2=0x7f46f007c720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:49:58.451 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:58.449+0000 7f4713520640 1 --2- 172.21.15.150:0/676654101 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f46f007a210 0x7f46f007c720 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7f46fc033000 tx=0x7f46fc004730 comp rx=0 tx=0).stop 2024-09-17T05:49:58.451 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:58.449+0000 7f4713520640 1 -- 172.21.15.150:0/676654101 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f470c0b42f0 msgr2=0x7f470c151b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:49:58.451 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:58.449+0000 7f4713520640 1 --2- 172.21.15.150:0/676654101 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f470c0b42f0 0x7f470c151b80 secure :-1 s=READY pgs=1231 cs=0 l=1 rev1=1 crypto rx=0x7f470800c940 tx=0x7f470800ce00 comp rx=0 tx=0).stop 2024-09-17T05:49:58.452 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:58.449+0000 7f4713520640 1 -- 172.21.15.150:0/676654101 shutdown_connections 2024-09-17T05:49:58.452 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:58.449+0000 7f4713520640 1 --2- 172.21.15.150:0/676654101 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f470c0b5610 0x7f470c0afd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:49:58.452 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:58.449+0000 7f4713520640 1 --2- 172.21.15.150:0/676654101 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f46f007a210 0x7f46f007c720 unknown :-1 s=CLOSED pgs=528 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:49:58.452 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:58.449+0000 7f4713520640 1 --2- 172.21.15.150:0/676654101 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f470c15ba80 0x7f470c0b02c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:49:58.452 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:58.449+0000 7f4713520640 1 --2- 172.21.15.150:0/676654101 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f470c0b42f0 0x7f470c151b80 unknown :-1 s=CLOSED pgs=1231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:49:58.452 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:58.449+0000 7f4713520640 1 -- 172.21.15.150:0/676654101 >> 172.21.15.150:0/676654101 conn(0x7f470c09aa50 msgr2=0x7f470c15f0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:49:58.452 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:58.450+0000 7f4713520640 1 -- 172.21.15.150:0/676654101 shutdown_connections 2024-09-17T05:49:58.452 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:58.450+0000 7f4713520640 1 -- 172.21.15.150:0/676654101 wait complete. 2024-09-17T05:49:58.467 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume rm --force cephfs subvol_clone408019 2024-09-17T05:49:58.647 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:58.645+0000 7f252f59e640 1 -- 172.21.15.150:0/190540592 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f25280520b0 msgr2=0x7f2528007c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:49:58.647 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:58.645+0000 7f252f59e640 1 --2- 172.21.15.150:0/190540592 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f25280520b0 0x7f2528007c60 secure :-1 s=READY pgs=1232 cs=0 l=1 rev1=1 crypto rx=0x7f252800e200 tx=0x7f252402a440 comp rx=0 tx=0).stop 2024-09-17T05:49:58.647 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:58.645+0000 7f252f59e640 1 -- 172.21.15.150:0/190540592 shutdown_connections 2024-09-17T05:49:58.647 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:58.645+0000 7f252f59e640 1 --2- 172.21.15.150:0/190540592 >> v2:172.21.15.176:3300/0 conn(0x7f2528053710 0x7f2528053b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:49:58.647 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:58.645+0000 7f252f59e640 1 --2- 172.21.15.150:0/190540592 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f25280520b0 0x7f2528007c60 unknown :-1 s=CLOSED pgs=1232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:49:58.647 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:58.645+0000 7f252f59e640 1 -- 172.21.15.150:0/190540592 >> 172.21.15.150:0/190540592 conn(0x7f252801e260 msgr2=0x7f2528039e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:49:58.648 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:58.645+0000 7f252f59e640 1 -- 172.21.15.150:0/190540592 shutdown_connections 2024-09-17T05:49:58.648 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:58.645+0000 7f252f59e640 1 -- 172.21.15.150:0/190540592 wait complete. 2024-09-17T05:49:58.649 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:58.647+0000 7f252f59e640 1 Processor -- start 2024-09-17T05:49:58.649 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:58.647+0000 7f252f59e640 1 -- start start 2024-09-17T05:49:58.651 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:58.649+0000 7f252f59e640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2528053710 0x7f2528034640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:49:58.651 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:58.649+0000 7f252f59e640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f25280df800 0x7f25280cdce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:49:58.651 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:58.649+0000 7f252f59e640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f252804abf0 0x7f252804b000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:49:58.652 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:58.650+0000 7f252f59e640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f25280541e0 con 0x7f2528053710 2024-09-17T05:49:58.652 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:58.650+0000 7f252f59e640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f2528054060 con 0x7f25280df800 2024-09-17T05:49:58.652 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:58.650+0000 7f252f59e640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f2528054360 con 0x7f252804abf0 2024-09-17T05:49:58.653 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:58.650+0000 7f252ed9d640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f252804abf0 0x7f252804b000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:49:58.654 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:58.650+0000 7f252ed9d640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f252804abf0 0x7f252804b000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3301/0 says I am v2:172.21.15.150:54562/0 (socket says 172.21.15.150:54562) 2024-09-17T05:49:58.654 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:58.650+0000 7f252ed9d640 1 -- 172.21.15.150:0/3980015528 learned_addr learned my addr 172.21.15.150:0/3980015528 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:49:58.654 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:58.650+0000 7f252dd9b640 1 --2- 172.21.15.150:0/3980015528 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f25280df800 0x7f25280cdce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:49:58.654 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:58.650+0000 7f252e59c640 1 --2- 172.21.15.150:0/3980015528 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2528053710 0x7f2528034640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:49:58.654 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:58.651+0000 7f252dd9b640 1 -- 172.21.15.150:0/3980015528 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f252804abf0 msgr2=0x7f252804b000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:49:58.654 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:58.651+0000 7f252dd9b640 1 --2- 172.21.15.150:0/3980015528 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f252804abf0 0x7f252804b000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:49:58.654 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:58.651+0000 7f252dd9b640 1 -- 172.21.15.150:0/3980015528 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2528053710 msgr2=0x7f2528034640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:49:58.654 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:58.651+0000 7f252dd9b640 1 --2- 172.21.15.150:0/3980015528 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2528053710 0x7f2528034640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:49:58.654 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:58.651+0000 7f252dd9b640 1 -- 172.21.15.150:0/3980015528 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f252804b540 con 0x7f25280df800 2024-09-17T05:49:58.654 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:58.651+0000 7f252e59c640 1 --2- 172.21.15.150:0/3980015528 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2528053710 0x7f2528034640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T05:49:58.654 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:58.651+0000 7f252dd9b640 1 --2- 172.21.15.150:0/3980015528 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f25280df800 0x7f25280cdce0 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f2528037af0 tx=0x7f2524033ba0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:49:58.654 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:58.652+0000 7f251effd640 1 -- 172.21.15.150:0/3980015528 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2524031b50 con 0x7f25280df800 2024-09-17T05:49:58.655 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:58.652+0000 7f251effd640 1 -- 172.21.15.150:0/3980015528 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f2524031d10 con 0x7f25280df800 2024-09-17T05:49:58.655 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:58.652+0000 7f251effd640 1 -- 172.21.15.150:0/3980015528 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2524033330 con 0x7f25280df800 2024-09-17T05:49:58.655 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:58.652+0000 7f252f59e640 1 -- 172.21.15.150:0/3980015528 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2528177d10 con 0x7f25280df800 2024-09-17T05:49:58.655 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:58.652+0000 7f252f59e640 1 -- 172.21.15.150:0/3980015528 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f25281782d0 con 0x7f25280df800 2024-09-17T05:49:58.656 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:58.655+0000 7f251effd640 1 -- 172.21.15.150:0/3980015528 <== mon.1 v2:172.21.15.176:3300/0 4 ==== mgrmap(e 32) ==== 103481+0+0 (secure 0 0 0) 0x7f25240334d0 con 0x7f25280df800 2024-09-17T05:49:58.657 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:58.655+0000 7f251effd640 1 --2- 172.21.15.150:0/3980015528 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f251007a210 0x7f251007c720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:49:58.657 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:58.656+0000 7f251effd640 1 -- 172.21.15.150:0/3980015528 <== mon.1 v2:172.21.15.176:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 5878+0+0 (secure 0 0 0) 0x7f25240baa80 con 0x7f25280df800 2024-09-17T05:49:58.657 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:58.656+0000 7f252f59e640 1 -- 172.21.15.150:0/3980015528 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2528054810 con 0x7f25280df800 2024-09-17T05:49:58.658 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:58.656+0000 7f252e59c640 1 --2- 172.21.15.150:0/3980015528 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f251007a210 0x7f251007c720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:49:58.659 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:58.657+0000 7f252e59c640 1 --2- 172.21.15.150:0/3980015528 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f251007a210 0x7f251007c720 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7f2520007f20 tx=0x7f2520007eb0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:49:58.667 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:58.665+0000 7f251effd640 1 -- 172.21.15.150:0/3980015528 <== mon.1 v2:172.21.15.176:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f252804b540 con 0x7f25280df800 2024-09-17T05:49:58.943 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:58.941+0000 7f252f59e640 1 -- 172.21.15.150:0/3980015528 --> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] -- mgr_command(tid 0: {"prefix": "fs subvolume rm", "force": true, "vol_name": "cephfs", "sub_name": "subvol_clone408019", "target": ["mon-mgr", ""]}) -- 0x7f2528034d40 con 0x7f251007a210 2024-09-17T05:49:58.958 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:58.957+0000 7f251effd640 1 -- 172.21.15.150:0/3980015528 <== mgr.4108 v2:172.21.15.176:6800/3631216395 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f2528034d40 con 0x7f251007a210 2024-09-17T05:49:58.961 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:58.959+0000 7f252f59e640 1 -- 172.21.15.150:0/3980015528 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f251007a210 msgr2=0x7f251007c720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:49:58.961 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:58.959+0000 7f252f59e640 1 --2- 172.21.15.150:0/3980015528 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f251007a210 0x7f251007c720 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7f2520007f20 tx=0x7f2520007eb0 comp rx=0 tx=0).stop 2024-09-17T05:49:58.961 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:58.959+0000 7f252f59e640 1 -- 172.21.15.150:0/3980015528 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f25280df800 msgr2=0x7f25280cdce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:49:58.961 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:58.959+0000 7f252f59e640 1 --2- 172.21.15.150:0/3980015528 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f25280df800 0x7f25280cdce0 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f2528037af0 tx=0x7f2524033ba0 comp rx=0 tx=0).stop 2024-09-17T05:49:58.961 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:58.959+0000 7f252f59e640 1 -- 172.21.15.150:0/3980015528 shutdown_connections 2024-09-17T05:49:58.961 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:58.959+0000 7f252f59e640 1 --2- 172.21.15.150:0/3980015528 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f25280df800 0x7f25280cdce0 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:49:58.961 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:58.959+0000 7f252f59e640 1 --2- 172.21.15.150:0/3980015528 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f251007a210 0x7f251007c720 unknown :-1 s=CLOSED pgs=529 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:49:58.961 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:58.959+0000 7f252f59e640 1 --2- 172.21.15.150:0/3980015528 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f252804abf0 0x7f252804b000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:49:58.961 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:58.959+0000 7f252f59e640 1 --2- 172.21.15.150:0/3980015528 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2528053710 0x7f2528034640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:49:58.961 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:58.959+0000 7f252f59e640 1 -- 172.21.15.150:0/3980015528 >> 172.21.15.150:0/3980015528 conn(0x7f252801e260 msgr2=0x7f25280dea60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:49:58.962 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:58.959+0000 7f252f59e640 1 -- 172.21.15.150:0/3980015528 shutdown_connections 2024-09-17T05:49:58.962 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:58.959+0000 7f252f59e640 1 -- 172.21.15.150:0/3980015528 wait complete. 2024-09-17T05:49:58.972 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume rm --force cephfs subvol_clone57205 2024-09-17T05:49:59.094 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:59.092+0000 7fa80ca0e640 1 -- 172.21.15.150:0/2047102318 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa8080b1d80 msgr2=0x7fa8080d0c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:49:59.094 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:59.092+0000 7fa80ca0e640 1 --2- 172.21.15.150:0/2047102318 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa8080b1d80 0x7fa8080d0c90 secure :-1 s=READY pgs=1233 cs=0 l=1 rev1=1 crypto rx=0x7fa808074240 tx=0x7fa7fc02a680 comp rx=0 tx=0).stop 2024-09-17T05:49:59.094 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:59.092+0000 7fa80ca0e640 1 -- 172.21.15.150:0/2047102318 shutdown_connections 2024-09-17T05:49:59.094 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:59.092+0000 7fa80ca0e640 1 --2- 172.21.15.150:0/2047102318 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa8080b1d80 0x7fa8080d0c90 unknown :-1 s=CLOSED pgs=1233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:49:59.094 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:59.092+0000 7fa80ca0e640 1 --2- 172.21.15.150:0/2047102318 >> v2:172.21.15.176:3300/0 conn(0x7fa8080d0520 0x7fa8080b7a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:49:59.094 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:59.092+0000 7fa80ca0e640 1 -- 172.21.15.150:0/2047102318 >> 172.21.15.150:0/2047102318 conn(0x7fa8080cef30 msgr2=0x7fa8080cf340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:49:59.094 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:59.092+0000 7fa80ca0e640 1 -- 172.21.15.150:0/2047102318 shutdown_connections 2024-09-17T05:49:59.094 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:59.092+0000 7fa80ca0e640 1 -- 172.21.15.150:0/2047102318 wait complete. 2024-09-17T05:49:59.095 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:59.094+0000 7fa80ca0e640 1 Processor -- start 2024-09-17T05:49:59.095 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:59.094+0000 7fa80ca0e640 1 -- start start 2024-09-17T05:49:59.098 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:59.095+0000 7fa80ca0e640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa8080b1d80 0x7fa80814d6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:49:59.098 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:59.095+0000 7fa80ca0e640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa8080d0520 0x7fa808155c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:49:59.098 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:59.095+0000 7fa80ca0e640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa8080d11d0 0x7fa8081561b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:49:59.098 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:59.095+0000 7fa80ca0e640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7fa808070f20 con 0x7fa8080b1d80 2024-09-17T05:49:59.098 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:59.095+0000 7fa80ca0e640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fa8080d3310 con 0x7fa8080d11d0 2024-09-17T05:49:59.098 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:59.095+0000 7fa80ca0e640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fa8080b2190 con 0x7fa8080d0520 2024-09-17T05:49:59.098 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:59.095+0000 7fa80659c640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa8080b1d80 0x7fa80814d6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:49:59.099 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:59.095+0000 7fa80659c640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa8080b1d80 0x7fa80814d6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:60666/0 (socket says 172.21.15.150:60666) 2024-09-17T05:49:59.099 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:59.095+0000 7fa80659c640 1 -- 172.21.15.150:0/2629614216 learned_addr learned my addr 172.21.15.150:0/2629614216 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:49:59.099 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:59.095+0000 7fa805d9b640 1 --2- 172.21.15.150:0/2629614216 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa8080d0520 0x7fa808155c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:49:59.099 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:59.095+0000 7fa806d9d640 1 --2- 172.21.15.150:0/2629614216 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa8080d11d0 0x7fa8081561b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:49:59.099 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:59.095+0000 7fa80659c640 1 -- 172.21.15.150:0/2629614216 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa8080d0520 msgr2=0x7fa808155c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:49:59.099 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:59.095+0000 7fa80659c640 1 --2- 172.21.15.150:0/2629614216 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa8080d0520 0x7fa808155c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:49:59.099 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:59.095+0000 7fa80659c640 1 -- 172.21.15.150:0/2629614216 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa8080d11d0 msgr2=0x7fa8081561b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:49:59.099 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:59.095+0000 7fa80659c640 1 --2- 172.21.15.150:0/2629614216 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa8080d11d0 0x7fa8081561b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:49:59.099 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:59.095+0000 7fa80659c640 1 -- 172.21.15.150:0/2629614216 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa80806df50 con 0x7fa8080b1d80 2024-09-17T05:49:59.099 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:59.095+0000 7fa806d9d640 1 --2- 172.21.15.150:0/2629614216 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa8080d11d0 0x7fa8081561b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:49:59.099 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:59.095+0000 7fa805d9b640 1 --2- 172.21.15.150:0/2629614216 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa8080d0520 0x7fa808155c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:49:59.099 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:59.096+0000 7fa80659c640 1 --2- 172.21.15.150:0/2629614216 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa8080b1d80 0x7fa80814d6d0 secure :-1 s=READY pgs=1234 cs=0 l=1 rev1=1 crypto rx=0x7fa7f800e790 tx=0x7fa7f800ec50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:49:59.099 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:59.096+0000 7fa7f6ffd640 1 -- 172.21.15.150:0/2629614216 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7f800eea0 con 0x7fa8080b1d80 2024-09-17T05:49:59.100 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:59.096+0000 7fa7f6ffd640 1 -- 172.21.15.150:0/2629614216 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa7f800cdb0 con 0x7fa8080b1d80 2024-09-17T05:49:59.100 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:59.096+0000 7fa7f6ffd640 1 -- 172.21.15.150:0/2629614216 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7f8010690 con 0x7fa8080b1d80 2024-09-17T05:49:59.100 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:59.096+0000 7fa80ca0e640 1 -- 172.21.15.150:0/2629614216 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa80806e1f0 con 0x7fa8080b1d80 2024-09-17T05:49:59.100 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:59.096+0000 7fa80ca0e640 1 -- 172.21.15.150:0/2629614216 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa80806e7b0 con 0x7fa8080b1d80 2024-09-17T05:49:59.101 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:59.097+0000 7fa80ca0e640 1 -- 172.21.15.150:0/2629614216 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa8080d0c90 con 0x7fa8080b1d80 2024-09-17T05:49:59.101 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:59.097+0000 7fa7f6ffd640 1 -- 172.21.15.150:0/2629614216 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 32) ==== 103481+0+0 (secure 0 0 0) 0x7fa7f8010830 con 0x7fa8080b1d80 2024-09-17T05:49:59.101 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:59.098+0000 7fa7f6ffd640 1 --2- 172.21.15.150:0/2629614216 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fa7e807a210 0x7fa7e807c720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:49:59.101 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:59.098+0000 7fa7f6ffd640 1 -- 172.21.15.150:0/2629614216 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 5878+0+0 (secure 0 0 0) 0x7fa7f809a480 con 0x7fa8080b1d80 2024-09-17T05:49:59.101 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:59.098+0000 7fa805d9b640 1 --2- 172.21.15.150:0/2629614216 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fa7e807a210 0x7fa7e807c720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:49:59.101 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:59.099+0000 7fa805d9b640 1 --2- 172.21.15.150:0/2629614216 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fa7e807a210 0x7fa7e807c720 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7fa7fc033000 tx=0x7fa7fc004730 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:49:59.104 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:59.102+0000 7fa7f6ffd640 1 -- 172.21.15.150:0/2629614216 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fa7f80643c0 con 0x7fa8080b1d80 2024-09-17T05:49:59.466 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:59.464+0000 7fa80ca0e640 1 -- 172.21.15.150:0/2629614216 --> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] -- mgr_command(tid 0: {"prefix": "fs subvolume rm", "force": true, "vol_name": "cephfs", "sub_name": "subvol_clone57205", "target": ["mon-mgr", ""]}) -- 0x7fa8080cb9a0 con 0x7fa7e807a210 2024-09-17T05:49:59.500 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:59.498+0000 7fa7f6ffd640 1 -- 172.21.15.150:0/2629614216 <== mgr.4108 v2:172.21.15.176:6800/3631216395 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7fa8080cb9a0 con 0x7fa7e807a210 2024-09-17T05:49:59.503 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:59.502+0000 7fa80ca0e640 1 -- 172.21.15.150:0/2629614216 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fa7e807a210 msgr2=0x7fa7e807c720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:49:59.504 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:59.502+0000 7fa80ca0e640 1 --2- 172.21.15.150:0/2629614216 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fa7e807a210 0x7fa7e807c720 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7fa7fc033000 tx=0x7fa7fc004730 comp rx=0 tx=0).stop 2024-09-17T05:49:59.504 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:59.502+0000 7fa80ca0e640 1 -- 172.21.15.150:0/2629614216 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa8080b1d80 msgr2=0x7fa80814d6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:49:59.504 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:59.502+0000 7fa80ca0e640 1 --2- 172.21.15.150:0/2629614216 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa8080b1d80 0x7fa80814d6d0 secure :-1 s=READY pgs=1234 cs=0 l=1 rev1=1 crypto rx=0x7fa7f800e790 tx=0x7fa7f800ec50 comp rx=0 tx=0).stop 2024-09-17T05:49:59.504 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:59.502+0000 7fa80ca0e640 1 -- 172.21.15.150:0/2629614216 shutdown_connections 2024-09-17T05:49:59.504 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:59.502+0000 7fa80ca0e640 1 --2- 172.21.15.150:0/2629614216 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa8080d11d0 0x7fa8081561b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:49:59.504 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:59.502+0000 7fa80ca0e640 1 --2- 172.21.15.150:0/2629614216 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fa7e807a210 0x7fa7e807c720 unknown :-1 s=CLOSED pgs=530 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:49:59.504 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:59.502+0000 7fa80ca0e640 1 --2- 172.21.15.150:0/2629614216 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa8080d0520 0x7fa808155c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:49:59.504 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:59.502+0000 7fa80ca0e640 1 --2- 172.21.15.150:0/2629614216 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa8080b1d80 0x7fa80814d6d0 unknown :-1 s=CLOSED pgs=1234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:49:59.504 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:59.502+0000 7fa80ca0e640 1 -- 172.21.15.150:0/2629614216 >> 172.21.15.150:0/2629614216 conn(0x7fa8080cef30 msgr2=0x7fa8080b2690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:49:59.504 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:59.502+0000 7fa80ca0e640 1 -- 172.21.15.150:0/2629614216 shutdown_connections 2024-09-17T05:49:59.504 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:59.502+0000 7fa80ca0e640 1 -- 172.21.15.150:0/2629614216 wait complete. 2024-09-17T05:49:59.520 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume rm --force cephfs subvol_clone818314 2024-09-17T05:49:59.706 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:59.703+0000 7f8f7b78b640 1 -- 172.21.15.150:0/3761081727 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8f740cf380 msgr2=0x7f8f740d0290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:49:59.706 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:59.703+0000 7f8f7b78b640 1 --2- 172.21.15.150:0/3761081727 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8f740cf380 0x7f8f740d0290 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f8f70009860 tx=0x7f8f7002a5d0 comp rx=0 tx=0).stop 2024-09-17T05:49:59.706 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:59.703+0000 7f8f7b78b640 1 -- 172.21.15.150:0/3761081727 shutdown_connections 2024-09-17T05:49:59.706 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:59.703+0000 7f8f7b78b640 1 --2- 172.21.15.150:0/3761081727 >> v2:172.21.15.176:3300/0 conn(0x7f8f740b6800 0x7f8f74168a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:49:59.706 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:59.703+0000 7f8f7b78b640 1 --2- 172.21.15.150:0/3761081727 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8f740cf380 0x7f8f740d0290 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:49:59.706 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:59.703+0000 7f8f7b78b640 1 -- 172.21.15.150:0/3761081727 >> 172.21.15.150:0/3761081727 conn(0x7f8f740d4670 msgr2=0x7f8f740d4a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:49:59.706 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:59.704+0000 7f8f7b78b640 1 -- 172.21.15.150:0/3761081727 shutdown_connections 2024-09-17T05:49:59.706 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:59.704+0000 7f8f7b78b640 1 -- 172.21.15.150:0/3761081727 wait complete. 2024-09-17T05:49:59.708 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:59.707+0000 7f8f7b78b640 1 Processor -- start 2024-09-17T05:49:59.708 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:59.707+0000 7f8f7b78b640 1 -- start start 2024-09-17T05:49:59.712 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:59.709+0000 7f8f7b78b640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8f740b9e40 0x7f8f740b60b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:49:59.712 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:59.709+0000 7f8f7b78b640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8f740cf380 0x7f8f7415ab20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:49:59.712 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:59.710+0000 7f8f79527640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8f740b9e40 0x7f8f740b60b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:49:59.712 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:59.710+0000 7f8f79527640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8f740b9e40 0x7f8f740b60b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3300/0 says I am v2:172.21.15.150:52946/0 (socket says 172.21.15.150:52946) 2024-09-17T05:49:59.712 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:59.710+0000 7f8f78d26640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8f740cf380 0x7f8f7415ab20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:49:59.712 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:59.710+0000 7f8f78d26640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8f740cf380 0x7f8f7415ab20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:60670/0 (socket says 172.21.15.150:60670) 2024-09-17T05:49:59.712 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:59.710+0000 7f8f79527640 1 -- 172.21.15.150:0/3956630703 learned_addr learned my addr 172.21.15.150:0/3956630703 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:49:59.713 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:59.710+0000 7f8f7b78b640 1 --2- 172.21.15.150:0/3956630703 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8f740b4810 0x7f8f7415b060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:49:59.713 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:59.710+0000 7f8f7b78b640 1 -- 172.21.15.150:0/3956630703 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f8f741692f0 con 0x7f8f740cf380 2024-09-17T05:49:59.713 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:59.710+0000 7f8f7b78b640 1 -- 172.21.15.150:0/3956630703 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f8f74169170 con 0x7f8f740b9e40 2024-09-17T05:49:59.713 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:59.710+0000 7f8f7b78b640 1 -- 172.21.15.150:0/3956630703 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f8f74169470 con 0x7f8f740b4810 2024-09-17T05:49:59.714 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:59.711+0000 7f8f79d28640 1 --2- 172.21.15.150:0/3956630703 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8f740b4810 0x7f8f7415b060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:49:59.714 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:59.711+0000 7f8f79527640 1 -- 172.21.15.150:0/3956630703 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8f740b4810 msgr2=0x7f8f7415b060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:49:59.714 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:59.711+0000 7f8f79527640 1 --2- 172.21.15.150:0/3956630703 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8f740b4810 0x7f8f7415b060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:49:59.714 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:59.711+0000 7f8f79527640 1 -- 172.21.15.150:0/3956630703 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8f740cf380 msgr2=0x7f8f7415ab20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:49:59.714 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:59.711+0000 7f8f79527640 1 --2- 172.21.15.150:0/3956630703 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8f740cf380 0x7f8f7415ab20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:49:59.714 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:59.711+0000 7f8f79527640 1 -- 172.21.15.150:0/3956630703 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8f7415a920 con 0x7f8f740b9e40 2024-09-17T05:49:59.715 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:59.711+0000 7f8f78d26640 1 --2- 172.21.15.150:0/3956630703 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8f740cf380 0x7f8f7415ab20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T05:49:59.715 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:59.712+0000 7f8f79527640 1 --2- 172.21.15.150:0/3956630703 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8f740b9e40 0x7f8f740b60b0 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f8f70009780 tx=0x7f8f70033ba0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:49:59.715 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:59.712+0000 7f8f69ffb640 1 -- 172.21.15.150:0/3956630703 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f70031950 con 0x7f8f740b9e40 2024-09-17T05:49:59.715 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:59.712+0000 7f8f69ffb640 1 -- 172.21.15.150:0/3956630703 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8f70031be0 con 0x7f8f740b9e40 2024-09-17T05:49:59.715 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:59.712+0000 7f8f69ffb640 1 -- 172.21.15.150:0/3956630703 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f70005020 con 0x7f8f740b9e40 2024-09-17T05:49:59.715 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:59.712+0000 7f8f7b78b640 1 -- 172.21.15.150:0/3956630703 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8f740b52f0 con 0x7f8f740b9e40 2024-09-17T05:49:59.715 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:59.713+0000 7f8f7b78b640 1 -- 172.21.15.150:0/3956630703 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8f740b58b0 con 0x7f8f740b9e40 2024-09-17T05:49:59.716 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:59.714+0000 7f8f7b78b640 1 -- 172.21.15.150:0/3956630703 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8f740d0290 con 0x7f8f740b9e40 2024-09-17T05:49:59.721 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:59.717+0000 7f8f69ffb640 1 -- 172.21.15.150:0/3956630703 <== mon.1 v2:172.21.15.176:3300/0 4 ==== mgrmap(e 32) ==== 103481+0+0 (secure 0 0 0) 0x7f8f70045020 con 0x7f8f740b9e40 2024-09-17T05:49:59.721 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:59.717+0000 7f8f69ffb640 1 --2- 172.21.15.150:0/3956630703 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f8f5807a2d0 0x7f8f5807c7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:49:59.721 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:59.718+0000 7f8f78d26640 1 --2- 172.21.15.150:0/3956630703 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f8f5807a2d0 0x7f8f5807c7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:49:59.721 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:59.718+0000 7f8f69ffb640 1 -- 172.21.15.150:0/3956630703 <== mon.1 v2:172.21.15.176:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 5878+0+0 (secure 0 0 0) 0x7f8f700ba400 con 0x7f8f740b9e40 2024-09-17T05:49:59.721 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:59.718+0000 7f8f78d26640 1 --2- 172.21.15.150:0/3956630703 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f8f5807a2d0 0x7f8f5807c7e0 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7f8f740ce8d0 tx=0x7f8f6c009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:49:59.725 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:59.723+0000 7f8f69ffb640 1 -- 172.21.15.150:0/3956630703 <== mon.1 v2:172.21.15.176:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f8f7415a920 con 0x7f8f740b9e40 2024-09-17T05:49:59.960 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:59.959+0000 7f8f7b78b640 1 -- 172.21.15.150:0/3956630703 --> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] -- mgr_command(tid 0: {"prefix": "fs subvolume rm", "force": true, "vol_name": "cephfs", "sub_name": "subvol_clone818314", "target": ["mon-mgr", ""]}) -- 0x7f8f740d5340 con 0x7f8f5807a2d0 2024-09-17T05:49:59.978 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:59.976+0000 7f8f69ffb640 1 -- 172.21.15.150:0/3956630703 <== mgr.4108 v2:172.21.15.176:6800/3631216395 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f8f740d5340 con 0x7f8f5807a2d0 2024-09-17T05:49:59.981 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:59.979+0000 7f8f7b78b640 1 -- 172.21.15.150:0/3956630703 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f8f5807a2d0 msgr2=0x7f8f5807c7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:49:59.981 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:59.979+0000 7f8f7b78b640 1 --2- 172.21.15.150:0/3956630703 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f8f5807a2d0 0x7f8f5807c7e0 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7f8f740ce8d0 tx=0x7f8f6c009040 comp rx=0 tx=0).stop 2024-09-17T05:49:59.981 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:59.979+0000 7f8f7b78b640 1 -- 172.21.15.150:0/3956630703 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8f740b9e40 msgr2=0x7f8f740b60b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:49:59.981 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:59.979+0000 7f8f7b78b640 1 --2- 172.21.15.150:0/3956630703 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8f740b9e40 0x7f8f740b60b0 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f8f70009780 tx=0x7f8f70033ba0 comp rx=0 tx=0).stop 2024-09-17T05:49:59.981 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:59.979+0000 7f8f7b78b640 1 -- 172.21.15.150:0/3956630703 shutdown_connections 2024-09-17T05:49:59.981 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:59.979+0000 7f8f7b78b640 1 --2- 172.21.15.150:0/3956630703 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f8f5807a2d0 0x7f8f5807c7e0 unknown :-1 s=CLOSED pgs=531 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:49:59.981 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:59.979+0000 7f8f7b78b640 1 --2- 172.21.15.150:0/3956630703 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8f740b4810 0x7f8f7415b060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:49:59.981 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:59.979+0000 7f8f7b78b640 1 --2- 172.21.15.150:0/3956630703 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8f740cf380 0x7f8f7415ab20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:49:59.981 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:59.979+0000 7f8f7b78b640 1 --2- 172.21.15.150:0/3956630703 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8f740b9e40 0x7f8f740b60b0 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:49:59.981 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:59.979+0000 7f8f7b78b640 1 -- 172.21.15.150:0/3956630703 >> 172.21.15.150:0/3956630703 conn(0x7f8f740d4670 msgr2=0x7f8f740b1e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:49:59.981 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:59.979+0000 7f8f7b78b640 1 -- 172.21.15.150:0/3956630703 shutdown_connections 2024-09-17T05:49:59.982 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:49:59.979+0000 7f8f7b78b640 1 -- 172.21.15.150:0/3956630703 wait complete. 2024-09-17T05:49:59.992 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume rm --force cephfs subvol_clone369718 2024-09-17T05:50:00.113 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:00.111+0000 7f14e1038640 1 -- 172.21.15.150:0/1550469505 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f14c4005250 msgr2=0x7f14c400b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:50:00.113 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:00.111+0000 7f14e1038640 1 --2- 172.21.15.150:0/1550469505 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f14c4005250 0x7f14c400b9c0 secure :-1 s=READY pgs=1237 cs=0 l=1 rev1=1 crypto rx=0x7f14d400c770 tx=0x7f14c4005830 comp rx=0 tx=0).stop 2024-09-17T05:50:00.113 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:00.111+0000 7f14e1038640 1 -- 172.21.15.150:0/1550469505 shutdown_connections 2024-09-17T05:50:00.113 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:00.111+0000 7f14e1038640 1 --2- 172.21.15.150:0/1550469505 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f14c4005250 0x7f14c400b9c0 unknown :-1 s=CLOSED pgs=1237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:50:00.113 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:00.111+0000 7f14e1038640 1 -- 172.21.15.150:0/1550469505 >> 172.21.15.150:0/1550469505 conn(0x7f14dc09aa50 msgr2=0x7f14dc0b2ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:50:00.113 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:00.111+0000 7f14e1038640 1 -- 172.21.15.150:0/1550469505 shutdown_connections 2024-09-17T05:50:00.113 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:00.111+0000 7f14e1038640 1 -- 172.21.15.150:0/1550469505 wait complete. 2024-09-17T05:50:00.114 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:00.113+0000 7f14e1038640 1 Processor -- start 2024-09-17T05:50:00.114 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:00.113+0000 7f14e1038640 1 -- start start 2024-09-17T05:50:00.117 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:00.114+0000 7f14e1038640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f14c4005250 0x7f14dc06cda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:50:00.117 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:00.114+0000 7f14e1038640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f14dc150e50 0x7f14dc06d2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:50:00.117 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:00.114+0000 7f14e1038640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f14dc154f50 0x7f14dc155360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:50:00.117 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:00.114+0000 7f14e1038640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f14dc0b59a0 con 0x7f14dc154f50 2024-09-17T05:50:00.118 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:00.114+0000 7f14e1038640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f14dc0b5820 con 0x7f14dc150e50 2024-09-17T05:50:00.118 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:00.114+0000 7f14e1038640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f14dc15ba80 con 0x7f14c4005250 2024-09-17T05:50:00.118 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:00.114+0000 7f14db59e640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f14dc154f50 0x7f14dc155360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:50:00.118 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:00.114+0000 7f14dad9d640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f14c4005250 0x7f14dc06cda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:50:00.118 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:00.114+0000 7f14db59e640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f14dc154f50 0x7f14dc155360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:60688/0 (socket says 172.21.15.150:60688) 2024-09-17T05:50:00.118 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:00.114+0000 7f14db59e640 1 -- 172.21.15.150:0/2889367855 learned_addr learned my addr 172.21.15.150:0/2889367855 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:50:00.118 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:00.114+0000 7f14da59c640 1 --2- 172.21.15.150:0/2889367855 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f14dc150e50 0x7f14dc06d2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:50:00.118 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:00.115+0000 7f14db59e640 1 -- 172.21.15.150:0/2889367855 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f14c4005250 msgr2=0x7f14dc06cda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:50:00.118 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:00.115+0000 7f14db59e640 1 --2- 172.21.15.150:0/2889367855 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f14c4005250 0x7f14dc06cda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:50:00.118 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:00.115+0000 7f14db59e640 1 -- 172.21.15.150:0/2889367855 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f14dc150e50 msgr2=0x7f14dc06d2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:50:00.118 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:00.115+0000 7f14db59e640 1 --2- 172.21.15.150:0/2889367855 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f14dc150e50 0x7f14dc06d2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:50:00.118 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:00.115+0000 7f14db59e640 1 -- 172.21.15.150:0/2889367855 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f14dc09e4e0 con 0x7f14dc154f50 2024-09-17T05:50:00.118 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:00.115+0000 7f14da59c640 1 --2- 172.21.15.150:0/2889367855 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f14dc150e50 0x7f14dc06d2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T05:50:00.119 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:00.115+0000 7f14db59e640 1 --2- 172.21.15.150:0/2889367855 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f14dc154f50 0x7f14dc155360 secure :-1 s=READY pgs=1238 cs=0 l=1 rev1=1 crypto rx=0x7f14d4000f80 tx=0x7f14d4003970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:50:00.119 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:00.115+0000 7f14c37fe640 1 -- 172.21.15.150:0/2889367855 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f14d402b9a0 con 0x7f14dc154f50 2024-09-17T05:50:00.119 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:00.115+0000 7f14c37fe640 1 -- 172.21.15.150:0/2889367855 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f14d403a070 con 0x7f14dc154f50 2024-09-17T05:50:00.119 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:00.115+0000 7f14e1038640 1 -- 172.21.15.150:0/2889367855 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f14dc09e7c0 con 0x7f14dc154f50 2024-09-17T05:50:00.119 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:00.115+0000 7f14c37fe640 1 -- 172.21.15.150:0/2889367855 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f14d4034470 con 0x7f14dc154f50 2024-09-17T05:50:00.119 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:00.115+0000 7f14e1038640 1 -- 172.21.15.150:0/2889367855 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f14dc09ed80 con 0x7f14dc154f50 2024-09-17T05:50:00.120 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:00.116+0000 7f14e1038640 1 -- 172.21.15.150:0/2889367855 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f14dc0719c0 con 0x7f14dc154f50 2024-09-17T05:50:00.120 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:00.117+0000 7f14c37fe640 1 -- 172.21.15.150:0/2889367855 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 32) ==== 103481+0+0 (secure 0 0 0) 0x7f14d403c020 con 0x7f14dc154f50 2024-09-17T05:50:00.120 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:00.118+0000 7f14c37fe640 1 --2- 172.21.15.150:0/2889367855 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f14c807a210 0x7f14c807c720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:50:00.121 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:00.118+0000 7f14c37fe640 1 -- 172.21.15.150:0/2889367855 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 5878+0+0 (secure 0 0 0) 0x7f14d40b9180 con 0x7f14dc154f50 2024-09-17T05:50:00.121 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:00.118+0000 7f14dad9d640 1 --2- 172.21.15.150:0/2889367855 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f14c807a210 0x7f14c807c720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:50:00.121 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:00.118+0000 7f14dad9d640 1 --2- 172.21.15.150:0/2889367855 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f14c807a210 0x7f14c807c720 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7f14cc006fd0 tx=0x7f14cc006d10 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:50:00.123 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:00.121+0000 7f14c37fe640 1 -- 172.21.15.150:0/2889367855 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f14dc0719c0 con 0x7f14dc154f50 2024-09-17T05:50:00.495 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:00.493+0000 7f14e1038640 1 -- 172.21.15.150:0/2889367855 --> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] -- mgr_command(tid 0: {"prefix": "fs subvolume rm", "force": true, "vol_name": "cephfs", "sub_name": "subvol_clone369718", "target": ["mon-mgr", ""]}) -- 0x7f14dc15bfe0 con 0x7f14c807a210 2024-09-17T05:50:00.528 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:00.526+0000 7f14c37fe640 1 -- 172.21.15.150:0/2889367855 <== mgr.4108 v2:172.21.15.176:6800/3631216395 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f14dc15bfe0 con 0x7f14c807a210 2024-09-17T05:50:00.532 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:00.530+0000 7f14e1038640 1 -- 172.21.15.150:0/2889367855 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f14c807a210 msgr2=0x7f14c807c720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:50:00.532 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:00.530+0000 7f14e1038640 1 --2- 172.21.15.150:0/2889367855 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f14c807a210 0x7f14c807c720 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7f14cc006fd0 tx=0x7f14cc006d10 comp rx=0 tx=0).stop 2024-09-17T05:50:00.532 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:00.530+0000 7f14e1038640 1 -- 172.21.15.150:0/2889367855 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f14dc154f50 msgr2=0x7f14dc155360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:50:00.532 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:00.530+0000 7f14e1038640 1 --2- 172.21.15.150:0/2889367855 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f14dc154f50 0x7f14dc155360 secure :-1 s=READY pgs=1238 cs=0 l=1 rev1=1 crypto rx=0x7f14d4000f80 tx=0x7f14d4003970 comp rx=0 tx=0).stop 2024-09-17T05:50:00.532 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:00.530+0000 7f14e1038640 1 -- 172.21.15.150:0/2889367855 shutdown_connections 2024-09-17T05:50:00.532 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:00.530+0000 7f14e1038640 1 --2- 172.21.15.150:0/2889367855 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f14dc150e50 0x7f14dc06d2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:50:00.533 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:00.530+0000 7f14e1038640 1 --2- 172.21.15.150:0/2889367855 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f14c807a210 0x7f14c807c720 unknown :-1 s=CLOSED pgs=532 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:50:00.533 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:00.530+0000 7f14e1038640 1 --2- 172.21.15.150:0/2889367855 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f14dc154f50 0x7f14dc155360 unknown :-1 s=CLOSED pgs=1238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:50:00.533 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:00.530+0000 7f14e1038640 1 --2- 172.21.15.150:0/2889367855 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f14c4005250 0x7f14dc06cda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:50:00.533 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:00.530+0000 7f14e1038640 1 -- 172.21.15.150:0/2889367855 >> 172.21.15.150:0/2889367855 conn(0x7f14dc09aa50 msgr2=0x7f14dc15d5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:50:00.533 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:00.532+0000 7f14e1038640 1 -- 172.21.15.150:0/2889367855 shutdown_connections 2024-09-17T05:50:00.533 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:00.532+0000 7f14e1038640 1 -- 172.21.15.150:0/2889367855 wait complete. 2024-09-17T05:50:00.551 DEBUG:teuthology.orchestra.run.smithi150:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'stat -c %h /home/ubuntu/cephtest/mnt.0/./volumes/_deleting') 2024-09-17T05:50:00.623 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:00 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-17T05:50:00.632 INFO:teuthology.orchestra.run.smithi150.stdout:2 2024-09-17T05:50:00.632 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:00 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T05:50:00.641 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mgr mgr/volumes/max_concurrent_clones 4 2024-09-17T05:50:00.816 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:00.814+0000 7f8d8e7eb640 1 -- 172.21.15.150:0/1829807816 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8d880b6550 msgr2=0x7f8d880b24c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:50:00.816 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:00.814+0000 7f8d8e7eb640 1 --2- 172.21.15.150:0/1829807816 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8d880b6550 0x7f8d880b24c0 secure :-1 s=READY pgs=1240 cs=0 l=1 rev1=1 crypto rx=0x7f8d880d0900 tx=0x7f8d7802a4a0 comp rx=0 tx=0).stop 2024-09-17T05:50:00.816 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:00.814+0000 7f8d8e7eb640 1 -- 172.21.15.150:0/1829807816 shutdown_connections 2024-09-17T05:50:00.817 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:00.814+0000 7f8d8e7eb640 1 --2- 172.21.15.150:0/1829807816 >> v2:172.21.15.176:3300/0 conn(0x7f8d88160200 0x7f8d880b4e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:50:00.817 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:00.814+0000 7f8d8e7eb640 1 --2- 172.21.15.150:0/1829807816 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8d880b6550 0x7f8d880b24c0 unknown :-1 s=CLOSED pgs=1240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:50:00.817 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:00.814+0000 7f8d8e7eb640 1 -- 172.21.15.150:0/1829807816 >> 172.21.15.150:0/1829807816 conn(0x7f8d880b2e80 msgr2=0x7f8d880b3290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:50:00.817 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:00.814+0000 7f8d8e7eb640 1 -- 172.21.15.150:0/1829807816 shutdown_connections 2024-09-17T05:50:00.817 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:00.814+0000 7f8d8e7eb640 1 -- 172.21.15.150:0/1829807816 wait complete. 2024-09-17T05:50:00.817 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:00.816+0000 7f8d8e7eb640 1 Processor -- start 2024-09-17T05:50:00.818 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:00.816+0000 7f8d8e7eb640 1 -- start start 2024-09-17T05:50:00.820 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:00.817+0000 7f8d8e7eb640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8d880b2a00 0x7f8d88157c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:50:00.820 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:00.817+0000 7f8d8e7eb640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8d880b6550 0x7f8d8815d450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:50:00.820 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:00.818+0000 7f8d8e7eb640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8d88160200 0x7f8d8806cf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:50:00.820 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:00.818+0000 7f8d8e7eb640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f8d880b3da0 con 0x7f8d880b6550 2024-09-17T05:50:00.821 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:00.818+0000 7f8d8e7eb640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f8d88160820 con 0x7f8d88160200 2024-09-17T05:50:00.821 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:00.818+0000 7f8d8e7eb640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f8d880b5390 con 0x7f8d880b2a00 2024-09-17T05:50:00.821 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:00.818+0000 7f8d877fe640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8d880b6550 0x7f8d8815d450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:50:00.821 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:00.818+0000 7f8d877fe640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8d880b6550 0x7f8d8815d450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:54832/0 (socket says 172.21.15.150:54832) 2024-09-17T05:50:00.821 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:00.818+0000 7f8d877fe640 1 -- 172.21.15.150:0/1782493339 learned_addr learned my addr 172.21.15.150:0/1782493339 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:50:00.821 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:00.818+0000 7f8d87fff640 1 --2- 172.21.15.150:0/1782493339 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8d880b2a00 0x7f8d88157c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:50:00.821 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:00.818+0000 7f8d8cd88640 1 --2- 172.21.15.150:0/1782493339 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8d88160200 0x7f8d8806cf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:50:00.821 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:00.818+0000 7f8d877fe640 1 -- 172.21.15.150:0/1782493339 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8d880b2a00 msgr2=0x7f8d88157c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:50:00.821 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:00.818+0000 7f8d877fe640 1 --2- 172.21.15.150:0/1782493339 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8d880b2a00 0x7f8d88157c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:50:00.821 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:00.818+0000 7f8d877fe640 1 -- 172.21.15.150:0/1782493339 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8d88160200 msgr2=0x7f8d8806cf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:50:00.821 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:00.818+0000 7f8d877fe640 1 --2- 172.21.15.150:0/1782493339 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8d88160200 0x7f8d8806cf80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:50:00.822 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:00.818+0000 7f8d877fe640 1 -- 172.21.15.150:0/1782493339 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8d880b0b30 con 0x7f8d880b6550 2024-09-17T05:50:00.822 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:00.818+0000 7f8d877fe640 1 --2- 172.21.15.150:0/1782493339 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8d880b6550 0x7f8d8815d450 secure :-1 s=READY pgs=1241 cs=0 l=1 rev1=1 crypto rx=0x7f8d7c00c3a0 tx=0x7f8d7c00c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:50:00.822 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:00.818+0000 7f8d84ff9640 1 -- 172.21.15.150:0/1782493339 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d7c011790 con 0x7f8d880b6550 2024-09-17T05:50:00.822 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:00.818+0000 7f8d84ff9640 1 -- 172.21.15.150:0/1782493339 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8d7c017070 con 0x7f8d880b6550 2024-09-17T05:50:00.822 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:00.818+0000 7f8d84ff9640 1 -- 172.21.15.150:0/1782493339 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d7c011ca0 con 0x7f8d880b6550 2024-09-17T05:50:00.822 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:00.818+0000 7f8d8e7eb640 1 -- 172.21.15.150:0/1782493339 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8d880b0e10 con 0x7f8d880b6550 2024-09-17T05:50:00.822 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:00.819+0000 7f8d8e7eb640 1 -- 172.21.15.150:0/1782493339 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8d8815d990 con 0x7f8d880b6550 2024-09-17T05:50:00.823 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:00.819+0000 7f8d8e7eb640 1 -- 172.21.15.150:0/1782493339 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8d880b1010 con 0x7f8d880b6550 2024-09-17T05:50:00.823 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:00.820+0000 7f8d84ff9640 1 -- 172.21.15.150:0/1782493339 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 32) ==== 103481+0+0 (secure 0 0 0) 0x7f8d7c01c460 con 0x7f8d880b6550 2024-09-17T05:50:00.823 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:00.821+0000 7f8d84ff9640 1 --2- 172.21.15.150:0/1782493339 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f8d7407a210 0x7f8d7407c720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:50:00.823 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:00.821+0000 7f8d84ff9640 1 -- 172.21.15.150:0/1782493339 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 5878+0+0 (secure 0 0 0) 0x7f8d7c099690 con 0x7f8d880b6550 2024-09-17T05:50:00.823 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:00.821+0000 7f8d87fff640 1 --2- 172.21.15.150:0/1782493339 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f8d7407a210 0x7f8d7407c720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:50:00.823 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:00.821+0000 7f8d87fff640 1 --2- 172.21.15.150:0/1782493339 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f8d7407a210 0x7f8d7407c720 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7f8d78034000 tx=0x7f8d78004730 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:50:00.827 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:00.825+0000 7f8d84ff9640 1 -- 172.21.15.150:0/1782493339 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f8d7c062f80 con 0x7f8d880b6550 2024-09-17T05:50:01.004 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:01.002+0000 7f8d8e7eb640 1 -- 172.21.15.150:0/1782493339 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command([{prefix=config set, name=mgr/volumes/max_concurrent_clones}] v 0) -- 0x7f8d880b24c0 con 0x7f8d880b6550 2024-09-17T05:50:01.004 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:01.003+0000 7f8d84ff9640 1 -- 172.21.15.150:0/1782493339 <== mon.0 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/volumes/max_concurrent_clones}]=0 v47)=0 v47) ==== 131+0+0 (secure 0 0 0) 0x7f8d7c0679b0 con 0x7f8d880b6550 2024-09-17T05:50:01.007 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:01.005+0000 7f8d8e7eb640 1 -- 172.21.15.150:0/1782493339 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f8d7407a210 msgr2=0x7f8d7407c720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:50:01.007 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:01.005+0000 7f8d8e7eb640 1 --2- 172.21.15.150:0/1782493339 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f8d7407a210 0x7f8d7407c720 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7f8d78034000 tx=0x7f8d78004730 comp rx=0 tx=0).stop 2024-09-17T05:50:01.007 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:01.005+0000 7f8d8e7eb640 1 -- 172.21.15.150:0/1782493339 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8d880b6550 msgr2=0x7f8d8815d450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:50:01.007 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:01.005+0000 7f8d8e7eb640 1 --2- 172.21.15.150:0/1782493339 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8d880b6550 0x7f8d8815d450 secure :-1 s=READY pgs=1241 cs=0 l=1 rev1=1 crypto rx=0x7f8d7c00c3a0 tx=0x7f8d7c00c860 comp rx=0 tx=0).stop 2024-09-17T05:50:01.007 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:01.005+0000 7f8d8e7eb640 1 -- 172.21.15.150:0/1782493339 shutdown_connections 2024-09-17T05:50:01.007 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:01.005+0000 7f8d8e7eb640 1 --2- 172.21.15.150:0/1782493339 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8d88160200 0x7f8d8806cf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:50:01.007 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:01.005+0000 7f8d8e7eb640 1 --2- 172.21.15.150:0/1782493339 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f8d7407a210 0x7f8d7407c720 unknown :-1 s=CLOSED pgs=533 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:50:01.007 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:01.005+0000 7f8d8e7eb640 1 --2- 172.21.15.150:0/1782493339 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8d880b6550 0x7f8d8815d450 unknown :-1 s=CLOSED pgs=1241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:50:01.007 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:01.005+0000 7f8d8e7eb640 1 --2- 172.21.15.150:0/1782493339 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8d880b2a00 0x7f8d88157c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:50:01.008 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:01.005+0000 7f8d8e7eb640 1 -- 172.21.15.150:0/1782493339 >> 172.21.15.150:0/1782493339 conn(0x7f8d880b2e80 msgr2=0x7f8d880cd9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:50:01.008 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:01.005+0000 7f8d8e7eb640 1 -- 172.21.15.150:0/1782493339 shutdown_connections 2024-09-17T05:50:01.008 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:01.005+0000 7f8d8e7eb640 1 -- 172.21.15.150:0/1782493339 wait complete. 2024-09-17T05:50:01.018 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-17T05:50:01.019 DEBUG:teuthology.orchestra.run.smithi150:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-17T05:50:01.054 DEBUG:teuthology.orchestra.run.smithi176:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-17T05:50:01.100 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-17T05:50:01.101 INFO:tasks.cephfs.mount:Terminating background process 2024-09-17T05:50:01.101 DEBUG:teuthology.orchestra.run.smithi150:> set -ex 2024-09-17T05:50:01.101 DEBUG:teuthology.orchestra.run.smithi150:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T05:50:01.117 DEBUG:teuthology.orchestra.run.smithi150:> set -ex 2024-09-17T05:50:01.117 DEBUG:teuthology.orchestra.run.smithi150:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T05:50:01.179 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-17T05:50:01.395 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:01.392+0000 7f80ad2dd640 1 -- 172.21.15.150:0/2166230846 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8094003a00 msgr2=0x7f8094003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:50:01.395 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:01.392+0000 7f80ad2dd640 1 --2- 172.21.15.150:0/2166230846 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8094003a00 0x7f8094003e70 secure :-1 s=READY pgs=1242 cs=0 l=1 rev1=1 crypto rx=0x7f8098009b40 tx=0x7f8094005830 comp rx=0 tx=0).stop 2024-09-17T05:50:01.395 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:01.393+0000 7f80a77fe640 1 -- 172.21.15.150:0/2166230846 reap_dead start 2024-09-17T05:50:01.395 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:01.393+0000 7f80ad2dd640 1 -- 172.21.15.150:0/2166230846 shutdown_connections 2024-09-17T05:50:01.395 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:01.393+0000 7f80ad2dd640 1 -- 172.21.15.150:0/2166230846 >> 172.21.15.150:0/2166230846 conn(0x7f80a808bfe0 msgr2=0x7f80a80d4660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:50:01.395 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:01.393+0000 7f80ad2dd640 1 -- 172.21.15.150:0/2166230846 shutdown_connections 2024-09-17T05:50:01.395 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:01.393+0000 7f80ad2dd640 1 -- 172.21.15.150:0/2166230846 wait complete. 2024-09-17T05:50:01.398 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:01.396+0000 7f80ad2dd640 1 Processor -- start 2024-09-17T05:50:01.398 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:01.396+0000 7f80ad2dd640 1 -- start start 2024-09-17T05:50:01.402 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:01.400+0000 7f80ad2dd640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f80a80ce0a0 0x7f80a81d25e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:50:01.402 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:01.400+0000 7f80ad2dd640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f80a80d0d90 0x7f80a80d11a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:50:01.402 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:01.400+0000 7f80a67fc640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f80a80d0d90 0x7f80a80d11a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:50:01.402 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:01.400+0000 7f80a67fc640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f80a80d0d90 0x7f80a80d11a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:54862/0 (socket says 172.21.15.150:54862) 2024-09-17T05:50:01.402 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:01.400+0000 7f80a6ffd640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f80a80ce0a0 0x7f80a81d25e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:50:01.402 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:01.400+0000 7f80a67fc640 1 -- 172.21.15.150:0/3880540473 learned_addr learned my addr 172.21.15.150:0/3880540473 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:50:01.402 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:01.400+0000 7f80ad2dd640 1 --2- 172.21.15.150:0/3880540473 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f80a80cb710 0x7f80a80cbb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:50:01.403 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:01.400+0000 7f80ad2dd640 1 -- 172.21.15.150:0/3880540473 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f80a80d04b0 con 0x7f80a80d0d90 2024-09-17T05:50:01.403 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:01.400+0000 7f80ad2dd640 1 -- 172.21.15.150:0/3880540473 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f80a80d0330 con 0x7f80a80ce0a0 2024-09-17T05:50:01.403 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:01.400+0000 7f80ad2dd640 1 -- 172.21.15.150:0/3880540473 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f80a80d0630 con 0x7f80a80cb710 2024-09-17T05:50:01.404 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:01.400+0000 7f80a77fe640 1 --2- 172.21.15.150:0/3880540473 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f80a80cb710 0x7f80a80cbb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:50:01.404 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:01.401+0000 7f80a6ffd640 1 -- 172.21.15.150:0/3880540473 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f80a80cb710 msgr2=0x7f80a80cbb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:50:01.404 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:01.401+0000 7f80a6ffd640 1 --2- 172.21.15.150:0/3880540473 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f80a80cb710 0x7f80a80cbb20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:50:01.404 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:01.401+0000 7f80a6ffd640 1 -- 172.21.15.150:0/3880540473 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f80a80d0d90 msgr2=0x7f80a80d11a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:50:01.404 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:01.401+0000 7f80a6ffd640 1 --2- 172.21.15.150:0/3880540473 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f80a80d0d90 0x7f80a80d11a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:50:01.404 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:01.401+0000 7f80a6ffd640 1 -- 172.21.15.150:0/3880540473 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f80a80d16e0 con 0x7f80a80ce0a0 2024-09-17T05:50:01.405 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:01.401+0000 7f80a67fc640 1 --2- 172.21.15.150:0/3880540473 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f80a80d0d90 0x7f80a80d11a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T05:50:01.405 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:01.401+0000 7f80a6ffd640 1 --2- 172.21.15.150:0/3880540473 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f80a80ce0a0 0x7f80a81d25e0 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f8098032000 tx=0x7f8098033670 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:50:01.405 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:01.402+0000 7f809f7fe640 1 -- 172.21.15.150:0/3880540473 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8098038070 con 0x7f80a80ce0a0 2024-09-17T05:50:01.405 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:01.402+0000 7f809f7fe640 1 -- 172.21.15.150:0/3880540473 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8098039040 con 0x7f80a80ce0a0 2024-09-17T05:50:01.405 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:01.402+0000 7f809f7fe640 1 -- 172.21.15.150:0/3880540473 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8098033cd0 con 0x7f80a80ce0a0 2024-09-17T05:50:01.405 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:01.402+0000 7f80ad2dd640 1 -- 172.21.15.150:0/3880540473 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f80a80cc760 con 0x7f80a80ce0a0 2024-09-17T05:50:01.405 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:01.402+0000 7f80ad2dd640 1 -- 172.21.15.150:0/3880540473 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f80a80cc480 con 0x7f80a80ce0a0 2024-09-17T05:50:01.405 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:01.404+0000 7f80ad2dd640 1 -- 172.21.15.150:0/3880540473 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f80a808caf0 con 0x7f80a80ce0a0 2024-09-17T05:50:01.406 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:01.404+0000 7f809f7fe640 1 -- 172.21.15.150:0/3880540473 <== mon.1 v2:172.21.15.176:3300/0 4 ==== mgrmap(e 32) ==== 103481+0+0 (secure 0 0 0) 0x7f8098044020 con 0x7f80a80ce0a0 2024-09-17T05:50:01.407 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:01.405+0000 7f809f7fe640 1 --2- 172.21.15.150:0/3880540473 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f808807a210 0x7f808807c720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:50:01.407 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:01.405+0000 7f809f7fe640 1 -- 172.21.15.150:0/3880540473 <== mon.1 v2:172.21.15.176:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 5878+0+0 (secure 0 0 0) 0x7f80980b99e0 con 0x7f80a80ce0a0 2024-09-17T05:50:01.407 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:01.406+0000 7f80a67fc640 1 --2- 172.21.15.150:0/3880540473 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f808807a210 0x7f808807c720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:50:01.408 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:01.406+0000 7f80a67fc640 1 --2- 172.21.15.150:0/3880540473 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f808807a210 0x7f808807c720 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7f80a0001be0 tx=0x7f80a0006b20 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:50:01.415 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:01.414+0000 7f809f7fe640 1 -- 172.21.15.150:0/3880540473 <== mon.1 v2:172.21.15.176:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f80a808caf0 con 0x7f80a80ce0a0 2024-09-17T05:50:01.696 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:01.695+0000 7f80ad2dd640 1 -- 172.21.15.150:0/3880540473 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f80a80d3260 con 0x7f80a80ce0a0 2024-09-17T05:50:01.697 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:01.695+0000 7f809f7fe640 1 -- 172.21.15.150:0/3880540473 <== mon.1 v2:172.21.15.176:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v89) ==== 80+0+0 (secure 0 0 0) 0x7f809804b020 con 0x7f80a80ce0a0 2024-09-17T05:50:01.697 INFO:teuthology.orchestra.run.smithi150.stderr:listed 0 entries 2024-09-17T05:50:01.699 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:01.697+0000 7f80ad2dd640 1 -- 172.21.15.150:0/3880540473 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f808807a210 msgr2=0x7f808807c720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:50:01.699 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:01.697+0000 7f80ad2dd640 1 --2- 172.21.15.150:0/3880540473 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f808807a210 0x7f808807c720 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7f80a0001be0 tx=0x7f80a0006b20 comp rx=0 tx=0).stop 2024-09-17T05:50:01.700 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:01.697+0000 7f80ad2dd640 1 -- 172.21.15.150:0/3880540473 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f80a80ce0a0 msgr2=0x7f80a81d25e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:50:01.700 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:01.697+0000 7f80ad2dd640 1 --2- 172.21.15.150:0/3880540473 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f80a80ce0a0 0x7f80a81d25e0 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f8098032000 tx=0x7f8098033670 comp rx=0 tx=0).stop 2024-09-17T05:50:01.700 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:01.698+0000 7f80ad2dd640 1 -- 172.21.15.150:0/3880540473 shutdown_connections 2024-09-17T05:50:01.700 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:01.698+0000 7f80ad2dd640 1 --2- 172.21.15.150:0/3880540473 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f808807a210 0x7f808807c720 unknown :-1 s=CLOSED pgs=534 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:50:01.700 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:01.698+0000 7f80ad2dd640 1 --2- 172.21.15.150:0/3880540473 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f80a80cb710 0x7f80a80cbb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:50:01.700 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:01.698+0000 7f80ad2dd640 1 --2- 172.21.15.150:0/3880540473 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f80a80d0d90 0x7f80a80d11a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:50:01.700 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:01.698+0000 7f80ad2dd640 1 --2- 172.21.15.150:0/3880540473 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f80a80ce0a0 0x7f80a81d25e0 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:50:01.700 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:01.698+0000 7f80ad2dd640 1 -- 172.21.15.150:0/3880540473 >> 172.21.15.150:0/3880540473 conn(0x7f80a808bfe0 msgr2=0x7f80a806eae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:50:01.700 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:01.698+0000 7f80ad2dd640 1 -- 172.21.15.150:0/3880540473 shutdown_connections 2024-09-17T05:50:01.701 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:01.698+0000 7f80ad2dd640 1 -- 172.21.15.150:0/3880540473 wait complete. 2024-09-17T05:50:01.711 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-09-17T05:50:01.711 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:50:01.711 DEBUG:teuthology.orchestra.run.smithi150:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-09-17T05:50:01.753 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi150.front.sepia.ceph.com 2024-09-17T05:50:01.753 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:50:01.753 DEBUG:teuthology.orchestra.run.smithi150:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-17T05:50:01.808 INFO:tasks.cephfs.mount:Terminating background process 2024-09-17T05:50:01.809 DEBUG:teuthology.orchestra.run.smithi176:> set -ex 2024-09-17T05:50:01.809 DEBUG:teuthology.orchestra.run.smithi176:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T05:50:01.825 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056030,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497468k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=3379 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248732k,nr_inodes=812183,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497468k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-17T05:50:01.825 INFO:tasks.cephfs.mount:Terminating background process 2024-09-17T05:50:01.825 DEBUG:teuthology.orchestra.run.smithi150:> set -ex 2024-09-17T05:50:01.826 DEBUG:teuthology.orchestra.run.smithi150:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T05:50:01.864 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056027,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497464k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=18693 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248728k,nr_inodes=812182,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497464k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-17T05:50:01.864 INFO:tasks.cephfs.mount:Terminating background process 2024-09-17T05:50:01.865 DEBUG:teuthology.orchestra.run.smithi176:> set -ex 2024-09-17T05:50:01.865 DEBUG:teuthology.orchestra.run.smithi176:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T05:50:01.881 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056030,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497468k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=3379 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248732k,nr_inodes=812183,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497468k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-17T05:50:01.882 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T05:50:02.018 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:02.016+0000 7f94de0c5640 1 -- 172.21.15.150:0/808358466 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f94d80b9d10 msgr2=0x7f94d80d2f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:50:02.018 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:02.016+0000 7f94de0c5640 1 --2- 172.21.15.150:0/808358466 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f94d80b9d10 0x7f94d80d2f60 secure :-1 s=READY pgs=1243 cs=0 l=1 rev1=1 crypto rx=0x7f94c8005fd0 tx=0x7f94c802aa90 comp rx=0 tx=0).stop 2024-09-17T05:50:02.018 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:02.016+0000 7f94de0c5640 1 -- 172.21.15.150:0/808358466 shutdown_connections 2024-09-17T05:50:02.018 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:02.016+0000 7f94de0c5640 1 --2- 172.21.15.150:0/808358466 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f94d80d1020 0x7f94d80d1430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:50:02.018 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:02.016+0000 7f94de0c5640 1 --2- 172.21.15.150:0/808358466 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f94d80b9d10 0x7f94d80d2f60 unknown :-1 s=CLOSED pgs=1243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:50:02.019 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:02.016+0000 7f94de0c5640 1 -- 172.21.15.150:0/808358466 >> 172.21.15.150:0/808358466 conn(0x7f94d808bfe0 msgr2=0x7f94d80d4650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:50:02.019 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:02.016+0000 7f94de0c5640 1 -- 172.21.15.150:0/808358466 shutdown_connections 2024-09-17T05:50:02.019 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:02.016+0000 7f94de0c5640 1 -- 172.21.15.150:0/808358466 wait complete. 2024-09-17T05:50:02.019 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:02.018+0000 7f94de0c5640 1 Processor -- start 2024-09-17T05:50:02.019 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:02.018+0000 7f94de0c5640 1 -- start start 2024-09-17T05:50:02.022 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:02.019+0000 7f94de0c5640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f94d80b9d10 0x7f94d81f5ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:50:02.022 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:02.019+0000 7f94de0c5640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f94d80d1020 0x7f94d8158a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:50:02.022 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:02.019+0000 7f94de0c5640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f94d80d50c0 0x7f94d80d2770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:50:02.022 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:02.019+0000 7f94de0c5640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f94d80b4300 con 0x7f94d80d50c0 2024-09-17T05:50:02.022 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:02.019+0000 7f94de0c5640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f94d80b4180 con 0x7f94d80b9d10 2024-09-17T05:50:02.023 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:02.019+0000 7f94de0c5640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f94d80b4480 con 0x7f94d80d1020 2024-09-17T05:50:02.023 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:02.019+0000 7f94d77fe640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f94d80b9d10 0x7f94d81f5ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:50:02.023 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:02.019+0000 7f94d7fff640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f94d80d50c0 0x7f94d80d2770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:50:02.023 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:02.019+0000 7f94d6ffd640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f94d80d1020 0x7f94d8158a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:50:02.023 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:02.019+0000 7f94d77fe640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f94d80b9d10 0x7f94d81f5ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3300/0 says I am v2:172.21.15.150:57122/0 (socket says 172.21.15.150:57122) 2024-09-17T05:50:02.023 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:02.019+0000 7f94d7fff640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f94d80d50c0 0x7f94d80d2770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:54872/0 (socket says 172.21.15.150:54872) 2024-09-17T05:50:02.023 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:02.019+0000 7f94d77fe640 1 -- 172.21.15.150:0/1373964695 learned_addr learned my addr 172.21.15.150:0/1373964695 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:50:02.023 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:02.020+0000 7f94d7fff640 1 -- 172.21.15.150:0/1373964695 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f94d80d1020 msgr2=0x7f94d8158a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:50:02.023 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:02.020+0000 7f94d7fff640 1 --2- 172.21.15.150:0/1373964695 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f94d80d1020 0x7f94d8158a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:50:02.023 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:02.020+0000 7f94d7fff640 1 -- 172.21.15.150:0/1373964695 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f94d80b9d10 msgr2=0x7f94d81f5ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:50:02.023 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:02.020+0000 7f94d7fff640 1 --2- 172.21.15.150:0/1373964695 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f94d80b9d10 0x7f94d81f5ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:50:02.023 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:02.020+0000 7f94d7fff640 1 -- 172.21.15.150:0/1373964695 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f94d81f6d20 con 0x7f94d80d50c0 2024-09-17T05:50:02.024 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:02.020+0000 7f94d7fff640 1 --2- 172.21.15.150:0/1373964695 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f94d80d50c0 0x7f94d80d2770 secure :-1 s=READY pgs=1244 cs=0 l=1 rev1=1 crypto rx=0x7f94d000d5e0 tx=0x7f94d000bf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:50:02.024 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:02.020+0000 7f94bffff640 1 -- 172.21.15.150:0/1373964695 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94d0017070 con 0x7f94d80d50c0 2024-09-17T05:50:02.024 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:02.020+0000 7f94bffff640 1 -- 172.21.15.150:0/1373964695 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f94d0005310 con 0x7f94d80d50c0 2024-09-17T05:50:02.024 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:02.020+0000 7f94de0c5640 1 -- 172.21.15.150:0/1373964695 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f94d81f64d0 con 0x7f94d80d50c0 2024-09-17T05:50:02.024 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:02.020+0000 7f94bffff640 1 -- 172.21.15.150:0/1373964695 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94d00047a0 con 0x7f94d80d50c0 2024-09-17T05:50:02.024 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:02.020+0000 7f94de0c5640 1 -- 172.21.15.150:0/1373964695 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f94d81f6a90 con 0x7f94d80d50c0 2024-09-17T05:50:02.025 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:02.021+0000 7f94de0c5640 1 -- 172.21.15.150:0/1373964695 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f94d81f6240 con 0x7f94d80d50c0 2024-09-17T05:50:02.025 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:02.022+0000 7f94bffff640 1 -- 172.21.15.150:0/1373964695 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 32) ==== 103481+0+0 (secure 0 0 0) 0x7f94d0004940 con 0x7f94d80d50c0 2024-09-17T05:50:02.025 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:02.023+0000 7f94bffff640 1 --2- 172.21.15.150:0/1373964695 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f94c407a240 0x7f94c407c750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:50:02.025 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:02.023+0000 7f94bffff640 1 -- 172.21.15.150:0/1373964695 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 5878+0+0 (secure 0 0 0) 0x7f94d00998f0 con 0x7f94d80d50c0 2024-09-17T05:50:02.025 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:02.023+0000 7f94d77fe640 1 --2- 172.21.15.150:0/1373964695 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f94c407a240 0x7f94c407c750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:50:02.025 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:02.023+0000 7f94d77fe640 1 --2- 172.21.15.150:0/1373964695 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f94c407a240 0x7f94c407c750 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7f94c8009bf0 tx=0x7f94c8038040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:50:02.029 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:02.027+0000 7f94bffff640 1 -- 172.21.15.150:0/1373964695 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f94d00631f0 con 0x7f94d80d50c0 2024-09-17T05:50:02.332 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:02.331+0000 7f94de0c5640 1 -- 172.21.15.150:0/1373964695 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f94d80b4930 con 0x7f94d80d50c0 2024-09-17T05:50:02.333 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:02.332+0000 7f94bffff640 1 -- 172.21.15.150:0/1373964695 <== mon.0 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 52 v52) ==== 94+0+5237 (secure 0 0 0) 0x7f94d0067c20 con 0x7f94d80d50c0 2024-09-17T05:50:02.334 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-09-17T05:50:02.334 INFO:teuthology.orchestra.run.smithi150.stdout:{"epoch":52,"btime":"2024-09-17T05:48:19:238380+0000","default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5993,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6835/1590564966","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6833","nonce":1590564966},{"type":"v1","addr":"172.21.15.150:6835","nonce":1590564966}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":47},{"gid":6008,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6837/3094459008","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6835","nonce":3094459008},{"type":"v1","addr":"172.21.15.176:6837","nonce":3094459008}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":47},{"gid":6484,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6834/1586974380","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6832","nonce":1586974380},{"type":"v1","addr":"172.21.15.150:6834","nonce":1586974380}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":46}],"filesystems":[{"mdsmap":{"epoch":51,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T05:48:06.348623+0000","modified":"2024-09-17T05:48:09.356798+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6496},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6496":{"gid":6496,"name":"d","rank":0,"incarnation":48,"state":"up:active","state_seq":3,"addr":"172.21.15.176:6836/4093204117","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6834","nonce":4093204117},{"type":"v1","addr":"172.21.15.176:6836","nonce":4093204117}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6496,"qdb_cluster":[6496]},"id":6}]} 2024-09-17T05:50:02.334 INFO:teuthology.orchestra.run.smithi150.stderr:dumped fsmap epoch 52 2024-09-17T05:50:02.337 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:02.336+0000 7f94de0c5640 1 -- 172.21.15.150:0/1373964695 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f94c407a240 msgr2=0x7f94c407c750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:50:02.337 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:02.336+0000 7f94de0c5640 1 --2- 172.21.15.150:0/1373964695 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f94c407a240 0x7f94c407c750 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7f94c8009bf0 tx=0x7f94c8038040 comp rx=0 tx=0).stop 2024-09-17T05:50:02.338 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:02.336+0000 7f94de0c5640 1 -- 172.21.15.150:0/1373964695 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f94d80d50c0 msgr2=0x7f94d80d2770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:50:02.338 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:02.336+0000 7f94de0c5640 1 --2- 172.21.15.150:0/1373964695 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f94d80d50c0 0x7f94d80d2770 secure :-1 s=READY pgs=1244 cs=0 l=1 rev1=1 crypto rx=0x7f94d000d5e0 tx=0x7f94d000bf90 comp rx=0 tx=0).stop 2024-09-17T05:50:02.338 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:02.336+0000 7f94de0c5640 1 -- 172.21.15.150:0/1373964695 shutdown_connections 2024-09-17T05:50:02.338 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:02.336+0000 7f94de0c5640 1 --2- 172.21.15.150:0/1373964695 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f94c407a240 0x7f94c407c750 unknown :-1 s=CLOSED pgs=535 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:50:02.338 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:02.336+0000 7f94de0c5640 1 --2- 172.21.15.150:0/1373964695 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f94d80d50c0 0x7f94d80d2770 unknown :-1 s=CLOSED pgs=1244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:50:02.338 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:02.336+0000 7f94de0c5640 1 --2- 172.21.15.150:0/1373964695 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f94d80d1020 0x7f94d8158a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:50:02.338 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:02.336+0000 7f94de0c5640 1 --2- 172.21.15.150:0/1373964695 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f94d80b9d10 0x7f94d81f5ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:50:02.338 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:02.336+0000 7f94de0c5640 1 -- 172.21.15.150:0/1373964695 >> 172.21.15.150:0/1373964695 conn(0x7f94d808bfe0 msgr2=0x7f94d8161e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:50:02.338 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:02.336+0000 7f94de0c5640 1 -- 172.21.15.150:0/1373964695 shutdown_connections 2024-09-17T05:50:02.339 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:02.336+0000 7f94de0c5640 1 -- 172.21.15.150:0/1373964695 wait complete. 2024-09-17T05:50:02.356 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T05:50:02.530 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:02.528+0000 7fb278cb4640 1 -- 172.21.15.150:0/4155215241 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb27406f5e0 msgr2=0x7fb2740b31e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:50:02.530 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:02.528+0000 7fb278cb4640 1 --2- 172.21.15.150:0/4155215241 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb27406f5e0 0x7fb2740b31e0 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7fb26c005fd0 tx=0x7fb26c02a8b0 comp rx=0 tx=0).stop 2024-09-17T05:50:02.531 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:02.529+0000 7fb278cb4640 1 -- 172.21.15.150:0/4155215241 shutdown_connections 2024-09-17T05:50:02.531 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:02.529+0000 7fb278cb4640 1 --2- 172.21.15.150:0/4155215241 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb27406f5e0 0x7fb2740b31e0 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:50:02.531 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:02.529+0000 7fb278cb4640 1 --2- 172.21.15.150:0/4155215241 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb274073c10 0x7fb27406f0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:50:02.531 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:02.529+0000 7fb278cb4640 1 -- 172.21.15.150:0/4155215241 >> 172.21.15.150:0/4155215241 conn(0x7fb27406d730 msgr2=0x7fb2740b1e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:50:02.531 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:02.529+0000 7fb278cb4640 1 -- 172.21.15.150:0/4155215241 shutdown_connections 2024-09-17T05:50:02.531 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:02.529+0000 7fb278cb4640 1 -- 172.21.15.150:0/4155215241 wait complete. 2024-09-17T05:50:02.534 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:02.532+0000 7fb278cb4640 1 Processor -- start 2024-09-17T05:50:02.534 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:02.532+0000 7fb278cb4640 1 -- start start 2024-09-17T05:50:02.536 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:02.534+0000 7fb278cb4640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb27406f5e0 0x7fb27415ae50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:50:02.536 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:02.534+0000 7fb278cb4640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb2740af630 0x7fb27409b710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:50:02.536 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:02.534+0000 7fb278cb4640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb274157640 0x7fb274157e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:50:02.536 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:02.534+0000 7fb278cb4640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7fb2740b3c50 con 0x7fb2740af630 2024-09-17T05:50:02.536 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:02.534+0000 7fb278cb4640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fb2740b3ad0 con 0x7fb274157640 2024-09-17T05:50:02.537 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:02.534+0000 7fb278cb4640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fb2740b3dd0 con 0x7fb27406f5e0 2024-09-17T05:50:02.538 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:02.534+0000 7fb271d9b640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb2740af630 0x7fb27409b710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:50:02.538 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:02.534+0000 7fb271d9b640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb2740af630 0x7fb27409b710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:54876/0 (socket says 172.21.15.150:54876) 2024-09-17T05:50:02.538 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:02.534+0000 7fb271d9b640 1 -- 172.21.15.150:0/1356002374 learned_addr learned my addr 172.21.15.150:0/1356002374 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:50:02.538 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:02.535+0000 7fb27259c640 1 --2- 172.21.15.150:0/1356002374 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb27406f5e0 0x7fb27415ae50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:50:02.539 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:02.535+0000 7fb272d9d640 1 --2- 172.21.15.150:0/1356002374 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb274157640 0x7fb274157e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:50:02.539 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:02.535+0000 7fb271d9b640 1 -- 172.21.15.150:0/1356002374 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb27406f5e0 msgr2=0x7fb27415ae50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:50:02.539 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:02.535+0000 7fb271d9b640 1 --2- 172.21.15.150:0/1356002374 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb27406f5e0 0x7fb27415ae50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:50:02.539 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:02.535+0000 7fb271d9b640 1 -- 172.21.15.150:0/1356002374 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb274157640 msgr2=0x7fb274157e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:50:02.539 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:02.535+0000 7fb271d9b640 1 --2- 172.21.15.150:0/1356002374 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb274157640 0x7fb274157e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:50:02.539 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:02.535+0000 7fb271d9b640 1 -- 172.21.15.150:0/1356002374 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb27409bc50 con 0x7fb2740af630 2024-09-17T05:50:02.539 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:02.536+0000 7fb271d9b640 1 --2- 172.21.15.150:0/1356002374 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb2740af630 0x7fb27409b710 secure :-1 s=READY pgs=1246 cs=0 l=1 rev1=1 crypto rx=0x7fb26800d6a0 tx=0x7fb26800db60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:50:02.539 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:02.536+0000 7fb27259c640 1 --2- 172.21.15.150:0/1356002374 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb27406f5e0 0x7fb27415ae50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:50:02.539 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:02.536+0000 7fb262ffd640 1 -- 172.21.15.150:0/1356002374 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb268017070 con 0x7fb2740af630 2024-09-17T05:50:02.539 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:02.536+0000 7fb262ffd640 1 -- 172.21.15.150:0/1356002374 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb268009ab0 con 0x7fb2740af630 2024-09-17T05:50:02.539 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:02.536+0000 7fb262ffd640 1 -- 172.21.15.150:0/1356002374 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb268010460 con 0x7fb2740af630 2024-09-17T05:50:02.539 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:02.536+0000 7fb278cb4640 1 -- 172.21.15.150:0/1356002374 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb27409a670 con 0x7fb2740af630 2024-09-17T05:50:02.539 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:02.536+0000 7fb278cb4640 1 -- 172.21.15.150:0/1356002374 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb27409ac30 con 0x7fb2740af630 2024-09-17T05:50:02.540 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:02.538+0000 7fb278cb4640 1 -- 172.21.15.150:0/1356002374 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb2740b4280 con 0x7fb2740af630 2024-09-17T05:50:02.540 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:02.539+0000 7fb262ffd640 1 -- 172.21.15.150:0/1356002374 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 32) ==== 103481+0+0 (secure 0 0 0) 0x7fb26801a070 con 0x7fb2740af630 2024-09-17T05:50:02.541 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:02.540+0000 7fb262ffd640 1 --2- 172.21.15.150:0/1356002374 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fb25407a210 0x7fb25407c720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:50:02.541 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:02.540+0000 7fb262ffd640 1 -- 172.21.15.150:0/1356002374 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 5878+0+0 (secure 0 0 0) 0x7fb268099a50 con 0x7fb2740af630 2024-09-17T05:50:02.542 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:02.540+0000 7fb27259c640 1 --2- 172.21.15.150:0/1356002374 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fb25407a210 0x7fb25407c720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:50:02.542 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:02.541+0000 7fb27259c640 1 --2- 172.21.15.150:0/1356002374 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fb25407a210 0x7fb25407c720 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7fb264007a50 tx=0x7fb264009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:50:02.548 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:02.547+0000 7fb262ffd640 1 -- 172.21.15.150:0/1356002374 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fb268063a20 con 0x7fb2740af630 2024-09-17T05:50:02.836 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:02.835+0000 7fb278cb4640 1 -- 172.21.15.150:0/1356002374 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fb27409e100 con 0x7fb2740af630 2024-09-17T05:50:02.837 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:02.835+0000 7fb262ffd640 1 -- 172.21.15.150:0/1356002374 <== mon.0 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 52 v52) ==== 94+0+5237 (secure 0 0 0) 0x7fb268063320 con 0x7fb2740af630 2024-09-17T05:50:02.837 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-09-17T05:50:02.837 INFO:teuthology.orchestra.run.smithi150.stdout:{"epoch":52,"btime":"2024-09-17T05:48:19:238380+0000","default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5993,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6835/1590564966","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6833","nonce":1590564966},{"type":"v1","addr":"172.21.15.150:6835","nonce":1590564966}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":47},{"gid":6008,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6837/3094459008","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6835","nonce":3094459008},{"type":"v1","addr":"172.21.15.176:6837","nonce":3094459008}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":47},{"gid":6484,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6834/1586974380","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6832","nonce":1586974380},{"type":"v1","addr":"172.21.15.150:6834","nonce":1586974380}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":46}],"filesystems":[{"mdsmap":{"epoch":51,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T05:48:06.348623+0000","modified":"2024-09-17T05:48:09.356798+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6496},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6496":{"gid":6496,"name":"d","rank":0,"incarnation":48,"state":"up:active","state_seq":3,"addr":"172.21.15.176:6836/4093204117","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6834","nonce":4093204117},{"type":"v1","addr":"172.21.15.176:6836","nonce":4093204117}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6496,"qdb_cluster":[6496]},"id":6}]} 2024-09-17T05:50:02.838 INFO:teuthology.orchestra.run.smithi150.stderr:dumped fsmap epoch 52 2024-09-17T05:50:02.839 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:02.837+0000 7fb278cb4640 1 -- 172.21.15.150:0/1356002374 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fb25407a210 msgr2=0x7fb25407c720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:50:02.839 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:02.837+0000 7fb278cb4640 1 --2- 172.21.15.150:0/1356002374 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fb25407a210 0x7fb25407c720 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7fb264007a50 tx=0x7fb264009040 comp rx=0 tx=0).stop 2024-09-17T05:50:02.839 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:02.837+0000 7fb278cb4640 1 -- 172.21.15.150:0/1356002374 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb2740af630 msgr2=0x7fb27409b710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:50:02.839 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:02.837+0000 7fb278cb4640 1 --2- 172.21.15.150:0/1356002374 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb2740af630 0x7fb27409b710 secure :-1 s=READY pgs=1246 cs=0 l=1 rev1=1 crypto rx=0x7fb26800d6a0 tx=0x7fb26800db60 comp rx=0 tx=0).stop 2024-09-17T05:50:02.840 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:02.837+0000 7fb278cb4640 1 -- 172.21.15.150:0/1356002374 shutdown_connections 2024-09-17T05:50:02.840 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:02.837+0000 7fb278cb4640 1 --2- 172.21.15.150:0/1356002374 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb274157640 0x7fb274157e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:50:02.840 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:02.837+0000 7fb278cb4640 1 --2- 172.21.15.150:0/1356002374 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fb25407a210 0x7fb25407c720 unknown :-1 s=CLOSED pgs=536 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:50:02.840 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:02.837+0000 7fb278cb4640 1 --2- 172.21.15.150:0/1356002374 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb2740af630 0x7fb27409b710 unknown :-1 s=CLOSED pgs=1246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:50:02.840 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:02.837+0000 7fb278cb4640 1 --2- 172.21.15.150:0/1356002374 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb27406f5e0 0x7fb27415ae50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:50:02.840 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:02.837+0000 7fb278cb4640 1 -- 172.21.15.150:0/1356002374 >> 172.21.15.150:0/1356002374 conn(0x7fb27406d730 msgr2=0x7fb2740ad0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:50:02.840 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:02.837+0000 7fb278cb4640 1 -- 172.21.15.150:0/1356002374 shutdown_connections 2024-09-17T05:50:02.840 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:02.837+0000 7fb278cb4640 1 -- 172.21.15.150:0/1356002374 wait complete. 2024-09-17T05:50:02.850 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T05:50:02.964 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:02.962+0000 7fa31e74a640 1 -- 172.21.15.150:0/6198691 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa3180d0550 msgr2=0x7fa3180b18c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:50:02.964 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:02.962+0000 7fa31e74a640 1 --2- 172.21.15.150:0/6198691 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa3180d0550 0x7fa3180b18c0 secure :-1 s=READY pgs=1247 cs=0 l=1 rev1=1 crypto rx=0x7fa3180711a0 tx=0x7fa30c02a5f0 comp rx=0 tx=0).stop 2024-09-17T05:50:02.965 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:02.962+0000 7fa31e74a640 1 -- 172.21.15.150:0/6198691 shutdown_connections 2024-09-17T05:50:02.965 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:02.962+0000 7fa31e74a640 1 --2- 172.21.15.150:0/6198691 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa3180d0550 0x7fa3180b18c0 unknown :-1 s=CLOSED pgs=1247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:50:02.965 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:02.962+0000 7fa31e74a640 1 --2- 172.21.15.150:0/6198691 >> v2:172.21.15.176:3300/0 conn(0x7fa3180d0c50 0x7fa3180d0010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:50:02.965 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:02.962+0000 7fa31e74a640 1 -- 172.21.15.150:0/6198691 >> 172.21.15.150:0/6198691 conn(0x7fa3180b3fc0 msgr2=0x7fa3180b43d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:50:02.965 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:02.962+0000 7fa31e74a640 1 -- 172.21.15.150:0/6198691 shutdown_connections 2024-09-17T05:50:02.965 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:02.962+0000 7fa31e74a640 1 -- 172.21.15.150:0/6198691 wait complete. 2024-09-17T05:50:02.966 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:02.964+0000 7fa31e74a640 1 Processor -- start 2024-09-17T05:50:02.966 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:02.964+0000 7fa31e74a640 1 -- start start 2024-09-17T05:50:02.968 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:02.965+0000 7fa31e74a640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa3180d0550 0x7fa3181f51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:50:02.968 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:02.965+0000 7fa31e74a640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa3180d0c50 0x7fa31806ed50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:50:02.968 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:02.966+0000 7fa31e74a640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa3180d1060 0x7fa31806f290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:50:02.969 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:02.966+0000 7fa31e74a640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7fa3180ced30 con 0x7fa3180d0c50 2024-09-17T05:50:02.969 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:02.966+0000 7fa31e74a640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fa3180cebb0 con 0x7fa3180d1060 2024-09-17T05:50:02.969 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:02.966+0000 7fa31e74a640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fa3180cd130 con 0x7fa3180d0550 2024-09-17T05:50:02.969 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:02.966+0000 7fa3177fe640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa3180d0c50 0x7fa31806ed50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:50:02.969 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:02.966+0000 7fa3177fe640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa3180d0c50 0x7fa31806ed50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:54886/0 (socket says 172.21.15.150:54886) 2024-09-17T05:50:02.969 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:02.966+0000 7fa3177fe640 1 -- 172.21.15.150:0/187632661 learned_addr learned my addr 172.21.15.150:0/187632661 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:50:02.969 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:02.966+0000 7fa317fff640 1 --2- 172.21.15.150:0/187632661 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa3180d0550 0x7fa3181f51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:50:02.969 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:02.966+0000 7fa31cce7640 1 --2- 172.21.15.150:0/187632661 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa3180d1060 0x7fa31806f290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:50:02.969 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:02.966+0000 7fa3177fe640 1 -- 172.21.15.150:0/187632661 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa3180d0550 msgr2=0x7fa3181f51b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:50:02.969 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:02.966+0000 7fa3177fe640 1 --2- 172.21.15.150:0/187632661 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa3180d0550 0x7fa3181f51b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:50:02.969 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:02.966+0000 7fa3177fe640 1 -- 172.21.15.150:0/187632661 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa3180d1060 msgr2=0x7fa31806f290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:50:02.969 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:02.966+0000 7fa3177fe640 1 --2- 172.21.15.150:0/187632661 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa3180d1060 0x7fa31806f290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:50:02.969 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:02.966+0000 7fa3177fe640 1 -- 172.21.15.150:0/187632661 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa3180cc590 con 0x7fa3180d0c50 2024-09-17T05:50:02.970 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:02.966+0000 7fa3177fe640 1 --2- 172.21.15.150:0/187632661 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa3180d0c50 0x7fa31806ed50 secure :-1 s=READY pgs=1248 cs=0 l=1 rev1=1 crypto rx=0x7fa30c034040 tx=0x7fa30c0039e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:50:02.970 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:02.966+0000 7fa314ff9640 1 -- 172.21.15.150:0/187632661 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa30c03e030 con 0x7fa3180d0c50 2024-09-17T05:50:02.970 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:02.966+0000 7fa314ff9640 1 -- 172.21.15.150:0/187632661 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa30c0047a0 con 0x7fa3180d0c50 2024-09-17T05:50:02.970 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:02.966+0000 7fa31e74a640 1 -- 172.21.15.150:0/187632661 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa3180c9760 con 0x7fa3180d0c50 2024-09-17T05:50:02.970 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:02.966+0000 7fa314ff9640 1 -- 172.21.15.150:0/187632661 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa30c035040 con 0x7fa3180d0c50 2024-09-17T05:50:02.970 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:02.967+0000 7fa31e74a640 1 -- 172.21.15.150:0/187632661 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa3181f56f0 con 0x7fa3180d0c50 2024-09-17T05:50:02.971 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:02.968+0000 7fa31e74a640 1 -- 172.21.15.150:0/187632661 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa3180d0010 con 0x7fa3180d0c50 2024-09-17T05:50:02.971 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:02.968+0000 7fa314ff9640 1 -- 172.21.15.150:0/187632661 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 32) ==== 103481+0+0 (secure 0 0 0) 0x7fa30c041030 con 0x7fa3180d0c50 2024-09-17T05:50:02.971 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:02.969+0000 7fa314ff9640 1 --2- 172.21.15.150:0/187632661 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fa30407a210 0x7fa30407c720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:50:02.971 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:02.969+0000 7fa314ff9640 1 -- 172.21.15.150:0/187632661 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 5878+0+0 (secure 0 0 0) 0x7fa30c0ba1a0 con 0x7fa3180d0c50 2024-09-17T05:50:02.971 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:02.969+0000 7fa317fff640 1 --2- 172.21.15.150:0/187632661 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fa30407a210 0x7fa30407c720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:50:02.971 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:02.970+0000 7fa317fff640 1 --2- 172.21.15.150:0/187632661 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fa30407a210 0x7fa30407c720 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7fa30800bb50 tx=0x7fa30800b2e0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:50:02.975 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:02.974+0000 7fa314ff9640 1 -- 172.21.15.150:0/187632661 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fa30c083aa0 con 0x7fa3180d0c50 2024-09-17T05:50:03.158 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:03.157+0000 7fa31e74a640 1 -- 172.21.15.150:0/187632661 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fa3180b7100 con 0x7fa3180d0c50 2024-09-17T05:50:03.160 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:03.158+0000 7fa314ff9640 1 -- 172.21.15.150:0/187632661 <== mon.0 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v89) ==== 74+0+17049 (secure 0 0 0) 0x7fa30c0884d0 con 0x7fa3180d0c50 2024-09-17T05:50:03.161 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-09-17T05:50:03.161 INFO:teuthology.orchestra.run.smithi150.stdout:{"epoch":89,"fsid":"9f2e05e9-d629-47b3-b26b-1360655b7d20","created":"2024-09-17T05:41:32.502979+0000","modified":"2024-09-17T05:49:57.467152+0000","last_up_change":"2024-09-17T05:41:46.150225+0000","last_in_change":"2024-09-17T05:41:36.120274+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":13,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T05:41:46.860779+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_metadata","create_time":"2024-09-17T05:48:03.989113+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_data","create_time":"2024-09-17T05:48:05.314806+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"89","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":3,"snap_epoch":89,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"4f31c018-c8a4-4d6d-b0c2-a597c47aae4a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6800","nonce":479374392},{"type":"v1","addr":"172.21.15.150:6801","nonce":479374392}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6802","nonce":479374392},{"type":"v1","addr":"172.21.15.150:6803","nonce":479374392}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6806","nonce":479374392},{"type":"v1","addr":"172.21.15.150:6807","nonce":479374392}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6804","nonce":479374392},{"type":"v1","addr":"172.21.15.150:6805","nonce":479374392}]},"public_addr":"172.21.15.150:6801/479374392","cluster_addr":"172.21.15.150:6803/479374392","heartbeat_back_addr":"172.21.15.150:6807/479374392","heartbeat_front_addr":"172.21.15.150:6805/479374392","state":["exists","up"]},{"osd":1,"uuid":"6ff4a573-500b-4e04-9de3-39265ead78b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6824","nonce":913899800},{"type":"v1","addr":"172.21.15.150:6825","nonce":913899800}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6826","nonce":913899800},{"type":"v1","addr":"172.21.15.150:6827","nonce":913899800}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6830","nonce":913899800},{"type":"v1","addr":"172.21.15.150:6831","nonce":913899800}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6828","nonce":913899800},{"type":"v1","addr":"172.21.15.150:6829","nonce":913899800}]},"public_addr":"172.21.15.150:6825/913899800","cluster_addr":"172.21.15.150:6827/913899800","heartbeat_back_addr":"172.21.15.150:6831/913899800","heartbeat_front_addr":"172.21.15.150:6829/913899800","state":["exists","up"]},{"osd":2,"uuid":"bffea6f9-2465-4182-b205-00436c41ac1c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6816","nonce":363718461},{"type":"v1","addr":"172.21.15.150:6817","nonce":363718461}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6818","nonce":363718461},{"type":"v1","addr":"172.21.15.150:6819","nonce":363718461}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6822","nonce":363718461},{"type":"v1","addr":"172.21.15.150:6823","nonce":363718461}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6820","nonce":363718461},{"type":"v1","addr":"172.21.15.150:6821","nonce":363718461}]},"public_addr":"172.21.15.150:6817/363718461","cluster_addr":"172.21.15.150:6819/363718461","heartbeat_back_addr":"172.21.15.150:6823/363718461","heartbeat_front_addr":"172.21.15.150:6821/363718461","state":["exists","up"]},{"osd":3,"uuid":"cda70430-d1e1-427e-b04e-56db4031d078","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6808","nonce":3550994626},{"type":"v1","addr":"172.21.15.150:6809","nonce":3550994626}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6810","nonce":3550994626},{"type":"v1","addr":"172.21.15.150:6811","nonce":3550994626}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6814","nonce":3550994626},{"type":"v1","addr":"172.21.15.150:6815","nonce":3550994626}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6812","nonce":3550994626},{"type":"v1","addr":"172.21.15.150:6813","nonce":3550994626}]},"public_addr":"172.21.15.150:6809/3550994626","cluster_addr":"172.21.15.150:6811/3550994626","heartbeat_back_addr":"172.21.15.150:6815/3550994626","heartbeat_front_addr":"172.21.15.150:6813/3550994626","state":["exists","up"]},{"osd":4,"uuid":"3a0277fb-5e1e-4f68-bb2d-9a8a0152f64a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6810","nonce":2718261497},{"type":"v1","addr":"172.21.15.176:6811","nonce":2718261497}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6812","nonce":2718261497},{"type":"v1","addr":"172.21.15.176:6813","nonce":2718261497}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6816","nonce":2718261497},{"type":"v1","addr":"172.21.15.176:6817","nonce":2718261497}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6814","nonce":2718261497},{"type":"v1","addr":"172.21.15.176:6815","nonce":2718261497}]},"public_addr":"172.21.15.176:6811/2718261497","cluster_addr":"172.21.15.176:6813/2718261497","heartbeat_back_addr":"172.21.15.176:6817/2718261497","heartbeat_front_addr":"172.21.15.176:6815/2718261497","state":["exists","up"]},{"osd":5,"uuid":"33aebee6-0315-40b7-a11c-6702f0be494d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6818","nonce":2049295774},{"type":"v1","addr":"172.21.15.176:6819","nonce":2049295774}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6820","nonce":2049295774},{"type":"v1","addr":"172.21.15.176:6821","nonce":2049295774}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6824","nonce":2049295774},{"type":"v1","addr":"172.21.15.176:6825","nonce":2049295774}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6822","nonce":2049295774},{"type":"v1","addr":"172.21.15.176:6823","nonce":2049295774}]},"public_addr":"172.21.15.176:6819/2049295774","cluster_addr":"172.21.15.176:6821/2049295774","heartbeat_back_addr":"172.21.15.176:6825/2049295774","heartbeat_front_addr":"172.21.15.176:6823/2049295774","state":["exists","up"]},{"osd":6,"uuid":"4d24f360-6751-4263-841b-d77793d33540","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6826","nonce":2164458476},{"type":"v1","addr":"172.21.15.176:6827","nonce":2164458476}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6828","nonce":2164458476},{"type":"v1","addr":"172.21.15.176:6829","nonce":2164458476}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6832","nonce":2164458476},{"type":"v1","addr":"172.21.15.176:6833","nonce":2164458476}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6830","nonce":2164458476},{"type":"v1","addr":"172.21.15.176:6831","nonce":2164458476}]},"public_addr":"172.21.15.176:6827/2164458476","cluster_addr":"172.21.15.176:6829/2164458476","heartbeat_back_addr":"172.21.15.176:6833/2164458476","heartbeat_front_addr":"172.21.15.176:6831/2164458476","state":["exists","up"]},{"osd":7,"uuid":"c8594fda-c74a-4ba9-8277-caf101d58ca1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6802","nonce":3239587708},{"type":"v1","addr":"172.21.15.176:6803","nonce":3239587708}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6804","nonce":3239587708},{"type":"v1","addr":"172.21.15.176:6805","nonce":3239587708}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6808","nonce":3239587708},{"type":"v1","addr":"172.21.15.176:6809","nonce":3239587708}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6806","nonce":3239587708},{"type":"v1","addr":"172.21.15.176:6807","nonce":3239587708}]},"public_addr":"172.21.15.176:6803/3239587708","cluster_addr":"172.21.15.176:6805/3239587708","heartbeat_back_addr":"172.21.15.176:6809/3239587708","heartbeat_front_addr":"172.21.15.176:6807/3239587708","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:41:41.905151+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:41:42.705679+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:41:42.459673+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:41:42.440819+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:41:42.668428+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:41:42.694972+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:41:43.078535+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:41:42.363539+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"13.3e","mappings":[{"from":1,"to":3}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":7,"snaps":[{"begin":2,"length":2}]},{"pool":9,"snaps":[{"begin":2,"length":2}]},{"pool":11,"snaps":[{"begin":2,"length":2}]},{"pool":13,"snaps":[{"begin":2,"length":2}]}],"new_removed_snaps":[{"pool":13,"snaps":[{"begin":2,"length":2}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T05:50:03.165 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:03.163+0000 7fa31e74a640 1 -- 172.21.15.150:0/187632661 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fa30407a210 msgr2=0x7fa30407c720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:50:03.165 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:03.163+0000 7fa31e74a640 1 --2- 172.21.15.150:0/187632661 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fa30407a210 0x7fa30407c720 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7fa30800bb50 tx=0x7fa30800b2e0 comp rx=0 tx=0).stop 2024-09-17T05:50:03.165 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:03.163+0000 7fa31e74a640 1 -- 172.21.15.150:0/187632661 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa3180d0c50 msgr2=0x7fa31806ed50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:50:03.165 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:03.163+0000 7fa31e74a640 1 --2- 172.21.15.150:0/187632661 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa3180d0c50 0x7fa31806ed50 secure :-1 s=READY pgs=1248 cs=0 l=1 rev1=1 crypto rx=0x7fa30c034040 tx=0x7fa30c0039e0 comp rx=0 tx=0).stop 2024-09-17T05:50:03.165 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:03.163+0000 7fa31e74a640 1 -- 172.21.15.150:0/187632661 shutdown_connections 2024-09-17T05:50:03.165 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:03.163+0000 7fa31e74a640 1 --2- 172.21.15.150:0/187632661 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa3180d1060 0x7fa31806f290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:50:03.165 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:03.163+0000 7fa31e74a640 1 --2- 172.21.15.150:0/187632661 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fa30407a210 0x7fa30407c720 unknown :-1 s=CLOSED pgs=537 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:50:03.165 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:03.163+0000 7fa31e74a640 1 --2- 172.21.15.150:0/187632661 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa3180d0c50 0x7fa31806ed50 unknown :-1 s=CLOSED pgs=1248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:50:03.165 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:03.163+0000 7fa31e74a640 1 --2- 172.21.15.150:0/187632661 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa3180d0550 0x7fa3181f51b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:50:03.165 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:03.163+0000 7fa31e74a640 1 -- 172.21.15.150:0/187632661 >> 172.21.15.150:0/187632661 conn(0x7fa3180b3fc0 msgr2=0x7fa31815da60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:50:03.165 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:03.163+0000 7fa31e74a640 1 -- 172.21.15.150:0/187632661 shutdown_connections 2024-09-17T05:50:03.166 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:03.163+0000 7fa31e74a640 1 -- 172.21.15.150:0/187632661 wait complete. 2024-09-17T05:50:03.183 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-09-17T05:50:03.184 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T05:50:03.319 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:03.317+0000 7f6c99af9640 1 -- 172.21.15.150:0/1571093096 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6c940b5e20 msgr2=0x7f6c94168190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:50:03.319 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:03.317+0000 7f6c99af9640 1 --2- 172.21.15.150:0/1571093096 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6c940b5e20 0x7f6c94168190 secure :-1 s=READY pgs=1250 cs=0 l=1 rev1=1 crypto rx=0x7f6c8c005fd0 tx=0x7f6c8c02ab40 comp rx=0 tx=0).stop 2024-09-17T05:50:03.319 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:03.317+0000 7f6c99af9640 1 -- 172.21.15.150:0/1571093096 shutdown_connections 2024-09-17T05:50:03.319 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:03.317+0000 7f6c99af9640 1 --2- 172.21.15.150:0/1571093096 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6c940b5e20 0x7f6c94168190 unknown :-1 s=CLOSED pgs=1250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:50:03.319 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:03.317+0000 7f6c99af9640 1 -- 172.21.15.150:0/1571093096 >> 172.21.15.150:0/1571093096 conn(0x7f6c940cef30 msgr2=0x7f6c940cf340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:50:03.319 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:03.317+0000 7f6c99af9640 1 -- 172.21.15.150:0/1571093096 shutdown_connections 2024-09-17T05:50:03.320 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:03.317+0000 7f6c99af9640 1 -- 172.21.15.150:0/1571093096 wait complete. 2024-09-17T05:50:03.320 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:03.319+0000 7f6c99af9640 1 Processor -- start 2024-09-17T05:50:03.320 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:03.319+0000 7f6c99af9640 1 -- start start 2024-09-17T05:50:03.323 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:03.320+0000 7f6c99af9640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6c940b5300 0x7f6c941d4d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:50:03.323 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:03.320+0000 7f6c99af9640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6c940b5e20 0x7f6c941d74e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:50:03.323 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:03.320+0000 7f6c99af9640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6c940b7490 0x7f6c941d7a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:50:03.323 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:03.320+0000 7f6c99af9640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f6c940b63b0 con 0x7f6c940b5e20 2024-09-17T05:50:03.323 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:03.320+0000 7f6c99af9640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f6c940b6230 con 0x7f6c940b7490 2024-09-17T05:50:03.324 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:03.320+0000 7f6c99af9640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f6c940d1460 con 0x7f6c940b5300 2024-09-17T05:50:03.324 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:03.320+0000 7f6c92ffd640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6c940b5e20 0x7f6c941d74e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:50:03.324 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:03.320+0000 7f6c92ffd640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6c940b5e20 0x7f6c941d74e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:54908/0 (socket says 172.21.15.150:54908) 2024-09-17T05:50:03.324 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:03.320+0000 7f6c92ffd640 1 -- 172.21.15.150:0/527995260 learned_addr learned my addr 172.21.15.150:0/527995260 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:50:03.324 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:03.321+0000 7f6c937fe640 1 --2- 172.21.15.150:0/527995260 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6c940b5300 0x7f6c941d4d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:50:03.324 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:03.321+0000 7f6c93fff640 1 --2- 172.21.15.150:0/527995260 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6c940b7490 0x7f6c941d7a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:50:03.324 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:03.321+0000 7f6c92ffd640 1 -- 172.21.15.150:0/527995260 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6c940b5300 msgr2=0x7f6c941d4d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:50:03.324 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:03.321+0000 7f6c92ffd640 1 --2- 172.21.15.150:0/527995260 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6c940b5300 0x7f6c941d4d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:50:03.324 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:03.321+0000 7f6c92ffd640 1 -- 172.21.15.150:0/527995260 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6c940b7490 msgr2=0x7f6c941d7a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:50:03.324 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:03.321+0000 7f6c92ffd640 1 --2- 172.21.15.150:0/527995260 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6c940b7490 0x7f6c941d7a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:50:03.324 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:03.321+0000 7f6c92ffd640 1 -- 172.21.15.150:0/527995260 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6c941f6490 con 0x7f6c940b5e20 2024-09-17T05:50:03.324 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:03.321+0000 7f6c937fe640 1 --2- 172.21.15.150:0/527995260 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6c940b5300 0x7f6c941d4d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T05:50:03.324 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:03.321+0000 7f6c92ffd640 1 --2- 172.21.15.150:0/527995260 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6c940b5e20 0x7f6c941d74e0 secure :-1 s=READY pgs=1251 cs=0 l=1 rev1=1 crypto rx=0x7f6c8800c400 tx=0x7f6c8800c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:50:03.325 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:03.321+0000 7f6c7bfff640 1 -- 172.21.15.150:0/527995260 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c88017070 con 0x7f6c940b5e20 2024-09-17T05:50:03.325 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:03.321+0000 7f6c7bfff640 1 -- 172.21.15.150:0/527995260 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f6c880053c0 con 0x7f6c940b5e20 2024-09-17T05:50:03.325 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:03.321+0000 7f6c99af9640 1 -- 172.21.15.150:0/527995260 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6c941f6770 con 0x7f6c940b5e20 2024-09-17T05:50:03.325 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:03.321+0000 7f6c7bfff640 1 -- 172.21.15.150:0/527995260 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c88003850 con 0x7f6c940b5e20 2024-09-17T05:50:03.325 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:03.321+0000 7f6c99af9640 1 -- 172.21.15.150:0/527995260 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6c940caac0 con 0x7f6c940b5e20 2024-09-17T05:50:03.326 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:03.322+0000 7f6c99af9640 1 -- 172.21.15.150:0/527995260 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6c941f6200 con 0x7f6c940b5e20 2024-09-17T05:50:03.326 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:03.323+0000 7f6c7bfff640 1 -- 172.21.15.150:0/527995260 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 32) ==== 103481+0+0 (secure 0 0 0) 0x7f6c8801a070 con 0x7f6c940b5e20 2024-09-17T05:50:03.326 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:03.323+0000 7f6c7bfff640 1 --2- 172.21.15.150:0/527995260 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f6c8007a210 0x7f6c8007c720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:50:03.326 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:03.324+0000 7f6c7bfff640 1 -- 172.21.15.150:0/527995260 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 5878+0+0 (secure 0 0 0) 0x7f6c88098eb0 con 0x7f6c940b5e20 2024-09-17T05:50:03.326 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:03.324+0000 7f6c937fe640 1 --2- 172.21.15.150:0/527995260 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f6c8007a210 0x7f6c8007c720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:50:03.326 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:03.324+0000 7f6c937fe640 1 --2- 172.21.15.150:0/527995260 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f6c8007a210 0x7f6c8007c720 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7f6c840015b0 tx=0x7f6c84009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:50:03.330 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:03.328+0000 7f6c7bfff640 1 -- 172.21.15.150:0/527995260 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f6c88062d70 con 0x7f6c940b5e20 2024-09-17T05:50:03.540 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:03.539+0000 7f6c99af9640 1 -- 172.21.15.150:0/527995260 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f6c941f6c90 con 0x7f6c940b5e20 2024-09-17T05:50:03.541 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:03.539+0000 7f6c7bfff640 1 -- 172.21.15.150:0/527995260 <== mon.0 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 52 v52) ==== 94+0+5237 (secure 0 0 0) 0x7f6c941f6c90 con 0x7f6c940b5e20 2024-09-17T05:50:03.541 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-09-17T05:50:03.541 INFO:teuthology.orchestra.run.smithi150.stdout:{"epoch":52,"btime":"2024-09-17T05:48:19:238380+0000","default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5993,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6835/1590564966","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6833","nonce":1590564966},{"type":"v1","addr":"172.21.15.150:6835","nonce":1590564966}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":47},{"gid":6008,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6837/3094459008","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6835","nonce":3094459008},{"type":"v1","addr":"172.21.15.176:6837","nonce":3094459008}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":47},{"gid":6484,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6834/1586974380","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6832","nonce":1586974380},{"type":"v1","addr":"172.21.15.150:6834","nonce":1586974380}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":46}],"filesystems":[{"mdsmap":{"epoch":51,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T05:48:06.348623+0000","modified":"2024-09-17T05:48:09.356798+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6496},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6496":{"gid":6496,"name":"d","rank":0,"incarnation":48,"state":"up:active","state_seq":3,"addr":"172.21.15.176:6836/4093204117","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6834","nonce":4093204117},{"type":"v1","addr":"172.21.15.176:6836","nonce":4093204117}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6496,"qdb_cluster":[6496]},"id":6}]} 2024-09-17T05:50:03.542 INFO:teuthology.orchestra.run.smithi150.stderr:dumped fsmap epoch 52 2024-09-17T05:50:03.544 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:03.542+0000 7f6c99af9640 1 -- 172.21.15.150:0/527995260 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f6c8007a210 msgr2=0x7f6c8007c720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:50:03.544 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:03.542+0000 7f6c99af9640 1 --2- 172.21.15.150:0/527995260 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f6c8007a210 0x7f6c8007c720 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7f6c840015b0 tx=0x7f6c84009040 comp rx=0 tx=0).stop 2024-09-17T05:50:03.544 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:03.542+0000 7f6c99af9640 1 -- 172.21.15.150:0/527995260 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6c940b5e20 msgr2=0x7f6c941d74e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:50:03.544 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:03.542+0000 7f6c99af9640 1 --2- 172.21.15.150:0/527995260 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6c940b5e20 0x7f6c941d74e0 secure :-1 s=READY pgs=1251 cs=0 l=1 rev1=1 crypto rx=0x7f6c8800c400 tx=0x7f6c8800c8c0 comp rx=0 tx=0).stop 2024-09-17T05:50:03.544 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:03.542+0000 7f6c99af9640 1 -- 172.21.15.150:0/527995260 shutdown_connections 2024-09-17T05:50:03.544 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:03.542+0000 7f6c99af9640 1 --2- 172.21.15.150:0/527995260 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6c940b7490 0x7f6c941d7a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:50:03.544 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:03.542+0000 7f6c99af9640 1 --2- 172.21.15.150:0/527995260 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f6c8007a210 0x7f6c8007c720 unknown :-1 s=CLOSED pgs=538 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:50:03.544 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:03.542+0000 7f6c99af9640 1 --2- 172.21.15.150:0/527995260 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6c940b5e20 0x7f6c941d74e0 unknown :-1 s=CLOSED pgs=1251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:50:03.544 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:03.542+0000 7f6c99af9640 1 --2- 172.21.15.150:0/527995260 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6c940b5300 0x7f6c941d4d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:50:03.544 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:03.542+0000 7f6c99af9640 1 -- 172.21.15.150:0/527995260 >> 172.21.15.150:0/527995260 conn(0x7f6c940cef30 msgr2=0x7f6c9409aa50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:50:03.544 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:03.542+0000 7f6c99af9640 1 -- 172.21.15.150:0/527995260 shutdown_connections 2024-09-17T05:50:03.545 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:03.542+0000 7f6c99af9640 1 -- 172.21.15.150:0/527995260 wait complete. 2024-09-17T05:50:03.555 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T05:50:03.669 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:03.667+0000 7f851f627640 1 -- 172.21.15.150:0/1765591563 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8500004800 msgr2=0x7f8500004c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:50:03.670 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:03.667+0000 7f851f627640 1 --2- 172.21.15.150:0/1765591563 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8500004800 0x7f8500004c10 secure :-1 s=READY pgs=1253 cs=0 l=1 rev1=1 crypto rx=0x7f85180d0660 tx=0x7f8500005830 comp rx=0 tx=0).stop 2024-09-17T05:50:03.670 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:03.668+0000 7f851dbc4640 1 -- 172.21.15.150:0/1765591563 reap_dead start 2024-09-17T05:50:03.670 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:03.668+0000 7f851f627640 1 -- 172.21.15.150:0/1765591563 shutdown_connections 2024-09-17T05:50:03.670 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:03.668+0000 7f851f627640 1 -- 172.21.15.150:0/1765591563 >> 172.21.15.150:0/1765591563 conn(0x7f85180d0b50 msgr2=0x7f85180d0f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:50:03.670 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:03.668+0000 7f851f627640 1 -- 172.21.15.150:0/1765591563 shutdown_connections 2024-09-17T05:50:03.670 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:03.668+0000 7f851f627640 1 -- 172.21.15.150:0/1765591563 wait complete. 2024-09-17T05:50:03.671 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:03.669+0000 7f851f627640 1 Processor -- start 2024-09-17T05:50:03.671 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:03.669+0000 7f851f627640 1 -- start start 2024-09-17T05:50:03.674 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:03.671+0000 7f851f627640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8500004800 0x7f85181e73f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:50:03.674 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:03.671+0000 7f851f627640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f85181e60b0 0x7f85181e64c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:50:03.674 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:03.671+0000 7f851f627640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f85181e6a00 0x7f851813a0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:50:03.674 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:03.671+0000 7f851f627640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f8518160050 con 0x7f8500004800 2024-09-17T05:50:03.674 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:03.671+0000 7f851f627640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f851815fed0 con 0x7f85181e60b0 2024-09-17T05:50:03.674 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:03.671+0000 7f851f627640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f85181601d0 con 0x7f85181e6a00 2024-09-17T05:50:03.675 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:03.671+0000 7f851d3c3640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8500004800 0x7f85181e73f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:50:03.675 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:03.671+0000 7f851d3c3640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8500004800 0x7f85181e73f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:54918/0 (socket says 172.21.15.150:54918) 2024-09-17T05:50:03.675 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:03.671+0000 7f851d3c3640 1 -- 172.21.15.150:0/674818096 learned_addr learned my addr 172.21.15.150:0/674818096 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:50:03.675 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:03.671+0000 7f851cbc2640 1 --2- 172.21.15.150:0/674818096 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f85181e60b0 0x7f85181e64c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:50:03.675 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:03.671+0000 7f851dbc4640 1 --2- 172.21.15.150:0/674818096 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f85181e6a00 0x7f851813a0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:50:03.675 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:03.671+0000 7f851d3c3640 1 -- 172.21.15.150:0/674818096 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f85181e6a00 msgr2=0x7f851813a0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:50:03.675 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:03.671+0000 7f851d3c3640 1 --2- 172.21.15.150:0/674818096 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f85181e6a00 0x7f851813a0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:50:03.675 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:03.671+0000 7f851d3c3640 1 -- 172.21.15.150:0/674818096 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f85181e60b0 msgr2=0x7f85181e64c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:50:03.675 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:03.671+0000 7f851d3c3640 1 --2- 172.21.15.150:0/674818096 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f85181e60b0 0x7f85181e64c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:50:03.675 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:03.671+0000 7f851d3c3640 1 -- 172.21.15.150:0/674818096 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f85181ead70 con 0x7f8500004800 2024-09-17T05:50:03.675 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:03.671+0000 7f851d3c3640 1 --2- 172.21.15.150:0/674818096 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8500004800 0x7f85181e73f0 secure :-1 s=READY pgs=1254 cs=0 l=1 rev1=1 crypto rx=0x7f8510006650 tx=0x7f8510001800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:50:03.675 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:03.671+0000 7f8515ffb640 1 -- 172.21.15.150:0/674818096 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8510011700 con 0x7f8500004800 2024-09-17T05:50:03.675 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:03.671+0000 7f8515ffb640 1 -- 172.21.15.150:0/674818096 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8510016020 con 0x7f8500004800 2024-09-17T05:50:03.676 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:03.671+0000 7f8515ffb640 1 -- 172.21.15.150:0/674818096 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8510011b00 con 0x7f8500004800 2024-09-17T05:50:03.676 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:03.671+0000 7f851f627640 1 -- 172.21.15.150:0/674818096 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8518139600 con 0x7f8500004800 2024-09-17T05:50:03.676 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:03.672+0000 7f851f627640 1 -- 172.21.15.150:0/674818096 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8518139bc0 con 0x7f8500004800 2024-09-17T05:50:03.676 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:03.673+0000 7f851f627640 1 -- 172.21.15.150:0/674818096 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f85180714e0 con 0x7f8500004800 2024-09-17T05:50:03.676 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:03.673+0000 7f8515ffb640 1 -- 172.21.15.150:0/674818096 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 32) ==== 103481+0+0 (secure 0 0 0) 0x7f8510011ca0 con 0x7f8500004800 2024-09-17T05:50:03.677 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:03.674+0000 7f8515ffb640 1 --2- 172.21.15.150:0/674818096 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f850407a240 0x7f850407c750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:50:03.677 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:03.674+0000 7f8515ffb640 1 -- 172.21.15.150:0/674818096 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 5878+0+0 (secure 0 0 0) 0x7f851009a530 con 0x7f8500004800 2024-09-17T05:50:03.677 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:03.674+0000 7f851cbc2640 1 --2- 172.21.15.150:0/674818096 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f850407a240 0x7f850407c750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:50:03.677 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:03.674+0000 7f851cbc2640 1 --2- 172.21.15.150:0/674818096 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f850407a240 0x7f850407c750 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7f850c034000 tx=0x7f850c02d040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:50:03.680 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:03.678+0000 7f8515ffb640 1 -- 172.21.15.150:0/674818096 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f8510020020 con 0x7f8500004800 2024-09-17T05:50:03.891 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:03.889+0000 7f851f627640 1 -- 172.21.15.150:0/674818096 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f8518072200 con 0x7f8500004800 2024-09-17T05:50:03.891 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:03.890+0000 7f8515ffb640 1 -- 172.21.15.150:0/674818096 <== mon.0 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 52 v52) ==== 94+0+5237 (secure 0 0 0) 0x7f8510063e20 con 0x7f8500004800 2024-09-17T05:50:03.892 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-09-17T05:50:03.892 INFO:teuthology.orchestra.run.smithi150.stdout:{"epoch":52,"btime":"2024-09-17T05:48:19:238380+0000","default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5993,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6835/1590564966","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6833","nonce":1590564966},{"type":"v1","addr":"172.21.15.150:6835","nonce":1590564966}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":47},{"gid":6008,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6837/3094459008","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6835","nonce":3094459008},{"type":"v1","addr":"172.21.15.176:6837","nonce":3094459008}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":47},{"gid":6484,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6834/1586974380","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6832","nonce":1586974380},{"type":"v1","addr":"172.21.15.150:6834","nonce":1586974380}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":46}],"filesystems":[{"mdsmap":{"epoch":51,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T05:48:06.348623+0000","modified":"2024-09-17T05:48:09.356798+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6496},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6496":{"gid":6496,"name":"d","rank":0,"incarnation":48,"state":"up:active","state_seq":3,"addr":"172.21.15.176:6836/4093204117","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6834","nonce":4093204117},{"type":"v1","addr":"172.21.15.176:6836","nonce":4093204117}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6496,"qdb_cluster":[6496]},"id":6}]} 2024-09-17T05:50:03.892 INFO:teuthology.orchestra.run.smithi150.stderr:dumped fsmap epoch 52 2024-09-17T05:50:03.894 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:03.892+0000 7f851f627640 1 -- 172.21.15.150:0/674818096 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f850407a240 msgr2=0x7f850407c750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:50:03.895 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:03.892+0000 7f851f627640 1 --2- 172.21.15.150:0/674818096 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f850407a240 0x7f850407c750 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7f850c034000 tx=0x7f850c02d040 comp rx=0 tx=0).stop 2024-09-17T05:50:03.895 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:03.892+0000 7f851f627640 1 -- 172.21.15.150:0/674818096 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8500004800 msgr2=0x7f85181e73f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:50:03.895 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:03.892+0000 7f851f627640 1 --2- 172.21.15.150:0/674818096 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8500004800 0x7f85181e73f0 secure :-1 s=READY pgs=1254 cs=0 l=1 rev1=1 crypto rx=0x7f8510006650 tx=0x7f8510001800 comp rx=0 tx=0).stop 2024-09-17T05:50:03.895 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:03.892+0000 7f851f627640 1 -- 172.21.15.150:0/674818096 shutdown_connections 2024-09-17T05:50:03.895 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:03.892+0000 7f851f627640 1 --2- 172.21.15.150:0/674818096 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f85181e60b0 0x7f85181e64c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:50:03.895 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:03.892+0000 7f851f627640 1 --2- 172.21.15.150:0/674818096 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f850407a240 0x7f850407c750 unknown :-1 s=CLOSED pgs=539 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:50:03.895 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:03.892+0000 7f851f627640 1 --2- 172.21.15.150:0/674818096 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f85181e6a00 0x7f851813a0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:50:03.895 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:03.892+0000 7f851f627640 1 --2- 172.21.15.150:0/674818096 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8500004800 0x7f85181e73f0 unknown :-1 s=CLOSED pgs=1254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:50:03.895 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:03.892+0000 7f851f627640 1 -- 172.21.15.150:0/674818096 >> 172.21.15.150:0/674818096 conn(0x7f85180d0b50 msgr2=0x7f8518151e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:50:03.895 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:03.892+0000 7f851f627640 1 -- 172.21.15.150:0/674818096 shutdown_connections 2024-09-17T05:50:03.895 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:03.892+0000 7f851f627640 1 -- 172.21.15.150:0/674818096 wait complete. 2024-09-17T05:50:03.905 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T05:50:04.019 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:04.017+0000 7f16f59da640 1 -- 172.21.15.150:0/1953761497 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f16f015ee50 msgr2=0x7f16f00d1090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:50:04.019 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:04.017+0000 7f16f59da640 1 --2- 172.21.15.150:0/1953761497 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f16f015ee50 0x7f16f00d1090 secure :-1 s=READY pgs=1255 cs=0 l=1 rev1=1 crypto rx=0x7f16f00ba730 tx=0x7f16d802a4d0 comp rx=0 tx=0).stop 2024-09-17T05:50:04.019 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:04.017+0000 7f16f59da640 1 -- 172.21.15.150:0/1953761497 shutdown_connections 2024-09-17T05:50:04.019 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:04.017+0000 7f16f59da640 1 --2- 172.21.15.150:0/1953761497 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f16f00d15d0 0x7f16f0162a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:50:04.019 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:04.017+0000 7f16f59da640 1 --2- 172.21.15.150:0/1953761497 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f16f015ee50 0x7f16f00d1090 unknown :-1 s=CLOSED pgs=1255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:50:04.019 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:04.017+0000 7f16f59da640 1 --2- 172.21.15.150:0/1953761497 >> v2:172.21.15.176:3300/0 conn(0x7f16f00b9780 0x7f16f00b3720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:50:04.020 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:04.017+0000 7f16f59da640 1 -- 172.21.15.150:0/1953761497 >> 172.21.15.150:0/1953761497 conn(0x7f16f00d4680 msgr2=0x7f16f00d4a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:50:04.020 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:04.017+0000 7f16f59da640 1 -- 172.21.15.150:0/1953761497 shutdown_connections 2024-09-17T05:50:04.020 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:04.017+0000 7f16f59da640 1 -- 172.21.15.150:0/1953761497 wait complete. 2024-09-17T05:50:04.020 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:04.019+0000 7f16f59da640 1 Processor -- start 2024-09-17T05:50:04.020 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:04.019+0000 7f16f59da640 1 -- start start 2024-09-17T05:50:04.026 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:04.020+0000 7f16f59da640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f16f00b9780 0x7f16f01f4f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:50:04.026 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:04.020+0000 7f16f59da640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f16f00d15d0 0x7f16f0161a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:50:04.026 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:04.020+0000 7f16f59da640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f16f015ee50 0x7f16f0161f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:50:04.026 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:04.020+0000 7f16f59da640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f16f0163120 con 0x7f16f00d15d0 2024-09-17T05:50:04.026 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:04.020+0000 7f16f59da640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f16f0162fa0 con 0x7f16f00b9780 2024-09-17T05:50:04.026 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:04.020+0000 7f16f59da640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f16f01632a0 con 0x7f16f015ee50 2024-09-17T05:50:04.026 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:04.020+0000 7f16e67fc640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f16f00d15d0 0x7f16f0161a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:50:04.026 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:04.020+0000 7f16e67fc640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f16f00d15d0 0x7f16f0161a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:54938/0 (socket says 172.21.15.150:54938) 2024-09-17T05:50:04.026 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:04.020+0000 7f16e67fc640 1 -- 172.21.15.150:0/1834940891 learned_addr learned my addr 172.21.15.150:0/1834940891 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:50:04.026 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:04.020+0000 7f16ef7fe640 1 --2- 172.21.15.150:0/1834940891 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f16f015ee50 0x7f16f0161f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:50:04.027 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:04.020+0000 7f16eeffd640 1 --2- 172.21.15.150:0/1834940891 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f16f00b9780 0x7f16f01f4f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:50:04.027 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:04.021+0000 7f16e67fc640 1 -- 172.21.15.150:0/1834940891 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f16f015ee50 msgr2=0x7f16f0161f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:50:04.027 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:04.021+0000 7f16e67fc640 1 --2- 172.21.15.150:0/1834940891 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f16f015ee50 0x7f16f0161f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:50:04.027 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:04.021+0000 7f16e67fc640 1 -- 172.21.15.150:0/1834940891 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f16f00b9780 msgr2=0x7f16f01f4f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:50:04.027 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:04.021+0000 7f16e67fc640 1 --2- 172.21.15.150:0/1834940891 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f16f00b9780 0x7f16f01f4f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:50:04.027 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:04.021+0000 7f16e67fc640 1 -- 172.21.15.150:0/1834940891 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f16f00b65a0 con 0x7f16f00d15d0 2024-09-17T05:50:04.027 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:04.021+0000 7f16e67fc640 1 --2- 172.21.15.150:0/1834940891 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f16f00d15d0 0x7f16f0161a20 secure :-1 s=READY pgs=1256 cs=0 l=1 rev1=1 crypto rx=0x7f16d8034040 tx=0x7f16d80039e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:50:04.027 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:04.021+0000 7f16ecff9640 1 -- 172.21.15.150:0/1834940891 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16d803e030 con 0x7f16f00d15d0 2024-09-17T05:50:04.027 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:04.021+0000 7f16ecff9640 1 -- 172.21.15.150:0/1834940891 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f16d80047a0 con 0x7f16f00d15d0 2024-09-17T05:50:04.027 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:04.021+0000 7f16f59da640 1 -- 172.21.15.150:0/1834940891 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f16f00b6a70 con 0x7f16f00d15d0 2024-09-17T05:50:04.027 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:04.021+0000 7f16ecff9640 1 -- 172.21.15.150:0/1834940891 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16d8035040 con 0x7f16f00d15d0 2024-09-17T05:50:04.027 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:04.021+0000 7f16f59da640 1 -- 172.21.15.150:0/1834940891 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f16f015f700 con 0x7f16f00d15d0 2024-09-17T05:50:04.027 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:04.022+0000 7f16f59da640 1 -- 172.21.15.150:0/1834940891 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f16f008d100 con 0x7f16f00d15d0 2024-09-17T05:50:04.028 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:04.023+0000 7f16ecff9640 1 -- 172.21.15.150:0/1834940891 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 32) ==== 103481+0+0 (secure 0 0 0) 0x7f16d8041030 con 0x7f16f00d15d0 2024-09-17T05:50:04.028 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:04.023+0000 7f16ecff9640 1 --2- 172.21.15.150:0/1834940891 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f16d007a210 0x7f16d007c720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:50:04.028 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:04.023+0000 7f16ecff9640 1 -- 172.21.15.150:0/1834940891 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 5878+0+0 (secure 0 0 0) 0x7f16d80ba210 con 0x7f16f00d15d0 2024-09-17T05:50:04.028 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:04.023+0000 7f16eeffd640 1 --2- 172.21.15.150:0/1834940891 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f16d007a210 0x7f16d007c720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:50:04.028 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:04.024+0000 7f16eeffd640 1 --2- 172.21.15.150:0/1834940891 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f16d007a210 0x7f16d007c720 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7f16e00058e0 tx=0x7f16e0005f70 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:50:04.029 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:04.028+0000 7f16ecff9640 1 -- 172.21.15.150:0/1834940891 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f16f008d100 con 0x7f16f00d15d0 2024-09-17T05:50:04.207 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:04.206+0000 7f16f59da640 1 -- 172.21.15.150:0/1834940891 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f16f00b6800 con 0x7f16f00d15d0 2024-09-17T05:50:04.208 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:04.207+0000 7f16ecff9640 1 -- 172.21.15.150:0/1834940891 <== mon.0 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v89) ==== 74+0+17049 (secure 0 0 0) 0x7f16d8083b90 con 0x7f16f00d15d0 2024-09-17T05:50:04.209 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-09-17T05:50:04.209 INFO:teuthology.orchestra.run.smithi150.stdout:{"epoch":89,"fsid":"9f2e05e9-d629-47b3-b26b-1360655b7d20","created":"2024-09-17T05:41:32.502979+0000","modified":"2024-09-17T05:49:57.467152+0000","last_up_change":"2024-09-17T05:41:46.150225+0000","last_in_change":"2024-09-17T05:41:36.120274+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":13,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T05:41:46.860779+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_metadata","create_time":"2024-09-17T05:48:03.989113+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_data","create_time":"2024-09-17T05:48:05.314806+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"89","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":3,"snap_epoch":89,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"4f31c018-c8a4-4d6d-b0c2-a597c47aae4a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6800","nonce":479374392},{"type":"v1","addr":"172.21.15.150:6801","nonce":479374392}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6802","nonce":479374392},{"type":"v1","addr":"172.21.15.150:6803","nonce":479374392}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6806","nonce":479374392},{"type":"v1","addr":"172.21.15.150:6807","nonce":479374392}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6804","nonce":479374392},{"type":"v1","addr":"172.21.15.150:6805","nonce":479374392}]},"public_addr":"172.21.15.150:6801/479374392","cluster_addr":"172.21.15.150:6803/479374392","heartbeat_back_addr":"172.21.15.150:6807/479374392","heartbeat_front_addr":"172.21.15.150:6805/479374392","state":["exists","up"]},{"osd":1,"uuid":"6ff4a573-500b-4e04-9de3-39265ead78b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6824","nonce":913899800},{"type":"v1","addr":"172.21.15.150:6825","nonce":913899800}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6826","nonce":913899800},{"type":"v1","addr":"172.21.15.150:6827","nonce":913899800}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6830","nonce":913899800},{"type":"v1","addr":"172.21.15.150:6831","nonce":913899800}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6828","nonce":913899800},{"type":"v1","addr":"172.21.15.150:6829","nonce":913899800}]},"public_addr":"172.21.15.150:6825/913899800","cluster_addr":"172.21.15.150:6827/913899800","heartbeat_back_addr":"172.21.15.150:6831/913899800","heartbeat_front_addr":"172.21.15.150:6829/913899800","state":["exists","up"]},{"osd":2,"uuid":"bffea6f9-2465-4182-b205-00436c41ac1c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6816","nonce":363718461},{"type":"v1","addr":"172.21.15.150:6817","nonce":363718461}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6818","nonce":363718461},{"type":"v1","addr":"172.21.15.150:6819","nonce":363718461}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6822","nonce":363718461},{"type":"v1","addr":"172.21.15.150:6823","nonce":363718461}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6820","nonce":363718461},{"type":"v1","addr":"172.21.15.150:6821","nonce":363718461}]},"public_addr":"172.21.15.150:6817/363718461","cluster_addr":"172.21.15.150:6819/363718461","heartbeat_back_addr":"172.21.15.150:6823/363718461","heartbeat_front_addr":"172.21.15.150:6821/363718461","state":["exists","up"]},{"osd":3,"uuid":"cda70430-d1e1-427e-b04e-56db4031d078","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6808","nonce":3550994626},{"type":"v1","addr":"172.21.15.150:6809","nonce":3550994626}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6810","nonce":3550994626},{"type":"v1","addr":"172.21.15.150:6811","nonce":3550994626}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6814","nonce":3550994626},{"type":"v1","addr":"172.21.15.150:6815","nonce":3550994626}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6812","nonce":3550994626},{"type":"v1","addr":"172.21.15.150:6813","nonce":3550994626}]},"public_addr":"172.21.15.150:6809/3550994626","cluster_addr":"172.21.15.150:6811/3550994626","heartbeat_back_addr":"172.21.15.150:6815/3550994626","heartbeat_front_addr":"172.21.15.150:6813/3550994626","state":["exists","up"]},{"osd":4,"uuid":"3a0277fb-5e1e-4f68-bb2d-9a8a0152f64a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6810","nonce":2718261497},{"type":"v1","addr":"172.21.15.176:6811","nonce":2718261497}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6812","nonce":2718261497},{"type":"v1","addr":"172.21.15.176:6813","nonce":2718261497}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6816","nonce":2718261497},{"type":"v1","addr":"172.21.15.176:6817","nonce":2718261497}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6814","nonce":2718261497},{"type":"v1","addr":"172.21.15.176:6815","nonce":2718261497}]},"public_addr":"172.21.15.176:6811/2718261497","cluster_addr":"172.21.15.176:6813/2718261497","heartbeat_back_addr":"172.21.15.176:6817/2718261497","heartbeat_front_addr":"172.21.15.176:6815/2718261497","state":["exists","up"]},{"osd":5,"uuid":"33aebee6-0315-40b7-a11c-6702f0be494d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6818","nonce":2049295774},{"type":"v1","addr":"172.21.15.176:6819","nonce":2049295774}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6820","nonce":2049295774},{"type":"v1","addr":"172.21.15.176:6821","nonce":2049295774}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6824","nonce":2049295774},{"type":"v1","addr":"172.21.15.176:6825","nonce":2049295774}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6822","nonce":2049295774},{"type":"v1","addr":"172.21.15.176:6823","nonce":2049295774}]},"public_addr":"172.21.15.176:6819/2049295774","cluster_addr":"172.21.15.176:6821/2049295774","heartbeat_back_addr":"172.21.15.176:6825/2049295774","heartbeat_front_addr":"172.21.15.176:6823/2049295774","state":["exists","up"]},{"osd":6,"uuid":"4d24f360-6751-4263-841b-d77793d33540","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6826","nonce":2164458476},{"type":"v1","addr":"172.21.15.176:6827","nonce":2164458476}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6828","nonce":2164458476},{"type":"v1","addr":"172.21.15.176:6829","nonce":2164458476}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6832","nonce":2164458476},{"type":"v1","addr":"172.21.15.176:6833","nonce":2164458476}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6830","nonce":2164458476},{"type":"v1","addr":"172.21.15.176:6831","nonce":2164458476}]},"public_addr":"172.21.15.176:6827/2164458476","cluster_addr":"172.21.15.176:6829/2164458476","heartbeat_back_addr":"172.21.15.176:6833/2164458476","heartbeat_front_addr":"172.21.15.176:6831/2164458476","state":["exists","up"]},{"osd":7,"uuid":"c8594fda-c74a-4ba9-8277-caf101d58ca1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6802","nonce":3239587708},{"type":"v1","addr":"172.21.15.176:6803","nonce":3239587708}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6804","nonce":3239587708},{"type":"v1","addr":"172.21.15.176:6805","nonce":3239587708}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6808","nonce":3239587708},{"type":"v1","addr":"172.21.15.176:6809","nonce":3239587708}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6806","nonce":3239587708},{"type":"v1","addr":"172.21.15.176:6807","nonce":3239587708}]},"public_addr":"172.21.15.176:6803/3239587708","cluster_addr":"172.21.15.176:6805/3239587708","heartbeat_back_addr":"172.21.15.176:6809/3239587708","heartbeat_front_addr":"172.21.15.176:6807/3239587708","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:41:41.905151+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:41:42.705679+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:41:42.459673+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:41:42.440819+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:41:42.668428+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:41:42.694972+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:41:43.078535+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:41:42.363539+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"13.3e","mappings":[{"from":1,"to":3}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":7,"snaps":[{"begin":2,"length":2}]},{"pool":9,"snaps":[{"begin":2,"length":2}]},{"pool":11,"snaps":[{"begin":2,"length":2}]},{"pool":13,"snaps":[{"begin":2,"length":2}]}],"new_removed_snaps":[{"pool":13,"snaps":[{"begin":2,"length":2}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T05:50:04.211 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:04.209+0000 7f16f59da640 1 -- 172.21.15.150:0/1834940891 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f16d007a210 msgr2=0x7f16d007c720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:50:04.211 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:04.209+0000 7f16f59da640 1 --2- 172.21.15.150:0/1834940891 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f16d007a210 0x7f16d007c720 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7f16e00058e0 tx=0x7f16e0005f70 comp rx=0 tx=0).stop 2024-09-17T05:50:04.211 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:04.209+0000 7f16f59da640 1 -- 172.21.15.150:0/1834940891 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f16f00d15d0 msgr2=0x7f16f0161a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:50:04.211 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:04.209+0000 7f16f59da640 1 --2- 172.21.15.150:0/1834940891 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f16f00d15d0 0x7f16f0161a20 secure :-1 s=READY pgs=1256 cs=0 l=1 rev1=1 crypto rx=0x7f16d8034040 tx=0x7f16d80039e0 comp rx=0 tx=0).stop 2024-09-17T05:50:04.211 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:04.209+0000 7f16f59da640 1 -- 172.21.15.150:0/1834940891 shutdown_connections 2024-09-17T05:50:04.211 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:04.209+0000 7f16f59da640 1 --2- 172.21.15.150:0/1834940891 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f16d007a210 0x7f16d007c720 unknown :-1 s=CLOSED pgs=540 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:50:04.212 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:04.209+0000 7f16f59da640 1 --2- 172.21.15.150:0/1834940891 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f16f015ee50 0x7f16f0161f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:50:04.212 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:04.209+0000 7f16f59da640 1 --2- 172.21.15.150:0/1834940891 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f16f00d15d0 0x7f16f0161a20 unknown :-1 s=CLOSED pgs=1256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:50:04.212 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:04.209+0000 7f16f59da640 1 --2- 172.21.15.150:0/1834940891 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f16f00b9780 0x7f16f01f4f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:50:04.212 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:04.209+0000 7f16f59da640 1 -- 172.21.15.150:0/1834940891 >> 172.21.15.150:0/1834940891 conn(0x7f16f00d4680 msgr2=0x7f16f00ce470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:50:04.212 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:04.209+0000 7f16f59da640 1 -- 172.21.15.150:0/1834940891 shutdown_connections 2024-09-17T05:50:04.212 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:04.209+0000 7f16f59da640 1 -- 172.21.15.150:0/1834940891 wait complete. 2024-09-17T05:50:04.223 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-09-17T05:50:04.339 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:04.337+0000 7fa8e165c640 1 -- 172.21.15.150:0/1191786783 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa8dc0b78c0 msgr2=0x7fa8dc0d0330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:50:04.339 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:04.337+0000 7fa8e165c640 1 --2- 172.21.15.150:0/1191786783 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa8dc0b78c0 0x7fa8dc0d0330 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7fa8c4005fd0 tx=0x7fa8c402a540 comp rx=0 tx=0).stop 2024-09-17T05:50:04.339 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:04.337+0000 7fa8e165c640 1 -- 172.21.15.150:0/1191786783 shutdown_connections 2024-09-17T05:50:04.339 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:04.337+0000 7fa8e165c640 1 --2- 172.21.15.150:0/1191786783 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa8dc0b6320 0x7fa8dc0b6730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:50:04.339 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:04.337+0000 7fa8e165c640 1 --2- 172.21.15.150:0/1191786783 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa8dc0b78c0 0x7fa8dc0d0330 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:50:04.340 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:04.337+0000 7fa8e165c640 1 -- 172.21.15.150:0/1191786783 >> 172.21.15.150:0/1191786783 conn(0x7fa8dc08bfe0 msgr2=0x7fa8dc0d4660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:50:04.340 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:04.337+0000 7fa8e165c640 1 -- 172.21.15.150:0/1191786783 shutdown_connections 2024-09-17T05:50:04.340 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:04.337+0000 7fa8e165c640 1 -- 172.21.15.150:0/1191786783 wait complete. 2024-09-17T05:50:04.340 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:04.339+0000 7fa8e165c640 1 Processor -- start 2024-09-17T05:50:04.340 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:04.339+0000 7fa8e165c640 1 -- start start 2024-09-17T05:50:04.343 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:04.340+0000 7fa8e165c640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa8dc0b6320 0x7fa8dc15ea10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:50:04.343 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:04.340+0000 7fa8e165c640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa8dc0b74b0 0x7fa8dc164b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:50:04.343 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:04.340+0000 7fa8e165c640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa8dc0b78c0 0x7fa8dc165090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:50:04.343 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:04.340+0000 7fa8e165c640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7fa8dc0b54e0 con 0x7fa8dc0b78c0 2024-09-17T05:50:04.343 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:04.340+0000 7fa8e165c640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fa8dc0b5360 con 0x7fa8dc0b6320 2024-09-17T05:50:04.344 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:04.340+0000 7fa8e165c640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fa8dc169330 con 0x7fa8dc0b74b0 2024-09-17T05:50:04.344 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:04.340+0000 7fa8db7fe640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa8dc0b78c0 0x7fa8dc165090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:50:04.344 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:04.340+0000 7fa8db7fe640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa8dc0b78c0 0x7fa8dc165090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:54940/0 (socket says 172.21.15.150:54940) 2024-09-17T05:50:04.344 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:04.340+0000 7fa8db7fe640 1 -- 172.21.15.150:0/2931196399 learned_addr learned my addr 172.21.15.150:0/2931196399 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:50:04.344 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:04.340+0000 7fa8d27fc640 1 --2- 172.21.15.150:0/2931196399 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa8dc0b74b0 0x7fa8dc164b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:50:04.344 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:04.341+0000 7fa8daffd640 1 --2- 172.21.15.150:0/2931196399 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa8dc0b6320 0x7fa8dc15ea10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:50:04.344 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:04.341+0000 7fa8db7fe640 1 -- 172.21.15.150:0/2931196399 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa8dc0b74b0 msgr2=0x7fa8dc164b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:50:04.344 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:04.341+0000 7fa8db7fe640 1 --2- 172.21.15.150:0/2931196399 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa8dc0b74b0 0x7fa8dc164b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:50:04.344 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:04.341+0000 7fa8db7fe640 1 -- 172.21.15.150:0/2931196399 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa8dc0b6320 msgr2=0x7fa8dc15ea10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:50:04.344 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:04.341+0000 7fa8db7fe640 1 --2- 172.21.15.150:0/2931196399 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa8dc0b6320 0x7fa8dc15ea10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:50:04.344 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:04.341+0000 7fa8db7fe640 1 -- 172.21.15.150:0/2931196399 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa8dc160620 con 0x7fa8dc0b78c0 2024-09-17T05:50:04.344 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:04.341+0000 7fa8db7fe640 1 --2- 172.21.15.150:0/2931196399 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa8dc0b78c0 0x7fa8dc165090 secure :-1 s=READY pgs=1257 cs=0 l=1 rev1=1 crypto rx=0x7fa8d400ec20 tx=0x7fa8d400c6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:50:04.345 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:04.341+0000 7fa8d3fff640 1 -- 172.21.15.150:0/2931196399 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8d4003b70 con 0x7fa8dc0b78c0 2024-09-17T05:50:04.345 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:04.341+0000 7fa8d3fff640 1 -- 172.21.15.150:0/2931196399 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa8d4003d10 con 0x7fa8dc0b78c0 2024-09-17T05:50:04.345 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:04.341+0000 7fa8e165c640 1 -- 172.21.15.150:0/2931196399 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa8dc15ef50 con 0x7fa8dc0b78c0 2024-09-17T05:50:04.345 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:04.341+0000 7fa8d3fff640 1 -- 172.21.15.150:0/2931196399 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8d4004280 con 0x7fa8dc0b78c0 2024-09-17T05:50:04.345 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:04.341+0000 7fa8e165c640 1 -- 172.21.15.150:0/2931196399 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa8dc0b3c40 con 0x7fa8dc0b78c0 2024-09-17T05:50:04.346 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:04.342+0000 7fa8e165c640 1 -- 172.21.15.150:0/2931196399 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa8dc08caf0 con 0x7fa8dc0b78c0 2024-09-17T05:50:04.346 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:04.343+0000 7fa8d3fff640 1 -- 172.21.15.150:0/2931196399 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 32) ==== 103481+0+0 (secure 0 0 0) 0x7fa8d4004420 con 0x7fa8dc0b78c0 2024-09-17T05:50:04.346 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:04.343+0000 7fa8d3fff640 1 --2- 172.21.15.150:0/2931196399 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fa8bc07a210 0x7fa8bc07c720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:50:04.346 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:04.343+0000 7fa8d3fff640 1 -- 172.21.15.150:0/2931196399 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 5878+0+0 (secure 0 0 0) 0x7fa8d409a6a0 con 0x7fa8dc0b78c0 2024-09-17T05:50:04.346 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:04.344+0000 7fa8daffd640 1 --2- 172.21.15.150:0/2931196399 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fa8bc07a210 0x7fa8bc07c720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:50:04.346 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:04.344+0000 7fa8daffd640 1 --2- 172.21.15.150:0/2931196399 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fa8bc07a210 0x7fa8bc07c720 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7fa8cc007fd0 tx=0x7fa8cc009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:50:04.349 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:04.348+0000 7fa8d3fff640 1 -- 172.21.15.150:0/2931196399 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fa8dc08caf0 con 0x7fa8dc0b78c0 2024-09-17T05:50:04.564 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:04.562+0000 7fa8e165c640 1 -- 172.21.15.150:0/2931196399 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7fa8dc15fa30 con 0x7fa8dc0b78c0 2024-09-17T05:50:04.564 INFO:tasks.ceph.mon.a.smithi150.stderr:2024-09-17T05:50:04.563+0000 7f73931ae640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-17T05:50:04.568 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:04.566+0000 7fa8d3fff640 1 -- 172.21.15.150:0/2931196399 <== mon.0 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v53) ==== 161+0+0 (secure 0 0 0) 0x7fa8d4063f10 con 0x7fa8dc0b78c0 2024-09-17T05:50:04.568 INFO:teuthology.orchestra.run.smithi150.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-09-17T05:50:04.571 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:04.568+0000 7fa8e165c640 1 -- 172.21.15.150:0/2931196399 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fa8bc07a210 msgr2=0x7fa8bc07c720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:50:04.571 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:04.568+0000 7fa8e165c640 1 --2- 172.21.15.150:0/2931196399 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fa8bc07a210 0x7fa8bc07c720 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7fa8cc007fd0 tx=0x7fa8cc009040 comp rx=0 tx=0).stop 2024-09-17T05:50:04.571 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:04.568+0000 7fa8e165c640 1 -- 172.21.15.150:0/2931196399 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa8dc0b78c0 msgr2=0x7fa8dc165090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:50:04.571 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:04.568+0000 7fa8e165c640 1 --2- 172.21.15.150:0/2931196399 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa8dc0b78c0 0x7fa8dc165090 secure :-1 s=READY pgs=1257 cs=0 l=1 rev1=1 crypto rx=0x7fa8d400ec20 tx=0x7fa8d400c6a0 comp rx=0 tx=0).stop 2024-09-17T05:50:04.571 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:04.568+0000 7fa8e165c640 1 -- 172.21.15.150:0/2931196399 shutdown_connections 2024-09-17T05:50:04.572 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:04.568+0000 7fa8e165c640 1 --2- 172.21.15.150:0/2931196399 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fa8bc07a210 0x7fa8bc07c720 unknown :-1 s=CLOSED pgs=541 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:50:04.572 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:04.568+0000 7fa8e165c640 1 --2- 172.21.15.150:0/2931196399 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa8dc0b78c0 0x7fa8dc165090 unknown :-1 s=CLOSED pgs=1257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:50:04.572 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:04.568+0000 7fa8e165c640 1 --2- 172.21.15.150:0/2931196399 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa8dc0b74b0 0x7fa8dc164b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:50:04.572 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:04.568+0000 7fa8e165c640 1 --2- 172.21.15.150:0/2931196399 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa8dc0b6320 0x7fa8dc15ea10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:50:04.572 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:04.568+0000 7fa8e165c640 1 -- 172.21.15.150:0/2931196399 >> 172.21.15.150:0/2931196399 conn(0x7fa8dc08bfe0 msgr2=0x7fa8dc06e5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:50:04.573 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:04.568+0000 7fa8e165c640 1 -- 172.21.15.150:0/2931196399 shutdown_connections 2024-09-17T05:50:04.573 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:04.568+0000 7fa8e165c640 1 -- 172.21.15.150:0/2931196399 wait complete. 2024-09-17T05:50:04.582 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-09-17T05:50:04.637 INFO:tasks.ceph.mds.d.smithi176.stdout:starting mds.d at 2024-09-17T05:50:04.698 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:04.697+0000 7fd2e2398640 1 -- 172.21.15.150:0/1082177753 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd2dc0d0730 msgr2=0x7fd2dc0b6160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:50:04.699 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:04.697+0000 7fd2e2398640 1 --2- 172.21.15.150:0/1082177753 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd2dc0d0730 0x7fd2dc0b6160 secure :-1 s=READY pgs=1259 cs=0 l=1 rev1=1 crypto rx=0x7fd2dc0cfd10 tx=0x7fd2d402a890 comp rx=0 tx=0).stop 2024-09-17T05:50:04.699 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:04.697+0000 7fd2e2398640 1 -- 172.21.15.150:0/1082177753 shutdown_connections 2024-09-17T05:50:04.699 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:04.697+0000 7fd2e2398640 1 --2- 172.21.15.150:0/1082177753 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd2dc0d0730 0x7fd2dc0b6160 unknown :-1 s=CLOSED pgs=1259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:50:04.699 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:04.697+0000 7fd2e2398640 1 -- 172.21.15.150:0/1082177753 >> 172.21.15.150:0/1082177753 conn(0x7fd2dc08bfe0 msgr2=0x7fd2dc0d46e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:50:04.699 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:04.697+0000 7fd2e2398640 1 -- 172.21.15.150:0/1082177753 shutdown_connections 2024-09-17T05:50:04.699 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:04.697+0000 7fd2e2398640 1 -- 172.21.15.150:0/1082177753 wait complete. 2024-09-17T05:50:04.700 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:04.698+0000 7fd2e2398640 1 Processor -- start 2024-09-17T05:50:04.700 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:04.698+0000 7fd2e2398640 1 -- start start 2024-09-17T05:50:04.702 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:04.700+0000 7fd2e2398640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd2dc06dea0 0x7fd2dc14fc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:50:04.703 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:04.700+0000 7fd2e2398640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd2dc0d0730 0x7fd2dc0b5140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:50:04.703 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:04.700+0000 7fd2e2398640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd2dc0d5150 0x7fd2dc0b5680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:50:04.703 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:04.700+0000 7fd2e2398640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7fd2dc06e430 con 0x7fd2dc0d5150 2024-09-17T05:50:04.703 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:04.700+0000 7fd2e2398640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fd2dc06e2b0 con 0x7fd2dc06dea0 2024-09-17T05:50:04.703 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:04.700+0000 7fd2e2398640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fd2dc06e5b0 con 0x7fd2dc0d0730 2024-09-17T05:50:04.703 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:04.700+0000 7fd2e0935640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd2dc0d5150 0x7fd2dc0b5680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:50:04.703 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:04.700+0000 7fd2e0935640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd2dc0d5150 0x7fd2dc0b5680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:54954/0 (socket says 172.21.15.150:54954) 2024-09-17T05:50:04.703 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:04.700+0000 7fd2e0935640 1 -- 172.21.15.150:0/465255429 learned_addr learned my addr 172.21.15.150:0/465255429 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:50:04.703 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:04.700+0000 7fd2d3fff640 1 --2- 172.21.15.150:0/465255429 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd2dc0d0730 0x7fd2dc0b5140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:50:04.703 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:04.700+0000 7fd2dbfff640 1 --2- 172.21.15.150:0/465255429 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd2dc06dea0 0x7fd2dc14fc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:50:04.703 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:04.700+0000 7fd2e0935640 1 -- 172.21.15.150:0/465255429 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd2dc0d0730 msgr2=0x7fd2dc0b5140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:50:04.704 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:04.700+0000 7fd2e0935640 1 --2- 172.21.15.150:0/465255429 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd2dc0d0730 0x7fd2dc0b5140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:50:04.704 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:04.700+0000 7fd2e0935640 1 -- 172.21.15.150:0/465255429 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd2dc06dea0 msgr2=0x7fd2dc14fc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:50:04.704 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:04.700+0000 7fd2e0935640 1 --2- 172.21.15.150:0/465255429 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd2dc06dea0 0x7fd2dc14fc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:50:04.704 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:04.700+0000 7fd2e0935640 1 -- 172.21.15.150:0/465255429 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd2dc0cbd00 con 0x7fd2dc0d5150 2024-09-17T05:50:04.704 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:04.700+0000 7fd2e0935640 1 --2- 172.21.15.150:0/465255429 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd2dc0d5150 0x7fd2dc0b5680 secure :-1 s=READY pgs=1260 cs=0 l=1 rev1=1 crypto rx=0x7fd2d4005fd0 tx=0x7fd2d40315c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:50:04.704 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:04.701+0000 7fd2d97fa640 1 -- 172.21.15.150:0/465255429 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2d4003e00 con 0x7fd2dc0d5150 2024-09-17T05:50:04.704 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:04.701+0000 7fd2d97fa640 1 -- 172.21.15.150:0/465255429 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd2d4031a60 con 0x7fd2dc0d5150 2024-09-17T05:50:04.704 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:04.701+0000 7fd2d97fa640 1 -- 172.21.15.150:0/465255429 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2d4033070 con 0x7fd2dc0d5150 2024-09-17T05:50:04.704 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:04.701+0000 7fd2e2398640 1 -- 172.21.15.150:0/465255429 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd2dc0cbfe0 con 0x7fd2dc0d5150 2024-09-17T05:50:04.704 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:04.701+0000 7fd2e2398640 1 -- 172.21.15.150:0/465255429 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd2dc0cc5a0 con 0x7fd2dc0d5150 2024-09-17T05:50:04.706 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:04.702+0000 7fd2e2398640 1 -- 172.21.15.150:0/465255429 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd2dc0b68d0 con 0x7fd2dc0d5150 2024-09-17T05:50:04.706 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:04.702+0000 7fd2d97fa640 1 -- 172.21.15.150:0/465255429 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 32) ==== 103481+0+0 (secure 0 0 0) 0x7fd2d4033210 con 0x7fd2dc0d5150 2024-09-17T05:50:04.706 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:04.703+0000 7fd2d97fa640 1 --2- 172.21.15.150:0/465255429 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fd2bc07a240 0x7fd2bc07c750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:50:04.706 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:04.703+0000 7fd2d97fa640 1 -- 172.21.15.150:0/465255429 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 5936+0+0 (secure 0 0 0) 0x7fd2d40babb0 con 0x7fd2dc0d5150 2024-09-17T05:50:04.706 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:04.703+0000 7fd2dbfff640 1 --2- 172.21.15.150:0/465255429 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fd2bc07a240 0x7fd2bc07c750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:50:04.706 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:04.703+0000 7fd2dbfff640 1 --2- 172.21.15.150:0/465255429 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fd2bc07a240 0x7fd2bc07c750 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7fd2cc0016f0 tx=0x7fd2cc009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:50:04.709 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:04.707+0000 7fd2d97fa640 1 -- 172.21.15.150:0/465255429 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fd2d403f030 con 0x7fd2dc0d5150 2024-09-17T05:50:04.924 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:04.922+0000 7fd2e2398640 1 -- 172.21.15.150:0/465255429 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7fd2dc0b76b0 con 0x7fd2dc0d5150 2024-09-17T05:50:05.576 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:05.575+0000 7fd2d97fa640 1 -- 172.21.15.150:0/465255429 <== mon.0 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v54) ==== 104+0+0 (secure 0 0 0) 0x7fd2d4084530 con 0x7fd2dc0d5150 2024-09-17T05:50:05.579 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:05.578+0000 7fd2e2398640 1 -- 172.21.15.150:0/465255429 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fd2bc07a240 msgr2=0x7fd2bc07c750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:50:05.579 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:05.578+0000 7fd2e2398640 1 --2- 172.21.15.150:0/465255429 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fd2bc07a240 0x7fd2bc07c750 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7fd2cc0016f0 tx=0x7fd2cc009040 comp rx=0 tx=0).stop 2024-09-17T05:50:05.579 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:05.578+0000 7fd2e2398640 1 -- 172.21.15.150:0/465255429 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd2dc0d5150 msgr2=0x7fd2dc0b5680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:50:05.579 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:05.578+0000 7fd2e2398640 1 --2- 172.21.15.150:0/465255429 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd2dc0d5150 0x7fd2dc0b5680 secure :-1 s=READY pgs=1260 cs=0 l=1 rev1=1 crypto rx=0x7fd2d4005fd0 tx=0x7fd2d40315c0 comp rx=0 tx=0).stop 2024-09-17T05:50:05.579 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:05.578+0000 7fd2e2398640 1 -- 172.21.15.150:0/465255429 shutdown_connections 2024-09-17T05:50:05.579 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:05.578+0000 7fd2e2398640 1 --2- 172.21.15.150:0/465255429 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fd2bc07a240 0x7fd2bc07c750 unknown :-1 s=CLOSED pgs=542 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:50:05.579 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:05.578+0000 7fd2e2398640 1 --2- 172.21.15.150:0/465255429 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd2dc0d5150 0x7fd2dc0b5680 unknown :-1 s=CLOSED pgs=1260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:50:05.579 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:05.578+0000 7fd2e2398640 1 --2- 172.21.15.150:0/465255429 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd2dc0d0730 0x7fd2dc0b5140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:50:05.579 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:05.578+0000 7fd2e2398640 1 --2- 172.21.15.150:0/465255429 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd2dc06dea0 0x7fd2dc14fc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:50:05.580 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:05.578+0000 7fd2e2398640 1 -- 172.21.15.150:0/465255429 >> 172.21.15.150:0/465255429 conn(0x7fd2dc08bfe0 msgr2=0x7fd2dc068e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:50:05.580 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:05.578+0000 7fd2e2398640 1 -- 172.21.15.150:0/465255429 shutdown_connections 2024-09-17T05:50:05.580 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:05.578+0000 7fd2e2398640 1 -- 172.21.15.150:0/465255429 wait complete. 2024-09-17T05:50:05.591 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-09-17T05:50:05.710 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:05.709+0000 7f16f4ace640 1 -- 172.21.15.150:0/1998533026 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f16f00b36f0 msgr2=0x7f16f00cb930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:50:05.710 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:05.709+0000 7f16f4ace640 1 --2- 172.21.15.150:0/1998533026 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f16f00b36f0 0x7f16f00cb930 secure :-1 s=READY pgs=1262 cs=0 l=1 rev1=1 crypto rx=0x7f16e8009830 tx=0x7f16e802a3f0 comp rx=0 tx=0).stop 2024-09-17T05:50:05.710 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:05.709+0000 7f16f4ace640 1 -- 172.21.15.150:0/1998533026 shutdown_connections 2024-09-17T05:50:05.711 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:05.709+0000 7f16f4ace640 1 --2- 172.21.15.150:0/1998533026 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f16f015ba50 0x7f16f00b3120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:50:05.711 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:05.709+0000 7f16f4ace640 1 --2- 172.21.15.150:0/1998533026 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f16f00b36f0 0x7f16f00cb930 unknown :-1 s=CLOSED pgs=1262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:50:05.711 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:05.709+0000 7f16f4ace640 1 -- 172.21.15.150:0/1998533026 >> 172.21.15.150:0/1998533026 conn(0x7f16f00b2540 msgr2=0x7f16f00d02d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:50:05.711 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:05.709+0000 7f16f4ace640 1 -- 172.21.15.150:0/1998533026 shutdown_connections 2024-09-17T05:50:05.711 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:05.709+0000 7f16f4ace640 1 -- 172.21.15.150:0/1998533026 wait complete. 2024-09-17T05:50:05.711 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:05.711+0000 7f16f4ace640 1 Processor -- start 2024-09-17T05:50:05.712 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:05.711+0000 7f16f4ace640 1 -- start start 2024-09-17T05:50:05.715 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:05.712+0000 7f16f4ace640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f16f00b36f0 0x7f16f01f55b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:50:05.715 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:05.712+0000 7f16f4ace640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f16f00cc7d0 0x7f16f0157bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:50:05.715 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:05.712+0000 7f16f4ace640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f16f015ba50 0x7f16f01580f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:50:05.715 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:05.712+0000 7f16f4ace640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f16f006f8a0 con 0x7f16f015ba50 2024-09-17T05:50:05.715 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:05.712+0000 7f16f4ace640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f16f006f720 con 0x7f16f00b36f0 2024-09-17T05:50:05.715 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:05.712+0000 7f16f4ace640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f16f006fa20 con 0x7f16f00cc7d0 2024-09-17T05:50:05.715 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:05.713+0000 7f16eed9d640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f16f015ba50 0x7f16f01580f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:50:05.715 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:05.713+0000 7f16eed9d640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f16f015ba50 0x7f16f01580f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:54974/0 (socket says 172.21.15.150:54974) 2024-09-17T05:50:05.715 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:05.713+0000 7f16eed9d640 1 -- 172.21.15.150:0/3113143078 learned_addr learned my addr 172.21.15.150:0/3113143078 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:50:05.715 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:05.713+0000 7f16ee59c640 1 --2- 172.21.15.150:0/3113143078 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f16f00b36f0 0x7f16f01f55b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:50:05.716 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:05.713+0000 7f16edd9b640 1 --2- 172.21.15.150:0/3113143078 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f16f00cc7d0 0x7f16f0157bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:50:05.716 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:05.713+0000 7f16eed9d640 1 -- 172.21.15.150:0/3113143078 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f16f00cc7d0 msgr2=0x7f16f0157bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:50:05.716 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:05.713+0000 7f16eed9d640 1 --2- 172.21.15.150:0/3113143078 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f16f00cc7d0 0x7f16f0157bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:50:05.716 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:05.713+0000 7f16eed9d640 1 -- 172.21.15.150:0/3113143078 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f16f00b36f0 msgr2=0x7f16f01f55b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:50:05.716 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:05.713+0000 7f16eed9d640 1 --2- 172.21.15.150:0/3113143078 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f16f00b36f0 0x7f16f01f55b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:50:05.716 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:05.713+0000 7f16eed9d640 1 -- 172.21.15.150:0/3113143078 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f16f00b08a0 con 0x7f16f015ba50 2024-09-17T05:50:05.716 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:05.713+0000 7f16edd9b640 1 --2- 172.21.15.150:0/3113143078 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f16f00cc7d0 0x7f16f0157bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T05:50:05.716 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:05.713+0000 7f16eed9d640 1 --2- 172.21.15.150:0/3113143078 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f16f015ba50 0x7f16f01580f0 secure :-1 s=READY pgs=1263 cs=0 l=1 rev1=1 crypto rx=0x7f16e8009920 tx=0x7f16e8033c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:50:05.716 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:05.713+0000 7f16deffd640 1 -- 172.21.15.150:0/3113143078 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16e8031d60 con 0x7f16f015ba50 2024-09-17T05:50:05.716 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:05.713+0000 7f16deffd640 1 -- 172.21.15.150:0/3113143078 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f16e8033e10 con 0x7f16f015ba50 2024-09-17T05:50:05.716 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:05.713+0000 7f16deffd640 1 -- 172.21.15.150:0/3113143078 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16e8033310 con 0x7f16f015ba50 2024-09-17T05:50:05.716 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:05.713+0000 7f16f4ace640 1 -- 172.21.15.150:0/3113143078 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f16f00b0b80 con 0x7f16f015ba50 2024-09-17T05:50:05.717 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:05.713+0000 7f16f4ace640 1 -- 172.21.15.150:0/3113143078 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f16f014f4d0 con 0x7f16f015ba50 2024-09-17T05:50:05.717 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:05.714+0000 7f16f4ace640 1 -- 172.21.15.150:0/3113143078 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f16f006ff40 con 0x7f16f015ba50 2024-09-17T05:50:05.718 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:05.715+0000 7f16deffd640 1 -- 172.21.15.150:0/3113143078 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 32) ==== 103481+0+0 (secure 0 0 0) 0x7f16e80334b0 con 0x7f16f015ba50 2024-09-17T05:50:05.718 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:05.716+0000 7f16deffd640 1 --2- 172.21.15.150:0/3113143078 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f16d007a210 0x7f16d007c720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:50:05.718 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:05.716+0000 7f16deffd640 1 -- 172.21.15.150:0/3113143078 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 5936+0+0 (secure 0 0 0) 0x7f16e80badd0 con 0x7f16f015ba50 2024-09-17T05:50:05.718 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:05.716+0000 7f16ee59c640 1 --2- 172.21.15.150:0/3113143078 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f16d007a210 0x7f16d007c720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:50:05.718 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:05.716+0000 7f16ee59c640 1 --2- 172.21.15.150:0/3113143078 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f16d007a210 0x7f16d007c720 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7f16e00020b0 tx=0x7f16e0009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:50:05.720 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:05.720+0000 7f16deffd640 1 -- 172.21.15.150:0/3113143078 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f16e803f030 con 0x7f16f015ba50 2024-09-17T05:50:05.897 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:05.896+0000 7f16f4ace640 1 -- 172.21.15.150:0/3113143078 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7f16f00cb4b0 con 0x7f16f015ba50 2024-09-17T05:50:06.578 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:06.577+0000 7f16deffd640 1 -- 172.21.15.150:0/3113143078 <== mon.0 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v91) ==== 181+0+0 (secure 0 0 0) 0x7f16e8084da0 con 0x7f16f015ba50 2024-09-17T05:50:06.578 INFO:teuthology.orchestra.run.smithi150.stderr:pool 'cephfs_metadata' removed 2024-09-17T05:50:06.582 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:06.581+0000 7f16f4ace640 1 -- 172.21.15.150:0/3113143078 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f16d007a210 msgr2=0x7f16d007c720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:50:06.582 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:06.581+0000 7f16f4ace640 1 --2- 172.21.15.150:0/3113143078 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f16d007a210 0x7f16d007c720 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7f16e00020b0 tx=0x7f16e0009040 comp rx=0 tx=0).stop 2024-09-17T05:50:06.582 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:06.581+0000 7f16f4ace640 1 -- 172.21.15.150:0/3113143078 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f16f015ba50 msgr2=0x7f16f01580f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:50:06.582 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:06.581+0000 7f16f4ace640 1 --2- 172.21.15.150:0/3113143078 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f16f015ba50 0x7f16f01580f0 secure :-1 s=READY pgs=1263 cs=0 l=1 rev1=1 crypto rx=0x7f16e8009920 tx=0x7f16e8033c20 comp rx=0 tx=0).stop 2024-09-17T05:50:06.582 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:06.581+0000 7f16f4ace640 1 -- 172.21.15.150:0/3113143078 shutdown_connections 2024-09-17T05:50:06.582 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:06.581+0000 7f16f4ace640 1 --2- 172.21.15.150:0/3113143078 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f16d007a210 0x7f16d007c720 unknown :-1 s=CLOSED pgs=544 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:50:06.583 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:06.581+0000 7f16f4ace640 1 --2- 172.21.15.150:0/3113143078 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f16f015ba50 0x7f16f01580f0 unknown :-1 s=CLOSED pgs=1263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:50:06.583 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:06.581+0000 7f16f4ace640 1 --2- 172.21.15.150:0/3113143078 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f16f00cc7d0 0x7f16f0157bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:50:06.583 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:06.581+0000 7f16f4ace640 1 --2- 172.21.15.150:0/3113143078 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f16f00b36f0 0x7f16f01f55b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:50:06.583 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:06.581+0000 7f16f4ace640 1 -- 172.21.15.150:0/3113143078 >> 172.21.15.150:0/3113143078 conn(0x7f16f00b2540 msgr2=0x7f16f015acc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:50:06.583 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:06.581+0000 7f16f4ace640 1 -- 172.21.15.150:0/3113143078 shutdown_connections 2024-09-17T05:50:06.583 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:06.582+0000 7f16f4ace640 1 -- 172.21.15.150:0/3113143078 wait complete. 2024-09-17T05:50:06.596 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-09-17T05:50:06.716 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:06.714+0000 7f0cef150640 1 -- 172.21.15.150:0/337762635 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0ce80b1d80 msgr2=0x7f0ce80d0c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:50:06.716 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:06.714+0000 7f0cef150640 1 --2- 172.21.15.150:0/337762635 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0ce80b1d80 0x7f0ce80d0c90 secure :-1 s=READY pgs=1264 cs=0 l=1 rev1=1 crypto rx=0x7f0ce8070c60 tx=0x7f0cd802a5f0 comp rx=0 tx=0).stop 2024-09-17T05:50:06.716 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:06.714+0000 7f0cef150640 1 -- 172.21.15.150:0/337762635 shutdown_connections 2024-09-17T05:50:06.716 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:06.715+0000 7f0cef150640 1 --2- 172.21.15.150:0/337762635 >> v2:172.21.15.176:3300/0 conn(0x7f0ce80d11d0 0x7f0ce8160d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:50:06.716 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:06.715+0000 7f0cef150640 1 --2- 172.21.15.150:0/337762635 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0ce80b1d80 0x7f0ce80d0c90 unknown :-1 s=CLOSED pgs=1264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:50:06.716 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:06.715+0000 7f0cef150640 1 --2- 172.21.15.150:0/337762635 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0ce80d0520 0x7f0ce80b7a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:50:06.716 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:06.715+0000 7f0cef150640 1 -- 172.21.15.150:0/337762635 >> 172.21.15.150:0/337762635 conn(0x7f0ce80cef30 msgr2=0x7f0ce80cf340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:50:06.716 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:06.715+0000 7f0cef150640 1 -- 172.21.15.150:0/337762635 shutdown_connections 2024-09-17T05:50:06.716 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:06.715+0000 7f0cef150640 1 -- 172.21.15.150:0/337762635 wait complete. 2024-09-17T05:50:06.717 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:06.716+0000 7f0cef150640 1 Processor -- start 2024-09-17T05:50:06.717 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:06.716+0000 7f0cef150640 1 -- start start 2024-09-17T05:50:06.720 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:06.718+0000 7f0cef150640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0ce80b1d80 0x7f0ce814dfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:50:06.720 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:06.718+0000 7f0cef150640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0ce80d0520 0x7f0ce81f3e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:50:06.720 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:06.718+0000 7f0cef150640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0ce80d11d0 0x7f0ce81f4360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:50:06.720 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:06.718+0000 7f0cef150640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f0ce8070f20 con 0x7f0ce80d11d0 2024-09-17T05:50:06.720 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:06.718+0000 7f0cef150640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f0ce80d3310 con 0x7f0ce80d0520 2024-09-17T05:50:06.720 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:06.718+0000 7f0cef150640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f0ce80b2190 con 0x7f0ce80b1d80 2024-09-17T05:50:06.720 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:06.718+0000 7f0ced6ed640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0ce80d11d0 0x7f0ce81f4360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:50:06.720 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:06.718+0000 7f0ced6ed640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0ce80d11d0 0x7f0ce81f4360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:54988/0 (socket says 172.21.15.150:54988) 2024-09-17T05:50:06.721 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:06.718+0000 7f0ced6ed640 1 -- 172.21.15.150:0/666876522 learned_addr learned my addr 172.21.15.150:0/666876522 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:50:06.721 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:06.718+0000 7f0ceceec640 1 --2- 172.21.15.150:0/666876522 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0ce80b1d80 0x7f0ce814dfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:50:06.721 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:06.718+0000 7f0cdffff640 1 --2- 172.21.15.150:0/666876522 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0ce80d0520 0x7f0ce81f3e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:50:06.721 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:06.718+0000 7f0ced6ed640 1 -- 172.21.15.150:0/666876522 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0ce80b1d80 msgr2=0x7f0ce814dfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:50:06.721 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:06.718+0000 7f0ced6ed640 1 --2- 172.21.15.150:0/666876522 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0ce80b1d80 0x7f0ce814dfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:50:06.721 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:06.718+0000 7f0ced6ed640 1 -- 172.21.15.150:0/666876522 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0ce80d0520 msgr2=0x7f0ce81f3e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:50:06.721 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:06.718+0000 7f0ced6ed640 1 --2- 172.21.15.150:0/666876522 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0ce80d0520 0x7f0ce81f3e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:50:06.721 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:06.718+0000 7f0ced6ed640 1 -- 172.21.15.150:0/666876522 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0ce814e9a0 con 0x7f0ce80d11d0 2024-09-17T05:50:06.722 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:06.719+0000 7f0ced6ed640 1 --2- 172.21.15.150:0/666876522 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0ce80d11d0 0x7f0ce81f4360 secure :-1 s=READY pgs=1265 cs=0 l=1 rev1=1 crypto rx=0x7f0ce000cab0 tx=0x7f0ce000cf70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:50:06.722 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:06.719+0000 7f0cdd7fa640 1 -- 172.21.15.150:0/666876522 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ce0007d90 con 0x7f0ce80d11d0 2024-09-17T05:50:06.722 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:06.719+0000 7f0cdd7fa640 1 -- 172.21.15.150:0/666876522 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0ce000f540 con 0x7f0ce80d11d0 2024-09-17T05:50:06.722 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:06.719+0000 7f0cef150640 1 -- 172.21.15.150:0/666876522 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0ce814ec80 con 0x7f0ce80d11d0 2024-09-17T05:50:06.722 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:06.719+0000 7f0cdd7fa640 1 -- 172.21.15.150:0/666876522 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ce000f990 con 0x7f0ce80d11d0 2024-09-17T05:50:06.722 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:06.719+0000 7f0cef150640 1 -- 172.21.15.150:0/666876522 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0ce814f240 con 0x7f0ce80d11d0 2024-09-17T05:50:06.723 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:06.720+0000 7f0cef150640 1 -- 172.21.15.150:0/666876522 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0ce80d0c90 con 0x7f0ce80d11d0 2024-09-17T05:50:06.723 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:06.721+0000 7f0cdd7fa640 1 -- 172.21.15.150:0/666876522 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 32) ==== 103481+0+0 (secure 0 0 0) 0x7f0ce000fb30 con 0x7f0ce80d11d0 2024-09-17T05:50:06.723 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:06.721+0000 7f0cdd7fa640 1 --2- 172.21.15.150:0/666876522 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f0cd407a210 0x7f0cd407c720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:50:06.723 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:06.722+0000 7f0cdd7fa640 1 -- 172.21.15.150:0/666876522 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 5498+0+0 (secure 0 0 0) 0x7f0ce009a3e0 con 0x7f0ce80d11d0 2024-09-17T05:50:06.723 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:06.722+0000 7f0ceceec640 1 --2- 172.21.15.150:0/666876522 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f0cd407a210 0x7f0cd407c720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:50:06.723 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:06.722+0000 7f0ceceec640 1 --2- 172.21.15.150:0/666876522 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f0cd407a210 0x7f0cd407c720 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7f0ce400aa10 tx=0x7f0ce4005ed0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:50:06.731 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:06.730+0000 7f0cdd7fa640 1 -- 172.21.15.150:0/666876522 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f0ce0014070 con 0x7f0ce80d11d0 2024-09-17T05:50:06.908 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:06.907+0000 7f0cef150640 1 -- 172.21.15.150:0/666876522 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7f0ce81f4950 con 0x7f0ce80d11d0 2024-09-17T05:50:07.583 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:07.582+0000 7f0cdd7fa640 1 -- 172.21.15.150:0/666876522 <== mon.0 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v92) ==== 169+0+0 (secure 0 0 0) 0x7f0ce000fe20 con 0x7f0ce80d11d0 2024-09-17T05:50:07.583 INFO:teuthology.orchestra.run.smithi150.stderr:pool 'cephfs_data' removed 2024-09-17T05:50:07.585 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:07.584+0000 7f0cef150640 1 -- 172.21.15.150:0/666876522 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f0cd407a210 msgr2=0x7f0cd407c720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:50:07.585 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:07.584+0000 7f0cef150640 1 --2- 172.21.15.150:0/666876522 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f0cd407a210 0x7f0cd407c720 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7f0ce400aa10 tx=0x7f0ce4005ed0 comp rx=0 tx=0).stop 2024-09-17T05:50:07.585 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:07.584+0000 7f0cef150640 1 -- 172.21.15.150:0/666876522 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0ce80d11d0 msgr2=0x7f0ce81f4360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:50:07.586 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:07.584+0000 7f0cef150640 1 --2- 172.21.15.150:0/666876522 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0ce80d11d0 0x7f0ce81f4360 secure :-1 s=READY pgs=1265 cs=0 l=1 rev1=1 crypto rx=0x7f0ce000cab0 tx=0x7f0ce000cf70 comp rx=0 tx=0).stop 2024-09-17T05:50:07.586 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:07.584+0000 7f0cef150640 1 -- 172.21.15.150:0/666876522 shutdown_connections 2024-09-17T05:50:07.586 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:07.584+0000 7f0cef150640 1 --2- 172.21.15.150:0/666876522 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0ce80d0520 0x7f0ce81f3e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:50:07.586 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:07.584+0000 7f0cef150640 1 --2- 172.21.15.150:0/666876522 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f0cd407a210 0x7f0cd407c720 unknown :-1 s=CLOSED pgs=545 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:50:07.586 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:07.584+0000 7f0cef150640 1 --2- 172.21.15.150:0/666876522 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0ce80d11d0 0x7f0ce81f4360 unknown :-1 s=CLOSED pgs=1265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:50:07.586 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:07.584+0000 7f0cef150640 1 --2- 172.21.15.150:0/666876522 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0ce80b1d80 0x7f0ce814dfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:50:07.586 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:07.584+0000 7f0cef150640 1 -- 172.21.15.150:0/666876522 >> 172.21.15.150:0/666876522 conn(0x7f0ce80cef30 msgr2=0x7f0ce8072430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:50:07.586 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:07.585+0000 7f0cef150640 1 -- 172.21.15.150:0/666876522 shutdown_connections 2024-09-17T05:50:07.586 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:07.585+0000 7f0cef150640 1 -- 172.21.15.150:0/666876522 wait complete. 2024-09-17T05:50:07.601 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config reset 31 2024-09-17T05:50:07.746 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:07.745+0000 7fcce51f9640 1 -- 172.21.15.150:0/3132720390 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fcce00b5300 msgr2=0x7fcce00b5710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:50:07.746 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:07.745+0000 7fcce51f9640 1 --2- 172.21.15.150:0/3132720390 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fcce00b5300 0x7fcce00b5710 secure :-1 s=READY pgs=1267 cs=0 l=1 rev1=1 crypto rx=0x7fccd0005fd0 tx=0x7fccd002a5f0 comp rx=0 tx=0).stop 2024-09-17T05:50:07.746 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:07.745+0000 7fcce51f9640 1 -- 172.21.15.150:0/3132720390 shutdown_connections 2024-09-17T05:50:07.746 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:07.745+0000 7fcce51f9640 1 --2- 172.21.15.150:0/3132720390 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fcce00b5c50 0x7fcce0167180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:50:07.746 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:07.745+0000 7fcce51f9640 1 --2- 172.21.15.150:0/3132720390 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fcce00b5300 0x7fcce00b5710 unknown :-1 s=CLOSED pgs=1267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:50:07.746 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:07.745+0000 7fcce51f9640 1 -- 172.21.15.150:0/3132720390 >> 172.21.15.150:0/3132720390 conn(0x7fcce00cef30 msgr2=0x7fcce00cf340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:50:07.746 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:07.745+0000 7fcce51f9640 1 -- 172.21.15.150:0/3132720390 shutdown_connections 2024-09-17T05:50:07.747 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:07.745+0000 7fcce51f9640 1 -- 172.21.15.150:0/3132720390 wait complete. 2024-09-17T05:50:07.747 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:07.747+0000 7fcce51f9640 1 Processor -- start 2024-09-17T05:50:07.748 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:07.747+0000 7fcce51f9640 1 -- start start 2024-09-17T05:50:07.750 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:07.748+0000 7fcce51f9640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fcce00b5300 0x7fcce01d3e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:50:07.750 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:07.748+0000 7fcce51f9640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fcce00b5c50 0x7fcce009ee30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:50:07.750 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:07.748+0000 7fcce51f9640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fcce00b7490 0x7fcce00b26e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:50:07.750 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:07.748+0000 7fcce51f9640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7fcce00d15e0 con 0x7fcce00b5300 2024-09-17T05:50:07.750 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:07.748+0000 7fcce51f9640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fcce00d1460 con 0x7fcce00b7490 2024-09-17T05:50:07.750 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:07.748+0000 7fcce51f9640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fcce00ceb70 con 0x7fcce00b5c50 2024-09-17T05:50:07.750 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:07.748+0000 7fccded9d640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fcce00b5300 0x7fcce01d3e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:50:07.751 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:07.748+0000 7fccded9d640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fcce00b5300 0x7fcce01d3e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:55008/0 (socket says 172.21.15.150:55008) 2024-09-17T05:50:07.751 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:07.748+0000 7fccded9d640 1 -- 172.21.15.150:0/786159802 learned_addr learned my addr 172.21.15.150:0/786159802 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:50:07.751 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:07.749+0000 7fccde59c640 1 --2- 172.21.15.150:0/786159802 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fcce00b5c50 0x7fcce009ee30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:50:07.751 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:07.749+0000 7fccdf59e640 1 --2- 172.21.15.150:0/786159802 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fcce00b7490 0x7fcce00b26e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:50:07.751 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:07.749+0000 7fccded9d640 1 -- 172.21.15.150:0/786159802 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fcce00b5c50 msgr2=0x7fcce009ee30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:50:07.751 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:07.749+0000 7fccded9d640 1 --2- 172.21.15.150:0/786159802 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fcce00b5c50 0x7fcce009ee30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:50:07.751 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:07.749+0000 7fccded9d640 1 -- 172.21.15.150:0/786159802 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fcce00b7490 msgr2=0x7fcce00b26e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:50:07.751 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:07.749+0000 7fccded9d640 1 --2- 172.21.15.150:0/786159802 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fcce00b7490 0x7fcce00b26e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:50:07.751 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:07.749+0000 7fccded9d640 1 -- 172.21.15.150:0/786159802 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcce01d1e20 con 0x7fcce00b5300 2024-09-17T05:50:07.751 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:07.749+0000 7fccded9d640 1 --2- 172.21.15.150:0/786159802 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fcce00b5300 0x7fcce01d3e70 secure :-1 s=READY pgs=1268 cs=0 l=1 rev1=1 crypto rx=0x7fccd400c3c0 tx=0x7fccd400c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:50:07.751 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:07.749+0000 7fccc77fe640 1 -- 172.21.15.150:0/786159802 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fccd4017070 con 0x7fcce00b5300 2024-09-17T05:50:07.752 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:07.749+0000 7fccc77fe640 1 -- 172.21.15.150:0/786159802 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fccd40035f0 con 0x7fcce00b5300 2024-09-17T05:50:07.752 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:07.749+0000 7fcce51f9640 1 -- 172.21.15.150:0/786159802 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcce01d4700 con 0x7fcce00b5300 2024-09-17T05:50:07.752 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:07.749+0000 7fccc77fe640 1 -- 172.21.15.150:0/786159802 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fccd4003a20 con 0x7fcce00b5300 2024-09-17T05:50:07.752 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:07.749+0000 7fcce51f9640 1 -- 172.21.15.150:0/786159802 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcce01d4cc0 con 0x7fcce00b5300 2024-09-17T05:50:07.753 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:07.750+0000 7fcce51f9640 1 -- 172.21.15.150:0/786159802 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcce00b61d0 con 0x7fcce00b5300 2024-09-17T05:50:07.753 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:07.751+0000 7fccc77fe640 1 -- 172.21.15.150:0/786159802 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 32) ==== 103481+0+0 (secure 0 0 0) 0x7fccd401a070 con 0x7fcce00b5300 2024-09-17T05:50:07.753 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:07.752+0000 7fccc77fe640 1 --2- 172.21.15.150:0/786159802 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fcccc07a210 0x7fcccc07c720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:50:07.753 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:07.752+0000 7fccc77fe640 1 -- 172.21.15.150:0/786159802 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 5055+0+0 (secure 0 0 0) 0x7fccd4098c10 con 0x7fcce00b5300 2024-09-17T05:50:07.753 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:07.752+0000 7fccde59c640 1 --2- 172.21.15.150:0/786159802 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fcccc07a210 0x7fcccc07c720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:50:07.753 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:07.753+0000 7fccde59c640 1 --2- 172.21.15.150:0/786159802 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fcccc07a210 0x7fcccc07c720 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7fccd0033000 tx=0x7fccd0004730 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:50:07.757 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:07.756+0000 7fccc77fe640 1 -- 172.21.15.150:0/786159802 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fccd4062500 con 0x7fcce00b5300 2024-09-17T05:50:07.935 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:07.934+0000 7fcce51f9640 1 -- 172.21.15.150:0/786159802 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "config reset", "num": 31} v 0) -- 0x7fcce00a0190 con 0x7fcce00b5300 2024-09-17T05:50:07.939 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:07.938+0000 7fccc77fe640 1 -- 172.21.15.150:0/786159802 <== mon.0 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "config reset", "num": 31}]=0 v48) ==== 71+0+0 (secure 0 0 0) 0x7fccd4066f30 con 0x7fcce00b5300 2024-09-17T05:50:07.941 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:07.941+0000 7fcce51f9640 1 -- 172.21.15.150:0/786159802 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fcccc07a210 msgr2=0x7fcccc07c720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:50:07.942 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:07.941+0000 7fcce51f9640 1 --2- 172.21.15.150:0/786159802 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fcccc07a210 0x7fcccc07c720 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7fccd0033000 tx=0x7fccd0004730 comp rx=0 tx=0).stop 2024-09-17T05:50:07.942 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:07.941+0000 7fcce51f9640 1 -- 172.21.15.150:0/786159802 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fcce00b5300 msgr2=0x7fcce01d3e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:50:07.942 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:07.941+0000 7fcce51f9640 1 --2- 172.21.15.150:0/786159802 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fcce00b5300 0x7fcce01d3e70 secure :-1 s=READY pgs=1268 cs=0 l=1 rev1=1 crypto rx=0x7fccd400c3c0 tx=0x7fccd400c880 comp rx=0 tx=0).stop 2024-09-17T05:50:07.942 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:07.941+0000 7fcce51f9640 1 -- 172.21.15.150:0/786159802 shutdown_connections 2024-09-17T05:50:07.942 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:07.941+0000 7fcce51f9640 1 --2- 172.21.15.150:0/786159802 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fcce00b7490 0x7fcce00b26e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:50:07.942 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:07.941+0000 7fcce51f9640 1 --2- 172.21.15.150:0/786159802 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fcccc07a210 0x7fcccc07c720 unknown :-1 s=CLOSED pgs=546 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:50:07.942 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:07.941+0000 7fcce51f9640 1 --2- 172.21.15.150:0/786159802 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fcce00b5c50 0x7fcce009ee30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:50:07.942 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:07.941+0000 7fcce51f9640 1 --2- 172.21.15.150:0/786159802 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fcce00b5300 0x7fcce01d3e70 unknown :-1 s=CLOSED pgs=1268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:50:07.942 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:07.941+0000 7fcce51f9640 1 -- 172.21.15.150:0/786159802 >> 172.21.15.150:0/786159802 conn(0x7fcce00cef30 msgr2=0x7fcce01e8690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:50:07.942 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:07.941+0000 7fcce51f9640 1 -- 172.21.15.150:0/786159802 shutdown_connections 2024-09-17T05:50:07.942 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:07.941+0000 7fcce51f9640 1 -- 172.21.15.150:0/786159802 wait complete. 2024-09-17T05:50:07.953 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_volumes.TestCloneProgressReporter.test_progress_drops_when_new_jobs_are_added' 2024-09-17T05:50:08.067 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:08.066+0000 7f23c430b640 1 -- 172.21.15.150:0/299221662 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f23bc0d1060 msgr2=0x7f23bc0b1fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:50:08.068 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:08.066+0000 7f23c430b640 1 --2- 172.21.15.150:0/299221662 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f23bc0d1060 0x7f23bc0b1fd0 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f23ac009830 tx=0x7f23ac02a530 comp rx=0 tx=0).stop 2024-09-17T05:50:08.068 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:08.067+0000 7f23c430b640 1 -- 172.21.15.150:0/299221662 shutdown_connections 2024-09-17T05:50:08.068 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:08.067+0000 7f23c430b640 1 --2- 172.21.15.150:0/299221662 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f23bc0d1060 0x7f23bc0b1fd0 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:50:08.068 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:08.067+0000 7f23c430b640 1 --2- 172.21.15.150:0/299221662 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f23bc0d0c50 0x7f23bc0d0010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:50:08.068 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:08.067+0000 7f23c430b640 1 -- 172.21.15.150:0/299221662 >> 172.21.15.150:0/299221662 conn(0x7f23bc0b3fc0 msgr2=0x7f23bc0b43d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:50:08.068 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:08.067+0000 7f23c430b640 1 -- 172.21.15.150:0/299221662 shutdown_connections 2024-09-17T05:50:08.068 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:08.067+0000 7f23c430b640 1 -- 172.21.15.150:0/299221662 wait complete. 2024-09-17T05:50:08.069 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:08.068+0000 7f23c430b640 1 Processor -- start 2024-09-17T05:50:08.069 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:08.068+0000 7f23c430b640 1 -- start start 2024-09-17T05:50:08.072 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:08.070+0000 7f23c430b640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f23bc0d0550 0x7f23bc1575b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:50:08.072 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:08.070+0000 7f23c430b640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f23bc0d0c50 0x7f23bc0c87e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:50:08.072 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:08.070+0000 7f23c430b640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f23bc0d1060 0x7f23bc1f9640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:50:08.072 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:08.070+0000 7f23c430b640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f23bc0ced80 con 0x7f23bc0d0c50 2024-09-17T05:50:08.072 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:08.070+0000 7f23c430b640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f23bc0cd130 con 0x7f23bc0d1060 2024-09-17T05:50:08.072 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:08.070+0000 7f23c430b640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f23bc159d70 con 0x7f23bc0d0550 2024-09-17T05:50:08.072 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:08.070+0000 7f23c18a6640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f23bc0d0c50 0x7f23bc0c87e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:50:08.072 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:08.070+0000 7f23c18a6640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f23bc0d0c50 0x7f23bc0c87e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:55020/0 (socket says 172.21.15.150:55020) 2024-09-17T05:50:08.073 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:08.070+0000 7f23c18a6640 1 -- 172.21.15.150:0/4101576698 learned_addr learned my addr 172.21.15.150:0/4101576698 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:50:08.073 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:08.070+0000 7f23c20a7640 1 --2- 172.21.15.150:0/4101576698 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f23bc0d0550 0x7f23bc1575b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:50:08.073 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:08.070+0000 7f23c28a8640 1 --2- 172.21.15.150:0/4101576698 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f23bc0d1060 0x7f23bc1f9640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:50:08.073 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:08.070+0000 7f23c18a6640 1 -- 172.21.15.150:0/4101576698 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f23bc0d0550 msgr2=0x7f23bc1575b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:50:08.073 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:08.070+0000 7f23c18a6640 1 --2- 172.21.15.150:0/4101576698 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f23bc0d0550 0x7f23bc1575b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:50:08.073 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:08.070+0000 7f23c18a6640 1 -- 172.21.15.150:0/4101576698 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f23bc0d1060 msgr2=0x7f23bc1f9640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:50:08.073 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:08.070+0000 7f23c18a6640 1 --2- 172.21.15.150:0/4101576698 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f23bc0d1060 0x7f23bc1f9640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:50:08.073 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:08.070+0000 7f23c18a6640 1 -- 172.21.15.150:0/4101576698 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f23bc156e80 con 0x7f23bc0d0c50 2024-09-17T05:50:08.073 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:08.070+0000 7f23c18a6640 1 --2- 172.21.15.150:0/4101576698 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f23bc0d0c50 0x7f23bc0c87e0 secure :-1 s=READY pgs=1270 cs=0 l=1 rev1=1 crypto rx=0x7f23b000c480 tx=0x7f23b000c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:50:08.073 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:08.071+0000 7f23baffd640 1 -- 172.21.15.150:0/4101576698 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23b0016020 con 0x7f23bc0d0c50 2024-09-17T05:50:08.073 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:08.071+0000 7f23baffd640 1 -- 172.21.15.150:0/4101576698 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f23b0012920 con 0x7f23bc0d0c50 2024-09-17T05:50:08.073 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:08.071+0000 7f23c430b640 1 -- 172.21.15.150:0/4101576698 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f23bc159fc0 con 0x7f23bc0d0c50 2024-09-17T05:50:08.073 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:08.071+0000 7f23baffd640 1 -- 172.21.15.150:0/4101576698 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23b0012d70 con 0x7f23bc0d0c50 2024-09-17T05:50:08.073 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:08.071+0000 7f23c430b640 1 -- 172.21.15.150:0/4101576698 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f23bc15a580 con 0x7f23bc0d0c50 2024-09-17T05:50:08.074 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:08.072+0000 7f23c430b640 1 -- 172.21.15.150:0/4101576698 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f23bc159b90 con 0x7f23bc0d0c50 2024-09-17T05:50:08.074 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:08.073+0000 7f23baffd640 1 -- 172.21.15.150:0/4101576698 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 32) ==== 103481+0+0 (secure 0 0 0) 0x7f23b0019020 con 0x7f23bc0d0c50 2024-09-17T05:50:08.075 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:08.073+0000 7f23baffd640 1 --2- 172.21.15.150:0/4101576698 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f23a807a210 0x7f23a807c720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:50:08.075 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:08.073+0000 7f23baffd640 1 -- 172.21.15.150:0/4101576698 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 5055+0+0 (secure 0 0 0) 0x7f23b0099930 con 0x7f23bc0d0c50 2024-09-17T05:50:08.075 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:08.073+0000 7f23c20a7640 1 --2- 172.21.15.150:0/4101576698 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f23a807a210 0x7f23a807c720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:50:08.075 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:08.074+0000 7f23c20a7640 1 --2- 172.21.15.150:0/4101576698 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f23a807a210 0x7f23a807c720 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7f23b40099a0 tx=0x7f23b4009500 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:50:08.078 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:08.077+0000 7f23baffd640 1 -- 172.21.15.150:0/4101576698 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f23bc159b90 con 0x7f23bc0d0c50 2024-09-17T05:50:08.326 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:08.325+0000 7f23c430b640 1 -- 172.21.15.150:0/4101576698 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_volumes.TestCloneProgressReporter.test_progress_drops_when_new_jobs_are_added"]} v 0) -- 0x7f23bc0d0010 con 0x7f23bc0d0c50 2024-09-17T05:50:08.584 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:08.584+0000 7f23baffd640 1 -- 172.21.15.150:0/4101576698 <== mon.0 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_volumes.TestCloneProgressReporter.test_progress_drops_when_new_jobs_are_added"]}]=0 v409) ==== 174+0+0 (secure 0 0 0) 0x7f23b0020020 con 0x7f23bc0d0c50 2024-09-17T05:50:08.587 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:08.586+0000 7f23c430b640 1 -- 172.21.15.150:0/4101576698 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f23a807a210 msgr2=0x7f23a807c720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:50:08.587 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:08.586+0000 7f23c430b640 1 --2- 172.21.15.150:0/4101576698 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f23a807a210 0x7f23a807c720 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7f23b40099a0 tx=0x7f23b4009500 comp rx=0 tx=0).stop 2024-09-17T05:50:08.587 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:08.586+0000 7f23c430b640 1 -- 172.21.15.150:0/4101576698 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f23bc0d0c50 msgr2=0x7f23bc0c87e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:50:08.587 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:08.586+0000 7f23c430b640 1 --2- 172.21.15.150:0/4101576698 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f23bc0d0c50 0x7f23bc0c87e0 secure :-1 s=READY pgs=1270 cs=0 l=1 rev1=1 crypto rx=0x7f23b000c480 tx=0x7f23b000c940 comp rx=0 tx=0).stop 2024-09-17T05:50:08.587 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:08.586+0000 7f23c430b640 1 -- 172.21.15.150:0/4101576698 shutdown_connections 2024-09-17T05:50:08.588 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:08.586+0000 7f23c430b640 1 --2- 172.21.15.150:0/4101576698 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f23bc0d1060 0x7f23bc1f9640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:50:08.588 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:08.586+0000 7f23c430b640 1 --2- 172.21.15.150:0/4101576698 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f23a807a210 0x7f23a807c720 unknown :-1 s=CLOSED pgs=547 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:50:08.588 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:08.586+0000 7f23c430b640 1 --2- 172.21.15.150:0/4101576698 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f23bc0d0c50 0x7f23bc0c87e0 unknown :-1 s=CLOSED pgs=1270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:50:08.588 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:08.586+0000 7f23c430b640 1 --2- 172.21.15.150:0/4101576698 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f23bc0d0550 0x7f23bc1575b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:50:08.588 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:08.586+0000 7f23c430b640 1 -- 172.21.15.150:0/4101576698 >> 172.21.15.150:0/4101576698 conn(0x7f23bc0b3fc0 msgr2=0x7f23bc15fe20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:50:08.588 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:08.586+0000 7f23c430b640 1 -- 172.21.15.150:0/4101576698 shutdown_connections 2024-09-17T05:50:08.588 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:08.587+0000 7f23c430b640 1 -- 172.21.15.150:0/4101576698 wait complete. 2024-09-17T05:50:08.601 INFO:tasks.cephfs_test_runner:Test that progress indicated by progress bar for ongoing+pending clones ... ok 2024-09-17T05:50:08.602 INFO:tasks.cephfs_test_runner:Starting test: test_progress_is_printed_in_clone_status_output (tasks.cephfs.test_volumes.TestCloneProgressReporter) Test that the command "ceph fs clone status" prints progress stats 2024-09-17T05:50:08.602 INFO:tasks.cephfs_test_runner:test_progress_is_printed_in_clone_status_output (tasks.cephfs.test_volumes.TestCloneProgressReporter) 2024-09-17T05:50:08.602 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T05:50:08.721 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:08.720+0000 7f217b5f9640 1 -- 172.21.15.150:0/299085689 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f215c005250 msgr2=0x7f215c00b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:50:08.722 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:08.720+0000 7f217b5f9640 1 --2- 172.21.15.150:0/299085689 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f215c005250 0x7f215c00b9c0 secure :-1 s=READY pgs=1272 cs=0 l=1 rev1=1 crypto rx=0x7f217406a060 tx=0x7f215c005830 comp rx=0 tx=0).stop 2024-09-17T05:50:08.722 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:08.720+0000 7f217b5f9640 1 -- 172.21.15.150:0/299085689 shutdown_connections 2024-09-17T05:50:08.722 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:08.720+0000 7f217b5f9640 1 --2- 172.21.15.150:0/299085689 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f215c005250 0x7f215c00b9c0 unknown :-1 s=CLOSED pgs=1272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:50:08.722 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:08.720+0000 7f217b5f9640 1 -- 172.21.15.150:0/299085689 >> 172.21.15.150:0/299085689 conn(0x7f21740cee90 msgr2=0x7f21740cf2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:50:08.722 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:08.721+0000 7f217b5f9640 1 -- 172.21.15.150:0/299085689 shutdown_connections 2024-09-17T05:50:08.722 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:08.721+0000 7f217b5f9640 1 -- 172.21.15.150:0/299085689 wait complete. 2024-09-17T05:50:08.723 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:08.722+0000 7f217b5f9640 1 Processor -- start 2024-09-17T05:50:08.723 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:08.722+0000 7f217b5f9640 1 -- start start 2024-09-17T05:50:08.729 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:08.724+0000 7f217b5f9640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f215c005250 0x7f21741df9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:50:08.729 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:08.724+0000 7f217b5f9640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f217409dea0 0x7f217406deb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:50:08.729 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:08.724+0000 7f217b5f9640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f217406e3f0 0x7f217406e800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:50:08.730 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:08.724+0000 7f217b5f9640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f21740b5f00 con 0x7f217406e3f0 2024-09-17T05:50:08.730 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:08.724+0000 7f217b5f9640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f21740b5d80 con 0x7f215c005250 2024-09-17T05:50:08.730 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:08.724+0000 7f217b5f9640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f21740b6080 con 0x7f217409dea0 2024-09-17T05:50:08.730 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:08.724+0000 7f2179b96640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f217406e3f0 0x7f217406e800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:50:08.730 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:08.724+0000 7f2179b96640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f217406e3f0 0x7f217406e800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:55030/0 (socket says 172.21.15.150:55030) 2024-09-17T05:50:08.730 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:08.724+0000 7f2179b96640 1 -- 172.21.15.150:0/3484811684 learned_addr learned my addr 172.21.15.150:0/3484811684 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:50:08.730 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:08.724+0000 7f2178b94640 1 --2- 172.21.15.150:0/3484811684 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f217409dea0 0x7f217406deb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:50:08.730 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:08.724+0000 7f2179395640 1 --2- 172.21.15.150:0/3484811684 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f215c005250 0x7f21741df9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:50:08.730 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:08.724+0000 7f2179b96640 1 -- 172.21.15.150:0/3484811684 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f217409dea0 msgr2=0x7f217406deb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:50:08.730 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:08.724+0000 7f2179b96640 1 --2- 172.21.15.150:0/3484811684 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f217409dea0 0x7f217406deb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:50:08.730 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:08.724+0000 7f2179b96640 1 -- 172.21.15.150:0/3484811684 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f215c005250 msgr2=0x7f21741df9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:50:08.730 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:08.724+0000 7f2179b96640 1 --2- 172.21.15.150:0/3484811684 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f215c005250 0x7f21741df9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:50:08.730 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:08.724+0000 7f2179b96640 1 -- 172.21.15.150:0/3484811684 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f217409e610 con 0x7f217406e3f0 2024-09-17T05:50:08.731 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:08.724+0000 7f2178b94640 1 --2- 172.21.15.150:0/3484811684 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f217409dea0 0x7f217406deb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T05:50:08.731 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:08.724+0000 7f2179b96640 1 --2- 172.21.15.150:0/3484811684 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f217406e3f0 0x7f217406e800 secure :-1 s=READY pgs=1273 cs=0 l=1 rev1=1 crypto rx=0x7f216c009c10 tx=0x7f216c02ca20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:50:08.731 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:08.724+0000 7f2171ffb640 1 -- 172.21.15.150:0/3484811684 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f216c005020 con 0x7f217406e3f0 2024-09-17T05:50:08.731 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:08.724+0000 7f2171ffb640 1 -- 172.21.15.150:0/3484811684 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f216c004aa0 con 0x7f217406e3f0 2024-09-17T05:50:08.731 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:08.724+0000 7f217b5f9640 1 -- 172.21.15.150:0/3484811684 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f217409e8f0 con 0x7f217406e3f0 2024-09-17T05:50:08.731 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:08.724+0000 7f2171ffb640 1 -- 172.21.15.150:0/3484811684 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f216c03c440 con 0x7f217406e3f0 2024-09-17T05:50:08.731 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:08.725+0000 7f217b5f9640 1 -- 172.21.15.150:0/3484811684 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f217409eeb0 con 0x7f217406e3f0 2024-09-17T05:50:08.731 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:08.726+0000 7f217b5f9640 1 -- 172.21.15.150:0/3484811684 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f21740b5470 con 0x7f217406e3f0 2024-09-17T05:50:08.731 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:08.726+0000 7f2171ffb640 1 -- 172.21.15.150:0/3484811684 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 32) ==== 103481+0+0 (secure 0 0 0) 0x7f216c044020 con 0x7f217406e3f0 2024-09-17T05:50:08.731 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:08.727+0000 7f2171ffb640 1 --2- 172.21.15.150:0/3484811684 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f216007a210 0x7f216007c720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:50:08.731 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:08.727+0000 7f2171ffb640 1 -- 172.21.15.150:0/3484811684 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 5055+0+0 (secure 0 0 0) 0x7f216c0ba2a0 con 0x7f217406e3f0 2024-09-17T05:50:08.731 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:08.727+0000 7f2179395640 1 --2- 172.21.15.150:0/3484811684 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f216007a210 0x7f216007c720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:50:08.732 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:08.728+0000 7f2179395640 1 --2- 172.21.15.150:0/3484811684 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f216007a210 0x7f216007c720 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7f2164006fd0 tx=0x7f2164006f40 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:50:08.732 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:08.731+0000 7f2171ffb640 1 -- 172.21.15.150:0/3484811684 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f216c04b020 con 0x7f217406e3f0 2024-09-17T05:50:08.906 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:08.906+0000 7f217b5f9640 1 -- 172.21.15.150:0/3484811684 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f21740723d0 con 0x7f217406e3f0 2024-09-17T05:50:08.907 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:08.907+0000 7f2171ffb640 1 -- 172.21.15.150:0/3484811684 <== mon.0 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v92) ==== 74+0+13248 (secure 0 0 0) 0x7f216c084270 con 0x7f217406e3f0 2024-09-17T05:50:08.907 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-09-17T05:50:08.908 INFO:teuthology.orchestra.run.smithi150.stdout:{"epoch":92,"fsid":"9f2e05e9-d629-47b3-b26b-1360655b7d20","created":"2024-09-17T05:41:32.502979+0000","modified":"2024-09-17T05:50:07.578191+0000","last_up_change":"2024-09-17T05:41:46.150225+0000","last_in_change":"2024-09-17T05:41:36.120274+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":13,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T05:41:46.860779+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"4f31c018-c8a4-4d6d-b0c2-a597c47aae4a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6800","nonce":479374392},{"type":"v1","addr":"172.21.15.150:6801","nonce":479374392}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6802","nonce":479374392},{"type":"v1","addr":"172.21.15.150:6803","nonce":479374392}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6806","nonce":479374392},{"type":"v1","addr":"172.21.15.150:6807","nonce":479374392}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6804","nonce":479374392},{"type":"v1","addr":"172.21.15.150:6805","nonce":479374392}]},"public_addr":"172.21.15.150:6801/479374392","cluster_addr":"172.21.15.150:6803/479374392","heartbeat_back_addr":"172.21.15.150:6807/479374392","heartbeat_front_addr":"172.21.15.150:6805/479374392","state":["exists","up"]},{"osd":1,"uuid":"6ff4a573-500b-4e04-9de3-39265ead78b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6824","nonce":913899800},{"type":"v1","addr":"172.21.15.150:6825","nonce":913899800}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6826","nonce":913899800},{"type":"v1","addr":"172.21.15.150:6827","nonce":913899800}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6830","nonce":913899800},{"type":"v1","addr":"172.21.15.150:6831","nonce":913899800}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6828","nonce":913899800},{"type":"v1","addr":"172.21.15.150:6829","nonce":913899800}]},"public_addr":"172.21.15.150:6825/913899800","cluster_addr":"172.21.15.150:6827/913899800","heartbeat_back_addr":"172.21.15.150:6831/913899800","heartbeat_front_addr":"172.21.15.150:6829/913899800","state":["exists","up"]},{"osd":2,"uuid":"bffea6f9-2465-4182-b205-00436c41ac1c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6816","nonce":363718461},{"type":"v1","addr":"172.21.15.150:6817","nonce":363718461}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6818","nonce":363718461},{"type":"v1","addr":"172.21.15.150:6819","nonce":363718461}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6822","nonce":363718461},{"type":"v1","addr":"172.21.15.150:6823","nonce":363718461}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6820","nonce":363718461},{"type":"v1","addr":"172.21.15.150:6821","nonce":363718461}]},"public_addr":"172.21.15.150:6817/363718461","cluster_addr":"172.21.15.150:6819/363718461","heartbeat_back_addr":"172.21.15.150:6823/363718461","heartbeat_front_addr":"172.21.15.150:6821/363718461","state":["exists","up"]},{"osd":3,"uuid":"cda70430-d1e1-427e-b04e-56db4031d078","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6808","nonce":3550994626},{"type":"v1","addr":"172.21.15.150:6809","nonce":3550994626}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6810","nonce":3550994626},{"type":"v1","addr":"172.21.15.150:6811","nonce":3550994626}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6814","nonce":3550994626},{"type":"v1","addr":"172.21.15.150:6815","nonce":3550994626}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6812","nonce":3550994626},{"type":"v1","addr":"172.21.15.150:6813","nonce":3550994626}]},"public_addr":"172.21.15.150:6809/3550994626","cluster_addr":"172.21.15.150:6811/3550994626","heartbeat_back_addr":"172.21.15.150:6815/3550994626","heartbeat_front_addr":"172.21.15.150:6813/3550994626","state":["exists","up"]},{"osd":4,"uuid":"3a0277fb-5e1e-4f68-bb2d-9a8a0152f64a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6810","nonce":2718261497},{"type":"v1","addr":"172.21.15.176:6811","nonce":2718261497}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6812","nonce":2718261497},{"type":"v1","addr":"172.21.15.176:6813","nonce":2718261497}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6816","nonce":2718261497},{"type":"v1","addr":"172.21.15.176:6817","nonce":2718261497}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6814","nonce":2718261497},{"type":"v1","addr":"172.21.15.176:6815","nonce":2718261497}]},"public_addr":"172.21.15.176:6811/2718261497","cluster_addr":"172.21.15.176:6813/2718261497","heartbeat_back_addr":"172.21.15.176:6817/2718261497","heartbeat_front_addr":"172.21.15.176:6815/2718261497","state":["exists","up"]},{"osd":5,"uuid":"33aebee6-0315-40b7-a11c-6702f0be494d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6818","nonce":2049295774},{"type":"v1","addr":"172.21.15.176:6819","nonce":2049295774}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6820","nonce":2049295774},{"type":"v1","addr":"172.21.15.176:6821","nonce":2049295774}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6824","nonce":2049295774},{"type":"v1","addr":"172.21.15.176:6825","nonce":2049295774}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6822","nonce":2049295774},{"type":"v1","addr":"172.21.15.176:6823","nonce":2049295774}]},"public_addr":"172.21.15.176:6819/2049295774","cluster_addr":"172.21.15.176:6821/2049295774","heartbeat_back_addr":"172.21.15.176:6825/2049295774","heartbeat_front_addr":"172.21.15.176:6823/2049295774","state":["exists","up"]},{"osd":6,"uuid":"4d24f360-6751-4263-841b-d77793d33540","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6826","nonce":2164458476},{"type":"v1","addr":"172.21.15.176:6827","nonce":2164458476}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6828","nonce":2164458476},{"type":"v1","addr":"172.21.15.176:6829","nonce":2164458476}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6832","nonce":2164458476},{"type":"v1","addr":"172.21.15.176:6833","nonce":2164458476}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6830","nonce":2164458476},{"type":"v1","addr":"172.21.15.176:6831","nonce":2164458476}]},"public_addr":"172.21.15.176:6827/2164458476","cluster_addr":"172.21.15.176:6829/2164458476","heartbeat_back_addr":"172.21.15.176:6833/2164458476","heartbeat_front_addr":"172.21.15.176:6831/2164458476","state":["exists","up"]},{"osd":7,"uuid":"c8594fda-c74a-4ba9-8277-caf101d58ca1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6802","nonce":3239587708},{"type":"v1","addr":"172.21.15.176:6803","nonce":3239587708}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6804","nonce":3239587708},{"type":"v1","addr":"172.21.15.176:6805","nonce":3239587708}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6808","nonce":3239587708},{"type":"v1","addr":"172.21.15.176:6809","nonce":3239587708}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6806","nonce":3239587708},{"type":"v1","addr":"172.21.15.176:6807","nonce":3239587708}]},"public_addr":"172.21.15.176:6803/3239587708","cluster_addr":"172.21.15.176:6805/3239587708","heartbeat_back_addr":"172.21.15.176:6809/3239587708","heartbeat_front_addr":"172.21.15.176:6807/3239587708","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:41:41.905151+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:41:42.705679+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:41:42.459673+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:41:42.440819+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:41:42.668428+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:41:42.694972+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:41:43.078535+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:41:42.363539+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.176:6836/4093204117":"2024-09-18T05:50:04.564315+0000","172.21.15.176:6834/4093204117":"2024-09-18T05:50:04.564315+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":7,"snaps":[{"begin":2,"length":2}]},{"pool":9,"snaps":[{"begin":2,"length":2}]},{"pool":11,"snaps":[{"begin":2,"length":2}]},{"pool":13,"snaps":[{"begin":2,"length":2}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T05:50:08.910 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:08.909+0000 7f217b5f9640 1 -- 172.21.15.150:0/3484811684 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f216007a210 msgr2=0x7f216007c720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:50:08.910 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:08.909+0000 7f217b5f9640 1 --2- 172.21.15.150:0/3484811684 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f216007a210 0x7f216007c720 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7f2164006fd0 tx=0x7f2164006f40 comp rx=0 tx=0).stop 2024-09-17T05:50:08.910 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:08.909+0000 7f217b5f9640 1 -- 172.21.15.150:0/3484811684 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f217406e3f0 msgr2=0x7f217406e800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:50:08.910 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:08.909+0000 7f217b5f9640 1 --2- 172.21.15.150:0/3484811684 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f217406e3f0 0x7f217406e800 secure :-1 s=READY pgs=1273 cs=0 l=1 rev1=1 crypto rx=0x7f216c009c10 tx=0x7f216c02ca20 comp rx=0 tx=0).stop 2024-09-17T05:50:08.910 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:08.909+0000 7f217b5f9640 1 -- 172.21.15.150:0/3484811684 shutdown_connections 2024-09-17T05:50:08.910 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:08.909+0000 7f217b5f9640 1 --2- 172.21.15.150:0/3484811684 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f216007a210 0x7f216007c720 unknown :-1 s=CLOSED pgs=548 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:50:08.910 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:08.909+0000 7f217b5f9640 1 --2- 172.21.15.150:0/3484811684 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f217406e3f0 0x7f217406e800 unknown :-1 s=CLOSED pgs=1273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:50:08.910 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:08.909+0000 7f217b5f9640 1 --2- 172.21.15.150:0/3484811684 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f217409dea0 0x7f217406deb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:50:08.910 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:08.909+0000 7f217b5f9640 1 --2- 172.21.15.150:0/3484811684 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f215c005250 0x7f21741df9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:50:08.910 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:08.909+0000 7f217b5f9640 1 -- 172.21.15.150:0/3484811684 >> 172.21.15.150:0/3484811684 conn(0x7f21740cee90 msgr2=0x7f21740b6290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:50:08.911 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:08.909+0000 7f217b5f9640 1 -- 172.21.15.150:0/3484811684 shutdown_connections 2024-09-17T05:50:08.911 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:08.909+0000 7f217b5f9640 1 -- 172.21.15.150:0/3484811684 wait complete. 2024-09-17T05:50:08.921 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-17T05:41:46.860779+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-17T05:50:08.922 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-17T05:50:09.039 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:09.038+0000 7f9703520640 1 -- 172.21.15.150:0/2204909374 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f96fc0d0fc0 msgr2=0x7f96fc0cd0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:50:09.039 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:09.038+0000 7f9703520640 1 --2- 172.21.15.150:0/2204909374 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f96fc0d0fc0 0x7f96fc0cd0e0 secure :-1 s=READY pgs=1274 cs=0 l=1 rev1=1 crypto rx=0x7f96fc0cfd70 tx=0x7f96f402a4d0 comp rx=0 tx=0).stop 2024-09-17T05:50:09.039 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:09.038+0000 7f9703520640 1 -- 172.21.15.150:0/2204909374 shutdown_connections 2024-09-17T05:50:09.039 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:09.038+0000 7f9703520640 1 --2- 172.21.15.150:0/2204909374 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f96fc0d0fc0 0x7f96fc0cd0e0 unknown :-1 s=CLOSED pgs=1274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:50:09.039 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:09.038+0000 7f9703520640 1 --2- 172.21.15.150:0/2204909374 >> v2:172.21.15.176:3300/0 conn(0x7f96fc0b7d70 0x7f96fc0d0a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:50:09.039 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:09.038+0000 7f9703520640 1 -- 172.21.15.150:0/2204909374 >> 172.21.15.150:0/2204909374 conn(0x7f96fc0cef20 msgr2=0x7f96fc0cf330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:50:09.040 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:09.038+0000 7f9703520640 1 -- 172.21.15.150:0/2204909374 shutdown_connections 2024-09-17T05:50:09.040 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:09.038+0000 7f9703520640 1 -- 172.21.15.150:0/2204909374 wait complete. 2024-09-17T05:50:09.041 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:09.040+0000 7f9703520640 1 Processor -- start 2024-09-17T05:50:09.041 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:09.040+0000 7f9703520640 1 -- start start 2024-09-17T05:50:09.043 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:09.041+0000 7f9703520640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f96fc0b7960 0x7f96fc1518b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:50:09.043 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:09.041+0000 7f9703520640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f96fc0b7d70 0x7f96fc150f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:50:09.043 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:09.041+0000 7f9703520640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f96fc0d0fc0 0x7f96fc15edf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:50:09.043 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:09.041+0000 7f9703520640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f96fc0af900 con 0x7f96fc0b7960 2024-09-17T05:50:09.043 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:09.041+0000 7f9703520640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f96fc0d1490 con 0x7f96fc0b7d70 2024-09-17T05:50:09.043 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:09.041+0000 7f9703520640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f96fc15eaa0 con 0x7f96fc0d0fc0 2024-09-17T05:50:09.043 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:09.041+0000 7f97012bc640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f96fc0b7960 0x7f96fc1518b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:50:09.044 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:09.041+0000 7f97012bc640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f96fc0b7960 0x7f96fc1518b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:55034/0 (socket says 172.21.15.150:55034) 2024-09-17T05:50:09.044 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:09.042+0000 7f97012bc640 1 -- 172.21.15.150:0/1471677109 learned_addr learned my addr 172.21.15.150:0/1471677109 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:50:09.044 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:09.042+0000 7f9700abb640 1 --2- 172.21.15.150:0/1471677109 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f96fc0b7d70 0x7f96fc150f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:50:09.044 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:09.042+0000 7f9701abd640 1 --2- 172.21.15.150:0/1471677109 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f96fc0d0fc0 0x7f96fc15edf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:50:09.044 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:09.042+0000 7f97012bc640 1 -- 172.21.15.150:0/1471677109 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f96fc0d0fc0 msgr2=0x7f96fc15edf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:50:09.044 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:09.042+0000 7f97012bc640 1 --2- 172.21.15.150:0/1471677109 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f96fc0d0fc0 0x7f96fc15edf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:50:09.044 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:09.042+0000 7f97012bc640 1 -- 172.21.15.150:0/1471677109 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f96fc0b7d70 msgr2=0x7f96fc150f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:50:09.044 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:09.042+0000 7f97012bc640 1 --2- 172.21.15.150:0/1471677109 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f96fc0b7d70 0x7f96fc150f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:50:09.044 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:09.042+0000 7f97012bc640 1 -- 172.21.15.150:0/1471677109 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f96fc1520e0 con 0x7f96fc0b7960 2024-09-17T05:50:09.044 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:09.042+0000 7f97012bc640 1 --2- 172.21.15.150:0/1471677109 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f96fc0b7960 0x7f96fc1518b0 secure :-1 s=READY pgs=1275 cs=0 l=1 rev1=1 crypto rx=0x7f96ec00c760 tx=0x7f96ec00cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:50:09.044 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:09.042+0000 7f96f9ffb640 1 -- 172.21.15.150:0/1471677109 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96ec003bc0 con 0x7f96fc0b7960 2024-09-17T05:50:09.044 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:09.042+0000 7f96f9ffb640 1 -- 172.21.15.150:0/1471677109 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f96ec003d60 con 0x7f96fc0b7960 2024-09-17T05:50:09.044 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:09.042+0000 7f9703520640 1 -- 172.21.15.150:0/1471677109 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f96fc1523c0 con 0x7f96fc0b7960 2024-09-17T05:50:09.045 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:09.042+0000 7f96f9ffb640 1 -- 172.21.15.150:0/1471677109 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96ec00aab0 con 0x7f96fc0b7960 2024-09-17T05:50:09.045 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:09.042+0000 7f9703520640 1 -- 172.21.15.150:0/1471677109 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f96fc152980 con 0x7f96fc0b7960 2024-09-17T05:50:09.045 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:09.044+0000 7f9703520640 1 -- 172.21.15.150:0/1471677109 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f96fc152bc0 con 0x7f96fc0b7960 2024-09-17T05:50:09.045 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:09.044+0000 7f96f9ffb640 1 -- 172.21.15.150:0/1471677109 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 32) ==== 103481+0+0 (secure 0 0 0) 0x7f96ec00ac50 con 0x7f96fc0b7960 2024-09-17T05:50:09.046 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:09.045+0000 7f96f9ffb640 1 --2- 172.21.15.150:0/1471677109 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f96e807a210 0x7f96e807c720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:50:09.046 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:09.045+0000 7f96f9ffb640 1 -- 172.21.15.150:0/1471677109 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 5055+0+0 (secure 0 0 0) 0x7f96ec0997a0 con 0x7f96fc0b7960 2024-09-17T05:50:09.046 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:09.045+0000 7f9700abb640 1 --2- 172.21.15.150:0/1471677109 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f96e807a210 0x7f96e807c720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:50:09.046 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:09.046+0000 7f9700abb640 1 --2- 172.21.15.150:0/1471677109 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f96e807a210 0x7f96e807c720 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7f96fc071f60 tx=0x7f96f0005f90 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:50:09.050 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:09.050+0000 7f96f9ffb640 1 -- 172.21.15.150:0/1471677109 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f96fc152bc0 con 0x7f96fc0b7960 2024-09-17T05:50:09.227 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:09.226+0000 7f9703520640 1 -- 172.21.15.150:0/1471677109 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f96fc0d0a80 con 0x7f96fc0b7960 2024-09-17T05:50:09.228 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:09.227+0000 7f96f9ffb640 1 -- 172.21.15.150:0/1471677109 <== mon.0 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v92) ==== 93+0+10 (secure 0 0 0) 0x7f96ec09fe20 con 0x7f96fc0b7960 2024-09-17T05:50:09.228 INFO:teuthology.orchestra.run.smithi150.stdout:pg_num: 1 2024-09-17T05:50:09.230 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:09.229+0000 7f9703520640 1 -- 172.21.15.150:0/1471677109 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f96e807a210 msgr2=0x7f96e807c720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:50:09.231 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:09.229+0000 7f9703520640 1 --2- 172.21.15.150:0/1471677109 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f96e807a210 0x7f96e807c720 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7f96fc071f60 tx=0x7f96f0005f90 comp rx=0 tx=0).stop 2024-09-17T05:50:09.231 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:09.229+0000 7f9703520640 1 -- 172.21.15.150:0/1471677109 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f96fc0b7960 msgr2=0x7f96fc1518b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:50:09.231 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:09.229+0000 7f9703520640 1 --2- 172.21.15.150:0/1471677109 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f96fc0b7960 0x7f96fc1518b0 secure :-1 s=READY pgs=1275 cs=0 l=1 rev1=1 crypto rx=0x7f96ec00c760 tx=0x7f96ec00cc20 comp rx=0 tx=0).stop 2024-09-17T05:50:09.231 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:09.230+0000 7f9703520640 1 -- 172.21.15.150:0/1471677109 shutdown_connections 2024-09-17T05:50:09.231 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:09.230+0000 7f9703520640 1 --2- 172.21.15.150:0/1471677109 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f96fc0b7d70 0x7f96fc150f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:50:09.231 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:09.230+0000 7f9703520640 1 --2- 172.21.15.150:0/1471677109 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f96e807a210 0x7f96e807c720 unknown :-1 s=CLOSED pgs=549 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:50:09.231 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:09.230+0000 7f9703520640 1 --2- 172.21.15.150:0/1471677109 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f96fc0d0fc0 0x7f96fc15edf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:50:09.231 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:09.230+0000 7f9703520640 1 --2- 172.21.15.150:0/1471677109 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f96fc0b7960 0x7f96fc1518b0 unknown :-1 s=CLOSED pgs=1275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:50:09.231 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:09.230+0000 7f9703520640 1 -- 172.21.15.150:0/1471677109 >> 172.21.15.150:0/1471677109 conn(0x7f96fc0cef20 msgr2=0x7f96fc153760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:50:09.231 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:09.230+0000 7f9703520640 1 -- 172.21.15.150:0/1471677109 shutdown_connections 2024-09-17T05:50:09.231 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:09.230+0000 7f9703520640 1 -- 172.21.15.150:0/1471677109 wait complete. 2024-09-17T05:50:09.243 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_volumes.TestCloneProgressReporter.test_progress_is_printed_in_clone_status_output' 2024-09-17T05:50:09.358 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:09.357+0000 7ff281a38640 1 -- 172.21.15.150:0/2552472756 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff27c0d15d0 msgr2=0x7ff27c162a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:50:09.359 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:09.357+0000 7ff281a38640 1 --2- 172.21.15.150:0/2552472756 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff27c0d15d0 0x7ff27c162a60 secure :-1 s=READY pgs=1276 cs=0 l=1 rev1=1 crypto rx=0x7ff27c0b7270 tx=0x7ff27402a4d0 comp rx=0 tx=0).stop 2024-09-17T05:50:09.359 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:09.357+0000 7ff281a38640 1 -- 172.21.15.150:0/2552472756 shutdown_connections 2024-09-17T05:50:09.359 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:09.357+0000 7ff281a38640 1 --2- 172.21.15.150:0/2552472756 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff27c0d15d0 0x7ff27c162a60 unknown :-1 s=CLOSED pgs=1276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:50:09.359 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:09.357+0000 7ff281a38640 1 --2- 172.21.15.150:0/2552472756 >> v2:172.21.15.176:3300/0 conn(0x7ff27c15ee50 0x7ff27c0d1090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:50:09.359 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:09.357+0000 7ff281a38640 1 --2- 172.21.15.150:0/2552472756 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff27c0b9780 0x7ff27c0b3720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:50:09.359 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:09.357+0000 7ff281a38640 1 -- 172.21.15.150:0/2552472756 >> 172.21.15.150:0/2552472756 conn(0x7ff27c0d4680 msgr2=0x7ff27c0d4a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:50:09.360 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:09.357+0000 7ff281a38640 1 -- 172.21.15.150:0/2552472756 shutdown_connections 2024-09-17T05:50:09.360 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:09.357+0000 7ff281a38640 1 -- 172.21.15.150:0/2552472756 wait complete. 2024-09-17T05:50:09.363 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:09.359+0000 7ff281a38640 1 Processor -- start 2024-09-17T05:50:09.363 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:09.359+0000 7ff281a38640 1 -- start start 2024-09-17T05:50:09.363 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:09.360+0000 7ff281a38640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff27c0b9780 0x7ff27c15f3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:50:09.363 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:09.360+0000 7ff281a38640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff27c0d15d0 0x7ff27c14f880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:50:09.363 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:09.360+0000 7ff281a38640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff27c15ee50 0x7ff27c0b6620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:50:09.363 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:09.360+0000 7ff281a38640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7ff27c163330 con 0x7ff27c15ee50 2024-09-17T05:50:09.363 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:09.360+0000 7ff281a38640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7ff27c1631b0 con 0x7ff27c0b9780 2024-09-17T05:50:09.363 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:09.360+0000 7ff281a38640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7ff27c1634b0 con 0x7ff27c0d15d0 2024-09-17T05:50:09.363 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:09.360+0000 7ff27b7fe640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff27c15ee50 0x7ff27c0b6620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:50:09.364 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:09.360+0000 7ff27b7fe640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff27c15ee50 0x7ff27c0b6620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:55046/0 (socket says 172.21.15.150:55046) 2024-09-17T05:50:09.364 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:09.360+0000 7ff27b7fe640 1 -- 172.21.15.150:0/4036766513 learned_addr learned my addr 172.21.15.150:0/4036766513 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:50:09.364 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:09.360+0000 7ff27a7fc640 1 --2- 172.21.15.150:0/4036766513 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff27c0d15d0 0x7ff27c14f880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:50:09.364 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:09.360+0000 7ff27affd640 1 --2- 172.21.15.150:0/4036766513 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff27c0b9780 0x7ff27c15f3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:50:09.364 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:09.360+0000 7ff27b7fe640 1 -- 172.21.15.150:0/4036766513 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff27c0d15d0 msgr2=0x7ff27c14f880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:50:09.364 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:09.360+0000 7ff27b7fe640 1 --2- 172.21.15.150:0/4036766513 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff27c0d15d0 0x7ff27c14f880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:50:09.364 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:09.360+0000 7ff27b7fe640 1 -- 172.21.15.150:0/4036766513 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff27c0b9780 msgr2=0x7ff27c15f3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:50:09.364 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:09.360+0000 7ff27b7fe640 1 --2- 172.21.15.150:0/4036766513 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff27c0b9780 0x7ff27c15f3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:50:09.364 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:09.360+0000 7ff27b7fe640 1 -- 172.21.15.150:0/4036766513 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff27c15fbf0 con 0x7ff27c15ee50 2024-09-17T05:50:09.364 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:09.361+0000 7ff27b7fe640 1 --2- 172.21.15.150:0/4036766513 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff27c15ee50 0x7ff27c0b6620 secure :-1 s=READY pgs=1277 cs=0 l=1 rev1=1 crypto rx=0x7ff274009230 tx=0x7ff274003960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:50:09.364 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:09.361+0000 7ff263fff640 1 -- 172.21.15.150:0/4036766513 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff27403e030 con 0x7ff27c15ee50 2024-09-17T05:50:09.364 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:09.361+0000 7ff263fff640 1 -- 172.21.15.150:0/4036766513 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff274003e50 con 0x7ff27c15ee50 2024-09-17T05:50:09.365 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:09.361+0000 7ff281a38640 1 -- 172.21.15.150:0/4036766513 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff27c15fed0 con 0x7ff27c15ee50 2024-09-17T05:50:09.365 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:09.361+0000 7ff263fff640 1 -- 172.21.15.150:0/4036766513 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff274035040 con 0x7ff27c15ee50 2024-09-17T05:50:09.365 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:09.361+0000 7ff281a38640 1 -- 172.21.15.150:0/4036766513 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff27c160490 con 0x7ff27c15ee50 2024-09-17T05:50:09.365 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:09.362+0000 7ff281a38640 1 -- 172.21.15.150:0/4036766513 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff27c08d100 con 0x7ff27c15ee50 2024-09-17T05:50:09.366 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:09.363+0000 7ff263fff640 1 -- 172.21.15.150:0/4036766513 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 32) ==== 103481+0+0 (secure 0 0 0) 0x7ff274041030 con 0x7ff27c15ee50 2024-09-17T05:50:09.366 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:09.363+0000 7ff263fff640 1 --2- 172.21.15.150:0/4036766513 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7ff26807a210 0x7ff26807c720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:50:09.366 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:09.363+0000 7ff263fff640 1 -- 172.21.15.150:0/4036766513 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 5055+0+0 (secure 0 0 0) 0x7ff2740ba0c0 con 0x7ff27c15ee50 2024-09-17T05:50:09.366 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:09.363+0000 7ff27affd640 1 --2- 172.21.15.150:0/4036766513 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7ff26807a210 0x7ff26807c720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:50:09.366 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:09.364+0000 7ff27affd640 1 --2- 172.21.15.150:0/4036766513 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7ff26807a210 0x7ff26807c720 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7ff26c005fd0 tx=0x7ff26c0095b0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:50:09.368 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:09.368+0000 7ff263fff640 1 -- 172.21.15.150:0/4036766513 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7ff27c08d100 con 0x7ff27c15ee50 2024-09-17T05:50:09.613 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:09.613+0000 7ff281a38640 1 -- 172.21.15.150:0/4036766513 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_volumes.TestCloneProgressReporter.test_progress_is_printed_in_clone_status_output"]} v 0) -- 0x7ff27c15f980 con 0x7ff27c15ee50 2024-09-17T05:50:10.591 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:10.590+0000 7ff263fff640 1 -- 172.21.15.150:0/4036766513 <== mon.0 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_volumes.TestCloneProgressReporter.test_progress_is_printed_in_clone_status_output"]}]=0 v411) ==== 181+0+0 (secure 0 0 0) 0x7ff274083a40 con 0x7ff27c15ee50 2024-09-17T05:50:10.594 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:10.593+0000 7ff281a38640 1 -- 172.21.15.150:0/4036766513 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7ff26807a210 msgr2=0x7ff26807c720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:50:10.595 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:10.593+0000 7ff281a38640 1 --2- 172.21.15.150:0/4036766513 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7ff26807a210 0x7ff26807c720 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7ff26c005fd0 tx=0x7ff26c0095b0 comp rx=0 tx=0).stop 2024-09-17T05:50:10.595 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:10.593+0000 7ff281a38640 1 -- 172.21.15.150:0/4036766513 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff27c15ee50 msgr2=0x7ff27c0b6620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:50:10.595 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:10.593+0000 7ff281a38640 1 --2- 172.21.15.150:0/4036766513 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff27c15ee50 0x7ff27c0b6620 secure :-1 s=READY pgs=1277 cs=0 l=1 rev1=1 crypto rx=0x7ff274009230 tx=0x7ff274003960 comp rx=0 tx=0).stop 2024-09-17T05:50:10.595 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:10.594+0000 7ff281a38640 1 -- 172.21.15.150:0/4036766513 shutdown_connections 2024-09-17T05:50:10.595 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:10.594+0000 7ff281a38640 1 --2- 172.21.15.150:0/4036766513 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7ff26807a210 0x7ff26807c720 unknown :-1 s=CLOSED pgs=550 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:50:10.595 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:10.594+0000 7ff281a38640 1 --2- 172.21.15.150:0/4036766513 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff27c15ee50 0x7ff27c0b6620 unknown :-1 s=CLOSED pgs=1277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:50:10.595 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:10.594+0000 7ff281a38640 1 --2- 172.21.15.150:0/4036766513 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff27c0d15d0 0x7ff27c14f880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:50:10.595 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:10.594+0000 7ff281a38640 1 --2- 172.21.15.150:0/4036766513 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff27c0b9780 0x7ff27c15f3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:50:10.595 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:10.594+0000 7ff281a38640 1 -- 172.21.15.150:0/4036766513 >> 172.21.15.150:0/4036766513 conn(0x7ff27c0d4680 msgr2=0x7ff27c06edb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:50:10.595 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:10.594+0000 7ff281a38640 1 -- 172.21.15.150:0/4036766513 shutdown_connections 2024-09-17T05:50:10.595 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:10.594+0000 7ff281a38640 1 -- 172.21.15.150:0/4036766513 wait complete. 2024-09-17T05:50:10.609 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config dump 2024-09-17T05:50:10.729 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:10.728+0000 7f49b245c640 1 -- 172.21.15.150:0/1705618272 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f49ac0cd890 msgr2=0x7f49ac167180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:50:10.729 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:10.728+0000 7f49b245c640 1 --2- 172.21.15.150:0/1705618272 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f49ac0cd890 0x7f49ac167180 secure :-1 s=READY pgs=1279 cs=0 l=1 rev1=1 crypto rx=0x7f49a4005fd0 tx=0x7f49a402a8b0 comp rx=0 tx=0).stop 2024-09-17T05:50:10.729 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:10.728+0000 7f49b245c640 1 -- 172.21.15.150:0/1705618272 shutdown_connections 2024-09-17T05:50:10.729 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:10.728+0000 7f49b245c640 1 --2- 172.21.15.150:0/1705618272 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f49ac0cd890 0x7f49ac167180 unknown :-1 s=CLOSED pgs=1279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:50:10.729 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:10.728+0000 7f49b245c640 1 --2- 172.21.15.150:0/1705618272 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f49ac0b7490 0x7f49ac0d0590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:50:10.729 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:10.728+0000 7f49b245c640 1 -- 172.21.15.150:0/1705618272 >> 172.21.15.150:0/1705618272 conn(0x7f49ac0cef30 msgr2=0x7f49ac0cf340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:50:10.730 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:10.728+0000 7f49b245c640 1 -- 172.21.15.150:0/1705618272 shutdown_connections 2024-09-17T05:50:10.730 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:10.728+0000 7f49b245c640 1 -- 172.21.15.150:0/1705618272 wait complete. 2024-09-17T05:50:10.730 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:10.730+0000 7f49b245c640 1 Processor -- start 2024-09-17T05:50:10.730 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:10.730+0000 7f49b245c640 1 -- start start 2024-09-17T05:50:10.733 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:10.731+0000 7f49b245c640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f49ac0b7490 0x7f49ac1dffe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:50:10.733 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:10.731+0000 7f49b245c640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f49ac0cd890 0x7f49ac0af260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:50:10.733 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:10.731+0000 7f49b245c640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f49ac0d0ad0 0x7f49ac1e7250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:50:10.733 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:10.731+0000 7f49b245c640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f49ac0d15e0 con 0x7f49ac0d0ad0 2024-09-17T05:50:10.734 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:10.731+0000 7f49b245c640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f49ac0d1460 con 0x7f49ac0b7490 2024-09-17T05:50:10.734 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:10.731+0000 7f49b245c640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f49ac0ceb70 con 0x7f49ac0cd890 2024-09-17T05:50:10.734 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:10.731+0000 7f49b09f9640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f49ac0d0ad0 0x7f49ac1e7250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:50:10.734 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:10.731+0000 7f49b09f9640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f49ac0d0ad0 0x7f49ac1e7250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:58868/0 (socket says 172.21.15.150:58868) 2024-09-17T05:50:10.734 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:10.731+0000 7f49b09f9640 1 -- 172.21.15.150:0/3997861342 learned_addr learned my addr 172.21.15.150:0/3997861342 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:50:10.734 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:10.731+0000 7f49a3fff640 1 --2- 172.21.15.150:0/3997861342 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f49ac0cd890 0x7f49ac0af260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:50:10.734 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:10.731+0000 7f49abfff640 1 --2- 172.21.15.150:0/3997861342 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f49ac0b7490 0x7f49ac1dffe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:50:10.734 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:10.732+0000 7f49b09f9640 1 -- 172.21.15.150:0/3997861342 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f49ac0cd890 msgr2=0x7f49ac0af260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:50:10.734 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:10.732+0000 7f49b09f9640 1 --2- 172.21.15.150:0/3997861342 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f49ac0cd890 0x7f49ac0af260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:50:10.734 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:10.732+0000 7f49b09f9640 1 -- 172.21.15.150:0/3997861342 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f49ac0b7490 msgr2=0x7f49ac1dffe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:50:10.734 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:10.732+0000 7f49b09f9640 1 --2- 172.21.15.150:0/3997861342 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f49ac0b7490 0x7f49ac1dffe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:50:10.734 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:10.732+0000 7f49b09f9640 1 -- 172.21.15.150:0/3997861342 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f49ac1e0520 con 0x7f49ac0d0ad0 2024-09-17T05:50:10.734 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:10.732+0000 7f49abfff640 1 --2- 172.21.15.150:0/3997861342 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f49ac0b7490 0x7f49ac1dffe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:50:10.734 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:10.732+0000 7f49b09f9640 1 --2- 172.21.15.150:0/3997861342 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f49ac0d0ad0 0x7f49ac1e7250 secure :-1 s=READY pgs=1280 cs=0 l=1 rev1=1 crypto rx=0x7f49a4006010 tx=0x7f49a4003970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:50:10.735 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:10.732+0000 7f49a97fa640 1 -- 172.21.15.150:0/3997861342 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49a4031990 con 0x7f49ac0d0ad0 2024-09-17T05:50:10.735 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:10.732+0000 7f49a97fa640 1 -- 172.21.15.150:0/3997861342 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f49a4031c20 con 0x7f49ac0d0ad0 2024-09-17T05:50:10.735 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:10.732+0000 7f49b245c640 1 -- 172.21.15.150:0/3997861342 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f49ac0af7a0 con 0x7f49ac0d0ad0 2024-09-17T05:50:10.735 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:10.732+0000 7f49a97fa640 1 -- 172.21.15.150:0/3997861342 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49a4033070 con 0x7f49ac0d0ad0 2024-09-17T05:50:10.735 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:10.732+0000 7f49b245c640 1 -- 172.21.15.150:0/3997861342 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f49ac0cb970 con 0x7f49ac0d0ad0 2024-09-17T05:50:10.736 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:10.733+0000 7f49b245c640 1 -- 172.21.15.150:0/3997861342 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f49ac0cde60 con 0x7f49ac0d0ad0 2024-09-17T05:50:10.736 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:10.734+0000 7f49a97fa640 1 -- 172.21.15.150:0/3997861342 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 32) ==== 103481+0+0 (secure 0 0 0) 0x7f49a4033210 con 0x7f49ac0d0ad0 2024-09-17T05:50:10.736 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:10.734+0000 7f49a97fa640 1 --2- 172.21.15.150:0/3997861342 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f498c07a230 0x7f498c07c740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:50:10.736 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:10.735+0000 7f49a97fa640 1 -- 172.21.15.150:0/3997861342 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 5055+0+0 (secure 0 0 0) 0x7f49a40baec0 con 0x7f49ac0d0ad0 2024-09-17T05:50:10.736 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:10.735+0000 7f49abfff640 1 --2- 172.21.15.150:0/3997861342 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f498c07a230 0x7f498c07c740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:50:10.736 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:10.735+0000 7f49abfff640 1 --2- 172.21.15.150:0/3997861342 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f498c07a230 0x7f498c07c740 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7f499c005fd0 tx=0x7f499c005ee0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:50:10.739 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:10.739+0000 7f49a97fa640 1 -- 172.21.15.150:0/3997861342 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f49a403f030 con 0x7f49ac0d0ad0 2024-09-17T05:50:10.915 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:10.915+0000 7f49b245c640 1 -- 172.21.15.150:0/3997861342 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "config dump"} v 0) -- 0x7f49ac1e5750 con 0x7f49ac0d0ad0 2024-09-17T05:50:10.916 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:10.915+0000 7f49a97fa640 1 -- 172.21.15.150:0/3997861342 <== mon.0 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "config dump"}]=0 v48) ==== 59+0+2294 (secure 0 0 0) 0x7f49a4084e00 con 0x7f49ac0d0ad0 2024-09-17T05:50:10.916 INFO:teuthology.orchestra.run.smithi150.stdout:WHO MASK LEVEL OPTION VALUE RO 2024-09-17T05:50:10.916 INFO:teuthology.orchestra.run.smithi150.stdout:mon advanced mon_op_complaint_time 120 2024-09-17T05:50:10.916 INFO:teuthology.orchestra.run.smithi150.stdout:mgr advanced client_mount_timeout 30 2024-09-17T05:50:10.916 INFO:teuthology.orchestra.run.smithi150.stdout:mgr advanced debug_client 20/20 2024-09-17T05:50:10.916 INFO:teuthology.orchestra.run.smithi150.stdout:mgr advanced debug_mgr 20/20 2024-09-17T05:50:10.916 INFO:teuthology.orchestra.run.smithi150.stdout:mgr advanced debug_ms 1/1 2024-09-17T05:50:10.916 INFO:teuthology.orchestra.run.smithi150.stdout:mgr dev mon_warn_on_pool_no_app false 2024-09-17T05:50:10.916 INFO:teuthology.orchestra.run.smithi150.stdout:osd advanced osd_op_complaint_time 180.000000 2024-09-17T05:50:10.917 INFO:teuthology.orchestra.run.smithi150.stdout:osd.0 basic osd_mclock_max_capacity_iops_ssd 6764.239331 2024-09-17T05:50:10.917 INFO:teuthology.orchestra.run.smithi150.stdout:osd.1 basic osd_mclock_max_capacity_iops_ssd 4956.769289 2024-09-17T05:50:10.917 INFO:teuthology.orchestra.run.smithi150.stdout:osd.2 basic osd_mclock_max_capacity_iops_ssd 5099.704467 2024-09-17T05:50:10.917 INFO:teuthology.orchestra.run.smithi150.stdout:osd.3 basic osd_mclock_max_capacity_iops_ssd 4681.616196 2024-09-17T05:50:10.917 INFO:teuthology.orchestra.run.smithi150.stdout:osd.4 basic osd_mclock_max_capacity_iops_ssd 4723.364425 2024-09-17T05:50:10.917 INFO:teuthology.orchestra.run.smithi150.stdout:osd.5 basic osd_mclock_max_capacity_iops_ssd 4509.722124 2024-09-17T05:50:10.917 INFO:teuthology.orchestra.run.smithi150.stdout:osd.6 basic osd_mclock_max_capacity_iops_ssd 6380.664158 2024-09-17T05:50:10.917 INFO:teuthology.orchestra.run.smithi150.stdout:osd.7 basic osd_mclock_max_capacity_iops_ssd 4303.333825 2024-09-17T05:50:10.917 INFO:teuthology.orchestra.run.smithi150.stdout:mds advanced debug_mds 20/20 2024-09-17T05:50:10.917 INFO:teuthology.orchestra.run.smithi150.stdout:mds advanced debug_mds_balancer 20/20 2024-09-17T05:50:10.917 INFO:teuthology.orchestra.run.smithi150.stdout:mds advanced debug_ms 2/2 2024-09-17T05:50:10.917 INFO:teuthology.orchestra.run.smithi150.stdout:mds dev mds_debug_frag true 2024-09-17T05:50:10.917 INFO:teuthology.orchestra.run.smithi150.stdout:mds dev mds_debug_scatterstat true 2024-09-17T05:50:10.917 INFO:teuthology.orchestra.run.smithi150.stdout:mds advanced mds_op_complaint_time 180.000000 2024-09-17T05:50:10.918 INFO:teuthology.orchestra.run.smithi150.stdout:mds dev mds_verify_scatter true 2024-09-17T05:50:10.918 INFO:teuthology.orchestra.run.smithi150.stdout:mds advanced osd_op_complaint_time 180.000000 2024-09-17T05:50:10.918 INFO:teuthology.orchestra.run.smithi150.stdout:mds advanced rados_mon_op_timeout 900 2024-09-17T05:50:10.918 INFO:teuthology.orchestra.run.smithi150.stdout:mds advanced rados_osd_op_timeout 900 2024-09-17T05:50:10.918 INFO:teuthology.orchestra.run.smithi150.stdout:client advanced client_mount_timeout 600 2024-09-17T05:50:10.918 INFO:teuthology.orchestra.run.smithi150.stdout:client advanced debug_client 20/20 2024-09-17T05:50:10.918 INFO:teuthology.orchestra.run.smithi150.stdout:client advanced debug_ms 1/1 2024-09-17T05:50:10.918 INFO:teuthology.orchestra.run.smithi150.stdout:client advanced rados_mon_op_timeout 900 2024-09-17T05:50:10.918 INFO:teuthology.orchestra.run.smithi150.stdout:client advanced rados_osd_op_timeout 900 2024-09-17T05:50:10.919 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:10.917+0000 7f49b245c640 1 -- 172.21.15.150:0/3997861342 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f498c07a230 msgr2=0x7f498c07c740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:50:10.919 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:10.917+0000 7f49b245c640 1 --2- 172.21.15.150:0/3997861342 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f498c07a230 0x7f498c07c740 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7f499c005fd0 tx=0x7f499c005ee0 comp rx=0 tx=0).stop 2024-09-17T05:50:10.919 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:10.917+0000 7f49b245c640 1 -- 172.21.15.150:0/3997861342 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f49ac0d0ad0 msgr2=0x7f49ac1e7250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:50:10.919 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:10.917+0000 7f49b245c640 1 --2- 172.21.15.150:0/3997861342 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f49ac0d0ad0 0x7f49ac1e7250 secure :-1 s=READY pgs=1280 cs=0 l=1 rev1=1 crypto rx=0x7f49a4006010 tx=0x7f49a4003970 comp rx=0 tx=0).stop 2024-09-17T05:50:10.919 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:10.917+0000 7f49b245c640 1 -- 172.21.15.150:0/3997861342 shutdown_connections 2024-09-17T05:50:10.919 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:10.917+0000 7f49b245c640 1 --2- 172.21.15.150:0/3997861342 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f498c07a230 0x7f498c07c740 unknown :-1 s=CLOSED pgs=551 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:50:10.919 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:10.917+0000 7f49b245c640 1 --2- 172.21.15.150:0/3997861342 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f49ac0d0ad0 0x7f49ac1e7250 unknown :-1 s=CLOSED pgs=1280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:50:10.919 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:10.917+0000 7f49b245c640 1 --2- 172.21.15.150:0/3997861342 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f49ac0cd890 0x7f49ac0af260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:50:10.920 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:10.917+0000 7f49b245c640 1 --2- 172.21.15.150:0/3997861342 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f49ac0b7490 0x7f49ac1dffe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:50:10.920 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:10.917+0000 7f49b245c640 1 -- 172.21.15.150:0/3997861342 >> 172.21.15.150:0/3997861342 conn(0x7f49ac0cef30 msgr2=0x7f49ac072950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:50:10.920 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:10.917+0000 7f49b245c640 1 -- 172.21.15.150:0/3997861342 shutdown_connections 2024-09-17T05:50:10.920 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:10.917+0000 7f49b245c640 1 -- 172.21.15.150:0/3997861342 wait complete. 2024-09-17T05:50:10.929 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-09-17T05:50:11.045 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:11.044+0000 7f577112b640 1 -- 172.21.15.150:0/1411806301 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f576c1628c0 msgr2=0x7f576c162cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:50:11.045 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:11.044+0000 7f577112b640 1 --2- 172.21.15.150:0/1411806301 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f576c1628c0 0x7f576c162cd0 secure :-1 s=READY pgs=1281 cs=0 l=1 rev1=1 crypto rx=0x7f5754005fd0 tx=0x7f575402a5d0 comp rx=0 tx=0).stop 2024-09-17T05:50:11.045 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:11.044+0000 7f577112b640 1 -- 172.21.15.150:0/1411806301 shutdown_connections 2024-09-17T05:50:11.045 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:11.044+0000 7f577112b640 1 --2- 172.21.15.150:0/1411806301 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f576c1628c0 0x7f576c162cd0 unknown :-1 s=CLOSED pgs=1281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:50:11.045 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:11.044+0000 7f577112b640 1 --2- 172.21.15.150:0/1411806301 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f576c0b3ae0 0x7f576c0d2370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:50:11.046 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:11.044+0000 7f577112b640 1 -- 172.21.15.150:0/1411806301 >> 172.21.15.150:0/1411806301 conn(0x7f576c0d4680 msgr2=0x7f576c0d4a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:50:11.046 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:11.044+0000 7f577112b640 1 -- 172.21.15.150:0/1411806301 shutdown_connections 2024-09-17T05:50:11.046 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:11.044+0000 7f577112b640 1 -- 172.21.15.150:0/1411806301 wait complete. 2024-09-17T05:50:11.046 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:11.046+0000 7f577112b640 1 Processor -- start 2024-09-17T05:50:11.046 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:11.046+0000 7f577112b640 1 -- start start 2024-09-17T05:50:11.049 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:11.047+0000 7f577112b640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f576c0b3ae0 0x7f576c15f3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:50:11.049 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:11.047+0000 7f577112b640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f576c1628c0 0x7f576c0c8120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:50:11.050 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:11.047+0000 7f577112b640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f576c163210 0x7f576c14fb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:50:11.050 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:11.047+0000 7f577112b640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f576c0cfd50 con 0x7f576c0b3ae0 2024-09-17T05:50:11.050 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:11.047+0000 7f577112b640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f576c0cfbd0 con 0x7f576c163210 2024-09-17T05:50:11.050 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:11.047+0000 7f577112b640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f576c0cfed0 con 0x7f576c1628c0 2024-09-17T05:50:11.050 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:11.047+0000 7f576ad9d640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f576c0b3ae0 0x7f576c15f3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:50:11.050 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:11.047+0000 7f576ad9d640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f576c0b3ae0 0x7f576c15f3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:58886/0 (socket says 172.21.15.150:58886) 2024-09-17T05:50:11.050 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:11.047+0000 7f576ad9d640 1 -- 172.21.15.150:0/3457455615 learned_addr learned my addr 172.21.15.150:0/3457455615 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:50:11.050 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:11.048+0000 7f576259c640 1 --2- 172.21.15.150:0/3457455615 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f576c1628c0 0x7f576c0c8120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:50:11.050 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:11.048+0000 7f576b59e640 1 --2- 172.21.15.150:0/3457455615 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f576c163210 0x7f576c14fb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:50:11.050 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:11.048+0000 7f576ad9d640 1 -- 172.21.15.150:0/3457455615 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f576c1628c0 msgr2=0x7f576c0c8120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:50:11.050 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:11.048+0000 7f576ad9d640 1 --2- 172.21.15.150:0/3457455615 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f576c1628c0 0x7f576c0c8120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:50:11.050 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:11.048+0000 7f576ad9d640 1 -- 172.21.15.150:0/3457455615 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f576c163210 msgr2=0x7f576c14fb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:50:11.051 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:11.048+0000 7f576ad9d640 1 --2- 172.21.15.150:0/3457455615 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f576c163210 0x7f576c14fb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:50:11.051 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:11.048+0000 7f576ad9d640 1 -- 172.21.15.150:0/3457455615 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f576c15fcc0 con 0x7f576c0b3ae0 2024-09-17T05:50:11.051 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:11.048+0000 7f576ad9d640 1 --2- 172.21.15.150:0/3457455615 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f576c0b3ae0 0x7f576c15f3c0 secure :-1 s=READY pgs=1282 cs=0 l=1 rev1=1 crypto rx=0x7f575c00e7c0 tx=0x7f575c00ec80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:50:11.051 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:11.048+0000 7f5763fff640 1 -- 172.21.15.150:0/3457455615 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f575c00ccc0 con 0x7f576c0b3ae0 2024-09-17T05:50:11.051 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:11.048+0000 7f5763fff640 1 -- 172.21.15.150:0/3457455615 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f575c010430 con 0x7f576c0b3ae0 2024-09-17T05:50:11.051 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:11.048+0000 7f5763fff640 1 -- 172.21.15.150:0/3457455615 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f575c010840 con 0x7f576c0b3ae0 2024-09-17T05:50:11.051 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:11.048+0000 7f577112b640 1 -- 172.21.15.150:0/3457455615 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f576c15ffa0 con 0x7f576c0b3ae0 2024-09-17T05:50:11.051 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:11.048+0000 7f577112b640 1 -- 172.21.15.150:0/3457455615 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f576c160f10 con 0x7f576c0b3ae0 2024-09-17T05:50:11.052 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:11.049+0000 7f577112b640 1 -- 172.21.15.150:0/3457455615 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f576c0b5fb0 con 0x7f576c0b3ae0 2024-09-17T05:50:11.052 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:11.050+0000 7f5763fff640 1 -- 172.21.15.150:0/3457455615 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 32) ==== 103481+0+0 (secure 0 0 0) 0x7f575c0109e0 con 0x7f576c0b3ae0 2024-09-17T05:50:11.052 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:11.051+0000 7f5763fff640 1 --2- 172.21.15.150:0/3457455615 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f574c07a210 0x7f574c07c720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:50:11.052 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:11.051+0000 7f5763fff640 1 -- 172.21.15.150:0/3457455615 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 5055+0+0 (secure 0 0 0) 0x7f575c09abf0 con 0x7f576c0b3ae0 2024-09-17T05:50:11.052 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:11.051+0000 7f576259c640 1 --2- 172.21.15.150:0/3457455615 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f574c07a210 0x7f574c07c720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:50:11.053 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:11.051+0000 7f576259c640 1 --2- 172.21.15.150:0/3457455615 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f574c07a210 0x7f574c07c720 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7f5754033000 tx=0x7f5754004730 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:50:11.055 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:11.054+0000 7f5763fff640 1 -- 172.21.15.150:0/3457455615 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f576c0b5fb0 con 0x7f576c0b3ae0 2024-09-17T05:50:11.234 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:11.233+0000 7f577112b640 1 -- 172.21.15.150:0/3457455615 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) -- 0x7f576c08e050 con 0x7f576c0b3ae0 2024-09-17T05:50:11.237 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:11.237+0000 7f5763fff640 1 -- 172.21.15.150:0/3457455615 <== mon.0 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v49)=0 v49) ==== 122+0+0 (secure 0 0 0) 0x7f576c08e050 con 0x7f576c0b3ae0 2024-09-17T05:50:11.240 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:11.239+0000 7f577112b640 1 -- 172.21.15.150:0/3457455615 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f574c07a210 msgr2=0x7f574c07c720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:50:11.240 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:11.239+0000 7f577112b640 1 --2- 172.21.15.150:0/3457455615 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f574c07a210 0x7f574c07c720 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7f5754033000 tx=0x7f5754004730 comp rx=0 tx=0).stop 2024-09-17T05:50:11.240 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:11.239+0000 7f577112b640 1 -- 172.21.15.150:0/3457455615 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f576c0b3ae0 msgr2=0x7f576c15f3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:50:11.240 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:11.239+0000 7f577112b640 1 --2- 172.21.15.150:0/3457455615 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f576c0b3ae0 0x7f576c15f3c0 secure :-1 s=READY pgs=1282 cs=0 l=1 rev1=1 crypto rx=0x7f575c00e7c0 tx=0x7f575c00ec80 comp rx=0 tx=0).stop 2024-09-17T05:50:11.241 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:11.239+0000 7f577112b640 1 -- 172.21.15.150:0/3457455615 shutdown_connections 2024-09-17T05:50:11.241 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:11.239+0000 7f577112b640 1 --2- 172.21.15.150:0/3457455615 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f576c163210 0x7f576c14fb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:50:11.241 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:11.239+0000 7f577112b640 1 --2- 172.21.15.150:0/3457455615 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f574c07a210 0x7f574c07c720 unknown :-1 s=CLOSED pgs=552 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:50:11.241 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:11.239+0000 7f577112b640 1 --2- 172.21.15.150:0/3457455615 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f576c1628c0 0x7f576c0c8120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:50:11.241 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:11.239+0000 7f577112b640 1 --2- 172.21.15.150:0/3457455615 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f576c0b3ae0 0x7f576c15f3c0 unknown :-1 s=CLOSED pgs=1282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:50:11.241 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:11.239+0000 7f577112b640 1 -- 172.21.15.150:0/3457455615 >> 172.21.15.150:0/3457455615 conn(0x7f576c0d4680 msgr2=0x7f576c06df80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:50:11.241 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:11.239+0000 7f577112b640 1 -- 172.21.15.150:0/3457455615 shutdown_connections 2024-09-17T05:50:11.241 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:11.239+0000 7f577112b640 1 -- 172.21.15.150:0/3457455615 wait complete. 2024-09-17T05:50:11.251 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-17T05:50:11.252 DEBUG:teuthology.orchestra.run.smithi150:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-17T05:50:11.289 DEBUG:teuthology.orchestra.run.smithi176:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-17T05:50:11.333 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-17T05:50:11.333 DEBUG:teuthology.orchestra.run.smithi150:> set -ex 2024-09-17T05:50:11.333 DEBUG:teuthology.orchestra.run.smithi150:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T05:50:11.349 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056027,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497464k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=18693 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248728k,nr_inodes=812182,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497464k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-17T05:50:11.349 DEBUG:teuthology.orchestra.run.smithi176:> set -ex 2024-09-17T05:50:11.349 DEBUG:teuthology.orchestra.run.smithi176:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T05:50:11.393 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056030,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497468k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=3379 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248732k,nr_inodes=812183,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497468k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-17T05:50:11.394 DEBUG:teuthology.orchestra.run.smithi150:> set -ex 2024-09-17T05:50:11.394 DEBUG:teuthology.orchestra.run.smithi150:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T05:50:11.409 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056027,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497464k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=18693 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248728k,nr_inodes=812182,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497464k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-17T05:50:11.409 DEBUG:teuthology.orchestra.run.smithi176:> set -ex 2024-09-17T05:50:11.409 DEBUG:teuthology.orchestra.run.smithi176:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T05:50:11.451 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056030,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497468k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=3379 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248732k,nr_inodes=812183,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497468k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-17T05:50:11.452 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-09-17T05:50:11.452 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T05:50:11.566 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:11.565+0000 7fa4ef512640 1 -- 172.21.15.150:0/4054995287 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa4d0003ff0 msgr2=0x7fa4d0004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:50:11.566 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:11.565+0000 7fa4ef512640 1 --2- 172.21.15.150:0/4054995287 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa4d0003ff0 0x7fa4d0004800 secure :-1 s=READY pgs=1284 cs=0 l=1 rev1=1 crypto rx=0x7fa4e8077250 tx=0x7fa4d0005830 comp rx=0 tx=0).stop 2024-09-17T05:50:11.566 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:11.565+0000 7fa4edaaf640 1 -- 172.21.15.150:0/4054995287 reap_dead start 2024-09-17T05:50:11.566 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:11.565+0000 7fa4ef512640 1 -- 172.21.15.150:0/4054995287 shutdown_connections 2024-09-17T05:50:11.566 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:11.565+0000 7fa4ef512640 1 -- 172.21.15.150:0/4054995287 >> 172.21.15.150:0/4054995287 conn(0x7fa4e80b3fc0 msgr2=0x7fa4e80b43d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:50:11.566 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:11.565+0000 7fa4ef512640 1 -- 172.21.15.150:0/4054995287 shutdown_connections 2024-09-17T05:50:11.566 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:11.565+0000 7fa4ef512640 1 -- 172.21.15.150:0/4054995287 wait complete. 2024-09-17T05:50:11.567 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:11.567+0000 7fa4ef512640 1 Processor -- start 2024-09-17T05:50:11.567 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:11.567+0000 7fa4ef512640 1 -- start start 2024-09-17T05:50:11.570 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:11.568+0000 7fa4ef512640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa4d0003ff0 0x7fa4e80cc2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:50:11.570 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:11.568+0000 7fa4ef512640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa4e81f9a10 0x7fa4e806deb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:50:11.571 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:11.568+0000 7fa4ef512640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa4e81f8e70 0x7fa4e81f9280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:50:11.571 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:11.568+0000 7fa4ef512640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7fa4e80b2390 con 0x7fa4e81f8e70 2024-09-17T05:50:11.571 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:11.568+0000 7fa4ef512640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fa4e80b2210 con 0x7fa4d0003ff0 2024-09-17T05:50:11.571 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:11.568+0000 7fa4ef512640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fa4e80ceb70 con 0x7fa4e81f9a10 2024-09-17T05:50:11.571 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:11.568+0000 7fa4edaaf640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa4e81f8e70 0x7fa4e81f9280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:50:11.571 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:11.568+0000 7fa4edaaf640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa4e81f8e70 0x7fa4e81f9280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:58914/0 (socket says 172.21.15.150:58914) 2024-09-17T05:50:11.571 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:11.568+0000 7fa4edaaf640 1 -- 172.21.15.150:0/93928741 learned_addr learned my addr 172.21.15.150:0/93928741 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:50:11.571 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:11.568+0000 7fa4ecaad640 1 --2- 172.21.15.150:0/93928741 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa4e81f9a10 0x7fa4e806deb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:50:11.571 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:11.568+0000 7fa4ed2ae640 1 --2- 172.21.15.150:0/93928741 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa4d0003ff0 0x7fa4e80cc2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:50:11.571 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:11.568+0000 7fa4edaaf640 1 -- 172.21.15.150:0/93928741 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa4e81f9a10 msgr2=0x7fa4e806deb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:50:11.571 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:11.568+0000 7fa4edaaf640 1 --2- 172.21.15.150:0/93928741 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa4e81f9a10 0x7fa4e806deb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:50:11.572 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:11.568+0000 7fa4edaaf640 1 -- 172.21.15.150:0/93928741 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa4d0003ff0 msgr2=0x7fa4e80cc2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:50:11.572 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:11.568+0000 7fa4edaaf640 1 --2- 172.21.15.150:0/93928741 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa4d0003ff0 0x7fa4e80cc2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:50:11.572 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:11.569+0000 7fa4edaaf640 1 -- 172.21.15.150:0/93928741 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa4e81f97c0 con 0x7fa4e81f8e70 2024-09-17T05:50:11.572 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:11.569+0000 7fa4edaaf640 1 --2- 172.21.15.150:0/93928741 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa4e81f8e70 0x7fa4e81f9280 secure :-1 s=READY pgs=1285 cs=0 l=1 rev1=1 crypto rx=0x7fa4e80d3540 tx=0x7fa4d8010d90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:50:11.572 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:11.569+0000 7fa4e5ffb640 1 -- 172.21.15.150:0/93928741 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4d8003d80 con 0x7fa4e81f8e70 2024-09-17T05:50:11.572 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:11.569+0000 7fa4e5ffb640 1 -- 172.21.15.150:0/93928741 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa4d8015070 con 0x7fa4e81f8e70 2024-09-17T05:50:11.572 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:11.569+0000 7fa4e5ffb640 1 -- 172.21.15.150:0/93928741 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4d800e820 con 0x7fa4e81f8e70 2024-09-17T05:50:11.572 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:11.569+0000 7fa4ef512640 1 -- 172.21.15.150:0/93928741 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa4e806f850 con 0x7fa4e81f8e70 2024-09-17T05:50:11.572 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:11.569+0000 7fa4ef512640 1 -- 172.21.15.150:0/93928741 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa4e806ea90 con 0x7fa4e81f8e70 2024-09-17T05:50:11.573 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:11.570+0000 7fa4ef512640 1 -- 172.21.15.150:0/93928741 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa4e80b18c0 con 0x7fa4e81f8e70 2024-09-17T05:50:11.573 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:11.571+0000 7fa4e5ffb640 1 -- 172.21.15.150:0/93928741 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 32) ==== 103481+0+0 (secure 0 0 0) 0x7fa4d800e9c0 con 0x7fa4e81f8e70 2024-09-17T05:50:11.573 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:11.571+0000 7fa4e5ffb640 1 --2- 172.21.15.150:0/93928741 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fa4d407a240 0x7fa4d407c750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:50:11.574 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:11.572+0000 7fa4e5ffb640 1 -- 172.21.15.150:0/93928741 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 5055+0+0 (secure 0 0 0) 0x7fa4d809a040 con 0x7fa4e81f8e70 2024-09-17T05:50:11.574 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:11.572+0000 7fa4ed2ae640 1 --2- 172.21.15.150:0/93928741 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fa4d407a240 0x7fa4d407c750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:50:11.574 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:11.572+0000 7fa4ed2ae640 1 --2- 172.21.15.150:0/93928741 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fa4d407a240 0x7fa4d407c750 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7fa4e0004b40 tx=0x7fa4e0006040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:50:11.576 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:11.576+0000 7fa4e5ffb640 1 -- 172.21.15.150:0/93928741 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fa4e81f97c0 con 0x7fa4e81f8e70 2024-09-17T05:50:11.789 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:11.788+0000 7fa4ef512640 1 -- 172.21.15.150:0/93928741 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fa4e8071c70 con 0x7fa4e81f8e70 2024-09-17T05:50:11.789 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:11.789+0000 7fa4e5ffb640 1 -- 172.21.15.150:0/93928741 <== mon.0 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 54 v54) ==== 94+0+3920 (secure 0 0 0) 0x7fa4d8064010 con 0x7fa4e81f8e70 2024-09-17T05:50:11.790 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-09-17T05:50:11.790 INFO:teuthology.orchestra.run.smithi150.stdout:{"epoch":54,"btime":"2024-09-17T05:50:05:568043+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5993,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6835/1590564966","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6833","nonce":1590564966},{"type":"v1","addr":"172.21.15.150:6835","nonce":1590564966}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":47},{"gid":6008,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6837/3094459008","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6835","nonce":3094459008},{"type":"v1","addr":"172.21.15.176:6837","nonce":3094459008}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":47},{"gid":6428,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6836/530228594","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6834","nonce":530228594},{"type":"v1","addr":"172.21.15.176:6836","nonce":530228594}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":54},{"gid":6484,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6834/1586974380","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6832","nonce":1586974380},{"type":"v1","addr":"172.21.15.150:6834","nonce":1586974380}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":46}],"filesystems":[]} 2024-09-17T05:50:11.790 INFO:teuthology.orchestra.run.smithi150.stderr:dumped fsmap epoch 54 2024-09-17T05:50:11.792 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:11.791+0000 7fa4ef512640 1 -- 172.21.15.150:0/93928741 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fa4d407a240 msgr2=0x7fa4d407c750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:50:11.792 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:11.791+0000 7fa4ef512640 1 --2- 172.21.15.150:0/93928741 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fa4d407a240 0x7fa4d407c750 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7fa4e0004b40 tx=0x7fa4e0006040 comp rx=0 tx=0).stop 2024-09-17T05:50:11.792 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:11.791+0000 7fa4ef512640 1 -- 172.21.15.150:0/93928741 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa4e81f8e70 msgr2=0x7fa4e81f9280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:50:11.792 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:11.791+0000 7fa4ef512640 1 --2- 172.21.15.150:0/93928741 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa4e81f8e70 0x7fa4e81f9280 secure :-1 s=READY pgs=1285 cs=0 l=1 rev1=1 crypto rx=0x7fa4e80d3540 tx=0x7fa4d8010d90 comp rx=0 tx=0).stop 2024-09-17T05:50:11.792 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:11.791+0000 7fa4ef512640 1 -- 172.21.15.150:0/93928741 shutdown_connections 2024-09-17T05:50:11.792 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:11.791+0000 7fa4ef512640 1 --2- 172.21.15.150:0/93928741 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fa4d407a240 0x7fa4d407c750 unknown :-1 s=CLOSED pgs=553 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:50:11.792 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:11.791+0000 7fa4ef512640 1 --2- 172.21.15.150:0/93928741 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa4e81f8e70 0x7fa4e81f9280 unknown :-1 s=CLOSED pgs=1285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:50:11.792 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:11.791+0000 7fa4ef512640 1 --2- 172.21.15.150:0/93928741 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa4e81f9a10 0x7fa4e806deb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:50:11.792 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:11.791+0000 7fa4ef512640 1 --2- 172.21.15.150:0/93928741 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa4d0003ff0 0x7fa4e80cc2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:50:11.792 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:11.791+0000 7fa4ef512640 1 -- 172.21.15.150:0/93928741 >> 172.21.15.150:0/93928741 conn(0x7fa4e80b3fc0 msgr2=0x7fa4e80cdcc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:50:11.792 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:11.791+0000 7fa4ef512640 1 -- 172.21.15.150:0/93928741 shutdown_connections 2024-09-17T05:50:11.793 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:11.791+0000 7fa4ef512640 1 -- 172.21.15.150:0/93928741 wait complete. 2024-09-17T05:50:11.805 INFO:tasks.ceph.mds.a:Restarting daemon 2024-09-17T05:50:11.806 INFO:tasks.ceph.mds.a:Stopping old one... 2024-09-17T05:50:11.806 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-09-17T05:50:11.806 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T05:50:11.806 INFO:tasks.ceph.mds.c:Restarting daemon 2024-09-17T05:50:11.806 INFO:tasks.ceph.mds.c:Stopping old one... 2024-09-17T05:50:11.806 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-09-17T05:50:11.806 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T05:50:11.807 INFO:tasks.ceph.mds.b:Restarting daemon 2024-09-17T05:50:11.807 INFO:tasks.ceph.mds.b:Stopping old one... 2024-09-17T05:50:11.807 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-09-17T05:50:11.807 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T05:50:11.807 INFO:tasks.ceph.mds.d:Restarting daemon 2024-09-17T05:50:11.807 INFO:tasks.ceph.mds.d:Stopping old one... 2024-09-17T05:50:11.807 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-09-17T05:50:11.808 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T05:50:11.816 INFO:tasks.ceph.mds.a:Stopped 2024-09-17T05:50:11.816 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-09-17T05:50:11.817 INFO:tasks.ceph.mds.c:Stopped 2024-09-17T05:50:11.817 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-09-17T05:50:11.819 INFO:tasks.ceph.mds.b:Stopped 2024-09-17T05:50:11.819 DEBUG:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-09-17T05:50:11.823 INFO:tasks.ceph.mds.d:Stopped 2024-09-17T05:50:11.823 DEBUG:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-09-17T05:50:11.859 INFO:tasks.ceph.mds.a:Started 2024-09-17T05:50:11.859 DEBUG:teuthology.parallel:result is None 2024-09-17T05:50:11.860 INFO:tasks.ceph.mds.c:Started 2024-09-17T05:50:11.860 DEBUG:teuthology.parallel:result is None 2024-09-17T05:50:11.865 INFO:tasks.ceph.mds.b:Started 2024-09-17T05:50:11.865 DEBUG:teuthology.parallel:result is None 2024-09-17T05:50:11.866 INFO:tasks.ceph.mds.d:Started 2024-09-17T05:50:11.867 DEBUG:teuthology.parallel:result is None 2024-09-17T05:50:11.867 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-09-17T05:50:11.947 INFO:tasks.ceph.mds.a.smithi150.stdout:starting mds.a at 2024-09-17T05:50:11.948 INFO:tasks.ceph.mds.c.smithi150.stdout:starting mds.c at 2024-09-17T05:50:11.960 INFO:tasks.ceph.mds.d.smithi176.stdout:starting mds.d at 2024-09-17T05:50:11.960 INFO:tasks.ceph.mds.b.smithi176.stdout:starting mds.b at 2024-09-17T05:50:11.988 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:11.987+0000 7fe2d8113640 1 -- 172.21.15.150:0/2060710880 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe2d015ae80 msgr2=0x7fe2d0070560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:50:11.988 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:11.987+0000 7fe2d8113640 1 --2- 172.21.15.150:0/2060710880 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe2d015ae80 0x7fe2d0070560 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fe2cc009860 tx=0x7fe2cc02a5a0 comp rx=0 tx=0).stop 2024-09-17T05:50:11.988 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:11.987+0000 7fe2d8113640 1 -- 172.21.15.150:0/2060710880 shutdown_connections 2024-09-17T05:50:11.988 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:11.987+0000 7fe2d8113640 1 --2- 172.21.15.150:0/2060710880 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe2d015ae80 0x7fe2d0070560 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:50:11.989 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:11.987+0000 7fe2d8113640 1 -- 172.21.15.150:0/2060710880 >> 172.21.15.150:0/2060710880 conn(0x7fe2d006d3d0 msgr2=0x7fe2d00b1ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:50:11.989 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:11.987+0000 7fe2d8113640 1 -- 172.21.15.150:0/2060710880 shutdown_connections 2024-09-17T05:50:11.989 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:11.987+0000 7fe2d8113640 1 -- 172.21.15.150:0/2060710880 wait complete. 2024-09-17T05:50:11.990 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:11.989+0000 7fe2d8113640 1 Processor -- start 2024-09-17T05:50:11.990 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:11.989+0000 7fe2d8113640 1 -- start start 2024-09-17T05:50:11.992 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:11.990+0000 7fe2d8113640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe2d00af1e0 0x7fe2d009db80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:50:11.992 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:11.990+0000 7fe2d8113640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe2d00ccd00 0x7fe2d015c7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:50:11.992 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:11.990+0000 7fe2d8113640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe2d015ae80 0x7fe2d00d02d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:50:11.993 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:11.990+0000 7fe2d8113640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7fe2d00b4650 con 0x7fe2d015ae80 2024-09-17T05:50:11.993 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:11.990+0000 7fe2d8113640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fe2d00b44d0 con 0x7fe2d00ccd00 2024-09-17T05:50:11.993 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:11.990+0000 7fe2d8113640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fe2d00b47d0 con 0x7fe2d00af1e0 2024-09-17T05:50:11.993 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:11.990+0000 7fe2d66b0640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe2d015ae80 0x7fe2d00d02d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:50:11.993 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:11.990+0000 7fe2d66b0640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe2d015ae80 0x7fe2d00d02d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:58954/0 (socket says 172.21.15.150:58954) 2024-09-17T05:50:11.993 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:11.990+0000 7fe2d66b0640 1 -- 172.21.15.150:0/2504813102 learned_addr learned my addr 172.21.15.150:0/2504813102 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:50:11.993 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:11.991+0000 7fe2d56ae640 1 --2- 172.21.15.150:0/2504813102 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe2d00ccd00 0x7fe2d015c7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:50:11.993 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:11.991+0000 7fe2d5eaf640 1 --2- 172.21.15.150:0/2504813102 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe2d00af1e0 0x7fe2d009db80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:50:11.993 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:11.991+0000 7fe2d66b0640 1 -- 172.21.15.150:0/2504813102 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe2d00af1e0 msgr2=0x7fe2d009db80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:50:11.993 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:11.991+0000 7fe2d66b0640 1 --2- 172.21.15.150:0/2504813102 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe2d00af1e0 0x7fe2d009db80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:50:11.993 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:11.991+0000 7fe2d66b0640 1 -- 172.21.15.150:0/2504813102 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe2d00ccd00 msgr2=0x7fe2d015c7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:50:11.993 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:11.991+0000 7fe2d66b0640 1 --2- 172.21.15.150:0/2504813102 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe2d00ccd00 0x7fe2d015c7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:50:11.993 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:11.991+0000 7fe2d66b0640 1 -- 172.21.15.150:0/2504813102 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe2d0098e90 con 0x7fe2d015ae80 2024-09-17T05:50:11.994 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:11.991+0000 7fe2d66b0640 1 --2- 172.21.15.150:0/2504813102 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe2d015ae80 0x7fe2d00d02d0 secure :-1 s=READY pgs=1292 cs=0 l=1 rev1=1 crypto rx=0x7fe2c800ed30 tx=0x7fe2c800c640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:50:11.994 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:11.991+0000 7fe2c67fc640 1 -- 172.21.15.150:0/2504813102 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2c8016070 con 0x7fe2d015ae80 2024-09-17T05:50:11.994 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:11.991+0000 7fe2c67fc640 1 -- 172.21.15.150:0/2504813102 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe2c8011760 con 0x7fe2d015ae80 2024-09-17T05:50:11.994 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:11.991+0000 7fe2d8113640 1 -- 172.21.15.150:0/2504813102 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe2d0099170 con 0x7fe2d015ae80 2024-09-17T05:50:11.994 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:11.991+0000 7fe2c67fc640 1 -- 172.21.15.150:0/2504813102 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2c8011bb0 con 0x7fe2d015ae80 2024-09-17T05:50:11.994 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:11.991+0000 7fe2d8113640 1 -- 172.21.15.150:0/2504813102 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe2d0099730 con 0x7fe2d015ae80 2024-09-17T05:50:11.995 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:11.992+0000 7fe2d8113640 1 -- 172.21.15.150:0/2504813102 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe2d00b2890 con 0x7fe2d015ae80 2024-09-17T05:50:11.995 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:11.994+0000 7fe2c67fc640 1 -- 172.21.15.150:0/2504813102 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 32) ==== 103481+0+0 (secure 0 0 0) 0x7fe2c8019070 con 0x7fe2d015ae80 2024-09-17T05:50:11.995 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:11.994+0000 7fe2c67fc640 1 --2- 172.21.15.150:0/2504813102 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fe2b407a210 0x7fe2b407c720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:50:11.995 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:11.994+0000 7fe2c67fc640 1 -- 172.21.15.150:0/2504813102 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 5055+0+0 (secure 0 0 0) 0x7fe2c809c600 con 0x7fe2d015ae80 2024-09-17T05:50:11.995 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:11.994+0000 7fe2d5eaf640 1 --2- 172.21.15.150:0/2504813102 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fe2b407a210 0x7fe2b407c720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:50:11.995 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:11.995+0000 7fe2d5eaf640 1 --2- 172.21.15.150:0/2504813102 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fe2b407a210 0x7fe2b407c720 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7fe2cc034000 tx=0x7fe2cc004730 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:50:11.998 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:11.998+0000 7fe2c67fc640 1 -- 172.21.15.150:0/2504813102 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fe2c8066120 con 0x7fe2d015ae80 2024-09-17T05:50:12.187 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:12.187+0000 7fe2d8113640 1 -- 172.21.15.150:0/2504813102 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) -- 0x7fe2d015d2d0 con 0x7fe2d015ae80 2024-09-17T05:50:13.612 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:13.611+0000 7fe2c67fc640 1 -- 172.21.15.150:0/2504813102 <== mon.0 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v97) ==== 97+0+0 (secure 0 0 0) 0x7fe2c806ab50 con 0x7fe2d015ae80 2024-09-17T05:50:13.613 INFO:teuthology.orchestra.run.smithi150.stderr: removed all blocklist entries 2024-09-17T05:50:13.616 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:13.615+0000 7fe2d8113640 1 -- 172.21.15.150:0/2504813102 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fe2b407a210 msgr2=0x7fe2b407c720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:50:13.616 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:13.615+0000 7fe2d8113640 1 --2- 172.21.15.150:0/2504813102 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fe2b407a210 0x7fe2b407c720 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7fe2cc034000 tx=0x7fe2cc004730 comp rx=0 tx=0).stop 2024-09-17T05:50:13.616 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:13.615+0000 7fe2d8113640 1 -- 172.21.15.150:0/2504813102 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe2d015ae80 msgr2=0x7fe2d00d02d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:50:13.616 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:13.615+0000 7fe2d8113640 1 --2- 172.21.15.150:0/2504813102 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe2d015ae80 0x7fe2d00d02d0 secure :-1 s=READY pgs=1292 cs=0 l=1 rev1=1 crypto rx=0x7fe2c800ed30 tx=0x7fe2c800c640 comp rx=0 tx=0).stop 2024-09-17T05:50:13.616 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:13.615+0000 7fe2d8113640 1 -- 172.21.15.150:0/2504813102 shutdown_connections 2024-09-17T05:50:13.616 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:13.615+0000 7fe2d8113640 1 --2- 172.21.15.150:0/2504813102 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe2d00ccd00 0x7fe2d015c7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:50:13.616 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:13.615+0000 7fe2d8113640 1 --2- 172.21.15.150:0/2504813102 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fe2b407a210 0x7fe2b407c720 unknown :-1 s=CLOSED pgs=554 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:50:13.616 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:13.615+0000 7fe2d8113640 1 --2- 172.21.15.150:0/2504813102 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe2d015ae80 0x7fe2d00d02d0 unknown :-1 s=CLOSED pgs=1292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:50:13.616 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:13.615+0000 7fe2d8113640 1 --2- 172.21.15.150:0/2504813102 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe2d00af1e0 0x7fe2d009db80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:50:13.616 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:13.615+0000 7fe2d8113640 1 -- 172.21.15.150:0/2504813102 >> 172.21.15.150:0/2504813102 conn(0x7fe2d006d3d0 msgr2=0x7fe2d00af5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:50:13.617 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:13.615+0000 7fe2d8113640 1 -- 172.21.15.150:0/2504813102 shutdown_connections 2024-09-17T05:50:13.617 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:13.615+0000 7fe2d8113640 1 -- 172.21.15.150:0/2504813102 wait complete. 2024-09-17T05:50:13.630 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-09-17T05:50:13.750 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:13.749+0000 7fe36660e640 1 -- 172.21.15.150:0/3173204821 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe348003a00 msgr2=0x7fe348003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:50:13.750 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:13.749+0000 7fe36660e640 1 --2- 172.21.15.150:0/3173204821 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe348003a00 0x7fe348003e70 secure :-1 s=READY pgs=1294 cs=0 l=1 rev1=1 crypto rx=0x7fe350009b50 tx=0x7fe348005830 comp rx=0 tx=0).stop 2024-09-17T05:50:13.750 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:13.749+0000 7fe364bab640 1 -- 172.21.15.150:0/3173204821 reap_dead start 2024-09-17T05:50:13.750 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:13.749+0000 7fe36660e640 1 -- 172.21.15.150:0/3173204821 shutdown_connections 2024-09-17T05:50:13.750 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:13.749+0000 7fe36660e640 1 -- 172.21.15.150:0/3173204821 >> 172.21.15.150:0/3173204821 conn(0x7fe36008bfe0 msgr2=0x7fe3600d4670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:50:13.751 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:13.749+0000 7fe36660e640 1 -- 172.21.15.150:0/3173204821 shutdown_connections 2024-09-17T05:50:13.751 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:13.749+0000 7fe36660e640 1 -- 172.21.15.150:0/3173204821 wait complete. 2024-09-17T05:50:13.751 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:13.751+0000 7fe36660e640 1 Processor -- start 2024-09-17T05:50:13.751 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:13.751+0000 7fe36660e640 1 -- start start 2024-09-17T05:50:13.754 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:13.753+0000 7fe36660e640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe348003a00 0x7fe3600b4dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:50:13.754 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:13.753+0000 7fe36660e640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe3600b1220 0x7fe36014a590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:50:13.755 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:13.753+0000 7fe36660e640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe3601f6120 0x7fe3601f6530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:50:13.755 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:13.753+0000 7fe36660e640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7fe3600b7640 con 0x7fe348003a00 2024-09-17T05:50:13.755 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:13.753+0000 7fe36660e640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fe3600b74c0 con 0x7fe3600b1220 2024-09-17T05:50:13.755 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:13.753+0000 7fe36660e640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fe3600b77c0 con 0x7fe3601f6120 2024-09-17T05:50:13.755 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:13.753+0000 7fe35ffff640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe348003a00 0x7fe3600b4dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:50:13.755 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:13.753+0000 7fe35ffff640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe348003a00 0x7fe3600b4dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:58966/0 (socket says 172.21.15.150:58966) 2024-09-17T05:50:13.755 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:13.753+0000 7fe35f7fe640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe3600b1220 0x7fe36014a590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:50:13.755 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:13.753+0000 7fe35ffff640 1 -- 172.21.15.150:0/1875398522 learned_addr learned my addr 172.21.15.150:0/1875398522 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:50:13.755 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:13.753+0000 7fe364bab640 1 --2- 172.21.15.150:0/1875398522 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe3601f6120 0x7fe3601f6530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:50:13.755 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:13.753+0000 7fe35ffff640 1 -- 172.21.15.150:0/1875398522 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe3601f6120 msgr2=0x7fe3601f6530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:50:13.755 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:13.753+0000 7fe35ffff640 1 --2- 172.21.15.150:0/1875398522 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe3601f6120 0x7fe3601f6530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:50:13.755 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:13.753+0000 7fe35ffff640 1 -- 172.21.15.150:0/1875398522 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe3600b1220 msgr2=0x7fe36014a590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:50:13.756 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:13.753+0000 7fe35ffff640 1 --2- 172.21.15.150:0/1875398522 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe3600b1220 0x7fe36014a590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:50:13.756 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:13.753+0000 7fe35ffff640 1 -- 172.21.15.150:0/1875398522 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe3601f6a70 con 0x7fe348003a00 2024-09-17T05:50:13.756 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:13.753+0000 7fe35f7fe640 1 --2- 172.21.15.150:0/1875398522 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe3600b1220 0x7fe36014a590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T05:50:13.756 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:13.753+0000 7fe35ffff640 1 --2- 172.21.15.150:0/1875398522 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe348003a00 0x7fe3600b4dd0 secure :-1 s=READY pgs=1295 cs=0 l=1 rev1=1 crypto rx=0x7fe350009a70 tx=0x7fe350033670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:50:13.756 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:13.753+0000 7fe35cff9640 1 -- 172.21.15.150:0/1875398522 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe350038040 con 0x7fe348003a00 2024-09-17T05:50:13.756 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:13.753+0000 7fe35cff9640 1 -- 172.21.15.150:0/1875398522 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe350004240 con 0x7fe348003a00 2024-09-17T05:50:13.756 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:13.753+0000 7fe36660e640 1 -- 172.21.15.150:0/1875398522 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe3601f9ff0 con 0x7fe348003a00 2024-09-17T05:50:13.756 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:13.754+0000 7fe35cff9640 1 -- 172.21.15.150:0/1875398522 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe3500337e0 con 0x7fe348003a00 2024-09-17T05:50:13.756 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:13.754+0000 7fe36660e640 1 -- 172.21.15.150:0/1875398522 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe3600b2480 con 0x7fe348003a00 2024-09-17T05:50:13.757 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:13.755+0000 7fe36660e640 1 -- 172.21.15.150:0/1875398522 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe3600d2780 con 0x7fe348003a00 2024-09-17T05:50:13.757 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:13.755+0000 7fe35cff9640 1 -- 172.21.15.150:0/1875398522 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 32) ==== 103481+0+0 (secure 0 0 0) 0x7fe350045060 con 0x7fe348003a00 2024-09-17T05:50:13.757 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:13.756+0000 7fe35cff9640 1 --2- 172.21.15.150:0/1875398522 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fe34c07a210 0x7fe34c07c720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:50:13.757 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:13.756+0000 7fe35cff9640 1 -- 172.21.15.150:0/1875398522 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(97..97 src has 1..97) ==== 4969+0+0 (secure 0 0 0) 0x7fe3500b9dd0 con 0x7fe348003a00 2024-09-17T05:50:13.757 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:13.756+0000 7fe35f7fe640 1 --2- 172.21.15.150:0/1875398522 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fe34c07a210 0x7fe34c07c720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:50:13.757 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:13.756+0000 7fe35f7fe640 1 --2- 172.21.15.150:0/1875398522 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fe34c07a210 0x7fe34c07c720 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7fe3601f6c60 tx=0x7fe354005f90 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:50:13.761 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:13.760+0000 7fe35cff9640 1 -- 172.21.15.150:0/1875398522 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fe350083750 con 0x7fe348003a00 2024-09-17T05:50:14.007 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:14.007+0000 7fe36660e640 1 -- 172.21.15.150:0/1875398522 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) -- 0x7fe3600d2d60 con 0x7fe348003a00 2024-09-17T05:50:14.008 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:14.007+0000 7fe35cff9640 1 -- 172.21.15.150:0/1875398522 <== mon.0 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v16) ==== 80+0+5304 (secure 0 0 0) 0x7fe350088180 con 0x7fe348003a00 2024-09-17T05:50:14.008 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-09-17T05:50:14.008 INFO:teuthology.orchestra.run.smithi150.stdout:{ 2024-09-17T05:50:14.008 INFO:teuthology.orchestra.run.smithi150.stdout: "auth_dump": [ 2024-09-17T05:50:14.008 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-09-17T05:50:14.008 INFO:teuthology.orchestra.run.smithi150.stdout: "entity": "mds.a", 2024-09-17T05:50:14.008 INFO:teuthology.orchestra.run.smithi150.stdout: "key": "AQBoFulmMHALAxAAEO+QBgzbd+BNfhyY2qPiqw==", 2024-09-17T05:50:14.008 INFO:teuthology.orchestra.run.smithi150.stdout: "caps": { 2024-09-17T05:50:14.009 INFO:teuthology.orchestra.run.smithi150.stdout: "mds": "allow", 2024-09-17T05:50:14.009 INFO:teuthology.orchestra.run.smithi150.stdout: "mgr": "allow *", 2024-09-17T05:50:14.009 INFO:teuthology.orchestra.run.smithi150.stdout: "mon": "allow *", 2024-09-17T05:50:14.009 INFO:teuthology.orchestra.run.smithi150.stdout: "osd": "allow *" 2024-09-17T05:50:14.009 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-09-17T05:50:14.009 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-17T05:50:14.009 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-09-17T05:50:14.009 INFO:teuthology.orchestra.run.smithi150.stdout: "entity": "mds.b", 2024-09-17T05:50:14.009 INFO:teuthology.orchestra.run.smithi150.stdout: "key": "AQBoFulmtutmEBAAhKJEJQm181pL1lPmSSdYRQ==", 2024-09-17T05:50:14.009 INFO:teuthology.orchestra.run.smithi150.stdout: "caps": { 2024-09-17T05:50:14.009 INFO:teuthology.orchestra.run.smithi150.stdout: "mds": "allow", 2024-09-17T05:50:14.009 INFO:teuthology.orchestra.run.smithi150.stdout: "mgr": "allow *", 2024-09-17T05:50:14.009 INFO:teuthology.orchestra.run.smithi150.stdout: "mon": "allow *", 2024-09-17T05:50:14.009 INFO:teuthology.orchestra.run.smithi150.stdout: "osd": "allow *" 2024-09-17T05:50:14.009 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-09-17T05:50:14.010 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-17T05:50:14.010 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-09-17T05:50:14.010 INFO:teuthology.orchestra.run.smithi150.stdout: "entity": "mds.c", 2024-09-17T05:50:14.010 INFO:teuthology.orchestra.run.smithi150.stdout: "key": "AQBoFulmHTKsChAA4/fUb2NC+fMhR+xIYIDjgQ==", 2024-09-17T05:50:14.010 INFO:teuthology.orchestra.run.smithi150.stdout: "caps": { 2024-09-17T05:50:14.010 INFO:teuthology.orchestra.run.smithi150.stdout: "mds": "allow", 2024-09-17T05:50:14.010 INFO:teuthology.orchestra.run.smithi150.stdout: "mgr": "allow *", 2024-09-17T05:50:14.010 INFO:teuthology.orchestra.run.smithi150.stdout: "mon": "allow *", 2024-09-17T05:50:14.010 INFO:teuthology.orchestra.run.smithi150.stdout: "osd": "allow *" 2024-09-17T05:50:14.010 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-09-17T05:50:14.010 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-17T05:50:14.010 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-09-17T05:50:14.010 INFO:teuthology.orchestra.run.smithi150.stdout: "entity": "mds.d", 2024-09-17T05:50:14.010 INFO:teuthology.orchestra.run.smithi150.stdout: "key": "AQBoFulmr2s3GBAAhXzLVtObF/LwTpDIrY8MIQ==", 2024-09-17T05:50:14.011 INFO:teuthology.orchestra.run.smithi150.stdout: "caps": { 2024-09-17T05:50:14.011 INFO:teuthology.orchestra.run.smithi150.stdout: "mds": "allow", 2024-09-17T05:50:14.011 INFO:teuthology.orchestra.run.smithi150.stdout: "mgr": "allow *", 2024-09-17T05:50:14.011 INFO:teuthology.orchestra.run.smithi150.stdout: "mon": "allow *", 2024-09-17T05:50:14.011 INFO:teuthology.orchestra.run.smithi150.stdout: "osd": "allow *" 2024-09-17T05:50:14.011 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-09-17T05:50:14.011 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-17T05:50:14.011 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-09-17T05:50:14.011 INFO:teuthology.orchestra.run.smithi150.stdout: "entity": "osd.0", 2024-09-17T05:50:14.011 INFO:teuthology.orchestra.run.smithi150.stdout: "key": "AQBrFulm9eU0NRAAqgc1CtMOz+jDCHBn8coaVw==", 2024-09-17T05:50:14.011 INFO:teuthology.orchestra.run.smithi150.stdout: "caps": { 2024-09-17T05:50:14.011 INFO:teuthology.orchestra.run.smithi150.stdout: "mgr": "allow profile osd", 2024-09-17T05:50:14.011 INFO:teuthology.orchestra.run.smithi150.stdout: "mon": "allow profile osd", 2024-09-17T05:50:14.011 INFO:teuthology.orchestra.run.smithi150.stdout: "osd": "allow *" 2024-09-17T05:50:14.012 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-09-17T05:50:14.012 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-17T05:50:14.012 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-09-17T05:50:14.012 INFO:teuthology.orchestra.run.smithi150.stdout: "entity": "osd.1", 2024-09-17T05:50:14.012 INFO:teuthology.orchestra.run.smithi150.stdout: "key": "AQBvFulmlFL6CxAA8ByBraZue2FLfyZeOIpj3A==", 2024-09-17T05:50:14.012 INFO:teuthology.orchestra.run.smithi150.stdout: "caps": { 2024-09-17T05:50:14.012 INFO:teuthology.orchestra.run.smithi150.stdout: "mgr": "allow profile osd", 2024-09-17T05:50:14.012 INFO:teuthology.orchestra.run.smithi150.stdout: "mon": "allow profile osd", 2024-09-17T05:50:14.012 INFO:teuthology.orchestra.run.smithi150.stdout: "osd": "allow *" 2024-09-17T05:50:14.012 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-09-17T05:50:14.012 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-17T05:50:14.012 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-09-17T05:50:14.012 INFO:teuthology.orchestra.run.smithi150.stdout: "entity": "osd.2", 2024-09-17T05:50:14.012 INFO:teuthology.orchestra.run.smithi150.stdout: "key": "AQByFulmMQF5LBAAB4rbdIL6Zd+l4I4LDC/r3Q==", 2024-09-17T05:50:14.013 INFO:teuthology.orchestra.run.smithi150.stdout: "caps": { 2024-09-17T05:50:14.013 INFO:teuthology.orchestra.run.smithi150.stdout: "mgr": "allow profile osd", 2024-09-17T05:50:14.013 INFO:teuthology.orchestra.run.smithi150.stdout: "mon": "allow profile osd", 2024-09-17T05:50:14.013 INFO:teuthology.orchestra.run.smithi150.stdout: "osd": "allow *" 2024-09-17T05:50:14.013 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-09-17T05:50:14.013 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-17T05:50:14.013 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-09-17T05:50:14.013 INFO:teuthology.orchestra.run.smithi150.stdout: "entity": "osd.3", 2024-09-17T05:50:14.013 INFO:teuthology.orchestra.run.smithi150.stdout: "key": "AQB2Fulm5fjaAhAASnkpgsW79Sr9IIiy4HMm4g==", 2024-09-17T05:50:14.013 INFO:teuthology.orchestra.run.smithi150.stdout: "caps": { 2024-09-17T05:50:14.013 INFO:teuthology.orchestra.run.smithi150.stdout: "mgr": "allow profile osd", 2024-09-17T05:50:14.013 INFO:teuthology.orchestra.run.smithi150.stdout: "mon": "allow profile osd", 2024-09-17T05:50:14.013 INFO:teuthology.orchestra.run.smithi150.stdout: "osd": "allow *" 2024-09-17T05:50:14.014 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-09-17T05:50:14.014 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-17T05:50:14.014 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-09-17T05:50:14.014 INFO:teuthology.orchestra.run.smithi150.stdout: "entity": "osd.4", 2024-09-17T05:50:14.014 INFO:teuthology.orchestra.run.smithi150.stdout: "key": "AQB8Fulm9fWPGhAA9nNf+0znlS0Z7rqOvC47xQ==", 2024-09-17T05:50:14.014 INFO:teuthology.orchestra.run.smithi150.stdout: "caps": { 2024-09-17T05:50:14.014 INFO:teuthology.orchestra.run.smithi150.stdout: "mgr": "allow profile osd", 2024-09-17T05:50:14.014 INFO:teuthology.orchestra.run.smithi150.stdout: "mon": "allow profile osd", 2024-09-17T05:50:14.014 INFO:teuthology.orchestra.run.smithi150.stdout: "osd": "allow *" 2024-09-17T05:50:14.014 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-09-17T05:50:14.014 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-17T05:50:14.014 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-09-17T05:50:14.014 INFO:teuthology.orchestra.run.smithi150.stdout: "entity": "osd.5", 2024-09-17T05:50:14.014 INFO:teuthology.orchestra.run.smithi150.stdout: "key": "AQB/FulmeHakHRAASlnmKa0UTqVX+NSbmiHEBw==", 2024-09-17T05:50:14.015 INFO:teuthology.orchestra.run.smithi150.stdout: "caps": { 2024-09-17T05:50:14.015 INFO:teuthology.orchestra.run.smithi150.stdout: "mgr": "allow profile osd", 2024-09-17T05:50:14.015 INFO:teuthology.orchestra.run.smithi150.stdout: "mon": "allow profile osd", 2024-09-17T05:50:14.015 INFO:teuthology.orchestra.run.smithi150.stdout: "osd": "allow *" 2024-09-17T05:50:14.015 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-09-17T05:50:14.015 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-17T05:50:14.015 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-09-17T05:50:14.015 INFO:teuthology.orchestra.run.smithi150.stdout: "entity": "osd.6", 2024-09-17T05:50:14.015 INFO:teuthology.orchestra.run.smithi150.stdout: "key": "AQCCFulmEZF3IBAAhtpCanI6m8Kb3hyi+sRyyQ==", 2024-09-17T05:50:14.015 INFO:teuthology.orchestra.run.smithi150.stdout: "caps": { 2024-09-17T05:50:14.015 INFO:teuthology.orchestra.run.smithi150.stdout: "mgr": "allow profile osd", 2024-09-17T05:50:14.015 INFO:teuthology.orchestra.run.smithi150.stdout: "mon": "allow profile osd", 2024-09-17T05:50:14.015 INFO:teuthology.orchestra.run.smithi150.stdout: "osd": "allow *" 2024-09-17T05:50:14.015 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-09-17T05:50:14.016 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-17T05:50:14.016 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-09-17T05:50:14.016 INFO:teuthology.orchestra.run.smithi150.stdout: "entity": "osd.7", 2024-09-17T05:50:14.016 INFO:teuthology.orchestra.run.smithi150.stdout: "key": "AQCGFulmdcs7BRAAxsctes949cbkGkivdGpoYw==", 2024-09-17T05:50:14.016 INFO:teuthology.orchestra.run.smithi150.stdout: "caps": { 2024-09-17T05:50:14.016 INFO:teuthology.orchestra.run.smithi150.stdout: "mgr": "allow profile osd", 2024-09-17T05:50:14.016 INFO:teuthology.orchestra.run.smithi150.stdout: "mon": "allow profile osd", 2024-09-17T05:50:14.016 INFO:teuthology.orchestra.run.smithi150.stdout: "osd": "allow *" 2024-09-17T05:50:14.016 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-09-17T05:50:14.016 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-17T05:50:14.016 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-09-17T05:50:14.016 INFO:teuthology.orchestra.run.smithi150.stdout: "entity": "client.0", 2024-09-17T05:50:14.016 INFO:teuthology.orchestra.run.smithi150.stdout: "key": "AQBoFulmfF/1HBAAMezEjZDeoHTJ+uFfDXNWHQ==", 2024-09-17T05:50:14.016 INFO:teuthology.orchestra.run.smithi150.stdout: "caps": { 2024-09-17T05:50:14.017 INFO:teuthology.orchestra.run.smithi150.stdout: "mds": "allow", 2024-09-17T05:50:14.017 INFO:teuthology.orchestra.run.smithi150.stdout: "mon": "allow r", 2024-09-17T05:50:14.017 INFO:teuthology.orchestra.run.smithi150.stdout: "osd": "allow rw tag cephfs data=cephfs" 2024-09-17T05:50:14.017 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-09-17T05:50:14.017 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-17T05:50:14.017 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-09-17T05:50:14.017 INFO:teuthology.orchestra.run.smithi150.stdout: "entity": "client.1", 2024-09-17T05:50:14.017 INFO:teuthology.orchestra.run.smithi150.stdout: "key": "AQBoFulmv3GQJBAANlgjLqiCwzNfmBh8uClJ9A==", 2024-09-17T05:50:14.017 INFO:teuthology.orchestra.run.smithi150.stdout: "caps": { 2024-09-17T05:50:14.017 INFO:teuthology.orchestra.run.smithi150.stdout: "mds": "allow", 2024-09-17T05:50:14.017 INFO:teuthology.orchestra.run.smithi150.stdout: "mgr": "allow r", 2024-09-17T05:50:14.017 INFO:teuthology.orchestra.run.smithi150.stdout: "mon": "allow rw", 2024-09-17T05:50:14.017 INFO:teuthology.orchestra.run.smithi150.stdout: "osd": "allow rwx" 2024-09-17T05:50:14.017 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-09-17T05:50:14.017 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-17T05:50:14.018 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-09-17T05:50:14.018 INFO:teuthology.orchestra.run.smithi150.stdout: "entity": "client.2", 2024-09-17T05:50:14.018 INFO:teuthology.orchestra.run.smithi150.stdout: "key": "AQBoFulm1O/BIBAA8kfQL3/13SmZO1+y2tOZvw==", 2024-09-17T05:50:14.018 INFO:teuthology.orchestra.run.smithi150.stdout: "caps": { 2024-09-17T05:50:14.018 INFO:teuthology.orchestra.run.smithi150.stdout: "mds": "allow", 2024-09-17T05:50:14.018 INFO:teuthology.orchestra.run.smithi150.stdout: "mgr": "allow r", 2024-09-17T05:50:14.018 INFO:teuthology.orchestra.run.smithi150.stdout: "mon": "allow rw", 2024-09-17T05:50:14.018 INFO:teuthology.orchestra.run.smithi150.stdout: "osd": "allow rwx" 2024-09-17T05:50:14.018 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-09-17T05:50:14.018 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-17T05:50:14.018 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-09-17T05:50:14.018 INFO:teuthology.orchestra.run.smithi150.stdout: "entity": "client.3", 2024-09-17T05:50:14.018 INFO:teuthology.orchestra.run.smithi150.stdout: "key": "AQBoFulmF4hVKBAAZ5FGapBLLLtez3t8kON9dg==", 2024-09-17T05:50:14.018 INFO:teuthology.orchestra.run.smithi150.stdout: "caps": { 2024-09-17T05:50:14.018 INFO:teuthology.orchestra.run.smithi150.stdout: "mds": "allow", 2024-09-17T05:50:14.019 INFO:teuthology.orchestra.run.smithi150.stdout: "mgr": "allow r", 2024-09-17T05:50:14.019 INFO:teuthology.orchestra.run.smithi150.stdout: "mon": "allow rw", 2024-09-17T05:50:14.019 INFO:teuthology.orchestra.run.smithi150.stdout: "osd": "allow rwx" 2024-09-17T05:50:14.019 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-09-17T05:50:14.019 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-17T05:50:14.019 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-09-17T05:50:14.019 INFO:teuthology.orchestra.run.smithi150.stdout: "entity": "client.admin", 2024-09-17T05:50:14.019 INFO:teuthology.orchestra.run.smithi150.stdout: "key": "AQBnFulmaU9+IBAA7ZmXWZ44s0IpQ+C+Zw2V1g==", 2024-09-17T05:50:14.019 INFO:teuthology.orchestra.run.smithi150.stdout: "caps": { 2024-09-17T05:50:14.019 INFO:teuthology.orchestra.run.smithi150.stdout: "mds": "allow *", 2024-09-17T05:50:14.019 INFO:teuthology.orchestra.run.smithi150.stdout: "mgr": "allow *", 2024-09-17T05:50:14.019 INFO:teuthology.orchestra.run.smithi150.stdout: "mon": "allow *", 2024-09-17T05:50:14.019 INFO:teuthology.orchestra.run.smithi150.stdout: "osd": "allow *" 2024-09-17T05:50:14.019 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-09-17T05:50:14.020 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-17T05:50:14.020 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-09-17T05:50:14.020 INFO:teuthology.orchestra.run.smithi150.stdout: "entity": "mgr.x", 2024-09-17T05:50:14.020 INFO:teuthology.orchestra.run.smithi150.stdout: "key": "AQBnFulmEjvROhAAn3GZxCEtqPYLWopR1AcSFA==", 2024-09-17T05:50:14.020 INFO:teuthology.orchestra.run.smithi150.stdout: "caps": { 2024-09-17T05:50:14.020 INFO:teuthology.orchestra.run.smithi150.stdout: "mds": "allow *", 2024-09-17T05:50:14.020 INFO:teuthology.orchestra.run.smithi150.stdout: "mon": "allow profile mgr", 2024-09-17T05:50:14.020 INFO:teuthology.orchestra.run.smithi150.stdout: "osd": "allow *" 2024-09-17T05:50:14.020 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-09-17T05:50:14.020 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-17T05:50:14.020 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-09-17T05:50:14.020 INFO:teuthology.orchestra.run.smithi150.stdout: "entity": "mgr.y", 2024-09-17T05:50:14.020 INFO:teuthology.orchestra.run.smithi150.stdout: "key": "AQBnFulm9IkENhAA4uf1vzhYOepmovspN5/v1w==", 2024-09-17T05:50:14.021 INFO:teuthology.orchestra.run.smithi150.stdout: "caps": { 2024-09-17T05:50:14.021 INFO:teuthology.orchestra.run.smithi150.stdout: "mds": "allow *", 2024-09-17T05:50:14.021 INFO:teuthology.orchestra.run.smithi150.stdout: "mon": "allow profile mgr", 2024-09-17T05:50:14.021 INFO:teuthology.orchestra.run.smithi150.stdout: "osd": "allow *" 2024-09-17T05:50:14.021 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-09-17T05:50:14.021 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-09-17T05:50:14.021 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2024-09-17T05:50:14.021 INFO:teuthology.orchestra.run.smithi150.stdout:} 2024-09-17T05:50:14.022 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:14.010+0000 7fe36660e640 1 -- 172.21.15.150:0/1875398522 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fe34c07a210 msgr2=0x7fe34c07c720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:50:14.022 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:14.010+0000 7fe36660e640 1 --2- 172.21.15.150:0/1875398522 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fe34c07a210 0x7fe34c07c720 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7fe3601f6c60 tx=0x7fe354005f90 comp rx=0 tx=0).stop 2024-09-17T05:50:14.022 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:14.010+0000 7fe36660e640 1 -- 172.21.15.150:0/1875398522 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe348003a00 msgr2=0x7fe3600b4dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:50:14.023 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:14.010+0000 7fe36660e640 1 --2- 172.21.15.150:0/1875398522 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe348003a00 0x7fe3600b4dd0 secure :-1 s=READY pgs=1295 cs=0 l=1 rev1=1 crypto rx=0x7fe350009a70 tx=0x7fe350033670 comp rx=0 tx=0).stop 2024-09-17T05:50:14.023 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:14.010+0000 7fe36660e640 1 -- 172.21.15.150:0/1875398522 shutdown_connections 2024-09-17T05:50:14.023 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:14.010+0000 7fe36660e640 1 --2- 172.21.15.150:0/1875398522 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe3600b1220 0x7fe36014a590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:50:14.023 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:14.010+0000 7fe36660e640 1 --2- 172.21.15.150:0/1875398522 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fe34c07a210 0x7fe34c07c720 unknown :-1 s=CLOSED pgs=559 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:50:14.023 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:14.010+0000 7fe36660e640 1 --2- 172.21.15.150:0/1875398522 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe3601f6120 0x7fe3601f6530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:50:14.023 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:14.010+0000 7fe36660e640 1 --2- 172.21.15.150:0/1875398522 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe348003a00 0x7fe3600b4dd0 unknown :-1 s=CLOSED pgs=1295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:50:14.023 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:14.010+0000 7fe36660e640 1 -- 172.21.15.150:0/1875398522 >> 172.21.15.150:0/1875398522 conn(0x7fe36008bfe0 msgr2=0x7fe360068e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:50:14.023 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:14.010+0000 7fe36660e640 1 -- 172.21.15.150:0/1875398522 shutdown_connections 2024-09-17T05:50:14.023 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:14.010+0000 7fe36660e640 1 -- 172.21.15.150:0/1875398522 wait complete. 2024-09-17T05:50:14.024 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-09-17T05:50:14.138 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:14.137+0000 7ff46dab6640 1 -- 172.21.15.150:0/2588494119 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff4680cd040 msgr2=0x7ff4681528b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:50:14.138 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:14.137+0000 7ff46dab6640 1 --2- 172.21.15.150:0/2588494119 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff4680cd040 0x7ff4681528b0 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7ff458009830 tx=0x7ff45802a4a0 comp rx=0 tx=0).stop 2024-09-17T05:50:14.139 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:14.137+0000 7ff46dab6640 1 -- 172.21.15.150:0/2588494119 shutdown_connections 2024-09-17T05:50:14.139 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:14.137+0000 7ff46dab6640 1 --2- 172.21.15.150:0/2588494119 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff46815f330 0x7ff46815f740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:50:14.139 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:14.137+0000 7ff46dab6640 1 --2- 172.21.15.150:0/2588494119 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff4680cd040 0x7ff4681528b0 unknown :-1 s=CLOSED pgs=455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:50:14.139 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:14.137+0000 7ff46dab6640 1 -- 172.21.15.150:0/2588494119 >> 172.21.15.150:0/2588494119 conn(0x7ff4680d0b50 msgr2=0x7ff4680d0f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:50:14.139 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:14.137+0000 7ff46dab6640 1 -- 172.21.15.150:0/2588494119 shutdown_connections 2024-09-17T05:50:14.139 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:14.137+0000 7ff46dab6640 1 -- 172.21.15.150:0/2588494119 wait complete. 2024-09-17T05:50:14.139 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:14.139+0000 7ff46dab6640 1 Processor -- start 2024-09-17T05:50:14.140 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:14.139+0000 7ff46dab6640 1 -- start start 2024-09-17T05:50:14.142 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:14.140+0000 7ff46dab6640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff4680cd040 0x7ff46813f580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:50:14.142 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:14.140+0000 7ff46dab6640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff46815f330 0x7ff46813ee50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:50:14.143 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:14.140+0000 7ff46dab6640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff46815fc80 0x7ff46815ac60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:50:14.143 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:14.140+0000 7ff46dab6640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7ff46815c450 con 0x7ff46815f330 2024-09-17T05:50:14.143 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:14.140+0000 7ff46dab6640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7ff4680718b0 con 0x7ff46815fc80 2024-09-17T05:50:14.143 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:14.140+0000 7ff46dab6640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7ff46815c5d0 con 0x7ff4680cd040 2024-09-17T05:50:14.143 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:14.141+0000 7ff466ffd640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff46815f330 0x7ff46813ee50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:50:14.143 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:14.141+0000 7ff466ffd640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff46815f330 0x7ff46813ee50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:58970/0 (socket says 172.21.15.150:58970) 2024-09-17T05:50:14.143 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:14.141+0000 7ff466ffd640 1 -- 172.21.15.150:0/1497351288 learned_addr learned my addr 172.21.15.150:0/1497351288 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:50:14.143 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:14.141+0000 7ff4677fe640 1 --2- 172.21.15.150:0/1497351288 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff4680cd040 0x7ff46813f580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:50:14.143 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:14.141+0000 7ff467fff640 1 --2- 172.21.15.150:0/1497351288 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff46815fc80 0x7ff46815ac60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:50:14.143 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:14.141+0000 7ff466ffd640 1 -- 172.21.15.150:0/1497351288 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff4680cd040 msgr2=0x7ff46813f580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:50:14.143 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:14.141+0000 7ff466ffd640 1 --2- 172.21.15.150:0/1497351288 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff4680cd040 0x7ff46813f580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:50:14.143 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:14.141+0000 7ff466ffd640 1 -- 172.21.15.150:0/1497351288 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff46815fc80 msgr2=0x7ff46815ac60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:50:14.143 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:14.141+0000 7ff466ffd640 1 --2- 172.21.15.150:0/1497351288 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff46815fc80 0x7ff46815ac60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:50:14.144 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:14.141+0000 7ff466ffd640 1 -- 172.21.15.150:0/1497351288 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff468153550 con 0x7ff46815f330 2024-09-17T05:50:14.144 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:14.141+0000 7ff466ffd640 1 --2- 172.21.15.150:0/1497351288 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff46815f330 0x7ff46813ee50 secure :-1 s=READY pgs=1297 cs=0 l=1 rev1=1 crypto rx=0x7ff45c00e9f0 tx=0x7ff45c00eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:50:14.144 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:14.141+0000 7ff44ffff640 1 -- 172.21.15.150:0/1497351288 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff45c00cd80 con 0x7ff46815f330 2024-09-17T05:50:14.144 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:14.141+0000 7ff44ffff640 1 -- 172.21.15.150:0/1497351288 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff45c004020 con 0x7ff46815f330 2024-09-17T05:50:14.144 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:14.141+0000 7ff46dab6640 1 -- 172.21.15.150:0/1497351288 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff468152f90 con 0x7ff46815f330 2024-09-17T05:50:14.144 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:14.141+0000 7ff44ffff640 1 -- 172.21.15.150:0/1497351288 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff45c004470 con 0x7ff46815f330 2024-09-17T05:50:14.144 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:14.141+0000 7ff46dab6640 1 -- 172.21.15.150:0/1497351288 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff46813fb50 con 0x7ff46815f330 2024-09-17T05:50:14.145 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:14.142+0000 7ff46dab6640 1 -- 172.21.15.150:0/1497351288 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff468155eb0 con 0x7ff46815f330 2024-09-17T05:50:14.145 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:14.143+0000 7ff44ffff640 1 -- 172.21.15.150:0/1497351288 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 32) ==== 103481+0+0 (secure 0 0 0) 0x7ff45c0035f0 con 0x7ff46815f330 2024-09-17T05:50:14.145 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:14.144+0000 7ff44ffff640 1 --2- 172.21.15.150:0/1497351288 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7ff45407a210 0x7ff45407c720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:50:14.145 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:14.144+0000 7ff44ffff640 1 -- 172.21.15.150:0/1497351288 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(97..97 src has 1..97) ==== 4969+0+0 (secure 0 0 0) 0x7ff45c09a230 con 0x7ff46815f330 2024-09-17T05:50:14.145 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:14.144+0000 7ff4677fe640 1 --2- 172.21.15.150:0/1497351288 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7ff45407a210 0x7ff45407c720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:50:14.145 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:14.144+0000 7ff4677fe640 1 --2- 172.21.15.150:0/1497351288 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7ff45407a210 0x7ff45407c720 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7ff458034000 tx=0x7ff458004730 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:50:14.149 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:14.148+0000 7ff44ffff640 1 -- 172.21.15.150:0/1497351288 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7ff45c063b20 con 0x7ff46815f330 2024-09-17T05:50:14.328 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:14.327+0000 7ff46dab6640 1 -- 172.21.15.150:0/1497351288 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7ff46815a550 con 0x7ff46815f330 2024-09-17T05:50:14.328 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:14.327+0000 7ff44ffff640 1 -- 172.21.15.150:0/1497351288 <== mon.0 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v97) ==== 84+0+65 (secure 0 0 0) 0x7ff45c068550 con 0x7ff46815f330 2024-09-17T05:50:14.328 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-09-17T05:50:14.328 INFO:teuthology.orchestra.run.smithi150.stdout:[ 2024-09-17T05:50:14.328 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-09-17T05:50:14.328 INFO:teuthology.orchestra.run.smithi150.stdout: "poolnum": 1, 2024-09-17T05:50:14.329 INFO:teuthology.orchestra.run.smithi150.stdout: "poolname": ".mgr" 2024-09-17T05:50:14.329 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-09-17T05:50:14.329 INFO:teuthology.orchestra.run.smithi150.stdout:] 2024-09-17T05:50:14.330 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:14.329+0000 7ff46dab6640 1 -- 172.21.15.150:0/1497351288 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7ff45407a210 msgr2=0x7ff45407c720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:50:14.330 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:14.329+0000 7ff46dab6640 1 --2- 172.21.15.150:0/1497351288 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7ff45407a210 0x7ff45407c720 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7ff458034000 tx=0x7ff458004730 comp rx=0 tx=0).stop 2024-09-17T05:50:14.331 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:14.329+0000 7ff46dab6640 1 -- 172.21.15.150:0/1497351288 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff46815f330 msgr2=0x7ff46813ee50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:50:14.331 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:14.329+0000 7ff46dab6640 1 --2- 172.21.15.150:0/1497351288 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff46815f330 0x7ff46813ee50 secure :-1 s=READY pgs=1297 cs=0 l=1 rev1=1 crypto rx=0x7ff45c00e9f0 tx=0x7ff45c00eeb0 comp rx=0 tx=0).stop 2024-09-17T05:50:14.331 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:14.330+0000 7ff46dab6640 1 -- 172.21.15.150:0/1497351288 shutdown_connections 2024-09-17T05:50:14.331 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:14.330+0000 7ff46dab6640 1 --2- 172.21.15.150:0/1497351288 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff46815fc80 0x7ff46815ac60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:50:14.331 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:14.330+0000 7ff46dab6640 1 --2- 172.21.15.150:0/1497351288 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7ff45407a210 0x7ff45407c720 unknown :-1 s=CLOSED pgs=560 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:50:14.331 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:14.330+0000 7ff46dab6640 1 --2- 172.21.15.150:0/1497351288 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff46815f330 0x7ff46813ee50 unknown :-1 s=CLOSED pgs=1297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:50:14.331 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:14.330+0000 7ff46dab6640 1 --2- 172.21.15.150:0/1497351288 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff4680cd040 0x7ff46813f580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:50:14.331 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:14.330+0000 7ff46dab6640 1 -- 172.21.15.150:0/1497351288 >> 172.21.15.150:0/1497351288 conn(0x7ff4680d0b50 msgr2=0x7ff4680b0810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:50:14.331 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:14.330+0000 7ff46dab6640 1 -- 172.21.15.150:0/1497351288 shutdown_connections 2024-09-17T05:50:14.331 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:14.330+0000 7ff46dab6640 1 -- 172.21.15.150:0/1497351288 wait complete. 2024-09-17T05:50:14.342 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-09-17T05:50:14.342 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-09-17T05:50:14.461 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:14.460+0000 7f4ec0590640 1 -- 172.21.15.150:0/1429854995 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4ea4004800 msgr2=0x7f4ea4004c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:50:14.461 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:14.460+0000 7f4ec0590640 1 --2- 172.21.15.150:0/1429854995 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4ea4004800 0x7f4ea4004c10 secure :-1 s=READY pgs=1299 cs=0 l=1 rev1=1 crypto rx=0x7f4ea80016c0 tx=0x7f4ea4005830 comp rx=0 tx=0).stop 2024-09-17T05:50:14.461 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:14.460+0000 7f4ec0590640 1 -- 172.21.15.150:0/1429854995 shutdown_connections 2024-09-17T05:50:14.461 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:14.460+0000 7f4ec0590640 1 --2- 172.21.15.150:0/1429854995 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4ea4004800 0x7f4ea4004c10 unknown :-1 s=CLOSED pgs=1299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:50:14.461 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:14.460+0000 7f4ec0590640 1 -- 172.21.15.150:0/1429854995 >> 172.21.15.150:0/1429854995 conn(0x7f4eb809aa50 msgr2=0x7f4eb80b2ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:50:14.461 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:14.460+0000 7f4ec0590640 1 -- 172.21.15.150:0/1429854995 shutdown_connections 2024-09-17T05:50:14.461 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:14.460+0000 7f4ec0590640 1 -- 172.21.15.150:0/1429854995 wait complete. 2024-09-17T05:50:14.462 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:14.462+0000 7f4ec0590640 1 Processor -- start 2024-09-17T05:50:14.462 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:14.462+0000 7f4ec0590640 1 -- start start 2024-09-17T05:50:14.465 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:14.463+0000 7f4ec0590640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4ea4004800 0x7f4eb8144880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:50:14.465 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:14.463+0000 7f4ec0590640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4eb81f3390 0x7f4eb81f0630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:50:14.465 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:14.463+0000 7f4ec0590640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4eb81f37a0 0x7f4eb8141c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:50:14.465 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:14.463+0000 7f4ec0590640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f4eb815bf20 con 0x7f4eb81f3390 2024-09-17T05:50:14.465 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:14.463+0000 7f4ec0590640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f4eb815bda0 con 0x7f4eb81f37a0 2024-09-17T05:50:14.466 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:14.463+0000 7f4ec0590640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f4eb815c0a0 con 0x7f4ea4004800 2024-09-17T05:50:14.466 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:14.463+0000 7f4ebdb2b640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4eb81f3390 0x7f4eb81f0630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:50:14.466 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:14.463+0000 7f4ebdb2b640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4eb81f3390 0x7f4eb81f0630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:59000/0 (socket says 172.21.15.150:59000) 2024-09-17T05:50:14.466 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:14.463+0000 7f4ebdb2b640 1 -- 172.21.15.150:0/931035751 learned_addr learned my addr 172.21.15.150:0/931035751 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:50:14.466 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:14.463+0000 7f4ebeb2d640 1 --2- 172.21.15.150:0/931035751 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4eb81f37a0 0x7f4eb8141c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:50:14.466 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:14.463+0000 7f4ebe32c640 1 --2- 172.21.15.150:0/931035751 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4ea4004800 0x7f4eb8144880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:50:14.466 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:14.463+0000 7f4ebdb2b640 1 -- 172.21.15.150:0/931035751 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4ea4004800 msgr2=0x7f4eb8144880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:50:14.466 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:14.463+0000 7f4ebdb2b640 1 --2- 172.21.15.150:0/931035751 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4ea4004800 0x7f4eb8144880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:50:14.466 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:14.463+0000 7f4ebdb2b640 1 -- 172.21.15.150:0/931035751 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4eb81f37a0 msgr2=0x7f4eb8141c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:50:14.466 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:14.463+0000 7f4ebdb2b640 1 --2- 172.21.15.150:0/931035751 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4eb81f37a0 0x7f4eb8141c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:50:14.466 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:14.463+0000 7f4ebdb2b640 1 -- 172.21.15.150:0/931035751 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4eb81f4250 con 0x7f4eb81f3390 2024-09-17T05:50:14.466 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:14.464+0000 7f4ebdb2b640 1 --2- 172.21.15.150:0/931035751 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4eb81f3390 0x7f4eb81f0630 secure :-1 s=READY pgs=1300 cs=0 l=1 rev1=1 crypto rx=0x7f4ea80017e0 tx=0x7f4ea80063a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:50:14.466 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:14.464+0000 7f4eaeffd640 1 -- 172.21.15.150:0/931035751 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ea8041070 con 0x7f4eb81f3390 2024-09-17T05:50:14.467 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:14.464+0000 7f4eaeffd640 1 -- 172.21.15.150:0/931035751 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f4ea8003af0 con 0x7f4eb81f3390 2024-09-17T05:50:14.467 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:14.464+0000 7f4ec0590640 1 -- 172.21.15.150:0/931035751 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4eb81f6c30 con 0x7f4eb81f3390 2024-09-17T05:50:14.467 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:14.464+0000 7f4eaeffd640 1 -- 172.21.15.150:0/931035751 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ea8038070 con 0x7f4eb81f3390 2024-09-17T05:50:14.467 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:14.464+0000 7f4ec0590640 1 -- 172.21.15.150:0/931035751 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4eb8143da0 con 0x7f4eb81f3390 2024-09-17T05:50:14.467 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:14.465+0000 7f4ec0590640 1 -- 172.21.15.150:0/931035751 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4eb80d2240 con 0x7f4eb81f3390 2024-09-17T05:50:14.468 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:14.466+0000 7f4eaeffd640 1 -- 172.21.15.150:0/931035751 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 32) ==== 103481+0+0 (secure 0 0 0) 0x7f4ea8044070 con 0x7f4eb81f3390 2024-09-17T05:50:14.468 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:14.466+0000 7f4eaeffd640 1 --2- 172.21.15.150:0/931035751 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f4e9c07a210 0x7f4e9c07c720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:50:14.468 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:14.466+0000 7f4eaeffd640 1 -- 172.21.15.150:0/931035751 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(97..97 src has 1..97) ==== 4969+0+0 (secure 0 0 0) 0x7f4ea80b9390 con 0x7f4eb81f3390 2024-09-17T05:50:14.468 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:14.467+0000 7f4ebe32c640 1 --2- 172.21.15.150:0/931035751 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f4e9c07a210 0x7f4e9c07c720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:50:14.468 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:14.467+0000 7f4ebe32c640 1 --2- 172.21.15.150:0/931035751 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f4e9c07a210 0x7f4e9c07c720 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7f4eb815d5a0 tx=0x7f4eb40067a0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:50:14.474 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:14.471+0000 7f4eaeffd640 1 -- 172.21.15.150:0/931035751 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f4eb80d2240 con 0x7f4eb81f3390 2024-09-17T05:50:14.648 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:14.647+0000 7f4ec0590640 1 -- 172.21.15.150:0/931035751 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7f4eb81f3d00 con 0x7f4eb81f3390 2024-09-17T05:50:15.650 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:15.649+0000 7f4eaeffd640 1 -- 172.21.15.150:0/931035751 <== mon.0 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v98) ==== 138+0+0 (secure 0 0 0) 0x7f4ea80832d0 con 0x7f4eb81f3390 2024-09-17T05:50:15.650 INFO:teuthology.orchestra.run.smithi150.stderr:pool 'cephfs_metadata' created 2024-09-17T05:50:15.654 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:15.653+0000 7f4ec0590640 1 -- 172.21.15.150:0/931035751 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f4e9c07a210 msgr2=0x7f4e9c07c720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:50:15.654 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:15.653+0000 7f4ec0590640 1 --2- 172.21.15.150:0/931035751 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f4e9c07a210 0x7f4e9c07c720 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7f4eb815d5a0 tx=0x7f4eb40067a0 comp rx=0 tx=0).stop 2024-09-17T05:50:15.654 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:15.653+0000 7f4ec0590640 1 -- 172.21.15.150:0/931035751 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4eb81f3390 msgr2=0x7f4eb81f0630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:50:15.654 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:15.653+0000 7f4ec0590640 1 --2- 172.21.15.150:0/931035751 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4eb81f3390 0x7f4eb81f0630 secure :-1 s=READY pgs=1300 cs=0 l=1 rev1=1 crypto rx=0x7f4ea80017e0 tx=0x7f4ea80063a0 comp rx=0 tx=0).stop 2024-09-17T05:50:15.654 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:15.653+0000 7f4ec0590640 1 -- 172.21.15.150:0/931035751 shutdown_connections 2024-09-17T05:50:15.654 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:15.653+0000 7f4ec0590640 1 --2- 172.21.15.150:0/931035751 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4eb81f37a0 0x7f4eb8141c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:50:15.654 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:15.653+0000 7f4ec0590640 1 --2- 172.21.15.150:0/931035751 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f4e9c07a210 0x7f4e9c07c720 unknown :-1 s=CLOSED pgs=561 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:50:15.654 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:15.653+0000 7f4ec0590640 1 --2- 172.21.15.150:0/931035751 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4eb81f3390 0x7f4eb81f0630 unknown :-1 s=CLOSED pgs=1300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:50:15.655 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:15.653+0000 7f4ec0590640 1 --2- 172.21.15.150:0/931035751 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4ea4004800 0x7f4eb8144880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:50:15.655 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:15.653+0000 7f4ec0590640 1 -- 172.21.15.150:0/931035751 >> 172.21.15.150:0/931035751 conn(0x7f4eb809aa50 msgr2=0x7f4eb815e350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:50:15.655 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:15.653+0000 7f4ec0590640 1 -- 172.21.15.150:0/931035751 shutdown_connections 2024-09-17T05:50:15.655 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:15.653+0000 7f4ec0590640 1 -- 172.21.15.150:0/931035751 wait complete. 2024-09-17T05:50:15.674 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-09-17T05:50:15.801 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:15.800+0000 7f8a0615e640 1 -- 172.21.15.150:0/3838349042 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8a0015fa30 msgr2=0x7f8a0015fe40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:50:15.802 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:15.800+0000 7f8a0615e640 1 --2- 172.21.15.150:0/3838349042 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8a0015fa30 0x7f8a0015fe40 secure :-1 s=READY pgs=1301 cs=0 l=1 rev1=1 crypto rx=0x7f8a00072b00 tx=0x7f89f802a8f0 comp rx=0 tx=0).stop 2024-09-17T05:50:15.802 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:15.801+0000 7f8a0615e640 1 -- 172.21.15.150:0/3838349042 shutdown_connections 2024-09-17T05:50:15.802 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:15.801+0000 7f8a0615e640 1 --2- 172.21.15.150:0/3838349042 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8a0015fa30 0x7f8a0015fe40 unknown :-1 s=CLOSED pgs=1301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:50:15.802 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:15.801+0000 7f8a0615e640 1 --2- 172.21.15.150:0/3838349042 >> v2:172.21.15.176:3300/0 conn(0x7f8a000b0fe0 0x7f8a000b13f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:50:15.802 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:15.801+0000 7f8a0615e640 1 --2- 172.21.15.150:0/3838349042 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8a000b25e0 0x7f8a000b1ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:50:15.802 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:15.801+0000 7f8a0615e640 1 -- 172.21.15.150:0/3838349042 >> 172.21.15.150:0/3838349042 conn(0x7f8a000b2ff0 msgr2=0x7f8a000b3400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:50:15.802 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:15.801+0000 7f8a0615e640 1 -- 172.21.15.150:0/3838349042 shutdown_connections 2024-09-17T05:50:15.802 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:15.801+0000 7f8a0615e640 1 -- 172.21.15.150:0/3838349042 wait complete. 2024-09-17T05:50:15.803 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:15.802+0000 7f8a0615e640 1 Processor -- start 2024-09-17T05:50:15.803 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:15.803+0000 7f8a0615e640 1 -- start start 2024-09-17T05:50:15.806 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:15.804+0000 7f8a0615e640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8a000b0fe0 0x7f8a00150db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:50:15.806 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:15.804+0000 7f8a0615e640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8a000b25e0 0x7f8a000ce480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:50:15.806 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:15.804+0000 7f8a0615e640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8a0015fa30 0x7f8a0006cda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:50:15.806 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:15.804+0000 7f8a0615e640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f8a000cf510 con 0x7f8a0015fa30 2024-09-17T05:50:15.807 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:15.804+0000 7f8a0615e640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f8a000cf390 con 0x7f8a000b25e0 2024-09-17T05:50:15.807 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:15.804+0000 7f8a0615e640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f8a000cf690 con 0x7f8a000b0fe0 2024-09-17T05:50:15.807 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:15.804+0000 7f89fffff640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8a0015fa30 0x7f8a0006cda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:50:15.807 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:15.804+0000 7f89fffff640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8a0015fa30 0x7f8a0006cda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:59020/0 (socket says 172.21.15.150:59020) 2024-09-17T05:50:15.807 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:15.804+0000 7f89fffff640 1 -- 172.21.15.150:0/3243007968 learned_addr learned my addr 172.21.15.150:0/3243007968 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:50:15.807 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:15.804+0000 7f89feffd640 1 --2- 172.21.15.150:0/3243007968 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8a000b25e0 0x7f8a000ce480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:50:15.807 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:15.804+0000 7f89ff7fe640 1 --2- 172.21.15.150:0/3243007968 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8a000b0fe0 0x7f8a00150db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:50:15.807 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:15.804+0000 7f89fffff640 1 -- 172.21.15.150:0/3243007968 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8a000b0fe0 msgr2=0x7f8a00150db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:50:15.807 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:15.804+0000 7f89fffff640 1 --2- 172.21.15.150:0/3243007968 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8a000b0fe0 0x7f8a00150db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:50:15.807 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:15.804+0000 7f89fffff640 1 -- 172.21.15.150:0/3243007968 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8a000b25e0 msgr2=0x7f8a000ce480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:50:15.807 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:15.804+0000 7f89fffff640 1 --2- 172.21.15.150:0/3243007968 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8a000b25e0 0x7f8a000ce480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:50:15.807 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:15.804+0000 7f89fffff640 1 -- 172.21.15.150:0/3243007968 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8a001f6fb0 con 0x7f8a0015fa30 2024-09-17T05:50:15.808 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:15.805+0000 7f89fffff640 1 --2- 172.21.15.150:0/3243007968 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8a0015fa30 0x7f8a0006cda0 secure :-1 s=READY pgs=1302 cs=0 l=1 rev1=1 crypto rx=0x7f89f8009d60 tx=0x7f89f8003ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:50:15.808 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:15.805+0000 7f89e7fff640 1 -- 172.21.15.150:0/3243007968 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89f8004040 con 0x7f8a0015fa30 2024-09-17T05:50:15.808 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:15.805+0000 7f89e7fff640 1 -- 172.21.15.150:0/3243007968 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f89f802d070 con 0x7f8a0015fa30 2024-09-17T05:50:15.808 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:15.805+0000 7f8a0615e640 1 -- 172.21.15.150:0/3243007968 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8a001f7bc0 con 0x7f8a0015fa30 2024-09-17T05:50:15.808 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:15.805+0000 7f89e7fff640 1 -- 172.21.15.150:0/3243007968 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89f8004460 con 0x7f8a0015fa30 2024-09-17T05:50:15.808 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:15.805+0000 7f8a0615e640 1 -- 172.21.15.150:0/3243007968 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8a001f7570 con 0x7f8a0015fa30 2024-09-17T05:50:15.808 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:15.806+0000 7f8a0615e640 1 -- 172.21.15.150:0/3243007968 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8a000b1ec0 con 0x7f8a0015fa30 2024-09-17T05:50:15.809 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:15.807+0000 7f89e7fff640 1 -- 172.21.15.150:0/3243007968 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 32) ==== 103481+0+0 (secure 0 0 0) 0x7f89f8004600 con 0x7f8a0015fa30 2024-09-17T05:50:15.809 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:15.807+0000 7f89e7fff640 1 --2- 172.21.15.150:0/3243007968 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f89ec07a210 0x7f89ec07c720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:50:15.809 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:15.807+0000 7f89e7fff640 1 -- 172.21.15.150:0/3243007968 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(98..98 src has 1..98) ==== 5339+0+0 (secure 0 0 0) 0x7f89f80bb100 con 0x7f8a0015fa30 2024-09-17T05:50:15.809 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:15.807+0000 7f89ff7fe640 1 --2- 172.21.15.150:0/3243007968 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f89ec07a210 0x7f89ec07c720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:50:15.809 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:15.808+0000 7f89ff7fe640 1 --2- 172.21.15.150:0/3243007968 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f89ec07a210 0x7f89ec07c720 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7f89f0009b30 tx=0x7f89f0005f90 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:50:15.813 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:15.812+0000 7f89e7fff640 1 -- 172.21.15.150:0/3243007968 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f89f8084a80 con 0x7f8a0015fa30 2024-09-17T05:50:15.989 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:15.989+0000 7f8a0615e640 1 -- 172.21.15.150:0/3243007968 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7f8a001f6d20 con 0x7f8a0015fa30 2024-09-17T05:50:16.652 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:16.651+0000 7f89e7fff640 1 -- 172.21.15.150:0/3243007968 <== mon.0 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v99) ==== 170+0+0 (secure 0 0 0) 0x7f89f80894b0 con 0x7f8a0015fa30 2024-09-17T05:50:16.652 INFO:teuthology.orchestra.run.smithi150.stderr:pool 'cephfs_data' created 2024-09-17T05:50:16.655 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:16.654+0000 7f8a0615e640 1 -- 172.21.15.150:0/3243007968 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f89ec07a210 msgr2=0x7f89ec07c720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:50:16.655 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:16.654+0000 7f8a0615e640 1 --2- 172.21.15.150:0/3243007968 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f89ec07a210 0x7f89ec07c720 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7f89f0009b30 tx=0x7f89f0005f90 comp rx=0 tx=0).stop 2024-09-17T05:50:16.655 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:16.654+0000 7f8a0615e640 1 -- 172.21.15.150:0/3243007968 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8a0015fa30 msgr2=0x7f8a0006cda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:50:16.655 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:16.654+0000 7f8a0615e640 1 --2- 172.21.15.150:0/3243007968 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8a0015fa30 0x7f8a0006cda0 secure :-1 s=READY pgs=1302 cs=0 l=1 rev1=1 crypto rx=0x7f89f8009d60 tx=0x7f89f8003ba0 comp rx=0 tx=0).stop 2024-09-17T05:50:16.655 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:16.654+0000 7f8a0615e640 1 -- 172.21.15.150:0/3243007968 shutdown_connections 2024-09-17T05:50:16.655 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:16.654+0000 7f8a0615e640 1 --2- 172.21.15.150:0/3243007968 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8a000b25e0 0x7f8a000ce480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:50:16.656 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:16.654+0000 7f8a0615e640 1 --2- 172.21.15.150:0/3243007968 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f89ec07a210 0x7f89ec07c720 unknown :-1 s=CLOSED pgs=562 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:50:16.656 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:16.654+0000 7f8a0615e640 1 --2- 172.21.15.150:0/3243007968 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8a0015fa30 0x7f8a0006cda0 unknown :-1 s=CLOSED pgs=1302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:50:16.656 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:16.654+0000 7f8a0615e640 1 --2- 172.21.15.150:0/3243007968 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8a000b0fe0 0x7f8a00150db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:50:16.656 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:16.654+0000 7f8a0615e640 1 -- 172.21.15.150:0/3243007968 >> 172.21.15.150:0/3243007968 conn(0x7f8a000b2ff0 msgr2=0x7f8a000b3400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:50:16.656 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:16.654+0000 7f8a0615e640 1 -- 172.21.15.150:0/3243007968 shutdown_connections 2024-09-17T05:50:16.656 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:16.654+0000 7f8a0615e640 1 -- 172.21.15.150:0/3243007968 wait complete. 2024-09-17T05:50:16.682 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-09-17T05:50:16.801 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:16.799+0000 7f4f84be4640 1 -- 172.21.15.150:0/2622833017 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4f68004800 msgr2=0x7f4f68004c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:50:16.801 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:16.799+0000 7f4f84be4640 1 --2- 172.21.15.150:0/2622833017 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4f68004800 0x7f4f68004c10 secure :-1 s=READY pgs=1304 cs=0 l=1 rev1=1 crypto rx=0x7f4f800d35a0 tx=0x7f4f68005830 comp rx=0 tx=0).stop 2024-09-17T05:50:16.801 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:16.800+0000 7f4f84be4640 1 -- 172.21.15.150:0/2622833017 shutdown_connections 2024-09-17T05:50:16.801 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:16.800+0000 7f4f84be4640 1 --2- 172.21.15.150:0/2622833017 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4f68004800 0x7f4f68004c10 unknown :-1 s=CLOSED pgs=1304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:50:16.801 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:16.800+0000 7f4f84be4640 1 -- 172.21.15.150:0/2622833017 >> 172.21.15.150:0/2622833017 conn(0x7f4f800cef20 msgr2=0x7f4f800cf330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:50:16.801 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:16.800+0000 7f4f84be4640 1 -- 172.21.15.150:0/2622833017 shutdown_connections 2024-09-17T05:50:16.801 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:16.800+0000 7f4f84be4640 1 -- 172.21.15.150:0/2622833017 wait complete. 2024-09-17T05:50:16.802 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:16.802+0000 7f4f84be4640 1 Processor -- start 2024-09-17T05:50:16.802 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:16.802+0000 7f4f84be4640 1 -- start start 2024-09-17T05:50:16.805 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:16.803+0000 7f4f84be4640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4f68004800 0x7f4f801f77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:50:16.805 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:16.803+0000 7f4f84be4640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4f801f2ff0 0x7f4f8015fc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:50:16.805 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:16.803+0000 7f4f84be4640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4f80160190 0x7f4f801520c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:50:16.805 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:16.803+0000 7f4f84be4640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f4f800ced10 con 0x7f4f80160190 2024-09-17T05:50:16.805 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:16.803+0000 7f4f84be4640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f4f800ceb90 con 0x7f4f68004800 2024-09-17T05:50:16.805 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:16.803+0000 7f4f84be4640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f4f800d0a80 con 0x7f4f801f2ff0 2024-09-17T05:50:16.805 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:16.803+0000 7f4f7ed9d640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4f80160190 0x7f4f801520c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:50:16.805 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:16.803+0000 7f4f7ed9d640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4f80160190 0x7f4f801520c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:59042/0 (socket says 172.21.15.150:59042) 2024-09-17T05:50:16.805 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:16.803+0000 7f4f7ed9d640 1 -- 172.21.15.150:0/996242673 learned_addr learned my addr 172.21.15.150:0/996242673 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:50:16.805 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:16.803+0000 7f4f7dd9b640 1 --2- 172.21.15.150:0/996242673 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4f801f2ff0 0x7f4f8015fc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:50:16.806 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:16.803+0000 7f4f7e59c640 1 --2- 172.21.15.150:0/996242673 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4f68004800 0x7f4f801f77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:50:16.806 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:16.803+0000 7f4f7ed9d640 1 -- 172.21.15.150:0/996242673 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4f801f2ff0 msgr2=0x7f4f8015fc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:50:16.806 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:16.803+0000 7f4f7ed9d640 1 --2- 172.21.15.150:0/996242673 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4f801f2ff0 0x7f4f8015fc50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:50:16.806 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:16.803+0000 7f4f7ed9d640 1 -- 172.21.15.150:0/996242673 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4f68004800 msgr2=0x7f4f801f77a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:50:16.806 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:16.803+0000 7f4f7ed9d640 1 --2- 172.21.15.150:0/996242673 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4f68004800 0x7f4f801f77a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:50:16.806 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:16.803+0000 7f4f7ed9d640 1 -- 172.21.15.150:0/996242673 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4f801605a0 con 0x7f4f80160190 2024-09-17T05:50:16.806 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:16.803+0000 7f4f7e59c640 1 --2- 172.21.15.150:0/996242673 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4f68004800 0x7f4f801f77a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T05:50:16.806 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:16.804+0000 7f4f7ed9d640 1 --2- 172.21.15.150:0/996242673 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4f80160190 0x7f4f801520c0 secure :-1 s=READY pgs=1305 cs=0 l=1 rev1=1 crypto rx=0x7f4f800d00b0 tx=0x7f4f78011c60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:50:16.806 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:16.804+0000 7f4f6effd640 1 -- 172.21.15.150:0/996242673 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f78004440 con 0x7f4f80160190 2024-09-17T05:50:16.806 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:16.804+0000 7f4f84be4640 1 -- 172.21.15.150:0/996242673 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4f80151900 con 0x7f4f80160190 2024-09-17T05:50:16.806 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:16.804+0000 7f4f6effd640 1 -- 172.21.15.150:0/996242673 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f4f7800f920 con 0x7f4f80160190 2024-09-17T05:50:16.806 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:16.804+0000 7f4f6effd640 1 -- 172.21.15.150:0/996242673 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f7800fd70 con 0x7f4f80160190 2024-09-17T05:50:16.806 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:16.804+0000 7f4f84be4640 1 -- 172.21.15.150:0/996242673 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4f80155f30 con 0x7f4f80160190 2024-09-17T05:50:16.807 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:16.805+0000 7f4f84be4640 1 -- 172.21.15.150:0/996242673 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4f800d1fd0 con 0x7f4f80160190 2024-09-17T05:50:16.807 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:16.806+0000 7f4f6effd640 1 -- 172.21.15.150:0/996242673 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 32) ==== 103481+0+0 (secure 0 0 0) 0x7f4f78005020 con 0x7f4f80160190 2024-09-17T05:50:16.807 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:16.806+0000 7f4f6effd640 1 --2- 172.21.15.150:0/996242673 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f4f6007a210 0x7f4f6007c720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:50:16.808 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:16.806+0000 7f4f6effd640 1 -- 172.21.15.150:0/996242673 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 5721+0+0 (secure 0 0 0) 0x7f4f7809a620 con 0x7f4f80160190 2024-09-17T05:50:16.808 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:16.807+0000 7f4f7e59c640 1 --2- 172.21.15.150:0/996242673 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f4f6007a210 0x7f4f6007c720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:50:16.808 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:16.807+0000 7f4f7e59c640 1 --2- 172.21.15.150:0/996242673 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f4f6007a210 0x7f4f6007c720 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7f4f70002170 tx=0x7f4f70001250 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:50:16.811 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:16.810+0000 7f4f6effd640 1 -- 172.21.15.150:0/996242673 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f4f800d1fd0 con 0x7f4f80160190 2024-09-17T05:50:17.022 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:17.021+0000 7f4f84be4640 1 -- 172.21.15.150:0/996242673 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7f4f801559e0 con 0x7f4f80160190 2024-09-17T05:50:17.678 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:17.677+0000 7f4f6effd640 1 -- 172.21.15.150:0/996242673 <== mon.0 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 14 and data pool 15 v56) ==== 174+0+0 (secure 0 0 0) 0x7f4f78020070 con 0x7f4f80160190 2024-09-17T05:50:17.678 INFO:teuthology.orchestra.run.smithi150.stderr:new fs with metadata pool 14 and data pool 15 2024-09-17T05:50:17.690 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:17.689+0000 7f4f84be4640 1 -- 172.21.15.150:0/996242673 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f4f6007a210 msgr2=0x7f4f6007c720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:50:17.690 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:17.689+0000 7f4f84be4640 1 --2- 172.21.15.150:0/996242673 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f4f6007a210 0x7f4f6007c720 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7f4f70002170 tx=0x7f4f70001250 comp rx=0 tx=0).stop 2024-09-17T05:50:17.690 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:17.689+0000 7f4f84be4640 1 -- 172.21.15.150:0/996242673 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4f80160190 msgr2=0x7f4f801520c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:50:17.691 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:17.690+0000 7f4f84be4640 1 --2- 172.21.15.150:0/996242673 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4f80160190 0x7f4f801520c0 secure :-1 s=READY pgs=1305 cs=0 l=1 rev1=1 crypto rx=0x7f4f800d00b0 tx=0x7f4f78011c60 comp rx=0 tx=0).stop 2024-09-17T05:50:17.691 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:17.690+0000 7f4f84be4640 1 -- 172.21.15.150:0/996242673 shutdown_connections 2024-09-17T05:50:17.691 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:17.690+0000 7f4f84be4640 1 --2- 172.21.15.150:0/996242673 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f4f6007a210 0x7f4f6007c720 unknown :-1 s=CLOSED pgs=563 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:50:17.691 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:17.690+0000 7f4f84be4640 1 --2- 172.21.15.150:0/996242673 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4f80160190 0x7f4f801520c0 unknown :-1 s=CLOSED pgs=1305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:50:17.691 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:17.690+0000 7f4f84be4640 1 --2- 172.21.15.150:0/996242673 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4f801f2ff0 0x7f4f8015fc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:50:17.691 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:17.690+0000 7f4f84be4640 1 --2- 172.21.15.150:0/996242673 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4f68004800 0x7f4f801f77a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:50:17.691 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:17.690+0000 7f4f84be4640 1 -- 172.21.15.150:0/996242673 >> 172.21.15.150:0/996242673 conn(0x7f4f800cef20 msgr2=0x7f4f800b30e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:50:17.692 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:17.691+0000 7f4f84be4640 1 -- 172.21.15.150:0/996242673 shutdown_connections 2024-09-17T05:50:17.692 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:17.691+0000 7f4f84be4640 1 -- 172.21.15.150:0/996242673 wait complete. 2024-09-17T05:50:17.710 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T05:50:17.825 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:17.824+0000 7f4a347ad640 1 -- 172.21.15.150:0/972756147 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4a18004d40 msgr2=0x7f4a18005150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:50:17.825 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:17.824+0000 7f4a347ad640 1 --2- 172.21.15.150:0/972756147 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4a18004d40 0x7f4a18005150 secure :-1 s=READY pgs=1307 cs=0 l=1 rev1=1 crypto rx=0x7f4a24006fd0 tx=0x7f4a18005830 comp rx=0 tx=0).stop 2024-09-17T05:50:17.825 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:17.824+0000 7f4a32d4a640 1 -- 172.21.15.150:0/972756147 reap_dead start 2024-09-17T05:50:17.826 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:17.824+0000 7f4a347ad640 1 -- 172.21.15.150:0/972756147 shutdown_connections 2024-09-17T05:50:17.826 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:17.824+0000 7f4a347ad640 1 -- 172.21.15.150:0/972756147 >> 172.21.15.150:0/972756147 conn(0x7f4a2c08bfe0 msgr2=0x7f4a2c0d4670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:50:17.826 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:17.824+0000 7f4a347ad640 1 -- 172.21.15.150:0/972756147 shutdown_connections 2024-09-17T05:50:17.826 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:17.824+0000 7f4a347ad640 1 -- 172.21.15.150:0/972756147 wait complete. 2024-09-17T05:50:17.826 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:17.826+0000 7f4a347ad640 1 Processor -- start 2024-09-17T05:50:17.827 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:17.826+0000 7f4a347ad640 1 -- start start 2024-09-17T05:50:17.830 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:17.827+0000 7f4a347ad640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4a18004d40 0x7f4a2c1565a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:50:17.830 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:17.827+0000 7f4a347ad640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4a2c154220 0x7f4a2c0b7d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:50:17.830 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:17.827+0000 7f4a347ad640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4a2c0b8240 0x7f4a2c1f9330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:50:17.830 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:17.827+0000 7f4a347ad640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f4a2c0b7640 con 0x7f4a18004d40 2024-09-17T05:50:17.830 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:17.827+0000 7f4a347ad640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f4a2c0b74c0 con 0x7f4a2c154220 2024-09-17T05:50:17.830 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:17.827+0000 7f4a347ad640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f4a2c0b77c0 con 0x7f4a2c0b8240 2024-09-17T05:50:17.830 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:17.827+0000 7f4a32549640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4a18004d40 0x7f4a2c1565a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:50:17.830 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:17.827+0000 7f4a32549640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4a18004d40 0x7f4a2c1565a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:59064/0 (socket says 172.21.15.150:59064) 2024-09-17T05:50:17.830 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:17.827+0000 7f4a32549640 1 -- 172.21.15.150:0/3833738515 learned_addr learned my addr 172.21.15.150:0/3833738515 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:50:17.830 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:17.828+0000 7f4a31d48640 1 --2- 172.21.15.150:0/3833738515 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4a2c154220 0x7f4a2c0b7d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:50:17.830 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:17.828+0000 7f4a32d4a640 1 --2- 172.21.15.150:0/3833738515 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4a2c0b8240 0x7f4a2c1f9330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:50:17.831 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:17.828+0000 7f4a32549640 1 -- 172.21.15.150:0/3833738515 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4a2c0b8240 msgr2=0x7f4a2c1f9330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:50:17.831 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:17.828+0000 7f4a32549640 1 --2- 172.21.15.150:0/3833738515 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4a2c0b8240 0x7f4a2c1f9330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:50:17.831 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:17.828+0000 7f4a32549640 1 -- 172.21.15.150:0/3833738515 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4a2c154220 msgr2=0x7f4a2c0b7d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:50:17.831 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:17.828+0000 7f4a32549640 1 --2- 172.21.15.150:0/3833738515 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4a2c154220 0x7f4a2c0b7d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:50:17.831 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:17.828+0000 7f4a32549640 1 -- 172.21.15.150:0/3833738515 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4a2c0b8650 con 0x7f4a18004d40 2024-09-17T05:50:17.831 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:17.828+0000 7f4a32549640 1 --2- 172.21.15.150:0/3833738515 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4a18004d40 0x7f4a2c1565a0 secure :-1 s=READY pgs=1308 cs=0 l=1 rev1=1 crypto rx=0x7f4a28011bf0 tx=0x7f4a28009f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:50:17.831 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:17.828+0000 7f4a22ffd640 1 -- 172.21.15.150:0/3833738515 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a2801e070 con 0x7f4a18004d40 2024-09-17T05:50:17.831 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:17.828+0000 7f4a22ffd640 1 -- 172.21.15.150:0/3833738515 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f4a2800fd60 con 0x7f4a18004d40 2024-09-17T05:50:17.831 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:17.828+0000 7f4a347ad640 1 -- 172.21.15.150:0/3833738515 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4a2c156f80 con 0x7f4a18004d40 2024-09-17T05:50:17.831 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:17.828+0000 7f4a22ffd640 1 -- 172.21.15.150:0/3833738515 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a28019670 con 0x7f4a18004d40 2024-09-17T05:50:17.831 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:17.828+0000 7f4a347ad640 1 -- 172.21.15.150:0/3833738515 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4a2c158c00 con 0x7f4a18004d40 2024-09-17T05:50:17.832 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:17.829+0000 7f4a347ad640 1 -- 172.21.15.150:0/3833738515 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4a2c0d0400 con 0x7f4a18004d40 2024-09-17T05:50:17.832 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:17.830+0000 7f4a22ffd640 1 -- 172.21.15.150:0/3833738515 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 32) ==== 103481+0+0 (secure 0 0 0) 0x7f4a28021070 con 0x7f4a18004d40 2024-09-17T05:50:17.833 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:17.830+0000 7f4a22ffd640 1 --2- 172.21.15.150:0/3833738515 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f4a1007a210 0x7f4a1007c720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:50:17.833 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:17.831+0000 7f4a22ffd640 1 -- 172.21.15.150:0/3833738515 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(100..100 src has 1..100) ==== 5821+0+0 (secure 0 0 0) 0x7f4a2809a310 con 0x7f4a18004d40 2024-09-17T05:50:17.833 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:17.831+0000 7f4a31d48640 1 --2- 172.21.15.150:0/3833738515 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f4a1007a210 0x7f4a1007c720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:50:17.833 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:17.832+0000 7f4a31d48640 1 --2- 172.21.15.150:0/3833738515 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f4a1007a210 0x7f4a1007c720 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7f4a2c0cf8f0 tx=0x7f4a1c005f90 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:50:17.836 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:17.835+0000 7f4a22ffd640 1 -- 172.21.15.150:0/3833738515 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f4a2c0b8650 con 0x7f4a18004d40 2024-09-17T05:50:18.012 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:18.011+0000 7f4a347ad640 1 -- 172.21.15.150:0/3833738515 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f4a2c0d2d60 con 0x7f4a18004d40 2024-09-17T05:50:18.013 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:18.012+0000 7f4a22ffd640 1 -- 172.21.15.150:0/3833738515 <== mon.0 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v100) ==== 74+0+16897 (secure 0 0 0) 0x7f4a28063c90 con 0x7f4a18004d40 2024-09-17T05:50:18.013 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-09-17T05:50:18.014 INFO:teuthology.orchestra.run.smithi150.stdout:{"epoch":100,"fsid":"9f2e05e9-d629-47b3-b26b-1360655b7d20","created":"2024-09-17T05:41:32.502979+0000","modified":"2024-09-17T05:50:17.022398+0000","last_up_change":"2024-09-17T05:41:46.150225+0000","last_in_change":"2024-09-17T05:41:36.120274+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T05:41:46.860779+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs_metadata","create_time":"2024-09-17T05:50:14.652062+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"100","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs_data","create_time":"2024-09-17T05:50:15.994053+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"100","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"4f31c018-c8a4-4d6d-b0c2-a597c47aae4a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6800","nonce":479374392},{"type":"v1","addr":"172.21.15.150:6801","nonce":479374392}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6802","nonce":479374392},{"type":"v1","addr":"172.21.15.150:6803","nonce":479374392}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6806","nonce":479374392},{"type":"v1","addr":"172.21.15.150:6807","nonce":479374392}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6804","nonce":479374392},{"type":"v1","addr":"172.21.15.150:6805","nonce":479374392}]},"public_addr":"172.21.15.150:6801/479374392","cluster_addr":"172.21.15.150:6803/479374392","heartbeat_back_addr":"172.21.15.150:6807/479374392","heartbeat_front_addr":"172.21.15.150:6805/479374392","state":["exists","up"]},{"osd":1,"uuid":"6ff4a573-500b-4e04-9de3-39265ead78b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6824","nonce":913899800},{"type":"v1","addr":"172.21.15.150:6825","nonce":913899800}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6826","nonce":913899800},{"type":"v1","addr":"172.21.15.150:6827","nonce":913899800}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6830","nonce":913899800},{"type":"v1","addr":"172.21.15.150:6831","nonce":913899800}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6828","nonce":913899800},{"type":"v1","addr":"172.21.15.150:6829","nonce":913899800}]},"public_addr":"172.21.15.150:6825/913899800","cluster_addr":"172.21.15.150:6827/913899800","heartbeat_back_addr":"172.21.15.150:6831/913899800","heartbeat_front_addr":"172.21.15.150:6829/913899800","state":["exists","up"]},{"osd":2,"uuid":"bffea6f9-2465-4182-b205-00436c41ac1c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6816","nonce":363718461},{"type":"v1","addr":"172.21.15.150:6817","nonce":363718461}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6818","nonce":363718461},{"type":"v1","addr":"172.21.15.150:6819","nonce":363718461}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6822","nonce":363718461},{"type":"v1","addr":"172.21.15.150:6823","nonce":363718461}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6820","nonce":363718461},{"type":"v1","addr":"172.21.15.150:6821","nonce":363718461}]},"public_addr":"172.21.15.150:6817/363718461","cluster_addr":"172.21.15.150:6819/363718461","heartbeat_back_addr":"172.21.15.150:6823/363718461","heartbeat_front_addr":"172.21.15.150:6821/363718461","state":["exists","up"]},{"osd":3,"uuid":"cda70430-d1e1-427e-b04e-56db4031d078","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6808","nonce":3550994626},{"type":"v1","addr":"172.21.15.150:6809","nonce":3550994626}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6810","nonce":3550994626},{"type":"v1","addr":"172.21.15.150:6811","nonce":3550994626}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6814","nonce":3550994626},{"type":"v1","addr":"172.21.15.150:6815","nonce":3550994626}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6812","nonce":3550994626},{"type":"v1","addr":"172.21.15.150:6813","nonce":3550994626}]},"public_addr":"172.21.15.150:6809/3550994626","cluster_addr":"172.21.15.150:6811/3550994626","heartbeat_back_addr":"172.21.15.150:6815/3550994626","heartbeat_front_addr":"172.21.15.150:6813/3550994626","state":["exists","up"]},{"osd":4,"uuid":"3a0277fb-5e1e-4f68-bb2d-9a8a0152f64a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6810","nonce":2718261497},{"type":"v1","addr":"172.21.15.176:6811","nonce":2718261497}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6812","nonce":2718261497},{"type":"v1","addr":"172.21.15.176:6813","nonce":2718261497}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6816","nonce":2718261497},{"type":"v1","addr":"172.21.15.176:6817","nonce":2718261497}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6814","nonce":2718261497},{"type":"v1","addr":"172.21.15.176:6815","nonce":2718261497}]},"public_addr":"172.21.15.176:6811/2718261497","cluster_addr":"172.21.15.176:6813/2718261497","heartbeat_back_addr":"172.21.15.176:6817/2718261497","heartbeat_front_addr":"172.21.15.176:6815/2718261497","state":["exists","up"]},{"osd":5,"uuid":"33aebee6-0315-40b7-a11c-6702f0be494d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6818","nonce":2049295774},{"type":"v1","addr":"172.21.15.176:6819","nonce":2049295774}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6820","nonce":2049295774},{"type":"v1","addr":"172.21.15.176:6821","nonce":2049295774}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6824","nonce":2049295774},{"type":"v1","addr":"172.21.15.176:6825","nonce":2049295774}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6822","nonce":2049295774},{"type":"v1","addr":"172.21.15.176:6823","nonce":2049295774}]},"public_addr":"172.21.15.176:6819/2049295774","cluster_addr":"172.21.15.176:6821/2049295774","heartbeat_back_addr":"172.21.15.176:6825/2049295774","heartbeat_front_addr":"172.21.15.176:6823/2049295774","state":["exists","up"]},{"osd":6,"uuid":"4d24f360-6751-4263-841b-d77793d33540","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6826","nonce":2164458476},{"type":"v1","addr":"172.21.15.176:6827","nonce":2164458476}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6828","nonce":2164458476},{"type":"v1","addr":"172.21.15.176:6829","nonce":2164458476}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6832","nonce":2164458476},{"type":"v1","addr":"172.21.15.176:6833","nonce":2164458476}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6830","nonce":2164458476},{"type":"v1","addr":"172.21.15.176:6831","nonce":2164458476}]},"public_addr":"172.21.15.176:6827/2164458476","cluster_addr":"172.21.15.176:6829/2164458476","heartbeat_back_addr":"172.21.15.176:6833/2164458476","heartbeat_front_addr":"172.21.15.176:6831/2164458476","state":["exists","up"]},{"osd":7,"uuid":"c8594fda-c74a-4ba9-8277-caf101d58ca1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6802","nonce":3239587708},{"type":"v1","addr":"172.21.15.176:6803","nonce":3239587708}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6804","nonce":3239587708},{"type":"v1","addr":"172.21.15.176:6805","nonce":3239587708}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6808","nonce":3239587708},{"type":"v1","addr":"172.21.15.176:6809","nonce":3239587708}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6806","nonce":3239587708},{"type":"v1","addr":"172.21.15.176:6807","nonce":3239587708}]},"public_addr":"172.21.15.176:6803/3239587708","cluster_addr":"172.21.15.176:6805/3239587708","heartbeat_back_addr":"172.21.15.176:6809/3239587708","heartbeat_front_addr":"172.21.15.176:6807/3239587708","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:41:41.905151+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:41:42.705679+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:41:42.459673+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:41:42.440819+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:41:42.668428+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:41:42.694972+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:41:43.078535+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:41:42.363539+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":7,"snaps":[{"begin":2,"length":2}]},{"pool":9,"snaps":[{"begin":2,"length":2}]},{"pool":11,"snaps":[{"begin":2,"length":2}]},{"pool":13,"snaps":[{"begin":2,"length":2}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T05:50:18.015 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:18.014+0000 7f4a347ad640 1 -- 172.21.15.150:0/3833738515 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f4a1007a210 msgr2=0x7f4a1007c720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:50:18.016 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:18.014+0000 7f4a347ad640 1 --2- 172.21.15.150:0/3833738515 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f4a1007a210 0x7f4a1007c720 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7f4a2c0cf8f0 tx=0x7f4a1c005f90 comp rx=0 tx=0).stop 2024-09-17T05:50:18.016 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:18.014+0000 7f4a347ad640 1 -- 172.21.15.150:0/3833738515 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4a18004d40 msgr2=0x7f4a2c1565a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:50:18.016 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:18.014+0000 7f4a347ad640 1 --2- 172.21.15.150:0/3833738515 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4a18004d40 0x7f4a2c1565a0 secure :-1 s=READY pgs=1308 cs=0 l=1 rev1=1 crypto rx=0x7f4a28011bf0 tx=0x7f4a28009f60 comp rx=0 tx=0).stop 2024-09-17T05:50:18.016 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:18.015+0000 7f4a347ad640 1 -- 172.21.15.150:0/3833738515 shutdown_connections 2024-09-17T05:50:18.016 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:18.015+0000 7f4a347ad640 1 --2- 172.21.15.150:0/3833738515 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4a2c154220 0x7f4a2c0b7d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:50:18.016 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:18.015+0000 7f4a347ad640 1 --2- 172.21.15.150:0/3833738515 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f4a1007a210 0x7f4a1007c720 unknown :-1 s=CLOSED pgs=564 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:50:18.016 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:18.015+0000 7f4a347ad640 1 --2- 172.21.15.150:0/3833738515 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4a2c0b8240 0x7f4a2c1f9330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:50:18.016 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:18.015+0000 7f4a347ad640 1 --2- 172.21.15.150:0/3833738515 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4a18004d40 0x7f4a2c1565a0 unknown :-1 s=CLOSED pgs=1308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:50:18.016 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:18.015+0000 7f4a347ad640 1 -- 172.21.15.150:0/3833738515 >> 172.21.15.150:0/3833738515 conn(0x7f4a2c08bfe0 msgr2=0x7f4a2c161920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:50:18.016 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:18.015+0000 7f4a347ad640 1 -- 172.21.15.150:0/3833738515 shutdown_connections 2024-09-17T05:50:18.016 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:18.015+0000 7f4a347ad640 1 -- 172.21.15.150:0/3833738515 wait complete. 2024-09-17T05:50:18.027 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T05:50:18.142 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:18.141+0000 7f29c70a9640 1 -- 172.21.15.150:0/107246957 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f29c00d0c50 msgr2=0x7f29c00d0010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:50:18.142 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:18.141+0000 7f29c70a9640 1 --2- 172.21.15.150:0/107246957 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f29c00d0c50 0x7f29c00d0010 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f29b4005fd0 tx=0x7f29b402a670 comp rx=0 tx=0).stop 2024-09-17T05:50:18.142 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:18.141+0000 7f29c70a9640 1 -- 172.21.15.150:0/107246957 shutdown_connections 2024-09-17T05:50:18.142 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:18.141+0000 7f29c70a9640 1 --2- 172.21.15.150:0/107246957 >> v2:172.21.15.176:3300/0 conn(0x7f29c00d1060 0x7f29c00b1fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:50:18.142 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:18.141+0000 7f29c70a9640 1 --2- 172.21.15.150:0/107246957 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f29c00d0c50 0x7f29c00d0010 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:50:18.142 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:18.141+0000 7f29c70a9640 1 -- 172.21.15.150:0/107246957 >> 172.21.15.150:0/107246957 conn(0x7f29c00b3fc0 msgr2=0x7f29c00b43d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:50:18.142 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:18.141+0000 7f29c70a9640 1 -- 172.21.15.150:0/107246957 shutdown_connections 2024-09-17T05:50:18.142 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:18.141+0000 7f29c70a9640 1 -- 172.21.15.150:0/107246957 wait complete. 2024-09-17T05:50:18.143 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:18.143+0000 7f29c70a9640 1 Processor -- start 2024-09-17T05:50:18.143 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:18.143+0000 7f29c70a9640 1 -- start start 2024-09-17T05:50:18.146 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:18.144+0000 7f29c70a9640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f29c00d0550 0x7f29c00c68d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:50:18.146 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:18.144+0000 7f29c70a9640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f29c00d0c50 0x7f29c014c6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:50:18.146 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:18.144+0000 7f29c70a9640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f29c00d1060 0x7f29c00b6670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:50:18.146 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:18.144+0000 7f29c70a9640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f29c00ced80 con 0x7f29c00d1060 2024-09-17T05:50:18.146 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:18.144+0000 7f29c70a9640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f29c00cd130 con 0x7f29c00d0c50 2024-09-17T05:50:18.146 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:18.144+0000 7f29c70a9640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f29c00ca4e0 con 0x7f29c00d0550 2024-09-17T05:50:18.146 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:18.144+0000 7f29c5646640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f29c00d1060 0x7f29c00b6670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:50:18.146 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:18.144+0000 7f29c4e45640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f29c00d0550 0x7f29c00c68d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:50:18.147 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:18.144+0000 7f29c5646640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f29c00d1060 0x7f29c00b6670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:59076/0 (socket says 172.21.15.150:59076) 2024-09-17T05:50:18.147 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:18.144+0000 7f29c5646640 1 -- 172.21.15.150:0/1547037061 learned_addr learned my addr 172.21.15.150:0/1547037061 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:50:18.147 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:18.144+0000 7f29bffff640 1 --2- 172.21.15.150:0/1547037061 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f29c00d0c50 0x7f29c014c6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:50:18.147 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:18.145+0000 7f29c5646640 1 -- 172.21.15.150:0/1547037061 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f29c00d0550 msgr2=0x7f29c00c68d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:50:18.147 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:18.145+0000 7f29c5646640 1 --2- 172.21.15.150:0/1547037061 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f29c00d0550 0x7f29c00c68d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:50:18.147 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:18.145+0000 7f29c5646640 1 -- 172.21.15.150:0/1547037061 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f29c00d0c50 msgr2=0x7f29c014c6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:50:18.147 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:18.145+0000 7f29c5646640 1 --2- 172.21.15.150:0/1547037061 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f29c00d0c50 0x7f29c014c6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:50:18.147 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:18.145+0000 7f29c5646640 1 -- 172.21.15.150:0/1547037061 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f29c00c8ea0 con 0x7f29c00d1060 2024-09-17T05:50:18.147 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:18.145+0000 7f29c4e45640 1 --2- 172.21.15.150:0/1547037061 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f29c00d0550 0x7f29c00c68d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T05:50:18.147 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:18.145+0000 7f29bffff640 1 --2- 172.21.15.150:0/1547037061 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f29c00d0c50 0x7f29c014c6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T05:50:18.147 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:18.145+0000 7f29c5646640 1 --2- 172.21.15.150:0/1547037061 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f29c00d1060 0x7f29c00b6670 secure :-1 s=READY pgs=1309 cs=0 l=1 rev1=1 crypto rx=0x7f29b800ea40 tx=0x7f29b800ef00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:50:18.147 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:18.145+0000 7f29bd7fa640 1 -- 172.21.15.150:0/1547037061 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29b800ce40 con 0x7f29c00d1060 2024-09-17T05:50:18.147 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:18.145+0000 7f29bd7fa640 1 -- 172.21.15.150:0/1547037061 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f29b8004c10 con 0x7f29c00d1060 2024-09-17T05:50:18.148 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:18.145+0000 7f29c70a9640 1 -- 172.21.15.150:0/1547037061 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f29c00c9180 con 0x7f29c00d1060 2024-09-17T05:50:18.148 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:18.145+0000 7f29bd7fa640 1 -- 172.21.15.150:0/1547037061 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29b8005020 con 0x7f29c00d1060 2024-09-17T05:50:18.148 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:18.145+0000 7f29c70a9640 1 -- 172.21.15.150:0/1547037061 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f29c00b5e70 con 0x7f29c00d1060 2024-09-17T05:50:18.148 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:18.146+0000 7f29c70a9640 1 -- 172.21.15.150:0/1547037061 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f29c00d0010 con 0x7f29c00d1060 2024-09-17T05:50:18.149 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:18.147+0000 7f29bd7fa640 1 -- 172.21.15.150:0/1547037061 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 32) ==== 103481+0+0 (secure 0 0 0) 0x7f29b80051c0 con 0x7f29c00d1060 2024-09-17T05:50:18.149 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:18.147+0000 7f29bd7fa640 1 --2- 172.21.15.150:0/1547037061 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f29a407a240 0x7f29a407c750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:50:18.149 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:18.148+0000 7f29bd7fa640 1 -- 172.21.15.150:0/1547037061 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(100..100 src has 1..100) ==== 5821+0+0 (secure 0 0 0) 0x7f29b809abd0 con 0x7f29c00d1060 2024-09-17T05:50:18.149 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:18.148+0000 7f29c4e45640 1 --2- 172.21.15.150:0/1547037061 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f29a407a240 0x7f29a407c750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:50:18.149 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:18.148+0000 7f29c4e45640 1 --2- 172.21.15.150:0/1547037061 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f29a407a240 0x7f29a407c750 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7f29b4033000 tx=0x7f29b4004730 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:50:18.151 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:18.151+0000 7f29bd7fa640 1 -- 172.21.15.150:0/1547037061 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f29b8026020 con 0x7f29c00d1060 2024-09-17T05:50:18.329 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:18.328+0000 7f29c70a9640 1 -- 172.21.15.150:0/1547037061 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f29c00b18d0 con 0x7f29c00d1060 2024-09-17T05:50:18.330 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:18.329+0000 7f29bd7fa640 1 -- 172.21.15.150:0/1547037061 <== mon.0 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v100) ==== 74+0+16897 (secure 0 0 0) 0x7f29b8064630 con 0x7f29c00d1060 2024-09-17T05:50:18.330 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-09-17T05:50:18.330 INFO:teuthology.orchestra.run.smithi150.stdout:{"epoch":100,"fsid":"9f2e05e9-d629-47b3-b26b-1360655b7d20","created":"2024-09-17T05:41:32.502979+0000","modified":"2024-09-17T05:50:17.022398+0000","last_up_change":"2024-09-17T05:41:46.150225+0000","last_in_change":"2024-09-17T05:41:36.120274+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T05:41:46.860779+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs_metadata","create_time":"2024-09-17T05:50:14.652062+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"100","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs_data","create_time":"2024-09-17T05:50:15.994053+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"100","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"4f31c018-c8a4-4d6d-b0c2-a597c47aae4a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6800","nonce":479374392},{"type":"v1","addr":"172.21.15.150:6801","nonce":479374392}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6802","nonce":479374392},{"type":"v1","addr":"172.21.15.150:6803","nonce":479374392}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6806","nonce":479374392},{"type":"v1","addr":"172.21.15.150:6807","nonce":479374392}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6804","nonce":479374392},{"type":"v1","addr":"172.21.15.150:6805","nonce":479374392}]},"public_addr":"172.21.15.150:6801/479374392","cluster_addr":"172.21.15.150:6803/479374392","heartbeat_back_addr":"172.21.15.150:6807/479374392","heartbeat_front_addr":"172.21.15.150:6805/479374392","state":["exists","up"]},{"osd":1,"uuid":"6ff4a573-500b-4e04-9de3-39265ead78b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6824","nonce":913899800},{"type":"v1","addr":"172.21.15.150:6825","nonce":913899800}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6826","nonce":913899800},{"type":"v1","addr":"172.21.15.150:6827","nonce":913899800}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6830","nonce":913899800},{"type":"v1","addr":"172.21.15.150:6831","nonce":913899800}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6828","nonce":913899800},{"type":"v1","addr":"172.21.15.150:6829","nonce":913899800}]},"public_addr":"172.21.15.150:6825/913899800","cluster_addr":"172.21.15.150:6827/913899800","heartbeat_back_addr":"172.21.15.150:6831/913899800","heartbeat_front_addr":"172.21.15.150:6829/913899800","state":["exists","up"]},{"osd":2,"uuid":"bffea6f9-2465-4182-b205-00436c41ac1c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6816","nonce":363718461},{"type":"v1","addr":"172.21.15.150:6817","nonce":363718461}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6818","nonce":363718461},{"type":"v1","addr":"172.21.15.150:6819","nonce":363718461}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6822","nonce":363718461},{"type":"v1","addr":"172.21.15.150:6823","nonce":363718461}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6820","nonce":363718461},{"type":"v1","addr":"172.21.15.150:6821","nonce":363718461}]},"public_addr":"172.21.15.150:6817/363718461","cluster_addr":"172.21.15.150:6819/363718461","heartbeat_back_addr":"172.21.15.150:6823/363718461","heartbeat_front_addr":"172.21.15.150:6821/363718461","state":["exists","up"]},{"osd":3,"uuid":"cda70430-d1e1-427e-b04e-56db4031d078","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6808","nonce":3550994626},{"type":"v1","addr":"172.21.15.150:6809","nonce":3550994626}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6810","nonce":3550994626},{"type":"v1","addr":"172.21.15.150:6811","nonce":3550994626}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6814","nonce":3550994626},{"type":"v1","addr":"172.21.15.150:6815","nonce":3550994626}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6812","nonce":3550994626},{"type":"v1","addr":"172.21.15.150:6813","nonce":3550994626}]},"public_addr":"172.21.15.150:6809/3550994626","cluster_addr":"172.21.15.150:6811/3550994626","heartbeat_back_addr":"172.21.15.150:6815/3550994626","heartbeat_front_addr":"172.21.15.150:6813/3550994626","state":["exists","up"]},{"osd":4,"uuid":"3a0277fb-5e1e-4f68-bb2d-9a8a0152f64a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6810","nonce":2718261497},{"type":"v1","addr":"172.21.15.176:6811","nonce":2718261497}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6812","nonce":2718261497},{"type":"v1","addr":"172.21.15.176:6813","nonce":2718261497}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6816","nonce":2718261497},{"type":"v1","addr":"172.21.15.176:6817","nonce":2718261497}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6814","nonce":2718261497},{"type":"v1","addr":"172.21.15.176:6815","nonce":2718261497}]},"public_addr":"172.21.15.176:6811/2718261497","cluster_addr":"172.21.15.176:6813/2718261497","heartbeat_back_addr":"172.21.15.176:6817/2718261497","heartbeat_front_addr":"172.21.15.176:6815/2718261497","state":["exists","up"]},{"osd":5,"uuid":"33aebee6-0315-40b7-a11c-6702f0be494d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6818","nonce":2049295774},{"type":"v1","addr":"172.21.15.176:6819","nonce":2049295774}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6820","nonce":2049295774},{"type":"v1","addr":"172.21.15.176:6821","nonce":2049295774}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6824","nonce":2049295774},{"type":"v1","addr":"172.21.15.176:6825","nonce":2049295774}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6822","nonce":2049295774},{"type":"v1","addr":"172.21.15.176:6823","nonce":2049295774}]},"public_addr":"172.21.15.176:6819/2049295774","cluster_addr":"172.21.15.176:6821/2049295774","heartbeat_back_addr":"172.21.15.176:6825/2049295774","heartbeat_front_addr":"172.21.15.176:6823/2049295774","state":["exists","up"]},{"osd":6,"uuid":"4d24f360-6751-4263-841b-d77793d33540","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6826","nonce":2164458476},{"type":"v1","addr":"172.21.15.176:6827","nonce":2164458476}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6828","nonce":2164458476},{"type":"v1","addr":"172.21.15.176:6829","nonce":2164458476}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6832","nonce":2164458476},{"type":"v1","addr":"172.21.15.176:6833","nonce":2164458476}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6830","nonce":2164458476},{"type":"v1","addr":"172.21.15.176:6831","nonce":2164458476}]},"public_addr":"172.21.15.176:6827/2164458476","cluster_addr":"172.21.15.176:6829/2164458476","heartbeat_back_addr":"172.21.15.176:6833/2164458476","heartbeat_front_addr":"172.21.15.176:6831/2164458476","state":["exists","up"]},{"osd":7,"uuid":"c8594fda-c74a-4ba9-8277-caf101d58ca1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6802","nonce":3239587708},{"type":"v1","addr":"172.21.15.176:6803","nonce":3239587708}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6804","nonce":3239587708},{"type":"v1","addr":"172.21.15.176:6805","nonce":3239587708}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6808","nonce":3239587708},{"type":"v1","addr":"172.21.15.176:6809","nonce":3239587708}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6806","nonce":3239587708},{"type":"v1","addr":"172.21.15.176:6807","nonce":3239587708}]},"public_addr":"172.21.15.176:6803/3239587708","cluster_addr":"172.21.15.176:6805/3239587708","heartbeat_back_addr":"172.21.15.176:6809/3239587708","heartbeat_front_addr":"172.21.15.176:6807/3239587708","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:41:41.905151+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:41:42.705679+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:41:42.459673+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:41:42.440819+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:41:42.668428+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:41:42.694972+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:41:43.078535+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:41:42.363539+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":7,"snaps":[{"begin":2,"length":2}]},{"pool":9,"snaps":[{"begin":2,"length":2}]},{"pool":11,"snaps":[{"begin":2,"length":2}]},{"pool":13,"snaps":[{"begin":2,"length":2}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T05:50:18.332 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:18.332+0000 7f29c70a9640 1 -- 172.21.15.150:0/1547037061 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f29a407a240 msgr2=0x7f29a407c750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:50:18.333 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:18.332+0000 7f29c70a9640 1 --2- 172.21.15.150:0/1547037061 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f29a407a240 0x7f29a407c750 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7f29b4033000 tx=0x7f29b4004730 comp rx=0 tx=0).stop 2024-09-17T05:50:18.333 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:18.332+0000 7f29c70a9640 1 -- 172.21.15.150:0/1547037061 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f29c00d1060 msgr2=0x7f29c00b6670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:50:18.333 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:18.332+0000 7f29c70a9640 1 --2- 172.21.15.150:0/1547037061 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f29c00d1060 0x7f29c00b6670 secure :-1 s=READY pgs=1309 cs=0 l=1 rev1=1 crypto rx=0x7f29b800ea40 tx=0x7f29b800ef00 comp rx=0 tx=0).stop 2024-09-17T05:50:18.333 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:18.332+0000 7f29c70a9640 1 -- 172.21.15.150:0/1547037061 shutdown_connections 2024-09-17T05:50:18.333 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:18.332+0000 7f29c70a9640 1 --2- 172.21.15.150:0/1547037061 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f29c00d0c50 0x7f29c014c6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:50:18.333 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:18.332+0000 7f29c70a9640 1 --2- 172.21.15.150:0/1547037061 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f29a407a240 0x7f29a407c750 unknown :-1 s=CLOSED pgs=565 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:50:18.333 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:18.332+0000 7f29c70a9640 1 --2- 172.21.15.150:0/1547037061 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f29c00d1060 0x7f29c00b6670 unknown :-1 s=CLOSED pgs=1309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:50:18.333 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:18.332+0000 7f29c70a9640 1 --2- 172.21.15.150:0/1547037061 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f29c00d0550 0x7f29c00c68d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:50:18.333 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:18.332+0000 7f29c70a9640 1 -- 172.21.15.150:0/1547037061 >> 172.21.15.150:0/1547037061 conn(0x7f29c00b3fc0 msgr2=0x7f29c0072b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:50:18.333 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:18.332+0000 7f29c70a9640 1 -- 172.21.15.150:0/1547037061 shutdown_connections 2024-09-17T05:50:18.333 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:18.332+0000 7f29c70a9640 1 -- 172.21.15.150:0/1547037061 wait complete. 2024-09-17T05:50:18.344 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-09-17T05:50:18.461 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:18.460+0000 7fe3446a9640 1 -- 172.21.15.150:0/32712488 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe33c0b6450 msgr2=0x7fe33c0cd3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:50:18.461 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:18.460+0000 7fe3446a9640 1 --2- 172.21.15.150:0/32712488 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe33c0b6450 0x7fe33c0cd3f0 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7fe334005fd0 tx=0x7fe33402a820 comp rx=0 tx=0).stop 2024-09-17T05:50:18.461 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:18.460+0000 7fe3446a9640 1 -- 172.21.15.150:0/32712488 shutdown_connections 2024-09-17T05:50:18.461 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:18.460+0000 7fe3446a9640 1 --2- 172.21.15.150:0/32712488 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe33c0b6450 0x7fe33c0cd3f0 unknown :-1 s=CLOSED pgs=459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:50:18.461 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:18.460+0000 7fe3446a9640 1 --2- 172.21.15.150:0/32712488 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe33c0ce800 0x7fe33c09aa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:50:18.461 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:18.460+0000 7fe3446a9640 1 -- 172.21.15.150:0/32712488 >> 172.21.15.150:0/32712488 conn(0x7fe33c0d2550 msgr2=0x7fe33c0d2960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:50:18.462 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:18.460+0000 7fe3446a9640 1 -- 172.21.15.150:0/32712488 shutdown_connections 2024-09-17T05:50:18.462 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:18.460+0000 7fe3446a9640 1 -- 172.21.15.150:0/32712488 wait complete. 2024-09-17T05:50:18.462 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:18.462+0000 7fe3446a9640 1 Processor -- start 2024-09-17T05:50:18.462 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:18.462+0000 7fe3446a9640 1 -- start start 2024-09-17T05:50:18.465 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:18.463+0000 7fe3446a9640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe33c09af90 0x7fe33c1d29b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:50:18.465 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:18.463+0000 7fe3446a9640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe33c0b6450 0x7fe33c1d2ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:50:18.465 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:18.463+0000 7fe3446a9640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe33c0ce800 0x7fe33c1f7330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:50:18.466 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:18.463+0000 7fe3446a9640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7fe33c0b75e0 con 0x7fe33c0ce800 2024-09-17T05:50:18.466 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:18.463+0000 7fe3446a9640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fe33c0cee20 con 0x7fe33c0b6450 2024-09-17T05:50:18.466 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:18.463+0000 7fe3446a9640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fe33c0cd930 con 0x7fe33c09af90 2024-09-17T05:50:18.466 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:18.463+0000 7fe342c46640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe33c0ce800 0x7fe33c1f7330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:50:18.466 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:18.463+0000 7fe342c46640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe33c0ce800 0x7fe33c1f7330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:59080/0 (socket says 172.21.15.150:59080) 2024-09-17T05:50:18.466 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:18.463+0000 7fe342c46640 1 -- 172.21.15.150:0/1707473402 learned_addr learned my addr 172.21.15.150:0/1707473402 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:50:18.466 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:18.463+0000 7fe342445640 1 --2- 172.21.15.150:0/1707473402 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe33c09af90 0x7fe33c1d29b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:50:18.466 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:18.464+0000 7fe341c44640 1 --2- 172.21.15.150:0/1707473402 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe33c0b6450 0x7fe33c1d2ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:50:18.466 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:18.464+0000 7fe342c46640 1 -- 172.21.15.150:0/1707473402 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe33c09af90 msgr2=0x7fe33c1d29b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:50:18.466 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:18.464+0000 7fe342c46640 1 --2- 172.21.15.150:0/1707473402 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe33c09af90 0x7fe33c1d29b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:50:18.466 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:18.464+0000 7fe342c46640 1 -- 172.21.15.150:0/1707473402 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe33c0b6450 msgr2=0x7fe33c1d2ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:50:18.466 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:18.464+0000 7fe342c46640 1 --2- 172.21.15.150:0/1707473402 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe33c0b6450 0x7fe33c1d2ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:50:18.467 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:18.464+0000 7fe342c46640 1 -- 172.21.15.150:0/1707473402 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe33c0af5c0 con 0x7fe33c0ce800 2024-09-17T05:50:18.467 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:18.464+0000 7fe342445640 1 --2- 172.21.15.150:0/1707473402 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe33c09af90 0x7fe33c1d29b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T05:50:18.467 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:18.464+0000 7fe341c44640 1 --2- 172.21.15.150:0/1707473402 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe33c0b6450 0x7fe33c1d2ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T05:50:18.467 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:18.464+0000 7fe342c46640 1 --2- 172.21.15.150:0/1707473402 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe33c0ce800 0x7fe33c1f7330 secure :-1 s=READY pgs=1311 cs=0 l=1 rev1=1 crypto rx=0x7fe334009cd0 tx=0x7fe334032c60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:50:18.467 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:18.464+0000 7fe332ffd640 1 -- 172.21.15.150:0/1707473402 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe334037040 con 0x7fe33c0ce800 2024-09-17T05:50:18.467 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:18.464+0000 7fe332ffd640 1 -- 172.21.15.150:0/1707473402 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe334042070 con 0x7fe33c0ce800 2024-09-17T05:50:18.467 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:18.464+0000 7fe3446a9640 1 -- 172.21.15.150:0/1707473402 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe33c0c6710 con 0x7fe33c0ce800 2024-09-17T05:50:18.467 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:18.464+0000 7fe332ffd640 1 -- 172.21.15.150:0/1707473402 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe334003e60 con 0x7fe33c0ce800 2024-09-17T05:50:18.467 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:18.464+0000 7fe3446a9640 1 -- 172.21.15.150:0/1707473402 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe33c1d3430 con 0x7fe33c0ce800 2024-09-17T05:50:18.467 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:18.465+0000 7fe3446a9640 1 -- 172.21.15.150:0/1707473402 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe33c1d0c30 con 0x7fe33c0ce800 2024-09-17T05:50:18.468 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:18.466+0000 7fe332ffd640 1 -- 172.21.15.150:0/1707473402 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 32) ==== 103481+0+0 (secure 0 0 0) 0x7fe334004280 con 0x7fe33c0ce800 2024-09-17T05:50:18.468 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:18.466+0000 7fe332ffd640 1 --2- 172.21.15.150:0/1707473402 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fe32007a210 0x7fe32007c720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:50:18.468 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:18.467+0000 7fe332ffd640 1 -- 172.21.15.150:0/1707473402 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(100..100 src has 1..100) ==== 5821+0+0 (secure 0 0 0) 0x7fe3340bb170 con 0x7fe33c0ce800 2024-09-17T05:50:18.468 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:18.467+0000 7fe342445640 1 --2- 172.21.15.150:0/1707473402 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fe32007a210 0x7fe32007c720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:50:18.468 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:18.467+0000 7fe342445640 1 --2- 172.21.15.150:0/1707473402 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fe32007a210 0x7fe32007c720 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7fe338009ab0 tx=0x7fe338005f90 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:50:18.470 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:18.470+0000 7fe332ffd640 1 -- 172.21.15.150:0/1707473402 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fe334085220 con 0x7fe33c0ce800 2024-09-17T05:50:18.683 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:18.683+0000 7fe3446a9640 1 -- 172.21.15.150:0/1707473402 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7fe33c1d3720 con 0x7fe33c0ce800 2024-09-17T05:50:19.687 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:19.687+0000 7fe332ffd640 1 -- 172.21.15.150:0/1707473402 <== mon.0 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v59) ==== 118+0+0 (secure 0 0 0) 0x7fe334084b20 con 0x7fe33c0ce800 2024-09-17T05:50:19.690 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:19.689+0000 7fe3446a9640 1 -- 172.21.15.150:0/1707473402 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fe32007a210 msgr2=0x7fe32007c720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:50:19.691 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:19.690+0000 7fe3446a9640 1 --2- 172.21.15.150:0/1707473402 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fe32007a210 0x7fe32007c720 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7fe338009ab0 tx=0x7fe338005f90 comp rx=0 tx=0).stop 2024-09-17T05:50:19.691 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:19.690+0000 7fe3446a9640 1 -- 172.21.15.150:0/1707473402 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe33c0ce800 msgr2=0x7fe33c1f7330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:50:19.691 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:19.690+0000 7fe3446a9640 1 --2- 172.21.15.150:0/1707473402 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe33c0ce800 0x7fe33c1f7330 secure :-1 s=READY pgs=1311 cs=0 l=1 rev1=1 crypto rx=0x7fe334009cd0 tx=0x7fe334032c60 comp rx=0 tx=0).stop 2024-09-17T05:50:19.691 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:19.690+0000 7fe3446a9640 1 -- 172.21.15.150:0/1707473402 shutdown_connections 2024-09-17T05:50:19.691 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:19.690+0000 7fe3446a9640 1 --2- 172.21.15.150:0/1707473402 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe33c0b6450 0x7fe33c1d2ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:50:19.691 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:19.690+0000 7fe3446a9640 1 --2- 172.21.15.150:0/1707473402 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fe32007a210 0x7fe32007c720 unknown :-1 s=CLOSED pgs=566 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:50:19.691 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:19.690+0000 7fe3446a9640 1 --2- 172.21.15.150:0/1707473402 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe33c0ce800 0x7fe33c1f7330 unknown :-1 s=CLOSED pgs=1311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:50:19.691 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:19.690+0000 7fe3446a9640 1 --2- 172.21.15.150:0/1707473402 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe33c09af90 0x7fe33c1d29b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:50:19.691 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:19.690+0000 7fe3446a9640 1 -- 172.21.15.150:0/1707473402 >> 172.21.15.150:0/1707473402 conn(0x7fe33c0d2550 msgr2=0x7fe33c068e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:50:19.691 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:19.690+0000 7fe3446a9640 1 -- 172.21.15.150:0/1707473402 shutdown_connections 2024-09-17T05:50:19.691 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:19.690+0000 7fe3446a9640 1 -- 172.21.15.150:0/1707473402 wait complete. 2024-09-17T05:50:19.705 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-09-17T05:50:19.705 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-09-17T05:50:19.829 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:19.827+0000 7f210a215640 1 -- 172.21.15.150:0/1534108662 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f20ec003a30 msgr2=0x7f20ec003ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:50:19.829 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:19.827+0000 7f210a215640 1 --2- 172.21.15.150:0/1534108662 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f20ec003a30 0x7f20ec003ea0 secure :-1 s=READY pgs=1313 cs=0 l=1 rev1=1 crypto rx=0x7f20f40016b0 tx=0x7f20ec005830 comp rx=0 tx=0).stop 2024-09-17T05:50:19.829 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:19.827+0000 7f2103fff640 1 -- 172.21.15.150:0/1534108662 reap_dead start 2024-09-17T05:50:19.829 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:19.828+0000 7f210a215640 1 -- 172.21.15.150:0/1534108662 shutdown_connections 2024-09-17T05:50:19.829 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:19.828+0000 7f210a215640 1 -- 172.21.15.150:0/1534108662 >> 172.21.15.150:0/1534108662 conn(0x7f21040cef20 msgr2=0x7f21040cf330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:50:19.829 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:19.828+0000 7f210a215640 1 -- 172.21.15.150:0/1534108662 shutdown_connections 2024-09-17T05:50:19.829 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:19.828+0000 7f210a215640 1 -- 172.21.15.150:0/1534108662 wait complete. 2024-09-17T05:50:19.830 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:19.829+0000 7f210a215640 1 Processor -- start 2024-09-17T05:50:19.830 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:19.830+0000 7f210a215640 1 -- start start 2024-09-17T05:50:19.833 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:19.831+0000 7f210a215640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f20ec003a30 0x7f210415a800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:50:19.833 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:19.831+0000 7f210a215640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f21041f7830 0x7f210415c840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:50:19.833 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:19.831+0000 7f210a215640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f210414f4c0 0x7f210415cd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:50:19.833 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:19.831+0000 7f210a215640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f21040af900 con 0x7f210414f4c0 2024-09-17T05:50:19.833 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:19.831+0000 7f210a215640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f21040ceb90 con 0x7f20ec003a30 2024-09-17T05:50:19.833 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:19.831+0000 7f210a215640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f210415a040 con 0x7f21041f7830 2024-09-17T05:50:19.833 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:19.831+0000 7f2103fff640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f210414f4c0 0x7f210415cd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:50:19.833 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:19.831+0000 7f2103fff640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f210414f4c0 0x7f210415cd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:59100/0 (socket says 172.21.15.150:59100) 2024-09-17T05:50:19.833 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:19.831+0000 7f2103fff640 1 -- 172.21.15.150:0/2789730283 learned_addr learned my addr 172.21.15.150:0/2789730283 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:50:19.834 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:19.831+0000 7f21037fe640 1 --2- 172.21.15.150:0/2789730283 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f20ec003a30 0x7f210415a800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:50:19.834 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:19.831+0000 7f2102ffd640 1 --2- 172.21.15.150:0/2789730283 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f21041f7830 0x7f210415c840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:50:19.834 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:19.831+0000 7f2103fff640 1 -- 172.21.15.150:0/2789730283 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f21041f7830 msgr2=0x7f210415c840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:50:19.834 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:19.831+0000 7f2103fff640 1 --2- 172.21.15.150:0/2789730283 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f21041f7830 0x7f210415c840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:50:19.834 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:19.831+0000 7f2103fff640 1 -- 172.21.15.150:0/2789730283 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f20ec003a30 msgr2=0x7f210415a800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:50:19.834 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:19.831+0000 7f2103fff640 1 --2- 172.21.15.150:0/2789730283 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f20ec003a30 0x7f210415a800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:50:19.834 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:19.831+0000 7f2103fff640 1 -- 172.21.15.150:0/2789730283 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2104150ff0 con 0x7f210414f4c0 2024-09-17T05:50:19.834 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:19.831+0000 7f2103fff640 1 --2- 172.21.15.150:0/2789730283 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f210414f4c0 0x7f210415cd80 secure :-1 s=READY pgs=1314 cs=0 l=1 rev1=1 crypto rx=0x7f20fc005fd0 tx=0x7f20fc00fd90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:50:19.834 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:19.832+0000 7f20ebfff640 1 -- 172.21.15.150:0/2789730283 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20fc003b80 con 0x7f210414f4c0 2024-09-17T05:50:19.834 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:19.832+0000 7f20ebfff640 1 -- 172.21.15.150:0/2789730283 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f20fc003e10 con 0x7f210414f4c0 2024-09-17T05:50:19.834 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:19.832+0000 7f210a215640 1 -- 172.21.15.150:0/2789730283 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f21041512d0 con 0x7f210414f4c0 2024-09-17T05:50:19.834 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:19.832+0000 7f20ebfff640 1 -- 172.21.15.150:0/2789730283 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20fc004d80 con 0x7f210414f4c0 2024-09-17T05:50:19.835 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:19.832+0000 7f210a215640 1 -- 172.21.15.150:0/2789730283 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2104151890 con 0x7f210414f4c0 2024-09-17T05:50:19.835 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:19.833+0000 7f210a215640 1 -- 172.21.15.150:0/2789730283 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f21040af1f0 con 0x7f210414f4c0 2024-09-17T05:50:19.835 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:19.834+0000 7f20ebfff640 1 -- 172.21.15.150:0/2789730283 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 32) ==== 103481+0+0 (secure 0 0 0) 0x7f20fc01a020 con 0x7f210414f4c0 2024-09-17T05:50:19.836 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:19.834+0000 7f20ebfff640 1 --2- 172.21.15.150:0/2789730283 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f20f007a210 0x7f20f007c720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:50:19.836 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:19.834+0000 7f20ebfff640 1 -- 172.21.15.150:0/2789730283 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(101..101 src has 1..101) ==== 5821+0+0 (secure 0 0 0) 0x7f20fc099d70 con 0x7f210414f4c0 2024-09-17T05:50:19.836 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:19.834+0000 7f21037fe640 1 --2- 172.21.15.150:0/2789730283 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f20f007a210 0x7f20f007c720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:50:19.836 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:19.835+0000 7f21037fe640 1 --2- 172.21.15.150:0/2789730283 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f20f007a210 0x7f20f007c720 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7f20f4001680 tx=0x7f20f40011e0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:50:19.839 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:19.838+0000 7f20ebfff640 1 -- 172.21.15.150:0/2789730283 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f20fc063c30 con 0x7f210414f4c0 2024-09-17T05:50:20.052 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:20.051+0000 7f210a215640 1 -- 172.21.15.150:0/2789730283 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7f210415ad40 con 0x7f210414f4c0 2024-09-17T05:50:20.689 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:20.688+0000 7f20ebfff640 1 -- 172.21.15.150:0/2789730283 <== mon.0 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v60) ==== 122+0+0 (secure 0 0 0) 0x7f20fc063530 con 0x7f210414f4c0 2024-09-17T05:50:20.693 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:20.691+0000 7f210a215640 1 -- 172.21.15.150:0/2789730283 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f20f007a210 msgr2=0x7f20f007c720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:50:20.693 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:20.691+0000 7f210a215640 1 --2- 172.21.15.150:0/2789730283 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f20f007a210 0x7f20f007c720 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7f20f4001680 tx=0x7f20f40011e0 comp rx=0 tx=0).stop 2024-09-17T05:50:20.693 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:20.691+0000 7f210a215640 1 -- 172.21.15.150:0/2789730283 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f210414f4c0 msgr2=0x7f210415cd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:50:20.693 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:20.691+0000 7f210a215640 1 --2- 172.21.15.150:0/2789730283 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f210414f4c0 0x7f210415cd80 secure :-1 s=READY pgs=1314 cs=0 l=1 rev1=1 crypto rx=0x7f20fc005fd0 tx=0x7f20fc00fd90 comp rx=0 tx=0).stop 2024-09-17T05:50:20.693 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:20.691+0000 7f210a215640 1 -- 172.21.15.150:0/2789730283 shutdown_connections 2024-09-17T05:50:20.693 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:20.691+0000 7f210a215640 1 --2- 172.21.15.150:0/2789730283 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f20f007a210 0x7f20f007c720 unknown :-1 s=CLOSED pgs=567 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:50:20.693 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:20.691+0000 7f210a215640 1 --2- 172.21.15.150:0/2789730283 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f210414f4c0 0x7f210415cd80 unknown :-1 s=CLOSED pgs=1314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:50:20.693 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:20.691+0000 7f210a215640 1 --2- 172.21.15.150:0/2789730283 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f21041f7830 0x7f210415c840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:50:20.693 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:20.691+0000 7f210a215640 1 --2- 172.21.15.150:0/2789730283 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f20ec003a30 0x7f210415a800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:50:20.693 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:20.692+0000 7f210a215640 1 -- 172.21.15.150:0/2789730283 >> 172.21.15.150:0/2789730283 conn(0x7f21040cef20 msgr2=0x7f21040b1c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:50:20.693 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:20.692+0000 7f210a215640 1 -- 172.21.15.150:0/2789730283 shutdown_connections 2024-09-17T05:50:20.693 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:20.692+0000 7f210a215640 1 -- 172.21.15.150:0/2789730283 wait complete. 2024-09-17T05:50:20.707 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-09-17T05:50:20.707 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T05:50:20.827 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:20.826+0000 7fc121521640 1 -- 172.21.15.150:0/1663335319 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc11c159260 msgr2=0x7fc11c0743b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:50:20.828 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:20.826+0000 7fc121521640 1 --2- 172.21.15.150:0/1663335319 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc11c159260 0x7fc11c0743b0 secure :-1 s=READY pgs=1316 cs=0 l=1 rev1=1 crypto rx=0x7fc104005fd0 tx=0x7fc10402a5d0 comp rx=0 tx=0).stop 2024-09-17T05:50:20.828 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:20.826+0000 7fc121521640 1 -- 172.21.15.150:0/1663335319 shutdown_connections 2024-09-17T05:50:20.828 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:20.826+0000 7fc121521640 1 --2- 172.21.15.150:0/1663335319 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc11c159260 0x7fc11c0743b0 unknown :-1 s=CLOSED pgs=1316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:50:20.828 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:20.826+0000 7fc121521640 1 -- 172.21.15.150:0/1663335319 >> 172.21.15.150:0/1663335319 conn(0x7fc11c073890 msgr2=0x7fc11c073ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:50:20.828 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:20.827+0000 7fc121521640 1 -- 172.21.15.150:0/1663335319 shutdown_connections 2024-09-17T05:50:20.828 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:20.827+0000 7fc121521640 1 -- 172.21.15.150:0/1663335319 wait complete. 2024-09-17T05:50:20.829 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:20.828+0000 7fc121521640 1 Processor -- start 2024-09-17T05:50:20.829 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:20.828+0000 7fc121521640 1 -- start start 2024-09-17T05:50:20.831 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:20.830+0000 7fc121521640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc11c06ddb0 0x7fc11c145550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:50:20.832 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:20.830+0000 7fc121521640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc11c159260 0x7fc11c15f200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:50:20.832 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:20.830+0000 7fc121521640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc11c15c930 0x7fc11c15f740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:50:20.832 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:20.830+0000 7fc121521640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7fc11c0cf100 con 0x7fc11c159260 2024-09-17T05:50:20.832 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:20.830+0000 7fc121521640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fc11c0cef80 con 0x7fc11c06ddb0 2024-09-17T05:50:20.832 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:20.830+0000 7fc121521640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fc11c0cf280 con 0x7fc11c15c930 2024-09-17T05:50:20.832 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:20.830+0000 7fc113fff640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc11c159260 0x7fc11c15f200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:50:20.832 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:20.830+0000 7fc113fff640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc11c159260 0x7fc11c15f200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:57250/0 (socket says 172.21.15.150:57250) 2024-09-17T05:50:20.832 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:20.830+0000 7fc113fff640 1 -- 172.21.15.150:0/2426405357 learned_addr learned my addr 172.21.15.150:0/2426405357 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:50:20.832 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:20.830+0000 7fc11affd640 1 --2- 172.21.15.150:0/2426405357 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc11c06ddb0 0x7fc11c145550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:50:20.832 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:20.830+0000 7fc11b7fe640 1 --2- 172.21.15.150:0/2426405357 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc11c15c930 0x7fc11c15f740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:50:20.832 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:20.830+0000 7fc113fff640 1 -- 172.21.15.150:0/2426405357 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc11c15c930 msgr2=0x7fc11c15f740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:50:20.832 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:20.830+0000 7fc113fff640 1 --2- 172.21.15.150:0/2426405357 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc11c15c930 0x7fc11c15f740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:50:20.833 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:20.830+0000 7fc113fff640 1 -- 172.21.15.150:0/2426405357 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc11c06ddb0 msgr2=0x7fc11c145550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:50:20.833 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:20.830+0000 7fc113fff640 1 --2- 172.21.15.150:0/2426405357 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc11c06ddb0 0x7fc11c145550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:50:20.833 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:20.830+0000 7fc113fff640 1 -- 172.21.15.150:0/2426405357 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc11c145a90 con 0x7fc11c159260 2024-09-17T05:50:20.833 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:20.830+0000 7fc11b7fe640 1 --2- 172.21.15.150:0/2426405357 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc11c15c930 0x7fc11c15f740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:50:20.833 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:20.830+0000 7fc113fff640 1 --2- 172.21.15.150:0/2426405357 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc11c159260 0x7fc11c15f200 secure :-1 s=READY pgs=1317 cs=0 l=1 rev1=1 crypto rx=0x7fc104034040 tx=0x7fc1040038a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:50:20.833 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:20.830+0000 7fc1137fe640 1 -- 172.21.15.150:0/2426405357 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc10403e030 con 0x7fc11c159260 2024-09-17T05:50:20.833 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:20.830+0000 7fc1137fe640 1 -- 172.21.15.150:0/2426405357 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc104003ca0 con 0x7fc11c159260 2024-09-17T05:50:20.833 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:20.830+0000 7fc1137fe640 1 -- 172.21.15.150:0/2426405357 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc104035040 con 0x7fc11c159260 2024-09-17T05:50:20.833 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:20.830+0000 7fc121521640 1 -- 172.21.15.150:0/2426405357 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc11c1f6d20 con 0x7fc11c159260 2024-09-17T05:50:20.833 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:20.831+0000 7fc121521640 1 -- 172.21.15.150:0/2426405357 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc11c1f72e0 con 0x7fc11c159260 2024-09-17T05:50:20.834 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:20.831+0000 7fc121521640 1 -- 172.21.15.150:0/2426405357 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc11c156670 con 0x7fc11c159260 2024-09-17T05:50:20.834 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:20.832+0000 7fc1137fe640 1 -- 172.21.15.150:0/2426405357 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 32) ==== 103481+0+0 (secure 0 0 0) 0x7fc104041030 con 0x7fc11c159260 2024-09-17T05:50:20.834 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:20.833+0000 7fc1137fe640 1 --2- 172.21.15.150:0/2426405357 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fc0fc07a210 0x7fc0fc07c720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:50:20.834 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:20.833+0000 7fc1137fe640 1 -- 172.21.15.150:0/2426405357 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(101..101 src has 1..101) ==== 5821+0+0 (secure 0 0 0) 0x7fc1040ba010 con 0x7fc11c159260 2024-09-17T05:50:20.834 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:20.833+0000 7fc11affd640 1 --2- 172.21.15.150:0/2426405357 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fc0fc07a210 0x7fc0fc07c720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:50:20.834 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:20.833+0000 7fc11affd640 1 --2- 172.21.15.150:0/2426405357 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fc0fc07a210 0x7fc0fc07c720 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7fc10c000f60 tx=0x7fc10c009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:50:20.838 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:20.837+0000 7fc1137fe640 1 -- 172.21.15.150:0/2426405357 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fc104083900 con 0x7fc11c159260 2024-09-17T05:50:21.053 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:21.052+0000 7fc121521640 1 -- 172.21.15.150:0/2426405357 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fc11c0743b0 con 0x7fc11c159260 2024-09-17T05:50:21.053 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:21.053+0000 7fc1137fe640 1 -- 172.21.15.150:0/2426405357 <== mon.0 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 60 v60) ==== 94+0+5231 (secure 0 0 0) 0x7fc104088330 con 0x7fc11c159260 2024-09-17T05:50:21.054 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-09-17T05:50:21.054 INFO:teuthology.orchestra.run.smithi150.stdout:{"epoch":60,"btime":"2024-09-17T05:50:20:687617+0000","default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6494,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6837/1755605193","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6835","nonce":1755605193},{"type":"v1","addr":"172.21.15.176:6837","nonce":1755605193}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":55},{"gid":7117,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6836/628081508","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6834","nonce":628081508},{"type":"v1","addr":"172.21.15.176:6836","nonce":628081508}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":55},{"gid":8061,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6835/187954104","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6833","nonce":187954104},{"type":"v1","addr":"172.21.15.150:6835","nonce":187954104}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":55}],"filesystems":[{"mdsmap":{"epoch":60,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T05:50:17.022354+0000","modified":"2024-09-17T05:50:20.052518+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":8064},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8064":{"gid":8064,"name":"c","rank":0,"incarnation":56,"state":"up:active","state_seq":3,"addr":"172.21.15.150:6834/3842369685","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6832","nonce":3842369685},{"type":"v1","addr":"172.21.15.150:6834","nonce":3842369685}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":8064,"qdb_cluster":[8064]},"id":7}]} 2024-09-17T05:50:21.054 INFO:teuthology.orchestra.run.smithi150.stderr:dumped fsmap epoch 60 2024-09-17T05:50:21.056 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:21.055+0000 7fc121521640 1 -- 172.21.15.150:0/2426405357 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fc0fc07a210 msgr2=0x7fc0fc07c720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:50:21.056 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:21.055+0000 7fc121521640 1 --2- 172.21.15.150:0/2426405357 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fc0fc07a210 0x7fc0fc07c720 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7fc10c000f60 tx=0x7fc10c009040 comp rx=0 tx=0).stop 2024-09-17T05:50:21.056 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:21.055+0000 7fc121521640 1 -- 172.21.15.150:0/2426405357 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc11c159260 msgr2=0x7fc11c15f200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:50:21.056 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:21.055+0000 7fc121521640 1 --2- 172.21.15.150:0/2426405357 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc11c159260 0x7fc11c15f200 secure :-1 s=READY pgs=1317 cs=0 l=1 rev1=1 crypto rx=0x7fc104034040 tx=0x7fc1040038a0 comp rx=0 tx=0).stop 2024-09-17T05:50:21.056 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:21.055+0000 7fc121521640 1 -- 172.21.15.150:0/2426405357 shutdown_connections 2024-09-17T05:50:21.056 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:21.055+0000 7fc121521640 1 --2- 172.21.15.150:0/2426405357 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fc0fc07a210 0x7fc0fc07c720 unknown :-1 s=CLOSED pgs=568 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:50:21.056 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:21.055+0000 7fc121521640 1 --2- 172.21.15.150:0/2426405357 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc11c15c930 0x7fc11c15f740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:50:21.056 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:21.055+0000 7fc121521640 1 --2- 172.21.15.150:0/2426405357 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc11c159260 0x7fc11c15f200 unknown :-1 s=CLOSED pgs=1317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:50:21.056 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:21.055+0000 7fc121521640 1 --2- 172.21.15.150:0/2426405357 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc11c06ddb0 0x7fc11c145550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:50:21.056 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:21.055+0000 7fc121521640 1 -- 172.21.15.150:0/2426405357 >> 172.21.15.150:0/2426405357 conn(0x7fc11c073890 msgr2=0x7fc11c0b1880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:50:21.056 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:21.055+0000 7fc121521640 1 -- 172.21.15.150:0/2426405357 shutdown_connections 2024-09-17T05:50:21.057 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:21.055+0000 7fc121521640 1 -- 172.21.15.150:0/2426405357 wait complete. 2024-09-17T05:50:21.068 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T05:50:21.180 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:21.179+0000 7f46bd0be640 1 -- 172.21.15.150:0/1997763592 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f46b80d0550 msgr2=0x7f46b80b18c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:50:21.180 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:21.179+0000 7f46bd0be640 1 --2- 172.21.15.150:0/1997763592 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f46b80d0550 0x7f46b80b18c0 secure :-1 s=READY pgs=1318 cs=0 l=1 rev1=1 crypto rx=0x7f46b80711a0 tx=0x7f46ac02a5f0 comp rx=0 tx=0).stop 2024-09-17T05:50:21.180 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:21.179+0000 7f46bd0be640 1 -- 172.21.15.150:0/1997763592 shutdown_connections 2024-09-17T05:50:21.180 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:21.179+0000 7f46bd0be640 1 --2- 172.21.15.150:0/1997763592 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f46b80d0550 0x7f46b80b18c0 unknown :-1 s=CLOSED pgs=1318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:50:21.181 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:21.179+0000 7f46bd0be640 1 --2- 172.21.15.150:0/1997763592 >> v2:172.21.15.176:3300/0 conn(0x7f46b80d0c50 0x7f46b80d0010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:50:21.181 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:21.179+0000 7f46bd0be640 1 -- 172.21.15.150:0/1997763592 >> 172.21.15.150:0/1997763592 conn(0x7f46b80b3fc0 msgr2=0x7f46b80b43d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:50:21.181 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:21.179+0000 7f46bd0be640 1 -- 172.21.15.150:0/1997763592 shutdown_connections 2024-09-17T05:50:21.181 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:21.179+0000 7f46bd0be640 1 -- 172.21.15.150:0/1997763592 wait complete. 2024-09-17T05:50:21.182 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:21.181+0000 7f46bd0be640 1 Processor -- start 2024-09-17T05:50:21.182 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:21.181+0000 7f46bd0be640 1 -- start start 2024-09-17T05:50:21.185 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:21.183+0000 7f46bd0be640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f46b80d0550 0x7f46b80cc050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:50:21.185 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:21.183+0000 7f46bd0be640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f46b80d0c50 0x7f46b80c60c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:50:21.185 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:21.183+0000 7f46bd0be640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f46b80d1060 0x7f46b80c7890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:50:21.185 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:21.183+0000 7f46bd0be640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f46b80ced30 con 0x7f46b80d0550 2024-09-17T05:50:21.185 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:21.183+0000 7f46bd0be640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f46b80cebb0 con 0x7f46b80d0c50 2024-09-17T05:50:21.185 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:21.183+0000 7f46bd0be640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f46b80cd130 con 0x7f46b80d1060 2024-09-17T05:50:21.185 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:21.183+0000 7f46b6d9d640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f46b80d0550 0x7f46b80cc050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:50:21.185 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:21.183+0000 7f46b6d9d640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f46b80d0550 0x7f46b80cc050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:57254/0 (socket says 172.21.15.150:57254) 2024-09-17T05:50:21.185 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:21.183+0000 7f46b6d9d640 1 -- 172.21.15.150:0/2868718051 learned_addr learned my addr 172.21.15.150:0/2868718051 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:50:21.185 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:21.183+0000 7f46b659c640 1 --2- 172.21.15.150:0/2868718051 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f46b80d0c50 0x7f46b80c60c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:50:21.186 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:21.183+0000 7f46b759e640 1 --2- 172.21.15.150:0/2868718051 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f46b80d1060 0x7f46b80c7890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:50:21.186 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:21.183+0000 7f46b6d9d640 1 -- 172.21.15.150:0/2868718051 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f46b80d1060 msgr2=0x7f46b80c7890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:50:21.186 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:21.183+0000 7f46b6d9d640 1 --2- 172.21.15.150:0/2868718051 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f46b80d1060 0x7f46b80c7890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:50:21.186 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:21.183+0000 7f46b6d9d640 1 -- 172.21.15.150:0/2868718051 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f46b80d0c50 msgr2=0x7f46b80c60c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:50:21.186 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:21.183+0000 7f46b6d9d640 1 --2- 172.21.15.150:0/2868718051 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f46b80d0c50 0x7f46b80c60c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:50:21.186 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:21.183+0000 7f46b6d9d640 1 -- 172.21.15.150:0/2868718051 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f46b80c6e30 con 0x7f46b80d0550 2024-09-17T05:50:21.186 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:21.183+0000 7f46b759e640 1 --2- 172.21.15.150:0/2868718051 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f46b80d1060 0x7f46b80c7890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:50:21.186 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:21.183+0000 7f46b6d9d640 1 --2- 172.21.15.150:0/2868718051 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f46b80d0550 0x7f46b80cc050 secure :-1 s=READY pgs=1319 cs=0 l=1 rev1=1 crypto rx=0x7f46a800c970 tx=0x7f46a800ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:50:21.186 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:21.183+0000 7f469f7fe640 1 -- 172.21.15.150:0/2868718051 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46a8007bb0 con 0x7f46b80d0550 2024-09-17T05:50:21.186 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:21.183+0000 7f469f7fe640 1 -- 172.21.15.150:0/2868718051 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f46a8007e40 con 0x7f46b80d0550 2024-09-17T05:50:21.186 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:21.183+0000 7f46bd0be640 1 -- 172.21.15.150:0/2868718051 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f46b80c9640 con 0x7f46b80d0550 2024-09-17T05:50:21.186 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:21.184+0000 7f469f7fe640 1 -- 172.21.15.150:0/2868718051 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46a800f690 con 0x7f46b80d0550 2024-09-17T05:50:21.187 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:21.184+0000 7f46bd0be640 1 -- 172.21.15.150:0/2868718051 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f46b80c9c00 con 0x7f46b80d0550 2024-09-17T05:50:21.187 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:21.184+0000 7f46bd0be640 1 -- 172.21.15.150:0/2868718051 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f46b80d0010 con 0x7f46b80d0550 2024-09-17T05:50:21.187 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:21.185+0000 7f469f7fe640 1 -- 172.21.15.150:0/2868718051 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 32) ==== 103481+0+0 (secure 0 0 0) 0x7f46a800f830 con 0x7f46b80d0550 2024-09-17T05:50:21.188 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:21.186+0000 7f469f7fe640 1 --2- 172.21.15.150:0/2868718051 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f46a407a210 0x7f46a407c720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:50:21.188 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:21.186+0000 7f469f7fe640 1 -- 172.21.15.150:0/2868718051 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(101..101 src has 1..101) ==== 5821+0+0 (secure 0 0 0) 0x7f46a809a1e0 con 0x7f46b80d0550 2024-09-17T05:50:21.188 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:21.186+0000 7f46b659c640 1 --2- 172.21.15.150:0/2868718051 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f46a407a210 0x7f46a407c720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:50:21.188 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:21.187+0000 7f46b659c640 1 --2- 172.21.15.150:0/2868718051 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f46a407a210 0x7f46a407c720 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7f46ac033000 tx=0x7f46ac004730 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:50:21.191 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:21.190+0000 7f469f7fe640 1 -- 172.21.15.150:0/2868718051 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f46a8014030 con 0x7f46b80d0550 2024-09-17T05:50:21.367 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:21.366+0000 7f46bd0be640 1 -- 172.21.15.150:0/2868718051 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f46b80b1c00 con 0x7f46b80d0550 2024-09-17T05:50:21.368 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:21.367+0000 7f469f7fe640 1 -- 172.21.15.150:0/2868718051 <== mon.0 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v101) ==== 74+0+16884 (secure 0 0 0) 0x7f46a80641b0 con 0x7f46b80d0550 2024-09-17T05:50:21.368 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-09-17T05:50:21.368 INFO:teuthology.orchestra.run.smithi150.stdout:{"epoch":101,"fsid":"9f2e05e9-d629-47b3-b26b-1360655b7d20","created":"2024-09-17T05:41:32.502979+0000","modified":"2024-09-17T05:50:18.663833+0000","last_up_change":"2024-09-17T05:41:46.150225+0000","last_in_change":"2024-09-17T05:41:36.120274+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T05:41:46.860779+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs_metadata","create_time":"2024-09-17T05:50:14.652062+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"100","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs_data","create_time":"2024-09-17T05:50:15.994053+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"101","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"4f31c018-c8a4-4d6d-b0c2-a597c47aae4a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6800","nonce":479374392},{"type":"v1","addr":"172.21.15.150:6801","nonce":479374392}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6802","nonce":479374392},{"type":"v1","addr":"172.21.15.150:6803","nonce":479374392}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6806","nonce":479374392},{"type":"v1","addr":"172.21.15.150:6807","nonce":479374392}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6804","nonce":479374392},{"type":"v1","addr":"172.21.15.150:6805","nonce":479374392}]},"public_addr":"172.21.15.150:6801/479374392","cluster_addr":"172.21.15.150:6803/479374392","heartbeat_back_addr":"172.21.15.150:6807/479374392","heartbeat_front_addr":"172.21.15.150:6805/479374392","state":["exists","up"]},{"osd":1,"uuid":"6ff4a573-500b-4e04-9de3-39265ead78b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6824","nonce":913899800},{"type":"v1","addr":"172.21.15.150:6825","nonce":913899800}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6826","nonce":913899800},{"type":"v1","addr":"172.21.15.150:6827","nonce":913899800}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6830","nonce":913899800},{"type":"v1","addr":"172.21.15.150:6831","nonce":913899800}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6828","nonce":913899800},{"type":"v1","addr":"172.21.15.150:6829","nonce":913899800}]},"public_addr":"172.21.15.150:6825/913899800","cluster_addr":"172.21.15.150:6827/913899800","heartbeat_back_addr":"172.21.15.150:6831/913899800","heartbeat_front_addr":"172.21.15.150:6829/913899800","state":["exists","up"]},{"osd":2,"uuid":"bffea6f9-2465-4182-b205-00436c41ac1c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6816","nonce":363718461},{"type":"v1","addr":"172.21.15.150:6817","nonce":363718461}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6818","nonce":363718461},{"type":"v1","addr":"172.21.15.150:6819","nonce":363718461}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6822","nonce":363718461},{"type":"v1","addr":"172.21.15.150:6823","nonce":363718461}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6820","nonce":363718461},{"type":"v1","addr":"172.21.15.150:6821","nonce":363718461}]},"public_addr":"172.21.15.150:6817/363718461","cluster_addr":"172.21.15.150:6819/363718461","heartbeat_back_addr":"172.21.15.150:6823/363718461","heartbeat_front_addr":"172.21.15.150:6821/363718461","state":["exists","up"]},{"osd":3,"uuid":"cda70430-d1e1-427e-b04e-56db4031d078","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6808","nonce":3550994626},{"type":"v1","addr":"172.21.15.150:6809","nonce":3550994626}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6810","nonce":3550994626},{"type":"v1","addr":"172.21.15.150:6811","nonce":3550994626}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6814","nonce":3550994626},{"type":"v1","addr":"172.21.15.150:6815","nonce":3550994626}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6812","nonce":3550994626},{"type":"v1","addr":"172.21.15.150:6813","nonce":3550994626}]},"public_addr":"172.21.15.150:6809/3550994626","cluster_addr":"172.21.15.150:6811/3550994626","heartbeat_back_addr":"172.21.15.150:6815/3550994626","heartbeat_front_addr":"172.21.15.150:6813/3550994626","state":["exists","up"]},{"osd":4,"uuid":"3a0277fb-5e1e-4f68-bb2d-9a8a0152f64a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6810","nonce":2718261497},{"type":"v1","addr":"172.21.15.176:6811","nonce":2718261497}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6812","nonce":2718261497},{"type":"v1","addr":"172.21.15.176:6813","nonce":2718261497}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6816","nonce":2718261497},{"type":"v1","addr":"172.21.15.176:6817","nonce":2718261497}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6814","nonce":2718261497},{"type":"v1","addr":"172.21.15.176:6815","nonce":2718261497}]},"public_addr":"172.21.15.176:6811/2718261497","cluster_addr":"172.21.15.176:6813/2718261497","heartbeat_back_addr":"172.21.15.176:6817/2718261497","heartbeat_front_addr":"172.21.15.176:6815/2718261497","state":["exists","up"]},{"osd":5,"uuid":"33aebee6-0315-40b7-a11c-6702f0be494d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6818","nonce":2049295774},{"type":"v1","addr":"172.21.15.176:6819","nonce":2049295774}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6820","nonce":2049295774},{"type":"v1","addr":"172.21.15.176:6821","nonce":2049295774}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6824","nonce":2049295774},{"type":"v1","addr":"172.21.15.176:6825","nonce":2049295774}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6822","nonce":2049295774},{"type":"v1","addr":"172.21.15.176:6823","nonce":2049295774}]},"public_addr":"172.21.15.176:6819/2049295774","cluster_addr":"172.21.15.176:6821/2049295774","heartbeat_back_addr":"172.21.15.176:6825/2049295774","heartbeat_front_addr":"172.21.15.176:6823/2049295774","state":["exists","up"]},{"osd":6,"uuid":"4d24f360-6751-4263-841b-d77793d33540","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6826","nonce":2164458476},{"type":"v1","addr":"172.21.15.176:6827","nonce":2164458476}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6828","nonce":2164458476},{"type":"v1","addr":"172.21.15.176:6829","nonce":2164458476}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6832","nonce":2164458476},{"type":"v1","addr":"172.21.15.176:6833","nonce":2164458476}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6830","nonce":2164458476},{"type":"v1","addr":"172.21.15.176:6831","nonce":2164458476}]},"public_addr":"172.21.15.176:6827/2164458476","cluster_addr":"172.21.15.176:6829/2164458476","heartbeat_back_addr":"172.21.15.176:6833/2164458476","heartbeat_front_addr":"172.21.15.176:6831/2164458476","state":["exists","up"]},{"osd":7,"uuid":"c8594fda-c74a-4ba9-8277-caf101d58ca1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6802","nonce":3239587708},{"type":"v1","addr":"172.21.15.176:6803","nonce":3239587708}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6804","nonce":3239587708},{"type":"v1","addr":"172.21.15.176:6805","nonce":3239587708}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6808","nonce":3239587708},{"type":"v1","addr":"172.21.15.176:6809","nonce":3239587708}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6806","nonce":3239587708},{"type":"v1","addr":"172.21.15.176:6807","nonce":3239587708}]},"public_addr":"172.21.15.176:6803/3239587708","cluster_addr":"172.21.15.176:6805/3239587708","heartbeat_back_addr":"172.21.15.176:6809/3239587708","heartbeat_front_addr":"172.21.15.176:6807/3239587708","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:41:41.905151+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:41:42.705679+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:41:42.459673+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:41:42.440819+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:41:42.668428+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:41:42.694972+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:41:43.078535+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:41:42.363539+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":7,"snaps":[{"begin":2,"length":2}]},{"pool":9,"snaps":[{"begin":2,"length":2}]},{"pool":11,"snaps":[{"begin":2,"length":2}]},{"pool":13,"snaps":[{"begin":2,"length":2}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T05:50:21.370 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:21.369+0000 7f46bd0be640 1 -- 172.21.15.150:0/2868718051 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f46a407a210 msgr2=0x7f46a407c720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:50:21.371 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:21.369+0000 7f46bd0be640 1 --2- 172.21.15.150:0/2868718051 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f46a407a210 0x7f46a407c720 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7f46ac033000 tx=0x7f46ac004730 comp rx=0 tx=0).stop 2024-09-17T05:50:21.371 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:21.369+0000 7f46bd0be640 1 -- 172.21.15.150:0/2868718051 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f46b80d0550 msgr2=0x7f46b80cc050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:50:21.371 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:21.369+0000 7f46bd0be640 1 --2- 172.21.15.150:0/2868718051 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f46b80d0550 0x7f46b80cc050 secure :-1 s=READY pgs=1319 cs=0 l=1 rev1=1 crypto rx=0x7f46a800c970 tx=0x7f46a800ce30 comp rx=0 tx=0).stop 2024-09-17T05:50:21.371 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:21.369+0000 7f46bd0be640 1 -- 172.21.15.150:0/2868718051 shutdown_connections 2024-09-17T05:50:21.371 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:21.369+0000 7f46bd0be640 1 --2- 172.21.15.150:0/2868718051 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f46b80d0c50 0x7f46b80c60c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:50:21.371 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:21.369+0000 7f46bd0be640 1 --2- 172.21.15.150:0/2868718051 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f46a407a210 0x7f46a407c720 unknown :-1 s=CLOSED pgs=569 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:50:21.371 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:21.369+0000 7f46bd0be640 1 --2- 172.21.15.150:0/2868718051 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f46b80d1060 0x7f46b80c7890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:50:21.371 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:21.369+0000 7f46bd0be640 1 --2- 172.21.15.150:0/2868718051 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f46b80d0550 0x7f46b80cc050 unknown :-1 s=CLOSED pgs=1319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:50:21.371 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:21.370+0000 7f46bd0be640 1 -- 172.21.15.150:0/2868718051 >> 172.21.15.150:0/2868718051 conn(0x7f46b80b3fc0 msgr2=0x7f46b80b0670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:50:21.371 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:21.370+0000 7f46bd0be640 1 -- 172.21.15.150:0/2868718051 shutdown_connections 2024-09-17T05:50:21.371 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:21.370+0000 7f46bd0be640 1 -- 172.21.15.150:0/2868718051 wait complete. 2024-09-17T05:50:21.383 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-17T05:50:21.383 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-17T05:50:21.497 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:21.496+0000 7fad30407640 1 -- 172.21.15.150:0/1152145512 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fad28152920 msgr2=0x7fad2815f3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:50:21.497 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:21.496+0000 7fad30407640 1 --2- 172.21.15.150:0/1152145512 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fad28152920 0x7fad2815f3d0 secure :-1 s=READY pgs=1321 cs=0 l=1 rev1=1 crypto rx=0x7fad1c005fd0 tx=0x7fad1c02a540 comp rx=0 tx=0).stop 2024-09-17T05:50:21.497 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:21.496+0000 7fad30407640 1 -- 172.21.15.150:0/1152145512 shutdown_connections 2024-09-17T05:50:21.497 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:21.496+0000 7fad30407640 1 --2- 172.21.15.150:0/1152145512 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fad28152920 0x7fad2815f3d0 unknown :-1 s=CLOSED pgs=1321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:50:21.498 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:21.496+0000 7fad30407640 1 -- 172.21.15.150:0/1152145512 >> 172.21.15.150:0/1152145512 conn(0x7fad2806d730 msgr2=0x7fad280b1e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:50:21.498 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:21.496+0000 7fad30407640 1 -- 172.21.15.150:0/1152145512 shutdown_connections 2024-09-17T05:50:21.498 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:21.496+0000 7fad30407640 1 -- 172.21.15.150:0/1152145512 wait complete. 2024-09-17T05:50:21.498 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:21.498+0000 7fad30407640 1 Processor -- start 2024-09-17T05:50:21.498 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:21.498+0000 7fad30407640 1 -- start start 2024-09-17T05:50:21.501 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:21.499+0000 7fad30407640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fad280aebc0 0x7fad280afe50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:50:21.501 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:21.499+0000 7fad30407640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fad28152920 0x7fad280b0a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:50:21.501 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:21.499+0000 7fad30407640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fad2815f910 0x7fad280b0fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:50:21.501 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:21.499+0000 7fad30407640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7fad280b4390 con 0x7fad28152920 2024-09-17T05:50:21.501 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:21.499+0000 7fad30407640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fad280b4210 con 0x7fad2815f910 2024-09-17T05:50:21.501 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:21.499+0000 7fad30407640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fad280b4510 con 0x7fad280aebc0 2024-09-17T05:50:21.502 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:21.499+0000 7fad2d9a2640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fad28152920 0x7fad280b0a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:50:21.502 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:21.499+0000 7fad2d9a2640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fad28152920 0x7fad280b0a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:57272/0 (socket says 172.21.15.150:57272) 2024-09-17T05:50:21.502 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:21.499+0000 7fad2d9a2640 1 -- 172.21.15.150:0/594186373 learned_addr learned my addr 172.21.15.150:0/594186373 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:50:21.502 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:21.499+0000 7fad2e9a4640 1 --2- 172.21.15.150:0/594186373 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fad2815f910 0x7fad280b0fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:50:21.502 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:21.499+0000 7fad2e1a3640 1 --2- 172.21.15.150:0/594186373 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fad280aebc0 0x7fad280afe50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:50:21.502 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:21.500+0000 7fad2d9a2640 1 -- 172.21.15.150:0/594186373 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fad280aebc0 msgr2=0x7fad280afe50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:50:21.502 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:21.500+0000 7fad2d9a2640 1 --2- 172.21.15.150:0/594186373 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fad280aebc0 0x7fad280afe50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:50:21.502 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:21.500+0000 7fad2d9a2640 1 -- 172.21.15.150:0/594186373 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fad2815f910 msgr2=0x7fad280b0fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:50:21.502 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:21.500+0000 7fad2d9a2640 1 --2- 172.21.15.150:0/594186373 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fad2815f910 0x7fad280b0fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:50:21.502 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:21.500+0000 7fad2d9a2640 1 -- 172.21.15.150:0/594186373 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fad2813f390 con 0x7fad28152920 2024-09-17T05:50:21.502 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:21.500+0000 7fad2d9a2640 1 --2- 172.21.15.150:0/594186373 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fad28152920 0x7fad280b0a60 secure :-1 s=READY pgs=1322 cs=0 l=1 rev1=1 crypto rx=0x7fad1c000c00 tx=0x7fad1c003970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:50:21.503 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:21.500+0000 7fad26ffd640 1 -- 172.21.15.150:0/594186373 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad1c03e030 con 0x7fad28152920 2024-09-17T05:50:21.503 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:21.500+0000 7fad26ffd640 1 -- 172.21.15.150:0/594186373 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fad1c003e60 con 0x7fad28152920 2024-09-17T05:50:21.503 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:21.500+0000 7fad26ffd640 1 -- 172.21.15.150:0/594186373 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad1c035040 con 0x7fad28152920 2024-09-17T05:50:21.503 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:21.500+0000 7fad30407640 1 -- 172.21.15.150:0/594186373 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fad281592c0 con 0x7fad28152920 2024-09-17T05:50:21.503 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:21.500+0000 7fad30407640 1 -- 172.21.15.150:0/594186373 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fad280cf0f0 con 0x7fad28152920 2024-09-17T05:50:21.504 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:21.501+0000 7fad30407640 1 -- 172.21.15.150:0/594186373 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fad280cf330 con 0x7fad28152920 2024-09-17T05:50:21.504 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:21.502+0000 7fad26ffd640 1 -- 172.21.15.150:0/594186373 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 32) ==== 103481+0+0 (secure 0 0 0) 0x7fad1c041030 con 0x7fad28152920 2024-09-17T05:50:21.504 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:21.502+0000 7fad26ffd640 1 --2- 172.21.15.150:0/594186373 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fad1407a240 0x7fad1407c750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:50:21.504 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:21.503+0000 7fad26ffd640 1 -- 172.21.15.150:0/594186373 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(101..101 src has 1..101) ==== 5821+0+0 (secure 0 0 0) 0x7fad1c0ba750 con 0x7fad28152920 2024-09-17T05:50:21.504 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:21.503+0000 7fad2e1a3640 1 --2- 172.21.15.150:0/594186373 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fad1407a240 0x7fad1407c750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:50:21.504 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:21.503+0000 7fad2e1a3640 1 --2- 172.21.15.150:0/594186373 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fad1407a240 0x7fad1407c750 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7fad180012e0 tx=0x7fad18009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:50:21.507 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:21.506+0000 7fad26ffd640 1 -- 172.21.15.150:0/594186373 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fad280cf330 con 0x7fad28152920 2024-09-17T05:50:21.680 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:21.679+0000 7fad30407640 1 -- 172.21.15.150:0/594186373 --> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fad280b49e0 con 0x7fad1407a240 2024-09-17T05:50:21.684 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:21.684+0000 7fad26ffd640 1 -- 172.21.15.150:0/594186373 <== mgr.4108 v2:172.21.15.176:6800/3631216395 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+250629 (secure 0 0 0) 0x7fad280b49e0 con 0x7fad1407a240 2024-09-17T05:50:21.688 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-09-17T05:50:21.689 INFO:teuthology.orchestra.run.smithi150.stderr:dumped all 2024-09-17T05:50:21.691 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:21.687+0000 7fad30407640 1 -- 172.21.15.150:0/594186373 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fad1407a240 msgr2=0x7fad1407c750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:50:21.691 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:21.687+0000 7fad30407640 1 --2- 172.21.15.150:0/594186373 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fad1407a240 0x7fad1407c750 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7fad180012e0 tx=0x7fad18009040 comp rx=0 tx=0).stop 2024-09-17T05:50:21.691 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:21.687+0000 7fad30407640 1 -- 172.21.15.150:0/594186373 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fad28152920 msgr2=0x7fad280b0a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:50:21.691 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:21.687+0000 7fad30407640 1 --2- 172.21.15.150:0/594186373 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fad28152920 0x7fad280b0a60 secure :-1 s=READY pgs=1322 cs=0 l=1 rev1=1 crypto rx=0x7fad1c000c00 tx=0x7fad1c003970 comp rx=0 tx=0).stop 2024-09-17T05:50:21.691 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:21.687+0000 7fad30407640 1 -- 172.21.15.150:0/594186373 shutdown_connections 2024-09-17T05:50:21.691 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:21.687+0000 7fad30407640 1 --2- 172.21.15.150:0/594186373 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fad2815f910 0x7fad280b0fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:50:21.691 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:21.687+0000 7fad30407640 1 --2- 172.21.15.150:0/594186373 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fad1407a240 0x7fad1407c750 unknown :-1 s=CLOSED pgs=570 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:50:21.691 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:21.687+0000 7fad30407640 1 --2- 172.21.15.150:0/594186373 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fad28152920 0x7fad280b0a60 unknown :-1 s=CLOSED pgs=1322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:50:21.691 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:21.687+0000 7fad30407640 1 --2- 172.21.15.150:0/594186373 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fad280aebc0 0x7fad280afe50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:50:21.691 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:21.687+0000 7fad30407640 1 -- 172.21.15.150:0/594186373 >> 172.21.15.150:0/594186373 conn(0x7fad2806d730 msgr2=0x7fad2815cf60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:50:21.692 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:21.687+0000 7fad30407640 1 -- 172.21.15.150:0/594186373 shutdown_connections 2024-09-17T05:50:21.692 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:21.687+0000 7fad30407640 1 -- 172.21.15.150:0/594186373 wait complete. 2024-09-17T05:50:21.700 INFO:teuthology.orchestra.run.smithi150.stdout:{"pg_ready":true,"pg_map":{"version":353,"stamp":"2024-09-17T05:50:21.039548+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":591054,"num_objects":15,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":129,"num_write_kb":1637,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":10,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":96,"ondisk_log_size":96,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":60,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":982940,"kb_used_data":10680,"kb_used_omap":12,"kb_used_meta":972083,"kb_avail":753991780,"statfs":{"total":773094113280,"available":772087582720,"internally_reserved":0,"allocated":10936320,"data_stored":5378520,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":995413552},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":20,"apply_latency_ms":20,"commit_latency_ns":20000000,"apply_latency_ns":20000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":686,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":10,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.388456"},"pg_stats":[{"pgid":"15.3f","version":"0'0","reported_seq":10,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-17T05:50:17.692584+0000","last_change":"2024-09-17T05:50:17.688948+0000","last_active":"2024-09-17T05:50:17.692584+0000","last_peered":"2024-09-17T05:50:17.692584+0000","last_clean":"2024-09-17T05:50:17.692584+0000","last_became_active":"2024-09-17T05:50:17.688664+0000","last_became_peered":"2024-09-17T05:50:17.688664+0000","last_unstale":"2024-09-17T05:50:17.692584+0000","last_undegraded":"2024-09-17T05:50:17.692584+0000","last_fullsized":"2024-09-17T05:50:17.692584+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:50:16.649689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:50:16.649689+0000","last_clean_scrub_stamp":"2024-09-17T05:50:16.649689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:03:34.676383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.3e","version":"0'0","reported_seq":13,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-17T05:50:18.686282+0000","last_change":"2024-09-17T05:50:17.686607+0000","last_active":"2024-09-17T05:50:18.686282+0000","last_peered":"2024-09-17T05:50:18.686282+0000","last_clean":"2024-09-17T05:50:18.686282+0000","last_became_active":"2024-09-17T05:50:17.685913+0000","last_became_peered":"2024-09-17T05:50:17.685913+0000","last_unstale":"2024-09-17T05:50:18.686282+0000","last_undegraded":"2024-09-17T05:50:18.686282+0000","last_fullsized":"2024-09-17T05:50:18.686282+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:50:16.649689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:50:16.649689+0000","last_clean_scrub_stamp":"2024-09-17T05:50:16.649689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:17:42.646673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.3d","version":"0'0","reported_seq":10,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-17T05:50:17.692516+0000","last_change":"2024-09-17T05:50:17.687586+0000","last_active":"2024-09-17T05:50:17.692516+0000","last_peered":"2024-09-17T05:50:17.692516+0000","last_clean":"2024-09-17T05:50:17.692516+0000","last_became_active":"2024-09-17T05:50:17.687288+0000","last_became_peered":"2024-09-17T05:50:17.687288+0000","last_unstale":"2024-09-17T05:50:17.692516+0000","last_undegraded":"2024-09-17T05:50:17.692516+0000","last_fullsized":"2024-09-17T05:50:17.692516+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:50:16.649689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:50:16.649689+0000","last_clean_scrub_stamp":"2024-09-17T05:50:16.649689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:27:25.644171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.3c","version":"0'0","reported_seq":10,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-17T05:50:17.679950+0000","last_change":"2024-09-17T05:50:17.677226+0000","last_active":"2024-09-17T05:50:17.679950+0000","last_peered":"2024-09-17T05:50:17.679950+0000","last_clean":"2024-09-17T05:50:17.679950+0000","last_became_active":"2024-09-17T05:50:17.676607+0000","last_became_peered":"2024-09-17T05:50:17.676607+0000","last_unstale":"2024-09-17T05:50:17.679950+0000","last_undegraded":"2024-09-17T05:50:17.679950+0000","last_fullsized":"2024-09-17T05:50:17.679950+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:50:16.649689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:50:16.649689+0000","last_clean_scrub_stamp":"2024-09-17T05:50:16.649689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:19:07.779617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.3b","version":"0'0","reported_seq":10,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-17T05:50:17.692019+0000","last_change":"2024-09-17T05:50:17.686438+0000","last_active":"2024-09-17T05:50:17.692019+0000","last_peered":"2024-09-17T05:50:17.692019+0000","last_clean":"2024-09-17T05:50:17.692019+0000","last_became_active":"2024-09-17T05:50:17.686137+0000","last_became_peered":"2024-09-17T05:50:17.686137+0000","last_unstale":"2024-09-17T05:50:17.692019+0000","last_undegraded":"2024-09-17T05:50:17.692019+0000","last_fullsized":"2024-09-17T05:50:17.692019+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:50:16.649689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:50:16.649689+0000","last_clean_scrub_stamp":"2024-09-17T05:50:16.649689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:04:28.500108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.3a","version":"0'0","reported_seq":1,"reported_epoch":99,"state":"creating+peering","last_fresh":"2024-09-17T05:50:16.664990+0000","last_change":"2024-09-17T05:50:16.664990+0000","last_active":"2024-09-17T05:50:16.649689+0000","last_peered":"2024-09-17T05:50:16.649689+0000","last_clean":"2024-09-17T05:50:16.649689+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:50:16.664990+0000","last_undegraded":"2024-09-17T05:50:16.664990+0000","last_fullsized":"2024-09-17T05:50:16.664990+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:50:16.649689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:50:16.649689+0000","last_clean_scrub_stamp":"2024-09-17T05:50:16.649689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.39","version":"0'0","reported_seq":1,"reported_epoch":99,"state":"creating+peering","last_fresh":"2024-09-17T05:50:16.665949+0000","last_change":"2024-09-17T05:50:16.665949+0000","last_active":"2024-09-17T05:50:16.649689+0000","last_peered":"2024-09-17T05:50:16.649689+0000","last_clean":"2024-09-17T05:50:16.649689+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:50:16.665949+0000","last_undegraded":"2024-09-17T05:50:16.665949+0000","last_fullsized":"2024-09-17T05:50:16.665949+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:50:16.649689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:50:16.649689+0000","last_clean_scrub_stamp":"2024-09-17T05:50:16.649689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.38","version":"0'0","reported_seq":13,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-17T05:50:18.686276+0000","last_change":"2024-09-17T05:50:17.688288+0000","last_active":"2024-09-17T05:50:18.686276+0000","last_peered":"2024-09-17T05:50:18.686276+0000","last_clean":"2024-09-17T05:50:18.686276+0000","last_became_active":"2024-09-17T05:50:17.687994+0000","last_became_peered":"2024-09-17T05:50:17.687994+0000","last_unstale":"2024-09-17T05:50:18.686276+0000","last_undegraded":"2024-09-17T05:50:18.686276+0000","last_fullsized":"2024-09-17T05:50:18.686276+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:50:16.649689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:50:16.649689+0000","last_clean_scrub_stamp":"2024-09-17T05:50:16.649689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:34:26.313722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.37","version":"0'0","reported_seq":1,"reported_epoch":99,"state":"creating+peering","last_fresh":"2024-09-17T05:50:16.656812+0000","last_change":"2024-09-17T05:50:16.656812+0000","last_active":"2024-09-17T05:50:16.649689+0000","last_peered":"2024-09-17T05:50:16.649689+0000","last_clean":"2024-09-17T05:50:16.649689+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:50:16.656812+0000","last_undegraded":"2024-09-17T05:50:16.656812+0000","last_fullsized":"2024-09-17T05:50:16.656812+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:50:16.649689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:50:16.649689+0000","last_clean_scrub_stamp":"2024-09-17T05:50:16.649689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.36","version":"0'0","reported_seq":10,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-17T05:50:17.694249+0000","last_change":"2024-09-17T05:50:17.691032+0000","last_active":"2024-09-17T05:50:17.694249+0000","last_peered":"2024-09-17T05:50:17.694249+0000","last_clean":"2024-09-17T05:50:17.694249+0000","last_became_active":"2024-09-17T05:50:17.687974+0000","last_became_peered":"2024-09-17T05:50:17.687974+0000","last_unstale":"2024-09-17T05:50:17.694249+0000","last_undegraded":"2024-09-17T05:50:17.694249+0000","last_fullsized":"2024-09-17T05:50:17.694249+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:50:16.649689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:50:16.649689+0000","last_clean_scrub_stamp":"2024-09-17T05:50:16.649689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:21:42.242980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.35","version":"0'0","reported_seq":1,"reported_epoch":99,"state":"creating+peering","last_fresh":"2024-09-17T05:50:16.669270+0000","last_change":"2024-09-17T05:50:16.669270+0000","last_active":"2024-09-17T05:50:16.649689+0000","last_peered":"2024-09-17T05:50:16.649689+0000","last_clean":"2024-09-17T05:50:16.649689+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:50:16.669270+0000","last_undegraded":"2024-09-17T05:50:16.669270+0000","last_fullsized":"2024-09-17T05:50:16.669270+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:50:16.649689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:50:16.649689+0000","last_clean_scrub_stamp":"2024-09-17T05:50:16.649689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.34","version":"0'0","reported_seq":1,"reported_epoch":99,"state":"creating+peering","last_fresh":"2024-09-17T05:50:16.657363+0000","last_change":"2024-09-17T05:50:16.657363+0000","last_active":"2024-09-17T05:50:16.649689+0000","last_peered":"2024-09-17T05:50:16.649689+0000","last_clean":"2024-09-17T05:50:16.649689+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:50:16.657363+0000","last_undegraded":"2024-09-17T05:50:16.657363+0000","last_fullsized":"2024-09-17T05:50:16.657363+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:50:16.649689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:50:16.649689+0000","last_clean_scrub_stamp":"2024-09-17T05:50:16.649689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.33","version":"0'0","reported_seq":10,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-17T05:50:17.680120+0000","last_change":"2024-09-17T05:50:17.674595+0000","last_active":"2024-09-17T05:50:17.680120+0000","last_peered":"2024-09-17T05:50:17.680120+0000","last_clean":"2024-09-17T05:50:17.680120+0000","last_became_active":"2024-09-17T05:50:17.674286+0000","last_became_peered":"2024-09-17T05:50:17.674286+0000","last_unstale":"2024-09-17T05:50:17.680120+0000","last_undegraded":"2024-09-17T05:50:17.680120+0000","last_fullsized":"2024-09-17T05:50:17.680120+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:50:16.649689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:50:16.649689+0000","last_clean_scrub_stamp":"2024-09-17T05:50:16.649689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:39:58.578693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.32","version":"0'0","reported_seq":10,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-17T05:50:17.699073+0000","last_change":"2024-09-17T05:50:17.693635+0000","last_active":"2024-09-17T05:50:17.699073+0000","last_peered":"2024-09-17T05:50:17.699073+0000","last_clean":"2024-09-17T05:50:17.699073+0000","last_became_active":"2024-09-17T05:50:17.693172+0000","last_became_peered":"2024-09-17T05:50:17.693172+0000","last_unstale":"2024-09-17T05:50:17.699073+0000","last_undegraded":"2024-09-17T05:50:17.699073+0000","last_fullsized":"2024-09-17T05:50:17.699073+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:50:16.649689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:50:16.649689+0000","last_clean_scrub_stamp":"2024-09-17T05:50:16.649689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:03:31.990762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.31","version":"0'0","reported_seq":10,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-17T05:50:17.685964+0000","last_change":"2024-09-17T05:50:17.681216+0000","last_active":"2024-09-17T05:50:17.685964+0000","last_peered":"2024-09-17T05:50:17.685964+0000","last_clean":"2024-09-17T05:50:17.685964+0000","last_became_active":"2024-09-17T05:50:17.680783+0000","last_became_peered":"2024-09-17T05:50:17.680783+0000","last_unstale":"2024-09-17T05:50:17.685964+0000","last_undegraded":"2024-09-17T05:50:17.685964+0000","last_fullsized":"2024-09-17T05:50:17.685964+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:50:16.649689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:50:16.649689+0000","last_clean_scrub_stamp":"2024-09-17T05:50:16.649689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:51:50.910297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.30","version":"0'0","reported_seq":1,"reported_epoch":99,"state":"creating+peering","last_fresh":"2024-09-17T05:50:16.667715+0000","last_change":"2024-09-17T05:50:16.667715+0000","last_active":"2024-09-17T05:50:16.649689+0000","last_peered":"2024-09-17T05:50:16.649689+0000","last_clean":"2024-09-17T05:50:16.649689+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:50:16.667715+0000","last_undegraded":"2024-09-17T05:50:16.667715+0000","last_fullsized":"2024-09-17T05:50:16.667715+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:50:16.649689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:50:16.649689+0000","last_clean_scrub_stamp":"2024-09-17T05:50:16.649689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.2f","version":"0'0","reported_seq":13,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-17T05:50:18.686505+0000","last_change":"2024-09-17T05:50:17.686002+0000","last_active":"2024-09-17T05:50:18.686505+0000","last_peered":"2024-09-17T05:50:18.686505+0000","last_clean":"2024-09-17T05:50:18.686505+0000","last_became_active":"2024-09-17T05:50:17.685687+0000","last_became_peered":"2024-09-17T05:50:17.685687+0000","last_unstale":"2024-09-17T05:50:18.686505+0000","last_undegraded":"2024-09-17T05:50:18.686505+0000","last_fullsized":"2024-09-17T05:50:18.686505+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:50:16.649689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:50:16.649689+0000","last_clean_scrub_stamp":"2024-09-17T05:50:16.649689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:46:40.056183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.2e","version":"0'0","reported_seq":10,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-17T05:50:17.680159+0000","last_change":"2024-09-17T05:50:17.676677+0000","last_active":"2024-09-17T05:50:17.680159+0000","last_peered":"2024-09-17T05:50:17.680159+0000","last_clean":"2024-09-17T05:50:17.680159+0000","last_became_active":"2024-09-17T05:50:17.676390+0000","last_became_peered":"2024-09-17T05:50:17.676390+0000","last_unstale":"2024-09-17T05:50:17.680159+0000","last_undegraded":"2024-09-17T05:50:17.680159+0000","last_fullsized":"2024-09-17T05:50:17.680159+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:50:16.649689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:50:16.649689+0000","last_clean_scrub_stamp":"2024-09-17T05:50:16.649689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:02:08.191996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.2d","version":"0'0","reported_seq":10,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-17T05:50:17.692165+0000","last_change":"2024-09-17T05:50:17.689114+0000","last_active":"2024-09-17T05:50:17.692165+0000","last_peered":"2024-09-17T05:50:17.692165+0000","last_clean":"2024-09-17T05:50:17.692165+0000","last_became_active":"2024-09-17T05:50:17.688766+0000","last_became_peered":"2024-09-17T05:50:17.688766+0000","last_unstale":"2024-09-17T05:50:17.692165+0000","last_undegraded":"2024-09-17T05:50:17.692165+0000","last_fullsized":"2024-09-17T05:50:17.692165+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:50:16.649689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:50:16.649689+0000","last_clean_scrub_stamp":"2024-09-17T05:50:16.649689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:56:51.160610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.2c","version":"0'0","reported_seq":1,"reported_epoch":99,"state":"creating+peering","last_fresh":"2024-09-17T05:50:16.656329+0000","last_change":"2024-09-17T05:50:16.656329+0000","last_active":"2024-09-17T05:50:16.649689+0000","last_peered":"2024-09-17T05:50:16.649689+0000","last_clean":"2024-09-17T05:50:16.649689+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:50:16.656329+0000","last_undegraded":"2024-09-17T05:50:16.656329+0000","last_fullsized":"2024-09-17T05:50:16.656329+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:50:16.649689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:50:16.649689+0000","last_clean_scrub_stamp":"2024-09-17T05:50:16.649689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.2b","version":"0'0","reported_seq":10,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-17T05:50:17.685753+0000","last_change":"2024-09-17T05:50:17.679256+0000","last_active":"2024-09-17T05:50:17.685753+0000","last_peered":"2024-09-17T05:50:17.685753+0000","last_clean":"2024-09-17T05:50:17.685753+0000","last_became_active":"2024-09-17T05:50:17.678923+0000","last_became_peered":"2024-09-17T05:50:17.678923+0000","last_unstale":"2024-09-17T05:50:17.685753+0000","last_undegraded":"2024-09-17T05:50:17.685753+0000","last_fullsized":"2024-09-17T05:50:17.685753+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:50:16.649689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:50:16.649689+0000","last_clean_scrub_stamp":"2024-09-17T05:50:16.649689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:28:08.714137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.2a","version":"0'0","reported_seq":13,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-17T05:50:18.686175+0000","last_change":"2024-09-17T05:50:17.687586+0000","last_active":"2024-09-17T05:50:18.686175+0000","last_peered":"2024-09-17T05:50:18.686175+0000","last_clean":"2024-09-17T05:50:18.686175+0000","last_became_active":"2024-09-17T05:50:17.687286+0000","last_became_peered":"2024-09-17T05:50:17.687286+0000","last_unstale":"2024-09-17T05:50:18.686175+0000","last_undegraded":"2024-09-17T05:50:18.686175+0000","last_fullsized":"2024-09-17T05:50:18.686175+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:50:16.649689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:50:16.649689+0000","last_clean_scrub_stamp":"2024-09-17T05:50:16.649689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:02:00.945244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.29","version":"0'0","reported_seq":13,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-17T05:50:18.686290+0000","last_change":"2024-09-17T05:50:17.688190+0000","last_active":"2024-09-17T05:50:18.686290+0000","last_peered":"2024-09-17T05:50:18.686290+0000","last_clean":"2024-09-17T05:50:18.686290+0000","last_became_active":"2024-09-17T05:50:17.687362+0000","last_became_peered":"2024-09-17T05:50:17.687362+0000","last_unstale":"2024-09-17T05:50:18.686290+0000","last_undegraded":"2024-09-17T05:50:18.686290+0000","last_fullsized":"2024-09-17T05:50:18.686290+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:50:16.649689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:50:16.649689+0000","last_clean_scrub_stamp":"2024-09-17T05:50:16.649689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:41:16.543702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.28","version":"0'0","reported_seq":1,"reported_epoch":99,"state":"creating+peering","last_fresh":"2024-09-17T05:50:16.666955+0000","last_change":"2024-09-17T05:50:16.666955+0000","last_active":"2024-09-17T05:50:16.649689+0000","last_peered":"2024-09-17T05:50:16.649689+0000","last_clean":"2024-09-17T05:50:16.649689+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:50:16.666955+0000","last_undegraded":"2024-09-17T05:50:16.666955+0000","last_fullsized":"2024-09-17T05:50:16.666955+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:50:16.649689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:50:16.649689+0000","last_clean_scrub_stamp":"2024-09-17T05:50:16.649689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.27","version":"0'0","reported_seq":10,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-17T05:50:17.702466+0000","last_change":"2024-09-17T05:50:17.701876+0000","last_active":"2024-09-17T05:50:17.702466+0000","last_peered":"2024-09-17T05:50:17.702466+0000","last_clean":"2024-09-17T05:50:17.702466+0000","last_became_active":"2024-09-17T05:50:17.701586+0000","last_became_peered":"2024-09-17T05:50:17.701586+0000","last_unstale":"2024-09-17T05:50:17.702466+0000","last_undegraded":"2024-09-17T05:50:17.702466+0000","last_fullsized":"2024-09-17T05:50:17.702466+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:50:16.649689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:50:16.649689+0000","last_clean_scrub_stamp":"2024-09-17T05:50:16.649689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:16:56.091340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.26","version":"0'0","reported_seq":13,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-17T05:50:18.686526+0000","last_change":"2024-09-17T05:50:17.689166+0000","last_active":"2024-09-17T05:50:18.686526+0000","last_peered":"2024-09-17T05:50:18.686526+0000","last_clean":"2024-09-17T05:50:18.686526+0000","last_became_active":"2024-09-17T05:50:17.688880+0000","last_became_peered":"2024-09-17T05:50:17.688880+0000","last_unstale":"2024-09-17T05:50:18.686526+0000","last_undegraded":"2024-09-17T05:50:18.686526+0000","last_fullsized":"2024-09-17T05:50:18.686526+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:50:16.649689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:50:16.649689+0000","last_clean_scrub_stamp":"2024-09-17T05:50:16.649689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:23:08.770975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.25","version":"0'0","reported_seq":1,"reported_epoch":99,"state":"creating+peering","last_fresh":"2024-09-17T05:50:16.668754+0000","last_change":"2024-09-17T05:50:16.668754+0000","last_active":"2024-09-17T05:50:16.649689+0000","last_peered":"2024-09-17T05:50:16.649689+0000","last_clean":"2024-09-17T05:50:16.649689+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:50:16.668754+0000","last_undegraded":"2024-09-17T05:50:16.668754+0000","last_fullsized":"2024-09-17T05:50:16.668754+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:50:16.649689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:50:16.649689+0000","last_clean_scrub_stamp":"2024-09-17T05:50:16.649689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.24","version":"0'0","reported_seq":10,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-17T05:50:17.692366+0000","last_change":"2024-09-17T05:50:17.686896+0000","last_active":"2024-09-17T05:50:17.692366+0000","last_peered":"2024-09-17T05:50:17.692366+0000","last_clean":"2024-09-17T05:50:17.692366+0000","last_became_active":"2024-09-17T05:50:17.686613+0000","last_became_peered":"2024-09-17T05:50:17.686613+0000","last_unstale":"2024-09-17T05:50:17.692366+0000","last_undegraded":"2024-09-17T05:50:17.692366+0000","last_fullsized":"2024-09-17T05:50:17.692366+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:50:16.649689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:50:16.649689+0000","last_clean_scrub_stamp":"2024-09-17T05:50:16.649689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:53:41.317085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.23","version":"0'0","reported_seq":13,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-17T05:50:18.686333+0000","last_change":"2024-09-17T05:50:17.693673+0000","last_active":"2024-09-17T05:50:18.686333+0000","last_peered":"2024-09-17T05:50:18.686333+0000","last_clean":"2024-09-17T05:50:18.686333+0000","last_became_active":"2024-09-17T05:50:17.693131+0000","last_became_peered":"2024-09-17T05:50:17.693131+0000","last_unstale":"2024-09-17T05:50:18.686333+0000","last_undegraded":"2024-09-17T05:50:18.686333+0000","last_fullsized":"2024-09-17T05:50:18.686333+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:50:16.649689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:50:16.649689+0000","last_clean_scrub_stamp":"2024-09-17T05:50:16.649689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:31:33.444956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.22","version":"0'0","reported_seq":10,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-17T05:50:17.698202+0000","last_change":"2024-09-17T05:50:17.691649+0000","last_active":"2024-09-17T05:50:17.698202+0000","last_peered":"2024-09-17T05:50:17.698202+0000","last_clean":"2024-09-17T05:50:17.698202+0000","last_became_active":"2024-09-17T05:50:17.691303+0000","last_became_peered":"2024-09-17T05:50:17.691303+0000","last_unstale":"2024-09-17T05:50:17.698202+0000","last_undegraded":"2024-09-17T05:50:17.698202+0000","last_fullsized":"2024-09-17T05:50:17.698202+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:50:16.649689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:50:16.649689+0000","last_clean_scrub_stamp":"2024-09-17T05:50:16.649689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:30:18.752029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.21","version":"0'0","reported_seq":10,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-17T05:50:17.695664+0000","last_change":"2024-09-17T05:50:17.686575+0000","last_active":"2024-09-17T05:50:17.695664+0000","last_peered":"2024-09-17T05:50:17.695664+0000","last_clean":"2024-09-17T05:50:17.695664+0000","last_became_active":"2024-09-17T05:50:17.684031+0000","last_became_peered":"2024-09-17T05:50:17.684031+0000","last_unstale":"2024-09-17T05:50:17.695664+0000","last_undegraded":"2024-09-17T05:50:17.695664+0000","last_fullsized":"2024-09-17T05:50:17.695664+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:50:16.649689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:50:16.649689+0000","last_clean_scrub_stamp":"2024-09-17T05:50:16.649689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:10:39.923888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.20","version":"0'0","reported_seq":10,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-17T05:50:17.698484+0000","last_change":"2024-09-17T05:50:17.690605+0000","last_active":"2024-09-17T05:50:17.698484+0000","last_peered":"2024-09-17T05:50:17.698484+0000","last_clean":"2024-09-17T05:50:17.698484+0000","last_became_active":"2024-09-17T05:50:17.690127+0000","last_became_peered":"2024-09-17T05:50:17.690127+0000","last_unstale":"2024-09-17T05:50:17.698484+0000","last_undegraded":"2024-09-17T05:50:17.698484+0000","last_fullsized":"2024-09-17T05:50:17.698484+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:50:16.649689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:50:16.649689+0000","last_clean_scrub_stamp":"2024-09-17T05:50:16.649689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:27:10.964544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.1e","version":"0'0","reported_seq":10,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-17T05:50:17.683922+0000","last_change":"2024-09-17T05:50:17.678131+0000","last_active":"2024-09-17T05:50:17.683922+0000","last_peered":"2024-09-17T05:50:17.683922+0000","last_clean":"2024-09-17T05:50:17.683922+0000","last_became_active":"2024-09-17T05:50:17.677816+0000","last_became_peered":"2024-09-17T05:50:17.677816+0000","last_unstale":"2024-09-17T05:50:17.683922+0000","last_undegraded":"2024-09-17T05:50:17.683922+0000","last_fullsized":"2024-09-17T05:50:17.683922+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:50:16.649689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:50:16.649689+0000","last_clean_scrub_stamp":"2024-09-17T05:50:16.649689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:55:41.145153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.1f","version":"100'4","reported_seq":19,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-17T05:50:18.686498+0000","last_change":"2024-09-17T05:50:16.666928+0000","last_active":"2024-09-17T05:50:18.686498+0000","last_peered":"2024-09-17T05:50:18.686498+0000","last_clean":"2024-09-17T05:50:18.686498+0000","last_became_active":"2024-09-17T05:50:16.666550+0000","last_became_peered":"2024-09-17T05:50:16.666550+0000","last_unstale":"2024-09-17T05:50:18.686498+0000","last_undegraded":"2024-09-17T05:50:18.686498+0000","last_fullsized":"2024-09-17T05:50:18.686498+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:50:15.639879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:50:15.639879+0000","last_clean_scrub_stamp":"2024-09-17T05:50:15.639879+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:57:05.869839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1f","version":"0'0","reported_seq":10,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-17T05:50:17.689373+0000","last_change":"2024-09-17T05:50:17.684448+0000","last_active":"2024-09-17T05:50:17.689373+0000","last_peered":"2024-09-17T05:50:17.689373+0000","last_clean":"2024-09-17T05:50:17.689373+0000","last_became_active":"2024-09-17T05:50:17.684014+0000","last_became_peered":"2024-09-17T05:50:17.684014+0000","last_unstale":"2024-09-17T05:50:17.689373+0000","last_undegraded":"2024-09-17T05:50:17.689373+0000","last_fullsized":"2024-09-17T05:50:17.689373+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:50:16.649689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:50:16.649689+0000","last_clean_scrub_stamp":"2024-09-17T05:50:16.649689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:55:05.250112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.1e","version":"0'0","reported_seq":10,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-17T05:50:16.676988+0000","last_change":"2024-09-17T05:50:16.676369+0000","last_active":"2024-09-17T05:50:16.676988+0000","last_peered":"2024-09-17T05:50:16.676988+0000","last_clean":"2024-09-17T05:50:16.676988+0000","last_became_active":"2024-09-17T05:50:16.676073+0000","last_became_peered":"2024-09-17T05:50:16.676073+0000","last_unstale":"2024-09-17T05:50:16.676988+0000","last_undegraded":"2024-09-17T05:50:16.676988+0000","last_fullsized":"2024-09-17T05:50:16.676988+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:50:15.639879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:50:15.639879+0000","last_clean_scrub_stamp":"2024-09-17T05:50:15.639879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:59:49.339081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.1c","version":"0'0","reported_seq":10,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-17T05:50:17.689800+0000","last_change":"2024-09-17T05:50:17.686482+0000","last_active":"2024-09-17T05:50:17.689800+0000","last_peered":"2024-09-17T05:50:17.689800+0000","last_clean":"2024-09-17T05:50:17.689800+0000","last_became_active":"2024-09-17T05:50:17.685224+0000","last_became_peered":"2024-09-17T05:50:17.685224+0000","last_unstale":"2024-09-17T05:50:17.689800+0000","last_undegraded":"2024-09-17T05:50:17.689800+0000","last_fullsized":"2024-09-17T05:50:17.689800+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:50:16.649689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:50:16.649689+0000","last_clean_scrub_stamp":"2024-09-17T05:50:16.649689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:43:04.212537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.1d","version":"100'2","reported_seq":17,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-17T05:50:18.686557+0000","last_change":"2024-09-17T05:50:16.678328+0000","last_active":"2024-09-17T05:50:18.686557+0000","last_peered":"2024-09-17T05:50:18.686557+0000","last_clean":"2024-09-17T05:50:18.686557+0000","last_became_active":"2024-09-17T05:50:16.677911+0000","last_became_peered":"2024-09-17T05:50:16.677911+0000","last_unstale":"2024-09-17T05:50:18.686557+0000","last_undegraded":"2024-09-17T05:50:18.686557+0000","last_fullsized":"2024-09-17T05:50:18.686557+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:50:15.639879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:50:15.639879+0000","last_clean_scrub_stamp":"2024-09-17T05:50:15.639879+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:12:56.944695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1d","version":"0'0","reported_seq":1,"reported_epoch":99,"state":"creating+peering","last_fresh":"2024-09-17T05:50:16.655870+0000","last_change":"2024-09-17T05:50:16.655870+0000","last_active":"2024-09-17T05:50:16.649689+0000","last_peered":"2024-09-17T05:50:16.649689+0000","last_clean":"2024-09-17T05:50:16.649689+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:50:16.655870+0000","last_undegraded":"2024-09-17T05:50:16.655870+0000","last_fullsized":"2024-09-17T05:50:16.655870+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:50:16.649689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:50:16.649689+0000","last_clean_scrub_stamp":"2024-09-17T05:50:16.649689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.1c","version":"100'2","reported_seq":17,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-17T05:50:18.686501+0000","last_change":"2024-09-17T05:50:16.677342+0000","last_active":"2024-09-17T05:50:18.686501+0000","last_peered":"2024-09-17T05:50:18.686501+0000","last_clean":"2024-09-17T05:50:18.686501+0000","last_became_active":"2024-09-17T05:50:16.674956+0000","last_became_peered":"2024-09-17T05:50:16.674956+0000","last_unstale":"2024-09-17T05:50:18.686501+0000","last_undegraded":"2024-09-17T05:50:18.686501+0000","last_fullsized":"2024-09-17T05:50:18.686501+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:50:15.639879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:50:15.639879+0000","last_clean_scrub_stamp":"2024-09-17T05:50:15.639879+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:36:51.832130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1a","version":"0'0","reported_seq":1,"reported_epoch":99,"state":"creating+peering","last_fresh":"2024-09-17T05:50:16.655670+0000","last_change":"2024-09-17T05:50:16.655670+0000","last_active":"2024-09-17T05:50:16.649689+0000","last_peered":"2024-09-17T05:50:16.649689+0000","last_clean":"2024-09-17T05:50:16.649689+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:50:16.655670+0000","last_undegraded":"2024-09-17T05:50:16.655670+0000","last_fullsized":"2024-09-17T05:50:16.655670+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:50:16.649689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:50:16.649689+0000","last_clean_scrub_stamp":"2024-09-17T05:50:16.649689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.1b","version":"100'1","reported_seq":14,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-17T05:50:17.699861+0000","last_change":"2024-09-17T05:50:16.671491+0000","last_active":"2024-09-17T05:50:17.699861+0000","last_peered":"2024-09-17T05:50:17.699861+0000","last_clean":"2024-09-17T05:50:17.699861+0000","last_became_active":"2024-09-17T05:50:16.671150+0000","last_became_peered":"2024-09-17T05:50:16.671150+0000","last_unstale":"2024-09-17T05:50:17.699861+0000","last_undegraded":"2024-09-17T05:50:17.699861+0000","last_fullsized":"2024-09-17T05:50:17.699861+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:50:15.639879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:50:15.639879+0000","last_clean_scrub_stamp":"2024-09-17T05:50:15.639879+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:56:38.653716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.1b","version":"0'0","reported_seq":1,"reported_epoch":99,"state":"creating+peering","last_fresh":"2024-09-17T05:50:16.664625+0000","last_change":"2024-09-17T05:50:16.664625+0000","last_active":"2024-09-17T05:50:16.649689+0000","last_peered":"2024-09-17T05:50:16.649689+0000","last_clean":"2024-09-17T05:50:16.649689+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:50:16.664625+0000","last_undegraded":"2024-09-17T05:50:16.664625+0000","last_fullsized":"2024-09-17T05:50:16.664625+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:50:16.649689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:50:16.649689+0000","last_clean_scrub_stamp":"2024-09-17T05:50:16.649689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.1a","version":"100'1","reported_seq":16,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-17T05:50:18.686071+0000","last_change":"2024-09-17T05:50:16.673854+0000","last_active":"2024-09-17T05:50:18.686071+0000","last_peered":"2024-09-17T05:50:18.686071+0000","last_clean":"2024-09-17T05:50:18.686071+0000","last_became_active":"2024-09-17T05:50:16.673522+0000","last_became_peered":"2024-09-17T05:50:16.673522+0000","last_unstale":"2024-09-17T05:50:18.686071+0000","last_undegraded":"2024-09-17T05:50:18.686071+0000","last_fullsized":"2024-09-17T05:50:18.686071+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:50:15.639879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:50:15.639879+0000","last_clean_scrub_stamp":"2024-09-17T05:50:15.639879+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:05:57.341308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.18","version":"0'0","reported_seq":10,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-17T05:50:17.690825+0000","last_change":"2024-09-17T05:50:17.684654+0000","last_active":"2024-09-17T05:50:17.690825+0000","last_peered":"2024-09-17T05:50:17.690825+0000","last_clean":"2024-09-17T05:50:17.690825+0000","last_became_active":"2024-09-17T05:50:17.684313+0000","last_became_peered":"2024-09-17T05:50:17.684313+0000","last_unstale":"2024-09-17T05:50:17.690825+0000","last_undegraded":"2024-09-17T05:50:17.690825+0000","last_fullsized":"2024-09-17T05:50:17.690825+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:50:16.649689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:50:16.649689+0000","last_clean_scrub_stamp":"2024-09-17T05:50:16.649689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:45:12.092469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.19","version":"0'0","reported_seq":13,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-17T05:50:17.680947+0000","last_change":"2024-09-17T05:50:16.674238+0000","last_active":"2024-09-17T05:50:17.680947+0000","last_peered":"2024-09-17T05:50:17.680947+0000","last_clean":"2024-09-17T05:50:17.680947+0000","last_became_active":"2024-09-17T05:50:16.673875+0000","last_became_peered":"2024-09-17T05:50:16.673875+0000","last_unstale":"2024-09-17T05:50:17.680947+0000","last_undegraded":"2024-09-17T05:50:17.680947+0000","last_fullsized":"2024-09-17T05:50:17.680947+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:50:15.639879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:50:15.639879+0000","last_clean_scrub_stamp":"2024-09-17T05:50:15.639879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:01:35.637247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.19","version":"0'0","reported_seq":1,"reported_epoch":99,"state":"creating+peering","last_fresh":"2024-09-17T05:50:16.655280+0000","last_change":"2024-09-17T05:50:16.655280+0000","last_active":"2024-09-17T05:50:16.649689+0000","last_peered":"2024-09-17T05:50:16.649689+0000","last_clean":"2024-09-17T05:50:16.649689+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:50:16.655280+0000","last_undegraded":"2024-09-17T05:50:16.655280+0000","last_fullsized":"2024-09-17T05:50:16.655280+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:50:16.649689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:50:16.649689+0000","last_clean_scrub_stamp":"2024-09-17T05:50:16.649689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.18","version":"0'0","reported_seq":13,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-17T05:50:17.675065+0000","last_change":"2024-09-17T05:50:16.672581+0000","last_active":"2024-09-17T05:50:17.675065+0000","last_peered":"2024-09-17T05:50:17.675065+0000","last_clean":"2024-09-17T05:50:17.675065+0000","last_became_active":"2024-09-17T05:50:16.671816+0000","last_became_peered":"2024-09-17T05:50:16.671816+0000","last_unstale":"2024-09-17T05:50:17.675065+0000","last_undegraded":"2024-09-17T05:50:17.675065+0000","last_fullsized":"2024-09-17T05:50:17.675065+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:50:15.639879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:50:15.639879+0000","last_clean_scrub_stamp":"2024-09-17T05:50:15.639879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:38:42.681739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.16","version":"0'0","reported_seq":13,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-17T05:50:18.686665+0000","last_change":"2024-09-17T05:50:17.686260+0000","last_active":"2024-09-17T05:50:18.686665+0000","last_peered":"2024-09-17T05:50:18.686665+0000","last_clean":"2024-09-17T05:50:18.686665+0000","last_became_active":"2024-09-17T05:50:17.685507+0000","last_became_peered":"2024-09-17T05:50:17.685507+0000","last_unstale":"2024-09-17T05:50:18.686665+0000","last_undegraded":"2024-09-17T05:50:18.686665+0000","last_fullsized":"2024-09-17T05:50:18.686665+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:50:16.649689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:50:16.649689+0000","last_clean_scrub_stamp":"2024-09-17T05:50:16.649689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:46:25.261334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.17","version":"0'0","reported_seq":13,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-17T05:50:17.676384+0000","last_change":"2024-09-17T05:50:16.666782+0000","last_active":"2024-09-17T05:50:17.676384+0000","last_peered":"2024-09-17T05:50:17.676384+0000","last_clean":"2024-09-17T05:50:17.676384+0000","last_became_active":"2024-09-17T05:50:16.666353+0000","last_became_peered":"2024-09-17T05:50:16.666353+0000","last_unstale":"2024-09-17T05:50:17.676384+0000","last_undegraded":"2024-09-17T05:50:17.676384+0000","last_fullsized":"2024-09-17T05:50:17.676384+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:50:15.639879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:50:15.639879+0000","last_clean_scrub_stamp":"2024-09-17T05:50:15.639879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:08:52.158143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.17","version":"0'0","reported_seq":1,"reported_epoch":99,"state":"creating+peering","last_fresh":"2024-09-17T05:50:16.656309+0000","last_change":"2024-09-17T05:50:16.656309+0000","last_active":"2024-09-17T05:50:16.649689+0000","last_peered":"2024-09-17T05:50:16.649689+0000","last_clean":"2024-09-17T05:50:16.649689+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:50:16.656309+0000","last_undegraded":"2024-09-17T05:50:16.656309+0000","last_fullsized":"2024-09-17T05:50:16.656309+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:50:16.649689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:50:16.649689+0000","last_clean_scrub_stamp":"2024-09-17T05:50:16.649689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.16","version":"0'0","reported_seq":13,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-17T05:50:17.666312+0000","last_change":"2024-09-17T05:50:16.666739+0000","last_active":"2024-09-17T05:50:17.666312+0000","last_peered":"2024-09-17T05:50:17.666312+0000","last_clean":"2024-09-17T05:50:17.666312+0000","last_became_active":"2024-09-17T05:50:16.666351+0000","last_became_peered":"2024-09-17T05:50:16.666351+0000","last_unstale":"2024-09-17T05:50:17.666312+0000","last_undegraded":"2024-09-17T05:50:17.666312+0000","last_fullsized":"2024-09-17T05:50:17.666312+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:50:15.639879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:50:15.639879+0000","last_clean_scrub_stamp":"2024-09-17T05:50:15.639879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:02:39.092792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.14","version":"0'0","reported_seq":10,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-17T05:50:17.701434+0000","last_change":"2024-09-17T05:50:17.700910+0000","last_active":"2024-09-17T05:50:17.701434+0000","last_peered":"2024-09-17T05:50:17.701434+0000","last_clean":"2024-09-17T05:50:17.701434+0000","last_became_active":"2024-09-17T05:50:17.700244+0000","last_became_peered":"2024-09-17T05:50:17.700244+0000","last_unstale":"2024-09-17T05:50:17.701434+0000","last_undegraded":"2024-09-17T05:50:17.701434+0000","last_fullsized":"2024-09-17T05:50:17.701434+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:50:16.649689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:50:16.649689+0000","last_clean_scrub_stamp":"2024-09-17T05:50:16.649689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:52:27.459055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.15","version":"0'0","reported_seq":10,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-17T05:50:16.674056+0000","last_change":"2024-09-17T05:50:16.673400+0000","last_active":"2024-09-17T05:50:16.674056+0000","last_peered":"2024-09-17T05:50:16.674056+0000","last_clean":"2024-09-17T05:50:16.674056+0000","last_became_active":"2024-09-17T05:50:16.673068+0000","last_became_peered":"2024-09-17T05:50:16.673068+0000","last_unstale":"2024-09-17T05:50:16.674056+0000","last_undegraded":"2024-09-17T05:50:16.674056+0000","last_fullsized":"2024-09-17T05:50:16.674056+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:50:15.639879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:50:15.639879+0000","last_clean_scrub_stamp":"2024-09-17T05:50:15.639879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:25:35.372566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.15","version":"0'0","reported_seq":1,"reported_epoch":99,"state":"creating+peering","last_fresh":"2024-09-17T05:50:16.666417+0000","last_change":"2024-09-17T05:50:16.666417+0000","last_active":"2024-09-17T05:50:16.649689+0000","last_peered":"2024-09-17T05:50:16.649689+0000","last_clean":"2024-09-17T05:50:16.649689+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:50:16.666417+0000","last_undegraded":"2024-09-17T05:50:16.666417+0000","last_fullsized":"2024-09-17T05:50:16.666417+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:50:16.649689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:50:16.649689+0000","last_clean_scrub_stamp":"2024-09-17T05:50:16.649689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.14","version":"0'0","reported_seq":10,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-17T05:50:16.666657+0000","last_change":"2024-09-17T05:50:16.663464+0000","last_active":"2024-09-17T05:50:16.666657+0000","last_peered":"2024-09-17T05:50:16.666657+0000","last_clean":"2024-09-17T05:50:16.666657+0000","last_became_active":"2024-09-17T05:50:16.663147+0000","last_became_peered":"2024-09-17T05:50:16.663147+0000","last_unstale":"2024-09-17T05:50:16.666657+0000","last_undegraded":"2024-09-17T05:50:16.666657+0000","last_fullsized":"2024-09-17T05:50:16.666657+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:50:15.639879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:50:15.639879+0000","last_clean_scrub_stamp":"2024-09-17T05:50:15.639879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:34:08.028316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.12","version":"0'0","reported_seq":10,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-17T05:50:17.680089+0000","last_change":"2024-09-17T05:50:17.678910+0000","last_active":"2024-09-17T05:50:17.680089+0000","last_peered":"2024-09-17T05:50:17.680089+0000","last_clean":"2024-09-17T05:50:17.680089+0000","last_became_active":"2024-09-17T05:50:17.678520+0000","last_became_peered":"2024-09-17T05:50:17.678520+0000","last_unstale":"2024-09-17T05:50:17.680089+0000","last_undegraded":"2024-09-17T05:50:17.680089+0000","last_fullsized":"2024-09-17T05:50:17.680089+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:50:16.649689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:50:16.649689+0000","last_clean_scrub_stamp":"2024-09-17T05:50:16.649689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:54:33.658300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.13","version":"100'2","reported_seq":15,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-17T05:50:17.699288+0000","last_change":"2024-09-17T05:50:16.677999+0000","last_active":"2024-09-17T05:50:17.699288+0000","last_peered":"2024-09-17T05:50:17.699288+0000","last_clean":"2024-09-17T05:50:17.699288+0000","last_became_active":"2024-09-17T05:50:16.677675+0000","last_became_peered":"2024-09-17T05:50:16.677675+0000","last_unstale":"2024-09-17T05:50:17.699288+0000","last_undegraded":"2024-09-17T05:50:17.699288+0000","last_fullsized":"2024-09-17T05:50:17.699288+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:50:15.639879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:50:15.639879+0000","last_clean_scrub_stamp":"2024-09-17T05:50:15.639879+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:52:12.200476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.13","version":"0'0","reported_seq":10,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-17T05:50:17.695914+0000","last_change":"2024-09-17T05:50:17.683595+0000","last_active":"2024-09-17T05:50:17.695914+0000","last_peered":"2024-09-17T05:50:17.695914+0000","last_clean":"2024-09-17T05:50:17.695914+0000","last_became_active":"2024-09-17T05:50:17.683280+0000","last_became_peered":"2024-09-17T05:50:17.683280+0000","last_unstale":"2024-09-17T05:50:17.695914+0000","last_undegraded":"2024-09-17T05:50:17.695914+0000","last_fullsized":"2024-09-17T05:50:17.695914+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:50:16.649689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:50:16.649689+0000","last_clean_scrub_stamp":"2024-09-17T05:50:16.649689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:52:17.955004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.12","version":"0'0","reported_seq":13,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-17T05:50:17.672150+0000","last_change":"2024-09-17T05:50:16.672657+0000","last_active":"2024-09-17T05:50:17.672150+0000","last_peered":"2024-09-17T05:50:17.672150+0000","last_clean":"2024-09-17T05:50:17.672150+0000","last_became_active":"2024-09-17T05:50:16.672353+0000","last_became_peered":"2024-09-17T05:50:16.672353+0000","last_unstale":"2024-09-17T05:50:17.672150+0000","last_undegraded":"2024-09-17T05:50:17.672150+0000","last_fullsized":"2024-09-17T05:50:17.672150+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:50:15.639879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:50:15.639879+0000","last_clean_scrub_stamp":"2024-09-17T05:50:15.639879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:31:01.840132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.10","version":"0'0","reported_seq":1,"reported_epoch":99,"state":"creating+peering","last_fresh":"2024-09-17T05:50:16.655229+0000","last_change":"2024-09-17T05:50:16.655229+0000","last_active":"2024-09-17T05:50:16.649689+0000","last_peered":"2024-09-17T05:50:16.649689+0000","last_clean":"2024-09-17T05:50:16.649689+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:50:16.655229+0000","last_undegraded":"2024-09-17T05:50:16.655229+0000","last_fullsized":"2024-09-17T05:50:16.655229+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:50:16.649689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:50:16.649689+0000","last_clean_scrub_stamp":"2024-09-17T05:50:16.649689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.11","version":"0'0","reported_seq":10,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-17T05:50:16.666735+0000","last_change":"2024-09-17T05:50:16.663949+0000","last_active":"2024-09-17T05:50:16.666735+0000","last_peered":"2024-09-17T05:50:16.666735+0000","last_clean":"2024-09-17T05:50:16.666735+0000","last_became_active":"2024-09-17T05:50:16.663594+0000","last_became_peered":"2024-09-17T05:50:16.663594+0000","last_unstale":"2024-09-17T05:50:16.666735+0000","last_undegraded":"2024-09-17T05:50:16.666735+0000","last_fullsized":"2024-09-17T05:50:16.666735+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:50:15.639879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:50:15.639879+0000","last_clean_scrub_stamp":"2024-09-17T05:50:15.639879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:32:04.915100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.11","version":"0'0","reported_seq":10,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-17T05:50:17.676653+0000","last_change":"2024-09-17T05:50:17.673526+0000","last_active":"2024-09-17T05:50:17.676653+0000","last_peered":"2024-09-17T05:50:17.676653+0000","last_clean":"2024-09-17T05:50:17.676653+0000","last_became_active":"2024-09-17T05:50:17.673209+0000","last_became_peered":"2024-09-17T05:50:17.673209+0000","last_unstale":"2024-09-17T05:50:17.676653+0000","last_undegraded":"2024-09-17T05:50:17.676653+0000","last_fullsized":"2024-09-17T05:50:17.676653+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:50:16.649689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:50:16.649689+0000","last_clean_scrub_stamp":"2024-09-17T05:50:16.649689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:45:11.588427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.10","version":"100'8","reported_seq":21,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-17T05:50:17.701091+0000","last_change":"2024-09-17T05:50:16.671667+0000","last_active":"2024-09-17T05:50:17.701091+0000","last_peered":"2024-09-17T05:50:17.701091+0000","last_clean":"2024-09-17T05:50:17.701091+0000","last_became_active":"2024-09-17T05:50:16.671069+0000","last_became_peered":"2024-09-17T05:50:16.671069+0000","last_unstale":"2024-09-17T05:50:17.701091+0000","last_undegraded":"2024-09-17T05:50:17.701091+0000","last_fullsized":"2024-09-17T05:50:17.701091+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:50:15.639879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:50:15.639879+0000","last_clean_scrub_stamp":"2024-09-17T05:50:15.639879+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:54:11.413425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.f","version":"0'0","reported_seq":10,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-17T05:50:17.694467+0000","last_change":"2024-09-17T05:50:17.693101+0000","last_active":"2024-09-17T05:50:17.694467+0000","last_peered":"2024-09-17T05:50:17.694467+0000","last_clean":"2024-09-17T05:50:17.694467+0000","last_became_active":"2024-09-17T05:50:17.692530+0000","last_became_peered":"2024-09-17T05:50:17.692530+0000","last_unstale":"2024-09-17T05:50:17.694467+0000","last_undegraded":"2024-09-17T05:50:17.694467+0000","last_fullsized":"2024-09-17T05:50:17.694467+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:50:16.649689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:50:16.649689+0000","last_clean_scrub_stamp":"2024-09-17T05:50:16.649689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:00:10.128109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.e","version":"0'0","reported_seq":10,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-17T05:50:16.677298+0000","last_change":"2024-09-17T05:50:16.676692+0000","last_active":"2024-09-17T05:50:16.677298+0000","last_peered":"2024-09-17T05:50:16.677298+0000","last_clean":"2024-09-17T05:50:16.677298+0000","last_became_active":"2024-09-17T05:50:16.676330+0000","last_became_peered":"2024-09-17T05:50:16.676330+0000","last_unstale":"2024-09-17T05:50:16.677298+0000","last_undegraded":"2024-09-17T05:50:16.677298+0000","last_fullsized":"2024-09-17T05:50:16.677298+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:50:15.639879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:50:15.639879+0000","last_clean_scrub_stamp":"2024-09-17T05:50:15.639879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:01:43.584924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.c","version":"0'0","reported_seq":1,"reported_epoch":99,"state":"creating+peering","last_fresh":"2024-09-17T05:50:16.655146+0000","last_change":"2024-09-17T05:50:16.655146+0000","last_active":"2024-09-17T05:50:16.649689+0000","last_peered":"2024-09-17T05:50:16.649689+0000","last_clean":"2024-09-17T05:50:16.649689+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:50:16.655146+0000","last_undegraded":"2024-09-17T05:50:16.655146+0000","last_fullsized":"2024-09-17T05:50:16.655146+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:50:16.649689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:50:16.649689+0000","last_clean_scrub_stamp":"2024-09-17T05:50:16.649689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.d","version":"100'1","reported_seq":14,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-17T05:50:17.702271+0000","last_change":"2024-09-17T05:50:16.663432+0000","last_active":"2024-09-17T05:50:17.702271+0000","last_peered":"2024-09-17T05:50:17.702271+0000","last_clean":"2024-09-17T05:50:17.702271+0000","last_became_active":"2024-09-17T05:50:16.663096+0000","last_became_peered":"2024-09-17T05:50:16.663096+0000","last_unstale":"2024-09-17T05:50:17.702271+0000","last_undegraded":"2024-09-17T05:50:17.702271+0000","last_fullsized":"2024-09-17T05:50:17.702271+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:50:15.639879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:50:15.639879+0000","last_clean_scrub_stamp":"2024-09-17T05:50:15.639879+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:31:07.149126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.d","version":"0'0","reported_seq":1,"reported_epoch":99,"state":"creating+peering","last_fresh":"2024-09-17T05:50:16.664714+0000","last_change":"2024-09-17T05:50:16.664714+0000","last_active":"2024-09-17T05:50:16.649689+0000","last_peered":"2024-09-17T05:50:16.649689+0000","last_clean":"2024-09-17T05:50:16.649689+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:50:16.664714+0000","last_undegraded":"2024-09-17T05:50:16.664714+0000","last_fullsized":"2024-09-17T05:50:16.664714+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:50:16.649689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:50:16.649689+0000","last_clean_scrub_stamp":"2024-09-17T05:50:16.649689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.c","version":"0'0","reported_seq":15,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-17T05:50:18.686186+0000","last_change":"2024-09-17T05:50:16.676827+0000","last_active":"2024-09-17T05:50:18.686186+0000","last_peered":"2024-09-17T05:50:18.686186+0000","last_clean":"2024-09-17T05:50:18.686186+0000","last_became_active":"2024-09-17T05:50:16.674588+0000","last_became_peered":"2024-09-17T05:50:16.674588+0000","last_unstale":"2024-09-17T05:50:18.686186+0000","last_undegraded":"2024-09-17T05:50:18.686186+0000","last_fullsized":"2024-09-17T05:50:18.686186+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:50:15.639879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:50:15.639879+0000","last_clean_scrub_stamp":"2024-09-17T05:50:15.639879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:41:10.083935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.a","version":"0'0","reported_seq":10,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-17T05:50:17.691508+0000","last_change":"2024-09-17T05:50:17.682895+0000","last_active":"2024-09-17T05:50:17.691508+0000","last_peered":"2024-09-17T05:50:17.691508+0000","last_clean":"2024-09-17T05:50:17.691508+0000","last_became_active":"2024-09-17T05:50:17.682597+0000","last_became_peered":"2024-09-17T05:50:17.682597+0000","last_unstale":"2024-09-17T05:50:17.691508+0000","last_undegraded":"2024-09-17T05:50:17.691508+0000","last_fullsized":"2024-09-17T05:50:17.691508+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:50:16.649689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:50:16.649689+0000","last_clean_scrub_stamp":"2024-09-17T05:50:16.649689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:08:03.346563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.b","version":"100'2","reported_seq":17,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-17T05:50:18.686463+0000","last_change":"2024-09-17T05:50:16.678475+0000","last_active":"2024-09-17T05:50:18.686463+0000","last_peered":"2024-09-17T05:50:18.686463+0000","last_clean":"2024-09-17T05:50:18.686463+0000","last_became_active":"2024-09-17T05:50:16.677955+0000","last_became_peered":"2024-09-17T05:50:16.677955+0000","last_unstale":"2024-09-17T05:50:18.686463+0000","last_undegraded":"2024-09-17T05:50:18.686463+0000","last_fullsized":"2024-09-17T05:50:18.686463+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:50:15.639879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:50:15.639879+0000","last_clean_scrub_stamp":"2024-09-17T05:50:15.639879+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:30:59.350580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.b","version":"0'0","reported_seq":10,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-17T05:50:17.697857+0000","last_change":"2024-09-17T05:50:17.690262+0000","last_active":"2024-09-17T05:50:17.697857+0000","last_peered":"2024-09-17T05:50:17.697857+0000","last_clean":"2024-09-17T05:50:17.697857+0000","last_became_active":"2024-09-17T05:50:17.689973+0000","last_became_peered":"2024-09-17T05:50:17.689973+0000","last_unstale":"2024-09-17T05:50:17.697857+0000","last_undegraded":"2024-09-17T05:50:17.697857+0000","last_fullsized":"2024-09-17T05:50:17.697857+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:50:16.649689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:50:16.649689+0000","last_clean_scrub_stamp":"2024-09-17T05:50:16.649689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:07:11.041448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.a","version":"0'0","reported_seq":10,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-17T05:50:16.672947+0000","last_change":"2024-09-17T05:50:16.672269+0000","last_active":"2024-09-17T05:50:16.672947+0000","last_peered":"2024-09-17T05:50:16.672947+0000","last_clean":"2024-09-17T05:50:16.672947+0000","last_became_active":"2024-09-17T05:50:16.671875+0000","last_became_peered":"2024-09-17T05:50:16.671875+0000","last_unstale":"2024-09-17T05:50:16.672947+0000","last_undegraded":"2024-09-17T05:50:16.672947+0000","last_fullsized":"2024-09-17T05:50:16.672947+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:50:15.639879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:50:15.639879+0000","last_clean_scrub_stamp":"2024-09-17T05:50:15.639879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:45:53.339111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.8","version":"0'0","reported_seq":10,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-17T05:50:17.678457+0000","last_change":"2024-09-17T05:50:17.675705+0000","last_active":"2024-09-17T05:50:17.678457+0000","last_peered":"2024-09-17T05:50:17.678457+0000","last_clean":"2024-09-17T05:50:17.678457+0000","last_became_active":"2024-09-17T05:50:17.674936+0000","last_became_peered":"2024-09-17T05:50:17.674936+0000","last_unstale":"2024-09-17T05:50:17.678457+0000","last_undegraded":"2024-09-17T05:50:17.678457+0000","last_fullsized":"2024-09-17T05:50:17.678457+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:50:16.649689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:50:16.649689+0000","last_clean_scrub_stamp":"2024-09-17T05:50:16.649689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:43:33.495433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.9","version":"0'0","reported_seq":10,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-17T05:50:16.665701+0000","last_change":"2024-09-17T05:50:16.663708+0000","last_active":"2024-09-17T05:50:16.665701+0000","last_peered":"2024-09-17T05:50:16.665701+0000","last_clean":"2024-09-17T05:50:16.665701+0000","last_became_active":"2024-09-17T05:50:16.663348+0000","last_became_peered":"2024-09-17T05:50:16.663348+0000","last_unstale":"2024-09-17T05:50:16.665701+0000","last_undegraded":"2024-09-17T05:50:16.665701+0000","last_fullsized":"2024-09-17T05:50:16.665701+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:50:15.639879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:50:15.639879+0000","last_clean_scrub_stamp":"2024-09-17T05:50:15.639879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:09:03.844072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.9","version":"0'0","reported_seq":10,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-17T05:50:17.692330+0000","last_change":"2024-09-17T05:50:17.687159+0000","last_active":"2024-09-17T05:50:17.692330+0000","last_peered":"2024-09-17T05:50:17.692330+0000","last_clean":"2024-09-17T05:50:17.692330+0000","last_became_active":"2024-09-17T05:50:17.686709+0000","last_became_peered":"2024-09-17T05:50:17.686709+0000","last_unstale":"2024-09-17T05:50:17.692330+0000","last_undegraded":"2024-09-17T05:50:17.692330+0000","last_fullsized":"2024-09-17T05:50:17.692330+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:50:16.649689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:50:16.649689+0000","last_clean_scrub_stamp":"2024-09-17T05:50:16.649689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:23:53.419421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.8","version":"0'0","reported_seq":15,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-17T05:50:18.686083+0000","last_change":"2024-09-17T05:50:16.673662+0000","last_active":"2024-09-17T05:50:18.686083+0000","last_peered":"2024-09-17T05:50:18.686083+0000","last_clean":"2024-09-17T05:50:18.686083+0000","last_became_active":"2024-09-17T05:50:16.673056+0000","last_became_peered":"2024-09-17T05:50:16.673056+0000","last_unstale":"2024-09-17T05:50:18.686083+0000","last_undegraded":"2024-09-17T05:50:18.686083+0000","last_fullsized":"2024-09-17T05:50:18.686083+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:50:15.639879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:50:15.639879+0000","last_clean_scrub_stamp":"2024-09-17T05:50:15.639879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:10:01.927806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.6","version":"0'0","reported_seq":13,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-17T05:50:18.686719+0000","last_change":"2024-09-17T05:50:17.684990+0000","last_active":"2024-09-17T05:50:18.686719+0000","last_peered":"2024-09-17T05:50:18.686719+0000","last_clean":"2024-09-17T05:50:18.686719+0000","last_became_active":"2024-09-17T05:50:17.684521+0000","last_became_peered":"2024-09-17T05:50:17.684521+0000","last_unstale":"2024-09-17T05:50:18.686719+0000","last_undegraded":"2024-09-17T05:50:18.686719+0000","last_fullsized":"2024-09-17T05:50:18.686719+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:50:16.649689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:50:16.649689+0000","last_clean_scrub_stamp":"2024-09-17T05:50:16.649689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:00:23.826449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.7","version":"0'0","reported_seq":10,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-17T05:50:16.665838+0000","last_change":"2024-09-17T05:50:16.663678+0000","last_active":"2024-09-17T05:50:16.665838+0000","last_peered":"2024-09-17T05:50:16.665838+0000","last_clean":"2024-09-17T05:50:16.665838+0000","last_became_active":"2024-09-17T05:50:16.663332+0000","last_became_peered":"2024-09-17T05:50:16.663332+0000","last_unstale":"2024-09-17T05:50:16.665838+0000","last_undegraded":"2024-09-17T05:50:16.665838+0000","last_fullsized":"2024-09-17T05:50:16.665838+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:50:15.639879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:50:15.639879+0000","last_clean_scrub_stamp":"2024-09-17T05:50:15.639879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:57:42.985502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.7","version":"0'0","reported_seq":10,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-17T05:50:17.683380+0000","last_change":"2024-09-17T05:50:17.680146+0000","last_active":"2024-09-17T05:50:17.683380+0000","last_peered":"2024-09-17T05:50:17.683380+0000","last_clean":"2024-09-17T05:50:17.683380+0000","last_became_active":"2024-09-17T05:50:17.679833+0000","last_became_peered":"2024-09-17T05:50:17.679833+0000","last_unstale":"2024-09-17T05:50:17.683380+0000","last_undegraded":"2024-09-17T05:50:17.683380+0000","last_fullsized":"2024-09-17T05:50:17.683380+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:50:16.649689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:50:16.649689+0000","last_clean_scrub_stamp":"2024-09-17T05:50:16.649689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:34:43.730314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.6","version":"101'1","reported_seq":16,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-17T05:50:18.687959+0000","last_change":"2024-09-17T05:50:16.676247+0000","last_active":"2024-09-17T05:50:18.687959+0000","last_peered":"2024-09-17T05:50:18.687959+0000","last_clean":"2024-09-17T05:50:18.687959+0000","last_became_active":"2024-09-17T05:50:16.674892+0000","last_became_peered":"2024-09-17T05:50:16.674892+0000","last_unstale":"2024-09-17T05:50:18.687959+0000","last_undegraded":"2024-09-17T05:50:18.687959+0000","last_fullsized":"2024-09-17T05:50:18.687959+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:50:15.639879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:50:15.639879+0000","last_clean_scrub_stamp":"2024-09-17T05:50:15.639879+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:30:08.711913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.4","version":"0'0","reported_seq":10,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-17T05:50:17.700701+0000","last_change":"2024-09-17T05:50:17.694044+0000","last_active":"2024-09-17T05:50:17.700701+0000","last_peered":"2024-09-17T05:50:17.700701+0000","last_clean":"2024-09-17T05:50:17.700701+0000","last_became_active":"2024-09-17T05:50:17.693724+0000","last_became_peered":"2024-09-17T05:50:17.693724+0000","last_unstale":"2024-09-17T05:50:17.700701+0000","last_undegraded":"2024-09-17T05:50:17.700701+0000","last_fullsized":"2024-09-17T05:50:17.700701+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:50:16.649689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:50:16.649689+0000","last_clean_scrub_stamp":"2024-09-17T05:50:16.649689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:00:14.576200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.5","version":"0'0","reported_seq":15,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-17T05:50:18.686425+0000","last_change":"2024-09-17T05:50:16.679037+0000","last_active":"2024-09-17T05:50:18.686425+0000","last_peered":"2024-09-17T05:50:18.686425+0000","last_clean":"2024-09-17T05:50:18.686425+0000","last_became_active":"2024-09-17T05:50:16.678604+0000","last_became_peered":"2024-09-17T05:50:16.678604+0000","last_unstale":"2024-09-17T05:50:18.686425+0000","last_undegraded":"2024-09-17T05:50:18.686425+0000","last_fullsized":"2024-09-17T05:50:18.686425+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:50:15.639879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:50:15.639879+0000","last_clean_scrub_stamp":"2024-09-17T05:50:15.639879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:31:44.846045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.5","version":"0'0","reported_seq":10,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-17T05:50:17.688492+0000","last_change":"2024-09-17T05:50:17.684200+0000","last_active":"2024-09-17T05:50:17.688492+0000","last_peered":"2024-09-17T05:50:17.688492+0000","last_clean":"2024-09-17T05:50:17.688492+0000","last_became_active":"2024-09-17T05:50:17.683866+0000","last_became_peered":"2024-09-17T05:50:17.683866+0000","last_unstale":"2024-09-17T05:50:17.688492+0000","last_undegraded":"2024-09-17T05:50:17.688492+0000","last_fullsized":"2024-09-17T05:50:17.688492+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:50:16.649689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:50:16.649689+0000","last_clean_scrub_stamp":"2024-09-17T05:50:16.649689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:45:29.227941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.4","version":"0'0","reported_seq":13,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-17T05:50:17.682877+0000","last_change":"2024-09-17T05:50:16.669515+0000","last_active":"2024-09-17T05:50:17.682877+0000","last_peered":"2024-09-17T05:50:17.682877+0000","last_clean":"2024-09-17T05:50:17.682877+0000","last_became_active":"2024-09-17T05:50:16.669123+0000","last_became_peered":"2024-09-17T05:50:16.669123+0000","last_unstale":"2024-09-17T05:50:17.682877+0000","last_undegraded":"2024-09-17T05:50:17.682877+0000","last_fullsized":"2024-09-17T05:50:17.682877+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:50:15.639879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:50:15.639879+0000","last_clean_scrub_stamp":"2024-09-17T05:50:15.639879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:36:09.486712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.2","version":"0'0","reported_seq":10,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-17T05:50:17.699104+0000","last_change":"2024-09-17T05:50:17.694213+0000","last_active":"2024-09-17T05:50:17.699104+0000","last_peered":"2024-09-17T05:50:17.699104+0000","last_clean":"2024-09-17T05:50:17.699104+0000","last_became_active":"2024-09-17T05:50:17.684089+0000","last_became_peered":"2024-09-17T05:50:17.684089+0000","last_unstale":"2024-09-17T05:50:17.699104+0000","last_undegraded":"2024-09-17T05:50:17.699104+0000","last_fullsized":"2024-09-17T05:50:17.699104+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:50:16.649689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:50:16.649689+0000","last_clean_scrub_stamp":"2024-09-17T05:50:16.649689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:58:43.708570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.3","version":"0'0","reported_seq":15,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-17T05:50:18.686471+0000","last_change":"2024-09-17T05:50:16.669971+0000","last_active":"2024-09-17T05:50:18.686471+0000","last_peered":"2024-09-17T05:50:18.686471+0000","last_clean":"2024-09-17T05:50:18.686471+0000","last_became_active":"2024-09-17T05:50:16.667502+0000","last_became_peered":"2024-09-17T05:50:16.667502+0000","last_unstale":"2024-09-17T05:50:18.686471+0000","last_undegraded":"2024-09-17T05:50:18.686471+0000","last_fullsized":"2024-09-17T05:50:18.686471+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:50:15.639879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:50:15.639879+0000","last_clean_scrub_stamp":"2024-09-17T05:50:15.639879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:15:08.648001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.3","version":"0'0","reported_seq":1,"reported_epoch":99,"state":"creating+peering","last_fresh":"2024-09-17T05:50:16.655898+0000","last_change":"2024-09-17T05:50:16.655898+0000","last_active":"2024-09-17T05:50:16.649689+0000","last_peered":"2024-09-17T05:50:16.649689+0000","last_clean":"2024-09-17T05:50:16.649689+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:50:16.655898+0000","last_undegraded":"2024-09-17T05:50:16.655898+0000","last_fullsized":"2024-09-17T05:50:16.655898+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:50:16.649689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:50:16.649689+0000","last_clean_scrub_stamp":"2024-09-17T05:50:16.649689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.2","version":"0'0","reported_seq":13,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-17T05:50:17.679835+0000","last_change":"2024-09-17T05:50:16.672742+0000","last_active":"2024-09-17T05:50:17.679835+0000","last_peered":"2024-09-17T05:50:17.679835+0000","last_clean":"2024-09-17T05:50:17.679835+0000","last_became_active":"2024-09-17T05:50:16.672357+0000","last_became_peered":"2024-09-17T05:50:16.672357+0000","last_unstale":"2024-09-17T05:50:17.679835+0000","last_undegraded":"2024-09-17T05:50:17.679835+0000","last_fullsized":"2024-09-17T05:50:17.679835+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:50:15.639879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:50:15.639879+0000","last_clean_scrub_stamp":"2024-09-17T05:50:15.639879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:30:35.738894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.0","version":"0'0","reported_seq":10,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-17T05:50:17.678422+0000","last_change":"2024-09-17T05:50:17.675260+0000","last_active":"2024-09-17T05:50:17.678422+0000","last_peered":"2024-09-17T05:50:17.678422+0000","last_clean":"2024-09-17T05:50:17.678422+0000","last_became_active":"2024-09-17T05:50:17.674667+0000","last_became_peered":"2024-09-17T05:50:17.674667+0000","last_unstale":"2024-09-17T05:50:17.678422+0000","last_undegraded":"2024-09-17T05:50:17.678422+0000","last_fullsized":"2024-09-17T05:50:17.678422+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:50:16.649689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:50:16.649689+0000","last_clean_scrub_stamp":"2024-09-17T05:50:16.649689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:33:47.309127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.1","version":"0'0","reported_seq":13,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-17T05:50:17.666388+0000","last_change":"2024-09-17T05:50:16.670111+0000","last_active":"2024-09-17T05:50:17.666388+0000","last_peered":"2024-09-17T05:50:17.666388+0000","last_clean":"2024-09-17T05:50:17.666388+0000","last_became_active":"2024-09-17T05:50:16.669343+0000","last_became_peered":"2024-09-17T05:50:16.669343+0000","last_unstale":"2024-09-17T05:50:17.666388+0000","last_undegraded":"2024-09-17T05:50:17.666388+0000","last_fullsized":"2024-09-17T05:50:17.666388+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:50:15.639879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:50:15.639879+0000","last_clean_scrub_stamp":"2024-09-17T05:50:15.639879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:14:06.830335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.1","version":"0'0","reported_seq":10,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-17T05:50:17.694046+0000","last_change":"2024-09-17T05:50:17.692076+0000","last_active":"2024-09-17T05:50:17.694046+0000","last_peered":"2024-09-17T05:50:17.694046+0000","last_clean":"2024-09-17T05:50:17.694046+0000","last_became_active":"2024-09-17T05:50:17.688755+0000","last_became_peered":"2024-09-17T05:50:17.688755+0000","last_unstale":"2024-09-17T05:50:17.694046+0000","last_undegraded":"2024-09-17T05:50:17.694046+0000","last_fullsized":"2024-09-17T05:50:17.694046+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:50:16.649689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:50:16.649689+0000","last_clean_scrub_stamp":"2024-09-17T05:50:16.649689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:09:55.788176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.0","version":"0'0","reported_seq":13,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-17T05:50:17.669830+0000","last_change":"2024-09-17T05:50:16.680798+0000","last_active":"2024-09-17T05:50:17.669830+0000","last_peered":"2024-09-17T05:50:17.669830+0000","last_clean":"2024-09-17T05:50:17.669830+0000","last_became_active":"2024-09-17T05:50:16.680485+0000","last_became_peered":"2024-09-17T05:50:16.680485+0000","last_unstale":"2024-09-17T05:50:17.669830+0000","last_undegraded":"2024-09-17T05:50:17.669830+0000","last_fullsized":"2024-09-17T05:50:17.669830+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:50:15.639879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:50:15.639879+0000","last_clean_scrub_stamp":"2024-09-17T05:50:15.639879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:59:08.119171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.e","version":"0'0","reported_seq":10,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-17T05:50:17.685022+0000","last_change":"2024-09-17T05:50:17.682012+0000","last_active":"2024-09-17T05:50:17.685022+0000","last_peered":"2024-09-17T05:50:17.685022+0000","last_clean":"2024-09-17T05:50:17.685022+0000","last_became_active":"2024-09-17T05:50:17.681695+0000","last_became_peered":"2024-09-17T05:50:17.681695+0000","last_unstale":"2024-09-17T05:50:17.685022+0000","last_undegraded":"2024-09-17T05:50:17.685022+0000","last_fullsized":"2024-09-17T05:50:17.685022+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:50:16.649689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:50:16.649689+0000","last_clean_scrub_stamp":"2024-09-17T05:50:16.649689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:51:07.133701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.f","version":"0'0","reported_seq":10,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-17T05:50:16.675558+0000","last_change":"2024-09-17T05:50:16.675030+0000","last_active":"2024-09-17T05:50:16.675558+0000","last_peered":"2024-09-17T05:50:16.675558+0000","last_clean":"2024-09-17T05:50:16.675558+0000","last_became_active":"2024-09-17T05:50:16.674713+0000","last_became_peered":"2024-09-17T05:50:16.674713+0000","last_unstale":"2024-09-17T05:50:16.675558+0000","last_undegraded":"2024-09-17T05:50:16.675558+0000","last_fullsized":"2024-09-17T05:50:16.675558+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:50:15.639879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:50:15.639879+0000","last_clean_scrub_stamp":"2024-09-17T05:50:15.639879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:41:28.416146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"19'72","reported_seq":251,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-17T05:50:16.668637+0000","last_change":"2024-09-17T05:41:48.539830+0000","last_active":"2024-09-17T05:50:16.668637+0000","last_peered":"2024-09-17T05:50:16.668637+0000","last_clean":"2024-09-17T05:50:16.668637+0000","last_became_active":"2024-09-17T05:41:48.538743+0000","last_became_peered":"2024-09-17T05:41:48.538743+0000","last_unstale":"2024-09-17T05:50:16.668637+0000","last_undegraded":"2024-09-17T05:50:16.668637+0000","last_fullsized":"2024-09-17T05:50:16.668637+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:47.152539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:47.152539+0000","last_clean_scrub_stamp":"2024-09-17T05:41:47.152539+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:08:02.952016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":15,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":14,"num_pg":32,"stat_sum":{"num_bytes":686,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":10,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2902,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":24,"ondisk_log_size":24,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":16,"seq":68719476843,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":118412,"kb_used_data":1208,"kb_used_omap":1,"kb_used_meta":117182,"kb_avail":94253428,"statfs":{"total":96636764160,"available":96515510272,"internally_reserved":0,"allocated":1236992,"data_stored":531916,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":119994822},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":7,"up_from":15,"seq":64424509547,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":127280,"kb_used_data":1756,"kb_used_omap":1,"kb_used_meta":125502,"kb_avail":94244560,"statfs":{"total":96636764160,"available":96506429440,"internally_reserved":0,"allocated":1798144,"data_stored":1108358,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":128514506},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509546,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":72556,"kb_used_data":1176,"kb_used_omap":1,"kb_used_meta":71358,"kb_avail":94299284,"statfs":{"total":96636764160,"available":96562466816,"internally_reserved":0,"allocated":1204224,"data_stored":517990,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":73071045},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509546,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":148908,"kb_used_data":1176,"kb_used_omap":1,"kb_used_meta":147710,"kb_avail":94222932,"statfs":{"total":96636764160,"available":96484282368,"internally_reserved":0,"allocated":1204224,"data_stored":517990,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":151255493},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509546,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":112824,"kb_used_data":1188,"kb_used_omap":1,"kb_used_meta":111614,"kb_avail":94259016,"statfs":{"total":96636764160,"available":96521232384,"internally_reserved":0,"allocated":1216512,"data_stored":524377,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":114293191},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509546,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":153096,"kb_used_data":1204,"kb_used_omap":1,"kb_used_meta":151870,"kb_avail":94218744,"statfs":{"total":96636764160,"available":96479993856,"internally_reserved":0,"allocated":1232896,"data_stored":531298,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":155515333},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509546,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":118396,"kb_used_data":1188,"kb_used_omap":1,"kb_used_meta":117182,"kb_avail":94253444,"statfs":{"total":96636764160,"available":96515526656,"internally_reserved":0,"allocated":1216512,"data_stored":524377,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":119994821},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574954,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":131468,"kb_used_data":1784,"kb_used_omap":1,"kb_used_meta":129662,"kb_avail":94240372,"statfs":{"total":96636764160,"available":96502140928,"internally_reserved":0,"allocated":1826816,"data_stored":1122214,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":132774341},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-17T05:50:21.704 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-17T05:50:21.854 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:21.853+0000 7fbebaeb6640 1 -- 172.21.15.150:0/1529198843 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fbeb40cf7c0 msgr2=0x7fbeb40cfbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:50:21.854 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:21.853+0000 7fbebaeb6640 1 --2- 172.21.15.150:0/1529198843 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fbeb40cf7c0 0x7fbeb40cfbd0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fbea8005fd0 tx=0x7fbea802aa90 comp rx=0 tx=0).stop 2024-09-17T05:50:21.854 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:21.853+0000 7fbebaeb6640 1 -- 172.21.15.150:0/1529198843 shutdown_connections 2024-09-17T05:50:21.854 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:21.853+0000 7fbebaeb6640 1 --2- 172.21.15.150:0/1529198843 >> v2:172.21.15.176:3300/0 conn(0x7fbeb40b5410 0x7fbeb40b5820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:50:21.854 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:21.853+0000 7fbebaeb6640 1 --2- 172.21.15.150:0/1529198843 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fbeb40cf7c0 0x7fbeb40cfbd0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:50:21.854 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:21.853+0000 7fbebaeb6640 1 -- 172.21.15.150:0/1529198843 >> 172.21.15.150:0/1529198843 conn(0x7fbeb40b2fd0 msgr2=0x7fbeb40b33e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:50:21.854 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:21.853+0000 7fbebaeb6640 1 -- 172.21.15.150:0/1529198843 shutdown_connections 2024-09-17T05:50:21.854 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:21.853+0000 7fbebaeb6640 1 -- 172.21.15.150:0/1529198843 wait complete. 2024-09-17T05:50:21.855 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:21.854+0000 7fbebaeb6640 1 Processor -- start 2024-09-17T05:50:21.855 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:21.854+0000 7fbebaeb6640 1 -- start start 2024-09-17T05:50:21.858 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:21.856+0000 7fbebaeb6640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbeb40b5410 0x7fbeb4153700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:50:21.858 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:21.856+0000 7fbebaeb6640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fbeb40cf7c0 0x7fbeb41f8c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:50:21.858 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:21.856+0000 7fbebaeb6640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fbeb415ee30 0x7fbeb41f91b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:50:21.858 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:21.856+0000 7fbebaeb6640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7fbeb40b60f0 con 0x7fbeb40b5410 2024-09-17T05:50:21.858 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:21.856+0000 7fbebaeb6640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fbeb40b5f70 con 0x7fbeb40cf7c0 2024-09-17T05:50:21.858 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:21.856+0000 7fbebaeb6640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fbeb40b6270 con 0x7fbeb415ee30 2024-09-17T05:50:21.858 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:21.856+0000 7fbeb8c52640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbeb40b5410 0x7fbeb4153700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:50:21.858 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:21.856+0000 7fbeb8c52640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbeb40b5410 0x7fbeb4153700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:57274/0 (socket says 172.21.15.150:57274) 2024-09-17T05:50:21.858 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:21.856+0000 7fbeb8c52640 1 -- 172.21.15.150:0/3623364165 learned_addr learned my addr 172.21.15.150:0/3623364165 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:50:21.858 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:21.856+0000 7fbeb3fff640 1 --2- 172.21.15.150:0/3623364165 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fbeb40cf7c0 0x7fbeb41f8c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:50:21.858 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:21.856+0000 7fbeb9453640 1 --2- 172.21.15.150:0/3623364165 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fbeb415ee30 0x7fbeb41f91b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:50:21.859 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:21.856+0000 7fbeb8c52640 1 -- 172.21.15.150:0/3623364165 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fbeb415ee30 msgr2=0x7fbeb41f91b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:50:21.859 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:21.856+0000 7fbeb8c52640 1 --2- 172.21.15.150:0/3623364165 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fbeb415ee30 0x7fbeb41f91b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:50:21.859 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:21.856+0000 7fbeb8c52640 1 -- 172.21.15.150:0/3623364165 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fbeb40cf7c0 msgr2=0x7fbeb41f8c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:50:21.859 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:21.856+0000 7fbeb8c52640 1 --2- 172.21.15.150:0/3623364165 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fbeb40cf7c0 0x7fbeb41f8c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:50:21.859 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:21.856+0000 7fbeb8c52640 1 -- 172.21.15.150:0/3623364165 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbeb40ca450 con 0x7fbeb40b5410 2024-09-17T05:50:21.859 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:21.857+0000 7fbeb8c52640 1 --2- 172.21.15.150:0/3623364165 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbeb40b5410 0x7fbeb4153700 secure :-1 s=READY pgs=1323 cs=0 l=1 rev1=1 crypto rx=0x7fbea400c3a0 tx=0x7fbea400c7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:50:21.859 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:21.857+0000 7fbeb17fa640 1 -- 172.21.15.150:0/3623364165 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbea4017070 con 0x7fbeb40b5410 2024-09-17T05:50:21.859 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:21.857+0000 7fbeb17fa640 1 -- 172.21.15.150:0/3623364165 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fbea40053c0 con 0x7fbeb40b5410 2024-09-17T05:50:21.859 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:21.857+0000 7fbebaeb6640 1 -- 172.21.15.150:0/3623364165 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbeb40c9e90 con 0x7fbeb40b5410 2024-09-17T05:50:21.859 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:21.857+0000 7fbeb17fa640 1 -- 172.21.15.150:0/3623364165 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbea4003850 con 0x7fbeb40b5410 2024-09-17T05:50:21.859 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:21.857+0000 7fbebaeb6640 1 -- 172.21.15.150:0/3623364165 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbeb40cc0b0 con 0x7fbeb40b5410 2024-09-17T05:50:21.860 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:21.858+0000 7fbebaeb6640 1 -- 172.21.15.150:0/3623364165 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbeb40b5820 con 0x7fbeb40b5410 2024-09-17T05:50:21.860 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:21.859+0000 7fbeb17fa640 1 -- 172.21.15.150:0/3623364165 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 32) ==== 103481+0+0 (secure 0 0 0) 0x7fbea401a070 con 0x7fbeb40b5410 2024-09-17T05:50:21.860 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:21.859+0000 7fbeb17fa640 1 --2- 172.21.15.150:0/3623364165 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fbea007a210 0x7fbea007c720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:50:21.861 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:21.859+0000 7fbeb17fa640 1 -- 172.21.15.150:0/3623364165 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(101..101 src has 1..101) ==== 5821+0+0 (secure 0 0 0) 0x7fbea4098c50 con 0x7fbeb40b5410 2024-09-17T05:50:21.861 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:21.859+0000 7fbeb3fff640 1 --2- 172.21.15.150:0/3623364165 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fbea007a210 0x7fbea007c720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:50:21.861 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:21.860+0000 7fbeb3fff640 1 --2- 172.21.15.150:0/3623364165 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fbea007a210 0x7fbea007c720 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7fbea8035000 tx=0x7fbea8038040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:50:21.864 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:21.864+0000 7fbeb17fa640 1 -- 172.21.15.150:0/3623364165 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fbeb40d0110 con 0x7fbeb40b5410 2024-09-17T05:50:22.036 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:22.036+0000 7fbebaeb6640 1 -- 172.21.15.150:0/3623364165 --> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fbeb40b3560 con 0x7fbea007a210 2024-09-17T05:50:22.041 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:22.041+0000 7fbeb17fa640 1 -- 172.21.15.150:0/3623364165 <== mgr.4108 v2:172.21.15.176:6800/3631216395 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+250629 (secure 0 0 0) 0x7fbeb40b3560 con 0x7fbea007a210 2024-09-17T05:50:22.044 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-09-17T05:50:22.045 INFO:teuthology.orchestra.run.smithi150.stderr:dumped all 2024-09-17T05:50:22.046 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:22.044+0000 7fbebaeb6640 1 -- 172.21.15.150:0/3623364165 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fbea007a210 msgr2=0x7fbea007c720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:50:22.046 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:22.044+0000 7fbebaeb6640 1 --2- 172.21.15.150:0/3623364165 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fbea007a210 0x7fbea007c720 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7fbea8035000 tx=0x7fbea8038040 comp rx=0 tx=0).stop 2024-09-17T05:50:22.047 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:22.044+0000 7fbebaeb6640 1 -- 172.21.15.150:0/3623364165 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbeb40b5410 msgr2=0x7fbeb4153700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:50:22.047 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:22.044+0000 7fbebaeb6640 1 --2- 172.21.15.150:0/3623364165 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbeb40b5410 0x7fbeb4153700 secure :-1 s=READY pgs=1323 cs=0 l=1 rev1=1 crypto rx=0x7fbea400c3a0 tx=0x7fbea400c7a0 comp rx=0 tx=0).stop 2024-09-17T05:50:22.047 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:22.044+0000 7fbebaeb6640 1 -- 172.21.15.150:0/3623364165 shutdown_connections 2024-09-17T05:50:22.047 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:22.044+0000 7fbebaeb6640 1 --2- 172.21.15.150:0/3623364165 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fbeb40cf7c0 0x7fbeb41f8c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:50:22.047 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:22.044+0000 7fbebaeb6640 1 --2- 172.21.15.150:0/3623364165 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fbea007a210 0x7fbea007c720 unknown :-1 s=CLOSED pgs=571 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:50:22.047 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:22.044+0000 7fbebaeb6640 1 --2- 172.21.15.150:0/3623364165 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fbeb415ee30 0x7fbeb41f91b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:50:22.047 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:22.044+0000 7fbebaeb6640 1 --2- 172.21.15.150:0/3623364165 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbeb40b5410 0x7fbeb4153700 unknown :-1 s=CLOSED pgs=1323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:50:22.047 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:22.044+0000 7fbebaeb6640 1 -- 172.21.15.150:0/3623364165 >> 172.21.15.150:0/3623364165 conn(0x7fbeb40b2fd0 msgr2=0x7fbeb415db30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:50:22.047 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:22.044+0000 7fbebaeb6640 1 -- 172.21.15.150:0/3623364165 shutdown_connections 2024-09-17T05:50:22.047 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:22.045+0000 7fbebaeb6640 1 -- 172.21.15.150:0/3623364165 wait complete. 2024-09-17T05:50:22.057 INFO:teuthology.orchestra.run.smithi150.stdout:{"pg_ready":true,"pg_map":{"version":353,"stamp":"2024-09-17T05:50:21.039548+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":591054,"num_objects":15,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":129,"num_write_kb":1637,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":10,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":96,"ondisk_log_size":96,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":60,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":982940,"kb_used_data":10680,"kb_used_omap":12,"kb_used_meta":972083,"kb_avail":753991780,"statfs":{"total":773094113280,"available":772087582720,"internally_reserved":0,"allocated":10936320,"data_stored":5378520,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":995413552},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":20,"apply_latency_ms":20,"commit_latency_ns":20000000,"apply_latency_ns":20000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":686,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":10,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.388456"},"pg_stats":[{"pgid":"15.3f","version":"0'0","reported_seq":10,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-17T05:50:17.692584+0000","last_change":"2024-09-17T05:50:17.688948+0000","last_active":"2024-09-17T05:50:17.692584+0000","last_peered":"2024-09-17T05:50:17.692584+0000","last_clean":"2024-09-17T05:50:17.692584+0000","last_became_active":"2024-09-17T05:50:17.688664+0000","last_became_peered":"2024-09-17T05:50:17.688664+0000","last_unstale":"2024-09-17T05:50:17.692584+0000","last_undegraded":"2024-09-17T05:50:17.692584+0000","last_fullsized":"2024-09-17T05:50:17.692584+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:50:16.649689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:50:16.649689+0000","last_clean_scrub_stamp":"2024-09-17T05:50:16.649689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:03:34.676383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.3e","version":"0'0","reported_seq":13,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-17T05:50:18.686282+0000","last_change":"2024-09-17T05:50:17.686607+0000","last_active":"2024-09-17T05:50:18.686282+0000","last_peered":"2024-09-17T05:50:18.686282+0000","last_clean":"2024-09-17T05:50:18.686282+0000","last_became_active":"2024-09-17T05:50:17.685913+0000","last_became_peered":"2024-09-17T05:50:17.685913+0000","last_unstale":"2024-09-17T05:50:18.686282+0000","last_undegraded":"2024-09-17T05:50:18.686282+0000","last_fullsized":"2024-09-17T05:50:18.686282+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:50:16.649689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:50:16.649689+0000","last_clean_scrub_stamp":"2024-09-17T05:50:16.649689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:17:42.646673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.3d","version":"0'0","reported_seq":10,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-17T05:50:17.692516+0000","last_change":"2024-09-17T05:50:17.687586+0000","last_active":"2024-09-17T05:50:17.692516+0000","last_peered":"2024-09-17T05:50:17.692516+0000","last_clean":"2024-09-17T05:50:17.692516+0000","last_became_active":"2024-09-17T05:50:17.687288+0000","last_became_peered":"2024-09-17T05:50:17.687288+0000","last_unstale":"2024-09-17T05:50:17.692516+0000","last_undegraded":"2024-09-17T05:50:17.692516+0000","last_fullsized":"2024-09-17T05:50:17.692516+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:50:16.649689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:50:16.649689+0000","last_clean_scrub_stamp":"2024-09-17T05:50:16.649689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:27:25.644171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.3c","version":"0'0","reported_seq":10,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-17T05:50:17.679950+0000","last_change":"2024-09-17T05:50:17.677226+0000","last_active":"2024-09-17T05:50:17.679950+0000","last_peered":"2024-09-17T05:50:17.679950+0000","last_clean":"2024-09-17T05:50:17.679950+0000","last_became_active":"2024-09-17T05:50:17.676607+0000","last_became_peered":"2024-09-17T05:50:17.676607+0000","last_unstale":"2024-09-17T05:50:17.679950+0000","last_undegraded":"2024-09-17T05:50:17.679950+0000","last_fullsized":"2024-09-17T05:50:17.679950+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:50:16.649689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:50:16.649689+0000","last_clean_scrub_stamp":"2024-09-17T05:50:16.649689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:19:07.779617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.3b","version":"0'0","reported_seq":10,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-17T05:50:17.692019+0000","last_change":"2024-09-17T05:50:17.686438+0000","last_active":"2024-09-17T05:50:17.692019+0000","last_peered":"2024-09-17T05:50:17.692019+0000","last_clean":"2024-09-17T05:50:17.692019+0000","last_became_active":"2024-09-17T05:50:17.686137+0000","last_became_peered":"2024-09-17T05:50:17.686137+0000","last_unstale":"2024-09-17T05:50:17.692019+0000","last_undegraded":"2024-09-17T05:50:17.692019+0000","last_fullsized":"2024-09-17T05:50:17.692019+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:50:16.649689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:50:16.649689+0000","last_clean_scrub_stamp":"2024-09-17T05:50:16.649689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:04:28.500108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.3a","version":"0'0","reported_seq":1,"reported_epoch":99,"state":"creating+peering","last_fresh":"2024-09-17T05:50:16.664990+0000","last_change":"2024-09-17T05:50:16.664990+0000","last_active":"2024-09-17T05:50:16.649689+0000","last_peered":"2024-09-17T05:50:16.649689+0000","last_clean":"2024-09-17T05:50:16.649689+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:50:16.664990+0000","last_undegraded":"2024-09-17T05:50:16.664990+0000","last_fullsized":"2024-09-17T05:50:16.664990+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:50:16.649689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:50:16.649689+0000","last_clean_scrub_stamp":"2024-09-17T05:50:16.649689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.39","version":"0'0","reported_seq":1,"reported_epoch":99,"state":"creating+peering","last_fresh":"2024-09-17T05:50:16.665949+0000","last_change":"2024-09-17T05:50:16.665949+0000","last_active":"2024-09-17T05:50:16.649689+0000","last_peered":"2024-09-17T05:50:16.649689+0000","last_clean":"2024-09-17T05:50:16.649689+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:50:16.665949+0000","last_undegraded":"2024-09-17T05:50:16.665949+0000","last_fullsized":"2024-09-17T05:50:16.665949+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:50:16.649689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:50:16.649689+0000","last_clean_scrub_stamp":"2024-09-17T05:50:16.649689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.38","version":"0'0","reported_seq":13,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-17T05:50:18.686276+0000","last_change":"2024-09-17T05:50:17.688288+0000","last_active":"2024-09-17T05:50:18.686276+0000","last_peered":"2024-09-17T05:50:18.686276+0000","last_clean":"2024-09-17T05:50:18.686276+0000","last_became_active":"2024-09-17T05:50:17.687994+0000","last_became_peered":"2024-09-17T05:50:17.687994+0000","last_unstale":"2024-09-17T05:50:18.686276+0000","last_undegraded":"2024-09-17T05:50:18.686276+0000","last_fullsized":"2024-09-17T05:50:18.686276+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:50:16.649689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:50:16.649689+0000","last_clean_scrub_stamp":"2024-09-17T05:50:16.649689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:34:26.313722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.37","version":"0'0","reported_seq":1,"reported_epoch":99,"state":"creating+peering","last_fresh":"2024-09-17T05:50:16.656812+0000","last_change":"2024-09-17T05:50:16.656812+0000","last_active":"2024-09-17T05:50:16.649689+0000","last_peered":"2024-09-17T05:50:16.649689+0000","last_clean":"2024-09-17T05:50:16.649689+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:50:16.656812+0000","last_undegraded":"2024-09-17T05:50:16.656812+0000","last_fullsized":"2024-09-17T05:50:16.656812+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:50:16.649689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:50:16.649689+0000","last_clean_scrub_stamp":"2024-09-17T05:50:16.649689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.36","version":"0'0","reported_seq":10,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-17T05:50:17.694249+0000","last_change":"2024-09-17T05:50:17.691032+0000","last_active":"2024-09-17T05:50:17.694249+0000","last_peered":"2024-09-17T05:50:17.694249+0000","last_clean":"2024-09-17T05:50:17.694249+0000","last_became_active":"2024-09-17T05:50:17.687974+0000","last_became_peered":"2024-09-17T05:50:17.687974+0000","last_unstale":"2024-09-17T05:50:17.694249+0000","last_undegraded":"2024-09-17T05:50:17.694249+0000","last_fullsized":"2024-09-17T05:50:17.694249+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:50:16.649689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:50:16.649689+0000","last_clean_scrub_stamp":"2024-09-17T05:50:16.649689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:21:42.242980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.35","version":"0'0","reported_seq":1,"reported_epoch":99,"state":"creating+peering","last_fresh":"2024-09-17T05:50:16.669270+0000","last_change":"2024-09-17T05:50:16.669270+0000","last_active":"2024-09-17T05:50:16.649689+0000","last_peered":"2024-09-17T05:50:16.649689+0000","last_clean":"2024-09-17T05:50:16.649689+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:50:16.669270+0000","last_undegraded":"2024-09-17T05:50:16.669270+0000","last_fullsized":"2024-09-17T05:50:16.669270+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:50:16.649689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:50:16.649689+0000","last_clean_scrub_stamp":"2024-09-17T05:50:16.649689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.34","version":"0'0","reported_seq":1,"reported_epoch":99,"state":"creating+peering","last_fresh":"2024-09-17T05:50:16.657363+0000","last_change":"2024-09-17T05:50:16.657363+0000","last_active":"2024-09-17T05:50:16.649689+0000","last_peered":"2024-09-17T05:50:16.649689+0000","last_clean":"2024-09-17T05:50:16.649689+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:50:16.657363+0000","last_undegraded":"2024-09-17T05:50:16.657363+0000","last_fullsized":"2024-09-17T05:50:16.657363+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:50:16.649689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:50:16.649689+0000","last_clean_scrub_stamp":"2024-09-17T05:50:16.649689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.33","version":"0'0","reported_seq":10,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-17T05:50:17.680120+0000","last_change":"2024-09-17T05:50:17.674595+0000","last_active":"2024-09-17T05:50:17.680120+0000","last_peered":"2024-09-17T05:50:17.680120+0000","last_clean":"2024-09-17T05:50:17.680120+0000","last_became_active":"2024-09-17T05:50:17.674286+0000","last_became_peered":"2024-09-17T05:50:17.674286+0000","last_unstale":"2024-09-17T05:50:17.680120+0000","last_undegraded":"2024-09-17T05:50:17.680120+0000","last_fullsized":"2024-09-17T05:50:17.680120+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:50:16.649689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:50:16.649689+0000","last_clean_scrub_stamp":"2024-09-17T05:50:16.649689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:39:58.578693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.32","version":"0'0","reported_seq":10,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-17T05:50:17.699073+0000","last_change":"2024-09-17T05:50:17.693635+0000","last_active":"2024-09-17T05:50:17.699073+0000","last_peered":"2024-09-17T05:50:17.699073+0000","last_clean":"2024-09-17T05:50:17.699073+0000","last_became_active":"2024-09-17T05:50:17.693172+0000","last_became_peered":"2024-09-17T05:50:17.693172+0000","last_unstale":"2024-09-17T05:50:17.699073+0000","last_undegraded":"2024-09-17T05:50:17.699073+0000","last_fullsized":"2024-09-17T05:50:17.699073+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:50:16.649689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:50:16.649689+0000","last_clean_scrub_stamp":"2024-09-17T05:50:16.649689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:03:31.990762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.31","version":"0'0","reported_seq":10,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-17T05:50:17.685964+0000","last_change":"2024-09-17T05:50:17.681216+0000","last_active":"2024-09-17T05:50:17.685964+0000","last_peered":"2024-09-17T05:50:17.685964+0000","last_clean":"2024-09-17T05:50:17.685964+0000","last_became_active":"2024-09-17T05:50:17.680783+0000","last_became_peered":"2024-09-17T05:50:17.680783+0000","last_unstale":"2024-09-17T05:50:17.685964+0000","last_undegraded":"2024-09-17T05:50:17.685964+0000","last_fullsized":"2024-09-17T05:50:17.685964+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:50:16.649689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:50:16.649689+0000","last_clean_scrub_stamp":"2024-09-17T05:50:16.649689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:51:50.910297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.30","version":"0'0","reported_seq":1,"reported_epoch":99,"state":"creating+peering","last_fresh":"2024-09-17T05:50:16.667715+0000","last_change":"2024-09-17T05:50:16.667715+0000","last_active":"2024-09-17T05:50:16.649689+0000","last_peered":"2024-09-17T05:50:16.649689+0000","last_clean":"2024-09-17T05:50:16.649689+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:50:16.667715+0000","last_undegraded":"2024-09-17T05:50:16.667715+0000","last_fullsized":"2024-09-17T05:50:16.667715+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:50:16.649689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:50:16.649689+0000","last_clean_scrub_stamp":"2024-09-17T05:50:16.649689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.2f","version":"0'0","reported_seq":13,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-17T05:50:18.686505+0000","last_change":"2024-09-17T05:50:17.686002+0000","last_active":"2024-09-17T05:50:18.686505+0000","last_peered":"2024-09-17T05:50:18.686505+0000","last_clean":"2024-09-17T05:50:18.686505+0000","last_became_active":"2024-09-17T05:50:17.685687+0000","last_became_peered":"2024-09-17T05:50:17.685687+0000","last_unstale":"2024-09-17T05:50:18.686505+0000","last_undegraded":"2024-09-17T05:50:18.686505+0000","last_fullsized":"2024-09-17T05:50:18.686505+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:50:16.649689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:50:16.649689+0000","last_clean_scrub_stamp":"2024-09-17T05:50:16.649689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:46:40.056183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.2e","version":"0'0","reported_seq":10,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-17T05:50:17.680159+0000","last_change":"2024-09-17T05:50:17.676677+0000","last_active":"2024-09-17T05:50:17.680159+0000","last_peered":"2024-09-17T05:50:17.680159+0000","last_clean":"2024-09-17T05:50:17.680159+0000","last_became_active":"2024-09-17T05:50:17.676390+0000","last_became_peered":"2024-09-17T05:50:17.676390+0000","last_unstale":"2024-09-17T05:50:17.680159+0000","last_undegraded":"2024-09-17T05:50:17.680159+0000","last_fullsized":"2024-09-17T05:50:17.680159+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:50:16.649689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:50:16.649689+0000","last_clean_scrub_stamp":"2024-09-17T05:50:16.649689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:02:08.191996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.2d","version":"0'0","reported_seq":10,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-17T05:50:17.692165+0000","last_change":"2024-09-17T05:50:17.689114+0000","last_active":"2024-09-17T05:50:17.692165+0000","last_peered":"2024-09-17T05:50:17.692165+0000","last_clean":"2024-09-17T05:50:17.692165+0000","last_became_active":"2024-09-17T05:50:17.688766+0000","last_became_peered":"2024-09-17T05:50:17.688766+0000","last_unstale":"2024-09-17T05:50:17.692165+0000","last_undegraded":"2024-09-17T05:50:17.692165+0000","last_fullsized":"2024-09-17T05:50:17.692165+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:50:16.649689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:50:16.649689+0000","last_clean_scrub_stamp":"2024-09-17T05:50:16.649689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:56:51.160610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.2c","version":"0'0","reported_seq":1,"reported_epoch":99,"state":"creating+peering","last_fresh":"2024-09-17T05:50:16.656329+0000","last_change":"2024-09-17T05:50:16.656329+0000","last_active":"2024-09-17T05:50:16.649689+0000","last_peered":"2024-09-17T05:50:16.649689+0000","last_clean":"2024-09-17T05:50:16.649689+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:50:16.656329+0000","last_undegraded":"2024-09-17T05:50:16.656329+0000","last_fullsized":"2024-09-17T05:50:16.656329+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:50:16.649689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:50:16.649689+0000","last_clean_scrub_stamp":"2024-09-17T05:50:16.649689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.2b","version":"0'0","reported_seq":10,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-17T05:50:17.685753+0000","last_change":"2024-09-17T05:50:17.679256+0000","last_active":"2024-09-17T05:50:17.685753+0000","last_peered":"2024-09-17T05:50:17.685753+0000","last_clean":"2024-09-17T05:50:17.685753+0000","last_became_active":"2024-09-17T05:50:17.678923+0000","last_became_peered":"2024-09-17T05:50:17.678923+0000","last_unstale":"2024-09-17T05:50:17.685753+0000","last_undegraded":"2024-09-17T05:50:17.685753+0000","last_fullsized":"2024-09-17T05:50:17.685753+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:50:16.649689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:50:16.649689+0000","last_clean_scrub_stamp":"2024-09-17T05:50:16.649689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:28:08.714137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.2a","version":"0'0","reported_seq":13,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-17T05:50:18.686175+0000","last_change":"2024-09-17T05:50:17.687586+0000","last_active":"2024-09-17T05:50:18.686175+0000","last_peered":"2024-09-17T05:50:18.686175+0000","last_clean":"2024-09-17T05:50:18.686175+0000","last_became_active":"2024-09-17T05:50:17.687286+0000","last_became_peered":"2024-09-17T05:50:17.687286+0000","last_unstale":"2024-09-17T05:50:18.686175+0000","last_undegraded":"2024-09-17T05:50:18.686175+0000","last_fullsized":"2024-09-17T05:50:18.686175+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:50:16.649689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:50:16.649689+0000","last_clean_scrub_stamp":"2024-09-17T05:50:16.649689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:02:00.945244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.29","version":"0'0","reported_seq":13,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-17T05:50:18.686290+0000","last_change":"2024-09-17T05:50:17.688190+0000","last_active":"2024-09-17T05:50:18.686290+0000","last_peered":"2024-09-17T05:50:18.686290+0000","last_clean":"2024-09-17T05:50:18.686290+0000","last_became_active":"2024-09-17T05:50:17.687362+0000","last_became_peered":"2024-09-17T05:50:17.687362+0000","last_unstale":"2024-09-17T05:50:18.686290+0000","last_undegraded":"2024-09-17T05:50:18.686290+0000","last_fullsized":"2024-09-17T05:50:18.686290+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:50:16.649689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:50:16.649689+0000","last_clean_scrub_stamp":"2024-09-17T05:50:16.649689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:41:16.543702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.28","version":"0'0","reported_seq":1,"reported_epoch":99,"state":"creating+peering","last_fresh":"2024-09-17T05:50:16.666955+0000","last_change":"2024-09-17T05:50:16.666955+0000","last_active":"2024-09-17T05:50:16.649689+0000","last_peered":"2024-09-17T05:50:16.649689+0000","last_clean":"2024-09-17T05:50:16.649689+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:50:16.666955+0000","last_undegraded":"2024-09-17T05:50:16.666955+0000","last_fullsized":"2024-09-17T05:50:16.666955+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:50:16.649689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:50:16.649689+0000","last_clean_scrub_stamp":"2024-09-17T05:50:16.649689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.27","version":"0'0","reported_seq":10,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-17T05:50:17.702466+0000","last_change":"2024-09-17T05:50:17.701876+0000","last_active":"2024-09-17T05:50:17.702466+0000","last_peered":"2024-09-17T05:50:17.702466+0000","last_clean":"2024-09-17T05:50:17.702466+0000","last_became_active":"2024-09-17T05:50:17.701586+0000","last_became_peered":"2024-09-17T05:50:17.701586+0000","last_unstale":"2024-09-17T05:50:17.702466+0000","last_undegraded":"2024-09-17T05:50:17.702466+0000","last_fullsized":"2024-09-17T05:50:17.702466+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:50:16.649689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:50:16.649689+0000","last_clean_scrub_stamp":"2024-09-17T05:50:16.649689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:16:56.091340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.26","version":"0'0","reported_seq":13,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-17T05:50:18.686526+0000","last_change":"2024-09-17T05:50:17.689166+0000","last_active":"2024-09-17T05:50:18.686526+0000","last_peered":"2024-09-17T05:50:18.686526+0000","last_clean":"2024-09-17T05:50:18.686526+0000","last_became_active":"2024-09-17T05:50:17.688880+0000","last_became_peered":"2024-09-17T05:50:17.688880+0000","last_unstale":"2024-09-17T05:50:18.686526+0000","last_undegraded":"2024-09-17T05:50:18.686526+0000","last_fullsized":"2024-09-17T05:50:18.686526+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:50:16.649689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:50:16.649689+0000","last_clean_scrub_stamp":"2024-09-17T05:50:16.649689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:23:08.770975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.25","version":"0'0","reported_seq":1,"reported_epoch":99,"state":"creating+peering","last_fresh":"2024-09-17T05:50:16.668754+0000","last_change":"2024-09-17T05:50:16.668754+0000","last_active":"2024-09-17T05:50:16.649689+0000","last_peered":"2024-09-17T05:50:16.649689+0000","last_clean":"2024-09-17T05:50:16.649689+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:50:16.668754+0000","last_undegraded":"2024-09-17T05:50:16.668754+0000","last_fullsized":"2024-09-17T05:50:16.668754+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:50:16.649689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:50:16.649689+0000","last_clean_scrub_stamp":"2024-09-17T05:50:16.649689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.24","version":"0'0","reported_seq":10,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-17T05:50:17.692366+0000","last_change":"2024-09-17T05:50:17.686896+0000","last_active":"2024-09-17T05:50:17.692366+0000","last_peered":"2024-09-17T05:50:17.692366+0000","last_clean":"2024-09-17T05:50:17.692366+0000","last_became_active":"2024-09-17T05:50:17.686613+0000","last_became_peered":"2024-09-17T05:50:17.686613+0000","last_unstale":"2024-09-17T05:50:17.692366+0000","last_undegraded":"2024-09-17T05:50:17.692366+0000","last_fullsized":"2024-09-17T05:50:17.692366+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:50:16.649689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:50:16.649689+0000","last_clean_scrub_stamp":"2024-09-17T05:50:16.649689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:53:41.317085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.23","version":"0'0","reported_seq":13,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-17T05:50:18.686333+0000","last_change":"2024-09-17T05:50:17.693673+0000","last_active":"2024-09-17T05:50:18.686333+0000","last_peered":"2024-09-17T05:50:18.686333+0000","last_clean":"2024-09-17T05:50:18.686333+0000","last_became_active":"2024-09-17T05:50:17.693131+0000","last_became_peered":"2024-09-17T05:50:17.693131+0000","last_unstale":"2024-09-17T05:50:18.686333+0000","last_undegraded":"2024-09-17T05:50:18.686333+0000","last_fullsized":"2024-09-17T05:50:18.686333+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:50:16.649689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:50:16.649689+0000","last_clean_scrub_stamp":"2024-09-17T05:50:16.649689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:31:33.444956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.22","version":"0'0","reported_seq":10,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-17T05:50:17.698202+0000","last_change":"2024-09-17T05:50:17.691649+0000","last_active":"2024-09-17T05:50:17.698202+0000","last_peered":"2024-09-17T05:50:17.698202+0000","last_clean":"2024-09-17T05:50:17.698202+0000","last_became_active":"2024-09-17T05:50:17.691303+0000","last_became_peered":"2024-09-17T05:50:17.691303+0000","last_unstale":"2024-09-17T05:50:17.698202+0000","last_undegraded":"2024-09-17T05:50:17.698202+0000","last_fullsized":"2024-09-17T05:50:17.698202+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:50:16.649689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:50:16.649689+0000","last_clean_scrub_stamp":"2024-09-17T05:50:16.649689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:30:18.752029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.21","version":"0'0","reported_seq":10,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-17T05:50:17.695664+0000","last_change":"2024-09-17T05:50:17.686575+0000","last_active":"2024-09-17T05:50:17.695664+0000","last_peered":"2024-09-17T05:50:17.695664+0000","last_clean":"2024-09-17T05:50:17.695664+0000","last_became_active":"2024-09-17T05:50:17.684031+0000","last_became_peered":"2024-09-17T05:50:17.684031+0000","last_unstale":"2024-09-17T05:50:17.695664+0000","last_undegraded":"2024-09-17T05:50:17.695664+0000","last_fullsized":"2024-09-17T05:50:17.695664+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:50:16.649689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:50:16.649689+0000","last_clean_scrub_stamp":"2024-09-17T05:50:16.649689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:10:39.923888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.20","version":"0'0","reported_seq":10,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-17T05:50:17.698484+0000","last_change":"2024-09-17T05:50:17.690605+0000","last_active":"2024-09-17T05:50:17.698484+0000","last_peered":"2024-09-17T05:50:17.698484+0000","last_clean":"2024-09-17T05:50:17.698484+0000","last_became_active":"2024-09-17T05:50:17.690127+0000","last_became_peered":"2024-09-17T05:50:17.690127+0000","last_unstale":"2024-09-17T05:50:17.698484+0000","last_undegraded":"2024-09-17T05:50:17.698484+0000","last_fullsized":"2024-09-17T05:50:17.698484+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:50:16.649689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:50:16.649689+0000","last_clean_scrub_stamp":"2024-09-17T05:50:16.649689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:27:10.964544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.1e","version":"0'0","reported_seq":10,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-17T05:50:17.683922+0000","last_change":"2024-09-17T05:50:17.678131+0000","last_active":"2024-09-17T05:50:17.683922+0000","last_peered":"2024-09-17T05:50:17.683922+0000","last_clean":"2024-09-17T05:50:17.683922+0000","last_became_active":"2024-09-17T05:50:17.677816+0000","last_became_peered":"2024-09-17T05:50:17.677816+0000","last_unstale":"2024-09-17T05:50:17.683922+0000","last_undegraded":"2024-09-17T05:50:17.683922+0000","last_fullsized":"2024-09-17T05:50:17.683922+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:50:16.649689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:50:16.649689+0000","last_clean_scrub_stamp":"2024-09-17T05:50:16.649689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:55:41.145153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.1f","version":"100'4","reported_seq":19,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-17T05:50:18.686498+0000","last_change":"2024-09-17T05:50:16.666928+0000","last_active":"2024-09-17T05:50:18.686498+0000","last_peered":"2024-09-17T05:50:18.686498+0000","last_clean":"2024-09-17T05:50:18.686498+0000","last_became_active":"2024-09-17T05:50:16.666550+0000","last_became_peered":"2024-09-17T05:50:16.666550+0000","last_unstale":"2024-09-17T05:50:18.686498+0000","last_undegraded":"2024-09-17T05:50:18.686498+0000","last_fullsized":"2024-09-17T05:50:18.686498+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:50:15.639879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:50:15.639879+0000","last_clean_scrub_stamp":"2024-09-17T05:50:15.639879+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:57:05.869839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1f","version":"0'0","reported_seq":10,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-17T05:50:17.689373+0000","last_change":"2024-09-17T05:50:17.684448+0000","last_active":"2024-09-17T05:50:17.689373+0000","last_peered":"2024-09-17T05:50:17.689373+0000","last_clean":"2024-09-17T05:50:17.689373+0000","last_became_active":"2024-09-17T05:50:17.684014+0000","last_became_peered":"2024-09-17T05:50:17.684014+0000","last_unstale":"2024-09-17T05:50:17.689373+0000","last_undegraded":"2024-09-17T05:50:17.689373+0000","last_fullsized":"2024-09-17T05:50:17.689373+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:50:16.649689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:50:16.649689+0000","last_clean_scrub_stamp":"2024-09-17T05:50:16.649689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:55:05.250112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.1e","version":"0'0","reported_seq":10,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-17T05:50:16.676988+0000","last_change":"2024-09-17T05:50:16.676369+0000","last_active":"2024-09-17T05:50:16.676988+0000","last_peered":"2024-09-17T05:50:16.676988+0000","last_clean":"2024-09-17T05:50:16.676988+0000","last_became_active":"2024-09-17T05:50:16.676073+0000","last_became_peered":"2024-09-17T05:50:16.676073+0000","last_unstale":"2024-09-17T05:50:16.676988+0000","last_undegraded":"2024-09-17T05:50:16.676988+0000","last_fullsized":"2024-09-17T05:50:16.676988+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:50:15.639879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:50:15.639879+0000","last_clean_scrub_stamp":"2024-09-17T05:50:15.639879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:59:49.339081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.1c","version":"0'0","reported_seq":10,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-17T05:50:17.689800+0000","last_change":"2024-09-17T05:50:17.686482+0000","last_active":"2024-09-17T05:50:17.689800+0000","last_peered":"2024-09-17T05:50:17.689800+0000","last_clean":"2024-09-17T05:50:17.689800+0000","last_became_active":"2024-09-17T05:50:17.685224+0000","last_became_peered":"2024-09-17T05:50:17.685224+0000","last_unstale":"2024-09-17T05:50:17.689800+0000","last_undegraded":"2024-09-17T05:50:17.689800+0000","last_fullsized":"2024-09-17T05:50:17.689800+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:50:16.649689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:50:16.649689+0000","last_clean_scrub_stamp":"2024-09-17T05:50:16.649689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:43:04.212537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.1d","version":"100'2","reported_seq":17,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-17T05:50:18.686557+0000","last_change":"2024-09-17T05:50:16.678328+0000","last_active":"2024-09-17T05:50:18.686557+0000","last_peered":"2024-09-17T05:50:18.686557+0000","last_clean":"2024-09-17T05:50:18.686557+0000","last_became_active":"2024-09-17T05:50:16.677911+0000","last_became_peered":"2024-09-17T05:50:16.677911+0000","last_unstale":"2024-09-17T05:50:18.686557+0000","last_undegraded":"2024-09-17T05:50:18.686557+0000","last_fullsized":"2024-09-17T05:50:18.686557+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:50:15.639879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:50:15.639879+0000","last_clean_scrub_stamp":"2024-09-17T05:50:15.639879+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:12:56.944695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1d","version":"0'0","reported_seq":1,"reported_epoch":99,"state":"creating+peering","last_fresh":"2024-09-17T05:50:16.655870+0000","last_change":"2024-09-17T05:50:16.655870+0000","last_active":"2024-09-17T05:50:16.649689+0000","last_peered":"2024-09-17T05:50:16.649689+0000","last_clean":"2024-09-17T05:50:16.649689+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:50:16.655870+0000","last_undegraded":"2024-09-17T05:50:16.655870+0000","last_fullsized":"2024-09-17T05:50:16.655870+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:50:16.649689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:50:16.649689+0000","last_clean_scrub_stamp":"2024-09-17T05:50:16.649689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.1c","version":"100'2","reported_seq":17,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-17T05:50:18.686501+0000","last_change":"2024-09-17T05:50:16.677342+0000","last_active":"2024-09-17T05:50:18.686501+0000","last_peered":"2024-09-17T05:50:18.686501+0000","last_clean":"2024-09-17T05:50:18.686501+0000","last_became_active":"2024-09-17T05:50:16.674956+0000","last_became_peered":"2024-09-17T05:50:16.674956+0000","last_unstale":"2024-09-17T05:50:18.686501+0000","last_undegraded":"2024-09-17T05:50:18.686501+0000","last_fullsized":"2024-09-17T05:50:18.686501+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:50:15.639879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:50:15.639879+0000","last_clean_scrub_stamp":"2024-09-17T05:50:15.639879+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:36:51.832130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1a","version":"0'0","reported_seq":1,"reported_epoch":99,"state":"creating+peering","last_fresh":"2024-09-17T05:50:16.655670+0000","last_change":"2024-09-17T05:50:16.655670+0000","last_active":"2024-09-17T05:50:16.649689+0000","last_peered":"2024-09-17T05:50:16.649689+0000","last_clean":"2024-09-17T05:50:16.649689+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:50:16.655670+0000","last_undegraded":"2024-09-17T05:50:16.655670+0000","last_fullsized":"2024-09-17T05:50:16.655670+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:50:16.649689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:50:16.649689+0000","last_clean_scrub_stamp":"2024-09-17T05:50:16.649689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.1b","version":"100'1","reported_seq":14,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-17T05:50:17.699861+0000","last_change":"2024-09-17T05:50:16.671491+0000","last_active":"2024-09-17T05:50:17.699861+0000","last_peered":"2024-09-17T05:50:17.699861+0000","last_clean":"2024-09-17T05:50:17.699861+0000","last_became_active":"2024-09-17T05:50:16.671150+0000","last_became_peered":"2024-09-17T05:50:16.671150+0000","last_unstale":"2024-09-17T05:50:17.699861+0000","last_undegraded":"2024-09-17T05:50:17.699861+0000","last_fullsized":"2024-09-17T05:50:17.699861+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:50:15.639879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:50:15.639879+0000","last_clean_scrub_stamp":"2024-09-17T05:50:15.639879+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:56:38.653716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.1b","version":"0'0","reported_seq":1,"reported_epoch":99,"state":"creating+peering","last_fresh":"2024-09-17T05:50:16.664625+0000","last_change":"2024-09-17T05:50:16.664625+0000","last_active":"2024-09-17T05:50:16.649689+0000","last_peered":"2024-09-17T05:50:16.649689+0000","last_clean":"2024-09-17T05:50:16.649689+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:50:16.664625+0000","last_undegraded":"2024-09-17T05:50:16.664625+0000","last_fullsized":"2024-09-17T05:50:16.664625+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:50:16.649689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:50:16.649689+0000","last_clean_scrub_stamp":"2024-09-17T05:50:16.649689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.1a","version":"100'1","reported_seq":16,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-17T05:50:18.686071+0000","last_change":"2024-09-17T05:50:16.673854+0000","last_active":"2024-09-17T05:50:18.686071+0000","last_peered":"2024-09-17T05:50:18.686071+0000","last_clean":"2024-09-17T05:50:18.686071+0000","last_became_active":"2024-09-17T05:50:16.673522+0000","last_became_peered":"2024-09-17T05:50:16.673522+0000","last_unstale":"2024-09-17T05:50:18.686071+0000","last_undegraded":"2024-09-17T05:50:18.686071+0000","last_fullsized":"2024-09-17T05:50:18.686071+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:50:15.639879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:50:15.639879+0000","last_clean_scrub_stamp":"2024-09-17T05:50:15.639879+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:05:57.341308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.18","version":"0'0","reported_seq":10,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-17T05:50:17.690825+0000","last_change":"2024-09-17T05:50:17.684654+0000","last_active":"2024-09-17T05:50:17.690825+0000","last_peered":"2024-09-17T05:50:17.690825+0000","last_clean":"2024-09-17T05:50:17.690825+0000","last_became_active":"2024-09-17T05:50:17.684313+0000","last_became_peered":"2024-09-17T05:50:17.684313+0000","last_unstale":"2024-09-17T05:50:17.690825+0000","last_undegraded":"2024-09-17T05:50:17.690825+0000","last_fullsized":"2024-09-17T05:50:17.690825+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:50:16.649689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:50:16.649689+0000","last_clean_scrub_stamp":"2024-09-17T05:50:16.649689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:45:12.092469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.19","version":"0'0","reported_seq":13,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-17T05:50:17.680947+0000","last_change":"2024-09-17T05:50:16.674238+0000","last_active":"2024-09-17T05:50:17.680947+0000","last_peered":"2024-09-17T05:50:17.680947+0000","last_clean":"2024-09-17T05:50:17.680947+0000","last_became_active":"2024-09-17T05:50:16.673875+0000","last_became_peered":"2024-09-17T05:50:16.673875+0000","last_unstale":"2024-09-17T05:50:17.680947+0000","last_undegraded":"2024-09-17T05:50:17.680947+0000","last_fullsized":"2024-09-17T05:50:17.680947+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:50:15.639879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:50:15.639879+0000","last_clean_scrub_stamp":"2024-09-17T05:50:15.639879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:01:35.637247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.19","version":"0'0","reported_seq":1,"reported_epoch":99,"state":"creating+peering","last_fresh":"2024-09-17T05:50:16.655280+0000","last_change":"2024-09-17T05:50:16.655280+0000","last_active":"2024-09-17T05:50:16.649689+0000","last_peered":"2024-09-17T05:50:16.649689+0000","last_clean":"2024-09-17T05:50:16.649689+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:50:16.655280+0000","last_undegraded":"2024-09-17T05:50:16.655280+0000","last_fullsized":"2024-09-17T05:50:16.655280+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:50:16.649689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:50:16.649689+0000","last_clean_scrub_stamp":"2024-09-17T05:50:16.649689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.18","version":"0'0","reported_seq":13,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-17T05:50:17.675065+0000","last_change":"2024-09-17T05:50:16.672581+0000","last_active":"2024-09-17T05:50:17.675065+0000","last_peered":"2024-09-17T05:50:17.675065+0000","last_clean":"2024-09-17T05:50:17.675065+0000","last_became_active":"2024-09-17T05:50:16.671816+0000","last_became_peered":"2024-09-17T05:50:16.671816+0000","last_unstale":"2024-09-17T05:50:17.675065+0000","last_undegraded":"2024-09-17T05:50:17.675065+0000","last_fullsized":"2024-09-17T05:50:17.675065+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:50:15.639879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:50:15.639879+0000","last_clean_scrub_stamp":"2024-09-17T05:50:15.639879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:38:42.681739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.16","version":"0'0","reported_seq":13,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-17T05:50:18.686665+0000","last_change":"2024-09-17T05:50:17.686260+0000","last_active":"2024-09-17T05:50:18.686665+0000","last_peered":"2024-09-17T05:50:18.686665+0000","last_clean":"2024-09-17T05:50:18.686665+0000","last_became_active":"2024-09-17T05:50:17.685507+0000","last_became_peered":"2024-09-17T05:50:17.685507+0000","last_unstale":"2024-09-17T05:50:18.686665+0000","last_undegraded":"2024-09-17T05:50:18.686665+0000","last_fullsized":"2024-09-17T05:50:18.686665+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:50:16.649689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:50:16.649689+0000","last_clean_scrub_stamp":"2024-09-17T05:50:16.649689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:46:25.261334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.17","version":"0'0","reported_seq":13,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-17T05:50:17.676384+0000","last_change":"2024-09-17T05:50:16.666782+0000","last_active":"2024-09-17T05:50:17.676384+0000","last_peered":"2024-09-17T05:50:17.676384+0000","last_clean":"2024-09-17T05:50:17.676384+0000","last_became_active":"2024-09-17T05:50:16.666353+0000","last_became_peered":"2024-09-17T05:50:16.666353+0000","last_unstale":"2024-09-17T05:50:17.676384+0000","last_undegraded":"2024-09-17T05:50:17.676384+0000","last_fullsized":"2024-09-17T05:50:17.676384+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:50:15.639879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:50:15.639879+0000","last_clean_scrub_stamp":"2024-09-17T05:50:15.639879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:08:52.158143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.17","version":"0'0","reported_seq":1,"reported_epoch":99,"state":"creating+peering","last_fresh":"2024-09-17T05:50:16.656309+0000","last_change":"2024-09-17T05:50:16.656309+0000","last_active":"2024-09-17T05:50:16.649689+0000","last_peered":"2024-09-17T05:50:16.649689+0000","last_clean":"2024-09-17T05:50:16.649689+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:50:16.656309+0000","last_undegraded":"2024-09-17T05:50:16.656309+0000","last_fullsized":"2024-09-17T05:50:16.656309+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:50:16.649689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:50:16.649689+0000","last_clean_scrub_stamp":"2024-09-17T05:50:16.649689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.16","version":"0'0","reported_seq":13,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-17T05:50:17.666312+0000","last_change":"2024-09-17T05:50:16.666739+0000","last_active":"2024-09-17T05:50:17.666312+0000","last_peered":"2024-09-17T05:50:17.666312+0000","last_clean":"2024-09-17T05:50:17.666312+0000","last_became_active":"2024-09-17T05:50:16.666351+0000","last_became_peered":"2024-09-17T05:50:16.666351+0000","last_unstale":"2024-09-17T05:50:17.666312+0000","last_undegraded":"2024-09-17T05:50:17.666312+0000","last_fullsized":"2024-09-17T05:50:17.666312+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:50:15.639879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:50:15.639879+0000","last_clean_scrub_stamp":"2024-09-17T05:50:15.639879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:02:39.092792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.14","version":"0'0","reported_seq":10,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-17T05:50:17.701434+0000","last_change":"2024-09-17T05:50:17.700910+0000","last_active":"2024-09-17T05:50:17.701434+0000","last_peered":"2024-09-17T05:50:17.701434+0000","last_clean":"2024-09-17T05:50:17.701434+0000","last_became_active":"2024-09-17T05:50:17.700244+0000","last_became_peered":"2024-09-17T05:50:17.700244+0000","last_unstale":"2024-09-17T05:50:17.701434+0000","last_undegraded":"2024-09-17T05:50:17.701434+0000","last_fullsized":"2024-09-17T05:50:17.701434+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:50:16.649689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:50:16.649689+0000","last_clean_scrub_stamp":"2024-09-17T05:50:16.649689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:52:27.459055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.15","version":"0'0","reported_seq":10,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-17T05:50:16.674056+0000","last_change":"2024-09-17T05:50:16.673400+0000","last_active":"2024-09-17T05:50:16.674056+0000","last_peered":"2024-09-17T05:50:16.674056+0000","last_clean":"2024-09-17T05:50:16.674056+0000","last_became_active":"2024-09-17T05:50:16.673068+0000","last_became_peered":"2024-09-17T05:50:16.673068+0000","last_unstale":"2024-09-17T05:50:16.674056+0000","last_undegraded":"2024-09-17T05:50:16.674056+0000","last_fullsized":"2024-09-17T05:50:16.674056+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:50:15.639879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:50:15.639879+0000","last_clean_scrub_stamp":"2024-09-17T05:50:15.639879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:25:35.372566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.15","version":"0'0","reported_seq":1,"reported_epoch":99,"state":"creating+peering","last_fresh":"2024-09-17T05:50:16.666417+0000","last_change":"2024-09-17T05:50:16.666417+0000","last_active":"2024-09-17T05:50:16.649689+0000","last_peered":"2024-09-17T05:50:16.649689+0000","last_clean":"2024-09-17T05:50:16.649689+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:50:16.666417+0000","last_undegraded":"2024-09-17T05:50:16.666417+0000","last_fullsized":"2024-09-17T05:50:16.666417+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:50:16.649689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:50:16.649689+0000","last_clean_scrub_stamp":"2024-09-17T05:50:16.649689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.14","version":"0'0","reported_seq":10,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-17T05:50:16.666657+0000","last_change":"2024-09-17T05:50:16.663464+0000","last_active":"2024-09-17T05:50:16.666657+0000","last_peered":"2024-09-17T05:50:16.666657+0000","last_clean":"2024-09-17T05:50:16.666657+0000","last_became_active":"2024-09-17T05:50:16.663147+0000","last_became_peered":"2024-09-17T05:50:16.663147+0000","last_unstale":"2024-09-17T05:50:16.666657+0000","last_undegraded":"2024-09-17T05:50:16.666657+0000","last_fullsized":"2024-09-17T05:50:16.666657+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:50:15.639879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:50:15.639879+0000","last_clean_scrub_stamp":"2024-09-17T05:50:15.639879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:34:08.028316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.12","version":"0'0","reported_seq":10,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-17T05:50:17.680089+0000","last_change":"2024-09-17T05:50:17.678910+0000","last_active":"2024-09-17T05:50:17.680089+0000","last_peered":"2024-09-17T05:50:17.680089+0000","last_clean":"2024-09-17T05:50:17.680089+0000","last_became_active":"2024-09-17T05:50:17.678520+0000","last_became_peered":"2024-09-17T05:50:17.678520+0000","last_unstale":"2024-09-17T05:50:17.680089+0000","last_undegraded":"2024-09-17T05:50:17.680089+0000","last_fullsized":"2024-09-17T05:50:17.680089+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:50:16.649689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:50:16.649689+0000","last_clean_scrub_stamp":"2024-09-17T05:50:16.649689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:54:33.658300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.13","version":"100'2","reported_seq":15,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-17T05:50:17.699288+0000","last_change":"2024-09-17T05:50:16.677999+0000","last_active":"2024-09-17T05:50:17.699288+0000","last_peered":"2024-09-17T05:50:17.699288+0000","last_clean":"2024-09-17T05:50:17.699288+0000","last_became_active":"2024-09-17T05:50:16.677675+0000","last_became_peered":"2024-09-17T05:50:16.677675+0000","last_unstale":"2024-09-17T05:50:17.699288+0000","last_undegraded":"2024-09-17T05:50:17.699288+0000","last_fullsized":"2024-09-17T05:50:17.699288+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:50:15.639879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:50:15.639879+0000","last_clean_scrub_stamp":"2024-09-17T05:50:15.639879+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:52:12.200476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.13","version":"0'0","reported_seq":10,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-17T05:50:17.695914+0000","last_change":"2024-09-17T05:50:17.683595+0000","last_active":"2024-09-17T05:50:17.695914+0000","last_peered":"2024-09-17T05:50:17.695914+0000","last_clean":"2024-09-17T05:50:17.695914+0000","last_became_active":"2024-09-17T05:50:17.683280+0000","last_became_peered":"2024-09-17T05:50:17.683280+0000","last_unstale":"2024-09-17T05:50:17.695914+0000","last_undegraded":"2024-09-17T05:50:17.695914+0000","last_fullsized":"2024-09-17T05:50:17.695914+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:50:16.649689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:50:16.649689+0000","last_clean_scrub_stamp":"2024-09-17T05:50:16.649689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:52:17.955004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.12","version":"0'0","reported_seq":13,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-17T05:50:17.672150+0000","last_change":"2024-09-17T05:50:16.672657+0000","last_active":"2024-09-17T05:50:17.672150+0000","last_peered":"2024-09-17T05:50:17.672150+0000","last_clean":"2024-09-17T05:50:17.672150+0000","last_became_active":"2024-09-17T05:50:16.672353+0000","last_became_peered":"2024-09-17T05:50:16.672353+0000","last_unstale":"2024-09-17T05:50:17.672150+0000","last_undegraded":"2024-09-17T05:50:17.672150+0000","last_fullsized":"2024-09-17T05:50:17.672150+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:50:15.639879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:50:15.639879+0000","last_clean_scrub_stamp":"2024-09-17T05:50:15.639879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:31:01.840132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.10","version":"0'0","reported_seq":1,"reported_epoch":99,"state":"creating+peering","last_fresh":"2024-09-17T05:50:16.655229+0000","last_change":"2024-09-17T05:50:16.655229+0000","last_active":"2024-09-17T05:50:16.649689+0000","last_peered":"2024-09-17T05:50:16.649689+0000","last_clean":"2024-09-17T05:50:16.649689+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:50:16.655229+0000","last_undegraded":"2024-09-17T05:50:16.655229+0000","last_fullsized":"2024-09-17T05:50:16.655229+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:50:16.649689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:50:16.649689+0000","last_clean_scrub_stamp":"2024-09-17T05:50:16.649689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.11","version":"0'0","reported_seq":10,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-17T05:50:16.666735+0000","last_change":"2024-09-17T05:50:16.663949+0000","last_active":"2024-09-17T05:50:16.666735+0000","last_peered":"2024-09-17T05:50:16.666735+0000","last_clean":"2024-09-17T05:50:16.666735+0000","last_became_active":"2024-09-17T05:50:16.663594+0000","last_became_peered":"2024-09-17T05:50:16.663594+0000","last_unstale":"2024-09-17T05:50:16.666735+0000","last_undegraded":"2024-09-17T05:50:16.666735+0000","last_fullsized":"2024-09-17T05:50:16.666735+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:50:15.639879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:50:15.639879+0000","last_clean_scrub_stamp":"2024-09-17T05:50:15.639879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:32:04.915100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.11","version":"0'0","reported_seq":10,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-17T05:50:17.676653+0000","last_change":"2024-09-17T05:50:17.673526+0000","last_active":"2024-09-17T05:50:17.676653+0000","last_peered":"2024-09-17T05:50:17.676653+0000","last_clean":"2024-09-17T05:50:17.676653+0000","last_became_active":"2024-09-17T05:50:17.673209+0000","last_became_peered":"2024-09-17T05:50:17.673209+0000","last_unstale":"2024-09-17T05:50:17.676653+0000","last_undegraded":"2024-09-17T05:50:17.676653+0000","last_fullsized":"2024-09-17T05:50:17.676653+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:50:16.649689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:50:16.649689+0000","last_clean_scrub_stamp":"2024-09-17T05:50:16.649689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:45:11.588427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.10","version":"100'8","reported_seq":21,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-17T05:50:17.701091+0000","last_change":"2024-09-17T05:50:16.671667+0000","last_active":"2024-09-17T05:50:17.701091+0000","last_peered":"2024-09-17T05:50:17.701091+0000","last_clean":"2024-09-17T05:50:17.701091+0000","last_became_active":"2024-09-17T05:50:16.671069+0000","last_became_peered":"2024-09-17T05:50:16.671069+0000","last_unstale":"2024-09-17T05:50:17.701091+0000","last_undegraded":"2024-09-17T05:50:17.701091+0000","last_fullsized":"2024-09-17T05:50:17.701091+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:50:15.639879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:50:15.639879+0000","last_clean_scrub_stamp":"2024-09-17T05:50:15.639879+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:54:11.413425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.f","version":"0'0","reported_seq":10,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-17T05:50:17.694467+0000","last_change":"2024-09-17T05:50:17.693101+0000","last_active":"2024-09-17T05:50:17.694467+0000","last_peered":"2024-09-17T05:50:17.694467+0000","last_clean":"2024-09-17T05:50:17.694467+0000","last_became_active":"2024-09-17T05:50:17.692530+0000","last_became_peered":"2024-09-17T05:50:17.692530+0000","last_unstale":"2024-09-17T05:50:17.694467+0000","last_undegraded":"2024-09-17T05:50:17.694467+0000","last_fullsized":"2024-09-17T05:50:17.694467+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:50:16.649689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:50:16.649689+0000","last_clean_scrub_stamp":"2024-09-17T05:50:16.649689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:00:10.128109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.e","version":"0'0","reported_seq":10,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-17T05:50:16.677298+0000","last_change":"2024-09-17T05:50:16.676692+0000","last_active":"2024-09-17T05:50:16.677298+0000","last_peered":"2024-09-17T05:50:16.677298+0000","last_clean":"2024-09-17T05:50:16.677298+0000","last_became_active":"2024-09-17T05:50:16.676330+0000","last_became_peered":"2024-09-17T05:50:16.676330+0000","last_unstale":"2024-09-17T05:50:16.677298+0000","last_undegraded":"2024-09-17T05:50:16.677298+0000","last_fullsized":"2024-09-17T05:50:16.677298+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:50:15.639879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:50:15.639879+0000","last_clean_scrub_stamp":"2024-09-17T05:50:15.639879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:01:43.584924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.c","version":"0'0","reported_seq":1,"reported_epoch":99,"state":"creating+peering","last_fresh":"2024-09-17T05:50:16.655146+0000","last_change":"2024-09-17T05:50:16.655146+0000","last_active":"2024-09-17T05:50:16.649689+0000","last_peered":"2024-09-17T05:50:16.649689+0000","last_clean":"2024-09-17T05:50:16.649689+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:50:16.655146+0000","last_undegraded":"2024-09-17T05:50:16.655146+0000","last_fullsized":"2024-09-17T05:50:16.655146+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:50:16.649689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:50:16.649689+0000","last_clean_scrub_stamp":"2024-09-17T05:50:16.649689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.d","version":"100'1","reported_seq":14,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-17T05:50:17.702271+0000","last_change":"2024-09-17T05:50:16.663432+0000","last_active":"2024-09-17T05:50:17.702271+0000","last_peered":"2024-09-17T05:50:17.702271+0000","last_clean":"2024-09-17T05:50:17.702271+0000","last_became_active":"2024-09-17T05:50:16.663096+0000","last_became_peered":"2024-09-17T05:50:16.663096+0000","last_unstale":"2024-09-17T05:50:17.702271+0000","last_undegraded":"2024-09-17T05:50:17.702271+0000","last_fullsized":"2024-09-17T05:50:17.702271+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:50:15.639879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:50:15.639879+0000","last_clean_scrub_stamp":"2024-09-17T05:50:15.639879+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:31:07.149126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.d","version":"0'0","reported_seq":1,"reported_epoch":99,"state":"creating+peering","last_fresh":"2024-09-17T05:50:16.664714+0000","last_change":"2024-09-17T05:50:16.664714+0000","last_active":"2024-09-17T05:50:16.649689+0000","last_peered":"2024-09-17T05:50:16.649689+0000","last_clean":"2024-09-17T05:50:16.649689+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:50:16.664714+0000","last_undegraded":"2024-09-17T05:50:16.664714+0000","last_fullsized":"2024-09-17T05:50:16.664714+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:50:16.649689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:50:16.649689+0000","last_clean_scrub_stamp":"2024-09-17T05:50:16.649689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.c","version":"0'0","reported_seq":15,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-17T05:50:18.686186+0000","last_change":"2024-09-17T05:50:16.676827+0000","last_active":"2024-09-17T05:50:18.686186+0000","last_peered":"2024-09-17T05:50:18.686186+0000","last_clean":"2024-09-17T05:50:18.686186+0000","last_became_active":"2024-09-17T05:50:16.674588+0000","last_became_peered":"2024-09-17T05:50:16.674588+0000","last_unstale":"2024-09-17T05:50:18.686186+0000","last_undegraded":"2024-09-17T05:50:18.686186+0000","last_fullsized":"2024-09-17T05:50:18.686186+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:50:15.639879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:50:15.639879+0000","last_clean_scrub_stamp":"2024-09-17T05:50:15.639879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:41:10.083935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.a","version":"0'0","reported_seq":10,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-17T05:50:17.691508+0000","last_change":"2024-09-17T05:50:17.682895+0000","last_active":"2024-09-17T05:50:17.691508+0000","last_peered":"2024-09-17T05:50:17.691508+0000","last_clean":"2024-09-17T05:50:17.691508+0000","last_became_active":"2024-09-17T05:50:17.682597+0000","last_became_peered":"2024-09-17T05:50:17.682597+0000","last_unstale":"2024-09-17T05:50:17.691508+0000","last_undegraded":"2024-09-17T05:50:17.691508+0000","last_fullsized":"2024-09-17T05:50:17.691508+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:50:16.649689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:50:16.649689+0000","last_clean_scrub_stamp":"2024-09-17T05:50:16.649689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:08:03.346563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.b","version":"100'2","reported_seq":17,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-17T05:50:18.686463+0000","last_change":"2024-09-17T05:50:16.678475+0000","last_active":"2024-09-17T05:50:18.686463+0000","last_peered":"2024-09-17T05:50:18.686463+0000","last_clean":"2024-09-17T05:50:18.686463+0000","last_became_active":"2024-09-17T05:50:16.677955+0000","last_became_peered":"2024-09-17T05:50:16.677955+0000","last_unstale":"2024-09-17T05:50:18.686463+0000","last_undegraded":"2024-09-17T05:50:18.686463+0000","last_fullsized":"2024-09-17T05:50:18.686463+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:50:15.639879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:50:15.639879+0000","last_clean_scrub_stamp":"2024-09-17T05:50:15.639879+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:30:59.350580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.b","version":"0'0","reported_seq":10,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-17T05:50:17.697857+0000","last_change":"2024-09-17T05:50:17.690262+0000","last_active":"2024-09-17T05:50:17.697857+0000","last_peered":"2024-09-17T05:50:17.697857+0000","last_clean":"2024-09-17T05:50:17.697857+0000","last_became_active":"2024-09-17T05:50:17.689973+0000","last_became_peered":"2024-09-17T05:50:17.689973+0000","last_unstale":"2024-09-17T05:50:17.697857+0000","last_undegraded":"2024-09-17T05:50:17.697857+0000","last_fullsized":"2024-09-17T05:50:17.697857+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:50:16.649689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:50:16.649689+0000","last_clean_scrub_stamp":"2024-09-17T05:50:16.649689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:07:11.041448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.a","version":"0'0","reported_seq":10,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-17T05:50:16.672947+0000","last_change":"2024-09-17T05:50:16.672269+0000","last_active":"2024-09-17T05:50:16.672947+0000","last_peered":"2024-09-17T05:50:16.672947+0000","last_clean":"2024-09-17T05:50:16.672947+0000","last_became_active":"2024-09-17T05:50:16.671875+0000","last_became_peered":"2024-09-17T05:50:16.671875+0000","last_unstale":"2024-09-17T05:50:16.672947+0000","last_undegraded":"2024-09-17T05:50:16.672947+0000","last_fullsized":"2024-09-17T05:50:16.672947+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:50:15.639879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:50:15.639879+0000","last_clean_scrub_stamp":"2024-09-17T05:50:15.639879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:45:53.339111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.8","version":"0'0","reported_seq":10,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-17T05:50:17.678457+0000","last_change":"2024-09-17T05:50:17.675705+0000","last_active":"2024-09-17T05:50:17.678457+0000","last_peered":"2024-09-17T05:50:17.678457+0000","last_clean":"2024-09-17T05:50:17.678457+0000","last_became_active":"2024-09-17T05:50:17.674936+0000","last_became_peered":"2024-09-17T05:50:17.674936+0000","last_unstale":"2024-09-17T05:50:17.678457+0000","last_undegraded":"2024-09-17T05:50:17.678457+0000","last_fullsized":"2024-09-17T05:50:17.678457+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:50:16.649689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:50:16.649689+0000","last_clean_scrub_stamp":"2024-09-17T05:50:16.649689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:43:33.495433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.9","version":"0'0","reported_seq":10,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-17T05:50:16.665701+0000","last_change":"2024-09-17T05:50:16.663708+0000","last_active":"2024-09-17T05:50:16.665701+0000","last_peered":"2024-09-17T05:50:16.665701+0000","last_clean":"2024-09-17T05:50:16.665701+0000","last_became_active":"2024-09-17T05:50:16.663348+0000","last_became_peered":"2024-09-17T05:50:16.663348+0000","last_unstale":"2024-09-17T05:50:16.665701+0000","last_undegraded":"2024-09-17T05:50:16.665701+0000","last_fullsized":"2024-09-17T05:50:16.665701+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:50:15.639879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:50:15.639879+0000","last_clean_scrub_stamp":"2024-09-17T05:50:15.639879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:09:03.844072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.9","version":"0'0","reported_seq":10,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-17T05:50:17.692330+0000","last_change":"2024-09-17T05:50:17.687159+0000","last_active":"2024-09-17T05:50:17.692330+0000","last_peered":"2024-09-17T05:50:17.692330+0000","last_clean":"2024-09-17T05:50:17.692330+0000","last_became_active":"2024-09-17T05:50:17.686709+0000","last_became_peered":"2024-09-17T05:50:17.686709+0000","last_unstale":"2024-09-17T05:50:17.692330+0000","last_undegraded":"2024-09-17T05:50:17.692330+0000","last_fullsized":"2024-09-17T05:50:17.692330+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:50:16.649689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:50:16.649689+0000","last_clean_scrub_stamp":"2024-09-17T05:50:16.649689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:23:53.419421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.8","version":"0'0","reported_seq":15,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-17T05:50:18.686083+0000","last_change":"2024-09-17T05:50:16.673662+0000","last_active":"2024-09-17T05:50:18.686083+0000","last_peered":"2024-09-17T05:50:18.686083+0000","last_clean":"2024-09-17T05:50:18.686083+0000","last_became_active":"2024-09-17T05:50:16.673056+0000","last_became_peered":"2024-09-17T05:50:16.673056+0000","last_unstale":"2024-09-17T05:50:18.686083+0000","last_undegraded":"2024-09-17T05:50:18.686083+0000","last_fullsized":"2024-09-17T05:50:18.686083+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:50:15.639879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:50:15.639879+0000","last_clean_scrub_stamp":"2024-09-17T05:50:15.639879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:10:01.927806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.6","version":"0'0","reported_seq":13,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-17T05:50:18.686719+0000","last_change":"2024-09-17T05:50:17.684990+0000","last_active":"2024-09-17T05:50:18.686719+0000","last_peered":"2024-09-17T05:50:18.686719+0000","last_clean":"2024-09-17T05:50:18.686719+0000","last_became_active":"2024-09-17T05:50:17.684521+0000","last_became_peered":"2024-09-17T05:50:17.684521+0000","last_unstale":"2024-09-17T05:50:18.686719+0000","last_undegraded":"2024-09-17T05:50:18.686719+0000","last_fullsized":"2024-09-17T05:50:18.686719+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:50:16.649689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:50:16.649689+0000","last_clean_scrub_stamp":"2024-09-17T05:50:16.649689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:00:23.826449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.7","version":"0'0","reported_seq":10,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-17T05:50:16.665838+0000","last_change":"2024-09-17T05:50:16.663678+0000","last_active":"2024-09-17T05:50:16.665838+0000","last_peered":"2024-09-17T05:50:16.665838+0000","last_clean":"2024-09-17T05:50:16.665838+0000","last_became_active":"2024-09-17T05:50:16.663332+0000","last_became_peered":"2024-09-17T05:50:16.663332+0000","last_unstale":"2024-09-17T05:50:16.665838+0000","last_undegraded":"2024-09-17T05:50:16.665838+0000","last_fullsized":"2024-09-17T05:50:16.665838+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:50:15.639879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:50:15.639879+0000","last_clean_scrub_stamp":"2024-09-17T05:50:15.639879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:57:42.985502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.7","version":"0'0","reported_seq":10,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-17T05:50:17.683380+0000","last_change":"2024-09-17T05:50:17.680146+0000","last_active":"2024-09-17T05:50:17.683380+0000","last_peered":"2024-09-17T05:50:17.683380+0000","last_clean":"2024-09-17T05:50:17.683380+0000","last_became_active":"2024-09-17T05:50:17.679833+0000","last_became_peered":"2024-09-17T05:50:17.679833+0000","last_unstale":"2024-09-17T05:50:17.683380+0000","last_undegraded":"2024-09-17T05:50:17.683380+0000","last_fullsized":"2024-09-17T05:50:17.683380+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:50:16.649689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:50:16.649689+0000","last_clean_scrub_stamp":"2024-09-17T05:50:16.649689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:34:43.730314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.6","version":"101'1","reported_seq":16,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-17T05:50:18.687959+0000","last_change":"2024-09-17T05:50:16.676247+0000","last_active":"2024-09-17T05:50:18.687959+0000","last_peered":"2024-09-17T05:50:18.687959+0000","last_clean":"2024-09-17T05:50:18.687959+0000","last_became_active":"2024-09-17T05:50:16.674892+0000","last_became_peered":"2024-09-17T05:50:16.674892+0000","last_unstale":"2024-09-17T05:50:18.687959+0000","last_undegraded":"2024-09-17T05:50:18.687959+0000","last_fullsized":"2024-09-17T05:50:18.687959+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:50:15.639879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:50:15.639879+0000","last_clean_scrub_stamp":"2024-09-17T05:50:15.639879+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:30:08.711913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.4","version":"0'0","reported_seq":10,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-17T05:50:17.700701+0000","last_change":"2024-09-17T05:50:17.694044+0000","last_active":"2024-09-17T05:50:17.700701+0000","last_peered":"2024-09-17T05:50:17.700701+0000","last_clean":"2024-09-17T05:50:17.700701+0000","last_became_active":"2024-09-17T05:50:17.693724+0000","last_became_peered":"2024-09-17T05:50:17.693724+0000","last_unstale":"2024-09-17T05:50:17.700701+0000","last_undegraded":"2024-09-17T05:50:17.700701+0000","last_fullsized":"2024-09-17T05:50:17.700701+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:50:16.649689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:50:16.649689+0000","last_clean_scrub_stamp":"2024-09-17T05:50:16.649689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:00:14.576200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.5","version":"0'0","reported_seq":15,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-17T05:50:18.686425+0000","last_change":"2024-09-17T05:50:16.679037+0000","last_active":"2024-09-17T05:50:18.686425+0000","last_peered":"2024-09-17T05:50:18.686425+0000","last_clean":"2024-09-17T05:50:18.686425+0000","last_became_active":"2024-09-17T05:50:16.678604+0000","last_became_peered":"2024-09-17T05:50:16.678604+0000","last_unstale":"2024-09-17T05:50:18.686425+0000","last_undegraded":"2024-09-17T05:50:18.686425+0000","last_fullsized":"2024-09-17T05:50:18.686425+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:50:15.639879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:50:15.639879+0000","last_clean_scrub_stamp":"2024-09-17T05:50:15.639879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:31:44.846045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.5","version":"0'0","reported_seq":10,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-17T05:50:17.688492+0000","last_change":"2024-09-17T05:50:17.684200+0000","last_active":"2024-09-17T05:50:17.688492+0000","last_peered":"2024-09-17T05:50:17.688492+0000","last_clean":"2024-09-17T05:50:17.688492+0000","last_became_active":"2024-09-17T05:50:17.683866+0000","last_became_peered":"2024-09-17T05:50:17.683866+0000","last_unstale":"2024-09-17T05:50:17.688492+0000","last_undegraded":"2024-09-17T05:50:17.688492+0000","last_fullsized":"2024-09-17T05:50:17.688492+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:50:16.649689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:50:16.649689+0000","last_clean_scrub_stamp":"2024-09-17T05:50:16.649689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:45:29.227941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.4","version":"0'0","reported_seq":13,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-17T05:50:17.682877+0000","last_change":"2024-09-17T05:50:16.669515+0000","last_active":"2024-09-17T05:50:17.682877+0000","last_peered":"2024-09-17T05:50:17.682877+0000","last_clean":"2024-09-17T05:50:17.682877+0000","last_became_active":"2024-09-17T05:50:16.669123+0000","last_became_peered":"2024-09-17T05:50:16.669123+0000","last_unstale":"2024-09-17T05:50:17.682877+0000","last_undegraded":"2024-09-17T05:50:17.682877+0000","last_fullsized":"2024-09-17T05:50:17.682877+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:50:15.639879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:50:15.639879+0000","last_clean_scrub_stamp":"2024-09-17T05:50:15.639879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:36:09.486712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.2","version":"0'0","reported_seq":10,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-17T05:50:17.699104+0000","last_change":"2024-09-17T05:50:17.694213+0000","last_active":"2024-09-17T05:50:17.699104+0000","last_peered":"2024-09-17T05:50:17.699104+0000","last_clean":"2024-09-17T05:50:17.699104+0000","last_became_active":"2024-09-17T05:50:17.684089+0000","last_became_peered":"2024-09-17T05:50:17.684089+0000","last_unstale":"2024-09-17T05:50:17.699104+0000","last_undegraded":"2024-09-17T05:50:17.699104+0000","last_fullsized":"2024-09-17T05:50:17.699104+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:50:16.649689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:50:16.649689+0000","last_clean_scrub_stamp":"2024-09-17T05:50:16.649689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:58:43.708570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.3","version":"0'0","reported_seq":15,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-17T05:50:18.686471+0000","last_change":"2024-09-17T05:50:16.669971+0000","last_active":"2024-09-17T05:50:18.686471+0000","last_peered":"2024-09-17T05:50:18.686471+0000","last_clean":"2024-09-17T05:50:18.686471+0000","last_became_active":"2024-09-17T05:50:16.667502+0000","last_became_peered":"2024-09-17T05:50:16.667502+0000","last_unstale":"2024-09-17T05:50:18.686471+0000","last_undegraded":"2024-09-17T05:50:18.686471+0000","last_fullsized":"2024-09-17T05:50:18.686471+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:50:15.639879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:50:15.639879+0000","last_clean_scrub_stamp":"2024-09-17T05:50:15.639879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:15:08.648001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.3","version":"0'0","reported_seq":1,"reported_epoch":99,"state":"creating+peering","last_fresh":"2024-09-17T05:50:16.655898+0000","last_change":"2024-09-17T05:50:16.655898+0000","last_active":"2024-09-17T05:50:16.649689+0000","last_peered":"2024-09-17T05:50:16.649689+0000","last_clean":"2024-09-17T05:50:16.649689+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:50:16.655898+0000","last_undegraded":"2024-09-17T05:50:16.655898+0000","last_fullsized":"2024-09-17T05:50:16.655898+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:50:16.649689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:50:16.649689+0000","last_clean_scrub_stamp":"2024-09-17T05:50:16.649689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.2","version":"0'0","reported_seq":13,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-17T05:50:17.679835+0000","last_change":"2024-09-17T05:50:16.672742+0000","last_active":"2024-09-17T05:50:17.679835+0000","last_peered":"2024-09-17T05:50:17.679835+0000","last_clean":"2024-09-17T05:50:17.679835+0000","last_became_active":"2024-09-17T05:50:16.672357+0000","last_became_peered":"2024-09-17T05:50:16.672357+0000","last_unstale":"2024-09-17T05:50:17.679835+0000","last_undegraded":"2024-09-17T05:50:17.679835+0000","last_fullsized":"2024-09-17T05:50:17.679835+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:50:15.639879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:50:15.639879+0000","last_clean_scrub_stamp":"2024-09-17T05:50:15.639879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:30:35.738894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.0","version":"0'0","reported_seq":10,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-17T05:50:17.678422+0000","last_change":"2024-09-17T05:50:17.675260+0000","last_active":"2024-09-17T05:50:17.678422+0000","last_peered":"2024-09-17T05:50:17.678422+0000","last_clean":"2024-09-17T05:50:17.678422+0000","last_became_active":"2024-09-17T05:50:17.674667+0000","last_became_peered":"2024-09-17T05:50:17.674667+0000","last_unstale":"2024-09-17T05:50:17.678422+0000","last_undegraded":"2024-09-17T05:50:17.678422+0000","last_fullsized":"2024-09-17T05:50:17.678422+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:50:16.649689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:50:16.649689+0000","last_clean_scrub_stamp":"2024-09-17T05:50:16.649689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:33:47.309127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.1","version":"0'0","reported_seq":13,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-17T05:50:17.666388+0000","last_change":"2024-09-17T05:50:16.670111+0000","last_active":"2024-09-17T05:50:17.666388+0000","last_peered":"2024-09-17T05:50:17.666388+0000","last_clean":"2024-09-17T05:50:17.666388+0000","last_became_active":"2024-09-17T05:50:16.669343+0000","last_became_peered":"2024-09-17T05:50:16.669343+0000","last_unstale":"2024-09-17T05:50:17.666388+0000","last_undegraded":"2024-09-17T05:50:17.666388+0000","last_fullsized":"2024-09-17T05:50:17.666388+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:50:15.639879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:50:15.639879+0000","last_clean_scrub_stamp":"2024-09-17T05:50:15.639879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:14:06.830335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.1","version":"0'0","reported_seq":10,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-17T05:50:17.694046+0000","last_change":"2024-09-17T05:50:17.692076+0000","last_active":"2024-09-17T05:50:17.694046+0000","last_peered":"2024-09-17T05:50:17.694046+0000","last_clean":"2024-09-17T05:50:17.694046+0000","last_became_active":"2024-09-17T05:50:17.688755+0000","last_became_peered":"2024-09-17T05:50:17.688755+0000","last_unstale":"2024-09-17T05:50:17.694046+0000","last_undegraded":"2024-09-17T05:50:17.694046+0000","last_fullsized":"2024-09-17T05:50:17.694046+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:50:16.649689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:50:16.649689+0000","last_clean_scrub_stamp":"2024-09-17T05:50:16.649689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:09:55.788176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.0","version":"0'0","reported_seq":13,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-17T05:50:17.669830+0000","last_change":"2024-09-17T05:50:16.680798+0000","last_active":"2024-09-17T05:50:17.669830+0000","last_peered":"2024-09-17T05:50:17.669830+0000","last_clean":"2024-09-17T05:50:17.669830+0000","last_became_active":"2024-09-17T05:50:16.680485+0000","last_became_peered":"2024-09-17T05:50:16.680485+0000","last_unstale":"2024-09-17T05:50:17.669830+0000","last_undegraded":"2024-09-17T05:50:17.669830+0000","last_fullsized":"2024-09-17T05:50:17.669830+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:50:15.639879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:50:15.639879+0000","last_clean_scrub_stamp":"2024-09-17T05:50:15.639879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:59:08.119171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.e","version":"0'0","reported_seq":10,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-17T05:50:17.685022+0000","last_change":"2024-09-17T05:50:17.682012+0000","last_active":"2024-09-17T05:50:17.685022+0000","last_peered":"2024-09-17T05:50:17.685022+0000","last_clean":"2024-09-17T05:50:17.685022+0000","last_became_active":"2024-09-17T05:50:17.681695+0000","last_became_peered":"2024-09-17T05:50:17.681695+0000","last_unstale":"2024-09-17T05:50:17.685022+0000","last_undegraded":"2024-09-17T05:50:17.685022+0000","last_fullsized":"2024-09-17T05:50:17.685022+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:50:16.649689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:50:16.649689+0000","last_clean_scrub_stamp":"2024-09-17T05:50:16.649689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:51:07.133701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.f","version":"0'0","reported_seq":10,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-17T05:50:16.675558+0000","last_change":"2024-09-17T05:50:16.675030+0000","last_active":"2024-09-17T05:50:16.675558+0000","last_peered":"2024-09-17T05:50:16.675558+0000","last_clean":"2024-09-17T05:50:16.675558+0000","last_became_active":"2024-09-17T05:50:16.674713+0000","last_became_peered":"2024-09-17T05:50:16.674713+0000","last_unstale":"2024-09-17T05:50:16.675558+0000","last_undegraded":"2024-09-17T05:50:16.675558+0000","last_fullsized":"2024-09-17T05:50:16.675558+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:50:15.639879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:50:15.639879+0000","last_clean_scrub_stamp":"2024-09-17T05:50:15.639879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:41:28.416146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"19'72","reported_seq":251,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-17T05:50:16.668637+0000","last_change":"2024-09-17T05:41:48.539830+0000","last_active":"2024-09-17T05:50:16.668637+0000","last_peered":"2024-09-17T05:50:16.668637+0000","last_clean":"2024-09-17T05:50:16.668637+0000","last_became_active":"2024-09-17T05:41:48.538743+0000","last_became_peered":"2024-09-17T05:41:48.538743+0000","last_unstale":"2024-09-17T05:50:16.668637+0000","last_undegraded":"2024-09-17T05:50:16.668637+0000","last_fullsized":"2024-09-17T05:50:16.668637+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:47.152539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:47.152539+0000","last_clean_scrub_stamp":"2024-09-17T05:41:47.152539+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:08:02.952016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":15,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":14,"num_pg":32,"stat_sum":{"num_bytes":686,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":10,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2902,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":24,"ondisk_log_size":24,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":16,"seq":68719476843,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":118412,"kb_used_data":1208,"kb_used_omap":1,"kb_used_meta":117182,"kb_avail":94253428,"statfs":{"total":96636764160,"available":96515510272,"internally_reserved":0,"allocated":1236992,"data_stored":531916,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":119994822},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":7,"up_from":15,"seq":64424509547,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":127280,"kb_used_data":1756,"kb_used_omap":1,"kb_used_meta":125502,"kb_avail":94244560,"statfs":{"total":96636764160,"available":96506429440,"internally_reserved":0,"allocated":1798144,"data_stored":1108358,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":128514506},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509546,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":72556,"kb_used_data":1176,"kb_used_omap":1,"kb_used_meta":71358,"kb_avail":94299284,"statfs":{"total":96636764160,"available":96562466816,"internally_reserved":0,"allocated":1204224,"data_stored":517990,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":73071045},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509546,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":148908,"kb_used_data":1176,"kb_used_omap":1,"kb_used_meta":147710,"kb_avail":94222932,"statfs":{"total":96636764160,"available":96484282368,"internally_reserved":0,"allocated":1204224,"data_stored":517990,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":151255493},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509546,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":112824,"kb_used_data":1188,"kb_used_omap":1,"kb_used_meta":111614,"kb_avail":94259016,"statfs":{"total":96636764160,"available":96521232384,"internally_reserved":0,"allocated":1216512,"data_stored":524377,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":114293191},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509546,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":153096,"kb_used_data":1204,"kb_used_omap":1,"kb_used_meta":151870,"kb_avail":94218744,"statfs":{"total":96636764160,"available":96479993856,"internally_reserved":0,"allocated":1232896,"data_stored":531298,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":155515333},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509546,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":118396,"kb_used_data":1188,"kb_used_omap":1,"kb_used_meta":117182,"kb_avail":94253444,"statfs":{"total":96636764160,"available":96515526656,"internally_reserved":0,"allocated":1216512,"data_stored":524377,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":119994821},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574954,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":131468,"kb_used_data":1784,"kb_used_omap":1,"kb_used_meta":129662,"kb_avail":94240372,"statfs":{"total":96636764160,"available":96502140928,"internally_reserved":0,"allocated":1826816,"data_stored":1122214,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":132774341},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-17T05:50:22.061 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-17T05:50:22.211 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:22.210+0000 7f8bcdc27640 1 -- 172.21.15.150:0/1582156274 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8bc80ad0e0 msgr2=0x7f8bc80ad4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:50:22.211 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:22.210+0000 7f8bcdc27640 1 --2- 172.21.15.150:0/1582156274 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8bc80ad0e0 0x7f8bc80ad4f0 secure :-1 s=READY pgs=1324 cs=0 l=1 rev1=1 crypto rx=0x7f8bbc005fd0 tx=0x7f8bbc02a4a0 comp rx=0 tx=0).stop 2024-09-17T05:50:22.211 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:22.210+0000 7f8bcdc27640 1 -- 172.21.15.150:0/1582156274 shutdown_connections 2024-09-17T05:50:22.211 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:22.210+0000 7f8bcdc27640 1 --2- 172.21.15.150:0/1582156274 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8bc80ad0e0 0x7f8bc80ad4f0 unknown :-1 s=CLOSED pgs=1324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:50:22.212 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:22.210+0000 7f8bcdc27640 1 --2- 172.21.15.150:0/1582156274 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8bc815d760 0x7f8bc81535c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:50:22.212 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:22.210+0000 7f8bcdc27640 1 -- 172.21.15.150:0/1582156274 >> 172.21.15.150:0/1582156274 conn(0x7f8bc806d730 msgr2=0x7f8bc80b1e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:50:22.212 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:22.210+0000 7f8bcdc27640 1 -- 172.21.15.150:0/1582156274 shutdown_connections 2024-09-17T05:50:22.212 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:22.210+0000 7f8bcdc27640 1 -- 172.21.15.150:0/1582156274 wait complete. 2024-09-17T05:50:22.212 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:22.212+0000 7f8bcdc27640 1 Processor -- start 2024-09-17T05:50:22.212 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:22.212+0000 7f8bcdc27640 1 -- start start 2024-09-17T05:50:22.216 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:22.213+0000 7f8bcdc27640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8bc80ad0e0 0x7f8bc8149220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:50:22.216 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:22.213+0000 7f8bcdc27640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8bc815d760 0x7f8bc8159140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:50:22.216 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:22.213+0000 7f8bcdc27640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8bc8160310 0x7f8bc8070100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:50:22.216 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:22.213+0000 7f8bcdc27640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f8bc806f220 con 0x7f8bc815d760 2024-09-17T05:50:22.216 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:22.213+0000 7f8bcdc27640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f8bc806f0a0 con 0x7f8bc80ad0e0 2024-09-17T05:50:22.216 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:22.213+0000 7f8bcdc27640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f8bc80b4c20 con 0x7f8bc8160310 2024-09-17T05:50:22.216 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:22.213+0000 7f8bc6ffd640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8bc815d760 0x7f8bc8159140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:50:22.216 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:22.213+0000 7f8bc6ffd640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8bc815d760 0x7f8bc8159140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:57284/0 (socket says 172.21.15.150:57284) 2024-09-17T05:50:22.216 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:22.213+0000 7f8bc6ffd640 1 -- 172.21.15.150:0/1813729126 learned_addr learned my addr 172.21.15.150:0/1813729126 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:50:22.216 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:22.214+0000 7f8bc77fe640 1 --2- 172.21.15.150:0/1813729126 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8bc80ad0e0 0x7f8bc8149220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:50:22.216 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:22.214+0000 7f8bc7fff640 1 --2- 172.21.15.150:0/1813729126 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8bc8160310 0x7f8bc8070100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:50:22.216 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:22.214+0000 7f8bc6ffd640 1 -- 172.21.15.150:0/1813729126 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8bc8160310 msgr2=0x7f8bc8070100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:50:22.217 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:22.214+0000 7f8bc6ffd640 1 --2- 172.21.15.150:0/1813729126 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8bc8160310 0x7f8bc8070100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:50:22.217 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:22.214+0000 7f8bc6ffd640 1 -- 172.21.15.150:0/1813729126 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8bc80ad0e0 msgr2=0x7f8bc8149220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:50:22.217 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:22.214+0000 7f8bc6ffd640 1 --2- 172.21.15.150:0/1813729126 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8bc80ad0e0 0x7f8bc8149220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:50:22.217 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:22.214+0000 7f8bc6ffd640 1 -- 172.21.15.150:0/1813729126 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8bc814d750 con 0x7f8bc815d760 2024-09-17T05:50:22.217 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:22.214+0000 7f8bc6ffd640 1 --2- 172.21.15.150:0/1813729126 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8bc815d760 0x7f8bc8159140 secure :-1 s=READY pgs=1325 cs=0 l=1 rev1=1 crypto rx=0x7f8bbc034040 tx=0x7f8bbc0039e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:50:22.217 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:22.214+0000 7f8baffff640 1 -- 172.21.15.150:0/1813729126 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8bbc03e030 con 0x7f8bc815d760 2024-09-17T05:50:22.217 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:22.214+0000 7f8baffff640 1 -- 172.21.15.150:0/1813729126 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8bbc0047a0 con 0x7f8bc815d760 2024-09-17T05:50:22.217 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:22.214+0000 7f8bcdc27640 1 -- 172.21.15.150:0/1813729126 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8bc8155e20 con 0x7f8bc815d760 2024-09-17T05:50:22.217 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:22.214+0000 7f8baffff640 1 -- 172.21.15.150:0/1813729126 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8bbc035040 con 0x7f8bc815d760 2024-09-17T05:50:22.217 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:22.214+0000 7f8bcdc27640 1 -- 172.21.15.150:0/1813729126 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8bc81542c0 con 0x7f8bc815d760 2024-09-17T05:50:22.217 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:22.215+0000 7f8bcdc27640 1 -- 172.21.15.150:0/1813729126 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8bc8159a20 con 0x7f8bc815d760 2024-09-17T05:50:22.218 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:22.216+0000 7f8baffff640 1 -- 172.21.15.150:0/1813729126 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 32) ==== 103481+0+0 (secure 0 0 0) 0x7f8bbc041030 con 0x7f8bc815d760 2024-09-17T05:50:22.218 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:22.216+0000 7f8baffff640 1 --2- 172.21.15.150:0/1813729126 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f8bb407a210 0x7f8bb407c720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:50:22.218 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:22.217+0000 7f8baffff640 1 -- 172.21.15.150:0/1813729126 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(101..101 src has 1..101) ==== 5821+0+0 (secure 0 0 0) 0x7f8bbc0ba3e0 con 0x7f8bc815d760 2024-09-17T05:50:22.218 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:22.217+0000 7f8bc77fe640 1 --2- 172.21.15.150:0/1813729126 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f8bb407a210 0x7f8bb407c720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:50:22.218 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:22.217+0000 7f8bc77fe640 1 --2- 172.21.15.150:0/1813729126 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f8bb407a210 0x7f8bb407c720 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7f8bb8005d70 tx=0x7f8bb8005d00 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:50:22.221 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:22.221+0000 7f8baffff640 1 -- 172.21.15.150:0/1813729126 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f8bc80ada30 con 0x7f8bc815d760 2024-09-17T05:50:22.392 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:22.391+0000 7f8bcdc27640 1 -- 172.21.15.150:0/1813729126 --> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f8bc8160fc0 con 0x7f8bb407a210 2024-09-17T05:50:22.396 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:22.396+0000 7f8baffff640 1 -- 172.21.15.150:0/1813729126 <== mgr.4108 v2:172.21.15.176:6800/3631216395 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+250629 (secure 0 0 0) 0x7f8bc8160fc0 con 0x7f8bb407a210 2024-09-17T05:50:22.399 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-09-17T05:50:22.400 INFO:teuthology.orchestra.run.smithi150.stderr:dumped all 2024-09-17T05:50:22.402 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:22.399+0000 7f8bcdc27640 1 -- 172.21.15.150:0/1813729126 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f8bb407a210 msgr2=0x7f8bb407c720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:50:22.402 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:22.399+0000 7f8bcdc27640 1 --2- 172.21.15.150:0/1813729126 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f8bb407a210 0x7f8bb407c720 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7f8bb8005d70 tx=0x7f8bb8005d00 comp rx=0 tx=0).stop 2024-09-17T05:50:22.402 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:22.399+0000 7f8bcdc27640 1 -- 172.21.15.150:0/1813729126 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8bc815d760 msgr2=0x7f8bc8159140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:50:22.402 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:22.399+0000 7f8bcdc27640 1 --2- 172.21.15.150:0/1813729126 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8bc815d760 0x7f8bc8159140 secure :-1 s=READY pgs=1325 cs=0 l=1 rev1=1 crypto rx=0x7f8bbc034040 tx=0x7f8bbc0039e0 comp rx=0 tx=0).stop 2024-09-17T05:50:22.402 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:22.399+0000 7f8bcdc27640 1 -- 172.21.15.150:0/1813729126 shutdown_connections 2024-09-17T05:50:22.402 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:22.399+0000 7f8bcdc27640 1 --2- 172.21.15.150:0/1813729126 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f8bb407a210 0x7f8bb407c720 unknown :-1 s=CLOSED pgs=572 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:50:22.403 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:22.399+0000 7f8bcdc27640 1 --2- 172.21.15.150:0/1813729126 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8bc8160310 0x7f8bc8070100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:50:22.403 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:22.399+0000 7f8bcdc27640 1 --2- 172.21.15.150:0/1813729126 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8bc815d760 0x7f8bc8159140 unknown :-1 s=CLOSED pgs=1325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:50:22.403 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:22.399+0000 7f8bcdc27640 1 --2- 172.21.15.150:0/1813729126 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8bc80ad0e0 0x7f8bc8149220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:50:22.403 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:22.399+0000 7f8bcdc27640 1 -- 172.21.15.150:0/1813729126 >> 172.21.15.150:0/1813729126 conn(0x7f8bc806d730 msgr2=0x7f8bc80d0270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:50:22.403 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:22.399+0000 7f8bcdc27640 1 -- 172.21.15.150:0/1813729126 shutdown_connections 2024-09-17T05:50:22.403 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:22.399+0000 7f8bcdc27640 1 -- 172.21.15.150:0/1813729126 wait complete. 2024-09-17T05:50:22.412 INFO:teuthology.orchestra.run.smithi150.stdout:{"pg_ready":true,"pg_map":{"version":353,"stamp":"2024-09-17T05:50:21.039548+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":591054,"num_objects":15,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":129,"num_write_kb":1637,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":10,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":96,"ondisk_log_size":96,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":60,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":982940,"kb_used_data":10680,"kb_used_omap":12,"kb_used_meta":972083,"kb_avail":753991780,"statfs":{"total":773094113280,"available":772087582720,"internally_reserved":0,"allocated":10936320,"data_stored":5378520,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":995413552},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":20,"apply_latency_ms":20,"commit_latency_ns":20000000,"apply_latency_ns":20000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":686,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":10,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.388456"},"pg_stats":[{"pgid":"15.3f","version":"0'0","reported_seq":10,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-17T05:50:17.692584+0000","last_change":"2024-09-17T05:50:17.688948+0000","last_active":"2024-09-17T05:50:17.692584+0000","last_peered":"2024-09-17T05:50:17.692584+0000","last_clean":"2024-09-17T05:50:17.692584+0000","last_became_active":"2024-09-17T05:50:17.688664+0000","last_became_peered":"2024-09-17T05:50:17.688664+0000","last_unstale":"2024-09-17T05:50:17.692584+0000","last_undegraded":"2024-09-17T05:50:17.692584+0000","last_fullsized":"2024-09-17T05:50:17.692584+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:50:16.649689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:50:16.649689+0000","last_clean_scrub_stamp":"2024-09-17T05:50:16.649689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:03:34.676383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.3e","version":"0'0","reported_seq":13,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-17T05:50:18.686282+0000","last_change":"2024-09-17T05:50:17.686607+0000","last_active":"2024-09-17T05:50:18.686282+0000","last_peered":"2024-09-17T05:50:18.686282+0000","last_clean":"2024-09-17T05:50:18.686282+0000","last_became_active":"2024-09-17T05:50:17.685913+0000","last_became_peered":"2024-09-17T05:50:17.685913+0000","last_unstale":"2024-09-17T05:50:18.686282+0000","last_undegraded":"2024-09-17T05:50:18.686282+0000","last_fullsized":"2024-09-17T05:50:18.686282+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:50:16.649689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:50:16.649689+0000","last_clean_scrub_stamp":"2024-09-17T05:50:16.649689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:17:42.646673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.3d","version":"0'0","reported_seq":10,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-17T05:50:17.692516+0000","last_change":"2024-09-17T05:50:17.687586+0000","last_active":"2024-09-17T05:50:17.692516+0000","last_peered":"2024-09-17T05:50:17.692516+0000","last_clean":"2024-09-17T05:50:17.692516+0000","last_became_active":"2024-09-17T05:50:17.687288+0000","last_became_peered":"2024-09-17T05:50:17.687288+0000","last_unstale":"2024-09-17T05:50:17.692516+0000","last_undegraded":"2024-09-17T05:50:17.692516+0000","last_fullsized":"2024-09-17T05:50:17.692516+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:50:16.649689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:50:16.649689+0000","last_clean_scrub_stamp":"2024-09-17T05:50:16.649689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:27:25.644171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.3c","version":"0'0","reported_seq":10,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-17T05:50:17.679950+0000","last_change":"2024-09-17T05:50:17.677226+0000","last_active":"2024-09-17T05:50:17.679950+0000","last_peered":"2024-09-17T05:50:17.679950+0000","last_clean":"2024-09-17T05:50:17.679950+0000","last_became_active":"2024-09-17T05:50:17.676607+0000","last_became_peered":"2024-09-17T05:50:17.676607+0000","last_unstale":"2024-09-17T05:50:17.679950+0000","last_undegraded":"2024-09-17T05:50:17.679950+0000","last_fullsized":"2024-09-17T05:50:17.679950+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:50:16.649689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:50:16.649689+0000","last_clean_scrub_stamp":"2024-09-17T05:50:16.649689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:19:07.779617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.3b","version":"0'0","reported_seq":10,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-17T05:50:17.692019+0000","last_change":"2024-09-17T05:50:17.686438+0000","last_active":"2024-09-17T05:50:17.692019+0000","last_peered":"2024-09-17T05:50:17.692019+0000","last_clean":"2024-09-17T05:50:17.692019+0000","last_became_active":"2024-09-17T05:50:17.686137+0000","last_became_peered":"2024-09-17T05:50:17.686137+0000","last_unstale":"2024-09-17T05:50:17.692019+0000","last_undegraded":"2024-09-17T05:50:17.692019+0000","last_fullsized":"2024-09-17T05:50:17.692019+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:50:16.649689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:50:16.649689+0000","last_clean_scrub_stamp":"2024-09-17T05:50:16.649689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:04:28.500108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.3a","version":"0'0","reported_seq":1,"reported_epoch":99,"state":"creating+peering","last_fresh":"2024-09-17T05:50:16.664990+0000","last_change":"2024-09-17T05:50:16.664990+0000","last_active":"2024-09-17T05:50:16.649689+0000","last_peered":"2024-09-17T05:50:16.649689+0000","last_clean":"2024-09-17T05:50:16.649689+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:50:16.664990+0000","last_undegraded":"2024-09-17T05:50:16.664990+0000","last_fullsized":"2024-09-17T05:50:16.664990+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:50:16.649689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:50:16.649689+0000","last_clean_scrub_stamp":"2024-09-17T05:50:16.649689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.39","version":"0'0","reported_seq":1,"reported_epoch":99,"state":"creating+peering","last_fresh":"2024-09-17T05:50:16.665949+0000","last_change":"2024-09-17T05:50:16.665949+0000","last_active":"2024-09-17T05:50:16.649689+0000","last_peered":"2024-09-17T05:50:16.649689+0000","last_clean":"2024-09-17T05:50:16.649689+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:50:16.665949+0000","last_undegraded":"2024-09-17T05:50:16.665949+0000","last_fullsized":"2024-09-17T05:50:16.665949+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:50:16.649689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:50:16.649689+0000","last_clean_scrub_stamp":"2024-09-17T05:50:16.649689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.38","version":"0'0","reported_seq":13,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-17T05:50:18.686276+0000","last_change":"2024-09-17T05:50:17.688288+0000","last_active":"2024-09-17T05:50:18.686276+0000","last_peered":"2024-09-17T05:50:18.686276+0000","last_clean":"2024-09-17T05:50:18.686276+0000","last_became_active":"2024-09-17T05:50:17.687994+0000","last_became_peered":"2024-09-17T05:50:17.687994+0000","last_unstale":"2024-09-17T05:50:18.686276+0000","last_undegraded":"2024-09-17T05:50:18.686276+0000","last_fullsized":"2024-09-17T05:50:18.686276+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:50:16.649689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:50:16.649689+0000","last_clean_scrub_stamp":"2024-09-17T05:50:16.649689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:34:26.313722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.37","version":"0'0","reported_seq":1,"reported_epoch":99,"state":"creating+peering","last_fresh":"2024-09-17T05:50:16.656812+0000","last_change":"2024-09-17T05:50:16.656812+0000","last_active":"2024-09-17T05:50:16.649689+0000","last_peered":"2024-09-17T05:50:16.649689+0000","last_clean":"2024-09-17T05:50:16.649689+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:50:16.656812+0000","last_undegraded":"2024-09-17T05:50:16.656812+0000","last_fullsized":"2024-09-17T05:50:16.656812+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:50:16.649689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:50:16.649689+0000","last_clean_scrub_stamp":"2024-09-17T05:50:16.649689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.36","version":"0'0","reported_seq":10,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-17T05:50:17.694249+0000","last_change":"2024-09-17T05:50:17.691032+0000","last_active":"2024-09-17T05:50:17.694249+0000","last_peered":"2024-09-17T05:50:17.694249+0000","last_clean":"2024-09-17T05:50:17.694249+0000","last_became_active":"2024-09-17T05:50:17.687974+0000","last_became_peered":"2024-09-17T05:50:17.687974+0000","last_unstale":"2024-09-17T05:50:17.694249+0000","last_undegraded":"2024-09-17T05:50:17.694249+0000","last_fullsized":"2024-09-17T05:50:17.694249+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:50:16.649689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:50:16.649689+0000","last_clean_scrub_stamp":"2024-09-17T05:50:16.649689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:21:42.242980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.35","version":"0'0","reported_seq":1,"reported_epoch":99,"state":"creating+peering","last_fresh":"2024-09-17T05:50:16.669270+0000","last_change":"2024-09-17T05:50:16.669270+0000","last_active":"2024-09-17T05:50:16.649689+0000","last_peered":"2024-09-17T05:50:16.649689+0000","last_clean":"2024-09-17T05:50:16.649689+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:50:16.669270+0000","last_undegraded":"2024-09-17T05:50:16.669270+0000","last_fullsized":"2024-09-17T05:50:16.669270+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:50:16.649689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:50:16.649689+0000","last_clean_scrub_stamp":"2024-09-17T05:50:16.649689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.34","version":"0'0","reported_seq":1,"reported_epoch":99,"state":"creating+peering","last_fresh":"2024-09-17T05:50:16.657363+0000","last_change":"2024-09-17T05:50:16.657363+0000","last_active":"2024-09-17T05:50:16.649689+0000","last_peered":"2024-09-17T05:50:16.649689+0000","last_clean":"2024-09-17T05:50:16.649689+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:50:16.657363+0000","last_undegraded":"2024-09-17T05:50:16.657363+0000","last_fullsized":"2024-09-17T05:50:16.657363+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:50:16.649689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:50:16.649689+0000","last_clean_scrub_stamp":"2024-09-17T05:50:16.649689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.33","version":"0'0","reported_seq":10,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-17T05:50:17.680120+0000","last_change":"2024-09-17T05:50:17.674595+0000","last_active":"2024-09-17T05:50:17.680120+0000","last_peered":"2024-09-17T05:50:17.680120+0000","last_clean":"2024-09-17T05:50:17.680120+0000","last_became_active":"2024-09-17T05:50:17.674286+0000","last_became_peered":"2024-09-17T05:50:17.674286+0000","last_unstale":"2024-09-17T05:50:17.680120+0000","last_undegraded":"2024-09-17T05:50:17.680120+0000","last_fullsized":"2024-09-17T05:50:17.680120+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:50:16.649689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:50:16.649689+0000","last_clean_scrub_stamp":"2024-09-17T05:50:16.649689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:39:58.578693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.32","version":"0'0","reported_seq":10,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-17T05:50:17.699073+0000","last_change":"2024-09-17T05:50:17.693635+0000","last_active":"2024-09-17T05:50:17.699073+0000","last_peered":"2024-09-17T05:50:17.699073+0000","last_clean":"2024-09-17T05:50:17.699073+0000","last_became_active":"2024-09-17T05:50:17.693172+0000","last_became_peered":"2024-09-17T05:50:17.693172+0000","last_unstale":"2024-09-17T05:50:17.699073+0000","last_undegraded":"2024-09-17T05:50:17.699073+0000","last_fullsized":"2024-09-17T05:50:17.699073+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:50:16.649689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:50:16.649689+0000","last_clean_scrub_stamp":"2024-09-17T05:50:16.649689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:03:31.990762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.31","version":"0'0","reported_seq":10,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-17T05:50:17.685964+0000","last_change":"2024-09-17T05:50:17.681216+0000","last_active":"2024-09-17T05:50:17.685964+0000","last_peered":"2024-09-17T05:50:17.685964+0000","last_clean":"2024-09-17T05:50:17.685964+0000","last_became_active":"2024-09-17T05:50:17.680783+0000","last_became_peered":"2024-09-17T05:50:17.680783+0000","last_unstale":"2024-09-17T05:50:17.685964+0000","last_undegraded":"2024-09-17T05:50:17.685964+0000","last_fullsized":"2024-09-17T05:50:17.685964+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:50:16.649689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:50:16.649689+0000","last_clean_scrub_stamp":"2024-09-17T05:50:16.649689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:51:50.910297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.30","version":"0'0","reported_seq":1,"reported_epoch":99,"state":"creating+peering","last_fresh":"2024-09-17T05:50:16.667715+0000","last_change":"2024-09-17T05:50:16.667715+0000","last_active":"2024-09-17T05:50:16.649689+0000","last_peered":"2024-09-17T05:50:16.649689+0000","last_clean":"2024-09-17T05:50:16.649689+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:50:16.667715+0000","last_undegraded":"2024-09-17T05:50:16.667715+0000","last_fullsized":"2024-09-17T05:50:16.667715+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:50:16.649689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:50:16.649689+0000","last_clean_scrub_stamp":"2024-09-17T05:50:16.649689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.2f","version":"0'0","reported_seq":13,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-17T05:50:18.686505+0000","last_change":"2024-09-17T05:50:17.686002+0000","last_active":"2024-09-17T05:50:18.686505+0000","last_peered":"2024-09-17T05:50:18.686505+0000","last_clean":"2024-09-17T05:50:18.686505+0000","last_became_active":"2024-09-17T05:50:17.685687+0000","last_became_peered":"2024-09-17T05:50:17.685687+0000","last_unstale":"2024-09-17T05:50:18.686505+0000","last_undegraded":"2024-09-17T05:50:18.686505+0000","last_fullsized":"2024-09-17T05:50:18.686505+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:50:16.649689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:50:16.649689+0000","last_clean_scrub_stamp":"2024-09-17T05:50:16.649689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:46:40.056183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.2e","version":"0'0","reported_seq":10,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-17T05:50:17.680159+0000","last_change":"2024-09-17T05:50:17.676677+0000","last_active":"2024-09-17T05:50:17.680159+0000","last_peered":"2024-09-17T05:50:17.680159+0000","last_clean":"2024-09-17T05:50:17.680159+0000","last_became_active":"2024-09-17T05:50:17.676390+0000","last_became_peered":"2024-09-17T05:50:17.676390+0000","last_unstale":"2024-09-17T05:50:17.680159+0000","last_undegraded":"2024-09-17T05:50:17.680159+0000","last_fullsized":"2024-09-17T05:50:17.680159+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:50:16.649689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:50:16.649689+0000","last_clean_scrub_stamp":"2024-09-17T05:50:16.649689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:02:08.191996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.2d","version":"0'0","reported_seq":10,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-17T05:50:17.692165+0000","last_change":"2024-09-17T05:50:17.689114+0000","last_active":"2024-09-17T05:50:17.692165+0000","last_peered":"2024-09-17T05:50:17.692165+0000","last_clean":"2024-09-17T05:50:17.692165+0000","last_became_active":"2024-09-17T05:50:17.688766+0000","last_became_peered":"2024-09-17T05:50:17.688766+0000","last_unstale":"2024-09-17T05:50:17.692165+0000","last_undegraded":"2024-09-17T05:50:17.692165+0000","last_fullsized":"2024-09-17T05:50:17.692165+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:50:16.649689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:50:16.649689+0000","last_clean_scrub_stamp":"2024-09-17T05:50:16.649689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:56:51.160610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.2c","version":"0'0","reported_seq":1,"reported_epoch":99,"state":"creating+peering","last_fresh":"2024-09-17T05:50:16.656329+0000","last_change":"2024-09-17T05:50:16.656329+0000","last_active":"2024-09-17T05:50:16.649689+0000","last_peered":"2024-09-17T05:50:16.649689+0000","last_clean":"2024-09-17T05:50:16.649689+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:50:16.656329+0000","last_undegraded":"2024-09-17T05:50:16.656329+0000","last_fullsized":"2024-09-17T05:50:16.656329+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:50:16.649689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:50:16.649689+0000","last_clean_scrub_stamp":"2024-09-17T05:50:16.649689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.2b","version":"0'0","reported_seq":10,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-17T05:50:17.685753+0000","last_change":"2024-09-17T05:50:17.679256+0000","last_active":"2024-09-17T05:50:17.685753+0000","last_peered":"2024-09-17T05:50:17.685753+0000","last_clean":"2024-09-17T05:50:17.685753+0000","last_became_active":"2024-09-17T05:50:17.678923+0000","last_became_peered":"2024-09-17T05:50:17.678923+0000","last_unstale":"2024-09-17T05:50:17.685753+0000","last_undegraded":"2024-09-17T05:50:17.685753+0000","last_fullsized":"2024-09-17T05:50:17.685753+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:50:16.649689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:50:16.649689+0000","last_clean_scrub_stamp":"2024-09-17T05:50:16.649689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:28:08.714137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.2a","version":"0'0","reported_seq":13,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-17T05:50:18.686175+0000","last_change":"2024-09-17T05:50:17.687586+0000","last_active":"2024-09-17T05:50:18.686175+0000","last_peered":"2024-09-17T05:50:18.686175+0000","last_clean":"2024-09-17T05:50:18.686175+0000","last_became_active":"2024-09-17T05:50:17.687286+0000","last_became_peered":"2024-09-17T05:50:17.687286+0000","last_unstale":"2024-09-17T05:50:18.686175+0000","last_undegraded":"2024-09-17T05:50:18.686175+0000","last_fullsized":"2024-09-17T05:50:18.686175+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:50:16.649689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:50:16.649689+0000","last_clean_scrub_stamp":"2024-09-17T05:50:16.649689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:02:00.945244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.29","version":"0'0","reported_seq":13,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-17T05:50:18.686290+0000","last_change":"2024-09-17T05:50:17.688190+0000","last_active":"2024-09-17T05:50:18.686290+0000","last_peered":"2024-09-17T05:50:18.686290+0000","last_clean":"2024-09-17T05:50:18.686290+0000","last_became_active":"2024-09-17T05:50:17.687362+0000","last_became_peered":"2024-09-17T05:50:17.687362+0000","last_unstale":"2024-09-17T05:50:18.686290+0000","last_undegraded":"2024-09-17T05:50:18.686290+0000","last_fullsized":"2024-09-17T05:50:18.686290+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:50:16.649689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:50:16.649689+0000","last_clean_scrub_stamp":"2024-09-17T05:50:16.649689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:41:16.543702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.28","version":"0'0","reported_seq":1,"reported_epoch":99,"state":"creating+peering","last_fresh":"2024-09-17T05:50:16.666955+0000","last_change":"2024-09-17T05:50:16.666955+0000","last_active":"2024-09-17T05:50:16.649689+0000","last_peered":"2024-09-17T05:50:16.649689+0000","last_clean":"2024-09-17T05:50:16.649689+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:50:16.666955+0000","last_undegraded":"2024-09-17T05:50:16.666955+0000","last_fullsized":"2024-09-17T05:50:16.666955+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:50:16.649689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:50:16.649689+0000","last_clean_scrub_stamp":"2024-09-17T05:50:16.649689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.27","version":"0'0","reported_seq":10,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-17T05:50:17.702466+0000","last_change":"2024-09-17T05:50:17.701876+0000","last_active":"2024-09-17T05:50:17.702466+0000","last_peered":"2024-09-17T05:50:17.702466+0000","last_clean":"2024-09-17T05:50:17.702466+0000","last_became_active":"2024-09-17T05:50:17.701586+0000","last_became_peered":"2024-09-17T05:50:17.701586+0000","last_unstale":"2024-09-17T05:50:17.702466+0000","last_undegraded":"2024-09-17T05:50:17.702466+0000","last_fullsized":"2024-09-17T05:50:17.702466+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:50:16.649689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:50:16.649689+0000","last_clean_scrub_stamp":"2024-09-17T05:50:16.649689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:16:56.091340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.26","version":"0'0","reported_seq":13,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-17T05:50:18.686526+0000","last_change":"2024-09-17T05:50:17.689166+0000","last_active":"2024-09-17T05:50:18.686526+0000","last_peered":"2024-09-17T05:50:18.686526+0000","last_clean":"2024-09-17T05:50:18.686526+0000","last_became_active":"2024-09-17T05:50:17.688880+0000","last_became_peered":"2024-09-17T05:50:17.688880+0000","last_unstale":"2024-09-17T05:50:18.686526+0000","last_undegraded":"2024-09-17T05:50:18.686526+0000","last_fullsized":"2024-09-17T05:50:18.686526+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:50:16.649689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:50:16.649689+0000","last_clean_scrub_stamp":"2024-09-17T05:50:16.649689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:23:08.770975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.25","version":"0'0","reported_seq":1,"reported_epoch":99,"state":"creating+peering","last_fresh":"2024-09-17T05:50:16.668754+0000","last_change":"2024-09-17T05:50:16.668754+0000","last_active":"2024-09-17T05:50:16.649689+0000","last_peered":"2024-09-17T05:50:16.649689+0000","last_clean":"2024-09-17T05:50:16.649689+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:50:16.668754+0000","last_undegraded":"2024-09-17T05:50:16.668754+0000","last_fullsized":"2024-09-17T05:50:16.668754+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:50:16.649689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:50:16.649689+0000","last_clean_scrub_stamp":"2024-09-17T05:50:16.649689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.24","version":"0'0","reported_seq":10,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-17T05:50:17.692366+0000","last_change":"2024-09-17T05:50:17.686896+0000","last_active":"2024-09-17T05:50:17.692366+0000","last_peered":"2024-09-17T05:50:17.692366+0000","last_clean":"2024-09-17T05:50:17.692366+0000","last_became_active":"2024-09-17T05:50:17.686613+0000","last_became_peered":"2024-09-17T05:50:17.686613+0000","last_unstale":"2024-09-17T05:50:17.692366+0000","last_undegraded":"2024-09-17T05:50:17.692366+0000","last_fullsized":"2024-09-17T05:50:17.692366+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:50:16.649689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:50:16.649689+0000","last_clean_scrub_stamp":"2024-09-17T05:50:16.649689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:53:41.317085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.23","version":"0'0","reported_seq":13,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-17T05:50:18.686333+0000","last_change":"2024-09-17T05:50:17.693673+0000","last_active":"2024-09-17T05:50:18.686333+0000","last_peered":"2024-09-17T05:50:18.686333+0000","last_clean":"2024-09-17T05:50:18.686333+0000","last_became_active":"2024-09-17T05:50:17.693131+0000","last_became_peered":"2024-09-17T05:50:17.693131+0000","last_unstale":"2024-09-17T05:50:18.686333+0000","last_undegraded":"2024-09-17T05:50:18.686333+0000","last_fullsized":"2024-09-17T05:50:18.686333+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:50:16.649689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:50:16.649689+0000","last_clean_scrub_stamp":"2024-09-17T05:50:16.649689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:31:33.444956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.22","version":"0'0","reported_seq":10,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-17T05:50:17.698202+0000","last_change":"2024-09-17T05:50:17.691649+0000","last_active":"2024-09-17T05:50:17.698202+0000","last_peered":"2024-09-17T05:50:17.698202+0000","last_clean":"2024-09-17T05:50:17.698202+0000","last_became_active":"2024-09-17T05:50:17.691303+0000","last_became_peered":"2024-09-17T05:50:17.691303+0000","last_unstale":"2024-09-17T05:50:17.698202+0000","last_undegraded":"2024-09-17T05:50:17.698202+0000","last_fullsized":"2024-09-17T05:50:17.698202+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:50:16.649689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:50:16.649689+0000","last_clean_scrub_stamp":"2024-09-17T05:50:16.649689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:30:18.752029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.21","version":"0'0","reported_seq":10,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-17T05:50:17.695664+0000","last_change":"2024-09-17T05:50:17.686575+0000","last_active":"2024-09-17T05:50:17.695664+0000","last_peered":"2024-09-17T05:50:17.695664+0000","last_clean":"2024-09-17T05:50:17.695664+0000","last_became_active":"2024-09-17T05:50:17.684031+0000","last_became_peered":"2024-09-17T05:50:17.684031+0000","last_unstale":"2024-09-17T05:50:17.695664+0000","last_undegraded":"2024-09-17T05:50:17.695664+0000","last_fullsized":"2024-09-17T05:50:17.695664+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:50:16.649689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:50:16.649689+0000","last_clean_scrub_stamp":"2024-09-17T05:50:16.649689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:10:39.923888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.20","version":"0'0","reported_seq":10,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-17T05:50:17.698484+0000","last_change":"2024-09-17T05:50:17.690605+0000","last_active":"2024-09-17T05:50:17.698484+0000","last_peered":"2024-09-17T05:50:17.698484+0000","last_clean":"2024-09-17T05:50:17.698484+0000","last_became_active":"2024-09-17T05:50:17.690127+0000","last_became_peered":"2024-09-17T05:50:17.690127+0000","last_unstale":"2024-09-17T05:50:17.698484+0000","last_undegraded":"2024-09-17T05:50:17.698484+0000","last_fullsized":"2024-09-17T05:50:17.698484+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:50:16.649689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:50:16.649689+0000","last_clean_scrub_stamp":"2024-09-17T05:50:16.649689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:27:10.964544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.1e","version":"0'0","reported_seq":10,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-17T05:50:17.683922+0000","last_change":"2024-09-17T05:50:17.678131+0000","last_active":"2024-09-17T05:50:17.683922+0000","last_peered":"2024-09-17T05:50:17.683922+0000","last_clean":"2024-09-17T05:50:17.683922+0000","last_became_active":"2024-09-17T05:50:17.677816+0000","last_became_peered":"2024-09-17T05:50:17.677816+0000","last_unstale":"2024-09-17T05:50:17.683922+0000","last_undegraded":"2024-09-17T05:50:17.683922+0000","last_fullsized":"2024-09-17T05:50:17.683922+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:50:16.649689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:50:16.649689+0000","last_clean_scrub_stamp":"2024-09-17T05:50:16.649689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:55:41.145153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.1f","version":"100'4","reported_seq":19,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-17T05:50:18.686498+0000","last_change":"2024-09-17T05:50:16.666928+0000","last_active":"2024-09-17T05:50:18.686498+0000","last_peered":"2024-09-17T05:50:18.686498+0000","last_clean":"2024-09-17T05:50:18.686498+0000","last_became_active":"2024-09-17T05:50:16.666550+0000","last_became_peered":"2024-09-17T05:50:16.666550+0000","last_unstale":"2024-09-17T05:50:18.686498+0000","last_undegraded":"2024-09-17T05:50:18.686498+0000","last_fullsized":"2024-09-17T05:50:18.686498+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:50:15.639879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:50:15.639879+0000","last_clean_scrub_stamp":"2024-09-17T05:50:15.639879+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:57:05.869839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1f","version":"0'0","reported_seq":10,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-17T05:50:17.689373+0000","last_change":"2024-09-17T05:50:17.684448+0000","last_active":"2024-09-17T05:50:17.689373+0000","last_peered":"2024-09-17T05:50:17.689373+0000","last_clean":"2024-09-17T05:50:17.689373+0000","last_became_active":"2024-09-17T05:50:17.684014+0000","last_became_peered":"2024-09-17T05:50:17.684014+0000","last_unstale":"2024-09-17T05:50:17.689373+0000","last_undegraded":"2024-09-17T05:50:17.689373+0000","last_fullsized":"2024-09-17T05:50:17.689373+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:50:16.649689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:50:16.649689+0000","last_clean_scrub_stamp":"2024-09-17T05:50:16.649689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:55:05.250112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.1e","version":"0'0","reported_seq":10,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-17T05:50:16.676988+0000","last_change":"2024-09-17T05:50:16.676369+0000","last_active":"2024-09-17T05:50:16.676988+0000","last_peered":"2024-09-17T05:50:16.676988+0000","last_clean":"2024-09-17T05:50:16.676988+0000","last_became_active":"2024-09-17T05:50:16.676073+0000","last_became_peered":"2024-09-17T05:50:16.676073+0000","last_unstale":"2024-09-17T05:50:16.676988+0000","last_undegraded":"2024-09-17T05:50:16.676988+0000","last_fullsized":"2024-09-17T05:50:16.676988+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:50:15.639879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:50:15.639879+0000","last_clean_scrub_stamp":"2024-09-17T05:50:15.639879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:59:49.339081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.1c","version":"0'0","reported_seq":10,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-17T05:50:17.689800+0000","last_change":"2024-09-17T05:50:17.686482+0000","last_active":"2024-09-17T05:50:17.689800+0000","last_peered":"2024-09-17T05:50:17.689800+0000","last_clean":"2024-09-17T05:50:17.689800+0000","last_became_active":"2024-09-17T05:50:17.685224+0000","last_became_peered":"2024-09-17T05:50:17.685224+0000","last_unstale":"2024-09-17T05:50:17.689800+0000","last_undegraded":"2024-09-17T05:50:17.689800+0000","last_fullsized":"2024-09-17T05:50:17.689800+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:50:16.649689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:50:16.649689+0000","last_clean_scrub_stamp":"2024-09-17T05:50:16.649689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:43:04.212537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.1d","version":"100'2","reported_seq":17,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-17T05:50:18.686557+0000","last_change":"2024-09-17T05:50:16.678328+0000","last_active":"2024-09-17T05:50:18.686557+0000","last_peered":"2024-09-17T05:50:18.686557+0000","last_clean":"2024-09-17T05:50:18.686557+0000","last_became_active":"2024-09-17T05:50:16.677911+0000","last_became_peered":"2024-09-17T05:50:16.677911+0000","last_unstale":"2024-09-17T05:50:18.686557+0000","last_undegraded":"2024-09-17T05:50:18.686557+0000","last_fullsized":"2024-09-17T05:50:18.686557+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:50:15.639879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:50:15.639879+0000","last_clean_scrub_stamp":"2024-09-17T05:50:15.639879+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:12:56.944695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1d","version":"0'0","reported_seq":1,"reported_epoch":99,"state":"creating+peering","last_fresh":"2024-09-17T05:50:16.655870+0000","last_change":"2024-09-17T05:50:16.655870+0000","last_active":"2024-09-17T05:50:16.649689+0000","last_peered":"2024-09-17T05:50:16.649689+0000","last_clean":"2024-09-17T05:50:16.649689+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:50:16.655870+0000","last_undegraded":"2024-09-17T05:50:16.655870+0000","last_fullsized":"2024-09-17T05:50:16.655870+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:50:16.649689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:50:16.649689+0000","last_clean_scrub_stamp":"2024-09-17T05:50:16.649689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.1c","version":"100'2","reported_seq":17,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-17T05:50:18.686501+0000","last_change":"2024-09-17T05:50:16.677342+0000","last_active":"2024-09-17T05:50:18.686501+0000","last_peered":"2024-09-17T05:50:18.686501+0000","last_clean":"2024-09-17T05:50:18.686501+0000","last_became_active":"2024-09-17T05:50:16.674956+0000","last_became_peered":"2024-09-17T05:50:16.674956+0000","last_unstale":"2024-09-17T05:50:18.686501+0000","last_undegraded":"2024-09-17T05:50:18.686501+0000","last_fullsized":"2024-09-17T05:50:18.686501+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:50:15.639879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:50:15.639879+0000","last_clean_scrub_stamp":"2024-09-17T05:50:15.639879+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:36:51.832130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1a","version":"0'0","reported_seq":1,"reported_epoch":99,"state":"creating+peering","last_fresh":"2024-09-17T05:50:16.655670+0000","last_change":"2024-09-17T05:50:16.655670+0000","last_active":"2024-09-17T05:50:16.649689+0000","last_peered":"2024-09-17T05:50:16.649689+0000","last_clean":"2024-09-17T05:50:16.649689+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:50:16.655670+0000","last_undegraded":"2024-09-17T05:50:16.655670+0000","last_fullsized":"2024-09-17T05:50:16.655670+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:50:16.649689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:50:16.649689+0000","last_clean_scrub_stamp":"2024-09-17T05:50:16.649689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.1b","version":"100'1","reported_seq":14,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-17T05:50:17.699861+0000","last_change":"2024-09-17T05:50:16.671491+0000","last_active":"2024-09-17T05:50:17.699861+0000","last_peered":"2024-09-17T05:50:17.699861+0000","last_clean":"2024-09-17T05:50:17.699861+0000","last_became_active":"2024-09-17T05:50:16.671150+0000","last_became_peered":"2024-09-17T05:50:16.671150+0000","last_unstale":"2024-09-17T05:50:17.699861+0000","last_undegraded":"2024-09-17T05:50:17.699861+0000","last_fullsized":"2024-09-17T05:50:17.699861+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:50:15.639879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:50:15.639879+0000","last_clean_scrub_stamp":"2024-09-17T05:50:15.639879+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:56:38.653716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.1b","version":"0'0","reported_seq":1,"reported_epoch":99,"state":"creating+peering","last_fresh":"2024-09-17T05:50:16.664625+0000","last_change":"2024-09-17T05:50:16.664625+0000","last_active":"2024-09-17T05:50:16.649689+0000","last_peered":"2024-09-17T05:50:16.649689+0000","last_clean":"2024-09-17T05:50:16.649689+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:50:16.664625+0000","last_undegraded":"2024-09-17T05:50:16.664625+0000","last_fullsized":"2024-09-17T05:50:16.664625+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:50:16.649689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:50:16.649689+0000","last_clean_scrub_stamp":"2024-09-17T05:50:16.649689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.1a","version":"100'1","reported_seq":16,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-17T05:50:18.686071+0000","last_change":"2024-09-17T05:50:16.673854+0000","last_active":"2024-09-17T05:50:18.686071+0000","last_peered":"2024-09-17T05:50:18.686071+0000","last_clean":"2024-09-17T05:50:18.686071+0000","last_became_active":"2024-09-17T05:50:16.673522+0000","last_became_peered":"2024-09-17T05:50:16.673522+0000","last_unstale":"2024-09-17T05:50:18.686071+0000","last_undegraded":"2024-09-17T05:50:18.686071+0000","last_fullsized":"2024-09-17T05:50:18.686071+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:50:15.639879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:50:15.639879+0000","last_clean_scrub_stamp":"2024-09-17T05:50:15.639879+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:05:57.341308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.18","version":"0'0","reported_seq":10,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-17T05:50:17.690825+0000","last_change":"2024-09-17T05:50:17.684654+0000","last_active":"2024-09-17T05:50:17.690825+0000","last_peered":"2024-09-17T05:50:17.690825+0000","last_clean":"2024-09-17T05:50:17.690825+0000","last_became_active":"2024-09-17T05:50:17.684313+0000","last_became_peered":"2024-09-17T05:50:17.684313+0000","last_unstale":"2024-09-17T05:50:17.690825+0000","last_undegraded":"2024-09-17T05:50:17.690825+0000","last_fullsized":"2024-09-17T05:50:17.690825+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:50:16.649689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:50:16.649689+0000","last_clean_scrub_stamp":"2024-09-17T05:50:16.649689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:45:12.092469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.19","version":"0'0","reported_seq":13,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-17T05:50:17.680947+0000","last_change":"2024-09-17T05:50:16.674238+0000","last_active":"2024-09-17T05:50:17.680947+0000","last_peered":"2024-09-17T05:50:17.680947+0000","last_clean":"2024-09-17T05:50:17.680947+0000","last_became_active":"2024-09-17T05:50:16.673875+0000","last_became_peered":"2024-09-17T05:50:16.673875+0000","last_unstale":"2024-09-17T05:50:17.680947+0000","last_undegraded":"2024-09-17T05:50:17.680947+0000","last_fullsized":"2024-09-17T05:50:17.680947+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:50:15.639879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:50:15.639879+0000","last_clean_scrub_stamp":"2024-09-17T05:50:15.639879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:01:35.637247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.19","version":"0'0","reported_seq":1,"reported_epoch":99,"state":"creating+peering","last_fresh":"2024-09-17T05:50:16.655280+0000","last_change":"2024-09-17T05:50:16.655280+0000","last_active":"2024-09-17T05:50:16.649689+0000","last_peered":"2024-09-17T05:50:16.649689+0000","last_clean":"2024-09-17T05:50:16.649689+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:50:16.655280+0000","last_undegraded":"2024-09-17T05:50:16.655280+0000","last_fullsized":"2024-09-17T05:50:16.655280+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:50:16.649689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:50:16.649689+0000","last_clean_scrub_stamp":"2024-09-17T05:50:16.649689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.18","version":"0'0","reported_seq":13,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-17T05:50:17.675065+0000","last_change":"2024-09-17T05:50:16.672581+0000","last_active":"2024-09-17T05:50:17.675065+0000","last_peered":"2024-09-17T05:50:17.675065+0000","last_clean":"2024-09-17T05:50:17.675065+0000","last_became_active":"2024-09-17T05:50:16.671816+0000","last_became_peered":"2024-09-17T05:50:16.671816+0000","last_unstale":"2024-09-17T05:50:17.675065+0000","last_undegraded":"2024-09-17T05:50:17.675065+0000","last_fullsized":"2024-09-17T05:50:17.675065+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:50:15.639879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:50:15.639879+0000","last_clean_scrub_stamp":"2024-09-17T05:50:15.639879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:38:42.681739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.16","version":"0'0","reported_seq":13,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-17T05:50:18.686665+0000","last_change":"2024-09-17T05:50:17.686260+0000","last_active":"2024-09-17T05:50:18.686665+0000","last_peered":"2024-09-17T05:50:18.686665+0000","last_clean":"2024-09-17T05:50:18.686665+0000","last_became_active":"2024-09-17T05:50:17.685507+0000","last_became_peered":"2024-09-17T05:50:17.685507+0000","last_unstale":"2024-09-17T05:50:18.686665+0000","last_undegraded":"2024-09-17T05:50:18.686665+0000","last_fullsized":"2024-09-17T05:50:18.686665+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:50:16.649689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:50:16.649689+0000","last_clean_scrub_stamp":"2024-09-17T05:50:16.649689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:46:25.261334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.17","version":"0'0","reported_seq":13,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-17T05:50:17.676384+0000","last_change":"2024-09-17T05:50:16.666782+0000","last_active":"2024-09-17T05:50:17.676384+0000","last_peered":"2024-09-17T05:50:17.676384+0000","last_clean":"2024-09-17T05:50:17.676384+0000","last_became_active":"2024-09-17T05:50:16.666353+0000","last_became_peered":"2024-09-17T05:50:16.666353+0000","last_unstale":"2024-09-17T05:50:17.676384+0000","last_undegraded":"2024-09-17T05:50:17.676384+0000","last_fullsized":"2024-09-17T05:50:17.676384+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:50:15.639879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:50:15.639879+0000","last_clean_scrub_stamp":"2024-09-17T05:50:15.639879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:08:52.158143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.17","version":"0'0","reported_seq":1,"reported_epoch":99,"state":"creating+peering","last_fresh":"2024-09-17T05:50:16.656309+0000","last_change":"2024-09-17T05:50:16.656309+0000","last_active":"2024-09-17T05:50:16.649689+0000","last_peered":"2024-09-17T05:50:16.649689+0000","last_clean":"2024-09-17T05:50:16.649689+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:50:16.656309+0000","last_undegraded":"2024-09-17T05:50:16.656309+0000","last_fullsized":"2024-09-17T05:50:16.656309+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:50:16.649689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:50:16.649689+0000","last_clean_scrub_stamp":"2024-09-17T05:50:16.649689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.16","version":"0'0","reported_seq":13,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-17T05:50:17.666312+0000","last_change":"2024-09-17T05:50:16.666739+0000","last_active":"2024-09-17T05:50:17.666312+0000","last_peered":"2024-09-17T05:50:17.666312+0000","last_clean":"2024-09-17T05:50:17.666312+0000","last_became_active":"2024-09-17T05:50:16.666351+0000","last_became_peered":"2024-09-17T05:50:16.666351+0000","last_unstale":"2024-09-17T05:50:17.666312+0000","last_undegraded":"2024-09-17T05:50:17.666312+0000","last_fullsized":"2024-09-17T05:50:17.666312+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:50:15.639879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:50:15.639879+0000","last_clean_scrub_stamp":"2024-09-17T05:50:15.639879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:02:39.092792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.14","version":"0'0","reported_seq":10,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-17T05:50:17.701434+0000","last_change":"2024-09-17T05:50:17.700910+0000","last_active":"2024-09-17T05:50:17.701434+0000","last_peered":"2024-09-17T05:50:17.701434+0000","last_clean":"2024-09-17T05:50:17.701434+0000","last_became_active":"2024-09-17T05:50:17.700244+0000","last_became_peered":"2024-09-17T05:50:17.700244+0000","last_unstale":"2024-09-17T05:50:17.701434+0000","last_undegraded":"2024-09-17T05:50:17.701434+0000","last_fullsized":"2024-09-17T05:50:17.701434+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:50:16.649689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:50:16.649689+0000","last_clean_scrub_stamp":"2024-09-17T05:50:16.649689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:52:27.459055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.15","version":"0'0","reported_seq":10,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-17T05:50:16.674056+0000","last_change":"2024-09-17T05:50:16.673400+0000","last_active":"2024-09-17T05:50:16.674056+0000","last_peered":"2024-09-17T05:50:16.674056+0000","last_clean":"2024-09-17T05:50:16.674056+0000","last_became_active":"2024-09-17T05:50:16.673068+0000","last_became_peered":"2024-09-17T05:50:16.673068+0000","last_unstale":"2024-09-17T05:50:16.674056+0000","last_undegraded":"2024-09-17T05:50:16.674056+0000","last_fullsized":"2024-09-17T05:50:16.674056+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:50:15.639879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:50:15.639879+0000","last_clean_scrub_stamp":"2024-09-17T05:50:15.639879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:25:35.372566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.15","version":"0'0","reported_seq":1,"reported_epoch":99,"state":"creating+peering","last_fresh":"2024-09-17T05:50:16.666417+0000","last_change":"2024-09-17T05:50:16.666417+0000","last_active":"2024-09-17T05:50:16.649689+0000","last_peered":"2024-09-17T05:50:16.649689+0000","last_clean":"2024-09-17T05:50:16.649689+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:50:16.666417+0000","last_undegraded":"2024-09-17T05:50:16.666417+0000","last_fullsized":"2024-09-17T05:50:16.666417+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:50:16.649689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:50:16.649689+0000","last_clean_scrub_stamp":"2024-09-17T05:50:16.649689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.14","version":"0'0","reported_seq":10,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-17T05:50:16.666657+0000","last_change":"2024-09-17T05:50:16.663464+0000","last_active":"2024-09-17T05:50:16.666657+0000","last_peered":"2024-09-17T05:50:16.666657+0000","last_clean":"2024-09-17T05:50:16.666657+0000","last_became_active":"2024-09-17T05:50:16.663147+0000","last_became_peered":"2024-09-17T05:50:16.663147+0000","last_unstale":"2024-09-17T05:50:16.666657+0000","last_undegraded":"2024-09-17T05:50:16.666657+0000","last_fullsized":"2024-09-17T05:50:16.666657+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:50:15.639879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:50:15.639879+0000","last_clean_scrub_stamp":"2024-09-17T05:50:15.639879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:34:08.028316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.12","version":"0'0","reported_seq":10,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-17T05:50:17.680089+0000","last_change":"2024-09-17T05:50:17.678910+0000","last_active":"2024-09-17T05:50:17.680089+0000","last_peered":"2024-09-17T05:50:17.680089+0000","last_clean":"2024-09-17T05:50:17.680089+0000","last_became_active":"2024-09-17T05:50:17.678520+0000","last_became_peered":"2024-09-17T05:50:17.678520+0000","last_unstale":"2024-09-17T05:50:17.680089+0000","last_undegraded":"2024-09-17T05:50:17.680089+0000","last_fullsized":"2024-09-17T05:50:17.680089+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:50:16.649689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:50:16.649689+0000","last_clean_scrub_stamp":"2024-09-17T05:50:16.649689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:54:33.658300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.13","version":"100'2","reported_seq":15,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-17T05:50:17.699288+0000","last_change":"2024-09-17T05:50:16.677999+0000","last_active":"2024-09-17T05:50:17.699288+0000","last_peered":"2024-09-17T05:50:17.699288+0000","last_clean":"2024-09-17T05:50:17.699288+0000","last_became_active":"2024-09-17T05:50:16.677675+0000","last_became_peered":"2024-09-17T05:50:16.677675+0000","last_unstale":"2024-09-17T05:50:17.699288+0000","last_undegraded":"2024-09-17T05:50:17.699288+0000","last_fullsized":"2024-09-17T05:50:17.699288+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:50:15.639879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:50:15.639879+0000","last_clean_scrub_stamp":"2024-09-17T05:50:15.639879+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:52:12.200476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.13","version":"0'0","reported_seq":10,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-17T05:50:17.695914+0000","last_change":"2024-09-17T05:50:17.683595+0000","last_active":"2024-09-17T05:50:17.695914+0000","last_peered":"2024-09-17T05:50:17.695914+0000","last_clean":"2024-09-17T05:50:17.695914+0000","last_became_active":"2024-09-17T05:50:17.683280+0000","last_became_peered":"2024-09-17T05:50:17.683280+0000","last_unstale":"2024-09-17T05:50:17.695914+0000","last_undegraded":"2024-09-17T05:50:17.695914+0000","last_fullsized":"2024-09-17T05:50:17.695914+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:50:16.649689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:50:16.649689+0000","last_clean_scrub_stamp":"2024-09-17T05:50:16.649689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:52:17.955004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.12","version":"0'0","reported_seq":13,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-17T05:50:17.672150+0000","last_change":"2024-09-17T05:50:16.672657+0000","last_active":"2024-09-17T05:50:17.672150+0000","last_peered":"2024-09-17T05:50:17.672150+0000","last_clean":"2024-09-17T05:50:17.672150+0000","last_became_active":"2024-09-17T05:50:16.672353+0000","last_became_peered":"2024-09-17T05:50:16.672353+0000","last_unstale":"2024-09-17T05:50:17.672150+0000","last_undegraded":"2024-09-17T05:50:17.672150+0000","last_fullsized":"2024-09-17T05:50:17.672150+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:50:15.639879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:50:15.639879+0000","last_clean_scrub_stamp":"2024-09-17T05:50:15.639879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:31:01.840132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.10","version":"0'0","reported_seq":1,"reported_epoch":99,"state":"creating+peering","last_fresh":"2024-09-17T05:50:16.655229+0000","last_change":"2024-09-17T05:50:16.655229+0000","last_active":"2024-09-17T05:50:16.649689+0000","last_peered":"2024-09-17T05:50:16.649689+0000","last_clean":"2024-09-17T05:50:16.649689+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:50:16.655229+0000","last_undegraded":"2024-09-17T05:50:16.655229+0000","last_fullsized":"2024-09-17T05:50:16.655229+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:50:16.649689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:50:16.649689+0000","last_clean_scrub_stamp":"2024-09-17T05:50:16.649689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.11","version":"0'0","reported_seq":10,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-17T05:50:16.666735+0000","last_change":"2024-09-17T05:50:16.663949+0000","last_active":"2024-09-17T05:50:16.666735+0000","last_peered":"2024-09-17T05:50:16.666735+0000","last_clean":"2024-09-17T05:50:16.666735+0000","last_became_active":"2024-09-17T05:50:16.663594+0000","last_became_peered":"2024-09-17T05:50:16.663594+0000","last_unstale":"2024-09-17T05:50:16.666735+0000","last_undegraded":"2024-09-17T05:50:16.666735+0000","last_fullsized":"2024-09-17T05:50:16.666735+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:50:15.639879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:50:15.639879+0000","last_clean_scrub_stamp":"2024-09-17T05:50:15.639879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:32:04.915100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.11","version":"0'0","reported_seq":10,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-17T05:50:17.676653+0000","last_change":"2024-09-17T05:50:17.673526+0000","last_active":"2024-09-17T05:50:17.676653+0000","last_peered":"2024-09-17T05:50:17.676653+0000","last_clean":"2024-09-17T05:50:17.676653+0000","last_became_active":"2024-09-17T05:50:17.673209+0000","last_became_peered":"2024-09-17T05:50:17.673209+0000","last_unstale":"2024-09-17T05:50:17.676653+0000","last_undegraded":"2024-09-17T05:50:17.676653+0000","last_fullsized":"2024-09-17T05:50:17.676653+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:50:16.649689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:50:16.649689+0000","last_clean_scrub_stamp":"2024-09-17T05:50:16.649689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:45:11.588427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.10","version":"100'8","reported_seq":21,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-17T05:50:17.701091+0000","last_change":"2024-09-17T05:50:16.671667+0000","last_active":"2024-09-17T05:50:17.701091+0000","last_peered":"2024-09-17T05:50:17.701091+0000","last_clean":"2024-09-17T05:50:17.701091+0000","last_became_active":"2024-09-17T05:50:16.671069+0000","last_became_peered":"2024-09-17T05:50:16.671069+0000","last_unstale":"2024-09-17T05:50:17.701091+0000","last_undegraded":"2024-09-17T05:50:17.701091+0000","last_fullsized":"2024-09-17T05:50:17.701091+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:50:15.639879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:50:15.639879+0000","last_clean_scrub_stamp":"2024-09-17T05:50:15.639879+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:54:11.413425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.f","version":"0'0","reported_seq":10,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-17T05:50:17.694467+0000","last_change":"2024-09-17T05:50:17.693101+0000","last_active":"2024-09-17T05:50:17.694467+0000","last_peered":"2024-09-17T05:50:17.694467+0000","last_clean":"2024-09-17T05:50:17.694467+0000","last_became_active":"2024-09-17T05:50:17.692530+0000","last_became_peered":"2024-09-17T05:50:17.692530+0000","last_unstale":"2024-09-17T05:50:17.694467+0000","last_undegraded":"2024-09-17T05:50:17.694467+0000","last_fullsized":"2024-09-17T05:50:17.694467+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:50:16.649689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:50:16.649689+0000","last_clean_scrub_stamp":"2024-09-17T05:50:16.649689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:00:10.128109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.e","version":"0'0","reported_seq":10,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-17T05:50:16.677298+0000","last_change":"2024-09-17T05:50:16.676692+0000","last_active":"2024-09-17T05:50:16.677298+0000","last_peered":"2024-09-17T05:50:16.677298+0000","last_clean":"2024-09-17T05:50:16.677298+0000","last_became_active":"2024-09-17T05:50:16.676330+0000","last_became_peered":"2024-09-17T05:50:16.676330+0000","last_unstale":"2024-09-17T05:50:16.677298+0000","last_undegraded":"2024-09-17T05:50:16.677298+0000","last_fullsized":"2024-09-17T05:50:16.677298+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:50:15.639879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:50:15.639879+0000","last_clean_scrub_stamp":"2024-09-17T05:50:15.639879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:01:43.584924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.c","version":"0'0","reported_seq":1,"reported_epoch":99,"state":"creating+peering","last_fresh":"2024-09-17T05:50:16.655146+0000","last_change":"2024-09-17T05:50:16.655146+0000","last_active":"2024-09-17T05:50:16.649689+0000","last_peered":"2024-09-17T05:50:16.649689+0000","last_clean":"2024-09-17T05:50:16.649689+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:50:16.655146+0000","last_undegraded":"2024-09-17T05:50:16.655146+0000","last_fullsized":"2024-09-17T05:50:16.655146+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:50:16.649689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:50:16.649689+0000","last_clean_scrub_stamp":"2024-09-17T05:50:16.649689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.d","version":"100'1","reported_seq":14,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-17T05:50:17.702271+0000","last_change":"2024-09-17T05:50:16.663432+0000","last_active":"2024-09-17T05:50:17.702271+0000","last_peered":"2024-09-17T05:50:17.702271+0000","last_clean":"2024-09-17T05:50:17.702271+0000","last_became_active":"2024-09-17T05:50:16.663096+0000","last_became_peered":"2024-09-17T05:50:16.663096+0000","last_unstale":"2024-09-17T05:50:17.702271+0000","last_undegraded":"2024-09-17T05:50:17.702271+0000","last_fullsized":"2024-09-17T05:50:17.702271+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:50:15.639879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:50:15.639879+0000","last_clean_scrub_stamp":"2024-09-17T05:50:15.639879+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:31:07.149126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.d","version":"0'0","reported_seq":1,"reported_epoch":99,"state":"creating+peering","last_fresh":"2024-09-17T05:50:16.664714+0000","last_change":"2024-09-17T05:50:16.664714+0000","last_active":"2024-09-17T05:50:16.649689+0000","last_peered":"2024-09-17T05:50:16.649689+0000","last_clean":"2024-09-17T05:50:16.649689+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:50:16.664714+0000","last_undegraded":"2024-09-17T05:50:16.664714+0000","last_fullsized":"2024-09-17T05:50:16.664714+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:50:16.649689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:50:16.649689+0000","last_clean_scrub_stamp":"2024-09-17T05:50:16.649689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.c","version":"0'0","reported_seq":15,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-17T05:50:18.686186+0000","last_change":"2024-09-17T05:50:16.676827+0000","last_active":"2024-09-17T05:50:18.686186+0000","last_peered":"2024-09-17T05:50:18.686186+0000","last_clean":"2024-09-17T05:50:18.686186+0000","last_became_active":"2024-09-17T05:50:16.674588+0000","last_became_peered":"2024-09-17T05:50:16.674588+0000","last_unstale":"2024-09-17T05:50:18.686186+0000","last_undegraded":"2024-09-17T05:50:18.686186+0000","last_fullsized":"2024-09-17T05:50:18.686186+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:50:15.639879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:50:15.639879+0000","last_clean_scrub_stamp":"2024-09-17T05:50:15.639879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:41:10.083935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.a","version":"0'0","reported_seq":10,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-17T05:50:17.691508+0000","last_change":"2024-09-17T05:50:17.682895+0000","last_active":"2024-09-17T05:50:17.691508+0000","last_peered":"2024-09-17T05:50:17.691508+0000","last_clean":"2024-09-17T05:50:17.691508+0000","last_became_active":"2024-09-17T05:50:17.682597+0000","last_became_peered":"2024-09-17T05:50:17.682597+0000","last_unstale":"2024-09-17T05:50:17.691508+0000","last_undegraded":"2024-09-17T05:50:17.691508+0000","last_fullsized":"2024-09-17T05:50:17.691508+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:50:16.649689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:50:16.649689+0000","last_clean_scrub_stamp":"2024-09-17T05:50:16.649689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:08:03.346563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.b","version":"100'2","reported_seq":17,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-17T05:50:18.686463+0000","last_change":"2024-09-17T05:50:16.678475+0000","last_active":"2024-09-17T05:50:18.686463+0000","last_peered":"2024-09-17T05:50:18.686463+0000","last_clean":"2024-09-17T05:50:18.686463+0000","last_became_active":"2024-09-17T05:50:16.677955+0000","last_became_peered":"2024-09-17T05:50:16.677955+0000","last_unstale":"2024-09-17T05:50:18.686463+0000","last_undegraded":"2024-09-17T05:50:18.686463+0000","last_fullsized":"2024-09-17T05:50:18.686463+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:50:15.639879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:50:15.639879+0000","last_clean_scrub_stamp":"2024-09-17T05:50:15.639879+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:30:59.350580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.b","version":"0'0","reported_seq":10,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-17T05:50:17.697857+0000","last_change":"2024-09-17T05:50:17.690262+0000","last_active":"2024-09-17T05:50:17.697857+0000","last_peered":"2024-09-17T05:50:17.697857+0000","last_clean":"2024-09-17T05:50:17.697857+0000","last_became_active":"2024-09-17T05:50:17.689973+0000","last_became_peered":"2024-09-17T05:50:17.689973+0000","last_unstale":"2024-09-17T05:50:17.697857+0000","last_undegraded":"2024-09-17T05:50:17.697857+0000","last_fullsized":"2024-09-17T05:50:17.697857+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:50:16.649689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:50:16.649689+0000","last_clean_scrub_stamp":"2024-09-17T05:50:16.649689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:07:11.041448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.a","version":"0'0","reported_seq":10,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-17T05:50:16.672947+0000","last_change":"2024-09-17T05:50:16.672269+0000","last_active":"2024-09-17T05:50:16.672947+0000","last_peered":"2024-09-17T05:50:16.672947+0000","last_clean":"2024-09-17T05:50:16.672947+0000","last_became_active":"2024-09-17T05:50:16.671875+0000","last_became_peered":"2024-09-17T05:50:16.671875+0000","last_unstale":"2024-09-17T05:50:16.672947+0000","last_undegraded":"2024-09-17T05:50:16.672947+0000","last_fullsized":"2024-09-17T05:50:16.672947+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:50:15.639879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:50:15.639879+0000","last_clean_scrub_stamp":"2024-09-17T05:50:15.639879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:45:53.339111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.8","version":"0'0","reported_seq":10,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-17T05:50:17.678457+0000","last_change":"2024-09-17T05:50:17.675705+0000","last_active":"2024-09-17T05:50:17.678457+0000","last_peered":"2024-09-17T05:50:17.678457+0000","last_clean":"2024-09-17T05:50:17.678457+0000","last_became_active":"2024-09-17T05:50:17.674936+0000","last_became_peered":"2024-09-17T05:50:17.674936+0000","last_unstale":"2024-09-17T05:50:17.678457+0000","last_undegraded":"2024-09-17T05:50:17.678457+0000","last_fullsized":"2024-09-17T05:50:17.678457+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:50:16.649689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:50:16.649689+0000","last_clean_scrub_stamp":"2024-09-17T05:50:16.649689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:43:33.495433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.9","version":"0'0","reported_seq":10,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-17T05:50:16.665701+0000","last_change":"2024-09-17T05:50:16.663708+0000","last_active":"2024-09-17T05:50:16.665701+0000","last_peered":"2024-09-17T05:50:16.665701+0000","last_clean":"2024-09-17T05:50:16.665701+0000","last_became_active":"2024-09-17T05:50:16.663348+0000","last_became_peered":"2024-09-17T05:50:16.663348+0000","last_unstale":"2024-09-17T05:50:16.665701+0000","last_undegraded":"2024-09-17T05:50:16.665701+0000","last_fullsized":"2024-09-17T05:50:16.665701+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:50:15.639879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:50:15.639879+0000","last_clean_scrub_stamp":"2024-09-17T05:50:15.639879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:09:03.844072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.9","version":"0'0","reported_seq":10,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-17T05:50:17.692330+0000","last_change":"2024-09-17T05:50:17.687159+0000","last_active":"2024-09-17T05:50:17.692330+0000","last_peered":"2024-09-17T05:50:17.692330+0000","last_clean":"2024-09-17T05:50:17.692330+0000","last_became_active":"2024-09-17T05:50:17.686709+0000","last_became_peered":"2024-09-17T05:50:17.686709+0000","last_unstale":"2024-09-17T05:50:17.692330+0000","last_undegraded":"2024-09-17T05:50:17.692330+0000","last_fullsized":"2024-09-17T05:50:17.692330+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:50:16.649689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:50:16.649689+0000","last_clean_scrub_stamp":"2024-09-17T05:50:16.649689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:23:53.419421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.8","version":"0'0","reported_seq":15,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-17T05:50:18.686083+0000","last_change":"2024-09-17T05:50:16.673662+0000","last_active":"2024-09-17T05:50:18.686083+0000","last_peered":"2024-09-17T05:50:18.686083+0000","last_clean":"2024-09-17T05:50:18.686083+0000","last_became_active":"2024-09-17T05:50:16.673056+0000","last_became_peered":"2024-09-17T05:50:16.673056+0000","last_unstale":"2024-09-17T05:50:18.686083+0000","last_undegraded":"2024-09-17T05:50:18.686083+0000","last_fullsized":"2024-09-17T05:50:18.686083+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:50:15.639879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:50:15.639879+0000","last_clean_scrub_stamp":"2024-09-17T05:50:15.639879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:10:01.927806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.6","version":"0'0","reported_seq":13,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-17T05:50:18.686719+0000","last_change":"2024-09-17T05:50:17.684990+0000","last_active":"2024-09-17T05:50:18.686719+0000","last_peered":"2024-09-17T05:50:18.686719+0000","last_clean":"2024-09-17T05:50:18.686719+0000","last_became_active":"2024-09-17T05:50:17.684521+0000","last_became_peered":"2024-09-17T05:50:17.684521+0000","last_unstale":"2024-09-17T05:50:18.686719+0000","last_undegraded":"2024-09-17T05:50:18.686719+0000","last_fullsized":"2024-09-17T05:50:18.686719+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:50:16.649689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:50:16.649689+0000","last_clean_scrub_stamp":"2024-09-17T05:50:16.649689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:00:23.826449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.7","version":"0'0","reported_seq":10,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-17T05:50:16.665838+0000","last_change":"2024-09-17T05:50:16.663678+0000","last_active":"2024-09-17T05:50:16.665838+0000","last_peered":"2024-09-17T05:50:16.665838+0000","last_clean":"2024-09-17T05:50:16.665838+0000","last_became_active":"2024-09-17T05:50:16.663332+0000","last_became_peered":"2024-09-17T05:50:16.663332+0000","last_unstale":"2024-09-17T05:50:16.665838+0000","last_undegraded":"2024-09-17T05:50:16.665838+0000","last_fullsized":"2024-09-17T05:50:16.665838+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:50:15.639879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:50:15.639879+0000","last_clean_scrub_stamp":"2024-09-17T05:50:15.639879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:57:42.985502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.7","version":"0'0","reported_seq":10,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-17T05:50:17.683380+0000","last_change":"2024-09-17T05:50:17.680146+0000","last_active":"2024-09-17T05:50:17.683380+0000","last_peered":"2024-09-17T05:50:17.683380+0000","last_clean":"2024-09-17T05:50:17.683380+0000","last_became_active":"2024-09-17T05:50:17.679833+0000","last_became_peered":"2024-09-17T05:50:17.679833+0000","last_unstale":"2024-09-17T05:50:17.683380+0000","last_undegraded":"2024-09-17T05:50:17.683380+0000","last_fullsized":"2024-09-17T05:50:17.683380+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:50:16.649689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:50:16.649689+0000","last_clean_scrub_stamp":"2024-09-17T05:50:16.649689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:34:43.730314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.6","version":"101'1","reported_seq":16,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-17T05:50:18.687959+0000","last_change":"2024-09-17T05:50:16.676247+0000","last_active":"2024-09-17T05:50:18.687959+0000","last_peered":"2024-09-17T05:50:18.687959+0000","last_clean":"2024-09-17T05:50:18.687959+0000","last_became_active":"2024-09-17T05:50:16.674892+0000","last_became_peered":"2024-09-17T05:50:16.674892+0000","last_unstale":"2024-09-17T05:50:18.687959+0000","last_undegraded":"2024-09-17T05:50:18.687959+0000","last_fullsized":"2024-09-17T05:50:18.687959+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:50:15.639879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:50:15.639879+0000","last_clean_scrub_stamp":"2024-09-17T05:50:15.639879+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:30:08.711913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.4","version":"0'0","reported_seq":10,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-17T05:50:17.700701+0000","last_change":"2024-09-17T05:50:17.694044+0000","last_active":"2024-09-17T05:50:17.700701+0000","last_peered":"2024-09-17T05:50:17.700701+0000","last_clean":"2024-09-17T05:50:17.700701+0000","last_became_active":"2024-09-17T05:50:17.693724+0000","last_became_peered":"2024-09-17T05:50:17.693724+0000","last_unstale":"2024-09-17T05:50:17.700701+0000","last_undegraded":"2024-09-17T05:50:17.700701+0000","last_fullsized":"2024-09-17T05:50:17.700701+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:50:16.649689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:50:16.649689+0000","last_clean_scrub_stamp":"2024-09-17T05:50:16.649689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:00:14.576200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.5","version":"0'0","reported_seq":15,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-17T05:50:18.686425+0000","last_change":"2024-09-17T05:50:16.679037+0000","last_active":"2024-09-17T05:50:18.686425+0000","last_peered":"2024-09-17T05:50:18.686425+0000","last_clean":"2024-09-17T05:50:18.686425+0000","last_became_active":"2024-09-17T05:50:16.678604+0000","last_became_peered":"2024-09-17T05:50:16.678604+0000","last_unstale":"2024-09-17T05:50:18.686425+0000","last_undegraded":"2024-09-17T05:50:18.686425+0000","last_fullsized":"2024-09-17T05:50:18.686425+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:50:15.639879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:50:15.639879+0000","last_clean_scrub_stamp":"2024-09-17T05:50:15.639879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:31:44.846045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.5","version":"0'0","reported_seq":10,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-17T05:50:17.688492+0000","last_change":"2024-09-17T05:50:17.684200+0000","last_active":"2024-09-17T05:50:17.688492+0000","last_peered":"2024-09-17T05:50:17.688492+0000","last_clean":"2024-09-17T05:50:17.688492+0000","last_became_active":"2024-09-17T05:50:17.683866+0000","last_became_peered":"2024-09-17T05:50:17.683866+0000","last_unstale":"2024-09-17T05:50:17.688492+0000","last_undegraded":"2024-09-17T05:50:17.688492+0000","last_fullsized":"2024-09-17T05:50:17.688492+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:50:16.649689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:50:16.649689+0000","last_clean_scrub_stamp":"2024-09-17T05:50:16.649689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:45:29.227941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.4","version":"0'0","reported_seq":13,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-17T05:50:17.682877+0000","last_change":"2024-09-17T05:50:16.669515+0000","last_active":"2024-09-17T05:50:17.682877+0000","last_peered":"2024-09-17T05:50:17.682877+0000","last_clean":"2024-09-17T05:50:17.682877+0000","last_became_active":"2024-09-17T05:50:16.669123+0000","last_became_peered":"2024-09-17T05:50:16.669123+0000","last_unstale":"2024-09-17T05:50:17.682877+0000","last_undegraded":"2024-09-17T05:50:17.682877+0000","last_fullsized":"2024-09-17T05:50:17.682877+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:50:15.639879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:50:15.639879+0000","last_clean_scrub_stamp":"2024-09-17T05:50:15.639879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:36:09.486712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.2","version":"0'0","reported_seq":10,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-17T05:50:17.699104+0000","last_change":"2024-09-17T05:50:17.694213+0000","last_active":"2024-09-17T05:50:17.699104+0000","last_peered":"2024-09-17T05:50:17.699104+0000","last_clean":"2024-09-17T05:50:17.699104+0000","last_became_active":"2024-09-17T05:50:17.684089+0000","last_became_peered":"2024-09-17T05:50:17.684089+0000","last_unstale":"2024-09-17T05:50:17.699104+0000","last_undegraded":"2024-09-17T05:50:17.699104+0000","last_fullsized":"2024-09-17T05:50:17.699104+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:50:16.649689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:50:16.649689+0000","last_clean_scrub_stamp":"2024-09-17T05:50:16.649689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:58:43.708570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.3","version":"0'0","reported_seq":15,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-17T05:50:18.686471+0000","last_change":"2024-09-17T05:50:16.669971+0000","last_active":"2024-09-17T05:50:18.686471+0000","last_peered":"2024-09-17T05:50:18.686471+0000","last_clean":"2024-09-17T05:50:18.686471+0000","last_became_active":"2024-09-17T05:50:16.667502+0000","last_became_peered":"2024-09-17T05:50:16.667502+0000","last_unstale":"2024-09-17T05:50:18.686471+0000","last_undegraded":"2024-09-17T05:50:18.686471+0000","last_fullsized":"2024-09-17T05:50:18.686471+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:50:15.639879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:50:15.639879+0000","last_clean_scrub_stamp":"2024-09-17T05:50:15.639879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:15:08.648001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.3","version":"0'0","reported_seq":1,"reported_epoch":99,"state":"creating+peering","last_fresh":"2024-09-17T05:50:16.655898+0000","last_change":"2024-09-17T05:50:16.655898+0000","last_active":"2024-09-17T05:50:16.649689+0000","last_peered":"2024-09-17T05:50:16.649689+0000","last_clean":"2024-09-17T05:50:16.649689+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:50:16.655898+0000","last_undegraded":"2024-09-17T05:50:16.655898+0000","last_fullsized":"2024-09-17T05:50:16.655898+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:50:16.649689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:50:16.649689+0000","last_clean_scrub_stamp":"2024-09-17T05:50:16.649689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.2","version":"0'0","reported_seq":13,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-17T05:50:17.679835+0000","last_change":"2024-09-17T05:50:16.672742+0000","last_active":"2024-09-17T05:50:17.679835+0000","last_peered":"2024-09-17T05:50:17.679835+0000","last_clean":"2024-09-17T05:50:17.679835+0000","last_became_active":"2024-09-17T05:50:16.672357+0000","last_became_peered":"2024-09-17T05:50:16.672357+0000","last_unstale":"2024-09-17T05:50:17.679835+0000","last_undegraded":"2024-09-17T05:50:17.679835+0000","last_fullsized":"2024-09-17T05:50:17.679835+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:50:15.639879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:50:15.639879+0000","last_clean_scrub_stamp":"2024-09-17T05:50:15.639879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:30:35.738894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.0","version":"0'0","reported_seq":10,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-17T05:50:17.678422+0000","last_change":"2024-09-17T05:50:17.675260+0000","last_active":"2024-09-17T05:50:17.678422+0000","last_peered":"2024-09-17T05:50:17.678422+0000","last_clean":"2024-09-17T05:50:17.678422+0000","last_became_active":"2024-09-17T05:50:17.674667+0000","last_became_peered":"2024-09-17T05:50:17.674667+0000","last_unstale":"2024-09-17T05:50:17.678422+0000","last_undegraded":"2024-09-17T05:50:17.678422+0000","last_fullsized":"2024-09-17T05:50:17.678422+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:50:16.649689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:50:16.649689+0000","last_clean_scrub_stamp":"2024-09-17T05:50:16.649689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:33:47.309127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.1","version":"0'0","reported_seq":13,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-17T05:50:17.666388+0000","last_change":"2024-09-17T05:50:16.670111+0000","last_active":"2024-09-17T05:50:17.666388+0000","last_peered":"2024-09-17T05:50:17.666388+0000","last_clean":"2024-09-17T05:50:17.666388+0000","last_became_active":"2024-09-17T05:50:16.669343+0000","last_became_peered":"2024-09-17T05:50:16.669343+0000","last_unstale":"2024-09-17T05:50:17.666388+0000","last_undegraded":"2024-09-17T05:50:17.666388+0000","last_fullsized":"2024-09-17T05:50:17.666388+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:50:15.639879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:50:15.639879+0000","last_clean_scrub_stamp":"2024-09-17T05:50:15.639879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:14:06.830335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.1","version":"0'0","reported_seq":10,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-17T05:50:17.694046+0000","last_change":"2024-09-17T05:50:17.692076+0000","last_active":"2024-09-17T05:50:17.694046+0000","last_peered":"2024-09-17T05:50:17.694046+0000","last_clean":"2024-09-17T05:50:17.694046+0000","last_became_active":"2024-09-17T05:50:17.688755+0000","last_became_peered":"2024-09-17T05:50:17.688755+0000","last_unstale":"2024-09-17T05:50:17.694046+0000","last_undegraded":"2024-09-17T05:50:17.694046+0000","last_fullsized":"2024-09-17T05:50:17.694046+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:50:16.649689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:50:16.649689+0000","last_clean_scrub_stamp":"2024-09-17T05:50:16.649689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:09:55.788176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.0","version":"0'0","reported_seq":13,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-17T05:50:17.669830+0000","last_change":"2024-09-17T05:50:16.680798+0000","last_active":"2024-09-17T05:50:17.669830+0000","last_peered":"2024-09-17T05:50:17.669830+0000","last_clean":"2024-09-17T05:50:17.669830+0000","last_became_active":"2024-09-17T05:50:16.680485+0000","last_became_peered":"2024-09-17T05:50:16.680485+0000","last_unstale":"2024-09-17T05:50:17.669830+0000","last_undegraded":"2024-09-17T05:50:17.669830+0000","last_fullsized":"2024-09-17T05:50:17.669830+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:50:15.639879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:50:15.639879+0000","last_clean_scrub_stamp":"2024-09-17T05:50:15.639879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:59:08.119171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.e","version":"0'0","reported_seq":10,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-17T05:50:17.685022+0000","last_change":"2024-09-17T05:50:17.682012+0000","last_active":"2024-09-17T05:50:17.685022+0000","last_peered":"2024-09-17T05:50:17.685022+0000","last_clean":"2024-09-17T05:50:17.685022+0000","last_became_active":"2024-09-17T05:50:17.681695+0000","last_became_peered":"2024-09-17T05:50:17.681695+0000","last_unstale":"2024-09-17T05:50:17.685022+0000","last_undegraded":"2024-09-17T05:50:17.685022+0000","last_fullsized":"2024-09-17T05:50:17.685022+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:50:16.649689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:50:16.649689+0000","last_clean_scrub_stamp":"2024-09-17T05:50:16.649689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:51:07.133701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.f","version":"0'0","reported_seq":10,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-17T05:50:16.675558+0000","last_change":"2024-09-17T05:50:16.675030+0000","last_active":"2024-09-17T05:50:16.675558+0000","last_peered":"2024-09-17T05:50:16.675558+0000","last_clean":"2024-09-17T05:50:16.675558+0000","last_became_active":"2024-09-17T05:50:16.674713+0000","last_became_peered":"2024-09-17T05:50:16.674713+0000","last_unstale":"2024-09-17T05:50:16.675558+0000","last_undegraded":"2024-09-17T05:50:16.675558+0000","last_fullsized":"2024-09-17T05:50:16.675558+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:50:15.639879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:50:15.639879+0000","last_clean_scrub_stamp":"2024-09-17T05:50:15.639879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:41:28.416146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"19'72","reported_seq":251,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-17T05:50:16.668637+0000","last_change":"2024-09-17T05:41:48.539830+0000","last_active":"2024-09-17T05:50:16.668637+0000","last_peered":"2024-09-17T05:50:16.668637+0000","last_clean":"2024-09-17T05:50:16.668637+0000","last_became_active":"2024-09-17T05:41:48.538743+0000","last_became_peered":"2024-09-17T05:41:48.538743+0000","last_unstale":"2024-09-17T05:50:16.668637+0000","last_undegraded":"2024-09-17T05:50:16.668637+0000","last_fullsized":"2024-09-17T05:50:16.668637+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:47.152539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:47.152539+0000","last_clean_scrub_stamp":"2024-09-17T05:41:47.152539+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:08:02.952016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":15,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":14,"num_pg":32,"stat_sum":{"num_bytes":686,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":10,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2902,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":24,"ondisk_log_size":24,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":16,"seq":68719476843,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":118412,"kb_used_data":1208,"kb_used_omap":1,"kb_used_meta":117182,"kb_avail":94253428,"statfs":{"total":96636764160,"available":96515510272,"internally_reserved":0,"allocated":1236992,"data_stored":531916,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":119994822},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":7,"up_from":15,"seq":64424509547,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":127280,"kb_used_data":1756,"kb_used_omap":1,"kb_used_meta":125502,"kb_avail":94244560,"statfs":{"total":96636764160,"available":96506429440,"internally_reserved":0,"allocated":1798144,"data_stored":1108358,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":128514506},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509546,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":72556,"kb_used_data":1176,"kb_used_omap":1,"kb_used_meta":71358,"kb_avail":94299284,"statfs":{"total":96636764160,"available":96562466816,"internally_reserved":0,"allocated":1204224,"data_stored":517990,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":73071045},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509546,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":148908,"kb_used_data":1176,"kb_used_omap":1,"kb_used_meta":147710,"kb_avail":94222932,"statfs":{"total":96636764160,"available":96484282368,"internally_reserved":0,"allocated":1204224,"data_stored":517990,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":151255493},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509546,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":112824,"kb_used_data":1188,"kb_used_omap":1,"kb_used_meta":111614,"kb_avail":94259016,"statfs":{"total":96636764160,"available":96521232384,"internally_reserved":0,"allocated":1216512,"data_stored":524377,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":114293191},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509546,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":153096,"kb_used_data":1204,"kb_used_omap":1,"kb_used_meta":151870,"kb_avail":94218744,"statfs":{"total":96636764160,"available":96479993856,"internally_reserved":0,"allocated":1232896,"data_stored":531298,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":155515333},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509546,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":118396,"kb_used_data":1188,"kb_used_omap":1,"kb_used_meta":117182,"kb_avail":94253444,"statfs":{"total":96636764160,"available":96515526656,"internally_reserved":0,"allocated":1216512,"data_stored":524377,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":119994821},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574954,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":131468,"kb_used_data":1784,"kb_used_omap":1,"kb_used_meta":129662,"kb_avail":94240372,"statfs":{"total":96636764160,"available":96502140928,"internally_reserved":0,"allocated":1826816,"data_stored":1122214,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":132774341},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-17T05:50:22.416 INFO:tasks.ceph.ceph_manager.ceph:PG 15.3a is not active+clean 2024-09-17T05:50:22.416 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '15.3a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 99, 'state': 'creating+peering', 'last_fresh': '2024-09-17T05:50:16.664990+0000', 'last_change': '2024-09-17T05:50:16.664990+0000', 'last_active': '2024-09-17T05:50:16.649689+0000', 'last_peered': '2024-09-17T05:50:16.649689+0000', 'last_clean': '2024-09-17T05:50:16.649689+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:50:16.664990+0000', 'last_undegraded': '2024-09-17T05:50:16.664990+0000', 'last_fullsized': '2024-09-17T05:50:16.664990+0000', 'mapping_epoch': 99, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 99, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:50:16.649689+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:50:16.649689+0000', 'last_clean_scrub_stamp': '2024-09-17T05:50:16.649689+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 5], 'acting': [7, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-17T05:50:22.416 INFO:tasks.ceph.ceph_manager.ceph:PG 15.39 is not active+clean 2024-09-17T05:50:22.416 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '15.39', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 99, 'state': 'creating+peering', 'last_fresh': '2024-09-17T05:50:16.665949+0000', 'last_change': '2024-09-17T05:50:16.665949+0000', 'last_active': '2024-09-17T05:50:16.649689+0000', 'last_peered': '2024-09-17T05:50:16.649689+0000', 'last_clean': '2024-09-17T05:50:16.649689+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:50:16.665949+0000', 'last_undegraded': '2024-09-17T05:50:16.665949+0000', 'last_fullsized': '2024-09-17T05:50:16.665949+0000', 'mapping_epoch': 99, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 99, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:50:16.649689+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:50:16.649689+0000', 'last_clean_scrub_stamp': '2024-09-17T05:50:16.649689+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 5], 'acting': [7, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-17T05:50:22.416 INFO:tasks.ceph.ceph_manager.ceph:PG 15.37 is not active+clean 2024-09-17T05:50:22.416 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '15.37', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 99, 'state': 'creating+peering', 'last_fresh': '2024-09-17T05:50:16.656812+0000', 'last_change': '2024-09-17T05:50:16.656812+0000', 'last_active': '2024-09-17T05:50:16.649689+0000', 'last_peered': '2024-09-17T05:50:16.649689+0000', 'last_clean': '2024-09-17T05:50:16.649689+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:50:16.656812+0000', 'last_undegraded': '2024-09-17T05:50:16.656812+0000', 'last_fullsized': '2024-09-17T05:50:16.656812+0000', 'mapping_epoch': 99, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 99, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:50:16.649689+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:50:16.649689+0000', 'last_clean_scrub_stamp': '2024-09-17T05:50:16.649689+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 3], 'acting': [4, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-17T05:50:22.416 INFO:tasks.ceph.ceph_manager.ceph:PG 15.35 is not active+clean 2024-09-17T05:50:22.416 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '15.35', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 99, 'state': 'creating+peering', 'last_fresh': '2024-09-17T05:50:16.669270+0000', 'last_change': '2024-09-17T05:50:16.669270+0000', 'last_active': '2024-09-17T05:50:16.649689+0000', 'last_peered': '2024-09-17T05:50:16.649689+0000', 'last_clean': '2024-09-17T05:50:16.649689+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:50:16.669270+0000', 'last_undegraded': '2024-09-17T05:50:16.669270+0000', 'last_fullsized': '2024-09-17T05:50:16.669270+0000', 'mapping_epoch': 99, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 99, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:50:16.649689+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:50:16.649689+0000', 'last_clean_scrub_stamp': '2024-09-17T05:50:16.649689+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 4], 'acting': [7, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-17T05:50:22.416 INFO:tasks.ceph.ceph_manager.ceph:PG 15.34 is not active+clean 2024-09-17T05:50:22.417 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '15.34', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 99, 'state': 'creating+peering', 'last_fresh': '2024-09-17T05:50:16.657363+0000', 'last_change': '2024-09-17T05:50:16.657363+0000', 'last_active': '2024-09-17T05:50:16.649689+0000', 'last_peered': '2024-09-17T05:50:16.649689+0000', 'last_clean': '2024-09-17T05:50:16.649689+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:50:16.657363+0000', 'last_undegraded': '2024-09-17T05:50:16.657363+0000', 'last_fullsized': '2024-09-17T05:50:16.657363+0000', 'mapping_epoch': 99, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 99, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:50:16.649689+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:50:16.649689+0000', 'last_clean_scrub_stamp': '2024-09-17T05:50:16.649689+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 1], 'acting': [4, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-17T05:50:22.417 INFO:tasks.ceph.ceph_manager.ceph:PG 15.30 is not active+clean 2024-09-17T05:50:22.417 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '15.30', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 99, 'state': 'creating+peering', 'last_fresh': '2024-09-17T05:50:16.667715+0000', 'last_change': '2024-09-17T05:50:16.667715+0000', 'last_active': '2024-09-17T05:50:16.649689+0000', 'last_peered': '2024-09-17T05:50:16.649689+0000', 'last_clean': '2024-09-17T05:50:16.649689+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:50:16.667715+0000', 'last_undegraded': '2024-09-17T05:50:16.667715+0000', 'last_fullsized': '2024-09-17T05:50:16.667715+0000', 'mapping_epoch': 99, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 99, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:50:16.649689+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:50:16.649689+0000', 'last_clean_scrub_stamp': '2024-09-17T05:50:16.649689+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 0], 'acting': [7, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-17T05:50:22.417 INFO:tasks.ceph.ceph_manager.ceph:PG 15.2c is not active+clean 2024-09-17T05:50:22.417 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '15.2c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 99, 'state': 'creating+peering', 'last_fresh': '2024-09-17T05:50:16.656329+0000', 'last_change': '2024-09-17T05:50:16.656329+0000', 'last_active': '2024-09-17T05:50:16.649689+0000', 'last_peered': '2024-09-17T05:50:16.649689+0000', 'last_clean': '2024-09-17T05:50:16.649689+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:50:16.656329+0000', 'last_undegraded': '2024-09-17T05:50:16.656329+0000', 'last_fullsized': '2024-09-17T05:50:16.656329+0000', 'mapping_epoch': 99, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 99, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:50:16.649689+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:50:16.649689+0000', 'last_clean_scrub_stamp': '2024-09-17T05:50:16.649689+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 3], 'acting': [4, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-17T05:50:22.417 INFO:tasks.ceph.ceph_manager.ceph:PG 15.28 is not active+clean 2024-09-17T05:50:22.417 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '15.28', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 99, 'state': 'creating+peering', 'last_fresh': '2024-09-17T05:50:16.666955+0000', 'last_change': '2024-09-17T05:50:16.666955+0000', 'last_active': '2024-09-17T05:50:16.649689+0000', 'last_peered': '2024-09-17T05:50:16.649689+0000', 'last_clean': '2024-09-17T05:50:16.649689+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:50:16.666955+0000', 'last_undegraded': '2024-09-17T05:50:16.666955+0000', 'last_fullsized': '2024-09-17T05:50:16.666955+0000', 'mapping_epoch': 99, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 99, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:50:16.649689+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:50:16.649689+0000', 'last_clean_scrub_stamp': '2024-09-17T05:50:16.649689+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 1], 'acting': [7, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-17T05:50:22.417 INFO:tasks.ceph.ceph_manager.ceph:PG 15.25 is not active+clean 2024-09-17T05:50:22.417 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '15.25', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 99, 'state': 'creating+peering', 'last_fresh': '2024-09-17T05:50:16.668754+0000', 'last_change': '2024-09-17T05:50:16.668754+0000', 'last_active': '2024-09-17T05:50:16.649689+0000', 'last_peered': '2024-09-17T05:50:16.649689+0000', 'last_clean': '2024-09-17T05:50:16.649689+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:50:16.668754+0000', 'last_undegraded': '2024-09-17T05:50:16.668754+0000', 'last_fullsized': '2024-09-17T05:50:16.668754+0000', 'mapping_epoch': 99, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 99, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:50:16.649689+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:50:16.649689+0000', 'last_clean_scrub_stamp': '2024-09-17T05:50:16.649689+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 2], 'acting': [7, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-17T05:50:22.417 INFO:tasks.ceph.ceph_manager.ceph:PG 15.1d is not active+clean 2024-09-17T05:50:22.417 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '15.1d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 99, 'state': 'creating+peering', 'last_fresh': '2024-09-17T05:50:16.655870+0000', 'last_change': '2024-09-17T05:50:16.655870+0000', 'last_active': '2024-09-17T05:50:16.649689+0000', 'last_peered': '2024-09-17T05:50:16.649689+0000', 'last_clean': '2024-09-17T05:50:16.649689+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:50:16.655870+0000', 'last_undegraded': '2024-09-17T05:50:16.655870+0000', 'last_fullsized': '2024-09-17T05:50:16.655870+0000', 'mapping_epoch': 99, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 99, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:50:16.649689+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:50:16.649689+0000', 'last_clean_scrub_stamp': '2024-09-17T05:50:16.649689+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 5], 'acting': [4, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-17T05:50:22.418 INFO:tasks.ceph.ceph_manager.ceph:PG 15.1a is not active+clean 2024-09-17T05:50:22.418 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '15.1a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 99, 'state': 'creating+peering', 'last_fresh': '2024-09-17T05:50:16.655670+0000', 'last_change': '2024-09-17T05:50:16.655670+0000', 'last_active': '2024-09-17T05:50:16.649689+0000', 'last_peered': '2024-09-17T05:50:16.649689+0000', 'last_clean': '2024-09-17T05:50:16.649689+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:50:16.655670+0000', 'last_undegraded': '2024-09-17T05:50:16.655670+0000', 'last_fullsized': '2024-09-17T05:50:16.655670+0000', 'mapping_epoch': 99, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 99, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:50:16.649689+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:50:16.649689+0000', 'last_clean_scrub_stamp': '2024-09-17T05:50:16.649689+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 4], 'acting': [5, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-17T05:50:22.418 INFO:tasks.ceph.ceph_manager.ceph:PG 15.1b is not active+clean 2024-09-17T05:50:22.418 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '15.1b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 99, 'state': 'creating+peering', 'last_fresh': '2024-09-17T05:50:16.664625+0000', 'last_change': '2024-09-17T05:50:16.664625+0000', 'last_active': '2024-09-17T05:50:16.649689+0000', 'last_peered': '2024-09-17T05:50:16.649689+0000', 'last_clean': '2024-09-17T05:50:16.649689+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:50:16.664625+0000', 'last_undegraded': '2024-09-17T05:50:16.664625+0000', 'last_fullsized': '2024-09-17T05:50:16.664625+0000', 'mapping_epoch': 99, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 99, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:50:16.649689+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:50:16.649689+0000', 'last_clean_scrub_stamp': '2024-09-17T05:50:16.649689+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 6], 'acting': [7, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-17T05:50:22.418 INFO:tasks.ceph.ceph_manager.ceph:PG 15.19 is not active+clean 2024-09-17T05:50:22.418 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '15.19', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 99, 'state': 'creating+peering', 'last_fresh': '2024-09-17T05:50:16.655280+0000', 'last_change': '2024-09-17T05:50:16.655280+0000', 'last_active': '2024-09-17T05:50:16.649689+0000', 'last_peered': '2024-09-17T05:50:16.649689+0000', 'last_clean': '2024-09-17T05:50:16.649689+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:50:16.655280+0000', 'last_undegraded': '2024-09-17T05:50:16.655280+0000', 'last_fullsized': '2024-09-17T05:50:16.655280+0000', 'mapping_epoch': 99, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 99, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:50:16.649689+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:50:16.649689+0000', 'last_clean_scrub_stamp': '2024-09-17T05:50:16.649689+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 5], 'acting': [4, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-17T05:50:22.418 INFO:tasks.ceph.ceph_manager.ceph:PG 15.17 is not active+clean 2024-09-17T05:50:22.418 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '15.17', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 99, 'state': 'creating+peering', 'last_fresh': '2024-09-17T05:50:16.656309+0000', 'last_change': '2024-09-17T05:50:16.656309+0000', 'last_active': '2024-09-17T05:50:16.649689+0000', 'last_peered': '2024-09-17T05:50:16.649689+0000', 'last_clean': '2024-09-17T05:50:16.649689+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:50:16.656309+0000', 'last_undegraded': '2024-09-17T05:50:16.656309+0000', 'last_fullsized': '2024-09-17T05:50:16.656309+0000', 'mapping_epoch': 99, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 99, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:50:16.649689+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:50:16.649689+0000', 'last_clean_scrub_stamp': '2024-09-17T05:50:16.649689+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 5], 'acting': [4, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-17T05:50:22.418 INFO:tasks.ceph.ceph_manager.ceph:PG 15.15 is not active+clean 2024-09-17T05:50:22.418 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '15.15', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 99, 'state': 'creating+peering', 'last_fresh': '2024-09-17T05:50:16.666417+0000', 'last_change': '2024-09-17T05:50:16.666417+0000', 'last_active': '2024-09-17T05:50:16.649689+0000', 'last_peered': '2024-09-17T05:50:16.649689+0000', 'last_clean': '2024-09-17T05:50:16.649689+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:50:16.666417+0000', 'last_undegraded': '2024-09-17T05:50:16.666417+0000', 'last_fullsized': '2024-09-17T05:50:16.666417+0000', 'mapping_epoch': 99, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 99, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:50:16.649689+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:50:16.649689+0000', 'last_clean_scrub_stamp': '2024-09-17T05:50:16.649689+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 0], 'acting': [7, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-17T05:50:22.418 INFO:tasks.ceph.ceph_manager.ceph:PG 15.10 is not active+clean 2024-09-17T05:50:22.418 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '15.10', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 99, 'state': 'creating+peering', 'last_fresh': '2024-09-17T05:50:16.655229+0000', 'last_change': '2024-09-17T05:50:16.655229+0000', 'last_active': '2024-09-17T05:50:16.649689+0000', 'last_peered': '2024-09-17T05:50:16.649689+0000', 'last_clean': '2024-09-17T05:50:16.649689+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:50:16.655229+0000', 'last_undegraded': '2024-09-17T05:50:16.655229+0000', 'last_fullsized': '2024-09-17T05:50:16.655229+0000', 'mapping_epoch': 99, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 99, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:50:16.649689+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:50:16.649689+0000', 'last_clean_scrub_stamp': '2024-09-17T05:50:16.649689+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 5], 'acting': [4, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-17T05:50:22.419 INFO:tasks.ceph.ceph_manager.ceph:PG 15.c is not active+clean 2024-09-17T05:50:22.419 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '15.c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 99, 'state': 'creating+peering', 'last_fresh': '2024-09-17T05:50:16.655146+0000', 'last_change': '2024-09-17T05:50:16.655146+0000', 'last_active': '2024-09-17T05:50:16.649689+0000', 'last_peered': '2024-09-17T05:50:16.649689+0000', 'last_clean': '2024-09-17T05:50:16.649689+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:50:16.655146+0000', 'last_undegraded': '2024-09-17T05:50:16.655146+0000', 'last_fullsized': '2024-09-17T05:50:16.655146+0000', 'mapping_epoch': 99, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 99, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:50:16.649689+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:50:16.649689+0000', 'last_clean_scrub_stamp': '2024-09-17T05:50:16.649689+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 6], 'acting': [5, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-17T05:50:22.419 INFO:tasks.ceph.ceph_manager.ceph:PG 15.d is not active+clean 2024-09-17T05:50:22.419 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '15.d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 99, 'state': 'creating+peering', 'last_fresh': '2024-09-17T05:50:16.664714+0000', 'last_change': '2024-09-17T05:50:16.664714+0000', 'last_active': '2024-09-17T05:50:16.649689+0000', 'last_peered': '2024-09-17T05:50:16.649689+0000', 'last_clean': '2024-09-17T05:50:16.649689+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:50:16.664714+0000', 'last_undegraded': '2024-09-17T05:50:16.664714+0000', 'last_fullsized': '2024-09-17T05:50:16.664714+0000', 'mapping_epoch': 99, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 99, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:50:16.649689+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:50:16.649689+0000', 'last_clean_scrub_stamp': '2024-09-17T05:50:16.649689+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 4], 'acting': [7, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-17T05:50:22.419 INFO:tasks.ceph.ceph_manager.ceph:PG 15.3 is not active+clean 2024-09-17T05:50:22.419 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '15.3', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 99, 'state': 'creating+peering', 'last_fresh': '2024-09-17T05:50:16.655898+0000', 'last_change': '2024-09-17T05:50:16.655898+0000', 'last_active': '2024-09-17T05:50:16.649689+0000', 'last_peered': '2024-09-17T05:50:16.649689+0000', 'last_clean': '2024-09-17T05:50:16.649689+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:50:16.655898+0000', 'last_undegraded': '2024-09-17T05:50:16.655898+0000', 'last_fullsized': '2024-09-17T05:50:16.655898+0000', 'mapping_epoch': 99, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 99, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:50:16.649689+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:50:16.649689+0000', 'last_clean_scrub_stamp': '2024-09-17T05:50:16.649689+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 6], 'acting': [4, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-17T05:50:22.420 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-09-17T05:50:22.565 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:22.564+0000 7f2323007640 1 -- 172.21.15.150:0/3646201392 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f231c15ee30 msgr2=0x7f231c0b2840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:50:22.565 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:22.564+0000 7f2323007640 1 --2- 172.21.15.150:0/3646201392 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f231c15ee30 0x7f231c0b2840 secure :-1 s=READY pgs=1327 cs=0 l=1 rev1=1 crypto rx=0x7f2314005fd0 tx=0x7f231402a5d0 comp rx=0 tx=0).stop 2024-09-17T05:50:22.565 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:22.564+0000 7f2323007640 1 -- 172.21.15.150:0/3646201392 shutdown_connections 2024-09-17T05:50:22.566 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:22.564+0000 7f2323007640 1 --2- 172.21.15.150:0/3646201392 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f231c15ee30 0x7f231c0b2840 unknown :-1 s=CLOSED pgs=1327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:50:22.566 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:22.564+0000 7f2323007640 1 -- 172.21.15.150:0/3646201392 >> 172.21.15.150:0/3646201392 conn(0x7f231c0b2fd0 msgr2=0x7f231c0b33e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:50:22.566 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:22.564+0000 7f2323007640 1 -- 172.21.15.150:0/3646201392 shutdown_connections 2024-09-17T05:50:22.566 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:22.564+0000 7f2323007640 1 -- 172.21.15.150:0/3646201392 wait complete. 2024-09-17T05:50:22.566 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:22.566+0000 7f2323007640 1 Processor -- start 2024-09-17T05:50:22.566 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:22.566+0000 7f2323007640 1 -- start start 2024-09-17T05:50:22.569 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:22.567+0000 7f2323007640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f231c0b5410 0x7f231c151880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:50:22.570 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:22.567+0000 7f2323007640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f231c0cf7c0 0x7f231c09d6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:50:22.570 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:22.567+0000 7f2323007640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f231c15ee30 0x7f231c1f36d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:50:22.570 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:22.567+0000 7f2323007640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f231c0b63d0 con 0x7f231c0b5410 2024-09-17T05:50:22.570 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:22.567+0000 7f2323007640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f231c0b6250 con 0x7f231c15ee30 2024-09-17T05:50:22.570 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:22.567+0000 7f2323007640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f231c0b6550 con 0x7f231c0cf7c0 2024-09-17T05:50:22.570 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:22.567+0000 7f2320da3640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f231c0b5410 0x7f231c151880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:50:22.570 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:22.567+0000 7f2320da3640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f231c0b5410 0x7f231c151880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:57304/0 (socket says 172.21.15.150:57304) 2024-09-17T05:50:22.570 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:22.567+0000 7f2320da3640 1 -- 172.21.15.150:0/646180830 learned_addr learned my addr 172.21.15.150:0/646180830 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:50:22.570 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:22.568+0000 7f231bfff640 1 --2- 172.21.15.150:0/646180830 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f231c0cf7c0 0x7f231c09d6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:50:22.570 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:22.568+0000 7f23215a4640 1 --2- 172.21.15.150:0/646180830 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f231c15ee30 0x7f231c1f36d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:50:22.570 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:22.568+0000 7f2320da3640 1 -- 172.21.15.150:0/646180830 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f231c0cf7c0 msgr2=0x7f231c09d6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:50:22.570 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:22.568+0000 7f2320da3640 1 --2- 172.21.15.150:0/646180830 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f231c0cf7c0 0x7f231c09d6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:50:22.571 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:22.568+0000 7f2320da3640 1 -- 172.21.15.150:0/646180830 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f231c15ee30 msgr2=0x7f231c1f36d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:50:22.571 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:22.568+0000 7f2320da3640 1 --2- 172.21.15.150:0/646180830 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f231c15ee30 0x7f231c1f36d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:50:22.571 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:22.568+0000 7f2320da3640 1 -- 172.21.15.150:0/646180830 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f231c151dc0 con 0x7f231c0b5410 2024-09-17T05:50:22.571 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:22.568+0000 7f23215a4640 1 --2- 172.21.15.150:0/646180830 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f231c15ee30 0x7f231c1f36d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:50:22.571 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:22.568+0000 7f2320da3640 1 --2- 172.21.15.150:0/646180830 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f231c0b5410 0x7f231c151880 secure :-1 s=READY pgs=1328 cs=0 l=1 rev1=1 crypto rx=0x7f2314000c00 tx=0x7f23140038a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:50:22.571 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:22.568+0000 7f23197fa640 1 -- 172.21.15.150:0/646180830 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f231403e030 con 0x7f231c0b5410 2024-09-17T05:50:22.571 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:22.568+0000 7f23197fa640 1 -- 172.21.15.150:0/646180830 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f2314003ca0 con 0x7f231c0b5410 2024-09-17T05:50:22.571 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:22.568+0000 7f23197fa640 1 -- 172.21.15.150:0/646180830 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2314035040 con 0x7f231c0b5410 2024-09-17T05:50:22.572 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:22.568+0000 7f2323007640 1 -- 172.21.15.150:0/646180830 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f231c09c620 con 0x7f231c0b5410 2024-09-17T05:50:22.572 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:22.568+0000 7f2323007640 1 -- 172.21.15.150:0/646180830 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f231c09cbe0 con 0x7f231c0b5410 2024-09-17T05:50:22.573 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:22.569+0000 7f2323007640 1 -- 172.21.15.150:0/646180830 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f231c0b6a80 con 0x7f231c0b5410 2024-09-17T05:50:22.573 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:22.570+0000 7f23197fa640 1 -- 172.21.15.150:0/646180830 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 32) ==== 103481+0+0 (secure 0 0 0) 0x7f2314041030 con 0x7f231c0b5410 2024-09-17T05:50:22.573 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:22.571+0000 7f23197fa640 1 --2- 172.21.15.150:0/646180830 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f22fc07a210 0x7f22fc07c720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:50:22.573 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:22.571+0000 7f23197fa640 1 -- 172.21.15.150:0/646180830 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(101..101 src has 1..101) ==== 5821+0+0 (secure 0 0 0) 0x7f23140b9fb0 con 0x7f231c0b5410 2024-09-17T05:50:22.573 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:22.571+0000 7f231bfff640 1 --2- 172.21.15.150:0/646180830 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f22fc07a210 0x7f22fc07c720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:50:22.573 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:22.571+0000 7f231bfff640 1 --2- 172.21.15.150:0/646180830 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f22fc07a210 0x7f22fc07c720 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7f230c0012e0 tx=0x7f230c009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:50:22.576 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:22.575+0000 7f23197fa640 1 -- 172.21.15.150:0/646180830 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f2314083930 con 0x7f231c0b5410 2024-09-17T05:50:22.638 INFO:tasks.ceph.mds.c.smithi150.stderr:2024-09-17T05:50:22.637+0000 7fc6189a9640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-17T05:50:22.822 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:22.821+0000 7f2323007640 1 -- 172.21.15.150:0/646180830 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) -- 0x7f231c0b3630 con 0x7f231c0b5410 2024-09-17T05:50:22.822 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:22.822+0000 7f23197fa640 1 -- 172.21.15.150:0/646180830 <== mon.0 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) ==== 72+0+1144 (secure 0 0 0) 0x7f2314088360 con 0x7f231c0b5410 2024-09-17T05:50:22.823 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-09-17T05:50:22.823 INFO:teuthology.orchestra.run.smithi150.stdout:{"fsid":"9f2e05e9-d629-47b3-b26b-1360655b7d20","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":530,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":101,"num_osds":8,"num_up_osds":8,"osd_up_since":1726551706,"num_in_osds":8,"osd_in_since":1726551696,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":78},{"state_name":"creating+peering","count":19}],"num_pgs":97,"num_pools":3,"num_objects":15,"data_bytes":591054,"bytes_used":1006530560,"bytes_avail":772087582720,"bytes_total":773094113280,"inactive_pgs_ratio":0.19587628543376923,"write_bytes_sec":1710,"read_op_per_sec":0,"write_op_per_sec":5},"fsmap":{"epoch":60,"btime":"2024-09-17T05:50:20:687617+0000","id":7,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":7,"rank":0,"name":"c","status":"up:active","gid":8064}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":17,"modified":"2024-09-17T05:49:15.004587+0000","services":{}},"progress_events":{}} 2024-09-17T05:50:22.826 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:22.824+0000 7f2323007640 1 -- 172.21.15.150:0/646180830 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f22fc07a210 msgr2=0x7f22fc07c720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:50:22.826 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:22.824+0000 7f2323007640 1 --2- 172.21.15.150:0/646180830 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f22fc07a210 0x7f22fc07c720 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7f230c0012e0 tx=0x7f230c009040 comp rx=0 tx=0).stop 2024-09-17T05:50:22.826 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:22.824+0000 7f2323007640 1 -- 172.21.15.150:0/646180830 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f231c0b5410 msgr2=0x7f231c151880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:50:22.827 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:22.824+0000 7f2323007640 1 --2- 172.21.15.150:0/646180830 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f231c0b5410 0x7f231c151880 secure :-1 s=READY pgs=1328 cs=0 l=1 rev1=1 crypto rx=0x7f2314000c00 tx=0x7f23140038a0 comp rx=0 tx=0).stop 2024-09-17T05:50:22.827 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:22.824+0000 7f2323007640 1 -- 172.21.15.150:0/646180830 shutdown_connections 2024-09-17T05:50:22.827 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:22.824+0000 7f2323007640 1 --2- 172.21.15.150:0/646180830 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f231c15ee30 0x7f231c1f36d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:50:22.827 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:22.824+0000 7f2323007640 1 --2- 172.21.15.150:0/646180830 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f22fc07a210 0x7f22fc07c720 unknown :-1 s=CLOSED pgs=573 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:50:22.827 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:22.824+0000 7f2323007640 1 --2- 172.21.15.150:0/646180830 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f231c0cf7c0 0x7f231c09d6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:50:22.827 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:22.824+0000 7f2323007640 1 --2- 172.21.15.150:0/646180830 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f231c0b5410 0x7f231c151880 unknown :-1 s=CLOSED pgs=1328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:50:22.828 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:22.824+0000 7f2323007640 1 -- 172.21.15.150:0/646180830 >> 172.21.15.150:0/646180830 conn(0x7f231c0b2fd0 msgr2=0x7f231c15c840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:50:22.828 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:22.825+0000 7f2323007640 1 -- 172.21.15.150:0/646180830 shutdown_connections 2024-09-17T05:50:22.828 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:22.825+0000 7f2323007640 1 -- 172.21.15.150:0/646180830 wait complete. 2024-09-17T05:50:22.837 INFO:tasks.ceph.ceph_manager.ceph:no progress seen, keeping timeout for now 2024-09-17T05:50:22.837 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-17T05:50:22.951 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:22.950+0000 7ff7eb669640 1 -- 172.21.15.150:0/1494679944 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff7d0004d40 msgr2=0x7ff7d0005150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:50:22.951 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:22.950+0000 7ff7eb669640 1 --2- 172.21.15.150:0/1494679944 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff7d0004d40 0x7ff7d0005150 secure :-1 s=READY pgs=1330 cs=0 l=1 rev1=1 crypto rx=0x7ff7e40c5d80 tx=0x7ff7d0005830 comp rx=0 tx=0).stop 2024-09-17T05:50:22.951 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:22.950+0000 7ff7e9c06640 1 -- 172.21.15.150:0/1494679944 reap_dead start 2024-09-17T05:50:22.952 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:22.950+0000 7ff7eb669640 1 -- 172.21.15.150:0/1494679944 shutdown_connections 2024-09-17T05:50:22.952 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:22.950+0000 7ff7eb669640 1 -- 172.21.15.150:0/1494679944 >> 172.21.15.150:0/1494679944 conn(0x7ff7e40cef30 msgr2=0x7ff7e40cf340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:50:22.952 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:22.950+0000 7ff7eb669640 1 -- 172.21.15.150:0/1494679944 shutdown_connections 2024-09-17T05:50:22.952 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:22.950+0000 7ff7eb669640 1 -- 172.21.15.150:0/1494679944 wait complete. 2024-09-17T05:50:22.953 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:22.952+0000 7ff7eb669640 1 Processor -- start 2024-09-17T05:50:22.953 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:22.952+0000 7ff7eb669640 1 -- start start 2024-09-17T05:50:22.955 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:22.953+0000 7ff7eb669640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff7d0004d40 0x7ff7e41f3ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:50:22.955 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:22.953+0000 7ff7eb669640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff7e40c7540 0x7ff7e40cb780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:50:22.955 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:22.953+0000 7ff7eb669640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff7e41d4100 0x7ff7e41d4510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:50:22.955 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:22.953+0000 7ff7eb669640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7ff7e40d15e0 con 0x7ff7e41d4100 2024-09-17T05:50:22.956 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:22.953+0000 7ff7eb669640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7ff7e40d1460 con 0x7ff7e40c7540 2024-09-17T05:50:22.956 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:22.953+0000 7ff7eb669640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7ff7e40ceb70 con 0x7ff7d0004d40 2024-09-17T05:50:22.956 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:22.954+0000 7ff7e9c06640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff7e41d4100 0x7ff7e41d4510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:50:22.956 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:22.954+0000 7ff7e9c06640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff7e41d4100 0x7ff7e41d4510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:57320/0 (socket says 172.21.15.150:57320) 2024-09-17T05:50:22.956 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:22.954+0000 7ff7e9c06640 1 -- 172.21.15.150:0/3955031450 learned_addr learned my addr 172.21.15.150:0/3955031450 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:50:22.956 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:22.954+0000 7ff7e8c04640 1 --2- 172.21.15.150:0/3955031450 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff7e40c7540 0x7ff7e40cb780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:50:22.956 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:22.954+0000 7ff7e9405640 1 --2- 172.21.15.150:0/3955031450 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff7d0004d40 0x7ff7e41f3ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:50:22.956 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:22.954+0000 7ff7e9c06640 1 -- 172.21.15.150:0/3955031450 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff7d0004d40 msgr2=0x7ff7e41f3ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:50:22.956 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:22.954+0000 7ff7e9c06640 1 --2- 172.21.15.150:0/3955031450 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff7d0004d40 0x7ff7e41f3ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:50:22.956 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:22.954+0000 7ff7e9c06640 1 -- 172.21.15.150:0/3955031450 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff7e40c7540 msgr2=0x7ff7e40cb780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:50:22.956 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:22.954+0000 7ff7e9c06640 1 --2- 172.21.15.150:0/3955031450 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff7e40c7540 0x7ff7e40cb780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:50:22.956 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:22.954+0000 7ff7e9c06640 1 -- 172.21.15.150:0/3955031450 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff7e41f4530 con 0x7ff7e41d4100 2024-09-17T05:50:22.957 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:22.954+0000 7ff7e9405640 1 --2- 172.21.15.150:0/3955031450 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff7d0004d40 0x7ff7e41f3ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:50:22.957 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:22.954+0000 7ff7e9c06640 1 --2- 172.21.15.150:0/3955031450 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff7e41d4100 0x7ff7e41d4510 secure :-1 s=READY pgs=1331 cs=0 l=1 rev1=1 crypto rx=0x7ff7dc036040 tx=0x7ff7dc034bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:50:22.957 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:22.954+0000 7ff7d9ffb640 1 -- 172.21.15.150:0/3955031450 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff7dc038040 con 0x7ff7e41d4100 2024-09-17T05:50:22.957 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:22.954+0000 7ff7d9ffb640 1 -- 172.21.15.150:0/3955031450 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff7dc02bbe0 con 0x7ff7e41d4100 2024-09-17T05:50:22.957 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:22.954+0000 7ff7eb669640 1 -- 172.21.15.150:0/3955031450 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff7e40c64a0 con 0x7ff7e41d4100 2024-09-17T05:50:22.957 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:22.954+0000 7ff7d9ffb640 1 -- 172.21.15.150:0/3955031450 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff7dc009200 con 0x7ff7e41d4100 2024-09-17T05:50:22.957 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:22.954+0000 7ff7eb669640 1 -- 172.21.15.150:0/3955031450 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff7e40c6a60 con 0x7ff7e41d4100 2024-09-17T05:50:22.958 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:22.955+0000 7ff7eb669640 1 -- 172.21.15.150:0/3955031450 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff7e40c6210 con 0x7ff7e41d4100 2024-09-17T05:50:22.958 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:22.956+0000 7ff7d9ffb640 1 -- 172.21.15.150:0/3955031450 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 32) ==== 103481+0+0 (secure 0 0 0) 0x7ff7dc044020 con 0x7ff7e41d4100 2024-09-17T05:50:22.958 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:22.957+0000 7ff7d9ffb640 1 --2- 172.21.15.150:0/3955031450 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7ff7c807a210 0x7ff7c807c720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:50:22.958 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:22.957+0000 7ff7d9ffb640 1 -- 172.21.15.150:0/3955031450 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(101..101 src has 1..101) ==== 5821+0+0 (secure 0 0 0) 0x7ff7dc0b9d10 con 0x7ff7e41d4100 2024-09-17T05:50:22.958 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:22.957+0000 7ff7e9405640 1 --2- 172.21.15.150:0/3955031450 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7ff7c807a210 0x7ff7c807c720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:50:22.958 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:22.958+0000 7ff7e9405640 1 --2- 172.21.15.150:0/3955031450 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7ff7c807a210 0x7ff7c807c720 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7ff7e0001090 tx=0x7ff7e00015e0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:50:22.962 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:22.961+0000 7ff7d9ffb640 1 -- 172.21.15.150:0/3955031450 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7ff7dc04b020 con 0x7ff7e41d4100 2024-09-17T05:50:23.136 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:23.135+0000 7ff7eb669640 1 -- 172.21.15.150:0/3955031450 --> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7ff7e40b6180 con 0x7ff7c807a210 2024-09-17T05:50:23.140 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:23.140+0000 7ff7d9ffb640 1 -- 172.21.15.150:0/3955031450 <== mgr.4108 v2:172.21.15.176:6800/3631216395 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+252259 (secure 0 0 0) 0x7ff7e40b6180 con 0x7ff7c807a210 2024-09-17T05:50:23.143 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-09-17T05:50:23.144 INFO:teuthology.orchestra.run.smithi150.stderr:dumped all 2024-09-17T05:50:23.146 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:23.143+0000 7ff7eb669640 1 -- 172.21.15.150:0/3955031450 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7ff7c807a210 msgr2=0x7ff7c807c720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:50:23.146 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:23.143+0000 7ff7eb669640 1 --2- 172.21.15.150:0/3955031450 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7ff7c807a210 0x7ff7c807c720 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7ff7e0001090 tx=0x7ff7e00015e0 comp rx=0 tx=0).stop 2024-09-17T05:50:23.146 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:23.143+0000 7ff7eb669640 1 -- 172.21.15.150:0/3955031450 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff7e41d4100 msgr2=0x7ff7e41d4510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:50:23.146 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:23.143+0000 7ff7eb669640 1 --2- 172.21.15.150:0/3955031450 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff7e41d4100 0x7ff7e41d4510 secure :-1 s=READY pgs=1331 cs=0 l=1 rev1=1 crypto rx=0x7ff7dc036040 tx=0x7ff7dc034bb0 comp rx=0 tx=0).stop 2024-09-17T05:50:23.146 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:23.143+0000 7ff7eb669640 1 -- 172.21.15.150:0/3955031450 shutdown_connections 2024-09-17T05:50:23.146 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:23.143+0000 7ff7eb669640 1 --2- 172.21.15.150:0/3955031450 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff7e40c7540 0x7ff7e40cb780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:50:23.146 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:23.143+0000 7ff7eb669640 1 --2- 172.21.15.150:0/3955031450 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7ff7c807a210 0x7ff7c807c720 unknown :-1 s=CLOSED pgs=574 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:50:23.146 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:23.143+0000 7ff7eb669640 1 --2- 172.21.15.150:0/3955031450 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff7e41d4100 0x7ff7e41d4510 unknown :-1 s=CLOSED pgs=1331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:50:23.146 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:23.143+0000 7ff7eb669640 1 --2- 172.21.15.150:0/3955031450 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff7d0004d40 0x7ff7e41f3ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:50:23.147 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:23.143+0000 7ff7eb669640 1 -- 172.21.15.150:0/3955031450 >> 172.21.15.150:0/3955031450 conn(0x7ff7e40cef30 msgr2=0x7ff7e4068e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:50:23.147 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:23.143+0000 7ff7eb669640 1 -- 172.21.15.150:0/3955031450 shutdown_connections 2024-09-17T05:50:23.147 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:23.143+0000 7ff7eb669640 1 -- 172.21.15.150:0/3955031450 wait complete. 2024-09-17T05:50:23.155 INFO:teuthology.orchestra.run.smithi150.stdout:{"pg_ready":true,"pg_map":{"version":354,"stamp":"2024-09-17T05:50:23.040077+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":146,"num_write_kb":1642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":111,"ondisk_log_size":111,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":128,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":983132,"kb_used_data":10860,"kb_used_omap":12,"kb_used_meta":972083,"kb_avail":753991588,"statfs":{"total":773094113280,"available":772087386112,"internally_reserved":0,"allocated":11120640,"data_stored":5454429,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":995413552},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":23,"apply_latency_ms":23,"commit_latency_ns":23000000,"apply_latency_ns":23000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.387121"},"pg_stats":[{"pgid":"15.3f","version":"0'0","reported_seq":10,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-17T05:50:17.692584+0000","last_change":"2024-09-17T05:50:17.688948+0000","last_active":"2024-09-17T05:50:17.692584+0000","last_peered":"2024-09-17T05:50:17.692584+0000","last_clean":"2024-09-17T05:50:17.692584+0000","last_became_active":"2024-09-17T05:50:17.688664+0000","last_became_peered":"2024-09-17T05:50:17.688664+0000","last_unstale":"2024-09-17T05:50:17.692584+0000","last_undegraded":"2024-09-17T05:50:17.692584+0000","last_fullsized":"2024-09-17T05:50:17.692584+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:50:16.649689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:50:16.649689+0000","last_clean_scrub_stamp":"2024-09-17T05:50:16.649689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:03:34.676383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.3e","version":"0'0","reported_seq":13,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-17T05:50:18.686282+0000","last_change":"2024-09-17T05:50:17.686607+0000","last_active":"2024-09-17T05:50:18.686282+0000","last_peered":"2024-09-17T05:50:18.686282+0000","last_clean":"2024-09-17T05:50:18.686282+0000","last_became_active":"2024-09-17T05:50:17.685913+0000","last_became_peered":"2024-09-17T05:50:17.685913+0000","last_unstale":"2024-09-17T05:50:18.686282+0000","last_undegraded":"2024-09-17T05:50:18.686282+0000","last_fullsized":"2024-09-17T05:50:18.686282+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:50:16.649689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:50:16.649689+0000","last_clean_scrub_stamp":"2024-09-17T05:50:16.649689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:17:42.646673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.3d","version":"0'0","reported_seq":10,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-17T05:50:17.692516+0000","last_change":"2024-09-17T05:50:17.687586+0000","last_active":"2024-09-17T05:50:17.692516+0000","last_peered":"2024-09-17T05:50:17.692516+0000","last_clean":"2024-09-17T05:50:17.692516+0000","last_became_active":"2024-09-17T05:50:17.687288+0000","last_became_peered":"2024-09-17T05:50:17.687288+0000","last_unstale":"2024-09-17T05:50:17.692516+0000","last_undegraded":"2024-09-17T05:50:17.692516+0000","last_fullsized":"2024-09-17T05:50:17.692516+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:50:16.649689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:50:16.649689+0000","last_clean_scrub_stamp":"2024-09-17T05:50:16.649689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:27:25.644171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.3c","version":"0'0","reported_seq":13,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-17T05:50:18.669867+0000","last_change":"2024-09-17T05:50:17.677226+0000","last_active":"2024-09-17T05:50:18.669867+0000","last_peered":"2024-09-17T05:50:18.669867+0000","last_clean":"2024-09-17T05:50:18.669867+0000","last_became_active":"2024-09-17T05:50:17.676607+0000","last_became_peered":"2024-09-17T05:50:17.676607+0000","last_unstale":"2024-09-17T05:50:18.669867+0000","last_undegraded":"2024-09-17T05:50:18.669867+0000","last_fullsized":"2024-09-17T05:50:18.669867+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:50:16.649689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:50:16.649689+0000","last_clean_scrub_stamp":"2024-09-17T05:50:16.649689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:19:02.355387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.3b","version":"0'0","reported_seq":10,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-17T05:50:17.692019+0000","last_change":"2024-09-17T05:50:17.686438+0000","last_active":"2024-09-17T05:50:17.692019+0000","last_peered":"2024-09-17T05:50:17.692019+0000","last_clean":"2024-09-17T05:50:17.692019+0000","last_became_active":"2024-09-17T05:50:17.686137+0000","last_became_peered":"2024-09-17T05:50:17.686137+0000","last_unstale":"2024-09-17T05:50:17.692019+0000","last_undegraded":"2024-09-17T05:50:17.692019+0000","last_fullsized":"2024-09-17T05:50:17.692019+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:50:16.649689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:50:16.649689+0000","last_clean_scrub_stamp":"2024-09-17T05:50:16.649689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:04:28.500108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.3a","version":"0'0","reported_seq":13,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-17T05:50:18.668037+0000","last_change":"2024-09-17T05:50:17.689343+0000","last_active":"2024-09-17T05:50:18.668037+0000","last_peered":"2024-09-17T05:50:18.668037+0000","last_clean":"2024-09-17T05:50:18.668037+0000","last_became_active":"2024-09-17T05:50:17.688942+0000","last_became_peered":"2024-09-17T05:50:17.688942+0000","last_unstale":"2024-09-17T05:50:18.668037+0000","last_undegraded":"2024-09-17T05:50:18.668037+0000","last_fullsized":"2024-09-17T05:50:18.668037+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:50:16.649689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:50:16.649689+0000","last_clean_scrub_stamp":"2024-09-17T05:50:16.649689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:43:41.984110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.39","version":"0'0","reported_seq":13,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-17T05:50:18.667840+0000","last_change":"2024-09-17T05:50:17.689387+0000","last_active":"2024-09-17T05:50:18.667840+0000","last_peered":"2024-09-17T05:50:18.667840+0000","last_clean":"2024-09-17T05:50:18.667840+0000","last_became_active":"2024-09-17T05:50:17.688927+0000","last_became_peered":"2024-09-17T05:50:17.688927+0000","last_unstale":"2024-09-17T05:50:18.667840+0000","last_undegraded":"2024-09-17T05:50:18.667840+0000","last_fullsized":"2024-09-17T05:50:18.667840+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:50:16.649689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:50:16.649689+0000","last_clean_scrub_stamp":"2024-09-17T05:50:16.649689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:40:34.433937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.38","version":"0'0","reported_seq":13,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-17T05:50:18.686276+0000","last_change":"2024-09-17T05:50:17.688288+0000","last_active":"2024-09-17T05:50:18.686276+0000","last_peered":"2024-09-17T05:50:18.686276+0000","last_clean":"2024-09-17T05:50:18.686276+0000","last_became_active":"2024-09-17T05:50:17.687994+0000","last_became_peered":"2024-09-17T05:50:17.687994+0000","last_unstale":"2024-09-17T05:50:18.686276+0000","last_undegraded":"2024-09-17T05:50:18.686276+0000","last_fullsized":"2024-09-17T05:50:18.686276+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:50:16.649689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:50:16.649689+0000","last_clean_scrub_stamp":"2024-09-17T05:50:16.649689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:34:26.313722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.37","version":"0'0","reported_seq":13,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-17T05:50:18.668463+0000","last_change":"2024-09-17T05:50:17.674445+0000","last_active":"2024-09-17T05:50:18.668463+0000","last_peered":"2024-09-17T05:50:18.668463+0000","last_clean":"2024-09-17T05:50:18.668463+0000","last_became_active":"2024-09-17T05:50:17.674111+0000","last_became_peered":"2024-09-17T05:50:17.674111+0000","last_unstale":"2024-09-17T05:50:18.668463+0000","last_undegraded":"2024-09-17T05:50:18.668463+0000","last_fullsized":"2024-09-17T05:50:18.668463+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:50:16.649689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:50:16.649689+0000","last_clean_scrub_stamp":"2024-09-17T05:50:16.649689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:02:39.895120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.36","version":"0'0","reported_seq":10,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-17T05:50:17.694249+0000","last_change":"2024-09-17T05:50:17.691032+0000","last_active":"2024-09-17T05:50:17.694249+0000","last_peered":"2024-09-17T05:50:17.694249+0000","last_clean":"2024-09-17T05:50:17.694249+0000","last_became_active":"2024-09-17T05:50:17.687974+0000","last_became_peered":"2024-09-17T05:50:17.687974+0000","last_unstale":"2024-09-17T05:50:17.694249+0000","last_undegraded":"2024-09-17T05:50:17.694249+0000","last_fullsized":"2024-09-17T05:50:17.694249+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:50:16.649689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:50:16.649689+0000","last_clean_scrub_stamp":"2024-09-17T05:50:16.649689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:21:42.242980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.35","version":"0'0","reported_seq":13,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-17T05:50:18.668324+0000","last_change":"2024-09-17T05:50:17.691868+0000","last_active":"2024-09-17T05:50:18.668324+0000","last_peered":"2024-09-17T05:50:18.668324+0000","last_clean":"2024-09-17T05:50:18.668324+0000","last_became_active":"2024-09-17T05:50:17.691541+0000","last_became_peered":"2024-09-17T05:50:17.691541+0000","last_unstale":"2024-09-17T05:50:18.668324+0000","last_undegraded":"2024-09-17T05:50:18.668324+0000","last_fullsized":"2024-09-17T05:50:18.668324+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:50:16.649689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:50:16.649689+0000","last_clean_scrub_stamp":"2024-09-17T05:50:16.649689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:30:55.806738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.34","version":"0'0","reported_seq":13,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-17T05:50:18.668820+0000","last_change":"2024-09-17T05:50:17.683887+0000","last_active":"2024-09-17T05:50:18.668820+0000","last_peered":"2024-09-17T05:50:18.668820+0000","last_clean":"2024-09-17T05:50:18.668820+0000","last_became_active":"2024-09-17T05:50:17.683522+0000","last_became_peered":"2024-09-17T05:50:17.683522+0000","last_unstale":"2024-09-17T05:50:18.668820+0000","last_undegraded":"2024-09-17T05:50:18.668820+0000","last_fullsized":"2024-09-17T05:50:18.668820+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:50:16.649689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:50:16.649689+0000","last_clean_scrub_stamp":"2024-09-17T05:50:16.649689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:00:55.730379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.33","version":"0'0","reported_seq":13,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-17T05:50:18.669824+0000","last_change":"2024-09-17T05:50:17.674595+0000","last_active":"2024-09-17T05:50:18.669824+0000","last_peered":"2024-09-17T05:50:18.669824+0000","last_clean":"2024-09-17T05:50:18.669824+0000","last_became_active":"2024-09-17T05:50:17.674286+0000","last_became_peered":"2024-09-17T05:50:17.674286+0000","last_unstale":"2024-09-17T05:50:18.669824+0000","last_undegraded":"2024-09-17T05:50:18.669824+0000","last_fullsized":"2024-09-17T05:50:18.669824+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:50:16.649689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:50:16.649689+0000","last_clean_scrub_stamp":"2024-09-17T05:50:16.649689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:06:12.173802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.32","version":"0'0","reported_seq":10,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-17T05:50:17.699073+0000","last_change":"2024-09-17T05:50:17.693635+0000","last_active":"2024-09-17T05:50:17.699073+0000","last_peered":"2024-09-17T05:50:17.699073+0000","last_clean":"2024-09-17T05:50:17.699073+0000","last_became_active":"2024-09-17T05:50:17.693172+0000","last_became_peered":"2024-09-17T05:50:17.693172+0000","last_unstale":"2024-09-17T05:50:17.699073+0000","last_undegraded":"2024-09-17T05:50:17.699073+0000","last_fullsized":"2024-09-17T05:50:17.699073+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:50:16.649689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:50:16.649689+0000","last_clean_scrub_stamp":"2024-09-17T05:50:16.649689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:03:31.990762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.31","version":"0'0","reported_seq":13,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-17T05:50:18.669356+0000","last_change":"2024-09-17T05:50:17.681216+0000","last_active":"2024-09-17T05:50:18.669356+0000","last_peered":"2024-09-17T05:50:18.669356+0000","last_clean":"2024-09-17T05:50:18.669356+0000","last_became_active":"2024-09-17T05:50:17.680783+0000","last_became_peered":"2024-09-17T05:50:17.680783+0000","last_unstale":"2024-09-17T05:50:18.669356+0000","last_undegraded":"2024-09-17T05:50:18.669356+0000","last_fullsized":"2024-09-17T05:50:18.669356+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:50:16.649689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:50:16.649689+0000","last_clean_scrub_stamp":"2024-09-17T05:50:16.649689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:35:47.320102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.30","version":"0'0","reported_seq":13,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-17T05:50:18.668532+0000","last_change":"2024-09-17T05:50:17.699799+0000","last_active":"2024-09-17T05:50:18.668532+0000","last_peered":"2024-09-17T05:50:18.668532+0000","last_clean":"2024-09-17T05:50:18.668532+0000","last_became_active":"2024-09-17T05:50:17.699453+0000","last_became_peered":"2024-09-17T05:50:17.699453+0000","last_unstale":"2024-09-17T05:50:18.668532+0000","last_undegraded":"2024-09-17T05:50:18.668532+0000","last_fullsized":"2024-09-17T05:50:18.668532+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:50:16.649689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:50:16.649689+0000","last_clean_scrub_stamp":"2024-09-17T05:50:16.649689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:27:07.848162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.2f","version":"0'0","reported_seq":13,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-17T05:50:18.686505+0000","last_change":"2024-09-17T05:50:17.686002+0000","last_active":"2024-09-17T05:50:18.686505+0000","last_peered":"2024-09-17T05:50:18.686505+0000","last_clean":"2024-09-17T05:50:18.686505+0000","last_became_active":"2024-09-17T05:50:17.685687+0000","last_became_peered":"2024-09-17T05:50:17.685687+0000","last_unstale":"2024-09-17T05:50:18.686505+0000","last_undegraded":"2024-09-17T05:50:18.686505+0000","last_fullsized":"2024-09-17T05:50:18.686505+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:50:16.649689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:50:16.649689+0000","last_clean_scrub_stamp":"2024-09-17T05:50:16.649689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:46:40.056183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.2e","version":"0'0","reported_seq":13,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-17T05:50:18.669583+0000","last_change":"2024-09-17T05:50:17.676677+0000","last_active":"2024-09-17T05:50:18.669583+0000","last_peered":"2024-09-17T05:50:18.669583+0000","last_clean":"2024-09-17T05:50:18.669583+0000","last_became_active":"2024-09-17T05:50:17.676390+0000","last_became_peered":"2024-09-17T05:50:17.676390+0000","last_unstale":"2024-09-17T05:50:18.669583+0000","last_undegraded":"2024-09-17T05:50:18.669583+0000","last_fullsized":"2024-09-17T05:50:18.669583+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:50:16.649689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:50:16.649689+0000","last_clean_scrub_stamp":"2024-09-17T05:50:16.649689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:39:12.094673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.2d","version":"0'0","reported_seq":10,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-17T05:50:17.692165+0000","last_change":"2024-09-17T05:50:17.689114+0000","last_active":"2024-09-17T05:50:17.692165+0000","last_peered":"2024-09-17T05:50:17.692165+0000","last_clean":"2024-09-17T05:50:17.692165+0000","last_became_active":"2024-09-17T05:50:17.688766+0000","last_became_peered":"2024-09-17T05:50:17.688766+0000","last_unstale":"2024-09-17T05:50:17.692165+0000","last_undegraded":"2024-09-17T05:50:17.692165+0000","last_fullsized":"2024-09-17T05:50:17.692165+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:50:16.649689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:50:16.649689+0000","last_clean_scrub_stamp":"2024-09-17T05:50:16.649689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:56:51.160610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.2c","version":"0'0","reported_seq":13,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-17T05:50:18.669240+0000","last_change":"2024-09-17T05:50:17.674138+0000","last_active":"2024-09-17T05:50:18.669240+0000","last_peered":"2024-09-17T05:50:18.669240+0000","last_clean":"2024-09-17T05:50:18.669240+0000","last_became_active":"2024-09-17T05:50:17.673792+0000","last_became_peered":"2024-09-17T05:50:17.673792+0000","last_unstale":"2024-09-17T05:50:18.669240+0000","last_undegraded":"2024-09-17T05:50:18.669240+0000","last_fullsized":"2024-09-17T05:50:18.669240+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:50:16.649689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:50:16.649689+0000","last_clean_scrub_stamp":"2024-09-17T05:50:16.649689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:00:15.548614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.2b","version":"0'0","reported_seq":10,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-17T05:50:17.685753+0000","last_change":"2024-09-17T05:50:17.679256+0000","last_active":"2024-09-17T05:50:17.685753+0000","last_peered":"2024-09-17T05:50:17.685753+0000","last_clean":"2024-09-17T05:50:17.685753+0000","last_became_active":"2024-09-17T05:50:17.678923+0000","last_became_peered":"2024-09-17T05:50:17.678923+0000","last_unstale":"2024-09-17T05:50:17.685753+0000","last_undegraded":"2024-09-17T05:50:17.685753+0000","last_fullsized":"2024-09-17T05:50:17.685753+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:50:16.649689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:50:16.649689+0000","last_clean_scrub_stamp":"2024-09-17T05:50:16.649689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:28:08.714137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.2a","version":"0'0","reported_seq":13,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-17T05:50:18.686175+0000","last_change":"2024-09-17T05:50:17.687586+0000","last_active":"2024-09-17T05:50:18.686175+0000","last_peered":"2024-09-17T05:50:18.686175+0000","last_clean":"2024-09-17T05:50:18.686175+0000","last_became_active":"2024-09-17T05:50:17.687286+0000","last_became_peered":"2024-09-17T05:50:17.687286+0000","last_unstale":"2024-09-17T05:50:18.686175+0000","last_undegraded":"2024-09-17T05:50:18.686175+0000","last_fullsized":"2024-09-17T05:50:18.686175+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:50:16.649689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:50:16.649689+0000","last_clean_scrub_stamp":"2024-09-17T05:50:16.649689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:02:00.945244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.29","version":"0'0","reported_seq":13,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-17T05:50:18.686290+0000","last_change":"2024-09-17T05:50:17.688190+0000","last_active":"2024-09-17T05:50:18.686290+0000","last_peered":"2024-09-17T05:50:18.686290+0000","last_clean":"2024-09-17T05:50:18.686290+0000","last_became_active":"2024-09-17T05:50:17.687362+0000","last_became_peered":"2024-09-17T05:50:17.687362+0000","last_unstale":"2024-09-17T05:50:18.686290+0000","last_undegraded":"2024-09-17T05:50:18.686290+0000","last_fullsized":"2024-09-17T05:50:18.686290+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:50:16.649689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:50:16.649689+0000","last_clean_scrub_stamp":"2024-09-17T05:50:16.649689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:41:16.543702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.28","version":"0'0","reported_seq":13,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-17T05:50:18.668665+0000","last_change":"2024-09-17T05:50:17.689555+0000","last_active":"2024-09-17T05:50:18.668665+0000","last_peered":"2024-09-17T05:50:18.668665+0000","last_clean":"2024-09-17T05:50:18.668665+0000","last_became_active":"2024-09-17T05:50:17.689175+0000","last_became_peered":"2024-09-17T05:50:17.689175+0000","last_unstale":"2024-09-17T05:50:18.668665+0000","last_undegraded":"2024-09-17T05:50:18.668665+0000","last_fullsized":"2024-09-17T05:50:18.668665+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:50:16.649689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:50:16.649689+0000","last_clean_scrub_stamp":"2024-09-17T05:50:16.649689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:26:34.724420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.27","version":"0'0","reported_seq":10,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-17T05:50:17.702466+0000","last_change":"2024-09-17T05:50:17.701876+0000","last_active":"2024-09-17T05:50:17.702466+0000","last_peered":"2024-09-17T05:50:17.702466+0000","last_clean":"2024-09-17T05:50:17.702466+0000","last_became_active":"2024-09-17T05:50:17.701586+0000","last_became_peered":"2024-09-17T05:50:17.701586+0000","last_unstale":"2024-09-17T05:50:17.702466+0000","last_undegraded":"2024-09-17T05:50:17.702466+0000","last_fullsized":"2024-09-17T05:50:17.702466+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:50:16.649689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:50:16.649689+0000","last_clean_scrub_stamp":"2024-09-17T05:50:16.649689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:16:56.091340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.26","version":"0'0","reported_seq":13,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-17T05:50:18.686526+0000","last_change":"2024-09-17T05:50:17.689166+0000","last_active":"2024-09-17T05:50:18.686526+0000","last_peered":"2024-09-17T05:50:18.686526+0000","last_clean":"2024-09-17T05:50:18.686526+0000","last_became_active":"2024-09-17T05:50:17.688880+0000","last_became_peered":"2024-09-17T05:50:17.688880+0000","last_unstale":"2024-09-17T05:50:18.686526+0000","last_undegraded":"2024-09-17T05:50:18.686526+0000","last_fullsized":"2024-09-17T05:50:18.686526+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:50:16.649689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:50:16.649689+0000","last_clean_scrub_stamp":"2024-09-17T05:50:16.649689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:23:08.770975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.25","version":"0'0","reported_seq":13,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-17T05:50:18.669057+0000","last_change":"2024-09-17T05:50:17.690690+0000","last_active":"2024-09-17T05:50:18.669057+0000","last_peered":"2024-09-17T05:50:18.669057+0000","last_clean":"2024-09-17T05:50:18.669057+0000","last_became_active":"2024-09-17T05:50:17.690283+0000","last_became_peered":"2024-09-17T05:50:17.690283+0000","last_unstale":"2024-09-17T05:50:18.669057+0000","last_undegraded":"2024-09-17T05:50:18.669057+0000","last_fullsized":"2024-09-17T05:50:18.669057+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:50:16.649689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:50:16.649689+0000","last_clean_scrub_stamp":"2024-09-17T05:50:16.649689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:05:53.683352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.24","version":"0'0","reported_seq":10,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-17T05:50:17.692366+0000","last_change":"2024-09-17T05:50:17.686896+0000","last_active":"2024-09-17T05:50:17.692366+0000","last_peered":"2024-09-17T05:50:17.692366+0000","last_clean":"2024-09-17T05:50:17.692366+0000","last_became_active":"2024-09-17T05:50:17.686613+0000","last_became_peered":"2024-09-17T05:50:17.686613+0000","last_unstale":"2024-09-17T05:50:17.692366+0000","last_undegraded":"2024-09-17T05:50:17.692366+0000","last_fullsized":"2024-09-17T05:50:17.692366+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:50:16.649689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:50:16.649689+0000","last_clean_scrub_stamp":"2024-09-17T05:50:16.649689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:53:41.317085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.23","version":"0'0","reported_seq":13,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-17T05:50:18.686333+0000","last_change":"2024-09-17T05:50:17.693673+0000","last_active":"2024-09-17T05:50:18.686333+0000","last_peered":"2024-09-17T05:50:18.686333+0000","last_clean":"2024-09-17T05:50:18.686333+0000","last_became_active":"2024-09-17T05:50:17.693131+0000","last_became_peered":"2024-09-17T05:50:17.693131+0000","last_unstale":"2024-09-17T05:50:18.686333+0000","last_undegraded":"2024-09-17T05:50:18.686333+0000","last_fullsized":"2024-09-17T05:50:18.686333+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:50:16.649689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:50:16.649689+0000","last_clean_scrub_stamp":"2024-09-17T05:50:16.649689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:31:33.444956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.22","version":"0'0","reported_seq":10,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-17T05:50:17.698202+0000","last_change":"2024-09-17T05:50:17.691649+0000","last_active":"2024-09-17T05:50:17.698202+0000","last_peered":"2024-09-17T05:50:17.698202+0000","last_clean":"2024-09-17T05:50:17.698202+0000","last_became_active":"2024-09-17T05:50:17.691303+0000","last_became_peered":"2024-09-17T05:50:17.691303+0000","last_unstale":"2024-09-17T05:50:17.698202+0000","last_undegraded":"2024-09-17T05:50:17.698202+0000","last_fullsized":"2024-09-17T05:50:17.698202+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:50:16.649689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:50:16.649689+0000","last_clean_scrub_stamp":"2024-09-17T05:50:16.649689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:30:18.752029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.21","version":"0'0","reported_seq":13,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-17T05:50:18.669595+0000","last_change":"2024-09-17T05:50:17.686575+0000","last_active":"2024-09-17T05:50:18.669595+0000","last_peered":"2024-09-17T05:50:18.669595+0000","last_clean":"2024-09-17T05:50:18.669595+0000","last_became_active":"2024-09-17T05:50:17.684031+0000","last_became_peered":"2024-09-17T05:50:17.684031+0000","last_unstale":"2024-09-17T05:50:18.669595+0000","last_undegraded":"2024-09-17T05:50:18.669595+0000","last_fullsized":"2024-09-17T05:50:18.669595+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:50:16.649689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:50:16.649689+0000","last_clean_scrub_stamp":"2024-09-17T05:50:16.649689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:22:37.891115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.20","version":"0'0","reported_seq":10,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-17T05:50:17.698484+0000","last_change":"2024-09-17T05:50:17.690605+0000","last_active":"2024-09-17T05:50:17.698484+0000","last_peered":"2024-09-17T05:50:17.698484+0000","last_clean":"2024-09-17T05:50:17.698484+0000","last_became_active":"2024-09-17T05:50:17.690127+0000","last_became_peered":"2024-09-17T05:50:17.690127+0000","last_unstale":"2024-09-17T05:50:17.698484+0000","last_undegraded":"2024-09-17T05:50:17.698484+0000","last_fullsized":"2024-09-17T05:50:17.698484+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:50:16.649689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:50:16.649689+0000","last_clean_scrub_stamp":"2024-09-17T05:50:16.649689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:27:10.964544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.1e","version":"0'0","reported_seq":10,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-17T05:50:17.683922+0000","last_change":"2024-09-17T05:50:17.678131+0000","last_active":"2024-09-17T05:50:17.683922+0000","last_peered":"2024-09-17T05:50:17.683922+0000","last_clean":"2024-09-17T05:50:17.683922+0000","last_became_active":"2024-09-17T05:50:17.677816+0000","last_became_peered":"2024-09-17T05:50:17.677816+0000","last_unstale":"2024-09-17T05:50:17.683922+0000","last_undegraded":"2024-09-17T05:50:17.683922+0000","last_fullsized":"2024-09-17T05:50:17.683922+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:50:16.649689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:50:16.649689+0000","last_clean_scrub_stamp":"2024-09-17T05:50:16.649689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:55:41.145153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.1f","version":"100'4","reported_seq":19,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-17T05:50:18.686498+0000","last_change":"2024-09-17T05:50:16.666928+0000","last_active":"2024-09-17T05:50:18.686498+0000","last_peered":"2024-09-17T05:50:18.686498+0000","last_clean":"2024-09-17T05:50:18.686498+0000","last_became_active":"2024-09-17T05:50:16.666550+0000","last_became_peered":"2024-09-17T05:50:16.666550+0000","last_unstale":"2024-09-17T05:50:18.686498+0000","last_undegraded":"2024-09-17T05:50:18.686498+0000","last_fullsized":"2024-09-17T05:50:18.686498+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:50:15.639879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:50:15.639879+0000","last_clean_scrub_stamp":"2024-09-17T05:50:15.639879+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:57:05.869839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1f","version":"0'0","reported_seq":13,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-17T05:50:18.669960+0000","last_change":"2024-09-17T05:50:17.684448+0000","last_active":"2024-09-17T05:50:18.669960+0000","last_peered":"2024-09-17T05:50:18.669960+0000","last_clean":"2024-09-17T05:50:18.669960+0000","last_became_active":"2024-09-17T05:50:17.684014+0000","last_became_peered":"2024-09-17T05:50:17.684014+0000","last_unstale":"2024-09-17T05:50:18.669960+0000","last_undegraded":"2024-09-17T05:50:18.669960+0000","last_fullsized":"2024-09-17T05:50:18.669960+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:50:16.649689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:50:16.649689+0000","last_clean_scrub_stamp":"2024-09-17T05:50:16.649689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:16:14.602391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.1e","version":"100'1","reported_seq":16,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-17T05:50:18.668133+0000","last_change":"2024-09-17T05:50:16.676369+0000","last_active":"2024-09-17T05:50:18.668133+0000","last_peered":"2024-09-17T05:50:18.668133+0000","last_clean":"2024-09-17T05:50:18.668133+0000","last_became_active":"2024-09-17T05:50:16.676073+0000","last_became_peered":"2024-09-17T05:50:16.676073+0000","last_unstale":"2024-09-17T05:50:18.668133+0000","last_undegraded":"2024-09-17T05:50:18.668133+0000","last_fullsized":"2024-09-17T05:50:18.668133+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:50:15.639879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:50:15.639879+0000","last_clean_scrub_stamp":"2024-09-17T05:50:15.639879+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:32:00.453681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.1c","version":"0'0","reported_seq":10,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-17T05:50:17.689800+0000","last_change":"2024-09-17T05:50:17.686482+0000","last_active":"2024-09-17T05:50:17.689800+0000","last_peered":"2024-09-17T05:50:17.689800+0000","last_clean":"2024-09-17T05:50:17.689800+0000","last_became_active":"2024-09-17T05:50:17.685224+0000","last_became_peered":"2024-09-17T05:50:17.685224+0000","last_unstale":"2024-09-17T05:50:17.689800+0000","last_undegraded":"2024-09-17T05:50:17.689800+0000","last_fullsized":"2024-09-17T05:50:17.689800+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:50:16.649689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:50:16.649689+0000","last_clean_scrub_stamp":"2024-09-17T05:50:16.649689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:43:04.212537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.1d","version":"100'2","reported_seq":17,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-17T05:50:18.686557+0000","last_change":"2024-09-17T05:50:16.678328+0000","last_active":"2024-09-17T05:50:18.686557+0000","last_peered":"2024-09-17T05:50:18.686557+0000","last_clean":"2024-09-17T05:50:18.686557+0000","last_became_active":"2024-09-17T05:50:16.677911+0000","last_became_peered":"2024-09-17T05:50:16.677911+0000","last_unstale":"2024-09-17T05:50:18.686557+0000","last_undegraded":"2024-09-17T05:50:18.686557+0000","last_fullsized":"2024-09-17T05:50:18.686557+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:50:15.639879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:50:15.639879+0000","last_clean_scrub_stamp":"2024-09-17T05:50:15.639879+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:12:56.944695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1d","version":"0'0","reported_seq":13,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-17T05:50:18.669395+0000","last_change":"2024-09-17T05:50:17.681462+0000","last_active":"2024-09-17T05:50:18.669395+0000","last_peered":"2024-09-17T05:50:18.669395+0000","last_clean":"2024-09-17T05:50:18.669395+0000","last_became_active":"2024-09-17T05:50:17.681107+0000","last_became_peered":"2024-09-17T05:50:17.681107+0000","last_unstale":"2024-09-17T05:50:18.669395+0000","last_undegraded":"2024-09-17T05:50:18.669395+0000","last_fullsized":"2024-09-17T05:50:18.669395+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:50:16.649689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:50:16.649689+0000","last_clean_scrub_stamp":"2024-09-17T05:50:16.649689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:54:44.529271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.1c","version":"100'2","reported_seq":17,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-17T05:50:18.686501+0000","last_change":"2024-09-17T05:50:16.677342+0000","last_active":"2024-09-17T05:50:18.686501+0000","last_peered":"2024-09-17T05:50:18.686501+0000","last_clean":"2024-09-17T05:50:18.686501+0000","last_became_active":"2024-09-17T05:50:16.674956+0000","last_became_peered":"2024-09-17T05:50:16.674956+0000","last_unstale":"2024-09-17T05:50:18.686501+0000","last_undegraded":"2024-09-17T05:50:18.686501+0000","last_fullsized":"2024-09-17T05:50:18.686501+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:50:15.639879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:50:15.639879+0000","last_clean_scrub_stamp":"2024-09-17T05:50:15.639879+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:36:51.832130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1a","version":"0'0","reported_seq":13,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-17T05:50:19.312949+0000","last_change":"2024-09-17T05:50:17.686834+0000","last_active":"2024-09-17T05:50:19.312949+0000","last_peered":"2024-09-17T05:50:19.312949+0000","last_clean":"2024-09-17T05:50:19.312949+0000","last_became_active":"2024-09-17T05:50:17.686443+0000","last_became_peered":"2024-09-17T05:50:17.686443+0000","last_unstale":"2024-09-17T05:50:19.312949+0000","last_undegraded":"2024-09-17T05:50:19.312949+0000","last_fullsized":"2024-09-17T05:50:19.312949+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:50:16.649689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:50:16.649689+0000","last_clean_scrub_stamp":"2024-09-17T05:50:16.649689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:01:44.594734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.1b","version":"100'1","reported_seq":14,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-17T05:50:17.699861+0000","last_change":"2024-09-17T05:50:16.671491+0000","last_active":"2024-09-17T05:50:17.699861+0000","last_peered":"2024-09-17T05:50:17.699861+0000","last_clean":"2024-09-17T05:50:17.699861+0000","last_became_active":"2024-09-17T05:50:16.671150+0000","last_became_peered":"2024-09-17T05:50:16.671150+0000","last_unstale":"2024-09-17T05:50:17.699861+0000","last_undegraded":"2024-09-17T05:50:17.699861+0000","last_fullsized":"2024-09-17T05:50:17.699861+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:50:15.639879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:50:15.639879+0000","last_clean_scrub_stamp":"2024-09-17T05:50:15.639879+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:56:38.653716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.1b","version":"0'0","reported_seq":13,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-17T05:50:18.667880+0000","last_change":"2024-09-17T05:50:17.685341+0000","last_active":"2024-09-17T05:50:18.667880+0000","last_peered":"2024-09-17T05:50:18.667880+0000","last_clean":"2024-09-17T05:50:18.667880+0000","last_became_active":"2024-09-17T05:50:17.685003+0000","last_became_peered":"2024-09-17T05:50:17.685003+0000","last_unstale":"2024-09-17T05:50:18.667880+0000","last_undegraded":"2024-09-17T05:50:18.667880+0000","last_fullsized":"2024-09-17T05:50:18.667880+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:50:16.649689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:50:16.649689+0000","last_clean_scrub_stamp":"2024-09-17T05:50:16.649689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:14:12.968153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.1a","version":"100'1","reported_seq":16,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-17T05:50:18.686071+0000","last_change":"2024-09-17T05:50:16.673854+0000","last_active":"2024-09-17T05:50:18.686071+0000","last_peered":"2024-09-17T05:50:18.686071+0000","last_clean":"2024-09-17T05:50:18.686071+0000","last_became_active":"2024-09-17T05:50:16.673522+0000","last_became_peered":"2024-09-17T05:50:16.673522+0000","last_unstale":"2024-09-17T05:50:18.686071+0000","last_undegraded":"2024-09-17T05:50:18.686071+0000","last_fullsized":"2024-09-17T05:50:18.686071+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:50:15.639879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:50:15.639879+0000","last_clean_scrub_stamp":"2024-09-17T05:50:15.639879+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:05:57.341308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.18","version":"0'0","reported_seq":13,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-17T05:50:18.669407+0000","last_change":"2024-09-17T05:50:17.684654+0000","last_active":"2024-09-17T05:50:18.669407+0000","last_peered":"2024-09-17T05:50:18.669407+0000","last_clean":"2024-09-17T05:50:18.669407+0000","last_became_active":"2024-09-17T05:50:17.684313+0000","last_became_peered":"2024-09-17T05:50:17.684313+0000","last_unstale":"2024-09-17T05:50:18.669407+0000","last_undegraded":"2024-09-17T05:50:18.669407+0000","last_fullsized":"2024-09-17T05:50:18.669407+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:50:16.649689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:50:16.649689+0000","last_clean_scrub_stamp":"2024-09-17T05:50:16.649689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:55:45.553826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.19","version":"0'0","reported_seq":13,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-17T05:50:17.680947+0000","last_change":"2024-09-17T05:50:16.674238+0000","last_active":"2024-09-17T05:50:17.680947+0000","last_peered":"2024-09-17T05:50:17.680947+0000","last_clean":"2024-09-17T05:50:17.680947+0000","last_became_active":"2024-09-17T05:50:16.673875+0000","last_became_peered":"2024-09-17T05:50:16.673875+0000","last_unstale":"2024-09-17T05:50:17.680947+0000","last_undegraded":"2024-09-17T05:50:17.680947+0000","last_fullsized":"2024-09-17T05:50:17.680947+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:50:15.639879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:50:15.639879+0000","last_clean_scrub_stamp":"2024-09-17T05:50:15.639879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:01:35.637247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.19","version":"0'0","reported_seq":13,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-17T05:50:18.668463+0000","last_change":"2024-09-17T05:50:17.680474+0000","last_active":"2024-09-17T05:50:18.668463+0000","last_peered":"2024-09-17T05:50:18.668463+0000","last_clean":"2024-09-17T05:50:18.668463+0000","last_became_active":"2024-09-17T05:50:17.680154+0000","last_became_peered":"2024-09-17T05:50:17.680154+0000","last_unstale":"2024-09-17T05:50:18.668463+0000","last_undegraded":"2024-09-17T05:50:18.668463+0000","last_fullsized":"2024-09-17T05:50:18.668463+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:50:16.649689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:50:16.649689+0000","last_clean_scrub_stamp":"2024-09-17T05:50:16.649689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:39:58.578693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.18","version":"0'0","reported_seq":13,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-17T05:50:17.675065+0000","last_change":"2024-09-17T05:50:16.672581+0000","last_active":"2024-09-17T05:50:17.675065+0000","last_peered":"2024-09-17T05:50:17.675065+0000","last_clean":"2024-09-17T05:50:17.675065+0000","last_became_active":"2024-09-17T05:50:16.671816+0000","last_became_peered":"2024-09-17T05:50:16.671816+0000","last_unstale":"2024-09-17T05:50:17.675065+0000","last_undegraded":"2024-09-17T05:50:17.675065+0000","last_fullsized":"2024-09-17T05:50:17.675065+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:50:15.639879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:50:15.639879+0000","last_clean_scrub_stamp":"2024-09-17T05:50:15.639879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:38:42.681739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.16","version":"0'0","reported_seq":13,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-17T05:50:18.686665+0000","last_change":"2024-09-17T05:50:17.686260+0000","last_active":"2024-09-17T05:50:18.686665+0000","last_peered":"2024-09-17T05:50:18.686665+0000","last_clean":"2024-09-17T05:50:18.686665+0000","last_became_active":"2024-09-17T05:50:17.685507+0000","last_became_peered":"2024-09-17T05:50:17.685507+0000","last_unstale":"2024-09-17T05:50:18.686665+0000","last_undegraded":"2024-09-17T05:50:18.686665+0000","last_fullsized":"2024-09-17T05:50:18.686665+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:50:16.649689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:50:16.649689+0000","last_clean_scrub_stamp":"2024-09-17T05:50:16.649689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:46:25.261334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.17","version":"0'0","reported_seq":13,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-17T05:50:17.676384+0000","last_change":"2024-09-17T05:50:16.666782+0000","last_active":"2024-09-17T05:50:17.676384+0000","last_peered":"2024-09-17T05:50:17.676384+0000","last_clean":"2024-09-17T05:50:17.676384+0000","last_became_active":"2024-09-17T05:50:16.666353+0000","last_became_peered":"2024-09-17T05:50:16.666353+0000","last_unstale":"2024-09-17T05:50:17.676384+0000","last_undegraded":"2024-09-17T05:50:17.676384+0000","last_fullsized":"2024-09-17T05:50:17.676384+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:50:15.639879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:50:15.639879+0000","last_clean_scrub_stamp":"2024-09-17T05:50:15.639879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:08:52.158143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.17","version":"0'0","reported_seq":13,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-17T05:50:18.668700+0000","last_change":"2024-09-17T05:50:17.689619+0000","last_active":"2024-09-17T05:50:18.668700+0000","last_peered":"2024-09-17T05:50:18.668700+0000","last_clean":"2024-09-17T05:50:18.668700+0000","last_became_active":"2024-09-17T05:50:17.689296+0000","last_became_peered":"2024-09-17T05:50:17.689296+0000","last_unstale":"2024-09-17T05:50:18.668700+0000","last_undegraded":"2024-09-17T05:50:18.668700+0000","last_fullsized":"2024-09-17T05:50:18.668700+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:50:16.649689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:50:16.649689+0000","last_clean_scrub_stamp":"2024-09-17T05:50:16.649689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:18:36.889653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.16","version":"0'0","reported_seq":15,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-17T05:50:18.669543+0000","last_change":"2024-09-17T05:50:16.666739+0000","last_active":"2024-09-17T05:50:18.669543+0000","last_peered":"2024-09-17T05:50:18.669543+0000","last_clean":"2024-09-17T05:50:18.669543+0000","last_became_active":"2024-09-17T05:50:16.666351+0000","last_became_peered":"2024-09-17T05:50:16.666351+0000","last_unstale":"2024-09-17T05:50:18.669543+0000","last_undegraded":"2024-09-17T05:50:18.669543+0000","last_fullsized":"2024-09-17T05:50:18.669543+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:50:15.639879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:50:15.639879+0000","last_clean_scrub_stamp":"2024-09-17T05:50:15.639879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:02:39.092792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.14","version":"0'0","reported_seq":10,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-17T05:50:17.701434+0000","last_change":"2024-09-17T05:50:17.700910+0000","last_active":"2024-09-17T05:50:17.701434+0000","last_peered":"2024-09-17T05:50:17.701434+0000","last_clean":"2024-09-17T05:50:17.701434+0000","last_became_active":"2024-09-17T05:50:17.700244+0000","last_became_peered":"2024-09-17T05:50:17.700244+0000","last_unstale":"2024-09-17T05:50:17.701434+0000","last_undegraded":"2024-09-17T05:50:17.701434+0000","last_fullsized":"2024-09-17T05:50:17.701434+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:50:16.649689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:50:16.649689+0000","last_clean_scrub_stamp":"2024-09-17T05:50:16.649689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:52:27.459055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.15","version":"100'3","reported_seq":18,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-17T05:50:18.669519+0000","last_change":"2024-09-17T05:50:16.673400+0000","last_active":"2024-09-17T05:50:18.669519+0000","last_peered":"2024-09-17T05:50:18.669519+0000","last_clean":"2024-09-17T05:50:18.669519+0000","last_became_active":"2024-09-17T05:50:16.673068+0000","last_became_peered":"2024-09-17T05:50:16.673068+0000","last_unstale":"2024-09-17T05:50:18.669519+0000","last_undegraded":"2024-09-17T05:50:18.669519+0000","last_fullsized":"2024-09-17T05:50:18.669519+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:50:15.639879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:50:15.639879+0000","last_clean_scrub_stamp":"2024-09-17T05:50:15.639879+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:17:06.188308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.15","version":"0'0","reported_seq":13,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-17T05:50:18.669125+0000","last_change":"2024-09-17T05:50:17.700722+0000","last_active":"2024-09-17T05:50:18.669125+0000","last_peered":"2024-09-17T05:50:18.669125+0000","last_clean":"2024-09-17T05:50:18.669125+0000","last_became_active":"2024-09-17T05:50:17.699976+0000","last_became_peered":"2024-09-17T05:50:17.699976+0000","last_unstale":"2024-09-17T05:50:18.669125+0000","last_undegraded":"2024-09-17T05:50:18.669125+0000","last_fullsized":"2024-09-17T05:50:18.669125+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:50:16.649689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:50:16.649689+0000","last_clean_scrub_stamp":"2024-09-17T05:50:16.649689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:04:24.869963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.14","version":"100'6","reported_seq":21,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-17T05:50:18.668998+0000","last_change":"2024-09-17T05:50:16.663464+0000","last_active":"2024-09-17T05:50:18.668998+0000","last_peered":"2024-09-17T05:50:18.668998+0000","last_clean":"2024-09-17T05:50:18.668998+0000","last_became_active":"2024-09-17T05:50:16.663147+0000","last_became_peered":"2024-09-17T05:50:16.663147+0000","last_unstale":"2024-09-17T05:50:18.668998+0000","last_undegraded":"2024-09-17T05:50:18.668998+0000","last_fullsized":"2024-09-17T05:50:18.668998+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:50:15.639879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:50:15.639879+0000","last_clean_scrub_stamp":"2024-09-17T05:50:15.639879+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:12:46.562781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.12","version":"0'0","reported_seq":13,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-17T05:50:18.669692+0000","last_change":"2024-09-17T05:50:17.678910+0000","last_active":"2024-09-17T05:50:18.669692+0000","last_peered":"2024-09-17T05:50:18.669692+0000","last_clean":"2024-09-17T05:50:18.669692+0000","last_became_active":"2024-09-17T05:50:17.678520+0000","last_became_peered":"2024-09-17T05:50:17.678520+0000","last_unstale":"2024-09-17T05:50:18.669692+0000","last_undegraded":"2024-09-17T05:50:18.669692+0000","last_fullsized":"2024-09-17T05:50:18.669692+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:50:16.649689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:50:16.649689+0000","last_clean_scrub_stamp":"2024-09-17T05:50:16.649689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:53:12.068807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.13","version":"100'2","reported_seq":15,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-17T05:50:17.699288+0000","last_change":"2024-09-17T05:50:16.677999+0000","last_active":"2024-09-17T05:50:17.699288+0000","last_peered":"2024-09-17T05:50:17.699288+0000","last_clean":"2024-09-17T05:50:17.699288+0000","last_became_active":"2024-09-17T05:50:16.677675+0000","last_became_peered":"2024-09-17T05:50:16.677675+0000","last_unstale":"2024-09-17T05:50:17.699288+0000","last_undegraded":"2024-09-17T05:50:17.699288+0000","last_fullsized":"2024-09-17T05:50:17.699288+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:50:15.639879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:50:15.639879+0000","last_clean_scrub_stamp":"2024-09-17T05:50:15.639879+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:52:12.200476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.13","version":"0'0","reported_seq":10,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-17T05:50:17.695914+0000","last_change":"2024-09-17T05:50:17.683595+0000","last_active":"2024-09-17T05:50:17.695914+0000","last_peered":"2024-09-17T05:50:17.695914+0000","last_clean":"2024-09-17T05:50:17.695914+0000","last_became_active":"2024-09-17T05:50:17.683280+0000","last_became_peered":"2024-09-17T05:50:17.683280+0000","last_unstale":"2024-09-17T05:50:17.695914+0000","last_undegraded":"2024-09-17T05:50:17.695914+0000","last_fullsized":"2024-09-17T05:50:17.695914+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:50:16.649689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:50:16.649689+0000","last_clean_scrub_stamp":"2024-09-17T05:50:16.649689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:52:17.955004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.12","version":"0'0","reported_seq":13,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-17T05:50:17.672150+0000","last_change":"2024-09-17T05:50:16.672657+0000","last_active":"2024-09-17T05:50:17.672150+0000","last_peered":"2024-09-17T05:50:17.672150+0000","last_clean":"2024-09-17T05:50:17.672150+0000","last_became_active":"2024-09-17T05:50:16.672353+0000","last_became_peered":"2024-09-17T05:50:16.672353+0000","last_unstale":"2024-09-17T05:50:17.672150+0000","last_undegraded":"2024-09-17T05:50:17.672150+0000","last_fullsized":"2024-09-17T05:50:17.672150+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:50:15.639879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:50:15.639879+0000","last_clean_scrub_stamp":"2024-09-17T05:50:15.639879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:31:01.840132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.10","version":"0'0","reported_seq":13,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-17T05:50:18.667787+0000","last_change":"2024-09-17T05:50:17.679597+0000","last_active":"2024-09-17T05:50:18.667787+0000","last_peered":"2024-09-17T05:50:18.667787+0000","last_clean":"2024-09-17T05:50:18.667787+0000","last_became_active":"2024-09-17T05:50:17.679272+0000","last_became_peered":"2024-09-17T05:50:17.679272+0000","last_unstale":"2024-09-17T05:50:18.667787+0000","last_undegraded":"2024-09-17T05:50:18.667787+0000","last_fullsized":"2024-09-17T05:50:18.667787+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:50:16.649689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:50:16.649689+0000","last_clean_scrub_stamp":"2024-09-17T05:50:16.649689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:31:55.605959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.11","version":"0'0","reported_seq":15,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-17T05:50:18.668995+0000","last_change":"2024-09-17T05:50:16.663949+0000","last_active":"2024-09-17T05:50:18.668995+0000","last_peered":"2024-09-17T05:50:18.668995+0000","last_clean":"2024-09-17T05:50:18.668995+0000","last_became_active":"2024-09-17T05:50:16.663594+0000","last_became_peered":"2024-09-17T05:50:16.663594+0000","last_unstale":"2024-09-17T05:50:18.668995+0000","last_undegraded":"2024-09-17T05:50:18.668995+0000","last_fullsized":"2024-09-17T05:50:18.668995+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:50:15.639879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:50:15.639879+0000","last_clean_scrub_stamp":"2024-09-17T05:50:15.639879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:51:28.101496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.11","version":"0'0","reported_seq":10,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-17T05:50:17.676653+0000","last_change":"2024-09-17T05:50:17.673526+0000","last_active":"2024-09-17T05:50:17.676653+0000","last_peered":"2024-09-17T05:50:17.676653+0000","last_clean":"2024-09-17T05:50:17.676653+0000","last_became_active":"2024-09-17T05:50:17.673209+0000","last_became_peered":"2024-09-17T05:50:17.673209+0000","last_unstale":"2024-09-17T05:50:17.676653+0000","last_undegraded":"2024-09-17T05:50:17.676653+0000","last_fullsized":"2024-09-17T05:50:17.676653+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:50:16.649689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:50:16.649689+0000","last_clean_scrub_stamp":"2024-09-17T05:50:16.649689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:45:11.588427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.10","version":"100'8","reported_seq":21,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-17T05:50:17.701091+0000","last_change":"2024-09-17T05:50:16.671667+0000","last_active":"2024-09-17T05:50:17.701091+0000","last_peered":"2024-09-17T05:50:17.701091+0000","last_clean":"2024-09-17T05:50:17.701091+0000","last_became_active":"2024-09-17T05:50:16.671069+0000","last_became_peered":"2024-09-17T05:50:16.671069+0000","last_unstale":"2024-09-17T05:50:17.701091+0000","last_undegraded":"2024-09-17T05:50:17.701091+0000","last_fullsized":"2024-09-17T05:50:17.701091+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:50:15.639879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:50:15.639879+0000","last_clean_scrub_stamp":"2024-09-17T05:50:15.639879+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:54:11.413425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.f","version":"0'0","reported_seq":10,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-17T05:50:17.694467+0000","last_change":"2024-09-17T05:50:17.693101+0000","last_active":"2024-09-17T05:50:17.694467+0000","last_peered":"2024-09-17T05:50:17.694467+0000","last_clean":"2024-09-17T05:50:17.694467+0000","last_became_active":"2024-09-17T05:50:17.692530+0000","last_became_peered":"2024-09-17T05:50:17.692530+0000","last_unstale":"2024-09-17T05:50:17.694467+0000","last_undegraded":"2024-09-17T05:50:17.694467+0000","last_fullsized":"2024-09-17T05:50:17.694467+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:50:16.649689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:50:16.649689+0000","last_clean_scrub_stamp":"2024-09-17T05:50:16.649689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:00:10.128109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.e","version":"100'2","reported_seq":17,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-17T05:50:18.668210+0000","last_change":"2024-09-17T05:50:16.676692+0000","last_active":"2024-09-17T05:50:18.668210+0000","last_peered":"2024-09-17T05:50:18.668210+0000","last_clean":"2024-09-17T05:50:18.668210+0000","last_became_active":"2024-09-17T05:50:16.676330+0000","last_became_peered":"2024-09-17T05:50:16.676330+0000","last_unstale":"2024-09-17T05:50:18.668210+0000","last_undegraded":"2024-09-17T05:50:18.668210+0000","last_fullsized":"2024-09-17T05:50:18.668210+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:50:15.639879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:50:15.639879+0000","last_clean_scrub_stamp":"2024-09-17T05:50:15.639879+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:11:37.328920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.c","version":"0'0","reported_seq":13,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-17T05:50:19.313016+0000","last_change":"2024-09-17T05:50:17.694120+0000","last_active":"2024-09-17T05:50:19.313016+0000","last_peered":"2024-09-17T05:50:19.313016+0000","last_clean":"2024-09-17T05:50:19.313016+0000","last_became_active":"2024-09-17T05:50:17.693757+0000","last_became_peered":"2024-09-17T05:50:17.693757+0000","last_unstale":"2024-09-17T05:50:19.313016+0000","last_undegraded":"2024-09-17T05:50:19.313016+0000","last_fullsized":"2024-09-17T05:50:19.313016+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:50:16.649689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:50:16.649689+0000","last_clean_scrub_stamp":"2024-09-17T05:50:16.649689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:11:38.338730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.d","version":"100'1","reported_seq":14,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-17T05:50:17.702271+0000","last_change":"2024-09-17T05:50:16.663432+0000","last_active":"2024-09-17T05:50:17.702271+0000","last_peered":"2024-09-17T05:50:17.702271+0000","last_clean":"2024-09-17T05:50:17.702271+0000","last_became_active":"2024-09-17T05:50:16.663096+0000","last_became_peered":"2024-09-17T05:50:16.663096+0000","last_unstale":"2024-09-17T05:50:17.702271+0000","last_undegraded":"2024-09-17T05:50:17.702271+0000","last_fullsized":"2024-09-17T05:50:17.702271+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:50:15.639879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:50:15.639879+0000","last_clean_scrub_stamp":"2024-09-17T05:50:15.639879+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:31:07.149126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.d","version":"0'0","reported_seq":13,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-17T05:50:18.669323+0000","last_change":"2024-09-17T05:50:17.692323+0000","last_active":"2024-09-17T05:50:18.669323+0000","last_peered":"2024-09-17T05:50:18.669323+0000","last_clean":"2024-09-17T05:50:18.669323+0000","last_became_active":"2024-09-17T05:50:17.691635+0000","last_became_peered":"2024-09-17T05:50:17.691635+0000","last_unstale":"2024-09-17T05:50:18.669323+0000","last_undegraded":"2024-09-17T05:50:18.669323+0000","last_fullsized":"2024-09-17T05:50:18.669323+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:50:16.649689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:50:16.649689+0000","last_clean_scrub_stamp":"2024-09-17T05:50:16.649689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:23:23.530384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.c","version":"0'0","reported_seq":15,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-17T05:50:18.686186+0000","last_change":"2024-09-17T05:50:16.676827+0000","last_active":"2024-09-17T05:50:18.686186+0000","last_peered":"2024-09-17T05:50:18.686186+0000","last_clean":"2024-09-17T05:50:18.686186+0000","last_became_active":"2024-09-17T05:50:16.674588+0000","last_became_peered":"2024-09-17T05:50:16.674588+0000","last_unstale":"2024-09-17T05:50:18.686186+0000","last_undegraded":"2024-09-17T05:50:18.686186+0000","last_fullsized":"2024-09-17T05:50:18.686186+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:50:15.639879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:50:15.639879+0000","last_clean_scrub_stamp":"2024-09-17T05:50:15.639879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:41:10.083935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.a","version":"0'0","reported_seq":10,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-17T05:50:17.691508+0000","last_change":"2024-09-17T05:50:17.682895+0000","last_active":"2024-09-17T05:50:17.691508+0000","last_peered":"2024-09-17T05:50:17.691508+0000","last_clean":"2024-09-17T05:50:17.691508+0000","last_became_active":"2024-09-17T05:50:17.682597+0000","last_became_peered":"2024-09-17T05:50:17.682597+0000","last_unstale":"2024-09-17T05:50:17.691508+0000","last_undegraded":"2024-09-17T05:50:17.691508+0000","last_fullsized":"2024-09-17T05:50:17.691508+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:50:16.649689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:50:16.649689+0000","last_clean_scrub_stamp":"2024-09-17T05:50:16.649689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:08:03.346563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.b","version":"100'2","reported_seq":17,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-17T05:50:18.686463+0000","last_change":"2024-09-17T05:50:16.678475+0000","last_active":"2024-09-17T05:50:18.686463+0000","last_peered":"2024-09-17T05:50:18.686463+0000","last_clean":"2024-09-17T05:50:18.686463+0000","last_became_active":"2024-09-17T05:50:16.677955+0000","last_became_peered":"2024-09-17T05:50:16.677955+0000","last_unstale":"2024-09-17T05:50:18.686463+0000","last_undegraded":"2024-09-17T05:50:18.686463+0000","last_fullsized":"2024-09-17T05:50:18.686463+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:50:15.639879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:50:15.639879+0000","last_clean_scrub_stamp":"2024-09-17T05:50:15.639879+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:30:59.350580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.b","version":"0'0","reported_seq":10,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-17T05:50:17.697857+0000","last_change":"2024-09-17T05:50:17.690262+0000","last_active":"2024-09-17T05:50:17.697857+0000","last_peered":"2024-09-17T05:50:17.697857+0000","last_clean":"2024-09-17T05:50:17.697857+0000","last_became_active":"2024-09-17T05:50:17.689973+0000","last_became_peered":"2024-09-17T05:50:17.689973+0000","last_unstale":"2024-09-17T05:50:17.697857+0000","last_undegraded":"2024-09-17T05:50:17.697857+0000","last_fullsized":"2024-09-17T05:50:17.697857+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:50:16.649689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:50:16.649689+0000","last_clean_scrub_stamp":"2024-09-17T05:50:16.649689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:07:11.041448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.a","version":"0'0","reported_seq":15,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-17T05:50:19.312945+0000","last_change":"2024-09-17T05:50:16.672269+0000","last_active":"2024-09-17T05:50:19.312945+0000","last_peered":"2024-09-17T05:50:19.312945+0000","last_clean":"2024-09-17T05:50:19.312945+0000","last_became_active":"2024-09-17T05:50:16.671875+0000","last_became_peered":"2024-09-17T05:50:16.671875+0000","last_unstale":"2024-09-17T05:50:19.312945+0000","last_undegraded":"2024-09-17T05:50:19.312945+0000","last_fullsized":"2024-09-17T05:50:19.312945+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:50:15.639879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:50:15.639879+0000","last_clean_scrub_stamp":"2024-09-17T05:50:15.639879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:29:05.386538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.8","version":"0'0","reported_seq":10,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-17T05:50:17.678457+0000","last_change":"2024-09-17T05:50:17.675705+0000","last_active":"2024-09-17T05:50:17.678457+0000","last_peered":"2024-09-17T05:50:17.678457+0000","last_clean":"2024-09-17T05:50:17.678457+0000","last_became_active":"2024-09-17T05:50:17.674936+0000","last_became_peered":"2024-09-17T05:50:17.674936+0000","last_unstale":"2024-09-17T05:50:17.678457+0000","last_undegraded":"2024-09-17T05:50:17.678457+0000","last_fullsized":"2024-09-17T05:50:17.678457+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:50:16.649689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:50:16.649689+0000","last_clean_scrub_stamp":"2024-09-17T05:50:16.649689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:43:33.495433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.9","version":"0'0","reported_seq":15,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-17T05:50:19.312840+0000","last_change":"2024-09-17T05:50:16.663708+0000","last_active":"2024-09-17T05:50:19.312840+0000","last_peered":"2024-09-17T05:50:19.312840+0000","last_clean":"2024-09-17T05:50:19.312840+0000","last_became_active":"2024-09-17T05:50:16.663348+0000","last_became_peered":"2024-09-17T05:50:16.663348+0000","last_unstale":"2024-09-17T05:50:19.312840+0000","last_undegraded":"2024-09-17T05:50:19.312840+0000","last_fullsized":"2024-09-17T05:50:19.312840+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:50:15.639879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:50:15.639879+0000","last_clean_scrub_stamp":"2024-09-17T05:50:15.639879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:54:14.277613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.9","version":"0'0","reported_seq":10,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-17T05:50:17.692330+0000","last_change":"2024-09-17T05:50:17.687159+0000","last_active":"2024-09-17T05:50:17.692330+0000","last_peered":"2024-09-17T05:50:17.692330+0000","last_clean":"2024-09-17T05:50:17.692330+0000","last_became_active":"2024-09-17T05:50:17.686709+0000","last_became_peered":"2024-09-17T05:50:17.686709+0000","last_unstale":"2024-09-17T05:50:17.692330+0000","last_undegraded":"2024-09-17T05:50:17.692330+0000","last_fullsized":"2024-09-17T05:50:17.692330+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:50:16.649689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:50:16.649689+0000","last_clean_scrub_stamp":"2024-09-17T05:50:16.649689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:23:53.419421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.8","version":"0'0","reported_seq":15,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-17T05:50:18.686083+0000","last_change":"2024-09-17T05:50:16.673662+0000","last_active":"2024-09-17T05:50:18.686083+0000","last_peered":"2024-09-17T05:50:18.686083+0000","last_clean":"2024-09-17T05:50:18.686083+0000","last_became_active":"2024-09-17T05:50:16.673056+0000","last_became_peered":"2024-09-17T05:50:16.673056+0000","last_unstale":"2024-09-17T05:50:18.686083+0000","last_undegraded":"2024-09-17T05:50:18.686083+0000","last_fullsized":"2024-09-17T05:50:18.686083+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:50:15.639879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:50:15.639879+0000","last_clean_scrub_stamp":"2024-09-17T05:50:15.639879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:10:01.927806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.6","version":"0'0","reported_seq":13,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-17T05:50:18.686719+0000","last_change":"2024-09-17T05:50:17.684990+0000","last_active":"2024-09-17T05:50:18.686719+0000","last_peered":"2024-09-17T05:50:18.686719+0000","last_clean":"2024-09-17T05:50:18.686719+0000","last_became_active":"2024-09-17T05:50:17.684521+0000","last_became_peered":"2024-09-17T05:50:17.684521+0000","last_unstale":"2024-09-17T05:50:18.686719+0000","last_undegraded":"2024-09-17T05:50:18.686719+0000","last_fullsized":"2024-09-17T05:50:18.686719+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:50:16.649689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:50:16.649689+0000","last_clean_scrub_stamp":"2024-09-17T05:50:16.649689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:00:23.826449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.7","version":"100'2","reported_seq":17,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-17T05:50:19.313188+0000","last_change":"2024-09-17T05:50:16.663678+0000","last_active":"2024-09-17T05:50:19.313188+0000","last_peered":"2024-09-17T05:50:19.313188+0000","last_clean":"2024-09-17T05:50:19.313188+0000","last_became_active":"2024-09-17T05:50:16.663332+0000","last_became_peered":"2024-09-17T05:50:16.663332+0000","last_unstale":"2024-09-17T05:50:19.313188+0000","last_undegraded":"2024-09-17T05:50:19.313188+0000","last_fullsized":"2024-09-17T05:50:19.313188+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:50:15.639879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:50:15.639879+0000","last_clean_scrub_stamp":"2024-09-17T05:50:15.639879+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:42:47.577081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.7","version":"0'0","reported_seq":10,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-17T05:50:17.683380+0000","last_change":"2024-09-17T05:50:17.680146+0000","last_active":"2024-09-17T05:50:17.683380+0000","last_peered":"2024-09-17T05:50:17.683380+0000","last_clean":"2024-09-17T05:50:17.683380+0000","last_became_active":"2024-09-17T05:50:17.679833+0000","last_became_peered":"2024-09-17T05:50:17.679833+0000","last_unstale":"2024-09-17T05:50:17.683380+0000","last_undegraded":"2024-09-17T05:50:17.683380+0000","last_fullsized":"2024-09-17T05:50:17.683380+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:50:16.649689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:50:16.649689+0000","last_clean_scrub_stamp":"2024-09-17T05:50:16.649689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:34:43.730314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.6","version":"101'1","reported_seq":16,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-17T05:50:18.687959+0000","last_change":"2024-09-17T05:50:16.676247+0000","last_active":"2024-09-17T05:50:18.687959+0000","last_peered":"2024-09-17T05:50:18.687959+0000","last_clean":"2024-09-17T05:50:18.687959+0000","last_became_active":"2024-09-17T05:50:16.674892+0000","last_became_peered":"2024-09-17T05:50:16.674892+0000","last_unstale":"2024-09-17T05:50:18.687959+0000","last_undegraded":"2024-09-17T05:50:18.687959+0000","last_fullsized":"2024-09-17T05:50:18.687959+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:50:15.639879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:50:15.639879+0000","last_clean_scrub_stamp":"2024-09-17T05:50:15.639879+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:30:08.711913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.4","version":"0'0","reported_seq":10,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-17T05:50:17.700701+0000","last_change":"2024-09-17T05:50:17.694044+0000","last_active":"2024-09-17T05:50:17.700701+0000","last_peered":"2024-09-17T05:50:17.700701+0000","last_clean":"2024-09-17T05:50:17.700701+0000","last_became_active":"2024-09-17T05:50:17.693724+0000","last_became_peered":"2024-09-17T05:50:17.693724+0000","last_unstale":"2024-09-17T05:50:17.700701+0000","last_undegraded":"2024-09-17T05:50:17.700701+0000","last_fullsized":"2024-09-17T05:50:17.700701+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:50:16.649689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:50:16.649689+0000","last_clean_scrub_stamp":"2024-09-17T05:50:16.649689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:00:14.576200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.5","version":"0'0","reported_seq":15,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-17T05:50:18.686425+0000","last_change":"2024-09-17T05:50:16.679037+0000","last_active":"2024-09-17T05:50:18.686425+0000","last_peered":"2024-09-17T05:50:18.686425+0000","last_clean":"2024-09-17T05:50:18.686425+0000","last_became_active":"2024-09-17T05:50:16.678604+0000","last_became_peered":"2024-09-17T05:50:16.678604+0000","last_unstale":"2024-09-17T05:50:18.686425+0000","last_undegraded":"2024-09-17T05:50:18.686425+0000","last_fullsized":"2024-09-17T05:50:18.686425+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:50:15.639879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:50:15.639879+0000","last_clean_scrub_stamp":"2024-09-17T05:50:15.639879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:31:44.846045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.5","version":"0'0","reported_seq":10,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-17T05:50:17.688492+0000","last_change":"2024-09-17T05:50:17.684200+0000","last_active":"2024-09-17T05:50:17.688492+0000","last_peered":"2024-09-17T05:50:17.688492+0000","last_clean":"2024-09-17T05:50:17.688492+0000","last_became_active":"2024-09-17T05:50:17.683866+0000","last_became_peered":"2024-09-17T05:50:17.683866+0000","last_unstale":"2024-09-17T05:50:17.688492+0000","last_undegraded":"2024-09-17T05:50:17.688492+0000","last_fullsized":"2024-09-17T05:50:17.688492+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:50:16.649689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:50:16.649689+0000","last_clean_scrub_stamp":"2024-09-17T05:50:16.649689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:45:29.227941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.4","version":"0'0","reported_seq":13,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-17T05:50:17.682877+0000","last_change":"2024-09-17T05:50:16.669515+0000","last_active":"2024-09-17T05:50:17.682877+0000","last_peered":"2024-09-17T05:50:17.682877+0000","last_clean":"2024-09-17T05:50:17.682877+0000","last_became_active":"2024-09-17T05:50:16.669123+0000","last_became_peered":"2024-09-17T05:50:16.669123+0000","last_unstale":"2024-09-17T05:50:17.682877+0000","last_undegraded":"2024-09-17T05:50:17.682877+0000","last_fullsized":"2024-09-17T05:50:17.682877+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:50:15.639879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:50:15.639879+0000","last_clean_scrub_stamp":"2024-09-17T05:50:15.639879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:36:09.486712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.2","version":"0'0","reported_seq":10,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-17T05:50:17.699104+0000","last_change":"2024-09-17T05:50:17.694213+0000","last_active":"2024-09-17T05:50:17.699104+0000","last_peered":"2024-09-17T05:50:17.699104+0000","last_clean":"2024-09-17T05:50:17.699104+0000","last_became_active":"2024-09-17T05:50:17.684089+0000","last_became_peered":"2024-09-17T05:50:17.684089+0000","last_unstale":"2024-09-17T05:50:17.699104+0000","last_undegraded":"2024-09-17T05:50:17.699104+0000","last_fullsized":"2024-09-17T05:50:17.699104+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:50:16.649689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:50:16.649689+0000","last_clean_scrub_stamp":"2024-09-17T05:50:16.649689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:58:43.708570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.3","version":"0'0","reported_seq":15,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-17T05:50:18.686471+0000","last_change":"2024-09-17T05:50:16.669971+0000","last_active":"2024-09-17T05:50:18.686471+0000","last_peered":"2024-09-17T05:50:18.686471+0000","last_clean":"2024-09-17T05:50:18.686471+0000","last_became_active":"2024-09-17T05:50:16.667502+0000","last_became_peered":"2024-09-17T05:50:16.667502+0000","last_unstale":"2024-09-17T05:50:18.686471+0000","last_undegraded":"2024-09-17T05:50:18.686471+0000","last_fullsized":"2024-09-17T05:50:18.686471+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:50:15.639879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:50:15.639879+0000","last_clean_scrub_stamp":"2024-09-17T05:50:15.639879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:15:08.648001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.3","version":"0'0","reported_seq":13,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-17T05:50:18.668208+0000","last_change":"2024-09-17T05:50:17.685609+0000","last_active":"2024-09-17T05:50:18.668208+0000","last_peered":"2024-09-17T05:50:18.668208+0000","last_clean":"2024-09-17T05:50:18.668208+0000","last_became_active":"2024-09-17T05:50:17.685256+0000","last_became_peered":"2024-09-17T05:50:17.685256+0000","last_unstale":"2024-09-17T05:50:18.668208+0000","last_undegraded":"2024-09-17T05:50:18.668208+0000","last_fullsized":"2024-09-17T05:50:18.668208+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:50:16.649689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:50:16.649689+0000","last_clean_scrub_stamp":"2024-09-17T05:50:16.649689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:20:50.827401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.2","version":"0'0","reported_seq":13,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-17T05:50:17.679835+0000","last_change":"2024-09-17T05:50:16.672742+0000","last_active":"2024-09-17T05:50:17.679835+0000","last_peered":"2024-09-17T05:50:17.679835+0000","last_clean":"2024-09-17T05:50:17.679835+0000","last_became_active":"2024-09-17T05:50:16.672357+0000","last_became_peered":"2024-09-17T05:50:16.672357+0000","last_unstale":"2024-09-17T05:50:17.679835+0000","last_undegraded":"2024-09-17T05:50:17.679835+0000","last_fullsized":"2024-09-17T05:50:17.679835+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:50:15.639879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:50:15.639879+0000","last_clean_scrub_stamp":"2024-09-17T05:50:15.639879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:30:35.738894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.0","version":"0'0","reported_seq":10,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-17T05:50:17.678422+0000","last_change":"2024-09-17T05:50:17.675260+0000","last_active":"2024-09-17T05:50:17.678422+0000","last_peered":"2024-09-17T05:50:17.678422+0000","last_clean":"2024-09-17T05:50:17.678422+0000","last_became_active":"2024-09-17T05:50:17.674667+0000","last_became_peered":"2024-09-17T05:50:17.674667+0000","last_unstale":"2024-09-17T05:50:17.678422+0000","last_undegraded":"2024-09-17T05:50:17.678422+0000","last_fullsized":"2024-09-17T05:50:17.678422+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:50:16.649689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:50:16.649689+0000","last_clean_scrub_stamp":"2024-09-17T05:50:16.649689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:33:47.309127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.1","version":"0'0","reported_seq":15,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-17T05:50:18.669751+0000","last_change":"2024-09-17T05:50:16.670111+0000","last_active":"2024-09-17T05:50:18.669751+0000","last_peered":"2024-09-17T05:50:18.669751+0000","last_clean":"2024-09-17T05:50:18.669751+0000","last_became_active":"2024-09-17T05:50:16.669343+0000","last_became_peered":"2024-09-17T05:50:16.669343+0000","last_unstale":"2024-09-17T05:50:18.669751+0000","last_undegraded":"2024-09-17T05:50:18.669751+0000","last_fullsized":"2024-09-17T05:50:18.669751+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:50:15.639879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:50:15.639879+0000","last_clean_scrub_stamp":"2024-09-17T05:50:15.639879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:14:06.830335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.1","version":"0'0","reported_seq":10,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-17T05:50:17.694046+0000","last_change":"2024-09-17T05:50:17.692076+0000","last_active":"2024-09-17T05:50:17.694046+0000","last_peered":"2024-09-17T05:50:17.694046+0000","last_clean":"2024-09-17T05:50:17.694046+0000","last_became_active":"2024-09-17T05:50:17.688755+0000","last_became_peered":"2024-09-17T05:50:17.688755+0000","last_unstale":"2024-09-17T05:50:17.694046+0000","last_undegraded":"2024-09-17T05:50:17.694046+0000","last_fullsized":"2024-09-17T05:50:17.694046+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:50:16.649689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:50:16.649689+0000","last_clean_scrub_stamp":"2024-09-17T05:50:16.649689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:09:55.788176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.0","version":"0'0","reported_seq":13,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-17T05:50:17.669830+0000","last_change":"2024-09-17T05:50:16.680798+0000","last_active":"2024-09-17T05:50:17.669830+0000","last_peered":"2024-09-17T05:50:17.669830+0000","last_clean":"2024-09-17T05:50:17.669830+0000","last_became_active":"2024-09-17T05:50:16.680485+0000","last_became_peered":"2024-09-17T05:50:16.680485+0000","last_unstale":"2024-09-17T05:50:17.669830+0000","last_undegraded":"2024-09-17T05:50:17.669830+0000","last_fullsized":"2024-09-17T05:50:17.669830+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:50:15.639879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:50:15.639879+0000","last_clean_scrub_stamp":"2024-09-17T05:50:15.639879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:59:08.119171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.e","version":"0'0","reported_seq":10,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-17T05:50:17.685022+0000","last_change":"2024-09-17T05:50:17.682012+0000","last_active":"2024-09-17T05:50:17.685022+0000","last_peered":"2024-09-17T05:50:17.685022+0000","last_clean":"2024-09-17T05:50:17.685022+0000","last_became_active":"2024-09-17T05:50:17.681695+0000","last_became_peered":"2024-09-17T05:50:17.681695+0000","last_unstale":"2024-09-17T05:50:17.685022+0000","last_undegraded":"2024-09-17T05:50:17.685022+0000","last_fullsized":"2024-09-17T05:50:17.685022+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:50:16.649689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:50:16.649689+0000","last_clean_scrub_stamp":"2024-09-17T05:50:16.649689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:51:07.133701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.f","version":"100'1","reported_seq":16,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-17T05:50:18.668437+0000","last_change":"2024-09-17T05:50:16.675030+0000","last_active":"2024-09-17T05:50:18.668437+0000","last_peered":"2024-09-17T05:50:18.668437+0000","last_clean":"2024-09-17T05:50:18.668437+0000","last_became_active":"2024-09-17T05:50:16.674713+0000","last_became_peered":"2024-09-17T05:50:16.674713+0000","last_unstale":"2024-09-17T05:50:18.668437+0000","last_undegraded":"2024-09-17T05:50:18.668437+0000","last_fullsized":"2024-09-17T05:50:18.668437+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:50:15.639879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:50:15.639879+0000","last_clean_scrub_stamp":"2024-09-17T05:50:15.639879+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:07:41.953366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"19'72","reported_seq":255,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-17T05:50:18.668757+0000","last_change":"2024-09-17T05:41:48.539830+0000","last_active":"2024-09-17T05:50:18.668757+0000","last_peered":"2024-09-17T05:50:18.668757+0000","last_clean":"2024-09-17T05:50:18.668757+0000","last_became_active":"2024-09-17T05:41:48.538743+0000","last_became_peered":"2024-09-17T05:41:48.538743+0000","last_unstale":"2024-09-17T05:50:18.668757+0000","last_undegraded":"2024-09-17T05:50:18.668757+0000","last_fullsized":"2024-09-17T05:50:18.668757+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:47.152539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:47.152539+0000","last_clean_scrub_stamp":"2024-09-17T05:41:47.152539+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:08:02.952016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":15,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":14,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":16,"seq":68719476843,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":118412,"kb_used_data":1208,"kb_used_omap":1,"kb_used_meta":117182,"kb_avail":94253428,"statfs":{"total":96636764160,"available":96515510272,"internally_reserved":0,"allocated":1236992,"data_stored":531916,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":119994822},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":7,"up_from":15,"seq":64424509548,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":127328,"kb_used_data":1800,"kb_used_omap":1,"kb_used_meta":125502,"kb_avail":94244512,"statfs":{"total":96636764160,"available":96506380288,"internally_reserved":0,"allocated":1843200,"data_stored":1128156,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":128514506},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509547,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":72596,"kb_used_data":1216,"kb_used_omap":1,"kb_used_meta":71358,"kb_avail":94299244,"statfs":{"total":96636764160,"available":96562425856,"internally_reserved":0,"allocated":1245184,"data_stored":537746,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":73071045},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509547,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":148964,"kb_used_data":1232,"kb_used_omap":1,"kb_used_meta":147710,"kb_avail":94222876,"statfs":{"total":96636764160,"available":96484225024,"internally_reserved":0,"allocated":1261568,"data_stored":539412,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":151255493},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509547,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":112872,"kb_used_data":1228,"kb_used_omap":1,"kb_used_meta":111614,"kb_avail":94258968,"statfs":{"total":96636764160,"available":96521183232,"internally_reserved":0,"allocated":1257472,"data_stored":539310,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":114293191},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509546,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":153096,"kb_used_data":1204,"kb_used_omap":1,"kb_used_meta":151870,"kb_avail":94218744,"statfs":{"total":96636764160,"available":96479993856,"internally_reserved":0,"allocated":1232896,"data_stored":531298,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":155515333},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509546,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":118396,"kb_used_data":1188,"kb_used_omap":1,"kb_used_meta":117182,"kb_avail":94253444,"statfs":{"total":96636764160,"available":96515526656,"internally_reserved":0,"allocated":1216512,"data_stored":524377,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":119994821},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574954,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":131468,"kb_used_data":1784,"kb_used_omap":1,"kb_used_meta":129662,"kb_avail":94240372,"statfs":{"total":96636764160,"available":96502140928,"internally_reserved":0,"allocated":1826816,"data_stored":1122214,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":132774341},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-17T05:50:26.159 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-17T05:50:26.291 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:26.290+0000 7fc30d4de640 1 -- 172.21.15.150:0/3246757920 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc3080d0c50 msgr2=0x7fc3080d0010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:50:26.291 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:26.290+0000 7fc30d4de640 1 --2- 172.21.15.150:0/3246757920 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc3080d0c50 0x7fc3080d0010 secure :-1 s=READY pgs=1333 cs=0 l=1 rev1=1 crypto rx=0x7fc308073f30 tx=0x7fc2f802a5d0 comp rx=0 tx=0).stop 2024-09-17T05:50:26.291 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:26.290+0000 7fc30d4de640 1 -- 172.21.15.150:0/3246757920 shutdown_connections 2024-09-17T05:50:26.291 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:26.290+0000 7fc30d4de640 1 --2- 172.21.15.150:0/3246757920 >> v2:172.21.15.176:3300/0 conn(0x7fc3080d0550 0x7fc3080b18c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:50:26.291 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:26.290+0000 7fc30d4de640 1 --2- 172.21.15.150:0/3246757920 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc3080d0c50 0x7fc3080d0010 unknown :-1 s=CLOSED pgs=1333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:50:26.292 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:26.290+0000 7fc30d4de640 1 -- 172.21.15.150:0/3246757920 >> 172.21.15.150:0/3246757920 conn(0x7fc3080b3fc0 msgr2=0x7fc3080b43d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:50:26.292 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:26.290+0000 7fc30d4de640 1 -- 172.21.15.150:0/3246757920 shutdown_connections 2024-09-17T05:50:26.292 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:26.290+0000 7fc30d4de640 1 -- 172.21.15.150:0/3246757920 wait complete. 2024-09-17T05:50:26.292 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:26.292+0000 7fc30d4de640 1 Processor -- start 2024-09-17T05:50:26.292 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:26.292+0000 7fc30d4de640 1 -- start start 2024-09-17T05:50:26.295 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:26.293+0000 7fc30d4de640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc3080d0550 0x7fc3080c8a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:50:26.295 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:26.293+0000 7fc30d4de640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc3080d0c50 0x7fc30815c830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:50:26.295 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:26.293+0000 7fc30d4de640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc3080d1060 0x7fc30815cd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:50:26.295 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:26.293+0000 7fc30d4de640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7fc3080ced30 con 0x7fc3080d0550 2024-09-17T05:50:26.295 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:26.293+0000 7fc30d4de640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fc3080cebb0 con 0x7fc3080d1060 2024-09-17T05:50:26.296 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:26.293+0000 7fc30d4de640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fc3080cd130 con 0x7fc3080d0c50 2024-09-17T05:50:26.296 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:26.293+0000 7fc306ffd640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc3080d0550 0x7fc3080c8a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:50:26.296 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:26.293+0000 7fc306ffd640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc3080d0550 0x7fc3080c8a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:57344/0 (socket says 172.21.15.150:57344) 2024-09-17T05:50:26.296 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:26.293+0000 7fc306ffd640 1 -- 172.21.15.150:0/303204855 learned_addr learned my addr 172.21.15.150:0/303204855 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:50:26.296 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:26.294+0000 7fc3067fc640 1 --2- 172.21.15.150:0/303204855 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc3080d0c50 0x7fc30815c830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:50:26.296 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:26.294+0000 7fc3077fe640 1 --2- 172.21.15.150:0/303204855 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc3080d1060 0x7fc30815cd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:50:26.296 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:26.294+0000 7fc306ffd640 1 -- 172.21.15.150:0/303204855 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc3080d0c50 msgr2=0x7fc30815c830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:50:26.296 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:26.294+0000 7fc306ffd640 1 --2- 172.21.15.150:0/303204855 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc3080d0c50 0x7fc30815c830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:50:26.296 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:26.294+0000 7fc306ffd640 1 -- 172.21.15.150:0/303204855 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc3080d1060 msgr2=0x7fc30815cd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:50:26.296 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:26.294+0000 7fc306ffd640 1 --2- 172.21.15.150:0/303204855 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc3080d1060 0x7fc30815cd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:50:26.296 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:26.294+0000 7fc306ffd640 1 -- 172.21.15.150:0/303204855 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc3080c9760 con 0x7fc3080d0550 2024-09-17T05:50:26.296 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:26.294+0000 7fc3077fe640 1 --2- 172.21.15.150:0/303204855 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc3080d1060 0x7fc30815cd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T05:50:26.297 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:26.294+0000 7fc3067fc640 1 --2- 172.21.15.150:0/303204855 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc3080d0c50 0x7fc30815c830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T05:50:26.297 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:26.294+0000 7fc306ffd640 1 --2- 172.21.15.150:0/303204855 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc3080d0550 0x7fc3080c8a90 secure :-1 s=READY pgs=1334 cs=0 l=1 rev1=1 crypto rx=0x7fc2f8009920 tx=0x7fc2f8033c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:50:26.297 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:26.294+0000 7fc2ef7fe640 1 -- 172.21.15.150:0/303204855 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2f8031d60 con 0x7fc3080d0550 2024-09-17T05:50:26.297 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:26.294+0000 7fc30d4de640 1 -- 172.21.15.150:0/303204855 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc3080c9a40 con 0x7fc3080d0550 2024-09-17T05:50:26.297 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:26.294+0000 7fc2ef7fe640 1 -- 172.21.15.150:0/303204855 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc2f80315d0 con 0x7fc3080d0550 2024-09-17T05:50:26.297 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:26.294+0000 7fc2ef7fe640 1 -- 172.21.15.150:0/303204855 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2f8005260 con 0x7fc3080d0550 2024-09-17T05:50:26.297 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:26.294+0000 7fc30d4de640 1 -- 172.21.15.150:0/303204855 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc308145c00 con 0x7fc3080d0550 2024-09-17T05:50:26.298 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:26.295+0000 7fc30d4de640 1 -- 172.21.15.150:0/303204855 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc3080d0010 con 0x7fc3080d0550 2024-09-17T05:50:26.298 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:26.296+0000 7fc2ef7fe640 1 -- 172.21.15.150:0/303204855 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 32) ==== 103481+0+0 (secure 0 0 0) 0x7fc2f8005400 con 0x7fc3080d0550 2024-09-17T05:50:26.298 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:26.297+0000 7fc2ef7fe640 1 --2- 172.21.15.150:0/303204855 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fc2f407a210 0x7fc2f407c720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:50:26.298 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:26.297+0000 7fc2ef7fe640 1 -- 172.21.15.150:0/303204855 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(101..101 src has 1..101) ==== 5821+0+0 (secure 0 0 0) 0x7fc2f80bae30 con 0x7fc3080d0550 2024-09-17T05:50:26.298 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:26.297+0000 7fc3067fc640 1 --2- 172.21.15.150:0/303204855 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fc2f407a210 0x7fc2f407c720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:50:26.298 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:26.297+0000 7fc3067fc640 1 --2- 172.21.15.150:0/303204855 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fc2f407a210 0x7fc2f407c720 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7fc3080762c0 tx=0x7fc2fc005df0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:50:26.305 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:26.305+0000 7fc2ef7fe640 1 -- 172.21.15.150:0/303204855 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fc2f803f030 con 0x7fc3080d0550 2024-09-17T05:50:26.485 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:26.485+0000 7fc30d4de640 1 -- 172.21.15.150:0/303204855 --> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fc3080c9510 con 0x7fc2f407a210 2024-09-17T05:50:26.490 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:26.490+0000 7fc2ef7fe640 1 -- 172.21.15.150:0/303204855 <== mgr.4108 v2:172.21.15.176:6800/3631216395 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+252221 (secure 0 0 0) 0x7fc3080c9510 con 0x7fc2f407a210 2024-09-17T05:50:26.493 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-09-17T05:50:26.494 INFO:teuthology.orchestra.run.smithi150.stderr:dumped all 2024-09-17T05:50:26.496 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:26.493+0000 7fc30d4de640 1 -- 172.21.15.150:0/303204855 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fc2f407a210 msgr2=0x7fc2f407c720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:50:26.496 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:26.493+0000 7fc30d4de640 1 --2- 172.21.15.150:0/303204855 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fc2f407a210 0x7fc2f407c720 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7fc3080762c0 tx=0x7fc2fc005df0 comp rx=0 tx=0).stop 2024-09-17T05:50:26.496 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:26.493+0000 7fc30d4de640 1 -- 172.21.15.150:0/303204855 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc3080d0550 msgr2=0x7fc3080c8a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:50:26.496 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:26.493+0000 7fc30d4de640 1 --2- 172.21.15.150:0/303204855 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc3080d0550 0x7fc3080c8a90 secure :-1 s=READY pgs=1334 cs=0 l=1 rev1=1 crypto rx=0x7fc2f8009920 tx=0x7fc2f8033c20 comp rx=0 tx=0).stop 2024-09-17T05:50:26.496 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:26.493+0000 7fc30d4de640 1 -- 172.21.15.150:0/303204855 shutdown_connections 2024-09-17T05:50:26.497 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:26.493+0000 7fc30d4de640 1 --2- 172.21.15.150:0/303204855 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc3080d1060 0x7fc30815cd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:50:26.497 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:26.493+0000 7fc30d4de640 1 --2- 172.21.15.150:0/303204855 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fc2f407a210 0x7fc2f407c720 unknown :-1 s=CLOSED pgs=575 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:50:26.497 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:26.493+0000 7fc30d4de640 1 --2- 172.21.15.150:0/303204855 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc3080d0c50 0x7fc30815c830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:50:26.497 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:26.493+0000 7fc30d4de640 1 --2- 172.21.15.150:0/303204855 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc3080d0550 0x7fc3080c8a90 unknown :-1 s=CLOSED pgs=1334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:50:26.497 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:26.493+0000 7fc30d4de640 1 -- 172.21.15.150:0/303204855 >> 172.21.15.150:0/303204855 conn(0x7fc3080b3fc0 msgr2=0x7fc308071280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:50:26.497 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:26.493+0000 7fc30d4de640 1 -- 172.21.15.150:0/303204855 shutdown_connections 2024-09-17T05:50:26.497 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:26.493+0000 7fc30d4de640 1 -- 172.21.15.150:0/303204855 wait complete. 2024-09-17T05:50:26.505 INFO:teuthology.orchestra.run.smithi150.stdout:{"pg_ready":true,"pg_map":{"version":355,"stamp":"2024-09-17T05:50:25.040837+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":146,"num_write_kb":1642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":111,"ondisk_log_size":111,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":983204,"kb_used_data":10920,"kb_used_omap":12,"kb_used_meta":972083,"kb_avail":753991516,"statfs":{"total":773094113280,"available":772087312384,"internally_reserved":0,"allocated":11182080,"data_stored":5486964,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":995413552},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.002255"},"pg_stats":[{"pgid":"15.3f","version":"0'0","reported_seq":13,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-17T05:50:19.311920+0000","last_change":"2024-09-17T05:50:17.688948+0000","last_active":"2024-09-17T05:50:19.311920+0000","last_peered":"2024-09-17T05:50:19.311920+0000","last_clean":"2024-09-17T05:50:19.311920+0000","last_became_active":"2024-09-17T05:50:17.688664+0000","last_became_peered":"2024-09-17T05:50:17.688664+0000","last_unstale":"2024-09-17T05:50:19.311920+0000","last_undegraded":"2024-09-17T05:50:19.311920+0000","last_fullsized":"2024-09-17T05:50:19.311920+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:50:16.649689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:50:16.649689+0000","last_clean_scrub_stamp":"2024-09-17T05:50:16.649689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:06:43.002286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.3e","version":"0'0","reported_seq":13,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-17T05:50:18.686282+0000","last_change":"2024-09-17T05:50:17.686607+0000","last_active":"2024-09-17T05:50:18.686282+0000","last_peered":"2024-09-17T05:50:18.686282+0000","last_clean":"2024-09-17T05:50:18.686282+0000","last_became_active":"2024-09-17T05:50:17.685913+0000","last_became_peered":"2024-09-17T05:50:17.685913+0000","last_unstale":"2024-09-17T05:50:18.686282+0000","last_undegraded":"2024-09-17T05:50:18.686282+0000","last_fullsized":"2024-09-17T05:50:18.686282+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:50:16.649689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:50:16.649689+0000","last_clean_scrub_stamp":"2024-09-17T05:50:16.649689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:17:42.646673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.3d","version":"0'0","reported_seq":13,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-17T05:50:19.311889+0000","last_change":"2024-09-17T05:50:17.687586+0000","last_active":"2024-09-17T05:50:19.311889+0000","last_peered":"2024-09-17T05:50:19.311889+0000","last_clean":"2024-09-17T05:50:19.311889+0000","last_became_active":"2024-09-17T05:50:17.687288+0000","last_became_peered":"2024-09-17T05:50:17.687288+0000","last_unstale":"2024-09-17T05:50:19.311889+0000","last_undegraded":"2024-09-17T05:50:19.311889+0000","last_fullsized":"2024-09-17T05:50:19.311889+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:50:16.649689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:50:16.649689+0000","last_clean_scrub_stamp":"2024-09-17T05:50:16.649689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:03:58.183061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.3c","version":"0'0","reported_seq":13,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-17T05:50:18.669867+0000","last_change":"2024-09-17T05:50:17.677226+0000","last_active":"2024-09-17T05:50:18.669867+0000","last_peered":"2024-09-17T05:50:18.669867+0000","last_clean":"2024-09-17T05:50:18.669867+0000","last_became_active":"2024-09-17T05:50:17.676607+0000","last_became_peered":"2024-09-17T05:50:17.676607+0000","last_unstale":"2024-09-17T05:50:18.669867+0000","last_undegraded":"2024-09-17T05:50:18.669867+0000","last_fullsized":"2024-09-17T05:50:18.669867+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:50:16.649689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:50:16.649689+0000","last_clean_scrub_stamp":"2024-09-17T05:50:16.649689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:19:02.355387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.3b","version":"0'0","reported_seq":13,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-17T05:50:18.949217+0000","last_change":"2024-09-17T05:50:17.686438+0000","last_active":"2024-09-17T05:50:18.949217+0000","last_peered":"2024-09-17T05:50:18.949217+0000","last_clean":"2024-09-17T05:50:18.949217+0000","last_became_active":"2024-09-17T05:50:17.686137+0000","last_became_peered":"2024-09-17T05:50:17.686137+0000","last_unstale":"2024-09-17T05:50:18.949217+0000","last_undegraded":"2024-09-17T05:50:18.949217+0000","last_fullsized":"2024-09-17T05:50:18.949217+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:50:16.649689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:50:16.649689+0000","last_clean_scrub_stamp":"2024-09-17T05:50:16.649689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:04:42.005182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.3a","version":"0'0","reported_seq":13,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-17T05:50:18.668037+0000","last_change":"2024-09-17T05:50:17.689343+0000","last_active":"2024-09-17T05:50:18.668037+0000","last_peered":"2024-09-17T05:50:18.668037+0000","last_clean":"2024-09-17T05:50:18.668037+0000","last_became_active":"2024-09-17T05:50:17.688942+0000","last_became_peered":"2024-09-17T05:50:17.688942+0000","last_unstale":"2024-09-17T05:50:18.668037+0000","last_undegraded":"2024-09-17T05:50:18.668037+0000","last_fullsized":"2024-09-17T05:50:18.668037+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:50:16.649689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:50:16.649689+0000","last_clean_scrub_stamp":"2024-09-17T05:50:16.649689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:43:41.984110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.39","version":"0'0","reported_seq":13,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-17T05:50:18.667840+0000","last_change":"2024-09-17T05:50:17.689387+0000","last_active":"2024-09-17T05:50:18.667840+0000","last_peered":"2024-09-17T05:50:18.667840+0000","last_clean":"2024-09-17T05:50:18.667840+0000","last_became_active":"2024-09-17T05:50:17.688927+0000","last_became_peered":"2024-09-17T05:50:17.688927+0000","last_unstale":"2024-09-17T05:50:18.667840+0000","last_undegraded":"2024-09-17T05:50:18.667840+0000","last_fullsized":"2024-09-17T05:50:18.667840+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:50:16.649689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:50:16.649689+0000","last_clean_scrub_stamp":"2024-09-17T05:50:16.649689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:40:34.433937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.38","version":"0'0","reported_seq":13,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-17T05:50:18.686276+0000","last_change":"2024-09-17T05:50:17.688288+0000","last_active":"2024-09-17T05:50:18.686276+0000","last_peered":"2024-09-17T05:50:18.686276+0000","last_clean":"2024-09-17T05:50:18.686276+0000","last_became_active":"2024-09-17T05:50:17.687994+0000","last_became_peered":"2024-09-17T05:50:17.687994+0000","last_unstale":"2024-09-17T05:50:18.686276+0000","last_undegraded":"2024-09-17T05:50:18.686276+0000","last_fullsized":"2024-09-17T05:50:18.686276+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:50:16.649689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:50:16.649689+0000","last_clean_scrub_stamp":"2024-09-17T05:50:16.649689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:34:26.313722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.37","version":"0'0","reported_seq":13,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-17T05:50:18.668463+0000","last_change":"2024-09-17T05:50:17.674445+0000","last_active":"2024-09-17T05:50:18.668463+0000","last_peered":"2024-09-17T05:50:18.668463+0000","last_clean":"2024-09-17T05:50:18.668463+0000","last_became_active":"2024-09-17T05:50:17.674111+0000","last_became_peered":"2024-09-17T05:50:17.674111+0000","last_unstale":"2024-09-17T05:50:18.668463+0000","last_undegraded":"2024-09-17T05:50:18.668463+0000","last_fullsized":"2024-09-17T05:50:18.668463+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:50:16.649689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:50:16.649689+0000","last_clean_scrub_stamp":"2024-09-17T05:50:16.649689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:02:39.895120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.36","version":"0'0","reported_seq":13,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-17T05:50:18.949062+0000","last_change":"2024-09-17T05:50:17.691032+0000","last_active":"2024-09-17T05:50:18.949062+0000","last_peered":"2024-09-17T05:50:18.949062+0000","last_clean":"2024-09-17T05:50:18.949062+0000","last_became_active":"2024-09-17T05:50:17.687974+0000","last_became_peered":"2024-09-17T05:50:17.687974+0000","last_unstale":"2024-09-17T05:50:18.949062+0000","last_undegraded":"2024-09-17T05:50:18.949062+0000","last_fullsized":"2024-09-17T05:50:18.949062+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:50:16.649689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:50:16.649689+0000","last_clean_scrub_stamp":"2024-09-17T05:50:16.649689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:16:37.688506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.35","version":"0'0","reported_seq":13,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-17T05:50:18.668324+0000","last_change":"2024-09-17T05:50:17.691868+0000","last_active":"2024-09-17T05:50:18.668324+0000","last_peered":"2024-09-17T05:50:18.668324+0000","last_clean":"2024-09-17T05:50:18.668324+0000","last_became_active":"2024-09-17T05:50:17.691541+0000","last_became_peered":"2024-09-17T05:50:17.691541+0000","last_unstale":"2024-09-17T05:50:18.668324+0000","last_undegraded":"2024-09-17T05:50:18.668324+0000","last_fullsized":"2024-09-17T05:50:18.668324+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:50:16.649689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:50:16.649689+0000","last_clean_scrub_stamp":"2024-09-17T05:50:16.649689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:30:55.806738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.34","version":"0'0","reported_seq":13,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-17T05:50:18.668820+0000","last_change":"2024-09-17T05:50:17.683887+0000","last_active":"2024-09-17T05:50:18.668820+0000","last_peered":"2024-09-17T05:50:18.668820+0000","last_clean":"2024-09-17T05:50:18.668820+0000","last_became_active":"2024-09-17T05:50:17.683522+0000","last_became_peered":"2024-09-17T05:50:17.683522+0000","last_unstale":"2024-09-17T05:50:18.668820+0000","last_undegraded":"2024-09-17T05:50:18.668820+0000","last_fullsized":"2024-09-17T05:50:18.668820+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:50:16.649689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:50:16.649689+0000","last_clean_scrub_stamp":"2024-09-17T05:50:16.649689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:00:55.730379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.33","version":"0'0","reported_seq":13,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-17T05:50:18.669824+0000","last_change":"2024-09-17T05:50:17.674595+0000","last_active":"2024-09-17T05:50:18.669824+0000","last_peered":"2024-09-17T05:50:18.669824+0000","last_clean":"2024-09-17T05:50:18.669824+0000","last_became_active":"2024-09-17T05:50:17.674286+0000","last_became_peered":"2024-09-17T05:50:17.674286+0000","last_unstale":"2024-09-17T05:50:18.669824+0000","last_undegraded":"2024-09-17T05:50:18.669824+0000","last_fullsized":"2024-09-17T05:50:18.669824+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:50:16.649689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:50:16.649689+0000","last_clean_scrub_stamp":"2024-09-17T05:50:16.649689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:06:12.173802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.32","version":"0'0","reported_seq":13,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-17T05:50:18.688698+0000","last_change":"2024-09-17T05:50:17.693635+0000","last_active":"2024-09-17T05:50:18.688698+0000","last_peered":"2024-09-17T05:50:18.688698+0000","last_clean":"2024-09-17T05:50:18.688698+0000","last_became_active":"2024-09-17T05:50:17.693172+0000","last_became_peered":"2024-09-17T05:50:17.693172+0000","last_unstale":"2024-09-17T05:50:18.688698+0000","last_undegraded":"2024-09-17T05:50:18.688698+0000","last_fullsized":"2024-09-17T05:50:18.688698+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:50:16.649689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:50:16.649689+0000","last_clean_scrub_stamp":"2024-09-17T05:50:16.649689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:57:00.165461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.31","version":"0'0","reported_seq":13,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-17T05:50:18.669356+0000","last_change":"2024-09-17T05:50:17.681216+0000","last_active":"2024-09-17T05:50:18.669356+0000","last_peered":"2024-09-17T05:50:18.669356+0000","last_clean":"2024-09-17T05:50:18.669356+0000","last_became_active":"2024-09-17T05:50:17.680783+0000","last_became_peered":"2024-09-17T05:50:17.680783+0000","last_unstale":"2024-09-17T05:50:18.669356+0000","last_undegraded":"2024-09-17T05:50:18.669356+0000","last_fullsized":"2024-09-17T05:50:18.669356+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:50:16.649689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:50:16.649689+0000","last_clean_scrub_stamp":"2024-09-17T05:50:16.649689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:35:47.320102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.30","version":"0'0","reported_seq":13,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-17T05:50:18.668532+0000","last_change":"2024-09-17T05:50:17.699799+0000","last_active":"2024-09-17T05:50:18.668532+0000","last_peered":"2024-09-17T05:50:18.668532+0000","last_clean":"2024-09-17T05:50:18.668532+0000","last_became_active":"2024-09-17T05:50:17.699453+0000","last_became_peered":"2024-09-17T05:50:17.699453+0000","last_unstale":"2024-09-17T05:50:18.668532+0000","last_undegraded":"2024-09-17T05:50:18.668532+0000","last_fullsized":"2024-09-17T05:50:18.668532+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:50:16.649689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:50:16.649689+0000","last_clean_scrub_stamp":"2024-09-17T05:50:16.649689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:27:07.848162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.2f","version":"0'0","reported_seq":13,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-17T05:50:18.686505+0000","last_change":"2024-09-17T05:50:17.686002+0000","last_active":"2024-09-17T05:50:18.686505+0000","last_peered":"2024-09-17T05:50:18.686505+0000","last_clean":"2024-09-17T05:50:18.686505+0000","last_became_active":"2024-09-17T05:50:17.685687+0000","last_became_peered":"2024-09-17T05:50:17.685687+0000","last_unstale":"2024-09-17T05:50:18.686505+0000","last_undegraded":"2024-09-17T05:50:18.686505+0000","last_fullsized":"2024-09-17T05:50:18.686505+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:50:16.649689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:50:16.649689+0000","last_clean_scrub_stamp":"2024-09-17T05:50:16.649689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:46:40.056183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.2e","version":"0'0","reported_seq":13,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-17T05:50:18.669583+0000","last_change":"2024-09-17T05:50:17.676677+0000","last_active":"2024-09-17T05:50:18.669583+0000","last_peered":"2024-09-17T05:50:18.669583+0000","last_clean":"2024-09-17T05:50:18.669583+0000","last_became_active":"2024-09-17T05:50:17.676390+0000","last_became_peered":"2024-09-17T05:50:17.676390+0000","last_unstale":"2024-09-17T05:50:18.669583+0000","last_undegraded":"2024-09-17T05:50:18.669583+0000","last_fullsized":"2024-09-17T05:50:18.669583+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:50:16.649689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:50:16.649689+0000","last_clean_scrub_stamp":"2024-09-17T05:50:16.649689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:39:12.094673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.2d","version":"0'0","reported_seq":13,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-17T05:50:18.688541+0000","last_change":"2024-09-17T05:50:17.689114+0000","last_active":"2024-09-17T05:50:18.688541+0000","last_peered":"2024-09-17T05:50:18.688541+0000","last_clean":"2024-09-17T05:50:18.688541+0000","last_became_active":"2024-09-17T05:50:17.688766+0000","last_became_peered":"2024-09-17T05:50:17.688766+0000","last_unstale":"2024-09-17T05:50:18.688541+0000","last_undegraded":"2024-09-17T05:50:18.688541+0000","last_fullsized":"2024-09-17T05:50:18.688541+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:50:16.649689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:50:16.649689+0000","last_clean_scrub_stamp":"2024-09-17T05:50:16.649689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:29:19.234850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.2c","version":"0'0","reported_seq":13,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-17T05:50:18.669240+0000","last_change":"2024-09-17T05:50:17.674138+0000","last_active":"2024-09-17T05:50:18.669240+0000","last_peered":"2024-09-17T05:50:18.669240+0000","last_clean":"2024-09-17T05:50:18.669240+0000","last_became_active":"2024-09-17T05:50:17.673792+0000","last_became_peered":"2024-09-17T05:50:17.673792+0000","last_unstale":"2024-09-17T05:50:18.669240+0000","last_undegraded":"2024-09-17T05:50:18.669240+0000","last_fullsized":"2024-09-17T05:50:18.669240+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:50:16.649689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:50:16.649689+0000","last_clean_scrub_stamp":"2024-09-17T05:50:16.649689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:00:15.548614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.2b","version":"0'0","reported_seq":13,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-17T05:50:18.688532+0000","last_change":"2024-09-17T05:50:17.679256+0000","last_active":"2024-09-17T05:50:18.688532+0000","last_peered":"2024-09-17T05:50:18.688532+0000","last_clean":"2024-09-17T05:50:18.688532+0000","last_became_active":"2024-09-17T05:50:17.678923+0000","last_became_peered":"2024-09-17T05:50:17.678923+0000","last_unstale":"2024-09-17T05:50:18.688532+0000","last_undegraded":"2024-09-17T05:50:18.688532+0000","last_fullsized":"2024-09-17T05:50:18.688532+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:50:16.649689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:50:16.649689+0000","last_clean_scrub_stamp":"2024-09-17T05:50:16.649689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:03:22.817761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.2a","version":"0'0","reported_seq":13,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-17T05:50:18.686175+0000","last_change":"2024-09-17T05:50:17.687586+0000","last_active":"2024-09-17T05:50:18.686175+0000","last_peered":"2024-09-17T05:50:18.686175+0000","last_clean":"2024-09-17T05:50:18.686175+0000","last_became_active":"2024-09-17T05:50:17.687286+0000","last_became_peered":"2024-09-17T05:50:17.687286+0000","last_unstale":"2024-09-17T05:50:18.686175+0000","last_undegraded":"2024-09-17T05:50:18.686175+0000","last_fullsized":"2024-09-17T05:50:18.686175+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:50:16.649689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:50:16.649689+0000","last_clean_scrub_stamp":"2024-09-17T05:50:16.649689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:02:00.945244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.29","version":"0'0","reported_seq":13,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-17T05:50:18.686290+0000","last_change":"2024-09-17T05:50:17.688190+0000","last_active":"2024-09-17T05:50:18.686290+0000","last_peered":"2024-09-17T05:50:18.686290+0000","last_clean":"2024-09-17T05:50:18.686290+0000","last_became_active":"2024-09-17T05:50:17.687362+0000","last_became_peered":"2024-09-17T05:50:17.687362+0000","last_unstale":"2024-09-17T05:50:18.686290+0000","last_undegraded":"2024-09-17T05:50:18.686290+0000","last_fullsized":"2024-09-17T05:50:18.686290+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:50:16.649689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:50:16.649689+0000","last_clean_scrub_stamp":"2024-09-17T05:50:16.649689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:41:16.543702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.28","version":"0'0","reported_seq":13,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-17T05:50:18.668665+0000","last_change":"2024-09-17T05:50:17.689555+0000","last_active":"2024-09-17T05:50:18.668665+0000","last_peered":"2024-09-17T05:50:18.668665+0000","last_clean":"2024-09-17T05:50:18.668665+0000","last_became_active":"2024-09-17T05:50:17.689175+0000","last_became_peered":"2024-09-17T05:50:17.689175+0000","last_unstale":"2024-09-17T05:50:18.668665+0000","last_undegraded":"2024-09-17T05:50:18.668665+0000","last_fullsized":"2024-09-17T05:50:18.668665+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:50:16.649689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:50:16.649689+0000","last_clean_scrub_stamp":"2024-09-17T05:50:16.649689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:26:34.724420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.27","version":"0'0","reported_seq":13,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-17T05:50:18.949261+0000","last_change":"2024-09-17T05:50:17.701876+0000","last_active":"2024-09-17T05:50:18.949261+0000","last_peered":"2024-09-17T05:50:18.949261+0000","last_clean":"2024-09-17T05:50:18.949261+0000","last_became_active":"2024-09-17T05:50:17.701586+0000","last_became_peered":"2024-09-17T05:50:17.701586+0000","last_unstale":"2024-09-17T05:50:18.949261+0000","last_undegraded":"2024-09-17T05:50:18.949261+0000","last_fullsized":"2024-09-17T05:50:18.949261+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:50:16.649689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:50:16.649689+0000","last_clean_scrub_stamp":"2024-09-17T05:50:16.649689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:39:03.499084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.26","version":"0'0","reported_seq":13,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-17T05:50:18.686526+0000","last_change":"2024-09-17T05:50:17.689166+0000","last_active":"2024-09-17T05:50:18.686526+0000","last_peered":"2024-09-17T05:50:18.686526+0000","last_clean":"2024-09-17T05:50:18.686526+0000","last_became_active":"2024-09-17T05:50:17.688880+0000","last_became_peered":"2024-09-17T05:50:17.688880+0000","last_unstale":"2024-09-17T05:50:18.686526+0000","last_undegraded":"2024-09-17T05:50:18.686526+0000","last_fullsized":"2024-09-17T05:50:18.686526+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:50:16.649689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:50:16.649689+0000","last_clean_scrub_stamp":"2024-09-17T05:50:16.649689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:23:08.770975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.25","version":"0'0","reported_seq":13,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-17T05:50:18.669057+0000","last_change":"2024-09-17T05:50:17.690690+0000","last_active":"2024-09-17T05:50:18.669057+0000","last_peered":"2024-09-17T05:50:18.669057+0000","last_clean":"2024-09-17T05:50:18.669057+0000","last_became_active":"2024-09-17T05:50:17.690283+0000","last_became_peered":"2024-09-17T05:50:17.690283+0000","last_unstale":"2024-09-17T05:50:18.669057+0000","last_undegraded":"2024-09-17T05:50:18.669057+0000","last_fullsized":"2024-09-17T05:50:18.669057+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:50:16.649689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:50:16.649689+0000","last_clean_scrub_stamp":"2024-09-17T05:50:16.649689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:05:53.683352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.24","version":"0'0","reported_seq":13,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-17T05:50:18.949254+0000","last_change":"2024-09-17T05:50:17.686896+0000","last_active":"2024-09-17T05:50:18.949254+0000","last_peered":"2024-09-17T05:50:18.949254+0000","last_clean":"2024-09-17T05:50:18.949254+0000","last_became_active":"2024-09-17T05:50:17.686613+0000","last_became_peered":"2024-09-17T05:50:17.686613+0000","last_unstale":"2024-09-17T05:50:18.949254+0000","last_undegraded":"2024-09-17T05:50:18.949254+0000","last_fullsized":"2024-09-17T05:50:18.949254+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:50:16.649689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:50:16.649689+0000","last_clean_scrub_stamp":"2024-09-17T05:50:16.649689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:07:26.633748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.23","version":"0'0","reported_seq":13,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-17T05:50:18.686333+0000","last_change":"2024-09-17T05:50:17.693673+0000","last_active":"2024-09-17T05:50:18.686333+0000","last_peered":"2024-09-17T05:50:18.686333+0000","last_clean":"2024-09-17T05:50:18.686333+0000","last_became_active":"2024-09-17T05:50:17.693131+0000","last_became_peered":"2024-09-17T05:50:17.693131+0000","last_unstale":"2024-09-17T05:50:18.686333+0000","last_undegraded":"2024-09-17T05:50:18.686333+0000","last_fullsized":"2024-09-17T05:50:18.686333+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:50:16.649689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:50:16.649689+0000","last_clean_scrub_stamp":"2024-09-17T05:50:16.649689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:31:33.444956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.22","version":"0'0","reported_seq":13,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-17T05:50:18.688368+0000","last_change":"2024-09-17T05:50:17.691649+0000","last_active":"2024-09-17T05:50:18.688368+0000","last_peered":"2024-09-17T05:50:18.688368+0000","last_clean":"2024-09-17T05:50:18.688368+0000","last_became_active":"2024-09-17T05:50:17.691303+0000","last_became_peered":"2024-09-17T05:50:17.691303+0000","last_unstale":"2024-09-17T05:50:18.688368+0000","last_undegraded":"2024-09-17T05:50:18.688368+0000","last_fullsized":"2024-09-17T05:50:18.688368+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:50:16.649689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:50:16.649689+0000","last_clean_scrub_stamp":"2024-09-17T05:50:16.649689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:59:17.484476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.21","version":"0'0","reported_seq":13,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-17T05:50:18.669595+0000","last_change":"2024-09-17T05:50:17.686575+0000","last_active":"2024-09-17T05:50:18.669595+0000","last_peered":"2024-09-17T05:50:18.669595+0000","last_clean":"2024-09-17T05:50:18.669595+0000","last_became_active":"2024-09-17T05:50:17.684031+0000","last_became_peered":"2024-09-17T05:50:17.684031+0000","last_unstale":"2024-09-17T05:50:18.669595+0000","last_undegraded":"2024-09-17T05:50:18.669595+0000","last_fullsized":"2024-09-17T05:50:18.669595+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:50:16.649689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:50:16.649689+0000","last_clean_scrub_stamp":"2024-09-17T05:50:16.649689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:22:37.891115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.20","version":"0'0","reported_seq":13,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-17T05:50:19.311700+0000","last_change":"2024-09-17T05:50:17.690605+0000","last_active":"2024-09-17T05:50:19.311700+0000","last_peered":"2024-09-17T05:50:19.311700+0000","last_clean":"2024-09-17T05:50:19.311700+0000","last_became_active":"2024-09-17T05:50:17.690127+0000","last_became_peered":"2024-09-17T05:50:17.690127+0000","last_unstale":"2024-09-17T05:50:19.311700+0000","last_undegraded":"2024-09-17T05:50:19.311700+0000","last_fullsized":"2024-09-17T05:50:19.311700+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:50:16.649689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:50:16.649689+0000","last_clean_scrub_stamp":"2024-09-17T05:50:16.649689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:28:24.084507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.1e","version":"0'0","reported_seq":13,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-17T05:50:18.688613+0000","last_change":"2024-09-17T05:50:17.678131+0000","last_active":"2024-09-17T05:50:18.688613+0000","last_peered":"2024-09-17T05:50:18.688613+0000","last_clean":"2024-09-17T05:50:18.688613+0000","last_became_active":"2024-09-17T05:50:17.677816+0000","last_became_peered":"2024-09-17T05:50:17.677816+0000","last_unstale":"2024-09-17T05:50:18.688613+0000","last_undegraded":"2024-09-17T05:50:18.688613+0000","last_fullsized":"2024-09-17T05:50:18.688613+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:50:16.649689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:50:16.649689+0000","last_clean_scrub_stamp":"2024-09-17T05:50:16.649689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:14:25.890557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.1f","version":"100'4","reported_seq":19,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-17T05:50:18.686498+0000","last_change":"2024-09-17T05:50:16.666928+0000","last_active":"2024-09-17T05:50:18.686498+0000","last_peered":"2024-09-17T05:50:18.686498+0000","last_clean":"2024-09-17T05:50:18.686498+0000","last_became_active":"2024-09-17T05:50:16.666550+0000","last_became_peered":"2024-09-17T05:50:16.666550+0000","last_unstale":"2024-09-17T05:50:18.686498+0000","last_undegraded":"2024-09-17T05:50:18.686498+0000","last_fullsized":"2024-09-17T05:50:18.686498+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:50:15.639879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:50:15.639879+0000","last_clean_scrub_stamp":"2024-09-17T05:50:15.639879+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:57:05.869839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1f","version":"0'0","reported_seq":13,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-17T05:50:18.669960+0000","last_change":"2024-09-17T05:50:17.684448+0000","last_active":"2024-09-17T05:50:18.669960+0000","last_peered":"2024-09-17T05:50:18.669960+0000","last_clean":"2024-09-17T05:50:18.669960+0000","last_became_active":"2024-09-17T05:50:17.684014+0000","last_became_peered":"2024-09-17T05:50:17.684014+0000","last_unstale":"2024-09-17T05:50:18.669960+0000","last_undegraded":"2024-09-17T05:50:18.669960+0000","last_fullsized":"2024-09-17T05:50:18.669960+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:50:16.649689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:50:16.649689+0000","last_clean_scrub_stamp":"2024-09-17T05:50:16.649689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:16:14.602391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.1e","version":"100'1","reported_seq":16,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-17T05:50:18.668133+0000","last_change":"2024-09-17T05:50:16.676369+0000","last_active":"2024-09-17T05:50:18.668133+0000","last_peered":"2024-09-17T05:50:18.668133+0000","last_clean":"2024-09-17T05:50:18.668133+0000","last_became_active":"2024-09-17T05:50:16.676073+0000","last_became_peered":"2024-09-17T05:50:16.676073+0000","last_unstale":"2024-09-17T05:50:18.668133+0000","last_undegraded":"2024-09-17T05:50:18.668133+0000","last_fullsized":"2024-09-17T05:50:18.668133+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:50:15.639879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:50:15.639879+0000","last_clean_scrub_stamp":"2024-09-17T05:50:15.639879+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:32:00.453681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.1c","version":"0'0","reported_seq":13,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-17T05:50:19.312113+0000","last_change":"2024-09-17T05:50:17.686482+0000","last_active":"2024-09-17T05:50:19.312113+0000","last_peered":"2024-09-17T05:50:19.312113+0000","last_clean":"2024-09-17T05:50:19.312113+0000","last_became_active":"2024-09-17T05:50:17.685224+0000","last_became_peered":"2024-09-17T05:50:17.685224+0000","last_unstale":"2024-09-17T05:50:19.312113+0000","last_undegraded":"2024-09-17T05:50:19.312113+0000","last_fullsized":"2024-09-17T05:50:19.312113+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:50:16.649689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:50:16.649689+0000","last_clean_scrub_stamp":"2024-09-17T05:50:16.649689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:24:17.789435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.1d","version":"100'2","reported_seq":17,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-17T05:50:18.686557+0000","last_change":"2024-09-17T05:50:16.678328+0000","last_active":"2024-09-17T05:50:18.686557+0000","last_peered":"2024-09-17T05:50:18.686557+0000","last_clean":"2024-09-17T05:50:18.686557+0000","last_became_active":"2024-09-17T05:50:16.677911+0000","last_became_peered":"2024-09-17T05:50:16.677911+0000","last_unstale":"2024-09-17T05:50:18.686557+0000","last_undegraded":"2024-09-17T05:50:18.686557+0000","last_fullsized":"2024-09-17T05:50:18.686557+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:50:15.639879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:50:15.639879+0000","last_clean_scrub_stamp":"2024-09-17T05:50:15.639879+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:12:56.944695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1d","version":"0'0","reported_seq":13,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-17T05:50:18.669395+0000","last_change":"2024-09-17T05:50:17.681462+0000","last_active":"2024-09-17T05:50:18.669395+0000","last_peered":"2024-09-17T05:50:18.669395+0000","last_clean":"2024-09-17T05:50:18.669395+0000","last_became_active":"2024-09-17T05:50:17.681107+0000","last_became_peered":"2024-09-17T05:50:17.681107+0000","last_unstale":"2024-09-17T05:50:18.669395+0000","last_undegraded":"2024-09-17T05:50:18.669395+0000","last_fullsized":"2024-09-17T05:50:18.669395+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:50:16.649689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:50:16.649689+0000","last_clean_scrub_stamp":"2024-09-17T05:50:16.649689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:54:44.529271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.1c","version":"100'2","reported_seq":17,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-17T05:50:18.686501+0000","last_change":"2024-09-17T05:50:16.677342+0000","last_active":"2024-09-17T05:50:18.686501+0000","last_peered":"2024-09-17T05:50:18.686501+0000","last_clean":"2024-09-17T05:50:18.686501+0000","last_became_active":"2024-09-17T05:50:16.674956+0000","last_became_peered":"2024-09-17T05:50:16.674956+0000","last_unstale":"2024-09-17T05:50:18.686501+0000","last_undegraded":"2024-09-17T05:50:18.686501+0000","last_fullsized":"2024-09-17T05:50:18.686501+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:50:15.639879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:50:15.639879+0000","last_clean_scrub_stamp":"2024-09-17T05:50:15.639879+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:36:51.832130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1a","version":"0'0","reported_seq":13,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-17T05:50:19.312949+0000","last_change":"2024-09-17T05:50:17.686834+0000","last_active":"2024-09-17T05:50:19.312949+0000","last_peered":"2024-09-17T05:50:19.312949+0000","last_clean":"2024-09-17T05:50:19.312949+0000","last_became_active":"2024-09-17T05:50:17.686443+0000","last_became_peered":"2024-09-17T05:50:17.686443+0000","last_unstale":"2024-09-17T05:50:19.312949+0000","last_undegraded":"2024-09-17T05:50:19.312949+0000","last_fullsized":"2024-09-17T05:50:19.312949+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:50:16.649689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:50:16.649689+0000","last_clean_scrub_stamp":"2024-09-17T05:50:16.649689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:01:44.594734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.1b","version":"100'1","reported_seq":16,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-17T05:50:19.311775+0000","last_change":"2024-09-17T05:50:16.671491+0000","last_active":"2024-09-17T05:50:19.311775+0000","last_peered":"2024-09-17T05:50:19.311775+0000","last_clean":"2024-09-17T05:50:19.311775+0000","last_became_active":"2024-09-17T05:50:16.671150+0000","last_became_peered":"2024-09-17T05:50:16.671150+0000","last_unstale":"2024-09-17T05:50:19.311775+0000","last_undegraded":"2024-09-17T05:50:19.311775+0000","last_fullsized":"2024-09-17T05:50:19.311775+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:50:15.639879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:50:15.639879+0000","last_clean_scrub_stamp":"2024-09-17T05:50:15.639879+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:56:38.653716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.1b","version":"0'0","reported_seq":13,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-17T05:50:18.667880+0000","last_change":"2024-09-17T05:50:17.685341+0000","last_active":"2024-09-17T05:50:18.667880+0000","last_peered":"2024-09-17T05:50:18.667880+0000","last_clean":"2024-09-17T05:50:18.667880+0000","last_became_active":"2024-09-17T05:50:17.685003+0000","last_became_peered":"2024-09-17T05:50:17.685003+0000","last_unstale":"2024-09-17T05:50:18.667880+0000","last_undegraded":"2024-09-17T05:50:18.667880+0000","last_fullsized":"2024-09-17T05:50:18.667880+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:50:16.649689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:50:16.649689+0000","last_clean_scrub_stamp":"2024-09-17T05:50:16.649689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:14:12.968153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.1a","version":"100'1","reported_seq":16,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-17T05:50:18.686071+0000","last_change":"2024-09-17T05:50:16.673854+0000","last_active":"2024-09-17T05:50:18.686071+0000","last_peered":"2024-09-17T05:50:18.686071+0000","last_clean":"2024-09-17T05:50:18.686071+0000","last_became_active":"2024-09-17T05:50:16.673522+0000","last_became_peered":"2024-09-17T05:50:16.673522+0000","last_unstale":"2024-09-17T05:50:18.686071+0000","last_undegraded":"2024-09-17T05:50:18.686071+0000","last_fullsized":"2024-09-17T05:50:18.686071+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:50:15.639879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:50:15.639879+0000","last_clean_scrub_stamp":"2024-09-17T05:50:15.639879+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:05:57.341308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.18","version":"0'0","reported_seq":13,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-17T05:50:18.669407+0000","last_change":"2024-09-17T05:50:17.684654+0000","last_active":"2024-09-17T05:50:18.669407+0000","last_peered":"2024-09-17T05:50:18.669407+0000","last_clean":"2024-09-17T05:50:18.669407+0000","last_became_active":"2024-09-17T05:50:17.684313+0000","last_became_peered":"2024-09-17T05:50:17.684313+0000","last_unstale":"2024-09-17T05:50:18.669407+0000","last_undegraded":"2024-09-17T05:50:18.669407+0000","last_fullsized":"2024-09-17T05:50:18.669407+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:50:16.649689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:50:16.649689+0000","last_clean_scrub_stamp":"2024-09-17T05:50:16.649689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:55:45.553826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.19","version":"0'0","reported_seq":15,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-17T05:50:18.949203+0000","last_change":"2024-09-17T05:50:16.674238+0000","last_active":"2024-09-17T05:50:18.949203+0000","last_peered":"2024-09-17T05:50:18.949203+0000","last_clean":"2024-09-17T05:50:18.949203+0000","last_became_active":"2024-09-17T05:50:16.673875+0000","last_became_peered":"2024-09-17T05:50:16.673875+0000","last_unstale":"2024-09-17T05:50:18.949203+0000","last_undegraded":"2024-09-17T05:50:18.949203+0000","last_fullsized":"2024-09-17T05:50:18.949203+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:50:15.639879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:50:15.639879+0000","last_clean_scrub_stamp":"2024-09-17T05:50:15.639879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:01:35.637247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.19","version":"0'0","reported_seq":13,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-17T05:50:18.668463+0000","last_change":"2024-09-17T05:50:17.680474+0000","last_active":"2024-09-17T05:50:18.668463+0000","last_peered":"2024-09-17T05:50:18.668463+0000","last_clean":"2024-09-17T05:50:18.668463+0000","last_became_active":"2024-09-17T05:50:17.680154+0000","last_became_peered":"2024-09-17T05:50:17.680154+0000","last_unstale":"2024-09-17T05:50:18.668463+0000","last_undegraded":"2024-09-17T05:50:18.668463+0000","last_fullsized":"2024-09-17T05:50:18.668463+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:50:16.649689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:50:16.649689+0000","last_clean_scrub_stamp":"2024-09-17T05:50:16.649689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:39:58.578693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.18","version":"0'0","reported_seq":15,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-17T05:50:19.311696+0000","last_change":"2024-09-17T05:50:16.672581+0000","last_active":"2024-09-17T05:50:19.311696+0000","last_peered":"2024-09-17T05:50:19.311696+0000","last_clean":"2024-09-17T05:50:19.311696+0000","last_became_active":"2024-09-17T05:50:16.671816+0000","last_became_peered":"2024-09-17T05:50:16.671816+0000","last_unstale":"2024-09-17T05:50:19.311696+0000","last_undegraded":"2024-09-17T05:50:19.311696+0000","last_fullsized":"2024-09-17T05:50:19.311696+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:50:15.639879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:50:15.639879+0000","last_clean_scrub_stamp":"2024-09-17T05:50:15.639879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:38:42.681739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.16","version":"0'0","reported_seq":13,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-17T05:50:18.686665+0000","last_change":"2024-09-17T05:50:17.686260+0000","last_active":"2024-09-17T05:50:18.686665+0000","last_peered":"2024-09-17T05:50:18.686665+0000","last_clean":"2024-09-17T05:50:18.686665+0000","last_became_active":"2024-09-17T05:50:17.685507+0000","last_became_peered":"2024-09-17T05:50:17.685507+0000","last_unstale":"2024-09-17T05:50:18.686665+0000","last_undegraded":"2024-09-17T05:50:18.686665+0000","last_fullsized":"2024-09-17T05:50:18.686665+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:50:16.649689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:50:16.649689+0000","last_clean_scrub_stamp":"2024-09-17T05:50:16.649689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:46:25.261334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.17","version":"0'0","reported_seq":15,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-17T05:50:19.312192+0000","last_change":"2024-09-17T05:50:16.666782+0000","last_active":"2024-09-17T05:50:19.312192+0000","last_peered":"2024-09-17T05:50:19.312192+0000","last_clean":"2024-09-17T05:50:19.312192+0000","last_became_active":"2024-09-17T05:50:16.666353+0000","last_became_peered":"2024-09-17T05:50:16.666353+0000","last_unstale":"2024-09-17T05:50:19.312192+0000","last_undegraded":"2024-09-17T05:50:19.312192+0000","last_fullsized":"2024-09-17T05:50:19.312192+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:50:15.639879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:50:15.639879+0000","last_clean_scrub_stamp":"2024-09-17T05:50:15.639879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:08:52.158143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.17","version":"0'0","reported_seq":13,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-17T05:50:18.668700+0000","last_change":"2024-09-17T05:50:17.689619+0000","last_active":"2024-09-17T05:50:18.668700+0000","last_peered":"2024-09-17T05:50:18.668700+0000","last_clean":"2024-09-17T05:50:18.668700+0000","last_became_active":"2024-09-17T05:50:17.689296+0000","last_became_peered":"2024-09-17T05:50:17.689296+0000","last_unstale":"2024-09-17T05:50:18.668700+0000","last_undegraded":"2024-09-17T05:50:18.668700+0000","last_fullsized":"2024-09-17T05:50:18.668700+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:50:16.649689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:50:16.649689+0000","last_clean_scrub_stamp":"2024-09-17T05:50:16.649689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:18:36.889653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.16","version":"0'0","reported_seq":15,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-17T05:50:18.669543+0000","last_change":"2024-09-17T05:50:16.666739+0000","last_active":"2024-09-17T05:50:18.669543+0000","last_peered":"2024-09-17T05:50:18.669543+0000","last_clean":"2024-09-17T05:50:18.669543+0000","last_became_active":"2024-09-17T05:50:16.666351+0000","last_became_peered":"2024-09-17T05:50:16.666351+0000","last_unstale":"2024-09-17T05:50:18.669543+0000","last_undegraded":"2024-09-17T05:50:18.669543+0000","last_fullsized":"2024-09-17T05:50:18.669543+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:50:15.639879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:50:15.639879+0000","last_clean_scrub_stamp":"2024-09-17T05:50:15.639879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:02:39.092792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.14","version":"0'0","reported_seq":13,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-17T05:50:18.949276+0000","last_change":"2024-09-17T05:50:17.700910+0000","last_active":"2024-09-17T05:50:18.949276+0000","last_peered":"2024-09-17T05:50:18.949276+0000","last_clean":"2024-09-17T05:50:18.949276+0000","last_became_active":"2024-09-17T05:50:17.700244+0000","last_became_peered":"2024-09-17T05:50:17.700244+0000","last_unstale":"2024-09-17T05:50:18.949276+0000","last_undegraded":"2024-09-17T05:50:18.949276+0000","last_fullsized":"2024-09-17T05:50:18.949276+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:50:16.649689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:50:16.649689+0000","last_clean_scrub_stamp":"2024-09-17T05:50:16.649689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:34:21.056671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.15","version":"100'3","reported_seq":18,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-17T05:50:18.669519+0000","last_change":"2024-09-17T05:50:16.673400+0000","last_active":"2024-09-17T05:50:18.669519+0000","last_peered":"2024-09-17T05:50:18.669519+0000","last_clean":"2024-09-17T05:50:18.669519+0000","last_became_active":"2024-09-17T05:50:16.673068+0000","last_became_peered":"2024-09-17T05:50:16.673068+0000","last_unstale":"2024-09-17T05:50:18.669519+0000","last_undegraded":"2024-09-17T05:50:18.669519+0000","last_fullsized":"2024-09-17T05:50:18.669519+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:50:15.639879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:50:15.639879+0000","last_clean_scrub_stamp":"2024-09-17T05:50:15.639879+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:17:06.188308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.15","version":"0'0","reported_seq":13,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-17T05:50:18.669125+0000","last_change":"2024-09-17T05:50:17.700722+0000","last_active":"2024-09-17T05:50:18.669125+0000","last_peered":"2024-09-17T05:50:18.669125+0000","last_clean":"2024-09-17T05:50:18.669125+0000","last_became_active":"2024-09-17T05:50:17.699976+0000","last_became_peered":"2024-09-17T05:50:17.699976+0000","last_unstale":"2024-09-17T05:50:18.669125+0000","last_undegraded":"2024-09-17T05:50:18.669125+0000","last_fullsized":"2024-09-17T05:50:18.669125+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:50:16.649689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:50:16.649689+0000","last_clean_scrub_stamp":"2024-09-17T05:50:16.649689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:04:24.869963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.14","version":"100'6","reported_seq":21,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-17T05:50:18.668998+0000","last_change":"2024-09-17T05:50:16.663464+0000","last_active":"2024-09-17T05:50:18.668998+0000","last_peered":"2024-09-17T05:50:18.668998+0000","last_clean":"2024-09-17T05:50:18.668998+0000","last_became_active":"2024-09-17T05:50:16.663147+0000","last_became_peered":"2024-09-17T05:50:16.663147+0000","last_unstale":"2024-09-17T05:50:18.668998+0000","last_undegraded":"2024-09-17T05:50:18.668998+0000","last_fullsized":"2024-09-17T05:50:18.668998+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:50:15.639879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:50:15.639879+0000","last_clean_scrub_stamp":"2024-09-17T05:50:15.639879+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:12:46.562781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.12","version":"0'0","reported_seq":13,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-17T05:50:18.669692+0000","last_change":"2024-09-17T05:50:17.678910+0000","last_active":"2024-09-17T05:50:18.669692+0000","last_peered":"2024-09-17T05:50:18.669692+0000","last_clean":"2024-09-17T05:50:18.669692+0000","last_became_active":"2024-09-17T05:50:17.678520+0000","last_became_peered":"2024-09-17T05:50:17.678520+0000","last_unstale":"2024-09-17T05:50:18.669692+0000","last_undegraded":"2024-09-17T05:50:18.669692+0000","last_fullsized":"2024-09-17T05:50:18.669692+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:50:16.649689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:50:16.649689+0000","last_clean_scrub_stamp":"2024-09-17T05:50:16.649689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:53:12.068807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.13","version":"100'2","reported_seq":17,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-17T05:50:18.688799+0000","last_change":"2024-09-17T05:50:16.677999+0000","last_active":"2024-09-17T05:50:18.688799+0000","last_peered":"2024-09-17T05:50:18.688799+0000","last_clean":"2024-09-17T05:50:18.688799+0000","last_became_active":"2024-09-17T05:50:16.677675+0000","last_became_peered":"2024-09-17T05:50:16.677675+0000","last_unstale":"2024-09-17T05:50:18.688799+0000","last_undegraded":"2024-09-17T05:50:18.688799+0000","last_fullsized":"2024-09-17T05:50:18.688799+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:50:15.639879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:50:15.639879+0000","last_clean_scrub_stamp":"2024-09-17T05:50:15.639879+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:52:12.200476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.13","version":"0'0","reported_seq":13,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-17T05:50:19.311891+0000","last_change":"2024-09-17T05:50:17.683595+0000","last_active":"2024-09-17T05:50:19.311891+0000","last_peered":"2024-09-17T05:50:19.311891+0000","last_clean":"2024-09-17T05:50:19.311891+0000","last_became_active":"2024-09-17T05:50:17.683280+0000","last_became_peered":"2024-09-17T05:50:17.683280+0000","last_unstale":"2024-09-17T05:50:19.311891+0000","last_undegraded":"2024-09-17T05:50:19.311891+0000","last_fullsized":"2024-09-17T05:50:19.311891+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:50:16.649689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:50:16.649689+0000","last_clean_scrub_stamp":"2024-09-17T05:50:16.649689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:53:13.483508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.12","version":"0'0","reported_seq":15,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-17T05:50:18.688883+0000","last_change":"2024-09-17T05:50:16.672657+0000","last_active":"2024-09-17T05:50:18.688883+0000","last_peered":"2024-09-17T05:50:18.688883+0000","last_clean":"2024-09-17T05:50:18.688883+0000","last_became_active":"2024-09-17T05:50:16.672353+0000","last_became_peered":"2024-09-17T05:50:16.672353+0000","last_unstale":"2024-09-17T05:50:18.688883+0000","last_undegraded":"2024-09-17T05:50:18.688883+0000","last_fullsized":"2024-09-17T05:50:18.688883+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:50:15.639879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:50:15.639879+0000","last_clean_scrub_stamp":"2024-09-17T05:50:15.639879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:31:01.840132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.10","version":"0'0","reported_seq":13,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-17T05:50:18.667787+0000","last_change":"2024-09-17T05:50:17.679597+0000","last_active":"2024-09-17T05:50:18.667787+0000","last_peered":"2024-09-17T05:50:18.667787+0000","last_clean":"2024-09-17T05:50:18.667787+0000","last_became_active":"2024-09-17T05:50:17.679272+0000","last_became_peered":"2024-09-17T05:50:17.679272+0000","last_unstale":"2024-09-17T05:50:18.667787+0000","last_undegraded":"2024-09-17T05:50:18.667787+0000","last_fullsized":"2024-09-17T05:50:18.667787+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:50:16.649689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:50:16.649689+0000","last_clean_scrub_stamp":"2024-09-17T05:50:16.649689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:31:55.605959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.11","version":"0'0","reported_seq":15,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-17T05:50:18.668995+0000","last_change":"2024-09-17T05:50:16.663949+0000","last_active":"2024-09-17T05:50:18.668995+0000","last_peered":"2024-09-17T05:50:18.668995+0000","last_clean":"2024-09-17T05:50:18.668995+0000","last_became_active":"2024-09-17T05:50:16.663594+0000","last_became_peered":"2024-09-17T05:50:16.663594+0000","last_unstale":"2024-09-17T05:50:18.668995+0000","last_undegraded":"2024-09-17T05:50:18.668995+0000","last_fullsized":"2024-09-17T05:50:18.668995+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:50:15.639879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:50:15.639879+0000","last_clean_scrub_stamp":"2024-09-17T05:50:15.639879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:51:28.101496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.11","version":"0'0","reported_seq":13,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-17T05:50:18.688402+0000","last_change":"2024-09-17T05:50:17.673526+0000","last_active":"2024-09-17T05:50:18.688402+0000","last_peered":"2024-09-17T05:50:18.688402+0000","last_clean":"2024-09-17T05:50:18.688402+0000","last_became_active":"2024-09-17T05:50:17.673209+0000","last_became_peered":"2024-09-17T05:50:17.673209+0000","last_unstale":"2024-09-17T05:50:18.688402+0000","last_undegraded":"2024-09-17T05:50:18.688402+0000","last_fullsized":"2024-09-17T05:50:18.688402+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:50:16.649689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:50:16.649689+0000","last_clean_scrub_stamp":"2024-09-17T05:50:16.649689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:25:22.508515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.10","version":"100'8","reported_seq":23,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-17T05:50:19.312007+0000","last_change":"2024-09-17T05:50:16.671667+0000","last_active":"2024-09-17T05:50:19.312007+0000","last_peered":"2024-09-17T05:50:19.312007+0000","last_clean":"2024-09-17T05:50:19.312007+0000","last_became_active":"2024-09-17T05:50:16.671069+0000","last_became_peered":"2024-09-17T05:50:16.671069+0000","last_unstale":"2024-09-17T05:50:19.312007+0000","last_undegraded":"2024-09-17T05:50:19.312007+0000","last_fullsized":"2024-09-17T05:50:19.312007+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:50:15.639879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:50:15.639879+0000","last_clean_scrub_stamp":"2024-09-17T05:50:15.639879+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:54:11.413425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.f","version":"0'0","reported_seq":13,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-17T05:50:18.949369+0000","last_change":"2024-09-17T05:50:17.693101+0000","last_active":"2024-09-17T05:50:18.949369+0000","last_peered":"2024-09-17T05:50:18.949369+0000","last_clean":"2024-09-17T05:50:18.949369+0000","last_became_active":"2024-09-17T05:50:17.692530+0000","last_became_peered":"2024-09-17T05:50:17.692530+0000","last_unstale":"2024-09-17T05:50:18.949369+0000","last_undegraded":"2024-09-17T05:50:18.949369+0000","last_fullsized":"2024-09-17T05:50:18.949369+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:50:16.649689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:50:16.649689+0000","last_clean_scrub_stamp":"2024-09-17T05:50:16.649689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:42:28.166479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.e","version":"100'2","reported_seq":17,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-17T05:50:18.668210+0000","last_change":"2024-09-17T05:50:16.676692+0000","last_active":"2024-09-17T05:50:18.668210+0000","last_peered":"2024-09-17T05:50:18.668210+0000","last_clean":"2024-09-17T05:50:18.668210+0000","last_became_active":"2024-09-17T05:50:16.676330+0000","last_became_peered":"2024-09-17T05:50:16.676330+0000","last_unstale":"2024-09-17T05:50:18.668210+0000","last_undegraded":"2024-09-17T05:50:18.668210+0000","last_fullsized":"2024-09-17T05:50:18.668210+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:50:15.639879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:50:15.639879+0000","last_clean_scrub_stamp":"2024-09-17T05:50:15.639879+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:11:37.328920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.c","version":"0'0","reported_seq":13,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-17T05:50:19.313016+0000","last_change":"2024-09-17T05:50:17.694120+0000","last_active":"2024-09-17T05:50:19.313016+0000","last_peered":"2024-09-17T05:50:19.313016+0000","last_clean":"2024-09-17T05:50:19.313016+0000","last_became_active":"2024-09-17T05:50:17.693757+0000","last_became_peered":"2024-09-17T05:50:17.693757+0000","last_unstale":"2024-09-17T05:50:19.313016+0000","last_undegraded":"2024-09-17T05:50:19.313016+0000","last_fullsized":"2024-09-17T05:50:19.313016+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:50:16.649689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:50:16.649689+0000","last_clean_scrub_stamp":"2024-09-17T05:50:16.649689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:11:38.338730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.d","version":"100'1","reported_seq":16,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-17T05:50:18.948929+0000","last_change":"2024-09-17T05:50:16.663432+0000","last_active":"2024-09-17T05:50:18.948929+0000","last_peered":"2024-09-17T05:50:18.948929+0000","last_clean":"2024-09-17T05:50:18.948929+0000","last_became_active":"2024-09-17T05:50:16.663096+0000","last_became_peered":"2024-09-17T05:50:16.663096+0000","last_unstale":"2024-09-17T05:50:18.948929+0000","last_undegraded":"2024-09-17T05:50:18.948929+0000","last_fullsized":"2024-09-17T05:50:18.948929+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:50:15.639879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:50:15.639879+0000","last_clean_scrub_stamp":"2024-09-17T05:50:15.639879+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:31:07.149126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.d","version":"0'0","reported_seq":13,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-17T05:50:18.669323+0000","last_change":"2024-09-17T05:50:17.692323+0000","last_active":"2024-09-17T05:50:18.669323+0000","last_peered":"2024-09-17T05:50:18.669323+0000","last_clean":"2024-09-17T05:50:18.669323+0000","last_became_active":"2024-09-17T05:50:17.691635+0000","last_became_peered":"2024-09-17T05:50:17.691635+0000","last_unstale":"2024-09-17T05:50:18.669323+0000","last_undegraded":"2024-09-17T05:50:18.669323+0000","last_fullsized":"2024-09-17T05:50:18.669323+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:50:16.649689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:50:16.649689+0000","last_clean_scrub_stamp":"2024-09-17T05:50:16.649689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:23:23.530384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.c","version":"0'0","reported_seq":15,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-17T05:50:18.686186+0000","last_change":"2024-09-17T05:50:16.676827+0000","last_active":"2024-09-17T05:50:18.686186+0000","last_peered":"2024-09-17T05:50:18.686186+0000","last_clean":"2024-09-17T05:50:18.686186+0000","last_became_active":"2024-09-17T05:50:16.674588+0000","last_became_peered":"2024-09-17T05:50:16.674588+0000","last_unstale":"2024-09-17T05:50:18.686186+0000","last_undegraded":"2024-09-17T05:50:18.686186+0000","last_fullsized":"2024-09-17T05:50:18.686186+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:50:15.639879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:50:15.639879+0000","last_clean_scrub_stamp":"2024-09-17T05:50:15.639879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:41:10.083935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.a","version":"0'0","reported_seq":13,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-17T05:50:18.688713+0000","last_change":"2024-09-17T05:50:17.682895+0000","last_active":"2024-09-17T05:50:18.688713+0000","last_peered":"2024-09-17T05:50:18.688713+0000","last_clean":"2024-09-17T05:50:18.688713+0000","last_became_active":"2024-09-17T05:50:17.682597+0000","last_became_peered":"2024-09-17T05:50:17.682597+0000","last_unstale":"2024-09-17T05:50:18.688713+0000","last_undegraded":"2024-09-17T05:50:18.688713+0000","last_fullsized":"2024-09-17T05:50:18.688713+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:50:16.649689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:50:16.649689+0000","last_clean_scrub_stamp":"2024-09-17T05:50:16.649689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:27:25.644171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.b","version":"100'2","reported_seq":17,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-17T05:50:18.686463+0000","last_change":"2024-09-17T05:50:16.678475+0000","last_active":"2024-09-17T05:50:18.686463+0000","last_peered":"2024-09-17T05:50:18.686463+0000","last_clean":"2024-09-17T05:50:18.686463+0000","last_became_active":"2024-09-17T05:50:16.677955+0000","last_became_peered":"2024-09-17T05:50:16.677955+0000","last_unstale":"2024-09-17T05:50:18.686463+0000","last_undegraded":"2024-09-17T05:50:18.686463+0000","last_fullsized":"2024-09-17T05:50:18.686463+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:50:15.639879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:50:15.639879+0000","last_clean_scrub_stamp":"2024-09-17T05:50:15.639879+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:30:59.350580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.b","version":"0'0","reported_seq":13,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-17T05:50:18.688627+0000","last_change":"2024-09-17T05:50:17.690262+0000","last_active":"2024-09-17T05:50:18.688627+0000","last_peered":"2024-09-17T05:50:18.688627+0000","last_clean":"2024-09-17T05:50:18.688627+0000","last_became_active":"2024-09-17T05:50:17.689973+0000","last_became_peered":"2024-09-17T05:50:17.689973+0000","last_unstale":"2024-09-17T05:50:18.688627+0000","last_undegraded":"2024-09-17T05:50:18.688627+0000","last_fullsized":"2024-09-17T05:50:18.688627+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:50:16.649689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:50:16.649689+0000","last_clean_scrub_stamp":"2024-09-17T05:50:16.649689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:42:13.728525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.a","version":"0'0","reported_seq":15,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-17T05:50:19.312945+0000","last_change":"2024-09-17T05:50:16.672269+0000","last_active":"2024-09-17T05:50:19.312945+0000","last_peered":"2024-09-17T05:50:19.312945+0000","last_clean":"2024-09-17T05:50:19.312945+0000","last_became_active":"2024-09-17T05:50:16.671875+0000","last_became_peered":"2024-09-17T05:50:16.671875+0000","last_unstale":"2024-09-17T05:50:19.312945+0000","last_undegraded":"2024-09-17T05:50:19.312945+0000","last_fullsized":"2024-09-17T05:50:19.312945+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:50:15.639879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:50:15.639879+0000","last_clean_scrub_stamp":"2024-09-17T05:50:15.639879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:29:05.386538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.8","version":"0'0","reported_seq":13,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-17T05:50:18.688318+0000","last_change":"2024-09-17T05:50:17.675705+0000","last_active":"2024-09-17T05:50:18.688318+0000","last_peered":"2024-09-17T05:50:18.688318+0000","last_clean":"2024-09-17T05:50:18.688318+0000","last_became_active":"2024-09-17T05:50:17.674936+0000","last_became_peered":"2024-09-17T05:50:17.674936+0000","last_unstale":"2024-09-17T05:50:18.688318+0000","last_undegraded":"2024-09-17T05:50:18.688318+0000","last_fullsized":"2024-09-17T05:50:18.688318+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:50:16.649689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:50:16.649689+0000","last_clean_scrub_stamp":"2024-09-17T05:50:16.649689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:49:52.936613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.9","version":"0'0","reported_seq":15,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-17T05:50:19.312840+0000","last_change":"2024-09-17T05:50:16.663708+0000","last_active":"2024-09-17T05:50:19.312840+0000","last_peered":"2024-09-17T05:50:19.312840+0000","last_clean":"2024-09-17T05:50:19.312840+0000","last_became_active":"2024-09-17T05:50:16.663348+0000","last_became_peered":"2024-09-17T05:50:16.663348+0000","last_unstale":"2024-09-17T05:50:19.312840+0000","last_undegraded":"2024-09-17T05:50:19.312840+0000","last_fullsized":"2024-09-17T05:50:19.312840+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:50:15.639879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:50:15.639879+0000","last_clean_scrub_stamp":"2024-09-17T05:50:15.639879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:54:14.277613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.9","version":"0'0","reported_seq":13,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-17T05:50:18.948766+0000","last_change":"2024-09-17T05:50:17.687159+0000","last_active":"2024-09-17T05:50:18.948766+0000","last_peered":"2024-09-17T05:50:18.948766+0000","last_clean":"2024-09-17T05:50:18.948766+0000","last_became_active":"2024-09-17T05:50:17.686709+0000","last_became_peered":"2024-09-17T05:50:17.686709+0000","last_unstale":"2024-09-17T05:50:18.948766+0000","last_undegraded":"2024-09-17T05:50:18.948766+0000","last_fullsized":"2024-09-17T05:50:18.948766+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:50:16.649689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:50:16.649689+0000","last_clean_scrub_stamp":"2024-09-17T05:50:16.649689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:01:07.342006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.8","version":"0'0","reported_seq":15,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-17T05:50:18.686083+0000","last_change":"2024-09-17T05:50:16.673662+0000","last_active":"2024-09-17T05:50:18.686083+0000","last_peered":"2024-09-17T05:50:18.686083+0000","last_clean":"2024-09-17T05:50:18.686083+0000","last_became_active":"2024-09-17T05:50:16.673056+0000","last_became_peered":"2024-09-17T05:50:16.673056+0000","last_unstale":"2024-09-17T05:50:18.686083+0000","last_undegraded":"2024-09-17T05:50:18.686083+0000","last_fullsized":"2024-09-17T05:50:18.686083+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:50:15.639879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:50:15.639879+0000","last_clean_scrub_stamp":"2024-09-17T05:50:15.639879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:10:01.927806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.6","version":"0'0","reported_seq":13,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-17T05:50:18.686719+0000","last_change":"2024-09-17T05:50:17.684990+0000","last_active":"2024-09-17T05:50:18.686719+0000","last_peered":"2024-09-17T05:50:18.686719+0000","last_clean":"2024-09-17T05:50:18.686719+0000","last_became_active":"2024-09-17T05:50:17.684521+0000","last_became_peered":"2024-09-17T05:50:17.684521+0000","last_unstale":"2024-09-17T05:50:18.686719+0000","last_undegraded":"2024-09-17T05:50:18.686719+0000","last_fullsized":"2024-09-17T05:50:18.686719+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:50:16.649689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:50:16.649689+0000","last_clean_scrub_stamp":"2024-09-17T05:50:16.649689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:00:23.826449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.7","version":"100'2","reported_seq":17,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-17T05:50:19.313188+0000","last_change":"2024-09-17T05:50:16.663678+0000","last_active":"2024-09-17T05:50:19.313188+0000","last_peered":"2024-09-17T05:50:19.313188+0000","last_clean":"2024-09-17T05:50:19.313188+0000","last_became_active":"2024-09-17T05:50:16.663332+0000","last_became_peered":"2024-09-17T05:50:16.663332+0000","last_unstale":"2024-09-17T05:50:19.313188+0000","last_undegraded":"2024-09-17T05:50:19.313188+0000","last_fullsized":"2024-09-17T05:50:19.313188+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:50:15.639879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:50:15.639879+0000","last_clean_scrub_stamp":"2024-09-17T05:50:15.639879+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:42:47.577081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.7","version":"0'0","reported_seq":13,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-17T05:50:19.312011+0000","last_change":"2024-09-17T05:50:17.680146+0000","last_active":"2024-09-17T05:50:19.312011+0000","last_peered":"2024-09-17T05:50:19.312011+0000","last_clean":"2024-09-17T05:50:19.312011+0000","last_became_active":"2024-09-17T05:50:17.679833+0000","last_became_peered":"2024-09-17T05:50:17.679833+0000","last_unstale":"2024-09-17T05:50:19.312011+0000","last_undegraded":"2024-09-17T05:50:19.312011+0000","last_fullsized":"2024-09-17T05:50:19.312011+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:50:16.649689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:50:16.649689+0000","last_clean_scrub_stamp":"2024-09-17T05:50:16.649689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:30:18.556021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.6","version":"101'1","reported_seq":16,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-17T05:50:18.687959+0000","last_change":"2024-09-17T05:50:16.676247+0000","last_active":"2024-09-17T05:50:18.687959+0000","last_peered":"2024-09-17T05:50:18.687959+0000","last_clean":"2024-09-17T05:50:18.687959+0000","last_became_active":"2024-09-17T05:50:16.674892+0000","last_became_peered":"2024-09-17T05:50:16.674892+0000","last_unstale":"2024-09-17T05:50:18.687959+0000","last_undegraded":"2024-09-17T05:50:18.687959+0000","last_fullsized":"2024-09-17T05:50:18.687959+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:50:15.639879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:50:15.639879+0000","last_clean_scrub_stamp":"2024-09-17T05:50:15.639879+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:30:08.711913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.4","version":"0'0","reported_seq":13,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-17T05:50:19.312139+0000","last_change":"2024-09-17T05:50:17.694044+0000","last_active":"2024-09-17T05:50:19.312139+0000","last_peered":"2024-09-17T05:50:19.312139+0000","last_clean":"2024-09-17T05:50:19.312139+0000","last_became_active":"2024-09-17T05:50:17.693724+0000","last_became_peered":"2024-09-17T05:50:17.693724+0000","last_unstale":"2024-09-17T05:50:19.312139+0000","last_undegraded":"2024-09-17T05:50:19.312139+0000","last_fullsized":"2024-09-17T05:50:19.312139+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:50:16.649689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:50:16.649689+0000","last_clean_scrub_stamp":"2024-09-17T05:50:16.649689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:54:46.693440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.5","version":"0'0","reported_seq":15,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-17T05:50:18.686425+0000","last_change":"2024-09-17T05:50:16.679037+0000","last_active":"2024-09-17T05:50:18.686425+0000","last_peered":"2024-09-17T05:50:18.686425+0000","last_clean":"2024-09-17T05:50:18.686425+0000","last_became_active":"2024-09-17T05:50:16.678604+0000","last_became_peered":"2024-09-17T05:50:16.678604+0000","last_unstale":"2024-09-17T05:50:18.686425+0000","last_undegraded":"2024-09-17T05:50:18.686425+0000","last_fullsized":"2024-09-17T05:50:18.686425+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:50:15.639879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:50:15.639879+0000","last_clean_scrub_stamp":"2024-09-17T05:50:15.639879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:31:44.846045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.5","version":"0'0","reported_seq":13,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-17T05:50:18.949002+0000","last_change":"2024-09-17T05:50:17.684200+0000","last_active":"2024-09-17T05:50:18.949002+0000","last_peered":"2024-09-17T05:50:18.949002+0000","last_clean":"2024-09-17T05:50:18.949002+0000","last_became_active":"2024-09-17T05:50:17.683866+0000","last_became_peered":"2024-09-17T05:50:17.683866+0000","last_unstale":"2024-09-17T05:50:18.949002+0000","last_undegraded":"2024-09-17T05:50:18.949002+0000","last_fullsized":"2024-09-17T05:50:18.949002+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:50:16.649689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:50:16.649689+0000","last_clean_scrub_stamp":"2024-09-17T05:50:16.649689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:47:32.573705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.4","version":"0'0","reported_seq":15,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-17T05:50:18.949414+0000","last_change":"2024-09-17T05:50:16.669515+0000","last_active":"2024-09-17T05:50:18.949414+0000","last_peered":"2024-09-17T05:50:18.949414+0000","last_clean":"2024-09-17T05:50:18.949414+0000","last_became_active":"2024-09-17T05:50:16.669123+0000","last_became_peered":"2024-09-17T05:50:16.669123+0000","last_unstale":"2024-09-17T05:50:18.949414+0000","last_undegraded":"2024-09-17T05:50:18.949414+0000","last_fullsized":"2024-09-17T05:50:18.949414+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:50:15.639879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:50:15.639879+0000","last_clean_scrub_stamp":"2024-09-17T05:50:15.639879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:36:09.486712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.2","version":"0'0","reported_seq":13,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-17T05:50:18.688944+0000","last_change":"2024-09-17T05:50:17.694213+0000","last_active":"2024-09-17T05:50:18.688944+0000","last_peered":"2024-09-17T05:50:18.688944+0000","last_clean":"2024-09-17T05:50:18.688944+0000","last_became_active":"2024-09-17T05:50:17.684089+0000","last_became_peered":"2024-09-17T05:50:17.684089+0000","last_unstale":"2024-09-17T05:50:18.688944+0000","last_undegraded":"2024-09-17T05:50:18.688944+0000","last_fullsized":"2024-09-17T05:50:18.688944+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:50:16.649689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:50:16.649689+0000","last_clean_scrub_stamp":"2024-09-17T05:50:16.649689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:20:12.473881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.3","version":"0'0","reported_seq":15,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-17T05:50:18.686471+0000","last_change":"2024-09-17T05:50:16.669971+0000","last_active":"2024-09-17T05:50:18.686471+0000","last_peered":"2024-09-17T05:50:18.686471+0000","last_clean":"2024-09-17T05:50:18.686471+0000","last_became_active":"2024-09-17T05:50:16.667502+0000","last_became_peered":"2024-09-17T05:50:16.667502+0000","last_unstale":"2024-09-17T05:50:18.686471+0000","last_undegraded":"2024-09-17T05:50:18.686471+0000","last_fullsized":"2024-09-17T05:50:18.686471+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:50:15.639879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:50:15.639879+0000","last_clean_scrub_stamp":"2024-09-17T05:50:15.639879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:15:08.648001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.3","version":"0'0","reported_seq":13,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-17T05:50:18.668208+0000","last_change":"2024-09-17T05:50:17.685609+0000","last_active":"2024-09-17T05:50:18.668208+0000","last_peered":"2024-09-17T05:50:18.668208+0000","last_clean":"2024-09-17T05:50:18.668208+0000","last_became_active":"2024-09-17T05:50:17.685256+0000","last_became_peered":"2024-09-17T05:50:17.685256+0000","last_unstale":"2024-09-17T05:50:18.668208+0000","last_undegraded":"2024-09-17T05:50:18.668208+0000","last_fullsized":"2024-09-17T05:50:18.668208+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:50:16.649689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:50:16.649689+0000","last_clean_scrub_stamp":"2024-09-17T05:50:16.649689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:20:50.827401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.2","version":"0'0","reported_seq":15,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-17T05:50:18.948746+0000","last_change":"2024-09-17T05:50:16.672742+0000","last_active":"2024-09-17T05:50:18.948746+0000","last_peered":"2024-09-17T05:50:18.948746+0000","last_clean":"2024-09-17T05:50:18.948746+0000","last_became_active":"2024-09-17T05:50:16.672357+0000","last_became_peered":"2024-09-17T05:50:16.672357+0000","last_unstale":"2024-09-17T05:50:18.948746+0000","last_undegraded":"2024-09-17T05:50:18.948746+0000","last_fullsized":"2024-09-17T05:50:18.948746+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:50:15.639879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:50:15.639879+0000","last_clean_scrub_stamp":"2024-09-17T05:50:15.639879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:30:35.738894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.0","version":"0'0","reported_seq":13,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-17T05:50:18.688323+0000","last_change":"2024-09-17T05:50:17.675260+0000","last_active":"2024-09-17T05:50:18.688323+0000","last_peered":"2024-09-17T05:50:18.688323+0000","last_clean":"2024-09-17T05:50:18.688323+0000","last_became_active":"2024-09-17T05:50:17.674667+0000","last_became_peered":"2024-09-17T05:50:17.674667+0000","last_unstale":"2024-09-17T05:50:18.688323+0000","last_undegraded":"2024-09-17T05:50:18.688323+0000","last_fullsized":"2024-09-17T05:50:18.688323+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:50:16.649689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:50:16.649689+0000","last_clean_scrub_stamp":"2024-09-17T05:50:16.649689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:07:36.187842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.1","version":"0'0","reported_seq":15,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-17T05:50:18.669751+0000","last_change":"2024-09-17T05:50:16.670111+0000","last_active":"2024-09-17T05:50:18.669751+0000","last_peered":"2024-09-17T05:50:18.669751+0000","last_clean":"2024-09-17T05:50:18.669751+0000","last_became_active":"2024-09-17T05:50:16.669343+0000","last_became_peered":"2024-09-17T05:50:16.669343+0000","last_unstale":"2024-09-17T05:50:18.669751+0000","last_undegraded":"2024-09-17T05:50:18.669751+0000","last_fullsized":"2024-09-17T05:50:18.669751+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:50:15.639879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:50:15.639879+0000","last_clean_scrub_stamp":"2024-09-17T05:50:15.639879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:14:06.830335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.1","version":"0'0","reported_seq":13,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-17T05:50:18.948964+0000","last_change":"2024-09-17T05:50:17.692076+0000","last_active":"2024-09-17T05:50:18.948964+0000","last_peered":"2024-09-17T05:50:18.948964+0000","last_clean":"2024-09-17T05:50:18.948964+0000","last_became_active":"2024-09-17T05:50:17.688755+0000","last_became_peered":"2024-09-17T05:50:17.688755+0000","last_unstale":"2024-09-17T05:50:18.948964+0000","last_undegraded":"2024-09-17T05:50:18.948964+0000","last_fullsized":"2024-09-17T05:50:18.948964+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:50:16.649689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:50:16.649689+0000","last_clean_scrub_stamp":"2024-09-17T05:50:16.649689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:54:02.806010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.0","version":"0'0","reported_seq":15,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-17T05:50:18.688518+0000","last_change":"2024-09-17T05:50:16.680798+0000","last_active":"2024-09-17T05:50:18.688518+0000","last_peered":"2024-09-17T05:50:18.688518+0000","last_clean":"2024-09-17T05:50:18.688518+0000","last_became_active":"2024-09-17T05:50:16.680485+0000","last_became_peered":"2024-09-17T05:50:16.680485+0000","last_unstale":"2024-09-17T05:50:18.688518+0000","last_undegraded":"2024-09-17T05:50:18.688518+0000","last_fullsized":"2024-09-17T05:50:18.688518+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:50:15.639879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:50:15.639879+0000","last_clean_scrub_stamp":"2024-09-17T05:50:15.639879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:59:08.119171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.e","version":"0'0","reported_seq":13,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-17T05:50:18.688633+0000","last_change":"2024-09-17T05:50:17.682012+0000","last_active":"2024-09-17T05:50:18.688633+0000","last_peered":"2024-09-17T05:50:18.688633+0000","last_clean":"2024-09-17T05:50:18.688633+0000","last_became_active":"2024-09-17T05:50:17.681695+0000","last_became_peered":"2024-09-17T05:50:17.681695+0000","last_unstale":"2024-09-17T05:50:18.688633+0000","last_undegraded":"2024-09-17T05:50:18.688633+0000","last_fullsized":"2024-09-17T05:50:18.688633+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:50:16.649689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:50:16.649689+0000","last_clean_scrub_stamp":"2024-09-17T05:50:16.649689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:52:17.955004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.f","version":"100'1","reported_seq":16,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-17T05:50:18.668437+0000","last_change":"2024-09-17T05:50:16.675030+0000","last_active":"2024-09-17T05:50:18.668437+0000","last_peered":"2024-09-17T05:50:18.668437+0000","last_clean":"2024-09-17T05:50:18.668437+0000","last_became_active":"2024-09-17T05:50:16.674713+0000","last_became_peered":"2024-09-17T05:50:16.674713+0000","last_unstale":"2024-09-17T05:50:18.668437+0000","last_undegraded":"2024-09-17T05:50:18.668437+0000","last_fullsized":"2024-09-17T05:50:18.668437+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:50:15.639879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:50:15.639879+0000","last_clean_scrub_stamp":"2024-09-17T05:50:15.639879+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:07:41.953366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"19'72","reported_seq":255,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-17T05:50:18.668757+0000","last_change":"2024-09-17T05:41:48.539830+0000","last_active":"2024-09-17T05:50:18.668757+0000","last_peered":"2024-09-17T05:50:18.668757+0000","last_clean":"2024-09-17T05:50:18.668757+0000","last_became_active":"2024-09-17T05:41:48.538743+0000","last_became_peered":"2024-09-17T05:41:48.538743+0000","last_unstale":"2024-09-17T05:50:18.668757+0000","last_undegraded":"2024-09-17T05:50:18.668757+0000","last_fullsized":"2024-09-17T05:50:18.668757+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:47.152539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:47.152539+0000","last_clean_scrub_stamp":"2024-09-17T05:41:47.152539+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:08:02.952016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":15,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":14,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":16,"seq":68719476844,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":118428,"kb_used_data":1220,"kb_used_omap":1,"kb_used_meta":117182,"kb_avail":94253412,"statfs":{"total":96636764160,"available":96515493888,"internally_reserved":0,"allocated":1249280,"data_stored":538328,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":119994822},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":7,"up_from":15,"seq":64424509548,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":127328,"kb_used_data":1800,"kb_used_omap":1,"kb_used_meta":125502,"kb_avail":94244512,"statfs":{"total":96636764160,"available":96506380288,"internally_reserved":0,"allocated":1843200,"data_stored":1128156,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":128514506},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509547,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":72596,"kb_used_data":1216,"kb_used_omap":1,"kb_used_meta":71358,"kb_avail":94299244,"statfs":{"total":96636764160,"available":96562425856,"internally_reserved":0,"allocated":1245184,"data_stored":537746,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":73071045},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509547,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":148964,"kb_used_data":1232,"kb_used_omap":1,"kb_used_meta":147710,"kb_avail":94222876,"statfs":{"total":96636764160,"available":96484225024,"internally_reserved":0,"allocated":1261568,"data_stored":539412,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":151255493},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509547,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":112872,"kb_used_data":1228,"kb_used_omap":1,"kb_used_meta":111614,"kb_avail":94258968,"statfs":{"total":96636764160,"available":96521183232,"internally_reserved":0,"allocated":1257472,"data_stored":539310,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":114293191},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509547,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":153112,"kb_used_data":1216,"kb_used_omap":1,"kb_used_meta":151870,"kb_avail":94218728,"statfs":{"total":96636764160,"available":96479977472,"internally_reserved":0,"allocated":1245184,"data_stored":537710,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":155515333},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509547,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":118420,"kb_used_data":1212,"kb_used_omap":1,"kb_used_meta":117182,"kb_avail":94253420,"statfs":{"total":96636764160,"available":96515502080,"internally_reserved":0,"allocated":1241088,"data_stored":537676,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":119994821},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574955,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":131484,"kb_used_data":1796,"kb_used_omap":1,"kb_used_meta":129662,"kb_avail":94240356,"statfs":{"total":96636764160,"available":96502124544,"internally_reserved":0,"allocated":1839104,"data_stored":1128626,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":132774341},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-17T05:50:26.509 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-17T05:50:26.510 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-09-17T05:50:26.592 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-17T05:50:26.594 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-17T05:50:26.671 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:26.670+0000 7f61db484640 1 -- 172.21.15.150:0/2804376553 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f61d40d5150 msgr2=0x7f61d40b9b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:50:26.671 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:26.670+0000 7f61db484640 1 --2- 172.21.15.150:0/2804376553 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f61d40d5150 0x7f61d40b9b10 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f61cc009850 tx=0x7f61cc02a530 comp rx=0 tx=0).stop 2024-09-17T05:50:26.672 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:26.670+0000 7f61db484640 1 -- 172.21.15.150:0/2804376553 shutdown_connections 2024-09-17T05:50:26.672 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:26.670+0000 7f61db484640 1 --2- 172.21.15.150:0/2804376553 >> v2:172.21.15.176:3300/0 conn(0x7f61d40d0730 0x7f61d40b6160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:50:26.672 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:26.670+0000 7f61db484640 1 --2- 172.21.15.150:0/2804376553 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f61d40d5150 0x7f61d40b9b10 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:50:26.672 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:26.670+0000 7f61db484640 1 -- 172.21.15.150:0/2804376553 >> 172.21.15.150:0/2804376553 conn(0x7f61d408bfe0 msgr2=0x7f61d40d46e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:50:26.672 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:26.670+0000 7f61db484640 1 -- 172.21.15.150:0/2804376553 shutdown_connections 2024-09-17T05:50:26.672 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:26.670+0000 7f61db484640 1 -- 172.21.15.150:0/2804376553 wait complete. 2024-09-17T05:50:26.673 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:26.672+0000 7f61db484640 1 Processor -- start 2024-09-17T05:50:26.673 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:26.672+0000 7f61db484640 1 -- start start 2024-09-17T05:50:26.677 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:26.674+0000 7f61db484640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f61d406dea0 0x7f61d414ac70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:50:26.677 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:26.674+0000 7f61db484640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f61d40d0730 0x7f61d41f9610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:50:26.677 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:26.674+0000 7f61db484640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f61d40d5150 0x7f61d41f9b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:50:26.677 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:26.674+0000 7f61db484640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f61d406e2b0 con 0x7f61d406dea0 2024-09-17T05:50:26.677 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:26.674+0000 7f61db484640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f61d40d31e0 con 0x7f61d40d5150 2024-09-17T05:50:26.677 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:26.674+0000 7f61db484640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f61d406e430 con 0x7f61d40d0730 2024-09-17T05:50:26.677 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:26.675+0000 7f61d9220640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f61d406dea0 0x7f61d414ac70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:50:26.678 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:26.675+0000 7f61d9220640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f61d406dea0 0x7f61d414ac70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:57352/0 (socket says 172.21.15.150:57352) 2024-09-17T05:50:26.678 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:26.675+0000 7f61d9220640 1 -- 172.21.15.150:0/804342224 learned_addr learned my addr 172.21.15.150:0/804342224 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:50:26.678 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:26.675+0000 7f61d9a21640 1 --2- 172.21.15.150:0/804342224 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f61d40d5150 0x7f61d41f9b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:50:26.678 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:26.675+0000 7f61d8a1f640 1 --2- 172.21.15.150:0/804342224 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f61d40d0730 0x7f61d41f9610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:50:26.678 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:26.675+0000 7f61d9220640 1 -- 172.21.15.150:0/804342224 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f61d40d0730 msgr2=0x7f61d41f9610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:50:26.678 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:26.675+0000 7f61d9220640 1 --2- 172.21.15.150:0/804342224 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f61d40d0730 0x7f61d41f9610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:50:26.678 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:26.675+0000 7f61d9220640 1 -- 172.21.15.150:0/804342224 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f61d40d5150 msgr2=0x7f61d41f9b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:50:26.678 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:26.675+0000 7f61d9220640 1 --2- 172.21.15.150:0/804342224 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f61d40d5150 0x7f61d41f9b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:50:26.678 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:26.675+0000 7f61d9220640 1 -- 172.21.15.150:0/804342224 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f61d40cd660 con 0x7f61d406dea0 2024-09-17T05:50:26.678 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:26.675+0000 7f61d9220640 1 --2- 172.21.15.150:0/804342224 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f61d406dea0 0x7f61d414ac70 secure :-1 s=READY pgs=1335 cs=0 l=1 rev1=1 crypto rx=0x7f61cc02ab20 tx=0x7f61cc0052f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:50:26.678 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:26.675+0000 7f61d1ffb640 1 -- 172.21.15.150:0/804342224 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61cc03f070 con 0x7f61d406dea0 2024-09-17T05:50:26.678 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:26.676+0000 7f61d1ffb640 1 -- 172.21.15.150:0/804342224 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f61cc004250 con 0x7f61d406dea0 2024-09-17T05:50:26.678 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:26.676+0000 7f61db484640 1 -- 172.21.15.150:0/804342224 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f61d40c9350 con 0x7f61d406dea0 2024-09-17T05:50:26.679 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:26.676+0000 7f61d1ffb640 1 -- 172.21.15.150:0/804342224 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61cc005c30 con 0x7f61d406dea0 2024-09-17T05:50:26.679 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:26.676+0000 7f61db484640 1 -- 172.21.15.150:0/804342224 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f61d40c9910 con 0x7f61d406dea0 2024-09-17T05:50:26.680 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:26.677+0000 7f61db484640 1 -- 172.21.15.150:0/804342224 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f61d40b6780 con 0x7f61d406dea0 2024-09-17T05:50:26.680 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:26.678+0000 7f61d1ffb640 1 -- 172.21.15.150:0/804342224 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 32) ==== 103481+0+0 (secure 0 0 0) 0x7f61cc042070 con 0x7f61d406dea0 2024-09-17T05:50:26.680 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:26.678+0000 7f61d1ffb640 1 --2- 172.21.15.150:0/804342224 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f61c007a210 0x7f61c007c720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:50:26.680 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:26.678+0000 7f61d1ffb640 1 -- 172.21.15.150:0/804342224 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(101..101 src has 1..101) ==== 5821+0+0 (secure 0 0 0) 0x7f61cc0ba7a0 con 0x7f61d406dea0 2024-09-17T05:50:26.681 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:26.679+0000 7f61d8a1f640 1 --2- 172.21.15.150:0/804342224 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f61c007a210 0x7f61c007c720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:50:26.681 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:26.679+0000 7f61d8a1f640 1 --2- 172.21.15.150:0/804342224 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f61c007a210 0x7f61c007c720 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7f61d40cb2c0 tx=0x7f61c8007e90 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:50:26.683 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:26.683+0000 7f61d1ffb640 1 -- 172.21.15.150:0/804342224 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f61cc084120 con 0x7f61d406dea0 2024-09-17T05:50:26.938 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:26.937+0000 7f61db484640 1 -- 172.21.15.150:0/804342224 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) -- 0x7f61d40b9c30 con 0x7f61d406dea0 2024-09-17T05:50:26.941 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:26.941+0000 7f61d1ffb640 1 -- 172.21.15.150:0/804342224 <== mon.0 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v17) ==== 190+0+147 (secure 0 0 0) 0x7f61cc088b50 con 0x7f61d406dea0 2024-09-17T05:50:26.941 INFO:teuthology.orchestra.run.smithi150.stdout:[client.0] 2024-09-17T05:50:26.941 INFO:teuthology.orchestra.run.smithi150.stdout: key = AQBoFulmfF/1HBAAMezEjZDeoHTJ+uFfDXNWHQ== 2024-09-17T05:50:26.942 INFO:teuthology.orchestra.run.smithi150.stdout: caps mds = "allow" 2024-09-17T05:50:26.942 INFO:teuthology.orchestra.run.smithi150.stdout: caps mon = "allow r" 2024-09-17T05:50:26.942 INFO:teuthology.orchestra.run.smithi150.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2024-09-17T05:50:26.942 INFO:teuthology.orchestra.run.smithi150.stderr:updated caps for client.0 2024-09-17T05:50:26.944 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:26.943+0000 7f61db484640 1 -- 172.21.15.150:0/804342224 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f61c007a210 msgr2=0x7f61c007c720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:50:26.944 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:26.943+0000 7f61db484640 1 --2- 172.21.15.150:0/804342224 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f61c007a210 0x7f61c007c720 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7f61d40cb2c0 tx=0x7f61c8007e90 comp rx=0 tx=0).stop 2024-09-17T05:50:26.944 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:26.943+0000 7f61db484640 1 -- 172.21.15.150:0/804342224 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f61d406dea0 msgr2=0x7f61d414ac70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:50:26.944 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:26.943+0000 7f61db484640 1 --2- 172.21.15.150:0/804342224 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f61d406dea0 0x7f61d414ac70 secure :-1 s=READY pgs=1335 cs=0 l=1 rev1=1 crypto rx=0x7f61cc02ab20 tx=0x7f61cc0052f0 comp rx=0 tx=0).stop 2024-09-17T05:50:26.944 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:26.943+0000 7f61db484640 1 -- 172.21.15.150:0/804342224 shutdown_connections 2024-09-17T05:50:26.944 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:26.943+0000 7f61db484640 1 --2- 172.21.15.150:0/804342224 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f61d40d5150 0x7f61d41f9b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:50:26.944 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:26.943+0000 7f61db484640 1 --2- 172.21.15.150:0/804342224 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f61c007a210 0x7f61c007c720 unknown :-1 s=CLOSED pgs=576 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:50:26.945 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:26.943+0000 7f61db484640 1 --2- 172.21.15.150:0/804342224 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f61d40d0730 0x7f61d41f9610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:50:26.945 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:26.943+0000 7f61db484640 1 --2- 172.21.15.150:0/804342224 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f61d406dea0 0x7f61d414ac70 unknown :-1 s=CLOSED pgs=1335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:50:26.945 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:26.943+0000 7f61db484640 1 -- 172.21.15.150:0/804342224 >> 172.21.15.150:0/804342224 conn(0x7f61d408bfe0 msgr2=0x7f61d40b8260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:50:26.945 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:26.943+0000 7f61db484640 1 -- 172.21.15.150:0/804342224 shutdown_connections 2024-09-17T05:50:26.945 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:26.943+0000 7f61db484640 1 -- 172.21.15.150:0/804342224 wait complete. 2024-09-17T05:50:26.956 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T05:50:27.111 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:27.110+0000 7f3b7c80a640 1 -- 172.21.15.150:0/3472000552 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3b780d1060 msgr2=0x7f3b780b1e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:50:27.111 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:27.110+0000 7f3b7c80a640 1 --2- 172.21.15.150:0/3472000552 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3b780d1060 0x7f3b780b1e00 secure :-1 s=READY pgs=1336 cs=0 l=1 rev1=1 crypto rx=0x7f3b780d3510 tx=0x7f3b7002aac0 comp rx=0 tx=0).stop 2024-09-17T05:50:27.111 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:27.110+0000 7f3b7c80a640 1 -- 172.21.15.150:0/3472000552 shutdown_connections 2024-09-17T05:50:27.111 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:27.110+0000 7f3b7c80a640 1 --2- 172.21.15.150:0/3472000552 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3b780d1060 0x7f3b780b1e00 unknown :-1 s=CLOSED pgs=1336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:50:27.111 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:27.110+0000 7f3b7c80a640 1 --2- 172.21.15.150:0/3472000552 >> v2:172.21.15.176:3300/0 conn(0x7f3b780d0550 0x7f3b780b18c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:50:27.112 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:27.110+0000 7f3b7c80a640 1 --2- 172.21.15.150:0/3472000552 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3b780d0c50 0x7f3b780d0010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:50:27.112 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:27.110+0000 7f3b7c80a640 1 -- 172.21.15.150:0/3472000552 >> 172.21.15.150:0/3472000552 conn(0x7f3b780b3fc0 msgr2=0x7f3b780b43d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:50:27.112 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:27.110+0000 7f3b7c80a640 1 -- 172.21.15.150:0/3472000552 shutdown_connections 2024-09-17T05:50:27.112 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:27.110+0000 7f3b7c80a640 1 -- 172.21.15.150:0/3472000552 wait complete. 2024-09-17T05:50:27.112 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:27.112+0000 7f3b7c80a640 1 Processor -- start 2024-09-17T05:50:27.113 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:27.112+0000 7f3b7c80a640 1 -- start start 2024-09-17T05:50:27.116 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:27.113+0000 7f3b7c80a640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3b780d0550 0x7f3b780cc280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:50:27.116 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:27.113+0000 7f3b7c80a640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3b780d0c50 0x7f3b780c8200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:50:27.116 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:27.113+0000 7f3b7c80a640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3b780d1060 0x7f3b780c9510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:50:27.116 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:27.113+0000 7f3b7c80a640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f3b780ceb70 con 0x7f3b780d0550 2024-09-17T05:50:27.116 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:27.113+0000 7f3b7c80a640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f3b780c5cb0 con 0x7f3b780d1060 2024-09-17T05:50:27.116 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:27.113+0000 7f3b7c80a640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f3b780cecf0 con 0x7f3b780d0c50 2024-09-17T05:50:27.116 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:27.113+0000 7f3b7659c640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3b780d0550 0x7f3b780cc280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:50:27.116 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:27.113+0000 7f3b7659c640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3b780d0550 0x7f3b780cc280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:57366/0 (socket says 172.21.15.150:57366) 2024-09-17T05:50:27.116 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:27.113+0000 7f3b7659c640 1 -- 172.21.15.150:0/2623497630 learned_addr learned my addr 172.21.15.150:0/2623497630 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:50:27.116 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:27.113+0000 7f3b76d9d640 1 --2- 172.21.15.150:0/2623497630 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3b780d1060 0x7f3b780c9510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:50:27.116 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:27.113+0000 7f3b75d9b640 1 --2- 172.21.15.150:0/2623497630 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3b780d0c50 0x7f3b780c8200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:50:27.117 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:27.114+0000 7f3b7659c640 1 -- 172.21.15.150:0/2623497630 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3b780d0c50 msgr2=0x7f3b780c8200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:50:27.117 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:27.114+0000 7f3b7659c640 1 --2- 172.21.15.150:0/2623497630 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3b780d0c50 0x7f3b780c8200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:50:27.117 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:27.114+0000 7f3b7659c640 1 -- 172.21.15.150:0/2623497630 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3b780d1060 msgr2=0x7f3b780c9510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:50:27.117 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:27.114+0000 7f3b7659c640 1 --2- 172.21.15.150:0/2623497630 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3b780d1060 0x7f3b780c9510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:50:27.117 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:27.114+0000 7f3b7659c640 1 -- 172.21.15.150:0/2623497630 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3b781f5e30 con 0x7f3b780d0550 2024-09-17T05:50:27.117 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:27.114+0000 7f3b7659c640 1 --2- 172.21.15.150:0/2623497630 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3b780d0550 0x7f3b780cc280 secure :-1 s=READY pgs=1337 cs=0 l=1 rev1=1 crypto rx=0x7f3b6800c970 tx=0x7f3b6800ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:50:27.117 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:27.114+0000 7f3b66ffd640 1 -- 172.21.15.150:0/2623497630 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b68007bb0 con 0x7f3b780d0550 2024-09-17T05:50:27.117 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:27.114+0000 7f3b66ffd640 1 -- 172.21.15.150:0/2623497630 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f3b68007e40 con 0x7f3b780d0550 2024-09-17T05:50:27.117 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:27.114+0000 7f3b7c80a640 1 -- 172.21.15.150:0/2623497630 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3b781f6110 con 0x7f3b780d0550 2024-09-17T05:50:27.117 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:27.114+0000 7f3b66ffd640 1 -- 172.21.15.150:0/2623497630 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b6800f690 con 0x7f3b780d0550 2024-09-17T05:50:27.117 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:27.114+0000 7f3b7c80a640 1 -- 172.21.15.150:0/2623497630 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3b781f66d0 con 0x7f3b780d0550 2024-09-17T05:50:27.118 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:27.115+0000 7f3b7c80a640 1 -- 172.21.15.150:0/2623497630 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3b780d0010 con 0x7f3b780d0550 2024-09-17T05:50:27.118 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:27.116+0000 7f3b66ffd640 1 -- 172.21.15.150:0/2623497630 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 32) ==== 103481+0+0 (secure 0 0 0) 0x7f3b68018400 con 0x7f3b780d0550 2024-09-17T05:50:27.119 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:27.117+0000 7f3b66ffd640 1 --2- 172.21.15.150:0/2623497630 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f3b5807a240 0x7f3b5807c750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:50:27.119 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:27.117+0000 7f3b66ffd640 1 -- 172.21.15.150:0/2623497630 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(101..101 src has 1..101) ==== 5821+0+0 (secure 0 0 0) 0x7f3b6809a4d0 con 0x7f3b780d0550 2024-09-17T05:50:27.119 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:27.117+0000 7f3b75d9b640 1 --2- 172.21.15.150:0/2623497630 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f3b5807a240 0x7f3b5807c750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:50:27.119 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:27.118+0000 7f3b75d9b640 1 --2- 172.21.15.150:0/2623497630 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f3b5807a240 0x7f3b5807c750 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7f3b780c50a0 tx=0x7f3b6c00b260 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:50:27.125 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:27.125+0000 7f3b66ffd640 1 -- 172.21.15.150:0/2623497630 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f3b68014030 con 0x7f3b780d0550 2024-09-17T05:50:27.344 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:27.344+0000 7f3b7c80a640 1 -- 172.21.15.150:0/2623497630 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f3b7806e630 con 0x7f3b780d0550 2024-09-17T05:50:27.345 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:27.345+0000 7f3b66ffd640 1 -- 172.21.15.150:0/2623497630 <== mon.0 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 60 v60) ==== 94+0+5231 (secure 0 0 0) 0x7f3b68068690 con 0x7f3b780d0550 2024-09-17T05:50:27.345 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-09-17T05:50:27.345 INFO:teuthology.orchestra.run.smithi150.stdout:{"epoch":60,"btime":"2024-09-17T05:50:20:687617+0000","default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6494,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6837/1755605193","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6835","nonce":1755605193},{"type":"v1","addr":"172.21.15.176:6837","nonce":1755605193}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":55},{"gid":7117,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6836/628081508","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6834","nonce":628081508},{"type":"v1","addr":"172.21.15.176:6836","nonce":628081508}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":55},{"gid":8061,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6835/187954104","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6833","nonce":187954104},{"type":"v1","addr":"172.21.15.150:6835","nonce":187954104}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":55}],"filesystems":[{"mdsmap":{"epoch":60,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T05:50:17.022354+0000","modified":"2024-09-17T05:50:20.052518+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":8064},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8064":{"gid":8064,"name":"c","rank":0,"incarnation":56,"state":"up:active","state_seq":3,"addr":"172.21.15.150:6834/3842369685","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6832","nonce":3842369685},{"type":"v1","addr":"172.21.15.150:6834","nonce":3842369685}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":8064,"qdb_cluster":[8064]},"id":7}]} 2024-09-17T05:50:27.346 INFO:teuthology.orchestra.run.smithi150.stderr:dumped fsmap epoch 60 2024-09-17T05:50:27.348 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:27.347+0000 7f3b7c80a640 1 -- 172.21.15.150:0/2623497630 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f3b5807a240 msgr2=0x7f3b5807c750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:50:27.348 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:27.347+0000 7f3b7c80a640 1 --2- 172.21.15.150:0/2623497630 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f3b5807a240 0x7f3b5807c750 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7f3b780c50a0 tx=0x7f3b6c00b260 comp rx=0 tx=0).stop 2024-09-17T05:50:27.348 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:27.347+0000 7f3b7c80a640 1 -- 172.21.15.150:0/2623497630 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3b780d0550 msgr2=0x7f3b780cc280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:50:27.348 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:27.347+0000 7f3b7c80a640 1 --2- 172.21.15.150:0/2623497630 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3b780d0550 0x7f3b780cc280 secure :-1 s=READY pgs=1337 cs=0 l=1 rev1=1 crypto rx=0x7f3b6800c970 tx=0x7f3b6800ce30 comp rx=0 tx=0).stop 2024-09-17T05:50:27.348 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:27.347+0000 7f3b7c80a640 1 -- 172.21.15.150:0/2623497630 shutdown_connections 2024-09-17T05:50:27.348 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:27.347+0000 7f3b7c80a640 1 --2- 172.21.15.150:0/2623497630 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3b780d1060 0x7f3b780c9510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:50:27.348 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:27.347+0000 7f3b7c80a640 1 --2- 172.21.15.150:0/2623497630 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f3b5807a240 0x7f3b5807c750 unknown :-1 s=CLOSED pgs=577 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:50:27.348 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:27.347+0000 7f3b7c80a640 1 --2- 172.21.15.150:0/2623497630 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3b780d0c50 0x7f3b780c8200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:50:27.348 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:27.347+0000 7f3b7c80a640 1 --2- 172.21.15.150:0/2623497630 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3b780d0550 0x7f3b780cc280 unknown :-1 s=CLOSED pgs=1337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:50:27.348 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:27.347+0000 7f3b7c80a640 1 -- 172.21.15.150:0/2623497630 >> 172.21.15.150:0/2623497630 conn(0x7f3b780b3fc0 msgr2=0x7f3b7815fa40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:50:27.348 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:27.347+0000 7f3b7c80a640 1 -- 172.21.15.150:0/2623497630 shutdown_connections 2024-09-17T05:50:27.349 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:27.347+0000 7f3b7c80a640 1 -- 172.21.15.150:0/2623497630 wait complete. 2024-09-17T05:50:27.762 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 60, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-17T05:50:17.022354+0000', 'modified': '2024-09-17T05:50:20.052518+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 8064}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_8064': {'gid': 8064, 'name': 'c', 'rank': 0, 'incarnation': 56, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.150:6834/3842369685', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.150:6832', 'nonce': 3842369685}, {'type': 'v1', 'addr': '172.21.15.150:6834', 'nonce': 3842369685}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [15], 'metadata_pool': 14, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 8064, 'qdb_cluster': [8064]} 2024-09-17T05:50:27.762 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-17T05:50:27.763 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2024-09-17T05:50:27.879 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:27.878+0000 7f33028c4640 1 -- 172.21.15.150:0/4075142388 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f32fc0c5b90 msgr2=0x7f32fc0d02b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:50:27.880 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:27.878+0000 7f33028c4640 1 --2- 172.21.15.150:0/4075142388 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f32fc0c5b90 0x7f32fc0d02b0 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f32ec009820 tx=0x7f32ec02a510 comp rx=0 tx=0).stop 2024-09-17T05:50:27.880 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:27.879+0000 7f33028c4640 1 -- 172.21.15.150:0/4075142388 shutdown_connections 2024-09-17T05:50:27.880 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:27.879+0000 7f33028c4640 1 --2- 172.21.15.150:0/4075142388 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f32fc0d07f0 0x7f32fc0b1da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:50:27.880 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:27.879+0000 7f33028c4640 1 --2- 172.21.15.150:0/4075142388 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f32fc0c5b90 0x7f32fc0d02b0 unknown :-1 s=CLOSED pgs=469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:50:27.880 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:27.879+0000 7f33028c4640 1 -- 172.21.15.150:0/4075142388 >> 172.21.15.150:0/4075142388 conn(0x7f32fc0cef80 msgr2=0x7f32fc0cf390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:50:27.880 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:27.879+0000 7f33028c4640 1 -- 172.21.15.150:0/4075142388 shutdown_connections 2024-09-17T05:50:27.880 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:27.879+0000 7f33028c4640 1 -- 172.21.15.150:0/4075142388 wait complete. 2024-09-17T05:50:27.881 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:27.880+0000 7f33028c4640 1 Processor -- start 2024-09-17T05:50:27.881 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:27.881+0000 7f33028c4640 1 -- start start 2024-09-17T05:50:27.884 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:27.882+0000 7f33028c4640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f32fc09ba60 0x7f32fc15c2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:50:27.884 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:27.882+0000 7f33028c4640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f32fc0c5b90 0x7f32fc15e440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:50:27.884 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:27.882+0000 7f33028c4640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f32fc0d07f0 0x7f32fc1f3990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:50:27.884 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:27.882+0000 7f33028c4640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f32fc0b2b70 con 0x7f32fc0c5b90 2024-09-17T05:50:27.884 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:27.882+0000 7f33028c4640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f32fc0b29f0 con 0x7f32fc0d07f0 2024-09-17T05:50:27.884 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:27.882+0000 7f33028c4640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f32fc0b2cf0 con 0x7f32fc09ba60 2024-09-17T05:50:27.884 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:27.882+0000 7f32fb7fe640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f32fc0c5b90 0x7f32fc15e440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:50:27.884 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:27.882+0000 7f32fb7fe640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f32fc0c5b90 0x7f32fc15e440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:57376/0 (socket says 172.21.15.150:57376) 2024-09-17T05:50:27.884 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:27.882+0000 7f32fb7fe640 1 -- 172.21.15.150:0/3739407431 learned_addr learned my addr 172.21.15.150:0/3739407431 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:50:27.885 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:27.882+0000 7f32fbfff640 1 --2- 172.21.15.150:0/3739407431 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f32fc09ba60 0x7f32fc15c2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:50:27.885 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:27.882+0000 7f3300e61640 1 --2- 172.21.15.150:0/3739407431 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f32fc0d07f0 0x7f32fc1f3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:50:27.885 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:27.882+0000 7f32fb7fe640 1 -- 172.21.15.150:0/3739407431 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f32fc09ba60 msgr2=0x7f32fc15c2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:50:27.885 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:27.882+0000 7f32fb7fe640 1 --2- 172.21.15.150:0/3739407431 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f32fc09ba60 0x7f32fc15c2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:50:27.885 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:27.882+0000 7f32fb7fe640 1 -- 172.21.15.150:0/3739407431 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f32fc0d07f0 msgr2=0x7f32fc1f3990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:50:27.885 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:27.882+0000 7f32fb7fe640 1 --2- 172.21.15.150:0/3739407431 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f32fc0d07f0 0x7f32fc1f3990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:50:27.885 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:27.882+0000 7f32fb7fe640 1 -- 172.21.15.150:0/3739407431 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f32fc1f46f0 con 0x7f32fc0c5b90 2024-09-17T05:50:27.885 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:27.882+0000 7f3300e61640 1 --2- 172.21.15.150:0/3739407431 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f32fc0d07f0 0x7f32fc1f3990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:50:27.885 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:27.883+0000 7f32fb7fe640 1 --2- 172.21.15.150:0/3739407431 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f32fc0c5b90 0x7f32fc15e440 secure :-1 s=READY pgs=1338 cs=0 l=1 rev1=1 crypto rx=0x7f32f000ea20 tx=0x7f32f000eee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:50:27.885 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:27.883+0000 7f32f8ff9640 1 -- 172.21.15.150:0/3739407431 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32f000ce40 con 0x7f32fc0c5b90 2024-09-17T05:50:27.885 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:27.883+0000 7f33028c4640 1 -- 172.21.15.150:0/3739407431 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f32fc15b7d0 con 0x7f32fc0c5b90 2024-09-17T05:50:27.885 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:27.883+0000 7f32f8ff9640 1 -- 172.21.15.150:0/3739407431 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f32f0004020 con 0x7f32fc0c5b90 2024-09-17T05:50:27.885 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:27.883+0000 7f32f8ff9640 1 -- 172.21.15.150:0/3739407431 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32f0004470 con 0x7f32fc0c5b90 2024-09-17T05:50:27.886 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:27.883+0000 7f33028c4640 1 -- 172.21.15.150:0/3739407431 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f32fc15e980 con 0x7f32fc0c5b90 2024-09-17T05:50:27.887 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:27.885+0000 7f32f8ff9640 1 -- 172.21.15.150:0/3739407431 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 32) ==== 103481+0+0 (secure 0 0 0) 0x7f32f00035f0 con 0x7f32fc0c5b90 2024-09-17T05:50:27.887 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:27.885+0000 7f32f8ff9640 1 --2- 172.21.15.150:0/3739407431 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f32e807a210 0x7f32e807c720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:50:27.887 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:27.885+0000 7f32f8ff9640 1 -- 172.21.15.150:0/3739407431 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(101..101 src has 1..101) ==== 5821+0+0 (secure 0 0 0) 0x7f32f009a5d0 con 0x7f32fc0c5b90 2024-09-17T05:50:27.887 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:27.885+0000 7f32fbfff640 1 --2- 172.21.15.150:0/3739407431 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f32e807a210 0x7f32e807c720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:50:27.887 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:27.886+0000 7f32fbfff640 1 --2- 172.21.15.150:0/3739407431 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f32e807a210 0x7f32e807c720 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7f32ec034000 tx=0x7f32ec004730 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:50:27.887 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:27.886+0000 7f3309830740 1 Processor -- start 2024-09-17T05:50:27.887 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:27.886+0000 7f3309830740 1 -- start start 2024-09-17T05:50:27.890 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:27.887+0000 7f3309830740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x564603133270 0x564603504fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:50:27.890 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:27.887+0000 7f3309830740 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x56460310a3b0 0x564603505500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:50:27.890 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:27.887+0000 7f3309830740 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x564603112590 0x564603522400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:50:27.890 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:27.887+0000 7f3309830740 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x56460344d820 con 0x564603112590 2024-09-17T05:50:27.891 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:27.887+0000 7f3309830740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x56460343cc50 con 0x564603133270 2024-09-17T05:50:27.891 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:27.887+0000 7f3309830740 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x564603440a60 con 0x56460310a3b0 2024-09-17T05:50:27.891 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:27.887+0000 7f3300e61640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x564603112590 0x564603522400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:50:27.891 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:27.887+0000 7f3300e61640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x564603112590 0x564603522400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:57378/0 (socket says 172.21.15.150:57378) 2024-09-17T05:50:27.891 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:27.887+0000 7f3300e61640 1 -- 172.21.15.150:0/3868508300 learned_addr learned my addr 172.21.15.150:0/3868508300 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:50:27.891 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:27.887+0000 7f32fb7fe640 1 --2- 172.21.15.150:0/3868508300 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x56460310a3b0 0x564603505500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:50:27.891 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:27.887+0000 7f32fbfff640 1 --2- 172.21.15.150:0/3868508300 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x564603133270 0x564603504fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:50:27.891 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:27.887+0000 7f3300e61640 1 -- 172.21.15.150:0/3868508300 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x56460310a3b0 msgr2=0x564603505500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:50:27.891 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:27.887+0000 7f3300e61640 1 --2- 172.21.15.150:0/3868508300 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x56460310a3b0 0x564603505500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:50:27.891 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:27.888+0000 7f3300e61640 1 -- 172.21.15.150:0/3868508300 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x564603133270 msgr2=0x564603504fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:50:27.891 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:27.888+0000 7f3300e61640 1 --2- 172.21.15.150:0/3868508300 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x564603133270 0x564603504fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:50:27.891 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:27.888+0000 7f3300e61640 1 -- 172.21.15.150:0/3868508300 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56460319e850 con 0x564603112590 2024-09-17T05:50:27.891 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:27.888+0000 7f3300e61640 1 --2- 172.21.15.150:0/3868508300 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x564603112590 0x564603522400 secure :-1 s=READY pgs=1339 cs=0 l=1 rev1=1 crypto rx=0x7f32f40020c0 tx=0x7f32f400e530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=962c2ee004c49255 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:50:27.892 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:27.888+0000 7f32e1ffb640 1 -- 172.21.15.150:0/3868508300 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32f4014480 con 0x564603112590 2024-09-17T05:50:27.892 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:27.888+0000 7f32e1ffb640 1 -- 172.21.15.150:0/3868508300 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f32f4019070 con 0x564603112590 2024-09-17T05:50:27.892 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:27.888+0000 7f32e1ffb640 1 -- 172.21.15.150:0/3868508300 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32f4014880 con 0x564603112590 2024-09-17T05:50:27.892 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:27.889+0000 7f3309830740 1 -- 172.21.15.150:0/3868508300 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x564603112590 msgr2=0x564603522400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:50:27.892 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:27.889+0000 7f3309830740 1 --2- 172.21.15.150:0/3868508300 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x564603112590 0x564603522400 secure :-1 s=READY pgs=1339 cs=0 l=1 rev1=1 crypto rx=0x7f32f40020c0 tx=0x7f32f400e530 comp rx=0 tx=0).stop 2024-09-17T05:50:27.892 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:27.889+0000 7f3309830740 1 -- 172.21.15.150:0/3868508300 shutdown_connections 2024-09-17T05:50:27.892 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:27.889+0000 7f3309830740 1 --2- 172.21.15.150:0/3868508300 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x564603112590 0x564603522400 unknown :-1 s=CLOSED pgs=1339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:50:27.892 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:27.889+0000 7f3309830740 1 --2- 172.21.15.150:0/3868508300 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x56460310a3b0 0x564603505500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:50:27.892 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:27.889+0000 7f3309830740 1 --2- 172.21.15.150:0/3868508300 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x564603133270 0x564603504fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:50:27.892 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:27.889+0000 7f3309830740 1 -- 172.21.15.150:0/3868508300 >> 172.21.15.150:0/3868508300 conn(0x5646031273c0 msgr2=0x5646034db280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:50:27.892 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:27.889+0000 7f3309830740 1 -- 172.21.15.150:0/3868508300 shutdown_connections 2024-09-17T05:50:27.892 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:27.889+0000 7f3309830740 1 -- 172.21.15.150:0/3868508300 wait complete. 2024-09-17T05:50:27.893 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:27.890+0000 7f3309830740 1 -- start start 2024-09-17T05:50:27.893 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:27.890+0000 7f3309830740 1 Processor -- start 2024-09-17T05:50:27.896 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:27.891+0000 7f3309830740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x56460310a3b0 0x56460351aa80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:50:27.896 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:27.891+0000 7f3309830740 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x564603112590 0x5646034f3400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:50:27.897 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:27.891+0000 7f3309830740 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x564603133270 0x564603521f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:50:27.897 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:27.891+0000 7f3309830740 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x5646031ad620 con 0x564603133270 2024-09-17T05:50:27.897 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:27.891+0000 7f3309830740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x5646033e25f0 con 0x56460310a3b0 2024-09-17T05:50:27.897 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:27.891+0000 7f3309830740 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x564603505a40 con 0x564603112590 2024-09-17T05:50:27.897 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:27.891+0000 7f3309830740 10 client.0 _ll_register_callbacks cb 0x5646033e60a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T05:50:27.897 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:27.891+0000 7f3300e61640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x564603133270 0x564603521f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:50:27.897 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:27.891+0000 7f3300e61640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x564603133270 0x564603521f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:57392/0 (socket says 172.21.15.150:57392) 2024-09-17T05:50:27.897 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:27.891+0000 7f3300e61640 1 -- 172.21.15.150:0/2938608890 learned_addr learned my addr 172.21.15.150:0/2938608890 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:50:27.897 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:27.891+0000 7f32fbfff640 1 --2- 172.21.15.150:0/2938608890 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x56460310a3b0 0x56460351aa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:50:27.897 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:27.891+0000 7f32fb7fe640 1 --2- 172.21.15.150:0/2938608890 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x564603112590 0x5646034f3400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:50:27.897 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:27.892+0000 7f3300e61640 1 -- 172.21.15.150:0/2938608890 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x564603112590 msgr2=0x5646034f3400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:50:27.897 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:27.892+0000 7f3300e61640 1 --2- 172.21.15.150:0/2938608890 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x564603112590 0x5646034f3400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:50:27.897 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:27.892+0000 7f3300e61640 1 -- 172.21.15.150:0/2938608890 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x56460310a3b0 msgr2=0x56460351aa80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:50:27.898 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:27.892+0000 7f3300e61640 1 --2- 172.21.15.150:0/2938608890 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x56460310a3b0 0x56460351aa80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:50:27.898 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:27.892+0000 7f3300e61640 1 -- 172.21.15.150:0/2938608890 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5646032156b0 con 0x564603133270 2024-09-17T05:50:27.898 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:27.892+0000 7f3300e61640 1 --2- 172.21.15.150:0/2938608890 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x564603133270 0x564603521f10 secure :-1 s=READY pgs=1340 cs=0 l=1 rev1=1 crypto rx=0x7f32f4016040 tx=0x7f32f4004c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4ea911bbc0f369fb server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:50:27.898 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:27.892+0000 7f32daffd640 10 client.0 ms_handle_connect on v2:172.21.15.150:3300/0 2024-09-17T05:50:27.898 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:27.892+0000 7f32daffd640 1 -- 172.21.15.150:0/2938608890 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32f4005450 con 0x564603133270 2024-09-17T05:50:27.898 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:27.892+0000 7f32daffd640 1 -- 172.21.15.150:0/2938608890 <== mon.0 v2:172.21.15.150:3300/0 2 ==== osd_map(101..101 src has 1..101) ==== 5821+0+0 (secure 0 0 0) 0x7f32f40055f0 con 0x564603133270 2024-09-17T05:50:27.898 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:27.892+0000 7f3309830740 1 -- 172.21.15.150:0/2938608890 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f32f4019070 con 0x564603133270 2024-09-17T05:50:27.898 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:27.892+0000 7f32daffd640 1 -- 172.21.15.150:0/2938608890 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_get_version_reply(handle=1 version=60) ==== 24+0+0 (secure 0 0 0) 0x7f32f4004e50 con 0x564603133270 2024-09-17T05:50:27.898 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:27.892+0000 7f3309830740 10 client.8202 fetch_fsmap learned FSMap version 60 2024-09-17T05:50:27.898 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:27.892+0000 7f3309830740 1 -- 172.21.15.150:0/2938608890 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,fsmap=60,monmap=2+}) -- 0x564603518ce0 con 0x564603133270 2024-09-17T05:50:27.898 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:27.892+0000 7f32daffd640 1 -- 172.21.15.150:0/2938608890 <== mon.0 v2:172.21.15.150:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f32f4019070 con 0x564603133270 2024-09-17T05:50:27.898 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:27.892+0000 7f32daffd640 1 -- 172.21.15.150:0/2938608890 <== mon.0 v2:172.21.15.150:3300/0 5 ==== fsmap(e 60) ==== 3502+0+0 (secure 0 0 0) 0x7f32f4014480 con 0x564603133270 2024-09-17T05:50:27.898 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:27.892+0000 7f3309830740 10 client.8202 fetch_fsmap finished waiting for FSMap version 60 2024-09-17T05:50:27.899 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:27.892+0000 7f3309830740 10 client.8202 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-17T05:50:27.899 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:27.892+0000 7f3309830740 20 client.8202 populate_metadata read hostname 'smithi150' 2024-09-17T05:50:27.899 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:27.892+0000 7f3309830740 1 --2- 172.21.15.150:0/2938608890 >> [v2:172.21.15.150:6832/3842369685,v1:172.21.15.150:6834/3842369685] conn(0x5646030f1e40 0x564603532480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:50:27.899 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:27.892+0000 7f3309830740 4 client.8202 mds_command: new command op to 8064 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-17T05:50:27.899 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:27.892+0000 7f3309830740 1 -- 172.21.15.150:0/2938608890 --> [v2:172.21.15.150:6832/3842369685,v1:172.21.15.150:6834/3842369685] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56460344f770 con 0x5646030f1e40 2024-09-17T05:50:27.899 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:27.893+0000 7f32fbfff640 1 --2- 172.21.15.150:0/2938608890 >> [v2:172.21.15.150:6832/3842369685,v1:172.21.15.150:6834/3842369685] conn(0x5646030f1e40 0x564603532480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:50:27.899 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:27.893+0000 7f32daffd640 10 client.8202 ms_handle_connect on v2:172.21.15.150:6832/3842369685 2024-09-17T05:50:27.899 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:27.893+0000 7f32fbfff640 1 --2- 172.21.15.150:0/2938608890 >> [v2:172.21.15.150:6832/3842369685,v1:172.21.15.150:6834/3842369685] conn(0x5646030f1e40 0x564603532480 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ba13ce43ec4937b7 server_cookie=80ac313e4efb4573 in_seq=0 out_seq=0 2024-09-17T05:50:27.899 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:27.894+0000 7f32daffd640 1 -- 172.21.15.150:0/2938608890 <== mds.0 v2:172.21.15.150:6832/3842369685 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x56460344f770 con 0x5646030f1e40 2024-09-17T05:50:27.899 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:27.894+0000 7f32daffd640 10 client.8202 handle_command_reply: tid=0 2024-09-17T05:50:27.899 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:27.894+0000 7f3309830740 1 client.8202 shutdown 2024-09-17T05:50:27.899 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:27.894+0000 7f3309830740 1 -- 172.21.15.150:0/2938608890 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x564603133270 msgr2=0x564603521f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:50:27.899 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:27.894+0000 7f3309830740 1 --2- 172.21.15.150:0/2938608890 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x564603133270 0x564603521f10 secure :-1 s=READY pgs=1340 cs=0 l=1 rev1=1 crypto rx=0x7f32f4016040 tx=0x7f32f4004c20 comp rx=0 tx=0).stop 2024-09-17T05:50:27.900 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:27.894+0000 7f3309830740 1 -- 172.21.15.150:0/2938608890 shutdown_connections 2024-09-17T05:50:27.900 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:27.894+0000 7f3309830740 1 --2- 172.21.15.150:0/2938608890 >> [v2:172.21.15.150:6832/3842369685,v1:172.21.15.150:6834/3842369685] conn(0x5646030f1e40 0x564603532480 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:50:27.900 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:27.894+0000 7f3309830740 1 --2- 172.21.15.150:0/2938608890 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x564603133270 0x564603521f10 unknown :-1 s=CLOSED pgs=1340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:50:27.900 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:27.894+0000 7f3309830740 1 --2- 172.21.15.150:0/2938608890 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x564603112590 0x5646034f3400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:50:27.900 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:27.894+0000 7f32daffd640 0 client.8202 ms_handle_reset on v2:172.21.15.150:6832/3842369685 2024-09-17T05:50:27.900 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:27.894+0000 7f3309830740 1 --2- 172.21.15.150:0/2938608890 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x56460310a3b0 0x56460351aa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:50:27.900 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:27.894+0000 7f3309830740 1 -- 172.21.15.150:0/2938608890 >> 172.21.15.150:0/2938608890 conn(0x5646031273c0 msgr2=0x5646034d5910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:50:27.900 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:27.894+0000 7f3309830740 1 -- 172.21.15.150:0/2938608890 shutdown_connections 2024-09-17T05:50:27.900 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:27.894+0000 7f3309830740 1 -- 172.21.15.150:0/2938608890 wait complete. 2024-09-17T05:50:27.900 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:27.894+0000 7f3309830740 20 client.8202 trim_cache size 0 max 16384 2024-09-17T05:50:27.913 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:27.912+0000 7f3309830740 1 Processor -- start 2024-09-17T05:50:27.913 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:27.913+0000 7f3309830740 1 -- start start 2024-09-17T05:50:27.916 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:27.914+0000 7f3309830740 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x56460310a3b0 0x5646035215a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:50:27.916 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:27.914+0000 7f3309830740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x564603112590 0x564603521ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:50:27.917 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:27.914+0000 7f3309830740 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x564603133270 0x564603515db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:50:27.917 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:27.914+0000 7f3309830740 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f32fc1f6fd0 con 0x564603133270 2024-09-17T05:50:27.917 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:27.914+0000 7f3309830740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f32fc1593b0 con 0x564603112590 2024-09-17T05:50:27.917 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:27.914+0000 7f3309830740 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f32fc159a00 con 0x56460310a3b0 2024-09-17T05:50:27.917 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:27.914+0000 7f3300e61640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x564603133270 0x564603515db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:50:27.917 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:27.914+0000 7f3300e61640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x564603133270 0x564603515db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:57398/0 (socket says 172.21.15.150:57398) 2024-09-17T05:50:27.917 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:27.914+0000 7f3300e61640 1 -- 172.21.15.150:0/3611666396 learned_addr learned my addr 172.21.15.150:0/3611666396 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:50:27.917 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:27.914+0000 7f32fbfff640 1 --2- 172.21.15.150:0/3611666396 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x56460310a3b0 0x5646035215a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:50:27.917 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:27.914+0000 7f3300e61640 1 -- 172.21.15.150:0/3611666396 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x56460310a3b0 msgr2=0x5646035215a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:50:27.917 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:27.914+0000 7f3300e61640 1 --2- 172.21.15.150:0/3611666396 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x56460310a3b0 0x5646035215a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:50:27.917 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:27.914+0000 7f32fb7fe640 1 --2- 172.21.15.150:0/3611666396 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x564603112590 0x564603521ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:50:27.917 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:27.914+0000 7f3300e61640 1 -- 172.21.15.150:0/3611666396 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x564603112590 msgr2=0x564603521ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:50:27.918 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:27.914+0000 7f3300e61640 1 --2- 172.21.15.150:0/3611666396 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x564603112590 0x564603521ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:50:27.918 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:27.914+0000 7f3300e61640 1 -- 172.21.15.150:0/3611666396 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564603521230 con 0x564603133270 2024-09-17T05:50:27.918 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:27.914+0000 7f32fb7fe640 1 --2- 172.21.15.150:0/3611666396 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x564603112590 0x564603521ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T05:50:27.918 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:27.915+0000 7f3300e61640 1 --2- 172.21.15.150:0/3611666396 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x564603133270 0x564603515db0 secure :-1 s=READY pgs=1341 cs=0 l=1 rev1=1 crypto rx=0x7f32f4001f90 tx=0x7f32f4001e20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e2db6d465c5c2311 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:50:27.918 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:27.915+0000 7f32e17fa640 1 -- 172.21.15.150:0/3611666396 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32f4005250 con 0x564603133270 2024-09-17T05:50:27.918 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:27.915+0000 7f32e17fa640 1 -- 172.21.15.150:0/3611666396 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f32f4019040 con 0x564603133270 2024-09-17T05:50:27.918 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:27.915+0000 7f32e17fa640 1 -- 172.21.15.150:0/3611666396 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32f4014980 con 0x564603133270 2024-09-17T05:50:27.918 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:27.915+0000 7f3309830740 1 -- 172.21.15.150:0/3611666396 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x564603133270 msgr2=0x564603515db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:50:27.918 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:27.915+0000 7f3309830740 1 --2- 172.21.15.150:0/3611666396 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x564603133270 0x564603515db0 secure :-1 s=READY pgs=1341 cs=0 l=1 rev1=1 crypto rx=0x7f32f4001f90 tx=0x7f32f4001e20 comp rx=0 tx=0).stop 2024-09-17T05:50:27.918 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:27.915+0000 7f3309830740 1 -- 172.21.15.150:0/3611666396 shutdown_connections 2024-09-17T05:50:27.918 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:27.915+0000 7f3309830740 1 --2- 172.21.15.150:0/3611666396 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x564603112590 0x564603521ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:50:27.918 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:27.915+0000 7f3309830740 1 --2- 172.21.15.150:0/3611666396 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x564603133270 0x564603515db0 unknown :-1 s=CLOSED pgs=1341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:50:27.919 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:27.915+0000 7f3309830740 1 --2- 172.21.15.150:0/3611666396 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x56460310a3b0 0x5646035215a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:50:27.919 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:27.915+0000 7f3309830740 1 -- 172.21.15.150:0/3611666396 >> 172.21.15.150:0/3611666396 conn(0x5646031273c0 msgr2=0x564603517dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:50:27.919 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:27.916+0000 7f3309830740 1 -- 172.21.15.150:0/3611666396 shutdown_connections 2024-09-17T05:50:27.919 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:27.916+0000 7f3309830740 1 -- 172.21.15.150:0/3611666396 wait complete. 2024-09-17T05:50:27.923 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:27.916+0000 7f3309830740 1 -- start start 2024-09-17T05:50:27.923 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:27.917+0000 7f3309830740 1 Processor -- start 2024-09-17T05:50:27.923 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:27.918+0000 7f3309830740 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x56460310a3b0 0x564603596080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:50:27.923 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:27.918+0000 7f3309830740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x564603112590 0x564603515db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:50:27.923 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:27.918+0000 7f3309830740 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x564603133270 0x5646035162f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:50:27.923 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:27.918+0000 7f3309830740 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x5646034f3940 con 0x56460310a3b0 2024-09-17T05:50:27.923 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:27.918+0000 7f3309830740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x56460352fe40 con 0x564603112590 2024-09-17T05:50:27.924 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:27.918+0000 7f3309830740 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x5646035189b0 con 0x564603133270 2024-09-17T05:50:27.924 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:27.918+0000 7f3309830740 10 client.0 _ll_register_callbacks cb 0x7f32f0005e30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T05:50:27.924 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:27.918+0000 7f32fbfff640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x56460310a3b0 0x564603596080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:50:27.924 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:27.918+0000 7f32fbfff640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x56460310a3b0 0x564603596080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:57412/0 (socket says 172.21.15.150:57412) 2024-09-17T05:50:27.924 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:27.918+0000 7f32fbfff640 1 -- 172.21.15.150:0/1023221489 learned_addr learned my addr 172.21.15.150:0/1023221489 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:50:27.924 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:27.918+0000 7f32fb7fe640 1 --2- 172.21.15.150:0/1023221489 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x564603112590 0x564603515db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:50:27.924 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:27.918+0000 7f3300e61640 1 --2- 172.21.15.150:0/1023221489 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x564603133270 0x5646035162f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:50:27.924 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:27.918+0000 7f32fbfff640 1 -- 172.21.15.150:0/1023221489 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x564603133270 msgr2=0x5646035162f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:50:27.924 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:27.918+0000 7f32fbfff640 1 --2- 172.21.15.150:0/1023221489 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x564603133270 0x5646035162f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:50:27.924 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:27.918+0000 7f32fbfff640 1 -- 172.21.15.150:0/1023221489 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x564603112590 msgr2=0x564603515db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:50:27.924 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:27.918+0000 7f32fbfff640 1 --2- 172.21.15.150:0/1023221489 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x564603112590 0x564603515db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:50:27.924 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:27.918+0000 7f32fbfff640 1 -- 172.21.15.150:0/1023221489 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5646034f3cf0 con 0x56460310a3b0 2024-09-17T05:50:27.925 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:27.918+0000 7f3300e61640 1 --2- 172.21.15.150:0/1023221489 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x564603133270 0x5646035162f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:50:27.925 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:27.919+0000 7f32fbfff640 1 --2- 172.21.15.150:0/1023221489 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x56460310a3b0 0x564603596080 secure :-1 s=READY pgs=1342 cs=0 l=1 rev1=1 crypto rx=0x7f32ec02ab00 tx=0x7f32ec02a510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9b90c4558c52ec54 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:50:27.925 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:27.919+0000 7f32daffd640 10 client.0 ms_handle_connect on v2:172.21.15.150:3300/0 2024-09-17T05:50:27.925 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:27.919+0000 7f32daffd640 1 -- 172.21.15.150:0/1023221489 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32ec055830 con 0x56460310a3b0 2024-09-17T05:50:27.925 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:27.919+0000 7f32daffd640 1 -- 172.21.15.150:0/1023221489 <== mon.0 v2:172.21.15.150:3300/0 2 ==== osd_map(101..101 src has 1..101) ==== 5821+0+0 (secure 0 0 0) 0x7f32ec0559d0 con 0x56460310a3b0 2024-09-17T05:50:27.925 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:27.919+0000 7f3309830740 1 -- 172.21.15.150:0/1023221489 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f32f4019040 con 0x56460310a3b0 2024-09-17T05:50:27.925 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:27.919+0000 7f32daffd640 1 -- 172.21.15.150:0/1023221489 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_get_version_reply(handle=1 version=60) ==== 24+0+0 (secure 0 0 0) 0x7f32ec064050 con 0x56460310a3b0 2024-09-17T05:50:27.925 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:27.919+0000 7f3309830740 10 client.8208 fetch_fsmap learned FSMap version 60 2024-09-17T05:50:27.925 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:27.919+0000 7f3309830740 1 -- 172.21.15.150:0/1023221489 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,fsmap=60,monmap=2+}) -- 0x5646035354f0 con 0x56460310a3b0 2024-09-17T05:50:27.925 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:27.919+0000 7f32daffd640 1 -- 172.21.15.150:0/1023221489 <== mon.0 v2:172.21.15.150:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f32f4019040 con 0x56460310a3b0 2024-09-17T05:50:27.925 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:27.919+0000 7f32daffd640 1 -- 172.21.15.150:0/1023221489 <== mon.0 v2:172.21.15.150:3300/0 5 ==== fsmap(e 60) ==== 3502+0+0 (secure 0 0 0) 0x7f32ec067020 con 0x56460310a3b0 2024-09-17T05:50:27.925 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:27.919+0000 7f3309830740 10 client.8208 fetch_fsmap finished waiting for FSMap version 60 2024-09-17T05:50:27.926 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:27.919+0000 7f3309830740 10 client.8208 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-17T05:50:27.926 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:27.919+0000 7f3309830740 20 client.8208 populate_metadata read hostname 'smithi150' 2024-09-17T05:50:27.926 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:27.919+0000 7f3309830740 1 --2- 172.21.15.150:0/1023221489 >> [v2:172.21.15.150:6832/3842369685,v1:172.21.15.150:6834/3842369685] conn(0x5646035a3760 0x5646034d4550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:50:27.926 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:27.919+0000 7f3309830740 4 client.8208 mds_command: new command op to 8064 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-17T05:50:27.926 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:27.919+0000 7f3309830740 1 -- 172.21.15.150:0/1023221489 --> [v2:172.21.15.150:6832/3842369685,v1:172.21.15.150:6834/3842369685] -- command(tid 0: {"prefix": "status"}) -- 0x56460344b220 con 0x5646035a3760 2024-09-17T05:50:27.926 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:27.919+0000 7f32fb7fe640 1 --2- 172.21.15.150:0/1023221489 >> [v2:172.21.15.150:6832/3842369685,v1:172.21.15.150:6834/3842369685] conn(0x5646035a3760 0x5646034d4550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:50:27.926 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:27.920+0000 7f32daffd640 10 client.8208 ms_handle_connect on v2:172.21.15.150:6832/3842369685 2024-09-17T05:50:27.926 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:27.920+0000 7f32fb7fe640 1 --2- 172.21.15.150:0/1023221489 >> [v2:172.21.15.150:6832/3842369685,v1:172.21.15.150:6834/3842369685] conn(0x5646035a3760 0x5646034d4550 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9052afdc07e70ae server_cookie=46bdca4f916478a4 in_seq=0 out_seq=0 2024-09-17T05:50:27.926 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:27.920+0000 7f32daffd640 1 -- 172.21.15.150:0/1023221489 <== mds.0 v2:172.21.15.150:6832/3842369685 1 ==== command_reply(tid 0: 0 ) ==== 8+0+333 (crc 0 0 0) 0x56460344b220 con 0x5646035a3760 2024-09-17T05:50:27.926 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:27.920+0000 7f32daffd640 10 client.8208 handle_command_reply: tid=0 2024-09-17T05:50:27.926 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:27.920+0000 7f3309830740 1 client.8208 shutdown 2024-09-17T05:50:27.926 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:27.920+0000 7f3309830740 1 -- 172.21.15.150:0/1023221489 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x56460310a3b0 msgr2=0x564603596080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:50:27.927 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:27.920+0000 7f3309830740 1 --2- 172.21.15.150:0/1023221489 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x56460310a3b0 0x564603596080 secure :-1 s=READY pgs=1342 cs=0 l=1 rev1=1 crypto rx=0x7f32ec02ab00 tx=0x7f32ec02a510 comp rx=0 tx=0).stop 2024-09-17T05:50:27.927 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:27.920+0000 7f3309830740 1 -- 172.21.15.150:0/1023221489 shutdown_connections 2024-09-17T05:50:27.927 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:27.920+0000 7f3309830740 1 --2- 172.21.15.150:0/1023221489 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x564603112590 0x564603515db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:50:27.927 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:27.920+0000 7f3309830740 1 --2- 172.21.15.150:0/1023221489 >> [v2:172.21.15.150:6832/3842369685,v1:172.21.15.150:6834/3842369685] conn(0x5646035a3760 0x5646034d4550 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:50:27.927 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:27.920+0000 7f3309830740 1 --2- 172.21.15.150:0/1023221489 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x564603133270 0x5646035162f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:50:27.927 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:27.920+0000 7f3309830740 1 --2- 172.21.15.150:0/1023221489 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x56460310a3b0 0x564603596080 unknown :-1 s=CLOSED pgs=1342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:50:27.927 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:27.920+0000 7f32daffd640 0 client.8208 ms_handle_reset on v2:172.21.15.150:6832/3842369685 2024-09-17T05:50:27.927 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:27.920+0000 7f3309830740 1 -- 172.21.15.150:0/1023221489 >> 172.21.15.150:0/1023221489 conn(0x5646031273c0 msgr2=0x564603517dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:50:27.927 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:27.920+0000 7f3309830740 1 -- 172.21.15.150:0/1023221489 shutdown_connections 2024-09-17T05:50:27.927 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:27.920+0000 7f3309830740 1 -- 172.21.15.150:0/1023221489 wait complete. 2024-09-17T05:50:27.928 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:27.921+0000 7f3309830740 20 client.8208 trim_cache size 0 max 16384 2024-09-17T05:50:27.928 INFO:teuthology.orchestra.run.smithi150.stdout:{ 2024-09-17T05:50:27.928 INFO:teuthology.orchestra.run.smithi150.stdout: "cluster_fsid": "9f2e05e9-d629-47b3-b26b-1360655b7d20", 2024-09-17T05:50:27.928 INFO:teuthology.orchestra.run.smithi150.stdout: "whoami": 0, 2024-09-17T05:50:27.928 INFO:teuthology.orchestra.run.smithi150.stdout: "id": 8064, 2024-09-17T05:50:27.928 INFO:teuthology.orchestra.run.smithi150.stdout: "want_state": "up:active", 2024-09-17T05:50:27.928 INFO:teuthology.orchestra.run.smithi150.stdout: "state": "up:active", 2024-09-17T05:50:27.928 INFO:teuthology.orchestra.run.smithi150.stdout: "fs_name": "cephfs", 2024-09-17T05:50:27.928 INFO:teuthology.orchestra.run.smithi150.stdout: "rank_uptime": 10.242494707000001, 2024-09-17T05:50:27.928 INFO:teuthology.orchestra.run.smithi150.stdout: "mdsmap_epoch": 60, 2024-09-17T05:50:27.929 INFO:teuthology.orchestra.run.smithi150.stdout: "osdmap_epoch": 101, 2024-09-17T05:50:27.929 INFO:teuthology.orchestra.run.smithi150.stdout: "osdmap_epoch_barrier": 101, 2024-09-17T05:50:27.929 INFO:teuthology.orchestra.run.smithi150.stdout: "uptime": 15.972288476999999 2024-09-17T05:50:27.929 INFO:teuthology.orchestra.run.smithi150.stdout:} 2024-09-17T05:50:27.930 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:27.921+0000 7f33028c4640 1 -- 172.21.15.150:0/3739407431 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f32e807a210 msgr2=0x7f32e807c720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:50:27.930 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:27.921+0000 7f33028c4640 1 --2- 172.21.15.150:0/3739407431 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f32e807a210 0x7f32e807c720 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7f32ec034000 tx=0x7f32ec004730 comp rx=0 tx=0).stop 2024-09-17T05:50:27.930 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:27.921+0000 7f33028c4640 1 -- 172.21.15.150:0/3739407431 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f32fc0c5b90 msgr2=0x7f32fc15e440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:50:27.930 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:27.921+0000 7f33028c4640 1 --2- 172.21.15.150:0/3739407431 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f32fc0c5b90 0x7f32fc15e440 secure :-1 s=READY pgs=1338 cs=0 l=1 rev1=1 crypto rx=0x7f32f000ea20 tx=0x7f32f000eee0 comp rx=0 tx=0).stop 2024-09-17T05:50:27.930 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:27.921+0000 7f33028c4640 1 -- 172.21.15.150:0/3739407431 shutdown_connections 2024-09-17T05:50:27.930 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:27.921+0000 7f33028c4640 1 --2- 172.21.15.150:0/3739407431 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f32fc0d07f0 0x7f32fc1f3990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:50:27.930 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:27.921+0000 7f33028c4640 1 --2- 172.21.15.150:0/3739407431 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f32e807a210 0x7f32e807c720 unknown :-1 s=CLOSED pgs=578 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:50:27.930 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:27.921+0000 7f33028c4640 1 --2- 172.21.15.150:0/3739407431 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f32fc0c5b90 0x7f32fc15e440 unknown :-1 s=CLOSED pgs=1338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:50:27.930 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:27.921+0000 7f33028c4640 1 --2- 172.21.15.150:0/3739407431 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f32fc09ba60 0x7f32fc15c2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:50:27.930 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:27.921+0000 7f33028c4640 1 -- 172.21.15.150:0/3739407431 >> 172.21.15.150:0/3739407431 conn(0x7f32fc0cef80 msgr2=0x7f32fc15fd40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:50:27.930 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:27.921+0000 7f33028c4640 1 -- 172.21.15.150:0/3739407431 shutdown_connections 2024-09-17T05:50:27.930 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:27.921+0000 7f33028c4640 1 -- 172.21.15.150:0/3739407431 wait complete. 2024-09-17T05:50:27.934 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-17T05:50:28.048 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:28.047+0000 7fa0396c5640 1 -- 172.21.15.150:0/190776670 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa0340b1e00 msgr2=0x7fa0340cd130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:50:28.048 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:28.047+0000 7fa0396c5640 1 --2- 172.21.15.150:0/190776670 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa0340b1e00 0x7fa0340cd130 secure :-1 s=READY pgs=1343 cs=0 l=1 rev1=1 crypto rx=0x7fa02c005fd0 tx=0x7fa02c02aa90 comp rx=0 tx=0).stop 2024-09-17T05:50:28.049 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:28.047+0000 7fa0396c5640 1 -- 172.21.15.150:0/190776670 shutdown_connections 2024-09-17T05:50:28.049 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:28.047+0000 7fa0396c5640 1 --2- 172.21.15.150:0/190776670 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa0340b1e00 0x7fa0340cd130 unknown :-1 s=CLOSED pgs=1343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:50:28.049 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:28.047+0000 7fa0396c5640 1 --2- 172.21.15.150:0/190776670 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa0340d1060 0x7fa0340b18c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:50:28.049 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:28.047+0000 7fa0396c5640 1 -- 172.21.15.150:0/190776670 >> 172.21.15.150:0/190776670 conn(0x7fa0340b3fc0 msgr2=0x7fa0340b43d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:50:28.049 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:28.047+0000 7fa0396c5640 1 -- 172.21.15.150:0/190776670 shutdown_connections 2024-09-17T05:50:28.049 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:28.047+0000 7fa0396c5640 1 -- 172.21.15.150:0/190776670 wait complete. 2024-09-17T05:50:28.050 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:28.049+0000 7fa0396c5640 1 Processor -- start 2024-09-17T05:50:28.050 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:28.049+0000 7fa0396c5640 1 -- start start 2024-09-17T05:50:28.052 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:28.050+0000 7fa0396c5640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa0340b1e00 0x7fa034153b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:50:28.053 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:28.051+0000 7fa0396c5640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa0340d0c50 0x7fa0341e8140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:50:28.053 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:28.051+0000 7fa0396c5640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa0340d1060 0x7fa0340b6410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:50:28.053 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:28.051+0000 7fa0396c5640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7fa0340b2390 con 0x7fa0340d0c50 2024-09-17T05:50:28.053 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:28.051+0000 7fa0396c5640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fa0340b2210 con 0x7fa0340b1e00 2024-09-17T05:50:28.053 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:28.051+0000 7fa0396c5640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fa0340ceb70 con 0x7fa0340d1060 2024-09-17T05:50:28.053 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:28.051+0000 7fa02bfff640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa0340d0c50 0x7fa0341e8140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:50:28.053 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:28.051+0000 7fa02bfff640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa0340d0c50 0x7fa0341e8140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:57440/0 (socket says 172.21.15.150:57440) 2024-09-17T05:50:28.053 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:28.051+0000 7fa02bfff640 1 -- 172.21.15.150:0/3107495197 learned_addr learned my addr 172.21.15.150:0/3107495197 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:50:28.053 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:28.051+0000 7fa0337fe640 1 --2- 172.21.15.150:0/3107495197 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa0340d1060 0x7fa0340b6410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:50:28.053 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:28.051+0000 7fa032ffd640 1 --2- 172.21.15.150:0/3107495197 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa0340b1e00 0x7fa034153b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:50:28.053 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:28.051+0000 7fa02bfff640 1 -- 172.21.15.150:0/3107495197 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa0340d1060 msgr2=0x7fa0340b6410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:50:28.054 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:28.051+0000 7fa02bfff640 1 --2- 172.21.15.150:0/3107495197 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa0340d1060 0x7fa0340b6410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:50:28.054 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:28.051+0000 7fa02bfff640 1 -- 172.21.15.150:0/3107495197 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa0340b1e00 msgr2=0x7fa034153b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:50:28.054 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:28.051+0000 7fa02bfff640 1 --2- 172.21.15.150:0/3107495197 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa0340b1e00 0x7fa034153b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:50:28.054 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:28.051+0000 7fa02bfff640 1 -- 172.21.15.150:0/3107495197 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa0341e8680 con 0x7fa0340d0c50 2024-09-17T05:50:28.054 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:28.051+0000 7fa02bfff640 1 --2- 172.21.15.150:0/3107495197 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa0340d0c50 0x7fa0341e8140 secure :-1 s=READY pgs=1344 cs=0 l=1 rev1=1 crypto rx=0x7fa01c00c9a0 tx=0x7fa01c00ce60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:50:28.054 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:28.051+0000 7fa02b7fe640 1 -- 172.21.15.150:0/3107495197 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa01c004220 con 0x7fa0340d0c50 2024-09-17T05:50:28.054 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:28.051+0000 7fa02b7fe640 1 -- 172.21.15.150:0/3107495197 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa01c0079b0 con 0x7fa0340d0c50 2024-09-17T05:50:28.054 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:28.051+0000 7fa0396c5640 1 -- 172.21.15.150:0/3107495197 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa0340c86a0 con 0x7fa0340d0c50 2024-09-17T05:50:28.054 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:28.051+0000 7fa02b7fe640 1 -- 172.21.15.150:0/3107495197 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa01c007e00 con 0x7fa0340d0c50 2024-09-17T05:50:28.054 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:28.051+0000 7fa0396c5640 1 -- 172.21.15.150:0/3107495197 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa0340c8c60 con 0x7fa0340d0c50 2024-09-17T05:50:28.055 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:28.053+0000 7fa0396c5640 1 -- 172.21.15.150:0/3107495197 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa0340cd130 con 0x7fa0340d0c50 2024-09-17T05:50:28.055 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:28.053+0000 7fa02b7fe640 1 -- 172.21.15.150:0/3107495197 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 32) ==== 103481+0+0 (secure 0 0 0) 0x7fa01c003610 con 0x7fa0340d0c50 2024-09-17T05:50:28.055 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:28.054+0000 7fa02b7fe640 1 --2- 172.21.15.150:0/3107495197 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fa01407a240 0x7fa01407c750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:50:28.055 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:28.054+0000 7fa02b7fe640 1 -- 172.21.15.150:0/3107495197 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(101..101 src has 1..101) ==== 5821+0+0 (secure 0 0 0) 0x7fa01c0999b0 con 0x7fa0340d0c50 2024-09-17T05:50:28.055 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:28.054+0000 7fa032ffd640 1 --2- 172.21.15.150:0/3107495197 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fa01407a240 0x7fa01407c750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:50:28.056 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:28.054+0000 7fa032ffd640 1 --2- 172.21.15.150:0/3107495197 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fa01407a240 0x7fa01407c750 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7fa024006fd0 tx=0x7fa024009060 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:50:28.059 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:28.058+0000 7fa02b7fe640 1 -- 172.21.15.150:0/3107495197 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fa0341e8680 con 0x7fa0340d0c50 2024-09-17T05:50:28.268 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:28.267+0000 7fa0396c5640 1 -- 172.21.15.150:0/3107495197 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7fa0340c8430 con 0x7fa0340d0c50 2024-09-17T05:50:28.268 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:28.267+0000 7fa02b7fe640 1 -- 172.21.15.150:0/3107495197 <== mon.0 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v60) ==== 53+0+73 (secure 0 0 0) 0x7fa01c014030 con 0x7fa0340d0c50 2024-09-17T05:50:28.269 INFO:teuthology.orchestra.run.smithi150.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-17T05:50:28.271 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:28.269+0000 7fa0396c5640 1 -- 172.21.15.150:0/3107495197 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fa01407a240 msgr2=0x7fa01407c750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:50:28.271 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:28.269+0000 7fa0396c5640 1 --2- 172.21.15.150:0/3107495197 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fa01407a240 0x7fa01407c750 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7fa024006fd0 tx=0x7fa024009060 comp rx=0 tx=0).stop 2024-09-17T05:50:28.271 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:28.269+0000 7fa0396c5640 1 -- 172.21.15.150:0/3107495197 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa0340d0c50 msgr2=0x7fa0341e8140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:50:28.271 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:28.269+0000 7fa0396c5640 1 --2- 172.21.15.150:0/3107495197 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa0340d0c50 0x7fa0341e8140 secure :-1 s=READY pgs=1344 cs=0 l=1 rev1=1 crypto rx=0x7fa01c00c9a0 tx=0x7fa01c00ce60 comp rx=0 tx=0).stop 2024-09-17T05:50:28.271 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:28.269+0000 7fa0396c5640 1 -- 172.21.15.150:0/3107495197 shutdown_connections 2024-09-17T05:50:28.271 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:28.269+0000 7fa0396c5640 1 --2- 172.21.15.150:0/3107495197 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fa01407a240 0x7fa01407c750 unknown :-1 s=CLOSED pgs=579 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:50:28.272 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:28.269+0000 7fa0396c5640 1 --2- 172.21.15.150:0/3107495197 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa0340d1060 0x7fa0340b6410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:50:28.272 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:28.269+0000 7fa0396c5640 1 --2- 172.21.15.150:0/3107495197 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa0340d0c50 0x7fa0341e8140 unknown :-1 s=CLOSED pgs=1344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:50:28.272 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:28.269+0000 7fa0396c5640 1 --2- 172.21.15.150:0/3107495197 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa0340b1e00 0x7fa034153b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:50:28.272 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:28.269+0000 7fa0396c5640 1 -- 172.21.15.150:0/3107495197 >> 172.21.15.150:0/3107495197 conn(0x7fa0340b3fc0 msgr2=0x7fa034072450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:50:28.272 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:28.270+0000 7fa0396c5640 1 -- 172.21.15.150:0/3107495197 shutdown_connections 2024-09-17T05:50:28.273 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:28.270+0000 7fa0396c5640 1 -- 172.21.15.150:0/3107495197 wait complete. 2024-09-17T05:50:28.281 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-09-17T05:50:28.281 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-17T05:50:28.282 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi150.front.sepia.ceph.com 2024-09-17T05:50:28.282 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-17T05:50:28.282 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-17T05:50:28.282 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-09-17T05:50:28.282 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-09-17T05:50:28.282 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-17T05:50:28.282 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-17T05:50:28.282 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:50:28.283 DEBUG:teuthology.orchestra.run.smithi150:> ip addr 2024-09-17T05:50:28.298 INFO:teuthology.orchestra.run.smithi150.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-17T05:50:28.299 INFO:teuthology.orchestra.run.smithi150.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-17T05:50:28.299 INFO:teuthology.orchestra.run.smithi150.stdout: inet 127.0.0.1/8 scope host lo 2024-09-17T05:50:28.299 INFO:teuthology.orchestra.run.smithi150.stdout: valid_lft forever preferred_lft forever 2024-09-17T05:50:28.299 INFO:teuthology.orchestra.run.smithi150.stdout: inet6 ::1/128 scope host 2024-09-17T05:50:28.299 INFO:teuthology.orchestra.run.smithi150.stdout: valid_lft forever preferred_lft forever 2024-09-17T05:50:28.299 INFO:teuthology.orchestra.run.smithi150.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-17T05:50:28.299 INFO:teuthology.orchestra.run.smithi150.stdout: link/ether 0c:c4:7a:d9:da:bc brd ff:ff:ff:ff:ff:ff 2024-09-17T05:50:28.299 INFO:teuthology.orchestra.run.smithi150.stdout: altname enp7s0f0 2024-09-17T05:50:28.299 INFO:teuthology.orchestra.run.smithi150.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-17T05:50:28.299 INFO:teuthology.orchestra.run.smithi150.stdout: link/ether 0c:c4:7a:d9:da:bd brd ff:ff:ff:ff:ff:ff 2024-09-17T05:50:28.299 INFO:teuthology.orchestra.run.smithi150.stdout: altname enp7s0f1 2024-09-17T05:50:28.299 INFO:teuthology.orchestra.run.smithi150.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-17T05:50:28.300 INFO:teuthology.orchestra.run.smithi150.stdout: link/ether 0c:c4:7a:88:6e:34 brd ff:ff:ff:ff:ff:ff 2024-09-17T05:50:28.300 INFO:teuthology.orchestra.run.smithi150.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-17T05:50:28.300 INFO:teuthology.orchestra.run.smithi150.stdout: link/ether 0c:c4:7a:88:6e:35 brd ff:ff:ff:ff:ff:ff 2024-09-17T05:50:28.300 INFO:teuthology.orchestra.run.smithi150.stdout: inet 172.21.15.150/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-09-17T05:50:28.300 INFO:teuthology.orchestra.run.smithi150.stdout: valid_lft 42286sec preferred_lft 42286sec 2024-09-17T05:50:28.300 INFO:teuthology.orchestra.run.smithi150.stdout: inet6 fe80::ec4:7aff:fe88:6e35/64 scope link noprefixroute 2024-09-17T05:50:28.300 INFO:teuthology.orchestra.run.smithi150.stdout: valid_lft forever preferred_lft forever 2024-09-17T05:50:28.300 INFO:teuthology.orchestra.run.smithi150.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-17T05:50:28.300 INFO:teuthology.orchestra.run.smithi150.stdout: link/ether 1a:d2:4c:31:46:82 brd ff:ff:ff:ff:ff:ff 2024-09-17T05:50:28.300 INFO:teuthology.orchestra.run.smithi150.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-17T05:50:28.300 INFO:teuthology.orchestra.run.smithi150.stdout: valid_lft forever preferred_lft forever 2024-09-17T05:50:28.300 INFO:teuthology.orchestra.run.smithi150.stdout: inet6 fe80::70b6:c6ff:fe60:62a2/64 scope link 2024-09-17T05:50:28.301 INFO:teuthology.orchestra.run.smithi150.stdout: valid_lft forever preferred_lft forever 2024-09-17T05:50:28.301 INFO:teuthology.orchestra.run.smithi150.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-17T05:50:28.301 INFO:teuthology.orchestra.run.smithi150.stdout: link/ether 32:e1:8b:37:8c:b3 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-17T05:50:28.301 INFO:teuthology.orchestra.run.smithi150.stdout: inet6 fe80::30e1:8bff:fe37:8cb3/64 scope link 2024-09-17T05:50:28.301 INFO:teuthology.orchestra.run.smithi150.stdout: valid_lft forever preferred_lft forever 2024-09-17T05:50:28.301 INFO:teuthology.orchestra.run.smithi150.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-17T05:50:28.301 INFO:teuthology.orchestra.run.smithi150.stdout: link/ether 1a:d2:4c:31:46:82 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-17T05:50:28.301 INFO:teuthology.orchestra.run.smithi150.stdout: inet6 fe80::18d2:4cff:fe31:4682/64 scope link 2024-09-17T05:50:28.301 INFO:teuthology.orchestra.run.smithi150.stdout: valid_lft forever preferred_lft forever 2024-09-17T05:50:28.301 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:50:28.302 DEBUG:teuthology.orchestra.run.smithi150:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-17T05:50:28.362 INFO:teuthology.orchestra.run.smithi150.stdout:1 2024-09-17T05:50:28.363 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:50:28.364 DEBUG:teuthology.orchestra.run.smithi150:> route 2024-09-17T05:50:28.420 INFO:teuthology.orchestra.run.smithi150.stdout:Kernel IP routing table 2024-09-17T05:50:28.420 INFO:teuthology.orchestra.run.smithi150.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-17T05:50:28.420 INFO:teuthology.orchestra.run.smithi150.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-17T05:50:28.420 INFO:teuthology.orchestra.run.smithi150.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-17T05:50:28.420 INFO:teuthology.orchestra.run.smithi150.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-17T05:50:28.420 DEBUG:teuthology.orchestra.run.smithi150:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-17T05:50:28.421 DEBUG:teuthology.orchestra.run.smithi150:> set -e 2024-09-17T05:50:28.421 DEBUG:teuthology.orchestra.run.smithi150:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-17T05:50:28.421 DEBUG:teuthology.orchestra.run.smithi150:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-17T05:50:28.421 DEBUG:teuthology.orchestra.run.smithi150:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-17T05:50:28.421 DEBUG:teuthology.orchestra.run.smithi150:> ') 2024-09-17T05:50:28.508 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:28 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-17T05:50:28.541 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:28 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T05:50:28.547 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:50:28.547 DEBUG:teuthology.orchestra.run.smithi150:> ip netns list 2024-09-17T05:50:28.563 INFO:teuthology.orchestra.run.smithi150.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-09-17T05:50:28.563 INFO:teuthology.orchestra.run.smithi150.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-17T05:50:28.563 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-17T05:50:28.563 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:50:28.563 DEBUG:teuthology.orchestra.run.smithi150:> sudo ip link set brx.0 up 2024-09-17T05:50:28.629 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-17T05:50:28.630 DEBUG:teuthology.orchestra.run.smithi150:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-17T05:50:28.685 INFO:teuthology.orchestra.run.smithi150.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-17T05:50:28.685 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-17T05:50:28.685 DEBUG:teuthology.orchestra.run.smithi150:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-17T05:50:28.741 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-09-17T05:50:28.741 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:50:28.741 DEBUG:teuthology.orchestra.run.smithi150:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-17T05:50:28.836 INFO:teuthology.orchestra.run.smithi150.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-17T05:50:28.836 INFO:teuthology.orchestra.run.smithi150.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-17T05:50:28.836 INFO:teuthology.orchestra.run.smithi150.stdout:invalid new device string format 2024-09-17T05:50:28.847 INFO:teuthology.orchestra.run.smithi150.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-17T05:50:28.847 INFO:teuthology.orchestra.run.smithi150.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-17T05:50:28.847 INFO:teuthology.orchestra.run.smithi150.stdout:invalid new device string format 2024-09-17T05:50:28.847 INFO:teuthology.orchestra.run.smithi150.stdout:mount.ceph: resolved to: "172.21.15.150:3300,172.21.15.176:3300,172.21.15.176:3301" 2024-09-17T05:50:28.847 INFO:teuthology.orchestra.run.smithi150.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-17T05:50:28.854 INFO:teuthology.orchestra.run.smithi150.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-17T05:50:28.854 INFO:teuthology.orchestra.run.smithi150.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-17T05:50:28.854 INFO:teuthology.orchestra.run.smithi150.stdout:invalid new device string format 2024-09-17T05:50:28.854 INFO:teuthology.orchestra.run.smithi150.stdout:mount.ceph: resolved to: "172.21.15.150:3300,172.21.15.176:3300,172.21.15.176:3301" 2024-09-17T05:50:28.854 INFO:teuthology.orchestra.run.smithi150.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-17T05:50:28.855 INFO:teuthology.orchestra.run.smithi150.stdout:mount.ceph: resolved to: "172.21.15.150:6789,172.21.15.176:6789,172.21.15.176:6790" 2024-09-17T05:50:28.855 INFO:teuthology.orchestra.run.smithi150.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.150:6789,172.21.15.176:6789,172.21.15.176:6790:/ 2024-09-17T05:50:28.855 INFO:teuthology.orchestra.run.smithi150.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=9f2e05e9-d629-47b3-b26b-1360655b7d20" will pass to kernel 2024-09-17T05:50:28.855 INFO:teuthology.orchestra.run.smithi150.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-09-17T05:50:28.855 INFO:teuthology.orchestra.run.smithi150.stdout: You just mounted a file system that supports labels which does not 2024-09-17T05:50:28.856 INFO:teuthology.orchestra.run.smithi150.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-09-17T05:50:28.856 INFO:teuthology.orchestra.run.smithi150.stdout: applications will generate AVC messages and not be allowed access to 2024-09-17T05:50:28.856 INFO:teuthology.orchestra.run.smithi150.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-09-17T05:50:28.857 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-17T05:50:28.857 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:50:28.858 DEBUG:teuthology.orchestra.run.smithi150:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-17T05:50:28.883 DEBUG:teuthology.orchestra.run.smithi150:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-17T05:50:28.973 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:28 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-17T05:50:28.979 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:28 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T05:50:28.985 INFO:teuthology.orchestra.run.smithi150.stdout:client7246 2024-09-17T05:50:28.985 DEBUG:teuthology.orchestra.run.smithi150:> set -ex 2024-09-17T05:50:28.985 DEBUG:teuthology.orchestra.run.smithi150:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T05:50:29.002 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs flag set enable_multiple true --yes-i-really-mean-it 2024-09-17T05:50:29.161 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:29.160+0000 7fedc8507640 1 -- 172.21.15.150:0/3919220951 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fedac005250 msgr2=0x7fedac00b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:50:29.161 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:29.160+0000 7fedc8507640 1 --2- 172.21.15.150:0/3919220951 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fedac005250 0x7fedac00b9c0 secure :-1 s=READY pgs=1346 cs=0 l=1 rev1=1 crypto rx=0x7fedb8005fd0 tx=0x7fedac005830 comp rx=0 tx=0).stop 2024-09-17T05:50:29.161 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:29.160+0000 7fedc8507640 1 -- 172.21.15.150:0/3919220951 shutdown_connections 2024-09-17T05:50:29.161 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:29.160+0000 7fedc8507640 1 --2- 172.21.15.150:0/3919220951 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fedac005250 0x7fedac00b9c0 unknown :-1 s=CLOSED pgs=1346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:50:29.161 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:29.160+0000 7fedc8507640 1 -- 172.21.15.150:0/3919220951 >> 172.21.15.150:0/3919220951 conn(0x7fedc00cef00 msgr2=0x7fedc00cf310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:50:29.162 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:29.160+0000 7fedc8507640 1 -- 172.21.15.150:0/3919220951 shutdown_connections 2024-09-17T05:50:29.162 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:29.160+0000 7fedc8507640 1 -- 172.21.15.150:0/3919220951 wait complete. 2024-09-17T05:50:29.162 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:29.162+0000 7fedc8507640 1 Processor -- start 2024-09-17T05:50:29.162 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:29.162+0000 7fedc8507640 1 -- start start 2024-09-17T05:50:29.165 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:29.163+0000 7fedc8507640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fedac005250 0x7fedc01f3e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:50:29.165 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:29.163+0000 7fedc8507640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fedc01d2260 0x7fedc00b64e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:50:29.165 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:29.163+0000 7fedc8507640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fedc00b6a20 0x7fedc01d4780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:50:29.165 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:29.163+0000 7fedc8507640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7fedc00b2d00 con 0x7fedc01d2260 2024-09-17T05:50:29.165 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:29.163+0000 7fedc8507640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fedc00b2b80 con 0x7fedac005250 2024-09-17T05:50:29.165 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:29.163+0000 7fedc8507640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fedc00b2e80 con 0x7fedc00b6a20 2024-09-17T05:50:29.166 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:29.163+0000 7fedc5aa2640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fedc01d2260 0x7fedc00b64e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:50:29.166 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:29.163+0000 7fedc5aa2640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fedc01d2260 0x7fedc00b64e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:57456/0 (socket says 172.21.15.150:57456) 2024-09-17T05:50:29.166 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:29.163+0000 7fedc5aa2640 1 -- 172.21.15.150:0/883599859 learned_addr learned my addr 172.21.15.150:0/883599859 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:50:29.166 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:29.163+0000 7fedc62a3640 1 --2- 172.21.15.150:0/883599859 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fedac005250 0x7fedc01f3e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:50:29.166 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:29.163+0000 7fedc6aa4640 1 --2- 172.21.15.150:0/883599859 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fedc00b6a20 0x7fedc01d4780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:50:29.166 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:29.164+0000 7fedc5aa2640 1 -- 172.21.15.150:0/883599859 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fedc00b6a20 msgr2=0x7fedc01d4780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:50:29.166 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:29.164+0000 7fedc5aa2640 1 --2- 172.21.15.150:0/883599859 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fedc00b6a20 0x7fedc01d4780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:50:29.166 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:29.164+0000 7fedc5aa2640 1 -- 172.21.15.150:0/883599859 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fedac005250 msgr2=0x7fedc01f3e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:50:29.166 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:29.164+0000 7fedc5aa2640 1 --2- 172.21.15.150:0/883599859 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fedac005250 0x7fedc01f3e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:50:29.166 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:29.164+0000 7fedc5aa2640 1 -- 172.21.15.150:0/883599859 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fedc01f6e10 con 0x7fedc01d2260 2024-09-17T05:50:29.166 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:29.164+0000 7fedc5aa2640 1 --2- 172.21.15.150:0/883599859 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fedc01d2260 0x7fedc00b64e0 secure :-1 s=READY pgs=1347 cs=0 l=1 rev1=1 crypto rx=0x7fedb0004f00 tx=0x7fedb0001630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:50:29.166 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:29.164+0000 7fedb6ffd640 1 -- 172.21.15.150:0/883599859 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fedb0015020 con 0x7fedc01d2260 2024-09-17T05:50:29.166 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:29.164+0000 7fedb6ffd640 1 -- 172.21.15.150:0/883599859 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fedb0011870 con 0x7fedc01d2260 2024-09-17T05:50:29.167 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:29.164+0000 7fedc8507640 1 -- 172.21.15.150:0/883599859 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fedc01f70f0 con 0x7fedc01d2260 2024-09-17T05:50:29.167 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:29.164+0000 7fedb6ffd640 1 -- 172.21.15.150:0/883599859 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fedb0011ca0 con 0x7fedc01d2260 2024-09-17T05:50:29.167 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:29.164+0000 7fedc8507640 1 -- 172.21.15.150:0/883599859 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fedc01f76b0 con 0x7fedc01d2260 2024-09-17T05:50:29.168 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:29.165+0000 7fedc8507640 1 -- 172.21.15.150:0/883599859 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fedc009b8e0 con 0x7fedc01d2260 2024-09-17T05:50:29.168 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:29.166+0000 7fedb6ffd640 1 -- 172.21.15.150:0/883599859 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 32) ==== 103481+0+0 (secure 0 0 0) 0x7fedb0018020 con 0x7fedc01d2260 2024-09-17T05:50:29.168 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:29.166+0000 7fedb6ffd640 1 --2- 172.21.15.150:0/883599859 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7feda407a210 0x7feda407c720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:50:29.168 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:29.166+0000 7fedb6ffd640 1 -- 172.21.15.150:0/883599859 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(101..101 src has 1..101) ==== 5821+0+0 (secure 0 0 0) 0x7fedb009a290 con 0x7fedc01d2260 2024-09-17T05:50:29.168 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:29.166+0000 7fedc62a3640 1 --2- 172.21.15.150:0/883599859 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7feda407a210 0x7feda407c720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:50:29.168 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:29.167+0000 7fedc62a3640 1 --2- 172.21.15.150:0/883599859 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7feda407a210 0x7feda407c720 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7fedbc0019d0 tx=0x7fedbc006040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:50:29.171 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:29.171+0000 7fedb6ffd640 1 -- 172.21.15.150:0/883599859 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fedc009b8e0 con 0x7fedc01d2260 2024-09-17T05:50:29.384 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:29.383+0000 7fedc8507640 1 -- 172.21.15.150:0/883599859 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "fs flag set", "flag_name": "enable_multiple", "val": "true", "yes_i_really_mean_it": true} v 0) -- 0x7fedc00b2140 con 0x7fedc01d2260 2024-09-17T05:50:29.719 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:29.719+0000 7fedb6ffd640 1 -- 172.21.15.150:0/883599859 <== mon.0 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "fs flag set", "flag_name": "enable_multiple", "val": "true", "yes_i_really_mean_it": true}]=0 v61) ==== 136+0+0 (secure 0 0 0) 0x7fedb001f020 con 0x7fedc01d2260 2024-09-17T05:50:29.723 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:29.722+0000 7fedc8507640 1 -- 172.21.15.150:0/883599859 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7feda407a210 msgr2=0x7feda407c720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:50:29.723 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:29.722+0000 7fedc8507640 1 --2- 172.21.15.150:0/883599859 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7feda407a210 0x7feda407c720 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7fedbc0019d0 tx=0x7fedbc006040 comp rx=0 tx=0).stop 2024-09-17T05:50:29.723 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:29.722+0000 7fedc8507640 1 -- 172.21.15.150:0/883599859 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fedc01d2260 msgr2=0x7fedc00b64e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:50:29.723 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:29.722+0000 7fedc8507640 1 --2- 172.21.15.150:0/883599859 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fedc01d2260 0x7fedc00b64e0 secure :-1 s=READY pgs=1347 cs=0 l=1 rev1=1 crypto rx=0x7fedb0004f00 tx=0x7fedb0001630 comp rx=0 tx=0).stop 2024-09-17T05:50:29.723 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:29.722+0000 7fedc8507640 1 -- 172.21.15.150:0/883599859 shutdown_connections 2024-09-17T05:50:29.723 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:29.722+0000 7fedc8507640 1 --2- 172.21.15.150:0/883599859 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7feda407a210 0x7feda407c720 unknown :-1 s=CLOSED pgs=580 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:50:29.724 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:29.722+0000 7fedc8507640 1 --2- 172.21.15.150:0/883599859 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fedc00b6a20 0x7fedc01d4780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:50:29.724 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:29.722+0000 7fedc8507640 1 --2- 172.21.15.150:0/883599859 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fedc01d2260 0x7fedc00b64e0 unknown :-1 s=CLOSED pgs=1347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:50:29.724 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:29.722+0000 7fedc8507640 1 --2- 172.21.15.150:0/883599859 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fedac005250 0x7fedc01f3e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:50:29.724 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:29.722+0000 7fedc8507640 1 -- 172.21.15.150:0/883599859 >> 172.21.15.150:0/883599859 conn(0x7fedc00cef00 msgr2=0x7fedc01e4bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:50:29.724 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:29.722+0000 7fedc8507640 1 -- 172.21.15.150:0/883599859 shutdown_connections 2024-09-17T05:50:29.724 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:29.722+0000 7fedc8507640 1 -- 172.21.15.150:0/883599859 wait complete. 2024-09-17T05:50:29.736 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume ls 2024-09-17T05:50:29.853 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:29.852+0000 7fb7ca1b0640 1 -- 172.21.15.150:0/2347351771 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb7ac004800 msgr2=0x7fb7ac004c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:50:29.853 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:29.852+0000 7fb7ca1b0640 1 --2- 172.21.15.150:0/2347351771 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb7ac004800 0x7fb7ac004c10 secure :-1 s=READY pgs=1349 cs=0 l=1 rev1=1 crypto rx=0x7fb7b80016c0 tx=0x7fb7ac005830 comp rx=0 tx=0).stop 2024-09-17T05:50:29.853 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:29.852+0000 7fb7ca1b0640 1 -- 172.21.15.150:0/2347351771 shutdown_connections 2024-09-17T05:50:29.853 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:29.852+0000 7fb7ca1b0640 1 --2- 172.21.15.150:0/2347351771 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb7ac004800 0x7fb7ac004c10 unknown :-1 s=CLOSED pgs=1349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:50:29.853 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:29.852+0000 7fb7ca1b0640 1 -- 172.21.15.150:0/2347351771 >> 172.21.15.150:0/2347351771 conn(0x7fb7c408bfe0 msgr2=0x7fb7c40d4660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:50:29.853 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:29.852+0000 7fb7ca1b0640 1 -- 172.21.15.150:0/2347351771 shutdown_connections 2024-09-17T05:50:29.853 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:29.852+0000 7fb7ca1b0640 1 -- 172.21.15.150:0/2347351771 wait complete. 2024-09-17T05:50:29.854 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:29.854+0000 7fb7ca1b0640 1 Processor -- start 2024-09-17T05:50:29.854 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:29.854+0000 7fb7ca1b0640 1 -- start start 2024-09-17T05:50:29.857 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:29.855+0000 7fb7ca1b0640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb7ac004800 0x7fb7c41d1800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:50:29.857 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:29.855+0000 7fb7ca1b0640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb7c40cd330 0x7fb7c40cd740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:50:29.857 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:29.855+0000 7fb7ca1b0640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb7c41e5c60 0x7fb7c41e6070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:50:29.857 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:29.855+0000 7fb7ca1b0640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7fb7c40b6ac0 con 0x7fb7c41e5c60 2024-09-17T05:50:29.857 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:29.855+0000 7fb7ca1b0640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fb7c40b6940 con 0x7fb7ac004800 2024-09-17T05:50:29.857 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:29.855+0000 7fb7ca1b0640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fb7c40d2e50 con 0x7fb7c40cd330 2024-09-17T05:50:29.857 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:29.855+0000 7fb7c3fff640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb7c41e5c60 0x7fb7c41e6070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:50:29.858 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:29.855+0000 7fb7c3fff640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb7c41e5c60 0x7fb7c41e6070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:57464/0 (socket says 172.21.15.150:57464) 2024-09-17T05:50:29.858 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:29.855+0000 7fb7c3fff640 1 -- 172.21.15.150:0/4122907277 learned_addr learned my addr 172.21.15.150:0/4122907277 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:50:29.858 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:29.855+0000 7fb7c37fe640 1 --2- 172.21.15.150:0/4122907277 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb7ac004800 0x7fb7c41d1800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:50:29.858 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:29.855+0000 7fb7c2ffd640 1 --2- 172.21.15.150:0/4122907277 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb7c40cd330 0x7fb7c40cd740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:50:29.858 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:29.856+0000 7fb7c3fff640 1 -- 172.21.15.150:0/4122907277 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb7c40cd330 msgr2=0x7fb7c40cd740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:50:29.858 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:29.856+0000 7fb7c3fff640 1 --2- 172.21.15.150:0/4122907277 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb7c40cd330 0x7fb7c40cd740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:50:29.858 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:29.856+0000 7fb7c3fff640 1 -- 172.21.15.150:0/4122907277 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb7ac004800 msgr2=0x7fb7c41d1800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:50:29.858 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:29.856+0000 7fb7c3fff640 1 --2- 172.21.15.150:0/4122907277 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb7ac004800 0x7fb7c41d1800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:50:29.858 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:29.856+0000 7fb7c3fff640 1 -- 172.21.15.150:0/4122907277 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb7c41f5770 con 0x7fb7c41e5c60 2024-09-17T05:50:29.858 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:29.856+0000 7fb7c3fff640 1 --2- 172.21.15.150:0/4122907277 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb7c41e5c60 0x7fb7c41e6070 secure :-1 s=READY pgs=1350 cs=0 l=1 rev1=1 crypto rx=0x7fb7bc005fd0 tx=0x7fb7bc00f790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:50:29.858 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:29.856+0000 7fb7abfff640 1 -- 172.21.15.150:0/4122907277 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7bc003d80 con 0x7fb7c41e5c60 2024-09-17T05:50:29.858 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:29.856+0000 7fb7abfff640 1 -- 172.21.15.150:0/4122907277 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb7bc004b20 con 0x7fb7c41e5c60 2024-09-17T05:50:29.858 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:29.856+0000 7fb7ca1b0640 1 -- 172.21.15.150:0/4122907277 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb7c41e65b0 con 0x7fb7c41e5c60 2024-09-17T05:50:29.859 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:29.856+0000 7fb7abfff640 1 -- 172.21.15.150:0/4122907277 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7bc004030 con 0x7fb7c41e5c60 2024-09-17T05:50:29.859 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:29.856+0000 7fb7ca1b0640 1 -- 172.21.15.150:0/4122907277 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb7c41f5a10 con 0x7fb7c41e5c60 2024-09-17T05:50:29.859 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:29.857+0000 7fb7ca1b0640 1 -- 172.21.15.150:0/4122907277 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb7c40cddd0 con 0x7fb7c41e5c60 2024-09-17T05:50:29.860 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:29.858+0000 7fb7abfff640 1 -- 172.21.15.150:0/4122907277 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 32) ==== 103481+0+0 (secure 0 0 0) 0x7fb7bc0041d0 con 0x7fb7c41e5c60 2024-09-17T05:50:29.860 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:29.858+0000 7fb7abfff640 1 --2- 172.21.15.150:0/4122907277 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fb7b007a240 0x7fb7b007c750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:50:29.860 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:29.858+0000 7fb7abfff640 1 -- 172.21.15.150:0/4122907277 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(101..101 src has 1..101) ==== 5821+0+0 (secure 0 0 0) 0x7fb7bc09a800 con 0x7fb7c41e5c60 2024-09-17T05:50:29.860 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:29.859+0000 7fb7c37fe640 1 --2- 172.21.15.150:0/4122907277 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fb7b007a240 0x7fb7b007c750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:50:29.860 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:29.859+0000 7fb7c37fe640 1 --2- 172.21.15.150:0/4122907277 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fb7b007a240 0x7fb7b007c750 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7fb7b40019d0 tx=0x7fb7b4006040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:50:29.863 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:29.863+0000 7fb7abfff640 1 -- 172.21.15.150:0/4122907277 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fb7bc064180 con 0x7fb7c41e5c60 2024-09-17T05:50:30.060 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:30.060+0000 7fb7ca1b0640 1 -- 172.21.15.150:0/4122907277 --> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] -- mgr_command(tid 0: {"prefix": "fs volume ls", "target": ["mon-mgr", ""]}) -- 0x7fb7c41e2240 con 0x7fb7b007a240 2024-09-17T05:50:30.062 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:30.062+0000 7fb7abfff640 1 -- 172.21.15.150:0/4122907277 <== mgr.4108 v2:172.21.15.176:6800/3631216395 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+41 (secure 0 0 0) 0x7fb7c41e2240 con 0x7fb7b007a240 2024-09-17T05:50:30.063 INFO:teuthology.orchestra.run.smithi150.stdout:[ 2024-09-17T05:50:30.063 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-09-17T05:50:30.063 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "cephfs" 2024-09-17T05:50:30.063 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-09-17T05:50:30.063 INFO:teuthology.orchestra.run.smithi150.stdout:] 2024-09-17T05:50:30.065 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:30.064+0000 7fb7ca1b0640 1 -- 172.21.15.150:0/4122907277 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fb7b007a240 msgr2=0x7fb7b007c750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:50:30.065 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:30.064+0000 7fb7ca1b0640 1 --2- 172.21.15.150:0/4122907277 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fb7b007a240 0x7fb7b007c750 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7fb7b40019d0 tx=0x7fb7b4006040 comp rx=0 tx=0).stop 2024-09-17T05:50:30.065 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:30.064+0000 7fb7ca1b0640 1 -- 172.21.15.150:0/4122907277 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb7c41e5c60 msgr2=0x7fb7c41e6070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:50:30.065 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:30.064+0000 7fb7ca1b0640 1 --2- 172.21.15.150:0/4122907277 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb7c41e5c60 0x7fb7c41e6070 secure :-1 s=READY pgs=1350 cs=0 l=1 rev1=1 crypto rx=0x7fb7bc005fd0 tx=0x7fb7bc00f790 comp rx=0 tx=0).stop 2024-09-17T05:50:30.065 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:30.064+0000 7fb7ca1b0640 1 -- 172.21.15.150:0/4122907277 shutdown_connections 2024-09-17T05:50:30.065 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:30.064+0000 7fb7ca1b0640 1 --2- 172.21.15.150:0/4122907277 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fb7b007a240 0x7fb7b007c750 unknown :-1 s=CLOSED pgs=581 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:50:30.065 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:30.064+0000 7fb7ca1b0640 1 --2- 172.21.15.150:0/4122907277 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb7c41e5c60 0x7fb7c41e6070 unknown :-1 s=CLOSED pgs=1350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:50:30.065 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:30.064+0000 7fb7ca1b0640 1 --2- 172.21.15.150:0/4122907277 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb7c40cd330 0x7fb7c40cd740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:50:30.065 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:30.064+0000 7fb7ca1b0640 1 --2- 172.21.15.150:0/4122907277 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb7ac004800 0x7fb7c41d1800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:50:30.066 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:30.064+0000 7fb7ca1b0640 1 -- 172.21.15.150:0/4122907277 >> 172.21.15.150:0/4122907277 conn(0x7fb7c408bfe0 msgr2=0x7fb7c406dea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:50:30.066 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:30.064+0000 7fb7ca1b0640 1 -- 172.21.15.150:0/4122907277 shutdown_connections 2024-09-17T05:50:30.066 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:30.064+0000 7fb7ca1b0640 1 -- 172.21.15.150:0/4122907277 wait complete. 2024-09-17T05:50:30.076 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-09-17T05:50:30.193 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:30.192+0000 7f988924d640 1 -- 172.21.15.150:0/129134504 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f98840b0990 msgr2=0x7f98840b0da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:50:30.193 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:30.192+0000 7f988924d640 1 --2- 172.21.15.150:0/129134504 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f98840b0990 0x7f98840b0da0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f986c009890 tx=0x7f986c02a4d0 comp rx=0 tx=0).stop 2024-09-17T05:50:30.193 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:30.192+0000 7f988924d640 1 -- 172.21.15.150:0/129134504 shutdown_connections 2024-09-17T05:50:30.194 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:30.192+0000 7f988924d640 1 --2- 172.21.15.150:0/129134504 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f98840b0990 0x7f98840b0da0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:50:30.194 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:30.192+0000 7f988924d640 1 -- 172.21.15.150:0/129134504 >> 172.21.15.150:0/129134504 conn(0x7f98840b2e80 msgr2=0x7f98840b3290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:50:30.194 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:30.192+0000 7f988924d640 1 -- 172.21.15.150:0/129134504 shutdown_connections 2024-09-17T05:50:30.194 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:30.192+0000 7f988924d640 1 -- 172.21.15.150:0/129134504 wait complete. 2024-09-17T05:50:30.195 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:30.194+0000 7f988924d640 1 Processor -- start 2024-09-17T05:50:30.195 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:30.194+0000 7f988924d640 1 -- start start 2024-09-17T05:50:30.198 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:30.196+0000 7f988924d640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f98840b0990 0x7f98840c9af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:50:30.198 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:30.196+0000 7f988924d640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f98840b12e0 0x7f988414acd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:50:30.198 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:30.196+0000 7f988924d640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f98840b6550 0x7f9884071220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:50:30.198 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:30.196+0000 7f988924d640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f98840b1a80 con 0x7f98840b0990 2024-09-17T05:50:30.198 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:30.196+0000 7f988924d640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f98840b1900 con 0x7f98840b6550 2024-09-17T05:50:30.198 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:30.196+0000 7f988924d640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f98840b5560 con 0x7f98840b12e0 2024-09-17T05:50:30.198 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:30.196+0000 7f9882d9d640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f98840b0990 0x7f98840c9af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:50:30.198 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:30.196+0000 7f9882d9d640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f98840b0990 0x7f98840c9af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:59574/0 (socket says 172.21.15.150:59574) 2024-09-17T05:50:30.198 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:30.196+0000 7f9882d9d640 1 -- 172.21.15.150:0/3749099479 learned_addr learned my addr 172.21.15.150:0/3749099479 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:50:30.198 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:30.196+0000 7f987a59c640 1 --2- 172.21.15.150:0/3749099479 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f98840b12e0 0x7f988414acd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:50:30.198 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:30.196+0000 7f988359e640 1 --2- 172.21.15.150:0/3749099479 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f98840b6550 0x7f9884071220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:50:30.198 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:30.196+0000 7f9882d9d640 1 -- 172.21.15.150:0/3749099479 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f98840b12e0 msgr2=0x7f988414acd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:50:30.199 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:30.196+0000 7f9882d9d640 1 --2- 172.21.15.150:0/3749099479 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f98840b12e0 0x7f988414acd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:50:30.199 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:30.196+0000 7f9882d9d640 1 -- 172.21.15.150:0/3749099479 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f98840b6550 msgr2=0x7f9884071220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:50:30.199 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:30.196+0000 7f9882d9d640 1 --2- 172.21.15.150:0/3749099479 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f98840b6550 0x7f9884071220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:50:30.199 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:30.196+0000 7f9882d9d640 1 -- 172.21.15.150:0/3749099479 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f98840701a0 con 0x7f98840b0990 2024-09-17T05:50:30.199 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:30.196+0000 7f9882d9d640 1 --2- 172.21.15.150:0/3749099479 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f98840b0990 0x7f98840c9af0 secure :-1 s=READY pgs=1352 cs=0 l=1 rev1=1 crypto rx=0x7f987400c430 tx=0x7f987400c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:50:30.199 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:30.196+0000 7f987bfff640 1 -- 172.21.15.150:0/3749099479 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9874017070 con 0x7f98840b0990 2024-09-17T05:50:30.199 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:30.196+0000 7f987bfff640 1 -- 172.21.15.150:0/3749099479 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f98740053e0 con 0x7f98840b0990 2024-09-17T05:50:30.199 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:30.196+0000 7f988924d640 1 -- 172.21.15.150:0/3749099479 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9884070460 con 0x7f98840b0990 2024-09-17T05:50:30.199 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:30.196+0000 7f987bfff640 1 -- 172.21.15.150:0/3749099479 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9874003850 con 0x7f98840b0990 2024-09-17T05:50:30.199 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:30.197+0000 7f988924d640 1 -- 172.21.15.150:0/3749099479 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9884070a20 con 0x7f98840b0990 2024-09-17T05:50:30.200 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:30.197+0000 7f988924d640 1 -- 172.21.15.150:0/3749099479 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9884068e80 con 0x7f98840b0990 2024-09-17T05:50:30.200 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:30.198+0000 7f987bfff640 1 -- 172.21.15.150:0/3749099479 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 32) ==== 103481+0+0 (secure 0 0 0) 0x7f987401a070 con 0x7f98840b0990 2024-09-17T05:50:30.201 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:30.199+0000 7f987bfff640 1 --2- 172.21.15.150:0/3749099479 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f986407a240 0x7f986407c750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:50:30.201 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:30.199+0000 7f987bfff640 1 -- 172.21.15.150:0/3749099479 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(101..101 src has 1..101) ==== 5821+0+0 (secure 0 0 0) 0x7f9874098e30 con 0x7f98840b0990 2024-09-17T05:50:30.201 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:30.199+0000 7f987a59c640 1 --2- 172.21.15.150:0/3749099479 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f986407a240 0x7f986407c750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:50:30.201 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:30.199+0000 7f987a59c640 1 --2- 172.21.15.150:0/3749099479 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f986407a240 0x7f986407c750 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7f986c034000 tx=0x7f986c004730 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:50:30.204 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:30.203+0000 7f987bfff640 1 -- 172.21.15.150:0/3749099479 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f9884068e80 con 0x7f98840b0990 2024-09-17T05:50:30.380 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:30.379+0000 7f988924d640 1 -- 172.21.15.150:0/3749099479 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) -- 0x7f98840b0da0 con 0x7f98840b0990 2024-09-17T05:50:30.380 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:30.380+0000 7f987bfff640 1 -- 172.21.15.150:0/3749099479 <== mon.0 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v49)=0 v49) ==== 122+0+0 (secure 0 0 0) 0x7f9874062cf0 con 0x7f98840b0990 2024-09-17T05:50:30.383 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:30.382+0000 7f988924d640 1 -- 172.21.15.150:0/3749099479 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f986407a240 msgr2=0x7f986407c750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:50:30.383 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:30.382+0000 7f988924d640 1 --2- 172.21.15.150:0/3749099479 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f986407a240 0x7f986407c750 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7f986c034000 tx=0x7f986c004730 comp rx=0 tx=0).stop 2024-09-17T05:50:30.383 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:30.382+0000 7f988924d640 1 -- 172.21.15.150:0/3749099479 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f98840b0990 msgr2=0x7f98840c9af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:50:30.383 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:30.382+0000 7f988924d640 1 --2- 172.21.15.150:0/3749099479 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f98840b0990 0x7f98840c9af0 secure :-1 s=READY pgs=1352 cs=0 l=1 rev1=1 crypto rx=0x7f987400c430 tx=0x7f987400c8f0 comp rx=0 tx=0).stop 2024-09-17T05:50:30.383 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:30.382+0000 7f988924d640 1 -- 172.21.15.150:0/3749099479 shutdown_connections 2024-09-17T05:50:30.383 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:30.382+0000 7f988924d640 1 --2- 172.21.15.150:0/3749099479 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f98840b6550 0x7f9884071220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:50:30.383 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:30.382+0000 7f988924d640 1 --2- 172.21.15.150:0/3749099479 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f986407a240 0x7f986407c750 unknown :-1 s=CLOSED pgs=582 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:50:30.383 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:30.382+0000 7f988924d640 1 --2- 172.21.15.150:0/3749099479 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f98840b12e0 0x7f988414acd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:50:30.383 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:30.382+0000 7f988924d640 1 --2- 172.21.15.150:0/3749099479 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f98840b0990 0x7f98840c9af0 unknown :-1 s=CLOSED pgs=1352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:50:30.383 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:30.382+0000 7f988924d640 1 -- 172.21.15.150:0/3749099479 >> 172.21.15.150:0/3749099479 conn(0x7f98840b2e80 msgr2=0x7f9884069130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:50:30.384 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:30.382+0000 7f988924d640 1 -- 172.21.15.150:0/3749099479 shutdown_connections 2024-09-17T05:50:30.384 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:30.382+0000 7f988924d640 1 -- 172.21.15.150:0/3749099479 wait complete. 2024-09-17T05:50:30.395 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config get mgr mgr/volumes/max_concurrent_clones 2024-09-17T05:50:30.511 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:30.510+0000 7f110db62640 1 -- 172.21.15.150:0/261666760 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1108164340 msgr2=0x7f1108166760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:50:30.511 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:30.510+0000 7f110db62640 1 --2- 172.21.15.150:0/261666760 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1108164340 0x7f1108166760 secure :-1 s=READY pgs=1354 cs=0 l=1 rev1=1 crypto rx=0x7f1100005fd0 tx=0x7f110002a8b0 comp rx=0 tx=0).stop 2024-09-17T05:50:30.511 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:30.510+0000 7f110db62640 1 -- 172.21.15.150:0/261666760 shutdown_connections 2024-09-17T05:50:30.511 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:30.510+0000 7f110db62640 1 --2- 172.21.15.150:0/261666760 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1108164340 0x7f1108166760 unknown :-1 s=CLOSED pgs=1354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:50:30.511 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:30.510+0000 7f110db62640 1 -- 172.21.15.150:0/261666760 >> 172.21.15.150:0/261666760 conn(0x7f110806d1c0 msgr2=0x7f110806d5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:50:30.511 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:30.510+0000 7f110db62640 1 -- 172.21.15.150:0/261666760 shutdown_connections 2024-09-17T05:50:30.511 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:30.510+0000 7f110db62640 1 -- 172.21.15.150:0/261666760 wait complete. 2024-09-17T05:50:30.512 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:30.512+0000 7f110db62640 1 Processor -- start 2024-09-17T05:50:30.512 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:30.512+0000 7f110db62640 1 -- start start 2024-09-17T05:50:30.515 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:30.513+0000 7f110db62640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1108073630 0x7f1108154e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:50:30.515 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:30.513+0000 7f110db62640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f11080ccc50 0x7f1108146db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:50:30.516 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:30.513+0000 7f110db62640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1108164340 0x7f11081472f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:50:30.516 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:30.513+0000 7f110db62640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f1108166ca0 con 0x7f11080ccc50 2024-09-17T05:50:30.516 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:30.513+0000 7f110db62640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f11080cfec0 con 0x7f1108164340 2024-09-17T05:50:30.516 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:30.513+0000 7f110db62640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f1108166e20 con 0x7f1108073630 2024-09-17T05:50:30.516 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:30.513+0000 7f1106ffd640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f11080ccc50 0x7f1108146db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:50:30.517 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:30.513+0000 7f1106ffd640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f11080ccc50 0x7f1108146db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:59600/0 (socket says 172.21.15.150:59600) 2024-09-17T05:50:30.517 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:30.513+0000 7f1106ffd640 1 -- 172.21.15.150:0/3827371272 learned_addr learned my addr 172.21.15.150:0/3827371272 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:50:30.517 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:30.513+0000 7f1107fff640 1 --2- 172.21.15.150:0/3827371272 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1108164340 0x7f11081472f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:50:30.517 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:30.513+0000 7f11077fe640 1 --2- 172.21.15.150:0/3827371272 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1108073630 0x7f1108154e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:50:30.517 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:30.513+0000 7f1106ffd640 1 -- 172.21.15.150:0/3827371272 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1108073630 msgr2=0x7f1108154e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:50:30.517 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:30.514+0000 7f1106ffd640 1 --2- 172.21.15.150:0/3827371272 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1108073630 0x7f1108154e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:50:30.517 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:30.514+0000 7f1106ffd640 1 -- 172.21.15.150:0/3827371272 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1108164340 msgr2=0x7f11081472f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:50:30.517 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:30.514+0000 7f1106ffd640 1 --2- 172.21.15.150:0/3827371272 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1108164340 0x7f11081472f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:50:30.517 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:30.514+0000 7f1106ffd640 1 -- 172.21.15.150:0/3827371272 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1108152310 con 0x7f11080ccc50 2024-09-17T05:50:30.517 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:30.514+0000 7f1107fff640 1 --2- 172.21.15.150:0/3827371272 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1108164340 0x7f11081472f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T05:50:30.517 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:30.514+0000 7f11077fe640 1 --2- 172.21.15.150:0/3827371272 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1108073630 0x7f1108154e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T05:50:30.517 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:30.514+0000 7f1106ffd640 1 --2- 172.21.15.150:0/3827371272 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f11080ccc50 0x7f1108146db0 secure :-1 s=READY pgs=1355 cs=0 l=1 rev1=1 crypto rx=0x7f10fc00c370 tx=0x7f10fc00c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:50:30.517 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:30.514+0000 7f10effff640 1 -- 172.21.15.150:0/3827371272 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10fc017070 con 0x7f11080ccc50 2024-09-17T05:50:30.518 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:30.514+0000 7f10effff640 1 -- 172.21.15.150:0/3827371272 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f10fc0035f0 con 0x7f11080ccc50 2024-09-17T05:50:30.518 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:30.514+0000 7f110db62640 1 -- 172.21.15.150:0/3827371272 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f11081518b0 con 0x7f11080ccc50 2024-09-17T05:50:30.518 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:30.514+0000 7f10effff640 1 -- 172.21.15.150:0/3827371272 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10fc003a40 con 0x7f11080ccc50 2024-09-17T05:50:30.518 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:30.514+0000 7f110db62640 1 -- 172.21.15.150:0/3827371272 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f11081f6d50 con 0x7f11080ccc50 2024-09-17T05:50:30.518 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:30.515+0000 7f110db62640 1 -- 172.21.15.150:0/3827371272 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f11080cf570 con 0x7f11080ccc50 2024-09-17T05:50:30.519 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:30.516+0000 7f10effff640 1 -- 172.21.15.150:0/3827371272 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 32) ==== 103481+0+0 (secure 0 0 0) 0x7f10fc01a070 con 0x7f11080ccc50 2024-09-17T05:50:30.519 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:30.516+0000 7f10effff640 1 --2- 172.21.15.150:0/3827371272 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f10f407a240 0x7f10f407c750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:50:30.519 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:30.516+0000 7f10effff640 1 -- 172.21.15.150:0/3827371272 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(101..101 src has 1..101) ==== 5821+0+0 (secure 0 0 0) 0x7f10fc098d50 con 0x7f11080ccc50 2024-09-17T05:50:30.519 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:30.516+0000 7f11077fe640 1 --2- 172.21.15.150:0/3827371272 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f10f407a240 0x7f10f407c750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:50:30.519 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:30.517+0000 7f11077fe640 1 --2- 172.21.15.150:0/3827371272 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f10f407a240 0x7f10f407c750 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7f10f8007fd0 tx=0x7f10f8009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:50:30.521 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:30.521+0000 7f10effff640 1 -- 172.21.15.150:0/3827371272 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f1108152310 con 0x7f11080ccc50 2024-09-17T05:50:30.696 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:30.696+0000 7f110db62640 1 -- 172.21.15.150:0/3827371272 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "config get", "who": "mgr", "key": "mgr/volumes/max_concurrent_clones"} v 0) -- 0x7f110815b230 con 0x7f11080ccc50 2024-09-17T05:50:30.697 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:30.696+0000 7f10effff640 1 -- 172.21.15.150:0/3827371272 <== mon.0 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "config get", "who": "mgr", "key": "mgr/volumes/max_concurrent_clones"}]=0 v49) ==== 116+0+2 (secure 0 0 0) 0x7f10fc062ca0 con 0x7f11080ccc50 2024-09-17T05:50:30.697 INFO:teuthology.orchestra.run.smithi150.stdout:4 2024-09-17T05:50:30.699 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:30.698+0000 7f110db62640 1 -- 172.21.15.150:0/3827371272 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f10f407a240 msgr2=0x7f10f407c750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:50:30.699 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:30.698+0000 7f110db62640 1 --2- 172.21.15.150:0/3827371272 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f10f407a240 0x7f10f407c750 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7f10f8007fd0 tx=0x7f10f8009040 comp rx=0 tx=0).stop 2024-09-17T05:50:30.699 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:30.698+0000 7f110db62640 1 -- 172.21.15.150:0/3827371272 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f11080ccc50 msgr2=0x7f1108146db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:50:30.700 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:30.698+0000 7f110db62640 1 --2- 172.21.15.150:0/3827371272 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f11080ccc50 0x7f1108146db0 secure :-1 s=READY pgs=1355 cs=0 l=1 rev1=1 crypto rx=0x7f10fc00c370 tx=0x7f10fc00c830 comp rx=0 tx=0).stop 2024-09-17T05:50:30.700 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:30.698+0000 7f110db62640 1 -- 172.21.15.150:0/3827371272 shutdown_connections 2024-09-17T05:50:30.700 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:30.698+0000 7f110db62640 1 --2- 172.21.15.150:0/3827371272 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1108164340 0x7f11081472f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:50:30.700 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:30.698+0000 7f110db62640 1 --2- 172.21.15.150:0/3827371272 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f10f407a240 0x7f10f407c750 unknown :-1 s=CLOSED pgs=583 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:50:30.700 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:30.698+0000 7f110db62640 1 --2- 172.21.15.150:0/3827371272 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f11080ccc50 0x7f1108146db0 unknown :-1 s=CLOSED pgs=1355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:50:30.700 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:30.698+0000 7f110db62640 1 --2- 172.21.15.150:0/3827371272 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1108073630 0x7f1108154e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:50:30.700 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:30.698+0000 7f110db62640 1 -- 172.21.15.150:0/3827371272 >> 172.21.15.150:0/3827371272 conn(0x7f110806d1c0 msgr2=0x7f1108159d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:50:30.700 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:30.698+0000 7f110db62640 1 -- 172.21.15.150:0/3827371272 shutdown_connections 2024-09-17T05:50:30.700 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:30.698+0000 7f110db62640 1 -- 172.21.15.150:0/3827371272 wait complete. 2024-09-17T05:50:30.711 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mgr mgr/volumes/max_concurrent_clones 4 2024-09-17T05:50:30.828 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:30.827+0000 7f569e6f4640 1 -- 172.21.15.150:0/1892048206 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f56980ccc30 msgr2=0x7f56980b4390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:50:30.829 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:30.827+0000 7f569e6f4640 1 --2- 172.21.15.150:0/1892048206 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f56980ccc30 0x7f56980b4390 secure :-1 s=READY pgs=1357 cs=0 l=1 rev1=1 crypto rx=0x7f5688005fd0 tx=0x7f568802a5d0 comp rx=0 tx=0).stop 2024-09-17T05:50:30.829 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:30.827+0000 7f569e6f4640 1 -- 172.21.15.150:0/1892048206 shutdown_connections 2024-09-17T05:50:30.829 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:30.827+0000 7f569e6f4640 1 --2- 172.21.15.150:0/1892048206 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f56980cf7c0 0x7f56980cfbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:50:30.829 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:30.827+0000 7f569e6f4640 1 --2- 172.21.15.150:0/1892048206 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f56980ccc30 0x7f56980b4390 unknown :-1 s=CLOSED pgs=1357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:50:30.829 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:30.827+0000 7f569e6f4640 1 -- 172.21.15.150:0/1892048206 >> 172.21.15.150:0/1892048206 conn(0x7f569806d1c0 msgr2=0x7f569806d5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:50:30.829 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:30.827+0000 7f569e6f4640 1 -- 172.21.15.150:0/1892048206 shutdown_connections 2024-09-17T05:50:30.829 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:30.827+0000 7f569e6f4640 1 -- 172.21.15.150:0/1892048206 wait complete. 2024-09-17T05:50:30.830 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:30.829+0000 7f569e6f4640 1 Processor -- start 2024-09-17T05:50:30.830 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:30.829+0000 7f569e6f4640 1 -- start start 2024-09-17T05:50:30.832 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:30.830+0000 7f569e6f4640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5698070290 0x7f5698151cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:50:30.832 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:30.830+0000 7f569e6f4640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f56980ccc30 0x7f56980ab400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:50:30.833 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:30.830+0000 7f569e6f4640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f56980cf7c0 0x7f56980ab940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:50:30.833 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:30.830+0000 7f569e6f4640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f569815c460 con 0x7f56980ccc30 2024-09-17T05:50:30.833 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:30.830+0000 7f569e6f4640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f569815c2e0 con 0x7f5698070290 2024-09-17T05:50:30.833 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:30.830+0000 7f569e6f4640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f569815c5e0 con 0x7f56980cf7c0 2024-09-17T05:50:30.833 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:30.831+0000 7f56977fe640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f56980ccc30 0x7f56980ab400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:50:30.833 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:30.831+0000 7f56977fe640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f56980ccc30 0x7f56980ab400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:59628/0 (socket says 172.21.15.150:59628) 2024-09-17T05:50:30.833 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:30.831+0000 7f56977fe640 1 -- 172.21.15.150:0/1175874608 learned_addr learned my addr 172.21.15.150:0/1175874608 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:50:30.833 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:30.831+0000 7f569cc91640 1 --2- 172.21.15.150:0/1175874608 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f56980cf7c0 0x7f56980ab940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:50:30.833 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:30.831+0000 7f5697fff640 1 --2- 172.21.15.150:0/1175874608 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5698070290 0x7f5698151cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:50:30.833 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:30.831+0000 7f56977fe640 1 -- 172.21.15.150:0/1175874608 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f56980cf7c0 msgr2=0x7f56980ab940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:50:30.833 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:30.831+0000 7f56977fe640 1 --2- 172.21.15.150:0/1175874608 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f56980cf7c0 0x7f56980ab940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:50:30.833 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:30.831+0000 7f56977fe640 1 -- 172.21.15.150:0/1175874608 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5698070290 msgr2=0x7f5698151cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:50:30.833 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:30.831+0000 7f56977fe640 1 --2- 172.21.15.150:0/1175874608 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5698070290 0x7f5698151cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:50:30.834 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:30.831+0000 7f56977fe640 1 -- 172.21.15.150:0/1175874608 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f56981f6df0 con 0x7f56980ccc30 2024-09-17T05:50:30.834 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:30.831+0000 7f569cc91640 1 --2- 172.21.15.150:0/1175874608 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f56980cf7c0 0x7f56980ab940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T05:50:30.834 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:30.831+0000 7f5697fff640 1 --2- 172.21.15.150:0/1175874608 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5698070290 0x7f5698151cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T05:50:30.834 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:30.831+0000 7f56977fe640 1 --2- 172.21.15.150:0/1175874608 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f56980ccc30 0x7f56980ab400 secure :-1 s=READY pgs=1358 cs=0 l=1 rev1=1 crypto rx=0x7f568c00d770 tx=0x7f568c00dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:50:30.834 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:30.831+0000 7f5694ff9640 1 -- 172.21.15.150:0/1175874608 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f568c017070 con 0x7f56980ccc30 2024-09-17T05:50:30.834 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:30.831+0000 7f5694ff9640 1 -- 172.21.15.150:0/1175874608 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f568c009d20 con 0x7f56980ccc30 2024-09-17T05:50:30.834 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:30.831+0000 7f569e6f4640 1 -- 172.21.15.150:0/1175874608 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f56981f70d0 con 0x7f56980ccc30 2024-09-17T05:50:30.834 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:30.831+0000 7f5694ff9640 1 -- 172.21.15.150:0/1175874608 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f568c0106c0 con 0x7f56980ccc30 2024-09-17T05:50:30.834 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:30.831+0000 7f569e6f4640 1 -- 172.21.15.150:0/1175874608 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f56981f7690 con 0x7f56980ccc30 2024-09-17T05:50:30.835 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:30.832+0000 7f569e6f4640 1 -- 172.21.15.150:0/1175874608 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f569815dc10 con 0x7f56980ccc30 2024-09-17T05:50:30.835 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:30.833+0000 7f5694ff9640 1 -- 172.21.15.150:0/1175874608 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 32) ==== 103481+0+0 (secure 0 0 0) 0x7f568c01a070 con 0x7f56980ccc30 2024-09-17T05:50:30.835 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:30.834+0000 7f5694ff9640 1 --2- 172.21.15.150:0/1175874608 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f568407a210 0x7f568407c720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:50:30.835 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:30.834+0000 7f5694ff9640 1 -- 172.21.15.150:0/1175874608 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(101..101 src has 1..101) ==== 5821+0+0 (secure 0 0 0) 0x7f568c099ba0 con 0x7f56980ccc30 2024-09-17T05:50:30.836 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:30.834+0000 7f5697fff640 1 --2- 172.21.15.150:0/1175874608 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f568407a210 0x7f568407c720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:50:30.836 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:30.834+0000 7f5697fff640 1 --2- 172.21.15.150:0/1175874608 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f568407a210 0x7f568407c720 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7f5688033000 tx=0x7f5688004730 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:50:30.839 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:30.838+0000 7f5694ff9640 1 -- 172.21.15.150:0/1175874608 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f568c063b70 con 0x7f56980ccc30 2024-09-17T05:50:31.015 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:31.014+0000 7f569e6f4640 1 -- 172.21.15.150:0/1175874608 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command([{prefix=config set, name=mgr/volumes/max_concurrent_clones}] v 0) -- 0x7f56981557e0 con 0x7f56980ccc30 2024-09-17T05:50:31.018 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:31.018+0000 7f5694ff9640 1 -- 172.21.15.150:0/1175874608 <== mon.0 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/volumes/max_concurrent_clones}]=0 v50)=0 v50) ==== 131+0+0 (secure 0 0 0) 0x7f568c063470 con 0x7f56980ccc30 2024-09-17T05:50:31.022 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:31.020+0000 7f569e6f4640 1 -- 172.21.15.150:0/1175874608 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f568407a210 msgr2=0x7f568407c720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:50:31.022 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:31.020+0000 7f569e6f4640 1 --2- 172.21.15.150:0/1175874608 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f568407a210 0x7f568407c720 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7f5688033000 tx=0x7f5688004730 comp rx=0 tx=0).stop 2024-09-17T05:50:31.022 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:31.020+0000 7f569e6f4640 1 -- 172.21.15.150:0/1175874608 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f56980ccc30 msgr2=0x7f56980ab400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:50:31.022 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:31.020+0000 7f569e6f4640 1 --2- 172.21.15.150:0/1175874608 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f56980ccc30 0x7f56980ab400 secure :-1 s=READY pgs=1358 cs=0 l=1 rev1=1 crypto rx=0x7f568c00d770 tx=0x7f568c00dc30 comp rx=0 tx=0).stop 2024-09-17T05:50:31.022 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:31.020+0000 7f569e6f4640 1 -- 172.21.15.150:0/1175874608 shutdown_connections 2024-09-17T05:50:31.022 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:31.020+0000 7f569e6f4640 1 --2- 172.21.15.150:0/1175874608 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f568407a210 0x7f568407c720 unknown :-1 s=CLOSED pgs=584 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:50:31.022 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:31.020+0000 7f569e6f4640 1 --2- 172.21.15.150:0/1175874608 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f56980cf7c0 0x7f56980ab940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:50:31.022 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:31.020+0000 7f569e6f4640 1 --2- 172.21.15.150:0/1175874608 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f56980ccc30 0x7f56980ab400 unknown :-1 s=CLOSED pgs=1358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:50:31.022 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:31.020+0000 7f569e6f4640 1 --2- 172.21.15.150:0/1175874608 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5698070290 0x7f5698151cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:50:31.022 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:31.020+0000 7f569e6f4640 1 -- 172.21.15.150:0/1175874608 >> 172.21.15.150:0/1175874608 conn(0x7f569806d1c0 msgr2=0x7f56980b04e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:50:31.023 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:31.020+0000 7f569e6f4640 1 -- 172.21.15.150:0/1175874608 shutdown_connections 2024-09-17T05:50:31.023 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:31.020+0000 7f569e6f4640 1 -- 172.21.15.150:0/1175874608 wait complete. 2024-09-17T05:50:31.033 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume create cephfs sv1 --mode=777 2024-09-17T05:50:31.040 INFO:tasks.ceph.mgr.x.smithi176.stderr:2024-09-17T05:50:31.040+0000 7f33d9f1f640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-17T05:50:31.040 INFO:tasks.ceph.mgr.x.smithi176.stderr:2024-09-17T05:50:31.040+0000 7f33d9f1f640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-17T05:50:31.040 INFO:tasks.ceph.mgr.x.smithi176.stderr:2024-09-17T05:50:31.040+0000 7f33d9f1f640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-17T05:50:31.040 INFO:tasks.ceph.mgr.x.smithi176.stderr:2024-09-17T05:50:31.040+0000 7f33d9f1f640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-17T05:50:31.040 INFO:tasks.ceph.mgr.x.smithi176.stderr:2024-09-17T05:50:31.040+0000 7f33d9f1f640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-17T05:50:31.152 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:31.151+0000 7fd9856c5640 1 -- 172.21.15.150:0/1366857908 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd980165fe0 msgr2=0x7fd980168400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:50:31.152 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:31.151+0000 7fd9856c5640 1 --2- 172.21.15.150:0/1366857908 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd980165fe0 0x7fd980168400 secure :-1 s=READY pgs=1361 cs=0 l=1 rev1=1 crypto rx=0x7fd978009830 tx=0x7fd97802a640 comp rx=0 tx=0).stop 2024-09-17T05:50:31.153 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:31.151+0000 7fd9856c5640 1 -- 172.21.15.150:0/1366857908 shutdown_connections 2024-09-17T05:50:31.153 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:31.151+0000 7fd9856c5640 1 --2- 172.21.15.150:0/1366857908 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd980165fe0 0x7fd980168400 unknown :-1 s=CLOSED pgs=1361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:50:31.153 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:31.151+0000 7fd9856c5640 1 -- 172.21.15.150:0/1366857908 >> 172.21.15.150:0/1366857908 conn(0x7fd9800cef30 msgr2=0x7fd9800cf340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:50:31.153 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:31.151+0000 7fd9856c5640 1 -- 172.21.15.150:0/1366857908 shutdown_connections 2024-09-17T05:50:31.153 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:31.151+0000 7fd9856c5640 1 -- 172.21.15.150:0/1366857908 wait complete. 2024-09-17T05:50:31.154 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:31.153+0000 7fd9856c5640 1 Processor -- start 2024-09-17T05:50:31.154 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:31.153+0000 7fd9856c5640 1 -- start start 2024-09-17T05:50:31.157 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:31.154+0000 7fd9856c5640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd9800b7a50 0x7fd9801560a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:50:31.157 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:31.154+0000 7fd9856c5640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd9800d0520 0x7fd98006deb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:50:31.157 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:31.154+0000 7fd9856c5640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd980165fe0 0x7fd98006e3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:50:31.158 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:31.154+0000 7fd9856c5640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7fd9800d3310 con 0x7fd9800d0520 2024-09-17T05:50:31.158 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:31.154+0000 7fd9856c5640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fd980070f20 con 0x7fd980165fe0 2024-09-17T05:50:31.158 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:31.154+0000 7fd9856c5640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fd9800b7e60 con 0x7fd9800b7a50 2024-09-17T05:50:31.158 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:31.154+0000 7fd97e7fc640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd9800d0520 0x7fd98006deb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:50:31.158 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:31.154+0000 7fd97e7fc640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd9800d0520 0x7fd98006deb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:59642/0 (socket says 172.21.15.150:59642) 2024-09-17T05:50:31.158 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:31.154+0000 7fd97e7fc640 1 -- 172.21.15.150:0/2689647208 learned_addr learned my addr 172.21.15.150:0/2689647208 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:50:31.158 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:31.154+0000 7fd97effd640 1 --2- 172.21.15.150:0/2689647208 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd9800b7a50 0x7fd9801560a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:50:31.158 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:31.154+0000 7fd97f7fe640 1 --2- 172.21.15.150:0/2689647208 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd980165fe0 0x7fd98006e3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:50:31.159 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:31.155+0000 7fd97e7fc640 1 -- 172.21.15.150:0/2689647208 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd9800b7a50 msgr2=0x7fd9801560a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:50:31.159 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:31.155+0000 7fd97e7fc640 1 --2- 172.21.15.150:0/2689647208 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd9800b7a50 0x7fd9801560a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:50:31.159 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:31.155+0000 7fd97e7fc640 1 -- 172.21.15.150:0/2689647208 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd980165fe0 msgr2=0x7fd98006e3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:50:31.159 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:31.155+0000 7fd97e7fc640 1 --2- 172.21.15.150:0/2689647208 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd980165fe0 0x7fd98006e3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:50:31.159 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:31.155+0000 7fd97e7fc640 1 -- 172.21.15.150:0/2689647208 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd9801565e0 con 0x7fd9800d0520 2024-09-17T05:50:31.159 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:31.155+0000 7fd97e7fc640 1 --2- 172.21.15.150:0/2689647208 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd9800d0520 0x7fd98006deb0 secure :-1 s=READY pgs=1362 cs=0 l=1 rev1=1 crypto rx=0x7fd97400c430 tx=0x7fd97400c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:50:31.159 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:31.155+0000 7fd9677fe640 1 -- 172.21.15.150:0/2689647208 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd974017070 con 0x7fd9800d0520 2024-09-17T05:50:31.160 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:31.155+0000 7fd9677fe640 1 -- 172.21.15.150:0/2689647208 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd9740053c0 con 0x7fd9800d0520 2024-09-17T05:50:31.160 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:31.155+0000 7fd9856c5640 1 -- 172.21.15.150:0/2689647208 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd9800cb0e0 con 0x7fd9800d0520 2024-09-17T05:50:31.160 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:31.155+0000 7fd9677fe640 1 -- 172.21.15.150:0/2689647208 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd974003850 con 0x7fd9800d0520 2024-09-17T05:50:31.160 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:31.155+0000 7fd9856c5640 1 -- 172.21.15.150:0/2689647208 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd98006f240 con 0x7fd9800d0520 2024-09-17T05:50:31.160 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:31.156+0000 7fd9856c5640 1 -- 172.21.15.150:0/2689647208 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd9800d0c90 con 0x7fd9800d0520 2024-09-17T05:50:31.161 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:31.157+0000 7fd9677fe640 1 -- 172.21.15.150:0/2689647208 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 32) ==== 103481+0+0 (secure 0 0 0) 0x7fd97401a070 con 0x7fd9800d0520 2024-09-17T05:50:31.162 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:31.158+0000 7fd9677fe640 1 --2- 172.21.15.150:0/2689647208 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fd96c07a240 0x7fd96c07c750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:50:31.162 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:31.158+0000 7fd9677fe640 1 -- 172.21.15.150:0/2689647208 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(101..101 src has 1..101) ==== 5821+0+0 (secure 0 0 0) 0x7fd974099060 con 0x7fd9800d0520 2024-09-17T05:50:31.162 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:31.158+0000 7fd97effd640 1 --2- 172.21.15.150:0/2689647208 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fd96c07a240 0x7fd96c07c750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:50:31.162 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:31.159+0000 7fd97effd640 1 --2- 172.21.15.150:0/2689647208 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fd96c07a240 0x7fd96c07c750 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7fd9700012e0 tx=0x7fd970009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:50:31.162 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:31.162+0000 7fd9677fe640 1 -- 172.21.15.150:0/2689647208 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fd974021020 con 0x7fd9800d0520 2024-09-17T05:50:31.361 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:31.361+0000 7fd9856c5640 1 -- 172.21.15.150:0/2689647208 --> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] -- mgr_command(tid 0: {"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv1", "mode": "777", "target": ["mon-mgr", ""]}) -- 0x7fd9800745d0 con 0x7fd96c07a240 2024-09-17T05:50:31.371 INFO:tasks.ceph.mgr.x.smithi176.stderr:2024-09-17T05:50:31.371+0000 7f33d771a640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-17T05:50:31.371 INFO:tasks.ceph.mgr.x.smithi176.stderr:2024-09-17T05:50:31.371+0000 7f33d771a640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-17T05:50:31.371 INFO:tasks.ceph.mgr.x.smithi176.stderr:2024-09-17T05:50:31.371+0000 7f33d771a640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-17T05:50:31.371 INFO:tasks.ceph.mgr.x.smithi176.stderr:2024-09-17T05:50:31.371+0000 7f33d771a640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-17T05:50:31.371 INFO:tasks.ceph.mgr.x.smithi176.stderr:2024-09-17T05:50:31.371+0000 7f33d771a640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-17T05:50:31.402 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:31.402+0000 7fd9677fe640 1 -- 172.21.15.150:0/2689647208 <== mgr.4108 v2:172.21.15.176:6800/3631216395 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7fd970001ae0 con 0x7fd96c07a240 2024-09-17T05:50:31.405 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:31.404+0000 7fd9856c5640 1 -- 172.21.15.150:0/2689647208 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fd96c07a240 msgr2=0x7fd96c07c750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:50:31.405 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:31.404+0000 7fd9856c5640 1 --2- 172.21.15.150:0/2689647208 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fd96c07a240 0x7fd96c07c750 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7fd9700012e0 tx=0x7fd970009040 comp rx=0 tx=0).stop 2024-09-17T05:50:31.406 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:31.404+0000 7fd9856c5640 1 -- 172.21.15.150:0/2689647208 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd9800d0520 msgr2=0x7fd98006deb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:50:31.406 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:31.404+0000 7fd9856c5640 1 --2- 172.21.15.150:0/2689647208 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd9800d0520 0x7fd98006deb0 secure :-1 s=READY pgs=1362 cs=0 l=1 rev1=1 crypto rx=0x7fd97400c430 tx=0x7fd97400c8f0 comp rx=0 tx=0).stop 2024-09-17T05:50:31.406 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:31.404+0000 7fd9856c5640 1 -- 172.21.15.150:0/2689647208 shutdown_connections 2024-09-17T05:50:31.406 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:31.404+0000 7fd9856c5640 1 --2- 172.21.15.150:0/2689647208 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd980165fe0 0x7fd98006e3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:50:31.406 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:31.404+0000 7fd9856c5640 1 --2- 172.21.15.150:0/2689647208 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fd96c07a240 0x7fd96c07c750 unknown :-1 s=CLOSED pgs=585 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:50:31.406 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:31.404+0000 7fd9856c5640 1 --2- 172.21.15.150:0/2689647208 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd9800d0520 0x7fd98006deb0 unknown :-1 s=CLOSED pgs=1362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:50:31.406 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:31.404+0000 7fd9856c5640 1 --2- 172.21.15.150:0/2689647208 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd9800b7a50 0x7fd9801560a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:50:31.406 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:31.404+0000 7fd9856c5640 1 -- 172.21.15.150:0/2689647208 >> 172.21.15.150:0/2689647208 conn(0x7fd9800cef30 msgr2=0x7fd9800b25a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:50:31.406 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:31.404+0000 7fd9856c5640 1 -- 172.21.15.150:0/2689647208 shutdown_connections 2024-09-17T05:50:31.406 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:31.404+0000 7fd9856c5640 1 -- 172.21.15.150:0/2689647208 wait complete. 2024-09-17T05:50:31.416 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume getpath cephfs sv1 2024-09-17T05:50:31.534 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:31.533+0000 7f2c9a84a640 1 -- 172.21.15.150:0/16234396 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2c7c004800 msgr2=0x7f2c7c004c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:50:31.534 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:31.533+0000 7f2c9a84a640 1 --2- 172.21.15.150:0/16234396 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2c7c004800 0x7f2c7c004c10 secure :-1 s=READY pgs=1364 cs=0 l=1 rev1=1 crypto rx=0x7f2c940d41f0 tx=0x7f2c7c005830 comp rx=0 tx=0).stop 2024-09-17T05:50:31.534 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:31.533+0000 7f2c98de7640 1 -- 172.21.15.150:0/16234396 reap_dead start 2024-09-17T05:50:31.534 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:31.533+0000 7f2c9a84a640 1 -- 172.21.15.150:0/16234396 shutdown_connections 2024-09-17T05:50:31.535 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:31.533+0000 7f2c9a84a640 1 -- 172.21.15.150:0/16234396 >> 172.21.15.150:0/16234396 conn(0x7f2c9408bfe0 msgr2=0x7f2c940d46e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:50:31.535 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:31.533+0000 7f2c9a84a640 1 -- 172.21.15.150:0/16234396 shutdown_connections 2024-09-17T05:50:31.535 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:31.533+0000 7f2c9a84a640 1 -- 172.21.15.150:0/16234396 wait complete. 2024-09-17T05:50:31.535 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:31.535+0000 7f2c9a84a640 1 Processor -- start 2024-09-17T05:50:31.536 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:31.535+0000 7f2c9a84a640 1 -- start start 2024-09-17T05:50:31.538 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:31.536+0000 7f2c9a84a640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2c7c004800 0x7f2c94154d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:50:31.538 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:31.536+0000 7f2c9a84a640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2c94157ec0 0x7f2c940b50b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:50:31.538 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:31.536+0000 7f2c9a84a640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2c940b55f0 0x7f2c941f8fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:50:31.538 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:31.536+0000 7f2c9a84a640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f2c9406e2b0 con 0x7f2c940b55f0 2024-09-17T05:50:31.538 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:31.536+0000 7f2c9a84a640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f2c940b6a80 con 0x7f2c7c004800 2024-09-17T05:50:31.539 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:31.536+0000 7f2c9a84a640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f2c9406e430 con 0x7f2c94157ec0 2024-09-17T05:50:31.539 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:31.537+0000 7f2c98de7640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2c940b55f0 0x7f2c941f8fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:50:31.539 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:31.537+0000 7f2c98de7640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2c940b55f0 0x7f2c941f8fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:59656/0 (socket says 172.21.15.150:59656) 2024-09-17T05:50:31.539 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:31.537+0000 7f2c98de7640 1 -- 172.21.15.150:0/568259484 learned_addr learned my addr 172.21.15.150:0/568259484 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:50:31.539 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:31.537+0000 7f2c937fe640 1 --2- 172.21.15.150:0/568259484 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2c94157ec0 0x7f2c940b50b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:50:31.539 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:31.537+0000 7f2c93fff640 1 --2- 172.21.15.150:0/568259484 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2c7c004800 0x7f2c94154d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:50:31.539 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:31.537+0000 7f2c98de7640 1 -- 172.21.15.150:0/568259484 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2c94157ec0 msgr2=0x7f2c940b50b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:50:31.539 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:31.537+0000 7f2c98de7640 1 --2- 172.21.15.150:0/568259484 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2c94157ec0 0x7f2c940b50b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:50:31.539 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:31.537+0000 7f2c98de7640 1 -- 172.21.15.150:0/568259484 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2c7c004800 msgr2=0x7f2c94154d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:50:31.539 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:31.537+0000 7f2c98de7640 1 --2- 172.21.15.150:0/568259484 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2c7c004800 0x7f2c94154d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:50:31.539 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:31.537+0000 7f2c98de7640 1 -- 172.21.15.150:0/568259484 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2c940b5a00 con 0x7f2c940b55f0 2024-09-17T05:50:31.539 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:31.537+0000 7f2c98de7640 1 --2- 172.21.15.150:0/568259484 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2c940b55f0 0x7f2c941f8fa0 secure :-1 s=READY pgs=1365 cs=0 l=1 rev1=1 crypto rx=0x7f2c9408d600 tx=0x7f2c8c006720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:50:31.540 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:31.537+0000 7f2c90ff9640 1 -- 172.21.15.150:0/568259484 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c8c00fc90 con 0x7f2c940b55f0 2024-09-17T05:50:31.540 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:31.537+0000 7f2c90ff9640 1 -- 172.21.15.150:0/568259484 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f2c8c018070 con 0x7f2c940b55f0 2024-09-17T05:50:31.540 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:31.537+0000 7f2c9a84a640 1 -- 172.21.15.150:0/568259484 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2c940cd3a0 con 0x7f2c940b55f0 2024-09-17T05:50:31.540 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:31.537+0000 7f2c90ff9640 1 -- 172.21.15.150:0/568259484 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c8c011690 con 0x7f2c940b55f0 2024-09-17T05:50:31.540 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:31.537+0000 7f2c9a84a640 1 -- 172.21.15.150:0/568259484 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2c940cd960 con 0x7f2c940b55f0 2024-09-17T05:50:31.541 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:31.538+0000 7f2c9a84a640 1 -- 172.21.15.150:0/568259484 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2c940cc480 con 0x7f2c940b55f0 2024-09-17T05:50:31.541 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:31.539+0000 7f2c90ff9640 1 -- 172.21.15.150:0/568259484 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 32) ==== 103481+0+0 (secure 0 0 0) 0x7f2c8c011830 con 0x7f2c940b55f0 2024-09-17T05:50:31.541 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:31.540+0000 7f2c90ff9640 1 --2- 172.21.15.150:0/568259484 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f2c8007a240 0x7f2c8007c750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:50:31.541 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:31.540+0000 7f2c90ff9640 1 -- 172.21.15.150:0/568259484 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(101..101 src has 1..101) ==== 5821+0+0 (secure 0 0 0) 0x7f2c8c09a120 con 0x7f2c940b55f0 2024-09-17T05:50:31.542 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:31.540+0000 7f2c93fff640 1 --2- 172.21.15.150:0/568259484 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f2c8007a240 0x7f2c8007c750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:50:31.542 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:31.540+0000 7f2c93fff640 1 --2- 172.21.15.150:0/568259484 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f2c8007a240 0x7f2c8007c750 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7f2c840058e0 tx=0x7f2c84005f30 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:50:31.545 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:31.544+0000 7f2c90ff9640 1 -- 172.21.15.150:0/568259484 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f2c940b5a00 con 0x7f2c940b55f0 2024-09-17T05:50:31.748 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:31.747+0000 7f2c9a84a640 1 -- 172.21.15.150:0/568259484 --> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "sub_name": "sv1", "target": ["mon-mgr", ""]}) -- 0x7f2c940d0020 con 0x7f2c8007a240 2024-09-17T05:50:31.753 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:31.752+0000 7f2c90ff9640 1 -- 172.21.15.150:0/568259484 <== mgr.4108 v2:172.21.15.176:6800/3631216395 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+59 (secure 0 0 0) 0x7f2c940d0020 con 0x7f2c8007a240 2024-09-17T05:50:31.753 INFO:teuthology.orchestra.run.smithi150.stdout:/volumes/_nogroup/sv1/3abb14c8-f94c-47ef-8bac-90c18ece3748 2024-09-17T05:50:31.756 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:31.755+0000 7f2c9a84a640 1 -- 172.21.15.150:0/568259484 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f2c8007a240 msgr2=0x7f2c8007c750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:50:31.756 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:31.755+0000 7f2c9a84a640 1 --2- 172.21.15.150:0/568259484 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f2c8007a240 0x7f2c8007c750 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7f2c840058e0 tx=0x7f2c84005f30 comp rx=0 tx=0).stop 2024-09-17T05:50:31.756 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:31.755+0000 7f2c9a84a640 1 -- 172.21.15.150:0/568259484 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2c940b55f0 msgr2=0x7f2c941f8fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:50:31.756 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:31.755+0000 7f2c9a84a640 1 --2- 172.21.15.150:0/568259484 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2c940b55f0 0x7f2c941f8fa0 secure :-1 s=READY pgs=1365 cs=0 l=1 rev1=1 crypto rx=0x7f2c9408d600 tx=0x7f2c8c006720 comp rx=0 tx=0).stop 2024-09-17T05:50:31.756 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:31.755+0000 7f2c9a84a640 1 -- 172.21.15.150:0/568259484 shutdown_connections 2024-09-17T05:50:31.756 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:31.755+0000 7f2c9a84a640 1 --2- 172.21.15.150:0/568259484 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f2c8007a240 0x7f2c8007c750 unknown :-1 s=CLOSED pgs=586 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:50:31.756 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:31.755+0000 7f2c9a84a640 1 --2- 172.21.15.150:0/568259484 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2c940b55f0 0x7f2c941f8fa0 unknown :-1 s=CLOSED pgs=1365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:50:31.756 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:31.755+0000 7f2c9a84a640 1 --2- 172.21.15.150:0/568259484 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2c94157ec0 0x7f2c940b50b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:50:31.756 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:31.755+0000 7f2c9a84a640 1 --2- 172.21.15.150:0/568259484 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2c7c004800 0x7f2c94154d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:50:31.756 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:31.755+0000 7f2c9a84a640 1 -- 172.21.15.150:0/568259484 >> 172.21.15.150:0/568259484 conn(0x7f2c9408bfe0 msgr2=0x7f2c940b7530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:50:31.756 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:31.755+0000 7f2c9a84a640 1 -- 172.21.15.150:0/568259484 shutdown_connections 2024-09-17T05:50:31.756 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:31.755+0000 7f2c9a84a640 1 -- 172.21.15.150:0/568259484 wait complete. 2024-09-17T05:50:31.768 DEBUG:tasks.cephfs.test_volumes:filling subvolume sv1 with 3 files each 1024MB size under directory volumes/_nogroup/sv1/3abb14c8-f94c-47ef-8bac-90c18ece3748 2024-09-17T05:50:31.768 DEBUG:teuthology.orchestra.run.smithi150:> set -ex 2024-09-17T05:50:31.768 DEBUG:teuthology.orchestra.run.smithi150:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T05:50:31.784 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:50:31.785 DEBUG:teuthology.orchestra.run.smithi150:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/sv1/3abb14c8-f94c-47ef-8bac-90c18ece3748/subvolume_file.0 bs=1M conv=fdatasync count=1024 seek=0) 2024-09-17T05:50:35.539 INFO:teuthology.orchestra.run.smithi150.stderr:1024+0 records in 2024-09-17T05:50:35.539 INFO:teuthology.orchestra.run.smithi150.stderr:1024+0 records out 2024-09-17T05:50:35.539 INFO:teuthology.orchestra.run.smithi150.stderr:1073741824 bytes (1.1 GB, 1.0 GiB) copied, 3.69201 s, 291 MB/s 2024-09-17T05:50:35.539 DEBUG:teuthology.orchestra.run.smithi150:> set -ex 2024-09-17T05:50:35.539 DEBUG:teuthology.orchestra.run.smithi150:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T05:50:35.555 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:50:35.555 DEBUG:teuthology.orchestra.run.smithi150:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/sv1/3abb14c8-f94c-47ef-8bac-90c18ece3748/subvolume_file.1 bs=1M conv=fdatasync count=1024 seek=0) 2024-09-17T05:50:39.365 INFO:teuthology.orchestra.run.smithi150.stderr:1024+0 records in 2024-09-17T05:50:39.366 INFO:teuthology.orchestra.run.smithi150.stderr:1024+0 records out 2024-09-17T05:50:39.366 INFO:teuthology.orchestra.run.smithi150.stderr:1073741824 bytes (1.1 GB, 1.0 GiB) copied, 3.7527 s, 286 MB/s 2024-09-17T05:50:39.366 DEBUG:teuthology.orchestra.run.smithi150:> set -ex 2024-09-17T05:50:39.366 DEBUG:teuthology.orchestra.run.smithi150:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T05:50:39.382 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:50:39.382 DEBUG:teuthology.orchestra.run.smithi150:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/sv1/3abb14c8-f94c-47ef-8bac-90c18ece3748/subvolume_file.2 bs=1M conv=fdatasync count=1024 seek=0) 2024-09-17T05:50:43.170 INFO:teuthology.orchestra.run.smithi150.stderr:1024+0 records in 2024-09-17T05:50:43.170 INFO:teuthology.orchestra.run.smithi150.stderr:1024+0 records out 2024-09-17T05:50:43.170 INFO:teuthology.orchestra.run.smithi150.stderr:1073741824 bytes (1.1 GB, 1.0 GiB) copied, 3.73053 s, 288 MB/s 2024-09-17T05:50:43.171 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume snapshot create cephfs sv1 ss1 2024-09-17T05:50:43.292 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:43.290+0000 7f5c5c732640 1 -- 172.21.15.150:0/29838681 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5c540d0d20 msgr2=0x7f5c540d1130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:50:43.292 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:43.290+0000 7f5c5c732640 1 --2- 172.21.15.150:0/29838681 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5c540d0d20 0x7f5c540d1130 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f5c50009860 tx=0x7f5c5002a530 comp rx=0 tx=0).stop 2024-09-17T05:50:43.292 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:43.290+0000 7f5c5c732640 1 -- 172.21.15.150:0/29838681 shutdown_connections 2024-09-17T05:50:43.292 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:43.290+0000 7f5c5c732640 1 --2- 172.21.15.150:0/29838681 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5c540d0d20 0x7f5c540d1130 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:50:43.292 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:43.290+0000 7f5c5c732640 1 -- 172.21.15.150:0/29838681 >> 172.21.15.150:0/29838681 conn(0x7f5c540d46f0 msgr2=0x7f5c540d4b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:50:43.292 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:43.290+0000 7f5c5c732640 1 -- 172.21.15.150:0/29838681 shutdown_connections 2024-09-17T05:50:43.292 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:43.290+0000 7f5c5c732640 1 -- 172.21.15.150:0/29838681 wait complete. 2024-09-17T05:50:43.293 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:43.291+0000 7f5c5c732640 1 Processor -- start 2024-09-17T05:50:43.293 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:43.292+0000 7f5c5c732640 1 -- start start 2024-09-17T05:50:43.296 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:43.293+0000 7f5c5c732640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5c540d0310 0x7f5c541e9eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:50:43.296 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:43.293+0000 7f5c5c732640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5c540d0d20 0x7f5c5415a810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:50:43.296 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:43.293+0000 7f5c5c732640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5c540d1670 0x7f5c54159330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:50:43.296 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:43.293+0000 7f5c5c732640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f5c540ba200 con 0x7f5c540d1670 2024-09-17T05:50:43.296 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:43.293+0000 7f5c5c732640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f5c540ba080 con 0x7f5c540d0d20 2024-09-17T05:50:43.296 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:43.293+0000 7f5c5c732640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f5c5406f1b0 con 0x7f5c540d0310 2024-09-17T05:50:43.296 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:43.293+0000 7f5c5accf640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5c540d1670 0x7f5c54159330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:50:43.296 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:43.293+0000 7f5c5accf640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5c540d1670 0x7f5c54159330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:45220/0 (socket says 172.21.15.150:45220) 2024-09-17T05:50:43.296 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:43.293+0000 7f5c5accf640 1 -- 172.21.15.150:0/3564112413 learned_addr learned my addr 172.21.15.150:0/3564112413 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:50:43.297 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:43.293+0000 7f5c5a4ce640 1 --2- 172.21.15.150:0/3564112413 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5c540d0310 0x7f5c541e9eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:50:43.297 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:43.293+0000 7f5c59ccd640 1 --2- 172.21.15.150:0/3564112413 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5c540d0d20 0x7f5c5415a810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:50:43.297 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:43.293+0000 7f5c5accf640 1 -- 172.21.15.150:0/3564112413 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5c540d0310 msgr2=0x7f5c541e9eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:50:43.297 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:43.293+0000 7f5c5accf640 1 --2- 172.21.15.150:0/3564112413 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5c540d0310 0x7f5c541e9eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:50:43.297 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:43.293+0000 7f5c5accf640 1 -- 172.21.15.150:0/3564112413 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5c540d0d20 msgr2=0x7f5c5415a810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:50:43.297 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:43.293+0000 7f5c5accf640 1 --2- 172.21.15.150:0/3564112413 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5c540d0d20 0x7f5c5415a810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:50:43.297 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:43.293+0000 7f5c5accf640 1 -- 172.21.15.150:0/3564112413 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5c541f9910 con 0x7f5c540d1670 2024-09-17T05:50:43.297 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:43.294+0000 7f5c5accf640 1 --2- 172.21.15.150:0/3564112413 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5c540d1670 0x7f5c54159330 secure :-1 s=READY pgs=1367 cs=0 l=1 rev1=1 crypto rx=0x7f5c4c00c760 tx=0x7f5c4c00cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:50:43.297 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:43.294+0000 7f5c4affd640 1 -- 172.21.15.150:0/3564112413 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c4c003b70 con 0x7f5c540d1670 2024-09-17T05:50:43.297 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:43.294+0000 7f5c5c732640 1 -- 172.21.15.150:0/3564112413 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5c541e8f10 con 0x7f5c540d1670 2024-09-17T05:50:43.297 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:43.294+0000 7f5c4affd640 1 -- 172.21.15.150:0/3564112413 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f5c4c003d30 con 0x7f5c540d1670 2024-09-17T05:50:43.297 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:43.294+0000 7f5c4affd640 1 -- 172.21.15.150:0/3564112413 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c4c00aab0 con 0x7f5c540d1670 2024-09-17T05:50:43.298 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:43.294+0000 7f5c5c732640 1 -- 172.21.15.150:0/3564112413 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5c541f5c60 con 0x7f5c540d1670 2024-09-17T05:50:43.298 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:43.295+0000 7f5c5c732640 1 -- 172.21.15.150:0/3564112413 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5c541f9b80 con 0x7f5c540d1670 2024-09-17T05:50:43.298 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:43.295+0000 7f5c4affd640 1 -- 172.21.15.150:0/3564112413 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 34) ==== 103583+0+0 (secure 0 0 0) 0x7f5c4c00ac50 con 0x7f5c540d1670 2024-09-17T05:50:43.299 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:43.296+0000 7f5c4affd640 1 --2- 172.21.15.150:0/3564112413 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f5c3807a360 0x7f5c3807c870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:50:43.299 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:43.296+0000 7f5c4affd640 1 -- 172.21.15.150:0/3564112413 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(101..101 src has 1..101) ==== 5821+0+0 (secure 0 0 0) 0x7f5c4c099710 con 0x7f5c540d1670 2024-09-17T05:50:43.299 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:43.296+0000 7f5c5a4ce640 1 --2- 172.21.15.150:0/3564112413 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f5c3807a360 0x7f5c3807c870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:50:43.299 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:43.297+0000 7f5c5a4ce640 1 --2- 172.21.15.150:0/3564112413 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f5c3807a360 0x7f5c3807c870 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7f5c50034000 tx=0x7f5c50004730 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:50:43.302 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:43.300+0000 7f5c4affd640 1 -- 172.21.15.150:0/3564112413 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f5c4c063010 con 0x7f5c540d1670 2024-09-17T05:50:43.505 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:43.503+0000 7f5c5c732640 1 -- 172.21.15.150:0/3564112413 --> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] -- mgr_command(tid 0: {"prefix": "fs subvolume snapshot create", "vol_name": "cephfs", "sub_name": "sv1", "snap_name": "ss1", "target": ["mon-mgr", ""]}) -- 0x7f5c540d1130 con 0x7f5c3807a360 2024-09-17T05:50:43.518 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:43.517+0000 7f5c4affd640 1 -- 172.21.15.150:0/3564112413 <== mgr.4108 v2:172.21.15.176:6800/3631216395 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f5c540d1130 con 0x7f5c3807a360 2024-09-17T05:50:43.521 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:43.519+0000 7f5c5c732640 1 -- 172.21.15.150:0/3564112413 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f5c3807a360 msgr2=0x7f5c3807c870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:50:43.521 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:43.519+0000 7f5c5c732640 1 --2- 172.21.15.150:0/3564112413 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f5c3807a360 0x7f5c3807c870 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7f5c50034000 tx=0x7f5c50004730 comp rx=0 tx=0).stop 2024-09-17T05:50:43.521 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:43.519+0000 7f5c5c732640 1 -- 172.21.15.150:0/3564112413 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5c540d1670 msgr2=0x7f5c54159330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:50:43.521 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:43.519+0000 7f5c5c732640 1 --2- 172.21.15.150:0/3564112413 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5c540d1670 0x7f5c54159330 secure :-1 s=READY pgs=1367 cs=0 l=1 rev1=1 crypto rx=0x7f5c4c00c760 tx=0x7f5c4c00cc20 comp rx=0 tx=0).stop 2024-09-17T05:50:43.521 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:43.519+0000 7f5c5c732640 1 -- 172.21.15.150:0/3564112413 shutdown_connections 2024-09-17T05:50:43.521 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:43.519+0000 7f5c5c732640 1 --2- 172.21.15.150:0/3564112413 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5c540d0d20 0x7f5c5415a810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:50:43.521 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:43.519+0000 7f5c5c732640 1 --2- 172.21.15.150:0/3564112413 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f5c3807a360 0x7f5c3807c870 unknown :-1 s=CLOSED pgs=587 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:50:43.521 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:43.519+0000 7f5c5c732640 1 --2- 172.21.15.150:0/3564112413 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5c540d1670 0x7f5c54159330 unknown :-1 s=CLOSED pgs=1367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:50:43.521 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:43.519+0000 7f5c5c732640 1 --2- 172.21.15.150:0/3564112413 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5c540d0310 0x7f5c541e9eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:50:43.522 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:43.519+0000 7f5c5c732640 1 -- 172.21.15.150:0/3564112413 >> 172.21.15.150:0/3564112413 conn(0x7f5c540d46f0 msgr2=0x7f5c540d4e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:50:43.522 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:43.519+0000 7f5c5c732640 1 -- 172.21.15.150:0/3564112413 shutdown_connections 2024-09-17T05:50:43.522 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:43.519+0000 7f5c5c732640 1 -- 172.21.15.150:0/3564112413 wait complete. 2024-09-17T05:50:43.532 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume getpath cephfs sv1 2024-09-17T05:50:43.649 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:43.647+0000 7fdf32a70640 1 -- 172.21.15.150:0/1253276900 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fdf2c070a10 msgr2=0x7fdf2c0b4070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:50:43.649 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:43.647+0000 7fdf32a70640 1 --2- 172.21.15.150:0/1253276900 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fdf2c070a10 0x7fdf2c0b4070 secure :-1 s=READY pgs=1369 cs=0 l=1 rev1=1 crypto rx=0x7fdf24009830 tx=0x7fdf2402a5c0 comp rx=0 tx=0).stop 2024-09-17T05:50:43.649 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:43.647+0000 7fdf32a70640 1 -- 172.21.15.150:0/1253276900 shutdown_connections 2024-09-17T05:50:43.649 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:43.647+0000 7fdf32a70640 1 --2- 172.21.15.150:0/1253276900 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fdf2c070a10 0x7fdf2c0b4070 unknown :-1 s=CLOSED pgs=1369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:50:43.649 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:43.647+0000 7fdf32a70640 1 -- 172.21.15.150:0/1253276900 >> 172.21.15.150:0/1253276900 conn(0x7fdf2c06d1c0 msgr2=0x7fdf2c06d5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:50:43.649 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:43.647+0000 7fdf32a70640 1 -- 172.21.15.150:0/1253276900 shutdown_connections 2024-09-17T05:50:43.649 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:43.647+0000 7fdf32a70640 1 -- 172.21.15.150:0/1253276900 wait complete. 2024-09-17T05:50:43.650 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:43.649+0000 7fdf32a70640 1 Processor -- start 2024-09-17T05:50:43.651 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:43.649+0000 7fdf32a70640 1 -- start start 2024-09-17T05:50:43.653 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:43.650+0000 7fdf32a70640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fdf2c070600 0x7fdf2c1e6070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:50:43.653 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:43.650+0000 7fdf32a70640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fdf2c070a10 0x7fdf2c14bce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:50:43.653 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:43.650+0000 7fdf32a70640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fdf2c1f9760 0x7fdf2c14f050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:50:43.653 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:43.650+0000 7fdf32a70640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7fdf2c0cf9c0 con 0x7fdf2c1f9760 2024-09-17T05:50:43.653 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:43.650+0000 7fdf32a70640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fdf2c0cf840 con 0x7fdf2c070a10 2024-09-17T05:50:43.653 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:43.650+0000 7fdf32a70640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fdf2c0cfb40 con 0x7fdf2c070600 2024-09-17T05:50:43.653 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:43.651+0000 7fdf3100d640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fdf2c1f9760 0x7fdf2c14f050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:50:43.653 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:43.651+0000 7fdf3080c640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fdf2c070600 0x7fdf2c1e6070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:50:43.654 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:43.651+0000 7fdf3100d640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fdf2c1f9760 0x7fdf2c14f050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:45242/0 (socket says 172.21.15.150:45242) 2024-09-17T05:50:43.654 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:43.651+0000 7fdf2bfff640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fdf2c070a10 0x7fdf2c14bce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:50:43.654 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:43.651+0000 7fdf3100d640 1 -- 172.21.15.150:0/671908537 learned_addr learned my addr 172.21.15.150:0/671908537 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:50:43.654 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:43.651+0000 7fdf3080c640 1 -- 172.21.15.150:0/671908537 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fdf2c070a10 msgr2=0x7fdf2c14bce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:50:43.654 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:43.651+0000 7fdf3080c640 1 --2- 172.21.15.150:0/671908537 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fdf2c070a10 0x7fdf2c14bce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:50:43.654 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:43.651+0000 7fdf3080c640 1 -- 172.21.15.150:0/671908537 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fdf2c1f9760 msgr2=0x7fdf2c14f050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:50:43.654 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:43.651+0000 7fdf3080c640 1 --2- 172.21.15.150:0/671908537 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fdf2c1f9760 0x7fdf2c14f050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:50:43.654 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:43.651+0000 7fdf3080c640 1 -- 172.21.15.150:0/671908537 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdf2c1f57c0 con 0x7fdf2c070600 2024-09-17T05:50:43.654 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:43.651+0000 7fdf2bfff640 1 --2- 172.21.15.150:0/671908537 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fdf2c070a10 0x7fdf2c14bce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T05:50:43.654 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:43.651+0000 7fdf3080c640 1 --2- 172.21.15.150:0/671908537 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fdf2c070600 0x7fdf2c1e6070 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fdf1c00c700 tx=0x7fdf1c00cbc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:50:43.655 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:43.653+0000 7fdf297fa640 1 -- 172.21.15.150:0/671908537 <== mon.2 v2:172.21.15.176:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf1c003b70 con 0x7fdf2c070600 2024-09-17T05:50:43.655 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:43.653+0000 7fdf297fa640 1 -- 172.21.15.150:0/671908537 <== mon.2 v2:172.21.15.176:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fdf1c003d30 con 0x7fdf2c070600 2024-09-17T05:50:43.655 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:43.653+0000 7fdf32a70640 1 -- 172.21.15.150:0/671908537 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdf2c1f5aa0 con 0x7fdf2c070600 2024-09-17T05:50:43.655 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:43.653+0000 7fdf297fa640 1 -- 172.21.15.150:0/671908537 <== mon.2 v2:172.21.15.176:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf1c0052d0 con 0x7fdf2c070600 2024-09-17T05:50:43.656 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:43.654+0000 7fdf32a70640 1 -- 172.21.15.150:0/671908537 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fdf2c1f6060 con 0x7fdf2c070600 2024-09-17T05:50:43.656 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:43.654+0000 7fdf32a70640 1 -- 172.21.15.150:0/671908537 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdf2c0cfff0 con 0x7fdf2c070600 2024-09-17T05:50:43.657 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:43.656+0000 7fdf297fa640 1 -- 172.21.15.150:0/671908537 <== mon.2 v2:172.21.15.176:3301/0 4 ==== mgrmap(e 34) ==== 103583+0+0 (secure 0 0 0) 0x7fdf1c005470 con 0x7fdf2c070600 2024-09-17T05:50:43.658 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:43.656+0000 7fdf297fa640 1 --2- 172.21.15.150:0/671908537 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fdf1807a330 0x7fdf1807c840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:50:43.658 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:43.656+0000 7fdf297fa640 1 -- 172.21.15.150:0/671908537 <== mon.2 v2:172.21.15.176:3301/0 5 ==== osd_map(101..101 src has 1..101) ==== 5821+0+0 (secure 0 0 0) 0x7fdf1c0996d0 con 0x7fdf2c070600 2024-09-17T05:50:43.658 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:43.656+0000 7fdf2bfff640 1 --2- 172.21.15.150:0/671908537 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fdf1807a330 0x7fdf1807c840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:50:43.658 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:43.657+0000 7fdf2bfff640 1 --2- 172.21.15.150:0/671908537 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fdf1807a330 0x7fdf1807c840 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7fdf2c0cd6e0 tx=0x7fdf20009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:50:43.663 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:43.661+0000 7fdf297fa640 1 -- 172.21.15.150:0/671908537 <== mon.2 v2:172.21.15.176:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fdf1c062fc0 con 0x7fdf2c070600 2024-09-17T05:50:43.876 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:43.874+0000 7fdf32a70640 1 -- 172.21.15.150:0/671908537 --> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "sub_name": "sv1", "target": ["mon-mgr", ""]}) -- 0x7fdf2c069000 con 0x7fdf1807a330 2024-09-17T05:50:43.880 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:43.879+0000 7fdf297fa640 1 -- 172.21.15.150:0/671908537 <== mgr.4108 v2:172.21.15.176:6800/3631216395 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+59 (secure 0 0 0) 0x7fdf2c069000 con 0x7fdf1807a330 2024-09-17T05:50:43.881 INFO:teuthology.orchestra.run.smithi150.stdout:/volumes/_nogroup/sv1/3abb14c8-f94c-47ef-8bac-90c18ece3748 2024-09-17T05:50:43.883 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:43.881+0000 7fdf32a70640 1 -- 172.21.15.150:0/671908537 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fdf1807a330 msgr2=0x7fdf1807c840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:50:43.883 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:43.881+0000 7fdf32a70640 1 --2- 172.21.15.150:0/671908537 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fdf1807a330 0x7fdf1807c840 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7fdf2c0cd6e0 tx=0x7fdf20009040 comp rx=0 tx=0).stop 2024-09-17T05:50:43.883 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:43.881+0000 7fdf32a70640 1 -- 172.21.15.150:0/671908537 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fdf2c070600 msgr2=0x7fdf2c1e6070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:50:43.883 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:43.881+0000 7fdf32a70640 1 --2- 172.21.15.150:0/671908537 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fdf2c070600 0x7fdf2c1e6070 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fdf1c00c700 tx=0x7fdf1c00cbc0 comp rx=0 tx=0).stop 2024-09-17T05:50:43.883 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:43.881+0000 7fdf32a70640 1 -- 172.21.15.150:0/671908537 shutdown_connections 2024-09-17T05:50:43.883 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:43.881+0000 7fdf32a70640 1 --2- 172.21.15.150:0/671908537 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fdf2c070a10 0x7fdf2c14bce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:50:43.884 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:43.881+0000 7fdf32a70640 1 --2- 172.21.15.150:0/671908537 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fdf1807a330 0x7fdf1807c840 unknown :-1 s=CLOSED pgs=588 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:50:43.884 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:43.881+0000 7fdf32a70640 1 --2- 172.21.15.150:0/671908537 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fdf2c1f9760 0x7fdf2c14f050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:50:43.884 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:43.881+0000 7fdf32a70640 1 --2- 172.21.15.150:0/671908537 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fdf2c070600 0x7fdf2c1e6070 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:50:43.884 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:43.881+0000 7fdf32a70640 1 -- 172.21.15.150:0/671908537 >> 172.21.15.150:0/671908537 conn(0x7fdf2c06d1c0 msgr2=0x7fdf2c14fcc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:50:43.884 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:43.881+0000 7fdf32a70640 1 -- 172.21.15.150:0/671908537 shutdown_connections 2024-09-17T05:50:43.884 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:43.881+0000 7fdf32a70640 1 -- 172.21.15.150:0/671908537 wait complete. 2024-09-17T05:50:43.894 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:50:43.894 DEBUG:teuthology.orchestra.run.smithi150:> (cd /home/ubuntu/cephtest/mnt.0 && exec getfattr -n ceph.dir.rbytes volumes/_nogroup/sv1/3abb14c8-f94c-47ef-8bac-90c18ece3748 2024-09-17T05:50:43.894 DEBUG:teuthology.orchestra.run.smithi150:> ) 2024-09-17T05:50:43.911 INFO:teuthology.orchestra.run.smithi150.stdout:# file: volumes/_nogroup/sv1/3abb14c8-f94c-47ef-8bac-90c18ece3748 2024-09-17T05:50:43.911 INFO:teuthology.orchestra.run.smithi150.stdout:ceph.dir.rbytes="2972172288" 2024-09-17T05:50:43.911 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-09-17T05:50:43.911 INFO:tasks.cephfs.test_volumes:r_size = 2972172288 exp_size = 3221225472 2024-09-17T05:50:45.912 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:50:45.913 DEBUG:teuthology.orchestra.run.smithi150:> (cd /home/ubuntu/cephtest/mnt.0 && exec getfattr -n ceph.dir.rbytes volumes/_nogroup/sv1/3abb14c8-f94c-47ef-8bac-90c18ece3748 2024-09-17T05:50:45.913 DEBUG:teuthology.orchestra.run.smithi150:> ) 2024-09-17T05:50:45.933 INFO:teuthology.orchestra.run.smithi150.stdout:# file: volumes/_nogroup/sv1/3abb14c8-f94c-47ef-8bac-90c18ece3748 2024-09-17T05:50:45.934 INFO:teuthology.orchestra.run.smithi150.stdout:ceph.dir.rbytes="2972172288" 2024-09-17T05:50:45.934 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-09-17T05:50:45.934 INFO:tasks.cephfs.test_volumes:r_size = 2972172288 exp_size = 3221225472 2024-09-17T05:50:47.935 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:50:47.935 DEBUG:teuthology.orchestra.run.smithi150:> (cd /home/ubuntu/cephtest/mnt.0 && exec getfattr -n ceph.dir.rbytes volumes/_nogroup/sv1/3abb14c8-f94c-47ef-8bac-90c18ece3748 2024-09-17T05:50:47.935 DEBUG:teuthology.orchestra.run.smithi150:> ) 2024-09-17T05:50:47.956 INFO:teuthology.orchestra.run.smithi150.stdout:# file: volumes/_nogroup/sv1/3abb14c8-f94c-47ef-8bac-90c18ece3748 2024-09-17T05:50:47.956 INFO:teuthology.orchestra.run.smithi150.stdout:ceph.dir.rbytes="3221225472" 2024-09-17T05:50:47.956 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-09-17T05:50:47.956 INFO:tasks.cephfs.test_volumes:r_size = 3221225472 exp_size = 3221225472 2024-09-17T05:50:47.957 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume snapshot clone cephfs sv1 ss1 ss1clone1 2024-09-17T05:50:48.131 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:48.129+0000 7fcbbad58640 1 -- 172.21.15.150:0/3424299665 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fcba40041c0 msgr2=0x7fcba4004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:50:48.131 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:48.129+0000 7fcbbad58640 1 --2- 172.21.15.150:0/3424299665 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fcba40041c0 0x7fcba4004800 secure :-1 s=READY pgs=1371 cs=0 l=1 rev1=1 crypto rx=0x7fcba0001800 tx=0x7fcba4005830 comp rx=0 tx=0).stop 2024-09-17T05:50:48.131 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:48.129+0000 7fcbb92f5640 1 -- 172.21.15.150:0/3424299665 reap_dead start 2024-09-17T05:50:48.132 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:48.129+0000 7fcbbad58640 1 -- 172.21.15.150:0/3424299665 shutdown_connections 2024-09-17T05:50:48.132 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:48.129+0000 7fcbbad58640 1 -- 172.21.15.150:0/3424299665 >> 172.21.15.150:0/3424299665 conn(0x7fcbb40d2550 msgr2=0x7fcbb40d2960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:50:48.132 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:48.129+0000 7fcbbad58640 1 -- 172.21.15.150:0/3424299665 shutdown_connections 2024-09-17T05:50:48.132 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:48.129+0000 7fcbbad58640 1 -- 172.21.15.150:0/3424299665 wait complete. 2024-09-17T05:50:48.132 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:48.131+0000 7fcbbad58640 1 Processor -- start 2024-09-17T05:50:48.133 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:48.131+0000 7fcbbad58640 1 -- start start 2024-09-17T05:50:48.135 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:48.132+0000 7fcbbad58640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fcba40041c0 0x7fcbb41f4120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:50:48.135 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:48.132+0000 7fcbbad58640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fcbb41dc750 0x7fcbb40b14c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:50:48.135 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:48.132+0000 7fcbbad58640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fcbb40b1a00 0x7fcbb40b01a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:50:48.136 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:48.132+0000 7fcbbad58640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7fcbb40cec10 con 0x7fcbb40b1a00 2024-09-17T05:50:48.136 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:48.132+0000 7fcbbad58640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fcbb40b7630 con 0x7fcba40041c0 2024-09-17T05:50:48.136 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:48.132+0000 7fcbbad58640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fcbb40ced90 con 0x7fcbb41dc750 2024-09-17T05:50:48.136 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:48.133+0000 7fcbb92f5640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fcbb40b1a00 0x7fcbb40b01a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:50:48.136 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:48.133+0000 7fcbb92f5640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fcbb40b1a00 0x7fcbb40b01a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:45250/0 (socket says 172.21.15.150:45250) 2024-09-17T05:50:48.136 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:48.133+0000 7fcbb92f5640 1 -- 172.21.15.150:0/2859006477 learned_addr learned my addr 172.21.15.150:0/2859006477 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:50:48.136 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:48.133+0000 7fcbb3fff640 1 --2- 172.21.15.150:0/2859006477 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fcbb41dc750 0x7fcbb40b14c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:50:48.136 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:48.133+0000 7fcbb8af4640 1 --2- 172.21.15.150:0/2859006477 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fcba40041c0 0x7fcbb41f4120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:50:48.136 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:48.133+0000 7fcbb92f5640 1 -- 172.21.15.150:0/2859006477 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fcbb41dc750 msgr2=0x7fcbb40b14c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:50:48.136 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:48.133+0000 7fcbb92f5640 1 --2- 172.21.15.150:0/2859006477 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fcbb41dc750 0x7fcbb40b14c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:50:48.136 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:48.133+0000 7fcbb92f5640 1 -- 172.21.15.150:0/2859006477 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fcba40041c0 msgr2=0x7fcbb41f4120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:50:48.136 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:48.133+0000 7fcbb92f5640 1 --2- 172.21.15.150:0/2859006477 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fcba40041c0 0x7fcbb41f4120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:50:48.137 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:48.133+0000 7fcbb92f5640 1 -- 172.21.15.150:0/2859006477 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcbb41f4660 con 0x7fcbb40b1a00 2024-09-17T05:50:48.137 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:48.133+0000 7fcbb92f5640 1 --2- 172.21.15.150:0/2859006477 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fcbb40b1a00 0x7fcbb40b01a0 secure :-1 s=READY pgs=1372 cs=0 l=1 rev1=1 crypto rx=0x7fcbb40ccb50 tx=0x7fcbac00ea20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:50:48.137 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:48.133+0000 7fcbb17fa640 1 -- 172.21.15.150:0/2859006477 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcbac015020 con 0x7fcbb40b1a00 2024-09-17T05:50:48.137 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:48.133+0000 7fcbb17fa640 1 -- 172.21.15.150:0/2859006477 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fcbac010980 con 0x7fcbb40b1a00 2024-09-17T05:50:48.137 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:48.133+0000 7fcbbad58640 1 -- 172.21.15.150:0/2859006477 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcbb40b1e10 con 0x7fcbb40b1a00 2024-09-17T05:50:48.137 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:48.133+0000 7fcbb17fa640 1 -- 172.21.15.150:0/2859006477 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcbac010dd0 con 0x7fcbb40b1a00 2024-09-17T05:50:48.137 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:48.133+0000 7fcbbad58640 1 -- 172.21.15.150:0/2859006477 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcbb40b3aa0 con 0x7fcbb40b1a00 2024-09-17T05:50:48.138 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:48.134+0000 7fcbbad58640 1 -- 172.21.15.150:0/2859006477 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcbb409acd0 con 0x7fcbb40b1a00 2024-09-17T05:50:48.138 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:48.135+0000 7fcbb17fa640 1 -- 172.21.15.150:0/2859006477 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 34) ==== 103583+0+0 (secure 0 0 0) 0x7fcbac018020 con 0x7fcbb40b1a00 2024-09-17T05:50:48.138 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:48.135+0000 7fcbb17fa640 1 --2- 172.21.15.150:0/2859006477 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fcb9807a330 0x7fcb9807c840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:50:48.138 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:48.136+0000 7fcbb17fa640 1 -- 172.21.15.150:0/2859006477 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(101..101 src has 1..101) ==== 5821+0+0 (secure 0 0 0) 0x7fcbac099cf0 con 0x7fcbb40b1a00 2024-09-17T05:50:48.138 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:48.136+0000 7fcbb8af4640 1 --2- 172.21.15.150:0/2859006477 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fcb9807a330 0x7fcb9807c840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:50:48.138 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:48.136+0000 7fcbb8af4640 1 --2- 172.21.15.150:0/2859006477 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fcb9807a330 0x7fcb9807c840 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7fcba8009bb0 tx=0x7fcba8005f90 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:50:48.141 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:48.140+0000 7fcbb17fa640 1 -- 172.21.15.150:0/2859006477 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fcbac01f030 con 0x7fcbb40b1a00 2024-09-17T05:50:48.349 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:48.347+0000 7fcbbad58640 1 -- 172.21.15.150:0/2859006477 --> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] -- mgr_command(tid 0: {"prefix": "fs subvolume snapshot clone", "vol_name": "cephfs", "sub_name": "sv1", "snap_name": "ss1", "target_sub_name": "ss1clone1", "target": ["mon-mgr", ""]}) -- 0x7fcbb40d04e0 con 0x7fcb9807a330 2024-09-17T05:50:48.405 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:48.404+0000 7fcbb17fa640 1 -- 172.21.15.150:0/2859006477 <== mgr.4108 v2:172.21.15.176:6800/3631216395 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7fcbb40d04e0 con 0x7fcb9807a330 2024-09-17T05:50:48.408 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:48.406+0000 7fcbbad58640 1 -- 172.21.15.150:0/2859006477 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fcb9807a330 msgr2=0x7fcb9807c840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:50:48.408 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:48.406+0000 7fcbbad58640 1 --2- 172.21.15.150:0/2859006477 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fcb9807a330 0x7fcb9807c840 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7fcba8009bb0 tx=0x7fcba8005f90 comp rx=0 tx=0).stop 2024-09-17T05:50:48.408 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:48.406+0000 7fcbbad58640 1 -- 172.21.15.150:0/2859006477 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fcbb40b1a00 msgr2=0x7fcbb40b01a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:50:48.408 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:48.406+0000 7fcbbad58640 1 --2- 172.21.15.150:0/2859006477 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fcbb40b1a00 0x7fcbb40b01a0 secure :-1 s=READY pgs=1372 cs=0 l=1 rev1=1 crypto rx=0x7fcbb40ccb50 tx=0x7fcbac00ea20 comp rx=0 tx=0).stop 2024-09-17T05:50:48.408 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:48.406+0000 7fcbbad58640 1 -- 172.21.15.150:0/2859006477 shutdown_connections 2024-09-17T05:50:48.408 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:48.406+0000 7fcbbad58640 1 --2- 172.21.15.150:0/2859006477 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fcb9807a330 0x7fcb9807c840 unknown :-1 s=CLOSED pgs=589 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:50:48.409 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:48.406+0000 7fcbbad58640 1 --2- 172.21.15.150:0/2859006477 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fcbb40b1a00 0x7fcbb40b01a0 unknown :-1 s=CLOSED pgs=1372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:50:48.409 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:48.406+0000 7fcbbad58640 1 --2- 172.21.15.150:0/2859006477 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fcbb41dc750 0x7fcbb40b14c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:50:48.409 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:48.406+0000 7fcbbad58640 1 --2- 172.21.15.150:0/2859006477 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fcba40041c0 0x7fcbb41f4120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:50:48.409 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:48.406+0000 7fcbbad58640 1 -- 172.21.15.150:0/2859006477 >> 172.21.15.150:0/2859006477 conn(0x7fcbb40d2550 msgr2=0x7fcbb40721b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:50:48.409 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:48.406+0000 7fcbbad58640 1 -- 172.21.15.150:0/2859006477 shutdown_connections 2024-09-17T05:50:48.409 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:48.406+0000 7fcbbad58640 1 -- 172.21.15.150:0/2859006477 wait complete. 2024-09-17T05:50:48.412 INFO:tasks.ceph.mgr.x.smithi176.stderr:2024-09-17T05:50:48.411+0000 7f33dc724640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-17T05:50:48.412 INFO:tasks.ceph.mgr.x.smithi176.stderr:2024-09-17T05:50:48.411+0000 7f33dc724640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-17T05:50:48.412 INFO:tasks.ceph.mgr.x.smithi176.stderr:2024-09-17T05:50:48.411+0000 7f33dc724640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-17T05:50:48.412 INFO:tasks.ceph.mgr.x.smithi176.stderr:2024-09-17T05:50:48.411+0000 7f33dc724640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-17T05:50:48.412 INFO:tasks.ceph.mgr.x.smithi176.stderr:2024-09-17T05:50:48.411+0000 7f33dc724640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-17T05:50:48.420 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs clone status cephfs ss1clone1 2024-09-17T05:50:48.427 INFO:tasks.ceph.mgr.x.smithi176.stderr:2024-09-17T05:50:48.426+0000 7f33dd726640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-17T05:50:48.427 INFO:tasks.ceph.mgr.x.smithi176.stderr:2024-09-17T05:50:48.426+0000 7f33dd726640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-17T05:50:48.427 INFO:tasks.ceph.mgr.x.smithi176.stderr:2024-09-17T05:50:48.426+0000 7f33dd726640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-17T05:50:48.427 INFO:tasks.ceph.mgr.x.smithi176.stderr:2024-09-17T05:50:48.426+0000 7f33dd726640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-17T05:50:48.427 INFO:tasks.ceph.mgr.x.smithi176.stderr:2024-09-17T05:50:48.426+0000 7f33dd726640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-17T05:50:48.538 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:48.536+0000 7f61d063f640 1 -- 172.21.15.150:0/3046554074 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f61c8070a70 msgr2=0x7f61c80cf8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:50:48.538 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:48.536+0000 7f61d063f640 1 --2- 172.21.15.150:0/3046554074 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f61c8070a70 0x7f61c80cf8b0 secure :-1 s=READY pgs=1374 cs=0 l=1 rev1=1 crypto rx=0x7f61c0005fd0 tx=0x7f61c002a820 comp rx=0 tx=0).stop 2024-09-17T05:50:48.539 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:48.536+0000 7f61d063f640 1 -- 172.21.15.150:0/3046554074 shutdown_connections 2024-09-17T05:50:48.539 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:48.536+0000 7f61d063f640 1 --2- 172.21.15.150:0/3046554074 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f61c806e4c0 0x7f61c80cf370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:50:48.539 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:48.536+0000 7f61d063f640 1 --2- 172.21.15.150:0/3046554074 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f61c8070a70 0x7f61c80cf8b0 unknown :-1 s=CLOSED pgs=1374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:50:48.539 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:48.536+0000 7f61d063f640 1 -- 172.21.15.150:0/3046554074 >> 172.21.15.150:0/3046554074 conn(0x7f61c8073920 msgr2=0x7f61c8073d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:50:48.539 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:48.536+0000 7f61d063f640 1 -- 172.21.15.150:0/3046554074 shutdown_connections 2024-09-17T05:50:48.539 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:48.536+0000 7f61d063f640 1 -- 172.21.15.150:0/3046554074 wait complete. 2024-09-17T05:50:48.539 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:48.538+0000 7f61d063f640 1 Processor -- start 2024-09-17T05:50:48.540 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:48.538+0000 7f61d063f640 1 -- start start 2024-09-17T05:50:48.542 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:48.539+0000 7f61d063f640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f61c8070a70 0x7f61c8146210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:50:48.542 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:48.539+0000 7f61d063f640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f61c8074440 0x7f61c815bf90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:50:48.542 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:48.539+0000 7f61d063f640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f61c8152120 0x7f61c81468c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:50:48.543 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:48.539+0000 7f61d063f640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f61c80cff70 con 0x7f61c8152120 2024-09-17T05:50:48.543 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:48.539+0000 7f61d063f640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f61c80cfdf0 con 0x7f61c8074440 2024-09-17T05:50:48.543 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:48.539+0000 7f61d063f640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f61c80d00f0 con 0x7f61c8070a70 2024-09-17T05:50:48.543 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:48.539+0000 7f61cebdc640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f61c8152120 0x7f61c81468c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:50:48.543 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:48.539+0000 7f61cebdc640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f61c8152120 0x7f61c81468c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:45278/0 (socket says 172.21.15.150:45278) 2024-09-17T05:50:48.543 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:48.540+0000 7f61cebdc640 1 -- 172.21.15.150:0/768160397 learned_addr learned my addr 172.21.15.150:0/768160397 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:50:48.543 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:48.540+0000 7f61ce3db640 1 --2- 172.21.15.150:0/768160397 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f61c8070a70 0x7f61c8146210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:50:48.543 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:48.540+0000 7f61cdbda640 1 --2- 172.21.15.150:0/768160397 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f61c8074440 0x7f61c815bf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:50:48.543 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:48.540+0000 7f61cebdc640 1 -- 172.21.15.150:0/768160397 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f61c8070a70 msgr2=0x7f61c8146210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:50:48.543 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:48.540+0000 7f61cebdc640 1 --2- 172.21.15.150:0/768160397 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f61c8070a70 0x7f61c8146210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:50:48.543 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:48.540+0000 7f61cebdc640 1 -- 172.21.15.150:0/768160397 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f61c8074440 msgr2=0x7f61c815bf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:50:48.544 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:48.540+0000 7f61cebdc640 1 --2- 172.21.15.150:0/768160397 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f61c8074440 0x7f61c815bf90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:50:48.544 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:48.540+0000 7f61cebdc640 1 -- 172.21.15.150:0/768160397 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f61c815c4d0 con 0x7f61c8152120 2024-09-17T05:50:48.544 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:48.540+0000 7f61cebdc640 1 --2- 172.21.15.150:0/768160397 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f61c8152120 0x7f61c81468c0 secure :-1 s=READY pgs=1375 cs=0 l=1 rev1=1 crypto rx=0x7f61c0009cd0 tx=0x7f61c0032c60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:50:48.544 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:48.540+0000 7f61baffd640 1 -- 172.21.15.150:0/768160397 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61c0037040 con 0x7f61c8152120 2024-09-17T05:50:48.544 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:48.540+0000 7f61baffd640 1 -- 172.21.15.150:0/768160397 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f61c0042070 con 0x7f61c8152120 2024-09-17T05:50:48.544 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:48.540+0000 7f61d063f640 1 -- 172.21.15.150:0/768160397 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f61c815ea30 con 0x7f61c8152120 2024-09-17T05:50:48.544 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:48.540+0000 7f61baffd640 1 -- 172.21.15.150:0/768160397 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61c0003e60 con 0x7f61c8152120 2024-09-17T05:50:48.544 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:48.540+0000 7f61d063f640 1 -- 172.21.15.150:0/768160397 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f61c815cc30 con 0x7f61c8152120 2024-09-17T05:50:48.545 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:48.541+0000 7f61d063f640 1 -- 172.21.15.150:0/768160397 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f61c80d0610 con 0x7f61c8152120 2024-09-17T05:50:48.545 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:48.542+0000 7f61baffd640 1 -- 172.21.15.150:0/768160397 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 34) ==== 103583+0+0 (secure 0 0 0) 0x7f61c0004280 con 0x7f61c8152120 2024-09-17T05:50:48.545 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:48.542+0000 7f61baffd640 1 --2- 172.21.15.150:0/768160397 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f61ac07a360 0x7f61ac07c870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:50:48.545 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:48.543+0000 7f61baffd640 1 -- 172.21.15.150:0/768160397 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(101..101 src has 1..101) ==== 5821+0+0 (secure 0 0 0) 0x7f61c00ba680 con 0x7f61c8152120 2024-09-17T05:50:48.545 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:48.543+0000 7f61ce3db640 1 --2- 172.21.15.150:0/768160397 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f61ac07a360 0x7f61ac07c870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:50:48.545 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:48.543+0000 7f61ce3db640 1 --2- 172.21.15.150:0/768160397 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f61ac07a360 0x7f61ac07c870 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7f61c4007fd0 tx=0x7f61c4001370 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:50:48.548 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:48.547+0000 7f61baffd640 1 -- 172.21.15.150:0/768160397 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f61c00c2030 con 0x7f61c8152120 2024-09-17T05:50:48.761 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:48.760+0000 7f61d063f640 1 -- 172.21.15.150:0/768160397 --> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] -- mgr_command(tid 0: {"prefix": "fs clone status", "vol_name": "cephfs", "clone_name": "ss1clone1", "target": ["mon-mgr", ""]}) -- 0x7f61c80b4e50 con 0x7f61ac07a360 2024-09-17T05:50:49.411 INFO:tasks.ceph.mgr.x.smithi176.stderr:2024-09-17T05:50:49.409+0000 7f33b2d91640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-17T05:50:49.411 INFO:tasks.ceph.mgr.x.smithi176.stderr:2024-09-17T05:50:49.409+0000 7f33b2d91640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-17T05:50:49.411 INFO:tasks.ceph.mgr.x.smithi176.stderr:2024-09-17T05:50:49.409+0000 7f33b2d91640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-17T05:50:49.411 INFO:tasks.ceph.mgr.x.smithi176.stderr:2024-09-17T05:50:49.409+0000 7f33b2d91640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-17T05:50:49.411 INFO:tasks.ceph.mgr.x.smithi176.stderr:2024-09-17T05:50:49.409+0000 7f33b2d91640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-17T05:50:49.439 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:49.437+0000 7f61baffd640 1 -- 172.21.15.150:0/768160397 <== mgr.4108 v2:172.21.15.176:6800/3631216395 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+278 (secure 0 0 0) 0x7f61c80b4e50 con 0x7f61ac07a360 2024-09-17T05:50:49.439 INFO:teuthology.orchestra.run.smithi150.stdout:{ 2024-09-17T05:50:49.439 INFO:teuthology.orchestra.run.smithi150.stdout: "status": { 2024-09-17T05:50:49.439 INFO:teuthology.orchestra.run.smithi150.stdout: "state": "in-progress", 2024-09-17T05:50:49.440 INFO:teuthology.orchestra.run.smithi150.stdout: "source": { 2024-09-17T05:50:49.440 INFO:teuthology.orchestra.run.smithi150.stdout: "volume": "cephfs", 2024-09-17T05:50:49.440 INFO:teuthology.orchestra.run.smithi150.stdout: "subvolume": "sv1", 2024-09-17T05:50:49.440 INFO:teuthology.orchestra.run.smithi150.stdout: "snapshot": "ss1" 2024-09-17T05:50:49.440 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-17T05:50:49.440 INFO:teuthology.orchestra.run.smithi150.stdout: "progress_report": { 2024-09-17T05:50:49.440 INFO:teuthology.orchestra.run.smithi150.stdout: "percentage cloned": "0.0%", 2024-09-17T05:50:49.440 INFO:teuthology.orchestra.run.smithi150.stdout: "amount cloned": "184/3.0G", 2024-09-17T05:50:49.440 INFO:teuthology.orchestra.run.smithi150.stdout: "files cloned": "3/4" 2024-09-17T05:50:49.440 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-09-17T05:50:49.440 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-09-17T05:50:49.440 INFO:teuthology.orchestra.run.smithi150.stdout:} 2024-09-17T05:50:49.443 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:49.441+0000 7f61d063f640 1 -- 172.21.15.150:0/768160397 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f61ac07a360 msgr2=0x7f61ac07c870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:50:49.443 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:49.441+0000 7f61d063f640 1 --2- 172.21.15.150:0/768160397 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f61ac07a360 0x7f61ac07c870 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7f61c4007fd0 tx=0x7f61c4001370 comp rx=0 tx=0).stop 2024-09-17T05:50:49.443 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:49.441+0000 7f61d063f640 1 -- 172.21.15.150:0/768160397 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f61c8152120 msgr2=0x7f61c81468c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:50:49.443 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:49.441+0000 7f61d063f640 1 --2- 172.21.15.150:0/768160397 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f61c8152120 0x7f61c81468c0 secure :-1 s=READY pgs=1375 cs=0 l=1 rev1=1 crypto rx=0x7f61c0009cd0 tx=0x7f61c0032c60 comp rx=0 tx=0).stop 2024-09-17T05:50:49.444 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:49.441+0000 7f61d063f640 1 -- 172.21.15.150:0/768160397 shutdown_connections 2024-09-17T05:50:49.444 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:49.441+0000 7f61d063f640 1 --2- 172.21.15.150:0/768160397 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f61c8074440 0x7f61c815bf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:50:49.444 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:49.441+0000 7f61d063f640 1 --2- 172.21.15.150:0/768160397 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f61ac07a360 0x7f61ac07c870 unknown :-1 s=CLOSED pgs=590 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:50:49.444 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:49.441+0000 7f61d063f640 1 --2- 172.21.15.150:0/768160397 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f61c8152120 0x7f61c81468c0 unknown :-1 s=CLOSED pgs=1375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:50:49.444 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:49.441+0000 7f61d063f640 1 --2- 172.21.15.150:0/768160397 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f61c8070a70 0x7f61c8146210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:50:49.444 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:49.441+0000 7f61d063f640 1 -- 172.21.15.150:0/768160397 >> 172.21.15.150:0/768160397 conn(0x7f61c8073920 msgr2=0x7f61c80b5650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:50:49.444 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:49.441+0000 7f61d063f640 1 -- 172.21.15.150:0/768160397 shutdown_connections 2024-09-17T05:50:49.444 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:49.441+0000 7f61d063f640 1 -- 172.21.15.150:0/768160397 wait complete. 2024-09-17T05:50:49.459 DEBUG:tasks.cephfs.test_volumes:current clone state = in-progress 2024-09-17T05:50:49.459 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs clone status cephfs ss1clone1 2024-09-17T05:50:49.625 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:49.622+0000 7f3076bad640 1 -- 172.21.15.150:0/3249548962 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f307015d5f0 msgr2=0x7f307015da00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:50:49.625 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:49.622+0000 7f3076bad640 1 --2- 172.21.15.150:0/3249548962 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f307015d5f0 0x7f307015da00 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7f305c009830 tx=0x7f305c02a3f0 comp rx=0 tx=0).stop 2024-09-17T05:50:49.625 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:49.623+0000 7f3076bad640 1 -- 172.21.15.150:0/3249548962 shutdown_connections 2024-09-17T05:50:49.625 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:49.623+0000 7f3076bad640 1 --2- 172.21.15.150:0/3249548962 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f307006ddb0 0x7f307006e1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:50:49.625 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:49.623+0000 7f3076bad640 1 --2- 172.21.15.150:0/3249548962 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f307015d5f0 0x7f307015da00 secure :-1 s=CLOSED pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7f305c009830 tx=0x7f305c02a3f0 comp rx=0 tx=0).stop 2024-09-17T05:50:49.625 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:49.623+0000 7f3076bad640 1 -- 172.21.15.150:0/3249548962 >> 172.21.15.150:0/3249548962 conn(0x7f3070073890 msgr2=0x7f3070073ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:50:49.627 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:49.624+0000 7f3076bad640 1 -- 172.21.15.150:0/3249548962 shutdown_connections 2024-09-17T05:50:49.627 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:49.625+0000 7f3076bad640 1 -- 172.21.15.150:0/3249548962 wait complete. 2024-09-17T05:50:49.630 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:49.628+0000 7f3076bad640 1 Processor -- start 2024-09-17T05:50:49.630 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:49.628+0000 7f3076bad640 1 -- start start 2024-09-17T05:50:49.632 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:49.630+0000 7f3076bad640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f307006ddb0 0x7f30700af4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:50:49.632 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:49.630+0000 7f3076bad640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f30700cd740 0x7f3070148580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:50:49.633 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:49.630+0000 7f3076bad640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f30701f6c00 0x7f3070148ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:50:49.633 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:49.630+0000 7f3076bad640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f307006fac0 con 0x7f30700cd740 2024-09-17T05:50:49.633 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:49.630+0000 7f3076bad640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f307006f940 con 0x7f307006ddb0 2024-09-17T05:50:49.633 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:49.630+0000 7f3076bad640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f307006fc40 con 0x7f30701f6c00 2024-09-17T05:50:49.633 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:49.630+0000 7f306ffff640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f30700cd740 0x7f3070148580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:50:49.633 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:49.630+0000 7f306ffff640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f30700cd740 0x7f3070148580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:45280/0 (socket says 172.21.15.150:45280) 2024-09-17T05:50:49.633 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:49.630+0000 7f306ffff640 1 -- 172.21.15.150:0/2424180761 learned_addr learned my addr 172.21.15.150:0/2424180761 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:50:49.633 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:49.631+0000 7f306ffff640 1 -- 172.21.15.150:0/2424180761 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f30701f6c00 msgr2=0x7f3070148ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:50:49.633 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:49.631+0000 7f306ffff640 1 --2- 172.21.15.150:0/2424180761 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f30701f6c00 0x7f3070148ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:50:49.633 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:49.631+0000 7f306ffff640 1 -- 172.21.15.150:0/2424180761 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f307006ddb0 msgr2=0x7f30700af4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:50:49.633 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:49.631+0000 7f306ffff640 1 --2- 172.21.15.150:0/2424180761 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f307006ddb0 0x7f30700af4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:50:49.634 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:49.631+0000 7f306ffff640 1 -- 172.21.15.150:0/2424180761 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f30701f7370 con 0x7f30700cd740 2024-09-17T05:50:49.634 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:49.631+0000 7f306ffff640 1 --2- 172.21.15.150:0/2424180761 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f30700cd740 0x7f3070148580 secure :-1 s=READY pgs=1376 cs=0 l=1 rev1=1 crypto rx=0x7f305c009950 tx=0x7f305c032b90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:50:49.634 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:49.631+0000 7f306d7fa640 1 -- 172.21.15.150:0/2424180761 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f305c040070 con 0x7f30700cd740 2024-09-17T05:50:49.634 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:49.631+0000 7f306d7fa640 1 -- 172.21.15.150:0/2424180761 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f305c005310 con 0x7f30700cd740 2024-09-17T05:50:49.635 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:49.631+0000 7f3076bad640 1 -- 172.21.15.150:0/2424180761 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f30701f7650 con 0x7f30700cd740 2024-09-17T05:50:49.635 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:49.631+0000 7f306d7fa640 1 -- 172.21.15.150:0/2424180761 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f305c0047a0 con 0x7f30700cd740 2024-09-17T05:50:49.635 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:49.632+0000 7f3076bad640 1 -- 172.21.15.150:0/2424180761 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f307015a660 con 0x7f30700cd740 2024-09-17T05:50:49.635 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:49.633+0000 7f3076bad640 1 -- 172.21.15.150:0/2424180761 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3070070160 con 0x7f30700cd740 2024-09-17T05:50:49.636 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:49.634+0000 7f306d7fa640 1 -- 172.21.15.150:0/2424180761 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 34) ==== 103583+0+0 (secure 0 0 0) 0x7f305c039040 con 0x7f30700cd740 2024-09-17T05:50:49.637 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:49.635+0000 7f306d7fa640 1 --2- 172.21.15.150:0/2424180761 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f305407a360 0x7f305407c870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:50:49.637 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:49.635+0000 7f306d7fa640 1 -- 172.21.15.150:0/2424180761 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(101..101 src has 1..101) ==== 5821+0+0 (secure 0 0 0) 0x7f305c0baa00 con 0x7f30700cd740 2024-09-17T05:50:49.641 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:49.640+0000 7f306d7fa640 1 -- 172.21.15.150:0/2424180761 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f305c0849d0 con 0x7f30700cd740 2024-09-17T05:50:49.643 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:49.642+0000 7f3074949640 1 --2- 172.21.15.150:0/2424180761 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f305407a360 0x7f305407c870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:50:49.645 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:49.644+0000 7f3074949640 1 --2- 172.21.15.150:0/2424180761 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f305407a360 0x7f305407c870 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7f3064000f60 tx=0x7f30640079b0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:50:49.724 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:49.721+0000 7f306d7fa640 1 -- 172.21.15.150:0/2424180761 <== mon.0 v2:172.21.15.150:3300/0 7 ==== mgrmap(e 35) ==== 103685+0+0 (secure 0 0 0) 0x7f305c080540 con 0x7f30700cd740 2024-09-17T05:50:49.960 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:49.958+0000 7f3076bad640 1 -- 172.21.15.150:0/2424180761 --> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] -- mgr_command(tid 0: {"prefix": "fs clone status", "vol_name": "cephfs", "clone_name": "ss1clone1", "target": ["mon-mgr", ""]}) -- 0x7f30701f7b70 con 0x7f305407a360 2024-09-17T05:50:50.009 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:50.007+0000 7f306d7fa640 1 -- 172.21.15.150:0/2424180761 <== mgr.4108 v2:172.21.15.176:6800/3631216395 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+278 (secure 0 0 0) 0x7f30640050d0 con 0x7f305407a360 2024-09-17T05:50:50.009 INFO:teuthology.orchestra.run.smithi150.stdout:{ 2024-09-17T05:50:50.010 INFO:teuthology.orchestra.run.smithi150.stdout: "status": { 2024-09-17T05:50:50.010 INFO:teuthology.orchestra.run.smithi150.stdout: "state": "in-progress", 2024-09-17T05:50:50.010 INFO:teuthology.orchestra.run.smithi150.stdout: "source": { 2024-09-17T05:50:50.010 INFO:teuthology.orchestra.run.smithi150.stdout: "volume": "cephfs", 2024-09-17T05:50:50.010 INFO:teuthology.orchestra.run.smithi150.stdout: "subvolume": "sv1", 2024-09-17T05:50:50.010 INFO:teuthology.orchestra.run.smithi150.stdout: "snapshot": "ss1" 2024-09-17T05:50:50.010 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-17T05:50:50.010 INFO:teuthology.orchestra.run.smithi150.stdout: "progress_report": { 2024-09-17T05:50:50.010 INFO:teuthology.orchestra.run.smithi150.stdout: "percentage cloned": "0.0%", 2024-09-17T05:50:50.010 INFO:teuthology.orchestra.run.smithi150.stdout: "amount cloned": "184/3.0G", 2024-09-17T05:50:50.010 INFO:teuthology.orchestra.run.smithi150.stdout: "files cloned": "4/4" 2024-09-17T05:50:50.010 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-09-17T05:50:50.011 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-09-17T05:50:50.011 INFO:teuthology.orchestra.run.smithi150.stdout:} 2024-09-17T05:50:50.013 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:50.011+0000 7f3076bad640 1 -- 172.21.15.150:0/2424180761 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f305407a360 msgr2=0x7f305407c870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:50:50.013 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:50.011+0000 7f3076bad640 1 --2- 172.21.15.150:0/2424180761 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f305407a360 0x7f305407c870 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7f3064000f60 tx=0x7f30640079b0 comp rx=0 tx=0).stop 2024-09-17T05:50:50.013 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:50.011+0000 7f3076bad640 1 -- 172.21.15.150:0/2424180761 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f30700cd740 msgr2=0x7f3070148580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:50:50.013 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:50.011+0000 7f3076bad640 1 --2- 172.21.15.150:0/2424180761 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f30700cd740 0x7f3070148580 secure :-1 s=READY pgs=1376 cs=0 l=1 rev1=1 crypto rx=0x7f305c009950 tx=0x7f305c032b90 comp rx=0 tx=0).stop 2024-09-17T05:50:50.013 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:50.011+0000 7f3076bad640 1 -- 172.21.15.150:0/2424180761 shutdown_connections 2024-09-17T05:50:50.013 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:50.011+0000 7f3076bad640 1 --2- 172.21.15.150:0/2424180761 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f305407a360 0x7f305407c870 unknown :-1 s=CLOSED pgs=591 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:50:50.013 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:50.011+0000 7f3076bad640 1 --2- 172.21.15.150:0/2424180761 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f30701f6c00 0x7f3070148ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:50:50.013 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:50.011+0000 7f3076bad640 1 --2- 172.21.15.150:0/2424180761 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f30700cd740 0x7f3070148580 unknown :-1 s=CLOSED pgs=1376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:50:50.013 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:50.011+0000 7f3076bad640 1 --2- 172.21.15.150:0/2424180761 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f307006ddb0 0x7f30700af4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:50:50.014 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:50.011+0000 7f3076bad640 1 -- 172.21.15.150:0/2424180761 >> 172.21.15.150:0/2424180761 conn(0x7f3070073890 msgr2=0x7f30700b1820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:50:50.014 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:50.011+0000 7f3076bad640 1 -- 172.21.15.150:0/2424180761 shutdown_connections 2024-09-17T05:50:50.014 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:50.011+0000 7f3076bad640 1 -- 172.21.15.150:0/2424180761 wait complete. 2024-09-17T05:50:50.034 DEBUG:tasks.cephfs.test_volumes:percentage cloned = 0.0% 2024-09-17T05:50:51.034 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs clone status cephfs ss1clone1 2024-09-17T05:50:51.197 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:51.194+0000 7f3c3d941640 1 -- 172.21.15.150:0/2452749226 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3c20003fe0 msgr2=0x7f3c20004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:50:51.197 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:51.194+0000 7f3c3d941640 1 --2- 172.21.15.150:0/2452749226 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3c20003fe0 0x7f3c20004800 secure :-1 s=READY pgs=1378 cs=0 l=1 rev1=1 crypto rx=0x7f3c2c00c2e0 tx=0x7f3c20005830 comp rx=0 tx=0).stop 2024-09-17T05:50:51.198 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:51.194+0000 7f3c377fe640 1 -- 172.21.15.150:0/2452749226 reap_dead start 2024-09-17T05:50:51.198 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:51.194+0000 7f3c3d941640 1 -- 172.21.15.150:0/2452749226 shutdown_connections 2024-09-17T05:50:51.198 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:51.194+0000 7f3c3d941640 1 -- 172.21.15.150:0/2452749226 >> 172.21.15.150:0/2452749226 conn(0x7f3c3806d1c0 msgr2=0x7f3c3806d5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:50:51.198 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:51.195+0000 7f3c3d941640 1 -- 172.21.15.150:0/2452749226 shutdown_connections 2024-09-17T05:50:51.198 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:51.196+0000 7f3c3d941640 1 -- 172.21.15.150:0/2452749226 wait complete. 2024-09-17T05:50:51.202 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:51.199+0000 7f3c3d941640 1 Processor -- start 2024-09-17T05:50:51.202 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:51.200+0000 7f3c3d941640 1 -- start start 2024-09-17T05:50:51.205 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:51.202+0000 7f3c3d941640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3c20003fe0 0x7f3c38146240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:50:51.205 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:51.202+0000 7f3c3d941640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3c38148730 0x7f3c3814a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:50:51.205 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:51.202+0000 7f3c3d941640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3c3814adb0 0x7f3c381468c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:50:51.206 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:51.202+0000 7f3c3d941640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f3c380b54a0 con 0x7f3c20003fe0 2024-09-17T05:50:51.206 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:51.202+0000 7f3c3d941640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f3c380b5320 con 0x7f3c38148730 2024-09-17T05:50:51.206 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:51.202+0000 7f3c3d941640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f3c380b5620 con 0x7f3c3814adb0 2024-09-17T05:50:51.206 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:51.202+0000 7f3c36ffd640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3c20003fe0 0x7f3c38146240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:50:51.206 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:51.202+0000 7f3c36ffd640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3c20003fe0 0x7f3c38146240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:58142/0 (socket says 172.21.15.150:58142) 2024-09-17T05:50:51.206 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:51.202+0000 7f3c36ffd640 1 -- 172.21.15.150:0/1854759781 learned_addr learned my addr 172.21.15.150:0/1854759781 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:50:51.206 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:51.202+0000 7f3c36ffd640 1 -- 172.21.15.150:0/1854759781 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3c3814adb0 msgr2=0x7f3c381468c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:50:51.206 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:51.202+0000 7f3c36ffd640 1 --2- 172.21.15.150:0/1854759781 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3c3814adb0 0x7f3c381468c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:50:51.206 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:51.202+0000 7f3c36ffd640 1 -- 172.21.15.150:0/1854759781 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3c38148730 msgr2=0x7f3c3814a870 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-17T05:50:51.206 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:51.202+0000 7f3c36ffd640 1 --2- 172.21.15.150:0/1854759781 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3c38148730 0x7f3c3814a870 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:50:51.207 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:51.202+0000 7f3c36ffd640 1 -- 172.21.15.150:0/1854759781 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3c3814b1c0 con 0x7f3c20003fe0 2024-09-17T05:50:51.207 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:51.202+0000 7f3c36ffd640 1 --2- 172.21.15.150:0/1854759781 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3c20003fe0 0x7f3c38146240 secure :-1 s=READY pgs=1379 cs=0 l=1 rev1=1 crypto rx=0x7f3c2800c490 tx=0x7f3c2800c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:50:51.207 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:51.203+0000 7f3c1ffff640 1 -- 172.21.15.150:0/1854759781 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c280052d0 con 0x7f3c20003fe0 2024-09-17T05:50:51.207 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:51.203+0000 7f3c1ffff640 1 -- 172.21.15.150:0/1854759781 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f3c28007020 con 0x7f3c20003fe0 2024-09-17T05:50:51.207 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:51.203+0000 7f3c1ffff640 1 -- 172.21.15.150:0/1854759781 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c28007470 con 0x7f3c20003fe0 2024-09-17T05:50:51.207 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:51.203+0000 7f3c3d941640 1 -- 172.21.15.150:0/1854759781 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3c381503b0 con 0x7f3c20003fe0 2024-09-17T05:50:51.207 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:51.203+0000 7f3c3d941640 1 -- 172.21.15.150:0/1854759781 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3c38150970 con 0x7f3c20003fe0 2024-09-17T05:50:51.208 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:51.204+0000 7f3c3d941640 1 -- 172.21.15.150:0/1854759781 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3c3815ecb0 con 0x7f3c20003fe0 2024-09-17T05:50:51.208 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:51.205+0000 7f3c1ffff640 1 -- 172.21.15.150:0/1854759781 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 35) ==== 103685+0+0 (secure 0 0 0) 0x7f3c280067d0 con 0x7f3c20003fe0 2024-09-17T05:50:51.208 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:51.205+0000 7f3c1ffff640 1 --2- 172.21.15.150:0/1854759781 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f3c2407a420 0x7f3c2407c930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:50:51.209 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:51.206+0000 7f3c1ffff640 1 -- 172.21.15.150:0/1854759781 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(101..101 src has 1..101) ==== 5821+0+0 (secure 0 0 0) 0x7f3c28099050 con 0x7f3c20003fe0 2024-09-17T05:50:51.209 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:51.206+0000 7f3c367fc640 1 --2- 172.21.15.150:0/1854759781 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f3c2407a420 0x7f3c2407c930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:50:51.209 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:51.206+0000 7f3c367fc640 1 --2- 172.21.15.150:0/1854759781 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f3c2407a420 0x7f3c2407c930 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7f3c2c033000 tx=0x7f3c2c0019f0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:50:51.213 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:51.211+0000 7f3c1ffff640 1 -- 172.21.15.150:0/1854759781 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f3c3814b1c0 con 0x7f3c20003fe0 2024-09-17T05:50:51.526 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:51.524+0000 7f3c3d941640 1 -- 172.21.15.150:0/1854759781 --> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] -- mgr_command(tid 0: {"prefix": "fs clone status", "vol_name": "cephfs", "clone_name": "ss1clone1", "target": ["mon-mgr", ""]}) -- 0x7f3c380ccc40 con 0x7f3c2407a420 2024-09-17T05:50:51.593 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:51.591+0000 7f3c1ffff640 1 -- 172.21.15.150:0/1854759781 <== mgr.4108 v2:172.21.15.176:6800/3631216395 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+282 (secure 0 0 0) 0x7f3c380ccc40 con 0x7f3c2407a420 2024-09-17T05:50:51.593 INFO:teuthology.orchestra.run.smithi150.stdout:{ 2024-09-17T05:50:51.593 INFO:teuthology.orchestra.run.smithi150.stdout: "status": { 2024-09-17T05:50:51.594 INFO:teuthology.orchestra.run.smithi150.stdout: "state": "in-progress", 2024-09-17T05:50:51.594 INFO:teuthology.orchestra.run.smithi150.stdout: "source": { 2024-09-17T05:50:51.594 INFO:teuthology.orchestra.run.smithi150.stdout: "volume": "cephfs", 2024-09-17T05:50:51.594 INFO:teuthology.orchestra.run.smithi150.stdout: "subvolume": "sv1", 2024-09-17T05:50:51.594 INFO:teuthology.orchestra.run.smithi150.stdout: "snapshot": "ss1" 2024-09-17T05:50:51.594 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-17T05:50:51.594 INFO:teuthology.orchestra.run.smithi150.stdout: "progress_report": { 2024-09-17T05:50:51.594 INFO:teuthology.orchestra.run.smithi150.stdout: "percentage cloned": "23.958%", 2024-09-17T05:50:51.594 INFO:teuthology.orchestra.run.smithi150.stdout: "amount cloned": "736M/3.0G", 2024-09-17T05:50:51.594 INFO:teuthology.orchestra.run.smithi150.stdout: "files cloned": "4/4" 2024-09-17T05:50:51.594 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-09-17T05:50:51.594 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-09-17T05:50:51.595 INFO:teuthology.orchestra.run.smithi150.stdout:} 2024-09-17T05:50:51.597 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:51.595+0000 7f3c3d941640 1 -- 172.21.15.150:0/1854759781 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f3c2407a420 msgr2=0x7f3c2407c930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:50:51.598 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:51.595+0000 7f3c3d941640 1 --2- 172.21.15.150:0/1854759781 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f3c2407a420 0x7f3c2407c930 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7f3c2c033000 tx=0x7f3c2c0019f0 comp rx=0 tx=0).stop 2024-09-17T05:50:51.598 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:51.595+0000 7f3c3d941640 1 -- 172.21.15.150:0/1854759781 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3c20003fe0 msgr2=0x7f3c38146240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:50:51.598 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:51.595+0000 7f3c3d941640 1 --2- 172.21.15.150:0/1854759781 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3c20003fe0 0x7f3c38146240 secure :-1 s=READY pgs=1379 cs=0 l=1 rev1=1 crypto rx=0x7f3c2800c490 tx=0x7f3c2800c950 comp rx=0 tx=0).stop 2024-09-17T05:50:51.598 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:51.595+0000 7f3c3d941640 1 -- 172.21.15.150:0/1854759781 shutdown_connections 2024-09-17T05:50:51.598 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:51.595+0000 7f3c3d941640 1 --2- 172.21.15.150:0/1854759781 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3c38148730 0x7f3c3814a870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:50:51.598 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:51.595+0000 7f3c3d941640 1 --2- 172.21.15.150:0/1854759781 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f3c2407a420 0x7f3c2407c930 unknown :-1 s=CLOSED pgs=592 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:50:51.598 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:51.595+0000 7f3c3d941640 1 --2- 172.21.15.150:0/1854759781 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3c3814adb0 0x7f3c381468c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:50:51.598 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:51.595+0000 7f3c3d941640 1 --2- 172.21.15.150:0/1854759781 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3c20003fe0 0x7f3c38146240 secure :-1 s=CLOSED pgs=1379 cs=0 l=1 rev1=1 crypto rx=0x7f3c2800c490 tx=0x7f3c2800c950 comp rx=0 tx=0).stop 2024-09-17T05:50:51.598 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:51.595+0000 7f3c3d941640 1 -- 172.21.15.150:0/1854759781 >> 172.21.15.150:0/1854759781 conn(0x7f3c3806d1c0 msgr2=0x7f3c3814e850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:50:51.598 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:51.596+0000 7f3c3d941640 1 -- 172.21.15.150:0/1854759781 shutdown_connections 2024-09-17T05:50:51.598 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:51.596+0000 7f3c3d941640 1 -- 172.21.15.150:0/1854759781 wait complete. 2024-09-17T05:50:51.619 DEBUG:tasks.cephfs.test_volumes:percentage cloned = 23.958% 2024-09-17T05:50:52.620 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs clone status cephfs ss1clone1 2024-09-17T05:50:52.795 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:52.793+0000 7f39bd519640 1 -- 172.21.15.150:0/1335353059 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f39b8152740 msgr2=0x7f39b80b63a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:50:52.796 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:52.793+0000 7f39bd519640 1 --2- 172.21.15.150:0/1335353059 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f39b8152740 0x7f39b80b63a0 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7f39a0009830 tx=0x7f39a002a540 comp rx=0 tx=0).stop 2024-09-17T05:50:52.796 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:52.793+0000 7f39bd519640 1 -- 172.21.15.150:0/1335353059 shutdown_connections 2024-09-17T05:50:52.796 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:52.793+0000 7f39bd519640 1 --2- 172.21.15.150:0/1335353059 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f39b8152740 0x7f39b80b63a0 unknown :-1 s=CLOSED pgs=491 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:50:52.796 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:52.793+0000 7f39bd519640 1 -- 172.21.15.150:0/1335353059 >> 172.21.15.150:0/1335353059 conn(0x7f39b8074840 msgr2=0x7f39b806cda0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:50:52.796 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:52.793+0000 7f39bd519640 1 -- 172.21.15.150:0/1335353059 shutdown_connections 2024-09-17T05:50:52.796 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:52.793+0000 7f39bd519640 1 -- 172.21.15.150:0/1335353059 wait complete. 2024-09-17T05:50:52.796 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:52.795+0000 7f39bd519640 1 Processor -- start 2024-09-17T05:50:52.797 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:52.795+0000 7f39bd519640 1 -- start start 2024-09-17T05:50:52.799 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:52.796+0000 7f39bd519640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f39b8075f30 0x7f39b81564b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:50:52.799 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:52.796+0000 7f39bd519640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f39b80b68e0 0x7f39b81f6f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:50:52.799 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:52.796+0000 7f39bd519640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f39b8152740 0x7f39b81f61a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:50:52.799 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:52.796+0000 7f39bd519640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f39b80d0060 con 0x7f39b8152740 2024-09-17T05:50:52.799 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:52.796+0000 7f39bd519640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f39b80cfee0 con 0x7f39b80b68e0 2024-09-17T05:50:52.800 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:52.796+0000 7f39bd519640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f39b80d01e0 con 0x7f39b8075f30 2024-09-17T05:50:52.800 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:52.796+0000 7f39b77fe640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f39b8152740 0x7f39b81f61a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:50:52.800 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:52.797+0000 7f39b77fe640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f39b8152740 0x7f39b81f61a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:58146/0 (socket says 172.21.15.150:58146) 2024-09-17T05:50:52.800 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:52.797+0000 7f39b77fe640 1 -- 172.21.15.150:0/2363479626 learned_addr learned my addr 172.21.15.150:0/2363479626 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:50:52.800 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:52.797+0000 7f39affff640 1 --2- 172.21.15.150:0/2363479626 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f39b80b68e0 0x7f39b81f6f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:50:52.800 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:52.797+0000 7f39b6ffd640 1 --2- 172.21.15.150:0/2363479626 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f39b8075f30 0x7f39b81564b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:50:52.800 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:52.797+0000 7f39b77fe640 1 -- 172.21.15.150:0/2363479626 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f39b8075f30 msgr2=0x7f39b81564b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:50:52.800 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:52.797+0000 7f39b77fe640 1 --2- 172.21.15.150:0/2363479626 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f39b8075f30 0x7f39b81564b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:50:52.800 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:52.797+0000 7f39b77fe640 1 -- 172.21.15.150:0/2363479626 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f39b80b68e0 msgr2=0x7f39b81f6f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:50:52.800 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:52.797+0000 7f39b77fe640 1 --2- 172.21.15.150:0/2363479626 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f39b80b68e0 0x7f39b81f6f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:50:52.800 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:52.797+0000 7f39b77fe640 1 -- 172.21.15.150:0/2363479626 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f39b81569f0 con 0x7f39b8152740 2024-09-17T05:50:52.800 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:52.797+0000 7f39b77fe640 1 --2- 172.21.15.150:0/2363479626 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f39b8152740 0x7f39b81f61a0 secure :-1 s=READY pgs=1381 cs=0 l=1 rev1=1 crypto rx=0x7f39b000c730 tx=0x7f39b000cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:50:52.801 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:52.797+0000 7f39af7fe640 1 -- 172.21.15.150:0/2363479626 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39b0003b70 con 0x7f39b8152740 2024-09-17T05:50:52.801 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:52.797+0000 7f39bd519640 1 -- 172.21.15.150:0/2363479626 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f39b814c3e0 con 0x7f39b8152740 2024-09-17T05:50:52.801 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:52.797+0000 7f39af7fe640 1 -- 172.21.15.150:0/2363479626 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f39b0003d10 con 0x7f39b8152740 2024-09-17T05:50:52.801 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:52.797+0000 7f39af7fe640 1 -- 172.21.15.150:0/2363479626 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39b000aab0 con 0x7f39b8152740 2024-09-17T05:50:52.801 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:52.797+0000 7f39bd519640 1 -- 172.21.15.150:0/2363479626 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f39b814c9a0 con 0x7f39b8152740 2024-09-17T05:50:52.802 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:52.799+0000 7f39bd519640 1 -- 172.21.15.150:0/2363479626 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f39b80d0720 con 0x7f39b8152740 2024-09-17T05:50:52.802 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:52.800+0000 7f39af7fe640 1 -- 172.21.15.150:0/2363479626 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 36) ==== 103736+0+0 (secure 0 0 0) 0x7f39b000ac50 con 0x7f39b8152740 2024-09-17T05:50:52.802 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:52.800+0000 7f39af7fe640 1 --2- 172.21.15.150:0/2363479626 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f399807a4e0 0x7f399807c9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:50:52.802 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:52.800+0000 7f39af7fe640 1 -- 172.21.15.150:0/2363479626 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(101..101 src has 1..101) ==== 5821+0+0 (secure 0 0 0) 0x7f39b0099810 con 0x7f39b8152740 2024-09-17T05:50:52.802 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:52.800+0000 7f39b6ffd640 1 --2- 172.21.15.150:0/2363479626 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f399807a4e0 0x7f399807c9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:50:52.803 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:52.801+0000 7f39b6ffd640 1 --2- 172.21.15.150:0/2363479626 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f399807a4e0 0x7f399807c9f0 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7f39a8000c00 tx=0x7f39a8004600 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:50:52.807 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:52.805+0000 7f39af7fe640 1 -- 172.21.15.150:0/2363479626 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f39b0063110 con 0x7f39b8152740 2024-09-17T05:50:53.089 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:53.087+0000 7f39bd519640 1 -- 172.21.15.150:0/2363479626 --> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] -- mgr_command(tid 0: {"prefix": "fs clone status", "vol_name": "cephfs", "clone_name": "ss1clone1", "target": ["mon-mgr", ""]}) -- 0x7f39b8070620 con 0x7f399807a4e0 2024-09-17T05:50:53.166 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:53.164+0000 7f39af7fe640 1 -- 172.21.15.150:0/2363479626 <== mgr.4108 v2:172.21.15.176:6800/3631216395 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+282 (secure 0 0 0) 0x7f39b8070620 con 0x7f399807a4e0 2024-09-17T05:50:53.166 INFO:teuthology.orchestra.run.smithi150.stdout:{ 2024-09-17T05:50:53.167 INFO:teuthology.orchestra.run.smithi150.stdout: "status": { 2024-09-17T05:50:53.167 INFO:teuthology.orchestra.run.smithi150.stdout: "state": "in-progress", 2024-09-17T05:50:53.167 INFO:teuthology.orchestra.run.smithi150.stdout: "source": { 2024-09-17T05:50:53.167 INFO:teuthology.orchestra.run.smithi150.stdout: "volume": "cephfs", 2024-09-17T05:50:53.167 INFO:teuthology.orchestra.run.smithi150.stdout: "subvolume": "sv1", 2024-09-17T05:50:53.167 INFO:teuthology.orchestra.run.smithi150.stdout: "snapshot": "ss1" 2024-09-17T05:50:53.167 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-17T05:50:53.167 INFO:teuthology.orchestra.run.smithi150.stdout: "progress_report": { 2024-09-17T05:50:53.167 INFO:teuthology.orchestra.run.smithi150.stdout: "percentage cloned": "66.667%", 2024-09-17T05:50:53.167 INFO:teuthology.orchestra.run.smithi150.stdout: "amount cloned": "2.0G/3.0G", 2024-09-17T05:50:53.167 INFO:teuthology.orchestra.run.smithi150.stdout: "files cloned": "5/4" 2024-09-17T05:50:53.167 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-09-17T05:50:53.167 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-09-17T05:50:53.168 INFO:teuthology.orchestra.run.smithi150.stdout:} 2024-09-17T05:50:53.171 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:53.169+0000 7f39bd519640 1 -- 172.21.15.150:0/2363479626 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f399807a4e0 msgr2=0x7f399807c9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:50:53.171 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:53.169+0000 7f39bd519640 1 --2- 172.21.15.150:0/2363479626 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f399807a4e0 0x7f399807c9f0 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7f39a8000c00 tx=0x7f39a8004600 comp rx=0 tx=0).stop 2024-09-17T05:50:53.171 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:53.169+0000 7f39bd519640 1 -- 172.21.15.150:0/2363479626 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f39b8152740 msgr2=0x7f39b81f61a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:50:53.171 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:53.169+0000 7f39bd519640 1 --2- 172.21.15.150:0/2363479626 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f39b8152740 0x7f39b81f61a0 secure :-1 s=READY pgs=1381 cs=0 l=1 rev1=1 crypto rx=0x7f39b000c730 tx=0x7f39b000cbf0 comp rx=0 tx=0).stop 2024-09-17T05:50:53.171 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:53.169+0000 7f39bd519640 1 -- 172.21.15.150:0/2363479626 shutdown_connections 2024-09-17T05:50:53.171 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:53.169+0000 7f39bd519640 1 --2- 172.21.15.150:0/2363479626 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f39b80b68e0 0x7f39b81f6f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:50:53.171 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:53.169+0000 7f39bd519640 1 --2- 172.21.15.150:0/2363479626 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f399807a4e0 0x7f399807c9f0 unknown :-1 s=CLOSED pgs=593 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:50:53.172 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:53.169+0000 7f39bd519640 1 --2- 172.21.15.150:0/2363479626 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f39b8152740 0x7f39b81f61a0 unknown :-1 s=CLOSED pgs=1381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:50:53.172 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:53.169+0000 7f39bd519640 1 --2- 172.21.15.150:0/2363479626 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f39b8075f30 0x7f39b81564b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:50:53.172 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:53.169+0000 7f39bd519640 1 -- 172.21.15.150:0/2363479626 >> 172.21.15.150:0/2363479626 conn(0x7f39b8074840 msgr2=0x7f39b80b4b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:50:53.172 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:53.169+0000 7f39bd519640 1 -- 172.21.15.150:0/2363479626 shutdown_connections 2024-09-17T05:50:53.172 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:53.169+0000 7f39bd519640 1 -- 172.21.15.150:0/2363479626 wait complete. 2024-09-17T05:50:53.191 DEBUG:tasks.cephfs.test_volumes:percentage cloned = 66.667% 2024-09-17T05:50:54.192 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs clone status cephfs ss1clone1 2024-09-17T05:50:54.371 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:54.369+0000 7f73e16a2640 1 -- 172.21.15.150:0/3543761518 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f73dc0b3510 msgr2=0x7f73dc1626f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:50:54.371 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:54.369+0000 7f73e16a2640 1 --2- 172.21.15.150:0/3543761518 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f73dc0b3510 0x7f73dc1626f0 secure :-1 s=READY pgs=1383 cs=0 l=1 rev1=1 crypto rx=0x7f73dc0ba770 tx=0x7f73cc02a4a0 comp rx=0 tx=0).stop 2024-09-17T05:50:54.372 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:54.370+0000 7f73e16a2640 1 -- 172.21.15.150:0/3543761518 shutdown_connections 2024-09-17T05:50:54.372 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:54.370+0000 7f73e16a2640 1 --2- 172.21.15.150:0/3543761518 >> v2:172.21.15.176:3300/0 conn(0x7f73dc0b9f20 0x7f73dc162c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:50:54.372 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:54.370+0000 7f73e16a2640 1 --2- 172.21.15.150:0/3543761518 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f73dc0b3510 0x7f73dc1626f0 unknown :-1 s=CLOSED pgs=1383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:50:54.372 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:54.370+0000 7f73e16a2640 1 -- 172.21.15.150:0/3543761518 >> 172.21.15.150:0/3543761518 conn(0x7f73dc0d46e0 msgr2=0x7f73dc0d4af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:50:54.372 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:54.370+0000 7f73e16a2640 1 -- 172.21.15.150:0/3543761518 shutdown_connections 2024-09-17T05:50:54.373 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:54.370+0000 7f73e16a2640 1 -- 172.21.15.150:0/3543761518 wait complete. 2024-09-17T05:50:54.375 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:54.374+0000 7f73e16a2640 1 Processor -- start 2024-09-17T05:50:54.375 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:54.374+0000 7f73e16a2640 1 -- start start 2024-09-17T05:50:54.378 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:54.376+0000 7f73e16a2640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f73dc0b13c0 0x7f73dc15cb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:50:54.378 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:54.376+0000 7f73e16a2640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f73dc0b3510 0x7f73dc14fc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:50:54.379 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:54.377+0000 7f73daffd640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f73dc0b13c0 0x7f73dc15cb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:50:54.379 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:54.377+0000 7f73daffd640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f73dc0b13c0 0x7f73dc15cb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3300/0 says I am v2:172.21.15.150:35784/0 (socket says 172.21.15.150:35784) 2024-09-17T05:50:54.379 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:54.377+0000 7f73daffd640 1 -- 172.21.15.150:0/26361510 learned_addr learned my addr 172.21.15.150:0/26361510 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:50:54.379 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:54.377+0000 7f73e16a2640 1 --2- 172.21.15.150:0/26361510 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f73dc0b9f20 0x7f73dc1f5b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:50:54.379 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:54.377+0000 7f73e16a2640 1 -- 172.21.15.150:0/26361510 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f73dc0b1ee0 con 0x7f73dc0b3510 2024-09-17T05:50:54.379 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:54.377+0000 7f73e16a2640 1 -- 172.21.15.150:0/26361510 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f73dc0d06a0 con 0x7f73dc0b13c0 2024-09-17T05:50:54.379 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:54.377+0000 7f73e16a2640 1 -- 172.21.15.150:0/26361510 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f73dc0b2060 con 0x7f73dc0b9f20 2024-09-17T05:50:54.380 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:54.377+0000 7f73da7fc640 1 --2- 172.21.15.150:0/26361510 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f73dc0b3510 0x7f73dc14fc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:50:54.380 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:54.378+0000 7f73db7fe640 1 --2- 172.21.15.150:0/26361510 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f73dc0b9f20 0x7f73dc1f5b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:50:54.380 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:54.378+0000 7f73daffd640 1 -- 172.21.15.150:0/26361510 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f73dc0b9f20 msgr2=0x7f73dc1f5b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:50:54.380 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:54.378+0000 7f73daffd640 1 --2- 172.21.15.150:0/26361510 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f73dc0b9f20 0x7f73dc1f5b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:50:54.381 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:54.378+0000 7f73daffd640 1 -- 172.21.15.150:0/26361510 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f73dc0b3510 msgr2=0x7f73dc14fc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:50:54.381 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:54.378+0000 7f73daffd640 1 --2- 172.21.15.150:0/26361510 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f73dc0b3510 0x7f73dc14fc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:50:54.381 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:54.378+0000 7f73daffd640 1 -- 172.21.15.150:0/26361510 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f73dc15d3b0 con 0x7f73dc0b13c0 2024-09-17T05:50:54.381 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:54.379+0000 7f73daffd640 1 --2- 172.21.15.150:0/26361510 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f73dc0b13c0 0x7f73dc15cb80 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7f73cc009920 tx=0x7f73cc033d60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:50:54.381 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:54.379+0000 7f73c37fe640 1 -- 172.21.15.150:0/26361510 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f73cc031d60 con 0x7f73dc0b13c0 2024-09-17T05:50:54.381 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:54.379+0000 7f73c37fe640 1 -- 172.21.15.150:0/26361510 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f73cc005020 con 0x7f73dc0b13c0 2024-09-17T05:50:54.382 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:54.379+0000 7f73e16a2640 1 -- 172.21.15.150:0/26361510 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f73dc15d690 con 0x7f73dc0b13c0 2024-09-17T05:50:54.382 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:54.379+0000 7f73c37fe640 1 -- 172.21.15.150:0/26361510 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f73cc005470 con 0x7f73dc0b13c0 2024-09-17T05:50:54.383 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:54.380+0000 7f73e16a2640 1 -- 172.21.15.150:0/26361510 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f73dc15dc50 con 0x7f73dc0b13c0 2024-09-17T05:50:54.383 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:54.381+0000 7f73e16a2640 1 -- 172.21.15.150:0/26361510 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f73dc0b2510 con 0x7f73dc0b13c0 2024-09-17T05:50:54.385 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:54.383+0000 7f73c37fe640 1 -- 172.21.15.150:0/26361510 <== mon.1 v2:172.21.15.176:3300/0 4 ==== mgrmap(e 36) ==== 103736+0+0 (secure 0 0 0) 0x7f73cc065930 con 0x7f73dc0b13c0 2024-09-17T05:50:54.385 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:54.384+0000 7f73c37fe640 1 --2- 172.21.15.150:0/26361510 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f73c807a560 0x7f73c807ca70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:50:54.385 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:54.384+0000 7f73c37fe640 1 -- 172.21.15.150:0/26361510 <== mon.1 v2:172.21.15.176:3300/0 5 ==== osd_map(101..101 src has 1..101) ==== 5821+0+0 (secure 0 0 0) 0x7f73cc0bada0 con 0x7f73dc0b13c0 2024-09-17T05:50:54.392 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:54.388+0000 7f73da7fc640 1 --2- 172.21.15.150:0/26361510 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f73c807a560 0x7f73c807ca70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:50:54.392 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:54.391+0000 7f73da7fc640 1 --2- 172.21.15.150:0/26361510 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f73c807a560 0x7f73c807ca70 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7f73dc0a2560 tx=0x7f73d0009060 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:50:54.398 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:54.393+0000 7f73c37fe640 1 -- 172.21.15.150:0/26361510 <== mon.1 v2:172.21.15.176:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f73cc03f030 con 0x7f73dc0b13c0 2024-09-17T05:50:54.643 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:54.641+0000 7f73e16a2640 1 -- 172.21.15.150:0/26361510 --> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] -- mgr_command(tid 0: {"prefix": "fs clone status", "vol_name": "cephfs", "clone_name": "ss1clone1", "target": ["mon-mgr", ""]}) -- 0x7f73dc0d52d0 con 0x7f73c807a560 2024-09-17T05:50:56.681 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-17T05:50:56.684 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-17T05:50:56.964 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:56.962+0000 7f73c37fe640 1 -- 172.21.15.150:0/26361510 <== mgr.4108 v2:172.21.15.176:6800/3631216395 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+46 (secure 0 0 0) 0x7f73dc0d52d0 con 0x7f73c807a560 2024-09-17T05:50:56.964 INFO:teuthology.orchestra.run.smithi150.stdout:{ 2024-09-17T05:50:56.964 INFO:teuthology.orchestra.run.smithi150.stdout: "status": { 2024-09-17T05:50:56.964 INFO:teuthology.orchestra.run.smithi150.stdout: "state": "complete" 2024-09-17T05:50:56.964 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-09-17T05:50:56.965 INFO:teuthology.orchestra.run.smithi150.stdout:} 2024-09-17T05:50:56.967 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:56.965+0000 7f73e16a2640 1 -- 172.21.15.150:0/26361510 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f73c807a560 msgr2=0x7f73c807ca70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:50:56.967 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:56.965+0000 7f73e16a2640 1 --2- 172.21.15.150:0/26361510 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f73c807a560 0x7f73c807ca70 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7f73dc0a2560 tx=0x7f73d0009060 comp rx=0 tx=0).stop 2024-09-17T05:50:56.967 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:56.965+0000 7f73e16a2640 1 -- 172.21.15.150:0/26361510 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f73dc0b13c0 msgr2=0x7f73dc15cb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:50:56.967 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:56.965+0000 7f73e16a2640 1 --2- 172.21.15.150:0/26361510 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f73dc0b13c0 0x7f73dc15cb80 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7f73cc009920 tx=0x7f73cc033d60 comp rx=0 tx=0).stop 2024-09-17T05:50:56.967 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:56.965+0000 7f73e16a2640 1 -- 172.21.15.150:0/26361510 shutdown_connections 2024-09-17T05:50:56.968 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:56.965+0000 7f73e16a2640 1 --2- 172.21.15.150:0/26361510 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f73c807a560 0x7f73c807ca70 unknown :-1 s=CLOSED pgs=594 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:50:56.968 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:56.965+0000 7f73e16a2640 1 --2- 172.21.15.150:0/26361510 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f73dc0b9f20 0x7f73dc1f5b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:50:56.968 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:56.965+0000 7f73e16a2640 1 --2- 172.21.15.150:0/26361510 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f73dc0b3510 0x7f73dc14fc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:50:56.968 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:56.965+0000 7f73e16a2640 1 --2- 172.21.15.150:0/26361510 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f73dc0b13c0 0x7f73dc15cb80 unknown :-1 s=CLOSED pgs=492 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:50:56.968 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:56.965+0000 7f73e16a2640 1 -- 172.21.15.150:0/26361510 >> 172.21.15.150:0/26361510 conn(0x7f73dc0d46e0 msgr2=0x7f73dc06ee30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:50:56.968 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:56.965+0000 7f73e16a2640 1 -- 172.21.15.150:0/26361510 shutdown_connections 2024-09-17T05:50:56.968 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:56.965+0000 7f73e16a2640 1 -- 172.21.15.150:0/26361510 wait complete. 2024-09-17T05:50:56.981 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs clone status cephfs ss1clone1 2024-09-17T05:50:57.104 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:57.102+0000 7fe2e7cf2640 1 -- 172.21.15.150:0/3329603999 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe2e00b7d70 msgr2=0x7fe2e00d0a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:50:57.104 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:57.102+0000 7fe2e7cf2640 1 --2- 172.21.15.150:0/3329603999 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe2e00b7d70 0x7fe2e00d0a80 secure :-1 s=READY pgs=1385 cs=0 l=1 rev1=1 crypto rx=0x7fe2d0009830 tx=0x7fe2d002a4a0 comp rx=0 tx=0).stop 2024-09-17T05:50:57.105 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:57.102+0000 7fe2e7cf2640 1 -- 172.21.15.150:0/3329603999 shutdown_connections 2024-09-17T05:50:57.105 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:57.102+0000 7fe2e7cf2640 1 --2- 172.21.15.150:0/3329603999 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe2e00b7d70 0x7fe2e00d0a80 unknown :-1 s=CLOSED pgs=1385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:50:57.105 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:57.102+0000 7fe2e7cf2640 1 -- 172.21.15.150:0/3329603999 >> 172.21.15.150:0/3329603999 conn(0x7fe2e00cef20 msgr2=0x7fe2e00cf330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:50:57.105 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:57.102+0000 7fe2e7cf2640 1 -- 172.21.15.150:0/3329603999 shutdown_connections 2024-09-17T05:50:57.105 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:57.102+0000 7fe2e7cf2640 1 -- 172.21.15.150:0/3329603999 wait complete. 2024-09-17T05:50:57.105 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:57.104+0000 7fe2e7cf2640 1 Processor -- start 2024-09-17T05:50:57.106 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:57.104+0000 7fe2e7cf2640 1 -- start start 2024-09-17T05:50:57.108 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:57.105+0000 7fe2e7cf2640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe2e00b7960 0x7fe2e00b7220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:50:57.108 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:57.105+0000 7fe2e7cf2640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe2e00b7d70 0x7fe2e01f6d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:50:57.108 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:57.105+0000 7fe2e7cf2640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe2e00d0fc0 0x7fe2e01f72d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:50:57.109 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:57.105+0000 7fe2e7cf2640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7fe2e00af900 con 0x7fe2e00d0fc0 2024-09-17T05:50:57.109 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:57.105+0000 7fe2e7cf2640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fe2e00ceb90 con 0x7fe2e00b7960 2024-09-17T05:50:57.109 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:57.105+0000 7fe2e7cf2640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fe2e0155580 con 0x7fe2e00b7d70 2024-09-17T05:50:57.109 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:57.105+0000 7fe2e628f640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe2e00d0fc0 0x7fe2e01f72d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:50:57.109 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:57.105+0000 7fe2e628f640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe2e00d0fc0 0x7fe2e01f72d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:58170/0 (socket says 172.21.15.150:58170) 2024-09-17T05:50:57.109 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:57.105+0000 7fe2e628f640 1 -- 172.21.15.150:0/2388401805 learned_addr learned my addr 172.21.15.150:0/2388401805 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:50:57.109 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:57.106+0000 7fe2e5a8e640 1 --2- 172.21.15.150:0/2388401805 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe2e00b7960 0x7fe2e00b7220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:50:57.110 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:57.106+0000 7fe2e528d640 1 --2- 172.21.15.150:0/2388401805 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe2e00b7d70 0x7fe2e01f6d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:50:57.110 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:57.106+0000 7fe2e628f640 1 -- 172.21.15.150:0/2388401805 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe2e00b7d70 msgr2=0x7fe2e01f6d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:50:57.110 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:57.106+0000 7fe2e628f640 1 --2- 172.21.15.150:0/2388401805 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe2e00b7d70 0x7fe2e01f6d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:50:57.110 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:57.106+0000 7fe2e628f640 1 -- 172.21.15.150:0/2388401805 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe2e00b7960 msgr2=0x7fe2e00b7220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:50:57.110 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:57.106+0000 7fe2e628f640 1 --2- 172.21.15.150:0/2388401805 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe2e00b7960 0x7fe2e00b7220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:50:57.111 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:57.106+0000 7fe2e628f640 1 -- 172.21.15.150:0/2388401805 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe2e015def0 con 0x7fe2e00d0fc0 2024-09-17T05:50:57.111 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:57.106+0000 7fe2e628f640 1 --2- 172.21.15.150:0/2388401805 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe2e00d0fc0 0x7fe2e01f72d0 secure :-1 s=READY pgs=1386 cs=0 l=1 rev1=1 crypto rx=0x7fe2d800c700 tx=0x7fe2d800cbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:50:57.111 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:57.106+0000 7fe2d67fc640 1 -- 172.21.15.150:0/2388401805 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2d8003b70 con 0x7fe2e00d0fc0 2024-09-17T05:50:57.111 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:57.106+0000 7fe2d67fc640 1 -- 172.21.15.150:0/2388401805 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe2d8003d10 con 0x7fe2e00d0fc0 2024-09-17T05:50:57.111 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:57.106+0000 7fe2d67fc640 1 -- 172.21.15.150:0/2388401805 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2d800aab0 con 0x7fe2e00d0fc0 2024-09-17T05:50:57.112 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:57.106+0000 7fe2e7cf2640 1 -- 172.21.15.150:0/2388401805 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe2e015e1d0 con 0x7fe2e00d0fc0 2024-09-17T05:50:57.112 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:57.106+0000 7fe2e7cf2640 1 -- 172.21.15.150:0/2388401805 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe2e015ae10 con 0x7fe2e00d0fc0 2024-09-17T05:50:57.113 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:57.107+0000 7fe2e7cf2640 1 -- 172.21.15.150:0/2388401805 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe2e00d0a80 con 0x7fe2e00d0fc0 2024-09-17T05:50:57.113 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:57.108+0000 7fe2d67fc640 1 -- 172.21.15.150:0/2388401805 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 36) ==== 103736+0+0 (secure 0 0 0) 0x7fe2d800ac50 con 0x7fe2e00d0fc0 2024-09-17T05:50:57.113 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:57.108+0000 7fe2d67fc640 1 --2- 172.21.15.150:0/2388401805 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fe2c407a4e0 0x7fe2c407c9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:50:57.113 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:57.108+0000 7fe2d67fc640 1 -- 172.21.15.150:0/2388401805 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(101..101 src has 1..101) ==== 5821+0+0 (secure 0 0 0) 0x7fe2d8099930 con 0x7fe2e00d0fc0 2024-09-17T05:50:57.113 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:57.109+0000 7fe2e5a8e640 1 --2- 172.21.15.150:0/2388401805 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fe2c407a4e0 0x7fe2c407c9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:50:57.114 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:57.109+0000 7fe2e5a8e640 1 --2- 172.21.15.150:0/2388401805 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fe2c407a4e0 0x7fe2c407c9f0 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7fe2dc007a50 tx=0x7fe2dc009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:50:57.114 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:57.113+0000 7fe2d67fc640 1 -- 172.21.15.150:0/2388401805 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fe2d8063870 con 0x7fe2e00d0fc0 2024-09-17T05:50:57.323 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:57.323+0000 7fe2e7cf2640 1 -- 172.21.15.150:0/2388401805 --> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] -- mgr_command(tid 0: {"prefix": "fs clone status", "vol_name": "cephfs", "clone_name": "ss1clone1", "target": ["mon-mgr", ""]}) -- 0x7fe2e0072810 con 0x7fe2c407a4e0 2024-09-17T05:50:57.330 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:57.329+0000 7fe2d67fc640 1 -- 172.21.15.150:0/2388401805 <== mgr.4108 v2:172.21.15.176:6800/3631216395 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+46 (secure 0 0 0) 0x7fe2e0072810 con 0x7fe2c407a4e0 2024-09-17T05:50:57.330 INFO:teuthology.orchestra.run.smithi150.stdout:{ 2024-09-17T05:50:57.330 INFO:teuthology.orchestra.run.smithi150.stdout: "status": { 2024-09-17T05:50:57.330 INFO:teuthology.orchestra.run.smithi150.stdout: "state": "complete" 2024-09-17T05:50:57.330 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-09-17T05:50:57.330 INFO:teuthology.orchestra.run.smithi150.stdout:} 2024-09-17T05:50:57.332 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:57.331+0000 7fe2e7cf2640 1 -- 172.21.15.150:0/2388401805 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fe2c407a4e0 msgr2=0x7fe2c407c9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:50:57.332 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:57.331+0000 7fe2e7cf2640 1 --2- 172.21.15.150:0/2388401805 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fe2c407a4e0 0x7fe2c407c9f0 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7fe2dc007a50 tx=0x7fe2dc009040 comp rx=0 tx=0).stop 2024-09-17T05:50:57.333 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:57.331+0000 7fe2e7cf2640 1 -- 172.21.15.150:0/2388401805 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe2e00d0fc0 msgr2=0x7fe2e01f72d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:50:57.333 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:57.331+0000 7fe2e7cf2640 1 --2- 172.21.15.150:0/2388401805 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe2e00d0fc0 0x7fe2e01f72d0 secure :-1 s=READY pgs=1386 cs=0 l=1 rev1=1 crypto rx=0x7fe2d800c700 tx=0x7fe2d800cbc0 comp rx=0 tx=0).stop 2024-09-17T05:50:57.333 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:57.331+0000 7fe2e7cf2640 1 -- 172.21.15.150:0/2388401805 shutdown_connections 2024-09-17T05:50:57.333 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:57.331+0000 7fe2e7cf2640 1 --2- 172.21.15.150:0/2388401805 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fe2c407a4e0 0x7fe2c407c9f0 unknown :-1 s=CLOSED pgs=595 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:50:57.333 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:57.331+0000 7fe2e7cf2640 1 --2- 172.21.15.150:0/2388401805 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe2e00d0fc0 0x7fe2e01f72d0 unknown :-1 s=CLOSED pgs=1386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:50:57.333 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:57.331+0000 7fe2e7cf2640 1 --2- 172.21.15.150:0/2388401805 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe2e00b7d70 0x7fe2e01f6d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:50:57.333 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:57.331+0000 7fe2e7cf2640 1 --2- 172.21.15.150:0/2388401805 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe2e00b7960 0x7fe2e00b7220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:50:57.333 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:57.331+0000 7fe2e7cf2640 1 -- 172.21.15.150:0/2388401805 >> 172.21.15.150:0/2388401805 conn(0x7fe2e00cef20 msgr2=0x7fe2e0072d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:50:57.333 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:57.331+0000 7fe2e7cf2640 1 -- 172.21.15.150:0/2388401805 shutdown_connections 2024-09-17T05:50:57.333 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:57.332+0000 7fe2e7cf2640 1 -- 172.21.15.150:0/2388401805 wait complete. 2024-09-17T05:50:57.344 DEBUG:tasks.cephfs.test_volumes:current clone state = complete 2024-09-17T05:50:57.344 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume ls 2024-09-17T05:50:57.458 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:57.457+0000 7fda847c6640 1 -- 172.21.15.150:0/3655898286 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fda7c0c5a90 msgr2=0x7fda7c160850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:50:57.458 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:57.457+0000 7fda847c6640 1 --2- 172.21.15.150:0/3655898286 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fda7c0c5a90 0x7fda7c160850 secure :-1 s=READY pgs=1387 cs=0 l=1 rev1=1 crypto rx=0x7fda6c005fd0 tx=0x7fda6c02a530 comp rx=0 tx=0).stop 2024-09-17T05:50:57.458 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:57.457+0000 7fda847c6640 1 -- 172.21.15.150:0/3655898286 shutdown_connections 2024-09-17T05:50:57.458 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:57.457+0000 7fda847c6640 1 --2- 172.21.15.150:0/3655898286 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fda7c0c5a90 0x7fda7c160850 unknown :-1 s=CLOSED pgs=1387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:50:57.458 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:57.457+0000 7fda847c6640 1 --2- 172.21.15.150:0/3655898286 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fda7c0cea50 0x7fda7c0d0270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:50:57.458 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:57.457+0000 7fda847c6640 1 -- 172.21.15.150:0/3655898286 >> 172.21.15.150:0/3655898286 conn(0x7fda7c0cee80 msgr2=0x7fda7c0cf290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:50:57.458 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:57.457+0000 7fda847c6640 1 -- 172.21.15.150:0/3655898286 shutdown_connections 2024-09-17T05:50:57.458 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:57.457+0000 7fda847c6640 1 -- 172.21.15.150:0/3655898286 wait complete. 2024-09-17T05:50:57.459 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:57.459+0000 7fda847c6640 1 Processor -- start 2024-09-17T05:50:57.459 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:57.459+0000 7fda847c6640 1 -- start start 2024-09-17T05:50:57.462 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:57.460+0000 7fda847c6640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fda7c0c5a90 0x7fda7c09f830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:50:57.462 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:57.460+0000 7fda847c6640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fda7c0cea50 0x7fda7c158fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:50:57.462 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:57.460+0000 7fda847c6640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fda7c160d90 0x7fda7c0af0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:50:57.462 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:57.460+0000 7fda847c6640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7fda7c161320 con 0x7fda7c0c5a90 2024-09-17T05:50:57.462 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:57.460+0000 7fda847c6640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fda7c1611a0 con 0x7fda7c160d90 2024-09-17T05:50:57.462 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:57.460+0000 7fda847c6640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fda7c1614a0 con 0x7fda7c0cea50 2024-09-17T05:50:57.462 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:57.460+0000 7fda82562640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fda7c0c5a90 0x7fda7c09f830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:50:57.463 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:57.460+0000 7fda82562640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fda7c0c5a90 0x7fda7c09f830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:58198/0 (socket says 172.21.15.150:58198) 2024-09-17T05:50:57.463 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:57.460+0000 7fda82562640 1 -- 172.21.15.150:0/1219402919 learned_addr learned my addr 172.21.15.150:0/1219402919 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:50:57.463 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:57.460+0000 7fda82d63640 1 --2- 172.21.15.150:0/1219402919 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fda7c160d90 0x7fda7c0af0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:50:57.463 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:57.460+0000 7fda81d61640 1 --2- 172.21.15.150:0/1219402919 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fda7c0cea50 0x7fda7c158fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:50:57.463 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:57.460+0000 7fda82562640 1 -- 172.21.15.150:0/1219402919 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fda7c0cea50 msgr2=0x7fda7c158fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:50:57.463 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:57.460+0000 7fda82562640 1 --2- 172.21.15.150:0/1219402919 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fda7c0cea50 0x7fda7c158fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:50:57.463 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:57.460+0000 7fda82562640 1 -- 172.21.15.150:0/1219402919 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fda7c160d90 msgr2=0x7fda7c0af0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:50:57.463 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:57.460+0000 7fda82562640 1 --2- 172.21.15.150:0/1219402919 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fda7c160d90 0x7fda7c0af0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:50:57.463 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:57.460+0000 7fda82562640 1 -- 172.21.15.150:0/1219402919 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fda7c09e790 con 0x7fda7c0c5a90 2024-09-17T05:50:57.463 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:57.460+0000 7fda81d61640 1 --2- 172.21.15.150:0/1219402919 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fda7c0cea50 0x7fda7c158fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T05:50:57.464 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:57.460+0000 7fda82562640 1 --2- 172.21.15.150:0/1219402919 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fda7c0c5a90 0x7fda7c09f830 secure :-1 s=READY pgs=1388 cs=0 l=1 rev1=1 crypto rx=0x7fda7800c970 tx=0x7fda7800ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:50:57.464 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:57.461+0000 7fda72ffd640 1 -- 172.21.15.150:0/1219402919 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda78007bb0 con 0x7fda7c0c5a90 2024-09-17T05:50:57.464 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:57.461+0000 7fda72ffd640 1 -- 172.21.15.150:0/1219402919 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fda78007d50 con 0x7fda7c0c5a90 2024-09-17T05:50:57.464 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:57.461+0000 7fda847c6640 1 -- 172.21.15.150:0/1219402919 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fda7c09ea70 con 0x7fda7c0c5a90 2024-09-17T05:50:57.464 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:57.461+0000 7fda72ffd640 1 -- 172.21.15.150:0/1219402919 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda78005290 con 0x7fda7c0c5a90 2024-09-17T05:50:57.464 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:57.461+0000 7fda847c6640 1 -- 172.21.15.150:0/1219402919 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fda7c09f030 con 0x7fda7c0c5a90 2024-09-17T05:50:57.464 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:57.462+0000 7fda847c6640 1 -- 172.21.15.150:0/1219402919 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fda7c160850 con 0x7fda7c0c5a90 2024-09-17T05:50:57.465 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:57.462+0000 7fda72ffd640 1 -- 172.21.15.150:0/1219402919 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 36) ==== 103736+0+0 (secure 0 0 0) 0x7fda78005430 con 0x7fda7c0c5a90 2024-09-17T05:50:57.466 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:57.463+0000 7fda72ffd640 1 --2- 172.21.15.150:0/1219402919 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fda6007a4e0 0x7fda6007c9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:50:57.466 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:57.463+0000 7fda72ffd640 1 -- 172.21.15.150:0/1219402919 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(101..101 src has 1..101) ==== 5821+0+0 (secure 0 0 0) 0x7fda7809a080 con 0x7fda7c0c5a90 2024-09-17T05:50:57.468 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:57.463+0000 7fda81d61640 1 --2- 172.21.15.150:0/1219402919 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fda6007a4e0 0x7fda6007c9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:50:57.468 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:57.464+0000 7fda81d61640 1 --2- 172.21.15.150:0/1219402919 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fda6007a4e0 0x7fda6007c9f0 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7fda6c033000 tx=0x7fda6c004730 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:50:57.469 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:57.467+0000 7fda72ffd640 1 -- 172.21.15.150:0/1219402919 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fda78014070 con 0x7fda7c0c5a90 2024-09-17T05:50:57.670 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:57.669+0000 7fda847c6640 1 -- 172.21.15.150:0/1219402919 --> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] -- mgr_command(tid 0: {"prefix": "fs volume ls", "target": ["mon-mgr", ""]}) -- 0x7fda7c159520 con 0x7fda6007a4e0 2024-09-17T05:50:57.671 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:57.671+0000 7fda72ffd640 1 -- 172.21.15.150:0/1219402919 <== mgr.4108 v2:172.21.15.176:6800/3631216395 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+41 (secure 0 0 0) 0x7fda7c159520 con 0x7fda6007a4e0 2024-09-17T05:50:57.672 INFO:teuthology.orchestra.run.smithi150.stdout:[ 2024-09-17T05:50:57.672 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-09-17T05:50:57.672 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "cephfs" 2024-09-17T05:50:57.672 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-09-17T05:50:57.672 INFO:teuthology.orchestra.run.smithi150.stdout:] 2024-09-17T05:50:57.674 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:57.673+0000 7fda847c6640 1 -- 172.21.15.150:0/1219402919 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fda6007a4e0 msgr2=0x7fda6007c9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:50:57.674 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:57.673+0000 7fda847c6640 1 --2- 172.21.15.150:0/1219402919 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fda6007a4e0 0x7fda6007c9f0 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7fda6c033000 tx=0x7fda6c004730 comp rx=0 tx=0).stop 2024-09-17T05:50:57.674 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:57.673+0000 7fda847c6640 1 -- 172.21.15.150:0/1219402919 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fda7c0c5a90 msgr2=0x7fda7c09f830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:50:57.674 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:57.673+0000 7fda847c6640 1 --2- 172.21.15.150:0/1219402919 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fda7c0c5a90 0x7fda7c09f830 secure :-1 s=READY pgs=1388 cs=0 l=1 rev1=1 crypto rx=0x7fda7800c970 tx=0x7fda7800ce30 comp rx=0 tx=0).stop 2024-09-17T05:50:57.674 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:57.673+0000 7fda847c6640 1 -- 172.21.15.150:0/1219402919 shutdown_connections 2024-09-17T05:50:57.675 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:57.673+0000 7fda847c6640 1 --2- 172.21.15.150:0/1219402919 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fda7c160d90 0x7fda7c0af0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:50:57.675 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:57.673+0000 7fda847c6640 1 --2- 172.21.15.150:0/1219402919 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fda6007a4e0 0x7fda6007c9f0 unknown :-1 s=CLOSED pgs=596 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:50:57.675 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:57.673+0000 7fda847c6640 1 --2- 172.21.15.150:0/1219402919 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fda7c0cea50 0x7fda7c158fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:50:57.675 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:57.673+0000 7fda847c6640 1 --2- 172.21.15.150:0/1219402919 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fda7c0c5a90 0x7fda7c09f830 unknown :-1 s=CLOSED pgs=1388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:50:57.675 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:57.673+0000 7fda847c6640 1 -- 172.21.15.150:0/1219402919 >> 172.21.15.150:0/1219402919 conn(0x7fda7c0cee80 msgr2=0x7fda7c15ca80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:50:57.675 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:57.673+0000 7fda847c6640 1 -- 172.21.15.150:0/1219402919 shutdown_connections 2024-09-17T05:50:57.675 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:57.673+0000 7fda847c6640 1 -- 172.21.15.150:0/1219402919 wait complete. 2024-09-17T05:50:57.686 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume ls cephfs --format json 2024-09-17T05:50:57.801 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:57.800+0000 7f9825f41640 1 -- 172.21.15.150:0/1246396648 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f98200b0fe0 msgr2=0x7f98200b13f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:50:57.801 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:57.800+0000 7f9825f41640 1 --2- 172.21.15.150:0/1246396648 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f98200b0fe0 0x7f98200b13f0 secure :-1 s=READY pgs=1390 cs=0 l=1 rev1=1 crypto rx=0x7f9820073060 tx=0x7f981402a790 comp rx=0 tx=0).stop 2024-09-17T05:50:57.801 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:57.800+0000 7f9825f41640 1 -- 172.21.15.150:0/1246396648 shutdown_connections 2024-09-17T05:50:57.801 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:57.800+0000 7f9825f41640 1 --2- 172.21.15.150:0/1246396648 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f98200b0fe0 0x7f98200b13f0 unknown :-1 s=CLOSED pgs=1390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:50:57.802 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:57.800+0000 7f9825f41640 1 --2- 172.21.15.150:0/1246396648 >> v2:172.21.15.176:3300/0 conn(0x7f98200b25e0 0x7f98200b1ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:50:57.802 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:57.800+0000 7f9825f41640 1 -- 172.21.15.150:0/1246396648 >> 172.21.15.150:0/1246396648 conn(0x7f98200b2ff0 msgr2=0x7f98200b3400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:50:57.802 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:57.800+0000 7f9825f41640 1 -- 172.21.15.150:0/1246396648 shutdown_connections 2024-09-17T05:50:57.802 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:57.800+0000 7f9825f41640 1 -- 172.21.15.150:0/1246396648 wait complete. 2024-09-17T05:50:57.802 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:57.802+0000 7f9825f41640 1 Processor -- start 2024-09-17T05:50:57.803 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:57.802+0000 7f9825f41640 1 -- start start 2024-09-17T05:50:57.806 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:57.803+0000 7f9825f41640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f98200b0fe0 0x7f98201f0860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:50:57.806 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:57.803+0000 7f9825f41640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f98200b25e0 0x7f982015eb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:50:57.806 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:57.803+0000 7f9825f41640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f982015fa30 0x7f982015f0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:50:57.806 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:57.803+0000 7f9825f41640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f98200ae740 con 0x7f982015fa30 2024-09-17T05:50:57.806 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:57.803+0000 7f9825f41640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f98200ae5c0 con 0x7f98200b0fe0 2024-09-17T05:50:57.806 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:57.803+0000 7f9825f41640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f98200ae8c0 con 0x7f98200b25e0 2024-09-17T05:50:57.806 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:57.803+0000 7f981ffff640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f982015fa30 0x7f982015f0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:50:57.806 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:57.803+0000 7f981ffff640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f982015fa30 0x7f982015f0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:58210/0 (socket says 172.21.15.150:58210) 2024-09-17T05:50:57.806 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:57.804+0000 7f981ffff640 1 -- 172.21.15.150:0/84276065 learned_addr learned my addr 172.21.15.150:0/84276065 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:50:57.806 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:57.804+0000 7f981f7fe640 1 --2- 172.21.15.150:0/84276065 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f98200b0fe0 0x7f98201f0860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:50:57.806 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:57.804+0000 7f981effd640 1 --2- 172.21.15.150:0/84276065 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f98200b25e0 0x7f982015eb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:50:57.806 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:57.804+0000 7f981ffff640 1 -- 172.21.15.150:0/84276065 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f98200b25e0 msgr2=0x7f982015eb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:50:57.807 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:57.804+0000 7f981ffff640 1 --2- 172.21.15.150:0/84276065 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f98200b25e0 0x7f982015eb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:50:57.807 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:57.804+0000 7f981ffff640 1 -- 172.21.15.150:0/84276065 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f98200b0fe0 msgr2=0x7f98201f0860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:50:57.807 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:57.804+0000 7f981ffff640 1 --2- 172.21.15.150:0/84276065 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f98200b0fe0 0x7f98201f0860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:50:57.807 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:57.804+0000 7f981ffff640 1 -- 172.21.15.150:0/84276065 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f98201f6aa0 con 0x7f982015fa30 2024-09-17T05:50:57.807 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:57.804+0000 7f981effd640 1 --2- 172.21.15.150:0/84276065 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f98200b25e0 0x7f982015eb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T05:50:57.807 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:57.804+0000 7f981f7fe640 1 --2- 172.21.15.150:0/84276065 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f98200b0fe0 0x7f98201f0860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:50:57.807 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:57.804+0000 7f981ffff640 1 --2- 172.21.15.150:0/84276065 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f982015fa30 0x7f982015f0d0 secure :-1 s=READY pgs=1391 cs=0 l=1 rev1=1 crypto rx=0x7f981800c390 tx=0x7f981800c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:50:57.807 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:57.804+0000 7f9807fff640 1 -- 172.21.15.150:0/84276065 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9818011790 con 0x7f982015fa30 2024-09-17T05:50:57.807 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:57.804+0000 7f9807fff640 1 -- 172.21.15.150:0/84276065 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9818017070 con 0x7f982015fa30 2024-09-17T05:50:57.807 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:57.804+0000 7f9825f41640 1 -- 172.21.15.150:0/84276065 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f98201f4330 con 0x7f982015fa30 2024-09-17T05:50:57.807 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:57.804+0000 7f9807fff640 1 -- 172.21.15.150:0/84276065 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9818011c40 con 0x7f982015fa30 2024-09-17T05:50:57.807 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:57.804+0000 7f9825f41640 1 -- 172.21.15.150:0/84276065 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f98201f7020 con 0x7f982015fa30 2024-09-17T05:50:57.807 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:57.805+0000 7f9825f41640 1 -- 172.21.15.150:0/84276065 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f98200b13f0 con 0x7f982015fa30 2024-09-17T05:50:57.808 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:57.806+0000 7f9807fff640 1 -- 172.21.15.150:0/84276065 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 36) ==== 103736+0+0 (secure 0 0 0) 0x7f981801c460 con 0x7f982015fa30 2024-09-17T05:50:57.808 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:57.806+0000 7f9807fff640 1 --2- 172.21.15.150:0/84276065 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f980c07a4e0 0x7f980c07c9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:50:57.808 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:57.807+0000 7f9807fff640 1 -- 172.21.15.150:0/84276065 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(101..101 src has 1..101) ==== 5821+0+0 (secure 0 0 0) 0x7f98180997f0 con 0x7f982015fa30 2024-09-17T05:50:57.809 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:57.807+0000 7f981f7fe640 1 --2- 172.21.15.150:0/84276065 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f980c07a4e0 0x7f980c07c9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:50:57.809 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:57.807+0000 7f981f7fe640 1 --2- 172.21.15.150:0/84276065 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f980c07a4e0 0x7f980c07c9f0 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7f9810005fd0 tx=0x7f981000f360 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:50:57.812 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:57.811+0000 7f9807fff640 1 -- 172.21.15.150:0/84276065 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f98180637c0 con 0x7f982015fa30 2024-09-17T05:50:58.013 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:58.012+0000 7f9825f41640 1 -- 172.21.15.150:0/84276065 --> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] -- mgr_command(tid 0: {"prefix": "fs subvolume ls", "vol_name": "cephfs", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f98200b0950 con 0x7f980c07a4e0 2024-09-17T05:50:58.018 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:58.018+0000 7f9807fff640 1 -- 172.21.15.150:0/84276065 <== mgr.4108 v2:172.21.15.176:6800/3631216395 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+79 (secure 0 0 0) 0x7f98200b0950 con 0x7f980c07a4e0 2024-09-17T05:50:58.019 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-09-17T05:50:58.019 INFO:teuthology.orchestra.run.smithi150.stdout:[ 2024-09-17T05:50:58.019 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-09-17T05:50:58.019 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "sv1" 2024-09-17T05:50:58.019 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-17T05:50:58.019 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-09-17T05:50:58.019 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "ss1clone1" 2024-09-17T05:50:58.019 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-09-17T05:50:58.019 INFO:teuthology.orchestra.run.smithi150.stdout:] 2024-09-17T05:50:58.021 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:58.020+0000 7f9825f41640 1 -- 172.21.15.150:0/84276065 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f980c07a4e0 msgr2=0x7f980c07c9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:50:58.021 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:58.020+0000 7f9825f41640 1 --2- 172.21.15.150:0/84276065 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f980c07a4e0 0x7f980c07c9f0 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7f9810005fd0 tx=0x7f981000f360 comp rx=0 tx=0).stop 2024-09-17T05:50:58.021 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:58.020+0000 7f9825f41640 1 -- 172.21.15.150:0/84276065 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f982015fa30 msgr2=0x7f982015f0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:50:58.021 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:58.020+0000 7f9825f41640 1 --2- 172.21.15.150:0/84276065 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f982015fa30 0x7f982015f0d0 secure :-1 s=READY pgs=1391 cs=0 l=1 rev1=1 crypto rx=0x7f981800c390 tx=0x7f981800c850 comp rx=0 tx=0).stop 2024-09-17T05:50:58.021 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:58.020+0000 7f9825f41640 1 -- 172.21.15.150:0/84276065 shutdown_connections 2024-09-17T05:50:58.021 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:58.020+0000 7f9825f41640 1 --2- 172.21.15.150:0/84276065 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f980c07a4e0 0x7f980c07c9f0 unknown :-1 s=CLOSED pgs=597 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:50:58.021 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:58.020+0000 7f9825f41640 1 --2- 172.21.15.150:0/84276065 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f982015fa30 0x7f982015f0d0 unknown :-1 s=CLOSED pgs=1391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:50:58.021 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:58.020+0000 7f9825f41640 1 --2- 172.21.15.150:0/84276065 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f98200b25e0 0x7f982015eb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:50:58.022 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:58.020+0000 7f9825f41640 1 --2- 172.21.15.150:0/84276065 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f98200b0fe0 0x7f98201f0860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:50:58.022 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:58.020+0000 7f9825f41640 1 -- 172.21.15.150:0/84276065 >> 172.21.15.150:0/84276065 conn(0x7f98200b2ff0 msgr2=0x7f98200b6300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:50:58.022 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:58.020+0000 7f9825f41640 1 -- 172.21.15.150:0/84276065 shutdown_connections 2024-09-17T05:50:58.022 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:58.020+0000 7f9825f41640 1 -- 172.21.15.150:0/84276065 wait complete. 2024-09-17T05:50:58.032 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume snapshot ls cephfs sv1 --format json 2024-09-17T05:50:58.151 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:58.149+0000 7fb83640e640 1 -- 172.21.15.150:0/221866777 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb8300b7a20 msgr2=0x7fb8300d0ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:50:58.152 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:58.149+0000 7fb83640e640 1 --2- 172.21.15.150:0/221866777 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb8300b7a20 0x7fb8300d0ce0 secure :-1 s=READY pgs=1393 cs=0 l=1 rev1=1 crypto rx=0x7fb824009830 tx=0x7fb82402a510 comp rx=0 tx=0).stop 2024-09-17T05:50:58.152 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:58.150+0000 7fb83640e640 1 -- 172.21.15.150:0/221866777 shutdown_connections 2024-09-17T05:50:58.152 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:58.150+0000 7fb83640e640 1 --2- 172.21.15.150:0/221866777 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb8300b7a20 0x7fb8300d0ce0 unknown :-1 s=CLOSED pgs=1393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:50:58.152 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:58.150+0000 7fb83640e640 1 --2- 172.21.15.150:0/221866777 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb8300d03d0 0x7fb8300b1e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:50:58.152 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:58.150+0000 7fb83640e640 1 -- 172.21.15.150:0/221866777 >> 172.21.15.150:0/221866777 conn(0x7fb8300cef50 msgr2=0x7fb8300cf360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:50:58.153 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:58.150+0000 7fb83640e640 1 -- 172.21.15.150:0/221866777 shutdown_connections 2024-09-17T05:50:58.153 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:58.150+0000 7fb83640e640 1 -- 172.21.15.150:0/221866777 wait complete. 2024-09-17T05:50:58.159 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:58.151+0000 7fb83640e640 1 Processor -- start 2024-09-17T05:50:58.159 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:58.152+0000 7fb83640e640 1 -- start start 2024-09-17T05:50:58.159 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:58.153+0000 7fb83640e640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb8300b7a20 0x7fb8301f6650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:50:58.159 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:58.153+0000 7fb83640e640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb8300d03d0 0x7fb8301560c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:50:58.159 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:58.153+0000 7fb83640e640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb830160be0 0x7fb830156600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:50:58.159 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:58.153+0000 7fb83640e640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7fb8300cfe90 con 0x7fb830160be0 2024-09-17T05:50:58.159 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:58.153+0000 7fb83640e640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fb8300cfd10 con 0x7fb8300b7a20 2024-09-17T05:50:58.159 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:58.153+0000 7fb83640e640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fb8300b8300 con 0x7fb8300d03d0 2024-09-17T05:50:58.160 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:58.153+0000 7fb8349ab640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb830160be0 0x7fb830156600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:50:58.160 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:58.153+0000 7fb8349ab640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb830160be0 0x7fb830156600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:58228/0 (socket says 172.21.15.150:58228) 2024-09-17T05:50:58.160 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:58.153+0000 7fb8349ab640 1 -- 172.21.15.150:0/1544063696 learned_addr learned my addr 172.21.15.150:0/1544063696 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:50:58.160 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:58.153+0000 7fb82ffff640 1 --2- 172.21.15.150:0/1544063696 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb8300b7a20 0x7fb8301f6650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:50:58.160 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:58.153+0000 7fb82f7fe640 1 --2- 172.21.15.150:0/1544063696 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb8300d03d0 0x7fb8301560c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:50:58.160 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:58.153+0000 7fb8349ab640 1 -- 172.21.15.150:0/1544063696 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb8300d03d0 msgr2=0x7fb8301560c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:50:58.160 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:58.153+0000 7fb8349ab640 1 --2- 172.21.15.150:0/1544063696 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb8300d03d0 0x7fb8301560c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:50:58.160 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:58.153+0000 7fb8349ab640 1 -- 172.21.15.150:0/1544063696 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb8300b7a20 msgr2=0x7fb8301f6650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:50:58.160 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:58.153+0000 7fb8349ab640 1 --2- 172.21.15.150:0/1544063696 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb8300b7a20 0x7fb8301f6650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:50:58.161 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:58.153+0000 7fb8349ab640 1 -- 172.21.15.150:0/1544063696 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb8300cb0d0 con 0x7fb830160be0 2024-09-17T05:50:58.161 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:58.153+0000 7fb82f7fe640 1 --2- 172.21.15.150:0/1544063696 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb8300d03d0 0x7fb8301560c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T05:50:58.161 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:58.153+0000 7fb8349ab640 1 --2- 172.21.15.150:0/1544063696 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb830160be0 0x7fb830156600 secure :-1 s=READY pgs=1394 cs=0 l=1 rev1=1 crypto rx=0x7fb82800cb10 tx=0x7fb82800a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:50:58.161 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:58.154+0000 7fb82cff9640 1 -- 172.21.15.150:0/1544063696 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb828016020 con 0x7fb830160be0 2024-09-17T05:50:58.161 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:58.154+0000 7fb82cff9640 1 -- 172.21.15.150:0/1544063696 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb82800ad60 con 0x7fb830160be0 2024-09-17T05:50:58.161 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:58.154+0000 7fb83640e640 1 -- 172.21.15.150:0/1544063696 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb8301f6b90 con 0x7fb830160be0 2024-09-17T05:50:58.161 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:58.154+0000 7fb82cff9640 1 -- 172.21.15.150:0/1544063696 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb828012680 con 0x7fb830160be0 2024-09-17T05:50:58.161 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:58.154+0000 7fb83640e640 1 -- 172.21.15.150:0/1544063696 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb8300ca310 con 0x7fb830160be0 2024-09-17T05:50:58.162 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:58.155+0000 7fb83640e640 1 -- 172.21.15.150:0/1544063696 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb8300d1300 con 0x7fb830160be0 2024-09-17T05:50:58.162 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:58.155+0000 7fb82cff9640 1 -- 172.21.15.150:0/1544063696 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 36) ==== 103736+0+0 (secure 0 0 0) 0x7fb828019020 con 0x7fb830160be0 2024-09-17T05:50:58.162 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:58.156+0000 7fb82cff9640 1 --2- 172.21.15.150:0/1544063696 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fb81c07a4e0 0x7fb81c07c9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:50:58.162 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:58.156+0000 7fb82cff9640 1 -- 172.21.15.150:0/1544063696 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(101..101 src has 1..101) ==== 5821+0+0 (secure 0 0 0) 0x7fb828099e70 con 0x7fb830160be0 2024-09-17T05:50:58.162 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:58.156+0000 7fb82ffff640 1 --2- 172.21.15.150:0/1544063696 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fb81c07a4e0 0x7fb81c07c9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:50:58.162 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:58.157+0000 7fb82ffff640 1 --2- 172.21.15.150:0/1544063696 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fb81c07a4e0 0x7fb81c07c9f0 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7fb820005fd0 tx=0x7fb820005dc0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:50:58.163 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:58.161+0000 7fb82cff9640 1 -- 172.21.15.150:0/1544063696 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fb828020030 con 0x7fb830160be0 2024-09-17T05:50:58.366 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:58.365+0000 7fb83640e640 1 -- 172.21.15.150:0/1544063696 --> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] -- mgr_command(tid 0: {"prefix": "fs subvolume snapshot ls", "vol_name": "cephfs", "sub_name": "sv1", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fb830160250 con 0x7fb81c07a4e0 2024-09-17T05:50:58.378 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:58.378+0000 7fb82cff9640 1 -- 172.21.15.150:0/1544063696 <== mgr.4108 v2:172.21.15.176:6800/3631216395 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+38 (secure 0 0 0) 0x7fb830160250 con 0x7fb81c07a4e0 2024-09-17T05:50:58.379 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-09-17T05:50:58.379 INFO:teuthology.orchestra.run.smithi150.stdout:[ 2024-09-17T05:50:58.379 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-09-17T05:50:58.379 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "ss1" 2024-09-17T05:50:58.379 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-09-17T05:50:58.379 INFO:teuthology.orchestra.run.smithi150.stdout:] 2024-09-17T05:50:58.381 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:58.380+0000 7fb83640e640 1 -- 172.21.15.150:0/1544063696 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fb81c07a4e0 msgr2=0x7fb81c07c9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:50:58.381 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:58.380+0000 7fb83640e640 1 --2- 172.21.15.150:0/1544063696 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fb81c07a4e0 0x7fb81c07c9f0 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7fb820005fd0 tx=0x7fb820005dc0 comp rx=0 tx=0).stop 2024-09-17T05:50:58.382 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:58.380+0000 7fb83640e640 1 -- 172.21.15.150:0/1544063696 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb830160be0 msgr2=0x7fb830156600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:50:58.382 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:58.380+0000 7fb83640e640 1 --2- 172.21.15.150:0/1544063696 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb830160be0 0x7fb830156600 secure :-1 s=READY pgs=1394 cs=0 l=1 rev1=1 crypto rx=0x7fb82800cb10 tx=0x7fb82800a060 comp rx=0 tx=0).stop 2024-09-17T05:50:58.382 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:58.381+0000 7fb83640e640 1 -- 172.21.15.150:0/1544063696 shutdown_connections 2024-09-17T05:50:58.382 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:58.381+0000 7fb83640e640 1 --2- 172.21.15.150:0/1544063696 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fb81c07a4e0 0x7fb81c07c9f0 unknown :-1 s=CLOSED pgs=598 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:50:58.382 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:58.381+0000 7fb83640e640 1 --2- 172.21.15.150:0/1544063696 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb830160be0 0x7fb830156600 unknown :-1 s=CLOSED pgs=1394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:50:58.382 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:58.381+0000 7fb83640e640 1 --2- 172.21.15.150:0/1544063696 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb8300d03d0 0x7fb8301560c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:50:58.382 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:58.381+0000 7fb83640e640 1 --2- 172.21.15.150:0/1544063696 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb8300b7a20 0x7fb8301f6650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:50:58.382 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:58.381+0000 7fb83640e640 1 -- 172.21.15.150:0/1544063696 >> 172.21.15.150:0/1544063696 conn(0x7fb8300cef50 msgr2=0x7fb830071310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:50:58.382 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:58.381+0000 7fb83640e640 1 -- 172.21.15.150:0/1544063696 shutdown_connections 2024-09-17T05:50:58.382 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:58.381+0000 7fb83640e640 1 -- 172.21.15.150:0/1544063696 wait complete. 2024-09-17T05:50:58.393 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume snapshot rm --force --format json cephfs sv1 ss1 2024-09-17T05:50:58.513 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:58.512+0000 7fecdb215640 1 -- 172.21.15.150:0/294273676 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fecd40d0fc0 msgr2=0x7fecd40cd0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:50:58.513 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:58.512+0000 7fecdb215640 1 --2- 172.21.15.150:0/294273676 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fecd40d0fc0 0x7fecd40cd0e0 secure :-1 s=READY pgs=1396 cs=0 l=1 rev1=1 crypto rx=0x7fecd40cfd70 tx=0x7feccc02a790 comp rx=0 tx=0).stop 2024-09-17T05:50:58.513 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:58.512+0000 7fecdb215640 1 -- 172.21.15.150:0/294273676 shutdown_connections 2024-09-17T05:50:58.513 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:58.512+0000 7fecdb215640 1 --2- 172.21.15.150:0/294273676 >> v2:172.21.15.176:3300/0 conn(0x7fecd40b7d70 0x7fecd40d0a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:50:58.514 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:58.512+0000 7fecdb215640 1 --2- 172.21.15.150:0/294273676 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fecd40d0fc0 0x7fecd40cd0e0 unknown :-1 s=CLOSED pgs=1396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:50:58.514 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:58.512+0000 7fecdb215640 1 -- 172.21.15.150:0/294273676 >> 172.21.15.150:0/294273676 conn(0x7fecd40cef20 msgr2=0x7fecd40cf330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:50:58.514 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:58.512+0000 7fecdb215640 1 -- 172.21.15.150:0/294273676 shutdown_connections 2024-09-17T05:50:58.514 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:58.512+0000 7fecdb215640 1 -- 172.21.15.150:0/294273676 wait complete. 2024-09-17T05:50:58.515 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:58.514+0000 7fecdb215640 1 Processor -- start 2024-09-17T05:50:58.515 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:58.514+0000 7fecdb215640 1 -- start start 2024-09-17T05:50:58.518 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:58.516+0000 7fecdb215640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fecd40b7960 0x7fecd4156b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:50:58.518 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:58.516+0000 7fecdb215640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fecd40b7d70 0x7fecd4152780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:50:58.518 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:58.516+0000 7fecdb215640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fecd40d0fc0 0x7fecd40cd030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:50:58.518 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:58.516+0000 7fecdb215640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7fecd40af900 con 0x7fecd40d0fc0 2024-09-17T05:50:58.519 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:58.516+0000 7fecdb215640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fecd40d1480 con 0x7fecd40b7d70 2024-09-17T05:50:58.519 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:58.516+0000 7fecdb215640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fecd415e7c0 con 0x7fecd40b7960 2024-09-17T05:50:58.519 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:58.516+0000 7fecd97b2640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fecd40d0fc0 0x7fecd40cd030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:50:58.519 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:58.516+0000 7fecd97b2640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fecd40d0fc0 0x7fecd40cd030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:58236/0 (socket says 172.21.15.150:58236) 2024-09-17T05:50:58.519 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:58.516+0000 7fecd97b2640 1 -- 172.21.15.150:0/4272354740 learned_addr learned my addr 172.21.15.150:0/4272354740 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:50:58.519 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:58.516+0000 7feccbfff640 1 --2- 172.21.15.150:0/4272354740 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fecd40b7d70 0x7fecd4152780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:50:58.519 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:58.516+0000 7fecd97b2640 1 -- 172.21.15.150:0/4272354740 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fecd40b7960 msgr2=0x7fecd4156b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:50:58.519 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:58.516+0000 7fecd8fb1640 1 --2- 172.21.15.150:0/4272354740 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fecd40b7960 0x7fecd4156b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:50:58.519 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:58.516+0000 7fecd97b2640 1 --2- 172.21.15.150:0/4272354740 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fecd40b7960 0x7fecd4156b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:50:58.519 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:58.516+0000 7fecd97b2640 1 -- 172.21.15.150:0/4272354740 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fecd40b7d70 msgr2=0x7fecd4152780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:50:58.519 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:58.516+0000 7fecd97b2640 1 --2- 172.21.15.150:0/4272354740 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fecd40b7d70 0x7fecd4152780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:50:58.519 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:58.516+0000 7fecd97b2640 1 -- 172.21.15.150:0/4272354740 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fecd41585f0 con 0x7fecd40d0fc0 2024-09-17T05:50:58.519 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:58.516+0000 7feccbfff640 1 --2- 172.21.15.150:0/4272354740 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fecd40b7d70 0x7fecd4152780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T05:50:58.520 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:58.516+0000 7fecd8fb1640 1 --2- 172.21.15.150:0/4272354740 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fecd40b7960 0x7fecd4156b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T05:50:58.520 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:58.516+0000 7fecd97b2640 1 --2- 172.21.15.150:0/4272354740 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fecd40d0fc0 0x7fecd40cd030 secure :-1 s=READY pgs=1397 cs=0 l=1 rev1=1 crypto rx=0x7feccc009ca0 tx=0x7feccc032e90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:50:58.520 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:58.516+0000 7fecc97fa640 1 -- 172.21.15.150:0/4272354740 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feccc041020 con 0x7fecd40d0fc0 2024-09-17T05:50:58.520 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:58.516+0000 7fecc97fa640 1 -- 172.21.15.150:0/4272354740 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7feccc004130 con 0x7fecd40d0fc0 2024-09-17T05:50:58.520 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:58.516+0000 7fecc97fa640 1 -- 172.21.15.150:0/4272354740 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feccc036040 con 0x7fecd40d0fc0 2024-09-17T05:50:58.520 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:58.517+0000 7fecdb215640 1 -- 172.21.15.150:0/4272354740 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fecd41f3620 con 0x7fecd40d0fc0 2024-09-17T05:50:58.520 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:58.517+0000 7fecdb215640 1 -- 172.21.15.150:0/4272354740 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fecd41f3be0 con 0x7fecd40d0fc0 2024-09-17T05:50:58.520 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:58.517+0000 7fecdb215640 1 -- 172.21.15.150:0/4272354740 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fecd40d0a80 con 0x7fecd40d0fc0 2024-09-17T05:50:58.521 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:58.518+0000 7fecc97fa640 1 -- 172.21.15.150:0/4272354740 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 36) ==== 103736+0+0 (secure 0 0 0) 0x7feccc044020 con 0x7fecd40d0fc0 2024-09-17T05:50:58.521 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:58.519+0000 7fecc97fa640 1 --2- 172.21.15.150:0/4272354740 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fecc007a540 0x7fecc007ca50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:50:58.521 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:58.519+0000 7fecc97fa640 1 -- 172.21.15.150:0/4272354740 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(101..101 src has 1..101) ==== 5821+0+0 (secure 0 0 0) 0x7feccc0baba0 con 0x7fecd40d0fc0 2024-09-17T05:50:58.521 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:58.519+0000 7fecd8fb1640 1 --2- 172.21.15.150:0/4272354740 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fecc007a540 0x7fecc007ca50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:50:58.521 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:58.520+0000 7fecd8fb1640 1 --2- 172.21.15.150:0/4272354740 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fecc007a540 0x7fecc007ca50 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7fecd40d2470 tx=0x7fecd0009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:50:58.524 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:58.523+0000 7fecc97fa640 1 -- 172.21.15.150:0/4272354740 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7feccc04b030 con 0x7fecd40d0fc0 2024-09-17T05:50:58.732 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:58.732+0000 7fecdb215640 1 -- 172.21.15.150:0/4272354740 --> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] -- mgr_command(tid 0: {"prefix": "fs subvolume snapshot rm", "force": true, "vol_name": "cephfs", "sub_name": "sv1", "snap_name": "ss1", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fecd40720a0 con 0x7fecc007a540 2024-09-17T05:50:58.758 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:58.757+0000 7fecc97fa640 1 -- 172.21.15.150:0/4272354740 <== mgr.4108 v2:172.21.15.176:6800/3631216395 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7fecd40720a0 con 0x7fecc007a540 2024-09-17T05:50:58.758 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-09-17T05:50:58.760 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:58.759+0000 7fecdb215640 1 -- 172.21.15.150:0/4272354740 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fecc007a540 msgr2=0x7fecc007ca50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:50:58.760 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:58.759+0000 7fecdb215640 1 --2- 172.21.15.150:0/4272354740 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fecc007a540 0x7fecc007ca50 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7fecd40d2470 tx=0x7fecd0009040 comp rx=0 tx=0).stop 2024-09-17T05:50:58.761 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:58.759+0000 7fecdb215640 1 -- 172.21.15.150:0/4272354740 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fecd40d0fc0 msgr2=0x7fecd40cd030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:50:58.761 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:58.759+0000 7fecdb215640 1 --2- 172.21.15.150:0/4272354740 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fecd40d0fc0 0x7fecd40cd030 secure :-1 s=READY pgs=1397 cs=0 l=1 rev1=1 crypto rx=0x7feccc009ca0 tx=0x7feccc032e90 comp rx=0 tx=0).stop 2024-09-17T05:50:58.761 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:58.759+0000 7fecdb215640 1 -- 172.21.15.150:0/4272354740 shutdown_connections 2024-09-17T05:50:58.761 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:58.759+0000 7fecdb215640 1 --2- 172.21.15.150:0/4272354740 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fecd40b7d70 0x7fecd4152780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:50:58.761 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:58.759+0000 7fecdb215640 1 --2- 172.21.15.150:0/4272354740 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fecc007a540 0x7fecc007ca50 unknown :-1 s=CLOSED pgs=599 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:50:58.761 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:58.759+0000 7fecdb215640 1 --2- 172.21.15.150:0/4272354740 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fecd40d0fc0 0x7fecd40cd030 unknown :-1 s=CLOSED pgs=1397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:50:58.761 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:58.759+0000 7fecdb215640 1 --2- 172.21.15.150:0/4272354740 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fecd40b7960 0x7fecd4156b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:50:58.761 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:58.759+0000 7fecdb215640 1 -- 172.21.15.150:0/4272354740 >> 172.21.15.150:0/4272354740 conn(0x7fecd40cef20 msgr2=0x7fecd4153380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:50:58.761 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:58.760+0000 7fecdb215640 1 -- 172.21.15.150:0/4272354740 shutdown_connections 2024-09-17T05:50:58.761 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:58.760+0000 7fecdb215640 1 -- 172.21.15.150:0/4272354740 wait complete. 2024-09-17T05:50:58.772 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume rm cephfs sv1 2024-09-17T05:50:58.889 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:58.888+0000 7f1918fc6640 1 -- 172.21.15.150:0/3765723015 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1900004800 msgr2=0x7f1900004c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:50:58.889 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:58.888+0000 7f1918fc6640 1 --2- 172.21.15.150:0/3765723015 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1900004800 0x7f1900004c10 secure :-1 s=READY pgs=1399 cs=0 l=1 rev1=1 crypto rx=0x7f19141613e0 tx=0x7f1900005830 comp rx=0 tx=0).stop 2024-09-17T05:50:58.889 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:58.888+0000 7f1912d9d640 1 -- 172.21.15.150:0/3765723015 reap_dead start 2024-09-17T05:50:58.889 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:58.888+0000 7f1918fc6640 1 -- 172.21.15.150:0/3765723015 shutdown_connections 2024-09-17T05:50:58.889 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:58.888+0000 7f1918fc6640 1 -- 172.21.15.150:0/3765723015 >> 172.21.15.150:0/3765723015 conn(0x7f191406d1c0 msgr2=0x7f191406d5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:50:58.889 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:58.888+0000 7f1918fc6640 1 -- 172.21.15.150:0/3765723015 shutdown_connections 2024-09-17T05:50:58.889 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:58.888+0000 7f1918fc6640 1 -- 172.21.15.150:0/3765723015 wait complete. 2024-09-17T05:50:58.890 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:58.890+0000 7f1918fc6640 1 Processor -- start 2024-09-17T05:50:58.891 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:58.890+0000 7f1918fc6640 1 -- start start 2024-09-17T05:50:58.898 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:58.891+0000 7f1918fc6640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1900004800 0x7f191413de50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:50:58.898 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:58.891+0000 7f1918fc6640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f191415f2e0 0x7f1914141aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:50:58.899 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:58.891+0000 7f1918fc6640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1914141fe0 0x7f19141423f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:50:58.899 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:58.891+0000 7f1918fc6640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f19140cdcd0 con 0x7f1914141fe0 2024-09-17T05:50:58.899 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:58.891+0000 7f1918fc6640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f19140cdb50 con 0x7f191415f2e0 2024-09-17T05:50:58.899 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:58.891+0000 7f1918fc6640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f19140cde50 con 0x7f1900004800 2024-09-17T05:50:58.899 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:58.891+0000 7f1912d9d640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1914141fe0 0x7f19141423f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:50:58.900 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:58.891+0000 7f1912d9d640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1914141fe0 0x7f19141423f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:58250/0 (socket says 172.21.15.150:58250) 2024-09-17T05:50:58.900 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:58.891+0000 7f1912d9d640 1 -- 172.21.15.150:0/51337002 learned_addr learned my addr 172.21.15.150:0/51337002 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:50:58.900 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:58.891+0000 7f191259c640 1 --2- 172.21.15.150:0/51337002 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1900004800 0x7f191413de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:50:58.900 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:58.891+0000 7f1909d9b640 1 --2- 172.21.15.150:0/51337002 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f191415f2e0 0x7f1914141aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:50:58.900 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:58.891+0000 7f1912d9d640 1 -- 172.21.15.150:0/51337002 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1900004800 msgr2=0x7f191413de50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:50:58.901 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:58.891+0000 7f1912d9d640 1 --2- 172.21.15.150:0/51337002 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1900004800 0x7f191413de50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:50:58.901 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:58.892+0000 7f1912d9d640 1 -- 172.21.15.150:0/51337002 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f191415f2e0 msgr2=0x7f1914141aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:50:58.901 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:58.892+0000 7f1912d9d640 1 --2- 172.21.15.150:0/51337002 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f191415f2e0 0x7f1914141aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:50:58.901 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:58.892+0000 7f1912d9d640 1 -- 172.21.15.150:0/51337002 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1914144b40 con 0x7f1914141fe0 2024-09-17T05:50:58.901 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:58.892+0000 7f1912d9d640 1 --2- 172.21.15.150:0/51337002 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1914141fe0 0x7f19141423f0 secure :-1 s=READY pgs=1400 cs=0 l=1 rev1=1 crypto rx=0x7f190c005fd0 tx=0x7f190c011f80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:50:58.901 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:58.892+0000 7f190b7fe640 1 -- 172.21.15.150:0/51337002 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f190c004b20 con 0x7f1914141fe0 2024-09-17T05:50:58.902 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:58.892+0000 7f190b7fe640 1 -- 172.21.15.150:0/51337002 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f190c004cc0 con 0x7f1914141fe0 2024-09-17T05:50:58.902 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:58.892+0000 7f1918fc6640 1 -- 172.21.15.150:0/51337002 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f191415ce90 con 0x7f1914141fe0 2024-09-17T05:50:58.902 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:58.892+0000 7f190b7fe640 1 -- 172.21.15.150:0/51337002 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f190c003bd0 con 0x7f1914141fe0 2024-09-17T05:50:58.902 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:58.892+0000 7f1918fc6640 1 -- 172.21.15.150:0/51337002 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f191415d450 con 0x7f1914141fe0 2024-09-17T05:50:58.902 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:58.893+0000 7f1918fc6640 1 -- 172.21.15.150:0/51337002 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f19140cd610 con 0x7f1914141fe0 2024-09-17T05:50:58.903 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:58.894+0000 7f190b7fe640 1 -- 172.21.15.150:0/51337002 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 36) ==== 103736+0+0 (secure 0 0 0) 0x7f190c004030 con 0x7f1914141fe0 2024-09-17T05:50:58.903 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:58.894+0000 7f190b7fe640 1 --2- 172.21.15.150:0/51337002 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f18f407a4e0 0x7f18f407c9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:50:58.903 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:58.894+0000 7f190b7fe640 1 -- 172.21.15.150:0/51337002 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(101..101 src has 1..101) ==== 5821+0+0 (secure 0 0 0) 0x7f190c09aa80 con 0x7f1914141fe0 2024-09-17T05:50:58.903 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:58.894+0000 7f191259c640 1 --2- 172.21.15.150:0/51337002 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f18f407a4e0 0x7f18f407c9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:50:58.903 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:58.895+0000 7f191259c640 1 --2- 172.21.15.150:0/51337002 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f18f407a4e0 0x7f18f407c9f0 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7f1904009b30 tx=0x7f1904005f90 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:50:58.904 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:58.899+0000 7f190b7fe640 1 -- 172.21.15.150:0/51337002 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f190c01f060 con 0x7f1914141fe0 2024-09-17T05:50:59.102 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:59.101+0000 7f1918fc6640 1 -- 172.21.15.150:0/51337002 --> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] -- mgr_command(tid 0: {"prefix": "fs subvolume rm", "vol_name": "cephfs", "sub_name": "sv1", "target": ["mon-mgr", ""]}) -- 0x7f1914144e20 con 0x7f18f407a4e0 2024-09-17T05:50:59.121 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:59.120+0000 7f190b7fe640 1 -- 172.21.15.150:0/51337002 <== mgr.4108 v2:172.21.15.176:6800/3631216395 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f1914144e20 con 0x7f18f407a4e0 2024-09-17T05:50:59.125 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:59.123+0000 7f1918fc6640 1 -- 172.21.15.150:0/51337002 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f18f407a4e0 msgr2=0x7f18f407c9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:50:59.125 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:59.123+0000 7f1918fc6640 1 --2- 172.21.15.150:0/51337002 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f18f407a4e0 0x7f18f407c9f0 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7f1904009b30 tx=0x7f1904005f90 comp rx=0 tx=0).stop 2024-09-17T05:50:59.125 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:59.123+0000 7f1918fc6640 1 -- 172.21.15.150:0/51337002 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1914141fe0 msgr2=0x7f19141423f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:50:59.125 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:59.123+0000 7f1918fc6640 1 --2- 172.21.15.150:0/51337002 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1914141fe0 0x7f19141423f0 secure :-1 s=READY pgs=1400 cs=0 l=1 rev1=1 crypto rx=0x7f190c005fd0 tx=0x7f190c011f80 comp rx=0 tx=0).stop 2024-09-17T05:50:59.125 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:59.123+0000 7f1918fc6640 1 -- 172.21.15.150:0/51337002 shutdown_connections 2024-09-17T05:50:59.126 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:59.123+0000 7f1918fc6640 1 --2- 172.21.15.150:0/51337002 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f191415f2e0 0x7f1914141aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:50:59.126 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:59.123+0000 7f1918fc6640 1 --2- 172.21.15.150:0/51337002 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f18f407a4e0 0x7f18f407c9f0 unknown :-1 s=CLOSED pgs=600 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:50:59.126 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:59.123+0000 7f1918fc6640 1 --2- 172.21.15.150:0/51337002 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1914141fe0 0x7f19141423f0 unknown :-1 s=CLOSED pgs=1400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:50:59.126 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:59.123+0000 7f1918fc6640 1 --2- 172.21.15.150:0/51337002 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1900004800 0x7f191413de50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:50:59.126 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:59.123+0000 7f1918fc6640 1 -- 172.21.15.150:0/51337002 >> 172.21.15.150:0/51337002 conn(0x7f191406d1c0 msgr2=0x7f19140b2900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:50:59.127 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:59.123+0000 7f1918fc6640 1 -- 172.21.15.150:0/51337002 shutdown_connections 2024-09-17T05:50:59.127 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:59.123+0000 7f1918fc6640 1 -- 172.21.15.150:0/51337002 wait complete. 2024-09-17T05:50:59.133 INFO:tasks.ceph.mgr.x.smithi176.stderr:2024-09-17T05:50:59.132+0000 7f33d971e640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-17T05:50:59.134 INFO:tasks.ceph.mgr.x.smithi176.stderr:2024-09-17T05:50:59.132+0000 7f33d971e640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-17T05:50:59.134 INFO:tasks.ceph.mgr.x.smithi176.stderr:2024-09-17T05:50:59.132+0000 7f33d971e640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-17T05:50:59.134 INFO:tasks.ceph.mgr.x.smithi176.stderr:2024-09-17T05:50:59.132+0000 7f33d971e640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-17T05:50:59.134 INFO:tasks.ceph.mgr.x.smithi176.stderr:2024-09-17T05:50:59.132+0000 7f33d971e640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-17T05:50:59.137 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume rm --force cephfs ss1clone1 2024-09-17T05:50:59.259 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:59.258+0000 7fba00132640 1 -- 172.21.15.150:0/1869040059 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb9f80ae2d0 msgr2=0x7fb9f806cda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:50:59.260 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:59.258+0000 7fba00132640 1 --2- 172.21.15.150:0/1869040059 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb9f80ae2d0 0x7fb9f806cda0 secure :-1 s=READY pgs=1402 cs=0 l=1 rev1=1 crypto rx=0x7fb9ec005fd0 tx=0x7fb9ec02a670 comp rx=0 tx=0).stop 2024-09-17T05:50:59.260 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:59.258+0000 7fba00132640 1 -- 172.21.15.150:0/1869040059 shutdown_connections 2024-09-17T05:50:59.260 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:59.258+0000 7fba00132640 1 --2- 172.21.15.150:0/1869040059 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb9f80ae2d0 0x7fb9f806cda0 unknown :-1 s=CLOSED pgs=1402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:50:59.260 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:59.258+0000 7fba00132640 1 -- 172.21.15.150:0/1869040059 >> 172.21.15.150:0/1869040059 conn(0x7fb9f809aa50 msgr2=0x7fb9f80b2ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:50:59.260 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:59.258+0000 7fba00132640 1 -- 172.21.15.150:0/1869040059 shutdown_connections 2024-09-17T05:50:59.260 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:59.258+0000 7fba00132640 1 -- 172.21.15.150:0/1869040059 wait complete. 2024-09-17T05:50:59.261 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:59.260+0000 7fba00132640 1 Processor -- start 2024-09-17T05:50:59.261 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:59.260+0000 7fba00132640 1 -- start start 2024-09-17T05:50:59.263 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:59.261+0000 7fba00132640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb9f80ae2d0 0x7fb9f8147830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:50:59.264 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:59.261+0000 7fba00132640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb9f80ae6e0 0x7fb9f80b6000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:50:59.264 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:59.262+0000 7fba00132640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb9f815ca70 0x7fb9f80b4f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:50:59.264 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:59.262+0000 7fba00132640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7fb9f815eb80 con 0x7fb9f815ca70 2024-09-17T05:50:59.264 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:59.262+0000 7fba00132640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fb9f815ea00 con 0x7fb9f80ae2d0 2024-09-17T05:50:59.264 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:59.262+0000 7fba00132640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fb9f806d2e0 con 0x7fb9f80ae6e0 2024-09-17T05:50:59.264 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:59.262+0000 7fb9fe6cf640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb9f815ca70 0x7fb9f80b4f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:50:59.264 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:59.262+0000 7fb9fe6cf640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb9f815ca70 0x7fb9f80b4f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:58272/0 (socket says 172.21.15.150:58272) 2024-09-17T05:50:59.264 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:59.262+0000 7fb9fe6cf640 1 -- 172.21.15.150:0/3145866565 learned_addr learned my addr 172.21.15.150:0/3145866565 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:50:59.264 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:59.262+0000 7fb9fd6cd640 1 --2- 172.21.15.150:0/3145866565 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb9f80ae6e0 0x7fb9f80b6000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:50:59.264 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:59.262+0000 7fb9fdece640 1 --2- 172.21.15.150:0/3145866565 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb9f80ae2d0 0x7fb9f8147830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:50:59.264 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:59.262+0000 7fb9fe6cf640 1 -- 172.21.15.150:0/3145866565 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb9f80ae6e0 msgr2=0x7fb9f80b6000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:50:59.264 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:59.262+0000 7fb9fe6cf640 1 --2- 172.21.15.150:0/3145866565 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb9f80ae6e0 0x7fb9f80b6000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:50:59.265 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:59.262+0000 7fb9fe6cf640 1 -- 172.21.15.150:0/3145866565 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb9f80ae2d0 msgr2=0x7fb9f8147830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:50:59.265 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:59.262+0000 7fb9fe6cf640 1 --2- 172.21.15.150:0/3145866565 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb9f80ae2d0 0x7fb9f8147830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:50:59.265 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:59.262+0000 7fb9fe6cf640 1 -- 172.21.15.150:0/3145866565 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb9f8147ff0 con 0x7fb9f815ca70 2024-09-17T05:50:59.265 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:59.262+0000 7fb9fd6cd640 1 --2- 172.21.15.150:0/3145866565 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb9f80ae6e0 0x7fb9f80b6000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:50:59.265 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:59.262+0000 7fb9fe6cf640 1 --2- 172.21.15.150:0/3145866565 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb9f815ca70 0x7fb9f80b4f70 secure :-1 s=READY pgs=1403 cs=0 l=1 rev1=1 crypto rx=0x7fb9f000c3c0 tx=0x7fb9f000c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:50:59.265 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:59.262+0000 7fb9f67fc640 1 -- 172.21.15.150:0/3145866565 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9f0017070 con 0x7fb9f815ca70 2024-09-17T05:50:59.265 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:59.262+0000 7fb9f67fc640 1 -- 172.21.15.150:0/3145866565 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb9f00053c0 con 0x7fb9f815ca70 2024-09-17T05:50:59.265 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:59.262+0000 7fba00132640 1 -- 172.21.15.150:0/3145866565 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb9f80b4490 con 0x7fb9f815ca70 2024-09-17T05:50:59.265 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:59.262+0000 7fb9f67fc640 1 -- 172.21.15.150:0/3145866565 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9f0003850 con 0x7fb9f815ca70 2024-09-17T05:50:59.265 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:59.262+0000 7fba00132640 1 -- 172.21.15.150:0/3145866565 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb9f814fc50 con 0x7fb9f815ca70 2024-09-17T05:50:59.266 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:59.263+0000 7fba00132640 1 -- 172.21.15.150:0/3145866565 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb9f8147630 con 0x7fb9f815ca70 2024-09-17T05:50:59.266 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:59.264+0000 7fb9f67fc640 1 -- 172.21.15.150:0/3145866565 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 36) ==== 103736+0+0 (secure 0 0 0) 0x7fb9f001a070 con 0x7fb9f815ca70 2024-09-17T05:50:59.266 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:59.265+0000 7fb9f67fc640 1 --2- 172.21.15.150:0/3145866565 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fb9e407a510 0x7fb9e407ca20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:50:59.266 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:59.265+0000 7fb9f67fc640 1 -- 172.21.15.150:0/3145866565 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(101..101 src has 1..101) ==== 5821+0+0 (secure 0 0 0) 0x7fb9f0098e40 con 0x7fb9f815ca70 2024-09-17T05:50:59.266 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:59.265+0000 7fb9fdece640 1 --2- 172.21.15.150:0/3145866565 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fb9e407a510 0x7fb9e407ca20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:50:59.267 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:59.265+0000 7fb9fdece640 1 --2- 172.21.15.150:0/3145866565 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fb9e407a510 0x7fb9e407ca20 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7fb9f80af860 tx=0x7fb9e8009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:50:59.270 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:59.269+0000 7fb9f67fc640 1 -- 172.21.15.150:0/3145866565 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fb9f8147630 con 0x7fb9f815ca70 2024-09-17T05:50:59.478 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:59.478+0000 7fba00132640 1 -- 172.21.15.150:0/3145866565 --> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] -- mgr_command(tid 0: {"prefix": "fs subvolume rm", "force": true, "vol_name": "cephfs", "sub_name": "ss1clone1", "target": ["mon-mgr", ""]}) -- 0x7fb9f814feb0 con 0x7fb9e407a510 2024-09-17T05:50:59.495 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:59.495+0000 7fb9f67fc640 1 -- 172.21.15.150:0/3145866565 <== mgr.4108 v2:172.21.15.176:6800/3631216395 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7fb9f814feb0 con 0x7fb9e407a510 2024-09-17T05:50:59.498 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:59.497+0000 7fba00132640 1 -- 172.21.15.150:0/3145866565 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fb9e407a510 msgr2=0x7fb9e407ca20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:50:59.498 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:59.497+0000 7fba00132640 1 --2- 172.21.15.150:0/3145866565 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fb9e407a510 0x7fb9e407ca20 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7fb9f80af860 tx=0x7fb9e8009040 comp rx=0 tx=0).stop 2024-09-17T05:50:59.498 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:59.497+0000 7fba00132640 1 -- 172.21.15.150:0/3145866565 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb9f815ca70 msgr2=0x7fb9f80b4f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:50:59.498 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:59.497+0000 7fba00132640 1 --2- 172.21.15.150:0/3145866565 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb9f815ca70 0x7fb9f80b4f70 secure :-1 s=READY pgs=1403 cs=0 l=1 rev1=1 crypto rx=0x7fb9f000c3c0 tx=0x7fb9f000c880 comp rx=0 tx=0).stop 2024-09-17T05:50:59.499 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:59.497+0000 7fba00132640 1 -- 172.21.15.150:0/3145866565 shutdown_connections 2024-09-17T05:50:59.499 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:59.497+0000 7fba00132640 1 --2- 172.21.15.150:0/3145866565 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fb9e407a510 0x7fb9e407ca20 unknown :-1 s=CLOSED pgs=601 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:50:59.499 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:59.497+0000 7fba00132640 1 --2- 172.21.15.150:0/3145866565 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb9f815ca70 0x7fb9f80b4f70 unknown :-1 s=CLOSED pgs=1403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:50:59.499 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:59.497+0000 7fba00132640 1 --2- 172.21.15.150:0/3145866565 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb9f80ae6e0 0x7fb9f80b6000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:50:59.499 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:59.497+0000 7fba00132640 1 --2- 172.21.15.150:0/3145866565 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb9f80ae2d0 0x7fb9f8147830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:50:59.499 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:59.497+0000 7fba00132640 1 -- 172.21.15.150:0/3145866565 >> 172.21.15.150:0/3145866565 conn(0x7fb9f809aa50 msgr2=0x7fb9f8157980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:50:59.499 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:59.497+0000 7fba00132640 1 -- 172.21.15.150:0/3145866565 shutdown_connections 2024-09-17T05:50:59.499 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:59.497+0000 7fba00132640 1 -- 172.21.15.150:0/3145866565 wait complete. 2024-09-17T05:50:59.510 DEBUG:teuthology.orchestra.run.smithi150:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'stat -c %h /home/ubuntu/cephtest/mnt.0/./volumes/_deleting') 2024-09-17T05:50:59.561 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:59 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-17T05:50:59.567 INFO:teuthology.orchestra.run.smithi150.stdout:2 2024-09-17T05:50:59.567 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:59 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T05:50:59.573 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mgr mgr/volumes/max_concurrent_clones 4 2024-09-17T05:50:59.690 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:59.689+0000 7f3101f13640 1 -- 172.21.15.150:0/99372955 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f30fc0ce800 msgr2=0x7f30fc09aa50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:50:59.690 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:59.689+0000 7f3101f13640 1 --2- 172.21.15.150:0/99372955 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f30fc0ce800 0x7f30fc09aa50 secure :-1 s=READY pgs=1405 cs=0 l=1 rev1=1 crypto rx=0x7f30ec009830 tx=0x7f30ec02a4d0 comp rx=0 tx=0).stop 2024-09-17T05:50:59.690 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:59.689+0000 7f3101f13640 1 -- 172.21.15.150:0/99372955 shutdown_connections 2024-09-17T05:50:59.690 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:59.689+0000 7f3101f13640 1 --2- 172.21.15.150:0/99372955 >> v2:172.21.15.176:3300/0 conn(0x7f30fc0b6450 0x7f30fc0cd3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:50:59.690 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:59.689+0000 7f3101f13640 1 --2- 172.21.15.150:0/99372955 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f30fc0ce800 0x7f30fc09aa50 unknown :-1 s=CLOSED pgs=1405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:50:59.690 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:59.689+0000 7f3101f13640 1 -- 172.21.15.150:0/99372955 >> 172.21.15.150:0/99372955 conn(0x7f30fc0d2550 msgr2=0x7f30fc0d2960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:50:59.690 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:59.689+0000 7f3101f13640 1 -- 172.21.15.150:0/99372955 shutdown_connections 2024-09-17T05:50:59.690 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:59.689+0000 7f3101f13640 1 -- 172.21.15.150:0/99372955 wait complete. 2024-09-17T05:50:59.691 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:59.691+0000 7f3101f13640 1 Processor -- start 2024-09-17T05:50:59.691 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:59.691+0000 7f3101f13640 1 -- start start 2024-09-17T05:50:59.694 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:59.692+0000 7f3101f13640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f30fc09af90 0x7f30fc157920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:50:59.694 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:59.692+0000 7f3101f13640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f30fc0b6450 0x7f30fc1599a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:50:59.695 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:59.692+0000 7f3101f13640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f30fc0ce800 0x7f30fc159ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:50:59.695 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:59.692+0000 7f3101f13640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f30fc0b7610 con 0x7f30fc0ce800 2024-09-17T05:50:59.695 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:59.692+0000 7f3101f13640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f30fc0cee20 con 0x7f30fc0b6450 2024-09-17T05:50:59.695 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:59.692+0000 7f3101f13640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f30fc0cd930 con 0x7f30fc09af90 2024-09-17T05:50:59.695 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:59.692+0000 7f30fbfff640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f30fc0ce800 0x7f30fc159ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:50:59.695 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:59.692+0000 7f30fbfff640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f30fc0ce800 0x7f30fc159ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:58294/0 (socket says 172.21.15.150:58294) 2024-09-17T05:50:59.695 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:59.692+0000 7f30fbfff640 1 -- 172.21.15.150:0/266705269 learned_addr learned my addr 172.21.15.150:0/266705269 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:50:59.695 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:59.692+0000 7f30fb7fe640 1 --2- 172.21.15.150:0/266705269 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f30fc09af90 0x7f30fc157920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:50:59.695 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:59.692+0000 7f30faffd640 1 --2- 172.21.15.150:0/266705269 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f30fc0b6450 0x7f30fc1599a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:50:59.695 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:59.693+0000 7f30fbfff640 1 -- 172.21.15.150:0/266705269 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f30fc09af90 msgr2=0x7f30fc157920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:50:59.695 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:59.693+0000 7f30fbfff640 1 --2- 172.21.15.150:0/266705269 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f30fc09af90 0x7f30fc157920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:50:59.695 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:59.693+0000 7f30fbfff640 1 -- 172.21.15.150:0/266705269 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f30fc0b6450 msgr2=0x7f30fc1599a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:50:59.695 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:59.693+0000 7f30fbfff640 1 --2- 172.21.15.150:0/266705269 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f30fc0b6450 0x7f30fc1599a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:50:59.696 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:59.693+0000 7f30fbfff640 1 -- 172.21.15.150:0/266705269 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f30fc1582e0 con 0x7f30fc0ce800 2024-09-17T05:50:59.696 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:59.693+0000 7f30faffd640 1 --2- 172.21.15.150:0/266705269 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f30fc0b6450 0x7f30fc1599a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:50:59.696 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:59.693+0000 7f30fb7fe640 1 --2- 172.21.15.150:0/266705269 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f30fc09af90 0x7f30fc157920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:50:59.696 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:59.693+0000 7f30fbfff640 1 --2- 172.21.15.150:0/266705269 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f30fc0ce800 0x7f30fc159ee0 secure :-1 s=READY pgs=1406 cs=0 l=1 rev1=1 crypto rx=0x7f30f400b9e0 tx=0x7f30f400bea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:50:59.696 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:59.693+0000 7f30e3fff640 1 -- 172.21.15.150:0/266705269 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30f4019070 con 0x7f30fc0ce800 2024-09-17T05:50:59.696 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:59.693+0000 7f30e3fff640 1 -- 172.21.15.150:0/266705269 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f30f400cc30 con 0x7f30fc0ce800 2024-09-17T05:50:59.696 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:59.693+0000 7f3101f13640 1 -- 172.21.15.150:0/266705269 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f30fc15e8b0 con 0x7f30fc0ce800 2024-09-17T05:50:59.696 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:59.693+0000 7f30e3fff640 1 -- 172.21.15.150:0/266705269 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30f40146a0 con 0x7f30fc0ce800 2024-09-17T05:50:59.696 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:59.693+0000 7f3101f13640 1 -- 172.21.15.150:0/266705269 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f30fc0c9a90 con 0x7f30fc0ce800 2024-09-17T05:50:59.696 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:59.694+0000 7f3101f13640 1 -- 172.21.15.150:0/266705269 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f30fc15e6a0 con 0x7f30fc0ce800 2024-09-17T05:50:59.697 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:59.695+0000 7f30e3fff640 1 -- 172.21.15.150:0/266705269 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 36) ==== 103736+0+0 (secure 0 0 0) 0x7f30f401c070 con 0x7f30fc0ce800 2024-09-17T05:50:59.697 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:59.695+0000 7f30e3fff640 1 --2- 172.21.15.150:0/266705269 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f30e807a4e0 0x7f30e807c9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:50:59.697 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:59.695+0000 7f30e3fff640 1 -- 172.21.15.150:0/266705269 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(101..101 src has 1..101) ==== 5821+0+0 (secure 0 0 0) 0x7f30f4099880 con 0x7f30fc0ce800 2024-09-17T05:50:59.697 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:59.696+0000 7f30fb7fe640 1 --2- 172.21.15.150:0/266705269 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f30e807a4e0 0x7f30e807c9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:50:59.697 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:59.696+0000 7f30fb7fe640 1 --2- 172.21.15.150:0/266705269 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f30e807a4e0 0x7f30e807c9f0 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7f30ec034000 tx=0x7f30ec004730 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:50:59.700 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:59.700+0000 7f30e3fff640 1 -- 172.21.15.150:0/266705269 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f30f400ce20 con 0x7f30fc0ce800 2024-09-17T05:50:59.875 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:59.874+0000 7f3101f13640 1 -- 172.21.15.150:0/266705269 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command([{prefix=config set, name=mgr/volumes/max_concurrent_clones}] v 0) -- 0x7f30fc09aa50 con 0x7f30fc0ce800 2024-09-17T05:50:59.876 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:59.875+0000 7f30e3fff640 1 -- 172.21.15.150:0/266705269 <== mon.0 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/volumes/max_concurrent_clones}]=0 v50)=0 v50) ==== 131+0+0 (secure 0 0 0) 0x7f30f40637c0 con 0x7f30fc0ce800 2024-09-17T05:50:59.878 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:59.877+0000 7f3101f13640 1 -- 172.21.15.150:0/266705269 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f30e807a4e0 msgr2=0x7f30e807c9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:50:59.878 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:59.877+0000 7f3101f13640 1 --2- 172.21.15.150:0/266705269 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f30e807a4e0 0x7f30e807c9f0 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7f30ec034000 tx=0x7f30ec004730 comp rx=0 tx=0).stop 2024-09-17T05:50:59.878 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:59.877+0000 7f3101f13640 1 -- 172.21.15.150:0/266705269 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f30fc0ce800 msgr2=0x7f30fc159ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:50:59.878 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:59.877+0000 7f3101f13640 1 --2- 172.21.15.150:0/266705269 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f30fc0ce800 0x7f30fc159ee0 secure :-1 s=READY pgs=1406 cs=0 l=1 rev1=1 crypto rx=0x7f30f400b9e0 tx=0x7f30f400bea0 comp rx=0 tx=0).stop 2024-09-17T05:50:59.879 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:59.877+0000 7f3101f13640 1 -- 172.21.15.150:0/266705269 shutdown_connections 2024-09-17T05:50:59.879 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:59.877+0000 7f3101f13640 1 --2- 172.21.15.150:0/266705269 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f30fc0b6450 0x7f30fc1599a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:50:59.879 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:59.877+0000 7f3101f13640 1 --2- 172.21.15.150:0/266705269 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f30e807a4e0 0x7f30e807c9f0 unknown :-1 s=CLOSED pgs=602 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:50:59.879 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:59.877+0000 7f3101f13640 1 --2- 172.21.15.150:0/266705269 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f30fc0ce800 0x7f30fc159ee0 unknown :-1 s=CLOSED pgs=1406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:50:59.879 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:59.877+0000 7f3101f13640 1 --2- 172.21.15.150:0/266705269 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f30fc09af90 0x7f30fc157920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:50:59.879 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:59.877+0000 7f3101f13640 1 -- 172.21.15.150:0/266705269 >> 172.21.15.150:0/266705269 conn(0x7f30fc0d2550 msgr2=0x7f30fc15dbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:50:59.879 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:59.877+0000 7f3101f13640 1 -- 172.21.15.150:0/266705269 shutdown_connections 2024-09-17T05:50:59.879 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:50:59.877+0000 7f3101f13640 1 -- 172.21.15.150:0/266705269 wait complete. 2024-09-17T05:50:59.890 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-17T05:50:59.890 DEBUG:teuthology.orchestra.run.smithi150:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-17T05:50:59.927 DEBUG:teuthology.orchestra.run.smithi176:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-17T05:50:59.973 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-17T05:50:59.973 INFO:tasks.cephfs.mount:Terminating background process 2024-09-17T05:50:59.973 DEBUG:teuthology.orchestra.run.smithi150:> set -ex 2024-09-17T05:50:59.973 DEBUG:teuthology.orchestra.run.smithi150:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T05:50:59.989 DEBUG:teuthology.orchestra.run.smithi150:> set -ex 2024-09-17T05:50:59.989 DEBUG:teuthology.orchestra.run.smithi150:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T05:51:00.046 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-17T05:51:00.200 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:00.199+0000 7f7bcc0f2640 1 -- 172.21.15.150:0/29668332 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7bc41637d0 msgr2=0x7f7bc40b5250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:51:00.200 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:00.199+0000 7f7bcc0f2640 1 --2- 172.21.15.150:0/29668332 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7bc41637d0 0x7f7bc40b5250 secure :-1 s=READY pgs=1408 cs=0 l=1 rev1=1 crypto rx=0x7f7bbc005fd0 tx=0x7f7bbc02a8b0 comp rx=0 tx=0).stop 2024-09-17T05:51:00.200 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:00.199+0000 7f7bcc0f2640 1 -- 172.21.15.150:0/29668332 shutdown_connections 2024-09-17T05:51:00.200 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:00.199+0000 7f7bcc0f2640 1 --2- 172.21.15.150:0/29668332 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7bc41637d0 0x7f7bc40b5250 unknown :-1 s=CLOSED pgs=1408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:51:00.200 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:00.199+0000 7f7bcc0f2640 1 --2- 172.21.15.150:0/29668332 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7bc40b7440 0x7f7bc406e090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:51:00.200 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:00.199+0000 7f7bcc0f2640 1 -- 172.21.15.150:0/29668332 >> 172.21.15.150:0/29668332 conn(0x7f7bc40cee80 msgr2=0x7f7bc40cf290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:51:00.200 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:00.199+0000 7f7bcc0f2640 1 -- 172.21.15.150:0/29668332 shutdown_connections 2024-09-17T05:51:00.200 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:00.199+0000 7f7bcc0f2640 1 -- 172.21.15.150:0/29668332 wait complete. 2024-09-17T05:51:00.201 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:00.200+0000 7f7bcc0f2640 1 Processor -- start 2024-09-17T05:51:00.201 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:00.201+0000 7f7bcc0f2640 1 -- start start 2024-09-17T05:51:00.204 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:00.202+0000 7f7bcc0f2640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7bc406e5d0 0x7f7bc40c6600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:51:00.204 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:00.202+0000 7f7bcc0f2640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7bc40b7440 0x7f7bc40b3190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:51:00.204 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:00.202+0000 7f7bcc0f2640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7bc41637d0 0x7f7bc41f8fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:51:00.204 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:00.202+0000 7f7bcc0f2640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f7bc4163be0 con 0x7f7bc406e5d0 2024-09-17T05:51:00.204 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:00.202+0000 7f7bcc0f2640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f7bc40cfdc0 con 0x7f7bc40b7440 2024-09-17T05:51:00.204 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:00.202+0000 7f7bcc0f2640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f7bc4163d60 con 0x7f7bc41637d0 2024-09-17T05:51:00.204 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:00.202+0000 7f7bc9e8e640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7bc406e5d0 0x7f7bc40c6600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:51:00.204 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:00.202+0000 7f7bc9e8e640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7bc406e5d0 0x7f7bc40c6600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:38726/0 (socket says 172.21.15.150:38726) 2024-09-17T05:51:00.204 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:00.202+0000 7f7bc9e8e640 1 -- 172.21.15.150:0/1630801920 learned_addr learned my addr 172.21.15.150:0/1630801920 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:51:00.204 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:00.202+0000 7f7bc968d640 1 --2- 172.21.15.150:0/1630801920 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7bc40b7440 0x7f7bc40b3190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:51:00.204 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:00.202+0000 7f7bc9e8e640 1 -- 172.21.15.150:0/1630801920 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7bc41637d0 msgr2=0x7f7bc41f8fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:51:00.204 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:00.202+0000 7f7bc9e8e640 1 --2- 172.21.15.150:0/1630801920 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7bc41637d0 0x7f7bc41f8fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:51:00.205 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:00.202+0000 7f7bc9e8e640 1 -- 172.21.15.150:0/1630801920 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7bc40b7440 msgr2=0x7f7bc40b3190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:51:00.205 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:00.202+0000 7f7bc9e8e640 1 --2- 172.21.15.150:0/1630801920 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7bc40b7440 0x7f7bc40b3190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:51:00.205 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:00.202+0000 7f7bc9e8e640 1 -- 172.21.15.150:0/1630801920 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7bc40afc10 con 0x7f7bc406e5d0 2024-09-17T05:51:00.205 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:00.202+0000 7f7bc9e8e640 1 --2- 172.21.15.150:0/1630801920 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7bc406e5d0 0x7f7bc40c6600 secure :-1 s=READY pgs=1409 cs=0 l=1 rev1=1 crypto rx=0x7f7bc000d700 tx=0x7f7bc000dbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:51:00.205 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:00.202+0000 7f7bba7fc640 1 -- 172.21.15.150:0/1630801920 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7bc0017070 con 0x7f7bc406e5d0 2024-09-17T05:51:00.205 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:00.202+0000 7f7bba7fc640 1 -- 172.21.15.150:0/1630801920 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f7bc0009d20 con 0x7f7bc406e5d0 2024-09-17T05:51:00.205 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:00.202+0000 7f7bcc0f2640 1 -- 172.21.15.150:0/1630801920 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7bc40afef0 con 0x7f7bc406e5d0 2024-09-17T05:51:00.205 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:00.203+0000 7f7bba7fc640 1 -- 172.21.15.150:0/1630801920 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7bc00106c0 con 0x7f7bc406e5d0 2024-09-17T05:51:00.205 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:00.203+0000 7f7bcc0f2640 1 -- 172.21.15.150:0/1630801920 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7bc40b04b0 con 0x7f7bc406e5d0 2024-09-17T05:51:00.206 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:00.204+0000 7f7bcc0f2640 1 -- 172.21.15.150:0/1630801920 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7bc406e090 con 0x7f7bc406e5d0 2024-09-17T05:51:00.206 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:00.204+0000 7f7bba7fc640 1 -- 172.21.15.150:0/1630801920 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 36) ==== 103736+0+0 (secure 0 0 0) 0x7f7bc001a070 con 0x7f7bc406e5d0 2024-09-17T05:51:00.206 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:00.205+0000 7f7bba7fc640 1 --2- 172.21.15.150:0/1630801920 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f7ba807a540 0x7f7ba807ca50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:51:00.206 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:00.205+0000 7f7bc968d640 1 --2- 172.21.15.150:0/1630801920 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f7ba807a540 0x7f7ba807ca50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:51:00.206 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:00.205+0000 7f7bba7fc640 1 -- 172.21.15.150:0/1630801920 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(101..101 src has 1..101) ==== 5821+0+0 (secure 0 0 0) 0x7f7bc0099c80 con 0x7f7bc406e5d0 2024-09-17T05:51:00.207 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:00.206+0000 7f7bc968d640 1 --2- 172.21.15.150:0/1630801920 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f7ba807a540 0x7f7ba807ca50 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7f7bc406e350 tx=0x7f7bb4009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:51:00.210 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:00.210+0000 7f7bba7fc640 1 -- 172.21.15.150:0/1630801920 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f7bc0063bc0 con 0x7f7bc406e5d0 2024-09-17T05:51:00.398 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:00.397+0000 7f7bcc0f2640 1 -- 172.21.15.150:0/1630801920 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f7bc40cc5f0 con 0x7f7bc406e5d0 2024-09-17T05:51:00.398 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:00.397+0000 7f7bba7fc640 1 -- 172.21.15.150:0/1630801920 <== mon.0 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v101) ==== 80+0+0 (secure 0 0 0) 0x7f7bc00634c0 con 0x7f7bc406e5d0 2024-09-17T05:51:00.398 INFO:teuthology.orchestra.run.smithi150.stderr:listed 0 entries 2024-09-17T05:51:00.401 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:00.400+0000 7f7bcc0f2640 1 -- 172.21.15.150:0/1630801920 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f7ba807a540 msgr2=0x7f7ba807ca50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:51:00.401 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:00.400+0000 7f7bcc0f2640 1 --2- 172.21.15.150:0/1630801920 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f7ba807a540 0x7f7ba807ca50 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7f7bc406e350 tx=0x7f7bb4009040 comp rx=0 tx=0).stop 2024-09-17T05:51:00.401 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:00.400+0000 7f7bcc0f2640 1 -- 172.21.15.150:0/1630801920 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7bc406e5d0 msgr2=0x7f7bc40c6600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:51:00.401 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:00.400+0000 7f7bcc0f2640 1 --2- 172.21.15.150:0/1630801920 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7bc406e5d0 0x7f7bc40c6600 secure :-1 s=READY pgs=1409 cs=0 l=1 rev1=1 crypto rx=0x7f7bc000d700 tx=0x7f7bc000dbc0 comp rx=0 tx=0).stop 2024-09-17T05:51:00.401 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:00.400+0000 7f7bcc0f2640 1 -- 172.21.15.150:0/1630801920 shutdown_connections 2024-09-17T05:51:00.401 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:00.400+0000 7f7bcc0f2640 1 --2- 172.21.15.150:0/1630801920 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7bc40b7440 0x7f7bc40b3190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:51:00.401 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:00.400+0000 7f7bcc0f2640 1 --2- 172.21.15.150:0/1630801920 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f7ba807a540 0x7f7ba807ca50 unknown :-1 s=CLOSED pgs=603 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:51:00.401 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:00.400+0000 7f7bcc0f2640 1 --2- 172.21.15.150:0/1630801920 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7bc41637d0 0x7f7bc41f8fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:51:00.401 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:00.400+0000 7f7bcc0f2640 1 --2- 172.21.15.150:0/1630801920 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7bc406e5d0 0x7f7bc40c6600 unknown :-1 s=CLOSED pgs=1409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:51:00.401 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:00.400+0000 7f7bcc0f2640 1 -- 172.21.15.150:0/1630801920 >> 172.21.15.150:0/1630801920 conn(0x7f7bc40cee80 msgr2=0x7f7bc4071310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:51:00.401 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:00.400+0000 7f7bcc0f2640 1 -- 172.21.15.150:0/1630801920 shutdown_connections 2024-09-17T05:51:00.401 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:00.400+0000 7f7bcc0f2640 1 -- 172.21.15.150:0/1630801920 wait complete. 2024-09-17T05:51:00.412 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-09-17T05:51:00.412 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:51:00.412 DEBUG:teuthology.orchestra.run.smithi150:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-09-17T05:51:00.453 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi150.front.sepia.ceph.com 2024-09-17T05:51:00.453 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:51:00.453 DEBUG:teuthology.orchestra.run.smithi150:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-17T05:51:00.509 INFO:tasks.cephfs.mount:Terminating background process 2024-09-17T05:51:00.510 DEBUG:teuthology.orchestra.run.smithi176:> set -ex 2024-09-17T05:51:00.510 DEBUG:teuthology.orchestra.run.smithi176:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T05:51:00.528 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056030,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497468k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=3379 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248732k,nr_inodes=812183,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497468k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-17T05:51:00.529 INFO:tasks.cephfs.mount:Terminating background process 2024-09-17T05:51:00.529 DEBUG:teuthology.orchestra.run.smithi150:> set -ex 2024-09-17T05:51:00.529 DEBUG:teuthology.orchestra.run.smithi150:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T05:51:00.565 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056027,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497464k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=18693 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248728k,nr_inodes=812182,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497464k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-17T05:51:00.565 INFO:tasks.cephfs.mount:Terminating background process 2024-09-17T05:51:00.565 DEBUG:teuthology.orchestra.run.smithi176:> set -ex 2024-09-17T05:51:00.566 DEBUG:teuthology.orchestra.run.smithi176:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T05:51:00.586 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056030,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497468k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=3379 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248732k,nr_inodes=812183,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497468k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-17T05:51:00.586 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T05:51:00.720 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:00.718+0000 7f5e4f077640 1 -- 172.21.15.150:0/1286875346 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5e4815ee50 msgr2=0x7f5e480d1090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:51:00.720 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:00.718+0000 7f5e4f077640 1 --2- 172.21.15.150:0/1286875346 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5e4815ee50 0x7f5e480d1090 secure :-1 s=READY pgs=1411 cs=0 l=1 rev1=1 crypto rx=0x7f5e480ba730 tx=0x7f5e3402a4a0 comp rx=0 tx=0).stop 2024-09-17T05:51:00.720 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:00.718+0000 7f5e4f077640 1 -- 172.21.15.150:0/1286875346 shutdown_connections 2024-09-17T05:51:00.721 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:00.718+0000 7f5e4f077640 1 --2- 172.21.15.150:0/1286875346 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5e4815ee50 0x7f5e480d1090 unknown :-1 s=CLOSED pgs=1411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:51:00.721 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:00.718+0000 7f5e4f077640 1 --2- 172.21.15.150:0/1286875346 >> v2:172.21.15.176:3300/0 conn(0x7f5e480b9780 0x7f5e480b3720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:51:00.721 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:00.718+0000 7f5e4f077640 1 -- 172.21.15.150:0/1286875346 >> 172.21.15.150:0/1286875346 conn(0x7f5e480d4680 msgr2=0x7f5e480d4a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:51:00.721 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:00.719+0000 7f5e4f077640 1 -- 172.21.15.150:0/1286875346 shutdown_connections 2024-09-17T05:51:00.721 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:00.719+0000 7f5e4f077640 1 -- 172.21.15.150:0/1286875346 wait complete. 2024-09-17T05:51:00.722 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:00.720+0000 7f5e4f077640 1 Processor -- start 2024-09-17T05:51:00.722 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:00.720+0000 7f5e4f077640 1 -- start start 2024-09-17T05:51:00.724 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:00.722+0000 7f5e4f077640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5e480b9780 0x7f5e48150720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:51:00.724 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:00.722+0000 7f5e4f077640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5e480d15d0 0x7f5e480b66d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:51:00.724 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:00.722+0000 7f5e4f077640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5e4815ee50 0x7f5e480b5960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:51:00.724 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:00.722+0000 7f5e4f077640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f5e480d0810 con 0x7f5e4815ee50 2024-09-17T05:51:00.724 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:00.722+0000 7f5e4f077640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f5e480d0690 con 0x7f5e480d15d0 2024-09-17T05:51:00.724 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:00.722+0000 7f5e4f077640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f5e4815f3a0 con 0x7f5e480b9780 2024-09-17T05:51:00.724 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:00.722+0000 7f5e4d614640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5e4815ee50 0x7f5e480b5960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:51:00.725 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:00.722+0000 7f5e4d614640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5e4815ee50 0x7f5e480b5960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:38732/0 (socket says 172.21.15.150:38732) 2024-09-17T05:51:00.725 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:00.722+0000 7f5e4d614640 1 -- 172.21.15.150:0/402318778 learned_addr learned my addr 172.21.15.150:0/402318778 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:51:00.725 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:00.722+0000 7f5e47fff640 1 --2- 172.21.15.150:0/402318778 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5e480d15d0 0x7f5e480b66d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:51:00.725 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:00.722+0000 7f5e4ce13640 1 --2- 172.21.15.150:0/402318778 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5e480b9780 0x7f5e48150720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:51:00.725 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:00.722+0000 7f5e4d614640 1 -- 172.21.15.150:0/402318778 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5e480b9780 msgr2=0x7f5e48150720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:51:00.725 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:00.722+0000 7f5e4d614640 1 --2- 172.21.15.150:0/402318778 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5e480b9780 0x7f5e48150720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:51:00.725 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:00.722+0000 7f5e4d614640 1 -- 172.21.15.150:0/402318778 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5e480d15d0 msgr2=0x7f5e480b66d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:51:00.725 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:00.722+0000 7f5e4d614640 1 --2- 172.21.15.150:0/402318778 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5e480d15d0 0x7f5e480b66d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:51:00.725 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:00.722+0000 7f5e4d614640 1 -- 172.21.15.150:0/402318778 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5e480b6c10 con 0x7f5e4815ee50 2024-09-17T05:51:00.725 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:00.722+0000 7f5e4ce13640 1 --2- 172.21.15.150:0/402318778 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5e480b9780 0x7f5e48150720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T05:51:00.726 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:00.722+0000 7f5e4d614640 1 --2- 172.21.15.150:0/402318778 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5e4815ee50 0x7f5e480b5960 secure :-1 s=READY pgs=1412 cs=0 l=1 rev1=1 crypto rx=0x7f5e4000cad0 tx=0x7f5e4000cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:51:00.726 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:00.722+0000 7f5e457fa640 1 -- 172.21.15.150:0/402318778 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e40016020 con 0x7f5e4815ee50 2024-09-17T05:51:00.726 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:00.723+0000 7f5e457fa640 1 -- 172.21.15.150:0/402318778 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f5e4000ad20 con 0x7f5e4815ee50 2024-09-17T05:51:00.726 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:00.723+0000 7f5e4f077640 1 -- 172.21.15.150:0/402318778 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5e481f9840 con 0x7f5e4815ee50 2024-09-17T05:51:00.726 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:00.723+0000 7f5e457fa640 1 -- 172.21.15.150:0/402318778 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e40012680 con 0x7f5e4815ee50 2024-09-17T05:51:00.726 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:00.723+0000 7f5e4f077640 1 -- 172.21.15.150:0/402318778 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5e481f9e00 con 0x7f5e4815ee50 2024-09-17T05:51:00.726 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:00.724+0000 7f5e4f077640 1 -- 172.21.15.150:0/402318778 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5e4808d100 con 0x7f5e4815ee50 2024-09-17T05:51:00.727 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:00.724+0000 7f5e457fa640 1 -- 172.21.15.150:0/402318778 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 36) ==== 103736+0+0 (secure 0 0 0) 0x7f5e40019020 con 0x7f5e4815ee50 2024-09-17T05:51:00.727 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:00.725+0000 7f5e457fa640 1 --2- 172.21.15.150:0/402318778 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f5e2c07a4e0 0x7f5e2c07c9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:51:00.727 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:00.725+0000 7f5e457fa640 1 -- 172.21.15.150:0/402318778 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(101..101 src has 1..101) ==== 5821+0+0 (secure 0 0 0) 0x7f5e4009a110 con 0x7f5e4815ee50 2024-09-17T05:51:00.727 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:00.725+0000 7f5e4ce13640 1 --2- 172.21.15.150:0/402318778 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f5e2c07a4e0 0x7f5e2c07c9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:51:00.727 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:00.726+0000 7f5e4ce13640 1 --2- 172.21.15.150:0/402318778 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f5e2c07a4e0 0x7f5e2c07c9f0 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7f5e3c009a80 tx=0x7f5e3c005cc0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:51:00.730 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:00.729+0000 7f5e457fa640 1 -- 172.21.15.150:0/402318778 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f5e4808d100 con 0x7f5e4815ee50 2024-09-17T05:51:00.939 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:00.939+0000 7f5e4f077640 1 -- 172.21.15.150:0/402318778 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f5e480b3720 con 0x7f5e4815ee50 2024-09-17T05:51:00.940 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:00.939+0000 7f5e457fa640 1 -- 172.21.15.150:0/402318778 <== mon.0 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 61 v61) ==== 94+0+5231 (secure 0 0 0) 0x7f5e40020020 con 0x7f5e4815ee50 2024-09-17T05:51:00.940 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-09-17T05:51:00.940 INFO:teuthology.orchestra.run.smithi150.stdout:{"epoch":61,"btime":"2024-09-17T05:50:29:714285+0000","default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6494,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6837/1755605193","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6835","nonce":1755605193},{"type":"v1","addr":"172.21.15.176:6837","nonce":1755605193}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":55},{"gid":7117,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6836/628081508","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6834","nonce":628081508},{"type":"v1","addr":"172.21.15.176:6836","nonce":628081508}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":55},{"gid":8061,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6835/187954104","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6833","nonce":187954104},{"type":"v1","addr":"172.21.15.150:6835","nonce":187954104}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":55}],"filesystems":[{"mdsmap":{"epoch":60,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T05:50:17.022354+0000","modified":"2024-09-17T05:50:20.052518+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":8064},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8064":{"gid":8064,"name":"c","rank":0,"incarnation":56,"state":"up:active","state_seq":3,"addr":"172.21.15.150:6834/3842369685","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6832","nonce":3842369685},{"type":"v1","addr":"172.21.15.150:6834","nonce":3842369685}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":8064,"qdb_cluster":[8064]},"id":7}]} 2024-09-17T05:51:00.941 INFO:teuthology.orchestra.run.smithi150.stderr:dumped fsmap epoch 61 2024-09-17T05:51:00.942 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:00.941+0000 7f5e4f077640 1 -- 172.21.15.150:0/402318778 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f5e2c07a4e0 msgr2=0x7f5e2c07c9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:51:00.942 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:00.941+0000 7f5e4f077640 1 --2- 172.21.15.150:0/402318778 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f5e2c07a4e0 0x7f5e2c07c9f0 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7f5e3c009a80 tx=0x7f5e3c005cc0 comp rx=0 tx=0).stop 2024-09-17T05:51:00.943 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:00.941+0000 7f5e4f077640 1 -- 172.21.15.150:0/402318778 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5e4815ee50 msgr2=0x7f5e480b5960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:51:00.943 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:00.941+0000 7f5e4f077640 1 --2- 172.21.15.150:0/402318778 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5e4815ee50 0x7f5e480b5960 secure :-1 s=READY pgs=1412 cs=0 l=1 rev1=1 crypto rx=0x7f5e4000cad0 tx=0x7f5e4000cf90 comp rx=0 tx=0).stop 2024-09-17T05:51:00.943 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:00.942+0000 7f5e4f077640 1 -- 172.21.15.150:0/402318778 shutdown_connections 2024-09-17T05:51:00.943 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:00.942+0000 7f5e4f077640 1 --2- 172.21.15.150:0/402318778 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5e480d15d0 0x7f5e480b66d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:51:00.943 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:00.942+0000 7f5e4f077640 1 --2- 172.21.15.150:0/402318778 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f5e2c07a4e0 0x7f5e2c07c9f0 unknown :-1 s=CLOSED pgs=604 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:51:00.943 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:00.942+0000 7f5e4f077640 1 --2- 172.21.15.150:0/402318778 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5e4815ee50 0x7f5e480b5960 unknown :-1 s=CLOSED pgs=1412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:51:00.943 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:00.942+0000 7f5e4f077640 1 --2- 172.21.15.150:0/402318778 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5e480b9780 0x7f5e48150720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:51:00.943 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:00.942+0000 7f5e4f077640 1 -- 172.21.15.150:0/402318778 >> 172.21.15.150:0/402318778 conn(0x7f5e480d4680 msgr2=0x7f5e480d4a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:51:00.943 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:00.942+0000 7f5e4f077640 1 -- 172.21.15.150:0/402318778 shutdown_connections 2024-09-17T05:51:00.943 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:00.942+0000 7f5e4f077640 1 -- 172.21.15.150:0/402318778 wait complete. 2024-09-17T05:51:00.955 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T05:51:01.070 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:01.069+0000 7f553a1a1640 1 -- 172.21.15.150:0/761620291 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f551c003a30 msgr2=0x7f551c003ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:51:01.070 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:01.069+0000 7f553a1a1640 1 --2- 172.21.15.150:0/761620291 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f551c003a30 0x7f551c003ea0 secure :-1 s=READY pgs=1414 cs=0 l=1 rev1=1 crypto rx=0x7f552400bb10 tx=0x7f551c005830 comp rx=0 tx=0).stop 2024-09-17T05:51:01.070 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:01.069+0000 7f5533fff640 1 -- 172.21.15.150:0/761620291 reap_dead start 2024-09-17T05:51:01.070 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:01.069+0000 7f553a1a1640 1 -- 172.21.15.150:0/761620291 shutdown_connections 2024-09-17T05:51:01.071 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:01.069+0000 7f553a1a1640 1 -- 172.21.15.150:0/761620291 >> 172.21.15.150:0/761620291 conn(0x7f55340cef30 msgr2=0x7f55340cf340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:51:01.071 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:01.069+0000 7f553a1a1640 1 -- 172.21.15.150:0/761620291 shutdown_connections 2024-09-17T05:51:01.071 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:01.069+0000 7f553a1a1640 1 -- 172.21.15.150:0/761620291 wait complete. 2024-09-17T05:51:01.071 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:01.071+0000 7f553a1a1640 1 Processor -- start 2024-09-17T05:51:01.071 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:01.071+0000 7f553a1a1640 1 -- start start 2024-09-17T05:51:01.074 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:01.072+0000 7f553a1a1640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f551c003a30 0x7f553409f9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:51:01.074 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:01.072+0000 7f553a1a1640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f553406e8c0 0x7f55341f6c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:51:01.074 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:01.072+0000 7f553a1a1640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f55341f2df0 0x7f553409ea70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:51:01.075 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:01.072+0000 7f553a1a1640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f55340ceb70 con 0x7f551c003a30 2024-09-17T05:51:01.075 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:01.072+0000 7f553a1a1640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f55340b83c0 con 0x7f553406e8c0 2024-09-17T05:51:01.075 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:01.072+0000 7f553a1a1640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f55340cecf0 con 0x7f55341f2df0 2024-09-17T05:51:01.075 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:01.072+0000 7f55337fe640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f551c003a30 0x7f553409f9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:51:01.075 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:01.073+0000 7f55337fe640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f551c003a30 0x7f553409f9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:38746/0 (socket says 172.21.15.150:38746) 2024-09-17T05:51:01.075 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:01.073+0000 7f55337fe640 1 -- 172.21.15.150:0/1143927602 learned_addr learned my addr 172.21.15.150:0/1143927602 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:51:01.075 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:01.073+0000 7f5532ffd640 1 --2- 172.21.15.150:0/1143927602 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f553406e8c0 0x7f55341f6c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:51:01.075 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:01.073+0000 7f5533fff640 1 --2- 172.21.15.150:0/1143927602 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f55341f2df0 0x7f553409ea70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:51:01.075 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:01.073+0000 7f55337fe640 1 -- 172.21.15.150:0/1143927602 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f55341f2df0 msgr2=0x7f553409ea70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:51:01.075 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:01.073+0000 7f55337fe640 1 --2- 172.21.15.150:0/1143927602 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f55341f2df0 0x7f553409ea70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:51:01.075 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:01.073+0000 7f55337fe640 1 -- 172.21.15.150:0/1143927602 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f553406e8c0 msgr2=0x7f55341f6c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:51:01.075 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:01.073+0000 7f55337fe640 1 --2- 172.21.15.150:0/1143927602 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f553406e8c0 0x7f55341f6c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:51:01.076 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:01.073+0000 7f55337fe640 1 -- 172.21.15.150:0/1143927602 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f553406f2f0 con 0x7f551c003a30 2024-09-17T05:51:01.076 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:01.073+0000 7f55337fe640 1 --2- 172.21.15.150:0/1143927602 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f551c003a30 0x7f553409f9f0 secure :-1 s=READY pgs=1415 cs=0 l=1 rev1=1 crypto rx=0x7f5524000c00 tx=0x7f5524005850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:51:01.076 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:01.073+0000 7f551bfff640 1 -- 172.21.15.150:0/1143927602 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5524040070 con 0x7f551c003a30 2024-09-17T05:51:01.076 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:01.073+0000 7f551bfff640 1 -- 172.21.15.150:0/1143927602 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f5524004250 con 0x7f551c003a30 2024-09-17T05:51:01.076 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:01.073+0000 7f551bfff640 1 -- 172.21.15.150:0/1143927602 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5524035040 con 0x7f551c003a30 2024-09-17T05:51:01.076 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:01.073+0000 7f553a1a1640 1 -- 172.21.15.150:0/1143927602 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f553409dfd0 con 0x7f551c003a30 2024-09-17T05:51:01.076 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:01.073+0000 7f553a1a1640 1 -- 172.21.15.150:0/1143927602 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f553409e270 con 0x7f551c003a30 2024-09-17T05:51:01.077 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:01.074+0000 7f553a1a1640 1 -- 172.21.15.150:0/1143927602 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f55340cded0 con 0x7f551c003a30 2024-09-17T05:51:01.077 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:01.075+0000 7f551bfff640 1 -- 172.21.15.150:0/1143927602 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 36) ==== 103736+0+0 (secure 0 0 0) 0x7f5524038020 con 0x7f551c003a30 2024-09-17T05:51:01.077 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:01.075+0000 7f551bfff640 1 --2- 172.21.15.150:0/1143927602 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f552007a4e0 0x7f552007c9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:51:01.077 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:01.076+0000 7f551bfff640 1 -- 172.21.15.150:0/1143927602 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(101..101 src has 1..101) ==== 5821+0+0 (secure 0 0 0) 0x7f55240ba560 con 0x7f551c003a30 2024-09-17T05:51:01.077 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:01.076+0000 7f5532ffd640 1 --2- 172.21.15.150:0/1143927602 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f552007a4e0 0x7f552007c9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:51:01.077 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:01.076+0000 7f5532ffd640 1 --2- 172.21.15.150:0/1143927602 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f552007a4e0 0x7f552007c9f0 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7f55341e8640 tx=0x7f5528006d00 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:51:01.080 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:01.080+0000 7f551bfff640 1 -- 172.21.15.150:0/1143927602 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f552402c040 con 0x7f551c003a30 2024-09-17T05:51:01.290 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:01.290+0000 7f553a1a1640 1 -- 172.21.15.150:0/1143927602 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f55341e5bf0 con 0x7f551c003a30 2024-09-17T05:51:01.291 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:01.290+0000 7f551bfff640 1 -- 172.21.15.150:0/1143927602 <== mon.0 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 61 v61) ==== 94+0+5231 (secure 0 0 0) 0x7f5524088640 con 0x7f551c003a30 2024-09-17T05:51:01.291 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-09-17T05:51:01.292 INFO:teuthology.orchestra.run.smithi150.stdout:{"epoch":61,"btime":"2024-09-17T05:50:29:714285+0000","default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6494,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6837/1755605193","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6835","nonce":1755605193},{"type":"v1","addr":"172.21.15.176:6837","nonce":1755605193}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":55},{"gid":7117,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6836/628081508","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6834","nonce":628081508},{"type":"v1","addr":"172.21.15.176:6836","nonce":628081508}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":55},{"gid":8061,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6835/187954104","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6833","nonce":187954104},{"type":"v1","addr":"172.21.15.150:6835","nonce":187954104}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":55}],"filesystems":[{"mdsmap":{"epoch":60,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T05:50:17.022354+0000","modified":"2024-09-17T05:50:20.052518+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":8064},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8064":{"gid":8064,"name":"c","rank":0,"incarnation":56,"state":"up:active","state_seq":3,"addr":"172.21.15.150:6834/3842369685","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6832","nonce":3842369685},{"type":"v1","addr":"172.21.15.150:6834","nonce":3842369685}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":8064,"qdb_cluster":[8064]},"id":7}]} 2024-09-17T05:51:01.292 INFO:teuthology.orchestra.run.smithi150.stderr:dumped fsmap epoch 61 2024-09-17T05:51:01.294 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:01.293+0000 7f553a1a1640 1 -- 172.21.15.150:0/1143927602 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f552007a4e0 msgr2=0x7f552007c9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:51:01.294 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:01.293+0000 7f553a1a1640 1 --2- 172.21.15.150:0/1143927602 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f552007a4e0 0x7f552007c9f0 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7f55341e8640 tx=0x7f5528006d00 comp rx=0 tx=0).stop 2024-09-17T05:51:01.294 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:01.293+0000 7f553a1a1640 1 -- 172.21.15.150:0/1143927602 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f551c003a30 msgr2=0x7f553409f9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:51:01.294 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:01.293+0000 7f553a1a1640 1 --2- 172.21.15.150:0/1143927602 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f551c003a30 0x7f553409f9f0 secure :-1 s=READY pgs=1415 cs=0 l=1 rev1=1 crypto rx=0x7f5524000c00 tx=0x7f5524005850 comp rx=0 tx=0).stop 2024-09-17T05:51:01.294 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:01.293+0000 7f553a1a1640 1 -- 172.21.15.150:0/1143927602 shutdown_connections 2024-09-17T05:51:01.294 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:01.293+0000 7f553a1a1640 1 --2- 172.21.15.150:0/1143927602 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f553406e8c0 0x7f55341f6c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:51:01.294 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:01.293+0000 7f553a1a1640 1 --2- 172.21.15.150:0/1143927602 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f552007a4e0 0x7f552007c9f0 unknown :-1 s=CLOSED pgs=605 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:51:01.294 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:01.293+0000 7f553a1a1640 1 --2- 172.21.15.150:0/1143927602 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f55341f2df0 0x7f553409ea70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:51:01.294 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:01.293+0000 7f553a1a1640 1 --2- 172.21.15.150:0/1143927602 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f551c003a30 0x7f553409f9f0 unknown :-1 s=CLOSED pgs=1415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:51:01.294 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:01.293+0000 7f553a1a1640 1 -- 172.21.15.150:0/1143927602 >> 172.21.15.150:0/1143927602 conn(0x7f55340cef30 msgr2=0x7f55340cf340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:51:01.294 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:01.293+0000 7f553a1a1640 1 -- 172.21.15.150:0/1143927602 shutdown_connections 2024-09-17T05:51:01.294 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:01.293+0000 7f553a1a1640 1 -- 172.21.15.150:0/1143927602 wait complete. 2024-09-17T05:51:01.305 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T05:51:01.419 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:01.417+0000 7fa269027640 1 -- 172.21.15.150:0/1169486422 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa26415ee30 msgr2=0x7fa2640b2840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:51:01.420 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:01.417+0000 7fa269027640 1 --2- 172.21.15.150:0/1169486422 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa26415ee30 0x7fa2640b2840 secure :-1 s=READY pgs=1416 cs=0 l=1 rev1=1 crypto rx=0x7fa254005fd0 tx=0x7fa25402a5d0 comp rx=0 tx=0).stop 2024-09-17T05:51:01.420 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:01.418+0000 7fa269027640 1 -- 172.21.15.150:0/1169486422 shutdown_connections 2024-09-17T05:51:01.420 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:01.418+0000 7fa269027640 1 --2- 172.21.15.150:0/1169486422 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa2640b5410 0x7fa2640b5820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:51:01.420 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:01.418+0000 7fa269027640 1 --2- 172.21.15.150:0/1169486422 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa26415ee30 0x7fa2640b2840 unknown :-1 s=CLOSED pgs=1416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:51:01.420 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:01.418+0000 7fa269027640 1 -- 172.21.15.150:0/1169486422 >> 172.21.15.150:0/1169486422 conn(0x7fa2640b2fd0 msgr2=0x7fa2640b33e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:51:01.420 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:01.418+0000 7fa269027640 1 -- 172.21.15.150:0/1169486422 shutdown_connections 2024-09-17T05:51:01.421 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:01.418+0000 7fa269027640 1 -- 172.21.15.150:0/1169486422 wait complete. 2024-09-17T05:51:01.425 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:01.419+0000 7fa269027640 1 Processor -- start 2024-09-17T05:51:01.425 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:01.420+0000 7fa269027640 1 -- start start 2024-09-17T05:51:01.425 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:01.421+0000 7fa269027640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa2640b5410 0x7fa26409bdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:51:01.426 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:01.421+0000 7fa269027640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa2640cf7c0 0x7fa264159990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:51:01.426 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:01.421+0000 7fa269027640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa26415ee30 0x7fa2641e4bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:51:01.426 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:01.421+0000 7fa269027640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7fa2640b6150 con 0x7fa2640b5410 2024-09-17T05:51:01.426 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:01.421+0000 7fa269027640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fa2640b5fd0 con 0x7fa26415ee30 2024-09-17T05:51:01.426 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:01.421+0000 7fa269027640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fa2640b62d0 con 0x7fa2640cf7c0 2024-09-17T05:51:01.426 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:01.421+0000 7fa262d9d640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa2640b5410 0x7fa26409bdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:51:01.426 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:01.421+0000 7fa262d9d640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa2640b5410 0x7fa26409bdd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:38764/0 (socket says 172.21.15.150:38764) 2024-09-17T05:51:01.426 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:01.421+0000 7fa262d9d640 1 -- 172.21.15.150:0/877868432 learned_addr learned my addr 172.21.15.150:0/877868432 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:51:01.426 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:01.421+0000 7fa25bfff640 1 --2- 172.21.15.150:0/877868432 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa2640cf7c0 0x7fa264159990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:51:01.426 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:01.421+0000 7fa26359e640 1 --2- 172.21.15.150:0/877868432 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa26415ee30 0x7fa2641e4bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:51:01.427 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:01.421+0000 7fa262d9d640 1 -- 172.21.15.150:0/877868432 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa2640cf7c0 msgr2=0x7fa264159990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:51:01.427 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:01.421+0000 7fa262d9d640 1 --2- 172.21.15.150:0/877868432 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa2640cf7c0 0x7fa264159990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:51:01.427 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:01.421+0000 7fa262d9d640 1 -- 172.21.15.150:0/877868432 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa26415ee30 msgr2=0x7fa2641e4bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:51:01.427 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:01.421+0000 7fa262d9d640 1 --2- 172.21.15.150:0/877868432 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa26415ee30 0x7fa2641e4bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:51:01.427 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:01.421+0000 7fa262d9d640 1 -- 172.21.15.150:0/877868432 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa26409c590 con 0x7fa2640b5410 2024-09-17T05:51:01.427 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:01.421+0000 7fa262d9d640 1 --2- 172.21.15.150:0/877868432 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa2640b5410 0x7fa26409bdd0 secure :-1 s=READY pgs=1417 cs=0 l=1 rev1=1 crypto rx=0x7fa254034040 tx=0x7fa2540035f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:51:01.427 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:01.422+0000 7fa25b7fe640 1 -- 172.21.15.150:0/877868432 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa25403e030 con 0x7fa2640b5410 2024-09-17T05:51:01.427 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:01.422+0000 7fa25b7fe640 1 -- 172.21.15.150:0/877868432 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa254003ae0 con 0x7fa2640b5410 2024-09-17T05:51:01.427 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:01.422+0000 7fa269027640 1 -- 172.21.15.150:0/877868432 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa26409c870 con 0x7fa2640b5410 2024-09-17T05:51:01.427 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:01.422+0000 7fa25b7fe640 1 -- 172.21.15.150:0/877868432 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa254035040 con 0x7fa2640b5410 2024-09-17T05:51:01.427 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:01.422+0000 7fa269027640 1 -- 172.21.15.150:0/877868432 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa26409ce30 con 0x7fa2640b5410 2024-09-17T05:51:01.427 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:01.423+0000 7fa269027640 1 -- 172.21.15.150:0/877868432 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa2640b2840 con 0x7fa2640b5410 2024-09-17T05:51:01.427 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:01.423+0000 7fa25b7fe640 1 -- 172.21.15.150:0/877868432 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 36) ==== 103736+0+0 (secure 0 0 0) 0x7fa254041030 con 0x7fa2640b5410 2024-09-17T05:51:01.428 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:01.424+0000 7fa25b7fe640 1 --2- 172.21.15.150:0/877868432 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fa24407a4e0 0x7fa24407c9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:51:01.428 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:01.424+0000 7fa25b7fe640 1 -- 172.21.15.150:0/877868432 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(101..101 src has 1..101) ==== 5821+0+0 (secure 0 0 0) 0x7fa2540ba3c0 con 0x7fa2640b5410 2024-09-17T05:51:01.428 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:01.424+0000 7fa25bfff640 1 --2- 172.21.15.150:0/877868432 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fa24407a4e0 0x7fa24407c9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:51:01.428 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:01.425+0000 7fa25bfff640 1 --2- 172.21.15.150:0/877868432 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fa24407a4e0 0x7fa24407c9f0 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7fa2641e4420 tx=0x7fa24c009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:51:01.429 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:01.428+0000 7fa25b7fe640 1 -- 172.21.15.150:0/877868432 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fa254083cb0 con 0x7fa2640b5410 2024-09-17T05:51:01.606 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:01.606+0000 7fa269027640 1 -- 172.21.15.150:0/877868432 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fa2640b1a20 con 0x7fa2640b5410 2024-09-17T05:51:01.607 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:01.607+0000 7fa25b7fe640 1 -- 172.21.15.150:0/877868432 <== mon.0 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v101) ==== 74+0+16884 (secure 0 0 0) 0x7fa2540886e0 con 0x7fa2640b5410 2024-09-17T05:51:01.608 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-09-17T05:51:01.608 INFO:teuthology.orchestra.run.smithi150.stdout:{"epoch":101,"fsid":"9f2e05e9-d629-47b3-b26b-1360655b7d20","created":"2024-09-17T05:41:32.502979+0000","modified":"2024-09-17T05:50:18.663833+0000","last_up_change":"2024-09-17T05:41:46.150225+0000","last_in_change":"2024-09-17T05:41:36.120274+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T05:41:46.860779+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs_metadata","create_time":"2024-09-17T05:50:14.652062+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"100","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs_data","create_time":"2024-09-17T05:50:15.994053+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"101","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"4f31c018-c8a4-4d6d-b0c2-a597c47aae4a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6800","nonce":479374392},{"type":"v1","addr":"172.21.15.150:6801","nonce":479374392}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6802","nonce":479374392},{"type":"v1","addr":"172.21.15.150:6803","nonce":479374392}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6806","nonce":479374392},{"type":"v1","addr":"172.21.15.150:6807","nonce":479374392}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6804","nonce":479374392},{"type":"v1","addr":"172.21.15.150:6805","nonce":479374392}]},"public_addr":"172.21.15.150:6801/479374392","cluster_addr":"172.21.15.150:6803/479374392","heartbeat_back_addr":"172.21.15.150:6807/479374392","heartbeat_front_addr":"172.21.15.150:6805/479374392","state":["exists","up"]},{"osd":1,"uuid":"6ff4a573-500b-4e04-9de3-39265ead78b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6824","nonce":913899800},{"type":"v1","addr":"172.21.15.150:6825","nonce":913899800}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6826","nonce":913899800},{"type":"v1","addr":"172.21.15.150:6827","nonce":913899800}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6830","nonce":913899800},{"type":"v1","addr":"172.21.15.150:6831","nonce":913899800}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6828","nonce":913899800},{"type":"v1","addr":"172.21.15.150:6829","nonce":913899800}]},"public_addr":"172.21.15.150:6825/913899800","cluster_addr":"172.21.15.150:6827/913899800","heartbeat_back_addr":"172.21.15.150:6831/913899800","heartbeat_front_addr":"172.21.15.150:6829/913899800","state":["exists","up"]},{"osd":2,"uuid":"bffea6f9-2465-4182-b205-00436c41ac1c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6816","nonce":363718461},{"type":"v1","addr":"172.21.15.150:6817","nonce":363718461}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6818","nonce":363718461},{"type":"v1","addr":"172.21.15.150:6819","nonce":363718461}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6822","nonce":363718461},{"type":"v1","addr":"172.21.15.150:6823","nonce":363718461}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6820","nonce":363718461},{"type":"v1","addr":"172.21.15.150:6821","nonce":363718461}]},"public_addr":"172.21.15.150:6817/363718461","cluster_addr":"172.21.15.150:6819/363718461","heartbeat_back_addr":"172.21.15.150:6823/363718461","heartbeat_front_addr":"172.21.15.150:6821/363718461","state":["exists","up"]},{"osd":3,"uuid":"cda70430-d1e1-427e-b04e-56db4031d078","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6808","nonce":3550994626},{"type":"v1","addr":"172.21.15.150:6809","nonce":3550994626}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6810","nonce":3550994626},{"type":"v1","addr":"172.21.15.150:6811","nonce":3550994626}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6814","nonce":3550994626},{"type":"v1","addr":"172.21.15.150:6815","nonce":3550994626}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6812","nonce":3550994626},{"type":"v1","addr":"172.21.15.150:6813","nonce":3550994626}]},"public_addr":"172.21.15.150:6809/3550994626","cluster_addr":"172.21.15.150:6811/3550994626","heartbeat_back_addr":"172.21.15.150:6815/3550994626","heartbeat_front_addr":"172.21.15.150:6813/3550994626","state":["exists","up"]},{"osd":4,"uuid":"3a0277fb-5e1e-4f68-bb2d-9a8a0152f64a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6810","nonce":2718261497},{"type":"v1","addr":"172.21.15.176:6811","nonce":2718261497}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6812","nonce":2718261497},{"type":"v1","addr":"172.21.15.176:6813","nonce":2718261497}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6816","nonce":2718261497},{"type":"v1","addr":"172.21.15.176:6817","nonce":2718261497}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6814","nonce":2718261497},{"type":"v1","addr":"172.21.15.176:6815","nonce":2718261497}]},"public_addr":"172.21.15.176:6811/2718261497","cluster_addr":"172.21.15.176:6813/2718261497","heartbeat_back_addr":"172.21.15.176:6817/2718261497","heartbeat_front_addr":"172.21.15.176:6815/2718261497","state":["exists","up"]},{"osd":5,"uuid":"33aebee6-0315-40b7-a11c-6702f0be494d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6818","nonce":2049295774},{"type":"v1","addr":"172.21.15.176:6819","nonce":2049295774}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6820","nonce":2049295774},{"type":"v1","addr":"172.21.15.176:6821","nonce":2049295774}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6824","nonce":2049295774},{"type":"v1","addr":"172.21.15.176:6825","nonce":2049295774}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6822","nonce":2049295774},{"type":"v1","addr":"172.21.15.176:6823","nonce":2049295774}]},"public_addr":"172.21.15.176:6819/2049295774","cluster_addr":"172.21.15.176:6821/2049295774","heartbeat_back_addr":"172.21.15.176:6825/2049295774","heartbeat_front_addr":"172.21.15.176:6823/2049295774","state":["exists","up"]},{"osd":6,"uuid":"4d24f360-6751-4263-841b-d77793d33540","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6826","nonce":2164458476},{"type":"v1","addr":"172.21.15.176:6827","nonce":2164458476}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6828","nonce":2164458476},{"type":"v1","addr":"172.21.15.176:6829","nonce":2164458476}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6832","nonce":2164458476},{"type":"v1","addr":"172.21.15.176:6833","nonce":2164458476}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6830","nonce":2164458476},{"type":"v1","addr":"172.21.15.176:6831","nonce":2164458476}]},"public_addr":"172.21.15.176:6827/2164458476","cluster_addr":"172.21.15.176:6829/2164458476","heartbeat_back_addr":"172.21.15.176:6833/2164458476","heartbeat_front_addr":"172.21.15.176:6831/2164458476","state":["exists","up"]},{"osd":7,"uuid":"c8594fda-c74a-4ba9-8277-caf101d58ca1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6802","nonce":3239587708},{"type":"v1","addr":"172.21.15.176:6803","nonce":3239587708}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6804","nonce":3239587708},{"type":"v1","addr":"172.21.15.176:6805","nonce":3239587708}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6808","nonce":3239587708},{"type":"v1","addr":"172.21.15.176:6809","nonce":3239587708}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6806","nonce":3239587708},{"type":"v1","addr":"172.21.15.176:6807","nonce":3239587708}]},"public_addr":"172.21.15.176:6803/3239587708","cluster_addr":"172.21.15.176:6805/3239587708","heartbeat_back_addr":"172.21.15.176:6809/3239587708","heartbeat_front_addr":"172.21.15.176:6807/3239587708","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:41:41.905151+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:41:42.705679+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:41:42.459673+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:41:42.440819+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:41:42.668428+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:41:42.694972+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:41:43.078535+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:41:42.363539+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":7,"snaps":[{"begin":2,"length":2}]},{"pool":9,"snaps":[{"begin":2,"length":2}]},{"pool":11,"snaps":[{"begin":2,"length":2}]},{"pool":13,"snaps":[{"begin":2,"length":2}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T05:51:01.610 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:01.609+0000 7fa269027640 1 -- 172.21.15.150:0/877868432 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fa24407a4e0 msgr2=0x7fa24407c9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:51:01.610 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:01.609+0000 7fa269027640 1 --2- 172.21.15.150:0/877868432 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fa24407a4e0 0x7fa24407c9f0 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7fa2641e4420 tx=0x7fa24c009040 comp rx=0 tx=0).stop 2024-09-17T05:51:01.610 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:01.609+0000 7fa269027640 1 -- 172.21.15.150:0/877868432 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa2640b5410 msgr2=0x7fa26409bdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:51:01.610 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:01.609+0000 7fa269027640 1 --2- 172.21.15.150:0/877868432 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa2640b5410 0x7fa26409bdd0 secure :-1 s=READY pgs=1417 cs=0 l=1 rev1=1 crypto rx=0x7fa254034040 tx=0x7fa2540035f0 comp rx=0 tx=0).stop 2024-09-17T05:51:01.610 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:01.609+0000 7fa269027640 1 -- 172.21.15.150:0/877868432 shutdown_connections 2024-09-17T05:51:01.610 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:01.609+0000 7fa269027640 1 --2- 172.21.15.150:0/877868432 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa26415ee30 0x7fa2641e4bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:51:01.610 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:01.609+0000 7fa269027640 1 --2- 172.21.15.150:0/877868432 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fa24407a4e0 0x7fa24407c9f0 unknown :-1 s=CLOSED pgs=606 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:51:01.610 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:01.609+0000 7fa269027640 1 --2- 172.21.15.150:0/877868432 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa2640cf7c0 0x7fa264159990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:51:01.610 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:01.609+0000 7fa269027640 1 --2- 172.21.15.150:0/877868432 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa2640b5410 0x7fa26409bdd0 unknown :-1 s=CLOSED pgs=1417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:51:01.611 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:01.609+0000 7fa269027640 1 -- 172.21.15.150:0/877868432 >> 172.21.15.150:0/877868432 conn(0x7fa2640b2fd0 msgr2=0x7fa2640d1c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:51:01.611 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:01.609+0000 7fa269027640 1 -- 172.21.15.150:0/877868432 shutdown_connections 2024-09-17T05:51:01.611 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:01.609+0000 7fa269027640 1 -- 172.21.15.150:0/877868432 wait complete. 2024-09-17T05:51:01.622 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-09-17T05:51:01.622 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T05:51:01.756 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:01.755+0000 7f6c1b732640 1 -- 172.21.15.150:0/68481414 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6c140b3af0 msgr2=0x7f6c14071980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:51:01.757 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:01.755+0000 7f6c1b732640 1 --2- 172.21.15.150:0/68481414 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6c140b3af0 0x7f6c14071980 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f6c04005fd0 tx=0x7f6c0402a7f0 comp rx=0 tx=0).stop 2024-09-17T05:51:01.757 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:01.755+0000 7f6c1b732640 1 -- 172.21.15.150:0/68481414 shutdown_connections 2024-09-17T05:51:01.757 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:01.755+0000 7f6c1b732640 1 --2- 172.21.15.150:0/68481414 >> v2:172.21.15.176:3300/0 conn(0x7f6c1406ddb0 0x7f6c1406e1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:51:01.757 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:01.755+0000 7f6c1b732640 1 --2- 172.21.15.150:0/68481414 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6c140b3af0 0x7f6c14071980 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:51:01.757 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:01.755+0000 7f6c1b732640 1 -- 172.21.15.150:0/68481414 >> 172.21.15.150:0/68481414 conn(0x7f6c140738b0 msgr2=0x7f6c14073cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:51:01.757 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:01.755+0000 7f6c1b732640 1 -- 172.21.15.150:0/68481414 shutdown_connections 2024-09-17T05:51:01.757 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:01.755+0000 7f6c1b732640 1 -- 172.21.15.150:0/68481414 wait complete. 2024-09-17T05:51:01.758 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:01.758+0000 7f6c1b732640 1 Processor -- start 2024-09-17T05:51:01.758 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:01.758+0000 7f6c1b732640 1 -- start start 2024-09-17T05:51:01.762 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:01.760+0000 7f6c1b732640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6c1406ddb0 0x7f6c141e69c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:51:01.762 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:01.760+0000 7f6c1b732640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6c140b3af0 0x7f6c14142bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:51:01.762 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:01.760+0000 7f6c1b732640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6c140ce450 0x7f6c1415a3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:51:01.762 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:01.760+0000 7f6c1b732640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f6c14070580 con 0x7f6c1406ddb0 2024-09-17T05:51:01.762 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:01.760+0000 7f6c1b732640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f6c14070400 con 0x7f6c140b3af0 2024-09-17T05:51:01.762 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:01.760+0000 7f6c1b732640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f6c14070700 con 0x7f6c140ce450 2024-09-17T05:51:01.763 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:01.761+0000 7f6c18ccd640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6c140b3af0 0x7f6c14142bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:51:01.763 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:01.761+0000 7f6c18ccd640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6c140b3af0 0x7f6c14142bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3300/0 says I am v2:172.21.15.150:39858/0 (socket says 172.21.15.150:39858) 2024-09-17T05:51:01.763 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:01.761+0000 7f6c18ccd640 1 -- 172.21.15.150:0/3748145183 learned_addr learned my addr 172.21.15.150:0/3748145183 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:51:01.763 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:01.761+0000 7f6c19ccf640 1 --2- 172.21.15.150:0/3748145183 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6c140ce450 0x7f6c1415a3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:51:01.763 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:01.761+0000 7f6c194ce640 1 --2- 172.21.15.150:0/3748145183 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6c1406ddb0 0x7f6c141e69c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:51:01.763 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:01.761+0000 7f6c19ccf640 1 -- 172.21.15.150:0/3748145183 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6c140b3af0 msgr2=0x7f6c14142bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:51:01.763 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:01.761+0000 7f6c19ccf640 1 --2- 172.21.15.150:0/3748145183 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6c140b3af0 0x7f6c14142bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:51:01.763 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:01.761+0000 7f6c19ccf640 1 -- 172.21.15.150:0/3748145183 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6c1406ddb0 msgr2=0x7f6c141e69c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:51:01.763 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:01.761+0000 7f6c19ccf640 1 --2- 172.21.15.150:0/3748145183 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6c1406ddb0 0x7f6c141e69c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:51:01.763 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:01.761+0000 7f6c19ccf640 1 -- 172.21.15.150:0/3748145183 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6c140cac90 con 0x7f6c140ce450 2024-09-17T05:51:01.764 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:01.761+0000 7f6c18ccd640 1 --2- 172.21.15.150:0/3748145183 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6c140b3af0 0x7f6c14142bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T05:51:01.764 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:01.761+0000 7f6c194ce640 1 --2- 172.21.15.150:0/3748145183 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6c1406ddb0 0x7f6c141e69c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:51:01.764 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:01.762+0000 7f6c19ccf640 1 --2- 172.21.15.150:0/3748145183 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6c140ce450 0x7f6c1415a3c0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f6c0800e640 tx=0x7f6c0800eb00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:51:01.764 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:01.763+0000 7f6c11ffb640 1 -- 172.21.15.150:0/3748145183 <== mon.2 v2:172.21.15.176:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c08004220 con 0x7f6c140ce450 2024-09-17T05:51:01.765 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:01.763+0000 7f6c11ffb640 1 -- 172.21.15.150:0/3748145183 <== mon.2 v2:172.21.15.176:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f6c08005020 con 0x7f6c140ce450 2024-09-17T05:51:01.765 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:01.763+0000 7f6c11ffb640 1 -- 172.21.15.150:0/3748145183 <== mon.2 v2:172.21.15.176:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c08005470 con 0x7f6c140ce450 2024-09-17T05:51:01.765 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:01.763+0000 7f6c1b732640 1 -- 172.21.15.150:0/3748145183 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6c141f9530 con 0x7f6c140ce450 2024-09-17T05:51:01.765 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:01.764+0000 7f6c1b732640 1 -- 172.21.15.150:0/3748145183 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f6c141f9af0 con 0x7f6c140ce450 2024-09-17T05:51:01.767 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:01.766+0000 7f6c11ffb640 1 -- 172.21.15.150:0/3748145183 <== mon.2 v2:172.21.15.176:3301/0 4 ==== mgrmap(e 36) ==== 103736+0+0 (secure 0 0 0) 0x7f6c0800c810 con 0x7f6c140ce450 2024-09-17T05:51:01.767 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:01.767+0000 7f6c1b732640 1 -- 172.21.15.150:0/3748145183 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6c14070c20 con 0x7f6c140ce450 2024-09-17T05:51:01.768 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:01.767+0000 7f6c11ffb640 1 --2- 172.21.15.150:0/3748145183 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f6c0007a5e0 0x7f6c0007caf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:51:01.768 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:01.768+0000 7f6c11ffb640 1 -- 172.21.15.150:0/3748145183 <== mon.2 v2:172.21.15.176:3301/0 5 ==== osd_map(101..101 src has 1..101) ==== 5821+0+0 (secure 0 0 0) 0x7f6c0809a130 con 0x7f6c140ce450 2024-09-17T05:51:01.769 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:01.768+0000 7f6c194ce640 1 --2- 172.21.15.150:0/3748145183 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f6c0007a5e0 0x7f6c0007caf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:51:01.772 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:01.771+0000 7f6c194ce640 1 --2- 172.21.15.150:0/3748145183 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f6c0007a5e0 0x7f6c0007caf0 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7f6c0c000f60 tx=0x7f6c0c009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:51:01.777 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:01.777+0000 7f6c11ffb640 1 -- 172.21.15.150:0/3748145183 <== mon.2 v2:172.21.15.176:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f6c08064050 con 0x7f6c140ce450 2024-09-17T05:51:01.999 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:01.998+0000 7f6c11ffb640 1 -- 172.21.15.150:0/3748145183 <== mon.2 v2:172.21.15.176:3301/0 7 ==== mgrmap(e 37) ==== 103787+0+0 (secure 0 0 0) 0x7f6c0805fbc0 con 0x7f6c140ce450 2024-09-17T05:51:02.192 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:02.192+0000 7f6c1b732640 1 -- 172.21.15.150:0/3748145183 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f6c141447f0 con 0x7f6c140ce450 2024-09-17T05:51:02.193 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:02.193+0000 7f6c11ffb640 1 -- 172.21.15.150:0/3748145183 <== mon.2 v2:172.21.15.176:3301/0 8 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 61 v61) ==== 94+0+5231 (secure 0 0 0) 0x7f6c0805be20 con 0x7f6c140ce450 2024-09-17T05:51:02.193 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-09-17T05:51:02.194 INFO:teuthology.orchestra.run.smithi150.stdout:{"epoch":61,"btime":"2024-09-17T05:50:29:714285+0000","default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6494,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6837/1755605193","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6835","nonce":1755605193},{"type":"v1","addr":"172.21.15.176:6837","nonce":1755605193}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":55},{"gid":7117,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6836/628081508","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6834","nonce":628081508},{"type":"v1","addr":"172.21.15.176:6836","nonce":628081508}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":55},{"gid":8061,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6835/187954104","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6833","nonce":187954104},{"type":"v1","addr":"172.21.15.150:6835","nonce":187954104}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":55}],"filesystems":[{"mdsmap":{"epoch":60,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T05:50:17.022354+0000","modified":"2024-09-17T05:50:20.052518+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":8064},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8064":{"gid":8064,"name":"c","rank":0,"incarnation":56,"state":"up:active","state_seq":3,"addr":"172.21.15.150:6834/3842369685","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6832","nonce":3842369685},{"type":"v1","addr":"172.21.15.150:6834","nonce":3842369685}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":8064,"qdb_cluster":[8064]},"id":7}]} 2024-09-17T05:51:02.194 INFO:teuthology.orchestra.run.smithi150.stderr:dumped fsmap epoch 61 2024-09-17T05:51:02.197 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:02.196+0000 7f6c1b732640 1 -- 172.21.15.150:0/3748145183 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f6c0007a5e0 msgr2=0x7f6c0007caf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:51:02.197 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:02.196+0000 7f6c1b732640 1 --2- 172.21.15.150:0/3748145183 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f6c0007a5e0 0x7f6c0007caf0 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7f6c0c000f60 tx=0x7f6c0c009040 comp rx=0 tx=0).stop 2024-09-17T05:51:02.197 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:02.196+0000 7f6c1b732640 1 -- 172.21.15.150:0/3748145183 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6c140ce450 msgr2=0x7f6c1415a3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:51:02.198 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:02.196+0000 7f6c1b732640 1 --2- 172.21.15.150:0/3748145183 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6c140ce450 0x7f6c1415a3c0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f6c0800e640 tx=0x7f6c0800eb00 comp rx=0 tx=0).stop 2024-09-17T05:51:02.198 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:02.196+0000 7f6c1b732640 1 -- 172.21.15.150:0/3748145183 shutdown_connections 2024-09-17T05:51:02.198 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:02.196+0000 7f6c1b732640 1 --2- 172.21.15.150:0/3748145183 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6c140b3af0 0x7f6c14142bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:51:02.198 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:02.196+0000 7f6c1b732640 1 --2- 172.21.15.150:0/3748145183 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f6c0007a5e0 0x7f6c0007caf0 unknown :-1 s=CLOSED pgs=607 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:51:02.198 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:02.196+0000 7f6c1b732640 1 --2- 172.21.15.150:0/3748145183 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6c140ce450 0x7f6c1415a3c0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:51:02.198 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:02.196+0000 7f6c1b732640 1 --2- 172.21.15.150:0/3748145183 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6c1406ddb0 0x7f6c141e69c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:51:02.198 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:02.197+0000 7f6c1b732640 1 -- 172.21.15.150:0/3748145183 >> 172.21.15.150:0/3748145183 conn(0x7f6c140738b0 msgr2=0x7f6c1415b680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:51:02.198 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:02.197+0000 7f6c1b732640 1 -- 172.21.15.150:0/3748145183 shutdown_connections 2024-09-17T05:51:02.198 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:02.197+0000 7f6c1b732640 1 -- 172.21.15.150:0/3748145183 wait complete. 2024-09-17T05:51:02.217 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T05:51:02.388 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:02.387+0000 7f53ab64d640 1 -- 172.21.15.150:0/1727819367 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f53a40ce370 msgr2=0x7f53a40cbc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:51:02.388 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:02.387+0000 7f53ab64d640 1 --2- 172.21.15.150:0/1727819367 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f53a40ce370 0x7f53a40cbc30 secure :-1 s=READY pgs=1419 cs=0 l=1 rev1=1 crypto rx=0x7f53a40738d0 tx=0x7f539c02aa30 comp rx=0 tx=0).stop 2024-09-17T05:51:02.388 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:02.387+0000 7f53ab64d640 1 -- 172.21.15.150:0/1727819367 shutdown_connections 2024-09-17T05:51:02.388 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:02.387+0000 7f53ab64d640 1 --2- 172.21.15.150:0/1727819367 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f53a40ce370 0x7f53a40cbc30 unknown :-1 s=CLOSED pgs=1419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:51:02.388 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:02.387+0000 7f53ab64d640 1 --2- 172.21.15.150:0/1727819367 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f53a40cda20 0x7f53a40cde30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:51:02.388 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:02.387+0000 7f53ab64d640 1 --2- 172.21.15.150:0/1727819367 >> v2:172.21.15.176:3300/0 conn(0x7f53a40b5ff0 0x7f53a40b67a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:51:02.389 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:02.387+0000 7f53ab64d640 1 -- 172.21.15.150:0/1727819367 >> 172.21.15.150:0/1727819367 conn(0x7f53a40b2e80 msgr2=0x7f53a40b3290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:51:02.389 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:02.387+0000 7f53ab64d640 1 -- 172.21.15.150:0/1727819367 shutdown_connections 2024-09-17T05:51:02.389 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:02.387+0000 7f53ab64d640 1 -- 172.21.15.150:0/1727819367 wait complete. 2024-09-17T05:51:02.394 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:02.389+0000 7f53ab64d640 1 Processor -- start 2024-09-17T05:51:02.394 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:02.389+0000 7f53ab64d640 1 -- start start 2024-09-17T05:51:02.395 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:02.390+0000 7f53ab64d640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f53a40b5ff0 0x7f53a40b1ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:51:02.395 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:02.390+0000 7f53ab64d640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f53a40cda20 0x7f53a409bf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:51:02.395 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:02.390+0000 7f53ab64d640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f53a40ce370 0x7f53a409c440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:51:02.395 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:02.390+0000 7f53ab64d640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f53a40cc5c0 con 0x7f53a40b5ff0 2024-09-17T05:51:02.395 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:02.390+0000 7f53ab64d640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f53a40cc440 con 0x7f53a40cda20 2024-09-17T05:51:02.395 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:02.390+0000 7f53ab64d640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f53a40cc740 con 0x7f53a40ce370 2024-09-17T05:51:02.395 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:02.390+0000 7f53a93e9640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f53a40b5ff0 0x7f53a40b1ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:51:02.395 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:02.391+0000 7f53a93e9640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f53a40b5ff0 0x7f53a40b1ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:38786/0 (socket says 172.21.15.150:38786) 2024-09-17T05:51:02.395 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:02.391+0000 7f53a93e9640 1 -- 172.21.15.150:0/4264135267 learned_addr learned my addr 172.21.15.150:0/4264135267 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:51:02.395 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:02.391+0000 7f53a8be8640 1 --2- 172.21.15.150:0/4264135267 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f53a40cda20 0x7f53a409bf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:51:02.395 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:02.391+0000 7f53a9bea640 1 --2- 172.21.15.150:0/4264135267 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f53a40ce370 0x7f53a409c440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:51:02.395 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:02.391+0000 7f53a93e9640 1 -- 172.21.15.150:0/4264135267 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f53a40ce370 msgr2=0x7f53a409c440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:51:02.395 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:02.391+0000 7f53a93e9640 1 --2- 172.21.15.150:0/4264135267 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f53a40ce370 0x7f53a409c440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:51:02.396 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:02.391+0000 7f53a93e9640 1 -- 172.21.15.150:0/4264135267 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f53a40cda20 msgr2=0x7f53a409bf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:51:02.396 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:02.391+0000 7f53a93e9640 1 --2- 172.21.15.150:0/4264135267 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f53a40cda20 0x7f53a409bf00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:51:02.396 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:02.391+0000 7f53a93e9640 1 -- 172.21.15.150:0/4264135267 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f53a415c370 con 0x7f53a40b5ff0 2024-09-17T05:51:02.396 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:02.391+0000 7f53a93e9640 1 --2- 172.21.15.150:0/4264135267 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f53a40b5ff0 0x7f53a40b1ea0 secure :-1 s=READY pgs=1420 cs=0 l=1 rev1=1 crypto rx=0x7f53a000d750 tx=0x7f53a000dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:51:02.396 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:02.391+0000 7f5399ffb640 1 -- 172.21.15.150:0/4264135267 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53a0017070 con 0x7f53a40b5ff0 2024-09-17T05:51:02.396 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:02.391+0000 7f5399ffb640 1 -- 172.21.15.150:0/4264135267 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f53a0009cc0 con 0x7f53a40b5ff0 2024-09-17T05:51:02.396 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:02.391+0000 7f5399ffb640 1 -- 172.21.15.150:0/4264135267 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53a00106c0 con 0x7f53a40b5ff0 2024-09-17T05:51:02.396 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:02.391+0000 7f53ab64d640 1 -- 172.21.15.150:0/4264135267 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f53a415c650 con 0x7f53a40b5ff0 2024-09-17T05:51:02.396 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:02.391+0000 7f53ab64d640 1 -- 172.21.15.150:0/4264135267 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f53a40b23e0 con 0x7f53a40b5ff0 2024-09-17T05:51:02.396 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:02.392+0000 7f53ab64d640 1 -- 172.21.15.150:0/4264135267 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f53a40cde30 con 0x7f53a40b5ff0 2024-09-17T05:51:02.396 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:02.393+0000 7f5399ffb640 1 -- 172.21.15.150:0/4264135267 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 37) ==== 103787+0+0 (secure 0 0 0) 0x7f53a001a070 con 0x7f53a40b5ff0 2024-09-17T05:51:02.396 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:02.393+0000 7f5399ffb640 1 --2- 172.21.15.150:0/4264135267 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f538807a570 0x7f538807ca80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:51:02.396 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:02.394+0000 7f5399ffb640 1 -- 172.21.15.150:0/4264135267 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(102..102 src has 1..102) ==== 5877+0+0 (secure 0 0 0) 0x7f53a0099bd0 con 0x7f53a40b5ff0 2024-09-17T05:51:02.397 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:02.394+0000 7f53a8be8640 1 --2- 172.21.15.150:0/4264135267 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f538807a570 0x7f538807ca80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:51:02.397 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:02.394+0000 7f53a8be8640 1 --2- 172.21.15.150:0/4264135267 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f538807a570 0x7f538807ca80 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7f53940058c0 tx=0x7f5394005850 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:51:02.398 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:02.398+0000 7f5399ffb640 1 -- 172.21.15.150:0/4264135267 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f53a000de60 con 0x7f53a40b5ff0 2024-09-17T05:51:02.611 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:02.610+0000 7f53ab64d640 1 -- 172.21.15.150:0/4264135267 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f53a415ee60 con 0x7f53a40b5ff0 2024-09-17T05:51:02.611 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:02.611+0000 7f5399ffb640 1 -- 172.21.15.150:0/4264135267 <== mon.0 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 61 v61) ==== 94+0+5231 (secure 0 0 0) 0x7f53a0063ba0 con 0x7f53a40b5ff0 2024-09-17T05:51:02.612 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-09-17T05:51:02.612 INFO:teuthology.orchestra.run.smithi150.stdout:{"epoch":61,"btime":"2024-09-17T05:50:29:714285+0000","default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6494,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6837/1755605193","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6835","nonce":1755605193},{"type":"v1","addr":"172.21.15.176:6837","nonce":1755605193}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":55},{"gid":7117,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6836/628081508","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6834","nonce":628081508},{"type":"v1","addr":"172.21.15.176:6836","nonce":628081508}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":55},{"gid":8061,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6835/187954104","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6833","nonce":187954104},{"type":"v1","addr":"172.21.15.150:6835","nonce":187954104}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":55}],"filesystems":[{"mdsmap":{"epoch":60,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T05:50:17.022354+0000","modified":"2024-09-17T05:50:20.052518+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":8064},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8064":{"gid":8064,"name":"c","rank":0,"incarnation":56,"state":"up:active","state_seq":3,"addr":"172.21.15.150:6834/3842369685","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6832","nonce":3842369685},{"type":"v1","addr":"172.21.15.150:6834","nonce":3842369685}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":8064,"qdb_cluster":[8064]},"id":7}]} 2024-09-17T05:51:02.612 INFO:teuthology.orchestra.run.smithi150.stderr:dumped fsmap epoch 61 2024-09-17T05:51:02.614 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:02.613+0000 7f53ab64d640 1 -- 172.21.15.150:0/4264135267 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f538807a570 msgr2=0x7f538807ca80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:51:02.614 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:02.613+0000 7f53ab64d640 1 --2- 172.21.15.150:0/4264135267 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f538807a570 0x7f538807ca80 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7f53940058c0 tx=0x7f5394005850 comp rx=0 tx=0).stop 2024-09-17T05:51:02.614 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:02.613+0000 7f53ab64d640 1 -- 172.21.15.150:0/4264135267 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f53a40b5ff0 msgr2=0x7f53a40b1ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:51:02.614 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:02.613+0000 7f53ab64d640 1 --2- 172.21.15.150:0/4264135267 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f53a40b5ff0 0x7f53a40b1ea0 secure :-1 s=READY pgs=1420 cs=0 l=1 rev1=1 crypto rx=0x7f53a000d750 tx=0x7f53a000dc10 comp rx=0 tx=0).stop 2024-09-17T05:51:02.614 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:02.613+0000 7f53ab64d640 1 -- 172.21.15.150:0/4264135267 shutdown_connections 2024-09-17T05:51:02.614 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:02.613+0000 7f53ab64d640 1 --2- 172.21.15.150:0/4264135267 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f53a40cda20 0x7f53a409bf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:51:02.614 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:02.613+0000 7f53ab64d640 1 --2- 172.21.15.150:0/4264135267 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f538807a570 0x7f538807ca80 unknown :-1 s=CLOSED pgs=608 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:51:02.614 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:02.613+0000 7f53ab64d640 1 --2- 172.21.15.150:0/4264135267 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f53a40ce370 0x7f53a409c440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:51:02.614 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:02.613+0000 7f53ab64d640 1 --2- 172.21.15.150:0/4264135267 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f53a40b5ff0 0x7f53a40b1ea0 unknown :-1 s=CLOSED pgs=1420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:51:02.615 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:02.613+0000 7f53ab64d640 1 -- 172.21.15.150:0/4264135267 >> 172.21.15.150:0/4264135267 conn(0x7f53a40b2e80 msgr2=0x7f53a40ca600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:51:02.615 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:02.613+0000 7f53ab64d640 1 -- 172.21.15.150:0/4264135267 shutdown_connections 2024-09-17T05:51:02.615 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:02.613+0000 7f53ab64d640 1 -- 172.21.15.150:0/4264135267 wait complete. 2024-09-17T05:51:02.626 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T05:51:02.741 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:02.739+0000 7f71fc625640 1 -- 172.21.15.150:0/1118408028 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f71f4152920 msgr2=0x7f71f415f3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:51:02.741 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:02.739+0000 7f71fc625640 1 --2- 172.21.15.150:0/1118408028 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f71f4152920 0x7f71f415f3d0 secure :-1 s=READY pgs=1422 cs=0 l=1 rev1=1 crypto rx=0x7f71e4009830 tx=0x7f71e402a530 comp rx=0 tx=0).stop 2024-09-17T05:51:02.741 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:02.739+0000 7f71fc625640 1 -- 172.21.15.150:0/1118408028 shutdown_connections 2024-09-17T05:51:02.741 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:02.739+0000 7f71fc625640 1 --2- 172.21.15.150:0/1118408028 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f71f4152920 0x7f71f415f3d0 unknown :-1 s=CLOSED pgs=1422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:51:02.741 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:02.740+0000 7f71fc625640 1 -- 172.21.15.150:0/1118408028 >> 172.21.15.150:0/1118408028 conn(0x7f71f406d730 msgr2=0x7f71f40b1e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:51:02.741 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:02.740+0000 7f71fc625640 1 -- 172.21.15.150:0/1118408028 shutdown_connections 2024-09-17T05:51:02.741 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:02.740+0000 7f71fc625640 1 -- 172.21.15.150:0/1118408028 wait complete. 2024-09-17T05:51:02.742 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:02.741+0000 7f71fc625640 1 Processor -- start 2024-09-17T05:51:02.742 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:02.741+0000 7f71fc625640 1 -- start start 2024-09-17T05:51:02.745 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:02.743+0000 7f71fc625640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f71f40aebc0 0x7f71f4155880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:51:02.745 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:02.743+0000 7f71fc625640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f71f4152920 0x7f71f41473f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:51:02.745 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:02.743+0000 7f71fc625640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f71f415f910 0x7f71f4147930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:51:02.745 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:02.743+0000 7f71fc625640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f71f40b4390 con 0x7f71f40aebc0 2024-09-17T05:51:02.745 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:02.743+0000 7f71fc625640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f71f40b4210 con 0x7f71f415f910 2024-09-17T05:51:02.745 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:02.743+0000 7f71fc625640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f71f40b4510 con 0x7f71f4152920 2024-09-17T05:51:02.745 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:02.743+0000 7f71fa3c1640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f71f40aebc0 0x7f71f4155880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:51:02.745 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:02.743+0000 7f71fa3c1640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f71f40aebc0 0x7f71f4155880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:38800/0 (socket says 172.21.15.150:38800) 2024-09-17T05:51:02.745 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:02.743+0000 7f71fa3c1640 1 -- 172.21.15.150:0/114277244 learned_addr learned my addr 172.21.15.150:0/114277244 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:51:02.746 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:02.743+0000 7f71fabc2640 1 --2- 172.21.15.150:0/114277244 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f71f415f910 0x7f71f4147930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:51:02.746 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:02.743+0000 7f71f9bc0640 1 --2- 172.21.15.150:0/114277244 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f71f4152920 0x7f71f41473f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:51:02.746 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:02.743+0000 7f71fa3c1640 1 -- 172.21.15.150:0/114277244 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f71f4152920 msgr2=0x7f71f41473f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:51:02.746 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:02.743+0000 7f71fa3c1640 1 --2- 172.21.15.150:0/114277244 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f71f4152920 0x7f71f41473f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:51:02.746 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:02.743+0000 7f71fa3c1640 1 -- 172.21.15.150:0/114277244 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f71f415f910 msgr2=0x7f71f4147930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:51:02.746 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:02.743+0000 7f71fa3c1640 1 --2- 172.21.15.150:0/114277244 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f71f415f910 0x7f71f4147930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:51:02.746 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:02.743+0000 7f71fa3c1640 1 -- 172.21.15.150:0/114277244 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f71f409a540 con 0x7f71f40aebc0 2024-09-17T05:51:02.746 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:02.743+0000 7f71fa3c1640 1 --2- 172.21.15.150:0/114277244 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f71f40aebc0 0x7f71f4155880 secure :-1 s=READY pgs=1423 cs=0 l=1 rev1=1 crypto rx=0x7f71f000c3a0 tx=0x7f71f000c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:51:02.746 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:02.743+0000 7f71eaffd640 1 -- 172.21.15.150:0/114277244 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71f0017070 con 0x7f71f40aebc0 2024-09-17T05:51:02.746 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:02.743+0000 7f71eaffd640 1 -- 172.21.15.150:0/114277244 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f71f00053c0 con 0x7f71f40aebc0 2024-09-17T05:51:02.746 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:02.743+0000 7f71fc625640 1 -- 172.21.15.150:0/114277244 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f71f409d100 con 0x7f71f40aebc0 2024-09-17T05:51:02.746 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:02.744+0000 7f71eaffd640 1 -- 172.21.15.150:0/114277244 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71f0003850 con 0x7f71f40aebc0 2024-09-17T05:51:02.747 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:02.744+0000 7f71fc625640 1 -- 172.21.15.150:0/114277244 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f71f409d6c0 con 0x7f71f40aebc0 2024-09-17T05:51:02.747 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:02.745+0000 7f71fc625640 1 -- 172.21.15.150:0/114277244 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f71f409ce80 con 0x7f71f40aebc0 2024-09-17T05:51:02.747 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:02.745+0000 7f71eaffd640 1 -- 172.21.15.150:0/114277244 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 37) ==== 103787+0+0 (secure 0 0 0) 0x7f71f001a070 con 0x7f71f40aebc0 2024-09-17T05:51:02.748 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:02.746+0000 7f71eaffd640 1 --2- 172.21.15.150:0/114277244 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f71d807a570 0x7f71d807ca80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:51:02.748 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:02.746+0000 7f71eaffd640 1 -- 172.21.15.150:0/114277244 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(102..102 src has 1..102) ==== 5877+0+0 (secure 0 0 0) 0x7f71f0098e80 con 0x7f71f40aebc0 2024-09-17T05:51:02.748 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:02.746+0000 7f71f9bc0640 1 --2- 172.21.15.150:0/114277244 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f71d807a570 0x7f71d807ca80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:51:02.748 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:02.746+0000 7f71f9bc0640 1 --2- 172.21.15.150:0/114277244 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f71d807a570 0x7f71d807ca80 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7f71e4034000 tx=0x7f71e4004730 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:51:02.751 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:02.750+0000 7f71eaffd640 1 -- 172.21.15.150:0/114277244 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f71f409ce80 con 0x7f71f40aebc0 2024-09-17T05:51:02.926 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:02.926+0000 7f71fc625640 1 -- 172.21.15.150:0/114277244 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f71f40b49c0 con 0x7f71f40aebc0 2024-09-17T05:51:02.927 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:02.927+0000 7f71eaffd640 1 -- 172.21.15.150:0/114277244 <== mon.0 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v102) ==== 74+0+16996 (secure 0 0 0) 0x7f71f415fd20 con 0x7f71f40aebc0 2024-09-17T05:51:02.928 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-09-17T05:51:02.928 INFO:teuthology.orchestra.run.smithi150.stdout:{"epoch":102,"fsid":"9f2e05e9-d629-47b3-b26b-1360655b7d20","created":"2024-09-17T05:41:32.502979+0000","modified":"2024-09-17T05:51:01.982952+0000","last_up_change":"2024-09-17T05:41:46.150225+0000","last_in_change":"2024-09-17T05:41:36.120274+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T05:41:46.860779+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs_metadata","create_time":"2024-09-17T05:50:14.652062+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"100","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs_data","create_time":"2024-09-17T05:50:15.994053+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"102","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":3,"snap_epoch":102,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"4f31c018-c8a4-4d6d-b0c2-a597c47aae4a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6800","nonce":479374392},{"type":"v1","addr":"172.21.15.150:6801","nonce":479374392}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6802","nonce":479374392},{"type":"v1","addr":"172.21.15.150:6803","nonce":479374392}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6806","nonce":479374392},{"type":"v1","addr":"172.21.15.150:6807","nonce":479374392}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6804","nonce":479374392},{"type":"v1","addr":"172.21.15.150:6805","nonce":479374392}]},"public_addr":"172.21.15.150:6801/479374392","cluster_addr":"172.21.15.150:6803/479374392","heartbeat_back_addr":"172.21.15.150:6807/479374392","heartbeat_front_addr":"172.21.15.150:6805/479374392","state":["exists","up"]},{"osd":1,"uuid":"6ff4a573-500b-4e04-9de3-39265ead78b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6824","nonce":913899800},{"type":"v1","addr":"172.21.15.150:6825","nonce":913899800}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6826","nonce":913899800},{"type":"v1","addr":"172.21.15.150:6827","nonce":913899800}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6830","nonce":913899800},{"type":"v1","addr":"172.21.15.150:6831","nonce":913899800}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6828","nonce":913899800},{"type":"v1","addr":"172.21.15.150:6829","nonce":913899800}]},"public_addr":"172.21.15.150:6825/913899800","cluster_addr":"172.21.15.150:6827/913899800","heartbeat_back_addr":"172.21.15.150:6831/913899800","heartbeat_front_addr":"172.21.15.150:6829/913899800","state":["exists","up"]},{"osd":2,"uuid":"bffea6f9-2465-4182-b205-00436c41ac1c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6816","nonce":363718461},{"type":"v1","addr":"172.21.15.150:6817","nonce":363718461}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6818","nonce":363718461},{"type":"v1","addr":"172.21.15.150:6819","nonce":363718461}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6822","nonce":363718461},{"type":"v1","addr":"172.21.15.150:6823","nonce":363718461}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6820","nonce":363718461},{"type":"v1","addr":"172.21.15.150:6821","nonce":363718461}]},"public_addr":"172.21.15.150:6817/363718461","cluster_addr":"172.21.15.150:6819/363718461","heartbeat_back_addr":"172.21.15.150:6823/363718461","heartbeat_front_addr":"172.21.15.150:6821/363718461","state":["exists","up"]},{"osd":3,"uuid":"cda70430-d1e1-427e-b04e-56db4031d078","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6808","nonce":3550994626},{"type":"v1","addr":"172.21.15.150:6809","nonce":3550994626}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6810","nonce":3550994626},{"type":"v1","addr":"172.21.15.150:6811","nonce":3550994626}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6814","nonce":3550994626},{"type":"v1","addr":"172.21.15.150:6815","nonce":3550994626}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6812","nonce":3550994626},{"type":"v1","addr":"172.21.15.150:6813","nonce":3550994626}]},"public_addr":"172.21.15.150:6809/3550994626","cluster_addr":"172.21.15.150:6811/3550994626","heartbeat_back_addr":"172.21.15.150:6815/3550994626","heartbeat_front_addr":"172.21.15.150:6813/3550994626","state":["exists","up"]},{"osd":4,"uuid":"3a0277fb-5e1e-4f68-bb2d-9a8a0152f64a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6810","nonce":2718261497},{"type":"v1","addr":"172.21.15.176:6811","nonce":2718261497}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6812","nonce":2718261497},{"type":"v1","addr":"172.21.15.176:6813","nonce":2718261497}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6816","nonce":2718261497},{"type":"v1","addr":"172.21.15.176:6817","nonce":2718261497}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6814","nonce":2718261497},{"type":"v1","addr":"172.21.15.176:6815","nonce":2718261497}]},"public_addr":"172.21.15.176:6811/2718261497","cluster_addr":"172.21.15.176:6813/2718261497","heartbeat_back_addr":"172.21.15.176:6817/2718261497","heartbeat_front_addr":"172.21.15.176:6815/2718261497","state":["exists","up"]},{"osd":5,"uuid":"33aebee6-0315-40b7-a11c-6702f0be494d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6818","nonce":2049295774},{"type":"v1","addr":"172.21.15.176:6819","nonce":2049295774}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6820","nonce":2049295774},{"type":"v1","addr":"172.21.15.176:6821","nonce":2049295774}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6824","nonce":2049295774},{"type":"v1","addr":"172.21.15.176:6825","nonce":2049295774}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6822","nonce":2049295774},{"type":"v1","addr":"172.21.15.176:6823","nonce":2049295774}]},"public_addr":"172.21.15.176:6819/2049295774","cluster_addr":"172.21.15.176:6821/2049295774","heartbeat_back_addr":"172.21.15.176:6825/2049295774","heartbeat_front_addr":"172.21.15.176:6823/2049295774","state":["exists","up"]},{"osd":6,"uuid":"4d24f360-6751-4263-841b-d77793d33540","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6826","nonce":2164458476},{"type":"v1","addr":"172.21.15.176:6827","nonce":2164458476}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6828","nonce":2164458476},{"type":"v1","addr":"172.21.15.176:6829","nonce":2164458476}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6832","nonce":2164458476},{"type":"v1","addr":"172.21.15.176:6833","nonce":2164458476}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6830","nonce":2164458476},{"type":"v1","addr":"172.21.15.176:6831","nonce":2164458476}]},"public_addr":"172.21.15.176:6827/2164458476","cluster_addr":"172.21.15.176:6829/2164458476","heartbeat_back_addr":"172.21.15.176:6833/2164458476","heartbeat_front_addr":"172.21.15.176:6831/2164458476","state":["exists","up"]},{"osd":7,"uuid":"c8594fda-c74a-4ba9-8277-caf101d58ca1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6802","nonce":3239587708},{"type":"v1","addr":"172.21.15.176:6803","nonce":3239587708}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6804","nonce":3239587708},{"type":"v1","addr":"172.21.15.176:6805","nonce":3239587708}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6808","nonce":3239587708},{"type":"v1","addr":"172.21.15.176:6809","nonce":3239587708}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6806","nonce":3239587708},{"type":"v1","addr":"172.21.15.176:6807","nonce":3239587708}]},"public_addr":"172.21.15.176:6803/3239587708","cluster_addr":"172.21.15.176:6805/3239587708","heartbeat_back_addr":"172.21.15.176:6809/3239587708","heartbeat_front_addr":"172.21.15.176:6807/3239587708","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:41:41.905151+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:41:42.705679+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:41:42.459673+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:41:42.440819+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:41:42.668428+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:41:42.694972+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:41:43.078535+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:41:42.363539+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":7,"snaps":[{"begin":2,"length":2}]},{"pool":9,"snaps":[{"begin":2,"length":2}]},{"pool":11,"snaps":[{"begin":2,"length":2}]},{"pool":13,"snaps":[{"begin":2,"length":2}]},{"pool":15,"snaps":[{"begin":2,"length":2}]}],"new_removed_snaps":[{"pool":15,"snaps":[{"begin":2,"length":2}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T05:51:02.930 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:02.929+0000 7f71fc625640 1 -- 172.21.15.150:0/114277244 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f71d807a570 msgr2=0x7f71d807ca80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:51:02.930 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:02.929+0000 7f71fc625640 1 --2- 172.21.15.150:0/114277244 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f71d807a570 0x7f71d807ca80 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7f71e4034000 tx=0x7f71e4004730 comp rx=0 tx=0).stop 2024-09-17T05:51:02.930 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:02.929+0000 7f71fc625640 1 -- 172.21.15.150:0/114277244 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f71f40aebc0 msgr2=0x7f71f4155880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:51:02.930 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:02.929+0000 7f71fc625640 1 --2- 172.21.15.150:0/114277244 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f71f40aebc0 0x7f71f4155880 secure :-1 s=READY pgs=1423 cs=0 l=1 rev1=1 crypto rx=0x7f71f000c3a0 tx=0x7f71f000c860 comp rx=0 tx=0).stop 2024-09-17T05:51:02.930 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:02.929+0000 7f71fc625640 1 -- 172.21.15.150:0/114277244 shutdown_connections 2024-09-17T05:51:02.930 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:02.929+0000 7f71fc625640 1 --2- 172.21.15.150:0/114277244 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f71f415f910 0x7f71f4147930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:51:02.930 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:02.929+0000 7f71fc625640 1 --2- 172.21.15.150:0/114277244 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f71d807a570 0x7f71d807ca80 unknown :-1 s=CLOSED pgs=609 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:51:02.930 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:02.929+0000 7f71fc625640 1 --2- 172.21.15.150:0/114277244 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f71f4152920 0x7f71f41473f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:51:02.931 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:02.929+0000 7f71fc625640 1 --2- 172.21.15.150:0/114277244 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f71f40aebc0 0x7f71f4155880 unknown :-1 s=CLOSED pgs=1423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:51:02.931 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:02.929+0000 7f71fc625640 1 -- 172.21.15.150:0/114277244 >> 172.21.15.150:0/114277244 conn(0x7f71f406d730 msgr2=0x7f71f415e320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:51:02.931 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:02.929+0000 7f71fc625640 1 -- 172.21.15.150:0/114277244 shutdown_connections 2024-09-17T05:51:02.931 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:02.929+0000 7f71fc625640 1 -- 172.21.15.150:0/114277244 wait complete. 2024-09-17T05:51:02.942 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-09-17T05:51:03.059 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:03.058+0000 7fa5d008b640 1 -- 172.21.15.150:0/3953848628 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa5b4003c30 msgr2=0x7fa5b4004080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:51:03.059 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:03.058+0000 7fa5d008b640 1 --2- 172.21.15.150:0/3953848628 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa5b4003c30 0x7fa5b4004080 secure :-1 s=READY pgs=1425 cs=0 l=1 rev1=1 crypto rx=0x7fa5c4006f90 tx=0x7fa5b4005830 comp rx=0 tx=0).stop 2024-09-17T05:51:03.059 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:03.058+0000 7fa5d008b640 1 -- 172.21.15.150:0/3953848628 shutdown_connections 2024-09-17T05:51:03.059 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:03.058+0000 7fa5d008b640 1 --2- 172.21.15.150:0/3953848628 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa5b4003c30 0x7fa5b4004080 unknown :-1 s=CLOSED pgs=1425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:51:03.059 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:03.058+0000 7fa5d008b640 1 -- 172.21.15.150:0/3953848628 >> 172.21.15.150:0/3953848628 conn(0x7fa5c80d4680 msgr2=0x7fa5c80d4a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:51:03.059 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:03.058+0000 7fa5d008b640 1 -- 172.21.15.150:0/3953848628 shutdown_connections 2024-09-17T05:51:03.059 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:03.058+0000 7fa5d008b640 1 -- 172.21.15.150:0/3953848628 wait complete. 2024-09-17T05:51:03.060 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:03.060+0000 7fa5d008b640 1 Processor -- start 2024-09-17T05:51:03.060 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:03.060+0000 7fa5d008b640 1 -- start start 2024-09-17T05:51:03.063 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:03.061+0000 7fa5d008b640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa5b4003c30 0x7fa5c81f6090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:51:03.063 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:03.061+0000 7fa5d008b640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa5c815da50 0x7fa5c80b40e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:51:03.063 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:03.061+0000 7fa5d008b640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa5c815de60 0x7fa5c80b4620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:51:03.063 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:03.061+0000 7fa5d008b640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7fa5c815f3a0 con 0x7fa5b4003c30 2024-09-17T05:51:03.063 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:03.061+0000 7fa5d008b640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fa5c815f220 con 0x7fa5c815de60 2024-09-17T05:51:03.063 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:03.061+0000 7fa5d008b640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fa5c80d1090 con 0x7fa5c815da50 2024-09-17T05:51:03.063 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:03.061+0000 7fa5cde27640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa5b4003c30 0x7fa5c81f6090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:51:03.063 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:03.061+0000 7fa5cde27640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa5b4003c30 0x7fa5c81f6090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:38828/0 (socket says 172.21.15.150:38828) 2024-09-17T05:51:03.063 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:03.061+0000 7fa5cde27640 1 -- 172.21.15.150:0/437043227 learned_addr learned my addr 172.21.15.150:0/437043227 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:51:03.064 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:03.061+0000 7fa5ce628640 1 --2- 172.21.15.150:0/437043227 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa5c815de60 0x7fa5c80b4620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:51:03.064 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:03.061+0000 7fa5cd626640 1 --2- 172.21.15.150:0/437043227 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa5c815da50 0x7fa5c80b40e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:51:03.064 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:03.061+0000 7fa5cde27640 1 -- 172.21.15.150:0/437043227 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa5c815da50 msgr2=0x7fa5c80b40e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:51:03.064 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:03.061+0000 7fa5cde27640 1 --2- 172.21.15.150:0/437043227 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa5c815da50 0x7fa5c80b40e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:51:03.064 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:03.061+0000 7fa5cde27640 1 -- 172.21.15.150:0/437043227 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa5c815de60 msgr2=0x7fa5c80b4620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:51:03.064 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:03.061+0000 7fa5cde27640 1 --2- 172.21.15.150:0/437043227 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa5c815de60 0x7fa5c80b4620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:51:03.064 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:03.061+0000 7fa5cde27640 1 -- 172.21.15.150:0/437043227 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa5c81f9000 con 0x7fa5b4003c30 2024-09-17T05:51:03.064 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:03.061+0000 7fa5ce628640 1 --2- 172.21.15.150:0/437043227 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa5c815de60 0x7fa5c80b4620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:51:03.064 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:03.061+0000 7fa5cde27640 1 --2- 172.21.15.150:0/437043227 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa5b4003c30 0x7fa5c81f6090 secure :-1 s=READY pgs=1426 cs=0 l=1 rev1=1 crypto rx=0x7fa5c4030040 tx=0x7fa5c4001010 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:51:03.064 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:03.062+0000 7fa5be7fc640 1 -- 172.21.15.150:0/437043227 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5c4003a00 con 0x7fa5b4003c30 2024-09-17T05:51:03.064 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:03.062+0000 7fa5be7fc640 1 -- 172.21.15.150:0/437043227 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa5c403e030 con 0x7fa5b4003c30 2024-09-17T05:51:03.064 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:03.062+0000 7fa5d008b640 1 -- 172.21.15.150:0/437043227 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa5c81f92e0 con 0x7fa5b4003c30 2024-09-17T05:51:03.065 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:03.062+0000 7fa5be7fc640 1 -- 172.21.15.150:0/437043227 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5c4003e20 con 0x7fa5b4003c30 2024-09-17T05:51:03.065 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:03.062+0000 7fa5d008b640 1 -- 172.21.15.150:0/437043227 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa5c81f98a0 con 0x7fa5b4003c30 2024-09-17T05:51:03.066 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:03.063+0000 7fa5d008b640 1 -- 172.21.15.150:0/437043227 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa5c808d100 con 0x7fa5b4003c30 2024-09-17T05:51:03.066 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:03.063+0000 7fa5be7fc640 1 -- 172.21.15.150:0/437043227 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 37) ==== 103787+0+0 (secure 0 0 0) 0x7fa5c402e440 con 0x7fa5b4003c30 2024-09-17T05:51:03.066 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:03.064+0000 7fa5be7fc640 1 --2- 172.21.15.150:0/437043227 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fa5ac07a5a0 0x7fa5ac07cab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:51:03.066 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:03.064+0000 7fa5be7fc640 1 -- 172.21.15.150:0/437043227 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(102..102 src has 1..102) ==== 5877+0+0 (secure 0 0 0) 0x7fa5c40ba450 con 0x7fa5b4003c30 2024-09-17T05:51:03.066 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:03.064+0000 7fa5cd626640 1 --2- 172.21.15.150:0/437043227 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fa5ac07a5a0 0x7fa5ac07cab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:51:03.066 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:03.065+0000 7fa5cd626640 1 --2- 172.21.15.150:0/437043227 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fa5ac07a5a0 0x7fa5ac07cab0 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7fa5b8006650 tx=0x7fa5b8006050 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:51:03.069 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:03.069+0000 7fa5be7fc640 1 -- 172.21.15.150:0/437043227 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fa5c808d100 con 0x7fa5b4003c30 2024-09-17T05:51:03.279 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:03.279+0000 7fa5d008b640 1 -- 172.21.15.150:0/437043227 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7fa5c80d15f0 con 0x7fa5b4003c30 2024-09-17T05:51:03.280 INFO:tasks.ceph.mon.a.smithi150.stderr:2024-09-17T05:51:03.280+0000 7f73931ae640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-17T05:51:03.282 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:03.281+0000 7fa5be7fc640 1 -- 172.21.15.150:0/437043227 <== mon.0 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v62) ==== 161+0+0 (secure 0 0 0) 0x7fa5c4084530 con 0x7fa5b4003c30 2024-09-17T05:51:03.282 INFO:teuthology.orchestra.run.smithi150.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-09-17T05:51:03.286 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:03.285+0000 7fa5d008b640 1 -- 172.21.15.150:0/437043227 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fa5ac07a5a0 msgr2=0x7fa5ac07cab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:51:03.286 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:03.285+0000 7fa5d008b640 1 --2- 172.21.15.150:0/437043227 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fa5ac07a5a0 0x7fa5ac07cab0 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7fa5b8006650 tx=0x7fa5b8006050 comp rx=0 tx=0).stop 2024-09-17T05:51:03.286 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:03.285+0000 7fa5d008b640 1 -- 172.21.15.150:0/437043227 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa5b4003c30 msgr2=0x7fa5c81f6090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:51:03.286 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:03.285+0000 7fa5d008b640 1 --2- 172.21.15.150:0/437043227 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa5b4003c30 0x7fa5c81f6090 secure :-1 s=READY pgs=1426 cs=0 l=1 rev1=1 crypto rx=0x7fa5c4030040 tx=0x7fa5c4001010 comp rx=0 tx=0).stop 2024-09-17T05:51:03.286 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:03.285+0000 7fa5d008b640 1 -- 172.21.15.150:0/437043227 shutdown_connections 2024-09-17T05:51:03.286 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:03.285+0000 7fa5d008b640 1 --2- 172.21.15.150:0/437043227 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa5c815de60 0x7fa5c80b4620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:51:03.286 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:03.285+0000 7fa5d008b640 1 --2- 172.21.15.150:0/437043227 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fa5ac07a5a0 0x7fa5ac07cab0 unknown :-1 s=CLOSED pgs=610 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:51:03.287 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:03.285+0000 7fa5d008b640 1 --2- 172.21.15.150:0/437043227 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa5c815da50 0x7fa5c80b40e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:51:03.287 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:03.285+0000 7fa5d008b640 1 --2- 172.21.15.150:0/437043227 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa5b4003c30 0x7fa5c81f6090 unknown :-1 s=CLOSED pgs=1426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:51:03.287 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:03.285+0000 7fa5d008b640 1 -- 172.21.15.150:0/437043227 >> 172.21.15.150:0/437043227 conn(0x7fa5c80d4680 msgr2=0x7fa5c815aa70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:51:03.287 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:03.285+0000 7fa5d008b640 1 -- 172.21.15.150:0/437043227 shutdown_connections 2024-09-17T05:51:03.287 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:03.285+0000 7fa5d008b640 1 -- 172.21.15.150:0/437043227 wait complete. 2024-09-17T05:51:03.298 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-09-17T05:51:03.350 INFO:tasks.ceph.mds.c.smithi150.stdout:starting mds.c at 2024-09-17T05:51:03.418 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:03.417+0000 7f49af838640 1 -- 172.21.15.150:0/1188809249 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f49a80b9810 msgr2=0x7f49a80b7ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:51:03.418 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:03.417+0000 7f49af838640 1 --2- 172.21.15.150:0/1188809249 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f49a80b9810 0x7f49a80b7ff0 secure :-1 s=READY pgs=1428 cs=0 l=1 rev1=1 crypto rx=0x7f49a808e6b0 tx=0x7f49a402a4b0 comp rx=0 tx=0).stop 2024-09-17T05:51:03.418 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:03.417+0000 7f49af838640 1 -- 172.21.15.150:0/1188809249 shutdown_connections 2024-09-17T05:51:03.418 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:03.417+0000 7f49af838640 1 --2- 172.21.15.150:0/1188809249 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f49a8162160 0x7f49a80b8a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:51:03.419 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:03.417+0000 7f49af838640 1 --2- 172.21.15.150:0/1188809249 >> v2:172.21.15.176:3300/0 conn(0x7f49a80b9d80 0x7f49a80b8530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:51:03.419 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:03.417+0000 7f49af838640 1 --2- 172.21.15.150:0/1188809249 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f49a80b9810 0x7f49a80b7ff0 unknown :-1 s=CLOSED pgs=1428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:51:03.419 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:03.417+0000 7f49af838640 1 -- 172.21.15.150:0/1188809249 >> 172.21.15.150:0/1188809249 conn(0x7f49a80d46c0 msgr2=0x7f49a80d4ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:51:03.419 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:03.417+0000 7f49af838640 1 -- 172.21.15.150:0/1188809249 shutdown_connections 2024-09-17T05:51:03.419 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:03.417+0000 7f49af838640 1 -- 172.21.15.150:0/1188809249 wait complete. 2024-09-17T05:51:03.419 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:03.419+0000 7f49af838640 1 Processor -- start 2024-09-17T05:51:03.419 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:03.419+0000 7f49af838640 1 -- start start 2024-09-17T05:51:03.422 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:03.420+0000 7f49af838640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f49a80b9d80 0x7f49a8151680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:51:03.422 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:03.420+0000 7f49af838640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f49a8162160 0x7f49a81f56e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:51:03.422 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:03.420+0000 7f49af838640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f49a814e210 0x7f49a806e9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:51:03.422 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:03.420+0000 7f49af838640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f49a806e380 con 0x7f49a80b9d80 2024-09-17T05:51:03.422 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:03.420+0000 7f49af838640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f49a806e200 con 0x7f49a814e210 2024-09-17T05:51:03.422 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:03.420+0000 7f49af838640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f49a806e500 con 0x7f49a8162160 2024-09-17T05:51:03.422 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:03.420+0000 7f49ad5d4640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f49a80b9d80 0x7f49a8151680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:51:03.423 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:03.420+0000 7f49ad5d4640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f49a80b9d80 0x7f49a8151680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:38856/0 (socket says 172.21.15.150:38856) 2024-09-17T05:51:03.423 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:03.420+0000 7f49ad5d4640 1 -- 172.21.15.150:0/87200666 learned_addr learned my addr 172.21.15.150:0/87200666 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:51:03.423 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:03.420+0000 7f49acdd3640 1 --2- 172.21.15.150:0/87200666 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f49a8162160 0x7f49a81f56e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:51:03.423 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:03.420+0000 7f49addd5640 1 --2- 172.21.15.150:0/87200666 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f49a814e210 0x7f49a806e9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:51:03.423 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:03.421+0000 7f49ad5d4640 1 -- 172.21.15.150:0/87200666 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f49a8162160 msgr2=0x7f49a81f56e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:51:03.423 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:03.421+0000 7f49ad5d4640 1 --2- 172.21.15.150:0/87200666 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f49a8162160 0x7f49a81f56e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:51:03.423 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:03.421+0000 7f49ad5d4640 1 -- 172.21.15.150:0/87200666 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f49a814e210 msgr2=0x7f49a806e9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:51:03.423 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:03.421+0000 7f49ad5d4640 1 --2- 172.21.15.150:0/87200666 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f49a814e210 0x7f49a806e9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:51:03.423 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:03.421+0000 7f49ad5d4640 1 -- 172.21.15.150:0/87200666 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f49a81f6040 con 0x7f49a80b9d80 2024-09-17T05:51:03.423 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:03.421+0000 7f49acdd3640 1 --2- 172.21.15.150:0/87200666 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f49a8162160 0x7f49a81f56e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:51:03.423 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:03.421+0000 7f49ad5d4640 1 --2- 172.21.15.150:0/87200666 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f49a80b9d80 0x7f49a8151680 secure :-1 s=READY pgs=1429 cs=0 l=1 rev1=1 crypto rx=0x7f49a40099d0 tx=0x7f49a40052f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:51:03.423 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:03.421+0000 7f499dffb640 1 -- 172.21.15.150:0/87200666 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49a4031b50 con 0x7f49a80b9d80 2024-09-17T05:51:03.423 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:03.421+0000 7f499dffb640 1 -- 172.21.15.150:0/87200666 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f49a4031de0 con 0x7f49a80b9d80 2024-09-17T05:51:03.424 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:03.421+0000 7f499dffb640 1 -- 172.21.15.150:0/87200666 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49a4033330 con 0x7f49a80b9d80 2024-09-17T05:51:03.424 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:03.421+0000 7f49af838640 1 -- 172.21.15.150:0/87200666 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f49a81f6320 con 0x7f49a80b9d80 2024-09-17T05:51:03.424 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:03.421+0000 7f49af838640 1 -- 172.21.15.150:0/87200666 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f49a814ea70 con 0x7f49a80b9d80 2024-09-17T05:51:03.425 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:03.422+0000 7f49af838640 1 -- 172.21.15.150:0/87200666 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f49a80b9810 con 0x7f49a80b9d80 2024-09-17T05:51:03.425 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:03.423+0000 7f499dffb640 1 -- 172.21.15.150:0/87200666 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 37) ==== 103787+0+0 (secure 0 0 0) 0x7f49a40334d0 con 0x7f49a80b9d80 2024-09-17T05:51:03.425 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:03.424+0000 7f499dffb640 1 --2- 172.21.15.150:0/87200666 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f498c07a570 0x7f498c07ca80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:51:03.425 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:03.424+0000 7f499dffb640 1 -- 172.21.15.150:0/87200666 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(103..103 src has 1..103) ==== 5935+0+0 (secure 0 0 0) 0x7f49a40bb020 con 0x7f49a80b9d80 2024-09-17T05:51:03.425 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:03.424+0000 7f49acdd3640 1 --2- 172.21.15.150:0/87200666 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f498c07a570 0x7f498c07ca80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:51:03.425 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:03.425+0000 7f49acdd3640 1 --2- 172.21.15.150:0/87200666 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f498c07a570 0x7f498c07ca80 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7f49a8069710 tx=0x7f4998005d90 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:51:03.429 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:03.428+0000 7f499dffb640 1 -- 172.21.15.150:0/87200666 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f49a403f030 con 0x7f49a80b9d80 2024-09-17T05:51:03.642 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:03.641+0000 7f49af838640 1 -- 172.21.15.150:0/87200666 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7f49a80d31f0 con 0x7f49a80b9d80 2024-09-17T05:51:04.284 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:04.283+0000 7f499dffb640 1 -- 172.21.15.150:0/87200666 <== mon.0 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v63) ==== 104+0+0 (secure 0 0 0) 0x7f49a4084f60 con 0x7f49a80b9d80 2024-09-17T05:51:04.286 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:04.286+0000 7f49af838640 1 -- 172.21.15.150:0/87200666 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f498c07a570 msgr2=0x7f498c07ca80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:51:04.287 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:04.286+0000 7f49af838640 1 --2- 172.21.15.150:0/87200666 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f498c07a570 0x7f498c07ca80 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7f49a8069710 tx=0x7f4998005d90 comp rx=0 tx=0).stop 2024-09-17T05:51:04.287 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:04.286+0000 7f49af838640 1 -- 172.21.15.150:0/87200666 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f49a80b9d80 msgr2=0x7f49a8151680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:51:04.287 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:04.286+0000 7f49af838640 1 --2- 172.21.15.150:0/87200666 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f49a80b9d80 0x7f49a8151680 secure :-1 s=READY pgs=1429 cs=0 l=1 rev1=1 crypto rx=0x7f49a40099d0 tx=0x7f49a40052f0 comp rx=0 tx=0).stop 2024-09-17T05:51:04.287 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:04.286+0000 7f49af838640 1 -- 172.21.15.150:0/87200666 shutdown_connections 2024-09-17T05:51:04.287 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:04.286+0000 7f49af838640 1 --2- 172.21.15.150:0/87200666 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f49a814e210 0x7f49a806e9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:51:04.287 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:04.286+0000 7f49af838640 1 --2- 172.21.15.150:0/87200666 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f498c07a570 0x7f498c07ca80 unknown :-1 s=CLOSED pgs=611 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:51:04.287 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:04.286+0000 7f49af838640 1 --2- 172.21.15.150:0/87200666 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f49a8162160 0x7f49a81f56e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:51:04.287 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:04.286+0000 7f49af838640 1 --2- 172.21.15.150:0/87200666 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f49a80b9d80 0x7f49a8151680 unknown :-1 s=CLOSED pgs=1429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:51:04.287 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:04.286+0000 7f49af838640 1 -- 172.21.15.150:0/87200666 >> 172.21.15.150:0/87200666 conn(0x7f49a80d46c0 msgr2=0x7f49a80d4ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:51:04.287 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:04.286+0000 7f49af838640 1 -- 172.21.15.150:0/87200666 shutdown_connections 2024-09-17T05:51:04.287 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:04.286+0000 7f49af838640 1 -- 172.21.15.150:0/87200666 wait complete. 2024-09-17T05:51:04.300 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-09-17T05:51:04.422 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:04.421+0000 7fac14430640 1 -- 172.21.15.150:0/837419098 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fabf8004d40 msgr2=0x7fabf8005150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:51:04.422 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:04.421+0000 7fac14430640 1 --2- 172.21.15.150:0/837419098 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fabf8004d40 0x7fabf8005150 secure :-1 s=READY pgs=1431 cs=0 l=1 rev1=1 crypto rx=0x7fac0c0cb720 tx=0x7fabf8005830 comp rx=0 tx=0).stop 2024-09-17T05:51:04.422 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:04.421+0000 7fac129cd640 1 -- 172.21.15.150:0/837419098 reap_dead start 2024-09-17T05:51:04.422 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:04.421+0000 7fac14430640 1 -- 172.21.15.150:0/837419098 shutdown_connections 2024-09-17T05:51:04.423 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:04.421+0000 7fac14430640 1 -- 172.21.15.150:0/837419098 >> 172.21.15.150:0/837419098 conn(0x7fac0c0d46a0 msgr2=0x7fac0c0d4ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:51:04.423 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:04.421+0000 7fac14430640 1 -- 172.21.15.150:0/837419098 shutdown_connections 2024-09-17T05:51:04.423 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:04.421+0000 7fac14430640 1 -- 172.21.15.150:0/837419098 wait complete. 2024-09-17T05:51:04.423 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:04.423+0000 7fac14430640 1 Processor -- start 2024-09-17T05:51:04.423 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:04.423+0000 7fac14430640 1 -- start start 2024-09-17T05:51:04.426 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:04.424+0000 7fac14430640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fabf8004d40 0x7fac0c15dc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:51:04.426 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:04.424+0000 7fac14430640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fac0c0b8af0 0x7fac0c1e9570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:51:04.426 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:04.424+0000 7fac14430640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fac0c1e9ab0 0x7fac0c0b75d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:51:04.427 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:04.424+0000 7fac14430640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7fac0c0d2790 con 0x7fac0c0b8af0 2024-09-17T05:51:04.427 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:04.424+0000 7fac14430640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fac0c0d2610 con 0x7fabf8004d40 2024-09-17T05:51:04.427 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:04.424+0000 7fac14430640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fac0c0d2910 con 0x7fac0c1e9ab0 2024-09-17T05:51:04.427 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:04.424+0000 7fac119cb640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fac0c0b8af0 0x7fac0c1e9570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:51:04.427 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:04.424+0000 7fac119cb640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fac0c0b8af0 0x7fac0c1e9570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:38872/0 (socket says 172.21.15.150:38872) 2024-09-17T05:51:04.427 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:04.424+0000 7fac119cb640 1 -- 172.21.15.150:0/2860697608 learned_addr learned my addr 172.21.15.150:0/2860697608 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:51:04.427 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:04.425+0000 7fac121cc640 1 --2- 172.21.15.150:0/2860697608 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fabf8004d40 0x7fac0c15dc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:51:04.427 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:04.425+0000 7fac129cd640 1 --2- 172.21.15.150:0/2860697608 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fac0c1e9ab0 0x7fac0c0b75d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:51:04.427 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:04.425+0000 7fac119cb640 1 -- 172.21.15.150:0/2860697608 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fac0c1e9ab0 msgr2=0x7fac0c0b75d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:51:04.427 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:04.425+0000 7fac119cb640 1 --2- 172.21.15.150:0/2860697608 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fac0c1e9ab0 0x7fac0c0b75d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:51:04.427 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:04.425+0000 7fac119cb640 1 -- 172.21.15.150:0/2860697608 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fabf8004d40 msgr2=0x7fac0c15dc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:51:04.427 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:04.425+0000 7fac119cb640 1 --2- 172.21.15.150:0/2860697608 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fabf8004d40 0x7fac0c15dc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:51:04.427 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:04.425+0000 7fac119cb640 1 -- 172.21.15.150:0/2860697608 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fac0c1e9ec0 con 0x7fac0c0b8af0 2024-09-17T05:51:04.428 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:04.425+0000 7fac119cb640 1 --2- 172.21.15.150:0/2860697608 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fac0c0b8af0 0x7fac0c1e9570 secure :-1 s=READY pgs=1432 cs=0 l=1 rev1=1 crypto rx=0x7fabfc011ab0 tx=0x7fabfc011f70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:51:04.428 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:04.425+0000 7fac02ffd640 1 -- 172.21.15.150:0/2860697608 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fabfc01e070 con 0x7fac0c0b8af0 2024-09-17T05:51:04.428 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:04.425+0000 7fac02ffd640 1 -- 172.21.15.150:0/2860697608 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fabfc00fc70 con 0x7fac0c0b8af0 2024-09-17T05:51:04.428 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:04.425+0000 7fac14430640 1 -- 172.21.15.150:0/2860697608 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fac0c1f58a0 con 0x7fac0c0b8af0 2024-09-17T05:51:04.428 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:04.425+0000 7fac02ffd640 1 -- 172.21.15.150:0/2860697608 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fabfc019670 con 0x7fac0c0b8af0 2024-09-17T05:51:04.428 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:04.425+0000 7fac14430640 1 -- 172.21.15.150:0/2860697608 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fac0c1f5e60 con 0x7fac0c0b8af0 2024-09-17T05:51:04.429 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:04.426+0000 7fac14430640 1 -- 172.21.15.150:0/2860697608 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fac0c1f6580 con 0x7fac0c0b8af0 2024-09-17T05:51:04.429 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:04.427+0000 7fac02ffd640 1 -- 172.21.15.150:0/2860697608 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 37) ==== 103787+0+0 (secure 0 0 0) 0x7fabfc021070 con 0x7fac0c0b8af0 2024-09-17T05:51:04.429 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:04.428+0000 7fac02ffd640 1 --2- 172.21.15.150:0/2860697608 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fabf007a570 0x7fabf007ca80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:51:04.429 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:04.428+0000 7fac02ffd640 1 -- 172.21.15.150:0/2860697608 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(103..103 src has 1..103) ==== 5935+0+0 (secure 0 0 0) 0x7fabfc09a3c0 con 0x7fac0c0b8af0 2024-09-17T05:51:04.429 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:04.428+0000 7fac121cc640 1 --2- 172.21.15.150:0/2860697608 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fabf007a570 0x7fabf007ca80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:51:04.429 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:04.428+0000 7fac121cc640 1 --2- 172.21.15.150:0/2860697608 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fabf007a570 0x7fabf007ca80 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7fac08003a50 tx=0x7fac08006f90 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:51:04.433 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:04.432+0000 7fac02ffd640 1 -- 172.21.15.150:0/2860697608 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fac0c1e9ec0 con 0x7fac0c0b8af0 2024-09-17T05:51:04.608 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:04.607+0000 7fac14430640 1 -- 172.21.15.150:0/2860697608 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7fac0c0b9910 con 0x7fac0c0b8af0 2024-09-17T05:51:05.285 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:05.284+0000 7fac02ffd640 1 -- 172.21.15.150:0/2860697608 <== mon.0 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v104) ==== 181+0+0 (secure 0 0 0) 0x7fabfc00fe60 con 0x7fac0c0b8af0 2024-09-17T05:51:05.285 INFO:teuthology.orchestra.run.smithi150.stderr:pool 'cephfs_metadata' removed 2024-09-17T05:51:05.289 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:05.288+0000 7fac14430640 1 -- 172.21.15.150:0/2860697608 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fabf007a570 msgr2=0x7fabf007ca80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:51:05.289 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:05.288+0000 7fac14430640 1 --2- 172.21.15.150:0/2860697608 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fabf007a570 0x7fabf007ca80 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7fac08003a50 tx=0x7fac08006f90 comp rx=0 tx=0).stop 2024-09-17T05:51:05.290 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:05.288+0000 7fac14430640 1 -- 172.21.15.150:0/2860697608 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fac0c0b8af0 msgr2=0x7fac0c1e9570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:51:05.290 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:05.288+0000 7fac14430640 1 --2- 172.21.15.150:0/2860697608 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fac0c0b8af0 0x7fac0c1e9570 secure :-1 s=READY pgs=1432 cs=0 l=1 rev1=1 crypto rx=0x7fabfc011ab0 tx=0x7fabfc011f70 comp rx=0 tx=0).stop 2024-09-17T05:51:05.290 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:05.288+0000 7fac14430640 1 -- 172.21.15.150:0/2860697608 shutdown_connections 2024-09-17T05:51:05.290 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:05.288+0000 7fac14430640 1 --2- 172.21.15.150:0/2860697608 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fabf007a570 0x7fabf007ca80 secure :-1 s=CLOSED pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7fac08003a50 tx=0x7fac08006f90 comp rx=0 tx=0).stop 2024-09-17T05:51:05.290 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:05.288+0000 7fac14430640 1 --2- 172.21.15.150:0/2860697608 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fac0c1e9ab0 0x7fac0c0b75d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:51:05.290 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:05.288+0000 7fac14430640 1 --2- 172.21.15.150:0/2860697608 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fac0c0b8af0 0x7fac0c1e9570 unknown :-1 s=CLOSED pgs=1432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:51:05.290 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:05.288+0000 7fac14430640 1 --2- 172.21.15.150:0/2860697608 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fabf8004d40 0x7fac0c15dc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:51:05.290 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:05.288+0000 7fac14430640 1 -- 172.21.15.150:0/2860697608 >> 172.21.15.150:0/2860697608 conn(0x7fac0c0d46a0 msgr2=0x7fac0c0d4ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:51:05.290 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:05.289+0000 7fac14430640 1 -- 172.21.15.150:0/2860697608 shutdown_connections 2024-09-17T05:51:05.290 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:05.289+0000 7fac14430640 1 -- 172.21.15.150:0/2860697608 wait complete. 2024-09-17T05:51:05.303 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-09-17T05:51:05.421 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:05.420+0000 7fb1fe869640 1 -- 172.21.15.150:0/188746576 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb1f80d05c0 msgr2=0x7fb1f80d0ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:51:05.421 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:05.420+0000 7fb1fe869640 1 --2- 172.21.15.150:0/188746576 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb1f80d05c0 0x7fb1f80d0ee0 secure :-1 s=READY pgs=1434 cs=0 l=1 rev1=1 crypto rx=0x7fb1f80b7ad0 tx=0x7fb1e002a510 comp rx=0 tx=0).stop 2024-09-17T05:51:05.422 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:05.420+0000 7fb1fe869640 1 -- 172.21.15.150:0/188746576 shutdown_connections 2024-09-17T05:51:05.422 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:05.420+0000 7fb1fe869640 1 --2- 172.21.15.150:0/188746576 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb1f80d05c0 0x7fb1f80d0ee0 unknown :-1 s=CLOSED pgs=1434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:51:05.422 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:05.420+0000 7fb1fe869640 1 -- 172.21.15.150:0/188746576 >> 172.21.15.150:0/188746576 conn(0x7fb1f80cee80 msgr2=0x7fb1f80cf290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:51:05.422 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:05.420+0000 7fb1fe869640 1 -- 172.21.15.150:0/188746576 shutdown_connections 2024-09-17T05:51:05.422 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:05.420+0000 7fb1fe869640 1 -- 172.21.15.150:0/188746576 wait complete. 2024-09-17T05:51:05.423 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:05.422+0000 7fb1fe869640 1 Processor -- start 2024-09-17T05:51:05.423 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:05.422+0000 7fb1fe869640 1 -- start start 2024-09-17T05:51:05.425 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:05.423+0000 7fb1fe869640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb1f80d01b0 0x7fb1f814f970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:51:05.425 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:05.423+0000 7fb1fe869640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb1f80d05c0 0x7fb1f815fd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:51:05.425 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:05.423+0000 7fb1fe869640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb1f80d1420 0x7fb1f815b980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:51:05.426 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:05.423+0000 7fb1fe869640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7fb1f809baf0 con 0x7fb1f80d01b0 2024-09-17T05:51:05.426 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:05.423+0000 7fb1fe869640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fb1f80b5960 con 0x7fb1f80d05c0 2024-09-17T05:51:05.426 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:05.423+0000 7fb1fe869640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fb1f809bc70 con 0x7fb1f80d1420 2024-09-17T05:51:05.426 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:05.423+0000 7fb1f7fff640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb1f80d01b0 0x7fb1f814f970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:51:05.426 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:05.423+0000 7fb1f7fff640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb1f80d01b0 0x7fb1f814f970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:38900/0 (socket says 172.21.15.150:38900) 2024-09-17T05:51:05.426 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:05.423+0000 7fb1f7fff640 1 -- 172.21.15.150:0/3422364625 learned_addr learned my addr 172.21.15.150:0/3422364625 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:51:05.426 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:05.424+0000 7fb1f7fff640 1 -- 172.21.15.150:0/3422364625 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb1f80d1420 msgr2=0x7fb1f815b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:51:05.426 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:05.424+0000 7fb1f7fff640 1 --2- 172.21.15.150:0/3422364625 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb1f80d1420 0x7fb1f815b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:51:05.426 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:05.424+0000 7fb1f7fff640 1 -- 172.21.15.150:0/3422364625 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb1f80d05c0 msgr2=0x7fb1f815fd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:51:05.426 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:05.424+0000 7fb1effff640 1 --2- 172.21.15.150:0/3422364625 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb1f80d05c0 0x7fb1f815fd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:51:05.426 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:05.424+0000 7fb1f7fff640 1 --2- 172.21.15.150:0/3422364625 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb1f80d05c0 0x7fb1f815fd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:51:05.426 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:05.424+0000 7fb1f7fff640 1 -- 172.21.15.150:0/3422364625 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb1f81f3e40 con 0x7fb1f80d01b0 2024-09-17T05:51:05.427 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:05.424+0000 7fb1f7fff640 1 --2- 172.21.15.150:0/3422364625 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb1f80d01b0 0x7fb1f814f970 secure :-1 s=READY pgs=1435 cs=0 l=1 rev1=1 crypto rx=0x7fb1e800b3f0 tx=0x7fb1e800b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:51:05.427 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:05.424+0000 7fb1f57fa640 1 -- 172.21.15.150:0/3422364625 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb1e8015030 con 0x7fb1f80d01b0 2024-09-17T05:51:05.427 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:05.424+0000 7fb1f57fa640 1 -- 172.21.15.150:0/3422364625 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb1e8005920 con 0x7fb1f80d01b0 2024-09-17T05:51:05.427 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:05.424+0000 7fb1fe869640 1 -- 172.21.15.150:0/3422364625 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb1f81f4120 con 0x7fb1f80d01b0 2024-09-17T05:51:05.427 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:05.424+0000 7fb1f57fa640 1 -- 172.21.15.150:0/3422364625 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb1e8005d90 con 0x7fb1f80d01b0 2024-09-17T05:51:05.427 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:05.424+0000 7fb1fe869640 1 -- 172.21.15.150:0/3422364625 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb1f81f46e0 con 0x7fb1f80d01b0 2024-09-17T05:51:05.428 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:05.425+0000 7fb1fe869640 1 -- 172.21.15.150:0/3422364625 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb1f80d0ee0 con 0x7fb1f80d01b0 2024-09-17T05:51:05.428 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:05.426+0000 7fb1f57fa640 1 -- 172.21.15.150:0/3422364625 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 37) ==== 103787+0+0 (secure 0 0 0) 0x7fb1e8018070 con 0x7fb1f80d01b0 2024-09-17T05:51:05.428 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:05.426+0000 7fb1f57fa640 1 --2- 172.21.15.150:0/3422364625 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fb1d807a570 0x7fb1d807ca80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:51:05.428 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:05.426+0000 7fb1f57fa640 1 -- 172.21.15.150:0/3422364625 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(104..104 src has 1..104) ==== 5497+0+0 (secure 0 0 0) 0x7fb1e80992f0 con 0x7fb1f80d01b0 2024-09-17T05:51:05.428 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:05.426+0000 7fb1effff640 1 --2- 172.21.15.150:0/3422364625 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fb1d807a570 0x7fb1d807ca80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:51:05.428 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:05.427+0000 7fb1effff640 1 --2- 172.21.15.150:0/3422364625 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fb1d807a570 0x7fb1d807ca80 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7fb1e0034000 tx=0x7fb1e0004730 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:51:05.431 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:05.431+0000 7fb1f57fa640 1 -- 172.21.15.150:0/3422364625 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fb1e80632c0 con 0x7fb1f80d01b0 2024-09-17T05:51:05.608 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:05.608+0000 7fb1fe869640 1 -- 172.21.15.150:0/3422364625 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7fb1f8074770 con 0x7fb1f80d01b0 2024-09-17T05:51:06.293 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:06.290+0000 7fb1f57fa640 1 -- 172.21.15.150:0/3422364625 <== mon.0 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v105) ==== 169+0+0 (secure 0 0 0) 0x7fb1e8062bc0 con 0x7fb1f80d01b0 2024-09-17T05:51:06.293 INFO:teuthology.orchestra.run.smithi150.stderr:pool 'cephfs_data' removed 2024-09-17T05:51:06.296 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:06.295+0000 7fb1fe869640 1 -- 172.21.15.150:0/3422364625 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fb1d807a570 msgr2=0x7fb1d807ca80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:51:06.297 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:06.296+0000 7fb1fe869640 1 --2- 172.21.15.150:0/3422364625 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fb1d807a570 0x7fb1d807ca80 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7fb1e0034000 tx=0x7fb1e0004730 comp rx=0 tx=0).stop 2024-09-17T05:51:06.297 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:06.296+0000 7fb1fe869640 1 -- 172.21.15.150:0/3422364625 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb1f80d01b0 msgr2=0x7fb1f814f970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:51:06.297 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:06.296+0000 7fb1fe869640 1 --2- 172.21.15.150:0/3422364625 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb1f80d01b0 0x7fb1f814f970 secure :-1 s=READY pgs=1435 cs=0 l=1 rev1=1 crypto rx=0x7fb1e800b3f0 tx=0x7fb1e800b8b0 comp rx=0 tx=0).stop 2024-09-17T05:51:06.298 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:06.297+0000 7fb1fe869640 1 -- 172.21.15.150:0/3422364625 shutdown_connections 2024-09-17T05:51:06.298 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:06.297+0000 7fb1fe869640 1 --2- 172.21.15.150:0/3422364625 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb1f80d05c0 0x7fb1f815fd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:51:06.298 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:06.297+0000 7fb1fe869640 1 --2- 172.21.15.150:0/3422364625 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fb1d807a570 0x7fb1d807ca80 unknown :-1 s=CLOSED pgs=614 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:51:06.298 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:06.297+0000 7fb1fe869640 1 --2- 172.21.15.150:0/3422364625 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb1f80d1420 0x7fb1f815b980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:51:06.298 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:06.297+0000 7fb1fe869640 1 --2- 172.21.15.150:0/3422364625 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb1f80d01b0 0x7fb1f814f970 secure :-1 s=CLOSED pgs=1435 cs=0 l=1 rev1=1 crypto rx=0x7fb1e800b3f0 tx=0x7fb1e800b8b0 comp rx=0 tx=0).stop 2024-09-17T05:51:06.298 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:06.297+0000 7fb1fe869640 1 -- 172.21.15.150:0/3422364625 >> 172.21.15.150:0/3422364625 conn(0x7fb1f80cee80 msgr2=0x7fb1f815ca80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:51:06.299 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:06.298+0000 7fb1fe869640 1 -- 172.21.15.150:0/3422364625 shutdown_connections 2024-09-17T05:51:06.300 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:06.299+0000 7fb1fe869640 1 -- 172.21.15.150:0/3422364625 wait complete. 2024-09-17T05:51:06.318 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config reset 31 2024-09-17T05:51:06.444 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:06.443+0000 7f7ba6f20640 1 -- 172.21.15.150:0/4124385768 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7ba00b5790 msgr2=0x7f7ba00b5ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:51:06.444 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:06.443+0000 7f7ba6f20640 1 --2- 172.21.15.150:0/4124385768 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7ba00b5790 0x7f7ba00b5ba0 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7f7b98005fd0 tx=0x7f7b9802a8b0 comp rx=0 tx=0).stop 2024-09-17T05:51:06.444 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:06.443+0000 7f7ba6f20640 1 -- 172.21.15.150:0/4124385768 shutdown_connections 2024-09-17T05:51:06.444 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:06.443+0000 7f7ba6f20640 1 --2- 172.21.15.150:0/4124385768 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7ba00b5790 0x7f7ba00b5ba0 unknown :-1 s=CLOSED pgs=502 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:51:06.445 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:06.443+0000 7f7ba6f20640 1 --2- 172.21.15.150:0/4124385768 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7ba00c5a90 0x7f7ba00b5250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:51:06.445 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:06.443+0000 7f7ba6f20640 1 -- 172.21.15.150:0/4124385768 >> 172.21.15.150:0/4124385768 conn(0x7f7ba00cee80 msgr2=0x7f7ba00cf290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:51:06.445 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:06.443+0000 7f7ba6f20640 1 -- 172.21.15.150:0/4124385768 shutdown_connections 2024-09-17T05:51:06.445 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:06.443+0000 7f7ba6f20640 1 -- 172.21.15.150:0/4124385768 wait complete. 2024-09-17T05:51:06.445 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:06.445+0000 7f7ba6f20640 1 Processor -- start 2024-09-17T05:51:06.445 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:06.445+0000 7f7ba6f20640 1 -- start start 2024-09-17T05:51:06.448 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:06.446+0000 7f7ba6f20640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7ba00b5790 0x7f7ba01f7d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:51:06.448 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:06.446+0000 7f7ba6f20640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7ba00c5a90 0x7f7ba014cf60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:51:06.449 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:06.446+0000 7f7ba6f20640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7ba00cea50 0x7f7ba009f2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:51:06.449 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:06.446+0000 7f7ba6f20640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f7ba00cd270 con 0x7f7ba00b5790 2024-09-17T05:51:06.449 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:06.446+0000 7f7ba6f20640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f7ba00cd0f0 con 0x7f7ba00c5a90 2024-09-17T05:51:06.449 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:06.446+0000 7f7ba6f20640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f7ba00cd3f0 con 0x7f7ba00cea50 2024-09-17T05:51:06.449 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:06.447+0000 7f7ba4cbc640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7ba00b5790 0x7f7ba01f7d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:51:06.449 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:06.447+0000 7f7ba4cbc640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7ba00b5790 0x7f7ba01f7d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:38914/0 (socket says 172.21.15.150:38914) 2024-09-17T05:51:06.449 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:06.447+0000 7f7ba4cbc640 1 -- 172.21.15.150:0/1759720253 learned_addr learned my addr 172.21.15.150:0/1759720253 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:51:06.449 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:06.447+0000 7f7b9ffff640 1 --2- 172.21.15.150:0/1759720253 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7ba00c5a90 0x7f7ba014cf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:51:06.449 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:06.447+0000 7f7ba54bd640 1 --2- 172.21.15.150:0/1759720253 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7ba00cea50 0x7f7ba009f2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:51:06.449 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:06.447+0000 7f7ba4cbc640 1 -- 172.21.15.150:0/1759720253 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7ba00cea50 msgr2=0x7f7ba009f2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:51:06.449 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:06.447+0000 7f7ba4cbc640 1 --2- 172.21.15.150:0/1759720253 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7ba00cea50 0x7f7ba009f2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:51:06.449 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:06.447+0000 7f7ba4cbc640 1 -- 172.21.15.150:0/1759720253 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7ba00c5a90 msgr2=0x7f7ba014cf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:51:06.449 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:06.447+0000 7f7ba4cbc640 1 --2- 172.21.15.150:0/1759720253 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7ba00c5a90 0x7f7ba014cf60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:51:06.449 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:06.447+0000 7f7ba4cbc640 1 -- 172.21.15.150:0/1759720253 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7ba01f8270 con 0x7f7ba00b5790 2024-09-17T05:51:06.450 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:06.447+0000 7f7ba4cbc640 1 --2- 172.21.15.150:0/1759720253 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7ba00b5790 0x7f7ba01f7d30 secure :-1 s=READY pgs=1436 cs=0 l=1 rev1=1 crypto rx=0x7f7b9000c390 tx=0x7f7b9000c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:51:06.450 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:06.447+0000 7f7b9d7fa640 1 -- 172.21.15.150:0/1759720253 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b90004020 con 0x7f7ba00b5790 2024-09-17T05:51:06.450 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:06.447+0000 7f7b9d7fa640 1 -- 172.21.15.150:0/1759720253 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f7b900042b0 con 0x7f7ba00b5790 2024-09-17T05:51:06.450 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:06.447+0000 7f7ba6f20640 1 -- 172.21.15.150:0/1759720253 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7ba014fe10 con 0x7f7ba00b5790 2024-09-17T05:51:06.450 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:06.447+0000 7f7b9d7fa640 1 -- 172.21.15.150:0/1759720253 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b90003640 con 0x7f7ba00b5790 2024-09-17T05:51:06.450 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:06.447+0000 7f7ba6f20640 1 -- 172.21.15.150:0/1759720253 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7ba01503d0 con 0x7f7ba00b5790 2024-09-17T05:51:06.451 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:06.448+0000 7f7ba6f20640 1 -- 172.21.15.150:0/1759720253 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7ba0074bb0 con 0x7f7ba00b5790 2024-09-17T05:51:06.451 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:06.449+0000 7f7b9d7fa640 1 -- 172.21.15.150:0/1759720253 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 37) ==== 103787+0+0 (secure 0 0 0) 0x7f7b90019020 con 0x7f7ba00b5790 2024-09-17T05:51:06.451 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:06.450+0000 7f7b9d7fa640 1 --2- 172.21.15.150:0/1759720253 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f7b8c07a570 0x7f7b8c07ca80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:51:06.451 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:06.450+0000 7f7b9d7fa640 1 -- 172.21.15.150:0/1759720253 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(105..105 src has 1..105) ==== 5083+0+0 (secure 0 0 0) 0x7f7b90099100 con 0x7f7ba00b5790 2024-09-17T05:51:06.451 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:06.450+0000 7f7b9ffff640 1 --2- 172.21.15.150:0/1759720253 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f7b8c07a570 0x7f7b8c07ca80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:51:06.451 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:06.451+0000 7f7b9ffff640 1 --2- 172.21.15.150:0/1759720253 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f7b8c07a570 0x7f7b8c07ca80 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7f7b940095f0 tx=0x7f7b94005f90 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:51:06.455 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:06.454+0000 7f7b9d7fa640 1 -- 172.21.15.150:0/1759720253 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f7ba0074bb0 con 0x7f7ba00b5790 2024-09-17T05:51:06.631 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:06.630+0000 7f7ba6f20640 1 -- 172.21.15.150:0/1759720253 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "config reset", "num": 31} v 0) -- 0x7f7ba00b5ba0 con 0x7f7ba00b5790 2024-09-17T05:51:06.635 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:06.634+0000 7f7b9d7fa640 1 -- 172.21.15.150:0/1759720253 <== mon.0 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "config reset", "num": 31}]=0 v51) ==== 71+0+0 (secure 0 0 0) 0x7f7b90062a80 con 0x7f7ba00b5790 2024-09-17T05:51:06.638 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:06.637+0000 7f7ba6f20640 1 -- 172.21.15.150:0/1759720253 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f7b8c07a570 msgr2=0x7f7b8c07ca80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:51:06.638 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:06.637+0000 7f7ba6f20640 1 --2- 172.21.15.150:0/1759720253 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f7b8c07a570 0x7f7b8c07ca80 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7f7b940095f0 tx=0x7f7b94005f90 comp rx=0 tx=0).stop 2024-09-17T05:51:06.638 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:06.637+0000 7f7ba6f20640 1 -- 172.21.15.150:0/1759720253 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7ba00b5790 msgr2=0x7f7ba01f7d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:51:06.638 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:06.637+0000 7f7ba6f20640 1 --2- 172.21.15.150:0/1759720253 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7ba00b5790 0x7f7ba01f7d30 secure :-1 s=READY pgs=1436 cs=0 l=1 rev1=1 crypto rx=0x7f7b9000c390 tx=0x7f7b9000c850 comp rx=0 tx=0).stop 2024-09-17T05:51:06.638 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:06.637+0000 7f7ba6f20640 1 -- 172.21.15.150:0/1759720253 shutdown_connections 2024-09-17T05:51:06.638 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:06.637+0000 7f7ba6f20640 1 --2- 172.21.15.150:0/1759720253 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7ba00c5a90 0x7f7ba014cf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:51:06.638 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:06.637+0000 7f7ba6f20640 1 --2- 172.21.15.150:0/1759720253 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f7b8c07a570 0x7f7b8c07ca80 unknown :-1 s=CLOSED pgs=615 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:51:06.638 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:06.637+0000 7f7ba6f20640 1 --2- 172.21.15.150:0/1759720253 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7ba00cea50 0x7f7ba009f2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:51:06.639 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:06.637+0000 7f7ba6f20640 1 --2- 172.21.15.150:0/1759720253 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7ba00b5790 0x7f7ba01f7d30 unknown :-1 s=CLOSED pgs=1436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:51:06.639 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:06.637+0000 7f7ba6f20640 1 -- 172.21.15.150:0/1759720253 >> 172.21.15.150:0/1759720253 conn(0x7f7ba00cee80 msgr2=0x7f7ba015c6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:51:06.639 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:06.637+0000 7f7ba6f20640 1 -- 172.21.15.150:0/1759720253 shutdown_connections 2024-09-17T05:51:06.639 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:06.637+0000 7f7ba6f20640 1 -- 172.21.15.150:0/1759720253 wait complete. 2024-09-17T05:51:06.649 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_volumes.TestCloneProgressReporter.test_progress_is_printed_in_clone_status_output' 2024-09-17T05:51:06.763 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:06.762+0000 7f9b30e30640 1 -- 172.21.15.150:0/380028958 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9b2c0cda20 msgr2=0x7f9b2c0cde30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:51:06.764 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:06.762+0000 7f9b30e30640 1 --2- 172.21.15.150:0/380028958 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9b2c0cda20 0x7f9b2c0cde30 secure :-1 s=READY pgs=1437 cs=0 l=1 rev1=1 crypto rx=0x7f9b2c0cbb80 tx=0x7f9b2002a560 comp rx=0 tx=0).stop 2024-09-17T05:51:06.764 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:06.762+0000 7f9b30e30640 1 -- 172.21.15.150:0/380028958 shutdown_connections 2024-09-17T05:51:06.764 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:06.762+0000 7f9b30e30640 1 --2- 172.21.15.150:0/380028958 >> v2:172.21.15.176:3300/0 conn(0x7f9b2c0ce370 0x7f9b2c0cbc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:51:06.764 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:06.762+0000 7f9b30e30640 1 --2- 172.21.15.150:0/380028958 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9b2c0cda20 0x7f9b2c0cde30 unknown :-1 s=CLOSED pgs=1437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:51:06.764 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:06.762+0000 7f9b30e30640 1 --2- 172.21.15.150:0/380028958 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9b2c0b5ff0 0x7f9b2c0b67a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:51:06.764 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:06.762+0000 7f9b30e30640 1 -- 172.21.15.150:0/380028958 >> 172.21.15.150:0/380028958 conn(0x7f9b2c0b2e80 msgr2=0x7f9b2c0b3290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:51:06.764 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:06.762+0000 7f9b30e30640 1 -- 172.21.15.150:0/380028958 shutdown_connections 2024-09-17T05:51:06.764 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:06.762+0000 7f9b30e30640 1 -- 172.21.15.150:0/380028958 wait complete. 2024-09-17T05:51:06.765 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:06.764+0000 7f9b30e30640 1 Processor -- start 2024-09-17T05:51:06.765 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:06.764+0000 7f9b30e30640 1 -- start start 2024-09-17T05:51:06.767 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:06.766+0000 7f9b30e30640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9b2c0b5ff0 0x7f9b2c14db60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:51:06.768 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:06.766+0000 7f9b30e30640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9b2c0cda20 0x7f9b2c1f3990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:51:06.768 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:06.766+0000 7f9b30e30640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9b2c0ce370 0x7f9b2c09e5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:51:06.768 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:06.766+0000 7f9b30e30640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f9b2c0cc500 con 0x7f9b2c0ce370 2024-09-17T05:51:06.768 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:06.766+0000 7f9b30e30640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f9b2c0cc380 con 0x7f9b2c0b5ff0 2024-09-17T05:51:06.768 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:06.766+0000 7f9b30e30640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f9b2c0cc680 con 0x7f9b2c0cda20 2024-09-17T05:51:06.768 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:06.766+0000 7f9b2ad9d640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9b2c0ce370 0x7f9b2c09e5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:51:06.768 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:06.766+0000 7f9b2ad9d640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9b2c0ce370 0x7f9b2c09e5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:38944/0 (socket says 172.21.15.150:38944) 2024-09-17T05:51:06.768 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:06.766+0000 7f9b2ad9d640 1 -- 172.21.15.150:0/1020067917 learned_addr learned my addr 172.21.15.150:0/1020067917 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:51:06.768 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:06.766+0000 7f9b2a59c640 1 --2- 172.21.15.150:0/1020067917 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9b2c0b5ff0 0x7f9b2c14db60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:51:06.768 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:06.766+0000 7f9b29d9b640 1 --2- 172.21.15.150:0/1020067917 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9b2c0cda20 0x7f9b2c1f3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:51:06.768 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:06.766+0000 7f9b2ad9d640 1 -- 172.21.15.150:0/1020067917 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9b2c0cda20 msgr2=0x7f9b2c1f3990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:51:06.768 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:06.766+0000 7f9b2ad9d640 1 --2- 172.21.15.150:0/1020067917 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9b2c0cda20 0x7f9b2c1f3990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:51:06.769 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:06.766+0000 7f9b2ad9d640 1 -- 172.21.15.150:0/1020067917 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9b2c0b5ff0 msgr2=0x7f9b2c14db60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:51:06.769 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:06.766+0000 7f9b2ad9d640 1 --2- 172.21.15.150:0/1020067917 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9b2c0b5ff0 0x7f9b2c14db60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:51:06.769 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:06.766+0000 7f9b2ad9d640 1 -- 172.21.15.150:0/1020067917 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9b2c14e570 con 0x7f9b2c0ce370 2024-09-17T05:51:06.769 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:06.766+0000 7f9b29d9b640 1 --2- 172.21.15.150:0/1020067917 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9b2c0cda20 0x7f9b2c1f3990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T05:51:06.769 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:06.766+0000 7f9b2ad9d640 1 --2- 172.21.15.150:0/1020067917 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9b2c0ce370 0x7f9b2c09e5b0 secure :-1 s=READY pgs=1438 cs=0 l=1 rev1=1 crypto rx=0x7f9b1c00cab0 tx=0x7f9b1c00cf70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:51:06.769 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:06.766+0000 7f9b1affd640 1 -- 172.21.15.150:0/1020067917 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b1c007df0 con 0x7f9b2c0ce370 2024-09-17T05:51:06.769 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:06.766+0000 7f9b1affd640 1 -- 172.21.15.150:0/1020067917 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9b1c003a80 con 0x7f9b2c0ce370 2024-09-17T05:51:06.769 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:06.766+0000 7f9b30e30640 1 -- 172.21.15.150:0/1020067917 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9b2c14e850 con 0x7f9b2c0ce370 2024-09-17T05:51:06.769 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:06.767+0000 7f9b1affd640 1 -- 172.21.15.150:0/1020067917 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b1c004020 con 0x7f9b2c0ce370 2024-09-17T05:51:06.769 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:06.767+0000 7f9b30e30640 1 -- 172.21.15.150:0/1020067917 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9b2c14ee10 con 0x7f9b2c0ce370 2024-09-17T05:51:06.770 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:06.768+0000 7f9b30e30640 1 -- 172.21.15.150:0/1020067917 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9b2c1f4470 con 0x7f9b2c0ce370 2024-09-17T05:51:06.770 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:06.768+0000 7f9b1affd640 1 -- 172.21.15.150:0/1020067917 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 37) ==== 103787+0+0 (secure 0 0 0) 0x7f9b1c0041c0 con 0x7f9b2c0ce370 2024-09-17T05:51:06.770 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:06.769+0000 7f9b1affd640 1 --2- 172.21.15.150:0/1020067917 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f9b0c07a570 0x7f9b0c07ca80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:51:06.770 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:06.769+0000 7f9b1affd640 1 -- 172.21.15.150:0/1020067917 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(105..105 src has 1..105) ==== 5083+0+0 (secure 0 0 0) 0x7f9b1c09a270 con 0x7f9b2c0ce370 2024-09-17T05:51:06.771 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:06.769+0000 7f9b2a59c640 1 --2- 172.21.15.150:0/1020067917 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f9b0c07a570 0x7f9b0c07ca80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:51:06.771 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:06.770+0000 7f9b2a59c640 1 --2- 172.21.15.150:0/1020067917 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f9b0c07a570 0x7f9b0c07ca80 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7f9b2400c9c0 tx=0x7f9b2400c3a0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:51:06.774 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:06.774+0000 7f9b1affd640 1 -- 172.21.15.150:0/1020067917 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f9b1c0a0e20 con 0x7f9b2c0ce370 2024-09-17T05:51:07.021 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:07.020+0000 7f9b30e30640 1 -- 172.21.15.150:0/1020067917 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_volumes.TestCloneProgressReporter.test_progress_is_printed_in_clone_status_output"]} v 0) -- 0x7f9b2c0ccbd0 con 0x7f9b2c0ce370 2024-09-17T05:51:07.292 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:07.292+0000 7f9b1affd640 1 -- 172.21.15.150:0/1020067917 <== mon.0 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_volumes.TestCloneProgressReporter.test_progress_is_printed_in_clone_status_output"]}]=0 v459) ==== 178+0+0 (secure 0 0 0) 0x7f9b1c014070 con 0x7f9b2c0ce370 2024-09-17T05:51:07.295 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:07.294+0000 7f9b30e30640 1 -- 172.21.15.150:0/1020067917 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f9b0c07a570 msgr2=0x7f9b0c07ca80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:51:07.295 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:07.294+0000 7f9b30e30640 1 --2- 172.21.15.150:0/1020067917 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f9b0c07a570 0x7f9b0c07ca80 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7f9b2400c9c0 tx=0x7f9b2400c3a0 comp rx=0 tx=0).stop 2024-09-17T05:51:07.295 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:07.294+0000 7f9b30e30640 1 -- 172.21.15.150:0/1020067917 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9b2c0ce370 msgr2=0x7f9b2c09e5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:51:07.295 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:07.294+0000 7f9b30e30640 1 --2- 172.21.15.150:0/1020067917 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9b2c0ce370 0x7f9b2c09e5b0 secure :-1 s=READY pgs=1438 cs=0 l=1 rev1=1 crypto rx=0x7f9b1c00cab0 tx=0x7f9b1c00cf70 comp rx=0 tx=0).stop 2024-09-17T05:51:07.295 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:07.294+0000 7f9b30e30640 1 -- 172.21.15.150:0/1020067917 shutdown_connections 2024-09-17T05:51:07.296 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:07.294+0000 7f9b30e30640 1 --2- 172.21.15.150:0/1020067917 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f9b0c07a570 0x7f9b0c07ca80 unknown :-1 s=CLOSED pgs=616 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:51:07.296 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:07.294+0000 7f9b30e30640 1 --2- 172.21.15.150:0/1020067917 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9b2c0ce370 0x7f9b2c09e5b0 unknown :-1 s=CLOSED pgs=1438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:51:07.296 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:07.294+0000 7f9b30e30640 1 --2- 172.21.15.150:0/1020067917 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9b2c0cda20 0x7f9b2c1f3990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:51:07.296 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:07.294+0000 7f9b30e30640 1 --2- 172.21.15.150:0/1020067917 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9b2c0b5ff0 0x7f9b2c14db60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:51:07.296 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:07.294+0000 7f9b30e30640 1 -- 172.21.15.150:0/1020067917 >> 172.21.15.150:0/1020067917 conn(0x7f9b2c0b2e80 msgr2=0x7f9b2c0cb060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:51:07.296 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:07.294+0000 7f9b30e30640 1 -- 172.21.15.150:0/1020067917 shutdown_connections 2024-09-17T05:51:07.296 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:07.294+0000 7f9b30e30640 1 -- 172.21.15.150:0/1020067917 wait complete. 2024-09-17T05:51:07.307 INFO:tasks.cephfs_test_runner:Test that the command "ceph fs clone status" prints progress stats ... ok 2024-09-17T05:51:07.307 INFO:tasks.cephfs_test_runner:Starting test: test_when_clones_cancelled_are_equal_to_cloner_threads (tasks.cephfs.test_volumes.TestCloneProgressReporter) Test that progress bars, that printed for 3 ongoing clone jobs, are 2024-09-17T05:51:07.308 INFO:tasks.cephfs_test_runner:test_when_clones_cancelled_are_equal_to_cloner_threads (tasks.cephfs.test_volumes.TestCloneProgressReporter) 2024-09-17T05:51:07.308 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T05:51:07.425 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:07.422+0000 7f2a02190640 1 -- 172.21.15.150:0/943614383 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f29fc15f910 msgr2=0x7f29fc15bd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:51:07.425 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:07.422+0000 7f2a02190640 1 --2- 172.21.15.150:0/943614383 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f29fc15f910 0x7f29fc15bd90 secure :-1 s=READY pgs=1439 cs=0 l=1 rev1=1 crypto rx=0x7f29fc071320 tx=0x7f29f402a980 comp rx=0 tx=0).stop 2024-09-17T05:51:07.425 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:07.422+0000 7f2a02190640 1 -- 172.21.15.150:0/943614383 shutdown_connections 2024-09-17T05:51:07.425 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:07.422+0000 7f2a02190640 1 --2- 172.21.15.150:0/943614383 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f29fc15f910 0x7f29fc15bd90 unknown :-1 s=CLOSED pgs=1439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:51:07.425 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:07.422+0000 7f2a02190640 1 --2- 172.21.15.150:0/943614383 >> v2:172.21.15.176:3300/0 conn(0x7f29fc0b2750 0x7f29fc15f3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:51:07.425 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:07.422+0000 7f2a02190640 1 --2- 172.21.15.150:0/943614383 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f29fc0aebc0 0x7f29fc152920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:51:07.426 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:07.422+0000 7f2a02190640 1 -- 172.21.15.150:0/943614383 >> 172.21.15.150:0/943614383 conn(0x7f29fc06d730 msgr2=0x7f29fc0b1e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:51:07.426 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:07.422+0000 7f2a02190640 1 -- 172.21.15.150:0/943614383 shutdown_connections 2024-09-17T05:51:07.426 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:07.422+0000 7f2a02190640 1 -- 172.21.15.150:0/943614383 wait complete. 2024-09-17T05:51:07.426 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:07.424+0000 7f2a02190640 1 Processor -- start 2024-09-17T05:51:07.426 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:07.424+0000 7f2a02190640 1 -- start start 2024-09-17T05:51:07.428 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:07.425+0000 7f2a02190640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f29fc0aebc0 0x7f29fc0ce8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:51:07.428 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:07.425+0000 7f2a02190640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f29fc0b2750 0x7f29fc147900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:51:07.428 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:07.425+0000 7f2a02190640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f29fc15f910 0x7f29fc15e150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:51:07.428 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:07.425+0000 7f2a02190640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f29fc15c660 con 0x7f29fc15f910 2024-09-17T05:51:07.428 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:07.425+0000 7f2a02190640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f29fc15c4e0 con 0x7f29fc0b2750 2024-09-17T05:51:07.428 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:07.425+0000 7f2a02190640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f29fc15c7e0 con 0x7f29fc0aebc0 2024-09-17T05:51:07.428 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:07.425+0000 7f29fbfff640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f29fc15f910 0x7f29fc15e150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:51:07.428 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:07.425+0000 7f29fbfff640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f29fc15f910 0x7f29fc15e150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:38964/0 (socket says 172.21.15.150:38964) 2024-09-17T05:51:07.428 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:07.425+0000 7f29fbfff640 1 -- 172.21.15.150:0/4182791563 learned_addr learned my addr 172.21.15.150:0/4182791563 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:51:07.428 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:07.425+0000 7f29f2ffd640 1 --2- 172.21.15.150:0/4182791563 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f29fc0b2750 0x7f29fc147900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:51:07.428 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:07.425+0000 7f29fb7fe640 1 --2- 172.21.15.150:0/4182791563 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f29fc0aebc0 0x7f29fc0ce8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:51:07.428 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:07.426+0000 7f29fbfff640 1 -- 172.21.15.150:0/4182791563 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f29fc0aebc0 msgr2=0x7f29fc0ce8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:51:07.429 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:07.426+0000 7f29fbfff640 1 --2- 172.21.15.150:0/4182791563 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f29fc0aebc0 0x7f29fc0ce8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:51:07.429 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:07.426+0000 7f29fbfff640 1 -- 172.21.15.150:0/4182791563 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f29fc0b2750 msgr2=0x7f29fc147900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:51:07.429 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:07.426+0000 7f29fbfff640 1 --2- 172.21.15.150:0/4182791563 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f29fc0b2750 0x7f29fc147900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:51:07.429 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:07.426+0000 7f29fbfff640 1 -- 172.21.15.150:0/4182791563 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f29fc0cd530 con 0x7f29fc15f910 2024-09-17T05:51:07.429 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:07.426+0000 7f29fbfff640 1 --2- 172.21.15.150:0/4182791563 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f29fc15f910 0x7f29fc15e150 secure :-1 s=READY pgs=1440 cs=0 l=1 rev1=1 crypto rx=0x7f29f4009d60 tx=0x7f29f4003f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:51:07.429 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:07.426+0000 7f29f8ff9640 1 -- 172.21.15.150:0/4182791563 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29f4034040 con 0x7f29fc15f910 2024-09-17T05:51:07.429 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:07.426+0000 7f29f8ff9640 1 -- 172.21.15.150:0/4182791563 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f29f4004540 con 0x7f29fc15f910 2024-09-17T05:51:07.429 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:07.426+0000 7f2a02190640 1 -- 172.21.15.150:0/4182791563 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f29fc0cd810 con 0x7f29fc15f910 2024-09-17T05:51:07.429 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:07.426+0000 7f29f8ff9640 1 -- 172.21.15.150:0/4182791563 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29f4045480 con 0x7f29fc15f910 2024-09-17T05:51:07.429 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:07.426+0000 7f2a02190640 1 -- 172.21.15.150:0/4182791563 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f29fc0cddd0 con 0x7f29fc15f910 2024-09-17T05:51:07.429 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:07.427+0000 7f2a02190640 1 -- 172.21.15.150:0/4182791563 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f29fc15f3d0 con 0x7f29fc15f910 2024-09-17T05:51:07.430 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:07.428+0000 7f29f8ff9640 1 -- 172.21.15.150:0/4182791563 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 37) ==== 103787+0+0 (secure 0 0 0) 0x7f29f4037020 con 0x7f29fc15f910 2024-09-17T05:51:07.430 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:07.428+0000 7f29f8ff9640 1 --2- 172.21.15.150:0/4182791563 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f29dc07a570 0x7f29dc07ca80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:51:07.430 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:07.428+0000 7f29f8ff9640 1 -- 172.21.15.150:0/4182791563 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(105..105 src has 1..105) ==== 5083+0+0 (secure 0 0 0) 0x7f29f40bb3b0 con 0x7f29fc15f910 2024-09-17T05:51:07.430 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:07.429+0000 7f29fb7fe640 1 --2- 172.21.15.150:0/4182791563 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f29dc07a570 0x7f29dc07ca80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:51:07.430 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:07.429+0000 7f29fb7fe640 1 --2- 172.21.15.150:0/4182791563 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f29dc07a570 0x7f29dc07ca80 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7f29ec005fd0 tx=0x7f29ec00b260 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:51:07.433 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:07.433+0000 7f29f8ff9640 1 -- 172.21.15.150:0/4182791563 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f29f4084cb0 con 0x7f29fc15f910 2024-09-17T05:51:07.613 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:07.612+0000 7f2a02190640 1 -- 172.21.15.150:0/4182791563 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f29fc152c20 con 0x7f29fc15f910 2024-09-17T05:51:07.613 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:07.613+0000 7f29f8ff9640 1 -- 172.21.15.150:0/4182791563 <== mon.0 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v105) ==== 74+0+13294 (secure 0 0 0) 0x7f29f40896e0 con 0x7f29fc15f910 2024-09-17T05:51:07.614 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-09-17T05:51:07.614 INFO:teuthology.orchestra.run.smithi150.stdout:{"epoch":105,"fsid":"9f2e05e9-d629-47b3-b26b-1360655b7d20","created":"2024-09-17T05:41:32.502979+0000","modified":"2024-09-17T05:51:06.285554+0000","last_up_change":"2024-09-17T05:41:46.150225+0000","last_in_change":"2024-09-17T05:41:36.120274+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T05:41:46.860779+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"4f31c018-c8a4-4d6d-b0c2-a597c47aae4a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6800","nonce":479374392},{"type":"v1","addr":"172.21.15.150:6801","nonce":479374392}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6802","nonce":479374392},{"type":"v1","addr":"172.21.15.150:6803","nonce":479374392}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6806","nonce":479374392},{"type":"v1","addr":"172.21.15.150:6807","nonce":479374392}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6804","nonce":479374392},{"type":"v1","addr":"172.21.15.150:6805","nonce":479374392}]},"public_addr":"172.21.15.150:6801/479374392","cluster_addr":"172.21.15.150:6803/479374392","heartbeat_back_addr":"172.21.15.150:6807/479374392","heartbeat_front_addr":"172.21.15.150:6805/479374392","state":["exists","up"]},{"osd":1,"uuid":"6ff4a573-500b-4e04-9de3-39265ead78b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6824","nonce":913899800},{"type":"v1","addr":"172.21.15.150:6825","nonce":913899800}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6826","nonce":913899800},{"type":"v1","addr":"172.21.15.150:6827","nonce":913899800}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6830","nonce":913899800},{"type":"v1","addr":"172.21.15.150:6831","nonce":913899800}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6828","nonce":913899800},{"type":"v1","addr":"172.21.15.150:6829","nonce":913899800}]},"public_addr":"172.21.15.150:6825/913899800","cluster_addr":"172.21.15.150:6827/913899800","heartbeat_back_addr":"172.21.15.150:6831/913899800","heartbeat_front_addr":"172.21.15.150:6829/913899800","state":["exists","up"]},{"osd":2,"uuid":"bffea6f9-2465-4182-b205-00436c41ac1c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6816","nonce":363718461},{"type":"v1","addr":"172.21.15.150:6817","nonce":363718461}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6818","nonce":363718461},{"type":"v1","addr":"172.21.15.150:6819","nonce":363718461}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6822","nonce":363718461},{"type":"v1","addr":"172.21.15.150:6823","nonce":363718461}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6820","nonce":363718461},{"type":"v1","addr":"172.21.15.150:6821","nonce":363718461}]},"public_addr":"172.21.15.150:6817/363718461","cluster_addr":"172.21.15.150:6819/363718461","heartbeat_back_addr":"172.21.15.150:6823/363718461","heartbeat_front_addr":"172.21.15.150:6821/363718461","state":["exists","up"]},{"osd":3,"uuid":"cda70430-d1e1-427e-b04e-56db4031d078","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6808","nonce":3550994626},{"type":"v1","addr":"172.21.15.150:6809","nonce":3550994626}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6810","nonce":3550994626},{"type":"v1","addr":"172.21.15.150:6811","nonce":3550994626}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6814","nonce":3550994626},{"type":"v1","addr":"172.21.15.150:6815","nonce":3550994626}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6812","nonce":3550994626},{"type":"v1","addr":"172.21.15.150:6813","nonce":3550994626}]},"public_addr":"172.21.15.150:6809/3550994626","cluster_addr":"172.21.15.150:6811/3550994626","heartbeat_back_addr":"172.21.15.150:6815/3550994626","heartbeat_front_addr":"172.21.15.150:6813/3550994626","state":["exists","up"]},{"osd":4,"uuid":"3a0277fb-5e1e-4f68-bb2d-9a8a0152f64a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6810","nonce":2718261497},{"type":"v1","addr":"172.21.15.176:6811","nonce":2718261497}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6812","nonce":2718261497},{"type":"v1","addr":"172.21.15.176:6813","nonce":2718261497}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6816","nonce":2718261497},{"type":"v1","addr":"172.21.15.176:6817","nonce":2718261497}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6814","nonce":2718261497},{"type":"v1","addr":"172.21.15.176:6815","nonce":2718261497}]},"public_addr":"172.21.15.176:6811/2718261497","cluster_addr":"172.21.15.176:6813/2718261497","heartbeat_back_addr":"172.21.15.176:6817/2718261497","heartbeat_front_addr":"172.21.15.176:6815/2718261497","state":["exists","up"]},{"osd":5,"uuid":"33aebee6-0315-40b7-a11c-6702f0be494d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6818","nonce":2049295774},{"type":"v1","addr":"172.21.15.176:6819","nonce":2049295774}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6820","nonce":2049295774},{"type":"v1","addr":"172.21.15.176:6821","nonce":2049295774}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6824","nonce":2049295774},{"type":"v1","addr":"172.21.15.176:6825","nonce":2049295774}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6822","nonce":2049295774},{"type":"v1","addr":"172.21.15.176:6823","nonce":2049295774}]},"public_addr":"172.21.15.176:6819/2049295774","cluster_addr":"172.21.15.176:6821/2049295774","heartbeat_back_addr":"172.21.15.176:6825/2049295774","heartbeat_front_addr":"172.21.15.176:6823/2049295774","state":["exists","up"]},{"osd":6,"uuid":"4d24f360-6751-4263-841b-d77793d33540","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6826","nonce":2164458476},{"type":"v1","addr":"172.21.15.176:6827","nonce":2164458476}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6828","nonce":2164458476},{"type":"v1","addr":"172.21.15.176:6829","nonce":2164458476}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6832","nonce":2164458476},{"type":"v1","addr":"172.21.15.176:6833","nonce":2164458476}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6830","nonce":2164458476},{"type":"v1","addr":"172.21.15.176:6831","nonce":2164458476}]},"public_addr":"172.21.15.176:6827/2164458476","cluster_addr":"172.21.15.176:6829/2164458476","heartbeat_back_addr":"172.21.15.176:6833/2164458476","heartbeat_front_addr":"172.21.15.176:6831/2164458476","state":["exists","up"]},{"osd":7,"uuid":"c8594fda-c74a-4ba9-8277-caf101d58ca1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6802","nonce":3239587708},{"type":"v1","addr":"172.21.15.176:6803","nonce":3239587708}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6804","nonce":3239587708},{"type":"v1","addr":"172.21.15.176:6805","nonce":3239587708}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6808","nonce":3239587708},{"type":"v1","addr":"172.21.15.176:6809","nonce":3239587708}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6806","nonce":3239587708},{"type":"v1","addr":"172.21.15.176:6807","nonce":3239587708}]},"public_addr":"172.21.15.176:6803/3239587708","cluster_addr":"172.21.15.176:6805/3239587708","heartbeat_back_addr":"172.21.15.176:6809/3239587708","heartbeat_front_addr":"172.21.15.176:6807/3239587708","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:41:41.905151+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:41:42.705679+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:41:42.459673+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:41:42.440819+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:41:42.668428+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:41:42.694972+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:41:43.078535+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:41:42.363539+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.150:6834/3842369685":"2024-09-18T05:51:03.280246+0000","172.21.15.150:6832/3842369685":"2024-09-18T05:51:03.280246+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":7,"snaps":[{"begin":2,"length":2}]},{"pool":9,"snaps":[{"begin":2,"length":2}]},{"pool":11,"snaps":[{"begin":2,"length":2}]},{"pool":13,"snaps":[{"begin":2,"length":2}]},{"pool":15,"snaps":[{"begin":2,"length":2}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T05:51:07.616 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:07.615+0000 7f2a02190640 1 -- 172.21.15.150:0/4182791563 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f29dc07a570 msgr2=0x7f29dc07ca80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:51:07.616 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:07.615+0000 7f2a02190640 1 --2- 172.21.15.150:0/4182791563 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f29dc07a570 0x7f29dc07ca80 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7f29ec005fd0 tx=0x7f29ec00b260 comp rx=0 tx=0).stop 2024-09-17T05:51:07.617 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:07.615+0000 7f2a02190640 1 -- 172.21.15.150:0/4182791563 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f29fc15f910 msgr2=0x7f29fc15e150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:51:07.617 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:07.615+0000 7f2a02190640 1 --2- 172.21.15.150:0/4182791563 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f29fc15f910 0x7f29fc15e150 secure :-1 s=READY pgs=1440 cs=0 l=1 rev1=1 crypto rx=0x7f29f4009d60 tx=0x7f29f4003f90 comp rx=0 tx=0).stop 2024-09-17T05:51:07.617 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:07.615+0000 7f2a02190640 1 -- 172.21.15.150:0/4182791563 shutdown_connections 2024-09-17T05:51:07.617 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:07.615+0000 7f2a02190640 1 --2- 172.21.15.150:0/4182791563 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f29fc0b2750 0x7f29fc147900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:51:07.617 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:07.615+0000 7f2a02190640 1 --2- 172.21.15.150:0/4182791563 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f29dc07a570 0x7f29dc07ca80 unknown :-1 s=CLOSED pgs=617 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:51:07.617 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:07.615+0000 7f2a02190640 1 --2- 172.21.15.150:0/4182791563 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f29fc15f910 0x7f29fc15e150 unknown :-1 s=CLOSED pgs=1440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:51:07.617 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:07.615+0000 7f2a02190640 1 --2- 172.21.15.150:0/4182791563 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f29fc0aebc0 0x7f29fc0ce8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:51:07.617 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:07.615+0000 7f2a02190640 1 -- 172.21.15.150:0/4182791563 >> 172.21.15.150:0/4182791563 conn(0x7f29fc06d730 msgr2=0x7f29fc0d0b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:51:07.617 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:07.615+0000 7f2a02190640 1 -- 172.21.15.150:0/4182791563 shutdown_connections 2024-09-17T05:51:07.617 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:07.615+0000 7f2a02190640 1 -- 172.21.15.150:0/4182791563 wait complete. 2024-09-17T05:51:07.628 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-17T05:41:46.860779+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-17T05:51:07.628 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-17T05:51:07.744 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:07.743+0000 7f64cf60a640 1 -- 172.21.15.150:0/1887009801 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f64c80b0fe0 msgr2=0x7f64c80b13f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:51:07.744 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:07.743+0000 7f64cf60a640 1 --2- 172.21.15.150:0/1887009801 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f64c80b0fe0 0x7f64c80b13f0 secure :-1 s=READY pgs=1442 cs=0 l=1 rev1=1 crypto rx=0x7f64c8073060 tx=0x7f64bc02a410 comp rx=0 tx=0).stop 2024-09-17T05:51:07.744 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:07.743+0000 7f64cf60a640 1 -- 172.21.15.150:0/1887009801 shutdown_connections 2024-09-17T05:51:07.744 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:07.743+0000 7f64cf60a640 1 --2- 172.21.15.150:0/1887009801 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f64c80b0fe0 0x7f64c80b13f0 unknown :-1 s=CLOSED pgs=1442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:51:07.745 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:07.743+0000 7f64cf60a640 1 --2- 172.21.15.150:0/1887009801 >> v2:172.21.15.176:3300/0 conn(0x7f64c80b25e0 0x7f64c80b1ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:51:07.745 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:07.743+0000 7f64cf60a640 1 -- 172.21.15.150:0/1887009801 >> 172.21.15.150:0/1887009801 conn(0x7f64c80b2ff0 msgr2=0x7f64c80b3400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:51:07.745 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:07.743+0000 7f64cf60a640 1 -- 172.21.15.150:0/1887009801 shutdown_connections 2024-09-17T05:51:07.745 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:07.743+0000 7f64cf60a640 1 -- 172.21.15.150:0/1887009801 wait complete. 2024-09-17T05:51:07.745 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:07.745+0000 7f64cf60a640 1 Processor -- start 2024-09-17T05:51:07.745 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:07.745+0000 7f64cf60a640 1 -- start start 2024-09-17T05:51:07.748 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:07.746+0000 7f64cf60a640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f64c80b0fe0 0x7f64c8156940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:51:07.748 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:07.746+0000 7f64cf60a640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f64c80b25e0 0x7f64c80cad90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:51:07.748 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:07.746+0000 7f64cf60a640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f64c815fa30 0x7f64c80af520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:51:07.748 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:07.746+0000 7f64cf60a640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f64c80ae740 con 0x7f64c815fa30 2024-09-17T05:51:07.748 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:07.746+0000 7f64cf60a640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f64c80ae5c0 con 0x7f64c80b25e0 2024-09-17T05:51:07.749 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:07.746+0000 7f64cf60a640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f64c80ae8c0 con 0x7f64c80b0fe0 2024-09-17T05:51:07.749 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:07.746+0000 7f64cdba7640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f64c815fa30 0x7f64c80af520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:51:07.749 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:07.746+0000 7f64cdba7640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f64c815fa30 0x7f64c80af520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:38994/0 (socket says 172.21.15.150:38994) 2024-09-17T05:51:07.749 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:07.746+0000 7f64cdba7640 1 -- 172.21.15.150:0/769082599 learned_addr learned my addr 172.21.15.150:0/769082599 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:51:07.749 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:07.747+0000 7f64ccba5640 1 --2- 172.21.15.150:0/769082599 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f64c80b25e0 0x7f64c80cad90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:51:07.749 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:07.747+0000 7f64cd3a6640 1 --2- 172.21.15.150:0/769082599 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f64c80b0fe0 0x7f64c8156940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:51:07.749 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:07.747+0000 7f64cdba7640 1 -- 172.21.15.150:0/769082599 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f64c80b0fe0 msgr2=0x7f64c8156940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:51:07.749 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:07.747+0000 7f64cdba7640 1 --2- 172.21.15.150:0/769082599 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f64c80b0fe0 0x7f64c8156940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:51:07.749 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:07.747+0000 7f64cdba7640 1 -- 172.21.15.150:0/769082599 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f64c80b25e0 msgr2=0x7f64c80cad90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:51:07.749 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:07.747+0000 7f64cdba7640 1 --2- 172.21.15.150:0/769082599 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f64c80b25e0 0x7f64c80cad90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:51:07.749 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:07.747+0000 7f64cdba7640 1 -- 172.21.15.150:0/769082599 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f64c81f32b0 con 0x7f64c815fa30 2024-09-17T05:51:07.749 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:07.747+0000 7f64cdba7640 1 --2- 172.21.15.150:0/769082599 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f64c815fa30 0x7f64c80af520 secure :-1 s=READY pgs=1443 cs=0 l=1 rev1=1 crypto rx=0x7f64c000c390 tx=0x7f64c000c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:51:07.750 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:07.747+0000 7f64c5ffb640 1 -- 172.21.15.150:0/769082599 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f64c0011790 con 0x7f64c815fa30 2024-09-17T05:51:07.750 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:07.747+0000 7f64c5ffb640 1 -- 172.21.15.150:0/769082599 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f64c0017070 con 0x7f64c815fa30 2024-09-17T05:51:07.750 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:07.747+0000 7f64cf60a640 1 -- 172.21.15.150:0/769082599 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f64c8159280 con 0x7f64c815fa30 2024-09-17T05:51:07.750 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:07.747+0000 7f64c5ffb640 1 -- 172.21.15.150:0/769082599 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f64c0011c40 con 0x7f64c815fa30 2024-09-17T05:51:07.750 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:07.747+0000 7f64cf60a640 1 -- 172.21.15.150:0/769082599 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f64c8159840 con 0x7f64c815fa30 2024-09-17T05:51:07.751 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:07.748+0000 7f64cf60a640 1 -- 172.21.15.150:0/769082599 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f64c80b13f0 con 0x7f64c815fa30 2024-09-17T05:51:07.751 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:07.749+0000 7f64c5ffb640 1 -- 172.21.15.150:0/769082599 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 37) ==== 103787+0+0 (secure 0 0 0) 0x7f64c001c460 con 0x7f64c815fa30 2024-09-17T05:51:07.751 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:07.750+0000 7f64c5ffb640 1 --2- 172.21.15.150:0/769082599 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f64b407a570 0x7f64b407ca80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:51:07.751 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:07.750+0000 7f64c5ffb640 1 -- 172.21.15.150:0/769082599 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(105..105 src has 1..105) ==== 5083+0+0 (secure 0 0 0) 0x7f64c00998d0 con 0x7f64c815fa30 2024-09-17T05:51:07.751 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:07.750+0000 7f64cd3a6640 1 --2- 172.21.15.150:0/769082599 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f64b407a570 0x7f64b407ca80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:51:07.751 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:07.751+0000 7f64cd3a6640 1 --2- 172.21.15.150:0/769082599 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f64b407a570 0x7f64b407ca80 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7f64b8008c80 tx=0x7f64b8008230 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:51:07.755 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:07.754+0000 7f64c5ffb640 1 -- 172.21.15.150:0/769082599 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f64c00638a0 con 0x7f64c815fa30 2024-09-17T05:51:07.926 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:07.926+0000 7f64cf60a640 1 -- 172.21.15.150:0/769082599 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f64c8157150 con 0x7f64c815fa30 2024-09-17T05:51:07.927 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:07.926+0000 7f64c5ffb640 1 -- 172.21.15.150:0/769082599 <== mon.0 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v105) ==== 93+0+10 (secure 0 0 0) 0x7f64c8157150 con 0x7f64c815fa30 2024-09-17T05:51:07.927 INFO:teuthology.orchestra.run.smithi150.stdout:pg_num: 1 2024-09-17T05:51:07.929 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:07.928+0000 7f64cf60a640 1 -- 172.21.15.150:0/769082599 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f64b407a570 msgr2=0x7f64b407ca80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:51:07.930 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:07.928+0000 7f64cf60a640 1 --2- 172.21.15.150:0/769082599 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f64b407a570 0x7f64b407ca80 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7f64b8008c80 tx=0x7f64b8008230 comp rx=0 tx=0).stop 2024-09-17T05:51:07.930 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:07.929+0000 7f64cf60a640 1 -- 172.21.15.150:0/769082599 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f64c815fa30 msgr2=0x7f64c80af520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:51:07.930 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:07.929+0000 7f64cf60a640 1 --2- 172.21.15.150:0/769082599 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f64c815fa30 0x7f64c80af520 secure :-1 s=READY pgs=1443 cs=0 l=1 rev1=1 crypto rx=0x7f64c000c390 tx=0x7f64c000c850 comp rx=0 tx=0).stop 2024-09-17T05:51:07.930 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:07.929+0000 7f64cf60a640 1 -- 172.21.15.150:0/769082599 shutdown_connections 2024-09-17T05:51:07.930 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:07.929+0000 7f64cf60a640 1 --2- 172.21.15.150:0/769082599 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f64c80b25e0 0x7f64c80cad90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:51:07.930 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:07.929+0000 7f64cf60a640 1 --2- 172.21.15.150:0/769082599 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f64b407a570 0x7f64b407ca80 unknown :-1 s=CLOSED pgs=618 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:51:07.930 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:07.929+0000 7f64cf60a640 1 --2- 172.21.15.150:0/769082599 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f64c815fa30 0x7f64c80af520 unknown :-1 s=CLOSED pgs=1443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:51:07.930 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:07.929+0000 7f64cf60a640 1 --2- 172.21.15.150:0/769082599 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f64c80b0fe0 0x7f64c8156940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:51:07.930 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:07.929+0000 7f64cf60a640 1 -- 172.21.15.150:0/769082599 >> 172.21.15.150:0/769082599 conn(0x7f64c80b2ff0 msgr2=0x7f64c80aec90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:51:07.930 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:07.929+0000 7f64cf60a640 1 -- 172.21.15.150:0/769082599 shutdown_connections 2024-09-17T05:51:07.930 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:07.929+0000 7f64cf60a640 1 -- 172.21.15.150:0/769082599 wait complete. 2024-09-17T05:51:07.941 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_volumes.TestCloneProgressReporter.test_when_clones_cancelled_are_equal_to_cloner_threads' 2024-09-17T05:51:08.056 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:08.055+0000 7f030ffad640 1 -- 172.21.15.150:0/3914602214 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f03080d03b0 msgr2=0x7f03080d07c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:51:08.056 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:08.055+0000 7f030ffad640 1 --2- 172.21.15.150:0/3914602214 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f03080d03b0 0x7f03080d07c0 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7f0304009820 tx=0x7f030402a490 comp rx=0 tx=0).stop 2024-09-17T05:51:08.056 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:08.055+0000 7f030ffad640 1 -- 172.21.15.150:0/3914602214 shutdown_connections 2024-09-17T05:51:08.056 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:08.055+0000 7f030ffad640 1 --2- 172.21.15.150:0/3914602214 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f03080d11d0 0x7f03081638c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:51:08.056 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:08.055+0000 7f030ffad640 1 --2- 172.21.15.150:0/3914602214 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f03080d03b0 0x7f03080d07c0 unknown :-1 s=CLOSED pgs=503 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:51:08.056 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:08.055+0000 7f030ffad640 1 -- 172.21.15.150:0/3914602214 >> 172.21.15.150:0/3914602214 conn(0x7f03080cef30 msgr2=0x7f03080cf340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:51:08.056 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:08.055+0000 7f030ffad640 1 -- 172.21.15.150:0/3914602214 shutdown_connections 2024-09-17T05:51:08.056 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:08.055+0000 7f030ffad640 1 -- 172.21.15.150:0/3914602214 wait complete. 2024-09-17T05:51:08.057 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:08.057+0000 7f030ffad640 1 Processor -- start 2024-09-17T05:51:08.057 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:08.057+0000 7f030ffad640 1 -- start start 2024-09-17T05:51:08.060 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:08.058+0000 7f030ffad640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f03080d03b0 0x7f0308162690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:51:08.060 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:08.058+0000 7f030ffad640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f03080d0dc0 0x7f030814b090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:51:08.060 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:08.058+0000 7f030ffad640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f03080d11d0 0x7f030806f350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:51:08.060 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:08.058+0000 7f030ffad640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f03080b1a20 con 0x7f03080d0dc0 2024-09-17T05:51:08.060 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:08.058+0000 7f030ffad640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f0308070ff0 con 0x7f03080d11d0 2024-09-17T05:51:08.060 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:08.058+0000 7f030ffad640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f03080b78e0 con 0x7f03080d03b0 2024-09-17T05:51:08.060 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:08.058+0000 7f030d548640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f03080d0dc0 0x7f030814b090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:51:08.060 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:08.058+0000 7f030d548640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f03080d0dc0 0x7f030814b090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:38996/0 (socket says 172.21.15.150:38996) 2024-09-17T05:51:08.061 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:08.058+0000 7f030d548640 1 -- 172.21.15.150:0/558134544 learned_addr learned my addr 172.21.15.150:0/558134544 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:51:08.061 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:08.058+0000 7f030e54a640 1 --2- 172.21.15.150:0/558134544 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f03080d11d0 0x7f030806f350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:51:08.061 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:08.058+0000 7f030dd49640 1 --2- 172.21.15.150:0/558134544 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f03080d03b0 0x7f0308162690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:51:08.061 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:08.058+0000 7f030d548640 1 -- 172.21.15.150:0/558134544 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f03080d03b0 msgr2=0x7f0308162690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:51:08.061 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:08.058+0000 7f030d548640 1 --2- 172.21.15.150:0/558134544 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f03080d03b0 0x7f0308162690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:51:08.061 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:08.058+0000 7f030d548640 1 -- 172.21.15.150:0/558134544 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f03080d11d0 msgr2=0x7f030806f350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:51:08.061 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:08.058+0000 7f030d548640 1 --2- 172.21.15.150:0/558134544 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f03080d11d0 0x7f030806f350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:51:08.061 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:08.058+0000 7f030d548640 1 -- 172.21.15.150:0/558134544 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0308157060 con 0x7f03080d0dc0 2024-09-17T05:51:08.061 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:08.058+0000 7f030d548640 1 --2- 172.21.15.150:0/558134544 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f03080d0dc0 0x7f030814b090 secure :-1 s=READY pgs=1445 cs=0 l=1 rev1=1 crypto rx=0x7f02f800c450 tx=0x7f02f800c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:51:08.061 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:08.059+0000 7f02fe7fc640 1 -- 172.21.15.150:0/558134544 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02f8016020 con 0x7f03080d0dc0 2024-09-17T05:51:08.061 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:08.059+0000 7f02fe7fc640 1 -- 172.21.15.150:0/558134544 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f02f8012920 con 0x7f03080d0dc0 2024-09-17T05:51:08.061 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:08.059+0000 7f030ffad640 1 -- 172.21.15.150:0/558134544 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f03081f9580 con 0x7f03080d0dc0 2024-09-17T05:51:08.062 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:08.059+0000 7f02fe7fc640 1 -- 172.21.15.150:0/558134544 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02f8012d70 con 0x7f03080d0dc0 2024-09-17T05:51:08.062 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:08.059+0000 7f030ffad640 1 -- 172.21.15.150:0/558134544 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f03081f9b40 con 0x7f03080d0dc0 2024-09-17T05:51:08.063 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:08.060+0000 7f030ffad640 1 -- 172.21.15.150:0/558134544 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f03080d07c0 con 0x7f03080d0dc0 2024-09-17T05:51:08.063 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:08.061+0000 7f02fe7fc640 1 -- 172.21.15.150:0/558134544 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 37) ==== 103787+0+0 (secure 0 0 0) 0x7f02f8019020 con 0x7f03080d0dc0 2024-09-17T05:51:08.063 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:08.061+0000 7f02fe7fc640 1 --2- 172.21.15.150:0/558134544 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f02ec07a570 0x7f02ec07ca80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:51:08.063 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:08.061+0000 7f02fe7fc640 1 -- 172.21.15.150:0/558134544 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(105..105 src has 1..105) ==== 5083+0+0 (secure 0 0 0) 0x7f02f8099c60 con 0x7f03080d0dc0 2024-09-17T05:51:08.063 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:08.061+0000 7f030dd49640 1 --2- 172.21.15.150:0/558134544 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f02ec07a570 0x7f02ec07ca80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:51:08.063 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:08.062+0000 7f030dd49640 1 --2- 172.21.15.150:0/558134544 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f02ec07a570 0x7f02ec07ca80 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7f0304034000 tx=0x7f0304004730 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:51:08.066 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:08.066+0000 7f02fe7fc640 1 -- 172.21.15.150:0/558134544 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f02f8020020 con 0x7f03080d0dc0 2024-09-17T05:51:08.312 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:08.311+0000 7f030ffad640 1 -- 172.21.15.150:0/558134544 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_volumes.TestCloneProgressReporter.test_when_clones_cancelled_are_equal_to_cloner_threads"]} v 0) -- 0x7f03080d17b0 con 0x7f03080d0dc0 2024-09-17T05:51:09.299 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:09.299+0000 7f02fe7fc640 1 -- 172.21.15.150:0/558134544 <== mon.0 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_volumes.TestCloneProgressReporter.test_when_clones_cancelled_are_equal_to_cloner_threads"]}]=0 v461) ==== 188+0+0 (secure 0 0 0) 0x7f02f8063ba0 con 0x7f03080d0dc0 2024-09-17T05:51:09.302 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:09.301+0000 7f030ffad640 1 -- 172.21.15.150:0/558134544 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f02ec07a570 msgr2=0x7f02ec07ca80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:51:09.302 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:09.301+0000 7f030ffad640 1 --2- 172.21.15.150:0/558134544 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f02ec07a570 0x7f02ec07ca80 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7f0304034000 tx=0x7f0304004730 comp rx=0 tx=0).stop 2024-09-17T05:51:09.303 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:09.301+0000 7f030ffad640 1 -- 172.21.15.150:0/558134544 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f03080d0dc0 msgr2=0x7f030814b090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:51:09.303 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:09.301+0000 7f030ffad640 1 --2- 172.21.15.150:0/558134544 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f03080d0dc0 0x7f030814b090 secure :-1 s=READY pgs=1445 cs=0 l=1 rev1=1 crypto rx=0x7f02f800c450 tx=0x7f02f800c910 comp rx=0 tx=0).stop 2024-09-17T05:51:09.303 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:09.301+0000 7f030ffad640 1 -- 172.21.15.150:0/558134544 shutdown_connections 2024-09-17T05:51:09.303 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:09.301+0000 7f030ffad640 1 --2- 172.21.15.150:0/558134544 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f03080d11d0 0x7f030806f350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:51:09.303 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:09.301+0000 7f030ffad640 1 --2- 172.21.15.150:0/558134544 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f02ec07a570 0x7f02ec07ca80 unknown :-1 s=CLOSED pgs=619 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:51:09.303 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:09.301+0000 7f030ffad640 1 --2- 172.21.15.150:0/558134544 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f03080d0dc0 0x7f030814b090 unknown :-1 s=CLOSED pgs=1445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:51:09.303 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:09.301+0000 7f030ffad640 1 --2- 172.21.15.150:0/558134544 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f03080d03b0 0x7f0308162690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:51:09.303 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:09.302+0000 7f030ffad640 1 -- 172.21.15.150:0/558134544 >> 172.21.15.150:0/558134544 conn(0x7f03080cef30 msgr2=0x7f03080ce220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:51:09.303 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:09.302+0000 7f030ffad640 1 -- 172.21.15.150:0/558134544 shutdown_connections 2024-09-17T05:51:09.303 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:09.302+0000 7f030ffad640 1 -- 172.21.15.150:0/558134544 wait complete. 2024-09-17T05:51:09.316 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config dump 2024-09-17T05:51:09.435 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:09.433+0000 7f0918fc6640 1 -- 172.21.15.150:0/2864166910 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f091406cda0 msgr2=0x7f091406d1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:51:09.435 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:09.433+0000 7f0918fc6640 1 --2- 172.21.15.150:0/2864166910 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f091406cda0 0x7f091406d1b0 secure :-1 s=READY pgs=1447 cs=0 l=1 rev1=1 crypto rx=0x7f090c009be0 tx=0x7f090c02a8d0 comp rx=0 tx=0).stop 2024-09-17T05:51:09.435 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:09.434+0000 7f0918fc6640 1 -- 172.21.15.150:0/2864166910 shutdown_connections 2024-09-17T05:51:09.435 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:09.434+0000 7f0918fc6640 1 --2- 172.21.15.150:0/2864166910 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f09140716f0 0x7f0914071b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:51:09.435 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:09.434+0000 7f0918fc6640 1 --2- 172.21.15.150:0/2864166910 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f091406cda0 0x7f091406d1b0 unknown :-1 s=CLOSED pgs=1447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:51:09.435 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:09.434+0000 7f0918fc6640 1 -- 172.21.15.150:0/2864166910 >> 172.21.15.150:0/2864166910 conn(0x7f09140d0b50 msgr2=0x7f09140d0f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:51:09.435 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:09.434+0000 7f0918fc6640 1 -- 172.21.15.150:0/2864166910 shutdown_connections 2024-09-17T05:51:09.435 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:09.434+0000 7f0918fc6640 1 -- 172.21.15.150:0/2864166910 wait complete. 2024-09-17T05:51:09.436 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:09.436+0000 7f0918fc6640 1 Processor -- start 2024-09-17T05:51:09.436 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:09.436+0000 7f0918fc6640 1 -- start start 2024-09-17T05:51:09.439 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:09.437+0000 7f0918fc6640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f091406cda0 0x7f0914159e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:51:09.439 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:09.437+0000 7f0918fc6640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f09140716f0 0x7f0914140600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:51:09.439 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:09.437+0000 7f0918fc6640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f091415d730 0x7f09140cf080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:51:09.439 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:09.437+0000 7f0918fc6640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f091406d870 con 0x7f09140716f0 2024-09-17T05:51:09.439 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:09.437+0000 7f0918fc6640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f091406d6f0 con 0x7f091406cda0 2024-09-17T05:51:09.439 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:09.437+0000 7f0918fc6640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f091406d9f0 con 0x7f091415d730 2024-09-17T05:51:09.439 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:09.437+0000 7f0911d9b640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f09140716f0 0x7f0914140600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:51:09.439 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:09.437+0000 7f0911d9b640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f09140716f0 0x7f0914140600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:39008/0 (socket says 172.21.15.150:39008) 2024-09-17T05:51:09.440 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:09.437+0000 7f0911d9b640 1 -- 172.21.15.150:0/3401800439 learned_addr learned my addr 172.21.15.150:0/3401800439 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:51:09.440 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:09.437+0000 7f0911d9b640 1 -- 172.21.15.150:0/3401800439 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f091415d730 msgr2=0x7f09140cf080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:51:09.440 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:09.437+0000 7f0912d9d640 1 --2- 172.21.15.150:0/3401800439 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f091415d730 0x7f09140cf080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:51:09.440 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:09.437+0000 7f0911d9b640 1 --2- 172.21.15.150:0/3401800439 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f091415d730 0x7f09140cf080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:51:09.440 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:09.437+0000 7f0911d9b640 1 -- 172.21.15.150:0/3401800439 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f091406cda0 msgr2=0x7f0914159e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:51:09.440 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:09.437+0000 7f0911d9b640 1 --2- 172.21.15.150:0/3401800439 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f091406cda0 0x7f0914159e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:51:09.440 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:09.437+0000 7f0911d9b640 1 -- 172.21.15.150:0/3401800439 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0914140b40 con 0x7f09140716f0 2024-09-17T05:51:09.440 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:09.437+0000 7f0911d9b640 1 --2- 172.21.15.150:0/3401800439 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f09140716f0 0x7f0914140600 secure :-1 s=READY pgs=1448 cs=0 l=1 rev1=1 crypto rx=0x7f090800d6d0 tx=0x7f090800db90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:51:09.440 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:09.438+0000 7f0902ffd640 1 -- 172.21.15.150:0/3401800439 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0908017070 con 0x7f09140716f0 2024-09-17T05:51:09.440 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:09.438+0000 7f0902ffd640 1 -- 172.21.15.150:0/3401800439 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0908009b10 con 0x7f09140716f0 2024-09-17T05:51:09.441 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:09.438+0000 7f0918fc6640 1 -- 172.21.15.150:0/3401800439 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f09140ce8c0 con 0x7f09140716f0 2024-09-17T05:51:09.441 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:09.438+0000 7f0902ffd640 1 -- 172.21.15.150:0/3401800439 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0908010460 con 0x7f09140716f0 2024-09-17T05:51:09.441 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:09.438+0000 7f0918fc6640 1 -- 172.21.15.150:0/3401800439 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f091415c6e0 con 0x7f09140716f0 2024-09-17T05:51:09.442 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:09.439+0000 7f0918fc6640 1 -- 172.21.15.150:0/3401800439 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f091406d1b0 con 0x7f09140716f0 2024-09-17T05:51:09.442 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:09.440+0000 7f0902ffd640 1 -- 172.21.15.150:0/3401800439 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 37) ==== 103787+0+0 (secure 0 0 0) 0x7f090801a070 con 0x7f09140716f0 2024-09-17T05:51:09.442 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:09.440+0000 7f0902ffd640 1 --2- 172.21.15.150:0/3401800439 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f08f407a5a0 0x7f08f407cab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:51:09.442 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:09.440+0000 7f0902ffd640 1 -- 172.21.15.150:0/3401800439 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(105..105 src has 1..105) ==== 5083+0+0 (secure 0 0 0) 0x7f0908099d40 con 0x7f09140716f0 2024-09-17T05:51:09.442 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:09.440+0000 7f091259c640 1 --2- 172.21.15.150:0/3401800439 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f08f407a5a0 0x7f08f407cab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:51:09.442 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:09.441+0000 7f091259c640 1 --2- 172.21.15.150:0/3401800439 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f08f407a5a0 0x7f08f407cab0 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7f09040046b0 tx=0x7f09040079d0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:51:09.445 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:09.445+0000 7f0902ffd640 1 -- 172.21.15.150:0/3401800439 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f0908063c00 con 0x7f09140716f0 2024-09-17T05:51:09.620 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:09.619+0000 7f0918fc6640 1 -- 172.21.15.150:0/3401800439 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "config dump"} v 0) -- 0x7f091415c920 con 0x7f09140716f0 2024-09-17T05:51:09.620 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:09.619+0000 7f0902ffd640 1 -- 172.21.15.150:0/3401800439 <== mon.0 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "config dump"}]=0 v51) ==== 59+0+2294 (secure 0 0 0) 0x7f0908063500 con 0x7f09140716f0 2024-09-17T05:51:09.620 INFO:teuthology.orchestra.run.smithi150.stdout:WHO MASK LEVEL OPTION VALUE RO 2024-09-17T05:51:09.621 INFO:teuthology.orchestra.run.smithi150.stdout:mon advanced mon_op_complaint_time 120 2024-09-17T05:51:09.621 INFO:teuthology.orchestra.run.smithi150.stdout:mgr advanced client_mount_timeout 30 2024-09-17T05:51:09.621 INFO:teuthology.orchestra.run.smithi150.stdout:mgr advanced debug_client 20/20 2024-09-17T05:51:09.621 INFO:teuthology.orchestra.run.smithi150.stdout:mgr advanced debug_mgr 20/20 2024-09-17T05:51:09.621 INFO:teuthology.orchestra.run.smithi150.stdout:mgr advanced debug_ms 1/1 2024-09-17T05:51:09.621 INFO:teuthology.orchestra.run.smithi150.stdout:mgr dev mon_warn_on_pool_no_app false 2024-09-17T05:51:09.621 INFO:teuthology.orchestra.run.smithi150.stdout:osd advanced osd_op_complaint_time 180.000000 2024-09-17T05:51:09.621 INFO:teuthology.orchestra.run.smithi150.stdout:osd.0 basic osd_mclock_max_capacity_iops_ssd 6764.239331 2024-09-17T05:51:09.621 INFO:teuthology.orchestra.run.smithi150.stdout:osd.1 basic osd_mclock_max_capacity_iops_ssd 4956.769289 2024-09-17T05:51:09.621 INFO:teuthology.orchestra.run.smithi150.stdout:osd.2 basic osd_mclock_max_capacity_iops_ssd 5099.704467 2024-09-17T05:51:09.621 INFO:teuthology.orchestra.run.smithi150.stdout:osd.3 basic osd_mclock_max_capacity_iops_ssd 4681.616196 2024-09-17T05:51:09.621 INFO:teuthology.orchestra.run.smithi150.stdout:osd.4 basic osd_mclock_max_capacity_iops_ssd 4723.364425 2024-09-17T05:51:09.622 INFO:teuthology.orchestra.run.smithi150.stdout:osd.5 basic osd_mclock_max_capacity_iops_ssd 4509.722124 2024-09-17T05:51:09.622 INFO:teuthology.orchestra.run.smithi150.stdout:osd.6 basic osd_mclock_max_capacity_iops_ssd 6380.664158 2024-09-17T05:51:09.622 INFO:teuthology.orchestra.run.smithi150.stdout:osd.7 basic osd_mclock_max_capacity_iops_ssd 4303.333825 2024-09-17T05:51:09.622 INFO:teuthology.orchestra.run.smithi150.stdout:mds advanced debug_mds 20/20 2024-09-17T05:51:09.622 INFO:teuthology.orchestra.run.smithi150.stdout:mds advanced debug_mds_balancer 20/20 2024-09-17T05:51:09.622 INFO:teuthology.orchestra.run.smithi150.stdout:mds advanced debug_ms 2/2 2024-09-17T05:51:09.622 INFO:teuthology.orchestra.run.smithi150.stdout:mds dev mds_debug_frag true 2024-09-17T05:51:09.622 INFO:teuthology.orchestra.run.smithi150.stdout:mds dev mds_debug_scatterstat true 2024-09-17T05:51:09.622 INFO:teuthology.orchestra.run.smithi150.stdout:mds advanced mds_op_complaint_time 180.000000 2024-09-17T05:51:09.622 INFO:teuthology.orchestra.run.smithi150.stdout:mds dev mds_verify_scatter true 2024-09-17T05:51:09.622 INFO:teuthology.orchestra.run.smithi150.stdout:mds advanced osd_op_complaint_time 180.000000 2024-09-17T05:51:09.623 INFO:teuthology.orchestra.run.smithi150.stdout:mds advanced rados_mon_op_timeout 900 2024-09-17T05:51:09.623 INFO:teuthology.orchestra.run.smithi150.stdout:mds advanced rados_osd_op_timeout 900 2024-09-17T05:51:09.623 INFO:teuthology.orchestra.run.smithi150.stdout:client advanced client_mount_timeout 600 2024-09-17T05:51:09.623 INFO:teuthology.orchestra.run.smithi150.stdout:client advanced debug_client 20/20 2024-09-17T05:51:09.623 INFO:teuthology.orchestra.run.smithi150.stdout:client advanced debug_ms 1/1 2024-09-17T05:51:09.623 INFO:teuthology.orchestra.run.smithi150.stdout:client advanced rados_mon_op_timeout 900 2024-09-17T05:51:09.623 INFO:teuthology.orchestra.run.smithi150.stdout:client advanced rados_osd_op_timeout 900 2024-09-17T05:51:09.624 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:09.621+0000 7f0918fc6640 1 -- 172.21.15.150:0/3401800439 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f08f407a5a0 msgr2=0x7f08f407cab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:51:09.624 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:09.621+0000 7f0918fc6640 1 --2- 172.21.15.150:0/3401800439 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f08f407a5a0 0x7f08f407cab0 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7f09040046b0 tx=0x7f09040079d0 comp rx=0 tx=0).stop 2024-09-17T05:51:09.624 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:09.622+0000 7f0918fc6640 1 -- 172.21.15.150:0/3401800439 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f09140716f0 msgr2=0x7f0914140600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:51:09.624 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:09.622+0000 7f0918fc6640 1 --2- 172.21.15.150:0/3401800439 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f09140716f0 0x7f0914140600 secure :-1 s=READY pgs=1448 cs=0 l=1 rev1=1 crypto rx=0x7f090800d6d0 tx=0x7f090800db90 comp rx=0 tx=0).stop 2024-09-17T05:51:09.624 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:09.622+0000 7f0918fc6640 1 -- 172.21.15.150:0/3401800439 shutdown_connections 2024-09-17T05:51:09.624 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:09.622+0000 7f0918fc6640 1 --2- 172.21.15.150:0/3401800439 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f08f407a5a0 0x7f08f407cab0 unknown :-1 s=CLOSED pgs=620 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:51:09.625 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:09.622+0000 7f0918fc6640 1 --2- 172.21.15.150:0/3401800439 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f091415d730 0x7f09140cf080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:51:09.625 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:09.622+0000 7f0918fc6640 1 --2- 172.21.15.150:0/3401800439 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f09140716f0 0x7f0914140600 unknown :-1 s=CLOSED pgs=1448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:51:09.625 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:09.622+0000 7f0918fc6640 1 --2- 172.21.15.150:0/3401800439 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f091406cda0 0x7f0914159e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:51:09.625 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:09.622+0000 7f0918fc6640 1 -- 172.21.15.150:0/3401800439 >> 172.21.15.150:0/3401800439 conn(0x7f09140d0b50 msgr2=0x7f0914145570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:51:09.625 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:09.622+0000 7f0918fc6640 1 -- 172.21.15.150:0/3401800439 shutdown_connections 2024-09-17T05:51:09.625 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:09.622+0000 7f0918fc6640 1 -- 172.21.15.150:0/3401800439 wait complete. 2024-09-17T05:51:09.634 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-09-17T05:51:09.751 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:09.750+0000 7f6a4549b640 1 -- 172.21.15.150:0/2331655281 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6a2c004800 msgr2=0x7f6a2c004c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:51:09.751 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:09.750+0000 7f6a4549b640 1 --2- 172.21.15.150:0/2331655281 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6a2c004800 0x7f6a2c004c10 secure :-1 s=READY pgs=1450 cs=0 l=1 rev1=1 crypto rx=0x7f6a400b1d40 tx=0x7f6a2c005830 comp rx=0 tx=0).stop 2024-09-17T05:51:09.751 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:09.750+0000 7f6a3f7fe640 1 -- 172.21.15.150:0/2331655281 reap_dead start 2024-09-17T05:51:09.751 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:09.750+0000 7f6a4549b640 1 -- 172.21.15.150:0/2331655281 shutdown_connections 2024-09-17T05:51:09.751 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:09.750+0000 7f6a4549b640 1 -- 172.21.15.150:0/2331655281 >> 172.21.15.150:0/2331655281 conn(0x7f6a400cef80 msgr2=0x7f6a400cf390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:51:09.751 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:09.750+0000 7f6a4549b640 1 -- 172.21.15.150:0/2331655281 shutdown_connections 2024-09-17T05:51:09.751 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:09.750+0000 7f6a4549b640 1 -- 172.21.15.150:0/2331655281 wait complete. 2024-09-17T05:51:09.752 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:09.752+0000 7f6a4549b640 1 Processor -- start 2024-09-17T05:51:09.752 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:09.752+0000 7f6a4549b640 1 -- start start 2024-09-17T05:51:09.755 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:09.753+0000 7f6a4549b640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6a2c004800 0x7f6a40156f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:51:09.755 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:09.753+0000 7f6a4549b640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6a40151b20 0x7f6a4015dcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:51:09.755 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:09.753+0000 7f6a4549b640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6a4015e1f0 0x7f6a4015b6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:51:09.756 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:09.753+0000 7f6a4549b640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f6a400d1490 con 0x7f6a40151b20 2024-09-17T05:51:09.756 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:09.753+0000 7f6a4549b640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f6a400d1310 con 0x7f6a2c004800 2024-09-17T05:51:09.756 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:09.753+0000 7f6a4549b640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f6a400b1860 con 0x7f6a4015e1f0 2024-09-17T05:51:09.756 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:09.753+0000 7f6a367fc640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6a40151b20 0x7f6a4015dcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:51:09.756 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:09.753+0000 7f6a367fc640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6a40151b20 0x7f6a4015dcb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:39020/0 (socket says 172.21.15.150:39020) 2024-09-17T05:51:09.756 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:09.753+0000 7f6a367fc640 1 -- 172.21.15.150:0/1103110604 learned_addr learned my addr 172.21.15.150:0/1103110604 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:51:09.756 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:09.753+0000 7f6a3effd640 1 --2- 172.21.15.150:0/1103110604 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6a2c004800 0x7f6a40156f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:51:09.756 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:09.753+0000 7f6a3f7fe640 1 --2- 172.21.15.150:0/1103110604 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6a4015e1f0 0x7f6a4015b6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:51:09.756 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:09.753+0000 7f6a367fc640 1 -- 172.21.15.150:0/1103110604 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6a4015e1f0 msgr2=0x7f6a4015b6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:51:09.756 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:09.753+0000 7f6a367fc640 1 --2- 172.21.15.150:0/1103110604 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6a4015e1f0 0x7f6a4015b6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:51:09.756 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:09.753+0000 7f6a367fc640 1 -- 172.21.15.150:0/1103110604 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6a2c004800 msgr2=0x7f6a40156f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:51:09.756 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:09.754+0000 7f6a367fc640 1 --2- 172.21.15.150:0/1103110604 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6a2c004800 0x7f6a40156f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:51:09.756 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:09.754+0000 7f6a367fc640 1 -- 172.21.15.150:0/1103110604 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6a4015e600 con 0x7f6a40151b20 2024-09-17T05:51:09.757 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:09.754+0000 7f6a3f7fe640 1 --2- 172.21.15.150:0/1103110604 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6a4015e1f0 0x7f6a4015b6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T05:51:09.757 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:09.754+0000 7f6a367fc640 1 --2- 172.21.15.150:0/1103110604 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6a40151b20 0x7f6a4015dcb0 secure :-1 s=READY pgs=1451 cs=0 l=1 rev1=1 crypto rx=0x7f6a2802b000 tx=0x7f6a28003e40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:51:09.757 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:09.754+0000 7f6a37fff640 1 -- 172.21.15.150:0/1103110604 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a28005020 con 0x7f6a40151b20 2024-09-17T05:51:09.757 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:09.754+0000 7f6a37fff640 1 -- 172.21.15.150:0/1103110604 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f6a280052b0 con 0x7f6a40151b20 2024-09-17T05:51:09.757 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:09.754+0000 7f6a4549b640 1 -- 172.21.15.150:0/1103110604 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6a40160240 con 0x7f6a40151b20 2024-09-17T05:51:09.757 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:09.754+0000 7f6a37fff640 1 -- 172.21.15.150:0/1103110604 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a280047a0 con 0x7f6a40151b20 2024-09-17T05:51:09.757 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:09.754+0000 7f6a4549b640 1 -- 172.21.15.150:0/1103110604 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6a40160800 con 0x7f6a40151b20 2024-09-17T05:51:09.757 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:09.755+0000 7f6a4549b640 1 -- 172.21.15.150:0/1103110604 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6a400d0a60 con 0x7f6a40151b20 2024-09-17T05:51:09.758 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:09.756+0000 7f6a37fff640 1 -- 172.21.15.150:0/1103110604 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 37) ==== 103787+0+0 (secure 0 0 0) 0x7f6a28004940 con 0x7f6a40151b20 2024-09-17T05:51:09.758 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:09.756+0000 7f6a37fff640 1 --2- 172.21.15.150:0/1103110604 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f6a2007a5a0 0x7f6a2007cab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:51:09.758 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:09.757+0000 7f6a37fff640 1 -- 172.21.15.150:0/1103110604 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(105..105 src has 1..105) ==== 5083+0+0 (secure 0 0 0) 0x7f6a280bb640 con 0x7f6a40151b20 2024-09-17T05:51:09.758 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:09.757+0000 7f6a3effd640 1 --2- 172.21.15.150:0/1103110604 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f6a2007a5a0 0x7f6a2007cab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:51:09.758 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:09.757+0000 7f6a3effd640 1 --2- 172.21.15.150:0/1103110604 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f6a2007a5a0 0x7f6a2007cab0 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7f6a30001010 tx=0x7f6a300067a0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:51:09.761 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:09.760+0000 7f6a37fff640 1 -- 172.21.15.150:0/1103110604 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f6a4015e600 con 0x7f6a40151b20 2024-09-17T05:51:09.935 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:09.934+0000 7f6a4549b640 1 -- 172.21.15.150:0/1103110604 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) -- 0x7f6a400b0b30 con 0x7f6a40151b20 2024-09-17T05:51:09.939 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:09.938+0000 7f6a37fff640 1 -- 172.21.15.150:0/1103110604 <== mon.0 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v52)=0 v52) ==== 122+0+0 (secure 0 0 0) 0x7f6a2803f030 con 0x7f6a40151b20 2024-09-17T05:51:09.942 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:09.941+0000 7f6a4549b640 1 -- 172.21.15.150:0/1103110604 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f6a2007a5a0 msgr2=0x7f6a2007cab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:51:09.942 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:09.941+0000 7f6a4549b640 1 --2- 172.21.15.150:0/1103110604 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f6a2007a5a0 0x7f6a2007cab0 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7f6a30001010 tx=0x7f6a300067a0 comp rx=0 tx=0).stop 2024-09-17T05:51:09.942 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:09.941+0000 7f6a4549b640 1 -- 172.21.15.150:0/1103110604 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6a40151b20 msgr2=0x7f6a4015dcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:51:09.942 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:09.941+0000 7f6a4549b640 1 --2- 172.21.15.150:0/1103110604 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6a40151b20 0x7f6a4015dcb0 secure :-1 s=READY pgs=1451 cs=0 l=1 rev1=1 crypto rx=0x7f6a2802b000 tx=0x7f6a28003e40 comp rx=0 tx=0).stop 2024-09-17T05:51:09.942 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:09.941+0000 7f6a4549b640 1 -- 172.21.15.150:0/1103110604 shutdown_connections 2024-09-17T05:51:09.942 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:09.941+0000 7f6a4549b640 1 --2- 172.21.15.150:0/1103110604 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f6a2007a5a0 0x7f6a2007cab0 unknown :-1 s=CLOSED pgs=621 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:51:09.943 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:09.941+0000 7f6a4549b640 1 --2- 172.21.15.150:0/1103110604 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6a4015e1f0 0x7f6a4015b6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:51:09.943 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:09.941+0000 7f6a4549b640 1 --2- 172.21.15.150:0/1103110604 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6a40151b20 0x7f6a4015dcb0 unknown :-1 s=CLOSED pgs=1451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:51:09.943 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:09.941+0000 7f6a4549b640 1 --2- 172.21.15.150:0/1103110604 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6a2c004800 0x7f6a40156f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:51:09.943 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:09.941+0000 7f6a4549b640 1 -- 172.21.15.150:0/1103110604 >> 172.21.15.150:0/1103110604 conn(0x7f6a400cef80 msgr2=0x7f6a401538c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:51:09.943 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:09.941+0000 7f6a4549b640 1 -- 172.21.15.150:0/1103110604 shutdown_connections 2024-09-17T05:51:09.943 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:09.941+0000 7f6a4549b640 1 -- 172.21.15.150:0/1103110604 wait complete. 2024-09-17T05:51:09.953 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-17T05:51:09.953 DEBUG:teuthology.orchestra.run.smithi150:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-17T05:51:10.001 DEBUG:teuthology.orchestra.run.smithi176:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-17T05:51:10.048 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-17T05:51:10.048 DEBUG:teuthology.orchestra.run.smithi150:> set -ex 2024-09-17T05:51:10.049 DEBUG:teuthology.orchestra.run.smithi150:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T05:51:10.065 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056027,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497464k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=18693 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248728k,nr_inodes=812182,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497464k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-17T05:51:10.065 DEBUG:teuthology.orchestra.run.smithi176:> set -ex 2024-09-17T05:51:10.066 DEBUG:teuthology.orchestra.run.smithi176:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T05:51:10.084 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056030,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497468k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=3379 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248732k,nr_inodes=812183,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497468k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-17T05:51:10.084 DEBUG:teuthology.orchestra.run.smithi150:> set -ex 2024-09-17T05:51:10.084 DEBUG:teuthology.orchestra.run.smithi150:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T05:51:10.122 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056027,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497464k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=18693 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248728k,nr_inodes=812182,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497464k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-17T05:51:10.122 DEBUG:teuthology.orchestra.run.smithi176:> set -ex 2024-09-17T05:51:10.122 DEBUG:teuthology.orchestra.run.smithi176:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T05:51:10.142 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056030,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497468k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=3379 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248732k,nr_inodes=812183,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497468k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-17T05:51:10.142 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-09-17T05:51:10.142 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T05:51:10.276 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:10.274+0000 7fd764ede640 1 -- 172.21.15.150:0/2926862674 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd7600ae9e0 msgr2=0x7fd76006cda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:51:10.276 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:10.274+0000 7fd764ede640 1 --2- 172.21.15.150:0/2926862674 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd7600ae9e0 0x7fd76006cda0 secure :-1 s=READY pgs=1453 cs=0 l=1 rev1=1 crypto rx=0x7fd758009830 tx=0x7fd75802a530 comp rx=0 tx=0).stop 2024-09-17T05:51:10.276 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:10.274+0000 7fd764ede640 1 -- 172.21.15.150:0/2926862674 shutdown_connections 2024-09-17T05:51:10.276 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:10.274+0000 7fd764ede640 1 --2- 172.21.15.150:0/2926862674 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd7600ae9e0 0x7fd76006cda0 unknown :-1 s=CLOSED pgs=1453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:51:10.277 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:10.274+0000 7fd764ede640 1 -- 172.21.15.150:0/2926862674 >> 172.21.15.150:0/2926862674 conn(0x7fd7600b2ff0 msgr2=0x7fd7600b3400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:51:10.277 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:10.274+0000 7fd764ede640 1 -- 172.21.15.150:0/2926862674 shutdown_connections 2024-09-17T05:51:10.277 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:10.274+0000 7fd764ede640 1 -- 172.21.15.150:0/2926862674 wait complete. 2024-09-17T05:51:10.282 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:10.276+0000 7fd764ede640 1 Processor -- start 2024-09-17T05:51:10.282 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:10.276+0000 7fd764ede640 1 -- start start 2024-09-17T05:51:10.282 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:10.277+0000 7fd764ede640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd7600ae9e0 0x7fd76015f8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:51:10.283 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:10.277+0000 7fd764ede640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd7600b3b10 0x7fd7601f3650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:51:10.283 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:10.277+0000 7fd764ede640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd7600b6b70 0x7fd7601528f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:51:10.283 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:10.277+0000 7fd764ede640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7fd7600cd1b0 con 0x7fd7600ae9e0 2024-09-17T05:51:10.283 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:10.277+0000 7fd764ede640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fd7600cd030 con 0x7fd7600b3b10 2024-09-17T05:51:10.284 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:10.277+0000 7fd764ede640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fd7600cd330 con 0x7fd7600b6b70 2024-09-17T05:51:10.284 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:10.278+0000 7fd75e59c640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd7600ae9e0 0x7fd76015f8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:51:10.284 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:10.278+0000 7fd75e59c640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd7600ae9e0 0x7fd76015f8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:50072/0 (socket says 172.21.15.150:50072) 2024-09-17T05:51:10.284 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:10.278+0000 7fd75e59c640 1 -- 172.21.15.150:0/1114864517 learned_addr learned my addr 172.21.15.150:0/1114864517 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:51:10.284 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:10.278+0000 7fd75dd9b640 1 --2- 172.21.15.150:0/1114864517 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd7600b3b10 0x7fd7601f3650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:51:10.285 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:10.278+0000 7fd75ed9d640 1 --2- 172.21.15.150:0/1114864517 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd7600b6b70 0x7fd7601528f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:51:10.285 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:10.278+0000 7fd75e59c640 1 -- 172.21.15.150:0/1114864517 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd7600b6b70 msgr2=0x7fd7601528f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:51:10.285 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:10.278+0000 7fd75e59c640 1 --2- 172.21.15.150:0/1114864517 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd7600b6b70 0x7fd7601528f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:51:10.285 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:10.278+0000 7fd75e59c640 1 -- 172.21.15.150:0/1114864517 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd7600b3b10 msgr2=0x7fd7601f3650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:51:10.285 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:10.278+0000 7fd75e59c640 1 --2- 172.21.15.150:0/1114864517 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd7600b3b10 0x7fd7601f3650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:51:10.286 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:10.278+0000 7fd75e59c640 1 -- 172.21.15.150:0/1114864517 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd76015fe00 con 0x7fd7600ae9e0 2024-09-17T05:51:10.286 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:10.278+0000 7fd75dd9b640 1 --2- 172.21.15.150:0/1114864517 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd7600b3b10 0x7fd7601f3650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:51:10.286 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:10.278+0000 7fd75e59c640 1 --2- 172.21.15.150:0/1114864517 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd7600ae9e0 0x7fd76015f8c0 secure :-1 s=READY pgs=1454 cs=0 l=1 rev1=1 crypto rx=0x7fd75000c760 tx=0x7fd75000cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:51:10.286 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:10.278+0000 7fd74effd640 1 -- 172.21.15.150:0/1114864517 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd750003da0 con 0x7fd7600ae9e0 2024-09-17T05:51:10.286 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:10.278+0000 7fd74effd640 1 -- 172.21.15.150:0/1114864517 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd750005070 con 0x7fd7600ae9e0 2024-09-17T05:51:10.286 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:10.278+0000 7fd74effd640 1 -- 172.21.15.150:0/1114864517 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd750005480 con 0x7fd7600ae9e0 2024-09-17T05:51:10.287 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:10.278+0000 7fd764ede640 1 -- 172.21.15.150:0/1114864517 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd7601f4510 con 0x7fd7600ae9e0 2024-09-17T05:51:10.287 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:10.278+0000 7fd764ede640 1 -- 172.21.15.150:0/1114864517 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd7601f4230 con 0x7fd7600ae9e0 2024-09-17T05:51:10.287 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:10.279+0000 7fd764ede640 1 -- 172.21.15.150:0/1114864517 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd760050f60 con 0x7fd7600ae9e0 2024-09-17T05:51:10.287 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:10.280+0000 7fd74effd640 1 -- 172.21.15.150:0/1114864517 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 37) ==== 103787+0+0 (secure 0 0 0) 0x7fd750005620 con 0x7fd7600ae9e0 2024-09-17T05:51:10.287 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:10.281+0000 7fd74effd640 1 --2- 172.21.15.150:0/1114864517 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fd74007a5a0 0x7fd74007cab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:51:10.288 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:10.281+0000 7fd74effd640 1 -- 172.21.15.150:0/1114864517 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(105..105 src has 1..105) ==== 5083+0+0 (secure 0 0 0) 0x7fd7500999b0 con 0x7fd7600ae9e0 2024-09-17T05:51:10.288 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:10.281+0000 7fd75dd9b640 1 --2- 172.21.15.150:0/1114864517 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fd74007a5a0 0x7fd74007cab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:51:10.288 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:10.281+0000 7fd75dd9b640 1 --2- 172.21.15.150:0/1114864517 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fd74007a5a0 0x7fd74007cab0 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7fd754007fd0 tx=0x7fd754009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:51:10.289 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:10.285+0000 7fd74effd640 1 -- 172.21.15.150:0/1114864517 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fd760050f60 con 0x7fd7600ae9e0 2024-09-17T05:51:10.497 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:10.497+0000 7fd764ede640 1 -- 172.21.15.150:0/1114864517 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fd76006a610 con 0x7fd7600ae9e0 2024-09-17T05:51:10.498 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:10.497+0000 7fd74effd640 1 -- 172.21.15.150:0/1114864517 <== mon.0 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 63 v63) ==== 94+0+3917 (secure 0 0 0) 0x7fd76006a610 con 0x7fd7600ae9e0 2024-09-17T05:51:10.498 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-09-17T05:51:10.498 INFO:teuthology.orchestra.run.smithi150.stdout:{"epoch":63,"btime":"2024-09-17T05:51:04:282408+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6494,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6837/1755605193","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6835","nonce":1755605193},{"type":"v1","addr":"172.21.15.176:6837","nonce":1755605193}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":55},{"gid":7117,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6836/628081508","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6834","nonce":628081508},{"type":"v1","addr":"172.21.15.176:6836","nonce":628081508}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":55},{"gid":8061,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6835/187954104","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6833","nonce":187954104},{"type":"v1","addr":"172.21.15.150:6835","nonce":187954104}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":55},{"gid":8481,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6834/3687199763","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6832","nonce":3687199763},{"type":"v1","addr":"172.21.15.150:6834","nonce":3687199763}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":63}],"filesystems":[]} 2024-09-17T05:51:10.499 INFO:teuthology.orchestra.run.smithi150.stderr:dumped fsmap epoch 63 2024-09-17T05:51:10.500 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:10.499+0000 7fd764ede640 1 -- 172.21.15.150:0/1114864517 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fd74007a5a0 msgr2=0x7fd74007cab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:51:10.500 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:10.499+0000 7fd764ede640 1 --2- 172.21.15.150:0/1114864517 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fd74007a5a0 0x7fd74007cab0 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7fd754007fd0 tx=0x7fd754009040 comp rx=0 tx=0).stop 2024-09-17T05:51:10.501 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:10.499+0000 7fd764ede640 1 -- 172.21.15.150:0/1114864517 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd7600ae9e0 msgr2=0x7fd76015f8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:51:10.501 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:10.499+0000 7fd764ede640 1 --2- 172.21.15.150:0/1114864517 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd7600ae9e0 0x7fd76015f8c0 secure :-1 s=READY pgs=1454 cs=0 l=1 rev1=1 crypto rx=0x7fd75000c760 tx=0x7fd75000cc20 comp rx=0 tx=0).stop 2024-09-17T05:51:10.501 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:10.499+0000 7fd764ede640 1 -- 172.21.15.150:0/1114864517 shutdown_connections 2024-09-17T05:51:10.501 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:10.499+0000 7fd764ede640 1 --2- 172.21.15.150:0/1114864517 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd7600b3b10 0x7fd7601f3650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:51:10.501 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:10.499+0000 7fd764ede640 1 --2- 172.21.15.150:0/1114864517 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fd74007a5a0 0x7fd74007cab0 unknown :-1 s=CLOSED pgs=622 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:51:10.501 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:10.499+0000 7fd764ede640 1 --2- 172.21.15.150:0/1114864517 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd7600b6b70 0x7fd7601528f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:51:10.501 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:10.499+0000 7fd764ede640 1 --2- 172.21.15.150:0/1114864517 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd7600ae9e0 0x7fd76015f8c0 unknown :-1 s=CLOSED pgs=1454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:51:10.501 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:10.499+0000 7fd764ede640 1 -- 172.21.15.150:0/1114864517 >> 172.21.15.150:0/1114864517 conn(0x7fd7600b2ff0 msgr2=0x7fd760153760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:51:10.501 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:10.500+0000 7fd764ede640 1 -- 172.21.15.150:0/1114864517 shutdown_connections 2024-09-17T05:51:10.501 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:10.500+0000 7fd764ede640 1 -- 172.21.15.150:0/1114864517 wait complete. 2024-09-17T05:51:10.512 INFO:tasks.ceph.mds.a:Restarting daemon 2024-09-17T05:51:10.513 INFO:tasks.ceph.mds.a:Stopping old one... 2024-09-17T05:51:10.513 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-09-17T05:51:10.513 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T05:51:10.513 INFO:tasks.ceph.mds.c:Restarting daemon 2024-09-17T05:51:10.513 INFO:tasks.ceph.mds.c:Stopping old one... 2024-09-17T05:51:10.513 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-09-17T05:51:10.513 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T05:51:10.514 INFO:tasks.ceph.mds.b:Restarting daemon 2024-09-17T05:51:10.514 INFO:tasks.ceph.mds.b:Stopping old one... 2024-09-17T05:51:10.514 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-09-17T05:51:10.514 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T05:51:10.514 INFO:tasks.ceph.mds.d:Restarting daemon 2024-09-17T05:51:10.514 INFO:tasks.ceph.mds.d:Stopping old one... 2024-09-17T05:51:10.514 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-09-17T05:51:10.515 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T05:51:10.524 INFO:tasks.ceph.mds.a:Stopped 2024-09-17T05:51:10.524 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-09-17T05:51:10.528 INFO:tasks.ceph.mds.c:Stopped 2024-09-17T05:51:10.528 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-09-17T05:51:10.529 INFO:tasks.ceph.mds.b:Stopped 2024-09-17T05:51:10.529 DEBUG:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-09-17T05:51:10.530 INFO:tasks.ceph.mds.d:Stopped 2024-09-17T05:51:10.530 DEBUG:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-09-17T05:51:10.571 INFO:tasks.ceph.mds.a:Started 2024-09-17T05:51:10.572 DEBUG:teuthology.parallel:result is None 2024-09-17T05:51:10.573 INFO:tasks.ceph.mds.c:Started 2024-09-17T05:51:10.574 DEBUG:teuthology.parallel:result is None 2024-09-17T05:51:10.574 INFO:tasks.ceph.mds.b:Started 2024-09-17T05:51:10.575 DEBUG:teuthology.parallel:result is None 2024-09-17T05:51:10.575 INFO:tasks.ceph.mds.d:Started 2024-09-17T05:51:10.576 DEBUG:teuthology.parallel:result is None 2024-09-17T05:51:10.576 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-09-17T05:51:10.659 INFO:tasks.ceph.mds.a.smithi150.stdout:starting mds.a at 2024-09-17T05:51:10.660 INFO:tasks.ceph.mds.c.smithi150.stdout:starting mds.c at 2024-09-17T05:51:10.666 INFO:tasks.ceph.mds.d.smithi176.stdout:starting mds.d at 2024-09-17T05:51:10.667 INFO:tasks.ceph.mds.b.smithi176.stdout:starting mds.b at 2024-09-17T05:51:10.697 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:10.696+0000 7f898864d640 1 -- 172.21.15.150:0/2227684576 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f89800c5b90 msgr2=0x7f89800d02b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:51:10.697 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:10.696+0000 7f898864d640 1 --2- 172.21.15.150:0/2227684576 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f89800c5b90 0x7f89800d02b0 secure :-1 s=READY pgs=1463 cs=0 l=1 rev1=1 crypto rx=0x7f897c009820 tx=0x7f897c02a510 comp rx=0 tx=0).stop 2024-09-17T05:51:10.698 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:10.696+0000 7f898864d640 1 -- 172.21.15.150:0/2227684576 shutdown_connections 2024-09-17T05:51:10.698 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:10.696+0000 7f898864d640 1 --2- 172.21.15.150:0/2227684576 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f89800d07f0 0x7f89800b1da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:51:10.698 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:10.696+0000 7f898864d640 1 --2- 172.21.15.150:0/2227684576 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f89800c5b90 0x7f89800d02b0 unknown :-1 s=CLOSED pgs=1463 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:51:10.698 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:10.696+0000 7f898864d640 1 -- 172.21.15.150:0/2227684576 >> 172.21.15.150:0/2227684576 conn(0x7f89800cef80 msgr2=0x7f89800cf390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:51:10.698 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:10.696+0000 7f898864d640 1 -- 172.21.15.150:0/2227684576 shutdown_connections 2024-09-17T05:51:10.698 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:10.696+0000 7f898864d640 1 -- 172.21.15.150:0/2227684576 wait complete. 2024-09-17T05:51:10.699 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:10.698+0000 7f898864d640 1 Processor -- start 2024-09-17T05:51:10.699 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:10.698+0000 7f898864d640 1 -- start start 2024-09-17T05:51:10.702 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:10.699+0000 7f898864d640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f898009ba60 0x7f898015b170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:51:10.702 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:10.699+0000 7f898864d640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f89800c5b90 0x7f89800b6af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:51:10.702 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:10.699+0000 7f898864d640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f89800d07f0 0x7f89800b7030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:51:10.702 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:10.699+0000 7f898864d640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f89800b2b70 con 0x7f89800d07f0 2024-09-17T05:51:10.702 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:10.699+0000 7f898864d640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f89800b29f0 con 0x7f898009ba60 2024-09-17T05:51:10.703 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:10.699+0000 7f898864d640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f89800b2cf0 con 0x7f89800c5b90 2024-09-17T05:51:10.703 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:10.699+0000 7f8986bea640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f89800d07f0 0x7f89800b7030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:51:10.703 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:10.699+0000 7f8986bea640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f89800d07f0 0x7f89800b7030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:50126/0 (socket says 172.21.15.150:50126) 2024-09-17T05:51:10.703 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:10.699+0000 7f8986bea640 1 -- 172.21.15.150:0/2665741822 learned_addr learned my addr 172.21.15.150:0/2665741822 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:51:10.703 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:10.699+0000 7f8985be8640 1 --2- 172.21.15.150:0/2665741822 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f89800c5b90 0x7f89800b6af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:51:10.703 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:10.699+0000 7f89863e9640 1 --2- 172.21.15.150:0/2665741822 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f898009ba60 0x7f898015b170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:51:10.704 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:10.700+0000 7f8986bea640 1 -- 172.21.15.150:0/2665741822 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f89800c5b90 msgr2=0x7f89800b6af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:51:10.704 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:10.700+0000 7f8986bea640 1 --2- 172.21.15.150:0/2665741822 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f89800c5b90 0x7f89800b6af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:51:10.704 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:10.700+0000 7f8986bea640 1 -- 172.21.15.150:0/2665741822 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f898009ba60 msgr2=0x7f898015b170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:51:10.704 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:10.700+0000 7f8986bea640 1 --2- 172.21.15.150:0/2665741822 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f898009ba60 0x7f898015b170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:51:10.704 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:10.700+0000 7f8986bea640 1 -- 172.21.15.150:0/2665741822 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f89801642c0 con 0x7f89800d07f0 2024-09-17T05:51:10.704 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:10.700+0000 7f8986bea640 1 --2- 172.21.15.150:0/2665741822 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f89800d07f0 0x7f89800b7030 secure :-1 s=READY pgs=1464 cs=0 l=1 rev1=1 crypto rx=0x7f897800ca80 tx=0x7f897800cf40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:51:10.705 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:10.700+0000 7f8976ffd640 1 -- 172.21.15.150:0/2665741822 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8978016020 con 0x7f89800d07f0 2024-09-17T05:51:10.705 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:10.700+0000 7f898864d640 1 -- 172.21.15.150:0/2665741822 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8980161bd0 con 0x7f89800d07f0 2024-09-17T05:51:10.705 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:10.700+0000 7f8976ffd640 1 -- 172.21.15.150:0/2665741822 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f897800ad20 con 0x7f89800d07f0 2024-09-17T05:51:10.705 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:10.700+0000 7f8976ffd640 1 -- 172.21.15.150:0/2665741822 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8978012680 con 0x7f89800d07f0 2024-09-17T05:51:10.705 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:10.700+0000 7f898864d640 1 -- 172.21.15.150:0/2665741822 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8980163da0 con 0x7f89800d07f0 2024-09-17T05:51:10.705 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:10.701+0000 7f898864d640 1 -- 172.21.15.150:0/2665741822 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f898015b8e0 con 0x7f89800d07f0 2024-09-17T05:51:10.707 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:10.702+0000 7f8976ffd640 1 -- 172.21.15.150:0/2665741822 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 37) ==== 103787+0+0 (secure 0 0 0) 0x7f8978019020 con 0x7f89800d07f0 2024-09-17T05:51:10.707 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:10.703+0000 7f8976ffd640 1 --2- 172.21.15.150:0/2665741822 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f896407a570 0x7f896407ca80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:51:10.707 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:10.703+0000 7f8976ffd640 1 -- 172.21.15.150:0/2665741822 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(105..105 src has 1..105) ==== 5083+0+0 (secure 0 0 0) 0x7f8978099fa0 con 0x7f89800d07f0 2024-09-17T05:51:10.707 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:10.703+0000 7f89863e9640 1 --2- 172.21.15.150:0/2665741822 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f896407a570 0x7f896407ca80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:51:10.707 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:10.703+0000 7f89863e9640 1 --2- 172.21.15.150:0/2665741822 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f896407a570 0x7f896407ca80 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7f897c034000 tx=0x7f897c004730 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:51:10.708 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:10.707+0000 7f8976ffd640 1 -- 172.21.15.150:0/2665741822 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f8978020020 con 0x7f89800d07f0 2024-09-17T05:51:10.895 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:10.895+0000 7f898864d640 1 -- 172.21.15.150:0/2665741822 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) -- 0x7f89800d02b0 con 0x7f89800d07f0 2024-09-17T05:51:11.317 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:11.316+0000 7f8976ffd640 1 -- 172.21.15.150:0/2665741822 <== mon.0 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v107) ==== 97+0+0 (secure 0 0 0) 0x7f89780638a0 con 0x7f89800d07f0 2024-09-17T05:51:11.317 INFO:teuthology.orchestra.run.smithi150.stderr: removed all blocklist entries 2024-09-17T05:51:11.319 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:11.318+0000 7f898864d640 1 -- 172.21.15.150:0/2665741822 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f896407a570 msgr2=0x7f896407ca80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:51:11.319 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:11.318+0000 7f898864d640 1 --2- 172.21.15.150:0/2665741822 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f896407a570 0x7f896407ca80 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7f897c034000 tx=0x7f897c004730 comp rx=0 tx=0).stop 2024-09-17T05:51:11.319 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:11.318+0000 7f898864d640 1 -- 172.21.15.150:0/2665741822 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f89800d07f0 msgr2=0x7f89800b7030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:51:11.320 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:11.318+0000 7f898864d640 1 --2- 172.21.15.150:0/2665741822 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f89800d07f0 0x7f89800b7030 secure :-1 s=READY pgs=1464 cs=0 l=1 rev1=1 crypto rx=0x7f897800ca80 tx=0x7f897800cf40 comp rx=0 tx=0).stop 2024-09-17T05:51:11.320 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:11.318+0000 7f898864d640 1 -- 172.21.15.150:0/2665741822 shutdown_connections 2024-09-17T05:51:11.320 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:11.318+0000 7f898864d640 1 --2- 172.21.15.150:0/2665741822 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f896407a570 0x7f896407ca80 unknown :-1 s=CLOSED pgs=623 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:51:11.320 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:11.318+0000 7f898864d640 1 --2- 172.21.15.150:0/2665741822 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f89800d07f0 0x7f89800b7030 unknown :-1 s=CLOSED pgs=1464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:51:11.320 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:11.318+0000 7f898864d640 1 --2- 172.21.15.150:0/2665741822 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f89800c5b90 0x7f89800b6af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:51:11.320 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:11.318+0000 7f898864d640 1 --2- 172.21.15.150:0/2665741822 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f898009ba60 0x7f898015b170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:51:11.320 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:11.318+0000 7f898864d640 1 -- 172.21.15.150:0/2665741822 >> 172.21.15.150:0/2665741822 conn(0x7f89800cef80 msgr2=0x7f89800b16c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:51:11.320 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:11.318+0000 7f898864d640 1 -- 172.21.15.150:0/2665741822 shutdown_connections 2024-09-17T05:51:11.320 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:11.318+0000 7f898864d640 1 -- 172.21.15.150:0/2665741822 wait complete. 2024-09-17T05:51:11.332 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-09-17T05:51:11.445 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:11.444+0000 7f2b8d2f2640 1 -- 172.21.15.150:0/2001441126 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2b8815f910 msgr2=0x7f2b880b3750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:51:11.445 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:11.444+0000 7f2b8d2f2640 1 --2- 172.21.15.150:0/2001441126 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2b8815f910 0x7f2b880b3750 secure :-1 s=READY pgs=1466 cs=0 l=1 rev1=1 crypto rx=0x7f2b8806f3c0 tx=0x7f2b8002a820 comp rx=0 tx=0).stop 2024-09-17T05:51:11.445 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:11.444+0000 7f2b8d2f2640 1 -- 172.21.15.150:0/2001441126 shutdown_connections 2024-09-17T05:51:11.445 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:11.444+0000 7f2b8d2f2640 1 --2- 172.21.15.150:0/2001441126 >> v2:172.21.15.176:3300/0 conn(0x7f2b88152920 0x7f2b8815f3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:51:11.446 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:11.444+0000 7f2b8d2f2640 1 --2- 172.21.15.150:0/2001441126 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2b8815f910 0x7f2b880b3750 unknown :-1 s=CLOSED pgs=1466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:51:11.446 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:11.444+0000 7f2b8d2f2640 1 -- 172.21.15.150:0/2001441126 >> 172.21.15.150:0/2001441126 conn(0x7f2b8806d730 msgr2=0x7f2b880b1e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:51:11.446 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:11.444+0000 7f2b8d2f2640 1 -- 172.21.15.150:0/2001441126 shutdown_connections 2024-09-17T05:51:11.446 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:11.444+0000 7f2b8d2f2640 1 -- 172.21.15.150:0/2001441126 wait complete. 2024-09-17T05:51:11.446 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:11.446+0000 7f2b8d2f2640 1 Processor -- start 2024-09-17T05:51:11.446 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:11.446+0000 7f2b8d2f2640 1 -- start start 2024-09-17T05:51:11.450 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:11.447+0000 7f2b8d2f2640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2b880aebc0 0x7f2b880ceb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:51:11.450 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:11.447+0000 7f2b8d2f2640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2b88152920 0x7f2b881f3460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:51:11.450 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:11.447+0000 7f2b8d2f2640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2b8815f910 0x7f2b88140e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:51:11.450 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:11.447+0000 7f2b8d2f2640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f2b880b4160 con 0x7f2b88152920 2024-09-17T05:51:11.450 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:11.447+0000 7f2b8d2f2640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f2b880b3fe0 con 0x7f2b880aebc0 2024-09-17T05:51:11.450 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:11.447+0000 7f2b8d2f2640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f2b880b42e0 con 0x7f2b8815f910 2024-09-17T05:51:11.450 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:11.447+0000 7f2b7e7fc640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2b88152920 0x7f2b881f3460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:51:11.450 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:11.447+0000 7f2b7e7fc640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2b88152920 0x7f2b881f3460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:50136/0 (socket says 172.21.15.150:50136) 2024-09-17T05:51:11.450 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:11.447+0000 7f2b7e7fc640 1 -- 172.21.15.150:0/1089687155 learned_addr learned my addr 172.21.15.150:0/1089687155 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:51:11.450 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:11.447+0000 7f2b86ffd640 1 --2- 172.21.15.150:0/1089687155 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2b880aebc0 0x7f2b880ceb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:51:11.450 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:11.447+0000 7f2b877fe640 1 --2- 172.21.15.150:0/1089687155 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2b8815f910 0x7f2b88140e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:51:11.450 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:11.448+0000 7f2b7e7fc640 1 -- 172.21.15.150:0/1089687155 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2b8815f910 msgr2=0x7f2b88140e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:51:11.451 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:11.448+0000 7f2b7e7fc640 1 --2- 172.21.15.150:0/1089687155 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2b8815f910 0x7f2b88140e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:51:11.451 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:11.448+0000 7f2b7e7fc640 1 -- 172.21.15.150:0/1089687155 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2b880aebc0 msgr2=0x7f2b880ceb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:51:11.451 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:11.448+0000 7f2b7e7fc640 1 --2- 172.21.15.150:0/1089687155 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2b880aebc0 0x7f2b880ceb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:51:11.451 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:11.448+0000 7f2b7e7fc640 1 -- 172.21.15.150:0/1089687155 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2b881f39a0 con 0x7f2b88152920 2024-09-17T05:51:11.451 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:11.448+0000 7f2b877fe640 1 --2- 172.21.15.150:0/1089687155 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2b8815f910 0x7f2b88140e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:51:11.451 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:11.448+0000 7f2b7e7fc640 1 --2- 172.21.15.150:0/1089687155 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2b88152920 0x7f2b881f3460 secure :-1 s=READY pgs=1467 cs=0 l=1 rev1=1 crypto rx=0x7f2b7000c970 tx=0x7f2b7000ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:51:11.451 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:11.448+0000 7f2b7ffff640 1 -- 172.21.15.150:0/1089687155 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b70007b50 con 0x7f2b88152920 2024-09-17T05:51:11.451 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:11.448+0000 7f2b7ffff640 1 -- 172.21.15.150:0/1089687155 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f2b70007de0 con 0x7f2b88152920 2024-09-17T05:51:11.451 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:11.448+0000 7f2b8d2f2640 1 -- 172.21.15.150:0/1089687155 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2b881f3eb0 con 0x7f2b88152920 2024-09-17T05:51:11.451 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:11.448+0000 7f2b7ffff640 1 -- 172.21.15.150:0/1089687155 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b70005280 con 0x7f2b88152920 2024-09-17T05:51:11.451 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:11.448+0000 7f2b8d2f2640 1 -- 172.21.15.150:0/1089687155 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2b88140670 con 0x7f2b88152920 2024-09-17T05:51:11.451 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:11.449+0000 7f2b8d2f2640 1 -- 172.21.15.150:0/1089687155 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2b880b4870 con 0x7f2b88152920 2024-09-17T05:51:11.452 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:11.450+0000 7f2b7ffff640 1 -- 172.21.15.150:0/1089687155 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 37) ==== 103787+0+0 (secure 0 0 0) 0x7f2b70005420 con 0x7f2b88152920 2024-09-17T05:51:11.453 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:11.450+0000 7f2b7ffff640 1 --2- 172.21.15.150:0/1089687155 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f2b6807a5a0 0x7f2b6807cab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:51:11.457 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:11.450+0000 7f2b7ffff640 1 -- 172.21.15.150:0/1089687155 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(109..109 src has 1..109) ==== 4997+0+0 (secure 0 0 0) 0x7f2b70099e80 con 0x7f2b88152920 2024-09-17T05:51:11.457 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:11.450+0000 7f2b86ffd640 1 --2- 172.21.15.150:0/1089687155 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f2b6807a5a0 0x7f2b6807cab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:51:11.457 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:11.451+0000 7f2b86ffd640 1 --2- 172.21.15.150:0/1089687155 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f2b6807a5a0 0x7f2b6807cab0 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7f2b78001720 tx=0x7f2b78007e90 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:51:11.457 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:11.455+0000 7f2b7ffff640 1 -- 172.21.15.150:0/1089687155 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f2b70014030 con 0x7f2b88152920 2024-09-17T05:51:11.697 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:11.697+0000 7f2b8d2f2640 1 -- 172.21.15.150:0/1089687155 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) -- 0x7f2b880d10d0 con 0x7f2b88152920 2024-09-17T05:51:11.698 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:11.697+0000 7f2b7ffff640 1 -- 172.21.15.150:0/1089687155 <== mon.0 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v17) ==== 80+0+5304 (secure 0 0 0) 0x7f2b700638c0 con 0x7f2b88152920 2024-09-17T05:51:11.698 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-09-17T05:51:11.698 INFO:teuthology.orchestra.run.smithi150.stdout:{ 2024-09-17T05:51:11.698 INFO:teuthology.orchestra.run.smithi150.stdout: "auth_dump": [ 2024-09-17T05:51:11.698 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-09-17T05:51:11.698 INFO:teuthology.orchestra.run.smithi150.stdout: "entity": "mds.a", 2024-09-17T05:51:11.698 INFO:teuthology.orchestra.run.smithi150.stdout: "key": "AQBoFulmMHALAxAAEO+QBgzbd+BNfhyY2qPiqw==", 2024-09-17T05:51:11.699 INFO:teuthology.orchestra.run.smithi150.stdout: "caps": { 2024-09-17T05:51:11.699 INFO:teuthology.orchestra.run.smithi150.stdout: "mds": "allow", 2024-09-17T05:51:11.699 INFO:teuthology.orchestra.run.smithi150.stdout: "mgr": "allow *", 2024-09-17T05:51:11.699 INFO:teuthology.orchestra.run.smithi150.stdout: "mon": "allow *", 2024-09-17T05:51:11.699 INFO:teuthology.orchestra.run.smithi150.stdout: "osd": "allow *" 2024-09-17T05:51:11.699 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-09-17T05:51:11.699 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-17T05:51:11.699 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-09-17T05:51:11.699 INFO:teuthology.orchestra.run.smithi150.stdout: "entity": "mds.b", 2024-09-17T05:51:11.699 INFO:teuthology.orchestra.run.smithi150.stdout: "key": "AQBoFulmtutmEBAAhKJEJQm181pL1lPmSSdYRQ==", 2024-09-17T05:51:11.699 INFO:teuthology.orchestra.run.smithi150.stdout: "caps": { 2024-09-17T05:51:11.699 INFO:teuthology.orchestra.run.smithi150.stdout: "mds": "allow", 2024-09-17T05:51:11.699 INFO:teuthology.orchestra.run.smithi150.stdout: "mgr": "allow *", 2024-09-17T05:51:11.700 INFO:teuthology.orchestra.run.smithi150.stdout: "mon": "allow *", 2024-09-17T05:51:11.700 INFO:teuthology.orchestra.run.smithi150.stdout: "osd": "allow *" 2024-09-17T05:51:11.700 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-09-17T05:51:11.700 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-17T05:51:11.700 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-09-17T05:51:11.700 INFO:teuthology.orchestra.run.smithi150.stdout: "entity": "mds.c", 2024-09-17T05:51:11.700 INFO:teuthology.orchestra.run.smithi150.stdout: "key": "AQBoFulmHTKsChAA4/fUb2NC+fMhR+xIYIDjgQ==", 2024-09-17T05:51:11.700 INFO:teuthology.orchestra.run.smithi150.stdout: "caps": { 2024-09-17T05:51:11.700 INFO:teuthology.orchestra.run.smithi150.stdout: "mds": "allow", 2024-09-17T05:51:11.700 INFO:teuthology.orchestra.run.smithi150.stdout: "mgr": "allow *", 2024-09-17T05:51:11.701 INFO:teuthology.orchestra.run.smithi150.stdout: "mon": "allow *", 2024-09-17T05:51:11.701 INFO:teuthology.orchestra.run.smithi150.stdout: "osd": "allow *" 2024-09-17T05:51:11.701 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-09-17T05:51:11.701 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-17T05:51:11.701 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-09-17T05:51:11.701 INFO:teuthology.orchestra.run.smithi150.stdout: "entity": "mds.d", 2024-09-17T05:51:11.701 INFO:teuthology.orchestra.run.smithi150.stdout: "key": "AQBoFulmr2s3GBAAhXzLVtObF/LwTpDIrY8MIQ==", 2024-09-17T05:51:11.701 INFO:teuthology.orchestra.run.smithi150.stdout: "caps": { 2024-09-17T05:51:11.701 INFO:teuthology.orchestra.run.smithi150.stdout: "mds": "allow", 2024-09-17T05:51:11.701 INFO:teuthology.orchestra.run.smithi150.stdout: "mgr": "allow *", 2024-09-17T05:51:11.701 INFO:teuthology.orchestra.run.smithi150.stdout: "mon": "allow *", 2024-09-17T05:51:11.701 INFO:teuthology.orchestra.run.smithi150.stdout: "osd": "allow *" 2024-09-17T05:51:11.701 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-09-17T05:51:11.702 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-17T05:51:11.702 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-09-17T05:51:11.702 INFO:teuthology.orchestra.run.smithi150.stdout: "entity": "osd.0", 2024-09-17T05:51:11.702 INFO:teuthology.orchestra.run.smithi150.stdout: "key": "AQBrFulm9eU0NRAAqgc1CtMOz+jDCHBn8coaVw==", 2024-09-17T05:51:11.702 INFO:teuthology.orchestra.run.smithi150.stdout: "caps": { 2024-09-17T05:51:11.702 INFO:teuthology.orchestra.run.smithi150.stdout: "mgr": "allow profile osd", 2024-09-17T05:51:11.702 INFO:teuthology.orchestra.run.smithi150.stdout: "mon": "allow profile osd", 2024-09-17T05:51:11.702 INFO:teuthology.orchestra.run.smithi150.stdout: "osd": "allow *" 2024-09-17T05:51:11.702 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-09-17T05:51:11.702 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-17T05:51:11.702 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-09-17T05:51:11.702 INFO:teuthology.orchestra.run.smithi150.stdout: "entity": "osd.1", 2024-09-17T05:51:11.703 INFO:teuthology.orchestra.run.smithi150.stdout: "key": "AQBvFulmlFL6CxAA8ByBraZue2FLfyZeOIpj3A==", 2024-09-17T05:51:11.703 INFO:teuthology.orchestra.run.smithi150.stdout: "caps": { 2024-09-17T05:51:11.703 INFO:teuthology.orchestra.run.smithi150.stdout: "mgr": "allow profile osd", 2024-09-17T05:51:11.703 INFO:teuthology.orchestra.run.smithi150.stdout: "mon": "allow profile osd", 2024-09-17T05:51:11.703 INFO:teuthology.orchestra.run.smithi150.stdout: "osd": "allow *" 2024-09-17T05:51:11.703 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-09-17T05:51:11.703 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-17T05:51:11.703 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-09-17T05:51:11.703 INFO:teuthology.orchestra.run.smithi150.stdout: "entity": "osd.2", 2024-09-17T05:51:11.703 INFO:teuthology.orchestra.run.smithi150.stdout: "key": "AQByFulmMQF5LBAAB4rbdIL6Zd+l4I4LDC/r3Q==", 2024-09-17T05:51:11.703 INFO:teuthology.orchestra.run.smithi150.stdout: "caps": { 2024-09-17T05:51:11.703 INFO:teuthology.orchestra.run.smithi150.stdout: "mgr": "allow profile osd", 2024-09-17T05:51:11.704 INFO:teuthology.orchestra.run.smithi150.stdout: "mon": "allow profile osd", 2024-09-17T05:51:11.704 INFO:teuthology.orchestra.run.smithi150.stdout: "osd": "allow *" 2024-09-17T05:51:11.704 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-09-17T05:51:11.704 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-17T05:51:11.704 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-09-17T05:51:11.704 INFO:teuthology.orchestra.run.smithi150.stdout: "entity": "osd.3", 2024-09-17T05:51:11.704 INFO:teuthology.orchestra.run.smithi150.stdout: "key": "AQB2Fulm5fjaAhAASnkpgsW79Sr9IIiy4HMm4g==", 2024-09-17T05:51:11.704 INFO:teuthology.orchestra.run.smithi150.stdout: "caps": { 2024-09-17T05:51:11.704 INFO:teuthology.orchestra.run.smithi150.stdout: "mgr": "allow profile osd", 2024-09-17T05:51:11.704 INFO:teuthology.orchestra.run.smithi150.stdout: "mon": "allow profile osd", 2024-09-17T05:51:11.705 INFO:teuthology.orchestra.run.smithi150.stdout: "osd": "allow *" 2024-09-17T05:51:11.705 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-09-17T05:51:11.705 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-17T05:51:11.705 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-09-17T05:51:11.705 INFO:teuthology.orchestra.run.smithi150.stdout: "entity": "osd.4", 2024-09-17T05:51:11.705 INFO:teuthology.orchestra.run.smithi150.stdout: "key": "AQB8Fulm9fWPGhAA9nNf+0znlS0Z7rqOvC47xQ==", 2024-09-17T05:51:11.705 INFO:teuthology.orchestra.run.smithi150.stdout: "caps": { 2024-09-17T05:51:11.705 INFO:teuthology.orchestra.run.smithi150.stdout: "mgr": "allow profile osd", 2024-09-17T05:51:11.705 INFO:teuthology.orchestra.run.smithi150.stdout: "mon": "allow profile osd", 2024-09-17T05:51:11.705 INFO:teuthology.orchestra.run.smithi150.stdout: "osd": "allow *" 2024-09-17T05:51:11.705 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-09-17T05:51:11.706 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-17T05:51:11.706 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-09-17T05:51:11.706 INFO:teuthology.orchestra.run.smithi150.stdout: "entity": "osd.5", 2024-09-17T05:51:11.706 INFO:teuthology.orchestra.run.smithi150.stdout: "key": "AQB/FulmeHakHRAASlnmKa0UTqVX+NSbmiHEBw==", 2024-09-17T05:51:11.706 INFO:teuthology.orchestra.run.smithi150.stdout: "caps": { 2024-09-17T05:51:11.706 INFO:teuthology.orchestra.run.smithi150.stdout: "mgr": "allow profile osd", 2024-09-17T05:51:11.706 INFO:teuthology.orchestra.run.smithi150.stdout: "mon": "allow profile osd", 2024-09-17T05:51:11.706 INFO:teuthology.orchestra.run.smithi150.stdout: "osd": "allow *" 2024-09-17T05:51:11.706 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-09-17T05:51:11.706 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-17T05:51:11.706 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-09-17T05:51:11.706 INFO:teuthology.orchestra.run.smithi150.stdout: "entity": "osd.6", 2024-09-17T05:51:11.707 INFO:teuthology.orchestra.run.smithi150.stdout: "key": "AQCCFulmEZF3IBAAhtpCanI6m8Kb3hyi+sRyyQ==", 2024-09-17T05:51:11.707 INFO:teuthology.orchestra.run.smithi150.stdout: "caps": { 2024-09-17T05:51:11.707 INFO:teuthology.orchestra.run.smithi150.stdout: "mgr": "allow profile osd", 2024-09-17T05:51:11.707 INFO:teuthology.orchestra.run.smithi150.stdout: "mon": "allow profile osd", 2024-09-17T05:51:11.707 INFO:teuthology.orchestra.run.smithi150.stdout: "osd": "allow *" 2024-09-17T05:51:11.707 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-09-17T05:51:11.707 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-17T05:51:11.707 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-09-17T05:51:11.707 INFO:teuthology.orchestra.run.smithi150.stdout: "entity": "osd.7", 2024-09-17T05:51:11.707 INFO:teuthology.orchestra.run.smithi150.stdout: "key": "AQCGFulmdcs7BRAAxsctes949cbkGkivdGpoYw==", 2024-09-17T05:51:11.707 INFO:teuthology.orchestra.run.smithi150.stdout: "caps": { 2024-09-17T05:51:11.707 INFO:teuthology.orchestra.run.smithi150.stdout: "mgr": "allow profile osd", 2024-09-17T05:51:11.707 INFO:teuthology.orchestra.run.smithi150.stdout: "mon": "allow profile osd", 2024-09-17T05:51:11.707 INFO:teuthology.orchestra.run.smithi150.stdout: "osd": "allow *" 2024-09-17T05:51:11.708 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-09-17T05:51:11.708 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-17T05:51:11.708 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-09-17T05:51:11.708 INFO:teuthology.orchestra.run.smithi150.stdout: "entity": "client.0", 2024-09-17T05:51:11.708 INFO:teuthology.orchestra.run.smithi150.stdout: "key": "AQBoFulmfF/1HBAAMezEjZDeoHTJ+uFfDXNWHQ==", 2024-09-17T05:51:11.708 INFO:teuthology.orchestra.run.smithi150.stdout: "caps": { 2024-09-17T05:51:11.708 INFO:teuthology.orchestra.run.smithi150.stdout: "mds": "allow", 2024-09-17T05:51:11.708 INFO:teuthology.orchestra.run.smithi150.stdout: "mon": "allow r", 2024-09-17T05:51:11.708 INFO:teuthology.orchestra.run.smithi150.stdout: "osd": "allow rw tag cephfs data=cephfs" 2024-09-17T05:51:11.709 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-09-17T05:51:11.709 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-17T05:51:11.709 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-09-17T05:51:11.709 INFO:teuthology.orchestra.run.smithi150.stdout: "entity": "client.1", 2024-09-17T05:51:11.709 INFO:teuthology.orchestra.run.smithi150.stdout: "key": "AQBoFulmv3GQJBAANlgjLqiCwzNfmBh8uClJ9A==", 2024-09-17T05:51:11.709 INFO:teuthology.orchestra.run.smithi150.stdout: "caps": { 2024-09-17T05:51:11.709 INFO:teuthology.orchestra.run.smithi150.stdout: "mds": "allow", 2024-09-17T05:51:11.709 INFO:teuthology.orchestra.run.smithi150.stdout: "mgr": "allow r", 2024-09-17T05:51:11.709 INFO:teuthology.orchestra.run.smithi150.stdout: "mon": "allow rw", 2024-09-17T05:51:11.709 INFO:teuthology.orchestra.run.smithi150.stdout: "osd": "allow rwx" 2024-09-17T05:51:11.709 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-09-17T05:51:11.709 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-17T05:51:11.709 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-09-17T05:51:11.710 INFO:teuthology.orchestra.run.smithi150.stdout: "entity": "client.2", 2024-09-17T05:51:11.710 INFO:teuthology.orchestra.run.smithi150.stdout: "key": "AQBoFulm1O/BIBAA8kfQL3/13SmZO1+y2tOZvw==", 2024-09-17T05:51:11.710 INFO:teuthology.orchestra.run.smithi150.stdout: "caps": { 2024-09-17T05:51:11.710 INFO:teuthology.orchestra.run.smithi150.stdout: "mds": "allow", 2024-09-17T05:51:11.710 INFO:teuthology.orchestra.run.smithi150.stdout: "mgr": "allow r", 2024-09-17T05:51:11.710 INFO:teuthology.orchestra.run.smithi150.stdout: "mon": "allow rw", 2024-09-17T05:51:11.710 INFO:teuthology.orchestra.run.smithi150.stdout: "osd": "allow rwx" 2024-09-17T05:51:11.710 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-09-17T05:51:11.710 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-17T05:51:11.710 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-09-17T05:51:11.710 INFO:teuthology.orchestra.run.smithi150.stdout: "entity": "client.3", 2024-09-17T05:51:11.710 INFO:teuthology.orchestra.run.smithi150.stdout: "key": "AQBoFulmF4hVKBAAZ5FGapBLLLtez3t8kON9dg==", 2024-09-17T05:51:11.710 INFO:teuthology.orchestra.run.smithi150.stdout: "caps": { 2024-09-17T05:51:11.710 INFO:teuthology.orchestra.run.smithi150.stdout: "mds": "allow", 2024-09-17T05:51:11.710 INFO:teuthology.orchestra.run.smithi150.stdout: "mgr": "allow r", 2024-09-17T05:51:11.711 INFO:teuthology.orchestra.run.smithi150.stdout: "mon": "allow rw", 2024-09-17T05:51:11.711 INFO:teuthology.orchestra.run.smithi150.stdout: "osd": "allow rwx" 2024-09-17T05:51:11.711 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-09-17T05:51:11.711 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-17T05:51:11.711 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-09-17T05:51:11.711 INFO:teuthology.orchestra.run.smithi150.stdout: "entity": "client.admin", 2024-09-17T05:51:11.711 INFO:teuthology.orchestra.run.smithi150.stdout: "key": "AQBnFulmaU9+IBAA7ZmXWZ44s0IpQ+C+Zw2V1g==", 2024-09-17T05:51:11.711 INFO:teuthology.orchestra.run.smithi150.stdout: "caps": { 2024-09-17T05:51:11.711 INFO:teuthology.orchestra.run.smithi150.stdout: "mds": "allow *", 2024-09-17T05:51:11.711 INFO:teuthology.orchestra.run.smithi150.stdout: "mgr": "allow *", 2024-09-17T05:51:11.711 INFO:teuthology.orchestra.run.smithi150.stdout: "mon": "allow *", 2024-09-17T05:51:11.711 INFO:teuthology.orchestra.run.smithi150.stdout: "osd": "allow *" 2024-09-17T05:51:11.711 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-09-17T05:51:11.712 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-17T05:51:11.712 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-09-17T05:51:11.712 INFO:teuthology.orchestra.run.smithi150.stdout: "entity": "mgr.x", 2024-09-17T05:51:11.712 INFO:teuthology.orchestra.run.smithi150.stdout: "key": "AQBnFulmEjvROhAAn3GZxCEtqPYLWopR1AcSFA==", 2024-09-17T05:51:11.712 INFO:teuthology.orchestra.run.smithi150.stdout: "caps": { 2024-09-17T05:51:11.712 INFO:teuthology.orchestra.run.smithi150.stdout: "mds": "allow *", 2024-09-17T05:51:11.712 INFO:teuthology.orchestra.run.smithi150.stdout: "mon": "allow profile mgr", 2024-09-17T05:51:11.712 INFO:teuthology.orchestra.run.smithi150.stdout: "osd": "allow *" 2024-09-17T05:51:11.712 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-09-17T05:51:11.712 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-17T05:51:11.712 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-09-17T05:51:11.712 INFO:teuthology.orchestra.run.smithi150.stdout: "entity": "mgr.y", 2024-09-17T05:51:11.712 INFO:teuthology.orchestra.run.smithi150.stdout: "key": "AQBnFulm9IkENhAA4uf1vzhYOepmovspN5/v1w==", 2024-09-17T05:51:11.713 INFO:teuthology.orchestra.run.smithi150.stdout: "caps": { 2024-09-17T05:51:11.713 INFO:teuthology.orchestra.run.smithi150.stdout: "mds": "allow *", 2024-09-17T05:51:11.713 INFO:teuthology.orchestra.run.smithi150.stdout: "mon": "allow profile mgr", 2024-09-17T05:51:11.713 INFO:teuthology.orchestra.run.smithi150.stdout: "osd": "allow *" 2024-09-17T05:51:11.713 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-09-17T05:51:11.713 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-09-17T05:51:11.713 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2024-09-17T05:51:11.713 INFO:teuthology.orchestra.run.smithi150.stdout:} 2024-09-17T05:51:11.715 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:11.699+0000 7f2b8d2f2640 1 -- 172.21.15.150:0/1089687155 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f2b6807a5a0 msgr2=0x7f2b6807cab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:51:11.715 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:11.699+0000 7f2b8d2f2640 1 --2- 172.21.15.150:0/1089687155 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f2b6807a5a0 0x7f2b6807cab0 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7f2b78001720 tx=0x7f2b78007e90 comp rx=0 tx=0).stop 2024-09-17T05:51:11.715 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:11.699+0000 7f2b8d2f2640 1 -- 172.21.15.150:0/1089687155 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2b88152920 msgr2=0x7f2b881f3460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:51:11.715 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:11.699+0000 7f2b8d2f2640 1 --2- 172.21.15.150:0/1089687155 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2b88152920 0x7f2b881f3460 secure :-1 s=READY pgs=1467 cs=0 l=1 rev1=1 crypto rx=0x7f2b7000c970 tx=0x7f2b7000ce30 comp rx=0 tx=0).stop 2024-09-17T05:51:11.715 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:11.699+0000 7f2b8d2f2640 1 -- 172.21.15.150:0/1089687155 shutdown_connections 2024-09-17T05:51:11.715 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:11.699+0000 7f2b8d2f2640 1 --2- 172.21.15.150:0/1089687155 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f2b6807a5a0 0x7f2b6807cab0 unknown :-1 s=CLOSED pgs=625 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:51:11.715 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:11.699+0000 7f2b8d2f2640 1 --2- 172.21.15.150:0/1089687155 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2b8815f910 0x7f2b88140e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:51:11.715 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:11.699+0000 7f2b8d2f2640 1 --2- 172.21.15.150:0/1089687155 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2b88152920 0x7f2b881f3460 unknown :-1 s=CLOSED pgs=1467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:51:11.715 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:11.699+0000 7f2b8d2f2640 1 --2- 172.21.15.150:0/1089687155 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2b880aebc0 0x7f2b880ceb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:51:11.715 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:11.699+0000 7f2b8d2f2640 1 -- 172.21.15.150:0/1089687155 >> 172.21.15.150:0/1089687155 conn(0x7f2b8806d730 msgr2=0x7f2b88159b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:51:11.715 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:11.699+0000 7f2b8d2f2640 1 -- 172.21.15.150:0/1089687155 shutdown_connections 2024-09-17T05:51:11.716 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:11.699+0000 7f2b8d2f2640 1 -- 172.21.15.150:0/1089687155 wait complete. 2024-09-17T05:51:11.716 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-09-17T05:51:11.829 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:11.828+0000 7f447108b640 1 -- 172.21.15.150:0/2810680431 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4458003ff0 msgr2=0x7f4458004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:51:11.830 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:11.828+0000 7f447108b640 1 --2- 172.21.15.150:0/2810680431 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4458003ff0 0x7f4458004800 secure :-1 s=READY pgs=1469 cs=0 l=1 rev1=1 crypto rx=0x7f4454009b50 tx=0x7f4458005830 comp rx=0 tx=0).stop 2024-09-17T05:51:11.830 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:11.828+0000 7f446b59e640 1 -- 172.21.15.150:0/2810680431 reap_dead start 2024-09-17T05:51:11.830 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:11.828+0000 7f447108b640 1 -- 172.21.15.150:0/2810680431 shutdown_connections 2024-09-17T05:51:11.830 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:11.828+0000 7f447108b640 1 -- 172.21.15.150:0/2810680431 >> 172.21.15.150:0/2810680431 conn(0x7f446c0d0b50 msgr2=0x7f446c0d0f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:51:11.830 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:11.828+0000 7f447108b640 1 -- 172.21.15.150:0/2810680431 shutdown_connections 2024-09-17T05:51:11.830 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:11.828+0000 7f447108b640 1 -- 172.21.15.150:0/2810680431 wait complete. 2024-09-17T05:51:11.831 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:11.830+0000 7f447108b640 1 Processor -- start 2024-09-17T05:51:11.831 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:11.830+0000 7f447108b640 1 -- start start 2024-09-17T05:51:11.834 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:11.832+0000 7f447108b640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4458003ff0 0x7f446c154a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:51:11.834 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:11.832+0000 7f447108b640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f446c154f80 0x7f446c1f5af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:51:11.834 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:11.832+0000 7f447108b640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f446c1f6030 0x7f446c158d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:51:11.834 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:11.832+0000 7f447108b640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f446c0715c0 con 0x7f446c1f6030 2024-09-17T05:51:11.834 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:11.832+0000 7f447108b640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f446c15f9d0 con 0x7f446c154f80 2024-09-17T05:51:11.835 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:11.832+0000 7f447108b640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f446c071740 con 0x7f4458003ff0 2024-09-17T05:51:11.835 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:11.832+0000 7f446b59e640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f446c1f6030 0x7f446c158d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:51:11.835 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:11.832+0000 7f446b59e640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f446c1f6030 0x7f446c158d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:50154/0 (socket says 172.21.15.150:50154) 2024-09-17T05:51:11.835 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:11.832+0000 7f446b59e640 1 -- 172.21.15.150:0/160106396 learned_addr learned my addr 172.21.15.150:0/160106396 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:51:11.835 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:11.832+0000 7f446b59e640 1 -- 172.21.15.150:0/160106396 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4458003ff0 msgr2=0x7f446c154a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:51:11.835 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:11.832+0000 7f446b59e640 1 --2- 172.21.15.150:0/160106396 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4458003ff0 0x7f446c154a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:51:11.835 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:11.832+0000 7f446b59e640 1 -- 172.21.15.150:0/160106396 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f446c154f80 msgr2=0x7f446c1f5af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:51:11.835 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:11.832+0000 7f446259c640 1 --2- 172.21.15.150:0/160106396 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f446c154f80 0x7f446c1f5af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:51:11.835 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:11.832+0000 7f446b59e640 1 --2- 172.21.15.150:0/160106396 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f446c154f80 0x7f446c1f5af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:51:11.835 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:11.832+0000 7f446b59e640 1 -- 172.21.15.150:0/160106396 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f446c1f2550 con 0x7f446c1f6030 2024-09-17T05:51:11.835 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:11.832+0000 7f446b59e640 1 --2- 172.21.15.150:0/160106396 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f446c1f6030 0x7f446c158d90 secure :-1 s=READY pgs=1470 cs=0 l=1 rev1=1 crypto rx=0x7f44640020a0 tx=0x7f446400ed10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:51:11.836 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:11.832+0000 7f4463fff640 1 -- 172.21.15.150:0/160106396 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f446400c9a0 con 0x7f446c1f6030 2024-09-17T05:51:11.836 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:11.833+0000 7f4463fff640 1 -- 172.21.15.150:0/160106396 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f4464018070 con 0x7f446c1f6030 2024-09-17T05:51:11.836 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:11.833+0000 7f4463fff640 1 -- 172.21.15.150:0/160106396 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4464011460 con 0x7f446c1f6030 2024-09-17T05:51:11.836 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:11.833+0000 7f447108b640 1 -- 172.21.15.150:0/160106396 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f446c1f2830 con 0x7f446c1f6030 2024-09-17T05:51:11.836 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:11.833+0000 7f447108b640 1 -- 172.21.15.150:0/160106396 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f446c14fce0 con 0x7f446c1f6030 2024-09-17T05:51:11.836 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:11.834+0000 7f447108b640 1 -- 172.21.15.150:0/160106396 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f446c1f65d0 con 0x7f446c1f6030 2024-09-17T05:51:11.837 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:11.834+0000 7f4463fff640 1 -- 172.21.15.150:0/160106396 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 37) ==== 103787+0+0 (secure 0 0 0) 0x7f4464011600 con 0x7f446c1f6030 2024-09-17T05:51:11.837 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:11.835+0000 7f4463fff640 1 --2- 172.21.15.150:0/160106396 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f444c07a570 0x7f444c07ca80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:51:11.837 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:11.835+0000 7f4463fff640 1 -- 172.21.15.150:0/160106396 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(109..109 src has 1..109) ==== 4997+0+0 (secure 0 0 0) 0x7f4464099f70 con 0x7f446c1f6030 2024-09-17T05:51:11.837 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:11.835+0000 7f446ad9d640 1 --2- 172.21.15.150:0/160106396 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f444c07a570 0x7f444c07ca80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:51:11.838 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:11.836+0000 7f446ad9d640 1 --2- 172.21.15.150:0/160106396 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f444c07a570 0x7f444c07ca80 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7f445c0058c0 tx=0x7f445c005850 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:51:11.840 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:11.840+0000 7f4463fff640 1 -- 172.21.15.150:0/160106396 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f4464063ec0 con 0x7f446c1f6030 2024-09-17T05:51:12.018 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:12.016+0000 7f447108b640 1 -- 172.21.15.150:0/160106396 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7f446c1528b0 con 0x7f446c1f6030 2024-09-17T05:51:12.018 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:12.017+0000 7f4463fff640 1 -- 172.21.15.150:0/160106396 <== mon.0 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v109) ==== 84+0+65 (secure 0 0 0) 0x7f44640637c0 con 0x7f446c1f6030 2024-09-17T05:51:12.018 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-09-17T05:51:12.019 INFO:teuthology.orchestra.run.smithi150.stdout:[ 2024-09-17T05:51:12.019 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-09-17T05:51:12.019 INFO:teuthology.orchestra.run.smithi150.stdout: "poolnum": 1, 2024-09-17T05:51:12.019 INFO:teuthology.orchestra.run.smithi150.stdout: "poolname": ".mgr" 2024-09-17T05:51:12.019 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-09-17T05:51:12.020 INFO:teuthology.orchestra.run.smithi150.stdout:] 2024-09-17T05:51:12.022 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:12.019+0000 7f447108b640 1 -- 172.21.15.150:0/160106396 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f444c07a570 msgr2=0x7f444c07ca80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:51:12.022 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:12.019+0000 7f447108b640 1 --2- 172.21.15.150:0/160106396 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f444c07a570 0x7f444c07ca80 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7f445c0058c0 tx=0x7f445c005850 comp rx=0 tx=0).stop 2024-09-17T05:51:12.022 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:12.019+0000 7f447108b640 1 -- 172.21.15.150:0/160106396 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f446c1f6030 msgr2=0x7f446c158d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:51:12.023 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:12.019+0000 7f447108b640 1 --2- 172.21.15.150:0/160106396 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f446c1f6030 0x7f446c158d90 secure :-1 s=READY pgs=1470 cs=0 l=1 rev1=1 crypto rx=0x7f44640020a0 tx=0x7f446400ed10 comp rx=0 tx=0).stop 2024-09-17T05:51:12.023 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:12.019+0000 7f447108b640 1 -- 172.21.15.150:0/160106396 shutdown_connections 2024-09-17T05:51:12.023 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:12.019+0000 7f447108b640 1 --2- 172.21.15.150:0/160106396 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f446c154f80 0x7f446c1f5af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:51:12.023 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:12.019+0000 7f447108b640 1 --2- 172.21.15.150:0/160106396 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f444c07a570 0x7f444c07ca80 unknown :-1 s=CLOSED pgs=626 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:51:12.023 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:12.019+0000 7f447108b640 1 --2- 172.21.15.150:0/160106396 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f446c1f6030 0x7f446c158d90 unknown :-1 s=CLOSED pgs=1470 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:51:12.023 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:12.019+0000 7f447108b640 1 --2- 172.21.15.150:0/160106396 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4458003ff0 0x7f446c154a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:51:12.024 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:12.019+0000 7f447108b640 1 -- 172.21.15.150:0/160106396 >> 172.21.15.150:0/160106396 conn(0x7f446c0d0b50 msgr2=0x7f446c0b0810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:51:12.024 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:12.019+0000 7f447108b640 1 -- 172.21.15.150:0/160106396 shutdown_connections 2024-09-17T05:51:12.024 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:12.019+0000 7f447108b640 1 -- 172.21.15.150:0/160106396 wait complete. 2024-09-17T05:51:12.032 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-09-17T05:51:12.032 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-09-17T05:51:12.151 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:12.149+0000 7fbd323c3640 1 -- 172.21.15.150:0/1084424482 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbd14004d40 msgr2=0x7fbd14005150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:51:12.151 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:12.149+0000 7fbd323c3640 1 --2- 172.21.15.150:0/1084424482 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbd14004d40 0x7fbd14005150 secure :-1 s=READY pgs=1472 cs=0 l=1 rev1=1 crypto rx=0x7fbd24005fd0 tx=0x7fbd14005830 comp rx=0 tx=0).stop 2024-09-17T05:51:12.151 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:12.150+0000 7fbd30960640 1 -- 172.21.15.150:0/1084424482 reap_dead start 2024-09-17T05:51:12.151 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:12.150+0000 7fbd323c3640 1 -- 172.21.15.150:0/1084424482 shutdown_connections 2024-09-17T05:51:12.151 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:12.150+0000 7fbd323c3640 1 -- 172.21.15.150:0/1084424482 >> 172.21.15.150:0/1084424482 conn(0x7fbd2c09aa50 msgr2=0x7fbd2c0b2ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:51:12.151 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:12.150+0000 7fbd323c3640 1 -- 172.21.15.150:0/1084424482 shutdown_connections 2024-09-17T05:51:12.151 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:12.150+0000 7fbd323c3640 1 -- 172.21.15.150:0/1084424482 wait complete. 2024-09-17T05:51:12.152 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:12.151+0000 7fbd323c3640 1 Processor -- start 2024-09-17T05:51:12.152 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:12.152+0000 7fbd323c3640 1 -- start start 2024-09-17T05:51:12.155 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:12.153+0000 7fbd323c3640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fbd14004d40 0x7fbd2c150e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:51:12.155 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:12.153+0000 7fbd323c3640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fbd2c15f3f0 0x7fbd2c1546f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:51:12.155 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:12.153+0000 7fbd323c3640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbd2c0b12a0 0x7fbd2c0b16b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:51:12.156 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:12.153+0000 7fbd323c3640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7fbd2c0b42f0 con 0x7fbd2c0b12a0 2024-09-17T05:51:12.156 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:12.153+0000 7fbd323c3640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fbd2c0b4470 con 0x7fbd2c15f3f0 2024-09-17T05:51:12.156 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:12.153+0000 7fbd323c3640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fbd2c0b45f0 con 0x7fbd14004d40 2024-09-17T05:51:12.156 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:12.153+0000 7fbd30960640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbd2c0b12a0 0x7fbd2c0b16b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:51:12.156 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:12.153+0000 7fbd30960640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbd2c0b12a0 0x7fbd2c0b16b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:50176/0 (socket says 172.21.15.150:50176) 2024-09-17T05:51:12.156 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:12.153+0000 7fbd30960640 1 -- 172.21.15.150:0/2988713460 learned_addr learned my addr 172.21.15.150:0/2988713460 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:51:12.156 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:12.153+0000 7fbd2b7fe640 1 --2- 172.21.15.150:0/2988713460 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fbd2c15f3f0 0x7fbd2c1546f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:51:12.156 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:12.153+0000 7fbd2bfff640 1 --2- 172.21.15.150:0/2988713460 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fbd14004d40 0x7fbd2c150e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:51:12.156 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:12.153+0000 7fbd30960640 1 -- 172.21.15.150:0/2988713460 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fbd14004d40 msgr2=0x7fbd2c150e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:51:12.156 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:12.153+0000 7fbd30960640 1 --2- 172.21.15.150:0/2988713460 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fbd14004d40 0x7fbd2c150e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:51:12.156 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:12.153+0000 7fbd30960640 1 -- 172.21.15.150:0/2988713460 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fbd2c15f3f0 msgr2=0x7fbd2c1546f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:51:12.157 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:12.153+0000 7fbd30960640 1 --2- 172.21.15.150:0/2988713460 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fbd2c15f3f0 0x7fbd2c1546f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:51:12.157 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:12.153+0000 7fbd30960640 1 -- 172.21.15.150:0/2988713460 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbd2c0b1bf0 con 0x7fbd2c0b12a0 2024-09-17T05:51:12.157 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:12.154+0000 7fbd30960640 1 --2- 172.21.15.150:0/2988713460 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbd2c0b12a0 0x7fbd2c0b16b0 secure :-1 s=READY pgs=1473 cs=0 l=1 rev1=1 crypto rx=0x7fbd2402ba00 tx=0x7fbd24032af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:51:12.157 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:12.154+0000 7fbd28ff9640 1 -- 172.21.15.150:0/2988713460 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd24036070 con 0x7fbd2c0b12a0 2024-09-17T05:51:12.157 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:12.154+0000 7fbd28ff9640 1 -- 172.21.15.150:0/2988713460 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fbd24042070 con 0x7fbd2c0b12a0 2024-09-17T05:51:12.157 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:12.154+0000 7fbd323c3640 1 -- 172.21.15.150:0/2988713460 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbd2c1f2690 con 0x7fbd2c0b12a0 2024-09-17T05:51:12.157 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:12.154+0000 7fbd28ff9640 1 -- 172.21.15.150:0/2988713460 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd24009ca0 con 0x7fbd2c0b12a0 2024-09-17T05:51:12.157 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:12.154+0000 7fbd323c3640 1 -- 172.21.15.150:0/2988713460 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbd2c1f2c50 con 0x7fbd2c0b12a0 2024-09-17T05:51:12.158 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:12.155+0000 7fbd323c3640 1 -- 172.21.15.150:0/2988713460 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbd2c1f3310 con 0x7fbd2c0b12a0 2024-09-17T05:51:12.158 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:12.156+0000 7fbd28ff9640 1 -- 172.21.15.150:0/2988713460 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 37) ==== 103787+0+0 (secure 0 0 0) 0x7fbd24047460 con 0x7fbd2c0b12a0 2024-09-17T05:51:12.158 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:12.156+0000 7fbd28ff9640 1 --2- 172.21.15.150:0/2988713460 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fbd1807a570 0x7fbd1807ca80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:51:12.158 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:12.156+0000 7fbd28ff9640 1 -- 172.21.15.150:0/2988713460 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(109..109 src has 1..109) ==== 4997+0+0 (secure 0 0 0) 0x7fbd240bb180 con 0x7fbd2c0b12a0 2024-09-17T05:51:12.159 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:12.156+0000 7fbd2bfff640 1 --2- 172.21.15.150:0/2988713460 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fbd1807a570 0x7fbd1807ca80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:51:12.159 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:12.157+0000 7fbd2bfff640 1 --2- 172.21.15.150:0/2988713460 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fbd1807a570 0x7fbd1807ca80 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7fbd1c006cd0 tx=0x7fbd1c000ed0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:51:12.161 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:12.161+0000 7fbd28ff9640 1 -- 172.21.15.150:0/2988713460 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fbd2c0b1bf0 con 0x7fbd2c0b12a0 2024-09-17T05:51:12.339 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:12.338+0000 7fbd323c3640 1 -- 172.21.15.150:0/2988713460 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7fbd2c0af8a0 con 0x7fbd2c0b12a0 2024-09-17T05:51:13.325 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:13.324+0000 7fbd28ff9640 1 -- 172.21.15.150:0/2988713460 <== mon.0 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v110) ==== 138+0+0 (secure 0 0 0) 0x7fbd24085130 con 0x7fbd2c0b12a0 2024-09-17T05:51:13.326 INFO:teuthology.orchestra.run.smithi150.stderr:pool 'cephfs_metadata' created 2024-09-17T05:51:13.328 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:13.328+0000 7fbd323c3640 1 -- 172.21.15.150:0/2988713460 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fbd1807a570 msgr2=0x7fbd1807ca80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:51:13.329 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:13.328+0000 7fbd323c3640 1 --2- 172.21.15.150:0/2988713460 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fbd1807a570 0x7fbd1807ca80 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7fbd1c006cd0 tx=0x7fbd1c000ed0 comp rx=0 tx=0).stop 2024-09-17T05:51:13.329 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:13.328+0000 7fbd323c3640 1 -- 172.21.15.150:0/2988713460 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbd2c0b12a0 msgr2=0x7fbd2c0b16b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:51:13.329 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:13.328+0000 7fbd323c3640 1 --2- 172.21.15.150:0/2988713460 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbd2c0b12a0 0x7fbd2c0b16b0 secure :-1 s=READY pgs=1473 cs=0 l=1 rev1=1 crypto rx=0x7fbd2402ba00 tx=0x7fbd24032af0 comp rx=0 tx=0).stop 2024-09-17T05:51:13.329 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:13.328+0000 7fbd323c3640 1 -- 172.21.15.150:0/2988713460 shutdown_connections 2024-09-17T05:51:13.329 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:13.328+0000 7fbd323c3640 1 --2- 172.21.15.150:0/2988713460 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fbd2c15f3f0 0x7fbd2c1546f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:51:13.329 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:13.328+0000 7fbd323c3640 1 --2- 172.21.15.150:0/2988713460 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fbd1807a570 0x7fbd1807ca80 unknown :-1 s=CLOSED pgs=627 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:51:13.329 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:13.328+0000 7fbd323c3640 1 --2- 172.21.15.150:0/2988713460 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbd2c0b12a0 0x7fbd2c0b16b0 unknown :-1 s=CLOSED pgs=1473 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:51:13.329 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:13.328+0000 7fbd323c3640 1 --2- 172.21.15.150:0/2988713460 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fbd14004d40 0x7fbd2c150e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:51:13.329 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:13.328+0000 7fbd323c3640 1 -- 172.21.15.150:0/2988713460 >> 172.21.15.150:0/2988713460 conn(0x7fbd2c09aa50 msgr2=0x7fbd2c15a750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:51:13.329 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:13.328+0000 7fbd323c3640 1 -- 172.21.15.150:0/2988713460 shutdown_connections 2024-09-17T05:51:13.329 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:13.328+0000 7fbd323c3640 1 -- 172.21.15.150:0/2988713460 wait complete. 2024-09-17T05:51:13.348 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-09-17T05:51:13.477 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:13.474+0000 7f4d52dc3640 1 -- 172.21.15.150:0/525118557 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4d4c0d5150 msgr2=0x7f4d4c0b9b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:51:13.477 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:13.474+0000 7f4d52dc3640 1 --2- 172.21.15.150:0/525118557 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4d4c0d5150 0x7f4d4c0b9b10 secure :-1 s=READY pgs=1474 cs=0 l=1 rev1=1 crypto rx=0x7f4d4c08e950 tx=0x7f4d4002a540 comp rx=0 tx=0).stop 2024-09-17T05:51:13.478 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:13.474+0000 7f4d52dc3640 1 -- 172.21.15.150:0/525118557 shutdown_connections 2024-09-17T05:51:13.478 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:13.474+0000 7f4d52dc3640 1 --2- 172.21.15.150:0/525118557 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4d4c06e2b0 0x7f4d4c0d0560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:51:13.478 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:13.474+0000 7f4d52dc3640 1 --2- 172.21.15.150:0/525118557 >> v2:172.21.15.176:3300/0 conn(0x7f4d4c06dea0 0x7f4d4c0d0020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:51:13.478 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:13.474+0000 7f4d52dc3640 1 --2- 172.21.15.150:0/525118557 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4d4c0d5150 0x7f4d4c0b9b10 unknown :-1 s=CLOSED pgs=1474 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:51:13.478 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:13.474+0000 7f4d52dc3640 1 -- 172.21.15.150:0/525118557 >> 172.21.15.150:0/525118557 conn(0x7f4d4c08bfe0 msgr2=0x7f4d4c0d46e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:51:13.478 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:13.474+0000 7f4d52dc3640 1 -- 172.21.15.150:0/525118557 shutdown_connections 2024-09-17T05:51:13.478 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:13.474+0000 7f4d52dc3640 1 -- 172.21.15.150:0/525118557 wait complete. 2024-09-17T05:51:13.478 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:13.476+0000 7f4d52dc3640 1 Processor -- start 2024-09-17T05:51:13.478 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:13.476+0000 7f4d52dc3640 1 -- start start 2024-09-17T05:51:13.480 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:13.478+0000 7f4d52dc3640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4d4c06dea0 0x7f4d4c1ea270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:51:13.480 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:13.478+0000 7f4d52dc3640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4d4c06e2b0 0x7f4d4c1e4af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:51:13.481 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:13.478+0000 7f4d52dc3640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4d4c0d5150 0x7f4d4c1f8ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:51:13.481 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:13.478+0000 7f4d52dc3640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f4d4c0d3150 con 0x7f4d4c06dea0 2024-09-17T05:51:13.481 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:13.478+0000 7f4d52dc3640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f4d4c0d2fd0 con 0x7f4d4c06e2b0 2024-09-17T05:51:13.481 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:13.478+0000 7f4d52dc3640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f4d4c0b6160 con 0x7f4d4c0d5150 2024-09-17T05:51:13.481 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:13.478+0000 7f4d50b5f640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4d4c06dea0 0x7f4d4c1ea270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:51:13.481 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:13.478+0000 7f4d50b5f640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4d4c06dea0 0x7f4d4c1ea270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:50202/0 (socket says 172.21.15.150:50202) 2024-09-17T05:51:13.481 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:13.478+0000 7f4d50b5f640 1 -- 172.21.15.150:0/2021566539 learned_addr learned my addr 172.21.15.150:0/2021566539 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:51:13.481 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:13.478+0000 7f4d4bfff640 1 --2- 172.21.15.150:0/2021566539 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4d4c06e2b0 0x7f4d4c1e4af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:51:13.481 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:13.478+0000 7f4d51360640 1 --2- 172.21.15.150:0/2021566539 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4d4c0d5150 0x7f4d4c1f8ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:51:13.481 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:13.478+0000 7f4d50b5f640 1 -- 172.21.15.150:0/2021566539 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4d4c0d5150 msgr2=0x7f4d4c1f8ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:51:13.481 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:13.478+0000 7f4d50b5f640 1 --2- 172.21.15.150:0/2021566539 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4d4c0d5150 0x7f4d4c1f8ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:51:13.482 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:13.478+0000 7f4d50b5f640 1 -- 172.21.15.150:0/2021566539 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4d4c06e2b0 msgr2=0x7f4d4c1e4af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:51:13.482 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:13.478+0000 7f4d50b5f640 1 --2- 172.21.15.150:0/2021566539 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4d4c06e2b0 0x7f4d4c1e4af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:51:13.482 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:13.478+0000 7f4d50b5f640 1 -- 172.21.15.150:0/2021566539 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4d4c1e9230 con 0x7f4d4c06dea0 2024-09-17T05:51:13.482 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:13.478+0000 7f4d50b5f640 1 --2- 172.21.15.150:0/2021566539 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4d4c06dea0 0x7f4d4c1ea270 secure :-1 s=READY pgs=1475 cs=0 l=1 rev1=1 crypto rx=0x7f4d400099d0 tx=0x7f4d400052f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:51:13.482 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:13.478+0000 7f4d497fa640 1 -- 172.21.15.150:0/2021566539 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d40005cf0 con 0x7f4d4c06dea0 2024-09-17T05:51:13.482 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:13.478+0000 7f4d497fa640 1 -- 172.21.15.150:0/2021566539 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f4d40031c40 con 0x7f4d4c06dea0 2024-09-17T05:51:13.482 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:13.479+0000 7f4d52dc3640 1 -- 172.21.15.150:0/2021566539 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4d4c1e94b0 con 0x7f4d4c06dea0 2024-09-17T05:51:13.482 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:13.479+0000 7f4d497fa640 1 -- 172.21.15.150:0/2021566539 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d40033330 con 0x7f4d4c06dea0 2024-09-17T05:51:13.482 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:13.479+0000 7f4d52dc3640 1 -- 172.21.15.150:0/2021566539 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4d4c1e9a70 con 0x7f4d4c06dea0 2024-09-17T05:51:13.482 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:13.479+0000 7f4d52dc3640 1 -- 172.21.15.150:0/2021566539 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4d4c0b9b10 con 0x7f4d4c06dea0 2024-09-17T05:51:13.483 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:13.480+0000 7f4d497fa640 1 -- 172.21.15.150:0/2021566539 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 37) ==== 103787+0+0 (secure 0 0 0) 0x7f4d400334d0 con 0x7f4d4c06dea0 2024-09-17T05:51:13.483 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:13.481+0000 7f4d497fa640 1 --2- 172.21.15.150:0/2021566539 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f4d3007a5a0 0x7f4d3007cab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:51:13.483 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:13.481+0000 7f4d497fa640 1 -- 172.21.15.150:0/2021566539 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(110..110 src has 1..110) ==== 5367+0+0 (secure 0 0 0) 0x7f4d400badf0 con 0x7f4d4c06dea0 2024-09-17T05:51:13.483 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:13.481+0000 7f4d4bfff640 1 --2- 172.21.15.150:0/2021566539 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f4d3007a5a0 0x7f4d3007cab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:51:13.483 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:13.482+0000 7f4d4bfff640 1 --2- 172.21.15.150:0/2021566539 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f4d3007a5a0 0x7f4d3007cab0 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7f4d4c15e9c0 tx=0x7f4d3800b260 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:51:13.486 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:13.486+0000 7f4d497fa640 1 -- 172.21.15.150:0/2021566539 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f4d4c1e9230 con 0x7f4d4c06dea0 2024-09-17T05:51:13.662 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:13.662+0000 7f4d52dc3640 1 -- 172.21.15.150:0/2021566539 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7f4d4c0d4f30 con 0x7f4d4c06dea0 2024-09-17T05:51:14.333 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:14.333+0000 7f4d497fa640 1 -- 172.21.15.150:0/2021566539 <== mon.0 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v111) ==== 170+0+0 (secure 0 0 0) 0x7f4d4003f030 con 0x7f4d4c06dea0 2024-09-17T05:51:14.334 INFO:teuthology.orchestra.run.smithi150.stderr:pool 'cephfs_data' created 2024-09-17T05:51:14.336 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:14.335+0000 7f4d52dc3640 1 -- 172.21.15.150:0/2021566539 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f4d3007a5a0 msgr2=0x7f4d3007cab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:51:14.336 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:14.335+0000 7f4d52dc3640 1 --2- 172.21.15.150:0/2021566539 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f4d3007a5a0 0x7f4d3007cab0 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7f4d4c15e9c0 tx=0x7f4d3800b260 comp rx=0 tx=0).stop 2024-09-17T05:51:14.336 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:14.335+0000 7f4d52dc3640 1 -- 172.21.15.150:0/2021566539 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4d4c06dea0 msgr2=0x7f4d4c1ea270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:51:14.337 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:14.335+0000 7f4d52dc3640 1 --2- 172.21.15.150:0/2021566539 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4d4c06dea0 0x7f4d4c1ea270 secure :-1 s=READY pgs=1475 cs=0 l=1 rev1=1 crypto rx=0x7f4d400099d0 tx=0x7f4d400052f0 comp rx=0 tx=0).stop 2024-09-17T05:51:14.337 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:14.336+0000 7f4d52dc3640 1 -- 172.21.15.150:0/2021566539 shutdown_connections 2024-09-17T05:51:14.337 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:14.336+0000 7f4d52dc3640 1 --2- 172.21.15.150:0/2021566539 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4d4c06e2b0 0x7f4d4c1e4af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:51:14.337 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:14.336+0000 7f4d52dc3640 1 --2- 172.21.15.150:0/2021566539 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f4d3007a5a0 0x7f4d3007cab0 unknown :-1 s=CLOSED pgs=631 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:51:14.337 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:14.336+0000 7f4d52dc3640 1 --2- 172.21.15.150:0/2021566539 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4d4c0d5150 0x7f4d4c1f8ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:51:14.337 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:14.336+0000 7f4d52dc3640 1 --2- 172.21.15.150:0/2021566539 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4d4c06dea0 0x7f4d4c1ea270 unknown :-1 s=CLOSED pgs=1475 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:51:14.337 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:14.336+0000 7f4d52dc3640 1 -- 172.21.15.150:0/2021566539 >> 172.21.15.150:0/2021566539 conn(0x7f4d4c08bfe0 msgr2=0x7f4d4c15eb10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:51:14.337 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:14.336+0000 7f4d52dc3640 1 -- 172.21.15.150:0/2021566539 shutdown_connections 2024-09-17T05:51:14.337 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:14.336+0000 7f4d52dc3640 1 -- 172.21.15.150:0/2021566539 wait complete. 2024-09-17T05:51:14.358 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-09-17T05:51:14.475 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:14.474+0000 7f80e5e41640 1 -- 172.21.15.150:0/248295268 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f80e00ce4c0 msgr2=0x7f80e00ce8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:51:14.475 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:14.474+0000 7f80e5e41640 1 --2- 172.21.15.150:0/248295268 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f80e00ce4c0 0x7f80e00ce8d0 secure :-1 s=READY pgs=1477 cs=0 l=1 rev1=1 crypto rx=0x7f80d4009830 tx=0x7f80d402a3f0 comp rx=0 tx=0).stop 2024-09-17T05:51:14.475 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:14.474+0000 7f80e5e41640 1 -- 172.21.15.150:0/248295268 shutdown_connections 2024-09-17T05:51:14.475 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:14.474+0000 7f80e5e41640 1 --2- 172.21.15.150:0/248295268 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f80e00ce4c0 0x7f80e00ce8d0 unknown :-1 s=CLOSED pgs=1477 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:51:14.475 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:14.474+0000 7f80e5e41640 1 --2- 172.21.15.150:0/248295268 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f80e00af160 0x7f80e00af570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:51:14.475 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:14.474+0000 7f80e5e41640 1 -- 172.21.15.150:0/248295268 >> 172.21.15.150:0/248295268 conn(0x7f80e00cefb0 msgr2=0x7f80e00cf3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:51:14.476 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:14.474+0000 7f80e5e41640 1 -- 172.21.15.150:0/248295268 shutdown_connections 2024-09-17T05:51:14.476 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:14.474+0000 7f80e5e41640 1 -- 172.21.15.150:0/248295268 wait complete. 2024-09-17T05:51:14.476 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:14.476+0000 7f80e5e41640 1 Processor -- start 2024-09-17T05:51:14.476 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:14.476+0000 7f80e5e41640 1 -- start start 2024-09-17T05:51:14.479 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:14.477+0000 7f80e5e41640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f80e00af160 0x7f80e015bb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:51:14.479 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:14.477+0000 7f80e5e41640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f80e00ce4c0 0x7f80e015e7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:51:14.479 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:14.477+0000 7f80e5e41640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f80e00d0980 0x7f80e015ecf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:51:14.479 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:14.477+0000 7f80e5e41640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f80e00b18e0 con 0x7f80e00d0980 2024-09-17T05:51:14.480 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:14.477+0000 7f80e5e41640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f80e00b1760 con 0x7f80e00af160 2024-09-17T05:51:14.480 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:14.477+0000 7f80e5e41640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f80e00cd040 con 0x7f80e00ce4c0 2024-09-17T05:51:14.480 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:14.477+0000 7f80dffff640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f80e00d0980 0x7f80e015ecf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:51:14.480 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:14.477+0000 7f80dffff640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f80e00d0980 0x7f80e015ecf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:50218/0 (socket says 172.21.15.150:50218) 2024-09-17T05:51:14.480 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:14.477+0000 7f80dffff640 1 -- 172.21.15.150:0/2477708513 learned_addr learned my addr 172.21.15.150:0/2477708513 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:51:14.480 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:14.477+0000 7f80deffd640 1 --2- 172.21.15.150:0/2477708513 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f80e00ce4c0 0x7f80e015e7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:51:14.480 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:14.477+0000 7f80df7fe640 1 --2- 172.21.15.150:0/2477708513 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f80e00af160 0x7f80e015bb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:51:14.480 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:14.478+0000 7f80dffff640 1 -- 172.21.15.150:0/2477708513 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f80e00ce4c0 msgr2=0x7f80e015e7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:51:14.480 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:14.478+0000 7f80dffff640 1 --2- 172.21.15.150:0/2477708513 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f80e00ce4c0 0x7f80e015e7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:51:14.480 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:14.478+0000 7f80dffff640 1 -- 172.21.15.150:0/2477708513 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f80e00af160 msgr2=0x7f80e015bb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:51:14.480 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:14.478+0000 7f80dffff640 1 --2- 172.21.15.150:0/2477708513 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f80e00af160 0x7f80e015bb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:51:14.480 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:14.478+0000 7f80dffff640 1 -- 172.21.15.150:0/2477708513 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f80e015cbe0 con 0x7f80e00d0980 2024-09-17T05:51:14.481 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:14.478+0000 7f80dffff640 1 --2- 172.21.15.150:0/2477708513 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f80e00d0980 0x7f80e015ecf0 secure :-1 s=READY pgs=1478 cs=0 l=1 rev1=1 crypto rx=0x7f80d800c3c0 tx=0x7f80d800c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:51:14.481 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:14.478+0000 7f80c7fff640 1 -- 172.21.15.150:0/2477708513 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80d8017070 con 0x7f80e00d0980 2024-09-17T05:51:14.481 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:14.478+0000 7f80c7fff640 1 -- 172.21.15.150:0/2477708513 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f80d80035f0 con 0x7f80e00d0980 2024-09-17T05:51:14.481 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:14.478+0000 7f80e5e41640 1 -- 172.21.15.150:0/2477708513 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f80e015cec0 con 0x7f80e00d0980 2024-09-17T05:51:14.481 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:14.478+0000 7f80c7fff640 1 -- 172.21.15.150:0/2477708513 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80d8003a40 con 0x7f80e00d0980 2024-09-17T05:51:14.481 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:14.478+0000 7f80e5e41640 1 -- 172.21.15.150:0/2477708513 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f80e00c88b0 con 0x7f80e00d0980 2024-09-17T05:51:14.482 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:14.479+0000 7f80e5e41640 1 -- 172.21.15.150:0/2477708513 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f80e015f230 con 0x7f80e00d0980 2024-09-17T05:51:14.482 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:14.480+0000 7f80c7fff640 1 -- 172.21.15.150:0/2477708513 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 37) ==== 103787+0+0 (secure 0 0 0) 0x7f80d801a070 con 0x7f80e00d0980 2024-09-17T05:51:14.482 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:14.481+0000 7f80c7fff640 1 --2- 172.21.15.150:0/2477708513 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f80cc07a570 0x7f80cc07ca80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:51:14.482 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:14.481+0000 7f80c7fff640 1 -- 172.21.15.150:0/2477708513 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(111..111 src has 1..111) ==== 5749+0+0 (secure 0 0 0) 0x7f80d8098ff0 con 0x7f80e00d0980 2024-09-17T05:51:14.482 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:14.481+0000 7f80df7fe640 1 --2- 172.21.15.150:0/2477708513 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f80cc07a570 0x7f80cc07ca80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:51:14.482 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:14.481+0000 7f80df7fe640 1 --2- 172.21.15.150:0/2477708513 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f80cc07a570 0x7f80cc07ca80 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7f80d0005fd0 tx=0x7f80d00095e0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:51:14.485 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:14.484+0000 7f80c7fff640 1 -- 172.21.15.150:0/2477708513 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f80d8021020 con 0x7f80e00d0980 2024-09-17T05:51:14.699 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:14.698+0000 7f80e5e41640 1 -- 172.21.15.150:0/2477708513 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7f80e01f44e0 con 0x7f80e00d0980 2024-09-17T05:51:15.346 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:15.346+0000 7f80c7fff640 1 -- 172.21.15.150:0/2477708513 <== mon.0 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 16 and data pool 17 v66) ==== 174+0+0 (secure 0 0 0) 0x7f80d8062a50 con 0x7f80e00d0980 2024-09-17T05:51:15.348 INFO:teuthology.orchestra.run.smithi150.stderr:new fs with metadata pool 16 and data pool 17 2024-09-17T05:51:15.365 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:15.364+0000 7f80e5e41640 1 -- 172.21.15.150:0/2477708513 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f80cc07a570 msgr2=0x7f80cc07ca80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:51:15.365 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:15.364+0000 7f80e5e41640 1 --2- 172.21.15.150:0/2477708513 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f80cc07a570 0x7f80cc07ca80 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7f80d0005fd0 tx=0x7f80d00095e0 comp rx=0 tx=0).stop 2024-09-17T05:51:15.365 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:15.364+0000 7f80e5e41640 1 -- 172.21.15.150:0/2477708513 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f80e00d0980 msgr2=0x7f80e015ecf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:51:15.366 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:15.364+0000 7f80e5e41640 1 --2- 172.21.15.150:0/2477708513 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f80e00d0980 0x7f80e015ecf0 secure :-1 s=READY pgs=1478 cs=0 l=1 rev1=1 crypto rx=0x7f80d800c3c0 tx=0x7f80d800c880 comp rx=0 tx=0).stop 2024-09-17T05:51:15.366 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:15.364+0000 7f80e5e41640 1 -- 172.21.15.150:0/2477708513 shutdown_connections 2024-09-17T05:51:15.366 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:15.364+0000 7f80e5e41640 1 --2- 172.21.15.150:0/2477708513 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f80cc07a570 0x7f80cc07ca80 unknown :-1 s=CLOSED pgs=632 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:51:15.366 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:15.364+0000 7f80e5e41640 1 --2- 172.21.15.150:0/2477708513 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f80e00d0980 0x7f80e015ecf0 unknown :-1 s=CLOSED pgs=1478 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:51:15.366 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:15.364+0000 7f80e5e41640 1 --2- 172.21.15.150:0/2477708513 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f80e00ce4c0 0x7f80e015e7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:51:15.366 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:15.364+0000 7f80e5e41640 1 --2- 172.21.15.150:0/2477708513 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f80e00af160 0x7f80e015bb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:51:15.366 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:15.364+0000 7f80e5e41640 1 -- 172.21.15.150:0/2477708513 >> 172.21.15.150:0/2477708513 conn(0x7f80e00cefb0 msgr2=0x7f80e0072b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:51:15.366 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:15.366+0000 7f80e5e41640 1 -- 172.21.15.150:0/2477708513 shutdown_connections 2024-09-17T05:51:15.367 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:15.366+0000 7f80e5e41640 1 -- 172.21.15.150:0/2477708513 wait complete. 2024-09-17T05:51:15.382 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T05:51:15.497 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:15.496+0000 7efc58294640 1 -- 172.21.15.150:0/796794256 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7efc500aebc0 msgr2=0x7efc50152920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:51:15.497 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:15.496+0000 7efc58294640 1 --2- 172.21.15.150:0/796794256 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7efc500aebc0 0x7efc50152920 secure :-1 s=READY pgs=1479 cs=0 l=1 rev1=1 crypto rx=0x7efc5006f3c0 tx=0x7efc4c02a560 comp rx=0 tx=0).stop 2024-09-17T05:51:15.497 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:15.496+0000 7efc58294640 1 -- 172.21.15.150:0/796794256 shutdown_connections 2024-09-17T05:51:15.497 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:15.496+0000 7efc58294640 1 --2- 172.21.15.150:0/796794256 >> v2:172.21.15.176:3300/0 conn(0x7efc500b2750 0x7efc5015f3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:51:15.497 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:15.496+0000 7efc58294640 1 --2- 172.21.15.150:0/796794256 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7efc500aebc0 0x7efc50152920 unknown :-1 s=CLOSED pgs=1479 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:51:15.497 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:15.496+0000 7efc58294640 1 -- 172.21.15.150:0/796794256 >> 172.21.15.150:0/796794256 conn(0x7efc5006d730 msgr2=0x7efc500b1e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:51:15.497 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:15.496+0000 7efc58294640 1 -- 172.21.15.150:0/796794256 shutdown_connections 2024-09-17T05:51:15.498 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:15.496+0000 7efc58294640 1 -- 172.21.15.150:0/796794256 wait complete. 2024-09-17T05:51:15.498 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:15.498+0000 7efc58294640 1 Processor -- start 2024-09-17T05:51:15.498 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:15.498+0000 7efc58294640 1 -- start start 2024-09-17T05:51:15.501 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:15.499+0000 7efc58294640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7efc500aebc0 0x7efc501f78e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:51:15.501 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:15.499+0000 7efc58294640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7efc500b2750 0x7efc5015b4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:51:15.501 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:15.499+0000 7efc58294640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7efc5015f910 0x7efc50145630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:51:15.501 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:15.499+0000 7efc58294640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7efc5015c4a0 con 0x7efc5015f910 2024-09-17T05:51:15.501 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:15.499+0000 7efc58294640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7efc500b4970 con 0x7efc500aebc0 2024-09-17T05:51:15.501 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:15.499+0000 7efc58294640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7efc5015c620 con 0x7efc500b2750 2024-09-17T05:51:15.501 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:15.499+0000 7efc56831640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7efc5015f910 0x7efc50145630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:51:15.501 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:15.499+0000 7efc56831640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7efc5015f910 0x7efc50145630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:50240/0 (socket says 172.21.15.150:50240) 2024-09-17T05:51:15.501 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:15.499+0000 7efc56831640 1 -- 172.21.15.150:0/2087308089 learned_addr learned my addr 172.21.15.150:0/2087308089 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:51:15.501 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:15.499+0000 7efc5582f640 1 --2- 172.21.15.150:0/2087308089 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7efc500b2750 0x7efc5015b4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:51:15.502 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:15.499+0000 7efc56030640 1 --2- 172.21.15.150:0/2087308089 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7efc500aebc0 0x7efc501f78e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:51:15.502 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:15.499+0000 7efc56831640 1 -- 172.21.15.150:0/2087308089 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7efc500b2750 msgr2=0x7efc5015b4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:51:15.502 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:15.499+0000 7efc56831640 1 --2- 172.21.15.150:0/2087308089 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7efc500b2750 0x7efc5015b4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:51:15.502 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:15.499+0000 7efc56831640 1 -- 172.21.15.150:0/2087308089 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7efc500aebc0 msgr2=0x7efc501f78e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:51:15.502 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:15.499+0000 7efc56831640 1 --2- 172.21.15.150:0/2087308089 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7efc500aebc0 0x7efc501f78e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:51:15.502 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:15.499+0000 7efc56831640 1 -- 172.21.15.150:0/2087308089 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efc501519a0 con 0x7efc5015f910 2024-09-17T05:51:15.502 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:15.499+0000 7efc5582f640 1 --2- 172.21.15.150:0/2087308089 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7efc500b2750 0x7efc5015b4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:51:15.502 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:15.499+0000 7efc56831640 1 --2- 172.21.15.150:0/2087308089 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7efc5015f910 0x7efc50145630 secure :-1 s=READY pgs=1480 cs=0 l=1 rev1=1 crypto rx=0x7efc4800c700 tx=0x7efc4800cbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:51:15.502 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:15.500+0000 7efc46ffd640 1 -- 172.21.15.150:0/2087308089 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc48003b70 con 0x7efc5015f910 2024-09-17T05:51:15.502 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:15.500+0000 7efc46ffd640 1 -- 172.21.15.150:0/2087308089 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7efc48003d10 con 0x7efc5015f910 2024-09-17T05:51:15.502 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:15.500+0000 7efc46ffd640 1 -- 172.21.15.150:0/2087308089 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc4800aa50 con 0x7efc5015f910 2024-09-17T05:51:15.502 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:15.500+0000 7efc58294640 1 -- 172.21.15.150:0/2087308089 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efc50146230 con 0x7efc5015f910 2024-09-17T05:51:15.503 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:15.500+0000 7efc58294640 1 -- 172.21.15.150:0/2087308089 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efc501f6e00 con 0x7efc5015f910 2024-09-17T05:51:15.504 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:15.501+0000 7efc58294640 1 -- 172.21.15.150:0/2087308089 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efc5015cab0 con 0x7efc5015f910 2024-09-17T05:51:15.504 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:15.501+0000 7efc46ffd640 1 -- 172.21.15.150:0/2087308089 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 37) ==== 103787+0+0 (secure 0 0 0) 0x7efc4800abf0 con 0x7efc5015f910 2024-09-17T05:51:15.504 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:15.502+0000 7efc46ffd640 1 --2- 172.21.15.150:0/2087308089 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7efc3407a570 0x7efc3407ca80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:51:15.504 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:15.502+0000 7efc46ffd640 1 -- 172.21.15.150:0/2087308089 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(112..112 src has 1..112) ==== 5849+0+0 (secure 0 0 0) 0x7efc480997e0 con 0x7efc5015f910 2024-09-17T05:51:15.504 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:15.502+0000 7efc56030640 1 --2- 172.21.15.150:0/2087308089 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7efc3407a570 0x7efc3407ca80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:51:15.504 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:15.503+0000 7efc56030640 1 --2- 172.21.15.150:0/2087308089 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7efc3407a570 0x7efc3407ca80 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7efc4c033000 tx=0x7efc4c004730 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:51:15.507 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:15.507+0000 7efc46ffd640 1 -- 172.21.15.150:0/2087308089 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7efc5015fd20 con 0x7efc5015f910 2024-09-17T05:51:15.685 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:15.684+0000 7efc58294640 1 -- 172.21.15.150:0/2087308089 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7efc501560d0 con 0x7efc5015f910 2024-09-17T05:51:15.686 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:15.685+0000 7efc46ffd640 1 -- 172.21.15.150:0/2087308089 <== mon.0 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v112) ==== 74+0+16958 (secure 0 0 0) 0x7efc480637b0 con 0x7efc5015f910 2024-09-17T05:51:15.686 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-09-17T05:51:15.686 INFO:teuthology.orchestra.run.smithi150.stdout:{"epoch":112,"fsid":"9f2e05e9-d629-47b3-b26b-1360655b7d20","created":"2024-09-17T05:41:32.502979+0000","modified":"2024-09-17T05:51:14.699754+0000","last_up_change":"2024-09-17T05:41:46.150225+0000","last_in_change":"2024-09-17T05:41:36.120274+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":17,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T05:41:46.860779+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":16,"pool_name":"cephfs_metadata","create_time":"2024-09-17T05:51:12.343530+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"112","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":17,"pool_name":"cephfs_data","create_time":"2024-09-17T05:51:13.667025+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"112","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"4f31c018-c8a4-4d6d-b0c2-a597c47aae4a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6800","nonce":479374392},{"type":"v1","addr":"172.21.15.150:6801","nonce":479374392}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6802","nonce":479374392},{"type":"v1","addr":"172.21.15.150:6803","nonce":479374392}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6806","nonce":479374392},{"type":"v1","addr":"172.21.15.150:6807","nonce":479374392}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6804","nonce":479374392},{"type":"v1","addr":"172.21.15.150:6805","nonce":479374392}]},"public_addr":"172.21.15.150:6801/479374392","cluster_addr":"172.21.15.150:6803/479374392","heartbeat_back_addr":"172.21.15.150:6807/479374392","heartbeat_front_addr":"172.21.15.150:6805/479374392","state":["exists","up"]},{"osd":1,"uuid":"6ff4a573-500b-4e04-9de3-39265ead78b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6824","nonce":913899800},{"type":"v1","addr":"172.21.15.150:6825","nonce":913899800}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6826","nonce":913899800},{"type":"v1","addr":"172.21.15.150:6827","nonce":913899800}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6830","nonce":913899800},{"type":"v1","addr":"172.21.15.150:6831","nonce":913899800}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6828","nonce":913899800},{"type":"v1","addr":"172.21.15.150:6829","nonce":913899800}]},"public_addr":"172.21.15.150:6825/913899800","cluster_addr":"172.21.15.150:6827/913899800","heartbeat_back_addr":"172.21.15.150:6831/913899800","heartbeat_front_addr":"172.21.15.150:6829/913899800","state":["exists","up"]},{"osd":2,"uuid":"bffea6f9-2465-4182-b205-00436c41ac1c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6816","nonce":363718461},{"type":"v1","addr":"172.21.15.150:6817","nonce":363718461}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6818","nonce":363718461},{"type":"v1","addr":"172.21.15.150:6819","nonce":363718461}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6822","nonce":363718461},{"type":"v1","addr":"172.21.15.150:6823","nonce":363718461}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6820","nonce":363718461},{"type":"v1","addr":"172.21.15.150:6821","nonce":363718461}]},"public_addr":"172.21.15.150:6817/363718461","cluster_addr":"172.21.15.150:6819/363718461","heartbeat_back_addr":"172.21.15.150:6823/363718461","heartbeat_front_addr":"172.21.15.150:6821/363718461","state":["exists","up"]},{"osd":3,"uuid":"cda70430-d1e1-427e-b04e-56db4031d078","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6808","nonce":3550994626},{"type":"v1","addr":"172.21.15.150:6809","nonce":3550994626}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6810","nonce":3550994626},{"type":"v1","addr":"172.21.15.150:6811","nonce":3550994626}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6814","nonce":3550994626},{"type":"v1","addr":"172.21.15.150:6815","nonce":3550994626}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6812","nonce":3550994626},{"type":"v1","addr":"172.21.15.150:6813","nonce":3550994626}]},"public_addr":"172.21.15.150:6809/3550994626","cluster_addr":"172.21.15.150:6811/3550994626","heartbeat_back_addr":"172.21.15.150:6815/3550994626","heartbeat_front_addr":"172.21.15.150:6813/3550994626","state":["exists","up"]},{"osd":4,"uuid":"3a0277fb-5e1e-4f68-bb2d-9a8a0152f64a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6810","nonce":2718261497},{"type":"v1","addr":"172.21.15.176:6811","nonce":2718261497}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6812","nonce":2718261497},{"type":"v1","addr":"172.21.15.176:6813","nonce":2718261497}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6816","nonce":2718261497},{"type":"v1","addr":"172.21.15.176:6817","nonce":2718261497}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6814","nonce":2718261497},{"type":"v1","addr":"172.21.15.176:6815","nonce":2718261497}]},"public_addr":"172.21.15.176:6811/2718261497","cluster_addr":"172.21.15.176:6813/2718261497","heartbeat_back_addr":"172.21.15.176:6817/2718261497","heartbeat_front_addr":"172.21.15.176:6815/2718261497","state":["exists","up"]},{"osd":5,"uuid":"33aebee6-0315-40b7-a11c-6702f0be494d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6818","nonce":2049295774},{"type":"v1","addr":"172.21.15.176:6819","nonce":2049295774}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6820","nonce":2049295774},{"type":"v1","addr":"172.21.15.176:6821","nonce":2049295774}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6824","nonce":2049295774},{"type":"v1","addr":"172.21.15.176:6825","nonce":2049295774}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6822","nonce":2049295774},{"type":"v1","addr":"172.21.15.176:6823","nonce":2049295774}]},"public_addr":"172.21.15.176:6819/2049295774","cluster_addr":"172.21.15.176:6821/2049295774","heartbeat_back_addr":"172.21.15.176:6825/2049295774","heartbeat_front_addr":"172.21.15.176:6823/2049295774","state":["exists","up"]},{"osd":6,"uuid":"4d24f360-6751-4263-841b-d77793d33540","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6826","nonce":2164458476},{"type":"v1","addr":"172.21.15.176:6827","nonce":2164458476}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6828","nonce":2164458476},{"type":"v1","addr":"172.21.15.176:6829","nonce":2164458476}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6832","nonce":2164458476},{"type":"v1","addr":"172.21.15.176:6833","nonce":2164458476}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6830","nonce":2164458476},{"type":"v1","addr":"172.21.15.176:6831","nonce":2164458476}]},"public_addr":"172.21.15.176:6827/2164458476","cluster_addr":"172.21.15.176:6829/2164458476","heartbeat_back_addr":"172.21.15.176:6833/2164458476","heartbeat_front_addr":"172.21.15.176:6831/2164458476","state":["exists","up"]},{"osd":7,"uuid":"c8594fda-c74a-4ba9-8277-caf101d58ca1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6802","nonce":3239587708},{"type":"v1","addr":"172.21.15.176:6803","nonce":3239587708}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6804","nonce":3239587708},{"type":"v1","addr":"172.21.15.176:6805","nonce":3239587708}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6808","nonce":3239587708},{"type":"v1","addr":"172.21.15.176:6809","nonce":3239587708}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6806","nonce":3239587708},{"type":"v1","addr":"172.21.15.176:6807","nonce":3239587708}]},"public_addr":"172.21.15.176:6803/3239587708","cluster_addr":"172.21.15.176:6805/3239587708","heartbeat_back_addr":"172.21.15.176:6809/3239587708","heartbeat_front_addr":"172.21.15.176:6807/3239587708","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:41:41.905151+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:41:42.705679+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:41:42.459673+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:41:42.440819+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:41:42.668428+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:41:42.694972+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:41:43.078535+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:41:42.363539+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":7,"snaps":[{"begin":2,"length":2}]},{"pool":9,"snaps":[{"begin":2,"length":2}]},{"pool":11,"snaps":[{"begin":2,"length":2}]},{"pool":13,"snaps":[{"begin":2,"length":2}]},{"pool":15,"snaps":[{"begin":2,"length":2}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T05:51:15.688 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:15.687+0000 7efc58294640 1 -- 172.21.15.150:0/2087308089 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7efc3407a570 msgr2=0x7efc3407ca80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:51:15.689 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:15.687+0000 7efc58294640 1 --2- 172.21.15.150:0/2087308089 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7efc3407a570 0x7efc3407ca80 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7efc4c033000 tx=0x7efc4c004730 comp rx=0 tx=0).stop 2024-09-17T05:51:15.689 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:15.687+0000 7efc58294640 1 -- 172.21.15.150:0/2087308089 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7efc5015f910 msgr2=0x7efc50145630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:51:15.689 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:15.687+0000 7efc58294640 1 --2- 172.21.15.150:0/2087308089 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7efc5015f910 0x7efc50145630 secure :-1 s=READY pgs=1480 cs=0 l=1 rev1=1 crypto rx=0x7efc4800c700 tx=0x7efc4800cbc0 comp rx=0 tx=0).stop 2024-09-17T05:51:15.689 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:15.687+0000 7efc58294640 1 -- 172.21.15.150:0/2087308089 shutdown_connections 2024-09-17T05:51:15.689 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:15.687+0000 7efc58294640 1 --2- 172.21.15.150:0/2087308089 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7efc3407a570 0x7efc3407ca80 unknown :-1 s=CLOSED pgs=633 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:51:15.689 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:15.687+0000 7efc58294640 1 --2- 172.21.15.150:0/2087308089 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7efc5015f910 0x7efc50145630 unknown :-1 s=CLOSED pgs=1480 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:51:15.689 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:15.687+0000 7efc58294640 1 --2- 172.21.15.150:0/2087308089 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7efc500b2750 0x7efc5015b4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:51:15.689 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:15.687+0000 7efc58294640 1 --2- 172.21.15.150:0/2087308089 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7efc500aebc0 0x7efc501f78e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:51:15.689 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:15.687+0000 7efc58294640 1 -- 172.21.15.150:0/2087308089 >> 172.21.15.150:0/2087308089 conn(0x7efc5006d730 msgr2=0x7efc500b0610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:51:15.689 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:15.688+0000 7efc58294640 1 -- 172.21.15.150:0/2087308089 shutdown_connections 2024-09-17T05:51:15.689 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:15.688+0000 7efc58294640 1 -- 172.21.15.150:0/2087308089 wait complete. 2024-09-17T05:51:15.700 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T05:51:15.814 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:15.813+0000 7f184832b640 1 -- 172.21.15.150:0/2511138092 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f18280039e0 msgr2=0x7f1828003e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:51:15.815 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:15.813+0000 7f184832b640 1 --2- 172.21.15.150:0/2511138092 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f18280039e0 0x7f1828003e10 secure :-1 s=READY pgs=1482 cs=0 l=1 rev1=1 crypto rx=0x7f1830006fd0 tx=0x7f1828005830 comp rx=0 tx=0).stop 2024-09-17T05:51:15.815 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:15.813+0000 7f18468c8640 1 -- 172.21.15.150:0/2511138092 reap_dead start 2024-09-17T05:51:15.815 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:15.813+0000 7f184832b640 1 -- 172.21.15.150:0/2511138092 shutdown_connections 2024-09-17T05:51:15.815 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:15.813+0000 7f184832b640 1 -- 172.21.15.150:0/2511138092 >> 172.21.15.150:0/2511138092 conn(0x7f184008bfe0 msgr2=0x7f18400d4670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:51:15.815 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:15.813+0000 7f184832b640 1 -- 172.21.15.150:0/2511138092 shutdown_connections 2024-09-17T05:51:15.815 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:15.813+0000 7f184832b640 1 -- 172.21.15.150:0/2511138092 wait complete. 2024-09-17T05:51:15.816 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:15.815+0000 7f184832b640 1 Processor -- start 2024-09-17T05:51:15.816 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:15.815+0000 7f184832b640 1 -- start start 2024-09-17T05:51:15.818 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:15.816+0000 7f184832b640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f18280039e0 0x7f184015a7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:51:15.818 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:15.816+0000 7f184832b640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f18400ce320 0x7f18401f9210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:51:15.818 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:15.816+0000 7f184832b640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f18400ce730 0x7f18401f9750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:51:15.818 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:15.816+0000 7f184832b640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f18400d2b10 con 0x7f18400ce730 2024-09-17T05:51:15.819 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:15.816+0000 7f184832b640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f18400d2990 con 0x7f18280039e0 2024-09-17T05:51:15.819 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:15.816+0000 7f184832b640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f18400d0400 con 0x7f18400ce320 2024-09-17T05:51:15.819 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:15.817+0000 7f18468c8640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f18400ce730 0x7f18401f9750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:51:15.819 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:15.817+0000 7f18468c8640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f18400ce730 0x7f18401f9750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:50254/0 (socket says 172.21.15.150:50254) 2024-09-17T05:51:15.819 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:15.817+0000 7f18468c8640 1 -- 172.21.15.150:0/1702189463 learned_addr learned my addr 172.21.15.150:0/1702189463 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:51:15.819 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:15.817+0000 7f18460c7640 1 --2- 172.21.15.150:0/1702189463 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f18280039e0 0x7f184015a7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:51:15.819 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:15.817+0000 7f18458c6640 1 --2- 172.21.15.150:0/1702189463 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f18400ce320 0x7f18401f9210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:51:15.819 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:15.817+0000 7f18468c8640 1 -- 172.21.15.150:0/1702189463 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f18400ce320 msgr2=0x7f18401f9210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:51:15.819 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:15.817+0000 7f18468c8640 1 --2- 172.21.15.150:0/1702189463 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f18400ce320 0x7f18401f9210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:51:15.819 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:15.817+0000 7f18468c8640 1 -- 172.21.15.150:0/1702189463 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f18280039e0 msgr2=0x7f184015a7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:51:15.819 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:15.817+0000 7f18468c8640 1 --2- 172.21.15.150:0/1702189463 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f18280039e0 0x7f184015a7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:51:15.819 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:15.817+0000 7f18468c8640 1 -- 172.21.15.150:0/1702189463 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f184015aff0 con 0x7f18400ce730 2024-09-17T05:51:15.819 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:15.817+0000 7f18460c7640 1 --2- 172.21.15.150:0/1702189463 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f18280039e0 0x7f184015a7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:51:15.819 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:15.817+0000 7f18468c8640 1 --2- 172.21.15.150:0/1702189463 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f18400ce730 0x7f18401f9750 secure :-1 s=READY pgs=1483 cs=0 l=1 rev1=1 crypto rx=0x7f184008d0c0 tx=0x7f1838001a90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:51:15.819 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:15.817+0000 7f183effd640 1 -- 172.21.15.150:0/1702189463 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1838011870 con 0x7f18400ce730 2024-09-17T05:51:15.820 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:15.817+0000 7f183effd640 1 -- 172.21.15.150:0/1702189463 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f1838017070 con 0x7f18400ce730 2024-09-17T05:51:15.820 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:15.817+0000 7f184832b640 1 -- 172.21.15.150:0/1702189463 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f184015b2d0 con 0x7f18400ce730 2024-09-17T05:51:15.820 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:15.817+0000 7f183effd640 1 -- 172.21.15.150:0/1702189463 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1838011dc0 con 0x7f18400ce730 2024-09-17T05:51:15.820 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:15.817+0000 7f184832b640 1 -- 172.21.15.150:0/1702189463 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f184015b890 con 0x7f18400ce730 2024-09-17T05:51:15.820 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:15.818+0000 7f184832b640 1 -- 172.21.15.150:0/1702189463 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f18400cef10 con 0x7f18400ce730 2024-09-17T05:51:15.821 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:15.819+0000 7f183effd640 1 -- 172.21.15.150:0/1702189463 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 37) ==== 103787+0+0 (secure 0 0 0) 0x7f1838026430 con 0x7f18400ce730 2024-09-17T05:51:15.821 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:15.819+0000 7f183effd640 1 --2- 172.21.15.150:0/1702189463 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f182c07a570 0x7f182c07ca80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:51:15.821 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:15.820+0000 7f183effd640 1 -- 172.21.15.150:0/1702189463 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(112..112 src has 1..112) ==== 5849+0+0 (secure 0 0 0) 0x7f183809ae30 con 0x7f18400ce730 2024-09-17T05:51:15.821 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:15.820+0000 7f18460c7640 1 --2- 172.21.15.150:0/1702189463 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f182c07a570 0x7f182c07ca80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:51:15.821 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:15.820+0000 7f18460c7640 1 --2- 172.21.15.150:0/1702189463 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f182c07a570 0x7f182c07ca80 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7f1830033000 tx=0x7f18300019f0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:51:15.824 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:15.823+0000 7f183effd640 1 -- 172.21.15.150:0/1702189463 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f18400cef10 con 0x7f18400ce730 2024-09-17T05:51:16.000 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:15.999+0000 7f184832b640 1 -- 172.21.15.150:0/1702189463 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f184015ad80 con 0x7f18400ce730 2024-09-17T05:51:16.001 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:16.000+0000 7f183effd640 1 -- 172.21.15.150:0/1702189463 <== mon.0 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v112) ==== 74+0+16958 (secure 0 0 0) 0x7f1838064e50 con 0x7f18400ce730 2024-09-17T05:51:16.001 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-09-17T05:51:16.001 INFO:teuthology.orchestra.run.smithi150.stdout:{"epoch":112,"fsid":"9f2e05e9-d629-47b3-b26b-1360655b7d20","created":"2024-09-17T05:41:32.502979+0000","modified":"2024-09-17T05:51:14.699754+0000","last_up_change":"2024-09-17T05:41:46.150225+0000","last_in_change":"2024-09-17T05:41:36.120274+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":17,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T05:41:46.860779+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":16,"pool_name":"cephfs_metadata","create_time":"2024-09-17T05:51:12.343530+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"112","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":17,"pool_name":"cephfs_data","create_time":"2024-09-17T05:51:13.667025+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"112","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"4f31c018-c8a4-4d6d-b0c2-a597c47aae4a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6800","nonce":479374392},{"type":"v1","addr":"172.21.15.150:6801","nonce":479374392}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6802","nonce":479374392},{"type":"v1","addr":"172.21.15.150:6803","nonce":479374392}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6806","nonce":479374392},{"type":"v1","addr":"172.21.15.150:6807","nonce":479374392}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6804","nonce":479374392},{"type":"v1","addr":"172.21.15.150:6805","nonce":479374392}]},"public_addr":"172.21.15.150:6801/479374392","cluster_addr":"172.21.15.150:6803/479374392","heartbeat_back_addr":"172.21.15.150:6807/479374392","heartbeat_front_addr":"172.21.15.150:6805/479374392","state":["exists","up"]},{"osd":1,"uuid":"6ff4a573-500b-4e04-9de3-39265ead78b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6824","nonce":913899800},{"type":"v1","addr":"172.21.15.150:6825","nonce":913899800}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6826","nonce":913899800},{"type":"v1","addr":"172.21.15.150:6827","nonce":913899800}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6830","nonce":913899800},{"type":"v1","addr":"172.21.15.150:6831","nonce":913899800}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6828","nonce":913899800},{"type":"v1","addr":"172.21.15.150:6829","nonce":913899800}]},"public_addr":"172.21.15.150:6825/913899800","cluster_addr":"172.21.15.150:6827/913899800","heartbeat_back_addr":"172.21.15.150:6831/913899800","heartbeat_front_addr":"172.21.15.150:6829/913899800","state":["exists","up"]},{"osd":2,"uuid":"bffea6f9-2465-4182-b205-00436c41ac1c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6816","nonce":363718461},{"type":"v1","addr":"172.21.15.150:6817","nonce":363718461}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6818","nonce":363718461},{"type":"v1","addr":"172.21.15.150:6819","nonce":363718461}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6822","nonce":363718461},{"type":"v1","addr":"172.21.15.150:6823","nonce":363718461}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6820","nonce":363718461},{"type":"v1","addr":"172.21.15.150:6821","nonce":363718461}]},"public_addr":"172.21.15.150:6817/363718461","cluster_addr":"172.21.15.150:6819/363718461","heartbeat_back_addr":"172.21.15.150:6823/363718461","heartbeat_front_addr":"172.21.15.150:6821/363718461","state":["exists","up"]},{"osd":3,"uuid":"cda70430-d1e1-427e-b04e-56db4031d078","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6808","nonce":3550994626},{"type":"v1","addr":"172.21.15.150:6809","nonce":3550994626}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6810","nonce":3550994626},{"type":"v1","addr":"172.21.15.150:6811","nonce":3550994626}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6814","nonce":3550994626},{"type":"v1","addr":"172.21.15.150:6815","nonce":3550994626}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6812","nonce":3550994626},{"type":"v1","addr":"172.21.15.150:6813","nonce":3550994626}]},"public_addr":"172.21.15.150:6809/3550994626","cluster_addr":"172.21.15.150:6811/3550994626","heartbeat_back_addr":"172.21.15.150:6815/3550994626","heartbeat_front_addr":"172.21.15.150:6813/3550994626","state":["exists","up"]},{"osd":4,"uuid":"3a0277fb-5e1e-4f68-bb2d-9a8a0152f64a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6810","nonce":2718261497},{"type":"v1","addr":"172.21.15.176:6811","nonce":2718261497}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6812","nonce":2718261497},{"type":"v1","addr":"172.21.15.176:6813","nonce":2718261497}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6816","nonce":2718261497},{"type":"v1","addr":"172.21.15.176:6817","nonce":2718261497}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6814","nonce":2718261497},{"type":"v1","addr":"172.21.15.176:6815","nonce":2718261497}]},"public_addr":"172.21.15.176:6811/2718261497","cluster_addr":"172.21.15.176:6813/2718261497","heartbeat_back_addr":"172.21.15.176:6817/2718261497","heartbeat_front_addr":"172.21.15.176:6815/2718261497","state":["exists","up"]},{"osd":5,"uuid":"33aebee6-0315-40b7-a11c-6702f0be494d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6818","nonce":2049295774},{"type":"v1","addr":"172.21.15.176:6819","nonce":2049295774}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6820","nonce":2049295774},{"type":"v1","addr":"172.21.15.176:6821","nonce":2049295774}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6824","nonce":2049295774},{"type":"v1","addr":"172.21.15.176:6825","nonce":2049295774}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6822","nonce":2049295774},{"type":"v1","addr":"172.21.15.176:6823","nonce":2049295774}]},"public_addr":"172.21.15.176:6819/2049295774","cluster_addr":"172.21.15.176:6821/2049295774","heartbeat_back_addr":"172.21.15.176:6825/2049295774","heartbeat_front_addr":"172.21.15.176:6823/2049295774","state":["exists","up"]},{"osd":6,"uuid":"4d24f360-6751-4263-841b-d77793d33540","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6826","nonce":2164458476},{"type":"v1","addr":"172.21.15.176:6827","nonce":2164458476}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6828","nonce":2164458476},{"type":"v1","addr":"172.21.15.176:6829","nonce":2164458476}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6832","nonce":2164458476},{"type":"v1","addr":"172.21.15.176:6833","nonce":2164458476}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6830","nonce":2164458476},{"type":"v1","addr":"172.21.15.176:6831","nonce":2164458476}]},"public_addr":"172.21.15.176:6827/2164458476","cluster_addr":"172.21.15.176:6829/2164458476","heartbeat_back_addr":"172.21.15.176:6833/2164458476","heartbeat_front_addr":"172.21.15.176:6831/2164458476","state":["exists","up"]},{"osd":7,"uuid":"c8594fda-c74a-4ba9-8277-caf101d58ca1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6802","nonce":3239587708},{"type":"v1","addr":"172.21.15.176:6803","nonce":3239587708}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6804","nonce":3239587708},{"type":"v1","addr":"172.21.15.176:6805","nonce":3239587708}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6808","nonce":3239587708},{"type":"v1","addr":"172.21.15.176:6809","nonce":3239587708}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6806","nonce":3239587708},{"type":"v1","addr":"172.21.15.176:6807","nonce":3239587708}]},"public_addr":"172.21.15.176:6803/3239587708","cluster_addr":"172.21.15.176:6805/3239587708","heartbeat_back_addr":"172.21.15.176:6809/3239587708","heartbeat_front_addr":"172.21.15.176:6807/3239587708","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:41:41.905151+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:41:42.705679+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:41:42.459673+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:41:42.440819+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:41:42.668428+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:41:42.694972+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:41:43.078535+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:41:42.363539+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":7,"snaps":[{"begin":2,"length":2}]},{"pool":9,"snaps":[{"begin":2,"length":2}]},{"pool":11,"snaps":[{"begin":2,"length":2}]},{"pool":13,"snaps":[{"begin":2,"length":2}]},{"pool":15,"snaps":[{"begin":2,"length":2}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T05:51:16.003 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:16.002+0000 7f184832b640 1 -- 172.21.15.150:0/1702189463 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f182c07a570 msgr2=0x7f182c07ca80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:51:16.003 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:16.002+0000 7f184832b640 1 --2- 172.21.15.150:0/1702189463 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f182c07a570 0x7f182c07ca80 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7f1830033000 tx=0x7f18300019f0 comp rx=0 tx=0).stop 2024-09-17T05:51:16.003 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:16.002+0000 7f184832b640 1 -- 172.21.15.150:0/1702189463 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f18400ce730 msgr2=0x7f18401f9750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:51:16.004 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:16.002+0000 7f184832b640 1 --2- 172.21.15.150:0/1702189463 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f18400ce730 0x7f18401f9750 secure :-1 s=READY pgs=1483 cs=0 l=1 rev1=1 crypto rx=0x7f184008d0c0 tx=0x7f1838001a90 comp rx=0 tx=0).stop 2024-09-17T05:51:16.004 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:16.002+0000 7f184832b640 1 -- 172.21.15.150:0/1702189463 shutdown_connections 2024-09-17T05:51:16.004 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:16.002+0000 7f184832b640 1 --2- 172.21.15.150:0/1702189463 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f182c07a570 0x7f182c07ca80 unknown :-1 s=CLOSED pgs=634 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:51:16.004 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:16.002+0000 7f184832b640 1 --2- 172.21.15.150:0/1702189463 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f18400ce730 0x7f18401f9750 unknown :-1 s=CLOSED pgs=1483 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:51:16.004 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:16.002+0000 7f184832b640 1 --2- 172.21.15.150:0/1702189463 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f18400ce320 0x7f18401f9210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:51:16.004 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:16.002+0000 7f184832b640 1 --2- 172.21.15.150:0/1702189463 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f18280039e0 0x7f184015a7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:51:16.004 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:16.002+0000 7f184832b640 1 -- 172.21.15.150:0/1702189463 >> 172.21.15.150:0/1702189463 conn(0x7f184008bfe0 msgr2=0x7f184006deb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:51:16.004 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:16.002+0000 7f184832b640 1 -- 172.21.15.150:0/1702189463 shutdown_connections 2024-09-17T05:51:16.004 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:16.002+0000 7f184832b640 1 -- 172.21.15.150:0/1702189463 wait complete. 2024-09-17T05:51:16.015 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-09-17T05:51:16.131 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:16.130+0000 7f25544d5640 1 -- 172.21.15.150:0/960705884 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f254c0cbcc0 msgr2=0x7f254c0cc0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:51:16.132 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:16.130+0000 7f25544d5640 1 --2- 172.21.15.150:0/960705884 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f254c0cbcc0 0x7f254c0cc0d0 secure :-1 s=READY pgs=1484 cs=0 l=1 rev1=1 crypto rx=0x7f254c0cb9f0 tx=0x7f254002a560 comp rx=0 tx=0).stop 2024-09-17T05:51:16.132 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:16.130+0000 7f25544d5640 1 -- 172.21.15.150:0/960705884 shutdown_connections 2024-09-17T05:51:16.132 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:16.130+0000 7f25544d5640 1 --2- 172.21.15.150:0/960705884 >> v2:172.21.15.176:3300/0 conn(0x7f254c0cc610 0x7f254c0cdbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:51:16.132 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:16.130+0000 7f25544d5640 1 --2- 172.21.15.150:0/960705884 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f254c0cbcc0 0x7f254c0cc0d0 unknown :-1 s=CLOSED pgs=1484 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:51:16.132 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:16.130+0000 7f25544d5640 1 --2- 172.21.15.150:0/960705884 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f254c0b6300 0x7f254c0b6710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:51:16.132 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:16.130+0000 7f25544d5640 1 -- 172.21.15.150:0/960705884 >> 172.21.15.150:0/960705884 conn(0x7f254c0b2ff0 msgr2=0x7f254c0b3400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:51:16.132 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:16.130+0000 7f25544d5640 1 -- 172.21.15.150:0/960705884 shutdown_connections 2024-09-17T05:51:16.132 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:16.131+0000 7f25544d5640 1 -- 172.21.15.150:0/960705884 wait complete. 2024-09-17T05:51:16.133 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:16.132+0000 7f25544d5640 1 Processor -- start 2024-09-17T05:51:16.133 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:16.132+0000 7f25544d5640 1 -- start start 2024-09-17T05:51:16.135 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:16.133+0000 7f25544d5640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f254c0b6300 0x7f254c14c160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:51:16.136 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:16.133+0000 7f25544d5640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f254c0cbcc0 0x7f254c0c4df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:51:16.136 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:16.133+0000 7f25544d5640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f254c0cc610 0x7f254c06cda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:51:16.136 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:16.133+0000 7f25544d5640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f254c0ce5b0 con 0x7f254c0cbcc0 2024-09-17T05:51:16.136 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:16.133+0000 7f25544d5640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f254c0ce430 con 0x7f254c0b6300 2024-09-17T05:51:16.136 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:16.133+0000 7f25544d5640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f254c0ce730 con 0x7f254c0cc610 2024-09-17T05:51:16.136 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:16.134+0000 7f2551a70640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f254c0cbcc0 0x7f254c0c4df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:51:16.136 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:16.134+0000 7f2551a70640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f254c0cbcc0 0x7f254c0c4df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:50274/0 (socket says 172.21.15.150:50274) 2024-09-17T05:51:16.136 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:16.134+0000 7f2551a70640 1 -- 172.21.15.150:0/3608640946 learned_addr learned my addr 172.21.15.150:0/3608640946 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:51:16.136 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:16.134+0000 7f2552a72640 1 --2- 172.21.15.150:0/3608640946 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f254c0cc610 0x7f254c06cda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:51:16.136 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:16.134+0000 7f2552271640 1 --2- 172.21.15.150:0/3608640946 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f254c0b6300 0x7f254c14c160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:51:16.136 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:16.134+0000 7f2551a70640 1 -- 172.21.15.150:0/3608640946 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f254c0cc610 msgr2=0x7f254c06cda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:51:16.136 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:16.134+0000 7f2551a70640 1 --2- 172.21.15.150:0/3608640946 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f254c0cc610 0x7f254c06cda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:51:16.137 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:16.134+0000 7f2551a70640 1 -- 172.21.15.150:0/3608640946 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f254c0b6300 msgr2=0x7f254c14c160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:51:16.137 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:16.134+0000 7f2551a70640 1 --2- 172.21.15.150:0/3608640946 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f254c0b6300 0x7f254c14c160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:51:16.137 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:16.134+0000 7f2551a70640 1 -- 172.21.15.150:0/3608640946 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f254c1f6d80 con 0x7f254c0cbcc0 2024-09-17T05:51:16.137 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:16.134+0000 7f2552271640 1 --2- 172.21.15.150:0/3608640946 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f254c0b6300 0x7f254c14c160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:51:16.137 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:16.134+0000 7f2551a70640 1 --2- 172.21.15.150:0/3608640946 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f254c0cbcc0 0x7f254c0c4df0 secure :-1 s=READY pgs=1485 cs=0 l=1 rev1=1 crypto rx=0x7f2540034040 tx=0x7f2540003910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:51:16.137 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:16.134+0000 7f254affd640 1 -- 172.21.15.150:0/3608640946 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f254003e030 con 0x7f254c0cbcc0 2024-09-17T05:51:16.137 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:16.134+0000 7f254affd640 1 -- 172.21.15.150:0/3608640946 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f2540003e00 con 0x7f254c0cbcc0 2024-09-17T05:51:16.137 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:16.134+0000 7f25544d5640 1 -- 172.21.15.150:0/3608640946 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f254c1f3760 con 0x7f254c0cbcc0 2024-09-17T05:51:16.137 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:16.134+0000 7f254affd640 1 -- 172.21.15.150:0/3608640946 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2540035040 con 0x7f254c0cbcc0 2024-09-17T05:51:16.137 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:16.134+0000 7f25544d5640 1 -- 172.21.15.150:0/3608640946 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f254c1f7560 con 0x7f254c0cbcc0 2024-09-17T05:51:16.138 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:16.135+0000 7f25544d5640 1 -- 172.21.15.150:0/3608640946 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f254c1f6ff0 con 0x7f254c0cbcc0 2024-09-17T05:51:16.138 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:16.136+0000 7f254affd640 1 -- 172.21.15.150:0/3608640946 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 37) ==== 103787+0+0 (secure 0 0 0) 0x7f2540041030 con 0x7f254c0cbcc0 2024-09-17T05:51:16.138 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:16.137+0000 7f254affd640 1 --2- 172.21.15.150:0/3608640946 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f253807a570 0x7f253807ca80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:51:16.138 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:16.137+0000 7f254affd640 1 -- 172.21.15.150:0/3608640946 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(112..112 src has 1..112) ==== 5849+0+0 (secure 0 0 0) 0x7f25400ba760 con 0x7f254c0cbcc0 2024-09-17T05:51:16.139 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:16.137+0000 7f2552271640 1 --2- 172.21.15.150:0/3608640946 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f253807a570 0x7f253807ca80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:51:16.139 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:16.138+0000 7f2552271640 1 --2- 172.21.15.150:0/3608640946 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f253807a570 0x7f253807ca80 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7f254c0735d0 tx=0x7f253c009420 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:51:16.141 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:16.141+0000 7f254affd640 1 -- 172.21.15.150:0/3608640946 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f2540084130 con 0x7f254c0cbcc0 2024-09-17T05:51:16.359 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:16.358+0000 7f25544d5640 1 -- 172.21.15.150:0/3608640946 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7f254c0cebe0 con 0x7f254c0cbcc0 2024-09-17T05:51:17.321 INFO:tasks.ceph.mds.c.smithi150.stderr:2024-09-17T05:51:17.320+0000 7f0b35047640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-17T05:51:17.358 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:17.358+0000 7f254affd640 1 -- 172.21.15.150:0/3608640946 <== mon.0 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v69) ==== 118+0+0 (secure 0 0 0) 0x7f2540088b60 con 0x7f254c0cbcc0 2024-09-17T05:51:17.362 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:17.361+0000 7f25544d5640 1 -- 172.21.15.150:0/3608640946 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f253807a570 msgr2=0x7f253807ca80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:51:17.362 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:17.361+0000 7f25544d5640 1 --2- 172.21.15.150:0/3608640946 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f253807a570 0x7f253807ca80 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7f254c0735d0 tx=0x7f253c009420 comp rx=0 tx=0).stop 2024-09-17T05:51:17.362 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:17.361+0000 7f25544d5640 1 -- 172.21.15.150:0/3608640946 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f254c0cbcc0 msgr2=0x7f254c0c4df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:51:17.362 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:17.361+0000 7f25544d5640 1 --2- 172.21.15.150:0/3608640946 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f254c0cbcc0 0x7f254c0c4df0 secure :-1 s=READY pgs=1485 cs=0 l=1 rev1=1 crypto rx=0x7f2540034040 tx=0x7f2540003910 comp rx=0 tx=0).stop 2024-09-17T05:51:17.362 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:17.361+0000 7f25544d5640 1 -- 172.21.15.150:0/3608640946 shutdown_connections 2024-09-17T05:51:17.362 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:17.361+0000 7f25544d5640 1 --2- 172.21.15.150:0/3608640946 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f253807a570 0x7f253807ca80 unknown :-1 s=CLOSED pgs=635 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:51:17.362 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:17.361+0000 7f25544d5640 1 --2- 172.21.15.150:0/3608640946 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f254c0cc610 0x7f254c06cda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:51:17.362 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:17.361+0000 7f25544d5640 1 --2- 172.21.15.150:0/3608640946 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f254c0cbcc0 0x7f254c0c4df0 unknown :-1 s=CLOSED pgs=1485 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:51:17.362 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:17.361+0000 7f25544d5640 1 --2- 172.21.15.150:0/3608640946 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f254c0b6300 0x7f254c14c160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:51:17.362 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:17.361+0000 7f25544d5640 1 -- 172.21.15.150:0/3608640946 >> 172.21.15.150:0/3608640946 conn(0x7f254c0b2ff0 msgr2=0x7f254c0b4d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:51:17.363 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:17.361+0000 7f25544d5640 1 -- 172.21.15.150:0/3608640946 shutdown_connections 2024-09-17T05:51:17.363 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:17.361+0000 7f25544d5640 1 -- 172.21.15.150:0/3608640946 wait complete. 2024-09-17T05:51:17.376 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-09-17T05:51:17.376 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-09-17T05:51:17.499 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:17.498+0000 7ff2fd264640 1 -- 172.21.15.150:0/2595873155 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff2f809af90 msgr2=0x7ff2f80ccce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:51:17.499 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:17.498+0000 7ff2fd264640 1 --2- 172.21.15.150:0/2595873155 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff2f809af90 0x7ff2f80ccce0 secure :-1 s=READY pgs=1486 cs=0 l=1 rev1=1 crypto rx=0x7ff2e0005fd0 tx=0x7ff2e002a4f0 comp rx=0 tx=0).stop 2024-09-17T05:51:17.499 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:17.498+0000 7ff2fd264640 1 -- 172.21.15.150:0/2595873155 shutdown_connections 2024-09-17T05:51:17.499 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:17.498+0000 7ff2fd264640 1 --2- 172.21.15.150:0/2595873155 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff2f80cd220 0x7ff2f80cd630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:51:17.499 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:17.498+0000 7ff2fd264640 1 --2- 172.21.15.150:0/2595873155 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff2f809af90 0x7ff2f80ccce0 unknown :-1 s=CLOSED pgs=1486 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:51:17.499 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:17.498+0000 7ff2fd264640 1 --2- 172.21.15.150:0/2595873155 >> v2:172.21.15.176:3300/0 conn(0x7ff2f80ce800 0x7ff2f809aa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:51:17.499 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:17.498+0000 7ff2fd264640 1 -- 172.21.15.150:0/2595873155 >> 172.21.15.150:0/2595873155 conn(0x7ff2f80d2550 msgr2=0x7ff2f80d2960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:51:17.499 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:17.498+0000 7ff2fd264640 1 -- 172.21.15.150:0/2595873155 shutdown_connections 2024-09-17T05:51:17.500 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:17.498+0000 7ff2fd264640 1 -- 172.21.15.150:0/2595873155 wait complete. 2024-09-17T05:51:17.500 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:17.500+0000 7ff2fd264640 1 Processor -- start 2024-09-17T05:51:17.500 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:17.500+0000 7ff2fd264640 1 -- start start 2024-09-17T05:51:17.504 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:17.501+0000 7ff2fd264640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff2f809af90 0x7ff2f81e8640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:51:17.504 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:17.501+0000 7ff2fd264640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff2f80cd220 0x7ff2f80c8620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:51:17.504 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:17.501+0000 7ff2fd264640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff2f80ce800 0x7ff2f81f73e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:51:17.504 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:17.501+0000 7ff2fd264640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7ff2f80cec10 con 0x7ff2f80ce800 2024-09-17T05:51:17.504 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:17.501+0000 7ff2fd264640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7ff2f80b7630 con 0x7ff2f80cd220 2024-09-17T05:51:17.504 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:17.501+0000 7ff2fd264640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7ff2f80ced90 con 0x7ff2f809af90 2024-09-17T05:51:17.505 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:17.501+0000 7ff2f77fe640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff2f80ce800 0x7ff2f81f73e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:51:17.505 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:17.501+0000 7ff2f6ffd640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff2f809af90 0x7ff2f81e8640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:51:17.505 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:17.501+0000 7ff2ee7fc640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff2f80cd220 0x7ff2f80c8620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:51:17.505 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:17.501+0000 7ff2f77fe640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff2f80ce800 0x7ff2f81f73e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:50290/0 (socket says 172.21.15.150:50290) 2024-09-17T05:51:17.505 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:17.501+0000 7ff2f77fe640 1 -- 172.21.15.150:0/2946294264 learned_addr learned my addr 172.21.15.150:0/2946294264 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:51:17.505 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:17.502+0000 7ff2f77fe640 1 -- 172.21.15.150:0/2946294264 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff2f809af90 msgr2=0x7ff2f81e8640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:51:17.505 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:17.502+0000 7ff2f77fe640 1 --2- 172.21.15.150:0/2946294264 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff2f809af90 0x7ff2f81e8640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:51:17.505 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:17.502+0000 7ff2f77fe640 1 -- 172.21.15.150:0/2946294264 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff2f80cd220 msgr2=0x7ff2f80c8620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:51:17.505 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:17.502+0000 7ff2f77fe640 1 --2- 172.21.15.150:0/2946294264 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff2f80cd220 0x7ff2f80c8620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:51:17.505 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:17.502+0000 7ff2f77fe640 1 -- 172.21.15.150:0/2946294264 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff2f81e8b80 con 0x7ff2f80ce800 2024-09-17T05:51:17.505 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:17.502+0000 7ff2f77fe640 1 --2- 172.21.15.150:0/2946294264 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff2f80ce800 0x7ff2f81f73e0 secure :-1 s=READY pgs=1487 cs=0 l=1 rev1=1 crypto rx=0x7ff2f000ba10 tx=0x7ff2f000bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:51:17.505 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:17.502+0000 7ff2effff640 1 -- 172.21.15.150:0/2946294264 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2f0019070 con 0x7ff2f80ce800 2024-09-17T05:51:17.505 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:17.502+0000 7ff2effff640 1 -- 172.21.15.150:0/2946294264 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff2f000cc50 con 0x7ff2f80ce800 2024-09-17T05:51:17.506 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:17.502+0000 7ff2fd264640 1 -- 172.21.15.150:0/2946294264 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff2f80c8b60 con 0x7ff2f80ce800 2024-09-17T05:51:17.506 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:17.502+0000 7ff2effff640 1 -- 172.21.15.150:0/2946294264 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2f00146a0 con 0x7ff2f80ce800 2024-09-17T05:51:17.506 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:17.502+0000 7ff2fd264640 1 -- 172.21.15.150:0/2946294264 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff2f80ca130 con 0x7ff2f80ce800 2024-09-17T05:51:17.506 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:17.503+0000 7ff2fd264640 1 -- 172.21.15.150:0/2946294264 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff2f80cd630 con 0x7ff2f80ce800 2024-09-17T05:51:17.507 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:17.504+0000 7ff2effff640 1 -- 172.21.15.150:0/2946294264 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 37) ==== 103787+0+0 (secure 0 0 0) 0x7ff2f001c070 con 0x7ff2f80ce800 2024-09-17T05:51:17.507 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:17.504+0000 7ff2effff640 1 --2- 172.21.15.150:0/2946294264 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7ff2d807a570 0x7ff2d807ca80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:51:17.507 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:17.505+0000 7ff2effff640 1 -- 172.21.15.150:0/2946294264 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(113..113 src has 1..113) ==== 5849+0+0 (secure 0 0 0) 0x7ff2f0099810 con 0x7ff2f80ce800 2024-09-17T05:51:17.507 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:17.505+0000 7ff2f6ffd640 1 --2- 172.21.15.150:0/2946294264 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7ff2d807a570 0x7ff2d807ca80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:51:17.507 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:17.505+0000 7ff2f6ffd640 1 --2- 172.21.15.150:0/2946294264 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7ff2d807a570 0x7ff2d807ca80 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7ff2e80098e0 tx=0x7ff2e8009060 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:51:17.510 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:17.509+0000 7ff2effff640 1 -- 172.21.15.150:0/2946294264 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7ff2f0063190 con 0x7ff2f80ce800 2024-09-17T05:51:17.723 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:17.723+0000 7ff2fd264640 1 -- 172.21.15.150:0/2946294264 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7ff2f80d04e0 con 0x7ff2f80ce800 2024-09-17T05:51:18.365 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:18.365+0000 7ff2effff640 1 -- 172.21.15.150:0/2946294264 <== mon.0 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v70) ==== 122+0+0 (secure 0 0 0) 0x7ff2f0067bc0 con 0x7ff2f80ce800 2024-09-17T05:51:18.368 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:18.367+0000 7ff2fd264640 1 -- 172.21.15.150:0/2946294264 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7ff2d807a570 msgr2=0x7ff2d807ca80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:51:18.368 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:18.367+0000 7ff2fd264640 1 --2- 172.21.15.150:0/2946294264 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7ff2d807a570 0x7ff2d807ca80 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7ff2e80098e0 tx=0x7ff2e8009060 comp rx=0 tx=0).stop 2024-09-17T05:51:18.368 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:18.367+0000 7ff2fd264640 1 -- 172.21.15.150:0/2946294264 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff2f80ce800 msgr2=0x7ff2f81f73e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:51:18.369 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:18.367+0000 7ff2fd264640 1 --2- 172.21.15.150:0/2946294264 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff2f80ce800 0x7ff2f81f73e0 secure :-1 s=READY pgs=1487 cs=0 l=1 rev1=1 crypto rx=0x7ff2f000ba10 tx=0x7ff2f000bed0 comp rx=0 tx=0).stop 2024-09-17T05:51:18.369 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:18.367+0000 7ff2fd264640 1 -- 172.21.15.150:0/2946294264 shutdown_connections 2024-09-17T05:51:18.369 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:18.367+0000 7ff2fd264640 1 --2- 172.21.15.150:0/2946294264 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff2f80cd220 0x7ff2f80c8620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:51:18.369 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:18.367+0000 7ff2fd264640 1 --2- 172.21.15.150:0/2946294264 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7ff2d807a570 0x7ff2d807ca80 unknown :-1 s=CLOSED pgs=636 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:51:18.369 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:18.367+0000 7ff2fd264640 1 --2- 172.21.15.150:0/2946294264 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff2f80ce800 0x7ff2f81f73e0 unknown :-1 s=CLOSED pgs=1487 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:51:18.369 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:18.367+0000 7ff2fd264640 1 --2- 172.21.15.150:0/2946294264 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff2f809af90 0x7ff2f81e8640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:51:18.369 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:18.367+0000 7ff2fd264640 1 -- 172.21.15.150:0/2946294264 >> 172.21.15.150:0/2946294264 conn(0x7ff2f80d2550 msgr2=0x7ff2f81e5390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:51:18.369 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:18.367+0000 7ff2fd264640 1 -- 172.21.15.150:0/2946294264 shutdown_connections 2024-09-17T05:51:18.369 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:18.367+0000 7ff2fd264640 1 -- 172.21.15.150:0/2946294264 wait complete. 2024-09-17T05:51:18.380 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-09-17T05:51:18.380 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T05:51:18.495 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:18.494+0000 7f943487f640 1 -- 172.21.15.150:0/3910967139 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f94180050e0 msgr2=0x7f9418005910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:51:18.495 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:18.494+0000 7f943487f640 1 --2- 172.21.15.150:0/3910967139 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f94180050e0 0x7f9418005910 secure :-1 s=READY pgs=1489 cs=0 l=1 rev1=1 crypto rx=0x7f9430071180 tx=0x7f9418006940 comp rx=0 tx=0).stop 2024-09-17T05:51:18.495 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:18.494+0000 7f942ed9d640 1 -- 172.21.15.150:0/3910967139 reap_dead start 2024-09-17T05:51:18.495 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:18.494+0000 7f943487f640 1 -- 172.21.15.150:0/3910967139 shutdown_connections 2024-09-17T05:51:18.495 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:18.494+0000 7f943487f640 1 -- 172.21.15.150:0/3910967139 >> 172.21.15.150:0/3910967139 conn(0x7f943006d730 msgr2=0x7f94300b1e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:51:18.496 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:18.494+0000 7f943487f640 1 -- 172.21.15.150:0/3910967139 shutdown_connections 2024-09-17T05:51:18.496 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:18.494+0000 7f943487f640 1 -- 172.21.15.150:0/3910967139 wait complete. 2024-09-17T05:51:18.496 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:18.496+0000 7f943487f640 1 Processor -- start 2024-09-17T05:51:18.497 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:18.496+0000 7f943487f640 1 -- start start 2024-09-17T05:51:18.499 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:18.497+0000 7f943487f640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f94180050e0 0x7f9430150c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:51:18.499 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:18.497+0000 7f943487f640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f943015dfd0 0x7f94301f4020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:51:18.499 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:18.497+0000 7f943487f640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f943014c180 0x7f943014c590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:51:18.499 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:18.497+0000 7f943487f640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f943015b380 con 0x7f94180050e0 2024-09-17T05:51:18.499 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:18.497+0000 7f943487f640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f943015b200 con 0x7f943015dfd0 2024-09-17T05:51:18.499 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:18.497+0000 7f943487f640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f943015f130 con 0x7f943014c180 2024-09-17T05:51:18.500 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:18.497+0000 7f942e59c640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f94180050e0 0x7f9430150c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:51:18.500 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:18.497+0000 7f942e59c640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f94180050e0 0x7f9430150c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:50312/0 (socket says 172.21.15.150:50312) 2024-09-17T05:51:18.500 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:18.497+0000 7f942e59c640 1 -- 172.21.15.150:0/4013743685 learned_addr learned my addr 172.21.15.150:0/4013743685 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:51:18.500 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:18.497+0000 7f942dd9b640 1 --2- 172.21.15.150:0/4013743685 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f943015dfd0 0x7f94301f4020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:51:18.500 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:18.498+0000 7f942ed9d640 1 --2- 172.21.15.150:0/4013743685 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f943014c180 0x7f943014c590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:51:18.500 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:18.498+0000 7f942e59c640 1 -- 172.21.15.150:0/4013743685 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f943014c180 msgr2=0x7f943014c590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:51:18.500 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:18.498+0000 7f942e59c640 1 --2- 172.21.15.150:0/4013743685 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f943014c180 0x7f943014c590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:51:18.500 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:18.498+0000 7f942e59c640 1 -- 172.21.15.150:0/4013743685 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f943015dfd0 msgr2=0x7f94301f4020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:51:18.500 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:18.498+0000 7f942e59c640 1 --2- 172.21.15.150:0/4013743685 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f943015dfd0 0x7f94301f4020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:51:18.500 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:18.498+0000 7f942e59c640 1 -- 172.21.15.150:0/4013743685 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f943014cad0 con 0x7f94180050e0 2024-09-17T05:51:18.500 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:18.498+0000 7f942e59c640 1 --2- 172.21.15.150:0/4013743685 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f94180050e0 0x7f9430150c90 secure :-1 s=READY pgs=1490 cs=0 l=1 rev1=1 crypto rx=0x7f9420011830 tx=0x7f9420011cf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:51:18.500 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:18.498+0000 7f941effd640 1 -- 172.21.15.150:0/4013743685 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9420004460 con 0x7f94180050e0 2024-09-17T05:51:18.501 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:18.498+0000 7f941effd640 1 -- 172.21.15.150:0/4013743685 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9420016070 con 0x7f94180050e0 2024-09-17T05:51:18.501 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:18.498+0000 7f943487f640 1 -- 172.21.15.150:0/4013743685 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f94301f49d0 con 0x7f94180050e0 2024-09-17T05:51:18.501 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:18.498+0000 7f941effd640 1 -- 172.21.15.150:0/4013743685 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f942000fb80 con 0x7f94180050e0 2024-09-17T05:51:18.501 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:18.498+0000 7f943487f640 1 -- 172.21.15.150:0/4013743685 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f94301f4f90 con 0x7f94180050e0 2024-09-17T05:51:18.501 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:18.499+0000 7f943487f640 1 -- 172.21.15.150:0/4013743685 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f94300b2b10 con 0x7f94180050e0 2024-09-17T05:51:18.502 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:18.500+0000 7f941effd640 1 -- 172.21.15.150:0/4013743685 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 37) ==== 103787+0+0 (secure 0 0 0) 0x7f9420018030 con 0x7f94180050e0 2024-09-17T05:51:18.502 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:18.501+0000 7f941effd640 1 --2- 172.21.15.150:0/4013743685 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f941007a5a0 0x7f941007cab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:51:18.502 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:18.501+0000 7f941effd640 1 -- 172.21.15.150:0/4013743685 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(113..113 src has 1..113) ==== 5849+0+0 (secure 0 0 0) 0x7f942009ab00 con 0x7f94180050e0 2024-09-17T05:51:18.502 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:18.501+0000 7f942dd9b640 1 --2- 172.21.15.150:0/4013743685 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f941007a5a0 0x7f941007cab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:51:18.502 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:18.502+0000 7f942dd9b640 1 --2- 172.21.15.150:0/4013743685 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f941007a5a0 0x7f941007cab0 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7f9424033000 tx=0x7f9424038040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:51:18.505 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:18.504+0000 7f941effd640 1 -- 172.21.15.150:0/4013743685 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f943014cad0 con 0x7f94180050e0 2024-09-17T05:51:18.713 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:18.712+0000 7f943487f640 1 -- 172.21.15.150:0/4013743685 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f943015f690 con 0x7f94180050e0 2024-09-17T05:51:18.713 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:18.713+0000 7f941effd640 1 -- 172.21.15.150:0/4013743685 <== mon.0 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 70 v70) ==== 94+0+5237 (secure 0 0 0) 0x7f94200643d0 con 0x7f94180050e0 2024-09-17T05:51:18.714 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-09-17T05:51:18.714 INFO:teuthology.orchestra.run.smithi150.stdout:{"epoch":70,"btime":"2024-09-17T05:51:18:358727+0000","default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6779,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6836/2908904841","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6835","nonce":2908904841},{"type":"v1","addr":"172.21.15.176:6836","nonce":2908904841}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":65},{"gid":6782,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6837/2764909757","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6834","nonce":2764909757},{"type":"v1","addr":"172.21.15.176:6837","nonce":2764909757}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":65},{"gid":8568,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6834/1970670297","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6832","nonce":1970670297},{"type":"v1","addr":"172.21.15.150:6834","nonce":1970670297}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":64}],"filesystems":[{"mdsmap":{"epoch":70,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T05:51:14.699714+0000","modified":"2024-09-17T05:51:17.724183+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":8571},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8571":{"gid":8571,"name":"c","rank":0,"incarnation":66,"state":"up:active","state_seq":3,"addr":"172.21.15.150:6835/4047640601","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6833","nonce":4047640601},{"type":"v1","addr":"172.21.15.150:6835","nonce":4047640601}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":8571,"qdb_cluster":[8571]},"id":8}]} 2024-09-17T05:51:18.714 INFO:teuthology.orchestra.run.smithi150.stderr:dumped fsmap epoch 70 2024-09-17T05:51:18.717 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:18.715+0000 7f943487f640 1 -- 172.21.15.150:0/4013743685 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f941007a5a0 msgr2=0x7f941007cab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:51:18.717 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:18.715+0000 7f943487f640 1 --2- 172.21.15.150:0/4013743685 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f941007a5a0 0x7f941007cab0 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7f9424033000 tx=0x7f9424038040 comp rx=0 tx=0).stop 2024-09-17T05:51:18.717 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:18.715+0000 7f943487f640 1 -- 172.21.15.150:0/4013743685 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f94180050e0 msgr2=0x7f9430150c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:51:18.717 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:18.715+0000 7f943487f640 1 --2- 172.21.15.150:0/4013743685 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f94180050e0 0x7f9430150c90 secure :-1 s=READY pgs=1490 cs=0 l=1 rev1=1 crypto rx=0x7f9420011830 tx=0x7f9420011cf0 comp rx=0 tx=0).stop 2024-09-17T05:51:18.717 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:18.715+0000 7f943487f640 1 -- 172.21.15.150:0/4013743685 shutdown_connections 2024-09-17T05:51:18.717 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:18.715+0000 7f943487f640 1 --2- 172.21.15.150:0/4013743685 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f943015dfd0 0x7f94301f4020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:51:18.717 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:18.715+0000 7f943487f640 1 --2- 172.21.15.150:0/4013743685 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f941007a5a0 0x7f941007cab0 unknown :-1 s=CLOSED pgs=637 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:51:18.717 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:18.715+0000 7f943487f640 1 --2- 172.21.15.150:0/4013743685 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f943014c180 0x7f943014c590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:51:18.717 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:18.715+0000 7f943487f640 1 --2- 172.21.15.150:0/4013743685 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f94180050e0 0x7f9430150c90 unknown :-1 s=CLOSED pgs=1490 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:51:18.717 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:18.715+0000 7f943487f640 1 -- 172.21.15.150:0/4013743685 >> 172.21.15.150:0/4013743685 conn(0x7f943006d730 msgr2=0x7f94300af0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:51:18.717 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:18.715+0000 7f943487f640 1 -- 172.21.15.150:0/4013743685 shutdown_connections 2024-09-17T05:51:18.718 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:18.715+0000 7f943487f640 1 -- 172.21.15.150:0/4013743685 wait complete. 2024-09-17T05:51:18.728 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T05:51:18.841 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:18.840+0000 7fa539230640 1 -- 172.21.15.150:0/2087961994 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa5340d4f90 msgr2=0x7fa5340d0400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:51:18.841 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:18.840+0000 7fa539230640 1 --2- 172.21.15.150:0/2087961994 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa5340d4f90 0x7fa5340d0400 secure :-1 s=READY pgs=1491 cs=0 l=1 rev1=1 crypto rx=0x7fa53408d3a0 tx=0x7fa52c02aac0 comp rx=0 tx=0).stop 2024-09-17T05:51:18.841 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:18.840+0000 7fa539230640 1 -- 172.21.15.150:0/2087961994 shutdown_connections 2024-09-17T05:51:18.841 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:18.840+0000 7fa539230640 1 --2- 172.21.15.150:0/2087961994 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa5340d4f90 0x7fa5340d0400 unknown :-1 s=CLOSED pgs=1491 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:51:18.841 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:18.840+0000 7fa539230640 1 --2- 172.21.15.150:0/2087961994 >> v2:172.21.15.176:3300/0 conn(0x7fa5340d1790 0x7fa5340d2780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:51:18.841 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:18.840+0000 7fa539230640 1 -- 172.21.15.150:0/2087961994 >> 172.21.15.150:0/2087961994 conn(0x7fa53408bfe0 msgr2=0x7fa5340d4670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:51:18.841 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:18.840+0000 7fa539230640 1 -- 172.21.15.150:0/2087961994 shutdown_connections 2024-09-17T05:51:18.841 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:18.840+0000 7fa539230640 1 -- 172.21.15.150:0/2087961994 wait complete. 2024-09-17T05:51:18.842 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:18.842+0000 7fa539230640 1 Processor -- start 2024-09-17T05:51:18.842 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:18.842+0000 7fa539230640 1 -- start start 2024-09-17T05:51:18.845 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:18.843+0000 7fa539230640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa5340b5d50 0x7fa5341f6860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:51:18.845 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:18.843+0000 7fa539230640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa5340d4f90 0x7fa5340ce4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:51:18.846 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:18.843+0000 7fa539230640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa534159ea0 0x7fa53415a2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:51:18.846 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:18.843+0000 7fa539230640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7fa5340b7a10 con 0x7fa5340b5d50 2024-09-17T05:51:18.846 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:18.843+0000 7fa539230640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fa5340b7890 con 0x7fa5340d4f90 2024-09-17T05:51:18.846 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:18.843+0000 7fa539230640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fa5340b7b90 con 0x7fa534159ea0 2024-09-17T05:51:18.846 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:18.843+0000 7fa532d9d640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa5340b5d50 0x7fa5341f6860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:51:18.846 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:18.843+0000 7fa532d9d640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa5340b5d50 0x7fa5341f6860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:50332/0 (socket says 172.21.15.150:50332) 2024-09-17T05:51:18.846 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:18.843+0000 7fa532d9d640 1 -- 172.21.15.150:0/2019790130 learned_addr learned my addr 172.21.15.150:0/2019790130 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:51:18.847 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:18.843+0000 7fa52a59c640 1 --2- 172.21.15.150:0/2019790130 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa5340d4f90 0x7fa5340ce4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:51:18.847 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:18.843+0000 7fa53359e640 1 --2- 172.21.15.150:0/2019790130 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa534159ea0 0x7fa53415a2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:51:18.847 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:18.844+0000 7fa532d9d640 1 -- 172.21.15.150:0/2019790130 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa534159ea0 msgr2=0x7fa53415a2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:51:18.847 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:18.844+0000 7fa532d9d640 1 --2- 172.21.15.150:0/2019790130 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa534159ea0 0x7fa53415a2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:51:18.847 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:18.844+0000 7fa532d9d640 1 -- 172.21.15.150:0/2019790130 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa5340d4f90 msgr2=0x7fa5340ce4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:51:18.847 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:18.844+0000 7fa532d9d640 1 --2- 172.21.15.150:0/2019790130 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa5340d4f90 0x7fa5340ce4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:51:18.847 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:18.844+0000 7fa532d9d640 1 -- 172.21.15.150:0/2019790130 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa5341f6da0 con 0x7fa5340b5d50 2024-09-17T05:51:18.847 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:18.844+0000 7fa532d9d640 1 --2- 172.21.15.150:0/2019790130 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa5340b5d50 0x7fa5341f6860 secure :-1 s=READY pgs=1492 cs=0 l=1 rev1=1 crypto rx=0x7fa52400c3d0 tx=0x7fa52400c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:51:18.847 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:18.844+0000 7fa52bfff640 1 -- 172.21.15.150:0/2019790130 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa524017070 con 0x7fa5340b5d50 2024-09-17T05:51:18.847 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:18.844+0000 7fa52bfff640 1 -- 172.21.15.150:0/2019790130 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa5240053c0 con 0x7fa5340b5d50 2024-09-17T05:51:18.847 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:18.844+0000 7fa539230640 1 -- 172.21.15.150:0/2019790130 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa5340ce9f0 con 0x7fa5340b5d50 2024-09-17T05:51:18.847 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:18.844+0000 7fa52bfff640 1 -- 172.21.15.150:0/2019790130 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa524003850 con 0x7fa5340b5d50 2024-09-17T05:51:18.848 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:18.844+0000 7fa539230640 1 -- 172.21.15.150:0/2019790130 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa5340b2b40 con 0x7fa5340b5d50 2024-09-17T05:51:18.849 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:18.845+0000 7fa539230640 1 -- 172.21.15.150:0/2019790130 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa5340b8870 con 0x7fa5340b5d50 2024-09-17T05:51:18.849 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:18.846+0000 7fa52bfff640 1 -- 172.21.15.150:0/2019790130 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 37) ==== 103787+0+0 (secure 0 0 0) 0x7fa52401a070 con 0x7fa5340b5d50 2024-09-17T05:51:18.849 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:18.846+0000 7fa52bfff640 1 --2- 172.21.15.150:0/2019790130 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fa51407a570 0x7fa51407ca80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:51:18.849 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:18.846+0000 7fa52bfff640 1 -- 172.21.15.150:0/2019790130 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(113..113 src has 1..113) ==== 5849+0+0 (secure 0 0 0) 0x7fa524098e60 con 0x7fa5340b5d50 2024-09-17T05:51:18.849 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:18.847+0000 7fa52a59c640 1 --2- 172.21.15.150:0/2019790130 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fa51407a570 0x7fa51407ca80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:51:18.850 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:18.847+0000 7fa52a59c640 1 --2- 172.21.15.150:0/2019790130 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fa51407a570 0x7fa51407ca80 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7fa5341fa490 tx=0x7fa51c005f90 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:51:18.852 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:18.851+0000 7fa52bfff640 1 -- 172.21.15.150:0/2019790130 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fa5340ce9f0 con 0x7fa5340b5d50 2024-09-17T05:51:19.028 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:19.027+0000 7fa539230640 1 -- 172.21.15.150:0/2019790130 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fa5340d2d60 con 0x7fa5340b5d50 2024-09-17T05:51:19.029 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:19.028+0000 7fa52bfff640 1 -- 172.21.15.150:0/2019790130 <== mon.0 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v113) ==== 74+0+16945 (secure 0 0 0) 0x7fa52409f250 con 0x7fa5340b5d50 2024-09-17T05:51:19.029 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-09-17T05:51:19.029 INFO:teuthology.orchestra.run.smithi150.stdout:{"epoch":113,"fsid":"9f2e05e9-d629-47b3-b26b-1360655b7d20","created":"2024-09-17T05:41:32.502979+0000","modified":"2024-09-17T05:51:16.335052+0000","last_up_change":"2024-09-17T05:41:46.150225+0000","last_in_change":"2024-09-17T05:41:36.120274+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":17,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T05:41:46.860779+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":16,"pool_name":"cephfs_metadata","create_time":"2024-09-17T05:51:12.343530+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"112","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":17,"pool_name":"cephfs_data","create_time":"2024-09-17T05:51:13.667025+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"113","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"4f31c018-c8a4-4d6d-b0c2-a597c47aae4a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6800","nonce":479374392},{"type":"v1","addr":"172.21.15.150:6801","nonce":479374392}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6802","nonce":479374392},{"type":"v1","addr":"172.21.15.150:6803","nonce":479374392}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6806","nonce":479374392},{"type":"v1","addr":"172.21.15.150:6807","nonce":479374392}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6804","nonce":479374392},{"type":"v1","addr":"172.21.15.150:6805","nonce":479374392}]},"public_addr":"172.21.15.150:6801/479374392","cluster_addr":"172.21.15.150:6803/479374392","heartbeat_back_addr":"172.21.15.150:6807/479374392","heartbeat_front_addr":"172.21.15.150:6805/479374392","state":["exists","up"]},{"osd":1,"uuid":"6ff4a573-500b-4e04-9de3-39265ead78b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6824","nonce":913899800},{"type":"v1","addr":"172.21.15.150:6825","nonce":913899800}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6826","nonce":913899800},{"type":"v1","addr":"172.21.15.150:6827","nonce":913899800}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6830","nonce":913899800},{"type":"v1","addr":"172.21.15.150:6831","nonce":913899800}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6828","nonce":913899800},{"type":"v1","addr":"172.21.15.150:6829","nonce":913899800}]},"public_addr":"172.21.15.150:6825/913899800","cluster_addr":"172.21.15.150:6827/913899800","heartbeat_back_addr":"172.21.15.150:6831/913899800","heartbeat_front_addr":"172.21.15.150:6829/913899800","state":["exists","up"]},{"osd":2,"uuid":"bffea6f9-2465-4182-b205-00436c41ac1c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6816","nonce":363718461},{"type":"v1","addr":"172.21.15.150:6817","nonce":363718461}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6818","nonce":363718461},{"type":"v1","addr":"172.21.15.150:6819","nonce":363718461}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6822","nonce":363718461},{"type":"v1","addr":"172.21.15.150:6823","nonce":363718461}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6820","nonce":363718461},{"type":"v1","addr":"172.21.15.150:6821","nonce":363718461}]},"public_addr":"172.21.15.150:6817/363718461","cluster_addr":"172.21.15.150:6819/363718461","heartbeat_back_addr":"172.21.15.150:6823/363718461","heartbeat_front_addr":"172.21.15.150:6821/363718461","state":["exists","up"]},{"osd":3,"uuid":"cda70430-d1e1-427e-b04e-56db4031d078","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6808","nonce":3550994626},{"type":"v1","addr":"172.21.15.150:6809","nonce":3550994626}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6810","nonce":3550994626},{"type":"v1","addr":"172.21.15.150:6811","nonce":3550994626}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6814","nonce":3550994626},{"type":"v1","addr":"172.21.15.150:6815","nonce":3550994626}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6812","nonce":3550994626},{"type":"v1","addr":"172.21.15.150:6813","nonce":3550994626}]},"public_addr":"172.21.15.150:6809/3550994626","cluster_addr":"172.21.15.150:6811/3550994626","heartbeat_back_addr":"172.21.15.150:6815/3550994626","heartbeat_front_addr":"172.21.15.150:6813/3550994626","state":["exists","up"]},{"osd":4,"uuid":"3a0277fb-5e1e-4f68-bb2d-9a8a0152f64a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6810","nonce":2718261497},{"type":"v1","addr":"172.21.15.176:6811","nonce":2718261497}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6812","nonce":2718261497},{"type":"v1","addr":"172.21.15.176:6813","nonce":2718261497}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6816","nonce":2718261497},{"type":"v1","addr":"172.21.15.176:6817","nonce":2718261497}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6814","nonce":2718261497},{"type":"v1","addr":"172.21.15.176:6815","nonce":2718261497}]},"public_addr":"172.21.15.176:6811/2718261497","cluster_addr":"172.21.15.176:6813/2718261497","heartbeat_back_addr":"172.21.15.176:6817/2718261497","heartbeat_front_addr":"172.21.15.176:6815/2718261497","state":["exists","up"]},{"osd":5,"uuid":"33aebee6-0315-40b7-a11c-6702f0be494d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6818","nonce":2049295774},{"type":"v1","addr":"172.21.15.176:6819","nonce":2049295774}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6820","nonce":2049295774},{"type":"v1","addr":"172.21.15.176:6821","nonce":2049295774}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6824","nonce":2049295774},{"type":"v1","addr":"172.21.15.176:6825","nonce":2049295774}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6822","nonce":2049295774},{"type":"v1","addr":"172.21.15.176:6823","nonce":2049295774}]},"public_addr":"172.21.15.176:6819/2049295774","cluster_addr":"172.21.15.176:6821/2049295774","heartbeat_back_addr":"172.21.15.176:6825/2049295774","heartbeat_front_addr":"172.21.15.176:6823/2049295774","state":["exists","up"]},{"osd":6,"uuid":"4d24f360-6751-4263-841b-d77793d33540","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6826","nonce":2164458476},{"type":"v1","addr":"172.21.15.176:6827","nonce":2164458476}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6828","nonce":2164458476},{"type":"v1","addr":"172.21.15.176:6829","nonce":2164458476}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6832","nonce":2164458476},{"type":"v1","addr":"172.21.15.176:6833","nonce":2164458476}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6830","nonce":2164458476},{"type":"v1","addr":"172.21.15.176:6831","nonce":2164458476}]},"public_addr":"172.21.15.176:6827/2164458476","cluster_addr":"172.21.15.176:6829/2164458476","heartbeat_back_addr":"172.21.15.176:6833/2164458476","heartbeat_front_addr":"172.21.15.176:6831/2164458476","state":["exists","up"]},{"osd":7,"uuid":"c8594fda-c74a-4ba9-8277-caf101d58ca1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6802","nonce":3239587708},{"type":"v1","addr":"172.21.15.176:6803","nonce":3239587708}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6804","nonce":3239587708},{"type":"v1","addr":"172.21.15.176:6805","nonce":3239587708}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6808","nonce":3239587708},{"type":"v1","addr":"172.21.15.176:6809","nonce":3239587708}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6806","nonce":3239587708},{"type":"v1","addr":"172.21.15.176:6807","nonce":3239587708}]},"public_addr":"172.21.15.176:6803/3239587708","cluster_addr":"172.21.15.176:6805/3239587708","heartbeat_back_addr":"172.21.15.176:6809/3239587708","heartbeat_front_addr":"172.21.15.176:6807/3239587708","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:41:41.905151+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:41:42.705679+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:41:42.459673+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:41:42.440819+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:41:42.668428+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:41:42.694972+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:41:43.078535+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:41:42.363539+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":7,"snaps":[{"begin":2,"length":2}]},{"pool":9,"snaps":[{"begin":2,"length":2}]},{"pool":11,"snaps":[{"begin":2,"length":2}]},{"pool":13,"snaps":[{"begin":2,"length":2}]},{"pool":15,"snaps":[{"begin":2,"length":2}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T05:51:19.032 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:19.031+0000 7fa539230640 1 -- 172.21.15.150:0/2019790130 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fa51407a570 msgr2=0x7fa51407ca80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:51:19.032 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:19.031+0000 7fa539230640 1 --2- 172.21.15.150:0/2019790130 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fa51407a570 0x7fa51407ca80 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7fa5341fa490 tx=0x7fa51c005f90 comp rx=0 tx=0).stop 2024-09-17T05:51:19.032 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:19.031+0000 7fa539230640 1 -- 172.21.15.150:0/2019790130 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa5340b5d50 msgr2=0x7fa5341f6860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:51:19.032 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:19.031+0000 7fa539230640 1 --2- 172.21.15.150:0/2019790130 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa5340b5d50 0x7fa5341f6860 secure :-1 s=READY pgs=1492 cs=0 l=1 rev1=1 crypto rx=0x7fa52400c3d0 tx=0x7fa52400c890 comp rx=0 tx=0).stop 2024-09-17T05:51:19.032 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:19.031+0000 7fa539230640 1 -- 172.21.15.150:0/2019790130 shutdown_connections 2024-09-17T05:51:19.032 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:19.031+0000 7fa539230640 1 --2- 172.21.15.150:0/2019790130 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa5340d4f90 0x7fa5340ce4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:51:19.032 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:19.031+0000 7fa539230640 1 --2- 172.21.15.150:0/2019790130 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fa51407a570 0x7fa51407ca80 unknown :-1 s=CLOSED pgs=638 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:51:19.032 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:19.031+0000 7fa539230640 1 --2- 172.21.15.150:0/2019790130 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa534159ea0 0x7fa53415a2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:51:19.032 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:19.031+0000 7fa539230640 1 --2- 172.21.15.150:0/2019790130 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa5340b5d50 0x7fa5341f6860 unknown :-1 s=CLOSED pgs=1492 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:51:19.033 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:19.031+0000 7fa539230640 1 -- 172.21.15.150:0/2019790130 >> 172.21.15.150:0/2019790130 conn(0x7fa53408bfe0 msgr2=0x7fa5340d1080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:51:19.033 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:19.031+0000 7fa539230640 1 -- 172.21.15.150:0/2019790130 shutdown_connections 2024-09-17T05:51:19.033 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:19.031+0000 7fa539230640 1 -- 172.21.15.150:0/2019790130 wait complete. 2024-09-17T05:51:19.044 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-17T05:51:19.044 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-17T05:51:19.158 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:19.157+0000 7f6386bad640 1 -- 172.21.15.150:0/3409667525 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6380070040 msgr2=0x7f63800ad880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:51:19.158 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:19.157+0000 7f6386bad640 1 --2- 172.21.15.150:0/3409667525 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6380070040 0x7f63800ad880 secure :-1 s=READY pgs=1494 cs=0 l=1 rev1=1 crypto rx=0x7f6370009830 tx=0x7f637002a480 comp rx=0 tx=0).stop 2024-09-17T05:51:19.158 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:19.157+0000 7f6386bad640 1 -- 172.21.15.150:0/3409667525 shutdown_connections 2024-09-17T05:51:19.158 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:19.157+0000 7f6386bad640 1 --2- 172.21.15.150:0/3409667525 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f63800730b0 0x7f63800addc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:51:19.158 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:19.157+0000 7f6386bad640 1 --2- 172.21.15.150:0/3409667525 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6380070040 0x7f63800ad880 unknown :-1 s=CLOSED pgs=1494 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:51:19.158 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:19.157+0000 7f6386bad640 1 -- 172.21.15.150:0/3409667525 >> 172.21.15.150:0/3409667525 conn(0x7f638006d730 msgr2=0x7f63800b1e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:51:19.158 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:19.157+0000 7f6386bad640 1 -- 172.21.15.150:0/3409667525 shutdown_connections 2024-09-17T05:51:19.158 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:19.157+0000 7f6386bad640 1 -- 172.21.15.150:0/3409667525 wait complete. 2024-09-17T05:51:19.159 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:19.158+0000 7f6386bad640 1 Processor -- start 2024-09-17T05:51:19.159 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:19.159+0000 7f6386bad640 1 -- start start 2024-09-17T05:51:19.162 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:19.160+0000 7f6386bad640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f63800707b0 0x7f63800cfbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:51:19.162 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:19.160+0000 7f6386bad640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f63800730b0 0x7f63800afd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:51:19.162 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:19.160+0000 7f6386bad640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f638015df30 0x7f63800b02b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:51:19.162 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:19.160+0000 7f6386bad640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f638015b170 con 0x7f63800730b0 2024-09-17T05:51:19.162 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:19.160+0000 7f6386bad640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f638015aff0 con 0x7f638015df30 2024-09-17T05:51:19.162 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:19.160+0000 7f6386bad640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f638015b2f0 con 0x7f63800707b0 2024-09-17T05:51:19.162 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:19.160+0000 7f6377fff640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f63800730b0 0x7f63800afd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:51:19.162 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:19.160+0000 7f6377fff640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f63800730b0 0x7f63800afd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:50356/0 (socket says 172.21.15.150:50356) 2024-09-17T05:51:19.163 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:19.160+0000 7f6377fff640 1 -- 172.21.15.150:0/1108808643 learned_addr learned my addr 172.21.15.150:0/1108808643 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:51:19.163 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:19.160+0000 7f6384949640 1 --2- 172.21.15.150:0/1108808643 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f63800707b0 0x7f63800cfbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:51:19.163 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:19.160+0000 7f638514a640 1 --2- 172.21.15.150:0/1108808643 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f638015df30 0x7f63800b02b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:51:19.163 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:19.160+0000 7f6377fff640 1 -- 172.21.15.150:0/1108808643 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f63800707b0 msgr2=0x7f63800cfbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:51:19.163 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:19.160+0000 7f6377fff640 1 --2- 172.21.15.150:0/1108808643 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f63800707b0 0x7f63800cfbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:51:19.163 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:19.160+0000 7f6377fff640 1 -- 172.21.15.150:0/1108808643 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f638015df30 msgr2=0x7f63800b02b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:51:19.163 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:19.160+0000 7f6377fff640 1 --2- 172.21.15.150:0/1108808643 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f638015df30 0x7f63800b02b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:51:19.163 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:19.160+0000 7f6377fff640 1 -- 172.21.15.150:0/1108808643 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f63801f8b80 con 0x7f63800730b0 2024-09-17T05:51:19.163 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:19.160+0000 7f6384949640 1 --2- 172.21.15.150:0/1108808643 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f63800707b0 0x7f63800cfbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:51:19.163 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:19.161+0000 7f6377fff640 1 --2- 172.21.15.150:0/1108808643 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f63800730b0 0x7f63800afd70 secure :-1 s=READY pgs=1495 cs=0 l=1 rev1=1 crypto rx=0x7f6370009950 tx=0x7f6370033c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:51:19.163 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:19.161+0000 7f63757fa640 1 -- 172.21.15.150:0/1108808643 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6370031d60 con 0x7f63800730b0 2024-09-17T05:51:19.163 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:19.161+0000 7f63757fa640 1 -- 172.21.15.150:0/1108808643 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f6370033e10 con 0x7f63800730b0 2024-09-17T05:51:19.163 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:19.161+0000 7f6386bad640 1 -- 172.21.15.150:0/1108808643 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f63801f8e60 con 0x7f63800730b0 2024-09-17T05:51:19.164 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:19.161+0000 7f63757fa640 1 -- 172.21.15.150:0/1108808643 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6370005260 con 0x7f63800730b0 2024-09-17T05:51:19.164 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:19.161+0000 7f6386bad640 1 -- 172.21.15.150:0/1108808643 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f63801f9420 con 0x7f63800730b0 2024-09-17T05:51:19.164 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:19.162+0000 7f6386bad640 1 -- 172.21.15.150:0/1108808643 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f63800ae5c0 con 0x7f63800730b0 2024-09-17T05:51:19.165 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:19.163+0000 7f63757fa640 1 -- 172.21.15.150:0/1108808643 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 37) ==== 103787+0+0 (secure 0 0 0) 0x7f6370005400 con 0x7f63800730b0 2024-09-17T05:51:19.165 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:19.163+0000 7f63757fa640 1 --2- 172.21.15.150:0/1108808643 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f636c07a5a0 0x7f636c07cab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:51:19.165 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:19.163+0000 7f63757fa640 1 -- 172.21.15.150:0/1108808643 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(113..113 src has 1..113) ==== 5849+0+0 (secure 0 0 0) 0x7f63700bace0 con 0x7f63800730b0 2024-09-17T05:51:19.165 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:19.163+0000 7f6384949640 1 --2- 172.21.15.150:0/1108808643 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f636c07a5a0 0x7f636c07cab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:51:19.165 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:19.164+0000 7f6384949640 1 --2- 172.21.15.150:0/1108808643 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f636c07a5a0 0x7f636c07cab0 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7f637c000f60 tx=0x7f637c009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:51:19.168 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:19.168+0000 7f63757fa640 1 -- 172.21.15.150:0/1108808643 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f637003f030 con 0x7f63800730b0 2024-09-17T05:51:19.341 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:19.340+0000 7f6386bad640 1 -- 172.21.15.150:0/1108808643 --> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f63800b2030 con 0x7f636c07a5a0 2024-09-17T05:51:19.345 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:19.345+0000 7f63757fa640 1 -- 172.21.15.150:0/1108808643 <== mgr.4108 v2:172.21.15.176:6800/3631216395 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+249997 (secure 0 0 0) 0x7f63800b2030 con 0x7f636c07a5a0 2024-09-17T05:51:19.349 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-09-17T05:51:19.350 INFO:teuthology.orchestra.run.smithi150.stderr:dumped all 2024-09-17T05:51:19.352 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:19.348+0000 7f6386bad640 1 -- 172.21.15.150:0/1108808643 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f636c07a5a0 msgr2=0x7f636c07cab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:51:19.352 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:19.348+0000 7f6386bad640 1 --2- 172.21.15.150:0/1108808643 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f636c07a5a0 0x7f636c07cab0 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7f637c000f60 tx=0x7f637c009040 comp rx=0 tx=0).stop 2024-09-17T05:51:19.352 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:19.348+0000 7f6386bad640 1 -- 172.21.15.150:0/1108808643 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f63800730b0 msgr2=0x7f63800afd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:51:19.352 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:19.348+0000 7f6386bad640 1 --2- 172.21.15.150:0/1108808643 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f63800730b0 0x7f63800afd70 secure :-1 s=READY pgs=1495 cs=0 l=1 rev1=1 crypto rx=0x7f6370009950 tx=0x7f6370033c20 comp rx=0 tx=0).stop 2024-09-17T05:51:19.352 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:19.348+0000 7f6386bad640 1 -- 172.21.15.150:0/1108808643 shutdown_connections 2024-09-17T05:51:19.352 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:19.348+0000 7f6386bad640 1 --2- 172.21.15.150:0/1108808643 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f638015df30 0x7f63800b02b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:51:19.352 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:19.348+0000 7f6386bad640 1 --2- 172.21.15.150:0/1108808643 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f636c07a5a0 0x7f636c07cab0 unknown :-1 s=CLOSED pgs=639 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:51:19.352 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:19.348+0000 7f6386bad640 1 --2- 172.21.15.150:0/1108808643 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f63800730b0 0x7f63800afd70 unknown :-1 s=CLOSED pgs=1495 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:51:19.353 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:19.348+0000 7f6386bad640 1 --2- 172.21.15.150:0/1108808643 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f63800707b0 0x7f63800cfbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:51:19.353 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:19.348+0000 7f6386bad640 1 -- 172.21.15.150:0/1108808643 >> 172.21.15.150:0/1108808643 conn(0x7f638006d730 msgr2=0x7f6380155a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:51:19.353 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:19.348+0000 7f6386bad640 1 -- 172.21.15.150:0/1108808643 shutdown_connections 2024-09-17T05:51:19.353 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:19.348+0000 7f6386bad640 1 -- 172.21.15.150:0/1108808643 wait complete. 2024-09-17T05:51:19.361 INFO:teuthology.orchestra.run.smithi150.stdout:{"pg_ready":true,"pg_map":{"version":394,"stamp":"2024-09-17T05:51:19.058233+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":591054,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":135,"num_write_kb":1637,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":12,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":101,"ondisk_log_size":101,"up":166,"acting":166,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":98,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":1009360,"kb_used_data":12044,"kb_used_omap":12,"kb_used_meta":997107,"kb_avail":753965360,"statfs":{"total":773094113280,"available":772060528640,"internally_reserved":0,"allocated":12333056,"data_stored":6016521,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":1021038128},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":17,"apply_latency_ms":17,"commit_latency_ns":17000000,"apply_latency_ns":17000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":686,"num_objects":15,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":34,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":12,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.726990"},"pg_stats":[{"pgid":"17.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:51:14.325451+0000","last_change":"2024-09-17T05:51:14.325451+0000","last_active":"2024-09-17T05:51:14.325451+0000","last_peered":"2024-09-17T05:51:14.325451+0000","last_clean":"2024-09-17T05:51:14.325451+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:51:14.325451+0000","last_undegraded":"2024-09-17T05:51:14.325451+0000","last_fullsized":"2024-09-17T05:51:14.325451+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:51:14.325451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:51:14.325451+0000","last_clean_scrub_stamp":"2024-09-17T05:51:14.325451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.3e","version":"0'0","reported_seq":13,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-17T05:51:16.340640+0000","last_change":"2024-09-17T05:51:15.344958+0000","last_active":"2024-09-17T05:51:16.340640+0000","last_peered":"2024-09-17T05:51:16.340640+0000","last_clean":"2024-09-17T05:51:16.340640+0000","last_became_active":"2024-09-17T05:51:15.344518+0000","last_became_peered":"2024-09-17T05:51:15.344518+0000","last_unstale":"2024-09-17T05:51:16.340640+0000","last_undegraded":"2024-09-17T05:51:16.340640+0000","last_fullsized":"2024-09-17T05:51:16.340640+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:51:14.325451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:51:14.325451+0000","last_clean_scrub_stamp":"2024-09-17T05:51:14.325451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:49:40.516537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.3d","version":"0'0","reported_seq":13,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-17T05:51:16.750744+0000","last_change":"2024-09-17T05:51:15.352551+0000","last_active":"2024-09-17T05:51:16.750744+0000","last_peered":"2024-09-17T05:51:16.750744+0000","last_clean":"2024-09-17T05:51:16.750744+0000","last_became_active":"2024-09-17T05:51:15.352223+0000","last_became_peered":"2024-09-17T05:51:15.352223+0000","last_unstale":"2024-09-17T05:51:16.750744+0000","last_undegraded":"2024-09-17T05:51:16.750744+0000","last_fullsized":"2024-09-17T05:51:16.750744+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:51:14.325451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:51:14.325451+0000","last_clean_scrub_stamp":"2024-09-17T05:51:14.325451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:56:32.607756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:51:14.325451+0000","last_change":"2024-09-17T05:51:14.325451+0000","last_active":"2024-09-17T05:51:14.325451+0000","last_peered":"2024-09-17T05:51:14.325451+0000","last_clean":"2024-09-17T05:51:14.325451+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:51:14.325451+0000","last_undegraded":"2024-09-17T05:51:14.325451+0000","last_fullsized":"2024-09-17T05:51:14.325451+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:51:14.325451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:51:14.325451+0000","last_clean_scrub_stamp":"2024-09-17T05:51:14.325451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.3b","version":"0'0","reported_seq":13,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-17T05:51:16.339755+0000","last_change":"2024-09-17T05:51:15.354740+0000","last_active":"2024-09-17T05:51:16.339755+0000","last_peered":"2024-09-17T05:51:16.339755+0000","last_clean":"2024-09-17T05:51:16.339755+0000","last_became_active":"2024-09-17T05:51:15.354441+0000","last_became_peered":"2024-09-17T05:51:15.354441+0000","last_unstale":"2024-09-17T05:51:16.339755+0000","last_undegraded":"2024-09-17T05:51:16.339755+0000","last_fullsized":"2024-09-17T05:51:16.339755+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:51:14.325451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:51:14.325451+0000","last_clean_scrub_stamp":"2024-09-17T05:51:14.325451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:01:13.224376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.3a","version":"0'0","reported_seq":13,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-17T05:51:16.750534+0000","last_change":"2024-09-17T05:51:15.349818+0000","last_active":"2024-09-17T05:51:16.750534+0000","last_peered":"2024-09-17T05:51:16.750534+0000","last_clean":"2024-09-17T05:51:16.750534+0000","last_became_active":"2024-09-17T05:51:15.349457+0000","last_became_peered":"2024-09-17T05:51:15.349457+0000","last_unstale":"2024-09-17T05:51:16.750534+0000","last_undegraded":"2024-09-17T05:51:16.750534+0000","last_fullsized":"2024-09-17T05:51:16.750534+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:51:14.325451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:51:14.325451+0000","last_clean_scrub_stamp":"2024-09-17T05:51:14.325451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:08:40.638937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.39","version":"0'0","reported_seq":13,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-17T05:51:16.360003+0000","last_change":"2024-09-17T05:51:15.358171+0000","last_active":"2024-09-17T05:51:16.360003+0000","last_peered":"2024-09-17T05:51:16.360003+0000","last_clean":"2024-09-17T05:51:16.360003+0000","last_became_active":"2024-09-17T05:51:15.357838+0000","last_became_peered":"2024-09-17T05:51:15.357838+0000","last_unstale":"2024-09-17T05:51:16.360003+0000","last_undegraded":"2024-09-17T05:51:16.360003+0000","last_fullsized":"2024-09-17T05:51:16.360003+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:51:14.325451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:51:14.325451+0000","last_clean_scrub_stamp":"2024-09-17T05:51:14.325451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:20:00.031149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.38","version":"0'0","reported_seq":13,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-17T05:51:16.750342+0000","last_change":"2024-09-17T05:51:15.361077+0000","last_active":"2024-09-17T05:51:16.750342+0000","last_peered":"2024-09-17T05:51:16.750342+0000","last_clean":"2024-09-17T05:51:16.750342+0000","last_became_active":"2024-09-17T05:51:15.359954+0000","last_became_peered":"2024-09-17T05:51:15.359954+0000","last_unstale":"2024-09-17T05:51:16.750342+0000","last_undegraded":"2024-09-17T05:51:16.750342+0000","last_fullsized":"2024-09-17T05:51:16.750342+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:51:14.325451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:51:14.325451+0000","last_clean_scrub_stamp":"2024-09-17T05:51:14.325451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:40:17.074211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:51:14.325451+0000","last_change":"2024-09-17T05:51:14.325451+0000","last_active":"2024-09-17T05:51:14.325451+0000","last_peered":"2024-09-17T05:51:14.325451+0000","last_clean":"2024-09-17T05:51:14.325451+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:51:14.325451+0000","last_undegraded":"2024-09-17T05:51:14.325451+0000","last_fullsized":"2024-09-17T05:51:14.325451+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:51:14.325451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:51:14.325451+0000","last_clean_scrub_stamp":"2024-09-17T05:51:14.325451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:51:14.325451+0000","last_change":"2024-09-17T05:51:14.325451+0000","last_active":"2024-09-17T05:51:14.325451+0000","last_peered":"2024-09-17T05:51:14.325451+0000","last_clean":"2024-09-17T05:51:14.325451+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:51:14.325451+0000","last_undegraded":"2024-09-17T05:51:14.325451+0000","last_fullsized":"2024-09-17T05:51:14.325451+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:51:14.325451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:51:14.325451+0000","last_clean_scrub_stamp":"2024-09-17T05:51:14.325451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.35","version":"0'0","reported_seq":13,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-17T05:51:16.341088+0000","last_change":"2024-09-17T05:51:15.353391+0000","last_active":"2024-09-17T05:51:16.341088+0000","last_peered":"2024-09-17T05:51:16.341088+0000","last_clean":"2024-09-17T05:51:16.341088+0000","last_became_active":"2024-09-17T05:51:15.353075+0000","last_became_peered":"2024-09-17T05:51:15.353075+0000","last_unstale":"2024-09-17T05:51:16.341088+0000","last_undegraded":"2024-09-17T05:51:16.341088+0000","last_fullsized":"2024-09-17T05:51:16.341088+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:51:14.325451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:51:14.325451+0000","last_clean_scrub_stamp":"2024-09-17T05:51:14.325451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:35:01.866394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:51:14.325451+0000","last_change":"2024-09-17T05:51:14.325451+0000","last_active":"2024-09-17T05:51:14.325451+0000","last_peered":"2024-09-17T05:51:14.325451+0000","last_clean":"2024-09-17T05:51:14.325451+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:51:14.325451+0000","last_undegraded":"2024-09-17T05:51:14.325451+0000","last_fullsized":"2024-09-17T05:51:14.325451+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:51:14.325451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:51:14.325451+0000","last_clean_scrub_stamp":"2024-09-17T05:51:14.325451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.33","version":"0'0","reported_seq":13,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-17T05:51:16.750511+0000","last_change":"2024-09-17T05:51:15.356651+0000","last_active":"2024-09-17T05:51:16.750511+0000","last_peered":"2024-09-17T05:51:16.750511+0000","last_clean":"2024-09-17T05:51:16.750511+0000","last_became_active":"2024-09-17T05:51:15.356329+0000","last_became_peered":"2024-09-17T05:51:15.356329+0000","last_unstale":"2024-09-17T05:51:16.750511+0000","last_undegraded":"2024-09-17T05:51:16.750511+0000","last_fullsized":"2024-09-17T05:51:16.750511+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:51:14.325451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:51:14.325451+0000","last_clean_scrub_stamp":"2024-09-17T05:51:14.325451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:40:43.043320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.32","version":"0'0","reported_seq":13,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-17T05:51:16.750261+0000","last_change":"2024-09-17T05:51:15.358138+0000","last_active":"2024-09-17T05:51:16.750261+0000","last_peered":"2024-09-17T05:51:16.750261+0000","last_clean":"2024-09-17T05:51:16.750261+0000","last_became_active":"2024-09-17T05:51:15.357839+0000","last_became_peered":"2024-09-17T05:51:15.357839+0000","last_unstale":"2024-09-17T05:51:16.750261+0000","last_undegraded":"2024-09-17T05:51:16.750261+0000","last_fullsized":"2024-09-17T05:51:16.750261+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:51:14.325451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:51:14.325451+0000","last_clean_scrub_stamp":"2024-09-17T05:51:14.325451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:31:24.479375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.31","version":"0'0","reported_seq":13,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-17T05:51:16.749988+0000","last_change":"2024-09-17T05:51:15.349182+0000","last_active":"2024-09-17T05:51:16.749988+0000","last_peered":"2024-09-17T05:51:16.749988+0000","last_clean":"2024-09-17T05:51:16.749988+0000","last_became_active":"2024-09-17T05:51:15.348875+0000","last_became_peered":"2024-09-17T05:51:15.348875+0000","last_unstale":"2024-09-17T05:51:16.749988+0000","last_undegraded":"2024-09-17T05:51:16.749988+0000","last_fullsized":"2024-09-17T05:51:16.749988+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:51:14.325451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:51:14.325451+0000","last_clean_scrub_stamp":"2024-09-17T05:51:14.325451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:32:59.139253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:51:14.325451+0000","last_change":"2024-09-17T05:51:14.325451+0000","last_active":"2024-09-17T05:51:14.325451+0000","last_peered":"2024-09-17T05:51:14.325451+0000","last_clean":"2024-09-17T05:51:14.325451+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:51:14.325451+0000","last_undegraded":"2024-09-17T05:51:14.325451+0000","last_fullsized":"2024-09-17T05:51:14.325451+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:51:14.325451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:51:14.325451+0000","last_clean_scrub_stamp":"2024-09-17T05:51:14.325451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.2f","version":"0'0","reported_seq":13,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-17T05:51:16.340854+0000","last_change":"2024-09-17T05:51:15.356819+0000","last_active":"2024-09-17T05:51:16.340854+0000","last_peered":"2024-09-17T05:51:16.340854+0000","last_clean":"2024-09-17T05:51:16.340854+0000","last_became_active":"2024-09-17T05:51:15.355786+0000","last_became_peered":"2024-09-17T05:51:15.355786+0000","last_unstale":"2024-09-17T05:51:16.340854+0000","last_undegraded":"2024-09-17T05:51:16.340854+0000","last_fullsized":"2024-09-17T05:51:16.340854+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:51:14.325451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:51:14.325451+0000","last_clean_scrub_stamp":"2024-09-17T05:51:14.325451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:41:26.394405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.2e","version":"0'0","reported_seq":13,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-17T05:51:16.357401+0000","last_change":"2024-09-17T05:51:15.355528+0000","last_active":"2024-09-17T05:51:16.357401+0000","last_peered":"2024-09-17T05:51:16.357401+0000","last_clean":"2024-09-17T05:51:16.357401+0000","last_became_active":"2024-09-17T05:51:15.355205+0000","last_became_peered":"2024-09-17T05:51:15.355205+0000","last_unstale":"2024-09-17T05:51:16.357401+0000","last_undegraded":"2024-09-17T05:51:16.357401+0000","last_fullsized":"2024-09-17T05:51:16.357401+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:51:14.325451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:51:14.325451+0000","last_clean_scrub_stamp":"2024-09-17T05:51:14.325451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:59:59.333951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.2d","version":"0'0","reported_seq":13,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-17T05:51:16.750770+0000","last_change":"2024-09-17T05:51:15.357170+0000","last_active":"2024-09-17T05:51:16.750770+0000","last_peered":"2024-09-17T05:51:16.750770+0000","last_clean":"2024-09-17T05:51:16.750770+0000","last_became_active":"2024-09-17T05:51:15.356347+0000","last_became_peered":"2024-09-17T05:51:15.356347+0000","last_unstale":"2024-09-17T05:51:16.750770+0000","last_undegraded":"2024-09-17T05:51:16.750770+0000","last_fullsized":"2024-09-17T05:51:16.750770+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:51:14.325451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:51:14.325451+0000","last_clean_scrub_stamp":"2024-09-17T05:51:14.325451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:39:17.891657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.2c","version":"0'0","reported_seq":13,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-17T05:51:16.341037+0000","last_change":"2024-09-17T05:51:15.351757+0000","last_active":"2024-09-17T05:51:16.341037+0000","last_peered":"2024-09-17T05:51:16.341037+0000","last_clean":"2024-09-17T05:51:16.341037+0000","last_became_active":"2024-09-17T05:51:15.351451+0000","last_became_peered":"2024-09-17T05:51:15.351451+0000","last_unstale":"2024-09-17T05:51:16.341037+0000","last_undegraded":"2024-09-17T05:51:16.341037+0000","last_fullsized":"2024-09-17T05:51:16.341037+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:51:14.325451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:51:14.325451+0000","last_clean_scrub_stamp":"2024-09-17T05:51:14.325451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:02:50.463096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.2b","version":"0'0","reported_seq":13,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-17T05:51:16.341258+0000","last_change":"2024-09-17T05:51:15.343820+0000","last_active":"2024-09-17T05:51:16.341258+0000","last_peered":"2024-09-17T05:51:16.341258+0000","last_clean":"2024-09-17T05:51:16.341258+0000","last_became_active":"2024-09-17T05:51:15.343446+0000","last_became_peered":"2024-09-17T05:51:15.343446+0000","last_unstale":"2024-09-17T05:51:16.341258+0000","last_undegraded":"2024-09-17T05:51:16.341258+0000","last_fullsized":"2024-09-17T05:51:16.341258+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:51:14.325451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:51:14.325451+0000","last_clean_scrub_stamp":"2024-09-17T05:51:14.325451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:01:59.401335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.2a","version":"0'0","reported_seq":13,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-17T05:51:16.340834+0000","last_change":"2024-09-17T05:51:15.347950+0000","last_active":"2024-09-17T05:51:16.340834+0000","last_peered":"2024-09-17T05:51:16.340834+0000","last_clean":"2024-09-17T05:51:16.340834+0000","last_became_active":"2024-09-17T05:51:15.347234+0000","last_became_peered":"2024-09-17T05:51:15.347234+0000","last_unstale":"2024-09-17T05:51:16.340834+0000","last_undegraded":"2024-09-17T05:51:16.340834+0000","last_fullsized":"2024-09-17T05:51:16.340834+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:51:14.325451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:51:14.325451+0000","last_clean_scrub_stamp":"2024-09-17T05:51:14.325451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:25:47.876263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.29","version":"0'0","reported_seq":13,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-17T05:51:16.340293+0000","last_change":"2024-09-17T05:51:15.351107+0000","last_active":"2024-09-17T05:51:16.340293+0000","last_peered":"2024-09-17T05:51:16.340293+0000","last_clean":"2024-09-17T05:51:16.340293+0000","last_became_active":"2024-09-17T05:51:15.350800+0000","last_became_peered":"2024-09-17T05:51:15.350800+0000","last_unstale":"2024-09-17T05:51:16.340293+0000","last_undegraded":"2024-09-17T05:51:16.340293+0000","last_fullsized":"2024-09-17T05:51:16.340293+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:51:14.325451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:51:14.325451+0000","last_clean_scrub_stamp":"2024-09-17T05:51:14.325451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:54:30.680562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.28","version":"0'0","reported_seq":13,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-17T05:51:16.340277+0000","last_change":"2024-09-17T05:51:15.352451+0000","last_active":"2024-09-17T05:51:16.340277+0000","last_peered":"2024-09-17T05:51:16.340277+0000","last_clean":"2024-09-17T05:51:16.340277+0000","last_became_active":"2024-09-17T05:51:15.351461+0000","last_became_peered":"2024-09-17T05:51:15.351461+0000","last_unstale":"2024-09-17T05:51:16.340277+0000","last_undegraded":"2024-09-17T05:51:16.340277+0000","last_fullsized":"2024-09-17T05:51:16.340277+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:51:14.325451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:51:14.325451+0000","last_clean_scrub_stamp":"2024-09-17T05:51:14.325451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:07:01.411755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.27","version":"0'0","reported_seq":13,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-17T05:51:16.340985+0000","last_change":"2024-09-17T05:51:15.356473+0000","last_active":"2024-09-17T05:51:16.340985+0000","last_peered":"2024-09-17T05:51:16.340985+0000","last_clean":"2024-09-17T05:51:16.340985+0000","last_became_active":"2024-09-17T05:51:15.355395+0000","last_became_peered":"2024-09-17T05:51:15.355395+0000","last_unstale":"2024-09-17T05:51:16.340985+0000","last_undegraded":"2024-09-17T05:51:16.340985+0000","last_fullsized":"2024-09-17T05:51:16.340985+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:51:14.325451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:51:14.325451+0000","last_clean_scrub_stamp":"2024-09-17T05:51:14.325451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:45:35.715638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:51:14.325451+0000","last_change":"2024-09-17T05:51:14.325451+0000","last_active":"2024-09-17T05:51:14.325451+0000","last_peered":"2024-09-17T05:51:14.325451+0000","last_clean":"2024-09-17T05:51:14.325451+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:51:14.325451+0000","last_undegraded":"2024-09-17T05:51:14.325451+0000","last_fullsized":"2024-09-17T05:51:14.325451+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:51:14.325451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:51:14.325451+0000","last_clean_scrub_stamp":"2024-09-17T05:51:14.325451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.25","version":"0'0","reported_seq":13,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-17T05:51:16.750795+0000","last_change":"2024-09-17T05:51:15.350114+0000","last_active":"2024-09-17T05:51:16.750795+0000","last_peered":"2024-09-17T05:51:16.750795+0000","last_clean":"2024-09-17T05:51:16.750795+0000","last_became_active":"2024-09-17T05:51:15.349717+0000","last_became_peered":"2024-09-17T05:51:15.349717+0000","last_unstale":"2024-09-17T05:51:16.750795+0000","last_undegraded":"2024-09-17T05:51:16.750795+0000","last_fullsized":"2024-09-17T05:51:16.750795+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:51:14.325451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:51:14.325451+0000","last_clean_scrub_stamp":"2024-09-17T05:51:14.325451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:18:04.873879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.24","version":"0'0","reported_seq":13,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-17T05:51:16.340958+0000","last_change":"2024-09-17T05:51:15.354301+0000","last_active":"2024-09-17T05:51:16.340958+0000","last_peered":"2024-09-17T05:51:16.340958+0000","last_clean":"2024-09-17T05:51:16.340958+0000","last_became_active":"2024-09-17T05:51:15.353951+0000","last_became_peered":"2024-09-17T05:51:15.353951+0000","last_unstale":"2024-09-17T05:51:16.340958+0000","last_undegraded":"2024-09-17T05:51:16.340958+0000","last_fullsized":"2024-09-17T05:51:16.340958+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:51:14.325451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:51:14.325451+0000","last_clean_scrub_stamp":"2024-09-17T05:51:14.325451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:59:08.824529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.23","version":"0'0","reported_seq":13,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-17T05:51:16.340611+0000","last_change":"2024-09-17T05:51:15.352151+0000","last_active":"2024-09-17T05:51:16.340611+0000","last_peered":"2024-09-17T05:51:16.340611+0000","last_clean":"2024-09-17T05:51:16.340611+0000","last_became_active":"2024-09-17T05:51:15.350686+0000","last_became_peered":"2024-09-17T05:51:15.350686+0000","last_unstale":"2024-09-17T05:51:16.340611+0000","last_undegraded":"2024-09-17T05:51:16.340611+0000","last_fullsized":"2024-09-17T05:51:16.340611+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:51:14.325451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:51:14.325451+0000","last_clean_scrub_stamp":"2024-09-17T05:51:14.325451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:43:23.785414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.22","version":"0'0","reported_seq":13,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-17T05:51:16.360088+0000","last_change":"2024-09-17T05:51:15.341975+0000","last_active":"2024-09-17T05:51:16.360088+0000","last_peered":"2024-09-17T05:51:16.360088+0000","last_clean":"2024-09-17T05:51:16.360088+0000","last_became_active":"2024-09-17T05:51:15.341693+0000","last_became_peered":"2024-09-17T05:51:15.341693+0000","last_unstale":"2024-09-17T05:51:16.360088+0000","last_undegraded":"2024-09-17T05:51:16.360088+0000","last_fullsized":"2024-09-17T05:51:16.360088+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:51:14.325451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:51:14.325451+0000","last_clean_scrub_stamp":"2024-09-17T05:51:14.325451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:09:41.960133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:51:14.325451+0000","last_change":"2024-09-17T05:51:14.325451+0000","last_active":"2024-09-17T05:51:14.325451+0000","last_peered":"2024-09-17T05:51:14.325451+0000","last_clean":"2024-09-17T05:51:14.325451+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:51:14.325451+0000","last_undegraded":"2024-09-17T05:51:14.325451+0000","last_fullsized":"2024-09-17T05:51:14.325451+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:51:14.325451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:51:14.325451+0000","last_clean_scrub_stamp":"2024-09-17T05:51:14.325451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.20","version":"0'0","reported_seq":13,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-17T05:51:16.749919+0000","last_change":"2024-09-17T05:51:15.352088+0000","last_active":"2024-09-17T05:51:16.749919+0000","last_peered":"2024-09-17T05:51:16.749919+0000","last_clean":"2024-09-17T05:51:16.749919+0000","last_became_active":"2024-09-17T05:51:15.347745+0000","last_became_peered":"2024-09-17T05:51:15.347745+0000","last_unstale":"2024-09-17T05:51:16.749919+0000","last_undegraded":"2024-09-17T05:51:16.749919+0000","last_fullsized":"2024-09-17T05:51:16.749919+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:51:14.325451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:51:14.325451+0000","last_clean_scrub_stamp":"2024-09-17T05:51:14.325451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:00:48.024653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.1e","version":"0'0","reported_seq":13,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-17T05:51:16.751289+0000","last_change":"2024-09-17T05:51:15.356066+0000","last_active":"2024-09-17T05:51:16.751289+0000","last_peered":"2024-09-17T05:51:16.751289+0000","last_clean":"2024-09-17T05:51:16.751289+0000","last_became_active":"2024-09-17T05:51:15.355748+0000","last_became_peered":"2024-09-17T05:51:15.355748+0000","last_unstale":"2024-09-17T05:51:16.751289+0000","last_undegraded":"2024-09-17T05:51:16.751289+0000","last_fullsized":"2024-09-17T05:51:16.751289+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:51:14.325451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:51:14.325451+0000","last_clean_scrub_stamp":"2024-09-17T05:51:14.325451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:54:46.604153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.1f","version":"112'4","reported_seq":19,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-17T05:51:16.360144+0000","last_change":"2024-09-17T05:51:14.352310+0000","last_active":"2024-09-17T05:51:16.360144+0000","last_peered":"2024-09-17T05:51:16.360144+0000","last_clean":"2024-09-17T05:51:16.360144+0000","last_became_active":"2024-09-17T05:51:14.351942+0000","last_became_peered":"2024-09-17T05:51:14.351942+0000","last_unstale":"2024-09-17T05:51:16.360144+0000","last_undegraded":"2024-09-17T05:51:16.360144+0000","last_fullsized":"2024-09-17T05:51:16.360144+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:51:13.315624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:51:13.315624+0000","last_clean_scrub_stamp":"2024-09-17T05:51:13.315624+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:00:47.014826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.1f","version":"0'0","reported_seq":13,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-17T05:51:16.357652+0000","last_change":"2024-09-17T05:51:15.352409+0000","last_active":"2024-09-17T05:51:16.357652+0000","last_peered":"2024-09-17T05:51:16.357652+0000","last_clean":"2024-09-17T05:51:16.357652+0000","last_became_active":"2024-09-17T05:51:15.352109+0000","last_became_peered":"2024-09-17T05:51:15.352109+0000","last_unstale":"2024-09-17T05:51:16.357652+0000","last_undegraded":"2024-09-17T05:51:16.357652+0000","last_fullsized":"2024-09-17T05:51:16.357652+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:51:14.325451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:51:14.325451+0000","last_clean_scrub_stamp":"2024-09-17T05:51:14.325451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:46:13.487513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.1e","version":"112'1","reported_seq":16,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-17T05:51:16.750344+0000","last_change":"2024-09-17T05:51:14.354672+0000","last_active":"2024-09-17T05:51:16.750344+0000","last_peered":"2024-09-17T05:51:16.750344+0000","last_clean":"2024-09-17T05:51:16.750344+0000","last_became_active":"2024-09-17T05:51:14.354096+0000","last_became_peered":"2024-09-17T05:51:14.354096+0000","last_unstale":"2024-09-17T05:51:16.750344+0000","last_undegraded":"2024-09-17T05:51:16.750344+0000","last_fullsized":"2024-09-17T05:51:16.750344+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:51:13.315624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:51:13.315624+0000","last_clean_scrub_stamp":"2024-09-17T05:51:13.315624+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:16:54.432517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.1c","version":"0'0","reported_seq":13,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-17T05:51:16.751166+0000","last_change":"2024-09-17T05:51:15.349713+0000","last_active":"2024-09-17T05:51:16.751166+0000","last_peered":"2024-09-17T05:51:16.751166+0000","last_clean":"2024-09-17T05:51:16.751166+0000","last_became_active":"2024-09-17T05:51:15.347772+0000","last_became_peered":"2024-09-17T05:51:15.347772+0000","last_unstale":"2024-09-17T05:51:16.751166+0000","last_undegraded":"2024-09-17T05:51:16.751166+0000","last_fullsized":"2024-09-17T05:51:16.751166+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:51:14.325451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:51:14.325451+0000","last_clean_scrub_stamp":"2024-09-17T05:51:14.325451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:23:35.566877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.1d","version":"112'2","reported_seq":17,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-17T05:51:16.339750+0000","last_change":"2024-09-17T05:51:14.353746+0000","last_active":"2024-09-17T05:51:16.339750+0000","last_peered":"2024-09-17T05:51:16.339750+0000","last_clean":"2024-09-17T05:51:16.339750+0000","last_became_active":"2024-09-17T05:51:14.353437+0000","last_became_peered":"2024-09-17T05:51:14.353437+0000","last_unstale":"2024-09-17T05:51:16.339750+0000","last_undegraded":"2024-09-17T05:51:16.339750+0000","last_fullsized":"2024-09-17T05:51:16.339750+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:51:13.315624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:51:13.315624+0000","last_clean_scrub_stamp":"2024-09-17T05:51:13.315624+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:05:50.149362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.1d","version":"0'0","reported_seq":13,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-17T05:51:16.750902+0000","last_change":"2024-09-17T05:51:15.359061+0000","last_active":"2024-09-17T05:51:16.750902+0000","last_peered":"2024-09-17T05:51:16.750902+0000","last_clean":"2024-09-17T05:51:16.750902+0000","last_became_active":"2024-09-17T05:51:15.358754+0000","last_became_peered":"2024-09-17T05:51:15.358754+0000","last_unstale":"2024-09-17T05:51:16.750902+0000","last_undegraded":"2024-09-17T05:51:16.750902+0000","last_fullsized":"2024-09-17T05:51:16.750902+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:51:14.325451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:51:14.325451+0000","last_clean_scrub_stamp":"2024-09-17T05:51:14.325451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:43:11.980324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.1c","version":"112'2","reported_seq":17,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-17T05:51:16.339897+0000","last_change":"2024-09-17T05:51:14.349011+0000","last_active":"2024-09-17T05:51:16.339897+0000","last_peered":"2024-09-17T05:51:16.339897+0000","last_clean":"2024-09-17T05:51:16.339897+0000","last_became_active":"2024-09-17T05:51:14.348713+0000","last_became_peered":"2024-09-17T05:51:14.348713+0000","last_unstale":"2024-09-17T05:51:16.339897+0000","last_undegraded":"2024-09-17T05:51:16.339897+0000","last_fullsized":"2024-09-17T05:51:16.339897+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:51:13.315624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:51:13.315624+0000","last_clean_scrub_stamp":"2024-09-17T05:51:13.315624+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:57:40.589853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:51:14.325451+0000","last_change":"2024-09-17T05:51:14.325451+0000","last_active":"2024-09-17T05:51:14.325451+0000","last_peered":"2024-09-17T05:51:14.325451+0000","last_clean":"2024-09-17T05:51:14.325451+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:51:14.325451+0000","last_undegraded":"2024-09-17T05:51:14.325451+0000","last_fullsized":"2024-09-17T05:51:14.325451+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:51:14.325451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:51:14.325451+0000","last_clean_scrub_stamp":"2024-09-17T05:51:14.325451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.1b","version":"112'1","reported_seq":16,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-17T05:51:16.359714+0000","last_change":"2024-09-17T05:51:14.354735+0000","last_active":"2024-09-17T05:51:16.359714+0000","last_peered":"2024-09-17T05:51:16.359714+0000","last_clean":"2024-09-17T05:51:16.359714+0000","last_became_active":"2024-09-17T05:51:14.354173+0000","last_became_peered":"2024-09-17T05:51:14.354173+0000","last_unstale":"2024-09-17T05:51:16.359714+0000","last_undegraded":"2024-09-17T05:51:16.359714+0000","last_fullsized":"2024-09-17T05:51:16.359714+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:51:13.315624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:51:13.315624+0000","last_clean_scrub_stamp":"2024-09-17T05:51:13.315624+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:55:41.195206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.1b","version":"0'0","reported_seq":13,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-17T05:51:16.340908+0000","last_change":"2024-09-17T05:51:15.344677+0000","last_active":"2024-09-17T05:51:16.340908+0000","last_peered":"2024-09-17T05:51:16.340908+0000","last_clean":"2024-09-17T05:51:16.340908+0000","last_became_active":"2024-09-17T05:51:15.344361+0000","last_became_peered":"2024-09-17T05:51:15.344361+0000","last_unstale":"2024-09-17T05:51:16.340908+0000","last_undegraded":"2024-09-17T05:51:16.340908+0000","last_fullsized":"2024-09-17T05:51:16.340908+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:51:14.325451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:51:14.325451+0000","last_clean_scrub_stamp":"2024-09-17T05:51:14.325451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:21:22.687943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.1a","version":"112'1","reported_seq":16,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-17T05:51:16.341177+0000","last_change":"2024-09-17T05:51:14.353138+0000","last_active":"2024-09-17T05:51:16.341177+0000","last_peered":"2024-09-17T05:51:16.341177+0000","last_clean":"2024-09-17T05:51:16.341177+0000","last_became_active":"2024-09-17T05:51:14.352671+0000","last_became_peered":"2024-09-17T05:51:14.352671+0000","last_unstale":"2024-09-17T05:51:16.341177+0000","last_undegraded":"2024-09-17T05:51:16.341177+0000","last_fullsized":"2024-09-17T05:51:16.341177+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:51:13.315624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:51:13.315624+0000","last_clean_scrub_stamp":"2024-09-17T05:51:13.315624+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:05:44.644453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:51:14.325451+0000","last_change":"2024-09-17T05:51:14.325451+0000","last_active":"2024-09-17T05:51:14.325451+0000","last_peered":"2024-09-17T05:51:14.325451+0000","last_clean":"2024-09-17T05:51:14.325451+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:51:14.325451+0000","last_undegraded":"2024-09-17T05:51:14.325451+0000","last_fullsized":"2024-09-17T05:51:14.325451+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:51:14.325451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:51:14.325451+0000","last_clean_scrub_stamp":"2024-09-17T05:51:14.325451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.19","version":"0'0","reported_seq":15,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-17T05:51:16.340804+0000","last_change":"2024-09-17T05:51:14.356410+0000","last_active":"2024-09-17T05:51:16.340804+0000","last_peered":"2024-09-17T05:51:16.340804+0000","last_clean":"2024-09-17T05:51:16.340804+0000","last_became_active":"2024-09-17T05:51:14.356114+0000","last_became_peered":"2024-09-17T05:51:14.356114+0000","last_unstale":"2024-09-17T05:51:16.340804+0000","last_undegraded":"2024-09-17T05:51:16.340804+0000","last_fullsized":"2024-09-17T05:51:16.340804+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:51:13.315624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:51:13.315624+0000","last_clean_scrub_stamp":"2024-09-17T05:51:13.315624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:27:31.390355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.19","version":"0'0","reported_seq":13,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-17T05:51:16.359869+0000","last_change":"2024-09-17T05:51:15.358103+0000","last_active":"2024-09-17T05:51:16.359869+0000","last_peered":"2024-09-17T05:51:16.359869+0000","last_clean":"2024-09-17T05:51:16.359869+0000","last_became_active":"2024-09-17T05:51:15.357513+0000","last_became_peered":"2024-09-17T05:51:15.357513+0000","last_unstale":"2024-09-17T05:51:16.359869+0000","last_undegraded":"2024-09-17T05:51:16.359869+0000","last_fullsized":"2024-09-17T05:51:16.359869+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:51:14.325451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:51:14.325451+0000","last_clean_scrub_stamp":"2024-09-17T05:51:14.325451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:51:39.791185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.18","version":"0'0","reported_seq":1,"reported_epoch":110,"state":"creating+peering","last_fresh":"2024-09-17T05:51:13.333713+0000","last_change":"2024-09-17T05:51:13.333713+0000","last_active":"2024-09-17T05:51:13.315624+0000","last_peered":"2024-09-17T05:51:13.315624+0000","last_clean":"2024-09-17T05:51:13.315624+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:51:13.333713+0000","last_undegraded":"2024-09-17T05:51:13.333713+0000","last_fullsized":"2024-09-17T05:51:13.333713+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:51:13.315624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:51:13.315624+0000","last_clean_scrub_stamp":"2024-09-17T05:51:13.315624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.16","version":"0'0","reported_seq":13,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-17T05:51:16.360215+0000","last_change":"2024-09-17T05:51:15.357705+0000","last_active":"2024-09-17T05:51:16.360215+0000","last_peered":"2024-09-17T05:51:16.360215+0000","last_clean":"2024-09-17T05:51:16.360215+0000","last_became_active":"2024-09-17T05:51:15.357029+0000","last_became_peered":"2024-09-17T05:51:15.357029+0000","last_unstale":"2024-09-17T05:51:16.360215+0000","last_undegraded":"2024-09-17T05:51:16.360215+0000","last_fullsized":"2024-09-17T05:51:16.360215+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:51:14.325451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:51:14.325451+0000","last_clean_scrub_stamp":"2024-09-17T05:51:14.325451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:29:03.820460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.17","version":"0'0","reported_seq":15,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-17T05:51:16.339454+0000","last_change":"2024-09-17T05:51:14.353904+0000","last_active":"2024-09-17T05:51:16.339454+0000","last_peered":"2024-09-17T05:51:16.339454+0000","last_clean":"2024-09-17T05:51:16.339454+0000","last_became_active":"2024-09-17T05:51:14.353591+0000","last_became_peered":"2024-09-17T05:51:14.353591+0000","last_unstale":"2024-09-17T05:51:16.339454+0000","last_undegraded":"2024-09-17T05:51:16.339454+0000","last_fullsized":"2024-09-17T05:51:16.339454+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:51:13.315624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:51:13.315624+0000","last_clean_scrub_stamp":"2024-09-17T05:51:13.315624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:13:44.186310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.17","version":"0'0","reported_seq":13,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-17T05:51:16.357574+0000","last_change":"2024-09-17T05:51:15.361884+0000","last_active":"2024-09-17T05:51:16.357574+0000","last_peered":"2024-09-17T05:51:16.357574+0000","last_clean":"2024-09-17T05:51:16.357574+0000","last_became_active":"2024-09-17T05:51:15.361562+0000","last_became_peered":"2024-09-17T05:51:15.361562+0000","last_unstale":"2024-09-17T05:51:16.357574+0000","last_undegraded":"2024-09-17T05:51:16.357574+0000","last_fullsized":"2024-09-17T05:51:16.357574+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:51:14.325451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:51:14.325451+0000","last_clean_scrub_stamp":"2024-09-17T05:51:14.325451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:46:55.155567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.16","version":"0'0","reported_seq":15,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-17T05:51:16.340693+0000","last_change":"2024-09-17T05:51:14.351671+0000","last_active":"2024-09-17T05:51:16.340693+0000","last_peered":"2024-09-17T05:51:16.340693+0000","last_clean":"2024-09-17T05:51:16.340693+0000","last_became_active":"2024-09-17T05:51:14.351378+0000","last_became_peered":"2024-09-17T05:51:14.351378+0000","last_unstale":"2024-09-17T05:51:16.340693+0000","last_undegraded":"2024-09-17T05:51:16.340693+0000","last_fullsized":"2024-09-17T05:51:16.340693+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:51:13.315624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:51:13.315624+0000","last_clean_scrub_stamp":"2024-09-17T05:51:13.315624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:13:21.431979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.14","version":"0'0","reported_seq":13,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-17T05:51:16.341035+0000","last_change":"2024-09-17T05:51:15.348925+0000","last_active":"2024-09-17T05:51:16.341035+0000","last_peered":"2024-09-17T05:51:16.341035+0000","last_clean":"2024-09-17T05:51:16.341035+0000","last_became_active":"2024-09-17T05:51:15.348098+0000","last_became_peered":"2024-09-17T05:51:15.348098+0000","last_unstale":"2024-09-17T05:51:16.341035+0000","last_undegraded":"2024-09-17T05:51:16.341035+0000","last_fullsized":"2024-09-17T05:51:16.341035+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:51:14.325451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:51:14.325451+0000","last_clean_scrub_stamp":"2024-09-17T05:51:14.325451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:45:04.503729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.15","version":"0'0","reported_seq":1,"reported_epoch":110,"state":"creating+peering","last_fresh":"2024-09-17T05:51:13.333287+0000","last_change":"2024-09-17T05:51:13.333287+0000","last_active":"2024-09-17T05:51:13.315624+0000","last_peered":"2024-09-17T05:51:13.315624+0000","last_clean":"2024-09-17T05:51:13.315624+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:51:13.333287+0000","last_undegraded":"2024-09-17T05:51:13.333287+0000","last_fullsized":"2024-09-17T05:51:13.333287+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:51:13.315624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:51:13.315624+0000","last_clean_scrub_stamp":"2024-09-17T05:51:13.315624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.15","version":"0'0","reported_seq":13,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-17T05:51:16.359997+0000","last_change":"2024-09-17T05:51:15.354430+0000","last_active":"2024-09-17T05:51:16.359997+0000","last_peered":"2024-09-17T05:51:16.359997+0000","last_clean":"2024-09-17T05:51:16.359997+0000","last_became_active":"2024-09-17T05:51:15.353340+0000","last_became_peered":"2024-09-17T05:51:15.353340+0000","last_unstale":"2024-09-17T05:51:16.359997+0000","last_undegraded":"2024-09-17T05:51:16.359997+0000","last_fullsized":"2024-09-17T05:51:16.359997+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:51:14.325451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:51:14.325451+0000","last_clean_scrub_stamp":"2024-09-17T05:51:14.325451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:06:33.197462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.14","version":"0'0","reported_seq":1,"reported_epoch":110,"state":"creating+peering","last_fresh":"2024-09-17T05:51:13.332882+0000","last_change":"2024-09-17T05:51:13.332882+0000","last_active":"2024-09-17T05:51:13.315624+0000","last_peered":"2024-09-17T05:51:13.315624+0000","last_clean":"2024-09-17T05:51:13.315624+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:51:13.332882+0000","last_undegraded":"2024-09-17T05:51:13.332882+0000","last_fullsized":"2024-09-17T05:51:13.332882+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:51:13.315624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:51:13.315624+0000","last_clean_scrub_stamp":"2024-09-17T05:51:13.315624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.12","version":"0'0","reported_seq":13,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-17T05:51:16.341056+0000","last_change":"2024-09-17T05:51:15.343838+0000","last_active":"2024-09-17T05:51:16.341056+0000","last_peered":"2024-09-17T05:51:16.341056+0000","last_clean":"2024-09-17T05:51:16.341056+0000","last_became_active":"2024-09-17T05:51:15.342425+0000","last_became_peered":"2024-09-17T05:51:15.342425+0000","last_unstale":"2024-09-17T05:51:16.341056+0000","last_undegraded":"2024-09-17T05:51:16.341056+0000","last_fullsized":"2024-09-17T05:51:16.341056+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:51:14.325451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:51:14.325451+0000","last_clean_scrub_stamp":"2024-09-17T05:51:14.325451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:38:28.098850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.13","version":"112'2","reported_seq":17,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-17T05:51:16.750889+0000","last_change":"2024-09-17T05:51:14.351875+0000","last_active":"2024-09-17T05:51:16.750889+0000","last_peered":"2024-09-17T05:51:16.750889+0000","last_clean":"2024-09-17T05:51:16.750889+0000","last_became_active":"2024-09-17T05:51:14.351584+0000","last_became_peered":"2024-09-17T05:51:14.351584+0000","last_unstale":"2024-09-17T05:51:16.750889+0000","last_undegraded":"2024-09-17T05:51:16.750889+0000","last_fullsized":"2024-09-17T05:51:16.750889+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:51:13.315624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:51:13.315624+0000","last_clean_scrub_stamp":"2024-09-17T05:51:13.315624+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:32:52.271894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.13","version":"0'0","reported_seq":13,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-17T05:51:16.340808+0000","last_change":"2024-09-17T05:51:15.352070+0000","last_active":"2024-09-17T05:51:16.340808+0000","last_peered":"2024-09-17T05:51:16.340808+0000","last_clean":"2024-09-17T05:51:16.340808+0000","last_became_active":"2024-09-17T05:51:15.351799+0000","last_became_peered":"2024-09-17T05:51:15.351799+0000","last_unstale":"2024-09-17T05:51:16.340808+0000","last_undegraded":"2024-09-17T05:51:16.340808+0000","last_fullsized":"2024-09-17T05:51:16.340808+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:51:14.325451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:51:14.325451+0000","last_clean_scrub_stamp":"2024-09-17T05:51:14.325451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:10:29.943649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.12","version":"0'0","reported_seq":15,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-17T05:51:16.357130+0000","last_change":"2024-09-17T05:51:14.358185+0000","last_active":"2024-09-17T05:51:16.357130+0000","last_peered":"2024-09-17T05:51:16.357130+0000","last_clean":"2024-09-17T05:51:16.357130+0000","last_became_active":"2024-09-17T05:51:14.357918+0000","last_became_peered":"2024-09-17T05:51:14.357918+0000","last_unstale":"2024-09-17T05:51:16.357130+0000","last_undegraded":"2024-09-17T05:51:16.357130+0000","last_fullsized":"2024-09-17T05:51:16.357130+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:51:13.315624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:51:13.315624+0000","last_clean_scrub_stamp":"2024-09-17T05:51:13.315624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:03:42.718274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.11","version":"0'0","reported_seq":13,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-17T05:51:16.340680+0000","last_change":"2024-09-17T05:51:15.344783+0000","last_active":"2024-09-17T05:51:16.340680+0000","last_peered":"2024-09-17T05:51:16.340680+0000","last_clean":"2024-09-17T05:51:16.340680+0000","last_became_active":"2024-09-17T05:51:15.344469+0000","last_became_peered":"2024-09-17T05:51:15.344469+0000","last_unstale":"2024-09-17T05:51:16.340680+0000","last_undegraded":"2024-09-17T05:51:16.340680+0000","last_fullsized":"2024-09-17T05:51:16.340680+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:51:14.325451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:51:14.325451+0000","last_clean_scrub_stamp":"2024-09-17T05:51:14.325451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:26:02.895405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.10","version":"112'8","reported_seq":23,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-17T05:51:16.339322+0000","last_change":"2024-09-17T05:51:14.358522+0000","last_active":"2024-09-17T05:51:16.339322+0000","last_peered":"2024-09-17T05:51:16.339322+0000","last_clean":"2024-09-17T05:51:16.339322+0000","last_became_active":"2024-09-17T05:51:14.358110+0000","last_became_peered":"2024-09-17T05:51:14.358110+0000","last_unstale":"2024-09-17T05:51:16.339322+0000","last_undegraded":"2024-09-17T05:51:16.339322+0000","last_fullsized":"2024-09-17T05:51:16.339322+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:51:13.315624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:51:13.315624+0000","last_clean_scrub_stamp":"2024-09-17T05:51:13.315624+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:16:44.660311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.e","version":"0'0","reported_seq":13,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-17T05:51:16.340190+0000","last_change":"2024-09-17T05:51:15.368761+0000","last_active":"2024-09-17T05:51:16.340190+0000","last_peered":"2024-09-17T05:51:16.340190+0000","last_clean":"2024-09-17T05:51:16.340190+0000","last_became_active":"2024-09-17T05:51:15.368438+0000","last_became_peered":"2024-09-17T05:51:15.368438+0000","last_unstale":"2024-09-17T05:51:16.340190+0000","last_undegraded":"2024-09-17T05:51:16.340190+0000","last_fullsized":"2024-09-17T05:51:16.340190+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:51:14.325451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:51:14.325451+0000","last_clean_scrub_stamp":"2024-09-17T05:51:14.325451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:55:42.205033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.f","version":"0'0","reported_seq":1,"reported_epoch":110,"state":"creating+peering","last_fresh":"2024-09-17T05:51:13.332721+0000","last_change":"2024-09-17T05:51:13.332721+0000","last_active":"2024-09-17T05:51:13.315624+0000","last_peered":"2024-09-17T05:51:13.315624+0000","last_clean":"2024-09-17T05:51:13.315624+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:51:13.332721+0000","last_undegraded":"2024-09-17T05:51:13.332721+0000","last_fullsized":"2024-09-17T05:51:13.332721+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:51:13.315624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:51:13.315624+0000","last_clean_scrub_stamp":"2024-09-17T05:51:13.315624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.f","version":"0'0","reported_seq":13,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-17T05:51:16.751118+0000","last_change":"2024-09-17T05:51:15.363658+0000","last_active":"2024-09-17T05:51:16.751118+0000","last_peered":"2024-09-17T05:51:16.751118+0000","last_clean":"2024-09-17T05:51:16.751118+0000","last_became_active":"2024-09-17T05:51:15.363025+0000","last_became_peered":"2024-09-17T05:51:15.363025+0000","last_unstale":"2024-09-17T05:51:16.751118+0000","last_undegraded":"2024-09-17T05:51:16.751118+0000","last_fullsized":"2024-09-17T05:51:16.751118+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:51:14.325451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:51:14.325451+0000","last_clean_scrub_stamp":"2024-09-17T05:51:14.325451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:44:29.490228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.e","version":"112'2","reported_seq":17,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-17T05:51:16.340090+0000","last_change":"2024-09-17T05:51:14.350142+0000","last_active":"2024-09-17T05:51:16.340090+0000","last_peered":"2024-09-17T05:51:16.340090+0000","last_clean":"2024-09-17T05:51:16.340090+0000","last_became_active":"2024-09-17T05:51:14.349835+0000","last_became_peered":"2024-09-17T05:51:14.349835+0000","last_unstale":"2024-09-17T05:51:16.340090+0000","last_undegraded":"2024-09-17T05:51:16.340090+0000","last_fullsized":"2024-09-17T05:51:16.340090+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:51:13.315624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:51:13.315624+0000","last_clean_scrub_stamp":"2024-09-17T05:51:13.315624+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:18:05.652933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.c","version":"0'0","reported_seq":13,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-17T05:51:16.750603+0000","last_change":"2024-09-17T05:51:15.374005+0000","last_active":"2024-09-17T05:51:16.750603+0000","last_peered":"2024-09-17T05:51:16.750603+0000","last_clean":"2024-09-17T05:51:16.750603+0000","last_became_active":"2024-09-17T05:51:15.373697+0000","last_became_peered":"2024-09-17T05:51:15.373697+0000","last_unstale":"2024-09-17T05:51:16.750603+0000","last_undegraded":"2024-09-17T05:51:16.750603+0000","last_fullsized":"2024-09-17T05:51:16.750603+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:51:14.325451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:51:14.325451+0000","last_clean_scrub_stamp":"2024-09-17T05:51:14.325451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:52:25.457579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.d","version":"112'1","reported_seq":16,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-17T05:51:16.357350+0000","last_change":"2024-09-17T05:51:14.356064+0000","last_active":"2024-09-17T05:51:16.357350+0000","last_peered":"2024-09-17T05:51:16.357350+0000","last_clean":"2024-09-17T05:51:16.357350+0000","last_became_active":"2024-09-17T05:51:14.355680+0000","last_became_peered":"2024-09-17T05:51:14.355680+0000","last_unstale":"2024-09-17T05:51:16.357350+0000","last_undegraded":"2024-09-17T05:51:16.357350+0000","last_fullsized":"2024-09-17T05:51:16.357350+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:51:13.315624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:51:13.315624+0000","last_clean_scrub_stamp":"2024-09-17T05:51:13.315624+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:37:25.718715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.d","version":"0'0","reported_seq":13,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-17T05:51:16.750927+0000","last_change":"2024-09-17T05:51:15.360993+0000","last_active":"2024-09-17T05:51:16.750927+0000","last_peered":"2024-09-17T05:51:16.750927+0000","last_clean":"2024-09-17T05:51:16.750927+0000","last_became_active":"2024-09-17T05:51:15.360005+0000","last_became_peered":"2024-09-17T05:51:15.360005+0000","last_unstale":"2024-09-17T05:51:16.750927+0000","last_undegraded":"2024-09-17T05:51:16.750927+0000","last_fullsized":"2024-09-17T05:51:16.750927+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:51:14.325451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:51:14.325451+0000","last_clean_scrub_stamp":"2024-09-17T05:51:14.325451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:15:42.659548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.c","version":"0'0","reported_seq":15,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-17T05:51:16.359734+0000","last_change":"2024-09-17T05:51:14.356802+0000","last_active":"2024-09-17T05:51:16.359734+0000","last_peered":"2024-09-17T05:51:16.359734+0000","last_clean":"2024-09-17T05:51:16.359734+0000","last_became_active":"2024-09-17T05:51:14.356443+0000","last_became_peered":"2024-09-17T05:51:14.356443+0000","last_unstale":"2024-09-17T05:51:16.359734+0000","last_undegraded":"2024-09-17T05:51:16.359734+0000","last_fullsized":"2024-09-17T05:51:16.359734+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:51:13.315624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:51:13.315624+0000","last_clean_scrub_stamp":"2024-09-17T05:51:13.315624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:26:33.048310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.a","version":"0'0","reported_seq":13,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-17T05:51:16.750331+0000","last_change":"2024-09-17T05:51:15.354900+0000","last_active":"2024-09-17T05:51:16.750331+0000","last_peered":"2024-09-17T05:51:16.750331+0000","last_clean":"2024-09-17T05:51:16.750331+0000","last_became_active":"2024-09-17T05:51:15.354432+0000","last_became_peered":"2024-09-17T05:51:15.354432+0000","last_unstale":"2024-09-17T05:51:16.750331+0000","last_undegraded":"2024-09-17T05:51:16.750331+0000","last_fullsized":"2024-09-17T05:51:16.750331+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:51:14.325451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:51:14.325451+0000","last_clean_scrub_stamp":"2024-09-17T05:51:14.325451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:02:42.943141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.b","version":"112'2","reported_seq":17,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-17T05:51:16.751008+0000","last_change":"2024-09-17T05:51:14.351844+0000","last_active":"2024-09-17T05:51:16.751008+0000","last_peered":"2024-09-17T05:51:16.751008+0000","last_clean":"2024-09-17T05:51:16.751008+0000","last_became_active":"2024-09-17T05:51:14.351191+0000","last_became_peered":"2024-09-17T05:51:14.351191+0000","last_unstale":"2024-09-17T05:51:16.751008+0000","last_undegraded":"2024-09-17T05:51:16.751008+0000","last_fullsized":"2024-09-17T05:51:16.751008+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:51:13.315624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:51:13.315624+0000","last_clean_scrub_stamp":"2024-09-17T05:51:13.315624+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:21:47.493336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:51:14.325451+0000","last_change":"2024-09-17T05:51:14.325451+0000","last_active":"2024-09-17T05:51:14.325451+0000","last_peered":"2024-09-17T05:51:14.325451+0000","last_clean":"2024-09-17T05:51:14.325451+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:51:14.325451+0000","last_undegraded":"2024-09-17T05:51:14.325451+0000","last_fullsized":"2024-09-17T05:51:14.325451+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:51:14.325451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:51:14.325451+0000","last_clean_scrub_stamp":"2024-09-17T05:51:14.325451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.a","version":"0'0","reported_seq":15,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-17T05:51:16.339399+0000","last_change":"2024-09-17T05:51:14.355042+0000","last_active":"2024-09-17T05:51:16.339399+0000","last_peered":"2024-09-17T05:51:16.339399+0000","last_clean":"2024-09-17T05:51:16.339399+0000","last_became_active":"2024-09-17T05:51:14.354728+0000","last_became_peered":"2024-09-17T05:51:14.354728+0000","last_unstale":"2024-09-17T05:51:16.339399+0000","last_undegraded":"2024-09-17T05:51:16.339399+0000","last_fullsized":"2024-09-17T05:51:16.339399+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:51:13.315624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:51:13.315624+0000","last_clean_scrub_stamp":"2024-09-17T05:51:13.315624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:03:36.768537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.8","version":"0'0","reported_seq":13,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-17T05:51:16.750402+0000","last_change":"2024-09-17T05:51:15.357234+0000","last_active":"2024-09-17T05:51:16.750402+0000","last_peered":"2024-09-17T05:51:16.750402+0000","last_clean":"2024-09-17T05:51:16.750402+0000","last_became_active":"2024-09-17T05:51:15.356159+0000","last_became_peered":"2024-09-17T05:51:15.356159+0000","last_unstale":"2024-09-17T05:51:16.750402+0000","last_undegraded":"2024-09-17T05:51:16.750402+0000","last_fullsized":"2024-09-17T05:51:16.750402+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:51:14.325451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:51:14.325451+0000","last_clean_scrub_stamp":"2024-09-17T05:51:14.325451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:12:11.367770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.9","version":"0'0","reported_seq":15,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-17T05:51:16.750271+0000","last_change":"2024-09-17T05:51:14.348936+0000","last_active":"2024-09-17T05:51:16.750271+0000","last_peered":"2024-09-17T05:51:16.750271+0000","last_clean":"2024-09-17T05:51:16.750271+0000","last_became_active":"2024-09-17T05:51:14.348618+0000","last_became_peered":"2024-09-17T05:51:14.348618+0000","last_unstale":"2024-09-17T05:51:16.750271+0000","last_undegraded":"2024-09-17T05:51:16.750271+0000","last_fullsized":"2024-09-17T05:51:16.750271+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:51:13.315624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:51:13.315624+0000","last_clean_scrub_stamp":"2024-09-17T05:51:13.315624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:03:36.561055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.9","version":"0'0","reported_seq":13,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-17T05:51:16.340732+0000","last_change":"2024-09-17T05:51:15.359252+0000","last_active":"2024-09-17T05:51:16.340732+0000","last_peered":"2024-09-17T05:51:16.340732+0000","last_clean":"2024-09-17T05:51:16.340732+0000","last_became_active":"2024-09-17T05:51:15.358940+0000","last_became_peered":"2024-09-17T05:51:15.358940+0000","last_unstale":"2024-09-17T05:51:16.340732+0000","last_undegraded":"2024-09-17T05:51:16.340732+0000","last_fullsized":"2024-09-17T05:51:16.340732+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:51:14.325451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:51:14.325451+0000","last_clean_scrub_stamp":"2024-09-17T05:51:14.325451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:12:03.752583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.8","version":"0'0","reported_seq":1,"reported_epoch":110,"state":"creating+peering","last_fresh":"2024-09-17T05:51:13.333212+0000","last_change":"2024-09-17T05:51:13.333212+0000","last_active":"2024-09-17T05:51:13.315624+0000","last_peered":"2024-09-17T05:51:13.315624+0000","last_clean":"2024-09-17T05:51:13.315624+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:51:13.333212+0000","last_undegraded":"2024-09-17T05:51:13.333212+0000","last_fullsized":"2024-09-17T05:51:13.333212+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:51:13.315624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:51:13.315624+0000","last_clean_scrub_stamp":"2024-09-17T05:51:13.315624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.6","version":"0'0","reported_seq":13,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-17T05:51:16.357443+0000","last_change":"2024-09-17T05:51:15.365607+0000","last_active":"2024-09-17T05:51:16.357443+0000","last_peered":"2024-09-17T05:51:16.357443+0000","last_clean":"2024-09-17T05:51:16.357443+0000","last_became_active":"2024-09-17T05:51:15.365266+0000","last_became_peered":"2024-09-17T05:51:15.365266+0000","last_unstale":"2024-09-17T05:51:16.357443+0000","last_undegraded":"2024-09-17T05:51:16.357443+0000","last_fullsized":"2024-09-17T05:51:16.357443+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:51:14.325451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:51:14.325451+0000","last_clean_scrub_stamp":"2024-09-17T05:51:14.325451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:49:28.476795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.7","version":"112'2","reported_seq":17,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-17T05:51:16.340820+0000","last_change":"2024-09-17T05:51:14.358131+0000","last_active":"2024-09-17T05:51:16.340820+0000","last_peered":"2024-09-17T05:51:16.340820+0000","last_clean":"2024-09-17T05:51:16.340820+0000","last_became_active":"2024-09-17T05:51:14.357812+0000","last_became_peered":"2024-09-17T05:51:14.357812+0000","last_unstale":"2024-09-17T05:51:16.340820+0000","last_undegraded":"2024-09-17T05:51:16.340820+0000","last_fullsized":"2024-09-17T05:51:16.340820+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:51:13.315624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:51:13.315624+0000","last_clean_scrub_stamp":"2024-09-17T05:51:13.315624+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:00:46.227529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:51:14.325451+0000","last_change":"2024-09-17T05:51:14.325451+0000","last_active":"2024-09-17T05:51:14.325451+0000","last_peered":"2024-09-17T05:51:14.325451+0000","last_clean":"2024-09-17T05:51:14.325451+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:51:14.325451+0000","last_undegraded":"2024-09-17T05:51:14.325451+0000","last_fullsized":"2024-09-17T05:51:14.325451+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:51:14.325451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:51:14.325451+0000","last_clean_scrub_stamp":"2024-09-17T05:51:14.325451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.6","version":"113'1","reported_seq":16,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-17T05:51:16.357547+0000","last_change":"2024-09-17T05:51:14.353668+0000","last_active":"2024-09-17T05:51:16.357547+0000","last_peered":"2024-09-17T05:51:16.357547+0000","last_clean":"2024-09-17T05:51:16.357547+0000","last_became_active":"2024-09-17T05:51:14.353344+0000","last_became_peered":"2024-09-17T05:51:14.353344+0000","last_unstale":"2024-09-17T05:51:16.357547+0000","last_undegraded":"2024-09-17T05:51:16.357547+0000","last_fullsized":"2024-09-17T05:51:16.357547+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:51:13.315624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:51:13.315624+0000","last_clean_scrub_stamp":"2024-09-17T05:51:13.315624+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:56:25.324024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:51:14.325451+0000","last_change":"2024-09-17T05:51:14.325451+0000","last_active":"2024-09-17T05:51:14.325451+0000","last_peered":"2024-09-17T05:51:14.325451+0000","last_clean":"2024-09-17T05:51:14.325451+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:51:14.325451+0000","last_undegraded":"2024-09-17T05:51:14.325451+0000","last_fullsized":"2024-09-17T05:51:14.325451+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:51:14.325451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:51:14.325451+0000","last_clean_scrub_stamp":"2024-09-17T05:51:14.325451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.5","version":"0'0","reported_seq":1,"reported_epoch":110,"state":"creating+peering","last_fresh":"2024-09-17T05:51:13.332782+0000","last_change":"2024-09-17T05:51:13.332782+0000","last_active":"2024-09-17T05:51:13.315624+0000","last_peered":"2024-09-17T05:51:13.315624+0000","last_clean":"2024-09-17T05:51:13.315624+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:51:13.332782+0000","last_undegraded":"2024-09-17T05:51:13.332782+0000","last_fullsized":"2024-09-17T05:51:13.332782+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:51:13.315624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:51:13.315624+0000","last_clean_scrub_stamp":"2024-09-17T05:51:13.315624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.5","version":"0'0","reported_seq":13,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-17T05:51:16.357324+0000","last_change":"2024-09-17T05:51:15.363844+0000","last_active":"2024-09-17T05:51:16.357324+0000","last_peered":"2024-09-17T05:51:16.357324+0000","last_clean":"2024-09-17T05:51:16.357324+0000","last_became_active":"2024-09-17T05:51:15.363465+0000","last_became_peered":"2024-09-17T05:51:15.363465+0000","last_unstale":"2024-09-17T05:51:16.357324+0000","last_undegraded":"2024-09-17T05:51:16.357324+0000","last_fullsized":"2024-09-17T05:51:16.357324+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:51:14.325451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:51:14.325451+0000","last_clean_scrub_stamp":"2024-09-17T05:51:14.325451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:17:42.550657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.4","version":"0'0","reported_seq":15,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-17T05:51:16.341090+0000","last_change":"2024-09-17T05:51:14.350349+0000","last_active":"2024-09-17T05:51:16.341090+0000","last_peered":"2024-09-17T05:51:16.341090+0000","last_clean":"2024-09-17T05:51:16.341090+0000","last_became_active":"2024-09-17T05:51:14.350017+0000","last_became_peered":"2024-09-17T05:51:14.350017+0000","last_unstale":"2024-09-17T05:51:16.341090+0000","last_undegraded":"2024-09-17T05:51:16.341090+0000","last_fullsized":"2024-09-17T05:51:16.341090+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:51:13.315624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:51:13.315624+0000","last_clean_scrub_stamp":"2024-09-17T05:51:13.315624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:31:26.485537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.2","version":"0'0","reported_seq":13,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-17T05:51:16.340588+0000","last_change":"2024-09-17T05:51:15.345136+0000","last_active":"2024-09-17T05:51:16.340588+0000","last_peered":"2024-09-17T05:51:16.340588+0000","last_clean":"2024-09-17T05:51:16.340588+0000","last_became_active":"2024-09-17T05:51:15.344810+0000","last_became_peered":"2024-09-17T05:51:15.344810+0000","last_unstale":"2024-09-17T05:51:16.340588+0000","last_undegraded":"2024-09-17T05:51:16.340588+0000","last_fullsized":"2024-09-17T05:51:16.340588+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:51:14.325451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:51:14.325451+0000","last_clean_scrub_stamp":"2024-09-17T05:51:14.325451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:46:58.628756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.3","version":"0'0","reported_seq":15,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-17T05:51:16.359885+0000","last_change":"2024-09-17T05:51:14.352438+0000","last_active":"2024-09-17T05:51:16.359885+0000","last_peered":"2024-09-17T05:51:16.359885+0000","last_clean":"2024-09-17T05:51:16.359885+0000","last_became_active":"2024-09-17T05:51:14.352097+0000","last_became_peered":"2024-09-17T05:51:14.352097+0000","last_unstale":"2024-09-17T05:51:16.359885+0000","last_undegraded":"2024-09-17T05:51:16.359885+0000","last_fullsized":"2024-09-17T05:51:16.359885+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:51:13.315624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:51:13.315624+0000","last_clean_scrub_stamp":"2024-09-17T05:51:13.315624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:42:26.091891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.3","version":"0'0","reported_seq":13,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-17T05:51:16.340998+0000","last_change":"2024-09-17T05:51:15.359800+0000","last_active":"2024-09-17T05:51:16.340998+0000","last_peered":"2024-09-17T05:51:16.340998+0000","last_clean":"2024-09-17T05:51:16.340998+0000","last_became_active":"2024-09-17T05:51:15.357898+0000","last_became_peered":"2024-09-17T05:51:15.357898+0000","last_unstale":"2024-09-17T05:51:16.340998+0000","last_undegraded":"2024-09-17T05:51:16.340998+0000","last_fullsized":"2024-09-17T05:51:16.340998+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:51:14.325451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:51:14.325451+0000","last_clean_scrub_stamp":"2024-09-17T05:51:14.325451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:44:07.877112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.2","version":"0'0","reported_seq":15,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-17T05:51:16.340331+0000","last_change":"2024-09-17T05:51:14.355271+0000","last_active":"2024-09-17T05:51:16.340331+0000","last_peered":"2024-09-17T05:51:16.340331+0000","last_clean":"2024-09-17T05:51:16.340331+0000","last_became_active":"2024-09-17T05:51:14.354782+0000","last_became_peered":"2024-09-17T05:51:14.354782+0000","last_unstale":"2024-09-17T05:51:16.340331+0000","last_undegraded":"2024-09-17T05:51:16.340331+0000","last_fullsized":"2024-09-17T05:51:16.340331+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:51:13.315624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:51:13.315624+0000","last_clean_scrub_stamp":"2024-09-17T05:51:13.315624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:28:04.514097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.0","version":"0'0","reported_seq":13,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-17T05:51:16.750649+0000","last_change":"2024-09-17T05:51:15.358735+0000","last_active":"2024-09-17T05:51:16.750649+0000","last_peered":"2024-09-17T05:51:16.750649+0000","last_clean":"2024-09-17T05:51:16.750649+0000","last_became_active":"2024-09-17T05:51:15.358337+0000","last_became_peered":"2024-09-17T05:51:15.358337+0000","last_unstale":"2024-09-17T05:51:16.750649+0000","last_undegraded":"2024-09-17T05:51:16.750649+0000","last_fullsized":"2024-09-17T05:51:16.750649+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:51:14.325451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:51:14.325451+0000","last_clean_scrub_stamp":"2024-09-17T05:51:14.325451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:23:41.242455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.1","version":"0'0","reported_seq":15,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-17T05:51:16.339383+0000","last_change":"2024-09-17T05:51:14.352047+0000","last_active":"2024-09-17T05:51:16.339383+0000","last_peered":"2024-09-17T05:51:16.339383+0000","last_clean":"2024-09-17T05:51:16.339383+0000","last_became_active":"2024-09-17T05:51:14.351529+0000","last_became_peered":"2024-09-17T05:51:14.351529+0000","last_unstale":"2024-09-17T05:51:16.339383+0000","last_undegraded":"2024-09-17T05:51:16.339383+0000","last_fullsized":"2024-09-17T05:51:16.339383+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:51:13.315624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:51:13.315624+0000","last_clean_scrub_stamp":"2024-09-17T05:51:13.315624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:58:57.809988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:51:14.325451+0000","last_change":"2024-09-17T05:51:14.325451+0000","last_active":"2024-09-17T05:51:14.325451+0000","last_peered":"2024-09-17T05:51:14.325451+0000","last_clean":"2024-09-17T05:51:14.325451+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:51:14.325451+0000","last_undegraded":"2024-09-17T05:51:14.325451+0000","last_fullsized":"2024-09-17T05:51:14.325451+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:51:14.325451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:51:14.325451+0000","last_clean_scrub_stamp":"2024-09-17T05:51:14.325451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.0","version":"0'0","reported_seq":1,"reported_epoch":110,"state":"creating+peering","last_fresh":"2024-09-17T05:51:13.332654+0000","last_change":"2024-09-17T05:51:13.332654+0000","last_active":"2024-09-17T05:51:13.315624+0000","last_peered":"2024-09-17T05:51:13.315624+0000","last_clean":"2024-09-17T05:51:13.315624+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:51:13.332654+0000","last_undegraded":"2024-09-17T05:51:13.332654+0000","last_fullsized":"2024-09-17T05:51:13.332654+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:51:13.315624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:51:13.315624+0000","last_clean_scrub_stamp":"2024-09-17T05:51:13.315624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.10","version":"0'0","reported_seq":13,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-17T05:51:16.340473+0000","last_change":"2024-09-17T05:51:15.351750+0000","last_active":"2024-09-17T05:51:16.340473+0000","last_peered":"2024-09-17T05:51:16.340473+0000","last_clean":"2024-09-17T05:51:16.340473+0000","last_became_active":"2024-09-17T05:51:15.351076+0000","last_became_peered":"2024-09-17T05:51:15.351076+0000","last_unstale":"2024-09-17T05:51:16.340473+0000","last_undegraded":"2024-09-17T05:51:16.340473+0000","last_fullsized":"2024-09-17T05:51:16.340473+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:51:14.325451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:51:14.325451+0000","last_clean_scrub_stamp":"2024-09-17T05:51:14.325451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:49:55.636228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.11","version":"0'0","reported_seq":15,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-17T05:51:16.360020+0000","last_change":"2024-09-17T05:51:14.358432+0000","last_active":"2024-09-17T05:51:16.360020+0000","last_peered":"2024-09-17T05:51:16.360020+0000","last_clean":"2024-09-17T05:51:16.360020+0000","last_became_active":"2024-09-17T05:51:14.358059+0000","last_became_peered":"2024-09-17T05:51:14.358059+0000","last_unstale":"2024-09-17T05:51:16.360020+0000","last_undegraded":"2024-09-17T05:51:16.360020+0000","last_fullsized":"2024-09-17T05:51:16.360020+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:51:13.315624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:51:13.315624+0000","last_clean_scrub_stamp":"2024-09-17T05:51:13.315624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:32:58.129426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"19'72","reported_seq":276,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-17T05:51:16.750680+0000","last_change":"2024-09-17T05:41:48.539830+0000","last_active":"2024-09-17T05:51:16.750680+0000","last_peered":"2024-09-17T05:51:16.750680+0000","last_clean":"2024-09-17T05:51:16.750680+0000","last_became_active":"2024-09-17T05:41:48.538743+0000","last_became_peered":"2024-09-17T05:41:48.538743+0000","last_unstale":"2024-09-17T05:51:16.750680+0000","last_undegraded":"2024-09-17T05:51:16.750680+0000","last_fullsized":"2024-09-17T05:51:16.750680+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:47.152539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:47.152539+0000","last_clean_scrub_stamp":"2024-09-17T05:41:47.152539+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:08:02.952016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":17,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":100,"acting":100,"num_store_stats":7},{"poolid":16,"num_pg":32,"stat_sum":{"num_bytes":686,"num_objects":15,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":34,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":12,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":3096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":29,"ondisk_log_size":29,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":16,"seq":68719476855,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":122740,"kb_used_data":1368,"kb_used_omap":1,"kb_used_meta":121342,"kb_avail":94249100,"statfs":{"total":96636764160,"available":96511078400,"internally_reserved":0,"allocated":1400832,"data_stored":608982,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":124254662},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":7,"up_from":15,"seq":64424509559,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":131624,"kb_used_data":1940,"kb_used_omap":1,"kb_used_meta":129662,"kb_avail":94240216,"statfs":{"total":96636764160,"available":96501981184,"internally_reserved":0,"allocated":1986560,"data_stored":1193456,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":132774346},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509558,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":108844,"kb_used_data":1360,"kb_used_omap":1,"kb_used_meta":107454,"kb_avail":94262996,"statfs":{"total":96636764160,"available":96525307904,"internally_reserved":0,"allocated":1392640,"data_stored":603076,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":110033349},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509558,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":136624,"kb_used_data":1364,"kb_used_omap":1,"kb_used_meta":135230,"kb_avail":94235216,"statfs":{"total":96636764160,"available":96496861184,"internally_reserved":0,"allocated":1396736,"data_stored":608912,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":138475973},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509558,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":131064,"kb_used_data":1380,"kb_used_omap":1,"kb_used_meta":129662,"kb_avail":94240776,"statfs":{"total":96636764160,"available":96502554624,"internally_reserved":0,"allocated":1413120,"data_stored":610594,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":132774343},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509558,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":136620,"kb_used_data":1364,"kb_used_omap":1,"kb_used_meta":135230,"kb_avail":94235220,"statfs":{"total":96636764160,"available":96496865280,"internally_reserved":0,"allocated":1396736,"data_stored":608912,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":138475973},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509558,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":122740,"kb_used_data":1372,"kb_used_omap":1,"kb_used_meta":121342,"kb_avail":94249100,"statfs":{"total":96636764160,"available":96511078400,"internally_reserved":0,"allocated":1404928,"data_stored":609036,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":124254661},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574965,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":119104,"kb_used_data":1896,"kb_used_omap":1,"kb_used_meta":117182,"kb_avail":94252736,"statfs":{"total":96636764160,"available":96514801664,"internally_reserved":0,"allocated":1941504,"data_stored":1173553,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":119994821},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1682,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-17T05:51:19.365 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-17T05:51:19.514 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:19.513+0000 7fc0fbf13640 1 -- 172.21.15.150:0/3921749071 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc0f41592d0 msgr2=0x7fc0f4073490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:51:19.514 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:19.513+0000 7fc0fbf13640 1 --2- 172.21.15.150:0/3921749071 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc0f41592d0 0x7fc0f4073490 secure :-1 s=READY pgs=1497 cs=0 l=1 rev1=1 crypto rx=0x7fc0f0009830 tx=0x7fc0f002a510 comp rx=0 tx=0).stop 2024-09-17T05:51:19.514 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:19.513+0000 7fc0fbf13640 1 -- 172.21.15.150:0/3921749071 shutdown_connections 2024-09-17T05:51:19.514 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:19.513+0000 7fc0fbf13640 1 --2- 172.21.15.150:0/3921749071 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc0f40cfac0 0x7fc0f40b52f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:51:19.514 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:19.513+0000 7fc0fbf13640 1 --2- 172.21.15.150:0/3921749071 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc0f41592d0 0x7fc0f4073490 unknown :-1 s=CLOSED pgs=1497 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:51:19.514 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:19.513+0000 7fc0fbf13640 1 -- 172.21.15.150:0/3921749071 >> 172.21.15.150:0/3921749071 conn(0x7fc0f40d06d0 msgr2=0x7fc0f40d0ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:51:19.514 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:19.513+0000 7fc0fbf13640 1 -- 172.21.15.150:0/3921749071 shutdown_connections 2024-09-17T05:51:19.514 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:19.513+0000 7fc0fbf13640 1 -- 172.21.15.150:0/3921749071 wait complete. 2024-09-17T05:51:19.515 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:19.515+0000 7fc0fbf13640 1 Processor -- start 2024-09-17T05:51:19.515 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:19.515+0000 7fc0fbf13640 1 -- start start 2024-09-17T05:51:19.518 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:19.516+0000 7fc0fbf13640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc0f40739d0 0x7fc0f4145790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:51:19.518 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:19.516+0000 7fc0fbf13640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc0f41592d0 0x7fc0f41f6770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:51:19.518 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:19.516+0000 7fc0fbf13640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc0f40af470 0x7fc0f41f6cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:51:19.518 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:19.516+0000 7fc0fbf13640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7fc0f40b5e30 con 0x7fc0f40739d0 2024-09-17T05:51:19.518 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:19.516+0000 7fc0fbf13640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fc0f40b5cb0 con 0x7fc0f41592d0 2024-09-17T05:51:19.518 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:19.516+0000 7fc0fbf13640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fc0f40b5fb0 con 0x7fc0f40af470 2024-09-17T05:51:19.518 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:19.516+0000 7fc0f9caf640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc0f40739d0 0x7fc0f4145790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:51:19.518 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:19.516+0000 7fc0f9caf640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc0f40739d0 0x7fc0f4145790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:50384/0 (socket says 172.21.15.150:50384) 2024-09-17T05:51:19.518 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:19.516+0000 7fc0f9caf640 1 -- 172.21.15.150:0/727150753 learned_addr learned my addr 172.21.15.150:0/727150753 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:51:19.518 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:19.516+0000 7fc0f9caf640 1 -- 172.21.15.150:0/727150753 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc0f40af470 msgr2=0x7fc0f41f6cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:51:19.518 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:19.516+0000 7fc0f9caf640 1 --2- 172.21.15.150:0/727150753 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc0f40af470 0x7fc0f41f6cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:51:19.519 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:19.516+0000 7fc0f9caf640 1 -- 172.21.15.150:0/727150753 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc0f41592d0 msgr2=0x7fc0f41f6770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:51:19.519 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:19.516+0000 7fc0f9caf640 1 --2- 172.21.15.150:0/727150753 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc0f41592d0 0x7fc0f41f6770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:51:19.519 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:19.516+0000 7fc0f9caf640 1 -- 172.21.15.150:0/727150753 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc0f41e7dc0 con 0x7fc0f40739d0 2024-09-17T05:51:19.519 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:19.517+0000 7fc0f9caf640 1 --2- 172.21.15.150:0/727150753 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc0f40739d0 0x7fc0f4145790 secure :-1 s=READY pgs=1498 cs=0 l=1 rev1=1 crypto rx=0x7fc0f0009950 tx=0x7fc0f0033d60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:51:19.519 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:19.517+0000 7fc0ea7fc640 1 -- 172.21.15.150:0/727150753 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0f0031d60 con 0x7fc0f40739d0 2024-09-17T05:51:19.519 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:19.517+0000 7fc0ea7fc640 1 -- 172.21.15.150:0/727150753 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc0f00330d0 con 0x7fc0f40739d0 2024-09-17T05:51:19.519 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:19.517+0000 7fc0ea7fc640 1 -- 172.21.15.150:0/727150753 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0f0033520 con 0x7fc0f40739d0 2024-09-17T05:51:19.519 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:19.517+0000 7fc0fbf13640 1 -- 172.21.15.150:0/727150753 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc0f41567e0 con 0x7fc0f40739d0 2024-09-17T05:51:19.519 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:19.517+0000 7fc0fbf13640 1 -- 172.21.15.150:0/727150753 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc0f4156da0 con 0x7fc0f40739d0 2024-09-17T05:51:19.520 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:19.518+0000 7fc0fbf13640 1 -- 172.21.15.150:0/727150753 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc0f40b6460 con 0x7fc0f40739d0 2024-09-17T05:51:19.520 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:19.519+0000 7fc0ea7fc640 1 -- 172.21.15.150:0/727150753 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 37) ==== 103787+0+0 (secure 0 0 0) 0x7fc0f00035f0 con 0x7fc0f40739d0 2024-09-17T05:51:19.520 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:19.519+0000 7fc0ea7fc640 1 --2- 172.21.15.150:0/727150753 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fc0d807a5a0 0x7fc0d807cab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:51:19.520 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:19.519+0000 7fc0ea7fc640 1 -- 172.21.15.150:0/727150753 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(113..113 src has 1..113) ==== 5849+0+0 (secure 0 0 0) 0x7fc0f00bb070 con 0x7fc0f40739d0 2024-09-17T05:51:19.520 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:19.520+0000 7fc0f94ae640 1 --2- 172.21.15.150:0/727150753 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fc0d807a5a0 0x7fc0d807cab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:51:19.521 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:19.520+0000 7fc0f94ae640 1 --2- 172.21.15.150:0/727150753 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fc0d807a5a0 0x7fc0d807cab0 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7fc0f40b1dc0 tx=0x7fc0e4007930 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:51:19.524 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:19.524+0000 7fc0ea7fc640 1 -- 172.21.15.150:0/727150753 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fc0f003f030 con 0x7fc0f40739d0 2024-09-17T05:51:19.697 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:19.696+0000 7fc0fbf13640 1 -- 172.21.15.150:0/727150753 --> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fc0f41429c0 con 0x7fc0d807a5a0 2024-09-17T05:51:19.701 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:19.701+0000 7fc0ea7fc640 1 -- 172.21.15.150:0/727150753 <== mgr.4108 v2:172.21.15.176:6800/3631216395 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+249997 (secure 0 0 0) 0x7fc0e40050d0 con 0x7fc0d807a5a0 2024-09-17T05:51:19.704 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-09-17T05:51:19.705 INFO:teuthology.orchestra.run.smithi150.stderr:dumped all 2024-09-17T05:51:19.707 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:19.704+0000 7fc0fbf13640 1 -- 172.21.15.150:0/727150753 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fc0d807a5a0 msgr2=0x7fc0d807cab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:51:19.707 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:19.704+0000 7fc0fbf13640 1 --2- 172.21.15.150:0/727150753 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fc0d807a5a0 0x7fc0d807cab0 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7fc0f40b1dc0 tx=0x7fc0e4007930 comp rx=0 tx=0).stop 2024-09-17T05:51:19.707 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:19.704+0000 7fc0fbf13640 1 -- 172.21.15.150:0/727150753 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc0f40739d0 msgr2=0x7fc0f4145790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:51:19.707 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:19.704+0000 7fc0fbf13640 1 --2- 172.21.15.150:0/727150753 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc0f40739d0 0x7fc0f4145790 secure :-1 s=READY pgs=1498 cs=0 l=1 rev1=1 crypto rx=0x7fc0f0009950 tx=0x7fc0f0033d60 comp rx=0 tx=0).stop 2024-09-17T05:51:19.707 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:19.704+0000 7fc0fbf13640 1 -- 172.21.15.150:0/727150753 shutdown_connections 2024-09-17T05:51:19.708 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:19.704+0000 7fc0fbf13640 1 --2- 172.21.15.150:0/727150753 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc0f41592d0 0x7fc0f41f6770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:51:19.708 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:19.704+0000 7fc0fbf13640 1 --2- 172.21.15.150:0/727150753 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fc0d807a5a0 0x7fc0d807cab0 unknown :-1 s=CLOSED pgs=640 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:51:19.708 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:19.704+0000 7fc0fbf13640 1 --2- 172.21.15.150:0/727150753 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc0f40af470 0x7fc0f41f6cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:51:19.708 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:19.704+0000 7fc0fbf13640 1 --2- 172.21.15.150:0/727150753 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc0f40739d0 0x7fc0f4145790 unknown :-1 s=CLOSED pgs=1498 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:51:19.708 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:19.704+0000 7fc0fbf13640 1 -- 172.21.15.150:0/727150753 >> 172.21.15.150:0/727150753 conn(0x7fc0f40d06d0 msgr2=0x7fc0f4071740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:51:19.708 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:19.704+0000 7fc0fbf13640 1 -- 172.21.15.150:0/727150753 shutdown_connections 2024-09-17T05:51:19.708 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:19.704+0000 7fc0fbf13640 1 -- 172.21.15.150:0/727150753 wait complete. 2024-09-17T05:51:19.717 INFO:teuthology.orchestra.run.smithi150.stdout:{"pg_ready":true,"pg_map":{"version":394,"stamp":"2024-09-17T05:51:19.058233+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":591054,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":135,"num_write_kb":1637,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":12,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":101,"ondisk_log_size":101,"up":166,"acting":166,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":98,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":1009360,"kb_used_data":12044,"kb_used_omap":12,"kb_used_meta":997107,"kb_avail":753965360,"statfs":{"total":773094113280,"available":772060528640,"internally_reserved":0,"allocated":12333056,"data_stored":6016521,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":1021038128},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":17,"apply_latency_ms":17,"commit_latency_ns":17000000,"apply_latency_ns":17000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":686,"num_objects":15,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":34,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":12,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.726990"},"pg_stats":[{"pgid":"17.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:51:14.325451+0000","last_change":"2024-09-17T05:51:14.325451+0000","last_active":"2024-09-17T05:51:14.325451+0000","last_peered":"2024-09-17T05:51:14.325451+0000","last_clean":"2024-09-17T05:51:14.325451+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:51:14.325451+0000","last_undegraded":"2024-09-17T05:51:14.325451+0000","last_fullsized":"2024-09-17T05:51:14.325451+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:51:14.325451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:51:14.325451+0000","last_clean_scrub_stamp":"2024-09-17T05:51:14.325451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.3e","version":"0'0","reported_seq":13,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-17T05:51:16.340640+0000","last_change":"2024-09-17T05:51:15.344958+0000","last_active":"2024-09-17T05:51:16.340640+0000","last_peered":"2024-09-17T05:51:16.340640+0000","last_clean":"2024-09-17T05:51:16.340640+0000","last_became_active":"2024-09-17T05:51:15.344518+0000","last_became_peered":"2024-09-17T05:51:15.344518+0000","last_unstale":"2024-09-17T05:51:16.340640+0000","last_undegraded":"2024-09-17T05:51:16.340640+0000","last_fullsized":"2024-09-17T05:51:16.340640+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:51:14.325451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:51:14.325451+0000","last_clean_scrub_stamp":"2024-09-17T05:51:14.325451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:49:40.516537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.3d","version":"0'0","reported_seq":13,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-17T05:51:16.750744+0000","last_change":"2024-09-17T05:51:15.352551+0000","last_active":"2024-09-17T05:51:16.750744+0000","last_peered":"2024-09-17T05:51:16.750744+0000","last_clean":"2024-09-17T05:51:16.750744+0000","last_became_active":"2024-09-17T05:51:15.352223+0000","last_became_peered":"2024-09-17T05:51:15.352223+0000","last_unstale":"2024-09-17T05:51:16.750744+0000","last_undegraded":"2024-09-17T05:51:16.750744+0000","last_fullsized":"2024-09-17T05:51:16.750744+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:51:14.325451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:51:14.325451+0000","last_clean_scrub_stamp":"2024-09-17T05:51:14.325451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:56:32.607756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:51:14.325451+0000","last_change":"2024-09-17T05:51:14.325451+0000","last_active":"2024-09-17T05:51:14.325451+0000","last_peered":"2024-09-17T05:51:14.325451+0000","last_clean":"2024-09-17T05:51:14.325451+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:51:14.325451+0000","last_undegraded":"2024-09-17T05:51:14.325451+0000","last_fullsized":"2024-09-17T05:51:14.325451+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:51:14.325451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:51:14.325451+0000","last_clean_scrub_stamp":"2024-09-17T05:51:14.325451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.3b","version":"0'0","reported_seq":13,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-17T05:51:16.339755+0000","last_change":"2024-09-17T05:51:15.354740+0000","last_active":"2024-09-17T05:51:16.339755+0000","last_peered":"2024-09-17T05:51:16.339755+0000","last_clean":"2024-09-17T05:51:16.339755+0000","last_became_active":"2024-09-17T05:51:15.354441+0000","last_became_peered":"2024-09-17T05:51:15.354441+0000","last_unstale":"2024-09-17T05:51:16.339755+0000","last_undegraded":"2024-09-17T05:51:16.339755+0000","last_fullsized":"2024-09-17T05:51:16.339755+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:51:14.325451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:51:14.325451+0000","last_clean_scrub_stamp":"2024-09-17T05:51:14.325451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:01:13.224376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.3a","version":"0'0","reported_seq":13,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-17T05:51:16.750534+0000","last_change":"2024-09-17T05:51:15.349818+0000","last_active":"2024-09-17T05:51:16.750534+0000","last_peered":"2024-09-17T05:51:16.750534+0000","last_clean":"2024-09-17T05:51:16.750534+0000","last_became_active":"2024-09-17T05:51:15.349457+0000","last_became_peered":"2024-09-17T05:51:15.349457+0000","last_unstale":"2024-09-17T05:51:16.750534+0000","last_undegraded":"2024-09-17T05:51:16.750534+0000","last_fullsized":"2024-09-17T05:51:16.750534+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:51:14.325451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:51:14.325451+0000","last_clean_scrub_stamp":"2024-09-17T05:51:14.325451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:08:40.638937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.39","version":"0'0","reported_seq":13,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-17T05:51:16.360003+0000","last_change":"2024-09-17T05:51:15.358171+0000","last_active":"2024-09-17T05:51:16.360003+0000","last_peered":"2024-09-17T05:51:16.360003+0000","last_clean":"2024-09-17T05:51:16.360003+0000","last_became_active":"2024-09-17T05:51:15.357838+0000","last_became_peered":"2024-09-17T05:51:15.357838+0000","last_unstale":"2024-09-17T05:51:16.360003+0000","last_undegraded":"2024-09-17T05:51:16.360003+0000","last_fullsized":"2024-09-17T05:51:16.360003+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:51:14.325451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:51:14.325451+0000","last_clean_scrub_stamp":"2024-09-17T05:51:14.325451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:20:00.031149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.38","version":"0'0","reported_seq":13,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-17T05:51:16.750342+0000","last_change":"2024-09-17T05:51:15.361077+0000","last_active":"2024-09-17T05:51:16.750342+0000","last_peered":"2024-09-17T05:51:16.750342+0000","last_clean":"2024-09-17T05:51:16.750342+0000","last_became_active":"2024-09-17T05:51:15.359954+0000","last_became_peered":"2024-09-17T05:51:15.359954+0000","last_unstale":"2024-09-17T05:51:16.750342+0000","last_undegraded":"2024-09-17T05:51:16.750342+0000","last_fullsized":"2024-09-17T05:51:16.750342+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:51:14.325451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:51:14.325451+0000","last_clean_scrub_stamp":"2024-09-17T05:51:14.325451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:40:17.074211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:51:14.325451+0000","last_change":"2024-09-17T05:51:14.325451+0000","last_active":"2024-09-17T05:51:14.325451+0000","last_peered":"2024-09-17T05:51:14.325451+0000","last_clean":"2024-09-17T05:51:14.325451+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:51:14.325451+0000","last_undegraded":"2024-09-17T05:51:14.325451+0000","last_fullsized":"2024-09-17T05:51:14.325451+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:51:14.325451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:51:14.325451+0000","last_clean_scrub_stamp":"2024-09-17T05:51:14.325451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:51:14.325451+0000","last_change":"2024-09-17T05:51:14.325451+0000","last_active":"2024-09-17T05:51:14.325451+0000","last_peered":"2024-09-17T05:51:14.325451+0000","last_clean":"2024-09-17T05:51:14.325451+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:51:14.325451+0000","last_undegraded":"2024-09-17T05:51:14.325451+0000","last_fullsized":"2024-09-17T05:51:14.325451+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:51:14.325451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:51:14.325451+0000","last_clean_scrub_stamp":"2024-09-17T05:51:14.325451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.35","version":"0'0","reported_seq":13,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-17T05:51:16.341088+0000","last_change":"2024-09-17T05:51:15.353391+0000","last_active":"2024-09-17T05:51:16.341088+0000","last_peered":"2024-09-17T05:51:16.341088+0000","last_clean":"2024-09-17T05:51:16.341088+0000","last_became_active":"2024-09-17T05:51:15.353075+0000","last_became_peered":"2024-09-17T05:51:15.353075+0000","last_unstale":"2024-09-17T05:51:16.341088+0000","last_undegraded":"2024-09-17T05:51:16.341088+0000","last_fullsized":"2024-09-17T05:51:16.341088+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:51:14.325451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:51:14.325451+0000","last_clean_scrub_stamp":"2024-09-17T05:51:14.325451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:35:01.866394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:51:14.325451+0000","last_change":"2024-09-17T05:51:14.325451+0000","last_active":"2024-09-17T05:51:14.325451+0000","last_peered":"2024-09-17T05:51:14.325451+0000","last_clean":"2024-09-17T05:51:14.325451+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:51:14.325451+0000","last_undegraded":"2024-09-17T05:51:14.325451+0000","last_fullsized":"2024-09-17T05:51:14.325451+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:51:14.325451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:51:14.325451+0000","last_clean_scrub_stamp":"2024-09-17T05:51:14.325451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.33","version":"0'0","reported_seq":13,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-17T05:51:16.750511+0000","last_change":"2024-09-17T05:51:15.356651+0000","last_active":"2024-09-17T05:51:16.750511+0000","last_peered":"2024-09-17T05:51:16.750511+0000","last_clean":"2024-09-17T05:51:16.750511+0000","last_became_active":"2024-09-17T05:51:15.356329+0000","last_became_peered":"2024-09-17T05:51:15.356329+0000","last_unstale":"2024-09-17T05:51:16.750511+0000","last_undegraded":"2024-09-17T05:51:16.750511+0000","last_fullsized":"2024-09-17T05:51:16.750511+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:51:14.325451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:51:14.325451+0000","last_clean_scrub_stamp":"2024-09-17T05:51:14.325451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:40:43.043320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.32","version":"0'0","reported_seq":13,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-17T05:51:16.750261+0000","last_change":"2024-09-17T05:51:15.358138+0000","last_active":"2024-09-17T05:51:16.750261+0000","last_peered":"2024-09-17T05:51:16.750261+0000","last_clean":"2024-09-17T05:51:16.750261+0000","last_became_active":"2024-09-17T05:51:15.357839+0000","last_became_peered":"2024-09-17T05:51:15.357839+0000","last_unstale":"2024-09-17T05:51:16.750261+0000","last_undegraded":"2024-09-17T05:51:16.750261+0000","last_fullsized":"2024-09-17T05:51:16.750261+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:51:14.325451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:51:14.325451+0000","last_clean_scrub_stamp":"2024-09-17T05:51:14.325451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:31:24.479375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.31","version":"0'0","reported_seq":13,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-17T05:51:16.749988+0000","last_change":"2024-09-17T05:51:15.349182+0000","last_active":"2024-09-17T05:51:16.749988+0000","last_peered":"2024-09-17T05:51:16.749988+0000","last_clean":"2024-09-17T05:51:16.749988+0000","last_became_active":"2024-09-17T05:51:15.348875+0000","last_became_peered":"2024-09-17T05:51:15.348875+0000","last_unstale":"2024-09-17T05:51:16.749988+0000","last_undegraded":"2024-09-17T05:51:16.749988+0000","last_fullsized":"2024-09-17T05:51:16.749988+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:51:14.325451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:51:14.325451+0000","last_clean_scrub_stamp":"2024-09-17T05:51:14.325451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:32:59.139253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:51:14.325451+0000","last_change":"2024-09-17T05:51:14.325451+0000","last_active":"2024-09-17T05:51:14.325451+0000","last_peered":"2024-09-17T05:51:14.325451+0000","last_clean":"2024-09-17T05:51:14.325451+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:51:14.325451+0000","last_undegraded":"2024-09-17T05:51:14.325451+0000","last_fullsized":"2024-09-17T05:51:14.325451+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:51:14.325451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:51:14.325451+0000","last_clean_scrub_stamp":"2024-09-17T05:51:14.325451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.2f","version":"0'0","reported_seq":13,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-17T05:51:16.340854+0000","last_change":"2024-09-17T05:51:15.356819+0000","last_active":"2024-09-17T05:51:16.340854+0000","last_peered":"2024-09-17T05:51:16.340854+0000","last_clean":"2024-09-17T05:51:16.340854+0000","last_became_active":"2024-09-17T05:51:15.355786+0000","last_became_peered":"2024-09-17T05:51:15.355786+0000","last_unstale":"2024-09-17T05:51:16.340854+0000","last_undegraded":"2024-09-17T05:51:16.340854+0000","last_fullsized":"2024-09-17T05:51:16.340854+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:51:14.325451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:51:14.325451+0000","last_clean_scrub_stamp":"2024-09-17T05:51:14.325451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:41:26.394405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.2e","version":"0'0","reported_seq":13,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-17T05:51:16.357401+0000","last_change":"2024-09-17T05:51:15.355528+0000","last_active":"2024-09-17T05:51:16.357401+0000","last_peered":"2024-09-17T05:51:16.357401+0000","last_clean":"2024-09-17T05:51:16.357401+0000","last_became_active":"2024-09-17T05:51:15.355205+0000","last_became_peered":"2024-09-17T05:51:15.355205+0000","last_unstale":"2024-09-17T05:51:16.357401+0000","last_undegraded":"2024-09-17T05:51:16.357401+0000","last_fullsized":"2024-09-17T05:51:16.357401+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:51:14.325451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:51:14.325451+0000","last_clean_scrub_stamp":"2024-09-17T05:51:14.325451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:59:59.333951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.2d","version":"0'0","reported_seq":13,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-17T05:51:16.750770+0000","last_change":"2024-09-17T05:51:15.357170+0000","last_active":"2024-09-17T05:51:16.750770+0000","last_peered":"2024-09-17T05:51:16.750770+0000","last_clean":"2024-09-17T05:51:16.750770+0000","last_became_active":"2024-09-17T05:51:15.356347+0000","last_became_peered":"2024-09-17T05:51:15.356347+0000","last_unstale":"2024-09-17T05:51:16.750770+0000","last_undegraded":"2024-09-17T05:51:16.750770+0000","last_fullsized":"2024-09-17T05:51:16.750770+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:51:14.325451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:51:14.325451+0000","last_clean_scrub_stamp":"2024-09-17T05:51:14.325451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:39:17.891657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.2c","version":"0'0","reported_seq":13,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-17T05:51:16.341037+0000","last_change":"2024-09-17T05:51:15.351757+0000","last_active":"2024-09-17T05:51:16.341037+0000","last_peered":"2024-09-17T05:51:16.341037+0000","last_clean":"2024-09-17T05:51:16.341037+0000","last_became_active":"2024-09-17T05:51:15.351451+0000","last_became_peered":"2024-09-17T05:51:15.351451+0000","last_unstale":"2024-09-17T05:51:16.341037+0000","last_undegraded":"2024-09-17T05:51:16.341037+0000","last_fullsized":"2024-09-17T05:51:16.341037+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:51:14.325451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:51:14.325451+0000","last_clean_scrub_stamp":"2024-09-17T05:51:14.325451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:02:50.463096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.2b","version":"0'0","reported_seq":13,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-17T05:51:16.341258+0000","last_change":"2024-09-17T05:51:15.343820+0000","last_active":"2024-09-17T05:51:16.341258+0000","last_peered":"2024-09-17T05:51:16.341258+0000","last_clean":"2024-09-17T05:51:16.341258+0000","last_became_active":"2024-09-17T05:51:15.343446+0000","last_became_peered":"2024-09-17T05:51:15.343446+0000","last_unstale":"2024-09-17T05:51:16.341258+0000","last_undegraded":"2024-09-17T05:51:16.341258+0000","last_fullsized":"2024-09-17T05:51:16.341258+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:51:14.325451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:51:14.325451+0000","last_clean_scrub_stamp":"2024-09-17T05:51:14.325451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:01:59.401335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.2a","version":"0'0","reported_seq":13,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-17T05:51:16.340834+0000","last_change":"2024-09-17T05:51:15.347950+0000","last_active":"2024-09-17T05:51:16.340834+0000","last_peered":"2024-09-17T05:51:16.340834+0000","last_clean":"2024-09-17T05:51:16.340834+0000","last_became_active":"2024-09-17T05:51:15.347234+0000","last_became_peered":"2024-09-17T05:51:15.347234+0000","last_unstale":"2024-09-17T05:51:16.340834+0000","last_undegraded":"2024-09-17T05:51:16.340834+0000","last_fullsized":"2024-09-17T05:51:16.340834+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:51:14.325451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:51:14.325451+0000","last_clean_scrub_stamp":"2024-09-17T05:51:14.325451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:25:47.876263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.29","version":"0'0","reported_seq":13,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-17T05:51:16.340293+0000","last_change":"2024-09-17T05:51:15.351107+0000","last_active":"2024-09-17T05:51:16.340293+0000","last_peered":"2024-09-17T05:51:16.340293+0000","last_clean":"2024-09-17T05:51:16.340293+0000","last_became_active":"2024-09-17T05:51:15.350800+0000","last_became_peered":"2024-09-17T05:51:15.350800+0000","last_unstale":"2024-09-17T05:51:16.340293+0000","last_undegraded":"2024-09-17T05:51:16.340293+0000","last_fullsized":"2024-09-17T05:51:16.340293+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:51:14.325451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:51:14.325451+0000","last_clean_scrub_stamp":"2024-09-17T05:51:14.325451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:54:30.680562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.28","version":"0'0","reported_seq":13,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-17T05:51:16.340277+0000","last_change":"2024-09-17T05:51:15.352451+0000","last_active":"2024-09-17T05:51:16.340277+0000","last_peered":"2024-09-17T05:51:16.340277+0000","last_clean":"2024-09-17T05:51:16.340277+0000","last_became_active":"2024-09-17T05:51:15.351461+0000","last_became_peered":"2024-09-17T05:51:15.351461+0000","last_unstale":"2024-09-17T05:51:16.340277+0000","last_undegraded":"2024-09-17T05:51:16.340277+0000","last_fullsized":"2024-09-17T05:51:16.340277+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:51:14.325451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:51:14.325451+0000","last_clean_scrub_stamp":"2024-09-17T05:51:14.325451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:07:01.411755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.27","version":"0'0","reported_seq":13,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-17T05:51:16.340985+0000","last_change":"2024-09-17T05:51:15.356473+0000","last_active":"2024-09-17T05:51:16.340985+0000","last_peered":"2024-09-17T05:51:16.340985+0000","last_clean":"2024-09-17T05:51:16.340985+0000","last_became_active":"2024-09-17T05:51:15.355395+0000","last_became_peered":"2024-09-17T05:51:15.355395+0000","last_unstale":"2024-09-17T05:51:16.340985+0000","last_undegraded":"2024-09-17T05:51:16.340985+0000","last_fullsized":"2024-09-17T05:51:16.340985+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:51:14.325451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:51:14.325451+0000","last_clean_scrub_stamp":"2024-09-17T05:51:14.325451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:45:35.715638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:51:14.325451+0000","last_change":"2024-09-17T05:51:14.325451+0000","last_active":"2024-09-17T05:51:14.325451+0000","last_peered":"2024-09-17T05:51:14.325451+0000","last_clean":"2024-09-17T05:51:14.325451+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:51:14.325451+0000","last_undegraded":"2024-09-17T05:51:14.325451+0000","last_fullsized":"2024-09-17T05:51:14.325451+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:51:14.325451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:51:14.325451+0000","last_clean_scrub_stamp":"2024-09-17T05:51:14.325451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.25","version":"0'0","reported_seq":13,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-17T05:51:16.750795+0000","last_change":"2024-09-17T05:51:15.350114+0000","last_active":"2024-09-17T05:51:16.750795+0000","last_peered":"2024-09-17T05:51:16.750795+0000","last_clean":"2024-09-17T05:51:16.750795+0000","last_became_active":"2024-09-17T05:51:15.349717+0000","last_became_peered":"2024-09-17T05:51:15.349717+0000","last_unstale":"2024-09-17T05:51:16.750795+0000","last_undegraded":"2024-09-17T05:51:16.750795+0000","last_fullsized":"2024-09-17T05:51:16.750795+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:51:14.325451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:51:14.325451+0000","last_clean_scrub_stamp":"2024-09-17T05:51:14.325451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:18:04.873879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.24","version":"0'0","reported_seq":13,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-17T05:51:16.340958+0000","last_change":"2024-09-17T05:51:15.354301+0000","last_active":"2024-09-17T05:51:16.340958+0000","last_peered":"2024-09-17T05:51:16.340958+0000","last_clean":"2024-09-17T05:51:16.340958+0000","last_became_active":"2024-09-17T05:51:15.353951+0000","last_became_peered":"2024-09-17T05:51:15.353951+0000","last_unstale":"2024-09-17T05:51:16.340958+0000","last_undegraded":"2024-09-17T05:51:16.340958+0000","last_fullsized":"2024-09-17T05:51:16.340958+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:51:14.325451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:51:14.325451+0000","last_clean_scrub_stamp":"2024-09-17T05:51:14.325451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:59:08.824529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.23","version":"0'0","reported_seq":13,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-17T05:51:16.340611+0000","last_change":"2024-09-17T05:51:15.352151+0000","last_active":"2024-09-17T05:51:16.340611+0000","last_peered":"2024-09-17T05:51:16.340611+0000","last_clean":"2024-09-17T05:51:16.340611+0000","last_became_active":"2024-09-17T05:51:15.350686+0000","last_became_peered":"2024-09-17T05:51:15.350686+0000","last_unstale":"2024-09-17T05:51:16.340611+0000","last_undegraded":"2024-09-17T05:51:16.340611+0000","last_fullsized":"2024-09-17T05:51:16.340611+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:51:14.325451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:51:14.325451+0000","last_clean_scrub_stamp":"2024-09-17T05:51:14.325451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:43:23.785414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.22","version":"0'0","reported_seq":13,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-17T05:51:16.360088+0000","last_change":"2024-09-17T05:51:15.341975+0000","last_active":"2024-09-17T05:51:16.360088+0000","last_peered":"2024-09-17T05:51:16.360088+0000","last_clean":"2024-09-17T05:51:16.360088+0000","last_became_active":"2024-09-17T05:51:15.341693+0000","last_became_peered":"2024-09-17T05:51:15.341693+0000","last_unstale":"2024-09-17T05:51:16.360088+0000","last_undegraded":"2024-09-17T05:51:16.360088+0000","last_fullsized":"2024-09-17T05:51:16.360088+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:51:14.325451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:51:14.325451+0000","last_clean_scrub_stamp":"2024-09-17T05:51:14.325451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:09:41.960133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:51:14.325451+0000","last_change":"2024-09-17T05:51:14.325451+0000","last_active":"2024-09-17T05:51:14.325451+0000","last_peered":"2024-09-17T05:51:14.325451+0000","last_clean":"2024-09-17T05:51:14.325451+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:51:14.325451+0000","last_undegraded":"2024-09-17T05:51:14.325451+0000","last_fullsized":"2024-09-17T05:51:14.325451+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:51:14.325451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:51:14.325451+0000","last_clean_scrub_stamp":"2024-09-17T05:51:14.325451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.20","version":"0'0","reported_seq":13,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-17T05:51:16.749919+0000","last_change":"2024-09-17T05:51:15.352088+0000","last_active":"2024-09-17T05:51:16.749919+0000","last_peered":"2024-09-17T05:51:16.749919+0000","last_clean":"2024-09-17T05:51:16.749919+0000","last_became_active":"2024-09-17T05:51:15.347745+0000","last_became_peered":"2024-09-17T05:51:15.347745+0000","last_unstale":"2024-09-17T05:51:16.749919+0000","last_undegraded":"2024-09-17T05:51:16.749919+0000","last_fullsized":"2024-09-17T05:51:16.749919+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:51:14.325451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:51:14.325451+0000","last_clean_scrub_stamp":"2024-09-17T05:51:14.325451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:00:48.024653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.1e","version":"0'0","reported_seq":13,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-17T05:51:16.751289+0000","last_change":"2024-09-17T05:51:15.356066+0000","last_active":"2024-09-17T05:51:16.751289+0000","last_peered":"2024-09-17T05:51:16.751289+0000","last_clean":"2024-09-17T05:51:16.751289+0000","last_became_active":"2024-09-17T05:51:15.355748+0000","last_became_peered":"2024-09-17T05:51:15.355748+0000","last_unstale":"2024-09-17T05:51:16.751289+0000","last_undegraded":"2024-09-17T05:51:16.751289+0000","last_fullsized":"2024-09-17T05:51:16.751289+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:51:14.325451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:51:14.325451+0000","last_clean_scrub_stamp":"2024-09-17T05:51:14.325451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:54:46.604153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.1f","version":"112'4","reported_seq":19,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-17T05:51:16.360144+0000","last_change":"2024-09-17T05:51:14.352310+0000","last_active":"2024-09-17T05:51:16.360144+0000","last_peered":"2024-09-17T05:51:16.360144+0000","last_clean":"2024-09-17T05:51:16.360144+0000","last_became_active":"2024-09-17T05:51:14.351942+0000","last_became_peered":"2024-09-17T05:51:14.351942+0000","last_unstale":"2024-09-17T05:51:16.360144+0000","last_undegraded":"2024-09-17T05:51:16.360144+0000","last_fullsized":"2024-09-17T05:51:16.360144+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:51:13.315624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:51:13.315624+0000","last_clean_scrub_stamp":"2024-09-17T05:51:13.315624+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:00:47.014826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.1f","version":"0'0","reported_seq":13,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-17T05:51:16.357652+0000","last_change":"2024-09-17T05:51:15.352409+0000","last_active":"2024-09-17T05:51:16.357652+0000","last_peered":"2024-09-17T05:51:16.357652+0000","last_clean":"2024-09-17T05:51:16.357652+0000","last_became_active":"2024-09-17T05:51:15.352109+0000","last_became_peered":"2024-09-17T05:51:15.352109+0000","last_unstale":"2024-09-17T05:51:16.357652+0000","last_undegraded":"2024-09-17T05:51:16.357652+0000","last_fullsized":"2024-09-17T05:51:16.357652+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:51:14.325451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:51:14.325451+0000","last_clean_scrub_stamp":"2024-09-17T05:51:14.325451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:46:13.487513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.1e","version":"112'1","reported_seq":16,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-17T05:51:16.750344+0000","last_change":"2024-09-17T05:51:14.354672+0000","last_active":"2024-09-17T05:51:16.750344+0000","last_peered":"2024-09-17T05:51:16.750344+0000","last_clean":"2024-09-17T05:51:16.750344+0000","last_became_active":"2024-09-17T05:51:14.354096+0000","last_became_peered":"2024-09-17T05:51:14.354096+0000","last_unstale":"2024-09-17T05:51:16.750344+0000","last_undegraded":"2024-09-17T05:51:16.750344+0000","last_fullsized":"2024-09-17T05:51:16.750344+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:51:13.315624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:51:13.315624+0000","last_clean_scrub_stamp":"2024-09-17T05:51:13.315624+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:16:54.432517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.1c","version":"0'0","reported_seq":13,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-17T05:51:16.751166+0000","last_change":"2024-09-17T05:51:15.349713+0000","last_active":"2024-09-17T05:51:16.751166+0000","last_peered":"2024-09-17T05:51:16.751166+0000","last_clean":"2024-09-17T05:51:16.751166+0000","last_became_active":"2024-09-17T05:51:15.347772+0000","last_became_peered":"2024-09-17T05:51:15.347772+0000","last_unstale":"2024-09-17T05:51:16.751166+0000","last_undegraded":"2024-09-17T05:51:16.751166+0000","last_fullsized":"2024-09-17T05:51:16.751166+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:51:14.325451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:51:14.325451+0000","last_clean_scrub_stamp":"2024-09-17T05:51:14.325451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:23:35.566877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.1d","version":"112'2","reported_seq":17,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-17T05:51:16.339750+0000","last_change":"2024-09-17T05:51:14.353746+0000","last_active":"2024-09-17T05:51:16.339750+0000","last_peered":"2024-09-17T05:51:16.339750+0000","last_clean":"2024-09-17T05:51:16.339750+0000","last_became_active":"2024-09-17T05:51:14.353437+0000","last_became_peered":"2024-09-17T05:51:14.353437+0000","last_unstale":"2024-09-17T05:51:16.339750+0000","last_undegraded":"2024-09-17T05:51:16.339750+0000","last_fullsized":"2024-09-17T05:51:16.339750+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:51:13.315624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:51:13.315624+0000","last_clean_scrub_stamp":"2024-09-17T05:51:13.315624+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:05:50.149362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.1d","version":"0'0","reported_seq":13,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-17T05:51:16.750902+0000","last_change":"2024-09-17T05:51:15.359061+0000","last_active":"2024-09-17T05:51:16.750902+0000","last_peered":"2024-09-17T05:51:16.750902+0000","last_clean":"2024-09-17T05:51:16.750902+0000","last_became_active":"2024-09-17T05:51:15.358754+0000","last_became_peered":"2024-09-17T05:51:15.358754+0000","last_unstale":"2024-09-17T05:51:16.750902+0000","last_undegraded":"2024-09-17T05:51:16.750902+0000","last_fullsized":"2024-09-17T05:51:16.750902+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:51:14.325451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:51:14.325451+0000","last_clean_scrub_stamp":"2024-09-17T05:51:14.325451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:43:11.980324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.1c","version":"112'2","reported_seq":17,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-17T05:51:16.339897+0000","last_change":"2024-09-17T05:51:14.349011+0000","last_active":"2024-09-17T05:51:16.339897+0000","last_peered":"2024-09-17T05:51:16.339897+0000","last_clean":"2024-09-17T05:51:16.339897+0000","last_became_active":"2024-09-17T05:51:14.348713+0000","last_became_peered":"2024-09-17T05:51:14.348713+0000","last_unstale":"2024-09-17T05:51:16.339897+0000","last_undegraded":"2024-09-17T05:51:16.339897+0000","last_fullsized":"2024-09-17T05:51:16.339897+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:51:13.315624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:51:13.315624+0000","last_clean_scrub_stamp":"2024-09-17T05:51:13.315624+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:57:40.589853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:51:14.325451+0000","last_change":"2024-09-17T05:51:14.325451+0000","last_active":"2024-09-17T05:51:14.325451+0000","last_peered":"2024-09-17T05:51:14.325451+0000","last_clean":"2024-09-17T05:51:14.325451+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:51:14.325451+0000","last_undegraded":"2024-09-17T05:51:14.325451+0000","last_fullsized":"2024-09-17T05:51:14.325451+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:51:14.325451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:51:14.325451+0000","last_clean_scrub_stamp":"2024-09-17T05:51:14.325451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.1b","version":"112'1","reported_seq":16,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-17T05:51:16.359714+0000","last_change":"2024-09-17T05:51:14.354735+0000","last_active":"2024-09-17T05:51:16.359714+0000","last_peered":"2024-09-17T05:51:16.359714+0000","last_clean":"2024-09-17T05:51:16.359714+0000","last_became_active":"2024-09-17T05:51:14.354173+0000","last_became_peered":"2024-09-17T05:51:14.354173+0000","last_unstale":"2024-09-17T05:51:16.359714+0000","last_undegraded":"2024-09-17T05:51:16.359714+0000","last_fullsized":"2024-09-17T05:51:16.359714+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:51:13.315624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:51:13.315624+0000","last_clean_scrub_stamp":"2024-09-17T05:51:13.315624+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:55:41.195206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.1b","version":"0'0","reported_seq":13,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-17T05:51:16.340908+0000","last_change":"2024-09-17T05:51:15.344677+0000","last_active":"2024-09-17T05:51:16.340908+0000","last_peered":"2024-09-17T05:51:16.340908+0000","last_clean":"2024-09-17T05:51:16.340908+0000","last_became_active":"2024-09-17T05:51:15.344361+0000","last_became_peered":"2024-09-17T05:51:15.344361+0000","last_unstale":"2024-09-17T05:51:16.340908+0000","last_undegraded":"2024-09-17T05:51:16.340908+0000","last_fullsized":"2024-09-17T05:51:16.340908+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:51:14.325451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:51:14.325451+0000","last_clean_scrub_stamp":"2024-09-17T05:51:14.325451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:21:22.687943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.1a","version":"112'1","reported_seq":16,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-17T05:51:16.341177+0000","last_change":"2024-09-17T05:51:14.353138+0000","last_active":"2024-09-17T05:51:16.341177+0000","last_peered":"2024-09-17T05:51:16.341177+0000","last_clean":"2024-09-17T05:51:16.341177+0000","last_became_active":"2024-09-17T05:51:14.352671+0000","last_became_peered":"2024-09-17T05:51:14.352671+0000","last_unstale":"2024-09-17T05:51:16.341177+0000","last_undegraded":"2024-09-17T05:51:16.341177+0000","last_fullsized":"2024-09-17T05:51:16.341177+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:51:13.315624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:51:13.315624+0000","last_clean_scrub_stamp":"2024-09-17T05:51:13.315624+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:05:44.644453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:51:14.325451+0000","last_change":"2024-09-17T05:51:14.325451+0000","last_active":"2024-09-17T05:51:14.325451+0000","last_peered":"2024-09-17T05:51:14.325451+0000","last_clean":"2024-09-17T05:51:14.325451+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:51:14.325451+0000","last_undegraded":"2024-09-17T05:51:14.325451+0000","last_fullsized":"2024-09-17T05:51:14.325451+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:51:14.325451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:51:14.325451+0000","last_clean_scrub_stamp":"2024-09-17T05:51:14.325451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.19","version":"0'0","reported_seq":15,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-17T05:51:16.340804+0000","last_change":"2024-09-17T05:51:14.356410+0000","last_active":"2024-09-17T05:51:16.340804+0000","last_peered":"2024-09-17T05:51:16.340804+0000","last_clean":"2024-09-17T05:51:16.340804+0000","last_became_active":"2024-09-17T05:51:14.356114+0000","last_became_peered":"2024-09-17T05:51:14.356114+0000","last_unstale":"2024-09-17T05:51:16.340804+0000","last_undegraded":"2024-09-17T05:51:16.340804+0000","last_fullsized":"2024-09-17T05:51:16.340804+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:51:13.315624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:51:13.315624+0000","last_clean_scrub_stamp":"2024-09-17T05:51:13.315624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:27:31.390355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.19","version":"0'0","reported_seq":13,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-17T05:51:16.359869+0000","last_change":"2024-09-17T05:51:15.358103+0000","last_active":"2024-09-17T05:51:16.359869+0000","last_peered":"2024-09-17T05:51:16.359869+0000","last_clean":"2024-09-17T05:51:16.359869+0000","last_became_active":"2024-09-17T05:51:15.357513+0000","last_became_peered":"2024-09-17T05:51:15.357513+0000","last_unstale":"2024-09-17T05:51:16.359869+0000","last_undegraded":"2024-09-17T05:51:16.359869+0000","last_fullsized":"2024-09-17T05:51:16.359869+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:51:14.325451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:51:14.325451+0000","last_clean_scrub_stamp":"2024-09-17T05:51:14.325451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:51:39.791185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.18","version":"0'0","reported_seq":1,"reported_epoch":110,"state":"creating+peering","last_fresh":"2024-09-17T05:51:13.333713+0000","last_change":"2024-09-17T05:51:13.333713+0000","last_active":"2024-09-17T05:51:13.315624+0000","last_peered":"2024-09-17T05:51:13.315624+0000","last_clean":"2024-09-17T05:51:13.315624+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:51:13.333713+0000","last_undegraded":"2024-09-17T05:51:13.333713+0000","last_fullsized":"2024-09-17T05:51:13.333713+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:51:13.315624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:51:13.315624+0000","last_clean_scrub_stamp":"2024-09-17T05:51:13.315624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.16","version":"0'0","reported_seq":13,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-17T05:51:16.360215+0000","last_change":"2024-09-17T05:51:15.357705+0000","last_active":"2024-09-17T05:51:16.360215+0000","last_peered":"2024-09-17T05:51:16.360215+0000","last_clean":"2024-09-17T05:51:16.360215+0000","last_became_active":"2024-09-17T05:51:15.357029+0000","last_became_peered":"2024-09-17T05:51:15.357029+0000","last_unstale":"2024-09-17T05:51:16.360215+0000","last_undegraded":"2024-09-17T05:51:16.360215+0000","last_fullsized":"2024-09-17T05:51:16.360215+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:51:14.325451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:51:14.325451+0000","last_clean_scrub_stamp":"2024-09-17T05:51:14.325451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:29:03.820460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.17","version":"0'0","reported_seq":15,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-17T05:51:16.339454+0000","last_change":"2024-09-17T05:51:14.353904+0000","last_active":"2024-09-17T05:51:16.339454+0000","last_peered":"2024-09-17T05:51:16.339454+0000","last_clean":"2024-09-17T05:51:16.339454+0000","last_became_active":"2024-09-17T05:51:14.353591+0000","last_became_peered":"2024-09-17T05:51:14.353591+0000","last_unstale":"2024-09-17T05:51:16.339454+0000","last_undegraded":"2024-09-17T05:51:16.339454+0000","last_fullsized":"2024-09-17T05:51:16.339454+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:51:13.315624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:51:13.315624+0000","last_clean_scrub_stamp":"2024-09-17T05:51:13.315624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:13:44.186310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.17","version":"0'0","reported_seq":13,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-17T05:51:16.357574+0000","last_change":"2024-09-17T05:51:15.361884+0000","last_active":"2024-09-17T05:51:16.357574+0000","last_peered":"2024-09-17T05:51:16.357574+0000","last_clean":"2024-09-17T05:51:16.357574+0000","last_became_active":"2024-09-17T05:51:15.361562+0000","last_became_peered":"2024-09-17T05:51:15.361562+0000","last_unstale":"2024-09-17T05:51:16.357574+0000","last_undegraded":"2024-09-17T05:51:16.357574+0000","last_fullsized":"2024-09-17T05:51:16.357574+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:51:14.325451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:51:14.325451+0000","last_clean_scrub_stamp":"2024-09-17T05:51:14.325451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:46:55.155567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.16","version":"0'0","reported_seq":15,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-17T05:51:16.340693+0000","last_change":"2024-09-17T05:51:14.351671+0000","last_active":"2024-09-17T05:51:16.340693+0000","last_peered":"2024-09-17T05:51:16.340693+0000","last_clean":"2024-09-17T05:51:16.340693+0000","last_became_active":"2024-09-17T05:51:14.351378+0000","last_became_peered":"2024-09-17T05:51:14.351378+0000","last_unstale":"2024-09-17T05:51:16.340693+0000","last_undegraded":"2024-09-17T05:51:16.340693+0000","last_fullsized":"2024-09-17T05:51:16.340693+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:51:13.315624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:51:13.315624+0000","last_clean_scrub_stamp":"2024-09-17T05:51:13.315624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:13:21.431979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.14","version":"0'0","reported_seq":13,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-17T05:51:16.341035+0000","last_change":"2024-09-17T05:51:15.348925+0000","last_active":"2024-09-17T05:51:16.341035+0000","last_peered":"2024-09-17T05:51:16.341035+0000","last_clean":"2024-09-17T05:51:16.341035+0000","last_became_active":"2024-09-17T05:51:15.348098+0000","last_became_peered":"2024-09-17T05:51:15.348098+0000","last_unstale":"2024-09-17T05:51:16.341035+0000","last_undegraded":"2024-09-17T05:51:16.341035+0000","last_fullsized":"2024-09-17T05:51:16.341035+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:51:14.325451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:51:14.325451+0000","last_clean_scrub_stamp":"2024-09-17T05:51:14.325451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:45:04.503729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.15","version":"0'0","reported_seq":1,"reported_epoch":110,"state":"creating+peering","last_fresh":"2024-09-17T05:51:13.333287+0000","last_change":"2024-09-17T05:51:13.333287+0000","last_active":"2024-09-17T05:51:13.315624+0000","last_peered":"2024-09-17T05:51:13.315624+0000","last_clean":"2024-09-17T05:51:13.315624+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:51:13.333287+0000","last_undegraded":"2024-09-17T05:51:13.333287+0000","last_fullsized":"2024-09-17T05:51:13.333287+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:51:13.315624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:51:13.315624+0000","last_clean_scrub_stamp":"2024-09-17T05:51:13.315624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.15","version":"0'0","reported_seq":13,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-17T05:51:16.359997+0000","last_change":"2024-09-17T05:51:15.354430+0000","last_active":"2024-09-17T05:51:16.359997+0000","last_peered":"2024-09-17T05:51:16.359997+0000","last_clean":"2024-09-17T05:51:16.359997+0000","last_became_active":"2024-09-17T05:51:15.353340+0000","last_became_peered":"2024-09-17T05:51:15.353340+0000","last_unstale":"2024-09-17T05:51:16.359997+0000","last_undegraded":"2024-09-17T05:51:16.359997+0000","last_fullsized":"2024-09-17T05:51:16.359997+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:51:14.325451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:51:14.325451+0000","last_clean_scrub_stamp":"2024-09-17T05:51:14.325451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:06:33.197462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.14","version":"0'0","reported_seq":1,"reported_epoch":110,"state":"creating+peering","last_fresh":"2024-09-17T05:51:13.332882+0000","last_change":"2024-09-17T05:51:13.332882+0000","last_active":"2024-09-17T05:51:13.315624+0000","last_peered":"2024-09-17T05:51:13.315624+0000","last_clean":"2024-09-17T05:51:13.315624+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:51:13.332882+0000","last_undegraded":"2024-09-17T05:51:13.332882+0000","last_fullsized":"2024-09-17T05:51:13.332882+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:51:13.315624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:51:13.315624+0000","last_clean_scrub_stamp":"2024-09-17T05:51:13.315624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.12","version":"0'0","reported_seq":13,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-17T05:51:16.341056+0000","last_change":"2024-09-17T05:51:15.343838+0000","last_active":"2024-09-17T05:51:16.341056+0000","last_peered":"2024-09-17T05:51:16.341056+0000","last_clean":"2024-09-17T05:51:16.341056+0000","last_became_active":"2024-09-17T05:51:15.342425+0000","last_became_peered":"2024-09-17T05:51:15.342425+0000","last_unstale":"2024-09-17T05:51:16.341056+0000","last_undegraded":"2024-09-17T05:51:16.341056+0000","last_fullsized":"2024-09-17T05:51:16.341056+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:51:14.325451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:51:14.325451+0000","last_clean_scrub_stamp":"2024-09-17T05:51:14.325451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:38:28.098850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.13","version":"112'2","reported_seq":17,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-17T05:51:16.750889+0000","last_change":"2024-09-17T05:51:14.351875+0000","last_active":"2024-09-17T05:51:16.750889+0000","last_peered":"2024-09-17T05:51:16.750889+0000","last_clean":"2024-09-17T05:51:16.750889+0000","last_became_active":"2024-09-17T05:51:14.351584+0000","last_became_peered":"2024-09-17T05:51:14.351584+0000","last_unstale":"2024-09-17T05:51:16.750889+0000","last_undegraded":"2024-09-17T05:51:16.750889+0000","last_fullsized":"2024-09-17T05:51:16.750889+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:51:13.315624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:51:13.315624+0000","last_clean_scrub_stamp":"2024-09-17T05:51:13.315624+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:32:52.271894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.13","version":"0'0","reported_seq":13,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-17T05:51:16.340808+0000","last_change":"2024-09-17T05:51:15.352070+0000","last_active":"2024-09-17T05:51:16.340808+0000","last_peered":"2024-09-17T05:51:16.340808+0000","last_clean":"2024-09-17T05:51:16.340808+0000","last_became_active":"2024-09-17T05:51:15.351799+0000","last_became_peered":"2024-09-17T05:51:15.351799+0000","last_unstale":"2024-09-17T05:51:16.340808+0000","last_undegraded":"2024-09-17T05:51:16.340808+0000","last_fullsized":"2024-09-17T05:51:16.340808+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:51:14.325451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:51:14.325451+0000","last_clean_scrub_stamp":"2024-09-17T05:51:14.325451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:10:29.943649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.12","version":"0'0","reported_seq":15,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-17T05:51:16.357130+0000","last_change":"2024-09-17T05:51:14.358185+0000","last_active":"2024-09-17T05:51:16.357130+0000","last_peered":"2024-09-17T05:51:16.357130+0000","last_clean":"2024-09-17T05:51:16.357130+0000","last_became_active":"2024-09-17T05:51:14.357918+0000","last_became_peered":"2024-09-17T05:51:14.357918+0000","last_unstale":"2024-09-17T05:51:16.357130+0000","last_undegraded":"2024-09-17T05:51:16.357130+0000","last_fullsized":"2024-09-17T05:51:16.357130+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:51:13.315624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:51:13.315624+0000","last_clean_scrub_stamp":"2024-09-17T05:51:13.315624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:03:42.718274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.11","version":"0'0","reported_seq":13,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-17T05:51:16.340680+0000","last_change":"2024-09-17T05:51:15.344783+0000","last_active":"2024-09-17T05:51:16.340680+0000","last_peered":"2024-09-17T05:51:16.340680+0000","last_clean":"2024-09-17T05:51:16.340680+0000","last_became_active":"2024-09-17T05:51:15.344469+0000","last_became_peered":"2024-09-17T05:51:15.344469+0000","last_unstale":"2024-09-17T05:51:16.340680+0000","last_undegraded":"2024-09-17T05:51:16.340680+0000","last_fullsized":"2024-09-17T05:51:16.340680+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:51:14.325451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:51:14.325451+0000","last_clean_scrub_stamp":"2024-09-17T05:51:14.325451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:26:02.895405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.10","version":"112'8","reported_seq":23,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-17T05:51:16.339322+0000","last_change":"2024-09-17T05:51:14.358522+0000","last_active":"2024-09-17T05:51:16.339322+0000","last_peered":"2024-09-17T05:51:16.339322+0000","last_clean":"2024-09-17T05:51:16.339322+0000","last_became_active":"2024-09-17T05:51:14.358110+0000","last_became_peered":"2024-09-17T05:51:14.358110+0000","last_unstale":"2024-09-17T05:51:16.339322+0000","last_undegraded":"2024-09-17T05:51:16.339322+0000","last_fullsized":"2024-09-17T05:51:16.339322+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:51:13.315624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:51:13.315624+0000","last_clean_scrub_stamp":"2024-09-17T05:51:13.315624+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:16:44.660311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.e","version":"0'0","reported_seq":13,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-17T05:51:16.340190+0000","last_change":"2024-09-17T05:51:15.368761+0000","last_active":"2024-09-17T05:51:16.340190+0000","last_peered":"2024-09-17T05:51:16.340190+0000","last_clean":"2024-09-17T05:51:16.340190+0000","last_became_active":"2024-09-17T05:51:15.368438+0000","last_became_peered":"2024-09-17T05:51:15.368438+0000","last_unstale":"2024-09-17T05:51:16.340190+0000","last_undegraded":"2024-09-17T05:51:16.340190+0000","last_fullsized":"2024-09-17T05:51:16.340190+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:51:14.325451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:51:14.325451+0000","last_clean_scrub_stamp":"2024-09-17T05:51:14.325451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:55:42.205033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.f","version":"0'0","reported_seq":1,"reported_epoch":110,"state":"creating+peering","last_fresh":"2024-09-17T05:51:13.332721+0000","last_change":"2024-09-17T05:51:13.332721+0000","last_active":"2024-09-17T05:51:13.315624+0000","last_peered":"2024-09-17T05:51:13.315624+0000","last_clean":"2024-09-17T05:51:13.315624+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:51:13.332721+0000","last_undegraded":"2024-09-17T05:51:13.332721+0000","last_fullsized":"2024-09-17T05:51:13.332721+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:51:13.315624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:51:13.315624+0000","last_clean_scrub_stamp":"2024-09-17T05:51:13.315624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.f","version":"0'0","reported_seq":13,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-17T05:51:16.751118+0000","last_change":"2024-09-17T05:51:15.363658+0000","last_active":"2024-09-17T05:51:16.751118+0000","last_peered":"2024-09-17T05:51:16.751118+0000","last_clean":"2024-09-17T05:51:16.751118+0000","last_became_active":"2024-09-17T05:51:15.363025+0000","last_became_peered":"2024-09-17T05:51:15.363025+0000","last_unstale":"2024-09-17T05:51:16.751118+0000","last_undegraded":"2024-09-17T05:51:16.751118+0000","last_fullsized":"2024-09-17T05:51:16.751118+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:51:14.325451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:51:14.325451+0000","last_clean_scrub_stamp":"2024-09-17T05:51:14.325451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:44:29.490228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.e","version":"112'2","reported_seq":17,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-17T05:51:16.340090+0000","last_change":"2024-09-17T05:51:14.350142+0000","last_active":"2024-09-17T05:51:16.340090+0000","last_peered":"2024-09-17T05:51:16.340090+0000","last_clean":"2024-09-17T05:51:16.340090+0000","last_became_active":"2024-09-17T05:51:14.349835+0000","last_became_peered":"2024-09-17T05:51:14.349835+0000","last_unstale":"2024-09-17T05:51:16.340090+0000","last_undegraded":"2024-09-17T05:51:16.340090+0000","last_fullsized":"2024-09-17T05:51:16.340090+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:51:13.315624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:51:13.315624+0000","last_clean_scrub_stamp":"2024-09-17T05:51:13.315624+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:18:05.652933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.c","version":"0'0","reported_seq":13,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-17T05:51:16.750603+0000","last_change":"2024-09-17T05:51:15.374005+0000","last_active":"2024-09-17T05:51:16.750603+0000","last_peered":"2024-09-17T05:51:16.750603+0000","last_clean":"2024-09-17T05:51:16.750603+0000","last_became_active":"2024-09-17T05:51:15.373697+0000","last_became_peered":"2024-09-17T05:51:15.373697+0000","last_unstale":"2024-09-17T05:51:16.750603+0000","last_undegraded":"2024-09-17T05:51:16.750603+0000","last_fullsized":"2024-09-17T05:51:16.750603+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:51:14.325451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:51:14.325451+0000","last_clean_scrub_stamp":"2024-09-17T05:51:14.325451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:52:25.457579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.d","version":"112'1","reported_seq":16,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-17T05:51:16.357350+0000","last_change":"2024-09-17T05:51:14.356064+0000","last_active":"2024-09-17T05:51:16.357350+0000","last_peered":"2024-09-17T05:51:16.357350+0000","last_clean":"2024-09-17T05:51:16.357350+0000","last_became_active":"2024-09-17T05:51:14.355680+0000","last_became_peered":"2024-09-17T05:51:14.355680+0000","last_unstale":"2024-09-17T05:51:16.357350+0000","last_undegraded":"2024-09-17T05:51:16.357350+0000","last_fullsized":"2024-09-17T05:51:16.357350+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:51:13.315624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:51:13.315624+0000","last_clean_scrub_stamp":"2024-09-17T05:51:13.315624+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:37:25.718715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.d","version":"0'0","reported_seq":13,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-17T05:51:16.750927+0000","last_change":"2024-09-17T05:51:15.360993+0000","last_active":"2024-09-17T05:51:16.750927+0000","last_peered":"2024-09-17T05:51:16.750927+0000","last_clean":"2024-09-17T05:51:16.750927+0000","last_became_active":"2024-09-17T05:51:15.360005+0000","last_became_peered":"2024-09-17T05:51:15.360005+0000","last_unstale":"2024-09-17T05:51:16.750927+0000","last_undegraded":"2024-09-17T05:51:16.750927+0000","last_fullsized":"2024-09-17T05:51:16.750927+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:51:14.325451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:51:14.325451+0000","last_clean_scrub_stamp":"2024-09-17T05:51:14.325451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:15:42.659548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.c","version":"0'0","reported_seq":15,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-17T05:51:16.359734+0000","last_change":"2024-09-17T05:51:14.356802+0000","last_active":"2024-09-17T05:51:16.359734+0000","last_peered":"2024-09-17T05:51:16.359734+0000","last_clean":"2024-09-17T05:51:16.359734+0000","last_became_active":"2024-09-17T05:51:14.356443+0000","last_became_peered":"2024-09-17T05:51:14.356443+0000","last_unstale":"2024-09-17T05:51:16.359734+0000","last_undegraded":"2024-09-17T05:51:16.359734+0000","last_fullsized":"2024-09-17T05:51:16.359734+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:51:13.315624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:51:13.315624+0000","last_clean_scrub_stamp":"2024-09-17T05:51:13.315624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:26:33.048310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.a","version":"0'0","reported_seq":13,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-17T05:51:16.750331+0000","last_change":"2024-09-17T05:51:15.354900+0000","last_active":"2024-09-17T05:51:16.750331+0000","last_peered":"2024-09-17T05:51:16.750331+0000","last_clean":"2024-09-17T05:51:16.750331+0000","last_became_active":"2024-09-17T05:51:15.354432+0000","last_became_peered":"2024-09-17T05:51:15.354432+0000","last_unstale":"2024-09-17T05:51:16.750331+0000","last_undegraded":"2024-09-17T05:51:16.750331+0000","last_fullsized":"2024-09-17T05:51:16.750331+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:51:14.325451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:51:14.325451+0000","last_clean_scrub_stamp":"2024-09-17T05:51:14.325451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:02:42.943141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.b","version":"112'2","reported_seq":17,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-17T05:51:16.751008+0000","last_change":"2024-09-17T05:51:14.351844+0000","last_active":"2024-09-17T05:51:16.751008+0000","last_peered":"2024-09-17T05:51:16.751008+0000","last_clean":"2024-09-17T05:51:16.751008+0000","last_became_active":"2024-09-17T05:51:14.351191+0000","last_became_peered":"2024-09-17T05:51:14.351191+0000","last_unstale":"2024-09-17T05:51:16.751008+0000","last_undegraded":"2024-09-17T05:51:16.751008+0000","last_fullsized":"2024-09-17T05:51:16.751008+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:51:13.315624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:51:13.315624+0000","last_clean_scrub_stamp":"2024-09-17T05:51:13.315624+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:21:47.493336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:51:14.325451+0000","last_change":"2024-09-17T05:51:14.325451+0000","last_active":"2024-09-17T05:51:14.325451+0000","last_peered":"2024-09-17T05:51:14.325451+0000","last_clean":"2024-09-17T05:51:14.325451+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:51:14.325451+0000","last_undegraded":"2024-09-17T05:51:14.325451+0000","last_fullsized":"2024-09-17T05:51:14.325451+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:51:14.325451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:51:14.325451+0000","last_clean_scrub_stamp":"2024-09-17T05:51:14.325451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.a","version":"0'0","reported_seq":15,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-17T05:51:16.339399+0000","last_change":"2024-09-17T05:51:14.355042+0000","last_active":"2024-09-17T05:51:16.339399+0000","last_peered":"2024-09-17T05:51:16.339399+0000","last_clean":"2024-09-17T05:51:16.339399+0000","last_became_active":"2024-09-17T05:51:14.354728+0000","last_became_peered":"2024-09-17T05:51:14.354728+0000","last_unstale":"2024-09-17T05:51:16.339399+0000","last_undegraded":"2024-09-17T05:51:16.339399+0000","last_fullsized":"2024-09-17T05:51:16.339399+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:51:13.315624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:51:13.315624+0000","last_clean_scrub_stamp":"2024-09-17T05:51:13.315624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:03:36.768537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.8","version":"0'0","reported_seq":13,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-17T05:51:16.750402+0000","last_change":"2024-09-17T05:51:15.357234+0000","last_active":"2024-09-17T05:51:16.750402+0000","last_peered":"2024-09-17T05:51:16.750402+0000","last_clean":"2024-09-17T05:51:16.750402+0000","last_became_active":"2024-09-17T05:51:15.356159+0000","last_became_peered":"2024-09-17T05:51:15.356159+0000","last_unstale":"2024-09-17T05:51:16.750402+0000","last_undegraded":"2024-09-17T05:51:16.750402+0000","last_fullsized":"2024-09-17T05:51:16.750402+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:51:14.325451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:51:14.325451+0000","last_clean_scrub_stamp":"2024-09-17T05:51:14.325451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:12:11.367770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.9","version":"0'0","reported_seq":15,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-17T05:51:16.750271+0000","last_change":"2024-09-17T05:51:14.348936+0000","last_active":"2024-09-17T05:51:16.750271+0000","last_peered":"2024-09-17T05:51:16.750271+0000","last_clean":"2024-09-17T05:51:16.750271+0000","last_became_active":"2024-09-17T05:51:14.348618+0000","last_became_peered":"2024-09-17T05:51:14.348618+0000","last_unstale":"2024-09-17T05:51:16.750271+0000","last_undegraded":"2024-09-17T05:51:16.750271+0000","last_fullsized":"2024-09-17T05:51:16.750271+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:51:13.315624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:51:13.315624+0000","last_clean_scrub_stamp":"2024-09-17T05:51:13.315624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:03:36.561055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.9","version":"0'0","reported_seq":13,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-17T05:51:16.340732+0000","last_change":"2024-09-17T05:51:15.359252+0000","last_active":"2024-09-17T05:51:16.340732+0000","last_peered":"2024-09-17T05:51:16.340732+0000","last_clean":"2024-09-17T05:51:16.340732+0000","last_became_active":"2024-09-17T05:51:15.358940+0000","last_became_peered":"2024-09-17T05:51:15.358940+0000","last_unstale":"2024-09-17T05:51:16.340732+0000","last_undegraded":"2024-09-17T05:51:16.340732+0000","last_fullsized":"2024-09-17T05:51:16.340732+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:51:14.325451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:51:14.325451+0000","last_clean_scrub_stamp":"2024-09-17T05:51:14.325451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:12:03.752583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.8","version":"0'0","reported_seq":1,"reported_epoch":110,"state":"creating+peering","last_fresh":"2024-09-17T05:51:13.333212+0000","last_change":"2024-09-17T05:51:13.333212+0000","last_active":"2024-09-17T05:51:13.315624+0000","last_peered":"2024-09-17T05:51:13.315624+0000","last_clean":"2024-09-17T05:51:13.315624+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:51:13.333212+0000","last_undegraded":"2024-09-17T05:51:13.333212+0000","last_fullsized":"2024-09-17T05:51:13.333212+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:51:13.315624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:51:13.315624+0000","last_clean_scrub_stamp":"2024-09-17T05:51:13.315624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.6","version":"0'0","reported_seq":13,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-17T05:51:16.357443+0000","last_change":"2024-09-17T05:51:15.365607+0000","last_active":"2024-09-17T05:51:16.357443+0000","last_peered":"2024-09-17T05:51:16.357443+0000","last_clean":"2024-09-17T05:51:16.357443+0000","last_became_active":"2024-09-17T05:51:15.365266+0000","last_became_peered":"2024-09-17T05:51:15.365266+0000","last_unstale":"2024-09-17T05:51:16.357443+0000","last_undegraded":"2024-09-17T05:51:16.357443+0000","last_fullsized":"2024-09-17T05:51:16.357443+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:51:14.325451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:51:14.325451+0000","last_clean_scrub_stamp":"2024-09-17T05:51:14.325451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:49:28.476795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.7","version":"112'2","reported_seq":17,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-17T05:51:16.340820+0000","last_change":"2024-09-17T05:51:14.358131+0000","last_active":"2024-09-17T05:51:16.340820+0000","last_peered":"2024-09-17T05:51:16.340820+0000","last_clean":"2024-09-17T05:51:16.340820+0000","last_became_active":"2024-09-17T05:51:14.357812+0000","last_became_peered":"2024-09-17T05:51:14.357812+0000","last_unstale":"2024-09-17T05:51:16.340820+0000","last_undegraded":"2024-09-17T05:51:16.340820+0000","last_fullsized":"2024-09-17T05:51:16.340820+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:51:13.315624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:51:13.315624+0000","last_clean_scrub_stamp":"2024-09-17T05:51:13.315624+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:00:46.227529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:51:14.325451+0000","last_change":"2024-09-17T05:51:14.325451+0000","last_active":"2024-09-17T05:51:14.325451+0000","last_peered":"2024-09-17T05:51:14.325451+0000","last_clean":"2024-09-17T05:51:14.325451+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:51:14.325451+0000","last_undegraded":"2024-09-17T05:51:14.325451+0000","last_fullsized":"2024-09-17T05:51:14.325451+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:51:14.325451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:51:14.325451+0000","last_clean_scrub_stamp":"2024-09-17T05:51:14.325451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.6","version":"113'1","reported_seq":16,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-17T05:51:16.357547+0000","last_change":"2024-09-17T05:51:14.353668+0000","last_active":"2024-09-17T05:51:16.357547+0000","last_peered":"2024-09-17T05:51:16.357547+0000","last_clean":"2024-09-17T05:51:16.357547+0000","last_became_active":"2024-09-17T05:51:14.353344+0000","last_became_peered":"2024-09-17T05:51:14.353344+0000","last_unstale":"2024-09-17T05:51:16.357547+0000","last_undegraded":"2024-09-17T05:51:16.357547+0000","last_fullsized":"2024-09-17T05:51:16.357547+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:51:13.315624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:51:13.315624+0000","last_clean_scrub_stamp":"2024-09-17T05:51:13.315624+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:56:25.324024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:51:14.325451+0000","last_change":"2024-09-17T05:51:14.325451+0000","last_active":"2024-09-17T05:51:14.325451+0000","last_peered":"2024-09-17T05:51:14.325451+0000","last_clean":"2024-09-17T05:51:14.325451+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:51:14.325451+0000","last_undegraded":"2024-09-17T05:51:14.325451+0000","last_fullsized":"2024-09-17T05:51:14.325451+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:51:14.325451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:51:14.325451+0000","last_clean_scrub_stamp":"2024-09-17T05:51:14.325451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.5","version":"0'0","reported_seq":1,"reported_epoch":110,"state":"creating+peering","last_fresh":"2024-09-17T05:51:13.332782+0000","last_change":"2024-09-17T05:51:13.332782+0000","last_active":"2024-09-17T05:51:13.315624+0000","last_peered":"2024-09-17T05:51:13.315624+0000","last_clean":"2024-09-17T05:51:13.315624+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:51:13.332782+0000","last_undegraded":"2024-09-17T05:51:13.332782+0000","last_fullsized":"2024-09-17T05:51:13.332782+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:51:13.315624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:51:13.315624+0000","last_clean_scrub_stamp":"2024-09-17T05:51:13.315624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.5","version":"0'0","reported_seq":13,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-17T05:51:16.357324+0000","last_change":"2024-09-17T05:51:15.363844+0000","last_active":"2024-09-17T05:51:16.357324+0000","last_peered":"2024-09-17T05:51:16.357324+0000","last_clean":"2024-09-17T05:51:16.357324+0000","last_became_active":"2024-09-17T05:51:15.363465+0000","last_became_peered":"2024-09-17T05:51:15.363465+0000","last_unstale":"2024-09-17T05:51:16.357324+0000","last_undegraded":"2024-09-17T05:51:16.357324+0000","last_fullsized":"2024-09-17T05:51:16.357324+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:51:14.325451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:51:14.325451+0000","last_clean_scrub_stamp":"2024-09-17T05:51:14.325451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:17:42.550657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.4","version":"0'0","reported_seq":15,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-17T05:51:16.341090+0000","last_change":"2024-09-17T05:51:14.350349+0000","last_active":"2024-09-17T05:51:16.341090+0000","last_peered":"2024-09-17T05:51:16.341090+0000","last_clean":"2024-09-17T05:51:16.341090+0000","last_became_active":"2024-09-17T05:51:14.350017+0000","last_became_peered":"2024-09-17T05:51:14.350017+0000","last_unstale":"2024-09-17T05:51:16.341090+0000","last_undegraded":"2024-09-17T05:51:16.341090+0000","last_fullsized":"2024-09-17T05:51:16.341090+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:51:13.315624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:51:13.315624+0000","last_clean_scrub_stamp":"2024-09-17T05:51:13.315624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:31:26.485537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.2","version":"0'0","reported_seq":13,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-17T05:51:16.340588+0000","last_change":"2024-09-17T05:51:15.345136+0000","last_active":"2024-09-17T05:51:16.340588+0000","last_peered":"2024-09-17T05:51:16.340588+0000","last_clean":"2024-09-17T05:51:16.340588+0000","last_became_active":"2024-09-17T05:51:15.344810+0000","last_became_peered":"2024-09-17T05:51:15.344810+0000","last_unstale":"2024-09-17T05:51:16.340588+0000","last_undegraded":"2024-09-17T05:51:16.340588+0000","last_fullsized":"2024-09-17T05:51:16.340588+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:51:14.325451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:51:14.325451+0000","last_clean_scrub_stamp":"2024-09-17T05:51:14.325451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:46:58.628756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.3","version":"0'0","reported_seq":15,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-17T05:51:16.359885+0000","last_change":"2024-09-17T05:51:14.352438+0000","last_active":"2024-09-17T05:51:16.359885+0000","last_peered":"2024-09-17T05:51:16.359885+0000","last_clean":"2024-09-17T05:51:16.359885+0000","last_became_active":"2024-09-17T05:51:14.352097+0000","last_became_peered":"2024-09-17T05:51:14.352097+0000","last_unstale":"2024-09-17T05:51:16.359885+0000","last_undegraded":"2024-09-17T05:51:16.359885+0000","last_fullsized":"2024-09-17T05:51:16.359885+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:51:13.315624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:51:13.315624+0000","last_clean_scrub_stamp":"2024-09-17T05:51:13.315624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:42:26.091891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.3","version":"0'0","reported_seq":13,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-17T05:51:16.340998+0000","last_change":"2024-09-17T05:51:15.359800+0000","last_active":"2024-09-17T05:51:16.340998+0000","last_peered":"2024-09-17T05:51:16.340998+0000","last_clean":"2024-09-17T05:51:16.340998+0000","last_became_active":"2024-09-17T05:51:15.357898+0000","last_became_peered":"2024-09-17T05:51:15.357898+0000","last_unstale":"2024-09-17T05:51:16.340998+0000","last_undegraded":"2024-09-17T05:51:16.340998+0000","last_fullsized":"2024-09-17T05:51:16.340998+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:51:14.325451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:51:14.325451+0000","last_clean_scrub_stamp":"2024-09-17T05:51:14.325451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:44:07.877112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.2","version":"0'0","reported_seq":15,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-17T05:51:16.340331+0000","last_change":"2024-09-17T05:51:14.355271+0000","last_active":"2024-09-17T05:51:16.340331+0000","last_peered":"2024-09-17T05:51:16.340331+0000","last_clean":"2024-09-17T05:51:16.340331+0000","last_became_active":"2024-09-17T05:51:14.354782+0000","last_became_peered":"2024-09-17T05:51:14.354782+0000","last_unstale":"2024-09-17T05:51:16.340331+0000","last_undegraded":"2024-09-17T05:51:16.340331+0000","last_fullsized":"2024-09-17T05:51:16.340331+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:51:13.315624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:51:13.315624+0000","last_clean_scrub_stamp":"2024-09-17T05:51:13.315624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:28:04.514097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.0","version":"0'0","reported_seq":13,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-17T05:51:16.750649+0000","last_change":"2024-09-17T05:51:15.358735+0000","last_active":"2024-09-17T05:51:16.750649+0000","last_peered":"2024-09-17T05:51:16.750649+0000","last_clean":"2024-09-17T05:51:16.750649+0000","last_became_active":"2024-09-17T05:51:15.358337+0000","last_became_peered":"2024-09-17T05:51:15.358337+0000","last_unstale":"2024-09-17T05:51:16.750649+0000","last_undegraded":"2024-09-17T05:51:16.750649+0000","last_fullsized":"2024-09-17T05:51:16.750649+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:51:14.325451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:51:14.325451+0000","last_clean_scrub_stamp":"2024-09-17T05:51:14.325451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:23:41.242455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.1","version":"0'0","reported_seq":15,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-17T05:51:16.339383+0000","last_change":"2024-09-17T05:51:14.352047+0000","last_active":"2024-09-17T05:51:16.339383+0000","last_peered":"2024-09-17T05:51:16.339383+0000","last_clean":"2024-09-17T05:51:16.339383+0000","last_became_active":"2024-09-17T05:51:14.351529+0000","last_became_peered":"2024-09-17T05:51:14.351529+0000","last_unstale":"2024-09-17T05:51:16.339383+0000","last_undegraded":"2024-09-17T05:51:16.339383+0000","last_fullsized":"2024-09-17T05:51:16.339383+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:51:13.315624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:51:13.315624+0000","last_clean_scrub_stamp":"2024-09-17T05:51:13.315624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:58:57.809988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:51:14.325451+0000","last_change":"2024-09-17T05:51:14.325451+0000","last_active":"2024-09-17T05:51:14.325451+0000","last_peered":"2024-09-17T05:51:14.325451+0000","last_clean":"2024-09-17T05:51:14.325451+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:51:14.325451+0000","last_undegraded":"2024-09-17T05:51:14.325451+0000","last_fullsized":"2024-09-17T05:51:14.325451+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:51:14.325451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:51:14.325451+0000","last_clean_scrub_stamp":"2024-09-17T05:51:14.325451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.0","version":"0'0","reported_seq":1,"reported_epoch":110,"state":"creating+peering","last_fresh":"2024-09-17T05:51:13.332654+0000","last_change":"2024-09-17T05:51:13.332654+0000","last_active":"2024-09-17T05:51:13.315624+0000","last_peered":"2024-09-17T05:51:13.315624+0000","last_clean":"2024-09-17T05:51:13.315624+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:51:13.332654+0000","last_undegraded":"2024-09-17T05:51:13.332654+0000","last_fullsized":"2024-09-17T05:51:13.332654+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:51:13.315624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:51:13.315624+0000","last_clean_scrub_stamp":"2024-09-17T05:51:13.315624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.10","version":"0'0","reported_seq":13,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-17T05:51:16.340473+0000","last_change":"2024-09-17T05:51:15.351750+0000","last_active":"2024-09-17T05:51:16.340473+0000","last_peered":"2024-09-17T05:51:16.340473+0000","last_clean":"2024-09-17T05:51:16.340473+0000","last_became_active":"2024-09-17T05:51:15.351076+0000","last_became_peered":"2024-09-17T05:51:15.351076+0000","last_unstale":"2024-09-17T05:51:16.340473+0000","last_undegraded":"2024-09-17T05:51:16.340473+0000","last_fullsized":"2024-09-17T05:51:16.340473+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:51:14.325451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:51:14.325451+0000","last_clean_scrub_stamp":"2024-09-17T05:51:14.325451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:49:55.636228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.11","version":"0'0","reported_seq":15,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-17T05:51:16.360020+0000","last_change":"2024-09-17T05:51:14.358432+0000","last_active":"2024-09-17T05:51:16.360020+0000","last_peered":"2024-09-17T05:51:16.360020+0000","last_clean":"2024-09-17T05:51:16.360020+0000","last_became_active":"2024-09-17T05:51:14.358059+0000","last_became_peered":"2024-09-17T05:51:14.358059+0000","last_unstale":"2024-09-17T05:51:16.360020+0000","last_undegraded":"2024-09-17T05:51:16.360020+0000","last_fullsized":"2024-09-17T05:51:16.360020+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:51:13.315624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:51:13.315624+0000","last_clean_scrub_stamp":"2024-09-17T05:51:13.315624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:32:58.129426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"19'72","reported_seq":276,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-17T05:51:16.750680+0000","last_change":"2024-09-17T05:41:48.539830+0000","last_active":"2024-09-17T05:51:16.750680+0000","last_peered":"2024-09-17T05:51:16.750680+0000","last_clean":"2024-09-17T05:51:16.750680+0000","last_became_active":"2024-09-17T05:41:48.538743+0000","last_became_peered":"2024-09-17T05:41:48.538743+0000","last_unstale":"2024-09-17T05:51:16.750680+0000","last_undegraded":"2024-09-17T05:51:16.750680+0000","last_fullsized":"2024-09-17T05:51:16.750680+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:47.152539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:47.152539+0000","last_clean_scrub_stamp":"2024-09-17T05:41:47.152539+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:08:02.952016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":17,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":100,"acting":100,"num_store_stats":7},{"poolid":16,"num_pg":32,"stat_sum":{"num_bytes":686,"num_objects":15,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":34,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":12,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":3096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":29,"ondisk_log_size":29,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":16,"seq":68719476855,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":122740,"kb_used_data":1368,"kb_used_omap":1,"kb_used_meta":121342,"kb_avail":94249100,"statfs":{"total":96636764160,"available":96511078400,"internally_reserved":0,"allocated":1400832,"data_stored":608982,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":124254662},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":7,"up_from":15,"seq":64424509559,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":131624,"kb_used_data":1940,"kb_used_omap":1,"kb_used_meta":129662,"kb_avail":94240216,"statfs":{"total":96636764160,"available":96501981184,"internally_reserved":0,"allocated":1986560,"data_stored":1193456,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":132774346},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509558,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":108844,"kb_used_data":1360,"kb_used_omap":1,"kb_used_meta":107454,"kb_avail":94262996,"statfs":{"total":96636764160,"available":96525307904,"internally_reserved":0,"allocated":1392640,"data_stored":603076,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":110033349},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509558,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":136624,"kb_used_data":1364,"kb_used_omap":1,"kb_used_meta":135230,"kb_avail":94235216,"statfs":{"total":96636764160,"available":96496861184,"internally_reserved":0,"allocated":1396736,"data_stored":608912,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":138475973},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509558,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":131064,"kb_used_data":1380,"kb_used_omap":1,"kb_used_meta":129662,"kb_avail":94240776,"statfs":{"total":96636764160,"available":96502554624,"internally_reserved":0,"allocated":1413120,"data_stored":610594,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":132774343},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509558,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":136620,"kb_used_data":1364,"kb_used_omap":1,"kb_used_meta":135230,"kb_avail":94235220,"statfs":{"total":96636764160,"available":96496865280,"internally_reserved":0,"allocated":1396736,"data_stored":608912,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":138475973},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509558,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":122740,"kb_used_data":1372,"kb_used_omap":1,"kb_used_meta":121342,"kb_avail":94249100,"statfs":{"total":96636764160,"available":96511078400,"internally_reserved":0,"allocated":1404928,"data_stored":609036,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":124254661},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574965,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":119104,"kb_used_data":1896,"kb_used_omap":1,"kb_used_meta":117182,"kb_avail":94252736,"statfs":{"total":96636764160,"available":96514801664,"internally_reserved":0,"allocated":1941504,"data_stored":1173553,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":119994821},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1682,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-17T05:51:19.720 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-17T05:51:19.871 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:19.870+0000 7f0c5aea2640 1 -- 172.21.15.150:0/2897576224 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0c3c003a00 msgr2=0x7f0c3c003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:51:19.871 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:19.870+0000 7f0c5aea2640 1 --2- 172.21.15.150:0/2897576224 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0c3c003a00 0x7f0c3c003e70 secure :-1 s=READY pgs=1500 cs=0 l=1 rev1=1 crypto rx=0x7f0c50009b40 tx=0x7f0c3c005830 comp rx=0 tx=0).stop 2024-09-17T05:51:19.871 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:19.870+0000 7f0c5943f640 1 -- 172.21.15.150:0/2897576224 reap_dead start 2024-09-17T05:51:19.871 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:19.870+0000 7f0c5aea2640 1 -- 172.21.15.150:0/2897576224 shutdown_connections 2024-09-17T05:51:19.872 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:19.870+0000 7f0c5aea2640 1 -- 172.21.15.150:0/2897576224 >> 172.21.15.150:0/2897576224 conn(0x7f0c540cee90 msgr2=0x7f0c540cf2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:51:19.872 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:19.870+0000 7f0c5aea2640 1 -- 172.21.15.150:0/2897576224 shutdown_connections 2024-09-17T05:51:19.872 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:19.870+0000 7f0c5aea2640 1 -- 172.21.15.150:0/2897576224 wait complete. 2024-09-17T05:51:19.872 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:19.872+0000 7f0c5aea2640 1 Processor -- start 2024-09-17T05:51:19.873 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:19.872+0000 7f0c5aea2640 1 -- start start 2024-09-17T05:51:19.875 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:19.873+0000 7f0c5aea2640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0c3c003a00 0x7f0c541d8fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:51:19.875 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:19.873+0000 7f0c5aea2640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0c541d5cc0 0x7f0c540c5e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:51:19.876 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:19.873+0000 7f0c5aea2640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0c540c6380 0x7f0c541f34b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:51:19.876 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:19.873+0000 7f0c5aea2640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f0c540d0870 con 0x7f0c540c6380 2024-09-17T05:51:19.876 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:19.873+0000 7f0c5aea2640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f0c540d06f0 con 0x7f0c541d5cc0 2024-09-17T05:51:19.876 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:19.874+0000 7f0c5aea2640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f0c540d09f0 con 0x7f0c3c003a00 2024-09-17T05:51:19.876 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:19.874+0000 7f0c5943f640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0c540c6380 0x7f0c541f34b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:51:19.876 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:19.874+0000 7f0c5943f640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0c540c6380 0x7f0c541f34b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:50402/0 (socket says 172.21.15.150:50402) 2024-09-17T05:51:19.876 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:19.874+0000 7f0c5943f640 1 -- 172.21.15.150:0/114615081 learned_addr learned my addr 172.21.15.150:0/114615081 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:51:19.876 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:19.874+0000 7f0c4bfff640 1 --2- 172.21.15.150:0/114615081 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0c541d5cc0 0x7f0c540c5e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:51:19.876 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:19.874+0000 7f0c58c3e640 1 --2- 172.21.15.150:0/114615081 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0c3c003a00 0x7f0c541d8fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:51:19.876 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:19.874+0000 7f0c5943f640 1 -- 172.21.15.150:0/114615081 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0c3c003a00 msgr2=0x7f0c541d8fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:51:19.876 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:19.874+0000 7f0c5943f640 1 --2- 172.21.15.150:0/114615081 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0c3c003a00 0x7f0c541d8fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:51:19.876 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:19.874+0000 7f0c5943f640 1 -- 172.21.15.150:0/114615081 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0c541d5cc0 msgr2=0x7f0c540c5e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:51:19.877 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:19.874+0000 7f0c5943f640 1 --2- 172.21.15.150:0/114615081 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0c541d5cc0 0x7f0c540c5e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:51:19.877 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:19.874+0000 7f0c5943f640 1 -- 172.21.15.150:0/114615081 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0c541f3f30 con 0x7f0c540c6380 2024-09-17T05:51:19.877 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:19.874+0000 7f0c5943f640 1 --2- 172.21.15.150:0/114615081 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0c540c6380 0x7f0c541f34b0 secure :-1 s=READY pgs=1501 cs=0 l=1 rev1=1 crypto rx=0x7f0c54069ef0 tx=0x7f0c4c010e50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:51:19.877 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:19.874+0000 7f0c497fa640 1 -- 172.21.15.150:0/114615081 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c4c00ed90 con 0x7f0c540c6380 2024-09-17T05:51:19.877 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:19.874+0000 7f0c497fa640 1 -- 172.21.15.150:0/114615081 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0c4c015070 con 0x7f0c540c6380 2024-09-17T05:51:19.877 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:19.874+0000 7f0c5aea2640 1 -- 172.21.15.150:0/114615081 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0c541f4210 con 0x7f0c540c6380 2024-09-17T05:51:19.877 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:19.874+0000 7f0c497fa640 1 -- 172.21.15.150:0/114615081 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c4c003bb0 con 0x7f0c540c6380 2024-09-17T05:51:19.877 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:19.874+0000 7f0c5aea2640 1 -- 172.21.15.150:0/114615081 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0c541d8a80 con 0x7f0c540c6380 2024-09-17T05:51:19.878 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:19.875+0000 7f0c5aea2640 1 -- 172.21.15.150:0/114615081 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0c541d8590 con 0x7f0c540c6380 2024-09-17T05:51:19.878 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:19.876+0000 7f0c497fa640 1 -- 172.21.15.150:0/114615081 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 37) ==== 103787+0+0 (secure 0 0 0) 0x7f0c4c004030 con 0x7f0c540c6380 2024-09-17T05:51:19.878 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:19.876+0000 7f0c497fa640 1 --2- 172.21.15.150:0/114615081 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f0c4007a570 0x7f0c4007ca80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:51:19.878 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:19.877+0000 7f0c497fa640 1 -- 172.21.15.150:0/114615081 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(113..113 src has 1..113) ==== 5849+0+0 (secure 0 0 0) 0x7f0c4c09a5f0 con 0x7f0c540c6380 2024-09-17T05:51:19.878 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:19.877+0000 7f0c58c3e640 1 --2- 172.21.15.150:0/114615081 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f0c4007a570 0x7f0c4007ca80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:51:19.878 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:19.877+0000 7f0c58c3e640 1 --2- 172.21.15.150:0/114615081 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f0c4007a570 0x7f0c4007ca80 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7f0c50009b40 tx=0x7f0c5002d040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:51:19.882 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:19.881+0000 7f0c497fa640 1 -- 172.21.15.150:0/114615081 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f0c4c064530 con 0x7f0c540c6380 2024-09-17T05:51:20.054 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:20.054+0000 7f0c5aea2640 1 -- 172.21.15.150:0/114615081 --> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f0c540b7330 con 0x7f0c4007a570 2024-09-17T05:51:20.059 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:20.059+0000 7f0c497fa640 1 -- 172.21.15.150:0/114615081 <== mgr.4108 v2:172.21.15.176:6800/3631216395 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+249997 (secure 0 0 0) 0x7f0c540b7330 con 0x7f0c4007a570 2024-09-17T05:51:20.062 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-09-17T05:51:20.063 INFO:teuthology.orchestra.run.smithi150.stderr:dumped all 2024-09-17T05:51:20.064 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:20.062+0000 7f0c5aea2640 1 -- 172.21.15.150:0/114615081 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f0c4007a570 msgr2=0x7f0c4007ca80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:51:20.065 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:20.062+0000 7f0c5aea2640 1 --2- 172.21.15.150:0/114615081 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f0c4007a570 0x7f0c4007ca80 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7f0c50009b40 tx=0x7f0c5002d040 comp rx=0 tx=0).stop 2024-09-17T05:51:20.065 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:20.062+0000 7f0c5aea2640 1 -- 172.21.15.150:0/114615081 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0c540c6380 msgr2=0x7f0c541f34b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:51:20.065 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:20.062+0000 7f0c5aea2640 1 --2- 172.21.15.150:0/114615081 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0c540c6380 0x7f0c541f34b0 secure :-1 s=READY pgs=1501 cs=0 l=1 rev1=1 crypto rx=0x7f0c54069ef0 tx=0x7f0c4c010e50 comp rx=0 tx=0).stop 2024-09-17T05:51:20.065 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:20.062+0000 7f0c5aea2640 1 -- 172.21.15.150:0/114615081 shutdown_connections 2024-09-17T05:51:20.065 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:20.062+0000 7f0c5aea2640 1 --2- 172.21.15.150:0/114615081 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0c541d5cc0 0x7f0c540c5e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:51:20.065 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:20.062+0000 7f0c5aea2640 1 --2- 172.21.15.150:0/114615081 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f0c4007a570 0x7f0c4007ca80 unknown :-1 s=CLOSED pgs=641 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:51:20.065 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:20.062+0000 7f0c5aea2640 1 --2- 172.21.15.150:0/114615081 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0c540c6380 0x7f0c541f34b0 unknown :-1 s=CLOSED pgs=1501 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:51:20.065 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:20.062+0000 7f0c5aea2640 1 --2- 172.21.15.150:0/114615081 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0c3c003a00 0x7f0c541d8fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:51:20.065 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:20.062+0000 7f0c5aea2640 1 -- 172.21.15.150:0/114615081 >> 172.21.15.150:0/114615081 conn(0x7f0c540cee90 msgr2=0x7f0c54068e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:51:20.065 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:20.062+0000 7f0c5aea2640 1 -- 172.21.15.150:0/114615081 shutdown_connections 2024-09-17T05:51:20.065 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:20.062+0000 7f0c5aea2640 1 -- 172.21.15.150:0/114615081 wait complete. 2024-09-17T05:51:20.074 INFO:teuthology.orchestra.run.smithi150.stdout:{"pg_ready":true,"pg_map":{"version":394,"stamp":"2024-09-17T05:51:19.058233+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":591054,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":135,"num_write_kb":1637,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":12,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":101,"ondisk_log_size":101,"up":166,"acting":166,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":98,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":1009360,"kb_used_data":12044,"kb_used_omap":12,"kb_used_meta":997107,"kb_avail":753965360,"statfs":{"total":773094113280,"available":772060528640,"internally_reserved":0,"allocated":12333056,"data_stored":6016521,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":1021038128},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":17,"apply_latency_ms":17,"commit_latency_ns":17000000,"apply_latency_ns":17000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":686,"num_objects":15,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":34,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":12,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.726990"},"pg_stats":[{"pgid":"17.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:51:14.325451+0000","last_change":"2024-09-17T05:51:14.325451+0000","last_active":"2024-09-17T05:51:14.325451+0000","last_peered":"2024-09-17T05:51:14.325451+0000","last_clean":"2024-09-17T05:51:14.325451+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:51:14.325451+0000","last_undegraded":"2024-09-17T05:51:14.325451+0000","last_fullsized":"2024-09-17T05:51:14.325451+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:51:14.325451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:51:14.325451+0000","last_clean_scrub_stamp":"2024-09-17T05:51:14.325451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.3e","version":"0'0","reported_seq":13,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-17T05:51:16.340640+0000","last_change":"2024-09-17T05:51:15.344958+0000","last_active":"2024-09-17T05:51:16.340640+0000","last_peered":"2024-09-17T05:51:16.340640+0000","last_clean":"2024-09-17T05:51:16.340640+0000","last_became_active":"2024-09-17T05:51:15.344518+0000","last_became_peered":"2024-09-17T05:51:15.344518+0000","last_unstale":"2024-09-17T05:51:16.340640+0000","last_undegraded":"2024-09-17T05:51:16.340640+0000","last_fullsized":"2024-09-17T05:51:16.340640+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:51:14.325451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:51:14.325451+0000","last_clean_scrub_stamp":"2024-09-17T05:51:14.325451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:49:40.516537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.3d","version":"0'0","reported_seq":13,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-17T05:51:16.750744+0000","last_change":"2024-09-17T05:51:15.352551+0000","last_active":"2024-09-17T05:51:16.750744+0000","last_peered":"2024-09-17T05:51:16.750744+0000","last_clean":"2024-09-17T05:51:16.750744+0000","last_became_active":"2024-09-17T05:51:15.352223+0000","last_became_peered":"2024-09-17T05:51:15.352223+0000","last_unstale":"2024-09-17T05:51:16.750744+0000","last_undegraded":"2024-09-17T05:51:16.750744+0000","last_fullsized":"2024-09-17T05:51:16.750744+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:51:14.325451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:51:14.325451+0000","last_clean_scrub_stamp":"2024-09-17T05:51:14.325451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:56:32.607756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:51:14.325451+0000","last_change":"2024-09-17T05:51:14.325451+0000","last_active":"2024-09-17T05:51:14.325451+0000","last_peered":"2024-09-17T05:51:14.325451+0000","last_clean":"2024-09-17T05:51:14.325451+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:51:14.325451+0000","last_undegraded":"2024-09-17T05:51:14.325451+0000","last_fullsized":"2024-09-17T05:51:14.325451+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:51:14.325451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:51:14.325451+0000","last_clean_scrub_stamp":"2024-09-17T05:51:14.325451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.3b","version":"0'0","reported_seq":13,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-17T05:51:16.339755+0000","last_change":"2024-09-17T05:51:15.354740+0000","last_active":"2024-09-17T05:51:16.339755+0000","last_peered":"2024-09-17T05:51:16.339755+0000","last_clean":"2024-09-17T05:51:16.339755+0000","last_became_active":"2024-09-17T05:51:15.354441+0000","last_became_peered":"2024-09-17T05:51:15.354441+0000","last_unstale":"2024-09-17T05:51:16.339755+0000","last_undegraded":"2024-09-17T05:51:16.339755+0000","last_fullsized":"2024-09-17T05:51:16.339755+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:51:14.325451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:51:14.325451+0000","last_clean_scrub_stamp":"2024-09-17T05:51:14.325451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:01:13.224376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.3a","version":"0'0","reported_seq":13,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-17T05:51:16.750534+0000","last_change":"2024-09-17T05:51:15.349818+0000","last_active":"2024-09-17T05:51:16.750534+0000","last_peered":"2024-09-17T05:51:16.750534+0000","last_clean":"2024-09-17T05:51:16.750534+0000","last_became_active":"2024-09-17T05:51:15.349457+0000","last_became_peered":"2024-09-17T05:51:15.349457+0000","last_unstale":"2024-09-17T05:51:16.750534+0000","last_undegraded":"2024-09-17T05:51:16.750534+0000","last_fullsized":"2024-09-17T05:51:16.750534+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:51:14.325451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:51:14.325451+0000","last_clean_scrub_stamp":"2024-09-17T05:51:14.325451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:08:40.638937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.39","version":"0'0","reported_seq":13,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-17T05:51:16.360003+0000","last_change":"2024-09-17T05:51:15.358171+0000","last_active":"2024-09-17T05:51:16.360003+0000","last_peered":"2024-09-17T05:51:16.360003+0000","last_clean":"2024-09-17T05:51:16.360003+0000","last_became_active":"2024-09-17T05:51:15.357838+0000","last_became_peered":"2024-09-17T05:51:15.357838+0000","last_unstale":"2024-09-17T05:51:16.360003+0000","last_undegraded":"2024-09-17T05:51:16.360003+0000","last_fullsized":"2024-09-17T05:51:16.360003+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:51:14.325451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:51:14.325451+0000","last_clean_scrub_stamp":"2024-09-17T05:51:14.325451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:20:00.031149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.38","version":"0'0","reported_seq":13,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-17T05:51:16.750342+0000","last_change":"2024-09-17T05:51:15.361077+0000","last_active":"2024-09-17T05:51:16.750342+0000","last_peered":"2024-09-17T05:51:16.750342+0000","last_clean":"2024-09-17T05:51:16.750342+0000","last_became_active":"2024-09-17T05:51:15.359954+0000","last_became_peered":"2024-09-17T05:51:15.359954+0000","last_unstale":"2024-09-17T05:51:16.750342+0000","last_undegraded":"2024-09-17T05:51:16.750342+0000","last_fullsized":"2024-09-17T05:51:16.750342+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:51:14.325451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:51:14.325451+0000","last_clean_scrub_stamp":"2024-09-17T05:51:14.325451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:40:17.074211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:51:14.325451+0000","last_change":"2024-09-17T05:51:14.325451+0000","last_active":"2024-09-17T05:51:14.325451+0000","last_peered":"2024-09-17T05:51:14.325451+0000","last_clean":"2024-09-17T05:51:14.325451+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:51:14.325451+0000","last_undegraded":"2024-09-17T05:51:14.325451+0000","last_fullsized":"2024-09-17T05:51:14.325451+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:51:14.325451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:51:14.325451+0000","last_clean_scrub_stamp":"2024-09-17T05:51:14.325451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:51:14.325451+0000","last_change":"2024-09-17T05:51:14.325451+0000","last_active":"2024-09-17T05:51:14.325451+0000","last_peered":"2024-09-17T05:51:14.325451+0000","last_clean":"2024-09-17T05:51:14.325451+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:51:14.325451+0000","last_undegraded":"2024-09-17T05:51:14.325451+0000","last_fullsized":"2024-09-17T05:51:14.325451+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:51:14.325451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:51:14.325451+0000","last_clean_scrub_stamp":"2024-09-17T05:51:14.325451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.35","version":"0'0","reported_seq":13,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-17T05:51:16.341088+0000","last_change":"2024-09-17T05:51:15.353391+0000","last_active":"2024-09-17T05:51:16.341088+0000","last_peered":"2024-09-17T05:51:16.341088+0000","last_clean":"2024-09-17T05:51:16.341088+0000","last_became_active":"2024-09-17T05:51:15.353075+0000","last_became_peered":"2024-09-17T05:51:15.353075+0000","last_unstale":"2024-09-17T05:51:16.341088+0000","last_undegraded":"2024-09-17T05:51:16.341088+0000","last_fullsized":"2024-09-17T05:51:16.341088+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:51:14.325451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:51:14.325451+0000","last_clean_scrub_stamp":"2024-09-17T05:51:14.325451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:35:01.866394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:51:14.325451+0000","last_change":"2024-09-17T05:51:14.325451+0000","last_active":"2024-09-17T05:51:14.325451+0000","last_peered":"2024-09-17T05:51:14.325451+0000","last_clean":"2024-09-17T05:51:14.325451+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:51:14.325451+0000","last_undegraded":"2024-09-17T05:51:14.325451+0000","last_fullsized":"2024-09-17T05:51:14.325451+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:51:14.325451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:51:14.325451+0000","last_clean_scrub_stamp":"2024-09-17T05:51:14.325451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.33","version":"0'0","reported_seq":13,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-17T05:51:16.750511+0000","last_change":"2024-09-17T05:51:15.356651+0000","last_active":"2024-09-17T05:51:16.750511+0000","last_peered":"2024-09-17T05:51:16.750511+0000","last_clean":"2024-09-17T05:51:16.750511+0000","last_became_active":"2024-09-17T05:51:15.356329+0000","last_became_peered":"2024-09-17T05:51:15.356329+0000","last_unstale":"2024-09-17T05:51:16.750511+0000","last_undegraded":"2024-09-17T05:51:16.750511+0000","last_fullsized":"2024-09-17T05:51:16.750511+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:51:14.325451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:51:14.325451+0000","last_clean_scrub_stamp":"2024-09-17T05:51:14.325451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:40:43.043320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.32","version":"0'0","reported_seq":13,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-17T05:51:16.750261+0000","last_change":"2024-09-17T05:51:15.358138+0000","last_active":"2024-09-17T05:51:16.750261+0000","last_peered":"2024-09-17T05:51:16.750261+0000","last_clean":"2024-09-17T05:51:16.750261+0000","last_became_active":"2024-09-17T05:51:15.357839+0000","last_became_peered":"2024-09-17T05:51:15.357839+0000","last_unstale":"2024-09-17T05:51:16.750261+0000","last_undegraded":"2024-09-17T05:51:16.750261+0000","last_fullsized":"2024-09-17T05:51:16.750261+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:51:14.325451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:51:14.325451+0000","last_clean_scrub_stamp":"2024-09-17T05:51:14.325451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:31:24.479375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.31","version":"0'0","reported_seq":13,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-17T05:51:16.749988+0000","last_change":"2024-09-17T05:51:15.349182+0000","last_active":"2024-09-17T05:51:16.749988+0000","last_peered":"2024-09-17T05:51:16.749988+0000","last_clean":"2024-09-17T05:51:16.749988+0000","last_became_active":"2024-09-17T05:51:15.348875+0000","last_became_peered":"2024-09-17T05:51:15.348875+0000","last_unstale":"2024-09-17T05:51:16.749988+0000","last_undegraded":"2024-09-17T05:51:16.749988+0000","last_fullsized":"2024-09-17T05:51:16.749988+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:51:14.325451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:51:14.325451+0000","last_clean_scrub_stamp":"2024-09-17T05:51:14.325451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:32:59.139253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:51:14.325451+0000","last_change":"2024-09-17T05:51:14.325451+0000","last_active":"2024-09-17T05:51:14.325451+0000","last_peered":"2024-09-17T05:51:14.325451+0000","last_clean":"2024-09-17T05:51:14.325451+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:51:14.325451+0000","last_undegraded":"2024-09-17T05:51:14.325451+0000","last_fullsized":"2024-09-17T05:51:14.325451+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:51:14.325451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:51:14.325451+0000","last_clean_scrub_stamp":"2024-09-17T05:51:14.325451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.2f","version":"0'0","reported_seq":13,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-17T05:51:16.340854+0000","last_change":"2024-09-17T05:51:15.356819+0000","last_active":"2024-09-17T05:51:16.340854+0000","last_peered":"2024-09-17T05:51:16.340854+0000","last_clean":"2024-09-17T05:51:16.340854+0000","last_became_active":"2024-09-17T05:51:15.355786+0000","last_became_peered":"2024-09-17T05:51:15.355786+0000","last_unstale":"2024-09-17T05:51:16.340854+0000","last_undegraded":"2024-09-17T05:51:16.340854+0000","last_fullsized":"2024-09-17T05:51:16.340854+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:51:14.325451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:51:14.325451+0000","last_clean_scrub_stamp":"2024-09-17T05:51:14.325451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:41:26.394405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.2e","version":"0'0","reported_seq":13,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-17T05:51:16.357401+0000","last_change":"2024-09-17T05:51:15.355528+0000","last_active":"2024-09-17T05:51:16.357401+0000","last_peered":"2024-09-17T05:51:16.357401+0000","last_clean":"2024-09-17T05:51:16.357401+0000","last_became_active":"2024-09-17T05:51:15.355205+0000","last_became_peered":"2024-09-17T05:51:15.355205+0000","last_unstale":"2024-09-17T05:51:16.357401+0000","last_undegraded":"2024-09-17T05:51:16.357401+0000","last_fullsized":"2024-09-17T05:51:16.357401+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:51:14.325451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:51:14.325451+0000","last_clean_scrub_stamp":"2024-09-17T05:51:14.325451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:59:59.333951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.2d","version":"0'0","reported_seq":13,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-17T05:51:16.750770+0000","last_change":"2024-09-17T05:51:15.357170+0000","last_active":"2024-09-17T05:51:16.750770+0000","last_peered":"2024-09-17T05:51:16.750770+0000","last_clean":"2024-09-17T05:51:16.750770+0000","last_became_active":"2024-09-17T05:51:15.356347+0000","last_became_peered":"2024-09-17T05:51:15.356347+0000","last_unstale":"2024-09-17T05:51:16.750770+0000","last_undegraded":"2024-09-17T05:51:16.750770+0000","last_fullsized":"2024-09-17T05:51:16.750770+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:51:14.325451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:51:14.325451+0000","last_clean_scrub_stamp":"2024-09-17T05:51:14.325451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:39:17.891657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.2c","version":"0'0","reported_seq":13,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-17T05:51:16.341037+0000","last_change":"2024-09-17T05:51:15.351757+0000","last_active":"2024-09-17T05:51:16.341037+0000","last_peered":"2024-09-17T05:51:16.341037+0000","last_clean":"2024-09-17T05:51:16.341037+0000","last_became_active":"2024-09-17T05:51:15.351451+0000","last_became_peered":"2024-09-17T05:51:15.351451+0000","last_unstale":"2024-09-17T05:51:16.341037+0000","last_undegraded":"2024-09-17T05:51:16.341037+0000","last_fullsized":"2024-09-17T05:51:16.341037+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:51:14.325451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:51:14.325451+0000","last_clean_scrub_stamp":"2024-09-17T05:51:14.325451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:02:50.463096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.2b","version":"0'0","reported_seq":13,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-17T05:51:16.341258+0000","last_change":"2024-09-17T05:51:15.343820+0000","last_active":"2024-09-17T05:51:16.341258+0000","last_peered":"2024-09-17T05:51:16.341258+0000","last_clean":"2024-09-17T05:51:16.341258+0000","last_became_active":"2024-09-17T05:51:15.343446+0000","last_became_peered":"2024-09-17T05:51:15.343446+0000","last_unstale":"2024-09-17T05:51:16.341258+0000","last_undegraded":"2024-09-17T05:51:16.341258+0000","last_fullsized":"2024-09-17T05:51:16.341258+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:51:14.325451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:51:14.325451+0000","last_clean_scrub_stamp":"2024-09-17T05:51:14.325451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:01:59.401335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.2a","version":"0'0","reported_seq":13,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-17T05:51:16.340834+0000","last_change":"2024-09-17T05:51:15.347950+0000","last_active":"2024-09-17T05:51:16.340834+0000","last_peered":"2024-09-17T05:51:16.340834+0000","last_clean":"2024-09-17T05:51:16.340834+0000","last_became_active":"2024-09-17T05:51:15.347234+0000","last_became_peered":"2024-09-17T05:51:15.347234+0000","last_unstale":"2024-09-17T05:51:16.340834+0000","last_undegraded":"2024-09-17T05:51:16.340834+0000","last_fullsized":"2024-09-17T05:51:16.340834+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:51:14.325451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:51:14.325451+0000","last_clean_scrub_stamp":"2024-09-17T05:51:14.325451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:25:47.876263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.29","version":"0'0","reported_seq":13,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-17T05:51:16.340293+0000","last_change":"2024-09-17T05:51:15.351107+0000","last_active":"2024-09-17T05:51:16.340293+0000","last_peered":"2024-09-17T05:51:16.340293+0000","last_clean":"2024-09-17T05:51:16.340293+0000","last_became_active":"2024-09-17T05:51:15.350800+0000","last_became_peered":"2024-09-17T05:51:15.350800+0000","last_unstale":"2024-09-17T05:51:16.340293+0000","last_undegraded":"2024-09-17T05:51:16.340293+0000","last_fullsized":"2024-09-17T05:51:16.340293+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:51:14.325451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:51:14.325451+0000","last_clean_scrub_stamp":"2024-09-17T05:51:14.325451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:54:30.680562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.28","version":"0'0","reported_seq":13,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-17T05:51:16.340277+0000","last_change":"2024-09-17T05:51:15.352451+0000","last_active":"2024-09-17T05:51:16.340277+0000","last_peered":"2024-09-17T05:51:16.340277+0000","last_clean":"2024-09-17T05:51:16.340277+0000","last_became_active":"2024-09-17T05:51:15.351461+0000","last_became_peered":"2024-09-17T05:51:15.351461+0000","last_unstale":"2024-09-17T05:51:16.340277+0000","last_undegraded":"2024-09-17T05:51:16.340277+0000","last_fullsized":"2024-09-17T05:51:16.340277+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:51:14.325451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:51:14.325451+0000","last_clean_scrub_stamp":"2024-09-17T05:51:14.325451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:07:01.411755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.27","version":"0'0","reported_seq":13,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-17T05:51:16.340985+0000","last_change":"2024-09-17T05:51:15.356473+0000","last_active":"2024-09-17T05:51:16.340985+0000","last_peered":"2024-09-17T05:51:16.340985+0000","last_clean":"2024-09-17T05:51:16.340985+0000","last_became_active":"2024-09-17T05:51:15.355395+0000","last_became_peered":"2024-09-17T05:51:15.355395+0000","last_unstale":"2024-09-17T05:51:16.340985+0000","last_undegraded":"2024-09-17T05:51:16.340985+0000","last_fullsized":"2024-09-17T05:51:16.340985+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:51:14.325451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:51:14.325451+0000","last_clean_scrub_stamp":"2024-09-17T05:51:14.325451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:45:35.715638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:51:14.325451+0000","last_change":"2024-09-17T05:51:14.325451+0000","last_active":"2024-09-17T05:51:14.325451+0000","last_peered":"2024-09-17T05:51:14.325451+0000","last_clean":"2024-09-17T05:51:14.325451+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:51:14.325451+0000","last_undegraded":"2024-09-17T05:51:14.325451+0000","last_fullsized":"2024-09-17T05:51:14.325451+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:51:14.325451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:51:14.325451+0000","last_clean_scrub_stamp":"2024-09-17T05:51:14.325451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.25","version":"0'0","reported_seq":13,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-17T05:51:16.750795+0000","last_change":"2024-09-17T05:51:15.350114+0000","last_active":"2024-09-17T05:51:16.750795+0000","last_peered":"2024-09-17T05:51:16.750795+0000","last_clean":"2024-09-17T05:51:16.750795+0000","last_became_active":"2024-09-17T05:51:15.349717+0000","last_became_peered":"2024-09-17T05:51:15.349717+0000","last_unstale":"2024-09-17T05:51:16.750795+0000","last_undegraded":"2024-09-17T05:51:16.750795+0000","last_fullsized":"2024-09-17T05:51:16.750795+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:51:14.325451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:51:14.325451+0000","last_clean_scrub_stamp":"2024-09-17T05:51:14.325451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:18:04.873879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.24","version":"0'0","reported_seq":13,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-17T05:51:16.340958+0000","last_change":"2024-09-17T05:51:15.354301+0000","last_active":"2024-09-17T05:51:16.340958+0000","last_peered":"2024-09-17T05:51:16.340958+0000","last_clean":"2024-09-17T05:51:16.340958+0000","last_became_active":"2024-09-17T05:51:15.353951+0000","last_became_peered":"2024-09-17T05:51:15.353951+0000","last_unstale":"2024-09-17T05:51:16.340958+0000","last_undegraded":"2024-09-17T05:51:16.340958+0000","last_fullsized":"2024-09-17T05:51:16.340958+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:51:14.325451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:51:14.325451+0000","last_clean_scrub_stamp":"2024-09-17T05:51:14.325451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:59:08.824529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.23","version":"0'0","reported_seq":13,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-17T05:51:16.340611+0000","last_change":"2024-09-17T05:51:15.352151+0000","last_active":"2024-09-17T05:51:16.340611+0000","last_peered":"2024-09-17T05:51:16.340611+0000","last_clean":"2024-09-17T05:51:16.340611+0000","last_became_active":"2024-09-17T05:51:15.350686+0000","last_became_peered":"2024-09-17T05:51:15.350686+0000","last_unstale":"2024-09-17T05:51:16.340611+0000","last_undegraded":"2024-09-17T05:51:16.340611+0000","last_fullsized":"2024-09-17T05:51:16.340611+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:51:14.325451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:51:14.325451+0000","last_clean_scrub_stamp":"2024-09-17T05:51:14.325451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:43:23.785414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.22","version":"0'0","reported_seq":13,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-17T05:51:16.360088+0000","last_change":"2024-09-17T05:51:15.341975+0000","last_active":"2024-09-17T05:51:16.360088+0000","last_peered":"2024-09-17T05:51:16.360088+0000","last_clean":"2024-09-17T05:51:16.360088+0000","last_became_active":"2024-09-17T05:51:15.341693+0000","last_became_peered":"2024-09-17T05:51:15.341693+0000","last_unstale":"2024-09-17T05:51:16.360088+0000","last_undegraded":"2024-09-17T05:51:16.360088+0000","last_fullsized":"2024-09-17T05:51:16.360088+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:51:14.325451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:51:14.325451+0000","last_clean_scrub_stamp":"2024-09-17T05:51:14.325451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:09:41.960133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:51:14.325451+0000","last_change":"2024-09-17T05:51:14.325451+0000","last_active":"2024-09-17T05:51:14.325451+0000","last_peered":"2024-09-17T05:51:14.325451+0000","last_clean":"2024-09-17T05:51:14.325451+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:51:14.325451+0000","last_undegraded":"2024-09-17T05:51:14.325451+0000","last_fullsized":"2024-09-17T05:51:14.325451+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:51:14.325451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:51:14.325451+0000","last_clean_scrub_stamp":"2024-09-17T05:51:14.325451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.20","version":"0'0","reported_seq":13,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-17T05:51:16.749919+0000","last_change":"2024-09-17T05:51:15.352088+0000","last_active":"2024-09-17T05:51:16.749919+0000","last_peered":"2024-09-17T05:51:16.749919+0000","last_clean":"2024-09-17T05:51:16.749919+0000","last_became_active":"2024-09-17T05:51:15.347745+0000","last_became_peered":"2024-09-17T05:51:15.347745+0000","last_unstale":"2024-09-17T05:51:16.749919+0000","last_undegraded":"2024-09-17T05:51:16.749919+0000","last_fullsized":"2024-09-17T05:51:16.749919+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:51:14.325451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:51:14.325451+0000","last_clean_scrub_stamp":"2024-09-17T05:51:14.325451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:00:48.024653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.1e","version":"0'0","reported_seq":13,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-17T05:51:16.751289+0000","last_change":"2024-09-17T05:51:15.356066+0000","last_active":"2024-09-17T05:51:16.751289+0000","last_peered":"2024-09-17T05:51:16.751289+0000","last_clean":"2024-09-17T05:51:16.751289+0000","last_became_active":"2024-09-17T05:51:15.355748+0000","last_became_peered":"2024-09-17T05:51:15.355748+0000","last_unstale":"2024-09-17T05:51:16.751289+0000","last_undegraded":"2024-09-17T05:51:16.751289+0000","last_fullsized":"2024-09-17T05:51:16.751289+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:51:14.325451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:51:14.325451+0000","last_clean_scrub_stamp":"2024-09-17T05:51:14.325451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:54:46.604153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.1f","version":"112'4","reported_seq":19,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-17T05:51:16.360144+0000","last_change":"2024-09-17T05:51:14.352310+0000","last_active":"2024-09-17T05:51:16.360144+0000","last_peered":"2024-09-17T05:51:16.360144+0000","last_clean":"2024-09-17T05:51:16.360144+0000","last_became_active":"2024-09-17T05:51:14.351942+0000","last_became_peered":"2024-09-17T05:51:14.351942+0000","last_unstale":"2024-09-17T05:51:16.360144+0000","last_undegraded":"2024-09-17T05:51:16.360144+0000","last_fullsized":"2024-09-17T05:51:16.360144+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:51:13.315624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:51:13.315624+0000","last_clean_scrub_stamp":"2024-09-17T05:51:13.315624+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:00:47.014826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.1f","version":"0'0","reported_seq":13,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-17T05:51:16.357652+0000","last_change":"2024-09-17T05:51:15.352409+0000","last_active":"2024-09-17T05:51:16.357652+0000","last_peered":"2024-09-17T05:51:16.357652+0000","last_clean":"2024-09-17T05:51:16.357652+0000","last_became_active":"2024-09-17T05:51:15.352109+0000","last_became_peered":"2024-09-17T05:51:15.352109+0000","last_unstale":"2024-09-17T05:51:16.357652+0000","last_undegraded":"2024-09-17T05:51:16.357652+0000","last_fullsized":"2024-09-17T05:51:16.357652+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:51:14.325451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:51:14.325451+0000","last_clean_scrub_stamp":"2024-09-17T05:51:14.325451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:46:13.487513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.1e","version":"112'1","reported_seq":16,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-17T05:51:16.750344+0000","last_change":"2024-09-17T05:51:14.354672+0000","last_active":"2024-09-17T05:51:16.750344+0000","last_peered":"2024-09-17T05:51:16.750344+0000","last_clean":"2024-09-17T05:51:16.750344+0000","last_became_active":"2024-09-17T05:51:14.354096+0000","last_became_peered":"2024-09-17T05:51:14.354096+0000","last_unstale":"2024-09-17T05:51:16.750344+0000","last_undegraded":"2024-09-17T05:51:16.750344+0000","last_fullsized":"2024-09-17T05:51:16.750344+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:51:13.315624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:51:13.315624+0000","last_clean_scrub_stamp":"2024-09-17T05:51:13.315624+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:16:54.432517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.1c","version":"0'0","reported_seq":13,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-17T05:51:16.751166+0000","last_change":"2024-09-17T05:51:15.349713+0000","last_active":"2024-09-17T05:51:16.751166+0000","last_peered":"2024-09-17T05:51:16.751166+0000","last_clean":"2024-09-17T05:51:16.751166+0000","last_became_active":"2024-09-17T05:51:15.347772+0000","last_became_peered":"2024-09-17T05:51:15.347772+0000","last_unstale":"2024-09-17T05:51:16.751166+0000","last_undegraded":"2024-09-17T05:51:16.751166+0000","last_fullsized":"2024-09-17T05:51:16.751166+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:51:14.325451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:51:14.325451+0000","last_clean_scrub_stamp":"2024-09-17T05:51:14.325451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:23:35.566877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.1d","version":"112'2","reported_seq":17,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-17T05:51:16.339750+0000","last_change":"2024-09-17T05:51:14.353746+0000","last_active":"2024-09-17T05:51:16.339750+0000","last_peered":"2024-09-17T05:51:16.339750+0000","last_clean":"2024-09-17T05:51:16.339750+0000","last_became_active":"2024-09-17T05:51:14.353437+0000","last_became_peered":"2024-09-17T05:51:14.353437+0000","last_unstale":"2024-09-17T05:51:16.339750+0000","last_undegraded":"2024-09-17T05:51:16.339750+0000","last_fullsized":"2024-09-17T05:51:16.339750+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:51:13.315624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:51:13.315624+0000","last_clean_scrub_stamp":"2024-09-17T05:51:13.315624+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:05:50.149362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.1d","version":"0'0","reported_seq":13,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-17T05:51:16.750902+0000","last_change":"2024-09-17T05:51:15.359061+0000","last_active":"2024-09-17T05:51:16.750902+0000","last_peered":"2024-09-17T05:51:16.750902+0000","last_clean":"2024-09-17T05:51:16.750902+0000","last_became_active":"2024-09-17T05:51:15.358754+0000","last_became_peered":"2024-09-17T05:51:15.358754+0000","last_unstale":"2024-09-17T05:51:16.750902+0000","last_undegraded":"2024-09-17T05:51:16.750902+0000","last_fullsized":"2024-09-17T05:51:16.750902+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:51:14.325451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:51:14.325451+0000","last_clean_scrub_stamp":"2024-09-17T05:51:14.325451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:43:11.980324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.1c","version":"112'2","reported_seq":17,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-17T05:51:16.339897+0000","last_change":"2024-09-17T05:51:14.349011+0000","last_active":"2024-09-17T05:51:16.339897+0000","last_peered":"2024-09-17T05:51:16.339897+0000","last_clean":"2024-09-17T05:51:16.339897+0000","last_became_active":"2024-09-17T05:51:14.348713+0000","last_became_peered":"2024-09-17T05:51:14.348713+0000","last_unstale":"2024-09-17T05:51:16.339897+0000","last_undegraded":"2024-09-17T05:51:16.339897+0000","last_fullsized":"2024-09-17T05:51:16.339897+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:51:13.315624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:51:13.315624+0000","last_clean_scrub_stamp":"2024-09-17T05:51:13.315624+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:57:40.589853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:51:14.325451+0000","last_change":"2024-09-17T05:51:14.325451+0000","last_active":"2024-09-17T05:51:14.325451+0000","last_peered":"2024-09-17T05:51:14.325451+0000","last_clean":"2024-09-17T05:51:14.325451+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:51:14.325451+0000","last_undegraded":"2024-09-17T05:51:14.325451+0000","last_fullsized":"2024-09-17T05:51:14.325451+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:51:14.325451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:51:14.325451+0000","last_clean_scrub_stamp":"2024-09-17T05:51:14.325451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.1b","version":"112'1","reported_seq":16,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-17T05:51:16.359714+0000","last_change":"2024-09-17T05:51:14.354735+0000","last_active":"2024-09-17T05:51:16.359714+0000","last_peered":"2024-09-17T05:51:16.359714+0000","last_clean":"2024-09-17T05:51:16.359714+0000","last_became_active":"2024-09-17T05:51:14.354173+0000","last_became_peered":"2024-09-17T05:51:14.354173+0000","last_unstale":"2024-09-17T05:51:16.359714+0000","last_undegraded":"2024-09-17T05:51:16.359714+0000","last_fullsized":"2024-09-17T05:51:16.359714+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:51:13.315624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:51:13.315624+0000","last_clean_scrub_stamp":"2024-09-17T05:51:13.315624+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:55:41.195206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.1b","version":"0'0","reported_seq":13,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-17T05:51:16.340908+0000","last_change":"2024-09-17T05:51:15.344677+0000","last_active":"2024-09-17T05:51:16.340908+0000","last_peered":"2024-09-17T05:51:16.340908+0000","last_clean":"2024-09-17T05:51:16.340908+0000","last_became_active":"2024-09-17T05:51:15.344361+0000","last_became_peered":"2024-09-17T05:51:15.344361+0000","last_unstale":"2024-09-17T05:51:16.340908+0000","last_undegraded":"2024-09-17T05:51:16.340908+0000","last_fullsized":"2024-09-17T05:51:16.340908+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:51:14.325451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:51:14.325451+0000","last_clean_scrub_stamp":"2024-09-17T05:51:14.325451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:21:22.687943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.1a","version":"112'1","reported_seq":16,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-17T05:51:16.341177+0000","last_change":"2024-09-17T05:51:14.353138+0000","last_active":"2024-09-17T05:51:16.341177+0000","last_peered":"2024-09-17T05:51:16.341177+0000","last_clean":"2024-09-17T05:51:16.341177+0000","last_became_active":"2024-09-17T05:51:14.352671+0000","last_became_peered":"2024-09-17T05:51:14.352671+0000","last_unstale":"2024-09-17T05:51:16.341177+0000","last_undegraded":"2024-09-17T05:51:16.341177+0000","last_fullsized":"2024-09-17T05:51:16.341177+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:51:13.315624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:51:13.315624+0000","last_clean_scrub_stamp":"2024-09-17T05:51:13.315624+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:05:44.644453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:51:14.325451+0000","last_change":"2024-09-17T05:51:14.325451+0000","last_active":"2024-09-17T05:51:14.325451+0000","last_peered":"2024-09-17T05:51:14.325451+0000","last_clean":"2024-09-17T05:51:14.325451+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:51:14.325451+0000","last_undegraded":"2024-09-17T05:51:14.325451+0000","last_fullsized":"2024-09-17T05:51:14.325451+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:51:14.325451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:51:14.325451+0000","last_clean_scrub_stamp":"2024-09-17T05:51:14.325451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.19","version":"0'0","reported_seq":15,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-17T05:51:16.340804+0000","last_change":"2024-09-17T05:51:14.356410+0000","last_active":"2024-09-17T05:51:16.340804+0000","last_peered":"2024-09-17T05:51:16.340804+0000","last_clean":"2024-09-17T05:51:16.340804+0000","last_became_active":"2024-09-17T05:51:14.356114+0000","last_became_peered":"2024-09-17T05:51:14.356114+0000","last_unstale":"2024-09-17T05:51:16.340804+0000","last_undegraded":"2024-09-17T05:51:16.340804+0000","last_fullsized":"2024-09-17T05:51:16.340804+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:51:13.315624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:51:13.315624+0000","last_clean_scrub_stamp":"2024-09-17T05:51:13.315624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:27:31.390355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.19","version":"0'0","reported_seq":13,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-17T05:51:16.359869+0000","last_change":"2024-09-17T05:51:15.358103+0000","last_active":"2024-09-17T05:51:16.359869+0000","last_peered":"2024-09-17T05:51:16.359869+0000","last_clean":"2024-09-17T05:51:16.359869+0000","last_became_active":"2024-09-17T05:51:15.357513+0000","last_became_peered":"2024-09-17T05:51:15.357513+0000","last_unstale":"2024-09-17T05:51:16.359869+0000","last_undegraded":"2024-09-17T05:51:16.359869+0000","last_fullsized":"2024-09-17T05:51:16.359869+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:51:14.325451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:51:14.325451+0000","last_clean_scrub_stamp":"2024-09-17T05:51:14.325451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:51:39.791185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.18","version":"0'0","reported_seq":1,"reported_epoch":110,"state":"creating+peering","last_fresh":"2024-09-17T05:51:13.333713+0000","last_change":"2024-09-17T05:51:13.333713+0000","last_active":"2024-09-17T05:51:13.315624+0000","last_peered":"2024-09-17T05:51:13.315624+0000","last_clean":"2024-09-17T05:51:13.315624+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:51:13.333713+0000","last_undegraded":"2024-09-17T05:51:13.333713+0000","last_fullsized":"2024-09-17T05:51:13.333713+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:51:13.315624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:51:13.315624+0000","last_clean_scrub_stamp":"2024-09-17T05:51:13.315624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.16","version":"0'0","reported_seq":13,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-17T05:51:16.360215+0000","last_change":"2024-09-17T05:51:15.357705+0000","last_active":"2024-09-17T05:51:16.360215+0000","last_peered":"2024-09-17T05:51:16.360215+0000","last_clean":"2024-09-17T05:51:16.360215+0000","last_became_active":"2024-09-17T05:51:15.357029+0000","last_became_peered":"2024-09-17T05:51:15.357029+0000","last_unstale":"2024-09-17T05:51:16.360215+0000","last_undegraded":"2024-09-17T05:51:16.360215+0000","last_fullsized":"2024-09-17T05:51:16.360215+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:51:14.325451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:51:14.325451+0000","last_clean_scrub_stamp":"2024-09-17T05:51:14.325451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:29:03.820460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.17","version":"0'0","reported_seq":15,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-17T05:51:16.339454+0000","last_change":"2024-09-17T05:51:14.353904+0000","last_active":"2024-09-17T05:51:16.339454+0000","last_peered":"2024-09-17T05:51:16.339454+0000","last_clean":"2024-09-17T05:51:16.339454+0000","last_became_active":"2024-09-17T05:51:14.353591+0000","last_became_peered":"2024-09-17T05:51:14.353591+0000","last_unstale":"2024-09-17T05:51:16.339454+0000","last_undegraded":"2024-09-17T05:51:16.339454+0000","last_fullsized":"2024-09-17T05:51:16.339454+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:51:13.315624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:51:13.315624+0000","last_clean_scrub_stamp":"2024-09-17T05:51:13.315624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:13:44.186310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.17","version":"0'0","reported_seq":13,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-17T05:51:16.357574+0000","last_change":"2024-09-17T05:51:15.361884+0000","last_active":"2024-09-17T05:51:16.357574+0000","last_peered":"2024-09-17T05:51:16.357574+0000","last_clean":"2024-09-17T05:51:16.357574+0000","last_became_active":"2024-09-17T05:51:15.361562+0000","last_became_peered":"2024-09-17T05:51:15.361562+0000","last_unstale":"2024-09-17T05:51:16.357574+0000","last_undegraded":"2024-09-17T05:51:16.357574+0000","last_fullsized":"2024-09-17T05:51:16.357574+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:51:14.325451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:51:14.325451+0000","last_clean_scrub_stamp":"2024-09-17T05:51:14.325451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:46:55.155567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.16","version":"0'0","reported_seq":15,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-17T05:51:16.340693+0000","last_change":"2024-09-17T05:51:14.351671+0000","last_active":"2024-09-17T05:51:16.340693+0000","last_peered":"2024-09-17T05:51:16.340693+0000","last_clean":"2024-09-17T05:51:16.340693+0000","last_became_active":"2024-09-17T05:51:14.351378+0000","last_became_peered":"2024-09-17T05:51:14.351378+0000","last_unstale":"2024-09-17T05:51:16.340693+0000","last_undegraded":"2024-09-17T05:51:16.340693+0000","last_fullsized":"2024-09-17T05:51:16.340693+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:51:13.315624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:51:13.315624+0000","last_clean_scrub_stamp":"2024-09-17T05:51:13.315624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:13:21.431979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.14","version":"0'0","reported_seq":13,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-17T05:51:16.341035+0000","last_change":"2024-09-17T05:51:15.348925+0000","last_active":"2024-09-17T05:51:16.341035+0000","last_peered":"2024-09-17T05:51:16.341035+0000","last_clean":"2024-09-17T05:51:16.341035+0000","last_became_active":"2024-09-17T05:51:15.348098+0000","last_became_peered":"2024-09-17T05:51:15.348098+0000","last_unstale":"2024-09-17T05:51:16.341035+0000","last_undegraded":"2024-09-17T05:51:16.341035+0000","last_fullsized":"2024-09-17T05:51:16.341035+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:51:14.325451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:51:14.325451+0000","last_clean_scrub_stamp":"2024-09-17T05:51:14.325451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:45:04.503729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.15","version":"0'0","reported_seq":1,"reported_epoch":110,"state":"creating+peering","last_fresh":"2024-09-17T05:51:13.333287+0000","last_change":"2024-09-17T05:51:13.333287+0000","last_active":"2024-09-17T05:51:13.315624+0000","last_peered":"2024-09-17T05:51:13.315624+0000","last_clean":"2024-09-17T05:51:13.315624+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:51:13.333287+0000","last_undegraded":"2024-09-17T05:51:13.333287+0000","last_fullsized":"2024-09-17T05:51:13.333287+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:51:13.315624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:51:13.315624+0000","last_clean_scrub_stamp":"2024-09-17T05:51:13.315624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.15","version":"0'0","reported_seq":13,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-17T05:51:16.359997+0000","last_change":"2024-09-17T05:51:15.354430+0000","last_active":"2024-09-17T05:51:16.359997+0000","last_peered":"2024-09-17T05:51:16.359997+0000","last_clean":"2024-09-17T05:51:16.359997+0000","last_became_active":"2024-09-17T05:51:15.353340+0000","last_became_peered":"2024-09-17T05:51:15.353340+0000","last_unstale":"2024-09-17T05:51:16.359997+0000","last_undegraded":"2024-09-17T05:51:16.359997+0000","last_fullsized":"2024-09-17T05:51:16.359997+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:51:14.325451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:51:14.325451+0000","last_clean_scrub_stamp":"2024-09-17T05:51:14.325451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:06:33.197462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.14","version":"0'0","reported_seq":1,"reported_epoch":110,"state":"creating+peering","last_fresh":"2024-09-17T05:51:13.332882+0000","last_change":"2024-09-17T05:51:13.332882+0000","last_active":"2024-09-17T05:51:13.315624+0000","last_peered":"2024-09-17T05:51:13.315624+0000","last_clean":"2024-09-17T05:51:13.315624+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:51:13.332882+0000","last_undegraded":"2024-09-17T05:51:13.332882+0000","last_fullsized":"2024-09-17T05:51:13.332882+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:51:13.315624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:51:13.315624+0000","last_clean_scrub_stamp":"2024-09-17T05:51:13.315624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.12","version":"0'0","reported_seq":13,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-17T05:51:16.341056+0000","last_change":"2024-09-17T05:51:15.343838+0000","last_active":"2024-09-17T05:51:16.341056+0000","last_peered":"2024-09-17T05:51:16.341056+0000","last_clean":"2024-09-17T05:51:16.341056+0000","last_became_active":"2024-09-17T05:51:15.342425+0000","last_became_peered":"2024-09-17T05:51:15.342425+0000","last_unstale":"2024-09-17T05:51:16.341056+0000","last_undegraded":"2024-09-17T05:51:16.341056+0000","last_fullsized":"2024-09-17T05:51:16.341056+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:51:14.325451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:51:14.325451+0000","last_clean_scrub_stamp":"2024-09-17T05:51:14.325451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:38:28.098850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.13","version":"112'2","reported_seq":17,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-17T05:51:16.750889+0000","last_change":"2024-09-17T05:51:14.351875+0000","last_active":"2024-09-17T05:51:16.750889+0000","last_peered":"2024-09-17T05:51:16.750889+0000","last_clean":"2024-09-17T05:51:16.750889+0000","last_became_active":"2024-09-17T05:51:14.351584+0000","last_became_peered":"2024-09-17T05:51:14.351584+0000","last_unstale":"2024-09-17T05:51:16.750889+0000","last_undegraded":"2024-09-17T05:51:16.750889+0000","last_fullsized":"2024-09-17T05:51:16.750889+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:51:13.315624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:51:13.315624+0000","last_clean_scrub_stamp":"2024-09-17T05:51:13.315624+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:32:52.271894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.13","version":"0'0","reported_seq":13,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-17T05:51:16.340808+0000","last_change":"2024-09-17T05:51:15.352070+0000","last_active":"2024-09-17T05:51:16.340808+0000","last_peered":"2024-09-17T05:51:16.340808+0000","last_clean":"2024-09-17T05:51:16.340808+0000","last_became_active":"2024-09-17T05:51:15.351799+0000","last_became_peered":"2024-09-17T05:51:15.351799+0000","last_unstale":"2024-09-17T05:51:16.340808+0000","last_undegraded":"2024-09-17T05:51:16.340808+0000","last_fullsized":"2024-09-17T05:51:16.340808+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:51:14.325451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:51:14.325451+0000","last_clean_scrub_stamp":"2024-09-17T05:51:14.325451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:10:29.943649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.12","version":"0'0","reported_seq":15,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-17T05:51:16.357130+0000","last_change":"2024-09-17T05:51:14.358185+0000","last_active":"2024-09-17T05:51:16.357130+0000","last_peered":"2024-09-17T05:51:16.357130+0000","last_clean":"2024-09-17T05:51:16.357130+0000","last_became_active":"2024-09-17T05:51:14.357918+0000","last_became_peered":"2024-09-17T05:51:14.357918+0000","last_unstale":"2024-09-17T05:51:16.357130+0000","last_undegraded":"2024-09-17T05:51:16.357130+0000","last_fullsized":"2024-09-17T05:51:16.357130+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:51:13.315624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:51:13.315624+0000","last_clean_scrub_stamp":"2024-09-17T05:51:13.315624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:03:42.718274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.11","version":"0'0","reported_seq":13,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-17T05:51:16.340680+0000","last_change":"2024-09-17T05:51:15.344783+0000","last_active":"2024-09-17T05:51:16.340680+0000","last_peered":"2024-09-17T05:51:16.340680+0000","last_clean":"2024-09-17T05:51:16.340680+0000","last_became_active":"2024-09-17T05:51:15.344469+0000","last_became_peered":"2024-09-17T05:51:15.344469+0000","last_unstale":"2024-09-17T05:51:16.340680+0000","last_undegraded":"2024-09-17T05:51:16.340680+0000","last_fullsized":"2024-09-17T05:51:16.340680+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:51:14.325451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:51:14.325451+0000","last_clean_scrub_stamp":"2024-09-17T05:51:14.325451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:26:02.895405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.10","version":"112'8","reported_seq":23,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-17T05:51:16.339322+0000","last_change":"2024-09-17T05:51:14.358522+0000","last_active":"2024-09-17T05:51:16.339322+0000","last_peered":"2024-09-17T05:51:16.339322+0000","last_clean":"2024-09-17T05:51:16.339322+0000","last_became_active":"2024-09-17T05:51:14.358110+0000","last_became_peered":"2024-09-17T05:51:14.358110+0000","last_unstale":"2024-09-17T05:51:16.339322+0000","last_undegraded":"2024-09-17T05:51:16.339322+0000","last_fullsized":"2024-09-17T05:51:16.339322+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:51:13.315624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:51:13.315624+0000","last_clean_scrub_stamp":"2024-09-17T05:51:13.315624+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:16:44.660311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.e","version":"0'0","reported_seq":13,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-17T05:51:16.340190+0000","last_change":"2024-09-17T05:51:15.368761+0000","last_active":"2024-09-17T05:51:16.340190+0000","last_peered":"2024-09-17T05:51:16.340190+0000","last_clean":"2024-09-17T05:51:16.340190+0000","last_became_active":"2024-09-17T05:51:15.368438+0000","last_became_peered":"2024-09-17T05:51:15.368438+0000","last_unstale":"2024-09-17T05:51:16.340190+0000","last_undegraded":"2024-09-17T05:51:16.340190+0000","last_fullsized":"2024-09-17T05:51:16.340190+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:51:14.325451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:51:14.325451+0000","last_clean_scrub_stamp":"2024-09-17T05:51:14.325451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:55:42.205033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.f","version":"0'0","reported_seq":1,"reported_epoch":110,"state":"creating+peering","last_fresh":"2024-09-17T05:51:13.332721+0000","last_change":"2024-09-17T05:51:13.332721+0000","last_active":"2024-09-17T05:51:13.315624+0000","last_peered":"2024-09-17T05:51:13.315624+0000","last_clean":"2024-09-17T05:51:13.315624+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:51:13.332721+0000","last_undegraded":"2024-09-17T05:51:13.332721+0000","last_fullsized":"2024-09-17T05:51:13.332721+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:51:13.315624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:51:13.315624+0000","last_clean_scrub_stamp":"2024-09-17T05:51:13.315624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.f","version":"0'0","reported_seq":13,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-17T05:51:16.751118+0000","last_change":"2024-09-17T05:51:15.363658+0000","last_active":"2024-09-17T05:51:16.751118+0000","last_peered":"2024-09-17T05:51:16.751118+0000","last_clean":"2024-09-17T05:51:16.751118+0000","last_became_active":"2024-09-17T05:51:15.363025+0000","last_became_peered":"2024-09-17T05:51:15.363025+0000","last_unstale":"2024-09-17T05:51:16.751118+0000","last_undegraded":"2024-09-17T05:51:16.751118+0000","last_fullsized":"2024-09-17T05:51:16.751118+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:51:14.325451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:51:14.325451+0000","last_clean_scrub_stamp":"2024-09-17T05:51:14.325451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:44:29.490228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.e","version":"112'2","reported_seq":17,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-17T05:51:16.340090+0000","last_change":"2024-09-17T05:51:14.350142+0000","last_active":"2024-09-17T05:51:16.340090+0000","last_peered":"2024-09-17T05:51:16.340090+0000","last_clean":"2024-09-17T05:51:16.340090+0000","last_became_active":"2024-09-17T05:51:14.349835+0000","last_became_peered":"2024-09-17T05:51:14.349835+0000","last_unstale":"2024-09-17T05:51:16.340090+0000","last_undegraded":"2024-09-17T05:51:16.340090+0000","last_fullsized":"2024-09-17T05:51:16.340090+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:51:13.315624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:51:13.315624+0000","last_clean_scrub_stamp":"2024-09-17T05:51:13.315624+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:18:05.652933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.c","version":"0'0","reported_seq":13,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-17T05:51:16.750603+0000","last_change":"2024-09-17T05:51:15.374005+0000","last_active":"2024-09-17T05:51:16.750603+0000","last_peered":"2024-09-17T05:51:16.750603+0000","last_clean":"2024-09-17T05:51:16.750603+0000","last_became_active":"2024-09-17T05:51:15.373697+0000","last_became_peered":"2024-09-17T05:51:15.373697+0000","last_unstale":"2024-09-17T05:51:16.750603+0000","last_undegraded":"2024-09-17T05:51:16.750603+0000","last_fullsized":"2024-09-17T05:51:16.750603+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:51:14.325451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:51:14.325451+0000","last_clean_scrub_stamp":"2024-09-17T05:51:14.325451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:52:25.457579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.d","version":"112'1","reported_seq":16,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-17T05:51:16.357350+0000","last_change":"2024-09-17T05:51:14.356064+0000","last_active":"2024-09-17T05:51:16.357350+0000","last_peered":"2024-09-17T05:51:16.357350+0000","last_clean":"2024-09-17T05:51:16.357350+0000","last_became_active":"2024-09-17T05:51:14.355680+0000","last_became_peered":"2024-09-17T05:51:14.355680+0000","last_unstale":"2024-09-17T05:51:16.357350+0000","last_undegraded":"2024-09-17T05:51:16.357350+0000","last_fullsized":"2024-09-17T05:51:16.357350+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:51:13.315624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:51:13.315624+0000","last_clean_scrub_stamp":"2024-09-17T05:51:13.315624+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:37:25.718715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.d","version":"0'0","reported_seq":13,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-17T05:51:16.750927+0000","last_change":"2024-09-17T05:51:15.360993+0000","last_active":"2024-09-17T05:51:16.750927+0000","last_peered":"2024-09-17T05:51:16.750927+0000","last_clean":"2024-09-17T05:51:16.750927+0000","last_became_active":"2024-09-17T05:51:15.360005+0000","last_became_peered":"2024-09-17T05:51:15.360005+0000","last_unstale":"2024-09-17T05:51:16.750927+0000","last_undegraded":"2024-09-17T05:51:16.750927+0000","last_fullsized":"2024-09-17T05:51:16.750927+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:51:14.325451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:51:14.325451+0000","last_clean_scrub_stamp":"2024-09-17T05:51:14.325451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:15:42.659548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.c","version":"0'0","reported_seq":15,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-17T05:51:16.359734+0000","last_change":"2024-09-17T05:51:14.356802+0000","last_active":"2024-09-17T05:51:16.359734+0000","last_peered":"2024-09-17T05:51:16.359734+0000","last_clean":"2024-09-17T05:51:16.359734+0000","last_became_active":"2024-09-17T05:51:14.356443+0000","last_became_peered":"2024-09-17T05:51:14.356443+0000","last_unstale":"2024-09-17T05:51:16.359734+0000","last_undegraded":"2024-09-17T05:51:16.359734+0000","last_fullsized":"2024-09-17T05:51:16.359734+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:51:13.315624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:51:13.315624+0000","last_clean_scrub_stamp":"2024-09-17T05:51:13.315624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:26:33.048310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.a","version":"0'0","reported_seq":13,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-17T05:51:16.750331+0000","last_change":"2024-09-17T05:51:15.354900+0000","last_active":"2024-09-17T05:51:16.750331+0000","last_peered":"2024-09-17T05:51:16.750331+0000","last_clean":"2024-09-17T05:51:16.750331+0000","last_became_active":"2024-09-17T05:51:15.354432+0000","last_became_peered":"2024-09-17T05:51:15.354432+0000","last_unstale":"2024-09-17T05:51:16.750331+0000","last_undegraded":"2024-09-17T05:51:16.750331+0000","last_fullsized":"2024-09-17T05:51:16.750331+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:51:14.325451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:51:14.325451+0000","last_clean_scrub_stamp":"2024-09-17T05:51:14.325451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:02:42.943141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.b","version":"112'2","reported_seq":17,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-17T05:51:16.751008+0000","last_change":"2024-09-17T05:51:14.351844+0000","last_active":"2024-09-17T05:51:16.751008+0000","last_peered":"2024-09-17T05:51:16.751008+0000","last_clean":"2024-09-17T05:51:16.751008+0000","last_became_active":"2024-09-17T05:51:14.351191+0000","last_became_peered":"2024-09-17T05:51:14.351191+0000","last_unstale":"2024-09-17T05:51:16.751008+0000","last_undegraded":"2024-09-17T05:51:16.751008+0000","last_fullsized":"2024-09-17T05:51:16.751008+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:51:13.315624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:51:13.315624+0000","last_clean_scrub_stamp":"2024-09-17T05:51:13.315624+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:21:47.493336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:51:14.325451+0000","last_change":"2024-09-17T05:51:14.325451+0000","last_active":"2024-09-17T05:51:14.325451+0000","last_peered":"2024-09-17T05:51:14.325451+0000","last_clean":"2024-09-17T05:51:14.325451+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:51:14.325451+0000","last_undegraded":"2024-09-17T05:51:14.325451+0000","last_fullsized":"2024-09-17T05:51:14.325451+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:51:14.325451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:51:14.325451+0000","last_clean_scrub_stamp":"2024-09-17T05:51:14.325451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.a","version":"0'0","reported_seq":15,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-17T05:51:16.339399+0000","last_change":"2024-09-17T05:51:14.355042+0000","last_active":"2024-09-17T05:51:16.339399+0000","last_peered":"2024-09-17T05:51:16.339399+0000","last_clean":"2024-09-17T05:51:16.339399+0000","last_became_active":"2024-09-17T05:51:14.354728+0000","last_became_peered":"2024-09-17T05:51:14.354728+0000","last_unstale":"2024-09-17T05:51:16.339399+0000","last_undegraded":"2024-09-17T05:51:16.339399+0000","last_fullsized":"2024-09-17T05:51:16.339399+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:51:13.315624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:51:13.315624+0000","last_clean_scrub_stamp":"2024-09-17T05:51:13.315624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:03:36.768537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.8","version":"0'0","reported_seq":13,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-17T05:51:16.750402+0000","last_change":"2024-09-17T05:51:15.357234+0000","last_active":"2024-09-17T05:51:16.750402+0000","last_peered":"2024-09-17T05:51:16.750402+0000","last_clean":"2024-09-17T05:51:16.750402+0000","last_became_active":"2024-09-17T05:51:15.356159+0000","last_became_peered":"2024-09-17T05:51:15.356159+0000","last_unstale":"2024-09-17T05:51:16.750402+0000","last_undegraded":"2024-09-17T05:51:16.750402+0000","last_fullsized":"2024-09-17T05:51:16.750402+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:51:14.325451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:51:14.325451+0000","last_clean_scrub_stamp":"2024-09-17T05:51:14.325451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:12:11.367770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.9","version":"0'0","reported_seq":15,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-17T05:51:16.750271+0000","last_change":"2024-09-17T05:51:14.348936+0000","last_active":"2024-09-17T05:51:16.750271+0000","last_peered":"2024-09-17T05:51:16.750271+0000","last_clean":"2024-09-17T05:51:16.750271+0000","last_became_active":"2024-09-17T05:51:14.348618+0000","last_became_peered":"2024-09-17T05:51:14.348618+0000","last_unstale":"2024-09-17T05:51:16.750271+0000","last_undegraded":"2024-09-17T05:51:16.750271+0000","last_fullsized":"2024-09-17T05:51:16.750271+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:51:13.315624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:51:13.315624+0000","last_clean_scrub_stamp":"2024-09-17T05:51:13.315624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:03:36.561055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.9","version":"0'0","reported_seq":13,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-17T05:51:16.340732+0000","last_change":"2024-09-17T05:51:15.359252+0000","last_active":"2024-09-17T05:51:16.340732+0000","last_peered":"2024-09-17T05:51:16.340732+0000","last_clean":"2024-09-17T05:51:16.340732+0000","last_became_active":"2024-09-17T05:51:15.358940+0000","last_became_peered":"2024-09-17T05:51:15.358940+0000","last_unstale":"2024-09-17T05:51:16.340732+0000","last_undegraded":"2024-09-17T05:51:16.340732+0000","last_fullsized":"2024-09-17T05:51:16.340732+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:51:14.325451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:51:14.325451+0000","last_clean_scrub_stamp":"2024-09-17T05:51:14.325451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:12:03.752583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.8","version":"0'0","reported_seq":1,"reported_epoch":110,"state":"creating+peering","last_fresh":"2024-09-17T05:51:13.333212+0000","last_change":"2024-09-17T05:51:13.333212+0000","last_active":"2024-09-17T05:51:13.315624+0000","last_peered":"2024-09-17T05:51:13.315624+0000","last_clean":"2024-09-17T05:51:13.315624+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:51:13.333212+0000","last_undegraded":"2024-09-17T05:51:13.333212+0000","last_fullsized":"2024-09-17T05:51:13.333212+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:51:13.315624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:51:13.315624+0000","last_clean_scrub_stamp":"2024-09-17T05:51:13.315624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.6","version":"0'0","reported_seq":13,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-17T05:51:16.357443+0000","last_change":"2024-09-17T05:51:15.365607+0000","last_active":"2024-09-17T05:51:16.357443+0000","last_peered":"2024-09-17T05:51:16.357443+0000","last_clean":"2024-09-17T05:51:16.357443+0000","last_became_active":"2024-09-17T05:51:15.365266+0000","last_became_peered":"2024-09-17T05:51:15.365266+0000","last_unstale":"2024-09-17T05:51:16.357443+0000","last_undegraded":"2024-09-17T05:51:16.357443+0000","last_fullsized":"2024-09-17T05:51:16.357443+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:51:14.325451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:51:14.325451+0000","last_clean_scrub_stamp":"2024-09-17T05:51:14.325451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:49:28.476795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.7","version":"112'2","reported_seq":17,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-17T05:51:16.340820+0000","last_change":"2024-09-17T05:51:14.358131+0000","last_active":"2024-09-17T05:51:16.340820+0000","last_peered":"2024-09-17T05:51:16.340820+0000","last_clean":"2024-09-17T05:51:16.340820+0000","last_became_active":"2024-09-17T05:51:14.357812+0000","last_became_peered":"2024-09-17T05:51:14.357812+0000","last_unstale":"2024-09-17T05:51:16.340820+0000","last_undegraded":"2024-09-17T05:51:16.340820+0000","last_fullsized":"2024-09-17T05:51:16.340820+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:51:13.315624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:51:13.315624+0000","last_clean_scrub_stamp":"2024-09-17T05:51:13.315624+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:00:46.227529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:51:14.325451+0000","last_change":"2024-09-17T05:51:14.325451+0000","last_active":"2024-09-17T05:51:14.325451+0000","last_peered":"2024-09-17T05:51:14.325451+0000","last_clean":"2024-09-17T05:51:14.325451+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:51:14.325451+0000","last_undegraded":"2024-09-17T05:51:14.325451+0000","last_fullsized":"2024-09-17T05:51:14.325451+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:51:14.325451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:51:14.325451+0000","last_clean_scrub_stamp":"2024-09-17T05:51:14.325451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.6","version":"113'1","reported_seq":16,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-17T05:51:16.357547+0000","last_change":"2024-09-17T05:51:14.353668+0000","last_active":"2024-09-17T05:51:16.357547+0000","last_peered":"2024-09-17T05:51:16.357547+0000","last_clean":"2024-09-17T05:51:16.357547+0000","last_became_active":"2024-09-17T05:51:14.353344+0000","last_became_peered":"2024-09-17T05:51:14.353344+0000","last_unstale":"2024-09-17T05:51:16.357547+0000","last_undegraded":"2024-09-17T05:51:16.357547+0000","last_fullsized":"2024-09-17T05:51:16.357547+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:51:13.315624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:51:13.315624+0000","last_clean_scrub_stamp":"2024-09-17T05:51:13.315624+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:56:25.324024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:51:14.325451+0000","last_change":"2024-09-17T05:51:14.325451+0000","last_active":"2024-09-17T05:51:14.325451+0000","last_peered":"2024-09-17T05:51:14.325451+0000","last_clean":"2024-09-17T05:51:14.325451+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:51:14.325451+0000","last_undegraded":"2024-09-17T05:51:14.325451+0000","last_fullsized":"2024-09-17T05:51:14.325451+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:51:14.325451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:51:14.325451+0000","last_clean_scrub_stamp":"2024-09-17T05:51:14.325451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.5","version":"0'0","reported_seq":1,"reported_epoch":110,"state":"creating+peering","last_fresh":"2024-09-17T05:51:13.332782+0000","last_change":"2024-09-17T05:51:13.332782+0000","last_active":"2024-09-17T05:51:13.315624+0000","last_peered":"2024-09-17T05:51:13.315624+0000","last_clean":"2024-09-17T05:51:13.315624+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:51:13.332782+0000","last_undegraded":"2024-09-17T05:51:13.332782+0000","last_fullsized":"2024-09-17T05:51:13.332782+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:51:13.315624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:51:13.315624+0000","last_clean_scrub_stamp":"2024-09-17T05:51:13.315624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.5","version":"0'0","reported_seq":13,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-17T05:51:16.357324+0000","last_change":"2024-09-17T05:51:15.363844+0000","last_active":"2024-09-17T05:51:16.357324+0000","last_peered":"2024-09-17T05:51:16.357324+0000","last_clean":"2024-09-17T05:51:16.357324+0000","last_became_active":"2024-09-17T05:51:15.363465+0000","last_became_peered":"2024-09-17T05:51:15.363465+0000","last_unstale":"2024-09-17T05:51:16.357324+0000","last_undegraded":"2024-09-17T05:51:16.357324+0000","last_fullsized":"2024-09-17T05:51:16.357324+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:51:14.325451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:51:14.325451+0000","last_clean_scrub_stamp":"2024-09-17T05:51:14.325451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:17:42.550657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.4","version":"0'0","reported_seq":15,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-17T05:51:16.341090+0000","last_change":"2024-09-17T05:51:14.350349+0000","last_active":"2024-09-17T05:51:16.341090+0000","last_peered":"2024-09-17T05:51:16.341090+0000","last_clean":"2024-09-17T05:51:16.341090+0000","last_became_active":"2024-09-17T05:51:14.350017+0000","last_became_peered":"2024-09-17T05:51:14.350017+0000","last_unstale":"2024-09-17T05:51:16.341090+0000","last_undegraded":"2024-09-17T05:51:16.341090+0000","last_fullsized":"2024-09-17T05:51:16.341090+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:51:13.315624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:51:13.315624+0000","last_clean_scrub_stamp":"2024-09-17T05:51:13.315624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:31:26.485537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.2","version":"0'0","reported_seq":13,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-17T05:51:16.340588+0000","last_change":"2024-09-17T05:51:15.345136+0000","last_active":"2024-09-17T05:51:16.340588+0000","last_peered":"2024-09-17T05:51:16.340588+0000","last_clean":"2024-09-17T05:51:16.340588+0000","last_became_active":"2024-09-17T05:51:15.344810+0000","last_became_peered":"2024-09-17T05:51:15.344810+0000","last_unstale":"2024-09-17T05:51:16.340588+0000","last_undegraded":"2024-09-17T05:51:16.340588+0000","last_fullsized":"2024-09-17T05:51:16.340588+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:51:14.325451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:51:14.325451+0000","last_clean_scrub_stamp":"2024-09-17T05:51:14.325451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:46:58.628756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.3","version":"0'0","reported_seq":15,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-17T05:51:16.359885+0000","last_change":"2024-09-17T05:51:14.352438+0000","last_active":"2024-09-17T05:51:16.359885+0000","last_peered":"2024-09-17T05:51:16.359885+0000","last_clean":"2024-09-17T05:51:16.359885+0000","last_became_active":"2024-09-17T05:51:14.352097+0000","last_became_peered":"2024-09-17T05:51:14.352097+0000","last_unstale":"2024-09-17T05:51:16.359885+0000","last_undegraded":"2024-09-17T05:51:16.359885+0000","last_fullsized":"2024-09-17T05:51:16.359885+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:51:13.315624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:51:13.315624+0000","last_clean_scrub_stamp":"2024-09-17T05:51:13.315624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:42:26.091891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.3","version":"0'0","reported_seq":13,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-17T05:51:16.340998+0000","last_change":"2024-09-17T05:51:15.359800+0000","last_active":"2024-09-17T05:51:16.340998+0000","last_peered":"2024-09-17T05:51:16.340998+0000","last_clean":"2024-09-17T05:51:16.340998+0000","last_became_active":"2024-09-17T05:51:15.357898+0000","last_became_peered":"2024-09-17T05:51:15.357898+0000","last_unstale":"2024-09-17T05:51:16.340998+0000","last_undegraded":"2024-09-17T05:51:16.340998+0000","last_fullsized":"2024-09-17T05:51:16.340998+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:51:14.325451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:51:14.325451+0000","last_clean_scrub_stamp":"2024-09-17T05:51:14.325451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:44:07.877112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.2","version":"0'0","reported_seq":15,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-17T05:51:16.340331+0000","last_change":"2024-09-17T05:51:14.355271+0000","last_active":"2024-09-17T05:51:16.340331+0000","last_peered":"2024-09-17T05:51:16.340331+0000","last_clean":"2024-09-17T05:51:16.340331+0000","last_became_active":"2024-09-17T05:51:14.354782+0000","last_became_peered":"2024-09-17T05:51:14.354782+0000","last_unstale":"2024-09-17T05:51:16.340331+0000","last_undegraded":"2024-09-17T05:51:16.340331+0000","last_fullsized":"2024-09-17T05:51:16.340331+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:51:13.315624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:51:13.315624+0000","last_clean_scrub_stamp":"2024-09-17T05:51:13.315624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:28:04.514097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.0","version":"0'0","reported_seq":13,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-17T05:51:16.750649+0000","last_change":"2024-09-17T05:51:15.358735+0000","last_active":"2024-09-17T05:51:16.750649+0000","last_peered":"2024-09-17T05:51:16.750649+0000","last_clean":"2024-09-17T05:51:16.750649+0000","last_became_active":"2024-09-17T05:51:15.358337+0000","last_became_peered":"2024-09-17T05:51:15.358337+0000","last_unstale":"2024-09-17T05:51:16.750649+0000","last_undegraded":"2024-09-17T05:51:16.750649+0000","last_fullsized":"2024-09-17T05:51:16.750649+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:51:14.325451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:51:14.325451+0000","last_clean_scrub_stamp":"2024-09-17T05:51:14.325451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:23:41.242455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.1","version":"0'0","reported_seq":15,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-17T05:51:16.339383+0000","last_change":"2024-09-17T05:51:14.352047+0000","last_active":"2024-09-17T05:51:16.339383+0000","last_peered":"2024-09-17T05:51:16.339383+0000","last_clean":"2024-09-17T05:51:16.339383+0000","last_became_active":"2024-09-17T05:51:14.351529+0000","last_became_peered":"2024-09-17T05:51:14.351529+0000","last_unstale":"2024-09-17T05:51:16.339383+0000","last_undegraded":"2024-09-17T05:51:16.339383+0000","last_fullsized":"2024-09-17T05:51:16.339383+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:51:13.315624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:51:13.315624+0000","last_clean_scrub_stamp":"2024-09-17T05:51:13.315624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:58:57.809988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:51:14.325451+0000","last_change":"2024-09-17T05:51:14.325451+0000","last_active":"2024-09-17T05:51:14.325451+0000","last_peered":"2024-09-17T05:51:14.325451+0000","last_clean":"2024-09-17T05:51:14.325451+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:51:14.325451+0000","last_undegraded":"2024-09-17T05:51:14.325451+0000","last_fullsized":"2024-09-17T05:51:14.325451+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:51:14.325451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:51:14.325451+0000","last_clean_scrub_stamp":"2024-09-17T05:51:14.325451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.0","version":"0'0","reported_seq":1,"reported_epoch":110,"state":"creating+peering","last_fresh":"2024-09-17T05:51:13.332654+0000","last_change":"2024-09-17T05:51:13.332654+0000","last_active":"2024-09-17T05:51:13.315624+0000","last_peered":"2024-09-17T05:51:13.315624+0000","last_clean":"2024-09-17T05:51:13.315624+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:51:13.332654+0000","last_undegraded":"2024-09-17T05:51:13.332654+0000","last_fullsized":"2024-09-17T05:51:13.332654+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:51:13.315624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:51:13.315624+0000","last_clean_scrub_stamp":"2024-09-17T05:51:13.315624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.10","version":"0'0","reported_seq":13,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-17T05:51:16.340473+0000","last_change":"2024-09-17T05:51:15.351750+0000","last_active":"2024-09-17T05:51:16.340473+0000","last_peered":"2024-09-17T05:51:16.340473+0000","last_clean":"2024-09-17T05:51:16.340473+0000","last_became_active":"2024-09-17T05:51:15.351076+0000","last_became_peered":"2024-09-17T05:51:15.351076+0000","last_unstale":"2024-09-17T05:51:16.340473+0000","last_undegraded":"2024-09-17T05:51:16.340473+0000","last_fullsized":"2024-09-17T05:51:16.340473+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:51:14.325451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:51:14.325451+0000","last_clean_scrub_stamp":"2024-09-17T05:51:14.325451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:49:55.636228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.11","version":"0'0","reported_seq":15,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-17T05:51:16.360020+0000","last_change":"2024-09-17T05:51:14.358432+0000","last_active":"2024-09-17T05:51:16.360020+0000","last_peered":"2024-09-17T05:51:16.360020+0000","last_clean":"2024-09-17T05:51:16.360020+0000","last_became_active":"2024-09-17T05:51:14.358059+0000","last_became_peered":"2024-09-17T05:51:14.358059+0000","last_unstale":"2024-09-17T05:51:16.360020+0000","last_undegraded":"2024-09-17T05:51:16.360020+0000","last_fullsized":"2024-09-17T05:51:16.360020+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:51:13.315624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:51:13.315624+0000","last_clean_scrub_stamp":"2024-09-17T05:51:13.315624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:32:58.129426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"19'72","reported_seq":276,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-17T05:51:16.750680+0000","last_change":"2024-09-17T05:41:48.539830+0000","last_active":"2024-09-17T05:51:16.750680+0000","last_peered":"2024-09-17T05:51:16.750680+0000","last_clean":"2024-09-17T05:51:16.750680+0000","last_became_active":"2024-09-17T05:41:48.538743+0000","last_became_peered":"2024-09-17T05:41:48.538743+0000","last_unstale":"2024-09-17T05:51:16.750680+0000","last_undegraded":"2024-09-17T05:51:16.750680+0000","last_fullsized":"2024-09-17T05:51:16.750680+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:47.152539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:47.152539+0000","last_clean_scrub_stamp":"2024-09-17T05:41:47.152539+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:08:02.952016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":17,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":100,"acting":100,"num_store_stats":7},{"poolid":16,"num_pg":32,"stat_sum":{"num_bytes":686,"num_objects":15,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":34,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":12,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":3096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":29,"ondisk_log_size":29,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":16,"seq":68719476855,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":122740,"kb_used_data":1368,"kb_used_omap":1,"kb_used_meta":121342,"kb_avail":94249100,"statfs":{"total":96636764160,"available":96511078400,"internally_reserved":0,"allocated":1400832,"data_stored":608982,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":124254662},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":7,"up_from":15,"seq":64424509559,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":131624,"kb_used_data":1940,"kb_used_omap":1,"kb_used_meta":129662,"kb_avail":94240216,"statfs":{"total":96636764160,"available":96501981184,"internally_reserved":0,"allocated":1986560,"data_stored":1193456,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":132774346},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509558,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":108844,"kb_used_data":1360,"kb_used_omap":1,"kb_used_meta":107454,"kb_avail":94262996,"statfs":{"total":96636764160,"available":96525307904,"internally_reserved":0,"allocated":1392640,"data_stored":603076,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":110033349},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509558,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":136624,"kb_used_data":1364,"kb_used_omap":1,"kb_used_meta":135230,"kb_avail":94235216,"statfs":{"total":96636764160,"available":96496861184,"internally_reserved":0,"allocated":1396736,"data_stored":608912,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":138475973},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509558,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":131064,"kb_used_data":1380,"kb_used_omap":1,"kb_used_meta":129662,"kb_avail":94240776,"statfs":{"total":96636764160,"available":96502554624,"internally_reserved":0,"allocated":1413120,"data_stored":610594,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":132774343},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509558,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":136620,"kb_used_data":1364,"kb_used_omap":1,"kb_used_meta":135230,"kb_avail":94235220,"statfs":{"total":96636764160,"available":96496865280,"internally_reserved":0,"allocated":1396736,"data_stored":608912,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":138475973},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509558,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":122740,"kb_used_data":1372,"kb_used_omap":1,"kb_used_meta":121342,"kb_avail":94249100,"statfs":{"total":96636764160,"available":96511078400,"internally_reserved":0,"allocated":1404928,"data_stored":609036,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":124254661},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574965,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":119104,"kb_used_data":1896,"kb_used_omap":1,"kb_used_meta":117182,"kb_avail":94252736,"statfs":{"total":96636764160,"available":96514801664,"internally_reserved":0,"allocated":1941504,"data_stored":1173553,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":119994821},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1682,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-17T05:51:20.078 INFO:tasks.ceph.ceph_manager.ceph:PG 17.3f is not active+clean 2024-09-17T05:51:20.078 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '17.3f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T05:51:14.325451+0000', 'last_change': '2024-09-17T05:51:14.325451+0000', 'last_active': '2024-09-17T05:51:14.325451+0000', 'last_peered': '2024-09-17T05:51:14.325451+0000', 'last_clean': '2024-09-17T05:51:14.325451+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:51:14.325451+0000', 'last_undegraded': '2024-09-17T05:51:14.325451+0000', 'last_fullsized': '2024-09-17T05:51:14.325451+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:51:14.325451+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:51:14.325451+0000', 'last_clean_scrub_stamp': '2024-09-17T05:51:14.325451+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T05:51:20.078 INFO:tasks.ceph.ceph_manager.ceph:PG 17.3c is not active+clean 2024-09-17T05:51:20.078 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '17.3c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T05:51:14.325451+0000', 'last_change': '2024-09-17T05:51:14.325451+0000', 'last_active': '2024-09-17T05:51:14.325451+0000', 'last_peered': '2024-09-17T05:51:14.325451+0000', 'last_clean': '2024-09-17T05:51:14.325451+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:51:14.325451+0000', 'last_undegraded': '2024-09-17T05:51:14.325451+0000', 'last_fullsized': '2024-09-17T05:51:14.325451+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:51:14.325451+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:51:14.325451+0000', 'last_clean_scrub_stamp': '2024-09-17T05:51:14.325451+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T05:51:20.079 INFO:tasks.ceph.ceph_manager.ceph:PG 17.37 is not active+clean 2024-09-17T05:51:20.079 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '17.37', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T05:51:14.325451+0000', 'last_change': '2024-09-17T05:51:14.325451+0000', 'last_active': '2024-09-17T05:51:14.325451+0000', 'last_peered': '2024-09-17T05:51:14.325451+0000', 'last_clean': '2024-09-17T05:51:14.325451+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:51:14.325451+0000', 'last_undegraded': '2024-09-17T05:51:14.325451+0000', 'last_fullsized': '2024-09-17T05:51:14.325451+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:51:14.325451+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:51:14.325451+0000', 'last_clean_scrub_stamp': '2024-09-17T05:51:14.325451+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T05:51:20.079 INFO:tasks.ceph.ceph_manager.ceph:PG 17.36 is not active+clean 2024-09-17T05:51:20.079 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '17.36', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T05:51:14.325451+0000', 'last_change': '2024-09-17T05:51:14.325451+0000', 'last_active': '2024-09-17T05:51:14.325451+0000', 'last_peered': '2024-09-17T05:51:14.325451+0000', 'last_clean': '2024-09-17T05:51:14.325451+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:51:14.325451+0000', 'last_undegraded': '2024-09-17T05:51:14.325451+0000', 'last_fullsized': '2024-09-17T05:51:14.325451+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:51:14.325451+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:51:14.325451+0000', 'last_clean_scrub_stamp': '2024-09-17T05:51:14.325451+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T05:51:20.079 INFO:tasks.ceph.ceph_manager.ceph:PG 17.34 is not active+clean 2024-09-17T05:51:20.079 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '17.34', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T05:51:14.325451+0000', 'last_change': '2024-09-17T05:51:14.325451+0000', 'last_active': '2024-09-17T05:51:14.325451+0000', 'last_peered': '2024-09-17T05:51:14.325451+0000', 'last_clean': '2024-09-17T05:51:14.325451+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:51:14.325451+0000', 'last_undegraded': '2024-09-17T05:51:14.325451+0000', 'last_fullsized': '2024-09-17T05:51:14.325451+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:51:14.325451+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:51:14.325451+0000', 'last_clean_scrub_stamp': '2024-09-17T05:51:14.325451+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T05:51:20.079 INFO:tasks.ceph.ceph_manager.ceph:PG 17.30 is not active+clean 2024-09-17T05:51:20.079 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '17.30', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T05:51:14.325451+0000', 'last_change': '2024-09-17T05:51:14.325451+0000', 'last_active': '2024-09-17T05:51:14.325451+0000', 'last_peered': '2024-09-17T05:51:14.325451+0000', 'last_clean': '2024-09-17T05:51:14.325451+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:51:14.325451+0000', 'last_undegraded': '2024-09-17T05:51:14.325451+0000', 'last_fullsized': '2024-09-17T05:51:14.325451+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:51:14.325451+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:51:14.325451+0000', 'last_clean_scrub_stamp': '2024-09-17T05:51:14.325451+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T05:51:20.079 INFO:tasks.ceph.ceph_manager.ceph:PG 17.26 is not active+clean 2024-09-17T05:51:20.079 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '17.26', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T05:51:14.325451+0000', 'last_change': '2024-09-17T05:51:14.325451+0000', 'last_active': '2024-09-17T05:51:14.325451+0000', 'last_peered': '2024-09-17T05:51:14.325451+0000', 'last_clean': '2024-09-17T05:51:14.325451+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:51:14.325451+0000', 'last_undegraded': '2024-09-17T05:51:14.325451+0000', 'last_fullsized': '2024-09-17T05:51:14.325451+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:51:14.325451+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:51:14.325451+0000', 'last_clean_scrub_stamp': '2024-09-17T05:51:14.325451+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T05:51:20.079 INFO:tasks.ceph.ceph_manager.ceph:PG 17.21 is not active+clean 2024-09-17T05:51:20.080 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '17.21', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T05:51:14.325451+0000', 'last_change': '2024-09-17T05:51:14.325451+0000', 'last_active': '2024-09-17T05:51:14.325451+0000', 'last_peered': '2024-09-17T05:51:14.325451+0000', 'last_clean': '2024-09-17T05:51:14.325451+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:51:14.325451+0000', 'last_undegraded': '2024-09-17T05:51:14.325451+0000', 'last_fullsized': '2024-09-17T05:51:14.325451+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:51:14.325451+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:51:14.325451+0000', 'last_clean_scrub_stamp': '2024-09-17T05:51:14.325451+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T05:51:20.080 INFO:tasks.ceph.ceph_manager.ceph:PG 17.1a is not active+clean 2024-09-17T05:51:20.080 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '17.1a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T05:51:14.325451+0000', 'last_change': '2024-09-17T05:51:14.325451+0000', 'last_active': '2024-09-17T05:51:14.325451+0000', 'last_peered': '2024-09-17T05:51:14.325451+0000', 'last_clean': '2024-09-17T05:51:14.325451+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:51:14.325451+0000', 'last_undegraded': '2024-09-17T05:51:14.325451+0000', 'last_fullsized': '2024-09-17T05:51:14.325451+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:51:14.325451+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:51:14.325451+0000', 'last_clean_scrub_stamp': '2024-09-17T05:51:14.325451+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T05:51:20.080 INFO:tasks.ceph.ceph_manager.ceph:PG 17.18 is not active+clean 2024-09-17T05:51:20.080 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '17.18', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T05:51:14.325451+0000', 'last_change': '2024-09-17T05:51:14.325451+0000', 'last_active': '2024-09-17T05:51:14.325451+0000', 'last_peered': '2024-09-17T05:51:14.325451+0000', 'last_clean': '2024-09-17T05:51:14.325451+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:51:14.325451+0000', 'last_undegraded': '2024-09-17T05:51:14.325451+0000', 'last_fullsized': '2024-09-17T05:51:14.325451+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:51:14.325451+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:51:14.325451+0000', 'last_clean_scrub_stamp': '2024-09-17T05:51:14.325451+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T05:51:20.080 INFO:tasks.ceph.ceph_manager.ceph:PG 16.18 is not active+clean 2024-09-17T05:51:20.080 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '16.18', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 110, 'state': 'creating+peering', 'last_fresh': '2024-09-17T05:51:13.333713+0000', 'last_change': '2024-09-17T05:51:13.333713+0000', 'last_active': '2024-09-17T05:51:13.315624+0000', 'last_peered': '2024-09-17T05:51:13.315624+0000', 'last_clean': '2024-09-17T05:51:13.315624+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:51:13.333713+0000', 'last_undegraded': '2024-09-17T05:51:13.333713+0000', 'last_fullsized': '2024-09-17T05:51:13.333713+0000', 'mapping_epoch': 110, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 110, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:51:13.315624+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:51:13.315624+0000', 'last_clean_scrub_stamp': '2024-09-17T05:51:13.315624+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 3], 'acting': [0, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-17T05:51:20.080 INFO:tasks.ceph.ceph_manager.ceph:PG 16.15 is not active+clean 2024-09-17T05:51:20.080 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '16.15', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 110, 'state': 'creating+peering', 'last_fresh': '2024-09-17T05:51:13.333287+0000', 'last_change': '2024-09-17T05:51:13.333287+0000', 'last_active': '2024-09-17T05:51:13.315624+0000', 'last_peered': '2024-09-17T05:51:13.315624+0000', 'last_clean': '2024-09-17T05:51:13.315624+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:51:13.333287+0000', 'last_undegraded': '2024-09-17T05:51:13.333287+0000', 'last_fullsized': '2024-09-17T05:51:13.333287+0000', 'mapping_epoch': 110, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 110, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:51:13.315624+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:51:13.315624+0000', 'last_clean_scrub_stamp': '2024-09-17T05:51:13.315624+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-17T05:51:20.080 INFO:tasks.ceph.ceph_manager.ceph:PG 16.14 is not active+clean 2024-09-17T05:51:20.080 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '16.14', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 110, 'state': 'creating+peering', 'last_fresh': '2024-09-17T05:51:13.332882+0000', 'last_change': '2024-09-17T05:51:13.332882+0000', 'last_active': '2024-09-17T05:51:13.315624+0000', 'last_peered': '2024-09-17T05:51:13.315624+0000', 'last_clean': '2024-09-17T05:51:13.315624+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:51:13.332882+0000', 'last_undegraded': '2024-09-17T05:51:13.332882+0000', 'last_fullsized': '2024-09-17T05:51:13.332882+0000', 'mapping_epoch': 110, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 110, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:51:13.315624+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:51:13.315624+0000', 'last_clean_scrub_stamp': '2024-09-17T05:51:13.315624+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 3], 'acting': [0, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-17T05:51:20.081 INFO:tasks.ceph.ceph_manager.ceph:PG 16.f is not active+clean 2024-09-17T05:51:20.081 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '16.f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 110, 'state': 'creating+peering', 'last_fresh': '2024-09-17T05:51:13.332721+0000', 'last_change': '2024-09-17T05:51:13.332721+0000', 'last_active': '2024-09-17T05:51:13.315624+0000', 'last_peered': '2024-09-17T05:51:13.315624+0000', 'last_clean': '2024-09-17T05:51:13.315624+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:51:13.332721+0000', 'last_undegraded': '2024-09-17T05:51:13.332721+0000', 'last_fullsized': '2024-09-17T05:51:13.332721+0000', 'mapping_epoch': 110, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 110, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:51:13.315624+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:51:13.315624+0000', 'last_clean_scrub_stamp': '2024-09-17T05:51:13.315624+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 5], 'acting': [0, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-17T05:51:20.081 INFO:tasks.ceph.ceph_manager.ceph:PG 17.b is not active+clean 2024-09-17T05:51:20.081 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '17.b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T05:51:14.325451+0000', 'last_change': '2024-09-17T05:51:14.325451+0000', 'last_active': '2024-09-17T05:51:14.325451+0000', 'last_peered': '2024-09-17T05:51:14.325451+0000', 'last_clean': '2024-09-17T05:51:14.325451+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:51:14.325451+0000', 'last_undegraded': '2024-09-17T05:51:14.325451+0000', 'last_fullsized': '2024-09-17T05:51:14.325451+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:51:14.325451+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:51:14.325451+0000', 'last_clean_scrub_stamp': '2024-09-17T05:51:14.325451+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T05:51:20.081 INFO:tasks.ceph.ceph_manager.ceph:PG 16.8 is not active+clean 2024-09-17T05:51:20.081 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '16.8', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 110, 'state': 'creating+peering', 'last_fresh': '2024-09-17T05:51:13.333212+0000', 'last_change': '2024-09-17T05:51:13.333212+0000', 'last_active': '2024-09-17T05:51:13.315624+0000', 'last_peered': '2024-09-17T05:51:13.315624+0000', 'last_clean': '2024-09-17T05:51:13.315624+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:51:13.333212+0000', 'last_undegraded': '2024-09-17T05:51:13.333212+0000', 'last_fullsized': '2024-09-17T05:51:13.333212+0000', 'mapping_epoch': 110, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 110, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:51:13.315624+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:51:13.315624+0000', 'last_clean_scrub_stamp': '2024-09-17T05:51:13.315624+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 6], 'acting': [0, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-17T05:51:20.081 INFO:tasks.ceph.ceph_manager.ceph:PG 17.7 is not active+clean 2024-09-17T05:51:20.081 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '17.7', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T05:51:14.325451+0000', 'last_change': '2024-09-17T05:51:14.325451+0000', 'last_active': '2024-09-17T05:51:14.325451+0000', 'last_peered': '2024-09-17T05:51:14.325451+0000', 'last_clean': '2024-09-17T05:51:14.325451+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:51:14.325451+0000', 'last_undegraded': '2024-09-17T05:51:14.325451+0000', 'last_fullsized': '2024-09-17T05:51:14.325451+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:51:14.325451+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:51:14.325451+0000', 'last_clean_scrub_stamp': '2024-09-17T05:51:14.325451+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T05:51:20.081 INFO:tasks.ceph.ceph_manager.ceph:PG 17.4 is not active+clean 2024-09-17T05:51:20.081 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '17.4', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T05:51:14.325451+0000', 'last_change': '2024-09-17T05:51:14.325451+0000', 'last_active': '2024-09-17T05:51:14.325451+0000', 'last_peered': '2024-09-17T05:51:14.325451+0000', 'last_clean': '2024-09-17T05:51:14.325451+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:51:14.325451+0000', 'last_undegraded': '2024-09-17T05:51:14.325451+0000', 'last_fullsized': '2024-09-17T05:51:14.325451+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:51:14.325451+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:51:14.325451+0000', 'last_clean_scrub_stamp': '2024-09-17T05:51:14.325451+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T05:51:20.082 INFO:tasks.ceph.ceph_manager.ceph:PG 16.5 is not active+clean 2024-09-17T05:51:20.082 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '16.5', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 110, 'state': 'creating+peering', 'last_fresh': '2024-09-17T05:51:13.332782+0000', 'last_change': '2024-09-17T05:51:13.332782+0000', 'last_active': '2024-09-17T05:51:13.315624+0000', 'last_peered': '2024-09-17T05:51:13.315624+0000', 'last_clean': '2024-09-17T05:51:13.315624+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:51:13.332782+0000', 'last_undegraded': '2024-09-17T05:51:13.332782+0000', 'last_fullsized': '2024-09-17T05:51:13.332782+0000', 'mapping_epoch': 110, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 110, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:51:13.315624+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:51:13.315624+0000', 'last_clean_scrub_stamp': '2024-09-17T05:51:13.315624+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 6], 'acting': [0, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-17T05:51:20.082 INFO:tasks.ceph.ceph_manager.ceph:PG 17.1 is not active+clean 2024-09-17T05:51:20.082 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '17.1', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T05:51:14.325451+0000', 'last_change': '2024-09-17T05:51:14.325451+0000', 'last_active': '2024-09-17T05:51:14.325451+0000', 'last_peered': '2024-09-17T05:51:14.325451+0000', 'last_clean': '2024-09-17T05:51:14.325451+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:51:14.325451+0000', 'last_undegraded': '2024-09-17T05:51:14.325451+0000', 'last_fullsized': '2024-09-17T05:51:14.325451+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:51:14.325451+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:51:14.325451+0000', 'last_clean_scrub_stamp': '2024-09-17T05:51:14.325451+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T05:51:20.082 INFO:tasks.ceph.ceph_manager.ceph:PG 16.0 is not active+clean 2024-09-17T05:51:20.082 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '16.0', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 110, 'state': 'creating+peering', 'last_fresh': '2024-09-17T05:51:13.332654+0000', 'last_change': '2024-09-17T05:51:13.332654+0000', 'last_active': '2024-09-17T05:51:13.315624+0000', 'last_peered': '2024-09-17T05:51:13.315624+0000', 'last_clean': '2024-09-17T05:51:13.315624+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:51:13.332654+0000', 'last_undegraded': '2024-09-17T05:51:13.332654+0000', 'last_fullsized': '2024-09-17T05:51:13.332654+0000', 'mapping_epoch': 110, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 110, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:51:13.315624+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:51:13.315624+0000', 'last_clean_scrub_stamp': '2024-09-17T05:51:13.315624+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 6], 'acting': [0, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-17T05:51:20.083 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-09-17T05:51:20.228 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:20.227+0000 7fd651c86640 1 -- 172.21.15.150:0/3524543417 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd634005350 msgr2=0x7fd63400b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:51:20.228 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:20.227+0000 7fd651c86640 1 --2- 172.21.15.150:0/3524543417 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd634005350 0x7fd63400b9c0 secure :-1 s=READY pgs=1503 cs=0 l=1 rev1=1 crypto rx=0x7fd644001dc0 tx=0x7fd634005830 comp rx=0 tx=0).stop 2024-09-17T05:51:20.229 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:20.227+0000 7fd651c86640 1 -- 172.21.15.150:0/3524543417 shutdown_connections 2024-09-17T05:51:20.229 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:20.227+0000 7fd651c86640 1 --2- 172.21.15.150:0/3524543417 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd634005350 0x7fd63400b9c0 unknown :-1 s=CLOSED pgs=1503 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:51:20.229 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:20.227+0000 7fd651c86640 1 -- 172.21.15.150:0/3524543417 >> 172.21.15.150:0/3524543417 conn(0x7fd64c06d730 msgr2=0x7fd64c0b1e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:51:20.229 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:20.227+0000 7fd651c86640 1 -- 172.21.15.150:0/3524543417 shutdown_connections 2024-09-17T05:51:20.229 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:20.227+0000 7fd651c86640 1 -- 172.21.15.150:0/3524543417 wait complete. 2024-09-17T05:51:20.229 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:20.229+0000 7fd651c86640 1 Processor -- start 2024-09-17T05:51:20.230 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:20.229+0000 7fd651c86640 1 -- start start 2024-09-17T05:51:20.233 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:20.230+0000 7fd651c86640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd634005350 0x7fd64c1510a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:51:20.233 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:20.230+0000 7fd651c86640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd64c0cf960 0x7fd64c1f3000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:51:20.233 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:20.230+0000 7fd651c86640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd64c154a10 0x7fd64c154e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:51:20.233 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:20.230+0000 7fd651c86640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7fd64c0b2750 con 0x7fd634005350 2024-09-17T05:51:20.233 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:20.230+0000 7fd651c86640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fd64c15f6f0 con 0x7fd64c0cf960 2024-09-17T05:51:20.233 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:20.230+0000 7fd651c86640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fd64c0b28d0 con 0x7fd64c154a10 2024-09-17T05:51:20.233 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:20.231+0000 7fd64b7fe640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd634005350 0x7fd64c1510a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:51:20.233 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:20.231+0000 7fd64b7fe640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd634005350 0x7fd64c1510a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:57586/0 (socket says 172.21.15.150:57586) 2024-09-17T05:51:20.233 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:20.231+0000 7fd64b7fe640 1 -- 172.21.15.150:0/365602792 learned_addr learned my addr 172.21.15.150:0/365602792 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:51:20.233 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:20.231+0000 7fd64bfff640 1 --2- 172.21.15.150:0/365602792 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd64c154a10 0x7fd64c154e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:51:20.233 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:20.231+0000 7fd64affd640 1 --2- 172.21.15.150:0/365602792 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd64c0cf960 0x7fd64c1f3000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:51:20.233 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:20.231+0000 7fd64b7fe640 1 -- 172.21.15.150:0/365602792 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd64c154a10 msgr2=0x7fd64c154e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:51:20.234 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:20.231+0000 7fd64b7fe640 1 --2- 172.21.15.150:0/365602792 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd64c154a10 0x7fd64c154e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:51:20.234 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:20.231+0000 7fd64b7fe640 1 -- 172.21.15.150:0/365602792 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd64c0cf960 msgr2=0x7fd64c1f3000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:51:20.234 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:20.231+0000 7fd64b7fe640 1 --2- 172.21.15.150:0/365602792 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd64c0cf960 0x7fd64c1f3000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:51:20.234 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:20.231+0000 7fd64b7fe640 1 -- 172.21.15.150:0/365602792 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd64c1f3540 con 0x7fd634005350 2024-09-17T05:51:20.234 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:20.231+0000 7fd64affd640 1 --2- 172.21.15.150:0/365602792 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd64c0cf960 0x7fd64c1f3000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:51:20.234 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:20.231+0000 7fd64bfff640 1 --2- 172.21.15.150:0/365602792 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd64c154a10 0x7fd64c154e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:51:20.234 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:20.231+0000 7fd64b7fe640 1 --2- 172.21.15.150:0/365602792 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd634005350 0x7fd64c1510a0 secure :-1 s=READY pgs=1504 cs=0 l=1 rev1=1 crypto rx=0x7fd63c00e630 tx=0x7fd63c00eaf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:51:20.234 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:20.231+0000 7fd633fff640 1 -- 172.21.15.150:0/365602792 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd63c015070 con 0x7fd634005350 2024-09-17T05:51:20.234 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:20.231+0000 7fd633fff640 1 -- 172.21.15.150:0/365602792 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd63c00ca80 con 0x7fd634005350 2024-09-17T05:51:20.234 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:20.231+0000 7fd651c86640 1 -- 172.21.15.150:0/365602792 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd64c154190 con 0x7fd634005350 2024-09-17T05:51:20.234 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:20.231+0000 7fd633fff640 1 -- 172.21.15.150:0/365602792 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd63c011460 con 0x7fd634005350 2024-09-17T05:51:20.234 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:20.231+0000 7fd651c86640 1 -- 172.21.15.150:0/365602792 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd64c0cd310 con 0x7fd634005350 2024-09-17T05:51:20.234 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:20.232+0000 7fd651c86640 1 -- 172.21.15.150:0/365602792 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd64c15bd90 con 0x7fd634005350 2024-09-17T05:51:20.235 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:20.233+0000 7fd633fff640 1 -- 172.21.15.150:0/365602792 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 37) ==== 103787+0+0 (secure 0 0 0) 0x7fd63c018070 con 0x7fd634005350 2024-09-17T05:51:20.235 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:20.233+0000 7fd633fff640 1 --2- 172.21.15.150:0/365602792 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fd63807a5a0 0x7fd63807cab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:51:20.235 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:20.234+0000 7fd633fff640 1 -- 172.21.15.150:0/365602792 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(113..113 src has 1..113) ==== 5849+0+0 (secure 0 0 0) 0x7fd63c099f10 con 0x7fd634005350 2024-09-17T05:51:20.235 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:20.234+0000 7fd64affd640 1 --2- 172.21.15.150:0/365602792 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fd63807a5a0 0x7fd63807cab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:51:20.235 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:20.234+0000 7fd64affd640 1 --2- 172.21.15.150:0/365602792 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fd63807a5a0 0x7fd63807cab0 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7fd640009ae0 tx=0x7fd640005f90 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:51:20.238 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:20.238+0000 7fd633fff640 1 -- 172.21.15.150:0/365602792 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fd63c063ee0 con 0x7fd634005350 2024-09-17T05:51:20.482 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:20.482+0000 7fd651c86640 1 -- 172.21.15.150:0/365602792 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) -- 0x7fd64c0b4dc0 con 0x7fd634005350 2024-09-17T05:51:20.483 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:20.482+0000 7fd633fff640 1 -- 172.21.15.150:0/365602792 <== mon.0 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) ==== 72+0+1220 (secure 0 0 0) 0x7fd63c0637e0 con 0x7fd634005350 2024-09-17T05:51:20.483 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-09-17T05:51:20.483 INFO:teuthology.orchestra.run.smithi150.stdout:{"fsid":"9f2e05e9-d629-47b3-b26b-1360655b7d20","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":587,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":113,"num_osds":8,"num_up_osds":8,"osd_up_since":1726551706,"num_in_osds":8,"osd_in_since":1726551696,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":76},{"state_name":"unknown","count":14},{"state_name":"creating+peering","count":7}],"num_pgs":97,"num_pools":3,"num_objects":17,"data_bytes":591054,"bytes_used":1033584640,"bytes_avail":772060528640,"bytes_total":773094113280,"unknown_pgs_ratio":0.14432989060878754,"inactive_pgs_ratio":0.072164945304393768,"write_bytes_sec":1609,"read_op_per_sec":0,"write_op_per_sec":5},"fsmap":{"epoch":70,"btime":"2024-09-17T05:51:18:358727+0000","id":8,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":8,"rank":0,"name":"c","status":"up:active","gid":8571}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":17,"modified":"2024-09-17T05:49:15.004587+0000","services":{}},"progress_events":{}} 2024-09-17T05:51:20.485 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:20.484+0000 7fd651c86640 1 -- 172.21.15.150:0/365602792 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fd63807a5a0 msgr2=0x7fd63807cab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:51:20.486 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:20.484+0000 7fd651c86640 1 --2- 172.21.15.150:0/365602792 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fd63807a5a0 0x7fd63807cab0 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7fd640009ae0 tx=0x7fd640005f90 comp rx=0 tx=0).stop 2024-09-17T05:51:20.486 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:20.484+0000 7fd651c86640 1 -- 172.21.15.150:0/365602792 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd634005350 msgr2=0x7fd64c1510a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:51:20.486 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:20.484+0000 7fd651c86640 1 --2- 172.21.15.150:0/365602792 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd634005350 0x7fd64c1510a0 secure :-1 s=READY pgs=1504 cs=0 l=1 rev1=1 crypto rx=0x7fd63c00e630 tx=0x7fd63c00eaf0 comp rx=0 tx=0).stop 2024-09-17T05:51:20.486 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:20.484+0000 7fd651c86640 1 -- 172.21.15.150:0/365602792 shutdown_connections 2024-09-17T05:51:20.486 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:20.484+0000 7fd651c86640 1 --2- 172.21.15.150:0/365602792 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd64c0cf960 0x7fd64c1f3000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:51:20.486 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:20.484+0000 7fd651c86640 1 --2- 172.21.15.150:0/365602792 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fd63807a5a0 0x7fd63807cab0 unknown :-1 s=CLOSED pgs=642 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:51:20.486 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:20.484+0000 7fd651c86640 1 --2- 172.21.15.150:0/365602792 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd64c154a10 0x7fd64c154e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:51:20.486 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:20.484+0000 7fd651c86640 1 --2- 172.21.15.150:0/365602792 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd634005350 0x7fd64c1510a0 unknown :-1 s=CLOSED pgs=1504 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:51:20.486 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:20.484+0000 7fd651c86640 1 -- 172.21.15.150:0/365602792 >> 172.21.15.150:0/365602792 conn(0x7fd64c06d730 msgr2=0x7fd64c15b240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:51:20.486 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:20.485+0000 7fd651c86640 1 -- 172.21.15.150:0/365602792 shutdown_connections 2024-09-17T05:51:20.486 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:20.485+0000 7fd651c86640 1 -- 172.21.15.150:0/365602792 wait complete. 2024-09-17T05:51:20.497 INFO:tasks.ceph.ceph_manager.ceph:no progress seen, keeping timeout for now 2024-09-17T05:51:20.497 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-17T05:51:20.611 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:20.609+0000 7f0ee4dba640 1 -- 172.21.15.150:0/468902498 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0ee009ba60 msgr2=0x7f0ee00b7330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:51:20.611 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:20.610+0000 7f0ee4dba640 1 --2- 172.21.15.150:0/468902498 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0ee009ba60 0x7f0ee00b7330 secure :-1 s=READY pgs=1505 cs=0 l=1 rev1=1 crypto rx=0x7f0ed00098e0 tx=0x7f0ed002a530 comp rx=0 tx=0).stop 2024-09-17T05:51:20.611 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:20.610+0000 7f0ee4dba640 1 -- 172.21.15.150:0/468902498 shutdown_connections 2024-09-17T05:51:20.611 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:20.610+0000 7f0ee4dba640 1 --2- 172.21.15.150:0/468902498 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0ee00cd850 0x7f0ee00d06f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:51:20.611 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:20.610+0000 7f0ee4dba640 1 --2- 172.21.15.150:0/468902498 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0ee009ba60 0x7f0ee00b7330 unknown :-1 s=CLOSED pgs=1505 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:51:20.611 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:20.610+0000 7f0ee4dba640 1 -- 172.21.15.150:0/468902498 >> 172.21.15.150:0/468902498 conn(0x7f0ee00cee90 msgr2=0x7f0ee00cf2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:51:20.612 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:20.610+0000 7f0ee4dba640 1 -- 172.21.15.150:0/468902498 shutdown_connections 2024-09-17T05:51:20.612 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:20.610+0000 7f0ee4dba640 1 -- 172.21.15.150:0/468902498 wait complete. 2024-09-17T05:51:20.612 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:20.612+0000 7f0ee4dba640 1 Processor -- start 2024-09-17T05:51:20.612 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:20.612+0000 7f0ee4dba640 1 -- start start 2024-09-17T05:51:20.615 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:20.613+0000 7f0ee4dba640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0ee009ba60 0x7f0ee01f60a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:51:20.615 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:20.613+0000 7f0ee4dba640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0ee00cd440 0x7f0ee009f940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:51:20.615 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:20.613+0000 7f0ee4dba640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0ee00cd850 0x7f0ee00caa20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:51:20.615 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:20.613+0000 7f0ee4dba640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f0ee00d0db0 con 0x7f0ee009ba60 2024-09-17T05:51:20.616 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:20.613+0000 7f0ee4dba640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f0ee00d0c30 con 0x7f0ee00cd850 2024-09-17T05:51:20.616 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:20.613+0000 7f0ee4dba640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f0ee00d0f30 con 0x7f0ee00cd440 2024-09-17T05:51:20.616 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:20.613+0000 7f0ede59c640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0ee009ba60 0x7f0ee01f60a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:51:20.616 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:20.613+0000 7f0ede59c640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0ee009ba60 0x7f0ee01f60a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:57600/0 (socket says 172.21.15.150:57600) 2024-09-17T05:51:20.616 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:20.613+0000 7f0ede59c640 1 -- 172.21.15.150:0/1038558836 learned_addr learned my addr 172.21.15.150:0/1038558836 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:51:20.616 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:20.613+0000 7f0eddd9b640 1 --2- 172.21.15.150:0/1038558836 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0ee00cd440 0x7f0ee009f940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:51:20.616 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:20.613+0000 7f0eded9d640 1 --2- 172.21.15.150:0/1038558836 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0ee00cd850 0x7f0ee00caa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:51:20.616 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:20.613+0000 7f0ede59c640 1 -- 172.21.15.150:0/1038558836 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0ee00cd440 msgr2=0x7f0ee009f940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:51:20.616 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:20.613+0000 7f0ede59c640 1 --2- 172.21.15.150:0/1038558836 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0ee00cd440 0x7f0ee009f940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:51:20.616 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:20.613+0000 7f0ede59c640 1 -- 172.21.15.150:0/1038558836 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0ee00cd850 msgr2=0x7f0ee00caa20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:51:20.616 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:20.613+0000 7f0ede59c640 1 --2- 172.21.15.150:0/1038558836 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0ee00cd850 0x7f0ee00caa20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:51:20.617 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:20.613+0000 7f0ede59c640 1 -- 172.21.15.150:0/1038558836 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0ee015eb80 con 0x7f0ee009ba60 2024-09-17T05:51:20.617 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:20.613+0000 7f0eded9d640 1 --2- 172.21.15.150:0/1038558836 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0ee00cd850 0x7f0ee00caa20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:51:20.617 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:20.613+0000 7f0ede59c640 1 --2- 172.21.15.150:0/1038558836 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0ee009ba60 0x7f0ee01f60a0 secure :-1 s=READY pgs=1506 cs=0 l=1 rev1=1 crypto rx=0x7f0ed0009a00 tx=0x7f0ed0004ac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:51:20.617 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:20.614+0000 7f0eceffd640 1 -- 172.21.15.150:0/1038558836 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ed0031b50 con 0x7f0ee009ba60 2024-09-17T05:51:20.617 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:20.614+0000 7f0eceffd640 1 -- 172.21.15.150:0/1038558836 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0ed0031de0 con 0x7f0ee009ba60 2024-09-17T05:51:20.617 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:20.614+0000 7f0ee4dba640 1 -- 172.21.15.150:0/1038558836 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0ee015ee60 con 0x7f0ee009ba60 2024-09-17T05:51:20.617 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:20.614+0000 7f0eceffd640 1 -- 172.21.15.150:0/1038558836 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ed00052a0 con 0x7f0ee009ba60 2024-09-17T05:51:20.617 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:20.614+0000 7f0ee4dba640 1 -- 172.21.15.150:0/1038558836 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0ee015f420 con 0x7f0ee009ba60 2024-09-17T05:51:20.617 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:20.615+0000 7f0ee4dba640 1 -- 172.21.15.150:0/1038558836 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0ee015f850 con 0x7f0ee009ba60 2024-09-17T05:51:20.618 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:20.616+0000 7f0eceffd640 1 -- 172.21.15.150:0/1038558836 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 37) ==== 103787+0+0 (secure 0 0 0) 0x7f0ed0005440 con 0x7f0ee009ba60 2024-09-17T05:51:20.618 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:20.616+0000 7f0eceffd640 1 --2- 172.21.15.150:0/1038558836 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f0ec007a570 0x7f0ec007ca80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:51:20.618 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:20.616+0000 7f0eceffd640 1 -- 172.21.15.150:0/1038558836 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(113..113 src has 1..113) ==== 5849+0+0 (secure 0 0 0) 0x7f0ed00bb030 con 0x7f0ee009ba60 2024-09-17T05:51:20.618 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:20.616+0000 7f0eddd9b640 1 --2- 172.21.15.150:0/1038558836 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f0ec007a570 0x7f0ec007ca80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:51:20.618 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:20.617+0000 7f0eddd9b640 1 --2- 172.21.15.150:0/1038558836 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f0ec007a570 0x7f0ec007ca80 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7f0ed4006fd0 tx=0x7f0ed4008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:51:20.621 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:20.621+0000 7f0eceffd640 1 -- 172.21.15.150:0/1038558836 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f0ed003f030 con 0x7f0ee009ba60 2024-09-17T05:51:20.793 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:20.793+0000 7f0ee4dba640 1 -- 172.21.15.150:0/1038558836 --> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f0ee0164a20 con 0x7f0ec007a570 2024-09-17T05:51:20.798 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:20.797+0000 7f0eceffd640 1 -- 172.21.15.150:0/1038558836 <== mgr.4108 v2:172.21.15.176:6800/3631216395 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+249997 (secure 0 0 0) 0x7f0ee0164a20 con 0x7f0ec007a570 2024-09-17T05:51:20.801 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-09-17T05:51:20.802 INFO:teuthology.orchestra.run.smithi150.stderr:dumped all 2024-09-17T05:51:20.803 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:20.801+0000 7f0ee4dba640 1 -- 172.21.15.150:0/1038558836 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f0ec007a570 msgr2=0x7f0ec007ca80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:51:20.803 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:20.801+0000 7f0ee4dba640 1 --2- 172.21.15.150:0/1038558836 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f0ec007a570 0x7f0ec007ca80 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7f0ed4006fd0 tx=0x7f0ed4008040 comp rx=0 tx=0).stop 2024-09-17T05:51:20.804 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:20.801+0000 7f0ee4dba640 1 -- 172.21.15.150:0/1038558836 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0ee009ba60 msgr2=0x7f0ee01f60a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:51:20.804 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:20.801+0000 7f0ee4dba640 1 --2- 172.21.15.150:0/1038558836 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0ee009ba60 0x7f0ee01f60a0 secure :-1 s=READY pgs=1506 cs=0 l=1 rev1=1 crypto rx=0x7f0ed0009a00 tx=0x7f0ed0004ac0 comp rx=0 tx=0).stop 2024-09-17T05:51:20.804 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:20.801+0000 7f0ee4dba640 1 -- 172.21.15.150:0/1038558836 shutdown_connections 2024-09-17T05:51:20.804 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:20.801+0000 7f0ee4dba640 1 --2- 172.21.15.150:0/1038558836 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0ee00cd850 0x7f0ee00caa20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:51:20.804 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:20.801+0000 7f0ee4dba640 1 --2- 172.21.15.150:0/1038558836 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f0ec007a570 0x7f0ec007ca80 unknown :-1 s=CLOSED pgs=643 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:51:20.804 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:20.801+0000 7f0ee4dba640 1 --2- 172.21.15.150:0/1038558836 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0ee00cd440 0x7f0ee009f940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:51:20.804 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:20.801+0000 7f0ee4dba640 1 --2- 172.21.15.150:0/1038558836 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0ee009ba60 0x7f0ee01f60a0 unknown :-1 s=CLOSED pgs=1506 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:51:20.804 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:20.801+0000 7f0ee4dba640 1 -- 172.21.15.150:0/1038558836 >> 172.21.15.150:0/1038558836 conn(0x7f0ee00cee90 msgr2=0x7f0ee00712d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:51:20.804 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:20.801+0000 7f0ee4dba640 1 -- 172.21.15.150:0/1038558836 shutdown_connections 2024-09-17T05:51:20.804 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:20.801+0000 7f0ee4dba640 1 -- 172.21.15.150:0/1038558836 wait complete. 2024-09-17T05:51:20.813 INFO:teuthology.orchestra.run.smithi150.stdout:{"pg_ready":true,"pg_map":{"version":394,"stamp":"2024-09-17T05:51:19.058233+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":591054,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":135,"num_write_kb":1637,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":12,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":101,"ondisk_log_size":101,"up":166,"acting":166,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":98,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":1009360,"kb_used_data":12044,"kb_used_omap":12,"kb_used_meta":997107,"kb_avail":753965360,"statfs":{"total":773094113280,"available":772060528640,"internally_reserved":0,"allocated":12333056,"data_stored":6016521,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":1021038128},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":17,"apply_latency_ms":17,"commit_latency_ns":17000000,"apply_latency_ns":17000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":686,"num_objects":15,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":34,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":12,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.726990"},"pg_stats":[{"pgid":"17.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:51:14.325451+0000","last_change":"2024-09-17T05:51:14.325451+0000","last_active":"2024-09-17T05:51:14.325451+0000","last_peered":"2024-09-17T05:51:14.325451+0000","last_clean":"2024-09-17T05:51:14.325451+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:51:14.325451+0000","last_undegraded":"2024-09-17T05:51:14.325451+0000","last_fullsized":"2024-09-17T05:51:14.325451+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:51:14.325451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:51:14.325451+0000","last_clean_scrub_stamp":"2024-09-17T05:51:14.325451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.3e","version":"0'0","reported_seq":13,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-17T05:51:16.340640+0000","last_change":"2024-09-17T05:51:15.344958+0000","last_active":"2024-09-17T05:51:16.340640+0000","last_peered":"2024-09-17T05:51:16.340640+0000","last_clean":"2024-09-17T05:51:16.340640+0000","last_became_active":"2024-09-17T05:51:15.344518+0000","last_became_peered":"2024-09-17T05:51:15.344518+0000","last_unstale":"2024-09-17T05:51:16.340640+0000","last_undegraded":"2024-09-17T05:51:16.340640+0000","last_fullsized":"2024-09-17T05:51:16.340640+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:51:14.325451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:51:14.325451+0000","last_clean_scrub_stamp":"2024-09-17T05:51:14.325451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:49:40.516537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.3d","version":"0'0","reported_seq":13,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-17T05:51:16.750744+0000","last_change":"2024-09-17T05:51:15.352551+0000","last_active":"2024-09-17T05:51:16.750744+0000","last_peered":"2024-09-17T05:51:16.750744+0000","last_clean":"2024-09-17T05:51:16.750744+0000","last_became_active":"2024-09-17T05:51:15.352223+0000","last_became_peered":"2024-09-17T05:51:15.352223+0000","last_unstale":"2024-09-17T05:51:16.750744+0000","last_undegraded":"2024-09-17T05:51:16.750744+0000","last_fullsized":"2024-09-17T05:51:16.750744+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:51:14.325451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:51:14.325451+0000","last_clean_scrub_stamp":"2024-09-17T05:51:14.325451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:56:32.607756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:51:14.325451+0000","last_change":"2024-09-17T05:51:14.325451+0000","last_active":"2024-09-17T05:51:14.325451+0000","last_peered":"2024-09-17T05:51:14.325451+0000","last_clean":"2024-09-17T05:51:14.325451+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:51:14.325451+0000","last_undegraded":"2024-09-17T05:51:14.325451+0000","last_fullsized":"2024-09-17T05:51:14.325451+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:51:14.325451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:51:14.325451+0000","last_clean_scrub_stamp":"2024-09-17T05:51:14.325451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.3b","version":"0'0","reported_seq":13,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-17T05:51:16.339755+0000","last_change":"2024-09-17T05:51:15.354740+0000","last_active":"2024-09-17T05:51:16.339755+0000","last_peered":"2024-09-17T05:51:16.339755+0000","last_clean":"2024-09-17T05:51:16.339755+0000","last_became_active":"2024-09-17T05:51:15.354441+0000","last_became_peered":"2024-09-17T05:51:15.354441+0000","last_unstale":"2024-09-17T05:51:16.339755+0000","last_undegraded":"2024-09-17T05:51:16.339755+0000","last_fullsized":"2024-09-17T05:51:16.339755+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:51:14.325451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:51:14.325451+0000","last_clean_scrub_stamp":"2024-09-17T05:51:14.325451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:01:13.224376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.3a","version":"0'0","reported_seq":13,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-17T05:51:16.750534+0000","last_change":"2024-09-17T05:51:15.349818+0000","last_active":"2024-09-17T05:51:16.750534+0000","last_peered":"2024-09-17T05:51:16.750534+0000","last_clean":"2024-09-17T05:51:16.750534+0000","last_became_active":"2024-09-17T05:51:15.349457+0000","last_became_peered":"2024-09-17T05:51:15.349457+0000","last_unstale":"2024-09-17T05:51:16.750534+0000","last_undegraded":"2024-09-17T05:51:16.750534+0000","last_fullsized":"2024-09-17T05:51:16.750534+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:51:14.325451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:51:14.325451+0000","last_clean_scrub_stamp":"2024-09-17T05:51:14.325451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:08:40.638937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.39","version":"0'0","reported_seq":13,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-17T05:51:16.360003+0000","last_change":"2024-09-17T05:51:15.358171+0000","last_active":"2024-09-17T05:51:16.360003+0000","last_peered":"2024-09-17T05:51:16.360003+0000","last_clean":"2024-09-17T05:51:16.360003+0000","last_became_active":"2024-09-17T05:51:15.357838+0000","last_became_peered":"2024-09-17T05:51:15.357838+0000","last_unstale":"2024-09-17T05:51:16.360003+0000","last_undegraded":"2024-09-17T05:51:16.360003+0000","last_fullsized":"2024-09-17T05:51:16.360003+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:51:14.325451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:51:14.325451+0000","last_clean_scrub_stamp":"2024-09-17T05:51:14.325451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:20:00.031149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.38","version":"0'0","reported_seq":13,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-17T05:51:16.750342+0000","last_change":"2024-09-17T05:51:15.361077+0000","last_active":"2024-09-17T05:51:16.750342+0000","last_peered":"2024-09-17T05:51:16.750342+0000","last_clean":"2024-09-17T05:51:16.750342+0000","last_became_active":"2024-09-17T05:51:15.359954+0000","last_became_peered":"2024-09-17T05:51:15.359954+0000","last_unstale":"2024-09-17T05:51:16.750342+0000","last_undegraded":"2024-09-17T05:51:16.750342+0000","last_fullsized":"2024-09-17T05:51:16.750342+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:51:14.325451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:51:14.325451+0000","last_clean_scrub_stamp":"2024-09-17T05:51:14.325451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:40:17.074211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:51:14.325451+0000","last_change":"2024-09-17T05:51:14.325451+0000","last_active":"2024-09-17T05:51:14.325451+0000","last_peered":"2024-09-17T05:51:14.325451+0000","last_clean":"2024-09-17T05:51:14.325451+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:51:14.325451+0000","last_undegraded":"2024-09-17T05:51:14.325451+0000","last_fullsized":"2024-09-17T05:51:14.325451+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:51:14.325451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:51:14.325451+0000","last_clean_scrub_stamp":"2024-09-17T05:51:14.325451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:51:14.325451+0000","last_change":"2024-09-17T05:51:14.325451+0000","last_active":"2024-09-17T05:51:14.325451+0000","last_peered":"2024-09-17T05:51:14.325451+0000","last_clean":"2024-09-17T05:51:14.325451+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:51:14.325451+0000","last_undegraded":"2024-09-17T05:51:14.325451+0000","last_fullsized":"2024-09-17T05:51:14.325451+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:51:14.325451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:51:14.325451+0000","last_clean_scrub_stamp":"2024-09-17T05:51:14.325451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.35","version":"0'0","reported_seq":13,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-17T05:51:16.341088+0000","last_change":"2024-09-17T05:51:15.353391+0000","last_active":"2024-09-17T05:51:16.341088+0000","last_peered":"2024-09-17T05:51:16.341088+0000","last_clean":"2024-09-17T05:51:16.341088+0000","last_became_active":"2024-09-17T05:51:15.353075+0000","last_became_peered":"2024-09-17T05:51:15.353075+0000","last_unstale":"2024-09-17T05:51:16.341088+0000","last_undegraded":"2024-09-17T05:51:16.341088+0000","last_fullsized":"2024-09-17T05:51:16.341088+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:51:14.325451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:51:14.325451+0000","last_clean_scrub_stamp":"2024-09-17T05:51:14.325451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:35:01.866394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:51:14.325451+0000","last_change":"2024-09-17T05:51:14.325451+0000","last_active":"2024-09-17T05:51:14.325451+0000","last_peered":"2024-09-17T05:51:14.325451+0000","last_clean":"2024-09-17T05:51:14.325451+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:51:14.325451+0000","last_undegraded":"2024-09-17T05:51:14.325451+0000","last_fullsized":"2024-09-17T05:51:14.325451+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:51:14.325451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:51:14.325451+0000","last_clean_scrub_stamp":"2024-09-17T05:51:14.325451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.33","version":"0'0","reported_seq":13,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-17T05:51:16.750511+0000","last_change":"2024-09-17T05:51:15.356651+0000","last_active":"2024-09-17T05:51:16.750511+0000","last_peered":"2024-09-17T05:51:16.750511+0000","last_clean":"2024-09-17T05:51:16.750511+0000","last_became_active":"2024-09-17T05:51:15.356329+0000","last_became_peered":"2024-09-17T05:51:15.356329+0000","last_unstale":"2024-09-17T05:51:16.750511+0000","last_undegraded":"2024-09-17T05:51:16.750511+0000","last_fullsized":"2024-09-17T05:51:16.750511+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:51:14.325451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:51:14.325451+0000","last_clean_scrub_stamp":"2024-09-17T05:51:14.325451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:40:43.043320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.32","version":"0'0","reported_seq":13,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-17T05:51:16.750261+0000","last_change":"2024-09-17T05:51:15.358138+0000","last_active":"2024-09-17T05:51:16.750261+0000","last_peered":"2024-09-17T05:51:16.750261+0000","last_clean":"2024-09-17T05:51:16.750261+0000","last_became_active":"2024-09-17T05:51:15.357839+0000","last_became_peered":"2024-09-17T05:51:15.357839+0000","last_unstale":"2024-09-17T05:51:16.750261+0000","last_undegraded":"2024-09-17T05:51:16.750261+0000","last_fullsized":"2024-09-17T05:51:16.750261+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:51:14.325451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:51:14.325451+0000","last_clean_scrub_stamp":"2024-09-17T05:51:14.325451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:31:24.479375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.31","version":"0'0","reported_seq":13,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-17T05:51:16.749988+0000","last_change":"2024-09-17T05:51:15.349182+0000","last_active":"2024-09-17T05:51:16.749988+0000","last_peered":"2024-09-17T05:51:16.749988+0000","last_clean":"2024-09-17T05:51:16.749988+0000","last_became_active":"2024-09-17T05:51:15.348875+0000","last_became_peered":"2024-09-17T05:51:15.348875+0000","last_unstale":"2024-09-17T05:51:16.749988+0000","last_undegraded":"2024-09-17T05:51:16.749988+0000","last_fullsized":"2024-09-17T05:51:16.749988+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:51:14.325451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:51:14.325451+0000","last_clean_scrub_stamp":"2024-09-17T05:51:14.325451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:32:59.139253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:51:14.325451+0000","last_change":"2024-09-17T05:51:14.325451+0000","last_active":"2024-09-17T05:51:14.325451+0000","last_peered":"2024-09-17T05:51:14.325451+0000","last_clean":"2024-09-17T05:51:14.325451+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:51:14.325451+0000","last_undegraded":"2024-09-17T05:51:14.325451+0000","last_fullsized":"2024-09-17T05:51:14.325451+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:51:14.325451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:51:14.325451+0000","last_clean_scrub_stamp":"2024-09-17T05:51:14.325451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.2f","version":"0'0","reported_seq":13,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-17T05:51:16.340854+0000","last_change":"2024-09-17T05:51:15.356819+0000","last_active":"2024-09-17T05:51:16.340854+0000","last_peered":"2024-09-17T05:51:16.340854+0000","last_clean":"2024-09-17T05:51:16.340854+0000","last_became_active":"2024-09-17T05:51:15.355786+0000","last_became_peered":"2024-09-17T05:51:15.355786+0000","last_unstale":"2024-09-17T05:51:16.340854+0000","last_undegraded":"2024-09-17T05:51:16.340854+0000","last_fullsized":"2024-09-17T05:51:16.340854+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:51:14.325451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:51:14.325451+0000","last_clean_scrub_stamp":"2024-09-17T05:51:14.325451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:41:26.394405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.2e","version":"0'0","reported_seq":13,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-17T05:51:16.357401+0000","last_change":"2024-09-17T05:51:15.355528+0000","last_active":"2024-09-17T05:51:16.357401+0000","last_peered":"2024-09-17T05:51:16.357401+0000","last_clean":"2024-09-17T05:51:16.357401+0000","last_became_active":"2024-09-17T05:51:15.355205+0000","last_became_peered":"2024-09-17T05:51:15.355205+0000","last_unstale":"2024-09-17T05:51:16.357401+0000","last_undegraded":"2024-09-17T05:51:16.357401+0000","last_fullsized":"2024-09-17T05:51:16.357401+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:51:14.325451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:51:14.325451+0000","last_clean_scrub_stamp":"2024-09-17T05:51:14.325451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:59:59.333951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.2d","version":"0'0","reported_seq":13,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-17T05:51:16.750770+0000","last_change":"2024-09-17T05:51:15.357170+0000","last_active":"2024-09-17T05:51:16.750770+0000","last_peered":"2024-09-17T05:51:16.750770+0000","last_clean":"2024-09-17T05:51:16.750770+0000","last_became_active":"2024-09-17T05:51:15.356347+0000","last_became_peered":"2024-09-17T05:51:15.356347+0000","last_unstale":"2024-09-17T05:51:16.750770+0000","last_undegraded":"2024-09-17T05:51:16.750770+0000","last_fullsized":"2024-09-17T05:51:16.750770+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:51:14.325451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:51:14.325451+0000","last_clean_scrub_stamp":"2024-09-17T05:51:14.325451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:39:17.891657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.2c","version":"0'0","reported_seq":13,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-17T05:51:16.341037+0000","last_change":"2024-09-17T05:51:15.351757+0000","last_active":"2024-09-17T05:51:16.341037+0000","last_peered":"2024-09-17T05:51:16.341037+0000","last_clean":"2024-09-17T05:51:16.341037+0000","last_became_active":"2024-09-17T05:51:15.351451+0000","last_became_peered":"2024-09-17T05:51:15.351451+0000","last_unstale":"2024-09-17T05:51:16.341037+0000","last_undegraded":"2024-09-17T05:51:16.341037+0000","last_fullsized":"2024-09-17T05:51:16.341037+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:51:14.325451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:51:14.325451+0000","last_clean_scrub_stamp":"2024-09-17T05:51:14.325451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:02:50.463096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.2b","version":"0'0","reported_seq":13,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-17T05:51:16.341258+0000","last_change":"2024-09-17T05:51:15.343820+0000","last_active":"2024-09-17T05:51:16.341258+0000","last_peered":"2024-09-17T05:51:16.341258+0000","last_clean":"2024-09-17T05:51:16.341258+0000","last_became_active":"2024-09-17T05:51:15.343446+0000","last_became_peered":"2024-09-17T05:51:15.343446+0000","last_unstale":"2024-09-17T05:51:16.341258+0000","last_undegraded":"2024-09-17T05:51:16.341258+0000","last_fullsized":"2024-09-17T05:51:16.341258+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:51:14.325451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:51:14.325451+0000","last_clean_scrub_stamp":"2024-09-17T05:51:14.325451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:01:59.401335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.2a","version":"0'0","reported_seq":13,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-17T05:51:16.340834+0000","last_change":"2024-09-17T05:51:15.347950+0000","last_active":"2024-09-17T05:51:16.340834+0000","last_peered":"2024-09-17T05:51:16.340834+0000","last_clean":"2024-09-17T05:51:16.340834+0000","last_became_active":"2024-09-17T05:51:15.347234+0000","last_became_peered":"2024-09-17T05:51:15.347234+0000","last_unstale":"2024-09-17T05:51:16.340834+0000","last_undegraded":"2024-09-17T05:51:16.340834+0000","last_fullsized":"2024-09-17T05:51:16.340834+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:51:14.325451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:51:14.325451+0000","last_clean_scrub_stamp":"2024-09-17T05:51:14.325451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:25:47.876263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.29","version":"0'0","reported_seq":13,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-17T05:51:16.340293+0000","last_change":"2024-09-17T05:51:15.351107+0000","last_active":"2024-09-17T05:51:16.340293+0000","last_peered":"2024-09-17T05:51:16.340293+0000","last_clean":"2024-09-17T05:51:16.340293+0000","last_became_active":"2024-09-17T05:51:15.350800+0000","last_became_peered":"2024-09-17T05:51:15.350800+0000","last_unstale":"2024-09-17T05:51:16.340293+0000","last_undegraded":"2024-09-17T05:51:16.340293+0000","last_fullsized":"2024-09-17T05:51:16.340293+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:51:14.325451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:51:14.325451+0000","last_clean_scrub_stamp":"2024-09-17T05:51:14.325451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:54:30.680562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.28","version":"0'0","reported_seq":13,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-17T05:51:16.340277+0000","last_change":"2024-09-17T05:51:15.352451+0000","last_active":"2024-09-17T05:51:16.340277+0000","last_peered":"2024-09-17T05:51:16.340277+0000","last_clean":"2024-09-17T05:51:16.340277+0000","last_became_active":"2024-09-17T05:51:15.351461+0000","last_became_peered":"2024-09-17T05:51:15.351461+0000","last_unstale":"2024-09-17T05:51:16.340277+0000","last_undegraded":"2024-09-17T05:51:16.340277+0000","last_fullsized":"2024-09-17T05:51:16.340277+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:51:14.325451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:51:14.325451+0000","last_clean_scrub_stamp":"2024-09-17T05:51:14.325451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:07:01.411755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.27","version":"0'0","reported_seq":13,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-17T05:51:16.340985+0000","last_change":"2024-09-17T05:51:15.356473+0000","last_active":"2024-09-17T05:51:16.340985+0000","last_peered":"2024-09-17T05:51:16.340985+0000","last_clean":"2024-09-17T05:51:16.340985+0000","last_became_active":"2024-09-17T05:51:15.355395+0000","last_became_peered":"2024-09-17T05:51:15.355395+0000","last_unstale":"2024-09-17T05:51:16.340985+0000","last_undegraded":"2024-09-17T05:51:16.340985+0000","last_fullsized":"2024-09-17T05:51:16.340985+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:51:14.325451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:51:14.325451+0000","last_clean_scrub_stamp":"2024-09-17T05:51:14.325451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:45:35.715638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:51:14.325451+0000","last_change":"2024-09-17T05:51:14.325451+0000","last_active":"2024-09-17T05:51:14.325451+0000","last_peered":"2024-09-17T05:51:14.325451+0000","last_clean":"2024-09-17T05:51:14.325451+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:51:14.325451+0000","last_undegraded":"2024-09-17T05:51:14.325451+0000","last_fullsized":"2024-09-17T05:51:14.325451+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:51:14.325451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:51:14.325451+0000","last_clean_scrub_stamp":"2024-09-17T05:51:14.325451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.25","version":"0'0","reported_seq":13,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-17T05:51:16.750795+0000","last_change":"2024-09-17T05:51:15.350114+0000","last_active":"2024-09-17T05:51:16.750795+0000","last_peered":"2024-09-17T05:51:16.750795+0000","last_clean":"2024-09-17T05:51:16.750795+0000","last_became_active":"2024-09-17T05:51:15.349717+0000","last_became_peered":"2024-09-17T05:51:15.349717+0000","last_unstale":"2024-09-17T05:51:16.750795+0000","last_undegraded":"2024-09-17T05:51:16.750795+0000","last_fullsized":"2024-09-17T05:51:16.750795+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:51:14.325451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:51:14.325451+0000","last_clean_scrub_stamp":"2024-09-17T05:51:14.325451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:18:04.873879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.24","version":"0'0","reported_seq":13,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-17T05:51:16.340958+0000","last_change":"2024-09-17T05:51:15.354301+0000","last_active":"2024-09-17T05:51:16.340958+0000","last_peered":"2024-09-17T05:51:16.340958+0000","last_clean":"2024-09-17T05:51:16.340958+0000","last_became_active":"2024-09-17T05:51:15.353951+0000","last_became_peered":"2024-09-17T05:51:15.353951+0000","last_unstale":"2024-09-17T05:51:16.340958+0000","last_undegraded":"2024-09-17T05:51:16.340958+0000","last_fullsized":"2024-09-17T05:51:16.340958+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:51:14.325451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:51:14.325451+0000","last_clean_scrub_stamp":"2024-09-17T05:51:14.325451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:59:08.824529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.23","version":"0'0","reported_seq":13,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-17T05:51:16.340611+0000","last_change":"2024-09-17T05:51:15.352151+0000","last_active":"2024-09-17T05:51:16.340611+0000","last_peered":"2024-09-17T05:51:16.340611+0000","last_clean":"2024-09-17T05:51:16.340611+0000","last_became_active":"2024-09-17T05:51:15.350686+0000","last_became_peered":"2024-09-17T05:51:15.350686+0000","last_unstale":"2024-09-17T05:51:16.340611+0000","last_undegraded":"2024-09-17T05:51:16.340611+0000","last_fullsized":"2024-09-17T05:51:16.340611+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:51:14.325451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:51:14.325451+0000","last_clean_scrub_stamp":"2024-09-17T05:51:14.325451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:43:23.785414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.22","version":"0'0","reported_seq":13,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-17T05:51:16.360088+0000","last_change":"2024-09-17T05:51:15.341975+0000","last_active":"2024-09-17T05:51:16.360088+0000","last_peered":"2024-09-17T05:51:16.360088+0000","last_clean":"2024-09-17T05:51:16.360088+0000","last_became_active":"2024-09-17T05:51:15.341693+0000","last_became_peered":"2024-09-17T05:51:15.341693+0000","last_unstale":"2024-09-17T05:51:16.360088+0000","last_undegraded":"2024-09-17T05:51:16.360088+0000","last_fullsized":"2024-09-17T05:51:16.360088+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:51:14.325451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:51:14.325451+0000","last_clean_scrub_stamp":"2024-09-17T05:51:14.325451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:09:41.960133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:51:14.325451+0000","last_change":"2024-09-17T05:51:14.325451+0000","last_active":"2024-09-17T05:51:14.325451+0000","last_peered":"2024-09-17T05:51:14.325451+0000","last_clean":"2024-09-17T05:51:14.325451+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:51:14.325451+0000","last_undegraded":"2024-09-17T05:51:14.325451+0000","last_fullsized":"2024-09-17T05:51:14.325451+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:51:14.325451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:51:14.325451+0000","last_clean_scrub_stamp":"2024-09-17T05:51:14.325451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.20","version":"0'0","reported_seq":13,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-17T05:51:16.749919+0000","last_change":"2024-09-17T05:51:15.352088+0000","last_active":"2024-09-17T05:51:16.749919+0000","last_peered":"2024-09-17T05:51:16.749919+0000","last_clean":"2024-09-17T05:51:16.749919+0000","last_became_active":"2024-09-17T05:51:15.347745+0000","last_became_peered":"2024-09-17T05:51:15.347745+0000","last_unstale":"2024-09-17T05:51:16.749919+0000","last_undegraded":"2024-09-17T05:51:16.749919+0000","last_fullsized":"2024-09-17T05:51:16.749919+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:51:14.325451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:51:14.325451+0000","last_clean_scrub_stamp":"2024-09-17T05:51:14.325451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:00:48.024653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.1e","version":"0'0","reported_seq":13,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-17T05:51:16.751289+0000","last_change":"2024-09-17T05:51:15.356066+0000","last_active":"2024-09-17T05:51:16.751289+0000","last_peered":"2024-09-17T05:51:16.751289+0000","last_clean":"2024-09-17T05:51:16.751289+0000","last_became_active":"2024-09-17T05:51:15.355748+0000","last_became_peered":"2024-09-17T05:51:15.355748+0000","last_unstale":"2024-09-17T05:51:16.751289+0000","last_undegraded":"2024-09-17T05:51:16.751289+0000","last_fullsized":"2024-09-17T05:51:16.751289+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:51:14.325451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:51:14.325451+0000","last_clean_scrub_stamp":"2024-09-17T05:51:14.325451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:54:46.604153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.1f","version":"112'4","reported_seq":19,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-17T05:51:16.360144+0000","last_change":"2024-09-17T05:51:14.352310+0000","last_active":"2024-09-17T05:51:16.360144+0000","last_peered":"2024-09-17T05:51:16.360144+0000","last_clean":"2024-09-17T05:51:16.360144+0000","last_became_active":"2024-09-17T05:51:14.351942+0000","last_became_peered":"2024-09-17T05:51:14.351942+0000","last_unstale":"2024-09-17T05:51:16.360144+0000","last_undegraded":"2024-09-17T05:51:16.360144+0000","last_fullsized":"2024-09-17T05:51:16.360144+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:51:13.315624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:51:13.315624+0000","last_clean_scrub_stamp":"2024-09-17T05:51:13.315624+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:00:47.014826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.1f","version":"0'0","reported_seq":13,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-17T05:51:16.357652+0000","last_change":"2024-09-17T05:51:15.352409+0000","last_active":"2024-09-17T05:51:16.357652+0000","last_peered":"2024-09-17T05:51:16.357652+0000","last_clean":"2024-09-17T05:51:16.357652+0000","last_became_active":"2024-09-17T05:51:15.352109+0000","last_became_peered":"2024-09-17T05:51:15.352109+0000","last_unstale":"2024-09-17T05:51:16.357652+0000","last_undegraded":"2024-09-17T05:51:16.357652+0000","last_fullsized":"2024-09-17T05:51:16.357652+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:51:14.325451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:51:14.325451+0000","last_clean_scrub_stamp":"2024-09-17T05:51:14.325451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:46:13.487513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.1e","version":"112'1","reported_seq":16,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-17T05:51:16.750344+0000","last_change":"2024-09-17T05:51:14.354672+0000","last_active":"2024-09-17T05:51:16.750344+0000","last_peered":"2024-09-17T05:51:16.750344+0000","last_clean":"2024-09-17T05:51:16.750344+0000","last_became_active":"2024-09-17T05:51:14.354096+0000","last_became_peered":"2024-09-17T05:51:14.354096+0000","last_unstale":"2024-09-17T05:51:16.750344+0000","last_undegraded":"2024-09-17T05:51:16.750344+0000","last_fullsized":"2024-09-17T05:51:16.750344+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:51:13.315624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:51:13.315624+0000","last_clean_scrub_stamp":"2024-09-17T05:51:13.315624+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:16:54.432517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.1c","version":"0'0","reported_seq":13,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-17T05:51:16.751166+0000","last_change":"2024-09-17T05:51:15.349713+0000","last_active":"2024-09-17T05:51:16.751166+0000","last_peered":"2024-09-17T05:51:16.751166+0000","last_clean":"2024-09-17T05:51:16.751166+0000","last_became_active":"2024-09-17T05:51:15.347772+0000","last_became_peered":"2024-09-17T05:51:15.347772+0000","last_unstale":"2024-09-17T05:51:16.751166+0000","last_undegraded":"2024-09-17T05:51:16.751166+0000","last_fullsized":"2024-09-17T05:51:16.751166+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:51:14.325451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:51:14.325451+0000","last_clean_scrub_stamp":"2024-09-17T05:51:14.325451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:23:35.566877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.1d","version":"112'2","reported_seq":17,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-17T05:51:16.339750+0000","last_change":"2024-09-17T05:51:14.353746+0000","last_active":"2024-09-17T05:51:16.339750+0000","last_peered":"2024-09-17T05:51:16.339750+0000","last_clean":"2024-09-17T05:51:16.339750+0000","last_became_active":"2024-09-17T05:51:14.353437+0000","last_became_peered":"2024-09-17T05:51:14.353437+0000","last_unstale":"2024-09-17T05:51:16.339750+0000","last_undegraded":"2024-09-17T05:51:16.339750+0000","last_fullsized":"2024-09-17T05:51:16.339750+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:51:13.315624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:51:13.315624+0000","last_clean_scrub_stamp":"2024-09-17T05:51:13.315624+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:05:50.149362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.1d","version":"0'0","reported_seq":13,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-17T05:51:16.750902+0000","last_change":"2024-09-17T05:51:15.359061+0000","last_active":"2024-09-17T05:51:16.750902+0000","last_peered":"2024-09-17T05:51:16.750902+0000","last_clean":"2024-09-17T05:51:16.750902+0000","last_became_active":"2024-09-17T05:51:15.358754+0000","last_became_peered":"2024-09-17T05:51:15.358754+0000","last_unstale":"2024-09-17T05:51:16.750902+0000","last_undegraded":"2024-09-17T05:51:16.750902+0000","last_fullsized":"2024-09-17T05:51:16.750902+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:51:14.325451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:51:14.325451+0000","last_clean_scrub_stamp":"2024-09-17T05:51:14.325451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:43:11.980324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.1c","version":"112'2","reported_seq":17,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-17T05:51:16.339897+0000","last_change":"2024-09-17T05:51:14.349011+0000","last_active":"2024-09-17T05:51:16.339897+0000","last_peered":"2024-09-17T05:51:16.339897+0000","last_clean":"2024-09-17T05:51:16.339897+0000","last_became_active":"2024-09-17T05:51:14.348713+0000","last_became_peered":"2024-09-17T05:51:14.348713+0000","last_unstale":"2024-09-17T05:51:16.339897+0000","last_undegraded":"2024-09-17T05:51:16.339897+0000","last_fullsized":"2024-09-17T05:51:16.339897+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:51:13.315624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:51:13.315624+0000","last_clean_scrub_stamp":"2024-09-17T05:51:13.315624+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:57:40.589853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:51:14.325451+0000","last_change":"2024-09-17T05:51:14.325451+0000","last_active":"2024-09-17T05:51:14.325451+0000","last_peered":"2024-09-17T05:51:14.325451+0000","last_clean":"2024-09-17T05:51:14.325451+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:51:14.325451+0000","last_undegraded":"2024-09-17T05:51:14.325451+0000","last_fullsized":"2024-09-17T05:51:14.325451+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:51:14.325451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:51:14.325451+0000","last_clean_scrub_stamp":"2024-09-17T05:51:14.325451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.1b","version":"112'1","reported_seq":16,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-17T05:51:16.359714+0000","last_change":"2024-09-17T05:51:14.354735+0000","last_active":"2024-09-17T05:51:16.359714+0000","last_peered":"2024-09-17T05:51:16.359714+0000","last_clean":"2024-09-17T05:51:16.359714+0000","last_became_active":"2024-09-17T05:51:14.354173+0000","last_became_peered":"2024-09-17T05:51:14.354173+0000","last_unstale":"2024-09-17T05:51:16.359714+0000","last_undegraded":"2024-09-17T05:51:16.359714+0000","last_fullsized":"2024-09-17T05:51:16.359714+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:51:13.315624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:51:13.315624+0000","last_clean_scrub_stamp":"2024-09-17T05:51:13.315624+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:55:41.195206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.1b","version":"0'0","reported_seq":13,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-17T05:51:16.340908+0000","last_change":"2024-09-17T05:51:15.344677+0000","last_active":"2024-09-17T05:51:16.340908+0000","last_peered":"2024-09-17T05:51:16.340908+0000","last_clean":"2024-09-17T05:51:16.340908+0000","last_became_active":"2024-09-17T05:51:15.344361+0000","last_became_peered":"2024-09-17T05:51:15.344361+0000","last_unstale":"2024-09-17T05:51:16.340908+0000","last_undegraded":"2024-09-17T05:51:16.340908+0000","last_fullsized":"2024-09-17T05:51:16.340908+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:51:14.325451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:51:14.325451+0000","last_clean_scrub_stamp":"2024-09-17T05:51:14.325451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:21:22.687943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.1a","version":"112'1","reported_seq":16,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-17T05:51:16.341177+0000","last_change":"2024-09-17T05:51:14.353138+0000","last_active":"2024-09-17T05:51:16.341177+0000","last_peered":"2024-09-17T05:51:16.341177+0000","last_clean":"2024-09-17T05:51:16.341177+0000","last_became_active":"2024-09-17T05:51:14.352671+0000","last_became_peered":"2024-09-17T05:51:14.352671+0000","last_unstale":"2024-09-17T05:51:16.341177+0000","last_undegraded":"2024-09-17T05:51:16.341177+0000","last_fullsized":"2024-09-17T05:51:16.341177+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:51:13.315624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:51:13.315624+0000","last_clean_scrub_stamp":"2024-09-17T05:51:13.315624+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:05:44.644453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:51:14.325451+0000","last_change":"2024-09-17T05:51:14.325451+0000","last_active":"2024-09-17T05:51:14.325451+0000","last_peered":"2024-09-17T05:51:14.325451+0000","last_clean":"2024-09-17T05:51:14.325451+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:51:14.325451+0000","last_undegraded":"2024-09-17T05:51:14.325451+0000","last_fullsized":"2024-09-17T05:51:14.325451+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:51:14.325451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:51:14.325451+0000","last_clean_scrub_stamp":"2024-09-17T05:51:14.325451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.19","version":"0'0","reported_seq":15,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-17T05:51:16.340804+0000","last_change":"2024-09-17T05:51:14.356410+0000","last_active":"2024-09-17T05:51:16.340804+0000","last_peered":"2024-09-17T05:51:16.340804+0000","last_clean":"2024-09-17T05:51:16.340804+0000","last_became_active":"2024-09-17T05:51:14.356114+0000","last_became_peered":"2024-09-17T05:51:14.356114+0000","last_unstale":"2024-09-17T05:51:16.340804+0000","last_undegraded":"2024-09-17T05:51:16.340804+0000","last_fullsized":"2024-09-17T05:51:16.340804+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:51:13.315624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:51:13.315624+0000","last_clean_scrub_stamp":"2024-09-17T05:51:13.315624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:27:31.390355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.19","version":"0'0","reported_seq":13,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-17T05:51:16.359869+0000","last_change":"2024-09-17T05:51:15.358103+0000","last_active":"2024-09-17T05:51:16.359869+0000","last_peered":"2024-09-17T05:51:16.359869+0000","last_clean":"2024-09-17T05:51:16.359869+0000","last_became_active":"2024-09-17T05:51:15.357513+0000","last_became_peered":"2024-09-17T05:51:15.357513+0000","last_unstale":"2024-09-17T05:51:16.359869+0000","last_undegraded":"2024-09-17T05:51:16.359869+0000","last_fullsized":"2024-09-17T05:51:16.359869+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:51:14.325451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:51:14.325451+0000","last_clean_scrub_stamp":"2024-09-17T05:51:14.325451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:51:39.791185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.18","version":"0'0","reported_seq":1,"reported_epoch":110,"state":"creating+peering","last_fresh":"2024-09-17T05:51:13.333713+0000","last_change":"2024-09-17T05:51:13.333713+0000","last_active":"2024-09-17T05:51:13.315624+0000","last_peered":"2024-09-17T05:51:13.315624+0000","last_clean":"2024-09-17T05:51:13.315624+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:51:13.333713+0000","last_undegraded":"2024-09-17T05:51:13.333713+0000","last_fullsized":"2024-09-17T05:51:13.333713+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:51:13.315624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:51:13.315624+0000","last_clean_scrub_stamp":"2024-09-17T05:51:13.315624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.16","version":"0'0","reported_seq":13,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-17T05:51:16.360215+0000","last_change":"2024-09-17T05:51:15.357705+0000","last_active":"2024-09-17T05:51:16.360215+0000","last_peered":"2024-09-17T05:51:16.360215+0000","last_clean":"2024-09-17T05:51:16.360215+0000","last_became_active":"2024-09-17T05:51:15.357029+0000","last_became_peered":"2024-09-17T05:51:15.357029+0000","last_unstale":"2024-09-17T05:51:16.360215+0000","last_undegraded":"2024-09-17T05:51:16.360215+0000","last_fullsized":"2024-09-17T05:51:16.360215+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:51:14.325451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:51:14.325451+0000","last_clean_scrub_stamp":"2024-09-17T05:51:14.325451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:29:03.820460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.17","version":"0'0","reported_seq":15,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-17T05:51:16.339454+0000","last_change":"2024-09-17T05:51:14.353904+0000","last_active":"2024-09-17T05:51:16.339454+0000","last_peered":"2024-09-17T05:51:16.339454+0000","last_clean":"2024-09-17T05:51:16.339454+0000","last_became_active":"2024-09-17T05:51:14.353591+0000","last_became_peered":"2024-09-17T05:51:14.353591+0000","last_unstale":"2024-09-17T05:51:16.339454+0000","last_undegraded":"2024-09-17T05:51:16.339454+0000","last_fullsized":"2024-09-17T05:51:16.339454+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:51:13.315624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:51:13.315624+0000","last_clean_scrub_stamp":"2024-09-17T05:51:13.315624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:13:44.186310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.17","version":"0'0","reported_seq":13,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-17T05:51:16.357574+0000","last_change":"2024-09-17T05:51:15.361884+0000","last_active":"2024-09-17T05:51:16.357574+0000","last_peered":"2024-09-17T05:51:16.357574+0000","last_clean":"2024-09-17T05:51:16.357574+0000","last_became_active":"2024-09-17T05:51:15.361562+0000","last_became_peered":"2024-09-17T05:51:15.361562+0000","last_unstale":"2024-09-17T05:51:16.357574+0000","last_undegraded":"2024-09-17T05:51:16.357574+0000","last_fullsized":"2024-09-17T05:51:16.357574+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:51:14.325451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:51:14.325451+0000","last_clean_scrub_stamp":"2024-09-17T05:51:14.325451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:46:55.155567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.16","version":"0'0","reported_seq":15,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-17T05:51:16.340693+0000","last_change":"2024-09-17T05:51:14.351671+0000","last_active":"2024-09-17T05:51:16.340693+0000","last_peered":"2024-09-17T05:51:16.340693+0000","last_clean":"2024-09-17T05:51:16.340693+0000","last_became_active":"2024-09-17T05:51:14.351378+0000","last_became_peered":"2024-09-17T05:51:14.351378+0000","last_unstale":"2024-09-17T05:51:16.340693+0000","last_undegraded":"2024-09-17T05:51:16.340693+0000","last_fullsized":"2024-09-17T05:51:16.340693+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:51:13.315624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:51:13.315624+0000","last_clean_scrub_stamp":"2024-09-17T05:51:13.315624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:13:21.431979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.14","version":"0'0","reported_seq":13,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-17T05:51:16.341035+0000","last_change":"2024-09-17T05:51:15.348925+0000","last_active":"2024-09-17T05:51:16.341035+0000","last_peered":"2024-09-17T05:51:16.341035+0000","last_clean":"2024-09-17T05:51:16.341035+0000","last_became_active":"2024-09-17T05:51:15.348098+0000","last_became_peered":"2024-09-17T05:51:15.348098+0000","last_unstale":"2024-09-17T05:51:16.341035+0000","last_undegraded":"2024-09-17T05:51:16.341035+0000","last_fullsized":"2024-09-17T05:51:16.341035+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:51:14.325451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:51:14.325451+0000","last_clean_scrub_stamp":"2024-09-17T05:51:14.325451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:45:04.503729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.15","version":"0'0","reported_seq":1,"reported_epoch":110,"state":"creating+peering","last_fresh":"2024-09-17T05:51:13.333287+0000","last_change":"2024-09-17T05:51:13.333287+0000","last_active":"2024-09-17T05:51:13.315624+0000","last_peered":"2024-09-17T05:51:13.315624+0000","last_clean":"2024-09-17T05:51:13.315624+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:51:13.333287+0000","last_undegraded":"2024-09-17T05:51:13.333287+0000","last_fullsized":"2024-09-17T05:51:13.333287+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:51:13.315624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:51:13.315624+0000","last_clean_scrub_stamp":"2024-09-17T05:51:13.315624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.15","version":"0'0","reported_seq":13,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-17T05:51:16.359997+0000","last_change":"2024-09-17T05:51:15.354430+0000","last_active":"2024-09-17T05:51:16.359997+0000","last_peered":"2024-09-17T05:51:16.359997+0000","last_clean":"2024-09-17T05:51:16.359997+0000","last_became_active":"2024-09-17T05:51:15.353340+0000","last_became_peered":"2024-09-17T05:51:15.353340+0000","last_unstale":"2024-09-17T05:51:16.359997+0000","last_undegraded":"2024-09-17T05:51:16.359997+0000","last_fullsized":"2024-09-17T05:51:16.359997+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:51:14.325451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:51:14.325451+0000","last_clean_scrub_stamp":"2024-09-17T05:51:14.325451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:06:33.197462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.14","version":"0'0","reported_seq":1,"reported_epoch":110,"state":"creating+peering","last_fresh":"2024-09-17T05:51:13.332882+0000","last_change":"2024-09-17T05:51:13.332882+0000","last_active":"2024-09-17T05:51:13.315624+0000","last_peered":"2024-09-17T05:51:13.315624+0000","last_clean":"2024-09-17T05:51:13.315624+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:51:13.332882+0000","last_undegraded":"2024-09-17T05:51:13.332882+0000","last_fullsized":"2024-09-17T05:51:13.332882+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:51:13.315624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:51:13.315624+0000","last_clean_scrub_stamp":"2024-09-17T05:51:13.315624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.12","version":"0'0","reported_seq":13,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-17T05:51:16.341056+0000","last_change":"2024-09-17T05:51:15.343838+0000","last_active":"2024-09-17T05:51:16.341056+0000","last_peered":"2024-09-17T05:51:16.341056+0000","last_clean":"2024-09-17T05:51:16.341056+0000","last_became_active":"2024-09-17T05:51:15.342425+0000","last_became_peered":"2024-09-17T05:51:15.342425+0000","last_unstale":"2024-09-17T05:51:16.341056+0000","last_undegraded":"2024-09-17T05:51:16.341056+0000","last_fullsized":"2024-09-17T05:51:16.341056+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:51:14.325451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:51:14.325451+0000","last_clean_scrub_stamp":"2024-09-17T05:51:14.325451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:38:28.098850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.13","version":"112'2","reported_seq":17,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-17T05:51:16.750889+0000","last_change":"2024-09-17T05:51:14.351875+0000","last_active":"2024-09-17T05:51:16.750889+0000","last_peered":"2024-09-17T05:51:16.750889+0000","last_clean":"2024-09-17T05:51:16.750889+0000","last_became_active":"2024-09-17T05:51:14.351584+0000","last_became_peered":"2024-09-17T05:51:14.351584+0000","last_unstale":"2024-09-17T05:51:16.750889+0000","last_undegraded":"2024-09-17T05:51:16.750889+0000","last_fullsized":"2024-09-17T05:51:16.750889+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:51:13.315624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:51:13.315624+0000","last_clean_scrub_stamp":"2024-09-17T05:51:13.315624+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:32:52.271894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.13","version":"0'0","reported_seq":13,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-17T05:51:16.340808+0000","last_change":"2024-09-17T05:51:15.352070+0000","last_active":"2024-09-17T05:51:16.340808+0000","last_peered":"2024-09-17T05:51:16.340808+0000","last_clean":"2024-09-17T05:51:16.340808+0000","last_became_active":"2024-09-17T05:51:15.351799+0000","last_became_peered":"2024-09-17T05:51:15.351799+0000","last_unstale":"2024-09-17T05:51:16.340808+0000","last_undegraded":"2024-09-17T05:51:16.340808+0000","last_fullsized":"2024-09-17T05:51:16.340808+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:51:14.325451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:51:14.325451+0000","last_clean_scrub_stamp":"2024-09-17T05:51:14.325451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:10:29.943649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.12","version":"0'0","reported_seq":15,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-17T05:51:16.357130+0000","last_change":"2024-09-17T05:51:14.358185+0000","last_active":"2024-09-17T05:51:16.357130+0000","last_peered":"2024-09-17T05:51:16.357130+0000","last_clean":"2024-09-17T05:51:16.357130+0000","last_became_active":"2024-09-17T05:51:14.357918+0000","last_became_peered":"2024-09-17T05:51:14.357918+0000","last_unstale":"2024-09-17T05:51:16.357130+0000","last_undegraded":"2024-09-17T05:51:16.357130+0000","last_fullsized":"2024-09-17T05:51:16.357130+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:51:13.315624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:51:13.315624+0000","last_clean_scrub_stamp":"2024-09-17T05:51:13.315624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:03:42.718274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.11","version":"0'0","reported_seq":13,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-17T05:51:16.340680+0000","last_change":"2024-09-17T05:51:15.344783+0000","last_active":"2024-09-17T05:51:16.340680+0000","last_peered":"2024-09-17T05:51:16.340680+0000","last_clean":"2024-09-17T05:51:16.340680+0000","last_became_active":"2024-09-17T05:51:15.344469+0000","last_became_peered":"2024-09-17T05:51:15.344469+0000","last_unstale":"2024-09-17T05:51:16.340680+0000","last_undegraded":"2024-09-17T05:51:16.340680+0000","last_fullsized":"2024-09-17T05:51:16.340680+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:51:14.325451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:51:14.325451+0000","last_clean_scrub_stamp":"2024-09-17T05:51:14.325451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:26:02.895405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.10","version":"112'8","reported_seq":23,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-17T05:51:16.339322+0000","last_change":"2024-09-17T05:51:14.358522+0000","last_active":"2024-09-17T05:51:16.339322+0000","last_peered":"2024-09-17T05:51:16.339322+0000","last_clean":"2024-09-17T05:51:16.339322+0000","last_became_active":"2024-09-17T05:51:14.358110+0000","last_became_peered":"2024-09-17T05:51:14.358110+0000","last_unstale":"2024-09-17T05:51:16.339322+0000","last_undegraded":"2024-09-17T05:51:16.339322+0000","last_fullsized":"2024-09-17T05:51:16.339322+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:51:13.315624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:51:13.315624+0000","last_clean_scrub_stamp":"2024-09-17T05:51:13.315624+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:16:44.660311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.e","version":"0'0","reported_seq":13,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-17T05:51:16.340190+0000","last_change":"2024-09-17T05:51:15.368761+0000","last_active":"2024-09-17T05:51:16.340190+0000","last_peered":"2024-09-17T05:51:16.340190+0000","last_clean":"2024-09-17T05:51:16.340190+0000","last_became_active":"2024-09-17T05:51:15.368438+0000","last_became_peered":"2024-09-17T05:51:15.368438+0000","last_unstale":"2024-09-17T05:51:16.340190+0000","last_undegraded":"2024-09-17T05:51:16.340190+0000","last_fullsized":"2024-09-17T05:51:16.340190+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:51:14.325451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:51:14.325451+0000","last_clean_scrub_stamp":"2024-09-17T05:51:14.325451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:55:42.205033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.f","version":"0'0","reported_seq":1,"reported_epoch":110,"state":"creating+peering","last_fresh":"2024-09-17T05:51:13.332721+0000","last_change":"2024-09-17T05:51:13.332721+0000","last_active":"2024-09-17T05:51:13.315624+0000","last_peered":"2024-09-17T05:51:13.315624+0000","last_clean":"2024-09-17T05:51:13.315624+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:51:13.332721+0000","last_undegraded":"2024-09-17T05:51:13.332721+0000","last_fullsized":"2024-09-17T05:51:13.332721+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:51:13.315624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:51:13.315624+0000","last_clean_scrub_stamp":"2024-09-17T05:51:13.315624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.f","version":"0'0","reported_seq":13,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-17T05:51:16.751118+0000","last_change":"2024-09-17T05:51:15.363658+0000","last_active":"2024-09-17T05:51:16.751118+0000","last_peered":"2024-09-17T05:51:16.751118+0000","last_clean":"2024-09-17T05:51:16.751118+0000","last_became_active":"2024-09-17T05:51:15.363025+0000","last_became_peered":"2024-09-17T05:51:15.363025+0000","last_unstale":"2024-09-17T05:51:16.751118+0000","last_undegraded":"2024-09-17T05:51:16.751118+0000","last_fullsized":"2024-09-17T05:51:16.751118+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:51:14.325451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:51:14.325451+0000","last_clean_scrub_stamp":"2024-09-17T05:51:14.325451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:44:29.490228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.e","version":"112'2","reported_seq":17,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-17T05:51:16.340090+0000","last_change":"2024-09-17T05:51:14.350142+0000","last_active":"2024-09-17T05:51:16.340090+0000","last_peered":"2024-09-17T05:51:16.340090+0000","last_clean":"2024-09-17T05:51:16.340090+0000","last_became_active":"2024-09-17T05:51:14.349835+0000","last_became_peered":"2024-09-17T05:51:14.349835+0000","last_unstale":"2024-09-17T05:51:16.340090+0000","last_undegraded":"2024-09-17T05:51:16.340090+0000","last_fullsized":"2024-09-17T05:51:16.340090+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:51:13.315624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:51:13.315624+0000","last_clean_scrub_stamp":"2024-09-17T05:51:13.315624+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:18:05.652933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.c","version":"0'0","reported_seq":13,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-17T05:51:16.750603+0000","last_change":"2024-09-17T05:51:15.374005+0000","last_active":"2024-09-17T05:51:16.750603+0000","last_peered":"2024-09-17T05:51:16.750603+0000","last_clean":"2024-09-17T05:51:16.750603+0000","last_became_active":"2024-09-17T05:51:15.373697+0000","last_became_peered":"2024-09-17T05:51:15.373697+0000","last_unstale":"2024-09-17T05:51:16.750603+0000","last_undegraded":"2024-09-17T05:51:16.750603+0000","last_fullsized":"2024-09-17T05:51:16.750603+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:51:14.325451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:51:14.325451+0000","last_clean_scrub_stamp":"2024-09-17T05:51:14.325451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:52:25.457579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.d","version":"112'1","reported_seq":16,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-17T05:51:16.357350+0000","last_change":"2024-09-17T05:51:14.356064+0000","last_active":"2024-09-17T05:51:16.357350+0000","last_peered":"2024-09-17T05:51:16.357350+0000","last_clean":"2024-09-17T05:51:16.357350+0000","last_became_active":"2024-09-17T05:51:14.355680+0000","last_became_peered":"2024-09-17T05:51:14.355680+0000","last_unstale":"2024-09-17T05:51:16.357350+0000","last_undegraded":"2024-09-17T05:51:16.357350+0000","last_fullsized":"2024-09-17T05:51:16.357350+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:51:13.315624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:51:13.315624+0000","last_clean_scrub_stamp":"2024-09-17T05:51:13.315624+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:37:25.718715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.d","version":"0'0","reported_seq":13,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-17T05:51:16.750927+0000","last_change":"2024-09-17T05:51:15.360993+0000","last_active":"2024-09-17T05:51:16.750927+0000","last_peered":"2024-09-17T05:51:16.750927+0000","last_clean":"2024-09-17T05:51:16.750927+0000","last_became_active":"2024-09-17T05:51:15.360005+0000","last_became_peered":"2024-09-17T05:51:15.360005+0000","last_unstale":"2024-09-17T05:51:16.750927+0000","last_undegraded":"2024-09-17T05:51:16.750927+0000","last_fullsized":"2024-09-17T05:51:16.750927+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:51:14.325451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:51:14.325451+0000","last_clean_scrub_stamp":"2024-09-17T05:51:14.325451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:15:42.659548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.c","version":"0'0","reported_seq":15,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-17T05:51:16.359734+0000","last_change":"2024-09-17T05:51:14.356802+0000","last_active":"2024-09-17T05:51:16.359734+0000","last_peered":"2024-09-17T05:51:16.359734+0000","last_clean":"2024-09-17T05:51:16.359734+0000","last_became_active":"2024-09-17T05:51:14.356443+0000","last_became_peered":"2024-09-17T05:51:14.356443+0000","last_unstale":"2024-09-17T05:51:16.359734+0000","last_undegraded":"2024-09-17T05:51:16.359734+0000","last_fullsized":"2024-09-17T05:51:16.359734+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:51:13.315624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:51:13.315624+0000","last_clean_scrub_stamp":"2024-09-17T05:51:13.315624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:26:33.048310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.a","version":"0'0","reported_seq":13,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-17T05:51:16.750331+0000","last_change":"2024-09-17T05:51:15.354900+0000","last_active":"2024-09-17T05:51:16.750331+0000","last_peered":"2024-09-17T05:51:16.750331+0000","last_clean":"2024-09-17T05:51:16.750331+0000","last_became_active":"2024-09-17T05:51:15.354432+0000","last_became_peered":"2024-09-17T05:51:15.354432+0000","last_unstale":"2024-09-17T05:51:16.750331+0000","last_undegraded":"2024-09-17T05:51:16.750331+0000","last_fullsized":"2024-09-17T05:51:16.750331+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:51:14.325451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:51:14.325451+0000","last_clean_scrub_stamp":"2024-09-17T05:51:14.325451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:02:42.943141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.b","version":"112'2","reported_seq":17,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-17T05:51:16.751008+0000","last_change":"2024-09-17T05:51:14.351844+0000","last_active":"2024-09-17T05:51:16.751008+0000","last_peered":"2024-09-17T05:51:16.751008+0000","last_clean":"2024-09-17T05:51:16.751008+0000","last_became_active":"2024-09-17T05:51:14.351191+0000","last_became_peered":"2024-09-17T05:51:14.351191+0000","last_unstale":"2024-09-17T05:51:16.751008+0000","last_undegraded":"2024-09-17T05:51:16.751008+0000","last_fullsized":"2024-09-17T05:51:16.751008+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:51:13.315624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:51:13.315624+0000","last_clean_scrub_stamp":"2024-09-17T05:51:13.315624+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:21:47.493336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:51:14.325451+0000","last_change":"2024-09-17T05:51:14.325451+0000","last_active":"2024-09-17T05:51:14.325451+0000","last_peered":"2024-09-17T05:51:14.325451+0000","last_clean":"2024-09-17T05:51:14.325451+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:51:14.325451+0000","last_undegraded":"2024-09-17T05:51:14.325451+0000","last_fullsized":"2024-09-17T05:51:14.325451+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:51:14.325451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:51:14.325451+0000","last_clean_scrub_stamp":"2024-09-17T05:51:14.325451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.a","version":"0'0","reported_seq":15,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-17T05:51:16.339399+0000","last_change":"2024-09-17T05:51:14.355042+0000","last_active":"2024-09-17T05:51:16.339399+0000","last_peered":"2024-09-17T05:51:16.339399+0000","last_clean":"2024-09-17T05:51:16.339399+0000","last_became_active":"2024-09-17T05:51:14.354728+0000","last_became_peered":"2024-09-17T05:51:14.354728+0000","last_unstale":"2024-09-17T05:51:16.339399+0000","last_undegraded":"2024-09-17T05:51:16.339399+0000","last_fullsized":"2024-09-17T05:51:16.339399+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:51:13.315624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:51:13.315624+0000","last_clean_scrub_stamp":"2024-09-17T05:51:13.315624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:03:36.768537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.8","version":"0'0","reported_seq":13,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-17T05:51:16.750402+0000","last_change":"2024-09-17T05:51:15.357234+0000","last_active":"2024-09-17T05:51:16.750402+0000","last_peered":"2024-09-17T05:51:16.750402+0000","last_clean":"2024-09-17T05:51:16.750402+0000","last_became_active":"2024-09-17T05:51:15.356159+0000","last_became_peered":"2024-09-17T05:51:15.356159+0000","last_unstale":"2024-09-17T05:51:16.750402+0000","last_undegraded":"2024-09-17T05:51:16.750402+0000","last_fullsized":"2024-09-17T05:51:16.750402+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:51:14.325451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:51:14.325451+0000","last_clean_scrub_stamp":"2024-09-17T05:51:14.325451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:12:11.367770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.9","version":"0'0","reported_seq":15,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-17T05:51:16.750271+0000","last_change":"2024-09-17T05:51:14.348936+0000","last_active":"2024-09-17T05:51:16.750271+0000","last_peered":"2024-09-17T05:51:16.750271+0000","last_clean":"2024-09-17T05:51:16.750271+0000","last_became_active":"2024-09-17T05:51:14.348618+0000","last_became_peered":"2024-09-17T05:51:14.348618+0000","last_unstale":"2024-09-17T05:51:16.750271+0000","last_undegraded":"2024-09-17T05:51:16.750271+0000","last_fullsized":"2024-09-17T05:51:16.750271+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:51:13.315624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:51:13.315624+0000","last_clean_scrub_stamp":"2024-09-17T05:51:13.315624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:03:36.561055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.9","version":"0'0","reported_seq":13,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-17T05:51:16.340732+0000","last_change":"2024-09-17T05:51:15.359252+0000","last_active":"2024-09-17T05:51:16.340732+0000","last_peered":"2024-09-17T05:51:16.340732+0000","last_clean":"2024-09-17T05:51:16.340732+0000","last_became_active":"2024-09-17T05:51:15.358940+0000","last_became_peered":"2024-09-17T05:51:15.358940+0000","last_unstale":"2024-09-17T05:51:16.340732+0000","last_undegraded":"2024-09-17T05:51:16.340732+0000","last_fullsized":"2024-09-17T05:51:16.340732+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:51:14.325451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:51:14.325451+0000","last_clean_scrub_stamp":"2024-09-17T05:51:14.325451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:12:03.752583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.8","version":"0'0","reported_seq":1,"reported_epoch":110,"state":"creating+peering","last_fresh":"2024-09-17T05:51:13.333212+0000","last_change":"2024-09-17T05:51:13.333212+0000","last_active":"2024-09-17T05:51:13.315624+0000","last_peered":"2024-09-17T05:51:13.315624+0000","last_clean":"2024-09-17T05:51:13.315624+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:51:13.333212+0000","last_undegraded":"2024-09-17T05:51:13.333212+0000","last_fullsized":"2024-09-17T05:51:13.333212+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:51:13.315624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:51:13.315624+0000","last_clean_scrub_stamp":"2024-09-17T05:51:13.315624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.6","version":"0'0","reported_seq":13,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-17T05:51:16.357443+0000","last_change":"2024-09-17T05:51:15.365607+0000","last_active":"2024-09-17T05:51:16.357443+0000","last_peered":"2024-09-17T05:51:16.357443+0000","last_clean":"2024-09-17T05:51:16.357443+0000","last_became_active":"2024-09-17T05:51:15.365266+0000","last_became_peered":"2024-09-17T05:51:15.365266+0000","last_unstale":"2024-09-17T05:51:16.357443+0000","last_undegraded":"2024-09-17T05:51:16.357443+0000","last_fullsized":"2024-09-17T05:51:16.357443+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:51:14.325451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:51:14.325451+0000","last_clean_scrub_stamp":"2024-09-17T05:51:14.325451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:49:28.476795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.7","version":"112'2","reported_seq":17,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-17T05:51:16.340820+0000","last_change":"2024-09-17T05:51:14.358131+0000","last_active":"2024-09-17T05:51:16.340820+0000","last_peered":"2024-09-17T05:51:16.340820+0000","last_clean":"2024-09-17T05:51:16.340820+0000","last_became_active":"2024-09-17T05:51:14.357812+0000","last_became_peered":"2024-09-17T05:51:14.357812+0000","last_unstale":"2024-09-17T05:51:16.340820+0000","last_undegraded":"2024-09-17T05:51:16.340820+0000","last_fullsized":"2024-09-17T05:51:16.340820+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:51:13.315624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:51:13.315624+0000","last_clean_scrub_stamp":"2024-09-17T05:51:13.315624+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:00:46.227529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:51:14.325451+0000","last_change":"2024-09-17T05:51:14.325451+0000","last_active":"2024-09-17T05:51:14.325451+0000","last_peered":"2024-09-17T05:51:14.325451+0000","last_clean":"2024-09-17T05:51:14.325451+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:51:14.325451+0000","last_undegraded":"2024-09-17T05:51:14.325451+0000","last_fullsized":"2024-09-17T05:51:14.325451+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:51:14.325451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:51:14.325451+0000","last_clean_scrub_stamp":"2024-09-17T05:51:14.325451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.6","version":"113'1","reported_seq":16,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-17T05:51:16.357547+0000","last_change":"2024-09-17T05:51:14.353668+0000","last_active":"2024-09-17T05:51:16.357547+0000","last_peered":"2024-09-17T05:51:16.357547+0000","last_clean":"2024-09-17T05:51:16.357547+0000","last_became_active":"2024-09-17T05:51:14.353344+0000","last_became_peered":"2024-09-17T05:51:14.353344+0000","last_unstale":"2024-09-17T05:51:16.357547+0000","last_undegraded":"2024-09-17T05:51:16.357547+0000","last_fullsized":"2024-09-17T05:51:16.357547+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:51:13.315624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:51:13.315624+0000","last_clean_scrub_stamp":"2024-09-17T05:51:13.315624+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:56:25.324024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:51:14.325451+0000","last_change":"2024-09-17T05:51:14.325451+0000","last_active":"2024-09-17T05:51:14.325451+0000","last_peered":"2024-09-17T05:51:14.325451+0000","last_clean":"2024-09-17T05:51:14.325451+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:51:14.325451+0000","last_undegraded":"2024-09-17T05:51:14.325451+0000","last_fullsized":"2024-09-17T05:51:14.325451+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:51:14.325451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:51:14.325451+0000","last_clean_scrub_stamp":"2024-09-17T05:51:14.325451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.5","version":"0'0","reported_seq":1,"reported_epoch":110,"state":"creating+peering","last_fresh":"2024-09-17T05:51:13.332782+0000","last_change":"2024-09-17T05:51:13.332782+0000","last_active":"2024-09-17T05:51:13.315624+0000","last_peered":"2024-09-17T05:51:13.315624+0000","last_clean":"2024-09-17T05:51:13.315624+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:51:13.332782+0000","last_undegraded":"2024-09-17T05:51:13.332782+0000","last_fullsized":"2024-09-17T05:51:13.332782+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:51:13.315624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:51:13.315624+0000","last_clean_scrub_stamp":"2024-09-17T05:51:13.315624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.5","version":"0'0","reported_seq":13,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-17T05:51:16.357324+0000","last_change":"2024-09-17T05:51:15.363844+0000","last_active":"2024-09-17T05:51:16.357324+0000","last_peered":"2024-09-17T05:51:16.357324+0000","last_clean":"2024-09-17T05:51:16.357324+0000","last_became_active":"2024-09-17T05:51:15.363465+0000","last_became_peered":"2024-09-17T05:51:15.363465+0000","last_unstale":"2024-09-17T05:51:16.357324+0000","last_undegraded":"2024-09-17T05:51:16.357324+0000","last_fullsized":"2024-09-17T05:51:16.357324+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:51:14.325451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:51:14.325451+0000","last_clean_scrub_stamp":"2024-09-17T05:51:14.325451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:17:42.550657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.4","version":"0'0","reported_seq":15,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-17T05:51:16.341090+0000","last_change":"2024-09-17T05:51:14.350349+0000","last_active":"2024-09-17T05:51:16.341090+0000","last_peered":"2024-09-17T05:51:16.341090+0000","last_clean":"2024-09-17T05:51:16.341090+0000","last_became_active":"2024-09-17T05:51:14.350017+0000","last_became_peered":"2024-09-17T05:51:14.350017+0000","last_unstale":"2024-09-17T05:51:16.341090+0000","last_undegraded":"2024-09-17T05:51:16.341090+0000","last_fullsized":"2024-09-17T05:51:16.341090+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:51:13.315624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:51:13.315624+0000","last_clean_scrub_stamp":"2024-09-17T05:51:13.315624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:31:26.485537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.2","version":"0'0","reported_seq":13,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-17T05:51:16.340588+0000","last_change":"2024-09-17T05:51:15.345136+0000","last_active":"2024-09-17T05:51:16.340588+0000","last_peered":"2024-09-17T05:51:16.340588+0000","last_clean":"2024-09-17T05:51:16.340588+0000","last_became_active":"2024-09-17T05:51:15.344810+0000","last_became_peered":"2024-09-17T05:51:15.344810+0000","last_unstale":"2024-09-17T05:51:16.340588+0000","last_undegraded":"2024-09-17T05:51:16.340588+0000","last_fullsized":"2024-09-17T05:51:16.340588+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:51:14.325451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:51:14.325451+0000","last_clean_scrub_stamp":"2024-09-17T05:51:14.325451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:46:58.628756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.3","version":"0'0","reported_seq":15,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-17T05:51:16.359885+0000","last_change":"2024-09-17T05:51:14.352438+0000","last_active":"2024-09-17T05:51:16.359885+0000","last_peered":"2024-09-17T05:51:16.359885+0000","last_clean":"2024-09-17T05:51:16.359885+0000","last_became_active":"2024-09-17T05:51:14.352097+0000","last_became_peered":"2024-09-17T05:51:14.352097+0000","last_unstale":"2024-09-17T05:51:16.359885+0000","last_undegraded":"2024-09-17T05:51:16.359885+0000","last_fullsized":"2024-09-17T05:51:16.359885+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:51:13.315624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:51:13.315624+0000","last_clean_scrub_stamp":"2024-09-17T05:51:13.315624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:42:26.091891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.3","version":"0'0","reported_seq":13,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-17T05:51:16.340998+0000","last_change":"2024-09-17T05:51:15.359800+0000","last_active":"2024-09-17T05:51:16.340998+0000","last_peered":"2024-09-17T05:51:16.340998+0000","last_clean":"2024-09-17T05:51:16.340998+0000","last_became_active":"2024-09-17T05:51:15.357898+0000","last_became_peered":"2024-09-17T05:51:15.357898+0000","last_unstale":"2024-09-17T05:51:16.340998+0000","last_undegraded":"2024-09-17T05:51:16.340998+0000","last_fullsized":"2024-09-17T05:51:16.340998+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:51:14.325451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:51:14.325451+0000","last_clean_scrub_stamp":"2024-09-17T05:51:14.325451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:44:07.877112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.2","version":"0'0","reported_seq":15,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-17T05:51:16.340331+0000","last_change":"2024-09-17T05:51:14.355271+0000","last_active":"2024-09-17T05:51:16.340331+0000","last_peered":"2024-09-17T05:51:16.340331+0000","last_clean":"2024-09-17T05:51:16.340331+0000","last_became_active":"2024-09-17T05:51:14.354782+0000","last_became_peered":"2024-09-17T05:51:14.354782+0000","last_unstale":"2024-09-17T05:51:16.340331+0000","last_undegraded":"2024-09-17T05:51:16.340331+0000","last_fullsized":"2024-09-17T05:51:16.340331+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:51:13.315624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:51:13.315624+0000","last_clean_scrub_stamp":"2024-09-17T05:51:13.315624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:28:04.514097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.0","version":"0'0","reported_seq":13,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-17T05:51:16.750649+0000","last_change":"2024-09-17T05:51:15.358735+0000","last_active":"2024-09-17T05:51:16.750649+0000","last_peered":"2024-09-17T05:51:16.750649+0000","last_clean":"2024-09-17T05:51:16.750649+0000","last_became_active":"2024-09-17T05:51:15.358337+0000","last_became_peered":"2024-09-17T05:51:15.358337+0000","last_unstale":"2024-09-17T05:51:16.750649+0000","last_undegraded":"2024-09-17T05:51:16.750649+0000","last_fullsized":"2024-09-17T05:51:16.750649+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:51:14.325451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:51:14.325451+0000","last_clean_scrub_stamp":"2024-09-17T05:51:14.325451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:23:41.242455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.1","version":"0'0","reported_seq":15,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-17T05:51:16.339383+0000","last_change":"2024-09-17T05:51:14.352047+0000","last_active":"2024-09-17T05:51:16.339383+0000","last_peered":"2024-09-17T05:51:16.339383+0000","last_clean":"2024-09-17T05:51:16.339383+0000","last_became_active":"2024-09-17T05:51:14.351529+0000","last_became_peered":"2024-09-17T05:51:14.351529+0000","last_unstale":"2024-09-17T05:51:16.339383+0000","last_undegraded":"2024-09-17T05:51:16.339383+0000","last_fullsized":"2024-09-17T05:51:16.339383+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:51:13.315624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:51:13.315624+0000","last_clean_scrub_stamp":"2024-09-17T05:51:13.315624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:58:57.809988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:51:14.325451+0000","last_change":"2024-09-17T05:51:14.325451+0000","last_active":"2024-09-17T05:51:14.325451+0000","last_peered":"2024-09-17T05:51:14.325451+0000","last_clean":"2024-09-17T05:51:14.325451+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:51:14.325451+0000","last_undegraded":"2024-09-17T05:51:14.325451+0000","last_fullsized":"2024-09-17T05:51:14.325451+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:51:14.325451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:51:14.325451+0000","last_clean_scrub_stamp":"2024-09-17T05:51:14.325451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.0","version":"0'0","reported_seq":1,"reported_epoch":110,"state":"creating+peering","last_fresh":"2024-09-17T05:51:13.332654+0000","last_change":"2024-09-17T05:51:13.332654+0000","last_active":"2024-09-17T05:51:13.315624+0000","last_peered":"2024-09-17T05:51:13.315624+0000","last_clean":"2024-09-17T05:51:13.315624+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:51:13.332654+0000","last_undegraded":"2024-09-17T05:51:13.332654+0000","last_fullsized":"2024-09-17T05:51:13.332654+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:51:13.315624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:51:13.315624+0000","last_clean_scrub_stamp":"2024-09-17T05:51:13.315624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.10","version":"0'0","reported_seq":13,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-17T05:51:16.340473+0000","last_change":"2024-09-17T05:51:15.351750+0000","last_active":"2024-09-17T05:51:16.340473+0000","last_peered":"2024-09-17T05:51:16.340473+0000","last_clean":"2024-09-17T05:51:16.340473+0000","last_became_active":"2024-09-17T05:51:15.351076+0000","last_became_peered":"2024-09-17T05:51:15.351076+0000","last_unstale":"2024-09-17T05:51:16.340473+0000","last_undegraded":"2024-09-17T05:51:16.340473+0000","last_fullsized":"2024-09-17T05:51:16.340473+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:51:14.325451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:51:14.325451+0000","last_clean_scrub_stamp":"2024-09-17T05:51:14.325451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:49:55.636228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.11","version":"0'0","reported_seq":15,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-17T05:51:16.360020+0000","last_change":"2024-09-17T05:51:14.358432+0000","last_active":"2024-09-17T05:51:16.360020+0000","last_peered":"2024-09-17T05:51:16.360020+0000","last_clean":"2024-09-17T05:51:16.360020+0000","last_became_active":"2024-09-17T05:51:14.358059+0000","last_became_peered":"2024-09-17T05:51:14.358059+0000","last_unstale":"2024-09-17T05:51:16.360020+0000","last_undegraded":"2024-09-17T05:51:16.360020+0000","last_fullsized":"2024-09-17T05:51:16.360020+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:51:13.315624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:51:13.315624+0000","last_clean_scrub_stamp":"2024-09-17T05:51:13.315624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:32:58.129426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"19'72","reported_seq":276,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-17T05:51:16.750680+0000","last_change":"2024-09-17T05:41:48.539830+0000","last_active":"2024-09-17T05:51:16.750680+0000","last_peered":"2024-09-17T05:51:16.750680+0000","last_clean":"2024-09-17T05:51:16.750680+0000","last_became_active":"2024-09-17T05:41:48.538743+0000","last_became_peered":"2024-09-17T05:41:48.538743+0000","last_unstale":"2024-09-17T05:51:16.750680+0000","last_undegraded":"2024-09-17T05:51:16.750680+0000","last_fullsized":"2024-09-17T05:51:16.750680+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:47.152539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:47.152539+0000","last_clean_scrub_stamp":"2024-09-17T05:41:47.152539+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:08:02.952016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":17,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":100,"acting":100,"num_store_stats":7},{"poolid":16,"num_pg":32,"stat_sum":{"num_bytes":686,"num_objects":15,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":34,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":12,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":3096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":29,"ondisk_log_size":29,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":16,"seq":68719476855,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":122740,"kb_used_data":1368,"kb_used_omap":1,"kb_used_meta":121342,"kb_avail":94249100,"statfs":{"total":96636764160,"available":96511078400,"internally_reserved":0,"allocated":1400832,"data_stored":608982,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":124254662},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":7,"up_from":15,"seq":64424509559,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":131624,"kb_used_data":1940,"kb_used_omap":1,"kb_used_meta":129662,"kb_avail":94240216,"statfs":{"total":96636764160,"available":96501981184,"internally_reserved":0,"allocated":1986560,"data_stored":1193456,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":132774346},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509558,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":108844,"kb_used_data":1360,"kb_used_omap":1,"kb_used_meta":107454,"kb_avail":94262996,"statfs":{"total":96636764160,"available":96525307904,"internally_reserved":0,"allocated":1392640,"data_stored":603076,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":110033349},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509558,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":136624,"kb_used_data":1364,"kb_used_omap":1,"kb_used_meta":135230,"kb_avail":94235216,"statfs":{"total":96636764160,"available":96496861184,"internally_reserved":0,"allocated":1396736,"data_stored":608912,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":138475973},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509558,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":131064,"kb_used_data":1380,"kb_used_omap":1,"kb_used_meta":129662,"kb_avail":94240776,"statfs":{"total":96636764160,"available":96502554624,"internally_reserved":0,"allocated":1413120,"data_stored":610594,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":132774343},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509558,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":136620,"kb_used_data":1364,"kb_used_omap":1,"kb_used_meta":135230,"kb_avail":94235220,"statfs":{"total":96636764160,"available":96496865280,"internally_reserved":0,"allocated":1396736,"data_stored":608912,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":138475973},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509558,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":122740,"kb_used_data":1372,"kb_used_omap":1,"kb_used_meta":121342,"kb_avail":94249100,"statfs":{"total":96636764160,"available":96511078400,"internally_reserved":0,"allocated":1404928,"data_stored":609036,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":124254661},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574965,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":119104,"kb_used_data":1896,"kb_used_omap":1,"kb_used_meta":117182,"kb_avail":94252736,"statfs":{"total":96636764160,"available":96514801664,"internally_reserved":0,"allocated":1941504,"data_stored":1173553,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":119994821},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1682,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-17T05:51:23.818 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-17T05:51:23.946 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:23.944+0000 7fde1534a640 1 -- 172.21.15.150:0/2544534122 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fde100d4f90 msgr2=0x7fde100d0400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:51:23.946 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:23.944+0000 7fde1534a640 1 --2- 172.21.15.150:0/2544534122 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fde100d4f90 0x7fde100d0400 secure :-1 s=READY pgs=1508 cs=0 l=1 rev1=1 crypto rx=0x7fde08009830 tx=0x7fde0802a510 comp rx=0 tx=0).stop 2024-09-17T05:51:23.946 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:23.945+0000 7fde1534a640 1 -- 172.21.15.150:0/2544534122 shutdown_connections 2024-09-17T05:51:23.946 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:23.945+0000 7fde1534a640 1 --2- 172.21.15.150:0/2544534122 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fde100d1790 0x7fde100d2780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:51:23.946 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:23.945+0000 7fde1534a640 1 --2- 172.21.15.150:0/2544534122 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fde100d4f90 0x7fde100d0400 unknown :-1 s=CLOSED pgs=1508 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:51:23.946 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:23.945+0000 7fde1534a640 1 -- 172.21.15.150:0/2544534122 >> 172.21.15.150:0/2544534122 conn(0x7fde1008bfe0 msgr2=0x7fde100d4670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:51:23.946 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:23.945+0000 7fde1534a640 1 -- 172.21.15.150:0/2544534122 shutdown_connections 2024-09-17T05:51:23.946 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:23.945+0000 7fde1534a640 1 -- 172.21.15.150:0/2544534122 wait complete. 2024-09-17T05:51:23.947 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:23.946+0000 7fde1534a640 1 Processor -- start 2024-09-17T05:51:23.947 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:23.947+0000 7fde1534a640 1 -- start start 2024-09-17T05:51:23.950 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:23.948+0000 7fde1534a640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fde100b5d50 0x7fde1014b9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:51:23.950 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:23.948+0000 7fde1534a640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fde100d4f90 0x7fde101589b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:51:23.950 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:23.948+0000 7fde1534a640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fde1015a7b0 0x7fde1015abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:51:23.950 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:23.948+0000 7fde1534a640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7fde100b7b00 con 0x7fde100d4f90 2024-09-17T05:51:23.950 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:23.948+0000 7fde1534a640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fde100b7980 con 0x7fde1015a7b0 2024-09-17T05:51:23.950 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:23.948+0000 7fde1534a640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fde100b7c80 con 0x7fde100b5d50 2024-09-17T05:51:23.951 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:23.948+0000 7fde0e7fc640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fde100d4f90 0x7fde101589b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:51:23.951 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:23.948+0000 7fde0e7fc640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fde100d4f90 0x7fde101589b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:57620/0 (socket says 172.21.15.150:57620) 2024-09-17T05:51:23.951 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:23.948+0000 7fde0e7fc640 1 -- 172.21.15.150:0/1476246831 learned_addr learned my addr 172.21.15.150:0/1476246831 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:51:23.951 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:23.948+0000 7fde0f7fe640 1 --2- 172.21.15.150:0/1476246831 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fde1015a7b0 0x7fde1015abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:51:23.951 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:23.948+0000 7fde0effd640 1 --2- 172.21.15.150:0/1476246831 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fde100b5d50 0x7fde1014b9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:51:23.951 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:23.948+0000 7fde0e7fc640 1 -- 172.21.15.150:0/1476246831 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fde100b5d50 msgr2=0x7fde1014b9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:51:23.951 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:23.948+0000 7fde0e7fc640 1 --2- 172.21.15.150:0/1476246831 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fde100b5d50 0x7fde1014b9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:51:23.951 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:23.948+0000 7fde0e7fc640 1 -- 172.21.15.150:0/1476246831 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fde1015a7b0 msgr2=0x7fde1015abc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:51:23.951 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:23.948+0000 7fde0e7fc640 1 --2- 172.21.15.150:0/1476246831 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fde1015a7b0 0x7fde1015abc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:51:23.951 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:23.948+0000 7fde0e7fc640 1 -- 172.21.15.150:0/1476246831 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fde10154f70 con 0x7fde100d4f90 2024-09-17T05:51:23.951 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:23.948+0000 7fde0f7fe640 1 --2- 172.21.15.150:0/1476246831 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fde1015a7b0 0x7fde1015abc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:51:23.952 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:23.948+0000 7fde0effd640 1 --2- 172.21.15.150:0/1476246831 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fde100b5d50 0x7fde1014b9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:51:23.952 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:23.948+0000 7fde0e7fc640 1 --2- 172.21.15.150:0/1476246831 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fde100d4f90 0x7fde101589b0 secure :-1 s=READY pgs=1509 cs=0 l=1 rev1=1 crypto rx=0x7fde0000d700 tx=0x7fde0000dbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:51:23.952 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:23.949+0000 7fddf77fe640 1 -- 172.21.15.150:0/1476246831 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde00017070 con 0x7fde100d4f90 2024-09-17T05:51:23.952 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:23.949+0000 7fddf77fe640 1 -- 172.21.15.150:0/1476246831 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fde00009b10 con 0x7fde100d4f90 2024-09-17T05:51:23.952 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:23.949+0000 7fde1534a640 1 -- 172.21.15.150:0/1476246831 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fde1015b100 con 0x7fde100d4f90 2024-09-17T05:51:23.952 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:23.949+0000 7fddf77fe640 1 -- 172.21.15.150:0/1476246831 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde00010460 con 0x7fde100d4f90 2024-09-17T05:51:23.952 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:23.949+0000 7fde1534a640 1 -- 172.21.15.150:0/1476246831 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fde10159590 con 0x7fde100d4f90 2024-09-17T05:51:23.953 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:23.950+0000 7fde1534a640 1 -- 172.21.15.150:0/1476246831 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fde100d2780 con 0x7fde100d4f90 2024-09-17T05:51:23.953 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:23.951+0000 7fddf77fe640 1 -- 172.21.15.150:0/1476246831 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 37) ==== 103787+0+0 (secure 0 0 0) 0x7fde0001a070 con 0x7fde100d4f90 2024-09-17T05:51:23.953 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:23.951+0000 7fddf77fe640 1 --2- 172.21.15.150:0/1476246831 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fddfc07a570 0x7fddfc07ca80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:51:23.953 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:23.951+0000 7fddf77fe640 1 -- 172.21.15.150:0/1476246831 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(113..113 src has 1..113) ==== 5849+0+0 (secure 0 0 0) 0x7fde0009a0c0 con 0x7fde100d4f90 2024-09-17T05:51:23.953 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:23.951+0000 7fde0effd640 1 --2- 172.21.15.150:0/1476246831 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fddfc07a570 0x7fddfc07ca80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:51:23.953 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:23.952+0000 7fde0effd640 1 --2- 172.21.15.150:0/1476246831 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fddfc07a570 0x7fddfc07ca80 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7fde04002170 tx=0x7fde04009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:51:23.955 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:23.955+0000 7fddf77fe640 1 -- 172.21.15.150:0/1476246831 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fde1015b100 con 0x7fde100d4f90 2024-09-17T05:51:24.128 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:24.127+0000 7fde1534a640 1 -- 172.21.15.150:0/1476246831 --> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fde10159320 con 0x7fddfc07a570 2024-09-17T05:51:24.133 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:24.132+0000 7fddf77fe640 1 -- 172.21.15.150:0/1476246831 <== mgr.4108 v2:172.21.15.176:6800/3631216395 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+252437 (secure 0 0 0) 0x7fde10159320 con 0x7fddfc07a570 2024-09-17T05:51:24.136 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-09-17T05:51:24.137 INFO:teuthology.orchestra.run.smithi150.stderr:dumped all 2024-09-17T05:51:24.139 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:24.135+0000 7fde1534a640 1 -- 172.21.15.150:0/1476246831 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fddfc07a570 msgr2=0x7fddfc07ca80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:51:24.139 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:24.135+0000 7fde1534a640 1 --2- 172.21.15.150:0/1476246831 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fddfc07a570 0x7fddfc07ca80 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7fde04002170 tx=0x7fde04009040 comp rx=0 tx=0).stop 2024-09-17T05:51:24.139 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:24.135+0000 7fde1534a640 1 -- 172.21.15.150:0/1476246831 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fde100d4f90 msgr2=0x7fde101589b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:51:24.139 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:24.135+0000 7fde1534a640 1 --2- 172.21.15.150:0/1476246831 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fde100d4f90 0x7fde101589b0 secure :-1 s=READY pgs=1509 cs=0 l=1 rev1=1 crypto rx=0x7fde0000d700 tx=0x7fde0000dbc0 comp rx=0 tx=0).stop 2024-09-17T05:51:24.139 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:24.135+0000 7fde1534a640 1 -- 172.21.15.150:0/1476246831 shutdown_connections 2024-09-17T05:51:24.139 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:24.135+0000 7fde1534a640 1 --2- 172.21.15.150:0/1476246831 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fde1015a7b0 0x7fde1015abc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:51:24.139 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:24.135+0000 7fde1534a640 1 --2- 172.21.15.150:0/1476246831 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fddfc07a570 0x7fddfc07ca80 unknown :-1 s=CLOSED pgs=644 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:51:24.139 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:24.135+0000 7fde1534a640 1 --2- 172.21.15.150:0/1476246831 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fde100d4f90 0x7fde101589b0 unknown :-1 s=CLOSED pgs=1509 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:51:24.139 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:24.135+0000 7fde1534a640 1 --2- 172.21.15.150:0/1476246831 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fde100b5d50 0x7fde1014b9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:51:24.139 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:24.135+0000 7fde1534a640 1 -- 172.21.15.150:0/1476246831 >> 172.21.15.150:0/1476246831 conn(0x7fde1008bfe0 msgr2=0x7fde100b5460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:51:24.139 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:24.136+0000 7fde1534a640 1 -- 172.21.15.150:0/1476246831 shutdown_connections 2024-09-17T05:51:24.139 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:24.136+0000 7fde1534a640 1 -- 172.21.15.150:0/1476246831 wait complete. 2024-09-17T05:51:24.148 INFO:teuthology.orchestra.run.smithi150.stdout:{"pg_ready":true,"pg_map":{"version":396,"stamp":"2024-09-17T05:51:23.059545+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":146,"num_write_kb":1642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":111,"ondisk_log_size":111,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":175,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":1009448,"kb_used_data":12136,"kb_used_omap":12,"kb_used_meta":997107,"kb_avail":753965272,"statfs":{"total":773094113280,"available":772060438528,"internally_reserved":0,"allocated":12427264,"data_stored":6056852,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":1021038128},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":11,"apply_latency_ms":11,"commit_latency_ns":11000000,"apply_latency_ns":11000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.002412"},"pg_stats":[{"pgid":"17.3f","version":"0'0","reported_seq":13,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-17T05:51:16.751343+0000","last_change":"2024-09-17T05:51:15.358791+0000","last_active":"2024-09-17T05:51:16.751343+0000","last_peered":"2024-09-17T05:51:16.751343+0000","last_clean":"2024-09-17T05:51:16.751343+0000","last_became_active":"2024-09-17T05:51:15.358133+0000","last_became_peered":"2024-09-17T05:51:15.358133+0000","last_unstale":"2024-09-17T05:51:16.751343+0000","last_undegraded":"2024-09-17T05:51:16.751343+0000","last_fullsized":"2024-09-17T05:51:16.751343+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:51:14.325451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:51:14.325451+0000","last_clean_scrub_stamp":"2024-09-17T05:51:14.325451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:02:10.815926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.3e","version":"0'0","reported_seq":13,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-17T05:51:16.340640+0000","last_change":"2024-09-17T05:51:15.344958+0000","last_active":"2024-09-17T05:51:16.340640+0000","last_peered":"2024-09-17T05:51:16.340640+0000","last_clean":"2024-09-17T05:51:16.340640+0000","last_became_active":"2024-09-17T05:51:15.344518+0000","last_became_peered":"2024-09-17T05:51:15.344518+0000","last_unstale":"2024-09-17T05:51:16.340640+0000","last_undegraded":"2024-09-17T05:51:16.340640+0000","last_fullsized":"2024-09-17T05:51:16.340640+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:51:14.325451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:51:14.325451+0000","last_clean_scrub_stamp":"2024-09-17T05:51:14.325451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:49:40.516537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.3d","version":"0'0","reported_seq":13,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-17T05:51:16.750744+0000","last_change":"2024-09-17T05:51:15.352551+0000","last_active":"2024-09-17T05:51:16.750744+0000","last_peered":"2024-09-17T05:51:16.750744+0000","last_clean":"2024-09-17T05:51:16.750744+0000","last_became_active":"2024-09-17T05:51:15.352223+0000","last_became_peered":"2024-09-17T05:51:15.352223+0000","last_unstale":"2024-09-17T05:51:16.750744+0000","last_undegraded":"2024-09-17T05:51:16.750744+0000","last_fullsized":"2024-09-17T05:51:16.750744+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:51:14.325451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:51:14.325451+0000","last_clean_scrub_stamp":"2024-09-17T05:51:14.325451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:56:32.607756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.3c","version":"0'0","reported_seq":13,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-17T05:51:16.750689+0000","last_change":"2024-09-17T05:51:15.360011+0000","last_active":"2024-09-17T05:51:16.750689+0000","last_peered":"2024-09-17T05:51:16.750689+0000","last_clean":"2024-09-17T05:51:16.750689+0000","last_became_active":"2024-09-17T05:51:15.357518+0000","last_became_peered":"2024-09-17T05:51:15.357518+0000","last_unstale":"2024-09-17T05:51:16.750689+0000","last_undegraded":"2024-09-17T05:51:16.750689+0000","last_fullsized":"2024-09-17T05:51:16.750689+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:51:14.325451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:51:14.325451+0000","last_clean_scrub_stamp":"2024-09-17T05:51:14.325451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:36:43.744987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.3b","version":"0'0","reported_seq":13,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-17T05:51:16.339755+0000","last_change":"2024-09-17T05:51:15.354740+0000","last_active":"2024-09-17T05:51:16.339755+0000","last_peered":"2024-09-17T05:51:16.339755+0000","last_clean":"2024-09-17T05:51:16.339755+0000","last_became_active":"2024-09-17T05:51:15.354441+0000","last_became_peered":"2024-09-17T05:51:15.354441+0000","last_unstale":"2024-09-17T05:51:16.339755+0000","last_undegraded":"2024-09-17T05:51:16.339755+0000","last_fullsized":"2024-09-17T05:51:16.339755+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:51:14.325451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:51:14.325451+0000","last_clean_scrub_stamp":"2024-09-17T05:51:14.325451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:01:13.224376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.3a","version":"0'0","reported_seq":13,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-17T05:51:16.750534+0000","last_change":"2024-09-17T05:51:15.349818+0000","last_active":"2024-09-17T05:51:16.750534+0000","last_peered":"2024-09-17T05:51:16.750534+0000","last_clean":"2024-09-17T05:51:16.750534+0000","last_became_active":"2024-09-17T05:51:15.349457+0000","last_became_peered":"2024-09-17T05:51:15.349457+0000","last_unstale":"2024-09-17T05:51:16.750534+0000","last_undegraded":"2024-09-17T05:51:16.750534+0000","last_fullsized":"2024-09-17T05:51:16.750534+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:51:14.325451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:51:14.325451+0000","last_clean_scrub_stamp":"2024-09-17T05:51:14.325451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:08:40.638937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.39","version":"0'0","reported_seq":13,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-17T05:51:16.360003+0000","last_change":"2024-09-17T05:51:15.358171+0000","last_active":"2024-09-17T05:51:16.360003+0000","last_peered":"2024-09-17T05:51:16.360003+0000","last_clean":"2024-09-17T05:51:16.360003+0000","last_became_active":"2024-09-17T05:51:15.357838+0000","last_became_peered":"2024-09-17T05:51:15.357838+0000","last_unstale":"2024-09-17T05:51:16.360003+0000","last_undegraded":"2024-09-17T05:51:16.360003+0000","last_fullsized":"2024-09-17T05:51:16.360003+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:51:14.325451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:51:14.325451+0000","last_clean_scrub_stamp":"2024-09-17T05:51:14.325451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:20:00.031149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.38","version":"0'0","reported_seq":13,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-17T05:51:16.750342+0000","last_change":"2024-09-17T05:51:15.361077+0000","last_active":"2024-09-17T05:51:16.750342+0000","last_peered":"2024-09-17T05:51:16.750342+0000","last_clean":"2024-09-17T05:51:16.750342+0000","last_became_active":"2024-09-17T05:51:15.359954+0000","last_became_peered":"2024-09-17T05:51:15.359954+0000","last_unstale":"2024-09-17T05:51:16.750342+0000","last_undegraded":"2024-09-17T05:51:16.750342+0000","last_fullsized":"2024-09-17T05:51:16.750342+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:51:14.325451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:51:14.325451+0000","last_clean_scrub_stamp":"2024-09-17T05:51:14.325451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:40:17.074211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.37","version":"0'0","reported_seq":13,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-17T05:51:16.751412+0000","last_change":"2024-09-17T05:51:15.348194+0000","last_active":"2024-09-17T05:51:16.751412+0000","last_peered":"2024-09-17T05:51:16.751412+0000","last_clean":"2024-09-17T05:51:16.751412+0000","last_became_active":"2024-09-17T05:51:15.347661+0000","last_became_peered":"2024-09-17T05:51:15.347661+0000","last_unstale":"2024-09-17T05:51:16.751412+0000","last_undegraded":"2024-09-17T05:51:16.751412+0000","last_fullsized":"2024-09-17T05:51:16.751412+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:51:14.325451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:51:14.325451+0000","last_clean_scrub_stamp":"2024-09-17T05:51:14.325451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:15:36.782535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.36","version":"0'0","reported_seq":13,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-17T05:51:16.750770+0000","last_change":"2024-09-17T05:51:15.366593+0000","last_active":"2024-09-17T05:51:16.750770+0000","last_peered":"2024-09-17T05:51:16.750770+0000","last_clean":"2024-09-17T05:51:16.750770+0000","last_became_active":"2024-09-17T05:51:15.363954+0000","last_became_peered":"2024-09-17T05:51:15.363954+0000","last_unstale":"2024-09-17T05:51:16.750770+0000","last_undegraded":"2024-09-17T05:51:16.750770+0000","last_fullsized":"2024-09-17T05:51:16.750770+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:51:14.325451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:51:14.325451+0000","last_clean_scrub_stamp":"2024-09-17T05:51:14.325451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:08:25.621509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.35","version":"0'0","reported_seq":13,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-17T05:51:16.341088+0000","last_change":"2024-09-17T05:51:15.353391+0000","last_active":"2024-09-17T05:51:16.341088+0000","last_peered":"2024-09-17T05:51:16.341088+0000","last_clean":"2024-09-17T05:51:16.341088+0000","last_became_active":"2024-09-17T05:51:15.353075+0000","last_became_peered":"2024-09-17T05:51:15.353075+0000","last_unstale":"2024-09-17T05:51:16.341088+0000","last_undegraded":"2024-09-17T05:51:16.341088+0000","last_fullsized":"2024-09-17T05:51:16.341088+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:51:14.325451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:51:14.325451+0000","last_clean_scrub_stamp":"2024-09-17T05:51:14.325451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:35:01.866394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.34","version":"0'0","reported_seq":13,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-17T05:51:16.750743+0000","last_change":"2024-09-17T05:51:15.360973+0000","last_active":"2024-09-17T05:51:16.750743+0000","last_peered":"2024-09-17T05:51:16.750743+0000","last_clean":"2024-09-17T05:51:16.750743+0000","last_became_active":"2024-09-17T05:51:15.360692+0000","last_became_peered":"2024-09-17T05:51:15.360692+0000","last_unstale":"2024-09-17T05:51:16.750743+0000","last_undegraded":"2024-09-17T05:51:16.750743+0000","last_fullsized":"2024-09-17T05:51:16.750743+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:51:14.325451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:51:14.325451+0000","last_clean_scrub_stamp":"2024-09-17T05:51:14.325451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:05:14.283685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.33","version":"0'0","reported_seq":13,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-17T05:51:16.750511+0000","last_change":"2024-09-17T05:51:15.356651+0000","last_active":"2024-09-17T05:51:16.750511+0000","last_peered":"2024-09-17T05:51:16.750511+0000","last_clean":"2024-09-17T05:51:16.750511+0000","last_became_active":"2024-09-17T05:51:15.356329+0000","last_became_peered":"2024-09-17T05:51:15.356329+0000","last_unstale":"2024-09-17T05:51:16.750511+0000","last_undegraded":"2024-09-17T05:51:16.750511+0000","last_fullsized":"2024-09-17T05:51:16.750511+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:51:14.325451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:51:14.325451+0000","last_clean_scrub_stamp":"2024-09-17T05:51:14.325451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:40:43.043320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.32","version":"0'0","reported_seq":13,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-17T05:51:16.750261+0000","last_change":"2024-09-17T05:51:15.358138+0000","last_active":"2024-09-17T05:51:16.750261+0000","last_peered":"2024-09-17T05:51:16.750261+0000","last_clean":"2024-09-17T05:51:16.750261+0000","last_became_active":"2024-09-17T05:51:15.357839+0000","last_became_peered":"2024-09-17T05:51:15.357839+0000","last_unstale":"2024-09-17T05:51:16.750261+0000","last_undegraded":"2024-09-17T05:51:16.750261+0000","last_fullsized":"2024-09-17T05:51:16.750261+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:51:14.325451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:51:14.325451+0000","last_clean_scrub_stamp":"2024-09-17T05:51:14.325451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:31:24.479375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.31","version":"0'0","reported_seq":13,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-17T05:51:16.749988+0000","last_change":"2024-09-17T05:51:15.349182+0000","last_active":"2024-09-17T05:51:16.749988+0000","last_peered":"2024-09-17T05:51:16.749988+0000","last_clean":"2024-09-17T05:51:16.749988+0000","last_became_active":"2024-09-17T05:51:15.348875+0000","last_became_peered":"2024-09-17T05:51:15.348875+0000","last_unstale":"2024-09-17T05:51:16.749988+0000","last_undegraded":"2024-09-17T05:51:16.749988+0000","last_fullsized":"2024-09-17T05:51:16.749988+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:51:14.325451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:51:14.325451+0000","last_clean_scrub_stamp":"2024-09-17T05:51:14.325451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:32:59.139253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.30","version":"0'0","reported_seq":13,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-17T05:51:16.749921+0000","last_change":"2024-09-17T05:51:15.368138+0000","last_active":"2024-09-17T05:51:16.749921+0000","last_peered":"2024-09-17T05:51:16.749921+0000","last_clean":"2024-09-17T05:51:16.749921+0000","last_became_active":"2024-09-17T05:51:15.362315+0000","last_became_peered":"2024-09-17T05:51:15.362315+0000","last_unstale":"2024-09-17T05:51:16.749921+0000","last_undegraded":"2024-09-17T05:51:16.749921+0000","last_fullsized":"2024-09-17T05:51:16.749921+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:51:14.325451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:51:14.325451+0000","last_clean_scrub_stamp":"2024-09-17T05:51:14.325451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:24:25.014490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.2f","version":"0'0","reported_seq":13,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-17T05:51:16.340854+0000","last_change":"2024-09-17T05:51:15.356819+0000","last_active":"2024-09-17T05:51:16.340854+0000","last_peered":"2024-09-17T05:51:16.340854+0000","last_clean":"2024-09-17T05:51:16.340854+0000","last_became_active":"2024-09-17T05:51:15.355786+0000","last_became_peered":"2024-09-17T05:51:15.355786+0000","last_unstale":"2024-09-17T05:51:16.340854+0000","last_undegraded":"2024-09-17T05:51:16.340854+0000","last_fullsized":"2024-09-17T05:51:16.340854+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:51:14.325451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:51:14.325451+0000","last_clean_scrub_stamp":"2024-09-17T05:51:14.325451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:41:26.394405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.2e","version":"0'0","reported_seq":13,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-17T05:51:16.357401+0000","last_change":"2024-09-17T05:51:15.355528+0000","last_active":"2024-09-17T05:51:16.357401+0000","last_peered":"2024-09-17T05:51:16.357401+0000","last_clean":"2024-09-17T05:51:16.357401+0000","last_became_active":"2024-09-17T05:51:15.355205+0000","last_became_peered":"2024-09-17T05:51:15.355205+0000","last_unstale":"2024-09-17T05:51:16.357401+0000","last_undegraded":"2024-09-17T05:51:16.357401+0000","last_fullsized":"2024-09-17T05:51:16.357401+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:51:14.325451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:51:14.325451+0000","last_clean_scrub_stamp":"2024-09-17T05:51:14.325451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:59:59.333951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.2d","version":"0'0","reported_seq":13,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-17T05:51:16.750770+0000","last_change":"2024-09-17T05:51:15.357170+0000","last_active":"2024-09-17T05:51:16.750770+0000","last_peered":"2024-09-17T05:51:16.750770+0000","last_clean":"2024-09-17T05:51:16.750770+0000","last_became_active":"2024-09-17T05:51:15.356347+0000","last_became_peered":"2024-09-17T05:51:15.356347+0000","last_unstale":"2024-09-17T05:51:16.750770+0000","last_undegraded":"2024-09-17T05:51:16.750770+0000","last_fullsized":"2024-09-17T05:51:16.750770+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:51:14.325451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:51:14.325451+0000","last_clean_scrub_stamp":"2024-09-17T05:51:14.325451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:39:17.891657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.2c","version":"0'0","reported_seq":13,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-17T05:51:16.341037+0000","last_change":"2024-09-17T05:51:15.351757+0000","last_active":"2024-09-17T05:51:16.341037+0000","last_peered":"2024-09-17T05:51:16.341037+0000","last_clean":"2024-09-17T05:51:16.341037+0000","last_became_active":"2024-09-17T05:51:15.351451+0000","last_became_peered":"2024-09-17T05:51:15.351451+0000","last_unstale":"2024-09-17T05:51:16.341037+0000","last_undegraded":"2024-09-17T05:51:16.341037+0000","last_fullsized":"2024-09-17T05:51:16.341037+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:51:14.325451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:51:14.325451+0000","last_clean_scrub_stamp":"2024-09-17T05:51:14.325451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:02:50.463096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.2b","version":"0'0","reported_seq":13,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-17T05:51:16.341258+0000","last_change":"2024-09-17T05:51:15.343820+0000","last_active":"2024-09-17T05:51:16.341258+0000","last_peered":"2024-09-17T05:51:16.341258+0000","last_clean":"2024-09-17T05:51:16.341258+0000","last_became_active":"2024-09-17T05:51:15.343446+0000","last_became_peered":"2024-09-17T05:51:15.343446+0000","last_unstale":"2024-09-17T05:51:16.341258+0000","last_undegraded":"2024-09-17T05:51:16.341258+0000","last_fullsized":"2024-09-17T05:51:16.341258+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:51:14.325451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:51:14.325451+0000","last_clean_scrub_stamp":"2024-09-17T05:51:14.325451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:01:59.401335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.2a","version":"0'0","reported_seq":13,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-17T05:51:16.340834+0000","last_change":"2024-09-17T05:51:15.347950+0000","last_active":"2024-09-17T05:51:16.340834+0000","last_peered":"2024-09-17T05:51:16.340834+0000","last_clean":"2024-09-17T05:51:16.340834+0000","last_became_active":"2024-09-17T05:51:15.347234+0000","last_became_peered":"2024-09-17T05:51:15.347234+0000","last_unstale":"2024-09-17T05:51:16.340834+0000","last_undegraded":"2024-09-17T05:51:16.340834+0000","last_fullsized":"2024-09-17T05:51:16.340834+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:51:14.325451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:51:14.325451+0000","last_clean_scrub_stamp":"2024-09-17T05:51:14.325451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:25:47.876263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.29","version":"0'0","reported_seq":13,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-17T05:51:16.340293+0000","last_change":"2024-09-17T05:51:15.351107+0000","last_active":"2024-09-17T05:51:16.340293+0000","last_peered":"2024-09-17T05:51:16.340293+0000","last_clean":"2024-09-17T05:51:16.340293+0000","last_became_active":"2024-09-17T05:51:15.350800+0000","last_became_peered":"2024-09-17T05:51:15.350800+0000","last_unstale":"2024-09-17T05:51:16.340293+0000","last_undegraded":"2024-09-17T05:51:16.340293+0000","last_fullsized":"2024-09-17T05:51:16.340293+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:51:14.325451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:51:14.325451+0000","last_clean_scrub_stamp":"2024-09-17T05:51:14.325451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:54:30.680562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.28","version":"0'0","reported_seq":13,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-17T05:51:16.340277+0000","last_change":"2024-09-17T05:51:15.352451+0000","last_active":"2024-09-17T05:51:16.340277+0000","last_peered":"2024-09-17T05:51:16.340277+0000","last_clean":"2024-09-17T05:51:16.340277+0000","last_became_active":"2024-09-17T05:51:15.351461+0000","last_became_peered":"2024-09-17T05:51:15.351461+0000","last_unstale":"2024-09-17T05:51:16.340277+0000","last_undegraded":"2024-09-17T05:51:16.340277+0000","last_fullsized":"2024-09-17T05:51:16.340277+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:51:14.325451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:51:14.325451+0000","last_clean_scrub_stamp":"2024-09-17T05:51:14.325451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:07:01.411755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.27","version":"0'0","reported_seq":13,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-17T05:51:16.340985+0000","last_change":"2024-09-17T05:51:15.356473+0000","last_active":"2024-09-17T05:51:16.340985+0000","last_peered":"2024-09-17T05:51:16.340985+0000","last_clean":"2024-09-17T05:51:16.340985+0000","last_became_active":"2024-09-17T05:51:15.355395+0000","last_became_peered":"2024-09-17T05:51:15.355395+0000","last_unstale":"2024-09-17T05:51:16.340985+0000","last_undegraded":"2024-09-17T05:51:16.340985+0000","last_fullsized":"2024-09-17T05:51:16.340985+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:51:14.325451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:51:14.325451+0000","last_clean_scrub_stamp":"2024-09-17T05:51:14.325451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:45:35.715638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.26","version":"0'0","reported_seq":13,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-17T05:51:16.750995+0000","last_change":"2024-09-17T05:51:15.363181+0000","last_active":"2024-09-17T05:51:16.750995+0000","last_peered":"2024-09-17T05:51:16.750995+0000","last_clean":"2024-09-17T05:51:16.750995+0000","last_became_active":"2024-09-17T05:51:15.361115+0000","last_became_peered":"2024-09-17T05:51:15.361115+0000","last_unstale":"2024-09-17T05:51:16.750995+0000","last_undegraded":"2024-09-17T05:51:16.750995+0000","last_fullsized":"2024-09-17T05:51:16.750995+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:51:14.325451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:51:14.325451+0000","last_clean_scrub_stamp":"2024-09-17T05:51:14.325451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:10:46.914699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.25","version":"0'0","reported_seq":13,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-17T05:51:16.750795+0000","last_change":"2024-09-17T05:51:15.350114+0000","last_active":"2024-09-17T05:51:16.750795+0000","last_peered":"2024-09-17T05:51:16.750795+0000","last_clean":"2024-09-17T05:51:16.750795+0000","last_became_active":"2024-09-17T05:51:15.349717+0000","last_became_peered":"2024-09-17T05:51:15.349717+0000","last_unstale":"2024-09-17T05:51:16.750795+0000","last_undegraded":"2024-09-17T05:51:16.750795+0000","last_fullsized":"2024-09-17T05:51:16.750795+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:51:14.325451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:51:14.325451+0000","last_clean_scrub_stamp":"2024-09-17T05:51:14.325451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:18:04.873879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.24","version":"0'0","reported_seq":13,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-17T05:51:16.340958+0000","last_change":"2024-09-17T05:51:15.354301+0000","last_active":"2024-09-17T05:51:16.340958+0000","last_peered":"2024-09-17T05:51:16.340958+0000","last_clean":"2024-09-17T05:51:16.340958+0000","last_became_active":"2024-09-17T05:51:15.353951+0000","last_became_peered":"2024-09-17T05:51:15.353951+0000","last_unstale":"2024-09-17T05:51:16.340958+0000","last_undegraded":"2024-09-17T05:51:16.340958+0000","last_fullsized":"2024-09-17T05:51:16.340958+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:51:14.325451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:51:14.325451+0000","last_clean_scrub_stamp":"2024-09-17T05:51:14.325451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:59:08.824529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.23","version":"0'0","reported_seq":13,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-17T05:51:16.340611+0000","last_change":"2024-09-17T05:51:15.352151+0000","last_active":"2024-09-17T05:51:16.340611+0000","last_peered":"2024-09-17T05:51:16.340611+0000","last_clean":"2024-09-17T05:51:16.340611+0000","last_became_active":"2024-09-17T05:51:15.350686+0000","last_became_peered":"2024-09-17T05:51:15.350686+0000","last_unstale":"2024-09-17T05:51:16.340611+0000","last_undegraded":"2024-09-17T05:51:16.340611+0000","last_fullsized":"2024-09-17T05:51:16.340611+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:51:14.325451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:51:14.325451+0000","last_clean_scrub_stamp":"2024-09-17T05:51:14.325451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:43:23.785414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.22","version":"0'0","reported_seq":13,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-17T05:51:16.360088+0000","last_change":"2024-09-17T05:51:15.341975+0000","last_active":"2024-09-17T05:51:16.360088+0000","last_peered":"2024-09-17T05:51:16.360088+0000","last_clean":"2024-09-17T05:51:16.360088+0000","last_became_active":"2024-09-17T05:51:15.341693+0000","last_became_peered":"2024-09-17T05:51:15.341693+0000","last_unstale":"2024-09-17T05:51:16.360088+0000","last_undegraded":"2024-09-17T05:51:16.360088+0000","last_fullsized":"2024-09-17T05:51:16.360088+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:51:14.325451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:51:14.325451+0000","last_clean_scrub_stamp":"2024-09-17T05:51:14.325451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:09:41.960133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.21","version":"0'0","reported_seq":13,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-17T05:51:16.750046+0000","last_change":"2024-09-17T05:51:15.358307+0000","last_active":"2024-09-17T05:51:16.750046+0000","last_peered":"2024-09-17T05:51:16.750046+0000","last_clean":"2024-09-17T05:51:16.750046+0000","last_became_active":"2024-09-17T05:51:15.357965+0000","last_became_peered":"2024-09-17T05:51:15.357965+0000","last_unstale":"2024-09-17T05:51:16.750046+0000","last_undegraded":"2024-09-17T05:51:16.750046+0000","last_fullsized":"2024-09-17T05:51:16.750046+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:51:14.325451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:51:14.325451+0000","last_clean_scrub_stamp":"2024-09-17T05:51:14.325451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:31:22.101799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.20","version":"0'0","reported_seq":13,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-17T05:51:16.749919+0000","last_change":"2024-09-17T05:51:15.352088+0000","last_active":"2024-09-17T05:51:16.749919+0000","last_peered":"2024-09-17T05:51:16.749919+0000","last_clean":"2024-09-17T05:51:16.749919+0000","last_became_active":"2024-09-17T05:51:15.347745+0000","last_became_peered":"2024-09-17T05:51:15.347745+0000","last_unstale":"2024-09-17T05:51:16.749919+0000","last_undegraded":"2024-09-17T05:51:16.749919+0000","last_fullsized":"2024-09-17T05:51:16.749919+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:51:14.325451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:51:14.325451+0000","last_clean_scrub_stamp":"2024-09-17T05:51:14.325451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:00:48.024653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.1e","version":"0'0","reported_seq":13,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-17T05:51:16.751289+0000","last_change":"2024-09-17T05:51:15.356066+0000","last_active":"2024-09-17T05:51:16.751289+0000","last_peered":"2024-09-17T05:51:16.751289+0000","last_clean":"2024-09-17T05:51:16.751289+0000","last_became_active":"2024-09-17T05:51:15.355748+0000","last_became_peered":"2024-09-17T05:51:15.355748+0000","last_unstale":"2024-09-17T05:51:16.751289+0000","last_undegraded":"2024-09-17T05:51:16.751289+0000","last_fullsized":"2024-09-17T05:51:16.751289+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:51:14.325451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:51:14.325451+0000","last_clean_scrub_stamp":"2024-09-17T05:51:14.325451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:54:46.604153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.1f","version":"112'4","reported_seq":19,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-17T05:51:16.360144+0000","last_change":"2024-09-17T05:51:14.352310+0000","last_active":"2024-09-17T05:51:16.360144+0000","last_peered":"2024-09-17T05:51:16.360144+0000","last_clean":"2024-09-17T05:51:16.360144+0000","last_became_active":"2024-09-17T05:51:14.351942+0000","last_became_peered":"2024-09-17T05:51:14.351942+0000","last_unstale":"2024-09-17T05:51:16.360144+0000","last_undegraded":"2024-09-17T05:51:16.360144+0000","last_fullsized":"2024-09-17T05:51:16.360144+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:51:13.315624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:51:13.315624+0000","last_clean_scrub_stamp":"2024-09-17T05:51:13.315624+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:00:47.014826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.1f","version":"0'0","reported_seq":13,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-17T05:51:16.357652+0000","last_change":"2024-09-17T05:51:15.352409+0000","last_active":"2024-09-17T05:51:16.357652+0000","last_peered":"2024-09-17T05:51:16.357652+0000","last_clean":"2024-09-17T05:51:16.357652+0000","last_became_active":"2024-09-17T05:51:15.352109+0000","last_became_peered":"2024-09-17T05:51:15.352109+0000","last_unstale":"2024-09-17T05:51:16.357652+0000","last_undegraded":"2024-09-17T05:51:16.357652+0000","last_fullsized":"2024-09-17T05:51:16.357652+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:51:14.325451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:51:14.325451+0000","last_clean_scrub_stamp":"2024-09-17T05:51:14.325451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:46:13.487513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.1e","version":"112'1","reported_seq":16,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-17T05:51:16.750344+0000","last_change":"2024-09-17T05:51:14.354672+0000","last_active":"2024-09-17T05:51:16.750344+0000","last_peered":"2024-09-17T05:51:16.750344+0000","last_clean":"2024-09-17T05:51:16.750344+0000","last_became_active":"2024-09-17T05:51:14.354096+0000","last_became_peered":"2024-09-17T05:51:14.354096+0000","last_unstale":"2024-09-17T05:51:16.750344+0000","last_undegraded":"2024-09-17T05:51:16.750344+0000","last_fullsized":"2024-09-17T05:51:16.750344+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:51:13.315624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:51:13.315624+0000","last_clean_scrub_stamp":"2024-09-17T05:51:13.315624+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:16:54.432517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.1c","version":"0'0","reported_seq":13,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-17T05:51:16.751166+0000","last_change":"2024-09-17T05:51:15.349713+0000","last_active":"2024-09-17T05:51:16.751166+0000","last_peered":"2024-09-17T05:51:16.751166+0000","last_clean":"2024-09-17T05:51:16.751166+0000","last_became_active":"2024-09-17T05:51:15.347772+0000","last_became_peered":"2024-09-17T05:51:15.347772+0000","last_unstale":"2024-09-17T05:51:16.751166+0000","last_undegraded":"2024-09-17T05:51:16.751166+0000","last_fullsized":"2024-09-17T05:51:16.751166+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:51:14.325451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:51:14.325451+0000","last_clean_scrub_stamp":"2024-09-17T05:51:14.325451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:23:35.566877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.1d","version":"112'2","reported_seq":17,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-17T05:51:16.339750+0000","last_change":"2024-09-17T05:51:14.353746+0000","last_active":"2024-09-17T05:51:16.339750+0000","last_peered":"2024-09-17T05:51:16.339750+0000","last_clean":"2024-09-17T05:51:16.339750+0000","last_became_active":"2024-09-17T05:51:14.353437+0000","last_became_peered":"2024-09-17T05:51:14.353437+0000","last_unstale":"2024-09-17T05:51:16.339750+0000","last_undegraded":"2024-09-17T05:51:16.339750+0000","last_fullsized":"2024-09-17T05:51:16.339750+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:51:13.315624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:51:13.315624+0000","last_clean_scrub_stamp":"2024-09-17T05:51:13.315624+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:05:50.149362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.1d","version":"0'0","reported_seq":13,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-17T05:51:16.750902+0000","last_change":"2024-09-17T05:51:15.359061+0000","last_active":"2024-09-17T05:51:16.750902+0000","last_peered":"2024-09-17T05:51:16.750902+0000","last_clean":"2024-09-17T05:51:16.750902+0000","last_became_active":"2024-09-17T05:51:15.358754+0000","last_became_peered":"2024-09-17T05:51:15.358754+0000","last_unstale":"2024-09-17T05:51:16.750902+0000","last_undegraded":"2024-09-17T05:51:16.750902+0000","last_fullsized":"2024-09-17T05:51:16.750902+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:51:14.325451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:51:14.325451+0000","last_clean_scrub_stamp":"2024-09-17T05:51:14.325451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:43:11.980324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.1c","version":"112'2","reported_seq":17,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-17T05:51:16.339897+0000","last_change":"2024-09-17T05:51:14.349011+0000","last_active":"2024-09-17T05:51:16.339897+0000","last_peered":"2024-09-17T05:51:16.339897+0000","last_clean":"2024-09-17T05:51:16.339897+0000","last_became_active":"2024-09-17T05:51:14.348713+0000","last_became_peered":"2024-09-17T05:51:14.348713+0000","last_unstale":"2024-09-17T05:51:16.339897+0000","last_undegraded":"2024-09-17T05:51:16.339897+0000","last_fullsized":"2024-09-17T05:51:16.339897+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:51:13.315624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:51:13.315624+0000","last_clean_scrub_stamp":"2024-09-17T05:51:13.315624+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:57:40.589853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.1a","version":"0'0","reported_seq":13,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-17T05:51:16.750385+0000","last_change":"2024-09-17T05:51:15.357597+0000","last_active":"2024-09-17T05:51:16.750385+0000","last_peered":"2024-09-17T05:51:16.750385+0000","last_clean":"2024-09-17T05:51:16.750385+0000","last_became_active":"2024-09-17T05:51:15.357210+0000","last_became_peered":"2024-09-17T05:51:15.357210+0000","last_unstale":"2024-09-17T05:51:16.750385+0000","last_undegraded":"2024-09-17T05:51:16.750385+0000","last_fullsized":"2024-09-17T05:51:16.750385+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:51:14.325451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:51:14.325451+0000","last_clean_scrub_stamp":"2024-09-17T05:51:14.325451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:42:07.017454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.1b","version":"112'1","reported_seq":16,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-17T05:51:16.359714+0000","last_change":"2024-09-17T05:51:14.354735+0000","last_active":"2024-09-17T05:51:16.359714+0000","last_peered":"2024-09-17T05:51:16.359714+0000","last_clean":"2024-09-17T05:51:16.359714+0000","last_became_active":"2024-09-17T05:51:14.354173+0000","last_became_peered":"2024-09-17T05:51:14.354173+0000","last_unstale":"2024-09-17T05:51:16.359714+0000","last_undegraded":"2024-09-17T05:51:16.359714+0000","last_fullsized":"2024-09-17T05:51:16.359714+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:51:13.315624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:51:13.315624+0000","last_clean_scrub_stamp":"2024-09-17T05:51:13.315624+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:55:41.195206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.1b","version":"0'0","reported_seq":13,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-17T05:51:16.340908+0000","last_change":"2024-09-17T05:51:15.344677+0000","last_active":"2024-09-17T05:51:16.340908+0000","last_peered":"2024-09-17T05:51:16.340908+0000","last_clean":"2024-09-17T05:51:16.340908+0000","last_became_active":"2024-09-17T05:51:15.344361+0000","last_became_peered":"2024-09-17T05:51:15.344361+0000","last_unstale":"2024-09-17T05:51:16.340908+0000","last_undegraded":"2024-09-17T05:51:16.340908+0000","last_fullsized":"2024-09-17T05:51:16.340908+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:51:14.325451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:51:14.325451+0000","last_clean_scrub_stamp":"2024-09-17T05:51:14.325451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:21:22.687943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.1a","version":"112'1","reported_seq":16,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-17T05:51:16.341177+0000","last_change":"2024-09-17T05:51:14.353138+0000","last_active":"2024-09-17T05:51:16.341177+0000","last_peered":"2024-09-17T05:51:16.341177+0000","last_clean":"2024-09-17T05:51:16.341177+0000","last_became_active":"2024-09-17T05:51:14.352671+0000","last_became_peered":"2024-09-17T05:51:14.352671+0000","last_unstale":"2024-09-17T05:51:16.341177+0000","last_undegraded":"2024-09-17T05:51:16.341177+0000","last_fullsized":"2024-09-17T05:51:16.341177+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:51:13.315624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:51:13.315624+0000","last_clean_scrub_stamp":"2024-09-17T05:51:13.315624+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:05:44.644453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.18","version":"0'0","reported_seq":13,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-17T05:51:16.750049+0000","last_change":"2024-09-17T05:51:15.365013+0000","last_active":"2024-09-17T05:51:16.750049+0000","last_peered":"2024-09-17T05:51:16.750049+0000","last_clean":"2024-09-17T05:51:16.750049+0000","last_became_active":"2024-09-17T05:51:15.361925+0000","last_became_peered":"2024-09-17T05:51:15.361925+0000","last_unstale":"2024-09-17T05:51:16.750049+0000","last_undegraded":"2024-09-17T05:51:16.750049+0000","last_fullsized":"2024-09-17T05:51:16.750049+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:51:14.325451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:51:14.325451+0000","last_clean_scrub_stamp":"2024-09-17T05:51:14.325451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:12:18.133895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.19","version":"0'0","reported_seq":15,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-17T05:51:16.340804+0000","last_change":"2024-09-17T05:51:14.356410+0000","last_active":"2024-09-17T05:51:16.340804+0000","last_peered":"2024-09-17T05:51:16.340804+0000","last_clean":"2024-09-17T05:51:16.340804+0000","last_became_active":"2024-09-17T05:51:14.356114+0000","last_became_peered":"2024-09-17T05:51:14.356114+0000","last_unstale":"2024-09-17T05:51:16.340804+0000","last_undegraded":"2024-09-17T05:51:16.340804+0000","last_fullsized":"2024-09-17T05:51:16.340804+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:51:13.315624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:51:13.315624+0000","last_clean_scrub_stamp":"2024-09-17T05:51:13.315624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:27:31.390355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.19","version":"0'0","reported_seq":13,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-17T05:51:16.359869+0000","last_change":"2024-09-17T05:51:15.358103+0000","last_active":"2024-09-17T05:51:16.359869+0000","last_peered":"2024-09-17T05:51:16.359869+0000","last_clean":"2024-09-17T05:51:16.359869+0000","last_became_active":"2024-09-17T05:51:15.357513+0000","last_became_peered":"2024-09-17T05:51:15.357513+0000","last_unstale":"2024-09-17T05:51:16.359869+0000","last_undegraded":"2024-09-17T05:51:16.359869+0000","last_fullsized":"2024-09-17T05:51:16.359869+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:51:14.325451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:51:14.325451+0000","last_clean_scrub_stamp":"2024-09-17T05:51:14.325451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:51:39.791185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.18","version":"0'0","reported_seq":15,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-17T05:51:16.749997+0000","last_change":"2024-09-17T05:51:14.358240+0000","last_active":"2024-09-17T05:51:16.749997+0000","last_peered":"2024-09-17T05:51:16.749997+0000","last_clean":"2024-09-17T05:51:16.749997+0000","last_became_active":"2024-09-17T05:51:14.357827+0000","last_became_peered":"2024-09-17T05:51:14.357827+0000","last_unstale":"2024-09-17T05:51:16.749997+0000","last_undegraded":"2024-09-17T05:51:16.749997+0000","last_fullsized":"2024-09-17T05:51:16.749997+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:51:13.315624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:51:13.315624+0000","last_clean_scrub_stamp":"2024-09-17T05:51:13.315624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:47:12.074832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.16","version":"0'0","reported_seq":13,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-17T05:51:16.360215+0000","last_change":"2024-09-17T05:51:15.357705+0000","last_active":"2024-09-17T05:51:16.360215+0000","last_peered":"2024-09-17T05:51:16.360215+0000","last_clean":"2024-09-17T05:51:16.360215+0000","last_became_active":"2024-09-17T05:51:15.357029+0000","last_became_peered":"2024-09-17T05:51:15.357029+0000","last_unstale":"2024-09-17T05:51:16.360215+0000","last_undegraded":"2024-09-17T05:51:16.360215+0000","last_fullsized":"2024-09-17T05:51:16.360215+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:51:14.325451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:51:14.325451+0000","last_clean_scrub_stamp":"2024-09-17T05:51:14.325451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:29:03.820460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.17","version":"0'0","reported_seq":15,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-17T05:51:16.339454+0000","last_change":"2024-09-17T05:51:14.353904+0000","last_active":"2024-09-17T05:51:16.339454+0000","last_peered":"2024-09-17T05:51:16.339454+0000","last_clean":"2024-09-17T05:51:16.339454+0000","last_became_active":"2024-09-17T05:51:14.353591+0000","last_became_peered":"2024-09-17T05:51:14.353591+0000","last_unstale":"2024-09-17T05:51:16.339454+0000","last_undegraded":"2024-09-17T05:51:16.339454+0000","last_fullsized":"2024-09-17T05:51:16.339454+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:51:13.315624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:51:13.315624+0000","last_clean_scrub_stamp":"2024-09-17T05:51:13.315624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:13:44.186310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.17","version":"0'0","reported_seq":13,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-17T05:51:16.357574+0000","last_change":"2024-09-17T05:51:15.361884+0000","last_active":"2024-09-17T05:51:16.357574+0000","last_peered":"2024-09-17T05:51:16.357574+0000","last_clean":"2024-09-17T05:51:16.357574+0000","last_became_active":"2024-09-17T05:51:15.361562+0000","last_became_peered":"2024-09-17T05:51:15.361562+0000","last_unstale":"2024-09-17T05:51:16.357574+0000","last_undegraded":"2024-09-17T05:51:16.357574+0000","last_fullsized":"2024-09-17T05:51:16.357574+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:51:14.325451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:51:14.325451+0000","last_clean_scrub_stamp":"2024-09-17T05:51:14.325451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:46:55.155567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.16","version":"0'0","reported_seq":15,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-17T05:51:16.340693+0000","last_change":"2024-09-17T05:51:14.351671+0000","last_active":"2024-09-17T05:51:16.340693+0000","last_peered":"2024-09-17T05:51:16.340693+0000","last_clean":"2024-09-17T05:51:16.340693+0000","last_became_active":"2024-09-17T05:51:14.351378+0000","last_became_peered":"2024-09-17T05:51:14.351378+0000","last_unstale":"2024-09-17T05:51:16.340693+0000","last_undegraded":"2024-09-17T05:51:16.340693+0000","last_fullsized":"2024-09-17T05:51:16.340693+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:51:13.315624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:51:13.315624+0000","last_clean_scrub_stamp":"2024-09-17T05:51:13.315624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:13:21.431979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.14","version":"0'0","reported_seq":13,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-17T05:51:16.341035+0000","last_change":"2024-09-17T05:51:15.348925+0000","last_active":"2024-09-17T05:51:16.341035+0000","last_peered":"2024-09-17T05:51:16.341035+0000","last_clean":"2024-09-17T05:51:16.341035+0000","last_became_active":"2024-09-17T05:51:15.348098+0000","last_became_peered":"2024-09-17T05:51:15.348098+0000","last_unstale":"2024-09-17T05:51:16.341035+0000","last_undegraded":"2024-09-17T05:51:16.341035+0000","last_fullsized":"2024-09-17T05:51:16.341035+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:51:14.325451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:51:14.325451+0000","last_clean_scrub_stamp":"2024-09-17T05:51:14.325451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:45:04.503729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.15","version":"112'3","reported_seq":18,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-17T05:51:16.750631+0000","last_change":"2024-09-17T05:51:14.356145+0000","last_active":"2024-09-17T05:51:16.750631+0000","last_peered":"2024-09-17T05:51:16.750631+0000","last_clean":"2024-09-17T05:51:16.750631+0000","last_became_active":"2024-09-17T05:51:14.355770+0000","last_became_peered":"2024-09-17T05:51:14.355770+0000","last_unstale":"2024-09-17T05:51:16.750631+0000","last_undegraded":"2024-09-17T05:51:16.750631+0000","last_fullsized":"2024-09-17T05:51:16.750631+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:51:13.315624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:51:13.315624+0000","last_clean_scrub_stamp":"2024-09-17T05:51:13.315624+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:57:40.948714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.15","version":"0'0","reported_seq":13,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-17T05:51:16.359997+0000","last_change":"2024-09-17T05:51:15.354430+0000","last_active":"2024-09-17T05:51:16.359997+0000","last_peered":"2024-09-17T05:51:16.359997+0000","last_clean":"2024-09-17T05:51:16.359997+0000","last_became_active":"2024-09-17T05:51:15.353340+0000","last_became_peered":"2024-09-17T05:51:15.353340+0000","last_unstale":"2024-09-17T05:51:16.359997+0000","last_undegraded":"2024-09-17T05:51:16.359997+0000","last_fullsized":"2024-09-17T05:51:16.359997+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:51:14.325451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:51:14.325451+0000","last_clean_scrub_stamp":"2024-09-17T05:51:14.325451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:06:33.197462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.14","version":"112'6","reported_seq":21,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-17T05:51:16.750812+0000","last_change":"2024-09-17T05:51:14.356836+0000","last_active":"2024-09-17T05:51:16.750812+0000","last_peered":"2024-09-17T05:51:16.750812+0000","last_clean":"2024-09-17T05:51:16.750812+0000","last_became_active":"2024-09-17T05:51:14.356527+0000","last_became_peered":"2024-09-17T05:51:14.356527+0000","last_unstale":"2024-09-17T05:51:16.750812+0000","last_undegraded":"2024-09-17T05:51:16.750812+0000","last_fullsized":"2024-09-17T05:51:16.750812+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:51:13.315624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:51:13.315624+0000","last_clean_scrub_stamp":"2024-09-17T05:51:13.315624+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:20:52.918202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.12","version":"0'0","reported_seq":13,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-17T05:51:16.341056+0000","last_change":"2024-09-17T05:51:15.343838+0000","last_active":"2024-09-17T05:51:16.341056+0000","last_peered":"2024-09-17T05:51:16.341056+0000","last_clean":"2024-09-17T05:51:16.341056+0000","last_became_active":"2024-09-17T05:51:15.342425+0000","last_became_peered":"2024-09-17T05:51:15.342425+0000","last_unstale":"2024-09-17T05:51:16.341056+0000","last_undegraded":"2024-09-17T05:51:16.341056+0000","last_fullsized":"2024-09-17T05:51:16.341056+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:51:14.325451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:51:14.325451+0000","last_clean_scrub_stamp":"2024-09-17T05:51:14.325451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:38:28.098850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.13","version":"112'2","reported_seq":17,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-17T05:51:16.750889+0000","last_change":"2024-09-17T05:51:14.351875+0000","last_active":"2024-09-17T05:51:16.750889+0000","last_peered":"2024-09-17T05:51:16.750889+0000","last_clean":"2024-09-17T05:51:16.750889+0000","last_became_active":"2024-09-17T05:51:14.351584+0000","last_became_peered":"2024-09-17T05:51:14.351584+0000","last_unstale":"2024-09-17T05:51:16.750889+0000","last_undegraded":"2024-09-17T05:51:16.750889+0000","last_fullsized":"2024-09-17T05:51:16.750889+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:51:13.315624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:51:13.315624+0000","last_clean_scrub_stamp":"2024-09-17T05:51:13.315624+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:32:52.271894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.13","version":"0'0","reported_seq":13,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-17T05:51:16.340808+0000","last_change":"2024-09-17T05:51:15.352070+0000","last_active":"2024-09-17T05:51:16.340808+0000","last_peered":"2024-09-17T05:51:16.340808+0000","last_clean":"2024-09-17T05:51:16.340808+0000","last_became_active":"2024-09-17T05:51:15.351799+0000","last_became_peered":"2024-09-17T05:51:15.351799+0000","last_unstale":"2024-09-17T05:51:16.340808+0000","last_undegraded":"2024-09-17T05:51:16.340808+0000","last_fullsized":"2024-09-17T05:51:16.340808+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:51:14.325451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:51:14.325451+0000","last_clean_scrub_stamp":"2024-09-17T05:51:14.325451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:10:29.943649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.12","version":"0'0","reported_seq":15,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-17T05:51:16.357130+0000","last_change":"2024-09-17T05:51:14.358185+0000","last_active":"2024-09-17T05:51:16.357130+0000","last_peered":"2024-09-17T05:51:16.357130+0000","last_clean":"2024-09-17T05:51:16.357130+0000","last_became_active":"2024-09-17T05:51:14.357918+0000","last_became_peered":"2024-09-17T05:51:14.357918+0000","last_unstale":"2024-09-17T05:51:16.357130+0000","last_undegraded":"2024-09-17T05:51:16.357130+0000","last_fullsized":"2024-09-17T05:51:16.357130+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:51:13.315624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:51:13.315624+0000","last_clean_scrub_stamp":"2024-09-17T05:51:13.315624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:03:42.718274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.11","version":"0'0","reported_seq":13,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-17T05:51:16.340680+0000","last_change":"2024-09-17T05:51:15.344783+0000","last_active":"2024-09-17T05:51:16.340680+0000","last_peered":"2024-09-17T05:51:16.340680+0000","last_clean":"2024-09-17T05:51:16.340680+0000","last_became_active":"2024-09-17T05:51:15.344469+0000","last_became_peered":"2024-09-17T05:51:15.344469+0000","last_unstale":"2024-09-17T05:51:16.340680+0000","last_undegraded":"2024-09-17T05:51:16.340680+0000","last_fullsized":"2024-09-17T05:51:16.340680+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:51:14.325451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:51:14.325451+0000","last_clean_scrub_stamp":"2024-09-17T05:51:14.325451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:26:02.895405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.10","version":"112'8","reported_seq":23,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-17T05:51:16.339322+0000","last_change":"2024-09-17T05:51:14.358522+0000","last_active":"2024-09-17T05:51:16.339322+0000","last_peered":"2024-09-17T05:51:16.339322+0000","last_clean":"2024-09-17T05:51:16.339322+0000","last_became_active":"2024-09-17T05:51:14.358110+0000","last_became_peered":"2024-09-17T05:51:14.358110+0000","last_unstale":"2024-09-17T05:51:16.339322+0000","last_undegraded":"2024-09-17T05:51:16.339322+0000","last_fullsized":"2024-09-17T05:51:16.339322+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:51:13.315624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:51:13.315624+0000","last_clean_scrub_stamp":"2024-09-17T05:51:13.315624+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:16:44.660311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.e","version":"0'0","reported_seq":13,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-17T05:51:16.340190+0000","last_change":"2024-09-17T05:51:15.368761+0000","last_active":"2024-09-17T05:51:16.340190+0000","last_peered":"2024-09-17T05:51:16.340190+0000","last_clean":"2024-09-17T05:51:16.340190+0000","last_became_active":"2024-09-17T05:51:15.368438+0000","last_became_peered":"2024-09-17T05:51:15.368438+0000","last_unstale":"2024-09-17T05:51:16.340190+0000","last_undegraded":"2024-09-17T05:51:16.340190+0000","last_fullsized":"2024-09-17T05:51:16.340190+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:51:14.325451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:51:14.325451+0000","last_clean_scrub_stamp":"2024-09-17T05:51:14.325451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:55:42.205033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.f","version":"112'1","reported_seq":16,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-17T05:51:16.751513+0000","last_change":"2024-09-17T05:51:14.356610+0000","last_active":"2024-09-17T05:51:16.751513+0000","last_peered":"2024-09-17T05:51:16.751513+0000","last_clean":"2024-09-17T05:51:16.751513+0000","last_became_active":"2024-09-17T05:51:14.356240+0000","last_became_peered":"2024-09-17T05:51:14.356240+0000","last_unstale":"2024-09-17T05:51:16.751513+0000","last_undegraded":"2024-09-17T05:51:16.751513+0000","last_fullsized":"2024-09-17T05:51:16.751513+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:51:13.315624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:51:13.315624+0000","last_clean_scrub_stamp":"2024-09-17T05:51:13.315624+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:38:25.347575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.f","version":"0'0","reported_seq":13,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-17T05:51:16.751118+0000","last_change":"2024-09-17T05:51:15.363658+0000","last_active":"2024-09-17T05:51:16.751118+0000","last_peered":"2024-09-17T05:51:16.751118+0000","last_clean":"2024-09-17T05:51:16.751118+0000","last_became_active":"2024-09-17T05:51:15.363025+0000","last_became_peered":"2024-09-17T05:51:15.363025+0000","last_unstale":"2024-09-17T05:51:16.751118+0000","last_undegraded":"2024-09-17T05:51:16.751118+0000","last_fullsized":"2024-09-17T05:51:16.751118+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:51:14.325451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:51:14.325451+0000","last_clean_scrub_stamp":"2024-09-17T05:51:14.325451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:44:29.490228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.e","version":"112'2","reported_seq":17,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-17T05:51:16.340090+0000","last_change":"2024-09-17T05:51:14.350142+0000","last_active":"2024-09-17T05:51:16.340090+0000","last_peered":"2024-09-17T05:51:16.340090+0000","last_clean":"2024-09-17T05:51:16.340090+0000","last_became_active":"2024-09-17T05:51:14.349835+0000","last_became_peered":"2024-09-17T05:51:14.349835+0000","last_unstale":"2024-09-17T05:51:16.340090+0000","last_undegraded":"2024-09-17T05:51:16.340090+0000","last_fullsized":"2024-09-17T05:51:16.340090+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:51:13.315624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:51:13.315624+0000","last_clean_scrub_stamp":"2024-09-17T05:51:13.315624+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:18:05.652933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.c","version":"0'0","reported_seq":13,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-17T05:51:16.750603+0000","last_change":"2024-09-17T05:51:15.374005+0000","last_active":"2024-09-17T05:51:16.750603+0000","last_peered":"2024-09-17T05:51:16.750603+0000","last_clean":"2024-09-17T05:51:16.750603+0000","last_became_active":"2024-09-17T05:51:15.373697+0000","last_became_peered":"2024-09-17T05:51:15.373697+0000","last_unstale":"2024-09-17T05:51:16.750603+0000","last_undegraded":"2024-09-17T05:51:16.750603+0000","last_fullsized":"2024-09-17T05:51:16.750603+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:51:14.325451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:51:14.325451+0000","last_clean_scrub_stamp":"2024-09-17T05:51:14.325451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:52:25.457579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.d","version":"112'1","reported_seq":16,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-17T05:51:16.357350+0000","last_change":"2024-09-17T05:51:14.356064+0000","last_active":"2024-09-17T05:51:16.357350+0000","last_peered":"2024-09-17T05:51:16.357350+0000","last_clean":"2024-09-17T05:51:16.357350+0000","last_became_active":"2024-09-17T05:51:14.355680+0000","last_became_peered":"2024-09-17T05:51:14.355680+0000","last_unstale":"2024-09-17T05:51:16.357350+0000","last_undegraded":"2024-09-17T05:51:16.357350+0000","last_fullsized":"2024-09-17T05:51:16.357350+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:51:13.315624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:51:13.315624+0000","last_clean_scrub_stamp":"2024-09-17T05:51:13.315624+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:37:25.718715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.d","version":"0'0","reported_seq":13,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-17T05:51:16.750927+0000","last_change":"2024-09-17T05:51:15.360993+0000","last_active":"2024-09-17T05:51:16.750927+0000","last_peered":"2024-09-17T05:51:16.750927+0000","last_clean":"2024-09-17T05:51:16.750927+0000","last_became_active":"2024-09-17T05:51:15.360005+0000","last_became_peered":"2024-09-17T05:51:15.360005+0000","last_unstale":"2024-09-17T05:51:16.750927+0000","last_undegraded":"2024-09-17T05:51:16.750927+0000","last_fullsized":"2024-09-17T05:51:16.750927+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:51:14.325451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:51:14.325451+0000","last_clean_scrub_stamp":"2024-09-17T05:51:14.325451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:15:42.659548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.c","version":"0'0","reported_seq":15,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-17T05:51:16.359734+0000","last_change":"2024-09-17T05:51:14.356802+0000","last_active":"2024-09-17T05:51:16.359734+0000","last_peered":"2024-09-17T05:51:16.359734+0000","last_clean":"2024-09-17T05:51:16.359734+0000","last_became_active":"2024-09-17T05:51:14.356443+0000","last_became_peered":"2024-09-17T05:51:14.356443+0000","last_unstale":"2024-09-17T05:51:16.359734+0000","last_undegraded":"2024-09-17T05:51:16.359734+0000","last_fullsized":"2024-09-17T05:51:16.359734+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:51:13.315624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:51:13.315624+0000","last_clean_scrub_stamp":"2024-09-17T05:51:13.315624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:26:33.048310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.a","version":"0'0","reported_seq":13,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-17T05:51:16.750331+0000","last_change":"2024-09-17T05:51:15.354900+0000","last_active":"2024-09-17T05:51:16.750331+0000","last_peered":"2024-09-17T05:51:16.750331+0000","last_clean":"2024-09-17T05:51:16.750331+0000","last_became_active":"2024-09-17T05:51:15.354432+0000","last_became_peered":"2024-09-17T05:51:15.354432+0000","last_unstale":"2024-09-17T05:51:16.750331+0000","last_undegraded":"2024-09-17T05:51:16.750331+0000","last_fullsized":"2024-09-17T05:51:16.750331+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:51:14.325451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:51:14.325451+0000","last_clean_scrub_stamp":"2024-09-17T05:51:14.325451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:02:42.943141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.b","version":"112'2","reported_seq":17,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-17T05:51:16.751008+0000","last_change":"2024-09-17T05:51:14.351844+0000","last_active":"2024-09-17T05:51:16.751008+0000","last_peered":"2024-09-17T05:51:16.751008+0000","last_clean":"2024-09-17T05:51:16.751008+0000","last_became_active":"2024-09-17T05:51:14.351191+0000","last_became_peered":"2024-09-17T05:51:14.351191+0000","last_unstale":"2024-09-17T05:51:16.751008+0000","last_undegraded":"2024-09-17T05:51:16.751008+0000","last_fullsized":"2024-09-17T05:51:16.751008+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:51:13.315624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:51:13.315624+0000","last_clean_scrub_stamp":"2024-09-17T05:51:13.315624+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:21:47.493336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.b","version":"0'0","reported_seq":13,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-17T05:51:16.750534+0000","last_change":"2024-09-17T05:51:15.362196+0000","last_active":"2024-09-17T05:51:16.750534+0000","last_peered":"2024-09-17T05:51:16.750534+0000","last_clean":"2024-09-17T05:51:16.750534+0000","last_became_active":"2024-09-17T05:51:15.361901+0000","last_became_peered":"2024-09-17T05:51:15.361901+0000","last_unstale":"2024-09-17T05:51:16.750534+0000","last_undegraded":"2024-09-17T05:51:16.750534+0000","last_fullsized":"2024-09-17T05:51:16.750534+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:51:14.325451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:51:14.325451+0000","last_clean_scrub_stamp":"2024-09-17T05:51:14.325451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:19:11.895733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.a","version":"0'0","reported_seq":15,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-17T05:51:16.339399+0000","last_change":"2024-09-17T05:51:14.355042+0000","last_active":"2024-09-17T05:51:16.339399+0000","last_peered":"2024-09-17T05:51:16.339399+0000","last_clean":"2024-09-17T05:51:16.339399+0000","last_became_active":"2024-09-17T05:51:14.354728+0000","last_became_peered":"2024-09-17T05:51:14.354728+0000","last_unstale":"2024-09-17T05:51:16.339399+0000","last_undegraded":"2024-09-17T05:51:16.339399+0000","last_fullsized":"2024-09-17T05:51:16.339399+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:51:13.315624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:51:13.315624+0000","last_clean_scrub_stamp":"2024-09-17T05:51:13.315624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:03:36.768537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.8","version":"0'0","reported_seq":13,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-17T05:51:16.750402+0000","last_change":"2024-09-17T05:51:15.357234+0000","last_active":"2024-09-17T05:51:16.750402+0000","last_peered":"2024-09-17T05:51:16.750402+0000","last_clean":"2024-09-17T05:51:16.750402+0000","last_became_active":"2024-09-17T05:51:15.356159+0000","last_became_peered":"2024-09-17T05:51:15.356159+0000","last_unstale":"2024-09-17T05:51:16.750402+0000","last_undegraded":"2024-09-17T05:51:16.750402+0000","last_fullsized":"2024-09-17T05:51:16.750402+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:51:14.325451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:51:14.325451+0000","last_clean_scrub_stamp":"2024-09-17T05:51:14.325451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:12:11.367770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.9","version":"0'0","reported_seq":15,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-17T05:51:16.750271+0000","last_change":"2024-09-17T05:51:14.348936+0000","last_active":"2024-09-17T05:51:16.750271+0000","last_peered":"2024-09-17T05:51:16.750271+0000","last_clean":"2024-09-17T05:51:16.750271+0000","last_became_active":"2024-09-17T05:51:14.348618+0000","last_became_peered":"2024-09-17T05:51:14.348618+0000","last_unstale":"2024-09-17T05:51:16.750271+0000","last_undegraded":"2024-09-17T05:51:16.750271+0000","last_fullsized":"2024-09-17T05:51:16.750271+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:51:13.315624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:51:13.315624+0000","last_clean_scrub_stamp":"2024-09-17T05:51:13.315624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:03:36.561055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.9","version":"0'0","reported_seq":13,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-17T05:51:16.340732+0000","last_change":"2024-09-17T05:51:15.359252+0000","last_active":"2024-09-17T05:51:16.340732+0000","last_peered":"2024-09-17T05:51:16.340732+0000","last_clean":"2024-09-17T05:51:16.340732+0000","last_became_active":"2024-09-17T05:51:15.358940+0000","last_became_peered":"2024-09-17T05:51:15.358940+0000","last_unstale":"2024-09-17T05:51:16.340732+0000","last_undegraded":"2024-09-17T05:51:16.340732+0000","last_fullsized":"2024-09-17T05:51:16.340732+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:51:14.325451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:51:14.325451+0000","last_clean_scrub_stamp":"2024-09-17T05:51:14.325451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:12:03.752583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.8","version":"0'0","reported_seq":15,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-17T05:51:16.750081+0000","last_change":"2024-09-17T05:51:14.357171+0000","last_active":"2024-09-17T05:51:16.750081+0000","last_peered":"2024-09-17T05:51:16.750081+0000","last_clean":"2024-09-17T05:51:16.750081+0000","last_became_active":"2024-09-17T05:51:14.356893+0000","last_became_peered":"2024-09-17T05:51:14.356893+0000","last_unstale":"2024-09-17T05:51:16.750081+0000","last_undegraded":"2024-09-17T05:51:16.750081+0000","last_fullsized":"2024-09-17T05:51:16.750081+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:51:13.315624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:51:13.315624+0000","last_clean_scrub_stamp":"2024-09-17T05:51:13.315624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:25:57.986825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.6","version":"0'0","reported_seq":13,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-17T05:51:16.357443+0000","last_change":"2024-09-17T05:51:15.365607+0000","last_active":"2024-09-17T05:51:16.357443+0000","last_peered":"2024-09-17T05:51:16.357443+0000","last_clean":"2024-09-17T05:51:16.357443+0000","last_became_active":"2024-09-17T05:51:15.365266+0000","last_became_peered":"2024-09-17T05:51:15.365266+0000","last_unstale":"2024-09-17T05:51:16.357443+0000","last_undegraded":"2024-09-17T05:51:16.357443+0000","last_fullsized":"2024-09-17T05:51:16.357443+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:51:14.325451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:51:14.325451+0000","last_clean_scrub_stamp":"2024-09-17T05:51:14.325451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:49:28.476795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.7","version":"112'2","reported_seq":17,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-17T05:51:16.340820+0000","last_change":"2024-09-17T05:51:14.358131+0000","last_active":"2024-09-17T05:51:16.340820+0000","last_peered":"2024-09-17T05:51:16.340820+0000","last_clean":"2024-09-17T05:51:16.340820+0000","last_became_active":"2024-09-17T05:51:14.357812+0000","last_became_peered":"2024-09-17T05:51:14.357812+0000","last_unstale":"2024-09-17T05:51:16.340820+0000","last_undegraded":"2024-09-17T05:51:16.340820+0000","last_fullsized":"2024-09-17T05:51:16.340820+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:51:13.315624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:51:13.315624+0000","last_clean_scrub_stamp":"2024-09-17T05:51:13.315624+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:00:46.227529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.7","version":"0'0","reported_seq":13,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-17T05:51:16.751578+0000","last_change":"2024-09-17T05:51:15.358115+0000","last_active":"2024-09-17T05:51:16.751578+0000","last_peered":"2024-09-17T05:51:16.751578+0000","last_clean":"2024-09-17T05:51:16.751578+0000","last_became_active":"2024-09-17T05:51:15.357133+0000","last_became_peered":"2024-09-17T05:51:15.357133+0000","last_unstale":"2024-09-17T05:51:16.751578+0000","last_undegraded":"2024-09-17T05:51:16.751578+0000","last_fullsized":"2024-09-17T05:51:16.751578+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:51:14.325451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:51:14.325451+0000","last_clean_scrub_stamp":"2024-09-17T05:51:14.325451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:55:59.749937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.6","version":"113'1","reported_seq":16,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-17T05:51:16.357547+0000","last_change":"2024-09-17T05:51:14.353668+0000","last_active":"2024-09-17T05:51:16.357547+0000","last_peered":"2024-09-17T05:51:16.357547+0000","last_clean":"2024-09-17T05:51:16.357547+0000","last_became_active":"2024-09-17T05:51:14.353344+0000","last_became_peered":"2024-09-17T05:51:14.353344+0000","last_unstale":"2024-09-17T05:51:16.357547+0000","last_undegraded":"2024-09-17T05:51:16.357547+0000","last_fullsized":"2024-09-17T05:51:16.357547+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:51:13.315624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:51:13.315624+0000","last_clean_scrub_stamp":"2024-09-17T05:51:13.315624+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:56:25.324024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.4","version":"0'0","reported_seq":13,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-17T05:51:16.750911+0000","last_change":"2024-09-17T05:51:15.366602+0000","last_active":"2024-09-17T05:51:16.750911+0000","last_peered":"2024-09-17T05:51:16.750911+0000","last_clean":"2024-09-17T05:51:16.750911+0000","last_became_active":"2024-09-17T05:51:15.364532+0000","last_became_peered":"2024-09-17T05:51:15.364532+0000","last_unstale":"2024-09-17T05:51:16.750911+0000","last_undegraded":"2024-09-17T05:51:16.750911+0000","last_fullsized":"2024-09-17T05:51:16.750911+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:51:14.325451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:51:14.325451+0000","last_clean_scrub_stamp":"2024-09-17T05:51:14.325451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:23:37.811735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.5","version":"0'0","reported_seq":15,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-17T05:51:16.750772+0000","last_change":"2024-09-17T05:51:14.356891+0000","last_active":"2024-09-17T05:51:16.750772+0000","last_peered":"2024-09-17T05:51:16.750772+0000","last_clean":"2024-09-17T05:51:16.750772+0000","last_became_active":"2024-09-17T05:51:14.355801+0000","last_became_peered":"2024-09-17T05:51:14.355801+0000","last_unstale":"2024-09-17T05:51:16.750772+0000","last_undegraded":"2024-09-17T05:51:16.750772+0000","last_fullsized":"2024-09-17T05:51:16.750772+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:51:13.315624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:51:13.315624+0000","last_clean_scrub_stamp":"2024-09-17T05:51:13.315624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:18:48.123629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.5","version":"0'0","reported_seq":13,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-17T05:51:16.357324+0000","last_change":"2024-09-17T05:51:15.363844+0000","last_active":"2024-09-17T05:51:16.357324+0000","last_peered":"2024-09-17T05:51:16.357324+0000","last_clean":"2024-09-17T05:51:16.357324+0000","last_became_active":"2024-09-17T05:51:15.363465+0000","last_became_peered":"2024-09-17T05:51:15.363465+0000","last_unstale":"2024-09-17T05:51:16.357324+0000","last_undegraded":"2024-09-17T05:51:16.357324+0000","last_fullsized":"2024-09-17T05:51:16.357324+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:51:14.325451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:51:14.325451+0000","last_clean_scrub_stamp":"2024-09-17T05:51:14.325451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:17:42.550657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.4","version":"0'0","reported_seq":15,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-17T05:51:16.341090+0000","last_change":"2024-09-17T05:51:14.350349+0000","last_active":"2024-09-17T05:51:16.341090+0000","last_peered":"2024-09-17T05:51:16.341090+0000","last_clean":"2024-09-17T05:51:16.341090+0000","last_became_active":"2024-09-17T05:51:14.350017+0000","last_became_peered":"2024-09-17T05:51:14.350017+0000","last_unstale":"2024-09-17T05:51:16.341090+0000","last_undegraded":"2024-09-17T05:51:16.341090+0000","last_fullsized":"2024-09-17T05:51:16.341090+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:51:13.315624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:51:13.315624+0000","last_clean_scrub_stamp":"2024-09-17T05:51:13.315624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:31:26.485537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.2","version":"0'0","reported_seq":13,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-17T05:51:16.340588+0000","last_change":"2024-09-17T05:51:15.345136+0000","last_active":"2024-09-17T05:51:16.340588+0000","last_peered":"2024-09-17T05:51:16.340588+0000","last_clean":"2024-09-17T05:51:16.340588+0000","last_became_active":"2024-09-17T05:51:15.344810+0000","last_became_peered":"2024-09-17T05:51:15.344810+0000","last_unstale":"2024-09-17T05:51:16.340588+0000","last_undegraded":"2024-09-17T05:51:16.340588+0000","last_fullsized":"2024-09-17T05:51:16.340588+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:51:14.325451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:51:14.325451+0000","last_clean_scrub_stamp":"2024-09-17T05:51:14.325451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:46:58.628756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.3","version":"0'0","reported_seq":15,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-17T05:51:16.359885+0000","last_change":"2024-09-17T05:51:14.352438+0000","last_active":"2024-09-17T05:51:16.359885+0000","last_peered":"2024-09-17T05:51:16.359885+0000","last_clean":"2024-09-17T05:51:16.359885+0000","last_became_active":"2024-09-17T05:51:14.352097+0000","last_became_peered":"2024-09-17T05:51:14.352097+0000","last_unstale":"2024-09-17T05:51:16.359885+0000","last_undegraded":"2024-09-17T05:51:16.359885+0000","last_fullsized":"2024-09-17T05:51:16.359885+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:51:13.315624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:51:13.315624+0000","last_clean_scrub_stamp":"2024-09-17T05:51:13.315624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:42:26.091891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.3","version":"0'0","reported_seq":13,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-17T05:51:16.340998+0000","last_change":"2024-09-17T05:51:15.359800+0000","last_active":"2024-09-17T05:51:16.340998+0000","last_peered":"2024-09-17T05:51:16.340998+0000","last_clean":"2024-09-17T05:51:16.340998+0000","last_became_active":"2024-09-17T05:51:15.357898+0000","last_became_peered":"2024-09-17T05:51:15.357898+0000","last_unstale":"2024-09-17T05:51:16.340998+0000","last_undegraded":"2024-09-17T05:51:16.340998+0000","last_fullsized":"2024-09-17T05:51:16.340998+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:51:14.325451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:51:14.325451+0000","last_clean_scrub_stamp":"2024-09-17T05:51:14.325451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:44:07.877112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.2","version":"0'0","reported_seq":15,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-17T05:51:16.340331+0000","last_change":"2024-09-17T05:51:14.355271+0000","last_active":"2024-09-17T05:51:16.340331+0000","last_peered":"2024-09-17T05:51:16.340331+0000","last_clean":"2024-09-17T05:51:16.340331+0000","last_became_active":"2024-09-17T05:51:14.354782+0000","last_became_peered":"2024-09-17T05:51:14.354782+0000","last_unstale":"2024-09-17T05:51:16.340331+0000","last_undegraded":"2024-09-17T05:51:16.340331+0000","last_fullsized":"2024-09-17T05:51:16.340331+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:51:13.315624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:51:13.315624+0000","last_clean_scrub_stamp":"2024-09-17T05:51:13.315624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:28:04.514097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.0","version":"0'0","reported_seq":13,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-17T05:51:16.750649+0000","last_change":"2024-09-17T05:51:15.358735+0000","last_active":"2024-09-17T05:51:16.750649+0000","last_peered":"2024-09-17T05:51:16.750649+0000","last_clean":"2024-09-17T05:51:16.750649+0000","last_became_active":"2024-09-17T05:51:15.358337+0000","last_became_peered":"2024-09-17T05:51:15.358337+0000","last_unstale":"2024-09-17T05:51:16.750649+0000","last_undegraded":"2024-09-17T05:51:16.750649+0000","last_fullsized":"2024-09-17T05:51:16.750649+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:51:14.325451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:51:14.325451+0000","last_clean_scrub_stamp":"2024-09-17T05:51:14.325451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:23:41.242455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.1","version":"0'0","reported_seq":15,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-17T05:51:16.339383+0000","last_change":"2024-09-17T05:51:14.352047+0000","last_active":"2024-09-17T05:51:16.339383+0000","last_peered":"2024-09-17T05:51:16.339383+0000","last_clean":"2024-09-17T05:51:16.339383+0000","last_became_active":"2024-09-17T05:51:14.351529+0000","last_became_peered":"2024-09-17T05:51:14.351529+0000","last_unstale":"2024-09-17T05:51:16.339383+0000","last_undegraded":"2024-09-17T05:51:16.339383+0000","last_fullsized":"2024-09-17T05:51:16.339383+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:51:13.315624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:51:13.315624+0000","last_clean_scrub_stamp":"2024-09-17T05:51:13.315624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:58:57.809988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.1","version":"0'0","reported_seq":13,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-17T05:51:16.750076+0000","last_change":"2024-09-17T05:51:15.367200+0000","last_active":"2024-09-17T05:51:16.750076+0000","last_peered":"2024-09-17T05:51:16.750076+0000","last_clean":"2024-09-17T05:51:16.750076+0000","last_became_active":"2024-09-17T05:51:15.363545+0000","last_became_peered":"2024-09-17T05:51:15.363545+0000","last_unstale":"2024-09-17T05:51:16.750076+0000","last_undegraded":"2024-09-17T05:51:16.750076+0000","last_fullsized":"2024-09-17T05:51:16.750076+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:51:14.325451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:51:14.325451+0000","last_clean_scrub_stamp":"2024-09-17T05:51:14.325451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:37:20.979751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.0","version":"0'0","reported_seq":15,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-17T05:51:16.750121+0000","last_change":"2024-09-17T05:51:14.356540+0000","last_active":"2024-09-17T05:51:16.750121+0000","last_peered":"2024-09-17T05:51:16.750121+0000","last_clean":"2024-09-17T05:51:16.750121+0000","last_became_active":"2024-09-17T05:51:14.356266+0000","last_became_peered":"2024-09-17T05:51:14.356266+0000","last_unstale":"2024-09-17T05:51:16.750121+0000","last_undegraded":"2024-09-17T05:51:16.750121+0000","last_fullsized":"2024-09-17T05:51:16.750121+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:51:13.315624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:51:13.315624+0000","last_clean_scrub_stamp":"2024-09-17T05:51:13.315624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:17:29.218559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.10","version":"0'0","reported_seq":13,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-17T05:51:16.340473+0000","last_change":"2024-09-17T05:51:15.351750+0000","last_active":"2024-09-17T05:51:16.340473+0000","last_peered":"2024-09-17T05:51:16.340473+0000","last_clean":"2024-09-17T05:51:16.340473+0000","last_became_active":"2024-09-17T05:51:15.351076+0000","last_became_peered":"2024-09-17T05:51:15.351076+0000","last_unstale":"2024-09-17T05:51:16.340473+0000","last_undegraded":"2024-09-17T05:51:16.340473+0000","last_fullsized":"2024-09-17T05:51:16.340473+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:51:14.325451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:51:14.325451+0000","last_clean_scrub_stamp":"2024-09-17T05:51:14.325451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:49:55.636228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.11","version":"0'0","reported_seq":15,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-17T05:51:16.360020+0000","last_change":"2024-09-17T05:51:14.358432+0000","last_active":"2024-09-17T05:51:16.360020+0000","last_peered":"2024-09-17T05:51:16.360020+0000","last_clean":"2024-09-17T05:51:16.360020+0000","last_became_active":"2024-09-17T05:51:14.358059+0000","last_became_peered":"2024-09-17T05:51:14.358059+0000","last_unstale":"2024-09-17T05:51:16.360020+0000","last_undegraded":"2024-09-17T05:51:16.360020+0000","last_fullsized":"2024-09-17T05:51:16.360020+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:51:13.315624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:51:13.315624+0000","last_clean_scrub_stamp":"2024-09-17T05:51:13.315624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:32:58.129426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"19'72","reported_seq":276,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-17T05:51:16.750680+0000","last_change":"2024-09-17T05:41:48.539830+0000","last_active":"2024-09-17T05:51:16.750680+0000","last_peered":"2024-09-17T05:51:16.750680+0000","last_clean":"2024-09-17T05:51:16.750680+0000","last_became_active":"2024-09-17T05:41:48.538743+0000","last_became_peered":"2024-09-17T05:41:48.538743+0000","last_unstale":"2024-09-17T05:51:16.750680+0000","last_undegraded":"2024-09-17T05:51:16.750680+0000","last_fullsized":"2024-09-17T05:51:16.750680+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:47.152539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:47.152539+0000","last_clean_scrub_stamp":"2024-09-17T05:41:47.152539+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:08:02.952016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":17,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":16,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":16,"seq":68719476855,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":122740,"kb_used_data":1368,"kb_used_omap":1,"kb_used_meta":121342,"kb_avail":94249100,"statfs":{"total":96636764160,"available":96511078400,"internally_reserved":0,"allocated":1400832,"data_stored":608982,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":124254662},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":7,"up_from":15,"seq":64424509560,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":131640,"kb_used_data":1952,"kb_used_omap":1,"kb_used_meta":129662,"kb_avail":94240200,"statfs":{"total":96636764160,"available":96501964800,"internally_reserved":0,"allocated":1998848,"data_stored":1199896,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":132774346},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509559,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":108848,"kb_used_data":1372,"kb_used_omap":1,"kb_used_meta":107454,"kb_avail":94262992,"statfs":{"total":96636764160,"available":96525303808,"internally_reserved":0,"allocated":1404928,"data_stored":609516,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":110033349},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509559,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":136624,"kb_used_data":1364,"kb_used_omap":1,"kb_used_meta":135230,"kb_avail":94235216,"statfs":{"total":96636764160,"available":96496861184,"internally_reserved":0,"allocated":1396736,"data_stored":608912,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":138475973},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509559,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":131064,"kb_used_data":1380,"kb_used_omap":1,"kb_used_meta":129662,"kb_avail":94240776,"statfs":{"total":96636764160,"available":96502554624,"internally_reserved":0,"allocated":1413120,"data_stored":610594,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":132774343},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509559,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":136620,"kb_used_data":1364,"kb_used_omap":1,"kb_used_meta":135230,"kb_avail":94235220,"statfs":{"total":96636764160,"available":96496865280,"internally_reserved":0,"allocated":1396736,"data_stored":608912,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":138475973},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509558,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":122740,"kb_used_data":1372,"kb_used_omap":1,"kb_used_meta":121342,"kb_avail":94249100,"statfs":{"total":96636764160,"available":96511078400,"internally_reserved":0,"allocated":1404928,"data_stored":609036,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":124254661},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574966,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":119172,"kb_used_data":1964,"kb_used_omap":1,"kb_used_meta":117182,"kb_avail":94252668,"statfs":{"total":96636764160,"available":96514732032,"internally_reserved":0,"allocated":2011136,"data_stored":1201004,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":119994821},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1682,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-17T05:51:24.152 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-17T05:51:24.152 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-09-17T05:51:24.310 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:24.309+0000 7f70e7c84640 1 -- 172.21.15.150:0/2210685632 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f70e00b69c0 msgr2=0x7f70e00b2800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:51:24.310 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:24.309+0000 7f70e7c84640 1 --2- 172.21.15.150:0/2210685632 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f70e00b69c0 0x7f70e00b2800 secure :-1 s=READY pgs=1510 cs=0 l=1 rev1=1 crypto rx=0x7f70e00cee90 tx=0x7f70d402a4d0 comp rx=0 tx=0).stop 2024-09-17T05:51:24.311 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:24.309+0000 7f70e7c84640 1 -- 172.21.15.150:0/2210685632 shutdown_connections 2024-09-17T05:51:24.311 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:24.309+0000 7f70e7c84640 1 --2- 172.21.15.150:0/2210685632 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f70e00b69c0 0x7f70e00b2800 unknown :-1 s=CLOSED pgs=1510 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:51:24.311 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:24.309+0000 7f70e7c84640 1 --2- 172.21.15.150:0/2210685632 >> v2:172.21.15.176:3300/0 conn(0x7f70e00b39a0 0x7f70e00b22c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:51:24.311 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:24.309+0000 7f70e7c84640 1 -- 172.21.15.150:0/2210685632 >> 172.21.15.150:0/2210685632 conn(0x7f70e00b2e80 msgr2=0x7f70e00b3290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:51:24.311 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:24.309+0000 7f70e7c84640 1 -- 172.21.15.150:0/2210685632 shutdown_connections 2024-09-17T05:51:24.311 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:24.309+0000 7f70e7c84640 1 -- 172.21.15.150:0/2210685632 wait complete. 2024-09-17T05:51:24.312 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:24.311+0000 7f70e7c84640 1 Processor -- start 2024-09-17T05:51:24.312 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:24.311+0000 7f70e7c84640 1 -- start start 2024-09-17T05:51:24.314 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:24.312+0000 7f70e7c84640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f70e00b39a0 0x7f70e01492b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:51:24.314 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:24.312+0000 7f70e7c84640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f70e00b69c0 0x7f70e01f9010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:51:24.315 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:24.312+0000 7f70e7c84640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f70e015ee30 0x7f70e01f9550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:51:24.315 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:24.312+0000 7f70e7c84640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f70e006d4b0 con 0x7f70e00b69c0 2024-09-17T05:51:24.315 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:24.312+0000 7f70e7c84640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f70e00b15b0 con 0x7f70e015ee30 2024-09-17T05:51:24.315 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:24.312+0000 7f70e7c84640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f70e006d630 con 0x7f70e00b39a0 2024-09-17T05:51:24.315 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:24.312+0000 7f70e521f640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f70e00b69c0 0x7f70e01f9010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:51:24.315 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:24.312+0000 7f70e521f640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f70e00b69c0 0x7f70e01f9010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:57640/0 (socket says 172.21.15.150:57640) 2024-09-17T05:51:24.315 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:24.313+0000 7f70e521f640 1 -- 172.21.15.150:0/2052794223 learned_addr learned my addr 172.21.15.150:0/2052794223 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:51:24.315 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:24.313+0000 7f70e5a20640 1 --2- 172.21.15.150:0/2052794223 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f70e00b39a0 0x7f70e01492b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:51:24.315 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:24.313+0000 7f70e6221640 1 --2- 172.21.15.150:0/2052794223 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f70e015ee30 0x7f70e01f9550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:51:24.315 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:24.313+0000 7f70e521f640 1 -- 172.21.15.150:0/2052794223 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f70e00b39a0 msgr2=0x7f70e01492b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:51:24.315 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:24.313+0000 7f70e521f640 1 --2- 172.21.15.150:0/2052794223 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f70e00b39a0 0x7f70e01492b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:51:24.316 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:24.313+0000 7f70e521f640 1 -- 172.21.15.150:0/2052794223 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f70e015ee30 msgr2=0x7f70e01f9550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:51:24.316 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:24.313+0000 7f70e521f640 1 --2- 172.21.15.150:0/2052794223 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f70e015ee30 0x7f70e01f9550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:51:24.316 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:24.313+0000 7f70e521f640 1 -- 172.21.15.150:0/2052794223 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f70e0158ab0 con 0x7f70e00b69c0 2024-09-17T05:51:24.316 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:24.313+0000 7f70e521f640 1 --2- 172.21.15.150:0/2052794223 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f70e00b69c0 0x7f70e01f9010 secure :-1 s=READY pgs=1511 cs=0 l=1 rev1=1 crypto rx=0x7f70d4034040 tx=0x7f70d4003910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:51:24.316 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:24.313+0000 7f70de7fc640 1 -- 172.21.15.150:0/2052794223 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70d403e030 con 0x7f70e00b69c0 2024-09-17T05:51:24.316 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:24.313+0000 7f70de7fc640 1 -- 172.21.15.150:0/2052794223 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f70d4003e00 con 0x7f70e00b69c0 2024-09-17T05:51:24.316 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:24.313+0000 7f70de7fc640 1 -- 172.21.15.150:0/2052794223 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70d4035040 con 0x7f70e00b69c0 2024-09-17T05:51:24.316 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:24.313+0000 7f70e7c84640 1 -- 172.21.15.150:0/2052794223 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f70e0158d90 con 0x7f70e00b69c0 2024-09-17T05:51:24.316 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:24.313+0000 7f70e7c84640 1 -- 172.21.15.150:0/2052794223 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f70e0159350 con 0x7f70e00b69c0 2024-09-17T05:51:24.317 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:24.314+0000 7f70e7c84640 1 -- 172.21.15.150:0/2052794223 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f70e01566c0 con 0x7f70e00b69c0 2024-09-17T05:51:24.317 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:24.315+0000 7f70de7fc640 1 -- 172.21.15.150:0/2052794223 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 37) ==== 103787+0+0 (secure 0 0 0) 0x7f70d4041030 con 0x7f70e00b69c0 2024-09-17T05:51:24.317 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:24.316+0000 7f70de7fc640 1 --2- 172.21.15.150:0/2052794223 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f70cc07a570 0x7f70cc07ca80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:51:24.317 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:24.316+0000 7f70de7fc640 1 -- 172.21.15.150:0/2052794223 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(113..113 src has 1..113) ==== 5849+0+0 (secure 0 0 0) 0x7f70d40ba5f0 con 0x7f70e00b69c0 2024-09-17T05:51:24.318 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:24.316+0000 7f70e5a20640 1 --2- 172.21.15.150:0/2052794223 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f70cc07a570 0x7f70cc07ca80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:51:24.318 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:24.316+0000 7f70e5a20640 1 --2- 172.21.15.150:0/2052794223 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f70cc07a570 0x7f70cc07ca80 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7f70e009f4b0 tx=0x7f70d00095e0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:51:24.320 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:24.319+0000 7f70de7fc640 1 -- 172.21.15.150:0/2052794223 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f70d4084050 con 0x7f70e00b69c0 2024-09-17T05:51:24.566 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:24.566+0000 7f70e7c84640 1 -- 172.21.15.150:0/2052794223 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) -- 0x7f70e006db20 con 0x7f70e00b69c0 2024-09-17T05:51:24.569 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:24.569+0000 7f70de7fc640 1 -- 172.21.15.150:0/2052794223 <== mon.0 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v18) ==== 190+0+147 (secure 0 0 0) 0x7f70d4088a80 con 0x7f70e00b69c0 2024-09-17T05:51:24.569 INFO:teuthology.orchestra.run.smithi150.stdout:[client.0] 2024-09-17T05:51:24.569 INFO:teuthology.orchestra.run.smithi150.stdout: key = AQBoFulmfF/1HBAAMezEjZDeoHTJ+uFfDXNWHQ== 2024-09-17T05:51:24.570 INFO:teuthology.orchestra.run.smithi150.stdout: caps mds = "allow" 2024-09-17T05:51:24.570 INFO:teuthology.orchestra.run.smithi150.stdout: caps mon = "allow r" 2024-09-17T05:51:24.570 INFO:teuthology.orchestra.run.smithi150.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2024-09-17T05:51:24.570 INFO:teuthology.orchestra.run.smithi150.stderr:updated caps for client.0 2024-09-17T05:51:24.572 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:24.571+0000 7f70e7c84640 1 -- 172.21.15.150:0/2052794223 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f70cc07a570 msgr2=0x7f70cc07ca80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:51:24.572 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:24.571+0000 7f70e7c84640 1 --2- 172.21.15.150:0/2052794223 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f70cc07a570 0x7f70cc07ca80 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7f70e009f4b0 tx=0x7f70d00095e0 comp rx=0 tx=0).stop 2024-09-17T05:51:24.572 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:24.571+0000 7f70e7c84640 1 -- 172.21.15.150:0/2052794223 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f70e00b69c0 msgr2=0x7f70e01f9010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:51:24.572 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:24.571+0000 7f70e7c84640 1 --2- 172.21.15.150:0/2052794223 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f70e00b69c0 0x7f70e01f9010 secure :-1 s=READY pgs=1511 cs=0 l=1 rev1=1 crypto rx=0x7f70d4034040 tx=0x7f70d4003910 comp rx=0 tx=0).stop 2024-09-17T05:51:24.572 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:24.571+0000 7f70e7c84640 1 -- 172.21.15.150:0/2052794223 shutdown_connections 2024-09-17T05:51:24.572 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:24.571+0000 7f70e7c84640 1 --2- 172.21.15.150:0/2052794223 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f70e015ee30 0x7f70e01f9550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:51:24.572 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:24.571+0000 7f70e7c84640 1 --2- 172.21.15.150:0/2052794223 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f70cc07a570 0x7f70cc07ca80 unknown :-1 s=CLOSED pgs=645 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:51:24.573 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:24.571+0000 7f70e7c84640 1 --2- 172.21.15.150:0/2052794223 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f70e00b69c0 0x7f70e01f9010 unknown :-1 s=CLOSED pgs=1511 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:51:24.573 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:24.571+0000 7f70e7c84640 1 --2- 172.21.15.150:0/2052794223 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f70e00b39a0 0x7f70e01492b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:51:24.573 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:24.571+0000 7f70e7c84640 1 -- 172.21.15.150:0/2052794223 >> 172.21.15.150:0/2052794223 conn(0x7f70e00b2e80 msgr2=0x7f70e00b61b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:51:24.573 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:24.571+0000 7f70e7c84640 1 -- 172.21.15.150:0/2052794223 shutdown_connections 2024-09-17T05:51:24.573 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:24.571+0000 7f70e7c84640 1 -- 172.21.15.150:0/2052794223 wait complete. 2024-09-17T05:51:24.583 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T05:51:24.697 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:24.696+0000 7fd24cad5640 1 -- 172.21.15.150:0/66067412 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd2480b5410 msgr2=0x7fd2480b5820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:51:24.697 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:24.696+0000 7fd24cad5640 1 --2- 172.21.15.150:0/66067412 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd2480b5410 0x7fd2480b5820 secure :-1 s=READY pgs=1513 cs=0 l=1 rev1=1 crypto rx=0x7fd248073cf0 tx=0x7fd24002a8b0 comp rx=0 tx=0).stop 2024-09-17T05:51:24.697 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:24.696+0000 7fd24cad5640 1 -- 172.21.15.150:0/66067412 shutdown_connections 2024-09-17T05:51:24.697 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:24.696+0000 7fd24cad5640 1 --2- 172.21.15.150:0/66067412 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd2480b5410 0x7fd2480b5820 unknown :-1 s=CLOSED pgs=1513 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:51:24.697 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:24.696+0000 7fd24cad5640 1 --2- 172.21.15.150:0/66067412 >> v2:172.21.15.176:3300/0 conn(0x7fd24815ee30 0x7fd2480b2840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:51:24.697 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:24.696+0000 7fd24cad5640 1 -- 172.21.15.150:0/66067412 >> 172.21.15.150:0/66067412 conn(0x7fd2480b2fd0 msgr2=0x7fd2480b33e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:51:24.697 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:24.696+0000 7fd24cad5640 1 -- 172.21.15.150:0/66067412 shutdown_connections 2024-09-17T05:51:24.697 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:24.696+0000 7fd24cad5640 1 -- 172.21.15.150:0/66067412 wait complete. 2024-09-17T05:51:24.698 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:24.698+0000 7fd24cad5640 1 Processor -- start 2024-09-17T05:51:24.698 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:24.698+0000 7fd24cad5640 1 -- start start 2024-09-17T05:51:24.701 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:24.699+0000 7fd24cad5640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd2480b5410 0x7fd24815ac60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:51:24.701 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:24.699+0000 7fd24cad5640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd2480cf7c0 0x7fd2481537a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:51:24.701 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:24.699+0000 7fd24cad5640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd24815ee30 0x7fd2480c5b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:51:24.701 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:24.699+0000 7fd24cad5640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7fd2480b6120 con 0x7fd24815ee30 2024-09-17T05:51:24.701 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:24.699+0000 7fd24cad5640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fd2480b5fa0 con 0x7fd2480b5410 2024-09-17T05:51:24.701 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:24.699+0000 7fd24cad5640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fd2480b62a0 con 0x7fd2480cf7c0 2024-09-17T05:51:24.702 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:24.699+0000 7fd246d9d640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd24815ee30 0x7fd2480c5b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:51:24.702 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:24.699+0000 7fd246d9d640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd24815ee30 0x7fd2480c5b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:57662/0 (socket says 172.21.15.150:57662) 2024-09-17T05:51:24.702 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:24.699+0000 7fd246d9d640 1 -- 172.21.15.150:0/3478153338 learned_addr learned my addr 172.21.15.150:0/3478153338 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:51:24.702 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:24.699+0000 7fd24659c640 1 --2- 172.21.15.150:0/3478153338 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd2480b5410 0x7fd24815ac60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:51:24.702 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:24.699+0000 7fd246d9d640 1 -- 172.21.15.150:0/3478153338 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd2480cf7c0 msgr2=0x7fd2481537a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:51:24.702 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:24.699+0000 7fd245d9b640 1 --2- 172.21.15.150:0/3478153338 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd2480cf7c0 0x7fd2481537a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:51:24.702 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:24.699+0000 7fd246d9d640 1 --2- 172.21.15.150:0/3478153338 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd2480cf7c0 0x7fd2481537a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:51:24.702 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:24.699+0000 7fd246d9d640 1 -- 172.21.15.150:0/3478153338 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd2480b5410 msgr2=0x7fd24815ac60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:51:24.702 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:24.699+0000 7fd246d9d640 1 --2- 172.21.15.150:0/3478153338 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd2480b5410 0x7fd24815ac60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:51:24.702 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:24.699+0000 7fd246d9d640 1 -- 172.21.15.150:0/3478153338 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd248153ce0 con 0x7fd24815ee30 2024-09-17T05:51:24.702 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:24.699+0000 7fd24659c640 1 --2- 172.21.15.150:0/3478153338 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd2480b5410 0x7fd24815ac60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T05:51:24.702 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:24.700+0000 7fd246d9d640 1 --2- 172.21.15.150:0/3478153338 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd24815ee30 0x7fd2480c5b70 secure :-1 s=READY pgs=1514 cs=0 l=1 rev1=1 crypto rx=0x7fd24002aea0 tx=0x7fd240003990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:51:24.702 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:24.700+0000 7fd236ffd640 1 -- 172.21.15.150:0/3478153338 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd240031990 con 0x7fd24815ee30 2024-09-17T05:51:24.703 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:24.700+0000 7fd236ffd640 1 -- 172.21.15.150:0/3478153338 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd240031c20 con 0x7fd24815ee30 2024-09-17T05:51:24.703 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:24.700+0000 7fd24cad5640 1 -- 172.21.15.150:0/3478153338 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd24809e820 con 0x7fd24815ee30 2024-09-17T05:51:24.703 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:24.700+0000 7fd236ffd640 1 -- 172.21.15.150:0/3478153338 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd240033070 con 0x7fd24815ee30 2024-09-17T05:51:24.703 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:24.700+0000 7fd24cad5640 1 -- 172.21.15.150:0/3478153338 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd24809ede0 con 0x7fd24815ee30 2024-09-17T05:51:24.704 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:24.701+0000 7fd24cad5640 1 -- 172.21.15.150:0/3478153338 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd24809e590 con 0x7fd24815ee30 2024-09-17T05:51:24.704 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:24.702+0000 7fd236ffd640 1 -- 172.21.15.150:0/3478153338 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 37) ==== 103787+0+0 (secure 0 0 0) 0x7fd240033230 con 0x7fd24815ee30 2024-09-17T05:51:24.704 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:24.702+0000 7fd236ffd640 1 --2- 172.21.15.150:0/3478153338 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fd22807a570 0x7fd22807ca80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:51:24.704 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:24.702+0000 7fd236ffd640 1 -- 172.21.15.150:0/3478153338 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(113..113 src has 1..113) ==== 5849+0+0 (secure 0 0 0) 0x7fd2400bb130 con 0x7fd24815ee30 2024-09-17T05:51:24.704 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:24.702+0000 7fd24659c640 1 --2- 172.21.15.150:0/3478153338 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fd22807a570 0x7fd22807ca80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:51:24.704 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:24.703+0000 7fd24659c640 1 --2- 172.21.15.150:0/3478153338 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fd22807a570 0x7fd22807ca80 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7fd2480d0de0 tx=0x7fd238005dd0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:51:24.707 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:24.707+0000 7fd236ffd640 1 -- 172.21.15.150:0/3478153338 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fd24003f030 con 0x7fd24815ee30 2024-09-17T05:51:24.914 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:24.914+0000 7fd24cad5640 1 -- 172.21.15.150:0/3478153338 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fd2480b67c0 con 0x7fd24815ee30 2024-09-17T05:51:24.915 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:24.914+0000 7fd236ffd640 1 -- 172.21.15.150:0/3478153338 <== mon.0 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 70 v70) ==== 94+0+5237 (secure 0 0 0) 0x7fd240085100 con 0x7fd24815ee30 2024-09-17T05:51:24.915 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-09-17T05:51:24.915 INFO:teuthology.orchestra.run.smithi150.stdout:{"epoch":70,"btime":"2024-09-17T05:51:18:358727+0000","default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6779,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6836/2908904841","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6835","nonce":2908904841},{"type":"v1","addr":"172.21.15.176:6836","nonce":2908904841}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":65},{"gid":6782,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6837/2764909757","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6834","nonce":2764909757},{"type":"v1","addr":"172.21.15.176:6837","nonce":2764909757}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":65},{"gid":8568,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6834/1970670297","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6832","nonce":1970670297},{"type":"v1","addr":"172.21.15.150:6834","nonce":1970670297}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":64}],"filesystems":[{"mdsmap":{"epoch":70,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T05:51:14.699714+0000","modified":"2024-09-17T05:51:17.724183+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":8571},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8571":{"gid":8571,"name":"c","rank":0,"incarnation":66,"state":"up:active","state_seq":3,"addr":"172.21.15.150:6835/4047640601","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6833","nonce":4047640601},{"type":"v1","addr":"172.21.15.150:6835","nonce":4047640601}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":8571,"qdb_cluster":[8571]},"id":8}]} 2024-09-17T05:51:24.915 INFO:teuthology.orchestra.run.smithi150.stderr:dumped fsmap epoch 70 2024-09-17T05:51:24.918 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:24.917+0000 7fd24cad5640 1 -- 172.21.15.150:0/3478153338 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fd22807a570 msgr2=0x7fd22807ca80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:51:24.918 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:24.917+0000 7fd24cad5640 1 --2- 172.21.15.150:0/3478153338 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fd22807a570 0x7fd22807ca80 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7fd2480d0de0 tx=0x7fd238005dd0 comp rx=0 tx=0).stop 2024-09-17T05:51:24.918 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:24.917+0000 7fd24cad5640 1 -- 172.21.15.150:0/3478153338 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd24815ee30 msgr2=0x7fd2480c5b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:51:24.918 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:24.917+0000 7fd24cad5640 1 --2- 172.21.15.150:0/3478153338 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd24815ee30 0x7fd2480c5b70 secure :-1 s=READY pgs=1514 cs=0 l=1 rev1=1 crypto rx=0x7fd24002aea0 tx=0x7fd240003990 comp rx=0 tx=0).stop 2024-09-17T05:51:24.918 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:24.917+0000 7fd24cad5640 1 -- 172.21.15.150:0/3478153338 shutdown_connections 2024-09-17T05:51:24.918 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:24.917+0000 7fd24cad5640 1 --2- 172.21.15.150:0/3478153338 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fd22807a570 0x7fd22807ca80 unknown :-1 s=CLOSED pgs=646 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:51:24.918 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:24.917+0000 7fd24cad5640 1 --2- 172.21.15.150:0/3478153338 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd24815ee30 0x7fd2480c5b70 unknown :-1 s=CLOSED pgs=1514 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:51:24.918 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:24.917+0000 7fd24cad5640 1 --2- 172.21.15.150:0/3478153338 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd2480cf7c0 0x7fd2481537a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:51:24.918 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:24.917+0000 7fd24cad5640 1 --2- 172.21.15.150:0/3478153338 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd2480b5410 0x7fd24815ac60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:51:24.918 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:24.917+0000 7fd24cad5640 1 -- 172.21.15.150:0/3478153338 >> 172.21.15.150:0/3478153338 conn(0x7fd2480b2fd0 msgr2=0x7fd248070f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:51:24.918 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:24.917+0000 7fd24cad5640 1 -- 172.21.15.150:0/3478153338 shutdown_connections 2024-09-17T05:51:24.918 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:24.917+0000 7fd24cad5640 1 -- 172.21.15.150:0/3478153338 wait complete. 2024-09-17T05:51:25.332 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 70, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-17T05:51:14.699714+0000', 'modified': '2024-09-17T05:51:17.724183+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 8571}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_8571': {'gid': 8571, 'name': 'c', 'rank': 0, 'incarnation': 66, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.150:6835/4047640601', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.150:6833', 'nonce': 4047640601}, {'type': 'v1', 'addr': '172.21.15.150:6835', 'nonce': 4047640601}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [17], 'metadata_pool': 16, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 8571, 'qdb_cluster': [8571]} 2024-09-17T05:51:25.332 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-17T05:51:25.332 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2024-09-17T05:51:25.452 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:25.451+0000 7f4f2b5b6640 1 -- 172.21.15.150:0/1994725954 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4f10003a80 msgr2=0x7f4f10003ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:51:25.452 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:25.451+0000 7f4f2b5b6640 1 --2- 172.21.15.150:0/1994725954 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4f10003a80 0x7f4f10003ef0 secure :-1 s=READY pgs=1516 cs=0 l=1 rev1=1 crypto rx=0x7f4f200016b0 tx=0x7f4f10005830 comp rx=0 tx=0).stop 2024-09-17T05:51:25.452 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:25.451+0000 7f4f29b53640 1 -- 172.21.15.150:0/1994725954 reap_dead start 2024-09-17T05:51:25.452 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:25.451+0000 7f4f2b5b6640 1 -- 172.21.15.150:0/1994725954 shutdown_connections 2024-09-17T05:51:25.452 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:25.451+0000 7f4f2b5b6640 1 -- 172.21.15.150:0/1994725954 >> 172.21.15.150:0/1994725954 conn(0x7f4f240cee80 msgr2=0x7f4f240cf290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:51:25.452 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:25.451+0000 7f4f2b5b6640 1 -- 172.21.15.150:0/1994725954 shutdown_connections 2024-09-17T05:51:25.453 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:25.451+0000 7f4f2b5b6640 1 -- 172.21.15.150:0/1994725954 wait complete. 2024-09-17T05:51:25.453 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:25.453+0000 7f4f2b5b6640 1 Processor -- start 2024-09-17T05:51:25.453 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:25.453+0000 7f4f2b5b6640 1 -- start start 2024-09-17T05:51:25.456 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:25.454+0000 7f4f2b5b6640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4f10003a80 0x7f4f241d4240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:51:25.456 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:25.454+0000 7f4f2b5b6640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4f241d1ca0 0x7f4f241d4780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:51:25.456 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:25.454+0000 7f4f2b5b6640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4f241d4cc0 0x7f4f241e5030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:51:25.456 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:25.454+0000 7f4f2b5b6640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f4f240d0bf0 con 0x7f4f241d1ca0 2024-09-17T05:51:25.456 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:25.454+0000 7f4f2b5b6640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f4f240cfdc0 con 0x7f4f241d4cc0 2024-09-17T05:51:25.456 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:25.454+0000 7f4f2b5b6640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f4f240d0d70 con 0x7f4f10003a80 2024-09-17T05:51:25.456 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:25.454+0000 7f4f28b51640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4f241d1ca0 0x7f4f241d4780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:51:25.456 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:25.454+0000 7f4f28b51640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4f241d1ca0 0x7f4f241d4780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:57678/0 (socket says 172.21.15.150:57678) 2024-09-17T05:51:25.457 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:25.454+0000 7f4f28b51640 1 -- 172.21.15.150:0/1351482540 learned_addr learned my addr 172.21.15.150:0/1351482540 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:51:25.457 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:25.454+0000 7f4f29352640 1 --2- 172.21.15.150:0/1351482540 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4f10003a80 0x7f4f241d4240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:51:25.457 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:25.454+0000 7f4f29b53640 1 --2- 172.21.15.150:0/1351482540 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4f241d4cc0 0x7f4f241e5030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:51:25.457 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:25.454+0000 7f4f28b51640 1 -- 172.21.15.150:0/1351482540 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4f10003a80 msgr2=0x7f4f241d4240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:51:25.457 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:25.454+0000 7f4f28b51640 1 --2- 172.21.15.150:0/1351482540 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4f10003a80 0x7f4f241d4240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:51:25.457 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:25.454+0000 7f4f28b51640 1 -- 172.21.15.150:0/1351482540 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4f241d4cc0 msgr2=0x7f4f241e5030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:51:25.457 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:25.454+0000 7f4f28b51640 1 --2- 172.21.15.150:0/1351482540 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4f241d4cc0 0x7f4f241e5030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:51:25.457 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:25.454+0000 7f4f28b51640 1 -- 172.21.15.150:0/1351482540 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4f2409cb70 con 0x7f4f241d1ca0 2024-09-17T05:51:25.457 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:25.455+0000 7f4f29352640 1 --2- 172.21.15.150:0/1351482540 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4f10003a80 0x7f4f241d4240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:51:25.457 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:25.455+0000 7f4f29b53640 1 --2- 172.21.15.150:0/1351482540 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4f241d4cc0 0x7f4f241e5030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:51:25.457 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:25.455+0000 7f4f28b51640 1 --2- 172.21.15.150:0/1351482540 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4f241d1ca0 0x7f4f241d4780 secure :-1 s=READY pgs=1517 cs=0 l=1 rev1=1 crypto rx=0x7f4f14004650 tx=0x7f4f1400ba40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:51:25.457 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:25.455+0000 7f4f19ffb640 1 -- 172.21.15.150:0/1351482540 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f14010790 con 0x7f4f241d1ca0 2024-09-17T05:51:25.458 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:25.455+0000 7f4f19ffb640 1 -- 172.21.15.150:0/1351482540 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f4f14010930 con 0x7f4f241d1ca0 2024-09-17T05:51:25.458 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:25.455+0000 7f4f19ffb640 1 -- 172.21.15.150:0/1351482540 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f14010d60 con 0x7f4f241d1ca0 2024-09-17T05:51:25.458 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:25.455+0000 7f4f2b5b6640 1 -- 172.21.15.150:0/1351482540 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4f2409c5f0 con 0x7f4f241d1ca0 2024-09-17T05:51:25.458 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:25.455+0000 7f4f2b5b6640 1 -- 172.21.15.150:0/1351482540 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4f2409f390 con 0x7f4f241d1ca0 2024-09-17T05:51:25.459 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:25.457+0000 7f4f19ffb640 1 -- 172.21.15.150:0/1351482540 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 37) ==== 103787+0+0 (secure 0 0 0) 0x7f4f14023440 con 0x7f4f241d1ca0 2024-09-17T05:51:25.459 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:25.457+0000 7f4f19ffb640 1 --2- 172.21.15.150:0/1351482540 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f4f0807a5a0 0x7f4f0807cab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:51:25.459 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:25.458+0000 7f4f19ffb640 1 -- 172.21.15.150:0/1351482540 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(113..113 src has 1..113) ==== 5849+0+0 (secure 0 0 0) 0x7f4f1409a7f0 con 0x7f4f241d1ca0 2024-09-17T05:51:25.459 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:25.458+0000 7f4f29352640 1 --2- 172.21.15.150:0/1351482540 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f4f0807a5a0 0x7f4f0807cab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:51:25.459 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:25.458+0000 7f4f325ff740 1 Processor -- start 2024-09-17T05:51:25.459 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:25.458+0000 7f4f325ff740 1 -- start start 2024-09-17T05:51:25.459 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:25.458+0000 7f4f29352640 1 --2- 172.21.15.150:0/1351482540 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f4f0807a5a0 0x7f4f0807cab0 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7f4f20001680 tx=0x7f4f200011e0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:51:25.462 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:25.459+0000 7f4f325ff740 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55f2b8672270 0x55f2b8a43fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:51:25.462 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:25.459+0000 7f4f325ff740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55f2b86493b0 0x55f2b8a444e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:51:25.462 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:25.459+0000 7f4f325ff740 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55f2b8651590 0x55f2b8a613e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:51:25.462 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:25.460+0000 7f4f325ff740 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x55f2b898c820 con 0x55f2b8651590 2024-09-17T05:51:25.462 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:25.460+0000 7f4f325ff740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x55f2b897bc50 con 0x55f2b86493b0 2024-09-17T05:51:25.462 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:25.460+0000 7f4f325ff740 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x55f2b897fa60 con 0x55f2b8672270 2024-09-17T05:51:25.463 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:25.460+0000 7f4f29b53640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55f2b8651590 0x55f2b8a613e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:51:25.463 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:25.460+0000 7f4f29b53640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55f2b8651590 0x55f2b8a613e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:57686/0 (socket says 172.21.15.150:57686) 2024-09-17T05:51:25.463 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:25.460+0000 7f4f29b53640 1 -- 172.21.15.150:0/1990256324 learned_addr learned my addr 172.21.15.150:0/1990256324 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:51:25.463 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:25.460+0000 7f4f29352640 1 --2- 172.21.15.150:0/1990256324 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55f2b8672270 0x55f2b8a43fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:51:25.463 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:25.460+0000 7f4f28b51640 1 --2- 172.21.15.150:0/1990256324 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55f2b86493b0 0x55f2b8a444e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:51:25.463 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:25.460+0000 7f4f29b53640 1 -- 172.21.15.150:0/1990256324 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55f2b8672270 msgr2=0x55f2b8a43fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:51:25.463 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:25.460+0000 7f4f29b53640 1 --2- 172.21.15.150:0/1990256324 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55f2b8672270 0x55f2b8a43fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:51:25.463 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:25.460+0000 7f4f29b53640 1 -- 172.21.15.150:0/1990256324 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55f2b86493b0 msgr2=0x55f2b8a444e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:51:25.463 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:25.460+0000 7f4f29b53640 1 --2- 172.21.15.150:0/1990256324 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55f2b86493b0 0x55f2b8a444e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:51:25.463 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:25.460+0000 7f4f29b53640 1 -- 172.21.15.150:0/1990256324 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f2b86dd850 con 0x55f2b8651590 2024-09-17T05:51:25.463 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:25.460+0000 7f4f29352640 1 --2- 172.21.15.150:0/1990256324 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55f2b8672270 0x55f2b8a43fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:51:25.463 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:25.460+0000 7f4f29b53640 1 --2- 172.21.15.150:0/1990256324 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55f2b8651590 0x55f2b8a613e0 secure :-1 s=READY pgs=1518 cs=0 l=1 rev1=1 crypto rx=0x7f4f1c000f80 tx=0x7f4f1c010730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=791dd67847616cd0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:51:25.463 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:25.460+0000 7f4f06ffd640 1 -- 172.21.15.150:0/1990256324 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f1c019070 con 0x55f2b8651590 2024-09-17T05:51:25.463 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:25.460+0000 7f4f06ffd640 1 -- 172.21.15.150:0/1990256324 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f4f1c012730 con 0x55f2b8651590 2024-09-17T05:51:25.464 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:25.460+0000 7f4f06ffd640 1 -- 172.21.15.150:0/1990256324 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f1c012b60 con 0x55f2b8651590 2024-09-17T05:51:25.464 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:25.461+0000 7f4f325ff740 1 -- 172.21.15.150:0/1990256324 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55f2b8651590 msgr2=0x55f2b8a613e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:51:25.464 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:25.461+0000 7f4f325ff740 1 --2- 172.21.15.150:0/1990256324 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55f2b8651590 0x55f2b8a613e0 secure :-1 s=READY pgs=1518 cs=0 l=1 rev1=1 crypto rx=0x7f4f1c000f80 tx=0x7f4f1c010730 comp rx=0 tx=0).stop 2024-09-17T05:51:25.464 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:25.461+0000 7f4f325ff740 1 -- 172.21.15.150:0/1990256324 shutdown_connections 2024-09-17T05:51:25.464 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:25.461+0000 7f4f325ff740 1 --2- 172.21.15.150:0/1990256324 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55f2b86493b0 0x55f2b8a444e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:51:25.464 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:25.461+0000 7f4f325ff740 1 --2- 172.21.15.150:0/1990256324 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55f2b8651590 0x55f2b8a613e0 unknown :-1 s=CLOSED pgs=1518 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:51:25.464 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:25.461+0000 7f4f325ff740 1 --2- 172.21.15.150:0/1990256324 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55f2b8672270 0x55f2b8a43fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:51:25.464 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:25.461+0000 7f4f325ff740 1 -- 172.21.15.150:0/1990256324 >> 172.21.15.150:0/1990256324 conn(0x55f2b86663c0 msgr2=0x55f2b8a1a260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:51:25.464 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:25.461+0000 7f4f325ff740 1 -- 172.21.15.150:0/1990256324 shutdown_connections 2024-09-17T05:51:25.464 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:25.461+0000 7f4f325ff740 1 -- 172.21.15.150:0/1990256324 wait complete. 2024-09-17T05:51:25.468 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:25.462+0000 7f4f325ff740 1 -- start start 2024-09-17T05:51:25.468 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:25.462+0000 7f4f325ff740 1 Processor -- start 2024-09-17T05:51:25.468 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:25.464+0000 7f4f325ff740 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55f2b86493b0 0x55f2b8a213d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:51:25.469 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:25.464+0000 7f4f325ff740 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55f2b8651590 0x55f2b8a57a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:51:25.469 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:25.464+0000 7f4f325ff740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55f2b8672270 0x55f2b8a57fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:51:25.469 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:25.464+0000 7f4f325ff740 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x55f2b86ec620 con 0x55f2b8651590 2024-09-17T05:51:25.469 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:25.464+0000 7f4f325ff740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x55f2b89215f0 con 0x55f2b8672270 2024-09-17T05:51:25.469 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:25.464+0000 7f4f325ff740 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x55f2b8a44a20 con 0x55f2b86493b0 2024-09-17T05:51:25.469 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:25.464+0000 7f4f325ff740 10 client.0 _ll_register_callbacks cb 0x55f2b89250a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T05:51:25.469 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:25.464+0000 7f4f28b51640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55f2b8651590 0x55f2b8a57a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:51:25.469 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:25.464+0000 7f4f28b51640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55f2b8651590 0x55f2b8a57a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:57688/0 (socket says 172.21.15.150:57688) 2024-09-17T05:51:25.469 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:25.464+0000 7f4f28b51640 1 -- 172.21.15.150:0/3511272990 learned_addr learned my addr 172.21.15.150:0/3511272990 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:51:25.469 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:25.464+0000 7f4f29352640 1 --2- 172.21.15.150:0/3511272990 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55f2b86493b0 0x55f2b8a213d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:51:25.469 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:25.464+0000 7f4f29b53640 1 --2- 172.21.15.150:0/3511272990 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55f2b8672270 0x55f2b8a57fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:51:25.469 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:25.464+0000 7f4f28b51640 1 -- 172.21.15.150:0/3511272990 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55f2b86493b0 msgr2=0x55f2b8a213d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:51:25.470 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:25.464+0000 7f4f28b51640 1 --2- 172.21.15.150:0/3511272990 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55f2b86493b0 0x55f2b8a213d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:51:25.470 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:25.464+0000 7f4f28b51640 1 -- 172.21.15.150:0/3511272990 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55f2b8672270 msgr2=0x55f2b8a57fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:51:25.470 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:25.464+0000 7f4f28b51640 1 --2- 172.21.15.150:0/3511272990 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55f2b8672270 0x55f2b8a57fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:51:25.470 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:25.464+0000 7f4f28b51640 1 -- 172.21.15.150:0/3511272990 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f2b87546b0 con 0x55f2b8651590 2024-09-17T05:51:25.470 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:25.464+0000 7f4f29b53640 1 --2- 172.21.15.150:0/3511272990 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55f2b8672270 0x55f2b8a57fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T05:51:25.470 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:25.464+0000 7f4f28b51640 1 --2- 172.21.15.150:0/3511272990 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55f2b8651590 0x55f2b8a57a80 secure :-1 s=READY pgs=1519 cs=0 l=1 rev1=1 crypto rx=0x7f4f14063fd0 tx=0x7f4f14064550 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a7265bfb722b01d8 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:51:25.470 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:25.464+0000 7f4efffff640 10 client.0 ms_handle_connect on v2:172.21.15.150:3300/0 2024-09-17T05:51:25.470 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:25.464+0000 7f4efffff640 1 -- 172.21.15.150:0/3511272990 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f1408a070 con 0x55f2b8651590 2024-09-17T05:51:25.470 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:25.464+0000 7f4efffff640 1 -- 172.21.15.150:0/3511272990 <== mon.0 v2:172.21.15.150:3300/0 2 ==== osd_map(113..113 src has 1..113) ==== 5849+0+0 (secure 0 0 0) 0x7f4f1408a210 con 0x55f2b8651590 2024-09-17T05:51:25.470 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:25.464+0000 7f4f325ff740 1 -- 172.21.15.150:0/3511272990 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4f1c012730 con 0x55f2b8651590 2024-09-17T05:51:25.470 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:25.464+0000 7f4efffff640 1 -- 172.21.15.150:0/3511272990 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_get_version_reply(handle=1 version=70) ==== 24+0+0 (secure 0 0 0) 0x7f4f14084050 con 0x55f2b8651590 2024-09-17T05:51:25.470 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:25.464+0000 7f4f325ff740 10 client.8736 fetch_fsmap learned FSMap version 70 2024-09-17T05:51:25.470 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:25.464+0000 7f4f325ff740 1 -- 172.21.15.150:0/3511272990 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,fsmap=70,monmap=2+}) -- 0x55f2b8a628c0 con 0x55f2b8651590 2024-09-17T05:51:25.471 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:25.465+0000 7f4efffff640 1 -- 172.21.15.150:0/3511272990 <== mon.0 v2:172.21.15.150:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f4f1c012730 con 0x55f2b8651590 2024-09-17T05:51:25.471 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:25.465+0000 7f4efffff640 1 -- 172.21.15.150:0/3511272990 <== mon.0 v2:172.21.15.150:3300/0 5 ==== fsmap(e 70) ==== 3502+0+0 (secure 0 0 0) 0x7f4f140632a0 con 0x55f2b8651590 2024-09-17T05:51:25.471 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:25.465+0000 7f4f325ff740 10 client.8736 fetch_fsmap finished waiting for FSMap version 70 2024-09-17T05:51:25.471 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:25.465+0000 7f4f325ff740 10 client.8736 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-17T05:51:25.471 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:25.465+0000 7f4f325ff740 20 client.8736 populate_metadata read hostname 'smithi150' 2024-09-17T05:51:25.471 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:25.465+0000 7f4f325ff740 1 --2- 172.21.15.150:0/3511272990 >> [v2:172.21.15.150:6833/4047640601,v1:172.21.15.150:6835/4047640601] conn(0x55f2b8630e40 0x55f2b8a7b700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:51:25.471 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:25.465+0000 7f4f325ff740 4 client.8736 mds_command: new command op to 8571 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-17T05:51:25.471 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:25.465+0000 7f4f325ff740 1 -- 172.21.15.150:0/3511272990 --> [v2:172.21.15.150:6833/4047640601,v1:172.21.15.150:6835/4047640601] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f2b898e770 con 0x55f2b8630e40 2024-09-17T05:51:25.471 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:25.465+0000 7f4f29352640 1 --2- 172.21.15.150:0/3511272990 >> [v2:172.21.15.150:6833/4047640601,v1:172.21.15.150:6835/4047640601] conn(0x55f2b8630e40 0x55f2b8a7b700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:51:25.471 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:25.465+0000 7f4efffff640 10 client.8736 ms_handle_connect on v2:172.21.15.150:6833/4047640601 2024-09-17T05:51:25.471 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:25.465+0000 7f4f29352640 1 --2- 172.21.15.150:0/3511272990 >> [v2:172.21.15.150:6833/4047640601,v1:172.21.15.150:6835/4047640601] conn(0x55f2b8630e40 0x55f2b8a7b700 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9ae9d2b46e6bb01f server_cookie=91a60f7493eb761e in_seq=0 out_seq=0 2024-09-17T05:51:25.471 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:25.466+0000 7f4efffff640 1 -- 172.21.15.150:0/3511272990 <== mds.0 v2:172.21.15.150:6833/4047640601 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55f2b898e770 con 0x55f2b8630e40 2024-09-17T05:51:25.472 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:25.466+0000 7f4efffff640 10 client.8736 handle_command_reply: tid=0 2024-09-17T05:51:25.472 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:25.466+0000 7f4f325ff740 1 client.8736 shutdown 2024-09-17T05:51:25.472 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:25.466+0000 7f4f325ff740 1 -- 172.21.15.150:0/3511272990 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55f2b8651590 msgr2=0x55f2b8a57a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:51:25.472 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:25.466+0000 7f4f325ff740 1 --2- 172.21.15.150:0/3511272990 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55f2b8651590 0x55f2b8a57a80 secure :-1 s=READY pgs=1519 cs=0 l=1 rev1=1 crypto rx=0x7f4f14063fd0 tx=0x7f4f14064550 comp rx=0 tx=0).stop 2024-09-17T05:51:25.472 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:25.466+0000 7f4f325ff740 1 -- 172.21.15.150:0/3511272990 shutdown_connections 2024-09-17T05:51:25.472 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:25.466+0000 7f4f325ff740 1 --2- 172.21.15.150:0/3511272990 >> [v2:172.21.15.150:6833/4047640601,v1:172.21.15.150:6835/4047640601] conn(0x55f2b8630e40 0x55f2b8a7b700 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:51:25.472 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:25.466+0000 7f4f325ff740 1 --2- 172.21.15.150:0/3511272990 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55f2b8672270 0x55f2b8a57fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:51:25.472 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:25.466+0000 7f4f325ff740 1 --2- 172.21.15.150:0/3511272990 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55f2b8651590 0x55f2b8a57a80 unknown :-1 s=CLOSED pgs=1519 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:51:25.472 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:25.466+0000 7f4efffff640 0 client.8736 ms_handle_reset on v2:172.21.15.150:6833/4047640601 2024-09-17T05:51:25.472 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:25.466+0000 7f4f325ff740 1 --2- 172.21.15.150:0/3511272990 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55f2b86493b0 0x55f2b8a213d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:51:25.472 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:25.466+0000 7f4f325ff740 1 -- 172.21.15.150:0/3511272990 >> 172.21.15.150:0/3511272990 conn(0x55f2b86663c0 msgr2=0x55f2b8a14cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:51:25.472 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:25.466+0000 7f4f325ff740 1 -- 172.21.15.150:0/3511272990 shutdown_connections 2024-09-17T05:51:25.472 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:25.466+0000 7f4f325ff740 1 -- 172.21.15.150:0/3511272990 wait complete. 2024-09-17T05:51:25.473 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:25.466+0000 7f4f325ff740 20 client.8736 trim_cache size 0 max 16384 2024-09-17T05:51:25.485 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:25.484+0000 7f4f325ff740 1 Processor -- start 2024-09-17T05:51:25.485 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:25.484+0000 7f4f325ff740 1 -- start start 2024-09-17T05:51:25.487 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:25.485+0000 7f4f325ff740 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55f2b86493b0 0x55f2b8a57f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:51:25.487 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:25.485+0000 7f4f325ff740 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55f2b8651590 0x55f2b8a5ed60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:51:25.487 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:25.485+0000 7f4f325ff740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55f2b8672270 0x55f2b8a5f2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:51:25.487 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:25.485+0000 7f4f325ff740 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f4f24201b60 con 0x55f2b8651590 2024-09-17T05:51:25.487 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:25.485+0000 7f4f325ff740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f4f241d2e20 con 0x55f2b8672270 2024-09-17T05:51:25.487 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:25.485+0000 7f4f325ff740 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f4f24201610 con 0x55f2b86493b0 2024-09-17T05:51:25.487 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:25.486+0000 7f4f28b51640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55f2b8651590 0x55f2b8a5ed60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:51:25.487 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:25.486+0000 7f4f28b51640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55f2b8651590 0x55f2b8a5ed60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:57700/0 (socket says 172.21.15.150:57700) 2024-09-17T05:51:25.487 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:25.486+0000 7f4f28b51640 1 -- 172.21.15.150:0/1887262548 learned_addr learned my addr 172.21.15.150:0/1887262548 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:51:25.488 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:25.486+0000 7f4f28b51640 1 -- 172.21.15.150:0/1887262548 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55f2b86493b0 msgr2=0x55f2b8a57f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:51:25.488 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:25.486+0000 7f4f28b51640 1 --2- 172.21.15.150:0/1887262548 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55f2b86493b0 0x55f2b8a57f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:51:25.488 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:25.486+0000 7f4f28b51640 1 -- 172.21.15.150:0/1887262548 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55f2b8672270 msgr2=0x55f2b8a5f2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:51:25.488 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:25.486+0000 7f4f28b51640 1 --2- 172.21.15.150:0/1887262548 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55f2b8672270 0x55f2b8a5f2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:51:25.488 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:25.486+0000 7f4f28b51640 1 -- 172.21.15.150:0/1887262548 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f2b8a1acb0 con 0x55f2b8651590 2024-09-17T05:51:25.488 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:25.486+0000 7f4f28b51640 1 --2- 172.21.15.150:0/1887262548 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55f2b8651590 0x55f2b8a5ed60 secure :-1 s=READY pgs=1520 cs=0 l=1 rev1=1 crypto rx=0x7f4f14063720 tx=0x7f4f14000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bee5ca3544e8a4f8 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:51:25.488 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:25.486+0000 7f4f067fc640 1 -- 172.21.15.150:0/1887262548 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f1408a040 con 0x55f2b8651590 2024-09-17T05:51:25.488 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:25.486+0000 7f4f067fc640 1 -- 172.21.15.150:0/1887262548 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f4f14064740 con 0x55f2b8651590 2024-09-17T05:51:25.488 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:25.486+0000 7f4f067fc640 1 -- 172.21.15.150:0/1887262548 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f140637b0 con 0x55f2b8651590 2024-09-17T05:51:25.489 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:25.487+0000 7f4f325ff740 1 -- 172.21.15.150:0/1887262548 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55f2b8651590 msgr2=0x55f2b8a5ed60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:51:25.489 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:25.487+0000 7f4f325ff740 1 --2- 172.21.15.150:0/1887262548 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55f2b8651590 0x55f2b8a5ed60 secure :-1 s=READY pgs=1520 cs=0 l=1 rev1=1 crypto rx=0x7f4f14063720 tx=0x7f4f14000bc0 comp rx=0 tx=0).stop 2024-09-17T05:51:25.489 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:25.487+0000 7f4f325ff740 1 -- 172.21.15.150:0/1887262548 shutdown_connections 2024-09-17T05:51:25.489 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:25.487+0000 7f4f325ff740 1 --2- 172.21.15.150:0/1887262548 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55f2b8672270 0x55f2b8a5f2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:51:25.489 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:25.487+0000 7f4f325ff740 1 --2- 172.21.15.150:0/1887262548 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55f2b8651590 0x55f2b8a5ed60 unknown :-1 s=CLOSED pgs=1520 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:51:25.490 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:25.487+0000 7f4f325ff740 1 --2- 172.21.15.150:0/1887262548 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55f2b86493b0 0x55f2b8a57f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:51:25.490 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:25.487+0000 7f4f325ff740 1 -- 172.21.15.150:0/1887262548 >> 172.21.15.150:0/1887262548 conn(0x55f2b86663c0 msgr2=0x55f2b8a2d340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:51:25.490 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:25.487+0000 7f4f325ff740 1 -- 172.21.15.150:0/1887262548 shutdown_connections 2024-09-17T05:51:25.490 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:25.487+0000 7f4f325ff740 1 -- 172.21.15.150:0/1887262548 wait complete. 2024-09-17T05:51:25.490 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:25.488+0000 7f4f325ff740 1 -- start start 2024-09-17T05:51:25.490 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:25.488+0000 7f4f325ff740 1 Processor -- start 2024-09-17T05:51:25.494 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:25.489+0000 7f4f325ff740 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55f2b86493b0 0x55f2b8ad7e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:51:25.494 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:25.489+0000 7f4f325ff740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55f2b8651590 0x55f2b8a740d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:51:25.494 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:25.489+0000 7f4f325ff740 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55f2b8672270 0x55f2b8a74610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:51:25.494 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:25.489+0000 7f4f325ff740 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x55f2b8a71320 con 0x55f2b86493b0 2024-09-17T05:51:25.494 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:25.489+0000 7f4f325ff740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x55f2b8a57280 con 0x55f2b8651590 2024-09-17T05:51:25.494 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:25.489+0000 7f4f325ff740 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x55f2b8a71940 con 0x55f2b8672270 2024-09-17T05:51:25.494 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:25.489+0000 7f4f325ff740 10 client.0 _ll_register_callbacks cb 0x7f4f14063ee0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T05:51:25.495 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:25.489+0000 7f4f29352640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55f2b86493b0 0x55f2b8ad7e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:51:25.495 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:25.489+0000 7f4f29352640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55f2b86493b0 0x55f2b8ad7e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:57706/0 (socket says 172.21.15.150:57706) 2024-09-17T05:51:25.495 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:25.489+0000 7f4f29352640 1 -- 172.21.15.150:0/2393429441 learned_addr learned my addr 172.21.15.150:0/2393429441 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:51:25.495 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:25.489+0000 7f4f29b53640 1 --2- 172.21.15.150:0/2393429441 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55f2b8672270 0x55f2b8a74610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:51:25.495 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:25.490+0000 7f4f28b51640 1 --2- 172.21.15.150:0/2393429441 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55f2b8651590 0x55f2b8a740d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:51:25.495 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:25.490+0000 7f4f29352640 1 -- 172.21.15.150:0/2393429441 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55f2b8672270 msgr2=0x55f2b8a74610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:51:25.495 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:25.490+0000 7f4f29352640 1 --2- 172.21.15.150:0/2393429441 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55f2b8672270 0x55f2b8a74610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:51:25.495 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:25.490+0000 7f4f29352640 1 -- 172.21.15.150:0/2393429441 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55f2b8651590 msgr2=0x55f2b8a740d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:51:25.495 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:25.490+0000 7f4f29352640 1 --2- 172.21.15.150:0/2393429441 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55f2b8651590 0x55f2b8a740d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:51:25.495 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:25.490+0000 7f4f29352640 1 -- 172.21.15.150:0/2393429441 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f2b8ad8350 con 0x55f2b86493b0 2024-09-17T05:51:25.495 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:25.490+0000 7f4f29352640 1 --2- 172.21.15.150:0/2393429441 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55f2b86493b0 0x55f2b8ad7e10 secure :-1 s=READY pgs=1521 cs=0 l=1 rev1=1 crypto rx=0x7f4f20001440 tx=0x7f4f20001170 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5658c193e0b80ff3 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:51:25.495 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:25.490+0000 7f4efffff640 10 client.0 ms_handle_connect on v2:172.21.15.150:3300/0 2024-09-17T05:51:25.496 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:25.490+0000 7f4efffff640 1 -- 172.21.15.150:0/2393429441 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f20057060 con 0x55f2b86493b0 2024-09-17T05:51:25.496 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:25.490+0000 7f4efffff640 1 -- 172.21.15.150:0/2393429441 <== mon.0 v2:172.21.15.150:3300/0 2 ==== osd_map(113..113 src has 1..113) ==== 5849+0+0 (secure 0 0 0) 0x7f4f2004d430 con 0x55f2b86493b0 2024-09-17T05:51:25.496 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:25.490+0000 7f4f325ff740 1 -- 172.21.15.150:0/2393429441 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4f14064740 con 0x55f2b86493b0 2024-09-17T05:51:25.496 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:25.490+0000 7f4efffff640 1 -- 172.21.15.150:0/2393429441 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_get_version_reply(handle=1 version=70) ==== 24+0+0 (secure 0 0 0) 0x7f4f20038040 con 0x55f2b86493b0 2024-09-17T05:51:25.496 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:25.490+0000 7f4f325ff740 10 client.8742 fetch_fsmap learned FSMap version 70 2024-09-17T05:51:25.496 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:25.490+0000 7f4f325ff740 1 -- 172.21.15.150:0/2393429441 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,fsmap=70,monmap=2+}) -- 0x55f2b8a1b4f0 con 0x55f2b86493b0 2024-09-17T05:51:25.496 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:25.490+0000 7f4efffff640 1 -- 172.21.15.150:0/2393429441 <== mon.0 v2:172.21.15.150:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f4f14064740 con 0x55f2b86493b0 2024-09-17T05:51:25.496 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:25.490+0000 7f4efffff640 1 -- 172.21.15.150:0/2393429441 <== mon.0 v2:172.21.15.150:3300/0 5 ==== fsmap(e 70) ==== 3502+0+0 (secure 0 0 0) 0x7f4f2004d630 con 0x55f2b86493b0 2024-09-17T05:51:25.496 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:25.490+0000 7f4f325ff740 10 client.8742 fetch_fsmap finished waiting for FSMap version 70 2024-09-17T05:51:25.496 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:25.491+0000 7f4f325ff740 10 client.8742 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-17T05:51:25.496 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:25.491+0000 7f4f325ff740 20 client.8742 populate_metadata read hostname 'smithi150' 2024-09-17T05:51:25.496 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:25.491+0000 7f4f325ff740 1 --2- 172.21.15.150:0/2393429441 >> [v2:172.21.15.150:6833/4047640601,v1:172.21.15.150:6835/4047640601] conn(0x55f2b8a72a40 0x55f2b8ae1560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:51:25.497 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:25.491+0000 7f4f325ff740 4 client.8742 mds_command: new command op to 8571 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-17T05:51:25.497 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:25.491+0000 7f4f325ff740 1 -- 172.21.15.150:0/2393429441 --> [v2:172.21.15.150:6833/4047640601,v1:172.21.15.150:6835/4047640601] -- command(tid 0: {"prefix": "status"}) -- 0x55f2b8a32b20 con 0x55f2b8a72a40 2024-09-17T05:51:25.497 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:25.491+0000 7f4f28b51640 1 --2- 172.21.15.150:0/2393429441 >> [v2:172.21.15.150:6833/4047640601,v1:172.21.15.150:6835/4047640601] conn(0x55f2b8a72a40 0x55f2b8ae1560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:51:25.497 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:25.491+0000 7f4efffff640 10 client.8742 ms_handle_connect on v2:172.21.15.150:6833/4047640601 2024-09-17T05:51:25.497 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:25.491+0000 7f4f28b51640 1 --2- 172.21.15.150:0/2393429441 >> [v2:172.21.15.150:6833/4047640601,v1:172.21.15.150:6835/4047640601] conn(0x55f2b8a72a40 0x55f2b8ae1560 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=42e07135aed06529 server_cookie=4ef36d86e36b159b in_seq=0 out_seq=0 2024-09-17T05:51:25.497 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:25.491+0000 7f4efffff640 1 -- 172.21.15.150:0/2393429441 <== mds.0 v2:172.21.15.150:6833/4047640601 1 ==== command_reply(tid 0: 0 ) ==== 8+0+333 (crc 0 0 0) 0x55f2b8a32b20 con 0x55f2b8a72a40 2024-09-17T05:51:25.497 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:25.491+0000 7f4efffff640 10 client.8742 handle_command_reply: tid=0 2024-09-17T05:51:25.497 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:25.491+0000 7f4f325ff740 1 client.8742 shutdown 2024-09-17T05:51:25.497 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:25.491+0000 7f4f325ff740 1 -- 172.21.15.150:0/2393429441 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55f2b86493b0 msgr2=0x55f2b8ad7e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:51:25.497 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:25.491+0000 7f4f325ff740 1 --2- 172.21.15.150:0/2393429441 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55f2b86493b0 0x55f2b8ad7e10 secure :-1 s=READY pgs=1521 cs=0 l=1 rev1=1 crypto rx=0x7f4f20001440 tx=0x7f4f20001170 comp rx=0 tx=0).stop 2024-09-17T05:51:25.497 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:25.492+0000 7f4f325ff740 1 -- 172.21.15.150:0/2393429441 shutdown_connections 2024-09-17T05:51:25.497 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:25.492+0000 7f4f325ff740 1 --2- 172.21.15.150:0/2393429441 >> [v2:172.21.15.150:6833/4047640601,v1:172.21.15.150:6835/4047640601] conn(0x55f2b8a72a40 0x55f2b8ae1560 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:51:25.497 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:25.492+0000 7f4f325ff740 1 --2- 172.21.15.150:0/2393429441 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55f2b8651590 0x55f2b8a740d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:51:25.498 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:25.492+0000 7f4f325ff740 1 --2- 172.21.15.150:0/2393429441 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55f2b8672270 0x55f2b8a74610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:51:25.498 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:25.492+0000 7f4efffff640 0 client.8742 ms_handle_reset on v2:172.21.15.150:6833/4047640601 2024-09-17T05:51:25.498 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:25.492+0000 7f4f325ff740 1 --2- 172.21.15.150:0/2393429441 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55f2b86493b0 0x55f2b8ad7e10 unknown :-1 s=CLOSED pgs=1521 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:51:25.498 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:25.492+0000 7f4f325ff740 1 -- 172.21.15.150:0/2393429441 >> 172.21.15.150:0/2393429441 conn(0x55f2b86663c0 msgr2=0x55f2b8a14cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:51:25.498 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:25.492+0000 7f4f325ff740 1 -- 172.21.15.150:0/2393429441 shutdown_connections 2024-09-17T05:51:25.498 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:25.492+0000 7f4f325ff740 1 -- 172.21.15.150:0/2393429441 wait complete. 2024-09-17T05:51:25.498 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:25.492+0000 7f4f325ff740 20 client.8742 trim_cache size 0 max 16384 2024-09-17T05:51:25.498 INFO:teuthology.orchestra.run.smithi150.stdout:{ 2024-09-17T05:51:25.498 INFO:teuthology.orchestra.run.smithi150.stdout: "cluster_fsid": "9f2e05e9-d629-47b3-b26b-1360655b7d20", 2024-09-17T05:51:25.498 INFO:teuthology.orchestra.run.smithi150.stdout: "whoami": 0, 2024-09-17T05:51:25.499 INFO:teuthology.orchestra.run.smithi150.stdout: "id": 8571, 2024-09-17T05:51:25.499 INFO:teuthology.orchestra.run.smithi150.stdout: "want_state": "up:active", 2024-09-17T05:51:25.499 INFO:teuthology.orchestra.run.smithi150.stdout: "state": "up:active", 2024-09-17T05:51:25.499 INFO:teuthology.orchestra.run.smithi150.stdout: "fs_name": "cephfs", 2024-09-17T05:51:25.499 INFO:teuthology.orchestra.run.smithi150.stdout: "rank_uptime": 10.144965704000001, 2024-09-17T05:51:25.499 INFO:teuthology.orchestra.run.smithi150.stdout: "mdsmap_epoch": 70, 2024-09-17T05:51:25.499 INFO:teuthology.orchestra.run.smithi150.stdout: "osdmap_epoch": 113, 2024-09-17T05:51:25.499 INFO:teuthology.orchestra.run.smithi150.stdout: "osdmap_epoch_barrier": 113, 2024-09-17T05:51:25.499 INFO:teuthology.orchestra.run.smithi150.stdout: "uptime": 14.831197551000001 2024-09-17T05:51:25.499 INFO:teuthology.orchestra.run.smithi150.stdout:} 2024-09-17T05:51:25.500 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:25.492+0000 7f4f2b5b6640 1 -- 172.21.15.150:0/1351482540 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f4f0807a5a0 msgr2=0x7f4f0807cab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:51:25.500 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:25.492+0000 7f4f2b5b6640 1 --2- 172.21.15.150:0/1351482540 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f4f0807a5a0 0x7f4f0807cab0 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7f4f20001680 tx=0x7f4f200011e0 comp rx=0 tx=0).stop 2024-09-17T05:51:25.500 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:25.492+0000 7f4f2b5b6640 1 -- 172.21.15.150:0/1351482540 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4f241d1ca0 msgr2=0x7f4f241d4780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:51:25.500 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:25.492+0000 7f4f2b5b6640 1 --2- 172.21.15.150:0/1351482540 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4f241d1ca0 0x7f4f241d4780 secure :-1 s=READY pgs=1517 cs=0 l=1 rev1=1 crypto rx=0x7f4f14004650 tx=0x7f4f1400ba40 comp rx=0 tx=0).stop 2024-09-17T05:51:25.500 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:25.492+0000 7f4f2b5b6640 1 -- 172.21.15.150:0/1351482540 shutdown_connections 2024-09-17T05:51:25.501 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:25.492+0000 7f4f2b5b6640 1 --2- 172.21.15.150:0/1351482540 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4f241d4cc0 0x7f4f241e5030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:51:25.501 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:25.492+0000 7f4f2b5b6640 1 --2- 172.21.15.150:0/1351482540 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f4f0807a5a0 0x7f4f0807cab0 unknown :-1 s=CLOSED pgs=647 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:51:25.501 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:25.492+0000 7f4f2b5b6640 1 --2- 172.21.15.150:0/1351482540 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4f241d1ca0 0x7f4f241d4780 unknown :-1 s=CLOSED pgs=1517 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:51:25.501 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:25.492+0000 7f4f2b5b6640 1 --2- 172.21.15.150:0/1351482540 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4f10003a80 0x7f4f241d4240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:51:25.501 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:25.492+0000 7f4f2b5b6640 1 -- 172.21.15.150:0/1351482540 >> 172.21.15.150:0/1351482540 conn(0x7f4f240cee80 msgr2=0x7f4f240cce80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:51:25.501 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:25.493+0000 7f4f2b5b6640 1 -- 172.21.15.150:0/1351482540 shutdown_connections 2024-09-17T05:51:25.501 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:25.493+0000 7f4f2b5b6640 1 -- 172.21.15.150:0/1351482540 wait complete. 2024-09-17T05:51:25.504 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-17T05:51:25.619 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:25.618+0000 7f3a8b2de640 1 -- 172.21.15.150:0/4243492040 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3a840b7330 msgr2=0x7f3a840b5260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:51:25.619 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:25.618+0000 7f3a8b2de640 1 --2- 172.21.15.150:0/4243492040 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3a840b7330 0x7f3a840b5260 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f3a74009830 tx=0x7f3a7402a4a0 comp rx=0 tx=0).stop 2024-09-17T05:51:25.619 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:25.618+0000 7f3a8b2de640 1 -- 172.21.15.150:0/4243492040 shutdown_connections 2024-09-17T05:51:25.619 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:25.618+0000 7f3a8b2de640 1 --2- 172.21.15.150:0/4243492040 >> v2:172.21.15.176:3300/0 conn(0x7f3a840b57a0 0x7f3a840b5bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:51:25.620 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:25.618+0000 7f3a8b2de640 1 --2- 172.21.15.150:0/4243492040 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3a840b7330 0x7f3a840b5260 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:51:25.620 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:25.618+0000 7f3a8b2de640 1 -- 172.21.15.150:0/4243492040 >> 172.21.15.150:0/4243492040 conn(0x7f3a840cee90 msgr2=0x7f3a840cf2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:51:25.620 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:25.618+0000 7f3a8b2de640 1 -- 172.21.15.150:0/4243492040 shutdown_connections 2024-09-17T05:51:25.620 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:25.618+0000 7f3a8b2de640 1 -- 172.21.15.150:0/4243492040 wait complete. 2024-09-17T05:51:25.621 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:25.620+0000 7f3a8b2de640 1 Processor -- start 2024-09-17T05:51:25.621 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:25.620+0000 7f3a8b2de640 1 -- start start 2024-09-17T05:51:25.623 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:25.621+0000 7f3a8b2de640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3a8409ba60 0x7f3a84160760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:51:25.623 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:25.621+0000 7f3a8b2de640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3a840b57a0 0x7f3a841598e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:51:25.623 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:25.621+0000 7f3a8b2de640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3a840b7330 0x7f3a8415b090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:51:25.623 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:25.621+0000 7f3a8b2de640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f3a840d1550 con 0x7f3a840b7330 2024-09-17T05:51:25.623 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:25.621+0000 7f3a8b2de640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f3a840d13d0 con 0x7f3a8409ba60 2024-09-17T05:51:25.624 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:25.621+0000 7f3a8b2de640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f3a841670e0 con 0x7f3a840b57a0 2024-09-17T05:51:25.624 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:25.621+0000 7f3a8987b640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3a840b7330 0x7f3a8415b090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:51:25.624 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:25.621+0000 7f3a8987b640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3a840b7330 0x7f3a8415b090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:57718/0 (socket says 172.21.15.150:57718) 2024-09-17T05:51:25.624 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:25.621+0000 7f3a8987b640 1 -- 172.21.15.150:0/1303639591 learned_addr learned my addr 172.21.15.150:0/1303639591 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:51:25.624 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:25.622+0000 7f3a88879640 1 --2- 172.21.15.150:0/1303639591 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3a840b57a0 0x7f3a841598e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:51:25.624 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:25.622+0000 7f3a8907a640 1 --2- 172.21.15.150:0/1303639591 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3a8409ba60 0x7f3a84160760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:51:25.624 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:25.622+0000 7f3a8987b640 1 -- 172.21.15.150:0/1303639591 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3a840b57a0 msgr2=0x7f3a841598e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:51:25.624 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:25.622+0000 7f3a8987b640 1 --2- 172.21.15.150:0/1303639591 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3a840b57a0 0x7f3a841598e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:51:25.624 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:25.622+0000 7f3a8987b640 1 -- 172.21.15.150:0/1303639591 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3a8409ba60 msgr2=0x7f3a84160760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:51:25.624 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:25.622+0000 7f3a8987b640 1 --2- 172.21.15.150:0/1303639591 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3a8409ba60 0x7f3a84160760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:51:25.624 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:25.622+0000 7f3a8987b640 1 -- 172.21.15.150:0/1303639591 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3a8409e410 con 0x7f3a840b7330 2024-09-17T05:51:25.624 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:25.622+0000 7f3a8987b640 1 --2- 172.21.15.150:0/1303639591 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3a840b7330 0x7f3a8415b090 secure :-1 s=READY pgs=1523 cs=0 l=1 rev1=1 crypto rx=0x7f3a7c00e6d0 tx=0x7f3a7c00eb90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:51:25.624 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:25.622+0000 7f3a79ffb640 1 -- 172.21.15.150:0/1303639591 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a7c00cab0 con 0x7f3a840b7330 2024-09-17T05:51:25.625 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:25.622+0000 7f3a8b2de640 1 -- 172.21.15.150:0/1303639591 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3a8409e6f0 con 0x7f3a840b7330 2024-09-17T05:51:25.625 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:25.622+0000 7f3a79ffb640 1 -- 172.21.15.150:0/1303639591 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f3a7c00cc50 con 0x7f3a840b7330 2024-09-17T05:51:25.625 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:25.622+0000 7f3a79ffb640 1 -- 172.21.15.150:0/1303639591 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a7c005020 con 0x7f3a840b7330 2024-09-17T05:51:25.625 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:25.622+0000 7f3a8b2de640 1 -- 172.21.15.150:0/1303639591 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3a8409ecb0 con 0x7f3a840b7330 2024-09-17T05:51:25.626 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:25.623+0000 7f3a8b2de640 1 -- 172.21.15.150:0/1303639591 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3a840b5bb0 con 0x7f3a840b7330 2024-09-17T05:51:25.626 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:25.624+0000 7f3a79ffb640 1 -- 172.21.15.150:0/1303639591 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 37) ==== 103787+0+0 (secure 0 0 0) 0x7f3a7c0051e0 con 0x7f3a840b7330 2024-09-17T05:51:25.626 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:25.624+0000 7f3a79ffb640 1 --2- 172.21.15.150:0/1303639591 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f3a6807a570 0x7f3a6807ca80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:51:25.626 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:25.625+0000 7f3a79ffb640 1 -- 172.21.15.150:0/1303639591 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(113..113 src has 1..113) ==== 5849+0+0 (secure 0 0 0) 0x7f3a7c09a500 con 0x7f3a840b7330 2024-09-17T05:51:25.626 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:25.625+0000 7f3a8907a640 1 --2- 172.21.15.150:0/1303639591 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f3a6807a570 0x7f3a6807ca80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:51:25.626 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:25.625+0000 7f3a8907a640 1 --2- 172.21.15.150:0/1303639591 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f3a6807a570 0x7f3a6807ca80 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7f3a800016d0 tx=0x7f3a80009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:51:25.629 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:25.629+0000 7f3a79ffb640 1 -- 172.21.15.150:0/1303639591 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f3a7c0643c0 con 0x7f3a840b7330 2024-09-17T05:51:25.839 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:25.839+0000 7f3a8b2de640 1 -- 172.21.15.150:0/1303639591 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f3a840726b0 con 0x7f3a840b7330 2024-09-17T05:51:25.840 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:25.839+0000 7f3a79ffb640 1 -- 172.21.15.150:0/1303639591 <== mon.0 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v70) ==== 53+0+73 (secure 0 0 0) 0x7f3a7c063cc0 con 0x7f3a840b7330 2024-09-17T05:51:25.840 INFO:teuthology.orchestra.run.smithi150.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-17T05:51:25.842 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:25.841+0000 7f3a8b2de640 1 -- 172.21.15.150:0/1303639591 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f3a6807a570 msgr2=0x7f3a6807ca80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:51:25.842 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:25.841+0000 7f3a8b2de640 1 --2- 172.21.15.150:0/1303639591 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f3a6807a570 0x7f3a6807ca80 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7f3a800016d0 tx=0x7f3a80009040 comp rx=0 tx=0).stop 2024-09-17T05:51:25.842 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:25.841+0000 7f3a8b2de640 1 -- 172.21.15.150:0/1303639591 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3a840b7330 msgr2=0x7f3a8415b090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:51:25.842 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:25.841+0000 7f3a8b2de640 1 --2- 172.21.15.150:0/1303639591 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3a840b7330 0x7f3a8415b090 secure :-1 s=READY pgs=1523 cs=0 l=1 rev1=1 crypto rx=0x7f3a7c00e6d0 tx=0x7f3a7c00eb90 comp rx=0 tx=0).stop 2024-09-17T05:51:25.842 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:25.841+0000 7f3a8b2de640 1 -- 172.21.15.150:0/1303639591 shutdown_connections 2024-09-17T05:51:25.843 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:25.841+0000 7f3a8b2de640 1 --2- 172.21.15.150:0/1303639591 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f3a6807a570 0x7f3a6807ca80 unknown :-1 s=CLOSED pgs=648 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:51:25.843 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:25.841+0000 7f3a8b2de640 1 --2- 172.21.15.150:0/1303639591 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3a840b7330 0x7f3a8415b090 unknown :-1 s=CLOSED pgs=1523 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:51:25.843 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:25.841+0000 7f3a8b2de640 1 --2- 172.21.15.150:0/1303639591 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3a840b57a0 0x7f3a841598e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:51:25.843 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:25.841+0000 7f3a8b2de640 1 --2- 172.21.15.150:0/1303639591 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3a8409ba60 0x7f3a84160760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:51:25.843 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:25.841+0000 7f3a8b2de640 1 -- 172.21.15.150:0/1303639591 >> 172.21.15.150:0/1303639591 conn(0x7f3a840cee90 msgr2=0x7f3a840cd440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:51:25.843 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:25.841+0000 7f3a8b2de640 1 -- 172.21.15.150:0/1303639591 shutdown_connections 2024-09-17T05:51:25.843 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:25.841+0000 7f3a8b2de640 1 -- 172.21.15.150:0/1303639591 wait complete. 2024-09-17T05:51:25.853 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-09-17T05:51:25.854 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-17T05:51:25.854 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi150.front.sepia.ceph.com 2024-09-17T05:51:25.854 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-17T05:51:25.854 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-17T05:51:25.854 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-09-17T05:51:25.854 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-09-17T05:51:25.854 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-17T05:51:25.854 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-17T05:51:25.854 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:51:25.854 DEBUG:teuthology.orchestra.run.smithi150:> ip addr 2024-09-17T05:51:25.870 INFO:teuthology.orchestra.run.smithi150.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-17T05:51:25.870 INFO:teuthology.orchestra.run.smithi150.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-17T05:51:25.870 INFO:teuthology.orchestra.run.smithi150.stdout: inet 127.0.0.1/8 scope host lo 2024-09-17T05:51:25.870 INFO:teuthology.orchestra.run.smithi150.stdout: valid_lft forever preferred_lft forever 2024-09-17T05:51:25.870 INFO:teuthology.orchestra.run.smithi150.stdout: inet6 ::1/128 scope host 2024-09-17T05:51:25.871 INFO:teuthology.orchestra.run.smithi150.stdout: valid_lft forever preferred_lft forever 2024-09-17T05:51:25.871 INFO:teuthology.orchestra.run.smithi150.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-17T05:51:25.871 INFO:teuthology.orchestra.run.smithi150.stdout: link/ether 0c:c4:7a:d9:da:bc brd ff:ff:ff:ff:ff:ff 2024-09-17T05:51:25.871 INFO:teuthology.orchestra.run.smithi150.stdout: altname enp7s0f0 2024-09-17T05:51:25.871 INFO:teuthology.orchestra.run.smithi150.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-17T05:51:25.871 INFO:teuthology.orchestra.run.smithi150.stdout: link/ether 0c:c4:7a:d9:da:bd brd ff:ff:ff:ff:ff:ff 2024-09-17T05:51:25.871 INFO:teuthology.orchestra.run.smithi150.stdout: altname enp7s0f1 2024-09-17T05:51:25.871 INFO:teuthology.orchestra.run.smithi150.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-17T05:51:25.871 INFO:teuthology.orchestra.run.smithi150.stdout: link/ether 0c:c4:7a:88:6e:34 brd ff:ff:ff:ff:ff:ff 2024-09-17T05:51:25.871 INFO:teuthology.orchestra.run.smithi150.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-17T05:51:25.871 INFO:teuthology.orchestra.run.smithi150.stdout: link/ether 0c:c4:7a:88:6e:35 brd ff:ff:ff:ff:ff:ff 2024-09-17T05:51:25.871 INFO:teuthology.orchestra.run.smithi150.stdout: inet 172.21.15.150/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-09-17T05:51:25.871 INFO:teuthology.orchestra.run.smithi150.stdout: valid_lft 42229sec preferred_lft 42229sec 2024-09-17T05:51:25.872 INFO:teuthology.orchestra.run.smithi150.stdout: inet6 fe80::ec4:7aff:fe88:6e35/64 scope link noprefixroute 2024-09-17T05:51:25.872 INFO:teuthology.orchestra.run.smithi150.stdout: valid_lft forever preferred_lft forever 2024-09-17T05:51:25.872 INFO:teuthology.orchestra.run.smithi150.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-17T05:51:25.872 INFO:teuthology.orchestra.run.smithi150.stdout: link/ether 1a:d2:4c:31:46:82 brd ff:ff:ff:ff:ff:ff 2024-09-17T05:51:25.872 INFO:teuthology.orchestra.run.smithi150.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-17T05:51:25.872 INFO:teuthology.orchestra.run.smithi150.stdout: valid_lft forever preferred_lft forever 2024-09-17T05:51:25.872 INFO:teuthology.orchestra.run.smithi150.stdout: inet6 fe80::70b6:c6ff:fe60:62a2/64 scope link 2024-09-17T05:51:25.872 INFO:teuthology.orchestra.run.smithi150.stdout: valid_lft forever preferred_lft forever 2024-09-17T05:51:25.872 INFO:teuthology.orchestra.run.smithi150.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-17T05:51:25.872 INFO:teuthology.orchestra.run.smithi150.stdout: link/ether 32:e1:8b:37:8c:b3 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-17T05:51:25.872 INFO:teuthology.orchestra.run.smithi150.stdout: inet6 fe80::30e1:8bff:fe37:8cb3/64 scope link 2024-09-17T05:51:25.872 INFO:teuthology.orchestra.run.smithi150.stdout: valid_lft forever preferred_lft forever 2024-09-17T05:51:25.872 INFO:teuthology.orchestra.run.smithi150.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-17T05:51:25.872 INFO:teuthology.orchestra.run.smithi150.stdout: link/ether 1a:d2:4c:31:46:82 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-17T05:51:25.873 INFO:teuthology.orchestra.run.smithi150.stdout: inet6 fe80::18d2:4cff:fe31:4682/64 scope link 2024-09-17T05:51:25.873 INFO:teuthology.orchestra.run.smithi150.stdout: valid_lft forever preferred_lft forever 2024-09-17T05:51:25.873 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:51:25.873 DEBUG:teuthology.orchestra.run.smithi150:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-17T05:51:25.934 INFO:teuthology.orchestra.run.smithi150.stdout:1 2024-09-17T05:51:25.935 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:51:25.936 DEBUG:teuthology.orchestra.run.smithi150:> route 2024-09-17T05:51:25.992 INFO:teuthology.orchestra.run.smithi150.stdout:Kernel IP routing table 2024-09-17T05:51:25.992 INFO:teuthology.orchestra.run.smithi150.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-17T05:51:25.992 INFO:teuthology.orchestra.run.smithi150.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-17T05:51:25.992 INFO:teuthology.orchestra.run.smithi150.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-17T05:51:25.992 INFO:teuthology.orchestra.run.smithi150.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-17T05:51:25.993 DEBUG:teuthology.orchestra.run.smithi150:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-17T05:51:25.993 DEBUG:teuthology.orchestra.run.smithi150:> set -e 2024-09-17T05:51:25.993 DEBUG:teuthology.orchestra.run.smithi150:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-17T05:51:25.993 DEBUG:teuthology.orchestra.run.smithi150:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-17T05:51:25.993 DEBUG:teuthology.orchestra.run.smithi150:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-17T05:51:25.993 DEBUG:teuthology.orchestra.run.smithi150:> ') 2024-09-17T05:51:26.081 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:26 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-17T05:51:26.113 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:26 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T05:51:26.119 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:51:26.119 DEBUG:teuthology.orchestra.run.smithi150:> ip netns list 2024-09-17T05:51:26.135 INFO:teuthology.orchestra.run.smithi150.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-09-17T05:51:26.135 INFO:teuthology.orchestra.run.smithi150.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-17T05:51:26.135 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-17T05:51:26.135 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:51:26.135 DEBUG:teuthology.orchestra.run.smithi150:> sudo ip link set brx.0 up 2024-09-17T05:51:26.201 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-17T05:51:26.201 DEBUG:teuthology.orchestra.run.smithi150:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-17T05:51:26.257 INFO:teuthology.orchestra.run.smithi150.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-17T05:51:26.257 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-17T05:51:26.257 DEBUG:teuthology.orchestra.run.smithi150:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-17T05:51:26.312 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-09-17T05:51:26.312 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:51:26.313 DEBUG:teuthology.orchestra.run.smithi150:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-17T05:51:26.406 INFO:teuthology.orchestra.run.smithi150.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-17T05:51:26.407 INFO:teuthology.orchestra.run.smithi150.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-17T05:51:26.407 INFO:teuthology.orchestra.run.smithi150.stdout:invalid new device string format 2024-09-17T05:51:26.417 INFO:teuthology.orchestra.run.smithi150.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-17T05:51:26.418 INFO:teuthology.orchestra.run.smithi150.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-17T05:51:26.418 INFO:teuthology.orchestra.run.smithi150.stdout:invalid new device string format 2024-09-17T05:51:26.418 INFO:teuthology.orchestra.run.smithi150.stdout:mount.ceph: resolved to: "172.21.15.150:3300,172.21.15.176:3300,172.21.15.176:3301" 2024-09-17T05:51:26.418 INFO:teuthology.orchestra.run.smithi150.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-17T05:51:26.423 INFO:teuthology.orchestra.run.smithi150.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-17T05:51:26.423 INFO:teuthology.orchestra.run.smithi150.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-17T05:51:26.423 INFO:teuthology.orchestra.run.smithi150.stdout:invalid new device string format 2024-09-17T05:51:26.423 INFO:teuthology.orchestra.run.smithi150.stdout:mount.ceph: resolved to: "172.21.15.150:3300,172.21.15.176:3300,172.21.15.176:3301" 2024-09-17T05:51:26.423 INFO:teuthology.orchestra.run.smithi150.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-17T05:51:26.423 INFO:teuthology.orchestra.run.smithi150.stdout:mount.ceph: resolved to: "172.21.15.150:6789,172.21.15.176:6789,172.21.15.176:6790" 2024-09-17T05:51:26.423 INFO:teuthology.orchestra.run.smithi150.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.150:6789,172.21.15.176:6789,172.21.15.176:6790:/ 2024-09-17T05:51:26.424 INFO:teuthology.orchestra.run.smithi150.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=9f2e05e9-d629-47b3-b26b-1360655b7d20" will pass to kernel 2024-09-17T05:51:26.424 INFO:teuthology.orchestra.run.smithi150.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-09-17T05:51:26.424 INFO:teuthology.orchestra.run.smithi150.stdout: You just mounted a file system that supports labels which does not 2024-09-17T05:51:26.424 INFO:teuthology.orchestra.run.smithi150.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-09-17T05:51:26.424 INFO:teuthology.orchestra.run.smithi150.stdout: applications will generate AVC messages and not be allowed access to 2024-09-17T05:51:26.424 INFO:teuthology.orchestra.run.smithi150.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-09-17T05:51:26.425 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-17T05:51:26.425 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:51:26.426 DEBUG:teuthology.orchestra.run.smithi150:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-17T05:51:26.450 DEBUG:teuthology.orchestra.run.smithi150:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-17T05:51:26.540 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:26 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-17T05:51:26.545 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:26 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T05:51:26.551 INFO:teuthology.orchestra.run.smithi150.stdout:client7627 2024-09-17T05:51:26.551 DEBUG:teuthology.orchestra.run.smithi150:> set -ex 2024-09-17T05:51:26.551 DEBUG:teuthology.orchestra.run.smithi150:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T05:51:26.568 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs flag set enable_multiple true --yes-i-really-mean-it 2024-09-17T05:51:26.725 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:26.723+0000 7fbbf7f43640 1 -- 172.21.15.150:0/3913770898 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbbf00d0d20 msgr2=0x7fbbf00d1130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:51:26.726 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:26.723+0000 7fbbf7f43640 1 --2- 172.21.15.150:0/3913770898 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbbf00d0d20 0x7fbbf00d1130 secure :-1 s=READY pgs=1524 cs=0 l=1 rev1=1 crypto rx=0x7fbbf00b4120 tx=0x7fbbec02a560 comp rx=0 tx=0).stop 2024-09-17T05:51:26.726 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:26.723+0000 7fbbf7f43640 1 -- 172.21.15.150:0/3913770898 shutdown_connections 2024-09-17T05:51:26.726 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:26.723+0000 7fbbf7f43640 1 --2- 172.21.15.150:0/3913770898 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fbbf006e8d0 0x7fbbf006ece0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:51:26.726 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:26.723+0000 7fbbf7f43640 1 --2- 172.21.15.150:0/3913770898 >> v2:172.21.15.176:3300/0 conn(0x7fbbf00d1670 0x7fbbf006e390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:51:26.726 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:26.723+0000 7fbbf7f43640 1 --2- 172.21.15.150:0/3913770898 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbbf00d0d20 0x7fbbf00d1130 unknown :-1 s=CLOSED pgs=1524 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:51:26.726 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:26.723+0000 7fbbf7f43640 1 -- 172.21.15.150:0/3913770898 >> 172.21.15.150:0/3913770898 conn(0x7fbbf00d46f0 msgr2=0x7fbbf00d4b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:51:26.726 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:26.723+0000 7fbbf7f43640 1 -- 172.21.15.150:0/3913770898 shutdown_connections 2024-09-17T05:51:26.726 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:26.723+0000 7fbbf7f43640 1 -- 172.21.15.150:0/3913770898 wait complete. 2024-09-17T05:51:26.727 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:26.725+0000 7fbbf7f43640 1 Processor -- start 2024-09-17T05:51:26.727 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:26.725+0000 7fbbf7f43640 1 -- start start 2024-09-17T05:51:26.730 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:26.726+0000 7fbbf7f43640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbbf006e8d0 0x7fbbf01e7770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:51:26.730 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:26.726+0000 7fbbf7f43640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fbbf00d0d20 0x7fbbf00b61e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:51:26.730 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:26.727+0000 7fbbf7f43640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fbbf00d1670 0x7fbbf00a0540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:51:26.730 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:26.727+0000 7fbbf7f43640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7fbbf006f220 con 0x7fbbf006e8d0 2024-09-17T05:51:26.730 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:26.727+0000 7fbbf7f43640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fbbf006f3a0 con 0x7fbbf00d1670 2024-09-17T05:51:26.730 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:26.727+0000 7fbbf7f43640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fbbf006f520 con 0x7fbbf00d0d20 2024-09-17T05:51:26.730 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:26.727+0000 7fbbf5cdf640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbbf006e8d0 0x7fbbf01e7770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:51:26.730 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:26.727+0000 7fbbf5cdf640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbbf006e8d0 0x7fbbf01e7770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:57742/0 (socket says 172.21.15.150:57742) 2024-09-17T05:51:26.731 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:26.727+0000 7fbbf5cdf640 1 -- 172.21.15.150:0/148554289 learned_addr learned my addr 172.21.15.150:0/148554289 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:51:26.731 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:26.727+0000 7fbbf54de640 1 --2- 172.21.15.150:0/148554289 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fbbf00d0d20 0x7fbbf00b61e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:51:26.731 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:26.727+0000 7fbbf64e0640 1 --2- 172.21.15.150:0/148554289 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fbbf00d1670 0x7fbbf00a0540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:51:26.731 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:26.727+0000 7fbbf5cdf640 1 -- 172.21.15.150:0/148554289 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fbbf00d0d20 msgr2=0x7fbbf00b61e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:51:26.731 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:26.727+0000 7fbbf5cdf640 1 --2- 172.21.15.150:0/148554289 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fbbf00d0d20 0x7fbbf00b61e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:51:26.731 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:26.727+0000 7fbbf5cdf640 1 -- 172.21.15.150:0/148554289 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fbbf00d1670 msgr2=0x7fbbf00a0540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:51:26.731 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:26.727+0000 7fbbf5cdf640 1 --2- 172.21.15.150:0/148554289 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fbbf00d1670 0x7fbbf00a0540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:51:26.731 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:26.727+0000 7fbbf5cdf640 1 -- 172.21.15.150:0/148554289 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbbf00c8220 con 0x7fbbf006e8d0 2024-09-17T05:51:26.731 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:26.727+0000 7fbbf64e0640 1 --2- 172.21.15.150:0/148554289 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fbbf00d1670 0x7fbbf00a0540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:51:26.731 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:26.727+0000 7fbbf5cdf640 1 --2- 172.21.15.150:0/148554289 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbbf006e8d0 0x7fbbf01e7770 secure :-1 s=READY pgs=1525 cs=0 l=1 rev1=1 crypto rx=0x7fbbec034040 tx=0x7fbbec0039e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:51:26.732 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:26.727+0000 7fbbe67fc640 1 -- 172.21.15.150:0/148554289 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbbec03e030 con 0x7fbbf006e8d0 2024-09-17T05:51:26.732 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:26.727+0000 7fbbe67fc640 1 -- 172.21.15.150:0/148554289 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fbbec0047a0 con 0x7fbbf006e8d0 2024-09-17T05:51:26.732 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:26.727+0000 7fbbf7f43640 1 -- 172.21.15.150:0/148554289 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbbf01e7fa0 con 0x7fbbf006e8d0 2024-09-17T05:51:26.732 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:26.727+0000 7fbbe67fc640 1 -- 172.21.15.150:0/148554289 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbbec035040 con 0x7fbbf006e8d0 2024-09-17T05:51:26.732 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:26.727+0000 7fbbf7f43640 1 -- 172.21.15.150:0/148554289 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbbf01e8560 con 0x7fbbf006e8d0 2024-09-17T05:51:26.732 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:26.728+0000 7fbbf7f43640 1 -- 172.21.15.150:0/148554289 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbbf00d1130 con 0x7fbbf006e8d0 2024-09-17T05:51:26.733 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:26.729+0000 7fbbe67fc640 1 -- 172.21.15.150:0/148554289 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 37) ==== 103787+0+0 (secure 0 0 0) 0x7fbbec041030 con 0x7fbbf006e8d0 2024-09-17T05:51:26.733 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:26.730+0000 7fbbe67fc640 1 --2- 172.21.15.150:0/148554289 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fbbd407a570 0x7fbbd407ca80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:51:26.733 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:26.730+0000 7fbbe67fc640 1 -- 172.21.15.150:0/148554289 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(113..113 src has 1..113) ==== 5849+0+0 (secure 0 0 0) 0x7fbbec0ba430 con 0x7fbbf006e8d0 2024-09-17T05:51:26.733 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:26.730+0000 7fbbf54de640 1 --2- 172.21.15.150:0/148554289 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fbbd407a570 0x7fbbd407ca80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:51:26.733 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:26.730+0000 7fbbf54de640 1 --2- 172.21.15.150:0/148554289 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fbbd407a570 0x7fbbd407ca80 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7fbbe0005ce0 tx=0x7fbbe0005c70 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:51:26.736 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:26.734+0000 7fbbe67fc640 1 -- 172.21.15.150:0/148554289 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fbbec084370 con 0x7fbbf006e8d0 2024-09-17T05:51:26.741 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-17T05:51:26.743 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-17T05:51:26.950 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:26.948+0000 7fbbf7f43640 1 -- 172.21.15.150:0/148554289 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "fs flag set", "flag_name": "enable_multiple", "val": "true", "yes_i_really_mean_it": true} v 0) -- 0x7fbbf00b9ae0 con 0x7fbbf006e8d0 2024-09-17T05:51:27.578 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:27.576+0000 7fbbe67fc640 1 -- 172.21.15.150:0/148554289 <== mon.0 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "fs flag set", "flag_name": "enable_multiple", "val": "true", "yes_i_really_mean_it": true}]=0 v71) ==== 136+0+0 (secure 0 0 0) 0x7fbbec083c70 con 0x7fbbf006e8d0 2024-09-17T05:51:27.581 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:27.579+0000 7fbbf7f43640 1 -- 172.21.15.150:0/148554289 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fbbd407a570 msgr2=0x7fbbd407ca80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:51:27.581 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:27.579+0000 7fbbf7f43640 1 --2- 172.21.15.150:0/148554289 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fbbd407a570 0x7fbbd407ca80 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7fbbe0005ce0 tx=0x7fbbe0005c70 comp rx=0 tx=0).stop 2024-09-17T05:51:27.581 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:27.579+0000 7fbbf7f43640 1 -- 172.21.15.150:0/148554289 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbbf006e8d0 msgr2=0x7fbbf01e7770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:51:27.581 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:27.579+0000 7fbbf7f43640 1 --2- 172.21.15.150:0/148554289 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbbf006e8d0 0x7fbbf01e7770 secure :-1 s=READY pgs=1525 cs=0 l=1 rev1=1 crypto rx=0x7fbbec034040 tx=0x7fbbec0039e0 comp rx=0 tx=0).stop 2024-09-17T05:51:27.581 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:27.579+0000 7fbbf7f43640 1 -- 172.21.15.150:0/148554289 shutdown_connections 2024-09-17T05:51:27.581 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:27.579+0000 7fbbf7f43640 1 --2- 172.21.15.150:0/148554289 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fbbf00d1670 0x7fbbf00a0540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:51:27.581 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:27.579+0000 7fbbf7f43640 1 --2- 172.21.15.150:0/148554289 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fbbd407a570 0x7fbbd407ca80 unknown :-1 s=CLOSED pgs=649 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:51:27.581 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:27.579+0000 7fbbf7f43640 1 --2- 172.21.15.150:0/148554289 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fbbf00d0d20 0x7fbbf00b61e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:51:27.581 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:27.579+0000 7fbbf7f43640 1 --2- 172.21.15.150:0/148554289 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbbf006e8d0 0x7fbbf01e7770 unknown :-1 s=CLOSED pgs=1525 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:51:27.581 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:27.579+0000 7fbbf7f43640 1 -- 172.21.15.150:0/148554289 >> 172.21.15.150:0/148554289 conn(0x7fbbf00d46f0 msgr2=0x7fbbf0161bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:51:27.581 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:27.579+0000 7fbbf7f43640 1 -- 172.21.15.150:0/148554289 shutdown_connections 2024-09-17T05:51:27.582 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:27.579+0000 7fbbf7f43640 1 -- 172.21.15.150:0/148554289 wait complete. 2024-09-17T05:51:27.595 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume ls 2024-09-17T05:51:27.719 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:27.716+0000 7f86f00fa640 1 -- 172.21.15.150:0/1760459690 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f86e80ce490 msgr2=0x7f86e80ce8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:51:27.719 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:27.716+0000 7f86f00fa640 1 --2- 172.21.15.150:0/1760459690 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f86e80ce490 0x7f86e80ce8a0 secure :-1 s=READY pgs=1526 cs=0 l=1 rev1=1 crypto rx=0x7f86e4005fd0 tx=0x7f86e402a4b0 comp rx=0 tx=0).stop 2024-09-17T05:51:27.719 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:27.717+0000 7f86f00fa640 1 -- 172.21.15.150:0/1760459690 shutdown_connections 2024-09-17T05:51:27.719 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:27.717+0000 7f86f00fa640 1 --2- 172.21.15.150:0/1760459690 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f86e80ce490 0x7f86e80ce8a0 unknown :-1 s=CLOSED pgs=1526 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:51:27.719 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:27.717+0000 7f86f00fa640 1 --2- 172.21.15.150:0/1760459690 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f86e8070660 0x7f86e80af6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:51:27.719 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:27.717+0000 7f86f00fa640 1 -- 172.21.15.150:0/1760459690 >> 172.21.15.150:0/1760459690 conn(0x7f86e806d3d0 msgr2=0x7f86e80b1ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:51:27.719 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:27.717+0000 7f86f00fa640 1 -- 172.21.15.150:0/1760459690 shutdown_connections 2024-09-17T05:51:27.719 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:27.717+0000 7f86f00fa640 1 -- 172.21.15.150:0/1760459690 wait complete. 2024-09-17T05:51:27.720 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:27.718+0000 7f86f00fa640 1 Processor -- start 2024-09-17T05:51:27.720 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:27.718+0000 7f86f00fa640 1 -- start start 2024-09-17T05:51:27.722 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:27.720+0000 7f86f00fa640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f86e8070660 0x7f86e8158a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:51:27.723 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:27.720+0000 7f86f00fa640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f86e80ad1c0 0x7f86e81f72d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:51:27.723 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:27.720+0000 7f86f00fa640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f86e80ce490 0x7f86e80c9790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:51:27.723 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:27.720+0000 7f86f00fa640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f86e80ade60 con 0x7f86e80ce490 2024-09-17T05:51:27.723 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:27.720+0000 7f86f00fa640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f86e80adce0 con 0x7f86e8070660 2024-09-17T05:51:27.723 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:27.720+0000 7f86f00fa640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f86e8165ee0 con 0x7f86e80ad1c0 2024-09-17T05:51:27.723 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:27.720+0000 7f86ee697640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f86e80ce490 0x7f86e80c9790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:51:27.723 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:27.720+0000 7f86ee697640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f86e80ce490 0x7f86e80c9790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:57762/0 (socket says 172.21.15.150:57762) 2024-09-17T05:51:27.723 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:27.720+0000 7f86ee697640 1 -- 172.21.15.150:0/2162521090 learned_addr learned my addr 172.21.15.150:0/2162521090 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:51:27.723 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:27.720+0000 7f86ede96640 1 --2- 172.21.15.150:0/2162521090 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f86e8070660 0x7f86e8158a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:51:27.723 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:27.720+0000 7f86ed695640 1 --2- 172.21.15.150:0/2162521090 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f86e80ad1c0 0x7f86e81f72d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:51:27.723 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:27.720+0000 7f86ee697640 1 -- 172.21.15.150:0/2162521090 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f86e80ad1c0 msgr2=0x7f86e81f72d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:51:27.723 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:27.720+0000 7f86ee697640 1 --2- 172.21.15.150:0/2162521090 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f86e80ad1c0 0x7f86e81f72d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:51:27.724 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:27.720+0000 7f86ee697640 1 -- 172.21.15.150:0/2162521090 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f86e8070660 msgr2=0x7f86e8158a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:51:27.724 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:27.720+0000 7f86ee697640 1 --2- 172.21.15.150:0/2162521090 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f86e8070660 0x7f86e8158a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:51:27.724 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:27.720+0000 7f86ee697640 1 -- 172.21.15.150:0/2162521090 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f86e81592b0 con 0x7f86e80ce490 2024-09-17T05:51:27.724 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:27.720+0000 7f86ee697640 1 --2- 172.21.15.150:0/2162521090 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f86e80ce490 0x7f86e80c9790 secure :-1 s=READY pgs=1527 cs=0 l=1 rev1=1 crypto rx=0x7f86e0002230 tx=0x7f86e000cb90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:51:27.724 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:27.720+0000 7f86da7fc640 1 -- 172.21.15.150:0/2162521090 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86e0003b70 con 0x7f86e80ce490 2024-09-17T05:51:27.724 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:27.721+0000 7f86da7fc640 1 -- 172.21.15.150:0/2162521090 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f86e0003d10 con 0x7f86e80ce490 2024-09-17T05:51:27.724 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:27.721+0000 7f86f00fa640 1 -- 172.21.15.150:0/2162521090 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f86e8159590 con 0x7f86e80ce490 2024-09-17T05:51:27.724 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:27.721+0000 7f86da7fc640 1 -- 172.21.15.150:0/2162521090 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86e0005330 con 0x7f86e80ce490 2024-09-17T05:51:27.724 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:27.721+0000 7f86f00fa640 1 -- 172.21.15.150:0/2162521090 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f86e81f6db0 con 0x7f86e80ce490 2024-09-17T05:51:27.725 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:27.721+0000 7f86f00fa640 1 -- 172.21.15.150:0/2162521090 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f86e8159020 con 0x7f86e80ce490 2024-09-17T05:51:27.725 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:27.722+0000 7f86da7fc640 1 -- 172.21.15.150:0/2162521090 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 37) ==== 103787+0+0 (secure 0 0 0) 0x7f86e00056e0 con 0x7f86e80ce490 2024-09-17T05:51:27.725 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:27.723+0000 7f86da7fc640 1 --2- 172.21.15.150:0/2162521090 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f86cc07a570 0x7f86cc07ca80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:51:27.725 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:27.723+0000 7f86da7fc640 1 -- 172.21.15.150:0/2162521090 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(113..113 src has 1..113) ==== 5849+0+0 (secure 0 0 0) 0x7f86e0099a20 con 0x7f86e80ce490 2024-09-17T05:51:27.725 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:27.723+0000 7f86ede96640 1 --2- 172.21.15.150:0/2162521090 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f86cc07a570 0x7f86cc07ca80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:51:27.726 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:27.724+0000 7f86ede96640 1 --2- 172.21.15.150:0/2162521090 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f86cc07a570 0x7f86cc07ca80 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7f86e8072000 tx=0x7f86dc005f90 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:51:27.729 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:27.728+0000 7f86da7fc640 1 -- 172.21.15.150:0/2162521090 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f86e0063310 con 0x7f86e80ce490 2024-09-17T05:51:27.930 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:27.929+0000 7f86f00fa640 1 -- 172.21.15.150:0/2162521090 --> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] -- mgr_command(tid 0: {"prefix": "fs volume ls", "target": ["mon-mgr", ""]}) -- 0x7f86e80af6a0 con 0x7f86cc07a570 2024-09-17T05:51:27.932 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:27.931+0000 7f86da7fc640 1 -- 172.21.15.150:0/2162521090 <== mgr.4108 v2:172.21.15.176:6800/3631216395 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+41 (secure 0 0 0) 0x7f86e80af6a0 con 0x7f86cc07a570 2024-09-17T05:51:27.932 INFO:teuthology.orchestra.run.smithi150.stdout:[ 2024-09-17T05:51:27.932 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-09-17T05:51:27.933 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "cephfs" 2024-09-17T05:51:27.933 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-09-17T05:51:27.933 INFO:teuthology.orchestra.run.smithi150.stdout:] 2024-09-17T05:51:27.935 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:27.933+0000 7f86f00fa640 1 -- 172.21.15.150:0/2162521090 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f86cc07a570 msgr2=0x7f86cc07ca80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:51:27.935 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:27.933+0000 7f86f00fa640 1 --2- 172.21.15.150:0/2162521090 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f86cc07a570 0x7f86cc07ca80 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7f86e8072000 tx=0x7f86dc005f90 comp rx=0 tx=0).stop 2024-09-17T05:51:27.935 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:27.933+0000 7f86f00fa640 1 -- 172.21.15.150:0/2162521090 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f86e80ce490 msgr2=0x7f86e80c9790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:51:27.935 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:27.933+0000 7f86f00fa640 1 --2- 172.21.15.150:0/2162521090 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f86e80ce490 0x7f86e80c9790 secure :-1 s=READY pgs=1527 cs=0 l=1 rev1=1 crypto rx=0x7f86e0002230 tx=0x7f86e000cb90 comp rx=0 tx=0).stop 2024-09-17T05:51:27.935 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:27.933+0000 7f86f00fa640 1 -- 172.21.15.150:0/2162521090 shutdown_connections 2024-09-17T05:51:27.935 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:27.933+0000 7f86f00fa640 1 --2- 172.21.15.150:0/2162521090 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f86cc07a570 0x7f86cc07ca80 unknown :-1 s=CLOSED pgs=650 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:51:27.935 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:27.933+0000 7f86f00fa640 1 --2- 172.21.15.150:0/2162521090 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f86e80ce490 0x7f86e80c9790 unknown :-1 s=CLOSED pgs=1527 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:51:27.935 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:27.933+0000 7f86f00fa640 1 --2- 172.21.15.150:0/2162521090 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f86e80ad1c0 0x7f86e81f72d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:51:27.936 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:27.933+0000 7f86f00fa640 1 --2- 172.21.15.150:0/2162521090 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f86e8070660 0x7f86e8158a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:51:27.936 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:27.933+0000 7f86f00fa640 1 -- 172.21.15.150:0/2162521090 >> 172.21.15.150:0/2162521090 conn(0x7f86e806d3d0 msgr2=0x7f86e8074d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:51:27.936 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:27.933+0000 7f86f00fa640 1 -- 172.21.15.150:0/2162521090 shutdown_connections 2024-09-17T05:51:27.936 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:27.933+0000 7f86f00fa640 1 -- 172.21.15.150:0/2162521090 wait complete. 2024-09-17T05:51:27.946 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-09-17T05:51:28.064 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:28.062+0000 7f525c2f2640 1 -- 172.21.15.150:0/917084831 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f525415fb80 msgr2=0x7f52540ce280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:51:28.064 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:28.062+0000 7f525c2f2640 1 --2- 172.21.15.150:0/917084831 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f525415fb80 0x7f52540ce280 secure :-1 s=READY pgs=1528 cs=0 l=1 rev1=1 crypto rx=0x7f5254074870 tx=0x7f524c02aa30 comp rx=0 tx=0).stop 2024-09-17T05:51:28.064 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:28.062+0000 7f525c2f2640 1 -- 172.21.15.150:0/917084831 shutdown_connections 2024-09-17T05:51:28.064 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:28.062+0000 7f525c2f2640 1 --2- 172.21.15.150:0/917084831 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f525415fb80 0x7f52540ce280 unknown :-1 s=CLOSED pgs=1528 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:51:28.064 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:28.062+0000 7f525c2f2640 1 --2- 172.21.15.150:0/917084831 >> v2:172.21.15.176:3300/0 conn(0x7f525415f230 0x7f525415f640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:51:28.064 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:28.062+0000 7f525c2f2640 1 --2- 172.21.15.150:0/917084831 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f525415b740 0x7f52540cf550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:51:28.065 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:28.062+0000 7f525c2f2640 1 -- 172.21.15.150:0/917084831 >> 172.21.15.150:0/917084831 conn(0x7f52540b2400 msgr2=0x7f52540b2810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:51:28.065 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:28.062+0000 7f525c2f2640 1 -- 172.21.15.150:0/917084831 shutdown_connections 2024-09-17T05:51:28.065 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:28.062+0000 7f525c2f2640 1 -- 172.21.15.150:0/917084831 wait complete. 2024-09-17T05:51:28.065 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:28.064+0000 7f525c2f2640 1 Processor -- start 2024-09-17T05:51:28.065 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:28.064+0000 7f525c2f2640 1 -- start start 2024-09-17T05:51:28.068 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:28.065+0000 7f525c2f2640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f525415b740 0x7f5254153d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:51:28.068 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:28.065+0000 7f525c2f2640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f525415f230 0x7f52541ef110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:51:28.068 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:28.065+0000 7f525c2f2640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f525415fb80 0x7f52541ef650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:51:28.068 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:28.065+0000 7f525c2f2640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f52540ceb50 con 0x7f525415b740 2024-09-17T05:51:28.068 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:28.065+0000 7f525c2f2640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f52540ce9d0 con 0x7f525415f230 2024-09-17T05:51:28.068 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:28.065+0000 7f525c2f2640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f52540cecd0 con 0x7f525415fb80 2024-09-17T05:51:28.069 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:28.065+0000 7f525a08e640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f525415b740 0x7f5254153d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:51:28.069 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:28.065+0000 7f525a08e640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f525415b740 0x7f5254153d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:57772/0 (socket says 172.21.15.150:57772) 2024-09-17T05:51:28.069 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:28.065+0000 7f525a08e640 1 -- 172.21.15.150:0/1924733884 learned_addr learned my addr 172.21.15.150:0/1924733884 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:51:28.069 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:28.065+0000 7f525a88f640 1 --2- 172.21.15.150:0/1924733884 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f525415fb80 0x7f52541ef650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:51:28.069 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:28.065+0000 7f525988d640 1 --2- 172.21.15.150:0/1924733884 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f525415f230 0x7f52541ef110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:51:28.069 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:28.066+0000 7f525a08e640 1 -- 172.21.15.150:0/1924733884 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f525415fb80 msgr2=0x7f52541ef650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:51:28.069 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:28.066+0000 7f525a08e640 1 --2- 172.21.15.150:0/1924733884 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f525415fb80 0x7f52541ef650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:51:28.069 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:28.066+0000 7f525a08e640 1 -- 172.21.15.150:0/1924733884 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f525415f230 msgr2=0x7f52541ef110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:51:28.069 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:28.066+0000 7f525a08e640 1 --2- 172.21.15.150:0/1924733884 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f525415f230 0x7f52541ef110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:51:28.069 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:28.066+0000 7f525a08e640 1 -- 172.21.15.150:0/1924733884 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f525415cad0 con 0x7f525415b740 2024-09-17T05:51:28.069 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:28.066+0000 7f525a08e640 1 --2- 172.21.15.150:0/1924733884 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f525415b740 0x7f5254153d30 secure :-1 s=READY pgs=1529 cs=0 l=1 rev1=1 crypto rx=0x7f525000c740 tx=0x7f525000cc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:51:28.069 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:28.066+0000 7f524affd640 1 -- 172.21.15.150:0/1924733884 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5250007bb0 con 0x7f525415b740 2024-09-17T05:51:28.070 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:28.066+0000 7f524affd640 1 -- 172.21.15.150:0/1924733884 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f525000ce50 con 0x7f525415b740 2024-09-17T05:51:28.070 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:28.066+0000 7f525c2f2640 1 -- 172.21.15.150:0/1924733884 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f525415cdb0 con 0x7f525415b740 2024-09-17T05:51:28.070 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:28.066+0000 7f524affd640 1 -- 172.21.15.150:0/1924733884 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5250005280 con 0x7f525415b740 2024-09-17T05:51:28.070 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:28.066+0000 7f525c2f2640 1 -- 172.21.15.150:0/1924733884 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f525415d370 con 0x7f525415b740 2024-09-17T05:51:28.070 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:28.067+0000 7f525c2f2640 1 -- 172.21.15.150:0/1924733884 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f52540cf120 con 0x7f525415b740 2024-09-17T05:51:28.071 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:28.068+0000 7f524affd640 1 -- 172.21.15.150:0/1924733884 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 37) ==== 103787+0+0 (secure 0 0 0) 0x7f5250005420 con 0x7f525415b740 2024-09-17T05:51:28.071 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:28.069+0000 7f524affd640 1 --2- 172.21.15.150:0/1924733884 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f523807a570 0x7f523807ca80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:51:28.071 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:28.069+0000 7f524affd640 1 -- 172.21.15.150:0/1924733884 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(113..113 src has 1..113) ==== 5849+0+0 (secure 0 0 0) 0x7f5250099ec0 con 0x7f525415b740 2024-09-17T05:51:28.071 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:28.069+0000 7f525988d640 1 --2- 172.21.15.150:0/1924733884 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f523807a570 0x7f523807ca80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:51:28.071 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:28.070+0000 7f525988d640 1 --2- 172.21.15.150:0/1924733884 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f523807a570 0x7f523807ca80 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7f524400a490 tx=0x7f524400a420 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:51:28.075 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:28.073+0000 7f524affd640 1 -- 172.21.15.150:0/1924733884 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f5250014030 con 0x7f525415b740 2024-09-17T05:51:28.251 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:28.249+0000 7f525c2f2640 1 -- 172.21.15.150:0/1924733884 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) -- 0x7f5254069700 con 0x7f525415b740 2024-09-17T05:51:28.251 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:28.250+0000 7f524affd640 1 -- 172.21.15.150:0/1924733884 <== mon.0 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v52)=0 v52) ==== 122+0+0 (secure 0 0 0) 0x7f5250063840 con 0x7f525415b740 2024-09-17T05:51:28.254 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:28.252+0000 7f525c2f2640 1 -- 172.21.15.150:0/1924733884 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f523807a570 msgr2=0x7f523807ca80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:51:28.254 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:28.252+0000 7f525c2f2640 1 --2- 172.21.15.150:0/1924733884 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f523807a570 0x7f523807ca80 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7f524400a490 tx=0x7f524400a420 comp rx=0 tx=0).stop 2024-09-17T05:51:28.254 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:28.252+0000 7f525c2f2640 1 -- 172.21.15.150:0/1924733884 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f525415b740 msgr2=0x7f5254153d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:51:28.254 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:28.252+0000 7f525c2f2640 1 --2- 172.21.15.150:0/1924733884 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f525415b740 0x7f5254153d30 secure :-1 s=READY pgs=1529 cs=0 l=1 rev1=1 crypto rx=0x7f525000c740 tx=0x7f525000cc00 comp rx=0 tx=0).stop 2024-09-17T05:51:28.254 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:28.252+0000 7f525c2f2640 1 -- 172.21.15.150:0/1924733884 shutdown_connections 2024-09-17T05:51:28.254 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:28.252+0000 7f525c2f2640 1 --2- 172.21.15.150:0/1924733884 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f525415f230 0x7f52541ef110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:51:28.254 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:28.252+0000 7f525c2f2640 1 --2- 172.21.15.150:0/1924733884 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f523807a570 0x7f523807ca80 unknown :-1 s=CLOSED pgs=651 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:51:28.254 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:28.252+0000 7f525c2f2640 1 --2- 172.21.15.150:0/1924733884 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f525415fb80 0x7f52541ef650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:51:28.254 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:28.252+0000 7f525c2f2640 1 --2- 172.21.15.150:0/1924733884 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f525415b740 0x7f5254153d30 unknown :-1 s=CLOSED pgs=1529 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:51:28.254 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:28.252+0000 7f525c2f2640 1 -- 172.21.15.150:0/1924733884 >> 172.21.15.150:0/1924733884 conn(0x7f52540b2400 msgr2=0x7f52540b2810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:51:28.254 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:28.252+0000 7f525c2f2640 1 -- 172.21.15.150:0/1924733884 shutdown_connections 2024-09-17T05:51:28.254 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:28.252+0000 7f525c2f2640 1 -- 172.21.15.150:0/1924733884 wait complete. 2024-09-17T05:51:28.265 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config get mgr mgr/volumes/max_concurrent_clones 2024-09-17T05:51:28.381 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:28.379+0000 7fb2a1d01640 1 -- 172.21.15.150:0/3776469489 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb29c0ccc50 msgr2=0x7fb29c0cf570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:51:28.382 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:28.379+0000 7fb2a1d01640 1 --2- 172.21.15.150:0/3776469489 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb29c0ccc50 0x7fb29c0cf570 secure :-1 s=READY pgs=1531 cs=0 l=1 rev1=1 crypto rx=0x7fb29c072330 tx=0x7fb28c02a4a0 comp rx=0 tx=0).stop 2024-09-17T05:51:28.382 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:28.379+0000 7fb2a1d01640 1 -- 172.21.15.150:0/3776469489 shutdown_connections 2024-09-17T05:51:28.382 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:28.379+0000 7fb2a1d01640 1 --2- 172.21.15.150:0/3776469489 >> v2:172.21.15.176:3300/0 conn(0x7fb29c0cfab0 0x7fb29c073630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:51:28.382 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:28.379+0000 7fb2a1d01640 1 --2- 172.21.15.150:0/3776469489 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb29c0ccc50 0x7fb29c0cf570 unknown :-1 s=CLOSED pgs=1531 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:51:28.382 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:28.379+0000 7fb2a1d01640 1 -- 172.21.15.150:0/3776469489 >> 172.21.15.150:0/3776469489 conn(0x7fb29c06d1c0 msgr2=0x7fb29c06d5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:51:28.382 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:28.379+0000 7fb2a1d01640 1 -- 172.21.15.150:0/3776469489 shutdown_connections 2024-09-17T05:51:28.382 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:28.379+0000 7fb2a1d01640 1 -- 172.21.15.150:0/3776469489 wait complete. 2024-09-17T05:51:28.383 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:28.381+0000 7fb2a1d01640 1 Processor -- start 2024-09-17T05:51:28.383 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:28.381+0000 7fb2a1d01640 1 -- start start 2024-09-17T05:51:28.385 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:28.382+0000 7fb2a1d01640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb29c073b70 0x7fb29c1e76e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:51:28.385 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:28.382+0000 7fb2a1d01640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb29c0ccc50 0x7fb29c06f360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:51:28.386 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:28.382+0000 7fb2a1d01640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb29c0cfab0 0x7fb29c1f6380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:51:28.386 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:28.382+0000 7fb2a1d01640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7fb29c15fa00 con 0x7fb29c073b70 2024-09-17T05:51:28.386 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:28.382+0000 7fb2a1d01640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fb29c15f880 con 0x7fb29c0ccc50 2024-09-17T05:51:28.386 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:28.382+0000 7fb2a1d01640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fb29c15fb80 con 0x7fb29c0cfab0 2024-09-17T05:51:28.386 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:28.382+0000 7fb29b7fe640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb29c073b70 0x7fb29c1e76e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:51:28.386 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:28.382+0000 7fb29b7fe640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb29c073b70 0x7fb29c1e76e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:57786/0 (socket says 172.21.15.150:57786) 2024-09-17T05:51:28.386 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:28.382+0000 7fb29b7fe640 1 -- 172.21.15.150:0/4092829679 learned_addr learned my addr 172.21.15.150:0/4092829679 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:51:28.386 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:28.383+0000 7fb293fff640 1 --2- 172.21.15.150:0/4092829679 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb29c0ccc50 0x7fb29c06f360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:51:28.386 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:28.383+0000 7fb29bfff640 1 --2- 172.21.15.150:0/4092829679 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb29c0cfab0 0x7fb29c1f6380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:51:28.386 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:28.383+0000 7fb29b7fe640 1 -- 172.21.15.150:0/4092829679 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb29c0cfab0 msgr2=0x7fb29c1f6380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:51:28.387 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:28.383+0000 7fb29b7fe640 1 --2- 172.21.15.150:0/4092829679 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb29c0cfab0 0x7fb29c1f6380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:51:28.387 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:28.383+0000 7fb29b7fe640 1 -- 172.21.15.150:0/4092829679 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb29c0ccc50 msgr2=0x7fb29c06f360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:51:28.387 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:28.383+0000 7fb29b7fe640 1 --2- 172.21.15.150:0/4092829679 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb29c0ccc50 0x7fb29c06f360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:51:28.387 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:28.383+0000 7fb29b7fe640 1 -- 172.21.15.150:0/4092829679 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb29c1f7130 con 0x7fb29c073b70 2024-09-17T05:51:28.387 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:28.383+0000 7fb29b7fe640 1 --2- 172.21.15.150:0/4092829679 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb29c073b70 0x7fb29c1e76e0 secure :-1 s=READY pgs=1532 cs=0 l=1 rev1=1 crypto rx=0x7fb28c009780 tx=0x7fb28c033c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:51:28.387 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:28.383+0000 7fb298ff9640 1 -- 172.21.15.150:0/4092829679 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb28c031d60 con 0x7fb29c073b70 2024-09-17T05:51:28.387 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:28.383+0000 7fb298ff9640 1 -- 172.21.15.150:0/4092829679 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb28c033e10 con 0x7fb29c073b70 2024-09-17T05:51:28.387 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:28.383+0000 7fb298ff9640 1 -- 172.21.15.150:0/4092829679 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb28c005260 con 0x7fb29c073b70 2024-09-17T05:51:28.387 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:28.383+0000 7fb2a1d01640 1 -- 172.21.15.150:0/4092829679 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb29c1f7410 con 0x7fb29c073b70 2024-09-17T05:51:28.387 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:28.383+0000 7fb2a1d01640 1 -- 172.21.15.150:0/4092829679 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb29c1f79d0 con 0x7fb29c073b70 2024-09-17T05:51:28.388 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:28.384+0000 7fb2a1d01640 1 -- 172.21.15.150:0/4092829679 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb29c0cf570 con 0x7fb29c073b70 2024-09-17T05:51:28.388 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:28.385+0000 7fb298ff9640 1 -- 172.21.15.150:0/4092829679 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 37) ==== 103787+0+0 (secure 0 0 0) 0x7fb28c005400 con 0x7fb29c073b70 2024-09-17T05:51:28.388 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:28.386+0000 7fb298ff9640 1 --2- 172.21.15.150:0/4092829679 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fb27c07a5a0 0x7fb27c07cab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:51:28.389 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:28.386+0000 7fb298ff9640 1 -- 172.21.15.150:0/4092829679 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(113..113 src has 1..113) ==== 5849+0+0 (secure 0 0 0) 0x7fb28c0bac60 con 0x7fb29c073b70 2024-09-17T05:51:28.389 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:28.386+0000 7fb293fff640 1 --2- 172.21.15.150:0/4092829679 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fb27c07a5a0 0x7fb27c07cab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:51:28.389 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:28.386+0000 7fb293fff640 1 --2- 172.21.15.150:0/4092829679 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fb27c07a5a0 0x7fb27c07cab0 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7fb29c0b1ec0 tx=0x7fb284005f90 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:51:28.392 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:28.390+0000 7fb298ff9640 1 -- 172.21.15.150:0/4092829679 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fb28c03f030 con 0x7fb29c073b70 2024-09-17T05:51:28.568 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:28.566+0000 7fb2a1d01640 1 -- 172.21.15.150:0/4092829679 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "config get", "who": "mgr", "key": "mgr/volumes/max_concurrent_clones"} v 0) -- 0x7fb29c0b21d0 con 0x7fb29c073b70 2024-09-17T05:51:28.568 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:28.567+0000 7fb298ff9640 1 -- 172.21.15.150:0/4092829679 <== mon.0 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "config get", "who": "mgr", "key": "mgr/volumes/max_concurrent_clones"}]=0 v52) ==== 116+0+2 (secure 0 0 0) 0x7fb28c084550 con 0x7fb29c073b70 2024-09-17T05:51:28.568 INFO:teuthology.orchestra.run.smithi150.stdout:4 2024-09-17T05:51:28.571 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:28.569+0000 7fb2a1d01640 1 -- 172.21.15.150:0/4092829679 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fb27c07a5a0 msgr2=0x7fb27c07cab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:51:28.571 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:28.569+0000 7fb2a1d01640 1 --2- 172.21.15.150:0/4092829679 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fb27c07a5a0 0x7fb27c07cab0 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7fb29c0b1ec0 tx=0x7fb284005f90 comp rx=0 tx=0).stop 2024-09-17T05:51:28.571 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:28.569+0000 7fb2a1d01640 1 -- 172.21.15.150:0/4092829679 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb29c073b70 msgr2=0x7fb29c1e76e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:51:28.571 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:28.569+0000 7fb2a1d01640 1 --2- 172.21.15.150:0/4092829679 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb29c073b70 0x7fb29c1e76e0 secure :-1 s=READY pgs=1532 cs=0 l=1 rev1=1 crypto rx=0x7fb28c009780 tx=0x7fb28c033c20 comp rx=0 tx=0).stop 2024-09-17T05:51:28.571 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:28.569+0000 7fb2a1d01640 1 -- 172.21.15.150:0/4092829679 shutdown_connections 2024-09-17T05:51:28.571 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:28.569+0000 7fb2a1d01640 1 --2- 172.21.15.150:0/4092829679 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb29c0ccc50 0x7fb29c06f360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:51:28.571 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:28.569+0000 7fb2a1d01640 1 --2- 172.21.15.150:0/4092829679 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fb27c07a5a0 0x7fb27c07cab0 unknown :-1 s=CLOSED pgs=652 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:51:28.571 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:28.569+0000 7fb2a1d01640 1 --2- 172.21.15.150:0/4092829679 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb29c0cfab0 0x7fb29c1f6380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:51:28.571 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:28.569+0000 7fb2a1d01640 1 --2- 172.21.15.150:0/4092829679 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb29c073b70 0x7fb29c1e76e0 unknown :-1 s=CLOSED pgs=1532 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:51:28.571 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:28.569+0000 7fb2a1d01640 1 -- 172.21.15.150:0/4092829679 >> 172.21.15.150:0/4092829679 conn(0x7fb29c06d1c0 msgr2=0x7fb29c0b3480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:51:28.571 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:28.569+0000 7fb2a1d01640 1 -- 172.21.15.150:0/4092829679 shutdown_connections 2024-09-17T05:51:28.571 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:28.569+0000 7fb2a1d01640 1 -- 172.21.15.150:0/4092829679 wait complete. 2024-09-17T05:51:28.583 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mgr mgr/volumes/max_concurrent_clones 4 2024-09-17T05:51:28.699 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:28.697+0000 7ffa388f9640 1 -- 172.21.15.150:0/2713743885 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ffa341633e0 msgr2=0x7ffa34168bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:51:28.699 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:28.697+0000 7ffa388f9640 1 --2- 172.21.15.150:0/2713743885 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ffa341633e0 0x7ffa34168bf0 secure :-1 s=READY pgs=1534 cs=0 l=1 rev1=1 crypto rx=0x7ffa340b9d60 tx=0x7ffa2c02a530 comp rx=0 tx=0).stop 2024-09-17T05:51:28.699 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:28.697+0000 7ffa388f9640 1 -- 172.21.15.150:0/2713743885 shutdown_connections 2024-09-17T05:51:28.699 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:28.697+0000 7ffa388f9640 1 --2- 172.21.15.150:0/2713743885 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ffa341633e0 0x7ffa34168bf0 unknown :-1 s=CLOSED pgs=1534 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:51:28.699 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:28.697+0000 7ffa388f9640 1 --2- 172.21.15.150:0/2713743885 >> v2:172.21.15.176:3300/0 conn(0x7ffa340b3ae0 0x7ffa340d2370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:51:28.700 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:28.697+0000 7ffa388f9640 1 -- 172.21.15.150:0/2713743885 >> 172.21.15.150:0/2713743885 conn(0x7ffa340d4680 msgr2=0x7ffa340d4a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:51:28.700 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:28.697+0000 7ffa388f9640 1 -- 172.21.15.150:0/2713743885 shutdown_connections 2024-09-17T05:51:28.700 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:28.697+0000 7ffa388f9640 1 -- 172.21.15.150:0/2713743885 wait complete. 2024-09-17T05:51:28.701 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:28.699+0000 7ffa388f9640 1 Processor -- start 2024-09-17T05:51:28.701 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:28.699+0000 7ffa388f9640 1 -- start start 2024-09-17T05:51:28.703 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:28.700+0000 7ffa388f9640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ffa340b3ae0 0x7ffa3415e590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:51:28.703 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:28.700+0000 7ffa388f9640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ffa341628c0 0x7ffa3406f300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:51:28.704 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:28.700+0000 7ffa388f9640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ffa341633e0 0x7ffa3406f840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:51:28.704 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:28.700+0000 7ffa388f9640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7ffa341692b0 con 0x7ffa341628c0 2024-09-17T05:51:28.704 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:28.700+0000 7ffa388f9640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7ffa34169130 con 0x7ffa340b3ae0 2024-09-17T05:51:28.704 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:28.700+0000 7ffa388f9640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7ffa34169430 con 0x7ffa341633e0 2024-09-17T05:51:28.704 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:28.701+0000 7ffa31d9b640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ffa341628c0 0x7ffa3406f300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:51:28.704 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:28.701+0000 7ffa31d9b640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ffa341628c0 0x7ffa3406f300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:57794/0 (socket says 172.21.15.150:57794) 2024-09-17T05:51:28.704 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:28.701+0000 7ffa31d9b640 1 -- 172.21.15.150:0/1149727575 learned_addr learned my addr 172.21.15.150:0/1149727575 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:51:28.704 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:28.701+0000 7ffa3259c640 1 --2- 172.21.15.150:0/1149727575 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ffa340b3ae0 0x7ffa3415e590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:51:28.704 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:28.701+0000 7ffa32d9d640 1 --2- 172.21.15.150:0/1149727575 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ffa341633e0 0x7ffa3406f840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:51:28.704 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:28.701+0000 7ffa31d9b640 1 -- 172.21.15.150:0/1149727575 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ffa341633e0 msgr2=0x7ffa3406f840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:51:28.704 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:28.701+0000 7ffa31d9b640 1 --2- 172.21.15.150:0/1149727575 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ffa341633e0 0x7ffa3406f840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:51:28.704 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:28.701+0000 7ffa31d9b640 1 -- 172.21.15.150:0/1149727575 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ffa340b3ae0 msgr2=0x7ffa3415e590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:51:28.705 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:28.701+0000 7ffa31d9b640 1 --2- 172.21.15.150:0/1149727575 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ffa340b3ae0 0x7ffa3415e590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:51:28.705 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:28.701+0000 7ffa31d9b640 1 -- 172.21.15.150:0/1149727575 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffa341f9620 con 0x7ffa341628c0 2024-09-17T05:51:28.705 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:28.701+0000 7ffa3259c640 1 --2- 172.21.15.150:0/1149727575 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ffa340b3ae0 0x7ffa3415e590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T05:51:28.705 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:28.701+0000 7ffa31d9b640 1 --2- 172.21.15.150:0/1149727575 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ffa341628c0 0x7ffa3406f300 secure :-1 s=READY pgs=1535 cs=0 l=1 rev1=1 crypto rx=0x7ffa2800c370 tx=0x7ffa2800c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:51:28.705 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:28.701+0000 7ffa22ffd640 1 -- 172.21.15.150:0/1149727575 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa28017070 con 0x7ffa341628c0 2024-09-17T05:51:28.705 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:28.701+0000 7ffa22ffd640 1 -- 172.21.15.150:0/1149727575 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ffa280035f0 con 0x7ffa341628c0 2024-09-17T05:51:28.705 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:28.701+0000 7ffa22ffd640 1 -- 172.21.15.150:0/1149727575 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa28003a40 con 0x7ffa341628c0 2024-09-17T05:51:28.705 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:28.701+0000 7ffa388f9640 1 -- 172.21.15.150:0/1149727575 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffa341f9900 con 0x7ffa341628c0 2024-09-17T05:51:28.705 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:28.701+0000 7ffa388f9640 1 -- 172.21.15.150:0/1149727575 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffa340cb840 con 0x7ffa341628c0 2024-09-17T05:51:28.706 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:28.702+0000 7ffa388f9640 1 -- 172.21.15.150:0/1149727575 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffa3408d090 con 0x7ffa341628c0 2024-09-17T05:51:28.706 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:28.703+0000 7ffa22ffd640 1 -- 172.21.15.150:0/1149727575 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 37) ==== 103787+0+0 (secure 0 0 0) 0x7ffa2801a070 con 0x7ffa341628c0 2024-09-17T05:51:28.706 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:28.704+0000 7ffa22ffd640 1 --2- 172.21.15.150:0/1149727575 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7ffa1407a570 0x7ffa1407ca80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:51:28.706 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:28.704+0000 7ffa22ffd640 1 -- 172.21.15.150:0/1149727575 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(113..113 src has 1..113) ==== 5849+0+0 (secure 0 0 0) 0x7ffa28098e50 con 0x7ffa341628c0 2024-09-17T05:51:28.706 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:28.704+0000 7ffa3259c640 1 --2- 172.21.15.150:0/1149727575 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7ffa1407a570 0x7ffa1407ca80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:51:28.706 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:28.704+0000 7ffa3259c640 1 --2- 172.21.15.150:0/1149727575 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7ffa1407a570 0x7ffa1407ca80 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7ffa24005fd0 tx=0x7ffa24004c70 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:51:28.710 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:28.708+0000 7ffa22ffd640 1 -- 172.21.15.150:0/1149727575 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7ffa3408d090 con 0x7ffa341628c0 2024-09-17T05:51:28.885 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:28.883+0000 7ffa388f9640 1 -- 172.21.15.150:0/1149727575 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command([{prefix=config set, name=mgr/volumes/max_concurrent_clones}] v 0) -- 0x7ffa340d2370 con 0x7ffa341628c0 2024-09-17T05:51:28.888 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:28.887+0000 7ffa22ffd640 1 -- 172.21.15.150:0/1149727575 <== mon.0 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/volumes/max_concurrent_clones}]=0 v53)=0 v53) ==== 131+0+0 (secure 0 0 0) 0x7ffa28062d90 con 0x7ffa341628c0 2024-09-17T05:51:28.891 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:28.889+0000 7ffa388f9640 1 -- 172.21.15.150:0/1149727575 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7ffa1407a570 msgr2=0x7ffa1407ca80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:51:28.891 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:28.889+0000 7ffa388f9640 1 --2- 172.21.15.150:0/1149727575 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7ffa1407a570 0x7ffa1407ca80 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7ffa24005fd0 tx=0x7ffa24004c70 comp rx=0 tx=0).stop 2024-09-17T05:51:28.891 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:28.889+0000 7ffa388f9640 1 -- 172.21.15.150:0/1149727575 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ffa341628c0 msgr2=0x7ffa3406f300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:51:28.891 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:28.889+0000 7ffa388f9640 1 --2- 172.21.15.150:0/1149727575 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ffa341628c0 0x7ffa3406f300 secure :-1 s=READY pgs=1535 cs=0 l=1 rev1=1 crypto rx=0x7ffa2800c370 tx=0x7ffa2800c830 comp rx=0 tx=0).stop 2024-09-17T05:51:28.891 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:28.889+0000 7ffa388f9640 1 -- 172.21.15.150:0/1149727575 shutdown_connections 2024-09-17T05:51:28.891 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:28.889+0000 7ffa388f9640 1 --2- 172.21.15.150:0/1149727575 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7ffa1407a570 0x7ffa1407ca80 unknown :-1 s=CLOSED pgs=653 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:51:28.892 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:28.889+0000 7ffa388f9640 1 --2- 172.21.15.150:0/1149727575 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ffa341633e0 0x7ffa3406f840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:51:28.892 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:28.889+0000 7ffa388f9640 1 --2- 172.21.15.150:0/1149727575 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ffa341628c0 0x7ffa3406f300 unknown :-1 s=CLOSED pgs=1535 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:51:28.892 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:28.889+0000 7ffa388f9640 1 --2- 172.21.15.150:0/1149727575 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ffa340b3ae0 0x7ffa3415e590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:51:28.892 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:28.889+0000 7ffa388f9640 1 -- 172.21.15.150:0/1149727575 >> 172.21.15.150:0/1149727575 conn(0x7ffa340d4680 msgr2=0x7ffa3406e640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:51:28.892 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:28.889+0000 7ffa388f9640 1 -- 172.21.15.150:0/1149727575 shutdown_connections 2024-09-17T05:51:28.892 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:28.889+0000 7ffa388f9640 1 -- 172.21.15.150:0/1149727575 wait complete. 2024-09-17T05:51:28.903 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume create cephfs sv1 --mode=777 2024-09-17T05:51:28.911 INFO:tasks.ceph.mgr.x.smithi176.stderr:2024-09-17T05:51:28.910+0000 7f33da720640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-17T05:51:28.911 INFO:tasks.ceph.mgr.x.smithi176.stderr:2024-09-17T05:51:28.910+0000 7f33da720640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-17T05:51:28.911 INFO:tasks.ceph.mgr.x.smithi176.stderr:2024-09-17T05:51:28.910+0000 7f33da720640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-17T05:51:28.911 INFO:tasks.ceph.mgr.x.smithi176.stderr:2024-09-17T05:51:28.910+0000 7f33da720640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-17T05:51:28.911 INFO:tasks.ceph.mgr.x.smithi176.stderr:2024-09-17T05:51:28.910+0000 7f33da720640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-17T05:51:29.021 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:29.019+0000 7f6675b32640 1 -- 172.21.15.150:0/2202476966 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f66700b5910 msgr2=0x7f6670158980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:51:29.021 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:29.019+0000 7f6675b32640 1 --2- 172.21.15.150:0/2202476966 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f66700b5910 0x7f6670158980 secure :-1 s=READY pgs=1536 cs=0 l=1 rev1=1 crypto rx=0x7f6670072ea0 tx=0x7f666802a980 comp rx=0 tx=0).stop 2024-09-17T05:51:29.021 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:29.019+0000 7f6675b32640 1 -- 172.21.15.150:0/2202476966 shutdown_connections 2024-09-17T05:51:29.021 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:29.019+0000 7f6675b32640 1 --2- 172.21.15.150:0/2202476966 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f66700b5910 0x7f6670158980 unknown :-1 s=CLOSED pgs=1536 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:51:29.021 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:29.019+0000 7f6675b32640 1 --2- 172.21.15.150:0/2202476966 >> v2:172.21.15.176:3300/0 conn(0x7f667015f200 0x7f667015bc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:51:29.021 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:29.019+0000 7f6675b32640 1 -- 172.21.15.150:0/2202476966 >> 172.21.15.150:0/2202476966 conn(0x7f667006d3d0 msgr2=0x7f66700b2470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:51:29.021 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:29.019+0000 7f6675b32640 1 -- 172.21.15.150:0/2202476966 shutdown_connections 2024-09-17T05:51:29.021 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:29.019+0000 7f6675b32640 1 -- 172.21.15.150:0/2202476966 wait complete. 2024-09-17T05:51:29.022 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:29.021+0000 7f6675b32640 1 Processor -- start 2024-09-17T05:51:29.022 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:29.021+0000 7f6675b32640 1 -- start start 2024-09-17T05:51:29.025 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:29.022+0000 7f6675b32640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f66700d0000 0x7f667014e460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:51:29.025 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:29.022+0000 7f6675b32640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f667015f200 0x7f6670142070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:51:29.025 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:29.022+0000 7f6675b32640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6670156dc0 0x7f66701571d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:51:29.025 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:29.022+0000 7f6675b32640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f66701593f0 con 0x7f6670156dc0 2024-09-17T05:51:29.025 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:29.022+0000 7f6675b32640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f6670159270 con 0x7f66700d0000 2024-09-17T05:51:29.025 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:29.022+0000 7f6675b32640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f6670159570 con 0x7f667015f200 2024-09-17T05:51:29.025 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:29.022+0000 7f666ffff640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6670156dc0 0x7f66701571d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:51:29.025 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:29.022+0000 7f666ffff640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6670156dc0 0x7f66701571d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:57814/0 (socket says 172.21.15.150:57814) 2024-09-17T05:51:29.026 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:29.022+0000 7f666ffff640 1 -- 172.21.15.150:0/450779798 learned_addr learned my addr 172.21.15.150:0/450779798 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:51:29.026 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:29.022+0000 7f666f7fe640 1 --2- 172.21.15.150:0/450779798 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f66700d0000 0x7f667014e460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:51:29.026 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:29.022+0000 7f666effd640 1 --2- 172.21.15.150:0/450779798 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f667015f200 0x7f6670142070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:51:29.026 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:29.022+0000 7f666ffff640 1 -- 172.21.15.150:0/450779798 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f667015f200 msgr2=0x7f6670142070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:51:29.026 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:29.022+0000 7f666ffff640 1 --2- 172.21.15.150:0/450779798 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f667015f200 0x7f6670142070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:51:29.026 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:29.022+0000 7f666ffff640 1 -- 172.21.15.150:0/450779798 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f66700d0000 msgr2=0x7f667014e460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:51:29.026 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:29.022+0000 7f666ffff640 1 --2- 172.21.15.150:0/450779798 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f66700d0000 0x7f667014e460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:51:29.026 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:29.022+0000 7f666ffff640 1 -- 172.21.15.150:0/450779798 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f66701551a0 con 0x7f6670156dc0 2024-09-17T05:51:29.026 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:29.023+0000 7f666ffff640 1 --2- 172.21.15.150:0/450779798 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6670156dc0 0x7f66701571d0 secure :-1 s=READY pgs=1537 cs=0 l=1 rev1=1 crypto rx=0x7f6668009bf0 tx=0x7f6668003f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:51:29.026 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:29.023+0000 7f6657fff640 1 -- 172.21.15.150:0/450779798 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6668034040 con 0x7f6670156dc0 2024-09-17T05:51:29.026 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:29.023+0000 7f6657fff640 1 -- 172.21.15.150:0/450779798 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f66680045e0 con 0x7f6670156dc0 2024-09-17T05:51:29.026 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:29.023+0000 7f6657fff640 1 -- 172.21.15.150:0/450779798 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6668045480 con 0x7f6670156dc0 2024-09-17T05:51:29.026 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:29.023+0000 7f6675b32640 1 -- 172.21.15.150:0/450779798 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6670157710 con 0x7f6670156dc0 2024-09-17T05:51:29.027 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:29.023+0000 7f6675b32640 1 -- 172.21.15.150:0/450779798 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6670154870 con 0x7f6670156dc0 2024-09-17T05:51:29.027 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:29.024+0000 7f6675b32640 1 -- 172.21.15.150:0/450779798 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6670158980 con 0x7f6670156dc0 2024-09-17T05:51:29.027 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:29.025+0000 7f6657fff640 1 -- 172.21.15.150:0/450779798 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 37) ==== 103787+0+0 (secure 0 0 0) 0x7f6668037020 con 0x7f6670156dc0 2024-09-17T05:51:29.027 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:29.025+0000 7f6657fff640 1 --2- 172.21.15.150:0/450779798 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f665c07a570 0x7f665c07ca80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:51:29.028 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:29.025+0000 7f6657fff640 1 -- 172.21.15.150:0/450779798 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(113..113 src has 1..113) ==== 5849+0+0 (secure 0 0 0) 0x7f66680bb440 con 0x7f6670156dc0 2024-09-17T05:51:29.028 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:29.025+0000 7f666f7fe640 1 --2- 172.21.15.150:0/450779798 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f665c07a570 0x7f665c07ca80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:51:29.028 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:29.026+0000 7f666f7fe640 1 --2- 172.21.15.150:0/450779798 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f665c07a570 0x7f665c07ca80 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7f66600058c0 tx=0x7f6660005f60 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:51:29.031 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:29.030+0000 7f6657fff640 1 -- 172.21.15.150:0/450779798 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f6670157710 con 0x7f6670156dc0 2024-09-17T05:51:29.231 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:29.230+0000 7f6675b32640 1 -- 172.21.15.150:0/450779798 --> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] -- mgr_command(tid 0: {"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv1", "mode": "777", "target": ["mon-mgr", ""]}) -- 0x7f6670154320 con 0x7f665c07a570 2024-09-17T05:51:29.241 INFO:tasks.ceph.mgr.x.smithi176.stderr:2024-09-17T05:51:29.240+0000 7f33d771a640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-17T05:51:29.241 INFO:tasks.ceph.mgr.x.smithi176.stderr:2024-09-17T05:51:29.240+0000 7f33d771a640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-17T05:51:29.241 INFO:tasks.ceph.mgr.x.smithi176.stderr:2024-09-17T05:51:29.240+0000 7f33d771a640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-17T05:51:29.241 INFO:tasks.ceph.mgr.x.smithi176.stderr:2024-09-17T05:51:29.240+0000 7f33d771a640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-17T05:51:29.241 INFO:tasks.ceph.mgr.x.smithi176.stderr:2024-09-17T05:51:29.240+0000 7f33d771a640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-17T05:51:29.273 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:29.271+0000 7f6657fff640 1 -- 172.21.15.150:0/450779798 <== mgr.4108 v2:172.21.15.176:6800/3631216395 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f6670154320 con 0x7f665c07a570 2024-09-17T05:51:29.276 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:29.274+0000 7f6675b32640 1 -- 172.21.15.150:0/450779798 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f665c07a570 msgr2=0x7f665c07ca80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:51:29.276 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:29.274+0000 7f6675b32640 1 --2- 172.21.15.150:0/450779798 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f665c07a570 0x7f665c07ca80 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7f66600058c0 tx=0x7f6660005f60 comp rx=0 tx=0).stop 2024-09-17T05:51:29.276 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:29.274+0000 7f6675b32640 1 -- 172.21.15.150:0/450779798 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6670156dc0 msgr2=0x7f66701571d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:51:29.276 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:29.274+0000 7f6675b32640 1 --2- 172.21.15.150:0/450779798 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6670156dc0 0x7f66701571d0 secure :-1 s=READY pgs=1537 cs=0 l=1 rev1=1 crypto rx=0x7f6668009bf0 tx=0x7f6668003f90 comp rx=0 tx=0).stop 2024-09-17T05:51:29.276 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:29.274+0000 7f6675b32640 1 -- 172.21.15.150:0/450779798 shutdown_connections 2024-09-17T05:51:29.276 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:29.274+0000 7f6675b32640 1 --2- 172.21.15.150:0/450779798 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f665c07a570 0x7f665c07ca80 unknown :-1 s=CLOSED pgs=654 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:51:29.276 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:29.274+0000 7f6675b32640 1 --2- 172.21.15.150:0/450779798 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6670156dc0 0x7f66701571d0 unknown :-1 s=CLOSED pgs=1537 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:51:29.276 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:29.274+0000 7f6675b32640 1 --2- 172.21.15.150:0/450779798 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f667015f200 0x7f6670142070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:51:29.276 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:29.274+0000 7f6675b32640 1 --2- 172.21.15.150:0/450779798 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f66700d0000 0x7f667014e460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:51:29.276 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:29.274+0000 7f6675b32640 1 -- 172.21.15.150:0/450779798 >> 172.21.15.150:0/450779798 conn(0x7f667006d3d0 msgr2=0x7f667006f8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:51:29.276 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:29.274+0000 7f6675b32640 1 -- 172.21.15.150:0/450779798 shutdown_connections 2024-09-17T05:51:29.277 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:29.274+0000 7f6675b32640 1 -- 172.21.15.150:0/450779798 wait complete. 2024-09-17T05:51:29.287 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume getpath cephfs sv1 2024-09-17T05:51:29.404 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:29.402+0000 7faa97425640 1 -- 172.21.15.150:0/342790037 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7faa900d0fc0 msgr2=0x7faa900cd0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:51:29.404 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:29.402+0000 7faa97425640 1 --2- 172.21.15.150:0/342790037 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7faa900d0fc0 0x7faa900cd0e0 secure :-1 s=READY pgs=1539 cs=0 l=1 rev1=1 crypto rx=0x7faa88005fd0 tx=0x7faa8802a4d0 comp rx=0 tx=0).stop 2024-09-17T05:51:29.404 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:29.402+0000 7faa97425640 1 -- 172.21.15.150:0/342790037 shutdown_connections 2024-09-17T05:51:29.404 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:29.402+0000 7faa97425640 1 --2- 172.21.15.150:0/342790037 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7faa900d0fc0 0x7faa900cd0e0 unknown :-1 s=CLOSED pgs=1539 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:51:29.405 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:29.402+0000 7faa97425640 1 --2- 172.21.15.150:0/342790037 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7faa900b7d70 0x7faa900d0a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:51:29.405 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:29.402+0000 7faa97425640 1 -- 172.21.15.150:0/342790037 >> 172.21.15.150:0/342790037 conn(0x7faa900cef20 msgr2=0x7faa900cf330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:51:29.405 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:29.402+0000 7faa97425640 1 -- 172.21.15.150:0/342790037 shutdown_connections 2024-09-17T05:51:29.405 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:29.402+0000 7faa97425640 1 -- 172.21.15.150:0/342790037 wait complete. 2024-09-17T05:51:29.405 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:29.404+0000 7faa97425640 1 Processor -- start 2024-09-17T05:51:29.405 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:29.404+0000 7faa97425640 1 -- start start 2024-09-17T05:51:29.409 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:29.405+0000 7faa97425640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7faa900b7960 0x7faa900cc140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:51:29.410 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:29.405+0000 7faa97425640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7faa900b7d70 0x7faa900b6710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:51:29.410 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:29.405+0000 7faa97425640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7faa900d0fc0 0x7faa900b6c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:51:29.410 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:29.405+0000 7faa97425640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7faa900af900 con 0x7faa900b7d70 2024-09-17T05:51:29.410 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:29.405+0000 7faa97425640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7faa900d1480 con 0x7faa900d0fc0 2024-09-17T05:51:29.410 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:29.405+0000 7faa97425640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7faa9015e7c0 con 0x7faa900b7960 2024-09-17T05:51:29.410 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:29.405+0000 7faa949c0640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7faa900b7d70 0x7faa900b6710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:51:29.410 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:29.405+0000 7faa949c0640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7faa900b7d70 0x7faa900b6710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:57836/0 (socket says 172.21.15.150:57836) 2024-09-17T05:51:29.410 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:29.405+0000 7faa949c0640 1 -- 172.21.15.150:0/1806939383 learned_addr learned my addr 172.21.15.150:0/1806939383 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:51:29.410 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:29.405+0000 7faa951c1640 1 --2- 172.21.15.150:0/1806939383 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7faa900b7960 0x7faa900cc140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:51:29.410 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:29.405+0000 7faa959c2640 1 --2- 172.21.15.150:0/1806939383 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7faa900d0fc0 0x7faa900b6c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:51:29.410 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:29.406+0000 7faa949c0640 1 -- 172.21.15.150:0/1806939383 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7faa900b7960 msgr2=0x7faa900cc140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:51:29.411 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:29.406+0000 7faa949c0640 1 --2- 172.21.15.150:0/1806939383 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7faa900b7960 0x7faa900cc140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:51:29.411 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:29.406+0000 7faa949c0640 1 -- 172.21.15.150:0/1806939383 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7faa900d0fc0 msgr2=0x7faa900b6c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:51:29.411 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:29.406+0000 7faa949c0640 1 --2- 172.21.15.150:0/1806939383 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7faa900d0fc0 0x7faa900b6c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:51:29.411 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:29.406+0000 7faa949c0640 1 -- 172.21.15.150:0/1806939383 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faa9006e090 con 0x7faa900b7d70 2024-09-17T05:51:29.411 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:29.406+0000 7faa949c0640 1 --2- 172.21.15.150:0/1806939383 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7faa900b7d70 0x7faa900b6710 secure :-1 s=READY pgs=1540 cs=0 l=1 rev1=1 crypto rx=0x7faa8400b410 tx=0x7faa84009f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:51:29.411 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:29.406+0000 7faa8dffb640 1 -- 172.21.15.150:0/1806939383 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa84015020 con 0x7faa900b7d70 2024-09-17T05:51:29.411 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:29.406+0000 7faa8dffb640 1 -- 172.21.15.150:0/1806939383 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7faa84011920 con 0x7faa900b7d70 2024-09-17T05:51:29.411 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:29.406+0000 7faa97425640 1 -- 172.21.15.150:0/1806939383 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faa9006e370 con 0x7faa900b7d70 2024-09-17T05:51:29.411 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:29.406+0000 7faa8dffb640 1 -- 172.21.15.150:0/1806939383 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa84011d70 con 0x7faa900b7d70 2024-09-17T05:51:29.411 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:29.406+0000 7faa97425640 1 -- 172.21.15.150:0/1806939383 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faa9006e930 con 0x7faa900b7d70 2024-09-17T05:51:29.411 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:29.407+0000 7faa97425640 1 -- 172.21.15.150:0/1806939383 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faa900d0a80 con 0x7faa900b7d70 2024-09-17T05:51:29.412 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:29.408+0000 7faa8dffb640 1 -- 172.21.15.150:0/1806939383 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 37) ==== 103787+0+0 (secure 0 0 0) 0x7faa84018020 con 0x7faa900b7d70 2024-09-17T05:51:29.412 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:29.409+0000 7faa8dffb640 1 --2- 172.21.15.150:0/1806939383 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7faa7c07a570 0x7faa7c07ca80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:51:29.413 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:29.409+0000 7faa8dffb640 1 -- 172.21.15.150:0/1806939383 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(113..113 src has 1..113) ==== 5849+0+0 (secure 0 0 0) 0x7faa84099900 con 0x7faa900b7d70 2024-09-17T05:51:29.413 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:29.409+0000 7faa951c1640 1 --2- 172.21.15.150:0/1806939383 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7faa7c07a570 0x7faa7c07ca80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:51:29.413 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:29.410+0000 7faa951c1640 1 --2- 172.21.15.150:0/1806939383 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7faa7c07a570 0x7faa7c07ca80 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7faa80007fd0 tx=0x7faa80009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:51:29.415 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:29.413+0000 7faa8dffb640 1 -- 172.21.15.150:0/1806939383 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7faa8401f020 con 0x7faa900b7d70 2024-09-17T05:51:29.617 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:29.615+0000 7faa97425640 1 -- 172.21.15.150:0/1806939383 --> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "sub_name": "sv1", "target": ["mon-mgr", ""]}) -- 0x7faa9006ee50 con 0x7faa7c07a570 2024-09-17T05:51:29.622 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:29.621+0000 7faa8dffb640 1 -- 172.21.15.150:0/1806939383 <== mgr.4108 v2:172.21.15.176:6800/3631216395 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+59 (secure 0 0 0) 0x7faa8000f960 con 0x7faa7c07a570 2024-09-17T05:51:29.622 INFO:teuthology.orchestra.run.smithi150.stdout:/volumes/_nogroup/sv1/fbf9550d-76fa-40ec-b469-433bba38ec25 2024-09-17T05:51:29.625 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:29.623+0000 7faa97425640 1 -- 172.21.15.150:0/1806939383 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7faa7c07a570 msgr2=0x7faa7c07ca80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:51:29.625 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:29.623+0000 7faa97425640 1 --2- 172.21.15.150:0/1806939383 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7faa7c07a570 0x7faa7c07ca80 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7faa80007fd0 tx=0x7faa80009040 comp rx=0 tx=0).stop 2024-09-17T05:51:29.625 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:29.623+0000 7faa97425640 1 -- 172.21.15.150:0/1806939383 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7faa900b7d70 msgr2=0x7faa900b6710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:51:29.625 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:29.623+0000 7faa97425640 1 --2- 172.21.15.150:0/1806939383 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7faa900b7d70 0x7faa900b6710 secure :-1 s=READY pgs=1540 cs=0 l=1 rev1=1 crypto rx=0x7faa8400b410 tx=0x7faa84009f90 comp rx=0 tx=0).stop 2024-09-17T05:51:29.625 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:29.623+0000 7faa97425640 1 -- 172.21.15.150:0/1806939383 shutdown_connections 2024-09-17T05:51:29.625 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:29.623+0000 7faa97425640 1 --2- 172.21.15.150:0/1806939383 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7faa900d0fc0 0x7faa900b6c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:51:29.625 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:29.623+0000 7faa97425640 1 --2- 172.21.15.150:0/1806939383 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7faa7c07a570 0x7faa7c07ca80 unknown :-1 s=CLOSED pgs=655 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:51:29.625 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:29.623+0000 7faa97425640 1 --2- 172.21.15.150:0/1806939383 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7faa900b7d70 0x7faa900b6710 unknown :-1 s=CLOSED pgs=1540 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:51:29.625 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:29.623+0000 7faa97425640 1 --2- 172.21.15.150:0/1806939383 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7faa900b7960 0x7faa900cc140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:51:29.625 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:29.623+0000 7faa97425640 1 -- 172.21.15.150:0/1806939383 >> 172.21.15.150:0/1806939383 conn(0x7faa900cef20 msgr2=0x7faa900ce2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:51:29.626 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:29.623+0000 7faa97425640 1 -- 172.21.15.150:0/1806939383 shutdown_connections 2024-09-17T05:51:29.626 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:29.623+0000 7faa97425640 1 -- 172.21.15.150:0/1806939383 wait complete. 2024-09-17T05:51:29.636 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume getpath cephfs sv1 2024-09-17T05:51:29.754 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:29.752+0000 7f66e184d640 1 -- 172.21.15.150:0/3873137995 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f66dc0ce4c0 msgr2=0x7f66dc0ce8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:51:29.754 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:29.752+0000 7f66e184d640 1 --2- 172.21.15.150:0/3873137995 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f66dc0ce4c0 0x7f66dc0ce8d0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f66d0005fd0 tx=0x7f66d002a4b0 comp rx=0 tx=0).stop 2024-09-17T05:51:29.754 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:29.752+0000 7f66e184d640 1 -- 172.21.15.150:0/3873137995 shutdown_connections 2024-09-17T05:51:29.754 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:29.752+0000 7f66e184d640 1 --2- 172.21.15.150:0/3873137995 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f66dc0ce4c0 0x7f66dc0ce8d0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:51:29.754 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:29.752+0000 7f66e184d640 1 --2- 172.21.15.150:0/3873137995 >> v2:172.21.15.176:3300/0 conn(0x7f66dc0af160 0x7f66dc0af570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:51:29.754 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:29.752+0000 7f66e184d640 1 -- 172.21.15.150:0/3873137995 >> 172.21.15.150:0/3873137995 conn(0x7f66dc0cefb0 msgr2=0x7f66dc0cf3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:51:29.754 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:29.752+0000 7f66e184d640 1 -- 172.21.15.150:0/3873137995 shutdown_connections 2024-09-17T05:51:29.754 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:29.752+0000 7f66e184d640 1 -- 172.21.15.150:0/3873137995 wait complete. 2024-09-17T05:51:29.755 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:29.754+0000 7f66e184d640 1 Processor -- start 2024-09-17T05:51:29.755 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:29.754+0000 7f66e184d640 1 -- start start 2024-09-17T05:51:29.758 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:29.755+0000 7f66e184d640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f66dc0af160 0x7f66dc0c75a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:51:29.758 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:29.755+0000 7f66e184d640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f66dc0ce4c0 0x7f66dc15b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:51:29.759 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:29.755+0000 7f66e184d640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f66dc0d0980 0x7f66dc0cbb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:51:29.759 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:29.755+0000 7f66e184d640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f66dc0b18e0 con 0x7f66dc0d0980 2024-09-17T05:51:29.759 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:29.755+0000 7f66e184d640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f66dc0b1760 con 0x7f66dc0ce4c0 2024-09-17T05:51:29.759 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:29.755+0000 7f66e184d640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f66dc0cd040 con 0x7f66dc0af160 2024-09-17T05:51:29.759 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:29.755+0000 7f66db7fe640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f66dc0d0980 0x7f66dc0cbb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:51:29.759 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:29.755+0000 7f66db7fe640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f66dc0d0980 0x7f66dc0cbb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:57846/0 (socket says 172.21.15.150:57846) 2024-09-17T05:51:29.759 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:29.755+0000 7f66db7fe640 1 -- 172.21.15.150:0/1182267343 learned_addr learned my addr 172.21.15.150:0/1182267343 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:51:29.759 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:29.755+0000 7f66daffd640 1 --2- 172.21.15.150:0/1182267343 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f66dc0af160 0x7f66dc0c75a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:51:29.759 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:29.755+0000 7f66da7fc640 1 --2- 172.21.15.150:0/1182267343 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f66dc0ce4c0 0x7f66dc15b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:51:29.759 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:29.755+0000 7f66db7fe640 1 -- 172.21.15.150:0/1182267343 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f66dc0af160 msgr2=0x7f66dc0c75a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:51:29.759 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:29.755+0000 7f66db7fe640 1 --2- 172.21.15.150:0/1182267343 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f66dc0af160 0x7f66dc0c75a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:51:29.759 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:29.755+0000 7f66db7fe640 1 -- 172.21.15.150:0/1182267343 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f66dc0ce4c0 msgr2=0x7f66dc15b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:51:29.759 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:29.755+0000 7f66db7fe640 1 --2- 172.21.15.150:0/1182267343 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f66dc0ce4c0 0x7f66dc15b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:51:29.760 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:29.755+0000 7f66db7fe640 1 -- 172.21.15.150:0/1182267343 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f66dc0ca600 con 0x7f66dc0d0980 2024-09-17T05:51:29.760 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:29.755+0000 7f66da7fc640 1 --2- 172.21.15.150:0/1182267343 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f66dc0ce4c0 0x7f66dc15b9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:51:29.760 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:29.755+0000 7f66daffd640 1 --2- 172.21.15.150:0/1182267343 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f66dc0af160 0x7f66dc0c75a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:51:29.760 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:29.756+0000 7f66db7fe640 1 --2- 172.21.15.150:0/1182267343 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f66dc0d0980 0x7f66dc0cbb60 secure :-1 s=READY pgs=1541 cs=0 l=1 rev1=1 crypto rx=0x7f66d400c760 tx=0x7f66d400cb60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:51:29.760 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:29.756+0000 7f66c3fff640 1 -- 172.21.15.150:0/1182267343 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f66d4003b70 con 0x7f66dc0d0980 2024-09-17T05:51:29.760 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:29.756+0000 7f66c3fff640 1 -- 172.21.15.150:0/1182267343 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f66d4003d10 con 0x7f66dc0d0980 2024-09-17T05:51:29.760 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:29.756+0000 7f66e184d640 1 -- 172.21.15.150:0/1182267343 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f66dc0c6fc0 con 0x7f66dc0d0980 2024-09-17T05:51:29.760 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:29.756+0000 7f66c3fff640 1 -- 172.21.15.150:0/1182267343 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f66d4005330 con 0x7f66dc0d0980 2024-09-17T05:51:29.760 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:29.756+0000 7f66e184d640 1 -- 172.21.15.150:0/1182267343 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f66dc0ca320 con 0x7f66dc0d0980 2024-09-17T05:51:29.760 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:29.757+0000 7f66e184d640 1 -- 172.21.15.150:0/1182267343 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f66dc0af570 con 0x7f66dc0d0980 2024-09-17T05:51:29.761 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:29.758+0000 7f66c3fff640 1 -- 172.21.15.150:0/1182267343 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 37) ==== 103787+0+0 (secure 0 0 0) 0x7f66d40054d0 con 0x7f66dc0d0980 2024-09-17T05:51:29.761 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:29.758+0000 7f66c3fff640 1 --2- 172.21.15.150:0/1182267343 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f66c807a570 0x7f66c807ca80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:51:29.761 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:29.759+0000 7f66c3fff640 1 -- 172.21.15.150:0/1182267343 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(113..113 src has 1..113) ==== 5849+0+0 (secure 0 0 0) 0x7f66d4099940 con 0x7f66dc0d0980 2024-09-17T05:51:29.761 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:29.759+0000 7f66daffd640 1 --2- 172.21.15.150:0/1182267343 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f66c807a570 0x7f66c807ca80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:51:29.761 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:29.759+0000 7f66daffd640 1 --2- 172.21.15.150:0/1182267343 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f66c807a570 0x7f66c807ca80 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7f66cc009b80 tx=0x7f66cc005f90 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:51:29.765 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:29.763+0000 7f66c3fff640 1 -- 172.21.15.150:0/1182267343 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f66dc0ca600 con 0x7f66dc0d0980 2024-09-17T05:51:29.897 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:29.896+0000 7f66c3fff640 1 -- 172.21.15.150:0/1182267343 <== mon.0 v2:172.21.15.150:3300/0 7 ==== mgrmap(e 38) ==== 103838+0+0 (secure 0 0 0) 0x7f66d405f370 con 0x7f66dc0d0980 2024-09-17T05:51:29.967 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:29.966+0000 7f66e184d640 1 -- 172.21.15.150:0/1182267343 --> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "sub_name": "sv1", "target": ["mon-mgr", ""]}) -- 0x7f66dc070250 con 0x7f66c807a570 2024-09-17T05:51:29.972 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:29.971+0000 7f66c3fff640 1 -- 172.21.15.150:0/1182267343 <== mgr.4108 v2:172.21.15.176:6800/3631216395 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+59 (secure 0 0 0) 0x7f66dc070250 con 0x7f66c807a570 2024-09-17T05:51:29.973 INFO:teuthology.orchestra.run.smithi150.stdout:/volumes/_nogroup/sv1/fbf9550d-76fa-40ec-b469-433bba38ec25 2024-09-17T05:51:29.975 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:29.973+0000 7f66e184d640 1 -- 172.21.15.150:0/1182267343 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f66c807a570 msgr2=0x7f66c807ca80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:51:29.975 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:29.973+0000 7f66e184d640 1 --2- 172.21.15.150:0/1182267343 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f66c807a570 0x7f66c807ca80 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7f66cc009b80 tx=0x7f66cc005f90 comp rx=0 tx=0).stop 2024-09-17T05:51:29.975 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:29.973+0000 7f66e184d640 1 -- 172.21.15.150:0/1182267343 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f66dc0d0980 msgr2=0x7f66dc0cbb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:51:29.975 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:29.973+0000 7f66e184d640 1 --2- 172.21.15.150:0/1182267343 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f66dc0d0980 0x7f66dc0cbb60 secure :-1 s=READY pgs=1541 cs=0 l=1 rev1=1 crypto rx=0x7f66d400c760 tx=0x7f66d400cb60 comp rx=0 tx=0).stop 2024-09-17T05:51:29.975 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:29.973+0000 7f66e184d640 1 -- 172.21.15.150:0/1182267343 shutdown_connections 2024-09-17T05:51:29.975 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:29.973+0000 7f66e184d640 1 --2- 172.21.15.150:0/1182267343 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f66dc0ce4c0 0x7f66dc15b9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:51:29.976 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:29.973+0000 7f66e184d640 1 --2- 172.21.15.150:0/1182267343 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f66c807a570 0x7f66c807ca80 unknown :-1 s=CLOSED pgs=656 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:51:29.976 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:29.973+0000 7f66e184d640 1 --2- 172.21.15.150:0/1182267343 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f66dc0d0980 0x7f66dc0cbb60 unknown :-1 s=CLOSED pgs=1541 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:51:29.976 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:29.973+0000 7f66e184d640 1 --2- 172.21.15.150:0/1182267343 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f66dc0af160 0x7f66dc0c75a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:51:29.976 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:29.973+0000 7f66e184d640 1 -- 172.21.15.150:0/1182267343 >> 172.21.15.150:0/1182267343 conn(0x7f66dc0cefb0 msgr2=0x7f66dc15c640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:51:29.976 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:29.973+0000 7f66e184d640 1 -- 172.21.15.150:0/1182267343 shutdown_connections 2024-09-17T05:51:29.976 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:29.973+0000 7f66e184d640 1 -- 172.21.15.150:0/1182267343 wait complete. 2024-09-17T05:51:29.987 DEBUG:tasks.cephfs.test_volumes:filling subvolume sv1 with 3 files each 1024MB size under directory volumes/_nogroup/sv1/fbf9550d-76fa-40ec-b469-433bba38ec25 2024-09-17T05:51:29.987 DEBUG:teuthology.orchestra.run.smithi150:> set -ex 2024-09-17T05:51:29.988 DEBUG:teuthology.orchestra.run.smithi150:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T05:51:30.003 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:51:30.003 DEBUG:teuthology.orchestra.run.smithi150:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/sv1/fbf9550d-76fa-40ec-b469-433bba38ec25/subvolume_file.0 bs=1M conv=fdatasync count=1024 seek=0) 2024-09-17T05:51:33.778 INFO:teuthology.orchestra.run.smithi150.stderr:1024+0 records in 2024-09-17T05:51:33.778 INFO:teuthology.orchestra.run.smithi150.stderr:1024+0 records out 2024-09-17T05:51:33.778 INFO:teuthology.orchestra.run.smithi150.stderr:1073741824 bytes (1.1 GB, 1.0 GiB) copied, 3.71245 s, 289 MB/s 2024-09-17T05:51:33.778 DEBUG:teuthology.orchestra.run.smithi150:> set -ex 2024-09-17T05:51:33.778 DEBUG:teuthology.orchestra.run.smithi150:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T05:51:33.794 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:51:33.794 DEBUG:teuthology.orchestra.run.smithi150:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/sv1/fbf9550d-76fa-40ec-b469-433bba38ec25/subvolume_file.1 bs=1M conv=fdatasync count=1024 seek=0) 2024-09-17T05:51:37.615 INFO:teuthology.orchestra.run.smithi150.stderr:1024+0 records in 2024-09-17T05:51:37.615 INFO:teuthology.orchestra.run.smithi150.stderr:1024+0 records out 2024-09-17T05:51:37.615 INFO:teuthology.orchestra.run.smithi150.stderr:1073741824 bytes (1.1 GB, 1.0 GiB) copied, 3.7634 s, 285 MB/s 2024-09-17T05:51:37.615 DEBUG:teuthology.orchestra.run.smithi150:> set -ex 2024-09-17T05:51:37.615 DEBUG:teuthology.orchestra.run.smithi150:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T05:51:37.631 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:51:37.631 DEBUG:teuthology.orchestra.run.smithi150:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/sv1/fbf9550d-76fa-40ec-b469-433bba38ec25/subvolume_file.2 bs=1M conv=fdatasync count=1024 seek=0) 2024-09-17T05:51:41.404 INFO:teuthology.orchestra.run.smithi150.stderr:1024+0 records in 2024-09-17T05:51:41.404 INFO:teuthology.orchestra.run.smithi150.stderr:1024+0 records out 2024-09-17T05:51:41.404 INFO:teuthology.orchestra.run.smithi150.stderr:1073741824 bytes (1.1 GB, 1.0 GiB) copied, 3.71598 s, 289 MB/s 2024-09-17T05:51:41.405 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume snapshot create cephfs sv1 ss1 2024-09-17T05:51:41.523 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:41.521+0000 7fb78950b640 1 -- 172.21.15.150:0/870944013 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb7840b42f0 msgr2=0x7fb78415cfc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:51:41.524 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:41.521+0000 7fb78950b640 1 --2- 172.21.15.150:0/870944013 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb7840b42f0 0x7fb78415cfc0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fb76c005fd0 tx=0x7fb76c02a5d0 comp rx=0 tx=0).stop 2024-09-17T05:51:41.524 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:41.521+0000 7fb78950b640 1 -- 172.21.15.150:0/870944013 shutdown_connections 2024-09-17T05:51:41.524 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:41.521+0000 7fb78950b640 1 --2- 172.21.15.150:0/870944013 >> v2:172.21.15.176:3300/0 conn(0x7fb78415ba80 0x7fb78415be90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:51:41.524 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:41.521+0000 7fb78950b640 1 --2- 172.21.15.150:0/870944013 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb7840b42f0 0x7fb78415cfc0 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:51:41.524 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:41.521+0000 7fb78950b640 1 -- 172.21.15.150:0/870944013 >> 172.21.15.150:0/870944013 conn(0x7fb78409aa50 msgr2=0x7fb7840b2ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:51:41.524 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:41.521+0000 7fb78950b640 1 -- 172.21.15.150:0/870944013 shutdown_connections 2024-09-17T05:51:41.524 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:41.522+0000 7fb78950b640 1 -- 172.21.15.150:0/870944013 wait complete. 2024-09-17T05:51:41.525 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:41.523+0000 7fb78950b640 1 Processor -- start 2024-09-17T05:51:41.525 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:41.523+0000 7fb78950b640 1 -- start start 2024-09-17T05:51:41.529 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:41.525+0000 7fb78950b640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb7840b42f0 0x7fb784145110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:51:41.529 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:41.525+0000 7fb78950b640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb7840b5610 0x7fb7840d0140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:51:41.529 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:41.525+0000 7fb78950b640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb78415ba80 0x7fb7841578c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:51:41.529 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:41.525+0000 7fb78950b640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7fb7840afa80 con 0x7fb7840b42f0 2024-09-17T05:51:41.529 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:41.525+0000 7fb78950b640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fb7840af900 con 0x7fb7840b5610 2024-09-17T05:51:41.529 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:41.525+0000 7fb78950b640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fb7840afc00 con 0x7fb78415ba80 2024-09-17T05:51:41.529 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:41.525+0000 7fb782ffd640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb7840b42f0 0x7fb784145110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:51:41.529 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:41.525+0000 7fb782ffd640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb7840b42f0 0x7fb784145110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:49574/0 (socket says 172.21.15.150:49574) 2024-09-17T05:51:41.529 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:41.525+0000 7fb782ffd640 1 -- 172.21.15.150:0/2625557271 learned_addr learned my addr 172.21.15.150:0/2625557271 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:51:41.529 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:41.525+0000 7fb7827fc640 1 --2- 172.21.15.150:0/2625557271 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb7840b5610 0x7fb7840d0140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:51:41.529 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:41.525+0000 7fb7837fe640 1 --2- 172.21.15.150:0/2625557271 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb78415ba80 0x7fb7841578c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:51:41.529 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:41.525+0000 7fb782ffd640 1 -- 172.21.15.150:0/2625557271 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb78415ba80 msgr2=0x7fb7841578c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:51:41.530 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:41.525+0000 7fb782ffd640 1 --2- 172.21.15.150:0/2625557271 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb78415ba80 0x7fb7841578c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:51:41.530 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:41.525+0000 7fb782ffd640 1 -- 172.21.15.150:0/2625557271 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb7840b5610 msgr2=0x7fb7840d0140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:51:41.530 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:41.525+0000 7fb782ffd640 1 --2- 172.21.15.150:0/2625557271 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb7840b5610 0x7fb7840d0140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:51:41.530 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:41.525+0000 7fb782ffd640 1 -- 172.21.15.150:0/2625557271 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb784145650 con 0x7fb7840b42f0 2024-09-17T05:51:41.530 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:41.525+0000 7fb7827fc640 1 --2- 172.21.15.150:0/2625557271 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb7840b5610 0x7fb7840d0140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T05:51:41.530 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:41.525+0000 7fb7837fe640 1 --2- 172.21.15.150:0/2625557271 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb78415ba80 0x7fb7841578c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T05:51:41.530 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:41.525+0000 7fb782ffd640 1 --2- 172.21.15.150:0/2625557271 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb7840b42f0 0x7fb784145110 secure :-1 s=READY pgs=1542 cs=0 l=1 rev1=1 crypto rx=0x7fb76c000c00 tx=0x7fb76c005770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:51:41.530 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:41.526+0000 7fb77b7fe640 1 -- 172.21.15.150:0/2625557271 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb76c03e030 con 0x7fb7840b42f0 2024-09-17T05:51:41.530 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:41.526+0000 7fb77b7fe640 1 -- 172.21.15.150:0/2625557271 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb76c003a70 con 0x7fb7840b42f0 2024-09-17T05:51:41.530 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:41.526+0000 7fb78950b640 1 -- 172.21.15.150:0/2625557271 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb784156820 con 0x7fb7840b42f0 2024-09-17T05:51:41.530 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:41.526+0000 7fb77b7fe640 1 -- 172.21.15.150:0/2625557271 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb76c035040 con 0x7fb7840b42f0 2024-09-17T05:51:41.530 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:41.526+0000 7fb78950b640 1 -- 172.21.15.150:0/2625557271 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb784156de0 con 0x7fb7840b42f0 2024-09-17T05:51:41.530 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:41.527+0000 7fb78950b640 1 -- 172.21.15.150:0/2625557271 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb78415cfc0 con 0x7fb7840b42f0 2024-09-17T05:51:41.531 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:41.528+0000 7fb77b7fe640 1 -- 172.21.15.150:0/2625557271 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 39) ==== 103889+0+0 (secure 0 0 0) 0x7fb76c041030 con 0x7fb7840b42f0 2024-09-17T05:51:41.531 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:41.529+0000 7fb77b7fe640 1 --2- 172.21.15.150:0/2625557271 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fb76407a690 0x7fb76407cba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:51:41.531 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:41.529+0000 7fb77b7fe640 1 -- 172.21.15.150:0/2625557271 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(115..115 src has 1..115) ==== 5907+0+0 (secure 0 0 0) 0x7fb76c0ba000 con 0x7fb7840b42f0 2024-09-17T05:51:41.531 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:41.529+0000 7fb7827fc640 1 --2- 172.21.15.150:0/2625557271 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fb76407a690 0x7fb76407cba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:51:41.531 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:41.530+0000 7fb7827fc640 1 --2- 172.21.15.150:0/2625557271 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fb76407a690 0x7fb76407cba0 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7fb7841e83a0 tx=0x7fb77400d040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:51:41.535 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:41.534+0000 7fb77b7fe640 1 -- 172.21.15.150:0/2625557271 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fb76c083870 con 0x7fb7840b42f0 2024-09-17T05:51:41.742 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:41.740+0000 7fb78950b640 1 -- 172.21.15.150:0/2625557271 --> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] -- mgr_command(tid 0: {"prefix": "fs subvolume snapshot create", "vol_name": "cephfs", "sub_name": "sv1", "snap_name": "ss1", "target": ["mon-mgr", ""]}) -- 0x7fb7840b39b0 con 0x7fb76407a690 2024-09-17T05:51:41.754 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:41.753+0000 7fb77b7fe640 1 -- 172.21.15.150:0/2625557271 <== mgr.4108 v2:172.21.15.176:6800/3631216395 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7fb7840b39b0 con 0x7fb76407a690 2024-09-17T05:51:41.757 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:41.755+0000 7fb78950b640 1 -- 172.21.15.150:0/2625557271 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fb76407a690 msgr2=0x7fb76407cba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:51:41.757 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:41.755+0000 7fb78950b640 1 --2- 172.21.15.150:0/2625557271 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fb76407a690 0x7fb76407cba0 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7fb7841e83a0 tx=0x7fb77400d040 comp rx=0 tx=0).stop 2024-09-17T05:51:41.757 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:41.755+0000 7fb78950b640 1 -- 172.21.15.150:0/2625557271 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb7840b42f0 msgr2=0x7fb784145110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:51:41.757 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:41.755+0000 7fb78950b640 1 --2- 172.21.15.150:0/2625557271 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb7840b42f0 0x7fb784145110 secure :-1 s=READY pgs=1542 cs=0 l=1 rev1=1 crypto rx=0x7fb76c000c00 tx=0x7fb76c005770 comp rx=0 tx=0).stop 2024-09-17T05:51:41.757 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:41.755+0000 7fb78950b640 1 -- 172.21.15.150:0/2625557271 shutdown_connections 2024-09-17T05:51:41.757 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:41.755+0000 7fb78950b640 1 --2- 172.21.15.150:0/2625557271 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb7840b5610 0x7fb7840d0140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:51:41.757 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:41.755+0000 7fb78950b640 1 --2- 172.21.15.150:0/2625557271 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fb76407a690 0x7fb76407cba0 unknown :-1 s=CLOSED pgs=657 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:51:41.757 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:41.755+0000 7fb78950b640 1 --2- 172.21.15.150:0/2625557271 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb78415ba80 0x7fb7841578c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:51:41.757 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:41.755+0000 7fb78950b640 1 --2- 172.21.15.150:0/2625557271 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb7840b42f0 0x7fb784145110 unknown :-1 s=CLOSED pgs=1542 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:51:41.757 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:41.755+0000 7fb78950b640 1 -- 172.21.15.150:0/2625557271 >> 172.21.15.150:0/2625557271 conn(0x7fb78409aa50 msgr2=0x7fb7840b2af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:51:41.758 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:41.755+0000 7fb78950b640 1 -- 172.21.15.150:0/2625557271 shutdown_connections 2024-09-17T05:51:41.758 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:41.755+0000 7fb78950b640 1 -- 172.21.15.150:0/2625557271 wait complete. 2024-09-17T05:51:41.768 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume getpath cephfs sv1 2024-09-17T05:51:41.884 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:41.882+0000 7f1eefaa9640 1 -- 172.21.15.150:0/1022014805 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1ee806e2b0 msgr2=0x7f1ee80d0560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:51:41.885 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:41.882+0000 7f1eefaa9640 1 --2- 172.21.15.150:0/1022014805 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1ee806e2b0 0x7f1ee80d0560 secure :-1 s=READY pgs=1544 cs=0 l=1 rev1=1 crypto rx=0x7f1ee808e950 tx=0x7f1ee002a8b0 comp rx=0 tx=0).stop 2024-09-17T05:51:41.885 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:41.882+0000 7f1eefaa9640 1 -- 172.21.15.150:0/1022014805 shutdown_connections 2024-09-17T05:51:41.885 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:41.882+0000 7f1eefaa9640 1 --2- 172.21.15.150:0/1022014805 >> v2:172.21.15.176:3300/0 conn(0x7f1ee806dea0 0x7f1ee80d0020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:51:41.885 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:41.882+0000 7f1eefaa9640 1 --2- 172.21.15.150:0/1022014805 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1ee806e2b0 0x7f1ee80d0560 unknown :-1 s=CLOSED pgs=1544 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:51:41.885 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:41.882+0000 7f1eefaa9640 1 -- 172.21.15.150:0/1022014805 >> 172.21.15.150:0/1022014805 conn(0x7f1ee808bfe0 msgr2=0x7f1ee80d46e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:51:41.885 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:41.882+0000 7f1eefaa9640 1 -- 172.21.15.150:0/1022014805 shutdown_connections 2024-09-17T05:51:41.885 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:41.882+0000 7f1eefaa9640 1 -- 172.21.15.150:0/1022014805 wait complete. 2024-09-17T05:51:41.886 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:41.884+0000 7f1eefaa9640 1 Processor -- start 2024-09-17T05:51:41.886 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:41.884+0000 7f1eefaa9640 1 -- start start 2024-09-17T05:51:41.889 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:41.885+0000 7f1eefaa9640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1ee806dea0 0x7f1ee8160840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:51:41.889 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:41.885+0000 7f1eefaa9640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1ee806e2b0 0x7f1ee80cb720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:51:41.889 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:41.886+0000 7f1eefaa9640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1ee80d5150 0x7f1ee815ee90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:51:41.889 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:41.886+0000 7f1eefaa9640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f1ee80b6160 con 0x7f1ee806dea0 2024-09-17T05:51:41.889 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:41.886+0000 7f1eefaa9640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f1ee80d31e0 con 0x7f1ee806e2b0 2024-09-17T05:51:41.889 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:41.886+0000 7f1eefaa9640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f1ee80b62e0 con 0x7f1ee80d5150 2024-09-17T05:51:41.889 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:41.886+0000 7f1eed845640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1ee806dea0 0x7f1ee8160840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:51:41.889 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:41.886+0000 7f1eed845640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1ee806dea0 0x7f1ee8160840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:49592/0 (socket says 172.21.15.150:49592) 2024-09-17T05:51:41.889 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:41.886+0000 7f1eed845640 1 -- 172.21.15.150:0/3717040369 learned_addr learned my addr 172.21.15.150:0/3717040369 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:51:41.889 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:41.886+0000 7f1eed044640 1 --2- 172.21.15.150:0/3717040369 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1ee806e2b0 0x7f1ee80cb720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:51:41.890 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:41.886+0000 7f1eee046640 1 --2- 172.21.15.150:0/3717040369 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1ee80d5150 0x7f1ee815ee90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:51:41.890 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:41.886+0000 7f1eed845640 1 -- 172.21.15.150:0/3717040369 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1ee80d5150 msgr2=0x7f1ee815ee90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:51:41.890 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:41.886+0000 7f1eed845640 1 --2- 172.21.15.150:0/3717040369 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1ee80d5150 0x7f1ee815ee90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:51:41.890 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:41.886+0000 7f1eed845640 1 -- 172.21.15.150:0/3717040369 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1ee806e2b0 msgr2=0x7f1ee80cb720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:51:41.890 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:41.886+0000 7f1eed845640 1 --2- 172.21.15.150:0/3717040369 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1ee806e2b0 0x7f1ee80cb720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:51:41.890 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:41.886+0000 7f1eed845640 1 -- 172.21.15.150:0/3717040369 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1ee81f9430 con 0x7f1ee806dea0 2024-09-17T05:51:41.890 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:41.886+0000 7f1eed044640 1 --2- 172.21.15.150:0/3717040369 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1ee806e2b0 0x7f1ee80cb720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T05:51:41.890 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:41.886+0000 7f1eed845640 1 --2- 172.21.15.150:0/3717040369 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1ee806dea0 0x7f1ee8160840 secure :-1 s=READY pgs=1545 cs=0 l=1 rev1=1 crypto rx=0x7f1ee400c3f0 tx=0x7f1ee4001e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:51:41.890 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:41.886+0000 7f1ede7fc640 1 -- 172.21.15.150:0/3717040369 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ee4017070 con 0x7f1ee806dea0 2024-09-17T05:51:41.890 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:41.886+0000 7f1ede7fc640 1 -- 172.21.15.150:0/3717040369 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f1ee40035f0 con 0x7f1ee806dea0 2024-09-17T05:51:41.890 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:41.886+0000 7f1eefaa9640 1 -- 172.21.15.150:0/3717040369 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1ee81f9710 con 0x7f1ee806dea0 2024-09-17T05:51:41.890 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:41.886+0000 7f1ede7fc640 1 -- 172.21.15.150:0/3717040369 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ee4003a40 con 0x7f1ee806dea0 2024-09-17T05:51:41.890 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:41.886+0000 7f1eefaa9640 1 -- 172.21.15.150:0/3717040369 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1ee81f58c0 con 0x7f1ee806dea0 2024-09-17T05:51:41.891 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:41.888+0000 7f1eefaa9640 1 -- 172.21.15.150:0/3717040369 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1ee81f56d0 con 0x7f1ee806dea0 2024-09-17T05:51:41.891 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:41.888+0000 7f1ede7fc640 1 -- 172.21.15.150:0/3717040369 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 39) ==== 103889+0+0 (secure 0 0 0) 0x7f1ee401a070 con 0x7f1ee806dea0 2024-09-17T05:51:41.891 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:41.889+0000 7f1ede7fc640 1 --2- 172.21.15.150:0/3717040369 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f1ecc07a690 0x7f1ecc07cba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:51:41.892 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:41.889+0000 7f1ede7fc640 1 -- 172.21.15.150:0/3717040369 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(115..115 src has 1..115) ==== 5907+0+0 (secure 0 0 0) 0x7f1ee4098d70 con 0x7f1ee806dea0 2024-09-17T05:51:41.892 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:41.889+0000 7f1eed044640 1 --2- 172.21.15.150:0/3717040369 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f1ecc07a690 0x7f1ecc07cba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:51:41.892 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:41.890+0000 7f1eed044640 1 --2- 172.21.15.150:0/3717040369 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f1ecc07a690 0x7f1ecc07cba0 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7f1ee80ba150 tx=0x7f1ed8005f90 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:51:41.895 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:41.893+0000 7f1ede7fc640 1 -- 172.21.15.150:0/3717040369 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f1ee40626f0 con 0x7f1ee806dea0 2024-09-17T05:51:42.096 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:42.095+0000 7f1eefaa9640 1 -- 172.21.15.150:0/3717040369 --> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "sub_name": "sv1", "target": ["mon-mgr", ""]}) -- 0x7f1ee81f9c30 con 0x7f1ecc07a690 2024-09-17T05:51:42.101 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:42.099+0000 7f1ede7fc640 1 -- 172.21.15.150:0/3717040369 <== mgr.4108 v2:172.21.15.176:6800/3631216395 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+59 (secure 0 0 0) 0x7f1ed8004050 con 0x7f1ecc07a690 2024-09-17T05:51:42.101 INFO:teuthology.orchestra.run.smithi150.stdout:/volumes/_nogroup/sv1/fbf9550d-76fa-40ec-b469-433bba38ec25 2024-09-17T05:51:42.104 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:42.102+0000 7f1eefaa9640 1 -- 172.21.15.150:0/3717040369 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f1ecc07a690 msgr2=0x7f1ecc07cba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:51:42.104 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:42.102+0000 7f1eefaa9640 1 --2- 172.21.15.150:0/3717040369 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f1ecc07a690 0x7f1ecc07cba0 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7f1ee80ba150 tx=0x7f1ed8005f90 comp rx=0 tx=0).stop 2024-09-17T05:51:42.104 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:42.102+0000 7f1eefaa9640 1 -- 172.21.15.150:0/3717040369 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1ee806dea0 msgr2=0x7f1ee8160840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:51:42.104 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:42.102+0000 7f1eefaa9640 1 --2- 172.21.15.150:0/3717040369 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1ee806dea0 0x7f1ee8160840 secure :-1 s=READY pgs=1545 cs=0 l=1 rev1=1 crypto rx=0x7f1ee400c3f0 tx=0x7f1ee4001e70 comp rx=0 tx=0).stop 2024-09-17T05:51:42.104 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:42.102+0000 7f1eefaa9640 1 -- 172.21.15.150:0/3717040369 shutdown_connections 2024-09-17T05:51:42.104 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:42.102+0000 7f1eefaa9640 1 --2- 172.21.15.150:0/3717040369 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1ee806e2b0 0x7f1ee80cb720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:51:42.104 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:42.102+0000 7f1eefaa9640 1 --2- 172.21.15.150:0/3717040369 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f1ecc07a690 0x7f1ecc07cba0 unknown :-1 s=CLOSED pgs=658 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:51:42.104 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:42.102+0000 7f1eefaa9640 1 --2- 172.21.15.150:0/3717040369 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1ee80d5150 0x7f1ee815ee90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:51:42.105 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:42.102+0000 7f1eefaa9640 1 --2- 172.21.15.150:0/3717040369 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1ee806dea0 0x7f1ee8160840 unknown :-1 s=CLOSED pgs=1545 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:51:42.105 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:42.102+0000 7f1eefaa9640 1 -- 172.21.15.150:0/3717040369 >> 172.21.15.150:0/3717040369 conn(0x7f1ee808bfe0 msgr2=0x7f1ee80b8150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:51:42.105 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:42.102+0000 7f1eefaa9640 1 -- 172.21.15.150:0/3717040369 shutdown_connections 2024-09-17T05:51:42.105 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:42.102+0000 7f1eefaa9640 1 -- 172.21.15.150:0/3717040369 wait complete. 2024-09-17T05:51:42.115 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:51:42.115 DEBUG:teuthology.orchestra.run.smithi150:> (cd /home/ubuntu/cephtest/mnt.0 && exec getfattr -n ceph.dir.rbytes volumes/_nogroup/sv1/fbf9550d-76fa-40ec-b469-433bba38ec25 2024-09-17T05:51:42.115 DEBUG:teuthology.orchestra.run.smithi150:> ) 2024-09-17T05:51:42.131 INFO:teuthology.orchestra.run.smithi150.stdout:# file: volumes/_nogroup/sv1/fbf9550d-76fa-40ec-b469-433bba38ec25 2024-09-17T05:51:42.131 INFO:teuthology.orchestra.run.smithi150.stdout:ceph.dir.rbytes="2972172288" 2024-09-17T05:51:42.131 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-09-17T05:51:42.131 INFO:tasks.cephfs.test_volumes:r_size = 2972172288 exp_size = 3221225472 2024-09-17T05:51:44.133 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:51:44.133 DEBUG:teuthology.orchestra.run.smithi150:> (cd /home/ubuntu/cephtest/mnt.0 && exec getfattr -n ceph.dir.rbytes volumes/_nogroup/sv1/fbf9550d-76fa-40ec-b469-433bba38ec25 2024-09-17T05:51:44.133 DEBUG:teuthology.orchestra.run.smithi150:> ) 2024-09-17T05:51:44.153 INFO:teuthology.orchestra.run.smithi150.stdout:# file: volumes/_nogroup/sv1/fbf9550d-76fa-40ec-b469-433bba38ec25 2024-09-17T05:51:44.153 INFO:teuthology.orchestra.run.smithi150.stdout:ceph.dir.rbytes="2972172288" 2024-09-17T05:51:44.154 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-09-17T05:51:44.154 INFO:tasks.cephfs.test_volumes:r_size = 2972172288 exp_size = 3221225472 2024-09-17T05:51:46.154 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:51:46.155 DEBUG:teuthology.orchestra.run.smithi150:> (cd /home/ubuntu/cephtest/mnt.0 && exec getfattr -n ceph.dir.rbytes volumes/_nogroup/sv1/fbf9550d-76fa-40ec-b469-433bba38ec25 2024-09-17T05:51:46.155 DEBUG:teuthology.orchestra.run.smithi150:> ) 2024-09-17T05:51:46.175 INFO:teuthology.orchestra.run.smithi150.stdout:# file: volumes/_nogroup/sv1/fbf9550d-76fa-40ec-b469-433bba38ec25 2024-09-17T05:51:46.175 INFO:teuthology.orchestra.run.smithi150.stdout:ceph.dir.rbytes="3221225472" 2024-09-17T05:51:46.175 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-09-17T05:51:46.176 INFO:tasks.cephfs.test_volumes:r_size = 3221225472 exp_size = 3221225472 2024-09-17T05:51:46.176 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume snapshot clone cephfs sv1 ss1 subvol_clone43860 2024-09-17T05:51:46.348 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:46.346+0000 7f1c14a94640 1 -- 172.21.15.150:0/608004986 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1c100d5150 msgr2=0x7f1c100b9b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:51:46.348 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:46.346+0000 7f1c14a94640 1 --2- 172.21.15.150:0/608004986 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1c100d5150 0x7f1c100b9b10 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f1c00009910 tx=0x7f1c0002a5f0 comp rx=0 tx=0).stop 2024-09-17T05:51:46.348 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:46.346+0000 7f1c14a94640 1 -- 172.21.15.150:0/608004986 shutdown_connections 2024-09-17T05:51:46.349 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:46.346+0000 7f1c14a94640 1 --2- 172.21.15.150:0/608004986 >> v2:172.21.15.176:3300/0 conn(0x7f1c100d0730 0x7f1c100b6160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:51:46.349 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:46.346+0000 7f1c14a94640 1 --2- 172.21.15.150:0/608004986 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1c100d5150 0x7f1c100b9b10 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:51:46.349 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:46.346+0000 7f1c14a94640 1 -- 172.21.15.150:0/608004986 >> 172.21.15.150:0/608004986 conn(0x7f1c1008bfe0 msgr2=0x7f1c100d46e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:51:46.349 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:46.346+0000 7f1c14a94640 1 -- 172.21.15.150:0/608004986 shutdown_connections 2024-09-17T05:51:46.349 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:46.346+0000 7f1c14a94640 1 -- 172.21.15.150:0/608004986 wait complete. 2024-09-17T05:51:46.350 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:46.348+0000 7f1c14a94640 1 Processor -- start 2024-09-17T05:51:46.350 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:46.348+0000 7f1c14a94640 1 -- start start 2024-09-17T05:51:46.352 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:46.350+0000 7f1c14a94640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1c1006dea0 0x7f1c100ce1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:51:46.352 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:46.350+0000 7f1c14a94640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1c100d0730 0x7f1c1014f970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:51:46.352 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:46.350+0000 7f1c14a94640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1c100d5150 0x7f1c101f93b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:51:46.352 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:46.350+0000 7f1c14a94640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f1c1006e2b0 con 0x7f1c100d5150 2024-09-17T05:51:46.352 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:46.350+0000 7f1c14a94640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f1c100d31e0 con 0x7f1c1006dea0 2024-09-17T05:51:46.352 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:46.350+0000 7f1c14a94640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f1c1006e430 con 0x7f1c100d0730 2024-09-17T05:51:46.352 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:46.350+0000 7f1c0ed9d640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1c100d5150 0x7f1c101f93b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:51:46.352 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:46.350+0000 7f1c0ed9d640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1c100d5150 0x7f1c101f93b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:49598/0 (socket says 172.21.15.150:49598) 2024-09-17T05:51:46.352 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:46.350+0000 7f1c0ed9d640 1 -- 172.21.15.150:0/1641197542 learned_addr learned my addr 172.21.15.150:0/1641197542 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:51:46.352 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:46.350+0000 7f1c0e59c640 1 --2- 172.21.15.150:0/1641197542 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1c1006dea0 0x7f1c100ce1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:51:46.352 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:46.350+0000 7f1c05d9b640 1 --2- 172.21.15.150:0/1641197542 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1c100d0730 0x7f1c1014f970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:51:46.353 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:46.350+0000 7f1c0ed9d640 1 -- 172.21.15.150:0/1641197542 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1c100d0730 msgr2=0x7f1c1014f970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:51:46.354 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:46.350+0000 7f1c0ed9d640 1 --2- 172.21.15.150:0/1641197542 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1c100d0730 0x7f1c1014f970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:51:46.354 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:46.350+0000 7f1c0ed9d640 1 -- 172.21.15.150:0/1641197542 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1c1006dea0 msgr2=0x7f1c100ce1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:51:46.354 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:46.350+0000 7f1c0ed9d640 1 --2- 172.21.15.150:0/1641197542 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1c1006dea0 0x7f1c100ce1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:51:46.354 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:46.350+0000 7f1c0ed9d640 1 -- 172.21.15.150:0/1641197542 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1c100cc860 con 0x7f1c100d5150 2024-09-17T05:51:46.354 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:46.351+0000 7f1c0ed9d640 1 --2- 172.21.15.150:0/1641197542 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1c100d5150 0x7f1c101f93b0 secure :-1 s=READY pgs=1546 cs=0 l=1 rev1=1 crypto rx=0x7f1c0800ebf0 tx=0x7f1c0800c6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:51:46.354 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:46.351+0000 7f1c077fe640 1 -- 172.21.15.150:0/1641197542 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c08003b70 con 0x7f1c100d5150 2024-09-17T05:51:46.354 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:46.351+0000 7f1c077fe640 1 -- 172.21.15.150:0/1641197542 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f1c08003d10 con 0x7f1c100d5150 2024-09-17T05:51:46.354 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:46.351+0000 7f1c077fe640 1 -- 172.21.15.150:0/1641197542 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c08004280 con 0x7f1c100d5150 2024-09-17T05:51:46.354 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:46.351+0000 7f1c14a94640 1 -- 172.21.15.150:0/1641197542 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1c100ccb40 con 0x7f1c100d5150 2024-09-17T05:51:46.354 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:46.351+0000 7f1c14a94640 1 -- 172.21.15.150:0/1641197542 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1c100c96f0 con 0x7f1c100d5150 2024-09-17T05:51:46.354 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:46.352+0000 7f1c14a94640 1 -- 172.21.15.150:0/1641197542 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1c100c9950 con 0x7f1c100d5150 2024-09-17T05:51:46.355 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:46.353+0000 7f1c077fe640 1 -- 172.21.15.150:0/1641197542 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 39) ==== 103889+0+0 (secure 0 0 0) 0x7f1c08004420 con 0x7f1c100d5150 2024-09-17T05:51:46.355 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:46.353+0000 7f1c077fe640 1 --2- 172.21.15.150:0/1641197542 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f1bf007a6c0 0x7f1bf007cbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:51:46.355 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:46.354+0000 7f1c077fe640 1 -- 172.21.15.150:0/1641197542 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(115..115 src has 1..115) ==== 5907+0+0 (secure 0 0 0) 0x7f1c0809a740 con 0x7f1c100d5150 2024-09-17T05:51:46.355 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:46.354+0000 7f1c0e59c640 1 --2- 172.21.15.150:0/1641197542 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f1bf007a6c0 0x7f1bf007cbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:51:46.356 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:46.354+0000 7f1c0e59c640 1 --2- 172.21.15.150:0/1641197542 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f1bf007a6c0 0x7f1bf007cbd0 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7f1c00034000 tx=0x7f1c00004730 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:51:46.360 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:46.358+0000 7f1c077fe640 1 -- 172.21.15.150:0/1641197542 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f1c08064040 con 0x7f1c100d5150 2024-09-17T05:51:46.570 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:46.568+0000 7f1c14a94640 1 -- 172.21.15.150:0/1641197542 --> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] -- mgr_command(tid 0: {"prefix": "fs subvolume snapshot clone", "vol_name": "cephfs", "sub_name": "sv1", "snap_name": "ss1", "target_sub_name": "subvol_clone43860", "target": ["mon-mgr", ""]}) -- 0x7f1c100b6780 con 0x7f1bf007a6c0 2024-09-17T05:51:46.627 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:46.626+0000 7f1c077fe640 1 -- 172.21.15.150:0/1641197542 <== mgr.4108 v2:172.21.15.176:6800/3631216395 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f1c100b6780 con 0x7f1bf007a6c0 2024-09-17T05:51:46.630 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:46.628+0000 7f1c14a94640 1 -- 172.21.15.150:0/1641197542 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f1bf007a6c0 msgr2=0x7f1bf007cbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:51:46.630 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:46.628+0000 7f1c14a94640 1 --2- 172.21.15.150:0/1641197542 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f1bf007a6c0 0x7f1bf007cbd0 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7f1c00034000 tx=0x7f1c00004730 comp rx=0 tx=0).stop 2024-09-17T05:51:46.630 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:46.628+0000 7f1c14a94640 1 -- 172.21.15.150:0/1641197542 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1c100d5150 msgr2=0x7f1c101f93b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:51:46.630 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:46.628+0000 7f1c14a94640 1 --2- 172.21.15.150:0/1641197542 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1c100d5150 0x7f1c101f93b0 secure :-1 s=READY pgs=1546 cs=0 l=1 rev1=1 crypto rx=0x7f1c0800ebf0 tx=0x7f1c0800c6a0 comp rx=0 tx=0).stop 2024-09-17T05:51:46.630 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:46.628+0000 7f1c14a94640 1 -- 172.21.15.150:0/1641197542 shutdown_connections 2024-09-17T05:51:46.631 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:46.628+0000 7f1c14a94640 1 --2- 172.21.15.150:0/1641197542 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f1bf007a6c0 0x7f1bf007cbd0 unknown :-1 s=CLOSED pgs=659 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:51:46.631 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:46.628+0000 7f1c14a94640 1 --2- 172.21.15.150:0/1641197542 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1c100d5150 0x7f1c101f93b0 unknown :-1 s=CLOSED pgs=1546 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:51:46.631 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:46.628+0000 7f1c14a94640 1 --2- 172.21.15.150:0/1641197542 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1c100d0730 0x7f1c1014f970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:51:46.631 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:46.628+0000 7f1c14a94640 1 --2- 172.21.15.150:0/1641197542 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1c1006dea0 0x7f1c100ce1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:51:46.631 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:46.628+0000 7f1c14a94640 1 -- 172.21.15.150:0/1641197542 >> 172.21.15.150:0/1641197542 conn(0x7f1c1008bfe0 msgr2=0x7f1c1015ea30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:51:46.631 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:46.628+0000 7f1c14a94640 1 -- 172.21.15.150:0/1641197542 shutdown_connections 2024-09-17T05:51:46.631 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:46.628+0000 7f1c14a94640 1 -- 172.21.15.150:0/1641197542 wait complete. 2024-09-17T05:51:46.632 INFO:tasks.ceph.mgr.x.smithi176.stderr:2024-09-17T05:51:46.631+0000 7f33dcf25640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-17T05:51:46.632 INFO:tasks.ceph.mgr.x.smithi176.stderr:2024-09-17T05:51:46.631+0000 7f33dcf25640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-17T05:51:46.632 INFO:tasks.ceph.mgr.x.smithi176.stderr:2024-09-17T05:51:46.631+0000 7f33dcf25640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-17T05:51:46.632 INFO:tasks.ceph.mgr.x.smithi176.stderr:2024-09-17T05:51:46.631+0000 7f33dcf25640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-17T05:51:46.632 INFO:tasks.ceph.mgr.x.smithi176.stderr:2024-09-17T05:51:46.631+0000 7f33dcf25640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-17T05:51:46.643 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume snapshot clone cephfs sv1 ss1 subvol_clone39571 2024-09-17T05:51:46.647 INFO:tasks.ceph.mgr.x.smithi176.stderr:2024-09-17T05:51:46.646+0000 7f33dd726640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-17T05:51:46.647 INFO:tasks.ceph.mgr.x.smithi176.stderr:2024-09-17T05:51:46.646+0000 7f33dd726640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-17T05:51:46.647 INFO:tasks.ceph.mgr.x.smithi176.stderr:2024-09-17T05:51:46.646+0000 7f33dd726640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-17T05:51:46.648 INFO:tasks.ceph.mgr.x.smithi176.stderr:2024-09-17T05:51:46.646+0000 7f33dd726640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-17T05:51:46.648 INFO:tasks.ceph.mgr.x.smithi176.stderr:2024-09-17T05:51:46.646+0000 7f33dd726640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-17T05:51:46.766 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:46.764+0000 7f79625c3640 1 -- 172.21.15.150:0/1591790798 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7944003a50 msgr2=0x7f7944003ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:51:46.766 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:46.764+0000 7f79625c3640 1 --2- 172.21.15.150:0/1591790798 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7944003a50 0x7f7944003ec0 secure :-1 s=READY pgs=1548 cs=0 l=1 rev1=1 crypto rx=0x7f794c006fc0 tx=0x7f7944005830 comp rx=0 tx=0).stop 2024-09-17T05:51:46.766 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:46.764+0000 7f79625c3640 1 -- 172.21.15.150:0/1591790798 shutdown_connections 2024-09-17T05:51:46.766 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:46.764+0000 7f79625c3640 1 --2- 172.21.15.150:0/1591790798 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7944003a50 0x7f7944003ec0 unknown :-1 s=CLOSED pgs=1548 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:51:46.766 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:46.764+0000 7f79625c3640 1 -- 172.21.15.150:0/1591790798 >> 172.21.15.150:0/1591790798 conn(0x7f795c0cefb0 msgr2=0x7f795c0cf3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:51:46.766 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:46.764+0000 7f79625c3640 1 -- 172.21.15.150:0/1591790798 shutdown_connections 2024-09-17T05:51:46.767 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:46.764+0000 7f79625c3640 1 -- 172.21.15.150:0/1591790798 wait complete. 2024-09-17T05:51:46.767 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:46.766+0000 7f79625c3640 1 Processor -- start 2024-09-17T05:51:46.767 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:46.766+0000 7f79625c3640 1 -- start start 2024-09-17T05:51:46.770 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:46.767+0000 7f79625c3640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7944003a50 0x7f795c15d890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:51:46.770 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:46.767+0000 7f79625c3640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f795c14b3f0 0x7f795c14b800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:51:46.771 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:46.767+0000 7f79625c3640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f795c14e870 0x7f795c14ec80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:51:46.771 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:46.767+0000 7f79625c3640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f795c0b18e0 con 0x7f795c14e870 2024-09-17T05:51:46.771 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:46.767+0000 7f79625c3640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f795c0b1760 con 0x7f7944003a50 2024-09-17T05:51:46.771 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:46.767+0000 7f79625c3640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f795c0d0980 con 0x7f795c14b3f0 2024-09-17T05:51:46.771 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:46.767+0000 7f7960b60640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f795c14e870 0x7f795c14ec80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:51:46.771 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:46.767+0000 7f7960b60640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f795c14e870 0x7f795c14ec80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:49622/0 (socket says 172.21.15.150:49622) 2024-09-17T05:51:46.771 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:46.767+0000 7f7960b60640 1 -- 172.21.15.150:0/2985583351 learned_addr learned my addr 172.21.15.150:0/2985583351 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:51:46.771 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:46.768+0000 7f795bfff640 1 --2- 172.21.15.150:0/2985583351 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7944003a50 0x7f795c15d890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:51:46.771 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:46.768+0000 7f795b7fe640 1 --2- 172.21.15.150:0/2985583351 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f795c14b3f0 0x7f795c14b800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:51:46.771 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:46.768+0000 7f7960b60640 1 -- 172.21.15.150:0/2985583351 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f795c14b3f0 msgr2=0x7f795c14b800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:51:46.771 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:46.768+0000 7f7960b60640 1 --2- 172.21.15.150:0/2985583351 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f795c14b3f0 0x7f795c14b800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:51:46.771 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:46.768+0000 7f7960b60640 1 -- 172.21.15.150:0/2985583351 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7944003a50 msgr2=0x7f795c15d890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:51:46.772 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:46.768+0000 7f7960b60640 1 --2- 172.21.15.150:0/2985583351 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7944003a50 0x7f795c15d890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:51:46.772 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:46.768+0000 7f7960b60640 1 -- 172.21.15.150:0/2985583351 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f795c14bd40 con 0x7f795c14e870 2024-09-17T05:51:46.772 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:46.768+0000 7f795bfff640 1 --2- 172.21.15.150:0/2985583351 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7944003a50 0x7f795c15d890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:51:46.772 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:46.768+0000 7f7960b60640 1 --2- 172.21.15.150:0/2985583351 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f795c14e870 0x7f795c14ec80 secure :-1 s=READY pgs=1549 cs=0 l=1 rev1=1 crypto rx=0x7f795c0a04b0 tx=0x7f795400f790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:51:46.772 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:46.768+0000 7f7958ff9640 1 -- 172.21.15.150:0/2985583351 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7954009ad0 con 0x7f795c14e870 2024-09-17T05:51:46.772 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:46.768+0000 7f7958ff9640 1 -- 172.21.15.150:0/2985583351 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f7954003b70 con 0x7f795c14e870 2024-09-17T05:51:46.772 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:46.768+0000 7f79625c3640 1 -- 172.21.15.150:0/2985583351 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f795c14f1c0 con 0x7f795c14e870 2024-09-17T05:51:46.772 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:46.768+0000 7f7958ff9640 1 -- 172.21.15.150:0/2985583351 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7954004050 con 0x7f795c14e870 2024-09-17T05:51:46.772 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:46.768+0000 7f79625c3640 1 -- 172.21.15.150:0/2985583351 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f795c15e630 con 0x7f795c14e870 2024-09-17T05:51:46.773 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:46.769+0000 7f79625c3640 1 -- 172.21.15.150:0/2985583351 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f795c15e0c0 con 0x7f795c14e870 2024-09-17T05:51:46.773 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:46.770+0000 7f7958ff9640 1 -- 172.21.15.150:0/2985583351 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 39) ==== 103889+0+0 (secure 0 0 0) 0x7f79540041f0 con 0x7f795c14e870 2024-09-17T05:51:46.773 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:46.770+0000 7f7958ff9640 1 --2- 172.21.15.150:0/2985583351 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f794807a690 0x7f794807cba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:51:46.773 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:46.771+0000 7f7958ff9640 1 -- 172.21.15.150:0/2985583351 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(115..115 src has 1..115) ==== 5907+0+0 (secure 0 0 0) 0x7f795409a910 con 0x7f795c14e870 2024-09-17T05:51:46.773 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:46.771+0000 7f795bfff640 1 --2- 172.21.15.150:0/2985583351 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f794807a690 0x7f794807cba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:51:46.773 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:46.771+0000 7f795bfff640 1 --2- 172.21.15.150:0/2985583351 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f794807a690 0x7f794807cba0 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7f794c033000 tx=0x7f794c000fe0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:51:46.777 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:46.775+0000 7f7958ff9640 1 -- 172.21.15.150:0/2985583351 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f795c14bd40 con 0x7f795c14e870 2024-09-17T05:51:46.982 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:46.980+0000 7f79625c3640 1 -- 172.21.15.150:0/2985583351 --> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] -- mgr_command(tid 0: {"prefix": "fs subvolume snapshot clone", "vol_name": "cephfs", "sub_name": "sv1", "snap_name": "ss1", "target_sub_name": "subvol_clone39571", "target": ["mon-mgr", ""]}) -- 0x7f795c0d0df0 con 0x7f794807a690 2024-09-17T05:51:47.463 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:47.461+0000 7f7958ff9640 1 -- 172.21.15.150:0/2985583351 <== mon.0 v2:172.21.15.150:3300/0 7 ==== mgrmap(e 40) ==== 103991+0+0 (secure 0 0 0) 0x7f79540603d0 con 0x7f795c14e870 2024-09-17T05:51:47.632 INFO:tasks.ceph.mgr.x.smithi176.stderr:2024-09-17T05:51:47.631+0000 7f3380dad640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-17T05:51:47.632 INFO:tasks.ceph.mgr.x.smithi176.stderr:2024-09-17T05:51:47.631+0000 7f3380dad640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-17T05:51:47.632 INFO:tasks.ceph.mgr.x.smithi176.stderr:2024-09-17T05:51:47.631+0000 7f3380dad640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-17T05:51:47.632 INFO:tasks.ceph.mgr.x.smithi176.stderr:2024-09-17T05:51:47.631+0000 7f3380dad640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-17T05:51:47.632 INFO:tasks.ceph.mgr.x.smithi176.stderr:2024-09-17T05:51:47.631+0000 7f3380dad640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-17T05:51:47.720 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:47.719+0000 7f7958ff9640 1 -- 172.21.15.150:0/2985583351 <== mgr.4108 v2:172.21.15.176:6800/3631216395 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f795c0d0df0 con 0x7f794807a690 2024-09-17T05:51:47.723 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:47.721+0000 7f79625c3640 1 -- 172.21.15.150:0/2985583351 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f794807a690 msgr2=0x7f794807cba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:51:47.723 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:47.721+0000 7f79625c3640 1 --2- 172.21.15.150:0/2985583351 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f794807a690 0x7f794807cba0 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7f794c033000 tx=0x7f794c000fe0 comp rx=0 tx=0).stop 2024-09-17T05:51:47.723 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:47.721+0000 7f79625c3640 1 -- 172.21.15.150:0/2985583351 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f795c14e870 msgr2=0x7f795c14ec80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:51:47.724 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:47.721+0000 7f79625c3640 1 --2- 172.21.15.150:0/2985583351 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f795c14e870 0x7f795c14ec80 secure :-1 s=READY pgs=1549 cs=0 l=1 rev1=1 crypto rx=0x7f795c0a04b0 tx=0x7f795400f790 comp rx=0 tx=0).stop 2024-09-17T05:51:47.724 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:47.721+0000 7f79625c3640 1 -- 172.21.15.150:0/2985583351 shutdown_connections 2024-09-17T05:51:47.724 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:47.721+0000 7f79625c3640 1 --2- 172.21.15.150:0/2985583351 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f794807a690 0x7f794807cba0 unknown :-1 s=CLOSED pgs=660 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:51:47.724 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:47.721+0000 7f79625c3640 1 --2- 172.21.15.150:0/2985583351 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f795c14e870 0x7f795c14ec80 unknown :-1 s=CLOSED pgs=1549 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:51:47.724 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:47.721+0000 7f79625c3640 1 --2- 172.21.15.150:0/2985583351 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f795c14b3f0 0x7f795c14b800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:51:47.724 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:47.721+0000 7f79625c3640 1 --2- 172.21.15.150:0/2985583351 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7944003a50 0x7f795c15d890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:51:47.724 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:47.721+0000 7f79625c3640 1 -- 172.21.15.150:0/2985583351 >> 172.21.15.150:0/2985583351 conn(0x7f795c0cefb0 msgr2=0x7f795c0b5360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:51:47.724 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:47.722+0000 7f79625c3640 1 -- 172.21.15.150:0/2985583351 shutdown_connections 2024-09-17T05:51:47.724 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:47.722+0000 7f79625c3640 1 -- 172.21.15.150:0/2985583351 wait complete. 2024-09-17T05:51:47.747 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume snapshot clone cephfs sv1 ss1 subvol_clone59012 2024-09-17T05:51:47.765 INFO:tasks.ceph.mgr.x.smithi176.stderr:2024-09-17T05:51:47.763+0000 7f33dd726640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-17T05:51:47.765 INFO:tasks.ceph.mgr.x.smithi176.stderr:2024-09-17T05:51:47.764+0000 7f33dd726640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-17T05:51:47.766 INFO:tasks.ceph.mgr.x.smithi176.stderr:2024-09-17T05:51:47.764+0000 7f33dd726640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-17T05:51:47.766 INFO:tasks.ceph.mgr.x.smithi176.stderr:2024-09-17T05:51:47.764+0000 7f33dd726640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-17T05:51:47.766 INFO:tasks.ceph.mgr.x.smithi176.stderr:2024-09-17T05:51:47.764+0000 7f33dd726640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-17T05:51:47.919 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:47.916+0000 7f3a8844d640 1 -- 172.21.15.150:0/3773304137 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3a800d0e00 msgr2=0x7f3a800b2030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:51:47.919 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:47.916+0000 7f3a8844d640 1 --2- 172.21.15.150:0/3773304137 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3a800d0e00 0x7f3a800b2030 secure :-1 s=READY pgs=1551 cs=0 l=1 rev1=1 crypto rx=0x7f3a78005fd0 tx=0x7f3a7802a780 comp rx=0 tx=0).stop 2024-09-17T05:51:47.919 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:47.917+0000 7f3a8844d640 1 -- 172.21.15.150:0/3773304137 shutdown_connections 2024-09-17T05:51:47.919 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:47.917+0000 7f3a8844d640 1 --2- 172.21.15.150:0/3773304137 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3a800d09f0 0x7f3a800b1af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:51:47.919 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:47.917+0000 7f3a8844d640 1 --2- 172.21.15.150:0/3773304137 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3a800d0e00 0x7f3a800b2030 unknown :-1 s=CLOSED pgs=1551 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:51:47.919 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:47.917+0000 7f3a8844d640 1 -- 172.21.15.150:0/3773304137 >> 172.21.15.150:0/3773304137 conn(0x7f3a800cefb0 msgr2=0x7f3a800cf3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:51:47.919 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:47.917+0000 7f3a8844d640 1 -- 172.21.15.150:0/3773304137 shutdown_connections 2024-09-17T05:51:47.919 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:47.917+0000 7f3a8844d640 1 -- 172.21.15.150:0/3773304137 wait complete. 2024-09-17T05:51:47.921 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:47.919+0000 7f3a8844d640 1 Processor -- start 2024-09-17T05:51:47.921 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:47.919+0000 7f3a8844d640 1 -- start start 2024-09-17T05:51:47.923 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:47.921+0000 7f3a8844d640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3a800cfad0 0x7f3a8015c590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:51:47.924 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:47.921+0000 7f3a8844d640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3a800d09f0 0x7f3a80166070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:51:47.924 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:47.921+0000 7f3a8844d640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3a800d0e00 0x7f3a8015d4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:51:47.924 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:47.922+0000 7f3a8844d640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f3a800b2ac0 con 0x7f3a800d0e00 2024-09-17T05:51:47.924 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:47.922+0000 7f3a8844d640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f3a800b2940 con 0x7f3a800cfad0 2024-09-17T05:51:47.924 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:47.922+0000 7f3a8844d640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f3a800b2c40 con 0x7f3a800d09f0 2024-09-17T05:51:47.924 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:47.922+0000 7f3a869ea640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3a800d0e00 0x7f3a8015d4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:51:47.924 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:47.922+0000 7f3a869ea640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3a800d0e00 0x7f3a8015d4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:49642/0 (socket says 172.21.15.150:49642) 2024-09-17T05:51:47.924 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:47.922+0000 7f3a869ea640 1 -- 172.21.15.150:0/1859888899 learned_addr learned my addr 172.21.15.150:0/1859888899 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:51:47.925 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:47.922+0000 7f3a869ea640 1 -- 172.21.15.150:0/1859888899 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3a800d09f0 msgr2=0x7f3a80166070 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-17T05:51:47.925 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:47.922+0000 7f3a869ea640 1 --2- 172.21.15.150:0/1859888899 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3a800d09f0 0x7f3a80166070 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:51:47.925 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:47.922+0000 7f3a869ea640 1 -- 172.21.15.150:0/1859888899 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3a800cfad0 msgr2=0x7f3a8015c590 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-17T05:51:47.926 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:47.922+0000 7f3a869ea640 1 --2- 172.21.15.150:0/1859888899 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3a800cfad0 0x7f3a8015c590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:51:47.926 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:47.922+0000 7f3a869ea640 1 -- 172.21.15.150:0/1859888899 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3a801665b0 con 0x7f3a800d0e00 2024-09-17T05:51:47.926 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:47.922+0000 7f3a869ea640 1 --2- 172.21.15.150:0/1859888899 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3a800d0e00 0x7f3a8015d4e0 secure :-1 s=READY pgs=1552 cs=0 l=1 rev1=1 crypto rx=0x7f3a78009cd0 tx=0x7f3a78003c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:51:47.926 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:47.923+0000 7f3a76ffd640 1 -- 172.21.15.150:0/1859888899 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a78040070 con 0x7f3a800d0e00 2024-09-17T05:51:47.926 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:47.923+0000 7f3a76ffd640 1 -- 172.21.15.150:0/1859888899 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f3a78004540 con 0x7f3a800d0e00 2024-09-17T05:51:47.926 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:47.923+0000 7f3a8844d640 1 -- 172.21.15.150:0/1859888899 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3a80164fd0 con 0x7f3a800d0e00 2024-09-17T05:51:47.926 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:47.923+0000 7f3a76ffd640 1 -- 172.21.15.150:0/1859888899 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a78003e10 con 0x7f3a800d0e00 2024-09-17T05:51:47.926 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:47.923+0000 7f3a8844d640 1 -- 172.21.15.150:0/1859888899 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3a80165590 con 0x7f3a800d0e00 2024-09-17T05:51:47.926 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:47.925+0000 7f3a8844d640 1 -- 172.21.15.150:0/1859888899 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3a800d02e0 con 0x7f3a800d0e00 2024-09-17T05:51:47.927 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:47.925+0000 7f3a76ffd640 1 -- 172.21.15.150:0/1859888899 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 40) ==== 103991+0+0 (secure 0 0 0) 0x7f3a78043070 con 0x7f3a800d0e00 2024-09-17T05:51:47.927 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:47.926+0000 7f3a76ffd640 1 --2- 172.21.15.150:0/1859888899 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f3a6407a7e0 0x7f3a6407ccf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:51:47.927 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:47.926+0000 7f3a76ffd640 1 -- 172.21.15.150:0/1859888899 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(115..115 src has 1..115) ==== 5907+0+0 (secure 0 0 0) 0x7f3a780bb170 con 0x7f3a800d0e00 2024-09-17T05:51:47.928 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:47.926+0000 7f3a861e9640 1 --2- 172.21.15.150:0/1859888899 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f3a6407a7e0 0x7f3a6407ccf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:51:47.929 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:47.927+0000 7f3a861e9640 1 --2- 172.21.15.150:0/1859888899 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f3a6407a7e0 0x7f3a6407ccf0 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7f3a7c001370 tx=0x7f3a7c001300 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:51:47.933 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:47.931+0000 7f3a76ffd640 1 -- 172.21.15.150:0/1859888899 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f3a780850c0 con 0x7f3a800d0e00 2024-09-17T05:51:48.226 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:48.224+0000 7f3a8844d640 1 -- 172.21.15.150:0/1859888899 --> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] -- mgr_command(tid 0: {"prefix": "fs subvolume snapshot clone", "vol_name": "cephfs", "sub_name": "sv1", "snap_name": "ss1", "target_sub_name": "subvol_clone59012", "target": ["mon-mgr", ""]}) -- 0x7f3a800b3e00 con 0x7f3a6407a7e0 2024-09-17T05:51:48.746 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:48.744+0000 7f3a76ffd640 1 -- 172.21.15.150:0/1859888899 <== mgr.4108 v2:172.21.15.176:6800/3631216395 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f3a800b3e00 con 0x7f3a6407a7e0 2024-09-17T05:51:48.751 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:48.749+0000 7f3a8844d640 1 -- 172.21.15.150:0/1859888899 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f3a6407a7e0 msgr2=0x7f3a6407ccf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:51:48.751 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:48.749+0000 7f3a8844d640 1 --2- 172.21.15.150:0/1859888899 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f3a6407a7e0 0x7f3a6407ccf0 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7f3a7c001370 tx=0x7f3a7c001300 comp rx=0 tx=0).stop 2024-09-17T05:51:48.751 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:48.749+0000 7f3a8844d640 1 -- 172.21.15.150:0/1859888899 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3a800d0e00 msgr2=0x7f3a8015d4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:51:48.751 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:48.749+0000 7f3a8844d640 1 --2- 172.21.15.150:0/1859888899 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3a800d0e00 0x7f3a8015d4e0 secure :-1 s=READY pgs=1552 cs=0 l=1 rev1=1 crypto rx=0x7f3a78009cd0 tx=0x7f3a78003c20 comp rx=0 tx=0).stop 2024-09-17T05:51:48.752 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:48.750+0000 7f3a8844d640 1 -- 172.21.15.150:0/1859888899 shutdown_connections 2024-09-17T05:51:48.752 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:48.750+0000 7f3a8844d640 1 --2- 172.21.15.150:0/1859888899 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f3a6407a7e0 0x7f3a6407ccf0 unknown :-1 s=CLOSED pgs=661 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:51:48.752 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:48.750+0000 7f3a8844d640 1 --2- 172.21.15.150:0/1859888899 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3a800d0e00 0x7f3a8015d4e0 unknown :-1 s=CLOSED pgs=1552 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:51:48.752 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:48.750+0000 7f3a8844d640 1 --2- 172.21.15.150:0/1859888899 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3a800d09f0 0x7f3a80166070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:51:48.752 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:48.750+0000 7f3a8844d640 1 --2- 172.21.15.150:0/1859888899 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3a800cfad0 0x7f3a8015c590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:51:48.753 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:48.750+0000 7f3a8844d640 1 -- 172.21.15.150:0/1859888899 >> 172.21.15.150:0/1859888899 conn(0x7f3a800cefb0 msgr2=0x7f3a80163a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:51:48.753 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:48.750+0000 7f3a8844d640 1 -- 172.21.15.150:0/1859888899 shutdown_connections 2024-09-17T05:51:48.753 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:48.750+0000 7f3a8844d640 1 -- 172.21.15.150:0/1859888899 wait complete. 2024-09-17T05:51:48.804 INFO:tasks.ceph.mgr.x.smithi176.stderr:2024-09-17T05:51:48.802+0000 7f33dbf23640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-17T05:51:48.804 INFO:tasks.ceph.mgr.x.smithi176.stderr:2024-09-17T05:51:48.802+0000 7f33dbf23640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-17T05:51:48.804 INFO:tasks.ceph.mgr.x.smithi176.stderr:2024-09-17T05:51:48.802+0000 7f33dbf23640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-17T05:51:48.804 INFO:tasks.ceph.mgr.x.smithi176.stderr:2024-09-17T05:51:48.802+0000 7f33dbf23640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-17T05:51:48.805 INFO:tasks.ceph.mgr.x.smithi176.stderr:2024-09-17T05:51:48.802+0000 7f33dbf23640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-17T05:51:49.768 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs clone cancel cephfs subvol_clone43860 2024-09-17T05:51:49.950 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:49.949+0000 7ff5e699d640 1 -- 172.21.15.150:0/3035270815 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff5e00b0420 msgr2=0x7ff5e00b40d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:51:49.950 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:49.949+0000 7ff5e699d640 1 --2- 172.21.15.150:0/3035270815 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff5e00b0420 0x7ff5e00b40d0 secure :-1 s=READY pgs=1553 cs=0 l=1 rev1=1 crypto rx=0x7ff5dc005fd0 tx=0x7ff5dc02a530 comp rx=0 tx=0).stop 2024-09-17T05:51:49.950 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:49.949+0000 7ff5e699d640 1 -- 172.21.15.150:0/3035270815 shutdown_connections 2024-09-17T05:51:49.950 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:49.949+0000 7ff5e699d640 1 --2- 172.21.15.150:0/3035270815 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff5e00cf030 0x7ff5e00cf440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:51:49.950 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:49.949+0000 7ff5e699d640 1 --2- 172.21.15.150:0/3035270815 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff5e00b0420 0x7ff5e00b40d0 unknown :-1 s=CLOSED pgs=1553 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:51:49.950 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:49.949+0000 7ff5e699d640 1 -- 172.21.15.150:0/3035270815 >> 172.21.15.150:0/3035270815 conn(0x7ff5e0074130 msgr2=0x7ff5e00d1280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:51:49.951 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:49.950+0000 7ff5e699d640 1 -- 172.21.15.150:0/3035270815 shutdown_connections 2024-09-17T05:51:49.951 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:49.950+0000 7ff5e699d640 1 -- 172.21.15.150:0/3035270815 wait complete. 2024-09-17T05:51:49.953 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:49.952+0000 7ff5e699d640 1 Processor -- start 2024-09-17T05:51:49.953 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:49.952+0000 7ff5e699d640 1 -- start start 2024-09-17T05:51:49.956 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:49.954+0000 7ff5e699d640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff5e00b0420 0x7ff5e01f9c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:51:49.956 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:49.954+0000 7ff5e699d640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff5e00ccd70 0x7ff5e0156cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:51:49.956 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:49.954+0000 7ff5e699d640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff5e00cf030 0x7ff5e00b49d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:51:49.956 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:49.954+0000 7ff5e699d640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7ff5e00b4610 con 0x7ff5e00b0420 2024-09-17T05:51:49.956 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:49.954+0000 7ff5e699d640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7ff5e00d0fc0 con 0x7ff5e00cf030 2024-09-17T05:51:49.956 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:49.954+0000 7ff5e699d640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7ff5e00b4790 con 0x7ff5e00ccd70 2024-09-17T05:51:49.956 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:49.954+0000 7ff5e599b640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff5e00b0420 0x7ff5e01f9c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:51:49.956 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:49.954+0000 7ff5e599b640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff5e00b0420 0x7ff5e01f9c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:49646/0 (socket says 172.21.15.150:49646) 2024-09-17T05:51:49.956 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:49.954+0000 7ff5e599b640 1 -- 172.21.15.150:0/59208146 learned_addr learned my addr 172.21.15.150:0/59208146 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:51:49.957 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:49.954+0000 7ff5e599b640 1 -- 172.21.15.150:0/59208146 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff5e00ccd70 msgr2=0x7ff5e0156cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:51:49.957 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:49.954+0000 7ff5e599b640 1 --2- 172.21.15.150:0/59208146 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff5e00ccd70 0x7ff5e0156cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:51:49.957 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:49.954+0000 7ff5e599b640 1 -- 172.21.15.150:0/59208146 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff5e00cf030 msgr2=0x7ff5e00b49d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:51:49.957 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:49.954+0000 7ff5e599b640 1 --2- 172.21.15.150:0/59208146 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff5e00cf030 0x7ff5e00b49d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:51:49.957 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:49.954+0000 7ff5e599b640 1 -- 172.21.15.150:0/59208146 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff5e01f71e0 con 0x7ff5e00b0420 2024-09-17T05:51:49.957 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:49.954+0000 7ff5e599b640 1 --2- 172.21.15.150:0/59208146 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff5e00b0420 0x7ff5e01f9c90 secure :-1 s=READY pgs=1554 cs=0 l=1 rev1=1 crypto rx=0x7ff5dc000c00 tx=0x7ff5dc003970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:51:49.957 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:49.954+0000 7ff5d67fc640 1 -- 172.21.15.150:0/59208146 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff5dc03e030 con 0x7ff5e00b0420 2024-09-17T05:51:49.957 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:49.955+0000 7ff5d67fc640 1 -- 172.21.15.150:0/59208146 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff5dc003e60 con 0x7ff5e00b0420 2024-09-17T05:51:49.957 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:49.955+0000 7ff5e699d640 1 -- 172.21.15.150:0/59208146 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff5e009b960 con 0x7ff5e00b0420 2024-09-17T05:51:49.957 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:49.955+0000 7ff5e699d640 1 -- 172.21.15.150:0/59208146 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff5e009d630 con 0x7ff5e00b0420 2024-09-17T05:51:49.957 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:49.955+0000 7ff5d67fc640 1 -- 172.21.15.150:0/59208146 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff5dc035040 con 0x7ff5e00b0420 2024-09-17T05:51:49.958 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:49.956+0000 7ff5e699d640 1 -- 172.21.15.150:0/59208146 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff5e00d00b0 con 0x7ff5e00b0420 2024-09-17T05:51:49.958 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:49.957+0000 7ff5d67fc640 1 -- 172.21.15.150:0/59208146 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 41) ==== 104144+0+0 (secure 0 0 0) 0x7ff5dc041030 con 0x7ff5e00b0420 2024-09-17T05:51:49.958 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:49.957+0000 7ff5d67fc640 1 --2- 172.21.15.150:0/59208146 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7ff5c407a990 0x7ff5c407cea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:51:49.958 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:49.957+0000 7ff5d67fc640 1 -- 172.21.15.150:0/59208146 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(115..115 src has 1..115) ==== 5907+0+0 (secure 0 0 0) 0x7ff5dc0ba460 con 0x7ff5e00b0420 2024-09-17T05:51:49.964 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:49.963+0000 7ff5e519a640 1 --2- 172.21.15.150:0/59208146 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7ff5c407a990 0x7ff5c407cea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:51:49.965 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:49.965+0000 7ff5d67fc640 1 -- 172.21.15.150:0/59208146 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7ff5e00d00b0 con 0x7ff5e00b0420 2024-09-17T05:51:49.995 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:49.994+0000 7ff5e519a640 1 --2- 172.21.15.150:0/59208146 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7ff5c407a990 0x7ff5c407cea0 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7ff5e00b4390 tx=0x7ff5d0006bf0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:51:50.308 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:50.307+0000 7ff5e699d640 1 -- 172.21.15.150:0/59208146 --> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] -- mgr_command(tid 0: {"prefix": "fs clone cancel", "vol_name": "cephfs", "clone_name": "subvol_clone43860", "target": ["mon-mgr", ""]}) -- 0x7ff5e00b40d0 con 0x7ff5c407a990 2024-09-17T05:51:51.397 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:51.396+0000 7ff5d67fc640 1 -- 172.21.15.150:0/59208146 <== mgr.4108 v2:172.21.15.176:6800/3631216395 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7ff5e00b40d0 con 0x7ff5c407a990 2024-09-17T05:51:51.402 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:51.401+0000 7ff5e699d640 1 -- 172.21.15.150:0/59208146 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7ff5c407a990 msgr2=0x7ff5c407cea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:51:51.403 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:51.401+0000 7ff5e699d640 1 --2- 172.21.15.150:0/59208146 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7ff5c407a990 0x7ff5c407cea0 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7ff5e00b4390 tx=0x7ff5d0006bf0 comp rx=0 tx=0).stop 2024-09-17T05:51:51.403 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:51.401+0000 7ff5e699d640 1 -- 172.21.15.150:0/59208146 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff5e00b0420 msgr2=0x7ff5e01f9c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:51:51.403 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:51.401+0000 7ff5e699d640 1 --2- 172.21.15.150:0/59208146 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff5e00b0420 0x7ff5e01f9c90 secure :-1 s=READY pgs=1554 cs=0 l=1 rev1=1 crypto rx=0x7ff5dc000c00 tx=0x7ff5dc003970 comp rx=0 tx=0).stop 2024-09-17T05:51:51.403 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:51.402+0000 7ff5e699d640 1 -- 172.21.15.150:0/59208146 shutdown_connections 2024-09-17T05:51:51.403 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:51.402+0000 7ff5e699d640 1 --2- 172.21.15.150:0/59208146 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff5e00cf030 0x7ff5e00b49d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:51:51.403 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:51.402+0000 7ff5e699d640 1 --2- 172.21.15.150:0/59208146 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7ff5c407a990 0x7ff5c407cea0 unknown :-1 s=CLOSED pgs=662 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:51:51.403 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:51.402+0000 7ff5e699d640 1 --2- 172.21.15.150:0/59208146 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff5e00ccd70 0x7ff5e0156cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:51:51.403 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:51.402+0000 7ff5e699d640 1 --2- 172.21.15.150:0/59208146 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff5e00b0420 0x7ff5e01f9c90 unknown :-1 s=CLOSED pgs=1554 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:51:51.403 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:51.402+0000 7ff5e699d640 1 -- 172.21.15.150:0/59208146 >> 172.21.15.150:0/59208146 conn(0x7ff5e0074130 msgr2=0x7ff5e015a950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:51:51.403 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:51.402+0000 7ff5e699d640 1 -- 172.21.15.150:0/59208146 shutdown_connections 2024-09-17T05:51:51.403 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:51.402+0000 7ff5e699d640 1 -- 172.21.15.150:0/59208146 wait complete. 2024-09-17T05:51:51.426 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs clone cancel cephfs subvol_clone39571 2024-09-17T05:51:51.606 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:51.605+0000 7f1002ef2640 1 -- 172.21.15.150:0/1467808558 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0ffc0b6550 msgr2=0x7f0ffc0b24c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:51:51.606 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:51.605+0000 7f1002ef2640 1 --2- 172.21.15.150:0/1467808558 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0ffc0b6550 0x7f0ffc0b24c0 secure :-1 s=READY pgs=1556 cs=0 l=1 rev1=1 crypto rx=0x7f0ff0009830 tx=0x7f0ff002a480 comp rx=0 tx=0).stop 2024-09-17T05:51:51.607 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:51.605+0000 7f1002ef2640 1 -- 172.21.15.150:0/1467808558 shutdown_connections 2024-09-17T05:51:51.607 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:51.605+0000 7f1002ef2640 1 --2- 172.21.15.150:0/1467808558 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0ffc160200 0x7f0ffc0b4e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:51:51.607 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:51.605+0000 7f1002ef2640 1 --2- 172.21.15.150:0/1467808558 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0ffc0b6550 0x7f0ffc0b24c0 unknown :-1 s=CLOSED pgs=1556 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:51:51.607 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:51.605+0000 7f1002ef2640 1 -- 172.21.15.150:0/1467808558 >> 172.21.15.150:0/1467808558 conn(0x7f0ffc0b2e80 msgr2=0x7f0ffc0b3290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:51:51.607 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:51.605+0000 7f1002ef2640 1 -- 172.21.15.150:0/1467808558 shutdown_connections 2024-09-17T05:51:51.607 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:51.605+0000 7f1002ef2640 1 -- 172.21.15.150:0/1467808558 wait complete. 2024-09-17T05:51:51.608 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:51.607+0000 7f1002ef2640 1 Processor -- start 2024-09-17T05:51:51.608 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:51.607+0000 7f1002ef2640 1 -- start start 2024-09-17T05:51:51.612 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:51.610+0000 7f1002ef2640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0ffc0b2a00 0x7f0ffc15e700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:51:51.612 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:51.610+0000 7f1002ef2640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0ffc0b6550 0x7f0ffc1f41e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:51:51.612 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:51.610+0000 7f1002ef2640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0ffc160200 0x7f0ffc15c580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:51:51.612 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:51.610+0000 7f1002ef2640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f0ffc0b5390 con 0x7f0ffc0b2a00 2024-09-17T05:51:51.612 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:51.610+0000 7f1002ef2640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f0ffc160820 con 0x7f0ffc0b6550 2024-09-17T05:51:51.612 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:51.611+0000 7f1000c8e640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0ffc0b2a00 0x7f0ffc15e700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:51:51.612 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:51.611+0000 7f1000c8e640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0ffc0b2a00 0x7f0ffc15e700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:58206/0 (socket says 172.21.15.150:58206) 2024-09-17T05:51:51.612 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:51.611+0000 7f1000c8e640 1 -- 172.21.15.150:0/2263742579 learned_addr learned my addr 172.21.15.150:0/2263742579 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:51:51.613 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:51.611+0000 7f1002ef2640 1 -- 172.21.15.150:0/2263742579 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f0ffc0b5510 con 0x7f0ffc160200 2024-09-17T05:51:51.613 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:51.611+0000 7f1000c8e640 1 -- 172.21.15.150:0/2263742579 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0ffc160200 msgr2=0x7f0ffc15c580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:51:51.613 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:51.611+0000 7f1000c8e640 1 --2- 172.21.15.150:0/2263742579 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0ffc160200 0x7f0ffc15c580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:51:51.613 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:51.611+0000 7f1000c8e640 1 -- 172.21.15.150:0/2263742579 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0ffc0b6550 msgr2=0x7f0ffc1f41e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:51:51.613 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:51.611+0000 7f1000c8e640 1 --2- 172.21.15.150:0/2263742579 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0ffc0b6550 0x7f0ffc1f41e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:51:51.613 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:51.611+0000 7f1000c8e640 1 -- 172.21.15.150:0/2263742579 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0ffc15f070 con 0x7f0ffc0b2a00 2024-09-17T05:51:51.614 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:51.612+0000 7f1000c8e640 1 --2- 172.21.15.150:0/2263742579 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0ffc0b2a00 0x7f0ffc15e700 secure :-1 s=READY pgs=1557 cs=0 l=1 rev1=1 crypto rx=0x7f0ff0009950 tx=0x7f0ff0033d60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:51:51.614 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:51.612+0000 7f0ff97fa640 1 -- 172.21.15.150:0/2263742579 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ff0031d60 con 0x7f0ffc0b2a00 2024-09-17T05:51:51.614 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:51.612+0000 7f0ff97fa640 1 -- 172.21.15.150:0/2263742579 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0ff00330d0 con 0x7f0ffc0b2a00 2024-09-17T05:51:51.614 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:51.612+0000 7f0ff97fa640 1 -- 172.21.15.150:0/2263742579 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ff0033520 con 0x7f0ffc0b2a00 2024-09-17T05:51:51.614 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:51.612+0000 7f1002ef2640 1 -- 172.21.15.150:0/2263742579 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0ffc15f350 con 0x7f0ffc0b2a00 2024-09-17T05:51:51.614 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:51.613+0000 7f1002ef2640 1 -- 172.21.15.150:0/2263742579 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0ffc1e81c0 con 0x7f0ffc0b2a00 2024-09-17T05:51:51.617 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:51.617+0000 7f1002ef2640 1 -- 172.21.15.150:0/2263742579 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0ffc0b24c0 con 0x7f0ffc0b2a00 2024-09-17T05:51:51.620 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:51.618+0000 7f0ff97fa640 1 -- 172.21.15.150:0/2263742579 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 41) ==== 104144+0+0 (secure 0 0 0) 0x7f0ff00035f0 con 0x7f0ffc0b2a00 2024-09-17T05:51:51.621 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:51.620+0000 7f0ff97fa640 1 --2- 172.21.15.150:0/2263742579 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f0fe007a9b0 0x7f0fe007cec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:51:51.622 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:51.620+0000 7f0ff97fa640 1 -- 172.21.15.150:0/2263742579 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(115..115 src has 1..115) ==== 5907+0+0 (secure 0 0 0) 0x7f0ff00bb5b0 con 0x7f0ffc0b2a00 2024-09-17T05:51:51.627 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:51.626+0000 7f0ff97fa640 1 -- 172.21.15.150:0/2263742579 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f0ff0052080 con 0x7f0ffc0b2a00 2024-09-17T05:51:51.640 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:51.639+0000 7f0ffbfff640 1 --2- 172.21.15.150:0/2263742579 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f0fe007a9b0 0x7f0fe007cec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:51:51.644 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:51.643+0000 7f0ffbfff640 1 --2- 172.21.15.150:0/2263742579 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f0fe007a9b0 0x7f0fe007cec0 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7f0ffc0c9060 tx=0x7f0fe8007a30 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:51:51.926 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:51.926+0000 7f1002ef2640 1 -- 172.21.15.150:0/2263742579 --> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] -- mgr_command(tid 0: {"prefix": "fs clone cancel", "vol_name": "cephfs", "clone_name": "subvol_clone39571", "target": ["mon-mgr", ""]}) -- 0x7f0ffc1e59f0 con 0x7f0fe007a9b0 2024-09-17T05:51:52.323 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:52.323+0000 7f0ff97fa640 1 -- 172.21.15.150:0/2263742579 <== mgr.4108 v2:172.21.15.176:6800/3631216395 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f0ffc1e59f0 con 0x7f0fe007a9b0 2024-09-17T05:51:52.327 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:52.326+0000 7f1002ef2640 1 -- 172.21.15.150:0/2263742579 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f0fe007a9b0 msgr2=0x7f0fe007cec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:51:52.327 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:52.326+0000 7f1002ef2640 1 --2- 172.21.15.150:0/2263742579 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f0fe007a9b0 0x7f0fe007cec0 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7f0ffc0c9060 tx=0x7f0fe8007a30 comp rx=0 tx=0).stop 2024-09-17T05:51:52.327 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:52.326+0000 7f1002ef2640 1 -- 172.21.15.150:0/2263742579 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0ffc0b2a00 msgr2=0x7f0ffc15e700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:51:52.327 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:52.326+0000 7f1002ef2640 1 --2- 172.21.15.150:0/2263742579 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0ffc0b2a00 0x7f0ffc15e700 secure :-1 s=READY pgs=1557 cs=0 l=1 rev1=1 crypto rx=0x7f0ff0009950 tx=0x7f0ff0033d60 comp rx=0 tx=0).stop 2024-09-17T05:51:52.327 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:52.326+0000 7f1002ef2640 1 -- 172.21.15.150:0/2263742579 shutdown_connections 2024-09-17T05:51:52.327 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:52.326+0000 7f1002ef2640 1 --2- 172.21.15.150:0/2263742579 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0ffc0b6550 0x7f0ffc1f41e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:51:52.327 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:52.326+0000 7f1002ef2640 1 --2- 172.21.15.150:0/2263742579 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f0fe007a9b0 0x7f0fe007cec0 unknown :-1 s=CLOSED pgs=663 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:51:52.327 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:52.326+0000 7f1002ef2640 1 --2- 172.21.15.150:0/2263742579 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0ffc160200 0x7f0ffc15c580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:51:52.327 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:52.326+0000 7f1002ef2640 1 --2- 172.21.15.150:0/2263742579 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0ffc0b2a00 0x7f0ffc15e700 unknown :-1 s=CLOSED pgs=1557 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:51:52.328 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:52.326+0000 7f1002ef2640 1 -- 172.21.15.150:0/2263742579 >> 172.21.15.150:0/2263742579 conn(0x7f0ffc0b2e80 msgr2=0x7f0ffc071380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:51:52.328 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:52.326+0000 7f1002ef2640 1 -- 172.21.15.150:0/2263742579 shutdown_connections 2024-09-17T05:51:52.328 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:52.326+0000 7f1002ef2640 1 -- 172.21.15.150:0/2263742579 wait complete. 2024-09-17T05:51:52.344 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs clone cancel cephfs subvol_clone59012 2024-09-17T05:51:52.521 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:52.520+0000 7f9e9989b640 1 -- 172.21.15.150:0/790199864 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9e9406e4c0 msgr2=0x7f9e94152800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:51:52.521 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:52.520+0000 7f9e9989b640 1 --2- 172.21.15.150:0/790199864 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9e9406e4c0 0x7f9e94152800 secure :-1 s=READY pgs=1559 cs=0 l=1 rev1=1 crypto rx=0x7f9e7c009830 tx=0x7f9e7c02a4b0 comp rx=0 tx=0).stop 2024-09-17T05:51:52.521 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:52.520+0000 7f9e9989b640 1 -- 172.21.15.150:0/790199864 shutdown_connections 2024-09-17T05:51:52.521 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:52.520+0000 7f9e9989b640 1 --2- 172.21.15.150:0/790199864 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9e9406e4c0 0x7f9e94152800 unknown :-1 s=CLOSED pgs=1559 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:51:52.521 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:52.520+0000 7f9e9989b640 1 -- 172.21.15.150:0/790199864 >> 172.21.15.150:0/790199864 conn(0x7f9e94073890 msgr2=0x7f9e94073ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:51:52.522 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:52.520+0000 7f9e9989b640 1 -- 172.21.15.150:0/790199864 shutdown_connections 2024-09-17T05:51:52.522 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:52.520+0000 7f9e9989b640 1 -- 172.21.15.150:0/790199864 wait complete. 2024-09-17T05:51:52.524 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:52.523+0000 7f9e9989b640 1 Processor -- start 2024-09-17T05:51:52.524 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:52.523+0000 7f9e9989b640 1 -- start start 2024-09-17T05:51:52.526 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:52.525+0000 7f9e9989b640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9e94071230 0x7f9e9413ac60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:51:52.526 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:52.525+0000 7f9e9989b640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9e9415ce20 0x7f9e940b4ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:51:52.526 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:52.525+0000 7f9e9989b640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9e94148580 0x7f9e940b5530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:51:52.526 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:52.525+0000 7f9e9989b640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f9e940cfbc0 con 0x7f9e9415ce20 2024-09-17T05:51:52.527 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:52.525+0000 7f9e9989b640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f9e940cfa40 con 0x7f9e94071230 2024-09-17T05:51:52.527 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:52.525+0000 7f9e9989b640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f9e940cfd40 con 0x7f9e94148580 2024-09-17T05:51:52.527 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:52.525+0000 7f9e927fc640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9e9415ce20 0x7f9e940b4ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:51:52.527 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:52.525+0000 7f9e927fc640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9e9415ce20 0x7f9e940b4ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:58226/0 (socket says 172.21.15.150:58226) 2024-09-17T05:51:52.527 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:52.525+0000 7f9e927fc640 1 -- 172.21.15.150:0/2320541015 learned_addr learned my addr 172.21.15.150:0/2320541015 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:51:52.527 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:52.525+0000 7f9e92ffd640 1 --2- 172.21.15.150:0/2320541015 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9e94071230 0x7f9e9413ac60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:51:52.527 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:52.525+0000 7f9e927fc640 1 -- 172.21.15.150:0/2320541015 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9e94148580 msgr2=0x7f9e940b5530 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-17T05:51:52.527 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:52.525+0000 7f9e927fc640 1 --2- 172.21.15.150:0/2320541015 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9e94148580 0x7f9e940b5530 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:51:52.527 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:52.525+0000 7f9e927fc640 1 -- 172.21.15.150:0/2320541015 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9e94071230 msgr2=0x7f9e9413ac60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:51:52.527 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:52.525+0000 7f9e927fc640 1 --2- 172.21.15.150:0/2320541015 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9e94071230 0x7f9e9413ac60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:51:52.527 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:52.525+0000 7f9e927fc640 1 -- 172.21.15.150:0/2320541015 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9e9414a620 con 0x7f9e9415ce20 2024-09-17T05:51:52.527 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:52.526+0000 7f9e927fc640 1 --2- 172.21.15.150:0/2320541015 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9e9415ce20 0x7f9e940b4ff0 secure :-1 s=READY pgs=1560 cs=0 l=1 rev1=1 crypto rx=0x7f9e7c009950 tx=0x7f9e7c033c90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:51:52.527 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:52.526+0000 7f9e8bfff640 1 -- 172.21.15.150:0/2320541015 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e7c031d60 con 0x7f9e9415ce20 2024-09-17T05:51:52.528 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:52.526+0000 7f9e9989b640 1 -- 172.21.15.150:0/2320541015 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9e9414a900 con 0x7f9e9415ce20 2024-09-17T05:51:52.528 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:52.526+0000 7f9e8bfff640 1 -- 172.21.15.150:0/2320541015 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9e7c005020 con 0x7f9e9415ce20 2024-09-17T05:51:52.528 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:52.526+0000 7f9e8bfff640 1 -- 172.21.15.150:0/2320541015 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e7c005450 con 0x7f9e9415ce20 2024-09-17T05:51:52.528 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:52.526+0000 7f9e9989b640 1 -- 172.21.15.150:0/2320541015 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9e9414aec0 con 0x7f9e9415ce20 2024-09-17T05:51:52.529 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:52.527+0000 7f9e9989b640 1 -- 172.21.15.150:0/2320541015 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9e78005290 con 0x7f9e9415ce20 2024-09-17T05:51:52.529 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:52.528+0000 7f9e8bfff640 1 -- 172.21.15.150:0/2320541015 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 41) ==== 104144+0+0 (secure 0 0 0) 0x7f9e7c0047a0 con 0x7f9e9415ce20 2024-09-17T05:51:52.530 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:52.529+0000 7f9e8bfff640 1 --2- 172.21.15.150:0/2320541015 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f9e7407a960 0x7f9e7407ce70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:51:52.530 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:52.529+0000 7f9e8bfff640 1 -- 172.21.15.150:0/2320541015 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(115..115 src has 1..115) ==== 5907+0+0 (secure 0 0 0) 0x7f9e7c0baec0 con 0x7f9e9415ce20 2024-09-17T05:51:52.534 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:52.534+0000 7f9e92ffd640 1 --2- 172.21.15.150:0/2320541015 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f9e7407a960 0x7f9e7407ce70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:51:52.535 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:52.534+0000 7f9e8bfff640 1 -- 172.21.15.150:0/2320541015 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f9e7c03f030 con 0x7f9e9415ce20 2024-09-17T05:51:52.539 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:52.538+0000 7f9e92ffd640 1 --2- 172.21.15.150:0/2320541015 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f9e7407a960 0x7f9e7407ce70 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7f9e840015e0 tx=0x7f9e84009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:51:52.846 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:52.845+0000 7f9e9989b640 1 -- 172.21.15.150:0/2320541015 --> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] -- mgr_command(tid 0: {"prefix": "fs clone cancel", "vol_name": "cephfs", "clone_name": "subvol_clone59012", "target": ["mon-mgr", ""]}) -- 0x7f9e78000bc0 con 0x7f9e7407a960 2024-09-17T05:51:52.989 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:52.988+0000 7f9e8bfff640 1 -- 172.21.15.150:0/2320541015 <== mgr.4108 v2:172.21.15.176:6800/3631216395 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f9e78000bc0 con 0x7f9e7407a960 2024-09-17T05:51:52.992 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:52.991+0000 7f9e9989b640 1 -- 172.21.15.150:0/2320541015 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f9e7407a960 msgr2=0x7f9e7407ce70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:51:52.992 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:52.991+0000 7f9e9989b640 1 --2- 172.21.15.150:0/2320541015 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f9e7407a960 0x7f9e7407ce70 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7f9e840015e0 tx=0x7f9e84009040 comp rx=0 tx=0).stop 2024-09-17T05:51:52.992 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:52.991+0000 7f9e9989b640 1 -- 172.21.15.150:0/2320541015 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9e9415ce20 msgr2=0x7f9e940b4ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:51:52.992 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:52.991+0000 7f9e9989b640 1 --2- 172.21.15.150:0/2320541015 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9e9415ce20 0x7f9e940b4ff0 secure :-1 s=READY pgs=1560 cs=0 l=1 rev1=1 crypto rx=0x7f9e7c009950 tx=0x7f9e7c033c90 comp rx=0 tx=0).stop 2024-09-17T05:51:52.992 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:52.991+0000 7f9e9989b640 1 -- 172.21.15.150:0/2320541015 shutdown_connections 2024-09-17T05:51:52.992 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:52.991+0000 7f9e9989b640 1 --2- 172.21.15.150:0/2320541015 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f9e7407a960 0x7f9e7407ce70 unknown :-1 s=CLOSED pgs=664 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:51:52.992 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:52.991+0000 7f9e9989b640 1 --2- 172.21.15.150:0/2320541015 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9e94148580 0x7f9e940b5530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:51:52.992 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:52.991+0000 7f9e9989b640 1 --2- 172.21.15.150:0/2320541015 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9e9415ce20 0x7f9e940b4ff0 unknown :-1 s=CLOSED pgs=1560 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:51:52.992 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:52.991+0000 7f9e9989b640 1 --2- 172.21.15.150:0/2320541015 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9e94071230 0x7f9e9413ac60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:51:52.992 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:52.991+0000 7f9e9989b640 1 -- 172.21.15.150:0/2320541015 >> 172.21.15.150:0/2320541015 conn(0x7f9e94073890 msgr2=0x7f9e9406e190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:51:52.992 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:52.991+0000 7f9e9989b640 1 -- 172.21.15.150:0/2320541015 shutdown_connections 2024-09-17T05:51:52.993 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:52.991+0000 7f9e9989b640 1 -- 172.21.15.150:0/2320541015 wait complete. 2024-09-17T05:51:53.003 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs clone status cephfs subvol_clone43860 2024-09-17T05:51:53.120 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:53.119+0000 7f392f5a9640 1 -- 172.21.15.150:0/3232288952 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f39280b7960 msgr2=0x7f39280af1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:51:53.120 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:53.119+0000 7f392f5a9640 1 --2- 172.21.15.150:0/3232288952 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f39280b7960 0x7f39280af1f0 secure :-1 s=READY pgs=1561 cs=0 l=1 rev1=1 crypto rx=0x7f39240098e0 tx=0x7f392402a490 comp rx=0 tx=0).stop 2024-09-17T05:51:53.120 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:53.119+0000 7f392f5a9640 1 -- 172.21.15.150:0/3232288952 shutdown_connections 2024-09-17T05:51:53.120 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:53.119+0000 7f392f5a9640 1 --2- 172.21.15.150:0/3232288952 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f39280d1190 0x7f39280cd0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:51:53.120 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:53.119+0000 7f392f5a9640 1 --2- 172.21.15.150:0/3232288952 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f39280b7960 0x7f39280af1f0 unknown :-1 s=CLOSED pgs=1561 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:51:53.121 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:53.119+0000 7f392f5a9640 1 -- 172.21.15.150:0/3232288952 >> 172.21.15.150:0/3232288952 conn(0x7f39280cef20 msgr2=0x7f39280cf330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:51:53.121 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:53.119+0000 7f392f5a9640 1 -- 172.21.15.150:0/3232288952 shutdown_connections 2024-09-17T05:51:53.121 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:53.119+0000 7f392f5a9640 1 -- 172.21.15.150:0/3232288952 wait complete. 2024-09-17T05:51:53.121 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:53.121+0000 7f392f5a9640 1 Processor -- start 2024-09-17T05:51:53.121 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:53.121+0000 7f392f5a9640 1 -- start start 2024-09-17T05:51:53.124 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:53.122+0000 7f392f5a9640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f39280b7960 0x7f392815e110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:51:53.124 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:53.122+0000 7f392f5a9640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f39280b7d70 0x7f39281e7df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:51:53.124 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:53.122+0000 7f392f5a9640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f39280d1190 0x7f3928144610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:51:53.125 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:53.122+0000 7f392f5a9640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f39280ced10 con 0x7f39280b7d70 2024-09-17T05:51:53.125 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:53.122+0000 7f392f5a9640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f39280ceb90 con 0x7f39280b7960 2024-09-17T05:51:53.125 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:53.122+0000 7f392f5a9640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f39280af730 con 0x7f39280d1190 2024-09-17T05:51:53.125 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:53.122+0000 7f392cb44640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f39280b7d70 0x7f39281e7df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:51:53.125 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:53.122+0000 7f392cb44640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f39280b7d70 0x7f39281e7df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:58244/0 (socket says 172.21.15.150:58244) 2024-09-17T05:51:53.125 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:53.122+0000 7f392cb44640 1 -- 172.21.15.150:0/1437367635 learned_addr learned my addr 172.21.15.150:0/1437367635 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:51:53.125 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:53.122+0000 7f392db46640 1 --2- 172.21.15.150:0/1437367635 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f39280d1190 0x7f3928144610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:51:53.125 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:53.122+0000 7f392d345640 1 --2- 172.21.15.150:0/1437367635 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f39280b7960 0x7f392815e110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:51:53.125 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:53.123+0000 7f392cb44640 1 -- 172.21.15.150:0/1437367635 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f39280d1190 msgr2=0x7f3928144610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:51:53.125 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:53.123+0000 7f392cb44640 1 --2- 172.21.15.150:0/1437367635 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f39280d1190 0x7f3928144610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:51:53.125 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:53.123+0000 7f392cb44640 1 -- 172.21.15.150:0/1437367635 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f39280b7960 msgr2=0x7f392815e110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:51:53.126 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:53.123+0000 7f392cb44640 1 --2- 172.21.15.150:0/1437367635 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f39280b7960 0x7f392815e110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:51:53.126 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:53.123+0000 7f392cb44640 1 -- 172.21.15.150:0/1437367635 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3928154150 con 0x7f39280b7d70 2024-09-17T05:51:53.126 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:53.123+0000 7f392cb44640 1 --2- 172.21.15.150:0/1437367635 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f39280b7d70 0x7f39281e7df0 secure :-1 s=READY pgs=1562 cs=0 l=1 rev1=1 crypto rx=0x7f391800c370 tx=0x7f391800c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:51:53.126 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:53.123+0000 7f391dffb640 1 -- 172.21.15.150:0/1437367635 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3918017070 con 0x7f39280b7d70 2024-09-17T05:51:53.126 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:53.123+0000 7f391dffb640 1 -- 172.21.15.150:0/1437367635 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f39180053c0 con 0x7f39280b7d70 2024-09-17T05:51:53.126 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:53.123+0000 7f392f5a9640 1 -- 172.21.15.150:0/1437367635 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3928153390 con 0x7f39280b7d70 2024-09-17T05:51:53.126 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:53.123+0000 7f391dffb640 1 -- 172.21.15.150:0/1437367635 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3918003850 con 0x7f39280b7d70 2024-09-17T05:51:53.126 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:53.123+0000 7f392f5a9640 1 -- 172.21.15.150:0/1437367635 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3928153950 con 0x7f39280b7d70 2024-09-17T05:51:53.127 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:53.124+0000 7f392f5a9640 1 -- 172.21.15.150:0/1437367635 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3928153120 con 0x7f39280b7d70 2024-09-17T05:51:53.127 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:53.125+0000 7f391dffb640 1 -- 172.21.15.150:0/1437367635 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 41) ==== 104144+0+0 (secure 0 0 0) 0x7f391801a070 con 0x7f39280b7d70 2024-09-17T05:51:53.127 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:53.125+0000 7f391dffb640 1 --2- 172.21.15.150:0/1437367635 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f390c07a960 0x7f390c07ce70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:51:53.127 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:53.125+0000 7f391dffb640 1 -- 172.21.15.150:0/1437367635 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(115..115 src has 1..115) ==== 5907+0+0 (secure 0 0 0) 0x7f3918098eb0 con 0x7f39280b7d70 2024-09-17T05:51:53.127 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:53.126+0000 7f392d345640 1 --2- 172.21.15.150:0/1437367635 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f390c07a960 0x7f390c07ce70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:51:53.127 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:53.126+0000 7f392d345640 1 --2- 172.21.15.150:0/1437367635 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f390c07a960 0x7f390c07ce70 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7f3924034000 tx=0x7f3924004730 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:51:53.131 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:53.130+0000 7f391dffb640 1 -- 172.21.15.150:0/1437367635 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f3918062830 con 0x7f39280b7d70 2024-09-17T05:51:53.341 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:53.340+0000 7f392f5a9640 1 -- 172.21.15.150:0/1437367635 --> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] -- mgr_command(tid 0: {"prefix": "fs clone status", "vol_name": "cephfs", "clone_name": "subvol_clone43860", "target": ["mon-mgr", ""]}) -- 0x7f392815e660 con 0x7f390c07a960 2024-09-17T05:51:53.349 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:53.348+0000 7f391dffb640 1 -- 172.21.15.150:0/1437367635 <== mgr.4108 v2:172.21.15.176:6800/3631216395 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+243 (secure 0 0 0) 0x7f392815e660 con 0x7f390c07a960 2024-09-17T05:51:53.349 INFO:teuthology.orchestra.run.smithi150.stdout:{ 2024-09-17T05:51:53.349 INFO:teuthology.orchestra.run.smithi150.stdout: "status": { 2024-09-17T05:51:53.349 INFO:teuthology.orchestra.run.smithi150.stdout: "state": "canceled", 2024-09-17T05:51:53.349 INFO:teuthology.orchestra.run.smithi150.stdout: "source": { 2024-09-17T05:51:53.349 INFO:teuthology.orchestra.run.smithi150.stdout: "volume": "cephfs", 2024-09-17T05:51:53.349 INFO:teuthology.orchestra.run.smithi150.stdout: "subvolume": "sv1", 2024-09-17T05:51:53.350 INFO:teuthology.orchestra.run.smithi150.stdout: "snapshot": "ss1" 2024-09-17T05:51:53.350 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-17T05:51:53.350 INFO:teuthology.orchestra.run.smithi150.stdout: "failure": { 2024-09-17T05:51:53.350 INFO:teuthology.orchestra.run.smithi150.stdout: "errno": "4", 2024-09-17T05:51:53.350 INFO:teuthology.orchestra.run.smithi150.stdout: "error_msg": "user interrupted clone operation" 2024-09-17T05:51:53.350 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-09-17T05:51:53.350 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-09-17T05:51:53.350 INFO:teuthology.orchestra.run.smithi150.stdout:} 2024-09-17T05:51:53.351 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:53.350+0000 7f392f5a9640 1 -- 172.21.15.150:0/1437367635 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f390c07a960 msgr2=0x7f390c07ce70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:51:53.352 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:53.350+0000 7f392f5a9640 1 --2- 172.21.15.150:0/1437367635 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f390c07a960 0x7f390c07ce70 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7f3924034000 tx=0x7f3924004730 comp rx=0 tx=0).stop 2024-09-17T05:51:53.352 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:53.350+0000 7f392f5a9640 1 -- 172.21.15.150:0/1437367635 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f39280b7d70 msgr2=0x7f39281e7df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:51:53.352 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:53.350+0000 7f392f5a9640 1 --2- 172.21.15.150:0/1437367635 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f39280b7d70 0x7f39281e7df0 secure :-1 s=READY pgs=1562 cs=0 l=1 rev1=1 crypto rx=0x7f391800c370 tx=0x7f391800c830 comp rx=0 tx=0).stop 2024-09-17T05:51:53.352 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:53.351+0000 7f392f5a9640 1 -- 172.21.15.150:0/1437367635 shutdown_connections 2024-09-17T05:51:53.352 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:53.351+0000 7f392f5a9640 1 --2- 172.21.15.150:0/1437367635 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f390c07a960 0x7f390c07ce70 unknown :-1 s=CLOSED pgs=665 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:51:53.352 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:53.351+0000 7f392f5a9640 1 --2- 172.21.15.150:0/1437367635 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f39280d1190 0x7f3928144610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:51:53.352 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:53.351+0000 7f392f5a9640 1 --2- 172.21.15.150:0/1437367635 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f39280b7d70 0x7f39281e7df0 unknown :-1 s=CLOSED pgs=1562 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:51:53.352 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:53.351+0000 7f392f5a9640 1 --2- 172.21.15.150:0/1437367635 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f39280b7960 0x7f392815e110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:51:53.352 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:53.351+0000 7f392f5a9640 1 -- 172.21.15.150:0/1437367635 >> 172.21.15.150:0/1437367635 conn(0x7f39280cef20 msgr2=0x7f39280b04c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:51:53.352 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:53.351+0000 7f392f5a9640 1 -- 172.21.15.150:0/1437367635 shutdown_connections 2024-09-17T05:51:53.353 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:53.351+0000 7f392f5a9640 1 -- 172.21.15.150:0/1437367635 wait complete. 2024-09-17T05:51:53.364 DEBUG:tasks.cephfs.test_volumes:current clone state = canceled 2024-09-17T05:51:53.364 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs clone status cephfs subvol_clone39571 2024-09-17T05:51:53.481 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:53.480+0000 7fc09d269640 1 -- 172.21.15.150:0/2812704197 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc0980d0730 msgr2=0x7fc0980b6160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:51:53.482 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:53.480+0000 7fc09d269640 1 --2- 172.21.15.150:0/2812704197 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc0980d0730 0x7fc0980b6160 secure :-1 s=READY pgs=1564 cs=0 l=1 rev1=1 crypto rx=0x7fc0980cfd10 tx=0x7fc09002a920 comp rx=0 tx=0).stop 2024-09-17T05:51:53.482 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:53.480+0000 7fc09d269640 1 -- 172.21.15.150:0/2812704197 shutdown_connections 2024-09-17T05:51:53.482 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:53.480+0000 7fc09d269640 1 --2- 172.21.15.150:0/2812704197 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc0980d0730 0x7fc0980b6160 unknown :-1 s=CLOSED pgs=1564 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:51:53.482 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:53.480+0000 7fc09d269640 1 -- 172.21.15.150:0/2812704197 >> 172.21.15.150:0/2812704197 conn(0x7fc09808bfe0 msgr2=0x7fc0980d46e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:51:53.482 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:53.480+0000 7fc09d269640 1 -- 172.21.15.150:0/2812704197 shutdown_connections 2024-09-17T05:51:53.482 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:53.480+0000 7fc09d269640 1 -- 172.21.15.150:0/2812704197 wait complete. 2024-09-17T05:51:53.482 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:53.482+0000 7fc09d269640 1 Processor -- start 2024-09-17T05:51:53.483 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:53.482+0000 7fc09d269640 1 -- start start 2024-09-17T05:51:53.486 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:53.484+0000 7fc09d269640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc09806dea0 0x7fc0980b3c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:51:53.486 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:53.484+0000 7fc09d269640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc0980d0730 0x7fc098158ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:51:53.486 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:53.484+0000 7fc09d269640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc0980d5150 0x7fc0980cc700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:51:53.486 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:53.484+0000 7fc09d269640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7fc09806e430 con 0x7fc0980d0730 2024-09-17T05:51:53.486 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:53.484+0000 7fc09d269640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fc09806e2b0 con 0x7fc0980d5150 2024-09-17T05:51:53.486 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:53.484+0000 7fc09d269640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fc09806e5b0 con 0x7fc09806dea0 2024-09-17T05:51:53.486 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:53.484+0000 7fc08e7fc640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc0980d0730 0x7fc098158ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:51:53.486 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:53.484+0000 7fc08e7fc640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc0980d0730 0x7fc098158ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:58256/0 (socket says 172.21.15.150:58256) 2024-09-17T05:51:53.486 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:53.484+0000 7fc08e7fc640 1 -- 172.21.15.150:0/982374975 learned_addr learned my addr 172.21.15.150:0/982374975 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:51:53.486 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:53.484+0000 7fc0977fe640 1 --2- 172.21.15.150:0/982374975 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc0980d5150 0x7fc0980cc700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:51:53.486 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:53.484+0000 7fc096ffd640 1 --2- 172.21.15.150:0/982374975 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc09806dea0 0x7fc0980b3c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:51:53.486 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:53.484+0000 7fc08e7fc640 1 -- 172.21.15.150:0/982374975 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc09806dea0 msgr2=0x7fc0980b3c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:51:53.487 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:53.484+0000 7fc08e7fc640 1 --2- 172.21.15.150:0/982374975 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc09806dea0 0x7fc0980b3c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:51:53.487 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:53.484+0000 7fc08e7fc640 1 -- 172.21.15.150:0/982374975 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc0980d5150 msgr2=0x7fc0980cc700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:51:53.487 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:53.484+0000 7fc08e7fc640 1 --2- 172.21.15.150:0/982374975 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc0980d5150 0x7fc0980cc700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:51:53.487 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:53.484+0000 7fc08e7fc640 1 -- 172.21.15.150:0/982374975 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc0981e8e60 con 0x7fc0980d0730 2024-09-17T05:51:53.487 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:53.484+0000 7fc08e7fc640 1 --2- 172.21.15.150:0/982374975 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc0980d0730 0x7fc098158ac0 secure :-1 s=READY pgs=1565 cs=0 l=1 rev1=1 crypto rx=0x7fc08000c400 tx=0x7fc08000c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:51:53.487 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:53.484+0000 7fc08ffff640 1 -- 172.21.15.150:0/982374975 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc080017070 con 0x7fc0980d0730 2024-09-17T05:51:53.487 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:53.484+0000 7fc08ffff640 1 -- 172.21.15.150:0/982374975 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc0800053c0 con 0x7fc0980d0730 2024-09-17T05:51:53.487 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:53.484+0000 7fc09d269640 1 -- 172.21.15.150:0/982374975 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc0981e9140 con 0x7fc0980d0730 2024-09-17T05:51:53.487 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:53.484+0000 7fc08ffff640 1 -- 172.21.15.150:0/982374975 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc080003850 con 0x7fc0980d0730 2024-09-17T05:51:53.487 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:53.484+0000 7fc09d269640 1 -- 172.21.15.150:0/982374975 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc0981e9700 con 0x7fc0980d0730 2024-09-17T05:51:53.488 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:53.485+0000 7fc09d269640 1 -- 172.21.15.150:0/982374975 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc0980b6860 con 0x7fc0980d0730 2024-09-17T05:51:53.488 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:53.486+0000 7fc08ffff640 1 -- 172.21.15.150:0/982374975 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 41) ==== 104144+0+0 (secure 0 0 0) 0x7fc08001a070 con 0x7fc0980d0730 2024-09-17T05:51:53.488 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:53.487+0000 7fc08ffff640 1 --2- 172.21.15.150:0/982374975 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fc07807a960 0x7fc07807ce70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:51:53.488 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:53.487+0000 7fc08ffff640 1 -- 172.21.15.150:0/982374975 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(115..115 src has 1..115) ==== 5907+0+0 (secure 0 0 0) 0x7fc080098f50 con 0x7fc0980d0730 2024-09-17T05:51:53.488 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:53.487+0000 7fc096ffd640 1 --2- 172.21.15.150:0/982374975 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fc07807a960 0x7fc07807ce70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:51:53.489 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:53.487+0000 7fc096ffd640 1 --2- 172.21.15.150:0/982374975 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fc07807a960 0x7fc07807ce70 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7fc088001760 tx=0x7fc088009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:51:53.492 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:53.491+0000 7fc08ffff640 1 -- 172.21.15.150:0/982374975 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fc0800628d0 con 0x7fc0980d0730 2024-09-17T05:51:53.702 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:53.701+0000 7fc09d269640 1 -- 172.21.15.150:0/982374975 --> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] -- mgr_command(tid 0: {"prefix": "fs clone status", "vol_name": "cephfs", "clone_name": "subvol_clone39571", "target": ["mon-mgr", ""]}) -- 0x7fc0981e8bf0 con 0x7fc07807a960 2024-09-17T05:51:55.681 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:55.680+0000 7fc08ffff640 1 -- 172.21.15.150:0/982374975 <== mgr.4108 v2:172.21.15.176:6800/3631216395 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+243 (secure 0 0 0) 0x7fc0981e8bf0 con 0x7fc07807a960 2024-09-17T05:51:55.681 INFO:teuthology.orchestra.run.smithi150.stdout:{ 2024-09-17T05:51:55.681 INFO:teuthology.orchestra.run.smithi150.stdout: "status": { 2024-09-17T05:51:55.681 INFO:teuthology.orchestra.run.smithi150.stdout: "state": "canceled", 2024-09-17T05:51:55.681 INFO:teuthology.orchestra.run.smithi150.stdout: "source": { 2024-09-17T05:51:55.681 INFO:teuthology.orchestra.run.smithi150.stdout: "volume": "cephfs", 2024-09-17T05:51:55.682 INFO:teuthology.orchestra.run.smithi150.stdout: "subvolume": "sv1", 2024-09-17T05:51:55.682 INFO:teuthology.orchestra.run.smithi150.stdout: "snapshot": "ss1" 2024-09-17T05:51:55.682 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-17T05:51:55.682 INFO:teuthology.orchestra.run.smithi150.stdout: "failure": { 2024-09-17T05:51:55.682 INFO:teuthology.orchestra.run.smithi150.stdout: "errno": "4", 2024-09-17T05:51:55.682 INFO:teuthology.orchestra.run.smithi150.stdout: "error_msg": "user interrupted clone operation" 2024-09-17T05:51:55.682 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-09-17T05:51:55.682 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-09-17T05:51:55.682 INFO:teuthology.orchestra.run.smithi150.stdout:} 2024-09-17T05:51:55.684 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:55.683+0000 7fc09d269640 1 -- 172.21.15.150:0/982374975 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fc07807a960 msgr2=0x7fc07807ce70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:51:55.684 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:55.683+0000 7fc09d269640 1 --2- 172.21.15.150:0/982374975 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fc07807a960 0x7fc07807ce70 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7fc088001760 tx=0x7fc088009040 comp rx=0 tx=0).stop 2024-09-17T05:51:55.684 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:55.683+0000 7fc09d269640 1 -- 172.21.15.150:0/982374975 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc0980d0730 msgr2=0x7fc098158ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:51:55.685 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:55.683+0000 7fc09d269640 1 --2- 172.21.15.150:0/982374975 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc0980d0730 0x7fc098158ac0 secure :-1 s=READY pgs=1565 cs=0 l=1 rev1=1 crypto rx=0x7fc08000c400 tx=0x7fc08000c8c0 comp rx=0 tx=0).stop 2024-09-17T05:51:55.685 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:55.683+0000 7fc09d269640 1 -- 172.21.15.150:0/982374975 shutdown_connections 2024-09-17T05:51:55.685 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:55.683+0000 7fc09d269640 1 --2- 172.21.15.150:0/982374975 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc0980d5150 0x7fc0980cc700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:51:55.685 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:55.683+0000 7fc09d269640 1 --2- 172.21.15.150:0/982374975 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fc07807a960 0x7fc07807ce70 unknown :-1 s=CLOSED pgs=666 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:51:55.685 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:55.683+0000 7fc09d269640 1 --2- 172.21.15.150:0/982374975 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc0980d0730 0x7fc098158ac0 unknown :-1 s=CLOSED pgs=1565 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:51:55.685 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:55.683+0000 7fc09d269640 1 --2- 172.21.15.150:0/982374975 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc09806dea0 0x7fc0980b3c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:51:55.685 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:55.683+0000 7fc09d269640 1 -- 172.21.15.150:0/982374975 >> 172.21.15.150:0/982374975 conn(0x7fc09808bfe0 msgr2=0x7fc0980b2c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:51:55.685 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:55.683+0000 7fc09d269640 1 -- 172.21.15.150:0/982374975 shutdown_connections 2024-09-17T05:51:55.685 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:55.684+0000 7fc09d269640 1 -- 172.21.15.150:0/982374975 wait complete. 2024-09-17T05:51:55.698 DEBUG:tasks.cephfs.test_volumes:current clone state = canceled 2024-09-17T05:51:55.698 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs clone status cephfs subvol_clone59012 2024-09-17T05:51:55.822 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:55.821+0000 7fab43269640 1 -- 172.21.15.150:0/2845661965 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fab28004800 msgr2=0x7fab28004c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:51:55.822 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:55.821+0000 7fab43269640 1 --2- 172.21.15.150:0/2845661965 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fab28004800 0x7fab28004c10 secure :-1 s=READY pgs=1567 cs=0 l=1 rev1=1 crypto rx=0x7fab2c009b50 tx=0x7fab28005830 comp rx=0 tx=0).stop 2024-09-17T05:51:55.822 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:55.821+0000 7fab41806640 1 -- 172.21.15.150:0/2845661965 reap_dead start 2024-09-17T05:51:55.822 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:55.821+0000 7fab43269640 1 -- 172.21.15.150:0/2845661965 shutdown_connections 2024-09-17T05:51:55.822 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:55.821+0000 7fab43269640 1 -- 172.21.15.150:0/2845661965 >> 172.21.15.150:0/2845661965 conn(0x7fab3c06d1c0 msgr2=0x7fab3c06d5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:51:55.822 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:55.821+0000 7fab43269640 1 -- 172.21.15.150:0/2845661965 shutdown_connections 2024-09-17T05:51:55.822 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:55.821+0000 7fab43269640 1 -- 172.21.15.150:0/2845661965 wait complete. 2024-09-17T05:51:55.823 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:55.823+0000 7fab43269640 1 Processor -- start 2024-09-17T05:51:55.823 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:55.823+0000 7fab43269640 1 -- start start 2024-09-17T05:51:55.826 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:55.824+0000 7fab43269640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fab28004800 0x7fab3c14d0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:51:55.826 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:55.824+0000 7fab43269640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fab3c14fc60 0x7fab3c14df60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:51:55.826 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:55.824+0000 7fab43269640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fab3c06f180 0x7fab3c06f590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:51:55.826 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:55.824+0000 7fab43269640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7fab3c0cf6f0 con 0x7fab3c14fc60 2024-09-17T05:51:55.826 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:55.824+0000 7fab43269640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fab3c0cf570 con 0x7fab28004800 2024-09-17T05:51:55.826 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:55.824+0000 7fab43269640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fab3c0cf870 con 0x7fab3c06f180 2024-09-17T05:51:55.827 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:55.824+0000 7fab40804640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fab3c14fc60 0x7fab3c14df60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:51:55.827 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:55.824+0000 7fab40804640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fab3c14fc60 0x7fab3c14df60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:58262/0 (socket says 172.21.15.150:58262) 2024-09-17T05:51:55.827 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:55.824+0000 7fab40804640 1 -- 172.21.15.150:0/1406946260 learned_addr learned my addr 172.21.15.150:0/1406946260 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:51:55.827 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:55.824+0000 7fab41005640 1 --2- 172.21.15.150:0/1406946260 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fab28004800 0x7fab3c14d0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:51:55.827 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:55.824+0000 7fab41806640 1 --2- 172.21.15.150:0/1406946260 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fab3c06f180 0x7fab3c06f590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:51:55.827 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:55.824+0000 7fab40804640 1 -- 172.21.15.150:0/1406946260 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fab3c06f180 msgr2=0x7fab3c06f590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:51:55.827 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:55.824+0000 7fab40804640 1 --2- 172.21.15.150:0/1406946260 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fab3c06f180 0x7fab3c06f590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:51:55.827 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:55.824+0000 7fab40804640 1 -- 172.21.15.150:0/1406946260 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fab28004800 msgr2=0x7fab3c14d0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:51:55.827 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:55.825+0000 7fab40804640 1 --2- 172.21.15.150:0/1406946260 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fab28004800 0x7fab3c14d0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:51:55.827 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:55.825+0000 7fab40804640 1 -- 172.21.15.150:0/1406946260 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fab3c06fad0 con 0x7fab3c14fc60 2024-09-17T05:51:55.827 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:55.825+0000 7fab41806640 1 --2- 172.21.15.150:0/1406946260 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fab3c06f180 0x7fab3c06f590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:51:55.827 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:55.825+0000 7fab40804640 1 --2- 172.21.15.150:0/1406946260 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fab3c14fc60 0x7fab3c14df60 secure :-1 s=READY pgs=1568 cs=0 l=1 rev1=1 crypto rx=0x7fab2c009c70 tx=0x7fab2c009850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:51:55.827 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:55.825+0000 7fab31ffb640 1 -- 172.21.15.150:0/1406946260 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab2c038050 con 0x7fab3c14fc60 2024-09-17T05:51:55.828 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:55.825+0000 7fab31ffb640 1 -- 172.21.15.150:0/1406946260 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fab2c039040 con 0x7fab3c14fc60 2024-09-17T05:51:55.828 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:55.825+0000 7fab43269640 1 -- 172.21.15.150:0/1406946260 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fab3c1f9f20 con 0x7fab3c14fc60 2024-09-17T05:51:55.828 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:55.825+0000 7fab31ffb640 1 -- 172.21.15.150:0/1406946260 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab2c033e40 con 0x7fab3c14fc60 2024-09-17T05:51:55.828 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:55.825+0000 7fab43269640 1 -- 172.21.15.150:0/1406946260 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fab3c1fa4c0 con 0x7fab3c14fc60 2024-09-17T05:51:55.829 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:55.826+0000 7fab43269640 1 -- 172.21.15.150:0/1406946260 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fab3c14d740 con 0x7fab3c14fc60 2024-09-17T05:51:55.829 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:55.827+0000 7fab31ffb640 1 -- 172.21.15.150:0/1406946260 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 41) ==== 104144+0+0 (secure 0 0 0) 0x7fab2c02b8c0 con 0x7fab3c14fc60 2024-09-17T05:51:55.829 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:55.827+0000 7fab31ffb640 1 --2- 172.21.15.150:0/1406946260 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fab2007a990 0x7fab2007cea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:51:55.829 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:55.827+0000 7fab31ffb640 1 -- 172.21.15.150:0/1406946260 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(115..115 src has 1..115) ==== 5907+0+0 (secure 0 0 0) 0x7fab2c0bae90 con 0x7fab3c14fc60 2024-09-17T05:51:55.829 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:55.828+0000 7fab41005640 1 --2- 172.21.15.150:0/1406946260 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fab2007a990 0x7fab2007cea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:51:55.829 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:55.828+0000 7fab41005640 1 --2- 172.21.15.150:0/1406946260 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fab2007a990 0x7fab2007cea0 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7fab38005e00 tx=0x7fab38005f90 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:51:55.832 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:55.832+0000 7fab31ffb640 1 -- 172.21.15.150:0/1406946260 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fab3c06fad0 con 0x7fab3c14fc60 2024-09-17T05:51:56.043 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:51:56.043+0000 7fab43269640 1 -- 172.21.15.150:0/1406946260 --> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] -- mgr_command(tid 0: {"prefix": "fs clone status", "vol_name": "cephfs", "clone_name": "subvol_clone59012", "target": ["mon-mgr", ""]}) -- 0x7fab3c073630 con 0x7fab2007a990 2024-09-17T05:51:56.797 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-17T05:51:56.800 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-17T05:52:00.677 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:00.676+0000 7fab31ffb640 1 -- 172.21.15.150:0/1406946260 <== mgr.4108 v2:172.21.15.176:6800/3631216395 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+243 (secure 0 0 0) 0x7fab3c073630 con 0x7fab2007a990 2024-09-17T05:52:00.677 INFO:teuthology.orchestra.run.smithi150.stdout:{ 2024-09-17T05:52:00.677 INFO:teuthology.orchestra.run.smithi150.stdout: "status": { 2024-09-17T05:52:00.677 INFO:teuthology.orchestra.run.smithi150.stdout: "state": "canceled", 2024-09-17T05:52:00.677 INFO:teuthology.orchestra.run.smithi150.stdout: "source": { 2024-09-17T05:52:00.677 INFO:teuthology.orchestra.run.smithi150.stdout: "volume": "cephfs", 2024-09-17T05:52:00.677 INFO:teuthology.orchestra.run.smithi150.stdout: "subvolume": "sv1", 2024-09-17T05:52:00.677 INFO:teuthology.orchestra.run.smithi150.stdout: "snapshot": "ss1" 2024-09-17T05:52:00.678 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-17T05:52:00.678 INFO:teuthology.orchestra.run.smithi150.stdout: "failure": { 2024-09-17T05:52:00.678 INFO:teuthology.orchestra.run.smithi150.stdout: "errno": "4", 2024-09-17T05:52:00.678 INFO:teuthology.orchestra.run.smithi150.stdout: "error_msg": "user interrupted clone operation" 2024-09-17T05:52:00.678 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-09-17T05:52:00.678 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-09-17T05:52:00.678 INFO:teuthology.orchestra.run.smithi150.stdout:} 2024-09-17T05:52:00.680 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:00.679+0000 7fab43269640 1 -- 172.21.15.150:0/1406946260 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fab2007a990 msgr2=0x7fab2007cea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:52:00.680 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:00.679+0000 7fab43269640 1 --2- 172.21.15.150:0/1406946260 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fab2007a990 0x7fab2007cea0 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7fab38005e00 tx=0x7fab38005f90 comp rx=0 tx=0).stop 2024-09-17T05:52:00.680 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:00.679+0000 7fab43269640 1 -- 172.21.15.150:0/1406946260 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fab3c14fc60 msgr2=0x7fab3c14df60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:52:00.680 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:00.679+0000 7fab43269640 1 --2- 172.21.15.150:0/1406946260 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fab3c14fc60 0x7fab3c14df60 secure :-1 s=READY pgs=1568 cs=0 l=1 rev1=1 crypto rx=0x7fab2c009c70 tx=0x7fab2c009850 comp rx=0 tx=0).stop 2024-09-17T05:52:00.680 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:00.679+0000 7fab43269640 1 -- 172.21.15.150:0/1406946260 shutdown_connections 2024-09-17T05:52:00.680 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:00.679+0000 7fab43269640 1 --2- 172.21.15.150:0/1406946260 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fab2007a990 0x7fab2007cea0 unknown :-1 s=CLOSED pgs=667 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:52:00.680 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:00.679+0000 7fab43269640 1 --2- 172.21.15.150:0/1406946260 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fab3c06f180 0x7fab3c06f590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:52:00.681 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:00.679+0000 7fab43269640 1 --2- 172.21.15.150:0/1406946260 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fab3c14fc60 0x7fab3c14df60 unknown :-1 s=CLOSED pgs=1568 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:52:00.681 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:00.679+0000 7fab43269640 1 --2- 172.21.15.150:0/1406946260 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fab28004800 0x7fab3c14d0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:52:00.681 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:00.679+0000 7fab43269640 1 -- 172.21.15.150:0/1406946260 >> 172.21.15.150:0/1406946260 conn(0x7fab3c06d1c0 msgr2=0x7fab3c0b3480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:52:00.681 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:00.679+0000 7fab43269640 1 -- 172.21.15.150:0/1406946260 shutdown_connections 2024-09-17T05:52:00.681 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:00.679+0000 7fab43269640 1 -- 172.21.15.150:0/1406946260 wait complete. 2024-09-17T05:52:00.692 DEBUG:tasks.cephfs.test_volumes:current clone state = canceled 2024-09-17T05:52:00.692 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format json-pretty 2024-09-17T05:52:00.808 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:00.806+0000 7f188a070640 1 -- 172.21.15.150:0/393790430 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f188415d760 msgr2=0x7f18841535c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:52:00.808 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:00.806+0000 7f188a070640 1 --2- 172.21.15.150:0/393790430 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f188415d760 0x7f18841535c0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f1874005fd0 tx=0x7f187402a540 comp rx=0 tx=0).stop 2024-09-17T05:52:00.808 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:00.807+0000 7f188a070640 1 -- 172.21.15.150:0/393790430 shutdown_connections 2024-09-17T05:52:00.808 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:00.807+0000 7f188a070640 1 --2- 172.21.15.150:0/393790430 >> v2:172.21.15.176:3300/0 conn(0x7f18840b3550 0x7f18840b3960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:52:00.808 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:00.807+0000 7f188a070640 1 --2- 172.21.15.150:0/393790430 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f188415d760 0x7f18841535c0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:52:00.808 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:00.807+0000 7f188a070640 1 -- 172.21.15.150:0/393790430 >> 172.21.15.150:0/393790430 conn(0x7f188406d730 msgr2=0x7f18840b1e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:52:00.808 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:00.807+0000 7f188a070640 1 -- 172.21.15.150:0/393790430 shutdown_connections 2024-09-17T05:52:00.809 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:00.807+0000 7f188a070640 1 -- 172.21.15.150:0/393790430 wait complete. 2024-09-17T05:52:00.809 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:00.808+0000 7f188a070640 1 Processor -- start 2024-09-17T05:52:00.809 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:00.808+0000 7f188a070640 1 -- start start 2024-09-17T05:52:00.812 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:00.810+0000 7f188a070640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f18840ad0e0 0x7f18841f6430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:52:00.812 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:00.810+0000 7f188a070640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f18840b3550 0x7f1884155aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:52:00.812 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:00.810+0000 7f188a070640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f188415d760 0x7f1884155fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:52:00.812 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:00.810+0000 7f188a070640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f18840b4da0 con 0x7f18840b3550 2024-09-17T05:52:00.812 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:00.810+0000 7f188a070640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f18840b4c20 con 0x7f188415d760 2024-09-17T05:52:00.812 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:00.810+0000 7f188a070640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f18840b3ea0 con 0x7f18840ad0e0 2024-09-17T05:52:00.812 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:00.810+0000 7f187bfff640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f18840b3550 0x7f1884155aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:52:00.812 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:00.810+0000 7f187bfff640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f18840b3550 0x7f1884155aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:55682/0 (socket says 172.21.15.150:55682) 2024-09-17T05:52:00.812 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:00.810+0000 7f187bfff640 1 -- 172.21.15.150:0/389591022 learned_addr learned my addr 172.21.15.150:0/389591022 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:52:00.812 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:00.810+0000 7f1883fff640 1 --2- 172.21.15.150:0/389591022 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f188415d760 0x7f1884155fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:52:00.812 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:00.810+0000 7f18837fe640 1 --2- 172.21.15.150:0/389591022 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f18840ad0e0 0x7f18841f6430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:52:00.813 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:00.810+0000 7f187bfff640 1 -- 172.21.15.150:0/389591022 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f18840ad0e0 msgr2=0x7f18841f6430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:52:00.813 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:00.810+0000 7f187bfff640 1 --2- 172.21.15.150:0/389591022 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f18840ad0e0 0x7f18841f6430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:52:00.813 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:00.810+0000 7f187bfff640 1 -- 172.21.15.150:0/389591022 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f188415d760 msgr2=0x7f1884155fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:52:00.813 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:00.810+0000 7f187bfff640 1 --2- 172.21.15.150:0/389591022 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f188415d760 0x7f1884155fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:52:00.813 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:00.810+0000 7f187bfff640 1 -- 172.21.15.150:0/389591022 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f188414ab90 con 0x7f18840b3550 2024-09-17T05:52:00.813 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:00.810+0000 7f187bfff640 1 --2- 172.21.15.150:0/389591022 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f18840b3550 0x7f1884155aa0 secure :-1 s=READY pgs=1569 cs=0 l=1 rev1=1 crypto rx=0x7f186c001eb0 tx=0x7f186c00c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:52:00.813 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:00.811+0000 7f1880ff9640 1 -- 172.21.15.150:0/389591022 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f186c017070 con 0x7f18840b3550 2024-09-17T05:52:00.813 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:00.811+0000 7f1880ff9640 1 -- 172.21.15.150:0/389591022 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f186c0053c0 con 0x7f18840b3550 2024-09-17T05:52:00.813 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:00.811+0000 7f188a070640 1 -- 172.21.15.150:0/389591022 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1884154fc0 con 0x7f18840b3550 2024-09-17T05:52:00.813 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:00.811+0000 7f1880ff9640 1 -- 172.21.15.150:0/389591022 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f186c003830 con 0x7f18840b3550 2024-09-17T05:52:00.813 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:00.811+0000 7f188a070640 1 -- 172.21.15.150:0/389591022 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1884155580 con 0x7f18840b3550 2024-09-17T05:52:00.814 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:00.812+0000 7f188a070640 1 -- 172.21.15.150:0/389591022 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f18840b4330 con 0x7f18840b3550 2024-09-17T05:52:00.814 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:00.812+0000 7f1880ff9640 1 -- 172.21.15.150:0/389591022 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 41) ==== 104144+0+0 (secure 0 0 0) 0x7f186c01a070 con 0x7f18840b3550 2024-09-17T05:52:00.814 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:00.813+0000 7f1880ff9640 1 --2- 172.21.15.150:0/389591022 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f186407a960 0x7f186407ce70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:52:00.814 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:00.813+0000 7f1880ff9640 1 -- 172.21.15.150:0/389591022 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(115..115 src has 1..115) ==== 5907+0+0 (secure 0 0 0) 0x7f186c099010 con 0x7f18840b3550 2024-09-17T05:52:00.814 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:00.813+0000 7f18837fe640 1 --2- 172.21.15.150:0/389591022 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f186407a960 0x7f186407ce70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:52:00.815 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:00.814+0000 7f18837fe640 1 --2- 172.21.15.150:0/389591022 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f186407a960 0x7f186407ce70 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7f1874033000 tx=0x7f1874004730 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:52:00.818 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:00.817+0000 7f1880ff9640 1 -- 172.21.15.150:0/389591022 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f186c062fe0 con 0x7f18840b3550 2024-09-17T05:52:01.061 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:01.061+0000 7f188a070640 1 -- 172.21.15.150:0/389591022 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) -- 0x7f1884148880 con 0x7f18840b3550 2024-09-17T05:52:01.062 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:01.061+0000 7f1880ff9640 1 -- 172.21.15.150:0/389591022 <== mon.0 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) ==== 79+0+1921 (secure 0 0 0) 0x7f186c0628e0 con 0x7f18840b3550 2024-09-17T05:52:01.062 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-09-17T05:52:01.062 INFO:teuthology.orchestra.run.smithi150.stdout:{ 2024-09-17T05:52:01.062 INFO:teuthology.orchestra.run.smithi150.stdout: "fsid": "9f2e05e9-d629-47b3-b26b-1360655b7d20", 2024-09-17T05:52:01.062 INFO:teuthology.orchestra.run.smithi150.stdout: "health": { 2024-09-17T05:52:01.062 INFO:teuthology.orchestra.run.smithi150.stdout: "status": "HEALTH_OK", 2024-09-17T05:52:01.062 INFO:teuthology.orchestra.run.smithi150.stdout: "checks": {}, 2024-09-17T05:52:01.062 INFO:teuthology.orchestra.run.smithi150.stdout: "mutes": [] 2024-09-17T05:52:01.062 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-17T05:52:01.062 INFO:teuthology.orchestra.run.smithi150.stdout: "election_epoch": 4, 2024-09-17T05:52:01.062 INFO:teuthology.orchestra.run.smithi150.stdout: "quorum": [ 2024-09-17T05:52:01.063 INFO:teuthology.orchestra.run.smithi150.stdout: 0, 2024-09-17T05:52:01.063 INFO:teuthology.orchestra.run.smithi150.stdout: 1, 2024-09-17T05:52:01.063 INFO:teuthology.orchestra.run.smithi150.stdout: 2 2024-09-17T05:52:01.063 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2024-09-17T05:52:01.063 INFO:teuthology.orchestra.run.smithi150.stdout: "quorum_names": [ 2024-09-17T05:52:01.063 INFO:teuthology.orchestra.run.smithi150.stdout: "a", 2024-09-17T05:52:01.063 INFO:teuthology.orchestra.run.smithi150.stdout: "b", 2024-09-17T05:52:01.063 INFO:teuthology.orchestra.run.smithi150.stdout: "c" 2024-09-17T05:52:01.063 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2024-09-17T05:52:01.063 INFO:teuthology.orchestra.run.smithi150.stdout: "quorum_age": 628, 2024-09-17T05:52:01.063 INFO:teuthology.orchestra.run.smithi150.stdout: "monmap": { 2024-09-17T05:52:01.063 INFO:teuthology.orchestra.run.smithi150.stdout: "epoch": 1, 2024-09-17T05:52:01.063 INFO:teuthology.orchestra.run.smithi150.stdout: "min_mon_release_name": "squid", 2024-09-17T05:52:01.063 INFO:teuthology.orchestra.run.smithi150.stdout: "num_mons": 3 2024-09-17T05:52:01.064 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-17T05:52:01.064 INFO:teuthology.orchestra.run.smithi150.stdout: "osdmap": { 2024-09-17T05:52:01.064 INFO:teuthology.orchestra.run.smithi150.stdout: "epoch": 115, 2024-09-17T05:52:01.064 INFO:teuthology.orchestra.run.smithi150.stdout: "num_osds": 8, 2024-09-17T05:52:01.064 INFO:teuthology.orchestra.run.smithi150.stdout: "num_up_osds": 8, 2024-09-17T05:52:01.064 INFO:teuthology.orchestra.run.smithi150.stdout: "osd_up_since": 1726551706, 2024-09-17T05:52:01.064 INFO:teuthology.orchestra.run.smithi150.stdout: "num_in_osds": 8, 2024-09-17T05:52:01.064 INFO:teuthology.orchestra.run.smithi150.stdout: "osd_in_since": 1726551696, 2024-09-17T05:52:01.064 INFO:teuthology.orchestra.run.smithi150.stdout: "num_remapped_pgs": 0 2024-09-17T05:52:01.064 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-17T05:52:01.064 INFO:teuthology.orchestra.run.smithi150.stdout: "pgmap": { 2024-09-17T05:52:01.064 INFO:teuthology.orchestra.run.smithi150.stdout: "pgs_by_state": [ 2024-09-17T05:52:01.064 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-09-17T05:52:01.064 INFO:teuthology.orchestra.run.smithi150.stdout: "state_name": "active+clean", 2024-09-17T05:52:01.065 INFO:teuthology.orchestra.run.smithi150.stdout: "count": 97 2024-09-17T05:52:01.065 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-09-17T05:52:01.065 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2024-09-17T05:52:01.065 INFO:teuthology.orchestra.run.smithi150.stdout: "num_pgs": 97, 2024-09-17T05:52:01.065 INFO:teuthology.orchestra.run.smithi150.stdout: "num_pools": 3, 2024-09-17T05:52:01.065 INFO:teuthology.orchestra.run.smithi150.stdout: "num_objects": 1700, 2024-09-17T05:52:01.065 INFO:teuthology.orchestra.run.smithi150.stdout: "data_bytes": 6988910751, 2024-09-17T05:52:01.065 INFO:teuthology.orchestra.run.smithi150.stdout: "bytes_used": 15024779264, 2024-09-17T05:52:01.065 INFO:teuthology.orchestra.run.smithi150.stdout: "bytes_avail": 758069334016, 2024-09-17T05:52:01.065 INFO:teuthology.orchestra.run.smithi150.stdout: "bytes_total": 773094113280, 2024-09-17T05:52:01.065 INFO:teuthology.orchestra.run.smithi150.stdout: "read_bytes_sec": 320051077, 2024-09-17T05:52:01.065 INFO:teuthology.orchestra.run.smithi150.stdout: "write_bytes_sec": 313803382, 2024-09-17T05:52:01.065 INFO:teuthology.orchestra.run.smithi150.stdout: "read_op_per_sec": 79, 2024-09-17T05:52:01.066 INFO:teuthology.orchestra.run.smithi150.stdout: "write_op_per_sec": 89 2024-09-17T05:52:01.066 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-17T05:52:01.066 INFO:teuthology.orchestra.run.smithi150.stdout: "fsmap": { 2024-09-17T05:52:01.066 INFO:teuthology.orchestra.run.smithi150.stdout: "epoch": 71, 2024-09-17T05:52:01.066 INFO:teuthology.orchestra.run.smithi150.stdout: "btime": "2024-09-17T05:51:27:572576+0000", 2024-09-17T05:52:01.066 INFO:teuthology.orchestra.run.smithi150.stdout: "id": 8, 2024-09-17T05:52:01.066 INFO:teuthology.orchestra.run.smithi150.stdout: "up": 1, 2024-09-17T05:52:01.066 INFO:teuthology.orchestra.run.smithi150.stdout: "in": 1, 2024-09-17T05:52:01.066 INFO:teuthology.orchestra.run.smithi150.stdout: "max": 1, 2024-09-17T05:52:01.066 INFO:teuthology.orchestra.run.smithi150.stdout: "by_rank": [ 2024-09-17T05:52:01.067 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-09-17T05:52:01.067 INFO:teuthology.orchestra.run.smithi150.stdout: "filesystem_id": 8, 2024-09-17T05:52:01.067 INFO:teuthology.orchestra.run.smithi150.stdout: "rank": 0, 2024-09-17T05:52:01.067 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "c", 2024-09-17T05:52:01.067 INFO:teuthology.orchestra.run.smithi150.stdout: "status": "up:active", 2024-09-17T05:52:01.067 INFO:teuthology.orchestra.run.smithi150.stdout: "gid": 8571 2024-09-17T05:52:01.067 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-09-17T05:52:01.067 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2024-09-17T05:52:01.067 INFO:teuthology.orchestra.run.smithi150.stdout: "up:standby": 3 2024-09-17T05:52:01.067 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-17T05:52:01.067 INFO:teuthology.orchestra.run.smithi150.stdout: "mgrmap": { 2024-09-17T05:52:01.067 INFO:teuthology.orchestra.run.smithi150.stdout: "available": true, 2024-09-17T05:52:01.067 INFO:teuthology.orchestra.run.smithi150.stdout: "num_standbys": 1, 2024-09-17T05:52:01.068 INFO:teuthology.orchestra.run.smithi150.stdout: "modules": [ 2024-09-17T05:52:01.068 INFO:teuthology.orchestra.run.smithi150.stdout: "iostat", 2024-09-17T05:52:01.068 INFO:teuthology.orchestra.run.smithi150.stdout: "nfs", 2024-09-17T05:52:01.068 INFO:teuthology.orchestra.run.smithi150.stdout: "restful" 2024-09-17T05:52:01.068 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2024-09-17T05:52:01.068 INFO:teuthology.orchestra.run.smithi150.stdout: "services": {} 2024-09-17T05:52:01.068 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-17T05:52:01.068 INFO:teuthology.orchestra.run.smithi150.stdout: "servicemap": { 2024-09-17T05:52:01.068 INFO:teuthology.orchestra.run.smithi150.stdout: "epoch": 17, 2024-09-17T05:52:01.068 INFO:teuthology.orchestra.run.smithi150.stdout: "modified": "2024-09-17T05:49:15.004587+0000", 2024-09-17T05:52:01.068 INFO:teuthology.orchestra.run.smithi150.stdout: "services": {} 2024-09-17T05:52:01.068 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-17T05:52:01.068 INFO:teuthology.orchestra.run.smithi150.stdout: "progress_events": {} 2024-09-17T05:52:01.069 INFO:teuthology.orchestra.run.smithi150.stdout:} 2024-09-17T05:52:01.069 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:01.063+0000 7f188a070640 1 -- 172.21.15.150:0/389591022 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f186407a960 msgr2=0x7f186407ce70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:52:01.069 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:01.063+0000 7f188a070640 1 --2- 172.21.15.150:0/389591022 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f186407a960 0x7f186407ce70 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7f1874033000 tx=0x7f1874004730 comp rx=0 tx=0).stop 2024-09-17T05:52:01.069 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:01.063+0000 7f188a070640 1 -- 172.21.15.150:0/389591022 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f18840b3550 msgr2=0x7f1884155aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:52:01.070 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:01.063+0000 7f188a070640 1 --2- 172.21.15.150:0/389591022 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f18840b3550 0x7f1884155aa0 secure :-1 s=READY pgs=1569 cs=0 l=1 rev1=1 crypto rx=0x7f186c001eb0 tx=0x7f186c00c890 comp rx=0 tx=0).stop 2024-09-17T05:52:01.070 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:01.063+0000 7f188a070640 1 -- 172.21.15.150:0/389591022 shutdown_connections 2024-09-17T05:52:01.070 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:01.063+0000 7f188a070640 1 --2- 172.21.15.150:0/389591022 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f188415d760 0x7f1884155fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:52:01.070 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:01.063+0000 7f188a070640 1 --2- 172.21.15.150:0/389591022 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f186407a960 0x7f186407ce70 unknown :-1 s=CLOSED pgs=668 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:52:01.070 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:01.063+0000 7f188a070640 1 --2- 172.21.15.150:0/389591022 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f18840b3550 0x7f1884155aa0 unknown :-1 s=CLOSED pgs=1569 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:52:01.070 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:01.063+0000 7f188a070640 1 --2- 172.21.15.150:0/389591022 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f18840ad0e0 0x7f18841f6430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:52:01.070 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:01.063+0000 7f188a070640 1 -- 172.21.15.150:0/389591022 >> 172.21.15.150:0/389591022 conn(0x7f188406d730 msgr2=0x7f188415dec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:52:01.070 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:01.063+0000 7f188a070640 1 -- 172.21.15.150:0/389591022 shutdown_connections 2024-09-17T05:52:01.070 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:01.064+0000 7f188a070640 1 -- 172.21.15.150:0/389591022 wait complete. 2024-09-17T05:52:01.076 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:52:01.076 DEBUG:teuthology.orchestra.run.smithi150:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls -lh volumes/_nogroup/subvol_clone43860/fbf9550d-76fa-40ec-b469-433bba38ec25 2024-09-17T05:52:01.076 DEBUG:teuthology.orchestra.run.smithi150:> ) 2024-09-17T05:52:01.093 DEBUG:teuthology.orchestra.run:got remote process result: 2 2024-09-17T05:52:01.093 INFO:teuthology.orchestra.run.smithi150.stderr:ls: cannot access 'volumes/_nogroup/subvol_clone43860/fbf9550d-76fa-40ec-b469-433bba38ec25': No such file or directory 2024-09-17T05:52:01.094 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume ls 2024-09-17T05:52:01.249 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:01.248+0000 7f3b27669640 1 -- 172.21.15.150:0/1782250872 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3b20160f60 msgr2=0x7f3b200cd0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:52:01.249 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:01.248+0000 7f3b27669640 1 --2- 172.21.15.150:0/1782250872 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3b20160f60 0x7f3b200cd0f0 secure :-1 s=READY pgs=1570 cs=0 l=1 rev1=1 crypto rx=0x7f3b20069f20 tx=0x7f3b1802aa30 comp rx=0 tx=0).stop 2024-09-17T05:52:01.249 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:01.248+0000 7f3b27669640 1 -- 172.21.15.150:0/1782250872 shutdown_connections 2024-09-17T05:52:01.249 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:01.248+0000 7f3b27669640 1 --2- 172.21.15.150:0/1782250872 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3b20160f60 0x7f3b200cd0f0 unknown :-1 s=CLOSED pgs=1570 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:52:01.249 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:01.248+0000 7f3b27669640 1 --2- 172.21.15.150:0/1782250872 >> v2:172.21.15.176:3300/0 conn(0x7f3b200cea50 0x7f3b200d0270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:52:01.249 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:01.248+0000 7f3b27669640 1 -- 172.21.15.150:0/1782250872 >> 172.21.15.150:0/1782250872 conn(0x7f3b200cee80 msgr2=0x7f3b200cf290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:52:01.249 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:01.248+0000 7f3b27669640 1 -- 172.21.15.150:0/1782250872 shutdown_connections 2024-09-17T05:52:01.250 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:01.248+0000 7f3b27669640 1 -- 172.21.15.150:0/1782250872 wait complete. 2024-09-17T05:52:01.251 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:01.250+0000 7f3b27669640 1 Processor -- start 2024-09-17T05:52:01.251 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:01.250+0000 7f3b27669640 1 -- start start 2024-09-17T05:52:01.253 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:01.251+0000 7f3b27669640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3b200c5a90 0x7f3b201f2a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:52:01.254 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:01.251+0000 7f3b27669640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3b200cea50 0x7f3b2006dee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:52:01.254 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:01.251+0000 7f3b27669640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3b20160f60 0x7f3b200c6720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:52:01.254 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:01.251+0000 7f3b27669640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f3b201614f0 con 0x7f3b200cea50 2024-09-17T05:52:01.254 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:01.251+0000 7f3b27669640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f3b20161370 con 0x7f3b20160f60 2024-09-17T05:52:01.254 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:01.251+0000 7f3b27669640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f3b20161670 con 0x7f3b200c5a90 2024-09-17T05:52:01.254 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:01.251+0000 7f3b24c04640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3b200cea50 0x7f3b2006dee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:52:01.254 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:01.251+0000 7f3b24c04640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3b200cea50 0x7f3b2006dee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:55696/0 (socket says 172.21.15.150:55696) 2024-09-17T05:52:01.254 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:01.251+0000 7f3b24c04640 1 -- 172.21.15.150:0/2224490471 learned_addr learned my addr 172.21.15.150:0/2224490471 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:52:01.254 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:01.251+0000 7f3b24c04640 1 -- 172.21.15.150:0/2224490471 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3b200c5a90 msgr2=0x7f3b201f2a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:52:01.254 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:01.251+0000 7f3b24c04640 1 --2- 172.21.15.150:0/2224490471 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3b200c5a90 0x7f3b201f2a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:52:01.254 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:01.251+0000 7f3b25c06640 1 --2- 172.21.15.150:0/2224490471 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3b20160f60 0x7f3b200c6720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:52:01.254 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:01.251+0000 7f3b24c04640 1 -- 172.21.15.150:0/2224490471 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3b20160f60 msgr2=0x7f3b200c6720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:52:01.255 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:01.251+0000 7f3b24c04640 1 --2- 172.21.15.150:0/2224490471 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3b20160f60 0x7f3b200c6720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:52:01.255 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:01.251+0000 7f3b24c04640 1 -- 172.21.15.150:0/2224490471 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3b201f5a60 con 0x7f3b200cea50 2024-09-17T05:52:01.255 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:01.252+0000 7f3b24c04640 1 --2- 172.21.15.150:0/2224490471 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3b200cea50 0x7f3b2006dee0 secure :-1 s=READY pgs=1571 cs=0 l=1 rev1=1 crypto rx=0x7f3b1000b3c0 tx=0x7f3b1000b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:52:01.255 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:01.252+0000 7f3b15ffb640 1 -- 172.21.15.150:0/2224490471 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b10015020 con 0x7f3b200cea50 2024-09-17T05:52:01.255 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:01.252+0000 7f3b15ffb640 1 -- 172.21.15.150:0/2224490471 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f3b10011920 con 0x7f3b200cea50 2024-09-17T05:52:01.255 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:01.252+0000 7f3b27669640 1 -- 172.21.15.150:0/2224490471 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3b2006ea30 con 0x7f3b200cea50 2024-09-17T05:52:01.255 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:01.252+0000 7f3b15ffb640 1 -- 172.21.15.150:0/2224490471 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b10011d50 con 0x7f3b200cea50 2024-09-17T05:52:01.255 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:01.252+0000 7f3b27669640 1 -- 172.21.15.150:0/2224490471 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3b2006eff0 con 0x7f3b200cea50 2024-09-17T05:52:01.255 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:01.253+0000 7f3b27669640 1 -- 172.21.15.150:0/2224490471 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3b200d0270 con 0x7f3b200cea50 2024-09-17T05:52:01.256 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:01.254+0000 7f3b15ffb640 1 -- 172.21.15.150:0/2224490471 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 41) ==== 104144+0+0 (secure 0 0 0) 0x7f3b10018020 con 0x7f3b200cea50 2024-09-17T05:52:01.256 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:01.254+0000 7f3b15ffb640 1 --2- 172.21.15.150:0/2224490471 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f3b0407a960 0x7f3b0407ce70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:52:01.256 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:01.254+0000 7f3b15ffb640 1 -- 172.21.15.150:0/2224490471 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(115..115 src has 1..115) ==== 5907+0+0 (secure 0 0 0) 0x7f3b10099b60 con 0x7f3b200cea50 2024-09-17T05:52:01.256 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:01.254+0000 7f3b25405640 1 --2- 172.21.15.150:0/2224490471 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f3b0407a960 0x7f3b0407ce70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:52:01.256 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:01.255+0000 7f3b25405640 1 --2- 172.21.15.150:0/2224490471 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f3b0407a960 0x7f3b0407ce70 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7f3b1c00a840 tx=0x7f3b1c005b40 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:52:01.259 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:01.259+0000 7f3b15ffb640 1 -- 172.21.15.150:0/2224490471 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f3b1001f020 con 0x7f3b200cea50 2024-09-17T05:52:01.456 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:01.455+0000 7f3b27669640 1 -- 172.21.15.150:0/2224490471 --> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] -- mgr_command(tid 0: {"prefix": "fs volume ls", "target": ["mon-mgr", ""]}) -- 0x7f3b20071ff0 con 0x7f3b0407a960 2024-09-17T05:52:01.458 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:01.457+0000 7f3b15ffb640 1 -- 172.21.15.150:0/2224490471 <== mgr.4108 v2:172.21.15.176:6800/3631216395 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+41 (secure 0 0 0) 0x7f3b20071ff0 con 0x7f3b0407a960 2024-09-17T05:52:01.458 INFO:teuthology.orchestra.run.smithi150.stdout:[ 2024-09-17T05:52:01.458 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-09-17T05:52:01.458 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "cephfs" 2024-09-17T05:52:01.458 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-09-17T05:52:01.458 INFO:teuthology.orchestra.run.smithi150.stdout:] 2024-09-17T05:52:01.460 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:01.459+0000 7f3b27669640 1 -- 172.21.15.150:0/2224490471 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f3b0407a960 msgr2=0x7f3b0407ce70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:52:01.460 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:01.459+0000 7f3b27669640 1 --2- 172.21.15.150:0/2224490471 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f3b0407a960 0x7f3b0407ce70 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7f3b1c00a840 tx=0x7f3b1c005b40 comp rx=0 tx=0).stop 2024-09-17T05:52:01.460 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:01.459+0000 7f3b27669640 1 -- 172.21.15.150:0/2224490471 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3b200cea50 msgr2=0x7f3b2006dee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:52:01.460 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:01.459+0000 7f3b27669640 1 --2- 172.21.15.150:0/2224490471 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3b200cea50 0x7f3b2006dee0 secure :-1 s=READY pgs=1571 cs=0 l=1 rev1=1 crypto rx=0x7f3b1000b3c0 tx=0x7f3b1000b880 comp rx=0 tx=0).stop 2024-09-17T05:52:01.461 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:01.459+0000 7f3b27669640 1 -- 172.21.15.150:0/2224490471 shutdown_connections 2024-09-17T05:52:01.461 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:01.459+0000 7f3b27669640 1 --2- 172.21.15.150:0/2224490471 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3b20160f60 0x7f3b200c6720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:52:01.461 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:01.459+0000 7f3b27669640 1 --2- 172.21.15.150:0/2224490471 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f3b0407a960 0x7f3b0407ce70 unknown :-1 s=CLOSED pgs=669 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:52:01.461 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:01.459+0000 7f3b27669640 1 --2- 172.21.15.150:0/2224490471 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3b200cea50 0x7f3b2006dee0 unknown :-1 s=CLOSED pgs=1571 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:52:01.461 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:01.459+0000 7f3b27669640 1 --2- 172.21.15.150:0/2224490471 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3b200c5a90 0x7f3b201f2a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:52:01.461 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:01.459+0000 7f3b27669640 1 -- 172.21.15.150:0/2224490471 >> 172.21.15.150:0/2224490471 conn(0x7f3b200cee80 msgr2=0x7f3b2015f5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:52:01.461 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:01.459+0000 7f3b27669640 1 -- 172.21.15.150:0/2224490471 shutdown_connections 2024-09-17T05:52:01.461 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:01.459+0000 7f3b27669640 1 -- 172.21.15.150:0/2224490471 wait complete. 2024-09-17T05:52:01.472 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume ls cephfs --format json 2024-09-17T05:52:01.588 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:01.587+0000 7f130e969640 1 -- 172.21.15.150:0/1547788368 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f12f0004f40 msgr2=0x7f12f000b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:52:01.588 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:01.587+0000 7f130e969640 1 --2- 172.21.15.150:0/1547788368 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f12f0004f40 0x7f12f000b9c0 secure :-1 s=READY pgs=1573 cs=0 l=1 rev1=1 crypto rx=0x7f1300001d90 tx=0x7f12f0005830 comp rx=0 tx=0).stop 2024-09-17T05:52:01.588 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:01.587+0000 7f130cf06640 1 -- 172.21.15.150:0/1547788368 reap_dead start 2024-09-17T05:52:01.589 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:01.587+0000 7f130e969640 1 -- 172.21.15.150:0/1547788368 shutdown_connections 2024-09-17T05:52:01.589 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:01.587+0000 7f130e969640 1 -- 172.21.15.150:0/1547788368 >> 172.21.15.150:0/1547788368 conn(0x7f13080cef20 msgr2=0x7f13080cf330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:52:01.589 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:01.587+0000 7f130e969640 1 -- 172.21.15.150:0/1547788368 shutdown_connections 2024-09-17T05:52:01.589 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:01.587+0000 7f130e969640 1 -- 172.21.15.150:0/1547788368 wait complete. 2024-09-17T05:52:01.590 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:01.589+0000 7f130e969640 1 Processor -- start 2024-09-17T05:52:01.590 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:01.589+0000 7f130e969640 1 -- start start 2024-09-17T05:52:01.593 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:01.591+0000 7f130e969640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f13081f9e70 0x7f130815f850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:52:01.593 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:01.591+0000 7f130e969640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f130806deb0 0x7f13081f9180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:52:01.593 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:01.591+0000 7f130e969640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f130806e2c0 0x7f13081f96c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:52:01.593 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:01.591+0000 7f130e969640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f13080af900 con 0x7f13081f9e70 2024-09-17T05:52:01.593 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:01.591+0000 7f130e969640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f13080ceb90 con 0x7f130806e2c0 2024-09-17T05:52:01.593 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:01.591+0000 7f130e969640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f130806f860 con 0x7f130806deb0 2024-09-17T05:52:01.593 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:01.591+0000 7f1307fff640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f13081f9e70 0x7f130815f850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:52:01.593 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:01.591+0000 7f1307fff640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f13081f9e70 0x7f130815f850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:55710/0 (socket says 172.21.15.150:55710) 2024-09-17T05:52:01.594 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:01.591+0000 7f1307fff640 1 -- 172.21.15.150:0/1962564154 learned_addr learned my addr 172.21.15.150:0/1962564154 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:52:01.594 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:01.591+0000 7f130cf06640 1 --2- 172.21.15.150:0/1962564154 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f130806e2c0 0x7f13081f96c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:52:01.594 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:01.591+0000 7f13077fe640 1 --2- 172.21.15.150:0/1962564154 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f130806deb0 0x7f13081f9180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:52:01.594 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:01.591+0000 7f1307fff640 1 -- 172.21.15.150:0/1962564154 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f130806deb0 msgr2=0x7f13081f9180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:52:01.594 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:01.591+0000 7f1307fff640 1 --2- 172.21.15.150:0/1962564154 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f130806deb0 0x7f13081f9180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:52:01.594 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:01.591+0000 7f1307fff640 1 -- 172.21.15.150:0/1962564154 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f130806e2c0 msgr2=0x7f13081f96c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:52:01.594 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:01.591+0000 7f1307fff640 1 --2- 172.21.15.150:0/1962564154 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f130806e2c0 0x7f13081f96c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:52:01.594 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:01.591+0000 7f1307fff640 1 -- 172.21.15.150:0/1962564154 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f130806e7c0 con 0x7f13081f9e70 2024-09-17T05:52:01.594 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:01.591+0000 7f130cf06640 1 --2- 172.21.15.150:0/1962564154 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f130806e2c0 0x7f13081f96c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T05:52:01.594 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:01.591+0000 7f13077fe640 1 --2- 172.21.15.150:0/1962564154 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f130806deb0 0x7f13081f9180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T05:52:01.594 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:01.591+0000 7f1307fff640 1 --2- 172.21.15.150:0/1962564154 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f13081f9e70 0x7f130815f850 secure :-1 s=READY pgs=1574 cs=0 l=1 rev1=1 crypto rx=0x7f12f8000ef0 tx=0x7f12f800ea20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:52:01.594 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:01.591+0000 7f1304ff9640 1 -- 172.21.15.150:0/1962564154 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12f8015070 con 0x7f13081f9e70 2024-09-17T05:52:01.595 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:01.591+0000 7f1304ff9640 1 -- 172.21.15.150:0/1962564154 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f12f80109a0 con 0x7f13081f9e70 2024-09-17T05:52:01.595 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:01.591+0000 7f130e969640 1 -- 172.21.15.150:0/1962564154 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f130806eaa0 con 0x7f13081f9e70 2024-09-17T05:52:01.595 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:01.591+0000 7f1304ff9640 1 -- 172.21.15.150:0/1962564154 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12f8010df0 con 0x7f13081f9e70 2024-09-17T05:52:01.595 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:01.592+0000 7f130e969640 1 -- 172.21.15.150:0/1962564154 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f130806f060 con 0x7f13081f9e70 2024-09-17T05:52:01.595 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:01.592+0000 7f130e969640 1 -- 172.21.15.150:0/1962564154 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f13080d0b60 con 0x7f13081f9e70 2024-09-17T05:52:01.596 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:01.594+0000 7f1304ff9640 1 -- 172.21.15.150:0/1962564154 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 41) ==== 104144+0+0 (secure 0 0 0) 0x7f12f8018070 con 0x7f13081f9e70 2024-09-17T05:52:01.596 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:01.594+0000 7f1304ff9640 1 --2- 172.21.15.150:0/1962564154 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f12f407a960 0x7f12f407ce70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:52:01.596 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:01.595+0000 7f1304ff9640 1 -- 172.21.15.150:0/1962564154 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(115..115 src has 1..115) ==== 5907+0+0 (secure 0 0 0) 0x7f12f809a400 con 0x7f13081f9e70 2024-09-17T05:52:01.596 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:01.595+0000 7f13077fe640 1 --2- 172.21.15.150:0/1962564154 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f12f407a960 0x7f12f407ce70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:52:01.596 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:01.595+0000 7f13077fe640 1 --2- 172.21.15.150:0/1962564154 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f12f407a960 0x7f12f407ce70 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7f12fc005fd0 tx=0x7f12fc00b530 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:52:01.599 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:01.598+0000 7f1304ff9640 1 -- 172.21.15.150:0/1962564154 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f12f80644b0 con 0x7f13081f9e70 2024-09-17T05:52:01.799 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:01.798+0000 7f130e969640 1 -- 172.21.15.150:0/1962564154 --> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] -- mgr_command(tid 0: {"prefix": "fs subvolume ls", "vol_name": "cephfs", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f13080b0ff0 con 0x7f12f407a960 2024-09-17T05:52:01.805 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:01.804+0000 7f1304ff9640 1 -- 172.21.15.150:0/1962564154 <== mgr.4108 v2:172.21.15.176:6800/3631216395 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+185 (secure 0 0 0) 0x7f13080b0ff0 con 0x7f12f407a960 2024-09-17T05:52:01.805 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-09-17T05:52:01.805 INFO:teuthology.orchestra.run.smithi150.stdout:[ 2024-09-17T05:52:01.805 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-09-17T05:52:01.805 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "subvol_clone43860" 2024-09-17T05:52:01.805 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-17T05:52:01.806 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-09-17T05:52:01.806 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "sv1" 2024-09-17T05:52:01.806 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-17T05:52:01.806 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-09-17T05:52:01.806 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "subvol_clone59012" 2024-09-17T05:52:01.806 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-17T05:52:01.806 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-09-17T05:52:01.806 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "subvol_clone39571" 2024-09-17T05:52:01.806 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-09-17T05:52:01.806 INFO:teuthology.orchestra.run.smithi150.stdout:] 2024-09-17T05:52:01.807 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:01.806+0000 7f130e969640 1 -- 172.21.15.150:0/1962564154 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f12f407a960 msgr2=0x7f12f407ce70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:52:01.807 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:01.806+0000 7f130e969640 1 --2- 172.21.15.150:0/1962564154 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f12f407a960 0x7f12f407ce70 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7f12fc005fd0 tx=0x7f12fc00b530 comp rx=0 tx=0).stop 2024-09-17T05:52:01.807 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:01.806+0000 7f130e969640 1 -- 172.21.15.150:0/1962564154 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f13081f9e70 msgr2=0x7f130815f850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:52:01.807 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:01.806+0000 7f130e969640 1 --2- 172.21.15.150:0/1962564154 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f13081f9e70 0x7f130815f850 secure :-1 s=READY pgs=1574 cs=0 l=1 rev1=1 crypto rx=0x7f12f8000ef0 tx=0x7f12f800ea20 comp rx=0 tx=0).stop 2024-09-17T05:52:01.807 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:01.806+0000 7f130e969640 1 -- 172.21.15.150:0/1962564154 shutdown_connections 2024-09-17T05:52:01.808 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:01.806+0000 7f130e969640 1 --2- 172.21.15.150:0/1962564154 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f130806e2c0 0x7f13081f96c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:52:01.808 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:01.806+0000 7f130e969640 1 --2- 172.21.15.150:0/1962564154 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f12f407a960 0x7f12f407ce70 unknown :-1 s=CLOSED pgs=670 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:52:01.808 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:01.806+0000 7f130e969640 1 --2- 172.21.15.150:0/1962564154 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f130806deb0 0x7f13081f9180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:52:01.808 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:01.806+0000 7f130e969640 1 --2- 172.21.15.150:0/1962564154 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f13081f9e70 0x7f130815f850 unknown :-1 s=CLOSED pgs=1574 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:52:01.808 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:01.806+0000 7f130e969640 1 -- 172.21.15.150:0/1962564154 >> 172.21.15.150:0/1962564154 conn(0x7f13080cef20 msgr2=0x7f1308071fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:52:01.808 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:01.806+0000 7f130e969640 1 -- 172.21.15.150:0/1962564154 shutdown_connections 2024-09-17T05:52:01.808 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:01.806+0000 7f130e969640 1 -- 172.21.15.150:0/1962564154 wait complete. 2024-09-17T05:52:01.819 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume rm --force cephfs subvol_clone43860 2024-09-17T05:52:01.935 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:01.934+0000 7f1583fba640 1 -- 172.21.15.150:0/3043711983 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f157c0d1670 msgr2=0x7f157c06e390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:52:01.935 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:01.934+0000 7f1583fba640 1 --2- 172.21.15.150:0/3043711983 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f157c0d1670 0x7f157c06e390 secure :-1 s=READY pgs=1575 cs=0 l=1 rev1=1 crypto rx=0x7f157c0b72b0 tx=0x7f157002a540 comp rx=0 tx=0).stop 2024-09-17T05:52:01.936 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:01.934+0000 7f1583fba640 1 -- 172.21.15.150:0/3043711983 shutdown_connections 2024-09-17T05:52:01.936 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:01.934+0000 7f1583fba640 1 --2- 172.21.15.150:0/3043711983 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f157c06e8d0 0x7f157c06ece0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:52:01.936 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:01.934+0000 7f1583fba640 1 --2- 172.21.15.150:0/3043711983 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f157c0d1670 0x7f157c06e390 unknown :-1 s=CLOSED pgs=1575 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:52:01.936 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:01.934+0000 7f1583fba640 1 --2- 172.21.15.150:0/3043711983 >> v2:172.21.15.176:3300/0 conn(0x7f157c0d0d20 0x7f157c0d1130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:52:01.936 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:01.934+0000 7f1583fba640 1 -- 172.21.15.150:0/3043711983 >> 172.21.15.150:0/3043711983 conn(0x7f157c0d46f0 msgr2=0x7f157c0d4b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:52:01.936 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:01.934+0000 7f1583fba640 1 -- 172.21.15.150:0/3043711983 shutdown_connections 2024-09-17T05:52:01.936 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:01.934+0000 7f1583fba640 1 -- 172.21.15.150:0/3043711983 wait complete. 2024-09-17T05:52:01.937 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:01.936+0000 7f1583fba640 1 Processor -- start 2024-09-17T05:52:01.937 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:01.936+0000 7f1583fba640 1 -- start start 2024-09-17T05:52:01.939 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:01.937+0000 7f1583fba640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f157c06e8d0 0x7f157c15f8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:52:01.939 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:01.937+0000 7f1583fba640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f157c0d0d20 0x7f157c15e550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:52:01.939 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:01.937+0000 7f1583fba640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f157c0d1670 0x7f157c1f8e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:52:01.940 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:01.937+0000 7f1583fba640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f157c06f220 con 0x7f157c0d0d20 2024-09-17T05:52:01.940 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:01.937+0000 7f1583fba640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f157c06f3a0 con 0x7f157c0d1670 2024-09-17T05:52:01.940 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:01.937+0000 7f1583fba640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f157c06f520 con 0x7f157c06e8d0 2024-09-17T05:52:01.940 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:01.937+0000 7f1581555640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f157c0d0d20 0x7f157c15e550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:52:01.940 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:01.937+0000 7f1581555640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f157c0d0d20 0x7f157c15e550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:55740/0 (socket says 172.21.15.150:55740) 2024-09-17T05:52:01.940 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:01.938+0000 7f1581555640 1 -- 172.21.15.150:0/680285306 learned_addr learned my addr 172.21.15.150:0/680285306 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:52:01.940 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:01.938+0000 7f1581d56640 1 --2- 172.21.15.150:0/680285306 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f157c06e8d0 0x7f157c15f8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:52:01.940 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:01.938+0000 7f1582557640 1 --2- 172.21.15.150:0/680285306 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f157c0d1670 0x7f157c1f8e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:52:01.940 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:01.938+0000 7f1581555640 1 -- 172.21.15.150:0/680285306 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f157c06e8d0 msgr2=0x7f157c15f8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:52:01.940 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:01.938+0000 7f1581555640 1 --2- 172.21.15.150:0/680285306 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f157c06e8d0 0x7f157c15f8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:52:01.940 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:01.938+0000 7f1581555640 1 -- 172.21.15.150:0/680285306 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f157c0d1670 msgr2=0x7f157c1f8e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:52:01.940 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:01.938+0000 7f1581555640 1 --2- 172.21.15.150:0/680285306 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f157c0d1670 0x7f157c1f8e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:52:01.940 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:01.938+0000 7f1581555640 1 -- 172.21.15.150:0/680285306 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f157c15f540 con 0x7f157c0d0d20 2024-09-17T05:52:01.941 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:01.938+0000 7f1581555640 1 --2- 172.21.15.150:0/680285306 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f157c0d0d20 0x7f157c15e550 secure :-1 s=READY pgs=1576 cs=0 l=1 rev1=1 crypto rx=0x7f15700099d0 tx=0x7f15700052f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:52:01.941 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:01.938+0000 7f157a7fc640 1 -- 172.21.15.150:0/680285306 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1570005cf0 con 0x7f157c0d0d20 2024-09-17T05:52:01.941 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:01.938+0000 7f157a7fc640 1 -- 172.21.15.150:0/680285306 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f1570031c40 con 0x7f157c0d0d20 2024-09-17T05:52:01.941 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:01.938+0000 7f1583fba640 1 -- 172.21.15.150:0/680285306 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f157c15a580 con 0x7f157c0d0d20 2024-09-17T05:52:01.941 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:01.938+0000 7f157a7fc640 1 -- 172.21.15.150:0/680285306 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1570004a00 con 0x7f157c0d0d20 2024-09-17T05:52:01.941 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:01.938+0000 7f1583fba640 1 -- 172.21.15.150:0/680285306 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f157c15ab40 con 0x7f157c0d0d20 2024-09-17T05:52:01.942 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:01.939+0000 7f1583fba640 1 -- 172.21.15.150:0/680285306 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f157c15f2b0 con 0x7f157c0d0d20 2024-09-17T05:52:01.942 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:01.940+0000 7f157a7fc640 1 -- 172.21.15.150:0/680285306 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 41) ==== 104144+0+0 (secure 0 0 0) 0x7f1570004ba0 con 0x7f157c0d0d20 2024-09-17T05:52:01.942 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:01.940+0000 7f157a7fc640 1 --2- 172.21.15.150:0/680285306 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f156807a960 0x7f156807ce70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:52:01.942 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:01.941+0000 7f157a7fc640 1 -- 172.21.15.150:0/680285306 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(115..115 src has 1..115) ==== 5907+0+0 (secure 0 0 0) 0x7f15700baee0 con 0x7f157c0d0d20 2024-09-17T05:52:01.942 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:01.941+0000 7f1581d56640 1 --2- 172.21.15.150:0/680285306 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f156807a960 0x7f156807ce70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:52:01.942 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:01.941+0000 7f1581d56640 1 --2- 172.21.15.150:0/680285306 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f156807a960 0x7f156807ce70 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7f156c004510 tx=0x7f156c00b390 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:52:01.945 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:01.945+0000 7f157a7fc640 1 -- 172.21.15.150:0/680285306 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f157003f030 con 0x7f157c0d0d20 2024-09-17T05:52:02.146 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:02.146+0000 7f1583fba640 1 -- 172.21.15.150:0/680285306 --> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] -- mgr_command(tid 0: {"prefix": "fs subvolume rm", "force": true, "vol_name": "cephfs", "sub_name": "subvol_clone43860", "target": ["mon-mgr", ""]}) -- 0x7f157c0d1130 con 0x7f156807a960 2024-09-17T05:52:02.164 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:02.163+0000 7f157a7fc640 1 -- 172.21.15.150:0/680285306 <== mgr.4108 v2:172.21.15.176:6800/3631216395 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f157c0d1130 con 0x7f156807a960 2024-09-17T05:52:02.167 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:02.166+0000 7f1583fba640 1 -- 172.21.15.150:0/680285306 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f156807a960 msgr2=0x7f156807ce70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:52:02.167 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:02.166+0000 7f1583fba640 1 --2- 172.21.15.150:0/680285306 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f156807a960 0x7f156807ce70 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7f156c004510 tx=0x7f156c00b390 comp rx=0 tx=0).stop 2024-09-17T05:52:02.167 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:02.166+0000 7f1583fba640 1 -- 172.21.15.150:0/680285306 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f157c0d0d20 msgr2=0x7f157c15e550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:52:02.167 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:02.166+0000 7f1583fba640 1 --2- 172.21.15.150:0/680285306 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f157c0d0d20 0x7f157c15e550 secure :-1 s=READY pgs=1576 cs=0 l=1 rev1=1 crypto rx=0x7f15700099d0 tx=0x7f15700052f0 comp rx=0 tx=0).stop 2024-09-17T05:52:02.167 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:02.166+0000 7f1583fba640 1 -- 172.21.15.150:0/680285306 shutdown_connections 2024-09-17T05:52:02.167 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:02.166+0000 7f1583fba640 1 --2- 172.21.15.150:0/680285306 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f157c0d1670 0x7f157c1f8e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:52:02.167 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:02.166+0000 7f1583fba640 1 --2- 172.21.15.150:0/680285306 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f156807a960 0x7f156807ce70 unknown :-1 s=CLOSED pgs=671 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:52:02.167 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:02.166+0000 7f1583fba640 1 --2- 172.21.15.150:0/680285306 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f157c0d0d20 0x7f157c15e550 unknown :-1 s=CLOSED pgs=1576 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:52:02.167 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:02.166+0000 7f1583fba640 1 --2- 172.21.15.150:0/680285306 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f157c06e8d0 0x7f157c15f8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:52:02.167 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:02.166+0000 7f1583fba640 1 -- 172.21.15.150:0/680285306 >> 172.21.15.150:0/680285306 conn(0x7f157c0d46f0 msgr2=0x7f157c161d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:52:02.168 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:02.166+0000 7f1583fba640 1 -- 172.21.15.150:0/680285306 shutdown_connections 2024-09-17T05:52:02.168 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:02.166+0000 7f1583fba640 1 -- 172.21.15.150:0/680285306 wait complete. 2024-09-17T05:52:02.176 INFO:tasks.ceph.mgr.x.smithi176.stderr:2024-09-17T05:52:02.175+0000 7f33d9f1f640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-17T05:52:02.176 INFO:tasks.ceph.mgr.x.smithi176.stderr:2024-09-17T05:52:02.175+0000 7f33d9f1f640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-17T05:52:02.176 INFO:tasks.ceph.mgr.x.smithi176.stderr:2024-09-17T05:52:02.175+0000 7f33d9f1f640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-17T05:52:02.177 INFO:tasks.ceph.mgr.x.smithi176.stderr:2024-09-17T05:52:02.175+0000 7f33d9f1f640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-17T05:52:02.177 INFO:tasks.ceph.mgr.x.smithi176.stderr:2024-09-17T05:52:02.175+0000 7f33d9f1f640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-17T05:52:02.179 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume snapshot ls cephfs sv1 --format json 2024-09-17T05:52:02.299 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:02.298+0000 7f4cd804d640 1 -- 172.21.15.150:0/3194986926 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4cd00b6320 msgr2=0x7f4cd00b6730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:52:02.299 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:02.298+0000 7f4cd804d640 1 --2- 172.21.15.150:0/3194986926 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4cd00b6320 0x7f4cd00b6730 secure :-1 s=READY pgs=1578 cs=0 l=1 rev1=1 crypto rx=0x7f4cc4009820 tx=0x7f4cc402a3f0 comp rx=0 tx=0).stop 2024-09-17T05:52:02.299 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:02.298+0000 7f4cd804d640 1 -- 172.21.15.150:0/3194986926 shutdown_connections 2024-09-17T05:52:02.299 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:02.298+0000 7f4cd804d640 1 --2- 172.21.15.150:0/3194986926 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4cd00b7510 0x7f4cd00b7920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:52:02.299 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:02.298+0000 7f4cd804d640 1 --2- 172.21.15.150:0/3194986926 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4cd00b6320 0x7f4cd00b6730 unknown :-1 s=CLOSED pgs=1578 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:52:02.299 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:02.298+0000 7f4cd804d640 1 -- 172.21.15.150:0/3194986926 >> 172.21.15.150:0/3194986926 conn(0x7f4cd00d46c0 msgr2=0x7f4cd00d4ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:52:02.299 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:02.298+0000 7f4cd804d640 1 -- 172.21.15.150:0/3194986926 shutdown_connections 2024-09-17T05:52:02.300 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:02.298+0000 7f4cd804d640 1 -- 172.21.15.150:0/3194986926 wait complete. 2024-09-17T05:52:02.300 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:02.300+0000 7f4cd804d640 1 Processor -- start 2024-09-17T05:52:02.300 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:02.300+0000 7f4cd804d640 1 -- start start 2024-09-17T05:52:02.303 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:02.301+0000 7f4cd804d640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4cd00b6320 0x7f4cd01e93d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:52:02.303 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:02.301+0000 7f4cd804d640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4cd00b7510 0x7f4cd01f93b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:52:02.303 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:02.301+0000 7f4cd804d640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4cd00d5300 0x7f4cd01f98f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:52:02.303 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:02.301+0000 7f4cd804d640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f4cd00d3ae0 con 0x7f4cd00b6320 2024-09-17T05:52:02.303 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:02.301+0000 7f4cd804d640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f4cd00d3960 con 0x7f4cd00d5300 2024-09-17T05:52:02.303 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:02.301+0000 7f4cd804d640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f4cd00cf500 con 0x7f4cd00b7510 2024-09-17T05:52:02.303 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:02.301+0000 7f4cd5de9640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4cd00b6320 0x7f4cd01e93d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:52:02.303 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:02.301+0000 7f4cd5de9640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4cd00b6320 0x7f4cd01e93d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:55752/0 (socket says 172.21.15.150:55752) 2024-09-17T05:52:02.303 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:02.301+0000 7f4cd5de9640 1 -- 172.21.15.150:0/633655747 learned_addr learned my addr 172.21.15.150:0/633655747 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:52:02.304 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:02.301+0000 7f4cd55e8640 1 --2- 172.21.15.150:0/633655747 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4cd00b7510 0x7f4cd01f93b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:52:02.304 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:02.301+0000 7f4cd65ea640 1 --2- 172.21.15.150:0/633655747 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4cd00d5300 0x7f4cd01f98f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:52:02.304 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:02.302+0000 7f4cd5de9640 1 -- 172.21.15.150:0/633655747 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4cd00b7510 msgr2=0x7f4cd01f93b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:52:02.304 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:02.302+0000 7f4cd5de9640 1 --2- 172.21.15.150:0/633655747 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4cd00b7510 0x7f4cd01f93b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:52:02.304 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:02.302+0000 7f4cd5de9640 1 -- 172.21.15.150:0/633655747 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4cd00d5300 msgr2=0x7f4cd01f98f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:52:02.304 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:02.302+0000 7f4cd5de9640 1 --2- 172.21.15.150:0/633655747 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4cd00d5300 0x7f4cd01f98f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:52:02.304 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:02.302+0000 7f4cd5de9640 1 -- 172.21.15.150:0/633655747 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4cd01eada0 con 0x7f4cd00b6320 2024-09-17T05:52:02.304 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:02.302+0000 7f4cd5de9640 1 --2- 172.21.15.150:0/633655747 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4cd00b6320 0x7f4cd01e93d0 secure :-1 s=READY pgs=1579 cs=0 l=1 rev1=1 crypto rx=0x7f4cc000cbc0 tx=0x7f4cc000a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:52:02.304 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:02.302+0000 7f4cce7fc640 1 -- 172.21.15.150:0/633655747 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4cc0016020 con 0x7f4cd00b6320 2024-09-17T05:52:02.304 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:02.302+0000 7f4cce7fc640 1 -- 172.21.15.150:0/633655747 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f4cc000ad90 con 0x7f4cd00b6320 2024-09-17T05:52:02.304 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:02.302+0000 7f4cd804d640 1 -- 172.21.15.150:0/633655747 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4cd01e9d00 con 0x7f4cd00b6320 2024-09-17T05:52:02.304 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:02.302+0000 7f4cce7fc640 1 -- 172.21.15.150:0/633655747 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4cc0012680 con 0x7f4cd00b6320 2024-09-17T05:52:02.304 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:02.302+0000 7f4cd804d640 1 -- 172.21.15.150:0/633655747 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4cd01ea2c0 con 0x7f4cd00b6320 2024-09-17T05:52:02.305 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:02.303+0000 7f4cd804d640 1 -- 172.21.15.150:0/633655747 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4cd008cd50 con 0x7f4cd00b6320 2024-09-17T05:52:02.305 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:02.304+0000 7f4cce7fc640 1 -- 172.21.15.150:0/633655747 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 41) ==== 104144+0+0 (secure 0 0 0) 0x7f4cc0019020 con 0x7f4cd00b6320 2024-09-17T05:52:02.305 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:02.304+0000 7f4cce7fc640 1 --2- 172.21.15.150:0/633655747 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f4cbc07a990 0x7f4cbc07cea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:52:02.305 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:02.305+0000 7f4cce7fc640 1 -- 172.21.15.150:0/633655747 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(115..115 src has 1..115) ==== 5907+0+0 (secure 0 0 0) 0x7f4cc009a490 con 0x7f4cd00b6320 2024-09-17T05:52:02.306 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:02.305+0000 7f4cd55e8640 1 --2- 172.21.15.150:0/633655747 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f4cbc07a990 0x7f4cbc07cea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:52:02.306 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:02.306+0000 7f4cd55e8640 1 --2- 172.21.15.150:0/633655747 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f4cbc07a990 0x7f4cbc07cea0 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7f4cc4034000 tx=0x7f4cc4004730 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:52:02.309 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:02.308+0000 7f4cce7fc640 1 -- 172.21.15.150:0/633655747 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f4cd008cd50 con 0x7f4cd00b6320 2024-09-17T05:52:02.517 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:02.516+0000 7f4cd804d640 1 -- 172.21.15.150:0/633655747 --> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] -- mgr_command(tid 0: {"prefix": "fs subvolume snapshot ls", "vol_name": "cephfs", "sub_name": "sv1", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f4cd00b6730 con 0x7f4cbc07a990 2024-09-17T05:52:02.533 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:02.532+0000 7f4cce7fc640 1 -- 172.21.15.150:0/633655747 <== mgr.4108 v2:172.21.15.176:6800/3631216395 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+38 (secure 0 0 0) 0x7f4cd00b6730 con 0x7f4cbc07a990 2024-09-17T05:52:02.533 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-09-17T05:52:02.533 INFO:teuthology.orchestra.run.smithi150.stdout:[ 2024-09-17T05:52:02.533 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-09-17T05:52:02.533 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "ss1" 2024-09-17T05:52:02.533 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-09-17T05:52:02.534 INFO:teuthology.orchestra.run.smithi150.stdout:] 2024-09-17T05:52:02.536 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:02.535+0000 7f4cd804d640 1 -- 172.21.15.150:0/633655747 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f4cbc07a990 msgr2=0x7f4cbc07cea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:52:02.536 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:02.535+0000 7f4cd804d640 1 --2- 172.21.15.150:0/633655747 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f4cbc07a990 0x7f4cbc07cea0 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7f4cc4034000 tx=0x7f4cc4004730 comp rx=0 tx=0).stop 2024-09-17T05:52:02.536 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:02.535+0000 7f4cd804d640 1 -- 172.21.15.150:0/633655747 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4cd00b6320 msgr2=0x7f4cd01e93d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:52:02.536 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:02.535+0000 7f4cd804d640 1 --2- 172.21.15.150:0/633655747 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4cd00b6320 0x7f4cd01e93d0 secure :-1 s=READY pgs=1579 cs=0 l=1 rev1=1 crypto rx=0x7f4cc000cbc0 tx=0x7f4cc000a060 comp rx=0 tx=0).stop 2024-09-17T05:52:02.536 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:02.535+0000 7f4cd804d640 1 -- 172.21.15.150:0/633655747 shutdown_connections 2024-09-17T05:52:02.536 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:02.535+0000 7f4cd804d640 1 --2- 172.21.15.150:0/633655747 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4cd00d5300 0x7f4cd01f98f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:52:02.536 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:02.535+0000 7f4cd804d640 1 --2- 172.21.15.150:0/633655747 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f4cbc07a990 0x7f4cbc07cea0 unknown :-1 s=CLOSED pgs=672 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:52:02.536 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:02.535+0000 7f4cd804d640 1 --2- 172.21.15.150:0/633655747 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4cd00b7510 0x7f4cd01f93b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:52:02.536 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:02.535+0000 7f4cd804d640 1 --2- 172.21.15.150:0/633655747 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4cd00b6320 0x7f4cd01e93d0 unknown :-1 s=CLOSED pgs=1579 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:52:02.536 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:02.535+0000 7f4cd804d640 1 -- 172.21.15.150:0/633655747 >> 172.21.15.150:0/633655747 conn(0x7f4cd00d46c0 msgr2=0x7f4cd00cda00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:52:02.536 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:02.535+0000 7f4cd804d640 1 -- 172.21.15.150:0/633655747 shutdown_connections 2024-09-17T05:52:02.537 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:02.535+0000 7f4cd804d640 1 -- 172.21.15.150:0/633655747 wait complete. 2024-09-17T05:52:02.547 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume snapshot rm --force --format json cephfs sv1 ss1 2024-09-17T05:52:02.667 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:02.666+0000 7ff5f86e5640 1 -- 172.21.15.150:0/3233224212 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff5f00b7960 msgr2=0x7ff5f00af1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:52:02.667 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:02.666+0000 7ff5f86e5640 1 --2- 172.21.15.150:0/3233224212 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff5f00b7960 0x7ff5f00af1f0 secure :-1 s=READY pgs=1581 cs=0 l=1 rev1=1 crypto rx=0x7ff5ec009820 tx=0x7ff5ec02a3f0 comp rx=0 tx=0).stop 2024-09-17T05:52:02.667 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:02.666+0000 7ff5f86e5640 1 -- 172.21.15.150:0/3233224212 shutdown_connections 2024-09-17T05:52:02.668 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:02.666+0000 7ff5f86e5640 1 --2- 172.21.15.150:0/3233224212 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff5f00b7960 0x7ff5f00af1f0 unknown :-1 s=CLOSED pgs=1581 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:52:02.668 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:02.666+0000 7ff5f86e5640 1 -- 172.21.15.150:0/3233224212 >> 172.21.15.150:0/3233224212 conn(0x7ff5f00cef20 msgr2=0x7ff5f00cf330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:52:02.668 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:02.666+0000 7ff5f86e5640 1 -- 172.21.15.150:0/3233224212 shutdown_connections 2024-09-17T05:52:02.668 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:02.666+0000 7ff5f86e5640 1 -- 172.21.15.150:0/3233224212 wait complete. 2024-09-17T05:52:02.668 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:02.668+0000 7ff5f86e5640 1 Processor -- start 2024-09-17T05:52:02.668 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:02.668+0000 7ff5f86e5640 1 -- start start 2024-09-17T05:52:02.671 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:02.669+0000 7ff5f86e5640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff5f00b7960 0x7ff5f0153590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:52:02.671 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:02.669+0000 7ff5f86e5640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff5f00b7d70 0x7ff5f0156d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:52:02.671 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:02.669+0000 7ff5f86e5640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff5f00d1190 0x7ff5f015f920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:52:02.671 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:02.669+0000 7ff5f86e5640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7ff5f00b83c0 con 0x7ff5f00b7d70 2024-09-17T05:52:02.671 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:02.669+0000 7ff5f86e5640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7ff5f00ceda0 con 0x7ff5f00d1190 2024-09-17T05:52:02.672 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:02.669+0000 7ff5f86e5640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7ff5f00af730 con 0x7ff5f00b7960 2024-09-17T05:52:02.672 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:02.669+0000 7ff5f5c80640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff5f00b7d70 0x7ff5f0156d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:52:02.672 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:02.669+0000 7ff5f5c80640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff5f00b7d70 0x7ff5f0156d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:55774/0 (socket says 172.21.15.150:55774) 2024-09-17T05:52:02.672 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:02.669+0000 7ff5f5c80640 1 -- 172.21.15.150:0/2513042179 learned_addr learned my addr 172.21.15.150:0/2513042179 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:52:02.672 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:02.669+0000 7ff5f6c82640 1 --2- 172.21.15.150:0/2513042179 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff5f00d1190 0x7ff5f015f920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:52:02.672 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:02.669+0000 7ff5f6481640 1 --2- 172.21.15.150:0/2513042179 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff5f00b7960 0x7ff5f0153590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:52:02.672 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:02.670+0000 7ff5f5c80640 1 -- 172.21.15.150:0/2513042179 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff5f00b7960 msgr2=0x7ff5f0153590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:52:02.672 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:02.670+0000 7ff5f5c80640 1 --2- 172.21.15.150:0/2513042179 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff5f00b7960 0x7ff5f0153590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:52:02.672 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:02.670+0000 7ff5f5c80640 1 -- 172.21.15.150:0/2513042179 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff5f00d1190 msgr2=0x7ff5f015f920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:52:02.672 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:02.670+0000 7ff5f5c80640 1 --2- 172.21.15.150:0/2513042179 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff5f00d1190 0x7ff5f015f920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:52:02.672 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:02.670+0000 7ff5f5c80640 1 -- 172.21.15.150:0/2513042179 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff5f0157260 con 0x7ff5f00b7d70 2024-09-17T05:52:02.673 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:02.670+0000 7ff5f6481640 1 --2- 172.21.15.150:0/2513042179 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff5f00b7960 0x7ff5f0153590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:52:02.673 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:02.670+0000 7ff5f5c80640 1 --2- 172.21.15.150:0/2513042179 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff5f00b7d70 0x7ff5f0156d20 secure :-1 s=READY pgs=1582 cs=0 l=1 rev1=1 crypto rx=0x7ff5e000b3e0 tx=0x7ff5e000b8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:52:02.673 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:02.670+0000 7ff5e6ffd640 1 -- 172.21.15.150:0/2513042179 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff5e0015020 con 0x7ff5f00b7d70 2024-09-17T05:52:02.673 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:02.670+0000 7ff5e6ffd640 1 -- 172.21.15.150:0/2513042179 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff5e0011920 con 0x7ff5f00b7d70 2024-09-17T05:52:02.673 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:02.670+0000 7ff5f86e5640 1 -- 172.21.15.150:0/2513042179 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff5f01f3950 con 0x7ff5f00b7d70 2024-09-17T05:52:02.673 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:02.670+0000 7ff5e6ffd640 1 -- 172.21.15.150:0/2513042179 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff5e0011d70 con 0x7ff5f00b7d70 2024-09-17T05:52:02.673 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:02.670+0000 7ff5f86e5640 1 -- 172.21.15.150:0/2513042179 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff5f01f3f10 con 0x7ff5f00b7d70 2024-09-17T05:52:02.674 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:02.671+0000 7ff5f86e5640 1 -- 172.21.15.150:0/2513042179 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff5f00af1f0 con 0x7ff5f00b7d70 2024-09-17T05:52:02.674 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:02.672+0000 7ff5e6ffd640 1 -- 172.21.15.150:0/2513042179 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 41) ==== 104144+0+0 (secure 0 0 0) 0x7ff5e0018020 con 0x7ff5f00b7d70 2024-09-17T05:52:02.674 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:02.672+0000 7ff5e6ffd640 1 --2- 172.21.15.150:0/2513042179 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7ff5d407a960 0x7ff5d407ce70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:52:02.674 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:02.672+0000 7ff5e6ffd640 1 -- 172.21.15.150:0/2513042179 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(115..115 src has 1..115) ==== 5907+0+0 (secure 0 0 0) 0x7ff5e0099b10 con 0x7ff5f00b7d70 2024-09-17T05:52:02.674 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:02.673+0000 7ff5f6481640 1 --2- 172.21.15.150:0/2513042179 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7ff5d407a960 0x7ff5d407ce70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:52:02.674 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:02.673+0000 7ff5f6481640 1 --2- 172.21.15.150:0/2513042179 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7ff5d407a960 0x7ff5d407ce70 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7ff5ec034000 tx=0x7ff5ec004730 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:52:02.678 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:02.677+0000 7ff5e6ffd640 1 -- 172.21.15.150:0/2513042179 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7ff5e001f020 con 0x7ff5f00b7d70 2024-09-17T05:52:02.884 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:02.884+0000 7ff5f86e5640 1 -- 172.21.15.150:0/2513042179 --> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] -- mgr_command(tid 0: {"prefix": "fs subvolume snapshot rm", "force": true, "vol_name": "cephfs", "sub_name": "sv1", "snap_name": "ss1", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7ff5f00afcb0 con 0x7ff5d407a960 2024-09-17T05:52:02.916 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:02.915+0000 7ff5e6ffd640 1 -- 172.21.15.150:0/2513042179 <== mgr.4108 v2:172.21.15.176:6800/3631216395 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7ff5f00afcb0 con 0x7ff5d407a960 2024-09-17T05:52:02.916 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-09-17T05:52:02.919 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:02.918+0000 7ff5f86e5640 1 -- 172.21.15.150:0/2513042179 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7ff5d407a960 msgr2=0x7ff5d407ce70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:52:02.919 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:02.918+0000 7ff5f86e5640 1 --2- 172.21.15.150:0/2513042179 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7ff5d407a960 0x7ff5d407ce70 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7ff5ec034000 tx=0x7ff5ec004730 comp rx=0 tx=0).stop 2024-09-17T05:52:02.919 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:02.918+0000 7ff5f86e5640 1 -- 172.21.15.150:0/2513042179 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff5f00b7d70 msgr2=0x7ff5f0156d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:52:02.919 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:02.918+0000 7ff5f86e5640 1 --2- 172.21.15.150:0/2513042179 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff5f00b7d70 0x7ff5f0156d20 secure :-1 s=READY pgs=1582 cs=0 l=1 rev1=1 crypto rx=0x7ff5e000b3e0 tx=0x7ff5e000b8a0 comp rx=0 tx=0).stop 2024-09-17T05:52:02.919 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:02.918+0000 7ff5f86e5640 1 -- 172.21.15.150:0/2513042179 shutdown_connections 2024-09-17T05:52:02.919 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:02.918+0000 7ff5f86e5640 1 --2- 172.21.15.150:0/2513042179 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff5f00d1190 0x7ff5f015f920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:52:02.919 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:02.918+0000 7ff5f86e5640 1 --2- 172.21.15.150:0/2513042179 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7ff5d407a960 0x7ff5d407ce70 unknown :-1 s=CLOSED pgs=673 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:52:02.919 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:02.918+0000 7ff5f86e5640 1 --2- 172.21.15.150:0/2513042179 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff5f00b7d70 0x7ff5f0156d20 unknown :-1 s=CLOSED pgs=1582 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:52:02.919 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:02.918+0000 7ff5f86e5640 1 --2- 172.21.15.150:0/2513042179 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff5f00b7960 0x7ff5f0153590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:52:02.919 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:02.918+0000 7ff5f86e5640 1 -- 172.21.15.150:0/2513042179 >> 172.21.15.150:0/2513042179 conn(0x7ff5f00cef20 msgr2=0x7ff5f0072d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:52:02.920 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:02.918+0000 7ff5f86e5640 1 -- 172.21.15.150:0/2513042179 shutdown_connections 2024-09-17T05:52:02.920 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:02.918+0000 7ff5f86e5640 1 -- 172.21.15.150:0/2513042179 wait complete. 2024-09-17T05:52:02.930 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume rm cephfs sv1 2024-09-17T05:52:03.046 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:03.045+0000 7f7069a25640 1 -- 172.21.15.150:0/1105984108 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f70640b3960 msgr2=0x7f70640b3d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:52:03.046 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:03.045+0000 7f7069a25640 1 --2- 172.21.15.150:0/1105984108 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f70640b3960 0x7f70640b3d70 secure :-1 s=READY pgs=1584 cs=0 l=1 rev1=1 crypto rx=0x7f706415f9c0 tx=0x7f705c02a530 comp rx=0 tx=0).stop 2024-09-17T05:52:03.046 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:03.045+0000 7f7069a25640 1 -- 172.21.15.150:0/1105984108 shutdown_connections 2024-09-17T05:52:03.046 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:03.045+0000 7f7069a25640 1 --2- 172.21.15.150:0/1105984108 >> v2:172.21.15.176:3300/0 conn(0x7f706415e940 0x7f706415ed50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:52:03.046 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:03.045+0000 7f7069a25640 1 --2- 172.21.15.150:0/1105984108 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f70640b3960 0x7f70640b3d70 unknown :-1 s=CLOSED pgs=1584 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:52:03.047 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:03.045+0000 7f7069a25640 1 -- 172.21.15.150:0/1105984108 >> 172.21.15.150:0/1105984108 conn(0x7f706406d1c0 msgr2=0x7f706406d5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:52:03.047 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:03.045+0000 7f7069a25640 1 -- 172.21.15.150:0/1105984108 shutdown_connections 2024-09-17T05:52:03.047 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:03.045+0000 7f7069a25640 1 -- 172.21.15.150:0/1105984108 wait complete. 2024-09-17T05:52:03.047 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:03.047+0000 7f7069a25640 1 Processor -- start 2024-09-17T05:52:03.047 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:03.047+0000 7f7069a25640 1 -- start start 2024-09-17T05:52:03.050 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:03.048+0000 7f7069a25640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f706406f180 0x7f70640b1140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:52:03.050 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:03.048+0000 7f7069a25640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f70640b3960 0x7f7064150e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:52:03.051 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:03.048+0000 7f7069a25640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f706415e940 0x7f7064131a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:52:03.051 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:03.048+0000 7f7069a25640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f70640739b0 con 0x7f706415e940 2024-09-17T05:52:03.051 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:03.048+0000 7f7069a25640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f7064073830 con 0x7f706406f180 2024-09-17T05:52:03.051 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:03.048+0000 7f7069a25640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f7064073b30 con 0x7f70640b3960 2024-09-17T05:52:03.051 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:03.048+0000 7f70637fe640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f706415e940 0x7f7064131a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:52:03.051 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:03.048+0000 7f70637fe640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f706415e940 0x7f7064131a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:55794/0 (socket says 172.21.15.150:55794) 2024-09-17T05:52:03.051 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:03.048+0000 7f70637fe640 1 -- 172.21.15.150:0/3199535491 learned_addr learned my addr 172.21.15.150:0/3199535491 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:52:03.051 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:03.048+0000 7f7062ffd640 1 --2- 172.21.15.150:0/3199535491 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f706406f180 0x7f70640b1140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:52:03.051 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:03.048+0000 7f70627fc640 1 --2- 172.21.15.150:0/3199535491 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f70640b3960 0x7f7064150e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:52:03.051 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:03.048+0000 7f70637fe640 1 -- 172.21.15.150:0/3199535491 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f70640b3960 msgr2=0x7f7064150e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:52:03.051 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:03.048+0000 7f70637fe640 1 --2- 172.21.15.150:0/3199535491 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f70640b3960 0x7f7064150e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:52:03.051 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:03.048+0000 7f70637fe640 1 -- 172.21.15.150:0/3199535491 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f706406f180 msgr2=0x7f70640b1140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:52:03.052 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:03.048+0000 7f70637fe640 1 --2- 172.21.15.150:0/3199535491 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f706406f180 0x7f70640b1140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:52:03.052 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:03.048+0000 7f70637fe640 1 -- 172.21.15.150:0/3199535491 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7064157360 con 0x7f706415e940 2024-09-17T05:52:03.052 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:03.048+0000 7f7062ffd640 1 --2- 172.21.15.150:0/3199535491 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f706406f180 0x7f70640b1140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:52:03.052 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:03.049+0000 7f70637fe640 1 --2- 172.21.15.150:0/3199535491 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f706415e940 0x7f7064131a50 secure :-1 s=READY pgs=1585 cs=0 l=1 rev1=1 crypto rx=0x7f705c0098f0 tx=0x7f705c033c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:52:03.052 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:03.049+0000 7f704bfff640 1 -- 172.21.15.150:0/3199535491 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f705c031d60 con 0x7f706415e940 2024-09-17T05:52:03.052 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:03.049+0000 7f704bfff640 1 -- 172.21.15.150:0/3199535491 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f705c033e10 con 0x7f706415e940 2024-09-17T05:52:03.052 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:03.049+0000 7f7069a25640 1 -- 172.21.15.150:0/3199535491 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7064132780 con 0x7f706415e940 2024-09-17T05:52:03.052 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:03.049+0000 7f704bfff640 1 -- 172.21.15.150:0/3199535491 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f705c005260 con 0x7f706415e940 2024-09-17T05:52:03.052 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:03.049+0000 7f7069a25640 1 -- 172.21.15.150:0/3199535491 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f70641578e0 con 0x7f706415e940 2024-09-17T05:52:03.052 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:03.050+0000 7f7069a25640 1 -- 172.21.15.150:0/3199535491 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f70641324f0 con 0x7f706415e940 2024-09-17T05:52:03.053 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:03.051+0000 7f704bfff640 1 -- 172.21.15.150:0/3199535491 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 41) ==== 104144+0+0 (secure 0 0 0) 0x7f705c005400 con 0x7f706415e940 2024-09-17T05:52:03.053 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:03.051+0000 7f704bfff640 1 --2- 172.21.15.150:0/3199535491 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f705007a990 0x7f705007cea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:52:03.053 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:03.051+0000 7f704bfff640 1 -- 172.21.15.150:0/3199535491 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(115..115 src has 1..115) ==== 5907+0+0 (secure 0 0 0) 0x7f705c0bae20 con 0x7f706415e940 2024-09-17T05:52:03.053 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:03.051+0000 7f7062ffd640 1 --2- 172.21.15.150:0/3199535491 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f705007a990 0x7f705007cea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:52:03.053 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:03.052+0000 7f7062ffd640 1 --2- 172.21.15.150:0/3199535491 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f705007a990 0x7f705007cea0 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7f7054007fd0 tx=0x7f7054009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:52:03.056 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:03.056+0000 7f704bfff640 1 -- 172.21.15.150:0/3199535491 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f705c03f030 con 0x7f706415e940 2024-09-17T05:52:03.260 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:03.260+0000 7f7069a25640 1 -- 172.21.15.150:0/3199535491 --> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] -- mgr_command(tid 0: {"prefix": "fs subvolume rm", "vol_name": "cephfs", "sub_name": "sv1", "target": ["mon-mgr", ""]}) -- 0x7f70640b3d70 con 0x7f705007a990 2024-09-17T05:52:03.282 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:03.282+0000 7f704bfff640 1 -- 172.21.15.150:0/3199535491 <== mgr.4108 v2:172.21.15.176:6800/3631216395 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f70640b3d70 con 0x7f705007a990 2024-09-17T05:52:03.286 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:03.284+0000 7f7069a25640 1 -- 172.21.15.150:0/3199535491 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f705007a990 msgr2=0x7f705007cea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:52:03.286 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:03.284+0000 7f7069a25640 1 --2- 172.21.15.150:0/3199535491 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f705007a990 0x7f705007cea0 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7f7054007fd0 tx=0x7f7054009040 comp rx=0 tx=0).stop 2024-09-17T05:52:03.286 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:03.284+0000 7f7069a25640 1 -- 172.21.15.150:0/3199535491 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f706415e940 msgr2=0x7f7064131a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:52:03.286 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:03.284+0000 7f7069a25640 1 --2- 172.21.15.150:0/3199535491 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f706415e940 0x7f7064131a50 secure :-1 s=READY pgs=1585 cs=0 l=1 rev1=1 crypto rx=0x7f705c0098f0 tx=0x7f705c033c20 comp rx=0 tx=0).stop 2024-09-17T05:52:03.286 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:03.284+0000 7f7069a25640 1 -- 172.21.15.150:0/3199535491 shutdown_connections 2024-09-17T05:52:03.286 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:03.285+0000 7f7069a25640 1 --2- 172.21.15.150:0/3199535491 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f705007a990 0x7f705007cea0 unknown :-1 s=CLOSED pgs=674 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:52:03.286 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:03.285+0000 7f7069a25640 1 --2- 172.21.15.150:0/3199535491 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f706415e940 0x7f7064131a50 unknown :-1 s=CLOSED pgs=1585 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:52:03.286 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:03.285+0000 7f7069a25640 1 --2- 172.21.15.150:0/3199535491 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f70640b3960 0x7f7064150e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:52:03.286 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:03.285+0000 7f7069a25640 1 --2- 172.21.15.150:0/3199535491 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f706406f180 0x7f70640b1140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:52:03.286 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:03.285+0000 7f7069a25640 1 -- 172.21.15.150:0/3199535491 >> 172.21.15.150:0/3199535491 conn(0x7f706406d1c0 msgr2=0x7f706415a0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:52:03.286 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:03.285+0000 7f7069a25640 1 -- 172.21.15.150:0/3199535491 shutdown_connections 2024-09-17T05:52:03.286 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:03.285+0000 7f7069a25640 1 -- 172.21.15.150:0/3199535491 wait complete. 2024-09-17T05:52:03.300 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume rm --force cephfs subvol_clone59012 2024-09-17T05:52:03.423 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:03.422+0000 7fcfa029b640 1 -- 172.21.15.150:0/316208165 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fcf980b2c60 msgr2=0x7fcf980cd860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:52:03.423 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:03.422+0000 7fcfa029b640 1 --2- 172.21.15.150:0/316208165 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fcf980b2c60 0x7fcf980cd860 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fcf90005fd0 tx=0x7fcf9002a940 comp rx=0 tx=0).stop 2024-09-17T05:52:03.423 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:03.422+0000 7fcfa029b640 1 -- 172.21.15.150:0/316208165 shutdown_connections 2024-09-17T05:52:03.423 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:03.422+0000 7fcfa029b640 1 --2- 172.21.15.150:0/316208165 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fcf980b2c60 0x7fcf980cd860 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:52:03.423 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:03.422+0000 7fcfa029b640 1 --2- 172.21.15.150:0/316208165 >> v2:172.21.15.176:3300/0 conn(0x7fcf980c5b10 0x7fcf980d0230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:52:03.423 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:03.422+0000 7fcfa029b640 1 -- 172.21.15.150:0/316208165 >> 172.21.15.150:0/316208165 conn(0x7fcf980cef00 msgr2=0x7fcf980cf310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:52:03.423 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:03.422+0000 7fcfa029b640 1 -- 172.21.15.150:0/316208165 shutdown_connections 2024-09-17T05:52:03.423 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:03.422+0000 7fcfa029b640 1 -- 172.21.15.150:0/316208165 wait complete. 2024-09-17T05:52:03.424 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:03.424+0000 7fcfa029b640 1 Processor -- start 2024-09-17T05:52:03.424 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:03.424+0000 7fcfa029b640 1 -- start start 2024-09-17T05:52:03.427 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:03.425+0000 7fcfa029b640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fcf980b2c60 0x7fcf981644e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:52:03.427 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:03.425+0000 7fcfa029b640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fcf980c5b10 0x7fcf980b58a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:52:03.427 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:03.425+0000 7fcfa029b640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fcf980d0770 0x7fcf980b5de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:52:03.427 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:03.425+0000 7fcfa029b640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7fcf980cdf20 con 0x7fcf980c5b10 2024-09-17T05:52:03.427 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:03.425+0000 7fcfa029b640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fcf980cdda0 con 0x7fcf980b2c60 2024-09-17T05:52:03.427 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:03.425+0000 7fcfa029b640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fcf980ce0a0 con 0x7fcf980d0770 2024-09-17T05:52:03.428 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:03.425+0000 7fcf9d836640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fcf980c5b10 0x7fcf980b58a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:52:03.428 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:03.425+0000 7fcf9d836640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fcf980c5b10 0x7fcf980b58a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:55804/0 (socket says 172.21.15.150:55804) 2024-09-17T05:52:03.428 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:03.425+0000 7fcf9d836640 1 -- 172.21.15.150:0/1229769496 learned_addr learned my addr 172.21.15.150:0/1229769496 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:52:03.428 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:03.425+0000 7fcf9e037640 1 --2- 172.21.15.150:0/1229769496 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fcf980b2c60 0x7fcf981644e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:52:03.428 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:03.425+0000 7fcf9e838640 1 --2- 172.21.15.150:0/1229769496 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fcf980d0770 0x7fcf980b5de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:52:03.428 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:03.425+0000 7fcf9d836640 1 -- 172.21.15.150:0/1229769496 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fcf980d0770 msgr2=0x7fcf980b5de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:52:03.428 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:03.425+0000 7fcf9d836640 1 --2- 172.21.15.150:0/1229769496 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fcf980d0770 0x7fcf980b5de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:52:03.428 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:03.425+0000 7fcf9d836640 1 -- 172.21.15.150:0/1229769496 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fcf980b2c60 msgr2=0x7fcf981644e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:52:03.428 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:03.425+0000 7fcf9d836640 1 --2- 172.21.15.150:0/1229769496 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fcf980b2c60 0x7fcf981644e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:52:03.428 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:03.425+0000 7fcf9d836640 1 -- 172.21.15.150:0/1229769496 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcf98158bb0 con 0x7fcf980c5b10 2024-09-17T05:52:03.428 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:03.426+0000 7fcf9d836640 1 --2- 172.21.15.150:0/1229769496 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fcf980c5b10 0x7fcf980b58a0 secure :-1 s=READY pgs=1586 cs=0 l=1 rev1=1 crypto rx=0x7fcf8800c3a0 tx=0x7fcf8800c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:52:03.428 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:03.426+0000 7fcf8effd640 1 -- 172.21.15.150:0/1229769496 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf88017070 con 0x7fcf980c5b10 2024-09-17T05:52:03.429 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:03.426+0000 7fcfa029b640 1 -- 172.21.15.150:0/1229769496 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcf98158e90 con 0x7fcf980c5b10 2024-09-17T05:52:03.429 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:03.426+0000 7fcf8effd640 1 -- 172.21.15.150:0/1229769496 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fcf880053c0 con 0x7fcf980c5b10 2024-09-17T05:52:03.429 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:03.426+0000 7fcf8effd640 1 -- 172.21.15.150:0/1229769496 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf88003850 con 0x7fcf980c5b10 2024-09-17T05:52:03.429 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:03.426+0000 7fcfa029b640 1 -- 172.21.15.150:0/1229769496 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcf98159450 con 0x7fcf980c5b10 2024-09-17T05:52:03.430 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:03.427+0000 7fcfa029b640 1 -- 172.21.15.150:0/1229769496 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcf980d0230 con 0x7fcf980c5b10 2024-09-17T05:52:03.430 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:03.428+0000 7fcf8effd640 1 -- 172.21.15.150:0/1229769496 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 41) ==== 104144+0+0 (secure 0 0 0) 0x7fcf8801a070 con 0x7fcf980c5b10 2024-09-17T05:52:03.430 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:03.429+0000 7fcf8effd640 1 --2- 172.21.15.150:0/1229769496 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fcf7c07a960 0x7fcf7c07ce70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:52:03.430 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:03.429+0000 7fcf8effd640 1 -- 172.21.15.150:0/1229769496 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(115..115 src has 1..115) ==== 5907+0+0 (secure 0 0 0) 0x7fcf88099440 con 0x7fcf980c5b10 2024-09-17T05:52:03.430 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:03.429+0000 7fcf9e037640 1 --2- 172.21.15.150:0/1229769496 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fcf7c07a960 0x7fcf7c07ce70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:52:03.430 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:03.429+0000 7fcf9e037640 1 --2- 172.21.15.150:0/1229769496 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fcf7c07a960 0x7fcf7c07ce70 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7fcf94009660 tx=0x7fcf940091e0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:52:03.433 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:03.432+0000 7fcf8effd640 1 -- 172.21.15.150:0/1229769496 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fcf88021020 con 0x7fcf980c5b10 2024-09-17T05:52:03.642 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:03.641+0000 7fcfa029b640 1 -- 172.21.15.150:0/1229769496 --> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] -- mgr_command(tid 0: {"prefix": "fs subvolume rm", "force": true, "vol_name": "cephfs", "sub_name": "subvol_clone59012", "target": ["mon-mgr", ""]}) -- 0x7fcf98160d10 con 0x7fcf7c07a960 2024-09-17T05:52:03.661 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:03.660+0000 7fcf8effd640 1 -- 172.21.15.150:0/1229769496 <== mgr.4108 v2:172.21.15.176:6800/3631216395 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7fcf98160d10 con 0x7fcf7c07a960 2024-09-17T05:52:03.664 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:03.663+0000 7fcfa029b640 1 -- 172.21.15.150:0/1229769496 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fcf7c07a960 msgr2=0x7fcf7c07ce70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:52:03.664 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:03.663+0000 7fcfa029b640 1 --2- 172.21.15.150:0/1229769496 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fcf7c07a960 0x7fcf7c07ce70 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7fcf94009660 tx=0x7fcf940091e0 comp rx=0 tx=0).stop 2024-09-17T05:52:03.664 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:03.663+0000 7fcfa029b640 1 -- 172.21.15.150:0/1229769496 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fcf980c5b10 msgr2=0x7fcf980b58a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:52:03.664 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:03.663+0000 7fcfa029b640 1 --2- 172.21.15.150:0/1229769496 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fcf980c5b10 0x7fcf980b58a0 secure :-1 s=READY pgs=1586 cs=0 l=1 rev1=1 crypto rx=0x7fcf8800c3a0 tx=0x7fcf8800c860 comp rx=0 tx=0).stop 2024-09-17T05:52:03.664 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:03.663+0000 7fcfa029b640 1 -- 172.21.15.150:0/1229769496 shutdown_connections 2024-09-17T05:52:03.664 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:03.663+0000 7fcfa029b640 1 --2- 172.21.15.150:0/1229769496 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fcf7c07a960 0x7fcf7c07ce70 unknown :-1 s=CLOSED pgs=675 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:52:03.664 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:03.663+0000 7fcfa029b640 1 --2- 172.21.15.150:0/1229769496 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fcf980d0770 0x7fcf980b5de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:52:03.664 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:03.663+0000 7fcfa029b640 1 --2- 172.21.15.150:0/1229769496 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fcf980c5b10 0x7fcf980b58a0 unknown :-1 s=CLOSED pgs=1586 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:52:03.664 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:03.663+0000 7fcfa029b640 1 --2- 172.21.15.150:0/1229769496 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fcf980b2c60 0x7fcf981644e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:52:03.665 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:03.663+0000 7fcfa029b640 1 -- 172.21.15.150:0/1229769496 >> 172.21.15.150:0/1229769496 conn(0x7fcf980cef00 msgr2=0x7fcf98161230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:52:03.665 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:03.663+0000 7fcfa029b640 1 -- 172.21.15.150:0/1229769496 shutdown_connections 2024-09-17T05:52:03.665 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:03.663+0000 7fcfa029b640 1 -- 172.21.15.150:0/1229769496 wait complete. 2024-09-17T05:52:03.675 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume rm --force cephfs subvol_clone39571 2024-09-17T05:52:03.794 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:03.793+0000 7f02af471640 1 -- 172.21.15.150:0/2454493626 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f02a80d05c0 msgr2=0x7f02a80d0ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:52:03.795 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:03.793+0000 7f02af471640 1 --2- 172.21.15.150:0/2454493626 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f02a80d05c0 0x7f02a80d0ee0 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7f029c005fd0 tx=0x7f029c02a5d0 comp rx=0 tx=0).stop 2024-09-17T05:52:03.795 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:03.793+0000 7f02af471640 1 -- 172.21.15.150:0/2454493626 shutdown_connections 2024-09-17T05:52:03.795 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:03.793+0000 7f02af471640 1 --2- 172.21.15.150:0/2454493626 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f02a80d1420 0x7f02a80cd160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:52:03.795 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:03.793+0000 7f02af471640 1 --2- 172.21.15.150:0/2454493626 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f02a80d05c0 0x7f02a80d0ee0 unknown :-1 s=CLOSED pgs=540 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:52:03.795 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:03.793+0000 7f02af471640 1 -- 172.21.15.150:0/2454493626 >> 172.21.15.150:0/2454493626 conn(0x7f02a80cee80 msgr2=0x7f02a80cf290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:52:03.795 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:03.793+0000 7f02af471640 1 -- 172.21.15.150:0/2454493626 shutdown_connections 2024-09-17T05:52:03.795 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:03.793+0000 7f02af471640 1 -- 172.21.15.150:0/2454493626 wait complete. 2024-09-17T05:52:03.796 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:03.795+0000 7f02af471640 1 Processor -- start 2024-09-17T05:52:03.796 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:03.795+0000 7f02af471640 1 -- start start 2024-09-17T05:52:03.798 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:03.796+0000 7f02af471640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f02a80d01b0 0x7f02a81f4240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:52:03.798 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:03.796+0000 7f02af471640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f02a80d05c0 0x7f02a80cbdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:52:03.798 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:03.796+0000 7f02af471640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f02a80d1420 0x7f02a815f850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:52:03.799 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:03.796+0000 7f02af471640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f02a809baf0 con 0x7f02a80d05c0 2024-09-17T05:52:03.799 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:03.796+0000 7f02af471640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f02a80b5960 con 0x7f02a80d01b0 2024-09-17T05:52:03.799 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:03.796+0000 7f02af471640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f02a809bc70 con 0x7f02a80d1420 2024-09-17T05:52:03.799 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:03.797+0000 7f02aca0c640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f02a80d05c0 0x7f02a80cbdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:52:03.799 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:03.797+0000 7f02aca0c640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f02a80d05c0 0x7f02a80cbdc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:55816/0 (socket says 172.21.15.150:55816) 2024-09-17T05:52:03.799 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:03.797+0000 7f02aca0c640 1 -- 172.21.15.150:0/3362429945 learned_addr learned my addr 172.21.15.150:0/3362429945 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:52:03.799 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:03.797+0000 7f02ada0e640 1 --2- 172.21.15.150:0/3362429945 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f02a80d1420 0x7f02a815f850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:52:03.799 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:03.797+0000 7f02ad20d640 1 --2- 172.21.15.150:0/3362429945 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f02a80d01b0 0x7f02a81f4240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:52:03.799 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:03.797+0000 7f02aca0c640 1 -- 172.21.15.150:0/3362429945 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f02a80d1420 msgr2=0x7f02a815f850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:52:03.799 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:03.797+0000 7f02aca0c640 1 --2- 172.21.15.150:0/3362429945 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f02a80d1420 0x7f02a815f850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:52:03.799 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:03.797+0000 7f02aca0c640 1 -- 172.21.15.150:0/3362429945 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f02a80d01b0 msgr2=0x7f02a81f4240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:52:03.799 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:03.797+0000 7f02aca0c640 1 --2- 172.21.15.150:0/3362429945 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f02a80d01b0 0x7f02a81f4240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:52:03.800 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:03.797+0000 7f02aca0c640 1 -- 172.21.15.150:0/3362429945 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f02a81f4780 con 0x7f02a80d05c0 2024-09-17T05:52:03.800 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:03.797+0000 7f02aca0c640 1 --2- 172.21.15.150:0/3362429945 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f02a80d05c0 0x7f02a80cbdc0 secure :-1 s=READY pgs=1587 cs=0 l=1 rev1=1 crypto rx=0x7f029c000c00 tx=0x7f029c0035f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:52:03.800 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:03.797+0000 7f02a5ffb640 1 -- 172.21.15.150:0/3362429945 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f029c03e030 con 0x7f02a80d05c0 2024-09-17T05:52:03.800 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:03.797+0000 7f02af471640 1 -- 172.21.15.150:0/3362429945 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f02a80cc300 con 0x7f02a80d05c0 2024-09-17T05:52:03.800 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:03.797+0000 7f02a5ffb640 1 -- 172.21.15.150:0/3362429945 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f029c003b00 con 0x7f02a80d05c0 2024-09-17T05:52:03.800 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:03.797+0000 7f02a5ffb640 1 -- 172.21.15.150:0/3362429945 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f029c035040 con 0x7f02a80d05c0 2024-09-17T05:52:03.800 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:03.798+0000 7f02af471640 1 -- 172.21.15.150:0/3362429945 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f02a815ea90 con 0x7f02a80d05c0 2024-09-17T05:52:03.801 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:03.799+0000 7f02af471640 1 -- 172.21.15.150:0/3362429945 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f02a80d0ee0 con 0x7f02a80d05c0 2024-09-17T05:52:03.801 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:03.799+0000 7f02a5ffb640 1 -- 172.21.15.150:0/3362429945 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 41) ==== 104144+0+0 (secure 0 0 0) 0x7f029c041030 con 0x7f02a80d05c0 2024-09-17T05:52:03.801 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:03.800+0000 7f02a5ffb640 1 --2- 172.21.15.150:0/3362429945 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f029407a960 0x7f029407ce70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:52:03.801 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:03.800+0000 7f02a5ffb640 1 -- 172.21.15.150:0/3362429945 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(115..115 src has 1..115) ==== 5907+0+0 (secure 0 0 0) 0x7f029c0ba630 con 0x7f02a80d05c0 2024-09-17T05:52:03.801 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:03.800+0000 7f02ad20d640 1 --2- 172.21.15.150:0/3362429945 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f029407a960 0x7f029407ce70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:52:03.801 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:03.801+0000 7f02ad20d640 1 --2- 172.21.15.150:0/3362429945 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f029407a960 0x7f029407ce70 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7f0298007fd0 tx=0x7f0298009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:52:03.804 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:03.804+0000 7f02a5ffb640 1 -- 172.21.15.150:0/3362429945 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f02a81f4780 con 0x7f02a80d05c0 2024-09-17T05:52:04.005 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:04.005+0000 7f02af471640 1 -- 172.21.15.150:0/3362429945 --> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] -- mgr_command(tid 0: {"prefix": "fs subvolume rm", "force": true, "vol_name": "cephfs", "sub_name": "subvol_clone39571", "target": ["mon-mgr", ""]}) -- 0x7f02a81e64d0 con 0x7f029407a960 2024-09-17T05:52:04.022 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:04.022+0000 7f02a5ffb640 1 -- 172.21.15.150:0/3362429945 <== mgr.4108 v2:172.21.15.176:6800/3631216395 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f02a81e64d0 con 0x7f029407a960 2024-09-17T05:52:04.025 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:04.024+0000 7f02af471640 1 -- 172.21.15.150:0/3362429945 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f029407a960 msgr2=0x7f029407ce70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:52:04.025 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:04.024+0000 7f02af471640 1 --2- 172.21.15.150:0/3362429945 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f029407a960 0x7f029407ce70 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7f0298007fd0 tx=0x7f0298009040 comp rx=0 tx=0).stop 2024-09-17T05:52:04.025 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:04.024+0000 7f02af471640 1 -- 172.21.15.150:0/3362429945 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f02a80d05c0 msgr2=0x7f02a80cbdc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:52:04.025 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:04.024+0000 7f02af471640 1 --2- 172.21.15.150:0/3362429945 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f02a80d05c0 0x7f02a80cbdc0 secure :-1 s=READY pgs=1587 cs=0 l=1 rev1=1 crypto rx=0x7f029c000c00 tx=0x7f029c0035f0 comp rx=0 tx=0).stop 2024-09-17T05:52:04.025 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:04.024+0000 7f02af471640 1 -- 172.21.15.150:0/3362429945 shutdown_connections 2024-09-17T05:52:04.026 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:04.024+0000 7f02af471640 1 --2- 172.21.15.150:0/3362429945 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f029407a960 0x7f029407ce70 unknown :-1 s=CLOSED pgs=676 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:52:04.026 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:04.024+0000 7f02af471640 1 --2- 172.21.15.150:0/3362429945 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f02a80d1420 0x7f02a815f850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:52:04.026 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:04.024+0000 7f02af471640 1 --2- 172.21.15.150:0/3362429945 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f02a80d05c0 0x7f02a80cbdc0 unknown :-1 s=CLOSED pgs=1587 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:52:04.026 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:04.024+0000 7f02af471640 1 --2- 172.21.15.150:0/3362429945 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f02a80d01b0 0x7f02a81f4240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:52:04.026 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:04.024+0000 7f02af471640 1 -- 172.21.15.150:0/3362429945 >> 172.21.15.150:0/3362429945 conn(0x7f02a80cee80 msgr2=0x7f02a815caf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:52:04.026 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:04.024+0000 7f02af471640 1 -- 172.21.15.150:0/3362429945 shutdown_connections 2024-09-17T05:52:04.026 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:04.024+0000 7f02af471640 1 -- 172.21.15.150:0/3362429945 wait complete. 2024-09-17T05:52:04.038 DEBUG:teuthology.orchestra.run.smithi150:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'stat -c %h /home/ubuntu/cephtest/mnt.0/./volumes/_deleting') 2024-09-17T05:52:04.089 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:04 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-17T05:52:04.093 INFO:teuthology.orchestra.run.smithi150.stdout:2 2024-09-17T05:52:04.093 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:04 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T05:52:04.100 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mgr mgr/volumes/max_concurrent_clones 4 2024-09-17T05:52:04.223 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:04.222+0000 7f195cea4640 1 -- 172.21.15.150:0/1035071578 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f19580b12e0 msgr2=0x7f19580b4e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:52:04.223 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:04.222+0000 7f195cea4640 1 --2- 172.21.15.150:0/1035071578 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f19580b12e0 0x7f19580b4e50 secure :-1 s=READY pgs=1588 cs=0 l=1 rev1=1 crypto rx=0x7f1950009900 tx=0x7f195002a4d0 comp rx=0 tx=0).stop 2024-09-17T05:52:04.223 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:04.222+0000 7f195cea4640 1 -- 172.21.15.150:0/1035071578 shutdown_connections 2024-09-17T05:52:04.223 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:04.222+0000 7f195cea4640 1 --2- 172.21.15.150:0/1035071578 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f19580b12e0 0x7f19580b4e50 unknown :-1 s=CLOSED pgs=1588 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:52:04.223 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:04.222+0000 7f195cea4640 1 --2- 172.21.15.150:0/1035071578 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f19580b0990 0x7f19580b0da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:52:04.223 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:04.222+0000 7f195cea4640 1 -- 172.21.15.150:0/1035071578 >> 172.21.15.150:0/1035071578 conn(0x7f19580b2e80 msgr2=0x7f19580b3290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:52:04.224 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:04.222+0000 7f195cea4640 1 -- 172.21.15.150:0/1035071578 shutdown_connections 2024-09-17T05:52:04.224 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:04.222+0000 7f195cea4640 1 -- 172.21.15.150:0/1035071578 wait complete. 2024-09-17T05:52:04.224 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:04.224+0000 7f195cea4640 1 Processor -- start 2024-09-17T05:52:04.224 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:04.224+0000 7f195cea4640 1 -- start start 2024-09-17T05:52:04.227 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:04.225+0000 7f195cea4640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f19580b0990 0x7f195809be60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:52:04.227 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:04.225+0000 7f195cea4640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f19580b12e0 0x7f19581f6600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:52:04.227 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:04.225+0000 7f195cea4640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f19580b6550 0x7f195814c6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:52:04.227 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:04.225+0000 7f195cea4640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f19580b1a80 con 0x7f19580b6550 2024-09-17T05:52:04.227 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:04.225+0000 7f195cea4640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f19580b1900 con 0x7f19580b12e0 2024-09-17T05:52:04.227 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:04.225+0000 7f195cea4640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f19580b5390 con 0x7f19580b0990 2024-09-17T05:52:04.228 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:04.225+0000 7f1956d9d640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f19580b6550 0x7f195814c6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:52:04.228 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:04.225+0000 7f1956d9d640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f19580b6550 0x7f195814c6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:55836/0 (socket says 172.21.15.150:55836) 2024-09-17T05:52:04.228 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:04.225+0000 7f1956d9d640 1 -- 172.21.15.150:0/1456854674 learned_addr learned my addr 172.21.15.150:0/1456854674 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:52:04.228 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:04.225+0000 7f195659c640 1 --2- 172.21.15.150:0/1456854674 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f19580b0990 0x7f195809be60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:52:04.228 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:04.225+0000 7f1955d9b640 1 --2- 172.21.15.150:0/1456854674 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f19580b12e0 0x7f19581f6600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:52:04.228 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:04.226+0000 7f1956d9d640 1 -- 172.21.15.150:0/1456854674 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f19580b0990 msgr2=0x7f195809be60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:52:04.228 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:04.226+0000 7f1956d9d640 1 --2- 172.21.15.150:0/1456854674 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f19580b0990 0x7f195809be60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:52:04.228 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:04.226+0000 7f1956d9d640 1 -- 172.21.15.150:0/1456854674 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f19580b12e0 msgr2=0x7f19581f6600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:52:04.228 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:04.226+0000 7f1956d9d640 1 --2- 172.21.15.150:0/1456854674 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f19580b12e0 0x7f19581f6600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:52:04.228 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:04.226+0000 7f1956d9d640 1 -- 172.21.15.150:0/1456854674 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f19581f6b40 con 0x7f19580b6550 2024-09-17T05:52:04.228 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:04.226+0000 7f1956d9d640 1 --2- 172.21.15.150:0/1456854674 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f19580b6550 0x7f195814c6e0 secure :-1 s=READY pgs=1589 cs=0 l=1 rev1=1 crypto rx=0x7f1950006010 tx=0x7f19500039e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:52:04.228 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:04.226+0000 7f1946ffd640 1 -- 172.21.15.150:0/1456854674 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f195003e030 con 0x7f19580b6550 2024-09-17T05:52:04.228 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:04.226+0000 7f1946ffd640 1 -- 172.21.15.150:0/1456854674 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f19500047a0 con 0x7f19580b6550 2024-09-17T05:52:04.229 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:04.226+0000 7f195cea4640 1 -- 172.21.15.150:0/1456854674 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f19580c4ea0 con 0x7f19580b6550 2024-09-17T05:52:04.229 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:04.226+0000 7f1946ffd640 1 -- 172.21.15.150:0/1456854674 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1950035040 con 0x7f19580b6550 2024-09-17T05:52:04.229 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:04.226+0000 7f195cea4640 1 -- 172.21.15.150:0/1456854674 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f195809b380 con 0x7f19580b6550 2024-09-17T05:52:04.230 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:04.227+0000 7f195cea4640 1 -- 172.21.15.150:0/1456854674 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f19580b0da0 con 0x7f19580b6550 2024-09-17T05:52:04.230 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:04.228+0000 7f1946ffd640 1 -- 172.21.15.150:0/1456854674 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 42) ==== 104195+0+0 (secure 0 0 0) 0x7f1950041030 con 0x7f19580b6550 2024-09-17T05:52:04.230 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:04.229+0000 7f1946ffd640 1 --2- 172.21.15.150:0/1456854674 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f193807aa20 0x7f193807cf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:52:04.230 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:04.229+0000 7f1946ffd640 1 -- 172.21.15.150:0/1456854674 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(115..115 src has 1..115) ==== 5907+0+0 (secure 0 0 0) 0x7f19500ba590 con 0x7f19580b6550 2024-09-17T05:52:04.230 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:04.229+0000 7f195659c640 1 --2- 172.21.15.150:0/1456854674 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f193807aa20 0x7f193807cf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:52:04.230 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:04.230+0000 7f195659c640 1 --2- 172.21.15.150:0/1456854674 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f193807aa20 0x7f193807cf30 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7f1948009f20 tx=0x7f19480094d0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:52:04.234 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:04.233+0000 7f1946ffd640 1 -- 172.21.15.150:0/1456854674 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f19581f6b40 con 0x7f19580b6550 2024-09-17T05:52:04.443 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:04.443+0000 7f195cea4640 1 -- 172.21.15.150:0/1456854674 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command([{prefix=config set, name=mgr/volumes/max_concurrent_clones}] v 0) -- 0x7f19580c50d0 con 0x7f19580b6550 2024-09-17T05:52:04.444 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:04.443+0000 7f1946ffd640 1 -- 172.21.15.150:0/1456854674 <== mon.0 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/volumes/max_concurrent_clones}]=0 v53)=0 v53) ==== 131+0+0 (secure 0 0 0) 0x7f19500844e0 con 0x7f19580b6550 2024-09-17T05:52:04.448 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:04.447+0000 7f195cea4640 1 -- 172.21.15.150:0/1456854674 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f193807aa20 msgr2=0x7f193807cf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:52:04.448 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:04.447+0000 7f195cea4640 1 --2- 172.21.15.150:0/1456854674 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f193807aa20 0x7f193807cf30 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7f1948009f20 tx=0x7f19480094d0 comp rx=0 tx=0).stop 2024-09-17T05:52:04.448 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:04.447+0000 7f195cea4640 1 -- 172.21.15.150:0/1456854674 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f19580b6550 msgr2=0x7f195814c6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:52:04.448 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:04.447+0000 7f195cea4640 1 --2- 172.21.15.150:0/1456854674 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f19580b6550 0x7f195814c6e0 secure :-1 s=READY pgs=1589 cs=0 l=1 rev1=1 crypto rx=0x7f1950006010 tx=0x7f19500039e0 comp rx=0 tx=0).stop 2024-09-17T05:52:04.448 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:04.447+0000 7f195cea4640 1 -- 172.21.15.150:0/1456854674 shutdown_connections 2024-09-17T05:52:04.448 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:04.447+0000 7f195cea4640 1 --2- 172.21.15.150:0/1456854674 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f19580b12e0 0x7f19581f6600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:52:04.448 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:04.447+0000 7f195cea4640 1 --2- 172.21.15.150:0/1456854674 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f193807aa20 0x7f193807cf30 unknown :-1 s=CLOSED pgs=677 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:52:04.449 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:04.447+0000 7f195cea4640 1 --2- 172.21.15.150:0/1456854674 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f19580b6550 0x7f195814c6e0 unknown :-1 s=CLOSED pgs=1589 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:52:04.449 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:04.447+0000 7f195cea4640 1 --2- 172.21.15.150:0/1456854674 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f19580b0990 0x7f195809be60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:52:04.449 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:04.447+0000 7f195cea4640 1 -- 172.21.15.150:0/1456854674 >> 172.21.15.150:0/1456854674 conn(0x7f19580b2e80 msgr2=0x7f195815b8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:52:04.449 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:04.447+0000 7f195cea4640 1 -- 172.21.15.150:0/1456854674 shutdown_connections 2024-09-17T05:52:04.449 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:04.447+0000 7f195cea4640 1 -- 172.21.15.150:0/1456854674 wait complete. 2024-09-17T05:52:04.469 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-17T05:52:04.469 DEBUG:teuthology.orchestra.run.smithi150:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-17T05:52:04.517 DEBUG:teuthology.orchestra.run.smithi176:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-17T05:52:04.555 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-17T05:52:04.555 INFO:tasks.cephfs.mount:Terminating background process 2024-09-17T05:52:04.555 DEBUG:teuthology.orchestra.run.smithi150:> set -ex 2024-09-17T05:52:04.555 DEBUG:teuthology.orchestra.run.smithi150:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T05:52:04.571 DEBUG:teuthology.orchestra.run.smithi150:> set -ex 2024-09-17T05:52:04.571 DEBUG:teuthology.orchestra.run.smithi150:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T05:52:04.628 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-17T05:52:04.783 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:04.782+0000 7fb887620640 1 -- 172.21.15.150:0/3095985360 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb868004800 msgr2=0x7fb868004c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:52:04.784 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:04.782+0000 7fb887620640 1 --2- 172.21.15.150:0/3095985360 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb868004800 0x7fb868004c10 secure :-1 s=READY pgs=1591 cs=0 l=1 rev1=1 crypto rx=0x7fb8740017d0 tx=0x7fb868005830 comp rx=0 tx=0).stop 2024-09-17T05:52:04.784 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:04.782+0000 7fb885bbd640 1 -- 172.21.15.150:0/3095985360 reap_dead start 2024-09-17T05:52:04.784 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:04.782+0000 7fb887620640 1 -- 172.21.15.150:0/3095985360 shutdown_connections 2024-09-17T05:52:04.784 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:04.782+0000 7fb887620640 1 -- 172.21.15.150:0/3095985360 >> 172.21.15.150:0/3095985360 conn(0x7fb8800d4680 msgr2=0x7fb8800d4a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:52:04.784 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:04.782+0000 7fb887620640 1 -- 172.21.15.150:0/3095985360 shutdown_connections 2024-09-17T05:52:04.784 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:04.782+0000 7fb887620640 1 -- 172.21.15.150:0/3095985360 wait complete. 2024-09-17T05:52:04.785 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:04.784+0000 7fb887620640 1 Processor -- start 2024-09-17T05:52:04.785 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:04.784+0000 7fb887620640 1 -- start start 2024-09-17T05:52:04.787 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:04.785+0000 7fb887620640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb868004800 0x7fb8800b6030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:52:04.787 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:04.785+0000 7fb887620640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb880167310 0x7fb8800b2320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:52:04.788 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:04.785+0000 7fb887620640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb880167720 0x7fb8800b2860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:52:04.788 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:04.785+0000 7fb887620640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7fb8800d0600 con 0x7fb880167720 2024-09-17T05:52:04.788 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:04.785+0000 7fb887620640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fb8800d0480 con 0x7fb868004800 2024-09-17T05:52:04.788 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:04.785+0000 7fb887620640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fb8800d0780 con 0x7fb880167310 2024-09-17T05:52:04.788 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:04.786+0000 7fb885bbd640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb880167720 0x7fb8800b2860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:52:04.788 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:04.786+0000 7fb885bbd640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb880167720 0x7fb8800b2860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:55856/0 (socket says 172.21.15.150:55856) 2024-09-17T05:52:04.788 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:04.786+0000 7fb885bbd640 1 -- 172.21.15.150:0/3428289076 learned_addr learned my addr 172.21.15.150:0/3428289076 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:52:04.788 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:04.786+0000 7fb8853bc640 1 --2- 172.21.15.150:0/3428289076 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb868004800 0x7fb8800b6030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:52:04.788 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:04.786+0000 7fb884bbb640 1 --2- 172.21.15.150:0/3428289076 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb880167310 0x7fb8800b2320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:52:04.788 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:04.786+0000 7fb885bbd640 1 -- 172.21.15.150:0/3428289076 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb880167310 msgr2=0x7fb8800b2320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:52:04.788 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:04.786+0000 7fb885bbd640 1 --2- 172.21.15.150:0/3428289076 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb880167310 0x7fb8800b2320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:52:04.789 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:04.786+0000 7fb885bbd640 1 -- 172.21.15.150:0/3428289076 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb868004800 msgr2=0x7fb8800b6030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:52:04.789 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:04.786+0000 7fb885bbd640 1 --2- 172.21.15.150:0/3428289076 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb868004800 0x7fb8800b6030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:52:04.789 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:04.786+0000 7fb885bbd640 1 -- 172.21.15.150:0/3428289076 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb8801f9b90 con 0x7fb880167720 2024-09-17T05:52:04.789 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:04.786+0000 7fb885bbd640 1 --2- 172.21.15.150:0/3428289076 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb880167720 0x7fb8800b2860 secure :-1 s=READY pgs=1592 cs=0 l=1 rev1=1 crypto rx=0x7fb870005fd0 tx=0x7fb87000f3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:52:04.789 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:04.786+0000 7fb87dffb640 1 -- 172.21.15.150:0/3428289076 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb870004b20 con 0x7fb880167720 2024-09-17T05:52:04.789 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:04.786+0000 7fb87dffb640 1 -- 172.21.15.150:0/3428289076 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb870004cc0 con 0x7fb880167720 2024-09-17T05:52:04.789 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:04.786+0000 7fb887620640 1 -- 172.21.15.150:0/3428289076 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb8801f8dd0 con 0x7fb880167720 2024-09-17T05:52:04.789 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:04.786+0000 7fb87dffb640 1 -- 172.21.15.150:0/3428289076 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb870003bd0 con 0x7fb880167720 2024-09-17T05:52:04.789 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:04.786+0000 7fb887620640 1 -- 172.21.15.150:0/3428289076 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb8801f9390 con 0x7fb880167720 2024-09-17T05:52:04.790 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:04.788+0000 7fb887620640 1 -- 172.21.15.150:0/3428289076 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb88008d100 con 0x7fb880167720 2024-09-17T05:52:04.790 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:04.788+0000 7fb87dffb640 1 -- 172.21.15.150:0/3428289076 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 42) ==== 104195+0+0 (secure 0 0 0) 0x7fb870004030 con 0x7fb880167720 2024-09-17T05:52:04.790 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:04.789+0000 7fb87dffb640 1 --2- 172.21.15.150:0/3428289076 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fb86c07a9f0 0x7fb86c07cf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:52:04.790 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:04.789+0000 7fb87dffb640 1 -- 172.21.15.150:0/3428289076 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(115..115 src has 1..115) ==== 5907+0+0 (secure 0 0 0) 0x7fb870099f80 con 0x7fb880167720 2024-09-17T05:52:04.790 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:04.789+0000 7fb8853bc640 1 --2- 172.21.15.150:0/3428289076 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fb86c07a9f0 0x7fb86c07cf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:52:04.790 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:04.789+0000 7fb8853bc640 1 --2- 172.21.15.150:0/3428289076 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fb86c07a9f0 0x7fb86c07cf00 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7fb8780019b0 tx=0x7fb878006640 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:52:04.794 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:04.793+0000 7fb87dffb640 1 -- 172.21.15.150:0/3428289076 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fb88008d100 con 0x7fb880167720 2024-09-17T05:52:04.980 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:04.979+0000 7fb887620640 1 -- 172.21.15.150:0/3428289076 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7fb8800b67a0 con 0x7fb880167720 2024-09-17T05:52:04.980 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:04.980+0000 7fb87dffb640 1 -- 172.21.15.150:0/3428289076 <== mon.0 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v115) ==== 80+0+0 (secure 0 0 0) 0x7fb870063900 con 0x7fb880167720 2024-09-17T05:52:04.980 INFO:teuthology.orchestra.run.smithi150.stderr:listed 0 entries 2024-09-17T05:52:04.983 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:04.982+0000 7fb887620640 1 -- 172.21.15.150:0/3428289076 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fb86c07a9f0 msgr2=0x7fb86c07cf00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:52:04.983 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:04.982+0000 7fb887620640 1 --2- 172.21.15.150:0/3428289076 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fb86c07a9f0 0x7fb86c07cf00 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7fb8780019b0 tx=0x7fb878006640 comp rx=0 tx=0).stop 2024-09-17T05:52:04.983 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:04.982+0000 7fb887620640 1 -- 172.21.15.150:0/3428289076 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb880167720 msgr2=0x7fb8800b2860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:52:04.983 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:04.982+0000 7fb887620640 1 --2- 172.21.15.150:0/3428289076 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb880167720 0x7fb8800b2860 secure :-1 s=READY pgs=1592 cs=0 l=1 rev1=1 crypto rx=0x7fb870005fd0 tx=0x7fb87000f3c0 comp rx=0 tx=0).stop 2024-09-17T05:52:04.983 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:04.982+0000 7fb887620640 1 -- 172.21.15.150:0/3428289076 shutdown_connections 2024-09-17T05:52:04.983 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:04.982+0000 7fb887620640 1 --2- 172.21.15.150:0/3428289076 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fb86c07a9f0 0x7fb86c07cf00 unknown :-1 s=CLOSED pgs=678 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:52:04.984 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:04.982+0000 7fb887620640 1 --2- 172.21.15.150:0/3428289076 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb880167720 0x7fb8800b2860 unknown :-1 s=CLOSED pgs=1592 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:52:04.984 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:04.982+0000 7fb887620640 1 --2- 172.21.15.150:0/3428289076 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb880167310 0x7fb8800b2320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:52:04.984 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:04.982+0000 7fb887620640 1 --2- 172.21.15.150:0/3428289076 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb868004800 0x7fb8800b6030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:52:04.984 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:04.982+0000 7fb887620640 1 -- 172.21.15.150:0/3428289076 >> 172.21.15.150:0/3428289076 conn(0x7fb8800d4680 msgr2=0x7fb8800d4a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:52:04.984 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:04.982+0000 7fb887620640 1 -- 172.21.15.150:0/3428289076 shutdown_connections 2024-09-17T05:52:04.984 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:04.982+0000 7fb887620640 1 -- 172.21.15.150:0/3428289076 wait complete. 2024-09-17T05:52:04.994 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-09-17T05:52:04.995 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:52:04.995 DEBUG:teuthology.orchestra.run.smithi150:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-09-17T05:52:05.035 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi150.front.sepia.ceph.com 2024-09-17T05:52:05.035 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:52:05.035 DEBUG:teuthology.orchestra.run.smithi150:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-17T05:52:05.091 INFO:tasks.cephfs.mount:Terminating background process 2024-09-17T05:52:05.091 DEBUG:teuthology.orchestra.run.smithi176:> set -ex 2024-09-17T05:52:05.091 DEBUG:teuthology.orchestra.run.smithi176:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T05:52:05.108 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056030,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497468k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=3379 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248732k,nr_inodes=812183,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497468k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-17T05:52:05.108 INFO:tasks.cephfs.mount:Terminating background process 2024-09-17T05:52:05.108 DEBUG:teuthology.orchestra.run.smithi150:> set -ex 2024-09-17T05:52:05.108 DEBUG:teuthology.orchestra.run.smithi150:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T05:52:05.147 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056027,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497464k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=18693 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248728k,nr_inodes=812182,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497464k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-17T05:52:05.148 INFO:tasks.cephfs.mount:Terminating background process 2024-09-17T05:52:05.148 DEBUG:teuthology.orchestra.run.smithi176:> set -ex 2024-09-17T05:52:05.148 DEBUG:teuthology.orchestra.run.smithi176:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T05:52:05.165 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056030,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497468k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=3379 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248732k,nr_inodes=812183,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497468k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-17T05:52:05.166 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T05:52:05.302 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:05.301+0000 7f7ef1d52640 1 -- 172.21.15.150:0/3557907309 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7eec0ce2a0 msgr2=0x7f7eec0ce6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:52:05.302 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:05.301+0000 7f7ef1d52640 1 --2- 172.21.15.150:0/3557907309 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7eec0ce2a0 0x7f7eec0ce6b0 secure :-1 s=READY pgs=1594 cs=0 l=1 rev1=1 crypto rx=0x7f7eec073d00 tx=0x7f7ee002a530 comp rx=0 tx=0).stop 2024-09-17T05:52:05.302 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:05.301+0000 7f7ef1d52640 1 -- 172.21.15.150:0/3557907309 shutdown_connections 2024-09-17T05:52:05.302 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:05.301+0000 7f7ef1d52640 1 --2- 172.21.15.150:0/3557907309 >> v2:172.21.15.176:3300/0 conn(0x7f7eec0b5b50 0x7f7eec0b5f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:52:05.302 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:05.301+0000 7f7ef1d52640 1 --2- 172.21.15.150:0/3557907309 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7eec0ce2a0 0x7f7eec0ce6b0 unknown :-1 s=CLOSED pgs=1594 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:52:05.302 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:05.301+0000 7f7ef1d52640 1 -- 172.21.15.150:0/3557907309 >> 172.21.15.150:0/3557907309 conn(0x7f7eec0d06d0 msgr2=0x7f7eec0d0ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:52:05.302 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:05.301+0000 7f7ef1d52640 1 -- 172.21.15.150:0/3557907309 shutdown_connections 2024-09-17T05:52:05.302 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:05.301+0000 7f7ef1d52640 1 -- 172.21.15.150:0/3557907309 wait complete. 2024-09-17T05:52:05.303 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:05.302+0000 7f7ef1d52640 1 Processor -- start 2024-09-17T05:52:05.303 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:05.303+0000 7f7ef1d52640 1 -- start start 2024-09-17T05:52:05.306 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:05.304+0000 7f7ef1d52640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7eec0719a0 0x7f7eec1f3490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:52:05.306 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:05.304+0000 7f7ef1d52640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7eec0b5b50 0x7f7eec13fd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:52:05.306 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:05.304+0000 7f7ef1d52640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7eec0ce2a0 0x7f7eec1f75f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:52:05.306 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:05.304+0000 7f7ef1d52640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f7eec15d4a0 con 0x7f7eec0b5b50 2024-09-17T05:52:05.306 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:05.304+0000 7f7ef1d52640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f7eec0b65e0 con 0x7f7eec0719a0 2024-09-17T05:52:05.306 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:05.304+0000 7f7ef1d52640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f7eec15d620 con 0x7f7eec0ce2a0 2024-09-17T05:52:05.306 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:05.304+0000 7f7eeaffd640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7eec0b5b50 0x7f7eec13fd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:52:05.306 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:05.304+0000 7f7eeaffd640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7eec0b5b50 0x7f7eec13fd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:55868/0 (socket says 172.21.15.150:55868) 2024-09-17T05:52:05.306 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:05.304+0000 7f7eeaffd640 1 -- 172.21.15.150:0/2695359255 learned_addr learned my addr 172.21.15.150:0/2695359255 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:52:05.306 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:05.304+0000 7f7eeb7fe640 1 --2- 172.21.15.150:0/2695359255 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7eec0719a0 0x7f7eec1f3490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:52:05.307 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:05.304+0000 7f7eebfff640 1 --2- 172.21.15.150:0/2695359255 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7eec0ce2a0 0x7f7eec1f75f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:52:05.307 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:05.304+0000 7f7eeaffd640 1 -- 172.21.15.150:0/2695359255 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7eec0ce2a0 msgr2=0x7f7eec1f75f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:52:05.307 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:05.304+0000 7f7eeaffd640 1 --2- 172.21.15.150:0/2695359255 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7eec0ce2a0 0x7f7eec1f75f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:52:05.307 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:05.304+0000 7f7eeaffd640 1 -- 172.21.15.150:0/2695359255 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7eec0719a0 msgr2=0x7f7eec1f3490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:52:05.307 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:05.304+0000 7f7eeaffd640 1 --2- 172.21.15.150:0/2695359255 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7eec0719a0 0x7f7eec1f3490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:52:05.307 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:05.304+0000 7f7eeaffd640 1 -- 172.21.15.150:0/2695359255 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7eec1f3d00 con 0x7f7eec0b5b50 2024-09-17T05:52:05.307 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:05.305+0000 7f7eeaffd640 1 --2- 172.21.15.150:0/2695359255 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7eec0b5b50 0x7f7eec13fd30 secure :-1 s=READY pgs=1595 cs=0 l=1 rev1=1 crypto rx=0x7f7ee002ab20 tx=0x7f7ee0033c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:52:05.307 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:05.305+0000 7f7ed3fff640 1 -- 172.21.15.150:0/2695359255 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ee0005c90 con 0x7f7eec0b5b50 2024-09-17T05:52:05.307 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:05.305+0000 7f7ed3fff640 1 -- 172.21.15.150:0/2695359255 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f7ee0031e50 con 0x7f7eec0b5b50 2024-09-17T05:52:05.307 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:05.305+0000 7f7ed3fff640 1 -- 172.21.15.150:0/2695359255 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ee0005240 con 0x7f7eec0b5b50 2024-09-17T05:52:05.307 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:05.305+0000 7f7ef1d52640 1 -- 172.21.15.150:0/2695359255 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7eec1f3fe0 con 0x7f7eec0b5b50 2024-09-17T05:52:05.307 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:05.305+0000 7f7ef1d52640 1 -- 172.21.15.150:0/2695359255 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7eec1e50d0 con 0x7f7eec0b5b50 2024-09-17T05:52:05.308 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:05.306+0000 7f7ef1d52640 1 -- 172.21.15.150:0/2695359255 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7eec1f3a70 con 0x7f7eec0b5b50 2024-09-17T05:52:05.308 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:05.306+0000 7f7ed3fff640 1 -- 172.21.15.150:0/2695359255 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 42) ==== 104195+0+0 (secure 0 0 0) 0x7f7ee00053e0 con 0x7f7eec0b5b50 2024-09-17T05:52:05.308 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:05.307+0000 7f7ed3fff640 1 --2- 172.21.15.150:0/2695359255 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f7ed807a9f0 0x7f7ed807cf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:52:05.309 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:05.307+0000 7f7ed3fff640 1 -- 172.21.15.150:0/2695359255 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(115..115 src has 1..115) ==== 5907+0+0 (secure 0 0 0) 0x7f7ee00bad30 con 0x7f7eec0b5b50 2024-09-17T05:52:05.309 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:05.307+0000 7f7eeb7fe640 1 --2- 172.21.15.150:0/2695359255 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f7ed807a9f0 0x7f7ed807cf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:52:05.309 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:05.308+0000 7f7eeb7fe640 1 --2- 172.21.15.150:0/2695359255 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f7ed807a9f0 0x7f7ed807cf00 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7f7edc000f60 tx=0x7f7edc009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:52:05.312 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:05.312+0000 7f7ed3fff640 1 -- 172.21.15.150:0/2695359255 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f7ee003f030 con 0x7f7eec0b5b50 2024-09-17T05:52:05.661 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:05.660+0000 7f7ef1d52640 1 -- 172.21.15.150:0/2695359255 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f7eec15db40 con 0x7f7eec0b5b50 2024-09-17T05:52:05.661 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:05.660+0000 7f7ed3fff640 1 -- 172.21.15.150:0/2695359255 <== mon.0 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 71 v71) ==== 94+0+5237 (secure 0 0 0) 0x7f7ee0031770 con 0x7f7eec0b5b50 2024-09-17T05:52:05.661 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-09-17T05:52:05.662 INFO:teuthology.orchestra.run.smithi150.stdout:{"epoch":71,"btime":"2024-09-17T05:51:27:572576+0000","default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6779,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6836/2908904841","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6835","nonce":2908904841},{"type":"v1","addr":"172.21.15.176:6836","nonce":2908904841}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":65},{"gid":6782,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6837/2764909757","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6834","nonce":2764909757},{"type":"v1","addr":"172.21.15.176:6837","nonce":2764909757}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":65},{"gid":8568,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6834/1970670297","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6832","nonce":1970670297},{"type":"v1","addr":"172.21.15.150:6834","nonce":1970670297}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":64}],"filesystems":[{"mdsmap":{"epoch":70,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T05:51:14.699714+0000","modified":"2024-09-17T05:51:17.724183+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":8571},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8571":{"gid":8571,"name":"c","rank":0,"incarnation":66,"state":"up:active","state_seq":3,"addr":"172.21.15.150:6835/4047640601","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6833","nonce":4047640601},{"type":"v1","addr":"172.21.15.150:6835","nonce":4047640601}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":8571,"qdb_cluster":[8571]},"id":8}]} 2024-09-17T05:52:05.662 INFO:teuthology.orchestra.run.smithi150.stderr:dumped fsmap epoch 71 2024-09-17T05:52:05.664 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:05.663+0000 7f7ef1d52640 1 -- 172.21.15.150:0/2695359255 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f7ed807a9f0 msgr2=0x7f7ed807cf00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:52:05.665 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:05.663+0000 7f7ef1d52640 1 --2- 172.21.15.150:0/2695359255 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f7ed807a9f0 0x7f7ed807cf00 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7f7edc000f60 tx=0x7f7edc009040 comp rx=0 tx=0).stop 2024-09-17T05:52:05.665 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:05.664+0000 7f7ef1d52640 1 -- 172.21.15.150:0/2695359255 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7eec0b5b50 msgr2=0x7f7eec13fd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:52:05.665 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:05.664+0000 7f7ef1d52640 1 --2- 172.21.15.150:0/2695359255 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7eec0b5b50 0x7f7eec13fd30 secure :-1 s=READY pgs=1595 cs=0 l=1 rev1=1 crypto rx=0x7f7ee002ab20 tx=0x7f7ee0033c20 comp rx=0 tx=0).stop 2024-09-17T05:52:05.665 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:05.664+0000 7f7ef1d52640 1 -- 172.21.15.150:0/2695359255 shutdown_connections 2024-09-17T05:52:05.665 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:05.664+0000 7f7ef1d52640 1 --2- 172.21.15.150:0/2695359255 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f7ed807a9f0 0x7f7ed807cf00 unknown :-1 s=CLOSED pgs=679 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:52:05.665 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:05.664+0000 7f7ef1d52640 1 --2- 172.21.15.150:0/2695359255 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7eec0ce2a0 0x7f7eec1f75f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:52:05.665 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:05.664+0000 7f7ef1d52640 1 --2- 172.21.15.150:0/2695359255 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7eec0b5b50 0x7f7eec13fd30 unknown :-1 s=CLOSED pgs=1595 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:52:05.665 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:05.664+0000 7f7ef1d52640 1 --2- 172.21.15.150:0/2695359255 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7eec0719a0 0x7f7eec1f3490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:52:05.665 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:05.664+0000 7f7ef1d52640 1 -- 172.21.15.150:0/2695359255 >> 172.21.15.150:0/2695359255 conn(0x7f7eec0d06d0 msgr2=0x7f7eec15ea40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:52:05.665 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:05.664+0000 7f7ef1d52640 1 -- 172.21.15.150:0/2695359255 shutdown_connections 2024-09-17T05:52:05.665 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:05.664+0000 7f7ef1d52640 1 -- 172.21.15.150:0/2695359255 wait complete. 2024-09-17T05:52:05.682 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T05:52:05.852 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:05.851+0000 7f67ef2ce640 1 -- 172.21.15.150:0/215724529 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f67e80d2780 msgr2=0x7f67e80d4f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:52:05.852 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:05.851+0000 7f67ef2ce640 1 --2- 172.21.15.150:0/215724529 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f67e80d2780 0x7f67e80d4f90 secure :-1 s=READY pgs=1597 cs=0 l=1 rev1=1 crypto rx=0x7f67e0009830 tx=0x7f67e002a5c0 comp rx=0 tx=0).stop 2024-09-17T05:52:05.852 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:05.851+0000 7f67ef2ce640 1 -- 172.21.15.150:0/215724529 shutdown_connections 2024-09-17T05:52:05.852 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:05.851+0000 7f67ef2ce640 1 --2- 172.21.15.150:0/215724529 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f67e80d2780 0x7f67e80d4f90 unknown :-1 s=CLOSED pgs=1597 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:52:05.852 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:05.851+0000 7f67ef2ce640 1 -- 172.21.15.150:0/215724529 >> 172.21.15.150:0/215724529 conn(0x7f67e808bfe0 msgr2=0x7f67e80d4670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:52:05.853 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:05.851+0000 7f67ef2ce640 1 -- 172.21.15.150:0/215724529 shutdown_connections 2024-09-17T05:52:05.853 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:05.851+0000 7f67ef2ce640 1 -- 172.21.15.150:0/215724529 wait complete. 2024-09-17T05:52:05.853 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:05.853+0000 7f67ef2ce640 1 Processor -- start 2024-09-17T05:52:05.853 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:05.853+0000 7f67ef2ce640 1 -- start start 2024-09-17T05:52:05.857 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:05.854+0000 7f67ef2ce640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f67e80b5d50 0x7f67e81519c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:52:05.857 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:05.854+0000 7f67ef2ce640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f67e80d2780 0x7f67e815c830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:52:05.857 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:05.854+0000 7f67ef2ce640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f67e8152140 0x7f67e815cd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:52:05.857 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:05.854+0000 7f67ef2ce640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f67e80b7d50 con 0x7f67e8152140 2024-09-17T05:52:05.857 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:05.854+0000 7f67ef2ce640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f67e80b7bd0 con 0x7f67e80b5d50 2024-09-17T05:52:05.857 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:05.854+0000 7f67ef2ce640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f67e80b7ed0 con 0x7f67e80d2780 2024-09-17T05:52:05.857 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:05.854+0000 7f67ed86b640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f67e8152140 0x7f67e815cd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:52:05.857 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:05.854+0000 7f67ed86b640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f67e8152140 0x7f67e815cd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:55892/0 (socket says 172.21.15.150:55892) 2024-09-17T05:52:05.857 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:05.854+0000 7f67ed86b640 1 -- 172.21.15.150:0/896676647 learned_addr learned my addr 172.21.15.150:0/896676647 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:52:05.858 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:05.854+0000 7f67ed06a640 1 --2- 172.21.15.150:0/896676647 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f67e80b5d50 0x7f67e81519c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:52:05.858 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:05.854+0000 7f67ec869640 1 --2- 172.21.15.150:0/896676647 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f67e80d2780 0x7f67e815c830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:52:05.858 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:05.855+0000 7f67ed86b640 1 -- 172.21.15.150:0/896676647 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f67e80d2780 msgr2=0x7f67e815c830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:52:05.858 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:05.855+0000 7f67ed86b640 1 --2- 172.21.15.150:0/896676647 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f67e80d2780 0x7f67e815c830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:52:05.858 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:05.855+0000 7f67ed86b640 1 -- 172.21.15.150:0/896676647 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f67e80b5d50 msgr2=0x7f67e81519c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:52:05.858 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:05.855+0000 7f67ed86b640 1 --2- 172.21.15.150:0/896676647 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f67e80b5d50 0x7f67e81519c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:52:05.858 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:05.855+0000 7f67ed86b640 1 -- 172.21.15.150:0/896676647 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f67e8151f00 con 0x7f67e8152140 2024-09-17T05:52:05.858 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:05.855+0000 7f67ed86b640 1 --2- 172.21.15.150:0/896676647 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f67e8152140 0x7f67e815cd70 secure :-1 s=READY pgs=1598 cs=0 l=1 rev1=1 crypto rx=0x7f67e0009950 tx=0x7f67e0033ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:52:05.858 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:05.855+0000 7f67e5ffb640 1 -- 172.21.15.150:0/896676647 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67e0031d60 con 0x7f67e8152140 2024-09-17T05:52:05.858 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:05.855+0000 7f67e5ffb640 1 -- 172.21.15.150:0/896676647 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f67e0005020 con 0x7f67e8152140 2024-09-17T05:52:05.858 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:05.855+0000 7f67ef2ce640 1 -- 172.21.15.150:0/896676647 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f67e81f98a0 con 0x7f67e8152140 2024-09-17T05:52:05.858 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:05.855+0000 7f67e5ffb640 1 -- 172.21.15.150:0/896676647 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67e0005450 con 0x7f67e8152140 2024-09-17T05:52:05.858 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:05.855+0000 7f67ef2ce640 1 -- 172.21.15.150:0/896676647 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f67e81f9e60 con 0x7f67e8152140 2024-09-17T05:52:05.859 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:05.856+0000 7f67ef2ce640 1 -- 172.21.15.150:0/896676647 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f67e80d4f90 con 0x7f67e8152140 2024-09-17T05:52:05.859 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:05.857+0000 7f67e5ffb640 1 -- 172.21.15.150:0/896676647 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 42) ==== 104195+0+0 (secure 0 0 0) 0x7f67e00047a0 con 0x7f67e8152140 2024-09-17T05:52:05.859 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:05.857+0000 7f67e5ffb640 1 --2- 172.21.15.150:0/896676647 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f67d407a9f0 0x7f67d407cf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:52:05.859 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:05.857+0000 7f67e5ffb640 1 -- 172.21.15.150:0/896676647 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(115..115 src has 1..115) ==== 5907+0+0 (secure 0 0 0) 0x7f67e00baef0 con 0x7f67e8152140 2024-09-17T05:52:05.860 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:05.858+0000 7f67ed06a640 1 --2- 172.21.15.150:0/896676647 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f67d407a9f0 0x7f67d407cf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:52:05.860 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:05.858+0000 7f67ed06a640 1 --2- 172.21.15.150:0/896676647 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f67d407a9f0 0x7f67d407cf00 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7f67d80012e0 tx=0x7f67d8009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:52:05.863 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:05.862+0000 7f67e5ffb640 1 -- 172.21.15.150:0/896676647 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f67e003f030 con 0x7f67e8152140 2024-09-17T05:52:06.073 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:06.073+0000 7f67ef2ce640 1 -- 172.21.15.150:0/896676647 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f67e80d2d60 con 0x7f67e8152140 2024-09-17T05:52:06.074 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:06.073+0000 7f67e5ffb640 1 -- 172.21.15.150:0/896676647 <== mon.0 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 71 v71) ==== 94+0+5237 (secure 0 0 0) 0x7f67e00847e0 con 0x7f67e8152140 2024-09-17T05:52:06.074 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-09-17T05:52:06.074 INFO:teuthology.orchestra.run.smithi150.stdout:{"epoch":71,"btime":"2024-09-17T05:51:27:572576+0000","default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6779,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6836/2908904841","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6835","nonce":2908904841},{"type":"v1","addr":"172.21.15.176:6836","nonce":2908904841}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":65},{"gid":6782,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6837/2764909757","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6834","nonce":2764909757},{"type":"v1","addr":"172.21.15.176:6837","nonce":2764909757}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":65},{"gid":8568,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6834/1970670297","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6832","nonce":1970670297},{"type":"v1","addr":"172.21.15.150:6834","nonce":1970670297}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":64}],"filesystems":[{"mdsmap":{"epoch":70,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T05:51:14.699714+0000","modified":"2024-09-17T05:51:17.724183+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":8571},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8571":{"gid":8571,"name":"c","rank":0,"incarnation":66,"state":"up:active","state_seq":3,"addr":"172.21.15.150:6835/4047640601","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6833","nonce":4047640601},{"type":"v1","addr":"172.21.15.150:6835","nonce":4047640601}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":8571,"qdb_cluster":[8571]},"id":8}]} 2024-09-17T05:52:06.075 INFO:teuthology.orchestra.run.smithi150.stderr:dumped fsmap epoch 71 2024-09-17T05:52:06.076 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:06.075+0000 7f67ef2ce640 1 -- 172.21.15.150:0/896676647 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f67d407a9f0 msgr2=0x7f67d407cf00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:52:06.077 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:06.075+0000 7f67ef2ce640 1 --2- 172.21.15.150:0/896676647 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f67d407a9f0 0x7f67d407cf00 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7f67d80012e0 tx=0x7f67d8009040 comp rx=0 tx=0).stop 2024-09-17T05:52:06.077 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:06.075+0000 7f67ef2ce640 1 -- 172.21.15.150:0/896676647 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f67e8152140 msgr2=0x7f67e815cd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:52:06.077 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:06.075+0000 7f67ef2ce640 1 --2- 172.21.15.150:0/896676647 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f67e8152140 0x7f67e815cd70 secure :-1 s=READY pgs=1598 cs=0 l=1 rev1=1 crypto rx=0x7f67e0009950 tx=0x7f67e0033ce0 comp rx=0 tx=0).stop 2024-09-17T05:52:06.077 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:06.075+0000 7f67ef2ce640 1 -- 172.21.15.150:0/896676647 shutdown_connections 2024-09-17T05:52:06.077 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:06.075+0000 7f67ef2ce640 1 --2- 172.21.15.150:0/896676647 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f67d407a9f0 0x7f67d407cf00 unknown :-1 s=CLOSED pgs=680 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:52:06.077 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:06.075+0000 7f67ef2ce640 1 --2- 172.21.15.150:0/896676647 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f67e8152140 0x7f67e815cd70 unknown :-1 s=CLOSED pgs=1598 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:52:06.077 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:06.075+0000 7f67ef2ce640 1 --2- 172.21.15.150:0/896676647 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f67e80d2780 0x7f67e815c830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:52:06.077 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:06.075+0000 7f67ef2ce640 1 --2- 172.21.15.150:0/896676647 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f67e80b5d50 0x7f67e81519c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:52:06.077 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:06.075+0000 7f67ef2ce640 1 -- 172.21.15.150:0/896676647 >> 172.21.15.150:0/896676647 conn(0x7f67e808bfe0 msgr2=0x7f67e80b8370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:52:06.077 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:06.076+0000 7f67ef2ce640 1 -- 172.21.15.150:0/896676647 shutdown_connections 2024-09-17T05:52:06.077 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:06.076+0000 7f67ef2ce640 1 -- 172.21.15.150:0/896676647 wait complete. 2024-09-17T05:52:06.088 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T05:52:06.207 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:06.206+0000 7f37e47ad640 1 -- 172.21.15.150:0/2978067282 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f37dc0d1790 msgr2=0x7f37dc0d2780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:52:06.208 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:06.206+0000 7f37e47ad640 1 --2- 172.21.15.150:0/2978067282 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f37dc0d1790 0x7f37dc0d2780 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7f37d0009830 tx=0x7f37d002a5c0 comp rx=0 tx=0).stop 2024-09-17T05:52:06.208 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:06.206+0000 7f37e47ad640 1 -- 172.21.15.150:0/2978067282 shutdown_connections 2024-09-17T05:52:06.208 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:06.206+0000 7f37e47ad640 1 --2- 172.21.15.150:0/2978067282 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f37dc0d1790 0x7f37dc0d2780 unknown :-1 s=CLOSED pgs=545 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:52:06.208 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:06.206+0000 7f37e47ad640 1 -- 172.21.15.150:0/2978067282 >> 172.21.15.150:0/2978067282 conn(0x7f37dc08bfe0 msgr2=0x7f37dc0d4670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:52:06.208 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:06.206+0000 7f37e47ad640 1 -- 172.21.15.150:0/2978067282 shutdown_connections 2024-09-17T05:52:06.208 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:06.206+0000 7f37e47ad640 1 -- 172.21.15.150:0/2978067282 wait complete. 2024-09-17T05:52:06.209 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:06.208+0000 7f37e47ad640 1 Processor -- start 2024-09-17T05:52:06.209 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:06.208+0000 7f37e47ad640 1 -- start start 2024-09-17T05:52:06.212 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:06.209+0000 7f37e47ad640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f37dc0b5d50 0x7f37dc09ed70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:52:06.212 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:06.209+0000 7f37e47ad640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f37dc0d4f90 0x7f37dc0b47c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:52:06.212 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:06.209+0000 7f37e47ad640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f37dc1f8f00 0x7f37dc1f9310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:52:06.212 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:06.209+0000 7f37e47ad640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f37dc0b7d50 con 0x7f37dc1f8f00 2024-09-17T05:52:06.212 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:06.209+0000 7f37e47ad640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f37dc0b7bd0 con 0x7f37dc0d4f90 2024-09-17T05:52:06.212 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:06.209+0000 7f37e47ad640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f37dc0b7ed0 con 0x7f37dc0b5d50 2024-09-17T05:52:06.212 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:06.210+0000 7f37e2d4a640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f37dc1f8f00 0x7f37dc1f9310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:52:06.213 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:06.210+0000 7f37e2d4a640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f37dc1f8f00 0x7f37dc1f9310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:55896/0 (socket says 172.21.15.150:55896) 2024-09-17T05:52:06.213 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:06.210+0000 7f37e2d4a640 1 -- 172.21.15.150:0/1337638012 learned_addr learned my addr 172.21.15.150:0/1337638012 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:52:06.213 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:06.210+0000 7f37e1d48640 1 --2- 172.21.15.150:0/1337638012 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f37dc0d4f90 0x7f37dc0b47c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:52:06.213 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:06.210+0000 7f37e2549640 1 --2- 172.21.15.150:0/1337638012 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f37dc0b5d50 0x7f37dc09ed70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:52:06.213 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:06.210+0000 7f37e2d4a640 1 -- 172.21.15.150:0/1337638012 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f37dc0b5d50 msgr2=0x7f37dc09ed70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:52:06.213 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:06.210+0000 7f37e2d4a640 1 --2- 172.21.15.150:0/1337638012 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f37dc0b5d50 0x7f37dc09ed70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:52:06.213 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:06.210+0000 7f37e2d4a640 1 -- 172.21.15.150:0/1337638012 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f37dc0d4f90 msgr2=0x7f37dc0b47c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:52:06.213 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:06.210+0000 7f37e2d4a640 1 --2- 172.21.15.150:0/1337638012 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f37dc0d4f90 0x7f37dc0b47c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:52:06.214 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:06.210+0000 7f37e2d4a640 1 -- 172.21.15.150:0/1337638012 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f37dc1f9850 con 0x7f37dc1f8f00 2024-09-17T05:52:06.214 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:06.210+0000 7f37e2d4a640 1 --2- 172.21.15.150:0/1337638012 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f37dc1f8f00 0x7f37dc1f9310 secure :-1 s=READY pgs=1600 cs=0 l=1 rev1=1 crypto rx=0x7f37cc00c760 tx=0x7f37cc00cb60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:52:06.214 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:06.210+0000 7f37daffd640 1 -- 172.21.15.150:0/1337638012 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37cc003b70 con 0x7f37dc1f8f00 2024-09-17T05:52:06.214 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:06.210+0000 7f37daffd640 1 -- 172.21.15.150:0/1337638012 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f37cc003d10 con 0x7f37dc1f8f00 2024-09-17T05:52:06.214 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:06.210+0000 7f37e47ad640 1 -- 172.21.15.150:0/1337638012 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f37dc0a1590 con 0x7f37dc1f8f00 2024-09-17T05:52:06.214 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:06.210+0000 7f37daffd640 1 -- 172.21.15.150:0/1337638012 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37cc0052d0 con 0x7f37dc1f8f00 2024-09-17T05:52:06.214 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:06.210+0000 7f37e47ad640 1 -- 172.21.15.150:0/1337638012 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f37dc0a1b50 con 0x7f37dc1f8f00 2024-09-17T05:52:06.214 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:06.211+0000 7f37e47ad640 1 -- 172.21.15.150:0/1337638012 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f37dc0d2780 con 0x7f37dc1f8f00 2024-09-17T05:52:06.215 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:06.212+0000 7f37daffd640 1 -- 172.21.15.150:0/1337638012 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 42) ==== 104195+0+0 (secure 0 0 0) 0x7f37cc005470 con 0x7f37dc1f8f00 2024-09-17T05:52:06.215 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:06.213+0000 7f37daffd640 1 --2- 172.21.15.150:0/1337638012 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f37c807a9f0 0x7f37c807cf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:52:06.215 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:06.213+0000 7f37daffd640 1 -- 172.21.15.150:0/1337638012 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(116..116 src has 1..116) ==== 5963+0+0 (secure 0 0 0) 0x7f37cc0999c0 con 0x7f37dc1f8f00 2024-09-17T05:52:06.215 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:06.213+0000 7f37e2549640 1 --2- 172.21.15.150:0/1337638012 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f37c807a9f0 0x7f37c807cf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:52:06.215 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:06.213+0000 7f37e2549640 1 --2- 172.21.15.150:0/1337638012 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f37c807a9f0 0x7f37c807cf00 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x7f37d4007fd0 tx=0x7f37d4001370 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:52:06.217 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:06.217+0000 7f37daffd640 1 -- 172.21.15.150:0/1337638012 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f37dc1f9850 con 0x7f37dc1f8f00 2024-09-17T05:52:06.415 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:06.415+0000 7f37e47ad640 1 -- 172.21.15.150:0/1337638012 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f37dc0d2d60 con 0x7f37dc1f8f00 2024-09-17T05:52:06.417 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:06.416+0000 7f37daffd640 1 -- 172.21.15.150:0/1337638012 <== mon.0 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v116) ==== 74+0+17211 (secure 0 0 0) 0x7f37cc063230 con 0x7f37dc1f8f00 2024-09-17T05:52:06.417 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-09-17T05:52:06.418 INFO:teuthology.orchestra.run.smithi150.stdout:{"epoch":116,"fsid":"9f2e05e9-d629-47b3-b26b-1360655b7d20","created":"2024-09-17T05:41:32.502979+0000","modified":"2024-09-17T05:52:06.151687+0000","last_up_change":"2024-09-17T05:41:46.150225+0000","last_in_change":"2024-09-17T05:41:36.120274+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":17,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T05:41:46.860779+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":16,"pool_name":"cephfs_metadata","create_time":"2024-09-17T05:51:12.343530+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"112","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":17,"pool_name":"cephfs_data","create_time":"2024-09-17T05:51:13.667025+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"116","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":3,"snap_epoch":116,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"4f31c018-c8a4-4d6d-b0c2-a597c47aae4a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6800","nonce":479374392},{"type":"v1","addr":"172.21.15.150:6801","nonce":479374392}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6802","nonce":479374392},{"type":"v1","addr":"172.21.15.150:6803","nonce":479374392}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6806","nonce":479374392},{"type":"v1","addr":"172.21.15.150:6807","nonce":479374392}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6804","nonce":479374392},{"type":"v1","addr":"172.21.15.150:6805","nonce":479374392}]},"public_addr":"172.21.15.150:6801/479374392","cluster_addr":"172.21.15.150:6803/479374392","heartbeat_back_addr":"172.21.15.150:6807/479374392","heartbeat_front_addr":"172.21.15.150:6805/479374392","state":["exists","up"]},{"osd":1,"uuid":"6ff4a573-500b-4e04-9de3-39265ead78b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6824","nonce":913899800},{"type":"v1","addr":"172.21.15.150:6825","nonce":913899800}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6826","nonce":913899800},{"type":"v1","addr":"172.21.15.150:6827","nonce":913899800}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6830","nonce":913899800},{"type":"v1","addr":"172.21.15.150:6831","nonce":913899800}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6828","nonce":913899800},{"type":"v1","addr":"172.21.15.150:6829","nonce":913899800}]},"public_addr":"172.21.15.150:6825/913899800","cluster_addr":"172.21.15.150:6827/913899800","heartbeat_back_addr":"172.21.15.150:6831/913899800","heartbeat_front_addr":"172.21.15.150:6829/913899800","state":["exists","up"]},{"osd":2,"uuid":"bffea6f9-2465-4182-b205-00436c41ac1c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":114,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6816","nonce":363718461},{"type":"v1","addr":"172.21.15.150:6817","nonce":363718461}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6818","nonce":363718461},{"type":"v1","addr":"172.21.15.150:6819","nonce":363718461}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6822","nonce":363718461},{"type":"v1","addr":"172.21.15.150:6823","nonce":363718461}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6820","nonce":363718461},{"type":"v1","addr":"172.21.15.150:6821","nonce":363718461}]},"public_addr":"172.21.15.150:6817/363718461","cluster_addr":"172.21.15.150:6819/363718461","heartbeat_back_addr":"172.21.15.150:6823/363718461","heartbeat_front_addr":"172.21.15.150:6821/363718461","state":["exists","up"]},{"osd":3,"uuid":"cda70430-d1e1-427e-b04e-56db4031d078","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":114,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6808","nonce":3550994626},{"type":"v1","addr":"172.21.15.150:6809","nonce":3550994626}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6810","nonce":3550994626},{"type":"v1","addr":"172.21.15.150:6811","nonce":3550994626}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6814","nonce":3550994626},{"type":"v1","addr":"172.21.15.150:6815","nonce":3550994626}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6812","nonce":3550994626},{"type":"v1","addr":"172.21.15.150:6813","nonce":3550994626}]},"public_addr":"172.21.15.150:6809/3550994626","cluster_addr":"172.21.15.150:6811/3550994626","heartbeat_back_addr":"172.21.15.150:6815/3550994626","heartbeat_front_addr":"172.21.15.150:6813/3550994626","state":["exists","up"]},{"osd":4,"uuid":"3a0277fb-5e1e-4f68-bb2d-9a8a0152f64a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6810","nonce":2718261497},{"type":"v1","addr":"172.21.15.176:6811","nonce":2718261497}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6812","nonce":2718261497},{"type":"v1","addr":"172.21.15.176:6813","nonce":2718261497}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6816","nonce":2718261497},{"type":"v1","addr":"172.21.15.176:6817","nonce":2718261497}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6814","nonce":2718261497},{"type":"v1","addr":"172.21.15.176:6815","nonce":2718261497}]},"public_addr":"172.21.15.176:6811/2718261497","cluster_addr":"172.21.15.176:6813/2718261497","heartbeat_back_addr":"172.21.15.176:6817/2718261497","heartbeat_front_addr":"172.21.15.176:6815/2718261497","state":["exists","up"]},{"osd":5,"uuid":"33aebee6-0315-40b7-a11c-6702f0be494d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6818","nonce":2049295774},{"type":"v1","addr":"172.21.15.176:6819","nonce":2049295774}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6820","nonce":2049295774},{"type":"v1","addr":"172.21.15.176:6821","nonce":2049295774}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6824","nonce":2049295774},{"type":"v1","addr":"172.21.15.176:6825","nonce":2049295774}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6822","nonce":2049295774},{"type":"v1","addr":"172.21.15.176:6823","nonce":2049295774}]},"public_addr":"172.21.15.176:6819/2049295774","cluster_addr":"172.21.15.176:6821/2049295774","heartbeat_back_addr":"172.21.15.176:6825/2049295774","heartbeat_front_addr":"172.21.15.176:6823/2049295774","state":["exists","up"]},{"osd":6,"uuid":"4d24f360-6751-4263-841b-d77793d33540","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6826","nonce":2164458476},{"type":"v1","addr":"172.21.15.176:6827","nonce":2164458476}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6828","nonce":2164458476},{"type":"v1","addr":"172.21.15.176:6829","nonce":2164458476}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6832","nonce":2164458476},{"type":"v1","addr":"172.21.15.176:6833","nonce":2164458476}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6830","nonce":2164458476},{"type":"v1","addr":"172.21.15.176:6831","nonce":2164458476}]},"public_addr":"172.21.15.176:6827/2164458476","cluster_addr":"172.21.15.176:6829/2164458476","heartbeat_back_addr":"172.21.15.176:6833/2164458476","heartbeat_front_addr":"172.21.15.176:6831/2164458476","state":["exists","up"]},{"osd":7,"uuid":"c8594fda-c74a-4ba9-8277-caf101d58ca1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6802","nonce":3239587708},{"type":"v1","addr":"172.21.15.176:6803","nonce":3239587708}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6804","nonce":3239587708},{"type":"v1","addr":"172.21.15.176:6805","nonce":3239587708}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6808","nonce":3239587708},{"type":"v1","addr":"172.21.15.176:6809","nonce":3239587708}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6806","nonce":3239587708},{"type":"v1","addr":"172.21.15.176:6807","nonce":3239587708}]},"public_addr":"172.21.15.176:6803/3239587708","cluster_addr":"172.21.15.176:6805/3239587708","heartbeat_back_addr":"172.21.15.176:6809/3239587708","heartbeat_front_addr":"172.21.15.176:6807/3239587708","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:41:41.905151+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:41:42.705679+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:41:42.459673+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:41:42.440819+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:41:42.668428+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:41:42.694972+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:41:43.078535+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:41:42.363539+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"17.24","mappings":[{"from":0,"to":5}]},{"pgid":"17.26","mappings":[{"from":0,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":7,"snaps":[{"begin":2,"length":2}]},{"pool":9,"snaps":[{"begin":2,"length":2}]},{"pool":11,"snaps":[{"begin":2,"length":2}]},{"pool":13,"snaps":[{"begin":2,"length":2}]},{"pool":15,"snaps":[{"begin":2,"length":2}]},{"pool":17,"snaps":[{"begin":2,"length":2}]}],"new_removed_snaps":[{"pool":17,"snaps":[{"begin":2,"length":2}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T05:52:06.420 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:06.420+0000 7f37e47ad640 1 -- 172.21.15.150:0/1337638012 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f37c807a9f0 msgr2=0x7f37c807cf00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:52:06.421 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:06.420+0000 7f37e47ad640 1 --2- 172.21.15.150:0/1337638012 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f37c807a9f0 0x7f37c807cf00 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x7f37d4007fd0 tx=0x7f37d4001370 comp rx=0 tx=0).stop 2024-09-17T05:52:06.421 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:06.420+0000 7f37e47ad640 1 -- 172.21.15.150:0/1337638012 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f37dc1f8f00 msgr2=0x7f37dc1f9310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:52:06.421 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:06.420+0000 7f37e47ad640 1 --2- 172.21.15.150:0/1337638012 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f37dc1f8f00 0x7f37dc1f9310 secure :-1 s=READY pgs=1600 cs=0 l=1 rev1=1 crypto rx=0x7f37cc00c760 tx=0x7f37cc00cb60 comp rx=0 tx=0).stop 2024-09-17T05:52:06.421 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:06.420+0000 7f37e47ad640 1 -- 172.21.15.150:0/1337638012 shutdown_connections 2024-09-17T05:52:06.421 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:06.420+0000 7f37e47ad640 1 --2- 172.21.15.150:0/1337638012 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f37dc0d4f90 0x7f37dc0b47c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:52:06.421 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:06.420+0000 7f37e47ad640 1 --2- 172.21.15.150:0/1337638012 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f37c807a9f0 0x7f37c807cf00 unknown :-1 s=CLOSED pgs=681 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:52:06.421 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:06.420+0000 7f37e47ad640 1 --2- 172.21.15.150:0/1337638012 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f37dc1f8f00 0x7f37dc1f9310 unknown :-1 s=CLOSED pgs=1600 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:52:06.422 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:06.420+0000 7f37e47ad640 1 --2- 172.21.15.150:0/1337638012 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f37dc0b5d50 0x7f37dc09ed70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:52:06.422 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:06.420+0000 7f37e47ad640 1 -- 172.21.15.150:0/1337638012 >> 172.21.15.150:0/1337638012 conn(0x7f37dc08bfe0 msgr2=0x7f37dc0b8310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:52:06.422 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:06.420+0000 7f37e47ad640 1 -- 172.21.15.150:0/1337638012 shutdown_connections 2024-09-17T05:52:06.422 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:06.421+0000 7f37e47ad640 1 -- 172.21.15.150:0/1337638012 wait complete. 2024-09-17T05:52:06.440 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-09-17T05:52:06.440 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T05:52:06.577 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:06.576+0000 7fd897e9b640 1 -- 172.21.15.150:0/2722957260 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd8900cda20 msgr2=0x7fd8900cde30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:52:06.578 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:06.576+0000 7fd897e9b640 1 --2- 172.21.15.150:0/2722957260 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd8900cda20 0x7fd8900cde30 secure :-1 s=READY pgs=1601 cs=0 l=1 rev1=1 crypto rx=0x7fd8900d0af0 tx=0x7fd88002a560 comp rx=0 tx=0).stop 2024-09-17T05:52:06.578 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:06.576+0000 7fd897e9b640 1 -- 172.21.15.150:0/2722957260 shutdown_connections 2024-09-17T05:52:06.578 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:06.576+0000 7fd897e9b640 1 --2- 172.21.15.150:0/2722957260 >> v2:172.21.15.176:3300/0 conn(0x7fd8900ce370 0x7fd8900b4460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:52:06.578 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:06.576+0000 7fd897e9b640 1 --2- 172.21.15.150:0/2722957260 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd8900cda20 0x7fd8900cde30 unknown :-1 s=CLOSED pgs=1601 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:52:06.578 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:06.576+0000 7fd897e9b640 1 -- 172.21.15.150:0/2722957260 >> 172.21.15.150:0/2722957260 conn(0x7fd8900b2e80 msgr2=0x7fd8900b3290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:52:06.578 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:06.576+0000 7fd897e9b640 1 -- 172.21.15.150:0/2722957260 shutdown_connections 2024-09-17T05:52:06.578 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:06.576+0000 7fd897e9b640 1 -- 172.21.15.150:0/2722957260 wait complete. 2024-09-17T05:52:06.579 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:06.578+0000 7fd897e9b640 1 Processor -- start 2024-09-17T05:52:06.579 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:06.578+0000 7fd897e9b640 1 -- start start 2024-09-17T05:52:06.582 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:06.579+0000 7fd897e9b640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd8900b5ff0 0x7fd89009d9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:52:06.582 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:06.579+0000 7fd897e9b640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd8900cda20 0x7fd8901f71a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:52:06.582 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:06.580+0000 7fd897e9b640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd8900ce370 0x7fd8901f76e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:52:06.582 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:06.580+0000 7fd897e9b640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7fd8900b4db0 con 0x7fd8900ce370 2024-09-17T05:52:06.582 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:06.580+0000 7fd897e9b640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fd8900b4c30 con 0x7fd8900b5ff0 2024-09-17T05:52:06.582 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:06.580+0000 7fd897e9b640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fd8900b4f30 con 0x7fd8900cda20 2024-09-17T05:52:06.582 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:06.580+0000 7fd896438640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd8900ce370 0x7fd8901f76e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:52:06.582 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:06.580+0000 7fd896438640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd8900ce370 0x7fd8901f76e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:55914/0 (socket says 172.21.15.150:55914) 2024-09-17T05:52:06.582 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:06.580+0000 7fd896438640 1 -- 172.21.15.150:0/1071141002 learned_addr learned my addr 172.21.15.150:0/1071141002 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:52:06.582 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:06.580+0000 7fd895c37640 1 --2- 172.21.15.150:0/1071141002 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd8900b5ff0 0x7fd89009d9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:52:06.582 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:06.580+0000 7fd895436640 1 --2- 172.21.15.150:0/1071141002 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd8900cda20 0x7fd8901f71a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:52:06.582 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:06.580+0000 7fd896438640 1 -- 172.21.15.150:0/1071141002 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd8900cda20 msgr2=0x7fd8901f71a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:52:06.582 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:06.580+0000 7fd896438640 1 --2- 172.21.15.150:0/1071141002 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd8900cda20 0x7fd8901f71a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:52:06.583 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:06.580+0000 7fd896438640 1 -- 172.21.15.150:0/1071141002 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd8900b5ff0 msgr2=0x7fd89009d9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:52:06.583 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:06.580+0000 7fd896438640 1 --2- 172.21.15.150:0/1071141002 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd8900b5ff0 0x7fd89009d9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:52:06.583 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:06.580+0000 7fd896438640 1 -- 172.21.15.150:0/1071141002 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd890154ad0 con 0x7fd8900ce370 2024-09-17T05:52:06.583 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:06.580+0000 7fd896438640 1 --2- 172.21.15.150:0/1071141002 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd8900ce370 0x7fd8901f76e0 secure :-1 s=READY pgs=1602 cs=0 l=1 rev1=1 crypto rx=0x7fd88800b970 tx=0x7fd88800be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:52:06.583 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:06.580+0000 7fd8867fc640 1 -- 172.21.15.150:0/1071141002 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd888019070 con 0x7fd8900ce370 2024-09-17T05:52:06.583 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:06.580+0000 7fd8867fc640 1 -- 172.21.15.150:0/1071141002 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd88800cc50 con 0x7fd8900ce370 2024-09-17T05:52:06.583 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:06.580+0000 7fd897e9b640 1 -- 172.21.15.150:0/1071141002 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd890154db0 con 0x7fd8900ce370 2024-09-17T05:52:06.583 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:06.580+0000 7fd8867fc640 1 -- 172.21.15.150:0/1071141002 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8880146a0 con 0x7fd8900ce370 2024-09-17T05:52:06.583 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:06.580+0000 7fd897e9b640 1 -- 172.21.15.150:0/1071141002 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd890155370 con 0x7fd8900ce370 2024-09-17T05:52:06.584 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:06.581+0000 7fd897e9b640 1 -- 172.21.15.150:0/1071141002 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd8900b54d0 con 0x7fd8900ce370 2024-09-17T05:52:06.584 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:06.582+0000 7fd8867fc640 1 -- 172.21.15.150:0/1071141002 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 42) ==== 104195+0+0 (secure 0 0 0) 0x7fd88801c070 con 0x7fd8900ce370 2024-09-17T05:52:06.584 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:06.583+0000 7fd8867fc640 1 --2- 172.21.15.150:0/1071141002 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fd87407a9f0 0x7fd87407cf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:52:06.584 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:06.583+0000 7fd8867fc640 1 -- 172.21.15.150:0/1071141002 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(116..116 src has 1..116) ==== 5963+0+0 (secure 0 0 0) 0x7fd888099b00 con 0x7fd8900ce370 2024-09-17T05:52:06.584 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:06.583+0000 7fd895c37640 1 --2- 172.21.15.150:0/1071141002 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fd87407a9f0 0x7fd87407cf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:52:06.584 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:06.584+0000 7fd895c37640 1 --2- 172.21.15.150:0/1071141002 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fd87407a9f0 0x7fd87407cf00 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7fd88c006fd0 tx=0x7fd88c008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:52:06.588 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:06.588+0000 7fd8867fc640 1 -- 172.21.15.150:0/1071141002 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fd8880639c0 con 0x7fd8900ce370 2024-09-17T05:52:06.801 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:06.800+0000 7fd897e9b640 1 -- 172.21.15.150:0/1071141002 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fd89015b340 con 0x7fd8900ce370 2024-09-17T05:52:06.801 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:06.800+0000 7fd8867fc640 1 -- 172.21.15.150:0/1071141002 <== mon.0 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 71 v71) ==== 94+0+5237 (secure 0 0 0) 0x7fd8880632c0 con 0x7fd8900ce370 2024-09-17T05:52:06.801 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-09-17T05:52:06.802 INFO:teuthology.orchestra.run.smithi150.stdout:{"epoch":71,"btime":"2024-09-17T05:51:27:572576+0000","default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6779,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6836/2908904841","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6835","nonce":2908904841},{"type":"v1","addr":"172.21.15.176:6836","nonce":2908904841}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":65},{"gid":6782,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6837/2764909757","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6834","nonce":2764909757},{"type":"v1","addr":"172.21.15.176:6837","nonce":2764909757}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":65},{"gid":8568,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6834/1970670297","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6832","nonce":1970670297},{"type":"v1","addr":"172.21.15.150:6834","nonce":1970670297}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":64}],"filesystems":[{"mdsmap":{"epoch":70,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T05:51:14.699714+0000","modified":"2024-09-17T05:51:17.724183+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":8571},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8571":{"gid":8571,"name":"c","rank":0,"incarnation":66,"state":"up:active","state_seq":3,"addr":"172.21.15.150:6835/4047640601","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6833","nonce":4047640601},{"type":"v1","addr":"172.21.15.150:6835","nonce":4047640601}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":8571,"qdb_cluster":[8571]},"id":8}]} 2024-09-17T05:52:06.802 INFO:teuthology.orchestra.run.smithi150.stderr:dumped fsmap epoch 71 2024-09-17T05:52:06.804 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:06.803+0000 7fd897e9b640 1 -- 172.21.15.150:0/1071141002 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fd87407a9f0 msgr2=0x7fd87407cf00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:52:06.804 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:06.803+0000 7fd897e9b640 1 --2- 172.21.15.150:0/1071141002 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fd87407a9f0 0x7fd87407cf00 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7fd88c006fd0 tx=0x7fd88c008040 comp rx=0 tx=0).stop 2024-09-17T05:52:06.804 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:06.803+0000 7fd897e9b640 1 -- 172.21.15.150:0/1071141002 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd8900ce370 msgr2=0x7fd8901f76e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:52:06.804 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:06.803+0000 7fd897e9b640 1 --2- 172.21.15.150:0/1071141002 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd8900ce370 0x7fd8901f76e0 secure :-1 s=READY pgs=1602 cs=0 l=1 rev1=1 crypto rx=0x7fd88800b970 tx=0x7fd88800be30 comp rx=0 tx=0).stop 2024-09-17T05:52:06.804 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:06.803+0000 7fd897e9b640 1 -- 172.21.15.150:0/1071141002 shutdown_connections 2024-09-17T05:52:06.804 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:06.803+0000 7fd897e9b640 1 --2- 172.21.15.150:0/1071141002 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fd87407a9f0 0x7fd87407cf00 unknown :-1 s=CLOSED pgs=682 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:52:06.804 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:06.803+0000 7fd897e9b640 1 --2- 172.21.15.150:0/1071141002 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd8900ce370 0x7fd8901f76e0 unknown :-1 s=CLOSED pgs=1602 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:52:06.804 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:06.803+0000 7fd897e9b640 1 --2- 172.21.15.150:0/1071141002 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd8900cda20 0x7fd8901f71a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:52:06.804 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:06.803+0000 7fd897e9b640 1 --2- 172.21.15.150:0/1071141002 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd8900b5ff0 0x7fd89009d9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:52:06.804 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:06.803+0000 7fd897e9b640 1 -- 172.21.15.150:0/1071141002 >> 172.21.15.150:0/1071141002 conn(0x7fd8900b2e80 msgr2=0x7fd89015a1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:52:06.805 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:06.803+0000 7fd897e9b640 1 -- 172.21.15.150:0/1071141002 shutdown_connections 2024-09-17T05:52:06.805 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:06.803+0000 7fd897e9b640 1 -- 172.21.15.150:0/1071141002 wait complete. 2024-09-17T05:52:06.815 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T05:52:06.929 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:06.928+0000 7feb3bb01640 1 -- 172.21.15.150:0/3124337549 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7feb1c004d40 msgr2=0x7feb1c0051f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:52:06.930 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:06.928+0000 7feb3bb01640 1 --2- 172.21.15.150:0/3124337549 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7feb1c004d40 0x7feb1c0051f0 secure :-1 s=READY pgs=1604 cs=0 l=1 rev1=1 crypto rx=0x7feb2c001dc0 tx=0x7feb1c005830 comp rx=0 tx=0).stop 2024-09-17T05:52:06.930 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:06.928+0000 7feb3a09e640 1 -- 172.21.15.150:0/3124337549 reap_dead start 2024-09-17T05:52:06.930 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:06.928+0000 7feb3bb01640 1 -- 172.21.15.150:0/3124337549 shutdown_connections 2024-09-17T05:52:06.930 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:06.928+0000 7feb3bb01640 1 -- 172.21.15.150:0/3124337549 >> 172.21.15.150:0/3124337549 conn(0x7feb3406d730 msgr2=0x7feb340b1e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:52:06.930 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:06.928+0000 7feb3bb01640 1 -- 172.21.15.150:0/3124337549 shutdown_connections 2024-09-17T05:52:06.930 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:06.928+0000 7feb3bb01640 1 -- 172.21.15.150:0/3124337549 wait complete. 2024-09-17T05:52:06.931 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:06.930+0000 7feb3bb01640 1 Processor -- start 2024-09-17T05:52:06.931 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:06.930+0000 7feb3bb01640 1 -- start start 2024-09-17T05:52:06.934 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:06.931+0000 7feb3bb01640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7feb34154e40 0x7feb34153d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:52:06.934 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:06.931+0000 7feb3bb01640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7feb3414dd20 0x7feb3414e130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:52:06.934 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:06.931+0000 7feb3bb01640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7feb340b1410 0x7feb340b1820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:52:06.934 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:06.931+0000 7feb3bb01640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7feb340b3fe0 con 0x7feb3414dd20 2024-09-17T05:52:06.934 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:06.931+0000 7feb3bb01640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7feb340b3e60 con 0x7feb34154e40 2024-09-17T05:52:06.934 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:06.931+0000 7feb3bb01640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7feb340b4160 con 0x7feb340b1410 2024-09-17T05:52:06.934 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:06.932+0000 7feb3909c640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7feb3414dd20 0x7feb3414e130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:52:06.934 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:06.932+0000 7feb3909c640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7feb3414dd20 0x7feb3414e130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:55922/0 (socket says 172.21.15.150:55922) 2024-09-17T05:52:06.934 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:06.932+0000 7feb3909c640 1 -- 172.21.15.150:0/721047980 learned_addr learned my addr 172.21.15.150:0/721047980 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:52:06.934 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:06.932+0000 7feb3a09e640 1 --2- 172.21.15.150:0/721047980 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7feb340b1410 0x7feb340b1820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:52:06.935 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:06.932+0000 7feb3909c640 1 -- 172.21.15.150:0/721047980 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7feb340b1410 msgr2=0x7feb340b1820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:52:06.935 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:06.932+0000 7feb3909c640 1 --2- 172.21.15.150:0/721047980 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7feb340b1410 0x7feb340b1820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:52:06.935 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:06.932+0000 7feb3909c640 1 -- 172.21.15.150:0/721047980 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7feb34154e40 msgr2=0x7feb34153d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:52:06.935 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:06.932+0000 7feb3989d640 1 --2- 172.21.15.150:0/721047980 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7feb34154e40 0x7feb34153d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:52:06.935 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:06.932+0000 7feb3909c640 1 --2- 172.21.15.150:0/721047980 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7feb34154e40 0x7feb34153d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:52:06.935 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:06.932+0000 7feb3909c640 1 -- 172.21.15.150:0/721047980 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feb341f5b60 con 0x7feb3414dd20 2024-09-17T05:52:06.935 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:06.932+0000 7feb3909c640 1 --2- 172.21.15.150:0/721047980 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7feb3414dd20 0x7feb3414e130 secure :-1 s=READY pgs=1605 cs=0 l=1 rev1=1 crypto rx=0x7feb28000fb0 tx=0x7feb2800eb60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:52:06.935 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:06.932+0000 7feb327fc640 1 -- 172.21.15.150:0/721047980 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb28015070 con 0x7feb3414dd20 2024-09-17T05:52:06.935 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:06.932+0000 7feb327fc640 1 -- 172.21.15.150:0/721047980 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7feb2800cb30 con 0x7feb3414dd20 2024-09-17T05:52:06.935 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:06.932+0000 7feb3bb01640 1 -- 172.21.15.150:0/721047980 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feb340b1d60 con 0x7feb3414dd20 2024-09-17T05:52:06.935 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:06.932+0000 7feb327fc640 1 -- 172.21.15.150:0/721047980 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb28011460 con 0x7feb3414dd20 2024-09-17T05:52:06.935 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:06.932+0000 7feb3bb01640 1 -- 172.21.15.150:0/721047980 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feb341f9be0 con 0x7feb3414dd20 2024-09-17T05:52:06.936 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:06.933+0000 7feb3bb01640 1 -- 172.21.15.150:0/721047980 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7feb340b46f0 con 0x7feb3414dd20 2024-09-17T05:52:06.936 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:06.934+0000 7feb327fc640 1 -- 172.21.15.150:0/721047980 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 42) ==== 104195+0+0 (secure 0 0 0) 0x7feb28018070 con 0x7feb3414dd20 2024-09-17T05:52:06.936 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:06.935+0000 7feb327fc640 1 --2- 172.21.15.150:0/721047980 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7feb2007a9f0 0x7feb2007cf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:52:06.936 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:06.935+0000 7feb327fc640 1 -- 172.21.15.150:0/721047980 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(116..116 src has 1..116) ==== 5963+0+0 (secure 0 0 0) 0x7feb2809a2a0 con 0x7feb3414dd20 2024-09-17T05:52:06.937 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:06.935+0000 7feb3989d640 1 --2- 172.21.15.150:0/721047980 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7feb2007a9f0 0x7feb2007cf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:52:06.937 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:06.935+0000 7feb3989d640 1 --2- 172.21.15.150:0/721047980 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7feb2007a9f0 0x7feb2007cf00 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7feb3414d7f0 tx=0x7feb24005f90 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:52:06.939 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:06.939+0000 7feb327fc640 1 -- 172.21.15.150:0/721047980 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7feb340b1d60 con 0x7feb3414dd20 2024-09-17T05:52:07.150 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:07.149+0000 7feb3bb01640 1 -- 172.21.15.150:0/721047980 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7feb341f9f80 con 0x7feb3414dd20 2024-09-17T05:52:07.150 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:07.149+0000 7feb327fc640 1 -- 172.21.15.150:0/721047980 <== mon.0 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 71 v71) ==== 94+0+5237 (secure 0 0 0) 0x7feb28064270 con 0x7feb3414dd20 2024-09-17T05:52:07.151 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-09-17T05:52:07.151 INFO:teuthology.orchestra.run.smithi150.stdout:{"epoch":71,"btime":"2024-09-17T05:51:27:572576+0000","default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6779,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6836/2908904841","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6835","nonce":2908904841},{"type":"v1","addr":"172.21.15.176:6836","nonce":2908904841}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":65},{"gid":6782,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6837/2764909757","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6834","nonce":2764909757},{"type":"v1","addr":"172.21.15.176:6837","nonce":2764909757}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":65},{"gid":8568,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6834/1970670297","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6832","nonce":1970670297},{"type":"v1","addr":"172.21.15.150:6834","nonce":1970670297}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":64}],"filesystems":[{"mdsmap":{"epoch":70,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T05:51:14.699714+0000","modified":"2024-09-17T05:51:17.724183+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":8571},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8571":{"gid":8571,"name":"c","rank":0,"incarnation":66,"state":"up:active","state_seq":3,"addr":"172.21.15.150:6835/4047640601","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6833","nonce":4047640601},{"type":"v1","addr":"172.21.15.150:6835","nonce":4047640601}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":8571,"qdb_cluster":[8571]},"id":8}]} 2024-09-17T05:52:07.151 INFO:teuthology.orchestra.run.smithi150.stderr:dumped fsmap epoch 71 2024-09-17T05:52:07.153 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:07.151+0000 7feb3bb01640 1 -- 172.21.15.150:0/721047980 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7feb2007a9f0 msgr2=0x7feb2007cf00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:52:07.153 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:07.151+0000 7feb3bb01640 1 --2- 172.21.15.150:0/721047980 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7feb2007a9f0 0x7feb2007cf00 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7feb3414d7f0 tx=0x7feb24005f90 comp rx=0 tx=0).stop 2024-09-17T05:52:07.153 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:07.151+0000 7feb3bb01640 1 -- 172.21.15.150:0/721047980 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7feb3414dd20 msgr2=0x7feb3414e130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:52:07.153 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:07.151+0000 7feb3bb01640 1 --2- 172.21.15.150:0/721047980 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7feb3414dd20 0x7feb3414e130 secure :-1 s=READY pgs=1605 cs=0 l=1 rev1=1 crypto rx=0x7feb28000fb0 tx=0x7feb2800eb60 comp rx=0 tx=0).stop 2024-09-17T05:52:07.153 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:07.152+0000 7feb3bb01640 1 -- 172.21.15.150:0/721047980 shutdown_connections 2024-09-17T05:52:07.153 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:07.152+0000 7feb3bb01640 1 --2- 172.21.15.150:0/721047980 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7feb2007a9f0 0x7feb2007cf00 unknown :-1 s=CLOSED pgs=683 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:52:07.153 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:07.152+0000 7feb3bb01640 1 --2- 172.21.15.150:0/721047980 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7feb340b1410 0x7feb340b1820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:52:07.153 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:07.152+0000 7feb3bb01640 1 --2- 172.21.15.150:0/721047980 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7feb3414dd20 0x7feb3414e130 unknown :-1 s=CLOSED pgs=1605 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:52:07.153 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:07.152+0000 7feb3bb01640 1 --2- 172.21.15.150:0/721047980 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7feb34154e40 0x7feb34153d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:52:07.153 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:07.152+0000 7feb3bb01640 1 -- 172.21.15.150:0/721047980 >> 172.21.15.150:0/721047980 conn(0x7feb3406d730 msgr2=0x7feb340cf770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:52:07.153 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:07.152+0000 7feb3bb01640 1 -- 172.21.15.150:0/721047980 shutdown_connections 2024-09-17T05:52:07.154 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:07.152+0000 7feb3bb01640 1 -- 172.21.15.150:0/721047980 wait complete. 2024-09-17T05:52:07.164 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T05:52:07.278 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:07.277+0000 7f82a42d5640 1 -- 172.21.15.150:0/2806266867 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f829c0b9b40 msgr2=0x7f829c0d51a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:52:07.278 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:07.277+0000 7f82a42d5640 1 --2- 172.21.15.150:0/2806266867 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f829c0b9b40 0x7f829c0d51a0 secure :-1 s=READY pgs=1607 cs=0 l=1 rev1=1 crypto rx=0x7f829c08cd30 tx=0x7f828c02a530 comp rx=0 tx=0).stop 2024-09-17T05:52:07.278 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:07.277+0000 7f82a42d5640 1 -- 172.21.15.150:0/2806266867 shutdown_connections 2024-09-17T05:52:07.278 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:07.277+0000 7f82a42d5640 1 --2- 172.21.15.150:0/2806266867 >> v2:172.21.15.176:3300/0 conn(0x7f829c0d31e0 0x7f829c0d0db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:52:07.278 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:07.277+0000 7f82a42d5640 1 --2- 172.21.15.150:0/2806266867 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f829c0b9b40 0x7f829c0d51a0 unknown :-1 s=CLOSED pgs=1607 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:52:07.278 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:07.277+0000 7f82a42d5640 1 -- 172.21.15.150:0/2806266867 >> 172.21.15.150:0/2806266867 conn(0x7f829c0d4680 msgr2=0x7f829c0d4a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:52:07.278 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:07.277+0000 7f82a42d5640 1 -- 172.21.15.150:0/2806266867 shutdown_connections 2024-09-17T05:52:07.279 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:07.277+0000 7f82a42d5640 1 -- 172.21.15.150:0/2806266867 wait complete. 2024-09-17T05:52:07.279 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:07.279+0000 7f82a42d5640 1 Processor -- start 2024-09-17T05:52:07.279 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:07.279+0000 7f82a42d5640 1 -- start start 2024-09-17T05:52:07.282 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:07.280+0000 7f82a42d5640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f829c0b9b40 0x7f829c1f6d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:52:07.282 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:07.280+0000 7f82a42d5640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f829c0d12f0 0x7f829c152a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:52:07.282 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:07.280+0000 7f82a42d5640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f829c0d31e0 0x7f829c09ffd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:52:07.282 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:07.280+0000 7f82a42d5640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f829c0b3c50 con 0x7f829c0d31e0 2024-09-17T05:52:07.282 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:07.280+0000 7f82a42d5640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f829c0b3ad0 con 0x7f829c0d12f0 2024-09-17T05:52:07.282 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:07.280+0000 7f82a42d5640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f829c0cf9a0 con 0x7f829c0b9b40 2024-09-17T05:52:07.282 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:07.280+0000 7f82a2872640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f829c0d31e0 0x7f829c09ffd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:52:07.282 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:07.280+0000 7f82a2872640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f829c0d31e0 0x7f829c09ffd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:55930/0 (socket says 172.21.15.150:55930) 2024-09-17T05:52:07.282 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:07.280+0000 7f82a2872640 1 -- 172.21.15.150:0/343466134 learned_addr learned my addr 172.21.15.150:0/343466134 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:52:07.283 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:07.280+0000 7f82a2071640 1 --2- 172.21.15.150:0/343466134 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f829c0b9b40 0x7f829c1f6d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:52:07.283 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:07.280+0000 7f82a1870640 1 --2- 172.21.15.150:0/343466134 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f829c0d12f0 0x7f829c152a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:52:07.283 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:07.280+0000 7f82a2872640 1 -- 172.21.15.150:0/343466134 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f829c0b9b40 msgr2=0x7f829c1f6d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:52:07.283 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:07.280+0000 7f82a2872640 1 --2- 172.21.15.150:0/343466134 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f829c0b9b40 0x7f829c1f6d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:52:07.283 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:07.280+0000 7f82a2872640 1 -- 172.21.15.150:0/343466134 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f829c0d12f0 msgr2=0x7f829c152a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:52:07.283 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:07.280+0000 7f82a2872640 1 --2- 172.21.15.150:0/343466134 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f829c0d12f0 0x7f829c152a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:52:07.283 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:07.280+0000 7f82a2872640 1 -- 172.21.15.150:0/343466134 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f829c0ce6e0 con 0x7f829c0d31e0 2024-09-17T05:52:07.283 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:07.281+0000 7f82a2872640 1 --2- 172.21.15.150:0/343466134 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f829c0d31e0 0x7f829c09ffd0 secure :-1 s=READY pgs=1608 cs=0 l=1 rev1=1 crypto rx=0x7f829400c760 tx=0x7f829400cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:52:07.283 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:07.281+0000 7f8292ffd640 1 -- 172.21.15.150:0/343466134 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8294003da0 con 0x7f829c0d31e0 2024-09-17T05:52:07.283 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:07.281+0000 7f8292ffd640 1 -- 172.21.15.150:0/343466134 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f829400ce10 con 0x7f829c0d31e0 2024-09-17T05:52:07.283 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:07.281+0000 7f82a42d5640 1 -- 172.21.15.150:0/343466134 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f829c0ce9c0 con 0x7f829c0d31e0 2024-09-17T05:52:07.283 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:07.281+0000 7f8292ffd640 1 -- 172.21.15.150:0/343466134 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82940052d0 con 0x7f829c0d31e0 2024-09-17T05:52:07.283 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:07.281+0000 7f82a42d5640 1 -- 172.21.15.150:0/343466134 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f829c09e6f0 con 0x7f829c0d31e0 2024-09-17T05:52:07.284 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:07.282+0000 7f82a42d5640 1 -- 172.21.15.150:0/343466134 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f829c0cfee0 con 0x7f829c0d31e0 2024-09-17T05:52:07.285 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:07.283+0000 7f8292ffd640 1 -- 172.21.15.150:0/343466134 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 42) ==== 104195+0+0 (secure 0 0 0) 0x7f8294005470 con 0x7f829c0d31e0 2024-09-17T05:52:07.285 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:07.283+0000 7f8292ffd640 1 --2- 172.21.15.150:0/343466134 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f828007a9f0 0x7f828007cf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:52:07.285 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:07.283+0000 7f8292ffd640 1 -- 172.21.15.150:0/343466134 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(116..116 src has 1..116) ==== 5963+0+0 (secure 0 0 0) 0x7f829409a4c0 con 0x7f829c0d31e0 2024-09-17T05:52:07.285 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:07.283+0000 7f82a2071640 1 --2- 172.21.15.150:0/343466134 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f828007a9f0 0x7f828007cf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:52:07.285 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:07.284+0000 7f82a2071640 1 --2- 172.21.15.150:0/343466134 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f828007a9f0 0x7f828007cf00 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x7f828c034000 tx=0x7f828c004730 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:52:07.287 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:07.287+0000 7f8292ffd640 1 -- 172.21.15.150:0/343466134 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f829c0d1700 con 0x7f829c0d31e0 2024-09-17T05:52:07.466 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:07.465+0000 7f82a42d5640 1 -- 172.21.15.150:0/343466134 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f829c0d1d30 con 0x7f829c0d31e0 2024-09-17T05:52:07.467 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:07.467+0000 7f8292ffd640 1 -- 172.21.15.150:0/343466134 <== mon.0 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v116) ==== 74+0+17211 (secure 0 0 0) 0x7f82940644e0 con 0x7f829c0d31e0 2024-09-17T05:52:07.468 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-09-17T05:52:07.468 INFO:teuthology.orchestra.run.smithi150.stdout:{"epoch":116,"fsid":"9f2e05e9-d629-47b3-b26b-1360655b7d20","created":"2024-09-17T05:41:32.502979+0000","modified":"2024-09-17T05:52:06.151687+0000","last_up_change":"2024-09-17T05:41:46.150225+0000","last_in_change":"2024-09-17T05:41:36.120274+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":17,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T05:41:46.860779+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":16,"pool_name":"cephfs_metadata","create_time":"2024-09-17T05:51:12.343530+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"112","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":17,"pool_name":"cephfs_data","create_time":"2024-09-17T05:51:13.667025+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"116","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":3,"snap_epoch":116,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"4f31c018-c8a4-4d6d-b0c2-a597c47aae4a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6800","nonce":479374392},{"type":"v1","addr":"172.21.15.150:6801","nonce":479374392}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6802","nonce":479374392},{"type":"v1","addr":"172.21.15.150:6803","nonce":479374392}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6806","nonce":479374392},{"type":"v1","addr":"172.21.15.150:6807","nonce":479374392}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6804","nonce":479374392},{"type":"v1","addr":"172.21.15.150:6805","nonce":479374392}]},"public_addr":"172.21.15.150:6801/479374392","cluster_addr":"172.21.15.150:6803/479374392","heartbeat_back_addr":"172.21.15.150:6807/479374392","heartbeat_front_addr":"172.21.15.150:6805/479374392","state":["exists","up"]},{"osd":1,"uuid":"6ff4a573-500b-4e04-9de3-39265ead78b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6824","nonce":913899800},{"type":"v1","addr":"172.21.15.150:6825","nonce":913899800}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6826","nonce":913899800},{"type":"v1","addr":"172.21.15.150:6827","nonce":913899800}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6830","nonce":913899800},{"type":"v1","addr":"172.21.15.150:6831","nonce":913899800}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6828","nonce":913899800},{"type":"v1","addr":"172.21.15.150:6829","nonce":913899800}]},"public_addr":"172.21.15.150:6825/913899800","cluster_addr":"172.21.15.150:6827/913899800","heartbeat_back_addr":"172.21.15.150:6831/913899800","heartbeat_front_addr":"172.21.15.150:6829/913899800","state":["exists","up"]},{"osd":2,"uuid":"bffea6f9-2465-4182-b205-00436c41ac1c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":114,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6816","nonce":363718461},{"type":"v1","addr":"172.21.15.150:6817","nonce":363718461}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6818","nonce":363718461},{"type":"v1","addr":"172.21.15.150:6819","nonce":363718461}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6822","nonce":363718461},{"type":"v1","addr":"172.21.15.150:6823","nonce":363718461}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6820","nonce":363718461},{"type":"v1","addr":"172.21.15.150:6821","nonce":363718461}]},"public_addr":"172.21.15.150:6817/363718461","cluster_addr":"172.21.15.150:6819/363718461","heartbeat_back_addr":"172.21.15.150:6823/363718461","heartbeat_front_addr":"172.21.15.150:6821/363718461","state":["exists","up"]},{"osd":3,"uuid":"cda70430-d1e1-427e-b04e-56db4031d078","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":114,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6808","nonce":3550994626},{"type":"v1","addr":"172.21.15.150:6809","nonce":3550994626}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6810","nonce":3550994626},{"type":"v1","addr":"172.21.15.150:6811","nonce":3550994626}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6814","nonce":3550994626},{"type":"v1","addr":"172.21.15.150:6815","nonce":3550994626}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6812","nonce":3550994626},{"type":"v1","addr":"172.21.15.150:6813","nonce":3550994626}]},"public_addr":"172.21.15.150:6809/3550994626","cluster_addr":"172.21.15.150:6811/3550994626","heartbeat_back_addr":"172.21.15.150:6815/3550994626","heartbeat_front_addr":"172.21.15.150:6813/3550994626","state":["exists","up"]},{"osd":4,"uuid":"3a0277fb-5e1e-4f68-bb2d-9a8a0152f64a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6810","nonce":2718261497},{"type":"v1","addr":"172.21.15.176:6811","nonce":2718261497}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6812","nonce":2718261497},{"type":"v1","addr":"172.21.15.176:6813","nonce":2718261497}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6816","nonce":2718261497},{"type":"v1","addr":"172.21.15.176:6817","nonce":2718261497}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6814","nonce":2718261497},{"type":"v1","addr":"172.21.15.176:6815","nonce":2718261497}]},"public_addr":"172.21.15.176:6811/2718261497","cluster_addr":"172.21.15.176:6813/2718261497","heartbeat_back_addr":"172.21.15.176:6817/2718261497","heartbeat_front_addr":"172.21.15.176:6815/2718261497","state":["exists","up"]},{"osd":5,"uuid":"33aebee6-0315-40b7-a11c-6702f0be494d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6818","nonce":2049295774},{"type":"v1","addr":"172.21.15.176:6819","nonce":2049295774}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6820","nonce":2049295774},{"type":"v1","addr":"172.21.15.176:6821","nonce":2049295774}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6824","nonce":2049295774},{"type":"v1","addr":"172.21.15.176:6825","nonce":2049295774}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6822","nonce":2049295774},{"type":"v1","addr":"172.21.15.176:6823","nonce":2049295774}]},"public_addr":"172.21.15.176:6819/2049295774","cluster_addr":"172.21.15.176:6821/2049295774","heartbeat_back_addr":"172.21.15.176:6825/2049295774","heartbeat_front_addr":"172.21.15.176:6823/2049295774","state":["exists","up"]},{"osd":6,"uuid":"4d24f360-6751-4263-841b-d77793d33540","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6826","nonce":2164458476},{"type":"v1","addr":"172.21.15.176:6827","nonce":2164458476}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6828","nonce":2164458476},{"type":"v1","addr":"172.21.15.176:6829","nonce":2164458476}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6832","nonce":2164458476},{"type":"v1","addr":"172.21.15.176:6833","nonce":2164458476}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6830","nonce":2164458476},{"type":"v1","addr":"172.21.15.176:6831","nonce":2164458476}]},"public_addr":"172.21.15.176:6827/2164458476","cluster_addr":"172.21.15.176:6829/2164458476","heartbeat_back_addr":"172.21.15.176:6833/2164458476","heartbeat_front_addr":"172.21.15.176:6831/2164458476","state":["exists","up"]},{"osd":7,"uuid":"c8594fda-c74a-4ba9-8277-caf101d58ca1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6802","nonce":3239587708},{"type":"v1","addr":"172.21.15.176:6803","nonce":3239587708}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6804","nonce":3239587708},{"type":"v1","addr":"172.21.15.176:6805","nonce":3239587708}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6808","nonce":3239587708},{"type":"v1","addr":"172.21.15.176:6809","nonce":3239587708}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6806","nonce":3239587708},{"type":"v1","addr":"172.21.15.176:6807","nonce":3239587708}]},"public_addr":"172.21.15.176:6803/3239587708","cluster_addr":"172.21.15.176:6805/3239587708","heartbeat_back_addr":"172.21.15.176:6809/3239587708","heartbeat_front_addr":"172.21.15.176:6807/3239587708","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:41:41.905151+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:41:42.705679+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:41:42.459673+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:41:42.440819+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:41:42.668428+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:41:42.694972+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:41:43.078535+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:41:42.363539+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"17.24","mappings":[{"from":0,"to":5}]},{"pgid":"17.26","mappings":[{"from":0,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":7,"snaps":[{"begin":2,"length":2}]},{"pool":9,"snaps":[{"begin":2,"length":2}]},{"pool":11,"snaps":[{"begin":2,"length":2}]},{"pool":13,"snaps":[{"begin":2,"length":2}]},{"pool":15,"snaps":[{"begin":2,"length":2}]},{"pool":17,"snaps":[{"begin":2,"length":2}]}],"new_removed_snaps":[{"pool":17,"snaps":[{"begin":2,"length":2}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T05:52:07.470 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:07.469+0000 7f82a42d5640 1 -- 172.21.15.150:0/343466134 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f828007a9f0 msgr2=0x7f828007cf00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:52:07.470 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:07.469+0000 7f82a42d5640 1 --2- 172.21.15.150:0/343466134 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f828007a9f0 0x7f828007cf00 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x7f828c034000 tx=0x7f828c004730 comp rx=0 tx=0).stop 2024-09-17T05:52:07.470 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:07.469+0000 7f82a42d5640 1 -- 172.21.15.150:0/343466134 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f829c0d31e0 msgr2=0x7f829c09ffd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:52:07.470 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:07.469+0000 7f82a42d5640 1 --2- 172.21.15.150:0/343466134 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f829c0d31e0 0x7f829c09ffd0 secure :-1 s=READY pgs=1608 cs=0 l=1 rev1=1 crypto rx=0x7f829400c760 tx=0x7f829400cc20 comp rx=0 tx=0).stop 2024-09-17T05:52:07.470 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:07.469+0000 7f82a42d5640 1 -- 172.21.15.150:0/343466134 shutdown_connections 2024-09-17T05:52:07.470 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:07.469+0000 7f82a42d5640 1 --2- 172.21.15.150:0/343466134 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f829c0d12f0 0x7f829c152a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:52:07.470 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:07.469+0000 7f82a42d5640 1 --2- 172.21.15.150:0/343466134 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f828007a9f0 0x7f828007cf00 unknown :-1 s=CLOSED pgs=684 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:52:07.470 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:07.469+0000 7f82a42d5640 1 --2- 172.21.15.150:0/343466134 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f829c0d31e0 0x7f829c09ffd0 unknown :-1 s=CLOSED pgs=1608 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:52:07.470 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:07.469+0000 7f82a42d5640 1 --2- 172.21.15.150:0/343466134 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f829c0b9b40 0x7f829c1f6d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:52:07.470 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:07.469+0000 7f82a42d5640 1 -- 172.21.15.150:0/343466134 >> 172.21.15.150:0/343466134 conn(0x7f829c0d4680 msgr2=0x7f829c068e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:52:07.470 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:07.469+0000 7f82a42d5640 1 -- 172.21.15.150:0/343466134 shutdown_connections 2024-09-17T05:52:07.470 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:07.469+0000 7f82a42d5640 1 -- 172.21.15.150:0/343466134 wait complete. 2024-09-17T05:52:07.482 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-09-17T05:52:07.596 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:07.595+0000 7fa7deee5640 1 -- 172.21.15.150:0/3978150034 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa7d80aea50 msgr2=0x7fa7d8166590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:52:07.596 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:07.595+0000 7fa7deee5640 1 --2- 172.21.15.150:0/3978150034 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa7d80aea50 0x7fa7d8166590 secure :-1 s=READY pgs=1610 cs=0 l=1 rev1=1 crypto rx=0x7fa7d0005fd0 tx=0x7fa7d002a5d0 comp rx=0 tx=0).stop 2024-09-17T05:52:07.596 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:07.595+0000 7fa7deee5640 1 -- 172.21.15.150:0/3978150034 shutdown_connections 2024-09-17T05:52:07.597 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:07.595+0000 7fa7deee5640 1 --2- 172.21.15.150:0/3978150034 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa7d80aea50 0x7fa7d8166590 unknown :-1 s=CLOSED pgs=1610 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:52:07.597 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:07.595+0000 7fa7deee5640 1 -- 172.21.15.150:0/3978150034 >> 172.21.15.150:0/3978150034 conn(0x7fa7d80b6880 msgr2=0x7fa7d80b3060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:52:07.597 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:07.595+0000 7fa7deee5640 1 -- 172.21.15.150:0/3978150034 shutdown_connections 2024-09-17T05:52:07.597 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:07.595+0000 7fa7deee5640 1 -- 172.21.15.150:0/3978150034 wait complete. 2024-09-17T05:52:07.597 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:07.597+0000 7fa7deee5640 1 Processor -- start 2024-09-17T05:52:07.597 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:07.597+0000 7fa7deee5640 1 -- start start 2024-09-17T05:52:07.600 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:07.598+0000 7fa7deee5640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa7d80aea50 0x7fa7d8145bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:52:07.601 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:07.598+0000 7fa7deee5640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa7d80d0cd0 0x7fa7d815d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:52:07.601 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:07.598+0000 7fa7deee5640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa7d8156130 0x7fa7d815dbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:52:07.601 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:07.598+0000 7fa7deee5640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7fa7d8166e60 con 0x7fa7d8156130 2024-09-17T05:52:07.601 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:07.598+0000 7fa7deee5640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fa7d8166ce0 con 0x7fa7d80d0cd0 2024-09-17T05:52:07.601 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:07.598+0000 7fa7deee5640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fa7d8166fe0 con 0x7fa7d80aea50 2024-09-17T05:52:07.601 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:07.598+0000 7fa7dd482640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa7d8156130 0x7fa7d815dbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:52:07.601 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:07.598+0000 7fa7dd482640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa7d8156130 0x7fa7d815dbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:55946/0 (socket says 172.21.15.150:55946) 2024-09-17T05:52:07.601 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:07.598+0000 7fa7dd482640 1 -- 172.21.15.150:0/3208851915 learned_addr learned my addr 172.21.15.150:0/3208851915 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:52:07.601 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:07.599+0000 7fa7dcc81640 1 --2- 172.21.15.150:0/3208851915 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa7d80aea50 0x7fa7d8145bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:52:07.601 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:07.599+0000 7fa7d7fff640 1 --2- 172.21.15.150:0/3208851915 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa7d80d0cd0 0x7fa7d815d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:52:07.601 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:07.599+0000 7fa7dd482640 1 -- 172.21.15.150:0/3208851915 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa7d80aea50 msgr2=0x7fa7d8145bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:52:07.601 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:07.599+0000 7fa7dd482640 1 --2- 172.21.15.150:0/3208851915 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa7d80aea50 0x7fa7d8145bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:52:07.602 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:07.599+0000 7fa7dd482640 1 -- 172.21.15.150:0/3208851915 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa7d80d0cd0 msgr2=0x7fa7d815d680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:52:07.602 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:07.599+0000 7fa7dd482640 1 --2- 172.21.15.150:0/3208851915 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa7d80d0cd0 0x7fa7d815d680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:52:07.602 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:07.599+0000 7fa7dd482640 1 -- 172.21.15.150:0/3208851915 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa7d815e490 con 0x7fa7d8156130 2024-09-17T05:52:07.602 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:07.599+0000 7fa7dcc81640 1 --2- 172.21.15.150:0/3208851915 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa7d80aea50 0x7fa7d8145bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:52:07.602 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:07.599+0000 7fa7dd482640 1 --2- 172.21.15.150:0/3208851915 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa7d8156130 0x7fa7d815dbc0 secure :-1 s=READY pgs=1611 cs=0 l=1 rev1=1 crypto rx=0x7fa7d0006010 tx=0x7fa7d00056d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:52:07.602 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:07.599+0000 7fa7d57fa640 1 -- 172.21.15.150:0/3208851915 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7d0035040 con 0x7fa7d8156130 2024-09-17T05:52:07.602 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:07.599+0000 7fa7d57fa640 1 -- 172.21.15.150:0/3208851915 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa7d0003b20 con 0x7fa7d8156130 2024-09-17T05:52:07.602 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:07.599+0000 7fa7deee5640 1 -- 172.21.15.150:0/3208851915 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa7d80b1690 con 0x7fa7d8156130 2024-09-17T05:52:07.602 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:07.599+0000 7fa7d57fa640 1 -- 172.21.15.150:0/3208851915 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7d00047a0 con 0x7fa7d8156130 2024-09-17T05:52:07.602 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:07.599+0000 7fa7deee5640 1 -- 172.21.15.150:0/3208851915 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa7d80b1c50 con 0x7fa7d8156130 2024-09-17T05:52:07.603 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:07.600+0000 7fa7deee5640 1 -- 172.21.15.150:0/3208851915 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa7d81481f0 con 0x7fa7d8156130 2024-09-17T05:52:07.603 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:07.601+0000 7fa7d57fa640 1 -- 172.21.15.150:0/3208851915 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 42) ==== 104195+0+0 (secure 0 0 0) 0x7fa7d0004940 con 0x7fa7d8156130 2024-09-17T05:52:07.603 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:07.602+0000 7fa7d57fa640 1 --2- 172.21.15.150:0/3208851915 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fa7c407a9f0 0x7fa7c407cf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:52:07.603 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:07.602+0000 7fa7d57fa640 1 -- 172.21.15.150:0/3208851915 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(116..116 src has 1..116) ==== 5963+0+0 (secure 0 0 0) 0x7fa7d00bc630 con 0x7fa7d8156130 2024-09-17T05:52:07.603 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:07.602+0000 7fa7dcc81640 1 --2- 172.21.15.150:0/3208851915 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fa7c407a9f0 0x7fa7c407cf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:52:07.604 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:07.602+0000 7fa7dcc81640 1 --2- 172.21.15.150:0/3208851915 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fa7c407a9f0 0x7fa7c407cf00 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7fa7c8001da0 tx=0x7fa7c8009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:52:07.607 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:07.606+0000 7fa7d57fa640 1 -- 172.21.15.150:0/3208851915 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fa7d0086600 con 0x7fa7d8156130 2024-09-17T05:52:07.822 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:07.821+0000 7fa7deee5640 1 -- 172.21.15.150:0/3208851915 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7fa7d815e220 con 0x7fa7d8156130 2024-09-17T05:52:07.823 INFO:tasks.ceph.mon.a.smithi150.stderr:2024-09-17T05:52:07.822+0000 7f73931ae640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-17T05:52:07.824 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:07.824+0000 7fa7d57fa640 1 -- 172.21.15.150:0/3208851915 <== mon.0 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v72) ==== 161+0+0 (secure 0 0 0) 0x7fa7d0085f00 con 0x7fa7d8156130 2024-09-17T05:52:07.824 INFO:teuthology.orchestra.run.smithi150.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-09-17T05:52:07.829 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:07.826+0000 7fa7deee5640 1 -- 172.21.15.150:0/3208851915 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fa7c407a9f0 msgr2=0x7fa7c407cf00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:52:07.829 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:07.826+0000 7fa7deee5640 1 --2- 172.21.15.150:0/3208851915 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fa7c407a9f0 0x7fa7c407cf00 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7fa7c8001da0 tx=0x7fa7c8009040 comp rx=0 tx=0).stop 2024-09-17T05:52:07.829 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:07.827+0000 7fa7deee5640 1 -- 172.21.15.150:0/3208851915 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa7d8156130 msgr2=0x7fa7d815dbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:52:07.829 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:07.827+0000 7fa7deee5640 1 --2- 172.21.15.150:0/3208851915 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa7d8156130 0x7fa7d815dbc0 secure :-1 s=READY pgs=1611 cs=0 l=1 rev1=1 crypto rx=0x7fa7d0006010 tx=0x7fa7d00056d0 comp rx=0 tx=0).stop 2024-09-17T05:52:07.829 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:07.827+0000 7fa7deee5640 1 -- 172.21.15.150:0/3208851915 shutdown_connections 2024-09-17T05:52:07.829 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:07.827+0000 7fa7deee5640 1 --2- 172.21.15.150:0/3208851915 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa7d80d0cd0 0x7fa7d815d680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:52:07.830 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:07.827+0000 7fa7deee5640 1 --2- 172.21.15.150:0/3208851915 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fa7c407a9f0 0x7fa7c407cf00 unknown :-1 s=CLOSED pgs=685 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:52:07.830 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:07.827+0000 7fa7deee5640 1 --2- 172.21.15.150:0/3208851915 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa7d8156130 0x7fa7d815dbc0 unknown :-1 s=CLOSED pgs=1611 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:52:07.830 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:07.827+0000 7fa7deee5640 1 --2- 172.21.15.150:0/3208851915 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa7d80aea50 0x7fa7d8145bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:52:07.830 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:07.827+0000 7fa7deee5640 1 -- 172.21.15.150:0/3208851915 >> 172.21.15.150:0/3208851915 conn(0x7fa7d80b6880 msgr2=0x7fa7d814b0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:52:07.831 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:07.829+0000 7fa7deee5640 1 -- 172.21.15.150:0/3208851915 shutdown_connections 2024-09-17T05:52:07.831 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:07.829+0000 7fa7deee5640 1 -- 172.21.15.150:0/3208851915 wait complete. 2024-09-17T05:52:07.843 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-09-17T05:52:07.891 INFO:tasks.ceph.mds.c.smithi150.stdout:starting mds.c at 2024-09-17T05:52:07.962 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:07.961+0000 7f463560e640 1 -- 172.21.15.150:0/3846047072 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f46300af570 msgr2=0x7f46300d0980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:52:07.962 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:07.961+0000 7f463560e640 1 --2- 172.21.15.150:0/3846047072 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f46300af570 0x7f46300d0980 secure :-1 s=READY pgs=1615 cs=0 l=1 rev1=1 crypto rx=0x7f4618009830 tx=0x7f461802a4a0 comp rx=0 tx=0).stop 2024-09-17T05:52:07.962 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:07.961+0000 7f463560e640 1 -- 172.21.15.150:0/3846047072 shutdown_connections 2024-09-17T05:52:07.963 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:07.961+0000 7f463560e640 1 --2- 172.21.15.150:0/3846047072 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f46300af570 0x7f46300d0980 unknown :-1 s=CLOSED pgs=1615 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:52:07.963 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:07.961+0000 7f463560e640 1 -- 172.21.15.150:0/3846047072 >> 172.21.15.150:0/3846047072 conn(0x7f46300cefb0 msgr2=0x7f46300cf3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:52:07.963 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:07.961+0000 7f463560e640 1 -- 172.21.15.150:0/3846047072 shutdown_connections 2024-09-17T05:52:07.963 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:07.961+0000 7f463560e640 1 -- 172.21.15.150:0/3846047072 wait complete. 2024-09-17T05:52:07.964 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:07.963+0000 7f463560e640 1 Processor -- start 2024-09-17T05:52:07.964 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:07.963+0000 7f463560e640 1 -- start start 2024-09-17T05:52:07.966 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:07.964+0000 7f463560e640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f46300af160 0x7f46301f42e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:52:07.966 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:07.964+0000 7f463560e640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f46300af570 0x7f46300cbd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:52:07.967 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:07.964+0000 7f463560e640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f46300d0ec0 0x7f463014f450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:52:07.967 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:07.964+0000 7f463560e640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f46300d12d0 con 0x7f46300af160 2024-09-17T05:52:07.967 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:07.964+0000 7f463560e640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f46300cede0 con 0x7f46300d0ec0 2024-09-17T05:52:07.967 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:07.964+0000 7f463560e640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f46300d1450 con 0x7f46300af570 2024-09-17T05:52:07.967 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:07.965+0000 7f462effd640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f46300af160 0x7f46301f42e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:52:07.967 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:07.965+0000 7f462effd640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f46300af160 0x7f46301f42e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:55992/0 (socket says 172.21.15.150:55992) 2024-09-17T05:52:07.967 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:07.965+0000 7f462effd640 1 -- 172.21.15.150:0/2133316428 learned_addr learned my addr 172.21.15.150:0/2133316428 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:52:07.967 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:07.965+0000 7f462e7fc640 1 --2- 172.21.15.150:0/2133316428 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f46300af570 0x7f46300cbd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:52:07.967 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:07.965+0000 7f462f7fe640 1 --2- 172.21.15.150:0/2133316428 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f46300d0ec0 0x7f463014f450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:52:07.967 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:07.965+0000 7f462effd640 1 -- 172.21.15.150:0/2133316428 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f46300af570 msgr2=0x7f46300cbd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:52:07.967 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:07.965+0000 7f462effd640 1 --2- 172.21.15.150:0/2133316428 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f46300af570 0x7f46300cbd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:52:07.967 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:07.965+0000 7f462effd640 1 -- 172.21.15.150:0/2133316428 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f46300d0ec0 msgr2=0x7f463014f450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:52:07.968 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:07.965+0000 7f462effd640 1 --2- 172.21.15.150:0/2133316428 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f46300d0ec0 0x7f463014f450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:52:07.968 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:07.965+0000 7f462effd640 1 -- 172.21.15.150:0/2133316428 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f463014ffc0 con 0x7f46300af160 2024-09-17T05:52:07.968 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:07.965+0000 7f462effd640 1 --2- 172.21.15.150:0/2133316428 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f46300af160 0x7f46301f42e0 secure :-1 s=READY pgs=1616 cs=0 l=1 rev1=1 crypto rx=0x7f462000c3a0 tx=0x7f462000c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:52:07.968 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:07.965+0000 7f46277fe640 1 -- 172.21.15.150:0/2133316428 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4620017070 con 0x7f46300af160 2024-09-17T05:52:07.968 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:07.965+0000 7f46277fe640 1 -- 172.21.15.150:0/2133316428 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f46200035f0 con 0x7f46300af160 2024-09-17T05:52:07.968 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:07.965+0000 7f463560e640 1 -- 172.21.15.150:0/2133316428 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f46301502a0 con 0x7f46300af160 2024-09-17T05:52:07.968 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:07.965+0000 7f46277fe640 1 -- 172.21.15.150:0/2133316428 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4620003a40 con 0x7f46300af160 2024-09-17T05:52:07.968 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:07.965+0000 7f463560e640 1 -- 172.21.15.150:0/2133316428 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f46301f7050 con 0x7f46300af160 2024-09-17T05:52:07.969 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:07.966+0000 7f463560e640 1 -- 172.21.15.150:0/2133316428 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f46300d0980 con 0x7f46300af160 2024-09-17T05:52:07.969 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:07.967+0000 7f46277fe640 1 -- 172.21.15.150:0/2133316428 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 42) ==== 104195+0+0 (secure 0 0 0) 0x7f462001a070 con 0x7f46300af160 2024-09-17T05:52:07.969 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:07.968+0000 7f46277fe640 1 --2- 172.21.15.150:0/2133316428 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f461007a9f0 0x7f461007cf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:52:07.969 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:07.968+0000 7f46277fe640 1 -- 172.21.15.150:0/2133316428 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(117..117 src has 1..117) ==== 6021+0+0 (secure 0 0 0) 0x7f4620098f30 con 0x7f46300af160 2024-09-17T05:52:07.969 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:07.968+0000 7f462e7fc640 1 --2- 172.21.15.150:0/2133316428 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f461007a9f0 0x7f461007cf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:52:07.969 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:07.969+0000 7f462e7fc640 1 --2- 172.21.15.150:0/2133316428 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f461007a9f0 0x7f461007cf00 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7f4618034000 tx=0x7f4618004730 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:52:07.973 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:07.972+0000 7f46277fe640 1 -- 172.21.15.150:0/2133316428 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f4620062820 con 0x7f46300af160 2024-09-17T05:52:08.187 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:08.186+0000 7f463560e640 1 -- 172.21.15.150:0/2133316428 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7f46300b5e10 con 0x7f46300af160 2024-09-17T05:52:08.826 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:08.825+0000 7f46277fe640 1 -- 172.21.15.150:0/2133316428 <== mon.0 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v73) ==== 104+0+0 (secure 0 0 0) 0x7f4620067250 con 0x7f46300af160 2024-09-17T05:52:08.829 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:08.828+0000 7f463560e640 1 -- 172.21.15.150:0/2133316428 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f461007a9f0 msgr2=0x7f461007cf00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:52:08.829 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:08.828+0000 7f463560e640 1 --2- 172.21.15.150:0/2133316428 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f461007a9f0 0x7f461007cf00 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7f4618034000 tx=0x7f4618004730 comp rx=0 tx=0).stop 2024-09-17T05:52:08.829 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:08.828+0000 7f463560e640 1 -- 172.21.15.150:0/2133316428 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f46300af160 msgr2=0x7f46301f42e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:52:08.829 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:08.828+0000 7f463560e640 1 --2- 172.21.15.150:0/2133316428 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f46300af160 0x7f46301f42e0 secure :-1 s=READY pgs=1616 cs=0 l=1 rev1=1 crypto rx=0x7f462000c3a0 tx=0x7f462000c860 comp rx=0 tx=0).stop 2024-09-17T05:52:08.829 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:08.828+0000 7f463560e640 1 -- 172.21.15.150:0/2133316428 shutdown_connections 2024-09-17T05:52:08.829 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:08.828+0000 7f463560e640 1 --2- 172.21.15.150:0/2133316428 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f46300d0ec0 0x7f463014f450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:52:08.829 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:08.828+0000 7f463560e640 1 --2- 172.21.15.150:0/2133316428 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f461007a9f0 0x7f461007cf00 unknown :-1 s=CLOSED pgs=686 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:52:08.829 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:08.828+0000 7f463560e640 1 --2- 172.21.15.150:0/2133316428 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f46300af570 0x7f46300cbd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:52:08.829 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:08.828+0000 7f463560e640 1 --2- 172.21.15.150:0/2133316428 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f46300af160 0x7f46301f42e0 unknown :-1 s=CLOSED pgs=1616 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:52:08.829 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:08.828+0000 7f463560e640 1 -- 172.21.15.150:0/2133316428 >> 172.21.15.150:0/2133316428 conn(0x7f46300cefb0 msgr2=0x7f463015dc30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:52:08.829 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:08.828+0000 7f463560e640 1 -- 172.21.15.150:0/2133316428 shutdown_connections 2024-09-17T05:52:08.830 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:08.828+0000 7f463560e640 1 -- 172.21.15.150:0/2133316428 wait complete. 2024-09-17T05:52:08.841 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-09-17T05:52:08.960 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:08.959+0000 7f2e5cbc6640 1 -- 172.21.15.150:0/1507899790 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2e40004800 msgr2=0x7f2e40004c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:52:08.960 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:08.959+0000 7f2e5cbc6640 1 --2- 172.21.15.150:0/1507899790 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2e40004800 0x7f2e40004c10 secure :-1 s=READY pgs=1618 cs=0 l=1 rev1=1 crypto rx=0x7f2e4c009b50 tx=0x7f2e40005830 comp rx=0 tx=0).stop 2024-09-17T05:52:08.960 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:08.959+0000 7f2e56d9d640 1 -- 172.21.15.150:0/1507899790 reap_dead start 2024-09-17T05:52:08.960 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:08.959+0000 7f2e5cbc6640 1 -- 172.21.15.150:0/1507899790 shutdown_connections 2024-09-17T05:52:08.960 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:08.959+0000 7f2e5cbc6640 1 -- 172.21.15.150:0/1507899790 >> 172.21.15.150:0/1507899790 conn(0x7f2e580cee80 msgr2=0x7f2e580cf290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:52:08.961 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:08.959+0000 7f2e5cbc6640 1 -- 172.21.15.150:0/1507899790 shutdown_connections 2024-09-17T05:52:08.961 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:08.959+0000 7f2e5cbc6640 1 -- 172.21.15.150:0/1507899790 wait complete. 2024-09-17T05:52:08.961 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:08.961+0000 7f2e5cbc6640 1 Processor -- start 2024-09-17T05:52:08.962 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:08.961+0000 7f2e5cbc6640 1 -- start start 2024-09-17T05:52:08.964 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:08.962+0000 7f2e5cbc6640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2e40004800 0x7f2e58153990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:52:08.965 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:08.962+0000 7f2e5cbc6640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2e581f6db0 0x7f2e581f71c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:52:08.965 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:08.962+0000 7f2e5cbc6640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2e5815d8a0 0x7f2e5815dcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:52:08.965 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:08.962+0000 7f2e5cbc6640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f2e5809baf0 con 0x7f2e5815d8a0 2024-09-17T05:52:08.965 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:08.962+0000 7f2e5cbc6640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f2e580b5960 con 0x7f2e581f6db0 2024-09-17T05:52:08.965 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:08.962+0000 7f2e5cbc6640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f2e5809bc70 con 0x7f2e40004800 2024-09-17T05:52:08.965 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:08.962+0000 7f2e56d9d640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2e5815d8a0 0x7f2e5815dcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:52:08.965 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:08.962+0000 7f2e56d9d640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2e5815d8a0 0x7f2e5815dcb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:56004/0 (socket says 172.21.15.150:56004) 2024-09-17T05:52:08.965 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:08.962+0000 7f2e56d9d640 1 -- 172.21.15.150:0/2324218189 learned_addr learned my addr 172.21.15.150:0/2324218189 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:52:08.965 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:08.963+0000 7f2e5659c640 1 --2- 172.21.15.150:0/2324218189 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2e40004800 0x7f2e58153990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:52:08.966 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:08.963+0000 7f2e55d9b640 1 --2- 172.21.15.150:0/2324218189 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2e581f6db0 0x7f2e581f71c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:52:08.966 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:08.963+0000 7f2e56d9d640 1 -- 172.21.15.150:0/2324218189 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2e40004800 msgr2=0x7f2e58153990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:52:08.966 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:08.963+0000 7f2e56d9d640 1 --2- 172.21.15.150:0/2324218189 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2e40004800 0x7f2e58153990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:52:08.966 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:08.963+0000 7f2e56d9d640 1 -- 172.21.15.150:0/2324218189 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2e581f6db0 msgr2=0x7f2e581f71c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:52:08.966 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:08.963+0000 7f2e56d9d640 1 --2- 172.21.15.150:0/2324218189 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2e581f6db0 0x7f2e581f71c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:52:08.966 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:08.963+0000 7f2e56d9d640 1 -- 172.21.15.150:0/2324218189 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2e581f7700 con 0x7f2e5815d8a0 2024-09-17T05:52:08.966 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:08.963+0000 7f2e56d9d640 1 --2- 172.21.15.150:0/2324218189 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2e5815d8a0 0x7f2e5815dcb0 secure :-1 s=READY pgs=1619 cs=0 l=1 rev1=1 crypto rx=0x7f2e58074fa0 tx=0x7f2e5000f3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:52:08.966 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:08.963+0000 7f2e46ffd640 1 -- 172.21.15.150:0/2324218189 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e50004b20 con 0x7f2e5815d8a0 2024-09-17T05:52:08.966 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:08.963+0000 7f2e46ffd640 1 -- 172.21.15.150:0/2324218189 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f2e50004cc0 con 0x7f2e5815d8a0 2024-09-17T05:52:08.966 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:08.963+0000 7f2e46ffd640 1 -- 172.21.15.150:0/2324218189 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e50003bd0 con 0x7f2e5815d8a0 2024-09-17T05:52:08.966 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:08.963+0000 7f2e5cbc6640 1 -- 172.21.15.150:0/2324218189 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2e5809f7a0 con 0x7f2e5815d8a0 2024-09-17T05:52:08.966 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:08.963+0000 7f2e5cbc6640 1 -- 172.21.15.150:0/2324218189 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2e5809fa60 con 0x7f2e5815d8a0 2024-09-17T05:52:08.966 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:08.964+0000 7f2e5cbc6640 1 -- 172.21.15.150:0/2324218189 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2e580d0ee0 con 0x7f2e5815d8a0 2024-09-17T05:52:08.967 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:08.965+0000 7f2e46ffd640 1 -- 172.21.15.150:0/2324218189 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 42) ==== 104195+0+0 (secure 0 0 0) 0x7f2e50004030 con 0x7f2e5815d8a0 2024-09-17T05:52:08.967 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:08.965+0000 7f2e46ffd640 1 --2- 172.21.15.150:0/2324218189 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f2e3807aa20 0x7f2e3807cf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:52:08.967 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:08.965+0000 7f2e46ffd640 1 -- 172.21.15.150:0/2324218189 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(117..117 src has 1..117) ==== 6021+0+0 (secure 0 0 0) 0x7f2e5009a100 con 0x7f2e5815d8a0 2024-09-17T05:52:08.967 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:08.966+0000 7f2e5659c640 1 --2- 172.21.15.150:0/2324218189 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f2e3807aa20 0x7f2e3807cf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:52:08.968 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:08.966+0000 7f2e5659c640 1 --2- 172.21.15.150:0/2324218189 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f2e3807aa20 0x7f2e3807cf30 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x7f2e48001920 tx=0x7f2e48001d70 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:52:08.972 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:08.970+0000 7f2e46ffd640 1 -- 172.21.15.150:0/2324218189 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f2e581f7700 con 0x7f2e5815d8a0 2024-09-17T05:52:09.149 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:09.148+0000 7f2e5cbc6640 1 -- 172.21.15.150:0/2324218189 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7f2e58074770 con 0x7f2e5815d8a0 2024-09-17T05:52:09.833 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:09.832+0000 7f2e46ffd640 1 -- 172.21.15.150:0/2324218189 <== mon.0 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v118) ==== 181+0+0 (secure 0 0 0) 0x7f2e500639f0 con 0x7f2e5815d8a0 2024-09-17T05:52:09.833 INFO:teuthology.orchestra.run.smithi150.stderr:pool 'cephfs_metadata' removed 2024-09-17T05:52:09.837 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:09.836+0000 7f2e5cbc6640 1 -- 172.21.15.150:0/2324218189 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f2e3807aa20 msgr2=0x7f2e3807cf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:52:09.837 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:09.836+0000 7f2e5cbc6640 1 --2- 172.21.15.150:0/2324218189 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f2e3807aa20 0x7f2e3807cf30 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x7f2e48001920 tx=0x7f2e48001d70 comp rx=0 tx=0).stop 2024-09-17T05:52:09.837 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:09.836+0000 7f2e5cbc6640 1 -- 172.21.15.150:0/2324218189 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2e5815d8a0 msgr2=0x7f2e5815dcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:52:09.837 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:09.836+0000 7f2e5cbc6640 1 --2- 172.21.15.150:0/2324218189 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2e5815d8a0 0x7f2e5815dcb0 secure :-1 s=READY pgs=1619 cs=0 l=1 rev1=1 crypto rx=0x7f2e58074fa0 tx=0x7f2e5000f3c0 comp rx=0 tx=0).stop 2024-09-17T05:52:09.837 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:09.836+0000 7f2e5cbc6640 1 -- 172.21.15.150:0/2324218189 shutdown_connections 2024-09-17T05:52:09.837 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:09.836+0000 7f2e5cbc6640 1 --2- 172.21.15.150:0/2324218189 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2e581f6db0 0x7f2e581f71c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:52:09.838 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:09.836+0000 7f2e5cbc6640 1 --2- 172.21.15.150:0/2324218189 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f2e3807aa20 0x7f2e3807cf30 unknown :-1 s=CLOSED pgs=688 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:52:09.838 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:09.836+0000 7f2e5cbc6640 1 --2- 172.21.15.150:0/2324218189 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2e5815d8a0 0x7f2e5815dcb0 unknown :-1 s=CLOSED pgs=1619 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:52:09.838 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:09.836+0000 7f2e5cbc6640 1 --2- 172.21.15.150:0/2324218189 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2e40004800 0x7f2e58153990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:52:09.838 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:09.836+0000 7f2e5cbc6640 1 -- 172.21.15.150:0/2324218189 >> 172.21.15.150:0/2324218189 conn(0x7f2e580cee80 msgr2=0x7f2e580727a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:52:09.839 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:09.838+0000 7f2e5cbc6640 1 -- 172.21.15.150:0/2324218189 shutdown_connections 2024-09-17T05:52:09.839 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:09.838+0000 7f2e5cbc6640 1 -- 172.21.15.150:0/2324218189 wait complete. 2024-09-17T05:52:09.854 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-09-17T05:52:09.975 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:09.974+0000 7f18d32f4640 1 -- 172.21.15.150:0/2691129956 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f18cc15ba50 msgr2=0x7f18cc0b3120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:52:09.975 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:09.974+0000 7f18d32f4640 1 --2- 172.21.15.150:0/2691129956 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f18cc15ba50 0x7f18cc0b3120 secure :-1 s=READY pgs=1621 cs=0 l=1 rev1=1 crypto rx=0x7f18cc06dee0 tx=0x7f18c002a410 comp rx=0 tx=0).stop 2024-09-17T05:52:09.975 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:09.974+0000 7f18d32f4640 1 -- 172.21.15.150:0/2691129956 shutdown_connections 2024-09-17T05:52:09.975 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:09.974+0000 7f18d32f4640 1 --2- 172.21.15.150:0/2691129956 >> v2:172.21.15.176:3300/0 conn(0x7f18cc0b36f0 0x7f18cc0cb930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:52:09.975 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:09.974+0000 7f18d32f4640 1 --2- 172.21.15.150:0/2691129956 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f18cc15ba50 0x7f18cc0b3120 unknown :-1 s=CLOSED pgs=1621 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:52:09.976 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:09.974+0000 7f18d32f4640 1 -- 172.21.15.150:0/2691129956 >> 172.21.15.150:0/2691129956 conn(0x7f18cc0b2540 msgr2=0x7f18cc0d02d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:52:09.976 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:09.974+0000 7f18d32f4640 1 -- 172.21.15.150:0/2691129956 shutdown_connections 2024-09-17T05:52:09.976 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:09.974+0000 7f18d32f4640 1 -- 172.21.15.150:0/2691129956 wait complete. 2024-09-17T05:52:09.976 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:09.976+0000 7f18d32f4640 1 Processor -- start 2024-09-17T05:52:09.976 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:09.976+0000 7f18d32f4640 1 -- start start 2024-09-17T05:52:09.979 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:09.977+0000 7f18d32f4640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f18cc0b36f0 0x7f18cc1f3980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:52:09.979 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:09.977+0000 7f18d32f4640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f18cc0cc7d0 0x7f18cc1f7630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:52:09.979 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:09.977+0000 7f18d32f4640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f18cc15ba50 0x7f18cc155a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:52:09.979 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:09.977+0000 7f18d32f4640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f18cc06f8a0 con 0x7f18cc0cc7d0 2024-09-17T05:52:09.979 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:09.977+0000 7f18d32f4640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f18cc06f720 con 0x7f18cc0b36f0 2024-09-17T05:52:09.980 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:09.977+0000 7f18d32f4640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f18cc06fa20 con 0x7f18cc15ba50 2024-09-17T05:52:09.980 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:09.977+0000 7f18d088f640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f18cc0cc7d0 0x7f18cc1f7630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:52:09.980 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:09.977+0000 7f18d088f640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f18cc0cc7d0 0x7f18cc1f7630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:56022/0 (socket says 172.21.15.150:56022) 2024-09-17T05:52:09.980 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:09.977+0000 7f18d088f640 1 -- 172.21.15.150:0/440813169 learned_addr learned my addr 172.21.15.150:0/440813169 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:52:09.980 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:09.977+0000 7f18d1090640 1 --2- 172.21.15.150:0/440813169 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f18cc0b36f0 0x7f18cc1f3980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:52:09.980 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:09.977+0000 7f18d1891640 1 --2- 172.21.15.150:0/440813169 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f18cc15ba50 0x7f18cc155a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:52:09.980 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:09.978+0000 7f18d088f640 1 -- 172.21.15.150:0/440813169 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f18cc15ba50 msgr2=0x7f18cc155a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:52:09.980 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:09.978+0000 7f18d088f640 1 --2- 172.21.15.150:0/440813169 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f18cc15ba50 0x7f18cc155a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:52:09.980 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:09.978+0000 7f18d088f640 1 -- 172.21.15.150:0/440813169 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f18cc0b36f0 msgr2=0x7f18cc1f3980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:52:09.980 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:09.978+0000 7f18d088f640 1 --2- 172.21.15.150:0/440813169 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f18cc0b36f0 0x7f18cc1f3980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:52:09.980 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:09.978+0000 7f18d088f640 1 -- 172.21.15.150:0/440813169 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f18cc0b1450 con 0x7f18cc0cc7d0 2024-09-17T05:52:09.981 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:09.978+0000 7f18d088f640 1 --2- 172.21.15.150:0/440813169 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f18cc0cc7d0 0x7f18cc1f7630 secure :-1 s=READY pgs=1622 cs=0 l=1 rev1=1 crypto rx=0x7f18c002aa00 tx=0x7f18c0033c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:52:09.981 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:09.978+0000 7f18c9ffb640 1 -- 172.21.15.150:0/440813169 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18c0031d60 con 0x7f18cc0cc7d0 2024-09-17T05:52:09.981 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:09.978+0000 7f18c9ffb640 1 -- 172.21.15.150:0/440813169 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f18c0033e10 con 0x7f18cc0cc7d0 2024-09-17T05:52:09.981 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:09.978+0000 7f18d32f4640 1 -- 172.21.15.150:0/440813169 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f18cc0b4f70 con 0x7f18cc0cc7d0 2024-09-17T05:52:09.981 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:09.978+0000 7f18c9ffb640 1 -- 172.21.15.150:0/440813169 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18c0005260 con 0x7f18cc0cc7d0 2024-09-17T05:52:09.981 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:09.978+0000 7f18d32f4640 1 -- 172.21.15.150:0/440813169 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f18cc09e120 con 0x7f18cc0cc7d0 2024-09-17T05:52:09.982 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:09.979+0000 7f18d32f4640 1 -- 172.21.15.150:0/440813169 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f18cc06ff10 con 0x7f18cc0cc7d0 2024-09-17T05:52:09.982 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:09.980+0000 7f18c9ffb640 1 -- 172.21.15.150:0/440813169 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 42) ==== 104195+0+0 (secure 0 0 0) 0x7f18c0005400 con 0x7f18cc0cc7d0 2024-09-17T05:52:09.982 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:09.981+0000 7f18c9ffb640 1 --2- 172.21.15.150:0/440813169 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f18b807a9f0 0x7f18b807cf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:52:09.982 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:09.981+0000 7f18c9ffb640 1 -- 172.21.15.150:0/440813169 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(118..118 src has 1..118) ==== 5583+0+0 (secure 0 0 0) 0x7f18c00bb540 con 0x7f18cc0cc7d0 2024-09-17T05:52:09.982 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:09.981+0000 7f18d1090640 1 --2- 172.21.15.150:0/440813169 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f18b807a9f0 0x7f18b807cf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:52:09.982 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:09.982+0000 7f18d1090640 1 --2- 172.21.15.150:0/440813169 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f18b807a9f0 0x7f18b807cf00 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7f18bc0046b0 tx=0x7f18bc007eb0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:52:09.985 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:09.984+0000 7f18c9ffb640 1 -- 172.21.15.150:0/440813169 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f18c003f030 con 0x7f18cc0cc7d0 2024-09-17T05:52:10.168 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:10.167+0000 7f18d32f4640 1 -- 172.21.15.150:0/440813169 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7f18cc09def0 con 0x7f18cc0cc7d0 2024-09-17T05:52:10.835 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:10.834+0000 7f18c9ffb640 1 -- 172.21.15.150:0/440813169 <== mon.0 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v119) ==== 169+0+0 (secure 0 0 0) 0x7f18c0031770 con 0x7f18cc0cc7d0 2024-09-17T05:52:10.835 INFO:teuthology.orchestra.run.smithi150.stderr:pool 'cephfs_data' removed 2024-09-17T05:52:10.839 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:10.838+0000 7f18d32f4640 1 -- 172.21.15.150:0/440813169 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f18b807a9f0 msgr2=0x7f18b807cf00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:52:10.839 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:10.838+0000 7f18d32f4640 1 --2- 172.21.15.150:0/440813169 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f18b807a9f0 0x7f18b807cf00 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7f18bc0046b0 tx=0x7f18bc007eb0 comp rx=0 tx=0).stop 2024-09-17T05:52:10.839 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:10.838+0000 7f18d32f4640 1 -- 172.21.15.150:0/440813169 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f18cc0cc7d0 msgr2=0x7f18cc1f7630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:52:10.839 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:10.838+0000 7f18d32f4640 1 --2- 172.21.15.150:0/440813169 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f18cc0cc7d0 0x7f18cc1f7630 secure :-1 s=READY pgs=1622 cs=0 l=1 rev1=1 crypto rx=0x7f18c002aa00 tx=0x7f18c0033c20 comp rx=0 tx=0).stop 2024-09-17T05:52:10.839 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:10.838+0000 7f18d32f4640 1 -- 172.21.15.150:0/440813169 shutdown_connections 2024-09-17T05:52:10.840 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:10.838+0000 7f18d32f4640 1 --2- 172.21.15.150:0/440813169 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f18b807a9f0 0x7f18b807cf00 unknown :-1 s=CLOSED pgs=689 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:52:10.840 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:10.838+0000 7f18d32f4640 1 --2- 172.21.15.150:0/440813169 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f18cc15ba50 0x7f18cc155a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:52:10.840 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:10.838+0000 7f18d32f4640 1 --2- 172.21.15.150:0/440813169 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f18cc0cc7d0 0x7f18cc1f7630 unknown :-1 s=CLOSED pgs=1622 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:52:10.840 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:10.838+0000 7f18d32f4640 1 --2- 172.21.15.150:0/440813169 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f18cc0b36f0 0x7f18cc1f3980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:52:10.840 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:10.838+0000 7f18d32f4640 1 -- 172.21.15.150:0/440813169 >> 172.21.15.150:0/440813169 conn(0x7f18cc0b2540 msgr2=0x7f18cc0745b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:52:10.840 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:10.838+0000 7f18d32f4640 1 -- 172.21.15.150:0/440813169 shutdown_connections 2024-09-17T05:52:10.840 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:10.838+0000 7f18d32f4640 1 -- 172.21.15.150:0/440813169 wait complete. 2024-09-17T05:52:10.856 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config reset 31 2024-09-17T05:52:10.984 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:10.983+0000 7faead815640 1 -- 172.21.15.150:0/3607849933 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7faea80b6a30 msgr2=0x7faea80d3260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:52:10.984 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:10.983+0000 7faead815640 1 --2- 172.21.15.150:0/3607849933 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7faea80b6a30 0x7faea80d3260 secure :-1 s=READY pgs=1623 cs=0 l=1 rev1=1 crypto rx=0x7faea808cac0 tx=0x7faea002a980 comp rx=0 tx=0).stop 2024-09-17T05:52:10.984 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:10.983+0000 7faead815640 1 -- 172.21.15.150:0/3607849933 shutdown_connections 2024-09-17T05:52:10.984 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:10.983+0000 7faead815640 1 --2- 172.21.15.150:0/3607849933 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7faea80b6a30 0x7faea80d3260 unknown :-1 s=CLOSED pgs=1623 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:52:10.984 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:10.983+0000 7faead815640 1 --2- 172.21.15.150:0/3607849933 >> v2:172.21.15.176:3300/0 conn(0x7faea80b74b0 0x7faea80b78c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:52:10.984 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:10.983+0000 7faead815640 1 -- 172.21.15.150:0/3607849933 >> 172.21.15.150:0/3607849933 conn(0x7faea808bfe0 msgr2=0x7faea80d4660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:52:10.984 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:10.983+0000 7faead815640 1 -- 172.21.15.150:0/3607849933 shutdown_connections 2024-09-17T05:52:10.984 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:10.983+0000 7faead815640 1 -- 172.21.15.150:0/3607849933 wait complete. 2024-09-17T05:52:10.985 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:10.984+0000 7faead815640 1 Processor -- start 2024-09-17T05:52:10.985 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:10.985+0000 7faead815640 1 -- start start 2024-09-17T05:52:10.988 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:10.986+0000 7faead815640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7faea80b6a30 0x7faea81490b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:52:10.989 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:10.986+0000 7faead815640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7faea80b74b0 0x7faea81f9150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:52:10.989 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:10.986+0000 7faead815640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7faea80d2e50 0x7faea81f9690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:52:10.989 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:10.986+0000 7faead815640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7faea80d0880 con 0x7faea80b6a30 2024-09-17T05:52:10.989 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:10.986+0000 7faead815640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7faea80d0700 con 0x7faea80d2e50 2024-09-17T05:52:10.989 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:10.986+0000 7faead815640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7faea80d0a00 con 0x7faea80b74b0 2024-09-17T05:52:10.989 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:10.986+0000 7faea6ffd640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7faea80b6a30 0x7faea81490b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:52:10.989 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:10.986+0000 7faea6ffd640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7faea80b6a30 0x7faea81490b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:42670/0 (socket says 172.21.15.150:42670) 2024-09-17T05:52:10.989 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:10.986+0000 7faea6ffd640 1 -- 172.21.15.150:0/3745502463 learned_addr learned my addr 172.21.15.150:0/3745502463 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:52:10.989 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:10.986+0000 7faea77fe640 1 --2- 172.21.15.150:0/3745502463 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7faea80d2e50 0x7faea81f9690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:52:10.989 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:10.986+0000 7fae9e7fc640 1 --2- 172.21.15.150:0/3745502463 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7faea80b74b0 0x7faea81f9150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:52:10.989 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:10.986+0000 7faea6ffd640 1 -- 172.21.15.150:0/3745502463 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7faea80b74b0 msgr2=0x7faea81f9150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:52:10.990 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:10.986+0000 7faea6ffd640 1 --2- 172.21.15.150:0/3745502463 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7faea80b74b0 0x7faea81f9150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:52:10.990 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:10.986+0000 7faea6ffd640 1 -- 172.21.15.150:0/3745502463 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7faea80d2e50 msgr2=0x7faea81f9690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:52:10.990 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:10.986+0000 7faea6ffd640 1 --2- 172.21.15.150:0/3745502463 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7faea80d2e50 0x7faea81f9690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:52:10.990 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:10.986+0000 7faea6ffd640 1 -- 172.21.15.150:0/3745502463 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faea8149b30 con 0x7faea80b6a30 2024-09-17T05:52:10.990 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:10.986+0000 7fae9e7fc640 1 --2- 172.21.15.150:0/3745502463 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7faea80b74b0 0x7faea81f9150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T05:52:10.990 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:10.987+0000 7faea6ffd640 1 --2- 172.21.15.150:0/3745502463 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7faea80b6a30 0x7faea81490b0 secure :-1 s=READY pgs=1624 cs=0 l=1 rev1=1 crypto rx=0x7fae9800c9a0 tx=0x7fae9800ce60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:52:10.990 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:10.987+0000 7faea4ff9640 1 -- 172.21.15.150:0/3745502463 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae98007b50 con 0x7faea80b6a30 2024-09-17T05:52:10.990 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:10.987+0000 7faea4ff9640 1 -- 172.21.15.150:0/3745502463 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fae98007de0 con 0x7faea80b6a30 2024-09-17T05:52:10.990 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:10.987+0000 7faead815640 1 -- 172.21.15.150:0/3745502463 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faea8149e10 con 0x7faea80b6a30 2024-09-17T05:52:10.990 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:10.987+0000 7faea4ff9640 1 -- 172.21.15.150:0/3745502463 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae98005290 con 0x7faea80b6a30 2024-09-17T05:52:10.990 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:10.987+0000 7faead815640 1 -- 172.21.15.150:0/3745502463 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faea814a3d0 con 0x7faea80b6a30 2024-09-17T05:52:10.990 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:10.988+0000 7faead815640 1 -- 172.21.15.150:0/3745502463 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faea808caf0 con 0x7faea80b6a30 2024-09-17T05:52:10.991 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:10.989+0000 7faea4ff9640 1 -- 172.21.15.150:0/3745502463 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 42) ==== 104195+0+0 (secure 0 0 0) 0x7fae98005430 con 0x7faea80b6a30 2024-09-17T05:52:10.991 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:10.989+0000 7faea4ff9640 1 --2- 172.21.15.150:0/3745502463 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fae8807a9f0 0x7fae8807cf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:52:10.992 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:10.989+0000 7faea4ff9640 1 -- 172.21.15.150:0/3745502463 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(119..119 src has 1..119) ==== 5111+0+0 (secure 0 0 0) 0x7fae9809a160 con 0x7faea80b6a30 2024-09-17T05:52:10.992 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:10.989+0000 7fae9e7fc640 1 --2- 172.21.15.150:0/3745502463 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fae8807a9f0 0x7fae8807cf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:52:10.992 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:10.990+0000 7fae9e7fc640 1 --2- 172.21.15.150:0/3745502463 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fae8807a9f0 0x7fae8807cf00 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7faea8163aa0 tx=0x7fae90008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:52:10.994 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:10.994+0000 7faea4ff9640 1 -- 172.21.15.150:0/3745502463 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7faea808caf0 con 0x7faea80b6a30 2024-09-17T05:52:11.171 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:11.170+0000 7faead815640 1 -- 172.21.15.150:0/3745502463 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "config reset", "num": 31} v 0) -- 0x7faea80d3260 con 0x7faea80b6a30 2024-09-17T05:52:11.174 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:11.174+0000 7faea4ff9640 1 -- 172.21.15.150:0/3745502463 <== mon.0 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "config reset", "num": 31}]=0 v54) ==== 71+0+0 (secure 0 0 0) 0x7fae98014070 con 0x7faea80b6a30 2024-09-17T05:52:11.177 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:11.176+0000 7faead815640 1 -- 172.21.15.150:0/3745502463 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fae8807a9f0 msgr2=0x7fae8807cf00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:52:11.177 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:11.176+0000 7faead815640 1 --2- 172.21.15.150:0/3745502463 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fae8807a9f0 0x7fae8807cf00 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7faea8163aa0 tx=0x7fae90008040 comp rx=0 tx=0).stop 2024-09-17T05:52:11.177 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:11.176+0000 7faead815640 1 -- 172.21.15.150:0/3745502463 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7faea80b6a30 msgr2=0x7faea81490b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:52:11.178 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:11.176+0000 7faead815640 1 --2- 172.21.15.150:0/3745502463 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7faea80b6a30 0x7faea81490b0 secure :-1 s=READY pgs=1624 cs=0 l=1 rev1=1 crypto rx=0x7fae9800c9a0 tx=0x7fae9800ce60 comp rx=0 tx=0).stop 2024-09-17T05:52:11.178 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:11.176+0000 7faead815640 1 -- 172.21.15.150:0/3745502463 shutdown_connections 2024-09-17T05:52:11.178 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:11.176+0000 7faead815640 1 --2- 172.21.15.150:0/3745502463 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7faea80d2e50 0x7faea81f9690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:52:11.178 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:11.176+0000 7faead815640 1 --2- 172.21.15.150:0/3745502463 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fae8807a9f0 0x7fae8807cf00 unknown :-1 s=CLOSED pgs=690 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:52:11.178 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:11.176+0000 7faead815640 1 --2- 172.21.15.150:0/3745502463 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7faea80b74b0 0x7faea81f9150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:52:11.178 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:11.176+0000 7faead815640 1 --2- 172.21.15.150:0/3745502463 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7faea80b6a30 0x7faea81490b0 unknown :-1 s=CLOSED pgs=1624 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:52:11.178 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:11.176+0000 7faead815640 1 -- 172.21.15.150:0/3745502463 >> 172.21.15.150:0/3745502463 conn(0x7faea808bfe0 msgr2=0x7faea80b8ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:52:11.178 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:11.176+0000 7faead815640 1 -- 172.21.15.150:0/3745502463 shutdown_connections 2024-09-17T05:52:11.178 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:11.176+0000 7faead815640 1 -- 172.21.15.150:0/3745502463 wait complete. 2024-09-17T05:52:11.188 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_volumes.TestCloneProgressReporter.test_when_clones_cancelled_are_equal_to_cloner_threads' 2024-09-17T05:52:11.303 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:11.302+0000 7f83b2c9d640 1 -- 172.21.15.150:0/1688946860 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f83ac0b7330 msgr2=0x7f83ac0b5260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:52:11.303 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:11.302+0000 7f83b2c9d640 1 --2- 172.21.15.150:0/1688946860 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f83ac0b7330 0x7f83ac0b5260 secure :-1 s=READY pgs=1626 cs=0 l=1 rev1=1 crypto rx=0x7f83ac0a0410 tx=0x7f83a002a8d0 comp rx=0 tx=0).stop 2024-09-17T05:52:11.303 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:11.302+0000 7f83b2c9d640 1 -- 172.21.15.150:0/1688946860 shutdown_connections 2024-09-17T05:52:11.303 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:11.302+0000 7f83b2c9d640 1 --2- 172.21.15.150:0/1688946860 >> v2:172.21.15.176:3300/0 conn(0x7f83ac0b57a0 0x7f83ac0b5bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:52:11.304 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:11.302+0000 7f83b2c9d640 1 --2- 172.21.15.150:0/1688946860 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f83ac0b7330 0x7f83ac0b5260 unknown :-1 s=CLOSED pgs=1626 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:52:11.304 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:11.302+0000 7f83b2c9d640 1 -- 172.21.15.150:0/1688946860 >> 172.21.15.150:0/1688946860 conn(0x7f83ac0cee90 msgr2=0x7f83ac0cf2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:52:11.304 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:11.302+0000 7f83b2c9d640 1 -- 172.21.15.150:0/1688946860 shutdown_connections 2024-09-17T05:52:11.304 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:11.302+0000 7f83b2c9d640 1 -- 172.21.15.150:0/1688946860 wait complete. 2024-09-17T05:52:11.304 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:11.304+0000 7f83b2c9d640 1 Processor -- start 2024-09-17T05:52:11.304 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:11.304+0000 7f83b2c9d640 1 -- start start 2024-09-17T05:52:11.307 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:11.305+0000 7f83b2c9d640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f83ac09ba60 0x7f83ac0cabe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:52:11.307 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:11.305+0000 7f83b2c9d640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f83ac0b57a0 0x7f83ac1f5880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:52:11.307 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:11.305+0000 7f83b2c9d640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f83ac0b7330 0x7f83ac15ec10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:52:11.307 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:11.305+0000 7f83b2c9d640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f83ac0d1550 con 0x7f83ac0b7330 2024-09-17T05:52:11.307 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:11.305+0000 7f83b2c9d640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f83ac0d13d0 con 0x7f83ac0b57a0 2024-09-17T05:52:11.308 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:11.305+0000 7f83b2c9d640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f83ac1670e0 con 0x7f83ac09ba60 2024-09-17T05:52:11.308 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:11.305+0000 7f83b123a640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f83ac0b7330 0x7f83ac15ec10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:52:11.308 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:11.305+0000 7f83b123a640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f83ac0b7330 0x7f83ac15ec10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:42688/0 (socket says 172.21.15.150:42688) 2024-09-17T05:52:11.308 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:11.305+0000 7f83b123a640 1 -- 172.21.15.150:0/2747525818 learned_addr learned my addr 172.21.15.150:0/2747525818 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:52:11.308 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:11.306+0000 7f83abfff640 1 --2- 172.21.15.150:0/2747525818 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f83ac0b57a0 0x7f83ac1f5880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:52:11.308 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:11.306+0000 7f83b0a39640 1 --2- 172.21.15.150:0/2747525818 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f83ac09ba60 0x7f83ac0cabe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:52:11.308 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:11.306+0000 7f83b123a640 1 -- 172.21.15.150:0/2747525818 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f83ac09ba60 msgr2=0x7f83ac0cabe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:52:11.308 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:11.306+0000 7f83b123a640 1 --2- 172.21.15.150:0/2747525818 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f83ac09ba60 0x7f83ac0cabe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:52:11.308 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:11.306+0000 7f83b123a640 1 -- 172.21.15.150:0/2747525818 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f83ac0b57a0 msgr2=0x7f83ac1f5880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:52:11.308 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:11.306+0000 7f83b123a640 1 --2- 172.21.15.150:0/2747525818 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f83ac0b57a0 0x7f83ac1f5880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:52:11.308 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:11.306+0000 7f83b123a640 1 -- 172.21.15.150:0/2747525818 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f83ac0cb580 con 0x7f83ac0b7330 2024-09-17T05:52:11.308 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:11.306+0000 7f83b123a640 1 --2- 172.21.15.150:0/2747525818 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f83ac0b7330 0x7f83ac15ec10 secure :-1 s=READY pgs=1627 cs=0 l=1 rev1=1 crypto rx=0x7f83a400b440 tx=0x7f83a400b900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:52:11.309 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:11.306+0000 7f83a97fa640 1 -- 172.21.15.150:0/2747525818 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83a4015020 con 0x7f83ac0b7330 2024-09-17T05:52:11.309 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:11.306+0000 7f83a97fa640 1 -- 172.21.15.150:0/2747525818 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f83a4011940 con 0x7f83ac0b7330 2024-09-17T05:52:11.309 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:11.306+0000 7f83b2c9d640 1 -- 172.21.15.150:0/2747525818 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f83ac0cb860 con 0x7f83ac0b7330 2024-09-17T05:52:11.309 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:11.306+0000 7f83a97fa640 1 -- 172.21.15.150:0/2747525818 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83a4011d90 con 0x7f83ac0b7330 2024-09-17T05:52:11.309 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:11.306+0000 7f83b2c9d640 1 -- 172.21.15.150:0/2747525818 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f83ac06e590 con 0x7f83ac0b7330 2024-09-17T05:52:11.310 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:11.307+0000 7f83b2c9d640 1 -- 172.21.15.150:0/2747525818 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f83ac0cb2d0 con 0x7f83ac0b7330 2024-09-17T05:52:11.310 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:11.308+0000 7f83a97fa640 1 -- 172.21.15.150:0/2747525818 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 42) ==== 104195+0+0 (secure 0 0 0) 0x7f83a4018020 con 0x7f83ac0b7330 2024-09-17T05:52:11.310 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:11.308+0000 7f83a97fa640 1 --2- 172.21.15.150:0/2747525818 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f839807a9f0 0x7f839807cf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:52:11.310 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:11.308+0000 7f83a97fa640 1 -- 172.21.15.150:0/2747525818 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(119..119 src has 1..119) ==== 5111+0+0 (secure 0 0 0) 0x7f83a4099bc0 con 0x7f83ac0b7330 2024-09-17T05:52:11.310 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:11.309+0000 7f83b0a39640 1 --2- 172.21.15.150:0/2747525818 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f839807a9f0 0x7f839807cf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:52:11.310 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:11.309+0000 7f83b0a39640 1 --2- 172.21.15.150:0/2747525818 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f839807a9f0 0x7f839807cf00 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7f839c0015d0 tx=0x7f839c009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:52:11.313 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:11.313+0000 7f83a97fa640 1 -- 172.21.15.150:0/2747525818 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f83a401f020 con 0x7f83ac0b7330 2024-09-17T05:52:11.558 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:11.558+0000 7f83b2c9d640 1 -- 172.21.15.150:0/2747525818 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_volumes.TestCloneProgressReporter.test_when_clones_cancelled_are_equal_to_cloner_threads"]} v 0) -- 0x7f83ac1f5dc0 con 0x7f83ac0b7330 2024-09-17T05:52:11.840 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:11.840+0000 7f83a97fa640 1 -- 172.21.15.150:0/2747525818 <== mon.0 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_volumes.TestCloneProgressReporter.test_when_clones_cancelled_are_equal_to_cloner_threads"]}]=0 v515) ==== 185+0+0 (secure 0 0 0) 0x7f83a4063b90 con 0x7f83ac0b7330 2024-09-17T05:52:11.843 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:11.842+0000 7f83b2c9d640 1 -- 172.21.15.150:0/2747525818 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f839807a9f0 msgr2=0x7f839807cf00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:52:11.843 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:11.842+0000 7f83b2c9d640 1 --2- 172.21.15.150:0/2747525818 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f839807a9f0 0x7f839807cf00 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7f839c0015d0 tx=0x7f839c009040 comp rx=0 tx=0).stop 2024-09-17T05:52:11.843 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:11.842+0000 7f83b2c9d640 1 -- 172.21.15.150:0/2747525818 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f83ac0b7330 msgr2=0x7f83ac15ec10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:52:11.843 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:11.842+0000 7f83b2c9d640 1 --2- 172.21.15.150:0/2747525818 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f83ac0b7330 0x7f83ac15ec10 secure :-1 s=READY pgs=1627 cs=0 l=1 rev1=1 crypto rx=0x7f83a400b440 tx=0x7f83a400b900 comp rx=0 tx=0).stop 2024-09-17T05:52:11.843 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:11.842+0000 7f83b2c9d640 1 -- 172.21.15.150:0/2747525818 shutdown_connections 2024-09-17T05:52:11.843 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:11.842+0000 7f83b2c9d640 1 --2- 172.21.15.150:0/2747525818 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f83ac0b57a0 0x7f83ac1f5880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:52:11.843 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:11.842+0000 7f83b2c9d640 1 --2- 172.21.15.150:0/2747525818 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f839807a9f0 0x7f839807cf00 unknown :-1 s=CLOSED pgs=691 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:52:11.844 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:11.842+0000 7f83b2c9d640 1 --2- 172.21.15.150:0/2747525818 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f83ac0b7330 0x7f83ac15ec10 unknown :-1 s=CLOSED pgs=1627 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:52:11.844 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:11.842+0000 7f83b2c9d640 1 --2- 172.21.15.150:0/2747525818 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f83ac09ba60 0x7f83ac0cabe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:52:11.844 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:11.842+0000 7f83b2c9d640 1 -- 172.21.15.150:0/2747525818 >> 172.21.15.150:0/2747525818 conn(0x7f83ac0cee90 msgr2=0x7f83ac0cffe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:52:11.844 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:11.842+0000 7f83b2c9d640 1 -- 172.21.15.150:0/2747525818 shutdown_connections 2024-09-17T05:52:11.844 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:11.842+0000 7f83b2c9d640 1 -- 172.21.15.150:0/2747525818 wait complete. 2024-09-17T05:52:11.855 INFO:tasks.cephfs_test_runner:Test that progress bars, that printed for 3 ongoing clone jobs, are ... ok 2024-09-17T05:52:11.856 INFO:tasks.cephfs_test_runner:Starting test: test_when_clones_cancelled_are_less_than_cloner_threads (tasks.cephfs.test_volumes.TestCloneProgressReporter) Test that the progress bar that is printed for 1 ongoing clone job is 2024-09-17T05:52:11.856 INFO:tasks.cephfs_test_runner:test_when_clones_cancelled_are_less_than_cloner_threads (tasks.cephfs.test_volumes.TestCloneProgressReporter) 2024-09-17T05:52:11.856 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T05:52:11.969 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:11.968+0000 7fae18f90640 1 -- 172.21.15.150:0/4195659476 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fae140d0550 msgr2=0x7fae140b18c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:52:11.970 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:11.968+0000 7fae18f90640 1 --2- 172.21.15.150:0/4195659476 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fae140d0550 0x7fae140b18c0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fadfc009830 tx=0x7fadfc02a5a0 comp rx=0 tx=0).stop 2024-09-17T05:52:11.970 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:11.968+0000 7fae18f90640 1 -- 172.21.15.150:0/4195659476 shutdown_connections 2024-09-17T05:52:11.970 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:11.968+0000 7fae18f90640 1 --2- 172.21.15.150:0/4195659476 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fae140d0550 0x7fae140b18c0 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:52:11.970 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:11.968+0000 7fae18f90640 1 --2- 172.21.15.150:0/4195659476 >> v2:172.21.15.176:3300/0 conn(0x7fae140d0c50 0x7fae140d0010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:52:11.970 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:11.968+0000 7fae18f90640 1 -- 172.21.15.150:0/4195659476 >> 172.21.15.150:0/4195659476 conn(0x7fae140b3fc0 msgr2=0x7fae140b43d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:52:11.970 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:11.969+0000 7fae18f90640 1 -- 172.21.15.150:0/4195659476 shutdown_connections 2024-09-17T05:52:11.970 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:11.969+0000 7fae18f90640 1 -- 172.21.15.150:0/4195659476 wait complete. 2024-09-17T05:52:11.971 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:11.971+0000 7fae18f90640 1 Processor -- start 2024-09-17T05:52:11.971 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:11.971+0000 7fae18f90640 1 -- start start 2024-09-17T05:52:11.974 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:11.972+0000 7fae18f90640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fae140d0550 0x7fae1415eb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:52:11.974 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:11.972+0000 7fae18f90640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fae140d0c50 0x7fae1415bc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:52:11.974 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:11.972+0000 7fae18f90640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fae140d1060 0x7fae140cb6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:52:11.974 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:11.972+0000 7fae18f90640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7fae140ced80 con 0x7fae140d0550 2024-09-17T05:52:11.974 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:11.972+0000 7fae18f90640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fae140cd130 con 0x7fae140d0c50 2024-09-17T05:52:11.974 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:11.972+0000 7fae18f90640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fae140c6e00 con 0x7fae140d1060 2024-09-17T05:52:11.974 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:11.972+0000 7fae1259c640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fae140d0550 0x7fae1415eb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:52:11.974 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:11.972+0000 7fae1259c640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fae140d0550 0x7fae1415eb10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:42690/0 (socket says 172.21.15.150:42690) 2024-09-17T05:52:11.975 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:11.972+0000 7fae1259c640 1 -- 172.21.15.150:0/4020015812 learned_addr learned my addr 172.21.15.150:0/4020015812 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:52:11.975 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:11.972+0000 7fae12d9d640 1 --2- 172.21.15.150:0/4020015812 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fae140d1060 0x7fae140cb6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:52:11.975 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:11.972+0000 7fae09d9b640 1 --2- 172.21.15.150:0/4020015812 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fae140d0c50 0x7fae1415bc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:52:11.975 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:11.972+0000 7fae1259c640 1 -- 172.21.15.150:0/4020015812 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fae140d1060 msgr2=0x7fae140cb6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:52:11.975 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:11.972+0000 7fae1259c640 1 --2- 172.21.15.150:0/4020015812 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fae140d1060 0x7fae140cb6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:52:11.975 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:11.972+0000 7fae1259c640 1 -- 172.21.15.150:0/4020015812 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fae140d0c50 msgr2=0x7fae1415bc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:52:11.975 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:11.972+0000 7fae1259c640 1 --2- 172.21.15.150:0/4020015812 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fae140d0c50 0x7fae1415bc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:52:11.975 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:11.972+0000 7fae1259c640 1 -- 172.21.15.150:0/4020015812 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fae1415f4f0 con 0x7fae140d0550 2024-09-17T05:52:11.975 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:11.973+0000 7fae09d9b640 1 --2- 172.21.15.150:0/4020015812 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fae140d0c50 0x7fae1415bc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T05:52:11.975 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:11.973+0000 7fae1259c640 1 --2- 172.21.15.150:0/4020015812 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fae140d0550 0x7fae1415eb10 secure :-1 s=READY pgs=1628 cs=0 l=1 rev1=1 crypto rx=0x7fae0400ea20 tx=0x7fae0400eee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:52:11.975 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:11.973+0000 7fae0b7fe640 1 -- 172.21.15.150:0/4020015812 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae0400ce40 con 0x7fae140d0550 2024-09-17T05:52:11.975 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:11.973+0000 7fae0b7fe640 1 -- 172.21.15.150:0/4020015812 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fae04004020 con 0x7fae140d0550 2024-09-17T05:52:11.976 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:11.973+0000 7fae18f90640 1 -- 172.21.15.150:0/4020015812 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fae141f3a30 con 0x7fae140d0550 2024-09-17T05:52:11.976 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:11.973+0000 7fae0b7fe640 1 -- 172.21.15.150:0/4020015812 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae04004470 con 0x7fae140d0550 2024-09-17T05:52:11.976 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:11.973+0000 7fae18f90640 1 -- 172.21.15.150:0/4020015812 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fae1415c140 con 0x7fae140d0550 2024-09-17T05:52:11.977 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:11.974+0000 7fae18f90640 1 -- 172.21.15.150:0/4020015812 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fae141f3820 con 0x7fae140d0550 2024-09-17T05:52:11.977 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:11.975+0000 7fae0b7fe640 1 -- 172.21.15.150:0/4020015812 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 42) ==== 104195+0+0 (secure 0 0 0) 0x7fae040035f0 con 0x7fae140d0550 2024-09-17T05:52:11.977 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:11.975+0000 7fae0b7fe640 1 --2- 172.21.15.150:0/4020015812 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fadf407aa20 0x7fadf407cf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:52:11.977 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:11.975+0000 7fae0b7fe640 1 -- 172.21.15.150:0/4020015812 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(119..119 src has 1..119) ==== 5111+0+0 (secure 0 0 0) 0x7fae0409a7d0 con 0x7fae140d0550 2024-09-17T05:52:11.977 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:11.976+0000 7fae09d9b640 1 --2- 172.21.15.150:0/4020015812 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fadf407aa20 0x7fadf407cf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:52:11.977 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:11.976+0000 7fae09d9b640 1 --2- 172.21.15.150:0/4020015812 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fadf407aa20 0x7fadf407cf30 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7fadfc034000 tx=0x7fadfc004730 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:52:11.980 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:11.980+0000 7fae0b7fe640 1 -- 172.21.15.150:0/4020015812 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fae04064720 con 0x7fae140d0550 2024-09-17T05:52:12.155 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:12.155+0000 7fae18f90640 1 -- 172.21.15.150:0/4020015812 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fae140d0010 con 0x7fae140d0550 2024-09-17T05:52:12.156 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:12.156+0000 7fae0b7fe640 1 -- 172.21.15.150:0/4020015812 <== mon.0 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v119) ==== 74+0+13347 (secure 0 0 0) 0x7fae04064020 con 0x7fae140d0550 2024-09-17T05:52:12.156 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-09-17T05:52:12.157 INFO:teuthology.orchestra.run.smithi150.stdout:{"epoch":119,"fsid":"9f2e05e9-d629-47b3-b26b-1360655b7d20","created":"2024-09-17T05:41:32.502979+0000","modified":"2024-09-17T05:52:10.832704+0000","last_up_change":"2024-09-17T05:41:46.150225+0000","last_in_change":"2024-09-17T05:41:36.120274+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":17,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T05:41:46.860779+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"4f31c018-c8a4-4d6d-b0c2-a597c47aae4a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6800","nonce":479374392},{"type":"v1","addr":"172.21.15.150:6801","nonce":479374392}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6802","nonce":479374392},{"type":"v1","addr":"172.21.15.150:6803","nonce":479374392}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6806","nonce":479374392},{"type":"v1","addr":"172.21.15.150:6807","nonce":479374392}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6804","nonce":479374392},{"type":"v1","addr":"172.21.15.150:6805","nonce":479374392}]},"public_addr":"172.21.15.150:6801/479374392","cluster_addr":"172.21.15.150:6803/479374392","heartbeat_back_addr":"172.21.15.150:6807/479374392","heartbeat_front_addr":"172.21.15.150:6805/479374392","state":["exists","up"]},{"osd":1,"uuid":"6ff4a573-500b-4e04-9de3-39265ead78b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6824","nonce":913899800},{"type":"v1","addr":"172.21.15.150:6825","nonce":913899800}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6826","nonce":913899800},{"type":"v1","addr":"172.21.15.150:6827","nonce":913899800}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6830","nonce":913899800},{"type":"v1","addr":"172.21.15.150:6831","nonce":913899800}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6828","nonce":913899800},{"type":"v1","addr":"172.21.15.150:6829","nonce":913899800}]},"public_addr":"172.21.15.150:6825/913899800","cluster_addr":"172.21.15.150:6827/913899800","heartbeat_back_addr":"172.21.15.150:6831/913899800","heartbeat_front_addr":"172.21.15.150:6829/913899800","state":["exists","up"]},{"osd":2,"uuid":"bffea6f9-2465-4182-b205-00436c41ac1c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":114,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6816","nonce":363718461},{"type":"v1","addr":"172.21.15.150:6817","nonce":363718461}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6818","nonce":363718461},{"type":"v1","addr":"172.21.15.150:6819","nonce":363718461}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6822","nonce":363718461},{"type":"v1","addr":"172.21.15.150:6823","nonce":363718461}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6820","nonce":363718461},{"type":"v1","addr":"172.21.15.150:6821","nonce":363718461}]},"public_addr":"172.21.15.150:6817/363718461","cluster_addr":"172.21.15.150:6819/363718461","heartbeat_back_addr":"172.21.15.150:6823/363718461","heartbeat_front_addr":"172.21.15.150:6821/363718461","state":["exists","up"]},{"osd":3,"uuid":"cda70430-d1e1-427e-b04e-56db4031d078","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":114,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6808","nonce":3550994626},{"type":"v1","addr":"172.21.15.150:6809","nonce":3550994626}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6810","nonce":3550994626},{"type":"v1","addr":"172.21.15.150:6811","nonce":3550994626}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6814","nonce":3550994626},{"type":"v1","addr":"172.21.15.150:6815","nonce":3550994626}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6812","nonce":3550994626},{"type":"v1","addr":"172.21.15.150:6813","nonce":3550994626}]},"public_addr":"172.21.15.150:6809/3550994626","cluster_addr":"172.21.15.150:6811/3550994626","heartbeat_back_addr":"172.21.15.150:6815/3550994626","heartbeat_front_addr":"172.21.15.150:6813/3550994626","state":["exists","up"]},{"osd":4,"uuid":"3a0277fb-5e1e-4f68-bb2d-9a8a0152f64a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6810","nonce":2718261497},{"type":"v1","addr":"172.21.15.176:6811","nonce":2718261497}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6812","nonce":2718261497},{"type":"v1","addr":"172.21.15.176:6813","nonce":2718261497}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6816","nonce":2718261497},{"type":"v1","addr":"172.21.15.176:6817","nonce":2718261497}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6814","nonce":2718261497},{"type":"v1","addr":"172.21.15.176:6815","nonce":2718261497}]},"public_addr":"172.21.15.176:6811/2718261497","cluster_addr":"172.21.15.176:6813/2718261497","heartbeat_back_addr":"172.21.15.176:6817/2718261497","heartbeat_front_addr":"172.21.15.176:6815/2718261497","state":["exists","up"]},{"osd":5,"uuid":"33aebee6-0315-40b7-a11c-6702f0be494d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6818","nonce":2049295774},{"type":"v1","addr":"172.21.15.176:6819","nonce":2049295774}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6820","nonce":2049295774},{"type":"v1","addr":"172.21.15.176:6821","nonce":2049295774}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6824","nonce":2049295774},{"type":"v1","addr":"172.21.15.176:6825","nonce":2049295774}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6822","nonce":2049295774},{"type":"v1","addr":"172.21.15.176:6823","nonce":2049295774}]},"public_addr":"172.21.15.176:6819/2049295774","cluster_addr":"172.21.15.176:6821/2049295774","heartbeat_back_addr":"172.21.15.176:6825/2049295774","heartbeat_front_addr":"172.21.15.176:6823/2049295774","state":["exists","up"]},{"osd":6,"uuid":"4d24f360-6751-4263-841b-d77793d33540","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6826","nonce":2164458476},{"type":"v1","addr":"172.21.15.176:6827","nonce":2164458476}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6828","nonce":2164458476},{"type":"v1","addr":"172.21.15.176:6829","nonce":2164458476}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6832","nonce":2164458476},{"type":"v1","addr":"172.21.15.176:6833","nonce":2164458476}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6830","nonce":2164458476},{"type":"v1","addr":"172.21.15.176:6831","nonce":2164458476}]},"public_addr":"172.21.15.176:6827/2164458476","cluster_addr":"172.21.15.176:6829/2164458476","heartbeat_back_addr":"172.21.15.176:6833/2164458476","heartbeat_front_addr":"172.21.15.176:6831/2164458476","state":["exists","up"]},{"osd":7,"uuid":"c8594fda-c74a-4ba9-8277-caf101d58ca1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6802","nonce":3239587708},{"type":"v1","addr":"172.21.15.176:6803","nonce":3239587708}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6804","nonce":3239587708},{"type":"v1","addr":"172.21.15.176:6805","nonce":3239587708}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6808","nonce":3239587708},{"type":"v1","addr":"172.21.15.176:6809","nonce":3239587708}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6806","nonce":3239587708},{"type":"v1","addr":"172.21.15.176:6807","nonce":3239587708}]},"public_addr":"172.21.15.176:6803/3239587708","cluster_addr":"172.21.15.176:6805/3239587708","heartbeat_back_addr":"172.21.15.176:6809/3239587708","heartbeat_front_addr":"172.21.15.176:6807/3239587708","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:41:41.905151+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:41:42.705679+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:41:42.459673+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:41:42.440819+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:41:42.668428+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:41:42.694972+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:41:43.078535+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:41:42.363539+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.150:6835/4047640601":"2024-09-18T05:52:07.822893+0000","172.21.15.150:6833/4047640601":"2024-09-18T05:52:07.822893+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":7,"snaps":[{"begin":2,"length":2}]},{"pool":9,"snaps":[{"begin":2,"length":2}]},{"pool":11,"snaps":[{"begin":2,"length":2}]},{"pool":13,"snaps":[{"begin":2,"length":2}]},{"pool":15,"snaps":[{"begin":2,"length":2}]},{"pool":17,"snaps":[{"begin":2,"length":2}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T05:52:12.159 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:12.158+0000 7fae18f90640 1 -- 172.21.15.150:0/4020015812 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fadf407aa20 msgr2=0x7fadf407cf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:52:12.159 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:12.158+0000 7fae18f90640 1 --2- 172.21.15.150:0/4020015812 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fadf407aa20 0x7fadf407cf30 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7fadfc034000 tx=0x7fadfc004730 comp rx=0 tx=0).stop 2024-09-17T05:52:12.159 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:12.158+0000 7fae18f90640 1 -- 172.21.15.150:0/4020015812 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fae140d0550 msgr2=0x7fae1415eb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:52:12.159 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:12.158+0000 7fae18f90640 1 --2- 172.21.15.150:0/4020015812 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fae140d0550 0x7fae1415eb10 secure :-1 s=READY pgs=1628 cs=0 l=1 rev1=1 crypto rx=0x7fae0400ea20 tx=0x7fae0400eee0 comp rx=0 tx=0).stop 2024-09-17T05:52:12.159 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:12.158+0000 7fae18f90640 1 -- 172.21.15.150:0/4020015812 shutdown_connections 2024-09-17T05:52:12.159 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:12.158+0000 7fae18f90640 1 --2- 172.21.15.150:0/4020015812 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fae140d0c50 0x7fae1415bc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:52:12.159 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:12.158+0000 7fae18f90640 1 --2- 172.21.15.150:0/4020015812 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fadf407aa20 0x7fadf407cf30 unknown :-1 s=CLOSED pgs=692 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:52:12.160 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:12.158+0000 7fae18f90640 1 --2- 172.21.15.150:0/4020015812 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fae140d1060 0x7fae140cb6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:52:12.160 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:12.158+0000 7fae18f90640 1 --2- 172.21.15.150:0/4020015812 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fae140d0550 0x7fae1415eb10 unknown :-1 s=CLOSED pgs=1628 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:52:12.160 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:12.158+0000 7fae18f90640 1 -- 172.21.15.150:0/4020015812 >> 172.21.15.150:0/4020015812 conn(0x7fae140b3fc0 msgr2=0x7fae140cd600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:52:12.160 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:12.158+0000 7fae18f90640 1 -- 172.21.15.150:0/4020015812 shutdown_connections 2024-09-17T05:52:12.160 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:12.158+0000 7fae18f90640 1 -- 172.21.15.150:0/4020015812 wait complete. 2024-09-17T05:52:12.171 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-17T05:41:46.860779+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-17T05:52:12.171 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-17T05:52:12.289 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:12.288+0000 7f9f0eacc640 1 -- 172.21.15.150:0/1863852186 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9f080d1090 msgr2=0x7f9f08167f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:52:12.289 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:12.288+0000 7f9f0eacc640 1 --2- 172.21.15.150:0/1863852186 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9f080d1090 0x7f9f08167f70 secure :-1 s=READY pgs=1630 cs=0 l=1 rev1=1 crypto rx=0x7f9f00005fd0 tx=0x7f9f0002a780 comp rx=0 tx=0).stop 2024-09-17T05:52:12.289 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:12.288+0000 7f9f0eacc640 1 -- 172.21.15.150:0/1863852186 shutdown_connections 2024-09-17T05:52:12.289 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:12.288+0000 7f9f0eacc640 1 --2- 172.21.15.150:0/1863852186 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9f080d1090 0x7f9f08167f70 unknown :-1 s=CLOSED pgs=1630 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:52:12.289 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:12.288+0000 7f9f0eacc640 1 -- 172.21.15.150:0/1863852186 >> 172.21.15.150:0/1863852186 conn(0x7f9f080cefb0 msgr2=0x7f9f080cf3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:52:12.289 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:12.288+0000 7f9f0eacc640 1 -- 172.21.15.150:0/1863852186 shutdown_connections 2024-09-17T05:52:12.289 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:12.288+0000 7f9f0eacc640 1 -- 172.21.15.150:0/1863852186 wait complete. 2024-09-17T05:52:12.290 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:12.289+0000 7f9f0eacc640 1 Processor -- start 2024-09-17T05:52:12.290 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:12.289+0000 7f9f0eacc640 1 -- start start 2024-09-17T05:52:12.293 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:12.291+0000 7f9f0eacc640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9f080af160 0x7f9f080cb7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:52:12.293 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:12.291+0000 7f9f0eacc640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9f080af570 0x7f9f0815ca30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:52:12.293 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:12.291+0000 7f9f0eacc640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9f080d1090 0x7f9f08158550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:52:12.293 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:12.291+0000 7f9f0eacc640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f9f080b12b0 con 0x7f9f080d1090 2024-09-17T05:52:12.293 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:12.291+0000 7f9f0eacc640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f9f080b1970 con 0x7f9f080af160 2024-09-17T05:52:12.294 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:12.291+0000 7f9f0eacc640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f9f080cebd0 con 0x7f9f080af570 2024-09-17T05:52:12.294 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:12.291+0000 7f9f0d069640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9f080d1090 0x7f9f08158550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:52:12.294 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:12.291+0000 7f9f0d069640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9f080d1090 0x7f9f08158550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:42704/0 (socket says 172.21.15.150:42704) 2024-09-17T05:52:12.294 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:12.291+0000 7f9f0d069640 1 -- 172.21.15.150:0/2132054125 learned_addr learned my addr 172.21.15.150:0/2132054125 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:52:12.294 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:12.291+0000 7f9f0c868640 1 --2- 172.21.15.150:0/2132054125 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9f080af160 0x7f9f080cb7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:52:12.294 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:12.291+0000 7f9efffff640 1 --2- 172.21.15.150:0/2132054125 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9f080af570 0x7f9f0815ca30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:52:12.294 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:12.291+0000 7f9f0d069640 1 -- 172.21.15.150:0/2132054125 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9f080af570 msgr2=0x7f9f0815ca30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:52:12.294 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:12.291+0000 7f9f0d069640 1 --2- 172.21.15.150:0/2132054125 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9f080af570 0x7f9f0815ca30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:52:12.294 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:12.291+0000 7f9f0d069640 1 -- 172.21.15.150:0/2132054125 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9f080af160 msgr2=0x7f9f080cb7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:52:12.294 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:12.291+0000 7f9f0d069640 1 --2- 172.21.15.150:0/2132054125 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9f080af160 0x7f9f080cb7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:52:12.294 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:12.292+0000 7f9f0d069640 1 -- 172.21.15.150:0/2132054125 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9f080ca750 con 0x7f9f080d1090 2024-09-17T05:52:12.295 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:12.292+0000 7f9f0d069640 1 --2- 172.21.15.150:0/2132054125 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9f080d1090 0x7f9f08158550 secure :-1 s=READY pgs=1631 cs=0 l=1 rev1=1 crypto rx=0x7f9f00009cd0 tx=0x7f9f00003f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:52:12.295 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:12.292+0000 7f9efd7fa640 1 -- 172.21.15.150:0/2132054125 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f00040070 con 0x7f9f080d1090 2024-09-17T05:52:12.295 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:12.292+0000 7f9efd7fa640 1 -- 172.21.15.150:0/2132054125 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9f00004540 con 0x7f9f080d1090 2024-09-17T05:52:12.295 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:12.292+0000 7f9efd7fa640 1 -- 172.21.15.150:0/2132054125 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f0003c420 con 0x7f9f080d1090 2024-09-17T05:52:12.295 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:12.292+0000 7f9f0eacc640 1 -- 172.21.15.150:0/2132054125 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9f080caa30 con 0x7f9f080d1090 2024-09-17T05:52:12.295 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:12.292+0000 7f9f0eacc640 1 -- 172.21.15.150:0/2132054125 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9f080caff0 con 0x7f9f080d1090 2024-09-17T05:52:12.296 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:12.293+0000 7f9f0eacc640 1 -- 172.21.15.150:0/2132054125 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9f080ce4c0 con 0x7f9f080d1090 2024-09-17T05:52:12.296 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:12.294+0000 7f9efd7fa640 1 -- 172.21.15.150:0/2132054125 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 42) ==== 104195+0+0 (secure 0 0 0) 0x7f9f00043070 con 0x7f9f080d1090 2024-09-17T05:52:12.296 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:12.294+0000 7f9efd7fa640 1 --2- 172.21.15.150:0/2132054125 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f9ef407aa20 0x7f9ef407cf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:52:12.296 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:12.294+0000 7f9efd7fa640 1 -- 172.21.15.150:0/2132054125 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(119..119 src has 1..119) ==== 5111+0+0 (secure 0 0 0) 0x7f9f000bb040 con 0x7f9f080d1090 2024-09-17T05:52:12.296 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:12.294+0000 7f9f0c868640 1 --2- 172.21.15.150:0/2132054125 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f9ef407aa20 0x7f9ef407cf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:52:12.296 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:12.295+0000 7f9f0c868640 1 --2- 172.21.15.150:0/2132054125 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f9ef407aa20 0x7f9ef407cf30 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7f9f04006fd0 tx=0x7f9f04009060 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:52:12.299 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:12.299+0000 7f9efd7fa640 1 -- 172.21.15.150:0/2132054125 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f9f000849c0 con 0x7f9f080d1090 2024-09-17T05:52:12.473 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:12.472+0000 7f9f0eacc640 1 -- 172.21.15.150:0/2132054125 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f9f080ca4e0 con 0x7f9f080d1090 2024-09-17T05:52:12.474 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:12.473+0000 7f9efd7fa640 1 -- 172.21.15.150:0/2132054125 <== mon.0 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v119) ==== 93+0+10 (secure 0 0 0) 0x7f9f000893f0 con 0x7f9f080d1090 2024-09-17T05:52:12.474 INFO:teuthology.orchestra.run.smithi150.stdout:pg_num: 1 2024-09-17T05:52:12.476 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:12.475+0000 7f9f0eacc640 1 -- 172.21.15.150:0/2132054125 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f9ef407aa20 msgr2=0x7f9ef407cf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:52:12.476 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:12.475+0000 7f9f0eacc640 1 --2- 172.21.15.150:0/2132054125 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f9ef407aa20 0x7f9ef407cf30 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7f9f04006fd0 tx=0x7f9f04009060 comp rx=0 tx=0).stop 2024-09-17T05:52:12.476 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:12.475+0000 7f9f0eacc640 1 -- 172.21.15.150:0/2132054125 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9f080d1090 msgr2=0x7f9f08158550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:52:12.477 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:12.475+0000 7f9f0eacc640 1 --2- 172.21.15.150:0/2132054125 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9f080d1090 0x7f9f08158550 secure :-1 s=READY pgs=1631 cs=0 l=1 rev1=1 crypto rx=0x7f9f00009cd0 tx=0x7f9f00003f10 comp rx=0 tx=0).stop 2024-09-17T05:52:12.477 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:12.475+0000 7f9f0eacc640 1 -- 172.21.15.150:0/2132054125 shutdown_connections 2024-09-17T05:52:12.477 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:12.475+0000 7f9f0eacc640 1 --2- 172.21.15.150:0/2132054125 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f9ef407aa20 0x7f9ef407cf30 unknown :-1 s=CLOSED pgs=693 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:52:12.477 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:12.475+0000 7f9f0eacc640 1 --2- 172.21.15.150:0/2132054125 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9f080d1090 0x7f9f08158550 unknown :-1 s=CLOSED pgs=1631 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:52:12.477 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:12.475+0000 7f9f0eacc640 1 --2- 172.21.15.150:0/2132054125 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9f080af570 0x7f9f0815ca30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:52:12.477 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:12.475+0000 7f9f0eacc640 1 --2- 172.21.15.150:0/2132054125 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9f080af160 0x7f9f080cb7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:52:12.477 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:12.475+0000 7f9f0eacc640 1 -- 172.21.15.150:0/2132054125 >> 172.21.15.150:0/2132054125 conn(0x7f9f080cefb0 msgr2=0x7f9f081594f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:52:12.478 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:12.475+0000 7f9f0eacc640 1 -- 172.21.15.150:0/2132054125 shutdown_connections 2024-09-17T05:52:12.478 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:12.475+0000 7f9f0eacc640 1 -- 172.21.15.150:0/2132054125 wait complete. 2024-09-17T05:52:12.488 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_volumes.TestCloneProgressReporter.test_when_clones_cancelled_are_less_than_cloner_threads' 2024-09-17T05:52:12.601 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:12.600+0000 7fe095fa8640 1 -- 172.21.15.150:0/2852716009 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe0900b5970 msgr2=0x7fe0900b5d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:52:12.602 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:12.600+0000 7fe095fa8640 1 --2- 172.21.15.150:0/2852716009 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe0900b5970 0x7fe0900b5d80 secure :-1 s=READY pgs=1633 cs=0 l=1 rev1=1 crypto rx=0x7fe088005fd0 tx=0x7fe08802a8b0 comp rx=0 tx=0).stop 2024-09-17T05:52:12.602 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:12.600+0000 7fe095fa8640 1 -- 172.21.15.150:0/2852716009 shutdown_connections 2024-09-17T05:52:12.602 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:12.600+0000 7fe095fa8640 1 --2- 172.21.15.150:0/2852716009 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe0900b5970 0x7fe0900b5d80 unknown :-1 s=CLOSED pgs=1633 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:52:12.602 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:12.600+0000 7fe095fa8640 1 -- 172.21.15.150:0/2852716009 >> 172.21.15.150:0/2852716009 conn(0x7fe0900cee90 msgr2=0x7fe0900cf2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:52:12.602 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:12.600+0000 7fe095fa8640 1 -- 172.21.15.150:0/2852716009 shutdown_connections 2024-09-17T05:52:12.602 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:12.600+0000 7fe095fa8640 1 -- 172.21.15.150:0/2852716009 wait complete. 2024-09-17T05:52:12.603 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:12.602+0000 7fe095fa8640 1 Processor -- start 2024-09-17T05:52:12.603 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:12.602+0000 7fe095fa8640 1 -- start start 2024-09-17T05:52:12.606 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:12.603+0000 7fe095fa8640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe09009ba60 0x7fe09015ebb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:52:12.606 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:12.603+0000 7fe095fa8640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe0900b5970 0x7fe0901f6a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:52:12.606 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:12.603+0000 7fe095fa8640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe0900b7330 0x7fe090160460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:52:12.606 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:12.603+0000 7fe095fa8640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7fe0901680f0 con 0x7fe0900b7330 2024-09-17T05:52:12.606 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:12.603+0000 7fe095fa8640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fe0900c5c10 con 0x7fe09009ba60 2024-09-17T05:52:12.606 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:12.603+0000 7fe095fa8640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fe090168270 con 0x7fe0900b5970 2024-09-17T05:52:12.606 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:12.604+0000 7fe08ffff640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe0900b7330 0x7fe090160460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:52:12.606 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:12.604+0000 7fe08ffff640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe0900b7330 0x7fe090160460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:42718/0 (socket says 172.21.15.150:42718) 2024-09-17T05:52:12.607 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:12.604+0000 7fe08ffff640 1 -- 172.21.15.150:0/3291877249 learned_addr learned my addr 172.21.15.150:0/3291877249 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:52:12.607 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:12.604+0000 7fe08f7fe640 1 --2- 172.21.15.150:0/3291877249 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe09009ba60 0x7fe09015ebb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:52:12.607 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:12.604+0000 7fe08effd640 1 --2- 172.21.15.150:0/3291877249 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe0900b5970 0x7fe0901f6a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:52:12.607 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:12.604+0000 7fe08ffff640 1 -- 172.21.15.150:0/3291877249 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe0900b5970 msgr2=0x7fe0901f6a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:52:12.607 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:12.604+0000 7fe08ffff640 1 --2- 172.21.15.150:0/3291877249 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe0900b5970 0x7fe0901f6a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:52:12.607 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:12.604+0000 7fe08ffff640 1 -- 172.21.15.150:0/3291877249 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe09009ba60 msgr2=0x7fe09015ebb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:52:12.607 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:12.604+0000 7fe08ffff640 1 --2- 172.21.15.150:0/3291877249 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe09009ba60 0x7fe09015ebb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:52:12.607 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:12.604+0000 7fe08ffff640 1 -- 172.21.15.150:0/3291877249 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe09015f3e0 con 0x7fe0900b7330 2024-09-17T05:52:12.607 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:12.604+0000 7fe08ffff640 1 --2- 172.21.15.150:0/3291877249 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe0900b7330 0x7fe090160460 secure :-1 s=READY pgs=1634 cs=0 l=1 rev1=1 crypto rx=0x7fe08802aea0 tx=0x7fe0880039f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:52:12.608 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:12.604+0000 7fe077fff640 1 -- 172.21.15.150:0/3291877249 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe088031990 con 0x7fe0900b7330 2024-09-17T05:52:12.608 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:12.604+0000 7fe095fa8640 1 -- 172.21.15.150:0/3291877249 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe09015f6c0 con 0x7fe0900b7330 2024-09-17T05:52:12.608 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:12.604+0000 7fe077fff640 1 -- 172.21.15.150:0/3291877249 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe088031c20 con 0x7fe0900b7330 2024-09-17T05:52:12.608 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:12.604+0000 7fe077fff640 1 -- 172.21.15.150:0/3291877249 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0880330d0 con 0x7fe0900b7330 2024-09-17T05:52:12.608 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:12.604+0000 7fe095fa8640 1 -- 172.21.15.150:0/3291877249 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe09009ce60 con 0x7fe0900b7330 2024-09-17T05:52:12.608 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:12.605+0000 7fe095fa8640 1 -- 172.21.15.150:0/3291877249 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe09009cc50 con 0x7fe0900b7330 2024-09-17T05:52:12.609 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:12.606+0000 7fe077fff640 1 -- 172.21.15.150:0/3291877249 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 42) ==== 104195+0+0 (secure 0 0 0) 0x7fe088033290 con 0x7fe0900b7330 2024-09-17T05:52:12.609 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:12.607+0000 7fe077fff640 1 --2- 172.21.15.150:0/3291877249 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fe07c07a9f0 0x7fe07c07cf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:52:12.609 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:12.607+0000 7fe077fff640 1 -- 172.21.15.150:0/3291877249 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(119..119 src has 1..119) ==== 5111+0+0 (secure 0 0 0) 0x7fe0880bb010 con 0x7fe0900b7330 2024-09-17T05:52:12.609 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:12.607+0000 7fe08f7fe640 1 --2- 172.21.15.150:0/3291877249 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fe07c07a9f0 0x7fe07c07cf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:52:12.609 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:12.607+0000 7fe08f7fe640 1 --2- 172.21.15.150:0/3291877249 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fe07c07a9f0 0x7fe07c07cf00 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7fe0800098c0 tx=0x7fe080009060 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:52:12.611 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:12.611+0000 7fe077fff640 1 -- 172.21.15.150:0/3291877249 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fe08804a030 con 0x7fe0900b7330 2024-09-17T05:52:12.857 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:12.857+0000 7fe095fa8640 1 -- 172.21.15.150:0/3291877249 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_volumes.TestCloneProgressReporter.test_when_clones_cancelled_are_less_than_cloner_threads"]} v 0) -- 0x7fe0900b5d80 con 0x7fe0900b7330 2024-09-17T05:52:13.849 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:13.848+0000 7fe077fff640 1 -- 172.21.15.150:0/3291877249 <== mon.0 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_volumes.TestCloneProgressReporter.test_when_clones_cancelled_are_less_than_cloner_threads"]}]=0 v517) ==== 189+0+0 (secure 0 0 0) 0x7fe08803f030 con 0x7fe0900b7330 2024-09-17T05:52:13.852 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:13.851+0000 7fe095fa8640 1 -- 172.21.15.150:0/3291877249 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fe07c07a9f0 msgr2=0x7fe07c07cf00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:52:13.852 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:13.851+0000 7fe095fa8640 1 --2- 172.21.15.150:0/3291877249 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fe07c07a9f0 0x7fe07c07cf00 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7fe0800098c0 tx=0x7fe080009060 comp rx=0 tx=0).stop 2024-09-17T05:52:13.852 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:13.851+0000 7fe095fa8640 1 -- 172.21.15.150:0/3291877249 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe0900b7330 msgr2=0x7fe090160460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:52:13.852 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:13.851+0000 7fe095fa8640 1 --2- 172.21.15.150:0/3291877249 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe0900b7330 0x7fe090160460 secure :-1 s=READY pgs=1634 cs=0 l=1 rev1=1 crypto rx=0x7fe08802aea0 tx=0x7fe0880039f0 comp rx=0 tx=0).stop 2024-09-17T05:52:13.852 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:13.851+0000 7fe095fa8640 1 -- 172.21.15.150:0/3291877249 shutdown_connections 2024-09-17T05:52:13.853 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:13.851+0000 7fe095fa8640 1 --2- 172.21.15.150:0/3291877249 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fe07c07a9f0 0x7fe07c07cf00 unknown :-1 s=CLOSED pgs=694 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:52:13.853 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:13.851+0000 7fe095fa8640 1 --2- 172.21.15.150:0/3291877249 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe0900b7330 0x7fe090160460 unknown :-1 s=CLOSED pgs=1634 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:52:13.853 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:13.851+0000 7fe095fa8640 1 --2- 172.21.15.150:0/3291877249 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe0900b5970 0x7fe0901f6a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:52:13.853 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:13.851+0000 7fe095fa8640 1 --2- 172.21.15.150:0/3291877249 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe09009ba60 0x7fe09015ebb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:52:13.853 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:13.851+0000 7fe095fa8640 1 -- 172.21.15.150:0/3291877249 >> 172.21.15.150:0/3291877249 conn(0x7fe0900cee90 msgr2=0x7fe0900cc210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:52:13.853 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:13.851+0000 7fe095fa8640 1 -- 172.21.15.150:0/3291877249 shutdown_connections 2024-09-17T05:52:13.853 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:13.851+0000 7fe095fa8640 1 -- 172.21.15.150:0/3291877249 wait complete. 2024-09-17T05:52:13.865 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config dump 2024-09-17T05:52:13.982 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:13.981+0000 7f21d4c5c640 1 -- 172.21.15.150:0/3916715700 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f21d009ba60 msgr2=0x7f21d00b7330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:52:13.983 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:13.981+0000 7f21d4c5c640 1 --2- 172.21.15.150:0/3916715700 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f21d009ba60 0x7f21d00b7330 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f21c00098e0 tx=0x7f21c002a5f0 comp rx=0 tx=0).stop 2024-09-17T05:52:13.983 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:13.981+0000 7f21d4c5c640 1 -- 172.21.15.150:0/3916715700 shutdown_connections 2024-09-17T05:52:13.983 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:13.981+0000 7f21d4c5c640 1 --2- 172.21.15.150:0/3916715700 >> v2:172.21.15.176:3300/0 conn(0x7f21d00cd850 0x7f21d00d06f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:52:13.983 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:13.981+0000 7f21d4c5c640 1 --2- 172.21.15.150:0/3916715700 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f21d009ba60 0x7f21d00b7330 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:52:13.983 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:13.981+0000 7f21d4c5c640 1 -- 172.21.15.150:0/3916715700 >> 172.21.15.150:0/3916715700 conn(0x7f21d00cee90 msgr2=0x7f21d00cf2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:52:13.983 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:13.981+0000 7f21d4c5c640 1 -- 172.21.15.150:0/3916715700 shutdown_connections 2024-09-17T05:52:13.983 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:13.981+0000 7f21d4c5c640 1 -- 172.21.15.150:0/3916715700 wait complete. 2024-09-17T05:52:13.984 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:13.983+0000 7f21d4c5c640 1 Processor -- start 2024-09-17T05:52:13.984 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:13.983+0000 7f21d4c5c640 1 -- start start 2024-09-17T05:52:13.987 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:13.985+0000 7f21d4c5c640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f21d009ba60 0x7f21d0157a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:52:13.987 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:13.985+0000 7f21d4c5c640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f21d00cd440 0x7f21d0166150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:52:13.987 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:13.985+0000 7f21d4c5c640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f21d00cd850 0x7f21d0166690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:52:13.987 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:13.985+0000 7f21d4c5c640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f21d00d0e40 con 0x7f21d009ba60 2024-09-17T05:52:13.988 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:13.985+0000 7f21d4c5c640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f21d01670e0 con 0x7f21d00cd850 2024-09-17T05:52:13.988 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:13.985+0000 7f21d4c5c640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f21d0159720 con 0x7f21d00cd440 2024-09-17T05:52:13.988 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:13.985+0000 7f21ce59c640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f21d009ba60 0x7f21d0157a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:52:13.988 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:13.985+0000 7f21ce59c640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f21d009ba60 0x7f21d0157a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:42720/0 (socket says 172.21.15.150:42720) 2024-09-17T05:52:13.988 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:13.985+0000 7f21ce59c640 1 -- 172.21.15.150:0/858998893 learned_addr learned my addr 172.21.15.150:0/858998893 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:52:13.988 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:13.985+0000 7f21ced9d640 1 --2- 172.21.15.150:0/858998893 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f21d00cd850 0x7f21d0166690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:52:13.988 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:13.985+0000 7f21cdd9b640 1 --2- 172.21.15.150:0/858998893 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f21d00cd440 0x7f21d0166150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:52:13.988 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:13.985+0000 7f21ce59c640 1 -- 172.21.15.150:0/858998893 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f21d00cd440 msgr2=0x7f21d0166150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:52:13.989 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:13.985+0000 7f21ce59c640 1 --2- 172.21.15.150:0/858998893 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f21d00cd440 0x7f21d0166150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:52:13.989 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:13.985+0000 7f21ce59c640 1 -- 172.21.15.150:0/858998893 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f21d00cd850 msgr2=0x7f21d0166690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:52:13.989 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:13.985+0000 7f21ce59c640 1 --2- 172.21.15.150:0/858998893 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f21d00cd850 0x7f21d0166690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:52:13.989 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:13.985+0000 7f21ce59c640 1 -- 172.21.15.150:0/858998893 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f21d0159970 con 0x7f21d009ba60 2024-09-17T05:52:13.989 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:13.985+0000 7f21ce59c640 1 --2- 172.21.15.150:0/858998893 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f21d009ba60 0x7f21d0157a50 secure :-1 s=READY pgs=1635 cs=0 l=1 rev1=1 crypto rx=0x7f21c002abe0 tx=0x7f21c00052f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:52:13.989 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:13.985+0000 7f21beffd640 1 -- 172.21.15.150:0/858998893 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21c003f070 con 0x7f21d009ba60 2024-09-17T05:52:13.989 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:13.985+0000 7f21d4c5c640 1 -- 172.21.15.150:0/858998893 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f21d0159c50 con 0x7f21d009ba60 2024-09-17T05:52:13.989 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:13.985+0000 7f21beffd640 1 -- 172.21.15.150:0/858998893 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f21c0004270 con 0x7f21d009ba60 2024-09-17T05:52:13.989 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:13.985+0000 7f21beffd640 1 -- 172.21.15.150:0/858998893 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21c0005cb0 con 0x7f21d009ba60 2024-09-17T05:52:13.989 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:13.986+0000 7f21d4c5c640 1 -- 172.21.15.150:0/858998893 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f21d015beb0 con 0x7f21d009ba60 2024-09-17T05:52:13.990 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:13.987+0000 7f21d4c5c640 1 -- 172.21.15.150:0/858998893 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f21d00b7330 con 0x7f21d009ba60 2024-09-17T05:52:13.990 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:13.987+0000 7f21beffd640 1 -- 172.21.15.150:0/858998893 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 42) ==== 104195+0+0 (secure 0 0 0) 0x7f21c0042070 con 0x7f21d009ba60 2024-09-17T05:52:13.990 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:13.988+0000 7f21beffd640 1 --2- 172.21.15.150:0/858998893 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f21b007a9f0 0x7f21b007cf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:52:13.990 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:13.988+0000 7f21beffd640 1 -- 172.21.15.150:0/858998893 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(119..119 src has 1..119) ==== 5111+0+0 (secure 0 0 0) 0x7f21c00bab40 con 0x7f21d009ba60 2024-09-17T05:52:13.991 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:13.988+0000 7f21cdd9b640 1 --2- 172.21.15.150:0/858998893 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f21b007a9f0 0x7f21b007cf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:52:13.991 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:13.989+0000 7f21cdd9b640 1 --2- 172.21.15.150:0/858998893 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f21b007a9f0 0x7f21b007cf00 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x7f21c4000f60 tx=0x7f21c4009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:52:13.993 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:13.993+0000 7f21beffd640 1 -- 172.21.15.150:0/858998893 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f21c00843b0 con 0x7f21d009ba60 2024-09-17T05:52:14.167 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:14.166+0000 7f21d4c5c640 1 -- 172.21.15.150:0/858998893 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "config dump"} v 0) -- 0x7f21d0164220 con 0x7f21d009ba60 2024-09-17T05:52:14.167 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:14.167+0000 7f21beffd640 1 -- 172.21.15.150:0/858998893 <== mon.0 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "config dump"}]=0 v54) ==== 59+0+2294 (secure 0 0 0) 0x7f21c0088de0 con 0x7f21d009ba60 2024-09-17T05:52:14.168 INFO:teuthology.orchestra.run.smithi150.stdout:WHO MASK LEVEL OPTION VALUE RO 2024-09-17T05:52:14.168 INFO:teuthology.orchestra.run.smithi150.stdout:mon advanced mon_op_complaint_time 120 2024-09-17T05:52:14.168 INFO:teuthology.orchestra.run.smithi150.stdout:mgr advanced client_mount_timeout 30 2024-09-17T05:52:14.168 INFO:teuthology.orchestra.run.smithi150.stdout:mgr advanced debug_client 20/20 2024-09-17T05:52:14.168 INFO:teuthology.orchestra.run.smithi150.stdout:mgr advanced debug_mgr 20/20 2024-09-17T05:52:14.168 INFO:teuthology.orchestra.run.smithi150.stdout:mgr advanced debug_ms 1/1 2024-09-17T05:52:14.168 INFO:teuthology.orchestra.run.smithi150.stdout:mgr dev mon_warn_on_pool_no_app false 2024-09-17T05:52:14.168 INFO:teuthology.orchestra.run.smithi150.stdout:osd advanced osd_op_complaint_time 180.000000 2024-09-17T05:52:14.168 INFO:teuthology.orchestra.run.smithi150.stdout:osd.0 basic osd_mclock_max_capacity_iops_ssd 6764.239331 2024-09-17T05:52:14.168 INFO:teuthology.orchestra.run.smithi150.stdout:osd.1 basic osd_mclock_max_capacity_iops_ssd 4956.769289 2024-09-17T05:52:14.168 INFO:teuthology.orchestra.run.smithi150.stdout:osd.2 basic osd_mclock_max_capacity_iops_ssd 5099.704467 2024-09-17T05:52:14.169 INFO:teuthology.orchestra.run.smithi150.stdout:osd.3 basic osd_mclock_max_capacity_iops_ssd 4681.616196 2024-09-17T05:52:14.169 INFO:teuthology.orchestra.run.smithi150.stdout:osd.4 basic osd_mclock_max_capacity_iops_ssd 4723.364425 2024-09-17T05:52:14.169 INFO:teuthology.orchestra.run.smithi150.stdout:osd.5 basic osd_mclock_max_capacity_iops_ssd 4509.722124 2024-09-17T05:52:14.169 INFO:teuthology.orchestra.run.smithi150.stdout:osd.6 basic osd_mclock_max_capacity_iops_ssd 6380.664158 2024-09-17T05:52:14.169 INFO:teuthology.orchestra.run.smithi150.stdout:osd.7 basic osd_mclock_max_capacity_iops_ssd 4303.333825 2024-09-17T05:52:14.169 INFO:teuthology.orchestra.run.smithi150.stdout:mds advanced debug_mds 20/20 2024-09-17T05:52:14.169 INFO:teuthology.orchestra.run.smithi150.stdout:mds advanced debug_mds_balancer 20/20 2024-09-17T05:52:14.169 INFO:teuthology.orchestra.run.smithi150.stdout:mds advanced debug_ms 2/2 2024-09-17T05:52:14.169 INFO:teuthology.orchestra.run.smithi150.stdout:mds dev mds_debug_frag true 2024-09-17T05:52:14.169 INFO:teuthology.orchestra.run.smithi150.stdout:mds dev mds_debug_scatterstat true 2024-09-17T05:52:14.169 INFO:teuthology.orchestra.run.smithi150.stdout:mds advanced mds_op_complaint_time 180.000000 2024-09-17T05:52:14.169 INFO:teuthology.orchestra.run.smithi150.stdout:mds dev mds_verify_scatter true 2024-09-17T05:52:14.169 INFO:teuthology.orchestra.run.smithi150.stdout:mds advanced osd_op_complaint_time 180.000000 2024-09-17T05:52:14.170 INFO:teuthology.orchestra.run.smithi150.stdout:mds advanced rados_mon_op_timeout 900 2024-09-17T05:52:14.170 INFO:teuthology.orchestra.run.smithi150.stdout:mds advanced rados_osd_op_timeout 900 2024-09-17T05:52:14.170 INFO:teuthology.orchestra.run.smithi150.stdout:client advanced client_mount_timeout 600 2024-09-17T05:52:14.170 INFO:teuthology.orchestra.run.smithi150.stdout:client advanced debug_client 20/20 2024-09-17T05:52:14.170 INFO:teuthology.orchestra.run.smithi150.stdout:client advanced debug_ms 1/1 2024-09-17T05:52:14.170 INFO:teuthology.orchestra.run.smithi150.stdout:client advanced rados_mon_op_timeout 900 2024-09-17T05:52:14.170 INFO:teuthology.orchestra.run.smithi150.stdout:client advanced rados_osd_op_timeout 900 2024-09-17T05:52:14.171 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:14.169+0000 7f21d4c5c640 1 -- 172.21.15.150:0/858998893 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f21b007a9f0 msgr2=0x7f21b007cf00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:52:14.171 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:14.169+0000 7f21d4c5c640 1 --2- 172.21.15.150:0/858998893 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f21b007a9f0 0x7f21b007cf00 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x7f21c4000f60 tx=0x7f21c4009040 comp rx=0 tx=0).stop 2024-09-17T05:52:14.171 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:14.169+0000 7f21d4c5c640 1 -- 172.21.15.150:0/858998893 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f21d009ba60 msgr2=0x7f21d0157a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:52:14.171 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:14.169+0000 7f21d4c5c640 1 --2- 172.21.15.150:0/858998893 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f21d009ba60 0x7f21d0157a50 secure :-1 s=READY pgs=1635 cs=0 l=1 rev1=1 crypto rx=0x7f21c002abe0 tx=0x7f21c00052f0 comp rx=0 tx=0).stop 2024-09-17T05:52:14.171 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:14.169+0000 7f21d4c5c640 1 -- 172.21.15.150:0/858998893 shutdown_connections 2024-09-17T05:52:14.171 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:14.169+0000 7f21d4c5c640 1 --2- 172.21.15.150:0/858998893 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f21d00cd850 0x7f21d0166690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:52:14.171 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:14.169+0000 7f21d4c5c640 1 --2- 172.21.15.150:0/858998893 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f21b007a9f0 0x7f21b007cf00 unknown :-1 s=CLOSED pgs=695 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:52:14.172 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:14.169+0000 7f21d4c5c640 1 --2- 172.21.15.150:0/858998893 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f21d00cd440 0x7f21d0166150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:52:14.172 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:14.169+0000 7f21d4c5c640 1 --2- 172.21.15.150:0/858998893 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f21d009ba60 0x7f21d0157a50 unknown :-1 s=CLOSED pgs=1635 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:52:14.172 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:14.169+0000 7f21d4c5c640 1 -- 172.21.15.150:0/858998893 >> 172.21.15.150:0/858998893 conn(0x7f21d00cee90 msgr2=0x7f21d0164740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:52:14.172 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:14.169+0000 7f21d4c5c640 1 -- 172.21.15.150:0/858998893 shutdown_connections 2024-09-17T05:52:14.172 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:14.169+0000 7f21d4c5c640 1 -- 172.21.15.150:0/858998893 wait complete. 2024-09-17T05:52:14.182 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-09-17T05:52:14.304 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:14.297+0000 7fbd5a7c3640 1 -- 172.21.15.150:0/1126479223 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fbd540b7960 msgr2=0x7fbd540af1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:52:14.304 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:14.297+0000 7fbd5a7c3640 1 --2- 172.21.15.150:0/1126479223 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fbd540b7960 0x7fbd540af1f0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fbd44009850 tx=0x7fbd4402a3f0 comp rx=0 tx=0).stop 2024-09-17T05:52:14.304 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:14.297+0000 7fbd5a7c3640 1 -- 172.21.15.150:0/1126479223 shutdown_connections 2024-09-17T05:52:14.304 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:14.297+0000 7fbd5a7c3640 1 --2- 172.21.15.150:0/1126479223 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fbd540b7960 0x7fbd540af1f0 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:52:14.304 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:14.297+0000 7fbd5a7c3640 1 -- 172.21.15.150:0/1126479223 >> 172.21.15.150:0/1126479223 conn(0x7fbd540cef20 msgr2=0x7fbd540cf330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:52:14.304 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:14.297+0000 7fbd5a7c3640 1 -- 172.21.15.150:0/1126479223 shutdown_connections 2024-09-17T05:52:14.304 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:14.297+0000 7fbd5a7c3640 1 -- 172.21.15.150:0/1126479223 wait complete. 2024-09-17T05:52:14.304 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:14.299+0000 7fbd5a7c3640 1 Processor -- start 2024-09-17T05:52:14.305 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:14.299+0000 7fbd5a7c3640 1 -- start start 2024-09-17T05:52:14.305 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:14.301+0000 7fbd5a7c3640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fbd540b7960 0x7fbd541f98b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:52:14.305 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:14.301+0000 7fbd5a7c3640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbd540b7d70 0x7fbd54145fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:52:14.305 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:14.301+0000 7fbd5a7c3640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fbd540d1190 0x7fbd540b6580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:52:14.305 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:14.301+0000 7fbd5a7c3640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7fbd540b8380 con 0x7fbd540b7d70 2024-09-17T05:52:14.305 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:14.301+0000 7fbd5a7c3640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fbd540ceda0 con 0x7fbd540d1190 2024-09-17T05:52:14.305 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:14.301+0000 7fbd5a7c3640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fbd540af730 con 0x7fbd540b7960 2024-09-17T05:52:14.305 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:14.301+0000 7fbd537fe640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbd540b7d70 0x7fbd54145fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:52:14.305 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:14.301+0000 7fbd537fe640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbd540b7d70 0x7fbd54145fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:42730/0 (socket says 172.21.15.150:42730) 2024-09-17T05:52:14.305 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:14.301+0000 7fbd537fe640 1 -- 172.21.15.150:0/2091884703 learned_addr learned my addr 172.21.15.150:0/2091884703 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:52:14.305 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:14.301+0000 7fbd58d60640 1 --2- 172.21.15.150:0/2091884703 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fbd540d1190 0x7fbd540b6580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:52:14.305 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:14.301+0000 7fbd53fff640 1 --2- 172.21.15.150:0/2091884703 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fbd540b7960 0x7fbd541f98b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:52:14.305 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:14.301+0000 7fbd537fe640 1 -- 172.21.15.150:0/2091884703 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fbd540b7960 msgr2=0x7fbd541f98b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:52:14.306 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:14.301+0000 7fbd537fe640 1 --2- 172.21.15.150:0/2091884703 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fbd540b7960 0x7fbd541f98b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:52:14.306 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:14.301+0000 7fbd537fe640 1 -- 172.21.15.150:0/2091884703 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fbd540d1190 msgr2=0x7fbd540b6580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:52:14.306 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:14.301+0000 7fbd537fe640 1 --2- 172.21.15.150:0/2091884703 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fbd540d1190 0x7fbd540b6580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:52:14.306 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:14.301+0000 7fbd537fe640 1 -- 172.21.15.150:0/2091884703 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbd5406e050 con 0x7fbd540b7d70 2024-09-17T05:52:14.306 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:14.301+0000 7fbd58d60640 1 --2- 172.21.15.150:0/2091884703 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fbd540d1190 0x7fbd540b6580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:52:14.306 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:14.301+0000 7fbd537fe640 1 --2- 172.21.15.150:0/2091884703 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbd540b7d70 0x7fbd54145fa0 secure :-1 s=READY pgs=1637 cs=0 l=1 rev1=1 crypto rx=0x7fbd4800c390 tx=0x7fbd4800c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:52:14.306 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:14.301+0000 7fbd50ff9640 1 -- 172.21.15.150:0/2091884703 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd48017070 con 0x7fbd540b7d70 2024-09-17T05:52:14.306 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:14.301+0000 7fbd50ff9640 1 -- 172.21.15.150:0/2091884703 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fbd480053c0 con 0x7fbd540b7d70 2024-09-17T05:52:14.306 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:14.301+0000 7fbd5a7c3640 1 -- 172.21.15.150:0/2091884703 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbd5406e330 con 0x7fbd540b7d70 2024-09-17T05:52:14.306 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:14.301+0000 7fbd50ff9640 1 -- 172.21.15.150:0/2091884703 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd48003850 con 0x7fbd540b7d70 2024-09-17T05:52:14.306 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:14.302+0000 7fbd5a7c3640 1 -- 172.21.15.150:0/2091884703 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbd5406ee10 con 0x7fbd540b7d70 2024-09-17T05:52:14.306 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:14.303+0000 7fbd5a7c3640 1 -- 172.21.15.150:0/2091884703 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbd541464e0 con 0x7fbd540b7d70 2024-09-17T05:52:14.307 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:14.303+0000 7fbd50ff9640 1 -- 172.21.15.150:0/2091884703 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 42) ==== 104195+0+0 (secure 0 0 0) 0x7fbd4801a070 con 0x7fbd540b7d70 2024-09-17T05:52:14.307 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:14.304+0000 7fbd50ff9640 1 --2- 172.21.15.150:0/2091884703 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fbd4007a9f0 0x7fbd4007cf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:52:14.307 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:14.304+0000 7fbd50ff9640 1 -- 172.21.15.150:0/2091884703 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(119..119 src has 1..119) ==== 5111+0+0 (secure 0 0 0) 0x7fbd48099040 con 0x7fbd540b7d70 2024-09-17T05:52:14.307 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:14.304+0000 7fbd53fff640 1 --2- 172.21.15.150:0/2091884703 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fbd4007a9f0 0x7fbd4007cf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:52:14.308 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:14.305+0000 7fbd53fff640 1 --2- 172.21.15.150:0/2091884703 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fbd4007a9f0 0x7fbd4007cf00 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7fbd44034000 tx=0x7fbd44004730 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:52:14.309 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:14.308+0000 7fbd50ff9640 1 -- 172.21.15.150:0/2091884703 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fbd48062f90 con 0x7fbd540b7d70 2024-09-17T05:52:14.484 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:14.483+0000 7fbd5a7c3640 1 -- 172.21.15.150:0/2091884703 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) -- 0x7fbd540af1f0 con 0x7fbd540b7d70 2024-09-17T05:52:14.487 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:14.487+0000 7fbd50ff9640 1 -- 172.21.15.150:0/2091884703 <== mon.0 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v55)=0 v55) ==== 122+0+0 (secure 0 0 0) 0x7fbd48062890 con 0x7fbd540b7d70 2024-09-17T05:52:14.490 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:14.489+0000 7fbd5a7c3640 1 -- 172.21.15.150:0/2091884703 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fbd4007a9f0 msgr2=0x7fbd4007cf00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:52:14.490 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:14.489+0000 7fbd5a7c3640 1 --2- 172.21.15.150:0/2091884703 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fbd4007a9f0 0x7fbd4007cf00 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7fbd44034000 tx=0x7fbd44004730 comp rx=0 tx=0).stop 2024-09-17T05:52:14.490 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:14.489+0000 7fbd5a7c3640 1 -- 172.21.15.150:0/2091884703 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbd540b7d70 msgr2=0x7fbd54145fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:52:14.490 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:14.489+0000 7fbd5a7c3640 1 --2- 172.21.15.150:0/2091884703 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbd540b7d70 0x7fbd54145fa0 secure :-1 s=READY pgs=1637 cs=0 l=1 rev1=1 crypto rx=0x7fbd4800c390 tx=0x7fbd4800c850 comp rx=0 tx=0).stop 2024-09-17T05:52:14.490 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:14.489+0000 7fbd5a7c3640 1 -- 172.21.15.150:0/2091884703 shutdown_connections 2024-09-17T05:52:14.491 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:14.489+0000 7fbd5a7c3640 1 --2- 172.21.15.150:0/2091884703 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fbd540d1190 0x7fbd540b6580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:52:14.491 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:14.489+0000 7fbd5a7c3640 1 --2- 172.21.15.150:0/2091884703 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fbd4007a9f0 0x7fbd4007cf00 unknown :-1 s=CLOSED pgs=696 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:52:14.491 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:14.489+0000 7fbd5a7c3640 1 --2- 172.21.15.150:0/2091884703 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbd540b7d70 0x7fbd54145fa0 unknown :-1 s=CLOSED pgs=1637 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:52:14.491 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:14.489+0000 7fbd5a7c3640 1 --2- 172.21.15.150:0/2091884703 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fbd540b7960 0x7fbd541f98b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:52:14.491 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:14.489+0000 7fbd5a7c3640 1 -- 172.21.15.150:0/2091884703 >> 172.21.15.150:0/2091884703 conn(0x7fbd540cef20 msgr2=0x7fbd540d0a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:52:14.491 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:14.489+0000 7fbd5a7c3640 1 -- 172.21.15.150:0/2091884703 shutdown_connections 2024-09-17T05:52:14.491 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:14.489+0000 7fbd5a7c3640 1 -- 172.21.15.150:0/2091884703 wait complete. 2024-09-17T05:52:14.506 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-17T05:52:14.506 DEBUG:teuthology.orchestra.run.smithi150:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-17T05:52:14.543 DEBUG:teuthology.orchestra.run.smithi176:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-17T05:52:14.586 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-17T05:52:14.586 DEBUG:teuthology.orchestra.run.smithi150:> set -ex 2024-09-17T05:52:14.586 DEBUG:teuthology.orchestra.run.smithi150:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T05:52:14.602 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056027,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497464k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=18693 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248728k,nr_inodes=812182,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497464k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-17T05:52:14.603 DEBUG:teuthology.orchestra.run.smithi176:> set -ex 2024-09-17T05:52:14.603 DEBUG:teuthology.orchestra.run.smithi176:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T05:52:14.645 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056030,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497468k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=3379 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248732k,nr_inodes=812183,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497468k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-17T05:52:14.645 DEBUG:teuthology.orchestra.run.smithi150:> set -ex 2024-09-17T05:52:14.646 DEBUG:teuthology.orchestra.run.smithi150:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T05:52:14.661 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056027,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497464k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=18693 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248728k,nr_inodes=812182,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497464k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-17T05:52:14.661 DEBUG:teuthology.orchestra.run.smithi176:> set -ex 2024-09-17T05:52:14.661 DEBUG:teuthology.orchestra.run.smithi176:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T05:52:14.704 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056030,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497468k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=3379 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248732k,nr_inodes=812183,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497468k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-17T05:52:14.704 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-09-17T05:52:14.704 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T05:52:14.822 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:14.821+0000 7f30176d5640 1 -- 172.21.15.150:0/473869794 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2ffc004800 msgr2=0x7f2ffc004c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:52:14.822 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:14.821+0000 7f30176d5640 1 --2- 172.21.15.150:0/473869794 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2ffc004800 0x7f2ffc004c10 secure :-1 s=READY pgs=1639 cs=0 l=1 rev1=1 crypto rx=0x7f3000001630 tx=0x7f2ffc005830 comp rx=0 tx=0).stop 2024-09-17T05:52:14.822 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:14.821+0000 7f3015c72640 1 -- 172.21.15.150:0/473869794 reap_dead start 2024-09-17T05:52:14.822 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:14.821+0000 7f30176d5640 1 -- 172.21.15.150:0/473869794 shutdown_connections 2024-09-17T05:52:14.822 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:14.821+0000 7f30176d5640 1 -- 172.21.15.150:0/473869794 >> 172.21.15.150:0/473869794 conn(0x7f30100cef30 msgr2=0x7f30100cf340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:52:14.823 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:14.821+0000 7f30176d5640 1 -- 172.21.15.150:0/473869794 shutdown_connections 2024-09-17T05:52:14.823 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:14.821+0000 7f30176d5640 1 -- 172.21.15.150:0/473869794 wait complete. 2024-09-17T05:52:14.823 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:14.823+0000 7f30176d5640 1 Processor -- start 2024-09-17T05:52:14.824 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:14.823+0000 7f30176d5640 1 -- start start 2024-09-17T05:52:14.826 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:14.824+0000 7f30176d5640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2ffc004800 0x7f30100b2b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:52:14.826 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:14.824+0000 7f30176d5640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f30101f4160 0x7f30100cb740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:52:14.826 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:14.824+0000 7f30176d5640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3010072700 0x7f3010072b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:52:14.826 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:14.824+0000 7f30176d5640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f30100d1460 con 0x7f2ffc004800 2024-09-17T05:52:14.827 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:14.824+0000 7f30176d5640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f30100b83c0 con 0x7f3010072700 2024-09-17T05:52:14.827 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:14.824+0000 7f30176d5640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f30100d15e0 con 0x7f30101f4160 2024-09-17T05:52:14.827 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:14.824+0000 7f3015471640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2ffc004800 0x7f30100b2b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:52:14.827 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:14.825+0000 7f3015471640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2ffc004800 0x7f30100b2b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:42734/0 (socket says 172.21.15.150:42734) 2024-09-17T05:52:14.827 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:14.825+0000 7f3015471640 1 -- 172.21.15.150:0/3330736046 learned_addr learned my addr 172.21.15.150:0/3330736046 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:52:14.827 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:14.825+0000 7f3015c72640 1 --2- 172.21.15.150:0/3330736046 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3010072700 0x7f3010072b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:52:14.827 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:14.825+0000 7f3014c70640 1 --2- 172.21.15.150:0/3330736046 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f30101f4160 0x7f30100cb740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:52:14.827 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:14.825+0000 7f3015471640 1 -- 172.21.15.150:0/3330736046 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f30101f4160 msgr2=0x7f30100cb740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:52:14.827 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:14.825+0000 7f3015471640 1 --2- 172.21.15.150:0/3330736046 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f30101f4160 0x7f30100cb740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:52:14.827 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:14.825+0000 7f3015471640 1 -- 172.21.15.150:0/3330736046 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3010072700 msgr2=0x7f3010072b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:52:14.827 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:14.825+0000 7f3015471640 1 --2- 172.21.15.150:0/3330736046 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3010072700 0x7f3010072b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:52:14.827 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:14.825+0000 7f3015471640 1 -- 172.21.15.150:0/3330736046 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3010073050 con 0x7f2ffc004800 2024-09-17T05:52:14.828 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:14.825+0000 7f3014c70640 1 --2- 172.21.15.150:0/3330736046 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f30101f4160 0x7f30100cb740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:52:14.828 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:14.825+0000 7f3015471640 1 --2- 172.21.15.150:0/3330736046 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2ffc004800 0x7f30100b2b80 secure :-1 s=READY pgs=1640 cs=0 l=1 rev1=1 crypto rx=0x7f300c006480 tx=0x7f300c0039c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:52:14.828 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:14.825+0000 7f3005ffb640 1 -- 172.21.15.150:0/3330736046 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f300c011700 con 0x7f2ffc004800 2024-09-17T05:52:14.828 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:14.825+0000 7f3005ffb640 1 -- 172.21.15.150:0/3330736046 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f300c016020 con 0x7f2ffc004800 2024-09-17T05:52:14.828 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:14.825+0000 7f30176d5640 1 -- 172.21.15.150:0/3330736046 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f30100b30c0 con 0x7f2ffc004800 2024-09-17T05:52:14.828 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:14.825+0000 7f3005ffb640 1 -- 172.21.15.150:0/3330736046 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f300c011b40 con 0x7f2ffc004800 2024-09-17T05:52:14.828 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:14.825+0000 7f30176d5640 1 -- 172.21.15.150:0/3330736046 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f30101f4a40 con 0x7f2ffc004800 2024-09-17T05:52:14.829 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:14.826+0000 7f30176d5640 1 -- 172.21.15.150:0/3330736046 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f30100cded0 con 0x7f2ffc004800 2024-09-17T05:52:14.829 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:14.827+0000 7f3005ffb640 1 -- 172.21.15.150:0/3330736046 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 42) ==== 104195+0+0 (secure 0 0 0) 0x7f300c011ce0 con 0x7f2ffc004800 2024-09-17T05:52:14.829 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:14.828+0000 7f3005ffb640 1 --2- 172.21.15.150:0/3330736046 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f2ff407a9f0 0x7f2ff407cf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:52:14.829 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:14.828+0000 7f3005ffb640 1 -- 172.21.15.150:0/3330736046 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(119..119 src has 1..119) ==== 5111+0+0 (secure 0 0 0) 0x7f300c09a7d0 con 0x7f2ffc004800 2024-09-17T05:52:14.829 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:14.828+0000 7f3014c70640 1 --2- 172.21.15.150:0/3330736046 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f2ff407a9f0 0x7f2ff407cf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:52:14.829 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:14.829+0000 7f3014c70640 1 --2- 172.21.15.150:0/3330736046 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f2ff407a9f0 0x7f2ff407cf00 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7f3000032000 tx=0x7f3000035040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:52:14.833 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:14.832+0000 7f3005ffb640 1 -- 172.21.15.150:0/3330736046 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f30100cded0 con 0x7f2ffc004800 2024-09-17T05:52:15.043 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:15.042+0000 7f30176d5640 1 -- 172.21.15.150:0/3330736046 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f30100b5710 con 0x7f2ffc004800 2024-09-17T05:52:15.043 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:15.043+0000 7f3005ffb640 1 -- 172.21.15.150:0/3330736046 <== mon.0 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 73 v73) ==== 94+0+3923 (secure 0 0 0) 0x7f300c020020 con 0x7f2ffc004800 2024-09-17T05:52:15.044 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-09-17T05:52:15.044 INFO:teuthology.orchestra.run.smithi150.stdout:{"epoch":73,"btime":"2024-09-17T05:52:08:824550+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6779,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6836/2908904841","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6835","nonce":2908904841},{"type":"v1","addr":"172.21.15.176:6836","nonce":2908904841}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":65},{"gid":6782,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6837/2764909757","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6834","nonce":2764909757},{"type":"v1","addr":"172.21.15.176:6837","nonce":2764909757}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":65},{"gid":8568,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6834/1970670297","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6832","nonce":1970670297},{"type":"v1","addr":"172.21.15.150:6834","nonce":1970670297}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":64},{"gid":9036,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6835/2067165134","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6833","nonce":2067165134},{"type":"v1","addr":"172.21.15.150:6835","nonce":2067165134}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":73}],"filesystems":[]} 2024-09-17T05:52:15.044 INFO:teuthology.orchestra.run.smithi150.stderr:dumped fsmap epoch 73 2024-09-17T05:52:15.046 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:15.045+0000 7f30176d5640 1 -- 172.21.15.150:0/3330736046 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f2ff407a9f0 msgr2=0x7f2ff407cf00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:52:15.046 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:15.045+0000 7f30176d5640 1 --2- 172.21.15.150:0/3330736046 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f2ff407a9f0 0x7f2ff407cf00 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7f3000032000 tx=0x7f3000035040 comp rx=0 tx=0).stop 2024-09-17T05:52:15.046 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:15.045+0000 7f30176d5640 1 -- 172.21.15.150:0/3330736046 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2ffc004800 msgr2=0x7f30100b2b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:52:15.046 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:15.045+0000 7f30176d5640 1 --2- 172.21.15.150:0/3330736046 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2ffc004800 0x7f30100b2b80 secure :-1 s=READY pgs=1640 cs=0 l=1 rev1=1 crypto rx=0x7f300c006480 tx=0x7f300c0039c0 comp rx=0 tx=0).stop 2024-09-17T05:52:15.046 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:15.045+0000 7f30176d5640 1 -- 172.21.15.150:0/3330736046 shutdown_connections 2024-09-17T05:52:15.046 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:15.045+0000 7f30176d5640 1 --2- 172.21.15.150:0/3330736046 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3010072700 0x7f3010072b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:52:15.046 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:15.045+0000 7f30176d5640 1 --2- 172.21.15.150:0/3330736046 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f2ff407a9f0 0x7f2ff407cf00 unknown :-1 s=CLOSED pgs=697 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:52:15.047 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:15.045+0000 7f30176d5640 1 --2- 172.21.15.150:0/3330736046 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f30101f4160 0x7f30100cb740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:52:15.047 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:15.045+0000 7f30176d5640 1 --2- 172.21.15.150:0/3330736046 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2ffc004800 0x7f30100b2b80 unknown :-1 s=CLOSED pgs=1640 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:52:15.047 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:15.045+0000 7f30176d5640 1 -- 172.21.15.150:0/3330736046 >> 172.21.15.150:0/3330736046 conn(0x7f30100cef30 msgr2=0x7f3010071d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:52:15.047 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:15.045+0000 7f30176d5640 1 -- 172.21.15.150:0/3330736046 shutdown_connections 2024-09-17T05:52:15.047 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:15.045+0000 7f30176d5640 1 -- 172.21.15.150:0/3330736046 wait complete. 2024-09-17T05:52:15.058 INFO:tasks.ceph.mds.a:Restarting daemon 2024-09-17T05:52:15.058 INFO:tasks.ceph.mds.a:Stopping old one... 2024-09-17T05:52:15.058 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-09-17T05:52:15.058 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T05:52:15.059 INFO:tasks.ceph.mds.c:Restarting daemon 2024-09-17T05:52:15.059 INFO:tasks.ceph.mds.c:Stopping old one... 2024-09-17T05:52:15.059 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-09-17T05:52:15.059 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T05:52:15.059 INFO:tasks.ceph.mds.b:Restarting daemon 2024-09-17T05:52:15.059 INFO:tasks.ceph.mds.b:Stopping old one... 2024-09-17T05:52:15.059 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-09-17T05:52:15.059 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T05:52:15.060 INFO:tasks.ceph.mds.d:Restarting daemon 2024-09-17T05:52:15.060 INFO:tasks.ceph.mds.d:Stopping old one... 2024-09-17T05:52:15.060 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-09-17T05:52:15.060 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T05:52:15.068 INFO:tasks.ceph.mds.a:Stopped 2024-09-17T05:52:15.068 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-09-17T05:52:15.072 INFO:tasks.ceph.mds.c:Stopped 2024-09-17T05:52:15.072 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-09-17T05:52:15.073 INFO:tasks.ceph.mds.d:Stopped 2024-09-17T05:52:15.074 DEBUG:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-09-17T05:52:15.074 INFO:tasks.ceph.mds.b:Stopped 2024-09-17T05:52:15.075 DEBUG:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-09-17T05:52:15.114 INFO:tasks.ceph.mds.a:Started 2024-09-17T05:52:15.115 DEBUG:teuthology.parallel:result is None 2024-09-17T05:52:15.116 INFO:tasks.ceph.mds.c:Started 2024-09-17T05:52:15.116 DEBUG:teuthology.parallel:result is None 2024-09-17T05:52:15.117 INFO:tasks.ceph.mds.d:Started 2024-09-17T05:52:15.118 DEBUG:teuthology.parallel:result is None 2024-09-17T05:52:15.118 INFO:tasks.ceph.mds.b:Started 2024-09-17T05:52:15.119 DEBUG:teuthology.parallel:result is None 2024-09-17T05:52:15.119 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-09-17T05:52:15.202 INFO:tasks.ceph.mds.a.smithi150.stdout:starting mds.a at 2024-09-17T05:52:15.202 INFO:tasks.ceph.mds.c.smithi150.stdout:starting mds.c at 2024-09-17T05:52:15.211 INFO:tasks.ceph.mds.d.smithi176.stdout:starting mds.d at 2024-09-17T05:52:15.212 INFO:tasks.ceph.mds.b.smithi176.stdout:starting mds.b at 2024-09-17T05:52:15.241 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:15.240+0000 7f0731e63640 1 -- 172.21.15.150:0/4171667668 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f072c0d50c0 msgr2=0x7f072c0d0240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:52:15.242 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:15.240+0000 7f0731e63640 1 --2- 172.21.15.150:0/4171667668 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f072c0d50c0 0x7f072c0d0240 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7f072c0d1d80 tx=0x7f071402a4a0 comp rx=0 tx=0).stop 2024-09-17T05:52:15.242 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:15.241+0000 7f0731e63640 1 -- 172.21.15.150:0/4171667668 shutdown_connections 2024-09-17T05:52:15.242 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:15.241+0000 7f0731e63640 1 --2- 172.21.15.150:0/4171667668 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f072c0d50c0 0x7f072c0d0240 unknown :-1 s=CLOSED pgs=561 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:52:15.242 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:15.241+0000 7f0731e63640 1 --2- 172.21.15.150:0/4171667668 >> v2:172.21.15.150:3300/0 conn(0x7f072c0b9d10 0x7f072c0d2f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:52:15.242 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:15.241+0000 7f0731e63640 1 -- 172.21.15.150:0/4171667668 >> 172.21.15.150:0/4171667668 conn(0x7f072c08bfe0 msgr2=0x7f072c0d4650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:52:15.242 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:15.241+0000 7f0731e63640 1 -- 172.21.15.150:0/4171667668 shutdown_connections 2024-09-17T05:52:15.242 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:15.241+0000 7f0731e63640 1 -- 172.21.15.150:0/4171667668 wait complete. 2024-09-17T05:52:15.243 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:15.242+0000 7f0731e63640 1 Processor -- start 2024-09-17T05:52:15.243 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:15.242+0000 7f0731e63640 1 -- start start 2024-09-17T05:52:15.246 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:15.244+0000 7f0731e63640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f072c0b9d10 0x7f072c0ce3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:52:15.246 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:15.244+0000 7f0731e63640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f072c0d1020 0x7f072c150990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:52:15.246 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:15.244+0000 7f0731e63640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f072c0d50c0 0x7f072c0ca400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:52:15.246 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:15.244+0000 7f0731e63640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f072c0b4300 con 0x7f072c0d1020 2024-09-17T05:52:15.246 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:15.244+0000 7f0731e63640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f072c0b4180 con 0x7f072c0b9d10 2024-09-17T05:52:15.246 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:15.244+0000 7f0731e63640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f072c0b4480 con 0x7f072c0d50c0 2024-09-17T05:52:15.246 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:15.244+0000 7f0723fff640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f072c0d1020 0x7f072c150990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:52:15.246 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:15.244+0000 7f0723fff640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f072c0d1020 0x7f072c150990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:42794/0 (socket says 172.21.15.150:42794) 2024-09-17T05:52:15.246 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:15.244+0000 7f0723fff640 1 -- 172.21.15.150:0/221033917 learned_addr learned my addr 172.21.15.150:0/221033917 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:52:15.246 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:15.244+0000 7f072b7fe640 1 --2- 172.21.15.150:0/221033917 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f072c0b9d10 0x7f072c0ce3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:52:15.247 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:15.244+0000 7f072bfff640 1 --2- 172.21.15.150:0/221033917 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f072c0d50c0 0x7f072c0ca400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:52:15.247 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:15.244+0000 7f0723fff640 1 -- 172.21.15.150:0/221033917 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f072c0d50c0 msgr2=0x7f072c0ca400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:52:15.247 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:15.244+0000 7f0723fff640 1 --2- 172.21.15.150:0/221033917 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f072c0d50c0 0x7f072c0ca400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:52:15.247 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:15.244+0000 7f0723fff640 1 -- 172.21.15.150:0/221033917 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f072c0b9d10 msgr2=0x7f072c0ce3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:52:15.247 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:15.244+0000 7f0723fff640 1 --2- 172.21.15.150:0/221033917 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f072c0b9d10 0x7f072c0ce3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:52:15.247 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:15.244+0000 7f0723fff640 1 -- 172.21.15.150:0/221033917 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f072c150ed0 con 0x7f072c0d1020 2024-09-17T05:52:15.247 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:15.244+0000 7f072bfff640 1 --2- 172.21.15.150:0/221033917 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f072c0d50c0 0x7f072c0ca400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T05:52:15.247 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:15.244+0000 7f0723fff640 1 --2- 172.21.15.150:0/221033917 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f072c0d1020 0x7f072c150990 secure :-1 s=READY pgs=1650 cs=0 l=1 rev1=1 crypto rx=0x7f07140098f0 tx=0x7f0714033c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:52:15.247 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:15.244+0000 7f0728ff9640 1 -- 172.21.15.150:0/221033917 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0714005c90 con 0x7f072c0d1020 2024-09-17T05:52:15.247 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:15.245+0000 7f0728ff9640 1 -- 172.21.15.150:0/221033917 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0714031e50 con 0x7f072c0d1020 2024-09-17T05:52:15.247 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:15.245+0000 7f0731e63640 1 -- 172.21.15.150:0/221033917 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f072c0cc850 con 0x7f072c0d1020 2024-09-17T05:52:15.247 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:15.245+0000 7f0728ff9640 1 -- 172.21.15.150:0/221033917 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0714005260 con 0x7f072c0d1020 2024-09-17T05:52:15.247 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:15.245+0000 7f0731e63640 1 -- 172.21.15.150:0/221033917 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f072c0cce10 con 0x7f072c0d1020 2024-09-17T05:52:15.248 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:15.246+0000 7f0731e63640 1 -- 172.21.15.150:0/221033917 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f072c0b4950 con 0x7f072c0d1020 2024-09-17T05:52:15.248 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:15.246+0000 7f0728ff9640 1 -- 172.21.15.150:0/221033917 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 42) ==== 104195+0+0 (secure 0 0 0) 0x7f0714005400 con 0x7f072c0d1020 2024-09-17T05:52:15.249 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:15.247+0000 7f0728ff9640 1 --2- 172.21.15.150:0/221033917 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f070c07aa20 0x7f070c07cf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:52:15.249 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:15.247+0000 7f0728ff9640 1 -- 172.21.15.150:0/221033917 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(119..119 src has 1..119) ==== 5111+0+0 (secure 0 0 0) 0x7f07140bad40 con 0x7f072c0d1020 2024-09-17T05:52:15.249 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:15.247+0000 7f072b7fe640 1 --2- 172.21.15.150:0/221033917 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f070c07aa20 0x7f070c07cf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:52:15.249 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:15.248+0000 7f072b7fe640 1 --2- 172.21.15.150:0/221033917 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f070c07aa20 0x7f070c07cf30 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7f071c005fd0 tx=0x7f071c009260 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:52:15.252 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:15.252+0000 7f0728ff9640 1 -- 172.21.15.150:0/221033917 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f071403f030 con 0x7f072c0d1020 2024-09-17T05:52:15.437 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:15.436+0000 7f0731e63640 1 -- 172.21.15.150:0/221033917 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) -- 0x7f072c0d1db0 con 0x7f072c0d1020 2024-09-17T05:52:15.867 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:15.866+0000 7f0728ff9640 1 -- 172.21.15.150:0/221033917 <== mon.0 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v121) ==== 97+0+0 (secure 0 0 0) 0x7f0714084c90 con 0x7f072c0d1020 2024-09-17T05:52:15.867 INFO:teuthology.orchestra.run.smithi150.stderr: removed all blocklist entries 2024-09-17T05:52:15.869 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:15.868+0000 7f0731e63640 1 -- 172.21.15.150:0/221033917 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f070c07aa20 msgr2=0x7f070c07cf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:52:15.869 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:15.868+0000 7f0731e63640 1 --2- 172.21.15.150:0/221033917 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f070c07aa20 0x7f070c07cf30 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7f071c005fd0 tx=0x7f071c009260 comp rx=0 tx=0).stop 2024-09-17T05:52:15.869 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:15.868+0000 7f0731e63640 1 -- 172.21.15.150:0/221033917 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f072c0d1020 msgr2=0x7f072c150990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:52:15.870 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:15.868+0000 7f0731e63640 1 --2- 172.21.15.150:0/221033917 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f072c0d1020 0x7f072c150990 secure :-1 s=READY pgs=1650 cs=0 l=1 rev1=1 crypto rx=0x7f07140098f0 tx=0x7f0714033c20 comp rx=0 tx=0).stop 2024-09-17T05:52:15.870 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:15.868+0000 7f0731e63640 1 -- 172.21.15.150:0/221033917 shutdown_connections 2024-09-17T05:52:15.870 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:15.868+0000 7f0731e63640 1 --2- 172.21.15.150:0/221033917 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f070c07aa20 0x7f070c07cf30 unknown :-1 s=CLOSED pgs=698 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:52:15.870 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:15.868+0000 7f0731e63640 1 --2- 172.21.15.150:0/221033917 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f072c0d50c0 0x7f072c0ca400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:52:15.870 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:15.868+0000 7f0731e63640 1 --2- 172.21.15.150:0/221033917 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f072c0d1020 0x7f072c150990 unknown :-1 s=CLOSED pgs=1650 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:52:15.870 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:15.868+0000 7f0731e63640 1 --2- 172.21.15.150:0/221033917 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f072c0b9d10 0x7f072c0ce3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:52:15.870 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:15.868+0000 7f0731e63640 1 -- 172.21.15.150:0/221033917 >> 172.21.15.150:0/221033917 conn(0x7f072c08bfe0 msgr2=0x7f072c0b7480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:52:15.870 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:15.869+0000 7f0731e63640 1 -- 172.21.15.150:0/221033917 shutdown_connections 2024-09-17T05:52:15.870 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:15.869+0000 7f0731e63640 1 -- 172.21.15.150:0/221033917 wait complete. 2024-09-17T05:52:15.882 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-09-17T05:52:15.997 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:15.996+0000 7f0b4c869640 1 -- 172.21.15.150:0/1003462638 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0b480b6420 msgr2=0x7f0b481665a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:52:15.997 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:15.996+0000 7f0b4c869640 1 --2- 172.21.15.150:0/1003462638 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0b480b6420 0x7f0b481665a0 secure :-1 s=READY pgs=1652 cs=0 l=1 rev1=1 crypto rx=0x7f0b40005fd0 tx=0x7f0b4002a940 comp rx=0 tx=0).stop 2024-09-17T05:52:15.997 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:15.996+0000 7f0b4c869640 1 -- 172.21.15.150:0/1003462638 shutdown_connections 2024-09-17T05:52:15.997 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:15.996+0000 7f0b4c869640 1 --2- 172.21.15.150:0/1003462638 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0b480b6420 0x7f0b481665a0 unknown :-1 s=CLOSED pgs=1652 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:52:15.997 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:15.996+0000 7f0b4c869640 1 -- 172.21.15.150:0/1003462638 >> 172.21.15.150:0/1003462638 conn(0x7f0b480b2fd0 msgr2=0x7f0b480b33e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:52:15.997 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:15.996+0000 7f0b4c869640 1 -- 172.21.15.150:0/1003462638 shutdown_connections 2024-09-17T05:52:15.998 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:15.996+0000 7f0b4c869640 1 -- 172.21.15.150:0/1003462638 wait complete. 2024-09-17T05:52:15.998 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:15.998+0000 7f0b4c869640 1 Processor -- start 2024-09-17T05:52:15.998 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:15.998+0000 7f0b4c869640 1 -- start start 2024-09-17T05:52:16.001 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:15.999+0000 7f0b4c869640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0b480b6420 0x7f0b48150410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:52:16.001 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:15.999+0000 7f0b4c869640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0b480cf7c0 0x7f0b480af450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:52:16.001 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:15.999+0000 7f0b4c869640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0b4815ee30 0x7f0b48154960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:52:16.001 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:15.999+0000 7f0b4c869640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f0b48166cf0 con 0x7f0b480b6420 2024-09-17T05:52:16.001 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:15.999+0000 7f0b4c869640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f0b480b6ae0 con 0x7f0b480cf7c0 2024-09-17T05:52:16.001 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:15.999+0000 7f0b4c869640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f0b48166e70 con 0x7f0b4815ee30 2024-09-17T05:52:16.001 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:15.999+0000 7f0b4659c640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0b480b6420 0x7f0b48150410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:52:16.001 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:15.999+0000 7f0b4659c640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0b480b6420 0x7f0b48150410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:42810/0 (socket says 172.21.15.150:42810) 2024-09-17T05:52:16.001 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:15.999+0000 7f0b4659c640 1 -- 172.21.15.150:0/206631086 learned_addr learned my addr 172.21.15.150:0/206631086 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:52:16.001 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:15.999+0000 7f0b45d9b640 1 --2- 172.21.15.150:0/206631086 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0b480cf7c0 0x7f0b480af450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:52:16.002 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:15.999+0000 7f0b46d9d640 1 --2- 172.21.15.150:0/206631086 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0b4815ee30 0x7f0b48154960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:52:16.002 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:15.999+0000 7f0b4659c640 1 -- 172.21.15.150:0/206631086 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0b4815ee30 msgr2=0x7f0b48154960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:52:16.002 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:15.999+0000 7f0b4659c640 1 --2- 172.21.15.150:0/206631086 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0b4815ee30 0x7f0b48154960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:52:16.002 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:15.999+0000 7f0b4659c640 1 -- 172.21.15.150:0/206631086 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0b480cf7c0 msgr2=0x7f0b480af450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:52:16.002 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:15.999+0000 7f0b4659c640 1 --2- 172.21.15.150:0/206631086 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0b480cf7c0 0x7f0b480af450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:52:16.002 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:15.999+0000 7f0b4659c640 1 -- 172.21.15.150:0/206631086 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0b481f6d10 con 0x7f0b480b6420 2024-09-17T05:52:16.002 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:16.000+0000 7f0b4659c640 1 --2- 172.21.15.150:0/206631086 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0b480b6420 0x7f0b48150410 secure :-1 s=READY pgs=1653 cs=0 l=1 rev1=1 crypto rx=0x7f0b3800c400 tx=0x7f0b3800c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:52:16.002 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:16.000+0000 7f0b36ffd640 1 -- 172.21.15.150:0/206631086 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b38017070 con 0x7f0b480b6420 2024-09-17T05:52:16.002 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:16.000+0000 7f0b4c869640 1 -- 172.21.15.150:0/206631086 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0b481f6fb0 con 0x7f0b480b6420 2024-09-17T05:52:16.002 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:16.000+0000 7f0b36ffd640 1 -- 172.21.15.150:0/206631086 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0b380053c0 con 0x7f0b480b6420 2024-09-17T05:52:16.002 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:16.000+0000 7f0b36ffd640 1 -- 172.21.15.150:0/206631086 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b38003830 con 0x7f0b480b6420 2024-09-17T05:52:16.002 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:16.000+0000 7f0b4c869640 1 -- 172.21.15.150:0/206631086 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0b481f7570 con 0x7f0b480b6420 2024-09-17T05:52:16.003 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:16.001+0000 7f0b4c869640 1 -- 172.21.15.150:0/206631086 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0b48071a50 con 0x7f0b480b6420 2024-09-17T05:52:16.003 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:16.002+0000 7f0b36ffd640 1 -- 172.21.15.150:0/206631086 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 42) ==== 104195+0+0 (secure 0 0 0) 0x7f0b3801a070 con 0x7f0b480b6420 2024-09-17T05:52:16.003 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:16.002+0000 7f0b36ffd640 1 --2- 172.21.15.150:0/206631086 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f0b2807aa20 0x7f0b2807cf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:52:16.003 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:16.002+0000 7f0b36ffd640 1 -- 172.21.15.150:0/206631086 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(123..123 src has 1..123) ==== 5025+0+0 (secure 0 0 0) 0x7f0b380990d0 con 0x7f0b480b6420 2024-09-17T05:52:16.004 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:16.002+0000 7f0b45d9b640 1 --2- 172.21.15.150:0/206631086 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f0b2807aa20 0x7f0b2807cf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:52:16.004 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:16.003+0000 7f0b45d9b640 1 --2- 172.21.15.150:0/206631086 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f0b2807aa20 0x7f0b2807cf30 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7f0b3c007fd0 tx=0x7f0b3c009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:52:16.007 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:16.007+0000 7f0b36ffd640 1 -- 172.21.15.150:0/206631086 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f0b481f6d10 con 0x7f0b480b6420 2024-09-17T05:52:16.249 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:16.248+0000 7f0b4c869640 1 -- 172.21.15.150:0/206631086 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) -- 0x7f0b480b2c60 con 0x7f0b480b6420 2024-09-17T05:52:16.251 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:16.248+0000 7f0b36ffd640 1 -- 172.21.15.150:0/206631086 <== mon.0 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v18) ==== 80+0+5304 (secure 0 0 0) 0x7f0b38062f90 con 0x7f0b480b6420 2024-09-17T05:52:16.251 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-09-17T05:52:16.252 INFO:teuthology.orchestra.run.smithi150.stdout:{ 2024-09-17T05:52:16.252 INFO:teuthology.orchestra.run.smithi150.stdout: "auth_dump": [ 2024-09-17T05:52:16.252 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-09-17T05:52:16.252 INFO:teuthology.orchestra.run.smithi150.stdout: "entity": "mds.a", 2024-09-17T05:52:16.252 INFO:teuthology.orchestra.run.smithi150.stdout: "key": "AQBoFulmMHALAxAAEO+QBgzbd+BNfhyY2qPiqw==", 2024-09-17T05:52:16.252 INFO:teuthology.orchestra.run.smithi150.stdout: "caps": { 2024-09-17T05:52:16.252 INFO:teuthology.orchestra.run.smithi150.stdout: "mds": "allow", 2024-09-17T05:52:16.252 INFO:teuthology.orchestra.run.smithi150.stdout: "mgr": "allow *", 2024-09-17T05:52:16.252 INFO:teuthology.orchestra.run.smithi150.stdout: "mon": "allow *", 2024-09-17T05:52:16.252 INFO:teuthology.orchestra.run.smithi150.stdout: "osd": "allow *" 2024-09-17T05:52:16.252 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-09-17T05:52:16.252 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-17T05:52:16.253 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-09-17T05:52:16.253 INFO:teuthology.orchestra.run.smithi150.stdout: "entity": "mds.b", 2024-09-17T05:52:16.253 INFO:teuthology.orchestra.run.smithi150.stdout: "key": "AQBoFulmtutmEBAAhKJEJQm181pL1lPmSSdYRQ==", 2024-09-17T05:52:16.253 INFO:teuthology.orchestra.run.smithi150.stdout: "caps": { 2024-09-17T05:52:16.253 INFO:teuthology.orchestra.run.smithi150.stdout: "mds": "allow", 2024-09-17T05:52:16.253 INFO:teuthology.orchestra.run.smithi150.stdout: "mgr": "allow *", 2024-09-17T05:52:16.253 INFO:teuthology.orchestra.run.smithi150.stdout: "mon": "allow *", 2024-09-17T05:52:16.253 INFO:teuthology.orchestra.run.smithi150.stdout: "osd": "allow *" 2024-09-17T05:52:16.253 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-09-17T05:52:16.253 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-17T05:52:16.253 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-09-17T05:52:16.253 INFO:teuthology.orchestra.run.smithi150.stdout: "entity": "mds.c", 2024-09-17T05:52:16.254 INFO:teuthology.orchestra.run.smithi150.stdout: "key": "AQBoFulmHTKsChAA4/fUb2NC+fMhR+xIYIDjgQ==", 2024-09-17T05:52:16.254 INFO:teuthology.orchestra.run.smithi150.stdout: "caps": { 2024-09-17T05:52:16.254 INFO:teuthology.orchestra.run.smithi150.stdout: "mds": "allow", 2024-09-17T05:52:16.254 INFO:teuthology.orchestra.run.smithi150.stdout: "mgr": "allow *", 2024-09-17T05:52:16.254 INFO:teuthology.orchestra.run.smithi150.stdout: "mon": "allow *", 2024-09-17T05:52:16.254 INFO:teuthology.orchestra.run.smithi150.stdout: "osd": "allow *" 2024-09-17T05:52:16.254 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-09-17T05:52:16.254 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-17T05:52:16.254 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-09-17T05:52:16.254 INFO:teuthology.orchestra.run.smithi150.stdout: "entity": "mds.d", 2024-09-17T05:52:16.254 INFO:teuthology.orchestra.run.smithi150.stdout: "key": "AQBoFulmr2s3GBAAhXzLVtObF/LwTpDIrY8MIQ==", 2024-09-17T05:52:16.254 INFO:teuthology.orchestra.run.smithi150.stdout: "caps": { 2024-09-17T05:52:16.254 INFO:teuthology.orchestra.run.smithi150.stdout: "mds": "allow", 2024-09-17T05:52:16.255 INFO:teuthology.orchestra.run.smithi150.stdout: "mgr": "allow *", 2024-09-17T05:52:16.255 INFO:teuthology.orchestra.run.smithi150.stdout: "mon": "allow *", 2024-09-17T05:52:16.255 INFO:teuthology.orchestra.run.smithi150.stdout: "osd": "allow *" 2024-09-17T05:52:16.255 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-09-17T05:52:16.255 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-17T05:52:16.255 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-09-17T05:52:16.255 INFO:teuthology.orchestra.run.smithi150.stdout: "entity": "osd.0", 2024-09-17T05:52:16.255 INFO:teuthology.orchestra.run.smithi150.stdout: "key": "AQBrFulm9eU0NRAAqgc1CtMOz+jDCHBn8coaVw==", 2024-09-17T05:52:16.255 INFO:teuthology.orchestra.run.smithi150.stdout: "caps": { 2024-09-17T05:52:16.255 INFO:teuthology.orchestra.run.smithi150.stdout: "mgr": "allow profile osd", 2024-09-17T05:52:16.255 INFO:teuthology.orchestra.run.smithi150.stdout: "mon": "allow profile osd", 2024-09-17T05:52:16.255 INFO:teuthology.orchestra.run.smithi150.stdout: "osd": "allow *" 2024-09-17T05:52:16.256 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-09-17T05:52:16.256 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-17T05:52:16.256 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-09-17T05:52:16.256 INFO:teuthology.orchestra.run.smithi150.stdout: "entity": "osd.1", 2024-09-17T05:52:16.256 INFO:teuthology.orchestra.run.smithi150.stdout: "key": "AQBvFulmlFL6CxAA8ByBraZue2FLfyZeOIpj3A==", 2024-09-17T05:52:16.256 INFO:teuthology.orchestra.run.smithi150.stdout: "caps": { 2024-09-17T05:52:16.256 INFO:teuthology.orchestra.run.smithi150.stdout: "mgr": "allow profile osd", 2024-09-17T05:52:16.256 INFO:teuthology.orchestra.run.smithi150.stdout: "mon": "allow profile osd", 2024-09-17T05:52:16.256 INFO:teuthology.orchestra.run.smithi150.stdout: "osd": "allow *" 2024-09-17T05:52:16.256 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-09-17T05:52:16.256 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-17T05:52:16.256 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-09-17T05:52:16.257 INFO:teuthology.orchestra.run.smithi150.stdout: "entity": "osd.2", 2024-09-17T05:52:16.257 INFO:teuthology.orchestra.run.smithi150.stdout: "key": "AQByFulmMQF5LBAAB4rbdIL6Zd+l4I4LDC/r3Q==", 2024-09-17T05:52:16.257 INFO:teuthology.orchestra.run.smithi150.stdout: "caps": { 2024-09-17T05:52:16.257 INFO:teuthology.orchestra.run.smithi150.stdout: "mgr": "allow profile osd", 2024-09-17T05:52:16.257 INFO:teuthology.orchestra.run.smithi150.stdout: "mon": "allow profile osd", 2024-09-17T05:52:16.257 INFO:teuthology.orchestra.run.smithi150.stdout: "osd": "allow *" 2024-09-17T05:52:16.257 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-09-17T05:52:16.257 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-17T05:52:16.257 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-09-17T05:52:16.257 INFO:teuthology.orchestra.run.smithi150.stdout: "entity": "osd.3", 2024-09-17T05:52:16.257 INFO:teuthology.orchestra.run.smithi150.stdout: "key": "AQB2Fulm5fjaAhAASnkpgsW79Sr9IIiy4HMm4g==", 2024-09-17T05:52:16.257 INFO:teuthology.orchestra.run.smithi150.stdout: "caps": { 2024-09-17T05:52:16.257 INFO:teuthology.orchestra.run.smithi150.stdout: "mgr": "allow profile osd", 2024-09-17T05:52:16.257 INFO:teuthology.orchestra.run.smithi150.stdout: "mon": "allow profile osd", 2024-09-17T05:52:16.258 INFO:teuthology.orchestra.run.smithi150.stdout: "osd": "allow *" 2024-09-17T05:52:16.258 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-09-17T05:52:16.258 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-17T05:52:16.258 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-09-17T05:52:16.258 INFO:teuthology.orchestra.run.smithi150.stdout: "entity": "osd.4", 2024-09-17T05:52:16.258 INFO:teuthology.orchestra.run.smithi150.stdout: "key": "AQB8Fulm9fWPGhAA9nNf+0znlS0Z7rqOvC47xQ==", 2024-09-17T05:52:16.258 INFO:teuthology.orchestra.run.smithi150.stdout: "caps": { 2024-09-17T05:52:16.258 INFO:teuthology.orchestra.run.smithi150.stdout: "mgr": "allow profile osd", 2024-09-17T05:52:16.258 INFO:teuthology.orchestra.run.smithi150.stdout: "mon": "allow profile osd", 2024-09-17T05:52:16.258 INFO:teuthology.orchestra.run.smithi150.stdout: "osd": "allow *" 2024-09-17T05:52:16.258 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-09-17T05:52:16.258 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-17T05:52:16.259 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-09-17T05:52:16.259 INFO:teuthology.orchestra.run.smithi150.stdout: "entity": "osd.5", 2024-09-17T05:52:16.259 INFO:teuthology.orchestra.run.smithi150.stdout: "key": "AQB/FulmeHakHRAASlnmKa0UTqVX+NSbmiHEBw==", 2024-09-17T05:52:16.259 INFO:teuthology.orchestra.run.smithi150.stdout: "caps": { 2024-09-17T05:52:16.259 INFO:teuthology.orchestra.run.smithi150.stdout: "mgr": "allow profile osd", 2024-09-17T05:52:16.259 INFO:teuthology.orchestra.run.smithi150.stdout: "mon": "allow profile osd", 2024-09-17T05:52:16.259 INFO:teuthology.orchestra.run.smithi150.stdout: "osd": "allow *" 2024-09-17T05:52:16.259 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-09-17T05:52:16.259 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-17T05:52:16.259 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-09-17T05:52:16.259 INFO:teuthology.orchestra.run.smithi150.stdout: "entity": "osd.6", 2024-09-17T05:52:16.259 INFO:teuthology.orchestra.run.smithi150.stdout: "key": "AQCCFulmEZF3IBAAhtpCanI6m8Kb3hyi+sRyyQ==", 2024-09-17T05:52:16.259 INFO:teuthology.orchestra.run.smithi150.stdout: "caps": { 2024-09-17T05:52:16.260 INFO:teuthology.orchestra.run.smithi150.stdout: "mgr": "allow profile osd", 2024-09-17T05:52:16.260 INFO:teuthology.orchestra.run.smithi150.stdout: "mon": "allow profile osd", 2024-09-17T05:52:16.260 INFO:teuthology.orchestra.run.smithi150.stdout: "osd": "allow *" 2024-09-17T05:52:16.260 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-09-17T05:52:16.260 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-17T05:52:16.260 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-09-17T05:52:16.260 INFO:teuthology.orchestra.run.smithi150.stdout: "entity": "osd.7", 2024-09-17T05:52:16.260 INFO:teuthology.orchestra.run.smithi150.stdout: "key": "AQCGFulmdcs7BRAAxsctes949cbkGkivdGpoYw==", 2024-09-17T05:52:16.260 INFO:teuthology.orchestra.run.smithi150.stdout: "caps": { 2024-09-17T05:52:16.260 INFO:teuthology.orchestra.run.smithi150.stdout: "mgr": "allow profile osd", 2024-09-17T05:52:16.260 INFO:teuthology.orchestra.run.smithi150.stdout: "mon": "allow profile osd", 2024-09-17T05:52:16.260 INFO:teuthology.orchestra.run.smithi150.stdout: "osd": "allow *" 2024-09-17T05:52:16.260 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-09-17T05:52:16.261 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-17T05:52:16.261 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-09-17T05:52:16.261 INFO:teuthology.orchestra.run.smithi150.stdout: "entity": "client.0", 2024-09-17T05:52:16.261 INFO:teuthology.orchestra.run.smithi150.stdout: "key": "AQBoFulmfF/1HBAAMezEjZDeoHTJ+uFfDXNWHQ==", 2024-09-17T05:52:16.261 INFO:teuthology.orchestra.run.smithi150.stdout: "caps": { 2024-09-17T05:52:16.261 INFO:teuthology.orchestra.run.smithi150.stdout: "mds": "allow", 2024-09-17T05:52:16.261 INFO:teuthology.orchestra.run.smithi150.stdout: "mon": "allow r", 2024-09-17T05:52:16.261 INFO:teuthology.orchestra.run.smithi150.stdout: "osd": "allow rw tag cephfs data=cephfs" 2024-09-17T05:52:16.261 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-09-17T05:52:16.261 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-17T05:52:16.261 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-09-17T05:52:16.261 INFO:teuthology.orchestra.run.smithi150.stdout: "entity": "client.1", 2024-09-17T05:52:16.261 INFO:teuthology.orchestra.run.smithi150.stdout: "key": "AQBoFulmv3GQJBAANlgjLqiCwzNfmBh8uClJ9A==", 2024-09-17T05:52:16.262 INFO:teuthology.orchestra.run.smithi150.stdout: "caps": { 2024-09-17T05:52:16.262 INFO:teuthology.orchestra.run.smithi150.stdout: "mds": "allow", 2024-09-17T05:52:16.262 INFO:teuthology.orchestra.run.smithi150.stdout: "mgr": "allow r", 2024-09-17T05:52:16.262 INFO:teuthology.orchestra.run.smithi150.stdout: "mon": "allow rw", 2024-09-17T05:52:16.262 INFO:teuthology.orchestra.run.smithi150.stdout: "osd": "allow rwx" 2024-09-17T05:52:16.262 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-09-17T05:52:16.262 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-17T05:52:16.262 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-09-17T05:52:16.262 INFO:teuthology.orchestra.run.smithi150.stdout: "entity": "client.2", 2024-09-17T05:52:16.262 INFO:teuthology.orchestra.run.smithi150.stdout: "key": "AQBoFulm1O/BIBAA8kfQL3/13SmZO1+y2tOZvw==", 2024-09-17T05:52:16.262 INFO:teuthology.orchestra.run.smithi150.stdout: "caps": { 2024-09-17T05:52:16.262 INFO:teuthology.orchestra.run.smithi150.stdout: "mds": "allow", 2024-09-17T05:52:16.262 INFO:teuthology.orchestra.run.smithi150.stdout: "mgr": "allow r", 2024-09-17T05:52:16.263 INFO:teuthology.orchestra.run.smithi150.stdout: "mon": "allow rw", 2024-09-17T05:52:16.263 INFO:teuthology.orchestra.run.smithi150.stdout: "osd": "allow rwx" 2024-09-17T05:52:16.263 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-09-17T05:52:16.263 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-17T05:52:16.263 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-09-17T05:52:16.263 INFO:teuthology.orchestra.run.smithi150.stdout: "entity": "client.3", 2024-09-17T05:52:16.263 INFO:teuthology.orchestra.run.smithi150.stdout: "key": "AQBoFulmF4hVKBAAZ5FGapBLLLtez3t8kON9dg==", 2024-09-17T05:52:16.263 INFO:teuthology.orchestra.run.smithi150.stdout: "caps": { 2024-09-17T05:52:16.263 INFO:teuthology.orchestra.run.smithi150.stdout: "mds": "allow", 2024-09-17T05:52:16.263 INFO:teuthology.orchestra.run.smithi150.stdout: "mgr": "allow r", 2024-09-17T05:52:16.263 INFO:teuthology.orchestra.run.smithi150.stdout: "mon": "allow rw", 2024-09-17T05:52:16.263 INFO:teuthology.orchestra.run.smithi150.stdout: "osd": "allow rwx" 2024-09-17T05:52:16.263 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-09-17T05:52:16.264 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-17T05:52:16.264 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-09-17T05:52:16.264 INFO:teuthology.orchestra.run.smithi150.stdout: "entity": "client.admin", 2024-09-17T05:52:16.264 INFO:teuthology.orchestra.run.smithi150.stdout: "key": "AQBnFulmaU9+IBAA7ZmXWZ44s0IpQ+C+Zw2V1g==", 2024-09-17T05:52:16.264 INFO:teuthology.orchestra.run.smithi150.stdout: "caps": { 2024-09-17T05:52:16.264 INFO:teuthology.orchestra.run.smithi150.stdout: "mds": "allow *", 2024-09-17T05:52:16.264 INFO:teuthology.orchestra.run.smithi150.stdout: "mgr": "allow *", 2024-09-17T05:52:16.264 INFO:teuthology.orchestra.run.smithi150.stdout: "mon": "allow *", 2024-09-17T05:52:16.264 INFO:teuthology.orchestra.run.smithi150.stdout: "osd": "allow *" 2024-09-17T05:52:16.264 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-09-17T05:52:16.264 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-17T05:52:16.264 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-09-17T05:52:16.264 INFO:teuthology.orchestra.run.smithi150.stdout: "entity": "mgr.x", 2024-09-17T05:52:16.265 INFO:teuthology.orchestra.run.smithi150.stdout: "key": "AQBnFulmEjvROhAAn3GZxCEtqPYLWopR1AcSFA==", 2024-09-17T05:52:16.265 INFO:teuthology.orchestra.run.smithi150.stdout: "caps": { 2024-09-17T05:52:16.265 INFO:teuthology.orchestra.run.smithi150.stdout: "mds": "allow *", 2024-09-17T05:52:16.265 INFO:teuthology.orchestra.run.smithi150.stdout: "mon": "allow profile mgr", 2024-09-17T05:52:16.265 INFO:teuthology.orchestra.run.smithi150.stdout: "osd": "allow *" 2024-09-17T05:52:16.265 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-09-17T05:52:16.265 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-17T05:52:16.265 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-09-17T05:52:16.265 INFO:teuthology.orchestra.run.smithi150.stdout: "entity": "mgr.y", 2024-09-17T05:52:16.265 INFO:teuthology.orchestra.run.smithi150.stdout: "key": "AQBnFulm9IkENhAA4uf1vzhYOepmovspN5/v1w==", 2024-09-17T05:52:16.265 INFO:teuthology.orchestra.run.smithi150.stdout: "caps": { 2024-09-17T05:52:16.265 INFO:teuthology.orchestra.run.smithi150.stdout: "mds": "allow *", 2024-09-17T05:52:16.265 INFO:teuthology.orchestra.run.smithi150.stdout: "mon": "allow profile mgr", 2024-09-17T05:52:16.266 INFO:teuthology.orchestra.run.smithi150.stdout: "osd": "allow *" 2024-09-17T05:52:16.266 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-09-17T05:52:16.266 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-09-17T05:52:16.266 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2024-09-17T05:52:16.266 INFO:teuthology.orchestra.run.smithi150.stdout:} 2024-09-17T05:52:16.267 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:16.250+0000 7f0b4c869640 1 -- 172.21.15.150:0/206631086 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f0b2807aa20 msgr2=0x7f0b2807cf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:52:16.267 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:16.250+0000 7f0b4c869640 1 --2- 172.21.15.150:0/206631086 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f0b2807aa20 0x7f0b2807cf30 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7f0b3c007fd0 tx=0x7f0b3c009040 comp rx=0 tx=0).stop 2024-09-17T05:52:16.267 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:16.250+0000 7f0b4c869640 1 -- 172.21.15.150:0/206631086 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0b480b6420 msgr2=0x7f0b48150410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:52:16.267 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:16.250+0000 7f0b4c869640 1 --2- 172.21.15.150:0/206631086 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0b480b6420 0x7f0b48150410 secure :-1 s=READY pgs=1653 cs=0 l=1 rev1=1 crypto rx=0x7f0b3800c400 tx=0x7f0b3800c8c0 comp rx=0 tx=0).stop 2024-09-17T05:52:16.267 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:16.250+0000 7f0b4c869640 1 -- 172.21.15.150:0/206631086 shutdown_connections 2024-09-17T05:52:16.267 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:16.250+0000 7f0b4c869640 1 --2- 172.21.15.150:0/206631086 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0b480cf7c0 0x7f0b480af450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:52:16.268 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:16.250+0000 7f0b4c869640 1 --2- 172.21.15.150:0/206631086 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f0b2807aa20 0x7f0b2807cf30 unknown :-1 s=CLOSED pgs=700 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:52:16.268 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:16.250+0000 7f0b4c869640 1 --2- 172.21.15.150:0/206631086 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0b4815ee30 0x7f0b48154960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:52:16.268 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:16.250+0000 7f0b4c869640 1 --2- 172.21.15.150:0/206631086 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0b480b6420 0x7f0b48150410 unknown :-1 s=CLOSED pgs=1653 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:52:16.268 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:16.250+0000 7f0b4c869640 1 -- 172.21.15.150:0/206631086 >> 172.21.15.150:0/206631086 conn(0x7f0b480b2fd0 msgr2=0x7f0b480b0c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:52:16.268 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:16.250+0000 7f0b4c869640 1 -- 172.21.15.150:0/206631086 shutdown_connections 2024-09-17T05:52:16.268 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:16.251+0000 7f0b4c869640 1 -- 172.21.15.150:0/206631086 wait complete. 2024-09-17T05:52:16.268 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-09-17T05:52:16.382 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:16.381+0000 7f7f5de8b640 1 -- 172.21.15.150:0/3764003048 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7f580707b0 msgr2=0x7f7f5806f930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:52:16.383 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:16.381+0000 7f7f5de8b640 1 --2- 172.21.15.150:0/3764003048 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7f580707b0 0x7f7f5806f930 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7f7f48009830 tx=0x7f7f4802a410 comp rx=0 tx=0).stop 2024-09-17T05:52:16.383 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:16.381+0000 7f7f5de8b640 1 -- 172.21.15.150:0/3764003048 shutdown_connections 2024-09-17T05:52:16.383 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:16.381+0000 7f7f5de8b640 1 --2- 172.21.15.150:0/3764003048 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7f580b4110 0x7f7f5806fe70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:52:16.383 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:16.381+0000 7f7f5de8b640 1 --2- 172.21.15.150:0/3764003048 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7f580707b0 0x7f7f5806f930 unknown :-1 s=CLOSED pgs=563 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:52:16.383 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:16.381+0000 7f7f5de8b640 1 -- 172.21.15.150:0/3764003048 >> 172.21.15.150:0/3764003048 conn(0x7f7f5806d730 msgr2=0x7f7f580b1e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:52:16.383 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:16.381+0000 7f7f5de8b640 1 -- 172.21.15.150:0/3764003048 shutdown_connections 2024-09-17T05:52:16.383 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:16.381+0000 7f7f5de8b640 1 -- 172.21.15.150:0/3764003048 wait complete. 2024-09-17T05:52:16.384 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:16.383+0000 7f7f5de8b640 1 Processor -- start 2024-09-17T05:52:16.384 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:16.383+0000 7f7f5de8b640 1 -- start start 2024-09-17T05:52:16.387 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:16.385+0000 7f7f5de8b640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7f580707b0 0x7f7f58098c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:52:16.387 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:16.385+0000 7f7f5de8b640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7f580730b0 0x7f7f5814b720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:52:16.387 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:16.385+0000 7f7f5de8b640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7f580b4110 0x7f7f5814bc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:52:16.387 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:16.385+0000 7f7f5de8b640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f7f5806f0a0 con 0x7f7f580b4110 2024-09-17T05:52:16.387 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:16.385+0000 7f7f5de8b640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f7f5815b230 con 0x7f7f580730b0 2024-09-17T05:52:16.387 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:16.385+0000 7f7f5de8b640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f7f5806f220 con 0x7f7f580707b0 2024-09-17T05:52:16.387 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:16.385+0000 7f7f57fff640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7f580b4110 0x7f7f5814bc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:52:16.387 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:16.385+0000 7f7f57fff640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7f580b4110 0x7f7f5814bc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:42812/0 (socket says 172.21.15.150:42812) 2024-09-17T05:52:16.387 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:16.385+0000 7f7f57fff640 1 -- 172.21.15.150:0/3827426911 learned_addr learned my addr 172.21.15.150:0/3827426911 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:52:16.387 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:16.385+0000 7f7f577fe640 1 --2- 172.21.15.150:0/3827426911 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7f580707b0 0x7f7f58098c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:52:16.387 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:16.385+0000 7f7f56ffd640 1 --2- 172.21.15.150:0/3827426911 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7f580730b0 0x7f7f5814b720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:52:16.387 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:16.385+0000 7f7f57fff640 1 -- 172.21.15.150:0/3827426911 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7f580707b0 msgr2=0x7f7f58098c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:52:16.388 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:16.385+0000 7f7f57fff640 1 --2- 172.21.15.150:0/3827426911 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7f580707b0 0x7f7f58098c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:52:16.388 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:16.385+0000 7f7f57fff640 1 -- 172.21.15.150:0/3827426911 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7f580730b0 msgr2=0x7f7f5814b720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:52:16.388 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:16.385+0000 7f7f57fff640 1 --2- 172.21.15.150:0/3827426911 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7f580730b0 0x7f7f5814b720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:52:16.388 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:16.385+0000 7f7f57fff640 1 -- 172.21.15.150:0/3827426911 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7f580992b0 con 0x7f7f580b4110 2024-09-17T05:52:16.388 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:16.385+0000 7f7f57fff640 1 --2- 172.21.15.150:0/3827426911 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7f580b4110 0x7f7f5814bc60 secure :-1 s=READY pgs=1655 cs=0 l=1 rev1=1 crypto rx=0x7f7f5000ec20 tx=0x7f7f5000c6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:52:16.388 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:16.385+0000 7f7f3ffff640 1 -- 172.21.15.150:0/3827426911 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f50003b70 con 0x7f7f580b4110 2024-09-17T05:52:16.388 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:16.386+0000 7f7f3ffff640 1 -- 172.21.15.150:0/3827426911 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f7f50003d10 con 0x7f7f580b4110 2024-09-17T05:52:16.388 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:16.386+0000 7f7f5de8b640 1 -- 172.21.15.150:0/3827426911 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7f581487a0 con 0x7f7f580b4110 2024-09-17T05:52:16.388 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:16.386+0000 7f7f3ffff640 1 -- 172.21.15.150:0/3827426911 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f50004280 con 0x7f7f580b4110 2024-09-17T05:52:16.388 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:16.386+0000 7f7f5de8b640 1 -- 172.21.15.150:0/3827426911 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7f58148a40 con 0x7f7f580b4110 2024-09-17T05:52:16.389 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:16.386+0000 7f7f5de8b640 1 -- 172.21.15.150:0/3827426911 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7f58099520 con 0x7f7f580b4110 2024-09-17T05:52:16.389 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:16.387+0000 7f7f3ffff640 1 -- 172.21.15.150:0/3827426911 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 42) ==== 104195+0+0 (secure 0 0 0) 0x7f7f50004420 con 0x7f7f580b4110 2024-09-17T05:52:16.389 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:16.388+0000 7f7f3ffff640 1 --2- 172.21.15.150:0/3827426911 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f7f4407aa20 0x7f7f4407cf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:52:16.389 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:16.388+0000 7f7f3ffff640 1 -- 172.21.15.150:0/3827426911 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(123..123 src has 1..123) ==== 5025+0+0 (secure 0 0 0) 0x7f7f5009a840 con 0x7f7f580b4110 2024-09-17T05:52:16.389 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:16.388+0000 7f7f577fe640 1 --2- 172.21.15.150:0/3827426911 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f7f4407aa20 0x7f7f4407cf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:52:16.390 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:16.389+0000 7f7f577fe640 1 --2- 172.21.15.150:0/3827426911 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f7f4407aa20 0x7f7f4407cf30 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7f7f48034000 tx=0x7f7f48004730 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:52:16.393 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:16.392+0000 7f7f3ffff640 1 -- 172.21.15.150:0/3827426911 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f7f50064140 con 0x7f7f580b4110 2024-09-17T05:52:16.569 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:16.568+0000 7f7f5de8b640 1 -- 172.21.15.150:0/3827426911 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7f7f5806f720 con 0x7f7f580b4110 2024-09-17T05:52:16.569 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:16.568+0000 7f7f3ffff640 1 -- 172.21.15.150:0/3827426911 <== mon.0 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v123) ==== 84+0+65 (secure 0 0 0) 0x7f7f50068b70 con 0x7f7f580b4110 2024-09-17T05:52:16.569 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-09-17T05:52:16.570 INFO:teuthology.orchestra.run.smithi150.stdout:[ 2024-09-17T05:52:16.570 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-09-17T05:52:16.570 INFO:teuthology.orchestra.run.smithi150.stdout: "poolnum": 1, 2024-09-17T05:52:16.570 INFO:teuthology.orchestra.run.smithi150.stdout: "poolname": ".mgr" 2024-09-17T05:52:16.570 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-09-17T05:52:16.570 INFO:teuthology.orchestra.run.smithi150.stdout:] 2024-09-17T05:52:16.572 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:16.570+0000 7f7f5de8b640 1 -- 172.21.15.150:0/3827426911 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f7f4407aa20 msgr2=0x7f7f4407cf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:52:16.572 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:16.570+0000 7f7f5de8b640 1 --2- 172.21.15.150:0/3827426911 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f7f4407aa20 0x7f7f4407cf30 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7f7f48034000 tx=0x7f7f48004730 comp rx=0 tx=0).stop 2024-09-17T05:52:16.572 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:16.571+0000 7f7f5de8b640 1 -- 172.21.15.150:0/3827426911 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7f580b4110 msgr2=0x7f7f5814bc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:52:16.572 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:16.571+0000 7f7f5de8b640 1 --2- 172.21.15.150:0/3827426911 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7f580b4110 0x7f7f5814bc60 secure :-1 s=READY pgs=1655 cs=0 l=1 rev1=1 crypto rx=0x7f7f5000ec20 tx=0x7f7f5000c6a0 comp rx=0 tx=0).stop 2024-09-17T05:52:16.572 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:16.571+0000 7f7f5de8b640 1 -- 172.21.15.150:0/3827426911 shutdown_connections 2024-09-17T05:52:16.572 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:16.571+0000 7f7f5de8b640 1 --2- 172.21.15.150:0/3827426911 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7f580730b0 0x7f7f5814b720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:52:16.572 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:16.571+0000 7f7f5de8b640 1 --2- 172.21.15.150:0/3827426911 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f7f4407aa20 0x7f7f4407cf30 unknown :-1 s=CLOSED pgs=701 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:52:16.572 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:16.571+0000 7f7f5de8b640 1 --2- 172.21.15.150:0/3827426911 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7f580b4110 0x7f7f5814bc60 unknown :-1 s=CLOSED pgs=1655 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:52:16.572 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:16.571+0000 7f7f5de8b640 1 --2- 172.21.15.150:0/3827426911 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7f580707b0 0x7f7f58098c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:52:16.572 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:16.571+0000 7f7f5de8b640 1 -- 172.21.15.150:0/3827426911 >> 172.21.15.150:0/3827426911 conn(0x7f7f5806d730 msgr2=0x7f7f581595a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:52:16.572 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:16.571+0000 7f7f5de8b640 1 -- 172.21.15.150:0/3827426911 shutdown_connections 2024-09-17T05:52:16.572 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:16.571+0000 7f7f5de8b640 1 -- 172.21.15.150:0/3827426911 wait complete. 2024-09-17T05:52:16.583 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-09-17T05:52:16.583 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-09-17T05:52:16.701 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:16.700+0000 7f3ba6ddf640 1 -- 172.21.15.150:0/4060219676 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3ba00b42f0 msgr2=0x7f3ba015cfc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:52:16.701 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:16.700+0000 7f3ba6ddf640 1 --2- 172.21.15.150:0/4060219676 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3ba00b42f0 0x7f3ba015cfc0 secure :-1 s=READY pgs=1656 cs=0 l=1 rev1=1 crypto rx=0x7f3ba00aeed0 tx=0x7f3b9c02a5f0 comp rx=0 tx=0).stop 2024-09-17T05:52:16.702 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:16.700+0000 7f3ba6ddf640 1 -- 172.21.15.150:0/4060219676 shutdown_connections 2024-09-17T05:52:16.702 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:16.700+0000 7f3ba6ddf640 1 --2- 172.21.15.150:0/4060219676 >> v2:172.21.15.176:3300/0 conn(0x7f3ba00b5d20 0x7f3ba015be90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:52:16.702 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:16.700+0000 7f3ba6ddf640 1 --2- 172.21.15.150:0/4060219676 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3ba00b42f0 0x7f3ba015cfc0 unknown :-1 s=CLOSED pgs=1656 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:52:16.702 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:16.700+0000 7f3ba6ddf640 1 -- 172.21.15.150:0/4060219676 >> 172.21.15.150:0/4060219676 conn(0x7f3ba009aa50 msgr2=0x7f3ba00b2ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:52:16.702 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:16.700+0000 7f3ba6ddf640 1 -- 172.21.15.150:0/4060219676 shutdown_connections 2024-09-17T05:52:16.702 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:16.700+0000 7f3ba6ddf640 1 -- 172.21.15.150:0/4060219676 wait complete. 2024-09-17T05:52:16.702 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:16.702+0000 7f3ba6ddf640 1 Processor -- start 2024-09-17T05:52:16.703 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:16.702+0000 7f3ba6ddf640 1 -- start start 2024-09-17T05:52:16.705 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:16.703+0000 7f3ba6ddf640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3ba00b42f0 0x7f3ba00d0140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:52:16.706 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:16.703+0000 7f3ba6ddf640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3ba015ba80 0x7f3ba013a460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:52:16.706 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:16.704+0000 7f3ba6ddf640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3ba013d970 0x7f3ba013cd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:52:16.706 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:16.704+0000 7f3ba6ddf640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f3ba00af9f0 con 0x7f3ba00b42f0 2024-09-17T05:52:16.706 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:16.704+0000 7f3ba6ddf640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f3ba00af870 con 0x7f3ba013d970 2024-09-17T05:52:16.706 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:16.704+0000 7f3ba6ddf640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f3ba00afb70 con 0x7f3ba015ba80 2024-09-17T05:52:16.706 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:16.704+0000 7f3ba4b7b640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3ba00b42f0 0x7f3ba00d0140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:52:16.706 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:16.704+0000 7f3ba4b7b640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3ba00b42f0 0x7f3ba00d0140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:42838/0 (socket says 172.21.15.150:42838) 2024-09-17T05:52:16.706 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:16.704+0000 7f3ba4b7b640 1 -- 172.21.15.150:0/857553696 learned_addr learned my addr 172.21.15.150:0/857553696 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:52:16.706 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:16.704+0000 7f3ba537c640 1 --2- 172.21.15.150:0/857553696 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3ba013d970 0x7f3ba013cd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:52:16.706 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:16.704+0000 7f3b97fff640 1 --2- 172.21.15.150:0/857553696 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3ba015ba80 0x7f3ba013a460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:52:16.706 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:16.704+0000 7f3ba4b7b640 1 -- 172.21.15.150:0/857553696 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3ba015ba80 msgr2=0x7f3ba013a460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:52:16.707 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:16.704+0000 7f3ba4b7b640 1 --2- 172.21.15.150:0/857553696 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3ba015ba80 0x7f3ba013a460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:52:16.707 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:16.704+0000 7f3ba4b7b640 1 -- 172.21.15.150:0/857553696 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3ba013d970 msgr2=0x7f3ba013cd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:52:16.707 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:16.704+0000 7f3ba4b7b640 1 --2- 172.21.15.150:0/857553696 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3ba013d970 0x7f3ba013cd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:52:16.707 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:16.704+0000 7f3ba4b7b640 1 -- 172.21.15.150:0/857553696 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3ba013af50 con 0x7f3ba00b42f0 2024-09-17T05:52:16.707 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:16.704+0000 7f3ba4b7b640 1 --2- 172.21.15.150:0/857553696 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3ba00b42f0 0x7f3ba00d0140 secure :-1 s=READY pgs=1657 cs=0 l=1 rev1=1 crypto rx=0x7f3b9c0099c0 tx=0x7f3b9c0038a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:52:16.707 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:16.704+0000 7f3b957fa640 1 -- 172.21.15.150:0/857553696 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b9c03e030 con 0x7f3ba00b42f0 2024-09-17T05:52:16.707 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:16.704+0000 7f3b957fa640 1 -- 172.21.15.150:0/857553696 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f3b9c003db0 con 0x7f3ba00b42f0 2024-09-17T05:52:16.707 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:16.704+0000 7f3ba6ddf640 1 -- 172.21.15.150:0/857553696 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3ba013b230 con 0x7f3ba00b42f0 2024-09-17T05:52:16.707 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:16.704+0000 7f3b957fa640 1 -- 172.21.15.150:0/857553696 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b9c035040 con 0x7f3ba00b42f0 2024-09-17T05:52:16.707 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:16.704+0000 7f3ba6ddf640 1 -- 172.21.15.150:0/857553696 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3ba013b7f0 con 0x7f3ba00b42f0 2024-09-17T05:52:16.708 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:16.705+0000 7f3ba6ddf640 1 -- 172.21.15.150:0/857553696 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3ba0069630 con 0x7f3ba00b42f0 2024-09-17T05:52:16.708 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:16.706+0000 7f3b957fa640 1 -- 172.21.15.150:0/857553696 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 42) ==== 104195+0+0 (secure 0 0 0) 0x7f3b9c041030 con 0x7f3ba00b42f0 2024-09-17T05:52:16.708 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:16.707+0000 7f3b957fa640 1 --2- 172.21.15.150:0/857553696 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f3b8c07a9f0 0x7f3b8c07cf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:52:16.708 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:16.707+0000 7f3b957fa640 1 -- 172.21.15.150:0/857553696 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(123..123 src has 1..123) ==== 5025+0+0 (secure 0 0 0) 0x7f3b9c0ba6c0 con 0x7f3ba00b42f0 2024-09-17T05:52:16.708 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:16.707+0000 7f3b97fff640 1 --2- 172.21.15.150:0/857553696 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f3b8c07a9f0 0x7f3b8c07cf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:52:16.708 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:16.707+0000 7f3b97fff640 1 --2- 172.21.15.150:0/857553696 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f3b8c07a9f0 0x7f3b8c07cf00 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 crypto rx=0x7f3ba014edc0 tx=0x7f3b90009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:52:16.712 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:16.711+0000 7f3b957fa640 1 -- 172.21.15.150:0/857553696 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f3ba0069630 con 0x7f3ba00b42f0 2024-09-17T05:52:16.893 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:16.892+0000 7f3ba6ddf640 1 -- 172.21.15.150:0/857553696 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7f3ba006d900 con 0x7f3ba00b42f0 2024-09-17T05:52:17.874 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:17.873+0000 7f3b957fa640 1 -- 172.21.15.150:0/857553696 <== mon.0 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v124) ==== 138+0+0 (secure 0 0 0) 0x7f3ba006d900 con 0x7f3ba00b42f0 2024-09-17T05:52:17.874 INFO:teuthology.orchestra.run.smithi150.stderr:pool 'cephfs_metadata' created 2024-09-17T05:52:17.878 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:17.877+0000 7f3ba6ddf640 1 -- 172.21.15.150:0/857553696 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f3b8c07a9f0 msgr2=0x7f3b8c07cf00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:52:17.878 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:17.877+0000 7f3ba6ddf640 1 --2- 172.21.15.150:0/857553696 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f3b8c07a9f0 0x7f3b8c07cf00 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 crypto rx=0x7f3ba014edc0 tx=0x7f3b90009040 comp rx=0 tx=0).stop 2024-09-17T05:52:17.878 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:17.877+0000 7f3ba6ddf640 1 -- 172.21.15.150:0/857553696 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3ba00b42f0 msgr2=0x7f3ba00d0140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:52:17.878 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:17.877+0000 7f3ba6ddf640 1 --2- 172.21.15.150:0/857553696 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3ba00b42f0 0x7f3ba00d0140 secure :-1 s=READY pgs=1657 cs=0 l=1 rev1=1 crypto rx=0x7f3b9c0099c0 tx=0x7f3b9c0038a0 comp rx=0 tx=0).stop 2024-09-17T05:52:17.879 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:17.878+0000 7f3ba6ddf640 1 -- 172.21.15.150:0/857553696 shutdown_connections 2024-09-17T05:52:17.879 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:17.878+0000 7f3ba6ddf640 1 --2- 172.21.15.150:0/857553696 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3ba013d970 0x7f3ba013cd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:52:17.879 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:17.878+0000 7f3ba6ddf640 1 --2- 172.21.15.150:0/857553696 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f3b8c07a9f0 0x7f3b8c07cf00 unknown :-1 s=CLOSED pgs=702 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:52:17.879 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:17.878+0000 7f3ba6ddf640 1 --2- 172.21.15.150:0/857553696 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3ba015ba80 0x7f3ba013a460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:52:17.879 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:17.878+0000 7f3ba6ddf640 1 --2- 172.21.15.150:0/857553696 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3ba00b42f0 0x7f3ba00d0140 unknown :-1 s=CLOSED pgs=1657 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:52:17.879 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:17.878+0000 7f3ba6ddf640 1 -- 172.21.15.150:0/857553696 >> 172.21.15.150:0/857553696 conn(0x7f3ba009aa50 msgr2=0x7f3ba015b0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:52:17.879 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:17.879+0000 7f3ba6ddf640 1 -- 172.21.15.150:0/857553696 shutdown_connections 2024-09-17T05:52:17.880 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:17.879+0000 7f3ba6ddf640 1 -- 172.21.15.150:0/857553696 wait complete. 2024-09-17T05:52:17.897 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-09-17T05:52:18.024 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:18.022+0000 7f885bd71640 1 -- 172.21.15.150:0/1759633364 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f88540d5150 msgr2=0x7f88540b9b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:52:18.025 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:18.022+0000 7f885bd71640 1 --2- 172.21.15.150:0/1759633364 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f88540d5150 0x7f88540b9b10 secure :-1 s=READY pgs=1659 cs=0 l=1 rev1=1 crypto rx=0x7f88540cfd10 tx=0x7f884402a9f0 comp rx=0 tx=0).stop 2024-09-17T05:52:18.025 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:18.022+0000 7f885bd71640 1 -- 172.21.15.150:0/1759633364 shutdown_connections 2024-09-17T05:52:18.025 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:18.022+0000 7f885bd71640 1 --2- 172.21.15.150:0/1759633364 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f885406dea0 0x7f88540d0020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:52:18.025 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:18.022+0000 7f885bd71640 1 --2- 172.21.15.150:0/1759633364 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f88540d5150 0x7f88540b9b10 unknown :-1 s=CLOSED pgs=1659 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:52:18.025 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:18.022+0000 7f885bd71640 1 -- 172.21.15.150:0/1759633364 >> 172.21.15.150:0/1759633364 conn(0x7f885408bfe0 msgr2=0x7f88540d46e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:52:18.025 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:18.022+0000 7f885bd71640 1 -- 172.21.15.150:0/1759633364 shutdown_connections 2024-09-17T05:52:18.025 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:18.022+0000 7f885bd71640 1 -- 172.21.15.150:0/1759633364 wait complete. 2024-09-17T05:52:18.026 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:18.024+0000 7f885bd71640 1 Processor -- start 2024-09-17T05:52:18.026 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:18.024+0000 7f885bd71640 1 -- start start 2024-09-17T05:52:18.028 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:18.025+0000 7f885bd71640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f885406dea0 0x7f88540b5420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:52:18.029 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:18.025+0000 7f885bd71640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f885406e2b0 0x7f885415c4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:52:18.029 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:18.025+0000 7f885bd71640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f88540d5150 0x7f885415d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:52:18.029 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:18.026+0000 7f885bd71640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f88540ba1a0 con 0x7f885406dea0 2024-09-17T05:52:18.029 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:18.026+0000 7f885bd71640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f88540d31e0 con 0x7f885406e2b0 2024-09-17T05:52:18.029 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:18.026+0000 7f885bd71640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f88540b6870 con 0x7f88540d5150 2024-09-17T05:52:18.029 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:18.026+0000 7f8859b0d640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f885406dea0 0x7f88540b5420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:52:18.029 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:18.026+0000 7f8859b0d640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f885406dea0 0x7f88540b5420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:42844/0 (socket says 172.21.15.150:42844) 2024-09-17T05:52:18.029 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:18.026+0000 7f8859b0d640 1 -- 172.21.15.150:0/798596924 learned_addr learned my addr 172.21.15.150:0/798596924 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:52:18.029 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:18.026+0000 7f885930c640 1 --2- 172.21.15.150:0/798596924 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f885406e2b0 0x7f885415c4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:52:18.029 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:18.026+0000 7f885a30e640 1 --2- 172.21.15.150:0/798596924 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f88540d5150 0x7f885415d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:52:18.029 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:18.026+0000 7f8859b0d640 1 -- 172.21.15.150:0/798596924 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f88540d5150 msgr2=0x7f885415d990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:52:18.029 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:18.026+0000 7f8859b0d640 1 --2- 172.21.15.150:0/798596924 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f88540d5150 0x7f885415d990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:52:18.030 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:18.026+0000 7f8859b0d640 1 -- 172.21.15.150:0/798596924 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f885406e2b0 msgr2=0x7f885415c4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:52:18.030 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:18.026+0000 7f8859b0d640 1 --2- 172.21.15.150:0/798596924 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f885406e2b0 0x7f885415c4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:52:18.030 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:18.026+0000 7f8859b0d640 1 -- 172.21.15.150:0/798596924 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f88540b3e30 con 0x7f885406dea0 2024-09-17T05:52:18.030 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:18.026+0000 7f8859b0d640 1 --2- 172.21.15.150:0/798596924 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f885406dea0 0x7f88540b5420 secure :-1 s=READY pgs=1660 cs=0 l=1 rev1=1 crypto rx=0x7f8844009d50 tx=0x7f8844003f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:52:18.030 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:18.026+0000 7f88527fc640 1 -- 172.21.15.150:0/798596924 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8844033050 con 0x7f885406dea0 2024-09-17T05:52:18.030 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:18.026+0000 7f88527fc640 1 -- 172.21.15.150:0/798596924 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8844004570 con 0x7f885406dea0 2024-09-17T05:52:18.030 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:18.026+0000 7f885bd71640 1 -- 172.21.15.150:0/798596924 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f88540b4110 con 0x7f885406dea0 2024-09-17T05:52:18.030 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:18.026+0000 7f88527fc640 1 -- 172.21.15.150:0/798596924 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8844038450 con 0x7f885406dea0 2024-09-17T05:52:18.030 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:18.026+0000 7f885bd71640 1 -- 172.21.15.150:0/798596924 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f88540b46d0 con 0x7f885406dea0 2024-09-17T05:52:18.031 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:18.027+0000 7f885bd71640 1 -- 172.21.15.150:0/798596924 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f88540d0020 con 0x7f885406dea0 2024-09-17T05:52:18.031 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:18.028+0000 7f88527fc640 1 -- 172.21.15.150:0/798596924 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 42) ==== 104195+0+0 (secure 0 0 0) 0x7f8844036070 con 0x7f885406dea0 2024-09-17T05:52:18.031 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:18.029+0000 7f88527fc640 1 --2- 172.21.15.150:0/798596924 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f884007aa20 0x7f884007cf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:52:18.031 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:18.029+0000 7f88527fc640 1 -- 172.21.15.150:0/798596924 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(124..124 src has 1..124) ==== 5395+0+0 (secure 0 0 0) 0x7f88440bb290 con 0x7f885406dea0 2024-09-17T05:52:18.031 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:18.029+0000 7f885930c640 1 --2- 172.21.15.150:0/798596924 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f884007aa20 0x7f884007cf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:52:18.032 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:18.030+0000 7f885930c640 1 --2- 172.21.15.150:0/798596924 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f884007aa20 0x7f884007cf30 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7f88540c7d70 tx=0x7f884800b2e0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:52:18.034 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:18.033+0000 7f88527fc640 1 -- 172.21.15.150:0/798596924 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f8844084b80 con 0x7f885406dea0 2024-09-17T05:52:18.210 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:18.208+0000 7f885bd71640 1 -- 172.21.15.150:0/798596924 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7f88540d4f30 con 0x7f885406dea0 2024-09-17T05:52:18.877 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:18.875+0000 7f88527fc640 1 -- 172.21.15.150:0/798596924 <== mon.0 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v125) ==== 170+0+0 (secure 0 0 0) 0x7f88440895b0 con 0x7f885406dea0 2024-09-17T05:52:18.877 INFO:teuthology.orchestra.run.smithi150.stderr:pool 'cephfs_data' created 2024-09-17T05:52:18.881 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:18.878+0000 7f885bd71640 1 -- 172.21.15.150:0/798596924 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f884007aa20 msgr2=0x7f884007cf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:52:18.881 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:18.878+0000 7f885bd71640 1 --2- 172.21.15.150:0/798596924 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f884007aa20 0x7f884007cf30 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7f88540c7d70 tx=0x7f884800b2e0 comp rx=0 tx=0).stop 2024-09-17T05:52:18.881 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:18.878+0000 7f885bd71640 1 -- 172.21.15.150:0/798596924 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f885406dea0 msgr2=0x7f88540b5420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:52:18.881 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:18.878+0000 7f885bd71640 1 --2- 172.21.15.150:0/798596924 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f885406dea0 0x7f88540b5420 secure :-1 s=READY pgs=1660 cs=0 l=1 rev1=1 crypto rx=0x7f8844009d50 tx=0x7f8844003f90 comp rx=0 tx=0).stop 2024-09-17T05:52:18.881 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:18.878+0000 7f885bd71640 1 -- 172.21.15.150:0/798596924 shutdown_connections 2024-09-17T05:52:18.881 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:18.878+0000 7f885bd71640 1 --2- 172.21.15.150:0/798596924 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f885406e2b0 0x7f885415c4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:52:18.881 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:18.878+0000 7f885bd71640 1 --2- 172.21.15.150:0/798596924 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f884007aa20 0x7f884007cf30 unknown :-1 s=CLOSED pgs=706 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:52:18.881 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:18.878+0000 7f885bd71640 1 --2- 172.21.15.150:0/798596924 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f88540d5150 0x7f885415d990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:52:18.881 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:18.878+0000 7f885bd71640 1 --2- 172.21.15.150:0/798596924 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f885406dea0 0x7f88540b5420 unknown :-1 s=CLOSED pgs=1660 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:52:18.881 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:18.878+0000 7f885bd71640 1 -- 172.21.15.150:0/798596924 >> 172.21.15.150:0/798596924 conn(0x7f885408bfe0 msgr2=0x7f885406f990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:52:18.881 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:18.879+0000 7f885bd71640 1 -- 172.21.15.150:0/798596924 shutdown_connections 2024-09-17T05:52:18.882 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:18.879+0000 7f885bd71640 1 -- 172.21.15.150:0/798596924 wait complete. 2024-09-17T05:52:18.912 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-09-17T05:52:19.033 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:19.031+0000 7fb928264640 1 -- 172.21.15.150:0/4069484245 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb9200b25e0 msgr2=0x7fb9200b1ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:52:19.034 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:19.031+0000 7fb928264640 1 --2- 172.21.15.150:0/4069484245 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb9200b25e0 0x7fb9200b1ec0 secure :-1 s=READY pgs=1662 cs=0 l=1 rev1=1 crypto rx=0x7fb91c005fd0 tx=0x7fb91c02a560 comp rx=0 tx=0).stop 2024-09-17T05:52:19.034 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:19.031+0000 7fb928264640 1 -- 172.21.15.150:0/4069484245 shutdown_connections 2024-09-17T05:52:19.034 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:19.031+0000 7fb928264640 1 --2- 172.21.15.150:0/4069484245 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb9200b25e0 0x7fb9200b1ec0 unknown :-1 s=CLOSED pgs=1662 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:52:19.034 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:19.031+0000 7fb928264640 1 -- 172.21.15.150:0/4069484245 >> 172.21.15.150:0/4069484245 conn(0x7fb9200b2ff0 msgr2=0x7fb9200b3400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:52:19.034 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:19.031+0000 7fb928264640 1 -- 172.21.15.150:0/4069484245 shutdown_connections 2024-09-17T05:52:19.034 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:19.031+0000 7fb928264640 1 -- 172.21.15.150:0/4069484245 wait complete. 2024-09-17T05:52:19.035 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:19.033+0000 7fb928264640 1 Processor -- start 2024-09-17T05:52:19.035 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:19.033+0000 7fb928264640 1 -- start start 2024-09-17T05:52:19.038 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:19.034+0000 7fb928264640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb9200b0fe0 0x7fb920159830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:52:19.038 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:19.034+0000 7fb928264640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb9200b25e0 0x7fb9200cd1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:52:19.038 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:19.034+0000 7fb928264640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb9200cf390 0x7fb9200cd700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:52:19.039 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:19.035+0000 7fb928264640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7fb920166cf0 con 0x7fb9200b0fe0 2024-09-17T05:52:19.039 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:19.035+0000 7fb928264640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fb9200d0280 con 0x7fb9200cf390 2024-09-17T05:52:19.039 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:19.035+0000 7fb928264640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fb920166e70 con 0x7fb9200b25e0 2024-09-17T05:52:19.039 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:19.035+0000 7fb926000640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb9200b0fe0 0x7fb920159830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:52:19.039 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:19.035+0000 7fb926000640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb9200b0fe0 0x7fb920159830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:42850/0 (socket says 172.21.15.150:42850) 2024-09-17T05:52:19.039 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:19.035+0000 7fb926000640 1 -- 172.21.15.150:0/1764371021 learned_addr learned my addr 172.21.15.150:0/1764371021 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:52:19.039 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:19.035+0000 7fb926801640 1 --2- 172.21.15.150:0/1764371021 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb9200cf390 0x7fb9200cd700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:52:19.039 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:19.035+0000 7fb9257ff640 1 --2- 172.21.15.150:0/1764371021 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb9200b25e0 0x7fb9200cd1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:52:19.039 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:19.035+0000 7fb926000640 1 -- 172.21.15.150:0/1764371021 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb9200b25e0 msgr2=0x7fb9200cd1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:52:19.039 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:19.035+0000 7fb926000640 1 --2- 172.21.15.150:0/1764371021 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb9200b25e0 0x7fb9200cd1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:52:19.039 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:19.035+0000 7fb926000640 1 -- 172.21.15.150:0/1764371021 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb9200cf390 msgr2=0x7fb9200cd700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:52:19.040 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:19.035+0000 7fb926000640 1 --2- 172.21.15.150:0/1764371021 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb9200cf390 0x7fb9200cd700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:52:19.040 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:19.035+0000 7fb926000640 1 -- 172.21.15.150:0/1764371021 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb9200ca750 con 0x7fb9200b0fe0 2024-09-17T05:52:19.040 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:19.035+0000 7fb926000640 1 --2- 172.21.15.150:0/1764371021 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb9200b0fe0 0x7fb920159830 secure :-1 s=READY pgs=1663 cs=0 l=1 rev1=1 crypto rx=0x7fb91c034040 tx=0x7fb91c003910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:52:19.040 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:19.035+0000 7fb9167fc640 1 -- 172.21.15.150:0/1764371021 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb91c03e030 con 0x7fb9200b0fe0 2024-09-17T05:52:19.040 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:19.035+0000 7fb9167fc640 1 -- 172.21.15.150:0/1764371021 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb91c003e00 con 0x7fb9200b0fe0 2024-09-17T05:52:19.040 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:19.035+0000 7fb9167fc640 1 -- 172.21.15.150:0/1764371021 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb91c035040 con 0x7fb9200b0fe0 2024-09-17T05:52:19.040 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:19.035+0000 7fb928264640 1 -- 172.21.15.150:0/1764371021 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb9200caa30 con 0x7fb9200b0fe0 2024-09-17T05:52:19.040 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:19.035+0000 7fb928264640 1 -- 172.21.15.150:0/1764371021 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb9200caff0 con 0x7fb9200b0fe0 2024-09-17T05:52:19.040 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:19.036+0000 7fb928264640 1 -- 172.21.15.150:0/1764371021 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb9200b1ec0 con 0x7fb9200b0fe0 2024-09-17T05:52:19.041 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:19.037+0000 7fb9167fc640 1 -- 172.21.15.150:0/1764371021 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 42) ==== 104195+0+0 (secure 0 0 0) 0x7fb91c041030 con 0x7fb9200b0fe0 2024-09-17T05:52:19.041 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:19.038+0000 7fb9167fc640 1 --2- 172.21.15.150:0/1764371021 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fb90407aa20 0x7fb90407cf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:52:19.041 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:19.038+0000 7fb9167fc640 1 -- 172.21.15.150:0/1764371021 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(125..125 src has 1..125) ==== 5777+0+0 (secure 0 0 0) 0x7fb91c0ba850 con 0x7fb9200b0fe0 2024-09-17T05:52:19.041 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:19.038+0000 7fb9257ff640 1 --2- 172.21.15.150:0/1764371021 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fb90407aa20 0x7fb90407cf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:52:19.041 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:19.038+0000 7fb9257ff640 1 --2- 172.21.15.150:0/1764371021 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fb90407aa20 0x7fb90407cf30 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x7fb920069930 tx=0x7fb910009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:52:19.043 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:19.042+0000 7fb9167fc640 1 -- 172.21.15.150:0/1764371021 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fb91c084220 con 0x7fb9200b0fe0 2024-09-17T05:52:19.256 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:19.255+0000 7fb928264640 1 -- 172.21.15.150:0/1764371021 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7fb9200b18c0 con 0x7fb9200b0fe0 2024-09-17T05:52:19.904 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:19.902+0000 7fb9167fc640 1 -- 172.21.15.150:0/1764371021 <== mon.0 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 18 and data pool 19 v76) ==== 174+0+0 (secure 0 0 0) 0x7fb91c088c50 con 0x7fb9200b0fe0 2024-09-17T05:52:19.904 INFO:teuthology.orchestra.run.smithi150.stderr:new fs with metadata pool 18 and data pool 19 2024-09-17T05:52:19.916 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:19.914+0000 7fb928264640 1 -- 172.21.15.150:0/1764371021 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fb90407aa20 msgr2=0x7fb90407cf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:52:19.916 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:19.914+0000 7fb928264640 1 --2- 172.21.15.150:0/1764371021 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fb90407aa20 0x7fb90407cf30 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x7fb920069930 tx=0x7fb910009040 comp rx=0 tx=0).stop 2024-09-17T05:52:19.916 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:19.914+0000 7fb928264640 1 -- 172.21.15.150:0/1764371021 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb9200b0fe0 msgr2=0x7fb920159830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:52:19.917 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:19.914+0000 7fb928264640 1 --2- 172.21.15.150:0/1764371021 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb9200b0fe0 0x7fb920159830 secure :-1 s=READY pgs=1663 cs=0 l=1 rev1=1 crypto rx=0x7fb91c034040 tx=0x7fb91c003910 comp rx=0 tx=0).stop 2024-09-17T05:52:19.918 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:19.916+0000 7fb928264640 1 -- 172.21.15.150:0/1764371021 shutdown_connections 2024-09-17T05:52:19.918 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:19.916+0000 7fb928264640 1 --2- 172.21.15.150:0/1764371021 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb9200cf390 0x7fb9200cd700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:52:19.918 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:19.916+0000 7fb928264640 1 --2- 172.21.15.150:0/1764371021 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fb90407aa20 0x7fb90407cf30 unknown :-1 s=CLOSED pgs=707 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:52:19.918 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:19.916+0000 7fb928264640 1 --2- 172.21.15.150:0/1764371021 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb9200b25e0 0x7fb9200cd1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:52:19.918 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:19.916+0000 7fb928264640 1 --2- 172.21.15.150:0/1764371021 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb9200b0fe0 0x7fb920159830 unknown :-1 s=CLOSED pgs=1663 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:52:19.918 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:19.916+0000 7fb928264640 1 -- 172.21.15.150:0/1764371021 >> 172.21.15.150:0/1764371021 conn(0x7fb9200b2ff0 msgr2=0x7fb920162c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:52:19.920 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:19.917+0000 7fb928264640 1 -- 172.21.15.150:0/1764371021 shutdown_connections 2024-09-17T05:52:19.920 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:19.918+0000 7fb928264640 1 -- 172.21.15.150:0/1764371021 wait complete. 2024-09-17T05:52:19.940 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T05:52:20.056 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:20.054+0000 7ff0b91e4640 1 -- 172.21.15.150:0/2729527516 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff0b40b9780 msgr2=0x7ff0b40b3720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:52:20.101 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:20.054+0000 7ff0b91e4640 1 --2- 172.21.15.150:0/2729527516 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff0b40b9780 0x7ff0b40b3720 secure :-1 s=READY pgs=1664 cs=0 l=1 rev1=1 crypto rx=0x7ff0b40d5740 tx=0x7ff0a402a4b0 comp rx=0 tx=0).stop 2024-09-17T05:52:20.101 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:20.055+0000 7ff0b91e4640 1 -- 172.21.15.150:0/2729527516 shutdown_connections 2024-09-17T05:52:20.101 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:20.055+0000 7ff0b91e4640 1 --2- 172.21.15.150:0/2729527516 >> v2:172.21.15.176:3300/0 conn(0x7ff0b40d17a0 0x7ff0b40cf470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:52:20.101 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:20.055+0000 7ff0b91e4640 1 --2- 172.21.15.150:0/2729527516 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff0b40b9780 0x7ff0b40b3720 unknown :-1 s=CLOSED pgs=1664 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:52:20.101 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:20.055+0000 7ff0b91e4640 1 -- 172.21.15.150:0/2729527516 >> 172.21.15.150:0/2729527516 conn(0x7ff0b40d4680 msgr2=0x7ff0b40d4a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:52:20.101 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:20.055+0000 7ff0b91e4640 1 -- 172.21.15.150:0/2729527516 shutdown_connections 2024-09-17T05:52:20.101 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:20.055+0000 7ff0b91e4640 1 -- 172.21.15.150:0/2729527516 wait complete. 2024-09-17T05:52:20.104 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:20.057+0000 7ff0b91e4640 1 Processor -- start 2024-09-17T05:52:20.104 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:20.057+0000 7ff0b91e4640 1 -- start start 2024-09-17T05:52:20.104 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:20.058+0000 7ff0b91e4640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff0b40b9780 0x7ff0b406ecd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:52:20.104 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:20.058+0000 7ff0b91e4640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff0b415ee50 0x7ff0b40b6620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:52:20.104 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:20.058+0000 7ff0b91e4640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff0b406f210 0x7ff0b415ff30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:52:20.104 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:20.058+0000 7ff0b91e4640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7ff0b40cfd40 con 0x7ff0b406f210 2024-09-17T05:52:20.105 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:20.058+0000 7ff0b91e4640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7ff0b40cfbc0 con 0x7ff0b40b9780 2024-09-17T05:52:20.105 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:20.058+0000 7ff0b91e4640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7ff0b40cfec0 con 0x7ff0b415ee50 2024-09-17T05:52:20.105 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:20.058+0000 7ff0b359e640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff0b406f210 0x7ff0b415ff30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:52:20.105 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:20.058+0000 7ff0b359e640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff0b406f210 0x7ff0b415ff30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:42872/0 (socket says 172.21.15.150:42872) 2024-09-17T05:52:20.105 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:20.058+0000 7ff0b359e640 1 -- 172.21.15.150:0/3937000841 learned_addr learned my addr 172.21.15.150:0/3937000841 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:52:20.105 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:20.058+0000 7ff0b2d9d640 1 --2- 172.21.15.150:0/3937000841 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff0b40b9780 0x7ff0b406ecd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:52:20.105 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:20.058+0000 7ff0b259c640 1 --2- 172.21.15.150:0/3937000841 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff0b415ee50 0x7ff0b40b6620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:52:20.105 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:20.058+0000 7ff0b359e640 1 -- 172.21.15.150:0/3937000841 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff0b415ee50 msgr2=0x7ff0b40b6620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:52:20.105 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:20.058+0000 7ff0b359e640 1 --2- 172.21.15.150:0/3937000841 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff0b415ee50 0x7ff0b40b6620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:52:20.105 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:20.058+0000 7ff0b359e640 1 -- 172.21.15.150:0/3937000841 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff0b40b9780 msgr2=0x7ff0b406ecd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:52:20.105 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:20.058+0000 7ff0b359e640 1 --2- 172.21.15.150:0/3937000841 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff0b40b9780 0x7ff0b406ecd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:52:20.105 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:20.058+0000 7ff0b359e640 1 -- 172.21.15.150:0/3937000841 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff0b41f5e50 con 0x7ff0b406f210 2024-09-17T05:52:20.105 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:20.058+0000 7ff0b259c640 1 --2- 172.21.15.150:0/3937000841 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff0b415ee50 0x7ff0b40b6620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:52:20.106 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:20.059+0000 7ff0b359e640 1 --2- 172.21.15.150:0/3937000841 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff0b406f210 0x7ff0b415ff30 secure :-1 s=READY pgs=1665 cs=0 l=1 rev1=1 crypto rx=0x7ff0ac00b9e0 tx=0x7ff0ac00bea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:52:20.106 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:20.059+0000 7ff09b7fe640 1 -- 172.21.15.150:0/3937000841 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0ac019070 con 0x7ff0b406f210 2024-09-17T05:52:20.106 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:20.059+0000 7ff09b7fe640 1 -- 172.21.15.150:0/3937000841 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff0ac00cc30 con 0x7ff0b406f210 2024-09-17T05:52:20.106 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:20.059+0000 7ff0b91e4640 1 -- 172.21.15.150:0/3937000841 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff0b41f6130 con 0x7ff0b406f210 2024-09-17T05:52:20.106 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:20.059+0000 7ff09b7fe640 1 -- 172.21.15.150:0/3937000841 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0ac0146a0 con 0x7ff0b406f210 2024-09-17T05:52:20.106 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:20.059+0000 7ff0b91e4640 1 -- 172.21.15.150:0/3937000841 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff0b41f66f0 con 0x7ff0b406f210 2024-09-17T05:52:20.106 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:20.060+0000 7ff0b91e4640 1 -- 172.21.15.150:0/3937000841 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff0b408d100 con 0x7ff0b406f210 2024-09-17T05:52:20.106 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:20.061+0000 7ff09b7fe640 1 -- 172.21.15.150:0/3937000841 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 42) ==== 104195+0+0 (secure 0 0 0) 0x7ff0ac01c070 con 0x7ff0b406f210 2024-09-17T05:52:20.106 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:20.061+0000 7ff09b7fe640 1 --2- 172.21.15.150:0/3937000841 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7ff0a007a9f0 0x7ff0a007cf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:52:20.106 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:20.061+0000 7ff09b7fe640 1 -- 172.21.15.150:0/3937000841 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(126..126 src has 1..126) ==== 5877+0+0 (secure 0 0 0) 0x7ff0ac099970 con 0x7ff0b406f210 2024-09-17T05:52:20.106 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:20.061+0000 7ff0b2d9d640 1 --2- 172.21.15.150:0/3937000841 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7ff0a007a9f0 0x7ff0a007cf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:52:20.106 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:20.062+0000 7ff0b2d9d640 1 --2- 172.21.15.150:0/3937000841 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7ff0a007a9f0 0x7ff0a007cf00 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7ff0a4034000 tx=0x7ff0a4004730 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:52:20.106 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:20.066+0000 7ff09b7fe640 1 -- 172.21.15.150:0/3937000841 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7ff0b408d100 con 0x7ff0b406f210 2024-09-17T05:52:20.246 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:20.245+0000 7ff0b91e4640 1 -- 172.21.15.150:0/3937000841 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7ff0b40b3720 con 0x7ff0b406f210 2024-09-17T05:52:20.248 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:20.246+0000 7ff09b7fe640 1 -- 172.21.15.150:0/3937000841 <== mon.0 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v126) ==== 74+0+17055 (secure 0 0 0) 0x7ff0ac00ce20 con 0x7ff0b406f210 2024-09-17T05:52:20.248 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-09-17T05:52:20.249 INFO:teuthology.orchestra.run.smithi150.stdout:{"epoch":126,"fsid":"9f2e05e9-d629-47b3-b26b-1360655b7d20","created":"2024-09-17T05:41:32.502979+0000","modified":"2024-09-17T05:52:19.257158+0000","last_up_change":"2024-09-17T05:41:46.150225+0000","last_in_change":"2024-09-17T05:41:36.120274+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":19,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T05:41:46.860779+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":18,"pool_name":"cephfs_metadata","create_time":"2024-09-17T05:52:16.897390+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"126","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":19,"pool_name":"cephfs_data","create_time":"2024-09-17T05:52:18.214964+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"126","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"4f31c018-c8a4-4d6d-b0c2-a597c47aae4a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":125,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6800","nonce":479374392},{"type":"v1","addr":"172.21.15.150:6801","nonce":479374392}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6802","nonce":479374392},{"type":"v1","addr":"172.21.15.150:6803","nonce":479374392}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6806","nonce":479374392},{"type":"v1","addr":"172.21.15.150:6807","nonce":479374392}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6804","nonce":479374392},{"type":"v1","addr":"172.21.15.150:6805","nonce":479374392}]},"public_addr":"172.21.15.150:6801/479374392","cluster_addr":"172.21.15.150:6803/479374392","heartbeat_back_addr":"172.21.15.150:6807/479374392","heartbeat_front_addr":"172.21.15.150:6805/479374392","state":["exists","up"]},{"osd":1,"uuid":"6ff4a573-500b-4e04-9de3-39265ead78b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":125,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6824","nonce":913899800},{"type":"v1","addr":"172.21.15.150:6825","nonce":913899800}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6826","nonce":913899800},{"type":"v1","addr":"172.21.15.150:6827","nonce":913899800}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6830","nonce":913899800},{"type":"v1","addr":"172.21.15.150:6831","nonce":913899800}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6828","nonce":913899800},{"type":"v1","addr":"172.21.15.150:6829","nonce":913899800}]},"public_addr":"172.21.15.150:6825/913899800","cluster_addr":"172.21.15.150:6827/913899800","heartbeat_back_addr":"172.21.15.150:6831/913899800","heartbeat_front_addr":"172.21.15.150:6829/913899800","state":["exists","up"]},{"osd":2,"uuid":"bffea6f9-2465-4182-b205-00436c41ac1c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":125,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6816","nonce":363718461},{"type":"v1","addr":"172.21.15.150:6817","nonce":363718461}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6818","nonce":363718461},{"type":"v1","addr":"172.21.15.150:6819","nonce":363718461}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6822","nonce":363718461},{"type":"v1","addr":"172.21.15.150:6823","nonce":363718461}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6820","nonce":363718461},{"type":"v1","addr":"172.21.15.150:6821","nonce":363718461}]},"public_addr":"172.21.15.150:6817/363718461","cluster_addr":"172.21.15.150:6819/363718461","heartbeat_back_addr":"172.21.15.150:6823/363718461","heartbeat_front_addr":"172.21.15.150:6821/363718461","state":["exists","up"]},{"osd":3,"uuid":"cda70430-d1e1-427e-b04e-56db4031d078","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":125,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6808","nonce":3550994626},{"type":"v1","addr":"172.21.15.150:6809","nonce":3550994626}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6810","nonce":3550994626},{"type":"v1","addr":"172.21.15.150:6811","nonce":3550994626}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6814","nonce":3550994626},{"type":"v1","addr":"172.21.15.150:6815","nonce":3550994626}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6812","nonce":3550994626},{"type":"v1","addr":"172.21.15.150:6813","nonce":3550994626}]},"public_addr":"172.21.15.150:6809/3550994626","cluster_addr":"172.21.15.150:6811/3550994626","heartbeat_back_addr":"172.21.15.150:6815/3550994626","heartbeat_front_addr":"172.21.15.150:6813/3550994626","state":["exists","up"]},{"osd":4,"uuid":"3a0277fb-5e1e-4f68-bb2d-9a8a0152f64a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":125,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6810","nonce":2718261497},{"type":"v1","addr":"172.21.15.176:6811","nonce":2718261497}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6812","nonce":2718261497},{"type":"v1","addr":"172.21.15.176:6813","nonce":2718261497}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6816","nonce":2718261497},{"type":"v1","addr":"172.21.15.176:6817","nonce":2718261497}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6814","nonce":2718261497},{"type":"v1","addr":"172.21.15.176:6815","nonce":2718261497}]},"public_addr":"172.21.15.176:6811/2718261497","cluster_addr":"172.21.15.176:6813/2718261497","heartbeat_back_addr":"172.21.15.176:6817/2718261497","heartbeat_front_addr":"172.21.15.176:6815/2718261497","state":["exists","up"]},{"osd":5,"uuid":"33aebee6-0315-40b7-a11c-6702f0be494d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":125,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6818","nonce":2049295774},{"type":"v1","addr":"172.21.15.176:6819","nonce":2049295774}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6820","nonce":2049295774},{"type":"v1","addr":"172.21.15.176:6821","nonce":2049295774}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6824","nonce":2049295774},{"type":"v1","addr":"172.21.15.176:6825","nonce":2049295774}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6822","nonce":2049295774},{"type":"v1","addr":"172.21.15.176:6823","nonce":2049295774}]},"public_addr":"172.21.15.176:6819/2049295774","cluster_addr":"172.21.15.176:6821/2049295774","heartbeat_back_addr":"172.21.15.176:6825/2049295774","heartbeat_front_addr":"172.21.15.176:6823/2049295774","state":["exists","up"]},{"osd":6,"uuid":"4d24f360-6751-4263-841b-d77793d33540","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":125,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6826","nonce":2164458476},{"type":"v1","addr":"172.21.15.176:6827","nonce":2164458476}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6828","nonce":2164458476},{"type":"v1","addr":"172.21.15.176:6829","nonce":2164458476}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6832","nonce":2164458476},{"type":"v1","addr":"172.21.15.176:6833","nonce":2164458476}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6830","nonce":2164458476},{"type":"v1","addr":"172.21.15.176:6831","nonce":2164458476}]},"public_addr":"172.21.15.176:6827/2164458476","cluster_addr":"172.21.15.176:6829/2164458476","heartbeat_back_addr":"172.21.15.176:6833/2164458476","heartbeat_front_addr":"172.21.15.176:6831/2164458476","state":["exists","up"]},{"osd":7,"uuid":"c8594fda-c74a-4ba9-8277-caf101d58ca1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":125,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6802","nonce":3239587708},{"type":"v1","addr":"172.21.15.176:6803","nonce":3239587708}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6804","nonce":3239587708},{"type":"v1","addr":"172.21.15.176:6805","nonce":3239587708}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6808","nonce":3239587708},{"type":"v1","addr":"172.21.15.176:6809","nonce":3239587708}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6806","nonce":3239587708},{"type":"v1","addr":"172.21.15.176:6807","nonce":3239587708}]},"public_addr":"172.21.15.176:6803/3239587708","cluster_addr":"172.21.15.176:6805/3239587708","heartbeat_back_addr":"172.21.15.176:6809/3239587708","heartbeat_front_addr":"172.21.15.176:6807/3239587708","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:41:41.905151+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:41:42.705679+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:41:42.459673+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:41:42.440819+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:41:42.668428+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:41:42.694972+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:41:43.078535+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:41:42.363539+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":7,"snaps":[{"begin":2,"length":2}]},{"pool":9,"snaps":[{"begin":2,"length":2}]},{"pool":11,"snaps":[{"begin":2,"length":2}]},{"pool":13,"snaps":[{"begin":2,"length":2}]},{"pool":15,"snaps":[{"begin":2,"length":2}]},{"pool":17,"snaps":[{"begin":2,"length":2}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T05:52:20.250 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:20.248+0000 7ff0b91e4640 1 -- 172.21.15.150:0/3937000841 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7ff0a007a9f0 msgr2=0x7ff0a007cf00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:52:20.250 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:20.248+0000 7ff0b91e4640 1 --2- 172.21.15.150:0/3937000841 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7ff0a007a9f0 0x7ff0a007cf00 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7ff0a4034000 tx=0x7ff0a4004730 comp rx=0 tx=0).stop 2024-09-17T05:52:20.250 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:20.248+0000 7ff0b91e4640 1 -- 172.21.15.150:0/3937000841 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff0b406f210 msgr2=0x7ff0b415ff30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:52:20.251 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:20.248+0000 7ff0b91e4640 1 --2- 172.21.15.150:0/3937000841 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff0b406f210 0x7ff0b415ff30 secure :-1 s=READY pgs=1665 cs=0 l=1 rev1=1 crypto rx=0x7ff0ac00b9e0 tx=0x7ff0ac00bea0 comp rx=0 tx=0).stop 2024-09-17T05:52:20.251 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:20.248+0000 7ff0b91e4640 1 -- 172.21.15.150:0/3937000841 shutdown_connections 2024-09-17T05:52:20.251 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:20.248+0000 7ff0b91e4640 1 --2- 172.21.15.150:0/3937000841 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7ff0a007a9f0 0x7ff0a007cf00 unknown :-1 s=CLOSED pgs=708 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:52:20.251 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:20.248+0000 7ff0b91e4640 1 --2- 172.21.15.150:0/3937000841 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff0b406f210 0x7ff0b415ff30 unknown :-1 s=CLOSED pgs=1665 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:52:20.251 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:20.248+0000 7ff0b91e4640 1 --2- 172.21.15.150:0/3937000841 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff0b415ee50 0x7ff0b40b6620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:52:20.251 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:20.248+0000 7ff0b91e4640 1 --2- 172.21.15.150:0/3937000841 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff0b40b9780 0x7ff0b406ecd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:52:20.251 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:20.248+0000 7ff0b91e4640 1 -- 172.21.15.150:0/3937000841 >> 172.21.15.150:0/3937000841 conn(0x7ff0b40d4680 msgr2=0x7ff0b40b89c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:52:20.251 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:20.249+0000 7ff0b91e4640 1 -- 172.21.15.150:0/3937000841 shutdown_connections 2024-09-17T05:52:20.251 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:20.249+0000 7ff0b91e4640 1 -- 172.21.15.150:0/3937000841 wait complete. 2024-09-17T05:52:20.263 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T05:52:20.375 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:20.373+0000 7fc8c0a7e640 1 -- 172.21.15.150:0/2853101934 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc8bc0715c0 msgr2=0x7fc8bc1666c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:52:20.376 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:20.373+0000 7fc8c0a7e640 1 --2- 172.21.15.150:0/2853101934 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc8bc0715c0 0x7fc8bc1666c0 secure :-1 s=READY pgs=1667 cs=0 l=1 rev1=1 crypto rx=0x7fc8b4005fd0 tx=0x7fc8b402a940 comp rx=0 tx=0).stop 2024-09-17T05:52:20.376 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:20.373+0000 7fc8c0a7e640 1 -- 172.21.15.150:0/2853101934 shutdown_connections 2024-09-17T05:52:20.376 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:20.373+0000 7fc8c0a7e640 1 --2- 172.21.15.150:0/2853101934 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc8bc0715c0 0x7fc8bc1666c0 unknown :-1 s=CLOSED pgs=1667 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:52:20.376 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:20.373+0000 7fc8c0a7e640 1 -- 172.21.15.150:0/2853101934 >> 172.21.15.150:0/2853101934 conn(0x7fc8bc0d0b50 msgr2=0x7fc8bc0d0f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:52:20.376 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:20.373+0000 7fc8c0a7e640 1 -- 172.21.15.150:0/2853101934 shutdown_connections 2024-09-17T05:52:20.376 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:20.373+0000 7fc8c0a7e640 1 -- 172.21.15.150:0/2853101934 wait complete. 2024-09-17T05:52:20.377 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:20.375+0000 7fc8c0a7e640 1 Processor -- start 2024-09-17T05:52:20.377 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:20.376+0000 7fc8c0a7e640 1 -- start start 2024-09-17T05:52:20.380 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:20.377+0000 7fc8c0a7e640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc8bc0715c0 0x7fc8bc159f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:52:20.380 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:20.377+0000 7fc8c0a7e640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc8bc0cd040 0x7fc8bc14e5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:52:20.380 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:20.377+0000 7fc8c0a7e640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc8bc1528b0 0x7fc8bc155440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:52:20.380 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:20.377+0000 7fc8c0a7e640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7fc8bc166f90 con 0x7fc8bc0cd040 2024-09-17T05:52:20.381 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:20.377+0000 7fc8c0a7e640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fc8bc166e10 con 0x7fc8bc0715c0 2024-09-17T05:52:20.381 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:20.377+0000 7fc8c0a7e640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fc8bc167110 con 0x7fc8bc1528b0 2024-09-17T05:52:20.381 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:20.377+0000 7fc8b1d9b640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc8bc0cd040 0x7fc8bc14e5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:52:20.381 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:20.377+0000 7fc8b1d9b640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc8bc0cd040 0x7fc8bc14e5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:35646/0 (socket says 172.21.15.150:35646) 2024-09-17T05:52:20.381 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:20.377+0000 7fc8b1d9b640 1 -- 172.21.15.150:0/1950390528 learned_addr learned my addr 172.21.15.150:0/1950390528 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:52:20.381 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:20.377+0000 7fc8ba59c640 1 --2- 172.21.15.150:0/1950390528 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc8bc0715c0 0x7fc8bc159f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:52:20.381 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:20.377+0000 7fc8bad9d640 1 --2- 172.21.15.150:0/1950390528 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc8bc1528b0 0x7fc8bc155440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:52:20.381 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:20.377+0000 7fc8b1d9b640 1 -- 172.21.15.150:0/1950390528 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc8bc1528b0 msgr2=0x7fc8bc155440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:52:20.381 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:20.377+0000 7fc8b1d9b640 1 --2- 172.21.15.150:0/1950390528 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc8bc1528b0 0x7fc8bc155440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:52:20.381 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:20.377+0000 7fc8b1d9b640 1 -- 172.21.15.150:0/1950390528 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc8bc0715c0 msgr2=0x7fc8bc159f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:52:20.382 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:20.377+0000 7fc8b1d9b640 1 --2- 172.21.15.150:0/1950390528 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc8bc0715c0 0x7fc8bc159f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:52:20.382 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:20.377+0000 7fc8b1d9b640 1 -- 172.21.15.150:0/1950390528 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc8bc154680 con 0x7fc8bc0cd040 2024-09-17T05:52:20.382 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:20.377+0000 7fc8ba59c640 1 --2- 172.21.15.150:0/1950390528 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc8bc0715c0 0x7fc8bc159f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T05:52:20.382 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:20.378+0000 7fc8b1d9b640 1 --2- 172.21.15.150:0/1950390528 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc8bc0cd040 0x7fc8bc14e5c0 secure :-1 s=READY pgs=1668 cs=0 l=1 rev1=1 crypto rx=0x7fc8a400e6a0 tx=0x7fc8a400eb60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:52:20.382 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:20.378+0000 7fc8b37fe640 1 -- 172.21.15.150:0/1950390528 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8a40052d0 con 0x7fc8bc0cd040 2024-09-17T05:52:20.382 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:20.378+0000 7fc8b37fe640 1 -- 172.21.15.150:0/1950390528 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc8a400c850 con 0x7fc8bc0cd040 2024-09-17T05:52:20.382 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:20.378+0000 7fc8c0a7e640 1 -- 172.21.15.150:0/1950390528 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc8bc154960 con 0x7fc8bc0cd040 2024-09-17T05:52:20.382 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:20.378+0000 7fc8b37fe640 1 -- 172.21.15.150:0/1950390528 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8a400cca0 con 0x7fc8bc0cd040 2024-09-17T05:52:20.382 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:20.378+0000 7fc8c0a7e640 1 -- 172.21.15.150:0/1950390528 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc8bc154f20 con 0x7fc8bc0cd040 2024-09-17T05:52:20.382 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:20.379+0000 7fc8c0a7e640 1 -- 172.21.15.150:0/1950390528 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc8bc1572f0 con 0x7fc8bc0cd040 2024-09-17T05:52:20.383 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:20.380+0000 7fc8b37fe640 1 -- 172.21.15.150:0/1950390528 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 42) ==== 104195+0+0 (secure 0 0 0) 0x7fc8a40035f0 con 0x7fc8bc0cd040 2024-09-17T05:52:20.383 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:20.380+0000 7fc8b37fe640 1 --2- 172.21.15.150:0/1950390528 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fc89c07a9f0 0x7fc89c07cf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:52:20.383 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:20.380+0000 7fc8b37fe640 1 -- 172.21.15.150:0/1950390528 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(126..126 src has 1..126) ==== 5877+0+0 (secure 0 0 0) 0x7fc8a409c0b0 con 0x7fc8bc0cd040 2024-09-17T05:52:20.383 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:20.380+0000 7fc8ba59c640 1 --2- 172.21.15.150:0/1950390528 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fc89c07a9f0 0x7fc89c07cf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:52:20.383 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:20.381+0000 7fc8ba59c640 1 --2- 172.21.15.150:0/1950390528 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fc89c07a9f0 0x7fc89c07cf00 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7fc8ac000f60 tx=0x7fc8ac009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:52:20.386 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:20.385+0000 7fc8b37fe640 1 -- 172.21.15.150:0/1950390528 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fc8a4016020 con 0x7fc8bc0cd040 2024-09-17T05:52:20.561 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:20.559+0000 7fc8c0a7e640 1 -- 172.21.15.150:0/1950390528 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fc8bc15f330 con 0x7fc8bc0cd040 2024-09-17T05:52:20.562 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:20.560+0000 7fc8b37fe640 1 -- 172.21.15.150:0/1950390528 <== mon.0 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v126) ==== 74+0+17055 (secure 0 0 0) 0x7fc8a4066080 con 0x7fc8bc0cd040 2024-09-17T05:52:20.563 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-09-17T05:52:20.563 INFO:teuthology.orchestra.run.smithi150.stdout:{"epoch":126,"fsid":"9f2e05e9-d629-47b3-b26b-1360655b7d20","created":"2024-09-17T05:41:32.502979+0000","modified":"2024-09-17T05:52:19.257158+0000","last_up_change":"2024-09-17T05:41:46.150225+0000","last_in_change":"2024-09-17T05:41:36.120274+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":19,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T05:41:46.860779+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":18,"pool_name":"cephfs_metadata","create_time":"2024-09-17T05:52:16.897390+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"126","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":19,"pool_name":"cephfs_data","create_time":"2024-09-17T05:52:18.214964+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"126","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"4f31c018-c8a4-4d6d-b0c2-a597c47aae4a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":125,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6800","nonce":479374392},{"type":"v1","addr":"172.21.15.150:6801","nonce":479374392}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6802","nonce":479374392},{"type":"v1","addr":"172.21.15.150:6803","nonce":479374392}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6806","nonce":479374392},{"type":"v1","addr":"172.21.15.150:6807","nonce":479374392}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6804","nonce":479374392},{"type":"v1","addr":"172.21.15.150:6805","nonce":479374392}]},"public_addr":"172.21.15.150:6801/479374392","cluster_addr":"172.21.15.150:6803/479374392","heartbeat_back_addr":"172.21.15.150:6807/479374392","heartbeat_front_addr":"172.21.15.150:6805/479374392","state":["exists","up"]},{"osd":1,"uuid":"6ff4a573-500b-4e04-9de3-39265ead78b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":125,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6824","nonce":913899800},{"type":"v1","addr":"172.21.15.150:6825","nonce":913899800}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6826","nonce":913899800},{"type":"v1","addr":"172.21.15.150:6827","nonce":913899800}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6830","nonce":913899800},{"type":"v1","addr":"172.21.15.150:6831","nonce":913899800}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6828","nonce":913899800},{"type":"v1","addr":"172.21.15.150:6829","nonce":913899800}]},"public_addr":"172.21.15.150:6825/913899800","cluster_addr":"172.21.15.150:6827/913899800","heartbeat_back_addr":"172.21.15.150:6831/913899800","heartbeat_front_addr":"172.21.15.150:6829/913899800","state":["exists","up"]},{"osd":2,"uuid":"bffea6f9-2465-4182-b205-00436c41ac1c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":125,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6816","nonce":363718461},{"type":"v1","addr":"172.21.15.150:6817","nonce":363718461}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6818","nonce":363718461},{"type":"v1","addr":"172.21.15.150:6819","nonce":363718461}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6822","nonce":363718461},{"type":"v1","addr":"172.21.15.150:6823","nonce":363718461}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6820","nonce":363718461},{"type":"v1","addr":"172.21.15.150:6821","nonce":363718461}]},"public_addr":"172.21.15.150:6817/363718461","cluster_addr":"172.21.15.150:6819/363718461","heartbeat_back_addr":"172.21.15.150:6823/363718461","heartbeat_front_addr":"172.21.15.150:6821/363718461","state":["exists","up"]},{"osd":3,"uuid":"cda70430-d1e1-427e-b04e-56db4031d078","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":125,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6808","nonce":3550994626},{"type":"v1","addr":"172.21.15.150:6809","nonce":3550994626}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6810","nonce":3550994626},{"type":"v1","addr":"172.21.15.150:6811","nonce":3550994626}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6814","nonce":3550994626},{"type":"v1","addr":"172.21.15.150:6815","nonce":3550994626}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6812","nonce":3550994626},{"type":"v1","addr":"172.21.15.150:6813","nonce":3550994626}]},"public_addr":"172.21.15.150:6809/3550994626","cluster_addr":"172.21.15.150:6811/3550994626","heartbeat_back_addr":"172.21.15.150:6815/3550994626","heartbeat_front_addr":"172.21.15.150:6813/3550994626","state":["exists","up"]},{"osd":4,"uuid":"3a0277fb-5e1e-4f68-bb2d-9a8a0152f64a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":125,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6810","nonce":2718261497},{"type":"v1","addr":"172.21.15.176:6811","nonce":2718261497}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6812","nonce":2718261497},{"type":"v1","addr":"172.21.15.176:6813","nonce":2718261497}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6816","nonce":2718261497},{"type":"v1","addr":"172.21.15.176:6817","nonce":2718261497}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6814","nonce":2718261497},{"type":"v1","addr":"172.21.15.176:6815","nonce":2718261497}]},"public_addr":"172.21.15.176:6811/2718261497","cluster_addr":"172.21.15.176:6813/2718261497","heartbeat_back_addr":"172.21.15.176:6817/2718261497","heartbeat_front_addr":"172.21.15.176:6815/2718261497","state":["exists","up"]},{"osd":5,"uuid":"33aebee6-0315-40b7-a11c-6702f0be494d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":125,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6818","nonce":2049295774},{"type":"v1","addr":"172.21.15.176:6819","nonce":2049295774}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6820","nonce":2049295774},{"type":"v1","addr":"172.21.15.176:6821","nonce":2049295774}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6824","nonce":2049295774},{"type":"v1","addr":"172.21.15.176:6825","nonce":2049295774}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6822","nonce":2049295774},{"type":"v1","addr":"172.21.15.176:6823","nonce":2049295774}]},"public_addr":"172.21.15.176:6819/2049295774","cluster_addr":"172.21.15.176:6821/2049295774","heartbeat_back_addr":"172.21.15.176:6825/2049295774","heartbeat_front_addr":"172.21.15.176:6823/2049295774","state":["exists","up"]},{"osd":6,"uuid":"4d24f360-6751-4263-841b-d77793d33540","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":125,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6826","nonce":2164458476},{"type":"v1","addr":"172.21.15.176:6827","nonce":2164458476}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6828","nonce":2164458476},{"type":"v1","addr":"172.21.15.176:6829","nonce":2164458476}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6832","nonce":2164458476},{"type":"v1","addr":"172.21.15.176:6833","nonce":2164458476}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6830","nonce":2164458476},{"type":"v1","addr":"172.21.15.176:6831","nonce":2164458476}]},"public_addr":"172.21.15.176:6827/2164458476","cluster_addr":"172.21.15.176:6829/2164458476","heartbeat_back_addr":"172.21.15.176:6833/2164458476","heartbeat_front_addr":"172.21.15.176:6831/2164458476","state":["exists","up"]},{"osd":7,"uuid":"c8594fda-c74a-4ba9-8277-caf101d58ca1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":125,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6802","nonce":3239587708},{"type":"v1","addr":"172.21.15.176:6803","nonce":3239587708}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6804","nonce":3239587708},{"type":"v1","addr":"172.21.15.176:6805","nonce":3239587708}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6808","nonce":3239587708},{"type":"v1","addr":"172.21.15.176:6809","nonce":3239587708}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6806","nonce":3239587708},{"type":"v1","addr":"172.21.15.176:6807","nonce":3239587708}]},"public_addr":"172.21.15.176:6803/3239587708","cluster_addr":"172.21.15.176:6805/3239587708","heartbeat_back_addr":"172.21.15.176:6809/3239587708","heartbeat_front_addr":"172.21.15.176:6807/3239587708","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:41:41.905151+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:41:42.705679+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:41:42.459673+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:41:42.440819+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:41:42.668428+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:41:42.694972+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:41:43.078535+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:41:42.363539+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":7,"snaps":[{"begin":2,"length":2}]},{"pool":9,"snaps":[{"begin":2,"length":2}]},{"pool":11,"snaps":[{"begin":2,"length":2}]},{"pool":13,"snaps":[{"begin":2,"length":2}]},{"pool":15,"snaps":[{"begin":2,"length":2}]},{"pool":17,"snaps":[{"begin":2,"length":2}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T05:52:20.566 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:20.563+0000 7fc8c0a7e640 1 -- 172.21.15.150:0/1950390528 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fc89c07a9f0 msgr2=0x7fc89c07cf00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:52:20.566 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:20.563+0000 7fc8c0a7e640 1 --2- 172.21.15.150:0/1950390528 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fc89c07a9f0 0x7fc89c07cf00 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7fc8ac000f60 tx=0x7fc8ac009040 comp rx=0 tx=0).stop 2024-09-17T05:52:20.566 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:20.563+0000 7fc8c0a7e640 1 -- 172.21.15.150:0/1950390528 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc8bc0cd040 msgr2=0x7fc8bc14e5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:52:20.566 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:20.563+0000 7fc8c0a7e640 1 --2- 172.21.15.150:0/1950390528 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc8bc0cd040 0x7fc8bc14e5c0 secure :-1 s=READY pgs=1668 cs=0 l=1 rev1=1 crypto rx=0x7fc8a400e6a0 tx=0x7fc8a400eb60 comp rx=0 tx=0).stop 2024-09-17T05:52:20.567 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:20.563+0000 7fc8c0a7e640 1 -- 172.21.15.150:0/1950390528 shutdown_connections 2024-09-17T05:52:20.567 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:20.563+0000 7fc8c0a7e640 1 --2- 172.21.15.150:0/1950390528 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fc89c07a9f0 0x7fc89c07cf00 unknown :-1 s=CLOSED pgs=709 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:52:20.567 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:20.563+0000 7fc8c0a7e640 1 --2- 172.21.15.150:0/1950390528 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc8bc1528b0 0x7fc8bc155440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:52:20.567 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:20.563+0000 7fc8c0a7e640 1 --2- 172.21.15.150:0/1950390528 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc8bc0cd040 0x7fc8bc14e5c0 unknown :-1 s=CLOSED pgs=1668 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:52:20.567 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:20.563+0000 7fc8c0a7e640 1 --2- 172.21.15.150:0/1950390528 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc8bc0715c0 0x7fc8bc159f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:52:20.568 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:20.563+0000 7fc8c0a7e640 1 -- 172.21.15.150:0/1950390528 >> 172.21.15.150:0/1950390528 conn(0x7fc8bc0d0b50 msgr2=0x7fc8bc14f100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:52:20.568 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:20.563+0000 7fc8c0a7e640 1 -- 172.21.15.150:0/1950390528 shutdown_connections 2024-09-17T05:52:20.568 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:20.563+0000 7fc8c0a7e640 1 -- 172.21.15.150:0/1950390528 wait complete. 2024-09-17T05:52:20.577 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-09-17T05:52:20.696 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:20.693+0000 7f1c03719640 1 -- 172.21.15.150:0/289051872 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1be8004800 msgr2=0x7f1be8004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:52:20.696 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:20.693+0000 7f1c03719640 1 --2- 172.21.15.150:0/289051872 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1be8004800 0x7f1be8004c90 secure :-1 s=READY pgs=1670 cs=0 l=1 rev1=1 crypto rx=0x7f1bec001800 tx=0x7f1be8005830 comp rx=0 tx=0).stop 2024-09-17T05:52:20.696 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:20.693+0000 7f1c01cb6640 1 -- 172.21.15.150:0/289051872 reap_dead start 2024-09-17T05:52:20.696 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:20.693+0000 7f1c03719640 1 -- 172.21.15.150:0/289051872 shutdown_connections 2024-09-17T05:52:20.697 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:20.693+0000 7f1c03719640 1 -- 172.21.15.150:0/289051872 >> 172.21.15.150:0/289051872 conn(0x7f1bfc0cef20 msgr2=0x7f1bfc0cf330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:52:20.697 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:20.693+0000 7f1c03719640 1 -- 172.21.15.150:0/289051872 shutdown_connections 2024-09-17T05:52:20.697 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:20.693+0000 7f1c03719640 1 -- 172.21.15.150:0/289051872 wait complete. 2024-09-17T05:52:20.704 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:20.695+0000 7f1c03719640 1 Processor -- start 2024-09-17T05:52:20.704 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:20.695+0000 7f1c03719640 1 -- start start 2024-09-17T05:52:20.705 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:20.696+0000 7f1c03719640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1be8004800 0x7f1bfc1f3b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:52:20.705 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:20.696+0000 7f1c03719640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1bfc1524f0 0x7f1bfc15f7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:52:20.705 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:20.696+0000 7f1c03719640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1bfc152900 0x7f1bfc15fd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:52:20.706 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:20.696+0000 7f1c03719640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f1bfc0ced10 con 0x7f1be8004800 2024-09-17T05:52:20.706 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:20.696+0000 7f1c03719640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f1bfc0ceb90 con 0x7f1bfc152900 2024-09-17T05:52:20.706 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:20.696+0000 7f1c03719640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f1bfc0cd7f0 con 0x7f1bfc1524f0 2024-09-17T05:52:20.706 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:20.696+0000 7f1c014b5640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1be8004800 0x7f1bfc1f3b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:52:20.706 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:20.696+0000 7f1c014b5640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1be8004800 0x7f1bfc1f3b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:35656/0 (socket says 172.21.15.150:35656) 2024-09-17T05:52:20.707 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:20.696+0000 7f1c014b5640 1 -- 172.21.15.150:0/205322830 learned_addr learned my addr 172.21.15.150:0/205322830 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:52:20.707 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:20.696+0000 7f1c00cb4640 1 --2- 172.21.15.150:0/205322830 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1bfc1524f0 0x7f1bfc15f7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:52:20.707 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:20.696+0000 7f1c01cb6640 1 --2- 172.21.15.150:0/205322830 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1bfc152900 0x7f1bfc15fd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:52:20.707 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:20.696+0000 7f1c014b5640 1 -- 172.21.15.150:0/205322830 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1bfc1524f0 msgr2=0x7f1bfc15f7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:52:20.707 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:20.696+0000 7f1c014b5640 1 --2- 172.21.15.150:0/205322830 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1bfc1524f0 0x7f1bfc15f7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:52:20.708 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:20.696+0000 7f1c014b5640 1 -- 172.21.15.150:0/205322830 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1bfc152900 msgr2=0x7f1bfc15fd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:52:20.708 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:20.696+0000 7f1c014b5640 1 --2- 172.21.15.150:0/205322830 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1bfc152900 0x7f1bfc15fd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:52:20.708 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:20.696+0000 7f1c014b5640 1 -- 172.21.15.150:0/205322830 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1bfc15a280 con 0x7f1be8004800 2024-09-17T05:52:20.708 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:20.696+0000 7f1c014b5640 1 --2- 172.21.15.150:0/205322830 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1be8004800 0x7f1bfc1f3b80 secure :-1 s=READY pgs=1671 cs=0 l=1 rev1=1 crypto rx=0x7f1bf80118e0 tx=0x7f1bf8011da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:52:20.708 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:20.697+0000 7f1bf1ffb640 1 -- 172.21.15.150:0/205322830 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1bf801e070 con 0x7f1be8004800 2024-09-17T05:52:20.708 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:20.697+0000 7f1bf1ffb640 1 -- 172.21.15.150:0/205322830 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f1bf800fc70 con 0x7f1be8004800 2024-09-17T05:52:20.709 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:20.697+0000 7f1c03719640 1 -- 172.21.15.150:0/205322830 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1bfc15a560 con 0x7f1be8004800 2024-09-17T05:52:20.709 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:20.697+0000 7f1bf1ffb640 1 -- 172.21.15.150:0/205322830 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1bf8019670 con 0x7f1be8004800 2024-09-17T05:52:20.709 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:20.697+0000 7f1c03719640 1 -- 172.21.15.150:0/205322830 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1bfc15eff0 con 0x7f1be8004800 2024-09-17T05:52:20.709 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:20.698+0000 7f1c03719640 1 -- 172.21.15.150:0/205322830 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1bfc0cdcf0 con 0x7f1be8004800 2024-09-17T05:52:20.709 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:20.699+0000 7f1bf1ffb640 1 -- 172.21.15.150:0/205322830 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 42) ==== 104195+0+0 (secure 0 0 0) 0x7f1bf8021070 con 0x7f1be8004800 2024-09-17T05:52:20.710 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:20.699+0000 7f1bf1ffb640 1 --2- 172.21.15.150:0/205322830 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f1be007aa20 0x7f1be007cf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:52:20.710 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:20.700+0000 7f1bf1ffb640 1 -- 172.21.15.150:0/205322830 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(126..126 src has 1..126) ==== 5877+0+0 (secure 0 0 0) 0x7f1bf809a440 con 0x7f1be8004800 2024-09-17T05:52:20.710 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:20.700+0000 7f1c00cb4640 1 --2- 172.21.15.150:0/205322830 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f1be007aa20 0x7f1be007cf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:52:20.710 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:20.700+0000 7f1c00cb4640 1 --2- 172.21.15.150:0/205322830 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f1be007aa20 0x7f1be007cf30 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x7f1bec032000 tx=0x7f1bec001360 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:52:20.711 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:20.704+0000 7f1bf1ffb640 1 -- 172.21.15.150:0/205322830 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f1bf800fe60 con 0x7f1be8004800 2024-09-17T05:52:20.920 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:20.918+0000 7f1c03719640 1 -- 172.21.15.150:0/205322830 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7f1bfc0afda0 con 0x7f1be8004800 2024-09-17T05:52:21.875 INFO:tasks.ceph.mds.d.smithi176.stderr:2024-09-17T05:52:21.873+0000 7f98ff58b640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-17T05:52:21.919 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:21.918+0000 7f1bf1ffb640 1 -- 172.21.15.150:0/205322830 <== mon.0 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v79) ==== 118+0+0 (secure 0 0 0) 0x7f1bf8063dc0 con 0x7f1be8004800 2024-09-17T05:52:21.924 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:21.922+0000 7f1c03719640 1 -- 172.21.15.150:0/205322830 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f1be007aa20 msgr2=0x7f1be007cf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:52:21.924 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:21.922+0000 7f1c03719640 1 --2- 172.21.15.150:0/205322830 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f1be007aa20 0x7f1be007cf30 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x7f1bec032000 tx=0x7f1bec001360 comp rx=0 tx=0).stop 2024-09-17T05:52:21.924 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:21.922+0000 7f1c03719640 1 -- 172.21.15.150:0/205322830 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1be8004800 msgr2=0x7f1bfc1f3b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:52:21.924 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:21.922+0000 7f1c03719640 1 --2- 172.21.15.150:0/205322830 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1be8004800 0x7f1bfc1f3b80 secure :-1 s=READY pgs=1671 cs=0 l=1 rev1=1 crypto rx=0x7f1bf80118e0 tx=0x7f1bf8011da0 comp rx=0 tx=0).stop 2024-09-17T05:52:21.924 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:21.922+0000 7f1c03719640 1 -- 172.21.15.150:0/205322830 shutdown_connections 2024-09-17T05:52:21.924 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:21.922+0000 7f1c03719640 1 --2- 172.21.15.150:0/205322830 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1bfc152900 0x7f1bfc15fd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:52:21.924 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:21.922+0000 7f1c03719640 1 --2- 172.21.15.150:0/205322830 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f1be007aa20 0x7f1be007cf30 unknown :-1 s=CLOSED pgs=710 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:52:21.924 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:21.922+0000 7f1c03719640 1 --2- 172.21.15.150:0/205322830 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1bfc1524f0 0x7f1bfc15f7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:52:21.925 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:21.922+0000 7f1c03719640 1 --2- 172.21.15.150:0/205322830 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1be8004800 0x7f1bfc1f3b80 unknown :-1 s=CLOSED pgs=1671 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:52:21.925 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:21.922+0000 7f1c03719640 1 -- 172.21.15.150:0/205322830 >> 172.21.15.150:0/205322830 conn(0x7f1bfc0cef20 msgr2=0x7f1bfc0d0a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:52:21.925 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:21.922+0000 7f1c03719640 1 -- 172.21.15.150:0/205322830 shutdown_connections 2024-09-17T05:52:21.925 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:21.922+0000 7f1c03719640 1 -- 172.21.15.150:0/205322830 wait complete. 2024-09-17T05:52:21.938 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-09-17T05:52:21.939 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-09-17T05:52:22.062 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:22.060+0000 7ff1b6369640 1 -- 172.21.15.150:0/3693477557 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff1b00cf390 msgr2=0x7ff1b00cf7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:52:22.062 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:22.060+0000 7ff1b6369640 1 --2- 172.21.15.150:0/3693477557 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff1b00cf390 0x7ff1b00cf7a0 secure :-1 s=READY pgs=1672 cs=0 l=1 rev1=1 crypto rx=0x7ff1a8005fd0 tx=0x7ff1a802a980 comp rx=0 tx=0).stop 2024-09-17T05:52:22.062 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:22.060+0000 7ff1b6369640 1 -- 172.21.15.150:0/3693477557 shutdown_connections 2024-09-17T05:52:22.062 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:22.060+0000 7ff1b6369640 1 --2- 172.21.15.150:0/3693477557 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff1b00cf390 0x7ff1b00cf7a0 unknown :-1 s=CLOSED pgs=1672 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:52:22.062 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:22.060+0000 7ff1b6369640 1 --2- 172.21.15.150:0/3693477557 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff1b00b16f0 0x7ff1b00b1ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:52:22.063 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:22.060+0000 7ff1b6369640 1 -- 172.21.15.150:0/3693477557 >> 172.21.15.150:0/3693477557 conn(0x7ff1b00b2ff0 msgr2=0x7ff1b00b3400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:52:22.063 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:22.060+0000 7ff1b6369640 1 -- 172.21.15.150:0/3693477557 shutdown_connections 2024-09-17T05:52:22.063 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:22.060+0000 7ff1b6369640 1 -- 172.21.15.150:0/3693477557 wait complete. 2024-09-17T05:52:22.063 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:22.062+0000 7ff1b6369640 1 Processor -- start 2024-09-17T05:52:22.064 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:22.062+0000 7ff1b6369640 1 -- start start 2024-09-17T05:52:22.066 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:22.063+0000 7ff1b6369640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff1b00b16f0 0x7ff1b01decb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:52:22.067 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:22.063+0000 7ff1b6369640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff1b00b25e0 0x7ff1b01e5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:52:22.067 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:22.063+0000 7ff1b6369640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff1b00cf390 0x7ff1b01e5c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:52:22.067 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:22.063+0000 7ff1b6369640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7ff1b00ae780 con 0x7ff1b00cf390 2024-09-17T05:52:22.067 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:22.063+0000 7ff1b6369640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7ff1b00ae600 con 0x7ff1b00b25e0 2024-09-17T05:52:22.067 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:22.063+0000 7ff1b6369640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7ff1b00ae900 con 0x7ff1b00b16f0 2024-09-17T05:52:22.067 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:22.064+0000 7ff1b4906640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff1b00cf390 0x7ff1b01e5c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:52:22.067 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:22.064+0000 7ff1b4906640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff1b00cf390 0x7ff1b01e5c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:35680/0 (socket says 172.21.15.150:35680) 2024-09-17T05:52:22.067 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:22.064+0000 7ff1b4906640 1 -- 172.21.15.150:0/831986818 learned_addr learned my addr 172.21.15.150:0/831986818 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:52:22.067 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:22.064+0000 7ff1affff640 1 --2- 172.21.15.150:0/831986818 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff1b00b16f0 0x7ff1b01decb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:52:22.067 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:22.064+0000 7ff1af7fe640 1 --2- 172.21.15.150:0/831986818 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff1b00b25e0 0x7ff1b01e5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:52:22.067 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:22.064+0000 7ff1b4906640 1 -- 172.21.15.150:0/831986818 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff1b00b16f0 msgr2=0x7ff1b01decb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:52:22.068 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:22.064+0000 7ff1b4906640 1 --2- 172.21.15.150:0/831986818 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff1b00b16f0 0x7ff1b01decb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:52:22.068 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:22.064+0000 7ff1b4906640 1 -- 172.21.15.150:0/831986818 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff1b00b25e0 msgr2=0x7ff1b01e5700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:52:22.068 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:22.064+0000 7ff1b4906640 1 --2- 172.21.15.150:0/831986818 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff1b00b25e0 0x7ff1b01e5700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:52:22.068 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:22.064+0000 7ff1b4906640 1 -- 172.21.15.150:0/831986818 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff1b00b48d0 con 0x7ff1b00cf390 2024-09-17T05:52:22.068 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:22.064+0000 7ff1b4906640 1 --2- 172.21.15.150:0/831986818 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff1b00cf390 0x7ff1b01e5c40 secure :-1 s=READY pgs=1673 cs=0 l=1 rev1=1 crypto rx=0x7ff1a8006010 tx=0x7ff1a8003f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:52:22.068 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:22.064+0000 7ff1acff9640 1 -- 172.21.15.150:0/831986818 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1a8034040 con 0x7ff1b00cf390 2024-09-17T05:52:22.068 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:22.064+0000 7ff1acff9640 1 -- 172.21.15.150:0/831986818 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff1a8004540 con 0x7ff1b00cf390 2024-09-17T05:52:22.068 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:22.064+0000 7ff1b6369640 1 -- 172.21.15.150:0/831986818 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff1b00b4bb0 con 0x7ff1b00cf390 2024-09-17T05:52:22.068 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:22.064+0000 7ff1acff9640 1 -- 172.21.15.150:0/831986818 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1a8045480 con 0x7ff1b00cf390 2024-09-17T05:52:22.068 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:22.064+0000 7ff1b6369640 1 -- 172.21.15.150:0/831986818 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff1b00b5170 con 0x7ff1b00cf390 2024-09-17T05:52:22.069 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:22.065+0000 7ff1b6369640 1 -- 172.21.15.150:0/831986818 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff1b00b1ec0 con 0x7ff1b00cf390 2024-09-17T05:52:22.069 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:22.066+0000 7ff1acff9640 1 -- 172.21.15.150:0/831986818 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 42) ==== 104195+0+0 (secure 0 0 0) 0x7ff1a8037020 con 0x7ff1b00cf390 2024-09-17T05:52:22.069 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:22.067+0000 7ff1acff9640 1 --2- 172.21.15.150:0/831986818 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7ff19c07a9f0 0x7ff19c07cf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:52:22.069 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:22.067+0000 7ff1acff9640 1 -- 172.21.15.150:0/831986818 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(127..127 src has 1..127) ==== 5877+0+0 (secure 0 0 0) 0x7ff1a80bb510 con 0x7ff1b00cf390 2024-09-17T05:52:22.069 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:22.067+0000 7ff1affff640 1 --2- 172.21.15.150:0/831986818 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7ff19c07a9f0 0x7ff19c07cf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:52:22.069 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:22.067+0000 7ff1affff640 1 --2- 172.21.15.150:0/831986818 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7ff19c07a9f0 0x7ff19c07cf00 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x7ff1a0001720 tx=0x7ff1a0009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:52:22.072 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:22.071+0000 7ff1acff9640 1 -- 172.21.15.150:0/831986818 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7ff1a8084e10 con 0x7ff1b00cf390 2024-09-17T05:52:22.283 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:22.281+0000 7ff1b6369640 1 -- 172.21.15.150:0/831986818 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7ff1b0071580 con 0x7ff1b00cf390 2024-09-17T05:52:22.921 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:22.919+0000 7ff1acff9640 1 -- 172.21.15.150:0/831986818 <== mon.0 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v80) ==== 122+0+0 (secure 0 0 0) 0x7ff1a8089840 con 0x7ff1b00cf390 2024-09-17T05:52:22.925 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:22.923+0000 7ff1b6369640 1 -- 172.21.15.150:0/831986818 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7ff19c07a9f0 msgr2=0x7ff19c07cf00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:52:22.925 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:22.923+0000 7ff1b6369640 1 --2- 172.21.15.150:0/831986818 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7ff19c07a9f0 0x7ff19c07cf00 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x7ff1a0001720 tx=0x7ff1a0009040 comp rx=0 tx=0).stop 2024-09-17T05:52:22.925 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:22.923+0000 7ff1b6369640 1 -- 172.21.15.150:0/831986818 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff1b00cf390 msgr2=0x7ff1b01e5c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:52:22.925 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:22.923+0000 7ff1b6369640 1 --2- 172.21.15.150:0/831986818 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff1b00cf390 0x7ff1b01e5c40 secure :-1 s=READY pgs=1673 cs=0 l=1 rev1=1 crypto rx=0x7ff1a8006010 tx=0x7ff1a8003f10 comp rx=0 tx=0).stop 2024-09-17T05:52:22.925 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:22.923+0000 7ff1b6369640 1 -- 172.21.15.150:0/831986818 shutdown_connections 2024-09-17T05:52:22.925 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:22.923+0000 7ff1b6369640 1 --2- 172.21.15.150:0/831986818 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff1b00b25e0 0x7ff1b01e5700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:52:22.925 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:22.923+0000 7ff1b6369640 1 --2- 172.21.15.150:0/831986818 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7ff19c07a9f0 0x7ff19c07cf00 unknown :-1 s=CLOSED pgs=711 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:52:22.925 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:22.923+0000 7ff1b6369640 1 --2- 172.21.15.150:0/831986818 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff1b00cf390 0x7ff1b01e5c40 unknown :-1 s=CLOSED pgs=1673 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:52:22.925 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:22.923+0000 7ff1b6369640 1 --2- 172.21.15.150:0/831986818 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff1b00b16f0 0x7ff1b01decb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:52:22.925 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:22.923+0000 7ff1b6369640 1 -- 172.21.15.150:0/831986818 >> 172.21.15.150:0/831986818 conn(0x7ff1b00b2ff0 msgr2=0x7ff1b00b3400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:52:22.925 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:22.923+0000 7ff1b6369640 1 -- 172.21.15.150:0/831986818 shutdown_connections 2024-09-17T05:52:22.926 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:22.923+0000 7ff1b6369640 1 -- 172.21.15.150:0/831986818 wait complete. 2024-09-17T05:52:22.939 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-09-17T05:52:22.939 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T05:52:23.056 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:23.054+0000 7fc51d369640 1 -- 172.21.15.150:0/3262658793 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc5180b5d50 msgr2=0x7fc5180d2780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:52:23.056 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:23.054+0000 7fc51d369640 1 --2- 172.21.15.150:0/3262658793 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc5180b5d50 0x7fc5180d2780 secure :-1 s=READY pgs=1675 cs=0 l=1 rev1=1 crypto rx=0x7fc508005fd0 tx=0x7fc50802a8b0 comp rx=0 tx=0).stop 2024-09-17T05:52:23.056 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:23.054+0000 7fc51d369640 1 -- 172.21.15.150:0/3262658793 shutdown_connections 2024-09-17T05:52:23.056 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:23.054+0000 7fc51d369640 1 --2- 172.21.15.150:0/3262658793 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc5180d1790 0x7fc5180d0400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:52:23.056 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:23.054+0000 7fc51d369640 1 --2- 172.21.15.150:0/3262658793 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc5180b5d50 0x7fc5180d2780 unknown :-1 s=CLOSED pgs=1675 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:52:23.056 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:23.054+0000 7fc51d369640 1 -- 172.21.15.150:0/3262658793 >> 172.21.15.150:0/3262658793 conn(0x7fc51808bfe0 msgr2=0x7fc5180d4670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:52:23.057 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:23.054+0000 7fc51d369640 1 -- 172.21.15.150:0/3262658793 shutdown_connections 2024-09-17T05:52:23.057 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:23.054+0000 7fc51d369640 1 -- 172.21.15.150:0/3262658793 wait complete. 2024-09-17T05:52:23.057 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:23.056+0000 7fc51d369640 1 Processor -- start 2024-09-17T05:52:23.057 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:23.056+0000 7fc51d369640 1 -- start start 2024-09-17T05:52:23.060 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:23.057+0000 7fc51d369640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc5180b5d50 0x7fc51815a340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:52:23.060 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:23.057+0000 7fc51d369640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc5180d4f90 0x7fc5180b4920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:52:23.061 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:23.057+0000 7fc51d369640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc5180b4e60 0x7fc51815acf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:52:23.061 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:23.057+0000 7fc51d369640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7fc5180b7b00 con 0x7fc5180b5d50 2024-09-17T05:52:23.061 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:23.057+0000 7fc51d369640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fc5180b7980 con 0x7fc5180d4f90 2024-09-17T05:52:23.061 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:23.057+0000 7fc51d369640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fc5180b7c80 con 0x7fc5180b4e60 2024-09-17T05:52:23.061 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:23.057+0000 7fc516ffd640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc5180b5d50 0x7fc51815a340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:52:23.061 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:23.057+0000 7fc516ffd640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc5180b5d50 0x7fc51815a340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:35692/0 (socket says 172.21.15.150:35692) 2024-09-17T05:52:23.061 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:23.057+0000 7fc516ffd640 1 -- 172.21.15.150:0/3227656276 learned_addr learned my addr 172.21.15.150:0/3227656276 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:52:23.061 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:23.057+0000 7fc5167fc640 1 --2- 172.21.15.150:0/3227656276 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc5180d4f90 0x7fc5180b4920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:52:23.061 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:23.058+0000 7fc5177fe640 1 --2- 172.21.15.150:0/3227656276 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc5180b4e60 0x7fc51815acf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:52:23.061 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:23.058+0000 7fc516ffd640 1 -- 172.21.15.150:0/3227656276 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc5180b4e60 msgr2=0x7fc51815acf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:52:23.061 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:23.058+0000 7fc516ffd640 1 --2- 172.21.15.150:0/3227656276 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc5180b4e60 0x7fc51815acf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:52:23.061 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:23.058+0000 7fc516ffd640 1 -- 172.21.15.150:0/3227656276 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc5180d4f90 msgr2=0x7fc5180b4920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:52:23.062 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:23.058+0000 7fc516ffd640 1 --2- 172.21.15.150:0/3227656276 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc5180d4f90 0x7fc5180b4920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:52:23.062 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:23.058+0000 7fc516ffd640 1 -- 172.21.15.150:0/3227656276 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc5181f6060 con 0x7fc5180b5d50 2024-09-17T05:52:23.062 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:23.058+0000 7fc5167fc640 1 --2- 172.21.15.150:0/3227656276 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc5180d4f90 0x7fc5180b4920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T05:52:23.062 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:23.058+0000 7fc516ffd640 1 --2- 172.21.15.150:0/3227656276 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc5180b5d50 0x7fc51815a340 secure :-1 s=READY pgs=1676 cs=0 l=1 rev1=1 crypto rx=0x7fc508006010 tx=0x7fc508003c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:52:23.062 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:23.058+0000 7fc4ff7fe640 1 -- 172.21.15.150:0/3227656276 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc508031da0 con 0x7fc5180b5d50 2024-09-17T05:52:23.062 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:23.058+0000 7fc4ff7fe640 1 -- 172.21.15.150:0/3227656276 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc5080330d0 con 0x7fc5180b5d50 2024-09-17T05:52:23.062 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:23.058+0000 7fc51d369640 1 -- 172.21.15.150:0/3227656276 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc5181f6320 con 0x7fc5180b5d50 2024-09-17T05:52:23.062 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:23.058+0000 7fc4ff7fe640 1 -- 172.21.15.150:0/3227656276 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc508033520 con 0x7fc5180b5d50 2024-09-17T05:52:23.062 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:23.058+0000 7fc51d369640 1 -- 172.21.15.150:0/3227656276 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc5181f68e0 con 0x7fc5180b5d50 2024-09-17T05:52:23.063 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:23.059+0000 7fc51d369640 1 -- 172.21.15.150:0/3227656276 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc5180d1540 con 0x7fc5180b5d50 2024-09-17T05:52:23.063 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:23.060+0000 7fc4ff7fe640 1 -- 172.21.15.150:0/3227656276 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 42) ==== 104195+0+0 (secure 0 0 0) 0x7fc5080336c0 con 0x7fc5180b5d50 2024-09-17T05:52:23.063 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:23.060+0000 7fc4ff7fe640 1 --2- 172.21.15.150:0/3227656276 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fc50407a9f0 0x7fc50407cf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:52:23.063 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:23.061+0000 7fc4ff7fe640 1 -- 172.21.15.150:0/3227656276 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(127..127 src has 1..127) ==== 5877+0+0 (secure 0 0 0) 0x7fc5080bb3c0 con 0x7fc5180b5d50 2024-09-17T05:52:23.063 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:23.061+0000 7fc5167fc640 1 --2- 172.21.15.150:0/3227656276 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fc50407a9f0 0x7fc50407cf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:52:23.063 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:23.061+0000 7fc5167fc640 1 --2- 172.21.15.150:0/3227656276 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fc50407a9f0 0x7fc50407cf00 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x7fc50c0046b0 tx=0x7fc50c009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:52:23.066 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:23.065+0000 7fc4ff7fe640 1 -- 172.21.15.150:0/3227656276 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fc5180d1540 con 0x7fc5180b5d50 2024-09-17T05:52:23.281 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:23.280+0000 7fc51d369640 1 -- 172.21.15.150:0/3227656276 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fc5180d2780 con 0x7fc5180b5d50 2024-09-17T05:52:23.282 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:23.280+0000 7fc4ff7fe640 1 -- 172.21.15.150:0/3227656276 <== mon.0 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 80 v80) ==== 94+0+5234 (secure 0 0 0) 0x7fc50803f030 con 0x7fc5180b5d50 2024-09-17T05:52:23.282 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-09-17T05:52:23.282 INFO:teuthology.orchestra.run.smithi150.stdout:{"epoch":80,"btime":"2024-09-17T05:52:22:919504+0000","default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":9123,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6834/2232109291","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6832","nonce":2232109291},{"type":"v1","addr":"172.21.15.150:6834","nonce":2232109291}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":74},{"gid":9126,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6835/423416474","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6833","nonce":423416474},{"type":"v1","addr":"172.21.15.150:6835","nonce":423416474}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":75},{"gid":9138,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6837/2582017817","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6835","nonce":2582017817},{"type":"v1","addr":"172.21.15.176:6837","nonce":2582017817}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":75}],"filesystems":[{"mdsmap":{"epoch":80,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T05:52:19.257101+0000","modified":"2024-09-17T05:52:22.283372+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":9141},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9141":{"gid":9141,"name":"d","rank":0,"incarnation":76,"state":"up:active","state_seq":3,"addr":"172.21.15.176:6836/1926613940","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6834","nonce":1926613940},{"type":"v1","addr":"172.21.15.176:6836","nonce":1926613940}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[19],"metadata_pool":18,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":9141,"qdb_cluster":[9141]},"id":9}]} 2024-09-17T05:52:23.283 INFO:teuthology.orchestra.run.smithi150.stderr:dumped fsmap epoch 80 2024-09-17T05:52:23.285 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:23.282+0000 7fc51d369640 1 -- 172.21.15.150:0/3227656276 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fc50407a9f0 msgr2=0x7fc50407cf00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:52:23.285 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:23.282+0000 7fc51d369640 1 --2- 172.21.15.150:0/3227656276 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fc50407a9f0 0x7fc50407cf00 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x7fc50c0046b0 tx=0x7fc50c009040 comp rx=0 tx=0).stop 2024-09-17T05:52:23.285 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:23.282+0000 7fc51d369640 1 -- 172.21.15.150:0/3227656276 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc5180b5d50 msgr2=0x7fc51815a340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:52:23.285 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:23.282+0000 7fc51d369640 1 --2- 172.21.15.150:0/3227656276 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc5180b5d50 0x7fc51815a340 secure :-1 s=READY pgs=1676 cs=0 l=1 rev1=1 crypto rx=0x7fc508006010 tx=0x7fc508003c20 comp rx=0 tx=0).stop 2024-09-17T05:52:23.285 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:23.282+0000 7fc51d369640 1 -- 172.21.15.150:0/3227656276 shutdown_connections 2024-09-17T05:52:23.285 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:23.282+0000 7fc51d369640 1 --2- 172.21.15.150:0/3227656276 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc5180d4f90 0x7fc5180b4920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:52:23.285 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:23.282+0000 7fc51d369640 1 --2- 172.21.15.150:0/3227656276 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fc50407a9f0 0x7fc50407cf00 unknown :-1 s=CLOSED pgs=712 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:52:23.285 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:23.282+0000 7fc51d369640 1 --2- 172.21.15.150:0/3227656276 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc5180b4e60 0x7fc51815acf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:52:23.285 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:23.282+0000 7fc51d369640 1 --2- 172.21.15.150:0/3227656276 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc5180b5d50 0x7fc51815a340 unknown :-1 s=CLOSED pgs=1676 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:52:23.286 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:23.282+0000 7fc51d369640 1 -- 172.21.15.150:0/3227656276 >> 172.21.15.150:0/3227656276 conn(0x7fc51808bfe0 msgr2=0x7fc5180b5460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:52:23.286 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:23.282+0000 7fc51d369640 1 -- 172.21.15.150:0/3227656276 shutdown_connections 2024-09-17T05:52:23.286 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:23.282+0000 7fc51d369640 1 -- 172.21.15.150:0/3227656276 wait complete. 2024-09-17T05:52:23.296 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T05:52:23.409 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:23.407+0000 7f46c3933640 1 -- 172.21.15.150:0/481462745 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f46bc0cf7c0 msgr2=0x7f46bc0cfbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:52:23.409 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:23.407+0000 7f46c3933640 1 --2- 172.21.15.150:0/481462745 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f46bc0cf7c0 0x7f46bc0cfbd0 secure :-1 s=READY pgs=1677 cs=0 l=1 rev1=1 crypto rx=0x7f46bc0b70c0 tx=0x7f46b002a5f0 comp rx=0 tx=0).stop 2024-09-17T05:52:23.409 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:23.407+0000 7f46c3933640 1 -- 172.21.15.150:0/481462745 shutdown_connections 2024-09-17T05:52:23.409 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:23.407+0000 7f46c3933640 1 --2- 172.21.15.150:0/481462745 >> v2:172.21.15.176:3300/0 conn(0x7f46bc0b5410 0x7f46bc0b5820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:52:23.410 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:23.407+0000 7f46c3933640 1 --2- 172.21.15.150:0/481462745 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f46bc0cf7c0 0x7f46bc0cfbd0 unknown :-1 s=CLOSED pgs=1677 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:52:23.410 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:23.407+0000 7f46c3933640 1 -- 172.21.15.150:0/481462745 >> 172.21.15.150:0/481462745 conn(0x7f46bc0b2fd0 msgr2=0x7f46bc0b33e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:52:23.410 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:23.407+0000 7f46c3933640 1 -- 172.21.15.150:0/481462745 shutdown_connections 2024-09-17T05:52:23.410 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:23.407+0000 7f46c3933640 1 -- 172.21.15.150:0/481462745 wait complete. 2024-09-17T05:52:23.410 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:23.409+0000 7f46c3933640 1 Processor -- start 2024-09-17T05:52:23.410 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:23.409+0000 7f46c3933640 1 -- start start 2024-09-17T05:52:23.413 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:23.410+0000 7f46c3933640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f46bc0b5410 0x7f46bc0ce7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:52:23.414 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:23.410+0000 7f46c3933640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f46bc0cf7c0 0x7f46bc153ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:52:23.414 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:23.410+0000 7f46c3933640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f46bc15ee30 0x7f46bc154020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:52:23.414 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:23.410+0000 7f46c3933640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f46bc0b60f0 con 0x7f46bc15ee30 2024-09-17T05:52:23.414 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:23.410+0000 7f46c3933640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f46bc0b5f70 con 0x7f46bc0cf7c0 2024-09-17T05:52:23.414 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:23.410+0000 7f46c3933640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f46bc0b6270 con 0x7f46bc0b5410 2024-09-17T05:52:23.414 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:23.410+0000 7f46c1ed0640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f46bc15ee30 0x7f46bc154020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:52:23.415 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:23.410+0000 7f46c1ed0640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f46bc15ee30 0x7f46bc154020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:35716/0 (socket says 172.21.15.150:35716) 2024-09-17T05:52:23.415 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:23.410+0000 7f46c1ed0640 1 -- 172.21.15.150:0/2387547341 learned_addr learned my addr 172.21.15.150:0/2387547341 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:52:23.415 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:23.410+0000 7f46c0ece640 1 --2- 172.21.15.150:0/2387547341 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f46bc0cf7c0 0x7f46bc153ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:52:23.415 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:23.410+0000 7f46c16cf640 1 --2- 172.21.15.150:0/2387547341 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f46bc0b5410 0x7f46bc0ce7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:52:23.415 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:23.411+0000 7f46c1ed0640 1 -- 172.21.15.150:0/2387547341 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f46bc0b5410 msgr2=0x7f46bc0ce7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:52:23.415 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:23.411+0000 7f46c1ed0640 1 --2- 172.21.15.150:0/2387547341 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f46bc0b5410 0x7f46bc0ce7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:52:23.415 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:23.411+0000 7f46c1ed0640 1 -- 172.21.15.150:0/2387547341 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f46bc0cf7c0 msgr2=0x7f46bc153ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:52:23.415 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:23.411+0000 7f46c1ed0640 1 --2- 172.21.15.150:0/2387547341 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f46bc0cf7c0 0x7f46bc153ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:52:23.415 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:23.411+0000 7f46c1ed0640 1 -- 172.21.15.150:0/2387547341 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f46bc1569b0 con 0x7f46bc15ee30 2024-09-17T05:52:23.415 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:23.411+0000 7f46c1ed0640 1 --2- 172.21.15.150:0/2387547341 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f46bc15ee30 0x7f46bc154020 secure :-1 s=READY pgs=1678 cs=0 l=1 rev1=1 crypto rx=0x7f46b400d6a0 tx=0x7f46b400db60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:52:23.415 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:23.411+0000 7f46b9ffb640 1 -- 172.21.15.150:0/2387547341 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46b4017070 con 0x7f46bc15ee30 2024-09-17T05:52:23.416 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:23.411+0000 7f46b9ffb640 1 -- 172.21.15.150:0/2387547341 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f46b4004310 con 0x7f46bc15ee30 2024-09-17T05:52:23.416 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:23.411+0000 7f46b9ffb640 1 -- 172.21.15.150:0/2387547341 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46b4005280 con 0x7f46bc15ee30 2024-09-17T05:52:23.416 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:23.411+0000 7f46c3933640 1 -- 172.21.15.150:0/2387547341 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f46bc0ced30 con 0x7f46bc15ee30 2024-09-17T05:52:23.416 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:23.411+0000 7f46c3933640 1 -- 172.21.15.150:0/2387547341 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f46bc151370 con 0x7f46bc15ee30 2024-09-17T05:52:23.416 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:23.412+0000 7f46c3933640 1 -- 172.21.15.150:0/2387547341 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f46bc0b67c0 con 0x7f46bc15ee30 2024-09-17T05:52:23.417 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:23.413+0000 7f46b9ffb640 1 -- 172.21.15.150:0/2387547341 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 42) ==== 104195+0+0 (secure 0 0 0) 0x7f46b4005420 con 0x7f46bc15ee30 2024-09-17T05:52:23.417 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:23.413+0000 7f46b9ffb640 1 --2- 172.21.15.150:0/2387547341 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f46a807a9f0 0x7f46a807cf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:52:23.417 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:23.414+0000 7f46b9ffb640 1 -- 172.21.15.150:0/2387547341 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(127..127 src has 1..127) ==== 5877+0+0 (secure 0 0 0) 0x7f46b4099f40 con 0x7f46bc15ee30 2024-09-17T05:52:23.417 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:23.414+0000 7f46c16cf640 1 --2- 172.21.15.150:0/2387547341 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f46a807a9f0 0x7f46a807cf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:52:23.417 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:23.414+0000 7f46c16cf640 1 --2- 172.21.15.150:0/2387547341 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f46a807a9f0 0x7f46a807cf00 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 crypto rx=0x7f46bc0d0de0 tx=0x7f46ac009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:52:23.420 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:23.418+0000 7f46b9ffb640 1 -- 172.21.15.150:0/2387547341 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f46b4020020 con 0x7f46bc15ee30 2024-09-17T05:52:23.595 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:23.594+0000 7f46c3933640 1 -- 172.21.15.150:0/2387547341 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f46bc151570 con 0x7f46bc15ee30 2024-09-17T05:52:23.596 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:23.595+0000 7f46b9ffb640 1 -- 172.21.15.150:0/2387547341 <== mon.0 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v127) ==== 74+0+17042 (secure 0 0 0) 0x7f46b40638c0 con 0x7f46bc15ee30 2024-09-17T05:52:23.597 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-09-17T05:52:23.597 INFO:teuthology.orchestra.run.smithi150.stdout:{"epoch":127,"fsid":"9f2e05e9-d629-47b3-b26b-1360655b7d20","created":"2024-09-17T05:41:32.502979+0000","modified":"2024-09-17T05:52:20.892542+0000","last_up_change":"2024-09-17T05:41:46.150225+0000","last_in_change":"2024-09-17T05:41:36.120274+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":19,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T05:41:46.860779+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":18,"pool_name":"cephfs_metadata","create_time":"2024-09-17T05:52:16.897390+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"126","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":19,"pool_name":"cephfs_data","create_time":"2024-09-17T05:52:18.214964+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"127","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"4f31c018-c8a4-4d6d-b0c2-a597c47aae4a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":125,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6800","nonce":479374392},{"type":"v1","addr":"172.21.15.150:6801","nonce":479374392}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6802","nonce":479374392},{"type":"v1","addr":"172.21.15.150:6803","nonce":479374392}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6806","nonce":479374392},{"type":"v1","addr":"172.21.15.150:6807","nonce":479374392}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6804","nonce":479374392},{"type":"v1","addr":"172.21.15.150:6805","nonce":479374392}]},"public_addr":"172.21.15.150:6801/479374392","cluster_addr":"172.21.15.150:6803/479374392","heartbeat_back_addr":"172.21.15.150:6807/479374392","heartbeat_front_addr":"172.21.15.150:6805/479374392","state":["exists","up"]},{"osd":1,"uuid":"6ff4a573-500b-4e04-9de3-39265ead78b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":125,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6824","nonce":913899800},{"type":"v1","addr":"172.21.15.150:6825","nonce":913899800}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6826","nonce":913899800},{"type":"v1","addr":"172.21.15.150:6827","nonce":913899800}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6830","nonce":913899800},{"type":"v1","addr":"172.21.15.150:6831","nonce":913899800}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6828","nonce":913899800},{"type":"v1","addr":"172.21.15.150:6829","nonce":913899800}]},"public_addr":"172.21.15.150:6825/913899800","cluster_addr":"172.21.15.150:6827/913899800","heartbeat_back_addr":"172.21.15.150:6831/913899800","heartbeat_front_addr":"172.21.15.150:6829/913899800","state":["exists","up"]},{"osd":2,"uuid":"bffea6f9-2465-4182-b205-00436c41ac1c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":125,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6816","nonce":363718461},{"type":"v1","addr":"172.21.15.150:6817","nonce":363718461}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6818","nonce":363718461},{"type":"v1","addr":"172.21.15.150:6819","nonce":363718461}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6822","nonce":363718461},{"type":"v1","addr":"172.21.15.150:6823","nonce":363718461}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6820","nonce":363718461},{"type":"v1","addr":"172.21.15.150:6821","nonce":363718461}]},"public_addr":"172.21.15.150:6817/363718461","cluster_addr":"172.21.15.150:6819/363718461","heartbeat_back_addr":"172.21.15.150:6823/363718461","heartbeat_front_addr":"172.21.15.150:6821/363718461","state":["exists","up"]},{"osd":3,"uuid":"cda70430-d1e1-427e-b04e-56db4031d078","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":125,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6808","nonce":3550994626},{"type":"v1","addr":"172.21.15.150:6809","nonce":3550994626}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6810","nonce":3550994626},{"type":"v1","addr":"172.21.15.150:6811","nonce":3550994626}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6814","nonce":3550994626},{"type":"v1","addr":"172.21.15.150:6815","nonce":3550994626}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6812","nonce":3550994626},{"type":"v1","addr":"172.21.15.150:6813","nonce":3550994626}]},"public_addr":"172.21.15.150:6809/3550994626","cluster_addr":"172.21.15.150:6811/3550994626","heartbeat_back_addr":"172.21.15.150:6815/3550994626","heartbeat_front_addr":"172.21.15.150:6813/3550994626","state":["exists","up"]},{"osd":4,"uuid":"3a0277fb-5e1e-4f68-bb2d-9a8a0152f64a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":125,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6810","nonce":2718261497},{"type":"v1","addr":"172.21.15.176:6811","nonce":2718261497}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6812","nonce":2718261497},{"type":"v1","addr":"172.21.15.176:6813","nonce":2718261497}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6816","nonce":2718261497},{"type":"v1","addr":"172.21.15.176:6817","nonce":2718261497}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6814","nonce":2718261497},{"type":"v1","addr":"172.21.15.176:6815","nonce":2718261497}]},"public_addr":"172.21.15.176:6811/2718261497","cluster_addr":"172.21.15.176:6813/2718261497","heartbeat_back_addr":"172.21.15.176:6817/2718261497","heartbeat_front_addr":"172.21.15.176:6815/2718261497","state":["exists","up"]},{"osd":5,"uuid":"33aebee6-0315-40b7-a11c-6702f0be494d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":125,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6818","nonce":2049295774},{"type":"v1","addr":"172.21.15.176:6819","nonce":2049295774}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6820","nonce":2049295774},{"type":"v1","addr":"172.21.15.176:6821","nonce":2049295774}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6824","nonce":2049295774},{"type":"v1","addr":"172.21.15.176:6825","nonce":2049295774}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6822","nonce":2049295774},{"type":"v1","addr":"172.21.15.176:6823","nonce":2049295774}]},"public_addr":"172.21.15.176:6819/2049295774","cluster_addr":"172.21.15.176:6821/2049295774","heartbeat_back_addr":"172.21.15.176:6825/2049295774","heartbeat_front_addr":"172.21.15.176:6823/2049295774","state":["exists","up"]},{"osd":6,"uuid":"4d24f360-6751-4263-841b-d77793d33540","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":125,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6826","nonce":2164458476},{"type":"v1","addr":"172.21.15.176:6827","nonce":2164458476}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6828","nonce":2164458476},{"type":"v1","addr":"172.21.15.176:6829","nonce":2164458476}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6832","nonce":2164458476},{"type":"v1","addr":"172.21.15.176:6833","nonce":2164458476}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6830","nonce":2164458476},{"type":"v1","addr":"172.21.15.176:6831","nonce":2164458476}]},"public_addr":"172.21.15.176:6827/2164458476","cluster_addr":"172.21.15.176:6829/2164458476","heartbeat_back_addr":"172.21.15.176:6833/2164458476","heartbeat_front_addr":"172.21.15.176:6831/2164458476","state":["exists","up"]},{"osd":7,"uuid":"c8594fda-c74a-4ba9-8277-caf101d58ca1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":125,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6802","nonce":3239587708},{"type":"v1","addr":"172.21.15.176:6803","nonce":3239587708}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6804","nonce":3239587708},{"type":"v1","addr":"172.21.15.176:6805","nonce":3239587708}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6808","nonce":3239587708},{"type":"v1","addr":"172.21.15.176:6809","nonce":3239587708}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6806","nonce":3239587708},{"type":"v1","addr":"172.21.15.176:6807","nonce":3239587708}]},"public_addr":"172.21.15.176:6803/3239587708","cluster_addr":"172.21.15.176:6805/3239587708","heartbeat_back_addr":"172.21.15.176:6809/3239587708","heartbeat_front_addr":"172.21.15.176:6807/3239587708","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:41:41.905151+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:41:42.705679+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:41:42.459673+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:41:42.440819+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:41:42.668428+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:41:42.694972+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:41:43.078535+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:41:42.363539+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":7,"snaps":[{"begin":2,"length":2}]},{"pool":9,"snaps":[{"begin":2,"length":2}]},{"pool":11,"snaps":[{"begin":2,"length":2}]},{"pool":13,"snaps":[{"begin":2,"length":2}]},{"pool":15,"snaps":[{"begin":2,"length":2}]},{"pool":17,"snaps":[{"begin":2,"length":2}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T05:52:23.599 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:23.597+0000 7f46c3933640 1 -- 172.21.15.150:0/2387547341 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f46a807a9f0 msgr2=0x7f46a807cf00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:52:23.599 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:23.597+0000 7f46c3933640 1 --2- 172.21.15.150:0/2387547341 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f46a807a9f0 0x7f46a807cf00 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 crypto rx=0x7f46bc0d0de0 tx=0x7f46ac009040 comp rx=0 tx=0).stop 2024-09-17T05:52:23.599 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:23.597+0000 7f46c3933640 1 -- 172.21.15.150:0/2387547341 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f46bc15ee30 msgr2=0x7f46bc154020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:52:23.599 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:23.597+0000 7f46c3933640 1 --2- 172.21.15.150:0/2387547341 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f46bc15ee30 0x7f46bc154020 secure :-1 s=READY pgs=1678 cs=0 l=1 rev1=1 crypto rx=0x7f46b400d6a0 tx=0x7f46b400db60 comp rx=0 tx=0).stop 2024-09-17T05:52:23.599 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:23.597+0000 7f46c3933640 1 -- 172.21.15.150:0/2387547341 shutdown_connections 2024-09-17T05:52:23.599 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:23.597+0000 7f46c3933640 1 --2- 172.21.15.150:0/2387547341 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f46bc0cf7c0 0x7f46bc153ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:52:23.599 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:23.597+0000 7f46c3933640 1 --2- 172.21.15.150:0/2387547341 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f46a807a9f0 0x7f46a807cf00 unknown :-1 s=CLOSED pgs=713 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:52:23.599 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:23.597+0000 7f46c3933640 1 --2- 172.21.15.150:0/2387547341 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f46bc15ee30 0x7f46bc154020 unknown :-1 s=CLOSED pgs=1678 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:52:23.600 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:23.597+0000 7f46c3933640 1 --2- 172.21.15.150:0/2387547341 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f46bc0b5410 0x7f46bc0ce7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:52:23.600 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:23.597+0000 7f46c3933640 1 -- 172.21.15.150:0/2387547341 >> 172.21.15.150:0/2387547341 conn(0x7f46bc0b2fd0 msgr2=0x7f46bc0b0e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:52:23.600 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:23.597+0000 7f46c3933640 1 -- 172.21.15.150:0/2387547341 shutdown_connections 2024-09-17T05:52:23.600 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:23.597+0000 7f46c3933640 1 -- 172.21.15.150:0/2387547341 wait complete. 2024-09-17T05:52:23.611 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-17T05:52:23.611 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-17T05:52:23.725 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:23.722+0000 7fe76464d640 1 -- 172.21.15.150:0/1392541250 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe75c152920 msgr2=0x7fe75c15f3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:52:23.725 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:23.722+0000 7fe76464d640 1 --2- 172.21.15.150:0/1392541250 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe75c152920 0x7fe75c15f3d0 secure :-1 s=READY pgs=1680 cs=0 l=1 rev1=1 crypto rx=0x7fe74c005fd0 tx=0x7fe74c02a540 comp rx=0 tx=0).stop 2024-09-17T05:52:23.725 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:23.723+0000 7fe76464d640 1 -- 172.21.15.150:0/1392541250 shutdown_connections 2024-09-17T05:52:23.725 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:23.723+0000 7fe76464d640 1 --2- 172.21.15.150:0/1392541250 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe75c152920 0x7fe75c15f3d0 unknown :-1 s=CLOSED pgs=1680 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:52:23.725 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:23.723+0000 7fe76464d640 1 -- 172.21.15.150:0/1392541250 >> 172.21.15.150:0/1392541250 conn(0x7fe75c06d730 msgr2=0x7fe75c0b1e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:52:23.725 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:23.723+0000 7fe76464d640 1 -- 172.21.15.150:0/1392541250 shutdown_connections 2024-09-17T05:52:23.725 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:23.723+0000 7fe76464d640 1 -- 172.21.15.150:0/1392541250 wait complete. 2024-09-17T05:52:23.726 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:23.724+0000 7fe76464d640 1 Processor -- start 2024-09-17T05:52:23.726 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:23.724+0000 7fe76464d640 1 -- start start 2024-09-17T05:52:23.729 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:23.726+0000 7fe76464d640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe75c0aebc0 0x7fe75c0b1530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:52:23.729 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:23.726+0000 7fe76464d640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe75c152920 0x7fe75c0cd9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:52:23.729 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:23.726+0000 7fe76464d640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe75c15f910 0x7fe75c15a8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:52:23.729 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:23.726+0000 7fe76464d640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7fe75c0b4390 con 0x7fe75c0aebc0 2024-09-17T05:52:23.729 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:23.726+0000 7fe76464d640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fe75c0b4210 con 0x7fe75c15f910 2024-09-17T05:52:23.729 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:23.726+0000 7fe76464d640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fe75c0b4510 con 0x7fe75c152920 2024-09-17T05:52:23.729 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:23.726+0000 7fe7623e9640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe75c0aebc0 0x7fe75c0b1530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:52:23.729 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:23.726+0000 7fe7623e9640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe75c0aebc0 0x7fe75c0b1530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:35732/0 (socket says 172.21.15.150:35732) 2024-09-17T05:52:23.729 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:23.726+0000 7fe7623e9640 1 -- 172.21.15.150:0/1212181020 learned_addr learned my addr 172.21.15.150:0/1212181020 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:52:23.730 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:23.726+0000 7fe762bea640 1 --2- 172.21.15.150:0/1212181020 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe75c15f910 0x7fe75c15a8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:52:23.730 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:23.726+0000 7fe761be8640 1 --2- 172.21.15.150:0/1212181020 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe75c152920 0x7fe75c0cd9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:52:23.730 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:23.726+0000 7fe7623e9640 1 -- 172.21.15.150:0/1212181020 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe75c152920 msgr2=0x7fe75c0cd9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:52:23.730 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:23.726+0000 7fe7623e9640 1 --2- 172.21.15.150:0/1212181020 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe75c152920 0x7fe75c0cd9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:52:23.730 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:23.726+0000 7fe7623e9640 1 -- 172.21.15.150:0/1212181020 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe75c15f910 msgr2=0x7fe75c15a8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:52:23.730 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:23.726+0000 7fe7623e9640 1 --2- 172.21.15.150:0/1212181020 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe75c15f910 0x7fe75c15a8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:52:23.730 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:23.726+0000 7fe7623e9640 1 -- 172.21.15.150:0/1212181020 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe75c0cc440 con 0x7fe75c0aebc0 2024-09-17T05:52:23.730 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:23.726+0000 7fe761be8640 1 --2- 172.21.15.150:0/1212181020 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe75c152920 0x7fe75c0cd9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T05:52:23.730 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:23.726+0000 7fe762bea640 1 --2- 172.21.15.150:0/1212181020 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe75c15f910 0x7fe75c15a8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:52:23.730 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:23.726+0000 7fe7623e9640 1 --2- 172.21.15.150:0/1212181020 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe75c0aebc0 0x7fe75c0b1530 secure :-1 s=READY pgs=1681 cs=0 l=1 rev1=1 crypto rx=0x7fe75800b420 tx=0x7fe75800b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:52:23.730 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:23.726+0000 7fe752ffd640 1 -- 172.21.15.150:0/1212181020 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe758011830 con 0x7fe75c0aebc0 2024-09-17T05:52:23.730 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:23.726+0000 7fe752ffd640 1 -- 172.21.15.150:0/1212181020 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe758016070 con 0x7fe75c0aebc0 2024-09-17T05:52:23.731 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:23.726+0000 7fe76464d640 1 -- 172.21.15.150:0/1212181020 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe75c0cc940 con 0x7fe75c0aebc0 2024-09-17T05:52:23.731 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:23.726+0000 7fe752ffd640 1 -- 172.21.15.150:0/1212181020 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe758011d60 con 0x7fe75c0aebc0 2024-09-17T05:52:23.731 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:23.727+0000 7fe76464d640 1 -- 172.21.15.150:0/1212181020 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe75c0ccf00 con 0x7fe75c0aebc0 2024-09-17T05:52:23.731 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:23.727+0000 7fe76464d640 1 -- 172.21.15.150:0/1212181020 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe75c0b49e0 con 0x7fe75c0aebc0 2024-09-17T05:52:23.731 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:23.728+0000 7fe752ffd640 1 -- 172.21.15.150:0/1212181020 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 42) ==== 104195+0+0 (secure 0 0 0) 0x7fe75801b460 con 0x7fe75c0aebc0 2024-09-17T05:52:23.732 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:23.729+0000 7fe752ffd640 1 --2- 172.21.15.150:0/1212181020 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fe74007a9f0 0x7fe74007cf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:52:23.732 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:23.729+0000 7fe752ffd640 1 -- 172.21.15.150:0/1212181020 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(127..127 src has 1..127) ==== 5877+0+0 (secure 0 0 0) 0x7fe758099880 con 0x7fe75c0aebc0 2024-09-17T05:52:23.732 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:23.729+0000 7fe761be8640 1 --2- 172.21.15.150:0/1212181020 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fe74007a9f0 0x7fe74007cf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:52:23.732 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:23.730+0000 7fe761be8640 1 --2- 172.21.15.150:0/1212181020 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fe74007a9f0 0x7fe74007cf00 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x7fe74c033000 tx=0x7fe74c004730 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:52:23.735 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:23.733+0000 7fe752ffd640 1 -- 172.21.15.150:0/1212181020 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fe758020020 con 0x7fe75c0aebc0 2024-09-17T05:52:23.910 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:23.908+0000 7fe76464d640 1 -- 172.21.15.150:0/1212181020 --> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fe75c0b1c00 con 0x7fe74007a9f0 2024-09-17T05:52:23.915 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:23.913+0000 7fe752ffd640 1 -- 172.21.15.150:0/1212181020 <== mgr.4108 v2:172.21.15.176:6800/3631216395 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+245437 (secure 0 0 0) 0x7fe75c0b1c00 con 0x7fe74007a9f0 2024-09-17T05:52:23.918 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-09-17T05:52:23.919 INFO:teuthology.orchestra.run.smithi150.stderr:dumped all 2024-09-17T05:52:23.921 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:23.916+0000 7fe76464d640 1 -- 172.21.15.150:0/1212181020 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fe74007a9f0 msgr2=0x7fe74007cf00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:52:23.921 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:23.916+0000 7fe76464d640 1 --2- 172.21.15.150:0/1212181020 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fe74007a9f0 0x7fe74007cf00 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x7fe74c033000 tx=0x7fe74c004730 comp rx=0 tx=0).stop 2024-09-17T05:52:23.921 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:23.916+0000 7fe76464d640 1 -- 172.21.15.150:0/1212181020 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe75c0aebc0 msgr2=0x7fe75c0b1530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:52:23.921 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:23.916+0000 7fe76464d640 1 --2- 172.21.15.150:0/1212181020 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe75c0aebc0 0x7fe75c0b1530 secure :-1 s=READY pgs=1681 cs=0 l=1 rev1=1 crypto rx=0x7fe75800b420 tx=0x7fe75800b8e0 comp rx=0 tx=0).stop 2024-09-17T05:52:23.921 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:23.916+0000 7fe76464d640 1 -- 172.21.15.150:0/1212181020 shutdown_connections 2024-09-17T05:52:23.921 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:23.916+0000 7fe76464d640 1 --2- 172.21.15.150:0/1212181020 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe75c15f910 0x7fe75c15a8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:52:23.921 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:23.916+0000 7fe76464d640 1 --2- 172.21.15.150:0/1212181020 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fe74007a9f0 0x7fe74007cf00 unknown :-1 s=CLOSED pgs=714 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:52:23.922 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:23.916+0000 7fe76464d640 1 --2- 172.21.15.150:0/1212181020 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe75c152920 0x7fe75c0cd9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:52:23.922 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:23.916+0000 7fe76464d640 1 --2- 172.21.15.150:0/1212181020 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe75c0aebc0 0x7fe75c0b1530 unknown :-1 s=CLOSED pgs=1681 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:52:23.922 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:23.916+0000 7fe76464d640 1 -- 172.21.15.150:0/1212181020 >> 172.21.15.150:0/1212181020 conn(0x7fe75c06d730 msgr2=0x7fe75c074650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:52:23.922 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:23.916+0000 7fe76464d640 1 -- 172.21.15.150:0/1212181020 shutdown_connections 2024-09-17T05:52:23.922 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:23.917+0000 7fe76464d640 1 -- 172.21.15.150:0/1212181020 wait complete. 2024-09-17T05:52:23.930 INFO:teuthology.orchestra.run.smithi150.stdout:{"pg_ready":true,"pg_map":{"version":440,"stamp":"2024-09-17T05:52:23.078310+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":591166,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":116,"num_write_kb":1639,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":87,"ondisk_log_size":87,"up":118,"acting":118,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":66,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":1046712,"kb_used_data":13312,"kb_used_omap":12,"kb_used_meta":1033203,"kb_avail":753928008,"statfs":{"total":773094113280,"available":772022280192,"internally_reserved":0,"allocated":13631488,"data_stored":6616226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":1058000432},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":15,"apply_latency_ms":15,"commit_latency_ns":15000000,"apply_latency_ns":15000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":798,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.203422"},"pg_stats":[{"pgid":"19.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:52:18.873991+0000","last_change":"2024-09-17T05:52:18.873991+0000","last_active":"2024-09-17T05:52:18.873991+0000","last_peered":"2024-09-17T05:52:18.873991+0000","last_clean":"2024-09-17T05:52:18.873991+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:52:18.873991+0000","last_undegraded":"2024-09-17T05:52:18.873991+0000","last_fullsized":"2024-09-17T05:52:18.873991+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:52:18.873991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:52:18.873991+0000","last_clean_scrub_stamp":"2024-09-17T05:52:18.873991+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:52:18.873991+0000","last_change":"2024-09-17T05:52:18.873991+0000","last_active":"2024-09-17T05:52:18.873991+0000","last_peered":"2024-09-17T05:52:18.873991+0000","last_clean":"2024-09-17T05:52:18.873991+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:52:18.873991+0000","last_undegraded":"2024-09-17T05:52:18.873991+0000","last_fullsized":"2024-09-17T05:52:18.873991+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:52:18.873991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:52:18.873991+0000","last_clean_scrub_stamp":"2024-09-17T05:52:18.873991+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:52:18.873991+0000","last_change":"2024-09-17T05:52:18.873991+0000","last_active":"2024-09-17T05:52:18.873991+0000","last_peered":"2024-09-17T05:52:18.873991+0000","last_clean":"2024-09-17T05:52:18.873991+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:52:18.873991+0000","last_undegraded":"2024-09-17T05:52:18.873991+0000","last_fullsized":"2024-09-17T05:52:18.873991+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:52:18.873991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:52:18.873991+0000","last_clean_scrub_stamp":"2024-09-17T05:52:18.873991+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:52:18.873991+0000","last_change":"2024-09-17T05:52:18.873991+0000","last_active":"2024-09-17T05:52:18.873991+0000","last_peered":"2024-09-17T05:52:18.873991+0000","last_clean":"2024-09-17T05:52:18.873991+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:52:18.873991+0000","last_undegraded":"2024-09-17T05:52:18.873991+0000","last_fullsized":"2024-09-17T05:52:18.873991+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:52:18.873991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:52:18.873991+0000","last_clean_scrub_stamp":"2024-09-17T05:52:18.873991+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.3b","version":"0'0","reported_seq":13,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-09-17T05:52:20.913430+0000","last_change":"2024-09-17T05:52:19.923296+0000","last_active":"2024-09-17T05:52:20.913430+0000","last_peered":"2024-09-17T05:52:20.913430+0000","last_clean":"2024-09-17T05:52:20.913430+0000","last_became_active":"2024-09-17T05:52:19.922558+0000","last_became_peered":"2024-09-17T05:52:19.922558+0000","last_unstale":"2024-09-17T05:52:20.913430+0000","last_undegraded":"2024-09-17T05:52:20.913430+0000","last_fullsized":"2024-09-17T05:52:20.913430+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:52:18.873991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:52:18.873991+0000","last_clean_scrub_stamp":"2024-09-17T05:52:18.873991+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:14:31.803577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.3a","version":"0'0","reported_seq":13,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-09-17T05:52:20.916572+0000","last_change":"2024-09-17T05:52:19.921204+0000","last_active":"2024-09-17T05:52:20.916572+0000","last_peered":"2024-09-17T05:52:20.916572+0000","last_clean":"2024-09-17T05:52:20.916572+0000","last_became_active":"2024-09-17T05:52:19.920892+0000","last_became_peered":"2024-09-17T05:52:19.920892+0000","last_unstale":"2024-09-17T05:52:20.916572+0000","last_undegraded":"2024-09-17T05:52:20.916572+0000","last_fullsized":"2024-09-17T05:52:20.916572+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:52:18.873991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:52:18.873991+0000","last_clean_scrub_stamp":"2024-09-17T05:52:18.873991+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:03:02.474723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.39","version":"0'0","reported_seq":13,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-09-17T05:52:20.915990+0000","last_change":"2024-09-17T05:52:19.926803+0000","last_active":"2024-09-17T05:52:20.915990+0000","last_peered":"2024-09-17T05:52:20.915990+0000","last_clean":"2024-09-17T05:52:20.915990+0000","last_became_active":"2024-09-17T05:52:19.926478+0000","last_became_peered":"2024-09-17T05:52:19.926478+0000","last_unstale":"2024-09-17T05:52:20.915990+0000","last_undegraded":"2024-09-17T05:52:20.915990+0000","last_fullsized":"2024-09-17T05:52:20.915990+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:52:18.873991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:52:18.873991+0000","last_clean_scrub_stamp":"2024-09-17T05:52:18.873991+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:48:46.344445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:52:18.873991+0000","last_change":"2024-09-17T05:52:18.873991+0000","last_active":"2024-09-17T05:52:18.873991+0000","last_peered":"2024-09-17T05:52:18.873991+0000","last_clean":"2024-09-17T05:52:18.873991+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:52:18.873991+0000","last_undegraded":"2024-09-17T05:52:18.873991+0000","last_fullsized":"2024-09-17T05:52:18.873991+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:52:18.873991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:52:18.873991+0000","last_clean_scrub_stamp":"2024-09-17T05:52:18.873991+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:52:18.873991+0000","last_change":"2024-09-17T05:52:18.873991+0000","last_active":"2024-09-17T05:52:18.873991+0000","last_peered":"2024-09-17T05:52:18.873991+0000","last_clean":"2024-09-17T05:52:18.873991+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:52:18.873991+0000","last_undegraded":"2024-09-17T05:52:18.873991+0000","last_fullsized":"2024-09-17T05:52:18.873991+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:52:18.873991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:52:18.873991+0000","last_clean_scrub_stamp":"2024-09-17T05:52:18.873991+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:52:18.873991+0000","last_change":"2024-09-17T05:52:18.873991+0000","last_active":"2024-09-17T05:52:18.873991+0000","last_peered":"2024-09-17T05:52:18.873991+0000","last_clean":"2024-09-17T05:52:18.873991+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:52:18.873991+0000","last_undegraded":"2024-09-17T05:52:18.873991+0000","last_fullsized":"2024-09-17T05:52:18.873991+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:52:18.873991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:52:18.873991+0000","last_clean_scrub_stamp":"2024-09-17T05:52:18.873991+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.35","version":"0'0","reported_seq":1,"reported_epoch":125,"state":"creating+peering","last_fresh":"2024-09-17T05:52:18.886163+0000","last_change":"2024-09-17T05:52:18.886163+0000","last_active":"2024-09-17T05:52:18.873991+0000","last_peered":"2024-09-17T05:52:18.873991+0000","last_clean":"2024-09-17T05:52:18.873991+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:52:18.886163+0000","last_undegraded":"2024-09-17T05:52:18.886163+0000","last_fullsized":"2024-09-17T05:52:18.886163+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:52:18.873991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:52:18.873991+0000","last_clean_scrub_stamp":"2024-09-17T05:52:18.873991+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:52:18.873991+0000","last_change":"2024-09-17T05:52:18.873991+0000","last_active":"2024-09-17T05:52:18.873991+0000","last_peered":"2024-09-17T05:52:18.873991+0000","last_clean":"2024-09-17T05:52:18.873991+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:52:18.873991+0000","last_undegraded":"2024-09-17T05:52:18.873991+0000","last_fullsized":"2024-09-17T05:52:18.873991+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:52:18.873991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:52:18.873991+0000","last_clean_scrub_stamp":"2024-09-17T05:52:18.873991+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:52:18.873991+0000","last_change":"2024-09-17T05:52:18.873991+0000","last_active":"2024-09-17T05:52:18.873991+0000","last_peered":"2024-09-17T05:52:18.873991+0000","last_clean":"2024-09-17T05:52:18.873991+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:52:18.873991+0000","last_undegraded":"2024-09-17T05:52:18.873991+0000","last_fullsized":"2024-09-17T05:52:18.873991+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:52:18.873991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:52:18.873991+0000","last_clean_scrub_stamp":"2024-09-17T05:52:18.873991+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:52:18.873991+0000","last_change":"2024-09-17T05:52:18.873991+0000","last_active":"2024-09-17T05:52:18.873991+0000","last_peered":"2024-09-17T05:52:18.873991+0000","last_clean":"2024-09-17T05:52:18.873991+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:52:18.873991+0000","last_undegraded":"2024-09-17T05:52:18.873991+0000","last_fullsized":"2024-09-17T05:52:18.873991+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:52:18.873991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:52:18.873991+0000","last_clean_scrub_stamp":"2024-09-17T05:52:18.873991+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:52:18.873991+0000","last_change":"2024-09-17T05:52:18.873991+0000","last_active":"2024-09-17T05:52:18.873991+0000","last_peered":"2024-09-17T05:52:18.873991+0000","last_clean":"2024-09-17T05:52:18.873991+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:52:18.873991+0000","last_undegraded":"2024-09-17T05:52:18.873991+0000","last_fullsized":"2024-09-17T05:52:18.873991+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:52:18.873991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:52:18.873991+0000","last_clean_scrub_stamp":"2024-09-17T05:52:18.873991+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:52:18.873991+0000","last_change":"2024-09-17T05:52:18.873991+0000","last_active":"2024-09-17T05:52:18.873991+0000","last_peered":"2024-09-17T05:52:18.873991+0000","last_clean":"2024-09-17T05:52:18.873991+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:52:18.873991+0000","last_undegraded":"2024-09-17T05:52:18.873991+0000","last_fullsized":"2024-09-17T05:52:18.873991+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:52:18.873991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:52:18.873991+0000","last_clean_scrub_stamp":"2024-09-17T05:52:18.873991+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.2f","version":"0'0","reported_seq":13,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-09-17T05:52:20.916291+0000","last_change":"2024-09-17T05:52:19.927246+0000","last_active":"2024-09-17T05:52:20.916291+0000","last_peered":"2024-09-17T05:52:20.916291+0000","last_clean":"2024-09-17T05:52:20.916291+0000","last_became_active":"2024-09-17T05:52:19.926923+0000","last_became_peered":"2024-09-17T05:52:19.926923+0000","last_unstale":"2024-09-17T05:52:20.916291+0000","last_undegraded":"2024-09-17T05:52:20.916291+0000","last_fullsized":"2024-09-17T05:52:20.916291+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:52:18.873991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:52:18.873991+0000","last_clean_scrub_stamp":"2024-09-17T05:52:18.873991+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:11:04.819830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:52:18.873991+0000","last_change":"2024-09-17T05:52:18.873991+0000","last_active":"2024-09-17T05:52:18.873991+0000","last_peered":"2024-09-17T05:52:18.873991+0000","last_clean":"2024-09-17T05:52:18.873991+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:52:18.873991+0000","last_undegraded":"2024-09-17T05:52:18.873991+0000","last_fullsized":"2024-09-17T05:52:18.873991+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:52:18.873991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:52:18.873991+0000","last_clean_scrub_stamp":"2024-09-17T05:52:18.873991+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.2d","version":"0'0","reported_seq":1,"reported_epoch":125,"state":"creating+peering","last_fresh":"2024-09-17T05:52:18.885679+0000","last_change":"2024-09-17T05:52:18.885679+0000","last_active":"2024-09-17T05:52:18.873991+0000","last_peered":"2024-09-17T05:52:18.873991+0000","last_clean":"2024-09-17T05:52:18.873991+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:52:18.885679+0000","last_undegraded":"2024-09-17T05:52:18.885679+0000","last_fullsized":"2024-09-17T05:52:18.885679+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:52:18.873991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:52:18.873991+0000","last_clean_scrub_stamp":"2024-09-17T05:52:18.873991+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:52:18.873991+0000","last_change":"2024-09-17T05:52:18.873991+0000","last_active":"2024-09-17T05:52:18.873991+0000","last_peered":"2024-09-17T05:52:18.873991+0000","last_clean":"2024-09-17T05:52:18.873991+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:52:18.873991+0000","last_undegraded":"2024-09-17T05:52:18.873991+0000","last_fullsized":"2024-09-17T05:52:18.873991+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:52:18.873991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:52:18.873991+0000","last_clean_scrub_stamp":"2024-09-17T05:52:18.873991+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.2b","version":"0'0","reported_seq":13,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-09-17T05:52:20.913343+0000","last_change":"2024-09-17T05:52:19.923630+0000","last_active":"2024-09-17T05:52:20.913343+0000","last_peered":"2024-09-17T05:52:20.913343+0000","last_clean":"2024-09-17T05:52:20.913343+0000","last_became_active":"2024-09-17T05:52:19.922986+0000","last_became_peered":"2024-09-17T05:52:19.922986+0000","last_unstale":"2024-09-17T05:52:20.913343+0000","last_undegraded":"2024-09-17T05:52:20.913343+0000","last_fullsized":"2024-09-17T05:52:20.913343+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:52:18.873991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:52:18.873991+0000","last_clean_scrub_stamp":"2024-09-17T05:52:18.873991+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:27:22.837955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.2a","version":"0'0","reported_seq":1,"reported_epoch":125,"state":"creating+peering","last_fresh":"2024-09-17T05:52:18.885585+0000","last_change":"2024-09-17T05:52:18.885585+0000","last_active":"2024-09-17T05:52:18.873991+0000","last_peered":"2024-09-17T05:52:18.873991+0000","last_clean":"2024-09-17T05:52:18.873991+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:52:18.885585+0000","last_undegraded":"2024-09-17T05:52:18.885585+0000","last_fullsized":"2024-09-17T05:52:18.885585+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:52:18.873991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:52:18.873991+0000","last_clean_scrub_stamp":"2024-09-17T05:52:18.873991+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:52:18.873991+0000","last_change":"2024-09-17T05:52:18.873991+0000","last_active":"2024-09-17T05:52:18.873991+0000","last_peered":"2024-09-17T05:52:18.873991+0000","last_clean":"2024-09-17T05:52:18.873991+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:52:18.873991+0000","last_undegraded":"2024-09-17T05:52:18.873991+0000","last_fullsized":"2024-09-17T05:52:18.873991+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:52:18.873991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:52:18.873991+0000","last_clean_scrub_stamp":"2024-09-17T05:52:18.873991+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.28","version":"0'0","reported_seq":1,"reported_epoch":125,"state":"creating+peering","last_fresh":"2024-09-17T05:52:18.884950+0000","last_change":"2024-09-17T05:52:18.884950+0000","last_active":"2024-09-17T05:52:18.873991+0000","last_peered":"2024-09-17T05:52:18.873991+0000","last_clean":"2024-09-17T05:52:18.873991+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:52:18.884950+0000","last_undegraded":"2024-09-17T05:52:18.884950+0000","last_fullsized":"2024-09-17T05:52:18.884950+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:52:18.873991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:52:18.873991+0000","last_clean_scrub_stamp":"2024-09-17T05:52:18.873991+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:52:18.873991+0000","last_change":"2024-09-17T05:52:18.873991+0000","last_active":"2024-09-17T05:52:18.873991+0000","last_peered":"2024-09-17T05:52:18.873991+0000","last_clean":"2024-09-17T05:52:18.873991+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:52:18.873991+0000","last_undegraded":"2024-09-17T05:52:18.873991+0000","last_fullsized":"2024-09-17T05:52:18.873991+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:52:18.873991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:52:18.873991+0000","last_clean_scrub_stamp":"2024-09-17T05:52:18.873991+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:52:18.873991+0000","last_change":"2024-09-17T05:52:18.873991+0000","last_active":"2024-09-17T05:52:18.873991+0000","last_peered":"2024-09-17T05:52:18.873991+0000","last_clean":"2024-09-17T05:52:18.873991+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:52:18.873991+0000","last_undegraded":"2024-09-17T05:52:18.873991+0000","last_fullsized":"2024-09-17T05:52:18.873991+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:52:18.873991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:52:18.873991+0000","last_clean_scrub_stamp":"2024-09-17T05:52:18.873991+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:52:18.873991+0000","last_change":"2024-09-17T05:52:18.873991+0000","last_active":"2024-09-17T05:52:18.873991+0000","last_peered":"2024-09-17T05:52:18.873991+0000","last_clean":"2024-09-17T05:52:18.873991+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:52:18.873991+0000","last_undegraded":"2024-09-17T05:52:18.873991+0000","last_fullsized":"2024-09-17T05:52:18.873991+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:52:18.873991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:52:18.873991+0000","last_clean_scrub_stamp":"2024-09-17T05:52:18.873991+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.24","version":"0'0","reported_seq":13,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-09-17T05:52:21.029763+0000","last_change":"2024-09-17T05:52:19.919487+0000","last_active":"2024-09-17T05:52:21.029763+0000","last_peered":"2024-09-17T05:52:21.029763+0000","last_clean":"2024-09-17T05:52:21.029763+0000","last_became_active":"2024-09-17T05:52:19.919132+0000","last_became_peered":"2024-09-17T05:52:19.919132+0000","last_unstale":"2024-09-17T05:52:21.029763+0000","last_undegraded":"2024-09-17T05:52:21.029763+0000","last_fullsized":"2024-09-17T05:52:21.029763+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:52:18.873991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:52:18.873991+0000","last_clean_scrub_stamp":"2024-09-17T05:52:18.873991+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:47:54.083475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:52:18.873991+0000","last_change":"2024-09-17T05:52:18.873991+0000","last_active":"2024-09-17T05:52:18.873991+0000","last_peered":"2024-09-17T05:52:18.873991+0000","last_clean":"2024-09-17T05:52:18.873991+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:52:18.873991+0000","last_undegraded":"2024-09-17T05:52:18.873991+0000","last_fullsized":"2024-09-17T05:52:18.873991+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:52:18.873991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:52:18.873991+0000","last_clean_scrub_stamp":"2024-09-17T05:52:18.873991+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:52:18.873991+0000","last_change":"2024-09-17T05:52:18.873991+0000","last_active":"2024-09-17T05:52:18.873991+0000","last_peered":"2024-09-17T05:52:18.873991+0000","last_clean":"2024-09-17T05:52:18.873991+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:52:18.873991+0000","last_undegraded":"2024-09-17T05:52:18.873991+0000","last_fullsized":"2024-09-17T05:52:18.873991+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:52:18.873991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:52:18.873991+0000","last_clean_scrub_stamp":"2024-09-17T05:52:18.873991+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.21","version":"0'0","reported_seq":13,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-09-17T05:52:20.912884+0000","last_change":"2024-09-17T05:52:19.921396+0000","last_active":"2024-09-17T05:52:20.912884+0000","last_peered":"2024-09-17T05:52:20.912884+0000","last_clean":"2024-09-17T05:52:20.912884+0000","last_became_active":"2024-09-17T05:52:19.916646+0000","last_became_peered":"2024-09-17T05:52:19.916646+0000","last_unstale":"2024-09-17T05:52:20.912884+0000","last_undegraded":"2024-09-17T05:52:20.912884+0000","last_fullsized":"2024-09-17T05:52:20.912884+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:52:18.873991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:52:18.873991+0000","last_clean_scrub_stamp":"2024-09-17T05:52:18.873991+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:31:59.058914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.20","version":"0'0","reported_seq":13,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-09-17T05:52:20.915791+0000","last_change":"2024-09-17T05:52:19.913824+0000","last_active":"2024-09-17T05:52:20.915791+0000","last_peered":"2024-09-17T05:52:20.915791+0000","last_clean":"2024-09-17T05:52:20.915791+0000","last_became_active":"2024-09-17T05:52:19.913513+0000","last_became_peered":"2024-09-17T05:52:19.913513+0000","last_unstale":"2024-09-17T05:52:20.915791+0000","last_undegraded":"2024-09-17T05:52:20.915791+0000","last_fullsized":"2024-09-17T05:52:20.915791+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:52:18.873991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:52:18.873991+0000","last_clean_scrub_stamp":"2024-09-17T05:52:18.873991+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:11:48.541624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:52:18.873991+0000","last_change":"2024-09-17T05:52:18.873991+0000","last_active":"2024-09-17T05:52:18.873991+0000","last_peered":"2024-09-17T05:52:18.873991+0000","last_clean":"2024-09-17T05:52:18.873991+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:52:18.873991+0000","last_undegraded":"2024-09-17T05:52:18.873991+0000","last_fullsized":"2024-09-17T05:52:18.873991+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:52:18.873991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:52:18.873991+0000","last_clean_scrub_stamp":"2024-09-17T05:52:18.873991+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.1f","version":"126'4","reported_seq":19,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-09-17T05:52:20.913562+0000","last_change":"2024-09-17T05:52:18.893653+0000","last_active":"2024-09-17T05:52:20.913562+0000","last_peered":"2024-09-17T05:52:20.913562+0000","last_clean":"2024-09-17T05:52:20.913562+0000","last_became_active":"2024-09-17T05:52:18.893296+0000","last_became_peered":"2024-09-17T05:52:18.893296+0000","last_unstale":"2024-09-17T05:52:20.913562+0000","last_undegraded":"2024-09-17T05:52:20.913562+0000","last_fullsized":"2024-09-17T05:52:20.913562+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:52:17.867506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:52:17.867506+0000","last_clean_scrub_stamp":"2024-09-17T05:52:17.867506+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:50:03.925050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:52:18.873991+0000","last_change":"2024-09-17T05:52:18.873991+0000","last_active":"2024-09-17T05:52:18.873991+0000","last_peered":"2024-09-17T05:52:18.873991+0000","last_clean":"2024-09-17T05:52:18.873991+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:52:18.873991+0000","last_undegraded":"2024-09-17T05:52:18.873991+0000","last_fullsized":"2024-09-17T05:52:18.873991+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:52:18.873991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:52:18.873991+0000","last_clean_scrub_stamp":"2024-09-17T05:52:18.873991+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.1e","version":"126'1","reported_seq":16,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-09-17T05:52:21.029801+0000","last_change":"2024-09-17T05:52:18.895473+0000","last_active":"2024-09-17T05:52:21.029801+0000","last_peered":"2024-09-17T05:52:21.029801+0000","last_clean":"2024-09-17T05:52:21.029801+0000","last_became_active":"2024-09-17T05:52:18.895096+0000","last_became_peered":"2024-09-17T05:52:18.895096+0000","last_unstale":"2024-09-17T05:52:21.029801+0000","last_undegraded":"2024-09-17T05:52:21.029801+0000","last_fullsized":"2024-09-17T05:52:21.029801+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:52:17.867506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:52:17.867506+0000","last_clean_scrub_stamp":"2024-09-17T05:52:17.867506+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:12:57.384707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.1c","version":"0'0","reported_seq":13,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-09-17T05:52:20.913652+0000","last_change":"2024-09-17T05:52:19.927142+0000","last_active":"2024-09-17T05:52:20.913652+0000","last_peered":"2024-09-17T05:52:20.913652+0000","last_clean":"2024-09-17T05:52:20.913652+0000","last_became_active":"2024-09-17T05:52:19.926836+0000","last_became_peered":"2024-09-17T05:52:19.926836+0000","last_unstale":"2024-09-17T05:52:20.913652+0000","last_undegraded":"2024-09-17T05:52:20.913652+0000","last_fullsized":"2024-09-17T05:52:20.913652+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:52:18.873991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:52:18.873991+0000","last_clean_scrub_stamp":"2024-09-17T05:52:18.873991+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:04:57.127249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.1d","version":"0'0","reported_seq":10,"reported_epoch":125,"state":"active+clean","last_fresh":"2024-09-17T05:52:18.899013+0000","last_change":"2024-09-17T05:52:18.897259+0000","last_active":"2024-09-17T05:52:18.899013+0000","last_peered":"2024-09-17T05:52:18.899013+0000","last_clean":"2024-09-17T05:52:18.899013+0000","last_became_active":"2024-09-17T05:52:18.896947+0000","last_became_peered":"2024-09-17T05:52:18.896947+0000","last_unstale":"2024-09-17T05:52:18.899013+0000","last_undegraded":"2024-09-17T05:52:18.899013+0000","last_fullsized":"2024-09-17T05:52:18.899013+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:52:17.867506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:52:17.867506+0000","last_clean_scrub_stamp":"2024-09-17T05:52:17.867506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:04:52.286987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.1d","version":"0'0","reported_seq":13,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-09-17T05:52:20.913030+0000","last_change":"2024-09-17T05:52:19.914720+0000","last_active":"2024-09-17T05:52:20.913030+0000","last_peered":"2024-09-17T05:52:20.913030+0000","last_clean":"2024-09-17T05:52:20.913030+0000","last_became_active":"2024-09-17T05:52:19.914342+0000","last_became_peered":"2024-09-17T05:52:19.914342+0000","last_unstale":"2024-09-17T05:52:20.913030+0000","last_undegraded":"2024-09-17T05:52:20.913030+0000","last_fullsized":"2024-09-17T05:52:20.913030+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:52:18.873991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:52:18.873991+0000","last_clean_scrub_stamp":"2024-09-17T05:52:18.873991+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:05:11.605569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.1c","version":"0'0","reported_seq":1,"reported_epoch":124,"state":"creating+peering","last_fresh":"2024-09-17T05:52:17.881845+0000","last_change":"2024-09-17T05:52:17.881845+0000","last_active":"2024-09-17T05:52:17.867506+0000","last_peered":"2024-09-17T05:52:17.867506+0000","last_clean":"2024-09-17T05:52:17.867506+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:52:17.881845+0000","last_undegraded":"2024-09-17T05:52:17.881845+0000","last_fullsized":"2024-09-17T05:52:17.881845+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:52:17.867506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:52:17.867506+0000","last_clean_scrub_stamp":"2024-09-17T05:52:17.867506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:52:18.873991+0000","last_change":"2024-09-17T05:52:18.873991+0000","last_active":"2024-09-17T05:52:18.873991+0000","last_peered":"2024-09-17T05:52:18.873991+0000","last_clean":"2024-09-17T05:52:18.873991+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:52:18.873991+0000","last_undegraded":"2024-09-17T05:52:18.873991+0000","last_fullsized":"2024-09-17T05:52:18.873991+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:52:18.873991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:52:18.873991+0000","last_clean_scrub_stamp":"2024-09-17T05:52:18.873991+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.1b","version":"0'0","reported_seq":1,"reported_epoch":124,"state":"creating+peering","last_fresh":"2024-09-17T05:52:17.881454+0000","last_change":"2024-09-17T05:52:17.881454+0000","last_active":"2024-09-17T05:52:17.867506+0000","last_peered":"2024-09-17T05:52:17.867506+0000","last_clean":"2024-09-17T05:52:17.867506+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:52:17.881454+0000","last_undegraded":"2024-09-17T05:52:17.881454+0000","last_fullsized":"2024-09-17T05:52:17.881454+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:52:17.867506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:52:17.867506+0000","last_clean_scrub_stamp":"2024-09-17T05:52:17.867506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.1b","version":"0'0","reported_seq":13,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-09-17T05:52:20.916633+0000","last_change":"2024-09-17T05:52:19.920703+0000","last_active":"2024-09-17T05:52:20.916633+0000","last_peered":"2024-09-17T05:52:20.916633+0000","last_clean":"2024-09-17T05:52:20.916633+0000","last_became_active":"2024-09-17T05:52:19.920376+0000","last_became_peered":"2024-09-17T05:52:19.920376+0000","last_unstale":"2024-09-17T05:52:20.916633+0000","last_undegraded":"2024-09-17T05:52:20.916633+0000","last_fullsized":"2024-09-17T05:52:20.916633+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:52:18.873991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:52:18.873991+0000","last_clean_scrub_stamp":"2024-09-17T05:52:18.873991+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:47:56.025899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.1a","version":"0'0","reported_seq":1,"reported_epoch":124,"state":"creating+peering","last_fresh":"2024-09-17T05:52:17.881579+0000","last_change":"2024-09-17T05:52:17.881579+0000","last_active":"2024-09-17T05:52:17.867506+0000","last_peered":"2024-09-17T05:52:17.867506+0000","last_clean":"2024-09-17T05:52:17.867506+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:52:17.881579+0000","last_undegraded":"2024-09-17T05:52:17.881579+0000","last_fullsized":"2024-09-17T05:52:17.881579+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:52:17.867506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:52:17.867506+0000","last_clean_scrub_stamp":"2024-09-17T05:52:17.867506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:52:18.873991+0000","last_change":"2024-09-17T05:52:18.873991+0000","last_active":"2024-09-17T05:52:18.873991+0000","last_peered":"2024-09-17T05:52:18.873991+0000","last_clean":"2024-09-17T05:52:18.873991+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:52:18.873991+0000","last_undegraded":"2024-09-17T05:52:18.873991+0000","last_fullsized":"2024-09-17T05:52:18.873991+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:52:18.873991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:52:18.873991+0000","last_clean_scrub_stamp":"2024-09-17T05:52:18.873991+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.19","version":"0'0","reported_seq":15,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-09-17T05:52:20.915745+0000","last_change":"2024-09-17T05:52:18.895524+0000","last_active":"2024-09-17T05:52:20.915745+0000","last_peered":"2024-09-17T05:52:20.915745+0000","last_clean":"2024-09-17T05:52:20.915745+0000","last_became_active":"2024-09-17T05:52:18.895221+0000","last_became_peered":"2024-09-17T05:52:18.895221+0000","last_unstale":"2024-09-17T05:52:20.915745+0000","last_undegraded":"2024-09-17T05:52:20.915745+0000","last_fullsized":"2024-09-17T05:52:20.915745+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:52:17.867506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:52:17.867506+0000","last_clean_scrub_stamp":"2024-09-17T05:52:17.867506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:03:36.241448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:52:18.873991+0000","last_change":"2024-09-17T05:52:18.873991+0000","last_active":"2024-09-17T05:52:18.873991+0000","last_peered":"2024-09-17T05:52:18.873991+0000","last_clean":"2024-09-17T05:52:18.873991+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:52:18.873991+0000","last_undegraded":"2024-09-17T05:52:18.873991+0000","last_fullsized":"2024-09-17T05:52:18.873991+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:52:18.873991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:52:18.873991+0000","last_clean_scrub_stamp":"2024-09-17T05:52:18.873991+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.18","version":"0'0","reported_seq":1,"reported_epoch":124,"state":"creating+peering","last_fresh":"2024-09-17T05:52:17.881271+0000","last_change":"2024-09-17T05:52:17.881271+0000","last_active":"2024-09-17T05:52:17.867506+0000","last_peered":"2024-09-17T05:52:17.867506+0000","last_clean":"2024-09-17T05:52:17.867506+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:52:17.881271+0000","last_undegraded":"2024-09-17T05:52:17.881271+0000","last_fullsized":"2024-09-17T05:52:17.881271+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:52:17.867506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:52:17.867506+0000","last_clean_scrub_stamp":"2024-09-17T05:52:17.867506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:52:18.873991+0000","last_change":"2024-09-17T05:52:18.873991+0000","last_active":"2024-09-17T05:52:18.873991+0000","last_peered":"2024-09-17T05:52:18.873991+0000","last_clean":"2024-09-17T05:52:18.873991+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:52:18.873991+0000","last_undegraded":"2024-09-17T05:52:18.873991+0000","last_fullsized":"2024-09-17T05:52:18.873991+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:52:18.873991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:52:18.873991+0000","last_clean_scrub_stamp":"2024-09-17T05:52:18.873991+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.17","version":"0'0","reported_seq":15,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-09-17T05:52:21.030071+0000","last_change":"2024-09-17T05:52:18.894591+0000","last_active":"2024-09-17T05:52:21.030071+0000","last_peered":"2024-09-17T05:52:21.030071+0000","last_clean":"2024-09-17T05:52:21.030071+0000","last_became_active":"2024-09-17T05:52:18.894241+0000","last_became_peered":"2024-09-17T05:52:18.894241+0000","last_unstale":"2024-09-17T05:52:21.030071+0000","last_undegraded":"2024-09-17T05:52:21.030071+0000","last_fullsized":"2024-09-17T05:52:21.030071+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:52:17.867506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:52:17.867506+0000","last_clean_scrub_stamp":"2024-09-17T05:52:17.867506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:32:31.037419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.17","version":"0'0","reported_seq":13,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-09-17T05:52:21.029975+0000","last_change":"2024-09-17T05:52:19.918028+0000","last_active":"2024-09-17T05:52:21.029975+0000","last_peered":"2024-09-17T05:52:21.029975+0000","last_clean":"2024-09-17T05:52:21.029975+0000","last_became_active":"2024-09-17T05:52:19.916968+0000","last_became_peered":"2024-09-17T05:52:19.916968+0000","last_unstale":"2024-09-17T05:52:21.029975+0000","last_undegraded":"2024-09-17T05:52:21.029975+0000","last_fullsized":"2024-09-17T05:52:21.029975+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:52:18.873991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:52:18.873991+0000","last_clean_scrub_stamp":"2024-09-17T05:52:18.873991+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:23:24.221785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.16","version":"0'0","reported_seq":1,"reported_epoch":124,"state":"creating+peering","last_fresh":"2024-09-17T05:52:17.880840+0000","last_change":"2024-09-17T05:52:17.880840+0000","last_active":"2024-09-17T05:52:17.867506+0000","last_peered":"2024-09-17T05:52:17.867506+0000","last_clean":"2024-09-17T05:52:17.867506+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:52:17.880840+0000","last_undegraded":"2024-09-17T05:52:17.880840+0000","last_fullsized":"2024-09-17T05:52:17.880840+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:52:17.867506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:52:17.867506+0000","last_clean_scrub_stamp":"2024-09-17T05:52:17.867506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.14","version":"0'0","reported_seq":13,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-09-17T05:52:20.913700+0000","last_change":"2024-09-17T05:52:19.912074+0000","last_active":"2024-09-17T05:52:20.913700+0000","last_peered":"2024-09-17T05:52:20.913700+0000","last_clean":"2024-09-17T05:52:20.913700+0000","last_became_active":"2024-09-17T05:52:19.911738+0000","last_became_peered":"2024-09-17T05:52:19.911738+0000","last_unstale":"2024-09-17T05:52:20.913700+0000","last_undegraded":"2024-09-17T05:52:20.913700+0000","last_fullsized":"2024-09-17T05:52:20.913700+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:52:18.873991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:52:18.873991+0000","last_clean_scrub_stamp":"2024-09-17T05:52:18.873991+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:23:11.922990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.15","version":"126'3","reported_seq":18,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-09-17T05:52:21.029706+0000","last_change":"2024-09-17T05:52:18.899892+0000","last_active":"2024-09-17T05:52:21.029706+0000","last_peered":"2024-09-17T05:52:21.029706+0000","last_clean":"2024-09-17T05:52:21.029706+0000","last_became_active":"2024-09-17T05:52:18.899449+0000","last_became_peered":"2024-09-17T05:52:18.899449+0000","last_unstale":"2024-09-17T05:52:21.029706+0000","last_undegraded":"2024-09-17T05:52:21.029706+0000","last_fullsized":"2024-09-17T05:52:21.029706+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:52:17.867506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:52:17.867506+0000","last_clean_scrub_stamp":"2024-09-17T05:52:17.867506+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:01:50.779410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.15","version":"0'0","reported_seq":13,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-09-17T05:52:20.913349+0000","last_change":"2024-09-17T05:52:19.909257+0000","last_active":"2024-09-17T05:52:20.913349+0000","last_peered":"2024-09-17T05:52:20.913349+0000","last_clean":"2024-09-17T05:52:20.913349+0000","last_became_active":"2024-09-17T05:52:19.908004+0000","last_became_peered":"2024-09-17T05:52:19.908004+0000","last_unstale":"2024-09-17T05:52:20.913349+0000","last_undegraded":"2024-09-17T05:52:20.913349+0000","last_fullsized":"2024-09-17T05:52:20.913349+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:52:18.873991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:52:18.873991+0000","last_clean_scrub_stamp":"2024-09-17T05:52:18.873991+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:41:01.713245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.14","version":"0'0","reported_seq":1,"reported_epoch":124,"state":"creating+peering","last_fresh":"2024-09-17T05:52:17.882679+0000","last_change":"2024-09-17T05:52:17.882679+0000","last_active":"2024-09-17T05:52:17.867506+0000","last_peered":"2024-09-17T05:52:17.867506+0000","last_clean":"2024-09-17T05:52:17.867506+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:52:17.882679+0000","last_undegraded":"2024-09-17T05:52:17.882679+0000","last_fullsized":"2024-09-17T05:52:17.882679+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:52:17.867506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:52:17.867506+0000","last_clean_scrub_stamp":"2024-09-17T05:52:17.867506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:52:18.873991+0000","last_change":"2024-09-17T05:52:18.873991+0000","last_active":"2024-09-17T05:52:18.873991+0000","last_peered":"2024-09-17T05:52:18.873991+0000","last_clean":"2024-09-17T05:52:18.873991+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:52:18.873991+0000","last_undegraded":"2024-09-17T05:52:18.873991+0000","last_fullsized":"2024-09-17T05:52:18.873991+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:52:18.873991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:52:18.873991+0000","last_clean_scrub_stamp":"2024-09-17T05:52:18.873991+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.12","version":"0'0","reported_seq":1,"reported_epoch":124,"state":"creating+peering","last_fresh":"2024-09-17T05:52:17.879821+0000","last_change":"2024-09-17T05:52:17.879821+0000","last_active":"2024-09-17T05:52:17.867506+0000","last_peered":"2024-09-17T05:52:17.867506+0000","last_clean":"2024-09-17T05:52:17.867506+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:52:17.879821+0000","last_undegraded":"2024-09-17T05:52:17.879821+0000","last_fullsized":"2024-09-17T05:52:17.879821+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:52:17.867506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:52:17.867506+0000","last_clean_scrub_stamp":"2024-09-17T05:52:17.867506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:52:18.873991+0000","last_change":"2024-09-17T05:52:18.873991+0000","last_active":"2024-09-17T05:52:18.873991+0000","last_peered":"2024-09-17T05:52:18.873991+0000","last_clean":"2024-09-17T05:52:18.873991+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:52:18.873991+0000","last_undegraded":"2024-09-17T05:52:18.873991+0000","last_fullsized":"2024-09-17T05:52:18.873991+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:52:18.873991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:52:18.873991+0000","last_clean_scrub_stamp":"2024-09-17T05:52:18.873991+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.11","version":"0'0","reported_seq":1,"reported_epoch":124,"state":"creating+peering","last_fresh":"2024-09-17T05:52:17.880788+0000","last_change":"2024-09-17T05:52:17.880788+0000","last_active":"2024-09-17T05:52:17.867506+0000","last_peered":"2024-09-17T05:52:17.867506+0000","last_clean":"2024-09-17T05:52:17.867506+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:52:17.880788+0000","last_undegraded":"2024-09-17T05:52:17.880788+0000","last_fullsized":"2024-09-17T05:52:17.880788+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:52:17.867506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:52:17.867506+0000","last_clean_scrub_stamp":"2024-09-17T05:52:17.867506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:52:18.873991+0000","last_change":"2024-09-17T05:52:18.873991+0000","last_active":"2024-09-17T05:52:18.873991+0000","last_peered":"2024-09-17T05:52:18.873991+0000","last_clean":"2024-09-17T05:52:18.873991+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:52:18.873991+0000","last_undegraded":"2024-09-17T05:52:18.873991+0000","last_fullsized":"2024-09-17T05:52:18.873991+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:52:18.873991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:52:18.873991+0000","last_clean_scrub_stamp":"2024-09-17T05:52:18.873991+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.10","version":"0'0","reported_seq":1,"reported_epoch":124,"state":"creating+peering","last_fresh":"2024-09-17T05:52:17.882633+0000","last_change":"2024-09-17T05:52:17.882633+0000","last_active":"2024-09-17T05:52:17.867506+0000","last_peered":"2024-09-17T05:52:17.867506+0000","last_clean":"2024-09-17T05:52:17.867506+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:52:17.882633+0000","last_undegraded":"2024-09-17T05:52:17.882633+0000","last_fullsized":"2024-09-17T05:52:17.882633+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:52:17.867506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:52:17.867506+0000","last_clean_scrub_stamp":"2024-09-17T05:52:17.867506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:52:18.873991+0000","last_change":"2024-09-17T05:52:18.873991+0000","last_active":"2024-09-17T05:52:18.873991+0000","last_peered":"2024-09-17T05:52:18.873991+0000","last_clean":"2024-09-17T05:52:18.873991+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:52:18.873991+0000","last_undegraded":"2024-09-17T05:52:18.873991+0000","last_fullsized":"2024-09-17T05:52:18.873991+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:52:18.873991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:52:18.873991+0000","last_clean_scrub_stamp":"2024-09-17T05:52:18.873991+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.f","version":"126'1","reported_seq":16,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-09-17T05:52:21.030089+0000","last_change":"2024-09-17T05:52:18.897267+0000","last_active":"2024-09-17T05:52:21.030089+0000","last_peered":"2024-09-17T05:52:21.030089+0000","last_clean":"2024-09-17T05:52:21.030089+0000","last_became_active":"2024-09-17T05:52:18.896904+0000","last_became_peered":"2024-09-17T05:52:18.896904+0000","last_unstale":"2024-09-17T05:52:21.030089+0000","last_undegraded":"2024-09-17T05:52:21.030089+0000","last_fullsized":"2024-09-17T05:52:21.030089+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:52:17.867506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:52:17.867506+0000","last_clean_scrub_stamp":"2024-09-17T05:52:17.867506+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:12:04.538452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.f","version":"0'0","reported_seq":13,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-09-17T05:52:21.029915+0000","last_change":"2024-09-17T05:52:19.919016+0000","last_active":"2024-09-17T05:52:21.029915+0000","last_peered":"2024-09-17T05:52:21.029915+0000","last_clean":"2024-09-17T05:52:21.029915+0000","last_became_active":"2024-09-17T05:52:19.918688+0000","last_became_peered":"2024-09-17T05:52:19.918688+0000","last_unstale":"2024-09-17T05:52:21.029915+0000","last_undegraded":"2024-09-17T05:52:21.029915+0000","last_fullsized":"2024-09-17T05:52:21.029915+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:52:18.873991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:52:18.873991+0000","last_clean_scrub_stamp":"2024-09-17T05:52:18.873991+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:31:23.140660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.e","version":"0'0","reported_seq":10,"reported_epoch":125,"state":"active+clean","last_fresh":"2024-09-17T05:52:18.895645+0000","last_change":"2024-09-17T05:52:18.893709+0000","last_active":"2024-09-17T05:52:18.895645+0000","last_peered":"2024-09-17T05:52:18.895645+0000","last_clean":"2024-09-17T05:52:18.895645+0000","last_became_active":"2024-09-17T05:52:18.893409+0000","last_became_peered":"2024-09-17T05:52:18.893409+0000","last_unstale":"2024-09-17T05:52:18.895645+0000","last_undegraded":"2024-09-17T05:52:18.895645+0000","last_fullsized":"2024-09-17T05:52:18.895645+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:52:17.867506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:52:17.867506+0000","last_clean_scrub_stamp":"2024-09-17T05:52:17.867506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:00:31.935995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:52:18.873991+0000","last_change":"2024-09-17T05:52:18.873991+0000","last_active":"2024-09-17T05:52:18.873991+0000","last_peered":"2024-09-17T05:52:18.873991+0000","last_clean":"2024-09-17T05:52:18.873991+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:52:18.873991+0000","last_undegraded":"2024-09-17T05:52:18.873991+0000","last_fullsized":"2024-09-17T05:52:18.873991+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:52:18.873991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:52:18.873991+0000","last_clean_scrub_stamp":"2024-09-17T05:52:18.873991+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.d","version":"126'1","reported_seq":16,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-09-17T05:52:20.916203+0000","last_change":"2024-09-17T05:52:18.896965+0000","last_active":"2024-09-17T05:52:20.916203+0000","last_peered":"2024-09-17T05:52:20.916203+0000","last_clean":"2024-09-17T05:52:20.916203+0000","last_became_active":"2024-09-17T05:52:18.896665+0000","last_became_peered":"2024-09-17T05:52:18.896665+0000","last_unstale":"2024-09-17T05:52:20.916203+0000","last_undegraded":"2024-09-17T05:52:20.916203+0000","last_fullsized":"2024-09-17T05:52:20.916203+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:52:17.867506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:52:17.867506+0000","last_clean_scrub_stamp":"2024-09-17T05:52:17.867506+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:03:31.140556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:52:18.873991+0000","last_change":"2024-09-17T05:52:18.873991+0000","last_active":"2024-09-17T05:52:18.873991+0000","last_peered":"2024-09-17T05:52:18.873991+0000","last_clean":"2024-09-17T05:52:18.873991+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:52:18.873991+0000","last_undegraded":"2024-09-17T05:52:18.873991+0000","last_fullsized":"2024-09-17T05:52:18.873991+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:52:18.873991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:52:18.873991+0000","last_clean_scrub_stamp":"2024-09-17T05:52:18.873991+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.c","version":"0'0","reported_seq":15,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-09-17T05:52:21.029699+0000","last_change":"2024-09-17T05:52:18.897796+0000","last_active":"2024-09-17T05:52:21.029699+0000","last_peered":"2024-09-17T05:52:21.029699+0000","last_clean":"2024-09-17T05:52:21.029699+0000","last_became_active":"2024-09-17T05:52:18.896607+0000","last_became_peered":"2024-09-17T05:52:18.896607+0000","last_unstale":"2024-09-17T05:52:21.029699+0000","last_undegraded":"2024-09-17T05:52:21.029699+0000","last_fullsized":"2024-09-17T05:52:21.029699+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:52:17.867506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:52:17.867506+0000","last_clean_scrub_stamp":"2024-09-17T05:52:17.867506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:06:49.196334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:52:18.873991+0000","last_change":"2024-09-17T05:52:18.873991+0000","last_active":"2024-09-17T05:52:18.873991+0000","last_peered":"2024-09-17T05:52:18.873991+0000","last_clean":"2024-09-17T05:52:18.873991+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:52:18.873991+0000","last_undegraded":"2024-09-17T05:52:18.873991+0000","last_fullsized":"2024-09-17T05:52:18.873991+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:52:18.873991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:52:18.873991+0000","last_clean_scrub_stamp":"2024-09-17T05:52:18.873991+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.b","version":"126'2","reported_seq":17,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-09-17T05:52:21.029634+0000","last_change":"2024-09-17T05:52:18.898700+0000","last_active":"2024-09-17T05:52:21.029634+0000","last_peered":"2024-09-17T05:52:21.029634+0000","last_clean":"2024-09-17T05:52:21.029634+0000","last_became_active":"2024-09-17T05:52:18.898205+0000","last_became_peered":"2024-09-17T05:52:18.898205+0000","last_unstale":"2024-09-17T05:52:21.029634+0000","last_undegraded":"2024-09-17T05:52:21.029634+0000","last_fullsized":"2024-09-17T05:52:21.029634+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:52:17.867506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:52:17.867506+0000","last_clean_scrub_stamp":"2024-09-17T05:52:17.867506+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:03:42.897065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.b","version":"0'0","reported_seq":13,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-09-17T05:52:20.916229+0000","last_change":"2024-09-17T05:52:19.926434+0000","last_active":"2024-09-17T05:52:20.916229+0000","last_peered":"2024-09-17T05:52:20.916229+0000","last_clean":"2024-09-17T05:52:20.916229+0000","last_became_active":"2024-09-17T05:52:19.926138+0000","last_became_peered":"2024-09-17T05:52:19.926138+0000","last_unstale":"2024-09-17T05:52:20.916229+0000","last_undegraded":"2024-09-17T05:52:20.916229+0000","last_fullsized":"2024-09-17T05:52:20.916229+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:52:18.873991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:52:18.873991+0000","last_clean_scrub_stamp":"2024-09-17T05:52:18.873991+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:39:56.592090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.a","version":"0'0","reported_seq":1,"reported_epoch":124,"state":"creating+peering","last_fresh":"2024-09-17T05:52:17.880917+0000","last_change":"2024-09-17T05:52:17.880917+0000","last_active":"2024-09-17T05:52:17.867506+0000","last_peered":"2024-09-17T05:52:17.867506+0000","last_clean":"2024-09-17T05:52:17.867506+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:52:17.880917+0000","last_undegraded":"2024-09-17T05:52:17.880917+0000","last_fullsized":"2024-09-17T05:52:17.880917+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:52:17.867506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:52:17.867506+0000","last_clean_scrub_stamp":"2024-09-17T05:52:17.867506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:52:18.873991+0000","last_change":"2024-09-17T05:52:18.873991+0000","last_active":"2024-09-17T05:52:18.873991+0000","last_peered":"2024-09-17T05:52:18.873991+0000","last_clean":"2024-09-17T05:52:18.873991+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:52:18.873991+0000","last_undegraded":"2024-09-17T05:52:18.873991+0000","last_fullsized":"2024-09-17T05:52:18.873991+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:52:18.873991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:52:18.873991+0000","last_clean_scrub_stamp":"2024-09-17T05:52:18.873991+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.9","version":"0'0","reported_seq":1,"reported_epoch":124,"state":"creating+peering","last_fresh":"2024-09-17T05:52:17.881742+0000","last_change":"2024-09-17T05:52:17.881742+0000","last_active":"2024-09-17T05:52:17.867506+0000","last_peered":"2024-09-17T05:52:17.867506+0000","last_clean":"2024-09-17T05:52:17.867506+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:52:17.881742+0000","last_undegraded":"2024-09-17T05:52:17.881742+0000","last_fullsized":"2024-09-17T05:52:17.881742+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:52:17.867506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:52:17.867506+0000","last_clean_scrub_stamp":"2024-09-17T05:52:17.867506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.9","version":"0'0","reported_seq":13,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-09-17T05:52:20.913125+0000","last_change":"2024-09-17T05:52:19.920709+0000","last_active":"2024-09-17T05:52:20.913125+0000","last_peered":"2024-09-17T05:52:20.913125+0000","last_clean":"2024-09-17T05:52:20.913125+0000","last_became_active":"2024-09-17T05:52:19.917358+0000","last_became_peered":"2024-09-17T05:52:19.917358+0000","last_unstale":"2024-09-17T05:52:20.913125+0000","last_undegraded":"2024-09-17T05:52:20.913125+0000","last_fullsized":"2024-09-17T05:52:20.913125+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:52:18.873991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:52:18.873991+0000","last_clean_scrub_stamp":"2024-09-17T05:52:18.873991+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:02:10.659710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.8","version":"0'0","reported_seq":10,"reported_epoch":125,"state":"active+clean","last_fresh":"2024-09-17T05:52:18.895648+0000","last_change":"2024-09-17T05:52:18.893798+0000","last_active":"2024-09-17T05:52:18.895648+0000","last_peered":"2024-09-17T05:52:18.895648+0000","last_clean":"2024-09-17T05:52:18.895648+0000","last_became_active":"2024-09-17T05:52:18.893085+0000","last_became_peered":"2024-09-17T05:52:18.893085+0000","last_unstale":"2024-09-17T05:52:18.895648+0000","last_undegraded":"2024-09-17T05:52:18.895648+0000","last_fullsized":"2024-09-17T05:52:18.895648+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:52:17.867506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:52:17.867506+0000","last_clean_scrub_stamp":"2024-09-17T05:52:17.867506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:43:24.092663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.6","version":"0'0","reported_seq":13,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-09-17T05:52:20.916705+0000","last_change":"2024-09-17T05:52:19.926025+0000","last_active":"2024-09-17T05:52:20.916705+0000","last_peered":"2024-09-17T05:52:20.916705+0000","last_clean":"2024-09-17T05:52:20.916705+0000","last_became_active":"2024-09-17T05:52:19.925657+0000","last_became_peered":"2024-09-17T05:52:19.925657+0000","last_unstale":"2024-09-17T05:52:20.916705+0000","last_undegraded":"2024-09-17T05:52:20.916705+0000","last_fullsized":"2024-09-17T05:52:20.916705+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:52:18.873991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:52:18.873991+0000","last_clean_scrub_stamp":"2024-09-17T05:52:18.873991+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:54:11.013453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.7","version":"0'0","reported_seq":1,"reported_epoch":124,"state":"creating+peering","last_fresh":"2024-09-17T05:52:17.879834+0000","last_change":"2024-09-17T05:52:17.879834+0000","last_active":"2024-09-17T05:52:17.867506+0000","last_peered":"2024-09-17T05:52:17.867506+0000","last_clean":"2024-09-17T05:52:17.867506+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:52:17.879834+0000","last_undegraded":"2024-09-17T05:52:17.879834+0000","last_fullsized":"2024-09-17T05:52:17.879834+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:52:17.867506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:52:17.867506+0000","last_clean_scrub_stamp":"2024-09-17T05:52:17.867506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:52:18.873991+0000","last_change":"2024-09-17T05:52:18.873991+0000","last_active":"2024-09-17T05:52:18.873991+0000","last_peered":"2024-09-17T05:52:18.873991+0000","last_clean":"2024-09-17T05:52:18.873991+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:52:18.873991+0000","last_undegraded":"2024-09-17T05:52:18.873991+0000","last_fullsized":"2024-09-17T05:52:18.873991+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:52:18.873991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:52:18.873991+0000","last_clean_scrub_stamp":"2024-09-17T05:52:18.873991+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.6","version":"127'1","reported_seq":16,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-09-17T05:52:20.914810+0000","last_change":"2024-09-17T05:52:18.893591+0000","last_active":"2024-09-17T05:52:20.914810+0000","last_peered":"2024-09-17T05:52:20.914810+0000","last_clean":"2024-09-17T05:52:20.914810+0000","last_became_active":"2024-09-17T05:52:18.893254+0000","last_became_peered":"2024-09-17T05:52:18.893254+0000","last_unstale":"2024-09-17T05:52:20.914810+0000","last_undegraded":"2024-09-17T05:52:20.914810+0000","last_fullsized":"2024-09-17T05:52:20.914810+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:52:17.867506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:52:17.867506+0000","last_clean_scrub_stamp":"2024-09-17T05:52:17.867506+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:20:34.378498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:52:18.873991+0000","last_change":"2024-09-17T05:52:18.873991+0000","last_active":"2024-09-17T05:52:18.873991+0000","last_peered":"2024-09-17T05:52:18.873991+0000","last_clean":"2024-09-17T05:52:18.873991+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:52:18.873991+0000","last_undegraded":"2024-09-17T05:52:18.873991+0000","last_fullsized":"2024-09-17T05:52:18.873991+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:52:18.873991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:52:18.873991+0000","last_clean_scrub_stamp":"2024-09-17T05:52:18.873991+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.5","version":"0'0","reported_seq":1,"reported_epoch":124,"state":"creating+peering","last_fresh":"2024-09-17T05:52:17.882208+0000","last_change":"2024-09-17T05:52:17.882208+0000","last_active":"2024-09-17T05:52:17.867506+0000","last_peered":"2024-09-17T05:52:17.867506+0000","last_clean":"2024-09-17T05:52:17.867506+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:52:17.882208+0000","last_undegraded":"2024-09-17T05:52:17.882208+0000","last_fullsized":"2024-09-17T05:52:17.882208+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:52:17.867506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:52:17.867506+0000","last_clean_scrub_stamp":"2024-09-17T05:52:17.867506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.5","version":"0'0","reported_seq":13,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-09-17T05:52:20.916284+0000","last_change":"2024-09-17T05:52:19.926104+0000","last_active":"2024-09-17T05:52:20.916284+0000","last_peered":"2024-09-17T05:52:20.916284+0000","last_clean":"2024-09-17T05:52:20.916284+0000","last_became_active":"2024-09-17T05:52:19.925767+0000","last_became_peered":"2024-09-17T05:52:19.925767+0000","last_unstale":"2024-09-17T05:52:20.916284+0000","last_undegraded":"2024-09-17T05:52:20.916284+0000","last_fullsized":"2024-09-17T05:52:20.916284+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:52:18.873991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:52:18.873991+0000","last_clean_scrub_stamp":"2024-09-17T05:52:18.873991+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:43:20.839584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.4","version":"0'0","reported_seq":10,"reported_epoch":125,"state":"active+clean","last_fresh":"2024-09-17T05:52:18.901169+0000","last_change":"2024-09-17T05:52:18.898186+0000","last_active":"2024-09-17T05:52:18.901169+0000","last_peered":"2024-09-17T05:52:18.901169+0000","last_clean":"2024-09-17T05:52:18.901169+0000","last_became_active":"2024-09-17T05:52:18.897402+0000","last_became_peered":"2024-09-17T05:52:18.897402+0000","last_unstale":"2024-09-17T05:52:18.901169+0000","last_undegraded":"2024-09-17T05:52:18.901169+0000","last_fullsized":"2024-09-17T05:52:18.901169+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:52:17.867506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:52:17.867506+0000","last_clean_scrub_stamp":"2024-09-17T05:52:17.867506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:49:01.468547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.2","version":"0'0","reported_seq":13,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-09-17T05:52:20.913065+0000","last_change":"2024-09-17T05:52:19.927870+0000","last_active":"2024-09-17T05:52:20.913065+0000","last_peered":"2024-09-17T05:52:20.913065+0000","last_clean":"2024-09-17T05:52:20.913065+0000","last_became_active":"2024-09-17T05:52:19.927573+0000","last_became_peered":"2024-09-17T05:52:19.927573+0000","last_unstale":"2024-09-17T05:52:20.913065+0000","last_undegraded":"2024-09-17T05:52:20.913065+0000","last_fullsized":"2024-09-17T05:52:20.913065+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:52:18.873991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:52:18.873991+0000","last_clean_scrub_stamp":"2024-09-17T05:52:18.873991+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:43:48.027258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.3","version":"0'0","reported_seq":1,"reported_epoch":124,"state":"creating+peering","last_fresh":"2024-09-17T05:52:17.880787+0000","last_change":"2024-09-17T05:52:17.880787+0000","last_active":"2024-09-17T05:52:17.867506+0000","last_peered":"2024-09-17T05:52:17.867506+0000","last_clean":"2024-09-17T05:52:17.867506+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:52:17.880787+0000","last_undegraded":"2024-09-17T05:52:17.880787+0000","last_fullsized":"2024-09-17T05:52:17.880787+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:52:17.867506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:52:17.867506+0000","last_clean_scrub_stamp":"2024-09-17T05:52:17.867506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.3","version":"0'0","reported_seq":13,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-09-17T05:52:21.029775+0000","last_change":"2024-09-17T05:52:19.923958+0000","last_active":"2024-09-17T05:52:21.029775+0000","last_peered":"2024-09-17T05:52:21.029775+0000","last_clean":"2024-09-17T05:52:21.029775+0000","last_became_active":"2024-09-17T05:52:19.923644+0000","last_became_peered":"2024-09-17T05:52:19.923644+0000","last_unstale":"2024-09-17T05:52:21.029775+0000","last_undegraded":"2024-09-17T05:52:21.029775+0000","last_fullsized":"2024-09-17T05:52:21.029775+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:52:18.873991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:52:18.873991+0000","last_clean_scrub_stamp":"2024-09-17T05:52:18.873991+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:47:43.829677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.2","version":"0'0","reported_seq":15,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-09-17T05:52:20.913214+0000","last_change":"2024-09-17T05:52:18.894258+0000","last_active":"2024-09-17T05:52:20.913214+0000","last_peered":"2024-09-17T05:52:20.913214+0000","last_clean":"2024-09-17T05:52:20.913214+0000","last_became_active":"2024-09-17T05:52:18.893908+0000","last_became_peered":"2024-09-17T05:52:18.893908+0000","last_unstale":"2024-09-17T05:52:20.913214+0000","last_undegraded":"2024-09-17T05:52:20.913214+0000","last_fullsized":"2024-09-17T05:52:20.913214+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:52:17.867506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:52:17.867506+0000","last_clean_scrub_stamp":"2024-09-17T05:52:17.867506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:04:22.951320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:52:18.873991+0000","last_change":"2024-09-17T05:52:18.873991+0000","last_active":"2024-09-17T05:52:18.873991+0000","last_peered":"2024-09-17T05:52:18.873991+0000","last_clean":"2024-09-17T05:52:18.873991+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:52:18.873991+0000","last_undegraded":"2024-09-17T05:52:18.873991+0000","last_fullsized":"2024-09-17T05:52:18.873991+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:52:18.873991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:52:18.873991+0000","last_clean_scrub_stamp":"2024-09-17T05:52:18.873991+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.1","version":"0'0","reported_seq":1,"reported_epoch":124,"state":"creating+peering","last_fresh":"2024-09-17T05:52:17.880828+0000","last_change":"2024-09-17T05:52:17.880828+0000","last_active":"2024-09-17T05:52:17.867506+0000","last_peered":"2024-09-17T05:52:17.867506+0000","last_clean":"2024-09-17T05:52:17.867506+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:52:17.880828+0000","last_undegraded":"2024-09-17T05:52:17.880828+0000","last_fullsized":"2024-09-17T05:52:17.880828+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:52:17.867506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:52:17.867506+0000","last_clean_scrub_stamp":"2024-09-17T05:52:17.867506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:52:18.873991+0000","last_change":"2024-09-17T05:52:18.873991+0000","last_active":"2024-09-17T05:52:18.873991+0000","last_peered":"2024-09-17T05:52:18.873991+0000","last_clean":"2024-09-17T05:52:18.873991+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:52:18.873991+0000","last_undegraded":"2024-09-17T05:52:18.873991+0000","last_fullsized":"2024-09-17T05:52:18.873991+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:52:18.873991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:52:18.873991+0000","last_clean_scrub_stamp":"2024-09-17T05:52:18.873991+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.0","version":"0'0","reported_seq":10,"reported_epoch":125,"state":"active+clean","last_fresh":"2024-09-17T05:52:18.890542+0000","last_change":"2024-09-17T05:52:18.889287+0000","last_active":"2024-09-17T05:52:18.890542+0000","last_peered":"2024-09-17T05:52:18.890542+0000","last_clean":"2024-09-17T05:52:18.890542+0000","last_became_active":"2024-09-17T05:52:18.888934+0000","last_became_peered":"2024-09-17T05:52:18.888934+0000","last_unstale":"2024-09-17T05:52:18.890542+0000","last_undegraded":"2024-09-17T05:52:18.890542+0000","last_fullsized":"2024-09-17T05:52:18.890542+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:52:17.867506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:52:17.867506+0000","last_clean_scrub_stamp":"2024-09-17T05:52:17.867506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:20:22.215964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.12","version":"0'0","reported_seq":13,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-09-17T05:52:20.913020+0000","last_change":"2024-09-17T05:52:19.917259+0000","last_active":"2024-09-17T05:52:20.913020+0000","last_peered":"2024-09-17T05:52:20.913020+0000","last_clean":"2024-09-17T05:52:20.913020+0000","last_became_active":"2024-09-17T05:52:19.916932+0000","last_became_peered":"2024-09-17T05:52:19.916932+0000","last_unstale":"2024-09-17T05:52:20.913020+0000","last_undegraded":"2024-09-17T05:52:20.913020+0000","last_fullsized":"2024-09-17T05:52:20.913020+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:52:18.873991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:52:18.873991+0000","last_clean_scrub_stamp":"2024-09-17T05:52:18.873991+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:28:29.059413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.13","version":"126'2","reported_seq":17,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-09-17T05:52:20.913529+0000","last_change":"2024-09-17T05:52:18.900120+0000","last_active":"2024-09-17T05:52:20.913529+0000","last_peered":"2024-09-17T05:52:20.913529+0000","last_clean":"2024-09-17T05:52:20.913529+0000","last_became_active":"2024-09-17T05:52:18.899687+0000","last_became_peered":"2024-09-17T05:52:18.899687+0000","last_unstale":"2024-09-17T05:52:20.913529+0000","last_undegraded":"2024-09-17T05:52:20.913529+0000","last_fullsized":"2024-09-17T05:52:20.913529+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:52:17.867506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:52:17.867506+0000","last_clean_scrub_stamp":"2024-09-17T05:52:17.867506+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:26:59.669212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"19'72","reported_seq":302,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-09-17T05:52:20.912559+0000","last_change":"2024-09-17T05:41:48.539830+0000","last_active":"2024-09-17T05:52:20.912559+0000","last_peered":"2024-09-17T05:52:20.912559+0000","last_clean":"2024-09-17T05:52:20.912559+0000","last_became_active":"2024-09-17T05:41:48.538743+0000","last_became_peered":"2024-09-17T05:41:48.538743+0000","last_unstale":"2024-09-17T05:52:20.912559+0000","last_undegraded":"2024-09-17T05:52:20.912559+0000","last_fullsized":"2024-09-17T05:52:20.912559+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:47.152539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:47.152539+0000","last_clean_scrub_stamp":"2024-09-17T05:41:47.152539+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:08:02.952016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":19,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":52,"acting":52,"num_store_stats":4},{"poolid":18,"num_pg":32,"stat_sum":{"num_bytes":798,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":2432,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":15,"ondisk_log_size":15,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":16,"seq":68719476867,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":145068,"kb_used_data":1492,"kb_used_omap":1,"kb_used_meta":143550,"kb_avail":94226772,"statfs":{"total":96636764160,"available":96488214528,"internally_reserved":0,"allocated":1527808,"data_stored":667141,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":146995654},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":15,"seq":64424509572,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":119356,"kb_used_data":2144,"kb_used_omap":1,"kb_used_meta":117182,"kb_avail":94252484,"statfs":{"total":96636764160,"available":96514543616,"internally_reserved":0,"allocated":2195456,"data_stored":1285598,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":119994826},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509571,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":113188,"kb_used_data":1548,"kb_used_omap":1,"kb_used_meta":111614,"kb_avail":94258652,"statfs":{"total":96636764160,"available":96520859648,"internally_reserved":0,"allocated":1585152,"data_stored":693092,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":114293189},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509571,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":140956,"kb_used_data":1544,"kb_used_omap":1,"kb_used_meta":139390,"kb_avail":94230884,"statfs":{"total":96636764160,"available":96492425216,"internally_reserved":0,"allocated":1581056,"data_stored":693050,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":142735813},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509570,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":118708,"kb_used_data":1504,"kb_used_omap":1,"kb_used_meta":117182,"kb_avail":94253132,"statfs":{"total":96636764160,"available":96515207168,"internally_reserved":0,"allocated":1540096,"data_stored":673126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":119994823},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509570,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":140904,"kb_used_data":1492,"kb_used_omap":1,"kb_used_meta":139390,"kb_avail":94230936,"statfs":{"total":96636764160,"available":96492478464,"internally_reserved":0,"allocated":1527808,"data_stored":667141,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":142735813},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509570,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":145068,"kb_used_data":1492,"kb_used_omap":1,"kb_used_meta":143550,"kb_avail":94226772,"statfs":{"total":96636764160,"available":96488214528,"internally_reserved":0,"allocated":1527808,"data_stored":667141,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":146995653},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574978,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":123464,"kb_used_data":2096,"kb_used_omap":1,"kb_used_meta":121342,"kb_avail":94248376,"statfs":{"total":96636764160,"available":96510337024,"internally_reserved":0,"allocated":2146304,"data_stored":1269937,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":124254661},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":2250,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-17T05:52:23.934 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-17T05:52:24.085 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:24.083+0000 7fafc58d3640 1 -- 172.21.15.150:0/262232337 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fafa8003fd0 msgr2=0x7fafa8004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:52:24.085 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:24.083+0000 7fafc58d3640 1 --2- 172.21.15.150:0/262232337 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fafa8003fd0 0x7fafa8004800 secure :-1 s=READY pgs=1683 cs=0 l=1 rev1=1 crypto rx=0x7fafb4009b50 tx=0x7fafa8005830 comp rx=0 tx=0).stop 2024-09-17T05:52:24.085 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:24.083+0000 7fafbf7fe640 1 -- 172.21.15.150:0/262232337 reap_dead start 2024-09-17T05:52:24.085 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:24.083+0000 7fafc58d3640 1 -- 172.21.15.150:0/262232337 shutdown_connections 2024-09-17T05:52:24.085 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:24.083+0000 7fafc58d3640 1 -- 172.21.15.150:0/262232337 >> 172.21.15.150:0/262232337 conn(0x7fafc00b2f60 msgr2=0x7fafc00b3370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:52:24.085 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:24.083+0000 7fafc58d3640 1 -- 172.21.15.150:0/262232337 shutdown_connections 2024-09-17T05:52:24.085 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:24.083+0000 7fafc58d3640 1 -- 172.21.15.150:0/262232337 wait complete. 2024-09-17T05:52:24.086 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:24.084+0000 7fafc58d3640 1 Processor -- start 2024-09-17T05:52:24.086 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:24.085+0000 7fafc58d3640 1 -- start start 2024-09-17T05:52:24.089 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:24.086+0000 7fafc58d3640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fafa8003fd0 0x7fafc01f2ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:52:24.089 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:24.086+0000 7fafc58d3640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fafc01f7050 0x7fafc0153030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:52:24.089 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:24.086+0000 7fafc58d3640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fafc0155c50 0x7fafc01516d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:52:24.089 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:24.086+0000 7fafc58d3640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7fafc00b5ba0 con 0x7fafc0155c50 2024-09-17T05:52:24.089 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:24.086+0000 7fafc58d3640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fafc00b5a20 con 0x7fafa8003fd0 2024-09-17T05:52:24.089 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:24.086+0000 7fafc58d3640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fafc00b5d20 con 0x7fafc01f7050 2024-09-17T05:52:24.089 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:24.086+0000 7fafbf7fe640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fafc0155c50 0x7fafc01516d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:52:24.090 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:24.086+0000 7fafbf7fe640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fafc0155c50 0x7fafc01516d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:35750/0 (socket says 172.21.15.150:35750) 2024-09-17T05:52:24.090 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:24.086+0000 7fafbf7fe640 1 -- 172.21.15.150:0/1755896192 learned_addr learned my addr 172.21.15.150:0/1755896192 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:52:24.090 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:24.086+0000 7fafbe7fc640 1 --2- 172.21.15.150:0/1755896192 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fafc01f7050 0x7fafc0153030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:52:24.090 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:24.086+0000 7fafbeffd640 1 --2- 172.21.15.150:0/1755896192 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fafa8003fd0 0x7fafc01f2ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:52:24.090 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:24.086+0000 7fafbf7fe640 1 -- 172.21.15.150:0/1755896192 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fafc01f7050 msgr2=0x7fafc0153030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:52:24.090 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:24.086+0000 7fafbf7fe640 1 --2- 172.21.15.150:0/1755896192 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fafc01f7050 0x7fafc0153030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:52:24.090 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:24.086+0000 7fafbf7fe640 1 -- 172.21.15.150:0/1755896192 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fafa8003fd0 msgr2=0x7fafc01f2ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:52:24.090 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:24.086+0000 7fafbf7fe640 1 --2- 172.21.15.150:0/1755896192 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fafa8003fd0 0x7fafc01f2ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:52:24.090 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:24.086+0000 7fafbf7fe640 1 -- 172.21.15.150:0/1755896192 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fafc01f3830 con 0x7fafc0155c50 2024-09-17T05:52:24.090 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:24.087+0000 7fafbf7fe640 1 --2- 172.21.15.150:0/1755896192 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fafc0155c50 0x7fafc01516d0 secure :-1 s=READY pgs=1684 cs=0 l=1 rev1=1 crypto rx=0x7fafb8005fd0 tx=0x7fafb8011f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:52:24.090 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:24.087+0000 7fafa7fff640 1 -- 172.21.15.150:0/1755896192 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fafb800fd70 con 0x7fafc0155c50 2024-09-17T05:52:24.090 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:24.087+0000 7fafa7fff640 1 -- 172.21.15.150:0/1755896192 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fafb8004b20 con 0x7fafc0155c50 2024-09-17T05:52:24.090 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:24.087+0000 7fafc58d3640 1 -- 172.21.15.150:0/1755896192 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fafc01f3b10 con 0x7fafc0155c50 2024-09-17T05:52:24.090 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:24.087+0000 7fafa7fff640 1 -- 172.21.15.150:0/1755896192 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fafb8003970 con 0x7fafc0155c50 2024-09-17T05:52:24.091 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:24.087+0000 7fafc58d3640 1 -- 172.21.15.150:0/1755896192 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fafc0153860 con 0x7fafc0155c50 2024-09-17T05:52:24.091 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:24.088+0000 7fafc58d3640 1 -- 172.21.15.150:0/1755896192 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fafc01f35a0 con 0x7fafc0155c50 2024-09-17T05:52:24.092 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:24.089+0000 7fafa7fff640 1 -- 172.21.15.150:0/1755896192 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 42) ==== 104195+0+0 (secure 0 0 0) 0x7fafb8020020 con 0x7fafc0155c50 2024-09-17T05:52:24.092 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:24.089+0000 7fafa7fff640 1 --2- 172.21.15.150:0/1755896192 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fafac07aa20 0x7fafac07cf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:52:24.092 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:24.089+0000 7fafa7fff640 1 -- 172.21.15.150:0/1755896192 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(127..127 src has 1..127) ==== 5877+0+0 (secure 0 0 0) 0x7fafb809ab90 con 0x7fafc0155c50 2024-09-17T05:52:24.092 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:24.089+0000 7fafbeffd640 1 --2- 172.21.15.150:0/1755896192 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fafac07aa20 0x7fafac07cf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:52:24.092 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:24.090+0000 7fafbeffd640 1 --2- 172.21.15.150:0/1755896192 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fafac07aa20 0x7fafac07cf30 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 crypto rx=0x7fafb0006ad0 tx=0x7fafb0006740 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:52:24.094 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:24.093+0000 7fafa7fff640 1 -- 172.21.15.150:0/1755896192 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fafb8027070 con 0x7fafc0155c50 2024-09-17T05:52:24.266 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:24.264+0000 7fafc58d3640 1 -- 172.21.15.150:0/1755896192 --> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fafc0153b00 con 0x7fafac07aa20 2024-09-17T05:52:24.271 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:24.269+0000 7fafa7fff640 1 -- 172.21.15.150:0/1755896192 <== mgr.4108 v2:172.21.15.176:6800/3631216395 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+245437 (secure 0 0 0) 0x7fafc0153b00 con 0x7fafac07aa20 2024-09-17T05:52:24.273 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-09-17T05:52:24.274 INFO:teuthology.orchestra.run.smithi150.stderr:dumped all 2024-09-17T05:52:24.276 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:24.273+0000 7fafc58d3640 1 -- 172.21.15.150:0/1755896192 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fafac07aa20 msgr2=0x7fafac07cf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:52:24.276 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:24.273+0000 7fafc58d3640 1 --2- 172.21.15.150:0/1755896192 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fafac07aa20 0x7fafac07cf30 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 crypto rx=0x7fafb0006ad0 tx=0x7fafb0006740 comp rx=0 tx=0).stop 2024-09-17T05:52:24.276 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:24.273+0000 7fafc58d3640 1 -- 172.21.15.150:0/1755896192 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fafc0155c50 msgr2=0x7fafc01516d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:52:24.276 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:24.273+0000 7fafc58d3640 1 --2- 172.21.15.150:0/1755896192 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fafc0155c50 0x7fafc01516d0 secure :-1 s=READY pgs=1684 cs=0 l=1 rev1=1 crypto rx=0x7fafb8005fd0 tx=0x7fafb8011f90 comp rx=0 tx=0).stop 2024-09-17T05:52:24.276 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:24.273+0000 7fafc58d3640 1 -- 172.21.15.150:0/1755896192 shutdown_connections 2024-09-17T05:52:24.277 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:24.273+0000 7fafc58d3640 1 --2- 172.21.15.150:0/1755896192 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fafac07aa20 0x7fafac07cf30 unknown :-1 s=CLOSED pgs=715 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:52:24.277 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:24.273+0000 7fafc58d3640 1 --2- 172.21.15.150:0/1755896192 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fafc0155c50 0x7fafc01516d0 unknown :-1 s=CLOSED pgs=1684 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:52:24.277 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:24.273+0000 7fafc58d3640 1 --2- 172.21.15.150:0/1755896192 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fafc01f7050 0x7fafc0153030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:52:24.277 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:24.273+0000 7fafc58d3640 1 --2- 172.21.15.150:0/1755896192 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fafa8003fd0 0x7fafc01f2ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:52:24.277 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:24.273+0000 7fafc58d3640 1 -- 172.21.15.150:0/1755896192 >> 172.21.15.150:0/1755896192 conn(0x7fafc00b2f60 msgr2=0x7fafc0068f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:52:24.277 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:24.273+0000 7fafc58d3640 1 -- 172.21.15.150:0/1755896192 shutdown_connections 2024-09-17T05:52:24.277 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:24.273+0000 7fafc58d3640 1 -- 172.21.15.150:0/1755896192 wait complete. 2024-09-17T05:52:24.287 INFO:teuthology.orchestra.run.smithi150.stdout:{"pg_ready":true,"pg_map":{"version":440,"stamp":"2024-09-17T05:52:23.078310+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":591166,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":116,"num_write_kb":1639,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":87,"ondisk_log_size":87,"up":118,"acting":118,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":66,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":1046712,"kb_used_data":13312,"kb_used_omap":12,"kb_used_meta":1033203,"kb_avail":753928008,"statfs":{"total":773094113280,"available":772022280192,"internally_reserved":0,"allocated":13631488,"data_stored":6616226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":1058000432},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":15,"apply_latency_ms":15,"commit_latency_ns":15000000,"apply_latency_ns":15000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":798,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.203422"},"pg_stats":[{"pgid":"19.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:52:18.873991+0000","last_change":"2024-09-17T05:52:18.873991+0000","last_active":"2024-09-17T05:52:18.873991+0000","last_peered":"2024-09-17T05:52:18.873991+0000","last_clean":"2024-09-17T05:52:18.873991+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:52:18.873991+0000","last_undegraded":"2024-09-17T05:52:18.873991+0000","last_fullsized":"2024-09-17T05:52:18.873991+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:52:18.873991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:52:18.873991+0000","last_clean_scrub_stamp":"2024-09-17T05:52:18.873991+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:52:18.873991+0000","last_change":"2024-09-17T05:52:18.873991+0000","last_active":"2024-09-17T05:52:18.873991+0000","last_peered":"2024-09-17T05:52:18.873991+0000","last_clean":"2024-09-17T05:52:18.873991+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:52:18.873991+0000","last_undegraded":"2024-09-17T05:52:18.873991+0000","last_fullsized":"2024-09-17T05:52:18.873991+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:52:18.873991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:52:18.873991+0000","last_clean_scrub_stamp":"2024-09-17T05:52:18.873991+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:52:18.873991+0000","last_change":"2024-09-17T05:52:18.873991+0000","last_active":"2024-09-17T05:52:18.873991+0000","last_peered":"2024-09-17T05:52:18.873991+0000","last_clean":"2024-09-17T05:52:18.873991+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:52:18.873991+0000","last_undegraded":"2024-09-17T05:52:18.873991+0000","last_fullsized":"2024-09-17T05:52:18.873991+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:52:18.873991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:52:18.873991+0000","last_clean_scrub_stamp":"2024-09-17T05:52:18.873991+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:52:18.873991+0000","last_change":"2024-09-17T05:52:18.873991+0000","last_active":"2024-09-17T05:52:18.873991+0000","last_peered":"2024-09-17T05:52:18.873991+0000","last_clean":"2024-09-17T05:52:18.873991+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:52:18.873991+0000","last_undegraded":"2024-09-17T05:52:18.873991+0000","last_fullsized":"2024-09-17T05:52:18.873991+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:52:18.873991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:52:18.873991+0000","last_clean_scrub_stamp":"2024-09-17T05:52:18.873991+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.3b","version":"0'0","reported_seq":13,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-09-17T05:52:20.913430+0000","last_change":"2024-09-17T05:52:19.923296+0000","last_active":"2024-09-17T05:52:20.913430+0000","last_peered":"2024-09-17T05:52:20.913430+0000","last_clean":"2024-09-17T05:52:20.913430+0000","last_became_active":"2024-09-17T05:52:19.922558+0000","last_became_peered":"2024-09-17T05:52:19.922558+0000","last_unstale":"2024-09-17T05:52:20.913430+0000","last_undegraded":"2024-09-17T05:52:20.913430+0000","last_fullsized":"2024-09-17T05:52:20.913430+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:52:18.873991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:52:18.873991+0000","last_clean_scrub_stamp":"2024-09-17T05:52:18.873991+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:14:31.803577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.3a","version":"0'0","reported_seq":13,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-09-17T05:52:20.916572+0000","last_change":"2024-09-17T05:52:19.921204+0000","last_active":"2024-09-17T05:52:20.916572+0000","last_peered":"2024-09-17T05:52:20.916572+0000","last_clean":"2024-09-17T05:52:20.916572+0000","last_became_active":"2024-09-17T05:52:19.920892+0000","last_became_peered":"2024-09-17T05:52:19.920892+0000","last_unstale":"2024-09-17T05:52:20.916572+0000","last_undegraded":"2024-09-17T05:52:20.916572+0000","last_fullsized":"2024-09-17T05:52:20.916572+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:52:18.873991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:52:18.873991+0000","last_clean_scrub_stamp":"2024-09-17T05:52:18.873991+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:03:02.474723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.39","version":"0'0","reported_seq":13,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-09-17T05:52:20.915990+0000","last_change":"2024-09-17T05:52:19.926803+0000","last_active":"2024-09-17T05:52:20.915990+0000","last_peered":"2024-09-17T05:52:20.915990+0000","last_clean":"2024-09-17T05:52:20.915990+0000","last_became_active":"2024-09-17T05:52:19.926478+0000","last_became_peered":"2024-09-17T05:52:19.926478+0000","last_unstale":"2024-09-17T05:52:20.915990+0000","last_undegraded":"2024-09-17T05:52:20.915990+0000","last_fullsized":"2024-09-17T05:52:20.915990+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:52:18.873991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:52:18.873991+0000","last_clean_scrub_stamp":"2024-09-17T05:52:18.873991+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:48:46.344445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:52:18.873991+0000","last_change":"2024-09-17T05:52:18.873991+0000","last_active":"2024-09-17T05:52:18.873991+0000","last_peered":"2024-09-17T05:52:18.873991+0000","last_clean":"2024-09-17T05:52:18.873991+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:52:18.873991+0000","last_undegraded":"2024-09-17T05:52:18.873991+0000","last_fullsized":"2024-09-17T05:52:18.873991+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:52:18.873991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:52:18.873991+0000","last_clean_scrub_stamp":"2024-09-17T05:52:18.873991+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:52:18.873991+0000","last_change":"2024-09-17T05:52:18.873991+0000","last_active":"2024-09-17T05:52:18.873991+0000","last_peered":"2024-09-17T05:52:18.873991+0000","last_clean":"2024-09-17T05:52:18.873991+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:52:18.873991+0000","last_undegraded":"2024-09-17T05:52:18.873991+0000","last_fullsized":"2024-09-17T05:52:18.873991+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:52:18.873991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:52:18.873991+0000","last_clean_scrub_stamp":"2024-09-17T05:52:18.873991+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:52:18.873991+0000","last_change":"2024-09-17T05:52:18.873991+0000","last_active":"2024-09-17T05:52:18.873991+0000","last_peered":"2024-09-17T05:52:18.873991+0000","last_clean":"2024-09-17T05:52:18.873991+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:52:18.873991+0000","last_undegraded":"2024-09-17T05:52:18.873991+0000","last_fullsized":"2024-09-17T05:52:18.873991+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:52:18.873991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:52:18.873991+0000","last_clean_scrub_stamp":"2024-09-17T05:52:18.873991+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.35","version":"0'0","reported_seq":1,"reported_epoch":125,"state":"creating+peering","last_fresh":"2024-09-17T05:52:18.886163+0000","last_change":"2024-09-17T05:52:18.886163+0000","last_active":"2024-09-17T05:52:18.873991+0000","last_peered":"2024-09-17T05:52:18.873991+0000","last_clean":"2024-09-17T05:52:18.873991+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:52:18.886163+0000","last_undegraded":"2024-09-17T05:52:18.886163+0000","last_fullsized":"2024-09-17T05:52:18.886163+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:52:18.873991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:52:18.873991+0000","last_clean_scrub_stamp":"2024-09-17T05:52:18.873991+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:52:18.873991+0000","last_change":"2024-09-17T05:52:18.873991+0000","last_active":"2024-09-17T05:52:18.873991+0000","last_peered":"2024-09-17T05:52:18.873991+0000","last_clean":"2024-09-17T05:52:18.873991+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:52:18.873991+0000","last_undegraded":"2024-09-17T05:52:18.873991+0000","last_fullsized":"2024-09-17T05:52:18.873991+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:52:18.873991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:52:18.873991+0000","last_clean_scrub_stamp":"2024-09-17T05:52:18.873991+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:52:18.873991+0000","last_change":"2024-09-17T05:52:18.873991+0000","last_active":"2024-09-17T05:52:18.873991+0000","last_peered":"2024-09-17T05:52:18.873991+0000","last_clean":"2024-09-17T05:52:18.873991+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:52:18.873991+0000","last_undegraded":"2024-09-17T05:52:18.873991+0000","last_fullsized":"2024-09-17T05:52:18.873991+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:52:18.873991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:52:18.873991+0000","last_clean_scrub_stamp":"2024-09-17T05:52:18.873991+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:52:18.873991+0000","last_change":"2024-09-17T05:52:18.873991+0000","last_active":"2024-09-17T05:52:18.873991+0000","last_peered":"2024-09-17T05:52:18.873991+0000","last_clean":"2024-09-17T05:52:18.873991+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:52:18.873991+0000","last_undegraded":"2024-09-17T05:52:18.873991+0000","last_fullsized":"2024-09-17T05:52:18.873991+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:52:18.873991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:52:18.873991+0000","last_clean_scrub_stamp":"2024-09-17T05:52:18.873991+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:52:18.873991+0000","last_change":"2024-09-17T05:52:18.873991+0000","last_active":"2024-09-17T05:52:18.873991+0000","last_peered":"2024-09-17T05:52:18.873991+0000","last_clean":"2024-09-17T05:52:18.873991+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:52:18.873991+0000","last_undegraded":"2024-09-17T05:52:18.873991+0000","last_fullsized":"2024-09-17T05:52:18.873991+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:52:18.873991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:52:18.873991+0000","last_clean_scrub_stamp":"2024-09-17T05:52:18.873991+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:52:18.873991+0000","last_change":"2024-09-17T05:52:18.873991+0000","last_active":"2024-09-17T05:52:18.873991+0000","last_peered":"2024-09-17T05:52:18.873991+0000","last_clean":"2024-09-17T05:52:18.873991+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:52:18.873991+0000","last_undegraded":"2024-09-17T05:52:18.873991+0000","last_fullsized":"2024-09-17T05:52:18.873991+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:52:18.873991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:52:18.873991+0000","last_clean_scrub_stamp":"2024-09-17T05:52:18.873991+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.2f","version":"0'0","reported_seq":13,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-09-17T05:52:20.916291+0000","last_change":"2024-09-17T05:52:19.927246+0000","last_active":"2024-09-17T05:52:20.916291+0000","last_peered":"2024-09-17T05:52:20.916291+0000","last_clean":"2024-09-17T05:52:20.916291+0000","last_became_active":"2024-09-17T05:52:19.926923+0000","last_became_peered":"2024-09-17T05:52:19.926923+0000","last_unstale":"2024-09-17T05:52:20.916291+0000","last_undegraded":"2024-09-17T05:52:20.916291+0000","last_fullsized":"2024-09-17T05:52:20.916291+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:52:18.873991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:52:18.873991+0000","last_clean_scrub_stamp":"2024-09-17T05:52:18.873991+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:11:04.819830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:52:18.873991+0000","last_change":"2024-09-17T05:52:18.873991+0000","last_active":"2024-09-17T05:52:18.873991+0000","last_peered":"2024-09-17T05:52:18.873991+0000","last_clean":"2024-09-17T05:52:18.873991+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:52:18.873991+0000","last_undegraded":"2024-09-17T05:52:18.873991+0000","last_fullsized":"2024-09-17T05:52:18.873991+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:52:18.873991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:52:18.873991+0000","last_clean_scrub_stamp":"2024-09-17T05:52:18.873991+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.2d","version":"0'0","reported_seq":1,"reported_epoch":125,"state":"creating+peering","last_fresh":"2024-09-17T05:52:18.885679+0000","last_change":"2024-09-17T05:52:18.885679+0000","last_active":"2024-09-17T05:52:18.873991+0000","last_peered":"2024-09-17T05:52:18.873991+0000","last_clean":"2024-09-17T05:52:18.873991+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:52:18.885679+0000","last_undegraded":"2024-09-17T05:52:18.885679+0000","last_fullsized":"2024-09-17T05:52:18.885679+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:52:18.873991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:52:18.873991+0000","last_clean_scrub_stamp":"2024-09-17T05:52:18.873991+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:52:18.873991+0000","last_change":"2024-09-17T05:52:18.873991+0000","last_active":"2024-09-17T05:52:18.873991+0000","last_peered":"2024-09-17T05:52:18.873991+0000","last_clean":"2024-09-17T05:52:18.873991+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:52:18.873991+0000","last_undegraded":"2024-09-17T05:52:18.873991+0000","last_fullsized":"2024-09-17T05:52:18.873991+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:52:18.873991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:52:18.873991+0000","last_clean_scrub_stamp":"2024-09-17T05:52:18.873991+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.2b","version":"0'0","reported_seq":13,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-09-17T05:52:20.913343+0000","last_change":"2024-09-17T05:52:19.923630+0000","last_active":"2024-09-17T05:52:20.913343+0000","last_peered":"2024-09-17T05:52:20.913343+0000","last_clean":"2024-09-17T05:52:20.913343+0000","last_became_active":"2024-09-17T05:52:19.922986+0000","last_became_peered":"2024-09-17T05:52:19.922986+0000","last_unstale":"2024-09-17T05:52:20.913343+0000","last_undegraded":"2024-09-17T05:52:20.913343+0000","last_fullsized":"2024-09-17T05:52:20.913343+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:52:18.873991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:52:18.873991+0000","last_clean_scrub_stamp":"2024-09-17T05:52:18.873991+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:27:22.837955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.2a","version":"0'0","reported_seq":1,"reported_epoch":125,"state":"creating+peering","last_fresh":"2024-09-17T05:52:18.885585+0000","last_change":"2024-09-17T05:52:18.885585+0000","last_active":"2024-09-17T05:52:18.873991+0000","last_peered":"2024-09-17T05:52:18.873991+0000","last_clean":"2024-09-17T05:52:18.873991+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:52:18.885585+0000","last_undegraded":"2024-09-17T05:52:18.885585+0000","last_fullsized":"2024-09-17T05:52:18.885585+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:52:18.873991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:52:18.873991+0000","last_clean_scrub_stamp":"2024-09-17T05:52:18.873991+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:52:18.873991+0000","last_change":"2024-09-17T05:52:18.873991+0000","last_active":"2024-09-17T05:52:18.873991+0000","last_peered":"2024-09-17T05:52:18.873991+0000","last_clean":"2024-09-17T05:52:18.873991+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:52:18.873991+0000","last_undegraded":"2024-09-17T05:52:18.873991+0000","last_fullsized":"2024-09-17T05:52:18.873991+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:52:18.873991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:52:18.873991+0000","last_clean_scrub_stamp":"2024-09-17T05:52:18.873991+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.28","version":"0'0","reported_seq":1,"reported_epoch":125,"state":"creating+peering","last_fresh":"2024-09-17T05:52:18.884950+0000","last_change":"2024-09-17T05:52:18.884950+0000","last_active":"2024-09-17T05:52:18.873991+0000","last_peered":"2024-09-17T05:52:18.873991+0000","last_clean":"2024-09-17T05:52:18.873991+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:52:18.884950+0000","last_undegraded":"2024-09-17T05:52:18.884950+0000","last_fullsized":"2024-09-17T05:52:18.884950+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:52:18.873991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:52:18.873991+0000","last_clean_scrub_stamp":"2024-09-17T05:52:18.873991+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:52:18.873991+0000","last_change":"2024-09-17T05:52:18.873991+0000","last_active":"2024-09-17T05:52:18.873991+0000","last_peered":"2024-09-17T05:52:18.873991+0000","last_clean":"2024-09-17T05:52:18.873991+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:52:18.873991+0000","last_undegraded":"2024-09-17T05:52:18.873991+0000","last_fullsized":"2024-09-17T05:52:18.873991+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:52:18.873991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:52:18.873991+0000","last_clean_scrub_stamp":"2024-09-17T05:52:18.873991+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:52:18.873991+0000","last_change":"2024-09-17T05:52:18.873991+0000","last_active":"2024-09-17T05:52:18.873991+0000","last_peered":"2024-09-17T05:52:18.873991+0000","last_clean":"2024-09-17T05:52:18.873991+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:52:18.873991+0000","last_undegraded":"2024-09-17T05:52:18.873991+0000","last_fullsized":"2024-09-17T05:52:18.873991+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:52:18.873991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:52:18.873991+0000","last_clean_scrub_stamp":"2024-09-17T05:52:18.873991+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:52:18.873991+0000","last_change":"2024-09-17T05:52:18.873991+0000","last_active":"2024-09-17T05:52:18.873991+0000","last_peered":"2024-09-17T05:52:18.873991+0000","last_clean":"2024-09-17T05:52:18.873991+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:52:18.873991+0000","last_undegraded":"2024-09-17T05:52:18.873991+0000","last_fullsized":"2024-09-17T05:52:18.873991+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:52:18.873991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:52:18.873991+0000","last_clean_scrub_stamp":"2024-09-17T05:52:18.873991+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.24","version":"0'0","reported_seq":13,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-09-17T05:52:21.029763+0000","last_change":"2024-09-17T05:52:19.919487+0000","last_active":"2024-09-17T05:52:21.029763+0000","last_peered":"2024-09-17T05:52:21.029763+0000","last_clean":"2024-09-17T05:52:21.029763+0000","last_became_active":"2024-09-17T05:52:19.919132+0000","last_became_peered":"2024-09-17T05:52:19.919132+0000","last_unstale":"2024-09-17T05:52:21.029763+0000","last_undegraded":"2024-09-17T05:52:21.029763+0000","last_fullsized":"2024-09-17T05:52:21.029763+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:52:18.873991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:52:18.873991+0000","last_clean_scrub_stamp":"2024-09-17T05:52:18.873991+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:47:54.083475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:52:18.873991+0000","last_change":"2024-09-17T05:52:18.873991+0000","last_active":"2024-09-17T05:52:18.873991+0000","last_peered":"2024-09-17T05:52:18.873991+0000","last_clean":"2024-09-17T05:52:18.873991+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:52:18.873991+0000","last_undegraded":"2024-09-17T05:52:18.873991+0000","last_fullsized":"2024-09-17T05:52:18.873991+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:52:18.873991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:52:18.873991+0000","last_clean_scrub_stamp":"2024-09-17T05:52:18.873991+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:52:18.873991+0000","last_change":"2024-09-17T05:52:18.873991+0000","last_active":"2024-09-17T05:52:18.873991+0000","last_peered":"2024-09-17T05:52:18.873991+0000","last_clean":"2024-09-17T05:52:18.873991+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:52:18.873991+0000","last_undegraded":"2024-09-17T05:52:18.873991+0000","last_fullsized":"2024-09-17T05:52:18.873991+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:52:18.873991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:52:18.873991+0000","last_clean_scrub_stamp":"2024-09-17T05:52:18.873991+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.21","version":"0'0","reported_seq":13,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-09-17T05:52:20.912884+0000","last_change":"2024-09-17T05:52:19.921396+0000","last_active":"2024-09-17T05:52:20.912884+0000","last_peered":"2024-09-17T05:52:20.912884+0000","last_clean":"2024-09-17T05:52:20.912884+0000","last_became_active":"2024-09-17T05:52:19.916646+0000","last_became_peered":"2024-09-17T05:52:19.916646+0000","last_unstale":"2024-09-17T05:52:20.912884+0000","last_undegraded":"2024-09-17T05:52:20.912884+0000","last_fullsized":"2024-09-17T05:52:20.912884+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:52:18.873991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:52:18.873991+0000","last_clean_scrub_stamp":"2024-09-17T05:52:18.873991+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:31:59.058914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.20","version":"0'0","reported_seq":13,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-09-17T05:52:20.915791+0000","last_change":"2024-09-17T05:52:19.913824+0000","last_active":"2024-09-17T05:52:20.915791+0000","last_peered":"2024-09-17T05:52:20.915791+0000","last_clean":"2024-09-17T05:52:20.915791+0000","last_became_active":"2024-09-17T05:52:19.913513+0000","last_became_peered":"2024-09-17T05:52:19.913513+0000","last_unstale":"2024-09-17T05:52:20.915791+0000","last_undegraded":"2024-09-17T05:52:20.915791+0000","last_fullsized":"2024-09-17T05:52:20.915791+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:52:18.873991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:52:18.873991+0000","last_clean_scrub_stamp":"2024-09-17T05:52:18.873991+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:11:48.541624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:52:18.873991+0000","last_change":"2024-09-17T05:52:18.873991+0000","last_active":"2024-09-17T05:52:18.873991+0000","last_peered":"2024-09-17T05:52:18.873991+0000","last_clean":"2024-09-17T05:52:18.873991+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:52:18.873991+0000","last_undegraded":"2024-09-17T05:52:18.873991+0000","last_fullsized":"2024-09-17T05:52:18.873991+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:52:18.873991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:52:18.873991+0000","last_clean_scrub_stamp":"2024-09-17T05:52:18.873991+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.1f","version":"126'4","reported_seq":19,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-09-17T05:52:20.913562+0000","last_change":"2024-09-17T05:52:18.893653+0000","last_active":"2024-09-17T05:52:20.913562+0000","last_peered":"2024-09-17T05:52:20.913562+0000","last_clean":"2024-09-17T05:52:20.913562+0000","last_became_active":"2024-09-17T05:52:18.893296+0000","last_became_peered":"2024-09-17T05:52:18.893296+0000","last_unstale":"2024-09-17T05:52:20.913562+0000","last_undegraded":"2024-09-17T05:52:20.913562+0000","last_fullsized":"2024-09-17T05:52:20.913562+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:52:17.867506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:52:17.867506+0000","last_clean_scrub_stamp":"2024-09-17T05:52:17.867506+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:50:03.925050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:52:18.873991+0000","last_change":"2024-09-17T05:52:18.873991+0000","last_active":"2024-09-17T05:52:18.873991+0000","last_peered":"2024-09-17T05:52:18.873991+0000","last_clean":"2024-09-17T05:52:18.873991+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:52:18.873991+0000","last_undegraded":"2024-09-17T05:52:18.873991+0000","last_fullsized":"2024-09-17T05:52:18.873991+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:52:18.873991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:52:18.873991+0000","last_clean_scrub_stamp":"2024-09-17T05:52:18.873991+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.1e","version":"126'1","reported_seq":16,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-09-17T05:52:21.029801+0000","last_change":"2024-09-17T05:52:18.895473+0000","last_active":"2024-09-17T05:52:21.029801+0000","last_peered":"2024-09-17T05:52:21.029801+0000","last_clean":"2024-09-17T05:52:21.029801+0000","last_became_active":"2024-09-17T05:52:18.895096+0000","last_became_peered":"2024-09-17T05:52:18.895096+0000","last_unstale":"2024-09-17T05:52:21.029801+0000","last_undegraded":"2024-09-17T05:52:21.029801+0000","last_fullsized":"2024-09-17T05:52:21.029801+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:52:17.867506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:52:17.867506+0000","last_clean_scrub_stamp":"2024-09-17T05:52:17.867506+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:12:57.384707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.1c","version":"0'0","reported_seq":13,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-09-17T05:52:20.913652+0000","last_change":"2024-09-17T05:52:19.927142+0000","last_active":"2024-09-17T05:52:20.913652+0000","last_peered":"2024-09-17T05:52:20.913652+0000","last_clean":"2024-09-17T05:52:20.913652+0000","last_became_active":"2024-09-17T05:52:19.926836+0000","last_became_peered":"2024-09-17T05:52:19.926836+0000","last_unstale":"2024-09-17T05:52:20.913652+0000","last_undegraded":"2024-09-17T05:52:20.913652+0000","last_fullsized":"2024-09-17T05:52:20.913652+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:52:18.873991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:52:18.873991+0000","last_clean_scrub_stamp":"2024-09-17T05:52:18.873991+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:04:57.127249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.1d","version":"0'0","reported_seq":10,"reported_epoch":125,"state":"active+clean","last_fresh":"2024-09-17T05:52:18.899013+0000","last_change":"2024-09-17T05:52:18.897259+0000","last_active":"2024-09-17T05:52:18.899013+0000","last_peered":"2024-09-17T05:52:18.899013+0000","last_clean":"2024-09-17T05:52:18.899013+0000","last_became_active":"2024-09-17T05:52:18.896947+0000","last_became_peered":"2024-09-17T05:52:18.896947+0000","last_unstale":"2024-09-17T05:52:18.899013+0000","last_undegraded":"2024-09-17T05:52:18.899013+0000","last_fullsized":"2024-09-17T05:52:18.899013+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:52:17.867506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:52:17.867506+0000","last_clean_scrub_stamp":"2024-09-17T05:52:17.867506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:04:52.286987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.1d","version":"0'0","reported_seq":13,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-09-17T05:52:20.913030+0000","last_change":"2024-09-17T05:52:19.914720+0000","last_active":"2024-09-17T05:52:20.913030+0000","last_peered":"2024-09-17T05:52:20.913030+0000","last_clean":"2024-09-17T05:52:20.913030+0000","last_became_active":"2024-09-17T05:52:19.914342+0000","last_became_peered":"2024-09-17T05:52:19.914342+0000","last_unstale":"2024-09-17T05:52:20.913030+0000","last_undegraded":"2024-09-17T05:52:20.913030+0000","last_fullsized":"2024-09-17T05:52:20.913030+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:52:18.873991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:52:18.873991+0000","last_clean_scrub_stamp":"2024-09-17T05:52:18.873991+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:05:11.605569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.1c","version":"0'0","reported_seq":1,"reported_epoch":124,"state":"creating+peering","last_fresh":"2024-09-17T05:52:17.881845+0000","last_change":"2024-09-17T05:52:17.881845+0000","last_active":"2024-09-17T05:52:17.867506+0000","last_peered":"2024-09-17T05:52:17.867506+0000","last_clean":"2024-09-17T05:52:17.867506+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:52:17.881845+0000","last_undegraded":"2024-09-17T05:52:17.881845+0000","last_fullsized":"2024-09-17T05:52:17.881845+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:52:17.867506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:52:17.867506+0000","last_clean_scrub_stamp":"2024-09-17T05:52:17.867506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:52:18.873991+0000","last_change":"2024-09-17T05:52:18.873991+0000","last_active":"2024-09-17T05:52:18.873991+0000","last_peered":"2024-09-17T05:52:18.873991+0000","last_clean":"2024-09-17T05:52:18.873991+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:52:18.873991+0000","last_undegraded":"2024-09-17T05:52:18.873991+0000","last_fullsized":"2024-09-17T05:52:18.873991+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:52:18.873991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:52:18.873991+0000","last_clean_scrub_stamp":"2024-09-17T05:52:18.873991+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.1b","version":"0'0","reported_seq":1,"reported_epoch":124,"state":"creating+peering","last_fresh":"2024-09-17T05:52:17.881454+0000","last_change":"2024-09-17T05:52:17.881454+0000","last_active":"2024-09-17T05:52:17.867506+0000","last_peered":"2024-09-17T05:52:17.867506+0000","last_clean":"2024-09-17T05:52:17.867506+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:52:17.881454+0000","last_undegraded":"2024-09-17T05:52:17.881454+0000","last_fullsized":"2024-09-17T05:52:17.881454+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:52:17.867506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:52:17.867506+0000","last_clean_scrub_stamp":"2024-09-17T05:52:17.867506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.1b","version":"0'0","reported_seq":13,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-09-17T05:52:20.916633+0000","last_change":"2024-09-17T05:52:19.920703+0000","last_active":"2024-09-17T05:52:20.916633+0000","last_peered":"2024-09-17T05:52:20.916633+0000","last_clean":"2024-09-17T05:52:20.916633+0000","last_became_active":"2024-09-17T05:52:19.920376+0000","last_became_peered":"2024-09-17T05:52:19.920376+0000","last_unstale":"2024-09-17T05:52:20.916633+0000","last_undegraded":"2024-09-17T05:52:20.916633+0000","last_fullsized":"2024-09-17T05:52:20.916633+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:52:18.873991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:52:18.873991+0000","last_clean_scrub_stamp":"2024-09-17T05:52:18.873991+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:47:56.025899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.1a","version":"0'0","reported_seq":1,"reported_epoch":124,"state":"creating+peering","last_fresh":"2024-09-17T05:52:17.881579+0000","last_change":"2024-09-17T05:52:17.881579+0000","last_active":"2024-09-17T05:52:17.867506+0000","last_peered":"2024-09-17T05:52:17.867506+0000","last_clean":"2024-09-17T05:52:17.867506+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:52:17.881579+0000","last_undegraded":"2024-09-17T05:52:17.881579+0000","last_fullsized":"2024-09-17T05:52:17.881579+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:52:17.867506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:52:17.867506+0000","last_clean_scrub_stamp":"2024-09-17T05:52:17.867506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:52:18.873991+0000","last_change":"2024-09-17T05:52:18.873991+0000","last_active":"2024-09-17T05:52:18.873991+0000","last_peered":"2024-09-17T05:52:18.873991+0000","last_clean":"2024-09-17T05:52:18.873991+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:52:18.873991+0000","last_undegraded":"2024-09-17T05:52:18.873991+0000","last_fullsized":"2024-09-17T05:52:18.873991+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:52:18.873991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:52:18.873991+0000","last_clean_scrub_stamp":"2024-09-17T05:52:18.873991+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.19","version":"0'0","reported_seq":15,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-09-17T05:52:20.915745+0000","last_change":"2024-09-17T05:52:18.895524+0000","last_active":"2024-09-17T05:52:20.915745+0000","last_peered":"2024-09-17T05:52:20.915745+0000","last_clean":"2024-09-17T05:52:20.915745+0000","last_became_active":"2024-09-17T05:52:18.895221+0000","last_became_peered":"2024-09-17T05:52:18.895221+0000","last_unstale":"2024-09-17T05:52:20.915745+0000","last_undegraded":"2024-09-17T05:52:20.915745+0000","last_fullsized":"2024-09-17T05:52:20.915745+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:52:17.867506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:52:17.867506+0000","last_clean_scrub_stamp":"2024-09-17T05:52:17.867506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:03:36.241448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:52:18.873991+0000","last_change":"2024-09-17T05:52:18.873991+0000","last_active":"2024-09-17T05:52:18.873991+0000","last_peered":"2024-09-17T05:52:18.873991+0000","last_clean":"2024-09-17T05:52:18.873991+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:52:18.873991+0000","last_undegraded":"2024-09-17T05:52:18.873991+0000","last_fullsized":"2024-09-17T05:52:18.873991+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:52:18.873991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:52:18.873991+0000","last_clean_scrub_stamp":"2024-09-17T05:52:18.873991+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.18","version":"0'0","reported_seq":1,"reported_epoch":124,"state":"creating+peering","last_fresh":"2024-09-17T05:52:17.881271+0000","last_change":"2024-09-17T05:52:17.881271+0000","last_active":"2024-09-17T05:52:17.867506+0000","last_peered":"2024-09-17T05:52:17.867506+0000","last_clean":"2024-09-17T05:52:17.867506+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:52:17.881271+0000","last_undegraded":"2024-09-17T05:52:17.881271+0000","last_fullsized":"2024-09-17T05:52:17.881271+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:52:17.867506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:52:17.867506+0000","last_clean_scrub_stamp":"2024-09-17T05:52:17.867506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:52:18.873991+0000","last_change":"2024-09-17T05:52:18.873991+0000","last_active":"2024-09-17T05:52:18.873991+0000","last_peered":"2024-09-17T05:52:18.873991+0000","last_clean":"2024-09-17T05:52:18.873991+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:52:18.873991+0000","last_undegraded":"2024-09-17T05:52:18.873991+0000","last_fullsized":"2024-09-17T05:52:18.873991+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:52:18.873991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:52:18.873991+0000","last_clean_scrub_stamp":"2024-09-17T05:52:18.873991+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.17","version":"0'0","reported_seq":15,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-09-17T05:52:21.030071+0000","last_change":"2024-09-17T05:52:18.894591+0000","last_active":"2024-09-17T05:52:21.030071+0000","last_peered":"2024-09-17T05:52:21.030071+0000","last_clean":"2024-09-17T05:52:21.030071+0000","last_became_active":"2024-09-17T05:52:18.894241+0000","last_became_peered":"2024-09-17T05:52:18.894241+0000","last_unstale":"2024-09-17T05:52:21.030071+0000","last_undegraded":"2024-09-17T05:52:21.030071+0000","last_fullsized":"2024-09-17T05:52:21.030071+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:52:17.867506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:52:17.867506+0000","last_clean_scrub_stamp":"2024-09-17T05:52:17.867506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:32:31.037419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.17","version":"0'0","reported_seq":13,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-09-17T05:52:21.029975+0000","last_change":"2024-09-17T05:52:19.918028+0000","last_active":"2024-09-17T05:52:21.029975+0000","last_peered":"2024-09-17T05:52:21.029975+0000","last_clean":"2024-09-17T05:52:21.029975+0000","last_became_active":"2024-09-17T05:52:19.916968+0000","last_became_peered":"2024-09-17T05:52:19.916968+0000","last_unstale":"2024-09-17T05:52:21.029975+0000","last_undegraded":"2024-09-17T05:52:21.029975+0000","last_fullsized":"2024-09-17T05:52:21.029975+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:52:18.873991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:52:18.873991+0000","last_clean_scrub_stamp":"2024-09-17T05:52:18.873991+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:23:24.221785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.16","version":"0'0","reported_seq":1,"reported_epoch":124,"state":"creating+peering","last_fresh":"2024-09-17T05:52:17.880840+0000","last_change":"2024-09-17T05:52:17.880840+0000","last_active":"2024-09-17T05:52:17.867506+0000","last_peered":"2024-09-17T05:52:17.867506+0000","last_clean":"2024-09-17T05:52:17.867506+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:52:17.880840+0000","last_undegraded":"2024-09-17T05:52:17.880840+0000","last_fullsized":"2024-09-17T05:52:17.880840+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:52:17.867506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:52:17.867506+0000","last_clean_scrub_stamp":"2024-09-17T05:52:17.867506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.14","version":"0'0","reported_seq":13,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-09-17T05:52:20.913700+0000","last_change":"2024-09-17T05:52:19.912074+0000","last_active":"2024-09-17T05:52:20.913700+0000","last_peered":"2024-09-17T05:52:20.913700+0000","last_clean":"2024-09-17T05:52:20.913700+0000","last_became_active":"2024-09-17T05:52:19.911738+0000","last_became_peered":"2024-09-17T05:52:19.911738+0000","last_unstale":"2024-09-17T05:52:20.913700+0000","last_undegraded":"2024-09-17T05:52:20.913700+0000","last_fullsized":"2024-09-17T05:52:20.913700+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:52:18.873991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:52:18.873991+0000","last_clean_scrub_stamp":"2024-09-17T05:52:18.873991+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:23:11.922990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.15","version":"126'3","reported_seq":18,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-09-17T05:52:21.029706+0000","last_change":"2024-09-17T05:52:18.899892+0000","last_active":"2024-09-17T05:52:21.029706+0000","last_peered":"2024-09-17T05:52:21.029706+0000","last_clean":"2024-09-17T05:52:21.029706+0000","last_became_active":"2024-09-17T05:52:18.899449+0000","last_became_peered":"2024-09-17T05:52:18.899449+0000","last_unstale":"2024-09-17T05:52:21.029706+0000","last_undegraded":"2024-09-17T05:52:21.029706+0000","last_fullsized":"2024-09-17T05:52:21.029706+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:52:17.867506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:52:17.867506+0000","last_clean_scrub_stamp":"2024-09-17T05:52:17.867506+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:01:50.779410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.15","version":"0'0","reported_seq":13,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-09-17T05:52:20.913349+0000","last_change":"2024-09-17T05:52:19.909257+0000","last_active":"2024-09-17T05:52:20.913349+0000","last_peered":"2024-09-17T05:52:20.913349+0000","last_clean":"2024-09-17T05:52:20.913349+0000","last_became_active":"2024-09-17T05:52:19.908004+0000","last_became_peered":"2024-09-17T05:52:19.908004+0000","last_unstale":"2024-09-17T05:52:20.913349+0000","last_undegraded":"2024-09-17T05:52:20.913349+0000","last_fullsized":"2024-09-17T05:52:20.913349+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:52:18.873991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:52:18.873991+0000","last_clean_scrub_stamp":"2024-09-17T05:52:18.873991+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:41:01.713245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.14","version":"0'0","reported_seq":1,"reported_epoch":124,"state":"creating+peering","last_fresh":"2024-09-17T05:52:17.882679+0000","last_change":"2024-09-17T05:52:17.882679+0000","last_active":"2024-09-17T05:52:17.867506+0000","last_peered":"2024-09-17T05:52:17.867506+0000","last_clean":"2024-09-17T05:52:17.867506+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:52:17.882679+0000","last_undegraded":"2024-09-17T05:52:17.882679+0000","last_fullsized":"2024-09-17T05:52:17.882679+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:52:17.867506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:52:17.867506+0000","last_clean_scrub_stamp":"2024-09-17T05:52:17.867506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:52:18.873991+0000","last_change":"2024-09-17T05:52:18.873991+0000","last_active":"2024-09-17T05:52:18.873991+0000","last_peered":"2024-09-17T05:52:18.873991+0000","last_clean":"2024-09-17T05:52:18.873991+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:52:18.873991+0000","last_undegraded":"2024-09-17T05:52:18.873991+0000","last_fullsized":"2024-09-17T05:52:18.873991+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:52:18.873991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:52:18.873991+0000","last_clean_scrub_stamp":"2024-09-17T05:52:18.873991+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.12","version":"0'0","reported_seq":1,"reported_epoch":124,"state":"creating+peering","last_fresh":"2024-09-17T05:52:17.879821+0000","last_change":"2024-09-17T05:52:17.879821+0000","last_active":"2024-09-17T05:52:17.867506+0000","last_peered":"2024-09-17T05:52:17.867506+0000","last_clean":"2024-09-17T05:52:17.867506+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:52:17.879821+0000","last_undegraded":"2024-09-17T05:52:17.879821+0000","last_fullsized":"2024-09-17T05:52:17.879821+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:52:17.867506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:52:17.867506+0000","last_clean_scrub_stamp":"2024-09-17T05:52:17.867506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:52:18.873991+0000","last_change":"2024-09-17T05:52:18.873991+0000","last_active":"2024-09-17T05:52:18.873991+0000","last_peered":"2024-09-17T05:52:18.873991+0000","last_clean":"2024-09-17T05:52:18.873991+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:52:18.873991+0000","last_undegraded":"2024-09-17T05:52:18.873991+0000","last_fullsized":"2024-09-17T05:52:18.873991+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:52:18.873991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:52:18.873991+0000","last_clean_scrub_stamp":"2024-09-17T05:52:18.873991+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.11","version":"0'0","reported_seq":1,"reported_epoch":124,"state":"creating+peering","last_fresh":"2024-09-17T05:52:17.880788+0000","last_change":"2024-09-17T05:52:17.880788+0000","last_active":"2024-09-17T05:52:17.867506+0000","last_peered":"2024-09-17T05:52:17.867506+0000","last_clean":"2024-09-17T05:52:17.867506+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:52:17.880788+0000","last_undegraded":"2024-09-17T05:52:17.880788+0000","last_fullsized":"2024-09-17T05:52:17.880788+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:52:17.867506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:52:17.867506+0000","last_clean_scrub_stamp":"2024-09-17T05:52:17.867506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:52:18.873991+0000","last_change":"2024-09-17T05:52:18.873991+0000","last_active":"2024-09-17T05:52:18.873991+0000","last_peered":"2024-09-17T05:52:18.873991+0000","last_clean":"2024-09-17T05:52:18.873991+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:52:18.873991+0000","last_undegraded":"2024-09-17T05:52:18.873991+0000","last_fullsized":"2024-09-17T05:52:18.873991+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:52:18.873991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:52:18.873991+0000","last_clean_scrub_stamp":"2024-09-17T05:52:18.873991+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.10","version":"0'0","reported_seq":1,"reported_epoch":124,"state":"creating+peering","last_fresh":"2024-09-17T05:52:17.882633+0000","last_change":"2024-09-17T05:52:17.882633+0000","last_active":"2024-09-17T05:52:17.867506+0000","last_peered":"2024-09-17T05:52:17.867506+0000","last_clean":"2024-09-17T05:52:17.867506+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:52:17.882633+0000","last_undegraded":"2024-09-17T05:52:17.882633+0000","last_fullsized":"2024-09-17T05:52:17.882633+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:52:17.867506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:52:17.867506+0000","last_clean_scrub_stamp":"2024-09-17T05:52:17.867506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:52:18.873991+0000","last_change":"2024-09-17T05:52:18.873991+0000","last_active":"2024-09-17T05:52:18.873991+0000","last_peered":"2024-09-17T05:52:18.873991+0000","last_clean":"2024-09-17T05:52:18.873991+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:52:18.873991+0000","last_undegraded":"2024-09-17T05:52:18.873991+0000","last_fullsized":"2024-09-17T05:52:18.873991+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:52:18.873991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:52:18.873991+0000","last_clean_scrub_stamp":"2024-09-17T05:52:18.873991+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.f","version":"126'1","reported_seq":16,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-09-17T05:52:21.030089+0000","last_change":"2024-09-17T05:52:18.897267+0000","last_active":"2024-09-17T05:52:21.030089+0000","last_peered":"2024-09-17T05:52:21.030089+0000","last_clean":"2024-09-17T05:52:21.030089+0000","last_became_active":"2024-09-17T05:52:18.896904+0000","last_became_peered":"2024-09-17T05:52:18.896904+0000","last_unstale":"2024-09-17T05:52:21.030089+0000","last_undegraded":"2024-09-17T05:52:21.030089+0000","last_fullsized":"2024-09-17T05:52:21.030089+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:52:17.867506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:52:17.867506+0000","last_clean_scrub_stamp":"2024-09-17T05:52:17.867506+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:12:04.538452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.f","version":"0'0","reported_seq":13,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-09-17T05:52:21.029915+0000","last_change":"2024-09-17T05:52:19.919016+0000","last_active":"2024-09-17T05:52:21.029915+0000","last_peered":"2024-09-17T05:52:21.029915+0000","last_clean":"2024-09-17T05:52:21.029915+0000","last_became_active":"2024-09-17T05:52:19.918688+0000","last_became_peered":"2024-09-17T05:52:19.918688+0000","last_unstale":"2024-09-17T05:52:21.029915+0000","last_undegraded":"2024-09-17T05:52:21.029915+0000","last_fullsized":"2024-09-17T05:52:21.029915+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:52:18.873991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:52:18.873991+0000","last_clean_scrub_stamp":"2024-09-17T05:52:18.873991+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:31:23.140660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.e","version":"0'0","reported_seq":10,"reported_epoch":125,"state":"active+clean","last_fresh":"2024-09-17T05:52:18.895645+0000","last_change":"2024-09-17T05:52:18.893709+0000","last_active":"2024-09-17T05:52:18.895645+0000","last_peered":"2024-09-17T05:52:18.895645+0000","last_clean":"2024-09-17T05:52:18.895645+0000","last_became_active":"2024-09-17T05:52:18.893409+0000","last_became_peered":"2024-09-17T05:52:18.893409+0000","last_unstale":"2024-09-17T05:52:18.895645+0000","last_undegraded":"2024-09-17T05:52:18.895645+0000","last_fullsized":"2024-09-17T05:52:18.895645+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:52:17.867506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:52:17.867506+0000","last_clean_scrub_stamp":"2024-09-17T05:52:17.867506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:00:31.935995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:52:18.873991+0000","last_change":"2024-09-17T05:52:18.873991+0000","last_active":"2024-09-17T05:52:18.873991+0000","last_peered":"2024-09-17T05:52:18.873991+0000","last_clean":"2024-09-17T05:52:18.873991+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:52:18.873991+0000","last_undegraded":"2024-09-17T05:52:18.873991+0000","last_fullsized":"2024-09-17T05:52:18.873991+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:52:18.873991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:52:18.873991+0000","last_clean_scrub_stamp":"2024-09-17T05:52:18.873991+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.d","version":"126'1","reported_seq":16,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-09-17T05:52:20.916203+0000","last_change":"2024-09-17T05:52:18.896965+0000","last_active":"2024-09-17T05:52:20.916203+0000","last_peered":"2024-09-17T05:52:20.916203+0000","last_clean":"2024-09-17T05:52:20.916203+0000","last_became_active":"2024-09-17T05:52:18.896665+0000","last_became_peered":"2024-09-17T05:52:18.896665+0000","last_unstale":"2024-09-17T05:52:20.916203+0000","last_undegraded":"2024-09-17T05:52:20.916203+0000","last_fullsized":"2024-09-17T05:52:20.916203+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:52:17.867506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:52:17.867506+0000","last_clean_scrub_stamp":"2024-09-17T05:52:17.867506+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:03:31.140556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:52:18.873991+0000","last_change":"2024-09-17T05:52:18.873991+0000","last_active":"2024-09-17T05:52:18.873991+0000","last_peered":"2024-09-17T05:52:18.873991+0000","last_clean":"2024-09-17T05:52:18.873991+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:52:18.873991+0000","last_undegraded":"2024-09-17T05:52:18.873991+0000","last_fullsized":"2024-09-17T05:52:18.873991+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:52:18.873991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:52:18.873991+0000","last_clean_scrub_stamp":"2024-09-17T05:52:18.873991+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.c","version":"0'0","reported_seq":15,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-09-17T05:52:21.029699+0000","last_change":"2024-09-17T05:52:18.897796+0000","last_active":"2024-09-17T05:52:21.029699+0000","last_peered":"2024-09-17T05:52:21.029699+0000","last_clean":"2024-09-17T05:52:21.029699+0000","last_became_active":"2024-09-17T05:52:18.896607+0000","last_became_peered":"2024-09-17T05:52:18.896607+0000","last_unstale":"2024-09-17T05:52:21.029699+0000","last_undegraded":"2024-09-17T05:52:21.029699+0000","last_fullsized":"2024-09-17T05:52:21.029699+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:52:17.867506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:52:17.867506+0000","last_clean_scrub_stamp":"2024-09-17T05:52:17.867506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:06:49.196334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:52:18.873991+0000","last_change":"2024-09-17T05:52:18.873991+0000","last_active":"2024-09-17T05:52:18.873991+0000","last_peered":"2024-09-17T05:52:18.873991+0000","last_clean":"2024-09-17T05:52:18.873991+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:52:18.873991+0000","last_undegraded":"2024-09-17T05:52:18.873991+0000","last_fullsized":"2024-09-17T05:52:18.873991+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:52:18.873991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:52:18.873991+0000","last_clean_scrub_stamp":"2024-09-17T05:52:18.873991+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.b","version":"126'2","reported_seq":17,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-09-17T05:52:21.029634+0000","last_change":"2024-09-17T05:52:18.898700+0000","last_active":"2024-09-17T05:52:21.029634+0000","last_peered":"2024-09-17T05:52:21.029634+0000","last_clean":"2024-09-17T05:52:21.029634+0000","last_became_active":"2024-09-17T05:52:18.898205+0000","last_became_peered":"2024-09-17T05:52:18.898205+0000","last_unstale":"2024-09-17T05:52:21.029634+0000","last_undegraded":"2024-09-17T05:52:21.029634+0000","last_fullsized":"2024-09-17T05:52:21.029634+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:52:17.867506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:52:17.867506+0000","last_clean_scrub_stamp":"2024-09-17T05:52:17.867506+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:03:42.897065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.b","version":"0'0","reported_seq":13,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-09-17T05:52:20.916229+0000","last_change":"2024-09-17T05:52:19.926434+0000","last_active":"2024-09-17T05:52:20.916229+0000","last_peered":"2024-09-17T05:52:20.916229+0000","last_clean":"2024-09-17T05:52:20.916229+0000","last_became_active":"2024-09-17T05:52:19.926138+0000","last_became_peered":"2024-09-17T05:52:19.926138+0000","last_unstale":"2024-09-17T05:52:20.916229+0000","last_undegraded":"2024-09-17T05:52:20.916229+0000","last_fullsized":"2024-09-17T05:52:20.916229+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:52:18.873991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:52:18.873991+0000","last_clean_scrub_stamp":"2024-09-17T05:52:18.873991+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:39:56.592090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.a","version":"0'0","reported_seq":1,"reported_epoch":124,"state":"creating+peering","last_fresh":"2024-09-17T05:52:17.880917+0000","last_change":"2024-09-17T05:52:17.880917+0000","last_active":"2024-09-17T05:52:17.867506+0000","last_peered":"2024-09-17T05:52:17.867506+0000","last_clean":"2024-09-17T05:52:17.867506+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:52:17.880917+0000","last_undegraded":"2024-09-17T05:52:17.880917+0000","last_fullsized":"2024-09-17T05:52:17.880917+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:52:17.867506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:52:17.867506+0000","last_clean_scrub_stamp":"2024-09-17T05:52:17.867506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:52:18.873991+0000","last_change":"2024-09-17T05:52:18.873991+0000","last_active":"2024-09-17T05:52:18.873991+0000","last_peered":"2024-09-17T05:52:18.873991+0000","last_clean":"2024-09-17T05:52:18.873991+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:52:18.873991+0000","last_undegraded":"2024-09-17T05:52:18.873991+0000","last_fullsized":"2024-09-17T05:52:18.873991+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:52:18.873991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:52:18.873991+0000","last_clean_scrub_stamp":"2024-09-17T05:52:18.873991+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.9","version":"0'0","reported_seq":1,"reported_epoch":124,"state":"creating+peering","last_fresh":"2024-09-17T05:52:17.881742+0000","last_change":"2024-09-17T05:52:17.881742+0000","last_active":"2024-09-17T05:52:17.867506+0000","last_peered":"2024-09-17T05:52:17.867506+0000","last_clean":"2024-09-17T05:52:17.867506+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:52:17.881742+0000","last_undegraded":"2024-09-17T05:52:17.881742+0000","last_fullsized":"2024-09-17T05:52:17.881742+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:52:17.867506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:52:17.867506+0000","last_clean_scrub_stamp":"2024-09-17T05:52:17.867506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.9","version":"0'0","reported_seq":13,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-09-17T05:52:20.913125+0000","last_change":"2024-09-17T05:52:19.920709+0000","last_active":"2024-09-17T05:52:20.913125+0000","last_peered":"2024-09-17T05:52:20.913125+0000","last_clean":"2024-09-17T05:52:20.913125+0000","last_became_active":"2024-09-17T05:52:19.917358+0000","last_became_peered":"2024-09-17T05:52:19.917358+0000","last_unstale":"2024-09-17T05:52:20.913125+0000","last_undegraded":"2024-09-17T05:52:20.913125+0000","last_fullsized":"2024-09-17T05:52:20.913125+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:52:18.873991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:52:18.873991+0000","last_clean_scrub_stamp":"2024-09-17T05:52:18.873991+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:02:10.659710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.8","version":"0'0","reported_seq":10,"reported_epoch":125,"state":"active+clean","last_fresh":"2024-09-17T05:52:18.895648+0000","last_change":"2024-09-17T05:52:18.893798+0000","last_active":"2024-09-17T05:52:18.895648+0000","last_peered":"2024-09-17T05:52:18.895648+0000","last_clean":"2024-09-17T05:52:18.895648+0000","last_became_active":"2024-09-17T05:52:18.893085+0000","last_became_peered":"2024-09-17T05:52:18.893085+0000","last_unstale":"2024-09-17T05:52:18.895648+0000","last_undegraded":"2024-09-17T05:52:18.895648+0000","last_fullsized":"2024-09-17T05:52:18.895648+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:52:17.867506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:52:17.867506+0000","last_clean_scrub_stamp":"2024-09-17T05:52:17.867506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:43:24.092663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.6","version":"0'0","reported_seq":13,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-09-17T05:52:20.916705+0000","last_change":"2024-09-17T05:52:19.926025+0000","last_active":"2024-09-17T05:52:20.916705+0000","last_peered":"2024-09-17T05:52:20.916705+0000","last_clean":"2024-09-17T05:52:20.916705+0000","last_became_active":"2024-09-17T05:52:19.925657+0000","last_became_peered":"2024-09-17T05:52:19.925657+0000","last_unstale":"2024-09-17T05:52:20.916705+0000","last_undegraded":"2024-09-17T05:52:20.916705+0000","last_fullsized":"2024-09-17T05:52:20.916705+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:52:18.873991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:52:18.873991+0000","last_clean_scrub_stamp":"2024-09-17T05:52:18.873991+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:54:11.013453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.7","version":"0'0","reported_seq":1,"reported_epoch":124,"state":"creating+peering","last_fresh":"2024-09-17T05:52:17.879834+0000","last_change":"2024-09-17T05:52:17.879834+0000","last_active":"2024-09-17T05:52:17.867506+0000","last_peered":"2024-09-17T05:52:17.867506+0000","last_clean":"2024-09-17T05:52:17.867506+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:52:17.879834+0000","last_undegraded":"2024-09-17T05:52:17.879834+0000","last_fullsized":"2024-09-17T05:52:17.879834+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:52:17.867506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:52:17.867506+0000","last_clean_scrub_stamp":"2024-09-17T05:52:17.867506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:52:18.873991+0000","last_change":"2024-09-17T05:52:18.873991+0000","last_active":"2024-09-17T05:52:18.873991+0000","last_peered":"2024-09-17T05:52:18.873991+0000","last_clean":"2024-09-17T05:52:18.873991+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:52:18.873991+0000","last_undegraded":"2024-09-17T05:52:18.873991+0000","last_fullsized":"2024-09-17T05:52:18.873991+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:52:18.873991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:52:18.873991+0000","last_clean_scrub_stamp":"2024-09-17T05:52:18.873991+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.6","version":"127'1","reported_seq":16,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-09-17T05:52:20.914810+0000","last_change":"2024-09-17T05:52:18.893591+0000","last_active":"2024-09-17T05:52:20.914810+0000","last_peered":"2024-09-17T05:52:20.914810+0000","last_clean":"2024-09-17T05:52:20.914810+0000","last_became_active":"2024-09-17T05:52:18.893254+0000","last_became_peered":"2024-09-17T05:52:18.893254+0000","last_unstale":"2024-09-17T05:52:20.914810+0000","last_undegraded":"2024-09-17T05:52:20.914810+0000","last_fullsized":"2024-09-17T05:52:20.914810+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:52:17.867506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:52:17.867506+0000","last_clean_scrub_stamp":"2024-09-17T05:52:17.867506+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:20:34.378498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:52:18.873991+0000","last_change":"2024-09-17T05:52:18.873991+0000","last_active":"2024-09-17T05:52:18.873991+0000","last_peered":"2024-09-17T05:52:18.873991+0000","last_clean":"2024-09-17T05:52:18.873991+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:52:18.873991+0000","last_undegraded":"2024-09-17T05:52:18.873991+0000","last_fullsized":"2024-09-17T05:52:18.873991+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:52:18.873991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:52:18.873991+0000","last_clean_scrub_stamp":"2024-09-17T05:52:18.873991+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.5","version":"0'0","reported_seq":1,"reported_epoch":124,"state":"creating+peering","last_fresh":"2024-09-17T05:52:17.882208+0000","last_change":"2024-09-17T05:52:17.882208+0000","last_active":"2024-09-17T05:52:17.867506+0000","last_peered":"2024-09-17T05:52:17.867506+0000","last_clean":"2024-09-17T05:52:17.867506+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:52:17.882208+0000","last_undegraded":"2024-09-17T05:52:17.882208+0000","last_fullsized":"2024-09-17T05:52:17.882208+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:52:17.867506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:52:17.867506+0000","last_clean_scrub_stamp":"2024-09-17T05:52:17.867506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.5","version":"0'0","reported_seq":13,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-09-17T05:52:20.916284+0000","last_change":"2024-09-17T05:52:19.926104+0000","last_active":"2024-09-17T05:52:20.916284+0000","last_peered":"2024-09-17T05:52:20.916284+0000","last_clean":"2024-09-17T05:52:20.916284+0000","last_became_active":"2024-09-17T05:52:19.925767+0000","last_became_peered":"2024-09-17T05:52:19.925767+0000","last_unstale":"2024-09-17T05:52:20.916284+0000","last_undegraded":"2024-09-17T05:52:20.916284+0000","last_fullsized":"2024-09-17T05:52:20.916284+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:52:18.873991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:52:18.873991+0000","last_clean_scrub_stamp":"2024-09-17T05:52:18.873991+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:43:20.839584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.4","version":"0'0","reported_seq":10,"reported_epoch":125,"state":"active+clean","last_fresh":"2024-09-17T05:52:18.901169+0000","last_change":"2024-09-17T05:52:18.898186+0000","last_active":"2024-09-17T05:52:18.901169+0000","last_peered":"2024-09-17T05:52:18.901169+0000","last_clean":"2024-09-17T05:52:18.901169+0000","last_became_active":"2024-09-17T05:52:18.897402+0000","last_became_peered":"2024-09-17T05:52:18.897402+0000","last_unstale":"2024-09-17T05:52:18.901169+0000","last_undegraded":"2024-09-17T05:52:18.901169+0000","last_fullsized":"2024-09-17T05:52:18.901169+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:52:17.867506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:52:17.867506+0000","last_clean_scrub_stamp":"2024-09-17T05:52:17.867506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:49:01.468547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.2","version":"0'0","reported_seq":13,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-09-17T05:52:20.913065+0000","last_change":"2024-09-17T05:52:19.927870+0000","last_active":"2024-09-17T05:52:20.913065+0000","last_peered":"2024-09-17T05:52:20.913065+0000","last_clean":"2024-09-17T05:52:20.913065+0000","last_became_active":"2024-09-17T05:52:19.927573+0000","last_became_peered":"2024-09-17T05:52:19.927573+0000","last_unstale":"2024-09-17T05:52:20.913065+0000","last_undegraded":"2024-09-17T05:52:20.913065+0000","last_fullsized":"2024-09-17T05:52:20.913065+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:52:18.873991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:52:18.873991+0000","last_clean_scrub_stamp":"2024-09-17T05:52:18.873991+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:43:48.027258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.3","version":"0'0","reported_seq":1,"reported_epoch":124,"state":"creating+peering","last_fresh":"2024-09-17T05:52:17.880787+0000","last_change":"2024-09-17T05:52:17.880787+0000","last_active":"2024-09-17T05:52:17.867506+0000","last_peered":"2024-09-17T05:52:17.867506+0000","last_clean":"2024-09-17T05:52:17.867506+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:52:17.880787+0000","last_undegraded":"2024-09-17T05:52:17.880787+0000","last_fullsized":"2024-09-17T05:52:17.880787+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:52:17.867506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:52:17.867506+0000","last_clean_scrub_stamp":"2024-09-17T05:52:17.867506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.3","version":"0'0","reported_seq":13,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-09-17T05:52:21.029775+0000","last_change":"2024-09-17T05:52:19.923958+0000","last_active":"2024-09-17T05:52:21.029775+0000","last_peered":"2024-09-17T05:52:21.029775+0000","last_clean":"2024-09-17T05:52:21.029775+0000","last_became_active":"2024-09-17T05:52:19.923644+0000","last_became_peered":"2024-09-17T05:52:19.923644+0000","last_unstale":"2024-09-17T05:52:21.029775+0000","last_undegraded":"2024-09-17T05:52:21.029775+0000","last_fullsized":"2024-09-17T05:52:21.029775+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:52:18.873991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:52:18.873991+0000","last_clean_scrub_stamp":"2024-09-17T05:52:18.873991+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:47:43.829677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.2","version":"0'0","reported_seq":15,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-09-17T05:52:20.913214+0000","last_change":"2024-09-17T05:52:18.894258+0000","last_active":"2024-09-17T05:52:20.913214+0000","last_peered":"2024-09-17T05:52:20.913214+0000","last_clean":"2024-09-17T05:52:20.913214+0000","last_became_active":"2024-09-17T05:52:18.893908+0000","last_became_peered":"2024-09-17T05:52:18.893908+0000","last_unstale":"2024-09-17T05:52:20.913214+0000","last_undegraded":"2024-09-17T05:52:20.913214+0000","last_fullsized":"2024-09-17T05:52:20.913214+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:52:17.867506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:52:17.867506+0000","last_clean_scrub_stamp":"2024-09-17T05:52:17.867506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:04:22.951320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:52:18.873991+0000","last_change":"2024-09-17T05:52:18.873991+0000","last_active":"2024-09-17T05:52:18.873991+0000","last_peered":"2024-09-17T05:52:18.873991+0000","last_clean":"2024-09-17T05:52:18.873991+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:52:18.873991+0000","last_undegraded":"2024-09-17T05:52:18.873991+0000","last_fullsized":"2024-09-17T05:52:18.873991+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:52:18.873991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:52:18.873991+0000","last_clean_scrub_stamp":"2024-09-17T05:52:18.873991+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.1","version":"0'0","reported_seq":1,"reported_epoch":124,"state":"creating+peering","last_fresh":"2024-09-17T05:52:17.880828+0000","last_change":"2024-09-17T05:52:17.880828+0000","last_active":"2024-09-17T05:52:17.867506+0000","last_peered":"2024-09-17T05:52:17.867506+0000","last_clean":"2024-09-17T05:52:17.867506+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:52:17.880828+0000","last_undegraded":"2024-09-17T05:52:17.880828+0000","last_fullsized":"2024-09-17T05:52:17.880828+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:52:17.867506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:52:17.867506+0000","last_clean_scrub_stamp":"2024-09-17T05:52:17.867506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:52:18.873991+0000","last_change":"2024-09-17T05:52:18.873991+0000","last_active":"2024-09-17T05:52:18.873991+0000","last_peered":"2024-09-17T05:52:18.873991+0000","last_clean":"2024-09-17T05:52:18.873991+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:52:18.873991+0000","last_undegraded":"2024-09-17T05:52:18.873991+0000","last_fullsized":"2024-09-17T05:52:18.873991+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:52:18.873991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:52:18.873991+0000","last_clean_scrub_stamp":"2024-09-17T05:52:18.873991+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.0","version":"0'0","reported_seq":10,"reported_epoch":125,"state":"active+clean","last_fresh":"2024-09-17T05:52:18.890542+0000","last_change":"2024-09-17T05:52:18.889287+0000","last_active":"2024-09-17T05:52:18.890542+0000","last_peered":"2024-09-17T05:52:18.890542+0000","last_clean":"2024-09-17T05:52:18.890542+0000","last_became_active":"2024-09-17T05:52:18.888934+0000","last_became_peered":"2024-09-17T05:52:18.888934+0000","last_unstale":"2024-09-17T05:52:18.890542+0000","last_undegraded":"2024-09-17T05:52:18.890542+0000","last_fullsized":"2024-09-17T05:52:18.890542+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:52:17.867506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:52:17.867506+0000","last_clean_scrub_stamp":"2024-09-17T05:52:17.867506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:20:22.215964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.12","version":"0'0","reported_seq":13,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-09-17T05:52:20.913020+0000","last_change":"2024-09-17T05:52:19.917259+0000","last_active":"2024-09-17T05:52:20.913020+0000","last_peered":"2024-09-17T05:52:20.913020+0000","last_clean":"2024-09-17T05:52:20.913020+0000","last_became_active":"2024-09-17T05:52:19.916932+0000","last_became_peered":"2024-09-17T05:52:19.916932+0000","last_unstale":"2024-09-17T05:52:20.913020+0000","last_undegraded":"2024-09-17T05:52:20.913020+0000","last_fullsized":"2024-09-17T05:52:20.913020+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:52:18.873991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:52:18.873991+0000","last_clean_scrub_stamp":"2024-09-17T05:52:18.873991+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:28:29.059413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.13","version":"126'2","reported_seq":17,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-09-17T05:52:20.913529+0000","last_change":"2024-09-17T05:52:18.900120+0000","last_active":"2024-09-17T05:52:20.913529+0000","last_peered":"2024-09-17T05:52:20.913529+0000","last_clean":"2024-09-17T05:52:20.913529+0000","last_became_active":"2024-09-17T05:52:18.899687+0000","last_became_peered":"2024-09-17T05:52:18.899687+0000","last_unstale":"2024-09-17T05:52:20.913529+0000","last_undegraded":"2024-09-17T05:52:20.913529+0000","last_fullsized":"2024-09-17T05:52:20.913529+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:52:17.867506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:52:17.867506+0000","last_clean_scrub_stamp":"2024-09-17T05:52:17.867506+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:26:59.669212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"19'72","reported_seq":302,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-09-17T05:52:20.912559+0000","last_change":"2024-09-17T05:41:48.539830+0000","last_active":"2024-09-17T05:52:20.912559+0000","last_peered":"2024-09-17T05:52:20.912559+0000","last_clean":"2024-09-17T05:52:20.912559+0000","last_became_active":"2024-09-17T05:41:48.538743+0000","last_became_peered":"2024-09-17T05:41:48.538743+0000","last_unstale":"2024-09-17T05:52:20.912559+0000","last_undegraded":"2024-09-17T05:52:20.912559+0000","last_fullsized":"2024-09-17T05:52:20.912559+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:47.152539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:47.152539+0000","last_clean_scrub_stamp":"2024-09-17T05:41:47.152539+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:08:02.952016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":19,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":52,"acting":52,"num_store_stats":4},{"poolid":18,"num_pg":32,"stat_sum":{"num_bytes":798,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":2432,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":15,"ondisk_log_size":15,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":16,"seq":68719476867,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":145068,"kb_used_data":1492,"kb_used_omap":1,"kb_used_meta":143550,"kb_avail":94226772,"statfs":{"total":96636764160,"available":96488214528,"internally_reserved":0,"allocated":1527808,"data_stored":667141,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":146995654},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":15,"seq":64424509572,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":119356,"kb_used_data":2144,"kb_used_omap":1,"kb_used_meta":117182,"kb_avail":94252484,"statfs":{"total":96636764160,"available":96514543616,"internally_reserved":0,"allocated":2195456,"data_stored":1285598,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":119994826},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509571,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":113188,"kb_used_data":1548,"kb_used_omap":1,"kb_used_meta":111614,"kb_avail":94258652,"statfs":{"total":96636764160,"available":96520859648,"internally_reserved":0,"allocated":1585152,"data_stored":693092,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":114293189},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509571,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":140956,"kb_used_data":1544,"kb_used_omap":1,"kb_used_meta":139390,"kb_avail":94230884,"statfs":{"total":96636764160,"available":96492425216,"internally_reserved":0,"allocated":1581056,"data_stored":693050,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":142735813},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509570,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":118708,"kb_used_data":1504,"kb_used_omap":1,"kb_used_meta":117182,"kb_avail":94253132,"statfs":{"total":96636764160,"available":96515207168,"internally_reserved":0,"allocated":1540096,"data_stored":673126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":119994823},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509570,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":140904,"kb_used_data":1492,"kb_used_omap":1,"kb_used_meta":139390,"kb_avail":94230936,"statfs":{"total":96636764160,"available":96492478464,"internally_reserved":0,"allocated":1527808,"data_stored":667141,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":142735813},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509570,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":145068,"kb_used_data":1492,"kb_used_omap":1,"kb_used_meta":143550,"kb_avail":94226772,"statfs":{"total":96636764160,"available":96488214528,"internally_reserved":0,"allocated":1527808,"data_stored":667141,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":146995653},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574978,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":123464,"kb_used_data":2096,"kb_used_omap":1,"kb_used_meta":121342,"kb_avail":94248376,"statfs":{"total":96636764160,"available":96510337024,"internally_reserved":0,"allocated":2146304,"data_stored":1269937,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":124254661},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":2250,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-17T05:52:24.291 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-17T05:52:24.440 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:24.438+0000 7f98568ce640 1 -- 172.21.15.150:0/4076259460 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f98500b3550 msgr2=0x7f98500b3960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:52:24.440 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:24.438+0000 7f98568ce640 1 --2- 172.21.15.150:0/4076259460 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f98500b3550 0x7f98500b3960 secure :-1 s=READY pgs=1686 cs=0 l=1 rev1=1 crypto rx=0x7f9848005fd0 tx=0x7f984802aa10 comp rx=0 tx=0).stop 2024-09-17T05:52:24.440 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:24.438+0000 7f98568ce640 1 -- 172.21.15.150:0/4076259460 shutdown_connections 2024-09-17T05:52:24.440 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:24.438+0000 7f98568ce640 1 --2- 172.21.15.150:0/4076259460 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f98500b3550 0x7f98500b3960 unknown :-1 s=CLOSED pgs=1686 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:52:24.440 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:24.438+0000 7f98568ce640 1 --2- 172.21.15.150:0/4076259460 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f985015d760 0x7f98501535c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:52:24.440 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:24.438+0000 7f98568ce640 1 -- 172.21.15.150:0/4076259460 >> 172.21.15.150:0/4076259460 conn(0x7f985006d730 msgr2=0x7f98500b1e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:52:24.440 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:24.438+0000 7f98568ce640 1 -- 172.21.15.150:0/4076259460 shutdown_connections 2024-09-17T05:52:24.441 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:24.438+0000 7f98568ce640 1 -- 172.21.15.150:0/4076259460 wait complete. 2024-09-17T05:52:24.441 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:24.440+0000 7f98568ce640 1 Processor -- start 2024-09-17T05:52:24.441 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:24.440+0000 7f98568ce640 1 -- start start 2024-09-17T05:52:24.444 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:24.441+0000 7f98568ce640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f98500ad0e0 0x7f98501f98e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:52:24.445 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:24.441+0000 7f98568ce640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f98500b3550 0x7f985014b8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:52:24.445 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:24.441+0000 7f98568ce640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f985015d760 0x7f9850150af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:52:24.445 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:24.441+0000 7f98568ce640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f98500b4da0 con 0x7f98500b3550 2024-09-17T05:52:24.445 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:24.441+0000 7f98568ce640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f98500b4c20 con 0x7f98500ad0e0 2024-09-17T05:52:24.445 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:24.441+0000 7f98568ce640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f98500b3ea0 con 0x7f985015d760 2024-09-17T05:52:24.445 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:24.441+0000 7f984f7fe640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f98500b3550 0x7f985014b8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:52:24.445 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:24.441+0000 7f984f7fe640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f98500b3550 0x7f985014b8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:35764/0 (socket says 172.21.15.150:35764) 2024-09-17T05:52:24.445 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:24.441+0000 7f984f7fe640 1 -- 172.21.15.150:0/1291562970 learned_addr learned my addr 172.21.15.150:0/1291562970 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:52:24.445 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:24.442+0000 7f984ffff640 1 --2- 172.21.15.150:0/1291562970 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f98500ad0e0 0x7f98501f98e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:52:24.446 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:24.442+0000 7f9854e6b640 1 --2- 172.21.15.150:0/1291562970 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f985015d760 0x7f9850150af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:52:24.446 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:24.442+0000 7f984f7fe640 1 -- 172.21.15.150:0/1291562970 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f985015d760 msgr2=0x7f9850150af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:52:24.446 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:24.442+0000 7f984f7fe640 1 --2- 172.21.15.150:0/1291562970 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f985015d760 0x7f9850150af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:52:24.446 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:24.442+0000 7f984f7fe640 1 -- 172.21.15.150:0/1291562970 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f98500ad0e0 msgr2=0x7f98501f98e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:52:24.446 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:24.442+0000 7f984f7fe640 1 --2- 172.21.15.150:0/1291562970 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f98500ad0e0 0x7f98501f98e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:52:24.446 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:24.442+0000 7f984f7fe640 1 -- 172.21.15.150:0/1291562970 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f98501f9e20 con 0x7f98500b3550 2024-09-17T05:52:24.446 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:24.442+0000 7f984ffff640 1 --2- 172.21.15.150:0/1291562970 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f98500ad0e0 0x7f98501f98e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:52:24.446 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:24.442+0000 7f9854e6b640 1 --2- 172.21.15.150:0/1291562970 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f985015d760 0x7f9850150af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:52:24.446 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:24.442+0000 7f984f7fe640 1 --2- 172.21.15.150:0/1291562970 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f98500b3550 0x7f985014b8d0 secure :-1 s=READY pgs=1687 cs=0 l=1 rev1=1 crypto rx=0x7f984400c390 tx=0x7f984400c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:52:24.446 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:24.442+0000 7f984cff9640 1 -- 172.21.15.150:0/1291562970 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9844017070 con 0x7f98500b3550 2024-09-17T05:52:24.446 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:24.442+0000 7f984cff9640 1 -- 172.21.15.150:0/1291562970 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f98440035f0 con 0x7f98500b3550 2024-09-17T05:52:24.446 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:24.442+0000 7f98568ce640 1 -- 172.21.15.150:0/1291562970 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9850073040 con 0x7f98500b3550 2024-09-17T05:52:24.447 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:24.442+0000 7f984cff9640 1 -- 172.21.15.150:0/1291562970 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9844003a20 con 0x7f98500b3550 2024-09-17T05:52:24.447 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:24.442+0000 7f98568ce640 1 -- 172.21.15.150:0/1291562970 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f985015c5a0 con 0x7f98500b3550 2024-09-17T05:52:24.447 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:24.443+0000 7f98568ce640 1 -- 172.21.15.150:0/1291562970 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9850069840 con 0x7f98500b3550 2024-09-17T05:52:24.447 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:24.444+0000 7f984cff9640 1 -- 172.21.15.150:0/1291562970 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 42) ==== 104195+0+0 (secure 0 0 0) 0x7f984401a070 con 0x7f98500b3550 2024-09-17T05:52:24.448 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:24.445+0000 7f984cff9640 1 --2- 172.21.15.150:0/1291562970 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f983c07a9f0 0x7f983c07cf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:52:24.448 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:24.445+0000 7f984cff9640 1 -- 172.21.15.150:0/1291562970 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(127..127 src has 1..127) ==== 5877+0+0 (secure 0 0 0) 0x7f9844099140 con 0x7f98500b3550 2024-09-17T05:52:24.448 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:24.445+0000 7f984ffff640 1 --2- 172.21.15.150:0/1291562970 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f983c07a9f0 0x7f983c07cf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:52:24.448 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:24.445+0000 7f984ffff640 1 --2- 172.21.15.150:0/1291562970 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f983c07a9f0 0x7f983c07cf00 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 crypto rx=0x7f9840005fd0 tx=0x7f984000f360 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:52:24.450 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:24.449+0000 7f984cff9640 1 -- 172.21.15.150:0/1291562970 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f9850069840 con 0x7f98500b3550 2024-09-17T05:52:24.621 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:24.619+0000 7f98568ce640 1 -- 172.21.15.150:0/1291562970 --> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f98500b4330 con 0x7f983c07a9f0 2024-09-17T05:52:24.626 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:24.624+0000 7f984cff9640 1 -- 172.21.15.150:0/1291562970 <== mgr.4108 v2:172.21.15.176:6800/3631216395 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+245437 (secure 0 0 0) 0x7f98500b4330 con 0x7f983c07a9f0 2024-09-17T05:52:24.628 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-09-17T05:52:24.629 INFO:teuthology.orchestra.run.smithi150.stderr:dumped all 2024-09-17T05:52:24.631 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:24.627+0000 7f98568ce640 1 -- 172.21.15.150:0/1291562970 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f983c07a9f0 msgr2=0x7f983c07cf00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:52:24.631 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:24.627+0000 7f98568ce640 1 --2- 172.21.15.150:0/1291562970 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f983c07a9f0 0x7f983c07cf00 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 crypto rx=0x7f9840005fd0 tx=0x7f984000f360 comp rx=0 tx=0).stop 2024-09-17T05:52:24.631 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:24.627+0000 7f98568ce640 1 -- 172.21.15.150:0/1291562970 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f98500b3550 msgr2=0x7f985014b8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:52:24.631 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:24.627+0000 7f98568ce640 1 --2- 172.21.15.150:0/1291562970 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f98500b3550 0x7f985014b8d0 secure :-1 s=READY pgs=1687 cs=0 l=1 rev1=1 crypto rx=0x7f984400c390 tx=0x7f984400c850 comp rx=0 tx=0).stop 2024-09-17T05:52:24.631 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:24.627+0000 7f98568ce640 1 -- 172.21.15.150:0/1291562970 shutdown_connections 2024-09-17T05:52:24.631 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:24.627+0000 7f98568ce640 1 --2- 172.21.15.150:0/1291562970 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f983c07a9f0 0x7f983c07cf00 unknown :-1 s=CLOSED pgs=716 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:52:24.631 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:24.627+0000 7f98568ce640 1 --2- 172.21.15.150:0/1291562970 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f985015d760 0x7f9850150af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:52:24.632 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:24.627+0000 7f98568ce640 1 --2- 172.21.15.150:0/1291562970 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f98500b3550 0x7f985014b8d0 unknown :-1 s=CLOSED pgs=1687 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:52:24.632 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:24.627+0000 7f98568ce640 1 --2- 172.21.15.150:0/1291562970 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f98500ad0e0 0x7f98501f98e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:52:24.632 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:24.627+0000 7f98568ce640 1 -- 172.21.15.150:0/1291562970 >> 172.21.15.150:0/1291562970 conn(0x7f985006d730 msgr2=0x7f985015e320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:52:24.632 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:24.627+0000 7f98568ce640 1 -- 172.21.15.150:0/1291562970 shutdown_connections 2024-09-17T05:52:24.632 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:24.627+0000 7f98568ce640 1 -- 172.21.15.150:0/1291562970 wait complete. 2024-09-17T05:52:24.641 INFO:teuthology.orchestra.run.smithi150.stdout:{"pg_ready":true,"pg_map":{"version":440,"stamp":"2024-09-17T05:52:23.078310+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":591166,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":116,"num_write_kb":1639,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":87,"ondisk_log_size":87,"up":118,"acting":118,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":66,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":1046712,"kb_used_data":13312,"kb_used_omap":12,"kb_used_meta":1033203,"kb_avail":753928008,"statfs":{"total":773094113280,"available":772022280192,"internally_reserved":0,"allocated":13631488,"data_stored":6616226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":1058000432},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":15,"apply_latency_ms":15,"commit_latency_ns":15000000,"apply_latency_ns":15000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":798,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.203422"},"pg_stats":[{"pgid":"19.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:52:18.873991+0000","last_change":"2024-09-17T05:52:18.873991+0000","last_active":"2024-09-17T05:52:18.873991+0000","last_peered":"2024-09-17T05:52:18.873991+0000","last_clean":"2024-09-17T05:52:18.873991+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:52:18.873991+0000","last_undegraded":"2024-09-17T05:52:18.873991+0000","last_fullsized":"2024-09-17T05:52:18.873991+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:52:18.873991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:52:18.873991+0000","last_clean_scrub_stamp":"2024-09-17T05:52:18.873991+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:52:18.873991+0000","last_change":"2024-09-17T05:52:18.873991+0000","last_active":"2024-09-17T05:52:18.873991+0000","last_peered":"2024-09-17T05:52:18.873991+0000","last_clean":"2024-09-17T05:52:18.873991+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:52:18.873991+0000","last_undegraded":"2024-09-17T05:52:18.873991+0000","last_fullsized":"2024-09-17T05:52:18.873991+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:52:18.873991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:52:18.873991+0000","last_clean_scrub_stamp":"2024-09-17T05:52:18.873991+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:52:18.873991+0000","last_change":"2024-09-17T05:52:18.873991+0000","last_active":"2024-09-17T05:52:18.873991+0000","last_peered":"2024-09-17T05:52:18.873991+0000","last_clean":"2024-09-17T05:52:18.873991+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:52:18.873991+0000","last_undegraded":"2024-09-17T05:52:18.873991+0000","last_fullsized":"2024-09-17T05:52:18.873991+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:52:18.873991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:52:18.873991+0000","last_clean_scrub_stamp":"2024-09-17T05:52:18.873991+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:52:18.873991+0000","last_change":"2024-09-17T05:52:18.873991+0000","last_active":"2024-09-17T05:52:18.873991+0000","last_peered":"2024-09-17T05:52:18.873991+0000","last_clean":"2024-09-17T05:52:18.873991+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:52:18.873991+0000","last_undegraded":"2024-09-17T05:52:18.873991+0000","last_fullsized":"2024-09-17T05:52:18.873991+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:52:18.873991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:52:18.873991+0000","last_clean_scrub_stamp":"2024-09-17T05:52:18.873991+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.3b","version":"0'0","reported_seq":13,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-09-17T05:52:20.913430+0000","last_change":"2024-09-17T05:52:19.923296+0000","last_active":"2024-09-17T05:52:20.913430+0000","last_peered":"2024-09-17T05:52:20.913430+0000","last_clean":"2024-09-17T05:52:20.913430+0000","last_became_active":"2024-09-17T05:52:19.922558+0000","last_became_peered":"2024-09-17T05:52:19.922558+0000","last_unstale":"2024-09-17T05:52:20.913430+0000","last_undegraded":"2024-09-17T05:52:20.913430+0000","last_fullsized":"2024-09-17T05:52:20.913430+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:52:18.873991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:52:18.873991+0000","last_clean_scrub_stamp":"2024-09-17T05:52:18.873991+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:14:31.803577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.3a","version":"0'0","reported_seq":13,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-09-17T05:52:20.916572+0000","last_change":"2024-09-17T05:52:19.921204+0000","last_active":"2024-09-17T05:52:20.916572+0000","last_peered":"2024-09-17T05:52:20.916572+0000","last_clean":"2024-09-17T05:52:20.916572+0000","last_became_active":"2024-09-17T05:52:19.920892+0000","last_became_peered":"2024-09-17T05:52:19.920892+0000","last_unstale":"2024-09-17T05:52:20.916572+0000","last_undegraded":"2024-09-17T05:52:20.916572+0000","last_fullsized":"2024-09-17T05:52:20.916572+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:52:18.873991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:52:18.873991+0000","last_clean_scrub_stamp":"2024-09-17T05:52:18.873991+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:03:02.474723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.39","version":"0'0","reported_seq":13,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-09-17T05:52:20.915990+0000","last_change":"2024-09-17T05:52:19.926803+0000","last_active":"2024-09-17T05:52:20.915990+0000","last_peered":"2024-09-17T05:52:20.915990+0000","last_clean":"2024-09-17T05:52:20.915990+0000","last_became_active":"2024-09-17T05:52:19.926478+0000","last_became_peered":"2024-09-17T05:52:19.926478+0000","last_unstale":"2024-09-17T05:52:20.915990+0000","last_undegraded":"2024-09-17T05:52:20.915990+0000","last_fullsized":"2024-09-17T05:52:20.915990+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:52:18.873991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:52:18.873991+0000","last_clean_scrub_stamp":"2024-09-17T05:52:18.873991+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:48:46.344445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:52:18.873991+0000","last_change":"2024-09-17T05:52:18.873991+0000","last_active":"2024-09-17T05:52:18.873991+0000","last_peered":"2024-09-17T05:52:18.873991+0000","last_clean":"2024-09-17T05:52:18.873991+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:52:18.873991+0000","last_undegraded":"2024-09-17T05:52:18.873991+0000","last_fullsized":"2024-09-17T05:52:18.873991+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:52:18.873991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:52:18.873991+0000","last_clean_scrub_stamp":"2024-09-17T05:52:18.873991+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:52:18.873991+0000","last_change":"2024-09-17T05:52:18.873991+0000","last_active":"2024-09-17T05:52:18.873991+0000","last_peered":"2024-09-17T05:52:18.873991+0000","last_clean":"2024-09-17T05:52:18.873991+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:52:18.873991+0000","last_undegraded":"2024-09-17T05:52:18.873991+0000","last_fullsized":"2024-09-17T05:52:18.873991+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:52:18.873991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:52:18.873991+0000","last_clean_scrub_stamp":"2024-09-17T05:52:18.873991+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:52:18.873991+0000","last_change":"2024-09-17T05:52:18.873991+0000","last_active":"2024-09-17T05:52:18.873991+0000","last_peered":"2024-09-17T05:52:18.873991+0000","last_clean":"2024-09-17T05:52:18.873991+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:52:18.873991+0000","last_undegraded":"2024-09-17T05:52:18.873991+0000","last_fullsized":"2024-09-17T05:52:18.873991+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:52:18.873991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:52:18.873991+0000","last_clean_scrub_stamp":"2024-09-17T05:52:18.873991+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.35","version":"0'0","reported_seq":1,"reported_epoch":125,"state":"creating+peering","last_fresh":"2024-09-17T05:52:18.886163+0000","last_change":"2024-09-17T05:52:18.886163+0000","last_active":"2024-09-17T05:52:18.873991+0000","last_peered":"2024-09-17T05:52:18.873991+0000","last_clean":"2024-09-17T05:52:18.873991+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:52:18.886163+0000","last_undegraded":"2024-09-17T05:52:18.886163+0000","last_fullsized":"2024-09-17T05:52:18.886163+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:52:18.873991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:52:18.873991+0000","last_clean_scrub_stamp":"2024-09-17T05:52:18.873991+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:52:18.873991+0000","last_change":"2024-09-17T05:52:18.873991+0000","last_active":"2024-09-17T05:52:18.873991+0000","last_peered":"2024-09-17T05:52:18.873991+0000","last_clean":"2024-09-17T05:52:18.873991+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:52:18.873991+0000","last_undegraded":"2024-09-17T05:52:18.873991+0000","last_fullsized":"2024-09-17T05:52:18.873991+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:52:18.873991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:52:18.873991+0000","last_clean_scrub_stamp":"2024-09-17T05:52:18.873991+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:52:18.873991+0000","last_change":"2024-09-17T05:52:18.873991+0000","last_active":"2024-09-17T05:52:18.873991+0000","last_peered":"2024-09-17T05:52:18.873991+0000","last_clean":"2024-09-17T05:52:18.873991+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:52:18.873991+0000","last_undegraded":"2024-09-17T05:52:18.873991+0000","last_fullsized":"2024-09-17T05:52:18.873991+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:52:18.873991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:52:18.873991+0000","last_clean_scrub_stamp":"2024-09-17T05:52:18.873991+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:52:18.873991+0000","last_change":"2024-09-17T05:52:18.873991+0000","last_active":"2024-09-17T05:52:18.873991+0000","last_peered":"2024-09-17T05:52:18.873991+0000","last_clean":"2024-09-17T05:52:18.873991+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:52:18.873991+0000","last_undegraded":"2024-09-17T05:52:18.873991+0000","last_fullsized":"2024-09-17T05:52:18.873991+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:52:18.873991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:52:18.873991+0000","last_clean_scrub_stamp":"2024-09-17T05:52:18.873991+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:52:18.873991+0000","last_change":"2024-09-17T05:52:18.873991+0000","last_active":"2024-09-17T05:52:18.873991+0000","last_peered":"2024-09-17T05:52:18.873991+0000","last_clean":"2024-09-17T05:52:18.873991+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:52:18.873991+0000","last_undegraded":"2024-09-17T05:52:18.873991+0000","last_fullsized":"2024-09-17T05:52:18.873991+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:52:18.873991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:52:18.873991+0000","last_clean_scrub_stamp":"2024-09-17T05:52:18.873991+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:52:18.873991+0000","last_change":"2024-09-17T05:52:18.873991+0000","last_active":"2024-09-17T05:52:18.873991+0000","last_peered":"2024-09-17T05:52:18.873991+0000","last_clean":"2024-09-17T05:52:18.873991+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:52:18.873991+0000","last_undegraded":"2024-09-17T05:52:18.873991+0000","last_fullsized":"2024-09-17T05:52:18.873991+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:52:18.873991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:52:18.873991+0000","last_clean_scrub_stamp":"2024-09-17T05:52:18.873991+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.2f","version":"0'0","reported_seq":13,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-09-17T05:52:20.916291+0000","last_change":"2024-09-17T05:52:19.927246+0000","last_active":"2024-09-17T05:52:20.916291+0000","last_peered":"2024-09-17T05:52:20.916291+0000","last_clean":"2024-09-17T05:52:20.916291+0000","last_became_active":"2024-09-17T05:52:19.926923+0000","last_became_peered":"2024-09-17T05:52:19.926923+0000","last_unstale":"2024-09-17T05:52:20.916291+0000","last_undegraded":"2024-09-17T05:52:20.916291+0000","last_fullsized":"2024-09-17T05:52:20.916291+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:52:18.873991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:52:18.873991+0000","last_clean_scrub_stamp":"2024-09-17T05:52:18.873991+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:11:04.819830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:52:18.873991+0000","last_change":"2024-09-17T05:52:18.873991+0000","last_active":"2024-09-17T05:52:18.873991+0000","last_peered":"2024-09-17T05:52:18.873991+0000","last_clean":"2024-09-17T05:52:18.873991+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:52:18.873991+0000","last_undegraded":"2024-09-17T05:52:18.873991+0000","last_fullsized":"2024-09-17T05:52:18.873991+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:52:18.873991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:52:18.873991+0000","last_clean_scrub_stamp":"2024-09-17T05:52:18.873991+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.2d","version":"0'0","reported_seq":1,"reported_epoch":125,"state":"creating+peering","last_fresh":"2024-09-17T05:52:18.885679+0000","last_change":"2024-09-17T05:52:18.885679+0000","last_active":"2024-09-17T05:52:18.873991+0000","last_peered":"2024-09-17T05:52:18.873991+0000","last_clean":"2024-09-17T05:52:18.873991+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:52:18.885679+0000","last_undegraded":"2024-09-17T05:52:18.885679+0000","last_fullsized":"2024-09-17T05:52:18.885679+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:52:18.873991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:52:18.873991+0000","last_clean_scrub_stamp":"2024-09-17T05:52:18.873991+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:52:18.873991+0000","last_change":"2024-09-17T05:52:18.873991+0000","last_active":"2024-09-17T05:52:18.873991+0000","last_peered":"2024-09-17T05:52:18.873991+0000","last_clean":"2024-09-17T05:52:18.873991+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:52:18.873991+0000","last_undegraded":"2024-09-17T05:52:18.873991+0000","last_fullsized":"2024-09-17T05:52:18.873991+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:52:18.873991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:52:18.873991+0000","last_clean_scrub_stamp":"2024-09-17T05:52:18.873991+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.2b","version":"0'0","reported_seq":13,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-09-17T05:52:20.913343+0000","last_change":"2024-09-17T05:52:19.923630+0000","last_active":"2024-09-17T05:52:20.913343+0000","last_peered":"2024-09-17T05:52:20.913343+0000","last_clean":"2024-09-17T05:52:20.913343+0000","last_became_active":"2024-09-17T05:52:19.922986+0000","last_became_peered":"2024-09-17T05:52:19.922986+0000","last_unstale":"2024-09-17T05:52:20.913343+0000","last_undegraded":"2024-09-17T05:52:20.913343+0000","last_fullsized":"2024-09-17T05:52:20.913343+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:52:18.873991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:52:18.873991+0000","last_clean_scrub_stamp":"2024-09-17T05:52:18.873991+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:27:22.837955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.2a","version":"0'0","reported_seq":1,"reported_epoch":125,"state":"creating+peering","last_fresh":"2024-09-17T05:52:18.885585+0000","last_change":"2024-09-17T05:52:18.885585+0000","last_active":"2024-09-17T05:52:18.873991+0000","last_peered":"2024-09-17T05:52:18.873991+0000","last_clean":"2024-09-17T05:52:18.873991+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:52:18.885585+0000","last_undegraded":"2024-09-17T05:52:18.885585+0000","last_fullsized":"2024-09-17T05:52:18.885585+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:52:18.873991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:52:18.873991+0000","last_clean_scrub_stamp":"2024-09-17T05:52:18.873991+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:52:18.873991+0000","last_change":"2024-09-17T05:52:18.873991+0000","last_active":"2024-09-17T05:52:18.873991+0000","last_peered":"2024-09-17T05:52:18.873991+0000","last_clean":"2024-09-17T05:52:18.873991+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:52:18.873991+0000","last_undegraded":"2024-09-17T05:52:18.873991+0000","last_fullsized":"2024-09-17T05:52:18.873991+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:52:18.873991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:52:18.873991+0000","last_clean_scrub_stamp":"2024-09-17T05:52:18.873991+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.28","version":"0'0","reported_seq":1,"reported_epoch":125,"state":"creating+peering","last_fresh":"2024-09-17T05:52:18.884950+0000","last_change":"2024-09-17T05:52:18.884950+0000","last_active":"2024-09-17T05:52:18.873991+0000","last_peered":"2024-09-17T05:52:18.873991+0000","last_clean":"2024-09-17T05:52:18.873991+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:52:18.884950+0000","last_undegraded":"2024-09-17T05:52:18.884950+0000","last_fullsized":"2024-09-17T05:52:18.884950+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:52:18.873991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:52:18.873991+0000","last_clean_scrub_stamp":"2024-09-17T05:52:18.873991+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:52:18.873991+0000","last_change":"2024-09-17T05:52:18.873991+0000","last_active":"2024-09-17T05:52:18.873991+0000","last_peered":"2024-09-17T05:52:18.873991+0000","last_clean":"2024-09-17T05:52:18.873991+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:52:18.873991+0000","last_undegraded":"2024-09-17T05:52:18.873991+0000","last_fullsized":"2024-09-17T05:52:18.873991+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:52:18.873991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:52:18.873991+0000","last_clean_scrub_stamp":"2024-09-17T05:52:18.873991+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:52:18.873991+0000","last_change":"2024-09-17T05:52:18.873991+0000","last_active":"2024-09-17T05:52:18.873991+0000","last_peered":"2024-09-17T05:52:18.873991+0000","last_clean":"2024-09-17T05:52:18.873991+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:52:18.873991+0000","last_undegraded":"2024-09-17T05:52:18.873991+0000","last_fullsized":"2024-09-17T05:52:18.873991+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:52:18.873991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:52:18.873991+0000","last_clean_scrub_stamp":"2024-09-17T05:52:18.873991+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:52:18.873991+0000","last_change":"2024-09-17T05:52:18.873991+0000","last_active":"2024-09-17T05:52:18.873991+0000","last_peered":"2024-09-17T05:52:18.873991+0000","last_clean":"2024-09-17T05:52:18.873991+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:52:18.873991+0000","last_undegraded":"2024-09-17T05:52:18.873991+0000","last_fullsized":"2024-09-17T05:52:18.873991+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:52:18.873991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:52:18.873991+0000","last_clean_scrub_stamp":"2024-09-17T05:52:18.873991+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.24","version":"0'0","reported_seq":13,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-09-17T05:52:21.029763+0000","last_change":"2024-09-17T05:52:19.919487+0000","last_active":"2024-09-17T05:52:21.029763+0000","last_peered":"2024-09-17T05:52:21.029763+0000","last_clean":"2024-09-17T05:52:21.029763+0000","last_became_active":"2024-09-17T05:52:19.919132+0000","last_became_peered":"2024-09-17T05:52:19.919132+0000","last_unstale":"2024-09-17T05:52:21.029763+0000","last_undegraded":"2024-09-17T05:52:21.029763+0000","last_fullsized":"2024-09-17T05:52:21.029763+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:52:18.873991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:52:18.873991+0000","last_clean_scrub_stamp":"2024-09-17T05:52:18.873991+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:47:54.083475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:52:18.873991+0000","last_change":"2024-09-17T05:52:18.873991+0000","last_active":"2024-09-17T05:52:18.873991+0000","last_peered":"2024-09-17T05:52:18.873991+0000","last_clean":"2024-09-17T05:52:18.873991+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:52:18.873991+0000","last_undegraded":"2024-09-17T05:52:18.873991+0000","last_fullsized":"2024-09-17T05:52:18.873991+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:52:18.873991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:52:18.873991+0000","last_clean_scrub_stamp":"2024-09-17T05:52:18.873991+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:52:18.873991+0000","last_change":"2024-09-17T05:52:18.873991+0000","last_active":"2024-09-17T05:52:18.873991+0000","last_peered":"2024-09-17T05:52:18.873991+0000","last_clean":"2024-09-17T05:52:18.873991+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:52:18.873991+0000","last_undegraded":"2024-09-17T05:52:18.873991+0000","last_fullsized":"2024-09-17T05:52:18.873991+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:52:18.873991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:52:18.873991+0000","last_clean_scrub_stamp":"2024-09-17T05:52:18.873991+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.21","version":"0'0","reported_seq":13,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-09-17T05:52:20.912884+0000","last_change":"2024-09-17T05:52:19.921396+0000","last_active":"2024-09-17T05:52:20.912884+0000","last_peered":"2024-09-17T05:52:20.912884+0000","last_clean":"2024-09-17T05:52:20.912884+0000","last_became_active":"2024-09-17T05:52:19.916646+0000","last_became_peered":"2024-09-17T05:52:19.916646+0000","last_unstale":"2024-09-17T05:52:20.912884+0000","last_undegraded":"2024-09-17T05:52:20.912884+0000","last_fullsized":"2024-09-17T05:52:20.912884+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:52:18.873991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:52:18.873991+0000","last_clean_scrub_stamp":"2024-09-17T05:52:18.873991+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:31:59.058914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.20","version":"0'0","reported_seq":13,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-09-17T05:52:20.915791+0000","last_change":"2024-09-17T05:52:19.913824+0000","last_active":"2024-09-17T05:52:20.915791+0000","last_peered":"2024-09-17T05:52:20.915791+0000","last_clean":"2024-09-17T05:52:20.915791+0000","last_became_active":"2024-09-17T05:52:19.913513+0000","last_became_peered":"2024-09-17T05:52:19.913513+0000","last_unstale":"2024-09-17T05:52:20.915791+0000","last_undegraded":"2024-09-17T05:52:20.915791+0000","last_fullsized":"2024-09-17T05:52:20.915791+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:52:18.873991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:52:18.873991+0000","last_clean_scrub_stamp":"2024-09-17T05:52:18.873991+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:11:48.541624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:52:18.873991+0000","last_change":"2024-09-17T05:52:18.873991+0000","last_active":"2024-09-17T05:52:18.873991+0000","last_peered":"2024-09-17T05:52:18.873991+0000","last_clean":"2024-09-17T05:52:18.873991+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:52:18.873991+0000","last_undegraded":"2024-09-17T05:52:18.873991+0000","last_fullsized":"2024-09-17T05:52:18.873991+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:52:18.873991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:52:18.873991+0000","last_clean_scrub_stamp":"2024-09-17T05:52:18.873991+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.1f","version":"126'4","reported_seq":19,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-09-17T05:52:20.913562+0000","last_change":"2024-09-17T05:52:18.893653+0000","last_active":"2024-09-17T05:52:20.913562+0000","last_peered":"2024-09-17T05:52:20.913562+0000","last_clean":"2024-09-17T05:52:20.913562+0000","last_became_active":"2024-09-17T05:52:18.893296+0000","last_became_peered":"2024-09-17T05:52:18.893296+0000","last_unstale":"2024-09-17T05:52:20.913562+0000","last_undegraded":"2024-09-17T05:52:20.913562+0000","last_fullsized":"2024-09-17T05:52:20.913562+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:52:17.867506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:52:17.867506+0000","last_clean_scrub_stamp":"2024-09-17T05:52:17.867506+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:50:03.925050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:52:18.873991+0000","last_change":"2024-09-17T05:52:18.873991+0000","last_active":"2024-09-17T05:52:18.873991+0000","last_peered":"2024-09-17T05:52:18.873991+0000","last_clean":"2024-09-17T05:52:18.873991+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:52:18.873991+0000","last_undegraded":"2024-09-17T05:52:18.873991+0000","last_fullsized":"2024-09-17T05:52:18.873991+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:52:18.873991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:52:18.873991+0000","last_clean_scrub_stamp":"2024-09-17T05:52:18.873991+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.1e","version":"126'1","reported_seq":16,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-09-17T05:52:21.029801+0000","last_change":"2024-09-17T05:52:18.895473+0000","last_active":"2024-09-17T05:52:21.029801+0000","last_peered":"2024-09-17T05:52:21.029801+0000","last_clean":"2024-09-17T05:52:21.029801+0000","last_became_active":"2024-09-17T05:52:18.895096+0000","last_became_peered":"2024-09-17T05:52:18.895096+0000","last_unstale":"2024-09-17T05:52:21.029801+0000","last_undegraded":"2024-09-17T05:52:21.029801+0000","last_fullsized":"2024-09-17T05:52:21.029801+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:52:17.867506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:52:17.867506+0000","last_clean_scrub_stamp":"2024-09-17T05:52:17.867506+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:12:57.384707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.1c","version":"0'0","reported_seq":13,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-09-17T05:52:20.913652+0000","last_change":"2024-09-17T05:52:19.927142+0000","last_active":"2024-09-17T05:52:20.913652+0000","last_peered":"2024-09-17T05:52:20.913652+0000","last_clean":"2024-09-17T05:52:20.913652+0000","last_became_active":"2024-09-17T05:52:19.926836+0000","last_became_peered":"2024-09-17T05:52:19.926836+0000","last_unstale":"2024-09-17T05:52:20.913652+0000","last_undegraded":"2024-09-17T05:52:20.913652+0000","last_fullsized":"2024-09-17T05:52:20.913652+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:52:18.873991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:52:18.873991+0000","last_clean_scrub_stamp":"2024-09-17T05:52:18.873991+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:04:57.127249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.1d","version":"0'0","reported_seq":10,"reported_epoch":125,"state":"active+clean","last_fresh":"2024-09-17T05:52:18.899013+0000","last_change":"2024-09-17T05:52:18.897259+0000","last_active":"2024-09-17T05:52:18.899013+0000","last_peered":"2024-09-17T05:52:18.899013+0000","last_clean":"2024-09-17T05:52:18.899013+0000","last_became_active":"2024-09-17T05:52:18.896947+0000","last_became_peered":"2024-09-17T05:52:18.896947+0000","last_unstale":"2024-09-17T05:52:18.899013+0000","last_undegraded":"2024-09-17T05:52:18.899013+0000","last_fullsized":"2024-09-17T05:52:18.899013+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:52:17.867506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:52:17.867506+0000","last_clean_scrub_stamp":"2024-09-17T05:52:17.867506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:04:52.286987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.1d","version":"0'0","reported_seq":13,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-09-17T05:52:20.913030+0000","last_change":"2024-09-17T05:52:19.914720+0000","last_active":"2024-09-17T05:52:20.913030+0000","last_peered":"2024-09-17T05:52:20.913030+0000","last_clean":"2024-09-17T05:52:20.913030+0000","last_became_active":"2024-09-17T05:52:19.914342+0000","last_became_peered":"2024-09-17T05:52:19.914342+0000","last_unstale":"2024-09-17T05:52:20.913030+0000","last_undegraded":"2024-09-17T05:52:20.913030+0000","last_fullsized":"2024-09-17T05:52:20.913030+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:52:18.873991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:52:18.873991+0000","last_clean_scrub_stamp":"2024-09-17T05:52:18.873991+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:05:11.605569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.1c","version":"0'0","reported_seq":1,"reported_epoch":124,"state":"creating+peering","last_fresh":"2024-09-17T05:52:17.881845+0000","last_change":"2024-09-17T05:52:17.881845+0000","last_active":"2024-09-17T05:52:17.867506+0000","last_peered":"2024-09-17T05:52:17.867506+0000","last_clean":"2024-09-17T05:52:17.867506+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:52:17.881845+0000","last_undegraded":"2024-09-17T05:52:17.881845+0000","last_fullsized":"2024-09-17T05:52:17.881845+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:52:17.867506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:52:17.867506+0000","last_clean_scrub_stamp":"2024-09-17T05:52:17.867506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:52:18.873991+0000","last_change":"2024-09-17T05:52:18.873991+0000","last_active":"2024-09-17T05:52:18.873991+0000","last_peered":"2024-09-17T05:52:18.873991+0000","last_clean":"2024-09-17T05:52:18.873991+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:52:18.873991+0000","last_undegraded":"2024-09-17T05:52:18.873991+0000","last_fullsized":"2024-09-17T05:52:18.873991+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:52:18.873991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:52:18.873991+0000","last_clean_scrub_stamp":"2024-09-17T05:52:18.873991+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.1b","version":"0'0","reported_seq":1,"reported_epoch":124,"state":"creating+peering","last_fresh":"2024-09-17T05:52:17.881454+0000","last_change":"2024-09-17T05:52:17.881454+0000","last_active":"2024-09-17T05:52:17.867506+0000","last_peered":"2024-09-17T05:52:17.867506+0000","last_clean":"2024-09-17T05:52:17.867506+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:52:17.881454+0000","last_undegraded":"2024-09-17T05:52:17.881454+0000","last_fullsized":"2024-09-17T05:52:17.881454+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:52:17.867506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:52:17.867506+0000","last_clean_scrub_stamp":"2024-09-17T05:52:17.867506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.1b","version":"0'0","reported_seq":13,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-09-17T05:52:20.916633+0000","last_change":"2024-09-17T05:52:19.920703+0000","last_active":"2024-09-17T05:52:20.916633+0000","last_peered":"2024-09-17T05:52:20.916633+0000","last_clean":"2024-09-17T05:52:20.916633+0000","last_became_active":"2024-09-17T05:52:19.920376+0000","last_became_peered":"2024-09-17T05:52:19.920376+0000","last_unstale":"2024-09-17T05:52:20.916633+0000","last_undegraded":"2024-09-17T05:52:20.916633+0000","last_fullsized":"2024-09-17T05:52:20.916633+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:52:18.873991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:52:18.873991+0000","last_clean_scrub_stamp":"2024-09-17T05:52:18.873991+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:47:56.025899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.1a","version":"0'0","reported_seq":1,"reported_epoch":124,"state":"creating+peering","last_fresh":"2024-09-17T05:52:17.881579+0000","last_change":"2024-09-17T05:52:17.881579+0000","last_active":"2024-09-17T05:52:17.867506+0000","last_peered":"2024-09-17T05:52:17.867506+0000","last_clean":"2024-09-17T05:52:17.867506+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:52:17.881579+0000","last_undegraded":"2024-09-17T05:52:17.881579+0000","last_fullsized":"2024-09-17T05:52:17.881579+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:52:17.867506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:52:17.867506+0000","last_clean_scrub_stamp":"2024-09-17T05:52:17.867506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:52:18.873991+0000","last_change":"2024-09-17T05:52:18.873991+0000","last_active":"2024-09-17T05:52:18.873991+0000","last_peered":"2024-09-17T05:52:18.873991+0000","last_clean":"2024-09-17T05:52:18.873991+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:52:18.873991+0000","last_undegraded":"2024-09-17T05:52:18.873991+0000","last_fullsized":"2024-09-17T05:52:18.873991+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:52:18.873991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:52:18.873991+0000","last_clean_scrub_stamp":"2024-09-17T05:52:18.873991+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.19","version":"0'0","reported_seq":15,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-09-17T05:52:20.915745+0000","last_change":"2024-09-17T05:52:18.895524+0000","last_active":"2024-09-17T05:52:20.915745+0000","last_peered":"2024-09-17T05:52:20.915745+0000","last_clean":"2024-09-17T05:52:20.915745+0000","last_became_active":"2024-09-17T05:52:18.895221+0000","last_became_peered":"2024-09-17T05:52:18.895221+0000","last_unstale":"2024-09-17T05:52:20.915745+0000","last_undegraded":"2024-09-17T05:52:20.915745+0000","last_fullsized":"2024-09-17T05:52:20.915745+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:52:17.867506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:52:17.867506+0000","last_clean_scrub_stamp":"2024-09-17T05:52:17.867506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:03:36.241448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:52:18.873991+0000","last_change":"2024-09-17T05:52:18.873991+0000","last_active":"2024-09-17T05:52:18.873991+0000","last_peered":"2024-09-17T05:52:18.873991+0000","last_clean":"2024-09-17T05:52:18.873991+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:52:18.873991+0000","last_undegraded":"2024-09-17T05:52:18.873991+0000","last_fullsized":"2024-09-17T05:52:18.873991+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:52:18.873991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:52:18.873991+0000","last_clean_scrub_stamp":"2024-09-17T05:52:18.873991+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.18","version":"0'0","reported_seq":1,"reported_epoch":124,"state":"creating+peering","last_fresh":"2024-09-17T05:52:17.881271+0000","last_change":"2024-09-17T05:52:17.881271+0000","last_active":"2024-09-17T05:52:17.867506+0000","last_peered":"2024-09-17T05:52:17.867506+0000","last_clean":"2024-09-17T05:52:17.867506+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:52:17.881271+0000","last_undegraded":"2024-09-17T05:52:17.881271+0000","last_fullsized":"2024-09-17T05:52:17.881271+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:52:17.867506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:52:17.867506+0000","last_clean_scrub_stamp":"2024-09-17T05:52:17.867506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:52:18.873991+0000","last_change":"2024-09-17T05:52:18.873991+0000","last_active":"2024-09-17T05:52:18.873991+0000","last_peered":"2024-09-17T05:52:18.873991+0000","last_clean":"2024-09-17T05:52:18.873991+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:52:18.873991+0000","last_undegraded":"2024-09-17T05:52:18.873991+0000","last_fullsized":"2024-09-17T05:52:18.873991+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:52:18.873991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:52:18.873991+0000","last_clean_scrub_stamp":"2024-09-17T05:52:18.873991+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.17","version":"0'0","reported_seq":15,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-09-17T05:52:21.030071+0000","last_change":"2024-09-17T05:52:18.894591+0000","last_active":"2024-09-17T05:52:21.030071+0000","last_peered":"2024-09-17T05:52:21.030071+0000","last_clean":"2024-09-17T05:52:21.030071+0000","last_became_active":"2024-09-17T05:52:18.894241+0000","last_became_peered":"2024-09-17T05:52:18.894241+0000","last_unstale":"2024-09-17T05:52:21.030071+0000","last_undegraded":"2024-09-17T05:52:21.030071+0000","last_fullsized":"2024-09-17T05:52:21.030071+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:52:17.867506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:52:17.867506+0000","last_clean_scrub_stamp":"2024-09-17T05:52:17.867506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:32:31.037419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.17","version":"0'0","reported_seq":13,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-09-17T05:52:21.029975+0000","last_change":"2024-09-17T05:52:19.918028+0000","last_active":"2024-09-17T05:52:21.029975+0000","last_peered":"2024-09-17T05:52:21.029975+0000","last_clean":"2024-09-17T05:52:21.029975+0000","last_became_active":"2024-09-17T05:52:19.916968+0000","last_became_peered":"2024-09-17T05:52:19.916968+0000","last_unstale":"2024-09-17T05:52:21.029975+0000","last_undegraded":"2024-09-17T05:52:21.029975+0000","last_fullsized":"2024-09-17T05:52:21.029975+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:52:18.873991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:52:18.873991+0000","last_clean_scrub_stamp":"2024-09-17T05:52:18.873991+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:23:24.221785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.16","version":"0'0","reported_seq":1,"reported_epoch":124,"state":"creating+peering","last_fresh":"2024-09-17T05:52:17.880840+0000","last_change":"2024-09-17T05:52:17.880840+0000","last_active":"2024-09-17T05:52:17.867506+0000","last_peered":"2024-09-17T05:52:17.867506+0000","last_clean":"2024-09-17T05:52:17.867506+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:52:17.880840+0000","last_undegraded":"2024-09-17T05:52:17.880840+0000","last_fullsized":"2024-09-17T05:52:17.880840+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:52:17.867506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:52:17.867506+0000","last_clean_scrub_stamp":"2024-09-17T05:52:17.867506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.14","version":"0'0","reported_seq":13,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-09-17T05:52:20.913700+0000","last_change":"2024-09-17T05:52:19.912074+0000","last_active":"2024-09-17T05:52:20.913700+0000","last_peered":"2024-09-17T05:52:20.913700+0000","last_clean":"2024-09-17T05:52:20.913700+0000","last_became_active":"2024-09-17T05:52:19.911738+0000","last_became_peered":"2024-09-17T05:52:19.911738+0000","last_unstale":"2024-09-17T05:52:20.913700+0000","last_undegraded":"2024-09-17T05:52:20.913700+0000","last_fullsized":"2024-09-17T05:52:20.913700+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:52:18.873991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:52:18.873991+0000","last_clean_scrub_stamp":"2024-09-17T05:52:18.873991+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:23:11.922990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.15","version":"126'3","reported_seq":18,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-09-17T05:52:21.029706+0000","last_change":"2024-09-17T05:52:18.899892+0000","last_active":"2024-09-17T05:52:21.029706+0000","last_peered":"2024-09-17T05:52:21.029706+0000","last_clean":"2024-09-17T05:52:21.029706+0000","last_became_active":"2024-09-17T05:52:18.899449+0000","last_became_peered":"2024-09-17T05:52:18.899449+0000","last_unstale":"2024-09-17T05:52:21.029706+0000","last_undegraded":"2024-09-17T05:52:21.029706+0000","last_fullsized":"2024-09-17T05:52:21.029706+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:52:17.867506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:52:17.867506+0000","last_clean_scrub_stamp":"2024-09-17T05:52:17.867506+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:01:50.779410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.15","version":"0'0","reported_seq":13,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-09-17T05:52:20.913349+0000","last_change":"2024-09-17T05:52:19.909257+0000","last_active":"2024-09-17T05:52:20.913349+0000","last_peered":"2024-09-17T05:52:20.913349+0000","last_clean":"2024-09-17T05:52:20.913349+0000","last_became_active":"2024-09-17T05:52:19.908004+0000","last_became_peered":"2024-09-17T05:52:19.908004+0000","last_unstale":"2024-09-17T05:52:20.913349+0000","last_undegraded":"2024-09-17T05:52:20.913349+0000","last_fullsized":"2024-09-17T05:52:20.913349+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:52:18.873991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:52:18.873991+0000","last_clean_scrub_stamp":"2024-09-17T05:52:18.873991+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:41:01.713245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.14","version":"0'0","reported_seq":1,"reported_epoch":124,"state":"creating+peering","last_fresh":"2024-09-17T05:52:17.882679+0000","last_change":"2024-09-17T05:52:17.882679+0000","last_active":"2024-09-17T05:52:17.867506+0000","last_peered":"2024-09-17T05:52:17.867506+0000","last_clean":"2024-09-17T05:52:17.867506+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:52:17.882679+0000","last_undegraded":"2024-09-17T05:52:17.882679+0000","last_fullsized":"2024-09-17T05:52:17.882679+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:52:17.867506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:52:17.867506+0000","last_clean_scrub_stamp":"2024-09-17T05:52:17.867506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:52:18.873991+0000","last_change":"2024-09-17T05:52:18.873991+0000","last_active":"2024-09-17T05:52:18.873991+0000","last_peered":"2024-09-17T05:52:18.873991+0000","last_clean":"2024-09-17T05:52:18.873991+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:52:18.873991+0000","last_undegraded":"2024-09-17T05:52:18.873991+0000","last_fullsized":"2024-09-17T05:52:18.873991+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:52:18.873991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:52:18.873991+0000","last_clean_scrub_stamp":"2024-09-17T05:52:18.873991+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.12","version":"0'0","reported_seq":1,"reported_epoch":124,"state":"creating+peering","last_fresh":"2024-09-17T05:52:17.879821+0000","last_change":"2024-09-17T05:52:17.879821+0000","last_active":"2024-09-17T05:52:17.867506+0000","last_peered":"2024-09-17T05:52:17.867506+0000","last_clean":"2024-09-17T05:52:17.867506+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:52:17.879821+0000","last_undegraded":"2024-09-17T05:52:17.879821+0000","last_fullsized":"2024-09-17T05:52:17.879821+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:52:17.867506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:52:17.867506+0000","last_clean_scrub_stamp":"2024-09-17T05:52:17.867506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:52:18.873991+0000","last_change":"2024-09-17T05:52:18.873991+0000","last_active":"2024-09-17T05:52:18.873991+0000","last_peered":"2024-09-17T05:52:18.873991+0000","last_clean":"2024-09-17T05:52:18.873991+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:52:18.873991+0000","last_undegraded":"2024-09-17T05:52:18.873991+0000","last_fullsized":"2024-09-17T05:52:18.873991+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:52:18.873991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:52:18.873991+0000","last_clean_scrub_stamp":"2024-09-17T05:52:18.873991+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.11","version":"0'0","reported_seq":1,"reported_epoch":124,"state":"creating+peering","last_fresh":"2024-09-17T05:52:17.880788+0000","last_change":"2024-09-17T05:52:17.880788+0000","last_active":"2024-09-17T05:52:17.867506+0000","last_peered":"2024-09-17T05:52:17.867506+0000","last_clean":"2024-09-17T05:52:17.867506+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:52:17.880788+0000","last_undegraded":"2024-09-17T05:52:17.880788+0000","last_fullsized":"2024-09-17T05:52:17.880788+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:52:17.867506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:52:17.867506+0000","last_clean_scrub_stamp":"2024-09-17T05:52:17.867506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:52:18.873991+0000","last_change":"2024-09-17T05:52:18.873991+0000","last_active":"2024-09-17T05:52:18.873991+0000","last_peered":"2024-09-17T05:52:18.873991+0000","last_clean":"2024-09-17T05:52:18.873991+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:52:18.873991+0000","last_undegraded":"2024-09-17T05:52:18.873991+0000","last_fullsized":"2024-09-17T05:52:18.873991+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:52:18.873991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:52:18.873991+0000","last_clean_scrub_stamp":"2024-09-17T05:52:18.873991+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.10","version":"0'0","reported_seq":1,"reported_epoch":124,"state":"creating+peering","last_fresh":"2024-09-17T05:52:17.882633+0000","last_change":"2024-09-17T05:52:17.882633+0000","last_active":"2024-09-17T05:52:17.867506+0000","last_peered":"2024-09-17T05:52:17.867506+0000","last_clean":"2024-09-17T05:52:17.867506+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:52:17.882633+0000","last_undegraded":"2024-09-17T05:52:17.882633+0000","last_fullsized":"2024-09-17T05:52:17.882633+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:52:17.867506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:52:17.867506+0000","last_clean_scrub_stamp":"2024-09-17T05:52:17.867506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:52:18.873991+0000","last_change":"2024-09-17T05:52:18.873991+0000","last_active":"2024-09-17T05:52:18.873991+0000","last_peered":"2024-09-17T05:52:18.873991+0000","last_clean":"2024-09-17T05:52:18.873991+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:52:18.873991+0000","last_undegraded":"2024-09-17T05:52:18.873991+0000","last_fullsized":"2024-09-17T05:52:18.873991+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:52:18.873991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:52:18.873991+0000","last_clean_scrub_stamp":"2024-09-17T05:52:18.873991+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.f","version":"126'1","reported_seq":16,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-09-17T05:52:21.030089+0000","last_change":"2024-09-17T05:52:18.897267+0000","last_active":"2024-09-17T05:52:21.030089+0000","last_peered":"2024-09-17T05:52:21.030089+0000","last_clean":"2024-09-17T05:52:21.030089+0000","last_became_active":"2024-09-17T05:52:18.896904+0000","last_became_peered":"2024-09-17T05:52:18.896904+0000","last_unstale":"2024-09-17T05:52:21.030089+0000","last_undegraded":"2024-09-17T05:52:21.030089+0000","last_fullsized":"2024-09-17T05:52:21.030089+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:52:17.867506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:52:17.867506+0000","last_clean_scrub_stamp":"2024-09-17T05:52:17.867506+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:12:04.538452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.f","version":"0'0","reported_seq":13,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-09-17T05:52:21.029915+0000","last_change":"2024-09-17T05:52:19.919016+0000","last_active":"2024-09-17T05:52:21.029915+0000","last_peered":"2024-09-17T05:52:21.029915+0000","last_clean":"2024-09-17T05:52:21.029915+0000","last_became_active":"2024-09-17T05:52:19.918688+0000","last_became_peered":"2024-09-17T05:52:19.918688+0000","last_unstale":"2024-09-17T05:52:21.029915+0000","last_undegraded":"2024-09-17T05:52:21.029915+0000","last_fullsized":"2024-09-17T05:52:21.029915+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:52:18.873991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:52:18.873991+0000","last_clean_scrub_stamp":"2024-09-17T05:52:18.873991+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:31:23.140660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.e","version":"0'0","reported_seq":10,"reported_epoch":125,"state":"active+clean","last_fresh":"2024-09-17T05:52:18.895645+0000","last_change":"2024-09-17T05:52:18.893709+0000","last_active":"2024-09-17T05:52:18.895645+0000","last_peered":"2024-09-17T05:52:18.895645+0000","last_clean":"2024-09-17T05:52:18.895645+0000","last_became_active":"2024-09-17T05:52:18.893409+0000","last_became_peered":"2024-09-17T05:52:18.893409+0000","last_unstale":"2024-09-17T05:52:18.895645+0000","last_undegraded":"2024-09-17T05:52:18.895645+0000","last_fullsized":"2024-09-17T05:52:18.895645+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:52:17.867506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:52:17.867506+0000","last_clean_scrub_stamp":"2024-09-17T05:52:17.867506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:00:31.935995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:52:18.873991+0000","last_change":"2024-09-17T05:52:18.873991+0000","last_active":"2024-09-17T05:52:18.873991+0000","last_peered":"2024-09-17T05:52:18.873991+0000","last_clean":"2024-09-17T05:52:18.873991+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:52:18.873991+0000","last_undegraded":"2024-09-17T05:52:18.873991+0000","last_fullsized":"2024-09-17T05:52:18.873991+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:52:18.873991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:52:18.873991+0000","last_clean_scrub_stamp":"2024-09-17T05:52:18.873991+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.d","version":"126'1","reported_seq":16,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-09-17T05:52:20.916203+0000","last_change":"2024-09-17T05:52:18.896965+0000","last_active":"2024-09-17T05:52:20.916203+0000","last_peered":"2024-09-17T05:52:20.916203+0000","last_clean":"2024-09-17T05:52:20.916203+0000","last_became_active":"2024-09-17T05:52:18.896665+0000","last_became_peered":"2024-09-17T05:52:18.896665+0000","last_unstale":"2024-09-17T05:52:20.916203+0000","last_undegraded":"2024-09-17T05:52:20.916203+0000","last_fullsized":"2024-09-17T05:52:20.916203+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:52:17.867506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:52:17.867506+0000","last_clean_scrub_stamp":"2024-09-17T05:52:17.867506+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:03:31.140556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:52:18.873991+0000","last_change":"2024-09-17T05:52:18.873991+0000","last_active":"2024-09-17T05:52:18.873991+0000","last_peered":"2024-09-17T05:52:18.873991+0000","last_clean":"2024-09-17T05:52:18.873991+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:52:18.873991+0000","last_undegraded":"2024-09-17T05:52:18.873991+0000","last_fullsized":"2024-09-17T05:52:18.873991+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:52:18.873991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:52:18.873991+0000","last_clean_scrub_stamp":"2024-09-17T05:52:18.873991+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.c","version":"0'0","reported_seq":15,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-09-17T05:52:21.029699+0000","last_change":"2024-09-17T05:52:18.897796+0000","last_active":"2024-09-17T05:52:21.029699+0000","last_peered":"2024-09-17T05:52:21.029699+0000","last_clean":"2024-09-17T05:52:21.029699+0000","last_became_active":"2024-09-17T05:52:18.896607+0000","last_became_peered":"2024-09-17T05:52:18.896607+0000","last_unstale":"2024-09-17T05:52:21.029699+0000","last_undegraded":"2024-09-17T05:52:21.029699+0000","last_fullsized":"2024-09-17T05:52:21.029699+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:52:17.867506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:52:17.867506+0000","last_clean_scrub_stamp":"2024-09-17T05:52:17.867506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:06:49.196334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:52:18.873991+0000","last_change":"2024-09-17T05:52:18.873991+0000","last_active":"2024-09-17T05:52:18.873991+0000","last_peered":"2024-09-17T05:52:18.873991+0000","last_clean":"2024-09-17T05:52:18.873991+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:52:18.873991+0000","last_undegraded":"2024-09-17T05:52:18.873991+0000","last_fullsized":"2024-09-17T05:52:18.873991+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:52:18.873991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:52:18.873991+0000","last_clean_scrub_stamp":"2024-09-17T05:52:18.873991+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.b","version":"126'2","reported_seq":17,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-09-17T05:52:21.029634+0000","last_change":"2024-09-17T05:52:18.898700+0000","last_active":"2024-09-17T05:52:21.029634+0000","last_peered":"2024-09-17T05:52:21.029634+0000","last_clean":"2024-09-17T05:52:21.029634+0000","last_became_active":"2024-09-17T05:52:18.898205+0000","last_became_peered":"2024-09-17T05:52:18.898205+0000","last_unstale":"2024-09-17T05:52:21.029634+0000","last_undegraded":"2024-09-17T05:52:21.029634+0000","last_fullsized":"2024-09-17T05:52:21.029634+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:52:17.867506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:52:17.867506+0000","last_clean_scrub_stamp":"2024-09-17T05:52:17.867506+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:03:42.897065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.b","version":"0'0","reported_seq":13,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-09-17T05:52:20.916229+0000","last_change":"2024-09-17T05:52:19.926434+0000","last_active":"2024-09-17T05:52:20.916229+0000","last_peered":"2024-09-17T05:52:20.916229+0000","last_clean":"2024-09-17T05:52:20.916229+0000","last_became_active":"2024-09-17T05:52:19.926138+0000","last_became_peered":"2024-09-17T05:52:19.926138+0000","last_unstale":"2024-09-17T05:52:20.916229+0000","last_undegraded":"2024-09-17T05:52:20.916229+0000","last_fullsized":"2024-09-17T05:52:20.916229+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:52:18.873991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:52:18.873991+0000","last_clean_scrub_stamp":"2024-09-17T05:52:18.873991+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:39:56.592090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.a","version":"0'0","reported_seq":1,"reported_epoch":124,"state":"creating+peering","last_fresh":"2024-09-17T05:52:17.880917+0000","last_change":"2024-09-17T05:52:17.880917+0000","last_active":"2024-09-17T05:52:17.867506+0000","last_peered":"2024-09-17T05:52:17.867506+0000","last_clean":"2024-09-17T05:52:17.867506+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:52:17.880917+0000","last_undegraded":"2024-09-17T05:52:17.880917+0000","last_fullsized":"2024-09-17T05:52:17.880917+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:52:17.867506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:52:17.867506+0000","last_clean_scrub_stamp":"2024-09-17T05:52:17.867506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:52:18.873991+0000","last_change":"2024-09-17T05:52:18.873991+0000","last_active":"2024-09-17T05:52:18.873991+0000","last_peered":"2024-09-17T05:52:18.873991+0000","last_clean":"2024-09-17T05:52:18.873991+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:52:18.873991+0000","last_undegraded":"2024-09-17T05:52:18.873991+0000","last_fullsized":"2024-09-17T05:52:18.873991+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:52:18.873991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:52:18.873991+0000","last_clean_scrub_stamp":"2024-09-17T05:52:18.873991+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.9","version":"0'0","reported_seq":1,"reported_epoch":124,"state":"creating+peering","last_fresh":"2024-09-17T05:52:17.881742+0000","last_change":"2024-09-17T05:52:17.881742+0000","last_active":"2024-09-17T05:52:17.867506+0000","last_peered":"2024-09-17T05:52:17.867506+0000","last_clean":"2024-09-17T05:52:17.867506+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:52:17.881742+0000","last_undegraded":"2024-09-17T05:52:17.881742+0000","last_fullsized":"2024-09-17T05:52:17.881742+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:52:17.867506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:52:17.867506+0000","last_clean_scrub_stamp":"2024-09-17T05:52:17.867506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.9","version":"0'0","reported_seq":13,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-09-17T05:52:20.913125+0000","last_change":"2024-09-17T05:52:19.920709+0000","last_active":"2024-09-17T05:52:20.913125+0000","last_peered":"2024-09-17T05:52:20.913125+0000","last_clean":"2024-09-17T05:52:20.913125+0000","last_became_active":"2024-09-17T05:52:19.917358+0000","last_became_peered":"2024-09-17T05:52:19.917358+0000","last_unstale":"2024-09-17T05:52:20.913125+0000","last_undegraded":"2024-09-17T05:52:20.913125+0000","last_fullsized":"2024-09-17T05:52:20.913125+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:52:18.873991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:52:18.873991+0000","last_clean_scrub_stamp":"2024-09-17T05:52:18.873991+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:02:10.659710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.8","version":"0'0","reported_seq":10,"reported_epoch":125,"state":"active+clean","last_fresh":"2024-09-17T05:52:18.895648+0000","last_change":"2024-09-17T05:52:18.893798+0000","last_active":"2024-09-17T05:52:18.895648+0000","last_peered":"2024-09-17T05:52:18.895648+0000","last_clean":"2024-09-17T05:52:18.895648+0000","last_became_active":"2024-09-17T05:52:18.893085+0000","last_became_peered":"2024-09-17T05:52:18.893085+0000","last_unstale":"2024-09-17T05:52:18.895648+0000","last_undegraded":"2024-09-17T05:52:18.895648+0000","last_fullsized":"2024-09-17T05:52:18.895648+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:52:17.867506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:52:17.867506+0000","last_clean_scrub_stamp":"2024-09-17T05:52:17.867506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:43:24.092663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.6","version":"0'0","reported_seq":13,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-09-17T05:52:20.916705+0000","last_change":"2024-09-17T05:52:19.926025+0000","last_active":"2024-09-17T05:52:20.916705+0000","last_peered":"2024-09-17T05:52:20.916705+0000","last_clean":"2024-09-17T05:52:20.916705+0000","last_became_active":"2024-09-17T05:52:19.925657+0000","last_became_peered":"2024-09-17T05:52:19.925657+0000","last_unstale":"2024-09-17T05:52:20.916705+0000","last_undegraded":"2024-09-17T05:52:20.916705+0000","last_fullsized":"2024-09-17T05:52:20.916705+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:52:18.873991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:52:18.873991+0000","last_clean_scrub_stamp":"2024-09-17T05:52:18.873991+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:54:11.013453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.7","version":"0'0","reported_seq":1,"reported_epoch":124,"state":"creating+peering","last_fresh":"2024-09-17T05:52:17.879834+0000","last_change":"2024-09-17T05:52:17.879834+0000","last_active":"2024-09-17T05:52:17.867506+0000","last_peered":"2024-09-17T05:52:17.867506+0000","last_clean":"2024-09-17T05:52:17.867506+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:52:17.879834+0000","last_undegraded":"2024-09-17T05:52:17.879834+0000","last_fullsized":"2024-09-17T05:52:17.879834+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:52:17.867506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:52:17.867506+0000","last_clean_scrub_stamp":"2024-09-17T05:52:17.867506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:52:18.873991+0000","last_change":"2024-09-17T05:52:18.873991+0000","last_active":"2024-09-17T05:52:18.873991+0000","last_peered":"2024-09-17T05:52:18.873991+0000","last_clean":"2024-09-17T05:52:18.873991+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:52:18.873991+0000","last_undegraded":"2024-09-17T05:52:18.873991+0000","last_fullsized":"2024-09-17T05:52:18.873991+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:52:18.873991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:52:18.873991+0000","last_clean_scrub_stamp":"2024-09-17T05:52:18.873991+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.6","version":"127'1","reported_seq":16,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-09-17T05:52:20.914810+0000","last_change":"2024-09-17T05:52:18.893591+0000","last_active":"2024-09-17T05:52:20.914810+0000","last_peered":"2024-09-17T05:52:20.914810+0000","last_clean":"2024-09-17T05:52:20.914810+0000","last_became_active":"2024-09-17T05:52:18.893254+0000","last_became_peered":"2024-09-17T05:52:18.893254+0000","last_unstale":"2024-09-17T05:52:20.914810+0000","last_undegraded":"2024-09-17T05:52:20.914810+0000","last_fullsized":"2024-09-17T05:52:20.914810+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:52:17.867506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:52:17.867506+0000","last_clean_scrub_stamp":"2024-09-17T05:52:17.867506+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:20:34.378498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:52:18.873991+0000","last_change":"2024-09-17T05:52:18.873991+0000","last_active":"2024-09-17T05:52:18.873991+0000","last_peered":"2024-09-17T05:52:18.873991+0000","last_clean":"2024-09-17T05:52:18.873991+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:52:18.873991+0000","last_undegraded":"2024-09-17T05:52:18.873991+0000","last_fullsized":"2024-09-17T05:52:18.873991+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:52:18.873991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:52:18.873991+0000","last_clean_scrub_stamp":"2024-09-17T05:52:18.873991+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.5","version":"0'0","reported_seq":1,"reported_epoch":124,"state":"creating+peering","last_fresh":"2024-09-17T05:52:17.882208+0000","last_change":"2024-09-17T05:52:17.882208+0000","last_active":"2024-09-17T05:52:17.867506+0000","last_peered":"2024-09-17T05:52:17.867506+0000","last_clean":"2024-09-17T05:52:17.867506+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:52:17.882208+0000","last_undegraded":"2024-09-17T05:52:17.882208+0000","last_fullsized":"2024-09-17T05:52:17.882208+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:52:17.867506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:52:17.867506+0000","last_clean_scrub_stamp":"2024-09-17T05:52:17.867506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.5","version":"0'0","reported_seq":13,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-09-17T05:52:20.916284+0000","last_change":"2024-09-17T05:52:19.926104+0000","last_active":"2024-09-17T05:52:20.916284+0000","last_peered":"2024-09-17T05:52:20.916284+0000","last_clean":"2024-09-17T05:52:20.916284+0000","last_became_active":"2024-09-17T05:52:19.925767+0000","last_became_peered":"2024-09-17T05:52:19.925767+0000","last_unstale":"2024-09-17T05:52:20.916284+0000","last_undegraded":"2024-09-17T05:52:20.916284+0000","last_fullsized":"2024-09-17T05:52:20.916284+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:52:18.873991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:52:18.873991+0000","last_clean_scrub_stamp":"2024-09-17T05:52:18.873991+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:43:20.839584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.4","version":"0'0","reported_seq":10,"reported_epoch":125,"state":"active+clean","last_fresh":"2024-09-17T05:52:18.901169+0000","last_change":"2024-09-17T05:52:18.898186+0000","last_active":"2024-09-17T05:52:18.901169+0000","last_peered":"2024-09-17T05:52:18.901169+0000","last_clean":"2024-09-17T05:52:18.901169+0000","last_became_active":"2024-09-17T05:52:18.897402+0000","last_became_peered":"2024-09-17T05:52:18.897402+0000","last_unstale":"2024-09-17T05:52:18.901169+0000","last_undegraded":"2024-09-17T05:52:18.901169+0000","last_fullsized":"2024-09-17T05:52:18.901169+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:52:17.867506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:52:17.867506+0000","last_clean_scrub_stamp":"2024-09-17T05:52:17.867506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:49:01.468547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.2","version":"0'0","reported_seq":13,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-09-17T05:52:20.913065+0000","last_change":"2024-09-17T05:52:19.927870+0000","last_active":"2024-09-17T05:52:20.913065+0000","last_peered":"2024-09-17T05:52:20.913065+0000","last_clean":"2024-09-17T05:52:20.913065+0000","last_became_active":"2024-09-17T05:52:19.927573+0000","last_became_peered":"2024-09-17T05:52:19.927573+0000","last_unstale":"2024-09-17T05:52:20.913065+0000","last_undegraded":"2024-09-17T05:52:20.913065+0000","last_fullsized":"2024-09-17T05:52:20.913065+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:52:18.873991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:52:18.873991+0000","last_clean_scrub_stamp":"2024-09-17T05:52:18.873991+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:43:48.027258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.3","version":"0'0","reported_seq":1,"reported_epoch":124,"state":"creating+peering","last_fresh":"2024-09-17T05:52:17.880787+0000","last_change":"2024-09-17T05:52:17.880787+0000","last_active":"2024-09-17T05:52:17.867506+0000","last_peered":"2024-09-17T05:52:17.867506+0000","last_clean":"2024-09-17T05:52:17.867506+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:52:17.880787+0000","last_undegraded":"2024-09-17T05:52:17.880787+0000","last_fullsized":"2024-09-17T05:52:17.880787+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:52:17.867506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:52:17.867506+0000","last_clean_scrub_stamp":"2024-09-17T05:52:17.867506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.3","version":"0'0","reported_seq":13,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-09-17T05:52:21.029775+0000","last_change":"2024-09-17T05:52:19.923958+0000","last_active":"2024-09-17T05:52:21.029775+0000","last_peered":"2024-09-17T05:52:21.029775+0000","last_clean":"2024-09-17T05:52:21.029775+0000","last_became_active":"2024-09-17T05:52:19.923644+0000","last_became_peered":"2024-09-17T05:52:19.923644+0000","last_unstale":"2024-09-17T05:52:21.029775+0000","last_undegraded":"2024-09-17T05:52:21.029775+0000","last_fullsized":"2024-09-17T05:52:21.029775+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:52:18.873991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:52:18.873991+0000","last_clean_scrub_stamp":"2024-09-17T05:52:18.873991+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:47:43.829677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.2","version":"0'0","reported_seq":15,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-09-17T05:52:20.913214+0000","last_change":"2024-09-17T05:52:18.894258+0000","last_active":"2024-09-17T05:52:20.913214+0000","last_peered":"2024-09-17T05:52:20.913214+0000","last_clean":"2024-09-17T05:52:20.913214+0000","last_became_active":"2024-09-17T05:52:18.893908+0000","last_became_peered":"2024-09-17T05:52:18.893908+0000","last_unstale":"2024-09-17T05:52:20.913214+0000","last_undegraded":"2024-09-17T05:52:20.913214+0000","last_fullsized":"2024-09-17T05:52:20.913214+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:52:17.867506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:52:17.867506+0000","last_clean_scrub_stamp":"2024-09-17T05:52:17.867506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:04:22.951320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:52:18.873991+0000","last_change":"2024-09-17T05:52:18.873991+0000","last_active":"2024-09-17T05:52:18.873991+0000","last_peered":"2024-09-17T05:52:18.873991+0000","last_clean":"2024-09-17T05:52:18.873991+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:52:18.873991+0000","last_undegraded":"2024-09-17T05:52:18.873991+0000","last_fullsized":"2024-09-17T05:52:18.873991+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:52:18.873991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:52:18.873991+0000","last_clean_scrub_stamp":"2024-09-17T05:52:18.873991+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.1","version":"0'0","reported_seq":1,"reported_epoch":124,"state":"creating+peering","last_fresh":"2024-09-17T05:52:17.880828+0000","last_change":"2024-09-17T05:52:17.880828+0000","last_active":"2024-09-17T05:52:17.867506+0000","last_peered":"2024-09-17T05:52:17.867506+0000","last_clean":"2024-09-17T05:52:17.867506+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:52:17.880828+0000","last_undegraded":"2024-09-17T05:52:17.880828+0000","last_fullsized":"2024-09-17T05:52:17.880828+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:52:17.867506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:52:17.867506+0000","last_clean_scrub_stamp":"2024-09-17T05:52:17.867506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:52:18.873991+0000","last_change":"2024-09-17T05:52:18.873991+0000","last_active":"2024-09-17T05:52:18.873991+0000","last_peered":"2024-09-17T05:52:18.873991+0000","last_clean":"2024-09-17T05:52:18.873991+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:52:18.873991+0000","last_undegraded":"2024-09-17T05:52:18.873991+0000","last_fullsized":"2024-09-17T05:52:18.873991+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:52:18.873991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:52:18.873991+0000","last_clean_scrub_stamp":"2024-09-17T05:52:18.873991+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.0","version":"0'0","reported_seq":10,"reported_epoch":125,"state":"active+clean","last_fresh":"2024-09-17T05:52:18.890542+0000","last_change":"2024-09-17T05:52:18.889287+0000","last_active":"2024-09-17T05:52:18.890542+0000","last_peered":"2024-09-17T05:52:18.890542+0000","last_clean":"2024-09-17T05:52:18.890542+0000","last_became_active":"2024-09-17T05:52:18.888934+0000","last_became_peered":"2024-09-17T05:52:18.888934+0000","last_unstale":"2024-09-17T05:52:18.890542+0000","last_undegraded":"2024-09-17T05:52:18.890542+0000","last_fullsized":"2024-09-17T05:52:18.890542+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:52:17.867506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:52:17.867506+0000","last_clean_scrub_stamp":"2024-09-17T05:52:17.867506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:20:22.215964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.12","version":"0'0","reported_seq":13,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-09-17T05:52:20.913020+0000","last_change":"2024-09-17T05:52:19.917259+0000","last_active":"2024-09-17T05:52:20.913020+0000","last_peered":"2024-09-17T05:52:20.913020+0000","last_clean":"2024-09-17T05:52:20.913020+0000","last_became_active":"2024-09-17T05:52:19.916932+0000","last_became_peered":"2024-09-17T05:52:19.916932+0000","last_unstale":"2024-09-17T05:52:20.913020+0000","last_undegraded":"2024-09-17T05:52:20.913020+0000","last_fullsized":"2024-09-17T05:52:20.913020+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:52:18.873991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:52:18.873991+0000","last_clean_scrub_stamp":"2024-09-17T05:52:18.873991+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:28:29.059413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.13","version":"126'2","reported_seq":17,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-09-17T05:52:20.913529+0000","last_change":"2024-09-17T05:52:18.900120+0000","last_active":"2024-09-17T05:52:20.913529+0000","last_peered":"2024-09-17T05:52:20.913529+0000","last_clean":"2024-09-17T05:52:20.913529+0000","last_became_active":"2024-09-17T05:52:18.899687+0000","last_became_peered":"2024-09-17T05:52:18.899687+0000","last_unstale":"2024-09-17T05:52:20.913529+0000","last_undegraded":"2024-09-17T05:52:20.913529+0000","last_fullsized":"2024-09-17T05:52:20.913529+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:52:17.867506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:52:17.867506+0000","last_clean_scrub_stamp":"2024-09-17T05:52:17.867506+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:26:59.669212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"19'72","reported_seq":302,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-09-17T05:52:20.912559+0000","last_change":"2024-09-17T05:41:48.539830+0000","last_active":"2024-09-17T05:52:20.912559+0000","last_peered":"2024-09-17T05:52:20.912559+0000","last_clean":"2024-09-17T05:52:20.912559+0000","last_became_active":"2024-09-17T05:41:48.538743+0000","last_became_peered":"2024-09-17T05:41:48.538743+0000","last_unstale":"2024-09-17T05:52:20.912559+0000","last_undegraded":"2024-09-17T05:52:20.912559+0000","last_fullsized":"2024-09-17T05:52:20.912559+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:47.152539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:47.152539+0000","last_clean_scrub_stamp":"2024-09-17T05:41:47.152539+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:08:02.952016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":19,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":52,"acting":52,"num_store_stats":4},{"poolid":18,"num_pg":32,"stat_sum":{"num_bytes":798,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":2432,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":15,"ondisk_log_size":15,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":16,"seq":68719476867,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":145068,"kb_used_data":1492,"kb_used_omap":1,"kb_used_meta":143550,"kb_avail":94226772,"statfs":{"total":96636764160,"available":96488214528,"internally_reserved":0,"allocated":1527808,"data_stored":667141,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":146995654},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":15,"seq":64424509572,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":119356,"kb_used_data":2144,"kb_used_omap":1,"kb_used_meta":117182,"kb_avail":94252484,"statfs":{"total":96636764160,"available":96514543616,"internally_reserved":0,"allocated":2195456,"data_stored":1285598,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":119994826},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509571,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":113188,"kb_used_data":1548,"kb_used_omap":1,"kb_used_meta":111614,"kb_avail":94258652,"statfs":{"total":96636764160,"available":96520859648,"internally_reserved":0,"allocated":1585152,"data_stored":693092,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":114293189},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509571,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":140956,"kb_used_data":1544,"kb_used_omap":1,"kb_used_meta":139390,"kb_avail":94230884,"statfs":{"total":96636764160,"available":96492425216,"internally_reserved":0,"allocated":1581056,"data_stored":693050,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":142735813},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509570,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":118708,"kb_used_data":1504,"kb_used_omap":1,"kb_used_meta":117182,"kb_avail":94253132,"statfs":{"total":96636764160,"available":96515207168,"internally_reserved":0,"allocated":1540096,"data_stored":673126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":119994823},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509570,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":140904,"kb_used_data":1492,"kb_used_omap":1,"kb_used_meta":139390,"kb_avail":94230936,"statfs":{"total":96636764160,"available":96492478464,"internally_reserved":0,"allocated":1527808,"data_stored":667141,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":142735813},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509570,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":145068,"kb_used_data":1492,"kb_used_omap":1,"kb_used_meta":143550,"kb_avail":94226772,"statfs":{"total":96636764160,"available":96488214528,"internally_reserved":0,"allocated":1527808,"data_stored":667141,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":146995653},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574978,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":123464,"kb_used_data":2096,"kb_used_omap":1,"kb_used_meta":121342,"kb_avail":94248376,"statfs":{"total":96636764160,"available":96510337024,"internally_reserved":0,"allocated":2146304,"data_stored":1269937,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":124254661},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":2250,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-17T05:52:24.645 INFO:tasks.ceph.ceph_manager.ceph:PG 19.3f is not active+clean 2024-09-17T05:52:24.645 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '19.3f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T05:52:18.873991+0000', 'last_change': '2024-09-17T05:52:18.873991+0000', 'last_active': '2024-09-17T05:52:18.873991+0000', 'last_peered': '2024-09-17T05:52:18.873991+0000', 'last_clean': '2024-09-17T05:52:18.873991+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:52:18.873991+0000', 'last_undegraded': '2024-09-17T05:52:18.873991+0000', 'last_fullsized': '2024-09-17T05:52:18.873991+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:52:18.873991+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:52:18.873991+0000', 'last_clean_scrub_stamp': '2024-09-17T05:52:18.873991+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T05:52:24.645 INFO:tasks.ceph.ceph_manager.ceph:PG 19.3e is not active+clean 2024-09-17T05:52:24.645 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '19.3e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T05:52:18.873991+0000', 'last_change': '2024-09-17T05:52:18.873991+0000', 'last_active': '2024-09-17T05:52:18.873991+0000', 'last_peered': '2024-09-17T05:52:18.873991+0000', 'last_clean': '2024-09-17T05:52:18.873991+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:52:18.873991+0000', 'last_undegraded': '2024-09-17T05:52:18.873991+0000', 'last_fullsized': '2024-09-17T05:52:18.873991+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:52:18.873991+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:52:18.873991+0000', 'last_clean_scrub_stamp': '2024-09-17T05:52:18.873991+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T05:52:24.645 INFO:tasks.ceph.ceph_manager.ceph:PG 19.3d is not active+clean 2024-09-17T05:52:24.645 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '19.3d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T05:52:18.873991+0000', 'last_change': '2024-09-17T05:52:18.873991+0000', 'last_active': '2024-09-17T05:52:18.873991+0000', 'last_peered': '2024-09-17T05:52:18.873991+0000', 'last_clean': '2024-09-17T05:52:18.873991+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:52:18.873991+0000', 'last_undegraded': '2024-09-17T05:52:18.873991+0000', 'last_fullsized': '2024-09-17T05:52:18.873991+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:52:18.873991+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:52:18.873991+0000', 'last_clean_scrub_stamp': '2024-09-17T05:52:18.873991+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T05:52:24.645 INFO:tasks.ceph.ceph_manager.ceph:PG 19.3c is not active+clean 2024-09-17T05:52:24.645 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '19.3c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T05:52:18.873991+0000', 'last_change': '2024-09-17T05:52:18.873991+0000', 'last_active': '2024-09-17T05:52:18.873991+0000', 'last_peered': '2024-09-17T05:52:18.873991+0000', 'last_clean': '2024-09-17T05:52:18.873991+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:52:18.873991+0000', 'last_undegraded': '2024-09-17T05:52:18.873991+0000', 'last_fullsized': '2024-09-17T05:52:18.873991+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:52:18.873991+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:52:18.873991+0000', 'last_clean_scrub_stamp': '2024-09-17T05:52:18.873991+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T05:52:24.646 INFO:tasks.ceph.ceph_manager.ceph:PG 19.38 is not active+clean 2024-09-17T05:52:24.646 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '19.38', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T05:52:18.873991+0000', 'last_change': '2024-09-17T05:52:18.873991+0000', 'last_active': '2024-09-17T05:52:18.873991+0000', 'last_peered': '2024-09-17T05:52:18.873991+0000', 'last_clean': '2024-09-17T05:52:18.873991+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:52:18.873991+0000', 'last_undegraded': '2024-09-17T05:52:18.873991+0000', 'last_fullsized': '2024-09-17T05:52:18.873991+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:52:18.873991+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:52:18.873991+0000', 'last_clean_scrub_stamp': '2024-09-17T05:52:18.873991+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T05:52:24.646 INFO:tasks.ceph.ceph_manager.ceph:PG 19.37 is not active+clean 2024-09-17T05:52:24.646 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '19.37', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T05:52:18.873991+0000', 'last_change': '2024-09-17T05:52:18.873991+0000', 'last_active': '2024-09-17T05:52:18.873991+0000', 'last_peered': '2024-09-17T05:52:18.873991+0000', 'last_clean': '2024-09-17T05:52:18.873991+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:52:18.873991+0000', 'last_undegraded': '2024-09-17T05:52:18.873991+0000', 'last_fullsized': '2024-09-17T05:52:18.873991+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:52:18.873991+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:52:18.873991+0000', 'last_clean_scrub_stamp': '2024-09-17T05:52:18.873991+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T05:52:24.646 INFO:tasks.ceph.ceph_manager.ceph:PG 19.36 is not active+clean 2024-09-17T05:52:24.646 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '19.36', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T05:52:18.873991+0000', 'last_change': '2024-09-17T05:52:18.873991+0000', 'last_active': '2024-09-17T05:52:18.873991+0000', 'last_peered': '2024-09-17T05:52:18.873991+0000', 'last_clean': '2024-09-17T05:52:18.873991+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:52:18.873991+0000', 'last_undegraded': '2024-09-17T05:52:18.873991+0000', 'last_fullsized': '2024-09-17T05:52:18.873991+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:52:18.873991+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:52:18.873991+0000', 'last_clean_scrub_stamp': '2024-09-17T05:52:18.873991+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T05:52:24.646 INFO:tasks.ceph.ceph_manager.ceph:PG 19.35 is not active+clean 2024-09-17T05:52:24.646 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '19.35', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 125, 'state': 'creating+peering', 'last_fresh': '2024-09-17T05:52:18.886163+0000', 'last_change': '2024-09-17T05:52:18.886163+0000', 'last_active': '2024-09-17T05:52:18.873991+0000', 'last_peered': '2024-09-17T05:52:18.873991+0000', 'last_clean': '2024-09-17T05:52:18.873991+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:52:18.886163+0000', 'last_undegraded': '2024-09-17T05:52:18.886163+0000', 'last_fullsized': '2024-09-17T05:52:18.886163+0000', 'mapping_epoch': 125, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 125, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:52:18.873991+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:52:18.873991+0000', 'last_clean_scrub_stamp': '2024-09-17T05:52:18.873991+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-17T05:52:24.646 INFO:tasks.ceph.ceph_manager.ceph:PG 19.34 is not active+clean 2024-09-17T05:52:24.646 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '19.34', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T05:52:18.873991+0000', 'last_change': '2024-09-17T05:52:18.873991+0000', 'last_active': '2024-09-17T05:52:18.873991+0000', 'last_peered': '2024-09-17T05:52:18.873991+0000', 'last_clean': '2024-09-17T05:52:18.873991+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:52:18.873991+0000', 'last_undegraded': '2024-09-17T05:52:18.873991+0000', 'last_fullsized': '2024-09-17T05:52:18.873991+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:52:18.873991+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:52:18.873991+0000', 'last_clean_scrub_stamp': '2024-09-17T05:52:18.873991+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T05:52:24.647 INFO:tasks.ceph.ceph_manager.ceph:PG 19.33 is not active+clean 2024-09-17T05:52:24.647 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '19.33', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T05:52:18.873991+0000', 'last_change': '2024-09-17T05:52:18.873991+0000', 'last_active': '2024-09-17T05:52:18.873991+0000', 'last_peered': '2024-09-17T05:52:18.873991+0000', 'last_clean': '2024-09-17T05:52:18.873991+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:52:18.873991+0000', 'last_undegraded': '2024-09-17T05:52:18.873991+0000', 'last_fullsized': '2024-09-17T05:52:18.873991+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:52:18.873991+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:52:18.873991+0000', 'last_clean_scrub_stamp': '2024-09-17T05:52:18.873991+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T05:52:24.647 INFO:tasks.ceph.ceph_manager.ceph:PG 19.32 is not active+clean 2024-09-17T05:52:24.647 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '19.32', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T05:52:18.873991+0000', 'last_change': '2024-09-17T05:52:18.873991+0000', 'last_active': '2024-09-17T05:52:18.873991+0000', 'last_peered': '2024-09-17T05:52:18.873991+0000', 'last_clean': '2024-09-17T05:52:18.873991+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:52:18.873991+0000', 'last_undegraded': '2024-09-17T05:52:18.873991+0000', 'last_fullsized': '2024-09-17T05:52:18.873991+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:52:18.873991+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:52:18.873991+0000', 'last_clean_scrub_stamp': '2024-09-17T05:52:18.873991+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T05:52:24.647 INFO:tasks.ceph.ceph_manager.ceph:PG 19.31 is not active+clean 2024-09-17T05:52:24.647 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '19.31', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T05:52:18.873991+0000', 'last_change': '2024-09-17T05:52:18.873991+0000', 'last_active': '2024-09-17T05:52:18.873991+0000', 'last_peered': '2024-09-17T05:52:18.873991+0000', 'last_clean': '2024-09-17T05:52:18.873991+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:52:18.873991+0000', 'last_undegraded': '2024-09-17T05:52:18.873991+0000', 'last_fullsized': '2024-09-17T05:52:18.873991+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:52:18.873991+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:52:18.873991+0000', 'last_clean_scrub_stamp': '2024-09-17T05:52:18.873991+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T05:52:24.647 INFO:tasks.ceph.ceph_manager.ceph:PG 19.30 is not active+clean 2024-09-17T05:52:24.647 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '19.30', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T05:52:18.873991+0000', 'last_change': '2024-09-17T05:52:18.873991+0000', 'last_active': '2024-09-17T05:52:18.873991+0000', 'last_peered': '2024-09-17T05:52:18.873991+0000', 'last_clean': '2024-09-17T05:52:18.873991+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:52:18.873991+0000', 'last_undegraded': '2024-09-17T05:52:18.873991+0000', 'last_fullsized': '2024-09-17T05:52:18.873991+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:52:18.873991+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:52:18.873991+0000', 'last_clean_scrub_stamp': '2024-09-17T05:52:18.873991+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T05:52:24.647 INFO:tasks.ceph.ceph_manager.ceph:PG 19.2e is not active+clean 2024-09-17T05:52:24.647 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '19.2e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T05:52:18.873991+0000', 'last_change': '2024-09-17T05:52:18.873991+0000', 'last_active': '2024-09-17T05:52:18.873991+0000', 'last_peered': '2024-09-17T05:52:18.873991+0000', 'last_clean': '2024-09-17T05:52:18.873991+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:52:18.873991+0000', 'last_undegraded': '2024-09-17T05:52:18.873991+0000', 'last_fullsized': '2024-09-17T05:52:18.873991+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:52:18.873991+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:52:18.873991+0000', 'last_clean_scrub_stamp': '2024-09-17T05:52:18.873991+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T05:52:24.648 INFO:tasks.ceph.ceph_manager.ceph:PG 19.2d is not active+clean 2024-09-17T05:52:24.648 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '19.2d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 125, 'state': 'creating+peering', 'last_fresh': '2024-09-17T05:52:18.885679+0000', 'last_change': '2024-09-17T05:52:18.885679+0000', 'last_active': '2024-09-17T05:52:18.873991+0000', 'last_peered': '2024-09-17T05:52:18.873991+0000', 'last_clean': '2024-09-17T05:52:18.873991+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:52:18.885679+0000', 'last_undegraded': '2024-09-17T05:52:18.885679+0000', 'last_fullsized': '2024-09-17T05:52:18.885679+0000', 'mapping_epoch': 125, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 125, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:52:18.873991+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:52:18.873991+0000', 'last_clean_scrub_stamp': '2024-09-17T05:52:18.873991+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 4], 'acting': [0, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-17T05:52:24.648 INFO:tasks.ceph.ceph_manager.ceph:PG 19.2c is not active+clean 2024-09-17T05:52:24.648 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '19.2c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T05:52:18.873991+0000', 'last_change': '2024-09-17T05:52:18.873991+0000', 'last_active': '2024-09-17T05:52:18.873991+0000', 'last_peered': '2024-09-17T05:52:18.873991+0000', 'last_clean': '2024-09-17T05:52:18.873991+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:52:18.873991+0000', 'last_undegraded': '2024-09-17T05:52:18.873991+0000', 'last_fullsized': '2024-09-17T05:52:18.873991+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:52:18.873991+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:52:18.873991+0000', 'last_clean_scrub_stamp': '2024-09-17T05:52:18.873991+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T05:52:24.648 INFO:tasks.ceph.ceph_manager.ceph:PG 19.2a is not active+clean 2024-09-17T05:52:24.648 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '19.2a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 125, 'state': 'creating+peering', 'last_fresh': '2024-09-17T05:52:18.885585+0000', 'last_change': '2024-09-17T05:52:18.885585+0000', 'last_active': '2024-09-17T05:52:18.873991+0000', 'last_peered': '2024-09-17T05:52:18.873991+0000', 'last_clean': '2024-09-17T05:52:18.873991+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:52:18.885585+0000', 'last_undegraded': '2024-09-17T05:52:18.885585+0000', 'last_fullsized': '2024-09-17T05:52:18.885585+0000', 'mapping_epoch': 125, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 125, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:52:18.873991+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:52:18.873991+0000', 'last_clean_scrub_stamp': '2024-09-17T05:52:18.873991+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-17T05:52:24.648 INFO:tasks.ceph.ceph_manager.ceph:PG 19.29 is not active+clean 2024-09-17T05:52:24.648 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '19.29', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T05:52:18.873991+0000', 'last_change': '2024-09-17T05:52:18.873991+0000', 'last_active': '2024-09-17T05:52:18.873991+0000', 'last_peered': '2024-09-17T05:52:18.873991+0000', 'last_clean': '2024-09-17T05:52:18.873991+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:52:18.873991+0000', 'last_undegraded': '2024-09-17T05:52:18.873991+0000', 'last_fullsized': '2024-09-17T05:52:18.873991+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:52:18.873991+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:52:18.873991+0000', 'last_clean_scrub_stamp': '2024-09-17T05:52:18.873991+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T05:52:24.648 INFO:tasks.ceph.ceph_manager.ceph:PG 19.28 is not active+clean 2024-09-17T05:52:24.648 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '19.28', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 125, 'state': 'creating+peering', 'last_fresh': '2024-09-17T05:52:18.884950+0000', 'last_change': '2024-09-17T05:52:18.884950+0000', 'last_active': '2024-09-17T05:52:18.873991+0000', 'last_peered': '2024-09-17T05:52:18.873991+0000', 'last_clean': '2024-09-17T05:52:18.873991+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:52:18.884950+0000', 'last_undegraded': '2024-09-17T05:52:18.884950+0000', 'last_fullsized': '2024-09-17T05:52:18.884950+0000', 'mapping_epoch': 125, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 125, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:52:18.873991+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:52:18.873991+0000', 'last_clean_scrub_stamp': '2024-09-17T05:52:18.873991+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 5], 'acting': [0, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-17T05:52:24.649 INFO:tasks.ceph.ceph_manager.ceph:PG 19.27 is not active+clean 2024-09-17T05:52:24.649 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '19.27', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T05:52:18.873991+0000', 'last_change': '2024-09-17T05:52:18.873991+0000', 'last_active': '2024-09-17T05:52:18.873991+0000', 'last_peered': '2024-09-17T05:52:18.873991+0000', 'last_clean': '2024-09-17T05:52:18.873991+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:52:18.873991+0000', 'last_undegraded': '2024-09-17T05:52:18.873991+0000', 'last_fullsized': '2024-09-17T05:52:18.873991+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:52:18.873991+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:52:18.873991+0000', 'last_clean_scrub_stamp': '2024-09-17T05:52:18.873991+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T05:52:24.649 INFO:tasks.ceph.ceph_manager.ceph:PG 19.26 is not active+clean 2024-09-17T05:52:24.649 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '19.26', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T05:52:18.873991+0000', 'last_change': '2024-09-17T05:52:18.873991+0000', 'last_active': '2024-09-17T05:52:18.873991+0000', 'last_peered': '2024-09-17T05:52:18.873991+0000', 'last_clean': '2024-09-17T05:52:18.873991+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:52:18.873991+0000', 'last_undegraded': '2024-09-17T05:52:18.873991+0000', 'last_fullsized': '2024-09-17T05:52:18.873991+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:52:18.873991+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:52:18.873991+0000', 'last_clean_scrub_stamp': '2024-09-17T05:52:18.873991+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T05:52:24.649 INFO:tasks.ceph.ceph_manager.ceph:PG 19.25 is not active+clean 2024-09-17T05:52:24.649 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '19.25', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T05:52:18.873991+0000', 'last_change': '2024-09-17T05:52:18.873991+0000', 'last_active': '2024-09-17T05:52:18.873991+0000', 'last_peered': '2024-09-17T05:52:18.873991+0000', 'last_clean': '2024-09-17T05:52:18.873991+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:52:18.873991+0000', 'last_undegraded': '2024-09-17T05:52:18.873991+0000', 'last_fullsized': '2024-09-17T05:52:18.873991+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:52:18.873991+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:52:18.873991+0000', 'last_clean_scrub_stamp': '2024-09-17T05:52:18.873991+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T05:52:24.649 INFO:tasks.ceph.ceph_manager.ceph:PG 19.23 is not active+clean 2024-09-17T05:52:24.649 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '19.23', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T05:52:18.873991+0000', 'last_change': '2024-09-17T05:52:18.873991+0000', 'last_active': '2024-09-17T05:52:18.873991+0000', 'last_peered': '2024-09-17T05:52:18.873991+0000', 'last_clean': '2024-09-17T05:52:18.873991+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:52:18.873991+0000', 'last_undegraded': '2024-09-17T05:52:18.873991+0000', 'last_fullsized': '2024-09-17T05:52:18.873991+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:52:18.873991+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:52:18.873991+0000', 'last_clean_scrub_stamp': '2024-09-17T05:52:18.873991+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T05:52:24.649 INFO:tasks.ceph.ceph_manager.ceph:PG 19.22 is not active+clean 2024-09-17T05:52:24.649 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '19.22', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T05:52:18.873991+0000', 'last_change': '2024-09-17T05:52:18.873991+0000', 'last_active': '2024-09-17T05:52:18.873991+0000', 'last_peered': '2024-09-17T05:52:18.873991+0000', 'last_clean': '2024-09-17T05:52:18.873991+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:52:18.873991+0000', 'last_undegraded': '2024-09-17T05:52:18.873991+0000', 'last_fullsized': '2024-09-17T05:52:18.873991+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:52:18.873991+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:52:18.873991+0000', 'last_clean_scrub_stamp': '2024-09-17T05:52:18.873991+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T05:52:24.649 INFO:tasks.ceph.ceph_manager.ceph:PG 19.1e is not active+clean 2024-09-17T05:52:24.650 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '19.1e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T05:52:18.873991+0000', 'last_change': '2024-09-17T05:52:18.873991+0000', 'last_active': '2024-09-17T05:52:18.873991+0000', 'last_peered': '2024-09-17T05:52:18.873991+0000', 'last_clean': '2024-09-17T05:52:18.873991+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:52:18.873991+0000', 'last_undegraded': '2024-09-17T05:52:18.873991+0000', 'last_fullsized': '2024-09-17T05:52:18.873991+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:52:18.873991+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:52:18.873991+0000', 'last_clean_scrub_stamp': '2024-09-17T05:52:18.873991+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T05:52:24.650 INFO:tasks.ceph.ceph_manager.ceph:PG 19.1f is not active+clean 2024-09-17T05:52:24.650 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '19.1f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T05:52:18.873991+0000', 'last_change': '2024-09-17T05:52:18.873991+0000', 'last_active': '2024-09-17T05:52:18.873991+0000', 'last_peered': '2024-09-17T05:52:18.873991+0000', 'last_clean': '2024-09-17T05:52:18.873991+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:52:18.873991+0000', 'last_undegraded': '2024-09-17T05:52:18.873991+0000', 'last_fullsized': '2024-09-17T05:52:18.873991+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:52:18.873991+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:52:18.873991+0000', 'last_clean_scrub_stamp': '2024-09-17T05:52:18.873991+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T05:52:24.650 INFO:tasks.ceph.ceph_manager.ceph:PG 18.1c is not active+clean 2024-09-17T05:52:24.650 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '18.1c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 124, 'state': 'creating+peering', 'last_fresh': '2024-09-17T05:52:17.881845+0000', 'last_change': '2024-09-17T05:52:17.881845+0000', 'last_active': '2024-09-17T05:52:17.867506+0000', 'last_peered': '2024-09-17T05:52:17.867506+0000', 'last_clean': '2024-09-17T05:52:17.867506+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:52:17.881845+0000', 'last_undegraded': '2024-09-17T05:52:17.881845+0000', 'last_fullsized': '2024-09-17T05:52:17.881845+0000', 'mapping_epoch': 124, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 124, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:52:17.867506+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:52:17.867506+0000', 'last_clean_scrub_stamp': '2024-09-17T05:52:17.867506+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 0], 'acting': [1, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-17T05:52:24.650 INFO:tasks.ceph.ceph_manager.ceph:PG 19.1a is not active+clean 2024-09-17T05:52:24.650 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '19.1a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T05:52:18.873991+0000', 'last_change': '2024-09-17T05:52:18.873991+0000', 'last_active': '2024-09-17T05:52:18.873991+0000', 'last_peered': '2024-09-17T05:52:18.873991+0000', 'last_clean': '2024-09-17T05:52:18.873991+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:52:18.873991+0000', 'last_undegraded': '2024-09-17T05:52:18.873991+0000', 'last_fullsized': '2024-09-17T05:52:18.873991+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:52:18.873991+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:52:18.873991+0000', 'last_clean_scrub_stamp': '2024-09-17T05:52:18.873991+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T05:52:24.650 INFO:tasks.ceph.ceph_manager.ceph:PG 18.1b is not active+clean 2024-09-17T05:52:24.650 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '18.1b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 124, 'state': 'creating+peering', 'last_fresh': '2024-09-17T05:52:17.881454+0000', 'last_change': '2024-09-17T05:52:17.881454+0000', 'last_active': '2024-09-17T05:52:17.867506+0000', 'last_peered': '2024-09-17T05:52:17.867506+0000', 'last_clean': '2024-09-17T05:52:17.867506+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:52:17.881454+0000', 'last_undegraded': '2024-09-17T05:52:17.881454+0000', 'last_fullsized': '2024-09-17T05:52:17.881454+0000', 'mapping_epoch': 124, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 124, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:52:17.867506+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:52:17.867506+0000', 'last_clean_scrub_stamp': '2024-09-17T05:52:17.867506+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 3], 'acting': [1, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-17T05:52:24.650 INFO:tasks.ceph.ceph_manager.ceph:PG 18.1a is not active+clean 2024-09-17T05:52:24.650 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '18.1a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 124, 'state': 'creating+peering', 'last_fresh': '2024-09-17T05:52:17.881579+0000', 'last_change': '2024-09-17T05:52:17.881579+0000', 'last_active': '2024-09-17T05:52:17.867506+0000', 'last_peered': '2024-09-17T05:52:17.867506+0000', 'last_clean': '2024-09-17T05:52:17.867506+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:52:17.881579+0000', 'last_undegraded': '2024-09-17T05:52:17.881579+0000', 'last_fullsized': '2024-09-17T05:52:17.881579+0000', 'mapping_epoch': 124, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 124, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:52:17.867506+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:52:17.867506+0000', 'last_clean_scrub_stamp': '2024-09-17T05:52:17.867506+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 1], 'acting': [3, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-17T05:52:24.651 INFO:tasks.ceph.ceph_manager.ceph:PG 19.18 is not active+clean 2024-09-17T05:52:24.651 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '19.18', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T05:52:18.873991+0000', 'last_change': '2024-09-17T05:52:18.873991+0000', 'last_active': '2024-09-17T05:52:18.873991+0000', 'last_peered': '2024-09-17T05:52:18.873991+0000', 'last_clean': '2024-09-17T05:52:18.873991+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:52:18.873991+0000', 'last_undegraded': '2024-09-17T05:52:18.873991+0000', 'last_fullsized': '2024-09-17T05:52:18.873991+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:52:18.873991+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:52:18.873991+0000', 'last_clean_scrub_stamp': '2024-09-17T05:52:18.873991+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T05:52:24.651 INFO:tasks.ceph.ceph_manager.ceph:PG 19.19 is not active+clean 2024-09-17T05:52:24.651 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '19.19', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T05:52:18.873991+0000', 'last_change': '2024-09-17T05:52:18.873991+0000', 'last_active': '2024-09-17T05:52:18.873991+0000', 'last_peered': '2024-09-17T05:52:18.873991+0000', 'last_clean': '2024-09-17T05:52:18.873991+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:52:18.873991+0000', 'last_undegraded': '2024-09-17T05:52:18.873991+0000', 'last_fullsized': '2024-09-17T05:52:18.873991+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:52:18.873991+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:52:18.873991+0000', 'last_clean_scrub_stamp': '2024-09-17T05:52:18.873991+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T05:52:24.651 INFO:tasks.ceph.ceph_manager.ceph:PG 18.18 is not active+clean 2024-09-17T05:52:24.651 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '18.18', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 124, 'state': 'creating+peering', 'last_fresh': '2024-09-17T05:52:17.881271+0000', 'last_change': '2024-09-17T05:52:17.881271+0000', 'last_active': '2024-09-17T05:52:17.867506+0000', 'last_peered': '2024-09-17T05:52:17.867506+0000', 'last_clean': '2024-09-17T05:52:17.867506+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:52:17.881271+0000', 'last_undegraded': '2024-09-17T05:52:17.881271+0000', 'last_fullsized': '2024-09-17T05:52:17.881271+0000', 'mapping_epoch': 124, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 124, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:52:17.867506+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:52:17.867506+0000', 'last_clean_scrub_stamp': '2024-09-17T05:52:17.867506+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 6], 'acting': [1, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-17T05:52:24.651 INFO:tasks.ceph.ceph_manager.ceph:PG 19.16 is not active+clean 2024-09-17T05:52:24.651 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '19.16', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T05:52:18.873991+0000', 'last_change': '2024-09-17T05:52:18.873991+0000', 'last_active': '2024-09-17T05:52:18.873991+0000', 'last_peered': '2024-09-17T05:52:18.873991+0000', 'last_clean': '2024-09-17T05:52:18.873991+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:52:18.873991+0000', 'last_undegraded': '2024-09-17T05:52:18.873991+0000', 'last_fullsized': '2024-09-17T05:52:18.873991+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:52:18.873991+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:52:18.873991+0000', 'last_clean_scrub_stamp': '2024-09-17T05:52:18.873991+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T05:52:24.651 INFO:tasks.ceph.ceph_manager.ceph:PG 18.16 is not active+clean 2024-09-17T05:52:24.651 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '18.16', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 124, 'state': 'creating+peering', 'last_fresh': '2024-09-17T05:52:17.880840+0000', 'last_change': '2024-09-17T05:52:17.880840+0000', 'last_active': '2024-09-17T05:52:17.867506+0000', 'last_peered': '2024-09-17T05:52:17.867506+0000', 'last_clean': '2024-09-17T05:52:17.867506+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:52:17.880840+0000', 'last_undegraded': '2024-09-17T05:52:17.880840+0000', 'last_fullsized': '2024-09-17T05:52:17.880840+0000', 'mapping_epoch': 124, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 124, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:52:17.867506+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:52:17.867506+0000', 'last_clean_scrub_stamp': '2024-09-17T05:52:17.867506+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 6], 'acting': [3, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-17T05:52:24.651 INFO:tasks.ceph.ceph_manager.ceph:PG 18.14 is not active+clean 2024-09-17T05:52:24.651 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '18.14', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 124, 'state': 'creating+peering', 'last_fresh': '2024-09-17T05:52:17.882679+0000', 'last_change': '2024-09-17T05:52:17.882679+0000', 'last_active': '2024-09-17T05:52:17.867506+0000', 'last_peered': '2024-09-17T05:52:17.867506+0000', 'last_clean': '2024-09-17T05:52:17.867506+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:52:17.882679+0000', 'last_undegraded': '2024-09-17T05:52:17.882679+0000', 'last_fullsized': '2024-09-17T05:52:17.882679+0000', 'mapping_epoch': 124, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 124, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:52:17.867506+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:52:17.867506+0000', 'last_clean_scrub_stamp': '2024-09-17T05:52:17.867506+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 7], 'acting': [6, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-17T05:52:24.651 INFO:tasks.ceph.ceph_manager.ceph:PG 19.13 is not active+clean 2024-09-17T05:52:24.652 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '19.13', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T05:52:18.873991+0000', 'last_change': '2024-09-17T05:52:18.873991+0000', 'last_active': '2024-09-17T05:52:18.873991+0000', 'last_peered': '2024-09-17T05:52:18.873991+0000', 'last_clean': '2024-09-17T05:52:18.873991+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:52:18.873991+0000', 'last_undegraded': '2024-09-17T05:52:18.873991+0000', 'last_fullsized': '2024-09-17T05:52:18.873991+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:52:18.873991+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:52:18.873991+0000', 'last_clean_scrub_stamp': '2024-09-17T05:52:18.873991+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T05:52:24.652 INFO:tasks.ceph.ceph_manager.ceph:PG 18.12 is not active+clean 2024-09-17T05:52:24.652 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '18.12', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 124, 'state': 'creating+peering', 'last_fresh': '2024-09-17T05:52:17.879821+0000', 'last_change': '2024-09-17T05:52:17.879821+0000', 'last_active': '2024-09-17T05:52:17.867506+0000', 'last_peered': '2024-09-17T05:52:17.867506+0000', 'last_clean': '2024-09-17T05:52:17.867506+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:52:17.879821+0000', 'last_undegraded': '2024-09-17T05:52:17.879821+0000', 'last_fullsized': '2024-09-17T05:52:17.879821+0000', 'mapping_epoch': 124, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 124, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:52:17.867506+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:52:17.867506+0000', 'last_clean_scrub_stamp': '2024-09-17T05:52:17.867506+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 4], 'acting': [2, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-17T05:52:24.652 INFO:tasks.ceph.ceph_manager.ceph:PG 19.10 is not active+clean 2024-09-17T05:52:24.652 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '19.10', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T05:52:18.873991+0000', 'last_change': '2024-09-17T05:52:18.873991+0000', 'last_active': '2024-09-17T05:52:18.873991+0000', 'last_peered': '2024-09-17T05:52:18.873991+0000', 'last_clean': '2024-09-17T05:52:18.873991+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:52:18.873991+0000', 'last_undegraded': '2024-09-17T05:52:18.873991+0000', 'last_fullsized': '2024-09-17T05:52:18.873991+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:52:18.873991+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:52:18.873991+0000', 'last_clean_scrub_stamp': '2024-09-17T05:52:18.873991+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T05:52:24.652 INFO:tasks.ceph.ceph_manager.ceph:PG 18.11 is not active+clean 2024-09-17T05:52:24.652 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '18.11', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 124, 'state': 'creating+peering', 'last_fresh': '2024-09-17T05:52:17.880788+0000', 'last_change': '2024-09-17T05:52:17.880788+0000', 'last_active': '2024-09-17T05:52:17.867506+0000', 'last_peered': '2024-09-17T05:52:17.867506+0000', 'last_clean': '2024-09-17T05:52:17.867506+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:52:17.880788+0000', 'last_undegraded': '2024-09-17T05:52:17.880788+0000', 'last_fullsized': '2024-09-17T05:52:17.880788+0000', 'mapping_epoch': 124, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 124, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:52:17.867506+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:52:17.867506+0000', 'last_clean_scrub_stamp': '2024-09-17T05:52:17.867506+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 7], 'acting': [1, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-17T05:52:24.652 INFO:tasks.ceph.ceph_manager.ceph:PG 19.11 is not active+clean 2024-09-17T05:52:24.652 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '19.11', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T05:52:18.873991+0000', 'last_change': '2024-09-17T05:52:18.873991+0000', 'last_active': '2024-09-17T05:52:18.873991+0000', 'last_peered': '2024-09-17T05:52:18.873991+0000', 'last_clean': '2024-09-17T05:52:18.873991+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:52:18.873991+0000', 'last_undegraded': '2024-09-17T05:52:18.873991+0000', 'last_fullsized': '2024-09-17T05:52:18.873991+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:52:18.873991+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:52:18.873991+0000', 'last_clean_scrub_stamp': '2024-09-17T05:52:18.873991+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T05:52:24.652 INFO:tasks.ceph.ceph_manager.ceph:PG 18.10 is not active+clean 2024-09-17T05:52:24.652 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '18.10', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 124, 'state': 'creating+peering', 'last_fresh': '2024-09-17T05:52:17.882633+0000', 'last_change': '2024-09-17T05:52:17.882633+0000', 'last_active': '2024-09-17T05:52:17.867506+0000', 'last_peered': '2024-09-17T05:52:17.867506+0000', 'last_clean': '2024-09-17T05:52:17.867506+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:52:17.882633+0000', 'last_undegraded': '2024-09-17T05:52:17.882633+0000', 'last_fullsized': '2024-09-17T05:52:17.882633+0000', 'mapping_epoch': 124, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 124, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:52:17.867506+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:52:17.867506+0000', 'last_clean_scrub_stamp': '2024-09-17T05:52:17.867506+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 3], 'acting': [6, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-17T05:52:24.653 INFO:tasks.ceph.ceph_manager.ceph:PG 19.e is not active+clean 2024-09-17T05:52:24.653 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '19.e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T05:52:18.873991+0000', 'last_change': '2024-09-17T05:52:18.873991+0000', 'last_active': '2024-09-17T05:52:18.873991+0000', 'last_peered': '2024-09-17T05:52:18.873991+0000', 'last_clean': '2024-09-17T05:52:18.873991+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:52:18.873991+0000', 'last_undegraded': '2024-09-17T05:52:18.873991+0000', 'last_fullsized': '2024-09-17T05:52:18.873991+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:52:18.873991+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:52:18.873991+0000', 'last_clean_scrub_stamp': '2024-09-17T05:52:18.873991+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T05:52:24.653 INFO:tasks.ceph.ceph_manager.ceph:PG 19.c is not active+clean 2024-09-17T05:52:24.653 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '19.c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T05:52:18.873991+0000', 'last_change': '2024-09-17T05:52:18.873991+0000', 'last_active': '2024-09-17T05:52:18.873991+0000', 'last_peered': '2024-09-17T05:52:18.873991+0000', 'last_clean': '2024-09-17T05:52:18.873991+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:52:18.873991+0000', 'last_undegraded': '2024-09-17T05:52:18.873991+0000', 'last_fullsized': '2024-09-17T05:52:18.873991+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:52:18.873991+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:52:18.873991+0000', 'last_clean_scrub_stamp': '2024-09-17T05:52:18.873991+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T05:52:24.653 INFO:tasks.ceph.ceph_manager.ceph:PG 19.d is not active+clean 2024-09-17T05:52:24.653 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '19.d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T05:52:18.873991+0000', 'last_change': '2024-09-17T05:52:18.873991+0000', 'last_active': '2024-09-17T05:52:18.873991+0000', 'last_peered': '2024-09-17T05:52:18.873991+0000', 'last_clean': '2024-09-17T05:52:18.873991+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:52:18.873991+0000', 'last_undegraded': '2024-09-17T05:52:18.873991+0000', 'last_fullsized': '2024-09-17T05:52:18.873991+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:52:18.873991+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:52:18.873991+0000', 'last_clean_scrub_stamp': '2024-09-17T05:52:18.873991+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T05:52:24.653 INFO:tasks.ceph.ceph_manager.ceph:PG 19.a is not active+clean 2024-09-17T05:52:24.653 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '19.a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T05:52:18.873991+0000', 'last_change': '2024-09-17T05:52:18.873991+0000', 'last_active': '2024-09-17T05:52:18.873991+0000', 'last_peered': '2024-09-17T05:52:18.873991+0000', 'last_clean': '2024-09-17T05:52:18.873991+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:52:18.873991+0000', 'last_undegraded': '2024-09-17T05:52:18.873991+0000', 'last_fullsized': '2024-09-17T05:52:18.873991+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:52:18.873991+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:52:18.873991+0000', 'last_clean_scrub_stamp': '2024-09-17T05:52:18.873991+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T05:52:24.653 INFO:tasks.ceph.ceph_manager.ceph:PG 18.a is not active+clean 2024-09-17T05:52:24.653 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '18.a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 124, 'state': 'creating+peering', 'last_fresh': '2024-09-17T05:52:17.880917+0000', 'last_change': '2024-09-17T05:52:17.880917+0000', 'last_active': '2024-09-17T05:52:17.867506+0000', 'last_peered': '2024-09-17T05:52:17.867506+0000', 'last_clean': '2024-09-17T05:52:17.867506+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:52:17.880917+0000', 'last_undegraded': '2024-09-17T05:52:17.880917+0000', 'last_fullsized': '2024-09-17T05:52:17.880917+0000', 'mapping_epoch': 124, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 124, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:52:17.867506+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:52:17.867506+0000', 'last_clean_scrub_stamp': '2024-09-17T05:52:17.867506+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 6], 'acting': [3, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-17T05:52:24.653 INFO:tasks.ceph.ceph_manager.ceph:PG 19.8 is not active+clean 2024-09-17T05:52:24.654 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '19.8', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T05:52:18.873991+0000', 'last_change': '2024-09-17T05:52:18.873991+0000', 'last_active': '2024-09-17T05:52:18.873991+0000', 'last_peered': '2024-09-17T05:52:18.873991+0000', 'last_clean': '2024-09-17T05:52:18.873991+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:52:18.873991+0000', 'last_undegraded': '2024-09-17T05:52:18.873991+0000', 'last_fullsized': '2024-09-17T05:52:18.873991+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:52:18.873991+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:52:18.873991+0000', 'last_clean_scrub_stamp': '2024-09-17T05:52:18.873991+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T05:52:24.654 INFO:tasks.ceph.ceph_manager.ceph:PG 18.9 is not active+clean 2024-09-17T05:52:24.654 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '18.9', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 124, 'state': 'creating+peering', 'last_fresh': '2024-09-17T05:52:17.881742+0000', 'last_change': '2024-09-17T05:52:17.881742+0000', 'last_active': '2024-09-17T05:52:17.867506+0000', 'last_peered': '2024-09-17T05:52:17.867506+0000', 'last_clean': '2024-09-17T05:52:17.867506+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:52:17.881742+0000', 'last_undegraded': '2024-09-17T05:52:17.881742+0000', 'last_fullsized': '2024-09-17T05:52:17.881742+0000', 'mapping_epoch': 124, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 124, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:52:17.867506+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:52:17.867506+0000', 'last_clean_scrub_stamp': '2024-09-17T05:52:17.867506+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 5], 'acting': [3, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-17T05:52:24.654 INFO:tasks.ceph.ceph_manager.ceph:PG 18.7 is not active+clean 2024-09-17T05:52:24.654 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '18.7', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 124, 'state': 'creating+peering', 'last_fresh': '2024-09-17T05:52:17.879834+0000', 'last_change': '2024-09-17T05:52:17.879834+0000', 'last_active': '2024-09-17T05:52:17.867506+0000', 'last_peered': '2024-09-17T05:52:17.867506+0000', 'last_clean': '2024-09-17T05:52:17.867506+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:52:17.879834+0000', 'last_undegraded': '2024-09-17T05:52:17.879834+0000', 'last_fullsized': '2024-09-17T05:52:17.879834+0000', 'mapping_epoch': 124, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 124, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:52:17.867506+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:52:17.867506+0000', 'last_clean_scrub_stamp': '2024-09-17T05:52:17.867506+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 5], 'acting': [2, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-17T05:52:24.654 INFO:tasks.ceph.ceph_manager.ceph:PG 19.7 is not active+clean 2024-09-17T05:52:24.654 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '19.7', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T05:52:18.873991+0000', 'last_change': '2024-09-17T05:52:18.873991+0000', 'last_active': '2024-09-17T05:52:18.873991+0000', 'last_peered': '2024-09-17T05:52:18.873991+0000', 'last_clean': '2024-09-17T05:52:18.873991+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:52:18.873991+0000', 'last_undegraded': '2024-09-17T05:52:18.873991+0000', 'last_fullsized': '2024-09-17T05:52:18.873991+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:52:18.873991+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:52:18.873991+0000', 'last_clean_scrub_stamp': '2024-09-17T05:52:18.873991+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T05:52:24.654 INFO:tasks.ceph.ceph_manager.ceph:PG 19.4 is not active+clean 2024-09-17T05:52:24.654 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '19.4', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T05:52:18.873991+0000', 'last_change': '2024-09-17T05:52:18.873991+0000', 'last_active': '2024-09-17T05:52:18.873991+0000', 'last_peered': '2024-09-17T05:52:18.873991+0000', 'last_clean': '2024-09-17T05:52:18.873991+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:52:18.873991+0000', 'last_undegraded': '2024-09-17T05:52:18.873991+0000', 'last_fullsized': '2024-09-17T05:52:18.873991+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:52:18.873991+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:52:18.873991+0000', 'last_clean_scrub_stamp': '2024-09-17T05:52:18.873991+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T05:52:24.654 INFO:tasks.ceph.ceph_manager.ceph:PG 18.5 is not active+clean 2024-09-17T05:52:24.654 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '18.5', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 124, 'state': 'creating+peering', 'last_fresh': '2024-09-17T05:52:17.882208+0000', 'last_change': '2024-09-17T05:52:17.882208+0000', 'last_active': '2024-09-17T05:52:17.867506+0000', 'last_peered': '2024-09-17T05:52:17.867506+0000', 'last_clean': '2024-09-17T05:52:17.867506+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:52:17.882208+0000', 'last_undegraded': '2024-09-17T05:52:17.882208+0000', 'last_fullsized': '2024-09-17T05:52:17.882208+0000', 'mapping_epoch': 124, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 124, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:52:17.867506+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:52:17.867506+0000', 'last_clean_scrub_stamp': '2024-09-17T05:52:17.867506+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 6], 'acting': [1, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-17T05:52:24.655 INFO:tasks.ceph.ceph_manager.ceph:PG 18.3 is not active+clean 2024-09-17T05:52:24.655 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '18.3', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 124, 'state': 'creating+peering', 'last_fresh': '2024-09-17T05:52:17.880787+0000', 'last_change': '2024-09-17T05:52:17.880787+0000', 'last_active': '2024-09-17T05:52:17.867506+0000', 'last_peered': '2024-09-17T05:52:17.867506+0000', 'last_clean': '2024-09-17T05:52:17.867506+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:52:17.880787+0000', 'last_undegraded': '2024-09-17T05:52:17.880787+0000', 'last_fullsized': '2024-09-17T05:52:17.880787+0000', 'mapping_epoch': 124, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 124, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:52:17.867506+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:52:17.867506+0000', 'last_clean_scrub_stamp': '2024-09-17T05:52:17.867506+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 7], 'acting': [1, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-17T05:52:24.655 INFO:tasks.ceph.ceph_manager.ceph:PG 19.0 is not active+clean 2024-09-17T05:52:24.655 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '19.0', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T05:52:18.873991+0000', 'last_change': '2024-09-17T05:52:18.873991+0000', 'last_active': '2024-09-17T05:52:18.873991+0000', 'last_peered': '2024-09-17T05:52:18.873991+0000', 'last_clean': '2024-09-17T05:52:18.873991+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:52:18.873991+0000', 'last_undegraded': '2024-09-17T05:52:18.873991+0000', 'last_fullsized': '2024-09-17T05:52:18.873991+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:52:18.873991+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:52:18.873991+0000', 'last_clean_scrub_stamp': '2024-09-17T05:52:18.873991+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T05:52:24.655 INFO:tasks.ceph.ceph_manager.ceph:PG 18.1 is not active+clean 2024-09-17T05:52:24.655 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '18.1', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 124, 'state': 'creating+peering', 'last_fresh': '2024-09-17T05:52:17.880828+0000', 'last_change': '2024-09-17T05:52:17.880828+0000', 'last_active': '2024-09-17T05:52:17.867506+0000', 'last_peered': '2024-09-17T05:52:17.867506+0000', 'last_clean': '2024-09-17T05:52:17.867506+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:52:17.880828+0000', 'last_undegraded': '2024-09-17T05:52:17.880828+0000', 'last_fullsized': '2024-09-17T05:52:17.880828+0000', 'mapping_epoch': 124, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 124, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:52:17.867506+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:52:17.867506+0000', 'last_clean_scrub_stamp': '2024-09-17T05:52:17.867506+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 6], 'acting': [3, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-17T05:52:24.655 INFO:tasks.ceph.ceph_manager.ceph:PG 19.1 is not active+clean 2024-09-17T05:52:24.655 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '19.1', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T05:52:18.873991+0000', 'last_change': '2024-09-17T05:52:18.873991+0000', 'last_active': '2024-09-17T05:52:18.873991+0000', 'last_peered': '2024-09-17T05:52:18.873991+0000', 'last_clean': '2024-09-17T05:52:18.873991+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:52:18.873991+0000', 'last_undegraded': '2024-09-17T05:52:18.873991+0000', 'last_fullsized': '2024-09-17T05:52:18.873991+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:52:18.873991+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:52:18.873991+0000', 'last_clean_scrub_stamp': '2024-09-17T05:52:18.873991+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T05:52:24.656 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-09-17T05:52:24.792 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:24.790+0000 7f056ce71640 1 -- 172.21.15.150:0/3018402545 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f05680aebc0 msgr2=0x7f0568152920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:52:24.792 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:24.790+0000 7f056ce71640 1 --2- 172.21.15.150:0/3018402545 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f05680aebc0 0x7f0568152920 secure :-1 s=READY pgs=1688 cs=0 l=1 rev1=1 crypto rx=0x7f05680b3230 tx=0x7f055802a4d0 comp rx=0 tx=0).stop 2024-09-17T05:52:24.792 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:24.790+0000 7f056ce71640 1 -- 172.21.15.150:0/3018402545 shutdown_connections 2024-09-17T05:52:24.792 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:24.790+0000 7f056ce71640 1 --2- 172.21.15.150:0/3018402545 >> v2:172.21.15.176:3300/0 conn(0x7f056815f910 0x7f056815bd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:52:24.792 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:24.790+0000 7f056ce71640 1 --2- 172.21.15.150:0/3018402545 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f05680b2750 0x7f056815f3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:52:24.792 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:24.790+0000 7f056ce71640 1 --2- 172.21.15.150:0/3018402545 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f05680aebc0 0x7f0568152920 unknown :-1 s=CLOSED pgs=1688 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:52:24.792 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:24.790+0000 7f056ce71640 1 -- 172.21.15.150:0/3018402545 >> 172.21.15.150:0/3018402545 conn(0x7f056806d730 msgr2=0x7f05680b1e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:52:24.792 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:24.790+0000 7f056ce71640 1 -- 172.21.15.150:0/3018402545 shutdown_connections 2024-09-17T05:52:24.792 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:24.790+0000 7f056ce71640 1 -- 172.21.15.150:0/3018402545 wait complete. 2024-09-17T05:52:24.793 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:24.792+0000 7f056ce71640 1 Processor -- start 2024-09-17T05:52:24.793 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:24.792+0000 7f056ce71640 1 -- start start 2024-09-17T05:52:24.796 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:24.793+0000 7f056ce71640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f05680aebc0 0x7f05680caee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:52:24.796 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:24.793+0000 7f056ce71640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f05680b2750 0x7f05680cca70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:52:24.797 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:24.793+0000 7f056ce71640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f056815f910 0x7f05680ccfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:52:24.797 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:24.793+0000 7f056ce71640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f056815c660 con 0x7f05680b2750 2024-09-17T05:52:24.797 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:24.793+0000 7f056ce71640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f056815c4e0 con 0x7f056815f910 2024-09-17T05:52:24.797 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:24.793+0000 7f056ce71640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f056815c7e0 con 0x7f05680aebc0 2024-09-17T05:52:24.797 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:24.793+0000 7f055dd9b640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f05680b2750 0x7f05680cca70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:52:24.797 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:24.793+0000 7f055dd9b640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f05680b2750 0x7f05680cca70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:35782/0 (socket says 172.21.15.150:35782) 2024-09-17T05:52:24.797 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:24.793+0000 7f055dd9b640 1 -- 172.21.15.150:0/3850142711 learned_addr learned my addr 172.21.15.150:0/3850142711 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:52:24.797 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:24.793+0000 7f0566d9d640 1 --2- 172.21.15.150:0/3850142711 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f056815f910 0x7f05680ccfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:52:24.797 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:24.793+0000 7f056659c640 1 --2- 172.21.15.150:0/3850142711 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f05680aebc0 0x7f05680caee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:52:24.797 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:24.794+0000 7f055dd9b640 1 -- 172.21.15.150:0/3850142711 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f05680aebc0 msgr2=0x7f05680caee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:52:24.797 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:24.794+0000 7f055dd9b640 1 --2- 172.21.15.150:0/3850142711 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f05680aebc0 0x7f05680caee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:52:24.797 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:24.794+0000 7f055dd9b640 1 -- 172.21.15.150:0/3850142711 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f056815f910 msgr2=0x7f05680ccfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:52:24.797 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:24.794+0000 7f055dd9b640 1 --2- 172.21.15.150:0/3850142711 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f056815f910 0x7f05680ccfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:52:24.798 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:24.794+0000 7f055dd9b640 1 -- 172.21.15.150:0/3850142711 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f05680ca120 con 0x7f05680b2750 2024-09-17T05:52:24.798 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:24.794+0000 7f055dd9b640 1 --2- 172.21.15.150:0/3850142711 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f05680b2750 0x7f05680cca70 secure :-1 s=READY pgs=1689 cs=0 l=1 rev1=1 crypto rx=0x7f055000b410 tx=0x7f055000b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:52:24.798 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:24.794+0000 7f055f7fe640 1 -- 172.21.15.150:0/3850142711 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0550015020 con 0x7f05680b2750 2024-09-17T05:52:24.798 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:24.794+0000 7f056ce71640 1 -- 172.21.15.150:0/3850142711 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f05680ca400 con 0x7f05680b2750 2024-09-17T05:52:24.798 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:24.794+0000 7f055f7fe640 1 -- 172.21.15.150:0/3850142711 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0550011940 con 0x7f05680b2750 2024-09-17T05:52:24.798 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:24.794+0000 7f055f7fe640 1 -- 172.21.15.150:0/3850142711 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0550011d90 con 0x7f05680b2750 2024-09-17T05:52:24.798 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:24.794+0000 7f056ce71640 1 -- 172.21.15.150:0/3850142711 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f05680ca9c0 con 0x7f05680b2750 2024-09-17T05:52:24.798 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:24.795+0000 7f056ce71640 1 -- 172.21.15.150:0/3850142711 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f056815f3d0 con 0x7f05680b2750 2024-09-17T05:52:24.799 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:24.796+0000 7f055f7fe640 1 -- 172.21.15.150:0/3850142711 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 42) ==== 104195+0+0 (secure 0 0 0) 0x7f0550018020 con 0x7f05680b2750 2024-09-17T05:52:24.799 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:24.796+0000 7f055f7fe640 1 --2- 172.21.15.150:0/3850142711 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f054807a9f0 0x7f054807cf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:52:24.799 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:24.796+0000 7f055f7fe640 1 -- 172.21.15.150:0/3850142711 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(127..127 src has 1..127) ==== 5877+0+0 (secure 0 0 0) 0x7f0550099bf0 con 0x7f05680b2750 2024-09-17T05:52:24.799 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:24.797+0000 7f056659c640 1 --2- 172.21.15.150:0/3850142711 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f054807a9f0 0x7f054807cf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:52:24.799 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:24.797+0000 7f056659c640 1 --2- 172.21.15.150:0/3850142711 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f054807a9f0 0x7f054807cf00 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 crypto rx=0x7f0558033000 tx=0x7f0558004730 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:52:24.802 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:24.801+0000 7f055f7fe640 1 -- 172.21.15.150:0/3850142711 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f055001f020 con 0x7f05680b2750 2024-09-17T05:52:25.050 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:25.048+0000 7f056ce71640 1 -- 172.21.15.150:0/3850142711 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) -- 0x7f056814e800 con 0x7f05680b2750 2024-09-17T05:52:25.050 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:25.049+0000 7f055f7fe640 1 -- 172.21.15.150:0/3850142711 <== mon.0 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) ==== 72+0+1381 (secure 0 0 0) 0x7f0550063460 con 0x7f05680b2750 2024-09-17T05:52:25.051 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-09-17T05:52:25.051 INFO:teuthology.orchestra.run.smithi150.stdout:{"fsid":"9f2e05e9-d629-47b3-b26b-1360655b7d20","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":652,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":127,"num_osds":8,"num_up_osds":8,"osd_up_since":1726551706,"num_in_osds":8,"osd_in_since":1726551696,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":40},{"state_name":"unknown","count":38},{"state_name":"creating+peering","count":19}],"num_pgs":97,"num_pools":3,"num_objects":12,"data_bytes":591166,"bytes_used":1071833088,"bytes_avail":772022280192,"bytes_total":773094113280,"unknown_pgs_ratio":0.39175257086753845,"inactive_pgs_ratio":0.19587628543376923,"write_bytes_sec":2164,"read_op_per_sec":0,"write_op_per_sec":2},"fsmap":{"epoch":80,"btime":"2024-09-17T05:52:22:919504+0000","id":9,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":9,"rank":0,"name":"d","status":"up:active","gid":9141}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":18,"modified":"2024-09-17T05:52:13.076074+0000","services":{"mds":{"daemons":{"summary":"","c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2024-09-17T05:52:25.053 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:25.051+0000 7f056ce71640 1 -- 172.21.15.150:0/3850142711 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f054807a9f0 msgr2=0x7f054807cf00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:52:25.053 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:25.051+0000 7f056ce71640 1 --2- 172.21.15.150:0/3850142711 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f054807a9f0 0x7f054807cf00 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 crypto rx=0x7f0558033000 tx=0x7f0558004730 comp rx=0 tx=0).stop 2024-09-17T05:52:25.053 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:25.051+0000 7f056ce71640 1 -- 172.21.15.150:0/3850142711 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f05680b2750 msgr2=0x7f05680cca70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:52:25.053 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:25.051+0000 7f056ce71640 1 --2- 172.21.15.150:0/3850142711 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f05680b2750 0x7f05680cca70 secure :-1 s=READY pgs=1689 cs=0 l=1 rev1=1 crypto rx=0x7f055000b410 tx=0x7f055000b8d0 comp rx=0 tx=0).stop 2024-09-17T05:52:25.053 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:25.051+0000 7f056ce71640 1 -- 172.21.15.150:0/3850142711 shutdown_connections 2024-09-17T05:52:25.054 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:25.051+0000 7f056ce71640 1 --2- 172.21.15.150:0/3850142711 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f056815f910 0x7f05680ccfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:52:25.054 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:25.051+0000 7f056ce71640 1 --2- 172.21.15.150:0/3850142711 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f054807a9f0 0x7f054807cf00 unknown :-1 s=CLOSED pgs=717 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:52:25.054 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:25.051+0000 7f056ce71640 1 --2- 172.21.15.150:0/3850142711 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f05680b2750 0x7f05680cca70 unknown :-1 s=CLOSED pgs=1689 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:52:25.054 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:25.051+0000 7f056ce71640 1 --2- 172.21.15.150:0/3850142711 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f05680aebc0 0x7f05680caee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:52:25.054 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:25.051+0000 7f056ce71640 1 -- 172.21.15.150:0/3850142711 >> 172.21.15.150:0/3850142711 conn(0x7f056806d730 msgr2=0x7f0568151ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:52:25.054 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:25.051+0000 7f056ce71640 1 -- 172.21.15.150:0/3850142711 shutdown_connections 2024-09-17T05:52:25.054 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:25.051+0000 7f056ce71640 1 -- 172.21.15.150:0/3850142711 wait complete. 2024-09-17T05:52:25.065 INFO:tasks.ceph.ceph_manager.ceph:no progress seen, keeping timeout for now 2024-09-17T05:52:25.065 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-17T05:52:25.180 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:25.178+0000 7f270bfba640 1 -- 172.21.15.150:0/1236300632 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f270409ba60 msgr2=0x7f27040b7330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:52:25.181 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:25.178+0000 7f270bfba640 1 --2- 172.21.15.150:0/1236300632 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f270409ba60 0x7f27040b7330 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7f2700009820 tx=0x7f270002a510 comp rx=0 tx=0).stop 2024-09-17T05:52:25.181 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:25.178+0000 7f270bfba640 1 -- 172.21.15.150:0/1236300632 shutdown_connections 2024-09-17T05:52:25.181 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:25.178+0000 7f270bfba640 1 --2- 172.21.15.150:0/1236300632 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f27040cd440 0x7f27040cd850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:52:25.181 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:25.178+0000 7f270bfba640 1 --2- 172.21.15.150:0/1236300632 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f270409ba60 0x7f27040b7330 unknown :-1 s=CLOSED pgs=572 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:52:25.181 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:25.178+0000 7f270bfba640 1 -- 172.21.15.150:0/1236300632 >> 172.21.15.150:0/1236300632 conn(0x7f27040cee90 msgr2=0x7f27040cf2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:52:25.181 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:25.179+0000 7f270bfba640 1 -- 172.21.15.150:0/1236300632 shutdown_connections 2024-09-17T05:52:25.181 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:25.179+0000 7f270bfba640 1 -- 172.21.15.150:0/1236300632 wait complete. 2024-09-17T05:52:25.182 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:25.180+0000 7f270bfba640 1 Processor -- start 2024-09-17T05:52:25.182 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:25.180+0000 7f270bfba640 1 -- start start 2024-09-17T05:52:25.184 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:25.182+0000 7f270bfba640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f270409ba60 0x7f27040b5420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:52:25.184 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:25.182+0000 7f270bfba640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f27040cd440 0x7f27040b2750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:52:25.185 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:25.182+0000 7f270bfba640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f27040cffe0 0x7f27040b2c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:52:25.185 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:25.182+0000 7f270bfba640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f27040d0e90 con 0x7f27040cd440 2024-09-17T05:52:25.185 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:25.182+0000 7f270bfba640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f27040d0d10 con 0x7f27040cffe0 2024-09-17T05:52:25.185 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:25.182+0000 7f270bfba640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f27041670e0 con 0x7f270409ba60 2024-09-17T05:52:25.185 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:25.182+0000 7f2709555640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f27040cd440 0x7f27040b2750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:52:25.185 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:25.182+0000 7f2709555640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f27040cd440 0x7f27040b2750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:35794/0 (socket says 172.21.15.150:35794) 2024-09-17T05:52:25.185 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:25.182+0000 7f2709555640 1 -- 172.21.15.150:0/1752840553 learned_addr learned my addr 172.21.15.150:0/1752840553 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:52:25.185 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:25.182+0000 7f270a557640 1 --2- 172.21.15.150:0/1752840553 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f27040cffe0 0x7f27040b2c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:52:25.185 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:25.182+0000 7f2709d56640 1 --2- 172.21.15.150:0/1752840553 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f270409ba60 0x7f27040b5420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:52:25.185 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:25.182+0000 7f2709555640 1 -- 172.21.15.150:0/1752840553 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f270409ba60 msgr2=0x7f27040b5420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:52:25.185 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:25.182+0000 7f2709555640 1 --2- 172.21.15.150:0/1752840553 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f270409ba60 0x7f27040b5420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:52:25.185 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:25.182+0000 7f2709555640 1 -- 172.21.15.150:0/1752840553 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f27040cffe0 msgr2=0x7f27040b2c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:52:25.185 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:25.182+0000 7f2709555640 1 --2- 172.21.15.150:0/1752840553 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f27040cffe0 0x7f27040b2c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:52:25.186 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:25.182+0000 7f2709555640 1 -- 172.21.15.150:0/1752840553 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f27040b02b0 con 0x7f27040cd440 2024-09-17T05:52:25.186 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:25.182+0000 7f2709555640 1 --2- 172.21.15.150:0/1752840553 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f27040cd440 0x7f27040b2750 secure :-1 s=READY pgs=1690 cs=0 l=1 rev1=1 crypto rx=0x7f26f400e9c0 tx=0x7f26f400ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:52:25.186 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:25.182+0000 7f26fa7fc640 1 -- 172.21.15.150:0/1752840553 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26f400ccc0 con 0x7f27040cd440 2024-09-17T05:52:25.186 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:25.182+0000 7f270bfba640 1 -- 172.21.15.150:0/1752840553 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f27040b0590 con 0x7f27040cd440 2024-09-17T05:52:25.186 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:25.182+0000 7f26fa7fc640 1 -- 172.21.15.150:0/1752840553 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f26f4010430 con 0x7f27040cd440 2024-09-17T05:52:25.186 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:25.183+0000 7f26fa7fc640 1 -- 172.21.15.150:0/1752840553 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26f4010880 con 0x7f27040cd440 2024-09-17T05:52:25.186 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:25.183+0000 7f270bfba640 1 -- 172.21.15.150:0/1752840553 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f27040b2250 con 0x7f27040cd440 2024-09-17T05:52:25.187 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:25.183+0000 7f270bfba640 1 -- 172.21.15.150:0/1752840553 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f27040b7330 con 0x7f27040cd440 2024-09-17T05:52:25.187 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:25.184+0000 7f26fa7fc640 1 -- 172.21.15.150:0/1752840553 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 42) ==== 104195+0+0 (secure 0 0 0) 0x7f26f4009310 con 0x7f27040cd440 2024-09-17T05:52:25.187 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:25.185+0000 7f26fa7fc640 1 --2- 172.21.15.150:0/1752840553 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f26e807a9f0 0x7f26e807cf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:52:25.187 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:25.185+0000 7f26fa7fc640 1 -- 172.21.15.150:0/1752840553 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(127..127 src has 1..127) ==== 5877+0+0 (secure 0 0 0) 0x7f26f409a820 con 0x7f27040cd440 2024-09-17T05:52:25.187 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:25.185+0000 7f2709d56640 1 --2- 172.21.15.150:0/1752840553 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f26e807a9f0 0x7f26e807cf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:52:25.187 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:25.186+0000 7f2709d56640 1 --2- 172.21.15.150:0/1752840553 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f26e807a9f0 0x7f26e807cf00 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 crypto rx=0x7f2700034000 tx=0x7f2700004730 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:52:25.191 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:25.189+0000 7f26fa7fc640 1 -- 172.21.15.150:0/1752840553 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f26f4064770 con 0x7f27040cd440 2024-09-17T05:52:25.361 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:25.360+0000 7f270bfba640 1 -- 172.21.15.150:0/1752840553 --> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f27040b1db0 con 0x7f26e807a9f0 2024-09-17T05:52:25.366 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:25.365+0000 7f26fa7fc640 1 -- 172.21.15.150:0/1752840553 <== mgr.4108 v2:172.21.15.176:6800/3631216395 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+252498 (secure 0 0 0) 0x7f2700005350 con 0x7f26e807a9f0 2024-09-17T05:52:25.369 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-09-17T05:52:25.370 INFO:teuthology.orchestra.run.smithi150.stderr:dumped all 2024-09-17T05:52:25.372 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:25.368+0000 7f270bfba640 1 -- 172.21.15.150:0/1752840553 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f26e807a9f0 msgr2=0x7f26e807cf00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:52:25.372 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:25.368+0000 7f270bfba640 1 --2- 172.21.15.150:0/1752840553 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f26e807a9f0 0x7f26e807cf00 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 crypto rx=0x7f2700034000 tx=0x7f2700004730 comp rx=0 tx=0).stop 2024-09-17T05:52:25.372 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:25.368+0000 7f270bfba640 1 -- 172.21.15.150:0/1752840553 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f27040cd440 msgr2=0x7f27040b2750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:52:25.373 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:25.368+0000 7f270bfba640 1 --2- 172.21.15.150:0/1752840553 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f27040cd440 0x7f27040b2750 secure :-1 s=READY pgs=1690 cs=0 l=1 rev1=1 crypto rx=0x7f26f400e9c0 tx=0x7f26f400ee80 comp rx=0 tx=0).stop 2024-09-17T05:52:25.373 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:25.368+0000 7f270bfba640 1 -- 172.21.15.150:0/1752840553 shutdown_connections 2024-09-17T05:52:25.373 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:25.368+0000 7f270bfba640 1 --2- 172.21.15.150:0/1752840553 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f27040cffe0 0x7f27040b2c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:52:25.373 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:25.368+0000 7f270bfba640 1 --2- 172.21.15.150:0/1752840553 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f26e807a9f0 0x7f26e807cf00 unknown :-1 s=CLOSED pgs=718 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:52:25.373 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:25.368+0000 7f270bfba640 1 --2- 172.21.15.150:0/1752840553 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f27040cd440 0x7f27040b2750 unknown :-1 s=CLOSED pgs=1690 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:52:25.373 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:25.368+0000 7f270bfba640 1 --2- 172.21.15.150:0/1752840553 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f270409ba60 0x7f27040b5420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:52:25.373 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:25.368+0000 7f270bfba640 1 -- 172.21.15.150:0/1752840553 >> 172.21.15.150:0/1752840553 conn(0x7f27040cee90 msgr2=0x7f27040d03f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:52:25.373 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:25.368+0000 7f270bfba640 1 -- 172.21.15.150:0/1752840553 shutdown_connections 2024-09-17T05:52:25.373 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:25.368+0000 7f270bfba640 1 -- 172.21.15.150:0/1752840553 wait complete. 2024-09-17T05:52:25.381 INFO:teuthology.orchestra.run.smithi150.stdout:{"pg_ready":true,"pg_map":{"version":441,"stamp":"2024-09-17T05:52:25.079012+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":146,"num_write_kb":1642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":111,"ondisk_log_size":111,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":159,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":1046948,"kb_used_data":13544,"kb_used_omap":12,"kb_used_meta":1033203,"kb_avail":753927772,"statfs":{"total":773094113280,"available":772022038528,"internally_reserved":0,"allocated":13869056,"data_stored":6729396,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":1058000432},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":20,"apply_latency_ms":20,"commit_latency_ns":20000000,"apply_latency_ns":20000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.200540"},"pg_stats":[{"pgid":"19.3f","version":"0'0","reported_seq":13,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-09-17T05:52:20.898770+0000","last_change":"2024-09-17T05:52:19.927176+0000","last_active":"2024-09-17T05:52:20.898770+0000","last_peered":"2024-09-17T05:52:20.898770+0000","last_clean":"2024-09-17T05:52:20.898770+0000","last_became_active":"2024-09-17T05:52:19.926840+0000","last_became_peered":"2024-09-17T05:52:19.926840+0000","last_unstale":"2024-09-17T05:52:20.898770+0000","last_undegraded":"2024-09-17T05:52:20.898770+0000","last_fullsized":"2024-09-17T05:52:20.898770+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:52:18.873991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:52:18.873991+0000","last_clean_scrub_stamp":"2024-09-17T05:52:18.873991+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:12:58.391192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.3e","version":"0'0","reported_seq":13,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-09-17T05:52:20.900233+0000","last_change":"2024-09-17T05:52:19.927167+0000","last_active":"2024-09-17T05:52:20.900233+0000","last_peered":"2024-09-17T05:52:20.900233+0000","last_clean":"2024-09-17T05:52:20.900233+0000","last_became_active":"2024-09-17T05:52:19.926290+0000","last_became_peered":"2024-09-17T05:52:19.926290+0000","last_unstale":"2024-09-17T05:52:20.900233+0000","last_undegraded":"2024-09-17T05:52:20.900233+0000","last_fullsized":"2024-09-17T05:52:20.900233+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:52:18.873991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:52:18.873991+0000","last_clean_scrub_stamp":"2024-09-17T05:52:18.873991+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:23:29.627779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.3d","version":"0'0","reported_seq":13,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-09-17T05:52:20.897935+0000","last_change":"2024-09-17T05:52:19.904747+0000","last_active":"2024-09-17T05:52:20.897935+0000","last_peered":"2024-09-17T05:52:20.897935+0000","last_clean":"2024-09-17T05:52:20.897935+0000","last_became_active":"2024-09-17T05:52:19.904370+0000","last_became_peered":"2024-09-17T05:52:19.904370+0000","last_unstale":"2024-09-17T05:52:20.897935+0000","last_undegraded":"2024-09-17T05:52:20.897935+0000","last_fullsized":"2024-09-17T05:52:20.897935+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:52:18.873991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:52:18.873991+0000","last_clean_scrub_stamp":"2024-09-17T05:52:18.873991+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:53:12.769720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.3c","version":"0'0","reported_seq":13,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-09-17T05:52:20.898737+0000","last_change":"2024-09-17T05:52:19.916037+0000","last_active":"2024-09-17T05:52:20.898737+0000","last_peered":"2024-09-17T05:52:20.898737+0000","last_clean":"2024-09-17T05:52:20.898737+0000","last_became_active":"2024-09-17T05:52:19.915727+0000","last_became_peered":"2024-09-17T05:52:19.915727+0000","last_unstale":"2024-09-17T05:52:20.898737+0000","last_undegraded":"2024-09-17T05:52:20.898737+0000","last_fullsized":"2024-09-17T05:52:20.898737+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:52:18.873991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:52:18.873991+0000","last_clean_scrub_stamp":"2024-09-17T05:52:18.873991+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:06:50.202820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.3b","version":"0'0","reported_seq":13,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-09-17T05:52:20.913430+0000","last_change":"2024-09-17T05:52:19.923296+0000","last_active":"2024-09-17T05:52:20.913430+0000","last_peered":"2024-09-17T05:52:20.913430+0000","last_clean":"2024-09-17T05:52:20.913430+0000","last_became_active":"2024-09-17T05:52:19.922558+0000","last_became_peered":"2024-09-17T05:52:19.922558+0000","last_unstale":"2024-09-17T05:52:20.913430+0000","last_undegraded":"2024-09-17T05:52:20.913430+0000","last_fullsized":"2024-09-17T05:52:20.913430+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:52:18.873991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:52:18.873991+0000","last_clean_scrub_stamp":"2024-09-17T05:52:18.873991+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:14:31.803577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.3a","version":"0'0","reported_seq":13,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-09-17T05:52:20.916572+0000","last_change":"2024-09-17T05:52:19.921204+0000","last_active":"2024-09-17T05:52:20.916572+0000","last_peered":"2024-09-17T05:52:20.916572+0000","last_clean":"2024-09-17T05:52:20.916572+0000","last_became_active":"2024-09-17T05:52:19.920892+0000","last_became_peered":"2024-09-17T05:52:19.920892+0000","last_unstale":"2024-09-17T05:52:20.916572+0000","last_undegraded":"2024-09-17T05:52:20.916572+0000","last_fullsized":"2024-09-17T05:52:20.916572+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:52:18.873991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:52:18.873991+0000","last_clean_scrub_stamp":"2024-09-17T05:52:18.873991+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:03:02.474723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.39","version":"0'0","reported_seq":13,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-09-17T05:52:20.915990+0000","last_change":"2024-09-17T05:52:19.926803+0000","last_active":"2024-09-17T05:52:20.915990+0000","last_peered":"2024-09-17T05:52:20.915990+0000","last_clean":"2024-09-17T05:52:20.915990+0000","last_became_active":"2024-09-17T05:52:19.926478+0000","last_became_peered":"2024-09-17T05:52:19.926478+0000","last_unstale":"2024-09-17T05:52:20.915990+0000","last_undegraded":"2024-09-17T05:52:20.915990+0000","last_fullsized":"2024-09-17T05:52:20.915990+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:52:18.873991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:52:18.873991+0000","last_clean_scrub_stamp":"2024-09-17T05:52:18.873991+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:48:46.344445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.38","version":"0'0","reported_seq":13,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-09-17T05:52:20.897488+0000","last_change":"2024-09-17T05:52:19.902333+0000","last_active":"2024-09-17T05:52:20.897488+0000","last_peered":"2024-09-17T05:52:20.897488+0000","last_clean":"2024-09-17T05:52:20.897488+0000","last_became_active":"2024-09-17T05:52:19.901948+0000","last_became_peered":"2024-09-17T05:52:19.901948+0000","last_unstale":"2024-09-17T05:52:20.897488+0000","last_undegraded":"2024-09-17T05:52:20.897488+0000","last_fullsized":"2024-09-17T05:52:20.897488+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:52:18.873991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:52:18.873991+0000","last_clean_scrub_stamp":"2024-09-17T05:52:18.873991+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:54:00.232524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.37","version":"0'0","reported_seq":13,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-09-17T05:52:20.898104+0000","last_change":"2024-09-17T05:52:19.928374+0000","last_active":"2024-09-17T05:52:20.898104+0000","last_peered":"2024-09-17T05:52:20.898104+0000","last_clean":"2024-09-17T05:52:20.898104+0000","last_became_active":"2024-09-17T05:52:19.927908+0000","last_became_peered":"2024-09-17T05:52:19.927908+0000","last_unstale":"2024-09-17T05:52:20.898104+0000","last_undegraded":"2024-09-17T05:52:20.898104+0000","last_fullsized":"2024-09-17T05:52:20.898104+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:52:18.873991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:52:18.873991+0000","last_clean_scrub_stamp":"2024-09-17T05:52:18.873991+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:26:19.092447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.36","version":"0'0","reported_seq":13,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-09-17T05:52:20.900177+0000","last_change":"2024-09-17T05:52:19.927798+0000","last_active":"2024-09-17T05:52:20.900177+0000","last_peered":"2024-09-17T05:52:20.900177+0000","last_clean":"2024-09-17T05:52:20.900177+0000","last_became_active":"2024-09-17T05:52:19.926257+0000","last_became_peered":"2024-09-17T05:52:19.926257+0000","last_unstale":"2024-09-17T05:52:20.900177+0000","last_undegraded":"2024-09-17T05:52:20.900177+0000","last_fullsized":"2024-09-17T05:52:20.900177+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:52:18.873991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:52:18.873991+0000","last_clean_scrub_stamp":"2024-09-17T05:52:18.873991+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:03:47.491680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.35","version":"0'0","reported_seq":13,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-09-17T05:52:21.029855+0000","last_change":"2024-09-17T05:52:19.905906+0000","last_active":"2024-09-17T05:52:21.029855+0000","last_peered":"2024-09-17T05:52:21.029855+0000","last_clean":"2024-09-17T05:52:21.029855+0000","last_became_active":"2024-09-17T05:52:19.905185+0000","last_became_peered":"2024-09-17T05:52:19.905185+0000","last_unstale":"2024-09-17T05:52:21.029855+0000","last_undegraded":"2024-09-17T05:52:21.029855+0000","last_fullsized":"2024-09-17T05:52:21.029855+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:52:18.873991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:52:18.873991+0000","last_clean_scrub_stamp":"2024-09-17T05:52:18.873991+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:42:59.395568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.34","version":"0'0","reported_seq":13,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-09-17T05:52:20.897596+0000","last_change":"2024-09-17T05:52:19.924840+0000","last_active":"2024-09-17T05:52:20.897596+0000","last_peered":"2024-09-17T05:52:20.897596+0000","last_clean":"2024-09-17T05:52:20.897596+0000","last_became_active":"2024-09-17T05:52:19.923792+0000","last_became_peered":"2024-09-17T05:52:19.923792+0000","last_unstale":"2024-09-17T05:52:20.897596+0000","last_undegraded":"2024-09-17T05:52:20.897596+0000","last_fullsized":"2024-09-17T05:52:20.897596+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:52:18.873991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:52:18.873991+0000","last_clean_scrub_stamp":"2024-09-17T05:52:18.873991+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:59:24.781962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.33","version":"0'0","reported_seq":13,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-09-17T05:52:20.898746+0000","last_change":"2024-09-17T05:52:19.928472+0000","last_active":"2024-09-17T05:52:20.898746+0000","last_peered":"2024-09-17T05:52:20.898746+0000","last_clean":"2024-09-17T05:52:20.898746+0000","last_became_active":"2024-09-17T05:52:19.928140+0000","last_became_peered":"2024-09-17T05:52:19.928140+0000","last_unstale":"2024-09-17T05:52:20.898746+0000","last_undegraded":"2024-09-17T05:52:20.898746+0000","last_fullsized":"2024-09-17T05:52:20.898746+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:52:18.873991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:52:18.873991+0000","last_clean_scrub_stamp":"2024-09-17T05:52:18.873991+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:42:30.942944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.32","version":"0'0","reported_seq":13,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-09-17T05:52:20.899523+0000","last_change":"2024-09-17T05:52:19.917603+0000","last_active":"2024-09-17T05:52:20.899523+0000","last_peered":"2024-09-17T05:52:20.899523+0000","last_clean":"2024-09-17T05:52:20.899523+0000","last_became_active":"2024-09-17T05:52:19.917263+0000","last_became_peered":"2024-09-17T05:52:19.917263+0000","last_unstale":"2024-09-17T05:52:20.899523+0000","last_undegraded":"2024-09-17T05:52:20.899523+0000","last_fullsized":"2024-09-17T05:52:20.899523+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:52:18.873991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:52:18.873991+0000","last_clean_scrub_stamp":"2024-09-17T05:52:18.873991+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:51:47.662102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.31","version":"0'0","reported_seq":13,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-09-17T05:52:20.898194+0000","last_change":"2024-09-17T05:52:19.917541+0000","last_active":"2024-09-17T05:52:20.898194+0000","last_peered":"2024-09-17T05:52:20.898194+0000","last_clean":"2024-09-17T05:52:20.898194+0000","last_became_active":"2024-09-17T05:52:19.917002+0000","last_became_peered":"2024-09-17T05:52:19.917002+0000","last_unstale":"2024-09-17T05:52:20.898194+0000","last_undegraded":"2024-09-17T05:52:20.898194+0000","last_fullsized":"2024-09-17T05:52:20.898194+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:52:18.873991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:52:18.873991+0000","last_clean_scrub_stamp":"2024-09-17T05:52:18.873991+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:22:12.966562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.30","version":"0'0","reported_seq":13,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-09-17T05:52:21.029573+0000","last_change":"2024-09-17T05:52:19.913101+0000","last_active":"2024-09-17T05:52:21.029573+0000","last_peered":"2024-09-17T05:52:21.029573+0000","last_clean":"2024-09-17T05:52:21.029573+0000","last_became_active":"2024-09-17T05:52:19.912706+0000","last_became_peered":"2024-09-17T05:52:19.912706+0000","last_unstale":"2024-09-17T05:52:21.029573+0000","last_undegraded":"2024-09-17T05:52:21.029573+0000","last_fullsized":"2024-09-17T05:52:21.029573+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:52:18.873991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:52:18.873991+0000","last_clean_scrub_stamp":"2024-09-17T05:52:18.873991+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:25:31.420646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.2f","version":"0'0","reported_seq":13,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-09-17T05:52:20.916291+0000","last_change":"2024-09-17T05:52:19.927246+0000","last_active":"2024-09-17T05:52:20.916291+0000","last_peered":"2024-09-17T05:52:20.916291+0000","last_clean":"2024-09-17T05:52:20.916291+0000","last_became_active":"2024-09-17T05:52:19.926923+0000","last_became_peered":"2024-09-17T05:52:19.926923+0000","last_unstale":"2024-09-17T05:52:20.916291+0000","last_undegraded":"2024-09-17T05:52:20.916291+0000","last_fullsized":"2024-09-17T05:52:20.916291+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:52:18.873991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:52:18.873991+0000","last_clean_scrub_stamp":"2024-09-17T05:52:18.873991+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:11:04.819830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.2e","version":"0'0","reported_seq":13,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-09-17T05:52:21.029920+0000","last_change":"2024-09-17T05:52:19.917011+0000","last_active":"2024-09-17T05:52:21.029920+0000","last_peered":"2024-09-17T05:52:21.029920+0000","last_clean":"2024-09-17T05:52:21.029920+0000","last_became_active":"2024-09-17T05:52:19.916646+0000","last_became_peered":"2024-09-17T05:52:19.916646+0000","last_unstale":"2024-09-17T05:52:21.029920+0000","last_undegraded":"2024-09-17T05:52:21.029920+0000","last_fullsized":"2024-09-17T05:52:21.029920+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:52:18.873991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:52:18.873991+0000","last_clean_scrub_stamp":"2024-09-17T05:52:18.873991+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:35:32.775637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.2d","version":"0'0","reported_seq":13,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-09-17T05:52:21.029925+0000","last_change":"2024-09-17T05:52:19.926758+0000","last_active":"2024-09-17T05:52:21.029925+0000","last_peered":"2024-09-17T05:52:21.029925+0000","last_clean":"2024-09-17T05:52:21.029925+0000","last_became_active":"2024-09-17T05:52:19.926399+0000","last_became_peered":"2024-09-17T05:52:19.926399+0000","last_unstale":"2024-09-17T05:52:21.029925+0000","last_undegraded":"2024-09-17T05:52:21.029925+0000","last_fullsized":"2024-09-17T05:52:21.029925+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:52:18.873991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:52:18.873991+0000","last_clean_scrub_stamp":"2024-09-17T05:52:18.873991+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:29:31.086507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.2c","version":"0'0","reported_seq":13,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-09-17T05:52:21.029968+0000","last_change":"2024-09-17T05:52:19.909258+0000","last_active":"2024-09-17T05:52:21.029968+0000","last_peered":"2024-09-17T05:52:21.029968+0000","last_clean":"2024-09-17T05:52:21.029968+0000","last_became_active":"2024-09-17T05:52:19.908594+0000","last_became_peered":"2024-09-17T05:52:19.908594+0000","last_unstale":"2024-09-17T05:52:21.029968+0000","last_undegraded":"2024-09-17T05:52:21.029968+0000","last_fullsized":"2024-09-17T05:52:21.029968+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:52:18.873991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:52:18.873991+0000","last_clean_scrub_stamp":"2024-09-17T05:52:18.873991+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:39:48.304671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.2b","version":"0'0","reported_seq":13,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-09-17T05:52:20.913343+0000","last_change":"2024-09-17T05:52:19.923630+0000","last_active":"2024-09-17T05:52:20.913343+0000","last_peered":"2024-09-17T05:52:20.913343+0000","last_clean":"2024-09-17T05:52:20.913343+0000","last_became_active":"2024-09-17T05:52:19.922986+0000","last_became_peered":"2024-09-17T05:52:19.922986+0000","last_unstale":"2024-09-17T05:52:20.913343+0000","last_undegraded":"2024-09-17T05:52:20.913343+0000","last_fullsized":"2024-09-17T05:52:20.913343+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:52:18.873991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:52:18.873991+0000","last_clean_scrub_stamp":"2024-09-17T05:52:18.873991+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:27:22.837955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.2a","version":"0'0","reported_seq":13,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-09-17T05:52:21.029880+0000","last_change":"2024-09-17T05:52:19.907967+0000","last_active":"2024-09-17T05:52:21.029880+0000","last_peered":"2024-09-17T05:52:21.029880+0000","last_clean":"2024-09-17T05:52:21.029880+0000","last_became_active":"2024-09-17T05:52:19.907649+0000","last_became_peered":"2024-09-17T05:52:19.907649+0000","last_unstale":"2024-09-17T05:52:21.029880+0000","last_undegraded":"2024-09-17T05:52:21.029880+0000","last_fullsized":"2024-09-17T05:52:21.029880+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:52:18.873991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:52:18.873991+0000","last_clean_scrub_stamp":"2024-09-17T05:52:18.873991+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:43:13.935866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.29","version":"0'0","reported_seq":13,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-09-17T05:52:20.897945+0000","last_change":"2024-09-17T05:52:19.924525+0000","last_active":"2024-09-17T05:52:20.897945+0000","last_peered":"2024-09-17T05:52:20.897945+0000","last_clean":"2024-09-17T05:52:20.897945+0000","last_became_active":"2024-09-17T05:52:19.924161+0000","last_became_peered":"2024-09-17T05:52:19.924161+0000","last_unstale":"2024-09-17T05:52:20.897945+0000","last_undegraded":"2024-09-17T05:52:20.897945+0000","last_fullsized":"2024-09-17T05:52:20.897945+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:52:18.873991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:52:18.873991+0000","last_clean_scrub_stamp":"2024-09-17T05:52:18.873991+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:36:49.213776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.28","version":"0'0","reported_seq":13,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-09-17T05:52:21.029358+0000","last_change":"2024-09-17T05:52:19.932794+0000","last_active":"2024-09-17T05:52:21.029358+0000","last_peered":"2024-09-17T05:52:21.029358+0000","last_clean":"2024-09-17T05:52:21.029358+0000","last_became_active":"2024-09-17T05:52:19.932449+0000","last_became_peered":"2024-09-17T05:52:19.932449+0000","last_unstale":"2024-09-17T05:52:21.029358+0000","last_undegraded":"2024-09-17T05:52:21.029358+0000","last_fullsized":"2024-09-17T05:52:21.029358+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:52:18.873991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:52:18.873991+0000","last_clean_scrub_stamp":"2024-09-17T05:52:18.873991+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:52:07.739392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.27","version":"0'0","reported_seq":13,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-09-17T05:52:20.900099+0000","last_change":"2024-09-17T05:52:19.912450+0000","last_active":"2024-09-17T05:52:20.900099+0000","last_peered":"2024-09-17T05:52:20.900099+0000","last_clean":"2024-09-17T05:52:20.900099+0000","last_became_active":"2024-09-17T05:52:19.912096+0000","last_became_peered":"2024-09-17T05:52:19.912096+0000","last_unstale":"2024-09-17T05:52:20.900099+0000","last_undegraded":"2024-09-17T05:52:20.900099+0000","last_fullsized":"2024-09-17T05:52:20.900099+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:52:18.873991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:52:18.873991+0000","last_clean_scrub_stamp":"2024-09-17T05:52:18.873991+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:32:29.027914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.26","version":"0'0","reported_seq":13,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-09-17T05:52:21.030347+0000","last_change":"2024-09-17T05:52:19.921071+0000","last_active":"2024-09-17T05:52:21.030347+0000","last_peered":"2024-09-17T05:52:21.030347+0000","last_clean":"2024-09-17T05:52:21.030347+0000","last_became_active":"2024-09-17T05:52:19.920770+0000","last_became_peered":"2024-09-17T05:52:19.920770+0000","last_unstale":"2024-09-17T05:52:21.030347+0000","last_undegraded":"2024-09-17T05:52:21.030347+0000","last_fullsized":"2024-09-17T05:52:21.030347+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:52:18.873991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:52:18.873991+0000","last_clean_scrub_stamp":"2024-09-17T05:52:18.873991+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:13:50.107788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.25","version":"0'0","reported_seq":13,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-09-17T05:52:20.898418+0000","last_change":"2024-09-17T05:52:19.927795+0000","last_active":"2024-09-17T05:52:20.898418+0000","last_peered":"2024-09-17T05:52:20.898418+0000","last_clean":"2024-09-17T05:52:20.898418+0000","last_became_active":"2024-09-17T05:52:19.927365+0000","last_became_peered":"2024-09-17T05:52:19.927365+0000","last_unstale":"2024-09-17T05:52:20.898418+0000","last_undegraded":"2024-09-17T05:52:20.898418+0000","last_fullsized":"2024-09-17T05:52:20.898418+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:52:18.873991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:52:18.873991+0000","last_clean_scrub_stamp":"2024-09-17T05:52:18.873991+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:31:38.910618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.24","version":"0'0","reported_seq":13,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-09-17T05:52:21.029763+0000","last_change":"2024-09-17T05:52:19.919487+0000","last_active":"2024-09-17T05:52:21.029763+0000","last_peered":"2024-09-17T05:52:21.029763+0000","last_clean":"2024-09-17T05:52:21.029763+0000","last_became_active":"2024-09-17T05:52:19.919132+0000","last_became_peered":"2024-09-17T05:52:19.919132+0000","last_unstale":"2024-09-17T05:52:21.029763+0000","last_undegraded":"2024-09-17T05:52:21.029763+0000","last_fullsized":"2024-09-17T05:52:21.029763+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:52:18.873991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:52:18.873991+0000","last_clean_scrub_stamp":"2024-09-17T05:52:18.873991+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:47:54.083475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.23","version":"0'0","reported_seq":13,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-09-17T05:52:20.898760+0000","last_change":"2024-09-17T05:52:19.920980+0000","last_active":"2024-09-17T05:52:20.898760+0000","last_peered":"2024-09-17T05:52:20.898760+0000","last_clean":"2024-09-17T05:52:20.898760+0000","last_became_active":"2024-09-17T05:52:19.920651+0000","last_became_peered":"2024-09-17T05:52:19.920651+0000","last_unstale":"2024-09-17T05:52:20.898760+0000","last_undegraded":"2024-09-17T05:52:20.898760+0000","last_fullsized":"2024-09-17T05:52:20.898760+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:52:18.873991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:52:18.873991+0000","last_clean_scrub_stamp":"2024-09-17T05:52:18.873991+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:12:05.544937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.22","version":"0'0","reported_seq":13,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-09-17T05:52:20.898557+0000","last_change":"2024-09-17T05:52:19.916812+0000","last_active":"2024-09-17T05:52:20.898557+0000","last_peered":"2024-09-17T05:52:20.898557+0000","last_clean":"2024-09-17T05:52:20.898557+0000","last_became_active":"2024-09-17T05:52:19.916455+0000","last_became_peered":"2024-09-17T05:52:19.916455+0000","last_unstale":"2024-09-17T05:52:20.898557+0000","last_undegraded":"2024-09-17T05:52:20.898557+0000","last_fullsized":"2024-09-17T05:52:20.898557+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:52:18.873991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:52:18.873991+0000","last_clean_scrub_stamp":"2024-09-17T05:52:18.873991+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:01:51.785896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.21","version":"0'0","reported_seq":13,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-09-17T05:52:20.912884+0000","last_change":"2024-09-17T05:52:19.921396+0000","last_active":"2024-09-17T05:52:20.912884+0000","last_peered":"2024-09-17T05:52:20.912884+0000","last_clean":"2024-09-17T05:52:20.912884+0000","last_became_active":"2024-09-17T05:52:19.916646+0000","last_became_peered":"2024-09-17T05:52:19.916646+0000","last_unstale":"2024-09-17T05:52:20.912884+0000","last_undegraded":"2024-09-17T05:52:20.912884+0000","last_fullsized":"2024-09-17T05:52:20.912884+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:52:18.873991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:52:18.873991+0000","last_clean_scrub_stamp":"2024-09-17T05:52:18.873991+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:31:59.058914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.20","version":"0'0","reported_seq":13,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-09-17T05:52:20.915791+0000","last_change":"2024-09-17T05:52:19.913824+0000","last_active":"2024-09-17T05:52:20.915791+0000","last_peered":"2024-09-17T05:52:20.915791+0000","last_clean":"2024-09-17T05:52:20.915791+0000","last_became_active":"2024-09-17T05:52:19.913513+0000","last_became_peered":"2024-09-17T05:52:19.913513+0000","last_unstale":"2024-09-17T05:52:20.915791+0000","last_undegraded":"2024-09-17T05:52:20.915791+0000","last_fullsized":"2024-09-17T05:52:20.915791+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:52:18.873991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:52:18.873991+0000","last_clean_scrub_stamp":"2024-09-17T05:52:18.873991+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:11:48.541624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.1e","version":"0'0","reported_seq":13,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-09-17T05:52:21.030345+0000","last_change":"2024-09-17T05:52:19.920065+0000","last_active":"2024-09-17T05:52:21.030345+0000","last_peered":"2024-09-17T05:52:21.030345+0000","last_clean":"2024-09-17T05:52:21.030345+0000","last_became_active":"2024-09-17T05:52:19.919754+0000","last_became_peered":"2024-09-17T05:52:19.919754+0000","last_unstale":"2024-09-17T05:52:21.030345+0000","last_undegraded":"2024-09-17T05:52:21.030345+0000","last_fullsized":"2024-09-17T05:52:21.030345+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:52:18.873991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:52:18.873991+0000","last_clean_scrub_stamp":"2024-09-17T05:52:18.873991+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:40:31.593162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.1f","version":"126'4","reported_seq":19,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-09-17T05:52:20.913562+0000","last_change":"2024-09-17T05:52:18.893653+0000","last_active":"2024-09-17T05:52:20.913562+0000","last_peered":"2024-09-17T05:52:20.913562+0000","last_clean":"2024-09-17T05:52:20.913562+0000","last_became_active":"2024-09-17T05:52:18.893296+0000","last_became_peered":"2024-09-17T05:52:18.893296+0000","last_unstale":"2024-09-17T05:52:20.913562+0000","last_undegraded":"2024-09-17T05:52:20.913562+0000","last_fullsized":"2024-09-17T05:52:20.913562+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:52:17.867506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:52:17.867506+0000","last_clean_scrub_stamp":"2024-09-17T05:52:17.867506+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:50:03.925050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.1f","version":"0'0","reported_seq":13,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-09-17T05:52:20.898201+0000","last_change":"2024-09-17T05:52:19.927446+0000","last_active":"2024-09-17T05:52:20.898201+0000","last_peered":"2024-09-17T05:52:20.898201+0000","last_clean":"2024-09-17T05:52:20.898201+0000","last_became_active":"2024-09-17T05:52:19.918688+0000","last_became_peered":"2024-09-17T05:52:19.918688+0000","last_unstale":"2024-09-17T05:52:20.898201+0000","last_undegraded":"2024-09-17T05:52:20.898201+0000","last_fullsized":"2024-09-17T05:52:20.898201+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:52:18.873991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:52:18.873991+0000","last_clean_scrub_stamp":"2024-09-17T05:52:18.873991+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:44:01.005729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.1e","version":"126'1","reported_seq":16,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-09-17T05:52:21.029801+0000","last_change":"2024-09-17T05:52:18.895473+0000","last_active":"2024-09-17T05:52:21.029801+0000","last_peered":"2024-09-17T05:52:21.029801+0000","last_clean":"2024-09-17T05:52:21.029801+0000","last_became_active":"2024-09-17T05:52:18.895096+0000","last_became_peered":"2024-09-17T05:52:18.895096+0000","last_unstale":"2024-09-17T05:52:21.029801+0000","last_undegraded":"2024-09-17T05:52:21.029801+0000","last_fullsized":"2024-09-17T05:52:21.029801+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:52:17.867506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:52:17.867506+0000","last_clean_scrub_stamp":"2024-09-17T05:52:17.867506+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:12:57.384707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.1c","version":"0'0","reported_seq":13,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-09-17T05:52:20.913652+0000","last_change":"2024-09-17T05:52:19.927142+0000","last_active":"2024-09-17T05:52:20.913652+0000","last_peered":"2024-09-17T05:52:20.913652+0000","last_clean":"2024-09-17T05:52:20.913652+0000","last_became_active":"2024-09-17T05:52:19.926836+0000","last_became_peered":"2024-09-17T05:52:19.926836+0000","last_unstale":"2024-09-17T05:52:20.913652+0000","last_undegraded":"2024-09-17T05:52:20.913652+0000","last_fullsized":"2024-09-17T05:52:20.913652+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:52:18.873991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:52:18.873991+0000","last_clean_scrub_stamp":"2024-09-17T05:52:18.873991+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:04:57.127249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.1d","version":"126'2","reported_seq":17,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-09-17T05:52:21.030022+0000","last_change":"2024-09-17T05:52:18.897259+0000","last_active":"2024-09-17T05:52:21.030022+0000","last_peered":"2024-09-17T05:52:21.030022+0000","last_clean":"2024-09-17T05:52:21.030022+0000","last_became_active":"2024-09-17T05:52:18.896947+0000","last_became_peered":"2024-09-17T05:52:18.896947+0000","last_unstale":"2024-09-17T05:52:21.030022+0000","last_undegraded":"2024-09-17T05:52:21.030022+0000","last_fullsized":"2024-09-17T05:52:21.030022+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:52:17.867506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:52:17.867506+0000","last_clean_scrub_stamp":"2024-09-17T05:52:17.867506+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:38:29.098685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.1d","version":"0'0","reported_seq":13,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-09-17T05:52:20.913030+0000","last_change":"2024-09-17T05:52:19.914720+0000","last_active":"2024-09-17T05:52:20.913030+0000","last_peered":"2024-09-17T05:52:20.913030+0000","last_clean":"2024-09-17T05:52:20.913030+0000","last_became_active":"2024-09-17T05:52:19.914342+0000","last_became_peered":"2024-09-17T05:52:19.914342+0000","last_unstale":"2024-09-17T05:52:20.913030+0000","last_undegraded":"2024-09-17T05:52:20.913030+0000","last_fullsized":"2024-09-17T05:52:20.913030+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:52:18.873991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:52:18.873991+0000","last_clean_scrub_stamp":"2024-09-17T05:52:18.873991+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:05:11.605569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.1c","version":"126'2","reported_seq":17,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-09-17T05:52:20.899808+0000","last_change":"2024-09-17T05:52:18.897273+0000","last_active":"2024-09-17T05:52:20.899808+0000","last_peered":"2024-09-17T05:52:20.899808+0000","last_clean":"2024-09-17T05:52:20.899808+0000","last_became_active":"2024-09-17T05:52:18.896887+0000","last_became_peered":"2024-09-17T05:52:18.896887+0000","last_unstale":"2024-09-17T05:52:20.899808+0000","last_undegraded":"2024-09-17T05:52:20.899808+0000","last_fullsized":"2024-09-17T05:52:20.899808+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:52:17.867506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:52:17.867506+0000","last_clean_scrub_stamp":"2024-09-17T05:52:17.867506+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:45:11.419166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.1a","version":"0'0","reported_seq":13,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-09-17T05:52:21.029685+0000","last_change":"2024-09-17T05:52:19.927841+0000","last_active":"2024-09-17T05:52:21.029685+0000","last_peered":"2024-09-17T05:52:21.029685+0000","last_clean":"2024-09-17T05:52:21.029685+0000","last_became_active":"2024-09-17T05:52:19.926892+0000","last_became_peered":"2024-09-17T05:52:19.926892+0000","last_unstale":"2024-09-17T05:52:21.029685+0000","last_undegraded":"2024-09-17T05:52:21.029685+0000","last_fullsized":"2024-09-17T05:52:21.029685+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:52:18.873991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:52:18.873991+0000","last_clean_scrub_stamp":"2024-09-17T05:52:18.873991+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:39:21.330823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.1b","version":"126'1","reported_seq":16,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-09-17T05:52:20.899260+0000","last_change":"2024-09-17T05:52:18.900769+0000","last_active":"2024-09-17T05:52:20.899260+0000","last_peered":"2024-09-17T05:52:20.899260+0000","last_clean":"2024-09-17T05:52:20.899260+0000","last_became_active":"2024-09-17T05:52:18.900376+0000","last_became_peered":"2024-09-17T05:52:18.900376+0000","last_unstale":"2024-09-17T05:52:20.899260+0000","last_undegraded":"2024-09-17T05:52:20.899260+0000","last_fullsized":"2024-09-17T05:52:20.899260+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:52:17.867506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:52:17.867506+0000","last_clean_scrub_stamp":"2024-09-17T05:52:17.867506+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:50:44.058591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.1b","version":"0'0","reported_seq":13,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-09-17T05:52:20.916633+0000","last_change":"2024-09-17T05:52:19.920703+0000","last_active":"2024-09-17T05:52:20.916633+0000","last_peered":"2024-09-17T05:52:20.916633+0000","last_clean":"2024-09-17T05:52:20.916633+0000","last_became_active":"2024-09-17T05:52:19.920376+0000","last_became_peered":"2024-09-17T05:52:19.920376+0000","last_unstale":"2024-09-17T05:52:20.916633+0000","last_undegraded":"2024-09-17T05:52:20.916633+0000","last_fullsized":"2024-09-17T05:52:20.916633+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:52:18.873991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:52:18.873991+0000","last_clean_scrub_stamp":"2024-09-17T05:52:18.873991+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:47:56.025899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.1a","version":"126'1","reported_seq":16,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-09-17T05:52:21.029437+0000","last_change":"2024-09-17T05:52:18.902862+0000","last_active":"2024-09-17T05:52:21.029437+0000","last_peered":"2024-09-17T05:52:21.029437+0000","last_clean":"2024-09-17T05:52:21.029437+0000","last_became_active":"2024-09-17T05:52:18.902515+0000","last_became_peered":"2024-09-17T05:52:18.902515+0000","last_unstale":"2024-09-17T05:52:21.029437+0000","last_undegraded":"2024-09-17T05:52:21.029437+0000","last_fullsized":"2024-09-17T05:52:21.029437+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:52:17.867506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:52:17.867506+0000","last_clean_scrub_stamp":"2024-09-17T05:52:17.867506+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:54:10.006968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.18","version":"0'0","reported_seq":13,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-09-17T05:52:20.898039+0000","last_change":"2024-09-17T05:52:19.905864+0000","last_active":"2024-09-17T05:52:20.898039+0000","last_peered":"2024-09-17T05:52:20.898039+0000","last_clean":"2024-09-17T05:52:20.898039+0000","last_became_active":"2024-09-17T05:52:19.905377+0000","last_became_peered":"2024-09-17T05:52:19.905377+0000","last_unstale":"2024-09-17T05:52:20.898039+0000","last_undegraded":"2024-09-17T05:52:20.898039+0000","last_fullsized":"2024-09-17T05:52:20.898039+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:52:18.873991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:52:18.873991+0000","last_clean_scrub_stamp":"2024-09-17T05:52:18.873991+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:38:43.436763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.19","version":"0'0","reported_seq":15,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-09-17T05:52:20.915745+0000","last_change":"2024-09-17T05:52:18.895524+0000","last_active":"2024-09-17T05:52:20.915745+0000","last_peered":"2024-09-17T05:52:20.915745+0000","last_clean":"2024-09-17T05:52:20.915745+0000","last_became_active":"2024-09-17T05:52:18.895221+0000","last_became_peered":"2024-09-17T05:52:18.895221+0000","last_unstale":"2024-09-17T05:52:20.915745+0000","last_undegraded":"2024-09-17T05:52:20.915745+0000","last_fullsized":"2024-09-17T05:52:20.915745+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:52:17.867506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:52:17.867506+0000","last_clean_scrub_stamp":"2024-09-17T05:52:17.867506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:03:36.241448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.19","version":"0'0","reported_seq":13,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-09-17T05:52:20.899352+0000","last_change":"2024-09-17T05:52:19.908005+0000","last_active":"2024-09-17T05:52:20.899352+0000","last_peered":"2024-09-17T05:52:20.899352+0000","last_clean":"2024-09-17T05:52:20.899352+0000","last_became_active":"2024-09-17T05:52:19.907517+0000","last_became_peered":"2024-09-17T05:52:19.907517+0000","last_unstale":"2024-09-17T05:52:20.899352+0000","last_undegraded":"2024-09-17T05:52:20.899352+0000","last_fullsized":"2024-09-17T05:52:20.899352+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:52:18.873991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:52:18.873991+0000","last_clean_scrub_stamp":"2024-09-17T05:52:18.873991+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:36:40.355849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.18","version":"0'0","reported_seq":15,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-09-17T05:52:20.899405+0000","last_change":"2024-09-17T05:52:18.896929+0000","last_active":"2024-09-17T05:52:20.899405+0000","last_peered":"2024-09-17T05:52:20.899405+0000","last_clean":"2024-09-17T05:52:20.899405+0000","last_became_active":"2024-09-17T05:52:18.896507+0000","last_became_peered":"2024-09-17T05:52:18.896507+0000","last_unstale":"2024-09-17T05:52:20.899405+0000","last_undegraded":"2024-09-17T05:52:20.899405+0000","last_fullsized":"2024-09-17T05:52:20.899405+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:52:17.867506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:52:17.867506+0000","last_clean_scrub_stamp":"2024-09-17T05:52:17.867506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:44:27.327469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.16","version":"0'0","reported_seq":13,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-09-17T05:52:20.898450+0000","last_change":"2024-09-17T05:52:19.916951+0000","last_active":"2024-09-17T05:52:20.898450+0000","last_peered":"2024-09-17T05:52:20.898450+0000","last_clean":"2024-09-17T05:52:20.898450+0000","last_became_active":"2024-09-17T05:52:19.916630+0000","last_became_peered":"2024-09-17T05:52:19.916630+0000","last_unstale":"2024-09-17T05:52:20.898450+0000","last_undegraded":"2024-09-17T05:52:20.898450+0000","last_fullsized":"2024-09-17T05:52:20.898450+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:52:18.873991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:52:18.873991+0000","last_clean_scrub_stamp":"2024-09-17T05:52:18.873991+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:54:37.842874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.17","version":"0'0","reported_seq":15,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-09-17T05:52:21.030071+0000","last_change":"2024-09-17T05:52:18.894591+0000","last_active":"2024-09-17T05:52:21.030071+0000","last_peered":"2024-09-17T05:52:21.030071+0000","last_clean":"2024-09-17T05:52:21.030071+0000","last_became_active":"2024-09-17T05:52:18.894241+0000","last_became_peered":"2024-09-17T05:52:18.894241+0000","last_unstale":"2024-09-17T05:52:21.030071+0000","last_undegraded":"2024-09-17T05:52:21.030071+0000","last_fullsized":"2024-09-17T05:52:21.030071+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:52:17.867506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:52:17.867506+0000","last_clean_scrub_stamp":"2024-09-17T05:52:17.867506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:32:31.037419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.17","version":"0'0","reported_seq":13,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-09-17T05:52:21.029975+0000","last_change":"2024-09-17T05:52:19.918028+0000","last_active":"2024-09-17T05:52:21.029975+0000","last_peered":"2024-09-17T05:52:21.029975+0000","last_clean":"2024-09-17T05:52:21.029975+0000","last_became_active":"2024-09-17T05:52:19.916968+0000","last_became_peered":"2024-09-17T05:52:19.916968+0000","last_unstale":"2024-09-17T05:52:21.029975+0000","last_undegraded":"2024-09-17T05:52:21.029975+0000","last_fullsized":"2024-09-17T05:52:21.029975+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:52:18.873991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:52:18.873991+0000","last_clean_scrub_stamp":"2024-09-17T05:52:18.873991+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:23:24.221785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.16","version":"0'0","reported_seq":15,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-09-17T05:52:21.030385+0000","last_change":"2024-09-17T05:52:18.897065+0000","last_active":"2024-09-17T05:52:21.030385+0000","last_peered":"2024-09-17T05:52:21.030385+0000","last_clean":"2024-09-17T05:52:21.030385+0000","last_became_active":"2024-09-17T05:52:18.896692+0000","last_became_peered":"2024-09-17T05:52:18.896692+0000","last_unstale":"2024-09-17T05:52:21.030385+0000","last_undegraded":"2024-09-17T05:52:21.030385+0000","last_fullsized":"2024-09-17T05:52:21.030385+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:52:17.867506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:52:17.867506+0000","last_clean_scrub_stamp":"2024-09-17T05:52:17.867506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:47:55.019414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.14","version":"0'0","reported_seq":13,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-09-17T05:52:20.913700+0000","last_change":"2024-09-17T05:52:19.912074+0000","last_active":"2024-09-17T05:52:20.913700+0000","last_peered":"2024-09-17T05:52:20.913700+0000","last_clean":"2024-09-17T05:52:20.913700+0000","last_became_active":"2024-09-17T05:52:19.911738+0000","last_became_peered":"2024-09-17T05:52:19.911738+0000","last_unstale":"2024-09-17T05:52:20.913700+0000","last_undegraded":"2024-09-17T05:52:20.913700+0000","last_fullsized":"2024-09-17T05:52:20.913700+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:52:18.873991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:52:18.873991+0000","last_clean_scrub_stamp":"2024-09-17T05:52:18.873991+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:23:11.922990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.15","version":"126'3","reported_seq":18,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-09-17T05:52:21.029706+0000","last_change":"2024-09-17T05:52:18.899892+0000","last_active":"2024-09-17T05:52:21.029706+0000","last_peered":"2024-09-17T05:52:21.029706+0000","last_clean":"2024-09-17T05:52:21.029706+0000","last_became_active":"2024-09-17T05:52:18.899449+0000","last_became_peered":"2024-09-17T05:52:18.899449+0000","last_unstale":"2024-09-17T05:52:21.029706+0000","last_undegraded":"2024-09-17T05:52:21.029706+0000","last_fullsized":"2024-09-17T05:52:21.029706+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:52:17.867506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:52:17.867506+0000","last_clean_scrub_stamp":"2024-09-17T05:52:17.867506+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:01:50.779410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.15","version":"0'0","reported_seq":13,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-09-17T05:52:20.913349+0000","last_change":"2024-09-17T05:52:19.909257+0000","last_active":"2024-09-17T05:52:20.913349+0000","last_peered":"2024-09-17T05:52:20.913349+0000","last_clean":"2024-09-17T05:52:20.913349+0000","last_became_active":"2024-09-17T05:52:19.908004+0000","last_became_peered":"2024-09-17T05:52:19.908004+0000","last_unstale":"2024-09-17T05:52:20.913349+0000","last_undegraded":"2024-09-17T05:52:20.913349+0000","last_fullsized":"2024-09-17T05:52:20.913349+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:52:18.873991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:52:18.873991+0000","last_clean_scrub_stamp":"2024-09-17T05:52:18.873991+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:41:01.713245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.14","version":"126'6","reported_seq":21,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-09-17T05:52:20.897695+0000","last_change":"2024-09-17T05:52:18.894488+0000","last_active":"2024-09-17T05:52:20.897695+0000","last_peered":"2024-09-17T05:52:20.897695+0000","last_clean":"2024-09-17T05:52:20.897695+0000","last_became_active":"2024-09-17T05:52:18.894159+0000","last_became_peered":"2024-09-17T05:52:18.894159+0000","last_unstale":"2024-09-17T05:52:20.897695+0000","last_undegraded":"2024-09-17T05:52:20.897695+0000","last_fullsized":"2024-09-17T05:52:20.897695+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:52:17.867506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:52:17.867506+0000","last_clean_scrub_stamp":"2024-09-17T05:52:17.867506+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:14:53.920161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.13","version":"0'0","reported_seq":13,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-09-17T05:52:20.898988+0000","last_change":"2024-09-17T05:52:19.915304+0000","last_active":"2024-09-17T05:52:20.898988+0000","last_peered":"2024-09-17T05:52:20.898988+0000","last_clean":"2024-09-17T05:52:20.898988+0000","last_became_active":"2024-09-17T05:52:19.914759+0000","last_became_peered":"2024-09-17T05:52:19.914759+0000","last_unstale":"2024-09-17T05:52:20.898988+0000","last_undegraded":"2024-09-17T05:52:20.898988+0000","last_fullsized":"2024-09-17T05:52:20.898988+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:52:18.873991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:52:18.873991+0000","last_clean_scrub_stamp":"2024-09-17T05:52:18.873991+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:03:43.903550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.12","version":"0'0","reported_seq":15,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-09-17T05:52:20.898567+0000","last_change":"2024-09-17T05:52:18.891286+0000","last_active":"2024-09-17T05:52:20.898567+0000","last_peered":"2024-09-17T05:52:20.898567+0000","last_clean":"2024-09-17T05:52:20.898567+0000","last_became_active":"2024-09-17T05:52:18.890871+0000","last_became_peered":"2024-09-17T05:52:18.890871+0000","last_unstale":"2024-09-17T05:52:20.898567+0000","last_undegraded":"2024-09-17T05:52:20.898567+0000","last_fullsized":"2024-09-17T05:52:20.898567+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:52:17.867506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:52:17.867506+0000","last_clean_scrub_stamp":"2024-09-17T05:52:17.867506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:16:14.185969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.10","version":"0'0","reported_seq":13,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-09-17T05:52:20.899453+0000","last_change":"2024-09-17T05:52:19.907832+0000","last_active":"2024-09-17T05:52:20.899453+0000","last_peered":"2024-09-17T05:52:20.899453+0000","last_clean":"2024-09-17T05:52:20.899453+0000","last_became_active":"2024-09-17T05:52:19.907363+0000","last_became_peered":"2024-09-17T05:52:19.907363+0000","last_unstale":"2024-09-17T05:52:20.899453+0000","last_undegraded":"2024-09-17T05:52:20.899453+0000","last_fullsized":"2024-09-17T05:52:20.899453+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:52:18.873991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:52:18.873991+0000","last_clean_scrub_stamp":"2024-09-17T05:52:18.873991+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:11:34.492188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.11","version":"0'0","reported_seq":15,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-09-17T05:52:20.899439+0000","last_change":"2024-09-17T05:52:18.898301+0000","last_active":"2024-09-17T05:52:20.899439+0000","last_peered":"2024-09-17T05:52:20.899439+0000","last_clean":"2024-09-17T05:52:20.899439+0000","last_became_active":"2024-09-17T05:52:18.897983+0000","last_became_peered":"2024-09-17T05:52:18.897983+0000","last_unstale":"2024-09-17T05:52:20.899439+0000","last_undegraded":"2024-09-17T05:52:20.899439+0000","last_fullsized":"2024-09-17T05:52:20.899439+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:52:17.867506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:52:17.867506+0000","last_clean_scrub_stamp":"2024-09-17T05:52:17.867506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:22:26.229997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.11","version":"0'0","reported_seq":13,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-09-17T05:52:20.897635+0000","last_change":"2024-09-17T05:52:19.924606+0000","last_active":"2024-09-17T05:52:20.897635+0000","last_peered":"2024-09-17T05:52:20.897635+0000","last_clean":"2024-09-17T05:52:20.897635+0000","last_became_active":"2024-09-17T05:52:19.924303+0000","last_became_peered":"2024-09-17T05:52:19.924303+0000","last_unstale":"2024-09-17T05:52:20.897635+0000","last_undegraded":"2024-09-17T05:52:20.897635+0000","last_fullsized":"2024-09-17T05:52:20.897635+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:52:18.873991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:52:18.873991+0000","last_clean_scrub_stamp":"2024-09-17T05:52:18.873991+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:31:07.855157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.10","version":"126'8","reported_seq":23,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-09-17T05:52:20.897968+0000","last_change":"2024-09-17T05:52:18.899319+0000","last_active":"2024-09-17T05:52:20.897968+0000","last_peered":"2024-09-17T05:52:20.897968+0000","last_clean":"2024-09-17T05:52:20.897968+0000","last_became_active":"2024-09-17T05:52:18.898986+0000","last_became_peered":"2024-09-17T05:52:18.898986+0000","last_unstale":"2024-09-17T05:52:20.897968+0000","last_undegraded":"2024-09-17T05:52:20.897968+0000","last_fullsized":"2024-09-17T05:52:20.897968+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:52:17.867506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:52:17.867506+0000","last_clean_scrub_stamp":"2024-09-17T05:52:17.867506+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:34:06.198386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.e","version":"0'0","reported_seq":13,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-09-17T05:52:20.898315+0000","last_change":"2024-09-17T05:52:19.920533+0000","last_active":"2024-09-17T05:52:20.898315+0000","last_peered":"2024-09-17T05:52:20.898315+0000","last_clean":"2024-09-17T05:52:20.898315+0000","last_became_active":"2024-09-17T05:52:19.920173+0000","last_became_peered":"2024-09-17T05:52:19.920173+0000","last_unstale":"2024-09-17T05:52:20.898315+0000","last_undegraded":"2024-09-17T05:52:20.898315+0000","last_fullsized":"2024-09-17T05:52:20.898315+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:52:18.873991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:52:18.873991+0000","last_clean_scrub_stamp":"2024-09-17T05:52:18.873991+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:19:04.088875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.f","version":"126'1","reported_seq":16,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-09-17T05:52:21.030089+0000","last_change":"2024-09-17T05:52:18.897267+0000","last_active":"2024-09-17T05:52:21.030089+0000","last_peered":"2024-09-17T05:52:21.030089+0000","last_clean":"2024-09-17T05:52:21.030089+0000","last_became_active":"2024-09-17T05:52:18.896904+0000","last_became_peered":"2024-09-17T05:52:18.896904+0000","last_unstale":"2024-09-17T05:52:21.030089+0000","last_undegraded":"2024-09-17T05:52:21.030089+0000","last_fullsized":"2024-09-17T05:52:21.030089+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:52:17.867506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:52:17.867506+0000","last_clean_scrub_stamp":"2024-09-17T05:52:17.867506+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:12:04.538452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.f","version":"0'0","reported_seq":13,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-09-17T05:52:21.029915+0000","last_change":"2024-09-17T05:52:19.919016+0000","last_active":"2024-09-17T05:52:21.029915+0000","last_peered":"2024-09-17T05:52:21.029915+0000","last_clean":"2024-09-17T05:52:21.029915+0000","last_became_active":"2024-09-17T05:52:19.918688+0000","last_became_peered":"2024-09-17T05:52:19.918688+0000","last_unstale":"2024-09-17T05:52:21.029915+0000","last_undegraded":"2024-09-17T05:52:21.029915+0000","last_fullsized":"2024-09-17T05:52:21.029915+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:52:18.873991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:52:18.873991+0000","last_clean_scrub_stamp":"2024-09-17T05:52:18.873991+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:31:23.140660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.e","version":"126'2","reported_seq":17,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-09-17T05:52:21.029853+0000","last_change":"2024-09-17T05:52:18.893709+0000","last_active":"2024-09-17T05:52:21.029853+0000","last_peered":"2024-09-17T05:52:21.029853+0000","last_clean":"2024-09-17T05:52:21.029853+0000","last_became_active":"2024-09-17T05:52:18.893409+0000","last_became_peered":"2024-09-17T05:52:18.893409+0000","last_unstale":"2024-09-17T05:52:21.029853+0000","last_undegraded":"2024-09-17T05:52:21.029853+0000","last_fullsized":"2024-09-17T05:52:21.029853+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:52:17.867506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:52:17.867506+0000","last_clean_scrub_stamp":"2024-09-17T05:52:17.867506+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:32:56.225412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.c","version":"0'0","reported_seq":13,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-09-17T05:52:21.030198+0000","last_change":"2024-09-17T05:52:19.920886+0000","last_active":"2024-09-17T05:52:21.030198+0000","last_peered":"2024-09-17T05:52:21.030198+0000","last_clean":"2024-09-17T05:52:21.030198+0000","last_became_active":"2024-09-17T05:52:19.920557+0000","last_became_peered":"2024-09-17T05:52:19.920557+0000","last_unstale":"2024-09-17T05:52:21.030198+0000","last_undegraded":"2024-09-17T05:52:21.030198+0000","last_fullsized":"2024-09-17T05:52:21.030198+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:52:18.873991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:52:18.873991+0000","last_clean_scrub_stamp":"2024-09-17T05:52:18.873991+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:25:48.964343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.d","version":"126'1","reported_seq":16,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-09-17T05:52:20.916203+0000","last_change":"2024-09-17T05:52:18.896965+0000","last_active":"2024-09-17T05:52:20.916203+0000","last_peered":"2024-09-17T05:52:20.916203+0000","last_clean":"2024-09-17T05:52:20.916203+0000","last_became_active":"2024-09-17T05:52:18.896665+0000","last_became_peered":"2024-09-17T05:52:18.896665+0000","last_unstale":"2024-09-17T05:52:20.916203+0000","last_undegraded":"2024-09-17T05:52:20.916203+0000","last_fullsized":"2024-09-17T05:52:20.916203+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:52:17.867506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:52:17.867506+0000","last_clean_scrub_stamp":"2024-09-17T05:52:17.867506+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:03:31.140556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.d","version":"0'0","reported_seq":13,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-09-17T05:52:20.900093+0000","last_change":"2024-09-17T05:52:19.901706+0000","last_active":"2024-09-17T05:52:20.900093+0000","last_peered":"2024-09-17T05:52:20.900093+0000","last_clean":"2024-09-17T05:52:20.900093+0000","last_became_active":"2024-09-17T05:52:19.901106+0000","last_became_peered":"2024-09-17T05:52:19.901106+0000","last_unstale":"2024-09-17T05:52:20.900093+0000","last_undegraded":"2024-09-17T05:52:20.900093+0000","last_fullsized":"2024-09-17T05:52:20.900093+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:52:18.873991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:52:18.873991+0000","last_clean_scrub_stamp":"2024-09-17T05:52:18.873991+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:57:34.081828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.c","version":"0'0","reported_seq":15,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-09-17T05:52:21.029699+0000","last_change":"2024-09-17T05:52:18.897796+0000","last_active":"2024-09-17T05:52:21.029699+0000","last_peered":"2024-09-17T05:52:21.029699+0000","last_clean":"2024-09-17T05:52:21.029699+0000","last_became_active":"2024-09-17T05:52:18.896607+0000","last_became_peered":"2024-09-17T05:52:18.896607+0000","last_unstale":"2024-09-17T05:52:21.029699+0000","last_undegraded":"2024-09-17T05:52:21.029699+0000","last_fullsized":"2024-09-17T05:52:21.029699+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:52:17.867506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:52:17.867506+0000","last_clean_scrub_stamp":"2024-09-17T05:52:17.867506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:06:49.196334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.a","version":"0'0","reported_seq":13,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-09-17T05:52:20.898493+0000","last_change":"2024-09-17T05:52:19.927684+0000","last_active":"2024-09-17T05:52:20.898493+0000","last_peered":"2024-09-17T05:52:20.898493+0000","last_clean":"2024-09-17T05:52:20.898493+0000","last_became_active":"2024-09-17T05:52:19.927177+0000","last_became_peered":"2024-09-17T05:52:19.927177+0000","last_unstale":"2024-09-17T05:52:20.898493+0000","last_undegraded":"2024-09-17T05:52:20.898493+0000","last_fullsized":"2024-09-17T05:52:20.898493+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:52:18.873991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:52:18.873991+0000","last_clean_scrub_stamp":"2024-09-17T05:52:18.873991+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:14:26.990346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.b","version":"126'2","reported_seq":17,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-09-17T05:52:21.029634+0000","last_change":"2024-09-17T05:52:18.898700+0000","last_active":"2024-09-17T05:52:21.029634+0000","last_peered":"2024-09-17T05:52:21.029634+0000","last_clean":"2024-09-17T05:52:21.029634+0000","last_became_active":"2024-09-17T05:52:18.898205+0000","last_became_peered":"2024-09-17T05:52:18.898205+0000","last_unstale":"2024-09-17T05:52:21.029634+0000","last_undegraded":"2024-09-17T05:52:21.029634+0000","last_fullsized":"2024-09-17T05:52:21.029634+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:52:17.867506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:52:17.867506+0000","last_clean_scrub_stamp":"2024-09-17T05:52:17.867506+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:03:42.897065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.b","version":"0'0","reported_seq":13,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-09-17T05:52:20.916229+0000","last_change":"2024-09-17T05:52:19.926434+0000","last_active":"2024-09-17T05:52:20.916229+0000","last_peered":"2024-09-17T05:52:20.916229+0000","last_clean":"2024-09-17T05:52:20.916229+0000","last_became_active":"2024-09-17T05:52:19.926138+0000","last_became_peered":"2024-09-17T05:52:19.926138+0000","last_unstale":"2024-09-17T05:52:20.916229+0000","last_undegraded":"2024-09-17T05:52:20.916229+0000","last_fullsized":"2024-09-17T05:52:20.916229+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:52:18.873991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:52:18.873991+0000","last_clean_scrub_stamp":"2024-09-17T05:52:18.873991+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:39:56.592090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.a","version":"0'0","reported_seq":15,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-09-17T05:52:21.029979+0000","last_change":"2024-09-17T05:52:18.898808+0000","last_active":"2024-09-17T05:52:21.029979+0000","last_peered":"2024-09-17T05:52:21.029979+0000","last_clean":"2024-09-17T05:52:21.029979+0000","last_became_active":"2024-09-17T05:52:18.896625+0000","last_became_peered":"2024-09-17T05:52:18.896625+0000","last_unstale":"2024-09-17T05:52:21.029979+0000","last_undegraded":"2024-09-17T05:52:21.029979+0000","last_fullsized":"2024-09-17T05:52:21.029979+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:52:17.867506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:52:17.867506+0000","last_clean_scrub_stamp":"2024-09-17T05:52:17.867506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:51:09.016534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.8","version":"0'0","reported_seq":13,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-09-17T05:52:20.899352+0000","last_change":"2024-09-17T05:52:19.904110+0000","last_active":"2024-09-17T05:52:20.899352+0000","last_peered":"2024-09-17T05:52:20.899352+0000","last_clean":"2024-09-17T05:52:20.899352+0000","last_became_active":"2024-09-17T05:52:19.902711+0000","last_became_peered":"2024-09-17T05:52:19.902711+0000","last_unstale":"2024-09-17T05:52:20.899352+0000","last_undegraded":"2024-09-17T05:52:20.899352+0000","last_fullsized":"2024-09-17T05:52:20.899352+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:52:18.873991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:52:18.873991+0000","last_clean_scrub_stamp":"2024-09-17T05:52:18.873991+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:13:08.301123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.9","version":"0'0","reported_seq":15,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-09-17T05:52:21.029274+0000","last_change":"2024-09-17T05:52:18.899801+0000","last_active":"2024-09-17T05:52:21.029274+0000","last_peered":"2024-09-17T05:52:21.029274+0000","last_clean":"2024-09-17T05:52:21.029274+0000","last_became_active":"2024-09-17T05:52:18.899430+0000","last_became_peered":"2024-09-17T05:52:18.899430+0000","last_unstale":"2024-09-17T05:52:21.029274+0000","last_undegraded":"2024-09-17T05:52:21.029274+0000","last_fullsized":"2024-09-17T05:52:21.029274+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:52:17.867506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:52:17.867506+0000","last_clean_scrub_stamp":"2024-09-17T05:52:17.867506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:03:01.468238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.9","version":"0'0","reported_seq":13,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-09-17T05:52:20.913125+0000","last_change":"2024-09-17T05:52:19.920709+0000","last_active":"2024-09-17T05:52:20.913125+0000","last_peered":"2024-09-17T05:52:20.913125+0000","last_clean":"2024-09-17T05:52:20.913125+0000","last_became_active":"2024-09-17T05:52:19.917358+0000","last_became_peered":"2024-09-17T05:52:19.917358+0000","last_unstale":"2024-09-17T05:52:20.913125+0000","last_undegraded":"2024-09-17T05:52:20.913125+0000","last_fullsized":"2024-09-17T05:52:20.913125+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:52:18.873991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:52:18.873991+0000","last_clean_scrub_stamp":"2024-09-17T05:52:18.873991+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:02:10.659710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.8","version":"0'0","reported_seq":15,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-09-17T05:52:21.029468+0000","last_change":"2024-09-17T05:52:18.893798+0000","last_active":"2024-09-17T05:52:21.029468+0000","last_peered":"2024-09-17T05:52:21.029468+0000","last_clean":"2024-09-17T05:52:21.029468+0000","last_became_active":"2024-09-17T05:52:18.893085+0000","last_became_peered":"2024-09-17T05:52:18.893085+0000","last_unstale":"2024-09-17T05:52:21.029468+0000","last_undegraded":"2024-09-17T05:52:21.029468+0000","last_fullsized":"2024-09-17T05:52:21.029468+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:52:17.867506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:52:17.867506+0000","last_clean_scrub_stamp":"2024-09-17T05:52:17.867506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:35:59.710747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.6","version":"0'0","reported_seq":13,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-09-17T05:52:20.916705+0000","last_change":"2024-09-17T05:52:19.926025+0000","last_active":"2024-09-17T05:52:20.916705+0000","last_peered":"2024-09-17T05:52:20.916705+0000","last_clean":"2024-09-17T05:52:20.916705+0000","last_became_active":"2024-09-17T05:52:19.925657+0000","last_became_peered":"2024-09-17T05:52:19.925657+0000","last_unstale":"2024-09-17T05:52:20.916705+0000","last_undegraded":"2024-09-17T05:52:20.916705+0000","last_fullsized":"2024-09-17T05:52:20.916705+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:52:18.873991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:52:18.873991+0000","last_clean_scrub_stamp":"2024-09-17T05:52:18.873991+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:54:11.013453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.7","version":"126'2","reported_seq":17,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-09-17T05:52:20.898639+0000","last_change":"2024-09-17T05:52:18.891660+0000","last_active":"2024-09-17T05:52:20.898639+0000","last_peered":"2024-09-17T05:52:20.898639+0000","last_clean":"2024-09-17T05:52:20.898639+0000","last_became_active":"2024-09-17T05:52:18.891313+0000","last_became_peered":"2024-09-17T05:52:18.891313+0000","last_unstale":"2024-09-17T05:52:20.898639+0000","last_undegraded":"2024-09-17T05:52:20.898639+0000","last_fullsized":"2024-09-17T05:52:20.898639+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:52:17.867506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:52:17.867506+0000","last_clean_scrub_stamp":"2024-09-17T05:52:17.867506+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:29:09.065979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.7","version":"0'0","reported_seq":13,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-09-17T05:52:20.898471+0000","last_change":"2024-09-17T05:52:19.929735+0000","last_active":"2024-09-17T05:52:20.898471+0000","last_peered":"2024-09-17T05:52:20.898471+0000","last_clean":"2024-09-17T05:52:20.898471+0000","last_became_active":"2024-09-17T05:52:19.929425+0000","last_became_peered":"2024-09-17T05:52:19.929425+0000","last_unstale":"2024-09-17T05:52:20.898471+0000","last_undegraded":"2024-09-17T05:52:20.898471+0000","last_fullsized":"2024-09-17T05:52:20.898471+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:52:18.873991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:52:18.873991+0000","last_clean_scrub_stamp":"2024-09-17T05:52:18.873991+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:07:37.135481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.6","version":"127'1","reported_seq":16,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-09-17T05:52:20.914810+0000","last_change":"2024-09-17T05:52:18.893591+0000","last_active":"2024-09-17T05:52:20.914810+0000","last_peered":"2024-09-17T05:52:20.914810+0000","last_clean":"2024-09-17T05:52:20.914810+0000","last_became_active":"2024-09-17T05:52:18.893254+0000","last_became_peered":"2024-09-17T05:52:18.893254+0000","last_unstale":"2024-09-17T05:52:20.914810+0000","last_undegraded":"2024-09-17T05:52:20.914810+0000","last_fullsized":"2024-09-17T05:52:20.914810+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:52:17.867506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:52:17.867506+0000","last_clean_scrub_stamp":"2024-09-17T05:52:17.867506+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:20:34.378498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.4","version":"0'0","reported_seq":13,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-09-17T05:52:20.899850+0000","last_change":"2024-09-17T05:52:19.913022+0000","last_active":"2024-09-17T05:52:20.899850+0000","last_peered":"2024-09-17T05:52:20.899850+0000","last_clean":"2024-09-17T05:52:20.899850+0000","last_became_active":"2024-09-17T05:52:19.912604+0000","last_became_peered":"2024-09-17T05:52:19.912604+0000","last_unstale":"2024-09-17T05:52:20.899850+0000","last_undegraded":"2024-09-17T05:52:20.899850+0000","last_fullsized":"2024-09-17T05:52:20.899850+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:52:18.873991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:52:18.873991+0000","last_clean_scrub_stamp":"2024-09-17T05:52:18.873991+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:20:52.890270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.5","version":"0'0","reported_seq":15,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-09-17T05:52:20.899960+0000","last_change":"2024-09-17T05:52:18.898676+0000","last_active":"2024-09-17T05:52:20.899960+0000","last_peered":"2024-09-17T05:52:20.899960+0000","last_clean":"2024-09-17T05:52:20.899960+0000","last_became_active":"2024-09-17T05:52:18.898353+0000","last_became_peered":"2024-09-17T05:52:18.898353+0000","last_unstale":"2024-09-17T05:52:20.899960+0000","last_undegraded":"2024-09-17T05:52:20.899960+0000","last_fullsized":"2024-09-17T05:52:20.899960+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:52:17.867506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:52:17.867506+0000","last_clean_scrub_stamp":"2024-09-17T05:52:17.867506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:48:02.170810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.5","version":"0'0","reported_seq":13,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-09-17T05:52:20.916284+0000","last_change":"2024-09-17T05:52:19.926104+0000","last_active":"2024-09-17T05:52:20.916284+0000","last_peered":"2024-09-17T05:52:20.916284+0000","last_clean":"2024-09-17T05:52:20.916284+0000","last_became_active":"2024-09-17T05:52:19.925767+0000","last_became_peered":"2024-09-17T05:52:19.925767+0000","last_unstale":"2024-09-17T05:52:20.916284+0000","last_undegraded":"2024-09-17T05:52:20.916284+0000","last_fullsized":"2024-09-17T05:52:20.916284+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:52:18.873991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:52:18.873991+0000","last_clean_scrub_stamp":"2024-09-17T05:52:18.873991+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:43:20.839584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.4","version":"0'0","reported_seq":15,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-09-17T05:52:21.030170+0000","last_change":"2024-09-17T05:52:18.898186+0000","last_active":"2024-09-17T05:52:21.030170+0000","last_peered":"2024-09-17T05:52:21.030170+0000","last_clean":"2024-09-17T05:52:21.030170+0000","last_became_active":"2024-09-17T05:52:18.897402+0000","last_became_peered":"2024-09-17T05:52:18.897402+0000","last_unstale":"2024-09-17T05:52:21.030170+0000","last_undegraded":"2024-09-17T05:52:21.030170+0000","last_fullsized":"2024-09-17T05:52:21.030170+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:52:17.867506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:52:17.867506+0000","last_clean_scrub_stamp":"2024-09-17T05:52:17.867506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:01:29.762480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.2","version":"0'0","reported_seq":13,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-09-17T05:52:20.913065+0000","last_change":"2024-09-17T05:52:19.927870+0000","last_active":"2024-09-17T05:52:20.913065+0000","last_peered":"2024-09-17T05:52:20.913065+0000","last_clean":"2024-09-17T05:52:20.913065+0000","last_became_active":"2024-09-17T05:52:19.927573+0000","last_became_peered":"2024-09-17T05:52:19.927573+0000","last_unstale":"2024-09-17T05:52:20.913065+0000","last_undegraded":"2024-09-17T05:52:20.913065+0000","last_fullsized":"2024-09-17T05:52:20.913065+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:52:18.873991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:52:18.873991+0000","last_clean_scrub_stamp":"2024-09-17T05:52:18.873991+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:43:48.027258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.3","version":"0'0","reported_seq":15,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-09-17T05:52:20.899605+0000","last_change":"2024-09-17T05:52:18.897422+0000","last_active":"2024-09-17T05:52:20.899605+0000","last_peered":"2024-09-17T05:52:20.899605+0000","last_clean":"2024-09-17T05:52:20.899605+0000","last_became_active":"2024-09-17T05:52:18.897087+0000","last_became_peered":"2024-09-17T05:52:18.897087+0000","last_unstale":"2024-09-17T05:52:20.899605+0000","last_undegraded":"2024-09-17T05:52:20.899605+0000","last_fullsized":"2024-09-17T05:52:20.899605+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:52:17.867506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:52:17.867506+0000","last_clean_scrub_stamp":"2024-09-17T05:52:17.867506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:42:29.936459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.3","version":"0'0","reported_seq":13,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-09-17T05:52:21.029775+0000","last_change":"2024-09-17T05:52:19.923958+0000","last_active":"2024-09-17T05:52:21.029775+0000","last_peered":"2024-09-17T05:52:21.029775+0000","last_clean":"2024-09-17T05:52:21.029775+0000","last_became_active":"2024-09-17T05:52:19.923644+0000","last_became_peered":"2024-09-17T05:52:19.923644+0000","last_unstale":"2024-09-17T05:52:21.029775+0000","last_undegraded":"2024-09-17T05:52:21.029775+0000","last_fullsized":"2024-09-17T05:52:21.029775+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:52:18.873991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:52:18.873991+0000","last_clean_scrub_stamp":"2024-09-17T05:52:18.873991+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:47:43.829677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.2","version":"0'0","reported_seq":15,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-09-17T05:52:20.913214+0000","last_change":"2024-09-17T05:52:18.894258+0000","last_active":"2024-09-17T05:52:20.913214+0000","last_peered":"2024-09-17T05:52:20.913214+0000","last_clean":"2024-09-17T05:52:20.913214+0000","last_became_active":"2024-09-17T05:52:18.893908+0000","last_became_peered":"2024-09-17T05:52:18.893908+0000","last_unstale":"2024-09-17T05:52:20.913214+0000","last_undegraded":"2024-09-17T05:52:20.913214+0000","last_fullsized":"2024-09-17T05:52:20.913214+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:52:17.867506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:52:17.867506+0000","last_clean_scrub_stamp":"2024-09-17T05:52:17.867506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:04:22.951320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.0","version":"0'0","reported_seq":13,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-09-17T05:52:21.029991+0000","last_change":"2024-09-17T05:52:19.903128+0000","last_active":"2024-09-17T05:52:21.029991+0000","last_peered":"2024-09-17T05:52:21.029991+0000","last_clean":"2024-09-17T05:52:21.029991+0000","last_became_active":"2024-09-17T05:52:19.902472+0000","last_became_peered":"2024-09-17T05:52:19.902472+0000","last_unstale":"2024-09-17T05:52:21.029991+0000","last_undegraded":"2024-09-17T05:52:21.029991+0000","last_fullsized":"2024-09-17T05:52:21.029991+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:52:18.873991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:52:18.873991+0000","last_clean_scrub_stamp":"2024-09-17T05:52:18.873991+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:12:01.805337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.1","version":"0'0","reported_seq":15,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-09-17T05:52:21.029440+0000","last_change":"2024-09-17T05:52:18.897210+0000","last_active":"2024-09-17T05:52:21.029440+0000","last_peered":"2024-09-17T05:52:21.029440+0000","last_clean":"2024-09-17T05:52:21.029440+0000","last_became_active":"2024-09-17T05:52:18.896900+0000","last_became_peered":"2024-09-17T05:52:18.896900+0000","last_unstale":"2024-09-17T05:52:21.029440+0000","last_undegraded":"2024-09-17T05:52:21.029440+0000","last_fullsized":"2024-09-17T05:52:21.029440+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:52:17.867506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:52:17.867506+0000","last_clean_scrub_stamp":"2024-09-17T05:52:17.867506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:24:56.802449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.1","version":"0'0","reported_seq":13,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-09-17T05:52:20.899761+0000","last_change":"2024-09-17T05:52:19.913868+0000","last_active":"2024-09-17T05:52:20.899761+0000","last_peered":"2024-09-17T05:52:20.899761+0000","last_clean":"2024-09-17T05:52:20.899761+0000","last_became_active":"2024-09-17T05:52:19.913405+0000","last_became_peered":"2024-09-17T05:52:19.913405+0000","last_unstale":"2024-09-17T05:52:20.899761+0000","last_undegraded":"2024-09-17T05:52:20.899761+0000","last_fullsized":"2024-09-17T05:52:20.899761+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:52:18.873991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:52:18.873991+0000","last_clean_scrub_stamp":"2024-09-17T05:52:18.873991+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:46:39.095749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.0","version":"0'0","reported_seq":15,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-09-17T05:52:21.029546+0000","last_change":"2024-09-17T05:52:18.889287+0000","last_active":"2024-09-17T05:52:21.029546+0000","last_peered":"2024-09-17T05:52:21.029546+0000","last_clean":"2024-09-17T05:52:21.029546+0000","last_became_active":"2024-09-17T05:52:18.888934+0000","last_became_peered":"2024-09-17T05:52:18.888934+0000","last_unstale":"2024-09-17T05:52:21.029546+0000","last_undegraded":"2024-09-17T05:52:21.029546+0000","last_fullsized":"2024-09-17T05:52:21.029546+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:52:17.867506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:52:17.867506+0000","last_clean_scrub_stamp":"2024-09-17T05:52:17.867506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:21:52.939589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.12","version":"0'0","reported_seq":13,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-09-17T05:52:20.913020+0000","last_change":"2024-09-17T05:52:19.917259+0000","last_active":"2024-09-17T05:52:20.913020+0000","last_peered":"2024-09-17T05:52:20.913020+0000","last_clean":"2024-09-17T05:52:20.913020+0000","last_became_active":"2024-09-17T05:52:19.916932+0000","last_became_peered":"2024-09-17T05:52:19.916932+0000","last_unstale":"2024-09-17T05:52:20.913020+0000","last_undegraded":"2024-09-17T05:52:20.913020+0000","last_fullsized":"2024-09-17T05:52:20.913020+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:52:18.873991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:52:18.873991+0000","last_clean_scrub_stamp":"2024-09-17T05:52:18.873991+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:28:29.059413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.13","version":"126'2","reported_seq":17,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-09-17T05:52:20.913529+0000","last_change":"2024-09-17T05:52:18.900120+0000","last_active":"2024-09-17T05:52:20.913529+0000","last_peered":"2024-09-17T05:52:20.913529+0000","last_clean":"2024-09-17T05:52:20.913529+0000","last_became_active":"2024-09-17T05:52:18.899687+0000","last_became_peered":"2024-09-17T05:52:18.899687+0000","last_unstale":"2024-09-17T05:52:20.913529+0000","last_undegraded":"2024-09-17T05:52:20.913529+0000","last_fullsized":"2024-09-17T05:52:20.913529+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:52:17.867506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:52:17.867506+0000","last_clean_scrub_stamp":"2024-09-17T05:52:17.867506+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:26:59.669212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"19'72","reported_seq":302,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-09-17T05:52:20.912559+0000","last_change":"2024-09-17T05:41:48.539830+0000","last_active":"2024-09-17T05:52:20.912559+0000","last_peered":"2024-09-17T05:52:20.912559+0000","last_clean":"2024-09-17T05:52:20.912559+0000","last_became_active":"2024-09-17T05:41:48.538743+0000","last_became_peered":"2024-09-17T05:41:48.538743+0000","last_unstale":"2024-09-17T05:52:20.912559+0000","last_undegraded":"2024-09-17T05:52:20.912559+0000","last_fullsized":"2024-09-17T05:52:20.912559+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:47.152539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:47.152539+0000","last_clean_scrub_stamp":"2024-09-17T05:41:47.152539+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:08:02.952016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":19,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":18,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":16,"seq":68719476868,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":145124,"kb_used_data":1552,"kb_used_omap":1,"kb_used_meta":143550,"kb_avail":94226716,"statfs":{"total":96636764160,"available":96488157184,"internally_reserved":0,"allocated":1589248,"data_stored":694592,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":146995654},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":7,"up_from":15,"seq":64424509572,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":119356,"kb_used_data":2144,"kb_used_omap":1,"kb_used_meta":117182,"kb_avail":94252484,"statfs":{"total":96636764160,"available":96514543616,"internally_reserved":0,"allocated":2195456,"data_stored":1285598,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":119994826},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509571,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":113188,"kb_used_data":1548,"kb_used_omap":1,"kb_used_meta":111614,"kb_avail":94258652,"statfs":{"total":96636764160,"available":96520859648,"internally_reserved":0,"allocated":1585152,"data_stored":693092,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":114293189},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509571,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":140956,"kb_used_data":1544,"kb_used_omap":1,"kb_used_meta":139390,"kb_avail":94230884,"statfs":{"total":96636764160,"available":96492425216,"internally_reserved":0,"allocated":1581056,"data_stored":693050,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":142735813},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509571,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":118756,"kb_used_data":1548,"kb_used_omap":1,"kb_used_meta":117182,"kb_avail":94253084,"statfs":{"total":96636764160,"available":96515158016,"internally_reserved":0,"allocated":1585152,"data_stored":693140,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":119994823},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509571,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":140960,"kb_used_data":1548,"kb_used_omap":1,"kb_used_meta":139390,"kb_avail":94230880,"statfs":{"total":96636764160,"available":96492421120,"internally_reserved":0,"allocated":1585152,"data_stored":693596,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":142735813},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509571,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":145120,"kb_used_data":1540,"kb_used_omap":1,"kb_used_meta":143550,"kb_avail":94226720,"statfs":{"total":96636764160,"available":96488161280,"internally_reserved":0,"allocated":1576960,"data_stored":692980,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":146995653},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574979,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":123488,"kb_used_data":2120,"kb_used_omap":1,"kb_used_meta":121342,"kb_avail":94248352,"statfs":{"total":96636764160,"available":96510312448,"internally_reserved":0,"allocated":2170880,"data_stored":1283348,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":124254661},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":2250,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-17T05:52:27.012 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-17T05:52:27.015 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-17T05:52:28.386 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-17T05:52:28.514 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:28.512+0000 7f19a96b2640 1 -- 172.21.15.150:0/3724330430 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f19a40d4f90 msgr2=0x7f19a40d0400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:52:28.514 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:28.512+0000 7f19a96b2640 1 --2- 172.21.15.150:0/3724330430 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f19a40d4f90 0x7f19a40d0400 secure :-1 s=READY pgs=1691 cs=0 l=1 rev1=1 crypto rx=0x7f19a40b71d0 tx=0x7f198c02a5f0 comp rx=0 tx=0).stop 2024-09-17T05:52:28.514 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:28.512+0000 7f19a96b2640 1 -- 172.21.15.150:0/3724330430 shutdown_connections 2024-09-17T05:52:28.514 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:28.512+0000 7f19a96b2640 1 --2- 172.21.15.150:0/3724330430 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f19a40d4f90 0x7f19a40d0400 unknown :-1 s=CLOSED pgs=1691 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:52:28.515 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:28.512+0000 7f19a96b2640 1 --2- 172.21.15.150:0/3724330430 >> v2:172.21.15.176:3300/0 conn(0x7f19a40b5d50 0x7f19a40d2780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:52:28.515 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:28.512+0000 7f19a96b2640 1 -- 172.21.15.150:0/3724330430 >> 172.21.15.150:0/3724330430 conn(0x7f19a408bfe0 msgr2=0x7f19a40d4670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:52:28.515 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:28.512+0000 7f19a96b2640 1 -- 172.21.15.150:0/3724330430 shutdown_connections 2024-09-17T05:52:28.515 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:28.512+0000 7f19a96b2640 1 -- 172.21.15.150:0/3724330430 wait complete. 2024-09-17T05:52:28.515 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:28.514+0000 7f19a96b2640 1 Processor -- start 2024-09-17T05:52:28.515 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:28.514+0000 7f19a96b2640 1 -- start start 2024-09-17T05:52:28.519 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:28.515+0000 7f19a96b2640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f19a40b5d50 0x7f19a41f5860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:52:28.519 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:28.515+0000 7f19a96b2640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f19a40d1080 0x7f19a41557f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:52:28.519 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:28.515+0000 7f19a96b2640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f19a40d4f90 0x7f19a41623b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:52:28.519 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:28.515+0000 7f19a96b2640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f19a40b7aa0 con 0x7f19a40d4f90 2024-09-17T05:52:28.519 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:28.515+0000 7f19a96b2640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f19a40b7920 con 0x7f19a40b5d50 2024-09-17T05:52:28.519 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:28.515+0000 7f19a96b2640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f19a40b7c20 con 0x7f19a40d1080 2024-09-17T05:52:28.519 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:28.515+0000 7f19a37fe640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f19a40d4f90 0x7f19a41623b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:52:28.519 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:28.515+0000 7f19a37fe640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f19a40d4f90 0x7f19a41623b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:35818/0 (socket says 172.21.15.150:35818) 2024-09-17T05:52:28.519 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:28.515+0000 7f19a37fe640 1 -- 172.21.15.150:0/1070510623 learned_addr learned my addr 172.21.15.150:0/1070510623 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:52:28.520 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:28.515+0000 7f19a2ffd640 1 --2- 172.21.15.150:0/1070510623 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f19a40b5d50 0x7f19a41f5860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:52:28.520 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:28.516+0000 7f199a7fc640 1 --2- 172.21.15.150:0/1070510623 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f19a40d1080 0x7f19a41557f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:52:28.520 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:28.516+0000 7f19a37fe640 1 -- 172.21.15.150:0/1070510623 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f19a40d1080 msgr2=0x7f19a41557f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:52:28.520 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:28.516+0000 7f19a37fe640 1 --2- 172.21.15.150:0/1070510623 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f19a40d1080 0x7f19a41557f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:52:28.520 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:28.516+0000 7f19a37fe640 1 -- 172.21.15.150:0/1070510623 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f19a40b5d50 msgr2=0x7f19a41f5860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:52:28.520 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:28.516+0000 7f19a37fe640 1 --2- 172.21.15.150:0/1070510623 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f19a40b5d50 0x7f19a41f5860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:52:28.520 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:28.516+0000 7f19a37fe640 1 -- 172.21.15.150:0/1070510623 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f19a4156470 con 0x7f19a40d4f90 2024-09-17T05:52:28.520 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:28.516+0000 7f199a7fc640 1 --2- 172.21.15.150:0/1070510623 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f19a40d1080 0x7f19a41557f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T05:52:28.520 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:28.516+0000 7f19a37fe640 1 --2- 172.21.15.150:0/1070510623 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f19a40d4f90 0x7f19a41623b0 secure :-1 s=READY pgs=1692 cs=0 l=1 rev1=1 crypto rx=0x7f199c00c700 tx=0x7f199c00cbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:52:28.520 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:28.516+0000 7f199bfff640 1 -- 172.21.15.150:0/1070510623 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f199c003b70 con 0x7f19a40d4f90 2024-09-17T05:52:28.521 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:28.516+0000 7f199bfff640 1 -- 172.21.15.150:0/1070510623 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f199c003d10 con 0x7f19a40d4f90 2024-09-17T05:52:28.521 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:28.516+0000 7f19a96b2640 1 -- 172.21.15.150:0/1070510623 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f19a4147e70 con 0x7f19a40d4f90 2024-09-17T05:52:28.521 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:28.516+0000 7f199bfff640 1 -- 172.21.15.150:0/1070510623 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f199c00aab0 con 0x7f19a40d4f90 2024-09-17T05:52:28.521 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:28.516+0000 7f19a96b2640 1 -- 172.21.15.150:0/1070510623 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f19a41fa1c0 con 0x7f19a40d4f90 2024-09-17T05:52:28.521 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:28.517+0000 7f19a96b2640 1 -- 172.21.15.150:0/1070510623 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f19a41561e0 con 0x7f19a40d4f90 2024-09-17T05:52:28.522 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:28.518+0000 7f199bfff640 1 -- 172.21.15.150:0/1070510623 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 42) ==== 104195+0+0 (secure 0 0 0) 0x7f199c00ac50 con 0x7f19a40d4f90 2024-09-17T05:52:28.522 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:28.518+0000 7f199bfff640 1 --2- 172.21.15.150:0/1070510623 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f198407aa20 0x7f198407cf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:52:28.522 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:28.519+0000 7f199bfff640 1 -- 172.21.15.150:0/1070510623 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(127..127 src has 1..127) ==== 5877+0+0 (secure 0 0 0) 0x7f199c099b70 con 0x7f19a40d4f90 2024-09-17T05:52:28.522 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:28.519+0000 7f19a2ffd640 1 --2- 172.21.15.150:0/1070510623 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f198407aa20 0x7f198407cf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:52:28.522 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:28.519+0000 7f19a2ffd640 1 --2- 172.21.15.150:0/1070510623 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f198407aa20 0x7f198407cf30 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 crypto rx=0x7f1994009ac0 tx=0x7f1994005f90 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:52:28.524 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:28.523+0000 7f199bfff640 1 -- 172.21.15.150:0/1070510623 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f199c063a30 con 0x7f19a40d4f90 2024-09-17T05:52:28.697 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:28.695+0000 7f19a96b2640 1 -- 172.21.15.150:0/1070510623 --> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f19a41fa460 con 0x7f198407aa20 2024-09-17T05:52:28.701 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:28.700+0000 7f199bfff640 1 -- 172.21.15.150:0/1070510623 <== mgr.4108 v2:172.21.15.176:6800/3631216395 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+252474 (secure 0 0 0) 0x7f19a41fa460 con 0x7f198407aa20 2024-09-17T05:52:28.704 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-09-17T05:52:28.705 INFO:teuthology.orchestra.run.smithi150.stderr:dumped all 2024-09-17T05:52:28.707 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:28.703+0000 7f19a96b2640 1 -- 172.21.15.150:0/1070510623 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f198407aa20 msgr2=0x7f198407cf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:52:28.707 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:28.703+0000 7f19a96b2640 1 --2- 172.21.15.150:0/1070510623 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f198407aa20 0x7f198407cf30 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 crypto rx=0x7f1994009ac0 tx=0x7f1994005f90 comp rx=0 tx=0).stop 2024-09-17T05:52:28.707 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:28.703+0000 7f19a96b2640 1 -- 172.21.15.150:0/1070510623 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f19a40d4f90 msgr2=0x7f19a41623b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:52:28.707 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:28.703+0000 7f19a96b2640 1 --2- 172.21.15.150:0/1070510623 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f19a40d4f90 0x7f19a41623b0 secure :-1 s=READY pgs=1692 cs=0 l=1 rev1=1 crypto rx=0x7f199c00c700 tx=0x7f199c00cbc0 comp rx=0 tx=0).stop 2024-09-17T05:52:28.707 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:28.703+0000 7f19a96b2640 1 -- 172.21.15.150:0/1070510623 shutdown_connections 2024-09-17T05:52:28.707 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:28.703+0000 7f19a96b2640 1 --2- 172.21.15.150:0/1070510623 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f198407aa20 0x7f198407cf30 unknown :-1 s=CLOSED pgs=719 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:52:28.707 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:28.703+0000 7f19a96b2640 1 --2- 172.21.15.150:0/1070510623 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f19a40d4f90 0x7f19a41623b0 unknown :-1 s=CLOSED pgs=1692 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:52:28.707 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:28.703+0000 7f19a96b2640 1 --2- 172.21.15.150:0/1070510623 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f19a40d1080 0x7f19a41557f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:52:28.707 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:28.703+0000 7f19a96b2640 1 --2- 172.21.15.150:0/1070510623 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f19a40b5d50 0x7f19a41f5860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:52:28.707 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:28.703+0000 7f19a96b2640 1 -- 172.21.15.150:0/1070510623 >> 172.21.15.150:0/1070510623 conn(0x7f19a408bfe0 msgr2=0x7f19a406f5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:52:28.708 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:28.703+0000 7f19a96b2640 1 -- 172.21.15.150:0/1070510623 shutdown_connections 2024-09-17T05:52:28.708 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:28.703+0000 7f19a96b2640 1 -- 172.21.15.150:0/1070510623 wait complete. 2024-09-17T05:52:28.717 INFO:teuthology.orchestra.run.smithi150.stdout:{"pg_ready":true,"pg_map":{"version":442,"stamp":"2024-09-17T05:52:27.079655+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":146,"num_write_kb":1642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":111,"ondisk_log_size":111,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":163,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":1046948,"kb_used_data":13544,"kb_used_omap":12,"kb_used_meta":1033203,"kb_avail":753927772,"statfs":{"total":773094113280,"available":772022038528,"internally_reserved":0,"allocated":13869056,"data_stored":6729396,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":1058000432},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":14,"apply_latency_ms":14,"commit_latency_ns":14000000,"apply_latency_ns":14000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.002363"},"pg_stats":[{"pgid":"19.3f","version":"0'0","reported_seq":13,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-09-17T05:52:20.898770+0000","last_change":"2024-09-17T05:52:19.927176+0000","last_active":"2024-09-17T05:52:20.898770+0000","last_peered":"2024-09-17T05:52:20.898770+0000","last_clean":"2024-09-17T05:52:20.898770+0000","last_became_active":"2024-09-17T05:52:19.926840+0000","last_became_peered":"2024-09-17T05:52:19.926840+0000","last_unstale":"2024-09-17T05:52:20.898770+0000","last_undegraded":"2024-09-17T05:52:20.898770+0000","last_fullsized":"2024-09-17T05:52:20.898770+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:52:18.873991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:52:18.873991+0000","last_clean_scrub_stamp":"2024-09-17T05:52:18.873991+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:12:58.391192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.3e","version":"0'0","reported_seq":13,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-09-17T05:52:20.900233+0000","last_change":"2024-09-17T05:52:19.927167+0000","last_active":"2024-09-17T05:52:20.900233+0000","last_peered":"2024-09-17T05:52:20.900233+0000","last_clean":"2024-09-17T05:52:20.900233+0000","last_became_active":"2024-09-17T05:52:19.926290+0000","last_became_peered":"2024-09-17T05:52:19.926290+0000","last_unstale":"2024-09-17T05:52:20.900233+0000","last_undegraded":"2024-09-17T05:52:20.900233+0000","last_fullsized":"2024-09-17T05:52:20.900233+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:52:18.873991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:52:18.873991+0000","last_clean_scrub_stamp":"2024-09-17T05:52:18.873991+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:23:29.627779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.3d","version":"0'0","reported_seq":13,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-09-17T05:52:20.897935+0000","last_change":"2024-09-17T05:52:19.904747+0000","last_active":"2024-09-17T05:52:20.897935+0000","last_peered":"2024-09-17T05:52:20.897935+0000","last_clean":"2024-09-17T05:52:20.897935+0000","last_became_active":"2024-09-17T05:52:19.904370+0000","last_became_peered":"2024-09-17T05:52:19.904370+0000","last_unstale":"2024-09-17T05:52:20.897935+0000","last_undegraded":"2024-09-17T05:52:20.897935+0000","last_fullsized":"2024-09-17T05:52:20.897935+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:52:18.873991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:52:18.873991+0000","last_clean_scrub_stamp":"2024-09-17T05:52:18.873991+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:53:12.769720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.3c","version":"0'0","reported_seq":13,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-09-17T05:52:20.898737+0000","last_change":"2024-09-17T05:52:19.916037+0000","last_active":"2024-09-17T05:52:20.898737+0000","last_peered":"2024-09-17T05:52:20.898737+0000","last_clean":"2024-09-17T05:52:20.898737+0000","last_became_active":"2024-09-17T05:52:19.915727+0000","last_became_peered":"2024-09-17T05:52:19.915727+0000","last_unstale":"2024-09-17T05:52:20.898737+0000","last_undegraded":"2024-09-17T05:52:20.898737+0000","last_fullsized":"2024-09-17T05:52:20.898737+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:52:18.873991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:52:18.873991+0000","last_clean_scrub_stamp":"2024-09-17T05:52:18.873991+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:06:50.202820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.3b","version":"0'0","reported_seq":13,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-09-17T05:52:20.913430+0000","last_change":"2024-09-17T05:52:19.923296+0000","last_active":"2024-09-17T05:52:20.913430+0000","last_peered":"2024-09-17T05:52:20.913430+0000","last_clean":"2024-09-17T05:52:20.913430+0000","last_became_active":"2024-09-17T05:52:19.922558+0000","last_became_peered":"2024-09-17T05:52:19.922558+0000","last_unstale":"2024-09-17T05:52:20.913430+0000","last_undegraded":"2024-09-17T05:52:20.913430+0000","last_fullsized":"2024-09-17T05:52:20.913430+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:52:18.873991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:52:18.873991+0000","last_clean_scrub_stamp":"2024-09-17T05:52:18.873991+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:14:31.803577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.3a","version":"0'0","reported_seq":13,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-09-17T05:52:20.916572+0000","last_change":"2024-09-17T05:52:19.921204+0000","last_active":"2024-09-17T05:52:20.916572+0000","last_peered":"2024-09-17T05:52:20.916572+0000","last_clean":"2024-09-17T05:52:20.916572+0000","last_became_active":"2024-09-17T05:52:19.920892+0000","last_became_peered":"2024-09-17T05:52:19.920892+0000","last_unstale":"2024-09-17T05:52:20.916572+0000","last_undegraded":"2024-09-17T05:52:20.916572+0000","last_fullsized":"2024-09-17T05:52:20.916572+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:52:18.873991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:52:18.873991+0000","last_clean_scrub_stamp":"2024-09-17T05:52:18.873991+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:03:02.474723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.39","version":"0'0","reported_seq":13,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-09-17T05:52:20.915990+0000","last_change":"2024-09-17T05:52:19.926803+0000","last_active":"2024-09-17T05:52:20.915990+0000","last_peered":"2024-09-17T05:52:20.915990+0000","last_clean":"2024-09-17T05:52:20.915990+0000","last_became_active":"2024-09-17T05:52:19.926478+0000","last_became_peered":"2024-09-17T05:52:19.926478+0000","last_unstale":"2024-09-17T05:52:20.915990+0000","last_undegraded":"2024-09-17T05:52:20.915990+0000","last_fullsized":"2024-09-17T05:52:20.915990+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:52:18.873991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:52:18.873991+0000","last_clean_scrub_stamp":"2024-09-17T05:52:18.873991+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:48:46.344445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.38","version":"0'0","reported_seq":13,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-09-17T05:52:20.897488+0000","last_change":"2024-09-17T05:52:19.902333+0000","last_active":"2024-09-17T05:52:20.897488+0000","last_peered":"2024-09-17T05:52:20.897488+0000","last_clean":"2024-09-17T05:52:20.897488+0000","last_became_active":"2024-09-17T05:52:19.901948+0000","last_became_peered":"2024-09-17T05:52:19.901948+0000","last_unstale":"2024-09-17T05:52:20.897488+0000","last_undegraded":"2024-09-17T05:52:20.897488+0000","last_fullsized":"2024-09-17T05:52:20.897488+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:52:18.873991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:52:18.873991+0000","last_clean_scrub_stamp":"2024-09-17T05:52:18.873991+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:54:00.232524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.37","version":"0'0","reported_seq":13,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-09-17T05:52:20.898104+0000","last_change":"2024-09-17T05:52:19.928374+0000","last_active":"2024-09-17T05:52:20.898104+0000","last_peered":"2024-09-17T05:52:20.898104+0000","last_clean":"2024-09-17T05:52:20.898104+0000","last_became_active":"2024-09-17T05:52:19.927908+0000","last_became_peered":"2024-09-17T05:52:19.927908+0000","last_unstale":"2024-09-17T05:52:20.898104+0000","last_undegraded":"2024-09-17T05:52:20.898104+0000","last_fullsized":"2024-09-17T05:52:20.898104+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:52:18.873991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:52:18.873991+0000","last_clean_scrub_stamp":"2024-09-17T05:52:18.873991+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:26:19.092447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.36","version":"0'0","reported_seq":13,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-09-17T05:52:20.900177+0000","last_change":"2024-09-17T05:52:19.927798+0000","last_active":"2024-09-17T05:52:20.900177+0000","last_peered":"2024-09-17T05:52:20.900177+0000","last_clean":"2024-09-17T05:52:20.900177+0000","last_became_active":"2024-09-17T05:52:19.926257+0000","last_became_peered":"2024-09-17T05:52:19.926257+0000","last_unstale":"2024-09-17T05:52:20.900177+0000","last_undegraded":"2024-09-17T05:52:20.900177+0000","last_fullsized":"2024-09-17T05:52:20.900177+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:52:18.873991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:52:18.873991+0000","last_clean_scrub_stamp":"2024-09-17T05:52:18.873991+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:03:47.491680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.35","version":"0'0","reported_seq":13,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-09-17T05:52:21.029855+0000","last_change":"2024-09-17T05:52:19.905906+0000","last_active":"2024-09-17T05:52:21.029855+0000","last_peered":"2024-09-17T05:52:21.029855+0000","last_clean":"2024-09-17T05:52:21.029855+0000","last_became_active":"2024-09-17T05:52:19.905185+0000","last_became_peered":"2024-09-17T05:52:19.905185+0000","last_unstale":"2024-09-17T05:52:21.029855+0000","last_undegraded":"2024-09-17T05:52:21.029855+0000","last_fullsized":"2024-09-17T05:52:21.029855+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:52:18.873991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:52:18.873991+0000","last_clean_scrub_stamp":"2024-09-17T05:52:18.873991+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:42:59.395568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.34","version":"0'0","reported_seq":13,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-09-17T05:52:20.897596+0000","last_change":"2024-09-17T05:52:19.924840+0000","last_active":"2024-09-17T05:52:20.897596+0000","last_peered":"2024-09-17T05:52:20.897596+0000","last_clean":"2024-09-17T05:52:20.897596+0000","last_became_active":"2024-09-17T05:52:19.923792+0000","last_became_peered":"2024-09-17T05:52:19.923792+0000","last_unstale":"2024-09-17T05:52:20.897596+0000","last_undegraded":"2024-09-17T05:52:20.897596+0000","last_fullsized":"2024-09-17T05:52:20.897596+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:52:18.873991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:52:18.873991+0000","last_clean_scrub_stamp":"2024-09-17T05:52:18.873991+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:59:24.781962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.33","version":"0'0","reported_seq":13,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-09-17T05:52:20.898746+0000","last_change":"2024-09-17T05:52:19.928472+0000","last_active":"2024-09-17T05:52:20.898746+0000","last_peered":"2024-09-17T05:52:20.898746+0000","last_clean":"2024-09-17T05:52:20.898746+0000","last_became_active":"2024-09-17T05:52:19.928140+0000","last_became_peered":"2024-09-17T05:52:19.928140+0000","last_unstale":"2024-09-17T05:52:20.898746+0000","last_undegraded":"2024-09-17T05:52:20.898746+0000","last_fullsized":"2024-09-17T05:52:20.898746+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:52:18.873991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:52:18.873991+0000","last_clean_scrub_stamp":"2024-09-17T05:52:18.873991+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:42:30.942944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.32","version":"0'0","reported_seq":13,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-09-17T05:52:20.899523+0000","last_change":"2024-09-17T05:52:19.917603+0000","last_active":"2024-09-17T05:52:20.899523+0000","last_peered":"2024-09-17T05:52:20.899523+0000","last_clean":"2024-09-17T05:52:20.899523+0000","last_became_active":"2024-09-17T05:52:19.917263+0000","last_became_peered":"2024-09-17T05:52:19.917263+0000","last_unstale":"2024-09-17T05:52:20.899523+0000","last_undegraded":"2024-09-17T05:52:20.899523+0000","last_fullsized":"2024-09-17T05:52:20.899523+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:52:18.873991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:52:18.873991+0000","last_clean_scrub_stamp":"2024-09-17T05:52:18.873991+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:51:47.662102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.31","version":"0'0","reported_seq":13,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-09-17T05:52:20.898194+0000","last_change":"2024-09-17T05:52:19.917541+0000","last_active":"2024-09-17T05:52:20.898194+0000","last_peered":"2024-09-17T05:52:20.898194+0000","last_clean":"2024-09-17T05:52:20.898194+0000","last_became_active":"2024-09-17T05:52:19.917002+0000","last_became_peered":"2024-09-17T05:52:19.917002+0000","last_unstale":"2024-09-17T05:52:20.898194+0000","last_undegraded":"2024-09-17T05:52:20.898194+0000","last_fullsized":"2024-09-17T05:52:20.898194+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:52:18.873991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:52:18.873991+0000","last_clean_scrub_stamp":"2024-09-17T05:52:18.873991+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:22:12.966562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.30","version":"0'0","reported_seq":13,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-09-17T05:52:21.029573+0000","last_change":"2024-09-17T05:52:19.913101+0000","last_active":"2024-09-17T05:52:21.029573+0000","last_peered":"2024-09-17T05:52:21.029573+0000","last_clean":"2024-09-17T05:52:21.029573+0000","last_became_active":"2024-09-17T05:52:19.912706+0000","last_became_peered":"2024-09-17T05:52:19.912706+0000","last_unstale":"2024-09-17T05:52:21.029573+0000","last_undegraded":"2024-09-17T05:52:21.029573+0000","last_fullsized":"2024-09-17T05:52:21.029573+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:52:18.873991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:52:18.873991+0000","last_clean_scrub_stamp":"2024-09-17T05:52:18.873991+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:25:31.420646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.2f","version":"0'0","reported_seq":13,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-09-17T05:52:20.916291+0000","last_change":"2024-09-17T05:52:19.927246+0000","last_active":"2024-09-17T05:52:20.916291+0000","last_peered":"2024-09-17T05:52:20.916291+0000","last_clean":"2024-09-17T05:52:20.916291+0000","last_became_active":"2024-09-17T05:52:19.926923+0000","last_became_peered":"2024-09-17T05:52:19.926923+0000","last_unstale":"2024-09-17T05:52:20.916291+0000","last_undegraded":"2024-09-17T05:52:20.916291+0000","last_fullsized":"2024-09-17T05:52:20.916291+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:52:18.873991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:52:18.873991+0000","last_clean_scrub_stamp":"2024-09-17T05:52:18.873991+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:11:04.819830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.2e","version":"0'0","reported_seq":13,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-09-17T05:52:21.029920+0000","last_change":"2024-09-17T05:52:19.917011+0000","last_active":"2024-09-17T05:52:21.029920+0000","last_peered":"2024-09-17T05:52:21.029920+0000","last_clean":"2024-09-17T05:52:21.029920+0000","last_became_active":"2024-09-17T05:52:19.916646+0000","last_became_peered":"2024-09-17T05:52:19.916646+0000","last_unstale":"2024-09-17T05:52:21.029920+0000","last_undegraded":"2024-09-17T05:52:21.029920+0000","last_fullsized":"2024-09-17T05:52:21.029920+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:52:18.873991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:52:18.873991+0000","last_clean_scrub_stamp":"2024-09-17T05:52:18.873991+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:35:32.775637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.2d","version":"0'0","reported_seq":13,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-09-17T05:52:21.029925+0000","last_change":"2024-09-17T05:52:19.926758+0000","last_active":"2024-09-17T05:52:21.029925+0000","last_peered":"2024-09-17T05:52:21.029925+0000","last_clean":"2024-09-17T05:52:21.029925+0000","last_became_active":"2024-09-17T05:52:19.926399+0000","last_became_peered":"2024-09-17T05:52:19.926399+0000","last_unstale":"2024-09-17T05:52:21.029925+0000","last_undegraded":"2024-09-17T05:52:21.029925+0000","last_fullsized":"2024-09-17T05:52:21.029925+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:52:18.873991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:52:18.873991+0000","last_clean_scrub_stamp":"2024-09-17T05:52:18.873991+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:29:31.086507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.2c","version":"0'0","reported_seq":13,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-09-17T05:52:21.029968+0000","last_change":"2024-09-17T05:52:19.909258+0000","last_active":"2024-09-17T05:52:21.029968+0000","last_peered":"2024-09-17T05:52:21.029968+0000","last_clean":"2024-09-17T05:52:21.029968+0000","last_became_active":"2024-09-17T05:52:19.908594+0000","last_became_peered":"2024-09-17T05:52:19.908594+0000","last_unstale":"2024-09-17T05:52:21.029968+0000","last_undegraded":"2024-09-17T05:52:21.029968+0000","last_fullsized":"2024-09-17T05:52:21.029968+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:52:18.873991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:52:18.873991+0000","last_clean_scrub_stamp":"2024-09-17T05:52:18.873991+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:39:48.304671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.2b","version":"0'0","reported_seq":13,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-09-17T05:52:20.913343+0000","last_change":"2024-09-17T05:52:19.923630+0000","last_active":"2024-09-17T05:52:20.913343+0000","last_peered":"2024-09-17T05:52:20.913343+0000","last_clean":"2024-09-17T05:52:20.913343+0000","last_became_active":"2024-09-17T05:52:19.922986+0000","last_became_peered":"2024-09-17T05:52:19.922986+0000","last_unstale":"2024-09-17T05:52:20.913343+0000","last_undegraded":"2024-09-17T05:52:20.913343+0000","last_fullsized":"2024-09-17T05:52:20.913343+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:52:18.873991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:52:18.873991+0000","last_clean_scrub_stamp":"2024-09-17T05:52:18.873991+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:27:22.837955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.2a","version":"0'0","reported_seq":13,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-09-17T05:52:21.029880+0000","last_change":"2024-09-17T05:52:19.907967+0000","last_active":"2024-09-17T05:52:21.029880+0000","last_peered":"2024-09-17T05:52:21.029880+0000","last_clean":"2024-09-17T05:52:21.029880+0000","last_became_active":"2024-09-17T05:52:19.907649+0000","last_became_peered":"2024-09-17T05:52:19.907649+0000","last_unstale":"2024-09-17T05:52:21.029880+0000","last_undegraded":"2024-09-17T05:52:21.029880+0000","last_fullsized":"2024-09-17T05:52:21.029880+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:52:18.873991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:52:18.873991+0000","last_clean_scrub_stamp":"2024-09-17T05:52:18.873991+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:43:13.935866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.29","version":"0'0","reported_seq":13,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-09-17T05:52:20.897945+0000","last_change":"2024-09-17T05:52:19.924525+0000","last_active":"2024-09-17T05:52:20.897945+0000","last_peered":"2024-09-17T05:52:20.897945+0000","last_clean":"2024-09-17T05:52:20.897945+0000","last_became_active":"2024-09-17T05:52:19.924161+0000","last_became_peered":"2024-09-17T05:52:19.924161+0000","last_unstale":"2024-09-17T05:52:20.897945+0000","last_undegraded":"2024-09-17T05:52:20.897945+0000","last_fullsized":"2024-09-17T05:52:20.897945+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:52:18.873991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:52:18.873991+0000","last_clean_scrub_stamp":"2024-09-17T05:52:18.873991+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:36:49.213776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.28","version":"0'0","reported_seq":13,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-09-17T05:52:21.029358+0000","last_change":"2024-09-17T05:52:19.932794+0000","last_active":"2024-09-17T05:52:21.029358+0000","last_peered":"2024-09-17T05:52:21.029358+0000","last_clean":"2024-09-17T05:52:21.029358+0000","last_became_active":"2024-09-17T05:52:19.932449+0000","last_became_peered":"2024-09-17T05:52:19.932449+0000","last_unstale":"2024-09-17T05:52:21.029358+0000","last_undegraded":"2024-09-17T05:52:21.029358+0000","last_fullsized":"2024-09-17T05:52:21.029358+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:52:18.873991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:52:18.873991+0000","last_clean_scrub_stamp":"2024-09-17T05:52:18.873991+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:52:07.739392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.27","version":"0'0","reported_seq":13,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-09-17T05:52:20.900099+0000","last_change":"2024-09-17T05:52:19.912450+0000","last_active":"2024-09-17T05:52:20.900099+0000","last_peered":"2024-09-17T05:52:20.900099+0000","last_clean":"2024-09-17T05:52:20.900099+0000","last_became_active":"2024-09-17T05:52:19.912096+0000","last_became_peered":"2024-09-17T05:52:19.912096+0000","last_unstale":"2024-09-17T05:52:20.900099+0000","last_undegraded":"2024-09-17T05:52:20.900099+0000","last_fullsized":"2024-09-17T05:52:20.900099+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:52:18.873991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:52:18.873991+0000","last_clean_scrub_stamp":"2024-09-17T05:52:18.873991+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:32:29.027914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.26","version":"0'0","reported_seq":13,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-09-17T05:52:21.030347+0000","last_change":"2024-09-17T05:52:19.921071+0000","last_active":"2024-09-17T05:52:21.030347+0000","last_peered":"2024-09-17T05:52:21.030347+0000","last_clean":"2024-09-17T05:52:21.030347+0000","last_became_active":"2024-09-17T05:52:19.920770+0000","last_became_peered":"2024-09-17T05:52:19.920770+0000","last_unstale":"2024-09-17T05:52:21.030347+0000","last_undegraded":"2024-09-17T05:52:21.030347+0000","last_fullsized":"2024-09-17T05:52:21.030347+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:52:18.873991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:52:18.873991+0000","last_clean_scrub_stamp":"2024-09-17T05:52:18.873991+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:13:50.107788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.25","version":"0'0","reported_seq":13,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-09-17T05:52:20.898418+0000","last_change":"2024-09-17T05:52:19.927795+0000","last_active":"2024-09-17T05:52:20.898418+0000","last_peered":"2024-09-17T05:52:20.898418+0000","last_clean":"2024-09-17T05:52:20.898418+0000","last_became_active":"2024-09-17T05:52:19.927365+0000","last_became_peered":"2024-09-17T05:52:19.927365+0000","last_unstale":"2024-09-17T05:52:20.898418+0000","last_undegraded":"2024-09-17T05:52:20.898418+0000","last_fullsized":"2024-09-17T05:52:20.898418+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:52:18.873991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:52:18.873991+0000","last_clean_scrub_stamp":"2024-09-17T05:52:18.873991+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:31:38.910618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.24","version":"0'0","reported_seq":13,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-09-17T05:52:21.029763+0000","last_change":"2024-09-17T05:52:19.919487+0000","last_active":"2024-09-17T05:52:21.029763+0000","last_peered":"2024-09-17T05:52:21.029763+0000","last_clean":"2024-09-17T05:52:21.029763+0000","last_became_active":"2024-09-17T05:52:19.919132+0000","last_became_peered":"2024-09-17T05:52:19.919132+0000","last_unstale":"2024-09-17T05:52:21.029763+0000","last_undegraded":"2024-09-17T05:52:21.029763+0000","last_fullsized":"2024-09-17T05:52:21.029763+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:52:18.873991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:52:18.873991+0000","last_clean_scrub_stamp":"2024-09-17T05:52:18.873991+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:47:54.083475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.23","version":"0'0","reported_seq":13,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-09-17T05:52:20.898760+0000","last_change":"2024-09-17T05:52:19.920980+0000","last_active":"2024-09-17T05:52:20.898760+0000","last_peered":"2024-09-17T05:52:20.898760+0000","last_clean":"2024-09-17T05:52:20.898760+0000","last_became_active":"2024-09-17T05:52:19.920651+0000","last_became_peered":"2024-09-17T05:52:19.920651+0000","last_unstale":"2024-09-17T05:52:20.898760+0000","last_undegraded":"2024-09-17T05:52:20.898760+0000","last_fullsized":"2024-09-17T05:52:20.898760+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:52:18.873991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:52:18.873991+0000","last_clean_scrub_stamp":"2024-09-17T05:52:18.873991+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:12:05.544937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.22","version":"0'0","reported_seq":13,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-09-17T05:52:20.898557+0000","last_change":"2024-09-17T05:52:19.916812+0000","last_active":"2024-09-17T05:52:20.898557+0000","last_peered":"2024-09-17T05:52:20.898557+0000","last_clean":"2024-09-17T05:52:20.898557+0000","last_became_active":"2024-09-17T05:52:19.916455+0000","last_became_peered":"2024-09-17T05:52:19.916455+0000","last_unstale":"2024-09-17T05:52:20.898557+0000","last_undegraded":"2024-09-17T05:52:20.898557+0000","last_fullsized":"2024-09-17T05:52:20.898557+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:52:18.873991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:52:18.873991+0000","last_clean_scrub_stamp":"2024-09-17T05:52:18.873991+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:01:51.785896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.21","version":"0'0","reported_seq":13,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-09-17T05:52:20.912884+0000","last_change":"2024-09-17T05:52:19.921396+0000","last_active":"2024-09-17T05:52:20.912884+0000","last_peered":"2024-09-17T05:52:20.912884+0000","last_clean":"2024-09-17T05:52:20.912884+0000","last_became_active":"2024-09-17T05:52:19.916646+0000","last_became_peered":"2024-09-17T05:52:19.916646+0000","last_unstale":"2024-09-17T05:52:20.912884+0000","last_undegraded":"2024-09-17T05:52:20.912884+0000","last_fullsized":"2024-09-17T05:52:20.912884+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:52:18.873991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:52:18.873991+0000","last_clean_scrub_stamp":"2024-09-17T05:52:18.873991+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:31:59.058914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.20","version":"0'0","reported_seq":13,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-09-17T05:52:20.915791+0000","last_change":"2024-09-17T05:52:19.913824+0000","last_active":"2024-09-17T05:52:20.915791+0000","last_peered":"2024-09-17T05:52:20.915791+0000","last_clean":"2024-09-17T05:52:20.915791+0000","last_became_active":"2024-09-17T05:52:19.913513+0000","last_became_peered":"2024-09-17T05:52:19.913513+0000","last_unstale":"2024-09-17T05:52:20.915791+0000","last_undegraded":"2024-09-17T05:52:20.915791+0000","last_fullsized":"2024-09-17T05:52:20.915791+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:52:18.873991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:52:18.873991+0000","last_clean_scrub_stamp":"2024-09-17T05:52:18.873991+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:11:48.541624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.1e","version":"0'0","reported_seq":13,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-09-17T05:52:21.030345+0000","last_change":"2024-09-17T05:52:19.920065+0000","last_active":"2024-09-17T05:52:21.030345+0000","last_peered":"2024-09-17T05:52:21.030345+0000","last_clean":"2024-09-17T05:52:21.030345+0000","last_became_active":"2024-09-17T05:52:19.919754+0000","last_became_peered":"2024-09-17T05:52:19.919754+0000","last_unstale":"2024-09-17T05:52:21.030345+0000","last_undegraded":"2024-09-17T05:52:21.030345+0000","last_fullsized":"2024-09-17T05:52:21.030345+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:52:18.873991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:52:18.873991+0000","last_clean_scrub_stamp":"2024-09-17T05:52:18.873991+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:40:31.593162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.1f","version":"126'4","reported_seq":19,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-09-17T05:52:20.913562+0000","last_change":"2024-09-17T05:52:18.893653+0000","last_active":"2024-09-17T05:52:20.913562+0000","last_peered":"2024-09-17T05:52:20.913562+0000","last_clean":"2024-09-17T05:52:20.913562+0000","last_became_active":"2024-09-17T05:52:18.893296+0000","last_became_peered":"2024-09-17T05:52:18.893296+0000","last_unstale":"2024-09-17T05:52:20.913562+0000","last_undegraded":"2024-09-17T05:52:20.913562+0000","last_fullsized":"2024-09-17T05:52:20.913562+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:52:17.867506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:52:17.867506+0000","last_clean_scrub_stamp":"2024-09-17T05:52:17.867506+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:50:03.925050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.1f","version":"0'0","reported_seq":13,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-09-17T05:52:20.898201+0000","last_change":"2024-09-17T05:52:19.927446+0000","last_active":"2024-09-17T05:52:20.898201+0000","last_peered":"2024-09-17T05:52:20.898201+0000","last_clean":"2024-09-17T05:52:20.898201+0000","last_became_active":"2024-09-17T05:52:19.918688+0000","last_became_peered":"2024-09-17T05:52:19.918688+0000","last_unstale":"2024-09-17T05:52:20.898201+0000","last_undegraded":"2024-09-17T05:52:20.898201+0000","last_fullsized":"2024-09-17T05:52:20.898201+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:52:18.873991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:52:18.873991+0000","last_clean_scrub_stamp":"2024-09-17T05:52:18.873991+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:44:01.005729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.1e","version":"126'1","reported_seq":16,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-09-17T05:52:21.029801+0000","last_change":"2024-09-17T05:52:18.895473+0000","last_active":"2024-09-17T05:52:21.029801+0000","last_peered":"2024-09-17T05:52:21.029801+0000","last_clean":"2024-09-17T05:52:21.029801+0000","last_became_active":"2024-09-17T05:52:18.895096+0000","last_became_peered":"2024-09-17T05:52:18.895096+0000","last_unstale":"2024-09-17T05:52:21.029801+0000","last_undegraded":"2024-09-17T05:52:21.029801+0000","last_fullsized":"2024-09-17T05:52:21.029801+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:52:17.867506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:52:17.867506+0000","last_clean_scrub_stamp":"2024-09-17T05:52:17.867506+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:12:57.384707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.1c","version":"0'0","reported_seq":13,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-09-17T05:52:20.913652+0000","last_change":"2024-09-17T05:52:19.927142+0000","last_active":"2024-09-17T05:52:20.913652+0000","last_peered":"2024-09-17T05:52:20.913652+0000","last_clean":"2024-09-17T05:52:20.913652+0000","last_became_active":"2024-09-17T05:52:19.926836+0000","last_became_peered":"2024-09-17T05:52:19.926836+0000","last_unstale":"2024-09-17T05:52:20.913652+0000","last_undegraded":"2024-09-17T05:52:20.913652+0000","last_fullsized":"2024-09-17T05:52:20.913652+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:52:18.873991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:52:18.873991+0000","last_clean_scrub_stamp":"2024-09-17T05:52:18.873991+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:04:57.127249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.1d","version":"126'2","reported_seq":17,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-09-17T05:52:21.030022+0000","last_change":"2024-09-17T05:52:18.897259+0000","last_active":"2024-09-17T05:52:21.030022+0000","last_peered":"2024-09-17T05:52:21.030022+0000","last_clean":"2024-09-17T05:52:21.030022+0000","last_became_active":"2024-09-17T05:52:18.896947+0000","last_became_peered":"2024-09-17T05:52:18.896947+0000","last_unstale":"2024-09-17T05:52:21.030022+0000","last_undegraded":"2024-09-17T05:52:21.030022+0000","last_fullsized":"2024-09-17T05:52:21.030022+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:52:17.867506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:52:17.867506+0000","last_clean_scrub_stamp":"2024-09-17T05:52:17.867506+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:38:29.098685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.1d","version":"0'0","reported_seq":13,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-09-17T05:52:20.913030+0000","last_change":"2024-09-17T05:52:19.914720+0000","last_active":"2024-09-17T05:52:20.913030+0000","last_peered":"2024-09-17T05:52:20.913030+0000","last_clean":"2024-09-17T05:52:20.913030+0000","last_became_active":"2024-09-17T05:52:19.914342+0000","last_became_peered":"2024-09-17T05:52:19.914342+0000","last_unstale":"2024-09-17T05:52:20.913030+0000","last_undegraded":"2024-09-17T05:52:20.913030+0000","last_fullsized":"2024-09-17T05:52:20.913030+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:52:18.873991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:52:18.873991+0000","last_clean_scrub_stamp":"2024-09-17T05:52:18.873991+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:05:11.605569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.1c","version":"126'2","reported_seq":17,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-09-17T05:52:20.899808+0000","last_change":"2024-09-17T05:52:18.897273+0000","last_active":"2024-09-17T05:52:20.899808+0000","last_peered":"2024-09-17T05:52:20.899808+0000","last_clean":"2024-09-17T05:52:20.899808+0000","last_became_active":"2024-09-17T05:52:18.896887+0000","last_became_peered":"2024-09-17T05:52:18.896887+0000","last_unstale":"2024-09-17T05:52:20.899808+0000","last_undegraded":"2024-09-17T05:52:20.899808+0000","last_fullsized":"2024-09-17T05:52:20.899808+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:52:17.867506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:52:17.867506+0000","last_clean_scrub_stamp":"2024-09-17T05:52:17.867506+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:45:11.419166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.1a","version":"0'0","reported_seq":13,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-09-17T05:52:21.029685+0000","last_change":"2024-09-17T05:52:19.927841+0000","last_active":"2024-09-17T05:52:21.029685+0000","last_peered":"2024-09-17T05:52:21.029685+0000","last_clean":"2024-09-17T05:52:21.029685+0000","last_became_active":"2024-09-17T05:52:19.926892+0000","last_became_peered":"2024-09-17T05:52:19.926892+0000","last_unstale":"2024-09-17T05:52:21.029685+0000","last_undegraded":"2024-09-17T05:52:21.029685+0000","last_fullsized":"2024-09-17T05:52:21.029685+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:52:18.873991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:52:18.873991+0000","last_clean_scrub_stamp":"2024-09-17T05:52:18.873991+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:39:21.330823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.1b","version":"126'1","reported_seq":16,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-09-17T05:52:20.899260+0000","last_change":"2024-09-17T05:52:18.900769+0000","last_active":"2024-09-17T05:52:20.899260+0000","last_peered":"2024-09-17T05:52:20.899260+0000","last_clean":"2024-09-17T05:52:20.899260+0000","last_became_active":"2024-09-17T05:52:18.900376+0000","last_became_peered":"2024-09-17T05:52:18.900376+0000","last_unstale":"2024-09-17T05:52:20.899260+0000","last_undegraded":"2024-09-17T05:52:20.899260+0000","last_fullsized":"2024-09-17T05:52:20.899260+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:52:17.867506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:52:17.867506+0000","last_clean_scrub_stamp":"2024-09-17T05:52:17.867506+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:50:44.058591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.1b","version":"0'0","reported_seq":13,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-09-17T05:52:20.916633+0000","last_change":"2024-09-17T05:52:19.920703+0000","last_active":"2024-09-17T05:52:20.916633+0000","last_peered":"2024-09-17T05:52:20.916633+0000","last_clean":"2024-09-17T05:52:20.916633+0000","last_became_active":"2024-09-17T05:52:19.920376+0000","last_became_peered":"2024-09-17T05:52:19.920376+0000","last_unstale":"2024-09-17T05:52:20.916633+0000","last_undegraded":"2024-09-17T05:52:20.916633+0000","last_fullsized":"2024-09-17T05:52:20.916633+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:52:18.873991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:52:18.873991+0000","last_clean_scrub_stamp":"2024-09-17T05:52:18.873991+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:47:56.025899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.1a","version":"126'1","reported_seq":16,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-09-17T05:52:21.029437+0000","last_change":"2024-09-17T05:52:18.902862+0000","last_active":"2024-09-17T05:52:21.029437+0000","last_peered":"2024-09-17T05:52:21.029437+0000","last_clean":"2024-09-17T05:52:21.029437+0000","last_became_active":"2024-09-17T05:52:18.902515+0000","last_became_peered":"2024-09-17T05:52:18.902515+0000","last_unstale":"2024-09-17T05:52:21.029437+0000","last_undegraded":"2024-09-17T05:52:21.029437+0000","last_fullsized":"2024-09-17T05:52:21.029437+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:52:17.867506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:52:17.867506+0000","last_clean_scrub_stamp":"2024-09-17T05:52:17.867506+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:54:10.006968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.18","version":"0'0","reported_seq":13,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-09-17T05:52:20.898039+0000","last_change":"2024-09-17T05:52:19.905864+0000","last_active":"2024-09-17T05:52:20.898039+0000","last_peered":"2024-09-17T05:52:20.898039+0000","last_clean":"2024-09-17T05:52:20.898039+0000","last_became_active":"2024-09-17T05:52:19.905377+0000","last_became_peered":"2024-09-17T05:52:19.905377+0000","last_unstale":"2024-09-17T05:52:20.898039+0000","last_undegraded":"2024-09-17T05:52:20.898039+0000","last_fullsized":"2024-09-17T05:52:20.898039+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:52:18.873991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:52:18.873991+0000","last_clean_scrub_stamp":"2024-09-17T05:52:18.873991+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:38:43.436763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.19","version":"0'0","reported_seq":15,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-09-17T05:52:20.915745+0000","last_change":"2024-09-17T05:52:18.895524+0000","last_active":"2024-09-17T05:52:20.915745+0000","last_peered":"2024-09-17T05:52:20.915745+0000","last_clean":"2024-09-17T05:52:20.915745+0000","last_became_active":"2024-09-17T05:52:18.895221+0000","last_became_peered":"2024-09-17T05:52:18.895221+0000","last_unstale":"2024-09-17T05:52:20.915745+0000","last_undegraded":"2024-09-17T05:52:20.915745+0000","last_fullsized":"2024-09-17T05:52:20.915745+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:52:17.867506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:52:17.867506+0000","last_clean_scrub_stamp":"2024-09-17T05:52:17.867506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:03:36.241448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.19","version":"0'0","reported_seq":13,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-09-17T05:52:20.899352+0000","last_change":"2024-09-17T05:52:19.908005+0000","last_active":"2024-09-17T05:52:20.899352+0000","last_peered":"2024-09-17T05:52:20.899352+0000","last_clean":"2024-09-17T05:52:20.899352+0000","last_became_active":"2024-09-17T05:52:19.907517+0000","last_became_peered":"2024-09-17T05:52:19.907517+0000","last_unstale":"2024-09-17T05:52:20.899352+0000","last_undegraded":"2024-09-17T05:52:20.899352+0000","last_fullsized":"2024-09-17T05:52:20.899352+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:52:18.873991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:52:18.873991+0000","last_clean_scrub_stamp":"2024-09-17T05:52:18.873991+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:36:40.355849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.18","version":"0'0","reported_seq":15,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-09-17T05:52:20.899405+0000","last_change":"2024-09-17T05:52:18.896929+0000","last_active":"2024-09-17T05:52:20.899405+0000","last_peered":"2024-09-17T05:52:20.899405+0000","last_clean":"2024-09-17T05:52:20.899405+0000","last_became_active":"2024-09-17T05:52:18.896507+0000","last_became_peered":"2024-09-17T05:52:18.896507+0000","last_unstale":"2024-09-17T05:52:20.899405+0000","last_undegraded":"2024-09-17T05:52:20.899405+0000","last_fullsized":"2024-09-17T05:52:20.899405+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:52:17.867506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:52:17.867506+0000","last_clean_scrub_stamp":"2024-09-17T05:52:17.867506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:44:27.327469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.16","version":"0'0","reported_seq":13,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-09-17T05:52:20.898450+0000","last_change":"2024-09-17T05:52:19.916951+0000","last_active":"2024-09-17T05:52:20.898450+0000","last_peered":"2024-09-17T05:52:20.898450+0000","last_clean":"2024-09-17T05:52:20.898450+0000","last_became_active":"2024-09-17T05:52:19.916630+0000","last_became_peered":"2024-09-17T05:52:19.916630+0000","last_unstale":"2024-09-17T05:52:20.898450+0000","last_undegraded":"2024-09-17T05:52:20.898450+0000","last_fullsized":"2024-09-17T05:52:20.898450+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:52:18.873991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:52:18.873991+0000","last_clean_scrub_stamp":"2024-09-17T05:52:18.873991+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:54:37.842874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.17","version":"0'0","reported_seq":15,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-09-17T05:52:21.030071+0000","last_change":"2024-09-17T05:52:18.894591+0000","last_active":"2024-09-17T05:52:21.030071+0000","last_peered":"2024-09-17T05:52:21.030071+0000","last_clean":"2024-09-17T05:52:21.030071+0000","last_became_active":"2024-09-17T05:52:18.894241+0000","last_became_peered":"2024-09-17T05:52:18.894241+0000","last_unstale":"2024-09-17T05:52:21.030071+0000","last_undegraded":"2024-09-17T05:52:21.030071+0000","last_fullsized":"2024-09-17T05:52:21.030071+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:52:17.867506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:52:17.867506+0000","last_clean_scrub_stamp":"2024-09-17T05:52:17.867506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:32:31.037419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.17","version":"0'0","reported_seq":13,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-09-17T05:52:21.029975+0000","last_change":"2024-09-17T05:52:19.918028+0000","last_active":"2024-09-17T05:52:21.029975+0000","last_peered":"2024-09-17T05:52:21.029975+0000","last_clean":"2024-09-17T05:52:21.029975+0000","last_became_active":"2024-09-17T05:52:19.916968+0000","last_became_peered":"2024-09-17T05:52:19.916968+0000","last_unstale":"2024-09-17T05:52:21.029975+0000","last_undegraded":"2024-09-17T05:52:21.029975+0000","last_fullsized":"2024-09-17T05:52:21.029975+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:52:18.873991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:52:18.873991+0000","last_clean_scrub_stamp":"2024-09-17T05:52:18.873991+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:23:24.221785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.16","version":"0'0","reported_seq":15,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-09-17T05:52:21.030385+0000","last_change":"2024-09-17T05:52:18.897065+0000","last_active":"2024-09-17T05:52:21.030385+0000","last_peered":"2024-09-17T05:52:21.030385+0000","last_clean":"2024-09-17T05:52:21.030385+0000","last_became_active":"2024-09-17T05:52:18.896692+0000","last_became_peered":"2024-09-17T05:52:18.896692+0000","last_unstale":"2024-09-17T05:52:21.030385+0000","last_undegraded":"2024-09-17T05:52:21.030385+0000","last_fullsized":"2024-09-17T05:52:21.030385+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:52:17.867506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:52:17.867506+0000","last_clean_scrub_stamp":"2024-09-17T05:52:17.867506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:47:55.019414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.14","version":"0'0","reported_seq":13,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-09-17T05:52:20.913700+0000","last_change":"2024-09-17T05:52:19.912074+0000","last_active":"2024-09-17T05:52:20.913700+0000","last_peered":"2024-09-17T05:52:20.913700+0000","last_clean":"2024-09-17T05:52:20.913700+0000","last_became_active":"2024-09-17T05:52:19.911738+0000","last_became_peered":"2024-09-17T05:52:19.911738+0000","last_unstale":"2024-09-17T05:52:20.913700+0000","last_undegraded":"2024-09-17T05:52:20.913700+0000","last_fullsized":"2024-09-17T05:52:20.913700+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:52:18.873991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:52:18.873991+0000","last_clean_scrub_stamp":"2024-09-17T05:52:18.873991+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:23:11.922990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.15","version":"126'3","reported_seq":18,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-09-17T05:52:21.029706+0000","last_change":"2024-09-17T05:52:18.899892+0000","last_active":"2024-09-17T05:52:21.029706+0000","last_peered":"2024-09-17T05:52:21.029706+0000","last_clean":"2024-09-17T05:52:21.029706+0000","last_became_active":"2024-09-17T05:52:18.899449+0000","last_became_peered":"2024-09-17T05:52:18.899449+0000","last_unstale":"2024-09-17T05:52:21.029706+0000","last_undegraded":"2024-09-17T05:52:21.029706+0000","last_fullsized":"2024-09-17T05:52:21.029706+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:52:17.867506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:52:17.867506+0000","last_clean_scrub_stamp":"2024-09-17T05:52:17.867506+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:01:50.779410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.15","version":"0'0","reported_seq":13,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-09-17T05:52:20.913349+0000","last_change":"2024-09-17T05:52:19.909257+0000","last_active":"2024-09-17T05:52:20.913349+0000","last_peered":"2024-09-17T05:52:20.913349+0000","last_clean":"2024-09-17T05:52:20.913349+0000","last_became_active":"2024-09-17T05:52:19.908004+0000","last_became_peered":"2024-09-17T05:52:19.908004+0000","last_unstale":"2024-09-17T05:52:20.913349+0000","last_undegraded":"2024-09-17T05:52:20.913349+0000","last_fullsized":"2024-09-17T05:52:20.913349+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:52:18.873991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:52:18.873991+0000","last_clean_scrub_stamp":"2024-09-17T05:52:18.873991+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:41:01.713245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.14","version":"126'6","reported_seq":21,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-09-17T05:52:20.897695+0000","last_change":"2024-09-17T05:52:18.894488+0000","last_active":"2024-09-17T05:52:20.897695+0000","last_peered":"2024-09-17T05:52:20.897695+0000","last_clean":"2024-09-17T05:52:20.897695+0000","last_became_active":"2024-09-17T05:52:18.894159+0000","last_became_peered":"2024-09-17T05:52:18.894159+0000","last_unstale":"2024-09-17T05:52:20.897695+0000","last_undegraded":"2024-09-17T05:52:20.897695+0000","last_fullsized":"2024-09-17T05:52:20.897695+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:52:17.867506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:52:17.867506+0000","last_clean_scrub_stamp":"2024-09-17T05:52:17.867506+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:14:53.920161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.13","version":"0'0","reported_seq":13,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-09-17T05:52:20.898988+0000","last_change":"2024-09-17T05:52:19.915304+0000","last_active":"2024-09-17T05:52:20.898988+0000","last_peered":"2024-09-17T05:52:20.898988+0000","last_clean":"2024-09-17T05:52:20.898988+0000","last_became_active":"2024-09-17T05:52:19.914759+0000","last_became_peered":"2024-09-17T05:52:19.914759+0000","last_unstale":"2024-09-17T05:52:20.898988+0000","last_undegraded":"2024-09-17T05:52:20.898988+0000","last_fullsized":"2024-09-17T05:52:20.898988+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:52:18.873991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:52:18.873991+0000","last_clean_scrub_stamp":"2024-09-17T05:52:18.873991+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:03:43.903550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.12","version":"0'0","reported_seq":15,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-09-17T05:52:20.898567+0000","last_change":"2024-09-17T05:52:18.891286+0000","last_active":"2024-09-17T05:52:20.898567+0000","last_peered":"2024-09-17T05:52:20.898567+0000","last_clean":"2024-09-17T05:52:20.898567+0000","last_became_active":"2024-09-17T05:52:18.890871+0000","last_became_peered":"2024-09-17T05:52:18.890871+0000","last_unstale":"2024-09-17T05:52:20.898567+0000","last_undegraded":"2024-09-17T05:52:20.898567+0000","last_fullsized":"2024-09-17T05:52:20.898567+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:52:17.867506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:52:17.867506+0000","last_clean_scrub_stamp":"2024-09-17T05:52:17.867506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:16:14.185969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.10","version":"0'0","reported_seq":13,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-09-17T05:52:20.899453+0000","last_change":"2024-09-17T05:52:19.907832+0000","last_active":"2024-09-17T05:52:20.899453+0000","last_peered":"2024-09-17T05:52:20.899453+0000","last_clean":"2024-09-17T05:52:20.899453+0000","last_became_active":"2024-09-17T05:52:19.907363+0000","last_became_peered":"2024-09-17T05:52:19.907363+0000","last_unstale":"2024-09-17T05:52:20.899453+0000","last_undegraded":"2024-09-17T05:52:20.899453+0000","last_fullsized":"2024-09-17T05:52:20.899453+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:52:18.873991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:52:18.873991+0000","last_clean_scrub_stamp":"2024-09-17T05:52:18.873991+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:11:34.492188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.11","version":"0'0","reported_seq":15,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-09-17T05:52:20.899439+0000","last_change":"2024-09-17T05:52:18.898301+0000","last_active":"2024-09-17T05:52:20.899439+0000","last_peered":"2024-09-17T05:52:20.899439+0000","last_clean":"2024-09-17T05:52:20.899439+0000","last_became_active":"2024-09-17T05:52:18.897983+0000","last_became_peered":"2024-09-17T05:52:18.897983+0000","last_unstale":"2024-09-17T05:52:20.899439+0000","last_undegraded":"2024-09-17T05:52:20.899439+0000","last_fullsized":"2024-09-17T05:52:20.899439+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:52:17.867506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:52:17.867506+0000","last_clean_scrub_stamp":"2024-09-17T05:52:17.867506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:22:26.229997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.11","version":"0'0","reported_seq":13,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-09-17T05:52:20.897635+0000","last_change":"2024-09-17T05:52:19.924606+0000","last_active":"2024-09-17T05:52:20.897635+0000","last_peered":"2024-09-17T05:52:20.897635+0000","last_clean":"2024-09-17T05:52:20.897635+0000","last_became_active":"2024-09-17T05:52:19.924303+0000","last_became_peered":"2024-09-17T05:52:19.924303+0000","last_unstale":"2024-09-17T05:52:20.897635+0000","last_undegraded":"2024-09-17T05:52:20.897635+0000","last_fullsized":"2024-09-17T05:52:20.897635+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:52:18.873991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:52:18.873991+0000","last_clean_scrub_stamp":"2024-09-17T05:52:18.873991+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:31:07.855157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.10","version":"126'8","reported_seq":23,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-09-17T05:52:20.897968+0000","last_change":"2024-09-17T05:52:18.899319+0000","last_active":"2024-09-17T05:52:20.897968+0000","last_peered":"2024-09-17T05:52:20.897968+0000","last_clean":"2024-09-17T05:52:20.897968+0000","last_became_active":"2024-09-17T05:52:18.898986+0000","last_became_peered":"2024-09-17T05:52:18.898986+0000","last_unstale":"2024-09-17T05:52:20.897968+0000","last_undegraded":"2024-09-17T05:52:20.897968+0000","last_fullsized":"2024-09-17T05:52:20.897968+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:52:17.867506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:52:17.867506+0000","last_clean_scrub_stamp":"2024-09-17T05:52:17.867506+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:34:06.198386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.e","version":"0'0","reported_seq":13,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-09-17T05:52:20.898315+0000","last_change":"2024-09-17T05:52:19.920533+0000","last_active":"2024-09-17T05:52:20.898315+0000","last_peered":"2024-09-17T05:52:20.898315+0000","last_clean":"2024-09-17T05:52:20.898315+0000","last_became_active":"2024-09-17T05:52:19.920173+0000","last_became_peered":"2024-09-17T05:52:19.920173+0000","last_unstale":"2024-09-17T05:52:20.898315+0000","last_undegraded":"2024-09-17T05:52:20.898315+0000","last_fullsized":"2024-09-17T05:52:20.898315+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:52:18.873991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:52:18.873991+0000","last_clean_scrub_stamp":"2024-09-17T05:52:18.873991+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:19:04.088875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.f","version":"126'1","reported_seq":16,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-09-17T05:52:21.030089+0000","last_change":"2024-09-17T05:52:18.897267+0000","last_active":"2024-09-17T05:52:21.030089+0000","last_peered":"2024-09-17T05:52:21.030089+0000","last_clean":"2024-09-17T05:52:21.030089+0000","last_became_active":"2024-09-17T05:52:18.896904+0000","last_became_peered":"2024-09-17T05:52:18.896904+0000","last_unstale":"2024-09-17T05:52:21.030089+0000","last_undegraded":"2024-09-17T05:52:21.030089+0000","last_fullsized":"2024-09-17T05:52:21.030089+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:52:17.867506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:52:17.867506+0000","last_clean_scrub_stamp":"2024-09-17T05:52:17.867506+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:12:04.538452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.f","version":"0'0","reported_seq":13,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-09-17T05:52:21.029915+0000","last_change":"2024-09-17T05:52:19.919016+0000","last_active":"2024-09-17T05:52:21.029915+0000","last_peered":"2024-09-17T05:52:21.029915+0000","last_clean":"2024-09-17T05:52:21.029915+0000","last_became_active":"2024-09-17T05:52:19.918688+0000","last_became_peered":"2024-09-17T05:52:19.918688+0000","last_unstale":"2024-09-17T05:52:21.029915+0000","last_undegraded":"2024-09-17T05:52:21.029915+0000","last_fullsized":"2024-09-17T05:52:21.029915+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:52:18.873991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:52:18.873991+0000","last_clean_scrub_stamp":"2024-09-17T05:52:18.873991+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:31:23.140660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.e","version":"126'2","reported_seq":17,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-09-17T05:52:21.029853+0000","last_change":"2024-09-17T05:52:18.893709+0000","last_active":"2024-09-17T05:52:21.029853+0000","last_peered":"2024-09-17T05:52:21.029853+0000","last_clean":"2024-09-17T05:52:21.029853+0000","last_became_active":"2024-09-17T05:52:18.893409+0000","last_became_peered":"2024-09-17T05:52:18.893409+0000","last_unstale":"2024-09-17T05:52:21.029853+0000","last_undegraded":"2024-09-17T05:52:21.029853+0000","last_fullsized":"2024-09-17T05:52:21.029853+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:52:17.867506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:52:17.867506+0000","last_clean_scrub_stamp":"2024-09-17T05:52:17.867506+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:32:56.225412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.c","version":"0'0","reported_seq":13,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-09-17T05:52:21.030198+0000","last_change":"2024-09-17T05:52:19.920886+0000","last_active":"2024-09-17T05:52:21.030198+0000","last_peered":"2024-09-17T05:52:21.030198+0000","last_clean":"2024-09-17T05:52:21.030198+0000","last_became_active":"2024-09-17T05:52:19.920557+0000","last_became_peered":"2024-09-17T05:52:19.920557+0000","last_unstale":"2024-09-17T05:52:21.030198+0000","last_undegraded":"2024-09-17T05:52:21.030198+0000","last_fullsized":"2024-09-17T05:52:21.030198+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:52:18.873991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:52:18.873991+0000","last_clean_scrub_stamp":"2024-09-17T05:52:18.873991+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:25:48.964343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.d","version":"126'1","reported_seq":16,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-09-17T05:52:20.916203+0000","last_change":"2024-09-17T05:52:18.896965+0000","last_active":"2024-09-17T05:52:20.916203+0000","last_peered":"2024-09-17T05:52:20.916203+0000","last_clean":"2024-09-17T05:52:20.916203+0000","last_became_active":"2024-09-17T05:52:18.896665+0000","last_became_peered":"2024-09-17T05:52:18.896665+0000","last_unstale":"2024-09-17T05:52:20.916203+0000","last_undegraded":"2024-09-17T05:52:20.916203+0000","last_fullsized":"2024-09-17T05:52:20.916203+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:52:17.867506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:52:17.867506+0000","last_clean_scrub_stamp":"2024-09-17T05:52:17.867506+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:03:31.140556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.d","version":"0'0","reported_seq":13,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-09-17T05:52:20.900093+0000","last_change":"2024-09-17T05:52:19.901706+0000","last_active":"2024-09-17T05:52:20.900093+0000","last_peered":"2024-09-17T05:52:20.900093+0000","last_clean":"2024-09-17T05:52:20.900093+0000","last_became_active":"2024-09-17T05:52:19.901106+0000","last_became_peered":"2024-09-17T05:52:19.901106+0000","last_unstale":"2024-09-17T05:52:20.900093+0000","last_undegraded":"2024-09-17T05:52:20.900093+0000","last_fullsized":"2024-09-17T05:52:20.900093+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:52:18.873991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:52:18.873991+0000","last_clean_scrub_stamp":"2024-09-17T05:52:18.873991+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:57:34.081828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.c","version":"0'0","reported_seq":15,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-09-17T05:52:21.029699+0000","last_change":"2024-09-17T05:52:18.897796+0000","last_active":"2024-09-17T05:52:21.029699+0000","last_peered":"2024-09-17T05:52:21.029699+0000","last_clean":"2024-09-17T05:52:21.029699+0000","last_became_active":"2024-09-17T05:52:18.896607+0000","last_became_peered":"2024-09-17T05:52:18.896607+0000","last_unstale":"2024-09-17T05:52:21.029699+0000","last_undegraded":"2024-09-17T05:52:21.029699+0000","last_fullsized":"2024-09-17T05:52:21.029699+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:52:17.867506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:52:17.867506+0000","last_clean_scrub_stamp":"2024-09-17T05:52:17.867506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:06:49.196334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.a","version":"0'0","reported_seq":13,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-09-17T05:52:20.898493+0000","last_change":"2024-09-17T05:52:19.927684+0000","last_active":"2024-09-17T05:52:20.898493+0000","last_peered":"2024-09-17T05:52:20.898493+0000","last_clean":"2024-09-17T05:52:20.898493+0000","last_became_active":"2024-09-17T05:52:19.927177+0000","last_became_peered":"2024-09-17T05:52:19.927177+0000","last_unstale":"2024-09-17T05:52:20.898493+0000","last_undegraded":"2024-09-17T05:52:20.898493+0000","last_fullsized":"2024-09-17T05:52:20.898493+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:52:18.873991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:52:18.873991+0000","last_clean_scrub_stamp":"2024-09-17T05:52:18.873991+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:14:26.990346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.b","version":"126'2","reported_seq":17,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-09-17T05:52:21.029634+0000","last_change":"2024-09-17T05:52:18.898700+0000","last_active":"2024-09-17T05:52:21.029634+0000","last_peered":"2024-09-17T05:52:21.029634+0000","last_clean":"2024-09-17T05:52:21.029634+0000","last_became_active":"2024-09-17T05:52:18.898205+0000","last_became_peered":"2024-09-17T05:52:18.898205+0000","last_unstale":"2024-09-17T05:52:21.029634+0000","last_undegraded":"2024-09-17T05:52:21.029634+0000","last_fullsized":"2024-09-17T05:52:21.029634+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:52:17.867506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:52:17.867506+0000","last_clean_scrub_stamp":"2024-09-17T05:52:17.867506+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:03:42.897065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.b","version":"0'0","reported_seq":13,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-09-17T05:52:20.916229+0000","last_change":"2024-09-17T05:52:19.926434+0000","last_active":"2024-09-17T05:52:20.916229+0000","last_peered":"2024-09-17T05:52:20.916229+0000","last_clean":"2024-09-17T05:52:20.916229+0000","last_became_active":"2024-09-17T05:52:19.926138+0000","last_became_peered":"2024-09-17T05:52:19.926138+0000","last_unstale":"2024-09-17T05:52:20.916229+0000","last_undegraded":"2024-09-17T05:52:20.916229+0000","last_fullsized":"2024-09-17T05:52:20.916229+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:52:18.873991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:52:18.873991+0000","last_clean_scrub_stamp":"2024-09-17T05:52:18.873991+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:39:56.592090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.a","version":"0'0","reported_seq":15,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-09-17T05:52:21.029979+0000","last_change":"2024-09-17T05:52:18.898808+0000","last_active":"2024-09-17T05:52:21.029979+0000","last_peered":"2024-09-17T05:52:21.029979+0000","last_clean":"2024-09-17T05:52:21.029979+0000","last_became_active":"2024-09-17T05:52:18.896625+0000","last_became_peered":"2024-09-17T05:52:18.896625+0000","last_unstale":"2024-09-17T05:52:21.029979+0000","last_undegraded":"2024-09-17T05:52:21.029979+0000","last_fullsized":"2024-09-17T05:52:21.029979+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:52:17.867506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:52:17.867506+0000","last_clean_scrub_stamp":"2024-09-17T05:52:17.867506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:51:09.016534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.8","version":"0'0","reported_seq":13,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-09-17T05:52:20.899352+0000","last_change":"2024-09-17T05:52:19.904110+0000","last_active":"2024-09-17T05:52:20.899352+0000","last_peered":"2024-09-17T05:52:20.899352+0000","last_clean":"2024-09-17T05:52:20.899352+0000","last_became_active":"2024-09-17T05:52:19.902711+0000","last_became_peered":"2024-09-17T05:52:19.902711+0000","last_unstale":"2024-09-17T05:52:20.899352+0000","last_undegraded":"2024-09-17T05:52:20.899352+0000","last_fullsized":"2024-09-17T05:52:20.899352+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:52:18.873991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:52:18.873991+0000","last_clean_scrub_stamp":"2024-09-17T05:52:18.873991+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:13:08.301123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.9","version":"0'0","reported_seq":15,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-09-17T05:52:21.029274+0000","last_change":"2024-09-17T05:52:18.899801+0000","last_active":"2024-09-17T05:52:21.029274+0000","last_peered":"2024-09-17T05:52:21.029274+0000","last_clean":"2024-09-17T05:52:21.029274+0000","last_became_active":"2024-09-17T05:52:18.899430+0000","last_became_peered":"2024-09-17T05:52:18.899430+0000","last_unstale":"2024-09-17T05:52:21.029274+0000","last_undegraded":"2024-09-17T05:52:21.029274+0000","last_fullsized":"2024-09-17T05:52:21.029274+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:52:17.867506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:52:17.867506+0000","last_clean_scrub_stamp":"2024-09-17T05:52:17.867506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:03:01.468238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.9","version":"0'0","reported_seq":13,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-09-17T05:52:20.913125+0000","last_change":"2024-09-17T05:52:19.920709+0000","last_active":"2024-09-17T05:52:20.913125+0000","last_peered":"2024-09-17T05:52:20.913125+0000","last_clean":"2024-09-17T05:52:20.913125+0000","last_became_active":"2024-09-17T05:52:19.917358+0000","last_became_peered":"2024-09-17T05:52:19.917358+0000","last_unstale":"2024-09-17T05:52:20.913125+0000","last_undegraded":"2024-09-17T05:52:20.913125+0000","last_fullsized":"2024-09-17T05:52:20.913125+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:52:18.873991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:52:18.873991+0000","last_clean_scrub_stamp":"2024-09-17T05:52:18.873991+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:02:10.659710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.8","version":"0'0","reported_seq":15,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-09-17T05:52:21.029468+0000","last_change":"2024-09-17T05:52:18.893798+0000","last_active":"2024-09-17T05:52:21.029468+0000","last_peered":"2024-09-17T05:52:21.029468+0000","last_clean":"2024-09-17T05:52:21.029468+0000","last_became_active":"2024-09-17T05:52:18.893085+0000","last_became_peered":"2024-09-17T05:52:18.893085+0000","last_unstale":"2024-09-17T05:52:21.029468+0000","last_undegraded":"2024-09-17T05:52:21.029468+0000","last_fullsized":"2024-09-17T05:52:21.029468+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:52:17.867506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:52:17.867506+0000","last_clean_scrub_stamp":"2024-09-17T05:52:17.867506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:35:59.710747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.6","version":"0'0","reported_seq":13,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-09-17T05:52:20.916705+0000","last_change":"2024-09-17T05:52:19.926025+0000","last_active":"2024-09-17T05:52:20.916705+0000","last_peered":"2024-09-17T05:52:20.916705+0000","last_clean":"2024-09-17T05:52:20.916705+0000","last_became_active":"2024-09-17T05:52:19.925657+0000","last_became_peered":"2024-09-17T05:52:19.925657+0000","last_unstale":"2024-09-17T05:52:20.916705+0000","last_undegraded":"2024-09-17T05:52:20.916705+0000","last_fullsized":"2024-09-17T05:52:20.916705+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:52:18.873991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:52:18.873991+0000","last_clean_scrub_stamp":"2024-09-17T05:52:18.873991+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:54:11.013453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.7","version":"126'2","reported_seq":17,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-09-17T05:52:20.898639+0000","last_change":"2024-09-17T05:52:18.891660+0000","last_active":"2024-09-17T05:52:20.898639+0000","last_peered":"2024-09-17T05:52:20.898639+0000","last_clean":"2024-09-17T05:52:20.898639+0000","last_became_active":"2024-09-17T05:52:18.891313+0000","last_became_peered":"2024-09-17T05:52:18.891313+0000","last_unstale":"2024-09-17T05:52:20.898639+0000","last_undegraded":"2024-09-17T05:52:20.898639+0000","last_fullsized":"2024-09-17T05:52:20.898639+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:52:17.867506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:52:17.867506+0000","last_clean_scrub_stamp":"2024-09-17T05:52:17.867506+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:29:09.065979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.7","version":"0'0","reported_seq":13,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-09-17T05:52:20.898471+0000","last_change":"2024-09-17T05:52:19.929735+0000","last_active":"2024-09-17T05:52:20.898471+0000","last_peered":"2024-09-17T05:52:20.898471+0000","last_clean":"2024-09-17T05:52:20.898471+0000","last_became_active":"2024-09-17T05:52:19.929425+0000","last_became_peered":"2024-09-17T05:52:19.929425+0000","last_unstale":"2024-09-17T05:52:20.898471+0000","last_undegraded":"2024-09-17T05:52:20.898471+0000","last_fullsized":"2024-09-17T05:52:20.898471+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:52:18.873991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:52:18.873991+0000","last_clean_scrub_stamp":"2024-09-17T05:52:18.873991+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:07:37.135481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.6","version":"127'1","reported_seq":16,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-09-17T05:52:20.914810+0000","last_change":"2024-09-17T05:52:18.893591+0000","last_active":"2024-09-17T05:52:20.914810+0000","last_peered":"2024-09-17T05:52:20.914810+0000","last_clean":"2024-09-17T05:52:20.914810+0000","last_became_active":"2024-09-17T05:52:18.893254+0000","last_became_peered":"2024-09-17T05:52:18.893254+0000","last_unstale":"2024-09-17T05:52:20.914810+0000","last_undegraded":"2024-09-17T05:52:20.914810+0000","last_fullsized":"2024-09-17T05:52:20.914810+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:52:17.867506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:52:17.867506+0000","last_clean_scrub_stamp":"2024-09-17T05:52:17.867506+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:20:34.378498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.4","version":"0'0","reported_seq":13,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-09-17T05:52:20.899850+0000","last_change":"2024-09-17T05:52:19.913022+0000","last_active":"2024-09-17T05:52:20.899850+0000","last_peered":"2024-09-17T05:52:20.899850+0000","last_clean":"2024-09-17T05:52:20.899850+0000","last_became_active":"2024-09-17T05:52:19.912604+0000","last_became_peered":"2024-09-17T05:52:19.912604+0000","last_unstale":"2024-09-17T05:52:20.899850+0000","last_undegraded":"2024-09-17T05:52:20.899850+0000","last_fullsized":"2024-09-17T05:52:20.899850+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:52:18.873991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:52:18.873991+0000","last_clean_scrub_stamp":"2024-09-17T05:52:18.873991+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:20:52.890270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.5","version":"0'0","reported_seq":15,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-09-17T05:52:20.899960+0000","last_change":"2024-09-17T05:52:18.898676+0000","last_active":"2024-09-17T05:52:20.899960+0000","last_peered":"2024-09-17T05:52:20.899960+0000","last_clean":"2024-09-17T05:52:20.899960+0000","last_became_active":"2024-09-17T05:52:18.898353+0000","last_became_peered":"2024-09-17T05:52:18.898353+0000","last_unstale":"2024-09-17T05:52:20.899960+0000","last_undegraded":"2024-09-17T05:52:20.899960+0000","last_fullsized":"2024-09-17T05:52:20.899960+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:52:17.867506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:52:17.867506+0000","last_clean_scrub_stamp":"2024-09-17T05:52:17.867506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:48:02.170810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.5","version":"0'0","reported_seq":13,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-09-17T05:52:20.916284+0000","last_change":"2024-09-17T05:52:19.926104+0000","last_active":"2024-09-17T05:52:20.916284+0000","last_peered":"2024-09-17T05:52:20.916284+0000","last_clean":"2024-09-17T05:52:20.916284+0000","last_became_active":"2024-09-17T05:52:19.925767+0000","last_became_peered":"2024-09-17T05:52:19.925767+0000","last_unstale":"2024-09-17T05:52:20.916284+0000","last_undegraded":"2024-09-17T05:52:20.916284+0000","last_fullsized":"2024-09-17T05:52:20.916284+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:52:18.873991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:52:18.873991+0000","last_clean_scrub_stamp":"2024-09-17T05:52:18.873991+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:43:20.839584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.4","version":"0'0","reported_seq":15,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-09-17T05:52:21.030170+0000","last_change":"2024-09-17T05:52:18.898186+0000","last_active":"2024-09-17T05:52:21.030170+0000","last_peered":"2024-09-17T05:52:21.030170+0000","last_clean":"2024-09-17T05:52:21.030170+0000","last_became_active":"2024-09-17T05:52:18.897402+0000","last_became_peered":"2024-09-17T05:52:18.897402+0000","last_unstale":"2024-09-17T05:52:21.030170+0000","last_undegraded":"2024-09-17T05:52:21.030170+0000","last_fullsized":"2024-09-17T05:52:21.030170+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:52:17.867506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:52:17.867506+0000","last_clean_scrub_stamp":"2024-09-17T05:52:17.867506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:01:29.762480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.2","version":"0'0","reported_seq":13,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-09-17T05:52:20.913065+0000","last_change":"2024-09-17T05:52:19.927870+0000","last_active":"2024-09-17T05:52:20.913065+0000","last_peered":"2024-09-17T05:52:20.913065+0000","last_clean":"2024-09-17T05:52:20.913065+0000","last_became_active":"2024-09-17T05:52:19.927573+0000","last_became_peered":"2024-09-17T05:52:19.927573+0000","last_unstale":"2024-09-17T05:52:20.913065+0000","last_undegraded":"2024-09-17T05:52:20.913065+0000","last_fullsized":"2024-09-17T05:52:20.913065+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:52:18.873991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:52:18.873991+0000","last_clean_scrub_stamp":"2024-09-17T05:52:18.873991+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:43:48.027258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.3","version":"0'0","reported_seq":15,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-09-17T05:52:20.899605+0000","last_change":"2024-09-17T05:52:18.897422+0000","last_active":"2024-09-17T05:52:20.899605+0000","last_peered":"2024-09-17T05:52:20.899605+0000","last_clean":"2024-09-17T05:52:20.899605+0000","last_became_active":"2024-09-17T05:52:18.897087+0000","last_became_peered":"2024-09-17T05:52:18.897087+0000","last_unstale":"2024-09-17T05:52:20.899605+0000","last_undegraded":"2024-09-17T05:52:20.899605+0000","last_fullsized":"2024-09-17T05:52:20.899605+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:52:17.867506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:52:17.867506+0000","last_clean_scrub_stamp":"2024-09-17T05:52:17.867506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:42:29.936459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.3","version":"0'0","reported_seq":13,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-09-17T05:52:21.029775+0000","last_change":"2024-09-17T05:52:19.923958+0000","last_active":"2024-09-17T05:52:21.029775+0000","last_peered":"2024-09-17T05:52:21.029775+0000","last_clean":"2024-09-17T05:52:21.029775+0000","last_became_active":"2024-09-17T05:52:19.923644+0000","last_became_peered":"2024-09-17T05:52:19.923644+0000","last_unstale":"2024-09-17T05:52:21.029775+0000","last_undegraded":"2024-09-17T05:52:21.029775+0000","last_fullsized":"2024-09-17T05:52:21.029775+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:52:18.873991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:52:18.873991+0000","last_clean_scrub_stamp":"2024-09-17T05:52:18.873991+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:47:43.829677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.2","version":"0'0","reported_seq":15,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-09-17T05:52:20.913214+0000","last_change":"2024-09-17T05:52:18.894258+0000","last_active":"2024-09-17T05:52:20.913214+0000","last_peered":"2024-09-17T05:52:20.913214+0000","last_clean":"2024-09-17T05:52:20.913214+0000","last_became_active":"2024-09-17T05:52:18.893908+0000","last_became_peered":"2024-09-17T05:52:18.893908+0000","last_unstale":"2024-09-17T05:52:20.913214+0000","last_undegraded":"2024-09-17T05:52:20.913214+0000","last_fullsized":"2024-09-17T05:52:20.913214+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:52:17.867506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:52:17.867506+0000","last_clean_scrub_stamp":"2024-09-17T05:52:17.867506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:04:22.951320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.0","version":"0'0","reported_seq":13,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-09-17T05:52:21.029991+0000","last_change":"2024-09-17T05:52:19.903128+0000","last_active":"2024-09-17T05:52:21.029991+0000","last_peered":"2024-09-17T05:52:21.029991+0000","last_clean":"2024-09-17T05:52:21.029991+0000","last_became_active":"2024-09-17T05:52:19.902472+0000","last_became_peered":"2024-09-17T05:52:19.902472+0000","last_unstale":"2024-09-17T05:52:21.029991+0000","last_undegraded":"2024-09-17T05:52:21.029991+0000","last_fullsized":"2024-09-17T05:52:21.029991+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:52:18.873991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:52:18.873991+0000","last_clean_scrub_stamp":"2024-09-17T05:52:18.873991+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:12:01.805337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.1","version":"0'0","reported_seq":15,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-09-17T05:52:21.029440+0000","last_change":"2024-09-17T05:52:18.897210+0000","last_active":"2024-09-17T05:52:21.029440+0000","last_peered":"2024-09-17T05:52:21.029440+0000","last_clean":"2024-09-17T05:52:21.029440+0000","last_became_active":"2024-09-17T05:52:18.896900+0000","last_became_peered":"2024-09-17T05:52:18.896900+0000","last_unstale":"2024-09-17T05:52:21.029440+0000","last_undegraded":"2024-09-17T05:52:21.029440+0000","last_fullsized":"2024-09-17T05:52:21.029440+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:52:17.867506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:52:17.867506+0000","last_clean_scrub_stamp":"2024-09-17T05:52:17.867506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:24:56.802449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.1","version":"0'0","reported_seq":13,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-09-17T05:52:20.899761+0000","last_change":"2024-09-17T05:52:19.913868+0000","last_active":"2024-09-17T05:52:20.899761+0000","last_peered":"2024-09-17T05:52:20.899761+0000","last_clean":"2024-09-17T05:52:20.899761+0000","last_became_active":"2024-09-17T05:52:19.913405+0000","last_became_peered":"2024-09-17T05:52:19.913405+0000","last_unstale":"2024-09-17T05:52:20.899761+0000","last_undegraded":"2024-09-17T05:52:20.899761+0000","last_fullsized":"2024-09-17T05:52:20.899761+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:52:18.873991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:52:18.873991+0000","last_clean_scrub_stamp":"2024-09-17T05:52:18.873991+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:46:39.095749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.0","version":"0'0","reported_seq":15,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-09-17T05:52:21.029546+0000","last_change":"2024-09-17T05:52:18.889287+0000","last_active":"2024-09-17T05:52:21.029546+0000","last_peered":"2024-09-17T05:52:21.029546+0000","last_clean":"2024-09-17T05:52:21.029546+0000","last_became_active":"2024-09-17T05:52:18.888934+0000","last_became_peered":"2024-09-17T05:52:18.888934+0000","last_unstale":"2024-09-17T05:52:21.029546+0000","last_undegraded":"2024-09-17T05:52:21.029546+0000","last_fullsized":"2024-09-17T05:52:21.029546+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:52:17.867506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:52:17.867506+0000","last_clean_scrub_stamp":"2024-09-17T05:52:17.867506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:21:52.939589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.12","version":"0'0","reported_seq":13,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-09-17T05:52:20.913020+0000","last_change":"2024-09-17T05:52:19.917259+0000","last_active":"2024-09-17T05:52:20.913020+0000","last_peered":"2024-09-17T05:52:20.913020+0000","last_clean":"2024-09-17T05:52:20.913020+0000","last_became_active":"2024-09-17T05:52:19.916932+0000","last_became_peered":"2024-09-17T05:52:19.916932+0000","last_unstale":"2024-09-17T05:52:20.913020+0000","last_undegraded":"2024-09-17T05:52:20.913020+0000","last_fullsized":"2024-09-17T05:52:20.913020+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:52:18.873991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:52:18.873991+0000","last_clean_scrub_stamp":"2024-09-17T05:52:18.873991+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:28:29.059413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.13","version":"126'2","reported_seq":17,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-09-17T05:52:20.913529+0000","last_change":"2024-09-17T05:52:18.900120+0000","last_active":"2024-09-17T05:52:20.913529+0000","last_peered":"2024-09-17T05:52:20.913529+0000","last_clean":"2024-09-17T05:52:20.913529+0000","last_became_active":"2024-09-17T05:52:18.899687+0000","last_became_peered":"2024-09-17T05:52:18.899687+0000","last_unstale":"2024-09-17T05:52:20.913529+0000","last_undegraded":"2024-09-17T05:52:20.913529+0000","last_fullsized":"2024-09-17T05:52:20.913529+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:52:17.867506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:52:17.867506+0000","last_clean_scrub_stamp":"2024-09-17T05:52:17.867506+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:26:59.669212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"19'72","reported_seq":302,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-09-17T05:52:20.912559+0000","last_change":"2024-09-17T05:41:48.539830+0000","last_active":"2024-09-17T05:52:20.912559+0000","last_peered":"2024-09-17T05:52:20.912559+0000","last_clean":"2024-09-17T05:52:20.912559+0000","last_became_active":"2024-09-17T05:41:48.538743+0000","last_became_peered":"2024-09-17T05:41:48.538743+0000","last_unstale":"2024-09-17T05:52:20.912559+0000","last_undegraded":"2024-09-17T05:52:20.912559+0000","last_fullsized":"2024-09-17T05:52:20.912559+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:47.152539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:47.152539+0000","last_clean_scrub_stamp":"2024-09-17T05:41:47.152539+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:08:02.952016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":19,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":18,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":16,"seq":68719476868,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":145124,"kb_used_data":1552,"kb_used_omap":1,"kb_used_meta":143550,"kb_avail":94226716,"statfs":{"total":96636764160,"available":96488157184,"internally_reserved":0,"allocated":1589248,"data_stored":694592,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":146995654},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":7,"up_from":15,"seq":64424509573,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":119356,"kb_used_data":2144,"kb_used_omap":1,"kb_used_meta":117182,"kb_avail":94252484,"statfs":{"total":96636764160,"available":96514543616,"internally_reserved":0,"allocated":2195456,"data_stored":1285598,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":119994826},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509572,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":113188,"kb_used_data":1548,"kb_used_omap":1,"kb_used_meta":111614,"kb_avail":94258652,"statfs":{"total":96636764160,"available":96520859648,"internally_reserved":0,"allocated":1585152,"data_stored":693092,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":114293189},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509571,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":140956,"kb_used_data":1544,"kb_used_omap":1,"kb_used_meta":139390,"kb_avail":94230884,"statfs":{"total":96636764160,"available":96492425216,"internally_reserved":0,"allocated":1581056,"data_stored":693050,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":142735813},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509571,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":118756,"kb_used_data":1548,"kb_used_omap":1,"kb_used_meta":117182,"kb_avail":94253084,"statfs":{"total":96636764160,"available":96515158016,"internally_reserved":0,"allocated":1585152,"data_stored":693140,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":119994823},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509571,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":140960,"kb_used_data":1548,"kb_used_omap":1,"kb_used_meta":139390,"kb_avail":94230880,"statfs":{"total":96636764160,"available":96492421120,"internally_reserved":0,"allocated":1585152,"data_stored":693596,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":142735813},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509571,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":145120,"kb_used_data":1540,"kb_used_omap":1,"kb_used_meta":143550,"kb_avail":94226720,"statfs":{"total":96636764160,"available":96488161280,"internally_reserved":0,"allocated":1576960,"data_stored":692980,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":146995653},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574979,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":123488,"kb_used_data":2120,"kb_used_omap":1,"kb_used_meta":121342,"kb_avail":94248352,"statfs":{"total":96636764160,"available":96510312448,"internally_reserved":0,"allocated":2170880,"data_stored":1283348,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":124254661},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":2250,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-17T05:52:28.721 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-17T05:52:28.721 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-09-17T05:52:28.877 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:28.875+0000 7fd264815640 1 -- 172.21.15.150:0/3510083588 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd260073a80 msgr2=0x7fd260160320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:52:28.877 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:28.875+0000 7fd264815640 1 --2- 172.21.15.150:0/3510083588 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd260073a80 0x7fd260160320 secure :-1 s=READY pgs=1693 cs=0 l=1 rev1=1 crypto rx=0x7fd2600b57e0 tx=0x7fd25802a5f0 comp rx=0 tx=0).stop 2024-09-17T05:52:28.877 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:28.875+0000 7fd264815640 1 -- 172.21.15.150:0/3510083588 shutdown_connections 2024-09-17T05:52:28.877 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:28.875+0000 7fd264815640 1 --2- 172.21.15.150:0/3510083588 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd260073a80 0x7fd260160320 unknown :-1 s=CLOSED pgs=1693 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:52:28.878 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:28.875+0000 7fd264815640 1 --2- 172.21.15.150:0/3510083588 >> v2:172.21.15.176:3300/0 conn(0x7fd260145a40 0x7fd260073540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:52:28.878 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:28.875+0000 7fd264815640 1 --2- 172.21.15.150:0/3510083588 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd260145550 0x7fd26006fb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:52:28.878 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:28.875+0000 7fd264815640 1 -- 172.21.15.150:0/3510083588 >> 172.21.15.150:0/3510083588 conn(0x7fd26006d1c0 msgr2=0x7fd26006d5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:52:28.878 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:28.875+0000 7fd264815640 1 -- 172.21.15.150:0/3510083588 shutdown_connections 2024-09-17T05:52:28.878 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:28.875+0000 7fd264815640 1 -- 172.21.15.150:0/3510083588 wait complete. 2024-09-17T05:52:28.879 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:28.877+0000 7fd264815640 1 Processor -- start 2024-09-17T05:52:28.879 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:28.877+0000 7fd264815640 1 -- start start 2024-09-17T05:52:28.881 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:28.878+0000 7fd264815640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd260073a80 0x7fd26015bae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:52:28.881 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:28.878+0000 7fd264815640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd260145550 0x7fd2601f7360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:52:28.881 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:28.878+0000 7fd264815640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd260145a40 0x7fd2601f78a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:52:28.882 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:28.878+0000 7fd264815640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7fd260160c20 con 0x7fd260145550 2024-09-17T05:52:28.882 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:28.878+0000 7fd264815640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fd260160aa0 con 0x7fd260073a80 2024-09-17T05:52:28.882 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:28.878+0000 7fd264815640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fd260160da0 con 0x7fd260145a40 2024-09-17T05:52:28.882 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:28.878+0000 7fd25dd9b640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd260145550 0x7fd2601f7360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:52:28.882 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:28.879+0000 7fd25dd9b640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd260145550 0x7fd2601f7360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:35840/0 (socket says 172.21.15.150:35840) 2024-09-17T05:52:28.882 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:28.879+0000 7fd25dd9b640 1 -- 172.21.15.150:0/2379752124 learned_addr learned my addr 172.21.15.150:0/2379752124 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:52:28.882 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:28.879+0000 7fd25ed9d640 1 --2- 172.21.15.150:0/2379752124 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd260145a40 0x7fd2601f78a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:52:28.882 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:28.879+0000 7fd25e59c640 1 --2- 172.21.15.150:0/2379752124 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd260073a80 0x7fd26015bae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:52:28.882 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:28.879+0000 7fd25dd9b640 1 -- 172.21.15.150:0/2379752124 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd260145a40 msgr2=0x7fd2601f78a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:52:28.882 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:28.879+0000 7fd25dd9b640 1 --2- 172.21.15.150:0/2379752124 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd260145a40 0x7fd2601f78a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:52:28.882 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:28.879+0000 7fd25dd9b640 1 -- 172.21.15.150:0/2379752124 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd260073a80 msgr2=0x7fd26015bae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:52:28.882 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:28.879+0000 7fd25dd9b640 1 --2- 172.21.15.150:0/2379752124 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd260073a80 0x7fd26015bae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:52:28.882 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:28.879+0000 7fd25dd9b640 1 -- 172.21.15.150:0/2379752124 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd26015ee40 con 0x7fd260145550 2024-09-17T05:52:28.883 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:28.879+0000 7fd25dd9b640 1 --2- 172.21.15.150:0/2379752124 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd260145550 0x7fd2601f7360 secure :-1 s=READY pgs=1694 cs=0 l=1 rev1=1 crypto rx=0x7fd25400d630 tx=0x7fd25400daf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:52:28.883 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:28.879+0000 7fd24effd640 1 -- 172.21.15.150:0/2379752124 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd254017070 con 0x7fd260145550 2024-09-17T05:52:28.883 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:28.879+0000 7fd24effd640 1 -- 172.21.15.150:0/2379752124 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd254004310 con 0x7fd260145550 2024-09-17T05:52:28.883 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:28.879+0000 7fd24effd640 1 -- 172.21.15.150:0/2379752124 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd254005260 con 0x7fd260145550 2024-09-17T05:52:28.883 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:28.879+0000 7fd264815640 1 -- 172.21.15.150:0/2379752124 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd26015f120 con 0x7fd260145550 2024-09-17T05:52:28.883 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:28.879+0000 7fd264815640 1 -- 172.21.15.150:0/2379752124 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd2601336a0 con 0x7fd260145550 2024-09-17T05:52:28.884 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:28.880+0000 7fd264815640 1 -- 172.21.15.150:0/2379752124 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd26006fb40 con 0x7fd260145550 2024-09-17T05:52:28.884 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:28.881+0000 7fd24effd640 1 -- 172.21.15.150:0/2379752124 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 42) ==== 104195+0+0 (secure 0 0 0) 0x7fd254005400 con 0x7fd260145550 2024-09-17T05:52:28.884 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:28.881+0000 7fd24effd640 1 --2- 172.21.15.150:0/2379752124 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fd24007aa20 0x7fd24007cf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:52:28.884 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:28.882+0000 7fd24effd640 1 -- 172.21.15.150:0/2379752124 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(127..127 src has 1..127) ==== 5877+0+0 (secure 0 0 0) 0x7fd254099fd0 con 0x7fd260145550 2024-09-17T05:52:28.884 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:28.882+0000 7fd25e59c640 1 --2- 172.21.15.150:0/2379752124 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fd24007aa20 0x7fd24007cf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:52:28.884 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:28.882+0000 7fd25e59c640 1 --2- 172.21.15.150:0/2379752124 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fd24007aa20 0x7fd24007cf30 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 crypto rx=0x7fd250005fd0 tx=0x7fd250009500 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:52:28.887 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:28.886+0000 7fd24effd640 1 -- 172.21.15.150:0/2379752124 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fd254020020 con 0x7fd260145550 2024-09-17T05:52:29.131 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:29.129+0000 7fd264815640 1 -- 172.21.15.150:0/2379752124 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) -- 0x7fd2600ce950 con 0x7fd260145550 2024-09-17T05:52:29.133 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:29.132+0000 7fd24effd640 1 -- 172.21.15.150:0/2379752124 <== mon.0 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v19) ==== 190+0+147 (secure 0 0 0) 0x7fd254063fa0 con 0x7fd260145550 2024-09-17T05:52:29.134 INFO:teuthology.orchestra.run.smithi150.stdout:[client.0] 2024-09-17T05:52:29.134 INFO:teuthology.orchestra.run.smithi150.stdout: key = AQBoFulmfF/1HBAAMezEjZDeoHTJ+uFfDXNWHQ== 2024-09-17T05:52:29.134 INFO:teuthology.orchestra.run.smithi150.stdout: caps mds = "allow" 2024-09-17T05:52:29.134 INFO:teuthology.orchestra.run.smithi150.stdout: caps mon = "allow r" 2024-09-17T05:52:29.134 INFO:teuthology.orchestra.run.smithi150.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2024-09-17T05:52:29.134 INFO:teuthology.orchestra.run.smithi150.stderr:updated caps for client.0 2024-09-17T05:52:29.136 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:29.134+0000 7fd264815640 1 -- 172.21.15.150:0/2379752124 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fd24007aa20 msgr2=0x7fd24007cf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:52:29.136 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:29.134+0000 7fd264815640 1 --2- 172.21.15.150:0/2379752124 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fd24007aa20 0x7fd24007cf30 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 crypto rx=0x7fd250005fd0 tx=0x7fd250009500 comp rx=0 tx=0).stop 2024-09-17T05:52:29.137 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:29.134+0000 7fd264815640 1 -- 172.21.15.150:0/2379752124 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd260145550 msgr2=0x7fd2601f7360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:52:29.137 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:29.134+0000 7fd264815640 1 --2- 172.21.15.150:0/2379752124 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd260145550 0x7fd2601f7360 secure :-1 s=READY pgs=1694 cs=0 l=1 rev1=1 crypto rx=0x7fd25400d630 tx=0x7fd25400daf0 comp rx=0 tx=0).stop 2024-09-17T05:52:29.137 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:29.134+0000 7fd264815640 1 -- 172.21.15.150:0/2379752124 shutdown_connections 2024-09-17T05:52:29.137 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:29.134+0000 7fd264815640 1 --2- 172.21.15.150:0/2379752124 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fd24007aa20 0x7fd24007cf30 unknown :-1 s=CLOSED pgs=720 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:52:29.137 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:29.134+0000 7fd264815640 1 --2- 172.21.15.150:0/2379752124 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd260145a40 0x7fd2601f78a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:52:29.137 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:29.134+0000 7fd264815640 1 --2- 172.21.15.150:0/2379752124 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd260145550 0x7fd2601f7360 unknown :-1 s=CLOSED pgs=1694 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:52:29.137 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:29.134+0000 7fd264815640 1 --2- 172.21.15.150:0/2379752124 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd260073a80 0x7fd26015bae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:52:29.137 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:29.134+0000 7fd264815640 1 -- 172.21.15.150:0/2379752124 >> 172.21.15.150:0/2379752124 conn(0x7fd26006d1c0 msgr2=0x7fd2600cd580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:52:29.137 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:29.134+0000 7fd264815640 1 -- 172.21.15.150:0/2379752124 shutdown_connections 2024-09-17T05:52:29.137 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:29.134+0000 7fd264815640 1 -- 172.21.15.150:0/2379752124 wait complete. 2024-09-17T05:52:29.148 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T05:52:29.263 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:29.260+0000 7f2e68713640 1 -- 172.21.15.150:0/2438410095 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2e600716b0 msgr2=0x7f2e60071ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:52:29.263 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:29.260+0000 7f2e68713640 1 --2- 172.21.15.150:0/2438410095 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2e600716b0 0x7f2e60071ac0 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7f2e54009830 tx=0x7f2e5402a510 comp rx=0 tx=0).stop 2024-09-17T05:52:29.263 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:29.260+0000 7f2e68713640 1 -- 172.21.15.150:0/2438410095 shutdown_connections 2024-09-17T05:52:29.263 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:29.260+0000 7f2e68713640 1 --2- 172.21.15.150:0/2438410095 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2e600716b0 0x7f2e60071ac0 unknown :-1 s=CLOSED pgs=575 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:52:29.263 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:29.260+0000 7f2e68713640 1 --2- 172.21.15.150:0/2438410095 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2e600ccf60 0x7f2e6015c8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:52:29.263 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:29.261+0000 7f2e68713640 1 -- 172.21.15.150:0/2438410095 >> 172.21.15.150:0/2438410095 conn(0x7f2e600d0b50 msgr2=0x7f2e600d0f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:52:29.263 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:29.261+0000 7f2e68713640 1 -- 172.21.15.150:0/2438410095 shutdown_connections 2024-09-17T05:52:29.263 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:29.261+0000 7f2e68713640 1 -- 172.21.15.150:0/2438410095 wait complete. 2024-09-17T05:52:29.264 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:29.262+0000 7f2e68713640 1 Processor -- start 2024-09-17T05:52:29.264 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:29.262+0000 7f2e68713640 1 -- start start 2024-09-17T05:52:29.267 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:29.263+0000 7f2e68713640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2e600716b0 0x7f2e6014e470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:52:29.267 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:29.264+0000 7f2e68713640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2e600b4260 0x7f2e6015f680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:52:29.267 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:29.264+0000 7f2e68713640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2e600ccf60 0x7f2e60152da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:52:29.267 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:29.264+0000 7f2e68713640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f2e6006e0e0 con 0x7f2e600b4260 2024-09-17T05:52:29.267 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:29.264+0000 7f2e68713640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f2e6006df60 con 0x7f2e600716b0 2024-09-17T05:52:29.267 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:29.264+0000 7f2e68713640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f2e6006e260 con 0x7f2e600ccf60 2024-09-17T05:52:29.268 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:29.264+0000 7f2e65cae640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2e600b4260 0x7f2e6015f680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:52:29.268 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:29.264+0000 7f2e65cae640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2e600b4260 0x7f2e6015f680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:35856/0 (socket says 172.21.15.150:35856) 2024-09-17T05:52:29.268 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:29.264+0000 7f2e65cae640 1 -- 172.21.15.150:0/562048963 learned_addr learned my addr 172.21.15.150:0/562048963 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:52:29.268 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:29.264+0000 7f2e664af640 1 --2- 172.21.15.150:0/562048963 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2e600716b0 0x7f2e6014e470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:52:29.268 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:29.264+0000 7f2e66cb0640 1 --2- 172.21.15.150:0/562048963 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2e600ccf60 0x7f2e60152da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:52:29.268 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:29.264+0000 7f2e65cae640 1 -- 172.21.15.150:0/562048963 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2e600ccf60 msgr2=0x7f2e60152da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:52:29.268 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:29.264+0000 7f2e65cae640 1 --2- 172.21.15.150:0/562048963 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2e600ccf60 0x7f2e60152da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:52:29.268 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:29.264+0000 7f2e65cae640 1 -- 172.21.15.150:0/562048963 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2e600716b0 msgr2=0x7f2e6014e470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:52:29.268 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:29.264+0000 7f2e65cae640 1 --2- 172.21.15.150:0/562048963 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2e600716b0 0x7f2e6014e470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:52:29.268 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:29.264+0000 7f2e65cae640 1 -- 172.21.15.150:0/562048963 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2e6014e9b0 con 0x7f2e600b4260 2024-09-17T05:52:29.268 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:29.264+0000 7f2e65cae640 1 --2- 172.21.15.150:0/562048963 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2e600b4260 0x7f2e6015f680 secure :-1 s=READY pgs=1695 cs=0 l=1 rev1=1 crypto rx=0x7f2e54009950 tx=0x7f2e54033c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:52:29.269 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:29.265+0000 7f2e5effd640 1 -- 172.21.15.150:0/562048963 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e54031d60 con 0x7f2e600b4260 2024-09-17T05:52:29.269 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:29.265+0000 7f2e5effd640 1 -- 172.21.15.150:0/562048963 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f2e54033e10 con 0x7f2e600b4260 2024-09-17T05:52:29.269 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:29.265+0000 7f2e68713640 1 -- 172.21.15.150:0/562048963 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2e601f7de0 con 0x7f2e600b4260 2024-09-17T05:52:29.269 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:29.265+0000 7f2e5effd640 1 -- 172.21.15.150:0/562048963 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e54005260 con 0x7f2e600b4260 2024-09-17T05:52:29.269 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:29.265+0000 7f2e68713640 1 -- 172.21.15.150:0/562048963 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2e6015ee80 con 0x7f2e600b4260 2024-09-17T05:52:29.269 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:29.265+0000 7f2e68713640 1 -- 172.21.15.150:0/562048963 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2e600703f0 con 0x7f2e600b4260 2024-09-17T05:52:29.270 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:29.266+0000 7f2e5effd640 1 -- 172.21.15.150:0/562048963 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 42) ==== 104195+0+0 (secure 0 0 0) 0x7f2e54005400 con 0x7f2e600b4260 2024-09-17T05:52:29.270 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:29.267+0000 7f2e5effd640 1 --2- 172.21.15.150:0/562048963 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f2e4c07a9f0 0x7f2e4c07cf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:52:29.270 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:29.267+0000 7f2e5effd640 1 -- 172.21.15.150:0/562048963 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(127..127 src has 1..127) ==== 5877+0+0 (secure 0 0 0) 0x7f2e540badb0 con 0x7f2e600b4260 2024-09-17T05:52:29.270 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:29.267+0000 7f2e664af640 1 --2- 172.21.15.150:0/562048963 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f2e4c07a9f0 0x7f2e4c07cf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:52:29.270 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:29.268+0000 7f2e664af640 1 --2- 172.21.15.150:0/562048963 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f2e4c07a9f0 0x7f2e4c07cf00 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 crypto rx=0x7f2e500099a0 tx=0x7f2e50009500 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:52:29.273 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:29.271+0000 7f2e5effd640 1 -- 172.21.15.150:0/562048963 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f2e600703f0 con 0x7f2e600b4260 2024-09-17T05:52:29.484 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:29.482+0000 7f2e68713640 1 -- 172.21.15.150:0/562048963 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f2e6006a7e0 con 0x7f2e600b4260 2024-09-17T05:52:29.484 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:29.483+0000 7f2e5effd640 1 -- 172.21.15.150:0/562048963 <== mon.0 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 80 v80) ==== 94+0+5234 (secure 0 0 0) 0x7f2e5403f030 con 0x7f2e600b4260 2024-09-17T05:52:29.485 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-09-17T05:52:29.485 INFO:teuthology.orchestra.run.smithi150.stdout:{"epoch":80,"btime":"2024-09-17T05:52:22:919504+0000","default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":9123,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6834/2232109291","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6832","nonce":2232109291},{"type":"v1","addr":"172.21.15.150:6834","nonce":2232109291}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":74},{"gid":9126,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6835/423416474","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6833","nonce":423416474},{"type":"v1","addr":"172.21.15.150:6835","nonce":423416474}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":75},{"gid":9138,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6837/2582017817","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6835","nonce":2582017817},{"type":"v1","addr":"172.21.15.176:6837","nonce":2582017817}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":75}],"filesystems":[{"mdsmap":{"epoch":80,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T05:52:19.257101+0000","modified":"2024-09-17T05:52:22.283372+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":9141},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9141":{"gid":9141,"name":"d","rank":0,"incarnation":76,"state":"up:active","state_seq":3,"addr":"172.21.15.176:6836/1926613940","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6834","nonce":1926613940},{"type":"v1","addr":"172.21.15.176:6836","nonce":1926613940}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[19],"metadata_pool":18,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":9141,"qdb_cluster":[9141]},"id":9}]} 2024-09-17T05:52:29.485 INFO:teuthology.orchestra.run.smithi150.stderr:dumped fsmap epoch 80 2024-09-17T05:52:29.487 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:29.485+0000 7f2e68713640 1 -- 172.21.15.150:0/562048963 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f2e4c07a9f0 msgr2=0x7f2e4c07cf00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:52:29.487 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:29.485+0000 7f2e68713640 1 --2- 172.21.15.150:0/562048963 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f2e4c07a9f0 0x7f2e4c07cf00 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 crypto rx=0x7f2e500099a0 tx=0x7f2e50009500 comp rx=0 tx=0).stop 2024-09-17T05:52:29.487 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:29.485+0000 7f2e68713640 1 -- 172.21.15.150:0/562048963 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2e600b4260 msgr2=0x7f2e6015f680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:52:29.487 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:29.485+0000 7f2e68713640 1 --2- 172.21.15.150:0/562048963 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2e600b4260 0x7f2e6015f680 secure :-1 s=READY pgs=1695 cs=0 l=1 rev1=1 crypto rx=0x7f2e54009950 tx=0x7f2e54033c20 comp rx=0 tx=0).stop 2024-09-17T05:52:29.487 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:29.485+0000 7f2e68713640 1 -- 172.21.15.150:0/562048963 shutdown_connections 2024-09-17T05:52:29.487 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:29.485+0000 7f2e68713640 1 --2- 172.21.15.150:0/562048963 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f2e4c07a9f0 0x7f2e4c07cf00 unknown :-1 s=CLOSED pgs=721 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:52:29.487 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:29.485+0000 7f2e68713640 1 --2- 172.21.15.150:0/562048963 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2e600ccf60 0x7f2e60152da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:52:29.487 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:29.485+0000 7f2e68713640 1 --2- 172.21.15.150:0/562048963 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2e600b4260 0x7f2e6015f680 unknown :-1 s=CLOSED pgs=1695 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:52:29.488 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:29.485+0000 7f2e68713640 1 --2- 172.21.15.150:0/562048963 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2e600716b0 0x7f2e6014e470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:52:29.488 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:29.485+0000 7f2e68713640 1 -- 172.21.15.150:0/562048963 >> 172.21.15.150:0/562048963 conn(0x7f2e600d0b50 msgr2=0x7f2e600d0f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:52:29.488 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:29.485+0000 7f2e68713640 1 -- 172.21.15.150:0/562048963 shutdown_connections 2024-09-17T05:52:29.488 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:29.485+0000 7f2e68713640 1 -- 172.21.15.150:0/562048963 wait complete. 2024-09-17T05:52:29.901 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 80, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-17T05:52:19.257101+0000', 'modified': '2024-09-17T05:52:22.283372+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 9141}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_9141': {'gid': 9141, 'name': 'd', 'rank': 0, 'incarnation': 76, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.176:6836/1926613940', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.176:6834', 'nonce': 1926613940}, {'type': 'v1', 'addr': '172.21.15.176:6836', 'nonce': 1926613940}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [19], 'metadata_pool': 18, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 9141, 'qdb_cluster': [9141]} 2024-09-17T05:52:29.901 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-17T05:52:29.901 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.d status 2024-09-17T05:52:30.019 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:30.017+0000 7f05639c6640 1 -- 172.21.15.150:0/2447490507 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0544005300 msgr2=0x7f054400b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:52:30.019 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:30.017+0000 7f05639c6640 1 --2- 172.21.15.150:0/2447490507 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0544005300 0x7f054400b9c0 secure :-1 s=READY pgs=1697 cs=0 l=1 rev1=1 crypto rx=0x7f0554001690 tx=0x7f0544005830 comp rx=0 tx=0).stop 2024-09-17T05:52:30.019 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:30.017+0000 7f05639c6640 1 -- 172.21.15.150:0/2447490507 shutdown_connections 2024-09-17T05:52:30.019 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:30.017+0000 7f05639c6640 1 --2- 172.21.15.150:0/2447490507 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0544005300 0x7f054400b9c0 unknown :-1 s=CLOSED pgs=1697 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:52:30.019 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:30.017+0000 7f05639c6640 1 -- 172.21.15.150:0/2447490507 >> 172.21.15.150:0/2447490507 conn(0x7f055c0cef80 msgr2=0x7f055c0cf390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:52:30.019 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:30.017+0000 7f05639c6640 1 -- 172.21.15.150:0/2447490507 shutdown_connections 2024-09-17T05:52:30.019 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:30.017+0000 7f05639c6640 1 -- 172.21.15.150:0/2447490507 wait complete. 2024-09-17T05:52:30.020 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:30.019+0000 7f05639c6640 1 Processor -- start 2024-09-17T05:52:30.020 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:30.019+0000 7f05639c6640 1 -- start start 2024-09-17T05:52:30.023 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:30.020+0000 7f05639c6640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0544005300 0x7f055c1e72c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:52:30.023 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:30.020+0000 7f05639c6640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f055c1e65e0 0x7f055c1de510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:52:30.023 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:30.020+0000 7f05639c6640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f055c0b1150 0x7f055c0b1560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:52:30.023 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:30.020+0000 7f05639c6640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f055c0b1da0 con 0x7f055c0b1150 2024-09-17T05:52:30.023 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:30.020+0000 7f05639c6640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f055c0d0570 con 0x7f055c1e65e0 2024-09-17T05:52:30.024 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:30.020+0000 7f05639c6640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f055c0b1f20 con 0x7f0544005300 2024-09-17T05:52:30.024 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:30.020+0000 7f0561f63640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f055c0b1150 0x7f055c0b1560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:52:30.024 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:30.020+0000 7f0561f63640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f055c0b1150 0x7f055c0b1560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:35880/0 (socket says 172.21.15.150:35880) 2024-09-17T05:52:30.024 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:30.020+0000 7f0561f63640 1 -- 172.21.15.150:0/2743472114 learned_addr learned my addr 172.21.15.150:0/2743472114 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:52:30.024 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:30.020+0000 7f0561762640 1 --2- 172.21.15.150:0/2743472114 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0544005300 0x7f055c1e72c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:52:30.024 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:30.020+0000 7f0560f61640 1 --2- 172.21.15.150:0/2743472114 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f055c1e65e0 0x7f055c1de510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:52:30.024 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:30.020+0000 7f0561f63640 1 -- 172.21.15.150:0/2743472114 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0544005300 msgr2=0x7f055c1e72c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:52:30.024 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:30.020+0000 7f0561f63640 1 --2- 172.21.15.150:0/2743472114 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0544005300 0x7f055c1e72c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:52:30.024 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:30.020+0000 7f0561f63640 1 -- 172.21.15.150:0/2743472114 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f055c1e65e0 msgr2=0x7f055c1de510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:52:30.024 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:30.020+0000 7f0561f63640 1 --2- 172.21.15.150:0/2743472114 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f055c1e65e0 0x7f055c1de510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:52:30.024 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:30.020+0000 7f0561f63640 1 -- 172.21.15.150:0/2743472114 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f055c0b1aa0 con 0x7f055c0b1150 2024-09-17T05:52:30.024 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:30.021+0000 7f0561f63640 1 --2- 172.21.15.150:0/2743472114 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f055c0b1150 0x7f055c0b1560 secure :-1 s=READY pgs=1698 cs=0 l=1 rev1=1 crypto rx=0x7f0554001690 tx=0x7f05540063d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:52:30.025 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:30.021+0000 7f0559ffb640 1 -- 172.21.15.150:0/2743472114 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0554037070 con 0x7f055c0b1150 2024-09-17T05:52:30.025 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:30.021+0000 7f0559ffb640 1 -- 172.21.15.150:0/2743472114 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0554003af0 con 0x7f055c0b1150 2024-09-17T05:52:30.025 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:30.021+0000 7f05639c6640 1 -- 172.21.15.150:0/2743472114 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f055c1f7350 con 0x7f055c0b1150 2024-09-17T05:52:30.025 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:30.021+0000 7f0559ffb640 1 -- 172.21.15.150:0/2743472114 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0554032410 con 0x7f055c0b1150 2024-09-17T05:52:30.025 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:30.021+0000 7f05639c6640 1 -- 172.21.15.150:0/2743472114 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f055c1f7910 con 0x7f055c0b1150 2024-09-17T05:52:30.026 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:30.023+0000 7f0559ffb640 1 -- 172.21.15.150:0/2743472114 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 42) ==== 104195+0+0 (secure 0 0 0) 0x7f0554030020 con 0x7f055c0b1150 2024-09-17T05:52:30.026 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:30.024+0000 7f0559ffb640 1 --2- 172.21.15.150:0/2743472114 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f054807aa20 0x7f054807cf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:52:30.026 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:30.024+0000 7f0559ffb640 1 -- 172.21.15.150:0/2743472114 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(127..127 src has 1..127) ==== 5877+0+0 (secure 0 0 0) 0x7f05540b94b0 con 0x7f055c0b1150 2024-09-17T05:52:30.026 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:30.024+0000 7f0561762640 1 --2- 172.21.15.150:0/2743472114 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f054807aa20 0x7f054807cf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:52:30.026 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:30.025+0000 7f056aa19740 1 Processor -- start 2024-09-17T05:52:30.027 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:30.025+0000 7f0561762640 1 --2- 172.21.15.150:0/2743472114 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f054807aa20 0x7f054807cf30 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x7f054c005fd0 tx=0x7f054c003c30 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:52:30.027 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:30.025+0000 7f056aa19740 1 -- start start 2024-09-17T05:52:30.029 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:30.026+0000 7f056aa19740 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55dc290a0270 0x55dc29460970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:52:30.029 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:30.026+0000 7f056aa19740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55dc290773b0 0x55dc2946ee70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:52:30.029 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:30.026+0000 7f056aa19740 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55dc2907f590 0x55dc2946f3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:52:30.030 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:30.026+0000 7f056aa19740 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x55dc293ba820 con 0x55dc2907f590 2024-09-17T05:52:30.030 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:30.026+0000 7f056aa19740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x55dc293a9c50 con 0x55dc290773b0 2024-09-17T05:52:30.030 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:30.026+0000 7f056aa19740 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x55dc293ada60 con 0x55dc290a0270 2024-09-17T05:52:30.030 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:30.026+0000 7f0561f63640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55dc2907f590 0x55dc2946f3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:52:30.030 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:30.026+0000 7f0561f63640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55dc2907f590 0x55dc2946f3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:35890/0 (socket says 172.21.15.150:35890) 2024-09-17T05:52:30.030 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:30.026+0000 7f0561f63640 1 -- 172.21.15.150:0/85668753 learned_addr learned my addr 172.21.15.150:0/85668753 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:52:30.030 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:30.026+0000 7f0561762640 1 --2- 172.21.15.150:0/85668753 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55dc290a0270 0x55dc29460970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:52:30.030 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:30.026+0000 7f0560f61640 1 --2- 172.21.15.150:0/85668753 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55dc290773b0 0x55dc2946ee70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:52:30.030 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:30.026+0000 7f0561f63640 1 -- 172.21.15.150:0/85668753 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55dc290a0270 msgr2=0x55dc29460970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:52:30.030 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:30.026+0000 7f0561f63640 1 --2- 172.21.15.150:0/85668753 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55dc290a0270 0x55dc29460970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:52:30.030 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:30.026+0000 7f0561f63640 1 -- 172.21.15.150:0/85668753 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55dc290773b0 msgr2=0x55dc2946ee70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:52:30.031 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:30.026+0000 7f0561f63640 1 --2- 172.21.15.150:0/85668753 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55dc290773b0 0x55dc2946ee70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:52:30.031 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:30.026+0000 7f0561f63640 1 -- 172.21.15.150:0/85668753 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55dc2910b850 con 0x55dc2907f590 2024-09-17T05:52:30.031 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:30.026+0000 7f0561f63640 1 --2- 172.21.15.150:0/85668753 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55dc2907f590 0x55dc2946f3b0 secure :-1 s=READY pgs=1699 cs=0 l=1 rev1=1 crypto rx=0x7f0554082bd0 tx=0x7f0554082820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ddebcc02cf91f5fe server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:52:30.031 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:30.027+0000 7f0542ffd640 1 -- 172.21.15.150:0/85668753 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0554082330 con 0x55dc2907f590 2024-09-17T05:52:30.031 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:30.027+0000 7f0542ffd640 1 -- 172.21.15.150:0/85668753 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f055402e030 con 0x55dc2907f590 2024-09-17T05:52:30.031 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:30.027+0000 7f0542ffd640 1 -- 172.21.15.150:0/85668753 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f055407ea80 con 0x55dc2907f590 2024-09-17T05:52:30.031 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:30.027+0000 7f056aa19740 1 -- 172.21.15.150:0/85668753 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55dc2907f590 msgr2=0x55dc2946f3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:52:30.031 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:30.027+0000 7f056aa19740 1 --2- 172.21.15.150:0/85668753 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55dc2907f590 0x55dc2946f3b0 secure :-1 s=READY pgs=1699 cs=0 l=1 rev1=1 crypto rx=0x7f0554082bd0 tx=0x7f0554082820 comp rx=0 tx=0).stop 2024-09-17T05:52:30.031 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:30.027+0000 7f056aa19740 1 -- 172.21.15.150:0/85668753 shutdown_connections 2024-09-17T05:52:30.031 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:30.027+0000 7f056aa19740 1 --2- 172.21.15.150:0/85668753 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55dc290773b0 0x55dc2946ee70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:52:30.031 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:30.027+0000 7f056aa19740 1 --2- 172.21.15.150:0/85668753 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55dc2907f590 0x55dc2946f3b0 unknown :-1 s=CLOSED pgs=1699 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:52:30.032 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:30.027+0000 7f056aa19740 1 --2- 172.21.15.150:0/85668753 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55dc290a0270 0x55dc29460970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:52:30.032 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:30.027+0000 7f056aa19740 1 -- 172.21.15.150:0/85668753 >> 172.21.15.150:0/85668753 conn(0x55dc290943c0 msgr2=0x55dc29448260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:52:30.032 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:30.027+0000 7f056aa19740 1 -- 172.21.15.150:0/85668753 shutdown_connections 2024-09-17T05:52:30.032 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:30.028+0000 7f056aa19740 1 -- 172.21.15.150:0/85668753 wait complete. 2024-09-17T05:52:30.036 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:30.028+0000 7f056aa19740 1 -- start start 2024-09-17T05:52:30.036 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:30.028+0000 7f056aa19740 1 Processor -- start 2024-09-17T05:52:30.036 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:30.030+0000 7f056aa19740 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55dc290773b0 0x55dc29487d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:52:30.036 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:30.030+0000 7f056aa19740 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55dc2907f590 0x55dc2949f680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:52:30.037 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:30.030+0000 7f056aa19740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55dc290a0270 0x55dc294472a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:52:30.037 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:30.030+0000 7f056aa19740 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x55dc2911a620 con 0x55dc290773b0 2024-09-17T05:52:30.037 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:30.030+0000 7f056aa19740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x55dc2934f5f0 con 0x55dc290a0270 2024-09-17T05:52:30.037 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:30.030+0000 7f056aa19740 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x55dc293a9c50 con 0x55dc2907f590 2024-09-17T05:52:30.037 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:30.030+0000 7f056aa19740 10 client.0 _ll_register_callbacks cb 0x55dc293530a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T05:52:30.037 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:30.030+0000 7f0561762640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55dc290773b0 0x55dc29487d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:52:30.037 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:30.030+0000 7f0561762640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55dc290773b0 0x55dc29487d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:35906/0 (socket says 172.21.15.150:35906) 2024-09-17T05:52:30.037 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:30.030+0000 7f0561762640 1 -- 172.21.15.150:0/2483690462 learned_addr learned my addr 172.21.15.150:0/2483690462 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:52:30.037 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:30.030+0000 7f0561f63640 1 --2- 172.21.15.150:0/2483690462 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55dc290a0270 0x55dc294472a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:52:30.037 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:30.030+0000 7f0560f61640 1 --2- 172.21.15.150:0/2483690462 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55dc2907f590 0x55dc2949f680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:52:30.038 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:30.030+0000 7f0561762640 1 -- 172.21.15.150:0/2483690462 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55dc2907f590 msgr2=0x55dc2949f680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:52:30.038 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:30.030+0000 7f0561762640 1 --2- 172.21.15.150:0/2483690462 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55dc2907f590 0x55dc2949f680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:52:30.038 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:30.030+0000 7f0561762640 1 -- 172.21.15.150:0/2483690462 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55dc290a0270 msgr2=0x55dc294472a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:52:30.038 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:30.030+0000 7f0561762640 1 --2- 172.21.15.150:0/2483690462 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55dc290a0270 0x55dc294472a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:52:30.038 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:30.030+0000 7f0561762640 1 -- 172.21.15.150:0/2483690462 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55dc291826b0 con 0x55dc290773b0 2024-09-17T05:52:30.038 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:30.030+0000 7f0561762640 1 --2- 172.21.15.150:0/2483690462 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55dc290773b0 0x55dc29487d30 secure :-1 s=READY pgs=1700 cs=0 l=1 rev1=1 crypto rx=0x7f054c012fd0 tx=0x7f054c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2b43ed6fc4236068 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:52:30.038 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:30.030+0000 7f053bfff640 10 client.0 ms_handle_connect on v2:172.21.15.150:3300/0 2024-09-17T05:52:30.038 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:30.031+0000 7f053bfff640 1 -- 172.21.15.150:0/2483690462 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f054c028420 con 0x55dc290773b0 2024-09-17T05:52:30.038 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:30.031+0000 7f053bfff640 1 -- 172.21.15.150:0/2483690462 <== mon.0 v2:172.21.15.150:3300/0 2 ==== osd_map(127..127 src has 1..127) ==== 5877+0+0 (secure 0 0 0) 0x7f054c0285c0 con 0x55dc290773b0 2024-09-17T05:52:30.038 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:30.031+0000 7f056aa19740 1 -- 172.21.15.150:0/2483690462 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f055402e030 con 0x55dc290773b0 2024-09-17T05:52:30.038 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:30.031+0000 7f053bfff640 1 -- 172.21.15.150:0/2483690462 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_get_version_reply(handle=1 version=80) ==== 24+0+0 (secure 0 0 0) 0x7f054c0287c0 con 0x55dc290773b0 2024-09-17T05:52:30.038 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:30.031+0000 7f056aa19740 10 client.9288 fetch_fsmap learned FSMap version 80 2024-09-17T05:52:30.039 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:30.031+0000 7f056aa19740 1 -- 172.21.15.150:0/2483690462 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,fsmap=80,monmap=2+}) -- 0x55dc29484f00 con 0x55dc290773b0 2024-09-17T05:52:30.039 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:30.031+0000 7f053bfff640 1 -- 172.21.15.150:0/2483690462 <== mon.0 v2:172.21.15.150:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f055402e030 con 0x55dc290773b0 2024-09-17T05:52:30.039 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:30.031+0000 7f053bfff640 1 -- 172.21.15.150:0/2483690462 <== mon.0 v2:172.21.15.150:3300/0 5 ==== fsmap(e 80) ==== 3502+0+0 (secure 0 0 0) 0x7f054c033080 con 0x55dc290773b0 2024-09-17T05:52:30.039 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:30.031+0000 7f056aa19740 10 client.9288 fetch_fsmap finished waiting for FSMap version 80 2024-09-17T05:52:30.039 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:30.031+0000 7f056aa19740 10 client.9288 resolve_mds: resolved name 'd' to daemon mds.d 2024-09-17T05:52:30.039 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:30.031+0000 7f056aa19740 20 client.9288 populate_metadata read hostname 'smithi150' 2024-09-17T05:52:30.039 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:30.031+0000 7f056aa19740 1 --2- 172.21.15.150:0/2483690462 >> [v2:172.21.15.176:6834/1926613940,v1:172.21.15.176:6836/1926613940] conn(0x55dc2905ee40 0x55dc294853c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:52:30.039 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:30.031+0000 7f056aa19740 4 client.9288 mds_command: new command op to 9141 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-17T05:52:30.039 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:30.031+0000 7f056aa19740 1 -- 172.21.15.150:0/2483690462 --> [v2:172.21.15.176:6834/1926613940,v1:172.21.15.176:6836/1926613940] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55dc293bc770 con 0x55dc2905ee40 2024-09-17T05:52:30.039 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:30.031+0000 7f0560f61640 1 --2- 172.21.15.150:0/2483690462 >> [v2:172.21.15.176:6834/1926613940,v1:172.21.15.176:6836/1926613940] conn(0x55dc2905ee40 0x55dc294853c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:52:30.039 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:30.032+0000 7f053bfff640 10 client.9288 ms_handle_connect on v2:172.21.15.176:6834/1926613940 2024-09-17T05:52:30.039 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:30.032+0000 7f0560f61640 1 --2- 172.21.15.150:0/2483690462 >> [v2:172.21.15.176:6834/1926613940,v1:172.21.15.176:6836/1926613940] conn(0x55dc2905ee40 0x55dc294853c0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3da3f70f38d31b82 server_cookie=72cd228927f9d49a in_seq=0 out_seq=0 2024-09-17T05:52:30.040 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:30.033+0000 7f053bfff640 1 -- 172.21.15.150:0/2483690462 <== mds.0 v2:172.21.15.176:6834/1926613940 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55dc293bc770 con 0x55dc2905ee40 2024-09-17T05:52:30.040 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:30.033+0000 7f053bfff640 10 client.9288 handle_command_reply: tid=0 2024-09-17T05:52:30.040 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:30.033+0000 7f056aa19740 1 client.9288 shutdown 2024-09-17T05:52:30.040 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:30.033+0000 7f056aa19740 1 -- 172.21.15.150:0/2483690462 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55dc290773b0 msgr2=0x55dc29487d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:52:30.040 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:30.033+0000 7f056aa19740 1 --2- 172.21.15.150:0/2483690462 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55dc290773b0 0x55dc29487d30 secure :-1 s=READY pgs=1700 cs=0 l=1 rev1=1 crypto rx=0x7f054c012fd0 tx=0x7f054c004a40 comp rx=0 tx=0).stop 2024-09-17T05:52:30.040 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:30.033+0000 7f056aa19740 1 -- 172.21.15.150:0/2483690462 shutdown_connections 2024-09-17T05:52:30.040 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:30.033+0000 7f056aa19740 1 --2- 172.21.15.150:0/2483690462 >> [v2:172.21.15.176:6834/1926613940,v1:172.21.15.176:6836/1926613940] conn(0x55dc2905ee40 0x55dc294853c0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:52:30.040 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:30.033+0000 7f056aa19740 1 --2- 172.21.15.150:0/2483690462 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55dc290a0270 0x55dc294472a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:52:30.040 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:30.033+0000 7f056aa19740 1 --2- 172.21.15.150:0/2483690462 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55dc2907f590 0x55dc2949f680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:52:30.040 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:30.033+0000 7f053bfff640 0 client.9288 ms_handle_reset on v2:172.21.15.176:6834/1926613940 2024-09-17T05:52:30.041 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:30.033+0000 7f056aa19740 1 --2- 172.21.15.150:0/2483690462 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55dc290773b0 0x55dc29487d30 unknown :-1 s=CLOSED pgs=1700 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:52:30.041 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:30.033+0000 7f056aa19740 1 -- 172.21.15.150:0/2483690462 >> 172.21.15.150:0/2483690462 conn(0x55dc290943c0 msgr2=0x55dc29471da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:52:30.041 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:30.033+0000 7f056aa19740 1 -- 172.21.15.150:0/2483690462 shutdown_connections 2024-09-17T05:52:30.041 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:30.033+0000 7f056aa19740 1 -- 172.21.15.150:0/2483690462 wait complete. 2024-09-17T05:52:30.041 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:30.033+0000 7f056aa19740 20 client.9288 trim_cache size 0 max 16384 2024-09-17T05:52:30.053 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:30.052+0000 7f056aa19740 1 Processor -- start 2024-09-17T05:52:30.053 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:30.052+0000 7f056aa19740 1 -- start start 2024-09-17T05:52:30.057 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:30.053+0000 7f056aa19740 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55dc2905ee40 0x55dc2948d4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:52:30.057 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:30.053+0000 7f056aa19740 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55dc290773b0 0x55dc29447dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:52:30.057 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:30.053+0000 7f056aa19740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55dc2907f590 0x55dc29448310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:52:30.057 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:30.053+0000 7f056aa19740 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f055c06f710 con 0x55dc2905ee40 2024-09-17T05:52:30.057 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:30.053+0000 7f056aa19740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f055c1dce70 con 0x55dc2907f590 2024-09-17T05:52:30.057 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:30.053+0000 7f056aa19740 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f055c06f0c0 con 0x55dc290773b0 2024-09-17T05:52:30.057 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:30.053+0000 7f0561762640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55dc2905ee40 0x55dc2948d4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:52:30.057 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:30.053+0000 7f0561762640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55dc2905ee40 0x55dc2948d4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:35922/0 (socket says 172.21.15.150:35922) 2024-09-17T05:52:30.058 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:30.053+0000 7f0561762640 1 -- 172.21.15.150:0/560558280 learned_addr learned my addr 172.21.15.150:0/560558280 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:52:30.058 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:30.053+0000 7f0561762640 1 -- 172.21.15.150:0/560558280 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55dc290773b0 msgr2=0x55dc29447dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:52:30.058 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:30.053+0000 7f0561762640 1 --2- 172.21.15.150:0/560558280 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55dc290773b0 0x55dc29447dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:52:30.058 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:30.053+0000 7f0561762640 1 -- 172.21.15.150:0/560558280 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55dc2907f590 msgr2=0x55dc29448310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:52:30.058 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:30.053+0000 7f0561f63640 1 --2- 172.21.15.150:0/560558280 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55dc2907f590 0x55dc29448310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:52:30.058 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:30.053+0000 7f0561762640 1 --2- 172.21.15.150:0/560558280 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55dc2907f590 0x55dc29448310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:52:30.058 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:30.053+0000 7f0561762640 1 -- 172.21.15.150:0/560558280 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55dc29444dc0 con 0x55dc2905ee40 2024-09-17T05:52:30.058 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:30.053+0000 7f0561f63640 1 --2- 172.21.15.150:0/560558280 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55dc2907f590 0x55dc29448310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T05:52:30.058 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:30.054+0000 7f0561762640 1 --2- 172.21.15.150:0/560558280 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55dc2905ee40 0x55dc2948d4b0 secure :-1 s=READY pgs=1701 cs=0 l=1 rev1=1 crypto rx=0x7f054c012900 tx=0x7f054c01ec80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cd5f79f0b902b42b server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:52:30.058 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:30.054+0000 7f05427fc640 1 -- 172.21.15.150:0/560558280 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f054c028b50 con 0x55dc2905ee40 2024-09-17T05:52:30.059 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:30.054+0000 7f05427fc640 1 -- 172.21.15.150:0/560558280 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f054c036070 con 0x55dc2905ee40 2024-09-17T05:52:30.059 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:30.054+0000 7f05427fc640 1 -- 172.21.15.150:0/560558280 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f054c01d420 con 0x55dc2905ee40 2024-09-17T05:52:30.059 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:30.054+0000 7f056aa19740 1 -- 172.21.15.150:0/560558280 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55dc2905ee40 msgr2=0x55dc2948d4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:52:30.059 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:30.054+0000 7f056aa19740 1 --2- 172.21.15.150:0/560558280 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55dc2905ee40 0x55dc2948d4b0 secure :-1 s=READY pgs=1701 cs=0 l=1 rev1=1 crypto rx=0x7f054c012900 tx=0x7f054c01ec80 comp rx=0 tx=0).stop 2024-09-17T05:52:30.059 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:30.054+0000 7f056aa19740 1 -- 172.21.15.150:0/560558280 shutdown_connections 2024-09-17T05:52:30.059 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:30.054+0000 7f056aa19740 1 --2- 172.21.15.150:0/560558280 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55dc2907f590 0x55dc29448310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:52:30.059 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:30.054+0000 7f056aa19740 1 --2- 172.21.15.150:0/560558280 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55dc290773b0 0x55dc29447dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:52:30.059 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:30.054+0000 7f056aa19740 1 --2- 172.21.15.150:0/560558280 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55dc2905ee40 0x55dc2948d4b0 unknown :-1 s=CLOSED pgs=1701 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:52:30.059 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:30.055+0000 7f056aa19740 1 -- 172.21.15.150:0/560558280 >> 172.21.15.150:0/560558280 conn(0x55dc290943c0 msgr2=0x55dc2948ee80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:52:30.059 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:30.055+0000 7f056aa19740 1 -- 172.21.15.150:0/560558280 shutdown_connections 2024-09-17T05:52:30.060 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:30.055+0000 7f056aa19740 1 -- 172.21.15.150:0/560558280 wait complete. 2024-09-17T05:52:30.060 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:30.055+0000 7f056aa19740 1 -- start start 2024-09-17T05:52:30.060 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:30.055+0000 7f056aa19740 1 Processor -- start 2024-09-17T05:52:30.064 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:30.057+0000 7f056aa19740 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55dc2905ee40 0x55dc294f94f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:52:30.064 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:30.057+0000 7f056aa19740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55dc290773b0 0x55dc2945f650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:52:30.064 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:30.057+0000 7f056aa19740 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55dc2907f590 0x55dc2945fb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:52:30.064 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:30.057+0000 7f056aa19740 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x55dc29483c90 con 0x55dc2907f590 2024-09-17T05:52:30.064 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:30.057+0000 7f056aa19740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x55dc293ba820 con 0x55dc290773b0 2024-09-17T05:52:30.064 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:30.057+0000 7f056aa19740 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x55dc294a35a0 con 0x55dc2905ee40 2024-09-17T05:52:30.064 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:30.057+0000 7f056aa19740 10 client.0 _ll_register_callbacks cb 0x7f054c012f00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T05:52:30.064 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:30.057+0000 7f0561f63640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55dc2907f590 0x55dc2945fb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:52:30.064 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:30.057+0000 7f0561f63640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55dc2907f590 0x55dc2945fb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:35936/0 (socket says 172.21.15.150:35936) 2024-09-17T05:52:30.065 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:30.057+0000 7f0561f63640 1 -- 172.21.15.150:0/456212357 learned_addr learned my addr 172.21.15.150:0/456212357 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:52:30.065 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:30.057+0000 7f0561762640 1 --2- 172.21.15.150:0/456212357 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55dc2905ee40 0x55dc294f94f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:52:30.065 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:30.057+0000 7f0560f61640 1 --2- 172.21.15.150:0/456212357 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55dc290773b0 0x55dc2945f650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:52:30.065 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:30.057+0000 7f0561f63640 1 -- 172.21.15.150:0/456212357 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55dc2905ee40 msgr2=0x55dc294f94f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:52:30.065 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:30.057+0000 7f0561f63640 1 --2- 172.21.15.150:0/456212357 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55dc2905ee40 0x55dc294f94f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:52:30.065 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:30.057+0000 7f0561f63640 1 -- 172.21.15.150:0/456212357 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55dc290773b0 msgr2=0x55dc2945f650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:52:30.065 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:30.057+0000 7f0561f63640 1 --2- 172.21.15.150:0/456212357 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55dc290773b0 0x55dc2945f650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:52:30.065 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:30.057+0000 7f0561f63640 1 -- 172.21.15.150:0/456212357 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55dc294b4430 con 0x55dc2907f590 2024-09-17T05:52:30.066 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:30.058+0000 7f0561f63640 1 --2- 172.21.15.150:0/456212357 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55dc2907f590 0x55dc2945fb90 secure :-1 s=READY pgs=1702 cs=0 l=1 rev1=1 crypto rx=0x7f05540b9990 tx=0x7f055408bc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1183eac411447c46 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:52:30.066 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:30.058+0000 7f053bfff640 10 client.0 ms_handle_connect on v2:172.21.15.150:3300/0 2024-09-17T05:52:30.066 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:30.058+0000 7f053bfff640 1 -- 172.21.15.150:0/456212357 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05540835d0 con 0x55dc2907f590 2024-09-17T05:52:30.066 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:30.058+0000 7f053bfff640 1 -- 172.21.15.150:0/456212357 <== mon.0 v2:172.21.15.150:3300/0 2 ==== osd_map(127..127 src has 1..127) ==== 5877+0+0 (secure 0 0 0) 0x7f055407e820 con 0x55dc2907f590 2024-09-17T05:52:30.066 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:30.058+0000 7f056aa19740 1 -- 172.21.15.150:0/456212357 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f054c036070 con 0x55dc2907f590 2024-09-17T05:52:30.066 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:30.058+0000 7f053bfff640 1 -- 172.21.15.150:0/456212357 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_get_version_reply(handle=1 version=80) ==== 24+0+0 (secure 0 0 0) 0x7f05540b8050 con 0x55dc2907f590 2024-09-17T05:52:30.066 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:30.058+0000 7f056aa19740 10 client.9294 fetch_fsmap learned FSMap version 80 2024-09-17T05:52:30.066 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:30.058+0000 7f056aa19740 1 -- 172.21.15.150:0/456212357 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,fsmap=80,monmap=2+}) -- 0x55dc29487e80 con 0x55dc2907f590 2024-09-17T05:52:30.066 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:30.058+0000 7f053bfff640 1 -- 172.21.15.150:0/456212357 <== mon.0 v2:172.21.15.150:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f054c036070 con 0x55dc2907f590 2024-09-17T05:52:30.066 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:30.058+0000 7f053bfff640 1 -- 172.21.15.150:0/456212357 <== mon.0 v2:172.21.15.150:3300/0 5 ==== fsmap(e 80) ==== 3502+0+0 (secure 0 0 0) 0x7f05540a0070 con 0x55dc2907f590 2024-09-17T05:52:30.066 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:30.058+0000 7f056aa19740 10 client.9294 fetch_fsmap finished waiting for FSMap version 80 2024-09-17T05:52:30.066 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:30.058+0000 7f056aa19740 10 client.9294 resolve_mds: resolved name 'd' to daemon mds.d 2024-09-17T05:52:30.067 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:30.058+0000 7f056aa19740 20 client.9294 populate_metadata read hostname 'smithi150' 2024-09-17T05:52:30.067 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:30.058+0000 7f056aa19740 1 --2- 172.21.15.150:0/456212357 >> [v2:172.21.15.176:6834/1926613940,v1:172.21.15.176:6836/1926613940] conn(0x55dc29034280 0x55dc29513880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:52:30.067 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:30.058+0000 7f056aa19740 4 client.9294 mds_command: new command op to 9141 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-17T05:52:30.067 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:30.058+0000 7f056aa19740 1 -- 172.21.15.150:0/456212357 --> [v2:172.21.15.176:6834/1926613940,v1:172.21.15.176:6836/1926613940] -- command(tid 0: {"prefix": "status"}) -- 0x55dc293b8220 con 0x55dc29034280 2024-09-17T05:52:30.067 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:30.058+0000 7f0561762640 1 --2- 172.21.15.150:0/456212357 >> [v2:172.21.15.176:6834/1926613940,v1:172.21.15.176:6836/1926613940] conn(0x55dc29034280 0x55dc29513880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:52:30.067 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:30.059+0000 7f053bfff640 10 client.9294 ms_handle_connect on v2:172.21.15.176:6834/1926613940 2024-09-17T05:52:30.067 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:30.059+0000 7f0561762640 1 --2- 172.21.15.150:0/456212357 >> [v2:172.21.15.176:6834/1926613940,v1:172.21.15.176:6836/1926613940] conn(0x55dc29034280 0x55dc29513880 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=232b38fa48a70da3 server_cookie=d7ba54c7b5424796 in_seq=0 out_seq=0 2024-09-17T05:52:30.067 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:30.059+0000 7f053bfff640 1 -- 172.21.15.150:0/456212357 <== mds.0 v2:172.21.15.176:6834/1926613940 1 ==== command_reply(tid 0: 0 ) ==== 8+0+333 (crc 0 0 0) 0x55dc293b8220 con 0x55dc29034280 2024-09-17T05:52:30.067 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:30.059+0000 7f053bfff640 10 client.9294 handle_command_reply: tid=0 2024-09-17T05:52:30.067 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:30.059+0000 7f056aa19740 1 client.9294 shutdown 2024-09-17T05:52:30.067 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:30.059+0000 7f056aa19740 1 -- 172.21.15.150:0/456212357 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55dc2907f590 msgr2=0x55dc2945fb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:52:30.067 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:30.059+0000 7f056aa19740 1 --2- 172.21.15.150:0/456212357 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55dc2907f590 0x55dc2945fb90 secure :-1 s=READY pgs=1702 cs=0 l=1 rev1=1 crypto rx=0x7f05540b9990 tx=0x7f055408bc20 comp rx=0 tx=0).stop 2024-09-17T05:52:30.068 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:30.059+0000 7f056aa19740 1 -- 172.21.15.150:0/456212357 shutdown_connections 2024-09-17T05:52:30.068 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:30.059+0000 7f056aa19740 1 --2- 172.21.15.150:0/456212357 >> [v2:172.21.15.176:6834/1926613940,v1:172.21.15.176:6836/1926613940] conn(0x55dc29034280 0x55dc29513880 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:52:30.068 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:30.059+0000 7f056aa19740 1 --2- 172.21.15.150:0/456212357 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55dc290773b0 0x55dc2945f650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:52:30.068 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:30.059+0000 7f056aa19740 1 --2- 172.21.15.150:0/456212357 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55dc2907f590 0x55dc2945fb90 unknown :-1 s=CLOSED pgs=1702 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:52:30.068 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:30.059+0000 7f053bfff640 0 client.9294 ms_handle_reset on v2:172.21.15.176:6834/1926613940 2024-09-17T05:52:30.068 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:30.059+0000 7f056aa19740 1 --2- 172.21.15.150:0/456212357 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55dc2905ee40 0x55dc294f94f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:52:30.068 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:30.059+0000 7f056aa19740 1 -- 172.21.15.150:0/456212357 >> 172.21.15.150:0/456212357 conn(0x55dc290943c0 msgr2=0x55dc2948ee80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:52:30.068 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:30.059+0000 7f056aa19740 1 -- 172.21.15.150:0/456212357 shutdown_connections 2024-09-17T05:52:30.068 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:30.059+0000 7f056aa19740 1 -- 172.21.15.150:0/456212357 wait complete. 2024-09-17T05:52:30.068 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:30.059+0000 7f056aa19740 20 client.9294 trim_cache size 0 max 16384 2024-09-17T05:52:30.069 INFO:teuthology.orchestra.run.smithi150.stdout:{ 2024-09-17T05:52:30.069 INFO:teuthology.orchestra.run.smithi150.stdout: "cluster_fsid": "9f2e05e9-d629-47b3-b26b-1360655b7d20", 2024-09-17T05:52:30.069 INFO:teuthology.orchestra.run.smithi150.stdout: "whoami": 0, 2024-09-17T05:52:30.069 INFO:teuthology.orchestra.run.smithi150.stdout: "id": 9141, 2024-09-17T05:52:30.069 INFO:teuthology.orchestra.run.smithi150.stdout: "want_state": "up:active", 2024-09-17T05:52:30.069 INFO:teuthology.orchestra.run.smithi150.stdout: "state": "up:active", 2024-09-17T05:52:30.069 INFO:teuthology.orchestra.run.smithi150.stdout: "fs_name": "cephfs", 2024-09-17T05:52:30.069 INFO:teuthology.orchestra.run.smithi150.stdout: "rank_uptime": 10.155188412999999, 2024-09-17T05:52:30.069 INFO:teuthology.orchestra.run.smithi150.stdout: "mdsmap_epoch": 80, 2024-09-17T05:52:30.069 INFO:teuthology.orchestra.run.smithi150.stdout: "osdmap_epoch": 127, 2024-09-17T05:52:30.069 INFO:teuthology.orchestra.run.smithi150.stdout: "osdmap_epoch_barrier": 127, 2024-09-17T05:52:30.069 INFO:teuthology.orchestra.run.smithi150.stdout: "uptime": 14.848012131999999 2024-09-17T05:52:30.070 INFO:teuthology.orchestra.run.smithi150.stdout:} 2024-09-17T05:52:30.070 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:30.060+0000 7f05639c6640 1 -- 172.21.15.150:0/2743472114 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f054807aa20 msgr2=0x7f054807cf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:52:30.070 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:30.060+0000 7f05639c6640 1 --2- 172.21.15.150:0/2743472114 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f054807aa20 0x7f054807cf30 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x7f054c005fd0 tx=0x7f054c003c30 comp rx=0 tx=0).stop 2024-09-17T05:52:30.071 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:30.060+0000 7f05639c6640 1 -- 172.21.15.150:0/2743472114 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f055c0b1150 msgr2=0x7f055c0b1560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:52:30.071 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:30.060+0000 7f05639c6640 1 --2- 172.21.15.150:0/2743472114 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f055c0b1150 0x7f055c0b1560 secure :-1 s=READY pgs=1698 cs=0 l=1 rev1=1 crypto rx=0x7f0554001690 tx=0x7f05540063d0 comp rx=0 tx=0).stop 2024-09-17T05:52:30.071 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:30.060+0000 7f05639c6640 1 -- 172.21.15.150:0/2743472114 shutdown_connections 2024-09-17T05:52:30.071 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:30.060+0000 7f05639c6640 1 --2- 172.21.15.150:0/2743472114 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f055c1e65e0 0x7f055c1de510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:52:30.071 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:30.060+0000 7f05639c6640 1 --2- 172.21.15.150:0/2743472114 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f054807aa20 0x7f054807cf30 unknown :-1 s=CLOSED pgs=722 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:52:30.071 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:30.060+0000 7f05639c6640 1 --2- 172.21.15.150:0/2743472114 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f055c0b1150 0x7f055c0b1560 unknown :-1 s=CLOSED pgs=1698 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:52:30.071 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:30.060+0000 7f05639c6640 1 --2- 172.21.15.150:0/2743472114 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0544005300 0x7f055c1e72c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:52:30.071 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:30.060+0000 7f05639c6640 1 -- 172.21.15.150:0/2743472114 >> 172.21.15.150:0/2743472114 conn(0x7f055c0cef80 msgr2=0x7f055c0cdce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:52:30.071 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:30.060+0000 7f05639c6640 1 -- 172.21.15.150:0/2743472114 shutdown_connections 2024-09-17T05:52:30.071 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:30.060+0000 7f05639c6640 1 -- 172.21.15.150:0/2743472114 wait complete. 2024-09-17T05:52:30.073 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-17T05:52:30.185 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:30.183+0000 7f80aa9e6640 1 -- 172.21.15.150:0/691309469 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f80a40b5d50 msgr2=0x7f80a40d2780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:52:30.186 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:30.183+0000 7f80aa9e6640 1 --2- 172.21.15.150:0/691309469 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f80a40b5d50 0x7f80a40d2780 secure :-1 s=READY pgs=1704 cs=0 l=1 rev1=1 crypto rx=0x7f80a408c5a0 tx=0x7f809402a5f0 comp rx=0 tx=0).stop 2024-09-17T05:52:30.186 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:30.183+0000 7f80aa9e6640 1 -- 172.21.15.150:0/691309469 shutdown_connections 2024-09-17T05:52:30.186 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:30.183+0000 7f80aa9e6640 1 --2- 172.21.15.150:0/691309469 >> v2:172.21.15.176:3300/0 conn(0x7f80a40d1790 0x7f80a40d0400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:52:30.186 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:30.183+0000 7f80aa9e6640 1 --2- 172.21.15.150:0/691309469 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f80a40b5d50 0x7f80a40d2780 unknown :-1 s=CLOSED pgs=1704 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:52:30.186 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:30.183+0000 7f80aa9e6640 1 -- 172.21.15.150:0/691309469 >> 172.21.15.150:0/691309469 conn(0x7f80a408bfe0 msgr2=0x7f80a40d4670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:52:30.186 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:30.184+0000 7f80aa9e6640 1 -- 172.21.15.150:0/691309469 shutdown_connections 2024-09-17T05:52:30.186 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:30.184+0000 7f80aa9e6640 1 -- 172.21.15.150:0/691309469 wait complete. 2024-09-17T05:52:30.187 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:30.185+0000 7f80aa9e6640 1 Processor -- start 2024-09-17T05:52:30.187 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:30.185+0000 7f80aa9e6640 1 -- start start 2024-09-17T05:52:30.190 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:30.187+0000 7f80aa9e6640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f80a40b5d50 0x7f80a409ffb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:52:30.190 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:30.187+0000 7f80aa9e6640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f80a40d4f90 0x7f80a409f200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:52:30.190 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:30.187+0000 7f80aa9e6640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f80a41566b0 0x7f80a4155350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:52:30.190 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:30.187+0000 7f80aa9e6640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f80a40b7aa0 con 0x7f80a40d4f90 2024-09-17T05:52:30.190 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:30.187+0000 7f80aa9e6640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f80a40b7920 con 0x7f80a40b5d50 2024-09-17T05:52:30.190 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:30.187+0000 7f80aa9e6640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f80a40b7c20 con 0x7f80a41566b0 2024-09-17T05:52:30.191 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:30.187+0000 7f80a37fe640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f80a40d4f90 0x7f80a409f200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:52:30.191 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:30.187+0000 7f80a37fe640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f80a40d4f90 0x7f80a409f200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:37794/0 (socket says 172.21.15.150:37794) 2024-09-17T05:52:30.191 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:30.187+0000 7f80a37fe640 1 -- 172.21.15.150:0/2705345008 learned_addr learned my addr 172.21.15.150:0/2705345008 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:52:30.191 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:30.187+0000 7f80a3fff640 1 --2- 172.21.15.150:0/2705345008 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f80a40b5d50 0x7f80a409ffb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:52:30.191 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:30.187+0000 7f80a8f83640 1 --2- 172.21.15.150:0/2705345008 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f80a41566b0 0x7f80a4155350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:52:30.191 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:30.187+0000 7f80a37fe640 1 -- 172.21.15.150:0/2705345008 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f80a41566b0 msgr2=0x7f80a4155350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:52:30.191 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:30.187+0000 7f80a37fe640 1 --2- 172.21.15.150:0/2705345008 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f80a41566b0 0x7f80a4155350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:52:30.191 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:30.187+0000 7f80a37fe640 1 -- 172.21.15.150:0/2705345008 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f80a40b5d50 msgr2=0x7f80a409ffb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:52:30.191 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:30.187+0000 7f80a37fe640 1 --2- 172.21.15.150:0/2705345008 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f80a40b5d50 0x7f80a409ffb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:52:30.191 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:30.187+0000 7f80a37fe640 1 -- 172.21.15.150:0/2705345008 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f80a40a0990 con 0x7f80a40d4f90 2024-09-17T05:52:30.191 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:30.187+0000 7f80a37fe640 1 --2- 172.21.15.150:0/2705345008 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f80a40d4f90 0x7f80a409f200 secure :-1 s=READY pgs=1705 cs=0 l=1 rev1=1 crypto rx=0x7f809800c430 tx=0x7f809800c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:52:30.191 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:30.187+0000 7f80a0ff9640 1 -- 172.21.15.150:0/2705345008 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8098017070 con 0x7f80a40d4f90 2024-09-17T05:52:30.192 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:30.187+0000 7f80a0ff9640 1 -- 172.21.15.150:0/2705345008 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f80980053c0 con 0x7f80a40d4f90 2024-09-17T05:52:30.192 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:30.188+0000 7f80a0ff9640 1 -- 172.21.15.150:0/2705345008 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8098003850 con 0x7f80a40d4f90 2024-09-17T05:52:30.192 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:30.188+0000 7f80aa9e6640 1 -- 172.21.15.150:0/2705345008 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f80a409e440 con 0x7f80a40d4f90 2024-09-17T05:52:30.192 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:30.188+0000 7f80aa9e6640 1 -- 172.21.15.150:0/2705345008 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f80a409ea00 con 0x7f80a40d4f90 2024-09-17T05:52:30.192 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:30.189+0000 7f80aa9e6640 1 -- 172.21.15.150:0/2705345008 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f80a40a0700 con 0x7f80a40d4f90 2024-09-17T05:52:30.193 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:30.189+0000 7f80a0ff9640 1 -- 172.21.15.150:0/2705345008 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 42) ==== 104195+0+0 (secure 0 0 0) 0x7f809801a070 con 0x7f80a40d4f90 2024-09-17T05:52:30.193 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:30.190+0000 7f80a0ff9640 1 --2- 172.21.15.150:0/2705345008 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f809007a9f0 0x7f809007cf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:52:30.193 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:30.190+0000 7f80a0ff9640 1 -- 172.21.15.150:0/2705345008 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(127..127 src has 1..127) ==== 5877+0+0 (secure 0 0 0) 0x7f8098098f90 con 0x7f80a40d4f90 2024-09-17T05:52:30.193 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:30.190+0000 7f80a3fff640 1 --2- 172.21.15.150:0/2705345008 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f809007a9f0 0x7f809007cf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:52:30.193 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:30.191+0000 7f80a3fff640 1 --2- 172.21.15.150:0/2705345008 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f809007a9f0 0x7f809007cf00 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 crypto rx=0x7f8094033000 tx=0x7f8094004730 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:52:30.196 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:30.195+0000 7f80a0ff9640 1 -- 172.21.15.150:0/2705345008 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f8098062910 con 0x7f80a40d4f90 2024-09-17T05:52:30.407 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:30.406+0000 7f80aa9e6640 1 -- 172.21.15.150:0/2705345008 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f80a40b8140 con 0x7f80a40d4f90 2024-09-17T05:52:30.408 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:30.406+0000 7f80a0ff9640 1 -- 172.21.15.150:0/2705345008 <== mon.0 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v80) ==== 53+0+73 (secure 0 0 0) 0x7f8098067340 con 0x7f80a40d4f90 2024-09-17T05:52:30.408 INFO:teuthology.orchestra.run.smithi150.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-17T05:52:30.410 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:30.408+0000 7f80aa9e6640 1 -- 172.21.15.150:0/2705345008 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f809007a9f0 msgr2=0x7f809007cf00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:52:30.410 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:30.408+0000 7f80aa9e6640 1 --2- 172.21.15.150:0/2705345008 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f809007a9f0 0x7f809007cf00 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 crypto rx=0x7f8094033000 tx=0x7f8094004730 comp rx=0 tx=0).stop 2024-09-17T05:52:30.411 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:30.408+0000 7f80aa9e6640 1 -- 172.21.15.150:0/2705345008 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f80a40d4f90 msgr2=0x7f80a409f200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:52:30.411 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:30.408+0000 7f80aa9e6640 1 --2- 172.21.15.150:0/2705345008 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f80a40d4f90 0x7f80a409f200 secure :-1 s=READY pgs=1705 cs=0 l=1 rev1=1 crypto rx=0x7f809800c430 tx=0x7f809800c8f0 comp rx=0 tx=0).stop 2024-09-17T05:52:30.411 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:30.408+0000 7f80aa9e6640 1 -- 172.21.15.150:0/2705345008 shutdown_connections 2024-09-17T05:52:30.411 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:30.408+0000 7f80aa9e6640 1 --2- 172.21.15.150:0/2705345008 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f809007a9f0 0x7f809007cf00 unknown :-1 s=CLOSED pgs=723 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:52:30.411 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:30.408+0000 7f80aa9e6640 1 --2- 172.21.15.150:0/2705345008 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f80a41566b0 0x7f80a4155350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:52:30.411 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:30.408+0000 7f80aa9e6640 1 --2- 172.21.15.150:0/2705345008 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f80a40d4f90 0x7f80a409f200 unknown :-1 s=CLOSED pgs=1705 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:52:30.411 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:30.408+0000 7f80aa9e6640 1 --2- 172.21.15.150:0/2705345008 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f80a40b5d50 0x7f80a409ffb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:52:30.411 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:30.408+0000 7f80aa9e6640 1 -- 172.21.15.150:0/2705345008 >> 172.21.15.150:0/2705345008 conn(0x7f80a408bfe0 msgr2=0x7f80a406e6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:52:30.411 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:30.408+0000 7f80aa9e6640 1 -- 172.21.15.150:0/2705345008 shutdown_connections 2024-09-17T05:52:30.411 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:30.408+0000 7f80aa9e6640 1 -- 172.21.15.150:0/2705345008 wait complete. 2024-09-17T05:52:30.422 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-09-17T05:52:30.422 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-17T05:52:30.422 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi150.front.sepia.ceph.com 2024-09-17T05:52:30.422 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-17T05:52:30.422 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-17T05:52:30.422 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-09-17T05:52:30.422 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-09-17T05:52:30.422 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-17T05:52:30.422 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-17T05:52:30.422 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:52:30.423 DEBUG:teuthology.orchestra.run.smithi150:> ip addr 2024-09-17T05:52:30.438 INFO:teuthology.orchestra.run.smithi150.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-17T05:52:30.439 INFO:teuthology.orchestra.run.smithi150.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-17T05:52:30.439 INFO:teuthology.orchestra.run.smithi150.stdout: inet 127.0.0.1/8 scope host lo 2024-09-17T05:52:30.439 INFO:teuthology.orchestra.run.smithi150.stdout: valid_lft forever preferred_lft forever 2024-09-17T05:52:30.439 INFO:teuthology.orchestra.run.smithi150.stdout: inet6 ::1/128 scope host 2024-09-17T05:52:30.439 INFO:teuthology.orchestra.run.smithi150.stdout: valid_lft forever preferred_lft forever 2024-09-17T05:52:30.439 INFO:teuthology.orchestra.run.smithi150.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-17T05:52:30.439 INFO:teuthology.orchestra.run.smithi150.stdout: link/ether 0c:c4:7a:d9:da:bc brd ff:ff:ff:ff:ff:ff 2024-09-17T05:52:30.440 INFO:teuthology.orchestra.run.smithi150.stdout: altname enp7s0f0 2024-09-17T05:52:30.440 INFO:teuthology.orchestra.run.smithi150.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-17T05:52:30.440 INFO:teuthology.orchestra.run.smithi150.stdout: link/ether 0c:c4:7a:d9:da:bd brd ff:ff:ff:ff:ff:ff 2024-09-17T05:52:30.440 INFO:teuthology.orchestra.run.smithi150.stdout: altname enp7s0f1 2024-09-17T05:52:30.440 INFO:teuthology.orchestra.run.smithi150.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-17T05:52:30.440 INFO:teuthology.orchestra.run.smithi150.stdout: link/ether 0c:c4:7a:88:6e:34 brd ff:ff:ff:ff:ff:ff 2024-09-17T05:52:30.440 INFO:teuthology.orchestra.run.smithi150.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-17T05:52:30.440 INFO:teuthology.orchestra.run.smithi150.stdout: link/ether 0c:c4:7a:88:6e:35 brd ff:ff:ff:ff:ff:ff 2024-09-17T05:52:30.440 INFO:teuthology.orchestra.run.smithi150.stdout: inet 172.21.15.150/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-09-17T05:52:30.440 INFO:teuthology.orchestra.run.smithi150.stdout: valid_lft 42164sec preferred_lft 42164sec 2024-09-17T05:52:30.440 INFO:teuthology.orchestra.run.smithi150.stdout: inet6 fe80::ec4:7aff:fe88:6e35/64 scope link noprefixroute 2024-09-17T05:52:30.440 INFO:teuthology.orchestra.run.smithi150.stdout: valid_lft forever preferred_lft forever 2024-09-17T05:52:30.441 INFO:teuthology.orchestra.run.smithi150.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-17T05:52:30.441 INFO:teuthology.orchestra.run.smithi150.stdout: link/ether 1a:d2:4c:31:46:82 brd ff:ff:ff:ff:ff:ff 2024-09-17T05:52:30.441 INFO:teuthology.orchestra.run.smithi150.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-17T05:52:30.441 INFO:teuthology.orchestra.run.smithi150.stdout: valid_lft forever preferred_lft forever 2024-09-17T05:52:30.441 INFO:teuthology.orchestra.run.smithi150.stdout: inet6 fe80::70b6:c6ff:fe60:62a2/64 scope link 2024-09-17T05:52:30.441 INFO:teuthology.orchestra.run.smithi150.stdout: valid_lft forever preferred_lft forever 2024-09-17T05:52:30.441 INFO:teuthology.orchestra.run.smithi150.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-17T05:52:30.441 INFO:teuthology.orchestra.run.smithi150.stdout: link/ether 32:e1:8b:37:8c:b3 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-17T05:52:30.441 INFO:teuthology.orchestra.run.smithi150.stdout: inet6 fe80::30e1:8bff:fe37:8cb3/64 scope link 2024-09-17T05:52:30.441 INFO:teuthology.orchestra.run.smithi150.stdout: valid_lft forever preferred_lft forever 2024-09-17T05:52:30.441 INFO:teuthology.orchestra.run.smithi150.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-17T05:52:30.441 INFO:teuthology.orchestra.run.smithi150.stdout: link/ether 1a:d2:4c:31:46:82 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-17T05:52:30.442 INFO:teuthology.orchestra.run.smithi150.stdout: inet6 fe80::18d2:4cff:fe31:4682/64 scope link 2024-09-17T05:52:30.442 INFO:teuthology.orchestra.run.smithi150.stdout: valid_lft forever preferred_lft forever 2024-09-17T05:52:30.442 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:52:30.442 DEBUG:teuthology.orchestra.run.smithi150:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-17T05:52:30.502 INFO:teuthology.orchestra.run.smithi150.stdout:1 2024-09-17T05:52:30.503 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:52:30.503 DEBUG:teuthology.orchestra.run.smithi150:> route 2024-09-17T05:52:30.560 INFO:teuthology.orchestra.run.smithi150.stdout:Kernel IP routing table 2024-09-17T05:52:30.561 INFO:teuthology.orchestra.run.smithi150.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-17T05:52:30.561 INFO:teuthology.orchestra.run.smithi150.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-17T05:52:30.561 INFO:teuthology.orchestra.run.smithi150.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-17T05:52:30.561 INFO:teuthology.orchestra.run.smithi150.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-17T05:52:30.561 DEBUG:teuthology.orchestra.run.smithi150:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-17T05:52:30.561 DEBUG:teuthology.orchestra.run.smithi150:> set -e 2024-09-17T05:52:30.562 DEBUG:teuthology.orchestra.run.smithi150:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-17T05:52:30.562 DEBUG:teuthology.orchestra.run.smithi150:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-17T05:52:30.562 DEBUG:teuthology.orchestra.run.smithi150:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-17T05:52:30.562 DEBUG:teuthology.orchestra.run.smithi150:> ') 2024-09-17T05:52:30.648 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:30 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-17T05:52:30.681 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:30 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T05:52:30.687 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:52:30.687 DEBUG:teuthology.orchestra.run.smithi150:> ip netns list 2024-09-17T05:52:30.702 INFO:teuthology.orchestra.run.smithi150.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-09-17T05:52:30.703 INFO:teuthology.orchestra.run.smithi150.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-17T05:52:30.703 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-17T05:52:30.703 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:52:30.703 DEBUG:teuthology.orchestra.run.smithi150:> sudo ip link set brx.0 up 2024-09-17T05:52:30.767 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-17T05:52:30.767 DEBUG:teuthology.orchestra.run.smithi150:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-17T05:52:30.823 INFO:teuthology.orchestra.run.smithi150.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-17T05:52:30.823 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-17T05:52:30.823 DEBUG:teuthology.orchestra.run.smithi150:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-17T05:52:30.878 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-09-17T05:52:30.878 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:52:30.879 DEBUG:teuthology.orchestra.run.smithi150:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-17T05:52:30.973 INFO:teuthology.orchestra.run.smithi150.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-17T05:52:30.973 INFO:teuthology.orchestra.run.smithi150.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-17T05:52:30.973 INFO:teuthology.orchestra.run.smithi150.stdout:invalid new device string format 2024-09-17T05:52:30.983 INFO:teuthology.orchestra.run.smithi150.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-17T05:52:30.983 INFO:teuthology.orchestra.run.smithi150.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-17T05:52:30.984 INFO:teuthology.orchestra.run.smithi150.stdout:invalid new device string format 2024-09-17T05:52:30.984 INFO:teuthology.orchestra.run.smithi150.stdout:mount.ceph: resolved to: "172.21.15.150:3300,172.21.15.176:3300,172.21.15.176:3301" 2024-09-17T05:52:30.984 INFO:teuthology.orchestra.run.smithi150.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-17T05:52:30.990 INFO:teuthology.orchestra.run.smithi150.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-17T05:52:30.990 INFO:teuthology.orchestra.run.smithi150.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-17T05:52:30.990 INFO:teuthology.orchestra.run.smithi150.stdout:invalid new device string format 2024-09-17T05:52:30.990 INFO:teuthology.orchestra.run.smithi150.stdout:mount.ceph: resolved to: "172.21.15.150:3300,172.21.15.176:3300,172.21.15.176:3301" 2024-09-17T05:52:30.990 INFO:teuthology.orchestra.run.smithi150.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-17T05:52:30.990 INFO:teuthology.orchestra.run.smithi150.stdout:mount.ceph: resolved to: "172.21.15.150:6789,172.21.15.176:6789,172.21.15.176:6790" 2024-09-17T05:52:30.990 INFO:teuthology.orchestra.run.smithi150.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.150:6789,172.21.15.176:6789,172.21.15.176:6790:/ 2024-09-17T05:52:30.990 INFO:teuthology.orchestra.run.smithi150.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=9f2e05e9-d629-47b3-b26b-1360655b7d20" will pass to kernel 2024-09-17T05:52:30.991 INFO:teuthology.orchestra.run.smithi150.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-09-17T05:52:30.991 INFO:teuthology.orchestra.run.smithi150.stdout: You just mounted a file system that supports labels which does not 2024-09-17T05:52:30.991 INFO:teuthology.orchestra.run.smithi150.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-09-17T05:52:30.991 INFO:teuthology.orchestra.run.smithi150.stdout: applications will generate AVC messages and not be allowed access to 2024-09-17T05:52:30.992 INFO:teuthology.orchestra.run.smithi150.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-09-17T05:52:30.992 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-17T05:52:30.993 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:52:30.993 DEBUG:teuthology.orchestra.run.smithi150:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-17T05:52:31.018 DEBUG:teuthology.orchestra.run.smithi150:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-17T05:52:31.110 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:31 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-17T05:52:31.117 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:31 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T05:52:31.123 INFO:teuthology.orchestra.run.smithi150.stdout:client9306 2024-09-17T05:52:31.124 DEBUG:teuthology.orchestra.run.smithi150:> set -ex 2024-09-17T05:52:31.124 DEBUG:teuthology.orchestra.run.smithi150:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T05:52:31.140 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs flag set enable_multiple true --yes-i-really-mean-it 2024-09-17T05:52:31.299 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:31.297+0000 7fe06c420640 1 -- 172.21.15.150:0/980599113 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe0640745c0 msgr2=0x7fe06415d610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:52:31.300 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:31.297+0000 7fe06c420640 1 --2- 172.21.15.150:0/980599113 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe0640745c0 0x7fe06415d610 secure :-1 s=READY pgs=1708 cs=0 l=1 rev1=1 crypto rx=0x7fe0640727c0 tx=0x7fe05402a530 comp rx=0 tx=0).stop 2024-09-17T05:52:31.300 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:31.297+0000 7fe06c420640 1 -- 172.21.15.150:0/980599113 shutdown_connections 2024-09-17T05:52:31.300 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:31.297+0000 7fe06c420640 1 --2- 172.21.15.150:0/980599113 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe0640745c0 0x7fe06415d610 unknown :-1 s=CLOSED pgs=1708 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:52:31.300 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:31.297+0000 7fe06c420640 1 --2- 172.21.15.150:0/980599113 >> v2:172.21.15.176:3300/0 conn(0x7fe064156db0 0x7fe0640b5f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:52:31.300 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:31.297+0000 7fe06c420640 1 -- 172.21.15.150:0/980599113 >> 172.21.15.150:0/980599113 conn(0x7fe064073890 msgr2=0x7fe064073ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:52:31.300 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:31.297+0000 7fe06c420640 1 -- 172.21.15.150:0/980599113 shutdown_connections 2024-09-17T05:52:31.300 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:31.297+0000 7fe06c420640 1 -- 172.21.15.150:0/980599113 wait complete. 2024-09-17T05:52:31.301 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:31.299+0000 7fe06c420640 1 Processor -- start 2024-09-17T05:52:31.301 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:31.299+0000 7fe06c420640 1 -- start start 2024-09-17T05:52:31.304 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:31.300+0000 7fe06c420640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe06406ddb0 0x7fe06414cc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:52:31.304 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:31.300+0000 7fe06c420640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe0640745c0 0x7fe064157330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:52:31.304 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:31.300+0000 7fe06c420640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe064156db0 0x7fe064144490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:52:31.304 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:31.300+0000 7fe06c420640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7fe0640cea20 con 0x7fe0640745c0 2024-09-17T05:52:31.304 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:31.300+0000 7fe06c420640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fe0640ce8a0 con 0x7fe064156db0 2024-09-17T05:52:31.304 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:31.300+0000 7fe06c420640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fe0640ceba0 con 0x7fe06406ddb0 2024-09-17T05:52:31.305 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:31.300+0000 7fe0699bb640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe0640745c0 0x7fe064157330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:52:31.305 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:31.300+0000 7fe0699bb640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe0640745c0 0x7fe064157330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:37802/0 (socket says 172.21.15.150:37802) 2024-09-17T05:52:31.305 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:31.300+0000 7fe0699bb640 1 -- 172.21.15.150:0/1952205062 learned_addr learned my addr 172.21.15.150:0/1952205062 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:52:31.305 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:31.300+0000 7fe06a9bd640 1 --2- 172.21.15.150:0/1952205062 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe064156db0 0x7fe064144490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:52:31.305 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:31.301+0000 7fe06a1bc640 1 --2- 172.21.15.150:0/1952205062 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe06406ddb0 0x7fe06414cc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:52:31.305 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:31.301+0000 7fe0699bb640 1 -- 172.21.15.150:0/1952205062 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe06406ddb0 msgr2=0x7fe06414cc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:52:31.305 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:31.301+0000 7fe0699bb640 1 --2- 172.21.15.150:0/1952205062 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe06406ddb0 0x7fe06414cc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:52:31.305 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:31.301+0000 7fe0699bb640 1 -- 172.21.15.150:0/1952205062 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe064156db0 msgr2=0x7fe064144490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:52:31.305 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:31.301+0000 7fe0699bb640 1 --2- 172.21.15.150:0/1952205062 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe064156db0 0x7fe064144490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:52:31.305 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:31.301+0000 7fe0699bb640 1 -- 172.21.15.150:0/1952205062 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe064157870 con 0x7fe0640745c0 2024-09-17T05:52:31.305 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:31.301+0000 7fe06a1bc640 1 --2- 172.21.15.150:0/1952205062 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe06406ddb0 0x7fe06414cc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:52:31.305 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:31.301+0000 7fe0699bb640 1 --2- 172.21.15.150:0/1952205062 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe0640745c0 0x7fe064157330 secure :-1 s=READY pgs=1709 cs=0 l=1 rev1=1 crypto rx=0x7fe05402ab20 tx=0x7fe054033c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:52:31.306 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:31.301+0000 7fe05affd640 1 -- 172.21.15.150:0/1952205062 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe054031d60 con 0x7fe0640745c0 2024-09-17T05:52:31.306 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:31.301+0000 7fe05affd640 1 -- 172.21.15.150:0/1952205062 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe054033e10 con 0x7fe0640745c0 2024-09-17T05:52:31.306 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:31.301+0000 7fe05affd640 1 -- 172.21.15.150:0/1952205062 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe054005260 con 0x7fe0640745c0 2024-09-17T05:52:31.306 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:31.301+0000 7fe06c420640 1 -- 172.21.15.150:0/1952205062 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe0641f69d0 con 0x7fe0640745c0 2024-09-17T05:52:31.306 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:31.301+0000 7fe06c420640 1 -- 172.21.15.150:0/1952205062 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe0641f6f50 con 0x7fe0640745c0 2024-09-17T05:52:31.306 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:31.302+0000 7fe06c420640 1 -- 172.21.15.150:0/1952205062 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe0640cf880 con 0x7fe0640745c0 2024-09-17T05:52:31.307 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:31.303+0000 7fe05affd640 1 -- 172.21.15.150:0/1952205062 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 42) ==== 104195+0+0 (secure 0 0 0) 0x7fe054005400 con 0x7fe0640745c0 2024-09-17T05:52:31.307 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:31.303+0000 7fe05affd640 1 --2- 172.21.15.150:0/1952205062 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fe04807a9f0 0x7fe04807cf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:52:31.307 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:31.303+0000 7fe05affd640 1 -- 172.21.15.150:0/1952205062 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(127..127 src has 1..127) ==== 5877+0+0 (secure 0 0 0) 0x7fe0540bafc0 con 0x7fe0640745c0 2024-09-17T05:52:31.307 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:31.304+0000 7fe06a1bc640 1 --2- 172.21.15.150:0/1952205062 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fe04807a9f0 0x7fe04807cf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:52:31.307 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:31.304+0000 7fe06a1bc640 1 --2- 172.21.15.150:0/1952205062 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fe04807a9f0 0x7fe04807cf00 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 crypto rx=0x7fe060005fd0 tx=0x7fe060005e20 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:52:31.309 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:31.308+0000 7fe05affd640 1 -- 172.21.15.150:0/1952205062 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fe05403f030 con 0x7fe0640745c0 2024-09-17T05:52:31.520 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:31.518+0000 7fe06c420640 1 -- 172.21.15.150:0/1952205062 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "fs flag set", "flag_name": "enable_multiple", "val": "true", "yes_i_really_mean_it": true} v 0) -- 0x7fe064152f40 con 0x7fe0640745c0 2024-09-17T05:52:32.164 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:32.162+0000 7fe05affd640 1 -- 172.21.15.150:0/1952205062 <== mon.0 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "fs flag set", "flag_name": "enable_multiple", "val": "true", "yes_i_really_mean_it": true}]=0 v81) ==== 136+0+0 (secure 0 0 0) 0x7fe054031770 con 0x7fe0640745c0 2024-09-17T05:52:32.167 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:32.165+0000 7fe06c420640 1 -- 172.21.15.150:0/1952205062 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fe04807a9f0 msgr2=0x7fe04807cf00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:52:32.167 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:32.165+0000 7fe06c420640 1 --2- 172.21.15.150:0/1952205062 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fe04807a9f0 0x7fe04807cf00 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 crypto rx=0x7fe060005fd0 tx=0x7fe060005e20 comp rx=0 tx=0).stop 2024-09-17T05:52:32.167 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:32.165+0000 7fe06c420640 1 -- 172.21.15.150:0/1952205062 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe0640745c0 msgr2=0x7fe064157330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:52:32.168 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:32.165+0000 7fe06c420640 1 --2- 172.21.15.150:0/1952205062 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe0640745c0 0x7fe064157330 secure :-1 s=READY pgs=1709 cs=0 l=1 rev1=1 crypto rx=0x7fe05402ab20 tx=0x7fe054033c20 comp rx=0 tx=0).stop 2024-09-17T05:52:32.168 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:32.165+0000 7fe06c420640 1 -- 172.21.15.150:0/1952205062 shutdown_connections 2024-09-17T05:52:32.168 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:32.165+0000 7fe06c420640 1 --2- 172.21.15.150:0/1952205062 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe064156db0 0x7fe064144490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:52:32.168 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:32.165+0000 7fe06c420640 1 --2- 172.21.15.150:0/1952205062 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fe04807a9f0 0x7fe04807cf00 unknown :-1 s=CLOSED pgs=724 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:52:32.168 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:32.165+0000 7fe06c420640 1 --2- 172.21.15.150:0/1952205062 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe0640745c0 0x7fe064157330 unknown :-1 s=CLOSED pgs=1709 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:52:32.169 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:32.165+0000 7fe06c420640 1 --2- 172.21.15.150:0/1952205062 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe06406ddb0 0x7fe06414cc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:52:32.169 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:32.165+0000 7fe06c420640 1 -- 172.21.15.150:0/1952205062 >> 172.21.15.150:0/1952205062 conn(0x7fe064073890 msgr2=0x7fe0640d0170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:52:32.169 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:32.165+0000 7fe06c420640 1 -- 172.21.15.150:0/1952205062 shutdown_connections 2024-09-17T05:52:32.169 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:32.165+0000 7fe06c420640 1 -- 172.21.15.150:0/1952205062 wait complete. 2024-09-17T05:52:32.180 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume ls 2024-09-17T05:52:32.298 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:32.296+0000 7f946e863640 1 -- 172.21.15.150:0/3936729095 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9454004800 msgr2=0x7f9454004c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:52:32.298 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:32.296+0000 7f946e863640 1 --2- 172.21.15.150:0/3936729095 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9454004800 0x7f9454004c10 secure :-1 s=READY pgs=1711 cs=0 l=1 rev1=1 crypto rx=0x7f94680b3ff0 tx=0x7f9454005830 comp rx=0 tx=0).stop 2024-09-17T05:52:32.298 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:32.296+0000 7f946ce00640 1 -- 172.21.15.150:0/3936729095 reap_dead start 2024-09-17T05:52:32.298 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:32.296+0000 7f946e863640 1 -- 172.21.15.150:0/3936729095 shutdown_connections 2024-09-17T05:52:32.298 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:32.296+0000 7f946e863640 1 -- 172.21.15.150:0/3936729095 >> 172.21.15.150:0/3936729095 conn(0x7f94680b6880 msgr2=0x7f94680b3060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:52:32.298 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:32.296+0000 7f946e863640 1 -- 172.21.15.150:0/3936729095 shutdown_connections 2024-09-17T05:52:32.298 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:32.296+0000 7f946e863640 1 -- 172.21.15.150:0/3936729095 wait complete. 2024-09-17T05:52:32.299 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:32.298+0000 7f946e863640 1 Processor -- start 2024-09-17T05:52:32.299 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:32.298+0000 7f946e863640 1 -- start start 2024-09-17T05:52:32.302 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:32.299+0000 7f946e863640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9454004800 0x7f9468152fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:52:32.302 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:32.299+0000 7f946e863640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f946809ef30 0x7f94681f5330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:52:32.302 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:32.299+0000 7f946e863640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f946815a9f0 0x7f946815ae00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:52:32.303 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:32.299+0000 7f946e863640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f94680aea00 con 0x7f9454004800 2024-09-17T05:52:32.303 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:32.299+0000 7f946e863640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f94680ae880 con 0x7f946809ef30 2024-09-17T05:52:32.303 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:32.299+0000 7f946e863640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f94680aeb80 con 0x7f946815a9f0 2024-09-17T05:52:32.303 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:32.299+0000 7f9467fff640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9454004800 0x7f9468152fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:52:32.303 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:32.299+0000 7f9467fff640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9454004800 0x7f9468152fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:37810/0 (socket says 172.21.15.150:37810) 2024-09-17T05:52:32.303 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:32.299+0000 7f9467fff640 1 -- 172.21.15.150:0/2479855507 learned_addr learned my addr 172.21.15.150:0/2479855507 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:52:32.303 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:32.299+0000 7f945f7fe640 1 --2- 172.21.15.150:0/2479855507 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f946809ef30 0x7f94681f5330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:52:32.303 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:32.299+0000 7f946ce00640 1 --2- 172.21.15.150:0/2479855507 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f946815a9f0 0x7f946815ae00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:52:32.303 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:32.300+0000 7f9467fff640 1 -- 172.21.15.150:0/2479855507 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f946815a9f0 msgr2=0x7f946815ae00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:52:32.303 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:32.300+0000 7f9467fff640 1 --2- 172.21.15.150:0/2479855507 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f946815a9f0 0x7f946815ae00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:52:32.303 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:32.300+0000 7f9467fff640 1 -- 172.21.15.150:0/2479855507 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f946809ef30 msgr2=0x7f94681f5330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:52:32.303 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:32.300+0000 7f9467fff640 1 --2- 172.21.15.150:0/2479855507 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f946809ef30 0x7f94681f5330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:52:32.304 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:32.300+0000 7f9467fff640 1 -- 172.21.15.150:0/2479855507 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f946815b340 con 0x7f9454004800 2024-09-17T05:52:32.304 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:32.300+0000 7f946ce00640 1 --2- 172.21.15.150:0/2479855507 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f946815a9f0 0x7f946815ae00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:52:32.304 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:32.300+0000 7f9467fff640 1 --2- 172.21.15.150:0/2479855507 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9454004800 0x7f9468152fe0 secure :-1 s=READY pgs=1712 cs=0 l=1 rev1=1 crypto rx=0x7f945800f6d0 tx=0x7f945800fb90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:52:32.304 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:32.300+0000 7f94657fa640 1 -- 172.21.15.150:0/2479855507 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f945800baa0 con 0x7f9454004800 2024-09-17T05:52:32.304 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:32.300+0000 7f94657fa640 1 -- 172.21.15.150:0/2479855507 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f945800bd30 con 0x7f9454004800 2024-09-17T05:52:32.304 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:32.300+0000 7f946e863640 1 -- 172.21.15.150:0/2479855507 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f94681f9c30 con 0x7f9454004800 2024-09-17T05:52:32.304 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:32.300+0000 7f94657fa640 1 -- 172.21.15.150:0/2479855507 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94580116a0 con 0x7f9454004800 2024-09-17T05:52:32.304 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:32.300+0000 7f946e863640 1 -- 172.21.15.150:0/2479855507 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f94681f9ef0 con 0x7f9454004800 2024-09-17T05:52:32.304 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:32.301+0000 7f946e863640 1 -- 172.21.15.150:0/2479855507 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9468152410 con 0x7f9454004800 2024-09-17T05:52:32.305 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:32.302+0000 7f94657fa640 1 -- 172.21.15.150:0/2479855507 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 42) ==== 104195+0+0 (secure 0 0 0) 0x7f9458019020 con 0x7f9454004800 2024-09-17T05:52:32.305 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:32.302+0000 7f94657fa640 1 --2- 172.21.15.150:0/2479855507 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f944807a9f0 0x7f944807cf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:52:32.305 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:32.302+0000 7f94657fa640 1 -- 172.21.15.150:0/2479855507 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(127..127 src has 1..127) ==== 5877+0+0 (secure 0 0 0) 0x7f945809a480 con 0x7f9454004800 2024-09-17T05:52:32.305 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:32.303+0000 7f945f7fe640 1 --2- 172.21.15.150:0/2479855507 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f944807a9f0 0x7f944807cf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:52:32.305 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:32.303+0000 7f945f7fe640 1 --2- 172.21.15.150:0/2479855507 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f944807a9f0 0x7f944807cf00 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 crypto rx=0x7f9450035000 tx=0x7f94500046c0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:52:32.308 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:32.307+0000 7f94657fa640 1 -- 172.21.15.150:0/2479855507 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f9468152410 con 0x7f9454004800 2024-09-17T05:52:32.506 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:32.504+0000 7f946e863640 1 -- 172.21.15.150:0/2479855507 --> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] -- mgr_command(tid 0: {"prefix": "fs volume ls", "target": ["mon-mgr", ""]}) -- 0x7f94681f9a80 con 0x7f944807a9f0 2024-09-17T05:52:32.507 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:32.507+0000 7f94657fa640 1 -- 172.21.15.150:0/2479855507 <== mgr.4108 v2:172.21.15.176:6800/3631216395 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+41 (secure 0 0 0) 0x7f94681f9a80 con 0x7f944807a9f0 2024-09-17T05:52:32.508 INFO:teuthology.orchestra.run.smithi150.stdout:[ 2024-09-17T05:52:32.508 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-09-17T05:52:32.508 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "cephfs" 2024-09-17T05:52:32.508 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-09-17T05:52:32.508 INFO:teuthology.orchestra.run.smithi150.stdout:] 2024-09-17T05:52:32.510 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:32.508+0000 7f946e863640 1 -- 172.21.15.150:0/2479855507 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f944807a9f0 msgr2=0x7f944807cf00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:52:32.510 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:32.508+0000 7f946e863640 1 --2- 172.21.15.150:0/2479855507 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f944807a9f0 0x7f944807cf00 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 crypto rx=0x7f9450035000 tx=0x7f94500046c0 comp rx=0 tx=0).stop 2024-09-17T05:52:32.511 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:32.508+0000 7f946e863640 1 -- 172.21.15.150:0/2479855507 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9454004800 msgr2=0x7f9468152fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:52:32.511 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:32.508+0000 7f946e863640 1 --2- 172.21.15.150:0/2479855507 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9454004800 0x7f9468152fe0 secure :-1 s=READY pgs=1712 cs=0 l=1 rev1=1 crypto rx=0x7f945800f6d0 tx=0x7f945800fb90 comp rx=0 tx=0).stop 2024-09-17T05:52:32.511 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:32.508+0000 7f946e863640 1 -- 172.21.15.150:0/2479855507 shutdown_connections 2024-09-17T05:52:32.511 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:32.508+0000 7f946e863640 1 --2- 172.21.15.150:0/2479855507 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f946809ef30 0x7f94681f5330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:52:32.511 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:32.508+0000 7f946e863640 1 --2- 172.21.15.150:0/2479855507 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f944807a9f0 0x7f944807cf00 unknown :-1 s=CLOSED pgs=725 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:52:32.511 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:32.508+0000 7f946e863640 1 --2- 172.21.15.150:0/2479855507 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f946815a9f0 0x7f946815ae00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:52:32.511 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:32.508+0000 7f946e863640 1 --2- 172.21.15.150:0/2479855507 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9454004800 0x7f9468152fe0 unknown :-1 s=CLOSED pgs=1712 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:52:32.511 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:32.508+0000 7f946e863640 1 -- 172.21.15.150:0/2479855507 >> 172.21.15.150:0/2479855507 conn(0x7f94680b6880 msgr2=0x7f94680cdb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:52:32.511 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:32.509+0000 7f946e863640 1 -- 172.21.15.150:0/2479855507 shutdown_connections 2024-09-17T05:52:32.511 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:32.509+0000 7f946e863640 1 -- 172.21.15.150:0/2479855507 wait complete. 2024-09-17T05:52:32.522 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-09-17T05:52:32.640 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:32.638+0000 7fa55036e640 1 -- 172.21.15.150:0/3818624660 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa5480b7960 msgr2=0x7fa5480af1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:52:32.640 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:32.638+0000 7fa55036e640 1 --2- 172.21.15.150:0/3818624660 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa5480b7960 0x7fa5480af1f0 secure :-1 s=READY pgs=1713 cs=0 l=1 rev1=1 crypto rx=0x7fa548074db0 tx=0x7fa54402a420 comp rx=0 tx=0).stop 2024-09-17T05:52:32.640 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:32.638+0000 7fa55036e640 1 -- 172.21.15.150:0/3818624660 shutdown_connections 2024-09-17T05:52:32.640 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:32.638+0000 7fa55036e640 1 --2- 172.21.15.150:0/3818624660 >> v2:172.21.15.176:3300/0 conn(0x7fa5480af730 0x7fa5480d0fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:52:32.641 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:32.638+0000 7fa55036e640 1 --2- 172.21.15.150:0/3818624660 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa5480b7d70 0x7fa5480d0a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:52:32.641 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:32.638+0000 7fa55036e640 1 --2- 172.21.15.150:0/3818624660 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa5480b7960 0x7fa5480af1f0 unknown :-1 s=CLOSED pgs=1713 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:52:32.641 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:32.638+0000 7fa55036e640 1 -- 172.21.15.150:0/3818624660 >> 172.21.15.150:0/3818624660 conn(0x7fa5480cef20 msgr2=0x7fa5480cf330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:52:32.641 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:32.638+0000 7fa55036e640 1 -- 172.21.15.150:0/3818624660 shutdown_connections 2024-09-17T05:52:32.641 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:32.638+0000 7fa55036e640 1 -- 172.21.15.150:0/3818624660 wait complete. 2024-09-17T05:52:32.641 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:32.640+0000 7fa55036e640 1 Processor -- start 2024-09-17T05:52:32.641 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:32.640+0000 7fa55036e640 1 -- start start 2024-09-17T05:52:32.644 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:32.641+0000 7fa55036e640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa5480af730 0x7fa54815f8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:52:32.644 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:32.641+0000 7fa55036e640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa5480b7960 0x7fa5481f3960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:52:32.644 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:32.641+0000 7fa55036e640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa5480b7d70 0x7fa548152510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:52:32.644 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:32.641+0000 7fa55036e640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7fa5480ceb90 con 0x7fa5480af730 2024-09-17T05:52:32.644 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:32.641+0000 7fa55036e640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fa5480b8310 con 0x7fa5480b7960 2024-09-17T05:52:32.645 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:32.641+0000 7fa55036e640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fa5480ced10 con 0x7fa5480b7d70 2024-09-17T05:52:32.645 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:32.641+0000 7fa54e10a640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa5480af730 0x7fa54815f8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:52:32.645 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:32.641+0000 7fa54e10a640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa5480af730 0x7fa54815f8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:37818/0 (socket says 172.21.15.150:37818) 2024-09-17T05:52:32.645 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:32.641+0000 7fa54e10a640 1 -- 172.21.15.150:0/3256351084 learned_addr learned my addr 172.21.15.150:0/3256351084 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:52:32.645 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:32.641+0000 7fa54e90b640 1 --2- 172.21.15.150:0/3256351084 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa5480b7d70 0x7fa548152510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:52:32.645 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:32.641+0000 7fa54d909640 1 --2- 172.21.15.150:0/3256351084 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa5480b7960 0x7fa5481f3960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:52:32.645 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:32.642+0000 7fa54e10a640 1 -- 172.21.15.150:0/3256351084 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa5480b7d70 msgr2=0x7fa548152510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:52:32.645 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:32.642+0000 7fa54e10a640 1 --2- 172.21.15.150:0/3256351084 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa5480b7d70 0x7fa548152510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:52:32.645 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:32.642+0000 7fa54e10a640 1 -- 172.21.15.150:0/3256351084 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa5480b7960 msgr2=0x7fa5481f3960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:52:32.645 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:32.642+0000 7fa54e10a640 1 --2- 172.21.15.150:0/3256351084 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa5480b7960 0x7fa5481f3960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:52:32.645 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:32.642+0000 7fa54e10a640 1 -- 172.21.15.150:0/3256351084 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa5481f46b0 con 0x7fa5480af730 2024-09-17T05:52:32.645 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:32.642+0000 7fa54e10a640 1 --2- 172.21.15.150:0/3256351084 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa5480af730 0x7fa54815f8e0 secure :-1 s=READY pgs=1714 cs=0 l=1 rev1=1 crypto rx=0x7fa5440099a0 tx=0x7fa544004ac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:52:32.645 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:32.642+0000 7fa53effd640 1 -- 172.21.15.150:0/3256351084 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa544031d60 con 0x7fa5480af730 2024-09-17T05:52:32.646 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:32.642+0000 7fa53effd640 1 -- 172.21.15.150:0/3256351084 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa544033070 con 0x7fa5480af730 2024-09-17T05:52:32.646 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:32.642+0000 7fa53effd640 1 -- 172.21.15.150:0/3256351084 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa544033480 con 0x7fa5480af730 2024-09-17T05:52:32.646 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:32.642+0000 7fa55036e640 1 -- 172.21.15.150:0/3256351084 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa548153f50 con 0x7fa5480af730 2024-09-17T05:52:32.646 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:32.642+0000 7fa55036e640 1 -- 172.21.15.150:0/3256351084 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa54815d970 con 0x7fa5480af730 2024-09-17T05:52:32.647 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:32.643+0000 7fa55036e640 1 -- 172.21.15.150:0/3256351084 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa54815dbd0 con 0x7fa5480af730 2024-09-17T05:52:32.647 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:32.644+0000 7fa53effd640 1 -- 172.21.15.150:0/3256351084 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 42) ==== 104195+0+0 (secure 0 0 0) 0x7fa544033620 con 0x7fa5480af730 2024-09-17T05:52:32.647 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:32.644+0000 7fa53effd640 1 --2- 172.21.15.150:0/3256351084 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fa52c07a9f0 0x7fa52c07cf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:52:32.647 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:32.644+0000 7fa53effd640 1 -- 172.21.15.150:0/3256351084 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(127..127 src has 1..127) ==== 5877+0+0 (secure 0 0 0) 0x7fa5440baf60 con 0x7fa5480af730 2024-09-17T05:52:32.647 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:32.644+0000 7fa54d909640 1 --2- 172.21.15.150:0/3256351084 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fa52c07a9f0 0x7fa52c07cf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:52:32.647 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:32.645+0000 7fa54d909640 1 --2- 172.21.15.150:0/3256351084 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fa52c07a9f0 0x7fa52c07cf00 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 crypto rx=0x7fa548157400 tx=0x7fa538005f60 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:52:32.650 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:32.649+0000 7fa53effd640 1 -- 172.21.15.150:0/3256351084 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fa54403f030 con 0x7fa5480af730 2024-09-17T05:52:32.826 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:32.825+0000 7fa55036e640 1 -- 172.21.15.150:0/3256351084 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) -- 0x7fa5480af1f0 con 0x7fa5480af730 2024-09-17T05:52:32.827 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:32.825+0000 7fa53effd640 1 -- 172.21.15.150:0/3256351084 <== mon.0 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v55)=0 v55) ==== 122+0+0 (secure 0 0 0) 0x7fa5440848e0 con 0x7fa5480af730 2024-09-17T05:52:32.829 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:32.827+0000 7fa55036e640 1 -- 172.21.15.150:0/3256351084 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fa52c07a9f0 msgr2=0x7fa52c07cf00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:52:32.830 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:32.827+0000 7fa55036e640 1 --2- 172.21.15.150:0/3256351084 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fa52c07a9f0 0x7fa52c07cf00 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 crypto rx=0x7fa548157400 tx=0x7fa538005f60 comp rx=0 tx=0).stop 2024-09-17T05:52:32.830 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:32.827+0000 7fa55036e640 1 -- 172.21.15.150:0/3256351084 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa5480af730 msgr2=0x7fa54815f8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:52:32.830 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:32.827+0000 7fa55036e640 1 --2- 172.21.15.150:0/3256351084 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa5480af730 0x7fa54815f8e0 secure :-1 s=READY pgs=1714 cs=0 l=1 rev1=1 crypto rx=0x7fa5440099a0 tx=0x7fa544004ac0 comp rx=0 tx=0).stop 2024-09-17T05:52:32.830 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:32.827+0000 7fa55036e640 1 -- 172.21.15.150:0/3256351084 shutdown_connections 2024-09-17T05:52:32.830 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:32.827+0000 7fa55036e640 1 --2- 172.21.15.150:0/3256351084 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa5480b7960 0x7fa5481f3960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:52:32.830 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:32.827+0000 7fa55036e640 1 --2- 172.21.15.150:0/3256351084 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fa52c07a9f0 0x7fa52c07cf00 unknown :-1 s=CLOSED pgs=726 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:52:32.830 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:32.827+0000 7fa55036e640 1 --2- 172.21.15.150:0/3256351084 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa5480b7d70 0x7fa548152510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:52:32.830 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:32.827+0000 7fa55036e640 1 --2- 172.21.15.150:0/3256351084 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa5480af730 0x7fa54815f8e0 unknown :-1 s=CLOSED pgs=1714 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:52:32.830 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:32.827+0000 7fa55036e640 1 -- 172.21.15.150:0/3256351084 >> 172.21.15.150:0/3256351084 conn(0x7fa5480cef20 msgr2=0x7fa5480b1c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:52:32.830 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:32.827+0000 7fa55036e640 1 -- 172.21.15.150:0/3256351084 shutdown_connections 2024-09-17T05:52:32.831 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:32.827+0000 7fa55036e640 1 -- 172.21.15.150:0/3256351084 wait complete. 2024-09-17T05:52:32.841 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config get mgr mgr/volumes/max_concurrent_clones 2024-09-17T05:52:32.957 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:32.955+0000 7faeae5f9640 1 -- 172.21.15.150:0/2002324210 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7faea80b7960 msgr2=0x7faea80af1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:52:32.957 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:32.955+0000 7faeae5f9640 1 --2- 172.21.15.150:0/2002324210 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7faea80b7960 0x7faea80af1f0 secure :-1 s=READY pgs=1716 cs=0 l=1 rev1=1 crypto rx=0x7faea80cfd70 tx=0x7fae9802a410 comp rx=0 tx=0).stop 2024-09-17T05:52:32.957 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:32.955+0000 7faeae5f9640 1 -- 172.21.15.150:0/2002324210 shutdown_connections 2024-09-17T05:52:32.958 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:32.955+0000 7faeae5f9640 1 --2- 172.21.15.150:0/2002324210 >> v2:172.21.15.176:3300/0 conn(0x7faea80b7d70 0x7faea80d0a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:52:32.958 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:32.955+0000 7faeae5f9640 1 --2- 172.21.15.150:0/2002324210 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7faea80b7960 0x7faea80af1f0 unknown :-1 s=CLOSED pgs=1716 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:52:32.958 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:32.955+0000 7faeae5f9640 1 -- 172.21.15.150:0/2002324210 >> 172.21.15.150:0/2002324210 conn(0x7faea80cef20 msgr2=0x7faea80cf330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:52:32.958 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:32.955+0000 7faeae5f9640 1 -- 172.21.15.150:0/2002324210 shutdown_connections 2024-09-17T05:52:32.958 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:32.955+0000 7faeae5f9640 1 -- 172.21.15.150:0/2002324210 wait complete. 2024-09-17T05:52:32.958 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:32.957+0000 7faeae5f9640 1 Processor -- start 2024-09-17T05:52:32.958 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:32.957+0000 7faeae5f9640 1 -- start start 2024-09-17T05:52:32.962 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:32.958+0000 7faeae5f9640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7faea80af730 0x7faea80cb6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:52:32.962 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:32.958+0000 7faeae5f9640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7faea80b7960 0x7faea81f3430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:52:32.962 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:32.958+0000 7faeae5f9640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7faea80b7d70 0x7faea80b6950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:52:32.962 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:32.958+0000 7faeae5f9640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7faea80ced10 con 0x7faea80b7d70 2024-09-17T05:52:32.962 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:32.958+0000 7faeae5f9640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7faea80ceb90 con 0x7faea80b7960 2024-09-17T05:52:32.962 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:32.958+0000 7faeae5f9640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7faea80d0fc0 con 0x7faea80af730 2024-09-17T05:52:32.962 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:32.958+0000 7faeacb96640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7faea80b7d70 0x7faea80b6950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:52:32.962 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:32.958+0000 7faeacb96640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7faea80b7d70 0x7faea80b6950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:37826/0 (socket says 172.21.15.150:37826) 2024-09-17T05:52:32.963 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:32.958+0000 7faeacb96640 1 -- 172.21.15.150:0/3273423990 learned_addr learned my addr 172.21.15.150:0/3273423990 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:52:32.963 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:32.959+0000 7faea77fe640 1 --2- 172.21.15.150:0/3273423990 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7faea80b7960 0x7faea81f3430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:52:32.963 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:32.959+0000 7faea7fff640 1 --2- 172.21.15.150:0/3273423990 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7faea80af730 0x7faea80cb6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:52:32.963 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:32.959+0000 7faeacb96640 1 -- 172.21.15.150:0/3273423990 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7faea80af730 msgr2=0x7faea80cb6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:52:32.963 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:32.959+0000 7faeacb96640 1 --2- 172.21.15.150:0/3273423990 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7faea80af730 0x7faea80cb6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:52:32.963 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:32.959+0000 7faeacb96640 1 -- 172.21.15.150:0/3273423990 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7faea80b7960 msgr2=0x7faea81f3430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:52:32.963 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:32.959+0000 7faeacb96640 1 --2- 172.21.15.150:0/3273423990 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7faea80b7960 0x7faea81f3430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:52:32.963 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:32.959+0000 7faeacb96640 1 -- 172.21.15.150:0/3273423990 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faea81f40b0 con 0x7faea80b7d70 2024-09-17T05:52:32.964 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:32.959+0000 7faea77fe640 1 --2- 172.21.15.150:0/3273423990 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7faea80b7960 0x7faea81f3430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:52:32.964 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:32.959+0000 7faea7fff640 1 --2- 172.21.15.150:0/3273423990 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7faea80af730 0x7faea80cb6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:52:32.964 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:32.959+0000 7faeacb96640 1 --2- 172.21.15.150:0/3273423990 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7faea80b7d70 0x7faea80b6950 secure :-1 s=READY pgs=1717 cs=0 l=1 rev1=1 crypto rx=0x7faea000c730 tx=0x7faea000cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:52:32.964 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:32.959+0000 7faea4ff9640 1 -- 172.21.15.150:0/3273423990 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faea0003b70 con 0x7faea80b7d70 2024-09-17T05:52:32.964 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:32.959+0000 7faea4ff9640 1 -- 172.21.15.150:0/3273423990 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7faea0003d30 con 0x7faea80b7d70 2024-09-17T05:52:32.964 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:32.959+0000 7faeae5f9640 1 -- 172.21.15.150:0/3273423990 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faea81f6ba0 con 0x7faea80b7d70 2024-09-17T05:52:32.964 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:32.959+0000 7faea4ff9640 1 -- 172.21.15.150:0/3273423990 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faea00052d0 con 0x7faea80b7d70 2024-09-17T05:52:32.964 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:32.959+0000 7faeae5f9640 1 -- 172.21.15.150:0/3273423990 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faea8145a90 con 0x7faea80b7d70 2024-09-17T05:52:32.965 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:32.960+0000 7faeae5f9640 1 -- 172.21.15.150:0/3273423990 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faea81f3e20 con 0x7faea80b7d70 2024-09-17T05:52:32.966 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:32.961+0000 7faea4ff9640 1 -- 172.21.15.150:0/3273423990 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 42) ==== 104195+0+0 (secure 0 0 0) 0x7faea0005680 con 0x7faea80b7d70 2024-09-17T05:52:32.966 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:32.961+0000 7faea4ff9640 1 --2- 172.21.15.150:0/3273423990 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fae9407a9f0 0x7fae9407cf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:52:32.966 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:32.962+0000 7faea4ff9640 1 -- 172.21.15.150:0/3273423990 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(127..127 src has 1..127) ==== 5877+0+0 (secure 0 0 0) 0x7faea0099c80 con 0x7faea80b7d70 2024-09-17T05:52:32.966 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:32.962+0000 7faea7fff640 1 --2- 172.21.15.150:0/3273423990 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fae9407a9f0 0x7fae9407cf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:52:32.966 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:32.962+0000 7faea7fff640 1 --2- 172.21.15.150:0/3273423990 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fae9407a9f0 0x7fae9407cf00 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 crypto rx=0x7fae98034000 tx=0x7fae98004730 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:52:32.968 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:32.966+0000 7faea4ff9640 1 -- 172.21.15.150:0/3273423990 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7faea0063bc0 con 0x7faea80b7d70 2024-09-17T05:52:33.143 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:33.141+0000 7faeae5f9640 1 -- 172.21.15.150:0/3273423990 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "config get", "who": "mgr", "key": "mgr/volumes/max_concurrent_clones"} v 0) -- 0x7faea80af1f0 con 0x7faea80b7d70 2024-09-17T05:52:33.143 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:33.141+0000 7faea4ff9640 1 -- 172.21.15.150:0/3273423990 <== mon.0 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "config get", "who": "mgr", "key": "mgr/volumes/max_concurrent_clones"}]=0 v55) ==== 116+0+2 (secure 0 0 0) 0x7faea00634c0 con 0x7faea80b7d70 2024-09-17T05:52:33.143 INFO:teuthology.orchestra.run.smithi150.stdout:4 2024-09-17T05:52:33.145 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:33.143+0000 7faeae5f9640 1 -- 172.21.15.150:0/3273423990 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fae9407a9f0 msgr2=0x7fae9407cf00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:52:33.145 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:33.143+0000 7faeae5f9640 1 --2- 172.21.15.150:0/3273423990 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fae9407a9f0 0x7fae9407cf00 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 crypto rx=0x7fae98034000 tx=0x7fae98004730 comp rx=0 tx=0).stop 2024-09-17T05:52:33.146 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:33.143+0000 7faeae5f9640 1 -- 172.21.15.150:0/3273423990 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7faea80b7d70 msgr2=0x7faea80b6950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:52:33.146 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:33.143+0000 7faeae5f9640 1 --2- 172.21.15.150:0/3273423990 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7faea80b7d70 0x7faea80b6950 secure :-1 s=READY pgs=1717 cs=0 l=1 rev1=1 crypto rx=0x7faea000c730 tx=0x7faea000cbf0 comp rx=0 tx=0).stop 2024-09-17T05:52:33.146 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:33.143+0000 7faeae5f9640 1 -- 172.21.15.150:0/3273423990 shutdown_connections 2024-09-17T05:52:33.146 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:33.143+0000 7faeae5f9640 1 --2- 172.21.15.150:0/3273423990 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7faea80b7960 0x7faea81f3430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:52:33.146 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:33.143+0000 7faeae5f9640 1 --2- 172.21.15.150:0/3273423990 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fae9407a9f0 0x7fae9407cf00 unknown :-1 s=CLOSED pgs=727 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:52:33.146 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:33.143+0000 7faeae5f9640 1 --2- 172.21.15.150:0/3273423990 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7faea80b7d70 0x7faea80b6950 unknown :-1 s=CLOSED pgs=1717 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:52:33.146 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:33.143+0000 7faeae5f9640 1 --2- 172.21.15.150:0/3273423990 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7faea80af730 0x7faea80cb6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:52:33.146 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:33.143+0000 7faeae5f9640 1 -- 172.21.15.150:0/3273423990 >> 172.21.15.150:0/3273423990 conn(0x7faea80cef20 msgr2=0x7faea80cc2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:52:33.146 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:33.144+0000 7faeae5f9640 1 -- 172.21.15.150:0/3273423990 shutdown_connections 2024-09-17T05:52:33.146 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:33.144+0000 7faeae5f9640 1 -- 172.21.15.150:0/3273423990 wait complete. 2024-09-17T05:52:33.157 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mgr mgr/volumes/max_concurrent_clones 4 2024-09-17T05:52:33.276 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:33.274+0000 7efe0d732640 1 -- 172.21.15.150:0/1441536978 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7efdf4004d40 msgr2=0x7efdf4005190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:52:33.276 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:33.274+0000 7efe0d732640 1 --2- 172.21.15.150:0/1441536978 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7efdf4004d40 0x7efdf4005190 secure :-1 s=READY pgs=1719 cs=0 l=1 rev1=1 crypto rx=0x7efe08074f00 tx=0x7efdf4005830 comp rx=0 tx=0).stop 2024-09-17T05:52:33.276 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:33.274+0000 7efe077fe640 1 -- 172.21.15.150:0/1441536978 reap_dead start 2024-09-17T05:52:33.276 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:33.274+0000 7efe0d732640 1 -- 172.21.15.150:0/1441536978 shutdown_connections 2024-09-17T05:52:33.276 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:33.274+0000 7efe0d732640 1 -- 172.21.15.150:0/1441536978 >> 172.21.15.150:0/1441536978 conn(0x7efe080b2e80 msgr2=0x7efe080b3290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:52:33.276 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:33.274+0000 7efe0d732640 1 -- 172.21.15.150:0/1441536978 shutdown_connections 2024-09-17T05:52:33.276 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:33.274+0000 7efe0d732640 1 -- 172.21.15.150:0/1441536978 wait complete. 2024-09-17T05:52:33.277 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:33.275+0000 7efe0d732640 1 Processor -- start 2024-09-17T05:52:33.277 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:33.276+0000 7efe0d732640 1 -- start start 2024-09-17T05:52:33.280 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:33.277+0000 7efe0d732640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7efdf4004d40 0x7efe0815d030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:52:33.281 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:33.277+0000 7efe0d732640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7efe080c9140 0x7efe080cafb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:52:33.281 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:33.277+0000 7efe0d732640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7efe080c9550 0x7efe080cb4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:52:33.281 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:33.277+0000 7efe0d732640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7efe080ae6f0 con 0x7efdf4004d40 2024-09-17T05:52:33.281 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:33.277+0000 7efe0d732640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7efe080ae570 con 0x7efe080c9550 2024-09-17T05:52:33.281 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:33.277+0000 7efe0d732640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7efe080cce90 con 0x7efe080c9140 2024-09-17T05:52:33.281 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:33.277+0000 7efe06ffd640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7efdf4004d40 0x7efe0815d030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:52:33.281 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:33.277+0000 7efe06ffd640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7efdf4004d40 0x7efe0815d030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:37846/0 (socket says 172.21.15.150:37846) 2024-09-17T05:52:33.281 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:33.277+0000 7efe06ffd640 1 -- 172.21.15.150:0/443528138 learned_addr learned my addr 172.21.15.150:0/443528138 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:52:33.281 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:33.277+0000 7efdfe7fc640 1 --2- 172.21.15.150:0/443528138 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7efe080c9140 0x7efe080cafb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:52:33.281 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:33.277+0000 7efe077fe640 1 --2- 172.21.15.150:0/443528138 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7efe080c9550 0x7efe080cb4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:52:33.281 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:33.277+0000 7efe06ffd640 1 -- 172.21.15.150:0/443528138 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7efe080c9140 msgr2=0x7efe080cafb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:52:33.282 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:33.277+0000 7efe06ffd640 1 --2- 172.21.15.150:0/443528138 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7efe080c9140 0x7efe080cafb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:52:33.282 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:33.277+0000 7efe06ffd640 1 -- 172.21.15.150:0/443528138 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7efe080c9550 msgr2=0x7efe080cb4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:52:33.282 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:33.277+0000 7efe06ffd640 1 --2- 172.21.15.150:0/443528138 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7efe080c9550 0x7efe080cb4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:52:33.282 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:33.277+0000 7efe06ffd640 1 -- 172.21.15.150:0/443528138 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efe081f8800 con 0x7efdf4004d40 2024-09-17T05:52:33.282 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:33.277+0000 7efdfe7fc640 1 --2- 172.21.15.150:0/443528138 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7efe080c9140 0x7efe080cafb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T05:52:33.282 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:33.277+0000 7efe077fe640 1 --2- 172.21.15.150:0/443528138 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7efe080c9550 0x7efe080cb4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T05:52:33.282 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:33.278+0000 7efe06ffd640 1 --2- 172.21.15.150:0/443528138 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7efdf4004d40 0x7efe0815d030 secure :-1 s=READY pgs=1720 cs=0 l=1 rev1=1 crypto rx=0x7efdf800fa00 tx=0x7efdf800fec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:52:33.282 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:33.278+0000 7efdfffff640 1 -- 172.21.15.150:0/443528138 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efdf800dd90 con 0x7efdf4004d40 2024-09-17T05:52:33.282 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:33.278+0000 7efdfffff640 1 -- 172.21.15.150:0/443528138 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7efdf8011440 con 0x7efdf4004d40 2024-09-17T05:52:33.282 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:33.278+0000 7efe0d732640 1 -- 172.21.15.150:0/443528138 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efe081f8ae0 con 0x7efdf4004d40 2024-09-17T05:52:33.282 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:33.278+0000 7efdfffff640 1 -- 172.21.15.150:0/443528138 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efdf80117f0 con 0x7efdf4004d40 2024-09-17T05:52:33.283 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:33.278+0000 7efe0d732640 1 -- 172.21.15.150:0/443528138 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efe081f90a0 con 0x7efdf4004d40 2024-09-17T05:52:33.283 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:33.279+0000 7efe0d732640 1 -- 172.21.15.150:0/443528138 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efe0806d7b0 con 0x7efdf4004d40 2024-09-17T05:52:33.283 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:33.280+0000 7efdfffff640 1 -- 172.21.15.150:0/443528138 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 42) ==== 104195+0+0 (secure 0 0 0) 0x7efdf8019020 con 0x7efdf4004d40 2024-09-17T05:52:33.284 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:33.280+0000 7efdfffff640 1 --2- 172.21.15.150:0/443528138 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7efde807a9f0 0x7efde807cf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:52:33.284 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:33.280+0000 7efdfffff640 1 -- 172.21.15.150:0/443528138 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(127..127 src has 1..127) ==== 5877+0+0 (secure 0 0 0) 0x7efdf809a830 con 0x7efdf4004d40 2024-09-17T05:52:33.284 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:33.281+0000 7efdfe7fc640 1 --2- 172.21.15.150:0/443528138 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7efde807a9f0 0x7efde807cf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:52:33.284 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:33.281+0000 7efdfe7fc640 1 --2- 172.21.15.150:0/443528138 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7efde807a9f0 0x7efde807cf00 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 crypto rx=0x7efe080ce460 tx=0x7efdf0005f90 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:52:33.286 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:33.285+0000 7efdfffff640 1 -- 172.21.15.150:0/443528138 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7efdf8064800 con 0x7efdf4004d40 2024-09-17T05:52:33.461 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:33.460+0000 7efe0d732640 1 -- 172.21.15.150:0/443528138 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command([{prefix=config set, name=mgr/volumes/max_concurrent_clones}] v 0) -- 0x7efe08070e70 con 0x7efdf4004d40 2024-09-17T05:52:33.467 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:33.466+0000 7efdfffff640 1 -- 172.21.15.150:0/443528138 <== mon.0 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/volumes/max_concurrent_clones}]=0 v56)=0 v56) ==== 131+0+0 (secure 0 0 0) 0x7efdf8064100 con 0x7efdf4004d40 2024-09-17T05:52:33.470 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:33.468+0000 7efe0d732640 1 -- 172.21.15.150:0/443528138 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7efde807a9f0 msgr2=0x7efde807cf00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:52:33.470 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:33.468+0000 7efe0d732640 1 --2- 172.21.15.150:0/443528138 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7efde807a9f0 0x7efde807cf00 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 crypto rx=0x7efe080ce460 tx=0x7efdf0005f90 comp rx=0 tx=0).stop 2024-09-17T05:52:33.470 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:33.468+0000 7efe0d732640 1 -- 172.21.15.150:0/443528138 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7efdf4004d40 msgr2=0x7efe0815d030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:52:33.470 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:33.468+0000 7efe0d732640 1 --2- 172.21.15.150:0/443528138 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7efdf4004d40 0x7efe0815d030 secure :-1 s=READY pgs=1720 cs=0 l=1 rev1=1 crypto rx=0x7efdf800fa00 tx=0x7efdf800fec0 comp rx=0 tx=0).stop 2024-09-17T05:52:33.470 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:33.468+0000 7efe0d732640 1 -- 172.21.15.150:0/443528138 shutdown_connections 2024-09-17T05:52:33.470 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:33.468+0000 7efe0d732640 1 --2- 172.21.15.150:0/443528138 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7efe080c9550 0x7efe080cb4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:52:33.471 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:33.468+0000 7efe0d732640 1 --2- 172.21.15.150:0/443528138 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7efde807a9f0 0x7efde807cf00 unknown :-1 s=CLOSED pgs=728 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:52:33.471 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:33.468+0000 7efe0d732640 1 --2- 172.21.15.150:0/443528138 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7efe080c9140 0x7efe080cafb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:52:33.471 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:33.468+0000 7efe0d732640 1 --2- 172.21.15.150:0/443528138 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7efdf4004d40 0x7efe0815d030 unknown :-1 s=CLOSED pgs=1720 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:52:33.471 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:33.468+0000 7efe0d732640 1 -- 172.21.15.150:0/443528138 >> 172.21.15.150:0/443528138 conn(0x7efe080b2e80 msgr2=0x7efe080b6640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:52:33.471 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:33.468+0000 7efe0d732640 1 -- 172.21.15.150:0/443528138 shutdown_connections 2024-09-17T05:52:33.471 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:33.468+0000 7efe0d732640 1 -- 172.21.15.150:0/443528138 wait complete. 2024-09-17T05:52:33.482 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume create cephfs sv1 --mode=777 2024-09-17T05:52:33.491 INFO:tasks.ceph.mgr.x.smithi176.stderr:2024-09-17T05:52:33.490+0000 7f33d971e640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-17T05:52:33.491 INFO:tasks.ceph.mgr.x.smithi176.stderr:2024-09-17T05:52:33.490+0000 7f33d971e640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-17T05:52:33.491 INFO:tasks.ceph.mgr.x.smithi176.stderr:2024-09-17T05:52:33.490+0000 7f33d971e640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-17T05:52:33.492 INFO:tasks.ceph.mgr.x.smithi176.stderr:2024-09-17T05:52:33.490+0000 7f33d971e640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-17T05:52:33.492 INFO:tasks.ceph.mgr.x.smithi176.stderr:2024-09-17T05:52:33.490+0000 7f33d971e640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-17T05:52:33.600 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:33.598+0000 7fd15ff2b640 1 -- 172.21.15.150:0/1605072393 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd144005350 msgr2=0x7fd14400b9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:52:33.601 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:33.598+0000 7fd15ff2b640 1 --2- 172.21.15.150:0/1605072393 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd144005350 0x7fd14400b9e0 secure :-1 s=READY pgs=1722 cs=0 l=1 rev1=1 crypto rx=0x7fd150001d90 tx=0x7fd144005830 comp rx=0 tx=0).stop 2024-09-17T05:52:33.601 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:33.598+0000 7fd15ff2b640 1 -- 172.21.15.150:0/1605072393 shutdown_connections 2024-09-17T05:52:33.601 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:33.598+0000 7fd15ff2b640 1 --2- 172.21.15.150:0/1605072393 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd144005350 0x7fd14400b9e0 unknown :-1 s=CLOSED pgs=1722 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:52:33.601 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:33.598+0000 7fd15ff2b640 1 -- 172.21.15.150:0/1605072393 >> 172.21.15.150:0/1605072393 conn(0x7fd1580cee80 msgr2=0x7fd1580cf290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:52:33.601 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:33.598+0000 7fd15ff2b640 1 -- 172.21.15.150:0/1605072393 shutdown_connections 2024-09-17T05:52:33.601 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:33.598+0000 7fd15ff2b640 1 -- 172.21.15.150:0/1605072393 wait complete. 2024-09-17T05:52:33.602 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:33.600+0000 7fd15ff2b640 1 Processor -- start 2024-09-17T05:52:33.602 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:33.600+0000 7fd15ff2b640 1 -- start start 2024-09-17T05:52:33.605 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:33.601+0000 7fd15ff2b640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd144005350 0x7fd158148900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:52:33.605 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:33.601+0000 7fd15ff2b640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd15815f6b0 0x7fd15815fac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:52:33.605 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:33.601+0000 7fd15ff2b640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd1580cb070 0x7fd1580cb480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:52:33.605 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:33.601+0000 7fd15ff2b640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7fd15809bc70 con 0x7fd1580cb070 2024-09-17T05:52:33.605 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:33.601+0000 7fd15ff2b640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fd15809baf0 con 0x7fd144005350 2024-09-17T05:52:33.605 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:33.601+0000 7fd15ff2b640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fd1580d05c0 con 0x7fd15815f6b0 2024-09-17T05:52:33.605 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:33.602+0000 7fd15e4c8640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd1580cb070 0x7fd1580cb480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:52:33.606 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:33.602+0000 7fd15e4c8640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd1580cb070 0x7fd1580cb480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:37854/0 (socket says 172.21.15.150:37854) 2024-09-17T05:52:33.606 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:33.602+0000 7fd15e4c8640 1 -- 172.21.15.150:0/2368813576 learned_addr learned my addr 172.21.15.150:0/2368813576 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:52:33.606 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:33.602+0000 7fd15d4c6640 1 --2- 172.21.15.150:0/2368813576 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd15815f6b0 0x7fd15815fac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:52:33.606 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:33.602+0000 7fd15dcc7640 1 --2- 172.21.15.150:0/2368813576 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd144005350 0x7fd158148900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:52:33.606 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:33.602+0000 7fd15e4c8640 1 -- 172.21.15.150:0/2368813576 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd15815f6b0 msgr2=0x7fd15815fac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:52:33.606 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:33.602+0000 7fd15e4c8640 1 --2- 172.21.15.150:0/2368813576 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd15815f6b0 0x7fd15815fac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:52:33.606 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:33.602+0000 7fd15e4c8640 1 -- 172.21.15.150:0/2368813576 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd144005350 msgr2=0x7fd158148900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:52:33.606 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:33.602+0000 7fd15e4c8640 1 --2- 172.21.15.150:0/2368813576 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd144005350 0x7fd158148900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:52:33.606 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:33.602+0000 7fd15e4c8640 1 -- 172.21.15.150:0/2368813576 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd158160000 con 0x7fd1580cb070 2024-09-17T05:52:33.606 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:33.602+0000 7fd15e4c8640 1 --2- 172.21.15.150:0/2368813576 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd1580cb070 0x7fd1580cb480 secure :-1 s=READY pgs=1723 cs=0 l=1 rev1=1 crypto rx=0x7fd150001370 tx=0x7fd150006cc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:52:33.606 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:33.602+0000 7fd14e7fc640 1 -- 172.21.15.150:0/2368813576 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd150003d80 con 0x7fd1580cb070 2024-09-17T05:52:33.607 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:33.602+0000 7fd14e7fc640 1 -- 172.21.15.150:0/2368813576 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd150005b00 con 0x7fd1580cb070 2024-09-17T05:52:33.607 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:33.602+0000 7fd14e7fc640 1 -- 172.21.15.150:0/2368813576 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd150005f50 con 0x7fd1580cb070 2024-09-17T05:52:33.607 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:33.602+0000 7fd15ff2b640 1 -- 172.21.15.150:0/2368813576 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd1580ca2b0 con 0x7fd1580cb070 2024-09-17T05:52:33.607 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:33.602+0000 7fd15ff2b640 1 -- 172.21.15.150:0/2368813576 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd1580ca870 con 0x7fd1580cb070 2024-09-17T05:52:33.607 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:33.603+0000 7fd15ff2b640 1 -- 172.21.15.150:0/2368813576 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd1580d0ee0 con 0x7fd1580cb070 2024-09-17T05:52:33.608 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:33.604+0000 7fd14e7fc640 1 -- 172.21.15.150:0/2368813576 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 42) ==== 104195+0+0 (secure 0 0 0) 0x7fd1500060f0 con 0x7fd1580cb070 2024-09-17T05:52:33.608 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:33.605+0000 7fd14e7fc640 1 --2- 172.21.15.150:0/2368813576 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fd13c07a9f0 0x7fd13c07cf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:52:33.608 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:33.605+0000 7fd14e7fc640 1 -- 172.21.15.150:0/2368813576 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(127..127 src has 1..127) ==== 5877+0+0 (secure 0 0 0) 0x7fd1500b98b0 con 0x7fd1580cb070 2024-09-17T05:52:33.608 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:33.605+0000 7fd15dcc7640 1 --2- 172.21.15.150:0/2368813576 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fd13c07a9f0 0x7fd13c07cf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:52:33.608 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:33.605+0000 7fd15dcc7640 1 --2- 172.21.15.150:0/2368813576 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fd13c07a9f0 0x7fd13c07cf00 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x7fd154005720 tx=0x7fd154005f90 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:52:33.611 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:33.609+0000 7fd14e7fc640 1 -- 172.21.15.150:0/2368813576 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fd158160000 con 0x7fd1580cb070 2024-09-17T05:52:33.813 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:33.811+0000 7fd15ff2b640 1 -- 172.21.15.150:0/2368813576 --> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] -- mgr_command(tid 0: {"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv1", "mode": "777", "target": ["mon-mgr", ""]}) -- 0x7fd1580ca060 con 0x7fd13c07a9f0 2024-09-17T05:52:33.822 INFO:tasks.ceph.mgr.x.smithi176.stderr:2024-09-17T05:52:33.820+0000 7f33d771a640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-17T05:52:33.822 INFO:tasks.ceph.mgr.x.smithi176.stderr:2024-09-17T05:52:33.820+0000 7f33d771a640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-17T05:52:33.822 INFO:tasks.ceph.mgr.x.smithi176.stderr:2024-09-17T05:52:33.820+0000 7f33d771a640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-17T05:52:33.822 INFO:tasks.ceph.mgr.x.smithi176.stderr:2024-09-17T05:52:33.820+0000 7f33d771a640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-17T05:52:33.822 INFO:tasks.ceph.mgr.x.smithi176.stderr:2024-09-17T05:52:33.820+0000 7f33d771a640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-17T05:52:33.855 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:33.853+0000 7fd14e7fc640 1 -- 172.21.15.150:0/2368813576 <== mgr.4108 v2:172.21.15.176:6800/3631216395 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7fd1580ca060 con 0x7fd13c07a9f0 2024-09-17T05:52:33.858 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:33.856+0000 7fd15ff2b640 1 -- 172.21.15.150:0/2368813576 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fd13c07a9f0 msgr2=0x7fd13c07cf00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:52:33.858 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:33.856+0000 7fd15ff2b640 1 --2- 172.21.15.150:0/2368813576 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fd13c07a9f0 0x7fd13c07cf00 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x7fd154005720 tx=0x7fd154005f90 comp rx=0 tx=0).stop 2024-09-17T05:52:33.858 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:33.856+0000 7fd15ff2b640 1 -- 172.21.15.150:0/2368813576 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd1580cb070 msgr2=0x7fd1580cb480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:52:33.858 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:33.856+0000 7fd15ff2b640 1 --2- 172.21.15.150:0/2368813576 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd1580cb070 0x7fd1580cb480 secure :-1 s=READY pgs=1723 cs=0 l=1 rev1=1 crypto rx=0x7fd150001370 tx=0x7fd150006cc0 comp rx=0 tx=0).stop 2024-09-17T05:52:33.858 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:33.856+0000 7fd15ff2b640 1 -- 172.21.15.150:0/2368813576 shutdown_connections 2024-09-17T05:52:33.858 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:33.856+0000 7fd15ff2b640 1 --2- 172.21.15.150:0/2368813576 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fd13c07a9f0 0x7fd13c07cf00 unknown :-1 s=CLOSED pgs=729 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:52:33.858 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:33.856+0000 7fd15ff2b640 1 --2- 172.21.15.150:0/2368813576 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd1580cb070 0x7fd1580cb480 unknown :-1 s=CLOSED pgs=1723 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:52:33.858 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:33.856+0000 7fd15ff2b640 1 --2- 172.21.15.150:0/2368813576 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd15815f6b0 0x7fd15815fac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:52:33.859 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:33.856+0000 7fd15ff2b640 1 --2- 172.21.15.150:0/2368813576 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd144005350 0x7fd158148900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:52:33.859 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:33.856+0000 7fd15ff2b640 1 -- 172.21.15.150:0/2368813576 >> 172.21.15.150:0/2368813576 conn(0x7fd1580cee80 msgr2=0x7fd1580b3650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:52:33.859 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:33.856+0000 7fd15ff2b640 1 -- 172.21.15.150:0/2368813576 shutdown_connections 2024-09-17T05:52:33.859 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:33.856+0000 7fd15ff2b640 1 -- 172.21.15.150:0/2368813576 wait complete. 2024-09-17T05:52:33.869 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume getpath cephfs sv1 2024-09-17T05:52:33.985 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:33.983+0000 7fb0f8f2b640 1 -- 172.21.15.150:0/2105751276 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb0f40d1190 msgr2=0x7fb0f40cd0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:52:33.986 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:33.983+0000 7fb0f8f2b640 1 --2- 172.21.15.150:0/2105751276 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb0f40d1190 0x7fb0f40cd0e0 secure :-1 s=READY pgs=1725 cs=0 l=1 rev1=1 crypto rx=0x7fb0ec005fd0 tx=0x7fb0ec02a8d0 comp rx=0 tx=0).stop 2024-09-17T05:52:33.986 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:33.983+0000 7fb0f8f2b640 1 -- 172.21.15.150:0/2105751276 shutdown_connections 2024-09-17T05:52:33.986 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:33.983+0000 7fb0f8f2b640 1 --2- 172.21.15.150:0/2105751276 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb0f40d1190 0x7fb0f40cd0e0 unknown :-1 s=CLOSED pgs=1725 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:52:33.986 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:33.983+0000 7fb0f8f2b640 1 --2- 172.21.15.150:0/2105751276 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb0f40b7960 0x7fb0f40af1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:52:33.986 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:33.983+0000 7fb0f8f2b640 1 -- 172.21.15.150:0/2105751276 >> 172.21.15.150:0/2105751276 conn(0x7fb0f40cef20 msgr2=0x7fb0f40cf330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:52:33.986 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:33.983+0000 7fb0f8f2b640 1 -- 172.21.15.150:0/2105751276 shutdown_connections 2024-09-17T05:52:33.986 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:33.983+0000 7fb0f8f2b640 1 -- 172.21.15.150:0/2105751276 wait complete. 2024-09-17T05:52:33.987 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:33.985+0000 7fb0f8f2b640 1 Processor -- start 2024-09-17T05:52:33.987 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:33.985+0000 7fb0f8f2b640 1 -- start start 2024-09-17T05:52:33.990 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:33.987+0000 7fb0f8f2b640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb0f40b7960 0x7fb0f415e690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:52:33.990 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:33.987+0000 7fb0f8f2b640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb0f40b7d70 0x7fb0f4156c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:52:33.990 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:33.987+0000 7fb0f8f2b640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb0f40d1190 0x7fb0f41535b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:52:33.990 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:33.987+0000 7fb0f8f2b640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7fb0f40ced10 con 0x7fb0f40d1190 2024-09-17T05:52:33.990 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:33.987+0000 7fb0f8f2b640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fb0f40ceb90 con 0x7fb0f40b7d70 2024-09-17T05:52:33.991 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:33.987+0000 7fb0f8f2b640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fb0f40af730 con 0x7fb0f40b7960 2024-09-17T05:52:33.991 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:33.987+0000 7fb0f2d9d640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb0f40d1190 0x7fb0f41535b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:52:33.991 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:33.987+0000 7fb0f2d9d640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb0f40d1190 0x7fb0f41535b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:37862/0 (socket says 172.21.15.150:37862) 2024-09-17T05:52:33.991 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:33.987+0000 7fb0f2d9d640 1 -- 172.21.15.150:0/3835637356 learned_addr learned my addr 172.21.15.150:0/3835637356 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:52:33.991 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:33.987+0000 7fb0e9d9b640 1 --2- 172.21.15.150:0/3835637356 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb0f40b7d70 0x7fb0f4156c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:52:33.991 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:33.987+0000 7fb0f259c640 1 --2- 172.21.15.150:0/3835637356 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb0f40b7960 0x7fb0f415e690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:52:33.991 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:33.987+0000 7fb0f2d9d640 1 -- 172.21.15.150:0/3835637356 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb0f40b7960 msgr2=0x7fb0f415e690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:52:33.991 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:33.987+0000 7fb0f2d9d640 1 --2- 172.21.15.150:0/3835637356 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb0f40b7960 0x7fb0f415e690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:52:33.991 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:33.987+0000 7fb0f2d9d640 1 -- 172.21.15.150:0/3835637356 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb0f40b7d70 msgr2=0x7fb0f4156c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:52:33.991 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:33.987+0000 7fb0f2d9d640 1 --2- 172.21.15.150:0/3835637356 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb0f40b7d70 0x7fb0f4156c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:52:33.991 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:33.987+0000 7fb0f2d9d640 1 -- 172.21.15.150:0/3835637356 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb0f415ebd0 con 0x7fb0f40d1190 2024-09-17T05:52:33.991 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:33.987+0000 7fb0f2d9d640 1 --2- 172.21.15.150:0/3835637356 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb0f40d1190 0x7fb0f41535b0 secure :-1 s=READY pgs=1726 cs=0 l=1 rev1=1 crypto rx=0x7fb0ec033040 tx=0x7fb0ec003ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:52:33.992 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:33.987+0000 7fb0eb7fe640 1 -- 172.21.15.150:0/3835637356 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb0ec004040 con 0x7fb0f40d1190 2024-09-17T05:52:33.992 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:33.987+0000 7fb0eb7fe640 1 -- 172.21.15.150:0/3835637356 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb0ec0041e0 con 0x7fb0f40d1190 2024-09-17T05:52:33.992 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:33.987+0000 7fb0eb7fe640 1 -- 172.21.15.150:0/3835637356 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb0ec0045d0 con 0x7fb0f40d1190 2024-09-17T05:52:33.992 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:33.987+0000 7fb0f8f2b640 1 -- 172.21.15.150:0/3835637356 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb0f415ff40 con 0x7fb0f40d1190 2024-09-17T05:52:33.992 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:33.988+0000 7fb0f8f2b640 1 -- 172.21.15.150:0/3835637356 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb0f415f180 con 0x7fb0f40d1190 2024-09-17T05:52:33.992 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:33.988+0000 7fb0f8f2b640 1 -- 172.21.15.150:0/3835637356 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb0f40af1f0 con 0x7fb0f40d1190 2024-09-17T05:52:33.993 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:33.989+0000 7fb0eb7fe640 1 -- 172.21.15.150:0/3835637356 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 42) ==== 104195+0+0 (secure 0 0 0) 0x7fb0ec031460 con 0x7fb0f40d1190 2024-09-17T05:52:33.993 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:33.990+0000 7fb0eb7fe640 1 --2- 172.21.15.150:0/3835637356 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fb0d407a9f0 0x7fb0d407cf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:52:33.993 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:33.990+0000 7fb0eb7fe640 1 -- 172.21.15.150:0/3835637356 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(127..127 src has 1..127) ==== 5877+0+0 (secure 0 0 0) 0x7fb0ec0bb670 con 0x7fb0f40d1190 2024-09-17T05:52:33.993 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:33.990+0000 7fb0f259c640 1 --2- 172.21.15.150:0/3835637356 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fb0d407a9f0 0x7fb0d407cf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:52:33.993 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:33.991+0000 7fb0f259c640 1 --2- 172.21.15.150:0/3835637356 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fb0d407a9f0 0x7fb0d407cf00 secure :-1 s=READY pgs=730 cs=0 l=1 rev1=1 crypto rx=0x7fb0f40d2470 tx=0x7fb0e4005f90 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:52:33.996 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:33.994+0000 7fb0eb7fe640 1 -- 172.21.15.150:0/3835637356 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fb0ec084f60 con 0x7fb0f40d1190 2024-09-17T05:52:34.198 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:34.196+0000 7fb0f8f2b640 1 -- 172.21.15.150:0/3835637356 --> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "sub_name": "sv1", "target": ["mon-mgr", ""]}) -- 0x7fb0f4072cd0 con 0x7fb0d407a9f0 2024-09-17T05:52:34.204 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:34.204+0000 7fb0eb7fe640 1 -- 172.21.15.150:0/3835637356 <== mgr.4108 v2:172.21.15.176:6800/3631216395 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+59 (secure 0 0 0) 0x7fb0f4072cd0 con 0x7fb0d407a9f0 2024-09-17T05:52:34.205 INFO:teuthology.orchestra.run.smithi150.stdout:/volumes/_nogroup/sv1/1bc3ddb5-d4ca-4f40-9c35-676acc146be9 2024-09-17T05:52:34.207 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:34.205+0000 7fb0f8f2b640 1 -- 172.21.15.150:0/3835637356 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fb0d407a9f0 msgr2=0x7fb0d407cf00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:52:34.207 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:34.205+0000 7fb0f8f2b640 1 --2- 172.21.15.150:0/3835637356 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fb0d407a9f0 0x7fb0d407cf00 secure :-1 s=READY pgs=730 cs=0 l=1 rev1=1 crypto rx=0x7fb0f40d2470 tx=0x7fb0e4005f90 comp rx=0 tx=0).stop 2024-09-17T05:52:34.208 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:34.205+0000 7fb0f8f2b640 1 -- 172.21.15.150:0/3835637356 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb0f40d1190 msgr2=0x7fb0f41535b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:52:34.208 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:34.205+0000 7fb0f8f2b640 1 --2- 172.21.15.150:0/3835637356 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb0f40d1190 0x7fb0f41535b0 secure :-1 s=READY pgs=1726 cs=0 l=1 rev1=1 crypto rx=0x7fb0ec033040 tx=0x7fb0ec003ba0 comp rx=0 tx=0).stop 2024-09-17T05:52:34.208 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:34.205+0000 7fb0f8f2b640 1 -- 172.21.15.150:0/3835637356 shutdown_connections 2024-09-17T05:52:34.208 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:34.205+0000 7fb0f8f2b640 1 --2- 172.21.15.150:0/3835637356 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb0f40b7d70 0x7fb0f4156c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:52:34.208 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:34.205+0000 7fb0f8f2b640 1 --2- 172.21.15.150:0/3835637356 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fb0d407a9f0 0x7fb0d407cf00 unknown :-1 s=CLOSED pgs=730 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:52:34.208 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:34.205+0000 7fb0f8f2b640 1 --2- 172.21.15.150:0/3835637356 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb0f40d1190 0x7fb0f41535b0 unknown :-1 s=CLOSED pgs=1726 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:52:34.208 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:34.205+0000 7fb0f8f2b640 1 --2- 172.21.15.150:0/3835637356 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb0f40b7960 0x7fb0f415e690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:52:34.208 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:34.205+0000 7fb0f8f2b640 1 -- 172.21.15.150:0/3835637356 >> 172.21.15.150:0/3835637356 conn(0x7fb0f40cef20 msgr2=0x7fb0f40ce280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:52:34.208 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:34.205+0000 7fb0f8f2b640 1 -- 172.21.15.150:0/3835637356 shutdown_connections 2024-09-17T05:52:34.208 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:34.205+0000 7fb0f8f2b640 1 -- 172.21.15.150:0/3835637356 wait complete. 2024-09-17T05:52:34.218 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume getpath cephfs sv1 2024-09-17T05:52:34.335 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:34.333+0000 7f21e644d640 1 -- 172.21.15.150:0/68180622 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f21e0070a10 msgr2=0x7f21e00b4070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:52:34.335 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:34.333+0000 7f21e644d640 1 --2- 172.21.15.150:0/68180622 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f21e0070a10 0x7f21e00b4070 secure :-1 s=READY pgs=1728 cs=0 l=1 rev1=1 crypto rx=0x7f21d8005fd0 tx=0x7f21d802a940 comp rx=0 tx=0).stop 2024-09-17T05:52:34.336 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:34.333+0000 7f21e644d640 1 -- 172.21.15.150:0/68180622 shutdown_connections 2024-09-17T05:52:34.336 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:34.333+0000 7f21e644d640 1 --2- 172.21.15.150:0/68180622 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f21e0070a10 0x7f21e00b4070 unknown :-1 s=CLOSED pgs=1728 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:52:34.336 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:34.333+0000 7f21e644d640 1 -- 172.21.15.150:0/68180622 >> 172.21.15.150:0/68180622 conn(0x7f21e006d1c0 msgr2=0x7f21e006d5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:52:34.336 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:34.333+0000 7f21e644d640 1 -- 172.21.15.150:0/68180622 shutdown_connections 2024-09-17T05:52:34.336 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:34.333+0000 7f21e644d640 1 -- 172.21.15.150:0/68180622 wait complete. 2024-09-17T05:52:34.337 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:34.335+0000 7f21e644d640 1 Processor -- start 2024-09-17T05:52:34.337 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:34.335+0000 7f21e644d640 1 -- start start 2024-09-17T05:52:34.340 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:34.337+0000 7f21e644d640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f21e0070600 0x7f21e0141880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:52:34.340 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:34.337+0000 7f21e644d640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f21e0070a10 0x7f21e0148760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:52:34.340 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:34.337+0000 7f21e644d640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f21e014ef00 0x7f21e0148ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:52:34.340 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:34.337+0000 7f21e644d640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f21e0073c30 con 0x7f21e014ef00 2024-09-17T05:52:34.340 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:34.337+0000 7f21e644d640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f21e0073ab0 con 0x7f21e0070600 2024-09-17T05:52:34.340 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:34.337+0000 7f21e644d640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f21e00cf350 con 0x7f21e0070a10 2024-09-17T05:52:34.340 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:34.337+0000 7f21e49ea640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f21e014ef00 0x7f21e0148ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:52:34.340 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:34.337+0000 7f21e49ea640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f21e014ef00 0x7f21e0148ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:37882/0 (socket says 172.21.15.150:37882) 2024-09-17T05:52:34.340 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:34.337+0000 7f21e49ea640 1 -- 172.21.15.150:0/2786820786 learned_addr learned my addr 172.21.15.150:0/2786820786 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:52:34.340 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:34.337+0000 7f21dffff640 1 --2- 172.21.15.150:0/2786820786 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f21e0070600 0x7f21e0141880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:52:34.340 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:34.337+0000 7f21df7fe640 1 --2- 172.21.15.150:0/2786820786 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f21e0070a10 0x7f21e0148760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:52:34.341 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:34.337+0000 7f21e49ea640 1 -- 172.21.15.150:0/2786820786 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f21e0070a10 msgr2=0x7f21e0148760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:52:34.341 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:34.337+0000 7f21e49ea640 1 --2- 172.21.15.150:0/2786820786 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f21e0070a10 0x7f21e0148760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:52:34.341 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:34.337+0000 7f21e49ea640 1 -- 172.21.15.150:0/2786820786 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f21e0070600 msgr2=0x7f21e0141880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:52:34.341 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:34.337+0000 7f21e49ea640 1 --2- 172.21.15.150:0/2786820786 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f21e0070600 0x7f21e0141880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:52:34.341 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:34.337+0000 7f21e49ea640 1 -- 172.21.15.150:0/2786820786 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f21e0141dc0 con 0x7f21e014ef00 2024-09-17T05:52:34.341 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:34.337+0000 7f21e49ea640 1 --2- 172.21.15.150:0/2786820786 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f21e014ef00 0x7f21e0148ca0 secure :-1 s=READY pgs=1729 cs=0 l=1 rev1=1 crypto rx=0x7f21d802af30 tx=0x7f21d8031ea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:52:34.341 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:34.337+0000 7f21dcff9640 1 -- 172.21.15.150:0/2786820786 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21d803e070 con 0x7f21e014ef00 2024-09-17T05:52:34.341 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:34.337+0000 7f21dcff9640 1 -- 172.21.15.150:0/2786820786 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f21d8004560 con 0x7f21e014ef00 2024-09-17T05:52:34.341 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:34.337+0000 7f21e644d640 1 -- 172.21.15.150:0/2786820786 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f21e00b0990 con 0x7f21e014ef00 2024-09-17T05:52:34.341 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:34.337+0000 7f21dcff9640 1 -- 172.21.15.150:0/2786820786 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21d8043460 con 0x7f21e014ef00 2024-09-17T05:52:34.341 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:34.338+0000 7f21e644d640 1 -- 172.21.15.150:0/2786820786 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f21e00b0f50 con 0x7f21e014ef00 2024-09-17T05:52:34.342 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:34.338+0000 7f21e644d640 1 -- 172.21.15.150:0/2786820786 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f21e00cf800 con 0x7f21e014ef00 2024-09-17T05:52:34.343 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:34.339+0000 7f21dcff9640 1 -- 172.21.15.150:0/2786820786 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 42) ==== 104195+0+0 (secure 0 0 0) 0x7f21d803a440 con 0x7f21e014ef00 2024-09-17T05:52:34.343 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:34.340+0000 7f21dcff9640 1 --2- 172.21.15.150:0/2786820786 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f21c007aa20 0x7f21c007cf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:52:34.343 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:34.340+0000 7f21dcff9640 1 -- 172.21.15.150:0/2786820786 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(127..127 src has 1..127) ==== 5877+0+0 (secure 0 0 0) 0x7f21d80bb7d0 con 0x7f21e014ef00 2024-09-17T05:52:34.343 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:34.340+0000 7f21dffff640 1 --2- 172.21.15.150:0/2786820786 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f21c007aa20 0x7f21c007cf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:52:34.343 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:34.341+0000 7f21dffff640 1 --2- 172.21.15.150:0/2786820786 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f21c007aa20 0x7f21c007cf30 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 crypto rx=0x7f21d00046b0 tx=0x7f21d0007e90 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:52:34.346 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:34.344+0000 7f21dcff9640 1 -- 172.21.15.150:0/2786820786 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f21d80850c0 con 0x7f21e014ef00 2024-09-17T05:52:34.548 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:34.546+0000 7f21e644d640 1 -- 172.21.15.150:0/2786820786 --> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "sub_name": "sv1", "target": ["mon-mgr", ""]}) -- 0x7f21e015d300 con 0x7f21c007aa20 2024-09-17T05:52:34.553 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:34.552+0000 7f21dcff9640 1 -- 172.21.15.150:0/2786820786 <== mgr.4108 v2:172.21.15.176:6800/3631216395 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+59 (secure 0 0 0) 0x7f21e015d300 con 0x7f21c007aa20 2024-09-17T05:52:34.553 INFO:teuthology.orchestra.run.smithi150.stdout:/volumes/_nogroup/sv1/1bc3ddb5-d4ca-4f40-9c35-676acc146be9 2024-09-17T05:52:34.556 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:34.554+0000 7f21e644d640 1 -- 172.21.15.150:0/2786820786 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f21c007aa20 msgr2=0x7f21c007cf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:52:34.556 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:34.554+0000 7f21e644d640 1 --2- 172.21.15.150:0/2786820786 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f21c007aa20 0x7f21c007cf30 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 crypto rx=0x7f21d00046b0 tx=0x7f21d0007e90 comp rx=0 tx=0).stop 2024-09-17T05:52:34.556 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:34.554+0000 7f21e644d640 1 -- 172.21.15.150:0/2786820786 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f21e014ef00 msgr2=0x7f21e0148ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:52:34.557 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:34.554+0000 7f21e644d640 1 --2- 172.21.15.150:0/2786820786 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f21e014ef00 0x7f21e0148ca0 secure :-1 s=READY pgs=1729 cs=0 l=1 rev1=1 crypto rx=0x7f21d802af30 tx=0x7f21d8031ea0 comp rx=0 tx=0).stop 2024-09-17T05:52:34.557 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:34.554+0000 7f21e644d640 1 -- 172.21.15.150:0/2786820786 shutdown_connections 2024-09-17T05:52:34.557 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:34.554+0000 7f21e644d640 1 --2- 172.21.15.150:0/2786820786 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f21c007aa20 0x7f21c007cf30 unknown :-1 s=CLOSED pgs=731 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:52:34.557 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:34.554+0000 7f21e644d640 1 --2- 172.21.15.150:0/2786820786 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f21e014ef00 0x7f21e0148ca0 unknown :-1 s=CLOSED pgs=1729 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:52:34.557 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:34.554+0000 7f21e644d640 1 --2- 172.21.15.150:0/2786820786 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f21e0070a10 0x7f21e0148760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:52:34.557 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:34.554+0000 7f21e644d640 1 --2- 172.21.15.150:0/2786820786 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f21e0070600 0x7f21e0141880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:52:34.557 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:34.554+0000 7f21e644d640 1 -- 172.21.15.150:0/2786820786 >> 172.21.15.150:0/2786820786 conn(0x7f21e006d1c0 msgr2=0x7f21e0149560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:52:34.557 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:34.554+0000 7f21e644d640 1 -- 172.21.15.150:0/2786820786 shutdown_connections 2024-09-17T05:52:34.557 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:34.554+0000 7f21e644d640 1 -- 172.21.15.150:0/2786820786 wait complete. 2024-09-17T05:52:34.568 DEBUG:tasks.cephfs.test_volumes:filling subvolume sv1 with 3 files each 1024MB size under directory volumes/_nogroup/sv1/1bc3ddb5-d4ca-4f40-9c35-676acc146be9 2024-09-17T05:52:34.568 DEBUG:teuthology.orchestra.run.smithi150:> set -ex 2024-09-17T05:52:34.568 DEBUG:teuthology.orchestra.run.smithi150:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T05:52:34.584 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:52:34.584 DEBUG:teuthology.orchestra.run.smithi150:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/sv1/1bc3ddb5-d4ca-4f40-9c35-676acc146be9/subvolume_file.0 bs=1M conv=fdatasync count=1024 seek=0) 2024-09-17T05:52:38.354 INFO:teuthology.orchestra.run.smithi150.stderr:1024+0 records in 2024-09-17T05:52:38.354 INFO:teuthology.orchestra.run.smithi150.stderr:1024+0 records out 2024-09-17T05:52:38.354 INFO:teuthology.orchestra.run.smithi150.stderr:1073741824 bytes (1.1 GB, 1.0 GiB) copied, 3.70576 s, 290 MB/s 2024-09-17T05:52:38.355 DEBUG:teuthology.orchestra.run.smithi150:> set -ex 2024-09-17T05:52:38.355 DEBUG:teuthology.orchestra.run.smithi150:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T05:52:38.371 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:52:38.371 DEBUG:teuthology.orchestra.run.smithi150:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/sv1/1bc3ddb5-d4ca-4f40-9c35-676acc146be9/subvolume_file.1 bs=1M conv=fdatasync count=1024 seek=0) 2024-09-17T05:52:42.183 INFO:teuthology.orchestra.run.smithi150.stderr:1024+0 records in 2024-09-17T05:52:42.183 INFO:teuthology.orchestra.run.smithi150.stderr:1024+0 records out 2024-09-17T05:52:42.183 INFO:teuthology.orchestra.run.smithi150.stderr:1073741824 bytes (1.1 GB, 1.0 GiB) copied, 3.75508 s, 286 MB/s 2024-09-17T05:52:42.183 DEBUG:teuthology.orchestra.run.smithi150:> set -ex 2024-09-17T05:52:42.183 DEBUG:teuthology.orchestra.run.smithi150:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T05:52:42.199 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:52:42.200 DEBUG:teuthology.orchestra.run.smithi150:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/sv1/1bc3ddb5-d4ca-4f40-9c35-676acc146be9/subvolume_file.2 bs=1M conv=fdatasync count=1024 seek=0) 2024-09-17T05:52:45.977 INFO:teuthology.orchestra.run.smithi150.stderr:1024+0 records in 2024-09-17T05:52:45.978 INFO:teuthology.orchestra.run.smithi150.stderr:1024+0 records out 2024-09-17T05:52:45.978 INFO:teuthology.orchestra.run.smithi150.stderr:1073741824 bytes (1.1 GB, 1.0 GiB) copied, 3.72032 s, 289 MB/s 2024-09-17T05:52:45.978 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume snapshot create cephfs sv1 ss1 2024-09-17T05:52:46.096 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:46.095+0000 7ff427f57640 1 -- 172.21.15.150:0/3879077634 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff4200b4a00 msgr2=0x7ff4200afcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:52:46.097 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:46.095+0000 7ff427f57640 1 --2- 172.21.15.150:0/3879077634 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff4200b4a00 0x7ff4200afcb0 secure :-1 s=READY pgs=1730 cs=0 l=1 rev1=1 crypto rx=0x7ff420073850 tx=0x7ff41802a9a0 comp rx=0 tx=0).stop 2024-09-17T05:52:46.097 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:46.095+0000 7ff427f57640 1 -- 172.21.15.150:0/3879077634 shutdown_connections 2024-09-17T05:52:46.097 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:46.095+0000 7ff427f57640 1 --2- 172.21.15.150:0/3879077634 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff4200b4a00 0x7ff4200afcb0 unknown :-1 s=CLOSED pgs=1730 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:52:46.097 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:46.095+0000 7ff427f57640 1 --2- 172.21.15.150:0/3879077634 >> v2:172.21.15.176:3300/0 conn(0x7ff42015d190 0x7ff42015d5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:52:46.097 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:46.095+0000 7ff427f57640 1 -- 172.21.15.150:0/3879077634 >> 172.21.15.150:0/3879077634 conn(0x7ff42009aa50 msgr2=0x7ff4200b2ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:52:46.097 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:46.095+0000 7ff427f57640 1 -- 172.21.15.150:0/3879077634 shutdown_connections 2024-09-17T05:52:46.097 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:46.095+0000 7ff427f57640 1 -- 172.21.15.150:0/3879077634 wait complete. 2024-09-17T05:52:46.098 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:46.097+0000 7ff427f57640 1 Processor -- start 2024-09-17T05:52:46.098 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:46.097+0000 7ff427f57640 1 -- start start 2024-09-17T05:52:46.101 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:46.098+0000 7ff427f57640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff4200af8a0 0x7ff4201f6de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:52:46.101 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:46.098+0000 7ff427f57640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff4200b4a00 0x7ff4201f7320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:52:46.101 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:46.098+0000 7ff427f57640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff42015d190 0x7ff4201f7860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:52:46.101 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:46.098+0000 7ff427f57640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7ff4201659d0 con 0x7ff42015d190 2024-09-17T05:52:46.102 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:46.098+0000 7ff427f57640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7ff420165850 con 0x7ff4200af8a0 2024-09-17T05:52:46.102 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:46.098+0000 7ff427f57640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7ff420165b50 con 0x7ff4200b4a00 2024-09-17T05:52:46.102 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:46.098+0000 7ff4264f4640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff42015d190 0x7ff4201f7860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:52:46.102 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:46.098+0000 7ff4264f4640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff42015d190 0x7ff4201f7860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:46290/0 (socket says 172.21.15.150:46290) 2024-09-17T05:52:46.102 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:46.099+0000 7ff4264f4640 1 -- 172.21.15.150:0/410816224 learned_addr learned my addr 172.21.15.150:0/410816224 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:52:46.102 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:46.099+0000 7ff425cf3640 1 --2- 172.21.15.150:0/410816224 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff4200af8a0 0x7ff4201f6de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:52:46.102 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:46.099+0000 7ff4254f2640 1 --2- 172.21.15.150:0/410816224 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff4200b4a00 0x7ff4201f7320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:52:46.102 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:46.099+0000 7ff4264f4640 1 -- 172.21.15.150:0/410816224 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff4200b4a00 msgr2=0x7ff4201f7320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:52:46.102 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:46.099+0000 7ff4264f4640 1 --2- 172.21.15.150:0/410816224 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff4200b4a00 0x7ff4201f7320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:52:46.102 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:46.099+0000 7ff4264f4640 1 -- 172.21.15.150:0/410816224 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff4200af8a0 msgr2=0x7ff4201f6de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:52:46.102 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:46.099+0000 7ff4264f4640 1 --2- 172.21.15.150:0/410816224 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff4200af8a0 0x7ff4201f6de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:52:46.103 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:46.099+0000 7ff4264f4640 1 -- 172.21.15.150:0/410816224 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff42015ac90 con 0x7ff42015d190 2024-09-17T05:52:46.103 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:46.099+0000 7ff425cf3640 1 --2- 172.21.15.150:0/410816224 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff4200af8a0 0x7ff4201f6de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T05:52:46.103 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:46.099+0000 7ff4264f4640 1 --2- 172.21.15.150:0/410816224 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff42015d190 0x7ff4201f7860 secure :-1 s=READY pgs=1731 cs=0 l=1 rev1=1 crypto rx=0x7ff418009d60 tx=0x7ff418003ef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:52:46.103 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:46.099+0000 7ff4167fc640 1 -- 172.21.15.150:0/410816224 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff418033050 con 0x7ff42015d190 2024-09-17T05:52:46.103 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:46.099+0000 7ff4167fc640 1 -- 172.21.15.150:0/410816224 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff418004450 con 0x7ff42015d190 2024-09-17T05:52:46.103 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:46.099+0000 7ff427f57640 1 -- 172.21.15.150:0/410816224 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff42015af70 con 0x7ff42015d190 2024-09-17T05:52:46.103 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:46.099+0000 7ff4167fc640 1 -- 172.21.15.150:0/410816224 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff418004860 con 0x7ff42015d190 2024-09-17T05:52:46.103 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:46.099+0000 7ff427f57640 1 -- 172.21.15.150:0/410816224 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff42015b530 con 0x7ff42015d190 2024-09-17T05:52:46.103 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:46.100+0000 7ff427f57640 1 -- 172.21.15.150:0/410816224 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff4200afcb0 con 0x7ff42015d190 2024-09-17T05:52:46.104 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:46.101+0000 7ff4167fc640 1 -- 172.21.15.150:0/410816224 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 43) ==== 104297+0+0 (secure 0 0 0) 0x7ff418036070 con 0x7ff42015d190 2024-09-17T05:52:46.104 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:46.102+0000 7ff4167fc640 1 --2- 172.21.15.150:0/410816224 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7ff40407ab40 0x7ff40407d050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:52:46.104 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:46.102+0000 7ff4167fc640 1 -- 172.21.15.150:0/410816224 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(129..129 src has 1..129) ==== 5935+0+0 (secure 0 0 0) 0x7ff4180badf0 con 0x7ff42015d190 2024-09-17T05:52:46.104 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:46.102+0000 7ff425cf3640 1 --2- 172.21.15.150:0/410816224 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7ff40407ab40 0x7ff40407d050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:52:46.105 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:46.102+0000 7ff425cf3640 1 --2- 172.21.15.150:0/410816224 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7ff40407ab40 0x7ff40407d050 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 crypto rx=0x7ff41c009f20 tx=0x7ff41c005f90 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:52:46.106 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:46.106+0000 7ff4167fc640 1 -- 172.21.15.150:0/410816224 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7ff4180846f0 con 0x7ff42015d190 2024-09-17T05:52:46.311 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:46.310+0000 7ff427f57640 1 -- 172.21.15.150:0/410816224 --> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] -- mgr_command(tid 0: {"prefix": "fs subvolume snapshot create", "vol_name": "cephfs", "sub_name": "sv1", "snap_name": "ss1", "target": ["mon-mgr", ""]}) -- 0x7ff4200cd500 con 0x7ff40407ab40 2024-09-17T05:52:46.322 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:46.321+0000 7ff4167fc640 1 -- 172.21.15.150:0/410816224 <== mgr.4108 v2:172.21.15.176:6800/3631216395 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7ff4200cd500 con 0x7ff40407ab40 2024-09-17T05:52:46.325 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:46.324+0000 7ff427f57640 1 -- 172.21.15.150:0/410816224 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7ff40407ab40 msgr2=0x7ff40407d050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:52:46.325 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:46.324+0000 7ff427f57640 1 --2- 172.21.15.150:0/410816224 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7ff40407ab40 0x7ff40407d050 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 crypto rx=0x7ff41c009f20 tx=0x7ff41c005f90 comp rx=0 tx=0).stop 2024-09-17T05:52:46.325 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:46.324+0000 7ff427f57640 1 -- 172.21.15.150:0/410816224 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff42015d190 msgr2=0x7ff4201f7860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:52:46.325 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:46.324+0000 7ff427f57640 1 --2- 172.21.15.150:0/410816224 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff42015d190 0x7ff4201f7860 secure :-1 s=READY pgs=1731 cs=0 l=1 rev1=1 crypto rx=0x7ff418009d60 tx=0x7ff418003ef0 comp rx=0 tx=0).stop 2024-09-17T05:52:46.325 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:46.324+0000 7ff427f57640 1 -- 172.21.15.150:0/410816224 shutdown_connections 2024-09-17T05:52:46.325 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:46.324+0000 7ff427f57640 1 --2- 172.21.15.150:0/410816224 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7ff40407ab40 0x7ff40407d050 unknown :-1 s=CLOSED pgs=732 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:52:46.326 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:46.324+0000 7ff427f57640 1 --2- 172.21.15.150:0/410816224 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff42015d190 0x7ff4201f7860 unknown :-1 s=CLOSED pgs=1731 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:52:46.326 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:46.324+0000 7ff427f57640 1 --2- 172.21.15.150:0/410816224 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff4200b4a00 0x7ff4201f7320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:52:46.326 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:46.324+0000 7ff427f57640 1 --2- 172.21.15.150:0/410816224 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff4200af8a0 0x7ff4201f6de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:52:46.326 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:46.324+0000 7ff427f57640 1 -- 172.21.15.150:0/410816224 >> 172.21.15.150:0/410816224 conn(0x7ff42009aa50 msgr2=0x7ff4200b2530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:52:46.326 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:46.324+0000 7ff427f57640 1 -- 172.21.15.150:0/410816224 shutdown_connections 2024-09-17T05:52:46.326 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:46.324+0000 7ff427f57640 1 -- 172.21.15.150:0/410816224 wait complete. 2024-09-17T05:52:46.337 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume getpath cephfs sv1 2024-09-17T05:52:46.453 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:46.452+0000 7f35c0a5c640 1 -- 172.21.15.150:0/241260099 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f35bc0cf390 msgr2=0x7f35bc0cf7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:52:46.453 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:46.452+0000 7f35c0a5c640 1 --2- 172.21.15.150:0/241260099 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f35bc0cf390 0x7f35bc0cf7a0 secure :-1 s=READY pgs=1733 cs=0 l=1 rev1=1 crypto rx=0x7f35bc0d2470 tx=0x7f35b402a790 comp rx=0 tx=0).stop 2024-09-17T05:52:46.454 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:46.452+0000 7f35c0a5c640 1 -- 172.21.15.150:0/241260099 shutdown_connections 2024-09-17T05:52:46.454 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:46.452+0000 7f35c0a5c640 1 --2- 172.21.15.150:0/241260099 >> v2:172.21.15.176:3300/0 conn(0x7f35bc0b16f0 0x7f35bc0b1ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:52:46.454 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:46.452+0000 7f35c0a5c640 1 --2- 172.21.15.150:0/241260099 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f35bc0cf390 0x7f35bc0cf7a0 unknown :-1 s=CLOSED pgs=1733 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:52:46.454 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:46.452+0000 7f35c0a5c640 1 -- 172.21.15.150:0/241260099 >> 172.21.15.150:0/241260099 conn(0x7f35bc0b2ff0 msgr2=0x7f35bc0b3400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:52:46.454 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:46.452+0000 7f35c0a5c640 1 -- 172.21.15.150:0/241260099 shutdown_connections 2024-09-17T05:52:46.454 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:46.452+0000 7f35c0a5c640 1 -- 172.21.15.150:0/241260099 wait complete. 2024-09-17T05:52:46.455 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:46.454+0000 7f35c0a5c640 1 Processor -- start 2024-09-17T05:52:46.455 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:46.454+0000 7f35c0a5c640 1 -- start start 2024-09-17T05:52:46.458 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:46.456+0000 7f35c0a5c640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f35bc0b16f0 0x7f35bc1e59b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:52:46.458 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:46.456+0000 7f35c0a5c640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f35bc0b25e0 0x7f35bc1f2c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:52:46.458 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:46.456+0000 7f35c0a5c640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f35bc0cf390 0x7f35bc0b5030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:52:46.458 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:46.456+0000 7f35c0a5c640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f35bc0ae740 con 0x7f35bc0cf390 2024-09-17T05:52:46.458 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:46.456+0000 7f35c0a5c640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f35bc0ae5c0 con 0x7f35bc0b25e0 2024-09-17T05:52:46.458 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:46.456+0000 7f35c0a5c640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f35bc0ae8c0 con 0x7f35bc0b16f0 2024-09-17T05:52:46.458 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:46.456+0000 7f35bad9d640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f35bc0cf390 0x7f35bc0b5030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:52:46.458 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:46.456+0000 7f35bad9d640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f35bc0cf390 0x7f35bc0b5030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:46298/0 (socket says 172.21.15.150:46298) 2024-09-17T05:52:46.458 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:46.456+0000 7f35bad9d640 1 -- 172.21.15.150:0/652982528 learned_addr learned my addr 172.21.15.150:0/652982528 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:52:46.458 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:46.456+0000 7f35b9d9b640 1 --2- 172.21.15.150:0/652982528 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f35bc0b25e0 0x7f35bc1f2c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:52:46.458 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:46.456+0000 7f35ba59c640 1 --2- 172.21.15.150:0/652982528 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f35bc0b16f0 0x7f35bc1e59b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:52:46.459 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:46.456+0000 7f35bad9d640 1 -- 172.21.15.150:0/652982528 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f35bc0b16f0 msgr2=0x7f35bc1e59b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:52:46.459 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:46.456+0000 7f35bad9d640 1 --2- 172.21.15.150:0/652982528 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f35bc0b16f0 0x7f35bc1e59b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:52:46.459 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:46.456+0000 7f35bad9d640 1 -- 172.21.15.150:0/652982528 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f35bc0b25e0 msgr2=0x7f35bc1f2c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:52:46.459 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:46.456+0000 7f35bad9d640 1 --2- 172.21.15.150:0/652982528 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f35bc0b25e0 0x7f35bc1f2c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:52:46.459 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:46.456+0000 7f35bad9d640 1 -- 172.21.15.150:0/652982528 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f35bc1e38d0 con 0x7f35bc0cf390 2024-09-17T05:52:46.459 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:46.456+0000 7f35bad9d640 1 --2- 172.21.15.150:0/652982528 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f35bc0cf390 0x7f35bc0b5030 secure :-1 s=READY pgs=1734 cs=0 l=1 rev1=1 crypto rx=0x7f35b4009ca0 tx=0x7f35b4005bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:52:46.459 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:46.456+0000 7f35aaffd640 1 -- 172.21.15.150:0/652982528 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35b4036040 con 0x7f35bc0cf390 2024-09-17T05:52:46.459 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:46.456+0000 7f35aaffd640 1 -- 172.21.15.150:0/652982528 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f35b4004130 con 0x7f35bc0cf390 2024-09-17T05:52:46.459 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:46.456+0000 7f35c0a5c640 1 -- 172.21.15.150:0/652982528 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f35bc1e35f0 con 0x7f35bc0cf390 2024-09-17T05:52:46.459 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:46.456+0000 7f35aaffd640 1 -- 172.21.15.150:0/652982528 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35b4004580 con 0x7f35bc0cf390 2024-09-17T05:52:46.459 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:46.457+0000 7f35c0a5c640 1 -- 172.21.15.150:0/652982528 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f35bc1e5ef0 con 0x7f35bc0cf390 2024-09-17T05:52:46.460 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:46.457+0000 7f35c0a5c640 1 -- 172.21.15.150:0/652982528 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f35bc0c7560 con 0x7f35bc0cf390 2024-09-17T05:52:46.460 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:46.458+0000 7f35aaffd640 1 -- 172.21.15.150:0/652982528 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 43) ==== 104297+0+0 (secure 0 0 0) 0x7f35b4045480 con 0x7f35bc0cf390 2024-09-17T05:52:46.460 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:46.459+0000 7f35aaffd640 1 --2- 172.21.15.150:0/652982528 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f359c07ab40 0x7f359c07d050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:52:46.461 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:46.459+0000 7f35aaffd640 1 -- 172.21.15.150:0/652982528 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(129..129 src has 1..129) ==== 5935+0+0 (secure 0 0 0) 0x7f35b40bc8a0 con 0x7f35bc0cf390 2024-09-17T05:52:46.461 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:46.459+0000 7f35ba59c640 1 --2- 172.21.15.150:0/652982528 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f359c07ab40 0x7f359c07d050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:52:46.461 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:46.459+0000 7f35ba59c640 1 --2- 172.21.15.150:0/652982528 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f359c07ab40 0x7f359c07d050 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x7f35ac000f60 tx=0x7f35ac009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:52:46.464 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:46.463+0000 7f35aaffd640 1 -- 172.21.15.150:0/652982528 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f35bc0c7560 con 0x7f35bc0cf390 2024-09-17T05:52:46.664 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:46.663+0000 7f35c0a5c640 1 -- 172.21.15.150:0/652982528 --> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "sub_name": "sv1", "target": ["mon-mgr", ""]}) -- 0x7f35bc0cbf40 con 0x7f359c07ab40 2024-09-17T05:52:46.669 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:46.668+0000 7f35aaffd640 1 -- 172.21.15.150:0/652982528 <== mgr.4108 v2:172.21.15.176:6800/3631216395 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+59 (secure 0 0 0) 0x7f35ac001420 con 0x7f359c07ab40 2024-09-17T05:52:46.669 INFO:teuthology.orchestra.run.smithi150.stdout:/volumes/_nogroup/sv1/1bc3ddb5-d4ca-4f40-9c35-676acc146be9 2024-09-17T05:52:46.672 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:46.670+0000 7f35c0a5c640 1 -- 172.21.15.150:0/652982528 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f359c07ab40 msgr2=0x7f359c07d050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:52:46.672 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:46.670+0000 7f35c0a5c640 1 --2- 172.21.15.150:0/652982528 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f359c07ab40 0x7f359c07d050 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x7f35ac000f60 tx=0x7f35ac009040 comp rx=0 tx=0).stop 2024-09-17T05:52:46.672 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:46.670+0000 7f35c0a5c640 1 -- 172.21.15.150:0/652982528 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f35bc0cf390 msgr2=0x7f35bc0b5030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:52:46.672 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:46.670+0000 7f35c0a5c640 1 --2- 172.21.15.150:0/652982528 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f35bc0cf390 0x7f35bc0b5030 secure :-1 s=READY pgs=1734 cs=0 l=1 rev1=1 crypto rx=0x7f35b4009ca0 tx=0x7f35b4005bf0 comp rx=0 tx=0).stop 2024-09-17T05:52:46.672 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:46.670+0000 7f35c0a5c640 1 -- 172.21.15.150:0/652982528 shutdown_connections 2024-09-17T05:52:46.673 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:46.670+0000 7f35c0a5c640 1 --2- 172.21.15.150:0/652982528 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f35bc0b25e0 0x7f35bc1f2c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:52:46.673 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:46.670+0000 7f35c0a5c640 1 --2- 172.21.15.150:0/652982528 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f359c07ab40 0x7f359c07d050 unknown :-1 s=CLOSED pgs=733 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:52:46.673 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:46.670+0000 7f35c0a5c640 1 --2- 172.21.15.150:0/652982528 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f35bc0cf390 0x7f35bc0b5030 unknown :-1 s=CLOSED pgs=1734 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:52:46.673 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:46.670+0000 7f35c0a5c640 1 --2- 172.21.15.150:0/652982528 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f35bc0b16f0 0x7f35bc1e59b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:52:46.674 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:46.670+0000 7f35c0a5c640 1 -- 172.21.15.150:0/652982528 >> 172.21.15.150:0/652982528 conn(0x7f35bc0b2ff0 msgr2=0x7f35bc1ddc80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:52:46.674 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:46.670+0000 7f35c0a5c640 1 -- 172.21.15.150:0/652982528 shutdown_connections 2024-09-17T05:52:46.674 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:46.670+0000 7f35c0a5c640 1 -- 172.21.15.150:0/652982528 wait complete. 2024-09-17T05:52:46.683 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:52:46.683 DEBUG:teuthology.orchestra.run.smithi150:> (cd /home/ubuntu/cephtest/mnt.0 && exec getfattr -n ceph.dir.rbytes volumes/_nogroup/sv1/1bc3ddb5-d4ca-4f40-9c35-676acc146be9 2024-09-17T05:52:46.683 DEBUG:teuthology.orchestra.run.smithi150:> ) 2024-09-17T05:52:46.700 INFO:teuthology.orchestra.run.smithi150.stdout:# file: volumes/_nogroup/sv1/1bc3ddb5-d4ca-4f40-9c35-676acc146be9 2024-09-17T05:52:46.701 INFO:teuthology.orchestra.run.smithi150.stdout:ceph.dir.rbytes="2972172288" 2024-09-17T05:52:46.701 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-09-17T05:52:46.702 INFO:tasks.cephfs.test_volumes:r_size = 2972172288 exp_size = 3221225472 2024-09-17T05:52:48.702 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:52:48.703 DEBUG:teuthology.orchestra.run.smithi150:> (cd /home/ubuntu/cephtest/mnt.0 && exec getfattr -n ceph.dir.rbytes volumes/_nogroup/sv1/1bc3ddb5-d4ca-4f40-9c35-676acc146be9 2024-09-17T05:52:48.703 DEBUG:teuthology.orchestra.run.smithi150:> ) 2024-09-17T05:52:48.722 INFO:teuthology.orchestra.run.smithi150.stdout:# file: volumes/_nogroup/sv1/1bc3ddb5-d4ca-4f40-9c35-676acc146be9 2024-09-17T05:52:48.723 INFO:teuthology.orchestra.run.smithi150.stdout:ceph.dir.rbytes="2972172288" 2024-09-17T05:52:48.723 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-09-17T05:52:48.724 INFO:tasks.cephfs.test_volumes:r_size = 2972172288 exp_size = 3221225472 2024-09-17T05:52:50.724 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:52:50.725 DEBUG:teuthology.orchestra.run.smithi150:> (cd /home/ubuntu/cephtest/mnt.0 && exec getfattr -n ceph.dir.rbytes volumes/_nogroup/sv1/1bc3ddb5-d4ca-4f40-9c35-676acc146be9 2024-09-17T05:52:50.725 DEBUG:teuthology.orchestra.run.smithi150:> ) 2024-09-17T05:52:50.746 INFO:teuthology.orchestra.run.smithi150.stdout:# file: volumes/_nogroup/sv1/1bc3ddb5-d4ca-4f40-9c35-676acc146be9 2024-09-17T05:52:50.746 INFO:teuthology.orchestra.run.smithi150.stdout:ceph.dir.rbytes="3221225472" 2024-09-17T05:52:50.746 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-09-17T05:52:50.747 INFO:tasks.cephfs.test_volumes:r_size = 3221225472 exp_size = 3221225472 2024-09-17T05:52:50.747 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume snapshot clone cephfs sv1 ss1 ss1clone1 2024-09-17T05:52:50.919 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:50.917+0000 7f5357f62640 1 -- 172.21.15.150:0/4270758726 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f53500b25e0 msgr2=0x7f53500b1ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:52:50.919 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:50.917+0000 7f5357f62640 1 --2- 172.21.15.150:0/4270758726 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f53500b25e0 0x7f53500b1ec0 secure :-1 s=READY pgs=1736 cs=0 l=1 rev1=1 crypto rx=0x7f534c009830 tx=0x7f534c02a4a0 comp rx=0 tx=0).stop 2024-09-17T05:52:50.919 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:50.917+0000 7f5357f62640 1 -- 172.21.15.150:0/4270758726 shutdown_connections 2024-09-17T05:52:50.919 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:50.917+0000 7f5357f62640 1 --2- 172.21.15.150:0/4270758726 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f53500b25e0 0x7f53500b1ec0 unknown :-1 s=CLOSED pgs=1736 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:52:50.919 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:50.917+0000 7f5357f62640 1 -- 172.21.15.150:0/4270758726 >> 172.21.15.150:0/4270758726 conn(0x7f53500b2ff0 msgr2=0x7f53500b3400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:52:50.920 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:50.917+0000 7f5357f62640 1 -- 172.21.15.150:0/4270758726 shutdown_connections 2024-09-17T05:52:50.920 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:50.917+0000 7f5357f62640 1 -- 172.21.15.150:0/4270758726 wait complete. 2024-09-17T05:52:50.925 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:50.919+0000 7f5357f62640 1 Processor -- start 2024-09-17T05:52:50.925 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:50.919+0000 7f5357f62640 1 -- start start 2024-09-17T05:52:50.925 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:50.920+0000 7f5357f62640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f53500b0fe0 0x7f535014be40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:52:50.926 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:50.920+0000 7f5357f62640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f53500b25e0 0x7f5350162ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:52:50.926 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:50.920+0000 7f5357f62640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f53500cf390 0x7f535015cad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:52:50.926 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:50.920+0000 7f5357f62640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f5350166cf0 con 0x7f53500b0fe0 2024-09-17T05:52:50.926 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:50.920+0000 7f5357f62640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f53500d0280 con 0x7f53500b25e0 2024-09-17T05:52:50.926 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:50.920+0000 7f5357f62640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f5350166e70 con 0x7f53500cf390 2024-09-17T05:52:50.926 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:50.920+0000 7f5355cfe640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f53500b0fe0 0x7f535014be40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:52:50.926 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:50.920+0000 7f5355cfe640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f53500b0fe0 0x7f535014be40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:38204/0 (socket says 172.21.15.150:38204) 2024-09-17T05:52:50.927 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:50.920+0000 7f5355cfe640 1 -- 172.21.15.150:0/1953487846 learned_addr learned my addr 172.21.15.150:0/1953487846 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:52:50.927 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:50.920+0000 7f53554fd640 1 --2- 172.21.15.150:0/1953487846 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f53500b25e0 0x7f5350162ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:52:50.927 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:50.920+0000 7f53564ff640 1 --2- 172.21.15.150:0/1953487846 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f53500cf390 0x7f535015cad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:52:50.927 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:50.921+0000 7f5355cfe640 1 -- 172.21.15.150:0/1953487846 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f53500cf390 msgr2=0x7f535015cad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:52:50.927 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:50.921+0000 7f5355cfe640 1 --2- 172.21.15.150:0/1953487846 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f53500cf390 0x7f535015cad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:52:50.927 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:50.921+0000 7f5355cfe640 1 -- 172.21.15.150:0/1953487846 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f53500b25e0 msgr2=0x7f5350162ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:52:50.927 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:50.921+0000 7f5355cfe640 1 --2- 172.21.15.150:0/1953487846 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f53500b25e0 0x7f5350162ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:52:50.928 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:50.921+0000 7f5355cfe640 1 -- 172.21.15.150:0/1953487846 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f53501620c0 con 0x7f53500b0fe0 2024-09-17T05:52:50.928 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:50.921+0000 7f5355cfe640 1 --2- 172.21.15.150:0/1953487846 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f53500b0fe0 0x7f535014be40 secure :-1 s=READY pgs=1737 cs=0 l=1 rev1=1 crypto rx=0x7f534c000c00 tx=0x7f534c033d60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:52:50.928 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:50.921+0000 7f53467fc640 1 -- 172.21.15.150:0/1953487846 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f534c031d60 con 0x7f53500b0fe0 2024-09-17T05:52:50.928 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:50.921+0000 7f53467fc640 1 -- 172.21.15.150:0/1953487846 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f534c033070 con 0x7f53500b0fe0 2024-09-17T05:52:50.928 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:50.921+0000 7f5357f62640 1 -- 172.21.15.150:0/1953487846 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5350164710 con 0x7f53500b0fe0 2024-09-17T05:52:50.929 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:50.921+0000 7f53467fc640 1 -- 172.21.15.150:0/1953487846 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f534c0334c0 con 0x7f53500b0fe0 2024-09-17T05:52:50.929 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:50.921+0000 7f5357f62640 1 -- 172.21.15.150:0/1953487846 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5350164cd0 con 0x7f53500b0fe0 2024-09-17T05:52:50.929 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:50.922+0000 7f5357f62640 1 -- 172.21.15.150:0/1953487846 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f535015a030 con 0x7f53500b0fe0 2024-09-17T05:52:50.929 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:50.923+0000 7f53467fc640 1 -- 172.21.15.150:0/1953487846 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 43) ==== 104297+0+0 (secure 0 0 0) 0x7f534c033660 con 0x7f53500b0fe0 2024-09-17T05:52:50.929 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:50.924+0000 7f53467fc640 1 --2- 172.21.15.150:0/1953487846 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f533407ab40 0x7f533407d050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:52:50.930 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:50.924+0000 7f53467fc640 1 -- 172.21.15.150:0/1953487846 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(129..129 src has 1..129) ==== 5935+0+0 (secure 0 0 0) 0x7f534c0bb240 con 0x7f53500b0fe0 2024-09-17T05:52:50.930 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:50.924+0000 7f53554fd640 1 --2- 172.21.15.150:0/1953487846 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f533407ab40 0x7f533407d050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:52:50.930 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:50.925+0000 7f53554fd640 1 --2- 172.21.15.150:0/1953487846 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f533407ab40 0x7f533407d050 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 crypto rx=0x7f535015da00 tx=0x7f5340009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:52:50.931 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:50.928+0000 7f53467fc640 1 -- 172.21.15.150:0/1953487846 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f534c03f030 con 0x7f53500b0fe0 2024-09-17T05:52:51.136 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:51.135+0000 7f5357f62640 1 -- 172.21.15.150:0/1953487846 --> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] -- mgr_command(tid 0: {"prefix": "fs subvolume snapshot clone", "vol_name": "cephfs", "sub_name": "sv1", "snap_name": "ss1", "target_sub_name": "ss1clone1", "target": ["mon-mgr", ""]}) -- 0x7f53500b1ec0 con 0x7f533407ab40 2024-09-17T05:52:51.194 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:51.193+0000 7f53467fc640 1 -- 172.21.15.150:0/1953487846 <== mgr.4108 v2:172.21.15.176:6800/3631216395 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f53500b1ec0 con 0x7f533407ab40 2024-09-17T05:52:51.196 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:51.195+0000 7f5357f62640 1 -- 172.21.15.150:0/1953487846 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f533407ab40 msgr2=0x7f533407d050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:52:51.197 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:51.195+0000 7f5357f62640 1 --2- 172.21.15.150:0/1953487846 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f533407ab40 0x7f533407d050 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 crypto rx=0x7f535015da00 tx=0x7f5340009040 comp rx=0 tx=0).stop 2024-09-17T05:52:51.197 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:51.195+0000 7f5357f62640 1 -- 172.21.15.150:0/1953487846 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f53500b0fe0 msgr2=0x7f535014be40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:52:51.197 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:51.195+0000 7f5357f62640 1 --2- 172.21.15.150:0/1953487846 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f53500b0fe0 0x7f535014be40 secure :-1 s=READY pgs=1737 cs=0 l=1 rev1=1 crypto rx=0x7f534c000c00 tx=0x7f534c033d60 comp rx=0 tx=0).stop 2024-09-17T05:52:51.197 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:51.195+0000 7f5357f62640 1 -- 172.21.15.150:0/1953487846 shutdown_connections 2024-09-17T05:52:51.197 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:51.195+0000 7f5357f62640 1 --2- 172.21.15.150:0/1953487846 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f53500b25e0 0x7f5350162ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:52:51.197 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:51.195+0000 7f5357f62640 1 --2- 172.21.15.150:0/1953487846 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f533407ab40 0x7f533407d050 unknown :-1 s=CLOSED pgs=734 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:52:51.198 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:51.195+0000 7f5357f62640 1 --2- 172.21.15.150:0/1953487846 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f53500cf390 0x7f535015cad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:52:51.198 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:51.195+0000 7f5357f62640 1 --2- 172.21.15.150:0/1953487846 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f53500b0fe0 0x7f535014be40 unknown :-1 s=CLOSED pgs=1737 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:52:51.198 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:51.195+0000 7f5357f62640 1 -- 172.21.15.150:0/1953487846 >> 172.21.15.150:0/1953487846 conn(0x7f53500b2ff0 msgr2=0x7f5350163c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:52:51.198 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:51.195+0000 7f5357f62640 1 -- 172.21.15.150:0/1953487846 shutdown_connections 2024-09-17T05:52:51.198 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:51.195+0000 7f5357f62640 1 -- 172.21.15.150:0/1953487846 wait complete. 2024-09-17T05:52:51.200 INFO:tasks.ceph.mgr.x.smithi176.stderr:2024-09-17T05:52:51.199+0000 7f33dbf23640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-17T05:52:51.200 INFO:tasks.ceph.mgr.x.smithi176.stderr:2024-09-17T05:52:51.199+0000 7f33dbf23640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-17T05:52:51.201 INFO:tasks.ceph.mgr.x.smithi176.stderr:2024-09-17T05:52:51.199+0000 7f33dbf23640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-17T05:52:51.201 INFO:tasks.ceph.mgr.x.smithi176.stderr:2024-09-17T05:52:51.199+0000 7f33dbf23640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-17T05:52:51.201 INFO:tasks.ceph.mgr.x.smithi176.stderr:2024-09-17T05:52:51.199+0000 7f33dbf23640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-17T05:52:51.218 INFO:tasks.ceph.mgr.x.smithi176.stderr:2024-09-17T05:52:51.214+0000 7f33dc724640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-17T05:52:51.219 INFO:tasks.ceph.mgr.x.smithi176.stderr:2024-09-17T05:52:51.214+0000 7f33dc724640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-17T05:52:51.219 INFO:tasks.ceph.mgr.x.smithi176.stderr:2024-09-17T05:52:51.214+0000 7f33dc724640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-17T05:52:51.219 INFO:tasks.ceph.mgr.x.smithi176.stderr:2024-09-17T05:52:51.214+0000 7f33dc724640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-17T05:52:51.219 INFO:tasks.ceph.mgr.x.smithi176.stderr:2024-09-17T05:52:51.214+0000 7f33dc724640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-17T05:52:52.202 INFO:tasks.ceph.mgr.x.smithi176.stderr:2024-09-17T05:52:52.200+0000 7f3377d9b640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-17T05:52:52.202 INFO:tasks.ceph.mgr.x.smithi176.stderr:2024-09-17T05:52:52.200+0000 7f3377d9b640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-17T05:52:52.202 INFO:tasks.ceph.mgr.x.smithi176.stderr:2024-09-17T05:52:52.200+0000 7f3377d9b640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-17T05:52:52.202 INFO:tasks.ceph.mgr.x.smithi176.stderr:2024-09-17T05:52:52.200+0000 7f3377d9b640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-17T05:52:52.202 INFO:tasks.ceph.mgr.x.smithi176.stderr:2024-09-17T05:52:52.200+0000 7f3377d9b640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-17T05:52:52.211 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs clone cancel cephfs ss1clone1 2024-09-17T05:52:52.364 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:52.363+0000 7f20077ed640 1 -- 172.21.15.150:0/2468560953 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f20000ce3d0 msgr2=0x7f200015eaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:52:52.364 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:52.363+0000 7f20077ed640 1 --2- 172.21.15.150:0/2468560953 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f20000ce3d0 0x7f200015eaa0 secure :-1 s=READY pgs=1738 cs=0 l=1 rev1=1 crypto rx=0x7f1ffc005fd0 tx=0x7f1ffc02a410 comp rx=0 tx=0).stop 2024-09-17T05:52:52.365 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:52.363+0000 7f20077ed640 1 -- 172.21.15.150:0/2468560953 shutdown_connections 2024-09-17T05:52:52.365 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:52.363+0000 7f20077ed640 1 --2- 172.21.15.150:0/2468560953 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f200006e4c0 0x7f20000b4670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:52:52.365 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:52.363+0000 7f20077ed640 1 --2- 172.21.15.150:0/2468560953 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f20000ce3d0 0x7f200015eaa0 unknown :-1 s=CLOSED pgs=1738 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:52:52.365 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:52.363+0000 7f20077ed640 1 -- 172.21.15.150:0/2468560953 >> 172.21.15.150:0/2468560953 conn(0x7f2000073820 msgr2=0x7f2000073c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:52:52.365 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:52.363+0000 7f20077ed640 1 -- 172.21.15.150:0/2468560953 shutdown_connections 2024-09-17T05:52:52.365 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:52.363+0000 7f20077ed640 1 -- 172.21.15.150:0/2468560953 wait complete. 2024-09-17T05:52:52.366 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:52.366+0000 7f20077ed640 1 Processor -- start 2024-09-17T05:52:52.367 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:52.366+0000 7f20077ed640 1 -- start start 2024-09-17T05:52:52.370 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:52.369+0000 7f20077ed640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f20000ce3d0 0x7f200015e300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:52:52.370 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:52.369+0000 7f20077ed640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f200015efe0 0x7f20001e6ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:52:52.370 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:52.369+0000 7f20077ed640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f200015a0b0 0x7f20001e7010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:52:52.370 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:52.369+0000 7f20077ed640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f20000b4d30 con 0x7f20000ce3d0 2024-09-17T05:52:52.370 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:52.369+0000 7f20077ed640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f20000b4bb0 con 0x7f200015efe0 2024-09-17T05:52:52.370 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:52.369+0000 7f20077ed640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f20000b4eb0 con 0x7f200015a0b0 2024-09-17T05:52:52.370 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:52.369+0000 7f2005589640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f20000ce3d0 0x7f200015e300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:52:52.371 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:52.369+0000 7f2005589640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f20000ce3d0 0x7f200015e300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:38220/0 (socket says 172.21.15.150:38220) 2024-09-17T05:52:52.371 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:52.369+0000 7f2005589640 1 -- 172.21.15.150:0/2110605583 learned_addr learned my addr 172.21.15.150:0/2110605583 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:52:52.371 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:52.369+0000 7f2005d8a640 1 --2- 172.21.15.150:0/2110605583 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f200015a0b0 0x7f20001e7010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:52:52.371 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:52.369+0000 7f2004d88640 1 --2- 172.21.15.150:0/2110605583 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f200015efe0 0x7f20001e6ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:52:52.371 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:52.369+0000 7f2005589640 1 -- 172.21.15.150:0/2110605583 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f200015a0b0 msgr2=0x7f20001e7010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:52:52.371 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:52.369+0000 7f2005589640 1 --2- 172.21.15.150:0/2110605583 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f200015a0b0 0x7f20001e7010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:52:52.371 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:52.369+0000 7f2005589640 1 -- 172.21.15.150:0/2110605583 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f200015efe0 msgr2=0x7f20001e6ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:52:52.371 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:52.369+0000 7f2005589640 1 --2- 172.21.15.150:0/2110605583 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f200015efe0 0x7f20001e6ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:52:52.372 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:52.369+0000 7f2005589640 1 -- 172.21.15.150:0/2110605583 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f20001e5640 con 0x7f20000ce3d0 2024-09-17T05:52:52.372 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:52.369+0000 7f2005d8a640 1 --2- 172.21.15.150:0/2110605583 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f200015a0b0 0x7f20001e7010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:52:52.373 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:52.369+0000 7f2005589640 1 --2- 172.21.15.150:0/2110605583 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f20000ce3d0 0x7f200015e300 secure :-1 s=READY pgs=1739 cs=0 l=1 rev1=1 crypto rx=0x7f1ffc034040 tx=0x7f1ffc003970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:52:52.373 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:52.370+0000 7f1ff5ffb640 1 -- 172.21.15.150:0/2110605583 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ffc035040 con 0x7f20000ce3d0 2024-09-17T05:52:52.373 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:52.370+0000 7f1ff5ffb640 1 -- 172.21.15.150:0/2110605583 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f1ffc003d80 con 0x7f20000ce3d0 2024-09-17T05:52:52.373 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:52.370+0000 7f20077ed640 1 -- 172.21.15.150:0/2110605583 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f20001e5920 con 0x7f20000ce3d0 2024-09-17T05:52:52.373 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:52.370+0000 7f1ff5ffb640 1 -- 172.21.15.150:0/2110605583 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ffc004a00 con 0x7f20000ce3d0 2024-09-17T05:52:52.373 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:52.370+0000 7f20077ed640 1 -- 172.21.15.150:0/2110605583 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f20001e5ee0 con 0x7f20000ce3d0 2024-09-17T05:52:52.373 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:52.372+0000 7f20077ed640 1 -- 172.21.15.150:0/2110605583 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f20000b53e0 con 0x7f20000ce3d0 2024-09-17T05:52:52.374 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:52.373+0000 7f1ff5ffb640 1 -- 172.21.15.150:0/2110605583 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 43) ==== 104297+0+0 (secure 0 0 0) 0x7f1ffc004ba0 con 0x7f20000ce3d0 2024-09-17T05:52:52.374 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:52.374+0000 7f1ff5ffb640 1 --2- 172.21.15.150:0/2110605583 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f1fe407ab10 0x7f1fe407d020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:52:52.374 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:52.374+0000 7f1ff5ffb640 1 -- 172.21.15.150:0/2110605583 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(129..129 src has 1..129) ==== 5935+0+0 (secure 0 0 0) 0x7f1ffc0bc880 con 0x7f20000ce3d0 2024-09-17T05:52:52.375 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:52.374+0000 7f2004d88640 1 --2- 172.21.15.150:0/2110605583 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f1fe407ab10 0x7f1fe407d020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:52:52.376 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:52.376+0000 7f2004d88640 1 --2- 172.21.15.150:0/2110605583 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f1fe407ab10 0x7f1fe407d020 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 crypto rx=0x7f1ff0006fd0 tx=0x7f1ff0008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:52:52.380 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:52.380+0000 7f1ff5ffb640 1 -- 172.21.15.150:0/2110605583 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f1ffc086850 con 0x7f20000ce3d0 2024-09-17T05:52:52.703 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:52.702+0000 7f20077ed640 1 -- 172.21.15.150:0/2110605583 --> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] -- mgr_command(tid 0: {"prefix": "fs clone cancel", "vol_name": "cephfs", "clone_name": "ss1clone1", "target": ["mon-mgr", ""]}) -- 0x7f200013ea90 con 0x7f1fe407ab10 2024-09-17T05:52:52.825 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:52.824+0000 7f1ff5ffb640 1 -- 172.21.15.150:0/2110605583 <== mgr.4108 v2:172.21.15.176:6800/3631216395 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f1ff000bda0 con 0x7f1fe407ab10 2024-09-17T05:52:52.827 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:52.827+0000 7f20077ed640 1 -- 172.21.15.150:0/2110605583 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f1fe407ab10 msgr2=0x7f1fe407d020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:52:52.828 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:52.827+0000 7f20077ed640 1 --2- 172.21.15.150:0/2110605583 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f1fe407ab10 0x7f1fe407d020 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 crypto rx=0x7f1ff0006fd0 tx=0x7f1ff0008040 comp rx=0 tx=0).stop 2024-09-17T05:52:52.828 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:52.827+0000 7f20077ed640 1 -- 172.21.15.150:0/2110605583 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f20000ce3d0 msgr2=0x7f200015e300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:52:52.828 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:52.827+0000 7f20077ed640 1 --2- 172.21.15.150:0/2110605583 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f20000ce3d0 0x7f200015e300 secure :-1 s=READY pgs=1739 cs=0 l=1 rev1=1 crypto rx=0x7f1ffc034040 tx=0x7f1ffc003970 comp rx=0 tx=0).stop 2024-09-17T05:52:52.828 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:52.827+0000 7f20077ed640 1 -- 172.21.15.150:0/2110605583 shutdown_connections 2024-09-17T05:52:52.828 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:52.827+0000 7f20077ed640 1 --2- 172.21.15.150:0/2110605583 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f200015efe0 0x7f20001e6ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:52:52.828 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:52.827+0000 7f20077ed640 1 --2- 172.21.15.150:0/2110605583 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f1fe407ab10 0x7f1fe407d020 unknown :-1 s=CLOSED pgs=735 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:52:52.828 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:52.827+0000 7f20077ed640 1 --2- 172.21.15.150:0/2110605583 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f200015a0b0 0x7f20001e7010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:52:52.828 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:52.827+0000 7f20077ed640 1 --2- 172.21.15.150:0/2110605583 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f20000ce3d0 0x7f200015e300 unknown :-1 s=CLOSED pgs=1739 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:52:52.828 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:52.827+0000 7f20077ed640 1 -- 172.21.15.150:0/2110605583 >> 172.21.15.150:0/2110605583 conn(0x7f2000073820 msgr2=0x7f20000b1120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:52:52.828 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:52.827+0000 7f20077ed640 1 -- 172.21.15.150:0/2110605583 shutdown_connections 2024-09-17T05:52:52.828 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:52.827+0000 7f20077ed640 1 -- 172.21.15.150:0/2110605583 wait complete. 2024-09-17T05:52:52.839 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs clone status cephfs ss1clone1 2024-09-17T05:52:52.957 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:52.956+0000 7f1e4b3b0640 1 -- 172.21.15.150:0/2111501506 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1e44070290 msgr2=0x7f1e440706a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:52:52.957 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:52.956+0000 7f1e4b3b0640 1 --2- 172.21.15.150:0/2111501506 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1e44070290 0x7f1e440706a0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f1e3c009830 tx=0x7f1e3c02a510 comp rx=0 tx=0).stop 2024-09-17T05:52:52.957 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:52.956+0000 7f1e4b3b0640 1 -- 172.21.15.150:0/2111501506 shutdown_connections 2024-09-17T05:52:52.958 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:52.956+0000 7f1e4b3b0640 1 --2- 172.21.15.150:0/2111501506 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1e44070290 0x7f1e440706a0 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:52:52.958 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:52.956+0000 7f1e4b3b0640 1 --2- 172.21.15.150:0/2111501506 >> v2:172.21.15.176:3300/0 conn(0x7f1e440ccc30 0x7f1e440b4390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:52:52.958 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:52.956+0000 7f1e4b3b0640 1 -- 172.21.15.150:0/2111501506 >> 172.21.15.150:0/2111501506 conn(0x7f1e4406d1c0 msgr2=0x7f1e4406d5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:52:52.958 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:52.956+0000 7f1e4b3b0640 1 -- 172.21.15.150:0/2111501506 shutdown_connections 2024-09-17T05:52:52.958 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:52.956+0000 7f1e4b3b0640 1 -- 172.21.15.150:0/2111501506 wait complete. 2024-09-17T05:52:52.959 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:52.958+0000 7f1e4b3b0640 1 Processor -- start 2024-09-17T05:52:52.959 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:52.958+0000 7f1e4b3b0640 1 -- start start 2024-09-17T05:52:52.962 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:52.959+0000 7f1e4b3b0640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1e44070290 0x7f1e440aece0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:52:52.962 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:52.959+0000 7f1e4b3b0640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1e440ccc30 0x7f1e44158670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:52:52.962 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:52.959+0000 7f1e4b3b0640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1e440cf7c0 0x7f1e44158bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:52:52.962 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:52.959+0000 7f1e4b3b0640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f1e4415c410 con 0x7f1e440cf7c0 2024-09-17T05:52:52.963 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:52.959+0000 7f1e4b3b0640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f1e4415c290 con 0x7f1e440ccc30 2024-09-17T05:52:52.963 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:52.959+0000 7f1e4b3b0640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f1e4415c590 con 0x7f1e44070290 2024-09-17T05:52:52.963 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:52.960+0000 7f1e4994d640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1e440cf7c0 0x7f1e44158bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:52:52.963 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:52.960+0000 7f1e4994d640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1e440cf7c0 0x7f1e44158bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:38222/0 (socket says 172.21.15.150:38222) 2024-09-17T05:52:52.963 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:52.960+0000 7f1e4994d640 1 -- 172.21.15.150:0/2004802041 learned_addr learned my addr 172.21.15.150:0/2004802041 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:52:52.963 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:52.960+0000 7f1e4914c640 1 --2- 172.21.15.150:0/2004802041 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1e44070290 0x7f1e440aece0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:52:52.963 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:52.960+0000 7f1e4894b640 1 --2- 172.21.15.150:0/2004802041 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1e440ccc30 0x7f1e44158670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:52:52.964 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:52.960+0000 7f1e4994d640 1 -- 172.21.15.150:0/2004802041 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1e44070290 msgr2=0x7f1e440aece0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:52:52.964 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:52.960+0000 7f1e4994d640 1 --2- 172.21.15.150:0/2004802041 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1e44070290 0x7f1e440aece0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:52:52.964 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:52.960+0000 7f1e4994d640 1 -- 172.21.15.150:0/2004802041 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1e440ccc30 msgr2=0x7f1e44158670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:52:52.964 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:52.960+0000 7f1e4994d640 1 --2- 172.21.15.150:0/2004802041 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1e440ccc30 0x7f1e44158670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:52:52.964 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:52.960+0000 7f1e4994d640 1 -- 172.21.15.150:0/2004802041 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1e440af220 con 0x7f1e440cf7c0 2024-09-17T05:52:52.964 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:52.960+0000 7f1e4994d640 1 --2- 172.21.15.150:0/2004802041 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1e440cf7c0 0x7f1e44158bb0 secure :-1 s=READY pgs=1741 cs=0 l=1 rev1=1 crypto rx=0x7f1e3c02ab00 tx=0x7f1e3c033c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:52:52.964 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:52.960+0000 7f1e39ffb640 1 -- 172.21.15.150:0/2004802041 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e3c005c90 con 0x7f1e440cf7c0 2024-09-17T05:52:52.964 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:52.960+0000 7f1e4b3b0640 1 -- 172.21.15.150:0/2004802041 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1e44152920 con 0x7f1e440cf7c0 2024-09-17T05:52:52.964 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:52.960+0000 7f1e39ffb640 1 -- 172.21.15.150:0/2004802041 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f1e3c031e50 con 0x7f1e440cf7c0 2024-09-17T05:52:52.964 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:52.960+0000 7f1e39ffb640 1 -- 172.21.15.150:0/2004802041 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e3c005220 con 0x7f1e440cf7c0 2024-09-17T05:52:52.964 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:52.961+0000 7f1e4b3b0640 1 -- 172.21.15.150:0/2004802041 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1e44152bc0 con 0x7f1e440cf7c0 2024-09-17T05:52:52.965 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:52.962+0000 7f1e4b3b0640 1 -- 172.21.15.150:0/2004802041 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1e44159410 con 0x7f1e440cf7c0 2024-09-17T05:52:52.965 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:52.962+0000 7f1e39ffb640 1 -- 172.21.15.150:0/2004802041 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 43) ==== 104297+0+0 (secure 0 0 0) 0x7f1e3c0053c0 con 0x7f1e440cf7c0 2024-09-17T05:52:52.965 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:52.963+0000 7f1e39ffb640 1 --2- 172.21.15.150:0/2004802041 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f1e2807ab10 0x7f1e2807d020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:52:52.966 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:52.963+0000 7f1e39ffb640 1 -- 172.21.15.150:0/2004802041 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(129..129 src has 1..129) ==== 5935+0+0 (secure 0 0 0) 0x7f1e3c0bad70 con 0x7f1e440cf7c0 2024-09-17T05:52:52.966 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:52.963+0000 7f1e4914c640 1 --2- 172.21.15.150:0/2004802041 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f1e2807ab10 0x7f1e2807d020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:52:52.966 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:52.963+0000 7f1e4914c640 1 --2- 172.21.15.150:0/2004802041 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f1e2807ab10 0x7f1e2807d020 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 crypto rx=0x7f1e400099a0 tx=0x7f1e40009500 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:52:52.968 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:52.967+0000 7f1e39ffb640 1 -- 172.21.15.150:0/2004802041 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f1e440af220 con 0x7f1e440cf7c0 2024-09-17T05:52:53.180 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:53.180+0000 7f1e4b3b0640 1 -- 172.21.15.150:0/2004802041 --> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] -- mgr_command(tid 0: {"prefix": "fs clone status", "vol_name": "cephfs", "clone_name": "ss1clone1", "target": ["mon-mgr", ""]}) -- 0x7f1e440693e0 con 0x7f1e2807ab10 2024-09-17T05:52:53.677 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:53.677+0000 7f1e39ffb640 1 -- 172.21.15.150:0/2004802041 <== mon.0 v2:172.21.15.150:3300/0 7 ==== mgrmap(e 44) ==== 104450+0+0 (secure 0 0 0) 0x7f1e3c0808e0 con 0x7f1e440cf7c0 2024-09-17T05:52:55.227 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:55.226+0000 7f1e39ffb640 1 -- 172.21.15.150:0/2004802041 <== mgr.4108 v2:172.21.15.176:6800/3631216395 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+243 (secure 0 0 0) 0x7f1e440693e0 con 0x7f1e2807ab10 2024-09-17T05:52:55.227 INFO:teuthology.orchestra.run.smithi150.stdout:{ 2024-09-17T05:52:55.228 INFO:teuthology.orchestra.run.smithi150.stdout: "status": { 2024-09-17T05:52:55.228 INFO:teuthology.orchestra.run.smithi150.stdout: "state": "canceled", 2024-09-17T05:52:55.228 INFO:teuthology.orchestra.run.smithi150.stdout: "source": { 2024-09-17T05:52:55.228 INFO:teuthology.orchestra.run.smithi150.stdout: "volume": "cephfs", 2024-09-17T05:52:55.228 INFO:teuthology.orchestra.run.smithi150.stdout: "subvolume": "sv1", 2024-09-17T05:52:55.228 INFO:teuthology.orchestra.run.smithi150.stdout: "snapshot": "ss1" 2024-09-17T05:52:55.228 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-17T05:52:55.228 INFO:teuthology.orchestra.run.smithi150.stdout: "failure": { 2024-09-17T05:52:55.228 INFO:teuthology.orchestra.run.smithi150.stdout: "errno": "4", 2024-09-17T05:52:55.228 INFO:teuthology.orchestra.run.smithi150.stdout: "error_msg": "user interrupted clone operation" 2024-09-17T05:52:55.228 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-09-17T05:52:55.228 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-09-17T05:52:55.228 INFO:teuthology.orchestra.run.smithi150.stdout:} 2024-09-17T05:52:55.231 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:55.230+0000 7f1e4b3b0640 1 -- 172.21.15.150:0/2004802041 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f1e2807ab10 msgr2=0x7f1e2807d020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:52:55.231 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:55.230+0000 7f1e4b3b0640 1 --2- 172.21.15.150:0/2004802041 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f1e2807ab10 0x7f1e2807d020 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 crypto rx=0x7f1e400099a0 tx=0x7f1e40009500 comp rx=0 tx=0).stop 2024-09-17T05:52:55.231 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:55.230+0000 7f1e4b3b0640 1 -- 172.21.15.150:0/2004802041 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1e440cf7c0 msgr2=0x7f1e44158bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:52:55.231 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:55.230+0000 7f1e4b3b0640 1 --2- 172.21.15.150:0/2004802041 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1e440cf7c0 0x7f1e44158bb0 secure :-1 s=READY pgs=1741 cs=0 l=1 rev1=1 crypto rx=0x7f1e3c02ab00 tx=0x7f1e3c033c20 comp rx=0 tx=0).stop 2024-09-17T05:52:55.231 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:55.230+0000 7f1e4b3b0640 1 -- 172.21.15.150:0/2004802041 shutdown_connections 2024-09-17T05:52:55.231 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:55.230+0000 7f1e4b3b0640 1 --2- 172.21.15.150:0/2004802041 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1e440ccc30 0x7f1e44158670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:52:55.231 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:55.230+0000 7f1e4b3b0640 1 --2- 172.21.15.150:0/2004802041 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f1e2807ab10 0x7f1e2807d020 unknown :-1 s=CLOSED pgs=736 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:52:55.231 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:55.230+0000 7f1e4b3b0640 1 --2- 172.21.15.150:0/2004802041 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1e440cf7c0 0x7f1e44158bb0 unknown :-1 s=CLOSED pgs=1741 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:52:55.231 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:55.230+0000 7f1e4b3b0640 1 --2- 172.21.15.150:0/2004802041 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1e44070290 0x7f1e440aece0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:52:55.232 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:55.230+0000 7f1e4b3b0640 1 -- 172.21.15.150:0/2004802041 >> 172.21.15.150:0/2004802041 conn(0x7f1e4406d1c0 msgr2=0x7f1e440b4fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:52:55.232 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:55.230+0000 7f1e4b3b0640 1 -- 172.21.15.150:0/2004802041 shutdown_connections 2024-09-17T05:52:55.232 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:55.230+0000 7f1e4b3b0640 1 -- 172.21.15.150:0/2004802041 wait complete. 2024-09-17T05:52:55.245 DEBUG:tasks.cephfs.test_volumes:current clone state = canceled 2024-09-17T05:52:55.245 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format json-pretty 2024-09-17T05:52:55.366 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:55.364+0000 7ff15418b640 1 -- 172.21.15.150:0/2469594054 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff14c0d1790 msgr2=0x7ff14c0d0400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:52:55.366 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:55.364+0000 7ff15418b640 1 --2- 172.21.15.150:0/2469594054 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff14c0d1790 0x7ff14c0d0400 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7ff144005fd0 tx=0x7ff14402a8b0 comp rx=0 tx=0).stop 2024-09-17T05:52:55.366 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:55.364+0000 7ff15418b640 1 -- 172.21.15.150:0/2469594054 shutdown_connections 2024-09-17T05:52:55.367 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:55.364+0000 7ff15418b640 1 --2- 172.21.15.150:0/2469594054 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff14c0d1790 0x7ff14c0d0400 unknown :-1 s=CLOSED pgs=587 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:52:55.367 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:55.364+0000 7ff15418b640 1 --2- 172.21.15.150:0/2469594054 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff14c0b5d50 0x7ff14c0d2780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:52:55.367 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:55.364+0000 7ff15418b640 1 -- 172.21.15.150:0/2469594054 >> 172.21.15.150:0/2469594054 conn(0x7ff14c08bfe0 msgr2=0x7ff14c0d4670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:52:55.367 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:55.364+0000 7ff15418b640 1 -- 172.21.15.150:0/2469594054 shutdown_connections 2024-09-17T05:52:55.367 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:55.364+0000 7ff15418b640 1 -- 172.21.15.150:0/2469594054 wait complete. 2024-09-17T05:52:55.371 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:55.366+0000 7ff15418b640 1 Processor -- start 2024-09-17T05:52:55.371 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:55.366+0000 7ff15418b640 1 -- start start 2024-09-17T05:52:55.371 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:55.367+0000 7ff15418b640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff14c0b5d50 0x7ff14c0b1220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:52:55.372 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:55.367+0000 7ff15418b640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff14c0d4f90 0x7ff14c0b4e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:52:55.372 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:55.367+0000 7ff15418b640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff14c160de0 0x7ff14c1611f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:52:55.372 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:55.367+0000 7ff15418b640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7ff14c0b7b00 con 0x7ff14c0b5d50 2024-09-17T05:52:55.372 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:55.367+0000 7ff15418b640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7ff14c0b7980 con 0x7ff14c0d4f90 2024-09-17T05:52:55.372 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:55.367+0000 7ff15418b640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7ff14c0b7c80 con 0x7ff14c160de0 2024-09-17T05:52:55.372 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:55.367+0000 7ff151f27640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff14c0b5d50 0x7ff14c0b1220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:52:55.372 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:55.367+0000 7ff151f27640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff14c0b5d50 0x7ff14c0b1220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:38234/0 (socket says 172.21.15.150:38234) 2024-09-17T05:52:55.372 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:55.367+0000 7ff151f27640 1 -- 172.21.15.150:0/1661987275 learned_addr learned my addr 172.21.15.150:0/1661987275 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:52:55.372 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:55.368+0000 7ff152728640 1 --2- 172.21.15.150:0/1661987275 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff14c160de0 0x7ff14c1611f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:52:55.372 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:55.368+0000 7ff151726640 1 --2- 172.21.15.150:0/1661987275 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff14c0d4f90 0x7ff14c0b4e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:52:55.372 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:55.368+0000 7ff151f27640 1 -- 172.21.15.150:0/1661987275 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff14c160de0 msgr2=0x7ff14c1611f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:52:55.373 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:55.368+0000 7ff151f27640 1 --2- 172.21.15.150:0/1661987275 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff14c160de0 0x7ff14c1611f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:52:55.373 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:55.368+0000 7ff151f27640 1 -- 172.21.15.150:0/1661987275 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff14c0d4f90 msgr2=0x7ff14c0b4e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:52:55.373 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:55.368+0000 7ff151f27640 1 --2- 172.21.15.150:0/1661987275 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff14c0d4f90 0x7ff14c0b4e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:52:55.373 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:55.368+0000 7ff151f27640 1 -- 172.21.15.150:0/1661987275 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff14c161730 con 0x7ff14c0b5d50 2024-09-17T05:52:55.373 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:55.368+0000 7ff151f27640 1 --2- 172.21.15.150:0/1661987275 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff14c0b5d50 0x7ff14c0b1220 secure :-1 s=READY pgs=1742 cs=0 l=1 rev1=1 crypto rx=0x7ff14800ea20 tx=0x7ff14800eee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:52:55.373 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:55.368+0000 7ff1427fc640 1 -- 172.21.15.150:0/1661987275 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff14800ce40 con 0x7ff14c0b5d50 2024-09-17T05:52:55.373 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:55.368+0000 7ff1427fc640 1 -- 172.21.15.150:0/1661987275 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff148004020 con 0x7ff14c0b5d50 2024-09-17T05:52:55.373 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:55.368+0000 7ff15418b640 1 -- 172.21.15.150:0/1661987275 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff14c1f61f0 con 0x7ff14c0b5d50 2024-09-17T05:52:55.373 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:55.368+0000 7ff1427fc640 1 -- 172.21.15.150:0/1661987275 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff148004470 con 0x7ff14c0b5d50 2024-09-17T05:52:55.373 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:55.368+0000 7ff15418b640 1 -- 172.21.15.150:0/1661987275 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff14c1f67b0 con 0x7ff14c0b5d50 2024-09-17T05:52:55.373 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:55.369+0000 7ff15418b640 1 -- 172.21.15.150:0/1661987275 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff14c0d2d60 con 0x7ff14c0b5d50 2024-09-17T05:52:55.373 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:55.370+0000 7ff1427fc640 1 -- 172.21.15.150:0/1661987275 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 44) ==== 104450+0+0 (secure 0 0 0) 0x7ff1480035f0 con 0x7ff14c0b5d50 2024-09-17T05:52:55.373 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:55.370+0000 7ff1427fc640 1 --2- 172.21.15.150:0/1661987275 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7ff13007acf0 0x7ff13007d200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:52:55.374 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:55.371+0000 7ff1427fc640 1 -- 172.21.15.150:0/1661987275 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(129..129 src has 1..129) ==== 5935+0+0 (secure 0 0 0) 0x7ff14809a680 con 0x7ff14c0b5d50 2024-09-17T05:52:55.374 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:55.371+0000 7ff151726640 1 --2- 172.21.15.150:0/1661987275 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7ff13007acf0 0x7ff13007d200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:52:55.374 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:55.371+0000 7ff151726640 1 --2- 172.21.15.150:0/1661987275 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7ff13007acf0 0x7ff13007d200 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 crypto rx=0x7ff14c15b140 tx=0x7ff13c009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:52:55.376 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:55.375+0000 7ff1427fc640 1 -- 172.21.15.150:0/1661987275 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7ff14c161730 con 0x7ff14c0b5d50 2024-09-17T05:52:55.619 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:55.618+0000 7ff15418b640 1 -- 172.21.15.150:0/1661987275 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) -- 0x7ff14c0d1e00 con 0x7ff14c0b5d50 2024-09-17T05:52:55.619 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:55.618+0000 7ff1427fc640 1 -- 172.21.15.150:0/1661987275 <== mon.0 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) ==== 79+0+2829 (secure 0 0 0) 0x7ff148064650 con 0x7ff14c0b5d50 2024-09-17T05:52:55.619 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-09-17T05:52:55.620 INFO:teuthology.orchestra.run.smithi150.stdout:{ 2024-09-17T05:52:55.620 INFO:teuthology.orchestra.run.smithi150.stdout: "fsid": "9f2e05e9-d629-47b3-b26b-1360655b7d20", 2024-09-17T05:52:55.620 INFO:teuthology.orchestra.run.smithi150.stdout: "health": { 2024-09-17T05:52:55.620 INFO:teuthology.orchestra.run.smithi150.stdout: "status": "HEALTH_OK", 2024-09-17T05:52:55.620 INFO:teuthology.orchestra.run.smithi150.stdout: "checks": {}, 2024-09-17T05:52:55.621 INFO:teuthology.orchestra.run.smithi150.stdout: "mutes": [] 2024-09-17T05:52:55.621 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-17T05:52:55.621 INFO:teuthology.orchestra.run.smithi150.stdout: "election_epoch": 4, 2024-09-17T05:52:55.621 INFO:teuthology.orchestra.run.smithi150.stdout: "quorum": [ 2024-09-17T05:52:55.621 INFO:teuthology.orchestra.run.smithi150.stdout: 0, 2024-09-17T05:52:55.621 INFO:teuthology.orchestra.run.smithi150.stdout: 1, 2024-09-17T05:52:55.622 INFO:teuthology.orchestra.run.smithi150.stdout: 2 2024-09-17T05:52:55.622 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2024-09-17T05:52:55.622 INFO:teuthology.orchestra.run.smithi150.stdout: "quorum_names": [ 2024-09-17T05:52:55.622 INFO:teuthology.orchestra.run.smithi150.stdout: "a", 2024-09-17T05:52:55.622 INFO:teuthology.orchestra.run.smithi150.stdout: "b", 2024-09-17T05:52:55.622 INFO:teuthology.orchestra.run.smithi150.stdout: "c" 2024-09-17T05:52:55.623 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2024-09-17T05:52:55.623 INFO:teuthology.orchestra.run.smithi150.stdout: "quorum_age": 683, 2024-09-17T05:52:55.623 INFO:teuthology.orchestra.run.smithi150.stdout: "monmap": { 2024-09-17T05:52:55.623 INFO:teuthology.orchestra.run.smithi150.stdout: "epoch": 1, 2024-09-17T05:52:55.623 INFO:teuthology.orchestra.run.smithi150.stdout: "min_mon_release_name": "squid", 2024-09-17T05:52:55.623 INFO:teuthology.orchestra.run.smithi150.stdout: "num_mons": 3 2024-09-17T05:52:55.624 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-17T05:52:55.624 INFO:teuthology.orchestra.run.smithi150.stdout: "osdmap": { 2024-09-17T05:52:55.624 INFO:teuthology.orchestra.run.smithi150.stdout: "epoch": 129, 2024-09-17T05:52:55.624 INFO:teuthology.orchestra.run.smithi150.stdout: "num_osds": 8, 2024-09-17T05:52:55.624 INFO:teuthology.orchestra.run.smithi150.stdout: "num_up_osds": 8, 2024-09-17T05:52:55.624 INFO:teuthology.orchestra.run.smithi150.stdout: "osd_up_since": 1726551706, 2024-09-17T05:52:55.624 INFO:teuthology.orchestra.run.smithi150.stdout: "num_in_osds": 8, 2024-09-17T05:52:55.625 INFO:teuthology.orchestra.run.smithi150.stdout: "osd_in_since": 1726551696, 2024-09-17T05:52:55.625 INFO:teuthology.orchestra.run.smithi150.stdout: "num_remapped_pgs": 0 2024-09-17T05:52:55.625 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-17T05:52:55.625 INFO:teuthology.orchestra.run.smithi150.stdout: "pgmap": { 2024-09-17T05:52:55.625 INFO:teuthology.orchestra.run.smithi150.stdout: "pgs_by_state": [ 2024-09-17T05:52:55.625 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-09-17T05:52:55.626 INFO:teuthology.orchestra.run.smithi150.stdout: "state_name": "active+clean", 2024-09-17T05:52:55.626 INFO:teuthology.orchestra.run.smithi150.stdout: "count": 97 2024-09-17T05:52:55.626 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-09-17T05:52:55.626 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2024-09-17T05:52:55.626 INFO:teuthology.orchestra.run.smithi150.stdout: "num_pgs": 97, 2024-09-17T05:52:55.626 INFO:teuthology.orchestra.run.smithi150.stdout: "num_pools": 3, 2024-09-17T05:52:55.627 INFO:teuthology.orchestra.run.smithi150.stdout: "num_objects": 797, 2024-09-17T05:52:55.627 INFO:teuthology.orchestra.run.smithi150.stdout: "data_bytes": 3238754611, 2024-09-17T05:52:55.627 INFO:teuthology.orchestra.run.smithi150.stdout: "bytes_used": 7515009024, 2024-09-17T05:52:55.627 INFO:teuthology.orchestra.run.smithi150.stdout: "bytes_avail": 765579104256, 2024-09-17T05:52:55.627 INFO:teuthology.orchestra.run.smithi150.stdout: "bytes_total": 773094113280, 2024-09-17T05:52:55.627 INFO:teuthology.orchestra.run.smithi150.stdout: "recovering_objects_per_sec": 0, 2024-09-17T05:52:55.628 INFO:teuthology.orchestra.run.smithi150.stdout: "recovering_bytes_per_sec": 2445879, 2024-09-17T05:52:55.628 INFO:teuthology.orchestra.run.smithi150.stdout: "recovering_keys_per_sec": 0, 2024-09-17T05:52:55.628 INFO:teuthology.orchestra.run.smithi150.stdout: "num_objects_recovered": 7, 2024-09-17T05:52:55.628 INFO:teuthology.orchestra.run.smithi150.stdout: "num_bytes_recovered": 29360128, 2024-09-17T05:52:55.628 INFO:teuthology.orchestra.run.smithi150.stdout: "num_keys_recovered": 0, 2024-09-17T05:52:55.628 INFO:teuthology.orchestra.run.smithi150.stdout: "read_bytes_sec": 1048233, 2024-09-17T05:52:55.628 INFO:teuthology.orchestra.run.smithi150.stdout: "write_bytes_sec": 210005659, 2024-09-17T05:52:55.629 INFO:teuthology.orchestra.run.smithi150.stdout: "read_op_per_sec": 0, 2024-09-17T05:52:55.629 INFO:teuthology.orchestra.run.smithi150.stdout: "write_op_per_sec": 53 2024-09-17T05:52:55.629 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-17T05:52:55.629 INFO:teuthology.orchestra.run.smithi150.stdout: "fsmap": { 2024-09-17T05:52:55.629 INFO:teuthology.orchestra.run.smithi150.stdout: "epoch": 81, 2024-09-17T05:52:55.629 INFO:teuthology.orchestra.run.smithi150.stdout: "btime": "2024-09-17T05:52:32:156241+0000", 2024-09-17T05:52:55.629 INFO:teuthology.orchestra.run.smithi150.stdout: "id": 9, 2024-09-17T05:52:55.629 INFO:teuthology.orchestra.run.smithi150.stdout: "up": 1, 2024-09-17T05:52:55.629 INFO:teuthology.orchestra.run.smithi150.stdout: "in": 1, 2024-09-17T05:52:55.629 INFO:teuthology.orchestra.run.smithi150.stdout: "max": 1, 2024-09-17T05:52:55.629 INFO:teuthology.orchestra.run.smithi150.stdout: "by_rank": [ 2024-09-17T05:52:55.629 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-09-17T05:52:55.630 INFO:teuthology.orchestra.run.smithi150.stdout: "filesystem_id": 9, 2024-09-17T05:52:55.630 INFO:teuthology.orchestra.run.smithi150.stdout: "rank": 0, 2024-09-17T05:52:55.630 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "d", 2024-09-17T05:52:55.630 INFO:teuthology.orchestra.run.smithi150.stdout: "status": "up:active", 2024-09-17T05:52:55.630 INFO:teuthology.orchestra.run.smithi150.stdout: "gid": 9141 2024-09-17T05:52:55.630 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-09-17T05:52:55.630 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2024-09-17T05:52:55.630 INFO:teuthology.orchestra.run.smithi150.stdout: "up:standby": 3 2024-09-17T05:52:55.630 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-17T05:52:55.630 INFO:teuthology.orchestra.run.smithi150.stdout: "mgrmap": { 2024-09-17T05:52:55.630 INFO:teuthology.orchestra.run.smithi150.stdout: "available": true, 2024-09-17T05:52:55.630 INFO:teuthology.orchestra.run.smithi150.stdout: "num_standbys": 1, 2024-09-17T05:52:55.630 INFO:teuthology.orchestra.run.smithi150.stdout: "modules": [ 2024-09-17T05:52:55.630 INFO:teuthology.orchestra.run.smithi150.stdout: "iostat", 2024-09-17T05:52:55.631 INFO:teuthology.orchestra.run.smithi150.stdout: "nfs", 2024-09-17T05:52:55.631 INFO:teuthology.orchestra.run.smithi150.stdout: "restful" 2024-09-17T05:52:55.631 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2024-09-17T05:52:55.631 INFO:teuthology.orchestra.run.smithi150.stdout: "services": {} 2024-09-17T05:52:55.631 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-17T05:52:55.631 INFO:teuthology.orchestra.run.smithi150.stdout: "servicemap": { 2024-09-17T05:52:55.631 INFO:teuthology.orchestra.run.smithi150.stdout: "epoch": 18, 2024-09-17T05:52:55.631 INFO:teuthology.orchestra.run.smithi150.stdout: "modified": "2024-09-17T05:52:13.076074+0000", 2024-09-17T05:52:55.631 INFO:teuthology.orchestra.run.smithi150.stdout: "services": { 2024-09-17T05:52:55.631 INFO:teuthology.orchestra.run.smithi150.stdout: "mds": { 2024-09-17T05:52:55.631 INFO:teuthology.orchestra.run.smithi150.stdout: "daemons": { 2024-09-17T05:52:55.632 INFO:teuthology.orchestra.run.smithi150.stdout: "summary": "", 2024-09-17T05:52:55.632 INFO:teuthology.orchestra.run.smithi150.stdout: "c": { 2024-09-17T05:52:55.632 INFO:teuthology.orchestra.run.smithi150.stdout: "start_epoch": 0, 2024-09-17T05:52:55.632 INFO:teuthology.orchestra.run.smithi150.stdout: "start_stamp": "0.000000", 2024-09-17T05:52:55.632 INFO:teuthology.orchestra.run.smithi150.stdout: "gid": 0, 2024-09-17T05:52:55.632 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "(unrecognized address family 0)/0", 2024-09-17T05:52:55.632 INFO:teuthology.orchestra.run.smithi150.stdout: "metadata": {}, 2024-09-17T05:52:55.632 INFO:teuthology.orchestra.run.smithi150.stdout: "task_status": {} 2024-09-17T05:52:55.632 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-09-17T05:52:55.633 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-09-17T05:52:55.633 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-09-17T05:52:55.633 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-09-17T05:52:55.633 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-17T05:52:55.633 INFO:teuthology.orchestra.run.smithi150.stdout: "progress_events": { 2024-09-17T05:52:55.633 INFO:teuthology.orchestra.run.smithi150.stdout: "mgr-vol-ongoing-clones": { 2024-09-17T05:52:55.633 INFO:teuthology.orchestra.run.smithi150.stdout: "message": "1 ongoing clones - average progress is 0.0% (0s)\n [............................] ", 2024-09-17T05:52:55.634 INFO:teuthology.orchestra.run.smithi150.stdout: "progress": 0, 2024-09-17T05:52:55.634 INFO:teuthology.orchestra.run.smithi150.stdout: "add_to_ceph_s": true 2024-09-17T05:52:55.634 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-09-17T05:52:55.634 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-09-17T05:52:55.634 INFO:teuthology.orchestra.run.smithi150.stdout:} 2024-09-17T05:52:55.637 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:55.620+0000 7ff15418b640 1 -- 172.21.15.150:0/1661987275 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7ff13007acf0 msgr2=0x7ff13007d200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:52:55.637 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:55.620+0000 7ff15418b640 1 --2- 172.21.15.150:0/1661987275 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7ff13007acf0 0x7ff13007d200 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 crypto rx=0x7ff14c15b140 tx=0x7ff13c009040 comp rx=0 tx=0).stop 2024-09-17T05:52:55.638 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:55.620+0000 7ff15418b640 1 -- 172.21.15.150:0/1661987275 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff14c0b5d50 msgr2=0x7ff14c0b1220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:52:55.638 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:55.620+0000 7ff15418b640 1 --2- 172.21.15.150:0/1661987275 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff14c0b5d50 0x7ff14c0b1220 secure :-1 s=READY pgs=1742 cs=0 l=1 rev1=1 crypto rx=0x7ff14800ea20 tx=0x7ff14800eee0 comp rx=0 tx=0).stop 2024-09-17T05:52:55.638 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:55.620+0000 7ff15418b640 1 -- 172.21.15.150:0/1661987275 shutdown_connections 2024-09-17T05:52:55.638 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:55.620+0000 7ff15418b640 1 --2- 172.21.15.150:0/1661987275 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff14c0d4f90 0x7ff14c0b4e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:52:55.638 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:55.620+0000 7ff15418b640 1 --2- 172.21.15.150:0/1661987275 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7ff13007acf0 0x7ff13007d200 unknown :-1 s=CLOSED pgs=737 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:52:55.638 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:55.620+0000 7ff15418b640 1 --2- 172.21.15.150:0/1661987275 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff14c160de0 0x7ff14c1611f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:52:55.639 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:55.620+0000 7ff15418b640 1 --2- 172.21.15.150:0/1661987275 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff14c0b5d50 0x7ff14c0b1220 unknown :-1 s=CLOSED pgs=1742 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:52:55.639 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:55.620+0000 7ff15418b640 1 -- 172.21.15.150:0/1661987275 >> 172.21.15.150:0/1661987275 conn(0x7ff14c08bfe0 msgr2=0x7ff14c15ec40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:52:55.639 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:55.620+0000 7ff15418b640 1 -- 172.21.15.150:0/1661987275 shutdown_connections 2024-09-17T05:52:55.639 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:55.620+0000 7ff15418b640 1 -- 172.21.15.150:0/1661987275 wait complete. 2024-09-17T05:52:56.141 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format json-pretty 2024-09-17T05:52:56.254 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:56.253+0000 7f762c64d640 1 -- 172.21.15.150:0/1640718089 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f76240cf7c0 msgr2=0x7f76240cfbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:52:56.254 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:56.253+0000 7f762c64d640 1 --2- 172.21.15.150:0/1640718089 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f76240cf7c0 0x7f76240cfbd0 secure :-1 s=READY pgs=1743 cs=0 l=1 rev1=1 crypto rx=0x7f76240cef60 tx=0x7f761402a560 comp rx=0 tx=0).stop 2024-09-17T05:52:56.254 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:56.253+0000 7f762c64d640 1 -- 172.21.15.150:0/1640718089 shutdown_connections 2024-09-17T05:52:56.254 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:56.253+0000 7f762c64d640 1 --2- 172.21.15.150:0/1640718089 >> v2:172.21.15.176:3300/0 conn(0x7f76240b0e20 0x7f76240b1230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:52:56.254 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:56.253+0000 7f762c64d640 1 --2- 172.21.15.150:0/1640718089 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f76240cf7c0 0x7f76240cfbd0 unknown :-1 s=CLOSED pgs=1743 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:52:56.254 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:56.253+0000 7f762c64d640 1 --2- 172.21.15.150:0/1640718089 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f762415ee30 0x7f76240b2840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:52:56.255 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:56.253+0000 7f762c64d640 1 -- 172.21.15.150:0/1640718089 >> 172.21.15.150:0/1640718089 conn(0x7f76240b2fd0 msgr2=0x7f76240b33e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:52:56.255 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:56.253+0000 7f762c64d640 1 -- 172.21.15.150:0/1640718089 shutdown_connections 2024-09-17T05:52:56.255 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:56.253+0000 7f762c64d640 1 -- 172.21.15.150:0/1640718089 wait complete. 2024-09-17T05:52:56.256 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:56.255+0000 7f762c64d640 1 Processor -- start 2024-09-17T05:52:56.256 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:56.255+0000 7f762c64d640 1 -- start start 2024-09-17T05:52:56.259 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:56.256+0000 7f762c64d640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f76240b0e20 0x7f762409edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:52:56.259 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:56.256+0000 7f762c64d640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f76240cf7c0 0x7f7624157800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:52:56.259 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:56.256+0000 7f762c64d640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f762415ee30 0x7f76240ce000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:52:56.260 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:56.256+0000 7f762c64d640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f76240b1b00 con 0x7f76240b0e20 2024-09-17T05:52:56.260 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:56.256+0000 7f762c64d640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f76240b1980 con 0x7f76240cf7c0 2024-09-17T05:52:56.260 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:56.256+0000 7f762c64d640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f76240b1c80 con 0x7f762415ee30 2024-09-17T05:52:56.260 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:56.256+0000 7f762a3e9640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f76240b0e20 0x7f762409edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:52:56.260 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:56.256+0000 7f762a3e9640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f76240b0e20 0x7f762409edb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:38248/0 (socket says 172.21.15.150:38248) 2024-09-17T05:52:56.260 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:56.256+0000 7f762a3e9640 1 -- 172.21.15.150:0/4205644131 learned_addr learned my addr 172.21.15.150:0/4205644131 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:52:56.260 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:56.256+0000 7f762abea640 1 --2- 172.21.15.150:0/4205644131 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f762415ee30 0x7f76240ce000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:52:56.260 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:56.256+0000 7f7629be8640 1 --2- 172.21.15.150:0/4205644131 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f76240cf7c0 0x7f7624157800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:52:56.260 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:56.256+0000 7f762a3e9640 1 -- 172.21.15.150:0/4205644131 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f762415ee30 msgr2=0x7f76240ce000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:52:56.261 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:56.256+0000 7f762a3e9640 1 --2- 172.21.15.150:0/4205644131 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f762415ee30 0x7f76240ce000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:52:56.261 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:56.256+0000 7f762a3e9640 1 -- 172.21.15.150:0/4205644131 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f76240cf7c0 msgr2=0x7f7624157800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:52:56.261 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:56.256+0000 7f762a3e9640 1 --2- 172.21.15.150:0/4205644131 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f76240cf7c0 0x7f7624157800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:52:56.261 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:56.256+0000 7f762a3e9640 1 -- 172.21.15.150:0/4205644131 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f76241f6bf0 con 0x7f76240b0e20 2024-09-17T05:52:56.261 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:56.256+0000 7f7629be8640 1 --2- 172.21.15.150:0/4205644131 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f76240cf7c0 0x7f7624157800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:52:56.261 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:56.257+0000 7f762a3e9640 1 --2- 172.21.15.150:0/4205644131 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f76240b0e20 0x7f762409edb0 secure :-1 s=READY pgs=1744 cs=0 l=1 rev1=1 crypto rx=0x7f762000d750 tx=0x7f762000dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:52:56.261 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:56.257+0000 7f761affd640 1 -- 172.21.15.150:0/4205644131 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7620017070 con 0x7f76240b0e20 2024-09-17T05:52:56.261 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:56.257+0000 7f761affd640 1 -- 172.21.15.150:0/4205644131 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f7620009b20 con 0x7f76240b0e20 2024-09-17T05:52:56.261 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:56.257+0000 7f762c64d640 1 -- 172.21.15.150:0/4205644131 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f76241f6e90 con 0x7f76240b0e20 2024-09-17T05:52:56.261 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:56.257+0000 7f761affd640 1 -- 172.21.15.150:0/4205644131 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7620010460 con 0x7f76240b0e20 2024-09-17T05:52:56.261 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:56.257+0000 7f762c64d640 1 -- 172.21.15.150:0/4205644131 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f76240afe80 con 0x7f76240b0e20 2024-09-17T05:52:56.261 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:56.258+0000 7f762c64d640 1 -- 172.21.15.150:0/4205644131 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f76240cfbd0 con 0x7f76240b0e20 2024-09-17T05:52:56.261 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:56.258+0000 7f761affd640 1 -- 172.21.15.150:0/4205644131 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 44) ==== 104450+0+0 (secure 0 0 0) 0x7f762001a070 con 0x7f76240b0e20 2024-09-17T05:52:56.262 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:56.259+0000 7f761affd640 1 --2- 172.21.15.150:0/4205644131 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f760807acf0 0x7f760807d200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:52:56.262 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:56.259+0000 7f761affd640 1 -- 172.21.15.150:0/4205644131 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(129..129 src has 1..129) ==== 5935+0+0 (secure 0 0 0) 0x7f7620099fe0 con 0x7f76240b0e20 2024-09-17T05:52:56.262 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:56.259+0000 7f7629be8640 1 --2- 172.21.15.150:0/4205644131 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f760807acf0 0x7f760807d200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:52:56.262 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:56.260+0000 7f7629be8640 1 --2- 172.21.15.150:0/4205644131 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f760807acf0 0x7f760807d200 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 crypto rx=0x7f7614033000 tx=0x7f7614004730 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:52:56.264 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:56.263+0000 7f761affd640 1 -- 172.21.15.150:0/4205644131 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f7620063ea0 con 0x7f76240b0e20 2024-09-17T05:52:56.508 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:56.507+0000 7f762c64d640 1 -- 172.21.15.150:0/4205644131 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) -- 0x7f762415e440 con 0x7f76240b0e20 2024-09-17T05:52:56.509 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:56.508+0000 7f761affd640 1 -- 172.21.15.150:0/4205644131 <== mon.0 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) ==== 79+0+2604 (secure 0 0 0) 0x7f76200637a0 con 0x7f76240b0e20 2024-09-17T05:52:56.509 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-09-17T05:52:56.509 INFO:teuthology.orchestra.run.smithi150.stdout:{ 2024-09-17T05:52:56.509 INFO:teuthology.orchestra.run.smithi150.stdout: "fsid": "9f2e05e9-d629-47b3-b26b-1360655b7d20", 2024-09-17T05:52:56.509 INFO:teuthology.orchestra.run.smithi150.stdout: "health": { 2024-09-17T05:52:56.509 INFO:teuthology.orchestra.run.smithi150.stdout: "status": "HEALTH_OK", 2024-09-17T05:52:56.509 INFO:teuthology.orchestra.run.smithi150.stdout: "checks": {}, 2024-09-17T05:52:56.509 INFO:teuthology.orchestra.run.smithi150.stdout: "mutes": [] 2024-09-17T05:52:56.510 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-17T05:52:56.510 INFO:teuthology.orchestra.run.smithi150.stdout: "election_epoch": 4, 2024-09-17T05:52:56.510 INFO:teuthology.orchestra.run.smithi150.stdout: "quorum": [ 2024-09-17T05:52:56.510 INFO:teuthology.orchestra.run.smithi150.stdout: 0, 2024-09-17T05:52:56.510 INFO:teuthology.orchestra.run.smithi150.stdout: 1, 2024-09-17T05:52:56.510 INFO:teuthology.orchestra.run.smithi150.stdout: 2 2024-09-17T05:52:56.510 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2024-09-17T05:52:56.510 INFO:teuthology.orchestra.run.smithi150.stdout: "quorum_names": [ 2024-09-17T05:52:56.510 INFO:teuthology.orchestra.run.smithi150.stdout: "a", 2024-09-17T05:52:56.510 INFO:teuthology.orchestra.run.smithi150.stdout: "b", 2024-09-17T05:52:56.510 INFO:teuthology.orchestra.run.smithi150.stdout: "c" 2024-09-17T05:52:56.510 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2024-09-17T05:52:56.511 INFO:teuthology.orchestra.run.smithi150.stdout: "quorum_age": 684, 2024-09-17T05:52:56.511 INFO:teuthology.orchestra.run.smithi150.stdout: "monmap": { 2024-09-17T05:52:56.511 INFO:teuthology.orchestra.run.smithi150.stdout: "epoch": 1, 2024-09-17T05:52:56.511 INFO:teuthology.orchestra.run.smithi150.stdout: "min_mon_release_name": "squid", 2024-09-17T05:52:56.511 INFO:teuthology.orchestra.run.smithi150.stdout: "num_mons": 3 2024-09-17T05:52:56.511 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-17T05:52:56.511 INFO:teuthology.orchestra.run.smithi150.stdout: "osdmap": { 2024-09-17T05:52:56.511 INFO:teuthology.orchestra.run.smithi150.stdout: "epoch": 129, 2024-09-17T05:52:56.511 INFO:teuthology.orchestra.run.smithi150.stdout: "num_osds": 8, 2024-09-17T05:52:56.511 INFO:teuthology.orchestra.run.smithi150.stdout: "num_up_osds": 8, 2024-09-17T05:52:56.511 INFO:teuthology.orchestra.run.smithi150.stdout: "osd_up_since": 1726551706, 2024-09-17T05:52:56.511 INFO:teuthology.orchestra.run.smithi150.stdout: "num_in_osds": 8, 2024-09-17T05:52:56.511 INFO:teuthology.orchestra.run.smithi150.stdout: "osd_in_since": 1726551696, 2024-09-17T05:52:56.512 INFO:teuthology.orchestra.run.smithi150.stdout: "num_remapped_pgs": 0 2024-09-17T05:52:56.512 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-17T05:52:56.512 INFO:teuthology.orchestra.run.smithi150.stdout: "pgmap": { 2024-09-17T05:52:56.512 INFO:teuthology.orchestra.run.smithi150.stdout: "pgs_by_state": [ 2024-09-17T05:52:56.512 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-09-17T05:52:56.512 INFO:teuthology.orchestra.run.smithi150.stdout: "state_name": "active+clean", 2024-09-17T05:52:56.512 INFO:teuthology.orchestra.run.smithi150.stdout: "count": 97 2024-09-17T05:52:56.512 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-09-17T05:52:56.512 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2024-09-17T05:52:56.512 INFO:teuthology.orchestra.run.smithi150.stdout: "num_pgs": 97, 2024-09-17T05:52:56.512 INFO:teuthology.orchestra.run.smithi150.stdout: "num_pools": 3, 2024-09-17T05:52:56.512 INFO:teuthology.orchestra.run.smithi150.stdout: "num_objects": 856, 2024-09-17T05:52:56.512 INFO:teuthology.orchestra.run.smithi150.stdout: "data_bytes": 3461198178, 2024-09-17T05:52:56.513 INFO:teuthology.orchestra.run.smithi150.stdout: "bytes_used": 7905259520, 2024-09-17T05:52:56.513 INFO:teuthology.orchestra.run.smithi150.stdout: "bytes_avail": 765188853760, 2024-09-17T05:52:56.513 INFO:teuthology.orchestra.run.smithi150.stdout: "bytes_total": 773094113280, 2024-09-17T05:52:56.513 INFO:teuthology.orchestra.run.smithi150.stdout: "recovering_objects_per_sec": 0, 2024-09-17T05:52:56.513 INFO:teuthology.orchestra.run.smithi150.stdout: "recovering_bytes_per_sec": 2445903, 2024-09-17T05:52:56.513 INFO:teuthology.orchestra.run.smithi150.stdout: "recovering_keys_per_sec": 0, 2024-09-17T05:52:56.513 INFO:teuthology.orchestra.run.smithi150.stdout: "num_objects_recovered": 7, 2024-09-17T05:52:56.513 INFO:teuthology.orchestra.run.smithi150.stdout: "num_bytes_recovered": 29360128, 2024-09-17T05:52:56.513 INFO:teuthology.orchestra.run.smithi150.stdout: "num_keys_recovered": 0, 2024-09-17T05:52:56.513 INFO:teuthology.orchestra.run.smithi150.stdout: "read_bytes_sec": 19218499, 2024-09-17T05:52:56.513 INFO:teuthology.orchestra.run.smithi150.stdout: "write_bytes_sec": 182068343, 2024-09-17T05:52:56.513 INFO:teuthology.orchestra.run.smithi150.stdout: "read_op_per_sec": 5, 2024-09-17T05:52:56.513 INFO:teuthology.orchestra.run.smithi150.stdout: "write_op_per_sec": 49 2024-09-17T05:52:56.514 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-17T05:52:56.514 INFO:teuthology.orchestra.run.smithi150.stdout: "fsmap": { 2024-09-17T05:52:56.514 INFO:teuthology.orchestra.run.smithi150.stdout: "epoch": 81, 2024-09-17T05:52:56.514 INFO:teuthology.orchestra.run.smithi150.stdout: "btime": "2024-09-17T05:52:32:156241+0000", 2024-09-17T05:52:56.514 INFO:teuthology.orchestra.run.smithi150.stdout: "id": 9, 2024-09-17T05:52:56.514 INFO:teuthology.orchestra.run.smithi150.stdout: "up": 1, 2024-09-17T05:52:56.514 INFO:teuthology.orchestra.run.smithi150.stdout: "in": 1, 2024-09-17T05:52:56.514 INFO:teuthology.orchestra.run.smithi150.stdout: "max": 1, 2024-09-17T05:52:56.514 INFO:teuthology.orchestra.run.smithi150.stdout: "by_rank": [ 2024-09-17T05:52:56.514 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-09-17T05:52:56.514 INFO:teuthology.orchestra.run.smithi150.stdout: "filesystem_id": 9, 2024-09-17T05:52:56.514 INFO:teuthology.orchestra.run.smithi150.stdout: "rank": 0, 2024-09-17T05:52:56.514 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "d", 2024-09-17T05:52:56.515 INFO:teuthology.orchestra.run.smithi150.stdout: "status": "up:active", 2024-09-17T05:52:56.515 INFO:teuthology.orchestra.run.smithi150.stdout: "gid": 9141 2024-09-17T05:52:56.515 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-09-17T05:52:56.515 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2024-09-17T05:52:56.515 INFO:teuthology.orchestra.run.smithi150.stdout: "up:standby": 3 2024-09-17T05:52:56.515 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-17T05:52:56.515 INFO:teuthology.orchestra.run.smithi150.stdout: "mgrmap": { 2024-09-17T05:52:56.515 INFO:teuthology.orchestra.run.smithi150.stdout: "available": true, 2024-09-17T05:52:56.515 INFO:teuthology.orchestra.run.smithi150.stdout: "num_standbys": 1, 2024-09-17T05:52:56.515 INFO:teuthology.orchestra.run.smithi150.stdout: "modules": [ 2024-09-17T05:52:56.515 INFO:teuthology.orchestra.run.smithi150.stdout: "iostat", 2024-09-17T05:52:56.516 INFO:teuthology.orchestra.run.smithi150.stdout: "nfs", 2024-09-17T05:52:56.516 INFO:teuthology.orchestra.run.smithi150.stdout: "restful" 2024-09-17T05:52:56.516 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2024-09-17T05:52:56.516 INFO:teuthology.orchestra.run.smithi150.stdout: "services": {} 2024-09-17T05:52:56.516 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-17T05:52:56.516 INFO:teuthology.orchestra.run.smithi150.stdout: "servicemap": { 2024-09-17T05:52:56.516 INFO:teuthology.orchestra.run.smithi150.stdout: "epoch": 18, 2024-09-17T05:52:56.516 INFO:teuthology.orchestra.run.smithi150.stdout: "modified": "2024-09-17T05:52:13.076074+0000", 2024-09-17T05:52:56.516 INFO:teuthology.orchestra.run.smithi150.stdout: "services": { 2024-09-17T05:52:56.516 INFO:teuthology.orchestra.run.smithi150.stdout: "mds": { 2024-09-17T05:52:56.516 INFO:teuthology.orchestra.run.smithi150.stdout: "daemons": { 2024-09-17T05:52:56.516 INFO:teuthology.orchestra.run.smithi150.stdout: "summary": "", 2024-09-17T05:52:56.517 INFO:teuthology.orchestra.run.smithi150.stdout: "c": { 2024-09-17T05:52:56.517 INFO:teuthology.orchestra.run.smithi150.stdout: "start_epoch": 0, 2024-09-17T05:52:56.517 INFO:teuthology.orchestra.run.smithi150.stdout: "start_stamp": "0.000000", 2024-09-17T05:52:56.517 INFO:teuthology.orchestra.run.smithi150.stdout: "gid": 0, 2024-09-17T05:52:56.517 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "(unrecognized address family 0)/0", 2024-09-17T05:52:56.517 INFO:teuthology.orchestra.run.smithi150.stdout: "metadata": {}, 2024-09-17T05:52:56.517 INFO:teuthology.orchestra.run.smithi150.stdout: "task_status": {} 2024-09-17T05:52:56.517 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-09-17T05:52:56.517 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-09-17T05:52:56.517 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-09-17T05:52:56.517 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-09-17T05:52:56.517 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-17T05:52:56.517 INFO:teuthology.orchestra.run.smithi150.stdout: "progress_events": {} 2024-09-17T05:52:56.518 INFO:teuthology.orchestra.run.smithi150.stdout:} 2024-09-17T05:52:56.518 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:56.510+0000 7f762c64d640 1 -- 172.21.15.150:0/4205644131 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f760807acf0 msgr2=0x7f760807d200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:52:56.518 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:56.510+0000 7f762c64d640 1 --2- 172.21.15.150:0/4205644131 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f760807acf0 0x7f760807d200 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 crypto rx=0x7f7614033000 tx=0x7f7614004730 comp rx=0 tx=0).stop 2024-09-17T05:52:56.519 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:56.510+0000 7f762c64d640 1 -- 172.21.15.150:0/4205644131 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f76240b0e20 msgr2=0x7f762409edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:52:56.519 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:56.510+0000 7f762c64d640 1 --2- 172.21.15.150:0/4205644131 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f76240b0e20 0x7f762409edb0 secure :-1 s=READY pgs=1744 cs=0 l=1 rev1=1 crypto rx=0x7f762000d750 tx=0x7f762000dc10 comp rx=0 tx=0).stop 2024-09-17T05:52:56.519 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:56.510+0000 7f762c64d640 1 -- 172.21.15.150:0/4205644131 shutdown_connections 2024-09-17T05:52:56.519 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:56.510+0000 7f762c64d640 1 --2- 172.21.15.150:0/4205644131 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f76240cf7c0 0x7f7624157800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:52:56.519 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:56.510+0000 7f762c64d640 1 --2- 172.21.15.150:0/4205644131 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f760807acf0 0x7f760807d200 unknown :-1 s=CLOSED pgs=738 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:52:56.519 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:56.510+0000 7f762c64d640 1 --2- 172.21.15.150:0/4205644131 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f762415ee30 0x7f76240ce000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:52:56.519 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:56.510+0000 7f762c64d640 1 --2- 172.21.15.150:0/4205644131 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f76240b0e20 0x7f762409edb0 unknown :-1 s=CLOSED pgs=1744 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:52:56.519 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:56.510+0000 7f762c64d640 1 -- 172.21.15.150:0/4205644131 >> 172.21.15.150:0/4205644131 conn(0x7f76240b2fd0 msgr2=0x7f762415bbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:52:56.519 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:56.510+0000 7f762c64d640 1 -- 172.21.15.150:0/4205644131 shutdown_connections 2024-09-17T05:52:56.519 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:56.510+0000 7f762c64d640 1 -- 172.21.15.150:0/4205644131 wait complete. 2024-09-17T05:52:56.525 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:52:56.525 DEBUG:teuthology.orchestra.run.smithi150:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls -lh volumes/_nogroup/ss1clone1/1bc3ddb5-d4ca-4f40-9c35-676acc146be9 2024-09-17T05:52:56.525 DEBUG:teuthology.orchestra.run.smithi150:> ) 2024-09-17T05:52:56.542 DEBUG:teuthology.orchestra.run:got remote process result: 2 2024-09-17T05:52:56.542 INFO:teuthology.orchestra.run.smithi150.stderr:ls: cannot access 'volumes/_nogroup/ss1clone1/1bc3ddb5-d4ca-4f40-9c35-676acc146be9': No such file or directory 2024-09-17T05:52:56.543 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume ls 2024-09-17T05:52:56.697 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:56.696+0000 7fc30c14a640 1 -- 172.21.15.150:0/2385962644 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc2f0003a30 msgr2=0x7fc2f0003ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:52:56.698 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:56.696+0000 7fc30c14a640 1 --2- 172.21.15.150:0/2385962644 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc2f0003a30 0x7fc2f0003ea0 secure :-1 s=READY pgs=1746 cs=0 l=1 rev1=1 crypto rx=0x7fc300001710 tx=0x7fc2f0005830 comp rx=0 tx=0).stop 2024-09-17T05:52:56.698 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:56.696+0000 7fc30a6e7640 1 -- 172.21.15.150:0/2385962644 reap_dead start 2024-09-17T05:52:56.698 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:56.696+0000 7fc30c14a640 1 -- 172.21.15.150:0/2385962644 shutdown_connections 2024-09-17T05:52:56.698 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:56.696+0000 7fc30c14a640 1 -- 172.21.15.150:0/2385962644 >> 172.21.15.150:0/2385962644 conn(0x7fc3040d4680 msgr2=0x7fc3040d4a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:52:56.698 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:56.696+0000 7fc30c14a640 1 -- 172.21.15.150:0/2385962644 shutdown_connections 2024-09-17T05:52:56.698 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:56.696+0000 7fc30c14a640 1 -- 172.21.15.150:0/2385962644 wait complete. 2024-09-17T05:52:56.699 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:56.698+0000 7fc30c14a640 1 Processor -- start 2024-09-17T05:52:56.699 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:56.698+0000 7fc30c14a640 1 -- start start 2024-09-17T05:52:56.701 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:56.699+0000 7fc30c14a640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc2f0003a30 0x7fc3040b8550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:52:56.701 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:56.699+0000 7fc30c14a640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc3040b4040 0x7fc3041610a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:52:56.701 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:56.699+0000 7fc30c14a640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc3041f62b0 0x7fc3041f66c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:52:56.701 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:56.700+0000 7fc30c14a640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7fc3040cfb80 con 0x7fc2f0003a30 2024-09-17T05:52:56.702 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:56.700+0000 7fc30c14a640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fc3040cfd00 con 0x7fc3040b4040 2024-09-17T05:52:56.702 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:56.700+0000 7fc30c14a640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fc3040cfe80 con 0x7fc3041f62b0 2024-09-17T05:52:56.702 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:56.700+0000 7fc309ee6640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc2f0003a30 0x7fc3040b8550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:52:56.702 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:56.700+0000 7fc309ee6640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc2f0003a30 0x7fc3040b8550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:38260/0 (socket says 172.21.15.150:38260) 2024-09-17T05:52:56.702 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:56.700+0000 7fc309ee6640 1 -- 172.21.15.150:0/3932689880 learned_addr learned my addr 172.21.15.150:0/3932689880 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:52:56.702 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:56.700+0000 7fc309ee6640 1 -- 172.21.15.150:0/3932689880 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc3041f62b0 msgr2=0x7fc3041f66c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:52:56.702 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:56.700+0000 7fc309ee6640 1 --2- 172.21.15.150:0/3932689880 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc3041f62b0 0x7fc3041f66c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:52:56.702 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:56.700+0000 7fc309ee6640 1 -- 172.21.15.150:0/3932689880 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc3040b4040 msgr2=0x7fc3041610a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:52:56.702 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:56.700+0000 7fc309ee6640 1 --2- 172.21.15.150:0/3932689880 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc3040b4040 0x7fc3041610a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:52:56.702 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:56.700+0000 7fc309ee6640 1 -- 172.21.15.150:0/3932689880 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc3041f6c00 con 0x7fc2f0003a30 2024-09-17T05:52:56.702 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:56.700+0000 7fc309ee6640 1 --2- 172.21.15.150:0/3932689880 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc2f0003a30 0x7fc3040b8550 secure :-1 s=READY pgs=1747 cs=0 l=1 rev1=1 crypto rx=0x7fc30002a930 tx=0x7fc300006290 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:52:56.702 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:56.700+0000 7fc2fa7fc640 1 -- 172.21.15.150:0/3932689880 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc300038070 con 0x7fc2f0003a30 2024-09-17T05:52:56.703 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:56.700+0000 7fc2fa7fc640 1 -- 172.21.15.150:0/3932689880 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc300003930 con 0x7fc2f0003a30 2024-09-17T05:52:56.703 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:56.700+0000 7fc2fa7fc640 1 -- 172.21.15.150:0/3932689880 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc300003d80 con 0x7fc2f0003a30 2024-09-17T05:52:56.703 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:56.700+0000 7fc30c14a640 1 -- 172.21.15.150:0/3932689880 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc3041f9830 con 0x7fc2f0003a30 2024-09-17T05:52:56.703 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:56.700+0000 7fc30c14a640 1 -- 172.21.15.150:0/3932689880 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc3041f9df0 con 0x7fc2f0003a30 2024-09-17T05:52:56.704 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:56.701+0000 7fc30c14a640 1 -- 172.21.15.150:0/3932689880 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc30408d100 con 0x7fc2f0003a30 2024-09-17T05:52:56.704 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:56.702+0000 7fc2fa7fc640 1 -- 172.21.15.150:0/3932689880 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 44) ==== 104450+0+0 (secure 0 0 0) 0x7fc300030070 con 0x7fc2f0003a30 2024-09-17T05:52:56.704 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:56.702+0000 7fc2fa7fc640 1 --2- 172.21.15.150:0/3932689880 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fc2e807acc0 0x7fc2e807d1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:52:56.704 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:56.703+0000 7fc2fa7fc640 1 -- 172.21.15.150:0/3932689880 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(129..129 src has 1..129) ==== 5935+0+0 (secure 0 0 0) 0x7fc3000b9a30 con 0x7fc2f0003a30 2024-09-17T05:52:56.704 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:56.703+0000 7fc3096e5640 1 --2- 172.21.15.150:0/3932689880 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fc2e807acc0 0x7fc2e807d1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:52:56.704 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:56.703+0000 7fc3096e5640 1 --2- 172.21.15.150:0/3932689880 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fc2e807acc0 0x7fc2e807d1d0 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 crypto rx=0x7fc30406e7c0 tx=0x7fc2f4009dd0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:52:56.707 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:56.707+0000 7fc2fa7fc640 1 -- 172.21.15.150:0/3932689880 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fc30408d100 con 0x7fc2f0003a30 2024-09-17T05:52:56.904 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:56.903+0000 7fc30c14a640 1 -- 172.21.15.150:0/3932689880 --> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] -- mgr_command(tid 0: {"prefix": "fs volume ls", "target": ["mon-mgr", ""]}) -- 0x7fc3040d0410 con 0x7fc2e807acc0 2024-09-17T05:52:56.906 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:56.905+0000 7fc2fa7fc640 1 -- 172.21.15.150:0/3932689880 <== mgr.4108 v2:172.21.15.176:6800/3631216395 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+41 (secure 0 0 0) 0x7fc3040d0410 con 0x7fc2e807acc0 2024-09-17T05:52:56.906 INFO:teuthology.orchestra.run.smithi150.stdout:[ 2024-09-17T05:52:56.906 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-09-17T05:52:56.906 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "cephfs" 2024-09-17T05:52:56.906 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-09-17T05:52:56.906 INFO:teuthology.orchestra.run.smithi150.stdout:] 2024-09-17T05:52:56.909 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:56.908+0000 7fc30c14a640 1 -- 172.21.15.150:0/3932689880 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fc2e807acc0 msgr2=0x7fc2e807d1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:52:56.909 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:56.908+0000 7fc30c14a640 1 --2- 172.21.15.150:0/3932689880 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fc2e807acc0 0x7fc2e807d1d0 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 crypto rx=0x7fc30406e7c0 tx=0x7fc2f4009dd0 comp rx=0 tx=0).stop 2024-09-17T05:52:56.909 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:56.908+0000 7fc30c14a640 1 -- 172.21.15.150:0/3932689880 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc2f0003a30 msgr2=0x7fc3040b8550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:52:56.909 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:56.908+0000 7fc30c14a640 1 --2- 172.21.15.150:0/3932689880 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc2f0003a30 0x7fc3040b8550 secure :-1 s=READY pgs=1747 cs=0 l=1 rev1=1 crypto rx=0x7fc30002a930 tx=0x7fc300006290 comp rx=0 tx=0).stop 2024-09-17T05:52:56.909 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:56.908+0000 7fc30c14a640 1 -- 172.21.15.150:0/3932689880 shutdown_connections 2024-09-17T05:52:56.909 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:56.908+0000 7fc30c14a640 1 --2- 172.21.15.150:0/3932689880 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc3040b4040 0x7fc3041610a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:52:56.909 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:56.908+0000 7fc30c14a640 1 --2- 172.21.15.150:0/3932689880 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fc2e807acc0 0x7fc2e807d1d0 unknown :-1 s=CLOSED pgs=739 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:52:56.910 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:56.908+0000 7fc30c14a640 1 --2- 172.21.15.150:0/3932689880 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc3041f62b0 0x7fc3041f66c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:52:56.910 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:56.908+0000 7fc30c14a640 1 --2- 172.21.15.150:0/3932689880 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc2f0003a30 0x7fc3040b8550 unknown :-1 s=CLOSED pgs=1747 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:52:56.910 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:56.908+0000 7fc30c14a640 1 -- 172.21.15.150:0/3932689880 >> 172.21.15.150:0/3932689880 conn(0x7fc3040d4680 msgr2=0x7fc30415d3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:52:56.910 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:56.908+0000 7fc30c14a640 1 -- 172.21.15.150:0/3932689880 shutdown_connections 2024-09-17T05:52:56.910 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:56.908+0000 7fc30c14a640 1 -- 172.21.15.150:0/3932689880 wait complete. 2024-09-17T05:52:56.920 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume ls cephfs --format json 2024-09-17T05:52:57.037 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:57.036+0000 7fb0f2edd640 1 -- 172.21.15.150:0/1423279515 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb0ec0b3b80 msgr2=0x7fb0ec0ce730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:52:57.037 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:57.036+0000 7fb0f2edd640 1 --2- 172.21.15.150:0/1423279515 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb0ec0b3b80 0x7fb0ec0ce730 secure :-1 s=READY pgs=1748 cs=0 l=1 rev1=1 crypto rx=0x7fb0ec073060 tx=0x7fb0dc02a4a0 comp rx=0 tx=0).stop 2024-09-17T05:52:57.037 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:57.036+0000 7fb0f2edd640 1 -- 172.21.15.150:0/1423279515 shutdown_connections 2024-09-17T05:52:57.037 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:57.036+0000 7fb0f2edd640 1 --2- 172.21.15.150:0/1423279515 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb0ec15d900 0x7fb0ec15dd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:52:57.038 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:57.036+0000 7fb0f2edd640 1 --2- 172.21.15.150:0/1423279515 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb0ec0b3b80 0x7fb0ec0ce730 unknown :-1 s=CLOSED pgs=1748 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:52:57.038 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:57.036+0000 7fb0f2edd640 1 -- 172.21.15.150:0/1423279515 >> 172.21.15.150:0/1423279515 conn(0x7fb0ec0b2ff0 msgr2=0x7fb0ec0b3400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:52:57.038 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:57.036+0000 7fb0f2edd640 1 -- 172.21.15.150:0/1423279515 shutdown_connections 2024-09-17T05:52:57.038 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:57.036+0000 7fb0f2edd640 1 -- 172.21.15.150:0/1423279515 wait complete. 2024-09-17T05:52:57.038 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:57.038+0000 7fb0f2edd640 1 Processor -- start 2024-09-17T05:52:57.038 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:57.038+0000 7fb0f2edd640 1 -- start start 2024-09-17T05:52:57.041 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:57.039+0000 7fb0f2edd640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb0ec15cbb0 0x7fb0ec0c8450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:52:57.041 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:57.039+0000 7fb0f2edd640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb0ec15d900 0x7fb0ec15b610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:52:57.041 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:57.039+0000 7fb0f2edd640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb0ec0af320 0x7fb0ec0af730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:52:57.041 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:57.039+0000 7fb0f2edd640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7fb0ec0c78d0 con 0x7fb0ec15d900 2024-09-17T05:52:57.042 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:57.039+0000 7fb0f2edd640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fb0ec0c7750 con 0x7fb0ec15cbb0 2024-09-17T05:52:57.042 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:57.039+0000 7fb0f2edd640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fb0ec0c7a50 con 0x7fb0ec0af320 2024-09-17T05:52:57.042 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:57.039+0000 7fb0ebfff640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb0ec15d900 0x7fb0ec15b610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:52:57.042 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:57.039+0000 7fb0ebfff640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb0ec15d900 0x7fb0ec15b610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:38278/0 (socket says 172.21.15.150:38278) 2024-09-17T05:52:57.042 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:57.039+0000 7fb0ebfff640 1 -- 172.21.15.150:0/2038203383 learned_addr learned my addr 172.21.15.150:0/2038203383 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:52:57.042 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:57.039+0000 7fb0f0c79640 1 --2- 172.21.15.150:0/2038203383 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb0ec15cbb0 0x7fb0ec0c8450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:52:57.042 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:57.039+0000 7fb0f147a640 1 --2- 172.21.15.150:0/2038203383 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb0ec0af320 0x7fb0ec0af730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:52:57.042 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:57.039+0000 7fb0ebfff640 1 -- 172.21.15.150:0/2038203383 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb0ec0af320 msgr2=0x7fb0ec0af730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:52:57.042 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:57.040+0000 7fb0ebfff640 1 --2- 172.21.15.150:0/2038203383 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb0ec0af320 0x7fb0ec0af730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:52:57.042 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:57.040+0000 7fb0ebfff640 1 -- 172.21.15.150:0/2038203383 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb0ec15cbb0 msgr2=0x7fb0ec0c8450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:52:57.042 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:57.040+0000 7fb0ebfff640 1 --2- 172.21.15.150:0/2038203383 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb0ec15cbb0 0x7fb0ec0c8450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:52:57.042 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:57.040+0000 7fb0ebfff640 1 -- 172.21.15.150:0/2038203383 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb0ec0afc70 con 0x7fb0ec15d900 2024-09-17T05:52:57.043 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:57.040+0000 7fb0f147a640 1 --2- 172.21.15.150:0/2038203383 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb0ec0af320 0x7fb0ec0af730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:52:57.043 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:57.040+0000 7fb0ebfff640 1 --2- 172.21.15.150:0/2038203383 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb0ec15d900 0x7fb0ec15b610 secure :-1 s=READY pgs=1749 cs=0 l=1 rev1=1 crypto rx=0x7fb0e000b3f0 tx=0x7fb0e000b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:52:57.043 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:57.040+0000 7fb0e97fa640 1 -- 172.21.15.150:0/2038203383 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb0e0015020 con 0x7fb0ec15d900 2024-09-17T05:52:57.043 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:57.040+0000 7fb0e97fa640 1 -- 172.21.15.150:0/2038203383 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb0e0011920 con 0x7fb0ec15d900 2024-09-17T05:52:57.043 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:57.040+0000 7fb0e97fa640 1 -- 172.21.15.150:0/2038203383 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb0e0011d70 con 0x7fb0ec15d900 2024-09-17T05:52:57.043 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:57.040+0000 7fb0f2edd640 1 -- 172.21.15.150:0/2038203383 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb0ec15bdb0 con 0x7fb0ec15d900 2024-09-17T05:52:57.043 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:57.040+0000 7fb0f2edd640 1 -- 172.21.15.150:0/2038203383 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb0ec0cef70 con 0x7fb0ec15d900 2024-09-17T05:52:57.044 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:57.041+0000 7fb0f2edd640 1 -- 172.21.15.150:0/2038203383 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb0ec0b3b80 con 0x7fb0ec15d900 2024-09-17T05:52:57.044 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:57.042+0000 7fb0e97fa640 1 -- 172.21.15.150:0/2038203383 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 44) ==== 104450+0+0 (secure 0 0 0) 0x7fb0e0018020 con 0x7fb0ec15d900 2024-09-17T05:52:57.044 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:57.042+0000 7fb0e97fa640 1 --2- 172.21.15.150:0/2038203383 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fb0d807acf0 0x7fb0d807d200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:52:57.044 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:57.042+0000 7fb0e97fa640 1 -- 172.21.15.150:0/2038203383 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(129..129 src has 1..129) ==== 5935+0+0 (secure 0 0 0) 0x7fb0e0099a10 con 0x7fb0ec15d900 2024-09-17T05:52:57.044 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:57.043+0000 7fb0f0c79640 1 --2- 172.21.15.150:0/2038203383 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fb0d807acf0 0x7fb0d807d200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:52:57.044 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:57.043+0000 7fb0f0c79640 1 --2- 172.21.15.150:0/2038203383 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fb0d807acf0 0x7fb0d807d200 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 crypto rx=0x7fb0dc033000 tx=0x7fb0dc004730 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:52:57.047 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:57.047+0000 7fb0e97fa640 1 -- 172.21.15.150:0/2038203383 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fb0e001f030 con 0x7fb0ec15d900 2024-09-17T05:52:57.221 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-17T05:52:57.224 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-17T05:52:57.252 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:57.252+0000 7fb0f2edd640 1 -- 172.21.15.150:0/2038203383 --> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] -- mgr_command(tid 0: {"prefix": "fs subvolume ls", "vol_name": "cephfs", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fb0ec0cd700 con 0x7fb0d807acf0 2024-09-17T05:52:57.257 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:57.256+0000 7fb0e97fa640 1 -- 172.21.15.150:0/2038203383 <== mgr.4108 v2:172.21.15.176:6800/3631216395 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+79 (secure 0 0 0) 0x7fb0ec0cd700 con 0x7fb0d807acf0 2024-09-17T05:52:57.257 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-09-17T05:52:57.257 INFO:teuthology.orchestra.run.smithi150.stdout:[ 2024-09-17T05:52:57.257 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-09-17T05:52:57.257 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "sv1" 2024-09-17T05:52:57.257 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-17T05:52:57.257 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-09-17T05:52:57.258 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "ss1clone1" 2024-09-17T05:52:57.258 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-09-17T05:52:57.258 INFO:teuthology.orchestra.run.smithi150.stdout:] 2024-09-17T05:52:57.260 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:57.258+0000 7fb0f2edd640 1 -- 172.21.15.150:0/2038203383 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fb0d807acf0 msgr2=0x7fb0d807d200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:52:57.260 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:57.259+0000 7fb0f2edd640 1 --2- 172.21.15.150:0/2038203383 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fb0d807acf0 0x7fb0d807d200 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 crypto rx=0x7fb0dc033000 tx=0x7fb0dc004730 comp rx=0 tx=0).stop 2024-09-17T05:52:57.260 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:57.259+0000 7fb0f2edd640 1 -- 172.21.15.150:0/2038203383 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb0ec15d900 msgr2=0x7fb0ec15b610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:52:57.260 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:57.259+0000 7fb0f2edd640 1 --2- 172.21.15.150:0/2038203383 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb0ec15d900 0x7fb0ec15b610 secure :-1 s=READY pgs=1749 cs=0 l=1 rev1=1 crypto rx=0x7fb0e000b3f0 tx=0x7fb0e000b8b0 comp rx=0 tx=0).stop 2024-09-17T05:52:57.260 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:57.259+0000 7fb0f2edd640 1 -- 172.21.15.150:0/2038203383 shutdown_connections 2024-09-17T05:52:57.260 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:57.259+0000 7fb0f2edd640 1 --2- 172.21.15.150:0/2038203383 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fb0d807acf0 0x7fb0d807d200 unknown :-1 s=CLOSED pgs=740 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:52:57.260 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:57.259+0000 7fb0f2edd640 1 --2- 172.21.15.150:0/2038203383 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb0ec0af320 0x7fb0ec0af730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:52:57.260 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:57.259+0000 7fb0f2edd640 1 --2- 172.21.15.150:0/2038203383 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb0ec15d900 0x7fb0ec15b610 unknown :-1 s=CLOSED pgs=1749 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:52:57.260 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:57.259+0000 7fb0f2edd640 1 --2- 172.21.15.150:0/2038203383 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb0ec15cbb0 0x7fb0ec0c8450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:52:57.261 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:57.259+0000 7fb0f2edd640 1 -- 172.21.15.150:0/2038203383 >> 172.21.15.150:0/2038203383 conn(0x7fb0ec0b2ff0 msgr2=0x7fb0ec0cc470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:52:57.261 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:57.259+0000 7fb0f2edd640 1 -- 172.21.15.150:0/2038203383 shutdown_connections 2024-09-17T05:52:57.261 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:57.259+0000 7fb0f2edd640 1 -- 172.21.15.150:0/2038203383 wait complete. 2024-09-17T05:52:57.271 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume snapshot ls cephfs sv1 --format json 2024-09-17T05:52:57.444 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:57.443+0000 7f188af20640 1 -- 172.21.15.150:0/1993211115 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f18840b5250 msgr2=0x7f18840b5660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:52:57.444 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:57.443+0000 7f188af20640 1 --2- 172.21.15.150:0/1993211115 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f18840b5250 0x7f18840b5660 secure :-1 s=READY pgs=1750 cs=0 l=1 rev1=1 crypto rx=0x7f18840b3ec0 tx=0x7f187802a560 comp rx=0 tx=0).stop 2024-09-17T05:52:57.444 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:57.443+0000 7f188af20640 1 -- 172.21.15.150:0/1993211115 shutdown_connections 2024-09-17T05:52:57.444 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:57.443+0000 7f188af20640 1 --2- 172.21.15.150:0/1993211115 >> v2:172.21.15.176:3300/0 conn(0x7f18840d0ee0 0x7f18840d12f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:52:57.444 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:57.443+0000 7f188af20640 1 --2- 172.21.15.150:0/1993211115 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f18840b5250 0x7f18840b5660 unknown :-1 s=CLOSED pgs=1750 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:52:57.444 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:57.443+0000 7f188af20640 1 --2- 172.21.15.150:0/1993211115 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f18840d01b0 0x7f18840d05c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:52:57.444 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:57.443+0000 7f188af20640 1 -- 172.21.15.150:0/1993211115 >> 172.21.15.150:0/1993211115 conn(0x7f18840cee80 msgr2=0x7f18840cf290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:52:57.445 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:57.443+0000 7f188af20640 1 -- 172.21.15.150:0/1993211115 shutdown_connections 2024-09-17T05:52:57.445 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:57.443+0000 7f188af20640 1 -- 172.21.15.150:0/1993211115 wait complete. 2024-09-17T05:52:57.445 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:57.445+0000 7f188af20640 1 Processor -- start 2024-09-17T05:52:57.445 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:57.445+0000 7f188af20640 1 -- start start 2024-09-17T05:52:57.448 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:57.446+0000 7f188af20640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f18840b5250 0x7f18841f9b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:52:57.448 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:57.446+0000 7f188af20640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f18840d01b0 0x7f1884153a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:52:57.448 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:57.446+0000 7f188af20640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f18840d0ee0 0x7f18840c7d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:52:57.448 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:57.446+0000 7f188af20640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f188409bc70 con 0x7f18840d01b0 2024-09-17T05:52:57.449 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:57.446+0000 7f188af20640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f188409baf0 con 0x7f18840b5250 2024-09-17T05:52:57.449 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:57.446+0000 7f188af20640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f1884160a30 con 0x7f18840d0ee0 2024-09-17T05:52:57.449 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:57.446+0000 7f1883fff640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f18840d01b0 0x7f1884153a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:52:57.449 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:57.446+0000 7f1883fff640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f18840d01b0 0x7f1884153a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:38294/0 (socket says 172.21.15.150:38294) 2024-09-17T05:52:57.449 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:57.446+0000 7f1883fff640 1 -- 172.21.15.150:0/3692550491 learned_addr learned my addr 172.21.15.150:0/3692550491 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:52:57.449 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:57.446+0000 7f1888cbc640 1 --2- 172.21.15.150:0/3692550491 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f18840b5250 0x7f18841f9b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:52:57.449 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:57.446+0000 7f18894bd640 1 --2- 172.21.15.150:0/3692550491 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f18840d0ee0 0x7f18840c7d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:52:57.449 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:57.446+0000 7f1883fff640 1 -- 172.21.15.150:0/3692550491 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f18840d0ee0 msgr2=0x7f18840c7d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:52:57.449 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:57.446+0000 7f1883fff640 1 --2- 172.21.15.150:0/3692550491 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f18840d0ee0 0x7f18840c7d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:52:57.449 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:57.447+0000 7f1883fff640 1 -- 172.21.15.150:0/3692550491 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f18840b5250 msgr2=0x7f18841f9b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:52:57.449 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:57.447+0000 7f1883fff640 1 --2- 172.21.15.150:0/3692550491 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f18840b5250 0x7f18841f9b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:52:57.449 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:57.447+0000 7f1883fff640 1 -- 172.21.15.150:0/3692550491 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f18841561b0 con 0x7f18840d01b0 2024-09-17T05:52:57.450 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:57.447+0000 7f1883fff640 1 --2- 172.21.15.150:0/3692550491 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f18840d01b0 0x7f1884153a40 secure :-1 s=READY pgs=1751 cs=0 l=1 rev1=1 crypto rx=0x7f1878000c00 tx=0x7f1878003910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:52:57.450 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:57.447+0000 7f18817fa640 1 -- 172.21.15.150:0/3692550491 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f187803e030 con 0x7f18840d01b0 2024-09-17T05:52:57.450 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:57.447+0000 7f18817fa640 1 -- 172.21.15.150:0/3692550491 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f1878003e00 con 0x7f18840d01b0 2024-09-17T05:52:57.450 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:57.447+0000 7f188af20640 1 -- 172.21.15.150:0/3692550491 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f18840cb000 con 0x7f18840d01b0 2024-09-17T05:52:57.450 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:57.447+0000 7f18817fa640 1 -- 172.21.15.150:0/3692550491 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1878035040 con 0x7f18840d01b0 2024-09-17T05:52:57.450 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:57.447+0000 7f188af20640 1 -- 172.21.15.150:0/3692550491 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f18840cb5c0 con 0x7f18840d01b0 2024-09-17T05:52:57.450 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:57.448+0000 7f188af20640 1 -- 172.21.15.150:0/3692550491 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f18840d05c0 con 0x7f18840d01b0 2024-09-17T05:52:57.451 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:57.449+0000 7f18817fa640 1 -- 172.21.15.150:0/3692550491 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 44) ==== 104450+0+0 (secure 0 0 0) 0x7f1878041030 con 0x7f18840d01b0 2024-09-17T05:52:57.451 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:57.449+0000 7f18817fa640 1 --2- 172.21.15.150:0/3692550491 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f187007acc0 0x7f187007d1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:52:57.451 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:57.449+0000 7f18817fa640 1 -- 172.21.15.150:0/3692550491 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(129..129 src has 1..129) ==== 5935+0+0 (secure 0 0 0) 0x7f18780ba570 con 0x7f18840d01b0 2024-09-17T05:52:57.451 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:57.449+0000 7f1888cbc640 1 --2- 172.21.15.150:0/3692550491 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f187007acc0 0x7f187007d1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:52:57.451 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:57.450+0000 7f1888cbc640 1 --2- 172.21.15.150:0/3692550491 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f187007acc0 0x7f187007d1d0 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 crypto rx=0x7f1874005670 tx=0x7f187400b260 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:52:57.454 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:57.454+0000 7f18817fa640 1 -- 172.21.15.150:0/3692550491 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f1878083e60 con 0x7f18840d01b0 2024-09-17T05:52:57.662 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:57.661+0000 7f188af20640 1 -- 172.21.15.150:0/3692550491 --> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] -- mgr_command(tid 0: {"prefix": "fs subvolume snapshot ls", "vol_name": "cephfs", "sub_name": "sv1", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f1884153f80 con 0x7f187007acc0 2024-09-17T05:52:57.674 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:57.674+0000 7f18817fa640 1 -- 172.21.15.150:0/3692550491 <== mgr.4108 v2:172.21.15.176:6800/3631216395 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+38 (secure 0 0 0) 0x7f187400b760 con 0x7f187007acc0 2024-09-17T05:52:57.675 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-09-17T05:52:57.675 INFO:teuthology.orchestra.run.smithi150.stdout:[ 2024-09-17T05:52:57.675 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-09-17T05:52:57.675 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "ss1" 2024-09-17T05:52:57.675 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-09-17T05:52:57.675 INFO:teuthology.orchestra.run.smithi150.stdout:] 2024-09-17T05:52:57.677 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:57.676+0000 7f188af20640 1 -- 172.21.15.150:0/3692550491 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f187007acc0 msgr2=0x7f187007d1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:52:57.678 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:57.676+0000 7f188af20640 1 --2- 172.21.15.150:0/3692550491 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f187007acc0 0x7f187007d1d0 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 crypto rx=0x7f1874005670 tx=0x7f187400b260 comp rx=0 tx=0).stop 2024-09-17T05:52:57.678 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:57.676+0000 7f188af20640 1 -- 172.21.15.150:0/3692550491 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f18840d01b0 msgr2=0x7f1884153a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:52:57.678 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:57.676+0000 7f188af20640 1 --2- 172.21.15.150:0/3692550491 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f18840d01b0 0x7f1884153a40 secure :-1 s=READY pgs=1751 cs=0 l=1 rev1=1 crypto rx=0x7f1878000c00 tx=0x7f1878003910 comp rx=0 tx=0).stop 2024-09-17T05:52:57.678 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:57.676+0000 7f188af20640 1 -- 172.21.15.150:0/3692550491 shutdown_connections 2024-09-17T05:52:57.678 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:57.676+0000 7f188af20640 1 --2- 172.21.15.150:0/3692550491 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f187007acc0 0x7f187007d1d0 unknown :-1 s=CLOSED pgs=741 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:52:57.678 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:57.676+0000 7f188af20640 1 --2- 172.21.15.150:0/3692550491 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f18840d0ee0 0x7f18840c7d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:52:57.679 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:57.676+0000 7f188af20640 1 --2- 172.21.15.150:0/3692550491 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f18840d01b0 0x7f1884153a40 unknown :-1 s=CLOSED pgs=1751 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:52:57.679 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:57.676+0000 7f188af20640 1 --2- 172.21.15.150:0/3692550491 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f18840b5250 0x7f18841f9b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:52:57.679 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:57.676+0000 7f188af20640 1 -- 172.21.15.150:0/3692550491 >> 172.21.15.150:0/3692550491 conn(0x7f18840cee80 msgr2=0x7f1884155850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:52:57.679 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:57.676+0000 7f188af20640 1 -- 172.21.15.150:0/3692550491 shutdown_connections 2024-09-17T05:52:57.679 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:57.676+0000 7f188af20640 1 -- 172.21.15.150:0/3692550491 wait complete. 2024-09-17T05:52:57.689 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume snapshot rm --force --format json cephfs sv1 ss1 2024-09-17T05:52:57.808 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:57.807+0000 7fb6d3cde640 1 -- 172.21.15.150:0/2612496375 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb6cc0d5150 msgr2=0x7fb6cc0b9b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:52:57.809 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:57.807+0000 7fb6d3cde640 1 --2- 172.21.15.150:0/2612496375 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb6cc0d5150 0x7fb6cc0b9b10 secure :-1 s=READY pgs=1753 cs=0 l=1 rev1=1 crypto rx=0x7fb6cc0cfd10 tx=0x7fb6bc02a890 comp rx=0 tx=0).stop 2024-09-17T05:52:57.809 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:57.807+0000 7fb6d3cde640 1 -- 172.21.15.150:0/2612496375 shutdown_connections 2024-09-17T05:52:57.809 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:57.807+0000 7fb6d3cde640 1 --2- 172.21.15.150:0/2612496375 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb6cc0d5150 0x7fb6cc0b9b10 unknown :-1 s=CLOSED pgs=1753 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:52:57.809 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:57.807+0000 7fb6d3cde640 1 -- 172.21.15.150:0/2612496375 >> 172.21.15.150:0/2612496375 conn(0x7fb6cc08bfe0 msgr2=0x7fb6cc0d46e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:52:57.809 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:57.807+0000 7fb6d3cde640 1 -- 172.21.15.150:0/2612496375 shutdown_connections 2024-09-17T05:52:57.809 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:57.807+0000 7fb6d3cde640 1 -- 172.21.15.150:0/2612496375 wait complete. 2024-09-17T05:52:57.810 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:57.809+0000 7fb6d3cde640 1 Processor -- start 2024-09-17T05:52:57.810 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:57.809+0000 7fb6d3cde640 1 -- start start 2024-09-17T05:52:57.813 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:57.810+0000 7fb6d3cde640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb6cc06dea0 0x7fb6cc14fba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:52:57.813 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:57.810+0000 7fb6d3cde640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb6cc0d0730 0x7fb6cc0b5210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:52:57.813 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:57.810+0000 7fb6d3cde640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb6cc0d5150 0x7fb6cc0b5750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:52:57.813 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:57.810+0000 7fb6d3cde640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7fb6cc0b6870 con 0x7fb6cc0d5150 2024-09-17T05:52:57.813 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:57.810+0000 7fb6d3cde640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fb6cc0d31e0 con 0x7fb6cc0d0730 2024-09-17T05:52:57.813 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:57.810+0000 7fb6d3cde640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fb6cc0b69f0 con 0x7fb6cc06dea0 2024-09-17T05:52:57.813 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:57.811+0000 7fb6d227b640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb6cc0d5150 0x7fb6cc0b5750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:52:57.813 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:57.811+0000 7fb6d227b640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb6cc0d5150 0x7fb6cc0b5750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:38312/0 (socket says 172.21.15.150:38312) 2024-09-17T05:52:57.813 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:57.811+0000 7fb6d227b640 1 -- 172.21.15.150:0/1929332357 learned_addr learned my addr 172.21.15.150:0/1929332357 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:52:57.813 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:57.811+0000 7fb6d1a7a640 1 --2- 172.21.15.150:0/1929332357 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb6cc06dea0 0x7fb6cc14fba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:52:57.814 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:57.811+0000 7fb6d1279640 1 --2- 172.21.15.150:0/1929332357 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb6cc0d0730 0x7fb6cc0b5210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:52:57.814 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:57.811+0000 7fb6d227b640 1 -- 172.21.15.150:0/1929332357 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb6cc06dea0 msgr2=0x7fb6cc14fba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:52:57.814 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:57.811+0000 7fb6d227b640 1 --2- 172.21.15.150:0/1929332357 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb6cc06dea0 0x7fb6cc14fba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:52:57.814 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:57.811+0000 7fb6d227b640 1 -- 172.21.15.150:0/1929332357 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb6cc0d0730 msgr2=0x7fb6cc0b5210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:52:57.814 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:57.811+0000 7fb6d227b640 1 --2- 172.21.15.150:0/1929332357 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb6cc0d0730 0x7fb6cc0b5210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:52:57.814 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:57.811+0000 7fb6d227b640 1 -- 172.21.15.150:0/1929332357 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb6cc1fa1e0 con 0x7fb6cc0d5150 2024-09-17T05:52:57.814 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:57.811+0000 7fb6d227b640 1 --2- 172.21.15.150:0/1929332357 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb6cc0d5150 0x7fb6cc0b5750 secure :-1 s=READY pgs=1754 cs=0 l=1 rev1=1 crypto rx=0x7fb6c400b410 tx=0x7fb6c400b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:52:57.814 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:57.811+0000 7fb6ca7fc640 1 -- 172.21.15.150:0/1929332357 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6c4015030 con 0x7fb6cc0d5150 2024-09-17T05:52:57.814 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:57.811+0000 7fb6ca7fc640 1 -- 172.21.15.150:0/1929332357 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb6c4004020 con 0x7fb6cc0d5150 2024-09-17T05:52:57.814 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:57.811+0000 7fb6d3cde640 1 -- 172.21.15.150:0/1929332357 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb6cc0cd590 con 0x7fb6cc0d5150 2024-09-17T05:52:57.814 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:57.811+0000 7fb6ca7fc640 1 -- 172.21.15.150:0/1929332357 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6c4004470 con 0x7fb6cc0d5150 2024-09-17T05:52:57.814 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:57.811+0000 7fb6d3cde640 1 -- 172.21.15.150:0/1929332357 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb6cc0cd830 con 0x7fb6cc0d5150 2024-09-17T05:52:57.815 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:57.812+0000 7fb6d3cde640 1 -- 172.21.15.150:0/1929332357 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb6cc06e440 con 0x7fb6cc0d5150 2024-09-17T05:52:57.815 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:57.813+0000 7fb6ca7fc640 1 -- 172.21.15.150:0/1929332357 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 44) ==== 104450+0+0 (secure 0 0 0) 0x7fb6c4018070 con 0x7fb6cc0d5150 2024-09-17T05:52:57.815 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:57.813+0000 7fb6ca7fc640 1 --2- 172.21.15.150:0/1929332357 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fb6b807acc0 0x7fb6b807d1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:52:57.816 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:57.814+0000 7fb6ca7fc640 1 -- 172.21.15.150:0/1929332357 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(129..129 src has 1..129) ==== 5935+0+0 (secure 0 0 0) 0x7fb6c40997e0 con 0x7fb6cc0d5150 2024-09-17T05:52:57.816 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:57.814+0000 7fb6d1a7a640 1 --2- 172.21.15.150:0/1929332357 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fb6b807acc0 0x7fb6b807d1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:52:57.816 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:57.814+0000 7fb6d1a7a640 1 --2- 172.21.15.150:0/1929332357 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fb6b807acc0 0x7fb6b807d1d0 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 crypto rx=0x7fb6cc08e950 tx=0x7fb6bc004ab0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:52:57.819 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:57.818+0000 7fb6ca7fc640 1 -- 172.21.15.150:0/1929332357 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fb6c4063160 con 0x7fb6cc0d5150 2024-09-17T05:52:58.025 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:58.024+0000 7fb6d3cde640 1 -- 172.21.15.150:0/1929332357 --> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] -- mgr_command(tid 0: {"prefix": "fs subvolume snapshot rm", "force": true, "vol_name": "cephfs", "sub_name": "sv1", "snap_name": "ss1", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fb6cc1f9c90 con 0x7fb6b807acc0 2024-09-17T05:52:58.051 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:58.050+0000 7fb6ca7fc640 1 -- 172.21.15.150:0/1929332357 <== mgr.4108 v2:172.21.15.176:6800/3631216395 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7fb6cc1f9c90 con 0x7fb6b807acc0 2024-09-17T05:52:58.051 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-09-17T05:52:58.054 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:58.053+0000 7fb6d3cde640 1 -- 172.21.15.150:0/1929332357 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fb6b807acc0 msgr2=0x7fb6b807d1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:52:58.055 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:58.053+0000 7fb6d3cde640 1 --2- 172.21.15.150:0/1929332357 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fb6b807acc0 0x7fb6b807d1d0 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 crypto rx=0x7fb6cc08e950 tx=0x7fb6bc004ab0 comp rx=0 tx=0).stop 2024-09-17T05:52:58.055 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:58.053+0000 7fb6d3cde640 1 -- 172.21.15.150:0/1929332357 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb6cc0d5150 msgr2=0x7fb6cc0b5750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:52:58.055 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:58.053+0000 7fb6d3cde640 1 --2- 172.21.15.150:0/1929332357 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb6cc0d5150 0x7fb6cc0b5750 secure :-1 s=READY pgs=1754 cs=0 l=1 rev1=1 crypto rx=0x7fb6c400b410 tx=0x7fb6c400b8d0 comp rx=0 tx=0).stop 2024-09-17T05:52:58.055 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:58.053+0000 7fb6d3cde640 1 -- 172.21.15.150:0/1929332357 shutdown_connections 2024-09-17T05:52:58.055 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:58.053+0000 7fb6d3cde640 1 --2- 172.21.15.150:0/1929332357 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb6cc0d0730 0x7fb6cc0b5210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:52:58.055 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:58.053+0000 7fb6d3cde640 1 --2- 172.21.15.150:0/1929332357 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fb6b807acc0 0x7fb6b807d1d0 unknown :-1 s=CLOSED pgs=742 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:52:58.055 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:58.053+0000 7fb6d3cde640 1 --2- 172.21.15.150:0/1929332357 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb6cc0d5150 0x7fb6cc0b5750 unknown :-1 s=CLOSED pgs=1754 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:52:58.055 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:58.053+0000 7fb6d3cde640 1 --2- 172.21.15.150:0/1929332357 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb6cc06dea0 0x7fb6cc14fba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:52:58.055 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:58.053+0000 7fb6d3cde640 1 -- 172.21.15.150:0/1929332357 >> 172.21.15.150:0/1929332357 conn(0x7fb6cc08bfe0 msgr2=0x7fb6cc163010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:52:58.055 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:58.053+0000 7fb6d3cde640 1 -- 172.21.15.150:0/1929332357 shutdown_connections 2024-09-17T05:52:58.055 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:58.053+0000 7fb6d3cde640 1 -- 172.21.15.150:0/1929332357 wait complete. 2024-09-17T05:52:58.065 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume rm cephfs sv1 2024-09-17T05:52:58.182 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:58.181+0000 7fbd6af90640 1 -- 172.21.15.150:0/1452197983 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbd4c004800 msgr2=0x7fbd4c004c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:52:58.182 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:58.181+0000 7fbd6af90640 1 --2- 172.21.15.150:0/1452197983 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbd4c004800 0x7fbd4c004c10 secure :-1 s=READY pgs=1756 cs=0 l=1 rev1=1 crypto rx=0x7fbd640d41f0 tx=0x7fbd4c005830 comp rx=0 tx=0).stop 2024-09-17T05:52:58.183 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:58.181+0000 7fbd6952d640 1 -- 172.21.15.150:0/1452197983 reap_dead start 2024-09-17T05:52:58.183 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:58.181+0000 7fbd6af90640 1 -- 172.21.15.150:0/1452197983 shutdown_connections 2024-09-17T05:52:58.183 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:58.181+0000 7fbd6af90640 1 -- 172.21.15.150:0/1452197983 >> 172.21.15.150:0/1452197983 conn(0x7fbd6408bfe0 msgr2=0x7fbd640d46e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:52:58.183 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:58.181+0000 7fbd6af90640 1 -- 172.21.15.150:0/1452197983 shutdown_connections 2024-09-17T05:52:58.183 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:58.181+0000 7fbd6af90640 1 -- 172.21.15.150:0/1452197983 wait complete. 2024-09-17T05:52:58.183 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:58.183+0000 7fbd6af90640 1 Processor -- start 2024-09-17T05:52:58.184 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:58.183+0000 7fbd6af90640 1 -- start start 2024-09-17T05:52:58.186 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:58.184+0000 7fbd6af90640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fbd4c004800 0x7fbd641f9610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:52:58.187 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:58.184+0000 7fbd6af90640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fbd641f58c0 0x7fbd641f5cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:52:58.187 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:58.184+0000 7fbd6af90640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbd640b5120 0x7fbd640b5530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:52:58.187 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:58.184+0000 7fbd6af90640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7fbd640b69f0 con 0x7fbd640b5120 2024-09-17T05:52:58.187 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:58.184+0000 7fbd6af90640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fbd640b6870 con 0x7fbd4c004800 2024-09-17T05:52:58.187 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:58.184+0000 7fbd6af90640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fbd640d0020 con 0x7fbd641f58c0 2024-09-17T05:52:58.187 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:58.184+0000 7fbd6952d640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbd640b5120 0x7fbd640b5530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:52:58.187 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:58.184+0000 7fbd6952d640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbd640b5120 0x7fbd640b5530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:38318/0 (socket says 172.21.15.150:38318) 2024-09-17T05:52:58.187 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:58.184+0000 7fbd6952d640 1 -- 172.21.15.150:0/1221652815 learned_addr learned my addr 172.21.15.150:0/1221652815 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:52:58.187 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:58.184+0000 7fbd68d2c640 1 --2- 172.21.15.150:0/1221652815 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fbd4c004800 0x7fbd641f9610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:52:58.187 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:58.185+0000 7fbd5bfff640 1 --2- 172.21.15.150:0/1221652815 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fbd641f58c0 0x7fbd641f5cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:52:58.187 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:58.185+0000 7fbd6952d640 1 -- 172.21.15.150:0/1221652815 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fbd641f58c0 msgr2=0x7fbd641f5cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:52:58.187 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:58.185+0000 7fbd6952d640 1 --2- 172.21.15.150:0/1221652815 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fbd641f58c0 0x7fbd641f5cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:52:58.188 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:58.185+0000 7fbd6952d640 1 -- 172.21.15.150:0/1221652815 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fbd4c004800 msgr2=0x7fbd641f9610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:52:58.188 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:58.185+0000 7fbd6952d640 1 --2- 172.21.15.150:0/1221652815 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fbd4c004800 0x7fbd641f9610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:52:58.188 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:58.185+0000 7fbd6952d640 1 -- 172.21.15.150:0/1221652815 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbd640b5a70 con 0x7fbd640b5120 2024-09-17T05:52:58.188 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:58.185+0000 7fbd6952d640 1 --2- 172.21.15.150:0/1221652815 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbd640b5120 0x7fbd640b5530 secure :-1 s=READY pgs=1757 cs=0 l=1 rev1=1 crypto rx=0x7fbd6415f340 tx=0x7fbd5c006660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:52:58.188 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:58.185+0000 7fbd597fa640 1 -- 172.21.15.150:0/1221652815 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd5c00fa20 con 0x7fbd640b5120 2024-09-17T05:52:58.188 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:58.185+0000 7fbd597fa640 1 -- 172.21.15.150:0/1221652815 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fbd5c018070 con 0x7fbd640b5120 2024-09-17T05:52:58.188 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:58.185+0000 7fbd6af90640 1 -- 172.21.15.150:0/1221652815 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbd641f6610 con 0x7fbd640b5120 2024-09-17T05:52:58.188 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:58.185+0000 7fbd597fa640 1 -- 172.21.15.150:0/1221652815 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd5c00fea0 con 0x7fbd640b5120 2024-09-17T05:52:58.188 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:58.185+0000 7fbd6af90640 1 -- 172.21.15.150:0/1221652815 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbd640cbaa0 con 0x7fbd640b5120 2024-09-17T05:52:58.188 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:58.186+0000 7fbd6af90640 1 -- 172.21.15.150:0/1221652815 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbd640d4f30 con 0x7fbd640b5120 2024-09-17T05:52:58.189 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:58.187+0000 7fbd597fa640 1 -- 172.21.15.150:0/1221652815 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 44) ==== 104450+0+0 (secure 0 0 0) 0x7fbd5c01d460 con 0x7fbd640b5120 2024-09-17T05:52:58.189 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:58.187+0000 7fbd597fa640 1 --2- 172.21.15.150:0/1221652815 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fbd5007acc0 0x7fbd5007d1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:52:58.189 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:58.187+0000 7fbd597fa640 1 -- 172.21.15.150:0/1221652815 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(129..129 src has 1..129) ==== 5935+0+0 (secure 0 0 0) 0x7fbd5c09a5a0 con 0x7fbd640b5120 2024-09-17T05:52:58.189 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:58.188+0000 7fbd68d2c640 1 --2- 172.21.15.150:0/1221652815 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fbd5007acc0 0x7fbd5007d1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:52:58.189 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:58.188+0000 7fbd68d2c640 1 --2- 172.21.15.150:0/1221652815 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fbd5007acc0 0x7fbd5007d1d0 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 crypto rx=0x7fbd60006fd0 tx=0x7fbd60006b60 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:52:58.192 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:58.192+0000 7fbd597fa640 1 -- 172.21.15.150:0/1221652815 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fbd640b5a70 con 0x7fbd640b5120 2024-09-17T05:52:58.394 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:58.393+0000 7fbd6af90640 1 -- 172.21.15.150:0/1221652815 --> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] -- mgr_command(tid 0: {"prefix": "fs subvolume rm", "vol_name": "cephfs", "sub_name": "sv1", "target": ["mon-mgr", ""]}) -- 0x7fbd6415ede0 con 0x7fbd5007acc0 2024-09-17T05:52:58.415 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:58.414+0000 7fbd597fa640 1 -- 172.21.15.150:0/1221652815 <== mgr.4108 v2:172.21.15.176:6800/3631216395 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7fbd6415ede0 con 0x7fbd5007acc0 2024-09-17T05:52:58.417 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:58.416+0000 7fbd6af90640 1 -- 172.21.15.150:0/1221652815 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fbd5007acc0 msgr2=0x7fbd5007d1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:52:58.418 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:58.416+0000 7fbd6af90640 1 --2- 172.21.15.150:0/1221652815 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fbd5007acc0 0x7fbd5007d1d0 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 crypto rx=0x7fbd60006fd0 tx=0x7fbd60006b60 comp rx=0 tx=0).stop 2024-09-17T05:52:58.418 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:58.416+0000 7fbd6af90640 1 -- 172.21.15.150:0/1221652815 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbd640b5120 msgr2=0x7fbd640b5530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:52:58.418 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:58.416+0000 7fbd6af90640 1 --2- 172.21.15.150:0/1221652815 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbd640b5120 0x7fbd640b5530 secure :-1 s=READY pgs=1757 cs=0 l=1 rev1=1 crypto rx=0x7fbd6415f340 tx=0x7fbd5c006660 comp rx=0 tx=0).stop 2024-09-17T05:52:58.418 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:58.416+0000 7fbd6af90640 1 -- 172.21.15.150:0/1221652815 shutdown_connections 2024-09-17T05:52:58.418 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:58.416+0000 7fbd6af90640 1 --2- 172.21.15.150:0/1221652815 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fbd5007acc0 0x7fbd5007d1d0 unknown :-1 s=CLOSED pgs=743 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:52:58.418 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:58.416+0000 7fbd6af90640 1 --2- 172.21.15.150:0/1221652815 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbd640b5120 0x7fbd640b5530 unknown :-1 s=CLOSED pgs=1757 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:52:58.418 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:58.416+0000 7fbd6af90640 1 --2- 172.21.15.150:0/1221652815 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fbd641f58c0 0x7fbd641f5cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:52:58.418 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:58.416+0000 7fbd6af90640 1 --2- 172.21.15.150:0/1221652815 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fbd4c004800 0x7fbd641f9610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:52:58.418 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:58.416+0000 7fbd6af90640 1 -- 172.21.15.150:0/1221652815 >> 172.21.15.150:0/1221652815 conn(0x7fbd6408bfe0 msgr2=0x7fbd640b1280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:52:58.418 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:58.417+0000 7fbd6af90640 1 -- 172.21.15.150:0/1221652815 shutdown_connections 2024-09-17T05:52:58.418 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:58.417+0000 7fbd6af90640 1 -- 172.21.15.150:0/1221652815 wait complete. 2024-09-17T05:52:58.429 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume rm --force cephfs ss1clone1 2024-09-17T05:52:58.430 INFO:tasks.ceph.mgr.x.smithi176.stderr:2024-09-17T05:52:58.427+0000 7f33d8f1d640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-17T05:52:58.430 INFO:tasks.ceph.mgr.x.smithi176.stderr:2024-09-17T05:52:58.427+0000 7f33d8f1d640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-17T05:52:58.430 INFO:tasks.ceph.mgr.x.smithi176.stderr:2024-09-17T05:52:58.427+0000 7f33d8f1d640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-17T05:52:58.430 INFO:tasks.ceph.mgr.x.smithi176.stderr:2024-09-17T05:52:58.427+0000 7f33d8f1d640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-17T05:52:58.430 INFO:tasks.ceph.mgr.x.smithi176.stderr:2024-09-17T05:52:58.427+0000 7f33d8f1d640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-17T05:52:58.559 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:58.557+0000 7f1206c71640 1 -- 172.21.15.150:0/3664826630 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f12000d01b0 msgr2=0x7f12000d05c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:52:58.559 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:58.557+0000 7f1206c71640 1 --2- 172.21.15.150:0/3664826630 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f12000d01b0 0x7f12000d05c0 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7f11fc009820 tx=0x7f11fc02a510 comp rx=0 tx=0).stop 2024-09-17T05:52:58.559 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:58.557+0000 7f1206c71640 1 -- 172.21.15.150:0/3664826630 shutdown_connections 2024-09-17T05:52:58.559 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:58.557+0000 7f1206c71640 1 --2- 172.21.15.150:0/3664826630 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f12000b5660 0x7f12000cd160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:52:58.559 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:58.557+0000 7f1206c71640 1 --2- 172.21.15.150:0/3664826630 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f12000d01b0 0x7f12000d05c0 unknown :-1 s=CLOSED pgs=593 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:52:58.559 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:58.557+0000 7f1206c71640 1 -- 172.21.15.150:0/3664826630 >> 172.21.15.150:0/3664826630 conn(0x7f12000cee80 msgr2=0x7f12000cf290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:52:58.559 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:58.557+0000 7f1206c71640 1 -- 172.21.15.150:0/3664826630 shutdown_connections 2024-09-17T05:52:58.559 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:58.557+0000 7f1206c71640 1 -- 172.21.15.150:0/3664826630 wait complete. 2024-09-17T05:52:58.560 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:58.559+0000 7f1206c71640 1 Processor -- start 2024-09-17T05:52:58.560 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:58.559+0000 7f1206c71640 1 -- start start 2024-09-17T05:52:58.562 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:58.560+0000 7f1206c71640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f12000b5250 0x7f12000cafd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:52:58.563 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:58.561+0000 7f1206c71640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f12000b5660 0x7f120015f190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:52:58.563 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:58.561+0000 7f1206c71640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f12000d01b0 0x7f12001f7010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:52:58.563 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:58.561+0000 7f1206c71640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f12000d1770 con 0x7f12000d01b0 2024-09-17T05:52:58.563 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:58.561+0000 7f1206c71640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f12000d15f0 con 0x7f12000b5660 2024-09-17T05:52:58.563 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:58.561+0000 7f1206c71640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f120009baf0 con 0x7f12000b5250 2024-09-17T05:52:58.563 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:58.561+0000 7f120520e640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f12000d01b0 0x7f12001f7010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:52:58.563 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:58.561+0000 7f120520e640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f12000d01b0 0x7f12001f7010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:38334/0 (socket says 172.21.15.150:38334) 2024-09-17T05:52:58.563 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:58.561+0000 7f120520e640 1 -- 172.21.15.150:0/608321690 learned_addr learned my addr 172.21.15.150:0/608321690 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:52:58.563 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:58.561+0000 7f11f7fff640 1 --2- 172.21.15.150:0/608321690 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f12000b5660 0x7f120015f190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:52:58.563 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:58.561+0000 7f1204a0d640 1 --2- 172.21.15.150:0/608321690 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f12000b5250 0x7f12000cafd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:52:58.563 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:58.561+0000 7f120520e640 1 -- 172.21.15.150:0/608321690 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f12000b5250 msgr2=0x7f12000cafd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:52:58.563 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:58.561+0000 7f120520e640 1 --2- 172.21.15.150:0/608321690 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f12000b5250 0x7f12000cafd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:52:58.563 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:58.561+0000 7f120520e640 1 -- 172.21.15.150:0/608321690 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f12000b5660 msgr2=0x7f120015f190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:52:58.564 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:58.561+0000 7f120520e640 1 --2- 172.21.15.150:0/608321690 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f12000b5660 0x7f120015f190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:52:58.564 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:58.561+0000 7f120520e640 1 -- 172.21.15.150:0/608321690 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f12000c94b0 con 0x7f12000d01b0 2024-09-17T05:52:58.564 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:58.561+0000 7f120520e640 1 --2- 172.21.15.150:0/608321690 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f12000d01b0 0x7f12001f7010 secure :-1 s=READY pgs=1758 cs=0 l=1 rev1=1 crypto rx=0x7f11f800ebf0 tx=0x7f11f800c6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:52:58.564 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:58.561+0000 7f11f57fa640 1 -- 172.21.15.150:0/608321690 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11f8003b70 con 0x7f12000d01b0 2024-09-17T05:52:58.564 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:58.561+0000 7f1206c71640 1 -- 172.21.15.150:0/608321690 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f120015f6d0 con 0x7f12000d01b0 2024-09-17T05:52:58.564 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:58.561+0000 7f11f57fa640 1 -- 172.21.15.150:0/608321690 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f11f8003d10 con 0x7f12000d01b0 2024-09-17T05:52:58.564 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:58.561+0000 7f11f57fa640 1 -- 172.21.15.150:0/608321690 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11f8004280 con 0x7f12000d01b0 2024-09-17T05:52:58.564 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:58.562+0000 7f1206c71640 1 -- 172.21.15.150:0/608321690 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f12000c9c90 con 0x7f12000d01b0 2024-09-17T05:52:58.565 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:58.563+0000 7f1206c71640 1 -- 172.21.15.150:0/608321690 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f12000c9720 con 0x7f12000d01b0 2024-09-17T05:52:58.565 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:58.564+0000 7f11f57fa640 1 -- 172.21.15.150:0/608321690 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 44) ==== 104450+0+0 (secure 0 0 0) 0x7f11f8004420 con 0x7f12000d01b0 2024-09-17T05:52:58.565 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:58.564+0000 7f11f57fa640 1 --2- 172.21.15.150:0/608321690 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f11ec07acc0 0x7f11ec07d1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:52:58.565 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:58.564+0000 7f11f57fa640 1 -- 172.21.15.150:0/608321690 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(129..129 src has 1..129) ==== 5935+0+0 (secure 0 0 0) 0x7f11f809ab80 con 0x7f12000d01b0 2024-09-17T05:52:58.565 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:58.564+0000 7f1204a0d640 1 --2- 172.21.15.150:0/608321690 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f11ec07acc0 0x7f11ec07d1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:52:58.565 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:58.565+0000 7f1204a0d640 1 --2- 172.21.15.150:0/608321690 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f11ec07acc0 0x7f11ec07d1d0 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 crypto rx=0x7f11fc034000 tx=0x7f11fc004730 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:52:58.572 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:58.572+0000 7f11f57fa640 1 -- 172.21.15.150:0/608321690 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f11f8064500 con 0x7f12000d01b0 2024-09-17T05:52:58.776 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:58.776+0000 7f1206c71640 1 -- 172.21.15.150:0/608321690 --> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] -- mgr_command(tid 0: {"prefix": "fs subvolume rm", "force": true, "vol_name": "cephfs", "sub_name": "ss1clone1", "target": ["mon-mgr", ""]}) -- 0x7f12000cd160 con 0x7f11ec07acc0 2024-09-17T05:52:58.795 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:58.794+0000 7f11f57fa640 1 -- 172.21.15.150:0/608321690 <== mgr.4108 v2:172.21.15.176:6800/3631216395 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f12000cd160 con 0x7f11ec07acc0 2024-09-17T05:52:58.798 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:58.797+0000 7f1206c71640 1 -- 172.21.15.150:0/608321690 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f11ec07acc0 msgr2=0x7f11ec07d1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:52:58.798 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:58.797+0000 7f1206c71640 1 --2- 172.21.15.150:0/608321690 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f11ec07acc0 0x7f11ec07d1d0 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 crypto rx=0x7f11fc034000 tx=0x7f11fc004730 comp rx=0 tx=0).stop 2024-09-17T05:52:58.798 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:58.797+0000 7f1206c71640 1 -- 172.21.15.150:0/608321690 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f12000d01b0 msgr2=0x7f12001f7010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:52:58.798 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:58.797+0000 7f1206c71640 1 --2- 172.21.15.150:0/608321690 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f12000d01b0 0x7f12001f7010 secure :-1 s=READY pgs=1758 cs=0 l=1 rev1=1 crypto rx=0x7f11f800ebf0 tx=0x7f11f800c6a0 comp rx=0 tx=0).stop 2024-09-17T05:52:58.798 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:58.797+0000 7f1206c71640 1 -- 172.21.15.150:0/608321690 shutdown_connections 2024-09-17T05:52:58.798 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:58.797+0000 7f1206c71640 1 --2- 172.21.15.150:0/608321690 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f12000b5660 0x7f120015f190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:52:58.798 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:58.797+0000 7f1206c71640 1 --2- 172.21.15.150:0/608321690 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f11ec07acc0 0x7f11ec07d1d0 unknown :-1 s=CLOSED pgs=744 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:52:58.799 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:58.797+0000 7f1206c71640 1 --2- 172.21.15.150:0/608321690 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f12000d01b0 0x7f12001f7010 unknown :-1 s=CLOSED pgs=1758 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:52:58.799 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:58.797+0000 7f1206c71640 1 --2- 172.21.15.150:0/608321690 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f12000b5250 0x7f12000cafd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:52:58.799 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:58.797+0000 7f1206c71640 1 -- 172.21.15.150:0/608321690 >> 172.21.15.150:0/608321690 conn(0x7f12000cee80 msgr2=0x7f120015cc80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:52:58.799 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:58.797+0000 7f1206c71640 1 -- 172.21.15.150:0/608321690 shutdown_connections 2024-09-17T05:52:58.799 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:58.797+0000 7f1206c71640 1 -- 172.21.15.150:0/608321690 wait complete. 2024-09-17T05:52:58.810 DEBUG:teuthology.orchestra.run.smithi150:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'stat -c %h /home/ubuntu/cephtest/mnt.0/./volumes/_deleting') 2024-09-17T05:52:58.859 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:58 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-17T05:52:58.865 INFO:teuthology.orchestra.run.smithi150.stdout:2 2024-09-17T05:52:58.865 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:58 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T05:52:58.870 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mgr mgr/volumes/max_concurrent_clones 4 2024-09-17T05:52:58.987 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:58.986+0000 7fa61bd01640 1 -- 172.21.15.150:0/1964272930 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa6140b7d70 msgr2=0x7fa6140d0a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:52:58.987 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:58.986+0000 7fa61bd01640 1 --2- 172.21.15.150:0/1964272930 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa6140b7d70 0x7fa6140d0a80 secure :-1 s=READY pgs=1759 cs=0 l=1 rev1=1 crypto rx=0x7fa6140b3f20 tx=0x7fa60402a440 comp rx=0 tx=0).stop 2024-09-17T05:52:58.987 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:58.986+0000 7fa61bd01640 1 -- 172.21.15.150:0/1964272930 shutdown_connections 2024-09-17T05:52:58.988 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:58.986+0000 7fa61bd01640 1 --2- 172.21.15.150:0/1964272930 >> v2:172.21.15.176:3300/0 conn(0x7fa6140d0fc0 0x7fa6140cd0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:52:58.988 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:58.986+0000 7fa61bd01640 1 --2- 172.21.15.150:0/1964272930 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa6140b7d70 0x7fa6140d0a80 unknown :-1 s=CLOSED pgs=1759 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:52:58.988 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:58.986+0000 7fa61bd01640 1 -- 172.21.15.150:0/1964272930 >> 172.21.15.150:0/1964272930 conn(0x7fa6140cef20 msgr2=0x7fa6140cf330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:52:58.988 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:58.986+0000 7fa61bd01640 1 -- 172.21.15.150:0/1964272930 shutdown_connections 2024-09-17T05:52:58.988 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:58.986+0000 7fa61bd01640 1 -- 172.21.15.150:0/1964272930 wait complete. 2024-09-17T05:52:58.988 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:58.988+0000 7fa61bd01640 1 Processor -- start 2024-09-17T05:52:58.988 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:58.988+0000 7fa61bd01640 1 -- start start 2024-09-17T05:52:58.991 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:58.990+0000 7fa61bd01640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa6140b7960 0x7fa6141f95a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:52:58.991 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:58.990+0000 7fa61bd01640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa6140b7d70 0x7fa61415ff10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:52:58.992 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:58.990+0000 7fa61bd01640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa6140d0fc0 0x7fa6140b69b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:52:58.992 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:58.990+0000 7fa61bd01640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7fa6140af900 con 0x7fa6140d0fc0 2024-09-17T05:52:58.992 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:58.990+0000 7fa61bd01640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fa6140d1490 con 0x7fa6140b7960 2024-09-17T05:52:58.992 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:58.990+0000 7fa61bd01640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fa6141f5f10 con 0x7fa6140b7d70 2024-09-17T05:52:58.992 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:58.990+0000 7fa61a29e640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa6140d0fc0 0x7fa6140b69b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:52:58.992 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:58.990+0000 7fa61a29e640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa6140d0fc0 0x7fa6140b69b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:38350/0 (socket says 172.21.15.150:38350) 2024-09-17T05:52:58.992 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:58.990+0000 7fa61a29e640 1 -- 172.21.15.150:0/1375294293 learned_addr learned my addr 172.21.15.150:0/1375294293 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:52:58.992 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:58.990+0000 7fa619a9d640 1 --2- 172.21.15.150:0/1375294293 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa6140b7960 0x7fa6141f95a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:52:58.992 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:58.990+0000 7fa61929c640 1 --2- 172.21.15.150:0/1375294293 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa6140b7d70 0x7fa61415ff10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:52:58.992 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:58.990+0000 7fa61a29e640 1 -- 172.21.15.150:0/1375294293 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa6140b7d70 msgr2=0x7fa61415ff10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:52:58.992 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:58.990+0000 7fa61a29e640 1 --2- 172.21.15.150:0/1375294293 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa6140b7d70 0x7fa61415ff10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:52:58.992 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:58.990+0000 7fa61a29e640 1 -- 172.21.15.150:0/1375294293 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa6140b7960 msgr2=0x7fa6141f95a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:52:58.993 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:58.990+0000 7fa61a29e640 1 --2- 172.21.15.150:0/1375294293 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa6140b7960 0x7fa6141f95a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:52:58.993 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:58.990+0000 7fa61a29e640 1 -- 172.21.15.150:0/1375294293 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa6141f9f80 con 0x7fa6140d0fc0 2024-09-17T05:52:58.993 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:58.990+0000 7fa61a29e640 1 --2- 172.21.15.150:0/1375294293 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa6140d0fc0 0x7fa6140b69b0 secure :-1 s=READY pgs=1760 cs=0 l=1 rev1=1 crypto rx=0x7fa60c00d650 tx=0x7fa60c00db10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:52:58.994 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:58.992+0000 7fa60a7fc640 1 -- 172.21.15.150:0/1375294293 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa60c017070 con 0x7fa6140d0fc0 2024-09-17T05:52:58.994 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:58.992+0000 7fa61bd01640 1 -- 172.21.15.150:0/1375294293 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa6141fa260 con 0x7fa6140d0fc0 2024-09-17T05:52:58.994 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:58.992+0000 7fa60a7fc640 1 -- 172.21.15.150:0/1375294293 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa60c005310 con 0x7fa6140d0fc0 2024-09-17T05:52:58.994 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:58.992+0000 7fa60a7fc640 1 -- 172.21.15.150:0/1375294293 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa60c009820 con 0x7fa6140d0fc0 2024-09-17T05:52:58.994 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:58.992+0000 7fa61bd01640 1 -- 172.21.15.150:0/1375294293 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa614160450 con 0x7fa6140d0fc0 2024-09-17T05:52:58.994 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:58.993+0000 7fa61bd01640 1 -- 172.21.15.150:0/1375294293 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa6141fa4a0 con 0x7fa6140d0fc0 2024-09-17T05:52:58.994 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:58.993+0000 7fa60a7fc640 1 -- 172.21.15.150:0/1375294293 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 44) ==== 104450+0+0 (secure 0 0 0) 0x7fa60c0099c0 con 0x7fa6140d0fc0 2024-09-17T05:52:58.995 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:58.994+0000 7fa60a7fc640 1 --2- 172.21.15.150:0/1375294293 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fa5f807acf0 0x7fa5f807d200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:52:58.995 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:58.994+0000 7fa60a7fc640 1 -- 172.21.15.150:0/1375294293 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(129..129 src has 1..129) ==== 5935+0+0 (secure 0 0 0) 0x7fa60c099d80 con 0x7fa6140d0fc0 2024-09-17T05:52:58.995 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:58.994+0000 7fa619a9d640 1 --2- 172.21.15.150:0/1375294293 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fa5f807acf0 0x7fa5f807d200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:52:58.995 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:58.995+0000 7fa619a9d640 1 --2- 172.21.15.150:0/1375294293 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fa5f807acf0 0x7fa5f807d200 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 crypto rx=0x7fa6140d2470 tx=0x7fa61000d040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:52:58.999 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:58.999+0000 7fa60a7fc640 1 -- 172.21.15.150:0/1375294293 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fa6141fa4a0 con 0x7fa6140d0fc0 2024-09-17T05:52:59.175 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:59.174+0000 7fa61bd01640 1 -- 172.21.15.150:0/1375294293 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command([{prefix=config set, name=mgr/volumes/max_concurrent_clones}] v 0) -- 0x7fa6141f9d10 con 0x7fa6140d0fc0 2024-09-17T05:52:59.175 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:59.174+0000 7fa60a7fc640 1 -- 172.21.15.150:0/1375294293 <== mon.0 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/volumes/max_concurrent_clones}]=0 v56)=0 v56) ==== 131+0+0 (secure 0 0 0) 0x7fa60c063680 con 0x7fa6140d0fc0 2024-09-17T05:52:59.178 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:59.176+0000 7fa61bd01640 1 -- 172.21.15.150:0/1375294293 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fa5f807acf0 msgr2=0x7fa5f807d200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:52:59.178 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:59.176+0000 7fa61bd01640 1 --2- 172.21.15.150:0/1375294293 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fa5f807acf0 0x7fa5f807d200 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 crypto rx=0x7fa6140d2470 tx=0x7fa61000d040 comp rx=0 tx=0).stop 2024-09-17T05:52:59.178 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:59.176+0000 7fa61bd01640 1 -- 172.21.15.150:0/1375294293 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa6140d0fc0 msgr2=0x7fa6140b69b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:52:59.178 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:59.176+0000 7fa61bd01640 1 --2- 172.21.15.150:0/1375294293 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa6140d0fc0 0x7fa6140b69b0 secure :-1 s=READY pgs=1760 cs=0 l=1 rev1=1 crypto rx=0x7fa60c00d650 tx=0x7fa60c00db10 comp rx=0 tx=0).stop 2024-09-17T05:52:59.178 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:59.176+0000 7fa61bd01640 1 -- 172.21.15.150:0/1375294293 shutdown_connections 2024-09-17T05:52:59.178 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:59.176+0000 7fa61bd01640 1 --2- 172.21.15.150:0/1375294293 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fa5f807acf0 0x7fa5f807d200 unknown :-1 s=CLOSED pgs=745 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:52:59.178 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:59.176+0000 7fa61bd01640 1 --2- 172.21.15.150:0/1375294293 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa6140d0fc0 0x7fa6140b69b0 unknown :-1 s=CLOSED pgs=1760 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:52:59.178 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:59.176+0000 7fa61bd01640 1 --2- 172.21.15.150:0/1375294293 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa6140b7d70 0x7fa61415ff10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:52:59.179 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:59.176+0000 7fa61bd01640 1 --2- 172.21.15.150:0/1375294293 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa6140b7960 0x7fa6141f95a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:52:59.179 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:59.176+0000 7fa61bd01640 1 -- 172.21.15.150:0/1375294293 >> 172.21.15.150:0/1375294293 conn(0x7fa6140cef20 msgr2=0x7fa6140ce190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:52:59.179 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:59.177+0000 7fa61bd01640 1 -- 172.21.15.150:0/1375294293 shutdown_connections 2024-09-17T05:52:59.179 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:59.177+0000 7fa61bd01640 1 -- 172.21.15.150:0/1375294293 wait complete. 2024-09-17T05:52:59.189 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-17T05:52:59.189 DEBUG:teuthology.orchestra.run.smithi150:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-17T05:52:59.237 DEBUG:teuthology.orchestra.run.smithi176:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-17T05:52:59.287 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-17T05:52:59.287 INFO:tasks.cephfs.mount:Terminating background process 2024-09-17T05:52:59.287 DEBUG:teuthology.orchestra.run.smithi150:> set -ex 2024-09-17T05:52:59.288 DEBUG:teuthology.orchestra.run.smithi150:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T05:52:59.304 DEBUG:teuthology.orchestra.run.smithi150:> set -ex 2024-09-17T05:52:59.304 DEBUG:teuthology.orchestra.run.smithi150:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T05:52:59.359 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-17T05:52:59.515 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:59.514+0000 7fbd87de6640 1 -- 172.21.15.150:0/593713431 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbd800b78c0 msgr2=0x7fbd800d0330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:52:59.515 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:59.514+0000 7fbd87de6640 1 --2- 172.21.15.150:0/593713431 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbd800b78c0 0x7fbd800d0330 secure :-1 s=READY pgs=1761 cs=0 l=1 rev1=1 crypto rx=0x7fbd800b5820 tx=0x7fbd7002a4d0 comp rx=0 tx=0).stop 2024-09-17T05:52:59.515 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:59.514+0000 7fbd87de6640 1 -- 172.21.15.150:0/593713431 shutdown_connections 2024-09-17T05:52:59.516 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:59.514+0000 7fbd87de6640 1 --2- 172.21.15.150:0/593713431 >> v2:172.21.15.176:3300/0 conn(0x7fbd800b6320 0x7fbd800b6730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:52:59.516 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:59.514+0000 7fbd87de6640 1 --2- 172.21.15.150:0/593713431 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbd800b78c0 0x7fbd800d0330 unknown :-1 s=CLOSED pgs=1761 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:52:59.516 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:59.514+0000 7fbd87de6640 1 -- 172.21.15.150:0/593713431 >> 172.21.15.150:0/593713431 conn(0x7fbd8008bfe0 msgr2=0x7fbd800d4660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:52:59.516 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:59.514+0000 7fbd87de6640 1 -- 172.21.15.150:0/593713431 shutdown_connections 2024-09-17T05:52:59.516 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:59.514+0000 7fbd87de6640 1 -- 172.21.15.150:0/593713431 wait complete. 2024-09-17T05:52:59.517 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:59.515+0000 7fbd87de6640 1 Processor -- start 2024-09-17T05:52:59.517 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:59.516+0000 7fbd87de6640 1 -- start start 2024-09-17T05:52:59.520 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:59.517+0000 7fbd87de6640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fbd800b6320 0x7fbd801f6720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:52:59.520 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:59.517+0000 7fbd87de6640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fbd800b74b0 0x7fbd800ccac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:52:59.520 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:59.517+0000 7fbd87de6640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbd800b78c0 0x7fbd800cd680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:52:59.520 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:59.517+0000 7fbd87de6640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7fbd800b54e0 con 0x7fbd800b78c0 2024-09-17T05:52:59.520 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:59.517+0000 7fbd87de6640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fbd800b5360 con 0x7fbd800b6320 2024-09-17T05:52:59.520 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:59.517+0000 7fbd87de6640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fbd80169330 con 0x7fbd800b74b0 2024-09-17T05:52:59.520 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:59.517+0000 7fbd86383640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbd800b78c0 0x7fbd800cd680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:52:59.520 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:59.517+0000 7fbd86383640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbd800b78c0 0x7fbd800cd680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:38368/0 (socket says 172.21.15.150:38368) 2024-09-17T05:52:59.521 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:59.517+0000 7fbd86383640 1 -- 172.21.15.150:0/3744780096 learned_addr learned my addr 172.21.15.150:0/3744780096 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:52:59.521 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:59.517+0000 7fbd85b82640 1 --2- 172.21.15.150:0/3744780096 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fbd800b6320 0x7fbd801f6720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:52:59.521 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:59.517+0000 7fbd85381640 1 --2- 172.21.15.150:0/3744780096 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fbd800b74b0 0x7fbd800ccac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:52:59.521 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:59.517+0000 7fbd86383640 1 -- 172.21.15.150:0/3744780096 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fbd800b74b0 msgr2=0x7fbd800ccac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:52:59.521 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:59.517+0000 7fbd86383640 1 --2- 172.21.15.150:0/3744780096 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fbd800b74b0 0x7fbd800ccac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:52:59.521 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:59.517+0000 7fbd86383640 1 -- 172.21.15.150:0/3744780096 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fbd800b6320 msgr2=0x7fbd801f6720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:52:59.521 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:59.517+0000 7fbd86383640 1 --2- 172.21.15.150:0/3744780096 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fbd800b6320 0x7fbd801f6720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:52:59.521 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:59.517+0000 7fbd86383640 1 -- 172.21.15.150:0/3744780096 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbd8015f230 con 0x7fbd800b78c0 2024-09-17T05:52:59.521 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:59.517+0000 7fbd85381640 1 --2- 172.21.15.150:0/3744780096 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fbd800b74b0 0x7fbd800ccac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T05:52:59.521 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:59.517+0000 7fbd86383640 1 --2- 172.21.15.150:0/3744780096 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbd800b78c0 0x7fbd800cd680 secure :-1 s=READY pgs=1762 cs=0 l=1 rev1=1 crypto rx=0x7fbd7800e9f0 tx=0x7fbd7800eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:52:59.521 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:59.518+0000 7fbd767fc640 1 -- 172.21.15.150:0/3744780096 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd78004d20 con 0x7fbd800b78c0 2024-09-17T05:52:59.522 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:59.518+0000 7fbd767fc640 1 -- 172.21.15.150:0/3744780096 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fbd7800cb20 con 0x7fbd800b78c0 2024-09-17T05:52:59.522 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:59.518+0000 7fbd87de6640 1 -- 172.21.15.150:0/3744780096 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbd8015f510 con 0x7fbd800b78c0 2024-09-17T05:52:59.522 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:59.518+0000 7fbd767fc640 1 -- 172.21.15.150:0/3744780096 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd78005020 con 0x7fbd800b78c0 2024-09-17T05:52:59.522 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:59.518+0000 7fbd87de6640 1 -- 172.21.15.150:0/3744780096 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbd8015fad0 con 0x7fbd800b78c0 2024-09-17T05:52:59.522 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:59.519+0000 7fbd87de6640 1 -- 172.21.15.150:0/3744780096 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbd800d4300 con 0x7fbd800b78c0 2024-09-17T05:52:59.522 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:59.519+0000 7fbd767fc640 1 -- 172.21.15.150:0/3744780096 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 44) ==== 104450+0+0 (secure 0 0 0) 0x7fbd780051c0 con 0x7fbd800b78c0 2024-09-17T05:52:59.523 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:59.520+0000 7fbd767fc640 1 --2- 172.21.15.150:0/3744780096 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fbd6407acc0 0x7fbd6407d1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:52:59.523 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:59.520+0000 7fbd767fc640 1 -- 172.21.15.150:0/3744780096 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(129..129 src has 1..129) ==== 5935+0+0 (secure 0 0 0) 0x7fbd7809a700 con 0x7fbd800b78c0 2024-09-17T05:52:59.523 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:59.520+0000 7fbd85b82640 1 --2- 172.21.15.150:0/3744780096 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fbd6407acc0 0x7fbd6407d1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:52:59.523 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:59.521+0000 7fbd85b82640 1 --2- 172.21.15.150:0/3744780096 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fbd6407acc0 0x7fbd6407d1d0 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 crypto rx=0x7fbd7c00b7f0 tx=0x7fbd7c008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:52:59.525 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:59.525+0000 7fbd767fc640 1 -- 172.21.15.150:0/3744780096 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fbd800d4300 con 0x7fbd800b78c0 2024-09-17T05:52:59.713 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:59.713+0000 7fbd87de6640 1 -- 172.21.15.150:0/3744780096 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7fbd8008caf0 con 0x7fbd800b78c0 2024-09-17T05:52:59.714 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:59.713+0000 7fbd767fc640 1 -- 172.21.15.150:0/3744780096 <== mon.0 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v129) ==== 80+0+0 (secure 0 0 0) 0x7fbd8008caf0 con 0x7fbd800b78c0 2024-09-17T05:52:59.714 INFO:teuthology.orchestra.run.smithi150.stderr:listed 0 entries 2024-09-17T05:52:59.716 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:59.715+0000 7fbd87de6640 1 -- 172.21.15.150:0/3744780096 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fbd6407acc0 msgr2=0x7fbd6407d1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:52:59.717 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:59.715+0000 7fbd87de6640 1 --2- 172.21.15.150:0/3744780096 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fbd6407acc0 0x7fbd6407d1d0 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 crypto rx=0x7fbd7c00b7f0 tx=0x7fbd7c008040 comp rx=0 tx=0).stop 2024-09-17T05:52:59.717 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:59.715+0000 7fbd87de6640 1 -- 172.21.15.150:0/3744780096 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbd800b78c0 msgr2=0x7fbd800cd680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:52:59.717 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:59.715+0000 7fbd87de6640 1 --2- 172.21.15.150:0/3744780096 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbd800b78c0 0x7fbd800cd680 secure :-1 s=READY pgs=1762 cs=0 l=1 rev1=1 crypto rx=0x7fbd7800e9f0 tx=0x7fbd7800eeb0 comp rx=0 tx=0).stop 2024-09-17T05:52:59.717 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:59.715+0000 7fbd87de6640 1 -- 172.21.15.150:0/3744780096 shutdown_connections 2024-09-17T05:52:59.717 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:59.715+0000 7fbd87de6640 1 --2- 172.21.15.150:0/3744780096 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fbd6407acc0 0x7fbd6407d1d0 unknown :-1 s=CLOSED pgs=746 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:52:59.717 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:59.715+0000 7fbd87de6640 1 --2- 172.21.15.150:0/3744780096 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbd800b78c0 0x7fbd800cd680 unknown :-1 s=CLOSED pgs=1762 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:52:59.717 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:59.715+0000 7fbd87de6640 1 --2- 172.21.15.150:0/3744780096 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fbd800b74b0 0x7fbd800ccac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:52:59.717 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:59.715+0000 7fbd87de6640 1 --2- 172.21.15.150:0/3744780096 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fbd800b6320 0x7fbd801f6720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:52:59.717 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:59.715+0000 7fbd87de6640 1 -- 172.21.15.150:0/3744780096 >> 172.21.15.150:0/3744780096 conn(0x7fbd8008bfe0 msgr2=0x7fbd8006e5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:52:59.717 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:59.716+0000 7fbd87de6640 1 -- 172.21.15.150:0/3744780096 shutdown_connections 2024-09-17T05:52:59.717 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:52:59.716+0000 7fbd87de6640 1 -- 172.21.15.150:0/3744780096 wait complete. 2024-09-17T05:52:59.728 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-09-17T05:52:59.728 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:52:59.728 DEBUG:teuthology.orchestra.run.smithi150:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-09-17T05:52:59.772 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi150.front.sepia.ceph.com 2024-09-17T05:52:59.772 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:52:59.772 DEBUG:teuthology.orchestra.run.smithi150:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-17T05:52:59.828 INFO:tasks.cephfs.mount:Terminating background process 2024-09-17T05:52:59.828 DEBUG:teuthology.orchestra.run.smithi176:> set -ex 2024-09-17T05:52:59.829 DEBUG:teuthology.orchestra.run.smithi176:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T05:52:59.846 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056030,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497468k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=3379 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248732k,nr_inodes=812183,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497468k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-17T05:52:59.846 INFO:tasks.cephfs.mount:Terminating background process 2024-09-17T05:52:59.846 DEBUG:teuthology.orchestra.run.smithi150:> set -ex 2024-09-17T05:52:59.846 DEBUG:teuthology.orchestra.run.smithi150:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T05:52:59.885 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056027,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497464k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=18693 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248728k,nr_inodes=812182,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497464k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-17T05:52:59.885 INFO:tasks.cephfs.mount:Terminating background process 2024-09-17T05:52:59.885 DEBUG:teuthology.orchestra.run.smithi176:> set -ex 2024-09-17T05:52:59.885 DEBUG:teuthology.orchestra.run.smithi176:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T05:52:59.903 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056030,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497468k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=3379 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248732k,nr_inodes=812183,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497468k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-17T05:52:59.903 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T05:53:00.042 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:00.041+0000 7fcba2951640 1 -- 172.21.15.150:0/1791805681 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fcb9c15ee30 msgr2=0x7fcb9c0b2840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:53:00.042 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:00.041+0000 7fcba2951640 1 --2- 172.21.15.150:0/1791805681 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fcb9c15ee30 0x7fcb9c0b2840 secure :-1 s=READY pgs=1764 cs=0 l=1 rev1=1 crypto rx=0x7fcb8c009830 tx=0x7fcb8c02a5c0 comp rx=0 tx=0).stop 2024-09-17T05:53:00.042 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:00.041+0000 7fcba2951640 1 -- 172.21.15.150:0/1791805681 shutdown_connections 2024-09-17T05:53:00.042 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:00.041+0000 7fcba2951640 1 --2- 172.21.15.150:0/1791805681 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fcb9c15ee30 0x7fcb9c0b2840 unknown :-1 s=CLOSED pgs=1764 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:53:00.042 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:00.041+0000 7fcba2951640 1 -- 172.21.15.150:0/1791805681 >> 172.21.15.150:0/1791805681 conn(0x7fcb9c0b2fd0 msgr2=0x7fcb9c0b33e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:53:00.043 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:00.041+0000 7fcba2951640 1 -- 172.21.15.150:0/1791805681 shutdown_connections 2024-09-17T05:53:00.043 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:00.041+0000 7fcba2951640 1 -- 172.21.15.150:0/1791805681 wait complete. 2024-09-17T05:53:00.043 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:00.043+0000 7fcba2951640 1 Processor -- start 2024-09-17T05:53:00.043 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:00.043+0000 7fcba2951640 1 -- start start 2024-09-17T05:53:00.048 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:00.044+0000 7fcba2951640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fcb9c0b5410 0x7fcb9c1f6180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:53:00.048 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:00.044+0000 7fcba2951640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fcb9c0cf7c0 0x7fcb9c1f69c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:53:00.048 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:00.044+0000 7fcba2951640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fcb9c15ee30 0x7fcb9c0b05d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:53:00.048 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:00.044+0000 7fcba2951640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7fcb9c0b6370 con 0x7fcb9c15ee30 2024-09-17T05:53:00.048 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:00.044+0000 7fcba2951640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fcb9c0b61f0 con 0x7fcb9c0b5410 2024-09-17T05:53:00.049 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:00.044+0000 7fcba2951640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fcb9c0b64f0 con 0x7fcb9c0cf7c0 2024-09-17T05:53:00.049 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:00.044+0000 7fcba0eee640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fcb9c15ee30 0x7fcb9c0b05d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:53:00.049 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:00.044+0000 7fcba0eee640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fcb9c15ee30 0x7fcb9c0b05d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:38384/0 (socket says 172.21.15.150:38384) 2024-09-17T05:53:00.049 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:00.044+0000 7fcba0eee640 1 -- 172.21.15.150:0/2892322685 learned_addr learned my addr 172.21.15.150:0/2892322685 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:53:00.049 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:00.044+0000 7fcb9bfff640 1 --2- 172.21.15.150:0/2892322685 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fcb9c0b5410 0x7fcb9c1f6180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:53:00.049 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:00.044+0000 7fcb9b7fe640 1 --2- 172.21.15.150:0/2892322685 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fcb9c0cf7c0 0x7fcb9c1f69c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:53:00.049 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:00.045+0000 7fcba0eee640 1 -- 172.21.15.150:0/2892322685 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fcb9c0cf7c0 msgr2=0x7fcb9c1f69c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:53:00.049 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:00.045+0000 7fcba0eee640 1 --2- 172.21.15.150:0/2892322685 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fcb9c0cf7c0 0x7fcb9c1f69c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:53:00.050 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:00.045+0000 7fcba0eee640 1 -- 172.21.15.150:0/2892322685 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fcb9c0b5410 msgr2=0x7fcb9c1f6180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:53:00.050 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:00.045+0000 7fcba0eee640 1 --2- 172.21.15.150:0/2892322685 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fcb9c0b5410 0x7fcb9c1f6180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:53:00.050 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:00.045+0000 7fcba0eee640 1 -- 172.21.15.150:0/2892322685 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcb9c1f66c0 con 0x7fcb9c15ee30 2024-09-17T05:53:00.050 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:00.045+0000 7fcba0eee640 1 --2- 172.21.15.150:0/2892322685 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fcb9c15ee30 0x7fcb9c0b05d0 secure :-1 s=READY pgs=1765 cs=0 l=1 rev1=1 crypto rx=0x7fcb9400c760 tx=0x7fcb9400cb60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:53:00.050 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:00.045+0000 7fcb98ff9640 1 -- 172.21.15.150:0/2892322685 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb94003b70 con 0x7fcb9c15ee30 2024-09-17T05:53:00.050 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:00.045+0000 7fcb98ff9640 1 -- 172.21.15.150:0/2892322685 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fcb94003d10 con 0x7fcb9c15ee30 2024-09-17T05:53:00.050 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:00.045+0000 7fcb98ff9640 1 -- 172.21.15.150:0/2892322685 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb940052d0 con 0x7fcb9c15ee30 2024-09-17T05:53:00.050 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:00.045+0000 7fcba2951640 1 -- 172.21.15.150:0/2892322685 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcb9c1f4450 con 0x7fcb9c15ee30 2024-09-17T05:53:00.050 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:00.045+0000 7fcba2951640 1 -- 172.21.15.150:0/2892322685 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcb9c0c4f60 con 0x7fcb9c15ee30 2024-09-17T05:53:00.051 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:00.046+0000 7fcba2951640 1 -- 172.21.15.150:0/2892322685 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcb9c1f7470 con 0x7fcb9c15ee30 2024-09-17T05:53:00.051 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:00.047+0000 7fcb98ff9640 1 -- 172.21.15.150:0/2892322685 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 45) ==== 104501+0+0 (secure 0 0 0) 0x7fcb94005470 con 0x7fcb9c15ee30 2024-09-17T05:53:00.051 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:00.047+0000 7fcb98ff9640 1 --2- 172.21.15.150:0/2892322685 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fcb7c07ad50 0x7fcb7c07d260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:53:00.051 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:00.047+0000 7fcb98ff9640 1 -- 172.21.15.150:0/2892322685 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(129..129 src has 1..129) ==== 5935+0+0 (secure 0 0 0) 0x7fcb94099ac0 con 0x7fcb9c15ee30 2024-09-17T05:53:00.051 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:00.047+0000 7fcb9bfff640 1 --2- 172.21.15.150:0/2892322685 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fcb7c07ad50 0x7fcb7c07d260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:53:00.051 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:00.048+0000 7fcb9bfff640 1 --2- 172.21.15.150:0/2892322685 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fcb7c07ad50 0x7fcb7c07d260 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 crypto rx=0x7fcb8c034000 tx=0x7fcb8c004730 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:53:00.053 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:00.052+0000 7fcb98ff9640 1 -- 172.21.15.150:0/2892322685 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fcb9c1f66c0 con 0x7fcb9c15ee30 2024-09-17T05:53:00.260 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:00.259+0000 7fcba2951640 1 -- 172.21.15.150:0/2892322685 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fcb9c0b69e0 con 0x7fcb9c15ee30 2024-09-17T05:53:00.261 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:00.260+0000 7fcb98ff9640 1 -- 172.21.15.150:0/2892322685 <== mon.0 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 81 v81) ==== 94+0+5234 (secure 0 0 0) 0x7fcb940633b0 con 0x7fcb9c15ee30 2024-09-17T05:53:00.261 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-09-17T05:53:00.261 INFO:teuthology.orchestra.run.smithi150.stdout:{"epoch":81,"btime":"2024-09-17T05:52:32:156241+0000","default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":9123,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6834/2232109291","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6832","nonce":2232109291},{"type":"v1","addr":"172.21.15.150:6834","nonce":2232109291}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":74},{"gid":9126,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6835/423416474","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6833","nonce":423416474},{"type":"v1","addr":"172.21.15.150:6835","nonce":423416474}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":75},{"gid":9138,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6837/2582017817","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6835","nonce":2582017817},{"type":"v1","addr":"172.21.15.176:6837","nonce":2582017817}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":75}],"filesystems":[{"mdsmap":{"epoch":80,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T05:52:19.257101+0000","modified":"2024-09-17T05:52:22.283372+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":9141},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9141":{"gid":9141,"name":"d","rank":0,"incarnation":76,"state":"up:active","state_seq":3,"addr":"172.21.15.176:6836/1926613940","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6834","nonce":1926613940},{"type":"v1","addr":"172.21.15.176:6836","nonce":1926613940}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[19],"metadata_pool":18,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":9141,"qdb_cluster":[9141]},"id":9}]} 2024-09-17T05:53:00.261 INFO:teuthology.orchestra.run.smithi150.stderr:dumped fsmap epoch 81 2024-09-17T05:53:00.263 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:00.262+0000 7fcba2951640 1 -- 172.21.15.150:0/2892322685 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fcb7c07ad50 msgr2=0x7fcb7c07d260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:53:00.263 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:00.262+0000 7fcba2951640 1 --2- 172.21.15.150:0/2892322685 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fcb7c07ad50 0x7fcb7c07d260 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 crypto rx=0x7fcb8c034000 tx=0x7fcb8c004730 comp rx=0 tx=0).stop 2024-09-17T05:53:00.263 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:00.262+0000 7fcba2951640 1 -- 172.21.15.150:0/2892322685 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fcb9c15ee30 msgr2=0x7fcb9c0b05d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:53:00.263 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:00.262+0000 7fcba2951640 1 --2- 172.21.15.150:0/2892322685 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fcb9c15ee30 0x7fcb9c0b05d0 secure :-1 s=READY pgs=1765 cs=0 l=1 rev1=1 crypto rx=0x7fcb9400c760 tx=0x7fcb9400cb60 comp rx=0 tx=0).stop 2024-09-17T05:53:00.263 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:00.262+0000 7fcba2951640 1 -- 172.21.15.150:0/2892322685 shutdown_connections 2024-09-17T05:53:00.264 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:00.262+0000 7fcba2951640 1 --2- 172.21.15.150:0/2892322685 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fcb7c07ad50 0x7fcb7c07d260 unknown :-1 s=CLOSED pgs=747 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:53:00.264 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:00.262+0000 7fcba2951640 1 --2- 172.21.15.150:0/2892322685 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fcb9c15ee30 0x7fcb9c0b05d0 unknown :-1 s=CLOSED pgs=1765 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:53:00.264 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:00.262+0000 7fcba2951640 1 --2- 172.21.15.150:0/2892322685 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fcb9c0cf7c0 0x7fcb9c1f69c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:53:00.264 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:00.262+0000 7fcba2951640 1 --2- 172.21.15.150:0/2892322685 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fcb9c0b5410 0x7fcb9c1f6180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:53:00.264 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:00.262+0000 7fcba2951640 1 -- 172.21.15.150:0/2892322685 >> 172.21.15.150:0/2892322685 conn(0x7fcb9c0b2fd0 msgr2=0x7fcb9c15d4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:53:00.264 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:00.262+0000 7fcba2951640 1 -- 172.21.15.150:0/2892322685 shutdown_connections 2024-09-17T05:53:00.264 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:00.262+0000 7fcba2951640 1 -- 172.21.15.150:0/2892322685 wait complete. 2024-09-17T05:53:00.276 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T05:53:00.390 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:00.389+0000 7f55fb97b640 1 -- 172.21.15.150:0/1158694043 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f55f40d11d0 msgr2=0x7f55f41638c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:53:00.390 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:00.389+0000 7f55fb97b640 1 --2- 172.21.15.150:0/1158694043 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f55f40d11d0 0x7f55f41638c0 secure :-1 s=READY pgs=1767 cs=0 l=1 rev1=1 crypto rx=0x7f55f409bf60 tx=0x7f55ec02aa80 comp rx=0 tx=0).stop 2024-09-17T05:53:00.390 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:00.389+0000 7f55fb97b640 1 -- 172.21.15.150:0/1158694043 shutdown_connections 2024-09-17T05:53:00.390 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:00.389+0000 7f55fb97b640 1 --2- 172.21.15.150:0/1158694043 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f55f40d11d0 0x7f55f41638c0 unknown :-1 s=CLOSED pgs=1767 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:53:00.390 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:00.389+0000 7f55fb97b640 1 --2- 172.21.15.150:0/1158694043 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f55f40d03b0 0x7f55f40d07c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:53:00.390 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:00.389+0000 7f55fb97b640 1 -- 172.21.15.150:0/1158694043 >> 172.21.15.150:0/1158694043 conn(0x7f55f40cef30 msgr2=0x7f55f40cf340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:53:00.390 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:00.389+0000 7f55fb97b640 1 -- 172.21.15.150:0/1158694043 shutdown_connections 2024-09-17T05:53:00.390 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:00.389+0000 7f55fb97b640 1 -- 172.21.15.150:0/1158694043 wait complete. 2024-09-17T05:53:00.391 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:00.390+0000 7f55fb97b640 1 Processor -- start 2024-09-17T05:53:00.391 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:00.391+0000 7f55fb97b640 1 -- start start 2024-09-17T05:53:00.394 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:00.392+0000 7f55fb97b640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f55f40d03b0 0x7f55f406f270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:53:00.394 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:00.392+0000 7f55fb97b640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f55f40d0dc0 0x7f55f406f7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:53:00.394 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:00.392+0000 7f55fb97b640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f55f40d11d0 0x7f55f40b02b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:53:00.394 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:00.392+0000 7f55fb97b640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f55f40b1a20 con 0x7f55f40d11d0 2024-09-17T05:53:00.394 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:00.392+0000 7f55fb97b640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f55f4070ff0 con 0x7f55f40d0dc0 2024-09-17T05:53:00.394 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:00.392+0000 7f55fb97b640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f55f40b78e0 con 0x7f55f40d03b0 2024-09-17T05:53:00.394 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:00.392+0000 7f55f9f18640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f55f40d11d0 0x7f55f40b02b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:53:00.394 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:00.392+0000 7f55f9f18640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f55f40d11d0 0x7f55f40b02b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:37372/0 (socket says 172.21.15.150:37372) 2024-09-17T05:53:00.394 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:00.392+0000 7f55f9f18640 1 -- 172.21.15.150:0/3000557429 learned_addr learned my addr 172.21.15.150:0/3000557429 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:53:00.395 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:00.392+0000 7f55f8f16640 1 --2- 172.21.15.150:0/3000557429 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f55f40d0dc0 0x7f55f406f7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:53:00.395 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:00.392+0000 7f55f9717640 1 --2- 172.21.15.150:0/3000557429 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f55f40d03b0 0x7f55f406f270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:53:00.395 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:00.392+0000 7f55f9f18640 1 -- 172.21.15.150:0/3000557429 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f55f40d03b0 msgr2=0x7f55f406f270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:53:00.395 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:00.392+0000 7f55f9f18640 1 --2- 172.21.15.150:0/3000557429 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f55f40d03b0 0x7f55f406f270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:53:00.395 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:00.392+0000 7f55f9f18640 1 -- 172.21.15.150:0/3000557429 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f55f40d0dc0 msgr2=0x7f55f406f7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:53:00.395 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:00.392+0000 7f55f9f18640 1 --2- 172.21.15.150:0/3000557429 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f55f40d0dc0 0x7f55f406f7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:53:00.395 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:00.392+0000 7f55f9f18640 1 -- 172.21.15.150:0/3000557429 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f55f415fa60 con 0x7f55f40d11d0 2024-09-17T05:53:00.395 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:00.392+0000 7f55f9f18640 1 --2- 172.21.15.150:0/3000557429 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f55f40d11d0 0x7f55f40b02b0 secure :-1 s=READY pgs=1768 cs=0 l=1 rev1=1 crypto rx=0x7f55ec009d60 tx=0x7f55ec003f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:53:00.395 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:00.393+0000 7f55e9ffb640 1 -- 172.21.15.150:0/3000557429 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55ec044070 con 0x7f55f40d11d0 2024-09-17T05:53:00.395 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:00.393+0000 7f55e9ffb640 1 -- 172.21.15.150:0/3000557429 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f55ec004250 con 0x7f55f40d11d0 2024-09-17T05:53:00.395 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:00.393+0000 7f55fb97b640 1 -- 172.21.15.150:0/3000557429 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f55f41f5f70 con 0x7f55f40d11d0 2024-09-17T05:53:00.395 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:00.393+0000 7f55e9ffb640 1 -- 172.21.15.150:0/3000557429 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55ec0046a0 con 0x7f55f40d11d0 2024-09-17T05:53:00.395 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:00.393+0000 7f55fb97b640 1 -- 172.21.15.150:0/3000557429 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f55f41f6240 con 0x7f55f40d11d0 2024-09-17T05:53:00.396 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:00.394+0000 7f55fb97b640 1 -- 172.21.15.150:0/3000557429 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f55f415fcd0 con 0x7f55f40d11d0 2024-09-17T05:53:00.396 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:00.395+0000 7f55e9ffb640 1 -- 172.21.15.150:0/3000557429 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 45) ==== 104501+0+0 (secure 0 0 0) 0x7f55ec047070 con 0x7f55f40d11d0 2024-09-17T05:53:00.397 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:00.395+0000 7f55e9ffb640 1 --2- 172.21.15.150:0/3000557429 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f55d807ad80 0x7f55d807d290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:53:00.397 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:00.395+0000 7f55e9ffb640 1 -- 172.21.15.150:0/3000557429 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(129..129 src has 1..129) ==== 5935+0+0 (secure 0 0 0) 0x7f55ec0badc0 con 0x7f55f40d11d0 2024-09-17T05:53:00.397 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:00.395+0000 7f55f9717640 1 --2- 172.21.15.150:0/3000557429 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f55d807ad80 0x7f55d807d290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:53:00.397 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:00.396+0000 7f55f9717640 1 --2- 172.21.15.150:0/3000557429 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f55d807ad80 0x7f55d807d290 secure :-1 s=READY pgs=748 cs=0 l=1 rev1=1 crypto rx=0x7f55f406e000 tx=0x7f55f0005f90 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:53:00.400 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:00.400+0000 7f55e9ffb640 1 -- 172.21.15.150:0/3000557429 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f55ec032030 con 0x7f55f40d11d0 2024-09-17T05:53:00.610 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:00.609+0000 7f55fb97b640 1 -- 172.21.15.150:0/3000557429 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f55f40d07c0 con 0x7f55f40d11d0 2024-09-17T05:53:00.610 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:00.610+0000 7f55e9ffb640 1 -- 172.21.15.150:0/3000557429 <== mon.0 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 81 v81) ==== 94+0+5234 (secure 0 0 0) 0x7f55ec084740 con 0x7f55f40d11d0 2024-09-17T05:53:00.610 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-09-17T05:53:00.611 INFO:teuthology.orchestra.run.smithi150.stdout:{"epoch":81,"btime":"2024-09-17T05:52:32:156241+0000","default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":9123,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6834/2232109291","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6832","nonce":2232109291},{"type":"v1","addr":"172.21.15.150:6834","nonce":2232109291}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":74},{"gid":9126,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6835/423416474","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6833","nonce":423416474},{"type":"v1","addr":"172.21.15.150:6835","nonce":423416474}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":75},{"gid":9138,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6837/2582017817","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6835","nonce":2582017817},{"type":"v1","addr":"172.21.15.176:6837","nonce":2582017817}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":75}],"filesystems":[{"mdsmap":{"epoch":80,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T05:52:19.257101+0000","modified":"2024-09-17T05:52:22.283372+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":9141},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9141":{"gid":9141,"name":"d","rank":0,"incarnation":76,"state":"up:active","state_seq":3,"addr":"172.21.15.176:6836/1926613940","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6834","nonce":1926613940},{"type":"v1","addr":"172.21.15.176:6836","nonce":1926613940}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[19],"metadata_pool":18,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":9141,"qdb_cluster":[9141]},"id":9}]} 2024-09-17T05:53:00.611 INFO:teuthology.orchestra.run.smithi150.stderr:dumped fsmap epoch 81 2024-09-17T05:53:00.613 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:00.612+0000 7f55fb97b640 1 -- 172.21.15.150:0/3000557429 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f55d807ad80 msgr2=0x7f55d807d290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:53:00.613 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:00.612+0000 7f55fb97b640 1 --2- 172.21.15.150:0/3000557429 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f55d807ad80 0x7f55d807d290 secure :-1 s=READY pgs=748 cs=0 l=1 rev1=1 crypto rx=0x7f55f406e000 tx=0x7f55f0005f90 comp rx=0 tx=0).stop 2024-09-17T05:53:00.613 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:00.612+0000 7f55fb97b640 1 -- 172.21.15.150:0/3000557429 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f55f40d11d0 msgr2=0x7f55f40b02b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:53:00.613 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:00.612+0000 7f55fb97b640 1 --2- 172.21.15.150:0/3000557429 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f55f40d11d0 0x7f55f40b02b0 secure :-1 s=READY pgs=1768 cs=0 l=1 rev1=1 crypto rx=0x7f55ec009d60 tx=0x7f55ec003f10 comp rx=0 tx=0).stop 2024-09-17T05:53:00.613 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:00.612+0000 7f55fb97b640 1 -- 172.21.15.150:0/3000557429 shutdown_connections 2024-09-17T05:53:00.613 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:00.612+0000 7f55fb97b640 1 --2- 172.21.15.150:0/3000557429 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f55f40d0dc0 0x7f55f406f7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:53:00.613 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:00.612+0000 7f55fb97b640 1 --2- 172.21.15.150:0/3000557429 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f55d807ad80 0x7f55d807d290 unknown :-1 s=CLOSED pgs=748 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:53:00.613 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:00.612+0000 7f55fb97b640 1 --2- 172.21.15.150:0/3000557429 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f55f40d11d0 0x7f55f40b02b0 unknown :-1 s=CLOSED pgs=1768 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:53:00.613 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:00.612+0000 7f55fb97b640 1 --2- 172.21.15.150:0/3000557429 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f55f40d03b0 0x7f55f406f270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:53:00.613 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:00.612+0000 7f55fb97b640 1 -- 172.21.15.150:0/3000557429 >> 172.21.15.150:0/3000557429 conn(0x7f55f40cef30 msgr2=0x7f55f4158150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:53:00.614 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:00.612+0000 7f55fb97b640 1 -- 172.21.15.150:0/3000557429 shutdown_connections 2024-09-17T05:53:00.614 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:00.612+0000 7f55fb97b640 1 -- 172.21.15.150:0/3000557429 wait complete. 2024-09-17T05:53:00.626 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T05:53:00.739 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:00.738+0000 7fe4e0fcf640 1 -- 172.21.15.150:0/3608380986 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe4dc0b7490 msgr2=0x7fe4dc0d0590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:53:00.739 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:00.738+0000 7fe4e0fcf640 1 --2- 172.21.15.150:0/3608380986 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe4dc0b7490 0x7fe4dc0d0590 secure :-1 s=READY pgs=1770 cs=0 l=1 rev1=1 crypto rx=0x7fe4cc009820 tx=0x7fe4cc02a510 comp rx=0 tx=0).stop 2024-09-17T05:53:00.739 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:00.738+0000 7fe4e0fcf640 1 -- 172.21.15.150:0/3608380986 shutdown_connections 2024-09-17T05:53:00.739 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:00.738+0000 7fe4e0fcf640 1 --2- 172.21.15.150:0/3608380986 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe4dc0b7490 0x7fe4dc0d0590 unknown :-1 s=CLOSED pgs=1770 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:53:00.739 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:00.738+0000 7fe4e0fcf640 1 -- 172.21.15.150:0/3608380986 >> 172.21.15.150:0/3608380986 conn(0x7fe4dc0cef30 msgr2=0x7fe4dc0cf340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:53:00.740 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:00.738+0000 7fe4e0fcf640 1 -- 172.21.15.150:0/3608380986 shutdown_connections 2024-09-17T05:53:00.740 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:00.738+0000 7fe4e0fcf640 1 -- 172.21.15.150:0/3608380986 wait complete. 2024-09-17T05:53:00.741 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:00.740+0000 7fe4e0fcf640 1 Processor -- start 2024-09-17T05:53:00.741 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:00.740+0000 7fe4e0fcf640 1 -- start start 2024-09-17T05:53:00.744 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:00.741+0000 7fe4e0fcf640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe4dc0b7490 0x7fe4dc1ca0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:53:00.744 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:00.741+0000 7fe4e0fcf640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe4dc0cd890 0x7fe4dc1ca630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:53:00.744 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:00.741+0000 7fe4e0fcf640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe4dc0d0ad0 0x7fe4dc1cab70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:53:00.744 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:00.741+0000 7fe4e0fcf640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7fe4dc0d14a0 con 0x7fe4dc0d0ad0 2024-09-17T05:53:00.744 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:00.742+0000 7fe4e0fcf640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fe4dc0ceb70 con 0x7fe4dc0b7490 2024-09-17T05:53:00.744 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:00.742+0000 7fe4e0fcf640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fe4dc1cb430 con 0x7fe4dc0cd890 2024-09-17T05:53:00.744 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:00.742+0000 7fe4dad9d640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe4dc0d0ad0 0x7fe4dc1cab70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:53:00.744 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:00.742+0000 7fe4dad9d640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe4dc0d0ad0 0x7fe4dc1cab70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:37382/0 (socket says 172.21.15.150:37382) 2024-09-17T05:53:00.744 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:00.742+0000 7fe4dad9d640 1 -- 172.21.15.150:0/3235270865 learned_addr learned my addr 172.21.15.150:0/3235270865 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:53:00.745 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:00.742+0000 7fe4da59c640 1 --2- 172.21.15.150:0/3235270865 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe4dc0b7490 0x7fe4dc1ca0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:53:00.745 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:00.742+0000 7fe4d1d9b640 1 --2- 172.21.15.150:0/3235270865 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe4dc0cd890 0x7fe4dc1ca630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:53:00.745 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:00.742+0000 7fe4dad9d640 1 -- 172.21.15.150:0/3235270865 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe4dc0cd890 msgr2=0x7fe4dc1ca630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:53:00.745 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:00.742+0000 7fe4dad9d640 1 --2- 172.21.15.150:0/3235270865 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe4dc0cd890 0x7fe4dc1ca630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:53:00.745 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:00.742+0000 7fe4dad9d640 1 -- 172.21.15.150:0/3235270865 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe4dc0b7490 msgr2=0x7fe4dc1ca0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:53:00.745 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:00.742+0000 7fe4dad9d640 1 --2- 172.21.15.150:0/3235270865 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe4dc0b7490 0x7fe4dc1ca0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:53:00.745 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:00.742+0000 7fe4dad9d640 1 -- 172.21.15.150:0/3235270865 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe4dc1e7440 con 0x7fe4dc0d0ad0 2024-09-17T05:53:00.745 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:00.742+0000 7fe4d1d9b640 1 --2- 172.21.15.150:0/3235270865 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe4dc0cd890 0x7fe4dc1ca630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T05:53:00.745 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:00.742+0000 7fe4dad9d640 1 --2- 172.21.15.150:0/3235270865 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe4dc0d0ad0 0x7fe4dc1cab70 secure :-1 s=READY pgs=1771 cs=0 l=1 rev1=1 crypto rx=0x7fe4d400b9a0 tx=0x7fe4d400be60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:53:00.745 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:00.742+0000 7fe4d37fe640 1 -- 172.21.15.150:0/3235270865 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4d4019070 con 0x7fe4dc0d0ad0 2024-09-17T05:53:00.745 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:00.742+0000 7fe4d37fe640 1 -- 172.21.15.150:0/3235270865 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe4d400cc90 con 0x7fe4dc0d0ad0 2024-09-17T05:53:00.745 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:00.742+0000 7fe4e0fcf640 1 -- 172.21.15.150:0/3235270865 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe4dc1e7720 con 0x7fe4dc0d0ad0 2024-09-17T05:53:00.745 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:00.742+0000 7fe4d37fe640 1 -- 172.21.15.150:0/3235270865 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4d40146a0 con 0x7fe4dc0d0ad0 2024-09-17T05:53:00.746 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:00.742+0000 7fe4e0fcf640 1 -- 172.21.15.150:0/3235270865 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe4dc1e7ce0 con 0x7fe4dc0d0ad0 2024-09-17T05:53:00.747 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:00.744+0000 7fe4e0fcf640 1 -- 172.21.15.150:0/3235270865 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe4dc0ce5d0 con 0x7fe4dc0d0ad0 2024-09-17T05:53:00.747 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:00.744+0000 7fe4d37fe640 1 -- 172.21.15.150:0/3235270865 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 45) ==== 104501+0+0 (secure 0 0 0) 0x7fe4d401c070 con 0x7fe4dc0d0ad0 2024-09-17T05:53:00.747 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:00.745+0000 7fe4d37fe640 1 --2- 172.21.15.150:0/3235270865 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fe4bc07ad50 0x7fe4bc07d260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:53:00.747 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:00.745+0000 7fe4d37fe640 1 -- 172.21.15.150:0/3235270865 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(129..129 src has 1..129) ==== 5935+0+0 (secure 0 0 0) 0x7fe4d4099cb0 con 0x7fe4dc0d0ad0 2024-09-17T05:53:00.747 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:00.745+0000 7fe4da59c640 1 --2- 172.21.15.150:0/3235270865 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fe4bc07ad50 0x7fe4bc07d260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:53:00.747 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:00.745+0000 7fe4da59c640 1 --2- 172.21.15.150:0/3235270865 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fe4bc07ad50 0x7fe4bc07d260 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 crypto rx=0x7fe4cc034000 tx=0x7fe4cc004730 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:53:00.750 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:00.749+0000 7fe4d37fe640 1 -- 172.21.15.150:0/3235270865 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fe4d4063b70 con 0x7fe4dc0d0ad0 2024-09-17T05:53:00.926 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:00.925+0000 7fe4e0fcf640 1 -- 172.21.15.150:0/3235270865 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fe4dc1e94c0 con 0x7fe4dc0d0ad0 2024-09-17T05:53:00.927 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:00.926+0000 7fe4d37fe640 1 -- 172.21.15.150:0/3235270865 <== mon.0 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v129) ==== 74+0+17139 (secure 0 0 0) 0x7fe4d4063470 con 0x7fe4dc0d0ad0 2024-09-17T05:53:00.927 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-09-17T05:53:00.927 INFO:teuthology.orchestra.run.smithi150.stdout:{"epoch":129,"fsid":"9f2e05e9-d629-47b3-b26b-1360655b7d20","created":"2024-09-17T05:41:32.502979+0000","modified":"2024-09-17T05:52:39.561423+0000","last_up_change":"2024-09-17T05:41:46.150225+0000","last_in_change":"2024-09-17T05:41:36.120274+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":19,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T05:41:46.860779+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":18,"pool_name":"cephfs_metadata","create_time":"2024-09-17T05:52:16.897390+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"126","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":19,"pool_name":"cephfs_data","create_time":"2024-09-17T05:52:18.214964+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"127","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"4f31c018-c8a4-4d6d-b0c2-a597c47aae4a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":125,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6800","nonce":479374392},{"type":"v1","addr":"172.21.15.150:6801","nonce":479374392}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6802","nonce":479374392},{"type":"v1","addr":"172.21.15.150:6803","nonce":479374392}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6806","nonce":479374392},{"type":"v1","addr":"172.21.15.150:6807","nonce":479374392}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6804","nonce":479374392},{"type":"v1","addr":"172.21.15.150:6805","nonce":479374392}]},"public_addr":"172.21.15.150:6801/479374392","cluster_addr":"172.21.15.150:6803/479374392","heartbeat_back_addr":"172.21.15.150:6807/479374392","heartbeat_front_addr":"172.21.15.150:6805/479374392","state":["exists","up"]},{"osd":1,"uuid":"6ff4a573-500b-4e04-9de3-39265ead78b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":125,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6824","nonce":913899800},{"type":"v1","addr":"172.21.15.150:6825","nonce":913899800}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6826","nonce":913899800},{"type":"v1","addr":"172.21.15.150:6827","nonce":913899800}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6830","nonce":913899800},{"type":"v1","addr":"172.21.15.150:6831","nonce":913899800}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6828","nonce":913899800},{"type":"v1","addr":"172.21.15.150:6829","nonce":913899800}]},"public_addr":"172.21.15.150:6825/913899800","cluster_addr":"172.21.15.150:6827/913899800","heartbeat_back_addr":"172.21.15.150:6831/913899800","heartbeat_front_addr":"172.21.15.150:6829/913899800","state":["exists","up"]},{"osd":2,"uuid":"bffea6f9-2465-4182-b205-00436c41ac1c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":125,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6816","nonce":363718461},{"type":"v1","addr":"172.21.15.150:6817","nonce":363718461}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6818","nonce":363718461},{"type":"v1","addr":"172.21.15.150:6819","nonce":363718461}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6822","nonce":363718461},{"type":"v1","addr":"172.21.15.150:6823","nonce":363718461}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6820","nonce":363718461},{"type":"v1","addr":"172.21.15.150:6821","nonce":363718461}]},"public_addr":"172.21.15.150:6817/363718461","cluster_addr":"172.21.15.150:6819/363718461","heartbeat_back_addr":"172.21.15.150:6823/363718461","heartbeat_front_addr":"172.21.15.150:6821/363718461","state":["exists","up"]},{"osd":3,"uuid":"cda70430-d1e1-427e-b04e-56db4031d078","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":128,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6808","nonce":3550994626},{"type":"v1","addr":"172.21.15.150:6809","nonce":3550994626}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6810","nonce":3550994626},{"type":"v1","addr":"172.21.15.150:6811","nonce":3550994626}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6814","nonce":3550994626},{"type":"v1","addr":"172.21.15.150:6815","nonce":3550994626}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6812","nonce":3550994626},{"type":"v1","addr":"172.21.15.150:6813","nonce":3550994626}]},"public_addr":"172.21.15.150:6809/3550994626","cluster_addr":"172.21.15.150:6811/3550994626","heartbeat_back_addr":"172.21.15.150:6815/3550994626","heartbeat_front_addr":"172.21.15.150:6813/3550994626","state":["exists","up"]},{"osd":4,"uuid":"3a0277fb-5e1e-4f68-bb2d-9a8a0152f64a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":125,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6810","nonce":2718261497},{"type":"v1","addr":"172.21.15.176:6811","nonce":2718261497}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6812","nonce":2718261497},{"type":"v1","addr":"172.21.15.176:6813","nonce":2718261497}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6816","nonce":2718261497},{"type":"v1","addr":"172.21.15.176:6817","nonce":2718261497}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6814","nonce":2718261497},{"type":"v1","addr":"172.21.15.176:6815","nonce":2718261497}]},"public_addr":"172.21.15.176:6811/2718261497","cluster_addr":"172.21.15.176:6813/2718261497","heartbeat_back_addr":"172.21.15.176:6817/2718261497","heartbeat_front_addr":"172.21.15.176:6815/2718261497","state":["exists","up"]},{"osd":5,"uuid":"33aebee6-0315-40b7-a11c-6702f0be494d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":125,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6818","nonce":2049295774},{"type":"v1","addr":"172.21.15.176:6819","nonce":2049295774}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6820","nonce":2049295774},{"type":"v1","addr":"172.21.15.176:6821","nonce":2049295774}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6824","nonce":2049295774},{"type":"v1","addr":"172.21.15.176:6825","nonce":2049295774}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6822","nonce":2049295774},{"type":"v1","addr":"172.21.15.176:6823","nonce":2049295774}]},"public_addr":"172.21.15.176:6819/2049295774","cluster_addr":"172.21.15.176:6821/2049295774","heartbeat_back_addr":"172.21.15.176:6825/2049295774","heartbeat_front_addr":"172.21.15.176:6823/2049295774","state":["exists","up"]},{"osd":6,"uuid":"4d24f360-6751-4263-841b-d77793d33540","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":128,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6826","nonce":2164458476},{"type":"v1","addr":"172.21.15.176:6827","nonce":2164458476}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6828","nonce":2164458476},{"type":"v1","addr":"172.21.15.176:6829","nonce":2164458476}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6832","nonce":2164458476},{"type":"v1","addr":"172.21.15.176:6833","nonce":2164458476}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6830","nonce":2164458476},{"type":"v1","addr":"172.21.15.176:6831","nonce":2164458476}]},"public_addr":"172.21.15.176:6827/2164458476","cluster_addr":"172.21.15.176:6829/2164458476","heartbeat_back_addr":"172.21.15.176:6833/2164458476","heartbeat_front_addr":"172.21.15.176:6831/2164458476","state":["exists","up"]},{"osd":7,"uuid":"c8594fda-c74a-4ba9-8277-caf101d58ca1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":125,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6802","nonce":3239587708},{"type":"v1","addr":"172.21.15.176:6803","nonce":3239587708}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6804","nonce":3239587708},{"type":"v1","addr":"172.21.15.176:6805","nonce":3239587708}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6808","nonce":3239587708},{"type":"v1","addr":"172.21.15.176:6809","nonce":3239587708}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6806","nonce":3239587708},{"type":"v1","addr":"172.21.15.176:6807","nonce":3239587708}]},"public_addr":"172.21.15.176:6803/3239587708","cluster_addr":"172.21.15.176:6805/3239587708","heartbeat_back_addr":"172.21.15.176:6809/3239587708","heartbeat_front_addr":"172.21.15.176:6807/3239587708","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:41:41.905151+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:41:42.705679+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:41:42.459673+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:41:42.440819+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:41:42.668428+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:41:42.694972+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:41:43.078535+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:41:42.363539+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"19.c","mappings":[{"from":2,"to":0}]},{"pgid":"19.1f","mappings":[{"from":2,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":7,"snaps":[{"begin":2,"length":2}]},{"pool":9,"snaps":[{"begin":2,"length":2}]},{"pool":11,"snaps":[{"begin":2,"length":2}]},{"pool":13,"snaps":[{"begin":2,"length":2}]},{"pool":15,"snaps":[{"begin":2,"length":2}]},{"pool":17,"snaps":[{"begin":2,"length":2}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T05:53:00.929 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:00.928+0000 7fe4e0fcf640 1 -- 172.21.15.150:0/3235270865 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fe4bc07ad50 msgr2=0x7fe4bc07d260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:53:00.929 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:00.928+0000 7fe4e0fcf640 1 --2- 172.21.15.150:0/3235270865 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fe4bc07ad50 0x7fe4bc07d260 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 crypto rx=0x7fe4cc034000 tx=0x7fe4cc004730 comp rx=0 tx=0).stop 2024-09-17T05:53:00.930 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:00.928+0000 7fe4e0fcf640 1 -- 172.21.15.150:0/3235270865 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe4dc0d0ad0 msgr2=0x7fe4dc1cab70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:53:00.930 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:00.928+0000 7fe4e0fcf640 1 --2- 172.21.15.150:0/3235270865 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe4dc0d0ad0 0x7fe4dc1cab70 secure :-1 s=READY pgs=1771 cs=0 l=1 rev1=1 crypto rx=0x7fe4d400b9a0 tx=0x7fe4d400be60 comp rx=0 tx=0).stop 2024-09-17T05:53:00.930 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:00.928+0000 7fe4e0fcf640 1 -- 172.21.15.150:0/3235270865 shutdown_connections 2024-09-17T05:53:00.930 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:00.928+0000 7fe4e0fcf640 1 --2- 172.21.15.150:0/3235270865 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fe4bc07ad50 0x7fe4bc07d260 unknown :-1 s=CLOSED pgs=749 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:53:00.930 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:00.928+0000 7fe4e0fcf640 1 --2- 172.21.15.150:0/3235270865 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe4dc0d0ad0 0x7fe4dc1cab70 unknown :-1 s=CLOSED pgs=1771 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:53:00.930 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:00.928+0000 7fe4e0fcf640 1 --2- 172.21.15.150:0/3235270865 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe4dc0cd890 0x7fe4dc1ca630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:53:00.930 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:00.928+0000 7fe4e0fcf640 1 --2- 172.21.15.150:0/3235270865 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe4dc0b7490 0x7fe4dc1ca0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:53:00.930 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:00.928+0000 7fe4e0fcf640 1 -- 172.21.15.150:0/3235270865 >> 172.21.15.150:0/3235270865 conn(0x7fe4dc0cef30 msgr2=0x7fe4dc071f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:53:00.930 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:00.928+0000 7fe4e0fcf640 1 -- 172.21.15.150:0/3235270865 shutdown_connections 2024-09-17T05:53:00.930 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:00.928+0000 7fe4e0fcf640 1 -- 172.21.15.150:0/3235270865 wait complete. 2024-09-17T05:53:00.946 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-09-17T05:53:00.946 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T05:53:01.128 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:01.128+0000 7fae0aba1640 1 -- 172.21.15.150:0/441673788 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fae040b4810 msgr2=0x7fae0406ddb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:53:01.129 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:01.128+0000 7fae0aba1640 1 --2- 172.21.15.150:0/441673788 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fae040b4810 0x7fae0406ddb0 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7fae040727e0 tx=0x7fadf402a3b0 comp rx=0 tx=0).stop 2024-09-17T05:53:01.129 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:01.128+0000 7fae0aba1640 1 -- 172.21.15.150:0/441673788 shutdown_connections 2024-09-17T05:53:01.129 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:01.128+0000 7fae0aba1640 1 --2- 172.21.15.150:0/441673788 >> v2:172.21.15.150:3300/0 conn(0x7fae0406e2f0 0x7fae040cde00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:53:01.129 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:01.128+0000 7fae0aba1640 1 --2- 172.21.15.150:0/441673788 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fae040b4810 0x7fae0406ddb0 unknown :-1 s=CLOSED pgs=599 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:53:01.129 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:01.128+0000 7fae0aba1640 1 -- 172.21.15.150:0/441673788 >> 172.21.15.150:0/441673788 conn(0x7fae040738b0 msgr2=0x7fae04073cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:53:01.129 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:01.128+0000 7fae0aba1640 1 -- 172.21.15.150:0/441673788 shutdown_connections 2024-09-17T05:53:01.129 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:01.128+0000 7fae0aba1640 1 -- 172.21.15.150:0/441673788 wait complete. 2024-09-17T05:53:01.132 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:01.131+0000 7fae0aba1640 1 Processor -- start 2024-09-17T05:53:01.132 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:01.131+0000 7fae0aba1640 1 -- start start 2024-09-17T05:53:01.134 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:01.133+0000 7fae0aba1640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fae0406e2f0 0x7fae04071020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:53:01.135 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:01.134+0000 7fae0893d640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fae0406e2f0 0x7fae04071020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:53:01.135 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:01.134+0000 7fae0893d640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fae0406e2f0 0x7fae04071020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:37394/0 (socket says 172.21.15.150:37394) 2024-09-17T05:53:01.135 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:01.134+0000 7fae0893d640 1 -- 172.21.15.150:0/3030930022 learned_addr learned my addr 172.21.15.150:0/3030930022 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:53:01.135 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:01.134+0000 7fae0aba1640 1 --2- 172.21.15.150:0/3030930022 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fae040ce340 0x7fae040c7200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:53:01.135 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:01.134+0000 7fae0aba1640 1 --2- 172.21.15.150:0/3030930022 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fae04144440 0x7fae04144e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:53:01.135 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:01.134+0000 7fae0aba1640 1 -- 172.21.15.150:0/3030930022 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7fae040b59a0 con 0x7fae0406e2f0 2024-09-17T05:53:01.135 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:01.134+0000 7fae0aba1640 1 -- 172.21.15.150:0/3030930022 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fae040b5820 con 0x7fae04144440 2024-09-17T05:53:01.135 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:01.134+0000 7fae0aba1640 1 -- 172.21.15.150:0/3030930022 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fae040b5b20 con 0x7fae040ce340 2024-09-17T05:53:01.135 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:01.134+0000 7fae0913e640 1 --2- 172.21.15.150:0/3030930022 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fae04144440 0x7fae04144e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:53:01.135 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:01.134+0000 7fae03fff640 1 --2- 172.21.15.150:0/3030930022 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fae040ce340 0x7fae040c7200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:53:01.137 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:01.135+0000 7fae0893d640 1 -- 172.21.15.150:0/3030930022 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fae040ce340 msgr2=0x7fae040c7200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:53:01.137 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:01.135+0000 7fae0893d640 1 --2- 172.21.15.150:0/3030930022 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fae040ce340 0x7fae040c7200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:53:01.137 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:01.135+0000 7fae0893d640 1 -- 172.21.15.150:0/3030930022 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fae04144440 msgr2=0x7fae04144e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:53:01.137 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:01.135+0000 7fae0893d640 1 --2- 172.21.15.150:0/3030930022 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fae04144440 0x7fae04144e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:53:01.137 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:01.135+0000 7fae0893d640 1 -- 172.21.15.150:0/3030930022 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fae040c6160 con 0x7fae0406e2f0 2024-09-17T05:53:01.137 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:01.135+0000 7fae0893d640 1 --2- 172.21.15.150:0/3030930022 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fae0406e2f0 0x7fae04071020 secure :-1 s=READY pgs=1772 cs=0 l=1 rev1=1 crypto rx=0x7fadf4000c00 tx=0x7fadf4033ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:53:01.137 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:01.135+0000 7fae017fa640 1 -- 172.21.15.150:0/3030930022 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fadf4037050 con 0x7fae0406e2f0 2024-09-17T05:53:01.137 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:01.135+0000 7fae017fa640 1 -- 172.21.15.150:0/3030930022 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fadf4038040 con 0x7fae0406e2f0 2024-09-17T05:53:01.137 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:01.135+0000 7fae0aba1640 1 -- 172.21.15.150:0/3030930022 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fae040c6440 con 0x7fae0406e2f0 2024-09-17T05:53:01.137 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:01.136+0000 7fae017fa640 1 -- 172.21.15.150:0/3030930022 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fadf4005280 con 0x7fae0406e2f0 2024-09-17T05:53:01.137 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:01.136+0000 7fae0aba1640 1 -- 172.21.15.150:0/3030930022 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fae040c6a00 con 0x7fae0406e2f0 2024-09-17T05:53:01.139 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:01.138+0000 7fae017fa640 1 -- 172.21.15.150:0/3030930022 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 45) ==== 104501+0+0 (secure 0 0 0) 0x7fadf4045020 con 0x7fae0406e2f0 2024-09-17T05:53:01.140 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:01.139+0000 7fae017fa640 1 --2- 172.21.15.150:0/3030930022 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fadf007ada0 0x7fadf007d2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:53:01.140 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:01.139+0000 7fae017fa640 1 -- 172.21.15.150:0/3030930022 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(130..130 src has 1..130) ==== 5991+0+0 (secure 0 0 0) 0x7fadf407faa0 con 0x7fae0406e2f0 2024-09-17T05:53:01.140 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:01.140+0000 7fae0aba1640 1 -- 172.21.15.150:0/3030930022 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fae0406ddb0 con 0x7fae0406e2f0 2024-09-17T05:53:01.141 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:01.140+0000 7fae03fff640 1 --2- 172.21.15.150:0/3030930022 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fadf007ada0 0x7fadf007d2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:53:01.141 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:01.141+0000 7fae03fff640 1 --2- 172.21.15.150:0/3030930022 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fadf007ada0 0x7fadf007d2b0 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 crypto rx=0x7fae040cf0a0 tx=0x7fadf8005f90 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:53:01.149 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:01.149+0000 7fae017fa640 1 -- 172.21.15.150:0/3030930022 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fadf404c020 con 0x7fae0406e2f0 2024-09-17T05:53:01.430 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:01.429+0000 7fae0aba1640 1 -- 172.21.15.150:0/3030930022 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fae0415e9b0 con 0x7fae0406e2f0 2024-09-17T05:53:01.431 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:01.430+0000 7fae017fa640 1 -- 172.21.15.150:0/3030930022 <== mon.0 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 81 v81) ==== 94+0+5234 (secure 0 0 0) 0x7fadf4083830 con 0x7fae0406e2f0 2024-09-17T05:53:01.431 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-09-17T05:53:01.431 INFO:teuthology.orchestra.run.smithi150.stdout:{"epoch":81,"btime":"2024-09-17T05:52:32:156241+0000","default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":9123,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6834/2232109291","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6832","nonce":2232109291},{"type":"v1","addr":"172.21.15.150:6834","nonce":2232109291}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":74},{"gid":9126,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6835/423416474","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6833","nonce":423416474},{"type":"v1","addr":"172.21.15.150:6835","nonce":423416474}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":75},{"gid":9138,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6837/2582017817","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6835","nonce":2582017817},{"type":"v1","addr":"172.21.15.176:6837","nonce":2582017817}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":75}],"filesystems":[{"mdsmap":{"epoch":80,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T05:52:19.257101+0000","modified":"2024-09-17T05:52:22.283372+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":9141},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9141":{"gid":9141,"name":"d","rank":0,"incarnation":76,"state":"up:active","state_seq":3,"addr":"172.21.15.176:6836/1926613940","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6834","nonce":1926613940},{"type":"v1","addr":"172.21.15.176:6836","nonce":1926613940}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[19],"metadata_pool":18,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":9141,"qdb_cluster":[9141]},"id":9}]} 2024-09-17T05:53:01.431 INFO:teuthology.orchestra.run.smithi150.stderr:dumped fsmap epoch 81 2024-09-17T05:53:01.433 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:01.432+0000 7fae0aba1640 1 -- 172.21.15.150:0/3030930022 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fadf007ada0 msgr2=0x7fadf007d2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:53:01.434 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:01.432+0000 7fae0aba1640 1 --2- 172.21.15.150:0/3030930022 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fadf007ada0 0x7fadf007d2b0 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 crypto rx=0x7fae040cf0a0 tx=0x7fadf8005f90 comp rx=0 tx=0).stop 2024-09-17T05:53:01.434 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:01.432+0000 7fae0aba1640 1 -- 172.21.15.150:0/3030930022 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fae0406e2f0 msgr2=0x7fae04071020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:53:01.434 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:01.432+0000 7fae0aba1640 1 --2- 172.21.15.150:0/3030930022 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fae0406e2f0 0x7fae04071020 secure :-1 s=READY pgs=1772 cs=0 l=1 rev1=1 crypto rx=0x7fadf4000c00 tx=0x7fadf4033ba0 comp rx=0 tx=0).stop 2024-09-17T05:53:01.434 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:01.433+0000 7fae0aba1640 1 -- 172.21.15.150:0/3030930022 shutdown_connections 2024-09-17T05:53:01.434 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:01.433+0000 7fae0aba1640 1 --2- 172.21.15.150:0/3030930022 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fae04144440 0x7fae04144e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:53:01.434 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:01.433+0000 7fae0aba1640 1 --2- 172.21.15.150:0/3030930022 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fadf007ada0 0x7fadf007d2b0 unknown :-1 s=CLOSED pgs=750 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:53:01.434 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:01.433+0000 7fae0aba1640 1 --2- 172.21.15.150:0/3030930022 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fae040ce340 0x7fae040c7200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:53:01.434 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:01.433+0000 7fae0aba1640 1 --2- 172.21.15.150:0/3030930022 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fae0406e2f0 0x7fae04071020 unknown :-1 s=CLOSED pgs=1772 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:53:01.434 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:01.433+0000 7fae0aba1640 1 -- 172.21.15.150:0/3030930022 >> 172.21.15.150:0/3030930022 conn(0x7fae040738b0 msgr2=0x7fae04156a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:53:01.434 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:01.433+0000 7fae0aba1640 1 -- 172.21.15.150:0/3030930022 shutdown_connections 2024-09-17T05:53:01.434 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:01.433+0000 7fae0aba1640 1 -- 172.21.15.150:0/3030930022 wait complete. 2024-09-17T05:53:01.445 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T05:53:01.559 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:01.558+0000 7faf8874a640 1 -- 172.21.15.150:0/3161345658 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7faf8009ba60 msgr2=0x7faf800b7330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:53:01.559 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:01.558+0000 7faf8874a640 1 --2- 172.21.15.150:0/3161345658 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7faf8009ba60 0x7faf800b7330 secure :-1 s=READY pgs=1773 cs=0 l=1 rev1=1 crypto rx=0x7faf800a0410 tx=0x7faf7002a5f0 comp rx=0 tx=0).stop 2024-09-17T05:53:01.559 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:01.558+0000 7faf8874a640 1 -- 172.21.15.150:0/3161345658 shutdown_connections 2024-09-17T05:53:01.559 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:01.558+0000 7faf8874a640 1 --2- 172.21.15.150:0/3161345658 >> v2:172.21.15.176:3300/0 conn(0x7faf800cd850 0x7faf800d06f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:53:01.559 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:01.558+0000 7faf8874a640 1 --2- 172.21.15.150:0/3161345658 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7faf8009ba60 0x7faf800b7330 unknown :-1 s=CLOSED pgs=1773 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:53:01.559 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:01.558+0000 7faf8874a640 1 -- 172.21.15.150:0/3161345658 >> 172.21.15.150:0/3161345658 conn(0x7faf800cee90 msgr2=0x7faf800cf2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:53:01.559 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:01.558+0000 7faf8874a640 1 -- 172.21.15.150:0/3161345658 shutdown_connections 2024-09-17T05:53:01.560 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:01.558+0000 7faf8874a640 1 -- 172.21.15.150:0/3161345658 wait complete. 2024-09-17T05:53:01.560 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:01.560+0000 7faf8874a640 1 Processor -- start 2024-09-17T05:53:01.560 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:01.560+0000 7faf8874a640 1 -- start start 2024-09-17T05:53:01.563 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:01.561+0000 7faf8874a640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7faf8009ba60 0x7faf8006deb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:53:01.563 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:01.561+0000 7faf8874a640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7faf800cd440 0x7faf801568d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:53:01.563 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:01.561+0000 7faf8874a640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7faf800cd850 0x7faf801fa4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:53:01.563 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:01.561+0000 7faf8874a640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7faf800d0db0 con 0x7faf8009ba60 2024-09-17T05:53:01.563 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:01.561+0000 7faf8874a640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7faf800d0c30 con 0x7faf800cd440 2024-09-17T05:53:01.563 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:01.561+0000 7faf8874a640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7faf800d0f30 con 0x7faf800cd850 2024-09-17T05:53:01.563 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:01.561+0000 7faf864e6640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7faf8009ba60 0x7faf8006deb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:53:01.563 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:01.561+0000 7faf864e6640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7faf8009ba60 0x7faf8006deb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:37414/0 (socket says 172.21.15.150:37414) 2024-09-17T05:53:01.564 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:01.561+0000 7faf864e6640 1 -- 172.21.15.150:0/1840772977 learned_addr learned my addr 172.21.15.150:0/1840772977 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:53:01.564 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:01.561+0000 7faf85ce5640 1 --2- 172.21.15.150:0/1840772977 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7faf800cd440 0x7faf801568d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:53:01.564 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:01.561+0000 7faf86ce7640 1 --2- 172.21.15.150:0/1840772977 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7faf800cd850 0x7faf801fa4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:53:01.564 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:01.561+0000 7faf864e6640 1 -- 172.21.15.150:0/1840772977 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7faf800cd850 msgr2=0x7faf801fa4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:53:01.564 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:01.561+0000 7faf864e6640 1 --2- 172.21.15.150:0/1840772977 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7faf800cd850 0x7faf801fa4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:53:01.564 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:01.561+0000 7faf864e6640 1 -- 172.21.15.150:0/1840772977 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7faf800cd440 msgr2=0x7faf801568d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:53:01.564 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:01.561+0000 7faf864e6640 1 --2- 172.21.15.150:0/1840772977 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7faf800cd440 0x7faf801568d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:53:01.564 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:01.561+0000 7faf864e6640 1 -- 172.21.15.150:0/1840772977 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faf801f9d30 con 0x7faf8009ba60 2024-09-17T05:53:01.564 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:01.562+0000 7faf864e6640 1 --2- 172.21.15.150:0/1840772977 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7faf8009ba60 0x7faf8006deb0 secure :-1 s=READY pgs=1774 cs=0 l=1 rev1=1 crypto rx=0x7faf7002abe0 tx=0x7faf700052f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:53:01.564 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:01.562+0000 7faf7effd640 1 -- 172.21.15.150:0/1840772977 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf70005cf0 con 0x7faf8009ba60 2024-09-17T05:53:01.564 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:01.562+0000 7faf7effd640 1 -- 172.21.15.150:0/1840772977 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7faf70031b50 con 0x7faf8009ba60 2024-09-17T05:53:01.564 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:01.562+0000 7faf8874a640 1 -- 172.21.15.150:0/1840772977 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faf8015ed10 con 0x7faf8009ba60 2024-09-17T05:53:01.565 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:01.562+0000 7faf7effd640 1 -- 172.21.15.150:0/1840772977 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf700047a0 con 0x7faf8009ba60 2024-09-17T05:53:01.565 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:01.562+0000 7faf8874a640 1 -- 172.21.15.150:0/1840772977 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faf8006e3f0 con 0x7faf8009ba60 2024-09-17T05:53:01.565 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:01.563+0000 7faf8874a640 1 -- 172.21.15.150:0/1840772977 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faf800b7330 con 0x7faf8009ba60 2024-09-17T05:53:01.566 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:01.564+0000 7faf7effd640 1 -- 172.21.15.150:0/1840772977 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 45) ==== 104501+0+0 (secure 0 0 0) 0x7faf70004940 con 0x7faf8009ba60 2024-09-17T05:53:01.566 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:01.564+0000 7faf7effd640 1 --2- 172.21.15.150:0/1840772977 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7faf6c07ad50 0x7faf6c07d260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:53:01.566 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:01.564+0000 7faf7effd640 1 -- 172.21.15.150:0/1840772977 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(130..130 src has 1..130) ==== 5991+0+0 (secure 0 0 0) 0x7faf700bb060 con 0x7faf8009ba60 2024-09-17T05:53:01.566 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:01.564+0000 7faf85ce5640 1 --2- 172.21.15.150:0/1840772977 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7faf6c07ad50 0x7faf6c07d260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:53:01.566 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:01.565+0000 7faf85ce5640 1 --2- 172.21.15.150:0/1840772977 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7faf6c07ad50 0x7faf6c07d260 secure :-1 s=READY pgs=751 cs=0 l=1 rev1=1 crypto rx=0x7faf800b7660 tx=0x7faf74009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:53:01.569 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:01.569+0000 7faf7effd640 1 -- 172.21.15.150:0/1840772977 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7faf7003f030 con 0x7faf8009ba60 2024-09-17T05:53:01.778 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:01.778+0000 7faf8874a640 1 -- 172.21.15.150:0/1840772977 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7faf800cc5a0 con 0x7faf8009ba60 2024-09-17T05:53:01.779 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:01.778+0000 7faf7effd640 1 -- 172.21.15.150:0/1840772977 <== mon.0 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 81 v81) ==== 94+0+5234 (secure 0 0 0) 0x7faf70031770 con 0x7faf8009ba60 2024-09-17T05:53:01.779 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-09-17T05:53:01.779 INFO:teuthology.orchestra.run.smithi150.stdout:{"epoch":81,"btime":"2024-09-17T05:52:32:156241+0000","default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":9123,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6834/2232109291","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6832","nonce":2232109291},{"type":"v1","addr":"172.21.15.150:6834","nonce":2232109291}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":74},{"gid":9126,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6835/423416474","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6833","nonce":423416474},{"type":"v1","addr":"172.21.15.150:6835","nonce":423416474}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":75},{"gid":9138,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6837/2582017817","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6835","nonce":2582017817},{"type":"v1","addr":"172.21.15.176:6837","nonce":2582017817}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":75}],"filesystems":[{"mdsmap":{"epoch":80,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T05:52:19.257101+0000","modified":"2024-09-17T05:52:22.283372+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":9141},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9141":{"gid":9141,"name":"d","rank":0,"incarnation":76,"state":"up:active","state_seq":3,"addr":"172.21.15.176:6836/1926613940","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6834","nonce":1926613940},{"type":"v1","addr":"172.21.15.176:6836","nonce":1926613940}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[19],"metadata_pool":18,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":9141,"qdb_cluster":[9141]},"id":9}]} 2024-09-17T05:53:01.780 INFO:teuthology.orchestra.run.smithi150.stderr:dumped fsmap epoch 81 2024-09-17T05:53:01.781 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:01.780+0000 7faf8874a640 1 -- 172.21.15.150:0/1840772977 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7faf6c07ad50 msgr2=0x7faf6c07d260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:53:01.782 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:01.780+0000 7faf8874a640 1 --2- 172.21.15.150:0/1840772977 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7faf6c07ad50 0x7faf6c07d260 secure :-1 s=READY pgs=751 cs=0 l=1 rev1=1 crypto rx=0x7faf800b7660 tx=0x7faf74009040 comp rx=0 tx=0).stop 2024-09-17T05:53:01.782 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:01.780+0000 7faf8874a640 1 -- 172.21.15.150:0/1840772977 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7faf8009ba60 msgr2=0x7faf8006deb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:53:01.782 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:01.780+0000 7faf8874a640 1 --2- 172.21.15.150:0/1840772977 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7faf8009ba60 0x7faf8006deb0 secure :-1 s=READY pgs=1774 cs=0 l=1 rev1=1 crypto rx=0x7faf7002abe0 tx=0x7faf700052f0 comp rx=0 tx=0).stop 2024-09-17T05:53:01.782 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:01.781+0000 7faf8874a640 1 -- 172.21.15.150:0/1840772977 shutdown_connections 2024-09-17T05:53:01.782 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:01.781+0000 7faf8874a640 1 --2- 172.21.15.150:0/1840772977 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7faf800cd440 0x7faf801568d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:53:01.782 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:01.781+0000 7faf8874a640 1 --2- 172.21.15.150:0/1840772977 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7faf6c07ad50 0x7faf6c07d260 unknown :-1 s=CLOSED pgs=751 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:53:01.782 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:01.781+0000 7faf8874a640 1 --2- 172.21.15.150:0/1840772977 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7faf800cd850 0x7faf801fa4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:53:01.782 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:01.781+0000 7faf8874a640 1 --2- 172.21.15.150:0/1840772977 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7faf8009ba60 0x7faf8006deb0 unknown :-1 s=CLOSED pgs=1774 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:53:01.782 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:01.781+0000 7faf8874a640 1 -- 172.21.15.150:0/1840772977 >> 172.21.15.150:0/1840772977 conn(0x7faf800cee90 msgr2=0x7faf800b5240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:53:01.782 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:01.781+0000 7faf8874a640 1 -- 172.21.15.150:0/1840772977 shutdown_connections 2024-09-17T05:53:01.782 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:01.781+0000 7faf8874a640 1 -- 172.21.15.150:0/1840772977 wait complete. 2024-09-17T05:53:01.793 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T05:53:01.909 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:01.908+0000 7f5f1ff6e640 1 -- 172.21.15.150:0/1131119240 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5f1815ee30 msgr2=0x7f5f180b2840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:53:01.909 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:01.908+0000 7f5f1ff6e640 1 --2- 172.21.15.150:0/1131119240 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5f1815ee30 0x7f5f180b2840 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7f5f14009830 tx=0x7f5f1402a510 comp rx=0 tx=0).stop 2024-09-17T05:53:01.909 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:01.908+0000 7f5f1ff6e640 1 -- 172.21.15.150:0/1131119240 shutdown_connections 2024-09-17T05:53:01.910 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:01.908+0000 7f5f1ff6e640 1 --2- 172.21.15.150:0/1131119240 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5f180b5410 0x7f5f180b5820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:53:01.910 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:01.908+0000 7f5f1ff6e640 1 --2- 172.21.15.150:0/1131119240 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5f1815ee30 0x7f5f180b2840 unknown :-1 s=CLOSED pgs=602 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:53:01.910 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:01.908+0000 7f5f1ff6e640 1 -- 172.21.15.150:0/1131119240 >> 172.21.15.150:0/1131119240 conn(0x7f5f180b2fd0 msgr2=0x7f5f180b33e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:53:01.910 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:01.908+0000 7f5f1ff6e640 1 -- 172.21.15.150:0/1131119240 shutdown_connections 2024-09-17T05:53:01.910 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:01.908+0000 7f5f1ff6e640 1 -- 172.21.15.150:0/1131119240 wait complete. 2024-09-17T05:53:01.910 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:01.910+0000 7f5f1ff6e640 1 Processor -- start 2024-09-17T05:53:01.910 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:01.910+0000 7f5f1ff6e640 1 -- start start 2024-09-17T05:53:01.913 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:01.911+0000 7f5f1ff6e640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5f180b5410 0x7f5f181538a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:53:01.913 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:01.911+0000 7f5f1ff6e640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5f180cf7c0 0x7f5f1806cda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:53:01.913 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:01.911+0000 7f5f1ff6e640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5f1815ee30 0x7f5f1806d2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:53:01.913 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:01.911+0000 7f5f1ff6e640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f5f180b6150 con 0x7f5f1815ee30 2024-09-17T05:53:01.914 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:01.911+0000 7f5f1ff6e640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f5f180b5fd0 con 0x7f5f180cf7c0 2024-09-17T05:53:01.914 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:01.911+0000 7f5f1ff6e640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f5f180b62d0 con 0x7f5f180b5410 2024-09-17T05:53:01.914 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:01.911+0000 7f5f1e50b640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5f1815ee30 0x7f5f1806d2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:53:01.914 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:01.911+0000 7f5f1dd0a640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5f180b5410 0x7f5f181538a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:53:01.914 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:01.911+0000 7f5f1d509640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5f180cf7c0 0x7f5f1806cda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:53:01.914 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:01.911+0000 7f5f1e50b640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5f1815ee30 0x7f5f1806d2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:37424/0 (socket says 172.21.15.150:37424) 2024-09-17T05:53:01.914 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:01.911+0000 7f5f1e50b640 1 -- 172.21.15.150:0/531650773 learned_addr learned my addr 172.21.15.150:0/531650773 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:53:01.914 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:01.912+0000 7f5f1dd0a640 1 -- 172.21.15.150:0/531650773 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5f180cf7c0 msgr2=0x7f5f1806cda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:53:01.914 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:01.912+0000 7f5f1dd0a640 1 --2- 172.21.15.150:0/531650773 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5f180cf7c0 0x7f5f1806cda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:53:01.914 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:01.912+0000 7f5f1dd0a640 1 -- 172.21.15.150:0/531650773 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5f1815ee30 msgr2=0x7f5f1806d2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:53:01.914 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:01.912+0000 7f5f1dd0a640 1 --2- 172.21.15.150:0/531650773 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5f1815ee30 0x7f5f1806d2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:53:01.914 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:01.912+0000 7f5f1dd0a640 1 -- 172.21.15.150:0/531650773 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5f18153de0 con 0x7f5f180b5410 2024-09-17T05:53:01.914 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:01.912+0000 7f5f1dd0a640 1 --2- 172.21.15.150:0/531650773 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5f180b5410 0x7f5f181538a0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f5f18073d40 tx=0x7f5f14033c20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:53:01.915 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:01.912+0000 7f5f0e7fc640 1 -- 172.21.15.150:0/531650773 <== mon.2 v2:172.21.15.176:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f14005c90 con 0x7f5f180b5410 2024-09-17T05:53:01.915 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:01.912+0000 7f5f0e7fc640 1 -- 172.21.15.150:0/531650773 <== mon.2 v2:172.21.15.176:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f5f14031e50 con 0x7f5f180b5410 2024-09-17T05:53:01.915 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:01.912+0000 7f5f1ff6e640 1 -- 172.21.15.150:0/531650773 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5f181f3680 con 0x7f5f180b5410 2024-09-17T05:53:01.915 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:01.912+0000 7f5f0e7fc640 1 -- 172.21.15.150:0/531650773 <== mon.2 v2:172.21.15.176:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f14005280 con 0x7f5f180b5410 2024-09-17T05:53:01.915 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:01.912+0000 7f5f1ff6e640 1 -- 172.21.15.150:0/531650773 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f5f180c56f0 con 0x7f5f180b5410 2024-09-17T05:53:01.916 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:01.913+0000 7f5f1ff6e640 1 -- 172.21.15.150:0/531650773 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5f180b67e0 con 0x7f5f180b5410 2024-09-17T05:53:01.916 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:01.914+0000 7f5f0e7fc640 1 -- 172.21.15.150:0/531650773 <== mon.2 v2:172.21.15.176:3301/0 4 ==== mgrmap(e 45) ==== 104501+0+0 (secure 0 0 0) 0x7f5f14005420 con 0x7f5f180b5410 2024-09-17T05:53:01.916 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:01.914+0000 7f5f0e7fc640 1 --2- 172.21.15.150:0/531650773 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f5efc07ad50 0x7f5efc07d260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:53:01.916 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:01.915+0000 7f5f0e7fc640 1 -- 172.21.15.150:0/531650773 <== mon.2 v2:172.21.15.176:3301/0 5 ==== osd_map(130..130 src has 1..130) ==== 5991+0+0 (secure 0 0 0) 0x7f5f140bb310 con 0x7f5f180b5410 2024-09-17T05:53:01.916 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:01.915+0000 7f5f1d509640 1 --2- 172.21.15.150:0/531650773 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f5efc07ad50 0x7f5efc07d260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:53:01.916 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:01.915+0000 7f5f1d509640 1 --2- 172.21.15.150:0/531650773 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f5efc07ad50 0x7f5efc07d260 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 crypto rx=0x7f5f180b6e20 tx=0x7f5f08009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:53:01.919 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:01.918+0000 7f5f0e7fc640 1 -- 172.21.15.150:0/531650773 <== mon.2 v2:172.21.15.176:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f5f1403f030 con 0x7f5f180b5410 2024-09-17T05:53:02.100 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:02.099+0000 7f5f1ff6e640 1 -- 172.21.15.150:0/531650773 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f5f180b2740 con 0x7f5f180b5410 2024-09-17T05:53:02.101 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:02.101+0000 7f5f0e7fc640 1 -- 172.21.15.150:0/531650773 <== mon.2 v2:172.21.15.176:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v130) ==== 74+0+17251 (secure 0 0 0) 0x7f5f14084d70 con 0x7f5f180b5410 2024-09-17T05:53:02.102 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-09-17T05:53:02.102 INFO:teuthology.orchestra.run.smithi150.stdout:{"epoch":130,"fsid":"9f2e05e9-d629-47b3-b26b-1360655b7d20","created":"2024-09-17T05:41:32.502979+0000","modified":"2024-09-17T05:53:00.996259+0000","last_up_change":"2024-09-17T05:41:46.150225+0000","last_in_change":"2024-09-17T05:41:36.120274+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":19,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T05:41:46.860779+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":18,"pool_name":"cephfs_metadata","create_time":"2024-09-17T05:52:16.897390+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"126","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":19,"pool_name":"cephfs_data","create_time":"2024-09-17T05:52:18.214964+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"130","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":3,"snap_epoch":130,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"4f31c018-c8a4-4d6d-b0c2-a597c47aae4a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":125,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6800","nonce":479374392},{"type":"v1","addr":"172.21.15.150:6801","nonce":479374392}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6802","nonce":479374392},{"type":"v1","addr":"172.21.15.150:6803","nonce":479374392}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6806","nonce":479374392},{"type":"v1","addr":"172.21.15.150:6807","nonce":479374392}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6804","nonce":479374392},{"type":"v1","addr":"172.21.15.150:6805","nonce":479374392}]},"public_addr":"172.21.15.150:6801/479374392","cluster_addr":"172.21.15.150:6803/479374392","heartbeat_back_addr":"172.21.15.150:6807/479374392","heartbeat_front_addr":"172.21.15.150:6805/479374392","state":["exists","up"]},{"osd":1,"uuid":"6ff4a573-500b-4e04-9de3-39265ead78b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":125,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6824","nonce":913899800},{"type":"v1","addr":"172.21.15.150:6825","nonce":913899800}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6826","nonce":913899800},{"type":"v1","addr":"172.21.15.150:6827","nonce":913899800}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6830","nonce":913899800},{"type":"v1","addr":"172.21.15.150:6831","nonce":913899800}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6828","nonce":913899800},{"type":"v1","addr":"172.21.15.150:6829","nonce":913899800}]},"public_addr":"172.21.15.150:6825/913899800","cluster_addr":"172.21.15.150:6827/913899800","heartbeat_back_addr":"172.21.15.150:6831/913899800","heartbeat_front_addr":"172.21.15.150:6829/913899800","state":["exists","up"]},{"osd":2,"uuid":"bffea6f9-2465-4182-b205-00436c41ac1c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":125,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6816","nonce":363718461},{"type":"v1","addr":"172.21.15.150:6817","nonce":363718461}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6818","nonce":363718461},{"type":"v1","addr":"172.21.15.150:6819","nonce":363718461}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6822","nonce":363718461},{"type":"v1","addr":"172.21.15.150:6823","nonce":363718461}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6820","nonce":363718461},{"type":"v1","addr":"172.21.15.150:6821","nonce":363718461}]},"public_addr":"172.21.15.150:6817/363718461","cluster_addr":"172.21.15.150:6819/363718461","heartbeat_back_addr":"172.21.15.150:6823/363718461","heartbeat_front_addr":"172.21.15.150:6821/363718461","state":["exists","up"]},{"osd":3,"uuid":"cda70430-d1e1-427e-b04e-56db4031d078","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":128,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6808","nonce":3550994626},{"type":"v1","addr":"172.21.15.150:6809","nonce":3550994626}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6810","nonce":3550994626},{"type":"v1","addr":"172.21.15.150:6811","nonce":3550994626}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6814","nonce":3550994626},{"type":"v1","addr":"172.21.15.150:6815","nonce":3550994626}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6812","nonce":3550994626},{"type":"v1","addr":"172.21.15.150:6813","nonce":3550994626}]},"public_addr":"172.21.15.150:6809/3550994626","cluster_addr":"172.21.15.150:6811/3550994626","heartbeat_back_addr":"172.21.15.150:6815/3550994626","heartbeat_front_addr":"172.21.15.150:6813/3550994626","state":["exists","up"]},{"osd":4,"uuid":"3a0277fb-5e1e-4f68-bb2d-9a8a0152f64a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":125,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6810","nonce":2718261497},{"type":"v1","addr":"172.21.15.176:6811","nonce":2718261497}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6812","nonce":2718261497},{"type":"v1","addr":"172.21.15.176:6813","nonce":2718261497}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6816","nonce":2718261497},{"type":"v1","addr":"172.21.15.176:6817","nonce":2718261497}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6814","nonce":2718261497},{"type":"v1","addr":"172.21.15.176:6815","nonce":2718261497}]},"public_addr":"172.21.15.176:6811/2718261497","cluster_addr":"172.21.15.176:6813/2718261497","heartbeat_back_addr":"172.21.15.176:6817/2718261497","heartbeat_front_addr":"172.21.15.176:6815/2718261497","state":["exists","up"]},{"osd":5,"uuid":"33aebee6-0315-40b7-a11c-6702f0be494d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":125,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6818","nonce":2049295774},{"type":"v1","addr":"172.21.15.176:6819","nonce":2049295774}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6820","nonce":2049295774},{"type":"v1","addr":"172.21.15.176:6821","nonce":2049295774}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6824","nonce":2049295774},{"type":"v1","addr":"172.21.15.176:6825","nonce":2049295774}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6822","nonce":2049295774},{"type":"v1","addr":"172.21.15.176:6823","nonce":2049295774}]},"public_addr":"172.21.15.176:6819/2049295774","cluster_addr":"172.21.15.176:6821/2049295774","heartbeat_back_addr":"172.21.15.176:6825/2049295774","heartbeat_front_addr":"172.21.15.176:6823/2049295774","state":["exists","up"]},{"osd":6,"uuid":"4d24f360-6751-4263-841b-d77793d33540","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":128,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6826","nonce":2164458476},{"type":"v1","addr":"172.21.15.176:6827","nonce":2164458476}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6828","nonce":2164458476},{"type":"v1","addr":"172.21.15.176:6829","nonce":2164458476}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6832","nonce":2164458476},{"type":"v1","addr":"172.21.15.176:6833","nonce":2164458476}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6830","nonce":2164458476},{"type":"v1","addr":"172.21.15.176:6831","nonce":2164458476}]},"public_addr":"172.21.15.176:6827/2164458476","cluster_addr":"172.21.15.176:6829/2164458476","heartbeat_back_addr":"172.21.15.176:6833/2164458476","heartbeat_front_addr":"172.21.15.176:6831/2164458476","state":["exists","up"]},{"osd":7,"uuid":"c8594fda-c74a-4ba9-8277-caf101d58ca1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":125,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6802","nonce":3239587708},{"type":"v1","addr":"172.21.15.176:6803","nonce":3239587708}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6804","nonce":3239587708},{"type":"v1","addr":"172.21.15.176:6805","nonce":3239587708}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6808","nonce":3239587708},{"type":"v1","addr":"172.21.15.176:6809","nonce":3239587708}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6806","nonce":3239587708},{"type":"v1","addr":"172.21.15.176:6807","nonce":3239587708}]},"public_addr":"172.21.15.176:6803/3239587708","cluster_addr":"172.21.15.176:6805/3239587708","heartbeat_back_addr":"172.21.15.176:6809/3239587708","heartbeat_front_addr":"172.21.15.176:6807/3239587708","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:41:41.905151+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:41:42.705679+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:41:42.459673+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:41:42.440819+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:41:42.668428+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:41:42.694972+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:41:43.078535+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:41:42.363539+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"19.c","mappings":[{"from":2,"to":0}]},{"pgid":"19.1f","mappings":[{"from":2,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":7,"snaps":[{"begin":2,"length":2}]},{"pool":9,"snaps":[{"begin":2,"length":2}]},{"pool":11,"snaps":[{"begin":2,"length":2}]},{"pool":13,"snaps":[{"begin":2,"length":2}]},{"pool":15,"snaps":[{"begin":2,"length":2}]},{"pool":17,"snaps":[{"begin":2,"length":2}]},{"pool":19,"snaps":[{"begin":2,"length":2}]}],"new_removed_snaps":[{"pool":19,"snaps":[{"begin":2,"length":2}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T05:53:02.104 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:02.103+0000 7f5f1ff6e640 1 -- 172.21.15.150:0/531650773 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f5efc07ad50 msgr2=0x7f5efc07d260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:53:02.104 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:02.103+0000 7f5f1ff6e640 1 --2- 172.21.15.150:0/531650773 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f5efc07ad50 0x7f5efc07d260 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 crypto rx=0x7f5f180b6e20 tx=0x7f5f08009040 comp rx=0 tx=0).stop 2024-09-17T05:53:02.104 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:02.103+0000 7f5f1ff6e640 1 -- 172.21.15.150:0/531650773 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5f180b5410 msgr2=0x7f5f181538a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:53:02.105 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:02.103+0000 7f5f1ff6e640 1 --2- 172.21.15.150:0/531650773 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5f180b5410 0x7f5f181538a0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f5f18073d40 tx=0x7f5f14033c20 comp rx=0 tx=0).stop 2024-09-17T05:53:02.105 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:02.103+0000 7f5f1ff6e640 1 -- 172.21.15.150:0/531650773 shutdown_connections 2024-09-17T05:53:02.105 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:02.103+0000 7f5f1ff6e640 1 --2- 172.21.15.150:0/531650773 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5f180cf7c0 0x7f5f1806cda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:53:02.105 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:02.103+0000 7f5f1ff6e640 1 --2- 172.21.15.150:0/531650773 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f5efc07ad50 0x7f5efc07d260 unknown :-1 s=CLOSED pgs=752 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:53:02.105 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:02.103+0000 7f5f1ff6e640 1 --2- 172.21.15.150:0/531650773 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5f1815ee30 0x7f5f1806d2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:53:02.105 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:02.103+0000 7f5f1ff6e640 1 --2- 172.21.15.150:0/531650773 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5f180b5410 0x7f5f181538a0 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:53:02.105 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:02.103+0000 7f5f1ff6e640 1 -- 172.21.15.150:0/531650773 >> 172.21.15.150:0/531650773 conn(0x7f5f180b2fd0 msgr2=0x7f5f18070c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:53:02.105 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:02.103+0000 7f5f1ff6e640 1 -- 172.21.15.150:0/531650773 shutdown_connections 2024-09-17T05:53:02.105 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:02.103+0000 7f5f1ff6e640 1 -- 172.21.15.150:0/531650773 wait complete. 2024-09-17T05:53:02.116 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-09-17T05:53:02.230 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:02.229+0000 7f3ec07c3640 1 -- 172.21.15.150:0/2050930991 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3eb80b55c0 msgr2=0x7f3eb806f9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:53:02.230 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:02.229+0000 7f3ec07c3640 1 --2- 172.21.15.150:0/2050930991 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3eb80b55c0 0x7f3eb806f9a0 secure :-1 s=READY pgs=1775 cs=0 l=1 rev1=1 crypto rx=0x7f3eb80ce170 tx=0x7f3eb002aa30 comp rx=0 tx=0).stop 2024-09-17T05:53:02.231 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:02.229+0000 7f3ec07c3640 1 -- 172.21.15.150:0/2050930991 shutdown_connections 2024-09-17T05:53:02.231 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:02.229+0000 7f3ec07c3640 1 --2- 172.21.15.150:0/2050930991 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3eb80b55c0 0x7f3eb806f9a0 unknown :-1 s=CLOSED pgs=1775 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:53:02.231 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:02.229+0000 7f3ec07c3640 1 --2- 172.21.15.150:0/2050930991 >> v2:172.21.15.176:3300/0 conn(0x7f3eb806e4c0 0x7f3eb80b5080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:53:02.231 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:02.229+0000 7f3ec07c3640 1 -- 172.21.15.150:0/2050930991 >> 172.21.15.150:0/2050930991 conn(0x7f3eb8073940 msgr2=0x7f3eb8073d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:53:02.231 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:02.229+0000 7f3ec07c3640 1 -- 172.21.15.150:0/2050930991 shutdown_connections 2024-09-17T05:53:02.231 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:02.229+0000 7f3ec07c3640 1 -- 172.21.15.150:0/2050930991 wait complete. 2024-09-17T05:53:02.231 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:02.231+0000 7f3ec07c3640 1 Processor -- start 2024-09-17T05:53:02.232 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:02.231+0000 7f3ec07c3640 1 -- start start 2024-09-17T05:53:02.234 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:02.232+0000 7f3ec07c3640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3eb80b55c0 0x7f3eb813fe40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:53:02.234 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:02.232+0000 7f3ec07c3640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3eb8144790 0x7f3eb8140380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:53:02.235 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:02.232+0000 7f3ec07c3640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3eb813cf80 0x7f3eb813d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:53:02.235 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:02.232+0000 7f3ec07c3640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f3eb8075ea0 con 0x7f3eb813cf80 2024-09-17T05:53:02.235 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:02.232+0000 7f3ec07c3640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f3eb8075d20 con 0x7f3eb8144790 2024-09-17T05:53:02.235 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:02.232+0000 7f3ec07c3640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f3eb8076020 con 0x7f3eb80b55c0 2024-09-17T05:53:02.235 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:02.232+0000 7f3ebed60640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3eb813cf80 0x7f3eb813d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:53:02.235 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:02.232+0000 7f3ebed60640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3eb813cf80 0x7f3eb813d390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:37428/0 (socket says 172.21.15.150:37428) 2024-09-17T05:53:02.235 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:02.232+0000 7f3ebed60640 1 -- 172.21.15.150:0/2024379690 learned_addr learned my addr 172.21.15.150:0/2024379690 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:53:02.235 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:02.232+0000 7f3ebe55f640 1 --2- 172.21.15.150:0/2024379690 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3eb80b55c0 0x7f3eb813fe40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:53:02.235 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:02.232+0000 7f3ebdd5e640 1 --2- 172.21.15.150:0/2024379690 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3eb8144790 0x7f3eb8140380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:53:02.235 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:02.233+0000 7f3ebed60640 1 -- 172.21.15.150:0/2024379690 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3eb80b55c0 msgr2=0x7f3eb813fe40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:53:02.235 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:02.233+0000 7f3ebed60640 1 --2- 172.21.15.150:0/2024379690 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3eb80b55c0 0x7f3eb813fe40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:53:02.235 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:02.233+0000 7f3ebed60640 1 -- 172.21.15.150:0/2024379690 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3eb8144790 msgr2=0x7f3eb8140380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:53:02.236 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:02.233+0000 7f3ebed60640 1 --2- 172.21.15.150:0/2024379690 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3eb8144790 0x7f3eb8140380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:53:02.236 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:02.233+0000 7f3ebed60640 1 -- 172.21.15.150:0/2024379690 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3eb8143c50 con 0x7f3eb813cf80 2024-09-17T05:53:02.236 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:02.233+0000 7f3ebed60640 1 --2- 172.21.15.150:0/2024379690 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3eb813cf80 0x7f3eb813d390 secure :-1 s=READY pgs=1776 cs=0 l=1 rev1=1 crypto rx=0x7f3eb002b020 tx=0x7f3eb0003f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:53:02.236 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:02.233+0000 7f3eaeffd640 1 -- 172.21.15.150:0/2024379690 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3eb0033050 con 0x7f3eb813cf80 2024-09-17T05:53:02.236 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:02.233+0000 7f3eaeffd640 1 -- 172.21.15.150:0/2024379690 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f3eb0004450 con 0x7f3eb813cf80 2024-09-17T05:53:02.236 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:02.233+0000 7f3ec07c3640 1 -- 172.21.15.150:0/2024379690 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3eb80a9f60 con 0x7f3eb813cf80 2024-09-17T05:53:02.236 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:02.233+0000 7f3eaeffd640 1 -- 172.21.15.150:0/2024379690 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3eb0004840 con 0x7f3eb813cf80 2024-09-17T05:53:02.236 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:02.233+0000 7f3ec07c3640 1 -- 172.21.15.150:0/2024379690 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3eb80aa520 con 0x7f3eb813cf80 2024-09-17T05:53:02.236 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:02.234+0000 7f3ec07c3640 1 -- 172.21.15.150:0/2024379690 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3eb80b5080 con 0x7f3eb813cf80 2024-09-17T05:53:02.237 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:02.235+0000 7f3eaeffd640 1 -- 172.21.15.150:0/2024379690 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 45) ==== 104501+0+0 (secure 0 0 0) 0x7f3eb0036070 con 0x7f3eb813cf80 2024-09-17T05:53:02.237 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:02.235+0000 7f3eaeffd640 1 --2- 172.21.15.150:0/2024379690 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f3e9c07ad80 0x7f3e9c07d290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:53:02.237 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:02.235+0000 7f3eaeffd640 1 -- 172.21.15.150:0/2024379690 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(130..130 src has 1..130) ==== 5991+0+0 (secure 0 0 0) 0x7f3eb00bb250 con 0x7f3eb813cf80 2024-09-17T05:53:02.237 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:02.235+0000 7f3ebe55f640 1 --2- 172.21.15.150:0/2024379690 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f3e9c07ad80 0x7f3e9c07d290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:53:02.237 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:02.236+0000 7f3ebe55f640 1 --2- 172.21.15.150:0/2024379690 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f3e9c07ad80 0x7f3e9c07d290 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 crypto rx=0x7f3eb40055f0 tx=0x7f3eb4007e30 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:53:02.240 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:02.240+0000 7f3eaeffd640 1 -- 172.21.15.150:0/2024379690 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f3eb0084b40 con 0x7f3eb813cf80 2024-09-17T05:53:02.448 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:02.447+0000 7f3ec07c3640 1 -- 172.21.15.150:0/2024379690 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7f3eb8074a90 con 0x7f3eb813cf80 2024-09-17T05:53:02.448 INFO:tasks.ceph.mon.a.smithi150.stderr:2024-09-17T05:53:02.448+0000 7f73931ae640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-17T05:53:02.450 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:02.449+0000 7f3eaeffd640 1 -- 172.21.15.150:0/2024379690 <== mon.0 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v82) ==== 161+0+0 (secure 0 0 0) 0x7f3eb0089570 con 0x7f3eb813cf80 2024-09-17T05:53:02.450 INFO:teuthology.orchestra.run.smithi150.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-09-17T05:53:02.453 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:02.452+0000 7f3ec07c3640 1 -- 172.21.15.150:0/2024379690 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f3e9c07ad80 msgr2=0x7f3e9c07d290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:53:02.453 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:02.452+0000 7f3ec07c3640 1 --2- 172.21.15.150:0/2024379690 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f3e9c07ad80 0x7f3e9c07d290 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 crypto rx=0x7f3eb40055f0 tx=0x7f3eb4007e30 comp rx=0 tx=0).stop 2024-09-17T05:53:02.453 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:02.452+0000 7f3ec07c3640 1 -- 172.21.15.150:0/2024379690 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3eb813cf80 msgr2=0x7f3eb813d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:53:02.453 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:02.452+0000 7f3ec07c3640 1 --2- 172.21.15.150:0/2024379690 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3eb813cf80 0x7f3eb813d390 secure :-1 s=READY pgs=1776 cs=0 l=1 rev1=1 crypto rx=0x7f3eb002b020 tx=0x7f3eb0003f10 comp rx=0 tx=0).stop 2024-09-17T05:53:02.453 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:02.452+0000 7f3ec07c3640 1 -- 172.21.15.150:0/2024379690 shutdown_connections 2024-09-17T05:53:02.454 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:02.452+0000 7f3ec07c3640 1 --2- 172.21.15.150:0/2024379690 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3eb8144790 0x7f3eb8140380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:53:02.454 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:02.452+0000 7f3ec07c3640 1 --2- 172.21.15.150:0/2024379690 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f3e9c07ad80 0x7f3e9c07d290 unknown :-1 s=CLOSED pgs=753 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:53:02.454 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:02.452+0000 7f3ec07c3640 1 --2- 172.21.15.150:0/2024379690 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3eb813cf80 0x7f3eb813d390 unknown :-1 s=CLOSED pgs=1776 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:53:02.454 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:02.452+0000 7f3ec07c3640 1 --2- 172.21.15.150:0/2024379690 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3eb80b55c0 0x7f3eb813fe40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:53:02.454 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:02.452+0000 7f3ec07c3640 1 -- 172.21.15.150:0/2024379690 >> 172.21.15.150:0/2024379690 conn(0x7f3eb8073940 msgr2=0x7f3eb8073d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:53:02.454 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:02.452+0000 7f3ec07c3640 1 -- 172.21.15.150:0/2024379690 shutdown_connections 2024-09-17T05:53:02.454 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:02.452+0000 7f3ec07c3640 1 -- 172.21.15.150:0/2024379690 wait complete. 2024-09-17T05:53:02.465 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-09-17T05:53:02.518 INFO:tasks.ceph.mds.d.smithi176.stdout:starting mds.d at 2024-09-17T05:53:02.582 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:02.581+0000 7f9fbed89640 1 -- 172.21.15.150:0/98366109 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9fb80b16f0 msgr2=0x7f9fb80b1ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:53:02.582 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:02.581+0000 7f9fbed89640 1 --2- 172.21.15.150:0/98366109 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9fb80b16f0 0x7f9fb80b1ec0 secure :-1 s=READY pgs=1779 cs=0 l=1 rev1=1 crypto rx=0x7f9fac009830 tx=0x7f9fac02a3f0 comp rx=0 tx=0).stop 2024-09-17T05:53:02.582 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:02.581+0000 7f9fbed89640 1 -- 172.21.15.150:0/98366109 shutdown_connections 2024-09-17T05:53:02.582 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:02.581+0000 7f9fbed89640 1 --2- 172.21.15.150:0/98366109 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9fb80cf390 0x7f9fb80cf7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:53:02.582 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:02.581+0000 7f9fbed89640 1 --2- 172.21.15.150:0/98366109 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9fb80b16f0 0x7f9fb80b1ec0 unknown :-1 s=CLOSED pgs=1779 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:53:02.583 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:02.581+0000 7f9fbed89640 1 -- 172.21.15.150:0/98366109 >> 172.21.15.150:0/98366109 conn(0x7f9fb80b2ff0 msgr2=0x7f9fb80b3400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:53:02.583 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:02.581+0000 7f9fbed89640 1 -- 172.21.15.150:0/98366109 shutdown_connections 2024-09-17T05:53:02.583 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:02.581+0000 7f9fbed89640 1 -- 172.21.15.150:0/98366109 wait complete. 2024-09-17T05:53:02.583 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:02.583+0000 7f9fbed89640 1 Processor -- start 2024-09-17T05:53:02.583 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:02.583+0000 7f9fbed89640 1 -- start start 2024-09-17T05:53:02.586 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:02.584+0000 7f9fbed89640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9fb80b16f0 0x7f9fb81f7ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:53:02.586 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:02.584+0000 7f9fbed89640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9fb80b25e0 0x7f9fb81d9c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:53:02.586 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:02.584+0000 7f9fbed89640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9fb80cf390 0x7f9fb806cda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:53:02.587 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:02.584+0000 7f9fbed89640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f9fb80ae740 con 0x7f9fb80cf390 2024-09-17T05:53:02.587 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:02.584+0000 7f9fbed89640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f9fb80ae5c0 con 0x7f9fb80b16f0 2024-09-17T05:53:02.587 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:02.584+0000 7f9fbed89640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f9fb80ae8c0 con 0x7f9fb80b25e0 2024-09-17T05:53:02.587 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:02.584+0000 7f9fbd326640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9fb80cf390 0x7f9fb806cda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:53:02.587 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:02.584+0000 7f9fbd326640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9fb80cf390 0x7f9fb806cda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:37444/0 (socket says 172.21.15.150:37444) 2024-09-17T05:53:02.587 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:02.584+0000 7f9fbd326640 1 -- 172.21.15.150:0/1564251648 learned_addr learned my addr 172.21.15.150:0/1564251648 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:53:02.587 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:02.584+0000 7f9fb7fff640 1 --2- 172.21.15.150:0/1564251648 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9fb80b25e0 0x7f9fb81d9c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:53:02.587 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:02.584+0000 7f9fbcb25640 1 --2- 172.21.15.150:0/1564251648 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9fb80b16f0 0x7f9fb81f7ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:53:02.587 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:02.585+0000 7f9fbd326640 1 -- 172.21.15.150:0/1564251648 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9fb80b25e0 msgr2=0x7f9fb81d9c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:53:02.587 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:02.585+0000 7f9fbd326640 1 --2- 172.21.15.150:0/1564251648 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9fb80b25e0 0x7f9fb81d9c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:53:02.587 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:02.585+0000 7f9fbd326640 1 -- 172.21.15.150:0/1564251648 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9fb80b16f0 msgr2=0x7f9fb81f7ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:53:02.587 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:02.585+0000 7f9fbd326640 1 --2- 172.21.15.150:0/1564251648 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9fb80b16f0 0x7f9fb81f7ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:53:02.588 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:02.585+0000 7f9fbd326640 1 -- 172.21.15.150:0/1564251648 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9fb80cb360 con 0x7f9fb80cf390 2024-09-17T05:53:02.588 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:02.585+0000 7f9fbd326640 1 --2- 172.21.15.150:0/1564251648 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9fb80cf390 0x7f9fb806cda0 secure :-1 s=READY pgs=1780 cs=0 l=1 rev1=1 crypto rx=0x7f9fb000ea80 tx=0x7f9fb000ef40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:53:02.588 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:02.585+0000 7f9fb57fa640 1 -- 172.21.15.150:0/1564251648 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9fb0004b20 con 0x7f9fb80cf390 2024-09-17T05:53:02.588 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:02.585+0000 7f9fb57fa640 1 -- 172.21.15.150:0/1564251648 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9fb0004ce0 con 0x7f9fb80cf390 2024-09-17T05:53:02.588 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:02.585+0000 7f9fbed89640 1 -- 172.21.15.150:0/1564251648 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9fb80cb640 con 0x7f9fb80cf390 2024-09-17T05:53:02.588 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:02.585+0000 7f9fb57fa640 1 -- 172.21.15.150:0/1564251648 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9fb0005280 con 0x7f9fb80cf390 2024-09-17T05:53:02.588 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:02.585+0000 7f9fbed89640 1 -- 172.21.15.150:0/1564251648 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9fb81f72c0 con 0x7f9fb80cf390 2024-09-17T05:53:02.589 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:02.586+0000 7f9fbed89640 1 -- 172.21.15.150:0/1564251648 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9fb80b1ec0 con 0x7f9fb80cf390 2024-09-17T05:53:02.589 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:02.587+0000 7f9fb57fa640 1 -- 172.21.15.150:0/1564251648 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 45) ==== 104501+0+0 (secure 0 0 0) 0x7f9fb0005420 con 0x7f9fb80cf390 2024-09-17T05:53:02.589 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:02.587+0000 7f9fb57fa640 1 --2- 172.21.15.150:0/1564251648 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f9fa407ad50 0x7f9fa407d260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:53:02.589 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:02.587+0000 7f9fb57fa640 1 -- 172.21.15.150:0/1564251648 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(131..131 src has 1..131) ==== 6049+0+0 (secure 0 0 0) 0x7f9fb009a980 con 0x7f9fb80cf390 2024-09-17T05:53:02.589 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:02.587+0000 7f9fbcb25640 1 --2- 172.21.15.150:0/1564251648 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f9fa407ad50 0x7f9fa407d260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:53:02.589 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:02.588+0000 7f9fbcb25640 1 --2- 172.21.15.150:0/1564251648 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f9fa407ad50 0x7f9fa407d260 secure :-1 s=READY pgs=754 cs=0 l=1 rev1=1 crypto rx=0x7f9fa8000f60 tx=0x7f9fa8009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:53:02.592 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:02.592+0000 7f9fb57fa640 1 -- 172.21.15.150:0/1564251648 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f9fb0064280 con 0x7f9fb80cf390 2024-09-17T05:53:02.803 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:02.803+0000 7f9fbed89640 1 -- 172.21.15.150:0/1564251648 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7f9fb80cb0e0 con 0x7f9fb80cf390 2024-09-17T05:53:03.451 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:03.451+0000 7f9fb57fa640 1 -- 172.21.15.150:0/1564251648 <== mon.0 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v83) ==== 104+0+0 (secure 0 0 0) 0x7f9fb80cb0e0 con 0x7f9fb80cf390 2024-09-17T05:53:03.454 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:03.453+0000 7f9fbed89640 1 -- 172.21.15.150:0/1564251648 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f9fa407ad50 msgr2=0x7f9fa407d260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:53:03.455 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:03.453+0000 7f9fbed89640 1 --2- 172.21.15.150:0/1564251648 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f9fa407ad50 0x7f9fa407d260 secure :-1 s=READY pgs=754 cs=0 l=1 rev1=1 crypto rx=0x7f9fa8000f60 tx=0x7f9fa8009040 comp rx=0 tx=0).stop 2024-09-17T05:53:03.455 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:03.453+0000 7f9fbed89640 1 -- 172.21.15.150:0/1564251648 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9fb80cf390 msgr2=0x7f9fb806cda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:53:03.455 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:03.453+0000 7f9fbed89640 1 --2- 172.21.15.150:0/1564251648 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9fb80cf390 0x7f9fb806cda0 secure :-1 s=READY pgs=1780 cs=0 l=1 rev1=1 crypto rx=0x7f9fb000ea80 tx=0x7f9fb000ef40 comp rx=0 tx=0).stop 2024-09-17T05:53:03.455 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:03.453+0000 7f9fbed89640 1 -- 172.21.15.150:0/1564251648 shutdown_connections 2024-09-17T05:53:03.455 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:03.453+0000 7f9fbed89640 1 --2- 172.21.15.150:0/1564251648 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f9fa407ad50 0x7f9fa407d260 unknown :-1 s=CLOSED pgs=754 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:53:03.455 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:03.453+0000 7f9fbed89640 1 --2- 172.21.15.150:0/1564251648 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9fb80cf390 0x7f9fb806cda0 unknown :-1 s=CLOSED pgs=1780 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:53:03.455 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:03.453+0000 7f9fbed89640 1 --2- 172.21.15.150:0/1564251648 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9fb80b25e0 0x7f9fb81d9c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:53:03.455 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:03.453+0000 7f9fbed89640 1 --2- 172.21.15.150:0/1564251648 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9fb80b16f0 0x7f9fb81f7ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:53:03.455 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:03.454+0000 7f9fbed89640 1 -- 172.21.15.150:0/1564251648 >> 172.21.15.150:0/1564251648 conn(0x7f9fb80b2ff0 msgr2=0x7f9fb81e4010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:53:03.455 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:03.454+0000 7f9fbed89640 1 -- 172.21.15.150:0/1564251648 shutdown_connections 2024-09-17T05:53:03.455 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:03.454+0000 7f9fbed89640 1 -- 172.21.15.150:0/1564251648 wait complete. 2024-09-17T05:53:03.467 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-09-17T05:53:03.588 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:03.587+0000 7f52a3869640 1 -- 172.21.15.150:0/4227343111 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f529c15c820 msgr2=0x7f529c06f940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:53:03.588 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:03.587+0000 7f52a3869640 1 --2- 172.21.15.150:0/4227343111 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f529c15c820 0x7f529c06f940 secure :-1 s=READY pgs=1782 cs=0 l=1 rev1=1 crypto rx=0x7f5294009be0 tx=0x7f529402a8d0 comp rx=0 tx=0).stop 2024-09-17T05:53:03.588 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:03.587+0000 7f52a3869640 1 -- 172.21.15.150:0/4227343111 shutdown_connections 2024-09-17T05:53:03.588 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:03.587+0000 7f52a3869640 1 --2- 172.21.15.150:0/4227343111 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f529c06e4c0 0x7f529c0747c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:53:03.588 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:03.587+0000 7f52a3869640 1 --2- 172.21.15.150:0/4227343111 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f529c15c820 0x7f529c06f940 unknown :-1 s=CLOSED pgs=1782 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:53:03.589 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:03.587+0000 7f52a3869640 1 -- 172.21.15.150:0/4227343111 >> 172.21.15.150:0/4227343111 conn(0x7f529c0738e0 msgr2=0x7f529c073cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:53:03.589 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:03.587+0000 7f52a3869640 1 -- 172.21.15.150:0/4227343111 shutdown_connections 2024-09-17T05:53:03.589 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:03.587+0000 7f52a3869640 1 -- 172.21.15.150:0/4227343111 wait complete. 2024-09-17T05:53:03.589 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:03.589+0000 7f52a3869640 1 Processor -- start 2024-09-17T05:53:03.589 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:03.589+0000 7f52a3869640 1 -- start start 2024-09-17T05:53:03.593 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:03.590+0000 7f52a3869640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f529c0b0240 0x7f529c142d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:53:03.593 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:03.590+0000 7f52a3869640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f529c15c820 0x7f529c151130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:53:03.593 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:03.590+0000 7f52a3869640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f529c153100 0x7f529c1f3510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:53:03.593 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:03.590+0000 7f52a3869640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f529c070240 con 0x7f529c153100 2024-09-17T05:53:03.593 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:03.590+0000 7f52a3869640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f529c0700c0 con 0x7f529c15c820 2024-09-17T05:53:03.594 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:03.590+0000 7f52a3869640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f529c0703c0 con 0x7f529c0b0240 2024-09-17T05:53:03.594 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:03.590+0000 7f52a1e06640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f529c153100 0x7f529c1f3510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:53:03.594 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:03.590+0000 7f52a1e06640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f529c153100 0x7f529c1f3510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:37462/0 (socket says 172.21.15.150:37462) 2024-09-17T05:53:03.594 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:03.590+0000 7f52a1e06640 1 -- 172.21.15.150:0/2323640192 learned_addr learned my addr 172.21.15.150:0/2323640192 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:53:03.594 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:03.591+0000 7f52a1605640 1 --2- 172.21.15.150:0/2323640192 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f529c0b0240 0x7f529c142d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:53:03.594 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:03.591+0000 7f52a0e04640 1 --2- 172.21.15.150:0/2323640192 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f529c15c820 0x7f529c151130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:53:03.594 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:03.591+0000 7f52a1e06640 1 -- 172.21.15.150:0/2323640192 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f529c0b0240 msgr2=0x7f529c142d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:53:03.594 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:03.591+0000 7f52a1e06640 1 --2- 172.21.15.150:0/2323640192 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f529c0b0240 0x7f529c142d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:53:03.594 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:03.591+0000 7f52a1e06640 1 -- 172.21.15.150:0/2323640192 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f529c15c820 msgr2=0x7f529c151130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:53:03.594 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:03.591+0000 7f52a1e06640 1 --2- 172.21.15.150:0/2323640192 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f529c15c820 0x7f529c151130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:53:03.595 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:03.591+0000 7f52a1e06640 1 -- 172.21.15.150:0/2323640192 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f529c143280 con 0x7f529c153100 2024-09-17T05:53:03.595 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:03.591+0000 7f52a0e04640 1 --2- 172.21.15.150:0/2323640192 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f529c15c820 0x7f529c151130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T05:53:03.595 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:03.591+0000 7f52a1e06640 1 --2- 172.21.15.150:0/2323640192 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f529c153100 0x7f529c1f3510 secure :-1 s=READY pgs=1783 cs=0 l=1 rev1=1 crypto rx=0x7f5294005fd0 tx=0x7f52940315c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:53:03.595 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:03.591+0000 7f5291ffb640 1 -- 172.21.15.150:0/2323640192 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5294003e00 con 0x7f529c153100 2024-09-17T05:53:03.595 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:03.591+0000 7f5291ffb640 1 -- 172.21.15.150:0/2323640192 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f5294031a60 con 0x7f529c153100 2024-09-17T05:53:03.595 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:03.591+0000 7f52a3869640 1 -- 172.21.15.150:0/2323640192 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f529c151670 con 0x7f529c153100 2024-09-17T05:53:03.595 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:03.591+0000 7f5291ffb640 1 -- 172.21.15.150:0/2323640192 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52940330d0 con 0x7f529c153100 2024-09-17T05:53:03.595 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:03.591+0000 7f52a3869640 1 -- 172.21.15.150:0/2323640192 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f529c15d240 con 0x7f529c153100 2024-09-17T05:53:03.595 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:03.592+0000 7f52a3869640 1 -- 172.21.15.150:0/2323640192 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f529c0708e0 con 0x7f529c153100 2024-09-17T05:53:03.596 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:03.593+0000 7f5291ffb640 1 -- 172.21.15.150:0/2323640192 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 45) ==== 104501+0+0 (secure 0 0 0) 0x7f5294033270 con 0x7f529c153100 2024-09-17T05:53:03.596 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:03.593+0000 7f5291ffb640 1 --2- 172.21.15.150:0/2323640192 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f528007ad80 0x7f528007d290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:53:03.596 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:03.594+0000 7f5291ffb640 1 -- 172.21.15.150:0/2323640192 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(131..131 src has 1..131) ==== 6049+0+0 (secure 0 0 0) 0x7f52940bb0f0 con 0x7f529c153100 2024-09-17T05:53:03.597 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:03.594+0000 7f52a1605640 1 --2- 172.21.15.150:0/2323640192 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f528007ad80 0x7f528007d290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:53:03.597 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:03.594+0000 7f52a1605640 1 --2- 172.21.15.150:0/2323640192 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f528007ad80 0x7f528007d290 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 crypto rx=0x7f5298007fd0 tx=0x7f5298009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:53:03.598 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:03.598+0000 7f5291ffb640 1 -- 172.21.15.150:0/2323640192 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f529c143280 con 0x7f529c153100 2024-09-17T05:53:03.777 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:03.776+0000 7f52a3869640 1 -- 172.21.15.150:0/2323640192 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7f529c076390 con 0x7f529c153100 2024-09-17T05:53:04.453 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:04.452+0000 7f5291ffb640 1 -- 172.21.15.150:0/2323640192 <== mon.0 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v132) ==== 181+0+0 (secure 0 0 0) 0x7f529403f030 con 0x7f529c153100 2024-09-17T05:53:04.453 INFO:teuthology.orchestra.run.smithi150.stderr:pool 'cephfs_metadata' removed 2024-09-17T05:53:04.457 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:04.456+0000 7f52a3869640 1 -- 172.21.15.150:0/2323640192 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f528007ad80 msgr2=0x7f528007d290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:53:04.457 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:04.456+0000 7f52a3869640 1 --2- 172.21.15.150:0/2323640192 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f528007ad80 0x7f528007d290 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 crypto rx=0x7f5298007fd0 tx=0x7f5298009040 comp rx=0 tx=0).stop 2024-09-17T05:53:04.457 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:04.456+0000 7f52a3869640 1 -- 172.21.15.150:0/2323640192 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f529c153100 msgr2=0x7f529c1f3510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:53:04.457 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:04.456+0000 7f52a3869640 1 --2- 172.21.15.150:0/2323640192 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f529c153100 0x7f529c1f3510 secure :-1 s=READY pgs=1783 cs=0 l=1 rev1=1 crypto rx=0x7f5294005fd0 tx=0x7f52940315c0 comp rx=0 tx=0).stop 2024-09-17T05:53:04.459 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:04.458+0000 7f52a3869640 1 -- 172.21.15.150:0/2323640192 shutdown_connections 2024-09-17T05:53:04.459 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:04.458+0000 7f52a3869640 1 --2- 172.21.15.150:0/2323640192 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f529c15c820 0x7f529c151130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:53:04.459 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:04.458+0000 7f52a3869640 1 --2- 172.21.15.150:0/2323640192 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f528007ad80 0x7f528007d290 unknown :-1 s=CLOSED pgs=756 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:53:04.459 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:04.458+0000 7f52a3869640 1 --2- 172.21.15.150:0/2323640192 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f529c153100 0x7f529c1f3510 unknown :-1 s=CLOSED pgs=1783 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:53:04.459 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:04.458+0000 7f52a3869640 1 --2- 172.21.15.150:0/2323640192 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f529c0b0240 0x7f529c142d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:53:04.459 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:04.458+0000 7f52a3869640 1 -- 172.21.15.150:0/2323640192 >> 172.21.15.150:0/2323640192 conn(0x7f529c0738e0 msgr2=0x7f529c073cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:53:04.459 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:04.458+0000 7f52a3869640 1 -- 172.21.15.150:0/2323640192 shutdown_connections 2024-09-17T05:53:04.459 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:04.458+0000 7f52a3869640 1 -- 172.21.15.150:0/2323640192 wait complete. 2024-09-17T05:53:04.475 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-09-17T05:53:04.596 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:04.595+0000 7ff3dd1c3640 1 -- 172.21.15.150:0/2351792505 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff3c4005350 msgr2=0x7ff3c400b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:53:04.597 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:04.595+0000 7ff3dd1c3640 1 --2- 172.21.15.150:0/2351792505 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff3c4005350 0x7ff3c400b9c0 secure :-1 s=READY pgs=1785 cs=0 l=1 rev1=1 crypto rx=0x7ff3d0005fd0 tx=0x7ff3c4005830 comp rx=0 tx=0).stop 2024-09-17T05:53:04.597 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:04.595+0000 7ff3dd1c3640 1 -- 172.21.15.150:0/2351792505 shutdown_connections 2024-09-17T05:53:04.597 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:04.595+0000 7ff3dd1c3640 1 --2- 172.21.15.150:0/2351792505 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff3c4005350 0x7ff3c400b9c0 unknown :-1 s=CLOSED pgs=1785 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:53:04.597 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:04.595+0000 7ff3dd1c3640 1 -- 172.21.15.150:0/2351792505 >> 172.21.15.150:0/2351792505 conn(0x7ff3d80d46f0 msgr2=0x7ff3d80d4b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:53:04.597 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:04.595+0000 7ff3dd1c3640 1 -- 172.21.15.150:0/2351792505 shutdown_connections 2024-09-17T05:53:04.597 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:04.595+0000 7ff3dd1c3640 1 -- 172.21.15.150:0/2351792505 wait complete. 2024-09-17T05:53:04.598 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:04.597+0000 7ff3dd1c3640 1 Processor -- start 2024-09-17T05:53:04.598 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:04.598+0000 7ff3dd1c3640 1 -- start start 2024-09-17T05:53:04.601 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:04.599+0000 7ff3dd1c3640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff3c4005350 0x7ff3d80a1c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:53:04.602 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:04.599+0000 7ff3dd1c3640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff3d815c0d0 0x7ff3d815ba20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:53:04.602 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:04.599+0000 7ff3dd1c3640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff3d80b5cf0 0x7ff3d80b6100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:53:04.602 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:04.599+0000 7ff3dd1c3640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7ff3d80cf480 con 0x7ff3c4005350 2024-09-17T05:53:04.602 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:04.599+0000 7ff3dd1c3640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7ff3d80cf300 con 0x7ff3d80b5cf0 2024-09-17T05:53:04.602 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:04.599+0000 7ff3dd1c3640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7ff3d80cf600 con 0x7ff3d815c0d0 2024-09-17T05:53:04.602 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:04.599+0000 7ff3d6d9d640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff3c4005350 0x7ff3d80a1c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:53:04.602 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:04.599+0000 7ff3d6d9d640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff3c4005350 0x7ff3d80a1c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:37486/0 (socket says 172.21.15.150:37486) 2024-09-17T05:53:04.603 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:04.599+0000 7ff3d6d9d640 1 -- 172.21.15.150:0/2501240245 learned_addr learned my addr 172.21.15.150:0/2501240245 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:53:04.603 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:04.599+0000 7ff3ce59c640 1 --2- 172.21.15.150:0/2501240245 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff3d815c0d0 0x7ff3d815ba20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:53:04.603 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:04.599+0000 7ff3d759e640 1 --2- 172.21.15.150:0/2501240245 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff3d80b5cf0 0x7ff3d80b6100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:53:04.603 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:04.599+0000 7ff3d6d9d640 1 -- 172.21.15.150:0/2501240245 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff3d815c0d0 msgr2=0x7ff3d815ba20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:53:04.603 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:04.599+0000 7ff3d6d9d640 1 --2- 172.21.15.150:0/2501240245 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff3d815c0d0 0x7ff3d815ba20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:53:04.603 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:04.599+0000 7ff3d6d9d640 1 -- 172.21.15.150:0/2501240245 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff3d80b5cf0 msgr2=0x7ff3d80b6100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:53:04.603 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:04.599+0000 7ff3d6d9d640 1 --2- 172.21.15.150:0/2501240245 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff3d80b5cf0 0x7ff3d80b6100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:53:04.603 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:04.599+0000 7ff3d6d9d640 1 -- 172.21.15.150:0/2501240245 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff3d80b6640 con 0x7ff3c4005350 2024-09-17T05:53:04.603 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:04.600+0000 7ff3d6d9d640 1 --2- 172.21.15.150:0/2501240245 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff3c4005350 0x7ff3d80a1c20 secure :-1 s=READY pgs=1786 cs=0 l=1 rev1=1 crypto rx=0x7ff3c800f6b0 tx=0x7ff3c800fb70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:53:04.603 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:04.600+0000 7ff3cffff640 1 -- 172.21.15.150:0/2501240245 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3c8015070 con 0x7ff3c4005350 2024-09-17T05:53:04.603 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:04.600+0000 7ff3cffff640 1 -- 172.21.15.150:0/2501240245 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff3c8006170 con 0x7ff3c4005350 2024-09-17T05:53:04.604 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:04.600+0000 7ff3cffff640 1 -- 172.21.15.150:0/2501240245 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3c800c840 con 0x7ff3c4005350 2024-09-17T05:53:04.604 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:04.600+0000 7ff3dd1c3640 1 -- 172.21.15.150:0/2501240245 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff3d815e3e0 con 0x7ff3c4005350 2024-09-17T05:53:04.604 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:04.600+0000 7ff3dd1c3640 1 -- 172.21.15.150:0/2501240245 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff3d815e960 con 0x7ff3c4005350 2024-09-17T05:53:04.604 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:04.601+0000 7ff3dd1c3640 1 -- 172.21.15.150:0/2501240245 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff3d80d11c0 con 0x7ff3c4005350 2024-09-17T05:53:04.605 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:04.601+0000 7ff3cffff640 1 -- 172.21.15.150:0/2501240245 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 45) ==== 104501+0+0 (secure 0 0 0) 0x7ff3c8018070 con 0x7ff3c4005350 2024-09-17T05:53:04.605 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:04.602+0000 7ff3cffff640 1 --2- 172.21.15.150:0/2501240245 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7ff3b807ad80 0x7ff3b807d290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:53:04.605 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:04.602+0000 7ff3cffff640 1 -- 172.21.15.150:0/2501240245 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(132..132 src has 1..132) ==== 5611+0+0 (secure 0 0 0) 0x7ff3c8099e60 con 0x7ff3c4005350 2024-09-17T05:53:04.605 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:04.602+0000 7ff3ce59c640 1 --2- 172.21.15.150:0/2501240245 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7ff3b807ad80 0x7ff3b807d290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:53:04.605 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:04.603+0000 7ff3ce59c640 1 --2- 172.21.15.150:0/2501240245 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7ff3b807ad80 0x7ff3b807d290 secure :-1 s=READY pgs=757 cs=0 l=1 rev1=1 crypto rx=0x7ff3c0001a10 tx=0x7ff3c0006040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:53:04.607 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:04.606+0000 7ff3cffff640 1 -- 172.21.15.150:0/2501240245 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7ff3d80b6640 con 0x7ff3c4005350 2024-09-17T05:53:04.782 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:04.781+0000 7ff3dd1c3640 1 -- 172.21.15.150:0/2501240245 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7ff3d81621b0 con 0x7ff3c4005350 2024-09-17T05:53:05.459 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:05.458+0000 7ff3cffff640 1 -- 172.21.15.150:0/2501240245 <== mon.0 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v133) ==== 169+0+0 (secure 0 0 0) 0x7ff3c80637e0 con 0x7ff3c4005350 2024-09-17T05:53:05.459 INFO:teuthology.orchestra.run.smithi150.stderr:pool 'cephfs_data' removed 2024-09-17T05:53:05.467 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:05.464+0000 7ff3dd1c3640 1 -- 172.21.15.150:0/2501240245 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7ff3b807ad80 msgr2=0x7ff3b807d290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:53:05.467 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:05.464+0000 7ff3dd1c3640 1 --2- 172.21.15.150:0/2501240245 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7ff3b807ad80 0x7ff3b807d290 secure :-1 s=READY pgs=757 cs=0 l=1 rev1=1 crypto rx=0x7ff3c0001a10 tx=0x7ff3c0006040 comp rx=0 tx=0).stop 2024-09-17T05:53:05.467 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:05.464+0000 7ff3dd1c3640 1 -- 172.21.15.150:0/2501240245 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff3c4005350 msgr2=0x7ff3d80a1c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:53:05.467 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:05.464+0000 7ff3dd1c3640 1 --2- 172.21.15.150:0/2501240245 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff3c4005350 0x7ff3d80a1c20 secure :-1 s=READY pgs=1786 cs=0 l=1 rev1=1 crypto rx=0x7ff3c800f6b0 tx=0x7ff3c800fb70 comp rx=0 tx=0).stop 2024-09-17T05:53:05.468 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:05.466+0000 7ff3dd1c3640 1 -- 172.21.15.150:0/2501240245 shutdown_connections 2024-09-17T05:53:05.468 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:05.466+0000 7ff3dd1c3640 1 --2- 172.21.15.150:0/2501240245 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff3d80b5cf0 0x7ff3d80b6100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:53:05.468 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:05.466+0000 7ff3dd1c3640 1 --2- 172.21.15.150:0/2501240245 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7ff3b807ad80 0x7ff3b807d290 unknown :-1 s=CLOSED pgs=757 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:53:05.468 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:05.466+0000 7ff3dd1c3640 1 --2- 172.21.15.150:0/2501240245 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff3d815c0d0 0x7ff3d815ba20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:53:05.468 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:05.466+0000 7ff3dd1c3640 1 --2- 172.21.15.150:0/2501240245 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff3c4005350 0x7ff3d80a1c20 unknown :-1 s=CLOSED pgs=1786 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:53:05.468 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:05.466+0000 7ff3dd1c3640 1 -- 172.21.15.150:0/2501240245 >> 172.21.15.150:0/2501240245 conn(0x7ff3d80d46f0 msgr2=0x7ff3d815f460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:53:05.468 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:05.467+0000 7ff3dd1c3640 1 -- 172.21.15.150:0/2501240245 shutdown_connections 2024-09-17T05:53:05.468 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:05.467+0000 7ff3dd1c3640 1 -- 172.21.15.150:0/2501240245 wait complete. 2024-09-17T05:53:05.486 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config reset 31 2024-09-17T05:53:05.610 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:05.608+0000 7f9b9b48c640 1 -- 172.21.15.150:0/704441113 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9b940c5a90 msgr2=0x7f9b940b5250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:53:05.610 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:05.608+0000 7f9b9b48c640 1 --2- 172.21.15.150:0/704441113 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9b940c5a90 0x7f9b940b5250 secure :-1 s=READY pgs=1788 cs=0 l=1 rev1=1 crypto rx=0x7f9b940d1660 tx=0x7f9b8402a530 comp rx=0 tx=0).stop 2024-09-17T05:53:05.610 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:05.608+0000 7f9b9b48c640 1 -- 172.21.15.150:0/704441113 shutdown_connections 2024-09-17T05:53:05.610 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:05.608+0000 7f9b9b48c640 1 --2- 172.21.15.150:0/704441113 >> v2:172.21.15.176:3300/0 conn(0x7f9b940b5790 0x7f9b940b5ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:53:05.610 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:05.608+0000 7f9b9b48c640 1 --2- 172.21.15.150:0/704441113 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9b940c5a90 0x7f9b940b5250 unknown :-1 s=CLOSED pgs=1788 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:53:05.610 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:05.608+0000 7f9b9b48c640 1 -- 172.21.15.150:0/704441113 >> 172.21.15.150:0/704441113 conn(0x7f9b940cee80 msgr2=0x7f9b940cf290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:53:05.610 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:05.608+0000 7f9b9b48c640 1 -- 172.21.15.150:0/704441113 shutdown_connections 2024-09-17T05:53:05.610 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:05.609+0000 7f9b9b48c640 1 -- 172.21.15.150:0/704441113 wait complete. 2024-09-17T05:53:05.611 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:05.610+0000 7f9b9b48c640 1 Processor -- start 2024-09-17T05:53:05.611 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:05.610+0000 7f9b9b48c640 1 -- start start 2024-09-17T05:53:05.613 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:05.612+0000 7f9b9b48c640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9b940b5790 0x7f9b940b24e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:53:05.614 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:05.612+0000 7f9b9b48c640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9b940c5a90 0x7f9b9414e5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:53:05.614 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:05.612+0000 7f9b9b48c640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9b940cea50 0x7f9b9414eaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:53:05.614 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:05.612+0000 7f9b9b48c640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f9b940cd0f0 con 0x7f9b940cea50 2024-09-17T05:53:05.614 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:05.612+0000 7f9b9b48c640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f9b9409bc70 con 0x7f9b940c5a90 2024-09-17T05:53:05.614 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:05.612+0000 7f9b9b48c640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f9b940cd270 con 0x7f9b940b5790 2024-09-17T05:53:05.614 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:05.612+0000 7f9b99a29640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9b940cea50 0x7f9b9414eaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:53:05.614 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:05.612+0000 7f9b99a29640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9b940cea50 0x7f9b9414eaf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:37506/0 (socket says 172.21.15.150:37506) 2024-09-17T05:53:05.614 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:05.612+0000 7f9b99a29640 1 -- 172.21.15.150:0/202426138 learned_addr learned my addr 172.21.15.150:0/202426138 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:53:05.614 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:05.612+0000 7f9b98a27640 1 --2- 172.21.15.150:0/202426138 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9b940c5a90 0x7f9b9414e5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:53:05.614 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:05.612+0000 7f9b99228640 1 --2- 172.21.15.150:0/202426138 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9b940b5790 0x7f9b940b24e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:53:05.614 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:05.612+0000 7f9b99a29640 1 -- 172.21.15.150:0/202426138 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9b940b5790 msgr2=0x7f9b940b24e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:53:05.614 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:05.612+0000 7f9b99a29640 1 --2- 172.21.15.150:0/202426138 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9b940b5790 0x7f9b940b24e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:53:05.615 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:05.612+0000 7f9b99a29640 1 -- 172.21.15.150:0/202426138 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9b940c5a90 msgr2=0x7f9b9414e5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:53:05.615 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:05.612+0000 7f9b99a29640 1 --2- 172.21.15.150:0/202426138 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9b940c5a90 0x7f9b9414e5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:53:05.615 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:05.612+0000 7f9b99a29640 1 -- 172.21.15.150:0/202426138 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9b9409e420 con 0x7f9b940cea50 2024-09-17T05:53:05.615 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:05.612+0000 7f9b99a29640 1 --2- 172.21.15.150:0/202426138 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9b940cea50 0x7f9b9414eaf0 secure :-1 s=READY pgs=1789 cs=0 l=1 rev1=1 crypto rx=0x7f9b8c00e960 tx=0x7f9b8c00ee20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:53:05.615 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:05.612+0000 7f9b89ffb640 1 -- 172.21.15.150:0/202426138 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b8c004d20 con 0x7f9b940cea50 2024-09-17T05:53:05.615 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:05.612+0000 7f9b89ffb640 1 -- 172.21.15.150:0/202426138 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9b8c00cb20 con 0x7f9b940cea50 2024-09-17T05:53:05.615 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:05.612+0000 7f9b9b48c640 1 -- 172.21.15.150:0/202426138 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9b9409e700 con 0x7f9b940cea50 2024-09-17T05:53:05.615 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:05.612+0000 7f9b89ffb640 1 -- 172.21.15.150:0/202426138 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b8c005020 con 0x7f9b940cea50 2024-09-17T05:53:05.615 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:05.613+0000 7f9b9b48c640 1 -- 172.21.15.150:0/202426138 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9b9409ecc0 con 0x7f9b940cea50 2024-09-17T05:53:05.616 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:05.614+0000 7f9b9b48c640 1 -- 172.21.15.150:0/202426138 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9b940d1750 con 0x7f9b940cea50 2024-09-17T05:53:05.616 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:05.614+0000 7f9b89ffb640 1 -- 172.21.15.150:0/202426138 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 45) ==== 104501+0+0 (secure 0 0 0) 0x7f9b8c0051c0 con 0x7f9b940cea50 2024-09-17T05:53:05.616 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:05.615+0000 7f9b89ffb640 1 --2- 172.21.15.150:0/202426138 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f9b7807ad50 0x7f9b7807d260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:53:05.616 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:05.615+0000 7f9b89ffb640 1 -- 172.21.15.150:0/202426138 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(133..133 src has 1..133) ==== 5139+0+0 (secure 0 0 0) 0x7f9b8c09a6f0 con 0x7f9b940cea50 2024-09-17T05:53:05.616 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:05.615+0000 7f9b99228640 1 --2- 172.21.15.150:0/202426138 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f9b7807ad50 0x7f9b7807d260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:53:05.616 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:05.616+0000 7f9b99228640 1 --2- 172.21.15.150:0/202426138 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f9b7807ad50 0x7f9b7807d260 secure :-1 s=READY pgs=758 cs=0 l=1 rev1=1 crypto rx=0x7f9b900016f0 tx=0x7f9b90009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:53:05.620 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:05.619+0000 7f9b89ffb640 1 -- 172.21.15.150:0/202426138 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f9b940d1750 con 0x7f9b940cea50 2024-09-17T05:53:05.795 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:05.794+0000 7f9b9b48c640 1 -- 172.21.15.150:0/202426138 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "config reset", "num": 31} v 0) -- 0x7f9b9414f0f0 con 0x7f9b940cea50 2024-09-17T05:53:05.799 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:05.799+0000 7f9b89ffb640 1 -- 172.21.15.150:0/202426138 <== mon.0 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "config reset", "num": 31}]=0 v57) ==== 71+0+0 (secure 0 0 0) 0x7f9b8c016030 con 0x7f9b940cea50 2024-09-17T05:53:05.802 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:05.801+0000 7f9b9b48c640 1 -- 172.21.15.150:0/202426138 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f9b7807ad50 msgr2=0x7f9b7807d260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:53:05.802 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:05.801+0000 7f9b9b48c640 1 --2- 172.21.15.150:0/202426138 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f9b7807ad50 0x7f9b7807d260 secure :-1 s=READY pgs=758 cs=0 l=1 rev1=1 crypto rx=0x7f9b900016f0 tx=0x7f9b90009040 comp rx=0 tx=0).stop 2024-09-17T05:53:05.802 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:05.801+0000 7f9b9b48c640 1 -- 172.21.15.150:0/202426138 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9b940cea50 msgr2=0x7f9b9414eaf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:53:05.802 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:05.801+0000 7f9b9b48c640 1 --2- 172.21.15.150:0/202426138 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9b940cea50 0x7f9b9414eaf0 secure :-1 s=READY pgs=1789 cs=0 l=1 rev1=1 crypto rx=0x7f9b8c00e960 tx=0x7f9b8c00ee20 comp rx=0 tx=0).stop 2024-09-17T05:53:05.802 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:05.801+0000 7f9b9b48c640 1 -- 172.21.15.150:0/202426138 shutdown_connections 2024-09-17T05:53:05.803 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:05.801+0000 7f9b9b48c640 1 --2- 172.21.15.150:0/202426138 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9b940c5a90 0x7f9b9414e5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:53:05.803 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:05.801+0000 7f9b9b48c640 1 --2- 172.21.15.150:0/202426138 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f9b7807ad50 0x7f9b7807d260 unknown :-1 s=CLOSED pgs=758 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:53:05.803 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:05.801+0000 7f9b9b48c640 1 --2- 172.21.15.150:0/202426138 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9b940cea50 0x7f9b9414eaf0 unknown :-1 s=CLOSED pgs=1789 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:53:05.803 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:05.801+0000 7f9b9b48c640 1 --2- 172.21.15.150:0/202426138 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9b940b5790 0x7f9b940b24e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:53:05.803 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:05.801+0000 7f9b9b48c640 1 -- 172.21.15.150:0/202426138 >> 172.21.15.150:0/202426138 conn(0x7f9b940cee80 msgr2=0x7f9b9415c8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:53:05.803 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:05.801+0000 7f9b9b48c640 1 -- 172.21.15.150:0/202426138 shutdown_connections 2024-09-17T05:53:05.803 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:05.801+0000 7f9b9b48c640 1 -- 172.21.15.150:0/202426138 wait complete. 2024-09-17T05:53:05.814 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_volumes.TestCloneProgressReporter.test_when_clones_cancelled_are_less_than_cloner_threads' 2024-09-17T05:53:05.927 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:05.926+0000 7f9d89739640 1 -- 172.21.15.150:0/1844338727 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9d6c003a00 msgr2=0x7f9d6c003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:53:05.927 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:05.926+0000 7f9d89739640 1 --2- 172.21.15.150:0/1844338727 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9d6c003a00 0x7f9d6c003e70 secure :-1 s=READY pgs=1791 cs=0 l=1 rev1=1 crypto rx=0x7f9d7400bbb0 tx=0x7f9d6c005830 comp rx=0 tx=0).stop 2024-09-17T05:53:05.928 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:05.926+0000 7f9d837fe640 1 -- 172.21.15.150:0/1844338727 reap_dead start 2024-09-17T05:53:05.928 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:05.926+0000 7f9d89739640 1 -- 172.21.15.150:0/1844338727 shutdown_connections 2024-09-17T05:53:05.928 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:05.926+0000 7f9d89739640 1 -- 172.21.15.150:0/1844338727 >> 172.21.15.150:0/1844338727 conn(0x7f9d8408bfe0 msgr2=0x7f9d840d4670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:53:05.928 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:05.926+0000 7f9d89739640 1 -- 172.21.15.150:0/1844338727 shutdown_connections 2024-09-17T05:53:05.928 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:05.926+0000 7f9d89739640 1 -- 172.21.15.150:0/1844338727 wait complete. 2024-09-17T05:53:05.929 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:05.928+0000 7f9d89739640 1 Processor -- start 2024-09-17T05:53:05.929 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:05.928+0000 7f9d89739640 1 -- start start 2024-09-17T05:53:05.931 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:05.929+0000 7f9d89739640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9d6c003a00 0x7f9d8414c5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:53:05.931 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:05.929+0000 7f9d89739640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9d84152e30 0x7f9d841f4e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:53:05.931 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:05.929+0000 7f9d89739640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9d841f53b0 0x7f9d841f57c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:53:05.931 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:05.929+0000 7f9d89739640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f9d840b7640 con 0x7f9d6c003a00 2024-09-17T05:53:05.931 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:05.929+0000 7f9d89739640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f9d840b74c0 con 0x7f9d84152e30 2024-09-17T05:53:05.931 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:05.929+0000 7f9d89739640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f9d840b77c0 con 0x7f9d841f53b0 2024-09-17T05:53:05.931 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:05.929+0000 7f9d82ffd640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9d6c003a00 0x7f9d8414c5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:53:05.932 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:05.929+0000 7f9d82ffd640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9d6c003a00 0x7f9d8414c5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:37520/0 (socket says 172.21.15.150:37520) 2024-09-17T05:53:05.932 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:05.930+0000 7f9d82ffd640 1 -- 172.21.15.150:0/3832821222 learned_addr learned my addr 172.21.15.150:0/3832821222 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:53:05.932 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:05.930+0000 7f9d837fe640 1 --2- 172.21.15.150:0/3832821222 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9d841f53b0 0x7f9d841f57c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:53:05.932 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:05.930+0000 7f9d827fc640 1 --2- 172.21.15.150:0/3832821222 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9d84152e30 0x7f9d841f4e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:53:05.932 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:05.930+0000 7f9d82ffd640 1 -- 172.21.15.150:0/3832821222 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9d841f53b0 msgr2=0x7f9d841f57c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:53:05.932 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:05.930+0000 7f9d82ffd640 1 --2- 172.21.15.150:0/3832821222 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9d841f53b0 0x7f9d841f57c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:53:05.932 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:05.930+0000 7f9d82ffd640 1 -- 172.21.15.150:0/3832821222 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9d84152e30 msgr2=0x7f9d841f4e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:53:05.932 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:05.930+0000 7f9d82ffd640 1 --2- 172.21.15.150:0/3832821222 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9d84152e30 0x7f9d841f4e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:53:05.932 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:05.930+0000 7f9d82ffd640 1 -- 172.21.15.150:0/3832821222 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9d8415d120 con 0x7f9d6c003a00 2024-09-17T05:53:05.932 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:05.930+0000 7f9d827fc640 1 --2- 172.21.15.150:0/3832821222 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9d84152e30 0x7f9d841f4e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T05:53:05.932 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:05.930+0000 7f9d82ffd640 1 --2- 172.21.15.150:0/3832821222 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9d6c003a00 0x7f9d8414c5b0 secure :-1 s=READY pgs=1792 cs=0 l=1 rev1=1 crypto rx=0x7f9d7400bb00 tx=0x7f9d74031ca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:53:05.932 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:05.930+0000 7f9d6b7fe640 1 -- 172.21.15.150:0/3832821222 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d74034040 con 0x7f9d6c003a00 2024-09-17T05:53:05.932 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:05.931+0000 7f9d6b7fe640 1 -- 172.21.15.150:0/3832821222 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9d7403c070 con 0x7f9d6c003a00 2024-09-17T05:53:05.933 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:05.931+0000 7f9d6b7fe640 1 -- 172.21.15.150:0/3832821222 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d74041a00 con 0x7f9d6c003a00 2024-09-17T05:53:05.933 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:05.931+0000 7f9d89739640 1 -- 172.21.15.150:0/3832821222 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9d840a05d0 con 0x7f9d6c003a00 2024-09-17T05:53:05.934 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:05.931+0000 7f9d89739640 1 -- 172.21.15.150:0/3832821222 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9d840a0b90 con 0x7f9d6c003a00 2024-09-17T05:53:05.934 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:05.933+0000 7f9d89739640 1 -- 172.21.15.150:0/3832821222 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9d840d2780 con 0x7f9d6c003a00 2024-09-17T05:53:05.937 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:05.935+0000 7f9d6b7fe640 1 -- 172.21.15.150:0/3832821222 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 45) ==== 104501+0+0 (secure 0 0 0) 0x7f9d74038400 con 0x7f9d6c003a00 2024-09-17T05:53:05.937 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:05.936+0000 7f9d6b7fe640 1 --2- 172.21.15.150:0/3832821222 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f9d7007ad80 0x7f9d7007d290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:53:05.938 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:05.936+0000 7f9d6b7fe640 1 -- 172.21.15.150:0/3832821222 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(133..133 src has 1..133) ==== 5139+0+0 (secure 0 0 0) 0x7f9d740bb0f0 con 0x7f9d6c003a00 2024-09-17T05:53:05.938 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:05.937+0000 7f9d827fc640 1 --2- 172.21.15.150:0/3832821222 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f9d7007ad80 0x7f9d7007d290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:53:05.939 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:05.939+0000 7f9d827fc640 1 --2- 172.21.15.150:0/3832821222 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f9d7007ad80 0x7f9d7007d290 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 crypto rx=0x7f9d841534a0 tx=0x7f9d78005f90 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:53:05.943 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:05.942+0000 7f9d6b7fe640 1 -- 172.21.15.150:0/3832821222 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f9d740850a0 con 0x7f9d6c003a00 2024-09-17T05:53:06.184 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:06.183+0000 7f9d89739640 1 -- 172.21.15.150:0/3832821222 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_volumes.TestCloneProgressReporter.test_when_clones_cancelled_are_less_than_cloner_threads"]} v 0) -- 0x7f9d840d2d60 con 0x7f9d6c003a00 2024-09-17T05:53:06.460 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:06.459+0000 7f9d6b7fe640 1 -- 172.21.15.150:0/3832821222 <== mon.0 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_volumes.TestCloneProgressReporter.test_when_clones_cancelled_are_less_than_cloner_threads"]}]=0 v561) ==== 186+0+0 (secure 0 0 0) 0x7f9d740849a0 con 0x7f9d6c003a00 2024-09-17T05:53:06.463 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:06.462+0000 7f9d89739640 1 -- 172.21.15.150:0/3832821222 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f9d7007ad80 msgr2=0x7f9d7007d290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:53:06.463 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:06.462+0000 7f9d89739640 1 --2- 172.21.15.150:0/3832821222 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f9d7007ad80 0x7f9d7007d290 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 crypto rx=0x7f9d841534a0 tx=0x7f9d78005f90 comp rx=0 tx=0).stop 2024-09-17T05:53:06.463 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:06.462+0000 7f9d89739640 1 -- 172.21.15.150:0/3832821222 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9d6c003a00 msgr2=0x7f9d8414c5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:53:06.463 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:06.462+0000 7f9d89739640 1 --2- 172.21.15.150:0/3832821222 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9d6c003a00 0x7f9d8414c5b0 secure :-1 s=READY pgs=1792 cs=0 l=1 rev1=1 crypto rx=0x7f9d7400bb00 tx=0x7f9d74031ca0 comp rx=0 tx=0).stop 2024-09-17T05:53:06.463 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:06.462+0000 7f9d89739640 1 -- 172.21.15.150:0/3832821222 shutdown_connections 2024-09-17T05:53:06.463 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:06.462+0000 7f9d89739640 1 --2- 172.21.15.150:0/3832821222 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9d84152e30 0x7f9d841f4e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:53:06.464 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:06.462+0000 7f9d89739640 1 --2- 172.21.15.150:0/3832821222 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f9d7007ad80 0x7f9d7007d290 unknown :-1 s=CLOSED pgs=759 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:53:06.464 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:06.462+0000 7f9d89739640 1 --2- 172.21.15.150:0/3832821222 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9d841f53b0 0x7f9d841f57c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:53:06.464 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:06.462+0000 7f9d89739640 1 --2- 172.21.15.150:0/3832821222 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9d6c003a00 0x7f9d8414c5b0 unknown :-1 s=CLOSED pgs=1792 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:53:06.464 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:06.462+0000 7f9d89739640 1 -- 172.21.15.150:0/3832821222 >> 172.21.15.150:0/3832821222 conn(0x7f9d8408bfe0 msgr2=0x7f9d84161cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:53:06.464 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:06.462+0000 7f9d89739640 1 -- 172.21.15.150:0/3832821222 shutdown_connections 2024-09-17T05:53:06.464 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:06.462+0000 7f9d89739640 1 -- 172.21.15.150:0/3832821222 wait complete. 2024-09-17T05:53:06.476 INFO:tasks.cephfs_test_runner:Test that the progress bar that is printed for 1 ongoing clone job is ... ok 2024-09-17T05:53:06.476 INFO:tasks.cephfs_test_runner:Starting test: test_when_clones_cancelled_are_more_than_cloner_threads (tasks.cephfs.test_volumes.TestCloneProgressReporter) Test that both the progress bars, that are printed for all 7 clone 2024-09-17T05:53:06.477 INFO:tasks.cephfs_test_runner:test_when_clones_cancelled_are_more_than_cloner_threads (tasks.cephfs.test_volumes.TestCloneProgressReporter) 2024-09-17T05:53:06.477 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T05:53:06.593 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:06.591+0000 7f03907a1640 1 -- 172.21.15.150:0/4016823250 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f038815d730 msgr2=0x7f038806f940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:53:06.593 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:06.591+0000 7f03907a1640 1 --2- 172.21.15.150:0/4016823250 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f038815d730 0x7f038806f940 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f0378009900 tx=0x7f037802a610 comp rx=0 tx=0).stop 2024-09-17T05:53:06.593 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:06.591+0000 7f03907a1640 1 -- 172.21.15.150:0/4016823250 shutdown_connections 2024-09-17T05:53:06.593 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:06.591+0000 7f03907a1640 1 --2- 172.21.15.150:0/4016823250 >> v2:172.21.15.176:3300/0 conn(0x7f038806cda0 0x7f038806d1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:53:06.593 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:06.591+0000 7f03907a1640 1 --2- 172.21.15.150:0/4016823250 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f038815d730 0x7f038806f940 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:53:06.593 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:06.591+0000 7f03907a1640 1 -- 172.21.15.150:0/4016823250 >> 172.21.15.150:0/4016823250 conn(0x7f03880d0b50 msgr2=0x7f03880d0f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:53:06.593 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:06.592+0000 7f03907a1640 1 -- 172.21.15.150:0/4016823250 shutdown_connections 2024-09-17T05:53:06.593 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:06.592+0000 7f03907a1640 1 -- 172.21.15.150:0/4016823250 wait complete. 2024-09-17T05:53:06.594 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:06.593+0000 7f03907a1640 1 Processor -- start 2024-09-17T05:53:06.594 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:06.593+0000 7f03907a1640 1 -- start start 2024-09-17T05:53:06.598 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:06.594+0000 7f03907a1640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f038806cda0 0x7f0388132220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:53:06.598 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:06.595+0000 7f03907a1640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f03880716f0 0x7f03881341b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:53:06.598 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:06.595+0000 7f03907a1640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f038815d730 0x7f03881e7310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:53:06.598 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:06.595+0000 7f03907a1640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f038806d870 con 0x7f038815d730 2024-09-17T05:53:06.598 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:06.595+0000 7f03907a1640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f038806d6f0 con 0x7f038806cda0 2024-09-17T05:53:06.598 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:06.595+0000 7f03907a1640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f038806d9f0 con 0x7f03880716f0 2024-09-17T05:53:06.598 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:06.595+0000 7f038ed3e640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f038815d730 0x7f03881e7310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:53:06.599 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:06.595+0000 7f038ed3e640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f038815d730 0x7f03881e7310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:37522/0 (socket says 172.21.15.150:37522) 2024-09-17T05:53:06.599 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:06.595+0000 7f038ed3e640 1 -- 172.21.15.150:0/2135305731 learned_addr learned my addr 172.21.15.150:0/2135305731 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:53:06.599 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:06.595+0000 7f038e53d640 1 --2- 172.21.15.150:0/2135305731 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f038806cda0 0x7f0388132220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:53:06.599 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:06.595+0000 7f038dd3c640 1 --2- 172.21.15.150:0/2135305731 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f03880716f0 0x7f03881341b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:53:06.599 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:06.595+0000 7f038ed3e640 1 -- 172.21.15.150:0/2135305731 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f03880716f0 msgr2=0x7f03881341b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:53:06.599 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:06.595+0000 7f038ed3e640 1 --2- 172.21.15.150:0/2135305731 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f03880716f0 0x7f03881341b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:53:06.599 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:06.595+0000 7f038ed3e640 1 -- 172.21.15.150:0/2135305731 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f038806cda0 msgr2=0x7f0388132220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:53:06.599 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:06.595+0000 7f038ed3e640 1 --2- 172.21.15.150:0/2135305731 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f038806cda0 0x7f0388132220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:53:06.599 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:06.595+0000 7f038ed3e640 1 -- 172.21.15.150:0/2135305731 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f03881e6270 con 0x7f038815d730 2024-09-17T05:53:06.599 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:06.595+0000 7f038ed3e640 1 --2- 172.21.15.150:0/2135305731 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f038815d730 0x7f03881e7310 secure :-1 s=READY pgs=1793 cs=0 l=1 rev1=1 crypto rx=0x7f038000ea10 tx=0x7f038000eed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:53:06.599 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:06.595+0000 7f0386ffd640 1 -- 172.21.15.150:0/2135305731 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f038000cde0 con 0x7f038815d730 2024-09-17T05:53:06.600 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:06.595+0000 7f0386ffd640 1 -- 172.21.15.150:0/2135305731 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0380004c10 con 0x7f038815d730 2024-09-17T05:53:06.600 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:06.595+0000 7f03907a1640 1 -- 172.21.15.150:0/2135305731 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f03881e6550 con 0x7f038815d730 2024-09-17T05:53:06.600 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:06.595+0000 7f0386ffd640 1 -- 172.21.15.150:0/2135305731 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0380005020 con 0x7f038815d730 2024-09-17T05:53:06.600 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:06.596+0000 7f03907a1640 1 -- 172.21.15.150:0/2135305731 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f03881e6b10 con 0x7f038815d730 2024-09-17T05:53:06.600 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:06.596+0000 7f03907a1640 1 -- 172.21.15.150:0/2135305731 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f038806d1b0 con 0x7f038815d730 2024-09-17T05:53:06.600 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:06.597+0000 7f0386ffd640 1 -- 172.21.15.150:0/2135305731 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 45) ==== 104501+0+0 (secure 0 0 0) 0x7f03800051c0 con 0x7f038815d730 2024-09-17T05:53:06.601 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:06.598+0000 7f0386ffd640 1 --2- 172.21.15.150:0/2135305731 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f037407ad50 0x7f037407d260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:53:06.601 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:06.598+0000 7f0386ffd640 1 -- 172.21.15.150:0/2135305731 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(133..133 src has 1..133) ==== 5139+0+0 (secure 0 0 0) 0x7f038009ab90 con 0x7f038815d730 2024-09-17T05:53:06.601 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:06.598+0000 7f038e53d640 1 --2- 172.21.15.150:0/2135305731 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f037407ad50 0x7f037407d260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:53:06.601 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:06.599+0000 7f038e53d640 1 --2- 172.21.15.150:0/2135305731 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f037407ad50 0x7f037407d260 secure :-1 s=READY pgs=760 cs=0 l=1 rev1=1 crypto rx=0x7f0378033000 tx=0x7f0378004730 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:53:06.603 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:06.602+0000 7f0386ffd640 1 -- 172.21.15.150:0/2135305731 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f0380064480 con 0x7f038815d730 2024-09-17T05:53:06.779 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:06.778+0000 7f03907a1640 1 -- 172.21.15.150:0/2135305731 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f03880b1580 con 0x7f038815d730 2024-09-17T05:53:06.780 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:06.779+0000 7f0386ffd640 1 -- 172.21.15.150:0/2135305731 <== mon.0 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v133) ==== 74+0+13392 (secure 0 0 0) 0x7f0380068eb0 con 0x7f038815d730 2024-09-17T05:53:06.780 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-09-17T05:53:06.780 INFO:teuthology.orchestra.run.smithi150.stdout:{"epoch":133,"fsid":"9f2e05e9-d629-47b3-b26b-1360655b7d20","created":"2024-09-17T05:41:32.502979+0000","modified":"2024-09-17T05:53:05.453582+0000","last_up_change":"2024-09-17T05:41:46.150225+0000","last_in_change":"2024-09-17T05:41:36.120274+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":19,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T05:41:46.860779+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"4f31c018-c8a4-4d6d-b0c2-a597c47aae4a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":125,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6800","nonce":479374392},{"type":"v1","addr":"172.21.15.150:6801","nonce":479374392}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6802","nonce":479374392},{"type":"v1","addr":"172.21.15.150:6803","nonce":479374392}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6806","nonce":479374392},{"type":"v1","addr":"172.21.15.150:6807","nonce":479374392}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6804","nonce":479374392},{"type":"v1","addr":"172.21.15.150:6805","nonce":479374392}]},"public_addr":"172.21.15.150:6801/479374392","cluster_addr":"172.21.15.150:6803/479374392","heartbeat_back_addr":"172.21.15.150:6807/479374392","heartbeat_front_addr":"172.21.15.150:6805/479374392","state":["exists","up"]},{"osd":1,"uuid":"6ff4a573-500b-4e04-9de3-39265ead78b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":125,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6824","nonce":913899800},{"type":"v1","addr":"172.21.15.150:6825","nonce":913899800}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6826","nonce":913899800},{"type":"v1","addr":"172.21.15.150:6827","nonce":913899800}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6830","nonce":913899800},{"type":"v1","addr":"172.21.15.150:6831","nonce":913899800}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6828","nonce":913899800},{"type":"v1","addr":"172.21.15.150:6829","nonce":913899800}]},"public_addr":"172.21.15.150:6825/913899800","cluster_addr":"172.21.15.150:6827/913899800","heartbeat_back_addr":"172.21.15.150:6831/913899800","heartbeat_front_addr":"172.21.15.150:6829/913899800","state":["exists","up"]},{"osd":2,"uuid":"bffea6f9-2465-4182-b205-00436c41ac1c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":125,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6816","nonce":363718461},{"type":"v1","addr":"172.21.15.150:6817","nonce":363718461}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6818","nonce":363718461},{"type":"v1","addr":"172.21.15.150:6819","nonce":363718461}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6822","nonce":363718461},{"type":"v1","addr":"172.21.15.150:6823","nonce":363718461}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6820","nonce":363718461},{"type":"v1","addr":"172.21.15.150:6821","nonce":363718461}]},"public_addr":"172.21.15.150:6817/363718461","cluster_addr":"172.21.15.150:6819/363718461","heartbeat_back_addr":"172.21.15.150:6823/363718461","heartbeat_front_addr":"172.21.15.150:6821/363718461","state":["exists","up"]},{"osd":3,"uuid":"cda70430-d1e1-427e-b04e-56db4031d078","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":128,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6808","nonce":3550994626},{"type":"v1","addr":"172.21.15.150:6809","nonce":3550994626}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6810","nonce":3550994626},{"type":"v1","addr":"172.21.15.150:6811","nonce":3550994626}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6814","nonce":3550994626},{"type":"v1","addr":"172.21.15.150:6815","nonce":3550994626}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6812","nonce":3550994626},{"type":"v1","addr":"172.21.15.150:6813","nonce":3550994626}]},"public_addr":"172.21.15.150:6809/3550994626","cluster_addr":"172.21.15.150:6811/3550994626","heartbeat_back_addr":"172.21.15.150:6815/3550994626","heartbeat_front_addr":"172.21.15.150:6813/3550994626","state":["exists","up"]},{"osd":4,"uuid":"3a0277fb-5e1e-4f68-bb2d-9a8a0152f64a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":125,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6810","nonce":2718261497},{"type":"v1","addr":"172.21.15.176:6811","nonce":2718261497}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6812","nonce":2718261497},{"type":"v1","addr":"172.21.15.176:6813","nonce":2718261497}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6816","nonce":2718261497},{"type":"v1","addr":"172.21.15.176:6817","nonce":2718261497}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6814","nonce":2718261497},{"type":"v1","addr":"172.21.15.176:6815","nonce":2718261497}]},"public_addr":"172.21.15.176:6811/2718261497","cluster_addr":"172.21.15.176:6813/2718261497","heartbeat_back_addr":"172.21.15.176:6817/2718261497","heartbeat_front_addr":"172.21.15.176:6815/2718261497","state":["exists","up"]},{"osd":5,"uuid":"33aebee6-0315-40b7-a11c-6702f0be494d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":125,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6818","nonce":2049295774},{"type":"v1","addr":"172.21.15.176:6819","nonce":2049295774}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6820","nonce":2049295774},{"type":"v1","addr":"172.21.15.176:6821","nonce":2049295774}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6824","nonce":2049295774},{"type":"v1","addr":"172.21.15.176:6825","nonce":2049295774}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6822","nonce":2049295774},{"type":"v1","addr":"172.21.15.176:6823","nonce":2049295774}]},"public_addr":"172.21.15.176:6819/2049295774","cluster_addr":"172.21.15.176:6821/2049295774","heartbeat_back_addr":"172.21.15.176:6825/2049295774","heartbeat_front_addr":"172.21.15.176:6823/2049295774","state":["exists","up"]},{"osd":6,"uuid":"4d24f360-6751-4263-841b-d77793d33540","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":128,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6826","nonce":2164458476},{"type":"v1","addr":"172.21.15.176:6827","nonce":2164458476}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6828","nonce":2164458476},{"type":"v1","addr":"172.21.15.176:6829","nonce":2164458476}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6832","nonce":2164458476},{"type":"v1","addr":"172.21.15.176:6833","nonce":2164458476}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6830","nonce":2164458476},{"type":"v1","addr":"172.21.15.176:6831","nonce":2164458476}]},"public_addr":"172.21.15.176:6827/2164458476","cluster_addr":"172.21.15.176:6829/2164458476","heartbeat_back_addr":"172.21.15.176:6833/2164458476","heartbeat_front_addr":"172.21.15.176:6831/2164458476","state":["exists","up"]},{"osd":7,"uuid":"c8594fda-c74a-4ba9-8277-caf101d58ca1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":125,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6802","nonce":3239587708},{"type":"v1","addr":"172.21.15.176:6803","nonce":3239587708}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6804","nonce":3239587708},{"type":"v1","addr":"172.21.15.176:6805","nonce":3239587708}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6808","nonce":3239587708},{"type":"v1","addr":"172.21.15.176:6809","nonce":3239587708}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6806","nonce":3239587708},{"type":"v1","addr":"172.21.15.176:6807","nonce":3239587708}]},"public_addr":"172.21.15.176:6803/3239587708","cluster_addr":"172.21.15.176:6805/3239587708","heartbeat_back_addr":"172.21.15.176:6809/3239587708","heartbeat_front_addr":"172.21.15.176:6807/3239587708","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:41:41.905151+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:41:42.705679+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:41:42.459673+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:41:42.440819+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:41:42.668428+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:41:42.694972+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:41:43.078535+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:41:42.363539+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.176:6836/1926613940":"2024-09-18T05:53:02.448526+0000","172.21.15.176:6834/1926613940":"2024-09-18T05:53:02.448526+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":7,"snaps":[{"begin":2,"length":2}]},{"pool":9,"snaps":[{"begin":2,"length":2}]},{"pool":11,"snaps":[{"begin":2,"length":2}]},{"pool":13,"snaps":[{"begin":2,"length":2}]},{"pool":15,"snaps":[{"begin":2,"length":2}]},{"pool":17,"snaps":[{"begin":2,"length":2}]},{"pool":19,"snaps":[{"begin":2,"length":2}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T05:53:06.783 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:06.782+0000 7f03907a1640 1 -- 172.21.15.150:0/2135305731 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f037407ad50 msgr2=0x7f037407d260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:53:06.783 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:06.782+0000 7f03907a1640 1 --2- 172.21.15.150:0/2135305731 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f037407ad50 0x7f037407d260 secure :-1 s=READY pgs=760 cs=0 l=1 rev1=1 crypto rx=0x7f0378033000 tx=0x7f0378004730 comp rx=0 tx=0).stop 2024-09-17T05:53:06.783 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:06.782+0000 7f03907a1640 1 -- 172.21.15.150:0/2135305731 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f038815d730 msgr2=0x7f03881e7310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:53:06.783 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:06.782+0000 7f03907a1640 1 --2- 172.21.15.150:0/2135305731 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f038815d730 0x7f03881e7310 secure :-1 s=READY pgs=1793 cs=0 l=1 rev1=1 crypto rx=0x7f038000ea10 tx=0x7f038000eed0 comp rx=0 tx=0).stop 2024-09-17T05:53:06.783 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:06.782+0000 7f03907a1640 1 -- 172.21.15.150:0/2135305731 shutdown_connections 2024-09-17T05:53:06.783 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:06.782+0000 7f03907a1640 1 --2- 172.21.15.150:0/2135305731 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f037407ad50 0x7f037407d260 unknown :-1 s=CLOSED pgs=760 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:53:06.783 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:06.782+0000 7f03907a1640 1 --2- 172.21.15.150:0/2135305731 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f038815d730 0x7f03881e7310 unknown :-1 s=CLOSED pgs=1793 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:53:06.783 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:06.782+0000 7f03907a1640 1 --2- 172.21.15.150:0/2135305731 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f03880716f0 0x7f03881341b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:53:06.783 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:06.782+0000 7f03907a1640 1 --2- 172.21.15.150:0/2135305731 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f038806cda0 0x7f0388132220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:53:06.784 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:06.782+0000 7f03907a1640 1 -- 172.21.15.150:0/2135305731 >> 172.21.15.150:0/2135305731 conn(0x7f03880d0b50 msgr2=0x7f03880b0710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:53:06.784 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:06.782+0000 7f03907a1640 1 -- 172.21.15.150:0/2135305731 shutdown_connections 2024-09-17T05:53:06.784 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:06.782+0000 7f03907a1640 1 -- 172.21.15.150:0/2135305731 wait complete. 2024-09-17T05:53:06.796 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-17T05:41:46.860779+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-17T05:53:06.796 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-17T05:53:06.915 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:06.913+0000 7f441fd69640 1 -- 172.21.15.150:0/2999063279 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f441806dea0 msgr2=0x7f44180d0020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:53:06.915 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:06.913+0000 7f441fd69640 1 --2- 172.21.15.150:0/2999063279 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f441806dea0 0x7f44180d0020 secure :-1 s=READY pgs=1794 cs=0 l=1 rev1=1 crypto rx=0x7f44180d3670 tx=0x7f440802a540 comp rx=0 tx=0).stop 2024-09-17T05:53:06.915 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:06.914+0000 7f441fd69640 1 -- 172.21.15.150:0/2999063279 shutdown_connections 2024-09-17T05:53:06.915 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:06.914+0000 7f441fd69640 1 --2- 172.21.15.150:0/2999063279 >> v2:172.21.15.176:3300/0 conn(0x7f441806e2b0 0x7f44180d0560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:53:06.915 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:06.914+0000 7f441fd69640 1 --2- 172.21.15.150:0/2999063279 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f441806dea0 0x7f44180d0020 unknown :-1 s=CLOSED pgs=1794 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:53:06.915 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:06.914+0000 7f441fd69640 1 --2- 172.21.15.150:0/2999063279 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f44180d5150 0x7f44180b9b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:53:06.915 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:06.914+0000 7f441fd69640 1 -- 172.21.15.150:0/2999063279 >> 172.21.15.150:0/2999063279 conn(0x7f441808bfe0 msgr2=0x7f44180d46e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:53:06.915 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:06.914+0000 7f441fd69640 1 -- 172.21.15.150:0/2999063279 shutdown_connections 2024-09-17T05:53:06.915 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:06.914+0000 7f441fd69640 1 -- 172.21.15.150:0/2999063279 wait complete. 2024-09-17T05:53:06.916 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:06.915+0000 7f441fd69640 1 Processor -- start 2024-09-17T05:53:06.916 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:06.915+0000 7f441fd69640 1 -- start start 2024-09-17T05:53:06.919 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:06.917+0000 7f441fd69640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f441806dea0 0x7f441814eef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:53:06.919 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:06.917+0000 7f441fd69640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f441806e2b0 0x7f441815d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:53:06.919 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:06.917+0000 7f441fd69640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f44180d5150 0x7f44180cd5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:53:06.919 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:06.917+0000 7f441fd69640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f44180d3150 con 0x7f44180d5150 2024-09-17T05:53:06.919 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:06.917+0000 7f441fd69640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f44180d2fd0 con 0x7f441806dea0 2024-09-17T05:53:06.919 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:06.917+0000 7f441fd69640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f44180b6160 con 0x7f441806e2b0 2024-09-17T05:53:06.919 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:06.917+0000 7f441e306640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f44180d5150 0x7f44180cd5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:53:06.919 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:06.917+0000 7f441e306640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f44180d5150 0x7f44180cd5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:37534/0 (socket says 172.21.15.150:37534) 2024-09-17T05:53:06.919 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:06.917+0000 7f441e306640 1 -- 172.21.15.150:0/3542143988 learned_addr learned my addr 172.21.15.150:0/3542143988 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:53:06.920 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:06.917+0000 7f441d304640 1 --2- 172.21.15.150:0/3542143988 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f441806e2b0 0x7f441815d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:53:06.920 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:06.917+0000 7f441db05640 1 --2- 172.21.15.150:0/3542143988 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f441806dea0 0x7f441814eef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:53:06.920 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:06.917+0000 7f441e306640 1 -- 172.21.15.150:0/3542143988 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f441806e2b0 msgr2=0x7f441815d1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:53:06.920 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:06.917+0000 7f441e306640 1 --2- 172.21.15.150:0/3542143988 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f441806e2b0 0x7f441815d1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:53:06.920 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:06.917+0000 7f441e306640 1 -- 172.21.15.150:0/3542143988 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f441806dea0 msgr2=0x7f441814eef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:53:06.920 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:06.917+0000 7f441e306640 1 --2- 172.21.15.150:0/3542143988 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f441806dea0 0x7f441814eef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:53:06.920 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:06.917+0000 7f441e306640 1 -- 172.21.15.150:0/3542143988 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f441814f430 con 0x7f44180d5150 2024-09-17T05:53:06.920 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:06.917+0000 7f441e306640 1 --2- 172.21.15.150:0/3542143988 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f44180d5150 0x7f44180cd5a0 secure :-1 s=READY pgs=1795 cs=0 l=1 rev1=1 crypto rx=0x7f441000cab0 tx=0x7f441000cf70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:53:06.920 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:06.917+0000 7f440e7fc640 1 -- 172.21.15.150:0/3542143988 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4410007df0 con 0x7f44180d5150 2024-09-17T05:53:06.920 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:06.917+0000 7f440e7fc640 1 -- 172.21.15.150:0/3542143988 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f441000f560 con 0x7f44180d5150 2024-09-17T05:53:06.920 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:06.917+0000 7f441fd69640 1 -- 172.21.15.150:0/3542143988 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f44180ccde0 con 0x7f44180d5150 2024-09-17T05:53:06.920 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:06.918+0000 7f440e7fc640 1 -- 172.21.15.150:0/3542143988 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f441000f9b0 con 0x7f44180d5150 2024-09-17T05:53:06.921 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:06.918+0000 7f441fd69640 1 -- 172.21.15.150:0/3542143988 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f44181f9cb0 con 0x7f44180d5150 2024-09-17T05:53:06.921 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:06.919+0000 7f441fd69640 1 -- 172.21.15.150:0/3542143988 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4418155100 con 0x7f44180d5150 2024-09-17T05:53:06.921 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:06.919+0000 7f440e7fc640 1 -- 172.21.15.150:0/3542143988 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 45) ==== 104501+0+0 (secure 0 0 0) 0x7f441000fb50 con 0x7f44180d5150 2024-09-17T05:53:06.922 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:06.920+0000 7f440e7fc640 1 --2- 172.21.15.150:0/3542143988 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f43fc07ad50 0x7f43fc07d260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:53:06.922 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:06.921+0000 7f440e7fc640 1 -- 172.21.15.150:0/3542143988 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(133..133 src has 1..133) ==== 5139+0+0 (secure 0 0 0) 0x7f441009a900 con 0x7f44180d5150 2024-09-17T05:53:06.922 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:06.921+0000 7f441db05640 1 --2- 172.21.15.150:0/3542143988 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f43fc07ad50 0x7f43fc07d260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:53:06.922 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:06.921+0000 7f441db05640 1 --2- 172.21.15.150:0/3542143988 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f43fc07ad50 0x7f43fc07d260 secure :-1 s=READY pgs=761 cs=0 l=1 rev1=1 crypto rx=0x7f441400bb30 tx=0x7f441400b2e0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:53:06.925 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:06.925+0000 7f440e7fc640 1 -- 172.21.15.150:0/3542143988 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f4410014070 con 0x7f44180d5150 2024-09-17T05:53:07.102 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:07.101+0000 7f441fd69640 1 -- 172.21.15.150:0/3542143988 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f44180d4f30 con 0x7f44180d5150 2024-09-17T05:53:07.102 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:07.102+0000 7f440e7fc640 1 -- 172.21.15.150:0/3542143988 <== mon.0 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v133) ==== 93+0+10 (secure 0 0 0) 0x7f4410064170 con 0x7f44180d5150 2024-09-17T05:53:07.103 INFO:teuthology.orchestra.run.smithi150.stdout:pg_num: 1 2024-09-17T05:53:07.105 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:07.104+0000 7f441fd69640 1 -- 172.21.15.150:0/3542143988 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f43fc07ad50 msgr2=0x7f43fc07d260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:53:07.105 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:07.104+0000 7f441fd69640 1 --2- 172.21.15.150:0/3542143988 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f43fc07ad50 0x7f43fc07d260 secure :-1 s=READY pgs=761 cs=0 l=1 rev1=1 crypto rx=0x7f441400bb30 tx=0x7f441400b2e0 comp rx=0 tx=0).stop 2024-09-17T05:53:07.105 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:07.104+0000 7f441fd69640 1 -- 172.21.15.150:0/3542143988 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f44180d5150 msgr2=0x7f44180cd5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:53:07.105 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:07.104+0000 7f441fd69640 1 --2- 172.21.15.150:0/3542143988 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f44180d5150 0x7f44180cd5a0 secure :-1 s=READY pgs=1795 cs=0 l=1 rev1=1 crypto rx=0x7f441000cab0 tx=0x7f441000cf70 comp rx=0 tx=0).stop 2024-09-17T05:53:07.105 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:07.104+0000 7f441fd69640 1 -- 172.21.15.150:0/3542143988 shutdown_connections 2024-09-17T05:53:07.105 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:07.104+0000 7f441fd69640 1 --2- 172.21.15.150:0/3542143988 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f43fc07ad50 0x7f43fc07d260 unknown :-1 s=CLOSED pgs=761 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:53:07.105 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:07.104+0000 7f441fd69640 1 --2- 172.21.15.150:0/3542143988 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f44180d5150 0x7f44180cd5a0 unknown :-1 s=CLOSED pgs=1795 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:53:07.105 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:07.104+0000 7f441fd69640 1 --2- 172.21.15.150:0/3542143988 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f441806e2b0 0x7f441815d1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:53:07.105 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:07.104+0000 7f441fd69640 1 --2- 172.21.15.150:0/3542143988 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f441806dea0 0x7f441814eef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:53:07.106 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:07.104+0000 7f441fd69640 1 -- 172.21.15.150:0/3542143988 >> 172.21.15.150:0/3542143988 conn(0x7f441808bfe0 msgr2=0x7f44180b1210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:53:07.106 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:07.104+0000 7f441fd69640 1 -- 172.21.15.150:0/3542143988 shutdown_connections 2024-09-17T05:53:07.106 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:07.104+0000 7f441fd69640 1 -- 172.21.15.150:0/3542143988 wait complete. 2024-09-17T05:53:07.116 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_volumes.TestCloneProgressReporter.test_when_clones_cancelled_are_more_than_cloner_threads' 2024-09-17T05:53:07.232 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:07.231+0000 7f55bb54a640 1 -- 172.21.15.150:0/3534538985 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f55a00052a0 msgr2=0x7f55a000b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:53:07.233 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:07.231+0000 7f55bb54a640 1 --2- 172.21.15.150:0/3534538985 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f55a00052a0 0x7f55a000b9c0 secure :-1 s=READY pgs=1797 cs=0 l=1 rev1=1 crypto rx=0x7f55ac001f30 tx=0x7f55a0005830 comp rx=0 tx=0).stop 2024-09-17T05:53:07.233 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:07.231+0000 7f55bb54a640 1 -- 172.21.15.150:0/3534538985 shutdown_connections 2024-09-17T05:53:07.233 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:07.231+0000 7f55bb54a640 1 --2- 172.21.15.150:0/3534538985 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f55a00052a0 0x7f55a000b9c0 unknown :-1 s=CLOSED pgs=1797 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:53:07.233 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:07.231+0000 7f55bb54a640 1 -- 172.21.15.150:0/3534538985 >> 172.21.15.150:0/3534538985 conn(0x7f55b40b2e80 msgr2=0x7f55b40b3290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:53:07.233 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:07.232+0000 7f55bb54a640 1 -- 172.21.15.150:0/3534538985 shutdown_connections 2024-09-17T05:53:07.233 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:07.232+0000 7f55bb54a640 1 -- 172.21.15.150:0/3534538985 wait complete. 2024-09-17T05:53:07.234 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:07.233+0000 7f55bb54a640 1 Processor -- start 2024-09-17T05:53:07.234 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:07.233+0000 7f55bb54a640 1 -- start start 2024-09-17T05:53:07.236 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:07.235+0000 7f55bb54a640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f55a00052a0 0x7f55b409c650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:53:07.236 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:07.235+0000 7f55bb54a640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f55b40ae160 0x7f55b41f6bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:53:07.237 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:07.235+0000 7f55bb54a640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f55b40ae570 0x7f55b41f7110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:53:07.237 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:07.235+0000 7f55bb54a640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f55b40ce1c0 con 0x7f55b40ae570 2024-09-17T05:53:07.237 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:07.235+0000 7f55bb54a640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f55b40ce040 con 0x7f55b40ae160 2024-09-17T05:53:07.237 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:07.235+0000 7f55bb54a640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f55b40b67a0 con 0x7f55a00052a0 2024-09-17T05:53:07.237 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:07.235+0000 7f55b9ae7640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f55b40ae570 0x7f55b41f7110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:53:07.237 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:07.235+0000 7f55b9ae7640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f55b40ae570 0x7f55b41f7110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:37552/0 (socket says 172.21.15.150:37552) 2024-09-17T05:53:07.237 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:07.235+0000 7f55b9ae7640 1 -- 172.21.15.150:0/655014187 learned_addr learned my addr 172.21.15.150:0/655014187 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:53:07.237 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:07.235+0000 7f55b8ae5640 1 --2- 172.21.15.150:0/655014187 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f55b40ae160 0x7f55b41f6bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:53:07.237 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:07.235+0000 7f55b92e6640 1 --2- 172.21.15.150:0/655014187 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f55a00052a0 0x7f55b409c650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:53:07.237 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:07.235+0000 7f55b9ae7640 1 -- 172.21.15.150:0/655014187 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f55a00052a0 msgr2=0x7f55b409c650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:53:07.237 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:07.235+0000 7f55b9ae7640 1 --2- 172.21.15.150:0/655014187 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f55a00052a0 0x7f55b409c650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:53:07.237 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:07.235+0000 7f55b9ae7640 1 -- 172.21.15.150:0/655014187 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f55b40ae160 msgr2=0x7f55b41f6bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:53:07.238 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:07.235+0000 7f55b9ae7640 1 --2- 172.21.15.150:0/655014187 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f55b40ae160 0x7f55b41f6bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:53:07.238 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:07.235+0000 7f55b9ae7640 1 -- 172.21.15.150:0/655014187 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f55b409be90 con 0x7f55b40ae570 2024-09-17T05:53:07.238 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:07.235+0000 7f55b92e6640 1 --2- 172.21.15.150:0/655014187 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f55a00052a0 0x7f55b409c650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:53:07.238 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:07.235+0000 7f55b8ae5640 1 --2- 172.21.15.150:0/655014187 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f55b40ae160 0x7f55b41f6bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:53:07.238 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:07.235+0000 7f55b9ae7640 1 --2- 172.21.15.150:0/655014187 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f55b40ae570 0x7f55b41f7110 secure :-1 s=READY pgs=1798 cs=0 l=1 rev1=1 crypto rx=0x7f55ac002050 tx=0x7f55ac001bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:53:07.238 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:07.235+0000 7f55a9ffb640 1 -- 172.21.15.150:0/655014187 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55ac003c40 con 0x7f55b40ae570 2024-09-17T05:53:07.238 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:07.235+0000 7f55a9ffb640 1 -- 172.21.15.150:0/655014187 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f55ac003e00 con 0x7f55b40ae570 2024-09-17T05:53:07.238 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:07.235+0000 7f55bb54a640 1 -- 172.21.15.150:0/655014187 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f55b409e2d0 con 0x7f55b40ae570 2024-09-17T05:53:07.238 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:07.235+0000 7f55a9ffb640 1 -- 172.21.15.150:0/655014187 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55ac0336b0 con 0x7f55b40ae570 2024-09-17T05:53:07.238 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:07.236+0000 7f55bb54a640 1 -- 172.21.15.150:0/655014187 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f55b409cb90 con 0x7f55b40ae570 2024-09-17T05:53:07.239 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:07.237+0000 7f55bb54a640 1 -- 172.21.15.150:0/655014187 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f55b40cbc30 con 0x7f55b40ae570 2024-09-17T05:53:07.239 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:07.237+0000 7f55a9ffb640 1 -- 172.21.15.150:0/655014187 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 45) ==== 104501+0+0 (secure 0 0 0) 0x7f55ac03c030 con 0x7f55b40ae570 2024-09-17T05:53:07.239 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:07.238+0000 7f55a9ffb640 1 --2- 172.21.15.150:0/655014187 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f559807ad50 0x7f559807d260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:53:07.239 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:07.238+0000 7f55a9ffb640 1 -- 172.21.15.150:0/655014187 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(133..133 src has 1..133) ==== 5139+0+0 (secure 0 0 0) 0x7f55ac0b94a0 con 0x7f55b40ae570 2024-09-17T05:53:07.239 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:07.238+0000 7f55b92e6640 1 --2- 172.21.15.150:0/655014187 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f559807ad50 0x7f559807d260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:53:07.239 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:07.239+0000 7f55b92e6640 1 --2- 172.21.15.150:0/655014187 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f559807ad50 0x7f559807d260 secure :-1 s=READY pgs=762 cs=0 l=1 rev1=1 crypto rx=0x7f55b0001240 tx=0x7f55b0001110 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:53:07.243 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:07.242+0000 7f55a9ffb640 1 -- 172.21.15.150:0/655014187 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f55ac082e20 con 0x7f55b40ae570 2024-09-17T05:53:07.490 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:07.489+0000 7f55bb54a640 1 -- 172.21.15.150:0/655014187 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_volumes.TestCloneProgressReporter.test_when_clones_cancelled_are_more_than_cloner_threads"]} v 0) -- 0x7f55b409e7f0 con 0x7f55b40ae570 2024-09-17T05:53:08.469 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:08.468+0000 7f55a9ffb640 1 -- 172.21.15.150:0/655014187 <== mon.0 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_volumes.TestCloneProgressReporter.test_when_clones_cancelled_are_more_than_cloner_threads"]}]=0 v563) ==== 189+0+0 (secure 0 0 0) 0x7f55ac087850 con 0x7f55b40ae570 2024-09-17T05:53:08.472 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:08.471+0000 7f55bb54a640 1 -- 172.21.15.150:0/655014187 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f559807ad50 msgr2=0x7f559807d260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:53:08.472 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:08.471+0000 7f55bb54a640 1 --2- 172.21.15.150:0/655014187 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f559807ad50 0x7f559807d260 secure :-1 s=READY pgs=762 cs=0 l=1 rev1=1 crypto rx=0x7f55b0001240 tx=0x7f55b0001110 comp rx=0 tx=0).stop 2024-09-17T05:53:08.472 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:08.471+0000 7f55bb54a640 1 -- 172.21.15.150:0/655014187 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f55b40ae570 msgr2=0x7f55b41f7110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:53:08.472 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:08.471+0000 7f55bb54a640 1 --2- 172.21.15.150:0/655014187 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f55b40ae570 0x7f55b41f7110 secure :-1 s=READY pgs=1798 cs=0 l=1 rev1=1 crypto rx=0x7f55ac002050 tx=0x7f55ac001bf0 comp rx=0 tx=0).stop 2024-09-17T05:53:08.472 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:08.471+0000 7f55bb54a640 1 -- 172.21.15.150:0/655014187 shutdown_connections 2024-09-17T05:53:08.472 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:08.471+0000 7f55bb54a640 1 --2- 172.21.15.150:0/655014187 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f55b40ae160 0x7f55b41f6bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:53:08.472 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:08.471+0000 7f55bb54a640 1 --2- 172.21.15.150:0/655014187 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f559807ad50 0x7f559807d260 unknown :-1 s=CLOSED pgs=762 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:53:08.472 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:08.471+0000 7f55bb54a640 1 --2- 172.21.15.150:0/655014187 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f55b40ae570 0x7f55b41f7110 unknown :-1 s=CLOSED pgs=1798 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:53:08.473 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:08.471+0000 7f55bb54a640 1 --2- 172.21.15.150:0/655014187 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f55a00052a0 0x7f55b409c650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:53:08.473 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:08.471+0000 7f55bb54a640 1 -- 172.21.15.150:0/655014187 >> 172.21.15.150:0/655014187 conn(0x7f55b40b2e80 msgr2=0x7f55b40b55e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:53:08.473 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:08.471+0000 7f55bb54a640 1 -- 172.21.15.150:0/655014187 shutdown_connections 2024-09-17T05:53:08.473 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:08.471+0000 7f55bb54a640 1 -- 172.21.15.150:0/655014187 wait complete. 2024-09-17T05:53:08.486 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config dump 2024-09-17T05:53:08.606 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:08.605+0000 7f5a668fa640 1 -- 172.21.15.150:0/2173550500 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5a600d0550 msgr2=0x7f5a600b18c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:53:08.606 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:08.605+0000 7f5a668fa640 1 --2- 172.21.15.150:0/2173550500 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5a600d0550 0x7f5a600b18c0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f5a54009830 tx=0x7f5a5402a5a0 comp rx=0 tx=0).stop 2024-09-17T05:53:08.606 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:08.605+0000 7f5a668fa640 1 -- 172.21.15.150:0/2173550500 shutdown_connections 2024-09-17T05:53:08.606 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:08.605+0000 7f5a668fa640 1 --2- 172.21.15.150:0/2173550500 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5a600d0550 0x7f5a600b18c0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:53:08.606 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:08.605+0000 7f5a668fa640 1 --2- 172.21.15.150:0/2173550500 >> v2:172.21.15.176:3300/0 conn(0x7f5a600d0c50 0x7f5a600d0010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:53:08.606 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:08.605+0000 7f5a668fa640 1 -- 172.21.15.150:0/2173550500 >> 172.21.15.150:0/2173550500 conn(0x7f5a600b3fc0 msgr2=0x7f5a600b43d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:53:08.606 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:08.605+0000 7f5a668fa640 1 -- 172.21.15.150:0/2173550500 shutdown_connections 2024-09-17T05:53:08.606 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:08.605+0000 7f5a668fa640 1 -- 172.21.15.150:0/2173550500 wait complete. 2024-09-17T05:53:08.607 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:08.606+0000 7f5a668fa640 1 Processor -- start 2024-09-17T05:53:08.607 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:08.607+0000 7f5a668fa640 1 -- start start 2024-09-17T05:53:08.610 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:08.608+0000 7f5a668fa640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5a600d0550 0x7f5a6015eb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:53:08.610 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:08.608+0000 7f5a668fa640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5a600d0c50 0x7f5a6015bc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:53:08.610 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:08.608+0000 7f5a668fa640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5a600d1060 0x7f5a600cb6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:53:08.611 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:08.608+0000 7f5a668fa640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f5a600ced80 con 0x7f5a600d0c50 2024-09-17T05:53:08.611 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:08.608+0000 7f5a668fa640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f5a600cd130 con 0x7f5a600d1060 2024-09-17T05:53:08.611 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:08.608+0000 7f5a668fa640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f5a600c6e00 con 0x7f5a600d0550 2024-09-17T05:53:08.611 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:08.608+0000 7f5a5f7fe640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5a600d0c50 0x7f5a6015bc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:53:08.611 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:08.608+0000 7f5a5f7fe640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5a600d0c50 0x7f5a6015bc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:37566/0 (socket says 172.21.15.150:37566) 2024-09-17T05:53:08.611 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:08.608+0000 7f5a5f7fe640 1 -- 172.21.15.150:0/3324341259 learned_addr learned my addr 172.21.15.150:0/3324341259 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:53:08.611 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:08.608+0000 7f5a5ffff640 1 --2- 172.21.15.150:0/3324341259 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5a600d0550 0x7f5a6015eb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:53:08.611 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:08.608+0000 7f5a64e97640 1 --2- 172.21.15.150:0/3324341259 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5a600d1060 0x7f5a600cb6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:53:08.611 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:08.608+0000 7f5a5f7fe640 1 -- 172.21.15.150:0/3324341259 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5a600d0550 msgr2=0x7f5a6015eb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:53:08.611 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:08.608+0000 7f5a5f7fe640 1 --2- 172.21.15.150:0/3324341259 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5a600d0550 0x7f5a6015eb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:53:08.611 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:08.608+0000 7f5a5f7fe640 1 -- 172.21.15.150:0/3324341259 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5a600d1060 msgr2=0x7f5a600cb6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:53:08.611 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:08.608+0000 7f5a5f7fe640 1 --2- 172.21.15.150:0/3324341259 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5a600d1060 0x7f5a600cb6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:53:08.611 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:08.608+0000 7f5a5f7fe640 1 -- 172.21.15.150:0/3324341259 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5a6015f4f0 con 0x7f5a600d0c50 2024-09-17T05:53:08.611 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:08.608+0000 7f5a64e97640 1 --2- 172.21.15.150:0/3324341259 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5a600d1060 0x7f5a600cb6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T05:53:08.612 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:08.609+0000 7f5a5f7fe640 1 --2- 172.21.15.150:0/3324341259 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5a600d0c50 0x7f5a6015bc00 secure :-1 s=READY pgs=1800 cs=0 l=1 rev1=1 crypto rx=0x7f5a5402ab90 tx=0x7f5a54033c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:53:08.612 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:08.609+0000 7f5a5cff9640 1 -- 172.21.15.150:0/3324341259 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a54005c90 con 0x7f5a600d0c50 2024-09-17T05:53:08.612 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:08.609+0000 7f5a5cff9640 1 -- 172.21.15.150:0/3324341259 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f5a54031e50 con 0x7f5a600d0c50 2024-09-17T05:53:08.612 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:08.609+0000 7f5a668fa640 1 -- 172.21.15.150:0/3324341259 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5a601f3a30 con 0x7f5a600d0c50 2024-09-17T05:53:08.612 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:08.609+0000 7f5a5cff9640 1 -- 172.21.15.150:0/3324341259 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a54005260 con 0x7f5a600d0c50 2024-09-17T05:53:08.612 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:08.609+0000 7f5a668fa640 1 -- 172.21.15.150:0/3324341259 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5a6015c140 con 0x7f5a600d0c50 2024-09-17T05:53:08.613 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:08.610+0000 7f5a668fa640 1 -- 172.21.15.150:0/3324341259 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5a601f3820 con 0x7f5a600d0c50 2024-09-17T05:53:08.613 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:08.611+0000 7f5a5cff9640 1 -- 172.21.15.150:0/3324341259 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 45) ==== 104501+0+0 (secure 0 0 0) 0x7f5a54005400 con 0x7f5a600d0c50 2024-09-17T05:53:08.613 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:08.611+0000 7f5a5cff9640 1 --2- 172.21.15.150:0/3324341259 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f5a4c07ad80 0x7f5a4c07d290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:53:08.613 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:08.611+0000 7f5a5cff9640 1 -- 172.21.15.150:0/3324341259 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(133..133 src has 1..133) ==== 5139+0+0 (secure 0 0 0) 0x7f5a540baec0 con 0x7f5a600d0c50 2024-09-17T05:53:08.613 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:08.611+0000 7f5a5ffff640 1 --2- 172.21.15.150:0/3324341259 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f5a4c07ad80 0x7f5a4c07d290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:53:08.613 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:08.612+0000 7f5a5ffff640 1 --2- 172.21.15.150:0/3324341259 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f5a4c07ad80 0x7f5a4c07d290 secure :-1 s=READY pgs=763 cs=0 l=1 rev1=1 crypto rx=0x7f5a50009ac0 tx=0x7f5a50005f90 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:53:08.616 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:08.616+0000 7f5a5cff9640 1 -- 172.21.15.150:0/3324341259 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f5a5403f030 con 0x7f5a600d0c50 2024-09-17T05:53:08.790 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:08.789+0000 7f5a668fa640 1 -- 172.21.15.150:0/3324341259 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "config dump"} v 0) -- 0x7f5a6015f280 con 0x7f5a600d0c50 2024-09-17T05:53:08.790 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:08.790+0000 7f5a5cff9640 1 -- 172.21.15.150:0/3324341259 <== mon.0 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "config dump"}]=0 v57) ==== 59+0+2294 (secure 0 0 0) 0x7f5a54084e10 con 0x7f5a600d0c50 2024-09-17T05:53:08.791 INFO:teuthology.orchestra.run.smithi150.stdout:WHO MASK LEVEL OPTION VALUE RO 2024-09-17T05:53:08.791 INFO:teuthology.orchestra.run.smithi150.stdout:mon advanced mon_op_complaint_time 120 2024-09-17T05:53:08.791 INFO:teuthology.orchestra.run.smithi150.stdout:mgr advanced client_mount_timeout 30 2024-09-17T05:53:08.791 INFO:teuthology.orchestra.run.smithi150.stdout:mgr advanced debug_client 20/20 2024-09-17T05:53:08.791 INFO:teuthology.orchestra.run.smithi150.stdout:mgr advanced debug_mgr 20/20 2024-09-17T05:53:08.791 INFO:teuthology.orchestra.run.smithi150.stdout:mgr advanced debug_ms 1/1 2024-09-17T05:53:08.791 INFO:teuthology.orchestra.run.smithi150.stdout:mgr dev mon_warn_on_pool_no_app false 2024-09-17T05:53:08.791 INFO:teuthology.orchestra.run.smithi150.stdout:osd advanced osd_op_complaint_time 180.000000 2024-09-17T05:53:08.791 INFO:teuthology.orchestra.run.smithi150.stdout:osd.0 basic osd_mclock_max_capacity_iops_ssd 6764.239331 2024-09-17T05:53:08.791 INFO:teuthology.orchestra.run.smithi150.stdout:osd.1 basic osd_mclock_max_capacity_iops_ssd 4956.769289 2024-09-17T05:53:08.791 INFO:teuthology.orchestra.run.smithi150.stdout:osd.2 basic osd_mclock_max_capacity_iops_ssd 5099.704467 2024-09-17T05:53:08.791 INFO:teuthology.orchestra.run.smithi150.stdout:osd.3 basic osd_mclock_max_capacity_iops_ssd 4681.616196 2024-09-17T05:53:08.792 INFO:teuthology.orchestra.run.smithi150.stdout:osd.4 basic osd_mclock_max_capacity_iops_ssd 4723.364425 2024-09-17T05:53:08.792 INFO:teuthology.orchestra.run.smithi150.stdout:osd.5 basic osd_mclock_max_capacity_iops_ssd 4509.722124 2024-09-17T05:53:08.792 INFO:teuthology.orchestra.run.smithi150.stdout:osd.6 basic osd_mclock_max_capacity_iops_ssd 6380.664158 2024-09-17T05:53:08.792 INFO:teuthology.orchestra.run.smithi150.stdout:osd.7 basic osd_mclock_max_capacity_iops_ssd 4303.333825 2024-09-17T05:53:08.792 INFO:teuthology.orchestra.run.smithi150.stdout:mds advanced debug_mds 20/20 2024-09-17T05:53:08.792 INFO:teuthology.orchestra.run.smithi150.stdout:mds advanced debug_mds_balancer 20/20 2024-09-17T05:53:08.792 INFO:teuthology.orchestra.run.smithi150.stdout:mds advanced debug_ms 2/2 2024-09-17T05:53:08.792 INFO:teuthology.orchestra.run.smithi150.stdout:mds dev mds_debug_frag true 2024-09-17T05:53:08.792 INFO:teuthology.orchestra.run.smithi150.stdout:mds dev mds_debug_scatterstat true 2024-09-17T05:53:08.792 INFO:teuthology.orchestra.run.smithi150.stdout:mds advanced mds_op_complaint_time 180.000000 2024-09-17T05:53:08.792 INFO:teuthology.orchestra.run.smithi150.stdout:mds dev mds_verify_scatter true 2024-09-17T05:53:08.792 INFO:teuthology.orchestra.run.smithi150.stdout:mds advanced osd_op_complaint_time 180.000000 2024-09-17T05:53:08.792 INFO:teuthology.orchestra.run.smithi150.stdout:mds advanced rados_mon_op_timeout 900 2024-09-17T05:53:08.793 INFO:teuthology.orchestra.run.smithi150.stdout:mds advanced rados_osd_op_timeout 900 2024-09-17T05:53:08.793 INFO:teuthology.orchestra.run.smithi150.stdout:client advanced client_mount_timeout 600 2024-09-17T05:53:08.793 INFO:teuthology.orchestra.run.smithi150.stdout:client advanced debug_client 20/20 2024-09-17T05:53:08.793 INFO:teuthology.orchestra.run.smithi150.stdout:client advanced debug_ms 1/1 2024-09-17T05:53:08.793 INFO:teuthology.orchestra.run.smithi150.stdout:client advanced rados_mon_op_timeout 900 2024-09-17T05:53:08.793 INFO:teuthology.orchestra.run.smithi150.stdout:client advanced rados_osd_op_timeout 900 2024-09-17T05:53:08.794 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:08.792+0000 7f5a668fa640 1 -- 172.21.15.150:0/3324341259 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f5a4c07ad80 msgr2=0x7f5a4c07d290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:53:08.794 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:08.792+0000 7f5a668fa640 1 --2- 172.21.15.150:0/3324341259 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f5a4c07ad80 0x7f5a4c07d290 secure :-1 s=READY pgs=763 cs=0 l=1 rev1=1 crypto rx=0x7f5a50009ac0 tx=0x7f5a50005f90 comp rx=0 tx=0).stop 2024-09-17T05:53:08.794 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:08.792+0000 7f5a668fa640 1 -- 172.21.15.150:0/3324341259 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5a600d0c50 msgr2=0x7f5a6015bc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:53:08.794 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:08.792+0000 7f5a668fa640 1 --2- 172.21.15.150:0/3324341259 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5a600d0c50 0x7f5a6015bc00 secure :-1 s=READY pgs=1800 cs=0 l=1 rev1=1 crypto rx=0x7f5a5402ab90 tx=0x7f5a54033c20 comp rx=0 tx=0).stop 2024-09-17T05:53:08.794 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:08.792+0000 7f5a668fa640 1 -- 172.21.15.150:0/3324341259 shutdown_connections 2024-09-17T05:53:08.794 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:08.792+0000 7f5a668fa640 1 --2- 172.21.15.150:0/3324341259 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5a600d1060 0x7f5a600cb6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:53:08.794 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:08.792+0000 7f5a668fa640 1 --2- 172.21.15.150:0/3324341259 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f5a4c07ad80 0x7f5a4c07d290 unknown :-1 s=CLOSED pgs=763 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:53:08.794 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:08.792+0000 7f5a668fa640 1 --2- 172.21.15.150:0/3324341259 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5a600d0c50 0x7f5a6015bc00 unknown :-1 s=CLOSED pgs=1800 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:53:08.794 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:08.792+0000 7f5a668fa640 1 --2- 172.21.15.150:0/3324341259 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5a600d0550 0x7f5a6015eb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:53:08.795 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:08.792+0000 7f5a668fa640 1 -- 172.21.15.150:0/3324341259 >> 172.21.15.150:0/3324341259 conn(0x7f5a600b3fc0 msgr2=0x7f5a600cd600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:53:08.795 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:08.792+0000 7f5a668fa640 1 -- 172.21.15.150:0/3324341259 shutdown_connections 2024-09-17T05:53:08.795 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:08.792+0000 7f5a668fa640 1 -- 172.21.15.150:0/3324341259 wait complete. 2024-09-17T05:53:08.804 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-09-17T05:53:08.922 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:08.921+0000 7f0558b13640 1 -- 172.21.15.150:0/2247752384 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f053c005330 msgr2=0x7f053c00b9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:53:08.923 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:08.921+0000 7f0558b13640 1 --2- 172.21.15.150:0/2247752384 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f053c005330 0x7f053c00b9e0 secure :-1 s=READY pgs=1802 cs=0 l=1 rev1=1 crypto rx=0x7f054c00c710 tx=0x7f053c005830 comp rx=0 tx=0).stop 2024-09-17T05:53:08.923 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:08.921+0000 7f0558b13640 1 -- 172.21.15.150:0/2247752384 shutdown_connections 2024-09-17T05:53:08.923 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:08.921+0000 7f0558b13640 1 --2- 172.21.15.150:0/2247752384 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f053c005330 0x7f053c00b9e0 unknown :-1 s=CLOSED pgs=1802 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:53:08.923 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:08.921+0000 7f0558b13640 1 -- 172.21.15.150:0/2247752384 >> 172.21.15.150:0/2247752384 conn(0x7f05540d46e0 msgr2=0x7f05540d4af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:53:08.923 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:08.921+0000 7f0558b13640 1 -- 172.21.15.150:0/2247752384 shutdown_connections 2024-09-17T05:53:08.923 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:08.921+0000 7f0558b13640 1 -- 172.21.15.150:0/2247752384 wait complete. 2024-09-17T05:53:08.924 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:08.923+0000 7f0558b13640 1 Processor -- start 2024-09-17T05:53:08.924 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:08.923+0000 7f0558b13640 1 -- start start 2024-09-17T05:53:08.927 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:08.925+0000 7f0558b13640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f053c005330 0x7f05540cb720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:53:08.927 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:08.925+0000 7f0558b13640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f05540b65d0 0x7f05540b69e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:53:08.927 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:08.925+0000 7f0558b13640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0554156790 0x7f0554156ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:53:08.927 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:08.925+0000 7f0558b13640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f0554162c40 con 0x7f05540b65d0 2024-09-17T05:53:08.927 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:08.925+0000 7f0558b13640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f0554162ac0 con 0x7f0554156790 2024-09-17T05:53:08.927 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:08.925+0000 7f0558b13640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f0554162dc0 con 0x7f053c005330 2024-09-17T05:53:08.927 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:08.925+0000 7f0551d9b640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f05540b65d0 0x7f05540b69e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:53:08.927 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:08.925+0000 7f0551d9b640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f05540b65d0 0x7f05540b69e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:37586/0 (socket says 172.21.15.150:37586) 2024-09-17T05:53:08.928 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:08.925+0000 7f0551d9b640 1 -- 172.21.15.150:0/81039162 learned_addr learned my addr 172.21.15.150:0/81039162 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:53:08.928 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:08.925+0000 7f055259c640 1 --2- 172.21.15.150:0/81039162 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f053c005330 0x7f05540cb720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:53:08.928 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:08.925+0000 7f0552d9d640 1 --2- 172.21.15.150:0/81039162 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0554156790 0x7f0554156ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:53:08.928 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:08.925+0000 7f0551d9b640 1 -- 172.21.15.150:0/81039162 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f053c005330 msgr2=0x7f05540cb720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:53:08.928 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:08.925+0000 7f0551d9b640 1 --2- 172.21.15.150:0/81039162 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f053c005330 0x7f05540cb720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:53:08.928 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:08.925+0000 7f0551d9b640 1 -- 172.21.15.150:0/81039162 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0554156790 msgr2=0x7f0554156ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:53:08.928 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:08.925+0000 7f0551d9b640 1 --2- 172.21.15.150:0/81039162 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0554156790 0x7f0554156ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:53:08.928 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:08.925+0000 7f0551d9b640 1 -- 172.21.15.150:0/81039162 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f05541570e0 con 0x7f05540b65d0 2024-09-17T05:53:08.928 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:08.925+0000 7f0551d9b640 1 --2- 172.21.15.150:0/81039162 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f05540b65d0 0x7f05540b69e0 secure :-1 s=READY pgs=1803 cs=0 l=1 rev1=1 crypto rx=0x7f054800f800 tx=0x7f054800fcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:53:08.928 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:08.925+0000 7f0542ffd640 1 -- 172.21.15.150:0/81039162 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f054800bcb0 con 0x7f05540b65d0 2024-09-17T05:53:08.928 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:08.925+0000 7f0542ffd640 1 -- 172.21.15.150:0/81039162 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0548011440 con 0x7f05540b65d0 2024-09-17T05:53:08.928 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:08.926+0000 7f0558b13640 1 -- 172.21.15.150:0/81039162 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f05540cc300 con 0x7f05540b65d0 2024-09-17T05:53:08.929 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:08.926+0000 7f0542ffd640 1 -- 172.21.15.150:0/81039162 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0548011870 con 0x7f05540b65d0 2024-09-17T05:53:08.929 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:08.926+0000 7f0558b13640 1 -- 172.21.15.150:0/81039162 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f05540cc8c0 con 0x7f05540b65d0 2024-09-17T05:53:08.929 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:08.926+0000 7f0558b13640 1 -- 172.21.15.150:0/81039162 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f05540cc070 con 0x7f05540b65d0 2024-09-17T05:53:08.929 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:08.927+0000 7f0542ffd640 1 -- 172.21.15.150:0/81039162 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 45) ==== 104501+0+0 (secure 0 0 0) 0x7f0548019020 con 0x7f05540b65d0 2024-09-17T05:53:08.930 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:08.928+0000 7f0542ffd640 1 --2- 172.21.15.150:0/81039162 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f053407ad80 0x7f053407d290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:53:08.930 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:08.928+0000 7f0542ffd640 1 -- 172.21.15.150:0/81039162 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(133..133 src has 1..133) ==== 5139+0+0 (secure 0 0 0) 0x7f054809a790 con 0x7f05540b65d0 2024-09-17T05:53:08.930 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:08.928+0000 7f055259c640 1 --2- 172.21.15.150:0/81039162 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f053407ad80 0x7f053407d290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:53:08.930 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:08.929+0000 7f055259c640 1 --2- 172.21.15.150:0/81039162 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f053407ad80 0x7f053407d290 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 crypto rx=0x7f0544001390 tx=0x7f0544006b20 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:53:08.933 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:08.932+0000 7f0542ffd640 1 -- 172.21.15.150:0/81039162 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f05480646d0 con 0x7f05540b65d0 2024-09-17T05:53:09.110 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:09.110+0000 7f0558b13640 1 -- 172.21.15.150:0/81039162 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) -- 0x7f05540b1b80 con 0x7f05540b65d0 2024-09-17T05:53:09.114 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:09.113+0000 7f0542ffd640 1 -- 172.21.15.150:0/81039162 <== mon.0 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v58)=0 v58) ==== 122+0+0 (secure 0 0 0) 0x7f0548063fd0 con 0x7f05540b65d0 2024-09-17T05:53:09.117 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:09.116+0000 7f0558b13640 1 -- 172.21.15.150:0/81039162 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f053407ad80 msgr2=0x7f053407d290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:53:09.117 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:09.116+0000 7f0558b13640 1 --2- 172.21.15.150:0/81039162 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f053407ad80 0x7f053407d290 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 crypto rx=0x7f0544001390 tx=0x7f0544006b20 comp rx=0 tx=0).stop 2024-09-17T05:53:09.117 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:09.116+0000 7f0558b13640 1 -- 172.21.15.150:0/81039162 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f05540b65d0 msgr2=0x7f05540b69e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:53:09.117 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:09.116+0000 7f0558b13640 1 --2- 172.21.15.150:0/81039162 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f05540b65d0 0x7f05540b69e0 secure :-1 s=READY pgs=1803 cs=0 l=1 rev1=1 crypto rx=0x7f054800f800 tx=0x7f054800fcc0 comp rx=0 tx=0).stop 2024-09-17T05:53:09.117 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:09.116+0000 7f0558b13640 1 -- 172.21.15.150:0/81039162 shutdown_connections 2024-09-17T05:53:09.117 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:09.116+0000 7f0558b13640 1 --2- 172.21.15.150:0/81039162 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0554156790 0x7f0554156ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:53:09.117 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:09.116+0000 7f0558b13640 1 --2- 172.21.15.150:0/81039162 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f053407ad80 0x7f053407d290 unknown :-1 s=CLOSED pgs=764 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:53:09.117 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:09.116+0000 7f0558b13640 1 --2- 172.21.15.150:0/81039162 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f05540b65d0 0x7f05540b69e0 unknown :-1 s=CLOSED pgs=1803 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:53:09.117 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:09.116+0000 7f0558b13640 1 --2- 172.21.15.150:0/81039162 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f053c005330 0x7f05540cb720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:53:09.117 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:09.116+0000 7f0558b13640 1 -- 172.21.15.150:0/81039162 >> 172.21.15.150:0/81039162 conn(0x7f05540d46e0 msgr2=0x7f0554160d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:53:09.117 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:09.116+0000 7f0558b13640 1 -- 172.21.15.150:0/81039162 shutdown_connections 2024-09-17T05:53:09.118 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:09.116+0000 7f0558b13640 1 -- 172.21.15.150:0/81039162 wait complete. 2024-09-17T05:53:09.129 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-17T05:53:09.129 DEBUG:teuthology.orchestra.run.smithi150:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-17T05:53:09.167 DEBUG:teuthology.orchestra.run.smithi176:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-17T05:53:09.226 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-17T05:53:09.226 DEBUG:teuthology.orchestra.run.smithi150:> set -ex 2024-09-17T05:53:09.226 DEBUG:teuthology.orchestra.run.smithi150:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T05:53:09.242 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056027,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497464k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=18693 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248728k,nr_inodes=812182,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497464k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-17T05:53:09.242 DEBUG:teuthology.orchestra.run.smithi176:> set -ex 2024-09-17T05:53:09.242 DEBUG:teuthology.orchestra.run.smithi176:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T05:53:09.261 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056030,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497468k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=3379 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248732k,nr_inodes=812183,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497468k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-17T05:53:09.261 DEBUG:teuthology.orchestra.run.smithi150:> set -ex 2024-09-17T05:53:09.261 DEBUG:teuthology.orchestra.run.smithi150:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T05:53:09.299 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056027,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497464k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=18693 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248728k,nr_inodes=812182,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497464k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-17T05:53:09.299 DEBUG:teuthology.orchestra.run.smithi176:> set -ex 2024-09-17T05:53:09.300 DEBUG:teuthology.orchestra.run.smithi176:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T05:53:09.319 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056030,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497468k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=3379 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248732k,nr_inodes=812183,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497468k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-17T05:53:09.320 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-09-17T05:53:09.320 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T05:53:09.454 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:09.453+0000 7f793d4b6640 1 -- 172.21.15.150:0/1992800714 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f79380d1790 msgr2=0x7f79380d0400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:53:09.454 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:09.453+0000 7f793d4b6640 1 --2- 172.21.15.150:0/1992800714 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f79380d1790 0x7f79380d0400 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f7930005fd0 tx=0x7f793002a8b0 comp rx=0 tx=0).stop 2024-09-17T05:53:09.455 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:09.453+0000 7f793d4b6640 1 -- 172.21.15.150:0/1992800714 shutdown_connections 2024-09-17T05:53:09.455 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:09.453+0000 7f793d4b6640 1 --2- 172.21.15.150:0/1992800714 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f79380d1790 0x7f79380d0400 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:53:09.455 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:09.453+0000 7f793d4b6640 1 --2- 172.21.15.150:0/1992800714 >> v2:172.21.15.176:3300/0 conn(0x7f79380b5d50 0x7f79380d2780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:53:09.455 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:09.453+0000 7f793d4b6640 1 -- 172.21.15.150:0/1992800714 >> 172.21.15.150:0/1992800714 conn(0x7f793808bfe0 msgr2=0x7f79380d4670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:53:09.455 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:09.453+0000 7f793d4b6640 1 -- 172.21.15.150:0/1992800714 shutdown_connections 2024-09-17T05:53:09.455 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:09.453+0000 7f793d4b6640 1 -- 172.21.15.150:0/1992800714 wait complete. 2024-09-17T05:53:09.455 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:09.455+0000 7f793d4b6640 1 Processor -- start 2024-09-17T05:53:09.456 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:09.455+0000 7f793d4b6640 1 -- start start 2024-09-17T05:53:09.458 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:09.456+0000 7f793d4b6640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f79380b5d50 0x7f79381547e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:53:09.458 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:09.456+0000 7f793d4b6640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f79380d4f90 0x7f79381e9d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:53:09.458 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:09.456+0000 7f793d4b6640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f79381ea2d0 0x7f79380b8150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:53:09.458 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:09.456+0000 7f793d4b6640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f79380b7b00 con 0x7f79380b5d50 2024-09-17T05:53:09.459 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:09.456+0000 7f793d4b6640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f79380b7980 con 0x7f79381ea2d0 2024-09-17T05:53:09.459 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:09.456+0000 7f793d4b6640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f79380b7c80 con 0x7f79380d4f90 2024-09-17T05:53:09.459 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:09.456+0000 7f7936ffd640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f79380b5d50 0x7f79381547e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:53:09.459 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:09.456+0000 7f7936ffd640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f79380b5d50 0x7f79381547e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:37590/0 (socket says 172.21.15.150:37590) 2024-09-17T05:53:09.459 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:09.456+0000 7f7936ffd640 1 -- 172.21.15.150:0/3248018824 learned_addr learned my addr 172.21.15.150:0/3248018824 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:53:09.459 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:09.457+0000 7f79367fc640 1 --2- 172.21.15.150:0/3248018824 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f79380d4f90 0x7f79381e9d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:53:09.459 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:09.457+0000 7f79377fe640 1 --2- 172.21.15.150:0/3248018824 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f79381ea2d0 0x7f79380b8150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:53:09.459 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:09.457+0000 7f7936ffd640 1 -- 172.21.15.150:0/3248018824 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f79380d4f90 msgr2=0x7f79381e9d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:53:09.459 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:09.457+0000 7f7936ffd640 1 --2- 172.21.15.150:0/3248018824 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f79380d4f90 0x7f79381e9d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:53:09.459 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:09.457+0000 7f7936ffd640 1 -- 172.21.15.150:0/3248018824 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f79381ea2d0 msgr2=0x7f79380b8150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:53:09.459 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:09.457+0000 7f7936ffd640 1 --2- 172.21.15.150:0/3248018824 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f79381ea2d0 0x7f79380b8150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:53:09.459 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:09.457+0000 7f7936ffd640 1 -- 172.21.15.150:0/3248018824 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f79381eaa50 con 0x7f79380b5d50 2024-09-17T05:53:09.459 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:09.457+0000 7f79377fe640 1 --2- 172.21.15.150:0/3248018824 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f79381ea2d0 0x7f79380b8150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:53:09.459 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:09.457+0000 7f7936ffd640 1 --2- 172.21.15.150:0/3248018824 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f79380b5d50 0x7f79381547e0 secure :-1 s=READY pgs=1805 cs=0 l=1 rev1=1 crypto rx=0x7f792800e7c0 tx=0x7f792800ec80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:53:09.460 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:09.457+0000 7f791f7fe640 1 -- 172.21.15.150:0/3248018824 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f792800ccc0 con 0x7f79380b5d50 2024-09-17T05:53:09.460 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:09.457+0000 7f793d4b6640 1 -- 172.21.15.150:0/3248018824 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f79381f9210 con 0x7f79380b5d50 2024-09-17T05:53:09.460 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:09.457+0000 7f791f7fe640 1 -- 172.21.15.150:0/3248018824 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f7928010430 con 0x7f79380b5d50 2024-09-17T05:53:09.460 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:09.457+0000 7f791f7fe640 1 -- 172.21.15.150:0/3248018824 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7928010860 con 0x7f79380b5d50 2024-09-17T05:53:09.460 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:09.457+0000 7f793d4b6640 1 -- 172.21.15.150:0/3248018824 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f79381f97d0 con 0x7f79380b5d50 2024-09-17T05:53:09.461 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:09.458+0000 7f793d4b6640 1 -- 172.21.15.150:0/3248018824 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f79380cef10 con 0x7f79380b5d50 2024-09-17T05:53:09.461 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:09.459+0000 7f791f7fe640 1 -- 172.21.15.150:0/3248018824 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 45) ==== 104501+0+0 (secure 0 0 0) 0x7f7928010a00 con 0x7f79380b5d50 2024-09-17T05:53:09.461 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:09.460+0000 7f791f7fe640 1 --2- 172.21.15.150:0/3248018824 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f792407ad50 0x7f792407d260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:53:09.461 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:09.460+0000 7f791f7fe640 1 -- 172.21.15.150:0/3248018824 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(133..133 src has 1..133) ==== 5139+0+0 (secure 0 0 0) 0x7f792809a7e0 con 0x7f79380b5d50 2024-09-17T05:53:09.461 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:09.460+0000 7f79367fc640 1 --2- 172.21.15.150:0/3248018824 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f792407ad50 0x7f792407d260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:53:09.461 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:09.461+0000 7f79367fc640 1 --2- 172.21.15.150:0/3248018824 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f792407ad50 0x7f792407d260 secure :-1 s=READY pgs=765 cs=0 l=1 rev1=1 crypto rx=0x7f792c007fd0 tx=0x7f792c001390 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:53:09.465 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:09.464+0000 7f791f7fe640 1 -- 172.21.15.150:0/3248018824 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f79380cef10 con 0x7f79380b5d50 2024-09-17T05:53:09.677 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:09.676+0000 7f793d4b6640 1 -- 172.21.15.150:0/3248018824 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f79380d2780 con 0x7f79380b5d50 2024-09-17T05:53:09.677 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:09.677+0000 7f791f7fe640 1 -- 172.21.15.150:0/3248018824 <== mon.0 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 83 v83) ==== 94+0+3920 (secure 0 0 0) 0x7f7928064050 con 0x7f79380b5d50 2024-09-17T05:53:09.678 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-09-17T05:53:09.678 INFO:teuthology.orchestra.run.smithi150.stdout:{"epoch":83,"btime":"2024-09-17T05:53:03:450110+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":8260,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6836/1012671211","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6834","nonce":1012671211},{"type":"v1","addr":"172.21.15.176:6836","nonce":1012671211}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":83},{"gid":9123,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6834/2232109291","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6832","nonce":2232109291},{"type":"v1","addr":"172.21.15.150:6834","nonce":2232109291}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":74},{"gid":9126,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6835/423416474","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6833","nonce":423416474},{"type":"v1","addr":"172.21.15.150:6835","nonce":423416474}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":75},{"gid":9138,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6837/2582017817","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6835","nonce":2582017817},{"type":"v1","addr":"172.21.15.176:6837","nonce":2582017817}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":75}],"filesystems":[]} 2024-09-17T05:53:09.678 INFO:teuthology.orchestra.run.smithi150.stderr:dumped fsmap epoch 83 2024-09-17T05:53:09.680 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:09.679+0000 7f793d4b6640 1 -- 172.21.15.150:0/3248018824 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f792407ad50 msgr2=0x7f792407d260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:53:09.681 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:09.679+0000 7f793d4b6640 1 --2- 172.21.15.150:0/3248018824 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f792407ad50 0x7f792407d260 secure :-1 s=READY pgs=765 cs=0 l=1 rev1=1 crypto rx=0x7f792c007fd0 tx=0x7f792c001390 comp rx=0 tx=0).stop 2024-09-17T05:53:09.681 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:09.679+0000 7f793d4b6640 1 -- 172.21.15.150:0/3248018824 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f79380b5d50 msgr2=0x7f79381547e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:53:09.681 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:09.679+0000 7f793d4b6640 1 --2- 172.21.15.150:0/3248018824 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f79380b5d50 0x7f79381547e0 secure :-1 s=READY pgs=1805 cs=0 l=1 rev1=1 crypto rx=0x7f792800e7c0 tx=0x7f792800ec80 comp rx=0 tx=0).stop 2024-09-17T05:53:09.681 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:09.679+0000 7f793d4b6640 1 -- 172.21.15.150:0/3248018824 shutdown_connections 2024-09-17T05:53:09.681 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:09.679+0000 7f793d4b6640 1 --2- 172.21.15.150:0/3248018824 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f79381ea2d0 0x7f79380b8150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:53:09.681 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:09.679+0000 7f793d4b6640 1 --2- 172.21.15.150:0/3248018824 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f792407ad50 0x7f792407d260 unknown :-1 s=CLOSED pgs=765 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:53:09.681 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:09.679+0000 7f793d4b6640 1 --2- 172.21.15.150:0/3248018824 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f79380d4f90 0x7f79381e9d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:53:09.681 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:09.679+0000 7f793d4b6640 1 --2- 172.21.15.150:0/3248018824 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f79380b5d50 0x7f79381547e0 unknown :-1 s=CLOSED pgs=1805 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:53:09.681 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:09.679+0000 7f793d4b6640 1 -- 172.21.15.150:0/3248018824 >> 172.21.15.150:0/3248018824 conn(0x7f793808bfe0 msgr2=0x7f7938163100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:53:09.681 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:09.679+0000 7f793d4b6640 1 -- 172.21.15.150:0/3248018824 shutdown_connections 2024-09-17T05:53:09.681 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:09.679+0000 7f793d4b6640 1 -- 172.21.15.150:0/3248018824 wait complete. 2024-09-17T05:53:09.692 INFO:tasks.ceph.mds.a:Restarting daemon 2024-09-17T05:53:09.692 INFO:tasks.ceph.mds.a:Stopping old one... 2024-09-17T05:53:09.692 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-09-17T05:53:09.692 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T05:53:09.693 INFO:tasks.ceph.mds.c:Restarting daemon 2024-09-17T05:53:09.693 INFO:tasks.ceph.mds.c:Stopping old one... 2024-09-17T05:53:09.693 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-09-17T05:53:09.693 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T05:53:09.693 INFO:tasks.ceph.mds.b:Restarting daemon 2024-09-17T05:53:09.693 INFO:tasks.ceph.mds.b:Stopping old one... 2024-09-17T05:53:09.694 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-09-17T05:53:09.694 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T05:53:09.694 INFO:tasks.ceph.mds.d:Restarting daemon 2024-09-17T05:53:09.694 INFO:tasks.ceph.mds.d:Stopping old one... 2024-09-17T05:53:09.694 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-09-17T05:53:09.694 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T05:53:09.703 INFO:tasks.ceph.mds.a:Stopped 2024-09-17T05:53:09.703 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-09-17T05:53:09.704 INFO:tasks.ceph.mds.c:Stopped 2024-09-17T05:53:09.704 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-09-17T05:53:09.707 INFO:tasks.ceph.mds.b:Stopped 2024-09-17T05:53:09.707 DEBUG:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-09-17T05:53:09.711 INFO:tasks.ceph.mds.d:Stopped 2024-09-17T05:53:09.712 DEBUG:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-09-17T05:53:09.745 INFO:tasks.ceph.mds.a:Started 2024-09-17T05:53:09.746 DEBUG:teuthology.parallel:result is None 2024-09-17T05:53:09.746 INFO:tasks.ceph.mds.c:Started 2024-09-17T05:53:09.746 DEBUG:teuthology.parallel:result is None 2024-09-17T05:53:09.753 INFO:tasks.ceph.mds.b:Started 2024-09-17T05:53:09.754 DEBUG:teuthology.parallel:result is None 2024-09-17T05:53:09.755 INFO:tasks.ceph.mds.d:Started 2024-09-17T05:53:09.755 DEBUG:teuthology.parallel:result is None 2024-09-17T05:53:09.755 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-09-17T05:53:09.833 INFO:tasks.ceph.mds.a.smithi150.stdout:starting mds.a at 2024-09-17T05:53:09.833 INFO:tasks.ceph.mds.c.smithi150.stdout:starting mds.c at 2024-09-17T05:53:09.847 INFO:tasks.ceph.mds.b.smithi176.stdout:starting mds.b at 2024-09-17T05:53:09.847 INFO:tasks.ceph.mds.d.smithi176.stdout:starting mds.d at 2024-09-17T05:53:09.876 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:09.875+0000 7f1aef67e640 1 -- 172.21.15.150:0/297450793 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1ae80d0db0 msgr2=0x7f1ae80d11c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:53:09.876 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:09.875+0000 7f1aef67e640 1 --2- 172.21.15.150:0/297450793 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1ae80d0db0 0x7f1ae80d11c0 secure :-1 s=READY pgs=1813 cs=0 l=1 rev1=1 crypto rx=0x7f1ae80a04a0 tx=0x7f1ae002aa30 comp rx=0 tx=0).stop 2024-09-17T05:53:09.876 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:09.875+0000 7f1aef67e640 1 -- 172.21.15.150:0/297450793 shutdown_connections 2024-09-17T05:53:09.876 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:09.875+0000 7f1aef67e640 1 --2- 172.21.15.150:0/297450793 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1ae80d0db0 0x7f1ae80d11c0 unknown :-1 s=CLOSED pgs=1813 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:53:09.876 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:09.875+0000 7f1aef67e640 1 --2- 172.21.15.150:0/297450793 >> v2:172.21.15.176:3300/0 conn(0x7f1ae806e5d0 0x7f1ae80d0870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:53:09.877 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:09.875+0000 7f1aef67e640 1 --2- 172.21.15.150:0/297450793 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1ae80b75a0 0x7f1ae806e090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:53:09.877 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:09.875+0000 7f1aef67e640 1 -- 172.21.15.150:0/297450793 >> 172.21.15.150:0/297450793 conn(0x7f1ae80cef80 msgr2=0x7f1ae80cf390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:53:09.877 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:09.875+0000 7f1aef67e640 1 -- 172.21.15.150:0/297450793 shutdown_connections 2024-09-17T05:53:09.877 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:09.875+0000 7f1aef67e640 1 -- 172.21.15.150:0/297450793 wait complete. 2024-09-17T05:53:09.877 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:09.877+0000 7f1aef67e640 1 Processor -- start 2024-09-17T05:53:09.877 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:09.877+0000 7f1aef67e640 1 -- start start 2024-09-17T05:53:09.880 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:09.878+0000 7f1aef67e640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1ae806e5d0 0x7f1ae81d45d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:53:09.880 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:09.878+0000 7f1aef67e640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1ae80b75a0 0x7f1ae81f9350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:53:09.880 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:09.878+0000 7f1aef67e640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1ae80d0db0 0x7f1ae81f9890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:53:09.880 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:09.878+0000 7f1aef67e640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f1ae80b5590 con 0x7f1ae80d0db0 2024-09-17T05:53:09.881 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:09.878+0000 7f1aef67e640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f1ae80cfec0 con 0x7f1ae806e5d0 2024-09-17T05:53:09.881 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:09.878+0000 7f1aef67e640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f1ae80b5710 con 0x7f1ae80b75a0 2024-09-17T05:53:09.881 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:09.878+0000 7f1aedc1b640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1ae80d0db0 0x7f1ae81f9890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:53:09.881 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:09.878+0000 7f1aedc1b640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1ae80d0db0 0x7f1ae81f9890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:37640/0 (socket says 172.21.15.150:37640) 2024-09-17T05:53:09.881 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:09.878+0000 7f1aedc1b640 1 -- 172.21.15.150:0/1986415147 learned_addr learned my addr 172.21.15.150:0/1986415147 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:53:09.881 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:09.878+0000 7f1aecc19640 1 --2- 172.21.15.150:0/1986415147 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1ae80b75a0 0x7f1ae81f9350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:53:09.881 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:09.878+0000 7f1aed41a640 1 --2- 172.21.15.150:0/1986415147 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1ae806e5d0 0x7f1ae81d45d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:53:09.881 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:09.879+0000 7f1aedc1b640 1 -- 172.21.15.150:0/1986415147 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1ae80b75a0 msgr2=0x7f1ae81f9350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:53:09.881 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:09.879+0000 7f1aedc1b640 1 --2- 172.21.15.150:0/1986415147 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1ae80b75a0 0x7f1ae81f9350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:53:09.881 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:09.879+0000 7f1aedc1b640 1 -- 172.21.15.150:0/1986415147 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1ae806e5d0 msgr2=0x7f1ae81d45d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:53:09.881 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:09.879+0000 7f1aedc1b640 1 --2- 172.21.15.150:0/1986415147 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1ae806e5d0 0x7f1ae81d45d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:53:09.881 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:09.879+0000 7f1aedc1b640 1 -- 172.21.15.150:0/1986415147 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1ae809d7d0 con 0x7f1ae80d0db0 2024-09-17T05:53:09.881 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:09.879+0000 7f1aedc1b640 1 --2- 172.21.15.150:0/1986415147 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1ae80d0db0 0x7f1ae81f9890 secure :-1 s=READY pgs=1814 cs=0 l=1 rev1=1 crypto rx=0x7f1ae002b020 tx=0x7f1ae0003f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:53:09.882 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:09.879+0000 7f1addffb640 1 -- 172.21.15.150:0/1986415147 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ae0033050 con 0x7f1ae80d0db0 2024-09-17T05:53:09.882 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:09.879+0000 7f1addffb640 1 -- 172.21.15.150:0/1986415147 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f1ae0004450 con 0x7f1ae80d0db0 2024-09-17T05:53:09.882 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:09.879+0000 7f1addffb640 1 -- 172.21.15.150:0/1986415147 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ae0038450 con 0x7f1ae80d0db0 2024-09-17T05:53:09.882 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:09.879+0000 7f1aef67e640 1 -- 172.21.15.150:0/1986415147 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1ae809dab0 con 0x7f1ae80d0db0 2024-09-17T05:53:09.882 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:09.879+0000 7f1aef67e640 1 -- 172.21.15.150:0/1986415147 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1ae809e070 con 0x7f1ae80d0db0 2024-09-17T05:53:09.883 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:09.880+0000 7f1aef67e640 1 -- 172.21.15.150:0/1986415147 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1ae80c8800 con 0x7f1ae80d0db0 2024-09-17T05:53:09.883 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:09.881+0000 7f1addffb640 1 -- 172.21.15.150:0/1986415147 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 45) ==== 104501+0+0 (secure 0 0 0) 0x7f1ae0036070 con 0x7f1ae80d0db0 2024-09-17T05:53:09.883 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:09.882+0000 7f1addffb640 1 --2- 172.21.15.150:0/1986415147 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f1acc07ad50 0x7f1acc07d260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:53:09.883 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:09.882+0000 7f1addffb640 1 -- 172.21.15.150:0/1986415147 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(133..133 src has 1..133) ==== 5139+0+0 (secure 0 0 0) 0x7f1ae00bb120 con 0x7f1ae80d0db0 2024-09-17T05:53:09.883 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:09.882+0000 7f1aed41a640 1 --2- 172.21.15.150:0/1986415147 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f1acc07ad50 0x7f1acc07d260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:53:09.883 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:09.882+0000 7f1aed41a640 1 --2- 172.21.15.150:0/1986415147 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f1acc07ad50 0x7f1acc07d260 secure :-1 s=READY pgs=766 cs=0 l=1 rev1=1 crypto rx=0x7f1ae4009c00 tx=0x7f1ae4005f30 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:53:09.887 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:09.886+0000 7f1addffb640 1 -- 172.21.15.150:0/1986415147 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f1ae0084a10 con 0x7f1ae80d0db0 2024-09-17T05:53:10.075 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:10.074+0000 7f1aef67e640 1 -- 172.21.15.150:0/1986415147 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) -- 0x7f1ae809d550 con 0x7f1ae80d0db0 2024-09-17T05:53:10.492 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:10.490+0000 7f1addffb640 1 -- 172.21.15.150:0/1986415147 <== mon.0 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v135) ==== 97+0+0 (secure 0 0 0) 0x7f1ae809d550 con 0x7f1ae80d0db0 2024-09-17T05:53:10.492 INFO:teuthology.orchestra.run.smithi150.stderr: removed all blocklist entries 2024-09-17T05:53:10.495 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:10.493+0000 7f1aef67e640 1 -- 172.21.15.150:0/1986415147 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f1acc07ad50 msgr2=0x7f1acc07d260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:53:10.495 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:10.493+0000 7f1aef67e640 1 --2- 172.21.15.150:0/1986415147 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f1acc07ad50 0x7f1acc07d260 secure :-1 s=READY pgs=766 cs=0 l=1 rev1=1 crypto rx=0x7f1ae4009c00 tx=0x7f1ae4005f30 comp rx=0 tx=0).stop 2024-09-17T05:53:10.496 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:10.493+0000 7f1aef67e640 1 -- 172.21.15.150:0/1986415147 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1ae80d0db0 msgr2=0x7f1ae81f9890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:53:10.496 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:10.493+0000 7f1aef67e640 1 --2- 172.21.15.150:0/1986415147 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1ae80d0db0 0x7f1ae81f9890 secure :-1 s=READY pgs=1814 cs=0 l=1 rev1=1 crypto rx=0x7f1ae002b020 tx=0x7f1ae0003f90 comp rx=0 tx=0).stop 2024-09-17T05:53:10.496 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:10.493+0000 7f1aef67e640 1 -- 172.21.15.150:0/1986415147 shutdown_connections 2024-09-17T05:53:10.496 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:10.493+0000 7f1aef67e640 1 --2- 172.21.15.150:0/1986415147 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f1acc07ad50 0x7f1acc07d260 unknown :-1 s=CLOSED pgs=766 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:53:10.496 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:10.493+0000 7f1aef67e640 1 --2- 172.21.15.150:0/1986415147 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1ae80d0db0 0x7f1ae81f9890 unknown :-1 s=CLOSED pgs=1814 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:53:10.496 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:10.493+0000 7f1aef67e640 1 --2- 172.21.15.150:0/1986415147 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1ae80b75a0 0x7f1ae81f9350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:53:10.496 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:10.493+0000 7f1aef67e640 1 --2- 172.21.15.150:0/1986415147 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1ae806e5d0 0x7f1ae81d45d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:53:10.496 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:10.493+0000 7f1aef67e640 1 -- 172.21.15.150:0/1986415147 >> 172.21.15.150:0/1986415147 conn(0x7f1ae80cef80 msgr2=0x7f1ae81eb210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:53:10.496 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:10.493+0000 7f1aef67e640 1 -- 172.21.15.150:0/1986415147 shutdown_connections 2024-09-17T05:53:10.496 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:10.493+0000 7f1aef67e640 1 -- 172.21.15.150:0/1986415147 wait complete. 2024-09-17T05:53:10.507 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-09-17T05:53:10.621 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:10.619+0000 7f6d34d72640 1 -- 172.21.15.150:0/3811022151 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6d300aebc0 msgr2=0x7f6d30152920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:53:10.621 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:10.619+0000 7f6d34d72640 1 --2- 172.21.15.150:0/3811022151 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6d300aebc0 0x7f6d30152920 secure :-1 s=READY pgs=1816 cs=0 l=1 rev1=1 crypto rx=0x7f6d20005fd0 tx=0x7f6d2002a820 comp rx=0 tx=0).stop 2024-09-17T05:53:10.621 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:10.619+0000 7f6d34d72640 1 -- 172.21.15.150:0/3811022151 shutdown_connections 2024-09-17T05:53:10.621 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:10.619+0000 7f6d34d72640 1 --2- 172.21.15.150:0/3811022151 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6d300aebc0 0x7f6d30152920 unknown :-1 s=CLOSED pgs=1816 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:53:10.621 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:10.619+0000 7f6d34d72640 1 -- 172.21.15.150:0/3811022151 >> 172.21.15.150:0/3811022151 conn(0x7f6d3006d730 msgr2=0x7f6d300b1e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:53:10.621 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:10.619+0000 7f6d34d72640 1 -- 172.21.15.150:0/3811022151 shutdown_connections 2024-09-17T05:53:10.621 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:10.619+0000 7f6d34d72640 1 -- 172.21.15.150:0/3811022151 wait complete. 2024-09-17T05:53:10.622 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:10.621+0000 7f6d34d72640 1 Processor -- start 2024-09-17T05:53:10.622 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:10.621+0000 7f6d34d72640 1 -- start start 2024-09-17T05:53:10.625 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:10.622+0000 7f6d34d72640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6d300aebc0 0x7f6d30147870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:53:10.625 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:10.622+0000 7f6d34d72640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6d300b2750 0x7f6d301e5330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:53:10.625 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:10.622+0000 7f6d34d72640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6d301e5870 0x7f6d3015a8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:53:10.625 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:10.622+0000 7f6d34d72640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f6d300b43b0 con 0x7f6d300aebc0 2024-09-17T05:53:10.625 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:10.622+0000 7f6d34d72640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f6d300b4230 con 0x7f6d301e5870 2024-09-17T05:53:10.626 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:10.622+0000 7f6d34d72640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f6d300b4530 con 0x7f6d300b2750 2024-09-17T05:53:10.626 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:10.622+0000 7f6d2e59c640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6d300aebc0 0x7f6d30147870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:53:10.626 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:10.622+0000 7f6d2e59c640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6d300aebc0 0x7f6d30147870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:34804/0 (socket says 172.21.15.150:34804) 2024-09-17T05:53:10.626 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:10.622+0000 7f6d2e59c640 1 -- 172.21.15.150:0/806341788 learned_addr learned my addr 172.21.15.150:0/806341788 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:53:10.626 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:10.622+0000 7f6d2ed9d640 1 --2- 172.21.15.150:0/806341788 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6d301e5870 0x7f6d3015a8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:53:10.626 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:10.622+0000 7f6d2dd9b640 1 --2- 172.21.15.150:0/806341788 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6d300b2750 0x7f6d301e5330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:53:10.626 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:10.622+0000 7f6d2e59c640 1 -- 172.21.15.150:0/806341788 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6d300b2750 msgr2=0x7f6d301e5330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:53:10.626 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:10.622+0000 7f6d2e59c640 1 --2- 172.21.15.150:0/806341788 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6d300b2750 0x7f6d301e5330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:53:10.626 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:10.622+0000 7f6d2e59c640 1 -- 172.21.15.150:0/806341788 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6d301e5870 msgr2=0x7f6d3015a8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:53:10.626 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:10.622+0000 7f6d2e59c640 1 --2- 172.21.15.150:0/806341788 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6d301e5870 0x7f6d3015a8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:53:10.626 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:10.622+0000 7f6d2e59c640 1 -- 172.21.15.150:0/806341788 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6d301e6020 con 0x7f6d300aebc0 2024-09-17T05:53:10.626 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:10.623+0000 7f6d2e59c640 1 --2- 172.21.15.150:0/806341788 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6d300aebc0 0x7f6d30147870 secure :-1 s=READY pgs=1817 cs=0 l=1 rev1=1 crypto rx=0x7f6d20006010 tx=0x7f6d20032c90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:53:10.627 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:10.623+0000 7f6d1effd640 1 -- 172.21.15.150:0/806341788 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d20037040 con 0x7f6d300aebc0 2024-09-17T05:53:10.627 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:10.623+0000 7f6d1effd640 1 -- 172.21.15.150:0/806341788 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f6d20042070 con 0x7f6d300aebc0 2024-09-17T05:53:10.627 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:10.623+0000 7f6d34d72640 1 -- 172.21.15.150:0/806341788 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6d301e6300 con 0x7f6d300aebc0 2024-09-17T05:53:10.627 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:10.623+0000 7f6d1effd640 1 -- 172.21.15.150:0/806341788 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d200042a0 con 0x7f6d300aebc0 2024-09-17T05:53:10.627 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:10.623+0000 7f6d34d72640 1 -- 172.21.15.150:0/806341788 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6d301e68c0 con 0x7f6d300aebc0 2024-09-17T05:53:10.628 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:10.624+0000 7f6d34d72640 1 -- 172.21.15.150:0/806341788 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6d3006a7e0 con 0x7f6d300aebc0 2024-09-17T05:53:10.628 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:10.625+0000 7f6d1effd640 1 -- 172.21.15.150:0/806341788 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 45) ==== 104501+0+0 (secure 0 0 0) 0x7f6d20004440 con 0x7f6d300aebc0 2024-09-17T05:53:10.628 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:10.626+0000 7f6d1effd640 1 --2- 172.21.15.150:0/806341788 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f6d1007ad50 0x7f6d1007d260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:53:10.628 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:10.626+0000 7f6d1effd640 1 -- 172.21.15.150:0/806341788 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(137..137 src has 1..137) ==== 5053+0+0 (secure 0 0 0) 0x7f6d200bad90 con 0x7f6d300aebc0 2024-09-17T05:53:10.628 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:10.626+0000 7f6d2dd9b640 1 --2- 172.21.15.150:0/806341788 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f6d1007ad50 0x7f6d1007d260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:53:10.628 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:10.626+0000 7f6d2dd9b640 1 --2- 172.21.15.150:0/806341788 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f6d1007ad50 0x7f6d1007d260 secure :-1 s=READY pgs=768 cs=0 l=1 rev1=1 crypto rx=0x7f6d24006fd0 tx=0x7f6d24008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:53:10.632 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:10.630+0000 7f6d1effd640 1 -- 172.21.15.150:0/806341788 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f6d20084cd0 con 0x7f6d300aebc0 2024-09-17T05:53:10.875 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:10.873+0000 7f6d34d72640 1 -- 172.21.15.150:0/806341788 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) -- 0x7f6d300b4a00 con 0x7f6d300aebc0 2024-09-17T05:53:10.875 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:10.874+0000 7f6d1effd640 1 -- 172.21.15.150:0/806341788 <== mon.0 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v19) ==== 80+0+5304 (secure 0 0 0) 0x7f6d200845d0 con 0x7f6d300aebc0 2024-09-17T05:53:10.875 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-09-17T05:53:10.876 INFO:teuthology.orchestra.run.smithi150.stdout:{ 2024-09-17T05:53:10.876 INFO:teuthology.orchestra.run.smithi150.stdout: "auth_dump": [ 2024-09-17T05:53:10.876 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-09-17T05:53:10.876 INFO:teuthology.orchestra.run.smithi150.stdout: "entity": "mds.a", 2024-09-17T05:53:10.876 INFO:teuthology.orchestra.run.smithi150.stdout: "key": "AQBoFulmMHALAxAAEO+QBgzbd+BNfhyY2qPiqw==", 2024-09-17T05:53:10.876 INFO:teuthology.orchestra.run.smithi150.stdout: "caps": { 2024-09-17T05:53:10.876 INFO:teuthology.orchestra.run.smithi150.stdout: "mds": "allow", 2024-09-17T05:53:10.876 INFO:teuthology.orchestra.run.smithi150.stdout: "mgr": "allow *", 2024-09-17T05:53:10.876 INFO:teuthology.orchestra.run.smithi150.stdout: "mon": "allow *", 2024-09-17T05:53:10.876 INFO:teuthology.orchestra.run.smithi150.stdout: "osd": "allow *" 2024-09-17T05:53:10.876 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-09-17T05:53:10.876 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-17T05:53:10.877 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-09-17T05:53:10.877 INFO:teuthology.orchestra.run.smithi150.stdout: "entity": "mds.b", 2024-09-17T05:53:10.877 INFO:teuthology.orchestra.run.smithi150.stdout: "key": "AQBoFulmtutmEBAAhKJEJQm181pL1lPmSSdYRQ==", 2024-09-17T05:53:10.877 INFO:teuthology.orchestra.run.smithi150.stdout: "caps": { 2024-09-17T05:53:10.877 INFO:teuthology.orchestra.run.smithi150.stdout: "mds": "allow", 2024-09-17T05:53:10.877 INFO:teuthology.orchestra.run.smithi150.stdout: "mgr": "allow *", 2024-09-17T05:53:10.877 INFO:teuthology.orchestra.run.smithi150.stdout: "mon": "allow *", 2024-09-17T05:53:10.877 INFO:teuthology.orchestra.run.smithi150.stdout: "osd": "allow *" 2024-09-17T05:53:10.877 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-09-17T05:53:10.877 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-17T05:53:10.877 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-09-17T05:53:10.877 INFO:teuthology.orchestra.run.smithi150.stdout: "entity": "mds.c", 2024-09-17T05:53:10.878 INFO:teuthology.orchestra.run.smithi150.stdout: "key": "AQBoFulmHTKsChAA4/fUb2NC+fMhR+xIYIDjgQ==", 2024-09-17T05:53:10.878 INFO:teuthology.orchestra.run.smithi150.stdout: "caps": { 2024-09-17T05:53:10.878 INFO:teuthology.orchestra.run.smithi150.stdout: "mds": "allow", 2024-09-17T05:53:10.878 INFO:teuthology.orchestra.run.smithi150.stdout: "mgr": "allow *", 2024-09-17T05:53:10.878 INFO:teuthology.orchestra.run.smithi150.stdout: "mon": "allow *", 2024-09-17T05:53:10.878 INFO:teuthology.orchestra.run.smithi150.stdout: "osd": "allow *" 2024-09-17T05:53:10.878 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-09-17T05:53:10.878 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-17T05:53:10.878 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-09-17T05:53:10.878 INFO:teuthology.orchestra.run.smithi150.stdout: "entity": "mds.d", 2024-09-17T05:53:10.878 INFO:teuthology.orchestra.run.smithi150.stdout: "key": "AQBoFulmr2s3GBAAhXzLVtObF/LwTpDIrY8MIQ==", 2024-09-17T05:53:10.878 INFO:teuthology.orchestra.run.smithi150.stdout: "caps": { 2024-09-17T05:53:10.878 INFO:teuthology.orchestra.run.smithi150.stdout: "mds": "allow", 2024-09-17T05:53:10.879 INFO:teuthology.orchestra.run.smithi150.stdout: "mgr": "allow *", 2024-09-17T05:53:10.879 INFO:teuthology.orchestra.run.smithi150.stdout: "mon": "allow *", 2024-09-17T05:53:10.879 INFO:teuthology.orchestra.run.smithi150.stdout: "osd": "allow *" 2024-09-17T05:53:10.879 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-09-17T05:53:10.879 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-17T05:53:10.879 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-09-17T05:53:10.879 INFO:teuthology.orchestra.run.smithi150.stdout: "entity": "osd.0", 2024-09-17T05:53:10.879 INFO:teuthology.orchestra.run.smithi150.stdout: "key": "AQBrFulm9eU0NRAAqgc1CtMOz+jDCHBn8coaVw==", 2024-09-17T05:53:10.879 INFO:teuthology.orchestra.run.smithi150.stdout: "caps": { 2024-09-17T05:53:10.879 INFO:teuthology.orchestra.run.smithi150.stdout: "mgr": "allow profile osd", 2024-09-17T05:53:10.880 INFO:teuthology.orchestra.run.smithi150.stdout: "mon": "allow profile osd", 2024-09-17T05:53:10.880 INFO:teuthology.orchestra.run.smithi150.stdout: "osd": "allow *" 2024-09-17T05:53:10.880 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-09-17T05:53:10.880 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-17T05:53:10.880 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-09-17T05:53:10.880 INFO:teuthology.orchestra.run.smithi150.stdout: "entity": "osd.1", 2024-09-17T05:53:10.880 INFO:teuthology.orchestra.run.smithi150.stdout: "key": "AQBvFulmlFL6CxAA8ByBraZue2FLfyZeOIpj3A==", 2024-09-17T05:53:10.880 INFO:teuthology.orchestra.run.smithi150.stdout: "caps": { 2024-09-17T05:53:10.880 INFO:teuthology.orchestra.run.smithi150.stdout: "mgr": "allow profile osd", 2024-09-17T05:53:10.880 INFO:teuthology.orchestra.run.smithi150.stdout: "mon": "allow profile osd", 2024-09-17T05:53:10.880 INFO:teuthology.orchestra.run.smithi150.stdout: "osd": "allow *" 2024-09-17T05:53:10.880 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-09-17T05:53:10.880 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-17T05:53:10.881 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-09-17T05:53:10.881 INFO:teuthology.orchestra.run.smithi150.stdout: "entity": "osd.2", 2024-09-17T05:53:10.881 INFO:teuthology.orchestra.run.smithi150.stdout: "key": "AQByFulmMQF5LBAAB4rbdIL6Zd+l4I4LDC/r3Q==", 2024-09-17T05:53:10.881 INFO:teuthology.orchestra.run.smithi150.stdout: "caps": { 2024-09-17T05:53:10.881 INFO:teuthology.orchestra.run.smithi150.stdout: "mgr": "allow profile osd", 2024-09-17T05:53:10.881 INFO:teuthology.orchestra.run.smithi150.stdout: "mon": "allow profile osd", 2024-09-17T05:53:10.881 INFO:teuthology.orchestra.run.smithi150.stdout: "osd": "allow *" 2024-09-17T05:53:10.881 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-09-17T05:53:10.881 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-17T05:53:10.881 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-09-17T05:53:10.881 INFO:teuthology.orchestra.run.smithi150.stdout: "entity": "osd.3", 2024-09-17T05:53:10.881 INFO:teuthology.orchestra.run.smithi150.stdout: "key": "AQB2Fulm5fjaAhAASnkpgsW79Sr9IIiy4HMm4g==", 2024-09-17T05:53:10.882 INFO:teuthology.orchestra.run.smithi150.stdout: "caps": { 2024-09-17T05:53:10.882 INFO:teuthology.orchestra.run.smithi150.stdout: "mgr": "allow profile osd", 2024-09-17T05:53:10.882 INFO:teuthology.orchestra.run.smithi150.stdout: "mon": "allow profile osd", 2024-09-17T05:53:10.882 INFO:teuthology.orchestra.run.smithi150.stdout: "osd": "allow *" 2024-09-17T05:53:10.882 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-09-17T05:53:10.882 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-17T05:53:10.882 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-09-17T05:53:10.882 INFO:teuthology.orchestra.run.smithi150.stdout: "entity": "osd.4", 2024-09-17T05:53:10.882 INFO:teuthology.orchestra.run.smithi150.stdout: "key": "AQB8Fulm9fWPGhAA9nNf+0znlS0Z7rqOvC47xQ==", 2024-09-17T05:53:10.882 INFO:teuthology.orchestra.run.smithi150.stdout: "caps": { 2024-09-17T05:53:10.882 INFO:teuthology.orchestra.run.smithi150.stdout: "mgr": "allow profile osd", 2024-09-17T05:53:10.882 INFO:teuthology.orchestra.run.smithi150.stdout: "mon": "allow profile osd", 2024-09-17T05:53:10.882 INFO:teuthology.orchestra.run.smithi150.stdout: "osd": "allow *" 2024-09-17T05:53:10.882 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-09-17T05:53:10.883 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-17T05:53:10.883 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-09-17T05:53:10.883 INFO:teuthology.orchestra.run.smithi150.stdout: "entity": "osd.5", 2024-09-17T05:53:10.883 INFO:teuthology.orchestra.run.smithi150.stdout: "key": "AQB/FulmeHakHRAASlnmKa0UTqVX+NSbmiHEBw==", 2024-09-17T05:53:10.883 INFO:teuthology.orchestra.run.smithi150.stdout: "caps": { 2024-09-17T05:53:10.883 INFO:teuthology.orchestra.run.smithi150.stdout: "mgr": "allow profile osd", 2024-09-17T05:53:10.883 INFO:teuthology.orchestra.run.smithi150.stdout: "mon": "allow profile osd", 2024-09-17T05:53:10.883 INFO:teuthology.orchestra.run.smithi150.stdout: "osd": "allow *" 2024-09-17T05:53:10.883 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-09-17T05:53:10.883 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-17T05:53:10.884 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-09-17T05:53:10.884 INFO:teuthology.orchestra.run.smithi150.stdout: "entity": "osd.6", 2024-09-17T05:53:10.884 INFO:teuthology.orchestra.run.smithi150.stdout: "key": "AQCCFulmEZF3IBAAhtpCanI6m8Kb3hyi+sRyyQ==", 2024-09-17T05:53:10.884 INFO:teuthology.orchestra.run.smithi150.stdout: "caps": { 2024-09-17T05:53:10.884 INFO:teuthology.orchestra.run.smithi150.stdout: "mgr": "allow profile osd", 2024-09-17T05:53:10.884 INFO:teuthology.orchestra.run.smithi150.stdout: "mon": "allow profile osd", 2024-09-17T05:53:10.884 INFO:teuthology.orchestra.run.smithi150.stdout: "osd": "allow *" 2024-09-17T05:53:10.884 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-09-17T05:53:10.884 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-17T05:53:10.884 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-09-17T05:53:10.884 INFO:teuthology.orchestra.run.smithi150.stdout: "entity": "osd.7", 2024-09-17T05:53:10.884 INFO:teuthology.orchestra.run.smithi150.stdout: "key": "AQCGFulmdcs7BRAAxsctes949cbkGkivdGpoYw==", 2024-09-17T05:53:10.884 INFO:teuthology.orchestra.run.smithi150.stdout: "caps": { 2024-09-17T05:53:10.885 INFO:teuthology.orchestra.run.smithi150.stdout: "mgr": "allow profile osd", 2024-09-17T05:53:10.885 INFO:teuthology.orchestra.run.smithi150.stdout: "mon": "allow profile osd", 2024-09-17T05:53:10.885 INFO:teuthology.orchestra.run.smithi150.stdout: "osd": "allow *" 2024-09-17T05:53:10.885 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-09-17T05:53:10.885 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-17T05:53:10.885 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-09-17T05:53:10.885 INFO:teuthology.orchestra.run.smithi150.stdout: "entity": "client.0", 2024-09-17T05:53:10.885 INFO:teuthology.orchestra.run.smithi150.stdout: "key": "AQBoFulmfF/1HBAAMezEjZDeoHTJ+uFfDXNWHQ==", 2024-09-17T05:53:10.885 INFO:teuthology.orchestra.run.smithi150.stdout: "caps": { 2024-09-17T05:53:10.885 INFO:teuthology.orchestra.run.smithi150.stdout: "mds": "allow", 2024-09-17T05:53:10.885 INFO:teuthology.orchestra.run.smithi150.stdout: "mon": "allow r", 2024-09-17T05:53:10.885 INFO:teuthology.orchestra.run.smithi150.stdout: "osd": "allow rw tag cephfs data=cephfs" 2024-09-17T05:53:10.886 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-09-17T05:53:10.886 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-17T05:53:10.886 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-09-17T05:53:10.886 INFO:teuthology.orchestra.run.smithi150.stdout: "entity": "client.1", 2024-09-17T05:53:10.886 INFO:teuthology.orchestra.run.smithi150.stdout: "key": "AQBoFulmv3GQJBAANlgjLqiCwzNfmBh8uClJ9A==", 2024-09-17T05:53:10.886 INFO:teuthology.orchestra.run.smithi150.stdout: "caps": { 2024-09-17T05:53:10.886 INFO:teuthology.orchestra.run.smithi150.stdout: "mds": "allow", 2024-09-17T05:53:10.886 INFO:teuthology.orchestra.run.smithi150.stdout: "mgr": "allow r", 2024-09-17T05:53:10.886 INFO:teuthology.orchestra.run.smithi150.stdout: "mon": "allow rw", 2024-09-17T05:53:10.886 INFO:teuthology.orchestra.run.smithi150.stdout: "osd": "allow rwx" 2024-09-17T05:53:10.886 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-09-17T05:53:10.886 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-17T05:53:10.886 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-09-17T05:53:10.886 INFO:teuthology.orchestra.run.smithi150.stdout: "entity": "client.2", 2024-09-17T05:53:10.887 INFO:teuthology.orchestra.run.smithi150.stdout: "key": "AQBoFulm1O/BIBAA8kfQL3/13SmZO1+y2tOZvw==", 2024-09-17T05:53:10.887 INFO:teuthology.orchestra.run.smithi150.stdout: "caps": { 2024-09-17T05:53:10.887 INFO:teuthology.orchestra.run.smithi150.stdout: "mds": "allow", 2024-09-17T05:53:10.887 INFO:teuthology.orchestra.run.smithi150.stdout: "mgr": "allow r", 2024-09-17T05:53:10.887 INFO:teuthology.orchestra.run.smithi150.stdout: "mon": "allow rw", 2024-09-17T05:53:10.887 INFO:teuthology.orchestra.run.smithi150.stdout: "osd": "allow rwx" 2024-09-17T05:53:10.887 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-09-17T05:53:10.887 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-17T05:53:10.887 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-09-17T05:53:10.887 INFO:teuthology.orchestra.run.smithi150.stdout: "entity": "client.3", 2024-09-17T05:53:10.887 INFO:teuthology.orchestra.run.smithi150.stdout: "key": "AQBoFulmF4hVKBAAZ5FGapBLLLtez3t8kON9dg==", 2024-09-17T05:53:10.887 INFO:teuthology.orchestra.run.smithi150.stdout: "caps": { 2024-09-17T05:53:10.888 INFO:teuthology.orchestra.run.smithi150.stdout: "mds": "allow", 2024-09-17T05:53:10.888 INFO:teuthology.orchestra.run.smithi150.stdout: "mgr": "allow r", 2024-09-17T05:53:10.888 INFO:teuthology.orchestra.run.smithi150.stdout: "mon": "allow rw", 2024-09-17T05:53:10.888 INFO:teuthology.orchestra.run.smithi150.stdout: "osd": "allow rwx" 2024-09-17T05:53:10.888 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-09-17T05:53:10.888 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-17T05:53:10.888 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-09-17T05:53:10.888 INFO:teuthology.orchestra.run.smithi150.stdout: "entity": "client.admin", 2024-09-17T05:53:10.888 INFO:teuthology.orchestra.run.smithi150.stdout: "key": "AQBnFulmaU9+IBAA7ZmXWZ44s0IpQ+C+Zw2V1g==", 2024-09-17T05:53:10.888 INFO:teuthology.orchestra.run.smithi150.stdout: "caps": { 2024-09-17T05:53:10.888 INFO:teuthology.orchestra.run.smithi150.stdout: "mds": "allow *", 2024-09-17T05:53:10.888 INFO:teuthology.orchestra.run.smithi150.stdout: "mgr": "allow *", 2024-09-17T05:53:10.888 INFO:teuthology.orchestra.run.smithi150.stdout: "mon": "allow *", 2024-09-17T05:53:10.889 INFO:teuthology.orchestra.run.smithi150.stdout: "osd": "allow *" 2024-09-17T05:53:10.889 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-09-17T05:53:10.889 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-17T05:53:10.889 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-09-17T05:53:10.889 INFO:teuthology.orchestra.run.smithi150.stdout: "entity": "mgr.x", 2024-09-17T05:53:10.889 INFO:teuthology.orchestra.run.smithi150.stdout: "key": "AQBnFulmEjvROhAAn3GZxCEtqPYLWopR1AcSFA==", 2024-09-17T05:53:10.889 INFO:teuthology.orchestra.run.smithi150.stdout: "caps": { 2024-09-17T05:53:10.889 INFO:teuthology.orchestra.run.smithi150.stdout: "mds": "allow *", 2024-09-17T05:53:10.889 INFO:teuthology.orchestra.run.smithi150.stdout: "mon": "allow profile mgr", 2024-09-17T05:53:10.889 INFO:teuthology.orchestra.run.smithi150.stdout: "osd": "allow *" 2024-09-17T05:53:10.889 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-09-17T05:53:10.889 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-17T05:53:10.890 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-09-17T05:53:10.890 INFO:teuthology.orchestra.run.smithi150.stdout: "entity": "mgr.y", 2024-09-17T05:53:10.890 INFO:teuthology.orchestra.run.smithi150.stdout: "key": "AQBnFulm9IkENhAA4uf1vzhYOepmovspN5/v1w==", 2024-09-17T05:53:10.890 INFO:teuthology.orchestra.run.smithi150.stdout: "caps": { 2024-09-17T05:53:10.890 INFO:teuthology.orchestra.run.smithi150.stdout: "mds": "allow *", 2024-09-17T05:53:10.890 INFO:teuthology.orchestra.run.smithi150.stdout: "mon": "allow profile mgr", 2024-09-17T05:53:10.890 INFO:teuthology.orchestra.run.smithi150.stdout: "osd": "allow *" 2024-09-17T05:53:10.890 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-09-17T05:53:10.890 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-09-17T05:53:10.890 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2024-09-17T05:53:10.890 INFO:teuthology.orchestra.run.smithi150.stdout:} 2024-09-17T05:53:10.892 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:10.876+0000 7f6d34d72640 1 -- 172.21.15.150:0/806341788 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f6d1007ad50 msgr2=0x7f6d1007d260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:53:10.892 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:10.876+0000 7f6d34d72640 1 --2- 172.21.15.150:0/806341788 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f6d1007ad50 0x7f6d1007d260 secure :-1 s=READY pgs=768 cs=0 l=1 rev1=1 crypto rx=0x7f6d24006fd0 tx=0x7f6d24008040 comp rx=0 tx=0).stop 2024-09-17T05:53:10.892 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:10.876+0000 7f6d34d72640 1 -- 172.21.15.150:0/806341788 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6d300aebc0 msgr2=0x7f6d30147870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:53:10.892 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:10.876+0000 7f6d34d72640 1 --2- 172.21.15.150:0/806341788 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6d300aebc0 0x7f6d30147870 secure :-1 s=READY pgs=1817 cs=0 l=1 rev1=1 crypto rx=0x7f6d20006010 tx=0x7f6d20032c90 comp rx=0 tx=0).stop 2024-09-17T05:53:10.892 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:10.876+0000 7f6d34d72640 1 -- 172.21.15.150:0/806341788 shutdown_connections 2024-09-17T05:53:10.892 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:10.876+0000 7f6d34d72640 1 --2- 172.21.15.150:0/806341788 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6d301e5870 0x7f6d3015a8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:53:10.892 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:10.876+0000 7f6d34d72640 1 --2- 172.21.15.150:0/806341788 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f6d1007ad50 0x7f6d1007d260 unknown :-1 s=CLOSED pgs=768 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:53:10.892 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:10.876+0000 7f6d34d72640 1 --2- 172.21.15.150:0/806341788 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6d300b2750 0x7f6d301e5330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:53:10.892 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:10.876+0000 7f6d34d72640 1 --2- 172.21.15.150:0/806341788 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6d300aebc0 0x7f6d30147870 unknown :-1 s=CLOSED pgs=1817 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:53:10.893 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:10.876+0000 7f6d34d72640 1 -- 172.21.15.150:0/806341788 >> 172.21.15.150:0/806341788 conn(0x7f6d3006d730 msgr2=0x7f6d3015e380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:53:10.893 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:10.876+0000 7f6d34d72640 1 -- 172.21.15.150:0/806341788 shutdown_connections 2024-09-17T05:53:10.893 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:10.876+0000 7f6d34d72640 1 -- 172.21.15.150:0/806341788 wait complete. 2024-09-17T05:53:10.893 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-09-17T05:53:11.008 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:11.006+0000 7f440d700640 1 -- 172.21.15.150:0/3887072054 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f43f4003a50 msgr2=0x7f43f4003ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:53:11.008 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:11.006+0000 7f440d700640 1 --2- 172.21.15.150:0/3887072054 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f43f4003a50 0x7f43f4003ec0 secure :-1 s=READY pgs=1819 cs=0 l=1 rev1=1 crypto rx=0x7f43f8006fc0 tx=0x7f43f4005830 comp rx=0 tx=0).stop 2024-09-17T05:53:11.009 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:11.006+0000 7f440d700640 1 -- 172.21.15.150:0/3887072054 shutdown_connections 2024-09-17T05:53:11.009 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:11.006+0000 7f440d700640 1 --2- 172.21.15.150:0/3887072054 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f43f4003a50 0x7f43f4003ec0 unknown :-1 s=CLOSED pgs=1819 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:53:11.009 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:11.006+0000 7f440d700640 1 -- 172.21.15.150:0/3887072054 >> 172.21.15.150:0/3887072054 conn(0x7f440808bfe0 msgr2=0x7f44080d4670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:53:11.009 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:11.006+0000 7f440d700640 1 -- 172.21.15.150:0/3887072054 shutdown_connections 2024-09-17T05:53:11.009 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:11.006+0000 7f440d700640 1 -- 172.21.15.150:0/3887072054 wait complete. 2024-09-17T05:53:11.009 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:11.008+0000 7f440d700640 1 Processor -- start 2024-09-17T05:53:11.010 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:11.008+0000 7f440d700640 1 -- start start 2024-09-17T05:53:11.012 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:11.009+0000 7f440d700640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f43f4003a50 0x7f44081f6390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:53:11.012 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:11.009+0000 7f440d700640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f44081424c0 0x7f44081f2c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:53:11.012 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:11.010+0000 7f440d700640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f44081f3180 0x7f44080b4920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:53:11.013 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:11.010+0000 7f440d700640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f44080d0580 con 0x7f44081f3180 2024-09-17T05:53:11.013 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:11.010+0000 7f440d700640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f44080d0400 con 0x7f43f4003a50 2024-09-17T05:53:11.013 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:11.010+0000 7f440d700640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f44080d0700 con 0x7f44081424c0 2024-09-17T05:53:11.013 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:11.010+0000 7f44077fe640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f44081f3180 0x7f44080b4920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:53:11.013 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:11.010+0000 7f44077fe640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f44081f3180 0x7f44080b4920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:34822/0 (socket says 172.21.15.150:34822) 2024-09-17T05:53:11.013 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:11.010+0000 7f44077fe640 1 -- 172.21.15.150:0/219592232 learned_addr learned my addr 172.21.15.150:0/219592232 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:53:11.013 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:11.010+0000 7f4406ffd640 1 --2- 172.21.15.150:0/219592232 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f43f4003a50 0x7f44081f6390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:53:11.013 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:11.010+0000 7f43fe7fc640 1 --2- 172.21.15.150:0/219592232 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f44081424c0 0x7f44081f2c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:53:11.013 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:11.010+0000 7f44077fe640 1 -- 172.21.15.150:0/219592232 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f44081424c0 msgr2=0x7f44081f2c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:53:11.013 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:11.010+0000 7f44077fe640 1 --2- 172.21.15.150:0/219592232 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f44081424c0 0x7f44081f2c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:53:11.013 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:11.010+0000 7f44077fe640 1 -- 172.21.15.150:0/219592232 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f43f4003a50 msgr2=0x7f44081f6390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:53:11.013 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:11.010+0000 7f44077fe640 1 --2- 172.21.15.150:0/219592232 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f43f4003a50 0x7f44081f6390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:53:11.014 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:11.010+0000 7f44077fe640 1 -- 172.21.15.150:0/219592232 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4408156420 con 0x7f44081f3180 2024-09-17T05:53:11.014 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:11.010+0000 7f44077fe640 1 --2- 172.21.15.150:0/219592232 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f44081f3180 0x7f44080b4920 secure :-1 s=READY pgs=1820 cs=0 l=1 rev1=1 crypto rx=0x7f440808e9b0 tx=0x7f44000019b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:53:11.014 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:11.010+0000 7f43fffff640 1 -- 172.21.15.150:0/219592232 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4400017070 con 0x7f44081f3180 2024-09-17T05:53:11.014 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:11.010+0000 7f43fffff640 1 -- 172.21.15.150:0/219592232 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f44000108c0 con 0x7f44081f3180 2024-09-17T05:53:11.014 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:11.010+0000 7f440d700640 1 -- 172.21.15.150:0/219592232 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4408156700 con 0x7f44081f3180 2024-09-17T05:53:11.014 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:11.010+0000 7f43fffff640 1 -- 172.21.15.150:0/219592232 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4400010d10 con 0x7f44081f3180 2024-09-17T05:53:11.014 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:11.010+0000 7f440d700640 1 -- 172.21.15.150:0/219592232 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4408156cc0 con 0x7f44081f3180 2024-09-17T05:53:11.015 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:11.012+0000 7f440d700640 1 -- 172.21.15.150:0/219592232 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f440815b940 con 0x7f44081f3180 2024-09-17T05:53:11.015 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:11.012+0000 7f43fffff640 1 -- 172.21.15.150:0/219592232 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 45) ==== 104501+0+0 (secure 0 0 0) 0x7f440001a070 con 0x7f44081f3180 2024-09-17T05:53:11.015 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:11.013+0000 7f43fffff640 1 --2- 172.21.15.150:0/219592232 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f43e807ad80 0x7f43e807d290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:53:11.015 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:11.013+0000 7f43fffff640 1 -- 172.21.15.150:0/219592232 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(137..137 src has 1..137) ==== 5053+0+0 (secure 0 0 0) 0x7f44000999b0 con 0x7f44081f3180 2024-09-17T05:53:11.015 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:11.013+0000 7f4406ffd640 1 --2- 172.21.15.150:0/219592232 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f43e807ad80 0x7f43e807d290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:53:11.015 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:11.014+0000 7f4406ffd640 1 --2- 172.21.15.150:0/219592232 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f43e807ad80 0x7f43e807d290 secure :-1 s=READY pgs=769 cs=0 l=1 rev1=1 crypto rx=0x7f43f8033000 tx=0x7f43f8038040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:53:11.019 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:11.017+0000 7f43fffff640 1 -- 172.21.15.150:0/219592232 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f4400063330 con 0x7f44081f3180 2024-09-17T05:53:11.196 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:11.194+0000 7f440d700640 1 -- 172.21.15.150:0/219592232 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7f44080d1240 con 0x7f44081f3180 2024-09-17T05:53:11.197 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:11.195+0000 7f43fffff640 1 -- 172.21.15.150:0/219592232 <== mon.0 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v137) ==== 84+0+65 (secure 0 0 0) 0x7f4400067d60 con 0x7f44081f3180 2024-09-17T05:53:11.197 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-09-17T05:53:11.197 INFO:teuthology.orchestra.run.smithi150.stdout:[ 2024-09-17T05:53:11.197 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-09-17T05:53:11.197 INFO:teuthology.orchestra.run.smithi150.stdout: "poolnum": 1, 2024-09-17T05:53:11.197 INFO:teuthology.orchestra.run.smithi150.stdout: "poolname": ".mgr" 2024-09-17T05:53:11.198 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-09-17T05:53:11.198 INFO:teuthology.orchestra.run.smithi150.stdout:] 2024-09-17T05:53:11.199 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:11.197+0000 7f440d700640 1 -- 172.21.15.150:0/219592232 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f43e807ad80 msgr2=0x7f43e807d290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:53:11.199 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:11.197+0000 7f440d700640 1 --2- 172.21.15.150:0/219592232 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f43e807ad80 0x7f43e807d290 secure :-1 s=READY pgs=769 cs=0 l=1 rev1=1 crypto rx=0x7f43f8033000 tx=0x7f43f8038040 comp rx=0 tx=0).stop 2024-09-17T05:53:11.199 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:11.197+0000 7f440d700640 1 -- 172.21.15.150:0/219592232 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f44081f3180 msgr2=0x7f44080b4920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:53:11.199 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:11.197+0000 7f440d700640 1 --2- 172.21.15.150:0/219592232 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f44081f3180 0x7f44080b4920 secure :-1 s=READY pgs=1820 cs=0 l=1 rev1=1 crypto rx=0x7f440808e9b0 tx=0x7f44000019b0 comp rx=0 tx=0).stop 2024-09-17T05:53:11.199 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:11.197+0000 7f440d700640 1 -- 172.21.15.150:0/219592232 shutdown_connections 2024-09-17T05:53:11.200 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:11.197+0000 7f440d700640 1 --2- 172.21.15.150:0/219592232 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f43e807ad80 0x7f43e807d290 unknown :-1 s=CLOSED pgs=769 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:53:11.200 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:11.197+0000 7f440d700640 1 --2- 172.21.15.150:0/219592232 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f44081f3180 0x7f44080b4920 unknown :-1 s=CLOSED pgs=1820 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:53:11.200 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:11.197+0000 7f440d700640 1 --2- 172.21.15.150:0/219592232 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f44081424c0 0x7f44081f2c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:53:11.200 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:11.197+0000 7f440d700640 1 --2- 172.21.15.150:0/219592232 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f43f4003a50 0x7f44081f6390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:53:11.200 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:11.197+0000 7f440d700640 1 -- 172.21.15.150:0/219592232 >> 172.21.15.150:0/219592232 conn(0x7f440808bfe0 msgr2=0x7f44080b7f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:53:11.200 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:11.197+0000 7f440d700640 1 -- 172.21.15.150:0/219592232 shutdown_connections 2024-09-17T05:53:11.200 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:11.197+0000 7f440d700640 1 -- 172.21.15.150:0/219592232 wait complete. 2024-09-17T05:53:11.211 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-09-17T05:53:11.211 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-09-17T05:53:11.330 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:11.327+0000 7fe454b7b640 1 -- 172.21.15.150:0/3506588779 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe450156db0 msgr2=0x7fe4500b5f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:53:11.330 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:11.327+0000 7fe454b7b640 1 --2- 172.21.15.150:0/3506588779 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe450156db0 0x7fe4500b5f40 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fe440009830 tx=0x7fe44002a510 comp rx=0 tx=0).stop 2024-09-17T05:53:11.330 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:11.328+0000 7fe454b7b640 1 -- 172.21.15.150:0/3506588779 shutdown_connections 2024-09-17T05:53:11.330 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:11.328+0000 7fe454b7b640 1 --2- 172.21.15.150:0/3506588779 >> v2:172.21.15.176:3300/0 conn(0x7fe4500745c0 0x7fe45015d610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:53:11.330 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:11.328+0000 7fe454b7b640 1 --2- 172.21.15.150:0/3506588779 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe450156db0 0x7fe4500b5f40 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:53:11.330 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:11.328+0000 7fe454b7b640 1 -- 172.21.15.150:0/3506588779 >> 172.21.15.150:0/3506588779 conn(0x7fe450073890 msgr2=0x7fe450073ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:53:11.330 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:11.328+0000 7fe454b7b640 1 -- 172.21.15.150:0/3506588779 shutdown_connections 2024-09-17T05:53:11.330 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:11.328+0000 7fe454b7b640 1 -- 172.21.15.150:0/3506588779 wait complete. 2024-09-17T05:53:11.331 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:11.329+0000 7fe454b7b640 1 Processor -- start 2024-09-17T05:53:11.331 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:11.330+0000 7fe454b7b640 1 -- start start 2024-09-17T05:53:11.334 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:11.331+0000 7fe454b7b640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe45006ddb0 0x7fe45014a580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:53:11.334 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:11.331+0000 7fe454b7b640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe4500745c0 0x7fe45014cb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:53:11.334 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:11.331+0000 7fe454b7b640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe450156db0 0x7fe45014d090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:53:11.334 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:11.331+0000 7fe454b7b640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7fe4500cea20 con 0x7fe45006ddb0 2024-09-17T05:53:11.334 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:11.331+0000 7fe454b7b640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fe4500ce8a0 con 0x7fe4500745c0 2024-09-17T05:53:11.334 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:11.331+0000 7fe454b7b640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fe4500ceba0 con 0x7fe450156db0 2024-09-17T05:53:11.334 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:11.331+0000 7fe44e59c640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe45006ddb0 0x7fe45014a580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:53:11.334 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:11.331+0000 7fe44e59c640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe45006ddb0 0x7fe45014a580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:34832/0 (socket says 172.21.15.150:34832) 2024-09-17T05:53:11.334 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:11.331+0000 7fe44e59c640 1 -- 172.21.15.150:0/202978660 learned_addr learned my addr 172.21.15.150:0/202978660 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:53:11.335 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:11.331+0000 7fe44ed9d640 1 --2- 172.21.15.150:0/202978660 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe450156db0 0x7fe45014d090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:53:11.335 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:11.331+0000 7fe44dd9b640 1 --2- 172.21.15.150:0/202978660 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe4500745c0 0x7fe45014cb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:53:11.335 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:11.331+0000 7fe44e59c640 1 -- 172.21.15.150:0/202978660 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe450156db0 msgr2=0x7fe45014d090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:53:11.335 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:11.331+0000 7fe44e59c640 1 --2- 172.21.15.150:0/202978660 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe450156db0 0x7fe45014d090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:53:11.335 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:11.331+0000 7fe44e59c640 1 -- 172.21.15.150:0/202978660 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe4500745c0 msgr2=0x7fe45014cb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:53:11.335 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:11.331+0000 7fe44e59c640 1 --2- 172.21.15.150:0/202978660 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe4500745c0 0x7fe45014cb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:53:11.335 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:11.331+0000 7fe44e59c640 1 -- 172.21.15.150:0/202978660 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe4500cc6f0 con 0x7fe45006ddb0 2024-09-17T05:53:11.335 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:11.332+0000 7fe44e59c640 1 --2- 172.21.15.150:0/202978660 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe45006ddb0 0x7fe45014a580 secure :-1 s=READY pgs=1821 cs=0 l=1 rev1=1 crypto rx=0x7fe440009950 tx=0x7fe440033c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:53:11.335 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:11.332+0000 7fe43effd640 1 -- 172.21.15.150:0/202978660 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe440031d60 con 0x7fe45006ddb0 2024-09-17T05:53:11.335 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:11.332+0000 7fe43effd640 1 -- 172.21.15.150:0/202978660 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe440033e10 con 0x7fe45006ddb0 2024-09-17T05:53:11.335 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:11.332+0000 7fe454b7b640 1 -- 172.21.15.150:0/202978660 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe450158950 con 0x7fe45006ddb0 2024-09-17T05:53:11.335 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:11.332+0000 7fe43effd640 1 -- 172.21.15.150:0/202978660 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe440005260 con 0x7fe45006ddb0 2024-09-17T05:53:11.336 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:11.332+0000 7fe454b7b640 1 -- 172.21.15.150:0/202978660 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe4501f3850 con 0x7fe45006ddb0 2024-09-17T05:53:11.336 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:11.333+0000 7fe454b7b640 1 -- 172.21.15.150:0/202978660 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe4501f3ab0 con 0x7fe45006ddb0 2024-09-17T05:53:11.336 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:11.333+0000 7fe43effd640 1 -- 172.21.15.150:0/202978660 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 45) ==== 104501+0+0 (secure 0 0 0) 0x7fe440005400 con 0x7fe45006ddb0 2024-09-17T05:53:11.337 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:11.334+0000 7fe43effd640 1 --2- 172.21.15.150:0/202978660 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fe43007ad50 0x7fe43007d260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:53:11.337 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:11.334+0000 7fe43effd640 1 -- 172.21.15.150:0/202978660 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(137..137 src has 1..137) ==== 5053+0+0 (secure 0 0 0) 0x7fe4400baf00 con 0x7fe45006ddb0 2024-09-17T05:53:11.337 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:11.334+0000 7fe44dd9b640 1 --2- 172.21.15.150:0/202978660 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fe43007ad50 0x7fe43007d260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:53:11.337 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:11.335+0000 7fe44dd9b640 1 --2- 172.21.15.150:0/202978660 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fe43007ad50 0x7fe43007d260 secure :-1 s=READY pgs=770 cs=0 l=1 rev1=1 crypto rx=0x7fe4500b4730 tx=0x7fe444005f90 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:53:11.340 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:11.339+0000 7fe43effd640 1 -- 172.21.15.150:0/202978660 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fe44003f030 con 0x7fe45006ddb0 2024-09-17T05:53:11.517 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:11.516+0000 7fe454b7b640 1 -- 172.21.15.150:0/202978660 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7fe4500cf0f0 con 0x7fe45006ddb0 2024-09-17T05:53:12.511 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:12.509+0000 7fe43effd640 1 -- 172.21.15.150:0/202978660 <== mon.0 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v138) ==== 138+0+0 (secure 0 0 0) 0x7fe440084800 con 0x7fe45006ddb0 2024-09-17T05:53:12.512 INFO:teuthology.orchestra.run.smithi150.stderr:pool 'cephfs_metadata' created 2024-09-17T05:53:12.516 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:12.514+0000 7fe454b7b640 1 -- 172.21.15.150:0/202978660 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fe43007ad50 msgr2=0x7fe43007d260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:53:12.516 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:12.514+0000 7fe454b7b640 1 --2- 172.21.15.150:0/202978660 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fe43007ad50 0x7fe43007d260 secure :-1 s=READY pgs=770 cs=0 l=1 rev1=1 crypto rx=0x7fe4500b4730 tx=0x7fe444005f90 comp rx=0 tx=0).stop 2024-09-17T05:53:12.516 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:12.514+0000 7fe454b7b640 1 -- 172.21.15.150:0/202978660 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe45006ddb0 msgr2=0x7fe45014a580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:53:12.516 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:12.514+0000 7fe454b7b640 1 --2- 172.21.15.150:0/202978660 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe45006ddb0 0x7fe45014a580 secure :-1 s=READY pgs=1821 cs=0 l=1 rev1=1 crypto rx=0x7fe440009950 tx=0x7fe440033c20 comp rx=0 tx=0).stop 2024-09-17T05:53:12.516 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:12.514+0000 7fe454b7b640 1 -- 172.21.15.150:0/202978660 shutdown_connections 2024-09-17T05:53:12.516 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:12.514+0000 7fe454b7b640 1 --2- 172.21.15.150:0/202978660 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe4500745c0 0x7fe45014cb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:53:12.516 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:12.514+0000 7fe454b7b640 1 --2- 172.21.15.150:0/202978660 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fe43007ad50 0x7fe43007d260 unknown :-1 s=CLOSED pgs=770 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:53:12.516 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:12.514+0000 7fe454b7b640 1 --2- 172.21.15.150:0/202978660 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe450156db0 0x7fe45014d090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:53:12.516 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:12.514+0000 7fe454b7b640 1 --2- 172.21.15.150:0/202978660 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe45006ddb0 0x7fe45014a580 unknown :-1 s=CLOSED pgs=1821 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:53:12.516 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:12.514+0000 7fe454b7b640 1 -- 172.21.15.150:0/202978660 >> 172.21.15.150:0/202978660 conn(0x7fe450073890 msgr2=0x7fe450154430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:53:12.517 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:12.514+0000 7fe454b7b640 1 -- 172.21.15.150:0/202978660 shutdown_connections 2024-09-17T05:53:12.517 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:12.514+0000 7fe454b7b640 1 -- 172.21.15.150:0/202978660 wait complete. 2024-09-17T05:53:12.535 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-09-17T05:53:12.663 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:12.661+0000 7f31bc112640 1 -- 172.21.15.150:0/504698991 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f31b40b7960 msgr2=0x7f31b40af1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:53:12.664 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:12.661+0000 7f31bc112640 1 --2- 172.21.15.150:0/504698991 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f31b40b7960 0x7f31b40af1f0 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7f31b00098e0 tx=0x7f31b002a490 comp rx=0 tx=0).stop 2024-09-17T05:53:12.664 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:12.661+0000 7f31bc112640 1 -- 172.21.15.150:0/504698991 shutdown_connections 2024-09-17T05:53:12.664 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:12.661+0000 7f31bc112640 1 --2- 172.21.15.150:0/504698991 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f31b40d1190 0x7f31b40cd0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:53:12.664 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:12.661+0000 7f31bc112640 1 --2- 172.21.15.150:0/504698991 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f31b40b7960 0x7f31b40af1f0 unknown :-1 s=CLOSED pgs=618 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:53:12.664 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:12.661+0000 7f31bc112640 1 -- 172.21.15.150:0/504698991 >> 172.21.15.150:0/504698991 conn(0x7f31b40cef20 msgr2=0x7f31b40cf330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:53:12.664 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:12.661+0000 7f31bc112640 1 -- 172.21.15.150:0/504698991 shutdown_connections 2024-09-17T05:53:12.664 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:12.661+0000 7f31bc112640 1 -- 172.21.15.150:0/504698991 wait complete. 2024-09-17T05:53:12.665 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:12.663+0000 7f31bc112640 1 Processor -- start 2024-09-17T05:53:12.665 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:12.663+0000 7f31bc112640 1 -- start start 2024-09-17T05:53:12.667 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:12.664+0000 7f31bc112640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f31b40b7960 0x7f31b41f7b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:53:12.668 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:12.664+0000 7f31bc112640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f31b40b7d70 0x7f31b4151910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:53:12.668 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:12.664+0000 7f31bc112640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f31b40d1190 0x7f31b40b5d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:53:12.668 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:12.664+0000 7f31bc112640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f31b40ced10 con 0x7f31b40d1190 2024-09-17T05:53:12.668 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:12.664+0000 7f31bc112640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f31b40ceb90 con 0x7f31b40b7960 2024-09-17T05:53:12.668 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:12.664+0000 7f31bc112640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f31b40af730 con 0x7f31b40b7d70 2024-09-17T05:53:12.668 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:12.665+0000 7f31ba6af640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f31b40d1190 0x7f31b40b5d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:53:12.668 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:12.665+0000 7f31ba6af640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f31b40d1190 0x7f31b40b5d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:34844/0 (socket says 172.21.15.150:34844) 2024-09-17T05:53:12.668 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:12.665+0000 7f31ba6af640 1 -- 172.21.15.150:0/1065029637 learned_addr learned my addr 172.21.15.150:0/1065029637 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:53:12.668 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:12.665+0000 7f31b9eae640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f31b40b7960 0x7f31b41f7b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:53:12.668 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:12.665+0000 7f31b96ad640 1 --2- 172.21.15.150:0/1065029637 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f31b40b7d70 0x7f31b4151910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:53:12.668 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:12.665+0000 7f31ba6af640 1 -- 172.21.15.150:0/1065029637 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f31b40b7d70 msgr2=0x7f31b4151910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:53:12.668 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:12.665+0000 7f31ba6af640 1 --2- 172.21.15.150:0/1065029637 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f31b40b7d70 0x7f31b4151910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:53:12.669 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:12.665+0000 7f31ba6af640 1 -- 172.21.15.150:0/1065029637 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f31b40b7960 msgr2=0x7f31b41f7b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:53:12.669 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:12.665+0000 7f31ba6af640 1 --2- 172.21.15.150:0/1065029637 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f31b40b7960 0x7f31b41f7b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:53:12.669 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:12.665+0000 7f31ba6af640 1 -- 172.21.15.150:0/1065029637 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f31b41f8090 con 0x7f31b40d1190 2024-09-17T05:53:12.669 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:12.665+0000 7f31b9eae640 1 --2- 172.21.15.150:0/1065029637 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f31b40b7960 0x7f31b41f7b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T05:53:12.669 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:12.665+0000 7f31ba6af640 1 --2- 172.21.15.150:0/1065029637 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f31b40d1190 0x7f31b40b5d00 secure :-1 s=READY pgs=1822 cs=0 l=1 rev1=1 crypto rx=0x7f31ac00ea40 tx=0x7f31ac00ef00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:53:12.669 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:12.665+0000 7f31aa7fc640 1 -- 172.21.15.150:0/1065029637 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31ac00ce40 con 0x7f31b40d1190 2024-09-17T05:53:12.669 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:12.665+0000 7f31aa7fc640 1 -- 172.21.15.150:0/1065029637 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f31ac004c10 con 0x7f31b40d1190 2024-09-17T05:53:12.669 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:12.665+0000 7f31bc112640 1 -- 172.21.15.150:0/1065029637 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f31b41f3f20 con 0x7f31b40d1190 2024-09-17T05:53:12.669 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:12.665+0000 7f31aa7fc640 1 -- 172.21.15.150:0/1065029637 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31ac005020 con 0x7f31b40d1190 2024-09-17T05:53:12.669 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:12.665+0000 7f31bc112640 1 -- 172.21.15.150:0/1065029637 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f31b41f44e0 con 0x7f31b40d1190 2024-09-17T05:53:12.670 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:12.666+0000 7f31bc112640 1 -- 172.21.15.150:0/1065029637 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f31b415cc80 con 0x7f31b40d1190 2024-09-17T05:53:12.670 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:12.667+0000 7f31aa7fc640 1 -- 172.21.15.150:0/1065029637 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 45) ==== 104501+0+0 (secure 0 0 0) 0x7f31ac0051c0 con 0x7f31b40d1190 2024-09-17T05:53:12.670 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:12.668+0000 7f31aa7fc640 1 --2- 172.21.15.150:0/1065029637 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f319807ad50 0x7f319807d260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:53:12.670 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:12.668+0000 7f31aa7fc640 1 -- 172.21.15.150:0/1065029637 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(138..138 src has 1..138) ==== 5423+0+0 (secure 0 0 0) 0x7f31ac09af90 con 0x7f31b40d1190 2024-09-17T05:53:12.671 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:12.668+0000 7f31b9eae640 1 --2- 172.21.15.150:0/1065029637 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f319807ad50 0x7f319807d260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:53:12.671 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:12.669+0000 7f31b9eae640 1 --2- 172.21.15.150:0/1065029637 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f319807ad50 0x7f319807d260 secure :-1 s=READY pgs=774 cs=0 l=1 rev1=1 crypto rx=0x7f31b0034000 tx=0x7f31b0004730 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:53:12.673 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:12.672+0000 7f31aa7fc640 1 -- 172.21.15.150:0/1065029637 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f31b415cc80 con 0x7f31b40d1190 2024-09-17T05:53:12.849 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:12.848+0000 7f31bc112640 1 -- 172.21.15.150:0/1065029637 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7f31b4074680 con 0x7f31b40d1190 2024-09-17T05:53:13.519 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:13.517+0000 7f31aa7fc640 1 -- 172.21.15.150:0/1065029637 <== mon.0 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v139) ==== 170+0+0 (secure 0 0 0) 0x7f31b4074680 con 0x7f31b40d1190 2024-09-17T05:53:13.519 INFO:teuthology.orchestra.run.smithi150.stderr:pool 'cephfs_data' created 2024-09-17T05:53:13.524 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:13.521+0000 7f31bc112640 1 -- 172.21.15.150:0/1065029637 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f319807ad50 msgr2=0x7f319807d260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:53:13.524 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:13.521+0000 7f31bc112640 1 --2- 172.21.15.150:0/1065029637 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f319807ad50 0x7f319807d260 secure :-1 s=READY pgs=774 cs=0 l=1 rev1=1 crypto rx=0x7f31b0034000 tx=0x7f31b0004730 comp rx=0 tx=0).stop 2024-09-17T05:53:13.524 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:13.521+0000 7f31bc112640 1 -- 172.21.15.150:0/1065029637 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f31b40d1190 msgr2=0x7f31b40b5d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:53:13.524 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:13.521+0000 7f31bc112640 1 --2- 172.21.15.150:0/1065029637 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f31b40d1190 0x7f31b40b5d00 secure :-1 s=READY pgs=1822 cs=0 l=1 rev1=1 crypto rx=0x7f31ac00ea40 tx=0x7f31ac00ef00 comp rx=0 tx=0).stop 2024-09-17T05:53:13.524 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:13.521+0000 7f31bc112640 1 -- 172.21.15.150:0/1065029637 shutdown_connections 2024-09-17T05:53:13.524 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:13.521+0000 7f31bc112640 1 --2- 172.21.15.150:0/1065029637 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f319807ad50 0x7f319807d260 unknown :-1 s=CLOSED pgs=774 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:53:13.525 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:13.521+0000 7f31bc112640 1 --2- 172.21.15.150:0/1065029637 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f31b40d1190 0x7f31b40b5d00 unknown :-1 s=CLOSED pgs=1822 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:53:13.525 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:13.521+0000 7f31bc112640 1 --2- 172.21.15.150:0/1065029637 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f31b40b7d70 0x7f31b4151910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:53:13.525 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:13.522+0000 7f31bc112640 1 --2- 172.21.15.150:0/1065029637 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f31b40b7960 0x7f31b41f7b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:53:13.525 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:13.522+0000 7f31bc112640 1 -- 172.21.15.150:0/1065029637 >> 172.21.15.150:0/1065029637 conn(0x7f31b40cef20 msgr2=0x7f31b40b0af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:53:13.525 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:13.522+0000 7f31bc112640 1 -- 172.21.15.150:0/1065029637 shutdown_connections 2024-09-17T05:53:13.525 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:13.522+0000 7f31bc112640 1 -- 172.21.15.150:0/1065029637 wait complete. 2024-09-17T05:53:13.552 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-09-17T05:53:13.675 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:13.672+0000 7f2dc02c5640 1 -- 172.21.15.150:0/4234312829 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2da40039e0 msgr2=0x7f2da4003e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:53:13.675 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:13.672+0000 7f2dc02c5640 1 --2- 172.21.15.150:0/4234312829 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2da40039e0 0x7f2da4003e10 secure :-1 s=READY pgs=1824 cs=0 l=1 rev1=1 crypto rx=0x7f2db400c260 tx=0x7f2da4005830 comp rx=0 tx=0).stop 2024-09-17T05:53:13.675 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:13.672+0000 7f2dbe862640 1 -- 172.21.15.150:0/4234312829 reap_dead start 2024-09-17T05:53:13.675 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:13.672+0000 7f2dc02c5640 1 -- 172.21.15.150:0/4234312829 shutdown_connections 2024-09-17T05:53:13.675 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:13.672+0000 7f2dc02c5640 1 -- 172.21.15.150:0/4234312829 >> 172.21.15.150:0/4234312829 conn(0x7f2db80cef20 msgr2=0x7f2db80cf330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:53:13.676 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:13.672+0000 7f2dc02c5640 1 -- 172.21.15.150:0/4234312829 shutdown_connections 2024-09-17T05:53:13.676 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:13.672+0000 7f2dc02c5640 1 -- 172.21.15.150:0/4234312829 wait complete. 2024-09-17T05:53:13.678 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:13.674+0000 7f2dc02c5640 1 Processor -- start 2024-09-17T05:53:13.678 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:13.674+0000 7f2dc02c5640 1 -- start start 2024-09-17T05:53:13.678 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:13.675+0000 7f2dc02c5640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2da40039e0 0x7f2db814aa50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:53:13.678 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:13.675+0000 7f2dc02c5640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2db815eea0 0x7f2db81f45d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:53:13.678 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:13.675+0000 7f2dc02c5640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2db81f6c70 0x7f2db81f7080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:53:13.678 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:13.675+0000 7f2dc02c5640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f2db80af900 con 0x7f2db81f6c70 2024-09-17T05:53:13.678 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:13.675+0000 7f2dc02c5640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f2db80ceb90 con 0x7f2db815eea0 2024-09-17T05:53:13.679 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:13.675+0000 7f2dc02c5640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f2db81f5130 con 0x7f2da40039e0 2024-09-17T05:53:13.679 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:13.675+0000 7f2dbe862640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2db81f6c70 0x7f2db81f7080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:53:13.681 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:13.675+0000 7f2dbe862640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2db81f6c70 0x7f2db81f7080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:34866/0 (socket says 172.21.15.150:34866) 2024-09-17T05:53:13.681 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:13.675+0000 7f2dbe862640 1 -- 172.21.15.150:0/352813679 learned_addr learned my addr 172.21.15.150:0/352813679 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:53:13.682 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:13.675+0000 7f2dbe061640 1 --2- 172.21.15.150:0/352813679 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2da40039e0 0x7f2db814aa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:53:13.682 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:13.675+0000 7f2dbd860640 1 --2- 172.21.15.150:0/352813679 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2db815eea0 0x7f2db81f45d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:53:13.682 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:13.676+0000 7f2dbe862640 1 -- 172.21.15.150:0/352813679 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2da40039e0 msgr2=0x7f2db814aa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:53:13.682 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:13.676+0000 7f2dbe862640 1 --2- 172.21.15.150:0/352813679 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2da40039e0 0x7f2db814aa50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:53:13.682 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:13.676+0000 7f2dbe862640 1 -- 172.21.15.150:0/352813679 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2db815eea0 msgr2=0x7f2db81f45d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:53:13.682 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:13.676+0000 7f2dbe862640 1 --2- 172.21.15.150:0/352813679 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2db815eea0 0x7f2db81f45d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:53:13.682 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:13.676+0000 7f2dbe862640 1 -- 172.21.15.150:0/352813679 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2db814af90 con 0x7f2db81f6c70 2024-09-17T05:53:13.682 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:13.676+0000 7f2dbe862640 1 --2- 172.21.15.150:0/352813679 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2db81f6c70 0x7f2db81f7080 secure :-1 s=READY pgs=1825 cs=0 l=1 rev1=1 crypto rx=0x7f2db0001520 tx=0x7f2db0006430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:53:13.682 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:13.676+0000 7f2daeffd640 1 -- 172.21.15.150:0/352813679 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2db0011900 con 0x7f2db81f6c70 2024-09-17T05:53:13.682 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:13.676+0000 7f2daeffd640 1 -- 172.21.15.150:0/352813679 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f2db0018070 con 0x7f2db81f6c70 2024-09-17T05:53:13.682 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:13.676+0000 7f2dc02c5640 1 -- 172.21.15.150:0/352813679 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2db815de00 con 0x7f2db81f6c70 2024-09-17T05:53:13.682 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:13.676+0000 7f2daeffd640 1 -- 172.21.15.150:0/352813679 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2db0011d40 con 0x7f2db81f6c70 2024-09-17T05:53:13.682 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:13.676+0000 7f2dc02c5640 1 -- 172.21.15.150:0/352813679 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2db815e3c0 con 0x7f2db81f6c70 2024-09-17T05:53:13.682 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:13.677+0000 7f2dc02c5640 1 -- 172.21.15.150:0/352813679 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2db80d0b60 con 0x7f2db81f6c70 2024-09-17T05:53:13.683 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:13.678+0000 7f2daeffd640 1 -- 172.21.15.150:0/352813679 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 45) ==== 104501+0+0 (secure 0 0 0) 0x7f2db001d460 con 0x7f2db81f6c70 2024-09-17T05:53:13.683 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:13.679+0000 7f2daeffd640 1 --2- 172.21.15.150:0/352813679 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f2d9c07ad50 0x7f2d9c07d260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:53:13.683 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:13.679+0000 7f2daeffd640 1 -- 172.21.15.150:0/352813679 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(139..139 src has 1..139) ==== 5805+0+0 (secure 0 0 0) 0x7f2db009a660 con 0x7f2db81f6c70 2024-09-17T05:53:13.683 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:13.679+0000 7f2dbe061640 1 --2- 172.21.15.150:0/352813679 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f2d9c07ad50 0x7f2d9c07d260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:53:13.683 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:13.679+0000 7f2dbe061640 1 --2- 172.21.15.150:0/352813679 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f2d9c07ad50 0x7f2d9c07d260 secure :-1 s=READY pgs=775 cs=0 l=1 rev1=1 crypto rx=0x7f2db4033000 tx=0x7f2db402d000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:53:13.685 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:13.683+0000 7f2daeffd640 1 -- 172.21.15.150:0/352813679 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f2db814af90 con 0x7f2db81f6c70 2024-09-17T05:53:13.899 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:13.898+0000 7f2dc02c5640 1 -- 172.21.15.150:0/352813679 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7f2db80b2d50 con 0x7f2db81f6c70 2024-09-17T05:53:14.521 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:14.519+0000 7f2daeffd640 1 -- 172.21.15.150:0/352813679 <== mon.0 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 20 and data pool 21 v86) ==== 174+0+0 (secure 0 0 0) 0x7f2db00645a0 con 0x7f2db81f6c70 2024-09-17T05:53:14.521 INFO:teuthology.orchestra.run.smithi150.stderr:new fs with metadata pool 20 and data pool 21 2024-09-17T05:53:14.525 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:14.524+0000 7f2dc02c5640 1 -- 172.21.15.150:0/352813679 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f2d9c07ad50 msgr2=0x7f2d9c07d260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:53:14.525 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:14.524+0000 7f2dc02c5640 1 --2- 172.21.15.150:0/352813679 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f2d9c07ad50 0x7f2d9c07d260 secure :-1 s=READY pgs=775 cs=0 l=1 rev1=1 crypto rx=0x7f2db4033000 tx=0x7f2db402d000 comp rx=0 tx=0).stop 2024-09-17T05:53:14.526 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:14.524+0000 7f2dc02c5640 1 -- 172.21.15.150:0/352813679 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2db81f6c70 msgr2=0x7f2db81f7080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:53:14.526 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:14.524+0000 7f2dc02c5640 1 --2- 172.21.15.150:0/352813679 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2db81f6c70 0x7f2db81f7080 secure :-1 s=READY pgs=1825 cs=0 l=1 rev1=1 crypto rx=0x7f2db0001520 tx=0x7f2db0006430 comp rx=0 tx=0).stop 2024-09-17T05:53:14.526 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:14.524+0000 7f2dc02c5640 1 -- 172.21.15.150:0/352813679 shutdown_connections 2024-09-17T05:53:14.526 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:14.524+0000 7f2dc02c5640 1 --2- 172.21.15.150:0/352813679 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2db815eea0 0x7f2db81f45d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:53:14.526 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:14.524+0000 7f2dc02c5640 1 --2- 172.21.15.150:0/352813679 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f2d9c07ad50 0x7f2d9c07d260 unknown :-1 s=CLOSED pgs=775 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:53:14.526 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:14.524+0000 7f2dc02c5640 1 --2- 172.21.15.150:0/352813679 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2db81f6c70 0x7f2db81f7080 unknown :-1 s=CLOSED pgs=1825 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:53:14.526 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:14.524+0000 7f2dc02c5640 1 --2- 172.21.15.150:0/352813679 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2da40039e0 0x7f2db814aa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:53:14.526 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:14.524+0000 7f2dc02c5640 1 -- 172.21.15.150:0/352813679 >> 172.21.15.150:0/352813679 conn(0x7f2db80cef20 msgr2=0x7f2db80b3270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:53:14.527 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:14.525+0000 7f2dc02c5640 1 -- 172.21.15.150:0/352813679 shutdown_connections 2024-09-17T05:53:14.527 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:14.525+0000 7f2dc02c5640 1 -- 172.21.15.150:0/352813679 wait complete. 2024-09-17T05:53:14.548 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T05:53:14.664 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:14.662+0000 7f30bc32b640 1 -- 172.21.15.150:0/1962380478 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f30a0004d40 msgr2=0x7f30a0005150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:53:14.665 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:14.662+0000 7f30bc32b640 1 --2- 172.21.15.150:0/1962380478 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f30a0004d40 0x7f30a0005150 secure :-1 s=READY pgs=1827 cs=0 l=1 rev1=1 crypto rx=0x7f30ac005fd0 tx=0x7f30a0005830 comp rx=0 tx=0).stop 2024-09-17T05:53:14.665 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:14.662+0000 7f30ba8c8640 1 -- 172.21.15.150:0/1962380478 reap_dead start 2024-09-17T05:53:14.665 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:14.662+0000 7f30bc32b640 1 -- 172.21.15.150:0/1962380478 shutdown_connections 2024-09-17T05:53:14.665 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:14.662+0000 7f30bc32b640 1 -- 172.21.15.150:0/1962380478 >> 172.21.15.150:0/1962380478 conn(0x7f30b408bfe0 msgr2=0x7f30b40d4650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:53:14.665 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:14.662+0000 7f30bc32b640 1 -- 172.21.15.150:0/1962380478 shutdown_connections 2024-09-17T05:53:14.665 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:14.662+0000 7f30bc32b640 1 -- 172.21.15.150:0/1962380478 wait complete. 2024-09-17T05:53:14.666 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:14.664+0000 7f30bc32b640 1 Processor -- start 2024-09-17T05:53:14.666 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:14.664+0000 7f30bc32b640 1 -- start start 2024-09-17T05:53:14.669 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:14.665+0000 7f30bc32b640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f30a0004d40 0x7f30b414db80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:53:14.669 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:14.665+0000 7f30bc32b640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f30b41f92e0 0x7f30b41f96f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:53:14.669 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:14.665+0000 7f30bc32b640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f30b40b8930 0x7f30b40b8d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:53:14.669 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:14.666+0000 7f30bc32b640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f30b40d33b0 con 0x7f30a0004d40 2024-09-17T05:53:14.669 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:14.666+0000 7f30bc32b640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f30b40d3230 con 0x7f30b41f92e0 2024-09-17T05:53:14.669 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:14.666+0000 7f30bc32b640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f30b40b3f70 con 0x7f30b40b8930 2024-09-17T05:53:14.669 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:14.666+0000 7f30ba0c7640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f30a0004d40 0x7f30b414db80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:53:14.669 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:14.666+0000 7f30ba0c7640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f30a0004d40 0x7f30b414db80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:34876/0 (socket says 172.21.15.150:34876) 2024-09-17T05:53:14.669 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:14.666+0000 7f30ba0c7640 1 -- 172.21.15.150:0/2480757019 learned_addr learned my addr 172.21.15.150:0/2480757019 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:53:14.669 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:14.666+0000 7f30b98c6640 1 --2- 172.21.15.150:0/2480757019 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f30b41f92e0 0x7f30b41f96f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:53:14.669 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:14.666+0000 7f30ba8c8640 1 --2- 172.21.15.150:0/2480757019 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f30b40b8930 0x7f30b40b8d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:53:14.670 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:14.666+0000 7f30ba0c7640 1 -- 172.21.15.150:0/2480757019 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f30b40b8930 msgr2=0x7f30b40b8d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:53:14.670 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:14.666+0000 7f30ba0c7640 1 --2- 172.21.15.150:0/2480757019 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f30b40b8930 0x7f30b40b8d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:53:14.670 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:14.666+0000 7f30ba0c7640 1 -- 172.21.15.150:0/2480757019 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f30b41f92e0 msgr2=0x7f30b41f96f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:53:14.670 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:14.666+0000 7f30ba0c7640 1 --2- 172.21.15.150:0/2480757019 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f30b41f92e0 0x7f30b41f96f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:53:14.670 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:14.666+0000 7f30ba0c7640 1 -- 172.21.15.150:0/2480757019 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f30b41fa240 con 0x7f30a0004d40 2024-09-17T05:53:14.670 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:14.666+0000 7f30ba8c8640 1 --2- 172.21.15.150:0/2480757019 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f30b40b8930 0x7f30b40b8d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T05:53:14.670 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:14.666+0000 7f30ba0c7640 1 --2- 172.21.15.150:0/2480757019 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f30a0004d40 0x7f30b414db80 secure :-1 s=READY pgs=1828 cs=0 l=1 rev1=1 crypto rx=0x7f30b0010a70 tx=0x7f30b0010f30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:53:14.670 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:14.666+0000 7f30aaffd640 1 -- 172.21.15.150:0/2480757019 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30b000eb90 con 0x7f30a0004d40 2024-09-17T05:53:14.670 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:14.666+0000 7f30aaffd640 1 -- 172.21.15.150:0/2480757019 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f30b000ed30 con 0x7f30a0004d40 2024-09-17T05:53:14.670 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:14.666+0000 7f30bc32b640 1 -- 172.21.15.150:0/2480757019 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f30b40b9280 con 0x7f30a0004d40 2024-09-17T05:53:14.670 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:14.666+0000 7f30aaffd640 1 -- 172.21.15.150:0/2480757019 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30b0011680 con 0x7f30a0004d40 2024-09-17T05:53:14.670 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:14.666+0000 7f30bc32b640 1 -- 172.21.15.150:0/2480757019 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f30b415e4e0 con 0x7f30a0004d40 2024-09-17T05:53:14.670 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:14.667+0000 7f30bc32b640 1 -- 172.21.15.150:0/2480757019 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f30b40d1430 con 0x7f30a0004d40 2024-09-17T05:53:14.671 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:14.668+0000 7f30aaffd640 1 -- 172.21.15.150:0/2480757019 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 45) ==== 104501+0+0 (secure 0 0 0) 0x7f30b0011820 con 0x7f30a0004d40 2024-09-17T05:53:14.672 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:14.668+0000 7f30aaffd640 1 --2- 172.21.15.150:0/2480757019 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f309807ad50 0x7f309807d260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:53:14.672 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:14.669+0000 7f30aaffd640 1 -- 172.21.15.150:0/2480757019 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(140..140 src has 1..140) ==== 5905+0+0 (secure 0 0 0) 0x7f30b009acb0 con 0x7f30a0004d40 2024-09-17T05:53:14.672 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:14.669+0000 7f30b98c6640 1 --2- 172.21.15.150:0/2480757019 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f309807ad50 0x7f309807d260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:53:14.672 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:14.669+0000 7f30b98c6640 1 --2- 172.21.15.150:0/2480757019 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f309807ad50 0x7f309807d260 secure :-1 s=READY pgs=776 cs=0 l=1 rev1=1 crypto rx=0x7f30a4000f60 tx=0x7f30a4000ed0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:53:14.675 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:14.673+0000 7f30aaffd640 1 -- 172.21.15.150:0/2480757019 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f30b40b9280 con 0x7f30a0004d40 2024-09-17T05:53:14.853 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:14.851+0000 7f30bc32b640 1 -- 172.21.15.150:0/2480757019 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f30b40d04f0 con 0x7f30a0004d40 2024-09-17T05:53:14.854 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:14.852+0000 7f30aaffd640 1 -- 172.21.15.150:0/2480757019 <== mon.0 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v140) ==== 74+0+17100 (secure 0 0 0) 0x7f30b0064c80 con 0x7f30a0004d40 2024-09-17T05:53:14.855 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-09-17T05:53:14.855 INFO:teuthology.orchestra.run.smithi150.stdout:{"epoch":140,"fsid":"9f2e05e9-d629-47b3-b26b-1360655b7d20","created":"2024-09-17T05:41:32.502979+0000","modified":"2024-09-17T05:53:13.900149+0000","last_up_change":"2024-09-17T05:41:46.150225+0000","last_in_change":"2024-09-17T05:41:36.120274+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":21,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T05:41:46.860779+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":20,"pool_name":"cephfs_metadata","create_time":"2024-09-17T05:53:11.522067+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"140","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":21,"pool_name":"cephfs_data","create_time":"2024-09-17T05:53:12.853902+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"140","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"4f31c018-c8a4-4d6d-b0c2-a597c47aae4a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":139,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6800","nonce":479374392},{"type":"v1","addr":"172.21.15.150:6801","nonce":479374392}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6802","nonce":479374392},{"type":"v1","addr":"172.21.15.150:6803","nonce":479374392}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6806","nonce":479374392},{"type":"v1","addr":"172.21.15.150:6807","nonce":479374392}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6804","nonce":479374392},{"type":"v1","addr":"172.21.15.150:6805","nonce":479374392}]},"public_addr":"172.21.15.150:6801/479374392","cluster_addr":"172.21.15.150:6803/479374392","heartbeat_back_addr":"172.21.15.150:6807/479374392","heartbeat_front_addr":"172.21.15.150:6805/479374392","state":["exists","up"]},{"osd":1,"uuid":"6ff4a573-500b-4e04-9de3-39265ead78b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":139,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6824","nonce":913899800},{"type":"v1","addr":"172.21.15.150:6825","nonce":913899800}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6826","nonce":913899800},{"type":"v1","addr":"172.21.15.150:6827","nonce":913899800}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6830","nonce":913899800},{"type":"v1","addr":"172.21.15.150:6831","nonce":913899800}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6828","nonce":913899800},{"type":"v1","addr":"172.21.15.150:6829","nonce":913899800}]},"public_addr":"172.21.15.150:6825/913899800","cluster_addr":"172.21.15.150:6827/913899800","heartbeat_back_addr":"172.21.15.150:6831/913899800","heartbeat_front_addr":"172.21.15.150:6829/913899800","state":["exists","up"]},{"osd":2,"uuid":"bffea6f9-2465-4182-b205-00436c41ac1c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":139,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6816","nonce":363718461},{"type":"v1","addr":"172.21.15.150:6817","nonce":363718461}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6818","nonce":363718461},{"type":"v1","addr":"172.21.15.150:6819","nonce":363718461}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6822","nonce":363718461},{"type":"v1","addr":"172.21.15.150:6823","nonce":363718461}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6820","nonce":363718461},{"type":"v1","addr":"172.21.15.150:6821","nonce":363718461}]},"public_addr":"172.21.15.150:6817/363718461","cluster_addr":"172.21.15.150:6819/363718461","heartbeat_back_addr":"172.21.15.150:6823/363718461","heartbeat_front_addr":"172.21.15.150:6821/363718461","state":["exists","up"]},{"osd":3,"uuid":"cda70430-d1e1-427e-b04e-56db4031d078","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":139,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6808","nonce":3550994626},{"type":"v1","addr":"172.21.15.150:6809","nonce":3550994626}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6810","nonce":3550994626},{"type":"v1","addr":"172.21.15.150:6811","nonce":3550994626}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6814","nonce":3550994626},{"type":"v1","addr":"172.21.15.150:6815","nonce":3550994626}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6812","nonce":3550994626},{"type":"v1","addr":"172.21.15.150:6813","nonce":3550994626}]},"public_addr":"172.21.15.150:6809/3550994626","cluster_addr":"172.21.15.150:6811/3550994626","heartbeat_back_addr":"172.21.15.150:6815/3550994626","heartbeat_front_addr":"172.21.15.150:6813/3550994626","state":["exists","up"]},{"osd":4,"uuid":"3a0277fb-5e1e-4f68-bb2d-9a8a0152f64a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":139,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6810","nonce":2718261497},{"type":"v1","addr":"172.21.15.176:6811","nonce":2718261497}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6812","nonce":2718261497},{"type":"v1","addr":"172.21.15.176:6813","nonce":2718261497}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6816","nonce":2718261497},{"type":"v1","addr":"172.21.15.176:6817","nonce":2718261497}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6814","nonce":2718261497},{"type":"v1","addr":"172.21.15.176:6815","nonce":2718261497}]},"public_addr":"172.21.15.176:6811/2718261497","cluster_addr":"172.21.15.176:6813/2718261497","heartbeat_back_addr":"172.21.15.176:6817/2718261497","heartbeat_front_addr":"172.21.15.176:6815/2718261497","state":["exists","up"]},{"osd":5,"uuid":"33aebee6-0315-40b7-a11c-6702f0be494d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":139,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6818","nonce":2049295774},{"type":"v1","addr":"172.21.15.176:6819","nonce":2049295774}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6820","nonce":2049295774},{"type":"v1","addr":"172.21.15.176:6821","nonce":2049295774}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6824","nonce":2049295774},{"type":"v1","addr":"172.21.15.176:6825","nonce":2049295774}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6822","nonce":2049295774},{"type":"v1","addr":"172.21.15.176:6823","nonce":2049295774}]},"public_addr":"172.21.15.176:6819/2049295774","cluster_addr":"172.21.15.176:6821/2049295774","heartbeat_back_addr":"172.21.15.176:6825/2049295774","heartbeat_front_addr":"172.21.15.176:6823/2049295774","state":["exists","up"]},{"osd":6,"uuid":"4d24f360-6751-4263-841b-d77793d33540","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":139,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6826","nonce":2164458476},{"type":"v1","addr":"172.21.15.176:6827","nonce":2164458476}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6828","nonce":2164458476},{"type":"v1","addr":"172.21.15.176:6829","nonce":2164458476}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6832","nonce":2164458476},{"type":"v1","addr":"172.21.15.176:6833","nonce":2164458476}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6830","nonce":2164458476},{"type":"v1","addr":"172.21.15.176:6831","nonce":2164458476}]},"public_addr":"172.21.15.176:6827/2164458476","cluster_addr":"172.21.15.176:6829/2164458476","heartbeat_back_addr":"172.21.15.176:6833/2164458476","heartbeat_front_addr":"172.21.15.176:6831/2164458476","state":["exists","up"]},{"osd":7,"uuid":"c8594fda-c74a-4ba9-8277-caf101d58ca1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":139,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6802","nonce":3239587708},{"type":"v1","addr":"172.21.15.176:6803","nonce":3239587708}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6804","nonce":3239587708},{"type":"v1","addr":"172.21.15.176:6805","nonce":3239587708}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6808","nonce":3239587708},{"type":"v1","addr":"172.21.15.176:6809","nonce":3239587708}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6806","nonce":3239587708},{"type":"v1","addr":"172.21.15.176:6807","nonce":3239587708}]},"public_addr":"172.21.15.176:6803/3239587708","cluster_addr":"172.21.15.176:6805/3239587708","heartbeat_back_addr":"172.21.15.176:6809/3239587708","heartbeat_front_addr":"172.21.15.176:6807/3239587708","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:41:41.905151+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:41:42.705679+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:41:42.459673+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:41:42.440819+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:41:42.668428+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:41:42.694972+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:41:43.078535+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:41:42.363539+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":7,"snaps":[{"begin":2,"length":2}]},{"pool":9,"snaps":[{"begin":2,"length":2}]},{"pool":11,"snaps":[{"begin":2,"length":2}]},{"pool":13,"snaps":[{"begin":2,"length":2}]},{"pool":15,"snaps":[{"begin":2,"length":2}]},{"pool":17,"snaps":[{"begin":2,"length":2}]},{"pool":19,"snaps":[{"begin":2,"length":2}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T05:53:14.857 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:14.855+0000 7f30bc32b640 1 -- 172.21.15.150:0/2480757019 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f309807ad50 msgr2=0x7f309807d260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:53:14.857 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:14.855+0000 7f30bc32b640 1 --2- 172.21.15.150:0/2480757019 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f309807ad50 0x7f309807d260 secure :-1 s=READY pgs=776 cs=0 l=1 rev1=1 crypto rx=0x7f30a4000f60 tx=0x7f30a4000ed0 comp rx=0 tx=0).stop 2024-09-17T05:53:14.857 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:14.855+0000 7f30bc32b640 1 -- 172.21.15.150:0/2480757019 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f30a0004d40 msgr2=0x7f30b414db80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:53:14.857 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:14.855+0000 7f30bc32b640 1 --2- 172.21.15.150:0/2480757019 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f30a0004d40 0x7f30b414db80 secure :-1 s=READY pgs=1828 cs=0 l=1 rev1=1 crypto rx=0x7f30b0010a70 tx=0x7f30b0010f30 comp rx=0 tx=0).stop 2024-09-17T05:53:14.857 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:14.855+0000 7f30bc32b640 1 -- 172.21.15.150:0/2480757019 shutdown_connections 2024-09-17T05:53:14.857 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:14.855+0000 7f30bc32b640 1 --2- 172.21.15.150:0/2480757019 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f30b41f92e0 0x7f30b41f96f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:53:14.857 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:14.855+0000 7f30bc32b640 1 --2- 172.21.15.150:0/2480757019 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f309807ad50 0x7f309807d260 unknown :-1 s=CLOSED pgs=776 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:53:14.857 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:14.855+0000 7f30bc32b640 1 --2- 172.21.15.150:0/2480757019 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f30b40b8930 0x7f30b40b8d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:53:14.857 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:14.855+0000 7f30bc32b640 1 --2- 172.21.15.150:0/2480757019 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f30a0004d40 0x7f30b414db80 unknown :-1 s=CLOSED pgs=1828 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:53:14.858 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:14.855+0000 7f30bc32b640 1 -- 172.21.15.150:0/2480757019 >> 172.21.15.150:0/2480757019 conn(0x7f30b408bfe0 msgr2=0x7f30b40b3270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:53:14.858 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:14.855+0000 7f30bc32b640 1 -- 172.21.15.150:0/2480757019 shutdown_connections 2024-09-17T05:53:14.858 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:14.855+0000 7f30bc32b640 1 -- 172.21.15.150:0/2480757019 wait complete. 2024-09-17T05:53:14.869 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T05:53:14.982 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:14.980+0000 7fd428f2b640 1 -- 172.21.15.150:0/1608540509 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd40c004d40 msgr2=0x7fd40c005150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:53:14.982 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:14.980+0000 7fd428f2b640 1 --2- 172.21.15.150:0/1608540509 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd40c004d40 0x7fd40c005150 secure :-1 s=READY pgs=1830 cs=0 l=1 rev1=1 crypto rx=0x7fd4240cd0b0 tx=0x7fd40c005830 comp rx=0 tx=0).stop 2024-09-17T05:53:14.982 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:14.980+0000 7fd422d9d640 1 -- 172.21.15.150:0/1608540509 reap_dead start 2024-09-17T05:53:14.982 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:14.980+0000 7fd428f2b640 1 -- 172.21.15.150:0/1608540509 shutdown_connections 2024-09-17T05:53:14.982 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:14.980+0000 7fd428f2b640 1 -- 172.21.15.150:0/1608540509 >> 172.21.15.150:0/1608540509 conn(0x7fd4240b2e80 msgr2=0x7fd4240b3290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:53:14.982 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:14.980+0000 7fd428f2b640 1 -- 172.21.15.150:0/1608540509 shutdown_connections 2024-09-17T05:53:14.982 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:14.980+0000 7fd428f2b640 1 -- 172.21.15.150:0/1608540509 wait complete. 2024-09-17T05:53:14.983 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:14.982+0000 7fd428f2b640 1 Processor -- start 2024-09-17T05:53:14.983 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:14.982+0000 7fd428f2b640 1 -- start start 2024-09-17T05:53:14.986 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:14.983+0000 7fd428f2b640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd40c004d40 0x7fd42414aec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:53:14.986 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:14.983+0000 7fd428f2b640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd4240b15a0 0x7fd42409e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:53:14.986 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:14.983+0000 7fd428f2b640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd42409e880 0x7fd4241f5550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:53:14.986 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:14.983+0000 7fd428f2b640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7fd4240b6b30 con 0x7fd42409e880 2024-09-17T05:53:14.986 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:14.983+0000 7fd428f2b640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fd4240b69b0 con 0x7fd4240b15a0 2024-09-17T05:53:14.986 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:14.983+0000 7fd428f2b640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fd4240b6cb0 con 0x7fd40c004d40 2024-09-17T05:53:14.987 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:14.983+0000 7fd422d9d640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd42409e880 0x7fd4241f5550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:53:14.987 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:14.983+0000 7fd422d9d640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd42409e880 0x7fd4241f5550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:34884/0 (socket says 172.21.15.150:34884) 2024-09-17T05:53:14.987 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:14.983+0000 7fd422d9d640 1 -- 172.21.15.150:0/2647048294 learned_addr learned my addr 172.21.15.150:0/2647048294 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:53:14.987 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:14.983+0000 7fd42259c640 1 --2- 172.21.15.150:0/2647048294 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd40c004d40 0x7fd42414aec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:53:14.987 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:14.983+0000 7fd421d9b640 1 --2- 172.21.15.150:0/2647048294 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd4240b15a0 0x7fd42409e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:53:14.987 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:14.984+0000 7fd422d9d640 1 -- 172.21.15.150:0/2647048294 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd40c004d40 msgr2=0x7fd42414aec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:53:14.987 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:14.984+0000 7fd422d9d640 1 --2- 172.21.15.150:0/2647048294 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd40c004d40 0x7fd42414aec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:53:14.987 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:14.984+0000 7fd422d9d640 1 -- 172.21.15.150:0/2647048294 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd4240b15a0 msgr2=0x7fd42409e340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:53:14.987 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:14.984+0000 7fd422d9d640 1 --2- 172.21.15.150:0/2647048294 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd4240b15a0 0x7fd42409e340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:53:14.987 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:14.984+0000 7fd422d9d640 1 -- 172.21.15.150:0/2647048294 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd42414e860 con 0x7fd42409e880 2024-09-17T05:53:14.987 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:14.984+0000 7fd422d9d640 1 --2- 172.21.15.150:0/2647048294 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd42409e880 0x7fd4241f5550 secure :-1 s=READY pgs=1831 cs=0 l=1 rev1=1 crypto rx=0x7fd41c02b0f0 tx=0x7fd41c036c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:53:14.987 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:14.984+0000 7fd412ffd640 1 -- 172.21.15.150:0/2647048294 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd41c031070 con 0x7fd42409e880 2024-09-17T05:53:14.987 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:14.984+0000 7fd412ffd640 1 -- 172.21.15.150:0/2647048294 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd41c001510 con 0x7fd42409e880 2024-09-17T05:53:14.988 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:14.984+0000 7fd428f2b640 1 -- 172.21.15.150:0/2647048294 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd42409ec90 con 0x7fd42409e880 2024-09-17T05:53:14.988 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:14.984+0000 7fd412ffd640 1 -- 172.21.15.150:0/2647048294 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd41c006c50 con 0x7fd42409e880 2024-09-17T05:53:14.988 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:14.984+0000 7fd428f2b640 1 -- 172.21.15.150:0/2647048294 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd42414dfc0 con 0x7fd42409e880 2024-09-17T05:53:14.988 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:14.985+0000 7fd428f2b640 1 -- 172.21.15.150:0/2647048294 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd4240cde30 con 0x7fd42409e880 2024-09-17T05:53:14.989 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:14.986+0000 7fd412ffd640 1 -- 172.21.15.150:0/2647048294 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 45) ==== 104501+0+0 (secure 0 0 0) 0x7fd41c034070 con 0x7fd42409e880 2024-09-17T05:53:14.989 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:14.986+0000 7fd412ffd640 1 --2- 172.21.15.150:0/2647048294 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fd40407ad50 0x7fd40407d260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:53:14.989 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:14.987+0000 7fd412ffd640 1 -- 172.21.15.150:0/2647048294 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(140..140 src has 1..140) ==== 5905+0+0 (secure 0 0 0) 0x7fd41c0b9920 con 0x7fd42409e880 2024-09-17T05:53:14.989 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:14.987+0000 7fd42259c640 1 --2- 172.21.15.150:0/2647048294 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fd40407ad50 0x7fd40407d260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:53:14.989 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:14.987+0000 7fd42259c640 1 --2- 172.21.15.150:0/2647048294 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fd40407ad50 0x7fd40407d260 secure :-1 s=READY pgs=777 cs=0 l=1 rev1=1 crypto rx=0x7fd414005fd0 tx=0x7fd414009500 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:53:14.993 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:14.991+0000 7fd412ffd640 1 -- 172.21.15.150:0/2647048294 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fd42409ec90 con 0x7fd42409e880 2024-09-17T05:53:15.168 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:15.166+0000 7fd428f2b640 1 -- 172.21.15.150:0/2647048294 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fd42415ba70 con 0x7fd42409e880 2024-09-17T05:53:15.169 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:15.167+0000 7fd412ffd640 1 -- 172.21.15.150:0/2647048294 <== mon.0 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v140) ==== 74+0+17100 (secure 0 0 0) 0x7fd41c006630 con 0x7fd42409e880 2024-09-17T05:53:15.169 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-09-17T05:53:15.171 INFO:teuthology.orchestra.run.smithi150.stdout:{"epoch":140,"fsid":"9f2e05e9-d629-47b3-b26b-1360655b7d20","created":"2024-09-17T05:41:32.502979+0000","modified":"2024-09-17T05:53:13.900149+0000","last_up_change":"2024-09-17T05:41:46.150225+0000","last_in_change":"2024-09-17T05:41:36.120274+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":21,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T05:41:46.860779+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":20,"pool_name":"cephfs_metadata","create_time":"2024-09-17T05:53:11.522067+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"140","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":21,"pool_name":"cephfs_data","create_time":"2024-09-17T05:53:12.853902+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"140","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"4f31c018-c8a4-4d6d-b0c2-a597c47aae4a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":139,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6800","nonce":479374392},{"type":"v1","addr":"172.21.15.150:6801","nonce":479374392}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6802","nonce":479374392},{"type":"v1","addr":"172.21.15.150:6803","nonce":479374392}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6806","nonce":479374392},{"type":"v1","addr":"172.21.15.150:6807","nonce":479374392}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6804","nonce":479374392},{"type":"v1","addr":"172.21.15.150:6805","nonce":479374392}]},"public_addr":"172.21.15.150:6801/479374392","cluster_addr":"172.21.15.150:6803/479374392","heartbeat_back_addr":"172.21.15.150:6807/479374392","heartbeat_front_addr":"172.21.15.150:6805/479374392","state":["exists","up"]},{"osd":1,"uuid":"6ff4a573-500b-4e04-9de3-39265ead78b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":139,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6824","nonce":913899800},{"type":"v1","addr":"172.21.15.150:6825","nonce":913899800}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6826","nonce":913899800},{"type":"v1","addr":"172.21.15.150:6827","nonce":913899800}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6830","nonce":913899800},{"type":"v1","addr":"172.21.15.150:6831","nonce":913899800}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6828","nonce":913899800},{"type":"v1","addr":"172.21.15.150:6829","nonce":913899800}]},"public_addr":"172.21.15.150:6825/913899800","cluster_addr":"172.21.15.150:6827/913899800","heartbeat_back_addr":"172.21.15.150:6831/913899800","heartbeat_front_addr":"172.21.15.150:6829/913899800","state":["exists","up"]},{"osd":2,"uuid":"bffea6f9-2465-4182-b205-00436c41ac1c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":139,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6816","nonce":363718461},{"type":"v1","addr":"172.21.15.150:6817","nonce":363718461}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6818","nonce":363718461},{"type":"v1","addr":"172.21.15.150:6819","nonce":363718461}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6822","nonce":363718461},{"type":"v1","addr":"172.21.15.150:6823","nonce":363718461}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6820","nonce":363718461},{"type":"v1","addr":"172.21.15.150:6821","nonce":363718461}]},"public_addr":"172.21.15.150:6817/363718461","cluster_addr":"172.21.15.150:6819/363718461","heartbeat_back_addr":"172.21.15.150:6823/363718461","heartbeat_front_addr":"172.21.15.150:6821/363718461","state":["exists","up"]},{"osd":3,"uuid":"cda70430-d1e1-427e-b04e-56db4031d078","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":139,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6808","nonce":3550994626},{"type":"v1","addr":"172.21.15.150:6809","nonce":3550994626}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6810","nonce":3550994626},{"type":"v1","addr":"172.21.15.150:6811","nonce":3550994626}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6814","nonce":3550994626},{"type":"v1","addr":"172.21.15.150:6815","nonce":3550994626}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6812","nonce":3550994626},{"type":"v1","addr":"172.21.15.150:6813","nonce":3550994626}]},"public_addr":"172.21.15.150:6809/3550994626","cluster_addr":"172.21.15.150:6811/3550994626","heartbeat_back_addr":"172.21.15.150:6815/3550994626","heartbeat_front_addr":"172.21.15.150:6813/3550994626","state":["exists","up"]},{"osd":4,"uuid":"3a0277fb-5e1e-4f68-bb2d-9a8a0152f64a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":139,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6810","nonce":2718261497},{"type":"v1","addr":"172.21.15.176:6811","nonce":2718261497}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6812","nonce":2718261497},{"type":"v1","addr":"172.21.15.176:6813","nonce":2718261497}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6816","nonce":2718261497},{"type":"v1","addr":"172.21.15.176:6817","nonce":2718261497}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6814","nonce":2718261497},{"type":"v1","addr":"172.21.15.176:6815","nonce":2718261497}]},"public_addr":"172.21.15.176:6811/2718261497","cluster_addr":"172.21.15.176:6813/2718261497","heartbeat_back_addr":"172.21.15.176:6817/2718261497","heartbeat_front_addr":"172.21.15.176:6815/2718261497","state":["exists","up"]},{"osd":5,"uuid":"33aebee6-0315-40b7-a11c-6702f0be494d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":139,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6818","nonce":2049295774},{"type":"v1","addr":"172.21.15.176:6819","nonce":2049295774}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6820","nonce":2049295774},{"type":"v1","addr":"172.21.15.176:6821","nonce":2049295774}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6824","nonce":2049295774},{"type":"v1","addr":"172.21.15.176:6825","nonce":2049295774}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6822","nonce":2049295774},{"type":"v1","addr":"172.21.15.176:6823","nonce":2049295774}]},"public_addr":"172.21.15.176:6819/2049295774","cluster_addr":"172.21.15.176:6821/2049295774","heartbeat_back_addr":"172.21.15.176:6825/2049295774","heartbeat_front_addr":"172.21.15.176:6823/2049295774","state":["exists","up"]},{"osd":6,"uuid":"4d24f360-6751-4263-841b-d77793d33540","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":139,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6826","nonce":2164458476},{"type":"v1","addr":"172.21.15.176:6827","nonce":2164458476}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6828","nonce":2164458476},{"type":"v1","addr":"172.21.15.176:6829","nonce":2164458476}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6832","nonce":2164458476},{"type":"v1","addr":"172.21.15.176:6833","nonce":2164458476}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6830","nonce":2164458476},{"type":"v1","addr":"172.21.15.176:6831","nonce":2164458476}]},"public_addr":"172.21.15.176:6827/2164458476","cluster_addr":"172.21.15.176:6829/2164458476","heartbeat_back_addr":"172.21.15.176:6833/2164458476","heartbeat_front_addr":"172.21.15.176:6831/2164458476","state":["exists","up"]},{"osd":7,"uuid":"c8594fda-c74a-4ba9-8277-caf101d58ca1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":139,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6802","nonce":3239587708},{"type":"v1","addr":"172.21.15.176:6803","nonce":3239587708}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6804","nonce":3239587708},{"type":"v1","addr":"172.21.15.176:6805","nonce":3239587708}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6808","nonce":3239587708},{"type":"v1","addr":"172.21.15.176:6809","nonce":3239587708}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6806","nonce":3239587708},{"type":"v1","addr":"172.21.15.176:6807","nonce":3239587708}]},"public_addr":"172.21.15.176:6803/3239587708","cluster_addr":"172.21.15.176:6805/3239587708","heartbeat_back_addr":"172.21.15.176:6809/3239587708","heartbeat_front_addr":"172.21.15.176:6807/3239587708","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:41:41.905151+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:41:42.705679+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:41:42.459673+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:41:42.440819+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:41:42.668428+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:41:42.694972+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:41:43.078535+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:41:42.363539+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":7,"snaps":[{"begin":2,"length":2}]},{"pool":9,"snaps":[{"begin":2,"length":2}]},{"pool":11,"snaps":[{"begin":2,"length":2}]},{"pool":13,"snaps":[{"begin":2,"length":2}]},{"pool":15,"snaps":[{"begin":2,"length":2}]},{"pool":17,"snaps":[{"begin":2,"length":2}]},{"pool":19,"snaps":[{"begin":2,"length":2}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T05:53:15.173 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:15.169+0000 7fd428f2b640 1 -- 172.21.15.150:0/2647048294 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fd40407ad50 msgr2=0x7fd40407d260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:53:15.173 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:15.169+0000 7fd428f2b640 1 --2- 172.21.15.150:0/2647048294 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fd40407ad50 0x7fd40407d260 secure :-1 s=READY pgs=777 cs=0 l=1 rev1=1 crypto rx=0x7fd414005fd0 tx=0x7fd414009500 comp rx=0 tx=0).stop 2024-09-17T05:53:15.173 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:15.169+0000 7fd428f2b640 1 -- 172.21.15.150:0/2647048294 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd42409e880 msgr2=0x7fd4241f5550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:53:15.173 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:15.169+0000 7fd428f2b640 1 --2- 172.21.15.150:0/2647048294 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd42409e880 0x7fd4241f5550 secure :-1 s=READY pgs=1831 cs=0 l=1 rev1=1 crypto rx=0x7fd41c02b0f0 tx=0x7fd41c036c00 comp rx=0 tx=0).stop 2024-09-17T05:53:15.173 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:15.169+0000 7fd428f2b640 1 -- 172.21.15.150:0/2647048294 shutdown_connections 2024-09-17T05:53:15.173 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:15.169+0000 7fd428f2b640 1 --2- 172.21.15.150:0/2647048294 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd4240b15a0 0x7fd42409e340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:53:15.173 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:15.169+0000 7fd428f2b640 1 --2- 172.21.15.150:0/2647048294 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fd40407ad50 0x7fd40407d260 unknown :-1 s=CLOSED pgs=777 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:53:15.173 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:15.169+0000 7fd428f2b640 1 --2- 172.21.15.150:0/2647048294 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd42409e880 0x7fd4241f5550 unknown :-1 s=CLOSED pgs=1831 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:53:15.173 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:15.169+0000 7fd428f2b640 1 --2- 172.21.15.150:0/2647048294 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd40c004d40 0x7fd42414aec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:53:15.174 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:15.169+0000 7fd428f2b640 1 -- 172.21.15.150:0/2647048294 >> 172.21.15.150:0/2647048294 conn(0x7fd4240b2e80 msgr2=0x7fd42415c120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:53:15.174 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:15.169+0000 7fd428f2b640 1 -- 172.21.15.150:0/2647048294 shutdown_connections 2024-09-17T05:53:15.174 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:15.169+0000 7fd428f2b640 1 -- 172.21.15.150:0/2647048294 wait complete. 2024-09-17T05:53:15.184 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-09-17T05:53:15.301 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:15.299+0000 7fa9b5107640 1 -- 172.21.15.150:0/13562015 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa9b00b3510 msgr2=0x7fa9b01626f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:53:15.301 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:15.299+0000 7fa9b5107640 1 --2- 172.21.15.150:0/13562015 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa9b00b3510 0x7fa9b01626f0 secure :-1 s=READY pgs=1833 cs=0 l=1 rev1=1 crypto rx=0x7fa9b00ba770 tx=0x7fa9a002a4a0 comp rx=0 tx=0).stop 2024-09-17T05:53:15.301 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:15.299+0000 7fa9b5107640 1 -- 172.21.15.150:0/13562015 shutdown_connections 2024-09-17T05:53:15.301 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:15.299+0000 7fa9b5107640 1 --2- 172.21.15.150:0/13562015 >> v2:172.21.15.176:3300/0 conn(0x7fa9b00b9f20 0x7fa9b0162c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:53:15.301 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:15.299+0000 7fa9b5107640 1 --2- 172.21.15.150:0/13562015 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa9b00b3510 0x7fa9b01626f0 unknown :-1 s=CLOSED pgs=1833 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:53:15.302 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:15.299+0000 7fa9b5107640 1 -- 172.21.15.150:0/13562015 >> 172.21.15.150:0/13562015 conn(0x7fa9b00d46e0 msgr2=0x7fa9b00d4af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:53:15.302 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:15.299+0000 7fa9b5107640 1 -- 172.21.15.150:0/13562015 shutdown_connections 2024-09-17T05:53:15.302 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:15.299+0000 7fa9b5107640 1 -- 172.21.15.150:0/13562015 wait complete. 2024-09-17T05:53:15.302 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:15.301+0000 7fa9b5107640 1 Processor -- start 2024-09-17T05:53:15.303 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:15.301+0000 7fa9b5107640 1 -- start start 2024-09-17T05:53:15.305 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:15.302+0000 7fa9b5107640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa9b00b13c0 0x7fa9b00a1f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:53:15.306 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:15.302+0000 7fa9b5107640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa9b00b3510 0x7fa9b014d870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:53:15.306 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:15.302+0000 7fa9b5107640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa9b00b9f20 0x7fa9b00b5280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:53:15.306 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:15.302+0000 7fa9b5107640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7fa9b00b1ee0 con 0x7fa9b00b9f20 2024-09-17T05:53:15.306 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:15.302+0000 7fa9b5107640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fa9b00d06a0 con 0x7fa9b00b3510 2024-09-17T05:53:15.306 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:15.302+0000 7fa9b5107640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fa9b00b2060 con 0x7fa9b00b13c0 2024-09-17T05:53:15.306 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:15.303+0000 7fa9af59e640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa9b00b9f20 0x7fa9b00b5280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:53:15.306 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:15.303+0000 7fa9af59e640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa9b00b9f20 0x7fa9b00b5280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:34906/0 (socket says 172.21.15.150:34906) 2024-09-17T05:53:15.306 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:15.303+0000 7fa9af59e640 1 -- 172.21.15.150:0/4108653719 learned_addr learned my addr 172.21.15.150:0/4108653719 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:53:15.306 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:15.303+0000 7fa9aed9d640 1 --2- 172.21.15.150:0/4108653719 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa9b00b13c0 0x7fa9b00a1f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:53:15.306 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:15.303+0000 7fa9a659c640 1 --2- 172.21.15.150:0/4108653719 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa9b00b3510 0x7fa9b014d870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:53:15.306 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:15.303+0000 7fa9af59e640 1 -- 172.21.15.150:0/4108653719 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa9b00b13c0 msgr2=0x7fa9b00a1f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:53:15.306 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:15.303+0000 7fa9af59e640 1 --2- 172.21.15.150:0/4108653719 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa9b00b13c0 0x7fa9b00a1f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:53:15.307 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:15.303+0000 7fa9af59e640 1 -- 172.21.15.150:0/4108653719 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa9b00b3510 msgr2=0x7fa9b014d870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:53:15.307 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:15.303+0000 7fa9af59e640 1 --2- 172.21.15.150:0/4108653719 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa9b00b3510 0x7fa9b014d870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:53:15.307 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:15.303+0000 7fa9af59e640 1 -- 172.21.15.150:0/4108653719 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa9b00b41e0 con 0x7fa9b00b9f20 2024-09-17T05:53:15.307 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:15.303+0000 7fa9a659c640 1 --2- 172.21.15.150:0/4108653719 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa9b00b3510 0x7fa9b014d870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:53:15.307 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:15.303+0000 7fa9af59e640 1 --2- 172.21.15.150:0/4108653719 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa9b00b9f20 0x7fa9b00b5280 secure :-1 s=READY pgs=1834 cs=0 l=1 rev1=1 crypto rx=0x7fa9a800ca80 tx=0x7fa9a800cf40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:53:15.307 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:15.303+0000 7fa9a7fff640 1 -- 172.21.15.150:0/4108653719 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9a8016020 con 0x7fa9b00b9f20 2024-09-17T05:53:15.307 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:15.303+0000 7fa9a7fff640 1 -- 172.21.15.150:0/4108653719 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa9a800acc0 con 0x7fa9b00b9f20 2024-09-17T05:53:15.307 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:15.303+0000 7fa9b5107640 1 -- 172.21.15.150:0/4108653719 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa9b00b44c0 con 0x7fa9b00b9f20 2024-09-17T05:53:15.307 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:15.303+0000 7fa9a7fff640 1 -- 172.21.15.150:0/4108653719 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9a8012680 con 0x7fa9b00b9f20 2024-09-17T05:53:15.307 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:15.303+0000 7fa9b5107640 1 -- 172.21.15.150:0/4108653719 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa9b00b4a80 con 0x7fa9b00b9f20 2024-09-17T05:53:15.308 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:15.305+0000 7fa9b5107640 1 -- 172.21.15.150:0/4108653719 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa9b0161840 con 0x7fa9b00b9f20 2024-09-17T05:53:15.308 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:15.305+0000 7fa9a7fff640 1 -- 172.21.15.150:0/4108653719 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 45) ==== 104501+0+0 (secure 0 0 0) 0x7fa9a8019020 con 0x7fa9b00b9f20 2024-09-17T05:53:15.308 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:15.306+0000 7fa9a7fff640 1 --2- 172.21.15.150:0/4108653719 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fa99007ad50 0x7fa99007d260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:53:15.308 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:15.306+0000 7fa9a7fff640 1 -- 172.21.15.150:0/4108653719 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(140..140 src has 1..140) ==== 5905+0+0 (secure 0 0 0) 0x7fa9a809a380 con 0x7fa9b00b9f20 2024-09-17T05:53:15.308 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:15.306+0000 7fa9aed9d640 1 --2- 172.21.15.150:0/4108653719 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fa99007ad50 0x7fa99007d260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:53:15.309 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:15.306+0000 7fa9aed9d640 1 --2- 172.21.15.150:0/4108653719 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fa99007ad50 0x7fa99007d260 secure :-1 s=READY pgs=778 cs=0 l=1 rev1=1 crypto rx=0x7fa9a0034000 tx=0x7fa9a0004730 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:53:15.311 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:15.310+0000 7fa9a7fff640 1 -- 172.21.15.150:0/4108653719 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fa9b0161840 con 0x7fa9b00b9f20 2024-09-17T05:53:15.526 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:15.524+0000 7fa9b5107640 1 -- 172.21.15.150:0/4108653719 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7fa9b00b2510 con 0x7fa9b00b9f20 2024-09-17T05:53:15.540 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:15.539+0000 7fa9a7fff640 1 -- 172.21.15.150:0/4108653719 <== mon.0 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v87) ==== 118+0+0 (secure 0 0 0) 0x7fa9a8020020 con 0x7fa9b00b9f20 2024-09-17T05:53:15.543 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:15.541+0000 7fa9b5107640 1 -- 172.21.15.150:0/4108653719 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fa99007ad50 msgr2=0x7fa99007d260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:53:15.543 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:15.541+0000 7fa9b5107640 1 --2- 172.21.15.150:0/4108653719 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fa99007ad50 0x7fa99007d260 secure :-1 s=READY pgs=778 cs=0 l=1 rev1=1 crypto rx=0x7fa9a0034000 tx=0x7fa9a0004730 comp rx=0 tx=0).stop 2024-09-17T05:53:15.543 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:15.541+0000 7fa9b5107640 1 -- 172.21.15.150:0/4108653719 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa9b00b9f20 msgr2=0x7fa9b00b5280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:53:15.543 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:15.541+0000 7fa9b5107640 1 --2- 172.21.15.150:0/4108653719 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa9b00b9f20 0x7fa9b00b5280 secure :-1 s=READY pgs=1834 cs=0 l=1 rev1=1 crypto rx=0x7fa9a800ca80 tx=0x7fa9a800cf40 comp rx=0 tx=0).stop 2024-09-17T05:53:15.543 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:15.541+0000 7fa9b5107640 1 -- 172.21.15.150:0/4108653719 shutdown_connections 2024-09-17T05:53:15.543 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:15.541+0000 7fa9b5107640 1 --2- 172.21.15.150:0/4108653719 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa9b00b3510 0x7fa9b014d870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:53:15.544 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:15.541+0000 7fa9b5107640 1 --2- 172.21.15.150:0/4108653719 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fa99007ad50 0x7fa99007d260 unknown :-1 s=CLOSED pgs=778 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:53:15.544 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:15.541+0000 7fa9b5107640 1 --2- 172.21.15.150:0/4108653719 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa9b00b9f20 0x7fa9b00b5280 unknown :-1 s=CLOSED pgs=1834 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:53:15.544 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:15.541+0000 7fa9b5107640 1 --2- 172.21.15.150:0/4108653719 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa9b00b13c0 0x7fa9b00a1f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:53:15.544 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:15.541+0000 7fa9b5107640 1 -- 172.21.15.150:0/4108653719 >> 172.21.15.150:0/4108653719 conn(0x7fa9b00d46e0 msgr2=0x7fa9b006f1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:53:15.544 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:15.541+0000 7fa9b5107640 1 -- 172.21.15.150:0/4108653719 shutdown_connections 2024-09-17T05:53:15.544 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:15.541+0000 7fa9b5107640 1 -- 172.21.15.150:0/4108653719 wait complete. 2024-09-17T05:53:15.555 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-09-17T05:53:15.555 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-09-17T05:53:15.673 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:15.671+0000 7fcebffba640 1 -- 172.21.15.150:0/1110298328 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fceb80b2a00 msgr2=0x7fceb815faf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:53:15.673 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:15.671+0000 7fcebffba640 1 --2- 172.21.15.150:0/1110298328 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fceb80b2a00 0x7fceb815faf0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fcea8009860 tx=0x7fcea802a4b0 comp rx=0 tx=0).stop 2024-09-17T05:53:15.673 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:15.671+0000 7fcebffba640 1 -- 172.21.15.150:0/1110298328 shutdown_connections 2024-09-17T05:53:15.674 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:15.671+0000 7fcebffba640 1 --2- 172.21.15.150:0/1110298328 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fceb80b2a00 0x7fceb815faf0 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:53:15.674 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:15.671+0000 7fcebffba640 1 --2- 172.21.15.150:0/1110298328 >> v2:172.21.15.176:3300/0 conn(0x7fceb80b6550 0x7fceb80b24c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:53:15.674 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:15.671+0000 7fcebffba640 1 -- 172.21.15.150:0/1110298328 >> 172.21.15.150:0/1110298328 conn(0x7fceb80b2e80 msgr2=0x7fceb80b3290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:53:15.674 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:15.671+0000 7fcebffba640 1 -- 172.21.15.150:0/1110298328 shutdown_connections 2024-09-17T05:53:15.674 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:15.671+0000 7fcebffba640 1 -- 172.21.15.150:0/1110298328 wait complete. 2024-09-17T05:53:15.674 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:15.673+0000 7fcebffba640 1 Processor -- start 2024-09-17T05:53:15.675 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:15.673+0000 7fcebffba640 1 -- start start 2024-09-17T05:53:15.677 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:15.674+0000 7fcebffba640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fceb80b2a00 0x7fceb8147060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:53:15.677 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:15.674+0000 7fcebffba640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fceb80b6550 0x7fceb81f5e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:53:15.677 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:15.674+0000 7fcebffba640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fceb8160030 0x7fceb81f63c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:53:15.677 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:15.674+0000 7fcebffba640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7fceb8160440 con 0x7fceb80b2a00 2024-09-17T05:53:15.678 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:15.674+0000 7fcebffba640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fceb80b6150 con 0x7fceb8160030 2024-09-17T05:53:15.678 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:15.674+0000 7fcebffba640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fceb81605c0 con 0x7fceb80b6550 2024-09-17T05:53:15.678 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:15.674+0000 7fcebdd56640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fceb80b2a00 0x7fceb8147060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:53:15.678 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:15.674+0000 7fcebdd56640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fceb80b2a00 0x7fceb8147060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:34914/0 (socket says 172.21.15.150:34914) 2024-09-17T05:53:15.678 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:15.674+0000 7fcebdd56640 1 -- 172.21.15.150:0/1254641893 learned_addr learned my addr 172.21.15.150:0/1254641893 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:53:15.678 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:15.674+0000 7fcebd555640 1 --2- 172.21.15.150:0/1254641893 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fceb80b6550 0x7fceb81f5e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:53:15.678 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:15.674+0000 7fcebe557640 1 --2- 172.21.15.150:0/1254641893 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fceb8160030 0x7fceb81f63c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:53:15.678 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:15.675+0000 7fcebdd56640 1 -- 172.21.15.150:0/1254641893 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fceb80b6550 msgr2=0x7fceb81f5e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:53:15.678 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:15.675+0000 7fcebdd56640 1 --2- 172.21.15.150:0/1254641893 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fceb80b6550 0x7fceb81f5e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:53:15.678 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:15.675+0000 7fcebdd56640 1 -- 172.21.15.150:0/1254641893 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fceb8160030 msgr2=0x7fceb81f63c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:53:15.678 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:15.675+0000 7fcebdd56640 1 --2- 172.21.15.150:0/1254641893 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fceb8160030 0x7fceb81f63c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:53:15.679 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:15.675+0000 7fcebdd56640 1 -- 172.21.15.150:0/1254641893 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fceb815e1c0 con 0x7fceb80b2a00 2024-09-17T05:53:15.679 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:15.675+0000 7fcebdd56640 1 --2- 172.21.15.150:0/1254641893 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fceb80b2a00 0x7fceb8147060 secure :-1 s=READY pgs=1835 cs=0 l=1 rev1=1 crypto rx=0x7fceb400e9f0 tx=0x7fceb400eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:53:15.679 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:15.675+0000 7fceae7fc640 1 -- 172.21.15.150:0/1254641893 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fceb400cd80 con 0x7fceb80b2a00 2024-09-17T05:53:15.679 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:15.675+0000 7fceae7fc640 1 -- 172.21.15.150:0/1254641893 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fceb4004020 con 0x7fceb80b2a00 2024-09-17T05:53:15.679 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:15.675+0000 7fceae7fc640 1 -- 172.21.15.150:0/1254641893 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fceb4004470 con 0x7fceb80b2a00 2024-09-17T05:53:15.679 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:15.675+0000 7fcebffba640 1 -- 172.21.15.150:0/1254641893 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fceb815d640 con 0x7fceb80b2a00 2024-09-17T05:53:15.679 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:15.675+0000 7fcebffba640 1 -- 172.21.15.150:0/1254641893 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fceb815dc00 con 0x7fceb80b2a00 2024-09-17T05:53:15.680 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:15.676+0000 7fcebffba640 1 -- 172.21.15.150:0/1254641893 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fceb815faf0 con 0x7fceb80b2a00 2024-09-17T05:53:15.680 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:15.677+0000 7fceae7fc640 1 -- 172.21.15.150:0/1254641893 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 45) ==== 104501+0+0 (secure 0 0 0) 0x7fceb40035f0 con 0x7fceb80b2a00 2024-09-17T05:53:15.680 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:15.677+0000 7fceae7fc640 1 --2- 172.21.15.150:0/1254641893 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fce9c07ad50 0x7fce9c07d260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:53:15.680 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:15.677+0000 7fceae7fc640 1 -- 172.21.15.150:0/1254641893 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(141..141 src has 1..141) ==== 5905+0+0 (secure 0 0 0) 0x7fceb409a7a0 con 0x7fceb80b2a00 2024-09-17T05:53:15.680 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:15.678+0000 7fcebd555640 1 --2- 172.21.15.150:0/1254641893 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fce9c07ad50 0x7fce9c07d260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:53:15.680 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:15.678+0000 7fcebd555640 1 --2- 172.21.15.150:0/1254641893 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fce9c07ad50 0x7fce9c07d260 secure :-1 s=READY pgs=779 cs=0 l=1 rev1=1 crypto rx=0x7fcea8034000 tx=0x7fcea8004730 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:53:15.683 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:15.682+0000 7fceae7fc640 1 -- 172.21.15.150:0/1254641893 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fceb4064120 con 0x7fceb80b2a00 2024-09-17T05:53:15.896 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:15.894+0000 7fcebffba640 1 -- 172.21.15.150:0/1254641893 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7fceb815c120 con 0x7fceb80b2a00 2024-09-17T05:53:16.499 INFO:tasks.ceph.mds.c.smithi150.stderr:2024-09-17T05:53:16.498+0000 7f05de2dc640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-17T05:53:16.546 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:16.544+0000 7fceae7fc640 1 -- 172.21.15.150:0/1254641893 <== mon.0 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v88) ==== 122+0+0 (secure 0 0 0) 0x7fceb4068b50 con 0x7fceb80b2a00 2024-09-17T05:53:16.551 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:16.548+0000 7fcebffba640 1 -- 172.21.15.150:0/1254641893 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fce9c07ad50 msgr2=0x7fce9c07d260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:53:16.551 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:16.548+0000 7fcebffba640 1 --2- 172.21.15.150:0/1254641893 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fce9c07ad50 0x7fce9c07d260 secure :-1 s=READY pgs=779 cs=0 l=1 rev1=1 crypto rx=0x7fcea8034000 tx=0x7fcea8004730 comp rx=0 tx=0).stop 2024-09-17T05:53:16.551 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:16.548+0000 7fcebffba640 1 -- 172.21.15.150:0/1254641893 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fceb80b2a00 msgr2=0x7fceb8147060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:53:16.551 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:16.548+0000 7fcebffba640 1 --2- 172.21.15.150:0/1254641893 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fceb80b2a00 0x7fceb8147060 secure :-1 s=READY pgs=1835 cs=0 l=1 rev1=1 crypto rx=0x7fceb400e9f0 tx=0x7fceb400eeb0 comp rx=0 tx=0).stop 2024-09-17T05:53:16.551 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:16.548+0000 7fcebffba640 1 -- 172.21.15.150:0/1254641893 shutdown_connections 2024-09-17T05:53:16.551 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:16.548+0000 7fcebffba640 1 --2- 172.21.15.150:0/1254641893 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fceb8160030 0x7fceb81f63c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:53:16.551 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:16.548+0000 7fcebffba640 1 --2- 172.21.15.150:0/1254641893 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fce9c07ad50 0x7fce9c07d260 unknown :-1 s=CLOSED pgs=779 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:53:16.551 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:16.548+0000 7fcebffba640 1 --2- 172.21.15.150:0/1254641893 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fceb80b6550 0x7fceb81f5e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:53:16.551 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:16.548+0000 7fcebffba640 1 --2- 172.21.15.150:0/1254641893 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fceb80b2a00 0x7fceb8147060 unknown :-1 s=CLOSED pgs=1835 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:53:16.551 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:16.549+0000 7fcebffba640 1 -- 172.21.15.150:0/1254641893 >> 172.21.15.150:0/1254641893 conn(0x7fceb80b2e80 msgr2=0x7fceb815b030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:53:16.551 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:16.549+0000 7fcebffba640 1 -- 172.21.15.150:0/1254641893 shutdown_connections 2024-09-17T05:53:16.552 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:16.549+0000 7fcebffba640 1 -- 172.21.15.150:0/1254641893 wait complete. 2024-09-17T05:53:16.564 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-09-17T05:53:16.564 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T05:53:16.682 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:16.679+0000 7f9ec3da1640 1 -- 172.21.15.150:0/263369992 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9ebc0d4f90 msgr2=0x7f9ebc0d0400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:53:16.682 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:16.679+0000 7f9ec3da1640 1 --2- 172.21.15.150:0/263369992 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9ebc0d4f90 0x7f9ebc0d0400 secure :-1 s=READY pgs=1836 cs=0 l=1 rev1=1 crypto rx=0x7f9ebc08d3a0 tx=0x7f9eb402aa30 comp rx=0 tx=0).stop 2024-09-17T05:53:16.682 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:16.679+0000 7f9ec3da1640 1 -- 172.21.15.150:0/263369992 shutdown_connections 2024-09-17T05:53:16.682 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:16.679+0000 7f9ec3da1640 1 --2- 172.21.15.150:0/263369992 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9ebc0d4f90 0x7f9ebc0d0400 unknown :-1 s=CLOSED pgs=1836 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:53:16.683 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:16.679+0000 7f9ec3da1640 1 --2- 172.21.15.150:0/263369992 >> v2:172.21.15.176:3300/0 conn(0x7f9ebc0d1790 0x7f9ebc0d2780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:53:16.683 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:16.679+0000 7f9ec3da1640 1 -- 172.21.15.150:0/263369992 >> 172.21.15.150:0/263369992 conn(0x7f9ebc08bfe0 msgr2=0x7f9ebc0d4670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:53:16.683 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:16.679+0000 7f9ec3da1640 1 -- 172.21.15.150:0/263369992 shutdown_connections 2024-09-17T05:53:16.683 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:16.679+0000 7f9ec3da1640 1 -- 172.21.15.150:0/263369992 wait complete. 2024-09-17T05:53:16.688 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:16.681+0000 7f9ec3da1640 1 Processor -- start 2024-09-17T05:53:16.688 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:16.681+0000 7f9ec3da1640 1 -- start start 2024-09-17T05:53:16.689 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:16.682+0000 7f9ec3da1640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9ebc0b5d50 0x7f9ebc1f9d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:53:16.689 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:16.682+0000 7f9ec3da1640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9ebc0d4f90 0x7f9ebc1f66b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:53:16.689 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:16.683+0000 7f9ec3da1640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9ebc0c80a0 0x7f9ebc1529f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:53:16.689 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:16.683+0000 7f9ec3da1640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f9ebc0b7aa0 con 0x7f9ebc0b5d50 2024-09-17T05:53:16.689 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:16.683+0000 7f9ec3da1640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f9ebc0b7920 con 0x7f9ebc0d4f90 2024-09-17T05:53:16.689 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:16.683+0000 7f9ec3da1640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f9ebc0b7c20 con 0x7f9ebc0c80a0 2024-09-17T05:53:16.689 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:16.683+0000 7f9ec1b3d640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9ebc0b5d50 0x7f9ebc1f9d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:53:16.689 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:16.683+0000 7f9ec1b3d640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9ebc0b5d50 0x7f9ebc1f9d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:34932/0 (socket says 172.21.15.150:34932) 2024-09-17T05:53:16.689 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:16.683+0000 7f9ec1b3d640 1 -- 172.21.15.150:0/274945327 learned_addr learned my addr 172.21.15.150:0/274945327 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:53:16.689 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:16.683+0000 7f9ec133c640 1 --2- 172.21.15.150:0/274945327 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9ebc0d4f90 0x7f9ebc1f66b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:53:16.689 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:16.683+0000 7f9ec233e640 1 --2- 172.21.15.150:0/274945327 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9ebc0c80a0 0x7f9ebc1529f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:53:16.689 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:16.683+0000 7f9ec1b3d640 1 -- 172.21.15.150:0/274945327 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9ebc0c80a0 msgr2=0x7f9ebc1529f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:53:16.690 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:16.683+0000 7f9ec1b3d640 1 --2- 172.21.15.150:0/274945327 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9ebc0c80a0 0x7f9ebc1529f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:53:16.690 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:16.683+0000 7f9ec1b3d640 1 -- 172.21.15.150:0/274945327 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9ebc0d4f90 msgr2=0x7f9ebc1f66b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:53:16.690 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:16.683+0000 7f9ec1b3d640 1 --2- 172.21.15.150:0/274945327 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9ebc0d4f90 0x7f9ebc1f66b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:53:16.690 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:16.683+0000 7f9ec1b3d640 1 -- 172.21.15.150:0/274945327 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9ebc0c8c00 con 0x7f9ebc0b5d50 2024-09-17T05:53:16.690 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:16.683+0000 7f9ec133c640 1 --2- 172.21.15.150:0/274945327 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9ebc0d4f90 0x7f9ebc1f66b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T05:53:16.690 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:16.683+0000 7f9ec1b3d640 1 --2- 172.21.15.150:0/274945327 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9ebc0b5d50 0x7f9ebc1f9d60 secure :-1 s=READY pgs=1837 cs=0 l=1 rev1=1 crypto rx=0x7f9eb800b420 tx=0x7f9eb800b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:53:16.690 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:16.683+0000 7f9eb27fc640 1 -- 172.21.15.150:0/274945327 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9eb8011830 con 0x7f9ebc0b5d50 2024-09-17T05:53:16.690 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:16.683+0000 7f9eb27fc640 1 -- 172.21.15.150:0/274945327 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9eb8016070 con 0x7f9ebc0b5d50 2024-09-17T05:53:16.690 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:16.683+0000 7f9ec3da1640 1 -- 172.21.15.150:0/274945327 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9ebc0c8ee0 con 0x7f9ebc0b5d50 2024-09-17T05:53:16.690 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:16.683+0000 7f9eb27fc640 1 -- 172.21.15.150:0/274945327 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9eb8011d60 con 0x7f9ebc0b5d50 2024-09-17T05:53:16.690 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:16.683+0000 7f9ec3da1640 1 -- 172.21.15.150:0/274945327 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9ebc1f9560 con 0x7f9ebc0b5d50 2024-09-17T05:53:16.690 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:16.685+0000 7f9ec3da1640 1 -- 172.21.15.150:0/274945327 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9ebc0b8900 con 0x7f9ebc0b5d50 2024-09-17T05:53:16.690 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:16.685+0000 7f9eb27fc640 1 -- 172.21.15.150:0/274945327 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 45) ==== 104501+0+0 (secure 0 0 0) 0x7f9eb801b460 con 0x7f9ebc0b5d50 2024-09-17T05:53:16.690 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:16.686+0000 7f9eb27fc640 1 --2- 172.21.15.150:0/274945327 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f9ea007ad50 0x7f9ea007d260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:53:16.691 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:16.686+0000 7f9eb27fc640 1 -- 172.21.15.150:0/274945327 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(141..141 src has 1..141) ==== 5905+0+0 (secure 0 0 0) 0x7f9eb8099870 con 0x7f9ebc0b5d50 2024-09-17T05:53:16.691 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:16.686+0000 7f9ec133c640 1 --2- 172.21.15.150:0/274945327 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f9ea007ad50 0x7f9ea007d260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:53:16.691 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:16.687+0000 7f9ec133c640 1 --2- 172.21.15.150:0/274945327 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f9ea007ad50 0x7f9ea007d260 secure :-1 s=READY pgs=780 cs=0 l=1 rev1=1 crypto rx=0x7f9ebc15fe20 tx=0x7f9eac005d10 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:53:16.692 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:16.691+0000 7f9eb27fc640 1 -- 172.21.15.150:0/274945327 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f9eb8020020 con 0x7f9ebc0b5d50 2024-09-17T05:53:16.907 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:16.905+0000 7f9ec3da1640 1 -- 172.21.15.150:0/274945327 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f9ebc0d2d60 con 0x7f9ebc0b5d50 2024-09-17T05:53:16.907 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:16.905+0000 7f9eb27fc640 1 -- 172.21.15.150:0/274945327 <== mon.0 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 88 v88) ==== 94+0+5233 (secure 0 0 0) 0x7f9eb8063840 con 0x7f9ebc0b5d50 2024-09-17T05:53:16.907 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-09-17T05:53:16.908 INFO:teuthology.orchestra.run.smithi150.stdout:{"epoch":88,"btime":"2024-09-17T05:53:16:540972+0000","default_fscid":10,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7418,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6836/984747558","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6834","nonce":984747558},{"type":"v1","addr":"172.21.15.176:6836","nonce":984747558}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":85},{"gid":7421,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6837/1815277837","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6835","nonce":1815277837},{"type":"v1","addr":"172.21.15.176:6837","nonce":1815277837}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":85},{"gid":9630,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6834/2397551288","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6832","nonce":2397551288},{"type":"v1","addr":"172.21.15.150:6834","nonce":2397551288}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":84}],"filesystems":[{"mdsmap":{"epoch":88,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T05:53:13.900105+0000","modified":"2024-09-17T05:53:15.896921+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":9633},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9633":{"gid":9633,"name":"c","rank":0,"incarnation":86,"state":"up:active","state_seq":3,"addr":"172.21.15.150:6835/122540131","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6833","nonce":122540131},{"type":"v1","addr":"172.21.15.150:6835","nonce":122540131}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[21],"metadata_pool":20,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":9633,"qdb_cluster":[9633]},"id":10}]} 2024-09-17T05:53:16.908 INFO:teuthology.orchestra.run.smithi150.stderr:dumped fsmap epoch 88 2024-09-17T05:53:16.910 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:16.908+0000 7f9ec3da1640 1 -- 172.21.15.150:0/274945327 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f9ea007ad50 msgr2=0x7f9ea007d260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:53:16.910 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:16.908+0000 7f9ec3da1640 1 --2- 172.21.15.150:0/274945327 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f9ea007ad50 0x7f9ea007d260 secure :-1 s=READY pgs=780 cs=0 l=1 rev1=1 crypto rx=0x7f9ebc15fe20 tx=0x7f9eac005d10 comp rx=0 tx=0).stop 2024-09-17T05:53:16.910 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:16.908+0000 7f9ec3da1640 1 -- 172.21.15.150:0/274945327 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9ebc0b5d50 msgr2=0x7f9ebc1f9d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:53:16.910 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:16.908+0000 7f9ec3da1640 1 --2- 172.21.15.150:0/274945327 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9ebc0b5d50 0x7f9ebc1f9d60 secure :-1 s=READY pgs=1837 cs=0 l=1 rev1=1 crypto rx=0x7f9eb800b420 tx=0x7f9eb800b8e0 comp rx=0 tx=0).stop 2024-09-17T05:53:16.910 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:16.908+0000 7f9ec3da1640 1 -- 172.21.15.150:0/274945327 shutdown_connections 2024-09-17T05:53:16.910 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:16.908+0000 7f9ec3da1640 1 --2- 172.21.15.150:0/274945327 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9ebc0d4f90 0x7f9ebc1f66b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:53:16.910 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:16.908+0000 7f9ec3da1640 1 --2- 172.21.15.150:0/274945327 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f9ea007ad50 0x7f9ea007d260 unknown :-1 s=CLOSED pgs=780 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:53:16.910 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:16.908+0000 7f9ec3da1640 1 --2- 172.21.15.150:0/274945327 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9ebc0c80a0 0x7f9ebc1529f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:53:16.910 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:16.908+0000 7f9ec3da1640 1 --2- 172.21.15.150:0/274945327 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9ebc0b5d50 0x7f9ebc1f9d60 unknown :-1 s=CLOSED pgs=1837 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:53:16.910 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:16.908+0000 7f9ec3da1640 1 -- 172.21.15.150:0/274945327 >> 172.21.15.150:0/274945327 conn(0x7f9ebc08bfe0 msgr2=0x7f9ebc15ec20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:53:16.910 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:16.908+0000 7f9ec3da1640 1 -- 172.21.15.150:0/274945327 shutdown_connections 2024-09-17T05:53:16.910 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:16.908+0000 7f9ec3da1640 1 -- 172.21.15.150:0/274945327 wait complete. 2024-09-17T05:53:16.922 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T05:53:17.036 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:17.034+0000 7f626844d640 1 -- 172.21.15.150:0/2249720910 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f62600d1790 msgr2=0x7f62600d2780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:53:17.037 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:17.034+0000 7f626844d640 1 --2- 172.21.15.150:0/2249720910 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f62600d1790 0x7f62600d2780 secure :-1 s=READY pgs=1839 cs=0 l=1 rev1=1 crypto rx=0x7f6254005fd0 tx=0x7f625402a8b0 comp rx=0 tx=0).stop 2024-09-17T05:53:17.037 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:17.034+0000 7f626844d640 1 -- 172.21.15.150:0/2249720910 shutdown_connections 2024-09-17T05:53:17.037 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:17.034+0000 7f626844d640 1 --2- 172.21.15.150:0/2249720910 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f62600d4f90 0x7f62600d0400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:53:17.037 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:17.034+0000 7f626844d640 1 --2- 172.21.15.150:0/2249720910 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f62600d1790 0x7f62600d2780 unknown :-1 s=CLOSED pgs=1839 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:53:17.037 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:17.034+0000 7f626844d640 1 -- 172.21.15.150:0/2249720910 >> 172.21.15.150:0/2249720910 conn(0x7f626008bfe0 msgr2=0x7f62600d4670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:53:17.037 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:17.034+0000 7f626844d640 1 -- 172.21.15.150:0/2249720910 shutdown_connections 2024-09-17T05:53:17.037 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:17.034+0000 7f626844d640 1 -- 172.21.15.150:0/2249720910 wait complete. 2024-09-17T05:53:17.038 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:17.036+0000 7f626844d640 1 Processor -- start 2024-09-17T05:53:17.038 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:17.036+0000 7f626844d640 1 -- start start 2024-09-17T05:53:17.040 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:17.037+0000 7f626844d640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f62600b5d50 0x7f626014d9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:53:17.040 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:17.037+0000 7f626844d640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f62600d4f90 0x7f62600ce5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:53:17.041 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:17.037+0000 7f626844d640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f62601534f0 0x7f62601f9320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:53:17.041 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:17.037+0000 7f626844d640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f62600b7b00 con 0x7f62601534f0 2024-09-17T05:53:17.041 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:17.037+0000 7f626844d640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f62600b7980 con 0x7f62600d4f90 2024-09-17T05:53:17.041 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:17.037+0000 7f626844d640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f62600b7c80 con 0x7f62600b5d50 2024-09-17T05:53:17.041 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:17.038+0000 7f62669ea640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f62601534f0 0x7f62601f9320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:53:17.041 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:17.038+0000 7f62669ea640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f62601534f0 0x7f62601f9320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:34958/0 (socket says 172.21.15.150:34958) 2024-09-17T05:53:17.041 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:17.038+0000 7f62669ea640 1 -- 172.21.15.150:0/3158903008 learned_addr learned my addr 172.21.15.150:0/3158903008 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:53:17.042 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:17.038+0000 7f62659e8640 1 --2- 172.21.15.150:0/3158903008 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f62600d4f90 0x7f62600ce5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:53:17.042 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:17.038+0000 7f62661e9640 1 --2- 172.21.15.150:0/3158903008 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f62600b5d50 0x7f626014d9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:53:17.042 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:17.038+0000 7f62669ea640 1 -- 172.21.15.150:0/3158903008 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f62600b5d50 msgr2=0x7f626014d9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:53:17.042 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:17.038+0000 7f62669ea640 1 --2- 172.21.15.150:0/3158903008 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f62600b5d50 0x7f626014d9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:53:17.042 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:17.038+0000 7f62669ea640 1 -- 172.21.15.150:0/3158903008 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f62600d4f90 msgr2=0x7f62600ce5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:53:17.042 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:17.038+0000 7f62669ea640 1 --2- 172.21.15.150:0/3158903008 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f62600d4f90 0x7f62600ce5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:53:17.042 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:17.038+0000 7f62669ea640 1 -- 172.21.15.150:0/3158903008 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6260153cf0 con 0x7f62601534f0 2024-09-17T05:53:17.042 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:17.038+0000 7f62661e9640 1 --2- 172.21.15.150:0/3158903008 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f62600b5d50 0x7f626014d9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:53:17.042 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:17.038+0000 7f62669ea640 1 --2- 172.21.15.150:0/3158903008 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f62601534f0 0x7f62601f9320 secure :-1 s=READY pgs=1840 cs=0 l=1 rev1=1 crypto rx=0x7f625800d650 tx=0x7f625800db10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:53:17.042 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:17.038+0000 7f625effd640 1 -- 172.21.15.150:0/3158903008 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6258017070 con 0x7f62601534f0 2024-09-17T05:53:17.042 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:17.038+0000 7f625effd640 1 -- 172.21.15.150:0/3158903008 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f6258005310 con 0x7f62601534f0 2024-09-17T05:53:17.043 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:17.038+0000 7f626844d640 1 -- 172.21.15.150:0/3158903008 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6260150130 con 0x7f62601534f0 2024-09-17T05:53:17.043 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:17.038+0000 7f625effd640 1 -- 172.21.15.150:0/3158903008 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6258009820 con 0x7f62601534f0 2024-09-17T05:53:17.043 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:17.038+0000 7f626844d640 1 -- 172.21.15.150:0/3158903008 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f62601506f0 con 0x7f62601534f0 2024-09-17T05:53:17.044 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:17.039+0000 7f626844d640 1 -- 172.21.15.150:0/3158903008 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f626014fea0 con 0x7f62601534f0 2024-09-17T05:53:17.044 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:17.040+0000 7f625effd640 1 -- 172.21.15.150:0/3158903008 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 45) ==== 104501+0+0 (secure 0 0 0) 0x7f62580099c0 con 0x7f62601534f0 2024-09-17T05:53:17.044 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:17.041+0000 7f625effd640 1 --2- 172.21.15.150:0/3158903008 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f624c07ad50 0x7f624c07d260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:53:17.044 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:17.041+0000 7f625effd640 1 -- 172.21.15.150:0/3158903008 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(141..141 src has 1..141) ==== 5905+0+0 (secure 0 0 0) 0x7f6258099d30 con 0x7f62601534f0 2024-09-17T05:53:17.044 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:17.041+0000 7f62661e9640 1 --2- 172.21.15.150:0/3158903008 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f624c07ad50 0x7f624c07d260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:53:17.044 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:17.041+0000 7f62661e9640 1 --2- 172.21.15.150:0/3158903008 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f624c07ad50 0x7f624c07d260 secure :-1 s=READY pgs=781 cs=0 l=1 rev1=1 crypto rx=0x7f6250007a50 tx=0x7f6250009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:53:17.046 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:17.045+0000 7f625effd640 1 -- 172.21.15.150:0/3158903008 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f62580636b0 con 0x7f62601534f0 2024-09-17T05:53:17.223 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:17.222+0000 7f626844d640 1 -- 172.21.15.150:0/3158903008 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f62600d2780 con 0x7f62601534f0 2024-09-17T05:53:17.224 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:17.223+0000 7f625effd640 1 -- 172.21.15.150:0/3158903008 <== mon.0 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v141) ==== 74+0+17087 (secure 0 0 0) 0x7f62580680e0 con 0x7f62601534f0 2024-09-17T05:53:17.225 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-09-17T05:53:17.225 INFO:teuthology.orchestra.run.smithi150.stdout:{"epoch":141,"fsid":"9f2e05e9-d629-47b3-b26b-1360655b7d20","created":"2024-09-17T05:41:32.502979+0000","modified":"2024-09-17T05:53:15.521108+0000","last_up_change":"2024-09-17T05:41:46.150225+0000","last_in_change":"2024-09-17T05:41:36.120274+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":21,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T05:41:46.860779+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":20,"pool_name":"cephfs_metadata","create_time":"2024-09-17T05:53:11.522067+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"140","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":21,"pool_name":"cephfs_data","create_time":"2024-09-17T05:53:12.853902+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"141","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"4f31c018-c8a4-4d6d-b0c2-a597c47aae4a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":139,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6800","nonce":479374392},{"type":"v1","addr":"172.21.15.150:6801","nonce":479374392}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6802","nonce":479374392},{"type":"v1","addr":"172.21.15.150:6803","nonce":479374392}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6806","nonce":479374392},{"type":"v1","addr":"172.21.15.150:6807","nonce":479374392}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6804","nonce":479374392},{"type":"v1","addr":"172.21.15.150:6805","nonce":479374392}]},"public_addr":"172.21.15.150:6801/479374392","cluster_addr":"172.21.15.150:6803/479374392","heartbeat_back_addr":"172.21.15.150:6807/479374392","heartbeat_front_addr":"172.21.15.150:6805/479374392","state":["exists","up"]},{"osd":1,"uuid":"6ff4a573-500b-4e04-9de3-39265ead78b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":139,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6824","nonce":913899800},{"type":"v1","addr":"172.21.15.150:6825","nonce":913899800}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6826","nonce":913899800},{"type":"v1","addr":"172.21.15.150:6827","nonce":913899800}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6830","nonce":913899800},{"type":"v1","addr":"172.21.15.150:6831","nonce":913899800}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6828","nonce":913899800},{"type":"v1","addr":"172.21.15.150:6829","nonce":913899800}]},"public_addr":"172.21.15.150:6825/913899800","cluster_addr":"172.21.15.150:6827/913899800","heartbeat_back_addr":"172.21.15.150:6831/913899800","heartbeat_front_addr":"172.21.15.150:6829/913899800","state":["exists","up"]},{"osd":2,"uuid":"bffea6f9-2465-4182-b205-00436c41ac1c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":139,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6816","nonce":363718461},{"type":"v1","addr":"172.21.15.150:6817","nonce":363718461}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6818","nonce":363718461},{"type":"v1","addr":"172.21.15.150:6819","nonce":363718461}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6822","nonce":363718461},{"type":"v1","addr":"172.21.15.150:6823","nonce":363718461}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6820","nonce":363718461},{"type":"v1","addr":"172.21.15.150:6821","nonce":363718461}]},"public_addr":"172.21.15.150:6817/363718461","cluster_addr":"172.21.15.150:6819/363718461","heartbeat_back_addr":"172.21.15.150:6823/363718461","heartbeat_front_addr":"172.21.15.150:6821/363718461","state":["exists","up"]},{"osd":3,"uuid":"cda70430-d1e1-427e-b04e-56db4031d078","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":139,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6808","nonce":3550994626},{"type":"v1","addr":"172.21.15.150:6809","nonce":3550994626}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6810","nonce":3550994626},{"type":"v1","addr":"172.21.15.150:6811","nonce":3550994626}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6814","nonce":3550994626},{"type":"v1","addr":"172.21.15.150:6815","nonce":3550994626}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6812","nonce":3550994626},{"type":"v1","addr":"172.21.15.150:6813","nonce":3550994626}]},"public_addr":"172.21.15.150:6809/3550994626","cluster_addr":"172.21.15.150:6811/3550994626","heartbeat_back_addr":"172.21.15.150:6815/3550994626","heartbeat_front_addr":"172.21.15.150:6813/3550994626","state":["exists","up"]},{"osd":4,"uuid":"3a0277fb-5e1e-4f68-bb2d-9a8a0152f64a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":139,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6810","nonce":2718261497},{"type":"v1","addr":"172.21.15.176:6811","nonce":2718261497}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6812","nonce":2718261497},{"type":"v1","addr":"172.21.15.176:6813","nonce":2718261497}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6816","nonce":2718261497},{"type":"v1","addr":"172.21.15.176:6817","nonce":2718261497}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6814","nonce":2718261497},{"type":"v1","addr":"172.21.15.176:6815","nonce":2718261497}]},"public_addr":"172.21.15.176:6811/2718261497","cluster_addr":"172.21.15.176:6813/2718261497","heartbeat_back_addr":"172.21.15.176:6817/2718261497","heartbeat_front_addr":"172.21.15.176:6815/2718261497","state":["exists","up"]},{"osd":5,"uuid":"33aebee6-0315-40b7-a11c-6702f0be494d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":139,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6818","nonce":2049295774},{"type":"v1","addr":"172.21.15.176:6819","nonce":2049295774}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6820","nonce":2049295774},{"type":"v1","addr":"172.21.15.176:6821","nonce":2049295774}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6824","nonce":2049295774},{"type":"v1","addr":"172.21.15.176:6825","nonce":2049295774}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6822","nonce":2049295774},{"type":"v1","addr":"172.21.15.176:6823","nonce":2049295774}]},"public_addr":"172.21.15.176:6819/2049295774","cluster_addr":"172.21.15.176:6821/2049295774","heartbeat_back_addr":"172.21.15.176:6825/2049295774","heartbeat_front_addr":"172.21.15.176:6823/2049295774","state":["exists","up"]},{"osd":6,"uuid":"4d24f360-6751-4263-841b-d77793d33540","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":139,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6826","nonce":2164458476},{"type":"v1","addr":"172.21.15.176:6827","nonce":2164458476}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6828","nonce":2164458476},{"type":"v1","addr":"172.21.15.176:6829","nonce":2164458476}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6832","nonce":2164458476},{"type":"v1","addr":"172.21.15.176:6833","nonce":2164458476}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6830","nonce":2164458476},{"type":"v1","addr":"172.21.15.176:6831","nonce":2164458476}]},"public_addr":"172.21.15.176:6827/2164458476","cluster_addr":"172.21.15.176:6829/2164458476","heartbeat_back_addr":"172.21.15.176:6833/2164458476","heartbeat_front_addr":"172.21.15.176:6831/2164458476","state":["exists","up"]},{"osd":7,"uuid":"c8594fda-c74a-4ba9-8277-caf101d58ca1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":139,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6802","nonce":3239587708},{"type":"v1","addr":"172.21.15.176:6803","nonce":3239587708}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6804","nonce":3239587708},{"type":"v1","addr":"172.21.15.176:6805","nonce":3239587708}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6808","nonce":3239587708},{"type":"v1","addr":"172.21.15.176:6809","nonce":3239587708}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6806","nonce":3239587708},{"type":"v1","addr":"172.21.15.176:6807","nonce":3239587708}]},"public_addr":"172.21.15.176:6803/3239587708","cluster_addr":"172.21.15.176:6805/3239587708","heartbeat_back_addr":"172.21.15.176:6809/3239587708","heartbeat_front_addr":"172.21.15.176:6807/3239587708","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:41:41.905151+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:41:42.705679+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:41:42.459673+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:41:42.440819+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:41:42.668428+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:41:42.694972+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:41:43.078535+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:41:42.363539+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":7,"snaps":[{"begin":2,"length":2}]},{"pool":9,"snaps":[{"begin":2,"length":2}]},{"pool":11,"snaps":[{"begin":2,"length":2}]},{"pool":13,"snaps":[{"begin":2,"length":2}]},{"pool":15,"snaps":[{"begin":2,"length":2}]},{"pool":17,"snaps":[{"begin":2,"length":2}]},{"pool":19,"snaps":[{"begin":2,"length":2}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T05:53:17.227 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:17.225+0000 7f626844d640 1 -- 172.21.15.150:0/3158903008 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f624c07ad50 msgr2=0x7f624c07d260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:53:17.227 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:17.225+0000 7f626844d640 1 --2- 172.21.15.150:0/3158903008 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f624c07ad50 0x7f624c07d260 secure :-1 s=READY pgs=781 cs=0 l=1 rev1=1 crypto rx=0x7f6250007a50 tx=0x7f6250009040 comp rx=0 tx=0).stop 2024-09-17T05:53:17.227 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:17.225+0000 7f626844d640 1 -- 172.21.15.150:0/3158903008 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f62601534f0 msgr2=0x7f62601f9320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:53:17.228 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:17.225+0000 7f626844d640 1 --2- 172.21.15.150:0/3158903008 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f62601534f0 0x7f62601f9320 secure :-1 s=READY pgs=1840 cs=0 l=1 rev1=1 crypto rx=0x7f625800d650 tx=0x7f625800db10 comp rx=0 tx=0).stop 2024-09-17T05:53:17.228 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:17.225+0000 7f626844d640 1 -- 172.21.15.150:0/3158903008 shutdown_connections 2024-09-17T05:53:17.228 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:17.225+0000 7f626844d640 1 --2- 172.21.15.150:0/3158903008 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f62600d4f90 0x7f62600ce5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:53:17.228 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:17.225+0000 7f626844d640 1 --2- 172.21.15.150:0/3158903008 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f624c07ad50 0x7f624c07d260 unknown :-1 s=CLOSED pgs=781 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:53:17.228 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:17.225+0000 7f626844d640 1 --2- 172.21.15.150:0/3158903008 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f62601534f0 0x7f62601f9320 unknown :-1 s=CLOSED pgs=1840 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:53:17.228 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:17.225+0000 7f626844d640 1 --2- 172.21.15.150:0/3158903008 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f62600b5d50 0x7f626014d9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:53:17.228 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:17.225+0000 7f626844d640 1 -- 172.21.15.150:0/3158903008 >> 172.21.15.150:0/3158903008 conn(0x7f626008bfe0 msgr2=0x7f626015ea30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:53:17.228 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:17.225+0000 7f626844d640 1 -- 172.21.15.150:0/3158903008 shutdown_connections 2024-09-17T05:53:17.228 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:17.225+0000 7f626844d640 1 -- 172.21.15.150:0/3158903008 wait complete. 2024-09-17T05:53:17.240 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-17T05:53:17.240 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-17T05:53:17.355 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:17.353+0000 7f22a8c7e640 1 -- 172.21.15.150:0/1789705924 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f228c003a00 msgr2=0x7f228c003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:53:17.355 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:17.353+0000 7f22a8c7e640 1 --2- 172.21.15.150:0/1789705924 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f228c003a00 0x7f228c003e70 secure :-1 s=READY pgs=1842 cs=0 l=1 rev1=1 crypto rx=0x7f2294009ed0 tx=0x7f228c005830 comp rx=0 tx=0).stop 2024-09-17T05:53:17.355 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:17.353+0000 7f22a2d9d640 1 -- 172.21.15.150:0/1789705924 reap_dead start 2024-09-17T05:53:17.355 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:17.353+0000 7f22a8c7e640 1 -- 172.21.15.150:0/1789705924 shutdown_connections 2024-09-17T05:53:17.355 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:17.353+0000 7f22a8c7e640 1 -- 172.21.15.150:0/1789705924 >> 172.21.15.150:0/1789705924 conn(0x7f22a40b3fc0 msgr2=0x7f22a40b43d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:53:17.355 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:17.353+0000 7f22a8c7e640 1 -- 172.21.15.150:0/1789705924 shutdown_connections 2024-09-17T05:53:17.356 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:17.353+0000 7f22a8c7e640 1 -- 172.21.15.150:0/1789705924 wait complete. 2024-09-17T05:53:17.356 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:17.355+0000 7f22a8c7e640 1 Processor -- start 2024-09-17T05:53:17.356 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:17.355+0000 7f22a8c7e640 1 -- start start 2024-09-17T05:53:17.359 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:17.356+0000 7f22a8c7e640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f228c003a00 0x7f22a414bb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:53:17.359 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:17.356+0000 7f22a8c7e640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f22a41f7960 0x7f22a414ed10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:53:17.359 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:17.356+0000 7f22a8c7e640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f22a415d4c0 0x7f22a40ca930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:53:17.359 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:17.356+0000 7f22a8c7e640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f22a40d0010 con 0x7f22a41f7960 2024-09-17T05:53:17.360 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:17.356+0000 7f22a8c7e640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f22a4070b60 con 0x7f228c003a00 2024-09-17T05:53:17.360 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:17.356+0000 7f22a8c7e640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f22a40d0190 con 0x7f22a415d4c0 2024-09-17T05:53:17.360 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:17.356+0000 7f22a1d9b640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f22a41f7960 0x7f22a414ed10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:53:17.360 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:17.356+0000 7f22a1d9b640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f22a41f7960 0x7f22a414ed10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:34986/0 (socket says 172.21.15.150:34986) 2024-09-17T05:53:17.360 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:17.356+0000 7f22a1d9b640 1 -- 172.21.15.150:0/1680033221 learned_addr learned my addr 172.21.15.150:0/1680033221 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:53:17.360 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:17.356+0000 7f22a259c640 1 --2- 172.21.15.150:0/1680033221 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f228c003a00 0x7f22a414bb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:53:17.360 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:17.356+0000 7f22a2d9d640 1 --2- 172.21.15.150:0/1680033221 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f22a415d4c0 0x7f22a40ca930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:53:17.360 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:17.357+0000 7f22a1d9b640 1 -- 172.21.15.150:0/1680033221 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f22a415d4c0 msgr2=0x7f22a40ca930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:53:17.360 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:17.357+0000 7f22a1d9b640 1 --2- 172.21.15.150:0/1680033221 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f22a415d4c0 0x7f22a40ca930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:53:17.360 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:17.357+0000 7f22a1d9b640 1 -- 172.21.15.150:0/1680033221 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f228c003a00 msgr2=0x7f22a414bb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:53:17.360 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:17.357+0000 7f22a1d9b640 1 --2- 172.21.15.150:0/1680033221 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f228c003a00 0x7f22a414bb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:53:17.360 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:17.357+0000 7f22a1d9b640 1 -- 172.21.15.150:0/1680033221 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f22a414c0d0 con 0x7f22a41f7960 2024-09-17T05:53:17.361 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:17.357+0000 7f22a1d9b640 1 --2- 172.21.15.150:0/1680033221 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f22a41f7960 0x7f22a414ed10 secure :-1 s=READY pgs=1843 cs=0 l=1 rev1=1 crypto rx=0x7f2298011800 tx=0x7f2298011cc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:53:17.361 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:17.357+0000 7f2292ffd640 1 -- 172.21.15.150:0/1680033221 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f229801f070 con 0x7f22a41f7960 2024-09-17T05:53:17.361 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:17.357+0000 7f2292ffd640 1 -- 172.21.15.150:0/1680033221 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f229800fd50 con 0x7f22a41f7960 2024-09-17T05:53:17.361 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:17.357+0000 7f22a8c7e640 1 -- 172.21.15.150:0/1680033221 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f22a40c9130 con 0x7f22a41f7960 2024-09-17T05:53:17.361 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:17.357+0000 7f2292ffd640 1 -- 172.21.15.150:0/1680033221 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22980126b0 con 0x7f22a41f7960 2024-09-17T05:53:17.361 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:17.357+0000 7f22a8c7e640 1 -- 172.21.15.150:0/1680033221 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f22a40c8e50 con 0x7f22a41f7960 2024-09-17T05:53:17.362 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:17.358+0000 7f22a8c7e640 1 -- 172.21.15.150:0/1680033221 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f22a40c9300 con 0x7f22a41f7960 2024-09-17T05:53:17.362 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:17.359+0000 7f2292ffd640 1 -- 172.21.15.150:0/1680033221 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 45) ==== 104501+0+0 (secure 0 0 0) 0x7f2298022070 con 0x7f22a41f7960 2024-09-17T05:53:17.362 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:17.360+0000 7f2292ffd640 1 --2- 172.21.15.150:0/1680033221 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f228407ad50 0x7f228407d260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:53:17.362 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:17.360+0000 7f2292ffd640 1 -- 172.21.15.150:0/1680033221 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(141..141 src has 1..141) ==== 5905+0+0 (secure 0 0 0) 0x7f229809a7b0 con 0x7f22a41f7960 2024-09-17T05:53:17.362 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:17.360+0000 7f22a259c640 1 --2- 172.21.15.150:0/1680033221 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f228407ad50 0x7f228407d260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:53:17.362 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:17.360+0000 7f22a259c640 1 --2- 172.21.15.150:0/1680033221 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f228407ad50 0x7f228407d260 secure :-1 s=READY pgs=782 cs=0 l=1 rev1=1 crypto rx=0x7f2294009ed0 tx=0x7f229402d040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:53:17.366 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:17.364+0000 7f2292ffd640 1 -- 172.21.15.150:0/1680033221 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f22980640a0 con 0x7f22a41f7960 2024-09-17T05:53:17.538 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:17.537+0000 7f22a8c7e640 1 -- 172.21.15.150:0/1680033221 --> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f22a40b18c0 con 0x7f228407ad50 2024-09-17T05:53:17.543 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:17.541+0000 7f2292ffd640 1 -- 172.21.15.150:0/1680033221 <== mgr.4108 v2:172.21.15.176:6800/3631216395 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+244020 (secure 0 0 0) 0x7f22a40b18c0 con 0x7f228407ad50 2024-09-17T05:53:17.546 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-09-17T05:53:17.547 INFO:teuthology.orchestra.run.smithi150.stderr:dumped all 2024-09-17T05:53:17.549 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:17.544+0000 7f22a8c7e640 1 -- 172.21.15.150:0/1680033221 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f228407ad50 msgr2=0x7f228407d260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:53:17.549 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:17.544+0000 7f22a8c7e640 1 --2- 172.21.15.150:0/1680033221 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f228407ad50 0x7f228407d260 secure :-1 s=READY pgs=782 cs=0 l=1 rev1=1 crypto rx=0x7f2294009ed0 tx=0x7f229402d040 comp rx=0 tx=0).stop 2024-09-17T05:53:17.549 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:17.544+0000 7f22a8c7e640 1 -- 172.21.15.150:0/1680033221 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f22a41f7960 msgr2=0x7f22a414ed10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:53:17.549 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:17.544+0000 7f22a8c7e640 1 --2- 172.21.15.150:0/1680033221 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f22a41f7960 0x7f22a414ed10 secure :-1 s=READY pgs=1843 cs=0 l=1 rev1=1 crypto rx=0x7f2298011800 tx=0x7f2298011cc0 comp rx=0 tx=0).stop 2024-09-17T05:53:17.549 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:17.545+0000 7f22a8c7e640 1 -- 172.21.15.150:0/1680033221 shutdown_connections 2024-09-17T05:53:17.549 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:17.545+0000 7f22a8c7e640 1 --2- 172.21.15.150:0/1680033221 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f228407ad50 0x7f228407d260 unknown :-1 s=CLOSED pgs=782 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:53:17.549 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:17.545+0000 7f22a8c7e640 1 --2- 172.21.15.150:0/1680033221 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f22a415d4c0 0x7f22a40ca930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:53:17.549 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:17.545+0000 7f22a8c7e640 1 --2- 172.21.15.150:0/1680033221 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f22a41f7960 0x7f22a414ed10 unknown :-1 s=CLOSED pgs=1843 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:53:17.549 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:17.545+0000 7f22a8c7e640 1 --2- 172.21.15.150:0/1680033221 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f228c003a00 0x7f22a414bb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:53:17.549 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:17.545+0000 7f22a8c7e640 1 -- 172.21.15.150:0/1680033221 >> 172.21.15.150:0/1680033221 conn(0x7f22a40b3fc0 msgr2=0x7f22a4071280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:53:17.550 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:17.545+0000 7f22a8c7e640 1 -- 172.21.15.150:0/1680033221 shutdown_connections 2024-09-17T05:53:17.550 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:17.545+0000 7f22a8c7e640 1 -- 172.21.15.150:0/1680033221 wait complete. 2024-09-17T05:53:17.559 INFO:teuthology.orchestra.run.smithi150.stdout:{"pg_ready":true,"pg_map":{"version":481,"stamp":"2024-09-17T05:53:17.094124+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590972,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":109,"num_write_kb":1630,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":80,"ondisk_log_size":80,"up":108,"acting":108,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":70,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":7,"kb":754974720,"kb_used":1070272,"kb_used_data":14660,"kb_used_omap":12,"kb_used_meta":1055411,"kb_avail":753904448,"statfs":{"total":773094113280,"available":771998154752,"internally_reserved":0,"allocated":15011840,"data_stored":7268793,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":1080741424},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":604,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.581804"},"pg_stats":[{"pgid":"21.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:53:13.511622+0000","last_change":"2024-09-17T05:53:13.511622+0000","last_active":"2024-09-17T05:53:13.511622+0000","last_peered":"2024-09-17T05:53:13.511622+0000","last_clean":"2024-09-17T05:53:13.511622+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:53:13.511622+0000","last_undegraded":"2024-09-17T05:53:13.511622+0000","last_fullsized":"2024-09-17T05:53:13.511622+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:53:13.511622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:53:13.511622+0000","last_clean_scrub_stamp":"2024-09-17T05:53:13.511622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:53:13.511622+0000","last_change":"2024-09-17T05:53:13.511622+0000","last_active":"2024-09-17T05:53:13.511622+0000","last_peered":"2024-09-17T05:53:13.511622+0000","last_clean":"2024-09-17T05:53:13.511622+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:53:13.511622+0000","last_undegraded":"2024-09-17T05:53:13.511622+0000","last_fullsized":"2024-09-17T05:53:13.511622+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:53:13.511622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:53:13.511622+0000","last_clean_scrub_stamp":"2024-09-17T05:53:13.511622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:53:13.511622+0000","last_change":"2024-09-17T05:53:13.511622+0000","last_active":"2024-09-17T05:53:13.511622+0000","last_peered":"2024-09-17T05:53:13.511622+0000","last_clean":"2024-09-17T05:53:13.511622+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:53:13.511622+0000","last_undegraded":"2024-09-17T05:53:13.511622+0000","last_fullsized":"2024-09-17T05:53:13.511622+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:53:13.511622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:53:13.511622+0000","last_clean_scrub_stamp":"2024-09-17T05:53:13.511622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:53:13.511622+0000","last_change":"2024-09-17T05:53:13.511622+0000","last_active":"2024-09-17T05:53:13.511622+0000","last_peered":"2024-09-17T05:53:13.511622+0000","last_clean":"2024-09-17T05:53:13.511622+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:53:13.511622+0000","last_undegraded":"2024-09-17T05:53:13.511622+0000","last_fullsized":"2024-09-17T05:53:13.511622+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:53:13.511622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:53:13.511622+0000","last_clean_scrub_stamp":"2024-09-17T05:53:13.511622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.3b","version":"0'0","reported_seq":13,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-17T05:53:16.572208+0000","last_change":"2024-09-17T05:53:14.550770+0000","last_active":"2024-09-17T05:53:16.572208+0000","last_peered":"2024-09-17T05:53:16.572208+0000","last_clean":"2024-09-17T05:53:16.572208+0000","last_became_active":"2024-09-17T05:53:14.550289+0000","last_became_peered":"2024-09-17T05:53:14.550289+0000","last_unstale":"2024-09-17T05:53:16.572208+0000","last_undegraded":"2024-09-17T05:53:16.572208+0000","last_fullsized":"2024-09-17T05:53:16.572208+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:53:13.511622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:53:13.511622+0000","last_clean_scrub_stamp":"2024-09-17T05:53:13.511622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:23:14.461386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:53:13.511622+0000","last_change":"2024-09-17T05:53:13.511622+0000","last_active":"2024-09-17T05:53:13.511622+0000","last_peered":"2024-09-17T05:53:13.511622+0000","last_clean":"2024-09-17T05:53:13.511622+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:53:13.511622+0000","last_undegraded":"2024-09-17T05:53:13.511622+0000","last_fullsized":"2024-09-17T05:53:13.511622+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:53:13.511622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:53:13.511622+0000","last_clean_scrub_stamp":"2024-09-17T05:53:13.511622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.39","version":"0'0","reported_seq":1,"reported_epoch":139,"state":"creating+peering","last_fresh":"2024-09-17T05:53:13.527403+0000","last_change":"2024-09-17T05:53:13.527403+0000","last_active":"2024-09-17T05:53:13.511622+0000","last_peered":"2024-09-17T05:53:13.511622+0000","last_clean":"2024-09-17T05:53:13.511622+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:53:13.527403+0000","last_undegraded":"2024-09-17T05:53:13.527403+0000","last_fullsized":"2024-09-17T05:53:13.527403+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:53:13.511622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:53:13.511622+0000","last_clean_scrub_stamp":"2024-09-17T05:53:13.511622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:53:13.511622+0000","last_change":"2024-09-17T05:53:13.511622+0000","last_active":"2024-09-17T05:53:13.511622+0000","last_peered":"2024-09-17T05:53:13.511622+0000","last_clean":"2024-09-17T05:53:13.511622+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:53:13.511622+0000","last_undegraded":"2024-09-17T05:53:13.511622+0000","last_fullsized":"2024-09-17T05:53:13.511622+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:53:13.511622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:53:13.511622+0000","last_clean_scrub_stamp":"2024-09-17T05:53:13.511622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:53:13.511622+0000","last_change":"2024-09-17T05:53:13.511622+0000","last_active":"2024-09-17T05:53:13.511622+0000","last_peered":"2024-09-17T05:53:13.511622+0000","last_clean":"2024-09-17T05:53:13.511622+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:53:13.511622+0000","last_undegraded":"2024-09-17T05:53:13.511622+0000","last_fullsized":"2024-09-17T05:53:13.511622+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:53:13.511622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:53:13.511622+0000","last_clean_scrub_stamp":"2024-09-17T05:53:13.511622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.36","version":"0'0","reported_seq":13,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-17T05:53:15.527536+0000","last_change":"2024-09-17T05:53:14.556175+0000","last_active":"2024-09-17T05:53:15.527536+0000","last_peered":"2024-09-17T05:53:15.527536+0000","last_clean":"2024-09-17T05:53:15.527536+0000","last_became_active":"2024-09-17T05:53:14.555806+0000","last_became_peered":"2024-09-17T05:53:14.555806+0000","last_unstale":"2024-09-17T05:53:15.527536+0000","last_undegraded":"2024-09-17T05:53:15.527536+0000","last_fullsized":"2024-09-17T05:53:15.527536+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:53:13.511622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:53:13.511622+0000","last_clean_scrub_stamp":"2024-09-17T05:53:13.511622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:25:57.952915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:53:13.511622+0000","last_change":"2024-09-17T05:53:13.511622+0000","last_active":"2024-09-17T05:53:13.511622+0000","last_peered":"2024-09-17T05:53:13.511622+0000","last_clean":"2024-09-17T05:53:13.511622+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:53:13.511622+0000","last_undegraded":"2024-09-17T05:53:13.511622+0000","last_fullsized":"2024-09-17T05:53:13.511622+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:53:13.511622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:53:13.511622+0000","last_clean_scrub_stamp":"2024-09-17T05:53:13.511622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.34","version":"0'0","reported_seq":13,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-17T05:53:15.528949+0000","last_change":"2024-09-17T05:53:14.548964+0000","last_active":"2024-09-17T05:53:15.528949+0000","last_peered":"2024-09-17T05:53:15.528949+0000","last_clean":"2024-09-17T05:53:15.528949+0000","last_became_active":"2024-09-17T05:53:14.548601+0000","last_became_peered":"2024-09-17T05:53:14.548601+0000","last_unstale":"2024-09-17T05:53:15.528949+0000","last_undegraded":"2024-09-17T05:53:15.528949+0000","last_fullsized":"2024-09-17T05:53:15.528949+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:53:13.511622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:53:13.511622+0000","last_clean_scrub_stamp":"2024-09-17T05:53:13.511622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:37:55.173570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.33","version":"0'0","reported_seq":13,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-17T05:53:16.572443+0000","last_change":"2024-09-17T05:53:14.550313+0000","last_active":"2024-09-17T05:53:16.572443+0000","last_peered":"2024-09-17T05:53:16.572443+0000","last_clean":"2024-09-17T05:53:16.572443+0000","last_became_active":"2024-09-17T05:53:14.549928+0000","last_became_peered":"2024-09-17T05:53:14.549928+0000","last_unstale":"2024-09-17T05:53:16.572443+0000","last_undegraded":"2024-09-17T05:53:16.572443+0000","last_fullsized":"2024-09-17T05:53:16.572443+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:53:13.511622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:53:13.511622+0000","last_clean_scrub_stamp":"2024-09-17T05:53:13.511622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:24:22.329433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:53:13.511622+0000","last_change":"2024-09-17T05:53:13.511622+0000","last_active":"2024-09-17T05:53:13.511622+0000","last_peered":"2024-09-17T05:53:13.511622+0000","last_clean":"2024-09-17T05:53:13.511622+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:53:13.511622+0000","last_undegraded":"2024-09-17T05:53:13.511622+0000","last_fullsized":"2024-09-17T05:53:13.511622+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:53:13.511622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:53:13.511622+0000","last_clean_scrub_stamp":"2024-09-17T05:53:13.511622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.31","version":"0'0","reported_seq":13,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-17T05:53:15.528260+0000","last_change":"2024-09-17T05:53:14.554387+0000","last_active":"2024-09-17T05:53:15.528260+0000","last_peered":"2024-09-17T05:53:15.528260+0000","last_clean":"2024-09-17T05:53:15.528260+0000","last_became_active":"2024-09-17T05:53:14.553370+0000","last_became_peered":"2024-09-17T05:53:14.553370+0000","last_unstale":"2024-09-17T05:53:15.528260+0000","last_undegraded":"2024-09-17T05:53:15.528260+0000","last_fullsized":"2024-09-17T05:53:15.528260+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:53:13.511622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:53:13.511622+0000","last_clean_scrub_stamp":"2024-09-17T05:53:13.511622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:28:53.104884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:53:13.511622+0000","last_change":"2024-09-17T05:53:13.511622+0000","last_active":"2024-09-17T05:53:13.511622+0000","last_peered":"2024-09-17T05:53:13.511622+0000","last_clean":"2024-09-17T05:53:13.511622+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:53:13.511622+0000","last_undegraded":"2024-09-17T05:53:13.511622+0000","last_fullsized":"2024-09-17T05:53:13.511622+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:53:13.511622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:53:13.511622+0000","last_clean_scrub_stamp":"2024-09-17T05:53:13.511622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.2f","version":"0'0","reported_seq":13,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-17T05:53:15.528909+0000","last_change":"2024-09-17T05:53:14.555496+0000","last_active":"2024-09-17T05:53:15.528909+0000","last_peered":"2024-09-17T05:53:15.528909+0000","last_clean":"2024-09-17T05:53:15.528909+0000","last_became_active":"2024-09-17T05:53:14.554855+0000","last_became_peered":"2024-09-17T05:53:14.554855+0000","last_unstale":"2024-09-17T05:53:15.528909+0000","last_undegraded":"2024-09-17T05:53:15.528909+0000","last_fullsized":"2024-09-17T05:53:15.528909+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:53:13.511622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:53:13.511622+0000","last_clean_scrub_stamp":"2024-09-17T05:53:13.511622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:25:34.532282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:53:13.511622+0000","last_change":"2024-09-17T05:53:13.511622+0000","last_active":"2024-09-17T05:53:13.511622+0000","last_peered":"2024-09-17T05:53:13.511622+0000","last_clean":"2024-09-17T05:53:13.511622+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:53:13.511622+0000","last_undegraded":"2024-09-17T05:53:13.511622+0000","last_fullsized":"2024-09-17T05:53:13.511622+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:53:13.511622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:53:13.511622+0000","last_clean_scrub_stamp":"2024-09-17T05:53:13.511622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:53:13.511622+0000","last_change":"2024-09-17T05:53:13.511622+0000","last_active":"2024-09-17T05:53:13.511622+0000","last_peered":"2024-09-17T05:53:13.511622+0000","last_clean":"2024-09-17T05:53:13.511622+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:53:13.511622+0000","last_undegraded":"2024-09-17T05:53:13.511622+0000","last_fullsized":"2024-09-17T05:53:13.511622+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:53:13.511622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:53:13.511622+0000","last_clean_scrub_stamp":"2024-09-17T05:53:13.511622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:53:13.511622+0000","last_change":"2024-09-17T05:53:13.511622+0000","last_active":"2024-09-17T05:53:13.511622+0000","last_peered":"2024-09-17T05:53:13.511622+0000","last_clean":"2024-09-17T05:53:13.511622+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:53:13.511622+0000","last_undegraded":"2024-09-17T05:53:13.511622+0000","last_fullsized":"2024-09-17T05:53:13.511622+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:53:13.511622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:53:13.511622+0000","last_clean_scrub_stamp":"2024-09-17T05:53:13.511622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.2b","version":"0'0","reported_seq":13,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-17T05:53:15.528299+0000","last_change":"2024-09-17T05:53:14.546652+0000","last_active":"2024-09-17T05:53:15.528299+0000","last_peered":"2024-09-17T05:53:15.528299+0000","last_clean":"2024-09-17T05:53:15.528299+0000","last_became_active":"2024-09-17T05:53:14.546032+0000","last_became_peered":"2024-09-17T05:53:14.546032+0000","last_unstale":"2024-09-17T05:53:15.528299+0000","last_undegraded":"2024-09-17T05:53:15.528299+0000","last_fullsized":"2024-09-17T05:53:15.528299+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:53:13.511622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:53:13.511622+0000","last_clean_scrub_stamp":"2024-09-17T05:53:13.511622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:39:23.674754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:53:13.511622+0000","last_change":"2024-09-17T05:53:13.511622+0000","last_active":"2024-09-17T05:53:13.511622+0000","last_peered":"2024-09-17T05:53:13.511622+0000","last_clean":"2024-09-17T05:53:13.511622+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:53:13.511622+0000","last_undegraded":"2024-09-17T05:53:13.511622+0000","last_fullsized":"2024-09-17T05:53:13.511622+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:53:13.511622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:53:13.511622+0000","last_clean_scrub_stamp":"2024-09-17T05:53:13.511622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:53:13.511622+0000","last_change":"2024-09-17T05:53:13.511622+0000","last_active":"2024-09-17T05:53:13.511622+0000","last_peered":"2024-09-17T05:53:13.511622+0000","last_clean":"2024-09-17T05:53:13.511622+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:53:13.511622+0000","last_undegraded":"2024-09-17T05:53:13.511622+0000","last_fullsized":"2024-09-17T05:53:13.511622+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:53:13.511622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:53:13.511622+0000","last_clean_scrub_stamp":"2024-09-17T05:53:13.511622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.28","version":"0'0","reported_seq":13,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-17T05:53:15.527650+0000","last_change":"2024-09-17T05:53:14.547009+0000","last_active":"2024-09-17T05:53:15.527650+0000","last_peered":"2024-09-17T05:53:15.527650+0000","last_clean":"2024-09-17T05:53:15.527650+0000","last_became_active":"2024-09-17T05:53:14.546691+0000","last_became_peered":"2024-09-17T05:53:14.546691+0000","last_unstale":"2024-09-17T05:53:15.527650+0000","last_undegraded":"2024-09-17T05:53:15.527650+0000","last_fullsized":"2024-09-17T05:53:15.527650+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:53:13.511622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:53:13.511622+0000","last_clean_scrub_stamp":"2024-09-17T05:53:13.511622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:07:35.487105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:53:13.511622+0000","last_change":"2024-09-17T05:53:13.511622+0000","last_active":"2024-09-17T05:53:13.511622+0000","last_peered":"2024-09-17T05:53:13.511622+0000","last_clean":"2024-09-17T05:53:13.511622+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:53:13.511622+0000","last_undegraded":"2024-09-17T05:53:13.511622+0000","last_fullsized":"2024-09-17T05:53:13.511622+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:53:13.511622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:53:13.511622+0000","last_clean_scrub_stamp":"2024-09-17T05:53:13.511622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:53:13.511622+0000","last_change":"2024-09-17T05:53:13.511622+0000","last_active":"2024-09-17T05:53:13.511622+0000","last_peered":"2024-09-17T05:53:13.511622+0000","last_clean":"2024-09-17T05:53:13.511622+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:53:13.511622+0000","last_undegraded":"2024-09-17T05:53:13.511622+0000","last_fullsized":"2024-09-17T05:53:13.511622+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:53:13.511622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:53:13.511622+0000","last_clean_scrub_stamp":"2024-09-17T05:53:13.511622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:53:13.511622+0000","last_change":"2024-09-17T05:53:13.511622+0000","last_active":"2024-09-17T05:53:13.511622+0000","last_peered":"2024-09-17T05:53:13.511622+0000","last_clean":"2024-09-17T05:53:13.511622+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:53:13.511622+0000","last_undegraded":"2024-09-17T05:53:13.511622+0000","last_fullsized":"2024-09-17T05:53:13.511622+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:53:13.511622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:53:13.511622+0000","last_clean_scrub_stamp":"2024-09-17T05:53:13.511622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.24","version":"0'0","reported_seq":1,"reported_epoch":139,"state":"creating+peering","last_fresh":"2024-09-17T05:53:13.528051+0000","last_change":"2024-09-17T05:53:13.528051+0000","last_active":"2024-09-17T05:53:13.511622+0000","last_peered":"2024-09-17T05:53:13.511622+0000","last_clean":"2024-09-17T05:53:13.511622+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:53:13.528051+0000","last_undegraded":"2024-09-17T05:53:13.528051+0000","last_fullsized":"2024-09-17T05:53:13.528051+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:53:13.511622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:53:13.511622+0000","last_clean_scrub_stamp":"2024-09-17T05:53:13.511622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:53:13.511622+0000","last_change":"2024-09-17T05:53:13.511622+0000","last_active":"2024-09-17T05:53:13.511622+0000","last_peered":"2024-09-17T05:53:13.511622+0000","last_clean":"2024-09-17T05:53:13.511622+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:53:13.511622+0000","last_undegraded":"2024-09-17T05:53:13.511622+0000","last_fullsized":"2024-09-17T05:53:13.511622+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:53:13.511622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:53:13.511622+0000","last_clean_scrub_stamp":"2024-09-17T05:53:13.511622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:53:13.511622+0000","last_change":"2024-09-17T05:53:13.511622+0000","last_active":"2024-09-17T05:53:13.511622+0000","last_peered":"2024-09-17T05:53:13.511622+0000","last_clean":"2024-09-17T05:53:13.511622+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:53:13.511622+0000","last_undegraded":"2024-09-17T05:53:13.511622+0000","last_fullsized":"2024-09-17T05:53:13.511622+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:53:13.511622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:53:13.511622+0000","last_clean_scrub_stamp":"2024-09-17T05:53:13.511622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:53:13.511622+0000","last_change":"2024-09-17T05:53:13.511622+0000","last_active":"2024-09-17T05:53:13.511622+0000","last_peered":"2024-09-17T05:53:13.511622+0000","last_clean":"2024-09-17T05:53:13.511622+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:53:13.511622+0000","last_undegraded":"2024-09-17T05:53:13.511622+0000","last_fullsized":"2024-09-17T05:53:13.511622+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:53:13.511622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:53:13.511622+0000","last_clean_scrub_stamp":"2024-09-17T05:53:13.511622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:53:13.511622+0000","last_change":"2024-09-17T05:53:13.511622+0000","last_active":"2024-09-17T05:53:13.511622+0000","last_peered":"2024-09-17T05:53:13.511622+0000","last_clean":"2024-09-17T05:53:13.511622+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:53:13.511622+0000","last_undegraded":"2024-09-17T05:53:13.511622+0000","last_fullsized":"2024-09-17T05:53:13.511622+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:53:13.511622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:53:13.511622+0000","last_clean_scrub_stamp":"2024-09-17T05:53:13.511622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.1e","version":"0'0","reported_seq":13,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-17T05:53:15.527757+0000","last_change":"2024-09-17T05:53:14.548181+0000","last_active":"2024-09-17T05:53:15.527757+0000","last_peered":"2024-09-17T05:53:15.527757+0000","last_clean":"2024-09-17T05:53:15.527757+0000","last_became_active":"2024-09-17T05:53:14.547859+0000","last_became_peered":"2024-09-17T05:53:14.547859+0000","last_unstale":"2024-09-17T05:53:15.527757+0000","last_undegraded":"2024-09-17T05:53:15.527757+0000","last_fullsized":"2024-09-17T05:53:15.527757+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:53:13.511622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:53:13.511622+0000","last_clean_scrub_stamp":"2024-09-17T05:53:13.511622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:17:09.456622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.1f","version":"140'4","reported_seq":19,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-17T05:53:15.528586+0000","last_change":"2024-09-17T05:53:13.539463+0000","last_active":"2024-09-17T05:53:15.528586+0000","last_peered":"2024-09-17T05:53:15.528586+0000","last_clean":"2024-09-17T05:53:15.528586+0000","last_became_active":"2024-09-17T05:53:13.538767+0000","last_became_peered":"2024-09-17T05:53:13.538767+0000","last_unstale":"2024-09-17T05:53:15.528586+0000","last_undegraded":"2024-09-17T05:53:15.528586+0000","last_fullsized":"2024-09-17T05:53:15.528586+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:53:12.509392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:53:12.509392+0000","last_clean_scrub_stamp":"2024-09-17T05:53:12.509392+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:26:51.175390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:53:13.511622+0000","last_change":"2024-09-17T05:53:13.511622+0000","last_active":"2024-09-17T05:53:13.511622+0000","last_peered":"2024-09-17T05:53:13.511622+0000","last_clean":"2024-09-17T05:53:13.511622+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:53:13.511622+0000","last_undegraded":"2024-09-17T05:53:13.511622+0000","last_fullsized":"2024-09-17T05:53:13.511622+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:53:13.511622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:53:13.511622+0000","last_clean_scrub_stamp":"2024-09-17T05:53:13.511622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.1e","version":"0'0","reported_seq":1,"reported_epoch":138,"state":"creating+peering","last_fresh":"2024-09-17T05:53:12.519409+0000","last_change":"2024-09-17T05:53:12.519409+0000","last_active":"2024-09-17T05:53:12.509392+0000","last_peered":"2024-09-17T05:53:12.509392+0000","last_clean":"2024-09-17T05:53:12.509392+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:53:12.519409+0000","last_undegraded":"2024-09-17T05:53:12.519409+0000","last_fullsized":"2024-09-17T05:53:12.519409+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:53:12.509392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:53:12.509392+0000","last_clean_scrub_stamp":"2024-09-17T05:53:12.509392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:53:13.511622+0000","last_change":"2024-09-17T05:53:13.511622+0000","last_active":"2024-09-17T05:53:13.511622+0000","last_peered":"2024-09-17T05:53:13.511622+0000","last_clean":"2024-09-17T05:53:13.511622+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:53:13.511622+0000","last_undegraded":"2024-09-17T05:53:13.511622+0000","last_fullsized":"2024-09-17T05:53:13.511622+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:53:13.511622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:53:13.511622+0000","last_clean_scrub_stamp":"2024-09-17T05:53:13.511622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:53:12.509392+0000","last_change":"2024-09-17T05:53:12.509392+0000","last_active":"2024-09-17T05:53:12.509392+0000","last_peered":"2024-09-17T05:53:12.509392+0000","last_clean":"2024-09-17T05:53:12.509392+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:53:12.509392+0000","last_undegraded":"2024-09-17T05:53:12.509392+0000","last_fullsized":"2024-09-17T05:53:12.509392+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:53:12.509392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:53:12.509392+0000","last_clean_scrub_stamp":"2024-09-17T05:53:12.509392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.1d","version":"0'0","reported_seq":13,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-17T05:53:15.528652+0000","last_change":"2024-09-17T05:53:14.554059+0000","last_active":"2024-09-17T05:53:15.528652+0000","last_peered":"2024-09-17T05:53:15.528652+0000","last_clean":"2024-09-17T05:53:15.528652+0000","last_became_active":"2024-09-17T05:53:14.553753+0000","last_became_peered":"2024-09-17T05:53:14.553753+0000","last_unstale":"2024-09-17T05:53:15.528652+0000","last_undegraded":"2024-09-17T05:53:15.528652+0000","last_fullsized":"2024-09-17T05:53:15.528652+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:53:13.511622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:53:13.511622+0000","last_clean_scrub_stamp":"2024-09-17T05:53:13.511622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:58:54.333486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:53:12.509392+0000","last_change":"2024-09-17T05:53:12.509392+0000","last_active":"2024-09-17T05:53:12.509392+0000","last_peered":"2024-09-17T05:53:12.509392+0000","last_clean":"2024-09-17T05:53:12.509392+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:53:12.509392+0000","last_undegraded":"2024-09-17T05:53:12.509392+0000","last_fullsized":"2024-09-17T05:53:12.509392+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:53:12.509392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:53:12.509392+0000","last_clean_scrub_stamp":"2024-09-17T05:53:12.509392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:53:13.511622+0000","last_change":"2024-09-17T05:53:13.511622+0000","last_active":"2024-09-17T05:53:13.511622+0000","last_peered":"2024-09-17T05:53:13.511622+0000","last_clean":"2024-09-17T05:53:13.511622+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:53:13.511622+0000","last_undegraded":"2024-09-17T05:53:13.511622+0000","last_fullsized":"2024-09-17T05:53:13.511622+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:53:13.511622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:53:13.511622+0000","last_clean_scrub_stamp":"2024-09-17T05:53:13.511622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.1b","version":"0'0","reported_seq":1,"reported_epoch":138,"state":"creating+peering","last_fresh":"2024-09-17T05:53:12.514220+0000","last_change":"2024-09-17T05:53:12.514220+0000","last_active":"2024-09-17T05:53:12.509392+0000","last_peered":"2024-09-17T05:53:12.509392+0000","last_clean":"2024-09-17T05:53:12.509392+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:53:12.514220+0000","last_undegraded":"2024-09-17T05:53:12.514220+0000","last_fullsized":"2024-09-17T05:53:12.514220+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:53:12.509392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:53:12.509392+0000","last_clean_scrub_stamp":"2024-09-17T05:53:12.509392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:53:13.511622+0000","last_change":"2024-09-17T05:53:13.511622+0000","last_active":"2024-09-17T05:53:13.511622+0000","last_peered":"2024-09-17T05:53:13.511622+0000","last_clean":"2024-09-17T05:53:13.511622+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:53:13.511622+0000","last_undegraded":"2024-09-17T05:53:13.511622+0000","last_fullsized":"2024-09-17T05:53:13.511622+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:53:13.511622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:53:13.511622+0000","last_clean_scrub_stamp":"2024-09-17T05:53:13.511622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.1a","version":"140'1","reported_seq":16,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-17T05:53:16.571986+0000","last_change":"2024-09-17T05:53:13.534883+0000","last_active":"2024-09-17T05:53:16.571986+0000","last_peered":"2024-09-17T05:53:16.571986+0000","last_clean":"2024-09-17T05:53:16.571986+0000","last_became_active":"2024-09-17T05:53:13.534547+0000","last_became_peered":"2024-09-17T05:53:13.534547+0000","last_unstale":"2024-09-17T05:53:16.571986+0000","last_undegraded":"2024-09-17T05:53:16.571986+0000","last_fullsized":"2024-09-17T05:53:16.571986+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:53:12.509392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:53:12.509392+0000","last_clean_scrub_stamp":"2024-09-17T05:53:12.509392+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:24:20.737152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:53:13.511622+0000","last_change":"2024-09-17T05:53:13.511622+0000","last_active":"2024-09-17T05:53:13.511622+0000","last_peered":"2024-09-17T05:53:13.511622+0000","last_clean":"2024-09-17T05:53:13.511622+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:53:13.511622+0000","last_undegraded":"2024-09-17T05:53:13.511622+0000","last_fullsized":"2024-09-17T05:53:13.511622+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:53:13.511622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:53:13.511622+0000","last_clean_scrub_stamp":"2024-09-17T05:53:13.511622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.19","version":"0'0","reported_seq":1,"reported_epoch":138,"state":"creating+peering","last_fresh":"2024-09-17T05:53:12.514359+0000","last_change":"2024-09-17T05:53:12.514359+0000","last_active":"2024-09-17T05:53:12.509392+0000","last_peered":"2024-09-17T05:53:12.509392+0000","last_clean":"2024-09-17T05:53:12.509392+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:53:12.514359+0000","last_undegraded":"2024-09-17T05:53:12.514359+0000","last_fullsized":"2024-09-17T05:53:12.514359+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:53:12.509392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:53:12.509392+0000","last_clean_scrub_stamp":"2024-09-17T05:53:12.509392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.19","version":"0'0","reported_seq":13,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-17T05:53:16.572391+0000","last_change":"2024-09-17T05:53:14.537974+0000","last_active":"2024-09-17T05:53:16.572391+0000","last_peered":"2024-09-17T05:53:16.572391+0000","last_clean":"2024-09-17T05:53:16.572391+0000","last_became_active":"2024-09-17T05:53:14.537611+0000","last_became_peered":"2024-09-17T05:53:14.537611+0000","last_unstale":"2024-09-17T05:53:16.572391+0000","last_undegraded":"2024-09-17T05:53:16.572391+0000","last_fullsized":"2024-09-17T05:53:16.572391+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:53:13.511622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:53:13.511622+0000","last_clean_scrub_stamp":"2024-09-17T05:53:13.511622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:38:57.194890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:53:12.509392+0000","last_change":"2024-09-17T05:53:12.509392+0000","last_active":"2024-09-17T05:53:12.509392+0000","last_peered":"2024-09-17T05:53:12.509392+0000","last_clean":"2024-09-17T05:53:12.509392+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:53:12.509392+0000","last_undegraded":"2024-09-17T05:53:12.509392+0000","last_fullsized":"2024-09-17T05:53:12.509392+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:53:12.509392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:53:12.509392+0000","last_clean_scrub_stamp":"2024-09-17T05:53:12.509392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.16","version":"0'0","reported_seq":13,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-17T05:53:16.572405+0000","last_change":"2024-09-17T05:53:14.542412+0000","last_active":"2024-09-17T05:53:16.572405+0000","last_peered":"2024-09-17T05:53:16.572405+0000","last_clean":"2024-09-17T05:53:16.572405+0000","last_became_active":"2024-09-17T05:53:14.541943+0000","last_became_peered":"2024-09-17T05:53:14.541943+0000","last_unstale":"2024-09-17T05:53:16.572405+0000","last_undegraded":"2024-09-17T05:53:16.572405+0000","last_fullsized":"2024-09-17T05:53:16.572405+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:53:13.511622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:53:13.511622+0000","last_clean_scrub_stamp":"2024-09-17T05:53:13.511622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:06:39.200488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.17","version":"0'0","reported_seq":1,"reported_epoch":138,"state":"creating+peering","last_fresh":"2024-09-17T05:53:12.518858+0000","last_change":"2024-09-17T05:53:12.518858+0000","last_active":"2024-09-17T05:53:12.509392+0000","last_peered":"2024-09-17T05:53:12.509392+0000","last_clean":"2024-09-17T05:53:12.509392+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:53:12.518858+0000","last_undegraded":"2024-09-17T05:53:12.518858+0000","last_fullsized":"2024-09-17T05:53:12.518858+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:53:12.509392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:53:12.509392+0000","last_clean_scrub_stamp":"2024-09-17T05:53:12.509392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.17","version":"0'0","reported_seq":13,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-17T05:53:15.528601+0000","last_change":"2024-09-17T05:53:14.555136+0000","last_active":"2024-09-17T05:53:15.528601+0000","last_peered":"2024-09-17T05:53:15.528601+0000","last_clean":"2024-09-17T05:53:15.528601+0000","last_became_active":"2024-09-17T05:53:14.554514+0000","last_became_peered":"2024-09-17T05:53:14.554514+0000","last_unstale":"2024-09-17T05:53:15.528601+0000","last_undegraded":"2024-09-17T05:53:15.528601+0000","last_fullsized":"2024-09-17T05:53:15.528601+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:53:13.511622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:53:13.511622+0000","last_clean_scrub_stamp":"2024-09-17T05:53:13.511622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:41:18.370466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.16","version":"0'0","reported_seq":15,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-17T05:53:15.528222+0000","last_change":"2024-09-17T05:53:13.534637+0000","last_active":"2024-09-17T05:53:15.528222+0000","last_peered":"2024-09-17T05:53:15.528222+0000","last_clean":"2024-09-17T05:53:15.528222+0000","last_became_active":"2024-09-17T05:53:13.534316+0000","last_became_peered":"2024-09-17T05:53:13.534316+0000","last_unstale":"2024-09-17T05:53:15.528222+0000","last_undegraded":"2024-09-17T05:53:15.528222+0000","last_fullsized":"2024-09-17T05:53:15.528222+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:53:12.509392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:53:12.509392+0000","last_clean_scrub_stamp":"2024-09-17T05:53:12.509392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:17:34.499459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:53:13.511622+0000","last_change":"2024-09-17T05:53:13.511622+0000","last_active":"2024-09-17T05:53:13.511622+0000","last_peered":"2024-09-17T05:53:13.511622+0000","last_clean":"2024-09-17T05:53:13.511622+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:53:13.511622+0000","last_undegraded":"2024-09-17T05:53:13.511622+0000","last_fullsized":"2024-09-17T05:53:13.511622+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:53:13.511622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:53:13.511622+0000","last_clean_scrub_stamp":"2024-09-17T05:53:13.511622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.14","version":"0'0","reported_seq":10,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-09-17T05:53:13.542150+0000","last_change":"2024-09-17T05:53:13.541151+0000","last_active":"2024-09-17T05:53:13.542150+0000","last_peered":"2024-09-17T05:53:13.542150+0000","last_clean":"2024-09-17T05:53:13.542150+0000","last_became_active":"2024-09-17T05:53:13.540717+0000","last_became_peered":"2024-09-17T05:53:13.540717+0000","last_unstale":"2024-09-17T05:53:13.542150+0000","last_undegraded":"2024-09-17T05:53:13.542150+0000","last_fullsized":"2024-09-17T05:53:13.542150+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:53:12.509392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:53:12.509392+0000","last_clean_scrub_stamp":"2024-09-17T05:53:12.509392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:54:36.994315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:53:13.511622+0000","last_change":"2024-09-17T05:53:13.511622+0000","last_active":"2024-09-17T05:53:13.511622+0000","last_peered":"2024-09-17T05:53:13.511622+0000","last_clean":"2024-09-17T05:53:13.511622+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:53:13.511622+0000","last_undegraded":"2024-09-17T05:53:13.511622+0000","last_fullsized":"2024-09-17T05:53:13.511622+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:53:13.511622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:53:13.511622+0000","last_clean_scrub_stamp":"2024-09-17T05:53:13.511622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.13","version":"0'0","reported_seq":1,"reported_epoch":138,"state":"creating+peering","last_fresh":"2024-09-17T05:53:12.516491+0000","last_change":"2024-09-17T05:53:12.516491+0000","last_active":"2024-09-17T05:53:12.509392+0000","last_peered":"2024-09-17T05:53:12.509392+0000","last_clean":"2024-09-17T05:53:12.509392+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:53:12.516491+0000","last_undegraded":"2024-09-17T05:53:12.516491+0000","last_fullsized":"2024-09-17T05:53:12.516491+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:53:12.509392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:53:12.509392+0000","last_clean_scrub_stamp":"2024-09-17T05:53:12.509392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:53:13.511622+0000","last_change":"2024-09-17T05:53:13.511622+0000","last_active":"2024-09-17T05:53:13.511622+0000","last_peered":"2024-09-17T05:53:13.511622+0000","last_clean":"2024-09-17T05:53:13.511622+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:53:13.511622+0000","last_undegraded":"2024-09-17T05:53:13.511622+0000","last_fullsized":"2024-09-17T05:53:13.511622+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:53:13.511622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:53:13.511622+0000","last_clean_scrub_stamp":"2024-09-17T05:53:13.511622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.12","version":"0'0","reported_seq":1,"reported_epoch":138,"state":"creating+peering","last_fresh":"2024-09-17T05:53:12.516394+0000","last_change":"2024-09-17T05:53:12.516394+0000","last_active":"2024-09-17T05:53:12.509392+0000","last_peered":"2024-09-17T05:53:12.509392+0000","last_clean":"2024-09-17T05:53:12.509392+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:53:12.516394+0000","last_undegraded":"2024-09-17T05:53:12.516394+0000","last_fullsized":"2024-09-17T05:53:12.516394+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:53:12.509392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:53:12.509392+0000","last_clean_scrub_stamp":"2024-09-17T05:53:12.509392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.10","version":"0'0","reported_seq":13,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-17T05:53:16.572253+0000","last_change":"2024-09-17T05:53:14.549168+0000","last_active":"2024-09-17T05:53:16.572253+0000","last_peered":"2024-09-17T05:53:16.572253+0000","last_clean":"2024-09-17T05:53:16.572253+0000","last_became_active":"2024-09-17T05:53:14.548829+0000","last_became_peered":"2024-09-17T05:53:14.548829+0000","last_unstale":"2024-09-17T05:53:16.572253+0000","last_undegraded":"2024-09-17T05:53:16.572253+0000","last_fullsized":"2024-09-17T05:53:16.572253+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:53:13.511622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:53:13.511622+0000","last_clean_scrub_stamp":"2024-09-17T05:53:13.511622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:48:29.849949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.11","version":"0'0","reported_seq":1,"reported_epoch":138,"state":"creating+peering","last_fresh":"2024-09-17T05:53:12.516984+0000","last_change":"2024-09-17T05:53:12.516984+0000","last_active":"2024-09-17T05:53:12.509392+0000","last_peered":"2024-09-17T05:53:12.509392+0000","last_clean":"2024-09-17T05:53:12.509392+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:53:12.516984+0000","last_undegraded":"2024-09-17T05:53:12.516984+0000","last_fullsized":"2024-09-17T05:53:12.516984+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:53:12.509392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:53:12.509392+0000","last_clean_scrub_stamp":"2024-09-17T05:53:12.509392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:53:13.511622+0000","last_change":"2024-09-17T05:53:13.511622+0000","last_active":"2024-09-17T05:53:13.511622+0000","last_peered":"2024-09-17T05:53:13.511622+0000","last_clean":"2024-09-17T05:53:13.511622+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:53:13.511622+0000","last_undegraded":"2024-09-17T05:53:13.511622+0000","last_fullsized":"2024-09-17T05:53:13.511622+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:53:13.511622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:53:13.511622+0000","last_clean_scrub_stamp":"2024-09-17T05:53:13.511622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.10","version":"0'0","reported_seq":1,"reported_epoch":138,"state":"creating+peering","last_fresh":"2024-09-17T05:53:12.514187+0000","last_change":"2024-09-17T05:53:12.514187+0000","last_active":"2024-09-17T05:53:12.509392+0000","last_peered":"2024-09-17T05:53:12.509392+0000","last_clean":"2024-09-17T05:53:12.509392+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:53:12.514187+0000","last_undegraded":"2024-09-17T05:53:12.514187+0000","last_fullsized":"2024-09-17T05:53:12.514187+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:53:12.509392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:53:12.509392+0000","last_clean_scrub_stamp":"2024-09-17T05:53:12.509392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.e","version":"0'0","reported_seq":13,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-17T05:53:15.528010+0000","last_change":"2024-09-17T05:53:14.548943+0000","last_active":"2024-09-17T05:53:15.528010+0000","last_peered":"2024-09-17T05:53:15.528010+0000","last_clean":"2024-09-17T05:53:15.528010+0000","last_became_active":"2024-09-17T05:53:14.547493+0000","last_became_peered":"2024-09-17T05:53:14.547493+0000","last_unstale":"2024-09-17T05:53:15.528010+0000","last_undegraded":"2024-09-17T05:53:15.528010+0000","last_fullsized":"2024-09-17T05:53:15.528010+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:53:13.511622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:53:13.511622+0000","last_clean_scrub_stamp":"2024-09-17T05:53:13.511622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:11:54.994505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.f","version":"140'1","reported_seq":16,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-17T05:53:16.572123+0000","last_change":"2024-09-17T05:53:13.538801+0000","last_active":"2024-09-17T05:53:16.572123+0000","last_peered":"2024-09-17T05:53:16.572123+0000","last_clean":"2024-09-17T05:53:16.572123+0000","last_became_active":"2024-09-17T05:53:13.538469+0000","last_became_peered":"2024-09-17T05:53:13.538469+0000","last_unstale":"2024-09-17T05:53:16.572123+0000","last_undegraded":"2024-09-17T05:53:16.572123+0000","last_fullsized":"2024-09-17T05:53:16.572123+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:53:12.509392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:53:12.509392+0000","last_clean_scrub_stamp":"2024-09-17T05:53:12.509392+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:33:19.361630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:53:13.511622+0000","last_change":"2024-09-17T05:53:13.511622+0000","last_active":"2024-09-17T05:53:13.511622+0000","last_peered":"2024-09-17T05:53:13.511622+0000","last_clean":"2024-09-17T05:53:13.511622+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:53:13.511622+0000","last_undegraded":"2024-09-17T05:53:13.511622+0000","last_fullsized":"2024-09-17T05:53:13.511622+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:53:13.511622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:53:13.511622+0000","last_clean_scrub_stamp":"2024-09-17T05:53:13.511622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.e","version":"0'0","reported_seq":1,"reported_epoch":138,"state":"creating+peering","last_fresh":"2024-09-17T05:53:12.518809+0000","last_change":"2024-09-17T05:53:12.518809+0000","last_active":"2024-09-17T05:53:12.509392+0000","last_peered":"2024-09-17T05:53:12.509392+0000","last_clean":"2024-09-17T05:53:12.509392+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:53:12.518809+0000","last_undegraded":"2024-09-17T05:53:12.518809+0000","last_fullsized":"2024-09-17T05:53:12.518809+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:53:12.509392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:53:12.509392+0000","last_clean_scrub_stamp":"2024-09-17T05:53:12.509392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:53:13.511622+0000","last_change":"2024-09-17T05:53:13.511622+0000","last_active":"2024-09-17T05:53:13.511622+0000","last_peered":"2024-09-17T05:53:13.511622+0000","last_clean":"2024-09-17T05:53:13.511622+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:53:13.511622+0000","last_undegraded":"2024-09-17T05:53:13.511622+0000","last_fullsized":"2024-09-17T05:53:13.511622+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:53:13.511622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:53:13.511622+0000","last_clean_scrub_stamp":"2024-09-17T05:53:13.511622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.d","version":"0'0","reported_seq":1,"reported_epoch":138,"state":"creating+peering","last_fresh":"2024-09-17T05:53:12.514221+0000","last_change":"2024-09-17T05:53:12.514221+0000","last_active":"2024-09-17T05:53:12.509392+0000","last_peered":"2024-09-17T05:53:12.509392+0000","last_clean":"2024-09-17T05:53:12.509392+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:53:12.514221+0000","last_undegraded":"2024-09-17T05:53:12.514221+0000","last_fullsized":"2024-09-17T05:53:12.514221+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:53:12.509392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:53:12.509392+0000","last_clean_scrub_stamp":"2024-09-17T05:53:12.509392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:53:13.511622+0000","last_change":"2024-09-17T05:53:13.511622+0000","last_active":"2024-09-17T05:53:13.511622+0000","last_peered":"2024-09-17T05:53:13.511622+0000","last_clean":"2024-09-17T05:53:13.511622+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:53:13.511622+0000","last_undegraded":"2024-09-17T05:53:13.511622+0000","last_fullsized":"2024-09-17T05:53:13.511622+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:53:13.511622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:53:13.511622+0000","last_clean_scrub_stamp":"2024-09-17T05:53:13.511622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.c","version":"0'0","reported_seq":1,"reported_epoch":138,"state":"creating+peering","last_fresh":"2024-09-17T05:53:12.518716+0000","last_change":"2024-09-17T05:53:12.518716+0000","last_active":"2024-09-17T05:53:12.509392+0000","last_peered":"2024-09-17T05:53:12.509392+0000","last_clean":"2024-09-17T05:53:12.509392+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:53:12.518716+0000","last_undegraded":"2024-09-17T05:53:12.518716+0000","last_fullsized":"2024-09-17T05:53:12.518716+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:53:12.509392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:53:12.509392+0000","last_clean_scrub_stamp":"2024-09-17T05:53:12.509392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:53:13.511622+0000","last_change":"2024-09-17T05:53:13.511622+0000","last_active":"2024-09-17T05:53:13.511622+0000","last_peered":"2024-09-17T05:53:13.511622+0000","last_clean":"2024-09-17T05:53:13.511622+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:53:13.511622+0000","last_undegraded":"2024-09-17T05:53:13.511622+0000","last_fullsized":"2024-09-17T05:53:13.511622+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:53:13.511622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:53:13.511622+0000","last_clean_scrub_stamp":"2024-09-17T05:53:13.511622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.b","version":"0'0","reported_seq":10,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-09-17T05:53:13.538312+0000","last_change":"2024-09-17T05:53:13.536538+0000","last_active":"2024-09-17T05:53:13.538312+0000","last_peered":"2024-09-17T05:53:13.538312+0000","last_clean":"2024-09-17T05:53:13.538312+0000","last_became_active":"2024-09-17T05:53:13.536195+0000","last_became_peered":"2024-09-17T05:53:13.536195+0000","last_unstale":"2024-09-17T05:53:13.538312+0000","last_undegraded":"2024-09-17T05:53:13.538312+0000","last_fullsized":"2024-09-17T05:53:13.538312+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:53:12.509392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:53:12.509392+0000","last_clean_scrub_stamp":"2024-09-17T05:53:12.509392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:49:58.949468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.b","version":"0'0","reported_seq":1,"reported_epoch":139,"state":"creating+peering","last_fresh":"2024-09-17T05:53:13.528919+0000","last_change":"2024-09-17T05:53:13.528919+0000","last_active":"2024-09-17T05:53:13.511622+0000","last_peered":"2024-09-17T05:53:13.511622+0000","last_clean":"2024-09-17T05:53:13.511622+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:53:13.528919+0000","last_undegraded":"2024-09-17T05:53:13.528919+0000","last_fullsized":"2024-09-17T05:53:13.528919+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:53:13.511622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:53:13.511622+0000","last_clean_scrub_stamp":"2024-09-17T05:53:13.511622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.a","version":"0'0","reported_seq":15,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-17T05:53:15.527504+0000","last_change":"2024-09-17T05:53:13.539072+0000","last_active":"2024-09-17T05:53:15.527504+0000","last_peered":"2024-09-17T05:53:15.527504+0000","last_clean":"2024-09-17T05:53:15.527504+0000","last_became_active":"2024-09-17T05:53:13.538503+0000","last_became_peered":"2024-09-17T05:53:13.538503+0000","last_unstale":"2024-09-17T05:53:15.527504+0000","last_undegraded":"2024-09-17T05:53:15.527504+0000","last_fullsized":"2024-09-17T05:53:15.527504+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:53:12.509392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:53:12.509392+0000","last_clean_scrub_stamp":"2024-09-17T05:53:12.509392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:17:17.870202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:53:13.511622+0000","last_change":"2024-09-17T05:53:13.511622+0000","last_active":"2024-09-17T05:53:13.511622+0000","last_peered":"2024-09-17T05:53:13.511622+0000","last_clean":"2024-09-17T05:53:13.511622+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:53:13.511622+0000","last_undegraded":"2024-09-17T05:53:13.511622+0000","last_fullsized":"2024-09-17T05:53:13.511622+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:53:13.511622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:53:13.511622+0000","last_clean_scrub_stamp":"2024-09-17T05:53:13.511622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.9","version":"0'0","reported_seq":15,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-17T05:53:15.528312+0000","last_change":"2024-09-17T05:53:13.539530+0000","last_active":"2024-09-17T05:53:15.528312+0000","last_peered":"2024-09-17T05:53:15.528312+0000","last_clean":"2024-09-17T05:53:15.528312+0000","last_became_active":"2024-09-17T05:53:13.539215+0000","last_became_peered":"2024-09-17T05:53:13.539215+0000","last_unstale":"2024-09-17T05:53:15.528312+0000","last_undegraded":"2024-09-17T05:53:15.528312+0000","last_fullsized":"2024-09-17T05:53:15.528312+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:53:12.509392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:53:12.509392+0000","last_clean_scrub_stamp":"2024-09-17T05:53:12.509392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:51:24.706974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.9","version":"0'0","reported_seq":1,"reported_epoch":139,"state":"creating+peering","last_fresh":"2024-09-17T05:53:13.528602+0000","last_change":"2024-09-17T05:53:13.528602+0000","last_active":"2024-09-17T05:53:13.511622+0000","last_peered":"2024-09-17T05:53:13.511622+0000","last_clean":"2024-09-17T05:53:13.511622+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:53:13.528602+0000","last_undegraded":"2024-09-17T05:53:13.528602+0000","last_fullsized":"2024-09-17T05:53:13.528602+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:53:13.511622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:53:13.511622+0000","last_clean_scrub_stamp":"2024-09-17T05:53:13.511622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.8","version":"0'0","reported_seq":1,"reported_epoch":138,"state":"creating+peering","last_fresh":"2024-09-17T05:53:12.516694+0000","last_change":"2024-09-17T05:53:12.516694+0000","last_active":"2024-09-17T05:53:12.509392+0000","last_peered":"2024-09-17T05:53:12.509392+0000","last_clean":"2024-09-17T05:53:12.509392+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:53:12.516694+0000","last_undegraded":"2024-09-17T05:53:12.516694+0000","last_fullsized":"2024-09-17T05:53:12.516694+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:53:12.509392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:53:12.509392+0000","last_clean_scrub_stamp":"2024-09-17T05:53:12.509392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.6","version":"0'0","reported_seq":13,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-17T05:53:16.572412+0000","last_change":"2024-09-17T05:53:14.549803+0000","last_active":"2024-09-17T05:53:16.572412+0000","last_peered":"2024-09-17T05:53:16.572412+0000","last_clean":"2024-09-17T05:53:16.572412+0000","last_became_active":"2024-09-17T05:53:14.549429+0000","last_became_peered":"2024-09-17T05:53:14.549429+0000","last_unstale":"2024-09-17T05:53:16.572412+0000","last_undegraded":"2024-09-17T05:53:16.572412+0000","last_fullsized":"2024-09-17T05:53:16.572412+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:53:13.511622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:53:13.511622+0000","last_clean_scrub_stamp":"2024-09-17T05:53:13.511622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:11:59.457461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.7","version":"140'2","reported_seq":17,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-17T05:53:15.529063+0000","last_change":"2024-09-17T05:53:13.541601+0000","last_active":"2024-09-17T05:53:15.529063+0000","last_peered":"2024-09-17T05:53:15.529063+0000","last_clean":"2024-09-17T05:53:15.529063+0000","last_became_active":"2024-09-17T05:53:13.541201+0000","last_became_peered":"2024-09-17T05:53:13.541201+0000","last_unstale":"2024-09-17T05:53:15.529063+0000","last_undegraded":"2024-09-17T05:53:15.529063+0000","last_fullsized":"2024-09-17T05:53:15.529063+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:53:12.509392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:53:12.509392+0000","last_clean_scrub_stamp":"2024-09-17T05:53:12.509392+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:58:54.719539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:53:13.511622+0000","last_change":"2024-09-17T05:53:13.511622+0000","last_active":"2024-09-17T05:53:13.511622+0000","last_peered":"2024-09-17T05:53:13.511622+0000","last_clean":"2024-09-17T05:53:13.511622+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:53:13.511622+0000","last_undegraded":"2024-09-17T05:53:13.511622+0000","last_fullsized":"2024-09-17T05:53:13.511622+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:53:13.511622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:53:13.511622+0000","last_clean_scrub_stamp":"2024-09-17T05:53:13.511622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.6","version":"0'0","reported_seq":1,"reported_epoch":138,"state":"creating+peering","last_fresh":"2024-09-17T05:53:12.517509+0000","last_change":"2024-09-17T05:53:12.517509+0000","last_active":"2024-09-17T05:53:12.509392+0000","last_peered":"2024-09-17T05:53:12.509392+0000","last_clean":"2024-09-17T05:53:12.509392+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:53:12.517509+0000","last_undegraded":"2024-09-17T05:53:12.517509+0000","last_fullsized":"2024-09-17T05:53:12.517509+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:53:12.509392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:53:12.509392+0000","last_clean_scrub_stamp":"2024-09-17T05:53:12.509392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:53:13.511622+0000","last_change":"2024-09-17T05:53:13.511622+0000","last_active":"2024-09-17T05:53:13.511622+0000","last_peered":"2024-09-17T05:53:13.511622+0000","last_clean":"2024-09-17T05:53:13.511622+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:53:13.511622+0000","last_undegraded":"2024-09-17T05:53:13.511622+0000","last_fullsized":"2024-09-17T05:53:13.511622+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:53:13.511622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:53:13.511622+0000","last_clean_scrub_stamp":"2024-09-17T05:53:13.511622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.5","version":"0'0","reported_seq":1,"reported_epoch":138,"state":"creating+peering","last_fresh":"2024-09-17T05:53:12.516944+0000","last_change":"2024-09-17T05:53:12.516944+0000","last_active":"2024-09-17T05:53:12.509392+0000","last_peered":"2024-09-17T05:53:12.509392+0000","last_clean":"2024-09-17T05:53:12.509392+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:53:12.516944+0000","last_undegraded":"2024-09-17T05:53:12.516944+0000","last_fullsized":"2024-09-17T05:53:12.516944+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:53:12.509392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:53:12.509392+0000","last_clean_scrub_stamp":"2024-09-17T05:53:12.509392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:53:13.511622+0000","last_change":"2024-09-17T05:53:13.511622+0000","last_active":"2024-09-17T05:53:13.511622+0000","last_peered":"2024-09-17T05:53:13.511622+0000","last_clean":"2024-09-17T05:53:13.511622+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:53:13.511622+0000","last_undegraded":"2024-09-17T05:53:13.511622+0000","last_fullsized":"2024-09-17T05:53:13.511622+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:53:13.511622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:53:13.511622+0000","last_clean_scrub_stamp":"2024-09-17T05:53:13.511622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.4","version":"0'0","reported_seq":1,"reported_epoch":138,"state":"creating+peering","last_fresh":"2024-09-17T05:53:12.516971+0000","last_change":"2024-09-17T05:53:12.516971+0000","last_active":"2024-09-17T05:53:12.509392+0000","last_peered":"2024-09-17T05:53:12.509392+0000","last_clean":"2024-09-17T05:53:12.509392+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:53:12.516971+0000","last_undegraded":"2024-09-17T05:53:12.516971+0000","last_fullsized":"2024-09-17T05:53:12.516971+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:53:12.509392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:53:12.509392+0000","last_clean_scrub_stamp":"2024-09-17T05:53:12.509392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:53:13.511622+0000","last_change":"2024-09-17T05:53:13.511622+0000","last_active":"2024-09-17T05:53:13.511622+0000","last_peered":"2024-09-17T05:53:13.511622+0000","last_clean":"2024-09-17T05:53:13.511622+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:53:13.511622+0000","last_undegraded":"2024-09-17T05:53:13.511622+0000","last_fullsized":"2024-09-17T05:53:13.511622+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:53:13.511622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:53:13.511622+0000","last_clean_scrub_stamp":"2024-09-17T05:53:13.511622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.3","version":"0'0","reported_seq":10,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-09-17T05:53:13.535257+0000","last_change":"2024-09-17T05:53:13.534284+0000","last_active":"2024-09-17T05:53:13.535257+0000","last_peered":"2024-09-17T05:53:13.535257+0000","last_clean":"2024-09-17T05:53:13.535257+0000","last_became_active":"2024-09-17T05:53:13.533933+0000","last_became_peered":"2024-09-17T05:53:13.533933+0000","last_unstale":"2024-09-17T05:53:13.535257+0000","last_undegraded":"2024-09-17T05:53:13.535257+0000","last_fullsized":"2024-09-17T05:53:13.535257+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:53:12.509392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:53:12.509392+0000","last_clean_scrub_stamp":"2024-09-17T05:53:12.509392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:26:31.492927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.3","version":"0'0","reported_seq":13,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-17T05:53:16.572509+0000","last_change":"2024-09-17T05:53:14.538521+0000","last_active":"2024-09-17T05:53:16.572509+0000","last_peered":"2024-09-17T05:53:16.572509+0000","last_clean":"2024-09-17T05:53:16.572509+0000","last_became_active":"2024-09-17T05:53:14.538059+0000","last_became_peered":"2024-09-17T05:53:14.538059+0000","last_unstale":"2024-09-17T05:53:16.572509+0000","last_undegraded":"2024-09-17T05:53:16.572509+0000","last_fullsized":"2024-09-17T05:53:16.572509+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:53:13.511622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:53:13.511622+0000","last_clean_scrub_stamp":"2024-09-17T05:53:13.511622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:06:01.140596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.2","version":"0'0","reported_seq":15,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-17T05:53:15.527619+0000","last_change":"2024-09-17T05:53:13.541556+0000","last_active":"2024-09-17T05:53:15.527619+0000","last_peered":"2024-09-17T05:53:15.527619+0000","last_clean":"2024-09-17T05:53:15.527619+0000","last_became_active":"2024-09-17T05:53:13.540985+0000","last_became_peered":"2024-09-17T05:53:13.540985+0000","last_unstale":"2024-09-17T05:53:15.527619+0000","last_undegraded":"2024-09-17T05:53:15.527619+0000","last_fullsized":"2024-09-17T05:53:15.527619+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:53:12.509392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:53:12.509392+0000","last_clean_scrub_stamp":"2024-09-17T05:53:12.509392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:59:32.172184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.0","version":"0'0","reported_seq":13,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-17T05:53:15.527867+0000","last_change":"2024-09-17T05:53:14.553791+0000","last_active":"2024-09-17T05:53:15.527867+0000","last_peered":"2024-09-17T05:53:15.527867+0000","last_clean":"2024-09-17T05:53:15.527867+0000","last_became_active":"2024-09-17T05:53:14.552645+0000","last_became_peered":"2024-09-17T05:53:14.552645+0000","last_unstale":"2024-09-17T05:53:15.527867+0000","last_undegraded":"2024-09-17T05:53:15.527867+0000","last_fullsized":"2024-09-17T05:53:15.527867+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:53:13.511622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:53:13.511622+0000","last_clean_scrub_stamp":"2024-09-17T05:53:13.511622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:17:37.335559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.1","version":"0'0","reported_seq":1,"reported_epoch":138,"state":"creating+peering","last_fresh":"2024-09-17T05:53:12.517785+0000","last_change":"2024-09-17T05:53:12.517785+0000","last_active":"2024-09-17T05:53:12.509392+0000","last_peered":"2024-09-17T05:53:12.509392+0000","last_clean":"2024-09-17T05:53:12.509392+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:53:12.517785+0000","last_undegraded":"2024-09-17T05:53:12.517785+0000","last_fullsized":"2024-09-17T05:53:12.517785+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:53:12.509392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:53:12.509392+0000","last_clean_scrub_stamp":"2024-09-17T05:53:12.509392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.1","version":"0'0","reported_seq":13,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-17T05:53:16.572259+0000","last_change":"2024-09-17T05:53:14.536337+0000","last_active":"2024-09-17T05:53:16.572259+0000","last_peered":"2024-09-17T05:53:16.572259+0000","last_clean":"2024-09-17T05:53:16.572259+0000","last_became_active":"2024-09-17T05:53:14.535962+0000","last_became_peered":"2024-09-17T05:53:14.535962+0000","last_unstale":"2024-09-17T05:53:16.572259+0000","last_undegraded":"2024-09-17T05:53:16.572259+0000","last_fullsized":"2024-09-17T05:53:16.572259+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:53:13.511622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:53:13.511622+0000","last_clean_scrub_stamp":"2024-09-17T05:53:13.511622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:12:43.179255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.0","version":"0'0","reported_seq":1,"reported_epoch":138,"state":"creating+peering","last_fresh":"2024-09-17T05:53:12.519815+0000","last_change":"2024-09-17T05:53:12.519815+0000","last_active":"2024-09-17T05:53:12.509392+0000","last_peered":"2024-09-17T05:53:12.509392+0000","last_clean":"2024-09-17T05:53:12.509392+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:53:12.519815+0000","last_undegraded":"2024-09-17T05:53:12.519815+0000","last_fullsized":"2024-09-17T05:53:12.519815+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:53:12.509392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:53:12.509392+0000","last_clean_scrub_stamp":"2024-09-17T05:53:12.509392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.14","version":"0'0","reported_seq":1,"reported_epoch":139,"state":"creating+peering","last_fresh":"2024-09-17T05:53:13.527612+0000","last_change":"2024-09-17T05:53:13.527612+0000","last_active":"2024-09-17T05:53:13.511622+0000","last_peered":"2024-09-17T05:53:13.511622+0000","last_clean":"2024-09-17T05:53:13.511622+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:53:13.527612+0000","last_undegraded":"2024-09-17T05:53:13.527612+0000","last_fullsized":"2024-09-17T05:53:13.527612+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:53:13.511622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:53:13.511622+0000","last_clean_scrub_stamp":"2024-09-17T05:53:13.511622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.15","version":"0'0","reported_seq":1,"reported_epoch":138,"state":"creating+peering","last_fresh":"2024-09-17T05:53:12.517048+0000","last_change":"2024-09-17T05:53:12.517048+0000","last_active":"2024-09-17T05:53:12.509392+0000","last_peered":"2024-09-17T05:53:12.509392+0000","last_clean":"2024-09-17T05:53:12.509392+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:53:12.517048+0000","last_undegraded":"2024-09-17T05:53:12.517048+0000","last_fullsized":"2024-09-17T05:53:12.517048+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:53:12.509392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:53:12.509392+0000","last_clean_scrub_stamp":"2024-09-17T05:53:12.509392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"19'72","reported_seq":328,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-17T05:53:15.528005+0000","last_change":"2024-09-17T05:41:48.539830+0000","last_active":"2024-09-17T05:53:15.528005+0000","last_peered":"2024-09-17T05:53:15.528005+0000","last_clean":"2024-09-17T05:53:15.528005+0000","last_became_active":"2024-09-17T05:41:48.538743+0000","last_became_peered":"2024-09-17T05:41:48.538743+0000","last_unstale":"2024-09-17T05:53:15.528005+0000","last_undegraded":"2024-09-17T05:53:15.528005+0000","last_fullsized":"2024-09-17T05:53:15.528005+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:47.152539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:47.152539+0000","last_clean_scrub_stamp":"2024-09-17T05:41:47.152539+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:08:02.952016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":21,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":48,"acting":48,"num_store_stats":3},{"poolid":20,"num_pg":32,"stat_sum":{"num_bytes":604,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":674,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":8,"ondisk_log_size":8,"up":58,"acting":58,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":16,"seq":68719476878,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":145256,"kb_used_data":1680,"kb_used_omap":1,"kb_used_meta":143550,"kb_avail":94226584,"statfs":{"total":96636764160,"available":96488022016,"internally_reserved":0,"allocated":1720320,"data_stored":757502,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":146995654},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":15,"seq":64424509583,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":119512,"kb_used_data":2304,"kb_used_omap":1,"kb_used_meta":117182,"kb_avail":94252328,"statfs":{"total":96636764160,"available":96514383872,"internally_reserved":0,"allocated":2359296,"data_stored":1368460,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":119994826},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509582,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":131396,"kb_used_data":1708,"kb_used_omap":1,"kb_used_meta":129662,"kb_avail":94240444,"statfs":{"total":96636764160,"available":96502214656,"internally_reserved":0,"allocated":1748992,"data_stored":770966,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":132774341},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509581,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":141092,"kb_used_data":1668,"kb_used_omap":1,"kb_used_meta":139390,"kb_avail":94230748,"statfs":{"total":96636764160,"available":96492285952,"internally_reserved":0,"allocated":1708032,"data_stored":751489,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":142735813},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509581,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":123044,"kb_used_data":1680,"kb_used_omap":1,"kb_used_meta":121342,"kb_avail":94248796,"statfs":{"total":96636764160,"available":96510767104,"internally_reserved":0,"allocated":1720320,"data_stored":757502,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":124254663},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509581,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":141092,"kb_used_data":1680,"kb_used_omap":1,"kb_used_meta":139390,"kb_avail":94230748,"statfs":{"total":96636764160,"available":96492285952,"internally_reserved":0,"allocated":1720320,"data_stored":757502,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":142735813},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509581,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":145252,"kb_used_data":1680,"kb_used_omap":1,"kb_used_meta":143550,"kb_avail":94226588,"statfs":{"total":96636764160,"available":96488026112,"internally_reserved":0,"allocated":1720320,"data_stored":757502,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":146995653},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574989,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":123628,"kb_used_data":2260,"kb_used_omap":1,"kb_used_meta":121342,"kb_avail":94248212,"statfs":{"total":96636764160,"available":96510169088,"internally_reserved":0,"allocated":2314240,"data_stored":1347870,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":124254661},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-17T05:53:17.563 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-17T05:53:17.711 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:17.709+0000 7f1539a25640 1 -- 172.21.15.150:0/925852513 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f15340d0da0 msgr2=0x7f15340b24b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:53:17.711 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:17.709+0000 7f1539a25640 1 --2- 172.21.15.150:0/925852513 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f15340d0da0 0x7f15340b24b0 secure :-1 s=READY pgs=1844 cs=0 l=1 rev1=1 crypto rx=0x7f152c005fd0 tx=0x7f152c02aa10 comp rx=0 tx=0).stop 2024-09-17T05:53:17.712 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:17.709+0000 7f1539a25640 1 -- 172.21.15.150:0/925852513 shutdown_connections 2024-09-17T05:53:17.712 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:17.709+0000 7f1539a25640 1 --2- 172.21.15.150:0/925852513 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f15340d0da0 0x7f15340b24b0 unknown :-1 s=CLOSED pgs=1844 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:53:17.712 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:17.709+0000 7f1539a25640 1 --2- 172.21.15.150:0/925852513 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f15340b1850 0x7f15340b7d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:53:17.712 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:17.709+0000 7f1539a25640 1 -- 172.21.15.150:0/925852513 >> 172.21.15.150:0/925852513 conn(0x7f15340cef80 msgr2=0x7f15340cf390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:53:17.712 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:17.709+0000 7f1539a25640 1 -- 172.21.15.150:0/925852513 shutdown_connections 2024-09-17T05:53:17.713 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:17.709+0000 7f1539a25640 1 -- 172.21.15.150:0/925852513 wait complete. 2024-09-17T05:53:17.713 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:17.711+0000 7f1539a25640 1 Processor -- start 2024-09-17T05:53:17.713 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:17.711+0000 7f1539a25640 1 -- start start 2024-09-17T05:53:17.716 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:17.712+0000 7f1539a25640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f15340b1850 0x7f153415a420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:53:17.717 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:17.712+0000 7f1539a25640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f15340d0990 0x7f153415a960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:53:17.717 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:17.712+0000 7f1539a25640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f15340d0da0 0x7f153406f0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:53:17.717 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:17.712+0000 7f1539a25640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f15340ced40 con 0x7f15340d0da0 2024-09-17T05:53:17.717 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:17.712+0000 7f1539a25640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f15340cebc0 con 0x7f15340d0990 2024-09-17T05:53:17.717 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:17.712+0000 7f1539a25640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f15340cd0a0 con 0x7f15340b1850 2024-09-17T05:53:17.717 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:17.713+0000 7f15337fe640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f15340d0da0 0x7f153406f0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:53:17.718 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:17.713+0000 7f15337fe640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f15340d0da0 0x7f153406f0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:35000/0 (socket says 172.21.15.150:35000) 2024-09-17T05:53:17.718 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:17.713+0000 7f1532ffd640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f15340b1850 0x7f153415a420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:53:17.718 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:17.713+0000 7f15337fe640 1 -- 172.21.15.150:0/1791845263 learned_addr learned my addr 172.21.15.150:0/1791845263 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:53:17.719 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:17.713+0000 7f15327fc640 1 --2- 172.21.15.150:0/1791845263 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f15340d0990 0x7f153415a960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:53:17.719 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:17.713+0000 7f15337fe640 1 -- 172.21.15.150:0/1791845263 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f15340b1850 msgr2=0x7f153415a420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:53:17.719 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:17.713+0000 7f15337fe640 1 --2- 172.21.15.150:0/1791845263 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f15340b1850 0x7f153415a420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:53:17.719 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:17.713+0000 7f15337fe640 1 -- 172.21.15.150:0/1791845263 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f15340d0990 msgr2=0x7f153415a960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:53:17.720 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:17.713+0000 7f15337fe640 1 --2- 172.21.15.150:0/1791845263 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f15340d0990 0x7f153415a960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:53:17.720 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:17.713+0000 7f15337fe640 1 -- 172.21.15.150:0/1791845263 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1534158c40 con 0x7f15340d0da0 2024-09-17T05:53:17.720 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:17.713+0000 7f15337fe640 1 --2- 172.21.15.150:0/1791845263 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f15340d0da0 0x7f153406f0d0 secure :-1 s=READY pgs=1845 cs=0 l=1 rev1=1 crypto rx=0x7f152c009d90 tx=0x7f152c003f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:53:17.721 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:17.713+0000 7f151bfff640 1 -- 172.21.15.150:0/1791845263 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f152c033050 con 0x7f15340d0da0 2024-09-17T05:53:17.721 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:17.713+0000 7f151bfff640 1 -- 172.21.15.150:0/1791845263 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f152c004450 con 0x7f15340d0da0 2024-09-17T05:53:17.721 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:17.713+0000 7f1539a25640 1 -- 172.21.15.150:0/1791845263 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f153406e5f0 con 0x7f15340d0da0 2024-09-17T05:53:17.721 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:17.713+0000 7f151bfff640 1 -- 172.21.15.150:0/1791845263 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f152c038450 con 0x7f15340d0da0 2024-09-17T05:53:17.721 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:17.713+0000 7f1539a25640 1 -- 172.21.15.150:0/1791845263 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f153406ebb0 con 0x7f15340d0da0 2024-09-17T05:53:17.721 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:17.714+0000 7f1539a25640 1 -- 172.21.15.150:0/1791845263 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f15340b7d10 con 0x7f15340d0da0 2024-09-17T05:53:17.723 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:17.715+0000 7f151bfff640 1 -- 172.21.15.150:0/1791845263 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 45) ==== 104501+0+0 (secure 0 0 0) 0x7f152c036070 con 0x7f15340d0da0 2024-09-17T05:53:17.723 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:17.716+0000 7f151bfff640 1 --2- 172.21.15.150:0/1791845263 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f152007ad80 0x7f152007d290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:53:17.723 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:17.716+0000 7f151bfff640 1 -- 172.21.15.150:0/1791845263 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(141..141 src has 1..141) ==== 5905+0+0 (secure 0 0 0) 0x7f152c0bb090 con 0x7f15340d0da0 2024-09-17T05:53:17.723 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:17.716+0000 7f1532ffd640 1 --2- 172.21.15.150:0/1791845263 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f152007ad80 0x7f152007d290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:53:17.723 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:17.717+0000 7f1532ffd640 1 --2- 172.21.15.150:0/1791845263 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f152007ad80 0x7f152007d290 secure :-1 s=READY pgs=783 cs=0 l=1 rev1=1 crypto rx=0x7f152400bb50 tx=0x7f152400b2e0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:53:17.723 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:17.721+0000 7f151bfff640 1 -- 172.21.15.150:0/1791845263 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f152c084a10 con 0x7f15340d0da0 2024-09-17T05:53:17.895 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:17.893+0000 7f1539a25640 1 -- 172.21.15.150:0/1791845263 --> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f1534158f20 con 0x7f152007ad80 2024-09-17T05:53:17.900 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:17.898+0000 7f151bfff640 1 -- 172.21.15.150:0/1791845263 <== mgr.4108 v2:172.21.15.176:6800/3631216395 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+244020 (secure 0 0 0) 0x7f1534158f20 con 0x7f152007ad80 2024-09-17T05:53:17.902 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-09-17T05:53:17.903 INFO:teuthology.orchestra.run.smithi150.stderr:dumped all 2024-09-17T05:53:17.905 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:17.901+0000 7f1539a25640 1 -- 172.21.15.150:0/1791845263 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f152007ad80 msgr2=0x7f152007d290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:53:17.905 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:17.901+0000 7f1539a25640 1 --2- 172.21.15.150:0/1791845263 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f152007ad80 0x7f152007d290 secure :-1 s=READY pgs=783 cs=0 l=1 rev1=1 crypto rx=0x7f152400bb50 tx=0x7f152400b2e0 comp rx=0 tx=0).stop 2024-09-17T05:53:17.905 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:17.901+0000 7f1539a25640 1 -- 172.21.15.150:0/1791845263 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f15340d0da0 msgr2=0x7f153406f0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:53:17.905 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:17.901+0000 7f1539a25640 1 --2- 172.21.15.150:0/1791845263 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f15340d0da0 0x7f153406f0d0 secure :-1 s=READY pgs=1845 cs=0 l=1 rev1=1 crypto rx=0x7f152c009d90 tx=0x7f152c003f10 comp rx=0 tx=0).stop 2024-09-17T05:53:17.905 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:17.901+0000 7f1539a25640 1 -- 172.21.15.150:0/1791845263 shutdown_connections 2024-09-17T05:53:17.905 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:17.901+0000 7f1539a25640 1 --2- 172.21.15.150:0/1791845263 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f15340d0990 0x7f153415a960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:53:17.905 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:17.901+0000 7f1539a25640 1 --2- 172.21.15.150:0/1791845263 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f152007ad80 0x7f152007d290 unknown :-1 s=CLOSED pgs=783 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:53:17.906 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:17.901+0000 7f1539a25640 1 --2- 172.21.15.150:0/1791845263 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f15340d0da0 0x7f153406f0d0 unknown :-1 s=CLOSED pgs=1845 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:53:17.906 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:17.901+0000 7f1539a25640 1 --2- 172.21.15.150:0/1791845263 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f15340b1850 0x7f153415a420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:53:17.906 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:17.901+0000 7f1539a25640 1 -- 172.21.15.150:0/1791845263 >> 172.21.15.150:0/1791845263 conn(0x7f15340cef80 msgr2=0x7f15340af1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:53:17.906 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:17.901+0000 7f1539a25640 1 -- 172.21.15.150:0/1791845263 shutdown_connections 2024-09-17T05:53:17.906 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:17.901+0000 7f1539a25640 1 -- 172.21.15.150:0/1791845263 wait complete. 2024-09-17T05:53:17.915 INFO:teuthology.orchestra.run.smithi150.stdout:{"pg_ready":true,"pg_map":{"version":481,"stamp":"2024-09-17T05:53:17.094124+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590972,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":109,"num_write_kb":1630,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":80,"ondisk_log_size":80,"up":108,"acting":108,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":70,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":7,"kb":754974720,"kb_used":1070272,"kb_used_data":14660,"kb_used_omap":12,"kb_used_meta":1055411,"kb_avail":753904448,"statfs":{"total":773094113280,"available":771998154752,"internally_reserved":0,"allocated":15011840,"data_stored":7268793,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":1080741424},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":604,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.581804"},"pg_stats":[{"pgid":"21.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:53:13.511622+0000","last_change":"2024-09-17T05:53:13.511622+0000","last_active":"2024-09-17T05:53:13.511622+0000","last_peered":"2024-09-17T05:53:13.511622+0000","last_clean":"2024-09-17T05:53:13.511622+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:53:13.511622+0000","last_undegraded":"2024-09-17T05:53:13.511622+0000","last_fullsized":"2024-09-17T05:53:13.511622+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:53:13.511622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:53:13.511622+0000","last_clean_scrub_stamp":"2024-09-17T05:53:13.511622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:53:13.511622+0000","last_change":"2024-09-17T05:53:13.511622+0000","last_active":"2024-09-17T05:53:13.511622+0000","last_peered":"2024-09-17T05:53:13.511622+0000","last_clean":"2024-09-17T05:53:13.511622+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:53:13.511622+0000","last_undegraded":"2024-09-17T05:53:13.511622+0000","last_fullsized":"2024-09-17T05:53:13.511622+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:53:13.511622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:53:13.511622+0000","last_clean_scrub_stamp":"2024-09-17T05:53:13.511622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:53:13.511622+0000","last_change":"2024-09-17T05:53:13.511622+0000","last_active":"2024-09-17T05:53:13.511622+0000","last_peered":"2024-09-17T05:53:13.511622+0000","last_clean":"2024-09-17T05:53:13.511622+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:53:13.511622+0000","last_undegraded":"2024-09-17T05:53:13.511622+0000","last_fullsized":"2024-09-17T05:53:13.511622+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:53:13.511622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:53:13.511622+0000","last_clean_scrub_stamp":"2024-09-17T05:53:13.511622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:53:13.511622+0000","last_change":"2024-09-17T05:53:13.511622+0000","last_active":"2024-09-17T05:53:13.511622+0000","last_peered":"2024-09-17T05:53:13.511622+0000","last_clean":"2024-09-17T05:53:13.511622+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:53:13.511622+0000","last_undegraded":"2024-09-17T05:53:13.511622+0000","last_fullsized":"2024-09-17T05:53:13.511622+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:53:13.511622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:53:13.511622+0000","last_clean_scrub_stamp":"2024-09-17T05:53:13.511622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.3b","version":"0'0","reported_seq":13,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-17T05:53:16.572208+0000","last_change":"2024-09-17T05:53:14.550770+0000","last_active":"2024-09-17T05:53:16.572208+0000","last_peered":"2024-09-17T05:53:16.572208+0000","last_clean":"2024-09-17T05:53:16.572208+0000","last_became_active":"2024-09-17T05:53:14.550289+0000","last_became_peered":"2024-09-17T05:53:14.550289+0000","last_unstale":"2024-09-17T05:53:16.572208+0000","last_undegraded":"2024-09-17T05:53:16.572208+0000","last_fullsized":"2024-09-17T05:53:16.572208+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:53:13.511622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:53:13.511622+0000","last_clean_scrub_stamp":"2024-09-17T05:53:13.511622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:23:14.461386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:53:13.511622+0000","last_change":"2024-09-17T05:53:13.511622+0000","last_active":"2024-09-17T05:53:13.511622+0000","last_peered":"2024-09-17T05:53:13.511622+0000","last_clean":"2024-09-17T05:53:13.511622+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:53:13.511622+0000","last_undegraded":"2024-09-17T05:53:13.511622+0000","last_fullsized":"2024-09-17T05:53:13.511622+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:53:13.511622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:53:13.511622+0000","last_clean_scrub_stamp":"2024-09-17T05:53:13.511622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.39","version":"0'0","reported_seq":1,"reported_epoch":139,"state":"creating+peering","last_fresh":"2024-09-17T05:53:13.527403+0000","last_change":"2024-09-17T05:53:13.527403+0000","last_active":"2024-09-17T05:53:13.511622+0000","last_peered":"2024-09-17T05:53:13.511622+0000","last_clean":"2024-09-17T05:53:13.511622+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:53:13.527403+0000","last_undegraded":"2024-09-17T05:53:13.527403+0000","last_fullsized":"2024-09-17T05:53:13.527403+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:53:13.511622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:53:13.511622+0000","last_clean_scrub_stamp":"2024-09-17T05:53:13.511622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:53:13.511622+0000","last_change":"2024-09-17T05:53:13.511622+0000","last_active":"2024-09-17T05:53:13.511622+0000","last_peered":"2024-09-17T05:53:13.511622+0000","last_clean":"2024-09-17T05:53:13.511622+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:53:13.511622+0000","last_undegraded":"2024-09-17T05:53:13.511622+0000","last_fullsized":"2024-09-17T05:53:13.511622+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:53:13.511622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:53:13.511622+0000","last_clean_scrub_stamp":"2024-09-17T05:53:13.511622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:53:13.511622+0000","last_change":"2024-09-17T05:53:13.511622+0000","last_active":"2024-09-17T05:53:13.511622+0000","last_peered":"2024-09-17T05:53:13.511622+0000","last_clean":"2024-09-17T05:53:13.511622+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:53:13.511622+0000","last_undegraded":"2024-09-17T05:53:13.511622+0000","last_fullsized":"2024-09-17T05:53:13.511622+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:53:13.511622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:53:13.511622+0000","last_clean_scrub_stamp":"2024-09-17T05:53:13.511622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.36","version":"0'0","reported_seq":13,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-17T05:53:15.527536+0000","last_change":"2024-09-17T05:53:14.556175+0000","last_active":"2024-09-17T05:53:15.527536+0000","last_peered":"2024-09-17T05:53:15.527536+0000","last_clean":"2024-09-17T05:53:15.527536+0000","last_became_active":"2024-09-17T05:53:14.555806+0000","last_became_peered":"2024-09-17T05:53:14.555806+0000","last_unstale":"2024-09-17T05:53:15.527536+0000","last_undegraded":"2024-09-17T05:53:15.527536+0000","last_fullsized":"2024-09-17T05:53:15.527536+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:53:13.511622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:53:13.511622+0000","last_clean_scrub_stamp":"2024-09-17T05:53:13.511622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:25:57.952915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:53:13.511622+0000","last_change":"2024-09-17T05:53:13.511622+0000","last_active":"2024-09-17T05:53:13.511622+0000","last_peered":"2024-09-17T05:53:13.511622+0000","last_clean":"2024-09-17T05:53:13.511622+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:53:13.511622+0000","last_undegraded":"2024-09-17T05:53:13.511622+0000","last_fullsized":"2024-09-17T05:53:13.511622+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:53:13.511622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:53:13.511622+0000","last_clean_scrub_stamp":"2024-09-17T05:53:13.511622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.34","version":"0'0","reported_seq":13,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-17T05:53:15.528949+0000","last_change":"2024-09-17T05:53:14.548964+0000","last_active":"2024-09-17T05:53:15.528949+0000","last_peered":"2024-09-17T05:53:15.528949+0000","last_clean":"2024-09-17T05:53:15.528949+0000","last_became_active":"2024-09-17T05:53:14.548601+0000","last_became_peered":"2024-09-17T05:53:14.548601+0000","last_unstale":"2024-09-17T05:53:15.528949+0000","last_undegraded":"2024-09-17T05:53:15.528949+0000","last_fullsized":"2024-09-17T05:53:15.528949+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:53:13.511622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:53:13.511622+0000","last_clean_scrub_stamp":"2024-09-17T05:53:13.511622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:37:55.173570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.33","version":"0'0","reported_seq":13,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-17T05:53:16.572443+0000","last_change":"2024-09-17T05:53:14.550313+0000","last_active":"2024-09-17T05:53:16.572443+0000","last_peered":"2024-09-17T05:53:16.572443+0000","last_clean":"2024-09-17T05:53:16.572443+0000","last_became_active":"2024-09-17T05:53:14.549928+0000","last_became_peered":"2024-09-17T05:53:14.549928+0000","last_unstale":"2024-09-17T05:53:16.572443+0000","last_undegraded":"2024-09-17T05:53:16.572443+0000","last_fullsized":"2024-09-17T05:53:16.572443+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:53:13.511622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:53:13.511622+0000","last_clean_scrub_stamp":"2024-09-17T05:53:13.511622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:24:22.329433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:53:13.511622+0000","last_change":"2024-09-17T05:53:13.511622+0000","last_active":"2024-09-17T05:53:13.511622+0000","last_peered":"2024-09-17T05:53:13.511622+0000","last_clean":"2024-09-17T05:53:13.511622+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:53:13.511622+0000","last_undegraded":"2024-09-17T05:53:13.511622+0000","last_fullsized":"2024-09-17T05:53:13.511622+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:53:13.511622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:53:13.511622+0000","last_clean_scrub_stamp":"2024-09-17T05:53:13.511622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.31","version":"0'0","reported_seq":13,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-17T05:53:15.528260+0000","last_change":"2024-09-17T05:53:14.554387+0000","last_active":"2024-09-17T05:53:15.528260+0000","last_peered":"2024-09-17T05:53:15.528260+0000","last_clean":"2024-09-17T05:53:15.528260+0000","last_became_active":"2024-09-17T05:53:14.553370+0000","last_became_peered":"2024-09-17T05:53:14.553370+0000","last_unstale":"2024-09-17T05:53:15.528260+0000","last_undegraded":"2024-09-17T05:53:15.528260+0000","last_fullsized":"2024-09-17T05:53:15.528260+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:53:13.511622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:53:13.511622+0000","last_clean_scrub_stamp":"2024-09-17T05:53:13.511622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:28:53.104884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:53:13.511622+0000","last_change":"2024-09-17T05:53:13.511622+0000","last_active":"2024-09-17T05:53:13.511622+0000","last_peered":"2024-09-17T05:53:13.511622+0000","last_clean":"2024-09-17T05:53:13.511622+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:53:13.511622+0000","last_undegraded":"2024-09-17T05:53:13.511622+0000","last_fullsized":"2024-09-17T05:53:13.511622+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:53:13.511622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:53:13.511622+0000","last_clean_scrub_stamp":"2024-09-17T05:53:13.511622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.2f","version":"0'0","reported_seq":13,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-17T05:53:15.528909+0000","last_change":"2024-09-17T05:53:14.555496+0000","last_active":"2024-09-17T05:53:15.528909+0000","last_peered":"2024-09-17T05:53:15.528909+0000","last_clean":"2024-09-17T05:53:15.528909+0000","last_became_active":"2024-09-17T05:53:14.554855+0000","last_became_peered":"2024-09-17T05:53:14.554855+0000","last_unstale":"2024-09-17T05:53:15.528909+0000","last_undegraded":"2024-09-17T05:53:15.528909+0000","last_fullsized":"2024-09-17T05:53:15.528909+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:53:13.511622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:53:13.511622+0000","last_clean_scrub_stamp":"2024-09-17T05:53:13.511622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:25:34.532282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:53:13.511622+0000","last_change":"2024-09-17T05:53:13.511622+0000","last_active":"2024-09-17T05:53:13.511622+0000","last_peered":"2024-09-17T05:53:13.511622+0000","last_clean":"2024-09-17T05:53:13.511622+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:53:13.511622+0000","last_undegraded":"2024-09-17T05:53:13.511622+0000","last_fullsized":"2024-09-17T05:53:13.511622+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:53:13.511622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:53:13.511622+0000","last_clean_scrub_stamp":"2024-09-17T05:53:13.511622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:53:13.511622+0000","last_change":"2024-09-17T05:53:13.511622+0000","last_active":"2024-09-17T05:53:13.511622+0000","last_peered":"2024-09-17T05:53:13.511622+0000","last_clean":"2024-09-17T05:53:13.511622+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:53:13.511622+0000","last_undegraded":"2024-09-17T05:53:13.511622+0000","last_fullsized":"2024-09-17T05:53:13.511622+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:53:13.511622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:53:13.511622+0000","last_clean_scrub_stamp":"2024-09-17T05:53:13.511622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:53:13.511622+0000","last_change":"2024-09-17T05:53:13.511622+0000","last_active":"2024-09-17T05:53:13.511622+0000","last_peered":"2024-09-17T05:53:13.511622+0000","last_clean":"2024-09-17T05:53:13.511622+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:53:13.511622+0000","last_undegraded":"2024-09-17T05:53:13.511622+0000","last_fullsized":"2024-09-17T05:53:13.511622+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:53:13.511622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:53:13.511622+0000","last_clean_scrub_stamp":"2024-09-17T05:53:13.511622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.2b","version":"0'0","reported_seq":13,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-17T05:53:15.528299+0000","last_change":"2024-09-17T05:53:14.546652+0000","last_active":"2024-09-17T05:53:15.528299+0000","last_peered":"2024-09-17T05:53:15.528299+0000","last_clean":"2024-09-17T05:53:15.528299+0000","last_became_active":"2024-09-17T05:53:14.546032+0000","last_became_peered":"2024-09-17T05:53:14.546032+0000","last_unstale":"2024-09-17T05:53:15.528299+0000","last_undegraded":"2024-09-17T05:53:15.528299+0000","last_fullsized":"2024-09-17T05:53:15.528299+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:53:13.511622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:53:13.511622+0000","last_clean_scrub_stamp":"2024-09-17T05:53:13.511622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:39:23.674754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:53:13.511622+0000","last_change":"2024-09-17T05:53:13.511622+0000","last_active":"2024-09-17T05:53:13.511622+0000","last_peered":"2024-09-17T05:53:13.511622+0000","last_clean":"2024-09-17T05:53:13.511622+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:53:13.511622+0000","last_undegraded":"2024-09-17T05:53:13.511622+0000","last_fullsized":"2024-09-17T05:53:13.511622+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:53:13.511622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:53:13.511622+0000","last_clean_scrub_stamp":"2024-09-17T05:53:13.511622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:53:13.511622+0000","last_change":"2024-09-17T05:53:13.511622+0000","last_active":"2024-09-17T05:53:13.511622+0000","last_peered":"2024-09-17T05:53:13.511622+0000","last_clean":"2024-09-17T05:53:13.511622+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:53:13.511622+0000","last_undegraded":"2024-09-17T05:53:13.511622+0000","last_fullsized":"2024-09-17T05:53:13.511622+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:53:13.511622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:53:13.511622+0000","last_clean_scrub_stamp":"2024-09-17T05:53:13.511622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.28","version":"0'0","reported_seq":13,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-17T05:53:15.527650+0000","last_change":"2024-09-17T05:53:14.547009+0000","last_active":"2024-09-17T05:53:15.527650+0000","last_peered":"2024-09-17T05:53:15.527650+0000","last_clean":"2024-09-17T05:53:15.527650+0000","last_became_active":"2024-09-17T05:53:14.546691+0000","last_became_peered":"2024-09-17T05:53:14.546691+0000","last_unstale":"2024-09-17T05:53:15.527650+0000","last_undegraded":"2024-09-17T05:53:15.527650+0000","last_fullsized":"2024-09-17T05:53:15.527650+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:53:13.511622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:53:13.511622+0000","last_clean_scrub_stamp":"2024-09-17T05:53:13.511622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:07:35.487105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:53:13.511622+0000","last_change":"2024-09-17T05:53:13.511622+0000","last_active":"2024-09-17T05:53:13.511622+0000","last_peered":"2024-09-17T05:53:13.511622+0000","last_clean":"2024-09-17T05:53:13.511622+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:53:13.511622+0000","last_undegraded":"2024-09-17T05:53:13.511622+0000","last_fullsized":"2024-09-17T05:53:13.511622+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:53:13.511622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:53:13.511622+0000","last_clean_scrub_stamp":"2024-09-17T05:53:13.511622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:53:13.511622+0000","last_change":"2024-09-17T05:53:13.511622+0000","last_active":"2024-09-17T05:53:13.511622+0000","last_peered":"2024-09-17T05:53:13.511622+0000","last_clean":"2024-09-17T05:53:13.511622+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:53:13.511622+0000","last_undegraded":"2024-09-17T05:53:13.511622+0000","last_fullsized":"2024-09-17T05:53:13.511622+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:53:13.511622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:53:13.511622+0000","last_clean_scrub_stamp":"2024-09-17T05:53:13.511622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:53:13.511622+0000","last_change":"2024-09-17T05:53:13.511622+0000","last_active":"2024-09-17T05:53:13.511622+0000","last_peered":"2024-09-17T05:53:13.511622+0000","last_clean":"2024-09-17T05:53:13.511622+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:53:13.511622+0000","last_undegraded":"2024-09-17T05:53:13.511622+0000","last_fullsized":"2024-09-17T05:53:13.511622+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:53:13.511622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:53:13.511622+0000","last_clean_scrub_stamp":"2024-09-17T05:53:13.511622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.24","version":"0'0","reported_seq":1,"reported_epoch":139,"state":"creating+peering","last_fresh":"2024-09-17T05:53:13.528051+0000","last_change":"2024-09-17T05:53:13.528051+0000","last_active":"2024-09-17T05:53:13.511622+0000","last_peered":"2024-09-17T05:53:13.511622+0000","last_clean":"2024-09-17T05:53:13.511622+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:53:13.528051+0000","last_undegraded":"2024-09-17T05:53:13.528051+0000","last_fullsized":"2024-09-17T05:53:13.528051+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:53:13.511622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:53:13.511622+0000","last_clean_scrub_stamp":"2024-09-17T05:53:13.511622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:53:13.511622+0000","last_change":"2024-09-17T05:53:13.511622+0000","last_active":"2024-09-17T05:53:13.511622+0000","last_peered":"2024-09-17T05:53:13.511622+0000","last_clean":"2024-09-17T05:53:13.511622+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:53:13.511622+0000","last_undegraded":"2024-09-17T05:53:13.511622+0000","last_fullsized":"2024-09-17T05:53:13.511622+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:53:13.511622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:53:13.511622+0000","last_clean_scrub_stamp":"2024-09-17T05:53:13.511622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:53:13.511622+0000","last_change":"2024-09-17T05:53:13.511622+0000","last_active":"2024-09-17T05:53:13.511622+0000","last_peered":"2024-09-17T05:53:13.511622+0000","last_clean":"2024-09-17T05:53:13.511622+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:53:13.511622+0000","last_undegraded":"2024-09-17T05:53:13.511622+0000","last_fullsized":"2024-09-17T05:53:13.511622+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:53:13.511622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:53:13.511622+0000","last_clean_scrub_stamp":"2024-09-17T05:53:13.511622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:53:13.511622+0000","last_change":"2024-09-17T05:53:13.511622+0000","last_active":"2024-09-17T05:53:13.511622+0000","last_peered":"2024-09-17T05:53:13.511622+0000","last_clean":"2024-09-17T05:53:13.511622+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:53:13.511622+0000","last_undegraded":"2024-09-17T05:53:13.511622+0000","last_fullsized":"2024-09-17T05:53:13.511622+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:53:13.511622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:53:13.511622+0000","last_clean_scrub_stamp":"2024-09-17T05:53:13.511622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:53:13.511622+0000","last_change":"2024-09-17T05:53:13.511622+0000","last_active":"2024-09-17T05:53:13.511622+0000","last_peered":"2024-09-17T05:53:13.511622+0000","last_clean":"2024-09-17T05:53:13.511622+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:53:13.511622+0000","last_undegraded":"2024-09-17T05:53:13.511622+0000","last_fullsized":"2024-09-17T05:53:13.511622+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:53:13.511622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:53:13.511622+0000","last_clean_scrub_stamp":"2024-09-17T05:53:13.511622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.1e","version":"0'0","reported_seq":13,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-17T05:53:15.527757+0000","last_change":"2024-09-17T05:53:14.548181+0000","last_active":"2024-09-17T05:53:15.527757+0000","last_peered":"2024-09-17T05:53:15.527757+0000","last_clean":"2024-09-17T05:53:15.527757+0000","last_became_active":"2024-09-17T05:53:14.547859+0000","last_became_peered":"2024-09-17T05:53:14.547859+0000","last_unstale":"2024-09-17T05:53:15.527757+0000","last_undegraded":"2024-09-17T05:53:15.527757+0000","last_fullsized":"2024-09-17T05:53:15.527757+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:53:13.511622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:53:13.511622+0000","last_clean_scrub_stamp":"2024-09-17T05:53:13.511622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:17:09.456622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.1f","version":"140'4","reported_seq":19,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-17T05:53:15.528586+0000","last_change":"2024-09-17T05:53:13.539463+0000","last_active":"2024-09-17T05:53:15.528586+0000","last_peered":"2024-09-17T05:53:15.528586+0000","last_clean":"2024-09-17T05:53:15.528586+0000","last_became_active":"2024-09-17T05:53:13.538767+0000","last_became_peered":"2024-09-17T05:53:13.538767+0000","last_unstale":"2024-09-17T05:53:15.528586+0000","last_undegraded":"2024-09-17T05:53:15.528586+0000","last_fullsized":"2024-09-17T05:53:15.528586+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:53:12.509392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:53:12.509392+0000","last_clean_scrub_stamp":"2024-09-17T05:53:12.509392+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:26:51.175390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:53:13.511622+0000","last_change":"2024-09-17T05:53:13.511622+0000","last_active":"2024-09-17T05:53:13.511622+0000","last_peered":"2024-09-17T05:53:13.511622+0000","last_clean":"2024-09-17T05:53:13.511622+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:53:13.511622+0000","last_undegraded":"2024-09-17T05:53:13.511622+0000","last_fullsized":"2024-09-17T05:53:13.511622+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:53:13.511622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:53:13.511622+0000","last_clean_scrub_stamp":"2024-09-17T05:53:13.511622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.1e","version":"0'0","reported_seq":1,"reported_epoch":138,"state":"creating+peering","last_fresh":"2024-09-17T05:53:12.519409+0000","last_change":"2024-09-17T05:53:12.519409+0000","last_active":"2024-09-17T05:53:12.509392+0000","last_peered":"2024-09-17T05:53:12.509392+0000","last_clean":"2024-09-17T05:53:12.509392+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:53:12.519409+0000","last_undegraded":"2024-09-17T05:53:12.519409+0000","last_fullsized":"2024-09-17T05:53:12.519409+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:53:12.509392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:53:12.509392+0000","last_clean_scrub_stamp":"2024-09-17T05:53:12.509392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:53:13.511622+0000","last_change":"2024-09-17T05:53:13.511622+0000","last_active":"2024-09-17T05:53:13.511622+0000","last_peered":"2024-09-17T05:53:13.511622+0000","last_clean":"2024-09-17T05:53:13.511622+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:53:13.511622+0000","last_undegraded":"2024-09-17T05:53:13.511622+0000","last_fullsized":"2024-09-17T05:53:13.511622+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:53:13.511622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:53:13.511622+0000","last_clean_scrub_stamp":"2024-09-17T05:53:13.511622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:53:12.509392+0000","last_change":"2024-09-17T05:53:12.509392+0000","last_active":"2024-09-17T05:53:12.509392+0000","last_peered":"2024-09-17T05:53:12.509392+0000","last_clean":"2024-09-17T05:53:12.509392+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:53:12.509392+0000","last_undegraded":"2024-09-17T05:53:12.509392+0000","last_fullsized":"2024-09-17T05:53:12.509392+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:53:12.509392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:53:12.509392+0000","last_clean_scrub_stamp":"2024-09-17T05:53:12.509392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.1d","version":"0'0","reported_seq":13,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-17T05:53:15.528652+0000","last_change":"2024-09-17T05:53:14.554059+0000","last_active":"2024-09-17T05:53:15.528652+0000","last_peered":"2024-09-17T05:53:15.528652+0000","last_clean":"2024-09-17T05:53:15.528652+0000","last_became_active":"2024-09-17T05:53:14.553753+0000","last_became_peered":"2024-09-17T05:53:14.553753+0000","last_unstale":"2024-09-17T05:53:15.528652+0000","last_undegraded":"2024-09-17T05:53:15.528652+0000","last_fullsized":"2024-09-17T05:53:15.528652+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:53:13.511622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:53:13.511622+0000","last_clean_scrub_stamp":"2024-09-17T05:53:13.511622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:58:54.333486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:53:12.509392+0000","last_change":"2024-09-17T05:53:12.509392+0000","last_active":"2024-09-17T05:53:12.509392+0000","last_peered":"2024-09-17T05:53:12.509392+0000","last_clean":"2024-09-17T05:53:12.509392+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:53:12.509392+0000","last_undegraded":"2024-09-17T05:53:12.509392+0000","last_fullsized":"2024-09-17T05:53:12.509392+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:53:12.509392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:53:12.509392+0000","last_clean_scrub_stamp":"2024-09-17T05:53:12.509392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:53:13.511622+0000","last_change":"2024-09-17T05:53:13.511622+0000","last_active":"2024-09-17T05:53:13.511622+0000","last_peered":"2024-09-17T05:53:13.511622+0000","last_clean":"2024-09-17T05:53:13.511622+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:53:13.511622+0000","last_undegraded":"2024-09-17T05:53:13.511622+0000","last_fullsized":"2024-09-17T05:53:13.511622+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:53:13.511622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:53:13.511622+0000","last_clean_scrub_stamp":"2024-09-17T05:53:13.511622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.1b","version":"0'0","reported_seq":1,"reported_epoch":138,"state":"creating+peering","last_fresh":"2024-09-17T05:53:12.514220+0000","last_change":"2024-09-17T05:53:12.514220+0000","last_active":"2024-09-17T05:53:12.509392+0000","last_peered":"2024-09-17T05:53:12.509392+0000","last_clean":"2024-09-17T05:53:12.509392+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:53:12.514220+0000","last_undegraded":"2024-09-17T05:53:12.514220+0000","last_fullsized":"2024-09-17T05:53:12.514220+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:53:12.509392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:53:12.509392+0000","last_clean_scrub_stamp":"2024-09-17T05:53:12.509392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:53:13.511622+0000","last_change":"2024-09-17T05:53:13.511622+0000","last_active":"2024-09-17T05:53:13.511622+0000","last_peered":"2024-09-17T05:53:13.511622+0000","last_clean":"2024-09-17T05:53:13.511622+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:53:13.511622+0000","last_undegraded":"2024-09-17T05:53:13.511622+0000","last_fullsized":"2024-09-17T05:53:13.511622+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:53:13.511622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:53:13.511622+0000","last_clean_scrub_stamp":"2024-09-17T05:53:13.511622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.1a","version":"140'1","reported_seq":16,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-17T05:53:16.571986+0000","last_change":"2024-09-17T05:53:13.534883+0000","last_active":"2024-09-17T05:53:16.571986+0000","last_peered":"2024-09-17T05:53:16.571986+0000","last_clean":"2024-09-17T05:53:16.571986+0000","last_became_active":"2024-09-17T05:53:13.534547+0000","last_became_peered":"2024-09-17T05:53:13.534547+0000","last_unstale":"2024-09-17T05:53:16.571986+0000","last_undegraded":"2024-09-17T05:53:16.571986+0000","last_fullsized":"2024-09-17T05:53:16.571986+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:53:12.509392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:53:12.509392+0000","last_clean_scrub_stamp":"2024-09-17T05:53:12.509392+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:24:20.737152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:53:13.511622+0000","last_change":"2024-09-17T05:53:13.511622+0000","last_active":"2024-09-17T05:53:13.511622+0000","last_peered":"2024-09-17T05:53:13.511622+0000","last_clean":"2024-09-17T05:53:13.511622+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:53:13.511622+0000","last_undegraded":"2024-09-17T05:53:13.511622+0000","last_fullsized":"2024-09-17T05:53:13.511622+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:53:13.511622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:53:13.511622+0000","last_clean_scrub_stamp":"2024-09-17T05:53:13.511622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.19","version":"0'0","reported_seq":1,"reported_epoch":138,"state":"creating+peering","last_fresh":"2024-09-17T05:53:12.514359+0000","last_change":"2024-09-17T05:53:12.514359+0000","last_active":"2024-09-17T05:53:12.509392+0000","last_peered":"2024-09-17T05:53:12.509392+0000","last_clean":"2024-09-17T05:53:12.509392+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:53:12.514359+0000","last_undegraded":"2024-09-17T05:53:12.514359+0000","last_fullsized":"2024-09-17T05:53:12.514359+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:53:12.509392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:53:12.509392+0000","last_clean_scrub_stamp":"2024-09-17T05:53:12.509392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.19","version":"0'0","reported_seq":13,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-17T05:53:16.572391+0000","last_change":"2024-09-17T05:53:14.537974+0000","last_active":"2024-09-17T05:53:16.572391+0000","last_peered":"2024-09-17T05:53:16.572391+0000","last_clean":"2024-09-17T05:53:16.572391+0000","last_became_active":"2024-09-17T05:53:14.537611+0000","last_became_peered":"2024-09-17T05:53:14.537611+0000","last_unstale":"2024-09-17T05:53:16.572391+0000","last_undegraded":"2024-09-17T05:53:16.572391+0000","last_fullsized":"2024-09-17T05:53:16.572391+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:53:13.511622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:53:13.511622+0000","last_clean_scrub_stamp":"2024-09-17T05:53:13.511622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:38:57.194890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:53:12.509392+0000","last_change":"2024-09-17T05:53:12.509392+0000","last_active":"2024-09-17T05:53:12.509392+0000","last_peered":"2024-09-17T05:53:12.509392+0000","last_clean":"2024-09-17T05:53:12.509392+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:53:12.509392+0000","last_undegraded":"2024-09-17T05:53:12.509392+0000","last_fullsized":"2024-09-17T05:53:12.509392+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:53:12.509392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:53:12.509392+0000","last_clean_scrub_stamp":"2024-09-17T05:53:12.509392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.16","version":"0'0","reported_seq":13,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-17T05:53:16.572405+0000","last_change":"2024-09-17T05:53:14.542412+0000","last_active":"2024-09-17T05:53:16.572405+0000","last_peered":"2024-09-17T05:53:16.572405+0000","last_clean":"2024-09-17T05:53:16.572405+0000","last_became_active":"2024-09-17T05:53:14.541943+0000","last_became_peered":"2024-09-17T05:53:14.541943+0000","last_unstale":"2024-09-17T05:53:16.572405+0000","last_undegraded":"2024-09-17T05:53:16.572405+0000","last_fullsized":"2024-09-17T05:53:16.572405+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:53:13.511622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:53:13.511622+0000","last_clean_scrub_stamp":"2024-09-17T05:53:13.511622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:06:39.200488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.17","version":"0'0","reported_seq":1,"reported_epoch":138,"state":"creating+peering","last_fresh":"2024-09-17T05:53:12.518858+0000","last_change":"2024-09-17T05:53:12.518858+0000","last_active":"2024-09-17T05:53:12.509392+0000","last_peered":"2024-09-17T05:53:12.509392+0000","last_clean":"2024-09-17T05:53:12.509392+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:53:12.518858+0000","last_undegraded":"2024-09-17T05:53:12.518858+0000","last_fullsized":"2024-09-17T05:53:12.518858+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:53:12.509392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:53:12.509392+0000","last_clean_scrub_stamp":"2024-09-17T05:53:12.509392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.17","version":"0'0","reported_seq":13,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-17T05:53:15.528601+0000","last_change":"2024-09-17T05:53:14.555136+0000","last_active":"2024-09-17T05:53:15.528601+0000","last_peered":"2024-09-17T05:53:15.528601+0000","last_clean":"2024-09-17T05:53:15.528601+0000","last_became_active":"2024-09-17T05:53:14.554514+0000","last_became_peered":"2024-09-17T05:53:14.554514+0000","last_unstale":"2024-09-17T05:53:15.528601+0000","last_undegraded":"2024-09-17T05:53:15.528601+0000","last_fullsized":"2024-09-17T05:53:15.528601+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:53:13.511622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:53:13.511622+0000","last_clean_scrub_stamp":"2024-09-17T05:53:13.511622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:41:18.370466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.16","version":"0'0","reported_seq":15,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-17T05:53:15.528222+0000","last_change":"2024-09-17T05:53:13.534637+0000","last_active":"2024-09-17T05:53:15.528222+0000","last_peered":"2024-09-17T05:53:15.528222+0000","last_clean":"2024-09-17T05:53:15.528222+0000","last_became_active":"2024-09-17T05:53:13.534316+0000","last_became_peered":"2024-09-17T05:53:13.534316+0000","last_unstale":"2024-09-17T05:53:15.528222+0000","last_undegraded":"2024-09-17T05:53:15.528222+0000","last_fullsized":"2024-09-17T05:53:15.528222+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:53:12.509392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:53:12.509392+0000","last_clean_scrub_stamp":"2024-09-17T05:53:12.509392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:17:34.499459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:53:13.511622+0000","last_change":"2024-09-17T05:53:13.511622+0000","last_active":"2024-09-17T05:53:13.511622+0000","last_peered":"2024-09-17T05:53:13.511622+0000","last_clean":"2024-09-17T05:53:13.511622+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:53:13.511622+0000","last_undegraded":"2024-09-17T05:53:13.511622+0000","last_fullsized":"2024-09-17T05:53:13.511622+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:53:13.511622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:53:13.511622+0000","last_clean_scrub_stamp":"2024-09-17T05:53:13.511622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.14","version":"0'0","reported_seq":10,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-09-17T05:53:13.542150+0000","last_change":"2024-09-17T05:53:13.541151+0000","last_active":"2024-09-17T05:53:13.542150+0000","last_peered":"2024-09-17T05:53:13.542150+0000","last_clean":"2024-09-17T05:53:13.542150+0000","last_became_active":"2024-09-17T05:53:13.540717+0000","last_became_peered":"2024-09-17T05:53:13.540717+0000","last_unstale":"2024-09-17T05:53:13.542150+0000","last_undegraded":"2024-09-17T05:53:13.542150+0000","last_fullsized":"2024-09-17T05:53:13.542150+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:53:12.509392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:53:12.509392+0000","last_clean_scrub_stamp":"2024-09-17T05:53:12.509392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:54:36.994315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:53:13.511622+0000","last_change":"2024-09-17T05:53:13.511622+0000","last_active":"2024-09-17T05:53:13.511622+0000","last_peered":"2024-09-17T05:53:13.511622+0000","last_clean":"2024-09-17T05:53:13.511622+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:53:13.511622+0000","last_undegraded":"2024-09-17T05:53:13.511622+0000","last_fullsized":"2024-09-17T05:53:13.511622+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:53:13.511622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:53:13.511622+0000","last_clean_scrub_stamp":"2024-09-17T05:53:13.511622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.13","version":"0'0","reported_seq":1,"reported_epoch":138,"state":"creating+peering","last_fresh":"2024-09-17T05:53:12.516491+0000","last_change":"2024-09-17T05:53:12.516491+0000","last_active":"2024-09-17T05:53:12.509392+0000","last_peered":"2024-09-17T05:53:12.509392+0000","last_clean":"2024-09-17T05:53:12.509392+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:53:12.516491+0000","last_undegraded":"2024-09-17T05:53:12.516491+0000","last_fullsized":"2024-09-17T05:53:12.516491+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:53:12.509392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:53:12.509392+0000","last_clean_scrub_stamp":"2024-09-17T05:53:12.509392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:53:13.511622+0000","last_change":"2024-09-17T05:53:13.511622+0000","last_active":"2024-09-17T05:53:13.511622+0000","last_peered":"2024-09-17T05:53:13.511622+0000","last_clean":"2024-09-17T05:53:13.511622+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:53:13.511622+0000","last_undegraded":"2024-09-17T05:53:13.511622+0000","last_fullsized":"2024-09-17T05:53:13.511622+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:53:13.511622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:53:13.511622+0000","last_clean_scrub_stamp":"2024-09-17T05:53:13.511622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.12","version":"0'0","reported_seq":1,"reported_epoch":138,"state":"creating+peering","last_fresh":"2024-09-17T05:53:12.516394+0000","last_change":"2024-09-17T05:53:12.516394+0000","last_active":"2024-09-17T05:53:12.509392+0000","last_peered":"2024-09-17T05:53:12.509392+0000","last_clean":"2024-09-17T05:53:12.509392+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:53:12.516394+0000","last_undegraded":"2024-09-17T05:53:12.516394+0000","last_fullsized":"2024-09-17T05:53:12.516394+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:53:12.509392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:53:12.509392+0000","last_clean_scrub_stamp":"2024-09-17T05:53:12.509392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.10","version":"0'0","reported_seq":13,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-17T05:53:16.572253+0000","last_change":"2024-09-17T05:53:14.549168+0000","last_active":"2024-09-17T05:53:16.572253+0000","last_peered":"2024-09-17T05:53:16.572253+0000","last_clean":"2024-09-17T05:53:16.572253+0000","last_became_active":"2024-09-17T05:53:14.548829+0000","last_became_peered":"2024-09-17T05:53:14.548829+0000","last_unstale":"2024-09-17T05:53:16.572253+0000","last_undegraded":"2024-09-17T05:53:16.572253+0000","last_fullsized":"2024-09-17T05:53:16.572253+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:53:13.511622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:53:13.511622+0000","last_clean_scrub_stamp":"2024-09-17T05:53:13.511622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:48:29.849949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.11","version":"0'0","reported_seq":1,"reported_epoch":138,"state":"creating+peering","last_fresh":"2024-09-17T05:53:12.516984+0000","last_change":"2024-09-17T05:53:12.516984+0000","last_active":"2024-09-17T05:53:12.509392+0000","last_peered":"2024-09-17T05:53:12.509392+0000","last_clean":"2024-09-17T05:53:12.509392+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:53:12.516984+0000","last_undegraded":"2024-09-17T05:53:12.516984+0000","last_fullsized":"2024-09-17T05:53:12.516984+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:53:12.509392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:53:12.509392+0000","last_clean_scrub_stamp":"2024-09-17T05:53:12.509392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:53:13.511622+0000","last_change":"2024-09-17T05:53:13.511622+0000","last_active":"2024-09-17T05:53:13.511622+0000","last_peered":"2024-09-17T05:53:13.511622+0000","last_clean":"2024-09-17T05:53:13.511622+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:53:13.511622+0000","last_undegraded":"2024-09-17T05:53:13.511622+0000","last_fullsized":"2024-09-17T05:53:13.511622+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:53:13.511622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:53:13.511622+0000","last_clean_scrub_stamp":"2024-09-17T05:53:13.511622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.10","version":"0'0","reported_seq":1,"reported_epoch":138,"state":"creating+peering","last_fresh":"2024-09-17T05:53:12.514187+0000","last_change":"2024-09-17T05:53:12.514187+0000","last_active":"2024-09-17T05:53:12.509392+0000","last_peered":"2024-09-17T05:53:12.509392+0000","last_clean":"2024-09-17T05:53:12.509392+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:53:12.514187+0000","last_undegraded":"2024-09-17T05:53:12.514187+0000","last_fullsized":"2024-09-17T05:53:12.514187+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:53:12.509392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:53:12.509392+0000","last_clean_scrub_stamp":"2024-09-17T05:53:12.509392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.e","version":"0'0","reported_seq":13,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-17T05:53:15.528010+0000","last_change":"2024-09-17T05:53:14.548943+0000","last_active":"2024-09-17T05:53:15.528010+0000","last_peered":"2024-09-17T05:53:15.528010+0000","last_clean":"2024-09-17T05:53:15.528010+0000","last_became_active":"2024-09-17T05:53:14.547493+0000","last_became_peered":"2024-09-17T05:53:14.547493+0000","last_unstale":"2024-09-17T05:53:15.528010+0000","last_undegraded":"2024-09-17T05:53:15.528010+0000","last_fullsized":"2024-09-17T05:53:15.528010+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:53:13.511622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:53:13.511622+0000","last_clean_scrub_stamp":"2024-09-17T05:53:13.511622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:11:54.994505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.f","version":"140'1","reported_seq":16,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-17T05:53:16.572123+0000","last_change":"2024-09-17T05:53:13.538801+0000","last_active":"2024-09-17T05:53:16.572123+0000","last_peered":"2024-09-17T05:53:16.572123+0000","last_clean":"2024-09-17T05:53:16.572123+0000","last_became_active":"2024-09-17T05:53:13.538469+0000","last_became_peered":"2024-09-17T05:53:13.538469+0000","last_unstale":"2024-09-17T05:53:16.572123+0000","last_undegraded":"2024-09-17T05:53:16.572123+0000","last_fullsized":"2024-09-17T05:53:16.572123+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:53:12.509392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:53:12.509392+0000","last_clean_scrub_stamp":"2024-09-17T05:53:12.509392+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:33:19.361630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:53:13.511622+0000","last_change":"2024-09-17T05:53:13.511622+0000","last_active":"2024-09-17T05:53:13.511622+0000","last_peered":"2024-09-17T05:53:13.511622+0000","last_clean":"2024-09-17T05:53:13.511622+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:53:13.511622+0000","last_undegraded":"2024-09-17T05:53:13.511622+0000","last_fullsized":"2024-09-17T05:53:13.511622+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:53:13.511622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:53:13.511622+0000","last_clean_scrub_stamp":"2024-09-17T05:53:13.511622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.e","version":"0'0","reported_seq":1,"reported_epoch":138,"state":"creating+peering","last_fresh":"2024-09-17T05:53:12.518809+0000","last_change":"2024-09-17T05:53:12.518809+0000","last_active":"2024-09-17T05:53:12.509392+0000","last_peered":"2024-09-17T05:53:12.509392+0000","last_clean":"2024-09-17T05:53:12.509392+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:53:12.518809+0000","last_undegraded":"2024-09-17T05:53:12.518809+0000","last_fullsized":"2024-09-17T05:53:12.518809+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:53:12.509392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:53:12.509392+0000","last_clean_scrub_stamp":"2024-09-17T05:53:12.509392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:53:13.511622+0000","last_change":"2024-09-17T05:53:13.511622+0000","last_active":"2024-09-17T05:53:13.511622+0000","last_peered":"2024-09-17T05:53:13.511622+0000","last_clean":"2024-09-17T05:53:13.511622+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:53:13.511622+0000","last_undegraded":"2024-09-17T05:53:13.511622+0000","last_fullsized":"2024-09-17T05:53:13.511622+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:53:13.511622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:53:13.511622+0000","last_clean_scrub_stamp":"2024-09-17T05:53:13.511622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.d","version":"0'0","reported_seq":1,"reported_epoch":138,"state":"creating+peering","last_fresh":"2024-09-17T05:53:12.514221+0000","last_change":"2024-09-17T05:53:12.514221+0000","last_active":"2024-09-17T05:53:12.509392+0000","last_peered":"2024-09-17T05:53:12.509392+0000","last_clean":"2024-09-17T05:53:12.509392+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:53:12.514221+0000","last_undegraded":"2024-09-17T05:53:12.514221+0000","last_fullsized":"2024-09-17T05:53:12.514221+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:53:12.509392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:53:12.509392+0000","last_clean_scrub_stamp":"2024-09-17T05:53:12.509392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:53:13.511622+0000","last_change":"2024-09-17T05:53:13.511622+0000","last_active":"2024-09-17T05:53:13.511622+0000","last_peered":"2024-09-17T05:53:13.511622+0000","last_clean":"2024-09-17T05:53:13.511622+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:53:13.511622+0000","last_undegraded":"2024-09-17T05:53:13.511622+0000","last_fullsized":"2024-09-17T05:53:13.511622+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:53:13.511622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:53:13.511622+0000","last_clean_scrub_stamp":"2024-09-17T05:53:13.511622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.c","version":"0'0","reported_seq":1,"reported_epoch":138,"state":"creating+peering","last_fresh":"2024-09-17T05:53:12.518716+0000","last_change":"2024-09-17T05:53:12.518716+0000","last_active":"2024-09-17T05:53:12.509392+0000","last_peered":"2024-09-17T05:53:12.509392+0000","last_clean":"2024-09-17T05:53:12.509392+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:53:12.518716+0000","last_undegraded":"2024-09-17T05:53:12.518716+0000","last_fullsized":"2024-09-17T05:53:12.518716+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:53:12.509392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:53:12.509392+0000","last_clean_scrub_stamp":"2024-09-17T05:53:12.509392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:53:13.511622+0000","last_change":"2024-09-17T05:53:13.511622+0000","last_active":"2024-09-17T05:53:13.511622+0000","last_peered":"2024-09-17T05:53:13.511622+0000","last_clean":"2024-09-17T05:53:13.511622+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:53:13.511622+0000","last_undegraded":"2024-09-17T05:53:13.511622+0000","last_fullsized":"2024-09-17T05:53:13.511622+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:53:13.511622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:53:13.511622+0000","last_clean_scrub_stamp":"2024-09-17T05:53:13.511622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.b","version":"0'0","reported_seq":10,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-09-17T05:53:13.538312+0000","last_change":"2024-09-17T05:53:13.536538+0000","last_active":"2024-09-17T05:53:13.538312+0000","last_peered":"2024-09-17T05:53:13.538312+0000","last_clean":"2024-09-17T05:53:13.538312+0000","last_became_active":"2024-09-17T05:53:13.536195+0000","last_became_peered":"2024-09-17T05:53:13.536195+0000","last_unstale":"2024-09-17T05:53:13.538312+0000","last_undegraded":"2024-09-17T05:53:13.538312+0000","last_fullsized":"2024-09-17T05:53:13.538312+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:53:12.509392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:53:12.509392+0000","last_clean_scrub_stamp":"2024-09-17T05:53:12.509392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:49:58.949468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.b","version":"0'0","reported_seq":1,"reported_epoch":139,"state":"creating+peering","last_fresh":"2024-09-17T05:53:13.528919+0000","last_change":"2024-09-17T05:53:13.528919+0000","last_active":"2024-09-17T05:53:13.511622+0000","last_peered":"2024-09-17T05:53:13.511622+0000","last_clean":"2024-09-17T05:53:13.511622+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:53:13.528919+0000","last_undegraded":"2024-09-17T05:53:13.528919+0000","last_fullsized":"2024-09-17T05:53:13.528919+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:53:13.511622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:53:13.511622+0000","last_clean_scrub_stamp":"2024-09-17T05:53:13.511622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.a","version":"0'0","reported_seq":15,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-17T05:53:15.527504+0000","last_change":"2024-09-17T05:53:13.539072+0000","last_active":"2024-09-17T05:53:15.527504+0000","last_peered":"2024-09-17T05:53:15.527504+0000","last_clean":"2024-09-17T05:53:15.527504+0000","last_became_active":"2024-09-17T05:53:13.538503+0000","last_became_peered":"2024-09-17T05:53:13.538503+0000","last_unstale":"2024-09-17T05:53:15.527504+0000","last_undegraded":"2024-09-17T05:53:15.527504+0000","last_fullsized":"2024-09-17T05:53:15.527504+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:53:12.509392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:53:12.509392+0000","last_clean_scrub_stamp":"2024-09-17T05:53:12.509392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:17:17.870202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:53:13.511622+0000","last_change":"2024-09-17T05:53:13.511622+0000","last_active":"2024-09-17T05:53:13.511622+0000","last_peered":"2024-09-17T05:53:13.511622+0000","last_clean":"2024-09-17T05:53:13.511622+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:53:13.511622+0000","last_undegraded":"2024-09-17T05:53:13.511622+0000","last_fullsized":"2024-09-17T05:53:13.511622+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:53:13.511622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:53:13.511622+0000","last_clean_scrub_stamp":"2024-09-17T05:53:13.511622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.9","version":"0'0","reported_seq":15,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-17T05:53:15.528312+0000","last_change":"2024-09-17T05:53:13.539530+0000","last_active":"2024-09-17T05:53:15.528312+0000","last_peered":"2024-09-17T05:53:15.528312+0000","last_clean":"2024-09-17T05:53:15.528312+0000","last_became_active":"2024-09-17T05:53:13.539215+0000","last_became_peered":"2024-09-17T05:53:13.539215+0000","last_unstale":"2024-09-17T05:53:15.528312+0000","last_undegraded":"2024-09-17T05:53:15.528312+0000","last_fullsized":"2024-09-17T05:53:15.528312+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:53:12.509392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:53:12.509392+0000","last_clean_scrub_stamp":"2024-09-17T05:53:12.509392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:51:24.706974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.9","version":"0'0","reported_seq":1,"reported_epoch":139,"state":"creating+peering","last_fresh":"2024-09-17T05:53:13.528602+0000","last_change":"2024-09-17T05:53:13.528602+0000","last_active":"2024-09-17T05:53:13.511622+0000","last_peered":"2024-09-17T05:53:13.511622+0000","last_clean":"2024-09-17T05:53:13.511622+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:53:13.528602+0000","last_undegraded":"2024-09-17T05:53:13.528602+0000","last_fullsized":"2024-09-17T05:53:13.528602+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:53:13.511622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:53:13.511622+0000","last_clean_scrub_stamp":"2024-09-17T05:53:13.511622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.8","version":"0'0","reported_seq":1,"reported_epoch":138,"state":"creating+peering","last_fresh":"2024-09-17T05:53:12.516694+0000","last_change":"2024-09-17T05:53:12.516694+0000","last_active":"2024-09-17T05:53:12.509392+0000","last_peered":"2024-09-17T05:53:12.509392+0000","last_clean":"2024-09-17T05:53:12.509392+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:53:12.516694+0000","last_undegraded":"2024-09-17T05:53:12.516694+0000","last_fullsized":"2024-09-17T05:53:12.516694+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:53:12.509392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:53:12.509392+0000","last_clean_scrub_stamp":"2024-09-17T05:53:12.509392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.6","version":"0'0","reported_seq":13,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-17T05:53:16.572412+0000","last_change":"2024-09-17T05:53:14.549803+0000","last_active":"2024-09-17T05:53:16.572412+0000","last_peered":"2024-09-17T05:53:16.572412+0000","last_clean":"2024-09-17T05:53:16.572412+0000","last_became_active":"2024-09-17T05:53:14.549429+0000","last_became_peered":"2024-09-17T05:53:14.549429+0000","last_unstale":"2024-09-17T05:53:16.572412+0000","last_undegraded":"2024-09-17T05:53:16.572412+0000","last_fullsized":"2024-09-17T05:53:16.572412+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:53:13.511622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:53:13.511622+0000","last_clean_scrub_stamp":"2024-09-17T05:53:13.511622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:11:59.457461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.7","version":"140'2","reported_seq":17,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-17T05:53:15.529063+0000","last_change":"2024-09-17T05:53:13.541601+0000","last_active":"2024-09-17T05:53:15.529063+0000","last_peered":"2024-09-17T05:53:15.529063+0000","last_clean":"2024-09-17T05:53:15.529063+0000","last_became_active":"2024-09-17T05:53:13.541201+0000","last_became_peered":"2024-09-17T05:53:13.541201+0000","last_unstale":"2024-09-17T05:53:15.529063+0000","last_undegraded":"2024-09-17T05:53:15.529063+0000","last_fullsized":"2024-09-17T05:53:15.529063+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:53:12.509392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:53:12.509392+0000","last_clean_scrub_stamp":"2024-09-17T05:53:12.509392+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:58:54.719539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:53:13.511622+0000","last_change":"2024-09-17T05:53:13.511622+0000","last_active":"2024-09-17T05:53:13.511622+0000","last_peered":"2024-09-17T05:53:13.511622+0000","last_clean":"2024-09-17T05:53:13.511622+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:53:13.511622+0000","last_undegraded":"2024-09-17T05:53:13.511622+0000","last_fullsized":"2024-09-17T05:53:13.511622+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:53:13.511622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:53:13.511622+0000","last_clean_scrub_stamp":"2024-09-17T05:53:13.511622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.6","version":"0'0","reported_seq":1,"reported_epoch":138,"state":"creating+peering","last_fresh":"2024-09-17T05:53:12.517509+0000","last_change":"2024-09-17T05:53:12.517509+0000","last_active":"2024-09-17T05:53:12.509392+0000","last_peered":"2024-09-17T05:53:12.509392+0000","last_clean":"2024-09-17T05:53:12.509392+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:53:12.517509+0000","last_undegraded":"2024-09-17T05:53:12.517509+0000","last_fullsized":"2024-09-17T05:53:12.517509+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:53:12.509392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:53:12.509392+0000","last_clean_scrub_stamp":"2024-09-17T05:53:12.509392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:53:13.511622+0000","last_change":"2024-09-17T05:53:13.511622+0000","last_active":"2024-09-17T05:53:13.511622+0000","last_peered":"2024-09-17T05:53:13.511622+0000","last_clean":"2024-09-17T05:53:13.511622+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:53:13.511622+0000","last_undegraded":"2024-09-17T05:53:13.511622+0000","last_fullsized":"2024-09-17T05:53:13.511622+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:53:13.511622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:53:13.511622+0000","last_clean_scrub_stamp":"2024-09-17T05:53:13.511622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.5","version":"0'0","reported_seq":1,"reported_epoch":138,"state":"creating+peering","last_fresh":"2024-09-17T05:53:12.516944+0000","last_change":"2024-09-17T05:53:12.516944+0000","last_active":"2024-09-17T05:53:12.509392+0000","last_peered":"2024-09-17T05:53:12.509392+0000","last_clean":"2024-09-17T05:53:12.509392+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:53:12.516944+0000","last_undegraded":"2024-09-17T05:53:12.516944+0000","last_fullsized":"2024-09-17T05:53:12.516944+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:53:12.509392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:53:12.509392+0000","last_clean_scrub_stamp":"2024-09-17T05:53:12.509392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:53:13.511622+0000","last_change":"2024-09-17T05:53:13.511622+0000","last_active":"2024-09-17T05:53:13.511622+0000","last_peered":"2024-09-17T05:53:13.511622+0000","last_clean":"2024-09-17T05:53:13.511622+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:53:13.511622+0000","last_undegraded":"2024-09-17T05:53:13.511622+0000","last_fullsized":"2024-09-17T05:53:13.511622+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:53:13.511622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:53:13.511622+0000","last_clean_scrub_stamp":"2024-09-17T05:53:13.511622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.4","version":"0'0","reported_seq":1,"reported_epoch":138,"state":"creating+peering","last_fresh":"2024-09-17T05:53:12.516971+0000","last_change":"2024-09-17T05:53:12.516971+0000","last_active":"2024-09-17T05:53:12.509392+0000","last_peered":"2024-09-17T05:53:12.509392+0000","last_clean":"2024-09-17T05:53:12.509392+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:53:12.516971+0000","last_undegraded":"2024-09-17T05:53:12.516971+0000","last_fullsized":"2024-09-17T05:53:12.516971+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:53:12.509392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:53:12.509392+0000","last_clean_scrub_stamp":"2024-09-17T05:53:12.509392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:53:13.511622+0000","last_change":"2024-09-17T05:53:13.511622+0000","last_active":"2024-09-17T05:53:13.511622+0000","last_peered":"2024-09-17T05:53:13.511622+0000","last_clean":"2024-09-17T05:53:13.511622+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:53:13.511622+0000","last_undegraded":"2024-09-17T05:53:13.511622+0000","last_fullsized":"2024-09-17T05:53:13.511622+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:53:13.511622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:53:13.511622+0000","last_clean_scrub_stamp":"2024-09-17T05:53:13.511622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.3","version":"0'0","reported_seq":10,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-09-17T05:53:13.535257+0000","last_change":"2024-09-17T05:53:13.534284+0000","last_active":"2024-09-17T05:53:13.535257+0000","last_peered":"2024-09-17T05:53:13.535257+0000","last_clean":"2024-09-17T05:53:13.535257+0000","last_became_active":"2024-09-17T05:53:13.533933+0000","last_became_peered":"2024-09-17T05:53:13.533933+0000","last_unstale":"2024-09-17T05:53:13.535257+0000","last_undegraded":"2024-09-17T05:53:13.535257+0000","last_fullsized":"2024-09-17T05:53:13.535257+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:53:12.509392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:53:12.509392+0000","last_clean_scrub_stamp":"2024-09-17T05:53:12.509392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:26:31.492927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.3","version":"0'0","reported_seq":13,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-17T05:53:16.572509+0000","last_change":"2024-09-17T05:53:14.538521+0000","last_active":"2024-09-17T05:53:16.572509+0000","last_peered":"2024-09-17T05:53:16.572509+0000","last_clean":"2024-09-17T05:53:16.572509+0000","last_became_active":"2024-09-17T05:53:14.538059+0000","last_became_peered":"2024-09-17T05:53:14.538059+0000","last_unstale":"2024-09-17T05:53:16.572509+0000","last_undegraded":"2024-09-17T05:53:16.572509+0000","last_fullsized":"2024-09-17T05:53:16.572509+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:53:13.511622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:53:13.511622+0000","last_clean_scrub_stamp":"2024-09-17T05:53:13.511622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:06:01.140596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.2","version":"0'0","reported_seq":15,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-17T05:53:15.527619+0000","last_change":"2024-09-17T05:53:13.541556+0000","last_active":"2024-09-17T05:53:15.527619+0000","last_peered":"2024-09-17T05:53:15.527619+0000","last_clean":"2024-09-17T05:53:15.527619+0000","last_became_active":"2024-09-17T05:53:13.540985+0000","last_became_peered":"2024-09-17T05:53:13.540985+0000","last_unstale":"2024-09-17T05:53:15.527619+0000","last_undegraded":"2024-09-17T05:53:15.527619+0000","last_fullsized":"2024-09-17T05:53:15.527619+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:53:12.509392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:53:12.509392+0000","last_clean_scrub_stamp":"2024-09-17T05:53:12.509392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:59:32.172184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.0","version":"0'0","reported_seq":13,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-17T05:53:15.527867+0000","last_change":"2024-09-17T05:53:14.553791+0000","last_active":"2024-09-17T05:53:15.527867+0000","last_peered":"2024-09-17T05:53:15.527867+0000","last_clean":"2024-09-17T05:53:15.527867+0000","last_became_active":"2024-09-17T05:53:14.552645+0000","last_became_peered":"2024-09-17T05:53:14.552645+0000","last_unstale":"2024-09-17T05:53:15.527867+0000","last_undegraded":"2024-09-17T05:53:15.527867+0000","last_fullsized":"2024-09-17T05:53:15.527867+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:53:13.511622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:53:13.511622+0000","last_clean_scrub_stamp":"2024-09-17T05:53:13.511622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:17:37.335559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.1","version":"0'0","reported_seq":1,"reported_epoch":138,"state":"creating+peering","last_fresh":"2024-09-17T05:53:12.517785+0000","last_change":"2024-09-17T05:53:12.517785+0000","last_active":"2024-09-17T05:53:12.509392+0000","last_peered":"2024-09-17T05:53:12.509392+0000","last_clean":"2024-09-17T05:53:12.509392+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:53:12.517785+0000","last_undegraded":"2024-09-17T05:53:12.517785+0000","last_fullsized":"2024-09-17T05:53:12.517785+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:53:12.509392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:53:12.509392+0000","last_clean_scrub_stamp":"2024-09-17T05:53:12.509392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.1","version":"0'0","reported_seq":13,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-17T05:53:16.572259+0000","last_change":"2024-09-17T05:53:14.536337+0000","last_active":"2024-09-17T05:53:16.572259+0000","last_peered":"2024-09-17T05:53:16.572259+0000","last_clean":"2024-09-17T05:53:16.572259+0000","last_became_active":"2024-09-17T05:53:14.535962+0000","last_became_peered":"2024-09-17T05:53:14.535962+0000","last_unstale":"2024-09-17T05:53:16.572259+0000","last_undegraded":"2024-09-17T05:53:16.572259+0000","last_fullsized":"2024-09-17T05:53:16.572259+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:53:13.511622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:53:13.511622+0000","last_clean_scrub_stamp":"2024-09-17T05:53:13.511622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:12:43.179255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.0","version":"0'0","reported_seq":1,"reported_epoch":138,"state":"creating+peering","last_fresh":"2024-09-17T05:53:12.519815+0000","last_change":"2024-09-17T05:53:12.519815+0000","last_active":"2024-09-17T05:53:12.509392+0000","last_peered":"2024-09-17T05:53:12.509392+0000","last_clean":"2024-09-17T05:53:12.509392+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:53:12.519815+0000","last_undegraded":"2024-09-17T05:53:12.519815+0000","last_fullsized":"2024-09-17T05:53:12.519815+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:53:12.509392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:53:12.509392+0000","last_clean_scrub_stamp":"2024-09-17T05:53:12.509392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.14","version":"0'0","reported_seq":1,"reported_epoch":139,"state":"creating+peering","last_fresh":"2024-09-17T05:53:13.527612+0000","last_change":"2024-09-17T05:53:13.527612+0000","last_active":"2024-09-17T05:53:13.511622+0000","last_peered":"2024-09-17T05:53:13.511622+0000","last_clean":"2024-09-17T05:53:13.511622+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:53:13.527612+0000","last_undegraded":"2024-09-17T05:53:13.527612+0000","last_fullsized":"2024-09-17T05:53:13.527612+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:53:13.511622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:53:13.511622+0000","last_clean_scrub_stamp":"2024-09-17T05:53:13.511622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.15","version":"0'0","reported_seq":1,"reported_epoch":138,"state":"creating+peering","last_fresh":"2024-09-17T05:53:12.517048+0000","last_change":"2024-09-17T05:53:12.517048+0000","last_active":"2024-09-17T05:53:12.509392+0000","last_peered":"2024-09-17T05:53:12.509392+0000","last_clean":"2024-09-17T05:53:12.509392+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:53:12.517048+0000","last_undegraded":"2024-09-17T05:53:12.517048+0000","last_fullsized":"2024-09-17T05:53:12.517048+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:53:12.509392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:53:12.509392+0000","last_clean_scrub_stamp":"2024-09-17T05:53:12.509392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"19'72","reported_seq":328,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-17T05:53:15.528005+0000","last_change":"2024-09-17T05:41:48.539830+0000","last_active":"2024-09-17T05:53:15.528005+0000","last_peered":"2024-09-17T05:53:15.528005+0000","last_clean":"2024-09-17T05:53:15.528005+0000","last_became_active":"2024-09-17T05:41:48.538743+0000","last_became_peered":"2024-09-17T05:41:48.538743+0000","last_unstale":"2024-09-17T05:53:15.528005+0000","last_undegraded":"2024-09-17T05:53:15.528005+0000","last_fullsized":"2024-09-17T05:53:15.528005+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:47.152539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:47.152539+0000","last_clean_scrub_stamp":"2024-09-17T05:41:47.152539+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:08:02.952016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":21,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":48,"acting":48,"num_store_stats":3},{"poolid":20,"num_pg":32,"stat_sum":{"num_bytes":604,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":674,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":8,"ondisk_log_size":8,"up":58,"acting":58,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":16,"seq":68719476878,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":145256,"kb_used_data":1680,"kb_used_omap":1,"kb_used_meta":143550,"kb_avail":94226584,"statfs":{"total":96636764160,"available":96488022016,"internally_reserved":0,"allocated":1720320,"data_stored":757502,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":146995654},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":15,"seq":64424509583,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":119512,"kb_used_data":2304,"kb_used_omap":1,"kb_used_meta":117182,"kb_avail":94252328,"statfs":{"total":96636764160,"available":96514383872,"internally_reserved":0,"allocated":2359296,"data_stored":1368460,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":119994826},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509582,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":131396,"kb_used_data":1708,"kb_used_omap":1,"kb_used_meta":129662,"kb_avail":94240444,"statfs":{"total":96636764160,"available":96502214656,"internally_reserved":0,"allocated":1748992,"data_stored":770966,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":132774341},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509581,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":141092,"kb_used_data":1668,"kb_used_omap":1,"kb_used_meta":139390,"kb_avail":94230748,"statfs":{"total":96636764160,"available":96492285952,"internally_reserved":0,"allocated":1708032,"data_stored":751489,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":142735813},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509581,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":123044,"kb_used_data":1680,"kb_used_omap":1,"kb_used_meta":121342,"kb_avail":94248796,"statfs":{"total":96636764160,"available":96510767104,"internally_reserved":0,"allocated":1720320,"data_stored":757502,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":124254663},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509581,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":141092,"kb_used_data":1680,"kb_used_omap":1,"kb_used_meta":139390,"kb_avail":94230748,"statfs":{"total":96636764160,"available":96492285952,"internally_reserved":0,"allocated":1720320,"data_stored":757502,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":142735813},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509581,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":145252,"kb_used_data":1680,"kb_used_omap":1,"kb_used_meta":143550,"kb_avail":94226588,"statfs":{"total":96636764160,"available":96488026112,"internally_reserved":0,"allocated":1720320,"data_stored":757502,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":146995653},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574989,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":123628,"kb_used_data":2260,"kb_used_omap":1,"kb_used_meta":121342,"kb_avail":94248212,"statfs":{"total":96636764160,"available":96510169088,"internally_reserved":0,"allocated":2314240,"data_stored":1347870,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":124254661},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-17T05:53:17.919 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-17T05:53:18.069 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:18.067+0000 7f4aa912b640 1 -- 172.21.15.150:0/2030027297 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4aa40d0550 msgr2=0x7f4aa40b18c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:53:18.070 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:18.067+0000 7f4aa912b640 1 --2- 172.21.15.150:0/2030027297 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4aa40d0550 0x7f4aa40b18c0 secure :-1 s=READY pgs=1846 cs=0 l=1 rev1=1 crypto rx=0x7f4aa40b7900 tx=0x7f4a8c02a5f0 comp rx=0 tx=0).stop 2024-09-17T05:53:18.070 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:18.067+0000 7f4aa912b640 1 -- 172.21.15.150:0/2030027297 shutdown_connections 2024-09-17T05:53:18.070 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:18.067+0000 7f4aa912b640 1 --2- 172.21.15.150:0/2030027297 >> v2:172.21.15.176:3300/0 conn(0x7f4aa40d1060 0x7f4aa40b1e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:53:18.070 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:18.067+0000 7f4aa912b640 1 --2- 172.21.15.150:0/2030027297 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4aa40d0550 0x7f4aa40b18c0 unknown :-1 s=CLOSED pgs=1846 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:53:18.070 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:18.067+0000 7f4aa912b640 1 --2- 172.21.15.150:0/2030027297 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4aa40d0c50 0x7f4aa40d0010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:53:18.070 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:18.067+0000 7f4aa912b640 1 -- 172.21.15.150:0/2030027297 >> 172.21.15.150:0/2030027297 conn(0x7f4aa40b3fc0 msgr2=0x7f4aa40b43d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:53:18.070 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:18.067+0000 7f4aa912b640 1 -- 172.21.15.150:0/2030027297 shutdown_connections 2024-09-17T05:53:18.070 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:18.067+0000 7f4aa912b640 1 -- 172.21.15.150:0/2030027297 wait complete. 2024-09-17T05:53:18.071 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:18.069+0000 7f4aa912b640 1 Processor -- start 2024-09-17T05:53:18.071 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:18.069+0000 7f4aa912b640 1 -- start start 2024-09-17T05:53:18.074 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:18.071+0000 7f4aa912b640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4aa40d0550 0x7f4aa409c240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:53:18.074 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:18.071+0000 7f4aa912b640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4aa40d0c50 0x7f4aa4153960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:53:18.074 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:18.071+0000 7f4aa912b640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4aa40d1060 0x7f4aa40c7ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:53:18.074 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:18.071+0000 7f4aa912b640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f4aa40cecf0 con 0x7f4aa40d0550 2024-09-17T05:53:18.074 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:18.071+0000 7f4aa912b640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f4aa40ceb70 con 0x7f4aa40d0c50 2024-09-17T05:53:18.074 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:18.071+0000 7f4aa912b640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f4aa4160a90 con 0x7f4aa40d1060 2024-09-17T05:53:18.074 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:18.071+0000 7f4aa2d9d640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4aa40d0550 0x7f4aa409c240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:53:18.074 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:18.071+0000 7f4aa2d9d640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4aa40d0550 0x7f4aa409c240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:35010/0 (socket says 172.21.15.150:35010) 2024-09-17T05:53:18.074 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:18.071+0000 7f4aa2d9d640 1 -- 172.21.15.150:0/2654124216 learned_addr learned my addr 172.21.15.150:0/2654124216 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:53:18.074 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:18.071+0000 7f4a9bfff640 1 --2- 172.21.15.150:0/2654124216 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4aa40d0c50 0x7f4aa4153960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:53:18.074 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:18.071+0000 7f4aa359e640 1 --2- 172.21.15.150:0/2654124216 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4aa40d1060 0x7f4aa40c7ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:53:18.075 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:18.071+0000 7f4aa2d9d640 1 -- 172.21.15.150:0/2654124216 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4aa40d1060 msgr2=0x7f4aa40c7ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:53:18.075 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:18.071+0000 7f4aa2d9d640 1 --2- 172.21.15.150:0/2654124216 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4aa40d1060 0x7f4aa40c7ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:53:18.075 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:18.071+0000 7f4aa2d9d640 1 -- 172.21.15.150:0/2654124216 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4aa40d0c50 msgr2=0x7f4aa4153960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:53:18.075 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:18.071+0000 7f4aa2d9d640 1 --2- 172.21.15.150:0/2654124216 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4aa40d0c50 0x7f4aa4153960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:53:18.075 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:18.071+0000 7f4aa2d9d640 1 -- 172.21.15.150:0/2654124216 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4aa409c780 con 0x7f4aa40d0550 2024-09-17T05:53:18.075 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:18.071+0000 7f4aa2d9d640 1 --2- 172.21.15.150:0/2654124216 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4aa40d0550 0x7f4aa409c240 secure :-1 s=READY pgs=1847 cs=0 l=1 rev1=1 crypto rx=0x7f4a9400c940 tx=0x7f4a9400ce00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:53:18.075 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:18.071+0000 7f4a9b7fe640 1 -- 172.21.15.150:0/2654124216 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a94004220 con 0x7f4aa40d0550 2024-09-17T05:53:18.075 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:18.071+0000 7f4a9b7fe640 1 -- 172.21.15.150:0/2654124216 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f4a940079b0 con 0x7f4aa40d0550 2024-09-17T05:53:18.075 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:18.071+0000 7f4a9b7fe640 1 -- 172.21.15.150:0/2654124216 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a94007de0 con 0x7f4aa40d0550 2024-09-17T05:53:18.075 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:18.071+0000 7f4aa912b640 1 -- 172.21.15.150:0/2654124216 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4aa409cc90 con 0x7f4aa40d0550 2024-09-17T05:53:18.075 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:18.072+0000 7f4aa912b640 1 -- 172.21.15.150:0/2654124216 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4aa41f73b0 con 0x7f4aa40d0550 2024-09-17T05:53:18.076 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:18.073+0000 7f4aa912b640 1 -- 172.21.15.150:0/2654124216 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4aa40d0010 con 0x7f4aa40d0550 2024-09-17T05:53:18.076 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:18.073+0000 7f4a9b7fe640 1 -- 172.21.15.150:0/2654124216 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 45) ==== 104501+0+0 (secure 0 0 0) 0x7f4a94005020 con 0x7f4aa40d0550 2024-09-17T05:53:18.076 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:18.074+0000 7f4a9b7fe640 1 --2- 172.21.15.150:0/2654124216 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f4a8407ad50 0x7f4a8407d260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:53:18.076 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:18.074+0000 7f4a9b7fe640 1 -- 172.21.15.150:0/2654124216 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(141..141 src has 1..141) ==== 5905+0+0 (secure 0 0 0) 0x7f4a9409a0c0 con 0x7f4aa40d0550 2024-09-17T05:53:18.076 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:18.074+0000 7f4a9bfff640 1 --2- 172.21.15.150:0/2654124216 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f4a8407ad50 0x7f4a8407d260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:53:18.077 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:18.075+0000 7f4a9bfff640 1 --2- 172.21.15.150:0/2654124216 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f4a8407ad50 0x7f4a8407d260 secure :-1 s=READY pgs=784 cs=0 l=1 rev1=1 crypto rx=0x7f4a8c033000 tx=0x7f4a8c004730 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:53:18.080 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:18.079+0000 7f4a9b7fe640 1 -- 172.21.15.150:0/2654124216 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f4a94014030 con 0x7f4aa40d0550 2024-09-17T05:53:18.253 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:18.252+0000 7f4aa912b640 1 -- 172.21.15.150:0/2654124216 --> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f4aa4076850 con 0x7f4a8407ad50 2024-09-17T05:53:18.258 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:18.257+0000 7f4a9b7fe640 1 -- 172.21.15.150:0/2654124216 <== mgr.4108 v2:172.21.15.176:6800/3631216395 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+244020 (secure 0 0 0) 0x7f4aa4076850 con 0x7f4a8407ad50 2024-09-17T05:53:18.261 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-09-17T05:53:18.262 INFO:teuthology.orchestra.run.smithi150.stderr:dumped all 2024-09-17T05:53:18.263 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:18.260+0000 7f4aa912b640 1 -- 172.21.15.150:0/2654124216 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f4a8407ad50 msgr2=0x7f4a8407d260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:53:18.264 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:18.260+0000 7f4aa912b640 1 --2- 172.21.15.150:0/2654124216 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f4a8407ad50 0x7f4a8407d260 secure :-1 s=READY pgs=784 cs=0 l=1 rev1=1 crypto rx=0x7f4a8c033000 tx=0x7f4a8c004730 comp rx=0 tx=0).stop 2024-09-17T05:53:18.264 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:18.260+0000 7f4aa912b640 1 -- 172.21.15.150:0/2654124216 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4aa40d0550 msgr2=0x7f4aa409c240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:53:18.264 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:18.260+0000 7f4aa912b640 1 --2- 172.21.15.150:0/2654124216 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4aa40d0550 0x7f4aa409c240 secure :-1 s=READY pgs=1847 cs=0 l=1 rev1=1 crypto rx=0x7f4a9400c940 tx=0x7f4a9400ce00 comp rx=0 tx=0).stop 2024-09-17T05:53:18.264 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:18.260+0000 7f4aa912b640 1 -- 172.21.15.150:0/2654124216 shutdown_connections 2024-09-17T05:53:18.264 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:18.260+0000 7f4aa912b640 1 --2- 172.21.15.150:0/2654124216 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4aa40d0c50 0x7f4aa4153960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:53:18.264 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:18.260+0000 7f4aa912b640 1 --2- 172.21.15.150:0/2654124216 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f4a8407ad50 0x7f4a8407d260 unknown :-1 s=CLOSED pgs=784 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:53:18.264 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:18.260+0000 7f4aa912b640 1 --2- 172.21.15.150:0/2654124216 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4aa40d1060 0x7f4aa40c7ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:53:18.264 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:18.260+0000 7f4aa912b640 1 --2- 172.21.15.150:0/2654124216 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4aa40d0550 0x7f4aa409c240 unknown :-1 s=CLOSED pgs=1847 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:53:18.264 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:18.260+0000 7f4aa912b640 1 -- 172.21.15.150:0/2654124216 >> 172.21.15.150:0/2654124216 conn(0x7f4aa40b3fc0 msgr2=0x7f4aa4071c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:53:18.264 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:18.260+0000 7f4aa912b640 1 -- 172.21.15.150:0/2654124216 shutdown_connections 2024-09-17T05:53:18.264 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:18.260+0000 7f4aa912b640 1 -- 172.21.15.150:0/2654124216 wait complete. 2024-09-17T05:53:18.274 INFO:teuthology.orchestra.run.smithi150.stdout:{"pg_ready":true,"pg_map":{"version":481,"stamp":"2024-09-17T05:53:17.094124+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590972,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":109,"num_write_kb":1630,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":80,"ondisk_log_size":80,"up":108,"acting":108,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":70,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":7,"kb":754974720,"kb_used":1070272,"kb_used_data":14660,"kb_used_omap":12,"kb_used_meta":1055411,"kb_avail":753904448,"statfs":{"total":773094113280,"available":771998154752,"internally_reserved":0,"allocated":15011840,"data_stored":7268793,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":1080741424},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":604,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.581804"},"pg_stats":[{"pgid":"21.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:53:13.511622+0000","last_change":"2024-09-17T05:53:13.511622+0000","last_active":"2024-09-17T05:53:13.511622+0000","last_peered":"2024-09-17T05:53:13.511622+0000","last_clean":"2024-09-17T05:53:13.511622+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:53:13.511622+0000","last_undegraded":"2024-09-17T05:53:13.511622+0000","last_fullsized":"2024-09-17T05:53:13.511622+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:53:13.511622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:53:13.511622+0000","last_clean_scrub_stamp":"2024-09-17T05:53:13.511622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:53:13.511622+0000","last_change":"2024-09-17T05:53:13.511622+0000","last_active":"2024-09-17T05:53:13.511622+0000","last_peered":"2024-09-17T05:53:13.511622+0000","last_clean":"2024-09-17T05:53:13.511622+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:53:13.511622+0000","last_undegraded":"2024-09-17T05:53:13.511622+0000","last_fullsized":"2024-09-17T05:53:13.511622+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:53:13.511622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:53:13.511622+0000","last_clean_scrub_stamp":"2024-09-17T05:53:13.511622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:53:13.511622+0000","last_change":"2024-09-17T05:53:13.511622+0000","last_active":"2024-09-17T05:53:13.511622+0000","last_peered":"2024-09-17T05:53:13.511622+0000","last_clean":"2024-09-17T05:53:13.511622+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:53:13.511622+0000","last_undegraded":"2024-09-17T05:53:13.511622+0000","last_fullsized":"2024-09-17T05:53:13.511622+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:53:13.511622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:53:13.511622+0000","last_clean_scrub_stamp":"2024-09-17T05:53:13.511622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:53:13.511622+0000","last_change":"2024-09-17T05:53:13.511622+0000","last_active":"2024-09-17T05:53:13.511622+0000","last_peered":"2024-09-17T05:53:13.511622+0000","last_clean":"2024-09-17T05:53:13.511622+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:53:13.511622+0000","last_undegraded":"2024-09-17T05:53:13.511622+0000","last_fullsized":"2024-09-17T05:53:13.511622+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:53:13.511622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:53:13.511622+0000","last_clean_scrub_stamp":"2024-09-17T05:53:13.511622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.3b","version":"0'0","reported_seq":13,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-17T05:53:16.572208+0000","last_change":"2024-09-17T05:53:14.550770+0000","last_active":"2024-09-17T05:53:16.572208+0000","last_peered":"2024-09-17T05:53:16.572208+0000","last_clean":"2024-09-17T05:53:16.572208+0000","last_became_active":"2024-09-17T05:53:14.550289+0000","last_became_peered":"2024-09-17T05:53:14.550289+0000","last_unstale":"2024-09-17T05:53:16.572208+0000","last_undegraded":"2024-09-17T05:53:16.572208+0000","last_fullsized":"2024-09-17T05:53:16.572208+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:53:13.511622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:53:13.511622+0000","last_clean_scrub_stamp":"2024-09-17T05:53:13.511622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:23:14.461386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:53:13.511622+0000","last_change":"2024-09-17T05:53:13.511622+0000","last_active":"2024-09-17T05:53:13.511622+0000","last_peered":"2024-09-17T05:53:13.511622+0000","last_clean":"2024-09-17T05:53:13.511622+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:53:13.511622+0000","last_undegraded":"2024-09-17T05:53:13.511622+0000","last_fullsized":"2024-09-17T05:53:13.511622+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:53:13.511622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:53:13.511622+0000","last_clean_scrub_stamp":"2024-09-17T05:53:13.511622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.39","version":"0'0","reported_seq":1,"reported_epoch":139,"state":"creating+peering","last_fresh":"2024-09-17T05:53:13.527403+0000","last_change":"2024-09-17T05:53:13.527403+0000","last_active":"2024-09-17T05:53:13.511622+0000","last_peered":"2024-09-17T05:53:13.511622+0000","last_clean":"2024-09-17T05:53:13.511622+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:53:13.527403+0000","last_undegraded":"2024-09-17T05:53:13.527403+0000","last_fullsized":"2024-09-17T05:53:13.527403+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:53:13.511622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:53:13.511622+0000","last_clean_scrub_stamp":"2024-09-17T05:53:13.511622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:53:13.511622+0000","last_change":"2024-09-17T05:53:13.511622+0000","last_active":"2024-09-17T05:53:13.511622+0000","last_peered":"2024-09-17T05:53:13.511622+0000","last_clean":"2024-09-17T05:53:13.511622+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:53:13.511622+0000","last_undegraded":"2024-09-17T05:53:13.511622+0000","last_fullsized":"2024-09-17T05:53:13.511622+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:53:13.511622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:53:13.511622+0000","last_clean_scrub_stamp":"2024-09-17T05:53:13.511622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:53:13.511622+0000","last_change":"2024-09-17T05:53:13.511622+0000","last_active":"2024-09-17T05:53:13.511622+0000","last_peered":"2024-09-17T05:53:13.511622+0000","last_clean":"2024-09-17T05:53:13.511622+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:53:13.511622+0000","last_undegraded":"2024-09-17T05:53:13.511622+0000","last_fullsized":"2024-09-17T05:53:13.511622+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:53:13.511622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:53:13.511622+0000","last_clean_scrub_stamp":"2024-09-17T05:53:13.511622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.36","version":"0'0","reported_seq":13,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-17T05:53:15.527536+0000","last_change":"2024-09-17T05:53:14.556175+0000","last_active":"2024-09-17T05:53:15.527536+0000","last_peered":"2024-09-17T05:53:15.527536+0000","last_clean":"2024-09-17T05:53:15.527536+0000","last_became_active":"2024-09-17T05:53:14.555806+0000","last_became_peered":"2024-09-17T05:53:14.555806+0000","last_unstale":"2024-09-17T05:53:15.527536+0000","last_undegraded":"2024-09-17T05:53:15.527536+0000","last_fullsized":"2024-09-17T05:53:15.527536+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:53:13.511622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:53:13.511622+0000","last_clean_scrub_stamp":"2024-09-17T05:53:13.511622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:25:57.952915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:53:13.511622+0000","last_change":"2024-09-17T05:53:13.511622+0000","last_active":"2024-09-17T05:53:13.511622+0000","last_peered":"2024-09-17T05:53:13.511622+0000","last_clean":"2024-09-17T05:53:13.511622+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:53:13.511622+0000","last_undegraded":"2024-09-17T05:53:13.511622+0000","last_fullsized":"2024-09-17T05:53:13.511622+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:53:13.511622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:53:13.511622+0000","last_clean_scrub_stamp":"2024-09-17T05:53:13.511622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.34","version":"0'0","reported_seq":13,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-17T05:53:15.528949+0000","last_change":"2024-09-17T05:53:14.548964+0000","last_active":"2024-09-17T05:53:15.528949+0000","last_peered":"2024-09-17T05:53:15.528949+0000","last_clean":"2024-09-17T05:53:15.528949+0000","last_became_active":"2024-09-17T05:53:14.548601+0000","last_became_peered":"2024-09-17T05:53:14.548601+0000","last_unstale":"2024-09-17T05:53:15.528949+0000","last_undegraded":"2024-09-17T05:53:15.528949+0000","last_fullsized":"2024-09-17T05:53:15.528949+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:53:13.511622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:53:13.511622+0000","last_clean_scrub_stamp":"2024-09-17T05:53:13.511622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:37:55.173570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.33","version":"0'0","reported_seq":13,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-17T05:53:16.572443+0000","last_change":"2024-09-17T05:53:14.550313+0000","last_active":"2024-09-17T05:53:16.572443+0000","last_peered":"2024-09-17T05:53:16.572443+0000","last_clean":"2024-09-17T05:53:16.572443+0000","last_became_active":"2024-09-17T05:53:14.549928+0000","last_became_peered":"2024-09-17T05:53:14.549928+0000","last_unstale":"2024-09-17T05:53:16.572443+0000","last_undegraded":"2024-09-17T05:53:16.572443+0000","last_fullsized":"2024-09-17T05:53:16.572443+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:53:13.511622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:53:13.511622+0000","last_clean_scrub_stamp":"2024-09-17T05:53:13.511622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:24:22.329433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:53:13.511622+0000","last_change":"2024-09-17T05:53:13.511622+0000","last_active":"2024-09-17T05:53:13.511622+0000","last_peered":"2024-09-17T05:53:13.511622+0000","last_clean":"2024-09-17T05:53:13.511622+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:53:13.511622+0000","last_undegraded":"2024-09-17T05:53:13.511622+0000","last_fullsized":"2024-09-17T05:53:13.511622+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:53:13.511622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:53:13.511622+0000","last_clean_scrub_stamp":"2024-09-17T05:53:13.511622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.31","version":"0'0","reported_seq":13,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-17T05:53:15.528260+0000","last_change":"2024-09-17T05:53:14.554387+0000","last_active":"2024-09-17T05:53:15.528260+0000","last_peered":"2024-09-17T05:53:15.528260+0000","last_clean":"2024-09-17T05:53:15.528260+0000","last_became_active":"2024-09-17T05:53:14.553370+0000","last_became_peered":"2024-09-17T05:53:14.553370+0000","last_unstale":"2024-09-17T05:53:15.528260+0000","last_undegraded":"2024-09-17T05:53:15.528260+0000","last_fullsized":"2024-09-17T05:53:15.528260+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:53:13.511622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:53:13.511622+0000","last_clean_scrub_stamp":"2024-09-17T05:53:13.511622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:28:53.104884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:53:13.511622+0000","last_change":"2024-09-17T05:53:13.511622+0000","last_active":"2024-09-17T05:53:13.511622+0000","last_peered":"2024-09-17T05:53:13.511622+0000","last_clean":"2024-09-17T05:53:13.511622+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:53:13.511622+0000","last_undegraded":"2024-09-17T05:53:13.511622+0000","last_fullsized":"2024-09-17T05:53:13.511622+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:53:13.511622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:53:13.511622+0000","last_clean_scrub_stamp":"2024-09-17T05:53:13.511622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.2f","version":"0'0","reported_seq":13,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-17T05:53:15.528909+0000","last_change":"2024-09-17T05:53:14.555496+0000","last_active":"2024-09-17T05:53:15.528909+0000","last_peered":"2024-09-17T05:53:15.528909+0000","last_clean":"2024-09-17T05:53:15.528909+0000","last_became_active":"2024-09-17T05:53:14.554855+0000","last_became_peered":"2024-09-17T05:53:14.554855+0000","last_unstale":"2024-09-17T05:53:15.528909+0000","last_undegraded":"2024-09-17T05:53:15.528909+0000","last_fullsized":"2024-09-17T05:53:15.528909+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:53:13.511622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:53:13.511622+0000","last_clean_scrub_stamp":"2024-09-17T05:53:13.511622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:25:34.532282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:53:13.511622+0000","last_change":"2024-09-17T05:53:13.511622+0000","last_active":"2024-09-17T05:53:13.511622+0000","last_peered":"2024-09-17T05:53:13.511622+0000","last_clean":"2024-09-17T05:53:13.511622+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:53:13.511622+0000","last_undegraded":"2024-09-17T05:53:13.511622+0000","last_fullsized":"2024-09-17T05:53:13.511622+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:53:13.511622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:53:13.511622+0000","last_clean_scrub_stamp":"2024-09-17T05:53:13.511622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:53:13.511622+0000","last_change":"2024-09-17T05:53:13.511622+0000","last_active":"2024-09-17T05:53:13.511622+0000","last_peered":"2024-09-17T05:53:13.511622+0000","last_clean":"2024-09-17T05:53:13.511622+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:53:13.511622+0000","last_undegraded":"2024-09-17T05:53:13.511622+0000","last_fullsized":"2024-09-17T05:53:13.511622+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:53:13.511622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:53:13.511622+0000","last_clean_scrub_stamp":"2024-09-17T05:53:13.511622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:53:13.511622+0000","last_change":"2024-09-17T05:53:13.511622+0000","last_active":"2024-09-17T05:53:13.511622+0000","last_peered":"2024-09-17T05:53:13.511622+0000","last_clean":"2024-09-17T05:53:13.511622+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:53:13.511622+0000","last_undegraded":"2024-09-17T05:53:13.511622+0000","last_fullsized":"2024-09-17T05:53:13.511622+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:53:13.511622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:53:13.511622+0000","last_clean_scrub_stamp":"2024-09-17T05:53:13.511622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.2b","version":"0'0","reported_seq":13,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-17T05:53:15.528299+0000","last_change":"2024-09-17T05:53:14.546652+0000","last_active":"2024-09-17T05:53:15.528299+0000","last_peered":"2024-09-17T05:53:15.528299+0000","last_clean":"2024-09-17T05:53:15.528299+0000","last_became_active":"2024-09-17T05:53:14.546032+0000","last_became_peered":"2024-09-17T05:53:14.546032+0000","last_unstale":"2024-09-17T05:53:15.528299+0000","last_undegraded":"2024-09-17T05:53:15.528299+0000","last_fullsized":"2024-09-17T05:53:15.528299+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:53:13.511622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:53:13.511622+0000","last_clean_scrub_stamp":"2024-09-17T05:53:13.511622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:39:23.674754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:53:13.511622+0000","last_change":"2024-09-17T05:53:13.511622+0000","last_active":"2024-09-17T05:53:13.511622+0000","last_peered":"2024-09-17T05:53:13.511622+0000","last_clean":"2024-09-17T05:53:13.511622+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:53:13.511622+0000","last_undegraded":"2024-09-17T05:53:13.511622+0000","last_fullsized":"2024-09-17T05:53:13.511622+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:53:13.511622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:53:13.511622+0000","last_clean_scrub_stamp":"2024-09-17T05:53:13.511622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:53:13.511622+0000","last_change":"2024-09-17T05:53:13.511622+0000","last_active":"2024-09-17T05:53:13.511622+0000","last_peered":"2024-09-17T05:53:13.511622+0000","last_clean":"2024-09-17T05:53:13.511622+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:53:13.511622+0000","last_undegraded":"2024-09-17T05:53:13.511622+0000","last_fullsized":"2024-09-17T05:53:13.511622+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:53:13.511622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:53:13.511622+0000","last_clean_scrub_stamp":"2024-09-17T05:53:13.511622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.28","version":"0'0","reported_seq":13,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-17T05:53:15.527650+0000","last_change":"2024-09-17T05:53:14.547009+0000","last_active":"2024-09-17T05:53:15.527650+0000","last_peered":"2024-09-17T05:53:15.527650+0000","last_clean":"2024-09-17T05:53:15.527650+0000","last_became_active":"2024-09-17T05:53:14.546691+0000","last_became_peered":"2024-09-17T05:53:14.546691+0000","last_unstale":"2024-09-17T05:53:15.527650+0000","last_undegraded":"2024-09-17T05:53:15.527650+0000","last_fullsized":"2024-09-17T05:53:15.527650+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:53:13.511622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:53:13.511622+0000","last_clean_scrub_stamp":"2024-09-17T05:53:13.511622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:07:35.487105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:53:13.511622+0000","last_change":"2024-09-17T05:53:13.511622+0000","last_active":"2024-09-17T05:53:13.511622+0000","last_peered":"2024-09-17T05:53:13.511622+0000","last_clean":"2024-09-17T05:53:13.511622+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:53:13.511622+0000","last_undegraded":"2024-09-17T05:53:13.511622+0000","last_fullsized":"2024-09-17T05:53:13.511622+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:53:13.511622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:53:13.511622+0000","last_clean_scrub_stamp":"2024-09-17T05:53:13.511622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:53:13.511622+0000","last_change":"2024-09-17T05:53:13.511622+0000","last_active":"2024-09-17T05:53:13.511622+0000","last_peered":"2024-09-17T05:53:13.511622+0000","last_clean":"2024-09-17T05:53:13.511622+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:53:13.511622+0000","last_undegraded":"2024-09-17T05:53:13.511622+0000","last_fullsized":"2024-09-17T05:53:13.511622+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:53:13.511622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:53:13.511622+0000","last_clean_scrub_stamp":"2024-09-17T05:53:13.511622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:53:13.511622+0000","last_change":"2024-09-17T05:53:13.511622+0000","last_active":"2024-09-17T05:53:13.511622+0000","last_peered":"2024-09-17T05:53:13.511622+0000","last_clean":"2024-09-17T05:53:13.511622+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:53:13.511622+0000","last_undegraded":"2024-09-17T05:53:13.511622+0000","last_fullsized":"2024-09-17T05:53:13.511622+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:53:13.511622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:53:13.511622+0000","last_clean_scrub_stamp":"2024-09-17T05:53:13.511622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.24","version":"0'0","reported_seq":1,"reported_epoch":139,"state":"creating+peering","last_fresh":"2024-09-17T05:53:13.528051+0000","last_change":"2024-09-17T05:53:13.528051+0000","last_active":"2024-09-17T05:53:13.511622+0000","last_peered":"2024-09-17T05:53:13.511622+0000","last_clean":"2024-09-17T05:53:13.511622+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:53:13.528051+0000","last_undegraded":"2024-09-17T05:53:13.528051+0000","last_fullsized":"2024-09-17T05:53:13.528051+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:53:13.511622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:53:13.511622+0000","last_clean_scrub_stamp":"2024-09-17T05:53:13.511622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:53:13.511622+0000","last_change":"2024-09-17T05:53:13.511622+0000","last_active":"2024-09-17T05:53:13.511622+0000","last_peered":"2024-09-17T05:53:13.511622+0000","last_clean":"2024-09-17T05:53:13.511622+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:53:13.511622+0000","last_undegraded":"2024-09-17T05:53:13.511622+0000","last_fullsized":"2024-09-17T05:53:13.511622+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:53:13.511622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:53:13.511622+0000","last_clean_scrub_stamp":"2024-09-17T05:53:13.511622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:53:13.511622+0000","last_change":"2024-09-17T05:53:13.511622+0000","last_active":"2024-09-17T05:53:13.511622+0000","last_peered":"2024-09-17T05:53:13.511622+0000","last_clean":"2024-09-17T05:53:13.511622+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:53:13.511622+0000","last_undegraded":"2024-09-17T05:53:13.511622+0000","last_fullsized":"2024-09-17T05:53:13.511622+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:53:13.511622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:53:13.511622+0000","last_clean_scrub_stamp":"2024-09-17T05:53:13.511622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:53:13.511622+0000","last_change":"2024-09-17T05:53:13.511622+0000","last_active":"2024-09-17T05:53:13.511622+0000","last_peered":"2024-09-17T05:53:13.511622+0000","last_clean":"2024-09-17T05:53:13.511622+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:53:13.511622+0000","last_undegraded":"2024-09-17T05:53:13.511622+0000","last_fullsized":"2024-09-17T05:53:13.511622+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:53:13.511622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:53:13.511622+0000","last_clean_scrub_stamp":"2024-09-17T05:53:13.511622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:53:13.511622+0000","last_change":"2024-09-17T05:53:13.511622+0000","last_active":"2024-09-17T05:53:13.511622+0000","last_peered":"2024-09-17T05:53:13.511622+0000","last_clean":"2024-09-17T05:53:13.511622+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:53:13.511622+0000","last_undegraded":"2024-09-17T05:53:13.511622+0000","last_fullsized":"2024-09-17T05:53:13.511622+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:53:13.511622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:53:13.511622+0000","last_clean_scrub_stamp":"2024-09-17T05:53:13.511622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.1e","version":"0'0","reported_seq":13,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-17T05:53:15.527757+0000","last_change":"2024-09-17T05:53:14.548181+0000","last_active":"2024-09-17T05:53:15.527757+0000","last_peered":"2024-09-17T05:53:15.527757+0000","last_clean":"2024-09-17T05:53:15.527757+0000","last_became_active":"2024-09-17T05:53:14.547859+0000","last_became_peered":"2024-09-17T05:53:14.547859+0000","last_unstale":"2024-09-17T05:53:15.527757+0000","last_undegraded":"2024-09-17T05:53:15.527757+0000","last_fullsized":"2024-09-17T05:53:15.527757+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:53:13.511622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:53:13.511622+0000","last_clean_scrub_stamp":"2024-09-17T05:53:13.511622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:17:09.456622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.1f","version":"140'4","reported_seq":19,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-17T05:53:15.528586+0000","last_change":"2024-09-17T05:53:13.539463+0000","last_active":"2024-09-17T05:53:15.528586+0000","last_peered":"2024-09-17T05:53:15.528586+0000","last_clean":"2024-09-17T05:53:15.528586+0000","last_became_active":"2024-09-17T05:53:13.538767+0000","last_became_peered":"2024-09-17T05:53:13.538767+0000","last_unstale":"2024-09-17T05:53:15.528586+0000","last_undegraded":"2024-09-17T05:53:15.528586+0000","last_fullsized":"2024-09-17T05:53:15.528586+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:53:12.509392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:53:12.509392+0000","last_clean_scrub_stamp":"2024-09-17T05:53:12.509392+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:26:51.175390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:53:13.511622+0000","last_change":"2024-09-17T05:53:13.511622+0000","last_active":"2024-09-17T05:53:13.511622+0000","last_peered":"2024-09-17T05:53:13.511622+0000","last_clean":"2024-09-17T05:53:13.511622+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:53:13.511622+0000","last_undegraded":"2024-09-17T05:53:13.511622+0000","last_fullsized":"2024-09-17T05:53:13.511622+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:53:13.511622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:53:13.511622+0000","last_clean_scrub_stamp":"2024-09-17T05:53:13.511622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.1e","version":"0'0","reported_seq":1,"reported_epoch":138,"state":"creating+peering","last_fresh":"2024-09-17T05:53:12.519409+0000","last_change":"2024-09-17T05:53:12.519409+0000","last_active":"2024-09-17T05:53:12.509392+0000","last_peered":"2024-09-17T05:53:12.509392+0000","last_clean":"2024-09-17T05:53:12.509392+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:53:12.519409+0000","last_undegraded":"2024-09-17T05:53:12.519409+0000","last_fullsized":"2024-09-17T05:53:12.519409+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:53:12.509392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:53:12.509392+0000","last_clean_scrub_stamp":"2024-09-17T05:53:12.509392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:53:13.511622+0000","last_change":"2024-09-17T05:53:13.511622+0000","last_active":"2024-09-17T05:53:13.511622+0000","last_peered":"2024-09-17T05:53:13.511622+0000","last_clean":"2024-09-17T05:53:13.511622+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:53:13.511622+0000","last_undegraded":"2024-09-17T05:53:13.511622+0000","last_fullsized":"2024-09-17T05:53:13.511622+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:53:13.511622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:53:13.511622+0000","last_clean_scrub_stamp":"2024-09-17T05:53:13.511622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:53:12.509392+0000","last_change":"2024-09-17T05:53:12.509392+0000","last_active":"2024-09-17T05:53:12.509392+0000","last_peered":"2024-09-17T05:53:12.509392+0000","last_clean":"2024-09-17T05:53:12.509392+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:53:12.509392+0000","last_undegraded":"2024-09-17T05:53:12.509392+0000","last_fullsized":"2024-09-17T05:53:12.509392+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:53:12.509392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:53:12.509392+0000","last_clean_scrub_stamp":"2024-09-17T05:53:12.509392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.1d","version":"0'0","reported_seq":13,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-17T05:53:15.528652+0000","last_change":"2024-09-17T05:53:14.554059+0000","last_active":"2024-09-17T05:53:15.528652+0000","last_peered":"2024-09-17T05:53:15.528652+0000","last_clean":"2024-09-17T05:53:15.528652+0000","last_became_active":"2024-09-17T05:53:14.553753+0000","last_became_peered":"2024-09-17T05:53:14.553753+0000","last_unstale":"2024-09-17T05:53:15.528652+0000","last_undegraded":"2024-09-17T05:53:15.528652+0000","last_fullsized":"2024-09-17T05:53:15.528652+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:53:13.511622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:53:13.511622+0000","last_clean_scrub_stamp":"2024-09-17T05:53:13.511622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:58:54.333486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:53:12.509392+0000","last_change":"2024-09-17T05:53:12.509392+0000","last_active":"2024-09-17T05:53:12.509392+0000","last_peered":"2024-09-17T05:53:12.509392+0000","last_clean":"2024-09-17T05:53:12.509392+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:53:12.509392+0000","last_undegraded":"2024-09-17T05:53:12.509392+0000","last_fullsized":"2024-09-17T05:53:12.509392+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:53:12.509392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:53:12.509392+0000","last_clean_scrub_stamp":"2024-09-17T05:53:12.509392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:53:13.511622+0000","last_change":"2024-09-17T05:53:13.511622+0000","last_active":"2024-09-17T05:53:13.511622+0000","last_peered":"2024-09-17T05:53:13.511622+0000","last_clean":"2024-09-17T05:53:13.511622+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:53:13.511622+0000","last_undegraded":"2024-09-17T05:53:13.511622+0000","last_fullsized":"2024-09-17T05:53:13.511622+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:53:13.511622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:53:13.511622+0000","last_clean_scrub_stamp":"2024-09-17T05:53:13.511622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.1b","version":"0'0","reported_seq":1,"reported_epoch":138,"state":"creating+peering","last_fresh":"2024-09-17T05:53:12.514220+0000","last_change":"2024-09-17T05:53:12.514220+0000","last_active":"2024-09-17T05:53:12.509392+0000","last_peered":"2024-09-17T05:53:12.509392+0000","last_clean":"2024-09-17T05:53:12.509392+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:53:12.514220+0000","last_undegraded":"2024-09-17T05:53:12.514220+0000","last_fullsized":"2024-09-17T05:53:12.514220+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:53:12.509392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:53:12.509392+0000","last_clean_scrub_stamp":"2024-09-17T05:53:12.509392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:53:13.511622+0000","last_change":"2024-09-17T05:53:13.511622+0000","last_active":"2024-09-17T05:53:13.511622+0000","last_peered":"2024-09-17T05:53:13.511622+0000","last_clean":"2024-09-17T05:53:13.511622+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:53:13.511622+0000","last_undegraded":"2024-09-17T05:53:13.511622+0000","last_fullsized":"2024-09-17T05:53:13.511622+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:53:13.511622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:53:13.511622+0000","last_clean_scrub_stamp":"2024-09-17T05:53:13.511622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.1a","version":"140'1","reported_seq":16,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-17T05:53:16.571986+0000","last_change":"2024-09-17T05:53:13.534883+0000","last_active":"2024-09-17T05:53:16.571986+0000","last_peered":"2024-09-17T05:53:16.571986+0000","last_clean":"2024-09-17T05:53:16.571986+0000","last_became_active":"2024-09-17T05:53:13.534547+0000","last_became_peered":"2024-09-17T05:53:13.534547+0000","last_unstale":"2024-09-17T05:53:16.571986+0000","last_undegraded":"2024-09-17T05:53:16.571986+0000","last_fullsized":"2024-09-17T05:53:16.571986+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:53:12.509392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:53:12.509392+0000","last_clean_scrub_stamp":"2024-09-17T05:53:12.509392+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:24:20.737152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:53:13.511622+0000","last_change":"2024-09-17T05:53:13.511622+0000","last_active":"2024-09-17T05:53:13.511622+0000","last_peered":"2024-09-17T05:53:13.511622+0000","last_clean":"2024-09-17T05:53:13.511622+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:53:13.511622+0000","last_undegraded":"2024-09-17T05:53:13.511622+0000","last_fullsized":"2024-09-17T05:53:13.511622+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:53:13.511622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:53:13.511622+0000","last_clean_scrub_stamp":"2024-09-17T05:53:13.511622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.19","version":"0'0","reported_seq":1,"reported_epoch":138,"state":"creating+peering","last_fresh":"2024-09-17T05:53:12.514359+0000","last_change":"2024-09-17T05:53:12.514359+0000","last_active":"2024-09-17T05:53:12.509392+0000","last_peered":"2024-09-17T05:53:12.509392+0000","last_clean":"2024-09-17T05:53:12.509392+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:53:12.514359+0000","last_undegraded":"2024-09-17T05:53:12.514359+0000","last_fullsized":"2024-09-17T05:53:12.514359+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:53:12.509392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:53:12.509392+0000","last_clean_scrub_stamp":"2024-09-17T05:53:12.509392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.19","version":"0'0","reported_seq":13,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-17T05:53:16.572391+0000","last_change":"2024-09-17T05:53:14.537974+0000","last_active":"2024-09-17T05:53:16.572391+0000","last_peered":"2024-09-17T05:53:16.572391+0000","last_clean":"2024-09-17T05:53:16.572391+0000","last_became_active":"2024-09-17T05:53:14.537611+0000","last_became_peered":"2024-09-17T05:53:14.537611+0000","last_unstale":"2024-09-17T05:53:16.572391+0000","last_undegraded":"2024-09-17T05:53:16.572391+0000","last_fullsized":"2024-09-17T05:53:16.572391+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:53:13.511622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:53:13.511622+0000","last_clean_scrub_stamp":"2024-09-17T05:53:13.511622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:38:57.194890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:53:12.509392+0000","last_change":"2024-09-17T05:53:12.509392+0000","last_active":"2024-09-17T05:53:12.509392+0000","last_peered":"2024-09-17T05:53:12.509392+0000","last_clean":"2024-09-17T05:53:12.509392+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:53:12.509392+0000","last_undegraded":"2024-09-17T05:53:12.509392+0000","last_fullsized":"2024-09-17T05:53:12.509392+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:53:12.509392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:53:12.509392+0000","last_clean_scrub_stamp":"2024-09-17T05:53:12.509392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.16","version":"0'0","reported_seq":13,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-17T05:53:16.572405+0000","last_change":"2024-09-17T05:53:14.542412+0000","last_active":"2024-09-17T05:53:16.572405+0000","last_peered":"2024-09-17T05:53:16.572405+0000","last_clean":"2024-09-17T05:53:16.572405+0000","last_became_active":"2024-09-17T05:53:14.541943+0000","last_became_peered":"2024-09-17T05:53:14.541943+0000","last_unstale":"2024-09-17T05:53:16.572405+0000","last_undegraded":"2024-09-17T05:53:16.572405+0000","last_fullsized":"2024-09-17T05:53:16.572405+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:53:13.511622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:53:13.511622+0000","last_clean_scrub_stamp":"2024-09-17T05:53:13.511622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:06:39.200488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.17","version":"0'0","reported_seq":1,"reported_epoch":138,"state":"creating+peering","last_fresh":"2024-09-17T05:53:12.518858+0000","last_change":"2024-09-17T05:53:12.518858+0000","last_active":"2024-09-17T05:53:12.509392+0000","last_peered":"2024-09-17T05:53:12.509392+0000","last_clean":"2024-09-17T05:53:12.509392+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:53:12.518858+0000","last_undegraded":"2024-09-17T05:53:12.518858+0000","last_fullsized":"2024-09-17T05:53:12.518858+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:53:12.509392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:53:12.509392+0000","last_clean_scrub_stamp":"2024-09-17T05:53:12.509392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.17","version":"0'0","reported_seq":13,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-17T05:53:15.528601+0000","last_change":"2024-09-17T05:53:14.555136+0000","last_active":"2024-09-17T05:53:15.528601+0000","last_peered":"2024-09-17T05:53:15.528601+0000","last_clean":"2024-09-17T05:53:15.528601+0000","last_became_active":"2024-09-17T05:53:14.554514+0000","last_became_peered":"2024-09-17T05:53:14.554514+0000","last_unstale":"2024-09-17T05:53:15.528601+0000","last_undegraded":"2024-09-17T05:53:15.528601+0000","last_fullsized":"2024-09-17T05:53:15.528601+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:53:13.511622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:53:13.511622+0000","last_clean_scrub_stamp":"2024-09-17T05:53:13.511622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:41:18.370466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.16","version":"0'0","reported_seq":15,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-17T05:53:15.528222+0000","last_change":"2024-09-17T05:53:13.534637+0000","last_active":"2024-09-17T05:53:15.528222+0000","last_peered":"2024-09-17T05:53:15.528222+0000","last_clean":"2024-09-17T05:53:15.528222+0000","last_became_active":"2024-09-17T05:53:13.534316+0000","last_became_peered":"2024-09-17T05:53:13.534316+0000","last_unstale":"2024-09-17T05:53:15.528222+0000","last_undegraded":"2024-09-17T05:53:15.528222+0000","last_fullsized":"2024-09-17T05:53:15.528222+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:53:12.509392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:53:12.509392+0000","last_clean_scrub_stamp":"2024-09-17T05:53:12.509392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:17:34.499459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:53:13.511622+0000","last_change":"2024-09-17T05:53:13.511622+0000","last_active":"2024-09-17T05:53:13.511622+0000","last_peered":"2024-09-17T05:53:13.511622+0000","last_clean":"2024-09-17T05:53:13.511622+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:53:13.511622+0000","last_undegraded":"2024-09-17T05:53:13.511622+0000","last_fullsized":"2024-09-17T05:53:13.511622+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:53:13.511622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:53:13.511622+0000","last_clean_scrub_stamp":"2024-09-17T05:53:13.511622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.14","version":"0'0","reported_seq":10,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-09-17T05:53:13.542150+0000","last_change":"2024-09-17T05:53:13.541151+0000","last_active":"2024-09-17T05:53:13.542150+0000","last_peered":"2024-09-17T05:53:13.542150+0000","last_clean":"2024-09-17T05:53:13.542150+0000","last_became_active":"2024-09-17T05:53:13.540717+0000","last_became_peered":"2024-09-17T05:53:13.540717+0000","last_unstale":"2024-09-17T05:53:13.542150+0000","last_undegraded":"2024-09-17T05:53:13.542150+0000","last_fullsized":"2024-09-17T05:53:13.542150+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:53:12.509392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:53:12.509392+0000","last_clean_scrub_stamp":"2024-09-17T05:53:12.509392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:54:36.994315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:53:13.511622+0000","last_change":"2024-09-17T05:53:13.511622+0000","last_active":"2024-09-17T05:53:13.511622+0000","last_peered":"2024-09-17T05:53:13.511622+0000","last_clean":"2024-09-17T05:53:13.511622+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:53:13.511622+0000","last_undegraded":"2024-09-17T05:53:13.511622+0000","last_fullsized":"2024-09-17T05:53:13.511622+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:53:13.511622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:53:13.511622+0000","last_clean_scrub_stamp":"2024-09-17T05:53:13.511622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.13","version":"0'0","reported_seq":1,"reported_epoch":138,"state":"creating+peering","last_fresh":"2024-09-17T05:53:12.516491+0000","last_change":"2024-09-17T05:53:12.516491+0000","last_active":"2024-09-17T05:53:12.509392+0000","last_peered":"2024-09-17T05:53:12.509392+0000","last_clean":"2024-09-17T05:53:12.509392+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:53:12.516491+0000","last_undegraded":"2024-09-17T05:53:12.516491+0000","last_fullsized":"2024-09-17T05:53:12.516491+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:53:12.509392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:53:12.509392+0000","last_clean_scrub_stamp":"2024-09-17T05:53:12.509392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:53:13.511622+0000","last_change":"2024-09-17T05:53:13.511622+0000","last_active":"2024-09-17T05:53:13.511622+0000","last_peered":"2024-09-17T05:53:13.511622+0000","last_clean":"2024-09-17T05:53:13.511622+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:53:13.511622+0000","last_undegraded":"2024-09-17T05:53:13.511622+0000","last_fullsized":"2024-09-17T05:53:13.511622+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:53:13.511622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:53:13.511622+0000","last_clean_scrub_stamp":"2024-09-17T05:53:13.511622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.12","version":"0'0","reported_seq":1,"reported_epoch":138,"state":"creating+peering","last_fresh":"2024-09-17T05:53:12.516394+0000","last_change":"2024-09-17T05:53:12.516394+0000","last_active":"2024-09-17T05:53:12.509392+0000","last_peered":"2024-09-17T05:53:12.509392+0000","last_clean":"2024-09-17T05:53:12.509392+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:53:12.516394+0000","last_undegraded":"2024-09-17T05:53:12.516394+0000","last_fullsized":"2024-09-17T05:53:12.516394+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:53:12.509392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:53:12.509392+0000","last_clean_scrub_stamp":"2024-09-17T05:53:12.509392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.10","version":"0'0","reported_seq":13,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-17T05:53:16.572253+0000","last_change":"2024-09-17T05:53:14.549168+0000","last_active":"2024-09-17T05:53:16.572253+0000","last_peered":"2024-09-17T05:53:16.572253+0000","last_clean":"2024-09-17T05:53:16.572253+0000","last_became_active":"2024-09-17T05:53:14.548829+0000","last_became_peered":"2024-09-17T05:53:14.548829+0000","last_unstale":"2024-09-17T05:53:16.572253+0000","last_undegraded":"2024-09-17T05:53:16.572253+0000","last_fullsized":"2024-09-17T05:53:16.572253+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:53:13.511622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:53:13.511622+0000","last_clean_scrub_stamp":"2024-09-17T05:53:13.511622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:48:29.849949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.11","version":"0'0","reported_seq":1,"reported_epoch":138,"state":"creating+peering","last_fresh":"2024-09-17T05:53:12.516984+0000","last_change":"2024-09-17T05:53:12.516984+0000","last_active":"2024-09-17T05:53:12.509392+0000","last_peered":"2024-09-17T05:53:12.509392+0000","last_clean":"2024-09-17T05:53:12.509392+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:53:12.516984+0000","last_undegraded":"2024-09-17T05:53:12.516984+0000","last_fullsized":"2024-09-17T05:53:12.516984+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:53:12.509392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:53:12.509392+0000","last_clean_scrub_stamp":"2024-09-17T05:53:12.509392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:53:13.511622+0000","last_change":"2024-09-17T05:53:13.511622+0000","last_active":"2024-09-17T05:53:13.511622+0000","last_peered":"2024-09-17T05:53:13.511622+0000","last_clean":"2024-09-17T05:53:13.511622+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:53:13.511622+0000","last_undegraded":"2024-09-17T05:53:13.511622+0000","last_fullsized":"2024-09-17T05:53:13.511622+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:53:13.511622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:53:13.511622+0000","last_clean_scrub_stamp":"2024-09-17T05:53:13.511622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.10","version":"0'0","reported_seq":1,"reported_epoch":138,"state":"creating+peering","last_fresh":"2024-09-17T05:53:12.514187+0000","last_change":"2024-09-17T05:53:12.514187+0000","last_active":"2024-09-17T05:53:12.509392+0000","last_peered":"2024-09-17T05:53:12.509392+0000","last_clean":"2024-09-17T05:53:12.509392+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:53:12.514187+0000","last_undegraded":"2024-09-17T05:53:12.514187+0000","last_fullsized":"2024-09-17T05:53:12.514187+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:53:12.509392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:53:12.509392+0000","last_clean_scrub_stamp":"2024-09-17T05:53:12.509392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.e","version":"0'0","reported_seq":13,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-17T05:53:15.528010+0000","last_change":"2024-09-17T05:53:14.548943+0000","last_active":"2024-09-17T05:53:15.528010+0000","last_peered":"2024-09-17T05:53:15.528010+0000","last_clean":"2024-09-17T05:53:15.528010+0000","last_became_active":"2024-09-17T05:53:14.547493+0000","last_became_peered":"2024-09-17T05:53:14.547493+0000","last_unstale":"2024-09-17T05:53:15.528010+0000","last_undegraded":"2024-09-17T05:53:15.528010+0000","last_fullsized":"2024-09-17T05:53:15.528010+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:53:13.511622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:53:13.511622+0000","last_clean_scrub_stamp":"2024-09-17T05:53:13.511622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:11:54.994505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.f","version":"140'1","reported_seq":16,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-17T05:53:16.572123+0000","last_change":"2024-09-17T05:53:13.538801+0000","last_active":"2024-09-17T05:53:16.572123+0000","last_peered":"2024-09-17T05:53:16.572123+0000","last_clean":"2024-09-17T05:53:16.572123+0000","last_became_active":"2024-09-17T05:53:13.538469+0000","last_became_peered":"2024-09-17T05:53:13.538469+0000","last_unstale":"2024-09-17T05:53:16.572123+0000","last_undegraded":"2024-09-17T05:53:16.572123+0000","last_fullsized":"2024-09-17T05:53:16.572123+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:53:12.509392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:53:12.509392+0000","last_clean_scrub_stamp":"2024-09-17T05:53:12.509392+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:33:19.361630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:53:13.511622+0000","last_change":"2024-09-17T05:53:13.511622+0000","last_active":"2024-09-17T05:53:13.511622+0000","last_peered":"2024-09-17T05:53:13.511622+0000","last_clean":"2024-09-17T05:53:13.511622+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:53:13.511622+0000","last_undegraded":"2024-09-17T05:53:13.511622+0000","last_fullsized":"2024-09-17T05:53:13.511622+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:53:13.511622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:53:13.511622+0000","last_clean_scrub_stamp":"2024-09-17T05:53:13.511622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.e","version":"0'0","reported_seq":1,"reported_epoch":138,"state":"creating+peering","last_fresh":"2024-09-17T05:53:12.518809+0000","last_change":"2024-09-17T05:53:12.518809+0000","last_active":"2024-09-17T05:53:12.509392+0000","last_peered":"2024-09-17T05:53:12.509392+0000","last_clean":"2024-09-17T05:53:12.509392+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:53:12.518809+0000","last_undegraded":"2024-09-17T05:53:12.518809+0000","last_fullsized":"2024-09-17T05:53:12.518809+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:53:12.509392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:53:12.509392+0000","last_clean_scrub_stamp":"2024-09-17T05:53:12.509392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:53:13.511622+0000","last_change":"2024-09-17T05:53:13.511622+0000","last_active":"2024-09-17T05:53:13.511622+0000","last_peered":"2024-09-17T05:53:13.511622+0000","last_clean":"2024-09-17T05:53:13.511622+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:53:13.511622+0000","last_undegraded":"2024-09-17T05:53:13.511622+0000","last_fullsized":"2024-09-17T05:53:13.511622+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:53:13.511622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:53:13.511622+0000","last_clean_scrub_stamp":"2024-09-17T05:53:13.511622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.d","version":"0'0","reported_seq":1,"reported_epoch":138,"state":"creating+peering","last_fresh":"2024-09-17T05:53:12.514221+0000","last_change":"2024-09-17T05:53:12.514221+0000","last_active":"2024-09-17T05:53:12.509392+0000","last_peered":"2024-09-17T05:53:12.509392+0000","last_clean":"2024-09-17T05:53:12.509392+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:53:12.514221+0000","last_undegraded":"2024-09-17T05:53:12.514221+0000","last_fullsized":"2024-09-17T05:53:12.514221+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:53:12.509392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:53:12.509392+0000","last_clean_scrub_stamp":"2024-09-17T05:53:12.509392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:53:13.511622+0000","last_change":"2024-09-17T05:53:13.511622+0000","last_active":"2024-09-17T05:53:13.511622+0000","last_peered":"2024-09-17T05:53:13.511622+0000","last_clean":"2024-09-17T05:53:13.511622+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:53:13.511622+0000","last_undegraded":"2024-09-17T05:53:13.511622+0000","last_fullsized":"2024-09-17T05:53:13.511622+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:53:13.511622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:53:13.511622+0000","last_clean_scrub_stamp":"2024-09-17T05:53:13.511622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.c","version":"0'0","reported_seq":1,"reported_epoch":138,"state":"creating+peering","last_fresh":"2024-09-17T05:53:12.518716+0000","last_change":"2024-09-17T05:53:12.518716+0000","last_active":"2024-09-17T05:53:12.509392+0000","last_peered":"2024-09-17T05:53:12.509392+0000","last_clean":"2024-09-17T05:53:12.509392+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:53:12.518716+0000","last_undegraded":"2024-09-17T05:53:12.518716+0000","last_fullsized":"2024-09-17T05:53:12.518716+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:53:12.509392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:53:12.509392+0000","last_clean_scrub_stamp":"2024-09-17T05:53:12.509392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:53:13.511622+0000","last_change":"2024-09-17T05:53:13.511622+0000","last_active":"2024-09-17T05:53:13.511622+0000","last_peered":"2024-09-17T05:53:13.511622+0000","last_clean":"2024-09-17T05:53:13.511622+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:53:13.511622+0000","last_undegraded":"2024-09-17T05:53:13.511622+0000","last_fullsized":"2024-09-17T05:53:13.511622+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:53:13.511622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:53:13.511622+0000","last_clean_scrub_stamp":"2024-09-17T05:53:13.511622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.b","version":"0'0","reported_seq":10,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-09-17T05:53:13.538312+0000","last_change":"2024-09-17T05:53:13.536538+0000","last_active":"2024-09-17T05:53:13.538312+0000","last_peered":"2024-09-17T05:53:13.538312+0000","last_clean":"2024-09-17T05:53:13.538312+0000","last_became_active":"2024-09-17T05:53:13.536195+0000","last_became_peered":"2024-09-17T05:53:13.536195+0000","last_unstale":"2024-09-17T05:53:13.538312+0000","last_undegraded":"2024-09-17T05:53:13.538312+0000","last_fullsized":"2024-09-17T05:53:13.538312+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:53:12.509392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:53:12.509392+0000","last_clean_scrub_stamp":"2024-09-17T05:53:12.509392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:49:58.949468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.b","version":"0'0","reported_seq":1,"reported_epoch":139,"state":"creating+peering","last_fresh":"2024-09-17T05:53:13.528919+0000","last_change":"2024-09-17T05:53:13.528919+0000","last_active":"2024-09-17T05:53:13.511622+0000","last_peered":"2024-09-17T05:53:13.511622+0000","last_clean":"2024-09-17T05:53:13.511622+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:53:13.528919+0000","last_undegraded":"2024-09-17T05:53:13.528919+0000","last_fullsized":"2024-09-17T05:53:13.528919+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:53:13.511622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:53:13.511622+0000","last_clean_scrub_stamp":"2024-09-17T05:53:13.511622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.a","version":"0'0","reported_seq":15,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-17T05:53:15.527504+0000","last_change":"2024-09-17T05:53:13.539072+0000","last_active":"2024-09-17T05:53:15.527504+0000","last_peered":"2024-09-17T05:53:15.527504+0000","last_clean":"2024-09-17T05:53:15.527504+0000","last_became_active":"2024-09-17T05:53:13.538503+0000","last_became_peered":"2024-09-17T05:53:13.538503+0000","last_unstale":"2024-09-17T05:53:15.527504+0000","last_undegraded":"2024-09-17T05:53:15.527504+0000","last_fullsized":"2024-09-17T05:53:15.527504+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:53:12.509392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:53:12.509392+0000","last_clean_scrub_stamp":"2024-09-17T05:53:12.509392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:17:17.870202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:53:13.511622+0000","last_change":"2024-09-17T05:53:13.511622+0000","last_active":"2024-09-17T05:53:13.511622+0000","last_peered":"2024-09-17T05:53:13.511622+0000","last_clean":"2024-09-17T05:53:13.511622+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:53:13.511622+0000","last_undegraded":"2024-09-17T05:53:13.511622+0000","last_fullsized":"2024-09-17T05:53:13.511622+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:53:13.511622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:53:13.511622+0000","last_clean_scrub_stamp":"2024-09-17T05:53:13.511622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.9","version":"0'0","reported_seq":15,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-17T05:53:15.528312+0000","last_change":"2024-09-17T05:53:13.539530+0000","last_active":"2024-09-17T05:53:15.528312+0000","last_peered":"2024-09-17T05:53:15.528312+0000","last_clean":"2024-09-17T05:53:15.528312+0000","last_became_active":"2024-09-17T05:53:13.539215+0000","last_became_peered":"2024-09-17T05:53:13.539215+0000","last_unstale":"2024-09-17T05:53:15.528312+0000","last_undegraded":"2024-09-17T05:53:15.528312+0000","last_fullsized":"2024-09-17T05:53:15.528312+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:53:12.509392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:53:12.509392+0000","last_clean_scrub_stamp":"2024-09-17T05:53:12.509392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:51:24.706974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.9","version":"0'0","reported_seq":1,"reported_epoch":139,"state":"creating+peering","last_fresh":"2024-09-17T05:53:13.528602+0000","last_change":"2024-09-17T05:53:13.528602+0000","last_active":"2024-09-17T05:53:13.511622+0000","last_peered":"2024-09-17T05:53:13.511622+0000","last_clean":"2024-09-17T05:53:13.511622+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:53:13.528602+0000","last_undegraded":"2024-09-17T05:53:13.528602+0000","last_fullsized":"2024-09-17T05:53:13.528602+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:53:13.511622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:53:13.511622+0000","last_clean_scrub_stamp":"2024-09-17T05:53:13.511622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.8","version":"0'0","reported_seq":1,"reported_epoch":138,"state":"creating+peering","last_fresh":"2024-09-17T05:53:12.516694+0000","last_change":"2024-09-17T05:53:12.516694+0000","last_active":"2024-09-17T05:53:12.509392+0000","last_peered":"2024-09-17T05:53:12.509392+0000","last_clean":"2024-09-17T05:53:12.509392+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:53:12.516694+0000","last_undegraded":"2024-09-17T05:53:12.516694+0000","last_fullsized":"2024-09-17T05:53:12.516694+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:53:12.509392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:53:12.509392+0000","last_clean_scrub_stamp":"2024-09-17T05:53:12.509392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.6","version":"0'0","reported_seq":13,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-17T05:53:16.572412+0000","last_change":"2024-09-17T05:53:14.549803+0000","last_active":"2024-09-17T05:53:16.572412+0000","last_peered":"2024-09-17T05:53:16.572412+0000","last_clean":"2024-09-17T05:53:16.572412+0000","last_became_active":"2024-09-17T05:53:14.549429+0000","last_became_peered":"2024-09-17T05:53:14.549429+0000","last_unstale":"2024-09-17T05:53:16.572412+0000","last_undegraded":"2024-09-17T05:53:16.572412+0000","last_fullsized":"2024-09-17T05:53:16.572412+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:53:13.511622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:53:13.511622+0000","last_clean_scrub_stamp":"2024-09-17T05:53:13.511622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:11:59.457461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.7","version":"140'2","reported_seq":17,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-17T05:53:15.529063+0000","last_change":"2024-09-17T05:53:13.541601+0000","last_active":"2024-09-17T05:53:15.529063+0000","last_peered":"2024-09-17T05:53:15.529063+0000","last_clean":"2024-09-17T05:53:15.529063+0000","last_became_active":"2024-09-17T05:53:13.541201+0000","last_became_peered":"2024-09-17T05:53:13.541201+0000","last_unstale":"2024-09-17T05:53:15.529063+0000","last_undegraded":"2024-09-17T05:53:15.529063+0000","last_fullsized":"2024-09-17T05:53:15.529063+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:53:12.509392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:53:12.509392+0000","last_clean_scrub_stamp":"2024-09-17T05:53:12.509392+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:58:54.719539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:53:13.511622+0000","last_change":"2024-09-17T05:53:13.511622+0000","last_active":"2024-09-17T05:53:13.511622+0000","last_peered":"2024-09-17T05:53:13.511622+0000","last_clean":"2024-09-17T05:53:13.511622+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:53:13.511622+0000","last_undegraded":"2024-09-17T05:53:13.511622+0000","last_fullsized":"2024-09-17T05:53:13.511622+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:53:13.511622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:53:13.511622+0000","last_clean_scrub_stamp":"2024-09-17T05:53:13.511622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.6","version":"0'0","reported_seq":1,"reported_epoch":138,"state":"creating+peering","last_fresh":"2024-09-17T05:53:12.517509+0000","last_change":"2024-09-17T05:53:12.517509+0000","last_active":"2024-09-17T05:53:12.509392+0000","last_peered":"2024-09-17T05:53:12.509392+0000","last_clean":"2024-09-17T05:53:12.509392+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:53:12.517509+0000","last_undegraded":"2024-09-17T05:53:12.517509+0000","last_fullsized":"2024-09-17T05:53:12.517509+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:53:12.509392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:53:12.509392+0000","last_clean_scrub_stamp":"2024-09-17T05:53:12.509392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:53:13.511622+0000","last_change":"2024-09-17T05:53:13.511622+0000","last_active":"2024-09-17T05:53:13.511622+0000","last_peered":"2024-09-17T05:53:13.511622+0000","last_clean":"2024-09-17T05:53:13.511622+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:53:13.511622+0000","last_undegraded":"2024-09-17T05:53:13.511622+0000","last_fullsized":"2024-09-17T05:53:13.511622+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:53:13.511622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:53:13.511622+0000","last_clean_scrub_stamp":"2024-09-17T05:53:13.511622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.5","version":"0'0","reported_seq":1,"reported_epoch":138,"state":"creating+peering","last_fresh":"2024-09-17T05:53:12.516944+0000","last_change":"2024-09-17T05:53:12.516944+0000","last_active":"2024-09-17T05:53:12.509392+0000","last_peered":"2024-09-17T05:53:12.509392+0000","last_clean":"2024-09-17T05:53:12.509392+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:53:12.516944+0000","last_undegraded":"2024-09-17T05:53:12.516944+0000","last_fullsized":"2024-09-17T05:53:12.516944+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:53:12.509392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:53:12.509392+0000","last_clean_scrub_stamp":"2024-09-17T05:53:12.509392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:53:13.511622+0000","last_change":"2024-09-17T05:53:13.511622+0000","last_active":"2024-09-17T05:53:13.511622+0000","last_peered":"2024-09-17T05:53:13.511622+0000","last_clean":"2024-09-17T05:53:13.511622+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:53:13.511622+0000","last_undegraded":"2024-09-17T05:53:13.511622+0000","last_fullsized":"2024-09-17T05:53:13.511622+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:53:13.511622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:53:13.511622+0000","last_clean_scrub_stamp":"2024-09-17T05:53:13.511622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.4","version":"0'0","reported_seq":1,"reported_epoch":138,"state":"creating+peering","last_fresh":"2024-09-17T05:53:12.516971+0000","last_change":"2024-09-17T05:53:12.516971+0000","last_active":"2024-09-17T05:53:12.509392+0000","last_peered":"2024-09-17T05:53:12.509392+0000","last_clean":"2024-09-17T05:53:12.509392+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:53:12.516971+0000","last_undegraded":"2024-09-17T05:53:12.516971+0000","last_fullsized":"2024-09-17T05:53:12.516971+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:53:12.509392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:53:12.509392+0000","last_clean_scrub_stamp":"2024-09-17T05:53:12.509392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:53:13.511622+0000","last_change":"2024-09-17T05:53:13.511622+0000","last_active":"2024-09-17T05:53:13.511622+0000","last_peered":"2024-09-17T05:53:13.511622+0000","last_clean":"2024-09-17T05:53:13.511622+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:53:13.511622+0000","last_undegraded":"2024-09-17T05:53:13.511622+0000","last_fullsized":"2024-09-17T05:53:13.511622+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:53:13.511622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:53:13.511622+0000","last_clean_scrub_stamp":"2024-09-17T05:53:13.511622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.3","version":"0'0","reported_seq":10,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-09-17T05:53:13.535257+0000","last_change":"2024-09-17T05:53:13.534284+0000","last_active":"2024-09-17T05:53:13.535257+0000","last_peered":"2024-09-17T05:53:13.535257+0000","last_clean":"2024-09-17T05:53:13.535257+0000","last_became_active":"2024-09-17T05:53:13.533933+0000","last_became_peered":"2024-09-17T05:53:13.533933+0000","last_unstale":"2024-09-17T05:53:13.535257+0000","last_undegraded":"2024-09-17T05:53:13.535257+0000","last_fullsized":"2024-09-17T05:53:13.535257+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:53:12.509392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:53:12.509392+0000","last_clean_scrub_stamp":"2024-09-17T05:53:12.509392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:26:31.492927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.3","version":"0'0","reported_seq":13,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-17T05:53:16.572509+0000","last_change":"2024-09-17T05:53:14.538521+0000","last_active":"2024-09-17T05:53:16.572509+0000","last_peered":"2024-09-17T05:53:16.572509+0000","last_clean":"2024-09-17T05:53:16.572509+0000","last_became_active":"2024-09-17T05:53:14.538059+0000","last_became_peered":"2024-09-17T05:53:14.538059+0000","last_unstale":"2024-09-17T05:53:16.572509+0000","last_undegraded":"2024-09-17T05:53:16.572509+0000","last_fullsized":"2024-09-17T05:53:16.572509+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:53:13.511622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:53:13.511622+0000","last_clean_scrub_stamp":"2024-09-17T05:53:13.511622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:06:01.140596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.2","version":"0'0","reported_seq":15,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-17T05:53:15.527619+0000","last_change":"2024-09-17T05:53:13.541556+0000","last_active":"2024-09-17T05:53:15.527619+0000","last_peered":"2024-09-17T05:53:15.527619+0000","last_clean":"2024-09-17T05:53:15.527619+0000","last_became_active":"2024-09-17T05:53:13.540985+0000","last_became_peered":"2024-09-17T05:53:13.540985+0000","last_unstale":"2024-09-17T05:53:15.527619+0000","last_undegraded":"2024-09-17T05:53:15.527619+0000","last_fullsized":"2024-09-17T05:53:15.527619+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:53:12.509392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:53:12.509392+0000","last_clean_scrub_stamp":"2024-09-17T05:53:12.509392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:59:32.172184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.0","version":"0'0","reported_seq":13,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-17T05:53:15.527867+0000","last_change":"2024-09-17T05:53:14.553791+0000","last_active":"2024-09-17T05:53:15.527867+0000","last_peered":"2024-09-17T05:53:15.527867+0000","last_clean":"2024-09-17T05:53:15.527867+0000","last_became_active":"2024-09-17T05:53:14.552645+0000","last_became_peered":"2024-09-17T05:53:14.552645+0000","last_unstale":"2024-09-17T05:53:15.527867+0000","last_undegraded":"2024-09-17T05:53:15.527867+0000","last_fullsized":"2024-09-17T05:53:15.527867+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:53:13.511622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:53:13.511622+0000","last_clean_scrub_stamp":"2024-09-17T05:53:13.511622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:17:37.335559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.1","version":"0'0","reported_seq":1,"reported_epoch":138,"state":"creating+peering","last_fresh":"2024-09-17T05:53:12.517785+0000","last_change":"2024-09-17T05:53:12.517785+0000","last_active":"2024-09-17T05:53:12.509392+0000","last_peered":"2024-09-17T05:53:12.509392+0000","last_clean":"2024-09-17T05:53:12.509392+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:53:12.517785+0000","last_undegraded":"2024-09-17T05:53:12.517785+0000","last_fullsized":"2024-09-17T05:53:12.517785+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:53:12.509392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:53:12.509392+0000","last_clean_scrub_stamp":"2024-09-17T05:53:12.509392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.1","version":"0'0","reported_seq":13,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-17T05:53:16.572259+0000","last_change":"2024-09-17T05:53:14.536337+0000","last_active":"2024-09-17T05:53:16.572259+0000","last_peered":"2024-09-17T05:53:16.572259+0000","last_clean":"2024-09-17T05:53:16.572259+0000","last_became_active":"2024-09-17T05:53:14.535962+0000","last_became_peered":"2024-09-17T05:53:14.535962+0000","last_unstale":"2024-09-17T05:53:16.572259+0000","last_undegraded":"2024-09-17T05:53:16.572259+0000","last_fullsized":"2024-09-17T05:53:16.572259+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:53:13.511622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:53:13.511622+0000","last_clean_scrub_stamp":"2024-09-17T05:53:13.511622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:12:43.179255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.0","version":"0'0","reported_seq":1,"reported_epoch":138,"state":"creating+peering","last_fresh":"2024-09-17T05:53:12.519815+0000","last_change":"2024-09-17T05:53:12.519815+0000","last_active":"2024-09-17T05:53:12.509392+0000","last_peered":"2024-09-17T05:53:12.509392+0000","last_clean":"2024-09-17T05:53:12.509392+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:53:12.519815+0000","last_undegraded":"2024-09-17T05:53:12.519815+0000","last_fullsized":"2024-09-17T05:53:12.519815+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:53:12.509392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:53:12.509392+0000","last_clean_scrub_stamp":"2024-09-17T05:53:12.509392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.14","version":"0'0","reported_seq":1,"reported_epoch":139,"state":"creating+peering","last_fresh":"2024-09-17T05:53:13.527612+0000","last_change":"2024-09-17T05:53:13.527612+0000","last_active":"2024-09-17T05:53:13.511622+0000","last_peered":"2024-09-17T05:53:13.511622+0000","last_clean":"2024-09-17T05:53:13.511622+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:53:13.527612+0000","last_undegraded":"2024-09-17T05:53:13.527612+0000","last_fullsized":"2024-09-17T05:53:13.527612+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:53:13.511622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:53:13.511622+0000","last_clean_scrub_stamp":"2024-09-17T05:53:13.511622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.15","version":"0'0","reported_seq":1,"reported_epoch":138,"state":"creating+peering","last_fresh":"2024-09-17T05:53:12.517048+0000","last_change":"2024-09-17T05:53:12.517048+0000","last_active":"2024-09-17T05:53:12.509392+0000","last_peered":"2024-09-17T05:53:12.509392+0000","last_clean":"2024-09-17T05:53:12.509392+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:53:12.517048+0000","last_undegraded":"2024-09-17T05:53:12.517048+0000","last_fullsized":"2024-09-17T05:53:12.517048+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:53:12.509392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:53:12.509392+0000","last_clean_scrub_stamp":"2024-09-17T05:53:12.509392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"19'72","reported_seq":328,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-17T05:53:15.528005+0000","last_change":"2024-09-17T05:41:48.539830+0000","last_active":"2024-09-17T05:53:15.528005+0000","last_peered":"2024-09-17T05:53:15.528005+0000","last_clean":"2024-09-17T05:53:15.528005+0000","last_became_active":"2024-09-17T05:41:48.538743+0000","last_became_peered":"2024-09-17T05:41:48.538743+0000","last_unstale":"2024-09-17T05:53:15.528005+0000","last_undegraded":"2024-09-17T05:53:15.528005+0000","last_fullsized":"2024-09-17T05:53:15.528005+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:47.152539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:47.152539+0000","last_clean_scrub_stamp":"2024-09-17T05:41:47.152539+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:08:02.952016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":21,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":48,"acting":48,"num_store_stats":3},{"poolid":20,"num_pg":32,"stat_sum":{"num_bytes":604,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":674,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":8,"ondisk_log_size":8,"up":58,"acting":58,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":16,"seq":68719476878,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":145256,"kb_used_data":1680,"kb_used_omap":1,"kb_used_meta":143550,"kb_avail":94226584,"statfs":{"total":96636764160,"available":96488022016,"internally_reserved":0,"allocated":1720320,"data_stored":757502,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":146995654},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":15,"seq":64424509583,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":119512,"kb_used_data":2304,"kb_used_omap":1,"kb_used_meta":117182,"kb_avail":94252328,"statfs":{"total":96636764160,"available":96514383872,"internally_reserved":0,"allocated":2359296,"data_stored":1368460,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":119994826},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509582,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":131396,"kb_used_data":1708,"kb_used_omap":1,"kb_used_meta":129662,"kb_avail":94240444,"statfs":{"total":96636764160,"available":96502214656,"internally_reserved":0,"allocated":1748992,"data_stored":770966,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":132774341},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509581,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":141092,"kb_used_data":1668,"kb_used_omap":1,"kb_used_meta":139390,"kb_avail":94230748,"statfs":{"total":96636764160,"available":96492285952,"internally_reserved":0,"allocated":1708032,"data_stored":751489,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":142735813},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509581,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":123044,"kb_used_data":1680,"kb_used_omap":1,"kb_used_meta":121342,"kb_avail":94248796,"statfs":{"total":96636764160,"available":96510767104,"internally_reserved":0,"allocated":1720320,"data_stored":757502,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":124254663},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509581,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":141092,"kb_used_data":1680,"kb_used_omap":1,"kb_used_meta":139390,"kb_avail":94230748,"statfs":{"total":96636764160,"available":96492285952,"internally_reserved":0,"allocated":1720320,"data_stored":757502,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":142735813},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509581,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":145252,"kb_used_data":1680,"kb_used_omap":1,"kb_used_meta":143550,"kb_avail":94226588,"statfs":{"total":96636764160,"available":96488026112,"internally_reserved":0,"allocated":1720320,"data_stored":757502,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":146995653},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574989,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":123628,"kb_used_data":2260,"kb_used_omap":1,"kb_used_meta":121342,"kb_avail":94248212,"statfs":{"total":96636764160,"available":96510169088,"internally_reserved":0,"allocated":2314240,"data_stored":1347870,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":124254661},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-17T05:53:18.278 INFO:tasks.ceph.ceph_manager.ceph:PG 21.3f is not active+clean 2024-09-17T05:53:18.278 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '21.3f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T05:53:13.511622+0000', 'last_change': '2024-09-17T05:53:13.511622+0000', 'last_active': '2024-09-17T05:53:13.511622+0000', 'last_peered': '2024-09-17T05:53:13.511622+0000', 'last_clean': '2024-09-17T05:53:13.511622+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:53:13.511622+0000', 'last_undegraded': '2024-09-17T05:53:13.511622+0000', 'last_fullsized': '2024-09-17T05:53:13.511622+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:53:13.511622+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:53:13.511622+0000', 'last_clean_scrub_stamp': '2024-09-17T05:53:13.511622+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T05:53:18.278 INFO:tasks.ceph.ceph_manager.ceph:PG 21.3e is not active+clean 2024-09-17T05:53:18.278 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '21.3e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T05:53:13.511622+0000', 'last_change': '2024-09-17T05:53:13.511622+0000', 'last_active': '2024-09-17T05:53:13.511622+0000', 'last_peered': '2024-09-17T05:53:13.511622+0000', 'last_clean': '2024-09-17T05:53:13.511622+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:53:13.511622+0000', 'last_undegraded': '2024-09-17T05:53:13.511622+0000', 'last_fullsized': '2024-09-17T05:53:13.511622+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:53:13.511622+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:53:13.511622+0000', 'last_clean_scrub_stamp': '2024-09-17T05:53:13.511622+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T05:53:18.279 INFO:tasks.ceph.ceph_manager.ceph:PG 21.3d is not active+clean 2024-09-17T05:53:18.279 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '21.3d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T05:53:13.511622+0000', 'last_change': '2024-09-17T05:53:13.511622+0000', 'last_active': '2024-09-17T05:53:13.511622+0000', 'last_peered': '2024-09-17T05:53:13.511622+0000', 'last_clean': '2024-09-17T05:53:13.511622+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:53:13.511622+0000', 'last_undegraded': '2024-09-17T05:53:13.511622+0000', 'last_fullsized': '2024-09-17T05:53:13.511622+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:53:13.511622+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:53:13.511622+0000', 'last_clean_scrub_stamp': '2024-09-17T05:53:13.511622+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T05:53:18.279 INFO:tasks.ceph.ceph_manager.ceph:PG 21.3c is not active+clean 2024-09-17T05:53:18.279 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '21.3c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T05:53:13.511622+0000', 'last_change': '2024-09-17T05:53:13.511622+0000', 'last_active': '2024-09-17T05:53:13.511622+0000', 'last_peered': '2024-09-17T05:53:13.511622+0000', 'last_clean': '2024-09-17T05:53:13.511622+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:53:13.511622+0000', 'last_undegraded': '2024-09-17T05:53:13.511622+0000', 'last_fullsized': '2024-09-17T05:53:13.511622+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:53:13.511622+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:53:13.511622+0000', 'last_clean_scrub_stamp': '2024-09-17T05:53:13.511622+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T05:53:18.279 INFO:tasks.ceph.ceph_manager.ceph:PG 21.3a is not active+clean 2024-09-17T05:53:18.279 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '21.3a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T05:53:13.511622+0000', 'last_change': '2024-09-17T05:53:13.511622+0000', 'last_active': '2024-09-17T05:53:13.511622+0000', 'last_peered': '2024-09-17T05:53:13.511622+0000', 'last_clean': '2024-09-17T05:53:13.511622+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:53:13.511622+0000', 'last_undegraded': '2024-09-17T05:53:13.511622+0000', 'last_fullsized': '2024-09-17T05:53:13.511622+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:53:13.511622+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:53:13.511622+0000', 'last_clean_scrub_stamp': '2024-09-17T05:53:13.511622+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T05:53:18.279 INFO:tasks.ceph.ceph_manager.ceph:PG 21.39 is not active+clean 2024-09-17T05:53:18.279 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '21.39', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 139, 'state': 'creating+peering', 'last_fresh': '2024-09-17T05:53:13.527403+0000', 'last_change': '2024-09-17T05:53:13.527403+0000', 'last_active': '2024-09-17T05:53:13.511622+0000', 'last_peered': '2024-09-17T05:53:13.511622+0000', 'last_clean': '2024-09-17T05:53:13.511622+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:53:13.527403+0000', 'last_undegraded': '2024-09-17T05:53:13.527403+0000', 'last_fullsized': '2024-09-17T05:53:13.527403+0000', 'mapping_epoch': 139, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 139, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:53:13.511622+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:53:13.511622+0000', 'last_clean_scrub_stamp': '2024-09-17T05:53:13.511622+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 4], 'acting': [0, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-17T05:53:18.279 INFO:tasks.ceph.ceph_manager.ceph:PG 21.38 is not active+clean 2024-09-17T05:53:18.279 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '21.38', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T05:53:13.511622+0000', 'last_change': '2024-09-17T05:53:13.511622+0000', 'last_active': '2024-09-17T05:53:13.511622+0000', 'last_peered': '2024-09-17T05:53:13.511622+0000', 'last_clean': '2024-09-17T05:53:13.511622+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:53:13.511622+0000', 'last_undegraded': '2024-09-17T05:53:13.511622+0000', 'last_fullsized': '2024-09-17T05:53:13.511622+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:53:13.511622+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:53:13.511622+0000', 'last_clean_scrub_stamp': '2024-09-17T05:53:13.511622+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T05:53:18.279 INFO:tasks.ceph.ceph_manager.ceph:PG 21.37 is not active+clean 2024-09-17T05:53:18.280 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '21.37', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T05:53:13.511622+0000', 'last_change': '2024-09-17T05:53:13.511622+0000', 'last_active': '2024-09-17T05:53:13.511622+0000', 'last_peered': '2024-09-17T05:53:13.511622+0000', 'last_clean': '2024-09-17T05:53:13.511622+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:53:13.511622+0000', 'last_undegraded': '2024-09-17T05:53:13.511622+0000', 'last_fullsized': '2024-09-17T05:53:13.511622+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:53:13.511622+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:53:13.511622+0000', 'last_clean_scrub_stamp': '2024-09-17T05:53:13.511622+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T05:53:18.280 INFO:tasks.ceph.ceph_manager.ceph:PG 21.35 is not active+clean 2024-09-17T05:53:18.280 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '21.35', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T05:53:13.511622+0000', 'last_change': '2024-09-17T05:53:13.511622+0000', 'last_active': '2024-09-17T05:53:13.511622+0000', 'last_peered': '2024-09-17T05:53:13.511622+0000', 'last_clean': '2024-09-17T05:53:13.511622+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:53:13.511622+0000', 'last_undegraded': '2024-09-17T05:53:13.511622+0000', 'last_fullsized': '2024-09-17T05:53:13.511622+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:53:13.511622+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:53:13.511622+0000', 'last_clean_scrub_stamp': '2024-09-17T05:53:13.511622+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T05:53:18.280 INFO:tasks.ceph.ceph_manager.ceph:PG 21.32 is not active+clean 2024-09-17T05:53:18.280 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '21.32', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T05:53:13.511622+0000', 'last_change': '2024-09-17T05:53:13.511622+0000', 'last_active': '2024-09-17T05:53:13.511622+0000', 'last_peered': '2024-09-17T05:53:13.511622+0000', 'last_clean': '2024-09-17T05:53:13.511622+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:53:13.511622+0000', 'last_undegraded': '2024-09-17T05:53:13.511622+0000', 'last_fullsized': '2024-09-17T05:53:13.511622+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:53:13.511622+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:53:13.511622+0000', 'last_clean_scrub_stamp': '2024-09-17T05:53:13.511622+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T05:53:18.280 INFO:tasks.ceph.ceph_manager.ceph:PG 21.30 is not active+clean 2024-09-17T05:53:18.280 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '21.30', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T05:53:13.511622+0000', 'last_change': '2024-09-17T05:53:13.511622+0000', 'last_active': '2024-09-17T05:53:13.511622+0000', 'last_peered': '2024-09-17T05:53:13.511622+0000', 'last_clean': '2024-09-17T05:53:13.511622+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:53:13.511622+0000', 'last_undegraded': '2024-09-17T05:53:13.511622+0000', 'last_fullsized': '2024-09-17T05:53:13.511622+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:53:13.511622+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:53:13.511622+0000', 'last_clean_scrub_stamp': '2024-09-17T05:53:13.511622+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T05:53:18.280 INFO:tasks.ceph.ceph_manager.ceph:PG 21.2e is not active+clean 2024-09-17T05:53:18.280 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '21.2e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T05:53:13.511622+0000', 'last_change': '2024-09-17T05:53:13.511622+0000', 'last_active': '2024-09-17T05:53:13.511622+0000', 'last_peered': '2024-09-17T05:53:13.511622+0000', 'last_clean': '2024-09-17T05:53:13.511622+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:53:13.511622+0000', 'last_undegraded': '2024-09-17T05:53:13.511622+0000', 'last_fullsized': '2024-09-17T05:53:13.511622+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:53:13.511622+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:53:13.511622+0000', 'last_clean_scrub_stamp': '2024-09-17T05:53:13.511622+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T05:53:18.280 INFO:tasks.ceph.ceph_manager.ceph:PG 21.2d is not active+clean 2024-09-17T05:53:18.280 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '21.2d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T05:53:13.511622+0000', 'last_change': '2024-09-17T05:53:13.511622+0000', 'last_active': '2024-09-17T05:53:13.511622+0000', 'last_peered': '2024-09-17T05:53:13.511622+0000', 'last_clean': '2024-09-17T05:53:13.511622+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:53:13.511622+0000', 'last_undegraded': '2024-09-17T05:53:13.511622+0000', 'last_fullsized': '2024-09-17T05:53:13.511622+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:53:13.511622+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:53:13.511622+0000', 'last_clean_scrub_stamp': '2024-09-17T05:53:13.511622+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T05:53:18.281 INFO:tasks.ceph.ceph_manager.ceph:PG 21.2c is not active+clean 2024-09-17T05:53:18.281 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '21.2c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T05:53:13.511622+0000', 'last_change': '2024-09-17T05:53:13.511622+0000', 'last_active': '2024-09-17T05:53:13.511622+0000', 'last_peered': '2024-09-17T05:53:13.511622+0000', 'last_clean': '2024-09-17T05:53:13.511622+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:53:13.511622+0000', 'last_undegraded': '2024-09-17T05:53:13.511622+0000', 'last_fullsized': '2024-09-17T05:53:13.511622+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:53:13.511622+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:53:13.511622+0000', 'last_clean_scrub_stamp': '2024-09-17T05:53:13.511622+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T05:53:18.281 INFO:tasks.ceph.ceph_manager.ceph:PG 21.2a is not active+clean 2024-09-17T05:53:18.281 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '21.2a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T05:53:13.511622+0000', 'last_change': '2024-09-17T05:53:13.511622+0000', 'last_active': '2024-09-17T05:53:13.511622+0000', 'last_peered': '2024-09-17T05:53:13.511622+0000', 'last_clean': '2024-09-17T05:53:13.511622+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:53:13.511622+0000', 'last_undegraded': '2024-09-17T05:53:13.511622+0000', 'last_fullsized': '2024-09-17T05:53:13.511622+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:53:13.511622+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:53:13.511622+0000', 'last_clean_scrub_stamp': '2024-09-17T05:53:13.511622+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T05:53:18.281 INFO:tasks.ceph.ceph_manager.ceph:PG 21.29 is not active+clean 2024-09-17T05:53:18.281 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '21.29', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T05:53:13.511622+0000', 'last_change': '2024-09-17T05:53:13.511622+0000', 'last_active': '2024-09-17T05:53:13.511622+0000', 'last_peered': '2024-09-17T05:53:13.511622+0000', 'last_clean': '2024-09-17T05:53:13.511622+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:53:13.511622+0000', 'last_undegraded': '2024-09-17T05:53:13.511622+0000', 'last_fullsized': '2024-09-17T05:53:13.511622+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:53:13.511622+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:53:13.511622+0000', 'last_clean_scrub_stamp': '2024-09-17T05:53:13.511622+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T05:53:18.281 INFO:tasks.ceph.ceph_manager.ceph:PG 21.27 is not active+clean 2024-09-17T05:53:18.281 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '21.27', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T05:53:13.511622+0000', 'last_change': '2024-09-17T05:53:13.511622+0000', 'last_active': '2024-09-17T05:53:13.511622+0000', 'last_peered': '2024-09-17T05:53:13.511622+0000', 'last_clean': '2024-09-17T05:53:13.511622+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:53:13.511622+0000', 'last_undegraded': '2024-09-17T05:53:13.511622+0000', 'last_fullsized': '2024-09-17T05:53:13.511622+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:53:13.511622+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:53:13.511622+0000', 'last_clean_scrub_stamp': '2024-09-17T05:53:13.511622+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T05:53:18.281 INFO:tasks.ceph.ceph_manager.ceph:PG 21.26 is not active+clean 2024-09-17T05:53:18.281 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '21.26', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T05:53:13.511622+0000', 'last_change': '2024-09-17T05:53:13.511622+0000', 'last_active': '2024-09-17T05:53:13.511622+0000', 'last_peered': '2024-09-17T05:53:13.511622+0000', 'last_clean': '2024-09-17T05:53:13.511622+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:53:13.511622+0000', 'last_undegraded': '2024-09-17T05:53:13.511622+0000', 'last_fullsized': '2024-09-17T05:53:13.511622+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:53:13.511622+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:53:13.511622+0000', 'last_clean_scrub_stamp': '2024-09-17T05:53:13.511622+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T05:53:18.281 INFO:tasks.ceph.ceph_manager.ceph:PG 21.25 is not active+clean 2024-09-17T05:53:18.282 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '21.25', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T05:53:13.511622+0000', 'last_change': '2024-09-17T05:53:13.511622+0000', 'last_active': '2024-09-17T05:53:13.511622+0000', 'last_peered': '2024-09-17T05:53:13.511622+0000', 'last_clean': '2024-09-17T05:53:13.511622+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:53:13.511622+0000', 'last_undegraded': '2024-09-17T05:53:13.511622+0000', 'last_fullsized': '2024-09-17T05:53:13.511622+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:53:13.511622+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:53:13.511622+0000', 'last_clean_scrub_stamp': '2024-09-17T05:53:13.511622+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T05:53:18.282 INFO:tasks.ceph.ceph_manager.ceph:PG 21.24 is not active+clean 2024-09-17T05:53:18.282 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '21.24', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 139, 'state': 'creating+peering', 'last_fresh': '2024-09-17T05:53:13.528051+0000', 'last_change': '2024-09-17T05:53:13.528051+0000', 'last_active': '2024-09-17T05:53:13.511622+0000', 'last_peered': '2024-09-17T05:53:13.511622+0000', 'last_clean': '2024-09-17T05:53:13.511622+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:53:13.528051+0000', 'last_undegraded': '2024-09-17T05:53:13.528051+0000', 'last_fullsized': '2024-09-17T05:53:13.528051+0000', 'mapping_epoch': 139, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 139, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:53:13.511622+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:53:13.511622+0000', 'last_clean_scrub_stamp': '2024-09-17T05:53:13.511622+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 6], 'acting': [0, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-17T05:53:18.282 INFO:tasks.ceph.ceph_manager.ceph:PG 21.23 is not active+clean 2024-09-17T05:53:18.282 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '21.23', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T05:53:13.511622+0000', 'last_change': '2024-09-17T05:53:13.511622+0000', 'last_active': '2024-09-17T05:53:13.511622+0000', 'last_peered': '2024-09-17T05:53:13.511622+0000', 'last_clean': '2024-09-17T05:53:13.511622+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:53:13.511622+0000', 'last_undegraded': '2024-09-17T05:53:13.511622+0000', 'last_fullsized': '2024-09-17T05:53:13.511622+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:53:13.511622+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:53:13.511622+0000', 'last_clean_scrub_stamp': '2024-09-17T05:53:13.511622+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T05:53:18.282 INFO:tasks.ceph.ceph_manager.ceph:PG 21.22 is not active+clean 2024-09-17T05:53:18.282 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '21.22', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T05:53:13.511622+0000', 'last_change': '2024-09-17T05:53:13.511622+0000', 'last_active': '2024-09-17T05:53:13.511622+0000', 'last_peered': '2024-09-17T05:53:13.511622+0000', 'last_clean': '2024-09-17T05:53:13.511622+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:53:13.511622+0000', 'last_undegraded': '2024-09-17T05:53:13.511622+0000', 'last_fullsized': '2024-09-17T05:53:13.511622+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:53:13.511622+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:53:13.511622+0000', 'last_clean_scrub_stamp': '2024-09-17T05:53:13.511622+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T05:53:18.282 INFO:tasks.ceph.ceph_manager.ceph:PG 21.21 is not active+clean 2024-09-17T05:53:18.282 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '21.21', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T05:53:13.511622+0000', 'last_change': '2024-09-17T05:53:13.511622+0000', 'last_active': '2024-09-17T05:53:13.511622+0000', 'last_peered': '2024-09-17T05:53:13.511622+0000', 'last_clean': '2024-09-17T05:53:13.511622+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:53:13.511622+0000', 'last_undegraded': '2024-09-17T05:53:13.511622+0000', 'last_fullsized': '2024-09-17T05:53:13.511622+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:53:13.511622+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:53:13.511622+0000', 'last_clean_scrub_stamp': '2024-09-17T05:53:13.511622+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T05:53:18.282 INFO:tasks.ceph.ceph_manager.ceph:PG 21.20 is not active+clean 2024-09-17T05:53:18.282 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '21.20', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T05:53:13.511622+0000', 'last_change': '2024-09-17T05:53:13.511622+0000', 'last_active': '2024-09-17T05:53:13.511622+0000', 'last_peered': '2024-09-17T05:53:13.511622+0000', 'last_clean': '2024-09-17T05:53:13.511622+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:53:13.511622+0000', 'last_undegraded': '2024-09-17T05:53:13.511622+0000', 'last_fullsized': '2024-09-17T05:53:13.511622+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:53:13.511622+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:53:13.511622+0000', 'last_clean_scrub_stamp': '2024-09-17T05:53:13.511622+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T05:53:18.283 INFO:tasks.ceph.ceph_manager.ceph:PG 21.1f is not active+clean 2024-09-17T05:53:18.283 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '21.1f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T05:53:13.511622+0000', 'last_change': '2024-09-17T05:53:13.511622+0000', 'last_active': '2024-09-17T05:53:13.511622+0000', 'last_peered': '2024-09-17T05:53:13.511622+0000', 'last_clean': '2024-09-17T05:53:13.511622+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:53:13.511622+0000', 'last_undegraded': '2024-09-17T05:53:13.511622+0000', 'last_fullsized': '2024-09-17T05:53:13.511622+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:53:13.511622+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:53:13.511622+0000', 'last_clean_scrub_stamp': '2024-09-17T05:53:13.511622+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T05:53:18.283 INFO:tasks.ceph.ceph_manager.ceph:PG 20.1e is not active+clean 2024-09-17T05:53:18.283 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '20.1e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 138, 'state': 'creating+peering', 'last_fresh': '2024-09-17T05:53:12.519409+0000', 'last_change': '2024-09-17T05:53:12.519409+0000', 'last_active': '2024-09-17T05:53:12.509392+0000', 'last_peered': '2024-09-17T05:53:12.509392+0000', 'last_clean': '2024-09-17T05:53:12.509392+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:53:12.519409+0000', 'last_undegraded': '2024-09-17T05:53:12.519409+0000', 'last_fullsized': '2024-09-17T05:53:12.519409+0000', 'mapping_epoch': 138, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 138, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:53:12.509392+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:53:12.509392+0000', 'last_clean_scrub_stamp': '2024-09-17T05:53:12.509392+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 7], 'acting': [3, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-17T05:53:18.283 INFO:tasks.ceph.ceph_manager.ceph:PG 21.1c is not active+clean 2024-09-17T05:53:18.283 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '21.1c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T05:53:13.511622+0000', 'last_change': '2024-09-17T05:53:13.511622+0000', 'last_active': '2024-09-17T05:53:13.511622+0000', 'last_peered': '2024-09-17T05:53:13.511622+0000', 'last_clean': '2024-09-17T05:53:13.511622+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:53:13.511622+0000', 'last_undegraded': '2024-09-17T05:53:13.511622+0000', 'last_fullsized': '2024-09-17T05:53:13.511622+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:53:13.511622+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:53:13.511622+0000', 'last_clean_scrub_stamp': '2024-09-17T05:53:13.511622+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T05:53:18.283 INFO:tasks.ceph.ceph_manager.ceph:PG 20.1d is not active+clean 2024-09-17T05:53:18.283 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '20.1d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T05:53:12.509392+0000', 'last_change': '2024-09-17T05:53:12.509392+0000', 'last_active': '2024-09-17T05:53:12.509392+0000', 'last_peered': '2024-09-17T05:53:12.509392+0000', 'last_clean': '2024-09-17T05:53:12.509392+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:53:12.509392+0000', 'last_undegraded': '2024-09-17T05:53:12.509392+0000', 'last_fullsized': '2024-09-17T05:53:12.509392+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:53:12.509392+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:53:12.509392+0000', 'last_clean_scrub_stamp': '2024-09-17T05:53:12.509392+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T05:53:18.283 INFO:tasks.ceph.ceph_manager.ceph:PG 20.1c is not active+clean 2024-09-17T05:53:18.283 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '20.1c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T05:53:12.509392+0000', 'last_change': '2024-09-17T05:53:12.509392+0000', 'last_active': '2024-09-17T05:53:12.509392+0000', 'last_peered': '2024-09-17T05:53:12.509392+0000', 'last_clean': '2024-09-17T05:53:12.509392+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:53:12.509392+0000', 'last_undegraded': '2024-09-17T05:53:12.509392+0000', 'last_fullsized': '2024-09-17T05:53:12.509392+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:53:12.509392+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:53:12.509392+0000', 'last_clean_scrub_stamp': '2024-09-17T05:53:12.509392+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T05:53:18.283 INFO:tasks.ceph.ceph_manager.ceph:PG 21.1a is not active+clean 2024-09-17T05:53:18.284 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '21.1a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T05:53:13.511622+0000', 'last_change': '2024-09-17T05:53:13.511622+0000', 'last_active': '2024-09-17T05:53:13.511622+0000', 'last_peered': '2024-09-17T05:53:13.511622+0000', 'last_clean': '2024-09-17T05:53:13.511622+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:53:13.511622+0000', 'last_undegraded': '2024-09-17T05:53:13.511622+0000', 'last_fullsized': '2024-09-17T05:53:13.511622+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:53:13.511622+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:53:13.511622+0000', 'last_clean_scrub_stamp': '2024-09-17T05:53:13.511622+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T05:53:18.284 INFO:tasks.ceph.ceph_manager.ceph:PG 20.1b is not active+clean 2024-09-17T05:53:18.284 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '20.1b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 138, 'state': 'creating+peering', 'last_fresh': '2024-09-17T05:53:12.514220+0000', 'last_change': '2024-09-17T05:53:12.514220+0000', 'last_active': '2024-09-17T05:53:12.509392+0000', 'last_peered': '2024-09-17T05:53:12.509392+0000', 'last_clean': '2024-09-17T05:53:12.509392+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:53:12.514220+0000', 'last_undegraded': '2024-09-17T05:53:12.514220+0000', 'last_fullsized': '2024-09-17T05:53:12.514220+0000', 'mapping_epoch': 138, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 138, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:53:12.509392+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:53:12.509392+0000', 'last_clean_scrub_stamp': '2024-09-17T05:53:12.509392+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 7], 'acting': [2, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-17T05:53:18.284 INFO:tasks.ceph.ceph_manager.ceph:PG 21.1b is not active+clean 2024-09-17T05:53:18.284 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '21.1b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T05:53:13.511622+0000', 'last_change': '2024-09-17T05:53:13.511622+0000', 'last_active': '2024-09-17T05:53:13.511622+0000', 'last_peered': '2024-09-17T05:53:13.511622+0000', 'last_clean': '2024-09-17T05:53:13.511622+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:53:13.511622+0000', 'last_undegraded': '2024-09-17T05:53:13.511622+0000', 'last_fullsized': '2024-09-17T05:53:13.511622+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:53:13.511622+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:53:13.511622+0000', 'last_clean_scrub_stamp': '2024-09-17T05:53:13.511622+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T05:53:18.284 INFO:tasks.ceph.ceph_manager.ceph:PG 21.18 is not active+clean 2024-09-17T05:53:18.284 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '21.18', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T05:53:13.511622+0000', 'last_change': '2024-09-17T05:53:13.511622+0000', 'last_active': '2024-09-17T05:53:13.511622+0000', 'last_peered': '2024-09-17T05:53:13.511622+0000', 'last_clean': '2024-09-17T05:53:13.511622+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:53:13.511622+0000', 'last_undegraded': '2024-09-17T05:53:13.511622+0000', 'last_fullsized': '2024-09-17T05:53:13.511622+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:53:13.511622+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:53:13.511622+0000', 'last_clean_scrub_stamp': '2024-09-17T05:53:13.511622+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T05:53:18.284 INFO:tasks.ceph.ceph_manager.ceph:PG 20.19 is not active+clean 2024-09-17T05:53:18.284 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '20.19', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 138, 'state': 'creating+peering', 'last_fresh': '2024-09-17T05:53:12.514359+0000', 'last_change': '2024-09-17T05:53:12.514359+0000', 'last_active': '2024-09-17T05:53:12.509392+0000', 'last_peered': '2024-09-17T05:53:12.509392+0000', 'last_clean': '2024-09-17T05:53:12.509392+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:53:12.514359+0000', 'last_undegraded': '2024-09-17T05:53:12.514359+0000', 'last_fullsized': '2024-09-17T05:53:12.514359+0000', 'mapping_epoch': 138, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 138, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:53:12.509392+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:53:12.509392+0000', 'last_clean_scrub_stamp': '2024-09-17T05:53:12.509392+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 5], 'acting': [2, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-17T05:53:18.284 INFO:tasks.ceph.ceph_manager.ceph:PG 20.18 is not active+clean 2024-09-17T05:53:18.284 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '20.18', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T05:53:12.509392+0000', 'last_change': '2024-09-17T05:53:12.509392+0000', 'last_active': '2024-09-17T05:53:12.509392+0000', 'last_peered': '2024-09-17T05:53:12.509392+0000', 'last_clean': '2024-09-17T05:53:12.509392+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:53:12.509392+0000', 'last_undegraded': '2024-09-17T05:53:12.509392+0000', 'last_fullsized': '2024-09-17T05:53:12.509392+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:53:12.509392+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:53:12.509392+0000', 'last_clean_scrub_stamp': '2024-09-17T05:53:12.509392+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T05:53:18.285 INFO:tasks.ceph.ceph_manager.ceph:PG 20.17 is not active+clean 2024-09-17T05:53:18.285 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '20.17', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 138, 'state': 'creating+peering', 'last_fresh': '2024-09-17T05:53:12.518858+0000', 'last_change': '2024-09-17T05:53:12.518858+0000', 'last_active': '2024-09-17T05:53:12.509392+0000', 'last_peered': '2024-09-17T05:53:12.509392+0000', 'last_clean': '2024-09-17T05:53:12.509392+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:53:12.518858+0000', 'last_undegraded': '2024-09-17T05:53:12.518858+0000', 'last_fullsized': '2024-09-17T05:53:12.518858+0000', 'mapping_epoch': 138, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 138, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:53:12.509392+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:53:12.509392+0000', 'last_clean_scrub_stamp': '2024-09-17T05:53:12.509392+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 1], 'acting': [3, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-17T05:53:18.285 INFO:tasks.ceph.ceph_manager.ceph:PG 21.15 is not active+clean 2024-09-17T05:53:18.285 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '21.15', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T05:53:13.511622+0000', 'last_change': '2024-09-17T05:53:13.511622+0000', 'last_active': '2024-09-17T05:53:13.511622+0000', 'last_peered': '2024-09-17T05:53:13.511622+0000', 'last_clean': '2024-09-17T05:53:13.511622+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:53:13.511622+0000', 'last_undegraded': '2024-09-17T05:53:13.511622+0000', 'last_fullsized': '2024-09-17T05:53:13.511622+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:53:13.511622+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:53:13.511622+0000', 'last_clean_scrub_stamp': '2024-09-17T05:53:13.511622+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T05:53:18.285 INFO:tasks.ceph.ceph_manager.ceph:PG 21.12 is not active+clean 2024-09-17T05:53:18.285 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '21.12', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T05:53:13.511622+0000', 'last_change': '2024-09-17T05:53:13.511622+0000', 'last_active': '2024-09-17T05:53:13.511622+0000', 'last_peered': '2024-09-17T05:53:13.511622+0000', 'last_clean': '2024-09-17T05:53:13.511622+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:53:13.511622+0000', 'last_undegraded': '2024-09-17T05:53:13.511622+0000', 'last_fullsized': '2024-09-17T05:53:13.511622+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:53:13.511622+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:53:13.511622+0000', 'last_clean_scrub_stamp': '2024-09-17T05:53:13.511622+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T05:53:18.285 INFO:tasks.ceph.ceph_manager.ceph:PG 20.13 is not active+clean 2024-09-17T05:53:18.285 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '20.13', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 138, 'state': 'creating+peering', 'last_fresh': '2024-09-17T05:53:12.516491+0000', 'last_change': '2024-09-17T05:53:12.516491+0000', 'last_active': '2024-09-17T05:53:12.509392+0000', 'last_peered': '2024-09-17T05:53:12.509392+0000', 'last_clean': '2024-09-17T05:53:12.509392+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:53:12.516491+0000', 'last_undegraded': '2024-09-17T05:53:12.516491+0000', 'last_fullsized': '2024-09-17T05:53:12.516491+0000', 'mapping_epoch': 138, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 138, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:53:12.509392+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:53:12.509392+0000', 'last_clean_scrub_stamp': '2024-09-17T05:53:12.509392+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 0], 'acting': [6, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-17T05:53:18.285 INFO:tasks.ceph.ceph_manager.ceph:PG 21.13 is not active+clean 2024-09-17T05:53:18.285 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '21.13', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T05:53:13.511622+0000', 'last_change': '2024-09-17T05:53:13.511622+0000', 'last_active': '2024-09-17T05:53:13.511622+0000', 'last_peered': '2024-09-17T05:53:13.511622+0000', 'last_clean': '2024-09-17T05:53:13.511622+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:53:13.511622+0000', 'last_undegraded': '2024-09-17T05:53:13.511622+0000', 'last_fullsized': '2024-09-17T05:53:13.511622+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:53:13.511622+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:53:13.511622+0000', 'last_clean_scrub_stamp': '2024-09-17T05:53:13.511622+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T05:53:18.285 INFO:tasks.ceph.ceph_manager.ceph:PG 20.12 is not active+clean 2024-09-17T05:53:18.286 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '20.12', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 138, 'state': 'creating+peering', 'last_fresh': '2024-09-17T05:53:12.516394+0000', 'last_change': '2024-09-17T05:53:12.516394+0000', 'last_active': '2024-09-17T05:53:12.509392+0000', 'last_peered': '2024-09-17T05:53:12.509392+0000', 'last_clean': '2024-09-17T05:53:12.509392+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:53:12.516394+0000', 'last_undegraded': '2024-09-17T05:53:12.516394+0000', 'last_fullsized': '2024-09-17T05:53:12.516394+0000', 'mapping_epoch': 138, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 138, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:53:12.509392+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:53:12.509392+0000', 'last_clean_scrub_stamp': '2024-09-17T05:53:12.509392+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 5], 'acting': [6, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-17T05:53:18.286 INFO:tasks.ceph.ceph_manager.ceph:PG 20.11 is not active+clean 2024-09-17T05:53:18.286 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '20.11', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 138, 'state': 'creating+peering', 'last_fresh': '2024-09-17T05:53:12.516984+0000', 'last_change': '2024-09-17T05:53:12.516984+0000', 'last_active': '2024-09-17T05:53:12.509392+0000', 'last_peered': '2024-09-17T05:53:12.509392+0000', 'last_clean': '2024-09-17T05:53:12.509392+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:53:12.516984+0000', 'last_undegraded': '2024-09-17T05:53:12.516984+0000', 'last_fullsized': '2024-09-17T05:53:12.516984+0000', 'mapping_epoch': 138, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 138, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:53:12.509392+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:53:12.509392+0000', 'last_clean_scrub_stamp': '2024-09-17T05:53:12.509392+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 0], 'acting': [1, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-17T05:53:18.286 INFO:tasks.ceph.ceph_manager.ceph:PG 21.11 is not active+clean 2024-09-17T05:53:18.286 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '21.11', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T05:53:13.511622+0000', 'last_change': '2024-09-17T05:53:13.511622+0000', 'last_active': '2024-09-17T05:53:13.511622+0000', 'last_peered': '2024-09-17T05:53:13.511622+0000', 'last_clean': '2024-09-17T05:53:13.511622+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:53:13.511622+0000', 'last_undegraded': '2024-09-17T05:53:13.511622+0000', 'last_fullsized': '2024-09-17T05:53:13.511622+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:53:13.511622+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:53:13.511622+0000', 'last_clean_scrub_stamp': '2024-09-17T05:53:13.511622+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T05:53:18.286 INFO:tasks.ceph.ceph_manager.ceph:PG 20.10 is not active+clean 2024-09-17T05:53:18.286 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '20.10', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 138, 'state': 'creating+peering', 'last_fresh': '2024-09-17T05:53:12.514187+0000', 'last_change': '2024-09-17T05:53:12.514187+0000', 'last_active': '2024-09-17T05:53:12.509392+0000', 'last_peered': '2024-09-17T05:53:12.509392+0000', 'last_clean': '2024-09-17T05:53:12.509392+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:53:12.514187+0000', 'last_undegraded': '2024-09-17T05:53:12.514187+0000', 'last_fullsized': '2024-09-17T05:53:12.514187+0000', 'mapping_epoch': 138, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 138, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:53:12.509392+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:53:12.509392+0000', 'last_clean_scrub_stamp': '2024-09-17T05:53:12.509392+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 6], 'acting': [2, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-17T05:53:18.286 INFO:tasks.ceph.ceph_manager.ceph:PG 21.f is not active+clean 2024-09-17T05:53:18.286 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '21.f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T05:53:13.511622+0000', 'last_change': '2024-09-17T05:53:13.511622+0000', 'last_active': '2024-09-17T05:53:13.511622+0000', 'last_peered': '2024-09-17T05:53:13.511622+0000', 'last_clean': '2024-09-17T05:53:13.511622+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:53:13.511622+0000', 'last_undegraded': '2024-09-17T05:53:13.511622+0000', 'last_fullsized': '2024-09-17T05:53:13.511622+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:53:13.511622+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:53:13.511622+0000', 'last_clean_scrub_stamp': '2024-09-17T05:53:13.511622+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T05:53:18.286 INFO:tasks.ceph.ceph_manager.ceph:PG 20.e is not active+clean 2024-09-17T05:53:18.286 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '20.e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 138, 'state': 'creating+peering', 'last_fresh': '2024-09-17T05:53:12.518809+0000', 'last_change': '2024-09-17T05:53:12.518809+0000', 'last_active': '2024-09-17T05:53:12.509392+0000', 'last_peered': '2024-09-17T05:53:12.509392+0000', 'last_clean': '2024-09-17T05:53:12.509392+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:53:12.518809+0000', 'last_undegraded': '2024-09-17T05:53:12.518809+0000', 'last_fullsized': '2024-09-17T05:53:12.518809+0000', 'mapping_epoch': 138, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 138, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:53:12.509392+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:53:12.509392+0000', 'last_clean_scrub_stamp': '2024-09-17T05:53:12.509392+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 6], 'acting': [3, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-17T05:53:18.287 INFO:tasks.ceph.ceph_manager.ceph:PG 21.c is not active+clean 2024-09-17T05:53:18.287 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '21.c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T05:53:13.511622+0000', 'last_change': '2024-09-17T05:53:13.511622+0000', 'last_active': '2024-09-17T05:53:13.511622+0000', 'last_peered': '2024-09-17T05:53:13.511622+0000', 'last_clean': '2024-09-17T05:53:13.511622+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:53:13.511622+0000', 'last_undegraded': '2024-09-17T05:53:13.511622+0000', 'last_fullsized': '2024-09-17T05:53:13.511622+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:53:13.511622+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:53:13.511622+0000', 'last_clean_scrub_stamp': '2024-09-17T05:53:13.511622+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T05:53:18.287 INFO:tasks.ceph.ceph_manager.ceph:PG 20.d is not active+clean 2024-09-17T05:53:18.287 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '20.d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 138, 'state': 'creating+peering', 'last_fresh': '2024-09-17T05:53:12.514221+0000', 'last_change': '2024-09-17T05:53:12.514221+0000', 'last_active': '2024-09-17T05:53:12.509392+0000', 'last_peered': '2024-09-17T05:53:12.509392+0000', 'last_clean': '2024-09-17T05:53:12.509392+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:53:12.514221+0000', 'last_undegraded': '2024-09-17T05:53:12.514221+0000', 'last_fullsized': '2024-09-17T05:53:12.514221+0000', 'mapping_epoch': 138, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 138, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:53:12.509392+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:53:12.509392+0000', 'last_clean_scrub_stamp': '2024-09-17T05:53:12.509392+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 7], 'acting': [2, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-17T05:53:18.287 INFO:tasks.ceph.ceph_manager.ceph:PG 21.d is not active+clean 2024-09-17T05:53:18.287 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '21.d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T05:53:13.511622+0000', 'last_change': '2024-09-17T05:53:13.511622+0000', 'last_active': '2024-09-17T05:53:13.511622+0000', 'last_peered': '2024-09-17T05:53:13.511622+0000', 'last_clean': '2024-09-17T05:53:13.511622+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:53:13.511622+0000', 'last_undegraded': '2024-09-17T05:53:13.511622+0000', 'last_fullsized': '2024-09-17T05:53:13.511622+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:53:13.511622+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:53:13.511622+0000', 'last_clean_scrub_stamp': '2024-09-17T05:53:13.511622+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T05:53:18.287 INFO:tasks.ceph.ceph_manager.ceph:PG 20.c is not active+clean 2024-09-17T05:53:18.287 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '20.c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 138, 'state': 'creating+peering', 'last_fresh': '2024-09-17T05:53:12.518716+0000', 'last_change': '2024-09-17T05:53:12.518716+0000', 'last_active': '2024-09-17T05:53:12.509392+0000', 'last_peered': '2024-09-17T05:53:12.509392+0000', 'last_clean': '2024-09-17T05:53:12.509392+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:53:12.518716+0000', 'last_undegraded': '2024-09-17T05:53:12.518716+0000', 'last_fullsized': '2024-09-17T05:53:12.518716+0000', 'mapping_epoch': 138, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 138, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:53:12.509392+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:53:12.509392+0000', 'last_clean_scrub_stamp': '2024-09-17T05:53:12.509392+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 2], 'acting': [3, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-17T05:53:18.287 INFO:tasks.ceph.ceph_manager.ceph:PG 21.a is not active+clean 2024-09-17T05:53:18.287 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '21.a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T05:53:13.511622+0000', 'last_change': '2024-09-17T05:53:13.511622+0000', 'last_active': '2024-09-17T05:53:13.511622+0000', 'last_peered': '2024-09-17T05:53:13.511622+0000', 'last_clean': '2024-09-17T05:53:13.511622+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:53:13.511622+0000', 'last_undegraded': '2024-09-17T05:53:13.511622+0000', 'last_fullsized': '2024-09-17T05:53:13.511622+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:53:13.511622+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:53:13.511622+0000', 'last_clean_scrub_stamp': '2024-09-17T05:53:13.511622+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T05:53:18.288 INFO:tasks.ceph.ceph_manager.ceph:PG 21.b is not active+clean 2024-09-17T05:53:18.288 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '21.b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 139, 'state': 'creating+peering', 'last_fresh': '2024-09-17T05:53:13.528919+0000', 'last_change': '2024-09-17T05:53:13.528919+0000', 'last_active': '2024-09-17T05:53:13.511622+0000', 'last_peered': '2024-09-17T05:53:13.511622+0000', 'last_clean': '2024-09-17T05:53:13.511622+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:53:13.528919+0000', 'last_undegraded': '2024-09-17T05:53:13.528919+0000', 'last_fullsized': '2024-09-17T05:53:13.528919+0000', 'mapping_epoch': 139, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 139, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:53:13.511622+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:53:13.511622+0000', 'last_clean_scrub_stamp': '2024-09-17T05:53:13.511622+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 4], 'acting': [0, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-17T05:53:18.288 INFO:tasks.ceph.ceph_manager.ceph:PG 21.8 is not active+clean 2024-09-17T05:53:18.288 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '21.8', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T05:53:13.511622+0000', 'last_change': '2024-09-17T05:53:13.511622+0000', 'last_active': '2024-09-17T05:53:13.511622+0000', 'last_peered': '2024-09-17T05:53:13.511622+0000', 'last_clean': '2024-09-17T05:53:13.511622+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:53:13.511622+0000', 'last_undegraded': '2024-09-17T05:53:13.511622+0000', 'last_fullsized': '2024-09-17T05:53:13.511622+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:53:13.511622+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:53:13.511622+0000', 'last_clean_scrub_stamp': '2024-09-17T05:53:13.511622+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T05:53:18.288 INFO:tasks.ceph.ceph_manager.ceph:PG 21.9 is not active+clean 2024-09-17T05:53:18.288 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '21.9', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 139, 'state': 'creating+peering', 'last_fresh': '2024-09-17T05:53:13.528602+0000', 'last_change': '2024-09-17T05:53:13.528602+0000', 'last_active': '2024-09-17T05:53:13.511622+0000', 'last_peered': '2024-09-17T05:53:13.511622+0000', 'last_clean': '2024-09-17T05:53:13.511622+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:53:13.528602+0000', 'last_undegraded': '2024-09-17T05:53:13.528602+0000', 'last_fullsized': '2024-09-17T05:53:13.528602+0000', 'mapping_epoch': 139, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 139, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:53:13.511622+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:53:13.511622+0000', 'last_clean_scrub_stamp': '2024-09-17T05:53:13.511622+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 4], 'acting': [0, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-17T05:53:18.288 INFO:tasks.ceph.ceph_manager.ceph:PG 20.8 is not active+clean 2024-09-17T05:53:18.288 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '20.8', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 138, 'state': 'creating+peering', 'last_fresh': '2024-09-17T05:53:12.516694+0000', 'last_change': '2024-09-17T05:53:12.516694+0000', 'last_active': '2024-09-17T05:53:12.509392+0000', 'last_peered': '2024-09-17T05:53:12.509392+0000', 'last_clean': '2024-09-17T05:53:12.509392+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:53:12.516694+0000', 'last_undegraded': '2024-09-17T05:53:12.516694+0000', 'last_fullsized': '2024-09-17T05:53:12.516694+0000', 'mapping_epoch': 138, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 138, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:53:12.509392+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:53:12.509392+0000', 'last_clean_scrub_stamp': '2024-09-17T05:53:12.509392+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 3], 'acting': [6, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-17T05:53:18.288 INFO:tasks.ceph.ceph_manager.ceph:PG 21.7 is not active+clean 2024-09-17T05:53:18.288 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '21.7', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T05:53:13.511622+0000', 'last_change': '2024-09-17T05:53:13.511622+0000', 'last_active': '2024-09-17T05:53:13.511622+0000', 'last_peered': '2024-09-17T05:53:13.511622+0000', 'last_clean': '2024-09-17T05:53:13.511622+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:53:13.511622+0000', 'last_undegraded': '2024-09-17T05:53:13.511622+0000', 'last_fullsized': '2024-09-17T05:53:13.511622+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:53:13.511622+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:53:13.511622+0000', 'last_clean_scrub_stamp': '2024-09-17T05:53:13.511622+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T05:53:18.289 INFO:tasks.ceph.ceph_manager.ceph:PG 20.6 is not active+clean 2024-09-17T05:53:18.289 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '20.6', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 138, 'state': 'creating+peering', 'last_fresh': '2024-09-17T05:53:12.517509+0000', 'last_change': '2024-09-17T05:53:12.517509+0000', 'last_active': '2024-09-17T05:53:12.509392+0000', 'last_peered': '2024-09-17T05:53:12.509392+0000', 'last_clean': '2024-09-17T05:53:12.509392+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:53:12.517509+0000', 'last_undegraded': '2024-09-17T05:53:12.517509+0000', 'last_fullsized': '2024-09-17T05:53:12.517509+0000', 'mapping_epoch': 138, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 138, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:53:12.509392+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:53:12.509392+0000', 'last_clean_scrub_stamp': '2024-09-17T05:53:12.509392+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 7], 'acting': [1, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-17T05:53:18.289 INFO:tasks.ceph.ceph_manager.ceph:PG 21.4 is not active+clean 2024-09-17T05:53:18.289 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '21.4', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T05:53:13.511622+0000', 'last_change': '2024-09-17T05:53:13.511622+0000', 'last_active': '2024-09-17T05:53:13.511622+0000', 'last_peered': '2024-09-17T05:53:13.511622+0000', 'last_clean': '2024-09-17T05:53:13.511622+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:53:13.511622+0000', 'last_undegraded': '2024-09-17T05:53:13.511622+0000', 'last_fullsized': '2024-09-17T05:53:13.511622+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:53:13.511622+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:53:13.511622+0000', 'last_clean_scrub_stamp': '2024-09-17T05:53:13.511622+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T05:53:18.289 INFO:tasks.ceph.ceph_manager.ceph:PG 20.5 is not active+clean 2024-09-17T05:53:18.289 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '20.5', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 138, 'state': 'creating+peering', 'last_fresh': '2024-09-17T05:53:12.516944+0000', 'last_change': '2024-09-17T05:53:12.516944+0000', 'last_active': '2024-09-17T05:53:12.509392+0000', 'last_peered': '2024-09-17T05:53:12.509392+0000', 'last_clean': '2024-09-17T05:53:12.509392+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:53:12.516944+0000', 'last_undegraded': '2024-09-17T05:53:12.516944+0000', 'last_fullsized': '2024-09-17T05:53:12.516944+0000', 'mapping_epoch': 138, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 138, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:53:12.509392+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:53:12.509392+0000', 'last_clean_scrub_stamp': '2024-09-17T05:53:12.509392+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 2], 'acting': [1, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-17T05:53:18.289 INFO:tasks.ceph.ceph_manager.ceph:PG 21.5 is not active+clean 2024-09-17T05:53:18.290 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '21.5', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T05:53:13.511622+0000', 'last_change': '2024-09-17T05:53:13.511622+0000', 'last_active': '2024-09-17T05:53:13.511622+0000', 'last_peered': '2024-09-17T05:53:13.511622+0000', 'last_clean': '2024-09-17T05:53:13.511622+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:53:13.511622+0000', 'last_undegraded': '2024-09-17T05:53:13.511622+0000', 'last_fullsized': '2024-09-17T05:53:13.511622+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:53:13.511622+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:53:13.511622+0000', 'last_clean_scrub_stamp': '2024-09-17T05:53:13.511622+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T05:53:18.290 INFO:tasks.ceph.ceph_manager.ceph:PG 20.4 is not active+clean 2024-09-17T05:53:18.290 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '20.4', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 138, 'state': 'creating+peering', 'last_fresh': '2024-09-17T05:53:12.516971+0000', 'last_change': '2024-09-17T05:53:12.516971+0000', 'last_active': '2024-09-17T05:53:12.509392+0000', 'last_peered': '2024-09-17T05:53:12.509392+0000', 'last_clean': '2024-09-17T05:53:12.509392+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:53:12.516971+0000', 'last_undegraded': '2024-09-17T05:53:12.516971+0000', 'last_fullsized': '2024-09-17T05:53:12.516971+0000', 'mapping_epoch': 138, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 138, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:53:12.509392+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:53:12.509392+0000', 'last_clean_scrub_stamp': '2024-09-17T05:53:12.509392+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 2], 'acting': [1, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-17T05:53:18.290 INFO:tasks.ceph.ceph_manager.ceph:PG 21.2 is not active+clean 2024-09-17T05:53:18.290 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '21.2', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T05:53:13.511622+0000', 'last_change': '2024-09-17T05:53:13.511622+0000', 'last_active': '2024-09-17T05:53:13.511622+0000', 'last_peered': '2024-09-17T05:53:13.511622+0000', 'last_clean': '2024-09-17T05:53:13.511622+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:53:13.511622+0000', 'last_undegraded': '2024-09-17T05:53:13.511622+0000', 'last_fullsized': '2024-09-17T05:53:13.511622+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:53:13.511622+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:53:13.511622+0000', 'last_clean_scrub_stamp': '2024-09-17T05:53:13.511622+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T05:53:18.290 INFO:tasks.ceph.ceph_manager.ceph:PG 20.1 is not active+clean 2024-09-17T05:53:18.290 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '20.1', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 138, 'state': 'creating+peering', 'last_fresh': '2024-09-17T05:53:12.517785+0000', 'last_change': '2024-09-17T05:53:12.517785+0000', 'last_active': '2024-09-17T05:53:12.509392+0000', 'last_peered': '2024-09-17T05:53:12.509392+0000', 'last_clean': '2024-09-17T05:53:12.509392+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:53:12.517785+0000', 'last_undegraded': '2024-09-17T05:53:12.517785+0000', 'last_fullsized': '2024-09-17T05:53:12.517785+0000', 'mapping_epoch': 138, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 138, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:53:12.509392+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:53:12.509392+0000', 'last_clean_scrub_stamp': '2024-09-17T05:53:12.509392+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 0], 'acting': [6, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-17T05:53:18.290 INFO:tasks.ceph.ceph_manager.ceph:PG 20.0 is not active+clean 2024-09-17T05:53:18.290 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '20.0', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 138, 'state': 'creating+peering', 'last_fresh': '2024-09-17T05:53:12.519815+0000', 'last_change': '2024-09-17T05:53:12.519815+0000', 'last_active': '2024-09-17T05:53:12.509392+0000', 'last_peered': '2024-09-17T05:53:12.509392+0000', 'last_clean': '2024-09-17T05:53:12.509392+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:53:12.519815+0000', 'last_undegraded': '2024-09-17T05:53:12.519815+0000', 'last_fullsized': '2024-09-17T05:53:12.519815+0000', 'mapping_epoch': 138, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 138, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:53:12.509392+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:53:12.509392+0000', 'last_clean_scrub_stamp': '2024-09-17T05:53:12.509392+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 7], 'acting': [3, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-17T05:53:18.290 INFO:tasks.ceph.ceph_manager.ceph:PG 21.14 is not active+clean 2024-09-17T05:53:18.290 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '21.14', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 139, 'state': 'creating+peering', 'last_fresh': '2024-09-17T05:53:13.527612+0000', 'last_change': '2024-09-17T05:53:13.527612+0000', 'last_active': '2024-09-17T05:53:13.511622+0000', 'last_peered': '2024-09-17T05:53:13.511622+0000', 'last_clean': '2024-09-17T05:53:13.511622+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:53:13.527612+0000', 'last_undegraded': '2024-09-17T05:53:13.527612+0000', 'last_fullsized': '2024-09-17T05:53:13.527612+0000', 'mapping_epoch': 139, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 139, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:53:13.511622+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:53:13.511622+0000', 'last_clean_scrub_stamp': '2024-09-17T05:53:13.511622+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 4], 'acting': [0, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-17T05:53:18.291 INFO:tasks.ceph.ceph_manager.ceph:PG 20.15 is not active+clean 2024-09-17T05:53:18.291 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '20.15', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 138, 'state': 'creating+peering', 'last_fresh': '2024-09-17T05:53:12.517048+0000', 'last_change': '2024-09-17T05:53:12.517048+0000', 'last_active': '2024-09-17T05:53:12.509392+0000', 'last_peered': '2024-09-17T05:53:12.509392+0000', 'last_clean': '2024-09-17T05:53:12.509392+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:53:12.517048+0000', 'last_undegraded': '2024-09-17T05:53:12.517048+0000', 'last_fullsized': '2024-09-17T05:53:12.517048+0000', 'mapping_epoch': 138, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 138, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:53:12.509392+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:53:12.509392+0000', 'last_clean_scrub_stamp': '2024-09-17T05:53:12.509392+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 3], 'acting': [6, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-17T05:53:18.291 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-09-17T05:53:18.426 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:18.424+0000 7f61894d5640 1 -- 172.21.15.150:0/1540314444 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f61840b3720 msgr2=0x7f61840d1090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:53:18.426 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:18.424+0000 7f61894d5640 1 --2- 172.21.15.150:0/1540314444 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f61840b3720 0x7f61840d1090 secure :-1 s=READY pgs=1849 cs=0 l=1 rev1=1 crypto rx=0x7f616c009830 tx=0x7f616c02a530 comp rx=0 tx=0).stop 2024-09-17T05:53:18.426 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:18.424+0000 7f61894d5640 1 -- 172.21.15.150:0/1540314444 shutdown_connections 2024-09-17T05:53:18.426 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:18.424+0000 7f61894d5640 1 --2- 172.21.15.150:0/1540314444 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f61840b3720 0x7f61840d1090 unknown :-1 s=CLOSED pgs=1849 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:53:18.426 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:18.424+0000 7f61894d5640 1 -- 172.21.15.150:0/1540314444 >> 172.21.15.150:0/1540314444 conn(0x7f61840d4680 msgr2=0x7f61840d4a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:53:18.426 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:18.424+0000 7f61894d5640 1 -- 172.21.15.150:0/1540314444 shutdown_connections 2024-09-17T05:53:18.427 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:18.424+0000 7f61894d5640 1 -- 172.21.15.150:0/1540314444 wait complete. 2024-09-17T05:53:18.427 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:18.426+0000 7f61894d5640 1 Processor -- start 2024-09-17T05:53:18.427 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:18.426+0000 7f61894d5640 1 -- start start 2024-09-17T05:53:18.430 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:18.427+0000 7f61894d5640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f61840b3720 0x7f61840ce550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:53:18.430 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:18.427+0000 7f61894d5640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f61840b9780 0x7f618409ef50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:53:18.430 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:18.427+0000 7f61894d5640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f61840d15d0 0x7f61840a0ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:53:18.430 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:18.427+0000 7f61894d5640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f61840cffc0 con 0x7f61840d15d0 2024-09-17T05:53:18.430 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:18.427+0000 7f61894d5640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f61840cfe40 con 0x7f61840b9780 2024-09-17T05:53:18.431 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:18.427+0000 7f61894d5640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f61840d0140 con 0x7f61840b3720 2024-09-17T05:53:18.431 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:18.427+0000 7f61837fe640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f61840d15d0 0x7f61840a0ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:53:18.431 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:18.427+0000 7f61837fe640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f61840d15d0 0x7f61840a0ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:35034/0 (socket says 172.21.15.150:35034) 2024-09-17T05:53:18.431 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:18.427+0000 7f61837fe640 1 -- 172.21.15.150:0/3067948666 learned_addr learned my addr 172.21.15.150:0/3067948666 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:53:18.431 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:18.427+0000 7f617a7fc640 1 --2- 172.21.15.150:0/3067948666 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f61840b9780 0x7f618409ef50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:53:18.431 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:18.427+0000 7f6182ffd640 1 --2- 172.21.15.150:0/3067948666 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f61840b3720 0x7f61840ce550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:53:18.431 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:18.428+0000 7f61837fe640 1 -- 172.21.15.150:0/3067948666 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f61840b3720 msgr2=0x7f61840ce550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:53:18.431 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:18.428+0000 7f61837fe640 1 --2- 172.21.15.150:0/3067948666 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f61840b3720 0x7f61840ce550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:53:18.431 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:18.428+0000 7f61837fe640 1 -- 172.21.15.150:0/3067948666 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f61840b9780 msgr2=0x7f618409ef50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:53:18.431 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:18.428+0000 7f61837fe640 1 --2- 172.21.15.150:0/3067948666 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f61840b9780 0x7f618409ef50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:53:18.431 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:18.428+0000 7f61837fe640 1 -- 172.21.15.150:0/3067948666 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f61840cea90 con 0x7f61840d15d0 2024-09-17T05:53:18.431 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:18.428+0000 7f6182ffd640 1 --2- 172.21.15.150:0/3067948666 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f61840b3720 0x7f61840ce550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:53:18.431 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:18.428+0000 7f61837fe640 1 --2- 172.21.15.150:0/3067948666 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f61840d15d0 0x7f61840a0ab0 secure :-1 s=READY pgs=1850 cs=0 l=1 rev1=1 crypto rx=0x7f617c00c700 tx=0x7f617c00cbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:53:18.432 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:18.428+0000 7f617bfff640 1 -- 172.21.15.150:0/3067948666 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f617c003b70 con 0x7f61840d15d0 2024-09-17T05:53:18.432 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:18.428+0000 7f617bfff640 1 -- 172.21.15.150:0/3067948666 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f617c003d10 con 0x7f61840d15d0 2024-09-17T05:53:18.432 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:18.428+0000 7f61894d5640 1 -- 172.21.15.150:0/3067948666 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f618414d940 con 0x7f61840d15d0 2024-09-17T05:53:18.432 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:18.428+0000 7f617bfff640 1 -- 172.21.15.150:0/3067948666 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f617c00aab0 con 0x7f61840d15d0 2024-09-17T05:53:18.432 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:18.428+0000 7f61894d5640 1 -- 172.21.15.150:0/3067948666 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f618409fcf0 con 0x7f61840d15d0 2024-09-17T05:53:18.433 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:18.429+0000 7f61894d5640 1 -- 172.21.15.150:0/3067948666 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f61840760f0 con 0x7f61840d15d0 2024-09-17T05:53:18.433 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:18.430+0000 7f617bfff640 1 -- 172.21.15.150:0/3067948666 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 45) ==== 104501+0+0 (secure 0 0 0) 0x7f617c00ac50 con 0x7f61840d15d0 2024-09-17T05:53:18.433 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:18.430+0000 7f617bfff640 1 --2- 172.21.15.150:0/3067948666 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f616407ad50 0x7f616407d260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:53:18.433 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:18.430+0000 7f617bfff640 1 -- 172.21.15.150:0/3067948666 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(141..141 src has 1..141) ==== 5905+0+0 (secure 0 0 0) 0x7f617c099c90 con 0x7f61840d15d0 2024-09-17T05:53:18.433 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:18.430+0000 7f6182ffd640 1 --2- 172.21.15.150:0/3067948666 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f616407ad50 0x7f616407d260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:53:18.433 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:18.431+0000 7f6182ffd640 1 --2- 172.21.15.150:0/3067948666 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f616407ad50 0x7f616407d260 secure :-1 s=READY pgs=785 cs=0 l=1 rev1=1 crypto rx=0x7f6174001090 tx=0x7f6174009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:53:18.436 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:18.435+0000 7f617bfff640 1 -- 172.21.15.150:0/3067948666 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f61840760f0 con 0x7f61840d15d0 2024-09-17T05:53:18.679 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:18.677+0000 7f61894d5640 1 -- 172.21.15.150:0/3067948666 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) -- 0x7f61840d0660 con 0x7f61840d15d0 2024-09-17T05:53:18.680 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:18.678+0000 7f617bfff640 1 -- 172.21.15.150:0/3067948666 <== mon.0 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) ==== 72+0+1639 (secure 0 0 0) 0x7f617c063b50 con 0x7f61840d15d0 2024-09-17T05:53:18.680 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-09-17T05:53:18.680 INFO:teuthology.orchestra.run.smithi150.stdout:{"fsid":"9f2e05e9-d629-47b3-b26b-1360655b7d20","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":706,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":141,"num_osds":8,"num_up_osds":8,"osd_up_since":1726551706,"num_in_osds":8,"osd_in_since":1726551696,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"unknown","count":43},{"state_name":"active+clean","count":31},{"state_name":"creating+peering","count":23}],"num_pgs":97,"num_pools":3,"num_objects":6,"data_bytes":590972,"bytes_used":1095958528,"bytes_avail":771998154752,"bytes_total":773094113280,"unknown_pgs_ratio":0.44329896569252014,"inactive_pgs_ratio":0.23711340129375458,"write_bytes_sec":446,"read_op_per_sec":0,"write_op_per_sec":1},"fsmap":{"epoch":88,"btime":"2024-09-17T05:53:16:540972+0000","id":10,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":10,"rank":0,"name":"c","status":"up:active","gid":9633}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":19,"modified":"2024-09-17T05:53:03.090698+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2024-09-17T05:53:18.682 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:18.680+0000 7f61894d5640 1 -- 172.21.15.150:0/3067948666 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f616407ad50 msgr2=0x7f616407d260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:53:18.682 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:18.680+0000 7f61894d5640 1 --2- 172.21.15.150:0/3067948666 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f616407ad50 0x7f616407d260 secure :-1 s=READY pgs=785 cs=0 l=1 rev1=1 crypto rx=0x7f6174001090 tx=0x7f6174009040 comp rx=0 tx=0).stop 2024-09-17T05:53:18.682 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:18.680+0000 7f61894d5640 1 -- 172.21.15.150:0/3067948666 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f61840d15d0 msgr2=0x7f61840a0ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:53:18.682 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:18.680+0000 7f61894d5640 1 --2- 172.21.15.150:0/3067948666 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f61840d15d0 0x7f61840a0ab0 secure :-1 s=READY pgs=1850 cs=0 l=1 rev1=1 crypto rx=0x7f617c00c700 tx=0x7f617c00cbc0 comp rx=0 tx=0).stop 2024-09-17T05:53:18.682 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:18.680+0000 7f61894d5640 1 -- 172.21.15.150:0/3067948666 shutdown_connections 2024-09-17T05:53:18.682 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:18.680+0000 7f61894d5640 1 --2- 172.21.15.150:0/3067948666 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f61840b9780 0x7f618409ef50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:53:18.682 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:18.680+0000 7f61894d5640 1 --2- 172.21.15.150:0/3067948666 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f616407ad50 0x7f616407d260 unknown :-1 s=CLOSED pgs=785 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:53:18.683 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:18.680+0000 7f61894d5640 1 --2- 172.21.15.150:0/3067948666 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f61840d15d0 0x7f61840a0ab0 unknown :-1 s=CLOSED pgs=1850 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:53:18.683 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:18.680+0000 7f61894d5640 1 --2- 172.21.15.150:0/3067948666 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f61840b3720 0x7f61840ce550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:53:18.683 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:18.680+0000 7f61894d5640 1 -- 172.21.15.150:0/3067948666 >> 172.21.15.150:0/3067948666 conn(0x7f61840d4680 msgr2=0x7f618415e0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:53:18.683 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:18.680+0000 7f61894d5640 1 -- 172.21.15.150:0/3067948666 shutdown_connections 2024-09-17T05:53:18.683 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:18.680+0000 7f61894d5640 1 -- 172.21.15.150:0/3067948666 wait complete. 2024-09-17T05:53:18.693 INFO:tasks.ceph.ceph_manager.ceph:no progress seen, keeping timeout for now 2024-09-17T05:53:18.694 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-17T05:53:18.807 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:18.805+0000 7f2beb78a640 1 -- 172.21.15.150:0/2316719220 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2be40d1060 msgr2=0x7f2be40b1e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:53:18.807 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:18.805+0000 7f2beb78a640 1 --2- 172.21.15.150:0/2316719220 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2be40d1060 0x7f2be40b1e00 secure :-1 s=READY pgs=1851 cs=0 l=1 rev1=1 crypto rx=0x7f2be40711a0 tx=0x7f2bdc02aac0 comp rx=0 tx=0).stop 2024-09-17T05:53:18.808 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:18.805+0000 7f2beb78a640 1 -- 172.21.15.150:0/2316719220 shutdown_connections 2024-09-17T05:53:18.808 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:18.805+0000 7f2beb78a640 1 --2- 172.21.15.150:0/2316719220 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2be40d1060 0x7f2be40b1e00 unknown :-1 s=CLOSED pgs=1851 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:53:18.808 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:18.805+0000 7f2beb78a640 1 --2- 172.21.15.150:0/2316719220 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2be40d0550 0x7f2be40b18c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:53:18.808 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:18.805+0000 7f2beb78a640 1 --2- 172.21.15.150:0/2316719220 >> v2:172.21.15.176:3300/0 conn(0x7f2be40d0c50 0x7f2be40d0010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:53:18.808 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:18.805+0000 7f2beb78a640 1 -- 172.21.15.150:0/2316719220 >> 172.21.15.150:0/2316719220 conn(0x7f2be40b3fc0 msgr2=0x7f2be40b43d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:53:18.808 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:18.805+0000 7f2beb78a640 1 -- 172.21.15.150:0/2316719220 shutdown_connections 2024-09-17T05:53:18.808 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:18.805+0000 7f2beb78a640 1 -- 172.21.15.150:0/2316719220 wait complete. 2024-09-17T05:53:18.808 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:18.807+0000 7f2beb78a640 1 Processor -- start 2024-09-17T05:53:18.809 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:18.807+0000 7f2beb78a640 1 -- start start 2024-09-17T05:53:18.811 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:18.808+0000 7f2beb78a640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2be40d0550 0x7f2be40cbd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:53:18.811 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:18.808+0000 7f2beb78a640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2be40d0c50 0x7f2be40b0000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:53:18.811 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:18.808+0000 7f2beb78a640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2be40d1060 0x7f2be40b0540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:53:18.811 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:18.808+0000 7f2beb78a640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f2be40ceb70 con 0x7f2be40d0550 2024-09-17T05:53:18.811 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:18.808+0000 7f2beb78a640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f2be40c5cb0 con 0x7f2be40d1060 2024-09-17T05:53:18.811 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:18.808+0000 7f2beb78a640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f2be40cecf0 con 0x7f2be40d0c50 2024-09-17T05:53:18.812 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:18.808+0000 7f2be9526640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2be40d0550 0x7f2be40cbd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:53:18.812 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:18.808+0000 7f2be9526640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2be40d0550 0x7f2be40cbd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:35058/0 (socket says 172.21.15.150:35058) 2024-09-17T05:53:18.812 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:18.808+0000 7f2be9526640 1 -- 172.21.15.150:0/230796180 learned_addr learned my addr 172.21.15.150:0/230796180 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:53:18.812 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:18.809+0000 7f2be9d27640 1 --2- 172.21.15.150:0/230796180 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2be40d1060 0x7f2be40b0540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:53:18.812 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:18.809+0000 7f2be8d25640 1 --2- 172.21.15.150:0/230796180 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2be40d0c50 0x7f2be40b0000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:53:18.812 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:18.809+0000 7f2be9526640 1 -- 172.21.15.150:0/230796180 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2be40d0c50 msgr2=0x7f2be40b0000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:53:18.812 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:18.809+0000 7f2be9526640 1 --2- 172.21.15.150:0/230796180 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2be40d0c50 0x7f2be40b0000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:53:18.812 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:18.809+0000 7f2be9526640 1 -- 172.21.15.150:0/230796180 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2be40d1060 msgr2=0x7f2be40b0540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:53:18.812 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:18.809+0000 7f2be9526640 1 --2- 172.21.15.150:0/230796180 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2be40d1060 0x7f2be40b0540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:53:18.812 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:18.809+0000 7f2be9526640 1 -- 172.21.15.150:0/230796180 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2be40cc580 con 0x7f2be40d0550 2024-09-17T05:53:18.812 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:18.809+0000 7f2be9526640 1 --2- 172.21.15.150:0/230796180 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2be40d0550 0x7f2be40cbd30 secure :-1 s=READY pgs=1852 cs=0 l=1 rev1=1 crypto rx=0x7f2bd400d750 tx=0x7f2bd400dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:53:18.812 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:18.809+0000 7f2be1ffb640 1 -- 172.21.15.150:0/230796180 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2bd4017070 con 0x7f2be40d0550 2024-09-17T05:53:18.813 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:18.809+0000 7f2be1ffb640 1 -- 172.21.15.150:0/230796180 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f2bd4004310 con 0x7f2be40d0550 2024-09-17T05:53:18.813 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:18.809+0000 7f2beb78a640 1 -- 172.21.15.150:0/230796180 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2be41f6ad0 con 0x7f2be40d0550 2024-09-17T05:53:18.813 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:18.809+0000 7f2be1ffb640 1 -- 172.21.15.150:0/230796180 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2bd400de60 con 0x7f2be40d0550 2024-09-17T05:53:18.813 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:18.809+0000 7f2beb78a640 1 -- 172.21.15.150:0/230796180 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2be41f6d70 con 0x7f2be40d0550 2024-09-17T05:53:18.813 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:18.810+0000 7f2beb78a640 1 -- 172.21.15.150:0/230796180 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2be40d0010 con 0x7f2be40d0550 2024-09-17T05:53:18.814 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:18.811+0000 7f2be1ffb640 1 -- 172.21.15.150:0/230796180 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 45) ==== 104501+0+0 (secure 0 0 0) 0x7f2bd4009c30 con 0x7f2be40d0550 2024-09-17T05:53:18.814 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:18.812+0000 7f2be1ffb640 1 --2- 172.21.15.150:0/230796180 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f2bd007ad80 0x7f2bd007d290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:53:18.814 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:18.812+0000 7f2be1ffb640 1 -- 172.21.15.150:0/230796180 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(141..141 src has 1..141) ==== 5905+0+0 (secure 0 0 0) 0x7f2bd409a210 con 0x7f2be40d0550 2024-09-17T05:53:18.814 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:18.812+0000 7f2be8d25640 1 --2- 172.21.15.150:0/230796180 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f2bd007ad80 0x7f2bd007d290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:53:18.814 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:18.812+0000 7f2be8d25640 1 --2- 172.21.15.150:0/230796180 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f2bd007ad80 0x7f2bd007d290 secure :-1 s=READY pgs=786 cs=0 l=1 rev1=1 crypto rx=0x7f2be40c8ca0 tx=0x7f2bd8005d70 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:53:18.818 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:18.816+0000 7f2be1ffb640 1 -- 172.21.15.150:0/230796180 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f2bd4020020 con 0x7f2be40d0550 2024-09-17T05:53:18.989 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:18.988+0000 7f2beb78a640 1 -- 172.21.15.150:0/230796180 --> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f2be40b1c50 con 0x7f2bd007ad80 2024-09-17T05:53:18.994 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:18.992+0000 7f2be1ffb640 1 -- 172.21.15.150:0/230796180 <== mgr.4108 v2:172.21.15.176:6800/3631216395 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+244020 (secure 0 0 0) 0x7f2be40b1c50 con 0x7f2bd007ad80 2024-09-17T05:53:18.996 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-09-17T05:53:18.997 INFO:teuthology.orchestra.run.smithi150.stderr:dumped all 2024-09-17T05:53:18.999 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:18.995+0000 7f2beb78a640 1 -- 172.21.15.150:0/230796180 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f2bd007ad80 msgr2=0x7f2bd007d290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:53:18.999 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:18.995+0000 7f2beb78a640 1 --2- 172.21.15.150:0/230796180 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f2bd007ad80 0x7f2bd007d290 secure :-1 s=READY pgs=786 cs=0 l=1 rev1=1 crypto rx=0x7f2be40c8ca0 tx=0x7f2bd8005d70 comp rx=0 tx=0).stop 2024-09-17T05:53:18.999 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:18.995+0000 7f2beb78a640 1 -- 172.21.15.150:0/230796180 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2be40d0550 msgr2=0x7f2be40cbd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:53:18.999 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:18.995+0000 7f2beb78a640 1 --2- 172.21.15.150:0/230796180 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2be40d0550 0x7f2be40cbd30 secure :-1 s=READY pgs=1852 cs=0 l=1 rev1=1 crypto rx=0x7f2bd400d750 tx=0x7f2bd400dc10 comp rx=0 tx=0).stop 2024-09-17T05:53:18.999 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:18.995+0000 7f2beb78a640 1 -- 172.21.15.150:0/230796180 shutdown_connections 2024-09-17T05:53:18.999 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:18.995+0000 7f2beb78a640 1 --2- 172.21.15.150:0/230796180 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2be40d1060 0x7f2be40b0540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:53:18.999 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:18.995+0000 7f2beb78a640 1 --2- 172.21.15.150:0/230796180 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f2bd007ad80 0x7f2bd007d290 unknown :-1 s=CLOSED pgs=786 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:53:19.000 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:18.995+0000 7f2beb78a640 1 --2- 172.21.15.150:0/230796180 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2be40d0c50 0x7f2be40b0000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:53:19.000 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:18.995+0000 7f2beb78a640 1 --2- 172.21.15.150:0/230796180 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2be40d0550 0x7f2be40cbd30 unknown :-1 s=CLOSED pgs=1852 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:53:19.000 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:18.995+0000 7f2beb78a640 1 -- 172.21.15.150:0/230796180 >> 172.21.15.150:0/230796180 conn(0x7f2be40b3fc0 msgr2=0x7f2be40729a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:53:19.000 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:18.995+0000 7f2beb78a640 1 -- 172.21.15.150:0/230796180 shutdown_connections 2024-09-17T05:53:19.000 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:18.995+0000 7f2beb78a640 1 -- 172.21.15.150:0/230796180 wait complete. 2024-09-17T05:53:19.008 INFO:teuthology.orchestra.run.smithi150.stdout:{"pg_ready":true,"pg_map":{"version":481,"stamp":"2024-09-17T05:53:17.094124+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590972,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":109,"num_write_kb":1630,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":80,"ondisk_log_size":80,"up":108,"acting":108,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":70,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":7,"kb":754974720,"kb_used":1070272,"kb_used_data":14660,"kb_used_omap":12,"kb_used_meta":1055411,"kb_avail":753904448,"statfs":{"total":773094113280,"available":771998154752,"internally_reserved":0,"allocated":15011840,"data_stored":7268793,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":1080741424},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":604,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.581804"},"pg_stats":[{"pgid":"21.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:53:13.511622+0000","last_change":"2024-09-17T05:53:13.511622+0000","last_active":"2024-09-17T05:53:13.511622+0000","last_peered":"2024-09-17T05:53:13.511622+0000","last_clean":"2024-09-17T05:53:13.511622+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:53:13.511622+0000","last_undegraded":"2024-09-17T05:53:13.511622+0000","last_fullsized":"2024-09-17T05:53:13.511622+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:53:13.511622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:53:13.511622+0000","last_clean_scrub_stamp":"2024-09-17T05:53:13.511622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:53:13.511622+0000","last_change":"2024-09-17T05:53:13.511622+0000","last_active":"2024-09-17T05:53:13.511622+0000","last_peered":"2024-09-17T05:53:13.511622+0000","last_clean":"2024-09-17T05:53:13.511622+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:53:13.511622+0000","last_undegraded":"2024-09-17T05:53:13.511622+0000","last_fullsized":"2024-09-17T05:53:13.511622+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:53:13.511622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:53:13.511622+0000","last_clean_scrub_stamp":"2024-09-17T05:53:13.511622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:53:13.511622+0000","last_change":"2024-09-17T05:53:13.511622+0000","last_active":"2024-09-17T05:53:13.511622+0000","last_peered":"2024-09-17T05:53:13.511622+0000","last_clean":"2024-09-17T05:53:13.511622+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:53:13.511622+0000","last_undegraded":"2024-09-17T05:53:13.511622+0000","last_fullsized":"2024-09-17T05:53:13.511622+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:53:13.511622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:53:13.511622+0000","last_clean_scrub_stamp":"2024-09-17T05:53:13.511622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:53:13.511622+0000","last_change":"2024-09-17T05:53:13.511622+0000","last_active":"2024-09-17T05:53:13.511622+0000","last_peered":"2024-09-17T05:53:13.511622+0000","last_clean":"2024-09-17T05:53:13.511622+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:53:13.511622+0000","last_undegraded":"2024-09-17T05:53:13.511622+0000","last_fullsized":"2024-09-17T05:53:13.511622+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:53:13.511622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:53:13.511622+0000","last_clean_scrub_stamp":"2024-09-17T05:53:13.511622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.3b","version":"0'0","reported_seq":13,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-17T05:53:16.572208+0000","last_change":"2024-09-17T05:53:14.550770+0000","last_active":"2024-09-17T05:53:16.572208+0000","last_peered":"2024-09-17T05:53:16.572208+0000","last_clean":"2024-09-17T05:53:16.572208+0000","last_became_active":"2024-09-17T05:53:14.550289+0000","last_became_peered":"2024-09-17T05:53:14.550289+0000","last_unstale":"2024-09-17T05:53:16.572208+0000","last_undegraded":"2024-09-17T05:53:16.572208+0000","last_fullsized":"2024-09-17T05:53:16.572208+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:53:13.511622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:53:13.511622+0000","last_clean_scrub_stamp":"2024-09-17T05:53:13.511622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:23:14.461386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:53:13.511622+0000","last_change":"2024-09-17T05:53:13.511622+0000","last_active":"2024-09-17T05:53:13.511622+0000","last_peered":"2024-09-17T05:53:13.511622+0000","last_clean":"2024-09-17T05:53:13.511622+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:53:13.511622+0000","last_undegraded":"2024-09-17T05:53:13.511622+0000","last_fullsized":"2024-09-17T05:53:13.511622+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:53:13.511622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:53:13.511622+0000","last_clean_scrub_stamp":"2024-09-17T05:53:13.511622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.39","version":"0'0","reported_seq":1,"reported_epoch":139,"state":"creating+peering","last_fresh":"2024-09-17T05:53:13.527403+0000","last_change":"2024-09-17T05:53:13.527403+0000","last_active":"2024-09-17T05:53:13.511622+0000","last_peered":"2024-09-17T05:53:13.511622+0000","last_clean":"2024-09-17T05:53:13.511622+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:53:13.527403+0000","last_undegraded":"2024-09-17T05:53:13.527403+0000","last_fullsized":"2024-09-17T05:53:13.527403+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:53:13.511622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:53:13.511622+0000","last_clean_scrub_stamp":"2024-09-17T05:53:13.511622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:53:13.511622+0000","last_change":"2024-09-17T05:53:13.511622+0000","last_active":"2024-09-17T05:53:13.511622+0000","last_peered":"2024-09-17T05:53:13.511622+0000","last_clean":"2024-09-17T05:53:13.511622+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:53:13.511622+0000","last_undegraded":"2024-09-17T05:53:13.511622+0000","last_fullsized":"2024-09-17T05:53:13.511622+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:53:13.511622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:53:13.511622+0000","last_clean_scrub_stamp":"2024-09-17T05:53:13.511622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:53:13.511622+0000","last_change":"2024-09-17T05:53:13.511622+0000","last_active":"2024-09-17T05:53:13.511622+0000","last_peered":"2024-09-17T05:53:13.511622+0000","last_clean":"2024-09-17T05:53:13.511622+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:53:13.511622+0000","last_undegraded":"2024-09-17T05:53:13.511622+0000","last_fullsized":"2024-09-17T05:53:13.511622+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:53:13.511622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:53:13.511622+0000","last_clean_scrub_stamp":"2024-09-17T05:53:13.511622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.36","version":"0'0","reported_seq":13,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-17T05:53:15.527536+0000","last_change":"2024-09-17T05:53:14.556175+0000","last_active":"2024-09-17T05:53:15.527536+0000","last_peered":"2024-09-17T05:53:15.527536+0000","last_clean":"2024-09-17T05:53:15.527536+0000","last_became_active":"2024-09-17T05:53:14.555806+0000","last_became_peered":"2024-09-17T05:53:14.555806+0000","last_unstale":"2024-09-17T05:53:15.527536+0000","last_undegraded":"2024-09-17T05:53:15.527536+0000","last_fullsized":"2024-09-17T05:53:15.527536+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:53:13.511622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:53:13.511622+0000","last_clean_scrub_stamp":"2024-09-17T05:53:13.511622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:25:57.952915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:53:13.511622+0000","last_change":"2024-09-17T05:53:13.511622+0000","last_active":"2024-09-17T05:53:13.511622+0000","last_peered":"2024-09-17T05:53:13.511622+0000","last_clean":"2024-09-17T05:53:13.511622+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:53:13.511622+0000","last_undegraded":"2024-09-17T05:53:13.511622+0000","last_fullsized":"2024-09-17T05:53:13.511622+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:53:13.511622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:53:13.511622+0000","last_clean_scrub_stamp":"2024-09-17T05:53:13.511622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.34","version":"0'0","reported_seq":13,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-17T05:53:15.528949+0000","last_change":"2024-09-17T05:53:14.548964+0000","last_active":"2024-09-17T05:53:15.528949+0000","last_peered":"2024-09-17T05:53:15.528949+0000","last_clean":"2024-09-17T05:53:15.528949+0000","last_became_active":"2024-09-17T05:53:14.548601+0000","last_became_peered":"2024-09-17T05:53:14.548601+0000","last_unstale":"2024-09-17T05:53:15.528949+0000","last_undegraded":"2024-09-17T05:53:15.528949+0000","last_fullsized":"2024-09-17T05:53:15.528949+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:53:13.511622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:53:13.511622+0000","last_clean_scrub_stamp":"2024-09-17T05:53:13.511622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:37:55.173570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.33","version":"0'0","reported_seq":13,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-17T05:53:16.572443+0000","last_change":"2024-09-17T05:53:14.550313+0000","last_active":"2024-09-17T05:53:16.572443+0000","last_peered":"2024-09-17T05:53:16.572443+0000","last_clean":"2024-09-17T05:53:16.572443+0000","last_became_active":"2024-09-17T05:53:14.549928+0000","last_became_peered":"2024-09-17T05:53:14.549928+0000","last_unstale":"2024-09-17T05:53:16.572443+0000","last_undegraded":"2024-09-17T05:53:16.572443+0000","last_fullsized":"2024-09-17T05:53:16.572443+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:53:13.511622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:53:13.511622+0000","last_clean_scrub_stamp":"2024-09-17T05:53:13.511622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:24:22.329433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:53:13.511622+0000","last_change":"2024-09-17T05:53:13.511622+0000","last_active":"2024-09-17T05:53:13.511622+0000","last_peered":"2024-09-17T05:53:13.511622+0000","last_clean":"2024-09-17T05:53:13.511622+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:53:13.511622+0000","last_undegraded":"2024-09-17T05:53:13.511622+0000","last_fullsized":"2024-09-17T05:53:13.511622+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:53:13.511622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:53:13.511622+0000","last_clean_scrub_stamp":"2024-09-17T05:53:13.511622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.31","version":"0'0","reported_seq":13,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-17T05:53:15.528260+0000","last_change":"2024-09-17T05:53:14.554387+0000","last_active":"2024-09-17T05:53:15.528260+0000","last_peered":"2024-09-17T05:53:15.528260+0000","last_clean":"2024-09-17T05:53:15.528260+0000","last_became_active":"2024-09-17T05:53:14.553370+0000","last_became_peered":"2024-09-17T05:53:14.553370+0000","last_unstale":"2024-09-17T05:53:15.528260+0000","last_undegraded":"2024-09-17T05:53:15.528260+0000","last_fullsized":"2024-09-17T05:53:15.528260+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:53:13.511622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:53:13.511622+0000","last_clean_scrub_stamp":"2024-09-17T05:53:13.511622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:28:53.104884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:53:13.511622+0000","last_change":"2024-09-17T05:53:13.511622+0000","last_active":"2024-09-17T05:53:13.511622+0000","last_peered":"2024-09-17T05:53:13.511622+0000","last_clean":"2024-09-17T05:53:13.511622+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:53:13.511622+0000","last_undegraded":"2024-09-17T05:53:13.511622+0000","last_fullsized":"2024-09-17T05:53:13.511622+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:53:13.511622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:53:13.511622+0000","last_clean_scrub_stamp":"2024-09-17T05:53:13.511622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.2f","version":"0'0","reported_seq":13,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-17T05:53:15.528909+0000","last_change":"2024-09-17T05:53:14.555496+0000","last_active":"2024-09-17T05:53:15.528909+0000","last_peered":"2024-09-17T05:53:15.528909+0000","last_clean":"2024-09-17T05:53:15.528909+0000","last_became_active":"2024-09-17T05:53:14.554855+0000","last_became_peered":"2024-09-17T05:53:14.554855+0000","last_unstale":"2024-09-17T05:53:15.528909+0000","last_undegraded":"2024-09-17T05:53:15.528909+0000","last_fullsized":"2024-09-17T05:53:15.528909+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:53:13.511622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:53:13.511622+0000","last_clean_scrub_stamp":"2024-09-17T05:53:13.511622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:25:34.532282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:53:13.511622+0000","last_change":"2024-09-17T05:53:13.511622+0000","last_active":"2024-09-17T05:53:13.511622+0000","last_peered":"2024-09-17T05:53:13.511622+0000","last_clean":"2024-09-17T05:53:13.511622+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:53:13.511622+0000","last_undegraded":"2024-09-17T05:53:13.511622+0000","last_fullsized":"2024-09-17T05:53:13.511622+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:53:13.511622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:53:13.511622+0000","last_clean_scrub_stamp":"2024-09-17T05:53:13.511622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:53:13.511622+0000","last_change":"2024-09-17T05:53:13.511622+0000","last_active":"2024-09-17T05:53:13.511622+0000","last_peered":"2024-09-17T05:53:13.511622+0000","last_clean":"2024-09-17T05:53:13.511622+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:53:13.511622+0000","last_undegraded":"2024-09-17T05:53:13.511622+0000","last_fullsized":"2024-09-17T05:53:13.511622+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:53:13.511622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:53:13.511622+0000","last_clean_scrub_stamp":"2024-09-17T05:53:13.511622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:53:13.511622+0000","last_change":"2024-09-17T05:53:13.511622+0000","last_active":"2024-09-17T05:53:13.511622+0000","last_peered":"2024-09-17T05:53:13.511622+0000","last_clean":"2024-09-17T05:53:13.511622+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:53:13.511622+0000","last_undegraded":"2024-09-17T05:53:13.511622+0000","last_fullsized":"2024-09-17T05:53:13.511622+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:53:13.511622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:53:13.511622+0000","last_clean_scrub_stamp":"2024-09-17T05:53:13.511622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.2b","version":"0'0","reported_seq":13,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-17T05:53:15.528299+0000","last_change":"2024-09-17T05:53:14.546652+0000","last_active":"2024-09-17T05:53:15.528299+0000","last_peered":"2024-09-17T05:53:15.528299+0000","last_clean":"2024-09-17T05:53:15.528299+0000","last_became_active":"2024-09-17T05:53:14.546032+0000","last_became_peered":"2024-09-17T05:53:14.546032+0000","last_unstale":"2024-09-17T05:53:15.528299+0000","last_undegraded":"2024-09-17T05:53:15.528299+0000","last_fullsized":"2024-09-17T05:53:15.528299+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:53:13.511622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:53:13.511622+0000","last_clean_scrub_stamp":"2024-09-17T05:53:13.511622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:39:23.674754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:53:13.511622+0000","last_change":"2024-09-17T05:53:13.511622+0000","last_active":"2024-09-17T05:53:13.511622+0000","last_peered":"2024-09-17T05:53:13.511622+0000","last_clean":"2024-09-17T05:53:13.511622+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:53:13.511622+0000","last_undegraded":"2024-09-17T05:53:13.511622+0000","last_fullsized":"2024-09-17T05:53:13.511622+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:53:13.511622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:53:13.511622+0000","last_clean_scrub_stamp":"2024-09-17T05:53:13.511622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:53:13.511622+0000","last_change":"2024-09-17T05:53:13.511622+0000","last_active":"2024-09-17T05:53:13.511622+0000","last_peered":"2024-09-17T05:53:13.511622+0000","last_clean":"2024-09-17T05:53:13.511622+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:53:13.511622+0000","last_undegraded":"2024-09-17T05:53:13.511622+0000","last_fullsized":"2024-09-17T05:53:13.511622+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:53:13.511622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:53:13.511622+0000","last_clean_scrub_stamp":"2024-09-17T05:53:13.511622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.28","version":"0'0","reported_seq":13,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-17T05:53:15.527650+0000","last_change":"2024-09-17T05:53:14.547009+0000","last_active":"2024-09-17T05:53:15.527650+0000","last_peered":"2024-09-17T05:53:15.527650+0000","last_clean":"2024-09-17T05:53:15.527650+0000","last_became_active":"2024-09-17T05:53:14.546691+0000","last_became_peered":"2024-09-17T05:53:14.546691+0000","last_unstale":"2024-09-17T05:53:15.527650+0000","last_undegraded":"2024-09-17T05:53:15.527650+0000","last_fullsized":"2024-09-17T05:53:15.527650+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:53:13.511622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:53:13.511622+0000","last_clean_scrub_stamp":"2024-09-17T05:53:13.511622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:07:35.487105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:53:13.511622+0000","last_change":"2024-09-17T05:53:13.511622+0000","last_active":"2024-09-17T05:53:13.511622+0000","last_peered":"2024-09-17T05:53:13.511622+0000","last_clean":"2024-09-17T05:53:13.511622+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:53:13.511622+0000","last_undegraded":"2024-09-17T05:53:13.511622+0000","last_fullsized":"2024-09-17T05:53:13.511622+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:53:13.511622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:53:13.511622+0000","last_clean_scrub_stamp":"2024-09-17T05:53:13.511622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:53:13.511622+0000","last_change":"2024-09-17T05:53:13.511622+0000","last_active":"2024-09-17T05:53:13.511622+0000","last_peered":"2024-09-17T05:53:13.511622+0000","last_clean":"2024-09-17T05:53:13.511622+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:53:13.511622+0000","last_undegraded":"2024-09-17T05:53:13.511622+0000","last_fullsized":"2024-09-17T05:53:13.511622+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:53:13.511622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:53:13.511622+0000","last_clean_scrub_stamp":"2024-09-17T05:53:13.511622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:53:13.511622+0000","last_change":"2024-09-17T05:53:13.511622+0000","last_active":"2024-09-17T05:53:13.511622+0000","last_peered":"2024-09-17T05:53:13.511622+0000","last_clean":"2024-09-17T05:53:13.511622+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:53:13.511622+0000","last_undegraded":"2024-09-17T05:53:13.511622+0000","last_fullsized":"2024-09-17T05:53:13.511622+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:53:13.511622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:53:13.511622+0000","last_clean_scrub_stamp":"2024-09-17T05:53:13.511622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.24","version":"0'0","reported_seq":1,"reported_epoch":139,"state":"creating+peering","last_fresh":"2024-09-17T05:53:13.528051+0000","last_change":"2024-09-17T05:53:13.528051+0000","last_active":"2024-09-17T05:53:13.511622+0000","last_peered":"2024-09-17T05:53:13.511622+0000","last_clean":"2024-09-17T05:53:13.511622+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:53:13.528051+0000","last_undegraded":"2024-09-17T05:53:13.528051+0000","last_fullsized":"2024-09-17T05:53:13.528051+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:53:13.511622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:53:13.511622+0000","last_clean_scrub_stamp":"2024-09-17T05:53:13.511622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:53:13.511622+0000","last_change":"2024-09-17T05:53:13.511622+0000","last_active":"2024-09-17T05:53:13.511622+0000","last_peered":"2024-09-17T05:53:13.511622+0000","last_clean":"2024-09-17T05:53:13.511622+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:53:13.511622+0000","last_undegraded":"2024-09-17T05:53:13.511622+0000","last_fullsized":"2024-09-17T05:53:13.511622+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:53:13.511622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:53:13.511622+0000","last_clean_scrub_stamp":"2024-09-17T05:53:13.511622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:53:13.511622+0000","last_change":"2024-09-17T05:53:13.511622+0000","last_active":"2024-09-17T05:53:13.511622+0000","last_peered":"2024-09-17T05:53:13.511622+0000","last_clean":"2024-09-17T05:53:13.511622+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:53:13.511622+0000","last_undegraded":"2024-09-17T05:53:13.511622+0000","last_fullsized":"2024-09-17T05:53:13.511622+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:53:13.511622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:53:13.511622+0000","last_clean_scrub_stamp":"2024-09-17T05:53:13.511622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:53:13.511622+0000","last_change":"2024-09-17T05:53:13.511622+0000","last_active":"2024-09-17T05:53:13.511622+0000","last_peered":"2024-09-17T05:53:13.511622+0000","last_clean":"2024-09-17T05:53:13.511622+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:53:13.511622+0000","last_undegraded":"2024-09-17T05:53:13.511622+0000","last_fullsized":"2024-09-17T05:53:13.511622+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:53:13.511622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:53:13.511622+0000","last_clean_scrub_stamp":"2024-09-17T05:53:13.511622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:53:13.511622+0000","last_change":"2024-09-17T05:53:13.511622+0000","last_active":"2024-09-17T05:53:13.511622+0000","last_peered":"2024-09-17T05:53:13.511622+0000","last_clean":"2024-09-17T05:53:13.511622+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:53:13.511622+0000","last_undegraded":"2024-09-17T05:53:13.511622+0000","last_fullsized":"2024-09-17T05:53:13.511622+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:53:13.511622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:53:13.511622+0000","last_clean_scrub_stamp":"2024-09-17T05:53:13.511622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.1e","version":"0'0","reported_seq":13,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-17T05:53:15.527757+0000","last_change":"2024-09-17T05:53:14.548181+0000","last_active":"2024-09-17T05:53:15.527757+0000","last_peered":"2024-09-17T05:53:15.527757+0000","last_clean":"2024-09-17T05:53:15.527757+0000","last_became_active":"2024-09-17T05:53:14.547859+0000","last_became_peered":"2024-09-17T05:53:14.547859+0000","last_unstale":"2024-09-17T05:53:15.527757+0000","last_undegraded":"2024-09-17T05:53:15.527757+0000","last_fullsized":"2024-09-17T05:53:15.527757+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:53:13.511622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:53:13.511622+0000","last_clean_scrub_stamp":"2024-09-17T05:53:13.511622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:17:09.456622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.1f","version":"140'4","reported_seq":19,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-17T05:53:15.528586+0000","last_change":"2024-09-17T05:53:13.539463+0000","last_active":"2024-09-17T05:53:15.528586+0000","last_peered":"2024-09-17T05:53:15.528586+0000","last_clean":"2024-09-17T05:53:15.528586+0000","last_became_active":"2024-09-17T05:53:13.538767+0000","last_became_peered":"2024-09-17T05:53:13.538767+0000","last_unstale":"2024-09-17T05:53:15.528586+0000","last_undegraded":"2024-09-17T05:53:15.528586+0000","last_fullsized":"2024-09-17T05:53:15.528586+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:53:12.509392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:53:12.509392+0000","last_clean_scrub_stamp":"2024-09-17T05:53:12.509392+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:26:51.175390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:53:13.511622+0000","last_change":"2024-09-17T05:53:13.511622+0000","last_active":"2024-09-17T05:53:13.511622+0000","last_peered":"2024-09-17T05:53:13.511622+0000","last_clean":"2024-09-17T05:53:13.511622+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:53:13.511622+0000","last_undegraded":"2024-09-17T05:53:13.511622+0000","last_fullsized":"2024-09-17T05:53:13.511622+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:53:13.511622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:53:13.511622+0000","last_clean_scrub_stamp":"2024-09-17T05:53:13.511622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.1e","version":"0'0","reported_seq":1,"reported_epoch":138,"state":"creating+peering","last_fresh":"2024-09-17T05:53:12.519409+0000","last_change":"2024-09-17T05:53:12.519409+0000","last_active":"2024-09-17T05:53:12.509392+0000","last_peered":"2024-09-17T05:53:12.509392+0000","last_clean":"2024-09-17T05:53:12.509392+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:53:12.519409+0000","last_undegraded":"2024-09-17T05:53:12.519409+0000","last_fullsized":"2024-09-17T05:53:12.519409+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:53:12.509392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:53:12.509392+0000","last_clean_scrub_stamp":"2024-09-17T05:53:12.509392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:53:13.511622+0000","last_change":"2024-09-17T05:53:13.511622+0000","last_active":"2024-09-17T05:53:13.511622+0000","last_peered":"2024-09-17T05:53:13.511622+0000","last_clean":"2024-09-17T05:53:13.511622+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:53:13.511622+0000","last_undegraded":"2024-09-17T05:53:13.511622+0000","last_fullsized":"2024-09-17T05:53:13.511622+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:53:13.511622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:53:13.511622+0000","last_clean_scrub_stamp":"2024-09-17T05:53:13.511622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:53:12.509392+0000","last_change":"2024-09-17T05:53:12.509392+0000","last_active":"2024-09-17T05:53:12.509392+0000","last_peered":"2024-09-17T05:53:12.509392+0000","last_clean":"2024-09-17T05:53:12.509392+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:53:12.509392+0000","last_undegraded":"2024-09-17T05:53:12.509392+0000","last_fullsized":"2024-09-17T05:53:12.509392+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:53:12.509392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:53:12.509392+0000","last_clean_scrub_stamp":"2024-09-17T05:53:12.509392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.1d","version":"0'0","reported_seq":13,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-17T05:53:15.528652+0000","last_change":"2024-09-17T05:53:14.554059+0000","last_active":"2024-09-17T05:53:15.528652+0000","last_peered":"2024-09-17T05:53:15.528652+0000","last_clean":"2024-09-17T05:53:15.528652+0000","last_became_active":"2024-09-17T05:53:14.553753+0000","last_became_peered":"2024-09-17T05:53:14.553753+0000","last_unstale":"2024-09-17T05:53:15.528652+0000","last_undegraded":"2024-09-17T05:53:15.528652+0000","last_fullsized":"2024-09-17T05:53:15.528652+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:53:13.511622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:53:13.511622+0000","last_clean_scrub_stamp":"2024-09-17T05:53:13.511622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:58:54.333486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:53:12.509392+0000","last_change":"2024-09-17T05:53:12.509392+0000","last_active":"2024-09-17T05:53:12.509392+0000","last_peered":"2024-09-17T05:53:12.509392+0000","last_clean":"2024-09-17T05:53:12.509392+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:53:12.509392+0000","last_undegraded":"2024-09-17T05:53:12.509392+0000","last_fullsized":"2024-09-17T05:53:12.509392+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:53:12.509392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:53:12.509392+0000","last_clean_scrub_stamp":"2024-09-17T05:53:12.509392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:53:13.511622+0000","last_change":"2024-09-17T05:53:13.511622+0000","last_active":"2024-09-17T05:53:13.511622+0000","last_peered":"2024-09-17T05:53:13.511622+0000","last_clean":"2024-09-17T05:53:13.511622+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:53:13.511622+0000","last_undegraded":"2024-09-17T05:53:13.511622+0000","last_fullsized":"2024-09-17T05:53:13.511622+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:53:13.511622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:53:13.511622+0000","last_clean_scrub_stamp":"2024-09-17T05:53:13.511622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.1b","version":"0'0","reported_seq":1,"reported_epoch":138,"state":"creating+peering","last_fresh":"2024-09-17T05:53:12.514220+0000","last_change":"2024-09-17T05:53:12.514220+0000","last_active":"2024-09-17T05:53:12.509392+0000","last_peered":"2024-09-17T05:53:12.509392+0000","last_clean":"2024-09-17T05:53:12.509392+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:53:12.514220+0000","last_undegraded":"2024-09-17T05:53:12.514220+0000","last_fullsized":"2024-09-17T05:53:12.514220+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:53:12.509392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:53:12.509392+0000","last_clean_scrub_stamp":"2024-09-17T05:53:12.509392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:53:13.511622+0000","last_change":"2024-09-17T05:53:13.511622+0000","last_active":"2024-09-17T05:53:13.511622+0000","last_peered":"2024-09-17T05:53:13.511622+0000","last_clean":"2024-09-17T05:53:13.511622+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:53:13.511622+0000","last_undegraded":"2024-09-17T05:53:13.511622+0000","last_fullsized":"2024-09-17T05:53:13.511622+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:53:13.511622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:53:13.511622+0000","last_clean_scrub_stamp":"2024-09-17T05:53:13.511622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.1a","version":"140'1","reported_seq":16,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-17T05:53:16.571986+0000","last_change":"2024-09-17T05:53:13.534883+0000","last_active":"2024-09-17T05:53:16.571986+0000","last_peered":"2024-09-17T05:53:16.571986+0000","last_clean":"2024-09-17T05:53:16.571986+0000","last_became_active":"2024-09-17T05:53:13.534547+0000","last_became_peered":"2024-09-17T05:53:13.534547+0000","last_unstale":"2024-09-17T05:53:16.571986+0000","last_undegraded":"2024-09-17T05:53:16.571986+0000","last_fullsized":"2024-09-17T05:53:16.571986+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:53:12.509392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:53:12.509392+0000","last_clean_scrub_stamp":"2024-09-17T05:53:12.509392+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:24:20.737152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:53:13.511622+0000","last_change":"2024-09-17T05:53:13.511622+0000","last_active":"2024-09-17T05:53:13.511622+0000","last_peered":"2024-09-17T05:53:13.511622+0000","last_clean":"2024-09-17T05:53:13.511622+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:53:13.511622+0000","last_undegraded":"2024-09-17T05:53:13.511622+0000","last_fullsized":"2024-09-17T05:53:13.511622+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:53:13.511622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:53:13.511622+0000","last_clean_scrub_stamp":"2024-09-17T05:53:13.511622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.19","version":"0'0","reported_seq":1,"reported_epoch":138,"state":"creating+peering","last_fresh":"2024-09-17T05:53:12.514359+0000","last_change":"2024-09-17T05:53:12.514359+0000","last_active":"2024-09-17T05:53:12.509392+0000","last_peered":"2024-09-17T05:53:12.509392+0000","last_clean":"2024-09-17T05:53:12.509392+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:53:12.514359+0000","last_undegraded":"2024-09-17T05:53:12.514359+0000","last_fullsized":"2024-09-17T05:53:12.514359+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:53:12.509392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:53:12.509392+0000","last_clean_scrub_stamp":"2024-09-17T05:53:12.509392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.19","version":"0'0","reported_seq":13,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-17T05:53:16.572391+0000","last_change":"2024-09-17T05:53:14.537974+0000","last_active":"2024-09-17T05:53:16.572391+0000","last_peered":"2024-09-17T05:53:16.572391+0000","last_clean":"2024-09-17T05:53:16.572391+0000","last_became_active":"2024-09-17T05:53:14.537611+0000","last_became_peered":"2024-09-17T05:53:14.537611+0000","last_unstale":"2024-09-17T05:53:16.572391+0000","last_undegraded":"2024-09-17T05:53:16.572391+0000","last_fullsized":"2024-09-17T05:53:16.572391+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:53:13.511622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:53:13.511622+0000","last_clean_scrub_stamp":"2024-09-17T05:53:13.511622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:38:57.194890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:53:12.509392+0000","last_change":"2024-09-17T05:53:12.509392+0000","last_active":"2024-09-17T05:53:12.509392+0000","last_peered":"2024-09-17T05:53:12.509392+0000","last_clean":"2024-09-17T05:53:12.509392+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:53:12.509392+0000","last_undegraded":"2024-09-17T05:53:12.509392+0000","last_fullsized":"2024-09-17T05:53:12.509392+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:53:12.509392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:53:12.509392+0000","last_clean_scrub_stamp":"2024-09-17T05:53:12.509392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.16","version":"0'0","reported_seq":13,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-17T05:53:16.572405+0000","last_change":"2024-09-17T05:53:14.542412+0000","last_active":"2024-09-17T05:53:16.572405+0000","last_peered":"2024-09-17T05:53:16.572405+0000","last_clean":"2024-09-17T05:53:16.572405+0000","last_became_active":"2024-09-17T05:53:14.541943+0000","last_became_peered":"2024-09-17T05:53:14.541943+0000","last_unstale":"2024-09-17T05:53:16.572405+0000","last_undegraded":"2024-09-17T05:53:16.572405+0000","last_fullsized":"2024-09-17T05:53:16.572405+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:53:13.511622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:53:13.511622+0000","last_clean_scrub_stamp":"2024-09-17T05:53:13.511622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:06:39.200488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.17","version":"0'0","reported_seq":1,"reported_epoch":138,"state":"creating+peering","last_fresh":"2024-09-17T05:53:12.518858+0000","last_change":"2024-09-17T05:53:12.518858+0000","last_active":"2024-09-17T05:53:12.509392+0000","last_peered":"2024-09-17T05:53:12.509392+0000","last_clean":"2024-09-17T05:53:12.509392+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:53:12.518858+0000","last_undegraded":"2024-09-17T05:53:12.518858+0000","last_fullsized":"2024-09-17T05:53:12.518858+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:53:12.509392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:53:12.509392+0000","last_clean_scrub_stamp":"2024-09-17T05:53:12.509392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.17","version":"0'0","reported_seq":13,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-17T05:53:15.528601+0000","last_change":"2024-09-17T05:53:14.555136+0000","last_active":"2024-09-17T05:53:15.528601+0000","last_peered":"2024-09-17T05:53:15.528601+0000","last_clean":"2024-09-17T05:53:15.528601+0000","last_became_active":"2024-09-17T05:53:14.554514+0000","last_became_peered":"2024-09-17T05:53:14.554514+0000","last_unstale":"2024-09-17T05:53:15.528601+0000","last_undegraded":"2024-09-17T05:53:15.528601+0000","last_fullsized":"2024-09-17T05:53:15.528601+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:53:13.511622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:53:13.511622+0000","last_clean_scrub_stamp":"2024-09-17T05:53:13.511622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:41:18.370466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.16","version":"0'0","reported_seq":15,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-17T05:53:15.528222+0000","last_change":"2024-09-17T05:53:13.534637+0000","last_active":"2024-09-17T05:53:15.528222+0000","last_peered":"2024-09-17T05:53:15.528222+0000","last_clean":"2024-09-17T05:53:15.528222+0000","last_became_active":"2024-09-17T05:53:13.534316+0000","last_became_peered":"2024-09-17T05:53:13.534316+0000","last_unstale":"2024-09-17T05:53:15.528222+0000","last_undegraded":"2024-09-17T05:53:15.528222+0000","last_fullsized":"2024-09-17T05:53:15.528222+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:53:12.509392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:53:12.509392+0000","last_clean_scrub_stamp":"2024-09-17T05:53:12.509392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:17:34.499459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:53:13.511622+0000","last_change":"2024-09-17T05:53:13.511622+0000","last_active":"2024-09-17T05:53:13.511622+0000","last_peered":"2024-09-17T05:53:13.511622+0000","last_clean":"2024-09-17T05:53:13.511622+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:53:13.511622+0000","last_undegraded":"2024-09-17T05:53:13.511622+0000","last_fullsized":"2024-09-17T05:53:13.511622+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:53:13.511622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:53:13.511622+0000","last_clean_scrub_stamp":"2024-09-17T05:53:13.511622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.14","version":"0'0","reported_seq":10,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-09-17T05:53:13.542150+0000","last_change":"2024-09-17T05:53:13.541151+0000","last_active":"2024-09-17T05:53:13.542150+0000","last_peered":"2024-09-17T05:53:13.542150+0000","last_clean":"2024-09-17T05:53:13.542150+0000","last_became_active":"2024-09-17T05:53:13.540717+0000","last_became_peered":"2024-09-17T05:53:13.540717+0000","last_unstale":"2024-09-17T05:53:13.542150+0000","last_undegraded":"2024-09-17T05:53:13.542150+0000","last_fullsized":"2024-09-17T05:53:13.542150+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:53:12.509392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:53:12.509392+0000","last_clean_scrub_stamp":"2024-09-17T05:53:12.509392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:54:36.994315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:53:13.511622+0000","last_change":"2024-09-17T05:53:13.511622+0000","last_active":"2024-09-17T05:53:13.511622+0000","last_peered":"2024-09-17T05:53:13.511622+0000","last_clean":"2024-09-17T05:53:13.511622+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:53:13.511622+0000","last_undegraded":"2024-09-17T05:53:13.511622+0000","last_fullsized":"2024-09-17T05:53:13.511622+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:53:13.511622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:53:13.511622+0000","last_clean_scrub_stamp":"2024-09-17T05:53:13.511622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.13","version":"0'0","reported_seq":1,"reported_epoch":138,"state":"creating+peering","last_fresh":"2024-09-17T05:53:12.516491+0000","last_change":"2024-09-17T05:53:12.516491+0000","last_active":"2024-09-17T05:53:12.509392+0000","last_peered":"2024-09-17T05:53:12.509392+0000","last_clean":"2024-09-17T05:53:12.509392+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:53:12.516491+0000","last_undegraded":"2024-09-17T05:53:12.516491+0000","last_fullsized":"2024-09-17T05:53:12.516491+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:53:12.509392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:53:12.509392+0000","last_clean_scrub_stamp":"2024-09-17T05:53:12.509392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:53:13.511622+0000","last_change":"2024-09-17T05:53:13.511622+0000","last_active":"2024-09-17T05:53:13.511622+0000","last_peered":"2024-09-17T05:53:13.511622+0000","last_clean":"2024-09-17T05:53:13.511622+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:53:13.511622+0000","last_undegraded":"2024-09-17T05:53:13.511622+0000","last_fullsized":"2024-09-17T05:53:13.511622+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:53:13.511622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:53:13.511622+0000","last_clean_scrub_stamp":"2024-09-17T05:53:13.511622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.12","version":"0'0","reported_seq":1,"reported_epoch":138,"state":"creating+peering","last_fresh":"2024-09-17T05:53:12.516394+0000","last_change":"2024-09-17T05:53:12.516394+0000","last_active":"2024-09-17T05:53:12.509392+0000","last_peered":"2024-09-17T05:53:12.509392+0000","last_clean":"2024-09-17T05:53:12.509392+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:53:12.516394+0000","last_undegraded":"2024-09-17T05:53:12.516394+0000","last_fullsized":"2024-09-17T05:53:12.516394+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:53:12.509392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:53:12.509392+0000","last_clean_scrub_stamp":"2024-09-17T05:53:12.509392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.10","version":"0'0","reported_seq":13,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-17T05:53:16.572253+0000","last_change":"2024-09-17T05:53:14.549168+0000","last_active":"2024-09-17T05:53:16.572253+0000","last_peered":"2024-09-17T05:53:16.572253+0000","last_clean":"2024-09-17T05:53:16.572253+0000","last_became_active":"2024-09-17T05:53:14.548829+0000","last_became_peered":"2024-09-17T05:53:14.548829+0000","last_unstale":"2024-09-17T05:53:16.572253+0000","last_undegraded":"2024-09-17T05:53:16.572253+0000","last_fullsized":"2024-09-17T05:53:16.572253+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:53:13.511622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:53:13.511622+0000","last_clean_scrub_stamp":"2024-09-17T05:53:13.511622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:48:29.849949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.11","version":"0'0","reported_seq":1,"reported_epoch":138,"state":"creating+peering","last_fresh":"2024-09-17T05:53:12.516984+0000","last_change":"2024-09-17T05:53:12.516984+0000","last_active":"2024-09-17T05:53:12.509392+0000","last_peered":"2024-09-17T05:53:12.509392+0000","last_clean":"2024-09-17T05:53:12.509392+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:53:12.516984+0000","last_undegraded":"2024-09-17T05:53:12.516984+0000","last_fullsized":"2024-09-17T05:53:12.516984+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:53:12.509392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:53:12.509392+0000","last_clean_scrub_stamp":"2024-09-17T05:53:12.509392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:53:13.511622+0000","last_change":"2024-09-17T05:53:13.511622+0000","last_active":"2024-09-17T05:53:13.511622+0000","last_peered":"2024-09-17T05:53:13.511622+0000","last_clean":"2024-09-17T05:53:13.511622+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:53:13.511622+0000","last_undegraded":"2024-09-17T05:53:13.511622+0000","last_fullsized":"2024-09-17T05:53:13.511622+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:53:13.511622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:53:13.511622+0000","last_clean_scrub_stamp":"2024-09-17T05:53:13.511622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.10","version":"0'0","reported_seq":1,"reported_epoch":138,"state":"creating+peering","last_fresh":"2024-09-17T05:53:12.514187+0000","last_change":"2024-09-17T05:53:12.514187+0000","last_active":"2024-09-17T05:53:12.509392+0000","last_peered":"2024-09-17T05:53:12.509392+0000","last_clean":"2024-09-17T05:53:12.509392+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:53:12.514187+0000","last_undegraded":"2024-09-17T05:53:12.514187+0000","last_fullsized":"2024-09-17T05:53:12.514187+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:53:12.509392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:53:12.509392+0000","last_clean_scrub_stamp":"2024-09-17T05:53:12.509392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.e","version":"0'0","reported_seq":13,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-17T05:53:15.528010+0000","last_change":"2024-09-17T05:53:14.548943+0000","last_active":"2024-09-17T05:53:15.528010+0000","last_peered":"2024-09-17T05:53:15.528010+0000","last_clean":"2024-09-17T05:53:15.528010+0000","last_became_active":"2024-09-17T05:53:14.547493+0000","last_became_peered":"2024-09-17T05:53:14.547493+0000","last_unstale":"2024-09-17T05:53:15.528010+0000","last_undegraded":"2024-09-17T05:53:15.528010+0000","last_fullsized":"2024-09-17T05:53:15.528010+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:53:13.511622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:53:13.511622+0000","last_clean_scrub_stamp":"2024-09-17T05:53:13.511622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:11:54.994505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.f","version":"140'1","reported_seq":16,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-17T05:53:16.572123+0000","last_change":"2024-09-17T05:53:13.538801+0000","last_active":"2024-09-17T05:53:16.572123+0000","last_peered":"2024-09-17T05:53:16.572123+0000","last_clean":"2024-09-17T05:53:16.572123+0000","last_became_active":"2024-09-17T05:53:13.538469+0000","last_became_peered":"2024-09-17T05:53:13.538469+0000","last_unstale":"2024-09-17T05:53:16.572123+0000","last_undegraded":"2024-09-17T05:53:16.572123+0000","last_fullsized":"2024-09-17T05:53:16.572123+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:53:12.509392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:53:12.509392+0000","last_clean_scrub_stamp":"2024-09-17T05:53:12.509392+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:33:19.361630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:53:13.511622+0000","last_change":"2024-09-17T05:53:13.511622+0000","last_active":"2024-09-17T05:53:13.511622+0000","last_peered":"2024-09-17T05:53:13.511622+0000","last_clean":"2024-09-17T05:53:13.511622+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:53:13.511622+0000","last_undegraded":"2024-09-17T05:53:13.511622+0000","last_fullsized":"2024-09-17T05:53:13.511622+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:53:13.511622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:53:13.511622+0000","last_clean_scrub_stamp":"2024-09-17T05:53:13.511622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.e","version":"0'0","reported_seq":1,"reported_epoch":138,"state":"creating+peering","last_fresh":"2024-09-17T05:53:12.518809+0000","last_change":"2024-09-17T05:53:12.518809+0000","last_active":"2024-09-17T05:53:12.509392+0000","last_peered":"2024-09-17T05:53:12.509392+0000","last_clean":"2024-09-17T05:53:12.509392+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:53:12.518809+0000","last_undegraded":"2024-09-17T05:53:12.518809+0000","last_fullsized":"2024-09-17T05:53:12.518809+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:53:12.509392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:53:12.509392+0000","last_clean_scrub_stamp":"2024-09-17T05:53:12.509392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:53:13.511622+0000","last_change":"2024-09-17T05:53:13.511622+0000","last_active":"2024-09-17T05:53:13.511622+0000","last_peered":"2024-09-17T05:53:13.511622+0000","last_clean":"2024-09-17T05:53:13.511622+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:53:13.511622+0000","last_undegraded":"2024-09-17T05:53:13.511622+0000","last_fullsized":"2024-09-17T05:53:13.511622+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:53:13.511622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:53:13.511622+0000","last_clean_scrub_stamp":"2024-09-17T05:53:13.511622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.d","version":"0'0","reported_seq":1,"reported_epoch":138,"state":"creating+peering","last_fresh":"2024-09-17T05:53:12.514221+0000","last_change":"2024-09-17T05:53:12.514221+0000","last_active":"2024-09-17T05:53:12.509392+0000","last_peered":"2024-09-17T05:53:12.509392+0000","last_clean":"2024-09-17T05:53:12.509392+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:53:12.514221+0000","last_undegraded":"2024-09-17T05:53:12.514221+0000","last_fullsized":"2024-09-17T05:53:12.514221+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:53:12.509392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:53:12.509392+0000","last_clean_scrub_stamp":"2024-09-17T05:53:12.509392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:53:13.511622+0000","last_change":"2024-09-17T05:53:13.511622+0000","last_active":"2024-09-17T05:53:13.511622+0000","last_peered":"2024-09-17T05:53:13.511622+0000","last_clean":"2024-09-17T05:53:13.511622+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:53:13.511622+0000","last_undegraded":"2024-09-17T05:53:13.511622+0000","last_fullsized":"2024-09-17T05:53:13.511622+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:53:13.511622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:53:13.511622+0000","last_clean_scrub_stamp":"2024-09-17T05:53:13.511622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.c","version":"0'0","reported_seq":1,"reported_epoch":138,"state":"creating+peering","last_fresh":"2024-09-17T05:53:12.518716+0000","last_change":"2024-09-17T05:53:12.518716+0000","last_active":"2024-09-17T05:53:12.509392+0000","last_peered":"2024-09-17T05:53:12.509392+0000","last_clean":"2024-09-17T05:53:12.509392+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:53:12.518716+0000","last_undegraded":"2024-09-17T05:53:12.518716+0000","last_fullsized":"2024-09-17T05:53:12.518716+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:53:12.509392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:53:12.509392+0000","last_clean_scrub_stamp":"2024-09-17T05:53:12.509392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:53:13.511622+0000","last_change":"2024-09-17T05:53:13.511622+0000","last_active":"2024-09-17T05:53:13.511622+0000","last_peered":"2024-09-17T05:53:13.511622+0000","last_clean":"2024-09-17T05:53:13.511622+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:53:13.511622+0000","last_undegraded":"2024-09-17T05:53:13.511622+0000","last_fullsized":"2024-09-17T05:53:13.511622+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:53:13.511622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:53:13.511622+0000","last_clean_scrub_stamp":"2024-09-17T05:53:13.511622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.b","version":"0'0","reported_seq":10,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-09-17T05:53:13.538312+0000","last_change":"2024-09-17T05:53:13.536538+0000","last_active":"2024-09-17T05:53:13.538312+0000","last_peered":"2024-09-17T05:53:13.538312+0000","last_clean":"2024-09-17T05:53:13.538312+0000","last_became_active":"2024-09-17T05:53:13.536195+0000","last_became_peered":"2024-09-17T05:53:13.536195+0000","last_unstale":"2024-09-17T05:53:13.538312+0000","last_undegraded":"2024-09-17T05:53:13.538312+0000","last_fullsized":"2024-09-17T05:53:13.538312+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:53:12.509392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:53:12.509392+0000","last_clean_scrub_stamp":"2024-09-17T05:53:12.509392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:49:58.949468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.b","version":"0'0","reported_seq":1,"reported_epoch":139,"state":"creating+peering","last_fresh":"2024-09-17T05:53:13.528919+0000","last_change":"2024-09-17T05:53:13.528919+0000","last_active":"2024-09-17T05:53:13.511622+0000","last_peered":"2024-09-17T05:53:13.511622+0000","last_clean":"2024-09-17T05:53:13.511622+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:53:13.528919+0000","last_undegraded":"2024-09-17T05:53:13.528919+0000","last_fullsized":"2024-09-17T05:53:13.528919+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:53:13.511622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:53:13.511622+0000","last_clean_scrub_stamp":"2024-09-17T05:53:13.511622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.a","version":"0'0","reported_seq":15,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-17T05:53:15.527504+0000","last_change":"2024-09-17T05:53:13.539072+0000","last_active":"2024-09-17T05:53:15.527504+0000","last_peered":"2024-09-17T05:53:15.527504+0000","last_clean":"2024-09-17T05:53:15.527504+0000","last_became_active":"2024-09-17T05:53:13.538503+0000","last_became_peered":"2024-09-17T05:53:13.538503+0000","last_unstale":"2024-09-17T05:53:15.527504+0000","last_undegraded":"2024-09-17T05:53:15.527504+0000","last_fullsized":"2024-09-17T05:53:15.527504+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:53:12.509392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:53:12.509392+0000","last_clean_scrub_stamp":"2024-09-17T05:53:12.509392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:17:17.870202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:53:13.511622+0000","last_change":"2024-09-17T05:53:13.511622+0000","last_active":"2024-09-17T05:53:13.511622+0000","last_peered":"2024-09-17T05:53:13.511622+0000","last_clean":"2024-09-17T05:53:13.511622+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:53:13.511622+0000","last_undegraded":"2024-09-17T05:53:13.511622+0000","last_fullsized":"2024-09-17T05:53:13.511622+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:53:13.511622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:53:13.511622+0000","last_clean_scrub_stamp":"2024-09-17T05:53:13.511622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.9","version":"0'0","reported_seq":15,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-17T05:53:15.528312+0000","last_change":"2024-09-17T05:53:13.539530+0000","last_active":"2024-09-17T05:53:15.528312+0000","last_peered":"2024-09-17T05:53:15.528312+0000","last_clean":"2024-09-17T05:53:15.528312+0000","last_became_active":"2024-09-17T05:53:13.539215+0000","last_became_peered":"2024-09-17T05:53:13.539215+0000","last_unstale":"2024-09-17T05:53:15.528312+0000","last_undegraded":"2024-09-17T05:53:15.528312+0000","last_fullsized":"2024-09-17T05:53:15.528312+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:53:12.509392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:53:12.509392+0000","last_clean_scrub_stamp":"2024-09-17T05:53:12.509392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:51:24.706974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.9","version":"0'0","reported_seq":1,"reported_epoch":139,"state":"creating+peering","last_fresh":"2024-09-17T05:53:13.528602+0000","last_change":"2024-09-17T05:53:13.528602+0000","last_active":"2024-09-17T05:53:13.511622+0000","last_peered":"2024-09-17T05:53:13.511622+0000","last_clean":"2024-09-17T05:53:13.511622+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:53:13.528602+0000","last_undegraded":"2024-09-17T05:53:13.528602+0000","last_fullsized":"2024-09-17T05:53:13.528602+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:53:13.511622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:53:13.511622+0000","last_clean_scrub_stamp":"2024-09-17T05:53:13.511622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.8","version":"0'0","reported_seq":1,"reported_epoch":138,"state":"creating+peering","last_fresh":"2024-09-17T05:53:12.516694+0000","last_change":"2024-09-17T05:53:12.516694+0000","last_active":"2024-09-17T05:53:12.509392+0000","last_peered":"2024-09-17T05:53:12.509392+0000","last_clean":"2024-09-17T05:53:12.509392+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:53:12.516694+0000","last_undegraded":"2024-09-17T05:53:12.516694+0000","last_fullsized":"2024-09-17T05:53:12.516694+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:53:12.509392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:53:12.509392+0000","last_clean_scrub_stamp":"2024-09-17T05:53:12.509392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.6","version":"0'0","reported_seq":13,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-17T05:53:16.572412+0000","last_change":"2024-09-17T05:53:14.549803+0000","last_active":"2024-09-17T05:53:16.572412+0000","last_peered":"2024-09-17T05:53:16.572412+0000","last_clean":"2024-09-17T05:53:16.572412+0000","last_became_active":"2024-09-17T05:53:14.549429+0000","last_became_peered":"2024-09-17T05:53:14.549429+0000","last_unstale":"2024-09-17T05:53:16.572412+0000","last_undegraded":"2024-09-17T05:53:16.572412+0000","last_fullsized":"2024-09-17T05:53:16.572412+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:53:13.511622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:53:13.511622+0000","last_clean_scrub_stamp":"2024-09-17T05:53:13.511622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:11:59.457461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.7","version":"140'2","reported_seq":17,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-17T05:53:15.529063+0000","last_change":"2024-09-17T05:53:13.541601+0000","last_active":"2024-09-17T05:53:15.529063+0000","last_peered":"2024-09-17T05:53:15.529063+0000","last_clean":"2024-09-17T05:53:15.529063+0000","last_became_active":"2024-09-17T05:53:13.541201+0000","last_became_peered":"2024-09-17T05:53:13.541201+0000","last_unstale":"2024-09-17T05:53:15.529063+0000","last_undegraded":"2024-09-17T05:53:15.529063+0000","last_fullsized":"2024-09-17T05:53:15.529063+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:53:12.509392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:53:12.509392+0000","last_clean_scrub_stamp":"2024-09-17T05:53:12.509392+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:58:54.719539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:53:13.511622+0000","last_change":"2024-09-17T05:53:13.511622+0000","last_active":"2024-09-17T05:53:13.511622+0000","last_peered":"2024-09-17T05:53:13.511622+0000","last_clean":"2024-09-17T05:53:13.511622+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:53:13.511622+0000","last_undegraded":"2024-09-17T05:53:13.511622+0000","last_fullsized":"2024-09-17T05:53:13.511622+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:53:13.511622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:53:13.511622+0000","last_clean_scrub_stamp":"2024-09-17T05:53:13.511622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.6","version":"0'0","reported_seq":1,"reported_epoch":138,"state":"creating+peering","last_fresh":"2024-09-17T05:53:12.517509+0000","last_change":"2024-09-17T05:53:12.517509+0000","last_active":"2024-09-17T05:53:12.509392+0000","last_peered":"2024-09-17T05:53:12.509392+0000","last_clean":"2024-09-17T05:53:12.509392+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:53:12.517509+0000","last_undegraded":"2024-09-17T05:53:12.517509+0000","last_fullsized":"2024-09-17T05:53:12.517509+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:53:12.509392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:53:12.509392+0000","last_clean_scrub_stamp":"2024-09-17T05:53:12.509392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:53:13.511622+0000","last_change":"2024-09-17T05:53:13.511622+0000","last_active":"2024-09-17T05:53:13.511622+0000","last_peered":"2024-09-17T05:53:13.511622+0000","last_clean":"2024-09-17T05:53:13.511622+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:53:13.511622+0000","last_undegraded":"2024-09-17T05:53:13.511622+0000","last_fullsized":"2024-09-17T05:53:13.511622+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:53:13.511622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:53:13.511622+0000","last_clean_scrub_stamp":"2024-09-17T05:53:13.511622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.5","version":"0'0","reported_seq":1,"reported_epoch":138,"state":"creating+peering","last_fresh":"2024-09-17T05:53:12.516944+0000","last_change":"2024-09-17T05:53:12.516944+0000","last_active":"2024-09-17T05:53:12.509392+0000","last_peered":"2024-09-17T05:53:12.509392+0000","last_clean":"2024-09-17T05:53:12.509392+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:53:12.516944+0000","last_undegraded":"2024-09-17T05:53:12.516944+0000","last_fullsized":"2024-09-17T05:53:12.516944+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:53:12.509392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:53:12.509392+0000","last_clean_scrub_stamp":"2024-09-17T05:53:12.509392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:53:13.511622+0000","last_change":"2024-09-17T05:53:13.511622+0000","last_active":"2024-09-17T05:53:13.511622+0000","last_peered":"2024-09-17T05:53:13.511622+0000","last_clean":"2024-09-17T05:53:13.511622+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:53:13.511622+0000","last_undegraded":"2024-09-17T05:53:13.511622+0000","last_fullsized":"2024-09-17T05:53:13.511622+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:53:13.511622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:53:13.511622+0000","last_clean_scrub_stamp":"2024-09-17T05:53:13.511622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.4","version":"0'0","reported_seq":1,"reported_epoch":138,"state":"creating+peering","last_fresh":"2024-09-17T05:53:12.516971+0000","last_change":"2024-09-17T05:53:12.516971+0000","last_active":"2024-09-17T05:53:12.509392+0000","last_peered":"2024-09-17T05:53:12.509392+0000","last_clean":"2024-09-17T05:53:12.509392+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:53:12.516971+0000","last_undegraded":"2024-09-17T05:53:12.516971+0000","last_fullsized":"2024-09-17T05:53:12.516971+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:53:12.509392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:53:12.509392+0000","last_clean_scrub_stamp":"2024-09-17T05:53:12.509392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:53:13.511622+0000","last_change":"2024-09-17T05:53:13.511622+0000","last_active":"2024-09-17T05:53:13.511622+0000","last_peered":"2024-09-17T05:53:13.511622+0000","last_clean":"2024-09-17T05:53:13.511622+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:53:13.511622+0000","last_undegraded":"2024-09-17T05:53:13.511622+0000","last_fullsized":"2024-09-17T05:53:13.511622+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:53:13.511622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:53:13.511622+0000","last_clean_scrub_stamp":"2024-09-17T05:53:13.511622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.3","version":"0'0","reported_seq":10,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-09-17T05:53:13.535257+0000","last_change":"2024-09-17T05:53:13.534284+0000","last_active":"2024-09-17T05:53:13.535257+0000","last_peered":"2024-09-17T05:53:13.535257+0000","last_clean":"2024-09-17T05:53:13.535257+0000","last_became_active":"2024-09-17T05:53:13.533933+0000","last_became_peered":"2024-09-17T05:53:13.533933+0000","last_unstale":"2024-09-17T05:53:13.535257+0000","last_undegraded":"2024-09-17T05:53:13.535257+0000","last_fullsized":"2024-09-17T05:53:13.535257+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:53:12.509392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:53:12.509392+0000","last_clean_scrub_stamp":"2024-09-17T05:53:12.509392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:26:31.492927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.3","version":"0'0","reported_seq":13,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-17T05:53:16.572509+0000","last_change":"2024-09-17T05:53:14.538521+0000","last_active":"2024-09-17T05:53:16.572509+0000","last_peered":"2024-09-17T05:53:16.572509+0000","last_clean":"2024-09-17T05:53:16.572509+0000","last_became_active":"2024-09-17T05:53:14.538059+0000","last_became_peered":"2024-09-17T05:53:14.538059+0000","last_unstale":"2024-09-17T05:53:16.572509+0000","last_undegraded":"2024-09-17T05:53:16.572509+0000","last_fullsized":"2024-09-17T05:53:16.572509+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:53:13.511622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:53:13.511622+0000","last_clean_scrub_stamp":"2024-09-17T05:53:13.511622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:06:01.140596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.2","version":"0'0","reported_seq":15,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-17T05:53:15.527619+0000","last_change":"2024-09-17T05:53:13.541556+0000","last_active":"2024-09-17T05:53:15.527619+0000","last_peered":"2024-09-17T05:53:15.527619+0000","last_clean":"2024-09-17T05:53:15.527619+0000","last_became_active":"2024-09-17T05:53:13.540985+0000","last_became_peered":"2024-09-17T05:53:13.540985+0000","last_unstale":"2024-09-17T05:53:15.527619+0000","last_undegraded":"2024-09-17T05:53:15.527619+0000","last_fullsized":"2024-09-17T05:53:15.527619+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:53:12.509392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:53:12.509392+0000","last_clean_scrub_stamp":"2024-09-17T05:53:12.509392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:59:32.172184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.0","version":"0'0","reported_seq":13,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-17T05:53:15.527867+0000","last_change":"2024-09-17T05:53:14.553791+0000","last_active":"2024-09-17T05:53:15.527867+0000","last_peered":"2024-09-17T05:53:15.527867+0000","last_clean":"2024-09-17T05:53:15.527867+0000","last_became_active":"2024-09-17T05:53:14.552645+0000","last_became_peered":"2024-09-17T05:53:14.552645+0000","last_unstale":"2024-09-17T05:53:15.527867+0000","last_undegraded":"2024-09-17T05:53:15.527867+0000","last_fullsized":"2024-09-17T05:53:15.527867+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:53:13.511622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:53:13.511622+0000","last_clean_scrub_stamp":"2024-09-17T05:53:13.511622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:17:37.335559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.1","version":"0'0","reported_seq":1,"reported_epoch":138,"state":"creating+peering","last_fresh":"2024-09-17T05:53:12.517785+0000","last_change":"2024-09-17T05:53:12.517785+0000","last_active":"2024-09-17T05:53:12.509392+0000","last_peered":"2024-09-17T05:53:12.509392+0000","last_clean":"2024-09-17T05:53:12.509392+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:53:12.517785+0000","last_undegraded":"2024-09-17T05:53:12.517785+0000","last_fullsized":"2024-09-17T05:53:12.517785+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:53:12.509392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:53:12.509392+0000","last_clean_scrub_stamp":"2024-09-17T05:53:12.509392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.1","version":"0'0","reported_seq":13,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-17T05:53:16.572259+0000","last_change":"2024-09-17T05:53:14.536337+0000","last_active":"2024-09-17T05:53:16.572259+0000","last_peered":"2024-09-17T05:53:16.572259+0000","last_clean":"2024-09-17T05:53:16.572259+0000","last_became_active":"2024-09-17T05:53:14.535962+0000","last_became_peered":"2024-09-17T05:53:14.535962+0000","last_unstale":"2024-09-17T05:53:16.572259+0000","last_undegraded":"2024-09-17T05:53:16.572259+0000","last_fullsized":"2024-09-17T05:53:16.572259+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:53:13.511622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:53:13.511622+0000","last_clean_scrub_stamp":"2024-09-17T05:53:13.511622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:12:43.179255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.0","version":"0'0","reported_seq":1,"reported_epoch":138,"state":"creating+peering","last_fresh":"2024-09-17T05:53:12.519815+0000","last_change":"2024-09-17T05:53:12.519815+0000","last_active":"2024-09-17T05:53:12.509392+0000","last_peered":"2024-09-17T05:53:12.509392+0000","last_clean":"2024-09-17T05:53:12.509392+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:53:12.519815+0000","last_undegraded":"2024-09-17T05:53:12.519815+0000","last_fullsized":"2024-09-17T05:53:12.519815+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:53:12.509392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:53:12.509392+0000","last_clean_scrub_stamp":"2024-09-17T05:53:12.509392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.14","version":"0'0","reported_seq":1,"reported_epoch":139,"state":"creating+peering","last_fresh":"2024-09-17T05:53:13.527612+0000","last_change":"2024-09-17T05:53:13.527612+0000","last_active":"2024-09-17T05:53:13.511622+0000","last_peered":"2024-09-17T05:53:13.511622+0000","last_clean":"2024-09-17T05:53:13.511622+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:53:13.527612+0000","last_undegraded":"2024-09-17T05:53:13.527612+0000","last_fullsized":"2024-09-17T05:53:13.527612+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:53:13.511622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:53:13.511622+0000","last_clean_scrub_stamp":"2024-09-17T05:53:13.511622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.15","version":"0'0","reported_seq":1,"reported_epoch":138,"state":"creating+peering","last_fresh":"2024-09-17T05:53:12.517048+0000","last_change":"2024-09-17T05:53:12.517048+0000","last_active":"2024-09-17T05:53:12.509392+0000","last_peered":"2024-09-17T05:53:12.509392+0000","last_clean":"2024-09-17T05:53:12.509392+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:53:12.517048+0000","last_undegraded":"2024-09-17T05:53:12.517048+0000","last_fullsized":"2024-09-17T05:53:12.517048+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:53:12.509392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:53:12.509392+0000","last_clean_scrub_stamp":"2024-09-17T05:53:12.509392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"19'72","reported_seq":328,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-17T05:53:15.528005+0000","last_change":"2024-09-17T05:41:48.539830+0000","last_active":"2024-09-17T05:53:15.528005+0000","last_peered":"2024-09-17T05:53:15.528005+0000","last_clean":"2024-09-17T05:53:15.528005+0000","last_became_active":"2024-09-17T05:41:48.538743+0000","last_became_peered":"2024-09-17T05:41:48.538743+0000","last_unstale":"2024-09-17T05:53:15.528005+0000","last_undegraded":"2024-09-17T05:53:15.528005+0000","last_fullsized":"2024-09-17T05:53:15.528005+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:47.152539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:47.152539+0000","last_clean_scrub_stamp":"2024-09-17T05:41:47.152539+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:08:02.952016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":21,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":48,"acting":48,"num_store_stats":3},{"poolid":20,"num_pg":32,"stat_sum":{"num_bytes":604,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":674,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":8,"ondisk_log_size":8,"up":58,"acting":58,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":16,"seq":68719476878,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":145256,"kb_used_data":1680,"kb_used_omap":1,"kb_used_meta":143550,"kb_avail":94226584,"statfs":{"total":96636764160,"available":96488022016,"internally_reserved":0,"allocated":1720320,"data_stored":757502,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":146995654},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":15,"seq":64424509583,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":119512,"kb_used_data":2304,"kb_used_omap":1,"kb_used_meta":117182,"kb_avail":94252328,"statfs":{"total":96636764160,"available":96514383872,"internally_reserved":0,"allocated":2359296,"data_stored":1368460,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":119994826},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509582,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":131396,"kb_used_data":1708,"kb_used_omap":1,"kb_used_meta":129662,"kb_avail":94240444,"statfs":{"total":96636764160,"available":96502214656,"internally_reserved":0,"allocated":1748992,"data_stored":770966,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":132774341},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509581,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":141092,"kb_used_data":1668,"kb_used_omap":1,"kb_used_meta":139390,"kb_avail":94230748,"statfs":{"total":96636764160,"available":96492285952,"internally_reserved":0,"allocated":1708032,"data_stored":751489,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":142735813},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509581,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":123044,"kb_used_data":1680,"kb_used_omap":1,"kb_used_meta":121342,"kb_avail":94248796,"statfs":{"total":96636764160,"available":96510767104,"internally_reserved":0,"allocated":1720320,"data_stored":757502,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":124254663},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509581,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":141092,"kb_used_data":1680,"kb_used_omap":1,"kb_used_meta":139390,"kb_avail":94230748,"statfs":{"total":96636764160,"available":96492285952,"internally_reserved":0,"allocated":1720320,"data_stored":757502,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":142735813},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509581,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":145252,"kb_used_data":1680,"kb_used_omap":1,"kb_used_meta":143550,"kb_avail":94226588,"statfs":{"total":96636764160,"available":96488026112,"internally_reserved":0,"allocated":1720320,"data_stored":757502,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":146995653},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574989,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":123628,"kb_used_data":2260,"kb_used_omap":1,"kb_used_meta":121342,"kb_avail":94248212,"statfs":{"total":96636764160,"available":96510169088,"internally_reserved":0,"allocated":2314240,"data_stored":1347870,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":124254661},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-17T05:53:22.013 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-17T05:53:22.141 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:22.139+0000 7fea94ece640 1 -- 172.21.15.150:0/3184815406 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fea900b4110 msgr2=0x7fea9006fe70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:53:22.141 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:22.139+0000 7fea94ece640 1 --2- 172.21.15.150:0/3184815406 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fea900b4110 0x7fea9006fe70 secure :-1 s=READY pgs=1853 cs=0 l=1 rev1=1 crypto rx=0x7fea9006dd20 tx=0x7fea8802b880 comp rx=0 tx=0).stop 2024-09-17T05:53:22.141 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:22.139+0000 7fea94ece640 1 -- 172.21.15.150:0/3184815406 shutdown_connections 2024-09-17T05:53:22.141 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:22.139+0000 7fea94ece640 1 --2- 172.21.15.150:0/3184815406 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fea900b4110 0x7fea9006fe70 unknown :-1 s=CLOSED pgs=1853 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:53:22.141 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:22.139+0000 7fea94ece640 1 --2- 172.21.15.150:0/3184815406 >> v2:172.21.15.176:3300/0 conn(0x7fea900707b0 0x7fea9006f930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:53:22.141 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:22.139+0000 7fea94ece640 1 -- 172.21.15.150:0/3184815406 >> 172.21.15.150:0/3184815406 conn(0x7fea9006d730 msgr2=0x7fea900b1e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:53:22.141 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:22.139+0000 7fea94ece640 1 -- 172.21.15.150:0/3184815406 shutdown_connections 2024-09-17T05:53:22.141 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:22.139+0000 7fea94ece640 1 -- 172.21.15.150:0/3184815406 wait complete. 2024-09-17T05:53:22.142 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:22.141+0000 7fea94ece640 1 Processor -- start 2024-09-17T05:53:22.142 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:22.141+0000 7fea94ece640 1 -- start start 2024-09-17T05:53:22.145 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:22.142+0000 7fea94ece640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fea900707b0 0x7fea9014fc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:53:22.145 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:22.142+0000 7fea94ece640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fea900730b0 0x7fea9014ce10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:53:22.145 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:22.142+0000 7fea94ece640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fea900b4110 0x7fea901f5c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:53:22.146 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:22.142+0000 7fea94ece640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7fea9006f0a0 con 0x7fea900730b0 2024-09-17T05:53:22.146 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:22.142+0000 7fea94ece640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fea9015b2b0 con 0x7fea900b4110 2024-09-17T05:53:22.146 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:22.142+0000 7fea94ece640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fea9006f220 con 0x7fea900707b0 2024-09-17T05:53:22.146 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:22.142+0000 7fea87fff640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fea900730b0 0x7fea9014ce10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:53:22.146 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:22.142+0000 7fea87fff640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fea900730b0 0x7fea9014ce10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:53682/0 (socket says 172.21.15.150:53682) 2024-09-17T05:53:22.146 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:22.142+0000 7fea87fff640 1 -- 172.21.15.150:0/1440267927 learned_addr learned my addr 172.21.15.150:0/1440267927 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:53:22.146 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:22.142+0000 7fea8ed9d640 1 --2- 172.21.15.150:0/1440267927 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fea900b4110 0x7fea901f5c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:53:22.146 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:22.142+0000 7fea87fff640 1 -- 172.21.15.150:0/1440267927 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fea900707b0 msgr2=0x7fea9014fc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:53:22.146 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:22.142+0000 7fea87fff640 1 --2- 172.21.15.150:0/1440267927 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fea900707b0 0x7fea9014fc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:53:22.146 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:22.142+0000 7fea87fff640 1 -- 172.21.15.150:0/1440267927 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fea900b4110 msgr2=0x7fea901f5c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:53:22.146 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:22.142+0000 7fea87fff640 1 --2- 172.21.15.150:0/1440267927 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fea900b4110 0x7fea901f5c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:53:22.146 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:22.142+0000 7fea87fff640 1 -- 172.21.15.150:0/1440267927 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fea9014ebb0 con 0x7fea900730b0 2024-09-17T05:53:22.147 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:22.143+0000 7fea87fff640 1 --2- 172.21.15.150:0/1440267927 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fea900730b0 0x7fea9014ce10 secure :-1 s=READY pgs=1854 cs=0 l=1 rev1=1 crypto rx=0x7fea7800b3e0 tx=0x7fea7800b8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:53:22.147 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:22.143+0000 7fea86ffd640 1 -- 172.21.15.150:0/1440267927 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea78015020 con 0x7fea900730b0 2024-09-17T05:53:22.147 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:22.143+0000 7fea86ffd640 1 -- 172.21.15.150:0/1440267927 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fea78011920 con 0x7fea900730b0 2024-09-17T05:53:22.147 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:22.143+0000 7fea94ece640 1 -- 172.21.15.150:0/1440267927 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fea9014ee90 con 0x7fea900730b0 2024-09-17T05:53:22.147 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:22.143+0000 7fea86ffd640 1 -- 172.21.15.150:0/1440267927 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea78011d70 con 0x7fea900730b0 2024-09-17T05:53:22.147 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:22.143+0000 7fea94ece640 1 -- 172.21.15.150:0/1440267927 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fea9014f450 con 0x7fea900730b0 2024-09-17T05:53:22.147 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:22.144+0000 7fea94ece640 1 -- 172.21.15.150:0/1440267927 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fea90051000 con 0x7fea900730b0 2024-09-17T05:53:22.148 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:22.145+0000 7fea86ffd640 1 -- 172.21.15.150:0/1440267927 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 45) ==== 104501+0+0 (secure 0 0 0) 0x7fea78018020 con 0x7fea900730b0 2024-09-17T05:53:22.148 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:22.145+0000 7fea86ffd640 1 --2- 172.21.15.150:0/1440267927 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fea7007ad80 0x7fea7007d290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:53:22.148 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:22.145+0000 7fea86ffd640 1 -- 172.21.15.150:0/1440267927 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(141..141 src has 1..141) ==== 5905+0+0 (secure 0 0 0) 0x7fea78099fd0 con 0x7fea900730b0 2024-09-17T05:53:22.148 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:22.146+0000 7fea8e59c640 1 --2- 172.21.15.150:0/1440267927 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fea7007ad80 0x7fea7007d290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:53:22.148 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:22.146+0000 7fea8e59c640 1 --2- 172.21.15.150:0/1440267927 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fea7007ad80 0x7fea7007d290 secure :-1 s=READY pgs=787 cs=0 l=1 rev1=1 crypto rx=0x7fea900b4630 tx=0x7fea80006bf0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:53:22.151 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:22.149+0000 7fea86ffd640 1 -- 172.21.15.150:0/1440267927 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fea90051000 con 0x7fea900730b0 2024-09-17T05:53:22.326 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:22.325+0000 7fea94ece640 1 -- 172.21.15.150:0/1440267927 --> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fea9006f7c0 con 0x7fea7007ad80 2024-09-17T05:53:22.332 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:22.330+0000 7fea86ffd640 1 -- 172.21.15.150:0/1440267927 <== mgr.4108 v2:172.21.15.176:6800/3631216395 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+252504 (secure 0 0 0) 0x7fea9006f7c0 con 0x7fea7007ad80 2024-09-17T05:53:22.334 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-09-17T05:53:22.336 INFO:teuthology.orchestra.run.smithi150.stderr:dumped all 2024-09-17T05:53:22.338 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:22.333+0000 7fea94ece640 1 -- 172.21.15.150:0/1440267927 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fea7007ad80 msgr2=0x7fea7007d290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:53:22.338 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:22.333+0000 7fea94ece640 1 --2- 172.21.15.150:0/1440267927 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fea7007ad80 0x7fea7007d290 secure :-1 s=READY pgs=787 cs=0 l=1 rev1=1 crypto rx=0x7fea900b4630 tx=0x7fea80006bf0 comp rx=0 tx=0).stop 2024-09-17T05:53:22.338 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:22.333+0000 7fea94ece640 1 -- 172.21.15.150:0/1440267927 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fea900730b0 msgr2=0x7fea9014ce10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:53:22.338 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:22.333+0000 7fea94ece640 1 --2- 172.21.15.150:0/1440267927 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fea900730b0 0x7fea9014ce10 secure :-1 s=READY pgs=1854 cs=0 l=1 rev1=1 crypto rx=0x7fea7800b3e0 tx=0x7fea7800b8a0 comp rx=0 tx=0).stop 2024-09-17T05:53:22.338 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:22.333+0000 7fea94ece640 1 -- 172.21.15.150:0/1440267927 shutdown_connections 2024-09-17T05:53:22.338 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:22.333+0000 7fea94ece640 1 --2- 172.21.15.150:0/1440267927 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fea900b4110 0x7fea901f5c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:53:22.338 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:22.333+0000 7fea94ece640 1 --2- 172.21.15.150:0/1440267927 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fea7007ad80 0x7fea7007d290 unknown :-1 s=CLOSED pgs=787 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:53:22.338 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:22.333+0000 7fea94ece640 1 --2- 172.21.15.150:0/1440267927 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fea900730b0 0x7fea9014ce10 unknown :-1 s=CLOSED pgs=1854 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:53:22.339 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:22.333+0000 7fea94ece640 1 --2- 172.21.15.150:0/1440267927 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fea900707b0 0x7fea9014fc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:53:22.339 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:22.333+0000 7fea94ece640 1 -- 172.21.15.150:0/1440267927 >> 172.21.15.150:0/1440267927 conn(0x7fea9006d730 msgr2=0x7fea900d0950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:53:22.339 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:22.333+0000 7fea94ece640 1 -- 172.21.15.150:0/1440267927 shutdown_connections 2024-09-17T05:53:22.339 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:22.333+0000 7fea94ece640 1 -- 172.21.15.150:0/1440267927 wait complete. 2024-09-17T05:53:22.346 INFO:teuthology.orchestra.run.smithi150.stdout:{"pg_ready":true,"pg_map":{"version":483,"stamp":"2024-09-17T05:53:21.095221+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":146,"num_write_kb":1642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":111,"ondisk_log_size":111,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":182,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":1070540,"kb_used_data":14940,"kb_used_omap":12,"kb_used_meta":1055411,"kb_avail":753904180,"statfs":{"total":773094113280,"available":771997880320,"internally_reserved":0,"allocated":15298560,"data_stored":7398580,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":1080741424},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":23,"apply_latency_ms":23,"commit_latency_ns":23000000,"apply_latency_ns":23000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"7.573592"},"pg_stats":[{"pgid":"21.3f","version":"0'0","reported_seq":13,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-17T05:53:16.529247+0000","last_change":"2024-09-17T05:53:14.555879+0000","last_active":"2024-09-17T05:53:16.529247+0000","last_peered":"2024-09-17T05:53:16.529247+0000","last_clean":"2024-09-17T05:53:16.529247+0000","last_became_active":"2024-09-17T05:53:14.555575+0000","last_became_peered":"2024-09-17T05:53:14.555575+0000","last_unstale":"2024-09-17T05:53:16.529247+0000","last_undegraded":"2024-09-17T05:53:16.529247+0000","last_fullsized":"2024-09-17T05:53:16.529247+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:53:13.511622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:53:13.511622+0000","last_clean_scrub_stamp":"2024-09-17T05:53:13.511622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:35:57.760250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.3e","version":"0'0","reported_seq":13,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-17T05:53:15.525389+0000","last_change":"2024-09-17T05:53:14.549638+0000","last_active":"2024-09-17T05:53:15.525389+0000","last_peered":"2024-09-17T05:53:15.525389+0000","last_clean":"2024-09-17T05:53:15.525389+0000","last_became_active":"2024-09-17T05:53:14.549123+0000","last_became_peered":"2024-09-17T05:53:14.549123+0000","last_unstale":"2024-09-17T05:53:15.525389+0000","last_undegraded":"2024-09-17T05:53:15.525389+0000","last_fullsized":"2024-09-17T05:53:15.525389+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:53:13.511622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:53:13.511622+0000","last_clean_scrub_stamp":"2024-09-17T05:53:13.511622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:48:02.350277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.3d","version":"0'0","reported_seq":13,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-17T05:53:15.527778+0000","last_change":"2024-09-17T05:53:14.550284+0000","last_active":"2024-09-17T05:53:15.527778+0000","last_peered":"2024-09-17T05:53:15.527778+0000","last_clean":"2024-09-17T05:53:15.527778+0000","last_became_active":"2024-09-17T05:53:14.549953+0000","last_became_peered":"2024-09-17T05:53:14.549953+0000","last_unstale":"2024-09-17T05:53:15.527778+0000","last_undegraded":"2024-09-17T05:53:15.527778+0000","last_fullsized":"2024-09-17T05:53:15.527778+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:53:13.511622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:53:13.511622+0000","last_clean_scrub_stamp":"2024-09-17T05:53:13.511622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:14:50.219923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.3c","version":"0'0","reported_seq":13,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-17T05:53:16.241028+0000","last_change":"2024-09-17T05:53:14.552758+0000","last_active":"2024-09-17T05:53:16.241028+0000","last_peered":"2024-09-17T05:53:16.241028+0000","last_clean":"2024-09-17T05:53:16.241028+0000","last_became_active":"2024-09-17T05:53:14.552457+0000","last_became_peered":"2024-09-17T05:53:14.552457+0000","last_unstale":"2024-09-17T05:53:16.241028+0000","last_undegraded":"2024-09-17T05:53:16.241028+0000","last_fullsized":"2024-09-17T05:53:16.241028+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:53:13.511622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:53:13.511622+0000","last_clean_scrub_stamp":"2024-09-17T05:53:13.511622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:52:10.762644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.3b","version":"0'0","reported_seq":13,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-17T05:53:16.572208+0000","last_change":"2024-09-17T05:53:14.550770+0000","last_active":"2024-09-17T05:53:16.572208+0000","last_peered":"2024-09-17T05:53:16.572208+0000","last_clean":"2024-09-17T05:53:16.572208+0000","last_became_active":"2024-09-17T05:53:14.550289+0000","last_became_peered":"2024-09-17T05:53:14.550289+0000","last_unstale":"2024-09-17T05:53:16.572208+0000","last_undegraded":"2024-09-17T05:53:16.572208+0000","last_fullsized":"2024-09-17T05:53:16.572208+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:53:13.511622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:53:13.511622+0000","last_clean_scrub_stamp":"2024-09-17T05:53:13.511622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:23:14.461386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.3a","version":"0'0","reported_seq":13,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-17T05:53:16.529059+0000","last_change":"2024-09-17T05:53:14.541112+0000","last_active":"2024-09-17T05:53:16.529059+0000","last_peered":"2024-09-17T05:53:16.529059+0000","last_clean":"2024-09-17T05:53:16.529059+0000","last_became_active":"2024-09-17T05:53:14.540852+0000","last_became_peered":"2024-09-17T05:53:14.540852+0000","last_unstale":"2024-09-17T05:53:16.529059+0000","last_undegraded":"2024-09-17T05:53:16.529059+0000","last_fullsized":"2024-09-17T05:53:16.529059+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:53:13.511622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:53:13.511622+0000","last_clean_scrub_stamp":"2024-09-17T05:53:13.511622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:41:26.230793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.39","version":"0'0","reported_seq":13,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-17T05:53:17.274113+0000","last_change":"2024-09-17T05:53:14.533804+0000","last_active":"2024-09-17T05:53:17.274113+0000","last_peered":"2024-09-17T05:53:17.274113+0000","last_clean":"2024-09-17T05:53:17.274113+0000","last_became_active":"2024-09-17T05:53:14.533477+0000","last_became_peered":"2024-09-17T05:53:14.533477+0000","last_unstale":"2024-09-17T05:53:17.274113+0000","last_undegraded":"2024-09-17T05:53:17.274113+0000","last_fullsized":"2024-09-17T05:53:17.274113+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:53:13.511622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:53:13.511622+0000","last_clean_scrub_stamp":"2024-09-17T05:53:13.511622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:18:11.692365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.38","version":"0'0","reported_seq":13,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-17T05:53:16.528748+0000","last_change":"2024-09-17T05:53:14.532461+0000","last_active":"2024-09-17T05:53:16.528748+0000","last_peered":"2024-09-17T05:53:16.528748+0000","last_clean":"2024-09-17T05:53:16.528748+0000","last_became_active":"2024-09-17T05:53:14.532077+0000","last_became_peered":"2024-09-17T05:53:14.532077+0000","last_unstale":"2024-09-17T05:53:16.528748+0000","last_undegraded":"2024-09-17T05:53:16.528748+0000","last_fullsized":"2024-09-17T05:53:16.528748+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:53:13.511622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:53:13.511622+0000","last_clean_scrub_stamp":"2024-09-17T05:53:13.511622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:40:15.968454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.37","version":"0'0","reported_seq":13,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-17T05:53:15.525261+0000","last_change":"2024-09-17T05:53:14.545599+0000","last_active":"2024-09-17T05:53:15.525261+0000","last_peered":"2024-09-17T05:53:15.525261+0000","last_clean":"2024-09-17T05:53:15.525261+0000","last_became_active":"2024-09-17T05:53:14.545295+0000","last_became_peered":"2024-09-17T05:53:14.545295+0000","last_unstale":"2024-09-17T05:53:15.525261+0000","last_undegraded":"2024-09-17T05:53:15.525261+0000","last_fullsized":"2024-09-17T05:53:15.525261+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:53:13.511622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:53:13.511622+0000","last_clean_scrub_stamp":"2024-09-17T05:53:13.511622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:43:16.880565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.36","version":"0'0","reported_seq":13,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-17T05:53:15.527536+0000","last_change":"2024-09-17T05:53:14.556175+0000","last_active":"2024-09-17T05:53:15.527536+0000","last_peered":"2024-09-17T05:53:15.527536+0000","last_clean":"2024-09-17T05:53:15.527536+0000","last_became_active":"2024-09-17T05:53:14.555806+0000","last_became_peered":"2024-09-17T05:53:14.555806+0000","last_unstale":"2024-09-17T05:53:15.527536+0000","last_undegraded":"2024-09-17T05:53:15.527536+0000","last_fullsized":"2024-09-17T05:53:15.527536+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:53:13.511622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:53:13.511622+0000","last_clean_scrub_stamp":"2024-09-17T05:53:13.511622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:25:57.952915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.35","version":"0'0","reported_seq":13,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-17T05:53:16.528893+0000","last_change":"2024-09-17T05:53:14.531047+0000","last_active":"2024-09-17T05:53:16.528893+0000","last_peered":"2024-09-17T05:53:16.528893+0000","last_clean":"2024-09-17T05:53:16.528893+0000","last_became_active":"2024-09-17T05:53:14.530176+0000","last_became_peered":"2024-09-17T05:53:14.530176+0000","last_unstale":"2024-09-17T05:53:16.528893+0000","last_undegraded":"2024-09-17T05:53:16.528893+0000","last_fullsized":"2024-09-17T05:53:16.528893+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:53:13.511622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:53:13.511622+0000","last_clean_scrub_stamp":"2024-09-17T05:53:13.511622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:40:42.942302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.34","version":"0'0","reported_seq":13,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-17T05:53:15.528949+0000","last_change":"2024-09-17T05:53:14.548964+0000","last_active":"2024-09-17T05:53:15.528949+0000","last_peered":"2024-09-17T05:53:15.528949+0000","last_clean":"2024-09-17T05:53:15.528949+0000","last_became_active":"2024-09-17T05:53:14.548601+0000","last_became_peered":"2024-09-17T05:53:14.548601+0000","last_unstale":"2024-09-17T05:53:15.528949+0000","last_undegraded":"2024-09-17T05:53:15.528949+0000","last_fullsized":"2024-09-17T05:53:15.528949+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:53:13.511622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:53:13.511622+0000","last_clean_scrub_stamp":"2024-09-17T05:53:13.511622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:37:55.173570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.33","version":"0'0","reported_seq":13,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-17T05:53:16.572443+0000","last_change":"2024-09-17T05:53:14.550313+0000","last_active":"2024-09-17T05:53:16.572443+0000","last_peered":"2024-09-17T05:53:16.572443+0000","last_clean":"2024-09-17T05:53:16.572443+0000","last_became_active":"2024-09-17T05:53:14.549928+0000","last_became_peered":"2024-09-17T05:53:14.549928+0000","last_unstale":"2024-09-17T05:53:16.572443+0000","last_undegraded":"2024-09-17T05:53:16.572443+0000","last_fullsized":"2024-09-17T05:53:16.572443+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:53:13.511622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:53:13.511622+0000","last_clean_scrub_stamp":"2024-09-17T05:53:13.511622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:24:22.329433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.32","version":"0'0","reported_seq":13,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-17T05:53:16.240854+0000","last_change":"2024-09-17T05:53:14.550458+0000","last_active":"2024-09-17T05:53:16.240854+0000","last_peered":"2024-09-17T05:53:16.240854+0000","last_clean":"2024-09-17T05:53:16.240854+0000","last_became_active":"2024-09-17T05:53:14.549281+0000","last_became_peered":"2024-09-17T05:53:14.549281+0000","last_unstale":"2024-09-17T05:53:16.240854+0000","last_undegraded":"2024-09-17T05:53:16.240854+0000","last_fullsized":"2024-09-17T05:53:16.240854+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:53:13.511622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:53:13.511622+0000","last_clean_scrub_stamp":"2024-09-17T05:53:13.511622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:01:12.907535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.31","version":"0'0","reported_seq":13,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-17T05:53:15.528260+0000","last_change":"2024-09-17T05:53:14.554387+0000","last_active":"2024-09-17T05:53:15.528260+0000","last_peered":"2024-09-17T05:53:15.528260+0000","last_clean":"2024-09-17T05:53:15.528260+0000","last_became_active":"2024-09-17T05:53:14.553370+0000","last_became_peered":"2024-09-17T05:53:14.553370+0000","last_unstale":"2024-09-17T05:53:15.528260+0000","last_undegraded":"2024-09-17T05:53:15.528260+0000","last_fullsized":"2024-09-17T05:53:15.528260+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:53:13.511622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:53:13.511622+0000","last_clean_scrub_stamp":"2024-09-17T05:53:13.511622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:28:53.104884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.30","version":"0'0","reported_seq":13,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-17T05:53:17.027469+0000","last_change":"2024-09-17T05:53:14.540661+0000","last_active":"2024-09-17T05:53:17.027469+0000","last_peered":"2024-09-17T05:53:17.027469+0000","last_clean":"2024-09-17T05:53:17.027469+0000","last_became_active":"2024-09-17T05:53:14.540336+0000","last_became_peered":"2024-09-17T05:53:14.540336+0000","last_unstale":"2024-09-17T05:53:17.027469+0000","last_undegraded":"2024-09-17T05:53:17.027469+0000","last_fullsized":"2024-09-17T05:53:17.027469+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:53:13.511622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:53:13.511622+0000","last_clean_scrub_stamp":"2024-09-17T05:53:13.511622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:38:57.194890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.2f","version":"0'0","reported_seq":13,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-17T05:53:15.528909+0000","last_change":"2024-09-17T05:53:14.555496+0000","last_active":"2024-09-17T05:53:15.528909+0000","last_peered":"2024-09-17T05:53:15.528909+0000","last_clean":"2024-09-17T05:53:15.528909+0000","last_became_active":"2024-09-17T05:53:14.554855+0000","last_became_peered":"2024-09-17T05:53:14.554855+0000","last_unstale":"2024-09-17T05:53:15.528909+0000","last_undegraded":"2024-09-17T05:53:15.528909+0000","last_fullsized":"2024-09-17T05:53:15.528909+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:53:13.511622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:53:13.511622+0000","last_clean_scrub_stamp":"2024-09-17T05:53:13.511622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:25:34.532282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.2e","version":"0'0","reported_seq":13,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-17T05:53:15.528589+0000","last_change":"2024-09-17T05:53:14.554299+0000","last_active":"2024-09-17T05:53:15.528589+0000","last_peered":"2024-09-17T05:53:15.528589+0000","last_clean":"2024-09-17T05:53:15.528589+0000","last_became_active":"2024-09-17T05:53:14.553847+0000","last_became_peered":"2024-09-17T05:53:14.553847+0000","last_unstale":"2024-09-17T05:53:15.528589+0000","last_undegraded":"2024-09-17T05:53:15.528589+0000","last_fullsized":"2024-09-17T05:53:15.528589+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:53:13.511622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:53:13.511622+0000","last_clean_scrub_stamp":"2024-09-17T05:53:13.511622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:06:54.088102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.2d","version":"0'0","reported_seq":13,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-17T05:53:16.529313+0000","last_change":"2024-09-17T05:53:14.542510+0000","last_active":"2024-09-17T05:53:16.529313+0000","last_peered":"2024-09-17T05:53:16.529313+0000","last_clean":"2024-09-17T05:53:16.529313+0000","last_became_active":"2024-09-17T05:53:14.538396+0000","last_became_peered":"2024-09-17T05:53:14.538396+0000","last_unstale":"2024-09-17T05:53:16.529313+0000","last_undegraded":"2024-09-17T05:53:16.529313+0000","last_fullsized":"2024-09-17T05:53:16.529313+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:53:13.511622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:53:13.511622+0000","last_clean_scrub_stamp":"2024-09-17T05:53:13.511622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:55:33.991367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.2c","version":"0'0","reported_seq":13,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-17T05:53:17.027792+0000","last_change":"2024-09-17T05:53:14.545110+0000","last_active":"2024-09-17T05:53:17.027792+0000","last_peered":"2024-09-17T05:53:17.027792+0000","last_clean":"2024-09-17T05:53:17.027792+0000","last_became_active":"2024-09-17T05:53:14.540914+0000","last_became_peered":"2024-09-17T05:53:14.540914+0000","last_unstale":"2024-09-17T05:53:17.027792+0000","last_undegraded":"2024-09-17T05:53:17.027792+0000","last_fullsized":"2024-09-17T05:53:17.027792+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:53:13.511622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:53:13.511622+0000","last_clean_scrub_stamp":"2024-09-17T05:53:13.511622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:24:22.329433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.2b","version":"0'0","reported_seq":13,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-17T05:53:15.528299+0000","last_change":"2024-09-17T05:53:14.546652+0000","last_active":"2024-09-17T05:53:15.528299+0000","last_peered":"2024-09-17T05:53:15.528299+0000","last_clean":"2024-09-17T05:53:15.528299+0000","last_became_active":"2024-09-17T05:53:14.546032+0000","last_became_peered":"2024-09-17T05:53:14.546032+0000","last_unstale":"2024-09-17T05:53:15.528299+0000","last_undegraded":"2024-09-17T05:53:15.528299+0000","last_fullsized":"2024-09-17T05:53:15.528299+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:53:13.511622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:53:13.511622+0000","last_clean_scrub_stamp":"2024-09-17T05:53:13.511622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:39:23.674754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.2a","version":"0'0","reported_seq":13,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-17T05:53:16.240826+0000","last_change":"2024-09-17T05:53:14.537834+0000","last_active":"2024-09-17T05:53:16.240826+0000","last_peered":"2024-09-17T05:53:16.240826+0000","last_clean":"2024-09-17T05:53:16.240826+0000","last_became_active":"2024-09-17T05:53:14.537529+0000","last_became_peered":"2024-09-17T05:53:14.537529+0000","last_unstale":"2024-09-17T05:53:16.240826+0000","last_undegraded":"2024-09-17T05:53:16.240826+0000","last_fullsized":"2024-09-17T05:53:16.240826+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:53:13.511622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:53:13.511622+0000","last_clean_scrub_stamp":"2024-09-17T05:53:13.511622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:27:05.932252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.29","version":"0'0","reported_seq":13,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-17T05:53:16.240573+0000","last_change":"2024-09-17T05:53:14.545236+0000","last_active":"2024-09-17T05:53:16.240573+0000","last_peered":"2024-09-17T05:53:16.240573+0000","last_clean":"2024-09-17T05:53:16.240573+0000","last_became_active":"2024-09-17T05:53:14.544639+0000","last_became_peered":"2024-09-17T05:53:14.544639+0000","last_unstale":"2024-09-17T05:53:16.240573+0000","last_undegraded":"2024-09-17T05:53:16.240573+0000","last_fullsized":"2024-09-17T05:53:16.240573+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:53:13.511622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:53:13.511622+0000","last_clean_scrub_stamp":"2024-09-17T05:53:13.511622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:24:06.560621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.28","version":"0'0","reported_seq":13,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-17T05:53:15.527650+0000","last_change":"2024-09-17T05:53:14.547009+0000","last_active":"2024-09-17T05:53:15.527650+0000","last_peered":"2024-09-17T05:53:15.527650+0000","last_clean":"2024-09-17T05:53:15.527650+0000","last_became_active":"2024-09-17T05:53:14.546691+0000","last_became_peered":"2024-09-17T05:53:14.546691+0000","last_unstale":"2024-09-17T05:53:15.527650+0000","last_undegraded":"2024-09-17T05:53:15.527650+0000","last_fullsized":"2024-09-17T05:53:15.527650+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:53:13.511622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:53:13.511622+0000","last_clean_scrub_stamp":"2024-09-17T05:53:13.511622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:07:35.487105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.27","version":"0'0","reported_seq":13,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-17T05:53:17.027916+0000","last_change":"2024-09-17T05:53:14.540370+0000","last_active":"2024-09-17T05:53:17.027916+0000","last_peered":"2024-09-17T05:53:17.027916+0000","last_clean":"2024-09-17T05:53:17.027916+0000","last_became_active":"2024-09-17T05:53:14.540030+0000","last_became_peered":"2024-09-17T05:53:14.540030+0000","last_unstale":"2024-09-17T05:53:17.027916+0000","last_undegraded":"2024-09-17T05:53:17.027916+0000","last_fullsized":"2024-09-17T05:53:17.027916+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:53:13.511622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:53:13.511622+0000","last_clean_scrub_stamp":"2024-09-17T05:53:13.511622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:47:52.548419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.26","version":"0'0","reported_seq":13,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-17T05:53:16.529085+0000","last_change":"2024-09-17T05:53:14.537700+0000","last_active":"2024-09-17T05:53:16.529085+0000","last_peered":"2024-09-17T05:53:16.529085+0000","last_clean":"2024-09-17T05:53:16.529085+0000","last_became_active":"2024-09-17T05:53:14.537381+0000","last_became_peered":"2024-09-17T05:53:14.537381+0000","last_unstale":"2024-09-17T05:53:16.529085+0000","last_undegraded":"2024-09-17T05:53:16.529085+0000","last_fullsized":"2024-09-17T05:53:16.529085+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:53:13.511622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:53:13.511622+0000","last_clean_scrub_stamp":"2024-09-17T05:53:13.511622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:22:46.552213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.25","version":"0'0","reported_seq":13,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-17T05:53:17.027801+0000","last_change":"2024-09-17T05:53:14.558586+0000","last_active":"2024-09-17T05:53:17.027801+0000","last_peered":"2024-09-17T05:53:17.027801+0000","last_clean":"2024-09-17T05:53:17.027801+0000","last_became_active":"2024-09-17T05:53:14.558237+0000","last_became_peered":"2024-09-17T05:53:14.558237+0000","last_unstale":"2024-09-17T05:53:17.027801+0000","last_undegraded":"2024-09-17T05:53:17.027801+0000","last_fullsized":"2024-09-17T05:53:17.027801+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:53:13.511622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:53:13.511622+0000","last_clean_scrub_stamp":"2024-09-17T05:53:13.511622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:06:01.140596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.24","version":"0'0","reported_seq":13,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-17T05:53:17.274198+0000","last_change":"2024-09-17T05:53:14.543919+0000","last_active":"2024-09-17T05:53:17.274198+0000","last_peered":"2024-09-17T05:53:17.274198+0000","last_clean":"2024-09-17T05:53:17.274198+0000","last_became_active":"2024-09-17T05:53:14.543599+0000","last_became_peered":"2024-09-17T05:53:14.543599+0000","last_unstale":"2024-09-17T05:53:17.274198+0000","last_undegraded":"2024-09-17T05:53:17.274198+0000","last_fullsized":"2024-09-17T05:53:17.274198+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:53:13.511622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:53:13.511622+0000","last_clean_scrub_stamp":"2024-09-17T05:53:13.511622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:00:36.965377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.23","version":"0'0","reported_seq":13,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-17T05:53:16.528799+0000","last_change":"2024-09-17T05:53:14.541926+0000","last_active":"2024-09-17T05:53:16.528799+0000","last_peered":"2024-09-17T05:53:16.528799+0000","last_clean":"2024-09-17T05:53:16.528799+0000","last_became_active":"2024-09-17T05:53:14.541637+0000","last_became_peered":"2024-09-17T05:53:14.541637+0000","last_unstale":"2024-09-17T05:53:16.528799+0000","last_undegraded":"2024-09-17T05:53:16.528799+0000","last_fullsized":"2024-09-17T05:53:16.528799+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:53:13.511622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:53:13.511622+0000","last_clean_scrub_stamp":"2024-09-17T05:53:13.511622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:36:27.413268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.22","version":"0'0","reported_seq":13,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-17T05:53:16.241078+0000","last_change":"2024-09-17T05:53:14.551704+0000","last_active":"2024-09-17T05:53:16.241078+0000","last_peered":"2024-09-17T05:53:16.241078+0000","last_clean":"2024-09-17T05:53:16.241078+0000","last_became_active":"2024-09-17T05:53:14.550147+0000","last_became_peered":"2024-09-17T05:53:14.550147+0000","last_unstale":"2024-09-17T05:53:16.241078+0000","last_undegraded":"2024-09-17T05:53:16.241078+0000","last_fullsized":"2024-09-17T05:53:16.241078+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:53:13.511622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:53:13.511622+0000","last_clean_scrub_stamp":"2024-09-17T05:53:13.511622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:26:47.700753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.21","version":"0'0","reported_seq":13,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-17T05:53:15.525206+0000","last_change":"2024-09-17T05:53:14.556590+0000","last_active":"2024-09-17T05:53:15.525206+0000","last_peered":"2024-09-17T05:53:15.525206+0000","last_clean":"2024-09-17T05:53:15.525206+0000","last_became_active":"2024-09-17T05:53:14.556281+0000","last_became_peered":"2024-09-17T05:53:14.556281+0000","last_unstale":"2024-09-17T05:53:15.525206+0000","last_undegraded":"2024-09-17T05:53:15.525206+0000","last_fullsized":"2024-09-17T05:53:15.525206+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:53:13.511622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:53:13.511622+0000","last_clean_scrub_stamp":"2024-09-17T05:53:13.511622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:15:50.606228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.20","version":"0'0","reported_seq":13,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-17T05:53:17.027506+0000","last_change":"2024-09-17T05:53:14.535929+0000","last_active":"2024-09-17T05:53:17.027506+0000","last_peered":"2024-09-17T05:53:17.027506+0000","last_clean":"2024-09-17T05:53:17.027506+0000","last_became_active":"2024-09-17T05:53:14.535482+0000","last_became_peered":"2024-09-17T05:53:14.535482+0000","last_unstale":"2024-09-17T05:53:17.027506+0000","last_undegraded":"2024-09-17T05:53:17.027506+0000","last_fullsized":"2024-09-17T05:53:17.027506+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:53:13.511622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:53:13.511622+0000","last_clean_scrub_stamp":"2024-09-17T05:53:13.511622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:06:39.200488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.1e","version":"0'0","reported_seq":13,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-17T05:53:15.527757+0000","last_change":"2024-09-17T05:53:14.548181+0000","last_active":"2024-09-17T05:53:15.527757+0000","last_peered":"2024-09-17T05:53:15.527757+0000","last_clean":"2024-09-17T05:53:15.527757+0000","last_became_active":"2024-09-17T05:53:14.547859+0000","last_became_peered":"2024-09-17T05:53:14.547859+0000","last_unstale":"2024-09-17T05:53:15.527757+0000","last_undegraded":"2024-09-17T05:53:15.527757+0000","last_fullsized":"2024-09-17T05:53:15.527757+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:53:13.511622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:53:13.511622+0000","last_clean_scrub_stamp":"2024-09-17T05:53:13.511622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:17:09.456622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.1f","version":"140'4","reported_seq":19,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-17T05:53:15.528586+0000","last_change":"2024-09-17T05:53:13.539463+0000","last_active":"2024-09-17T05:53:15.528586+0000","last_peered":"2024-09-17T05:53:15.528586+0000","last_clean":"2024-09-17T05:53:15.528586+0000","last_became_active":"2024-09-17T05:53:13.538767+0000","last_became_peered":"2024-09-17T05:53:13.538767+0000","last_unstale":"2024-09-17T05:53:15.528586+0000","last_undegraded":"2024-09-17T05:53:15.528586+0000","last_fullsized":"2024-09-17T05:53:15.528586+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:53:12.509392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:53:12.509392+0000","last_clean_scrub_stamp":"2024-09-17T05:53:12.509392+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:26:51.175390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.1f","version":"0'0","reported_seq":13,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-17T05:53:15.525480+0000","last_change":"2024-09-17T05:53:14.549878+0000","last_active":"2024-09-17T05:53:15.525480+0000","last_peered":"2024-09-17T05:53:15.525480+0000","last_clean":"2024-09-17T05:53:15.525480+0000","last_became_active":"2024-09-17T05:53:14.549546+0000","last_became_peered":"2024-09-17T05:53:14.549546+0000","last_unstale":"2024-09-17T05:53:15.525480+0000","last_undegraded":"2024-09-17T05:53:15.525480+0000","last_fullsized":"2024-09-17T05:53:15.525480+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:53:13.511622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:53:13.511622+0000","last_clean_scrub_stamp":"2024-09-17T05:53:13.511622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:15:46.398387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.1e","version":"140'1","reported_seq":16,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-17T05:53:15.525461+0000","last_change":"2024-09-17T05:53:13.534967+0000","last_active":"2024-09-17T05:53:15.525461+0000","last_peered":"2024-09-17T05:53:15.525461+0000","last_clean":"2024-09-17T05:53:15.525461+0000","last_became_active":"2024-09-17T05:53:13.534633+0000","last_became_peered":"2024-09-17T05:53:13.534633+0000","last_unstale":"2024-09-17T05:53:15.525461+0000","last_undegraded":"2024-09-17T05:53:15.525461+0000","last_fullsized":"2024-09-17T05:53:15.525461+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:53:12.509392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:53:12.509392+0000","last_clean_scrub_stamp":"2024-09-17T05:53:12.509392+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:27:14.501259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.1c","version":"0'0","reported_seq":13,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-17T05:53:16.529028+0000","last_change":"2024-09-17T05:53:14.539741+0000","last_active":"2024-09-17T05:53:16.529028+0000","last_peered":"2024-09-17T05:53:16.529028+0000","last_clean":"2024-09-17T05:53:16.529028+0000","last_became_active":"2024-09-17T05:53:14.539057+0000","last_became_peered":"2024-09-17T05:53:14.539057+0000","last_unstale":"2024-09-17T05:53:16.529028+0000","last_undegraded":"2024-09-17T05:53:16.529028+0000","last_fullsized":"2024-09-17T05:53:16.529028+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:53:13.511622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:53:13.511622+0000","last_clean_scrub_stamp":"2024-09-17T05:53:13.511622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:26:43.601974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.1d","version":"140'2","reported_seq":17,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-17T05:53:16.240943+0000","last_change":"2024-09-17T05:53:13.537119+0000","last_active":"2024-09-17T05:53:16.240943+0000","last_peered":"2024-09-17T05:53:16.240943+0000","last_clean":"2024-09-17T05:53:16.240943+0000","last_became_active":"2024-09-17T05:53:13.536775+0000","last_became_peered":"2024-09-17T05:53:13.536775+0000","last_unstale":"2024-09-17T05:53:16.240943+0000","last_undegraded":"2024-09-17T05:53:16.240943+0000","last_fullsized":"2024-09-17T05:53:16.240943+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:53:12.509392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:53:12.509392+0000","last_clean_scrub_stamp":"2024-09-17T05:53:12.509392+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:11:22.756476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.1d","version":"0'0","reported_seq":13,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-17T05:53:15.528652+0000","last_change":"2024-09-17T05:53:14.554059+0000","last_active":"2024-09-17T05:53:15.528652+0000","last_peered":"2024-09-17T05:53:15.528652+0000","last_clean":"2024-09-17T05:53:15.528652+0000","last_became_active":"2024-09-17T05:53:14.553753+0000","last_became_peered":"2024-09-17T05:53:14.553753+0000","last_unstale":"2024-09-17T05:53:15.528652+0000","last_undegraded":"2024-09-17T05:53:15.528652+0000","last_fullsized":"2024-09-17T05:53:15.528652+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:53:13.511622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:53:13.511622+0000","last_clean_scrub_stamp":"2024-09-17T05:53:13.511622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:58:54.333486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.1c","version":"140'2","reported_seq":17,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-17T05:53:16.240916+0000","last_change":"2024-09-17T05:53:13.540612+0000","last_active":"2024-09-17T05:53:16.240916+0000","last_peered":"2024-09-17T05:53:16.240916+0000","last_clean":"2024-09-17T05:53:16.240916+0000","last_became_active":"2024-09-17T05:53:13.540271+0000","last_became_peered":"2024-09-17T05:53:13.540271+0000","last_unstale":"2024-09-17T05:53:16.240916+0000","last_undegraded":"2024-09-17T05:53:16.240916+0000","last_fullsized":"2024-09-17T05:53:16.240916+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:53:12.509392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:53:12.509392+0000","last_clean_scrub_stamp":"2024-09-17T05:53:12.509392+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:49:46.449132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.1a","version":"0'0","reported_seq":13,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-17T05:53:15.525163+0000","last_change":"2024-09-17T05:53:14.558092+0000","last_active":"2024-09-17T05:53:15.525163+0000","last_peered":"2024-09-17T05:53:15.525163+0000","last_clean":"2024-09-17T05:53:15.525163+0000","last_became_active":"2024-09-17T05:53:14.557764+0000","last_became_peered":"2024-09-17T05:53:14.557764+0000","last_unstale":"2024-09-17T05:53:15.525163+0000","last_undegraded":"2024-09-17T05:53:15.525163+0000","last_fullsized":"2024-09-17T05:53:15.525163+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:53:13.511622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:53:13.511622+0000","last_clean_scrub_stamp":"2024-09-17T05:53:13.511622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:58:55.194299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.1b","version":"140'1","reported_seq":16,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-17T05:53:17.027487+0000","last_change":"2024-09-17T05:53:13.542968+0000","last_active":"2024-09-17T05:53:17.027487+0000","last_peered":"2024-09-17T05:53:17.027487+0000","last_clean":"2024-09-17T05:53:17.027487+0000","last_became_active":"2024-09-17T05:53:13.541698+0000","last_became_peered":"2024-09-17T05:53:13.541698+0000","last_unstale":"2024-09-17T05:53:17.027487+0000","last_undegraded":"2024-09-17T05:53:17.027487+0000","last_fullsized":"2024-09-17T05:53:17.027487+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:53:12.509392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:53:12.509392+0000","last_clean_scrub_stamp":"2024-09-17T05:53:12.509392+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:50:11.518958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.1b","version":"0'0","reported_seq":13,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-17T05:53:16.240922+0000","last_change":"2024-09-17T05:53:14.539845+0000","last_active":"2024-09-17T05:53:16.240922+0000","last_peered":"2024-09-17T05:53:16.240922+0000","last_clean":"2024-09-17T05:53:16.240922+0000","last_became_active":"2024-09-17T05:53:14.539515+0000","last_became_peered":"2024-09-17T05:53:14.539515+0000","last_unstale":"2024-09-17T05:53:16.240922+0000","last_undegraded":"2024-09-17T05:53:16.240922+0000","last_fullsized":"2024-09-17T05:53:16.240922+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:53:13.511622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:53:13.511622+0000","last_clean_scrub_stamp":"2024-09-17T05:53:13.511622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:42:58.702536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.1a","version":"140'1","reported_seq":16,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-17T05:53:16.571986+0000","last_change":"2024-09-17T05:53:13.534883+0000","last_active":"2024-09-17T05:53:16.571986+0000","last_peered":"2024-09-17T05:53:16.571986+0000","last_clean":"2024-09-17T05:53:16.571986+0000","last_became_active":"2024-09-17T05:53:13.534547+0000","last_became_peered":"2024-09-17T05:53:13.534547+0000","last_unstale":"2024-09-17T05:53:16.571986+0000","last_undegraded":"2024-09-17T05:53:16.571986+0000","last_fullsized":"2024-09-17T05:53:16.571986+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:53:12.509392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:53:12.509392+0000","last_clean_scrub_stamp":"2024-09-17T05:53:12.509392+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:24:20.737152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.18","version":"0'0","reported_seq":13,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-17T05:53:15.525172+0000","last_change":"2024-09-17T05:53:14.543344+0000","last_active":"2024-09-17T05:53:15.525172+0000","last_peered":"2024-09-17T05:53:15.525172+0000","last_clean":"2024-09-17T05:53:15.525172+0000","last_became_active":"2024-09-17T05:53:14.542980+0000","last_became_peered":"2024-09-17T05:53:14.542980+0000","last_unstale":"2024-09-17T05:53:15.525172+0000","last_undegraded":"2024-09-17T05:53:15.525172+0000","last_fullsized":"2024-09-17T05:53:15.525172+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:53:13.511622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:53:13.511622+0000","last_clean_scrub_stamp":"2024-09-17T05:53:13.511622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:32:55.358024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.19","version":"0'0","reported_seq":15,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-17T05:53:17.027416+0000","last_change":"2024-09-17T05:53:13.540173+0000","last_active":"2024-09-17T05:53:17.027416+0000","last_peered":"2024-09-17T05:53:17.027416+0000","last_clean":"2024-09-17T05:53:17.027416+0000","last_became_active":"2024-09-17T05:53:13.539751+0000","last_became_peered":"2024-09-17T05:53:13.539751+0000","last_unstale":"2024-09-17T05:53:17.027416+0000","last_undegraded":"2024-09-17T05:53:17.027416+0000","last_fullsized":"2024-09-17T05:53:17.027416+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:53:12.509392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:53:12.509392+0000","last_clean_scrub_stamp":"2024-09-17T05:53:12.509392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:04:25.782442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.19","version":"0'0","reported_seq":13,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-17T05:53:16.572391+0000","last_change":"2024-09-17T05:53:14.537974+0000","last_active":"2024-09-17T05:53:16.572391+0000","last_peered":"2024-09-17T05:53:16.572391+0000","last_clean":"2024-09-17T05:53:16.572391+0000","last_became_active":"2024-09-17T05:53:14.537611+0000","last_became_peered":"2024-09-17T05:53:14.537611+0000","last_unstale":"2024-09-17T05:53:16.572391+0000","last_undegraded":"2024-09-17T05:53:16.572391+0000","last_fullsized":"2024-09-17T05:53:16.572391+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:53:13.511622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:53:13.511622+0000","last_clean_scrub_stamp":"2024-09-17T05:53:13.511622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:38:57.194890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.18","version":"0'0","reported_seq":15,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-17T05:53:16.240383+0000","last_change":"2024-09-17T05:53:13.536829+0000","last_active":"2024-09-17T05:53:16.240383+0000","last_peered":"2024-09-17T05:53:16.240383+0000","last_clean":"2024-09-17T05:53:16.240383+0000","last_became_active":"2024-09-17T05:53:13.536475+0000","last_became_peered":"2024-09-17T05:53:13.536475+0000","last_unstale":"2024-09-17T05:53:16.240383+0000","last_undegraded":"2024-09-17T05:53:16.240383+0000","last_fullsized":"2024-09-17T05:53:16.240383+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:53:12.509392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:53:12.509392+0000","last_clean_scrub_stamp":"2024-09-17T05:53:12.509392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:55:32.989137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.16","version":"0'0","reported_seq":13,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-17T05:53:16.572405+0000","last_change":"2024-09-17T05:53:14.542412+0000","last_active":"2024-09-17T05:53:16.572405+0000","last_peered":"2024-09-17T05:53:16.572405+0000","last_clean":"2024-09-17T05:53:16.572405+0000","last_became_active":"2024-09-17T05:53:14.541943+0000","last_became_peered":"2024-09-17T05:53:14.541943+0000","last_unstale":"2024-09-17T05:53:16.572405+0000","last_undegraded":"2024-09-17T05:53:16.572405+0000","last_fullsized":"2024-09-17T05:53:16.572405+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:53:13.511622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:53:13.511622+0000","last_clean_scrub_stamp":"2024-09-17T05:53:13.511622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:06:39.200488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.17","version":"0'0","reported_seq":15,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-17T05:53:15.525545+0000","last_change":"2024-09-17T05:53:13.540323+0000","last_active":"2024-09-17T05:53:15.525545+0000","last_peered":"2024-09-17T05:53:15.525545+0000","last_clean":"2024-09-17T05:53:15.525545+0000","last_became_active":"2024-09-17T05:53:13.539684+0000","last_became_peered":"2024-09-17T05:53:13.539684+0000","last_unstale":"2024-09-17T05:53:15.525545+0000","last_undegraded":"2024-09-17T05:53:15.525545+0000","last_fullsized":"2024-09-17T05:53:15.525545+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:53:12.509392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:53:12.509392+0000","last_clean_scrub_stamp":"2024-09-17T05:53:12.509392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:58:52.733606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.17","version":"0'0","reported_seq":13,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-17T05:53:15.528601+0000","last_change":"2024-09-17T05:53:14.555136+0000","last_active":"2024-09-17T05:53:15.528601+0000","last_peered":"2024-09-17T05:53:15.528601+0000","last_clean":"2024-09-17T05:53:15.528601+0000","last_became_active":"2024-09-17T05:53:14.554514+0000","last_became_peered":"2024-09-17T05:53:14.554514+0000","last_unstale":"2024-09-17T05:53:15.528601+0000","last_undegraded":"2024-09-17T05:53:15.528601+0000","last_fullsized":"2024-09-17T05:53:15.528601+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:53:13.511622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:53:13.511622+0000","last_clean_scrub_stamp":"2024-09-17T05:53:13.511622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:41:18.370466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.16","version":"0'0","reported_seq":15,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-17T05:53:15.528222+0000","last_change":"2024-09-17T05:53:13.534637+0000","last_active":"2024-09-17T05:53:15.528222+0000","last_peered":"2024-09-17T05:53:15.528222+0000","last_clean":"2024-09-17T05:53:15.528222+0000","last_became_active":"2024-09-17T05:53:13.534316+0000","last_became_peered":"2024-09-17T05:53:13.534316+0000","last_unstale":"2024-09-17T05:53:15.528222+0000","last_undegraded":"2024-09-17T05:53:15.528222+0000","last_fullsized":"2024-09-17T05:53:15.528222+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:53:12.509392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:53:12.509392+0000","last_clean_scrub_stamp":"2024-09-17T05:53:12.509392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:17:34.499459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.15","version":"0'0","reported_seq":13,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-17T05:53:17.027824+0000","last_change":"2024-09-17T05:53:14.547731+0000","last_active":"2024-09-17T05:53:17.027824+0000","last_peered":"2024-09-17T05:53:17.027824+0000","last_clean":"2024-09-17T05:53:17.027824+0000","last_became_active":"2024-09-17T05:53:14.547146+0000","last_became_peered":"2024-09-17T05:53:14.547146+0000","last_unstale":"2024-09-17T05:53:17.027824+0000","last_undegraded":"2024-09-17T05:53:17.027824+0000","last_fullsized":"2024-09-17T05:53:17.027824+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:53:13.511622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:53:13.511622+0000","last_clean_scrub_stamp":"2024-09-17T05:53:13.511622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:15:10.385404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.14","version":"140'6","reported_seq":21,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-17T05:53:17.274406+0000","last_change":"2024-09-17T05:53:13.541151+0000","last_active":"2024-09-17T05:53:17.274406+0000","last_peered":"2024-09-17T05:53:17.274406+0000","last_clean":"2024-09-17T05:53:17.274406+0000","last_became_active":"2024-09-17T05:53:13.540717+0000","last_became_peered":"2024-09-17T05:53:13.540717+0000","last_unstale":"2024-09-17T05:53:17.274406+0000","last_undegraded":"2024-09-17T05:53:17.274406+0000","last_fullsized":"2024-09-17T05:53:17.274406+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:53:12.509392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:53:12.509392+0000","last_clean_scrub_stamp":"2024-09-17T05:53:12.509392+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:34:34.949023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.12","version":"0'0","reported_seq":13,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-17T05:53:15.527892+0000","last_change":"2024-09-17T05:53:14.545291+0000","last_active":"2024-09-17T05:53:15.527892+0000","last_peered":"2024-09-17T05:53:15.527892+0000","last_clean":"2024-09-17T05:53:15.527892+0000","last_became_active":"2024-09-17T05:53:14.544040+0000","last_became_peered":"2024-09-17T05:53:14.544040+0000","last_unstale":"2024-09-17T05:53:15.527892+0000","last_undegraded":"2024-09-17T05:53:15.527892+0000","last_fullsized":"2024-09-17T05:53:15.527892+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:53:13.511622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:53:13.511622+0000","last_clean_scrub_stamp":"2024-09-17T05:53:13.511622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:36:59.234463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.13","version":"140'2","reported_seq":17,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-17T05:53:15.528151+0000","last_change":"2024-09-17T05:53:13.534849+0000","last_active":"2024-09-17T05:53:15.528151+0000","last_peered":"2024-09-17T05:53:15.528151+0000","last_clean":"2024-09-17T05:53:15.528151+0000","last_became_active":"2024-09-17T05:53:13.534513+0000","last_became_peered":"2024-09-17T05:53:13.534513+0000","last_unstale":"2024-09-17T05:53:15.528151+0000","last_undegraded":"2024-09-17T05:53:15.528151+0000","last_fullsized":"2024-09-17T05:53:15.528151+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:53:12.509392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:53:12.509392+0000","last_clean_scrub_stamp":"2024-09-17T05:53:12.509392+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:13:59.843653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.13","version":"0'0","reported_seq":13,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-17T05:53:15.525228+0000","last_change":"2024-09-17T05:53:14.549448+0000","last_active":"2024-09-17T05:53:15.525228+0000","last_peered":"2024-09-17T05:53:15.525228+0000","last_clean":"2024-09-17T05:53:15.525228+0000","last_became_active":"2024-09-17T05:53:14.549137+0000","last_became_peered":"2024-09-17T05:53:14.549137+0000","last_unstale":"2024-09-17T05:53:15.525228+0000","last_undegraded":"2024-09-17T05:53:15.525228+0000","last_fullsized":"2024-09-17T05:53:15.525228+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:53:13.511622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:53:13.511622+0000","last_clean_scrub_stamp":"2024-09-17T05:53:13.511622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:14:24.330869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.12","version":"0'0","reported_seq":15,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-17T05:53:15.527732+0000","last_change":"2024-09-17T05:53:13.531178+0000","last_active":"2024-09-17T05:53:15.527732+0000","last_peered":"2024-09-17T05:53:15.527732+0000","last_clean":"2024-09-17T05:53:15.527732+0000","last_became_active":"2024-09-17T05:53:13.530850+0000","last_became_peered":"2024-09-17T05:53:13.530850+0000","last_unstale":"2024-09-17T05:53:15.527732+0000","last_undegraded":"2024-09-17T05:53:15.527732+0000","last_fullsized":"2024-09-17T05:53:15.527732+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:53:12.509392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:53:12.509392+0000","last_clean_scrub_stamp":"2024-09-17T05:53:12.509392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:26:34.510765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.10","version":"0'0","reported_seq":13,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-17T05:53:16.572253+0000","last_change":"2024-09-17T05:53:14.549168+0000","last_active":"2024-09-17T05:53:16.572253+0000","last_peered":"2024-09-17T05:53:16.572253+0000","last_clean":"2024-09-17T05:53:16.572253+0000","last_became_active":"2024-09-17T05:53:14.548829+0000","last_became_peered":"2024-09-17T05:53:14.548829+0000","last_unstale":"2024-09-17T05:53:16.572253+0000","last_undegraded":"2024-09-17T05:53:16.572253+0000","last_fullsized":"2024-09-17T05:53:16.572253+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:53:13.511622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:53:13.511622+0000","last_clean_scrub_stamp":"2024-09-17T05:53:13.511622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:48:29.849949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.11","version":"0'0","reported_seq":15,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-17T05:53:16.528524+0000","last_change":"2024-09-17T05:53:13.537617+0000","last_active":"2024-09-17T05:53:16.528524+0000","last_peered":"2024-09-17T05:53:16.528524+0000","last_clean":"2024-09-17T05:53:16.528524+0000","last_became_active":"2024-09-17T05:53:13.535555+0000","last_became_peered":"2024-09-17T05:53:13.535555+0000","last_unstale":"2024-09-17T05:53:16.528524+0000","last_undegraded":"2024-09-17T05:53:16.528524+0000","last_fullsized":"2024-09-17T05:53:16.528524+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:53:12.509392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:53:12.509392+0000","last_clean_scrub_stamp":"2024-09-17T05:53:12.509392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:24:21.327203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.11","version":"0'0","reported_seq":13,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-17T05:53:15.528024+0000","last_change":"2024-09-17T05:53:14.555554+0000","last_active":"2024-09-17T05:53:15.528024+0000","last_peered":"2024-09-17T05:53:15.528024+0000","last_clean":"2024-09-17T05:53:15.528024+0000","last_became_active":"2024-09-17T05:53:14.555012+0000","last_became_peered":"2024-09-17T05:53:14.555012+0000","last_unstale":"2024-09-17T05:53:15.528024+0000","last_undegraded":"2024-09-17T05:53:15.528024+0000","last_fullsized":"2024-09-17T05:53:15.528024+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:53:13.511622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:53:13.511622+0000","last_clean_scrub_stamp":"2024-09-17T05:53:13.511622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:52:21.920528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.10","version":"140'8","reported_seq":23,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-17T05:53:17.027559+0000","last_change":"2024-09-17T05:53:13.542933+0000","last_active":"2024-09-17T05:53:17.027559+0000","last_peered":"2024-09-17T05:53:17.027559+0000","last_clean":"2024-09-17T05:53:17.027559+0000","last_became_active":"2024-09-17T05:53:13.542592+0000","last_became_peered":"2024-09-17T05:53:13.542592+0000","last_unstale":"2024-09-17T05:53:17.027559+0000","last_undegraded":"2024-09-17T05:53:17.027559+0000","last_fullsized":"2024-09-17T05:53:17.027559+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:53:12.509392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:53:12.509392+0000","last_clean_scrub_stamp":"2024-09-17T05:53:12.509392+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:33:19.361630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.e","version":"0'0","reported_seq":13,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-17T05:53:15.528010+0000","last_change":"2024-09-17T05:53:14.548943+0000","last_active":"2024-09-17T05:53:15.528010+0000","last_peered":"2024-09-17T05:53:15.528010+0000","last_clean":"2024-09-17T05:53:15.528010+0000","last_became_active":"2024-09-17T05:53:14.547493+0000","last_became_peered":"2024-09-17T05:53:14.547493+0000","last_unstale":"2024-09-17T05:53:15.528010+0000","last_undegraded":"2024-09-17T05:53:15.528010+0000","last_fullsized":"2024-09-17T05:53:15.528010+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:53:13.511622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:53:13.511622+0000","last_clean_scrub_stamp":"2024-09-17T05:53:13.511622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:11:54.994505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.f","version":"140'1","reported_seq":16,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-17T05:53:16.572123+0000","last_change":"2024-09-17T05:53:13.538801+0000","last_active":"2024-09-17T05:53:16.572123+0000","last_peered":"2024-09-17T05:53:16.572123+0000","last_clean":"2024-09-17T05:53:16.572123+0000","last_became_active":"2024-09-17T05:53:13.538469+0000","last_became_peered":"2024-09-17T05:53:13.538469+0000","last_unstale":"2024-09-17T05:53:16.572123+0000","last_undegraded":"2024-09-17T05:53:16.572123+0000","last_fullsized":"2024-09-17T05:53:16.572123+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:53:12.509392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:53:12.509392+0000","last_clean_scrub_stamp":"2024-09-17T05:53:12.509392+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:33:19.361630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.f","version":"0'0","reported_seq":13,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-17T05:53:17.027926+0000","last_change":"2024-09-17T05:53:14.555208+0000","last_active":"2024-09-17T05:53:17.027926+0000","last_peered":"2024-09-17T05:53:17.027926+0000","last_clean":"2024-09-17T05:53:17.027926+0000","last_became_active":"2024-09-17T05:53:14.554902+0000","last_became_peered":"2024-09-17T05:53:14.554902+0000","last_unstale":"2024-09-17T05:53:17.027926+0000","last_undegraded":"2024-09-17T05:53:17.027926+0000","last_fullsized":"2024-09-17T05:53:17.027926+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:53:13.511622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:53:13.511622+0000","last_clean_scrub_stamp":"2024-09-17T05:53:13.511622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:25:52.446565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.e","version":"140'2","reported_seq":17,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-17T05:53:15.525585+0000","last_change":"2024-09-17T05:53:13.538056+0000","last_active":"2024-09-17T05:53:15.525585+0000","last_peered":"2024-09-17T05:53:15.525585+0000","last_clean":"2024-09-17T05:53:15.525585+0000","last_became_active":"2024-09-17T05:53:13.537504+0000","last_became_peered":"2024-09-17T05:53:13.537504+0000","last_unstale":"2024-09-17T05:53:15.525585+0000","last_undegraded":"2024-09-17T05:53:15.525585+0000","last_fullsized":"2024-09-17T05:53:15.525585+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:53:12.509392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:53:12.509392+0000","last_clean_scrub_stamp":"2024-09-17T05:53:12.509392+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:57:06.086555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.c","version":"0'0","reported_seq":13,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-17T05:53:15.527539+0000","last_change":"2024-09-17T05:53:14.542594+0000","last_active":"2024-09-17T05:53:15.527539+0000","last_peered":"2024-09-17T05:53:15.527539+0000","last_clean":"2024-09-17T05:53:15.527539+0000","last_became_active":"2024-09-17T05:53:14.542223+0000","last_became_peered":"2024-09-17T05:53:14.542223+0000","last_unstale":"2024-09-17T05:53:15.527539+0000","last_undegraded":"2024-09-17T05:53:15.527539+0000","last_fullsized":"2024-09-17T05:53:15.527539+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:53:13.511622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:53:13.511622+0000","last_clean_scrub_stamp":"2024-09-17T05:53:13.511622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:33:28.816937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.d","version":"140'1","reported_seq":16,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-17T05:53:17.027855+0000","last_change":"2024-09-17T05:53:13.540821+0000","last_active":"2024-09-17T05:53:17.027855+0000","last_peered":"2024-09-17T05:53:17.027855+0000","last_clean":"2024-09-17T05:53:17.027855+0000","last_became_active":"2024-09-17T05:53:13.540479+0000","last_became_peered":"2024-09-17T05:53:13.540479+0000","last_unstale":"2024-09-17T05:53:17.027855+0000","last_undegraded":"2024-09-17T05:53:17.027855+0000","last_fullsized":"2024-09-17T05:53:17.027855+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:53:12.509392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:53:12.509392+0000","last_clean_scrub_stamp":"2024-09-17T05:53:12.509392+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:04:30.883334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.d","version":"0'0","reported_seq":13,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-17T05:53:16.528928+0000","last_change":"2024-09-17T05:53:14.554087+0000","last_active":"2024-09-17T05:53:16.528928+0000","last_peered":"2024-09-17T05:53:16.528928+0000","last_clean":"2024-09-17T05:53:16.528928+0000","last_became_active":"2024-09-17T05:53:14.553773+0000","last_became_peered":"2024-09-17T05:53:14.553773+0000","last_unstale":"2024-09-17T05:53:16.528928+0000","last_undegraded":"2024-09-17T05:53:16.528928+0000","last_fullsized":"2024-09-17T05:53:16.528928+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:53:13.511622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:53:13.511622+0000","last_clean_scrub_stamp":"2024-09-17T05:53:13.511622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:12:56.442968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.c","version":"0'0","reported_seq":15,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-17T05:53:15.525020+0000","last_change":"2024-09-17T05:53:13.541554+0000","last_active":"2024-09-17T05:53:15.525020+0000","last_peered":"2024-09-17T05:53:15.525020+0000","last_clean":"2024-09-17T05:53:15.525020+0000","last_became_active":"2024-09-17T05:53:13.540695+0000","last_became_peered":"2024-09-17T05:53:13.540695+0000","last_unstale":"2024-09-17T05:53:15.525020+0000","last_undegraded":"2024-09-17T05:53:15.525020+0000","last_fullsized":"2024-09-17T05:53:15.525020+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:53:12.509392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:53:12.509392+0000","last_clean_scrub_stamp":"2024-09-17T05:53:12.509392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:45:40.099479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.a","version":"0'0","reported_seq":13,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-17T05:53:16.241130+0000","last_change":"2024-09-17T05:53:14.551144+0000","last_active":"2024-09-17T05:53:16.241130+0000","last_peered":"2024-09-17T05:53:16.241130+0000","last_clean":"2024-09-17T05:53:16.241130+0000","last_became_active":"2024-09-17T05:53:14.549755+0000","last_became_peered":"2024-09-17T05:53:14.549755+0000","last_unstale":"2024-09-17T05:53:16.241130+0000","last_undegraded":"2024-09-17T05:53:16.241130+0000","last_fullsized":"2024-09-17T05:53:16.241130+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:53:13.511622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:53:13.511622+0000","last_clean_scrub_stamp":"2024-09-17T05:53:13.511622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:54:38.631637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.b","version":"140'2","reported_seq":17,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-17T05:53:17.274122+0000","last_change":"2024-09-17T05:53:13.536538+0000","last_active":"2024-09-17T05:53:17.274122+0000","last_peered":"2024-09-17T05:53:17.274122+0000","last_clean":"2024-09-17T05:53:17.274122+0000","last_became_active":"2024-09-17T05:53:13.536195+0000","last_became_peered":"2024-09-17T05:53:13.536195+0000","last_unstale":"2024-09-17T05:53:17.274122+0000","last_undegraded":"2024-09-17T05:53:17.274122+0000","last_fullsized":"2024-09-17T05:53:17.274122+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:53:12.509392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:53:12.509392+0000","last_clean_scrub_stamp":"2024-09-17T05:53:12.509392+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:31:49.206832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.b","version":"0'0","reported_seq":13,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-17T05:53:17.274086+0000","last_change":"2024-09-17T05:53:14.544766+0000","last_active":"2024-09-17T05:53:17.274086+0000","last_peered":"2024-09-17T05:53:17.274086+0000","last_clean":"2024-09-17T05:53:17.274086+0000","last_became_active":"2024-09-17T05:53:14.544470+0000","last_became_peered":"2024-09-17T05:53:14.544470+0000","last_unstale":"2024-09-17T05:53:17.274086+0000","last_undegraded":"2024-09-17T05:53:17.274086+0000","last_fullsized":"2024-09-17T05:53:17.274086+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:53:13.511622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:53:13.511622+0000","last_clean_scrub_stamp":"2024-09-17T05:53:13.511622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:02:45.848215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.a","version":"0'0","reported_seq":15,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-17T05:53:15.527504+0000","last_change":"2024-09-17T05:53:13.539072+0000","last_active":"2024-09-17T05:53:15.527504+0000","last_peered":"2024-09-17T05:53:15.527504+0000","last_clean":"2024-09-17T05:53:15.527504+0000","last_became_active":"2024-09-17T05:53:13.538503+0000","last_became_peered":"2024-09-17T05:53:13.538503+0000","last_unstale":"2024-09-17T05:53:15.527504+0000","last_undegraded":"2024-09-17T05:53:15.527504+0000","last_fullsized":"2024-09-17T05:53:15.527504+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:53:12.509392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:53:12.509392+0000","last_clean_scrub_stamp":"2024-09-17T05:53:12.509392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:17:17.870202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.8","version":"0'0","reported_seq":13,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-17T05:53:16.240464+0000","last_change":"2024-09-17T05:53:14.532298+0000","last_active":"2024-09-17T05:53:16.240464+0000","last_peered":"2024-09-17T05:53:16.240464+0000","last_clean":"2024-09-17T05:53:16.240464+0000","last_became_active":"2024-09-17T05:53:14.531914+0000","last_became_peered":"2024-09-17T05:53:14.531914+0000","last_unstale":"2024-09-17T05:53:16.240464+0000","last_undegraded":"2024-09-17T05:53:16.240464+0000","last_fullsized":"2024-09-17T05:53:16.240464+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:53:13.511622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:53:13.511622+0000","last_clean_scrub_stamp":"2024-09-17T05:53:13.511622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:05:51.764880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.9","version":"0'0","reported_seq":15,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-17T05:53:15.528312+0000","last_change":"2024-09-17T05:53:13.539530+0000","last_active":"2024-09-17T05:53:15.528312+0000","last_peered":"2024-09-17T05:53:15.528312+0000","last_clean":"2024-09-17T05:53:15.528312+0000","last_became_active":"2024-09-17T05:53:13.539215+0000","last_became_peered":"2024-09-17T05:53:13.539215+0000","last_unstale":"2024-09-17T05:53:15.528312+0000","last_undegraded":"2024-09-17T05:53:15.528312+0000","last_fullsized":"2024-09-17T05:53:15.528312+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:53:12.509392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:53:12.509392+0000","last_clean_scrub_stamp":"2024-09-17T05:53:12.509392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:51:24.706974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.9","version":"0'0","reported_seq":13,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-17T05:53:17.274016+0000","last_change":"2024-09-17T05:53:14.542206+0000","last_active":"2024-09-17T05:53:17.274016+0000","last_peered":"2024-09-17T05:53:17.274016+0000","last_clean":"2024-09-17T05:53:17.274016+0000","last_became_active":"2024-09-17T05:53:14.539611+0000","last_became_peered":"2024-09-17T05:53:14.539611+0000","last_unstale":"2024-09-17T05:53:17.274016+0000","last_undegraded":"2024-09-17T05:53:17.274016+0000","last_fullsized":"2024-09-17T05:53:17.274016+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:53:13.511622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:53:13.511622+0000","last_clean_scrub_stamp":"2024-09-17T05:53:13.511622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:33:58.589399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.8","version":"0'0","reported_seq":15,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-17T05:53:15.526857+0000","last_change":"2024-09-17T05:53:13.537852+0000","last_active":"2024-09-17T05:53:15.526857+0000","last_peered":"2024-09-17T05:53:15.526857+0000","last_clean":"2024-09-17T05:53:15.526857+0000","last_became_active":"2024-09-17T05:53:13.537532+0000","last_became_peered":"2024-09-17T05:53:13.537532+0000","last_unstale":"2024-09-17T05:53:15.526857+0000","last_undegraded":"2024-09-17T05:53:15.526857+0000","last_fullsized":"2024-09-17T05:53:15.526857+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:53:12.509392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:53:12.509392+0000","last_clean_scrub_stamp":"2024-09-17T05:53:12.509392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:08:58.592038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.6","version":"0'0","reported_seq":13,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-17T05:53:16.572412+0000","last_change":"2024-09-17T05:53:14.549803+0000","last_active":"2024-09-17T05:53:16.572412+0000","last_peered":"2024-09-17T05:53:16.572412+0000","last_clean":"2024-09-17T05:53:16.572412+0000","last_became_active":"2024-09-17T05:53:14.549429+0000","last_became_peered":"2024-09-17T05:53:14.549429+0000","last_unstale":"2024-09-17T05:53:16.572412+0000","last_undegraded":"2024-09-17T05:53:16.572412+0000","last_fullsized":"2024-09-17T05:53:16.572412+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:53:13.511622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:53:13.511622+0000","last_clean_scrub_stamp":"2024-09-17T05:53:13.511622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:11:59.457461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.7","version":"140'2","reported_seq":17,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-17T05:53:15.529063+0000","last_change":"2024-09-17T05:53:13.541601+0000","last_active":"2024-09-17T05:53:15.529063+0000","last_peered":"2024-09-17T05:53:15.529063+0000","last_clean":"2024-09-17T05:53:15.529063+0000","last_became_active":"2024-09-17T05:53:13.541201+0000","last_became_peered":"2024-09-17T05:53:13.541201+0000","last_unstale":"2024-09-17T05:53:15.529063+0000","last_undegraded":"2024-09-17T05:53:15.529063+0000","last_fullsized":"2024-09-17T05:53:15.529063+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:53:12.509392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:53:12.509392+0000","last_clean_scrub_stamp":"2024-09-17T05:53:12.509392+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:58:54.719539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.7","version":"0'0","reported_seq":13,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-17T05:53:15.529031+0000","last_change":"2024-09-17T05:53:14.548166+0000","last_active":"2024-09-17T05:53:15.529031+0000","last_peered":"2024-09-17T05:53:15.529031+0000","last_clean":"2024-09-17T05:53:15.529031+0000","last_became_active":"2024-09-17T05:53:14.547837+0000","last_became_peered":"2024-09-17T05:53:14.547837+0000","last_unstale":"2024-09-17T05:53:15.529031+0000","last_undegraded":"2024-09-17T05:53:15.529031+0000","last_fullsized":"2024-09-17T05:53:15.529031+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:53:13.511622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:53:13.511622+0000","last_clean_scrub_stamp":"2024-09-17T05:53:13.511622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:59:53.598465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.6","version":"141'1","reported_seq":16,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-17T05:53:16.529075+0000","last_change":"2024-09-17T05:53:13.537615+0000","last_active":"2024-09-17T05:53:16.529075+0000","last_peered":"2024-09-17T05:53:16.529075+0000","last_clean":"2024-09-17T05:53:16.529075+0000","last_became_active":"2024-09-17T05:53:13.537240+0000","last_became_peered":"2024-09-17T05:53:13.537240+0000","last_unstale":"2024-09-17T05:53:16.529075+0000","last_undegraded":"2024-09-17T05:53:16.529075+0000","last_fullsized":"2024-09-17T05:53:16.529075+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:53:12.509392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:53:12.509392+0000","last_clean_scrub_stamp":"2024-09-17T05:53:12.509392+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:06:00.138366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.4","version":"0'0","reported_seq":13,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-17T05:53:15.525308+0000","last_change":"2024-09-17T05:53:14.547432+0000","last_active":"2024-09-17T05:53:15.525308+0000","last_peered":"2024-09-17T05:53:15.525308+0000","last_clean":"2024-09-17T05:53:15.525308+0000","last_became_active":"2024-09-17T05:53:14.547014+0000","last_became_peered":"2024-09-17T05:53:14.547014+0000","last_unstale":"2024-09-17T05:53:15.525308+0000","last_undegraded":"2024-09-17T05:53:15.525308+0000","last_fullsized":"2024-09-17T05:53:15.525308+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:53:13.511622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:53:13.511622+0000","last_clean_scrub_stamp":"2024-09-17T05:53:13.511622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:13:41.924526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.5","version":"0'0","reported_seq":15,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-17T05:53:16.529243+0000","last_change":"2024-09-17T05:53:13.542474+0000","last_active":"2024-09-17T05:53:16.529243+0000","last_peered":"2024-09-17T05:53:16.529243+0000","last_clean":"2024-09-17T05:53:16.529243+0000","last_became_active":"2024-09-17T05:53:13.542143+0000","last_became_peered":"2024-09-17T05:53:13.542143+0000","last_unstale":"2024-09-17T05:53:16.529243+0000","last_undegraded":"2024-09-17T05:53:16.529243+0000","last_fullsized":"2024-09-17T05:53:16.529243+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:53:12.509392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:53:12.509392+0000","last_clean_scrub_stamp":"2024-09-17T05:53:12.509392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:47:51.546189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.5","version":"0'0","reported_seq":13,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-17T05:53:16.529182+0000","last_change":"2024-09-17T05:53:14.540379+0000","last_active":"2024-09-17T05:53:16.529182+0000","last_peered":"2024-09-17T05:53:16.529182+0000","last_clean":"2024-09-17T05:53:16.529182+0000","last_became_active":"2024-09-17T05:53:14.540130+0000","last_became_peered":"2024-09-17T05:53:14.540130+0000","last_unstale":"2024-09-17T05:53:16.529182+0000","last_undegraded":"2024-09-17T05:53:16.529182+0000","last_fullsized":"2024-09-17T05:53:16.529182+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:53:13.511622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:53:13.511622+0000","last_clean_scrub_stamp":"2024-09-17T05:53:13.511622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:43:21.768890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.4","version":"0'0","reported_seq":15,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-17T05:53:16.528848+0000","last_change":"2024-09-17T05:53:13.542397+0000","last_active":"2024-09-17T05:53:16.528848+0000","last_peered":"2024-09-17T05:53:16.528848+0000","last_clean":"2024-09-17T05:53:16.528848+0000","last_became_active":"2024-09-17T05:53:13.541837+0000","last_became_peered":"2024-09-17T05:53:13.541837+0000","last_unstale":"2024-09-17T05:53:16.528848+0000","last_undegraded":"2024-09-17T05:53:16.528848+0000","last_fullsized":"2024-09-17T05:53:16.528848+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:53:12.509392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:53:12.509392+0000","last_clean_scrub_stamp":"2024-09-17T05:53:12.509392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:15:09.383174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.2","version":"0'0","reported_seq":13,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-17T05:53:17.027637+0000","last_change":"2024-09-17T05:53:14.547223+0000","last_active":"2024-09-17T05:53:17.027637+0000","last_peered":"2024-09-17T05:53:17.027637+0000","last_clean":"2024-09-17T05:53:17.027637+0000","last_became_active":"2024-09-17T05:53:14.546658+0000","last_became_peered":"2024-09-17T05:53:14.546658+0000","last_unstale":"2024-09-17T05:53:17.027637+0000","last_undegraded":"2024-09-17T05:53:17.027637+0000","last_fullsized":"2024-09-17T05:53:17.027637+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:53:13.511622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:53:13.511622+0000","last_clean_scrub_stamp":"2024-09-17T05:53:13.511622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:11:59.457461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.3","version":"0'0","reported_seq":15,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-17T05:53:17.274273+0000","last_change":"2024-09-17T05:53:13.534284+0000","last_active":"2024-09-17T05:53:17.274273+0000","last_peered":"2024-09-17T05:53:17.274273+0000","last_clean":"2024-09-17T05:53:17.274273+0000","last_became_active":"2024-09-17T05:53:13.533933+0000","last_became_peered":"2024-09-17T05:53:13.533933+0000","last_unstale":"2024-09-17T05:53:17.274273+0000","last_undegraded":"2024-09-17T05:53:17.274273+0000","last_fullsized":"2024-09-17T05:53:17.274273+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:53:12.509392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:53:12.509392+0000","last_clean_scrub_stamp":"2024-09-17T05:53:12.509392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:52:01.919384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.3","version":"0'0","reported_seq":13,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-17T05:53:16.572509+0000","last_change":"2024-09-17T05:53:14.538521+0000","last_active":"2024-09-17T05:53:16.572509+0000","last_peered":"2024-09-17T05:53:16.572509+0000","last_clean":"2024-09-17T05:53:16.572509+0000","last_became_active":"2024-09-17T05:53:14.538059+0000","last_became_peered":"2024-09-17T05:53:14.538059+0000","last_unstale":"2024-09-17T05:53:16.572509+0000","last_undegraded":"2024-09-17T05:53:16.572509+0000","last_fullsized":"2024-09-17T05:53:16.572509+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:53:13.511622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:53:13.511622+0000","last_clean_scrub_stamp":"2024-09-17T05:53:13.511622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:06:01.140596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.2","version":"0'0","reported_seq":15,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-17T05:53:15.527619+0000","last_change":"2024-09-17T05:53:13.541556+0000","last_active":"2024-09-17T05:53:15.527619+0000","last_peered":"2024-09-17T05:53:15.527619+0000","last_clean":"2024-09-17T05:53:15.527619+0000","last_became_active":"2024-09-17T05:53:13.540985+0000","last_became_peered":"2024-09-17T05:53:13.540985+0000","last_unstale":"2024-09-17T05:53:15.527619+0000","last_undegraded":"2024-09-17T05:53:15.527619+0000","last_fullsized":"2024-09-17T05:53:15.527619+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:53:12.509392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:53:12.509392+0000","last_clean_scrub_stamp":"2024-09-17T05:53:12.509392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:59:32.172184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.0","version":"0'0","reported_seq":13,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-17T05:53:15.527867+0000","last_change":"2024-09-17T05:53:14.553791+0000","last_active":"2024-09-17T05:53:15.527867+0000","last_peered":"2024-09-17T05:53:15.527867+0000","last_clean":"2024-09-17T05:53:15.527867+0000","last_became_active":"2024-09-17T05:53:14.552645+0000","last_became_peered":"2024-09-17T05:53:14.552645+0000","last_unstale":"2024-09-17T05:53:15.527867+0000","last_undegraded":"2024-09-17T05:53:15.527867+0000","last_fullsized":"2024-09-17T05:53:15.527867+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:53:13.511622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:53:13.511622+0000","last_clean_scrub_stamp":"2024-09-17T05:53:13.511622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:17:37.335559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.1","version":"0'0","reported_seq":15,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-17T05:53:15.526977+0000","last_change":"2024-09-17T05:53:13.536554+0000","last_active":"2024-09-17T05:53:15.526977+0000","last_peered":"2024-09-17T05:53:15.526977+0000","last_clean":"2024-09-17T05:53:15.526977+0000","last_became_active":"2024-09-17T05:53:13.536229+0000","last_became_peered":"2024-09-17T05:53:13.536229+0000","last_unstale":"2024-09-17T05:53:15.526977+0000","last_undegraded":"2024-09-17T05:53:15.526977+0000","last_fullsized":"2024-09-17T05:53:15.526977+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:53:12.509392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:53:12.509392+0000","last_clean_scrub_stamp":"2024-09-17T05:53:12.509392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:29:10.492533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.1","version":"0'0","reported_seq":13,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-17T05:53:16.572259+0000","last_change":"2024-09-17T05:53:14.536337+0000","last_active":"2024-09-17T05:53:16.572259+0000","last_peered":"2024-09-17T05:53:16.572259+0000","last_clean":"2024-09-17T05:53:16.572259+0000","last_became_active":"2024-09-17T05:53:14.535962+0000","last_became_peered":"2024-09-17T05:53:14.535962+0000","last_unstale":"2024-09-17T05:53:16.572259+0000","last_undegraded":"2024-09-17T05:53:16.572259+0000","last_fullsized":"2024-09-17T05:53:16.572259+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:53:13.511622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:53:13.511622+0000","last_clean_scrub_stamp":"2024-09-17T05:53:13.511622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:12:43.179255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.0","version":"0'0","reported_seq":15,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-17T05:53:15.524868+0000","last_change":"2024-09-17T05:53:13.533679+0000","last_active":"2024-09-17T05:53:15.524868+0000","last_peered":"2024-09-17T05:53:15.524868+0000","last_clean":"2024-09-17T05:53:15.524868+0000","last_became_active":"2024-09-17T05:53:13.533142+0000","last_became_peered":"2024-09-17T05:53:13.533142+0000","last_unstale":"2024-09-17T05:53:15.524868+0000","last_undegraded":"2024-09-17T05:53:15.524868+0000","last_fullsized":"2024-09-17T05:53:15.524868+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:53:12.509392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:53:12.509392+0000","last_clean_scrub_stamp":"2024-09-17T05:53:12.509392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:04:36.004030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.14","version":"0'0","reported_seq":13,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-17T05:53:17.274468+0000","last_change":"2024-09-17T05:53:14.541816+0000","last_active":"2024-09-17T05:53:17.274468+0000","last_peered":"2024-09-17T05:53:17.274468+0000","last_clean":"2024-09-17T05:53:17.274468+0000","last_became_active":"2024-09-17T05:53:14.541453+0000","last_became_peered":"2024-09-17T05:53:14.541453+0000","last_unstale":"2024-09-17T05:53:17.274468+0000","last_undegraded":"2024-09-17T05:53:17.274468+0000","last_fullsized":"2024-09-17T05:53:17.274468+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:53:13.511622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:53:13.511622+0000","last_clean_scrub_stamp":"2024-09-17T05:53:13.511622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:46:47.642168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.15","version":"140'3","reported_seq":18,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-17T05:53:15.527882+0000","last_change":"2024-09-17T05:53:13.537425+0000","last_active":"2024-09-17T05:53:15.527882+0000","last_peered":"2024-09-17T05:53:15.527882+0000","last_clean":"2024-09-17T05:53:15.527882+0000","last_became_active":"2024-09-17T05:53:13.537045+0000","last_became_peered":"2024-09-17T05:53:13.537045+0000","last_unstale":"2024-09-17T05:53:15.527882+0000","last_undegraded":"2024-09-17T05:53:15.527882+0000","last_fullsized":"2024-09-17T05:53:15.527882+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:53:12.509392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:53:12.509392+0000","last_clean_scrub_stamp":"2024-09-17T05:53:12.509392+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:21:22.184350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"19'72","reported_seq":328,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-17T05:53:15.528005+0000","last_change":"2024-09-17T05:41:48.539830+0000","last_active":"2024-09-17T05:53:15.528005+0000","last_peered":"2024-09-17T05:53:15.528005+0000","last_clean":"2024-09-17T05:53:15.528005+0000","last_became_active":"2024-09-17T05:41:48.538743+0000","last_became_peered":"2024-09-17T05:41:48.538743+0000","last_unstale":"2024-09-17T05:53:15.528005+0000","last_undegraded":"2024-09-17T05:53:15.528005+0000","last_fullsized":"2024-09-17T05:53:15.528005+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:47.152539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:47.152539+0000","last_clean_scrub_stamp":"2024-09-17T05:41:47.152539+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:08:02.952016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":21,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":20,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":16,"seq":68719476879,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":145304,"kb_used_data":1728,"kb_used_omap":1,"kb_used_meta":143550,"kb_avail":94226536,"statfs":{"total":96636764160,"available":96487972864,"internally_reserved":0,"allocated":1769472,"data_stored":777586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":146995654},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":7,"up_from":15,"seq":64424509583,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":119512,"kb_used_data":2304,"kb_used_omap":1,"kb_used_meta":117182,"kb_avail":94252328,"statfs":{"total":96636764160,"available":96514383872,"internally_reserved":0,"allocated":2359296,"data_stored":1368460,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":119994826},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509582,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":131396,"kb_used_data":1708,"kb_used_omap":1,"kb_used_meta":129662,"kb_avail":94240444,"statfs":{"total":96636764160,"available":96502214656,"internally_reserved":0,"allocated":1748992,"data_stored":770966,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":132774341},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509582,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":141128,"kb_used_data":1716,"kb_used_omap":1,"kb_used_meta":139390,"kb_avail":94230712,"statfs":{"total":96636764160,"available":96492249088,"internally_reserved":0,"allocated":1757184,"data_stored":777440,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":142735813},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509582,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":123088,"kb_used_data":1720,"kb_used_omap":1,"kb_used_meta":121342,"kb_avail":94248752,"statfs":{"total":96636764160,"available":96510722048,"internally_reserved":0,"allocated":1761280,"data_stored":777530,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":124254663},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509582,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":141144,"kb_used_data":1732,"kb_used_omap":1,"kb_used_meta":139390,"kb_avail":94230696,"statfs":{"total":96636764160,"available":96492232704,"internally_reserved":0,"allocated":1773568,"data_stored":779122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":142735813},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509582,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":145292,"kb_used_data":1720,"kb_used_omap":1,"kb_used_meta":143550,"kb_avail":94226548,"statfs":{"total":96636764160,"available":96487985152,"internally_reserved":0,"allocated":1761280,"data_stored":778022,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":146995653},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574990,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":123676,"kb_used_data":2312,"kb_used_omap":1,"kb_used_meta":121342,"kb_avail":94248164,"statfs":{"total":96636764160,"available":96510119936,"internally_reserved":0,"allocated":2367488,"data_stored":1369454,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":124254661},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1646,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1682,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":146,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-17T05:53:22.350 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-17T05:53:22.351 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-09-17T05:53:22.508 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:22.506+0000 7ff880b2b640 1 -- 172.21.15.150:0/4210084395 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff87c0b7960 msgr2=0x7ff87c0af1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:53:22.508 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:22.506+0000 7ff880b2b640 1 --2- 172.21.15.150:0/4210084395 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff87c0b7960 0x7ff87c0af1f0 secure :-1 s=READY pgs=1855 cs=0 l=1 rev1=1 crypto rx=0x7ff87c0cfd70 tx=0x7ff86c02a420 comp rx=0 tx=0).stop 2024-09-17T05:53:22.508 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:22.506+0000 7ff880b2b640 1 -- 172.21.15.150:0/4210084395 shutdown_connections 2024-09-17T05:53:22.508 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:22.506+0000 7ff880b2b640 1 --2- 172.21.15.150:0/4210084395 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff87c0af730 0x7ff87c0d0fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:53:22.508 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:22.506+0000 7ff880b2b640 1 --2- 172.21.15.150:0/4210084395 >> v2:172.21.15.176:3300/0 conn(0x7ff87c0b7d70 0x7ff87c0d0a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:53:22.509 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:22.506+0000 7ff880b2b640 1 --2- 172.21.15.150:0/4210084395 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff87c0b7960 0x7ff87c0af1f0 unknown :-1 s=CLOSED pgs=1855 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:53:22.509 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:22.506+0000 7ff880b2b640 1 -- 172.21.15.150:0/4210084395 >> 172.21.15.150:0/4210084395 conn(0x7ff87c0cef20 msgr2=0x7ff87c0cf330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:53:22.509 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:22.506+0000 7ff880b2b640 1 -- 172.21.15.150:0/4210084395 shutdown_connections 2024-09-17T05:53:22.509 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:22.506+0000 7ff880b2b640 1 -- 172.21.15.150:0/4210084395 wait complete. 2024-09-17T05:53:22.510 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:22.508+0000 7ff880b2b640 1 Processor -- start 2024-09-17T05:53:22.510 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:22.508+0000 7ff880b2b640 1 -- start start 2024-09-17T05:53:22.512 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:22.509+0000 7ff880b2b640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff87c0af730 0x7ff87c1f4420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:53:22.512 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:22.509+0000 7ff880b2b640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff87c0b7960 0x7ff87c1528b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:53:22.513 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:22.509+0000 7ff880b2b640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff87c0b7d70 0x7ff87c15eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:53:22.513 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:22.509+0000 7ff880b2b640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7ff87c0ceb90 con 0x7ff87c0af730 2024-09-17T05:53:22.513 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:22.509+0000 7ff880b2b640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7ff87c0b82d0 con 0x7ff87c0b7d70 2024-09-17T05:53:22.513 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:22.509+0000 7ff880b2b640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7ff87c0ced10 con 0x7ff87c0b7960 2024-09-17T05:53:22.513 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:22.509+0000 7ff87a59c640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff87c0af730 0x7ff87c1f4420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:53:22.513 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:22.509+0000 7ff87a59c640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff87c0af730 0x7ff87c1f4420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:53694/0 (socket says 172.21.15.150:53694) 2024-09-17T05:53:22.513 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:22.509+0000 7ff87a59c640 1 -- 172.21.15.150:0/946176986 learned_addr learned my addr 172.21.15.150:0/946176986 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:53:22.513 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:22.509+0000 7ff879d9b640 1 --2- 172.21.15.150:0/946176986 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff87c0b7960 0x7ff87c1528b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:53:22.513 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:22.509+0000 7ff87ad9d640 1 --2- 172.21.15.150:0/946176986 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff87c0b7d70 0x7ff87c15eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:53:22.513 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:22.510+0000 7ff87a59c640 1 -- 172.21.15.150:0/946176986 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff87c0b7960 msgr2=0x7ff87c1528b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:53:22.513 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:22.510+0000 7ff87a59c640 1 --2- 172.21.15.150:0/946176986 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff87c0b7960 0x7ff87c1528b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:53:22.513 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:22.510+0000 7ff87a59c640 1 -- 172.21.15.150:0/946176986 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff87c0b7d70 msgr2=0x7ff87c15eb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:53:22.514 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:22.510+0000 7ff87a59c640 1 --2- 172.21.15.150:0/946176986 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff87c0b7d70 0x7ff87c15eb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:53:22.514 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:22.510+0000 7ff87a59c640 1 -- 172.21.15.150:0/946176986 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff87c1f4960 con 0x7ff87c0af730 2024-09-17T05:53:22.514 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:22.510+0000 7ff87a59c640 1 --2- 172.21.15.150:0/946176986 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff87c0af730 0x7ff87c1f4420 secure :-1 s=READY pgs=1856 cs=0 l=1 rev1=1 crypto rx=0x7ff86c0099a0 tx=0x7ff86c0049d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:53:22.514 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:22.510+0000 7ff86affd640 1 -- 172.21.15.150:0/946176986 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff86c033e60 con 0x7ff87c0af730 2024-09-17T05:53:22.514 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:22.510+0000 7ff86affd640 1 -- 172.21.15.150:0/946176986 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff86c031e50 con 0x7ff87c0af730 2024-09-17T05:53:22.514 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:22.510+0000 7ff86affd640 1 -- 172.21.15.150:0/946176986 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff86c033290 con 0x7ff87c0af730 2024-09-17T05:53:22.514 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:22.510+0000 7ff880b2b640 1 -- 172.21.15.150:0/946176986 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff87c15a560 con 0x7ff87c0af730 2024-09-17T05:53:22.514 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:22.510+0000 7ff880b2b640 1 -- 172.21.15.150:0/946176986 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff87c15dd70 con 0x7ff87c0af730 2024-09-17T05:53:22.515 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:22.511+0000 7ff880b2b640 1 -- 172.21.15.150:0/946176986 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff87c0af1f0 con 0x7ff87c0af730 2024-09-17T05:53:22.515 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:22.512+0000 7ff86affd640 1 -- 172.21.15.150:0/946176986 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 45) ==== 104501+0+0 (secure 0 0 0) 0x7ff86c033430 con 0x7ff87c0af730 2024-09-17T05:53:22.515 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:22.513+0000 7ff86affd640 1 --2- 172.21.15.150:0/946176986 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7ff85c07ad80 0x7ff85c07d290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:53:22.515 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:22.513+0000 7ff86affd640 1 -- 172.21.15.150:0/946176986 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(141..141 src has 1..141) ==== 5905+0+0 (secure 0 0 0) 0x7ff86c0bb080 con 0x7ff87c0af730 2024-09-17T05:53:22.515 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:22.513+0000 7ff879d9b640 1 --2- 172.21.15.150:0/946176986 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7ff85c07ad80 0x7ff85c07d290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:53:22.515 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:22.514+0000 7ff879d9b640 1 --2- 172.21.15.150:0/946176986 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7ff85c07ad80 0x7ff85c07d290 secure :-1 s=READY pgs=788 cs=0 l=1 rev1=1 crypto rx=0x7ff87c159c30 tx=0x7ff870005f90 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:53:22.518 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:22.517+0000 7ff86affd640 1 -- 172.21.15.150:0/946176986 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7ff87c1f4960 con 0x7ff87c0af730 2024-09-17T05:53:22.769 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:22.768+0000 7ff880b2b640 1 -- 172.21.15.150:0/946176986 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) -- 0x7ff87c0b3030 con 0x7ff87c0af730 2024-09-17T05:53:22.772 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:22.770+0000 7ff86affd640 1 -- 172.21.15.150:0/946176986 <== mon.0 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v20) ==== 190+0+147 (secure 0 0 0) 0x7ff86c03f030 con 0x7ff87c0af730 2024-09-17T05:53:22.772 INFO:teuthology.orchestra.run.smithi150.stdout:[client.0] 2024-09-17T05:53:22.772 INFO:teuthology.orchestra.run.smithi150.stdout: key = AQBoFulmfF/1HBAAMezEjZDeoHTJ+uFfDXNWHQ== 2024-09-17T05:53:22.772 INFO:teuthology.orchestra.run.smithi150.stdout: caps mds = "allow" 2024-09-17T05:53:22.772 INFO:teuthology.orchestra.run.smithi150.stdout: caps mon = "allow r" 2024-09-17T05:53:22.772 INFO:teuthology.orchestra.run.smithi150.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2024-09-17T05:53:22.773 INFO:teuthology.orchestra.run.smithi150.stderr:updated caps for client.0 2024-09-17T05:53:22.775 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:22.773+0000 7ff880b2b640 1 -- 172.21.15.150:0/946176986 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7ff85c07ad80 msgr2=0x7ff85c07d290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:53:22.775 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:22.773+0000 7ff880b2b640 1 --2- 172.21.15.150:0/946176986 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7ff85c07ad80 0x7ff85c07d290 secure :-1 s=READY pgs=788 cs=0 l=1 rev1=1 crypto rx=0x7ff87c159c30 tx=0x7ff870005f90 comp rx=0 tx=0).stop 2024-09-17T05:53:22.775 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:22.773+0000 7ff880b2b640 1 -- 172.21.15.150:0/946176986 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff87c0af730 msgr2=0x7ff87c1f4420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:53:22.775 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:22.773+0000 7ff880b2b640 1 --2- 172.21.15.150:0/946176986 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff87c0af730 0x7ff87c1f4420 secure :-1 s=READY pgs=1856 cs=0 l=1 rev1=1 crypto rx=0x7ff86c0099a0 tx=0x7ff86c0049d0 comp rx=0 tx=0).stop 2024-09-17T05:53:22.775 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:22.773+0000 7ff880b2b640 1 -- 172.21.15.150:0/946176986 shutdown_connections 2024-09-17T05:53:22.775 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:22.773+0000 7ff880b2b640 1 --2- 172.21.15.150:0/946176986 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff87c0b7d70 0x7ff87c15eb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:53:22.775 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:22.773+0000 7ff880b2b640 1 --2- 172.21.15.150:0/946176986 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7ff85c07ad80 0x7ff85c07d290 unknown :-1 s=CLOSED pgs=788 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:53:22.775 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:22.773+0000 7ff880b2b640 1 --2- 172.21.15.150:0/946176986 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff87c0b7960 0x7ff87c1528b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:53:22.775 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:22.773+0000 7ff880b2b640 1 --2- 172.21.15.150:0/946176986 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff87c0af730 0x7ff87c1f4420 unknown :-1 s=CLOSED pgs=1856 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:53:22.776 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:22.773+0000 7ff880b2b640 1 -- 172.21.15.150:0/946176986 >> 172.21.15.150:0/946176986 conn(0x7ff87c0cef20 msgr2=0x7ff87c0b1c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:53:22.776 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:22.773+0000 7ff880b2b640 1 -- 172.21.15.150:0/946176986 shutdown_connections 2024-09-17T05:53:22.776 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:22.773+0000 7ff880b2b640 1 -- 172.21.15.150:0/946176986 wait complete. 2024-09-17T05:53:22.786 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T05:53:22.899 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:22.897+0000 7f0976441640 1 -- 172.21.15.150:0/582747593 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f09700b5410 msgr2=0x7f09700b5820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:53:22.899 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:22.897+0000 7f0976441640 1 --2- 172.21.15.150:0/582747593 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f09700b5410 0x7f09700b5820 secure :-1 s=READY pgs=1857 cs=0 l=1 rev1=1 crypto rx=0x7f0970075540 tx=0x7f096802aac0 comp rx=0 tx=0).stop 2024-09-17T05:53:22.899 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:22.897+0000 7f0976441640 1 -- 172.21.15.150:0/582747593 shutdown_connections 2024-09-17T05:53:22.899 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:22.897+0000 7f0976441640 1 --2- 172.21.15.150:0/582747593 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f09700b5410 0x7f09700b5820 unknown :-1 s=CLOSED pgs=1857 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:53:22.899 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:22.897+0000 7f0976441640 1 --2- 172.21.15.150:0/582747593 >> v2:172.21.15.176:3300/0 conn(0x7f09700cf7c0 0x7f09700cfbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:53:22.900 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:22.897+0000 7f0976441640 1 -- 172.21.15.150:0/582747593 >> 172.21.15.150:0/582747593 conn(0x7f09700b2fd0 msgr2=0x7f09700b33e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:53:22.900 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:22.897+0000 7f0976441640 1 -- 172.21.15.150:0/582747593 shutdown_connections 2024-09-17T05:53:22.900 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:22.897+0000 7f0976441640 1 -- 172.21.15.150:0/582747593 wait complete. 2024-09-17T05:53:22.900 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:22.899+0000 7f0976441640 1 Processor -- start 2024-09-17T05:53:22.901 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:22.899+0000 7f0976441640 1 -- start start 2024-09-17T05:53:22.903 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:22.900+0000 7f0976441640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f09700b5410 0x7f097009ec30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:53:22.903 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:22.900+0000 7f0976441640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f09700cf7c0 0x7f0970156970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:53:22.903 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:22.900+0000 7f0976441640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f097015ee30 0x7f09701f6e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:53:22.903 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:22.900+0000 7f0976441640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f09700b60f0 con 0x7f097015ee30 2024-09-17T05:53:22.903 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:22.900+0000 7f0976441640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f09700b5f70 con 0x7f09700cf7c0 2024-09-17T05:53:22.903 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:22.900+0000 7f0976441640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f09700b6270 con 0x7f09700b5410 2024-09-17T05:53:22.903 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:22.900+0000 7f09749de640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f097015ee30 0x7f09701f6e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:53:22.904 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:22.901+0000 7f09749de640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f097015ee30 0x7f09701f6e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:53706/0 (socket says 172.21.15.150:53706) 2024-09-17T05:53:22.904 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:22.901+0000 7f09749de640 1 -- 172.21.15.150:0/501465688 learned_addr learned my addr 172.21.15.150:0/501465688 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:53:22.904 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:22.901+0000 7f096f7fe640 1 --2- 172.21.15.150:0/501465688 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f09700cf7c0 0x7f0970156970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:53:22.904 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:22.901+0000 7f096ffff640 1 --2- 172.21.15.150:0/501465688 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f09700b5410 0x7f097009ec30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:53:22.904 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:22.901+0000 7f09749de640 1 -- 172.21.15.150:0/501465688 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f09700b5410 msgr2=0x7f097009ec30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:53:22.904 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:22.901+0000 7f09749de640 1 --2- 172.21.15.150:0/501465688 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f09700b5410 0x7f097009ec30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:53:22.904 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:22.901+0000 7f09749de640 1 -- 172.21.15.150:0/501465688 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f09700cf7c0 msgr2=0x7f0970156970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:53:22.904 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:22.901+0000 7f09749de640 1 --2- 172.21.15.150:0/501465688 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f09700cf7c0 0x7f0970156970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:53:22.904 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:22.901+0000 7f09749de640 1 -- 172.21.15.150:0/501465688 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0970155150 con 0x7f097015ee30 2024-09-17T05:53:22.904 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:22.901+0000 7f096ffff640 1 --2- 172.21.15.150:0/501465688 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f09700b5410 0x7f097009ec30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:53:22.904 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:22.901+0000 7f09749de640 1 --2- 172.21.15.150:0/501465688 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f097015ee30 0x7f09701f6e10 secure :-1 s=READY pgs=1858 cs=0 l=1 rev1=1 crypto rx=0x7f0968009d60 tx=0x7f0968003ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:53:22.904 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:22.901+0000 7f096cff9640 1 -- 172.21.15.150:0/501465688 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0968044070 con 0x7f097015ee30 2024-09-17T05:53:22.904 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:22.901+0000 7f096cff9640 1 -- 172.21.15.150:0/501465688 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0968004250 con 0x7f097015ee30 2024-09-17T05:53:22.905 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:22.901+0000 7f0976441640 1 -- 172.21.15.150:0/501465688 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0970155430 con 0x7f097015ee30 2024-09-17T05:53:22.905 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:22.901+0000 7f096cff9640 1 -- 172.21.15.150:0/501465688 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f09680046a0 con 0x7f097015ee30 2024-09-17T05:53:22.905 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:22.901+0000 7f0976441640 1 -- 172.21.15.150:0/501465688 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f09701559f0 con 0x7f097015ee30 2024-09-17T05:53:22.905 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:22.902+0000 7f0976441640 1 -- 172.21.15.150:0/501465688 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f097015e0f0 con 0x7f097015ee30 2024-09-17T05:53:22.905 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:22.903+0000 7f096cff9640 1 -- 172.21.15.150:0/501465688 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 45) ==== 104501+0+0 (secure 0 0 0) 0x7f0968036400 con 0x7f097015ee30 2024-09-17T05:53:22.906 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:22.904+0000 7f096cff9640 1 --2- 172.21.15.150:0/501465688 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f095c07ad50 0x7f095c07d260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:53:22.906 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:22.904+0000 7f096cff9640 1 -- 172.21.15.150:0/501465688 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(141..141 src has 1..141) ==== 5905+0+0 (secure 0 0 0) 0x7f09680bae10 con 0x7f097015ee30 2024-09-17T05:53:22.906 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:22.904+0000 7f096ffff640 1 --2- 172.21.15.150:0/501465688 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f095c07ad50 0x7f095c07d260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:53:22.906 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:22.905+0000 7f096ffff640 1 --2- 172.21.15.150:0/501465688 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f095c07ad50 0x7f095c07d260 secure :-1 s=READY pgs=789 cs=0 l=1 rev1=1 crypto rx=0x7f0960007fd0 tx=0x7f0960009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:53:22.909 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:22.907+0000 7f096cff9640 1 -- 172.21.15.150:0/501465688 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f097015e0f0 con 0x7f097015ee30 2024-09-17T05:53:23.117 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:23.115+0000 7f0976441640 1 -- 172.21.15.150:0/501465688 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f09700cfbd0 con 0x7f097015ee30 2024-09-17T05:53:23.117 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:23.116+0000 7f096cff9640 1 -- 172.21.15.150:0/501465688 <== mon.0 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 88 v88) ==== 94+0+5233 (secure 0 0 0) 0x7f0968032030 con 0x7f097015ee30 2024-09-17T05:53:23.118 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-09-17T05:53:23.118 INFO:teuthology.orchestra.run.smithi150.stdout:{"epoch":88,"btime":"2024-09-17T05:53:16:540972+0000","default_fscid":10,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7418,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6836/984747558","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6834","nonce":984747558},{"type":"v1","addr":"172.21.15.176:6836","nonce":984747558}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":85},{"gid":7421,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6837/1815277837","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6835","nonce":1815277837},{"type":"v1","addr":"172.21.15.176:6837","nonce":1815277837}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":85},{"gid":9630,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6834/2397551288","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6832","nonce":2397551288},{"type":"v1","addr":"172.21.15.150:6834","nonce":2397551288}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":84}],"filesystems":[{"mdsmap":{"epoch":88,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T05:53:13.900105+0000","modified":"2024-09-17T05:53:15.896921+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":9633},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9633":{"gid":9633,"name":"c","rank":0,"incarnation":86,"state":"up:active","state_seq":3,"addr":"172.21.15.150:6835/122540131","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6833","nonce":122540131},{"type":"v1","addr":"172.21.15.150:6835","nonce":122540131}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[21],"metadata_pool":20,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":9633,"qdb_cluster":[9633]},"id":10}]} 2024-09-17T05:53:23.118 INFO:teuthology.orchestra.run.smithi150.stderr:dumped fsmap epoch 88 2024-09-17T05:53:23.120 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:23.118+0000 7f0976441640 1 -- 172.21.15.150:0/501465688 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f095c07ad50 msgr2=0x7f095c07d260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:53:23.120 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:23.118+0000 7f0976441640 1 --2- 172.21.15.150:0/501465688 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f095c07ad50 0x7f095c07d260 secure :-1 s=READY pgs=789 cs=0 l=1 rev1=1 crypto rx=0x7f0960007fd0 tx=0x7f0960009040 comp rx=0 tx=0).stop 2024-09-17T05:53:23.120 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:23.118+0000 7f0976441640 1 -- 172.21.15.150:0/501465688 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f097015ee30 msgr2=0x7f09701f6e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:53:23.120 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:23.118+0000 7f0976441640 1 --2- 172.21.15.150:0/501465688 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f097015ee30 0x7f09701f6e10 secure :-1 s=READY pgs=1858 cs=0 l=1 rev1=1 crypto rx=0x7f0968009d60 tx=0x7f0968003ce0 comp rx=0 tx=0).stop 2024-09-17T05:53:23.120 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:23.118+0000 7f0976441640 1 -- 172.21.15.150:0/501465688 shutdown_connections 2024-09-17T05:53:23.120 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:23.118+0000 7f0976441640 1 --2- 172.21.15.150:0/501465688 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f09700cf7c0 0x7f0970156970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:53:23.120 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:23.118+0000 7f0976441640 1 --2- 172.21.15.150:0/501465688 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f095c07ad50 0x7f095c07d260 unknown :-1 s=CLOSED pgs=789 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:53:23.121 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:23.118+0000 7f0976441640 1 --2- 172.21.15.150:0/501465688 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f097015ee30 0x7f09701f6e10 unknown :-1 s=CLOSED pgs=1858 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:53:23.121 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:23.118+0000 7f0976441640 1 --2- 172.21.15.150:0/501465688 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f09700b5410 0x7f097009ec30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:53:23.121 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:23.118+0000 7f0976441640 1 -- 172.21.15.150:0/501465688 >> 172.21.15.150:0/501465688 conn(0x7f09700b2fd0 msgr2=0x7f09700b33e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:53:23.121 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:23.118+0000 7f0976441640 1 -- 172.21.15.150:0/501465688 shutdown_connections 2024-09-17T05:53:23.121 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:23.118+0000 7f0976441640 1 -- 172.21.15.150:0/501465688 wait complete. 2024-09-17T05:53:23.534 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 88, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-17T05:53:13.900105+0000', 'modified': '2024-09-17T05:53:15.896921+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 9633}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_9633': {'gid': 9633, 'name': 'c', 'rank': 0, 'incarnation': 86, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.150:6835/122540131', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.150:6833', 'nonce': 122540131}, {'type': 'v1', 'addr': '172.21.15.150:6835', 'nonce': 122540131}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [21], 'metadata_pool': 20, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 9633, 'qdb_cluster': [9633]} 2024-09-17T05:53:23.535 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-17T05:53:23.535 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2024-09-17T05:53:23.654 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:23.652+0000 7f3465e0e640 1 -- 172.21.15.150:0/1451899519 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f344c003fd0 msgr2=0x7f344c004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:53:23.654 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:23.652+0000 7f3465e0e640 1 --2- 172.21.15.150:0/1451899519 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f344c003fd0 0x7f344c004800 secure :-1 s=READY pgs=1860 cs=0 l=1 rev1=1 crypto rx=0x7f346009bfb0 tx=0x7f344c005830 comp rx=0 tx=0).stop 2024-09-17T05:53:23.655 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:23.652+0000 7f345ffff640 1 -- 172.21.15.150:0/1451899519 reap_dead start 2024-09-17T05:53:23.655 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:23.652+0000 7f3465e0e640 1 -- 172.21.15.150:0/1451899519 shutdown_connections 2024-09-17T05:53:23.655 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:23.652+0000 7f3465e0e640 1 -- 172.21.15.150:0/1451899519 >> 172.21.15.150:0/1451899519 conn(0x7f34600cef30 msgr2=0x7f34600cf340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:53:23.655 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:23.652+0000 7f3465e0e640 1 -- 172.21.15.150:0/1451899519 shutdown_connections 2024-09-17T05:53:23.655 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:23.652+0000 7f3465e0e640 1 -- 172.21.15.150:0/1451899519 wait complete. 2024-09-17T05:53:23.655 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:23.654+0000 7f3465e0e640 1 Processor -- start 2024-09-17T05:53:23.655 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:23.654+0000 7f3465e0e640 1 -- start start 2024-09-17T05:53:23.658 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:23.655+0000 7f3465e0e640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f344c003fd0 0x7f34601dba40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:53:23.658 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:23.655+0000 7f3465e0e640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f34600ca3f0 0x7f34600b2b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:53:23.658 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:23.655+0000 7f3465e0e640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f346006f780 0x7f34601f8fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:53:23.658 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:23.655+0000 7f3465e0e640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f34600cecf0 con 0x7f346006f780 2024-09-17T05:53:23.658 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:23.655+0000 7f3465e0e640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f34600ceb70 con 0x7f344c003fd0 2024-09-17T05:53:23.658 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:23.655+0000 7f3465e0e640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f34600d0590 con 0x7f34600ca3f0 2024-09-17T05:53:23.658 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:23.655+0000 7f345ffff640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f346006f780 0x7f34601f8fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:53:23.658 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:23.655+0000 7f345ffff640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f346006f780 0x7f34601f8fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:53724/0 (socket says 172.21.15.150:53724) 2024-09-17T05:53:23.658 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:23.655+0000 7f345ffff640 1 -- 172.21.15.150:0/2728022049 learned_addr learned my addr 172.21.15.150:0/2728022049 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:53:23.659 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:23.655+0000 7f345f7fe640 1 --2- 172.21.15.150:0/2728022049 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f344c003fd0 0x7f34601dba40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:53:23.659 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:23.655+0000 7f3457fff640 1 --2- 172.21.15.150:0/2728022049 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f34600ca3f0 0x7f34600b2b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:53:23.659 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:23.655+0000 7f345ffff640 1 -- 172.21.15.150:0/2728022049 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f34600ca3f0 msgr2=0x7f34600b2b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:53:23.659 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:23.655+0000 7f345ffff640 1 --2- 172.21.15.150:0/2728022049 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f34600ca3f0 0x7f34600b2b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:53:23.659 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:23.655+0000 7f345ffff640 1 -- 172.21.15.150:0/2728022049 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f344c003fd0 msgr2=0x7f34601dba40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:53:23.659 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:23.655+0000 7f345ffff640 1 --2- 172.21.15.150:0/2728022049 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f344c003fd0 0x7f34601dba40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:53:23.659 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:23.655+0000 7f345ffff640 1 -- 172.21.15.150:0/2728022049 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f34600b1d40 con 0x7f346006f780 2024-09-17T05:53:23.659 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:23.655+0000 7f345f7fe640 1 --2- 172.21.15.150:0/2728022049 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f344c003fd0 0x7f34601dba40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T05:53:23.659 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:23.655+0000 7f345ffff640 1 --2- 172.21.15.150:0/2728022049 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f346006f780 0x7f34601f8fe0 secure :-1 s=READY pgs=1861 cs=0 l=1 rev1=1 crypto rx=0x7f3460074270 tx=0x7f345800ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:53:23.659 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:23.656+0000 7f345cff9640 1 -- 172.21.15.150:0/2728022049 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f345800cba0 con 0x7f346006f780 2024-09-17T05:53:23.659 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:23.656+0000 7f345cff9640 1 -- 172.21.15.150:0/2728022049 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f3458017070 con 0x7f346006f780 2024-09-17T05:53:23.659 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:23.656+0000 7f3465e0e640 1 -- 172.21.15.150:0/2728022049 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f34600b2020 con 0x7f346006f780 2024-09-17T05:53:23.659 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:23.656+0000 7f345cff9640 1 -- 172.21.15.150:0/2728022049 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34580116c0 con 0x7f346006f780 2024-09-17T05:53:23.660 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:23.656+0000 7f3465e0e640 1 -- 172.21.15.150:0/2728022049 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f34601f9e00 con 0x7f346006f780 2024-09-17T05:53:23.660 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:23.657+0000 7f345cff9640 1 -- 172.21.15.150:0/2728022049 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 45) ==== 104501+0+0 (secure 0 0 0) 0x7f3458011860 con 0x7f346006f780 2024-09-17T05:53:23.661 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:23.658+0000 7f345cff9640 1 --2- 172.21.15.150:0/2728022049 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f344007ad50 0x7f344007d260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:53:23.661 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:23.658+0000 7f345cff9640 1 -- 172.21.15.150:0/2728022049 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(141..141 src has 1..141) ==== 5905+0+0 (secure 0 0 0) 0x7f345809a2b0 con 0x7f346006f780 2024-09-17T05:53:23.661 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:23.658+0000 7f345f7fe640 1 --2- 172.21.15.150:0/2728022049 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f344007ad50 0x7f344007d260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:53:23.661 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:23.659+0000 7f345f7fe640 1 --2- 172.21.15.150:0/2728022049 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f344007ad50 0x7f344007d260 secure :-1 s=READY pgs=790 cs=0 l=1 rev1=1 crypto rx=0x7f3450009aa0 tx=0x7f3450005f30 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:53:23.661 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:23.659+0000 7f346ce5a740 1 Processor -- start 2024-09-17T05:53:23.661 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:23.659+0000 7f346ce5a740 1 -- start start 2024-09-17T05:53:23.663 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:23.661+0000 7f346ce5a740 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55aa33784270 0x55aa33b55fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:53:23.663 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:23.661+0000 7f346ce5a740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55aa3375b3b0 0x55aa33b56500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:53:23.663 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:23.661+0000 7f346ce5a740 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55aa33763590 0x55aa33b73400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:53:23.664 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:23.661+0000 7f346ce5a740 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x55aa33a9e820 con 0x55aa33784270 2024-09-17T05:53:23.664 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:23.661+0000 7f346ce5a740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x55aa33a8dc50 con 0x55aa3375b3b0 2024-09-17T05:53:23.664 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:23.661+0000 7f346ce5a740 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x55aa33a91a60 con 0x55aa33763590 2024-09-17T05:53:23.664 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:23.661+0000 7f345f7fe640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55aa33784270 0x55aa33b55fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:53:23.664 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:23.661+0000 7f345f7fe640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55aa33784270 0x55aa33b55fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:53736/0 (socket says 172.21.15.150:53736) 2024-09-17T05:53:23.664 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:23.661+0000 7f345f7fe640 1 -- 172.21.15.150:0/3341517598 learned_addr learned my addr 172.21.15.150:0/3341517598 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:53:23.664 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:23.661+0000 7f345ffff640 1 --2- 172.21.15.150:0/3341517598 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55aa33763590 0x55aa33b73400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:53:23.664 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:23.661+0000 7f3457fff640 1 --2- 172.21.15.150:0/3341517598 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55aa3375b3b0 0x55aa33b56500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:53:23.664 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:23.661+0000 7f345f7fe640 1 -- 172.21.15.150:0/3341517598 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55aa33763590 msgr2=0x55aa33b73400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:53:23.664 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:23.661+0000 7f345f7fe640 1 --2- 172.21.15.150:0/3341517598 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55aa33763590 0x55aa33b73400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:53:23.664 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:23.661+0000 7f345f7fe640 1 -- 172.21.15.150:0/3341517598 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55aa3375b3b0 msgr2=0x55aa33b56500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:53:23.664 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:23.661+0000 7f345f7fe640 1 --2- 172.21.15.150:0/3341517598 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55aa3375b3b0 0x55aa33b56500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:53:23.664 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:23.661+0000 7f345f7fe640 1 -- 172.21.15.150:0/3341517598 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55aa337ef850 con 0x55aa33784270 2024-09-17T05:53:23.665 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:23.661+0000 7f345f7fe640 1 --2- 172.21.15.150:0/3341517598 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55aa33784270 0x55aa33b55fc0 secure :-1 s=READY pgs=1862 cs=0 l=1 rev1=1 crypto rx=0x7f3450013f70 tx=0x7f3450016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a589486899bf1eb2 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:53:23.665 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:23.661+0000 7f34557fa640 1 -- 172.21.15.150:0/3341517598 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f345001c660 con 0x55aa33784270 2024-09-17T05:53:23.665 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:23.661+0000 7f34557fa640 1 -- 172.21.15.150:0/3341517598 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f345001c800 con 0x55aa33784270 2024-09-17T05:53:23.665 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:23.661+0000 7f34557fa640 1 -- 172.21.15.150:0/3341517598 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f345001cc10 con 0x55aa33784270 2024-09-17T05:53:23.666 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:23.662+0000 7f346ce5a740 1 -- 172.21.15.150:0/3341517598 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55aa33784270 msgr2=0x55aa33b55fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:53:23.666 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:23.662+0000 7f346ce5a740 1 --2- 172.21.15.150:0/3341517598 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55aa33784270 0x55aa33b55fc0 secure :-1 s=READY pgs=1862 cs=0 l=1 rev1=1 crypto rx=0x7f3450013f70 tx=0x7f3450016000 comp rx=0 tx=0).stop 2024-09-17T05:53:23.666 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:23.662+0000 7f346ce5a740 1 -- 172.21.15.150:0/3341517598 shutdown_connections 2024-09-17T05:53:23.666 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:23.662+0000 7f346ce5a740 1 --2- 172.21.15.150:0/3341517598 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55aa3375b3b0 0x55aa33b56500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:53:23.666 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:23.662+0000 7f346ce5a740 1 --2- 172.21.15.150:0/3341517598 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55aa33763590 0x55aa33b73400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:53:23.666 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:23.662+0000 7f346ce5a740 1 --2- 172.21.15.150:0/3341517598 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55aa33784270 0x55aa33b55fc0 unknown :-1 s=CLOSED pgs=1862 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:53:23.666 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:23.662+0000 7f346ce5a740 1 -- 172.21.15.150:0/3341517598 >> 172.21.15.150:0/3341517598 conn(0x55aa337783c0 msgr2=0x55aa33b2c280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:53:23.666 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:23.662+0000 7f346ce5a740 1 -- 172.21.15.150:0/3341517598 shutdown_connections 2024-09-17T05:53:23.666 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:23.662+0000 7f346ce5a740 1 -- 172.21.15.150:0/3341517598 wait complete. 2024-09-17T05:53:23.666 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:23.663+0000 7f346ce5a740 1 -- start start 2024-09-17T05:53:23.666 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:23.663+0000 7f346ce5a740 1 Processor -- start 2024-09-17T05:53:23.670 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:23.665+0000 7f346ce5a740 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55aa3375b3b0 0x55aa33b80e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:53:23.670 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:23.665+0000 7f346ce5a740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55aa33763590 0x55aa33b71480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:53:23.670 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:23.665+0000 7f346ce5a740 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55aa33784270 0x55aa33b83920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:53:23.670 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:23.665+0000 7f346ce5a740 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x55aa337fe620 con 0x55aa33784270 2024-09-17T05:53:23.670 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:23.665+0000 7f346ce5a740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x55aa33a335f0 con 0x55aa33763590 2024-09-17T05:53:23.670 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:23.665+0000 7f346ce5a740 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x55aa33b56a40 con 0x55aa3375b3b0 2024-09-17T05:53:23.670 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:23.665+0000 7f346ce5a740 10 client.0 _ll_register_callbacks cb 0x55aa33a370a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T05:53:23.671 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:23.665+0000 7f345ffff640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55aa33784270 0x55aa33b83920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:53:23.671 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:23.665+0000 7f345ffff640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55aa33784270 0x55aa33b83920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:53746/0 (socket says 172.21.15.150:53746) 2024-09-17T05:53:23.671 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:23.665+0000 7f345ffff640 1 -- 172.21.15.150:0/1457473544 learned_addr learned my addr 172.21.15.150:0/1457473544 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:53:23.671 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:23.665+0000 7f3457fff640 1 --2- 172.21.15.150:0/1457473544 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55aa33763590 0x55aa33b71480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:53:23.671 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:23.665+0000 7f345f7fe640 1 --2- 172.21.15.150:0/1457473544 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55aa3375b3b0 0x55aa33b80e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:53:23.671 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:23.665+0000 7f345ffff640 1 -- 172.21.15.150:0/1457473544 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55aa3375b3b0 msgr2=0x55aa33b80e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:53:23.671 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:23.665+0000 7f345ffff640 1 --2- 172.21.15.150:0/1457473544 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55aa3375b3b0 0x55aa33b80e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:53:23.671 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:23.665+0000 7f345ffff640 1 -- 172.21.15.150:0/1457473544 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55aa33763590 msgr2=0x55aa33b71480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:53:23.671 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:23.665+0000 7f345ffff640 1 --2- 172.21.15.150:0/1457473544 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55aa33763590 0x55aa33b71480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:53:23.671 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:23.665+0000 7f345ffff640 1 -- 172.21.15.150:0/1457473544 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55aa338666b0 con 0x55aa33784270 2024-09-17T05:53:23.671 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:23.665+0000 7f345f7fe640 1 --2- 172.21.15.150:0/1457473544 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55aa3375b3b0 0x55aa33b80e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T05:53:23.671 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:23.665+0000 7f345ffff640 1 --2- 172.21.15.150:0/1457473544 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55aa33784270 0x55aa33b83920 secure :-1 s=READY pgs=1863 cs=0 l=1 rev1=1 crypto rx=0x7f3458063880 tx=0x7f3458064120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=165291c5b476cdc9 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:53:23.671 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:23.665+0000 7f343e7fc640 10 client.0 ms_handle_connect on v2:172.21.15.150:3300/0 2024-09-17T05:53:23.672 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:23.665+0000 7f343e7fc640 1 -- 172.21.15.150:0/1457473544 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f345800ce70 con 0x55aa33784270 2024-09-17T05:53:23.672 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:23.665+0000 7f343e7fc640 1 -- 172.21.15.150:0/1457473544 <== mon.0 v2:172.21.15.150:3300/0 2 ==== osd_map(141..141 src has 1..141) ==== 5905+0+0 (secure 0 0 0) 0x7f3458062de0 con 0x55aa33784270 2024-09-17T05:53:23.672 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:23.665+0000 7f346ce5a740 1 -- 172.21.15.150:0/1457473544 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f345001c800 con 0x55aa33784270 2024-09-17T05:53:23.672 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:23.665+0000 7f343e7fc640 1 -- 172.21.15.150:0/1457473544 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_get_version_reply(handle=1 version=88) ==== 24+0+0 (secure 0 0 0) 0x7f3458064280 con 0x55aa33784270 2024-09-17T05:53:23.672 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:23.666+0000 7f346ce5a740 10 client.9780 fetch_fsmap learned FSMap version 88 2024-09-17T05:53:23.672 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:23.666+0000 7f346ce5a740 1 -- 172.21.15.150:0/1457473544 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,fsmap=88,monmap=2+}) -- 0x55aa33b80330 con 0x55aa33784270 2024-09-17T05:53:23.672 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:23.666+0000 7f343e7fc640 1 -- 172.21.15.150:0/1457473544 <== mon.0 v2:172.21.15.150:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f345001c800 con 0x55aa33784270 2024-09-17T05:53:23.672 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:23.666+0000 7f343e7fc640 1 -- 172.21.15.150:0/1457473544 <== mon.0 v2:172.21.15.150:3300/0 5 ==== fsmap(e 88) ==== 3502+0+0 (secure 0 0 0) 0x7f3458087070 con 0x55aa33784270 2024-09-17T05:53:23.672 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:23.666+0000 7f346ce5a740 10 client.9780 fetch_fsmap finished waiting for FSMap version 88 2024-09-17T05:53:23.672 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:23.666+0000 7f346ce5a740 10 client.9780 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-17T05:53:23.672 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:23.666+0000 7f346ce5a740 20 client.9780 populate_metadata read hostname 'smithi150' 2024-09-17T05:53:23.672 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:23.666+0000 7f346ce5a740 1 --2- 172.21.15.150:0/1457473544 >> [v2:172.21.15.150:6833/122540131,v1:172.21.15.150:6835/122540131] conn(0x55aa33742e40 0x55aa33b74490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:53:23.672 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:23.666+0000 7f346ce5a740 4 client.9780 mds_command: new command op to 9633 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-17T05:53:23.673 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:23.666+0000 7f346ce5a740 1 -- 172.21.15.150:0/1457473544 --> [v2:172.21.15.150:6833/122540131,v1:172.21.15.150:6835/122540131] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55aa33aa0770 con 0x55aa33742e40 2024-09-17T05:53:23.673 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:23.666+0000 7f345f7fe640 1 --2- 172.21.15.150:0/1457473544 >> [v2:172.21.15.150:6833/122540131,v1:172.21.15.150:6835/122540131] conn(0x55aa33742e40 0x55aa33b74490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:53:23.673 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:23.666+0000 7f343e7fc640 10 client.9780 ms_handle_connect on v2:172.21.15.150:6833/122540131 2024-09-17T05:53:23.673 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:23.666+0000 7f345f7fe640 1 --2- 172.21.15.150:0/1457473544 >> [v2:172.21.15.150:6833/122540131,v1:172.21.15.150:6835/122540131] conn(0x55aa33742e40 0x55aa33b74490 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=40ab4a17586e7894 server_cookie=abcc533ab7a9bbd2 in_seq=0 out_seq=0 2024-09-17T05:53:23.673 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:23.667+0000 7f343e7fc640 1 -- 172.21.15.150:0/1457473544 <== mds.0 v2:172.21.15.150:6833/122540131 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55aa33aa0770 con 0x55aa33742e40 2024-09-17T05:53:23.673 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:23.667+0000 7f343e7fc640 10 client.9780 handle_command_reply: tid=0 2024-09-17T05:53:23.673 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:23.667+0000 7f346ce5a740 1 client.9780 shutdown 2024-09-17T05:53:23.673 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:23.667+0000 7f346ce5a740 1 -- 172.21.15.150:0/1457473544 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55aa33784270 msgr2=0x55aa33b83920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:53:23.673 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:23.667+0000 7f346ce5a740 1 --2- 172.21.15.150:0/1457473544 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55aa33784270 0x55aa33b83920 secure :-1 s=READY pgs=1863 cs=0 l=1 rev1=1 crypto rx=0x7f3458063880 tx=0x7f3458064120 comp rx=0 tx=0).stop 2024-09-17T05:53:23.673 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:23.667+0000 7f346ce5a740 1 -- 172.21.15.150:0/1457473544 shutdown_connections 2024-09-17T05:53:23.673 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:23.667+0000 7f346ce5a740 1 --2- 172.21.15.150:0/1457473544 >> [v2:172.21.15.150:6833/122540131,v1:172.21.15.150:6835/122540131] conn(0x55aa33742e40 0x55aa33b74490 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:53:23.673 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:23.667+0000 7f346ce5a740 1 --2- 172.21.15.150:0/1457473544 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55aa33763590 0x55aa33b71480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:53:23.674 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:23.667+0000 7f346ce5a740 1 --2- 172.21.15.150:0/1457473544 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55aa33784270 0x55aa33b83920 unknown :-1 s=CLOSED pgs=1863 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:53:23.674 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:23.667+0000 7f343e7fc640 0 client.9780 ms_handle_reset on v2:172.21.15.150:6833/122540131 2024-09-17T05:53:23.674 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:23.667+0000 7f346ce5a740 1 --2- 172.21.15.150:0/1457473544 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55aa3375b3b0 0x55aa33b80e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:53:23.674 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:23.667+0000 7f346ce5a740 1 -- 172.21.15.150:0/1457473544 >> 172.21.15.150:0/1457473544 conn(0x55aa337783c0 msgr2=0x55aa33b25df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:53:23.674 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:23.667+0000 7f346ce5a740 1 -- 172.21.15.150:0/1457473544 shutdown_connections 2024-09-17T05:53:23.674 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:23.667+0000 7f346ce5a740 1 -- 172.21.15.150:0/1457473544 wait complete. 2024-09-17T05:53:23.674 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:23.667+0000 7f346ce5a740 20 client.9780 trim_cache size 0 max 16384 2024-09-17T05:53:23.687 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:23.686+0000 7f346ce5a740 1 Processor -- start 2024-09-17T05:53:23.688 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:23.686+0000 7f346ce5a740 1 -- start start 2024-09-17T05:53:23.691 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:23.687+0000 7f346ce5a740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55aa3375b3b0 0x55aa33b6fc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:53:23.691 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:23.687+0000 7f346ce5a740 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55aa33763590 0x55aa33b2c110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:53:23.691 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:23.687+0000 7f346ce5a740 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55aa33784270 0x55aa33b2c650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:53:23.691 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:23.687+0000 7f346ce5a740 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f34602029d0 con 0x55aa33763590 2024-09-17T05:53:23.691 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:23.687+0000 7f346ce5a740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f34602019e0 con 0x55aa3375b3b0 2024-09-17T05:53:23.691 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:23.687+0000 7f346ce5a740 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f34600cbae0 con 0x55aa33784270 2024-09-17T05:53:23.691 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:23.687+0000 7f3457fff640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55aa33763590 0x55aa33b2c110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:53:23.691 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:23.687+0000 7f3457fff640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55aa33763590 0x55aa33b2c110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:53754/0 (socket says 172.21.15.150:53754) 2024-09-17T05:53:23.692 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:23.687+0000 7f3457fff640 1 -- 172.21.15.150:0/630600617 learned_addr learned my addr 172.21.15.150:0/630600617 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:53:23.692 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:23.687+0000 7f345f7fe640 1 --2- 172.21.15.150:0/630600617 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55aa3375b3b0 0x55aa33b6fc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:53:23.692 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:23.687+0000 7f345ffff640 1 --2- 172.21.15.150:0/630600617 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55aa33784270 0x55aa33b2c650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:53:23.692 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:23.688+0000 7f3457fff640 1 -- 172.21.15.150:0/630600617 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55aa33784270 msgr2=0x55aa33b2c650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:53:23.692 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:23.688+0000 7f3457fff640 1 --2- 172.21.15.150:0/630600617 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55aa33784270 0x55aa33b2c650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:53:23.692 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:23.688+0000 7f3457fff640 1 -- 172.21.15.150:0/630600617 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55aa3375b3b0 msgr2=0x55aa33b6fc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:53:23.692 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:23.688+0000 7f3457fff640 1 --2- 172.21.15.150:0/630600617 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55aa3375b3b0 0x55aa33b6fc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:53:23.692 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:23.688+0000 7f3457fff640 1 -- 172.21.15.150:0/630600617 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55aa33b6d8f0 con 0x55aa33763590 2024-09-17T05:53:23.692 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:23.688+0000 7f345f7fe640 1 --2- 172.21.15.150:0/630600617 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55aa3375b3b0 0x55aa33b6fc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:53:23.692 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:23.688+0000 7f3457fff640 1 --2- 172.21.15.150:0/630600617 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55aa33763590 0x55aa33b2c110 secure :-1 s=READY pgs=1864 cs=0 l=1 rev1=1 crypto rx=0x7f344802b4d0 tx=0x7f34480046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7ca5b54cd3aed91 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:53:23.692 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:23.688+0000 7f3454ff9640 1 -- 172.21.15.150:0/630600617 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3448042030 con 0x55aa33763590 2024-09-17T05:53:23.692 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:23.688+0000 7f3454ff9640 1 -- 172.21.15.150:0/630600617 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f3448004110 con 0x55aa33763590 2024-09-17T05:53:23.693 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:23.688+0000 7f3454ff9640 1 -- 172.21.15.150:0/630600617 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3448038040 con 0x55aa33763590 2024-09-17T05:53:23.693 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:23.689+0000 7f346ce5a740 1 -- 172.21.15.150:0/630600617 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55aa33763590 msgr2=0x55aa33b2c110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:53:23.693 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:23.689+0000 7f346ce5a740 1 --2- 172.21.15.150:0/630600617 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55aa33763590 0x55aa33b2c110 secure :-1 s=READY pgs=1864 cs=0 l=1 rev1=1 crypto rx=0x7f344802b4d0 tx=0x7f34480046c0 comp rx=0 tx=0).stop 2024-09-17T05:53:23.693 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:23.689+0000 7f346ce5a740 1 -- 172.21.15.150:0/630600617 shutdown_connections 2024-09-17T05:53:23.693 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:23.689+0000 7f346ce5a740 1 --2- 172.21.15.150:0/630600617 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55aa33784270 0x55aa33b2c650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:53:23.693 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:23.689+0000 7f346ce5a740 1 --2- 172.21.15.150:0/630600617 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55aa33763590 0x55aa33b2c110 unknown :-1 s=CLOSED pgs=1864 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:53:23.693 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:23.689+0000 7f346ce5a740 1 --2- 172.21.15.150:0/630600617 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55aa3375b3b0 0x55aa33b6fc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:53:23.693 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:23.689+0000 7f346ce5a740 1 -- 172.21.15.150:0/630600617 >> 172.21.15.150:0/630600617 conn(0x55aa337783c0 msgr2=0x55aa33b6d1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:53:23.693 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:23.689+0000 7f346ce5a740 1 -- 172.21.15.150:0/630600617 shutdown_connections 2024-09-17T05:53:23.693 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:23.689+0000 7f346ce5a740 1 -- 172.21.15.150:0/630600617 wait complete. 2024-09-17T05:53:23.697 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:23.690+0000 7f346ce5a740 1 -- start start 2024-09-17T05:53:23.698 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:23.690+0000 7f346ce5a740 1 Processor -- start 2024-09-17T05:53:23.698 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:23.691+0000 7f346ce5a740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55aa3375b3b0 0x55aa33be7030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:53:23.698 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:23.691+0000 7f346ce5a740 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55aa33763590 0x55aa33b6ab40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:53:23.698 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:23.691+0000 7f346ce5a740 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55aa33784270 0x55aa33bf43e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:53:23.698 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:23.691+0000 7f346ce5a740 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x55aa33b69ba0 con 0x55aa33784270 2024-09-17T05:53:23.698 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:23.691+0000 7f346ce5a740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f3460201330 con 0x55aa3375b3b0 2024-09-17T05:53:23.698 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:23.691+0000 7f346ce5a740 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x55aa33b54e70 con 0x55aa33763590 2024-09-17T05:53:23.698 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:23.691+0000 7f346ce5a740 10 client.0 _ll_register_callbacks cb 0x7f3458014040 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T05:53:23.698 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:23.691+0000 7f345ffff640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55aa33784270 0x55aa33bf43e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:53:23.698 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:23.691+0000 7f345ffff640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55aa33784270 0x55aa33bf43e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:53764/0 (socket says 172.21.15.150:53764) 2024-09-17T05:53:23.698 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:23.691+0000 7f345ffff640 1 -- 172.21.15.150:0/3975077742 learned_addr learned my addr 172.21.15.150:0/3975077742 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:53:23.698 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:23.691+0000 7f3457fff640 1 --2- 172.21.15.150:0/3975077742 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55aa33763590 0x55aa33b6ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:53:23.699 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:23.691+0000 7f345f7fe640 1 --2- 172.21.15.150:0/3975077742 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55aa3375b3b0 0x55aa33be7030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:53:23.699 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:23.692+0000 7f345ffff640 1 -- 172.21.15.150:0/3975077742 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55aa33763590 msgr2=0x55aa33b6ab40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:53:23.699 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:23.692+0000 7f345ffff640 1 --2- 172.21.15.150:0/3975077742 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55aa33763590 0x55aa33b6ab40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:53:23.699 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:23.692+0000 7f345ffff640 1 -- 172.21.15.150:0/3975077742 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55aa3375b3b0 msgr2=0x55aa33be7030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:53:23.699 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:23.692+0000 7f345ffff640 1 --2- 172.21.15.150:0/3975077742 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55aa3375b3b0 0x55aa33be7030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:53:23.699 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:23.692+0000 7f345ffff640 1 -- 172.21.15.150:0/3975077742 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55aa33b6a870 con 0x55aa33784270 2024-09-17T05:53:23.699 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:23.692+0000 7f345ffff640 1 --2- 172.21.15.150:0/3975077742 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55aa33784270 0x55aa33bf43e0 secure :-1 s=READY pgs=1865 cs=0 l=1 rev1=1 crypto rx=0x7f345809a620 tx=0x7f345805f700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b1c488d5f4d7d365 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:53:23.699 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:23.692+0000 7f343e7fc640 10 client.0 ms_handle_connect on v2:172.21.15.150:3300/0 2024-09-17T05:53:23.699 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:23.692+0000 7f343e7fc640 1 -- 172.21.15.150:0/3975077742 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34580601d0 con 0x55aa33784270 2024-09-17T05:53:23.699 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:23.692+0000 7f343e7fc640 1 -- 172.21.15.150:0/3975077742 <== mon.0 v2:172.21.15.150:3300/0 2 ==== osd_map(141..141 src has 1..141) ==== 5905+0+0 (secure 0 0 0) 0x7f345805f7f0 con 0x55aa33784270 2024-09-17T05:53:23.699 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:23.692+0000 7f346ce5a740 1 -- 172.21.15.150:0/3975077742 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3448004110 con 0x55aa33784270 2024-09-17T05:53:23.699 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:23.692+0000 7f343e7fc640 1 -- 172.21.15.150:0/3975077742 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_get_version_reply(handle=1 version=88) ==== 24+0+0 (secure 0 0 0) 0x7f345800ce70 con 0x55aa33784270 2024-09-17T05:53:23.699 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:23.692+0000 7f346ce5a740 10 client.9786 fetch_fsmap learned FSMap version 88 2024-09-17T05:53:23.700 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:23.692+0000 7f346ce5a740 1 -- 172.21.15.150:0/3975077742 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,fsmap=88,monmap=2+}) -- 0x55aa33bf3c40 con 0x55aa33784270 2024-09-17T05:53:23.700 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:23.692+0000 7f343e7fc640 1 -- 172.21.15.150:0/3975077742 <== mon.0 v2:172.21.15.150:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f3448004110 con 0x55aa33784270 2024-09-17T05:53:23.700 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:23.692+0000 7f343e7fc640 1 -- 172.21.15.150:0/3975077742 <== mon.0 v2:172.21.15.150:3300/0 5 ==== fsmap(e 88) ==== 3502+0+0 (secure 0 0 0) 0x7f3458087040 con 0x55aa33784270 2024-09-17T05:53:23.700 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:23.692+0000 7f346ce5a740 10 client.9786 fetch_fsmap finished waiting for FSMap version 88 2024-09-17T05:53:23.700 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:23.692+0000 7f346ce5a740 10 client.9786 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-17T05:53:23.700 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:23.692+0000 7f346ce5a740 20 client.9786 populate_metadata read hostname 'smithi150' 2024-09-17T05:53:23.700 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:23.692+0000 7f346ce5a740 1 --2- 172.21.15.150:0/3975077742 >> [v2:172.21.15.150:6833/122540131,v1:172.21.15.150:6835/122540131] conn(0x55aa33b712b0 0x55aa33b92dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:53:23.700 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:23.692+0000 7f346ce5a740 4 client.9786 mds_command: new command op to 9633 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-17T05:53:23.700 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:23.692+0000 7f346ce5a740 1 -- 172.21.15.150:0/3975077742 --> [v2:172.21.15.150:6833/122540131,v1:172.21.15.150:6835/122540131] -- command(tid 0: {"prefix": "status"}) -- 0x55aa33a9c220 con 0x55aa33b712b0 2024-09-17T05:53:23.700 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:23.692+0000 7f345f7fe640 1 --2- 172.21.15.150:0/3975077742 >> [v2:172.21.15.150:6833/122540131,v1:172.21.15.150:6835/122540131] conn(0x55aa33b712b0 0x55aa33b92dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:53:23.700 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:23.693+0000 7f343e7fc640 10 client.9786 ms_handle_connect on v2:172.21.15.150:6833/122540131 2024-09-17T05:53:23.700 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:23.693+0000 7f345f7fe640 1 --2- 172.21.15.150:0/3975077742 >> [v2:172.21.15.150:6833/122540131,v1:172.21.15.150:6835/122540131] conn(0x55aa33b712b0 0x55aa33b92dd0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=89d2331166e71079 server_cookie=9b9dd2823e5a0c64 in_seq=0 out_seq=0 2024-09-17T05:53:23.700 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:23.693+0000 7f343e7fc640 1 -- 172.21.15.150:0/3975077742 <== mds.0 v2:172.21.15.150:6833/122540131 1 ==== command_reply(tid 0: 0 ) ==== 8+0+333 (crc 0 0 0) 0x55aa33a9c220 con 0x55aa33b712b0 2024-09-17T05:53:23.701 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:23.693+0000 7f343e7fc640 10 client.9786 handle_command_reply: tid=0 2024-09-17T05:53:23.701 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:23.693+0000 7f346ce5a740 1 client.9786 shutdown 2024-09-17T05:53:23.701 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:23.693+0000 7f346ce5a740 1 -- 172.21.15.150:0/3975077742 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55aa33784270 msgr2=0x55aa33bf43e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:53:23.701 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:23.693+0000 7f346ce5a740 1 --2- 172.21.15.150:0/3975077742 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55aa33784270 0x55aa33bf43e0 secure :-1 s=READY pgs=1865 cs=0 l=1 rev1=1 crypto rx=0x7f345809a620 tx=0x7f345805f700 comp rx=0 tx=0).stop 2024-09-17T05:53:23.701 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:23.693+0000 7f346ce5a740 1 -- 172.21.15.150:0/3975077742 shutdown_connections 2024-09-17T05:53:23.701 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:23.693+0000 7f346ce5a740 1 --2- 172.21.15.150:0/3975077742 >> [v2:172.21.15.150:6833/122540131,v1:172.21.15.150:6835/122540131] conn(0x55aa33b712b0 0x55aa33b92dd0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:53:23.701 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:23.693+0000 7f346ce5a740 1 --2- 172.21.15.150:0/3975077742 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55aa33784270 0x55aa33bf43e0 unknown :-1 s=CLOSED pgs=1865 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:53:23.701 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:23.693+0000 7f346ce5a740 1 --2- 172.21.15.150:0/3975077742 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55aa33763590 0x55aa33b6ab40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:53:23.701 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:23.693+0000 7f343e7fc640 0 client.9786 ms_handle_reset on v2:172.21.15.150:6833/122540131 2024-09-17T05:53:23.701 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:23.693+0000 7f346ce5a740 1 --2- 172.21.15.150:0/3975077742 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55aa3375b3b0 0x55aa33be7030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:53:23.701 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:23.693+0000 7f346ce5a740 1 -- 172.21.15.150:0/3975077742 >> 172.21.15.150:0/3975077742 conn(0x55aa337783c0 msgr2=0x55aa33b6b390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:53:23.701 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:23.693+0000 7f346ce5a740 1 -- 172.21.15.150:0/3975077742 shutdown_connections 2024-09-17T05:53:23.701 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:23.693+0000 7f346ce5a740 1 -- 172.21.15.150:0/3975077742 wait complete. 2024-09-17T05:53:23.702 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:23.693+0000 7f346ce5a740 20 client.9786 trim_cache size 0 max 16384 2024-09-17T05:53:23.702 INFO:teuthology.orchestra.run.smithi150.stdout:{ 2024-09-17T05:53:23.702 INFO:teuthology.orchestra.run.smithi150.stdout: "cluster_fsid": "9f2e05e9-d629-47b3-b26b-1360655b7d20", 2024-09-17T05:53:23.702 INFO:teuthology.orchestra.run.smithi150.stdout: "whoami": 0, 2024-09-17T05:53:23.702 INFO:teuthology.orchestra.run.smithi150.stdout: "id": 9633, 2024-09-17T05:53:23.702 INFO:teuthology.orchestra.run.smithi150.stdout: "want_state": "up:active", 2024-09-17T05:53:23.702 INFO:teuthology.orchestra.run.smithi150.stdout: "state": "up:active", 2024-09-17T05:53:23.702 INFO:teuthology.orchestra.run.smithi150.stdout: "fs_name": "cephfs", 2024-09-17T05:53:23.702 INFO:teuthology.orchestra.run.smithi150.stdout: "rank_uptime": 9.1732324950000006, 2024-09-17T05:53:23.702 INFO:teuthology.orchestra.run.smithi150.stdout: "mdsmap_epoch": 88, 2024-09-17T05:53:23.703 INFO:teuthology.orchestra.run.smithi150.stdout: "osdmap_epoch": 141, 2024-09-17T05:53:23.703 INFO:teuthology.orchestra.run.smithi150.stdout: "osdmap_epoch_barrier": 141, 2024-09-17T05:53:23.703 INFO:teuthology.orchestra.run.smithi150.stdout: "uptime": 13.860304813999999 2024-09-17T05:53:23.703 INFO:teuthology.orchestra.run.smithi150.stdout:} 2024-09-17T05:53:23.704 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:23.694+0000 7f3465e0e640 1 -- 172.21.15.150:0/2728022049 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f344007ad50 msgr2=0x7f344007d260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:53:23.704 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:23.694+0000 7f3465e0e640 1 --2- 172.21.15.150:0/2728022049 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f344007ad50 0x7f344007d260 secure :-1 s=READY pgs=790 cs=0 l=1 rev1=1 crypto rx=0x7f3450009aa0 tx=0x7f3450005f30 comp rx=0 tx=0).stop 2024-09-17T05:53:23.704 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:23.694+0000 7f3465e0e640 1 -- 172.21.15.150:0/2728022049 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f346006f780 msgr2=0x7f34601f8fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:53:23.704 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:23.694+0000 7f3465e0e640 1 --2- 172.21.15.150:0/2728022049 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f346006f780 0x7f34601f8fe0 secure :-1 s=READY pgs=1861 cs=0 l=1 rev1=1 crypto rx=0x7f3460074270 tx=0x7f345800ed30 comp rx=0 tx=0).stop 2024-09-17T05:53:23.704 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:23.694+0000 7f3465e0e640 1 -- 172.21.15.150:0/2728022049 shutdown_connections 2024-09-17T05:53:23.704 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:23.694+0000 7f3465e0e640 1 --2- 172.21.15.150:0/2728022049 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f344007ad50 0x7f344007d260 unknown :-1 s=CLOSED pgs=790 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:53:23.704 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:23.694+0000 7f3465e0e640 1 --2- 172.21.15.150:0/2728022049 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f346006f780 0x7f34601f8fe0 unknown :-1 s=CLOSED pgs=1861 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:53:23.704 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:23.694+0000 7f3465e0e640 1 --2- 172.21.15.150:0/2728022049 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f34600ca3f0 0x7f34600b2b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:53:23.704 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:23.694+0000 7f3465e0e640 1 --2- 172.21.15.150:0/2728022049 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f344c003fd0 0x7f34601dba40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:53:23.704 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:23.694+0000 7f3465e0e640 1 -- 172.21.15.150:0/2728022049 >> 172.21.15.150:0/2728022049 conn(0x7f34600cef30 msgr2=0x7f3460072b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:53:23.704 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:23.694+0000 7f3465e0e640 1 -- 172.21.15.150:0/2728022049 shutdown_connections 2024-09-17T05:53:23.704 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:23.694+0000 7f3465e0e640 1 -- 172.21.15.150:0/2728022049 wait complete. 2024-09-17T05:53:23.707 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-17T05:53:23.821 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:23.819+0000 7f6a9dc94640 1 -- 172.21.15.150:0/1710792075 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6a9809ba60 msgr2=0x7f6a980b7330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:53:23.821 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:23.819+0000 7f6a9dc94640 1 --2- 172.21.15.150:0/1710792075 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6a9809ba60 0x7f6a980b7330 secure :-1 s=READY pgs=1867 cs=0 l=1 rev1=1 crypto rx=0x7f6a88009820 tx=0x7f6a8802a5a0 comp rx=0 tx=0).stop 2024-09-17T05:53:23.821 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:23.819+0000 7f6a9dc94640 1 -- 172.21.15.150:0/1710792075 shutdown_connections 2024-09-17T05:53:23.821 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:23.819+0000 7f6a9dc94640 1 --2- 172.21.15.150:0/1710792075 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6a9809ba60 0x7f6a980b7330 unknown :-1 s=CLOSED pgs=1867 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:53:23.822 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:23.819+0000 7f6a9dc94640 1 -- 172.21.15.150:0/1710792075 >> 172.21.15.150:0/1710792075 conn(0x7f6a980cee90 msgr2=0x7f6a980cf2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:53:23.822 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:23.819+0000 7f6a9dc94640 1 -- 172.21.15.150:0/1710792075 shutdown_connections 2024-09-17T05:53:23.822 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:23.819+0000 7f6a9dc94640 1 -- 172.21.15.150:0/1710792075 wait complete. 2024-09-17T05:53:23.822 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:23.821+0000 7f6a9dc94640 1 Processor -- start 2024-09-17T05:53:23.822 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:23.821+0000 7f6a9dc94640 1 -- start start 2024-09-17T05:53:23.825 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:23.822+0000 7f6a9dc94640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6a9809ba60 0x7f6a98161f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:53:23.825 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:23.822+0000 7f6a9dc94640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6a980cd440 0x7f6a98158de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:53:23.825 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:23.822+0000 7f6a9dc94640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6a980cd850 0x7f6a98159d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:53:23.826 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:23.822+0000 7f6a9dc94640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f6a981680f0 con 0x7f6a980cd440 2024-09-17T05:53:23.826 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:23.822+0000 7f6a9dc94640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f6a98168270 con 0x7f6a9809ba60 2024-09-17T05:53:23.826 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:23.822+0000 7f6a9dc94640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f6a981683f0 con 0x7f6a980cd850 2024-09-17T05:53:23.826 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:23.822+0000 7f6a8effd640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6a980cd440 0x7f6a98158de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:53:23.826 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:23.822+0000 7f6a8effd640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6a980cd440 0x7f6a98158de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:53772/0 (socket says 172.21.15.150:53772) 2024-09-17T05:53:23.826 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:23.822+0000 7f6a8effd640 1 -- 172.21.15.150:0/1658433945 learned_addr learned my addr 172.21.15.150:0/1658433945 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:53:23.826 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:23.822+0000 7f6a977fe640 1 --2- 172.21.15.150:0/1658433945 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6a9809ba60 0x7f6a98161f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:53:23.826 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:23.822+0000 7f6a97fff640 1 --2- 172.21.15.150:0/1658433945 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6a980cd850 0x7f6a98159d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:53:23.826 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:23.823+0000 7f6a8effd640 1 -- 172.21.15.150:0/1658433945 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6a980cd850 msgr2=0x7f6a98159d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:53:23.826 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:23.823+0000 7f6a8effd640 1 --2- 172.21.15.150:0/1658433945 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6a980cd850 0x7f6a98159d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:53:23.826 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:23.823+0000 7f6a8effd640 1 -- 172.21.15.150:0/1658433945 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6a9809ba60 msgr2=0x7f6a98161f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:53:23.826 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:23.823+0000 7f6a8effd640 1 --2- 172.21.15.150:0/1658433945 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6a9809ba60 0x7f6a98161f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:53:23.826 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:23.823+0000 7f6a8effd640 1 -- 172.21.15.150:0/1658433945 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6a981639f0 con 0x7f6a980cd440 2024-09-17T05:53:23.827 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:23.823+0000 7f6a8effd640 1 --2- 172.21.15.150:0/1658433945 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6a980cd440 0x7f6a98158de0 secure :-1 s=READY pgs=1868 cs=0 l=1 rev1=1 crypto rx=0x7f6a8000c3a0 tx=0x7f6a8000c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:53:23.827 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:23.823+0000 7f6a94ff9640 1 -- 172.21.15.150:0/1658433945 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a80017070 con 0x7f6a980cd440 2024-09-17T05:53:23.827 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:23.823+0000 7f6a94ff9640 1 -- 172.21.15.150:0/1658433945 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f6a800035f0 con 0x7f6a980cd440 2024-09-17T05:53:23.827 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:23.823+0000 7f6a94ff9640 1 -- 172.21.15.150:0/1658433945 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a80003a40 con 0x7f6a980cd440 2024-09-17T05:53:23.827 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:23.823+0000 7f6a9dc94640 1 -- 172.21.15.150:0/1658433945 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6a98163430 con 0x7f6a980cd440 2024-09-17T05:53:23.827 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:23.823+0000 7f6a9dc94640 1 -- 172.21.15.150:0/1658433945 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6a9815a9e0 con 0x7f6a980cd440 2024-09-17T05:53:23.828 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:23.824+0000 7f6a9dc94640 1 -- 172.21.15.150:0/1658433945 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6a980cc2f0 con 0x7f6a980cd440 2024-09-17T05:53:23.828 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:23.825+0000 7f6a94ff9640 1 -- 172.21.15.150:0/1658433945 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 45) ==== 104501+0+0 (secure 0 0 0) 0x7f6a8001a070 con 0x7f6a980cd440 2024-09-17T05:53:23.828 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:23.826+0000 7f6a94ff9640 1 --2- 172.21.15.150:0/1658433945 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f6a7807ad50 0x7f6a7807d260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:53:23.828 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:23.826+0000 7f6a94ff9640 1 -- 172.21.15.150:0/1658433945 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(141..141 src has 1..141) ==== 5905+0+0 (secure 0 0 0) 0x7f6a80098fd0 con 0x7f6a980cd440 2024-09-17T05:53:23.828 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:23.826+0000 7f6a977fe640 1 --2- 172.21.15.150:0/1658433945 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f6a7807ad50 0x7f6a7807d260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:53:23.828 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:23.826+0000 7f6a977fe640 1 --2- 172.21.15.150:0/1658433945 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f6a7807ad50 0x7f6a7807d260 secure :-1 s=READY pgs=791 cs=0 l=1 rev1=1 crypto rx=0x7f6a88034000 tx=0x7f6a88004730 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:53:23.831 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:23.830+0000 7f6a94ff9640 1 -- 172.21.15.150:0/1658433945 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f6a981639f0 con 0x7f6a980cd440 2024-09-17T05:53:24.043 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:24.041+0000 7f6a9dc94640 1 -- 172.21.15.150:0/1658433945 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f6a98163eb0 con 0x7f6a980cd440 2024-09-17T05:53:24.043 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:24.042+0000 7f6a94ff9640 1 -- 172.21.15.150:0/1658433945 <== mon.0 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v88) ==== 53+0+73 (secure 0 0 0) 0x7f6a80062950 con 0x7f6a980cd440 2024-09-17T05:53:24.044 INFO:teuthology.orchestra.run.smithi150.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-17T05:53:24.046 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:24.044+0000 7f6a9dc94640 1 -- 172.21.15.150:0/1658433945 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f6a7807ad50 msgr2=0x7f6a7807d260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:53:24.046 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:24.044+0000 7f6a9dc94640 1 --2- 172.21.15.150:0/1658433945 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f6a7807ad50 0x7f6a7807d260 secure :-1 s=READY pgs=791 cs=0 l=1 rev1=1 crypto rx=0x7f6a88034000 tx=0x7f6a88004730 comp rx=0 tx=0).stop 2024-09-17T05:53:24.046 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:24.044+0000 7f6a9dc94640 1 -- 172.21.15.150:0/1658433945 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6a980cd440 msgr2=0x7f6a98158de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:53:24.046 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:24.044+0000 7f6a9dc94640 1 --2- 172.21.15.150:0/1658433945 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6a980cd440 0x7f6a98158de0 secure :-1 s=READY pgs=1868 cs=0 l=1 rev1=1 crypto rx=0x7f6a8000c3a0 tx=0x7f6a8000c860 comp rx=0 tx=0).stop 2024-09-17T05:53:24.046 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:24.044+0000 7f6a9dc94640 1 -- 172.21.15.150:0/1658433945 shutdown_connections 2024-09-17T05:53:24.046 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:24.044+0000 7f6a9dc94640 1 --2- 172.21.15.150:0/1658433945 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f6a7807ad50 0x7f6a7807d260 unknown :-1 s=CLOSED pgs=791 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:53:24.046 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:24.044+0000 7f6a9dc94640 1 --2- 172.21.15.150:0/1658433945 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6a980cd850 0x7f6a98159d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:53:24.047 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:24.044+0000 7f6a9dc94640 1 --2- 172.21.15.150:0/1658433945 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6a980cd440 0x7f6a98158de0 unknown :-1 s=CLOSED pgs=1868 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:53:24.047 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:24.044+0000 7f6a9dc94640 1 --2- 172.21.15.150:0/1658433945 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6a9809ba60 0x7f6a98161f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:53:24.047 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:24.044+0000 7f6a9dc94640 1 -- 172.21.15.150:0/1658433945 >> 172.21.15.150:0/1658433945 conn(0x7f6a980cee90 msgr2=0x7f6a980b31d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:53:24.047 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:24.044+0000 7f6a9dc94640 1 -- 172.21.15.150:0/1658433945 shutdown_connections 2024-09-17T05:53:24.047 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:24.044+0000 7f6a9dc94640 1 -- 172.21.15.150:0/1658433945 wait complete. 2024-09-17T05:53:24.058 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-09-17T05:53:24.058 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-17T05:53:24.058 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi150.front.sepia.ceph.com 2024-09-17T05:53:24.058 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-17T05:53:24.058 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-17T05:53:24.058 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-09-17T05:53:24.058 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-09-17T05:53:24.058 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-17T05:53:24.058 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-17T05:53:24.059 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:53:24.059 DEBUG:teuthology.orchestra.run.smithi150:> ip addr 2024-09-17T05:53:24.075 INFO:teuthology.orchestra.run.smithi150.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-17T05:53:24.075 INFO:teuthology.orchestra.run.smithi150.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-17T05:53:24.075 INFO:teuthology.orchestra.run.smithi150.stdout: inet 127.0.0.1/8 scope host lo 2024-09-17T05:53:24.075 INFO:teuthology.orchestra.run.smithi150.stdout: valid_lft forever preferred_lft forever 2024-09-17T05:53:24.075 INFO:teuthology.orchestra.run.smithi150.stdout: inet6 ::1/128 scope host 2024-09-17T05:53:24.075 INFO:teuthology.orchestra.run.smithi150.stdout: valid_lft forever preferred_lft forever 2024-09-17T05:53:24.075 INFO:teuthology.orchestra.run.smithi150.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-17T05:53:24.075 INFO:teuthology.orchestra.run.smithi150.stdout: link/ether 0c:c4:7a:d9:da:bc brd ff:ff:ff:ff:ff:ff 2024-09-17T05:53:24.075 INFO:teuthology.orchestra.run.smithi150.stdout: altname enp7s0f0 2024-09-17T05:53:24.075 INFO:teuthology.orchestra.run.smithi150.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-17T05:53:24.075 INFO:teuthology.orchestra.run.smithi150.stdout: link/ether 0c:c4:7a:d9:da:bd brd ff:ff:ff:ff:ff:ff 2024-09-17T05:53:24.076 INFO:teuthology.orchestra.run.smithi150.stdout: altname enp7s0f1 2024-09-17T05:53:24.076 INFO:teuthology.orchestra.run.smithi150.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-17T05:53:24.076 INFO:teuthology.orchestra.run.smithi150.stdout: link/ether 0c:c4:7a:88:6e:34 brd ff:ff:ff:ff:ff:ff 2024-09-17T05:53:24.076 INFO:teuthology.orchestra.run.smithi150.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-17T05:53:24.076 INFO:teuthology.orchestra.run.smithi150.stdout: link/ether 0c:c4:7a:88:6e:35 brd ff:ff:ff:ff:ff:ff 2024-09-17T05:53:24.076 INFO:teuthology.orchestra.run.smithi150.stdout: inet 172.21.15.150/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-09-17T05:53:24.076 INFO:teuthology.orchestra.run.smithi150.stdout: valid_lft 42111sec preferred_lft 42111sec 2024-09-17T05:53:24.076 INFO:teuthology.orchestra.run.smithi150.stdout: inet6 fe80::ec4:7aff:fe88:6e35/64 scope link noprefixroute 2024-09-17T05:53:24.076 INFO:teuthology.orchestra.run.smithi150.stdout: valid_lft forever preferred_lft forever 2024-09-17T05:53:24.077 INFO:teuthology.orchestra.run.smithi150.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-17T05:53:24.077 INFO:teuthology.orchestra.run.smithi150.stdout: link/ether 1a:d2:4c:31:46:82 brd ff:ff:ff:ff:ff:ff 2024-09-17T05:53:24.077 INFO:teuthology.orchestra.run.smithi150.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-17T05:53:24.077 INFO:teuthology.orchestra.run.smithi150.stdout: valid_lft forever preferred_lft forever 2024-09-17T05:53:24.077 INFO:teuthology.orchestra.run.smithi150.stdout: inet6 fe80::70b6:c6ff:fe60:62a2/64 scope link 2024-09-17T05:53:24.077 INFO:teuthology.orchestra.run.smithi150.stdout: valid_lft forever preferred_lft forever 2024-09-17T05:53:24.077 INFO:teuthology.orchestra.run.smithi150.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-17T05:53:24.077 INFO:teuthology.orchestra.run.smithi150.stdout: link/ether 32:e1:8b:37:8c:b3 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-17T05:53:24.077 INFO:teuthology.orchestra.run.smithi150.stdout: inet6 fe80::30e1:8bff:fe37:8cb3/64 scope link 2024-09-17T05:53:24.077 INFO:teuthology.orchestra.run.smithi150.stdout: valid_lft forever preferred_lft forever 2024-09-17T05:53:24.077 INFO:teuthology.orchestra.run.smithi150.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-17T05:53:24.077 INFO:teuthology.orchestra.run.smithi150.stdout: link/ether 1a:d2:4c:31:46:82 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-17T05:53:24.077 INFO:teuthology.orchestra.run.smithi150.stdout: inet6 fe80::18d2:4cff:fe31:4682/64 scope link 2024-09-17T05:53:24.078 INFO:teuthology.orchestra.run.smithi150.stdout: valid_lft forever preferred_lft forever 2024-09-17T05:53:24.078 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:53:24.078 DEBUG:teuthology.orchestra.run.smithi150:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-17T05:53:24.139 INFO:teuthology.orchestra.run.smithi150.stdout:1 2024-09-17T05:53:24.141 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:53:24.141 DEBUG:teuthology.orchestra.run.smithi150:> route 2024-09-17T05:53:24.198 INFO:teuthology.orchestra.run.smithi150.stdout:Kernel IP routing table 2024-09-17T05:53:24.198 INFO:teuthology.orchestra.run.smithi150.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-17T05:53:24.198 INFO:teuthology.orchestra.run.smithi150.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-17T05:53:24.198 INFO:teuthology.orchestra.run.smithi150.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-17T05:53:24.198 INFO:teuthology.orchestra.run.smithi150.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-17T05:53:24.199 DEBUG:teuthology.orchestra.run.smithi150:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-17T05:53:24.199 DEBUG:teuthology.orchestra.run.smithi150:> set -e 2024-09-17T05:53:24.199 DEBUG:teuthology.orchestra.run.smithi150:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-17T05:53:24.199 DEBUG:teuthology.orchestra.run.smithi150:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-17T05:53:24.199 DEBUG:teuthology.orchestra.run.smithi150:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-17T05:53:24.199 DEBUG:teuthology.orchestra.run.smithi150:> ') 2024-09-17T05:53:24.287 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:24 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-17T05:53:24.319 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:24 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T05:53:24.325 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:53:24.326 DEBUG:teuthology.orchestra.run.smithi150:> ip netns list 2024-09-17T05:53:24.341 INFO:teuthology.orchestra.run.smithi150.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-09-17T05:53:24.341 INFO:teuthology.orchestra.run.smithi150.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-17T05:53:24.341 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-17T05:53:24.342 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:53:24.342 DEBUG:teuthology.orchestra.run.smithi150:> sudo ip link set brx.0 up 2024-09-17T05:53:24.406 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-17T05:53:24.407 DEBUG:teuthology.orchestra.run.smithi150:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-17T05:53:24.462 INFO:teuthology.orchestra.run.smithi150.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-17T05:53:24.462 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-17T05:53:24.462 DEBUG:teuthology.orchestra.run.smithi150:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-17T05:53:24.518 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-09-17T05:53:24.518 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:53:24.518 DEBUG:teuthology.orchestra.run.smithi150:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-17T05:53:24.612 INFO:teuthology.orchestra.run.smithi150.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-17T05:53:24.612 INFO:teuthology.orchestra.run.smithi150.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-17T05:53:24.612 INFO:teuthology.orchestra.run.smithi150.stdout:invalid new device string format 2024-09-17T05:53:24.623 INFO:teuthology.orchestra.run.smithi150.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-17T05:53:24.623 INFO:teuthology.orchestra.run.smithi150.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-17T05:53:24.623 INFO:teuthology.orchestra.run.smithi150.stdout:invalid new device string format 2024-09-17T05:53:24.623 INFO:teuthology.orchestra.run.smithi150.stdout:mount.ceph: resolved to: "172.21.15.150:3300,172.21.15.176:3300,172.21.15.176:3301" 2024-09-17T05:53:24.623 INFO:teuthology.orchestra.run.smithi150.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-17T05:53:24.628 INFO:teuthology.orchestra.run.smithi150.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-17T05:53:24.628 INFO:teuthology.orchestra.run.smithi150.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-17T05:53:24.628 INFO:teuthology.orchestra.run.smithi150.stdout:invalid new device string format 2024-09-17T05:53:24.628 INFO:teuthology.orchestra.run.smithi150.stdout:mount.ceph: resolved to: "172.21.15.150:3300,172.21.15.176:3300,172.21.15.176:3301" 2024-09-17T05:53:24.629 INFO:teuthology.orchestra.run.smithi150.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-17T05:53:24.629 INFO:teuthology.orchestra.run.smithi150.stdout:mount.ceph: resolved to: "172.21.15.150:6789,172.21.15.176:6789,172.21.15.176:6790" 2024-09-17T05:53:24.629 INFO:teuthology.orchestra.run.smithi150.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.150:6789,172.21.15.176:6789,172.21.15.176:6790:/ 2024-09-17T05:53:24.629 INFO:teuthology.orchestra.run.smithi150.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=9f2e05e9-d629-47b3-b26b-1360655b7d20" will pass to kernel 2024-09-17T05:53:24.631 INFO:teuthology.orchestra.run.smithi150.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-09-17T05:53:24.631 INFO:teuthology.orchestra.run.smithi150.stdout: You just mounted a file system that supports labels which does not 2024-09-17T05:53:24.631 INFO:teuthology.orchestra.run.smithi150.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-09-17T05:53:24.631 INFO:teuthology.orchestra.run.smithi150.stdout: applications will generate AVC messages and not be allowed access to 2024-09-17T05:53:24.631 INFO:teuthology.orchestra.run.smithi150.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-09-17T05:53:24.632 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-17T05:53:24.632 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:53:24.632 DEBUG:teuthology.orchestra.run.smithi150:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-17T05:53:24.662 DEBUG:teuthology.orchestra.run.smithi150:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-17T05:53:24.752 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:24 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-17T05:53:24.758 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:24 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T05:53:24.764 INFO:teuthology.orchestra.run.smithi150.stdout:client9798 2024-09-17T05:53:24.764 DEBUG:teuthology.orchestra.run.smithi150:> set -ex 2024-09-17T05:53:24.765 DEBUG:teuthology.orchestra.run.smithi150:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T05:53:24.780 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs flag set enable_multiple true --yes-i-really-mean-it 2024-09-17T05:53:24.938 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:24.936+0000 7fe1983a8640 1 -- 172.21.15.150:0/3150530196 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe1900b1d80 msgr2=0x7fe1900d0c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:53:24.939 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:24.936+0000 7fe1983a8640 1 --2- 172.21.15.150:0/3150530196 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe1900b1d80 0x7fe1900d0c90 secure :-1 s=READY pgs=1870 cs=0 l=1 rev1=1 crypto rx=0x7fe190074240 tx=0x7fe18002a680 comp rx=0 tx=0).stop 2024-09-17T05:53:24.939 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:24.936+0000 7fe1983a8640 1 -- 172.21.15.150:0/3150530196 shutdown_connections 2024-09-17T05:53:24.939 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:24.936+0000 7fe1983a8640 1 --2- 172.21.15.150:0/3150530196 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe1900b1d80 0x7fe1900d0c90 unknown :-1 s=CLOSED pgs=1870 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:53:24.939 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:24.936+0000 7fe1983a8640 1 --2- 172.21.15.150:0/3150530196 >> v2:172.21.15.176:3300/0 conn(0x7fe1900d0520 0x7fe1900b7a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:53:24.939 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:24.936+0000 7fe1983a8640 1 -- 172.21.15.150:0/3150530196 >> 172.21.15.150:0/3150530196 conn(0x7fe1900cef30 msgr2=0x7fe1900cf340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:53:24.939 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:24.936+0000 7fe1983a8640 1 -- 172.21.15.150:0/3150530196 shutdown_connections 2024-09-17T05:53:24.939 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:24.936+0000 7fe1983a8640 1 -- 172.21.15.150:0/3150530196 wait complete. 2024-09-17T05:53:24.940 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:24.938+0000 7fe1983a8640 1 Processor -- start 2024-09-17T05:53:24.940 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:24.938+0000 7fe1983a8640 1 -- start start 2024-09-17T05:53:24.943 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:24.939+0000 7fe1983a8640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe1900b1d80 0x7fe190156410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:53:24.943 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:24.940+0000 7fe1983a8640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe1900d0520 0x7fe19015a6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:53:24.943 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:24.940+0000 7fe1983a8640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe1900d11d0 0x7fe1901f73a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:53:24.943 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:24.940+0000 7fe1983a8640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7fe190070f20 con 0x7fe1900b1d80 2024-09-17T05:53:24.943 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:24.940+0000 7fe1983a8640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fe1900d3310 con 0x7fe1900d0520 2024-09-17T05:53:24.943 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:24.940+0000 7fe1983a8640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fe1900b2190 con 0x7fe1900d11d0 2024-09-17T05:53:24.943 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:24.940+0000 7fe196144640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe1900b1d80 0x7fe190156410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:53:24.943 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:24.940+0000 7fe196144640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe1900b1d80 0x7fe190156410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:53784/0 (socket says 172.21.15.150:53784) 2024-09-17T05:53:24.943 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:24.940+0000 7fe196144640 1 -- 172.21.15.150:0/1742339170 learned_addr learned my addr 172.21.15.150:0/1742339170 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:53:24.943 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:24.940+0000 7fe196144640 1 -- 172.21.15.150:0/1742339170 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe1900d11d0 msgr2=0x7fe1901f73a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:53:24.943 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:24.940+0000 7fe195943640 1 --2- 172.21.15.150:0/1742339170 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe1900d0520 0x7fe19015a6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:53:24.943 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:24.940+0000 7fe196144640 1 --2- 172.21.15.150:0/1742339170 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe1900d11d0 0x7fe1901f73a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:53:24.944 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:24.940+0000 7fe196144640 1 -- 172.21.15.150:0/1742339170 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe1900d0520 msgr2=0x7fe19015a6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:53:24.944 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:24.940+0000 7fe196144640 1 --2- 172.21.15.150:0/1742339170 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe1900d0520 0x7fe19015a6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:53:24.944 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:24.940+0000 7fe196144640 1 -- 172.21.15.150:0/1742339170 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe1901457f0 con 0x7fe1900b1d80 2024-09-17T05:53:24.944 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:24.940+0000 7fe195943640 1 --2- 172.21.15.150:0/1742339170 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe1900d0520 0x7fe19015a6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T05:53:24.944 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:24.940+0000 7fe196144640 1 --2- 172.21.15.150:0/1742339170 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe1900b1d80 0x7fe190156410 secure :-1 s=READY pgs=1871 cs=0 l=1 rev1=1 crypto rx=0x7fe18c00e7c0 tx=0x7fe18c00ec80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:53:24.944 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:24.940+0000 7fe186ffd640 1 -- 172.21.15.150:0/1742339170 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe18c00ccc0 con 0x7fe1900b1d80 2024-09-17T05:53:24.944 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:24.940+0000 7fe186ffd640 1 -- 172.21.15.150:0/1742339170 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe18c010430 con 0x7fe1900b1d80 2024-09-17T05:53:24.944 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:24.940+0000 7fe1983a8640 1 -- 172.21.15.150:0/1742339170 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe19015d8d0 con 0x7fe1900b1d80 2024-09-17T05:53:24.944 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:24.940+0000 7fe186ffd640 1 -- 172.21.15.150:0/1742339170 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe18c010860 con 0x7fe1900b1d80 2024-09-17T05:53:24.944 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:24.940+0000 7fe1983a8640 1 -- 172.21.15.150:0/1742339170 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe19015de90 con 0x7fe1900b1d80 2024-09-17T05:53:24.945 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:24.941+0000 7fe1983a8640 1 -- 172.21.15.150:0/1742339170 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe1900d0c90 con 0x7fe1900b1d80 2024-09-17T05:53:24.945 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:24.942+0000 7fe186ffd640 1 -- 172.21.15.150:0/1742339170 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 45) ==== 104501+0+0 (secure 0 0 0) 0x7fe18c010a00 con 0x7fe1900b1d80 2024-09-17T05:53:24.945 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:24.943+0000 7fe186ffd640 1 --2- 172.21.15.150:0/1742339170 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fe17407ad50 0x7fe17407d260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:53:24.945 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:24.943+0000 7fe186ffd640 1 -- 172.21.15.150:0/1742339170 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(141..141 src has 1..141) ==== 5905+0+0 (secure 0 0 0) 0x7fe18c09a850 con 0x7fe1900b1d80 2024-09-17T05:53:24.945 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:24.943+0000 7fe195943640 1 --2- 172.21.15.150:0/1742339170 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fe17407ad50 0x7fe17407d260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:53:24.945 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:24.944+0000 7fe195943640 1 --2- 172.21.15.150:0/1742339170 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fe17407ad50 0x7fe17407d260 secure :-1 s=READY pgs=792 cs=0 l=1 rev1=1 crypto rx=0x7fe180033000 tx=0x7fe180004730 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:53:24.949 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:24.947+0000 7fe186ffd640 1 -- 172.21.15.150:0/1742339170 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fe18c0647a0 con 0x7fe1900b1d80 2024-09-17T05:53:25.161 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:25.159+0000 7fe1983a8640 1 -- 172.21.15.150:0/1742339170 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "fs flag set", "flag_name": "enable_multiple", "val": "true", "yes_i_really_mean_it": true} v 0) -- 0x7fe190076180 con 0x7fe1900b1d80 2024-09-17T05:53:25.570 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:25.568+0000 7fe186ffd640 1 -- 172.21.15.150:0/1742339170 <== mon.0 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "fs flag set", "flag_name": "enable_multiple", "val": "true", "yes_i_really_mean_it": true}]=0 v89) ==== 136+0+0 (secure 0 0 0) 0x7fe18c0640a0 con 0x7fe1900b1d80 2024-09-17T05:53:25.574 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:25.572+0000 7fe1983a8640 1 -- 172.21.15.150:0/1742339170 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fe17407ad50 msgr2=0x7fe17407d260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:53:25.574 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:25.572+0000 7fe1983a8640 1 --2- 172.21.15.150:0/1742339170 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fe17407ad50 0x7fe17407d260 secure :-1 s=READY pgs=792 cs=0 l=1 rev1=1 crypto rx=0x7fe180033000 tx=0x7fe180004730 comp rx=0 tx=0).stop 2024-09-17T05:53:25.574 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:25.572+0000 7fe1983a8640 1 -- 172.21.15.150:0/1742339170 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe1900b1d80 msgr2=0x7fe190156410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:53:25.574 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:25.572+0000 7fe1983a8640 1 --2- 172.21.15.150:0/1742339170 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe1900b1d80 0x7fe190156410 secure :-1 s=READY pgs=1871 cs=0 l=1 rev1=1 crypto rx=0x7fe18c00e7c0 tx=0x7fe18c00ec80 comp rx=0 tx=0).stop 2024-09-17T05:53:25.575 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:25.572+0000 7fe1983a8640 1 -- 172.21.15.150:0/1742339170 shutdown_connections 2024-09-17T05:53:25.575 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:25.572+0000 7fe1983a8640 1 --2- 172.21.15.150:0/1742339170 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe1900d0520 0x7fe19015a6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:53:25.575 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:25.572+0000 7fe1983a8640 1 --2- 172.21.15.150:0/1742339170 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fe17407ad50 0x7fe17407d260 unknown :-1 s=CLOSED pgs=792 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:53:25.575 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:25.572+0000 7fe1983a8640 1 --2- 172.21.15.150:0/1742339170 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe1900d11d0 0x7fe1901f73a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:53:25.575 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:25.572+0000 7fe1983a8640 1 --2- 172.21.15.150:0/1742339170 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe1900b1d80 0x7fe190156410 unknown :-1 s=CLOSED pgs=1871 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:53:25.575 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:25.572+0000 7fe1983a8640 1 -- 172.21.15.150:0/1742339170 >> 172.21.15.150:0/1742339170 conn(0x7fe1900cef30 msgr2=0x7fe1900cbd70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:53:25.575 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:25.572+0000 7fe1983a8640 1 -- 172.21.15.150:0/1742339170 shutdown_connections 2024-09-17T05:53:25.575 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:25.572+0000 7fe1983a8640 1 -- 172.21.15.150:0/1742339170 wait complete. 2024-09-17T05:53:25.587 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume ls 2024-09-17T05:53:25.704 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:25.702+0000 7f06fa0be640 1 -- 172.21.15.150:0/1513777358 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f06f40ae880 msgr2=0x7f06f4165580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:53:25.704 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:25.702+0000 7f06fa0be640 1 --2- 172.21.15.150:0/1513777358 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f06f40ae880 0x7f06f4165580 secure :-1 s=READY pgs=1872 cs=0 l=1 rev1=1 crypto rx=0x7f06f4074bc0 tx=0x7f06ec02aa30 comp rx=0 tx=0).stop 2024-09-17T05:53:25.705 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:25.702+0000 7f06fa0be640 1 -- 172.21.15.150:0/1513777358 shutdown_connections 2024-09-17T05:53:25.705 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:25.702+0000 7f06fa0be640 1 --2- 172.21.15.150:0/1513777358 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f06f40ae880 0x7f06f4165580 unknown :-1 s=CLOSED pgs=1872 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:53:25.705 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:25.702+0000 7f06fa0be640 1 --2- 172.21.15.150:0/1513777358 >> v2:172.21.15.176:3300/0 conn(0x7f06f40d0cd0 0x7f06f40ae340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:53:25.705 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:25.702+0000 7f06fa0be640 1 -- 172.21.15.150:0/1513777358 >> 172.21.15.150:0/1513777358 conn(0x7f06f40b6880 msgr2=0x7f06f40b3060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:53:25.705 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:25.702+0000 7f06fa0be640 1 -- 172.21.15.150:0/1513777358 shutdown_connections 2024-09-17T05:53:25.705 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:25.702+0000 7f06fa0be640 1 -- 172.21.15.150:0/1513777358 wait complete. 2024-09-17T05:53:25.705 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:25.704+0000 7f06fa0be640 1 Processor -- start 2024-09-17T05:53:25.706 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:25.704+0000 7f06fa0be640 1 -- start start 2024-09-17T05:53:25.709 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:25.705+0000 7f06fa0be640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f06f40ae880 0x7f06f4147c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:53:25.710 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:25.705+0000 7f06fa0be640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f06f40d0cd0 0x7f06f414bcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:53:25.710 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:25.705+0000 7f06fa0be640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f06f4156130 0x7f06f414c210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:53:25.710 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:25.705+0000 7f06fa0be640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f06f4165c40 con 0x7f06f4156130 2024-09-17T05:53:25.710 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:25.705+0000 7f06fa0be640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f06f4165ac0 con 0x7f06f40d0cd0 2024-09-17T05:53:25.710 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:25.705+0000 7f06fa0be640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f06f4165dc0 con 0x7f06f40ae880 2024-09-17T05:53:25.710 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:25.705+0000 7f06f3fff640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f06f4156130 0x7f06f414c210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:53:25.710 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:25.705+0000 7f06f3fff640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f06f4156130 0x7f06f414c210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:53806/0 (socket says 172.21.15.150:53806) 2024-09-17T05:53:25.710 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:25.705+0000 7f06f3fff640 1 -- 172.21.15.150:0/2172131645 learned_addr learned my addr 172.21.15.150:0/2172131645 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:53:25.716 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:25.705+0000 7f06f2ffd640 1 --2- 172.21.15.150:0/2172131645 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f06f40d0cd0 0x7f06f414bcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:53:25.716 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:25.705+0000 7f06f37fe640 1 --2- 172.21.15.150:0/2172131645 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f06f40ae880 0x7f06f4147c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:53:25.716 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:25.706+0000 7f06f3fff640 1 -- 172.21.15.150:0/2172131645 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f06f40ae880 msgr2=0x7f06f4147c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:53:25.716 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:25.706+0000 7f06f3fff640 1 --2- 172.21.15.150:0/2172131645 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f06f40ae880 0x7f06f4147c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:53:25.717 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:25.706+0000 7f06f3fff640 1 -- 172.21.15.150:0/2172131645 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f06f40d0cd0 msgr2=0x7f06f414bcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:53:25.717 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:25.706+0000 7f06f3fff640 1 --2- 172.21.15.150:0/2172131645 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f06f40d0cd0 0x7f06f414bcd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:53:25.717 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:25.706+0000 7f06f3fff640 1 -- 172.21.15.150:0/2172131645 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f06f414d4d0 con 0x7f06f4156130 2024-09-17T05:53:25.717 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:25.706+0000 7f06f37fe640 1 --2- 172.21.15.150:0/2172131645 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f06f40ae880 0x7f06f4147c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T05:53:25.717 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:25.706+0000 7f06f3fff640 1 --2- 172.21.15.150:0/2172131645 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f06f4156130 0x7f06f414c210 secure :-1 s=READY pgs=1873 cs=0 l=1 rev1=1 crypto rx=0x7f06ec02b020 tx=0x7f06ec003f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:53:25.717 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:25.706+0000 7f06dbfff640 1 -- 172.21.15.150:0/2172131645 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06ec033050 con 0x7f06f4156130 2024-09-17T05:53:25.717 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:25.706+0000 7f06dbfff640 1 -- 172.21.15.150:0/2172131645 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f06ec004450 con 0x7f06f4156130 2024-09-17T05:53:25.717 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:25.706+0000 7f06fa0be640 1 -- 172.21.15.150:0/2172131645 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f06f414d7b0 con 0x7f06f4156130 2024-09-17T05:53:25.717 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:25.706+0000 7f06dbfff640 1 -- 172.21.15.150:0/2172131645 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06ec038450 con 0x7f06f4156130 2024-09-17T05:53:25.717 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:25.706+0000 7f06fa0be640 1 -- 172.21.15.150:0/2172131645 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f06f414e910 con 0x7f06f4156130 2024-09-17T05:53:25.717 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:25.707+0000 7f06fa0be640 1 -- 172.21.15.150:0/2172131645 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f06f4155d00 con 0x7f06f4156130 2024-09-17T05:53:25.717 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:25.708+0000 7f06dbfff640 1 -- 172.21.15.150:0/2172131645 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 45) ==== 104501+0+0 (secure 0 0 0) 0x7f06ec036070 con 0x7f06f4156130 2024-09-17T05:53:25.718 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:25.708+0000 7f06dbfff640 1 --2- 172.21.15.150:0/2172131645 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f06e007ad80 0x7f06e007d290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:53:25.718 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:25.709+0000 7f06dbfff640 1 -- 172.21.15.150:0/2172131645 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(141..141 src has 1..141) ==== 5905+0+0 (secure 0 0 0) 0x7f06ec0bb360 con 0x7f06f4156130 2024-09-17T05:53:25.719 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:25.709+0000 7f06f37fe640 1 --2- 172.21.15.150:0/2172131645 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f06e007ad80 0x7f06e007d290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:53:25.719 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:25.709+0000 7f06f37fe640 1 --2- 172.21.15.150:0/2172131645 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f06e007ad80 0x7f06e007d290 secure :-1 s=READY pgs=793 cs=0 l=1 rev1=1 crypto rx=0x7f06e400a830 tx=0x7f06e4008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:53:25.719 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:25.713+0000 7f06dbfff640 1 -- 172.21.15.150:0/2172131645 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f06f40cf870 con 0x7f06f4156130 2024-09-17T05:53:25.913 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:25.911+0000 7f06fa0be640 1 -- 172.21.15.150:0/2172131645 --> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] -- mgr_command(tid 0: {"prefix": "fs volume ls", "target": ["mon-mgr", ""]}) -- 0x7f06f40ae340 con 0x7f06e007ad80 2024-09-17T05:53:25.914 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:25.914+0000 7f06dbfff640 1 -- 172.21.15.150:0/2172131645 <== mgr.4108 v2:172.21.15.176:6800/3631216395 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+41 (secure 0 0 0) 0x7f06f40ae340 con 0x7f06e007ad80 2024-09-17T05:53:25.914 INFO:teuthology.orchestra.run.smithi150.stdout:[ 2024-09-17T05:53:25.915 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-09-17T05:53:25.915 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "cephfs" 2024-09-17T05:53:25.915 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-09-17T05:53:25.915 INFO:teuthology.orchestra.run.smithi150.stdout:] 2024-09-17T05:53:25.917 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:25.915+0000 7f06fa0be640 1 -- 172.21.15.150:0/2172131645 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f06e007ad80 msgr2=0x7f06e007d290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:53:25.917 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:25.915+0000 7f06fa0be640 1 --2- 172.21.15.150:0/2172131645 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f06e007ad80 0x7f06e007d290 secure :-1 s=READY pgs=793 cs=0 l=1 rev1=1 crypto rx=0x7f06e400a830 tx=0x7f06e4008040 comp rx=0 tx=0).stop 2024-09-17T05:53:25.917 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:25.915+0000 7f06fa0be640 1 -- 172.21.15.150:0/2172131645 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f06f4156130 msgr2=0x7f06f414c210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:53:25.918 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:25.915+0000 7f06fa0be640 1 --2- 172.21.15.150:0/2172131645 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f06f4156130 0x7f06f414c210 secure :-1 s=READY pgs=1873 cs=0 l=1 rev1=1 crypto rx=0x7f06ec02b020 tx=0x7f06ec003f10 comp rx=0 tx=0).stop 2024-09-17T05:53:25.918 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:25.915+0000 7f06fa0be640 1 -- 172.21.15.150:0/2172131645 shutdown_connections 2024-09-17T05:53:25.918 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:25.915+0000 7f06fa0be640 1 --2- 172.21.15.150:0/2172131645 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f06f40d0cd0 0x7f06f414bcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:53:25.918 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:25.915+0000 7f06fa0be640 1 --2- 172.21.15.150:0/2172131645 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f06e007ad80 0x7f06e007d290 unknown :-1 s=CLOSED pgs=793 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:53:25.918 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:25.915+0000 7f06fa0be640 1 --2- 172.21.15.150:0/2172131645 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f06f4156130 0x7f06f414c210 unknown :-1 s=CLOSED pgs=1873 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:53:25.918 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:25.915+0000 7f06fa0be640 1 --2- 172.21.15.150:0/2172131645 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f06f40ae880 0x7f06f4147c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:53:25.918 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:25.915+0000 7f06fa0be640 1 -- 172.21.15.150:0/2172131645 >> 172.21.15.150:0/2172131645 conn(0x7f06f40b6880 msgr2=0x7f06f40b4360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:53:25.918 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:25.915+0000 7f06fa0be640 1 -- 172.21.15.150:0/2172131645 shutdown_connections 2024-09-17T05:53:25.918 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:25.915+0000 7f06fa0be640 1 -- 172.21.15.150:0/2172131645 wait complete. 2024-09-17T05:53:25.929 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-09-17T05:53:26.046 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:26.043+0000 7fc73ff7b640 1 -- 172.21.15.150:0/4050030654 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc738070a70 msgr2=0x7fc7380cf8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:53:26.046 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:26.043+0000 7fc73ff7b640 1 --2- 172.21.15.150:0/4050030654 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc738070a70 0x7fc7380cf8b0 secure :-1 s=READY pgs=1875 cs=0 l=1 rev1=1 crypto rx=0x7fc730005fd0 tx=0x7fc73002a820 comp rx=0 tx=0).stop 2024-09-17T05:53:26.046 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:26.043+0000 7fc73ff7b640 1 -- 172.21.15.150:0/4050030654 shutdown_connections 2024-09-17T05:53:26.046 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:26.043+0000 7fc73ff7b640 1 --2- 172.21.15.150:0/4050030654 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc73806e4c0 0x7fc7380cf370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:53:26.046 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:26.044+0000 7fc73ff7b640 1 --2- 172.21.15.150:0/4050030654 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc738070a70 0x7fc7380cf8b0 unknown :-1 s=CLOSED pgs=1875 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:53:26.046 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:26.044+0000 7fc73ff7b640 1 -- 172.21.15.150:0/4050030654 >> 172.21.15.150:0/4050030654 conn(0x7fc738073920 msgr2=0x7fc738073d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:53:26.046 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:26.044+0000 7fc73ff7b640 1 -- 172.21.15.150:0/4050030654 shutdown_connections 2024-09-17T05:53:26.046 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:26.044+0000 7fc73ff7b640 1 -- 172.21.15.150:0/4050030654 wait complete. 2024-09-17T05:53:26.047 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:26.045+0000 7fc73ff7b640 1 Processor -- start 2024-09-17T05:53:26.047 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:26.045+0000 7fc73ff7b640 1 -- start start 2024-09-17T05:53:26.050 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:26.047+0000 7fc73ff7b640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc738070a70 0x7fc73815de80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:53:26.050 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:26.047+0000 7fc73ff7b640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc738074440 0x7fc73814dbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:53:26.050 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:26.047+0000 7fc73ff7b640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc73814e9c0 0x7fc73806f960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:53:26.050 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:26.047+0000 7fc73ff7b640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7fc7380cff70 con 0x7fc738070a70 2024-09-17T05:53:26.050 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:26.047+0000 7fc73ff7b640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fc7380cfdf0 con 0x7fc738074440 2024-09-17T05:53:26.051 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:26.047+0000 7fc73ff7b640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fc7380d00f0 con 0x7fc73814e9c0 2024-09-17T05:53:26.051 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:26.047+0000 7fc73dd17640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc738070a70 0x7fc73815de80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:53:26.051 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:26.047+0000 7fc73dd17640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc738070a70 0x7fc73815de80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:53812/0 (socket says 172.21.15.150:53812) 2024-09-17T05:53:26.051 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:26.047+0000 7fc73dd17640 1 -- 172.21.15.150:0/2937498358 learned_addr learned my addr 172.21.15.150:0/2937498358 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:53:26.051 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:26.047+0000 7fc73d516640 1 --2- 172.21.15.150:0/2937498358 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc738074440 0x7fc73814dbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:53:26.051 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:26.047+0000 7fc73e518640 1 --2- 172.21.15.150:0/2937498358 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc73814e9c0 0x7fc73806f960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:53:26.051 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:26.047+0000 7fc73dd17640 1 -- 172.21.15.150:0/2937498358 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc73814e9c0 msgr2=0x7fc73806f960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:53:26.051 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:26.047+0000 7fc73dd17640 1 --2- 172.21.15.150:0/2937498358 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc73814e9c0 0x7fc73806f960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:53:26.051 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:26.047+0000 7fc73dd17640 1 -- 172.21.15.150:0/2937498358 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc738074440 msgr2=0x7fc73814dbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:53:26.051 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:26.047+0000 7fc73dd17640 1 --2- 172.21.15.150:0/2937498358 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc738074440 0x7fc73814dbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:53:26.051 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:26.047+0000 7fc73dd17640 1 -- 172.21.15.150:0/2937498358 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc73815e3c0 con 0x7fc738070a70 2024-09-17T05:53:26.052 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:26.047+0000 7fc73dd17640 1 --2- 172.21.15.150:0/2937498358 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc738070a70 0x7fc73815de80 secure :-1 s=READY pgs=1876 cs=0 l=1 rev1=1 crypto rx=0x7fc73400c3c0 tx=0x7fc73400c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:53:26.052 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:26.047+0000 7fc72e7fc640 1 -- 172.21.15.150:0/2937498358 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc734017070 con 0x7fc738070a70 2024-09-17T05:53:26.052 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:26.047+0000 7fc72e7fc640 1 -- 172.21.15.150:0/2937498358 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc7340035f0 con 0x7fc738070a70 2024-09-17T05:53:26.052 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:26.047+0000 7fc72e7fc640 1 -- 172.21.15.150:0/2937498358 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc734003a40 con 0x7fc738070a70 2024-09-17T05:53:26.052 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:26.047+0000 7fc73ff7b640 1 -- 172.21.15.150:0/2937498358 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc73815e800 con 0x7fc738070a70 2024-09-17T05:53:26.052 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:26.047+0000 7fc73ff7b640 1 -- 172.21.15.150:0/2937498358 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc7381f8f80 con 0x7fc738070a70 2024-09-17T05:53:26.052 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:26.048+0000 7fc73ff7b640 1 -- 172.21.15.150:0/2937498358 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc7381f8ad0 con 0x7fc738070a70 2024-09-17T05:53:26.053 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:26.049+0000 7fc72e7fc640 1 -- 172.21.15.150:0/2937498358 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 45) ==== 104501+0+0 (secure 0 0 0) 0x7fc73401a070 con 0x7fc738070a70 2024-09-17T05:53:26.053 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:26.050+0000 7fc72e7fc640 1 --2- 172.21.15.150:0/2937498358 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fc71c07ad80 0x7fc71c07d290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:53:26.053 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:26.050+0000 7fc72e7fc640 1 -- 172.21.15.150:0/2937498358 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(141..141 src has 1..141) ==== 5905+0+0 (secure 0 0 0) 0x7fc734099070 con 0x7fc738070a70 2024-09-17T05:53:26.053 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:26.050+0000 7fc73d516640 1 --2- 172.21.15.150:0/2937498358 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fc71c07ad80 0x7fc71c07d290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:53:26.053 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:26.050+0000 7fc73d516640 1 --2- 172.21.15.150:0/2937498358 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fc71c07ad80 0x7fc71c07d290 secure :-1 s=READY pgs=794 cs=0 l=1 rev1=1 crypto rx=0x7fc728005d00 tx=0x7fc728005c70 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:53:26.056 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:26.054+0000 7fc72e7fc640 1 -- 172.21.15.150:0/2937498358 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fc734063040 con 0x7fc738070a70 2024-09-17T05:53:26.230 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:26.226+0000 7fc73ff7b640 1 -- 172.21.15.150:0/2937498358 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) -- 0x7fc7380d0610 con 0x7fc738070a70 2024-09-17T05:53:26.230 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:26.227+0000 7fc72e7fc640 1 -- 172.21.15.150:0/2937498358 <== mon.0 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v58)=0 v58) ==== 122+0+0 (secure 0 0 0) 0x7fc734062940 con 0x7fc738070a70 2024-09-17T05:53:26.231 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:26.229+0000 7fc73ff7b640 1 -- 172.21.15.150:0/2937498358 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fc71c07ad80 msgr2=0x7fc71c07d290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:53:26.231 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:26.229+0000 7fc73ff7b640 1 --2- 172.21.15.150:0/2937498358 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fc71c07ad80 0x7fc71c07d290 secure :-1 s=READY pgs=794 cs=0 l=1 rev1=1 crypto rx=0x7fc728005d00 tx=0x7fc728005c70 comp rx=0 tx=0).stop 2024-09-17T05:53:26.231 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:26.229+0000 7fc73ff7b640 1 -- 172.21.15.150:0/2937498358 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc738070a70 msgr2=0x7fc73815de80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:53:26.231 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:26.229+0000 7fc73ff7b640 1 --2- 172.21.15.150:0/2937498358 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc738070a70 0x7fc73815de80 secure :-1 s=READY pgs=1876 cs=0 l=1 rev1=1 crypto rx=0x7fc73400c3c0 tx=0x7fc73400c880 comp rx=0 tx=0).stop 2024-09-17T05:53:26.231 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:26.229+0000 7fc73ff7b640 1 -- 172.21.15.150:0/2937498358 shutdown_connections 2024-09-17T05:53:26.231 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:26.229+0000 7fc73ff7b640 1 --2- 172.21.15.150:0/2937498358 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc738074440 0x7fc73814dbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:53:26.232 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:26.229+0000 7fc73ff7b640 1 --2- 172.21.15.150:0/2937498358 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fc71c07ad80 0x7fc71c07d290 unknown :-1 s=CLOSED pgs=794 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:53:26.232 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:26.229+0000 7fc73ff7b640 1 --2- 172.21.15.150:0/2937498358 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc73814e9c0 0x7fc73806f960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:53:26.232 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:26.229+0000 7fc73ff7b640 1 --2- 172.21.15.150:0/2937498358 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc738070a70 0x7fc73815de80 unknown :-1 s=CLOSED pgs=1876 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:53:26.232 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:26.229+0000 7fc73ff7b640 1 -- 172.21.15.150:0/2937498358 >> 172.21.15.150:0/2937498358 conn(0x7fc738073920 msgr2=0x7fc7381528f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:53:26.232 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:26.229+0000 7fc73ff7b640 1 -- 172.21.15.150:0/2937498358 shutdown_connections 2024-09-17T05:53:26.232 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:26.229+0000 7fc73ff7b640 1 -- 172.21.15.150:0/2937498358 wait complete. 2024-09-17T05:53:26.243 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config get mgr mgr/volumes/max_concurrent_clones 2024-09-17T05:53:26.360 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:26.358+0000 7f906d2ec640 1 -- 172.21.15.150:0/4201112026 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9054003a50 msgr2=0x7f9054003ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:53:26.360 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:26.358+0000 7f906d2ec640 1 --2- 172.21.15.150:0/4201112026 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9054003a50 0x7f9054003ec0 secure :-1 s=READY pgs=1878 cs=0 l=1 rev1=1 crypto rx=0x7f9058001dc0 tx=0x7f9054005830 comp rx=0 tx=0).stop 2024-09-17T05:53:26.360 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:26.358+0000 7f906d2ec640 1 -- 172.21.15.150:0/4201112026 shutdown_connections 2024-09-17T05:53:26.360 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:26.358+0000 7f906d2ec640 1 --2- 172.21.15.150:0/4201112026 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9054003a50 0x7f9054003ec0 unknown :-1 s=CLOSED pgs=1878 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:53:26.360 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:26.358+0000 7f906d2ec640 1 -- 172.21.15.150:0/4201112026 >> 172.21.15.150:0/4201112026 conn(0x7f90680b2e80 msgr2=0x7f90680b3290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:53:26.360 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:26.358+0000 7f906d2ec640 1 -- 172.21.15.150:0/4201112026 shutdown_connections 2024-09-17T05:53:26.360 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:26.358+0000 7f906d2ec640 1 -- 172.21.15.150:0/4201112026 wait complete. 2024-09-17T05:53:26.361 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:26.360+0000 7f906d2ec640 1 Processor -- start 2024-09-17T05:53:26.361 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:26.360+0000 7f906d2ec640 1 -- start start 2024-09-17T05:53:26.364 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:26.361+0000 7f906d2ec640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9054003a50 0x7f9068152a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:53:26.364 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:26.361+0000 7f906d2ec640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f90680c9970 0x7f90680afaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:53:26.364 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:26.361+0000 7f906d2ec640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f90680c9d80 0x7f90680b0030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:53:26.364 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:26.361+0000 7f906d2ec640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f90680b0da0 con 0x7f90680c9970 2024-09-17T05:53:26.364 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:26.361+0000 7f906d2ec640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f90680b1a10 con 0x7f90680c9d80 2024-09-17T05:53:26.365 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:26.361+0000 7f906d2ec640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f90680b0f20 con 0x7f9054003a50 2024-09-17T05:53:26.365 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:26.361+0000 7f90667fc640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f90680c9970 0x7f90680afaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:53:26.365 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:26.361+0000 7f90667fc640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f90680c9970 0x7f90680afaf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:53834/0 (socket says 172.21.15.150:53834) 2024-09-17T05:53:26.365 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:26.361+0000 7f90667fc640 1 -- 172.21.15.150:0/624105189 learned_addr learned my addr 172.21.15.150:0/624105189 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:53:26.365 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:26.361+0000 7f90677fe640 1 --2- 172.21.15.150:0/624105189 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f90680c9d80 0x7f90680b0030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:53:26.365 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:26.361+0000 7f9066ffd640 1 --2- 172.21.15.150:0/624105189 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9054003a50 0x7f9068152a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:53:26.365 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:26.361+0000 7f90667fc640 1 -- 172.21.15.150:0/624105189 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9054003a50 msgr2=0x7f9068152a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:53:26.365 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:26.361+0000 7f90667fc640 1 --2- 172.21.15.150:0/624105189 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9054003a50 0x7f9068152a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:53:26.365 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:26.361+0000 7f90667fc640 1 -- 172.21.15.150:0/624105189 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f90680c9d80 msgr2=0x7f90680b0030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:53:26.365 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:26.361+0000 7f90667fc640 1 --2- 172.21.15.150:0/624105189 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f90680c9d80 0x7f90680b0030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:53:26.365 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:26.361+0000 7f90667fc640 1 -- 172.21.15.150:0/624105189 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f90681f7aa0 con 0x7f90680c9970 2024-09-17T05:53:26.365 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:26.362+0000 7f90667fc640 1 --2- 172.21.15.150:0/624105189 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f90680c9970 0x7f90680afaf0 secure :-1 s=READY pgs=1879 cs=0 l=1 rev1=1 crypto rx=0x7f9050011ae0 tx=0x7f9050009e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:53:26.366 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:26.362+0000 7f905f7fe640 1 -- 172.21.15.150:0/624105189 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f905001e070 con 0x7f90680c9970 2024-09-17T05:53:26.366 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:26.362+0000 7f905f7fe640 1 -- 172.21.15.150:0/624105189 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f905000fe70 con 0x7f90680c9970 2024-09-17T05:53:26.366 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:26.362+0000 7f906d2ec640 1 -- 172.21.15.150:0/624105189 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f90681f3760 con 0x7f90680c9970 2024-09-17T05:53:26.366 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:26.362+0000 7f905f7fe640 1 -- 172.21.15.150:0/624105189 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f90500042b0 con 0x7f90680c9970 2024-09-17T05:53:26.366 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:26.362+0000 7f906d2ec640 1 -- 172.21.15.150:0/624105189 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f90681f3d20 con 0x7f90680c9970 2024-09-17T05:53:26.366 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:26.363+0000 7f906d2ec640 1 -- 172.21.15.150:0/624105189 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f90680ae690 con 0x7f90680c9970 2024-09-17T05:53:26.367 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:26.364+0000 7f905f7fe640 1 -- 172.21.15.150:0/624105189 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 45) ==== 104501+0+0 (secure 0 0 0) 0x7f9050021070 con 0x7f90680c9970 2024-09-17T05:53:26.367 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:26.364+0000 7f905f7fe640 1 --2- 172.21.15.150:0/624105189 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f904807ad80 0x7f904807d290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:53:26.367 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:26.364+0000 7f905f7fe640 1 -- 172.21.15.150:0/624105189 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(141..141 src has 1..141) ==== 5905+0+0 (secure 0 0 0) 0x7f905009a7a0 con 0x7f90680c9970 2024-09-17T05:53:26.367 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:26.364+0000 7f9066ffd640 1 --2- 172.21.15.150:0/624105189 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f904807ad80 0x7f904807d290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:53:26.367 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:26.365+0000 7f9066ffd640 1 --2- 172.21.15.150:0/624105189 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f904807ad80 0x7f904807d290 secure :-1 s=READY pgs=795 cs=0 l=1 rev1=1 crypto rx=0x7f9058032000 tx=0x7f9058001510 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:53:26.370 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:26.369+0000 7f905f7fe640 1 -- 172.21.15.150:0/624105189 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f90680ae690 con 0x7f90680c9970 2024-09-17T05:53:26.545 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:26.544+0000 7f906d2ec640 1 -- 172.21.15.150:0/624105189 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "config get", "who": "mgr", "key": "mgr/volumes/max_concurrent_clones"} v 0) -- 0x7f90680ca280 con 0x7f90680c9970 2024-09-17T05:53:26.546 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:26.544+0000 7f905f7fe640 1 -- 172.21.15.150:0/624105189 <== mon.0 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "config get", "who": "mgr", "key": "mgr/volumes/max_concurrent_clones"}]=0 v58) ==== 116+0+2 (secure 0 0 0) 0x7f90680ca280 con 0x7f90680c9970 2024-09-17T05:53:26.546 INFO:teuthology.orchestra.run.smithi150.stdout:4 2024-09-17T05:53:26.549 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:26.547+0000 7f906d2ec640 1 -- 172.21.15.150:0/624105189 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f904807ad80 msgr2=0x7f904807d290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:53:26.549 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:26.547+0000 7f906d2ec640 1 --2- 172.21.15.150:0/624105189 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f904807ad80 0x7f904807d290 secure :-1 s=READY pgs=795 cs=0 l=1 rev1=1 crypto rx=0x7f9058032000 tx=0x7f9058001510 comp rx=0 tx=0).stop 2024-09-17T05:53:26.549 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:26.547+0000 7f906d2ec640 1 -- 172.21.15.150:0/624105189 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f90680c9970 msgr2=0x7f90680afaf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:53:26.550 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:26.547+0000 7f906d2ec640 1 --2- 172.21.15.150:0/624105189 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f90680c9970 0x7f90680afaf0 secure :-1 s=READY pgs=1879 cs=0 l=1 rev1=1 crypto rx=0x7f9050011ae0 tx=0x7f9050009e80 comp rx=0 tx=0).stop 2024-09-17T05:53:26.550 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:26.547+0000 7f906d2ec640 1 -- 172.21.15.150:0/624105189 shutdown_connections 2024-09-17T05:53:26.550 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:26.547+0000 7f906d2ec640 1 --2- 172.21.15.150:0/624105189 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f90680c9d80 0x7f90680b0030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:53:26.550 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:26.547+0000 7f906d2ec640 1 --2- 172.21.15.150:0/624105189 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f904807ad80 0x7f904807d290 unknown :-1 s=CLOSED pgs=795 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:53:26.550 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:26.547+0000 7f906d2ec640 1 --2- 172.21.15.150:0/624105189 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f90680c9970 0x7f90680afaf0 unknown :-1 s=CLOSED pgs=1879 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:53:26.550 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:26.547+0000 7f906d2ec640 1 --2- 172.21.15.150:0/624105189 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9054003a50 0x7f9068152a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:53:26.550 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:26.547+0000 7f906d2ec640 1 -- 172.21.15.150:0/624105189 >> 172.21.15.150:0/624105189 conn(0x7f90680b2e80 msgr2=0x7f9068071a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:53:26.550 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:26.547+0000 7f906d2ec640 1 -- 172.21.15.150:0/624105189 shutdown_connections 2024-09-17T05:53:26.550 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:26.547+0000 7f906d2ec640 1 -- 172.21.15.150:0/624105189 wait complete. 2024-09-17T05:53:26.560 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mgr mgr/volumes/max_concurrent_clones 4 2024-09-17T05:53:26.678 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:26.675+0000 7fa8d8f0b640 1 -- 172.21.15.150:0/3623918803 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa8d40d1190 msgr2=0x7fa8d40cd0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:53:26.678 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:26.675+0000 7fa8d8f0b640 1 --2- 172.21.15.150:0/3623918803 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa8d40d1190 0x7fa8d40cd0e0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fa8cc005fd0 tx=0x7fa8cc02a4b0 comp rx=0 tx=0).stop 2024-09-17T05:53:26.678 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:26.675+0000 7fa8d8f0b640 1 -- 172.21.15.150:0/3623918803 shutdown_connections 2024-09-17T05:53:26.678 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:26.675+0000 7fa8d8f0b640 1 --2- 172.21.15.150:0/3623918803 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa8d40d1190 0x7fa8d40cd0e0 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:53:26.678 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:26.675+0000 7fa8d8f0b640 1 --2- 172.21.15.150:0/3623918803 >> v2:172.21.15.176:3300/0 conn(0x7fa8d40b7960 0x7fa8d40af1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:53:26.679 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:26.675+0000 7fa8d8f0b640 1 -- 172.21.15.150:0/3623918803 >> 172.21.15.150:0/3623918803 conn(0x7fa8d40cef20 msgr2=0x7fa8d40cf330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:53:26.679 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:26.676+0000 7fa8d8f0b640 1 -- 172.21.15.150:0/3623918803 shutdown_connections 2024-09-17T05:53:26.679 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:26.676+0000 7fa8d8f0b640 1 -- 172.21.15.150:0/3623918803 wait complete. 2024-09-17T05:53:26.679 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:26.677+0000 7fa8d8f0b640 1 Processor -- start 2024-09-17T05:53:26.679 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:26.677+0000 7fa8d8f0b640 1 -- start start 2024-09-17T05:53:26.682 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:26.679+0000 7fa8d8f0b640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa8d40b7960 0x7fa8d41f6a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:53:26.682 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:26.679+0000 7fa8d8f0b640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa8d40b7d70 0x7fa8d406f230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:53:26.682 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:26.679+0000 7fa8d8f0b640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa8d40d1190 0x7fa8d4156ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:53:26.682 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:26.679+0000 7fa8d8f0b640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7fa8d40ced10 con 0x7fa8d40b7d70 2024-09-17T05:53:26.682 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:26.679+0000 7fa8d8f0b640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fa8d40ceb90 con 0x7fa8d40d1190 2024-09-17T05:53:26.682 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:26.679+0000 7fa8d8f0b640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fa8d40af730 con 0x7fa8d40b7960 2024-09-17T05:53:26.682 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:26.679+0000 7fa8d1d9b640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa8d40b7d70 0x7fa8d406f230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:53:26.682 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:26.679+0000 7fa8d1d9b640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa8d40b7d70 0x7fa8d406f230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:53840/0 (socket says 172.21.15.150:53840) 2024-09-17T05:53:26.682 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:26.679+0000 7fa8d1d9b640 1 -- 172.21.15.150:0/3183941246 learned_addr learned my addr 172.21.15.150:0/3183941246 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:53:26.682 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:26.679+0000 7fa8d259c640 1 --2- 172.21.15.150:0/3183941246 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa8d40b7960 0x7fa8d41f6a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:53:26.683 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:26.679+0000 7fa8d2d9d640 1 --2- 172.21.15.150:0/3183941246 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa8d40d1190 0x7fa8d4156ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:53:26.683 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:26.679+0000 7fa8d1d9b640 1 -- 172.21.15.150:0/3183941246 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa8d40b7960 msgr2=0x7fa8d41f6a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:53:26.683 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:26.679+0000 7fa8d1d9b640 1 --2- 172.21.15.150:0/3183941246 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa8d40b7960 0x7fa8d41f6a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:53:26.683 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:26.679+0000 7fa8d1d9b640 1 -- 172.21.15.150:0/3183941246 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa8d40d1190 msgr2=0x7fa8d4156ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:53:26.683 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:26.679+0000 7fa8d1d9b640 1 --2- 172.21.15.150:0/3183941246 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa8d40d1190 0x7fa8d4156ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:53:26.683 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:26.679+0000 7fa8d1d9b640 1 -- 172.21.15.150:0/3183941246 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa8d41f6f80 con 0x7fa8d40b7d70 2024-09-17T05:53:26.683 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:26.679+0000 7fa8d2d9d640 1 --2- 172.21.15.150:0/3183941246 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa8d40d1190 0x7fa8d4156ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:53:26.683 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:26.679+0000 7fa8d1d9b640 1 --2- 172.21.15.150:0/3183941246 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa8d40b7d70 0x7fa8d406f230 secure :-1 s=READY pgs=1880 cs=0 l=1 rev1=1 crypto rx=0x7fa8c800c3f0 tx=0x7fa8c800c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:53:26.683 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:26.680+0000 7fa8c2ffd640 1 -- 172.21.15.150:0/3183941246 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8c8017070 con 0x7fa8d40b7d70 2024-09-17T05:53:26.683 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:26.680+0000 7fa8d8f0b640 1 -- 172.21.15.150:0/3183941246 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa8d415ef20 con 0x7fa8d40b7d70 2024-09-17T05:53:26.683 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:26.680+0000 7fa8c2ffd640 1 -- 172.21.15.150:0/3183941246 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa8c80035f0 con 0x7fa8d40b7d70 2024-09-17T05:53:26.683 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:26.680+0000 7fa8c2ffd640 1 -- 172.21.15.150:0/3183941246 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8c8003a40 con 0x7fa8d40b7d70 2024-09-17T05:53:26.684 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:26.680+0000 7fa8d8f0b640 1 -- 172.21.15.150:0/3183941246 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa8d415f4e0 con 0x7fa8d40b7d70 2024-09-17T05:53:26.685 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:26.681+0000 7fa8d8f0b640 1 -- 172.21.15.150:0/3183941246 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa8d40af1f0 con 0x7fa8d40b7d70 2024-09-17T05:53:26.685 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:26.681+0000 7fa8c2ffd640 1 -- 172.21.15.150:0/3183941246 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 45) ==== 104501+0+0 (secure 0 0 0) 0x7fa8c801a070 con 0x7fa8d40b7d70 2024-09-17T05:53:26.685 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:26.682+0000 7fa8c2ffd640 1 --2- 172.21.15.150:0/3183941246 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fa8b407ad50 0x7fa8b407d260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:53:26.685 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:26.682+0000 7fa8c2ffd640 1 -- 172.21.15.150:0/3183941246 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(141..141 src has 1..141) ==== 5905+0+0 (secure 0 0 0) 0x7fa8c8098fb0 con 0x7fa8d40b7d70 2024-09-17T05:53:26.685 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:26.682+0000 7fa8d259c640 1 --2- 172.21.15.150:0/3183941246 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fa8b407ad50 0x7fa8b407d260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:53:26.685 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:26.683+0000 7fa8d259c640 1 --2- 172.21.15.150:0/3183941246 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fa8b407ad50 0x7fa8b407d260 secure :-1 s=READY pgs=796 cs=0 l=1 rev1=1 crypto rx=0x7fa8c4005fd0 tx=0x7fa8c40094a0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:53:26.690 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:26.686+0000 7fa8c2ffd640 1 -- 172.21.15.150:0/3183941246 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fa8c80628b0 con 0x7fa8d40b7d70 2024-09-17T05:53:26.864 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:26.862+0000 7fa8d8f0b640 1 -- 172.21.15.150:0/3183941246 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command([{prefix=config set, name=mgr/volumes/max_concurrent_clones}] v 0) -- 0x7fa8d4071d30 con 0x7fa8d40b7d70 2024-09-17T05:53:26.869 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:26.866+0000 7fa8c2ffd640 1 -- 172.21.15.150:0/3183941246 <== mon.0 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/volumes/max_concurrent_clones}]=0 v59)=0 v59) ==== 131+0+0 (secure 0 0 0) 0x7fa8c80672e0 con 0x7fa8d40b7d70 2024-09-17T05:53:26.871 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:26.869+0000 7fa8d8f0b640 1 -- 172.21.15.150:0/3183941246 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fa8b407ad50 msgr2=0x7fa8b407d260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:53:26.871 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:26.869+0000 7fa8d8f0b640 1 --2- 172.21.15.150:0/3183941246 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fa8b407ad50 0x7fa8b407d260 secure :-1 s=READY pgs=796 cs=0 l=1 rev1=1 crypto rx=0x7fa8c4005fd0 tx=0x7fa8c40094a0 comp rx=0 tx=0).stop 2024-09-17T05:53:26.871 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:26.869+0000 7fa8d8f0b640 1 -- 172.21.15.150:0/3183941246 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa8d40b7d70 msgr2=0x7fa8d406f230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:53:26.871 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:26.869+0000 7fa8d8f0b640 1 --2- 172.21.15.150:0/3183941246 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa8d40b7d70 0x7fa8d406f230 secure :-1 s=READY pgs=1880 cs=0 l=1 rev1=1 crypto rx=0x7fa8c800c3f0 tx=0x7fa8c800c8b0 comp rx=0 tx=0).stop 2024-09-17T05:53:26.871 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:26.869+0000 7fa8d8f0b640 1 -- 172.21.15.150:0/3183941246 shutdown_connections 2024-09-17T05:53:26.871 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:26.869+0000 7fa8d8f0b640 1 --2- 172.21.15.150:0/3183941246 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa8d40d1190 0x7fa8d4156ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:53:26.871 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:26.869+0000 7fa8d8f0b640 1 --2- 172.21.15.150:0/3183941246 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fa8b407ad50 0x7fa8b407d260 unknown :-1 s=CLOSED pgs=796 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:53:26.871 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:26.869+0000 7fa8d8f0b640 1 --2- 172.21.15.150:0/3183941246 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa8d40b7d70 0x7fa8d406f230 unknown :-1 s=CLOSED pgs=1880 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:53:26.871 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:26.869+0000 7fa8d8f0b640 1 --2- 172.21.15.150:0/3183941246 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa8d40b7960 0x7fa8d41f6a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:53:26.872 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:26.869+0000 7fa8d8f0b640 1 -- 172.21.15.150:0/3183941246 >> 172.21.15.150:0/3183941246 conn(0x7fa8d40cef20 msgr2=0x7fa8d40b0a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:53:26.872 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:26.869+0000 7fa8d8f0b640 1 -- 172.21.15.150:0/3183941246 shutdown_connections 2024-09-17T05:53:26.872 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:26.869+0000 7fa8d8f0b640 1 -- 172.21.15.150:0/3183941246 wait complete. 2024-09-17T05:53:26.883 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mgr mgr/volumes/snapshot_clone_no_wait false 2024-09-17T05:53:26.892 INFO:tasks.ceph.mgr.x.smithi176.stderr:2024-09-17T05:53:26.890+0000 7f33da720640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-17T05:53:26.892 INFO:tasks.ceph.mgr.x.smithi176.stderr:2024-09-17T05:53:26.890+0000 7f33da720640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-17T05:53:26.892 INFO:tasks.ceph.mgr.x.smithi176.stderr:2024-09-17T05:53:26.890+0000 7f33da720640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-17T05:53:26.892 INFO:tasks.ceph.mgr.x.smithi176.stderr:2024-09-17T05:53:26.890+0000 7f33da720640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-17T05:53:26.892 INFO:tasks.ceph.mgr.x.smithi176.stderr:2024-09-17T05:53:26.890+0000 7f33da720640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-17T05:53:27.000 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:26.998+0000 7f4aa39da640 1 -- 172.21.15.150:0/2624994486 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4a88004800 msgr2=0x7f4a88004c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:53:27.000 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:26.998+0000 7f4aa39da640 1 --2- 172.21.15.150:0/2624994486 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4a88004800 0x7f4a88004c10 secure :-1 s=READY pgs=1882 cs=0 l=1 rev1=1 crypto rx=0x7f4a9c0ccb30 tx=0x7f4a88005830 comp rx=0 tx=0).stop 2024-09-17T05:53:27.000 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:26.998+0000 7f4aa1f77640 1 -- 172.21.15.150:0/2624994486 reap_dead start 2024-09-17T05:53:27.000 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:26.998+0000 7f4aa39da640 1 -- 172.21.15.150:0/2624994486 shutdown_connections 2024-09-17T05:53:27.000 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:26.998+0000 7f4aa39da640 1 -- 172.21.15.150:0/2624994486 >> 172.21.15.150:0/2624994486 conn(0x7f4a9c0cefb0 msgr2=0x7f4a9c0cf3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:53:27.000 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:26.998+0000 7f4aa39da640 1 -- 172.21.15.150:0/2624994486 shutdown_connections 2024-09-17T05:53:27.000 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:26.998+0000 7f4aa39da640 1 -- 172.21.15.150:0/2624994486 wait complete. 2024-09-17T05:53:27.001 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:27.000+0000 7f4aa39da640 1 Processor -- start 2024-09-17T05:53:27.001 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:27.000+0000 7f4aa39da640 1 -- start start 2024-09-17T05:53:27.004 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:27.001+0000 7f4aa39da640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4a88004800 0x7f4a9c1d47b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:53:27.004 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:27.001+0000 7f4aa39da640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4a9c1f3270 0x7f4a9c1f3680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:53:27.004 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:27.001+0000 7f4aa39da640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4a9c1f68b0 0x7f4a9c1f6cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:53:27.004 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:27.001+0000 7f4aa39da640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f4a9c0cdc40 con 0x7f4a9c1f68b0 2024-09-17T05:53:27.004 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:27.001+0000 7f4aa39da640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f4a9c0cdac0 con 0x7f4a9c1f3270 2024-09-17T05:53:27.004 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:27.001+0000 7f4aa39da640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f4a9c0cddc0 con 0x7f4a88004800 2024-09-17T05:53:27.005 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:27.001+0000 7f4aa1f77640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4a9c1f68b0 0x7f4a9c1f6cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:53:27.005 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:27.001+0000 7f4aa1f77640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4a9c1f68b0 0x7f4a9c1f6cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:53866/0 (socket says 172.21.15.150:53866) 2024-09-17T05:53:27.005 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:27.001+0000 7f4aa1f77640 1 -- 172.21.15.150:0/3581911470 learned_addr learned my addr 172.21.15.150:0/3581911470 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:53:27.005 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:27.001+0000 7f4aa1776640 1 --2- 172.21.15.150:0/3581911470 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4a88004800 0x7f4a9c1d47b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:53:27.005 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:27.001+0000 7f4aa0f75640 1 --2- 172.21.15.150:0/3581911470 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4a9c1f3270 0x7f4a9c1f3680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:53:27.005 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:27.001+0000 7f4aa1f77640 1 -- 172.21.15.150:0/3581911470 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4a88004800 msgr2=0x7f4a9c1d47b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:53:27.005 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:27.001+0000 7f4aa1f77640 1 --2- 172.21.15.150:0/3581911470 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4a88004800 0x7f4a9c1d47b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:53:27.005 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:27.001+0000 7f4aa1f77640 1 -- 172.21.15.150:0/3581911470 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4a9c1f3270 msgr2=0x7f4a9c1f3680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:53:27.005 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:27.001+0000 7f4aa1f77640 1 --2- 172.21.15.150:0/3581911470 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4a9c1f3270 0x7f4a9c1f3680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:53:27.005 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:27.001+0000 7f4aa1f77640 1 -- 172.21.15.150:0/3581911470 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4a9c1f7200 con 0x7f4a9c1f68b0 2024-09-17T05:53:27.005 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:27.002+0000 7f4aa1f77640 1 --2- 172.21.15.150:0/3581911470 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4a9c1f68b0 0x7f4a9c1f6cc0 secure :-1 s=READY pgs=1883 cs=0 l=1 rev1=1 crypto rx=0x7f4a9c0d35e0 tx=0x7f4a94006720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:53:27.005 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:27.002+0000 7f4a91ffb640 1 -- 172.21.15.150:0/3581911470 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a9400fa20 con 0x7f4a9c1f68b0 2024-09-17T05:53:27.006 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:27.002+0000 7f4a91ffb640 1 -- 172.21.15.150:0/3581911470 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f4a94018070 con 0x7f4a9c1f68b0 2024-09-17T05:53:27.006 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:27.002+0000 7f4a91ffb640 1 -- 172.21.15.150:0/3581911470 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a9400fe60 con 0x7f4a9c1f68b0 2024-09-17T05:53:27.006 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:27.002+0000 7f4aa39da640 1 -- 172.21.15.150:0/3581911470 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4a9c0cacc0 con 0x7f4a9c1f68b0 2024-09-17T05:53:27.006 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:27.002+0000 7f4aa39da640 1 -- 172.21.15.150:0/3581911470 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4a9c09e1c0 con 0x7f4a9c1f68b0 2024-09-17T05:53:27.007 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:27.003+0000 7f4aa39da640 1 -- 172.21.15.150:0/3581911470 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4a9c1f3dd0 con 0x7f4a9c1f68b0 2024-09-17T05:53:27.007 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:27.004+0000 7f4a91ffb640 1 -- 172.21.15.150:0/3581911470 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 45) ==== 104501+0+0 (secure 0 0 0) 0x7f4a9401d460 con 0x7f4a9c1f68b0 2024-09-17T05:53:27.007 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:27.004+0000 7f4a91ffb640 1 --2- 172.21.15.150:0/3581911470 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f4a8007ad80 0x7f4a8007d290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:53:27.007 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:27.004+0000 7f4a91ffb640 1 -- 172.21.15.150:0/3581911470 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(141..141 src has 1..141) ==== 5905+0+0 (secure 0 0 0) 0x7f4a9409a4d0 con 0x7f4a9c1f68b0 2024-09-17T05:53:27.007 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:27.004+0000 7f4aa1776640 1 --2- 172.21.15.150:0/3581911470 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f4a8007ad80 0x7f4a8007d290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:53:27.007 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:27.005+0000 7f4aa1776640 1 --2- 172.21.15.150:0/3581911470 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f4a8007ad80 0x7f4a8007d290 secure :-1 s=READY pgs=797 cs=0 l=1 rev1=1 crypto rx=0x7f4a98009400 tx=0x7f4a98005f30 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:53:27.010 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:27.009+0000 7f4a91ffb640 1 -- 172.21.15.150:0/3581911470 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f4a9c1f7200 con 0x7f4a9c1f68b0 2024-09-17T05:53:27.184 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:27.182+0000 7f4aa39da640 1 -- 172.21.15.150:0/3581911470 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command([{prefix=config set, name=mgr/volumes/snapshot_clone_no_wait}] v 0) -- 0x7f4a9c0d0e60 con 0x7f4a9c1f68b0 2024-09-17T05:53:27.188 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:27.186+0000 7f4a91ffb640 1 -- 172.21.15.150:0/3581911470 <== mon.0 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/volumes/snapshot_clone_no_wait}]=0 v60)=0 v60) ==== 136+0+0 (secure 0 0 0) 0x7f4a94063e50 con 0x7f4a9c1f68b0 2024-09-17T05:53:27.190 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:27.189+0000 7f4aa39da640 1 -- 172.21.15.150:0/3581911470 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f4a8007ad80 msgr2=0x7f4a8007d290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:53:27.191 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:27.189+0000 7f4aa39da640 1 --2- 172.21.15.150:0/3581911470 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f4a8007ad80 0x7f4a8007d290 secure :-1 s=READY pgs=797 cs=0 l=1 rev1=1 crypto rx=0x7f4a98009400 tx=0x7f4a98005f30 comp rx=0 tx=0).stop 2024-09-17T05:53:27.191 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:27.189+0000 7f4aa39da640 1 -- 172.21.15.150:0/3581911470 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4a9c1f68b0 msgr2=0x7f4a9c1f6cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:53:27.191 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:27.189+0000 7f4aa39da640 1 --2- 172.21.15.150:0/3581911470 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4a9c1f68b0 0x7f4a9c1f6cc0 secure :-1 s=READY pgs=1883 cs=0 l=1 rev1=1 crypto rx=0x7f4a9c0d35e0 tx=0x7f4a94006720 comp rx=0 tx=0).stop 2024-09-17T05:53:27.191 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:27.189+0000 7f4aa39da640 1 -- 172.21.15.150:0/3581911470 shutdown_connections 2024-09-17T05:53:27.191 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:27.189+0000 7f4aa39da640 1 --2- 172.21.15.150:0/3581911470 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4a9c1f3270 0x7f4a9c1f3680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:53:27.191 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:27.189+0000 7f4aa39da640 1 --2- 172.21.15.150:0/3581911470 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f4a8007ad80 0x7f4a8007d290 unknown :-1 s=CLOSED pgs=797 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:53:27.191 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:27.189+0000 7f4aa39da640 1 --2- 172.21.15.150:0/3581911470 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4a9c1f68b0 0x7f4a9c1f6cc0 unknown :-1 s=CLOSED pgs=1883 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:53:27.191 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:27.189+0000 7f4aa39da640 1 --2- 172.21.15.150:0/3581911470 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4a88004800 0x7f4a9c1d47b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:53:27.191 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:27.189+0000 7f4aa39da640 1 -- 172.21.15.150:0/3581911470 >> 172.21.15.150:0/3581911470 conn(0x7f4a9c0cefb0 msgr2=0x7f4a9c072970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:53:27.191 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:27.189+0000 7f4aa39da640 1 -- 172.21.15.150:0/3581911470 shutdown_connections 2024-09-17T05:53:27.191 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:27.189+0000 7f4aa39da640 1 -- 172.21.15.150:0/3581911470 wait complete. 2024-09-17T05:53:27.203 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume create cephfs sv1 --mode=777 2024-09-17T05:53:27.287 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-17T05:53:27.289 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-17T05:53:27.323 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:27.321+0000 7fb9cbe27640 1 -- 172.21.15.150:0/900940176 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb9c40c5b10 msgr2=0x7fb9c40d0230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:53:27.323 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:27.321+0000 7fb9cbe27640 1 --2- 172.21.15.150:0/900940176 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb9c40c5b10 0x7fb9c40d0230 secure :-1 s=READY pgs=1884 cs=0 l=1 rev1=1 crypto rx=0x7fb9c00098e0 tx=0x7fb9c002a5c0 comp rx=0 tx=0).stop 2024-09-17T05:53:27.323 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:27.321+0000 7fb9cbe27640 1 -- 172.21.15.150:0/900940176 shutdown_connections 2024-09-17T05:53:27.323 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:27.321+0000 7fb9cbe27640 1 --2- 172.21.15.150:0/900940176 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb9c40b2c60 0x7fb9c40cd860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:53:27.323 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:27.321+0000 7fb9cbe27640 1 --2- 172.21.15.150:0/900940176 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb9c40c5b10 0x7fb9c40d0230 unknown :-1 s=CLOSED pgs=1884 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:53:27.323 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:27.321+0000 7fb9cbe27640 1 -- 172.21.15.150:0/900940176 >> 172.21.15.150:0/900940176 conn(0x7fb9c40cef00 msgr2=0x7fb9c40cf310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:53:27.323 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:27.321+0000 7fb9cbe27640 1 -- 172.21.15.150:0/900940176 shutdown_connections 2024-09-17T05:53:27.323 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:27.321+0000 7fb9cbe27640 1 -- 172.21.15.150:0/900940176 wait complete. 2024-09-17T05:53:27.324 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:27.323+0000 7fb9cbe27640 1 Processor -- start 2024-09-17T05:53:27.324 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:27.323+0000 7fb9cbe27640 1 -- start start 2024-09-17T05:53:27.327 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:27.324+0000 7fb9cbe27640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb9c40b2c60 0x7fb9c40b6d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:53:27.327 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:27.324+0000 7fb9cbe27640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb9c40c5b10 0x7fb9c4148c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:53:27.327 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:27.324+0000 7fb9cbe27640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb9c40d0770 0x7fb9c41640a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:53:27.327 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:27.324+0000 7fb9cbe27640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7fb9c40cdf20 con 0x7fb9c40d0770 2024-09-17T05:53:27.327 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:27.324+0000 7fb9cbe27640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fb9c40cdda0 con 0x7fb9c40c5b10 2024-09-17T05:53:27.327 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:27.324+0000 7fb9cbe27640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fb9c40ce0a0 con 0x7fb9c40b2c60 2024-09-17T05:53:27.327 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:27.324+0000 7fb9ca3c4640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb9c40d0770 0x7fb9c41640a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:53:27.327 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:27.324+0000 7fb9ca3c4640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb9c40d0770 0x7fb9c41640a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:53892/0 (socket says 172.21.15.150:53892) 2024-09-17T05:53:27.327 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:27.324+0000 7fb9ca3c4640 1 -- 172.21.15.150:0/926205435 learned_addr learned my addr 172.21.15.150:0/926205435 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:53:27.328 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:27.324+0000 7fb9c93c2640 1 --2- 172.21.15.150:0/926205435 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb9c40c5b10 0x7fb9c4148c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:53:27.328 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:27.324+0000 7fb9c9bc3640 1 --2- 172.21.15.150:0/926205435 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb9c40b2c60 0x7fb9c40b6d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:53:27.328 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:27.324+0000 7fb9ca3c4640 1 -- 172.21.15.150:0/926205435 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb9c40b2c60 msgr2=0x7fb9c40b6d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:53:27.328 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:27.324+0000 7fb9ca3c4640 1 --2- 172.21.15.150:0/926205435 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb9c40b2c60 0x7fb9c40b6d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:53:27.328 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:27.324+0000 7fb9ca3c4640 1 -- 172.21.15.150:0/926205435 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb9c40c5b10 msgr2=0x7fb9c4148c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:53:27.328 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:27.324+0000 7fb9ca3c4640 1 --2- 172.21.15.150:0/926205435 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb9c40c5b10 0x7fb9c4148c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:53:27.328 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:27.324+0000 7fb9ca3c4640 1 -- 172.21.15.150:0/926205435 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb9c40b72d0 con 0x7fb9c40d0770 2024-09-17T05:53:27.328 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:27.325+0000 7fb9ca3c4640 1 --2- 172.21.15.150:0/926205435 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb9c40d0770 0x7fb9c41640a0 secure :-1 s=READY pgs=1885 cs=0 l=1 rev1=1 crypto rx=0x7fb9bc00cab0 tx=0x7fb9bc00cf70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:53:27.328 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:27.325+0000 7fb9ba7fc640 1 -- 172.21.15.150:0/926205435 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9bc00ae20 con 0x7fb9c40d0770 2024-09-17T05:53:27.328 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:27.325+0000 7fb9ba7fc640 1 -- 172.21.15.150:0/926205435 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb9bc003a60 con 0x7fb9c40d0770 2024-09-17T05:53:27.328 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:27.325+0000 7fb9cbe27640 1 -- 172.21.15.150:0/926205435 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb9c40ca390 con 0x7fb9c40d0770 2024-09-17T05:53:27.329 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:27.325+0000 7fb9ba7fc640 1 -- 172.21.15.150:0/926205435 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9bc004030 con 0x7fb9c40d0770 2024-09-17T05:53:27.329 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:27.325+0000 7fb9cbe27640 1 -- 172.21.15.150:0/926205435 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb9c40ca650 con 0x7fb9c40d0770 2024-09-17T05:53:27.329 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:27.326+0000 7fb9cbe27640 1 -- 172.21.15.150:0/926205435 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb9c40b54e0 con 0x7fb9c40d0770 2024-09-17T05:53:27.330 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:27.327+0000 7fb9ba7fc640 1 -- 172.21.15.150:0/926205435 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 45) ==== 104501+0+0 (secure 0 0 0) 0x7fb9bc0041d0 con 0x7fb9c40d0770 2024-09-17T05:53:27.330 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:27.327+0000 7fb9ba7fc640 1 --2- 172.21.15.150:0/926205435 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fb9a807ad50 0x7fb9a807d260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:53:27.330 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:27.327+0000 7fb9ba7fc640 1 -- 172.21.15.150:0/926205435 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(141..141 src has 1..141) ==== 5905+0+0 (secure 0 0 0) 0x7fb9bc09a5b0 con 0x7fb9c40d0770 2024-09-17T05:53:27.330 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:27.327+0000 7fb9c9bc3640 1 --2- 172.21.15.150:0/926205435 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fb9a807ad50 0x7fb9a807d260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:53:27.330 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:27.328+0000 7fb9c9bc3640 1 --2- 172.21.15.150:0/926205435 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fb9a807ad50 0x7fb9a807d260 secure :-1 s=READY pgs=798 cs=0 l=1 rev1=1 crypto rx=0x7fb9c0034000 tx=0x7fb9c0004730 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:53:27.333 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:27.332+0000 7fb9ba7fc640 1 -- 172.21.15.150:0/926205435 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fb9bc014070 con 0x7fb9c40d0770 2024-09-17T05:53:27.533 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:27.532+0000 7fb9cbe27640 1 -- 172.21.15.150:0/926205435 --> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] -- mgr_command(tid 0: {"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv1", "mode": "777", "target": ["mon-mgr", ""]}) -- 0x7fb9c40d0230 con 0x7fb9a807ad50 2024-09-17T05:53:27.542 INFO:tasks.ceph.mgr.x.smithi176.stderr:2024-09-17T05:53:27.541+0000 7f33d771a640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-17T05:53:27.542 INFO:tasks.ceph.mgr.x.smithi176.stderr:2024-09-17T05:53:27.541+0000 7f33d771a640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-17T05:53:27.542 INFO:tasks.ceph.mgr.x.smithi176.stderr:2024-09-17T05:53:27.541+0000 7f33d771a640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-17T05:53:27.542 INFO:tasks.ceph.mgr.x.smithi176.stderr:2024-09-17T05:53:27.541+0000 7f33d771a640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-17T05:53:27.543 INFO:tasks.ceph.mgr.x.smithi176.stderr:2024-09-17T05:53:27.541+0000 7f33d771a640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-17T05:53:27.578 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:27.576+0000 7fb9ba7fc640 1 -- 172.21.15.150:0/926205435 <== mgr.4108 v2:172.21.15.176:6800/3631216395 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7fb9c40d0230 con 0x7fb9a807ad50 2024-09-17T05:53:27.580 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:27.578+0000 7fb9cbe27640 1 -- 172.21.15.150:0/926205435 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fb9a807ad50 msgr2=0x7fb9a807d260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:53:27.580 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:27.578+0000 7fb9cbe27640 1 --2- 172.21.15.150:0/926205435 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fb9a807ad50 0x7fb9a807d260 secure :-1 s=READY pgs=798 cs=0 l=1 rev1=1 crypto rx=0x7fb9c0034000 tx=0x7fb9c0004730 comp rx=0 tx=0).stop 2024-09-17T05:53:27.581 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:27.578+0000 7fb9cbe27640 1 -- 172.21.15.150:0/926205435 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb9c40d0770 msgr2=0x7fb9c41640a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:53:27.581 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:27.578+0000 7fb9cbe27640 1 --2- 172.21.15.150:0/926205435 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb9c40d0770 0x7fb9c41640a0 secure :-1 s=READY pgs=1885 cs=0 l=1 rev1=1 crypto rx=0x7fb9bc00cab0 tx=0x7fb9bc00cf70 comp rx=0 tx=0).stop 2024-09-17T05:53:27.581 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:27.578+0000 7fb9cbe27640 1 -- 172.21.15.150:0/926205435 shutdown_connections 2024-09-17T05:53:27.581 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:27.578+0000 7fb9cbe27640 1 --2- 172.21.15.150:0/926205435 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb9c40c5b10 0x7fb9c4148c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:53:27.581 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:27.578+0000 7fb9cbe27640 1 --2- 172.21.15.150:0/926205435 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fb9a807ad50 0x7fb9a807d260 unknown :-1 s=CLOSED pgs=798 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:53:27.581 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:27.578+0000 7fb9cbe27640 1 --2- 172.21.15.150:0/926205435 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb9c40d0770 0x7fb9c41640a0 unknown :-1 s=CLOSED pgs=1885 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:53:27.581 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:27.578+0000 7fb9cbe27640 1 --2- 172.21.15.150:0/926205435 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb9c40b2c60 0x7fb9c40b6d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:53:27.581 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:27.578+0000 7fb9cbe27640 1 -- 172.21.15.150:0/926205435 >> 172.21.15.150:0/926205435 conn(0x7fb9c40cef00 msgr2=0x7fb9c4072520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:53:27.581 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:27.578+0000 7fb9cbe27640 1 -- 172.21.15.150:0/926205435 shutdown_connections 2024-09-17T05:53:27.581 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:27.579+0000 7fb9cbe27640 1 -- 172.21.15.150:0/926205435 wait complete. 2024-09-17T05:53:27.592 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume getpath cephfs sv1 2024-09-17T05:53:27.750 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:27.748+0000 7f0857ab6640 1 -- 172.21.15.150:0/1586067580 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f085015b6a0 msgr2=0x7f0850151950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:53:27.750 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:27.748+0000 7f0857ab6640 1 --2- 172.21.15.150:0/1586067580 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f085015b6a0 0x7f0850151950 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7f0848009be0 tx=0x7f084802a870 comp rx=0 tx=0).stop 2024-09-17T05:53:27.750 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:27.748+0000 7f0857ab6640 1 -- 172.21.15.150:0/1586067580 shutdown_connections 2024-09-17T05:53:27.750 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:27.748+0000 7f0857ab6640 1 --2- 172.21.15.150:0/1586067580 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f085015b6a0 0x7f0850151950 unknown :-1 s=CLOSED pgs=633 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:53:27.750 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:27.748+0000 7f0857ab6640 1 -- 172.21.15.150:0/1586067580 >> 172.21.15.150:0/1586067580 conn(0x7f085006d1c0 msgr2=0x7f085006d5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:53:27.750 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:27.748+0000 7f0857ab6640 1 -- 172.21.15.150:0/1586067580 shutdown_connections 2024-09-17T05:53:27.751 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:27.748+0000 7f0857ab6640 1 -- 172.21.15.150:0/1586067580 wait complete. 2024-09-17T05:53:27.751 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:27.750+0000 7f0857ab6640 1 Processor -- start 2024-09-17T05:53:27.751 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:27.750+0000 7f0857ab6640 1 -- start start 2024-09-17T05:53:27.754 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:27.751+0000 7f0857ab6640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f085015b6a0 0x7f0850142320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:53:27.755 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:27.751+0000 7f0857ab6640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0850142dd0 0x7f085014b280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:53:27.755 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:27.751+0000 7f0857ab6640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0850147a20 0x7f08501599d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:53:27.755 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:27.751+0000 7f0857ab6640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f0850165a90 con 0x7f085015b6a0 2024-09-17T05:53:27.755 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:27.751+0000 7f0857ab6640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f0850165910 con 0x7f0850147a20 2024-09-17T05:53:27.755 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:27.751+0000 7f0857ab6640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f0850165c10 con 0x7f0850142dd0 2024-09-17T05:53:27.755 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:27.751+0000 7f0855852640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f085015b6a0 0x7f0850142320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:53:27.755 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:27.751+0000 7f0855852640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f085015b6a0 0x7f0850142320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:53896/0 (socket says 172.21.15.150:53896) 2024-09-17T05:53:27.755 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:27.751+0000 7f0855852640 1 -- 172.21.15.150:0/1068025426 learned_addr learned my addr 172.21.15.150:0/1068025426 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:53:27.756 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:27.751+0000 7f0856053640 1 --2- 172.21.15.150:0/1068025426 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0850147a20 0x7f08501599d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:53:27.756 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:27.751+0000 7f0855051640 1 --2- 172.21.15.150:0/1068025426 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0850142dd0 0x7f085014b280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:53:27.756 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:27.751+0000 7f0855852640 1 -- 172.21.15.150:0/1068025426 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0850142dd0 msgr2=0x7f085014b280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:53:27.756 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:27.751+0000 7f0855852640 1 --2- 172.21.15.150:0/1068025426 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0850142dd0 0x7f085014b280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:53:27.756 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:27.751+0000 7f0855852640 1 -- 172.21.15.150:0/1068025426 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0850147a20 msgr2=0x7f08501599d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:53:27.756 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:27.751+0000 7f0855852640 1 --2- 172.21.15.150:0/1068025426 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0850147a20 0x7f08501599d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:53:27.756 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:27.751+0000 7f0855852640 1 -- 172.21.15.150:0/1068025426 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f085014b7c0 con 0x7f085015b6a0 2024-09-17T05:53:27.756 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:27.752+0000 7f0856053640 1 --2- 172.21.15.150:0/1068025426 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0850147a20 0x7f08501599d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T05:53:27.756 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:27.752+0000 7f0855051640 1 --2- 172.21.15.150:0/1068025426 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0850142dd0 0x7f085014b280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T05:53:27.756 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:27.752+0000 7f0855852640 1 --2- 172.21.15.150:0/1068025426 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f085015b6a0 0x7f0850142320 secure :-1 s=READY pgs=1887 cs=0 l=1 rev1=1 crypto rx=0x7f084c00c4b0 tx=0x7f084c00c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:53:27.756 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:27.752+0000 7f08467fc640 1 -- 172.21.15.150:0/1068025426 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f084c016020 con 0x7f085015b6a0 2024-09-17T05:53:27.757 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:27.752+0000 7f08467fc640 1 -- 172.21.15.150:0/1068025426 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f084c012920 con 0x7f085015b6a0 2024-09-17T05:53:27.757 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:27.752+0000 7f08467fc640 1 -- 172.21.15.150:0/1068025426 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f084c012d70 con 0x7f085015b6a0 2024-09-17T05:53:27.757 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:27.752+0000 7f0857ab6640 1 -- 172.21.15.150:0/1068025426 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f085014a1e0 con 0x7f085015b6a0 2024-09-17T05:53:27.757 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:27.752+0000 7f0857ab6640 1 -- 172.21.15.150:0/1068025426 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f085014a7a0 con 0x7f085015b6a0 2024-09-17T05:53:27.757 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:27.753+0000 7f0857ab6640 1 -- 172.21.15.150:0/1068025426 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f085006fe70 con 0x7f085015b6a0 2024-09-17T05:53:27.758 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:27.754+0000 7f08467fc640 1 -- 172.21.15.150:0/1068025426 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 45) ==== 104501+0+0 (secure 0 0 0) 0x7f084c019020 con 0x7f085015b6a0 2024-09-17T05:53:27.758 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:27.754+0000 7f08467fc640 1 --2- 172.21.15.150:0/1068025426 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f083407ad50 0x7f083407d260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:53:27.758 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:27.755+0000 7f08467fc640 1 -- 172.21.15.150:0/1068025426 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(141..141 src has 1..141) ==== 5905+0+0 (secure 0 0 0) 0x7f084c099b50 con 0x7f085015b6a0 2024-09-17T05:53:27.758 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:27.755+0000 7f0855051640 1 --2- 172.21.15.150:0/1068025426 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f083407ad50 0x7f083407d260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:53:27.758 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:27.755+0000 7f0855051640 1 --2- 172.21.15.150:0/1068025426 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f083407ad50 0x7f083407d260 secure :-1 s=READY pgs=799 cs=0 l=1 rev1=1 crypto rx=0x7f0850142d80 tx=0x7f0840009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:53:27.761 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:27.759+0000 7f08467fc640 1 -- 172.21.15.150:0/1068025426 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f084c020030 con 0x7f085015b6a0 2024-09-17T05:53:27.962 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:27.960+0000 7f0857ab6640 1 -- 172.21.15.150:0/1068025426 --> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "sub_name": "sv1", "target": ["mon-mgr", ""]}) -- 0x7f085014c3d0 con 0x7f083407ad50 2024-09-17T05:53:27.967 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:27.966+0000 7f08467fc640 1 -- 172.21.15.150:0/1068025426 <== mgr.4108 v2:172.21.15.176:6800/3631216395 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+59 (secure 0 0 0) 0x7f085014c3d0 con 0x7f083407ad50 2024-09-17T05:53:27.968 INFO:teuthology.orchestra.run.smithi150.stdout:/volumes/_nogroup/sv1/410f10a5-e2b3-409c-9cb1-eda83cddd440 2024-09-17T05:53:27.970 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:27.968+0000 7f0857ab6640 1 -- 172.21.15.150:0/1068025426 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f083407ad50 msgr2=0x7f083407d260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:53:27.970 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:27.968+0000 7f0857ab6640 1 --2- 172.21.15.150:0/1068025426 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f083407ad50 0x7f083407d260 secure :-1 s=READY pgs=799 cs=0 l=1 rev1=1 crypto rx=0x7f0850142d80 tx=0x7f0840009040 comp rx=0 tx=0).stop 2024-09-17T05:53:27.970 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:27.968+0000 7f0857ab6640 1 -- 172.21.15.150:0/1068025426 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f085015b6a0 msgr2=0x7f0850142320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:53:27.970 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:27.968+0000 7f0857ab6640 1 --2- 172.21.15.150:0/1068025426 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f085015b6a0 0x7f0850142320 secure :-1 s=READY pgs=1887 cs=0 l=1 rev1=1 crypto rx=0x7f084c00c4b0 tx=0x7f084c00c970 comp rx=0 tx=0).stop 2024-09-17T05:53:27.970 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:27.968+0000 7f0857ab6640 1 -- 172.21.15.150:0/1068025426 shutdown_connections 2024-09-17T05:53:27.970 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:27.968+0000 7f0857ab6640 1 --2- 172.21.15.150:0/1068025426 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0850147a20 0x7f08501599d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:53:27.971 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:27.968+0000 7f0857ab6640 1 --2- 172.21.15.150:0/1068025426 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f083407ad50 0x7f083407d260 unknown :-1 s=CLOSED pgs=799 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:53:27.971 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:27.968+0000 7f0857ab6640 1 --2- 172.21.15.150:0/1068025426 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0850142dd0 0x7f085014b280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:53:27.971 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:27.968+0000 7f0857ab6640 1 --2- 172.21.15.150:0/1068025426 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f085015b6a0 0x7f0850142320 unknown :-1 s=CLOSED pgs=1887 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:53:27.971 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:27.968+0000 7f0857ab6640 1 -- 172.21.15.150:0/1068025426 >> 172.21.15.150:0/1068025426 conn(0x7f085006d1c0 msgr2=0x7f08500b13e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:53:27.971 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:27.968+0000 7f0857ab6640 1 -- 172.21.15.150:0/1068025426 shutdown_connections 2024-09-17T05:53:27.971 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:27.968+0000 7f0857ab6640 1 -- 172.21.15.150:0/1068025426 wait complete. 2024-09-17T05:53:27.981 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume getpath cephfs sv1 2024-09-17T05:53:28.097 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:28.095+0000 7f58b6d39640 1 -- 172.21.15.150:0/2691349934 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f58b00d1190 msgr2=0x7f58b00cd0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:53:28.098 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:28.095+0000 7f58b6d39640 1 --2- 172.21.15.150:0/2691349934 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f58b00d1190 0x7f58b00cd0e0 secure :-1 s=READY pgs=1889 cs=0 l=1 rev1=1 crypto rx=0x7f58a8005fd0 tx=0x7f58a802a780 comp rx=0 tx=0).stop 2024-09-17T05:53:28.098 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:28.095+0000 7f58b6d39640 1 -- 172.21.15.150:0/2691349934 shutdown_connections 2024-09-17T05:53:28.098 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:28.095+0000 7f58b6d39640 1 --2- 172.21.15.150:0/2691349934 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f58b00d1190 0x7f58b00cd0e0 unknown :-1 s=CLOSED pgs=1889 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:53:28.098 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:28.095+0000 7f58b6d39640 1 --2- 172.21.15.150:0/2691349934 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f58b00b7960 0x7f58b00af1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:53:28.098 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:28.095+0000 7f58b6d39640 1 -- 172.21.15.150:0/2691349934 >> 172.21.15.150:0/2691349934 conn(0x7f58b00cef20 msgr2=0x7f58b00cf330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:53:28.098 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:28.095+0000 7f58b6d39640 1 -- 172.21.15.150:0/2691349934 shutdown_connections 2024-09-17T05:53:28.098 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:28.095+0000 7f58b6d39640 1 -- 172.21.15.150:0/2691349934 wait complete. 2024-09-17T05:53:28.099 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:28.097+0000 7f58b6d39640 1 Processor -- start 2024-09-17T05:53:28.099 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:28.097+0000 7f58b6d39640 1 -- start start 2024-09-17T05:53:28.102 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:28.099+0000 7f58b6d39640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f58b00b7960 0x7f58b0156ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:53:28.102 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:28.099+0000 7f58b6d39640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f58b00b7d70 0x7f58b00b69e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:53:28.102 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:28.099+0000 7f58b6d39640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f58b00d1190 0x7f58b0152280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:53:28.102 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:28.099+0000 7f58b6d39640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f58b00ced10 con 0x7f58b00b7960 2024-09-17T05:53:28.102 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:28.099+0000 7f58b6d39640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f58b00ceb90 con 0x7f58b00d1190 2024-09-17T05:53:28.102 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:28.099+0000 7f58b6d39640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f58b00af730 con 0x7f58b00b7d70 2024-09-17T05:53:28.102 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:28.099+0000 7f58b4ad5640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f58b00b7960 0x7f58b0156ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:53:28.102 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:28.099+0000 7f58b4ad5640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f58b00b7960 0x7f58b0156ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:53928/0 (socket says 172.21.15.150:53928) 2024-09-17T05:53:28.102 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:28.099+0000 7f58b4ad5640 1 -- 172.21.15.150:0/3239351886 learned_addr learned my addr 172.21.15.150:0/3239351886 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:53:28.102 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:28.099+0000 7f58b4ad5640 1 -- 172.21.15.150:0/3239351886 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f58b00b7d70 msgr2=0x7f58b00b69e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:53:28.102 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:28.099+0000 7f58a7fff640 1 --2- 172.21.15.150:0/3239351886 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f58b00b7d70 0x7f58b00b69e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:53:28.102 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:28.099+0000 7f58b52d6640 1 --2- 172.21.15.150:0/3239351886 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f58b00d1190 0x7f58b0152280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:53:28.103 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:28.099+0000 7f58b4ad5640 1 --2- 172.21.15.150:0/3239351886 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f58b00b7d70 0x7f58b00b69e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:53:28.103 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:28.099+0000 7f58b4ad5640 1 -- 172.21.15.150:0/3239351886 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f58b00d1190 msgr2=0x7f58b0152280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:53:28.103 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:28.099+0000 7f58b4ad5640 1 --2- 172.21.15.150:0/3239351886 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f58b00d1190 0x7f58b0152280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:53:28.103 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:28.099+0000 7f58b4ad5640 1 -- 172.21.15.150:0/3239351886 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f58b0159d30 con 0x7f58b00b7960 2024-09-17T05:53:28.103 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:28.099+0000 7f58b4ad5640 1 --2- 172.21.15.150:0/3239351886 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f58b00b7960 0x7f58b0156ad0 secure :-1 s=READY pgs=1890 cs=0 l=1 rev1=1 crypto rx=0x7f58ac00c970 tx=0x7f58ac00ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:53:28.103 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:28.099+0000 7f58a57fa640 1 -- 172.21.15.150:0/3239351886 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58ac007bb0 con 0x7f58b00b7960 2024-09-17T05:53:28.103 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:28.099+0000 7f58a57fa640 1 -- 172.21.15.150:0/3239351886 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f58ac007e40 con 0x7f58b00b7960 2024-09-17T05:53:28.103 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:28.099+0000 7f58b6d39640 1 -- 172.21.15.150:0/3239351886 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f58b01f6ce0 con 0x7f58b00b7960 2024-09-17T05:53:28.103 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:28.099+0000 7f58a57fa640 1 -- 172.21.15.150:0/3239351886 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58ac005280 con 0x7f58b00b7960 2024-09-17T05:53:28.103 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:28.099+0000 7f58b6d39640 1 -- 172.21.15.150:0/3239351886 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f58b01f72a0 con 0x7f58b00b7960 2024-09-17T05:53:28.104 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:28.101+0000 7f58b6d39640 1 -- 172.21.15.150:0/3239351886 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f58b00af1f0 con 0x7f58b00b7960 2024-09-17T05:53:28.104 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:28.101+0000 7f58a57fa640 1 -- 172.21.15.150:0/3239351886 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 45) ==== 104501+0+0 (secure 0 0 0) 0x7f58ac005420 con 0x7f58b00b7960 2024-09-17T05:53:28.105 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:28.102+0000 7f58a57fa640 1 --2- 172.21.15.150:0/3239351886 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f589c07ad50 0x7f589c07d260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:53:28.105 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:28.102+0000 7f58a57fa640 1 -- 172.21.15.150:0/3239351886 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(141..141 src has 1..141) ==== 5905+0+0 (secure 0 0 0) 0x7f58ac09a010 con 0x7f58b00b7960 2024-09-17T05:53:28.105 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:28.102+0000 7f58a7fff640 1 --2- 172.21.15.150:0/3239351886 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f589c07ad50 0x7f589c07d260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:53:28.105 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:28.103+0000 7f58a7fff640 1 --2- 172.21.15.150:0/3239351886 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f589c07ad50 0x7f589c07d260 secure :-1 s=READY pgs=800 cs=0 l=1 rev1=1 crypto rx=0x7f58b0160990 tx=0x7f58a0009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:53:28.108 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:28.106+0000 7f58a57fa640 1 -- 172.21.15.150:0/3239351886 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f58ac014030 con 0x7f58b00b7960 2024-09-17T05:53:28.193 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:28.191+0000 7f58a57fa640 1 -- 172.21.15.150:0/3239351886 <== mon.0 v2:172.21.15.150:3300/0 7 ==== mgrmap(e 46) ==== 104552+0+0 (secure 0 0 0) 0x7f58ac05fa40 con 0x7f58b00b7960 2024-09-17T05:53:28.315 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:28.314+0000 7f58b6d39640 1 -- 172.21.15.150:0/3239351886 --> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "sub_name": "sv1", "target": ["mon-mgr", ""]}) -- 0x7f58b0072340 con 0x7f589c07ad50 2024-09-17T05:53:28.321 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:28.319+0000 7f58a57fa640 1 -- 172.21.15.150:0/3239351886 <== mgr.4108 v2:172.21.15.176:6800/3631216395 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+59 (secure 0 0 0) 0x7f58b0072340 con 0x7f589c07ad50 2024-09-17T05:53:28.321 INFO:teuthology.orchestra.run.smithi150.stdout:/volumes/_nogroup/sv1/410f10a5-e2b3-409c-9cb1-eda83cddd440 2024-09-17T05:53:28.323 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:28.321+0000 7f58b6d39640 1 -- 172.21.15.150:0/3239351886 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f589c07ad50 msgr2=0x7f589c07d260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:53:28.324 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:28.321+0000 7f58b6d39640 1 --2- 172.21.15.150:0/3239351886 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f589c07ad50 0x7f589c07d260 secure :-1 s=READY pgs=800 cs=0 l=1 rev1=1 crypto rx=0x7f58b0160990 tx=0x7f58a0009040 comp rx=0 tx=0).stop 2024-09-17T05:53:28.324 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:28.321+0000 7f58b6d39640 1 -- 172.21.15.150:0/3239351886 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f58b00b7960 msgr2=0x7f58b0156ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:53:28.324 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:28.321+0000 7f58b6d39640 1 --2- 172.21.15.150:0/3239351886 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f58b00b7960 0x7f58b0156ad0 secure :-1 s=READY pgs=1890 cs=0 l=1 rev1=1 crypto rx=0x7f58ac00c970 tx=0x7f58ac00ce30 comp rx=0 tx=0).stop 2024-09-17T05:53:28.324 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:28.321+0000 7f58b6d39640 1 -- 172.21.15.150:0/3239351886 shutdown_connections 2024-09-17T05:53:28.324 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:28.321+0000 7f58b6d39640 1 --2- 172.21.15.150:0/3239351886 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f58b00d1190 0x7f58b0152280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:53:28.324 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:28.321+0000 7f58b6d39640 1 --2- 172.21.15.150:0/3239351886 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f589c07ad50 0x7f589c07d260 unknown :-1 s=CLOSED pgs=800 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:53:28.324 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:28.321+0000 7f58b6d39640 1 --2- 172.21.15.150:0/3239351886 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f58b00b7d70 0x7f58b00b69e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:53:28.324 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:28.321+0000 7f58b6d39640 1 --2- 172.21.15.150:0/3239351886 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f58b00b7960 0x7f58b0156ad0 unknown :-1 s=CLOSED pgs=1890 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:53:28.324 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:28.321+0000 7f58b6d39640 1 -- 172.21.15.150:0/3239351886 >> 172.21.15.150:0/3239351886 conn(0x7f58b00cef20 msgr2=0x7f58b0072b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:53:28.325 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:28.321+0000 7f58b6d39640 1 -- 172.21.15.150:0/3239351886 shutdown_connections 2024-09-17T05:53:28.325 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:28.321+0000 7f58b6d39640 1 -- 172.21.15.150:0/3239351886 wait complete. 2024-09-17T05:53:28.335 DEBUG:tasks.cephfs.test_volumes:filling subvolume sv1 with 3 files each 1024MB size under directory volumes/_nogroup/sv1/410f10a5-e2b3-409c-9cb1-eda83cddd440 2024-09-17T05:53:28.335 DEBUG:teuthology.orchestra.run.smithi150:> set -ex 2024-09-17T05:53:28.335 DEBUG:teuthology.orchestra.run.smithi150:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T05:53:28.351 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:53:28.351 DEBUG:teuthology.orchestra.run.smithi150:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/sv1/410f10a5-e2b3-409c-9cb1-eda83cddd440/subvolume_file.0 bs=1M conv=fdatasync count=1024 seek=0) 2024-09-17T05:53:32.223 INFO:teuthology.orchestra.run.smithi150.stderr:1024+0 records in 2024-09-17T05:53:32.223 INFO:teuthology.orchestra.run.smithi150.stderr:1024+0 records out 2024-09-17T05:53:32.223 INFO:teuthology.orchestra.run.smithi150.stderr:1073741824 bytes (1.1 GB, 1.0 GiB) copied, 3.80739 s, 282 MB/s 2024-09-17T05:53:32.224 DEBUG:teuthology.orchestra.run.smithi150:> set -ex 2024-09-17T05:53:32.224 DEBUG:teuthology.orchestra.run.smithi150:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T05:53:32.239 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:53:32.240 DEBUG:teuthology.orchestra.run.smithi150:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/sv1/410f10a5-e2b3-409c-9cb1-eda83cddd440/subvolume_file.1 bs=1M conv=fdatasync count=1024 seek=0) 2024-09-17T05:53:36.001 INFO:teuthology.orchestra.run.smithi150.stderr:1024+0 records in 2024-09-17T05:53:36.001 INFO:teuthology.orchestra.run.smithi150.stderr:1024+0 records out 2024-09-17T05:53:36.001 INFO:teuthology.orchestra.run.smithi150.stderr:1073741824 bytes (1.1 GB, 1.0 GiB) copied, 3.70396 s, 290 MB/s 2024-09-17T05:53:36.002 DEBUG:teuthology.orchestra.run.smithi150:> set -ex 2024-09-17T05:53:36.002 DEBUG:teuthology.orchestra.run.smithi150:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T05:53:36.018 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:53:36.018 DEBUG:teuthology.orchestra.run.smithi150:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/sv1/410f10a5-e2b3-409c-9cb1-eda83cddd440/subvolume_file.2 bs=1M conv=fdatasync count=1024 seek=0) 2024-09-17T05:53:39.943 INFO:teuthology.orchestra.run.smithi150.stderr:1024+0 records in 2024-09-17T05:53:39.943 INFO:teuthology.orchestra.run.smithi150.stderr:1024+0 records out 2024-09-17T05:53:39.943 INFO:teuthology.orchestra.run.smithi150.stderr:1073741824 bytes (1.1 GB, 1.0 GiB) copied, 3.86231 s, 278 MB/s 2024-09-17T05:53:39.943 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume snapshot create cephfs sv1 ss1 2024-09-17T05:53:40.062 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:40.061+0000 7f9a8c484640 1 -- 172.21.15.150:0/2715743786 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9a8406cda0 msgr2=0x7f9a8406d1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:53:40.062 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:40.061+0000 7f9a8c484640 1 --2- 172.21.15.150:0/2715743786 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9a8406cda0 0x7f9a8406d1b0 secure :-1 s=READY pgs=1891 cs=0 l=1 rev1=1 crypto rx=0x7f9a74005fd0 tx=0x7f9a7402a5d0 comp rx=0 tx=0).stop 2024-09-17T05:53:40.062 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:40.061+0000 7f9a8c484640 1 -- 172.21.15.150:0/2715743786 shutdown_connections 2024-09-17T05:53:40.062 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:40.061+0000 7f9a8c484640 1 --2- 172.21.15.150:0/2715743786 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9a8406cda0 0x7f9a8406d1b0 unknown :-1 s=CLOSED pgs=1891 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:53:40.062 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:40.061+0000 7f9a8c484640 1 --2- 172.21.15.150:0/2715743786 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9a840cc830 0x7f9a840b4620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:53:40.062 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:40.061+0000 7f9a8c484640 1 -- 172.21.15.150:0/2715743786 >> 172.21.15.150:0/2715743786 conn(0x7f9a840b2540 msgr2=0x7f9a840d02d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:53:40.062 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:40.061+0000 7f9a8c484640 1 -- 172.21.15.150:0/2715743786 shutdown_connections 2024-09-17T05:53:40.062 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:40.061+0000 7f9a8c484640 1 -- 172.21.15.150:0/2715743786 wait complete. 2024-09-17T05:53:40.063 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:40.063+0000 7f9a8c484640 1 Processor -- start 2024-09-17T05:53:40.063 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:40.063+0000 7f9a8c484640 1 -- start start 2024-09-17T05:53:40.066 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:40.064+0000 7f9a8c484640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9a8406cda0 0x7f9a84098990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:53:40.066 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:40.064+0000 7f9a8c484640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9a840af100 0x7f9a8409d690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:53:40.066 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:40.064+0000 7f9a8c484640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9a840cc830 0x7f9a8409dbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:53:40.066 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:40.064+0000 7f9a8c484640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f9a840b3600 con 0x7f9a840af100 2024-09-17T05:53:40.066 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:40.064+0000 7f9a8c484640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f9a840b3480 con 0x7f9a8406cda0 2024-09-17T05:53:40.066 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:40.064+0000 7f9a8c484640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f9a840b3780 con 0x7f9a840cc830 2024-09-17T05:53:40.066 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:40.064+0000 7f9a89a1f640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9a840af100 0x7f9a8409d690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:53:40.066 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:40.064+0000 7f9a89a1f640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9a840af100 0x7f9a8409d690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:57866/0 (socket says 172.21.15.150:57866) 2024-09-17T05:53:40.066 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:40.064+0000 7f9a89a1f640 1 -- 172.21.15.150:0/2379478074 learned_addr learned my addr 172.21.15.150:0/2379478074 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:53:40.067 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:40.064+0000 7f9a8a220640 1 --2- 172.21.15.150:0/2379478074 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9a8406cda0 0x7f9a84098990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:53:40.067 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:40.064+0000 7f9a8aa21640 1 --2- 172.21.15.150:0/2379478074 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9a840cc830 0x7f9a8409dbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:53:40.067 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:40.064+0000 7f9a89a1f640 1 -- 172.21.15.150:0/2379478074 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9a840cc830 msgr2=0x7f9a8409dbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:53:40.067 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:40.064+0000 7f9a89a1f640 1 --2- 172.21.15.150:0/2379478074 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9a840cc830 0x7f9a8409dbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:53:40.067 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:40.064+0000 7f9a89a1f640 1 -- 172.21.15.150:0/2379478074 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9a8406cda0 msgr2=0x7f9a84098990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:53:40.067 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:40.064+0000 7f9a89a1f640 1 --2- 172.21.15.150:0/2379478074 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9a8406cda0 0x7f9a84098990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:53:40.067 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:40.064+0000 7f9a89a1f640 1 -- 172.21.15.150:0/2379478074 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9a8415c590 con 0x7f9a840af100 2024-09-17T05:53:40.067 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:40.065+0000 7f9a89a1f640 1 --2- 172.21.15.150:0/2379478074 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9a840af100 0x7f9a8409d690 secure :-1 s=READY pgs=1892 cs=0 l=1 rev1=1 crypto rx=0x7f9a74006010 tx=0x7f9a740038a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:53:40.067 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:40.065+0000 7f9a7affd640 1 -- 172.21.15.150:0/2379478074 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a7403e030 con 0x7f9a840af100 2024-09-17T05:53:40.067 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:40.065+0000 7f9a7affd640 1 -- 172.21.15.150:0/2379478074 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9a74003ca0 con 0x7f9a840af100 2024-09-17T05:53:40.067 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:40.065+0000 7f9a7affd640 1 -- 172.21.15.150:0/2379478074 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a74035040 con 0x7f9a840af100 2024-09-17T05:53:40.067 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:40.065+0000 7f9a8c484640 1 -- 172.21.15.150:0/2379478074 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9a841f3f80 con 0x7f9a840af100 2024-09-17T05:53:40.067 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:40.065+0000 7f9a8c484640 1 -- 172.21.15.150:0/2379478074 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9a841f4a60 con 0x7f9a840af100 2024-09-17T05:53:40.069 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:40.066+0000 7f9a8c484640 1 -- 172.21.15.150:0/2379478074 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9a8415c300 con 0x7f9a840af100 2024-09-17T05:53:40.069 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:40.066+0000 7f9a7affd640 1 -- 172.21.15.150:0/2379478074 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 47) ==== 104603+0+0 (secure 0 0 0) 0x7f9a74041030 con 0x7f9a840af100 2024-09-17T05:53:40.069 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:40.067+0000 7f9a7affd640 1 --2- 172.21.15.150:0/2379478074 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f9a6807ae70 0x7f9a6807d380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:53:40.069 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:40.067+0000 7f9a7affd640 1 -- 172.21.15.150:0/2379478074 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(142..142 src has 1..142) ==== 5934+0+0 (secure 0 0 0) 0x7f9a740ba450 con 0x7f9a840af100 2024-09-17T05:53:40.069 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:40.067+0000 7f9a8a220640 1 --2- 172.21.15.150:0/2379478074 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f9a6807ae70 0x7f9a6807d380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:53:40.069 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:40.068+0000 7f9a8a220640 1 --2- 172.21.15.150:0/2379478074 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f9a6807ae70 0x7f9a6807d380 secure :-1 s=READY pgs=801 cs=0 l=1 rev1=1 crypto rx=0x7f9a80005fd0 tx=0x7f9a80005850 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:53:40.072 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:40.072+0000 7f9a7affd640 1 -- 172.21.15.150:0/2379478074 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f9a74084420 con 0x7f9a840af100 2024-09-17T05:53:40.277 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:40.276+0000 7f9a8c484640 1 -- 172.21.15.150:0/2379478074 --> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] -- mgr_command(tid 0: {"prefix": "fs subvolume snapshot create", "vol_name": "cephfs", "sub_name": "sv1", "snap_name": "ss1", "target": ["mon-mgr", ""]}) -- 0x7f9a8406a700 con 0x7f9a6807ae70 2024-09-17T05:53:40.292 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:40.292+0000 7f9a7affd640 1 -- 172.21.15.150:0/2379478074 <== mgr.4108 v2:172.21.15.176:6800/3631216395 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f9a8406a700 con 0x7f9a6807ae70 2024-09-17T05:53:40.295 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:40.294+0000 7f9a8c484640 1 -- 172.21.15.150:0/2379478074 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f9a6807ae70 msgr2=0x7f9a6807d380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:53:40.295 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:40.294+0000 7f9a8c484640 1 --2- 172.21.15.150:0/2379478074 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f9a6807ae70 0x7f9a6807d380 secure :-1 s=READY pgs=801 cs=0 l=1 rev1=1 crypto rx=0x7f9a80005fd0 tx=0x7f9a80005850 comp rx=0 tx=0).stop 2024-09-17T05:53:40.295 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:40.294+0000 7f9a8c484640 1 -- 172.21.15.150:0/2379478074 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9a840af100 msgr2=0x7f9a8409d690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:53:40.295 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:40.294+0000 7f9a8c484640 1 --2- 172.21.15.150:0/2379478074 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9a840af100 0x7f9a8409d690 secure :-1 s=READY pgs=1892 cs=0 l=1 rev1=1 crypto rx=0x7f9a74006010 tx=0x7f9a740038a0 comp rx=0 tx=0).stop 2024-09-17T05:53:40.295 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:40.294+0000 7f9a8c484640 1 -- 172.21.15.150:0/2379478074 shutdown_connections 2024-09-17T05:53:40.295 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:40.294+0000 7f9a8c484640 1 --2- 172.21.15.150:0/2379478074 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f9a6807ae70 0x7f9a6807d380 unknown :-1 s=CLOSED pgs=801 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:53:40.296 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:40.294+0000 7f9a8c484640 1 --2- 172.21.15.150:0/2379478074 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9a840cc830 0x7f9a8409dbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:53:40.296 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:40.294+0000 7f9a8c484640 1 --2- 172.21.15.150:0/2379478074 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9a840af100 0x7f9a8409d690 unknown :-1 s=CLOSED pgs=1892 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:53:40.296 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:40.294+0000 7f9a8c484640 1 --2- 172.21.15.150:0/2379478074 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9a8406cda0 0x7f9a84098990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:53:40.296 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:40.294+0000 7f9a8c484640 1 -- 172.21.15.150:0/2379478074 >> 172.21.15.150:0/2379478074 conn(0x7f9a840b2540 msgr2=0x7f9a8406f010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:53:40.296 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:40.294+0000 7f9a8c484640 1 -- 172.21.15.150:0/2379478074 shutdown_connections 2024-09-17T05:53:40.296 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:40.294+0000 7f9a8c484640 1 -- 172.21.15.150:0/2379478074 wait complete. 2024-09-17T05:53:40.306 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume getpath cephfs sv1 2024-09-17T05:53:40.424 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:40.423+0000 7f9072119640 1 -- 172.21.15.150:0/4121962500 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f906c073630 msgr2=0x7f906c073a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:53:40.424 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:40.423+0000 7f9072119640 1 --2- 172.21.15.150:0/4121962500 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f906c073630 0x7f906c073a40 secure :-1 s=READY pgs=1893 cs=0 l=1 rev1=1 crypto rx=0x7f906c0ceaf0 tx=0x7f906002a560 comp rx=0 tx=0).stop 2024-09-17T05:53:40.424 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:40.423+0000 7f9072119640 1 -- 172.21.15.150:0/4121962500 shutdown_connections 2024-09-17T05:53:40.424 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:40.423+0000 7f9072119640 1 --2- 172.21.15.150:0/4121962500 >> v2:172.21.15.176:3300/0 conn(0x7f906c15ccf0 0x7f906c15d100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:53:40.424 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:40.423+0000 7f9072119640 1 --2- 172.21.15.150:0/4121962500 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f906c073630 0x7f906c073a40 unknown :-1 s=CLOSED pgs=1893 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:53:40.424 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:40.423+0000 7f9072119640 1 -- 172.21.15.150:0/4121962500 >> 172.21.15.150:0/4121962500 conn(0x7f906c06d1c0 msgr2=0x7f906c06d5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:53:40.425 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:40.423+0000 7f9072119640 1 -- 172.21.15.150:0/4121962500 shutdown_connections 2024-09-17T05:53:40.425 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:40.423+0000 7f9072119640 1 -- 172.21.15.150:0/4121962500 wait complete. 2024-09-17T05:53:40.425 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:40.425+0000 7f9072119640 1 Processor -- start 2024-09-17T05:53:40.425 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:40.425+0000 7f9072119640 1 -- start start 2024-09-17T05:53:40.428 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:40.426+0000 7f9072119640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f906c073630 0x7f906c156210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:53:40.428 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:40.426+0000 7f9072119640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f906c0ccc50 0x7f906c13c390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:53:40.428 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:40.426+0000 7f9072119640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f906c15ccf0 0x7f906c154440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:53:40.428 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:40.426+0000 7f9072119640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f906c15d7c0 con 0x7f906c15ccf0 2024-09-17T05:53:40.429 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:40.426+0000 7f9072119640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f906c15d640 con 0x7f906c0ccc50 2024-09-17T05:53:40.429 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:40.426+0000 7f9072119640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f906c15d940 con 0x7f906c073630 2024-09-17T05:53:40.429 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:40.426+0000 7f906bfff640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f906c15ccf0 0x7f906c154440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:53:40.429 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:40.426+0000 7f906bfff640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f906c15ccf0 0x7f906c154440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:53700/0 (socket says 172.21.15.150:53700) 2024-09-17T05:53:40.429 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:40.426+0000 7f906bfff640 1 -- 172.21.15.150:0/2669873783 learned_addr learned my addr 172.21.15.150:0/2669873783 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:53:40.429 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:40.426+0000 7f906affd640 1 --2- 172.21.15.150:0/2669873783 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f906c0ccc50 0x7f906c13c390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:53:40.429 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:40.426+0000 7f906b7fe640 1 --2- 172.21.15.150:0/2669873783 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f906c073630 0x7f906c156210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:53:40.429 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:40.427+0000 7f906bfff640 1 -- 172.21.15.150:0/2669873783 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f906c073630 msgr2=0x7f906c156210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:53:40.429 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:40.427+0000 7f906bfff640 1 --2- 172.21.15.150:0/2669873783 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f906c073630 0x7f906c156210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:53:40.429 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:40.427+0000 7f906bfff640 1 -- 172.21.15.150:0/2669873783 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f906c0ccc50 msgr2=0x7f906c13c390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:53:40.429 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:40.427+0000 7f906bfff640 1 --2- 172.21.15.150:0/2669873783 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f906c0ccc50 0x7f906c13c390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:53:40.429 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:40.427+0000 7f906bfff640 1 -- 172.21.15.150:0/2669873783 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f906c13cdc0 con 0x7f906c15ccf0 2024-09-17T05:53:40.429 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:40.427+0000 7f906bfff640 1 --2- 172.21.15.150:0/2669873783 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f906c15ccf0 0x7f906c154440 secure :-1 s=READY pgs=1894 cs=0 l=1 rev1=1 crypto rx=0x7f906400ea80 tx=0x7f906400ef40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:53:40.429 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:40.427+0000 7f9053fff640 1 -- 172.21.15.150:0/2669873783 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9064004b20 con 0x7f906c15ccf0 2024-09-17T05:53:40.430 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:40.427+0000 7f9053fff640 1 -- 172.21.15.150:0/2669873783 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9064004ce0 con 0x7f906c15ccf0 2024-09-17T05:53:40.430 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:40.427+0000 7f9072119640 1 -- 172.21.15.150:0/2669873783 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f906c13eef0 con 0x7f906c15ccf0 2024-09-17T05:53:40.430 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:40.427+0000 7f9053fff640 1 -- 172.21.15.150:0/2669873783 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9064005280 con 0x7f906c15ccf0 2024-09-17T05:53:40.430 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:40.427+0000 7f9072119640 1 -- 172.21.15.150:0/2669873783 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f906c13f4b0 con 0x7f906c15ccf0 2024-09-17T05:53:40.431 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:40.428+0000 7f9072119640 1 -- 172.21.15.150:0/2669873783 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f906c13cf90 con 0x7f906c15ccf0 2024-09-17T05:53:40.431 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:40.429+0000 7f9053fff640 1 -- 172.21.15.150:0/2669873783 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 47) ==== 104603+0+0 (secure 0 0 0) 0x7f9064005420 con 0x7f906c15ccf0 2024-09-17T05:53:40.431 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:40.429+0000 7f9053fff640 1 --2- 172.21.15.150:0/2669873783 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f905807ae70 0x7f905807d380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:53:40.431 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:40.430+0000 7f9053fff640 1 -- 172.21.15.150:0/2669873783 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(142..142 src has 1..142) ==== 5934+0+0 (secure 0 0 0) 0x7f906409aaa0 con 0x7f906c15ccf0 2024-09-17T05:53:40.431 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:40.430+0000 7f906b7fe640 1 --2- 172.21.15.150:0/2669873783 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f905807ae70 0x7f905807d380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:53:40.431 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:40.430+0000 7f906b7fe640 1 --2- 172.21.15.150:0/2669873783 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f905807ae70 0x7f905807d380 secure :-1 s=READY pgs=802 cs=0 l=1 rev1=1 crypto rx=0x7f905c001720 tx=0x7f905c009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:53:40.434 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:40.434+0000 7f9053fff640 1 -- 172.21.15.150:0/2669873783 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f9064064310 con 0x7f906c15ccf0 2024-09-17T05:53:40.638 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:40.637+0000 7f9072119640 1 -- 172.21.15.150:0/2669873783 --> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "sub_name": "sv1", "target": ["mon-mgr", ""]}) -- 0x7f906c051040 con 0x7f905807ae70 2024-09-17T05:53:40.643 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:40.642+0000 7f9053fff640 1 -- 172.21.15.150:0/2669873783 <== mgr.4108 v2:172.21.15.176:6800/3631216395 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+59 (secure 0 0 0) 0x7f906c051040 con 0x7f905807ae70 2024-09-17T05:53:40.643 INFO:teuthology.orchestra.run.smithi150.stdout:/volumes/_nogroup/sv1/410f10a5-e2b3-409c-9cb1-eda83cddd440 2024-09-17T05:53:40.645 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:40.644+0000 7f9072119640 1 -- 172.21.15.150:0/2669873783 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f905807ae70 msgr2=0x7f905807d380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:53:40.646 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:40.644+0000 7f9072119640 1 --2- 172.21.15.150:0/2669873783 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f905807ae70 0x7f905807d380 secure :-1 s=READY pgs=802 cs=0 l=1 rev1=1 crypto rx=0x7f905c001720 tx=0x7f905c009040 comp rx=0 tx=0).stop 2024-09-17T05:53:40.646 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:40.644+0000 7f9072119640 1 -- 172.21.15.150:0/2669873783 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f906c15ccf0 msgr2=0x7f906c154440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:53:40.646 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:40.644+0000 7f9072119640 1 --2- 172.21.15.150:0/2669873783 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f906c15ccf0 0x7f906c154440 secure :-1 s=READY pgs=1894 cs=0 l=1 rev1=1 crypto rx=0x7f906400ea80 tx=0x7f906400ef40 comp rx=0 tx=0).stop 2024-09-17T05:53:40.646 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:40.644+0000 7f9072119640 1 -- 172.21.15.150:0/2669873783 shutdown_connections 2024-09-17T05:53:40.646 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:40.644+0000 7f9072119640 1 --2- 172.21.15.150:0/2669873783 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f906c0ccc50 0x7f906c13c390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:53:40.646 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:40.644+0000 7f9072119640 1 --2- 172.21.15.150:0/2669873783 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f905807ae70 0x7f905807d380 unknown :-1 s=CLOSED pgs=802 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:53:40.646 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:40.644+0000 7f9072119640 1 --2- 172.21.15.150:0/2669873783 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f906c15ccf0 0x7f906c154440 unknown :-1 s=CLOSED pgs=1894 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:53:40.646 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:40.644+0000 7f9072119640 1 --2- 172.21.15.150:0/2669873783 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f906c073630 0x7f906c156210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:53:40.646 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:40.644+0000 7f9072119640 1 -- 172.21.15.150:0/2669873783 >> 172.21.15.150:0/2669873783 conn(0x7f906c06d1c0 msgr2=0x7f906c0b4850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:53:40.646 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:40.645+0000 7f9072119640 1 -- 172.21.15.150:0/2669873783 shutdown_connections 2024-09-17T05:53:40.646 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:40.645+0000 7f9072119640 1 -- 172.21.15.150:0/2669873783 wait complete. 2024-09-17T05:53:40.656 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:53:40.657 DEBUG:teuthology.orchestra.run.smithi150:> (cd /home/ubuntu/cephtest/mnt.0 && exec getfattr -n ceph.dir.rbytes volumes/_nogroup/sv1/410f10a5-e2b3-409c-9cb1-eda83cddd440 2024-09-17T05:53:40.657 DEBUG:teuthology.orchestra.run.smithi150:> ) 2024-09-17T05:53:40.674 INFO:teuthology.orchestra.run.smithi150.stdout:# file: volumes/_nogroup/sv1/410f10a5-e2b3-409c-9cb1-eda83cddd440 2024-09-17T05:53:40.674 INFO:teuthology.orchestra.run.smithi150.stdout:ceph.dir.rbytes="2972172288" 2024-09-17T05:53:40.674 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-09-17T05:53:40.675 INFO:tasks.cephfs.test_volumes:r_size = 2972172288 exp_size = 3221225472 2024-09-17T05:53:42.676 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:53:42.676 DEBUG:teuthology.orchestra.run.smithi150:> (cd /home/ubuntu/cephtest/mnt.0 && exec getfattr -n ceph.dir.rbytes volumes/_nogroup/sv1/410f10a5-e2b3-409c-9cb1-eda83cddd440 2024-09-17T05:53:42.676 DEBUG:teuthology.orchestra.run.smithi150:> ) 2024-09-17T05:53:42.697 INFO:teuthology.orchestra.run.smithi150.stdout:# file: volumes/_nogroup/sv1/410f10a5-e2b3-409c-9cb1-eda83cddd440 2024-09-17T05:53:42.697 INFO:teuthology.orchestra.run.smithi150.stdout:ceph.dir.rbytes="2972172288" 2024-09-17T05:53:42.697 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-09-17T05:53:42.697 INFO:tasks.cephfs.test_volumes:r_size = 2972172288 exp_size = 3221225472 2024-09-17T05:53:44.699 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:53:44.699 DEBUG:teuthology.orchestra.run.smithi150:> (cd /home/ubuntu/cephtest/mnt.0 && exec getfattr -n ceph.dir.rbytes volumes/_nogroup/sv1/410f10a5-e2b3-409c-9cb1-eda83cddd440 2024-09-17T05:53:44.699 DEBUG:teuthology.orchestra.run.smithi150:> ) 2024-09-17T05:53:44.720 INFO:teuthology.orchestra.run.smithi150.stdout:# file: volumes/_nogroup/sv1/410f10a5-e2b3-409c-9cb1-eda83cddd440 2024-09-17T05:53:44.721 INFO:teuthology.orchestra.run.smithi150.stdout:ceph.dir.rbytes="2972172288" 2024-09-17T05:53:44.721 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-09-17T05:53:44.721 INFO:tasks.cephfs.test_volumes:r_size = 2972172288 exp_size = 3221225472 2024-09-17T05:53:46.722 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:53:46.722 DEBUG:teuthology.orchestra.run.smithi150:> (cd /home/ubuntu/cephtest/mnt.0 && exec getfattr -n ceph.dir.rbytes volumes/_nogroup/sv1/410f10a5-e2b3-409c-9cb1-eda83cddd440 2024-09-17T05:53:46.722 DEBUG:teuthology.orchestra.run.smithi150:> ) 2024-09-17T05:53:46.743 INFO:teuthology.orchestra.run.smithi150.stdout:# file: volumes/_nogroup/sv1/410f10a5-e2b3-409c-9cb1-eda83cddd440 2024-09-17T05:53:46.744 INFO:teuthology.orchestra.run.smithi150.stdout:ceph.dir.rbytes="3221225472" 2024-09-17T05:53:46.744 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-09-17T05:53:46.744 INFO:tasks.cephfs.test_volumes:r_size = 3221225472 exp_size = 3221225472 2024-09-17T05:53:46.744 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume snapshot clone cephfs sv1 ss1 subvol_clone38300 2024-09-17T05:53:46.915 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:46.913+0000 7f15004ec640 1 -- 172.21.15.150:0/3740210103 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f14f80b0fe0 msgr2=0x7f14f80b13f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:53:46.915 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:46.913+0000 7f15004ec640 1 --2- 172.21.15.150:0/3740210103 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f14f80b0fe0 0x7f14f80b13f0 secure :-1 s=READY pgs=1895 cs=0 l=1 rev1=1 crypto rx=0x7f14f80d2440 tx=0x7f14ec02a440 comp rx=0 tx=0).stop 2024-09-17T05:53:46.915 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:46.913+0000 7f15004ec640 1 -- 172.21.15.150:0/3740210103 shutdown_connections 2024-09-17T05:53:46.916 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:46.913+0000 7f15004ec640 1 --2- 172.21.15.150:0/3740210103 >> v2:172.21.15.176:3300/0 conn(0x7f14f815fa30 0x7f14f815fe40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:53:46.916 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:46.913+0000 7f15004ec640 1 --2- 172.21.15.150:0/3740210103 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f14f80b0fe0 0x7f14f80b13f0 unknown :-1 s=CLOSED pgs=1895 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:53:46.916 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:46.913+0000 7f15004ec640 1 --2- 172.21.15.150:0/3740210103 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f14f80b25e0 0x7f14f80b1ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:53:46.916 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:46.913+0000 7f15004ec640 1 -- 172.21.15.150:0/3740210103 >> 172.21.15.150:0/3740210103 conn(0x7f14f80b2ff0 msgr2=0x7f14f80b3400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:53:46.916 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:46.913+0000 7f15004ec640 1 -- 172.21.15.150:0/3740210103 shutdown_connections 2024-09-17T05:53:46.917 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:46.913+0000 7f15004ec640 1 -- 172.21.15.150:0/3740210103 wait complete. 2024-09-17T05:53:46.922 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:46.915+0000 7f15004ec640 1 Processor -- start 2024-09-17T05:53:46.922 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:46.915+0000 7f15004ec640 1 -- start start 2024-09-17T05:53:46.922 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:46.916+0000 7f15004ec640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f14f80b0fe0 0x7f14f81f7a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:53:46.922 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:46.916+0000 7f15004ec640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f14f80b25e0 0x7f14f81489e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:53:46.922 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:46.916+0000 7f15004ec640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f14f815fa30 0x7f14f815a550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:53:46.923 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:46.916+0000 7f15004ec640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f14f80cf510 con 0x7f14f80b0fe0 2024-09-17T05:53:46.923 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:46.916+0000 7f15004ec640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f14f80cf390 con 0x7f14f80b25e0 2024-09-17T05:53:46.923 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:46.916+0000 7f15004ec640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f14f80cf690 con 0x7f14f815fa30 2024-09-17T05:53:46.923 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:46.917+0000 7f14fe288640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f14f80b0fe0 0x7f14f81f7a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:53:46.923 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:46.917+0000 7f14fe288640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f14f80b0fe0 0x7f14f81f7a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:53710/0 (socket says 172.21.15.150:53710) 2024-09-17T05:53:46.924 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:46.917+0000 7f14fda87640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f14f80b25e0 0x7f14f81489e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:53:46.924 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:46.917+0000 7f14fe288640 1 -- 172.21.15.150:0/1332199170 learned_addr learned my addr 172.21.15.150:0/1332199170 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:53:46.924 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:46.917+0000 7f14fea89640 1 --2- 172.21.15.150:0/1332199170 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f14f815fa30 0x7f14f815a550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:53:46.924 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:46.917+0000 7f14fe288640 1 -- 172.21.15.150:0/1332199170 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f14f815fa30 msgr2=0x7f14f815a550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:53:46.924 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:46.917+0000 7f14fe288640 1 --2- 172.21.15.150:0/1332199170 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f14f815fa30 0x7f14f815a550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:53:46.924 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:46.917+0000 7f14fe288640 1 -- 172.21.15.150:0/1332199170 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f14f80b25e0 msgr2=0x7f14f81489e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:53:46.925 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:46.917+0000 7f14fe288640 1 --2- 172.21.15.150:0/1332199170 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f14f80b25e0 0x7f14f81489e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:53:46.925 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:46.917+0000 7f14fe288640 1 -- 172.21.15.150:0/1332199170 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f14f815aa90 con 0x7f14f80b0fe0 2024-09-17T05:53:46.925 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:46.917+0000 7f14fe288640 1 --2- 172.21.15.150:0/1332199170 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f14f80b0fe0 0x7f14f81f7a60 secure :-1 s=READY pgs=1896 cs=0 l=1 rev1=1 crypto rx=0x7f14e800e960 tx=0x7f14e800ee20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:53:46.925 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:46.917+0000 7f14f6ffd640 1 -- 172.21.15.150:0/1332199170 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f14e8004d20 con 0x7f14f80b0fe0 2024-09-17T05:53:46.925 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:46.917+0000 7f14f6ffd640 1 -- 172.21.15.150:0/1332199170 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f14e800cac0 con 0x7f14f80b0fe0 2024-09-17T05:53:46.925 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:46.917+0000 7f15004ec640 1 -- 172.21.15.150:0/1332199170 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f14f8149180 con 0x7f14f80b0fe0 2024-09-17T05:53:46.926 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:46.917+0000 7f14f6ffd640 1 -- 172.21.15.150:0/1332199170 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f14e8005020 con 0x7f14f80b0fe0 2024-09-17T05:53:46.926 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:46.917+0000 7f15004ec640 1 -- 172.21.15.150:0/1332199170 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f14f8149740 con 0x7f14f80b0fe0 2024-09-17T05:53:46.926 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:46.918+0000 7f15004ec640 1 -- 172.21.15.150:0/1332199170 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f14f80b7290 con 0x7f14f80b0fe0 2024-09-17T05:53:46.926 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:46.919+0000 7f14f6ffd640 1 -- 172.21.15.150:0/1332199170 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 47) ==== 104603+0+0 (secure 0 0 0) 0x7f14e80051c0 con 0x7f14f80b0fe0 2024-09-17T05:53:46.926 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:46.920+0000 7f14f6ffd640 1 --2- 172.21.15.150:0/1332199170 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f14e407ae70 0x7f14e407d380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:53:46.927 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:46.920+0000 7f14f6ffd640 1 -- 172.21.15.150:0/1332199170 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(143..143 src has 1..143) ==== 5934+0+0 (secure 0 0 0) 0x7f14e809a6e0 con 0x7f14f80b0fe0 2024-09-17T05:53:46.927 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:46.920+0000 7f14fda87640 1 --2- 172.21.15.150:0/1332199170 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f14e407ae70 0x7f14e407d380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:53:46.927 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:46.921+0000 7f14fda87640 1 --2- 172.21.15.150:0/1332199170 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f14e407ae70 0x7f14e407d380 secure :-1 s=READY pgs=803 cs=0 l=1 rev1=1 crypto rx=0x7f14ec033000 tx=0x7f14ec004730 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:53:46.928 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:46.924+0000 7f14f6ffd640 1 -- 172.21.15.150:0/1332199170 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f14f80b7290 con 0x7f14f80b0fe0 2024-09-17T05:53:47.131 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:47.130+0000 7f15004ec640 1 -- 172.21.15.150:0/1332199170 --> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] -- mgr_command(tid 0: {"prefix": "fs subvolume snapshot clone", "vol_name": "cephfs", "sub_name": "sv1", "snap_name": "ss1", "target_sub_name": "subvol_clone38300", "target": ["mon-mgr", ""]}) -- 0x7f14f80c8120 con 0x7f14e407ae70 2024-09-17T05:53:47.188 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:47.187+0000 7f14f6ffd640 1 -- 172.21.15.150:0/1332199170 <== mgr.4108 v2:172.21.15.176:6800/3631216395 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f14f80c8120 con 0x7f14e407ae70 2024-09-17T05:53:47.191 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:47.189+0000 7f15004ec640 1 -- 172.21.15.150:0/1332199170 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f14e407ae70 msgr2=0x7f14e407d380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:53:47.191 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:47.189+0000 7f15004ec640 1 --2- 172.21.15.150:0/1332199170 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f14e407ae70 0x7f14e407d380 secure :-1 s=READY pgs=803 cs=0 l=1 rev1=1 crypto rx=0x7f14ec033000 tx=0x7f14ec004730 comp rx=0 tx=0).stop 2024-09-17T05:53:47.191 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:47.189+0000 7f15004ec640 1 -- 172.21.15.150:0/1332199170 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f14f80b0fe0 msgr2=0x7f14f81f7a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:53:47.191 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:47.189+0000 7f15004ec640 1 --2- 172.21.15.150:0/1332199170 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f14f80b0fe0 0x7f14f81f7a60 secure :-1 s=READY pgs=1896 cs=0 l=1 rev1=1 crypto rx=0x7f14e800e960 tx=0x7f14e800ee20 comp rx=0 tx=0).stop 2024-09-17T05:53:47.191 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:47.190+0000 7f15004ec640 1 -- 172.21.15.150:0/1332199170 shutdown_connections 2024-09-17T05:53:47.191 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:47.190+0000 7f15004ec640 1 --2- 172.21.15.150:0/1332199170 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f14f80b25e0 0x7f14f81489e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:53:47.191 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:47.190+0000 7f15004ec640 1 --2- 172.21.15.150:0/1332199170 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f14e407ae70 0x7f14e407d380 unknown :-1 s=CLOSED pgs=803 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:53:47.191 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:47.190+0000 7f15004ec640 1 --2- 172.21.15.150:0/1332199170 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f14f815fa30 0x7f14f815a550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:53:47.191 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:47.190+0000 7f15004ec640 1 --2- 172.21.15.150:0/1332199170 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f14f80b0fe0 0x7f14f81f7a60 unknown :-1 s=CLOSED pgs=1896 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:53:47.191 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:47.190+0000 7f15004ec640 1 -- 172.21.15.150:0/1332199170 >> 172.21.15.150:0/1332199170 conn(0x7f14f80b2ff0 msgr2=0x7f14f80b0360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:53:47.192 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:47.190+0000 7f15004ec640 1 -- 172.21.15.150:0/1332199170 shutdown_connections 2024-09-17T05:53:47.192 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:47.190+0000 7f15004ec640 1 -- 172.21.15.150:0/1332199170 wait complete. 2024-09-17T05:53:47.192 INFO:tasks.ceph.mgr.x.smithi176.stderr:2024-09-17T05:53:47.192+0000 7f33dc724640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-17T05:53:47.193 INFO:tasks.ceph.mgr.x.smithi176.stderr:2024-09-17T05:53:47.192+0000 7f33dc724640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-17T05:53:47.193 INFO:tasks.ceph.mgr.x.smithi176.stderr:2024-09-17T05:53:47.192+0000 7f33dc724640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-17T05:53:47.193 INFO:tasks.ceph.mgr.x.smithi176.stderr:2024-09-17T05:53:47.192+0000 7f33dc724640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-17T05:53:47.193 INFO:tasks.ceph.mgr.x.smithi176.stderr:2024-09-17T05:53:47.192+0000 7f33dc724640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-17T05:53:47.203 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume snapshot clone cephfs sv1 ss1 subvol_clone67871 2024-09-17T05:53:47.208 INFO:tasks.ceph.mgr.x.smithi176.stderr:2024-09-17T05:53:47.208+0000 7f33dcf25640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-17T05:53:47.208 INFO:tasks.ceph.mgr.x.smithi176.stderr:2024-09-17T05:53:47.208+0000 7f33dcf25640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-17T05:53:47.208 INFO:tasks.ceph.mgr.x.smithi176.stderr:2024-09-17T05:53:47.208+0000 7f33dcf25640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-17T05:53:47.208 INFO:tasks.ceph.mgr.x.smithi176.stderr:2024-09-17T05:53:47.208+0000 7f33dcf25640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-17T05:53:47.209 INFO:tasks.ceph.mgr.x.smithi176.stderr:2024-09-17T05:53:47.208+0000 7f33dcf25640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-17T05:53:47.324 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:47.323+0000 7f865dd20640 1 -- 172.21.15.150:0/3006130043 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f86580b1350 msgr2=0x7f865815d900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:53:47.324 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:47.323+0000 7f865dd20640 1 --2- 172.21.15.150:0/3006130043 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f86580b1350 0x7f865815d900 secure :-1 s=READY pgs=1897 cs=0 l=1 rev1=1 crypto rx=0x7f8658073060 tx=0x7f865002a9c0 comp rx=0 tx=0).stop 2024-09-17T05:53:47.324 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:47.323+0000 7f865dd20640 1 -- 172.21.15.150:0/3006130043 shutdown_connections 2024-09-17T05:53:47.324 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:47.323+0000 7f865dd20640 1 --2- 172.21.15.150:0/3006130043 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f86580b1350 0x7f865815d900 unknown :-1 s=CLOSED pgs=1897 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:53:47.324 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:47.323+0000 7f865dd20640 1 --2- 172.21.15.150:0/3006130043 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f865815cbb0 0x7f86580b0e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:53:47.324 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:47.323+0000 7f865dd20640 1 --2- 172.21.15.150:0/3006130043 >> v2:172.21.15.176:3300/0 conn(0x7f86580b3b80 0x7f86580ce730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:53:47.325 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:47.323+0000 7f865dd20640 1 -- 172.21.15.150:0/3006130043 >> 172.21.15.150:0/3006130043 conn(0x7f86580b2ff0 msgr2=0x7f86580b3400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:53:47.325 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:47.323+0000 7f865dd20640 1 -- 172.21.15.150:0/3006130043 shutdown_connections 2024-09-17T05:53:47.325 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:47.323+0000 7f865dd20640 1 -- 172.21.15.150:0/3006130043 wait complete. 2024-09-17T05:53:47.325 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:47.325+0000 7f865dd20640 1 Processor -- start 2024-09-17T05:53:47.325 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:47.325+0000 7f865dd20640 1 -- start start 2024-09-17T05:53:47.328 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:47.326+0000 7f865dd20640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f86580b1350 0x7f865814b2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:53:47.328 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:47.326+0000 7f865dd20640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f865815cbb0 0x7f86581f6990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:53:47.329 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:47.326+0000 7f865dd20640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f86581f6ed0 0x7f86581f72e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:53:47.329 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:47.326+0000 7f865dd20640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f86580c76c0 con 0x7f86581f6ed0 2024-09-17T05:53:47.329 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:47.326+0000 7f865dd20640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f86580c7540 con 0x7f86580b1350 2024-09-17T05:53:47.329 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:47.326+0000 7f865dd20640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f86580c7840 con 0x7f865815cbb0 2024-09-17T05:53:47.329 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:47.326+0000 7f8657fff640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f86581f6ed0 0x7f86581f72e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:53:47.329 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:47.326+0000 7f8657fff640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f86581f6ed0 0x7f86581f72e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:53730/0 (socket says 172.21.15.150:53730) 2024-09-17T05:53:47.329 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:47.326+0000 7f8657fff640 1 -- 172.21.15.150:0/1313183972 learned_addr learned my addr 172.21.15.150:0/1313183972 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:53:47.329 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:47.326+0000 7f8656ffd640 1 --2- 172.21.15.150:0/1313183972 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f865815cbb0 0x7f86581f6990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:53:47.329 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:47.326+0000 7f86577fe640 1 --2- 172.21.15.150:0/1313183972 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f86580b1350 0x7f865814b2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:53:47.329 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:47.326+0000 7f8657fff640 1 -- 172.21.15.150:0/1313183972 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f865815cbb0 msgr2=0x7f86581f6990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:53:47.329 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:47.326+0000 7f8657fff640 1 --2- 172.21.15.150:0/1313183972 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f865815cbb0 0x7f86581f6990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:53:47.329 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:47.326+0000 7f8657fff640 1 -- 172.21.15.150:0/1313183972 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f86580b1350 msgr2=0x7f865814b2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:53:47.329 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:47.326+0000 7f8657fff640 1 --2- 172.21.15.150:0/1313183972 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f86580b1350 0x7f865814b2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:53:47.330 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:47.326+0000 7f8657fff640 1 -- 172.21.15.150:0/1313183972 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8658157300 con 0x7f86581f6ed0 2024-09-17T05:53:47.330 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:47.327+0000 7f8657fff640 1 --2- 172.21.15.150:0/1313183972 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f86581f6ed0 0x7f86581f72e0 secure :-1 s=READY pgs=1898 cs=0 l=1 rev1=1 crypto rx=0x7f8650033040 tx=0x7f8650003f70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:53:47.330 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:47.327+0000 7f863ffff640 1 -- 172.21.15.150:0/1313183972 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8650034040 con 0x7f86581f6ed0 2024-09-17T05:53:47.330 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:47.327+0000 7f863ffff640 1 -- 172.21.15.150:0/1313183972 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8650004540 con 0x7f86581f6ed0 2024-09-17T05:53:47.330 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:47.327+0000 7f865dd20640 1 -- 172.21.15.150:0/1313183972 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8658159460 con 0x7f86581f6ed0 2024-09-17T05:53:47.330 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:47.327+0000 7f863ffff640 1 -- 172.21.15.150:0/1313183972 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8650045480 con 0x7f86581f6ed0 2024-09-17T05:53:47.330 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:47.327+0000 7f865dd20640 1 -- 172.21.15.150:0/1313183972 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8658159a20 con 0x7f86581f6ed0 2024-09-17T05:53:47.330 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:47.328+0000 7f865dd20640 1 -- 172.21.15.150:0/1313183972 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f86580b3b80 con 0x7f86581f6ed0 2024-09-17T05:53:47.331 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:47.329+0000 7f863ffff640 1 -- 172.21.15.150:0/1313183972 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 47) ==== 104603+0+0 (secure 0 0 0) 0x7f8650037020 con 0x7f86581f6ed0 2024-09-17T05:53:47.331 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:47.329+0000 7f863ffff640 1 --2- 172.21.15.150:0/1313183972 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f864407ae70 0x7f864407d380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:53:47.331 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:47.329+0000 7f863ffff640 1 -- 172.21.15.150:0/1313183972 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(143..143 src has 1..143) ==== 5934+0+0 (secure 0 0 0) 0x7f86500bb540 con 0x7f86581f6ed0 2024-09-17T05:53:47.331 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:47.329+0000 7f86577fe640 1 --2- 172.21.15.150:0/1313183972 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f864407ae70 0x7f864407d380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:53:47.331 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:47.330+0000 7f86577fe640 1 --2- 172.21.15.150:0/1313183972 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f864407ae70 0x7f864407d380 secure :-1 s=READY pgs=804 cs=0 l=1 rev1=1 crypto rx=0x7f8648005fd0 tx=0x7f864800b260 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:53:47.334 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:47.334+0000 7f863ffff640 1 -- 172.21.15.150:0/1313183972 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f8650084ec0 con 0x7f86581f6ed0 2024-09-17T05:53:47.540 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:47.539+0000 7f865dd20640 1 -- 172.21.15.150:0/1313183972 --> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] -- mgr_command(tid 0: {"prefix": "fs subvolume snapshot clone", "vol_name": "cephfs", "sub_name": "sv1", "snap_name": "ss1", "target_sub_name": "subvol_clone67871", "target": ["mon-mgr", ""]}) -- 0x7f86580ae750 con 0x7f864407ae70 2024-09-17T05:53:48.192 INFO:tasks.ceph.mgr.x.smithi176.stderr:2024-09-17T05:53:48.192+0000 7f3388dbd640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-17T05:53:48.193 INFO:tasks.ceph.mgr.x.smithi176.stderr:2024-09-17T05:53:48.192+0000 7f3388dbd640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-17T05:53:48.193 INFO:tasks.ceph.mgr.x.smithi176.stderr:2024-09-17T05:53:48.192+0000 7f3388dbd640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-17T05:53:48.193 INFO:tasks.ceph.mgr.x.smithi176.stderr:2024-09-17T05:53:48.192+0000 7f3388dbd640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-17T05:53:48.193 INFO:tasks.ceph.mgr.x.smithi176.stderr:2024-09-17T05:53:48.192+0000 7f3388dbd640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-17T05:53:48.280 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:48.279+0000 7f863ffff640 1 -- 172.21.15.150:0/1313183972 <== mgr.4108 v2:172.21.15.176:6800/3631216395 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f86580ae750 con 0x7f864407ae70 2024-09-17T05:53:48.285 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:48.283+0000 7f865dd20640 1 -- 172.21.15.150:0/1313183972 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f864407ae70 msgr2=0x7f864407d380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:53:48.285 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:48.283+0000 7f865dd20640 1 --2- 172.21.15.150:0/1313183972 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f864407ae70 0x7f864407d380 secure :-1 s=READY pgs=804 cs=0 l=1 rev1=1 crypto rx=0x7f8648005fd0 tx=0x7f864800b260 comp rx=0 tx=0).stop 2024-09-17T05:53:48.285 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:48.283+0000 7f865dd20640 1 -- 172.21.15.150:0/1313183972 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f86581f6ed0 msgr2=0x7f86581f72e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:53:48.285 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:48.283+0000 7f865dd20640 1 --2- 172.21.15.150:0/1313183972 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f86581f6ed0 0x7f86581f72e0 secure :-1 s=READY pgs=1898 cs=0 l=1 rev1=1 crypto rx=0x7f8650033040 tx=0x7f8650003f70 comp rx=0 tx=0).stop 2024-09-17T05:53:48.285 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:48.284+0000 7f865dd20640 1 -- 172.21.15.150:0/1313183972 shutdown_connections 2024-09-17T05:53:48.286 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:48.284+0000 7f865dd20640 1 --2- 172.21.15.150:0/1313183972 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f864407ae70 0x7f864407d380 unknown :-1 s=CLOSED pgs=804 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:53:48.286 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:48.284+0000 7f865dd20640 1 --2- 172.21.15.150:0/1313183972 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f86581f6ed0 0x7f86581f72e0 unknown :-1 s=CLOSED pgs=1898 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:53:48.286 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:48.284+0000 7f865dd20640 1 --2- 172.21.15.150:0/1313183972 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f865815cbb0 0x7f86581f6990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:53:48.286 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:48.284+0000 7f865dd20640 1 --2- 172.21.15.150:0/1313183972 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f86580b1350 0x7f865814b2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:53:48.286 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:48.284+0000 7f865dd20640 1 -- 172.21.15.150:0/1313183972 >> 172.21.15.150:0/1313183972 conn(0x7f86580b2ff0 msgr2=0x7f86580b51d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:53:48.286 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:48.284+0000 7f865dd20640 1 -- 172.21.15.150:0/1313183972 shutdown_connections 2024-09-17T05:53:48.286 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:48.284+0000 7f865dd20640 1 -- 172.21.15.150:0/1313183972 wait complete. 2024-09-17T05:53:48.313 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume snapshot clone cephfs sv1 ss1 subvol_clone02 2024-09-17T05:53:48.319 INFO:tasks.ceph.mgr.x.smithi176.stderr:2024-09-17T05:53:48.319+0000 7f33dcf25640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-17T05:53:48.320 INFO:tasks.ceph.mgr.x.smithi176.stderr:2024-09-17T05:53:48.319+0000 7f33dcf25640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-17T05:53:48.320 INFO:tasks.ceph.mgr.x.smithi176.stderr:2024-09-17T05:53:48.319+0000 7f33dcf25640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-17T05:53:48.320 INFO:tasks.ceph.mgr.x.smithi176.stderr:2024-09-17T05:53:48.319+0000 7f33dcf25640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-17T05:53:48.320 INFO:tasks.ceph.mgr.x.smithi176.stderr:2024-09-17T05:53:48.319+0000 7f33dcf25640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-17T05:53:48.495 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:48.494+0000 7fd9f0af2640 1 -- 172.21.15.150:0/3931537161 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd9ec0b9810 msgr2=0x7fd9ec0b7ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:53:48.495 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:48.494+0000 7fd9f0af2640 1 --2- 172.21.15.150:0/3931537161 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd9ec0b9810 0x7fd9ec0b7ff0 secure :-1 s=READY pgs=1899 cs=0 l=1 rev1=1 crypto rx=0x7fd9dc0098e0 tx=0x7fd9dc02a4d0 comp rx=0 tx=0).stop 2024-09-17T05:53:48.495 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:48.494+0000 7fd9f0af2640 1 -- 172.21.15.150:0/3931537161 shutdown_connections 2024-09-17T05:53:48.495 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:48.494+0000 7fd9f0af2640 1 --2- 172.21.15.150:0/3931537161 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd9ec0b9d80 0x7fd9ec0b8530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:53:48.495 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:48.494+0000 7fd9f0af2640 1 --2- 172.21.15.150:0/3931537161 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd9ec0b9810 0x7fd9ec0b7ff0 unknown :-1 s=CLOSED pgs=1899 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:53:48.496 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:48.494+0000 7fd9f0af2640 1 -- 172.21.15.150:0/3931537161 >> 172.21.15.150:0/3931537161 conn(0x7fd9ec0d46c0 msgr2=0x7fd9ec0d4ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:53:48.496 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:48.494+0000 7fd9f0af2640 1 -- 172.21.15.150:0/3931537161 shutdown_connections 2024-09-17T05:53:48.496 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:48.494+0000 7fd9f0af2640 1 -- 172.21.15.150:0/3931537161 wait complete. 2024-09-17T05:53:48.496 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:48.496+0000 7fd9f0af2640 1 Processor -- start 2024-09-17T05:53:48.497 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:48.496+0000 7fd9f0af2640 1 -- start start 2024-09-17T05:53:48.500 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:48.497+0000 7fd9f0af2640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd9ec0b9d80 0x7fd9ec0d1c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:53:48.500 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:48.497+0000 7fd9f0af2640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd9ec162160 0x7fd9ec1f6050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:53:48.500 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:48.497+0000 7fd9f0af2640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd9ec158810 0x7fd9ec158c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:53:48.500 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:48.498+0000 7fd9f0af2640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7fd9ec06f4a0 con 0x7fd9ec0b9d80 2024-09-17T05:53:48.500 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:48.498+0000 7fd9f0af2640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fd9ec06f320 con 0x7fd9ec158810 2024-09-17T05:53:48.500 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:48.498+0000 7fd9f0af2640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fd9ec06f620 con 0x7fd9ec162160 2024-09-17T05:53:48.500 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:48.498+0000 7fd9ea59c640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd9ec0b9d80 0x7fd9ec0d1c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:53:48.500 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:48.498+0000 7fd9ea59c640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd9ec0b9d80 0x7fd9ec0d1c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:53742/0 (socket says 172.21.15.150:53742) 2024-09-17T05:53:48.500 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:48.498+0000 7fd9ea59c640 1 -- 172.21.15.150:0/2909291825 learned_addr learned my addr 172.21.15.150:0/2909291825 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:53:48.500 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:48.498+0000 7fd9ead9d640 1 --2- 172.21.15.150:0/2909291825 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd9ec158810 0x7fd9ec158c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:53:48.500 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:48.498+0000 7fd9ea59c640 1 -- 172.21.15.150:0/2909291825 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd9ec162160 msgr2=0x7fd9ec1f6050 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-17T05:53:48.500 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:48.498+0000 7fd9ea59c640 1 --2- 172.21.15.150:0/2909291825 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd9ec162160 0x7fd9ec1f6050 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:53:48.501 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:48.498+0000 7fd9ea59c640 1 -- 172.21.15.150:0/2909291825 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd9ec158810 msgr2=0x7fd9ec158c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:53:48.501 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:48.498+0000 7fd9ea59c640 1 --2- 172.21.15.150:0/2909291825 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd9ec158810 0x7fd9ec158c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:53:48.501 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:48.498+0000 7fd9ea59c640 1 -- 172.21.15.150:0/2909291825 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd9ec159160 con 0x7fd9ec0b9d80 2024-09-17T05:53:48.501 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:48.499+0000 7fd9ea59c640 1 --2- 172.21.15.150:0/2909291825 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd9ec0b9d80 0x7fd9ec0d1c90 secure :-1 s=READY pgs=1900 cs=0 l=1 rev1=1 crypto rx=0x7fd9dc02aac0 tx=0x7fd9dc005270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:53:48.502 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:48.499+0000 7fd9e2ffd640 1 -- 172.21.15.150:0/2909291825 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9dc03f070 con 0x7fd9ec0b9d80 2024-09-17T05:53:48.502 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:48.499+0000 7fd9e2ffd640 1 -- 172.21.15.150:0/2909291825 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd9dc004340 con 0x7fd9ec0b9d80 2024-09-17T05:53:48.502 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:48.499+0000 7fd9f0af2640 1 -- 172.21.15.150:0/2909291825 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd9ec156730 con 0x7fd9ec0b9d80 2024-09-17T05:53:48.502 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:48.500+0000 7fd9f0af2640 1 -- 172.21.15.150:0/2909291825 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd9ec156ba0 con 0x7fd9ec0b9d80 2024-09-17T05:53:48.502 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:48.500+0000 7fd9e2ffd640 1 -- 172.21.15.150:0/2909291825 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9dc031bb0 con 0x7fd9ec0b9d80 2024-09-17T05:53:48.504 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:48.503+0000 7fd9f0af2640 1 -- 172.21.15.150:0/2909291825 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd9ec0b9810 con 0x7fd9ec0b9d80 2024-09-17T05:53:48.504 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:48.504+0000 7fd9e2ffd640 1 -- 172.21.15.150:0/2909291825 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 47) ==== 104603+0+0 (secure 0 0 0) 0x7fd9dc042070 con 0x7fd9ec0b9d80 2024-09-17T05:53:48.505 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:48.505+0000 7fd9e2ffd640 1 --2- 172.21.15.150:0/2909291825 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fd9cc07af40 0x7fd9cc07d450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:53:48.505 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:48.505+0000 7fd9e2ffd640 1 -- 172.21.15.150:0/2909291825 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(143..143 src has 1..143) ==== 5934+0+0 (secure 0 0 0) 0x7fd9dc0baf10 con 0x7fd9ec0b9d80 2024-09-17T05:53:48.506 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:48.505+0000 7fd9e3fff640 1 --2- 172.21.15.150:0/2909291825 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fd9cc07af40 0x7fd9cc07d450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:53:48.508 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:48.507+0000 7fd9e3fff640 1 --2- 172.21.15.150:0/2909291825 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fd9cc07af40 0x7fd9cc07d450 secure :-1 s=READY pgs=805 cs=0 l=1 rev1=1 crypto rx=0x7fd9ec1580a0 tx=0x7fd9d4006b80 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:53:48.514 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:48.513+0000 7fd9e2ffd640 1 -- 172.21.15.150:0/2909291825 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fd9ec159160 con 0x7fd9ec0b9d80 2024-09-17T05:53:48.839 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:48.839+0000 7fd9f0af2640 1 -- 172.21.15.150:0/2909291825 --> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] -- mgr_command(tid 0: {"prefix": "fs subvolume snapshot clone", "vol_name": "cephfs", "sub_name": "sv1", "snap_name": "ss1", "target_sub_name": "subvol_clone02", "target": ["mon-mgr", ""]}) -- 0x7fd9ec0b3750 con 0x7fd9cc07af40 2024-09-17T05:53:49.264 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:49.263+0000 7fd9e2ffd640 1 -- 172.21.15.150:0/2909291825 <== mgr.4108 v2:172.21.15.176:6800/3631216395 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7fd9ec0b3750 con 0x7fd9cc07af40 2024-09-17T05:53:49.267 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:49.266+0000 7fd9f0af2640 1 -- 172.21.15.150:0/2909291825 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fd9cc07af40 msgr2=0x7fd9cc07d450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:53:49.267 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:49.266+0000 7fd9f0af2640 1 --2- 172.21.15.150:0/2909291825 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fd9cc07af40 0x7fd9cc07d450 secure :-1 s=READY pgs=805 cs=0 l=1 rev1=1 crypto rx=0x7fd9ec1580a0 tx=0x7fd9d4006b80 comp rx=0 tx=0).stop 2024-09-17T05:53:49.268 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:49.266+0000 7fd9f0af2640 1 -- 172.21.15.150:0/2909291825 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd9ec0b9d80 msgr2=0x7fd9ec0d1c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:53:49.268 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:49.266+0000 7fd9f0af2640 1 --2- 172.21.15.150:0/2909291825 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd9ec0b9d80 0x7fd9ec0d1c90 secure :-1 s=READY pgs=1900 cs=0 l=1 rev1=1 crypto rx=0x7fd9dc02aac0 tx=0x7fd9dc005270 comp rx=0 tx=0).stop 2024-09-17T05:53:49.268 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:49.266+0000 7fd9f0af2640 1 -- 172.21.15.150:0/2909291825 shutdown_connections 2024-09-17T05:53:49.268 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:49.266+0000 7fd9f0af2640 1 --2- 172.21.15.150:0/2909291825 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd9ec158810 0x7fd9ec158c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:53:49.268 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:49.266+0000 7fd9f0af2640 1 --2- 172.21.15.150:0/2909291825 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fd9cc07af40 0x7fd9cc07d450 unknown :-1 s=CLOSED pgs=805 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:53:49.268 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:49.266+0000 7fd9f0af2640 1 --2- 172.21.15.150:0/2909291825 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd9ec162160 0x7fd9ec1f6050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:53:49.268 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:49.266+0000 7fd9f0af2640 1 --2- 172.21.15.150:0/2909291825 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd9ec0b9d80 0x7fd9ec0d1c90 unknown :-1 s=CLOSED pgs=1900 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:53:49.268 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:49.266+0000 7fd9f0af2640 1 -- 172.21.15.150:0/2909291825 >> 172.21.15.150:0/2909291825 conn(0x7fd9ec0d46c0 msgr2=0x7fd9ec15ee70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:53:49.268 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:49.267+0000 7fd9f0af2640 1 -- 172.21.15.150:0/2909291825 shutdown_connections 2024-09-17T05:53:49.268 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:49.267+0000 7fd9f0af2640 1 -- 172.21.15.150:0/2909291825 wait complete. 2024-09-17T05:53:49.281 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume snapshot clone cephfs sv1 ss1 subvol_clone48513 2024-09-17T05:53:49.332 INFO:tasks.ceph.mgr.x.smithi176.stderr:2024-09-17T05:53:49.331+0000 7f33dd726640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-17T05:53:49.332 INFO:tasks.ceph.mgr.x.smithi176.stderr:2024-09-17T05:53:49.331+0000 7f33dd726640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-17T05:53:49.332 INFO:tasks.ceph.mgr.x.smithi176.stderr:2024-09-17T05:53:49.331+0000 7f33dd726640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-17T05:53:49.332 INFO:tasks.ceph.mgr.x.smithi176.stderr:2024-09-17T05:53:49.331+0000 7f33dd726640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-17T05:53:49.333 INFO:tasks.ceph.mgr.x.smithi176.stderr:2024-09-17T05:53:49.331+0000 7f33dd726640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-17T05:53:49.451 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:49.450+0000 7fd84a09b640 1 -- 172.21.15.150:0/1035495346 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd830005270 msgr2=0x7fd83000b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:53:49.451 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:49.450+0000 7fd84a09b640 1 --2- 172.21.15.150:0/1035495346 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd830005270 0x7fd83000b9c0 secure :-1 s=READY pgs=1902 cs=0 l=1 rev1=1 crypto rx=0x7fd83c00c290 tx=0x7fd830005830 comp rx=0 tx=0).stop 2024-09-17T05:53:49.451 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:49.450+0000 7fd84a09b640 1 -- 172.21.15.150:0/1035495346 shutdown_connections 2024-09-17T05:53:49.451 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:49.450+0000 7fd84a09b640 1 --2- 172.21.15.150:0/1035495346 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd830005270 0x7fd83000b9c0 unknown :-1 s=CLOSED pgs=1902 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:53:49.452 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:49.450+0000 7fd84a09b640 1 -- 172.21.15.150:0/1035495346 >> 172.21.15.150:0/1035495346 conn(0x7fd84408bfe0 msgr2=0x7fd8440d46e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:53:49.452 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:49.450+0000 7fd84a09b640 1 -- 172.21.15.150:0/1035495346 shutdown_connections 2024-09-17T05:53:49.452 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:49.450+0000 7fd84a09b640 1 -- 172.21.15.150:0/1035495346 wait complete. 2024-09-17T05:53:49.452 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:49.452+0000 7fd84a09b640 1 Processor -- start 2024-09-17T05:53:49.453 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:49.452+0000 7fd84a09b640 1 -- start start 2024-09-17T05:53:49.455 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:49.453+0000 7fd84a09b640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd830005270 0x7fd8441f5e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:53:49.455 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:49.453+0000 7fd84a09b640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd8440ce040 0x7fd8441f63b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:53:49.455 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:49.453+0000 7fd84a09b640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd8440b5e60 0x7fd8440b6270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:53:49.455 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:49.453+0000 7fd84a09b640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7fd84406e430 con 0x7fd8440b5e60 2024-09-17T05:53:49.456 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:49.453+0000 7fd84a09b640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fd84406e2b0 con 0x7fd830005270 2024-09-17T05:53:49.456 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:49.453+0000 7fd84a09b640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fd84406e5b0 con 0x7fd8440ce040 2024-09-17T05:53:49.456 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:49.454+0000 7fd843fff640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd8440b5e60 0x7fd8440b6270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:53:49.456 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:49.454+0000 7fd843fff640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd8440b5e60 0x7fd8440b6270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:53756/0 (socket says 172.21.15.150:53756) 2024-09-17T05:53:49.456 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:49.454+0000 7fd843fff640 1 -- 172.21.15.150:0/3532556685 learned_addr learned my addr 172.21.15.150:0/3532556685 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:53:49.456 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:49.454+0000 7fd8437fe640 1 --2- 172.21.15.150:0/3532556685 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd830005270 0x7fd8441f5e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:53:49.456 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:49.454+0000 7fd843fff640 1 -- 172.21.15.150:0/3532556685 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd8440ce040 msgr2=0x7fd8441f63b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:53:49.456 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:49.454+0000 7fd843fff640 1 --2- 172.21.15.150:0/3532556685 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd8440ce040 0x7fd8441f63b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:53:49.456 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:49.454+0000 7fd843fff640 1 -- 172.21.15.150:0/3532556685 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd830005270 msgr2=0x7fd8441f5e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:53:49.456 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:49.454+0000 7fd843fff640 1 --2- 172.21.15.150:0/3532556685 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd830005270 0x7fd8441f5e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:53:49.456 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:49.454+0000 7fd843fff640 1 -- 172.21.15.150:0/3532556685 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd8440b4230 con 0x7fd8440b5e60 2024-09-17T05:53:49.456 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:49.454+0000 7fd843fff640 1 --2- 172.21.15.150:0/3532556685 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd8440b5e60 0x7fd8440b6270 secure :-1 s=READY pgs=1903 cs=0 l=1 rev1=1 crypto rx=0x7fd83c00c380 tx=0x7fd83c02ec30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:53:49.457 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:49.454+0000 7fd840ff9640 1 -- 172.21.15.150:0/3532556685 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd83c031070 con 0x7fd8440b5e60 2024-09-17T05:53:49.457 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:49.454+0000 7fd840ff9640 1 -- 172.21.15.150:0/3532556685 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd83c0014f0 con 0x7fd8440b5e60 2024-09-17T05:53:49.457 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:49.454+0000 7fd84a09b640 1 -- 172.21.15.150:0/3532556685 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd8440b44f0 con 0x7fd8440b5e60 2024-09-17T05:53:49.457 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:49.454+0000 7fd840ff9640 1 -- 172.21.15.150:0/3532556685 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd83c006c50 con 0x7fd8440b5e60 2024-09-17T05:53:49.457 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:49.454+0000 7fd84a09b640 1 -- 172.21.15.150:0/3532556685 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd8440b4ab0 con 0x7fd8440b5e60 2024-09-17T05:53:49.457 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:49.455+0000 7fd84a09b640 1 -- 172.21.15.150:0/3532556685 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd8440d02e0 con 0x7fd8440b5e60 2024-09-17T05:53:49.458 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:49.456+0000 7fd840ff9640 1 -- 172.21.15.150:0/3532556685 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 47) ==== 104603+0+0 (secure 0 0 0) 0x7fd83c034070 con 0x7fd8440b5e60 2024-09-17T05:53:49.458 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:49.457+0000 7fd840ff9640 1 --2- 172.21.15.150:0/3532556685 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fd82407aea0 0x7fd82407d3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:53:49.458 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:49.457+0000 7fd840ff9640 1 -- 172.21.15.150:0/3532556685 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(143..143 src has 1..143) ==== 5934+0+0 (secure 0 0 0) 0x7fd83c0ba120 con 0x7fd8440b5e60 2024-09-17T05:53:49.463 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:49.463+0000 7fd840ff9640 1 -- 172.21.15.150:0/3532556685 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fd83c045020 con 0x7fd8440b5e60 2024-09-17T05:53:49.481 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:49.481+0000 7fd8437fe640 1 --2- 172.21.15.150:0/3532556685 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fd82407aea0 0x7fd82407d3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:53:49.516 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:49.515+0000 7fd8437fe640 1 --2- 172.21.15.150:0/3532556685 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fd82407aea0 0x7fd82407d3b0 secure :-1 s=READY pgs=806 cs=0 l=1 rev1=1 crypto rx=0x7fd834005fd0 tx=0x7fd8340094a0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:53:49.846 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:49.845+0000 7fd84a09b640 1 -- 172.21.15.150:0/3532556685 --> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] -- mgr_command(tid 0: {"prefix": "fs subvolume snapshot clone", "vol_name": "cephfs", "sub_name": "sv1", "snap_name": "ss1", "target_sub_name": "subvol_clone48513", "target": ["mon-mgr", ""]}) -- 0x7fd8440b52b0 con 0x7fd82407aea0 2024-09-17T05:53:50.294 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:50.293+0000 7fd840ff9640 1 -- 172.21.15.150:0/3532556685 <== mon.0 v2:172.21.15.150:3300/0 7 ==== mgrmap(e 48) ==== 104807+0+0 (secure 0 0 0) 0x7fd83c006120 con 0x7fd8440b5e60 2024-09-17T05:53:50.671 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:50.670+0000 7fd840ff9640 1 -- 172.21.15.150:0/3532556685 <== mgr.4108 v2:172.21.15.176:6800/3631216395 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7fd834009b10 con 0x7fd82407aea0 2024-09-17T05:53:50.674 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:50.673+0000 7fd84a09b640 1 -- 172.21.15.150:0/3532556685 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fd82407aea0 msgr2=0x7fd82407d3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:53:50.674 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:50.673+0000 7fd84a09b640 1 --2- 172.21.15.150:0/3532556685 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fd82407aea0 0x7fd82407d3b0 secure :-1 s=READY pgs=806 cs=0 l=1 rev1=1 crypto rx=0x7fd834005fd0 tx=0x7fd8340094a0 comp rx=0 tx=0).stop 2024-09-17T05:53:50.674 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:50.673+0000 7fd84a09b640 1 -- 172.21.15.150:0/3532556685 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd8440b5e60 msgr2=0x7fd8440b6270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:53:50.674 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:50.673+0000 7fd84a09b640 1 --2- 172.21.15.150:0/3532556685 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd8440b5e60 0x7fd8440b6270 secure :-1 s=READY pgs=1903 cs=0 l=1 rev1=1 crypto rx=0x7fd83c00c380 tx=0x7fd83c02ec30 comp rx=0 tx=0).stop 2024-09-17T05:53:50.674 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:50.673+0000 7fd84a09b640 1 -- 172.21.15.150:0/3532556685 shutdown_connections 2024-09-17T05:53:50.675 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:50.673+0000 7fd84a09b640 1 --2- 172.21.15.150:0/3532556685 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fd82407aea0 0x7fd82407d3b0 unknown :-1 s=CLOSED pgs=806 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:53:50.675 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:50.673+0000 7fd84a09b640 1 --2- 172.21.15.150:0/3532556685 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd8440b5e60 0x7fd8440b6270 unknown :-1 s=CLOSED pgs=1903 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:53:50.675 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:50.673+0000 7fd84a09b640 1 --2- 172.21.15.150:0/3532556685 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd8440ce040 0x7fd8441f63b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:53:50.675 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:50.673+0000 7fd84a09b640 1 --2- 172.21.15.150:0/3532556685 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd830005270 0x7fd8441f5e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:53:50.675 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:50.673+0000 7fd84a09b640 1 -- 172.21.15.150:0/3532556685 >> 172.21.15.150:0/3532556685 conn(0x7fd84408bfe0 msgr2=0x7fd844068e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:53:50.675 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:50.673+0000 7fd84a09b640 1 -- 172.21.15.150:0/3532556685 shutdown_connections 2024-09-17T05:53:50.675 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:50.673+0000 7fd84a09b640 1 -- 172.21.15.150:0/3532556685 wait complete. 2024-09-17T05:53:50.688 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume snapshot clone cephfs sv1 ss1 subvol_clone78074 2024-09-17T05:53:50.863 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:50.861+0000 7fac034f2640 1 -- 172.21.15.150:0/565222928 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fabfc162160 msgr2=0x7fabfc06f540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:53:50.863 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:50.861+0000 7fac034f2640 1 --2- 172.21.15.150:0/565222928 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fabfc162160 0x7fabfc06f540 secure :-1 s=READY pgs=1904 cs=0 l=1 rev1=1 crypto rx=0x7fabf4005fd0 tx=0x7fabf402a9a0 comp rx=0 tx=0).stop 2024-09-17T05:53:50.863 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:50.862+0000 7fac034f2640 1 -- 172.21.15.150:0/565222928 shutdown_connections 2024-09-17T05:53:50.863 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:50.862+0000 7fac034f2640 1 --2- 172.21.15.150:0/565222928 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fabfc162160 0x7fabfc06f540 unknown :-1 s=CLOSED pgs=1904 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:53:50.863 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:50.862+0000 7fac034f2640 1 --2- 172.21.15.150:0/565222928 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fabfc0b9d80 0x7fabfc06f000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:53:50.863 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:50.862+0000 7fac034f2640 1 -- 172.21.15.150:0/565222928 >> 172.21.15.150:0/565222928 conn(0x7fabfc0d46c0 msgr2=0x7fabfc0d4ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:53:50.863 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:50.862+0000 7fac034f2640 1 -- 172.21.15.150:0/565222928 shutdown_connections 2024-09-17T05:53:50.864 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:50.862+0000 7fac034f2640 1 -- 172.21.15.150:0/565222928 wait complete. 2024-09-17T05:53:50.864 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:50.864+0000 7fac034f2640 1 Processor -- start 2024-09-17T05:53:50.865 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:50.864+0000 7fac034f2640 1 -- start start 2024-09-17T05:53:50.867 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:50.865+0000 7fac034f2640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fabfc0b9d80 0x7fabfc151420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:53:50.867 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:50.865+0000 7fac034f2640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fabfc162160 0x7fabfc1f6a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:53:50.867 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:50.865+0000 7fac034f2640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fabfc0d07d0 0x7fabfc1f6fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:53:50.867 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:50.865+0000 7fac034f2640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7fabfc0b8c60 con 0x7fabfc0b9d80 2024-09-17T05:53:50.868 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:50.865+0000 7fac034f2640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fabfc0b8ae0 con 0x7fabfc0d07d0 2024-09-17T05:53:50.868 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:50.865+0000 7fac034f2640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fabfc0b8de0 con 0x7fabfc162160 2024-09-17T05:53:50.868 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:50.865+0000 7fac0128e640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fabfc0b9d80 0x7fabfc151420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:53:50.868 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:50.866+0000 7fac0128e640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fabfc0b9d80 0x7fabfc151420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:50378/0 (socket says 172.21.15.150:50378) 2024-09-17T05:53:50.868 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:50.866+0000 7fac0128e640 1 -- 172.21.15.150:0/2340388104 learned_addr learned my addr 172.21.15.150:0/2340388104 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:53:50.868 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:50.866+0000 7fac0128e640 1 -- 172.21.15.150:0/2340388104 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fabfc162160 msgr2=0x7fabfc1f6a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:53:50.868 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:50.866+0000 7fac01a8f640 1 --2- 172.21.15.150:0/2340388104 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fabfc0d07d0 0x7fabfc1f6fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:53:50.868 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:50.866+0000 7fac0128e640 1 --2- 172.21.15.150:0/2340388104 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fabfc162160 0x7fabfc1f6a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:53:50.868 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:50.866+0000 7fac0128e640 1 -- 172.21.15.150:0/2340388104 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fabfc0d07d0 msgr2=0x7fabfc1f6fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:53:50.868 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:50.866+0000 7fac0128e640 1 --2- 172.21.15.150:0/2340388104 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fabfc0d07d0 0x7fabfc1f6fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:53:50.869 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:50.866+0000 7fac0128e640 1 -- 172.21.15.150:0/2340388104 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fabfc0d1e40 con 0x7fabfc0b9d80 2024-09-17T05:53:50.869 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:50.866+0000 7fac0128e640 1 --2- 172.21.15.150:0/2340388104 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fabfc0b9d80 0x7fabfc151420 secure :-1 s=READY pgs=1905 cs=0 l=1 rev1=1 crypto rx=0x7fabf800b3c0 tx=0x7fabf800b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:53:50.869 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:50.866+0000 7fabf1ffb640 1 -- 172.21.15.150:0/2340388104 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fabf8015030 con 0x7fabfc0b9d80 2024-09-17T05:53:50.869 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:50.866+0000 7fac034f2640 1 -- 172.21.15.150:0/2340388104 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fabfc0cfcf0 con 0x7fabfc0b9d80 2024-09-17T05:53:50.869 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:50.867+0000 7fabf1ffb640 1 -- 172.21.15.150:0/2340388104 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fabf8005920 con 0x7fabfc0b9d80 2024-09-17T05:53:50.869 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:50.867+0000 7fabf1ffb640 1 -- 172.21.15.150:0/2340388104 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fabf8005dd0 con 0x7fabfc0b9d80 2024-09-17T05:53:50.869 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:50.867+0000 7fac034f2640 1 -- 172.21.15.150:0/2340388104 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fabfc151c50 con 0x7fabfc0b9d80 2024-09-17T05:53:50.869 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:50.868+0000 7fac034f2640 1 -- 172.21.15.150:0/2340388104 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fabfc0cfb20 con 0x7fabfc0b9d80 2024-09-17T05:53:50.870 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:50.869+0000 7fabf1ffb640 1 -- 172.21.15.150:0/2340388104 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 48) ==== 104807+0+0 (secure 0 0 0) 0x7fabf8018070 con 0x7fabfc0b9d80 2024-09-17T05:53:50.870 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:50.870+0000 7fabf1ffb640 1 --2- 172.21.15.150:0/2340388104 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fabe007b0e0 0x7fabe007d5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:53:50.870 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:50.870+0000 7fabf1ffb640 1 -- 172.21.15.150:0/2340388104 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(143..143 src has 1..143) ==== 5934+0+0 (secure 0 0 0) 0x7fabf8099a70 con 0x7fabfc0b9d80 2024-09-17T05:53:50.877 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:50.876+0000 7fabf1ffb640 1 -- 172.21.15.150:0/2340388104 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fabf80639a0 con 0x7fabfc0b9d80 2024-09-17T05:53:50.892 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:50.892+0000 7fac00a8d640 1 --2- 172.21.15.150:0/2340388104 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fabe007b0e0 0x7fabe007d5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:53:50.913 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:50.911+0000 7fac00a8d640 1 --2- 172.21.15.150:0/2340388104 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fabe007b0e0 0x7fabe007d5f0 secure :-1 s=READY pgs=807 cs=0 l=1 rev1=1 crypto rx=0x7fabfc0d4480 tx=0x7fabec006ba0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:53:51.196 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:51.196+0000 7fac034f2640 1 -- 172.21.15.150:0/2340388104 --> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] -- mgr_command(tid 0: {"prefix": "fs subvolume snapshot clone", "vol_name": "cephfs", "sub_name": "sv1", "snap_name": "ss1", "target_sub_name": "subvol_clone78074", "target": ["mon-mgr", ""]}) -- 0x7fabfc0b9810 con 0x7fabe007b0e0 2024-09-17T05:53:51.381 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:51.379+0000 7fabf1ffb640 1 -- 172.21.15.150:0/2340388104 <== mon.0 v2:172.21.15.150:3300/0 7 ==== mgrmap(e 49) ==== 104858+0+0 (secure 0 0 0) 0x7fabf805f510 con 0x7fabfc0b9d80 2024-09-17T05:53:51.996 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:51.995+0000 7fabf1ffb640 1 -- 172.21.15.150:0/2340388104 <== mgr.4108 v2:172.21.15.176:6800/3631216395 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7fabfc0b9810 con 0x7fabe007b0e0 2024-09-17T05:53:52.000 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:51.998+0000 7fac034f2640 1 -- 172.21.15.150:0/2340388104 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fabe007b0e0 msgr2=0x7fabe007d5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:53:52.000 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:51.998+0000 7fac034f2640 1 --2- 172.21.15.150:0/2340388104 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fabe007b0e0 0x7fabe007d5f0 secure :-1 s=READY pgs=807 cs=0 l=1 rev1=1 crypto rx=0x7fabfc0d4480 tx=0x7fabec006ba0 comp rx=0 tx=0).stop 2024-09-17T05:53:52.000 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:51.998+0000 7fac034f2640 1 -- 172.21.15.150:0/2340388104 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fabfc0b9d80 msgr2=0x7fabfc151420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:53:52.000 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:51.998+0000 7fac034f2640 1 --2- 172.21.15.150:0/2340388104 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fabfc0b9d80 0x7fabfc151420 secure :-1 s=READY pgs=1905 cs=0 l=1 rev1=1 crypto rx=0x7fabf800b3c0 tx=0x7fabf800b880 comp rx=0 tx=0).stop 2024-09-17T05:53:52.000 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:51.999+0000 7fac034f2640 1 -- 172.21.15.150:0/2340388104 shutdown_connections 2024-09-17T05:53:52.000 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:51.999+0000 7fac034f2640 1 --2- 172.21.15.150:0/2340388104 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fabfc0d07d0 0x7fabfc1f6fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:53:52.000 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:51.999+0000 7fac034f2640 1 --2- 172.21.15.150:0/2340388104 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fabe007b0e0 0x7fabe007d5f0 unknown :-1 s=CLOSED pgs=807 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:53:52.000 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:51.999+0000 7fac034f2640 1 --2- 172.21.15.150:0/2340388104 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fabfc162160 0x7fabfc1f6a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:53:52.000 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:51.999+0000 7fac034f2640 1 --2- 172.21.15.150:0/2340388104 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fabfc0b9d80 0x7fabfc151420 unknown :-1 s=CLOSED pgs=1905 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:53:52.001 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:51.999+0000 7fac034f2640 1 -- 172.21.15.150:0/2340388104 >> 172.21.15.150:0/2340388104 conn(0x7fabfc0d46c0 msgr2=0x7fabfc0b1540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:53:52.001 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:51.999+0000 7fac034f2640 1 -- 172.21.15.150:0/2340388104 shutdown_connections 2024-09-17T05:53:52.001 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:51.999+0000 7fac034f2640 1 -- 172.21.15.150:0/2340388104 wait complete. 2024-09-17T05:53:52.024 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume snapshot clone cephfs sv1 ss1 subvol_clone58715 2024-09-17T05:53:52.204 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:52.203+0000 7f038a7fc640 1 -- 172.21.15.150:0/3147732720 <== mon.2 v2:172.21.15.176:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0374031bf0 con 0x7f038c0cd380 2024-09-17T05:53:52.205 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:52.204+0000 7f039189b640 1 -- 172.21.15.150:0/3147732720 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f038c0cd380 msgr2=0x7f038c15ceb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:53:52.205 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:52.204+0000 7f039189b640 1 --2- 172.21.15.150:0/3147732720 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f038c0cd380 0x7f038c15ceb0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f0374009830 tx=0x7f037402a480 comp rx=0 tx=0).stop 2024-09-17T05:53:52.206 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:52.204+0000 7f039189b640 1 -- 172.21.15.150:0/3147732720 shutdown_connections 2024-09-17T05:53:52.206 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:52.204+0000 7f039189b640 1 --2- 172.21.15.150:0/3147732720 >> v2:172.21.15.176:3300/0 conn(0x7f038c15d3f0 0x7f038c06ddb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:53:52.206 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:52.204+0000 7f039189b640 1 --2- 172.21.15.150:0/3147732720 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f038c0cd380 0x7f038c15ceb0 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:53:52.206 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:52.204+0000 7f039189b640 1 -- 172.21.15.150:0/3147732720 >> 172.21.15.150:0/3147732720 conn(0x7f038c073890 msgr2=0x7f038c073ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:53:52.206 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:52.205+0000 7f039189b640 1 -- 172.21.15.150:0/3147732720 shutdown_connections 2024-09-17T05:53:52.206 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:52.205+0000 7f039189b640 1 -- 172.21.15.150:0/3147732720 wait complete. 2024-09-17T05:53:52.207 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:52.206+0000 7f039189b640 1 Processor -- start 2024-09-17T05:53:52.207 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:52.207+0000 7f039189b640 1 -- start start 2024-09-17T05:53:52.210 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:52.209+0000 7f039189b640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f038c0cd380 0x7f038c0a94b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:53:52.210 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:52.209+0000 7f039189b640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f038c15c820 0x7f038c15a6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:53:52.210 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:52.209+0000 7f039189b640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f038c15d3f0 0x7f038c0ac120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:53:52.210 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:52.209+0000 7f039189b640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f038c0cf8e0 con 0x7f038c15c820 2024-09-17T05:53:52.210 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:52.209+0000 7f039189b640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f038c0cf760 con 0x7f038c15d3f0 2024-09-17T05:53:52.210 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:52.209+0000 7f039189b640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f038c0cfa60 con 0x7f038c0cd380 2024-09-17T05:53:52.210 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:52.209+0000 7f03827fc640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f038c15c820 0x7f038c15a6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:53:52.211 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:52.209+0000 7f03827fc640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f038c15c820 0x7f038c15a6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:50392/0 (socket says 172.21.15.150:50392) 2024-09-17T05:53:52.211 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:52.209+0000 7f03827fc640 1 -- 172.21.15.150:0/4272983850 learned_addr learned my addr 172.21.15.150:0/4272983850 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:53:52.212 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:52.210+0000 7f03827fc640 1 -- 172.21.15.150:0/4272983850 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f038c0cd380 msgr2=0x7f038c0a94b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:53:52.212 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:52.210+0000 7f03827fc640 1 --2- 172.21.15.150:0/4272983850 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f038c0cd380 0x7f038c0a94b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:53:52.212 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:52.210+0000 7f03827fc640 1 -- 172.21.15.150:0/4272983850 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f038c15d3f0 msgr2=0x7f038c0ac120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:53:52.213 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:52.210+0000 7f03827fc640 1 --2- 172.21.15.150:0/4272983850 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f038c15d3f0 0x7f038c0ac120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:53:52.213 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:52.210+0000 7f03827fc640 1 -- 172.21.15.150:0/4272983850 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f038c0a99f0 con 0x7f038c15c820 2024-09-17T05:53:52.213 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:52.210+0000 7f03827fc640 1 --2- 172.21.15.150:0/4272983850 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f038c15c820 0x7f038c15a6b0 secure :-1 s=READY pgs=1906 cs=0 l=1 rev1=1 crypto rx=0x7f0374009950 tx=0x7f0374033ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:53:52.213 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:52.210+0000 7f0388ff9640 1 -- 172.21.15.150:0/4272983850 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0374031b50 con 0x7f038c15c820 2024-09-17T05:53:52.213 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:52.211+0000 7f0388ff9640 1 -- 172.21.15.150:0/4272983850 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0374031de0 con 0x7f038c15c820 2024-09-17T05:53:52.213 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:52.211+0000 7f039189b640 1 -- 172.21.15.150:0/4272983850 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f038c0a9f00 con 0x7f038c15c820 2024-09-17T05:53:52.214 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:52.211+0000 7f0388ff9640 1 -- 172.21.15.150:0/4272983850 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0374033330 con 0x7f038c15c820 2024-09-17T05:53:52.214 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:52.211+0000 7f039189b640 1 -- 172.21.15.150:0/4272983850 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f038c0aa4c0 con 0x7f038c15c820 2024-09-17T05:53:52.214 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:52.213+0000 7f039189b640 1 -- 172.21.15.150:0/4272983850 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f038c0a9c70 con 0x7f038c15c820 2024-09-17T05:53:52.214 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:52.213+0000 7f0388ff9640 1 -- 172.21.15.150:0/4272983850 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 49) ==== 104858+0+0 (secure 0 0 0) 0x7f03740334d0 con 0x7f038c15c820 2024-09-17T05:53:52.215 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:52.214+0000 7f0388ff9640 1 --2- 172.21.15.150:0/4272983850 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f036c07b170 0x7f036c07d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:53:52.215 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:52.214+0000 7f0388ff9640 1 -- 172.21.15.150:0/4272983850 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(143..143 src has 1..143) ==== 5934+0+0 (secure 0 0 0) 0x7f03740bb370 con 0x7f038c15c820 2024-09-17T05:53:52.221 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:52.220+0000 7f0388ff9640 1 -- 172.21.15.150:0/4272983850 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f037403f030 con 0x7f038c15c820 2024-09-17T05:53:52.226 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:52.225+0000 7f038affd640 1 --2- 172.21.15.150:0/4272983850 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f036c07b170 0x7f036c07d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:53:52.244 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:52.243+0000 7f038affd640 1 --2- 172.21.15.150:0/4272983850 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f036c07b170 0x7f036c07d680 secure :-1 s=READY pgs=808 cs=0 l=1 rev1=1 crypto rx=0x7f037c000f60 tx=0x7f037c0079b0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:53:52.560 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:52.559+0000 7f039189b640 1 -- 172.21.15.150:0/4272983850 --> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] -- mgr_command(tid 0: {"prefix": "fs subvolume snapshot clone", "vol_name": "cephfs", "sub_name": "sv1", "snap_name": "ss1", "target_sub_name": "subvol_clone58715", "target": ["mon-mgr", ""]}) -- 0x7f038c0cfee0 con 0x7f036c07b170 2024-09-17T05:53:53.516 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:53.515+0000 7f0388ff9640 1 -- 172.21.15.150:0/4272983850 <== mgr.4108 v2:172.21.15.176:6800/3631216395 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f038c0cfee0 con 0x7f036c07b170 2024-09-17T05:53:53.518 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:53.517+0000 7f039189b640 1 -- 172.21.15.150:0/4272983850 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f036c07b170 msgr2=0x7f036c07d680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:53:53.519 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:53.517+0000 7f039189b640 1 --2- 172.21.15.150:0/4272983850 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f036c07b170 0x7f036c07d680 secure :-1 s=READY pgs=808 cs=0 l=1 rev1=1 crypto rx=0x7f037c000f60 tx=0x7f037c0079b0 comp rx=0 tx=0).stop 2024-09-17T05:53:53.519 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:53.518+0000 7f039189b640 1 -- 172.21.15.150:0/4272983850 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f038c15c820 msgr2=0x7f038c15a6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:53:53.519 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:53.518+0000 7f039189b640 1 --2- 172.21.15.150:0/4272983850 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f038c15c820 0x7f038c15a6b0 secure :-1 s=READY pgs=1906 cs=0 l=1 rev1=1 crypto rx=0x7f0374009950 tx=0x7f0374033ba0 comp rx=0 tx=0).stop 2024-09-17T05:53:53.519 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:53.518+0000 7f039189b640 1 -- 172.21.15.150:0/4272983850 shutdown_connections 2024-09-17T05:53:53.519 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:53.518+0000 7f039189b640 1 --2- 172.21.15.150:0/4272983850 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f038c15d3f0 0x7f038c0ac120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:53:53.519 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:53.518+0000 7f039189b640 1 --2- 172.21.15.150:0/4272983850 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f036c07b170 0x7f036c07d680 unknown :-1 s=CLOSED pgs=808 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:53:53.519 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:53.518+0000 7f039189b640 1 --2- 172.21.15.150:0/4272983850 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f038c15c820 0x7f038c15a6b0 unknown :-1 s=CLOSED pgs=1906 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:53:53.519 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:53.518+0000 7f039189b640 1 --2- 172.21.15.150:0/4272983850 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f038c0cd380 0x7f038c0a94b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:53:53.519 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:53.518+0000 7f039189b640 1 -- 172.21.15.150:0/4272983850 >> 172.21.15.150:0/4272983850 conn(0x7f038c073890 msgr2=0x7f038c0d0530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:53:53.519 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:53.518+0000 7f039189b640 1 -- 172.21.15.150:0/4272983850 shutdown_connections 2024-09-17T05:53:53.519 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:53.518+0000 7f039189b640 1 -- 172.21.15.150:0/4272983850 wait complete. 2024-09-17T05:53:53.533 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume snapshot clone cephfs sv1 ss1 subvol_clone65316 2024-09-17T05:53:53.730 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:53.728+0000 7f954e739640 1 -- 172.21.15.150:0/3518243256 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9530003a00 msgr2=0x7f9530003e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:53:53.731 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:53.728+0000 7f954e739640 1 --2- 172.21.15.150:0/3518243256 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9530003a00 0x7f9530003e50 secure :-1 s=READY pgs=1908 cs=0 l=1 rev1=1 crypto rx=0x7f953800aaf0 tx=0x7f9530005830 comp rx=0 tx=0).stop 2024-09-17T05:53:53.731 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:53.729+0000 7f954e739640 1 -- 172.21.15.150:0/3518243256 shutdown_connections 2024-09-17T05:53:53.731 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:53.729+0000 7f954e739640 1 --2- 172.21.15.150:0/3518243256 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9530003a00 0x7f9530003e50 unknown :-1 s=CLOSED pgs=1908 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:53:53.731 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:53.729+0000 7f954e739640 1 -- 172.21.15.150:0/3518243256 >> 172.21.15.150:0/3518243256 conn(0x7f95480b2ff0 msgr2=0x7f95480b3400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:53:53.731 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:53.729+0000 7f954e739640 1 -- 172.21.15.150:0/3518243256 shutdown_connections 2024-09-17T05:53:53.731 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:53.729+0000 7f954e739640 1 -- 172.21.15.150:0/3518243256 wait complete. 2024-09-17T05:53:53.732 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:53.731+0000 7f954e739640 1 Processor -- start 2024-09-17T05:53:53.732 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:53.731+0000 7f954e739640 1 -- start start 2024-09-17T05:53:53.733 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:53.732+0000 7f954e739640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9530003a00 0x7f9548152b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:53:53.733 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:53.732+0000 7f954e739640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f954815ee50 0x7f954815f3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:53:53.734 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:53.732+0000 7f954e739640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f954815f8e0 0x7f95481f6b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:53:53.734 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:53.732+0000 7f954e739640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f954806d330 con 0x7f954815ee50 2024-09-17T05:53:53.734 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:53.732+0000 7f954e739640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f954806d1b0 con 0x7f9530003a00 2024-09-17T05:53:53.734 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:53.732+0000 7f954e739640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f954806d4b0 con 0x7f954815f8e0 2024-09-17T05:53:53.734 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:53.733+0000 7f95477fe640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f954815ee50 0x7f954815f3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:53:53.734 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:53.733+0000 7f95477fe640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f954815ee50 0x7f954815f3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:50414/0 (socket says 172.21.15.150:50414) 2024-09-17T05:53:53.734 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:53.733+0000 7f95477fe640 1 -- 172.21.15.150:0/4172816070 learned_addr learned my addr 172.21.15.150:0/4172816070 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:53:53.736 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:53.733+0000 7f95477fe640 1 -- 172.21.15.150:0/4172816070 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f954815f8e0 msgr2=0x7f95481f6b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:53:53.736 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:53.733+0000 7f95477fe640 1 --2- 172.21.15.150:0/4172816070 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f954815f8e0 0x7f95481f6b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:53:53.736 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:53.734+0000 7f9547fff640 1 --2- 172.21.15.150:0/4172816070 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9530003a00 0x7f9548152b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:53:53.736 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:53.734+0000 7f95477fe640 1 -- 172.21.15.150:0/4172816070 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9530003a00 msgr2=0x7f9548152b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:53:53.736 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:53.734+0000 7f95477fe640 1 --2- 172.21.15.150:0/4172816070 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9530003a00 0x7f9548152b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:53:53.736 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:53.734+0000 7f95477fe640 1 -- 172.21.15.150:0/4172816070 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f954815fcf0 con 0x7f954815ee50 2024-09-17T05:53:53.736 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:53.734+0000 7f9547fff640 1 --2- 172.21.15.150:0/4172816070 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9530003a00 0x7f9548152b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T05:53:53.736 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:53.734+0000 7f95477fe640 1 --2- 172.21.15.150:0/4172816070 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f954815ee50 0x7f954815f3a0 secure :-1 s=READY pgs=1909 cs=0 l=1 rev1=1 crypto rx=0x7f953c00c3c0 tx=0x7f953c00c7c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:53:53.736 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:53.734+0000 7f9544ff9640 1 -- 172.21.15.150:0/4172816070 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f953c011790 con 0x7f954815ee50 2024-09-17T05:53:53.736 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:53.734+0000 7f9544ff9640 1 -- 172.21.15.150:0/4172816070 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f953c017070 con 0x7f954815ee50 2024-09-17T05:53:53.736 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:53.734+0000 7f9544ff9640 1 -- 172.21.15.150:0/4172816070 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f953c011cc0 con 0x7f954815ee50 2024-09-17T05:53:53.737 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:53.734+0000 7f954e739640 1 -- 172.21.15.150:0/4172816070 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f954815e1f0 con 0x7f954815ee50 2024-09-17T05:53:53.737 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:53.735+0000 7f954e739640 1 -- 172.21.15.150:0/4172816070 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f954815e7b0 con 0x7f954815ee50 2024-09-17T05:53:53.737 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:53.736+0000 7f954e739640 1 -- 172.21.15.150:0/4172816070 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9548076300 con 0x7f954815ee50 2024-09-17T05:53:53.737 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:53.737+0000 7f9544ff9640 1 -- 172.21.15.150:0/4172816070 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 49) ==== 104858+0+0 (secure 0 0 0) 0x7f953c01c460 con 0x7f954815ee50 2024-09-17T05:53:53.739 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:53.737+0000 7f9544ff9640 1 --2- 172.21.15.150:0/4172816070 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f953407b140 0x7f953407d650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:53:53.739 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:53.737+0000 7f9544ff9640 1 -- 172.21.15.150:0/4172816070 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(143..143 src has 1..143) ==== 5934+0+0 (secure 0 0 0) 0x7f953c09a9e0 con 0x7f954815ee50 2024-09-17T05:53:53.741 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:53.740+0000 7f9547fff640 1 --2- 172.21.15.150:0/4172816070 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f953407b140 0x7f953407d650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:53:53.743 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:53.742+0000 7f9547fff640 1 --2- 172.21.15.150:0/4172816070 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f953407b140 0x7f953407d650 secure :-1 s=READY pgs=809 cs=0 l=1 rev1=1 crypto rx=0x7f9538034000 tx=0x7f9538033040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:53:53.744 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:53.744+0000 7f9544ff9640 1 -- 172.21.15.150:0/4172816070 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f9548076300 con 0x7f954815ee50 2024-09-17T05:53:54.081 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:54.079+0000 7f954e739640 1 -- 172.21.15.150:0/4172816070 --> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] -- mgr_command(tid 0: {"prefix": "fs subvolume snapshot clone", "vol_name": "cephfs", "sub_name": "sv1", "snap_name": "ss1", "target_sub_name": "subvol_clone65316", "target": ["mon-mgr", ""]}) -- 0x7f95480b0960 con 0x7f953407b140 2024-09-17T05:53:55.046 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:55.045+0000 7f9544ff9640 1 -- 172.21.15.150:0/4172816070 <== mgr.4108 v2:172.21.15.176:6800/3631216395 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f95480b0960 con 0x7f953407b140 2024-09-17T05:53:55.051 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:55.050+0000 7f954e739640 1 -- 172.21.15.150:0/4172816070 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f953407b140 msgr2=0x7f953407d650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:53:55.051 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:55.050+0000 7f954e739640 1 --2- 172.21.15.150:0/4172816070 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f953407b140 0x7f953407d650 secure :-1 s=READY pgs=809 cs=0 l=1 rev1=1 crypto rx=0x7f9538034000 tx=0x7f9538033040 comp rx=0 tx=0).stop 2024-09-17T05:53:55.051 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:55.050+0000 7f954e739640 1 -- 172.21.15.150:0/4172816070 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f954815ee50 msgr2=0x7f954815f3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:53:55.051 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:55.050+0000 7f954e739640 1 --2- 172.21.15.150:0/4172816070 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f954815ee50 0x7f954815f3a0 secure :-1 s=READY pgs=1909 cs=0 l=1 rev1=1 crypto rx=0x7f953c00c3c0 tx=0x7f953c00c7c0 comp rx=0 tx=0).stop 2024-09-17T05:53:55.051 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:55.050+0000 7f954e739640 1 -- 172.21.15.150:0/4172816070 shutdown_connections 2024-09-17T05:53:55.051 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:55.050+0000 7f954e739640 1 --2- 172.21.15.150:0/4172816070 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f953407b140 0x7f953407d650 unknown :-1 s=CLOSED pgs=809 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:53:55.052 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:55.050+0000 7f954e739640 1 --2- 172.21.15.150:0/4172816070 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f954815f8e0 0x7f95481f6b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:53:55.052 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:55.050+0000 7f954e739640 1 --2- 172.21.15.150:0/4172816070 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f954815ee50 0x7f954815f3a0 unknown :-1 s=CLOSED pgs=1909 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:53:55.052 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:55.050+0000 7f954e739640 1 --2- 172.21.15.150:0/4172816070 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9530003a00 0x7f9548152b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:53:55.052 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:55.050+0000 7f954e739640 1 -- 172.21.15.150:0/4172816070 >> 172.21.15.150:0/4172816070 conn(0x7f95480b2ff0 msgr2=0x7f95480717f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:53:55.052 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:55.050+0000 7f954e739640 1 -- 172.21.15.150:0/4172816070 shutdown_connections 2024-09-17T05:53:55.052 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:55.050+0000 7f954e739640 1 -- 172.21.15.150:0/4172816070 wait complete. 2024-09-17T05:53:56.068 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs clone cancel cephfs subvol_clone38300 2024-09-17T05:53:56.251 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:56.250+0000 7ff9939f1640 1 -- 172.21.15.150:0/3780288493 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff98c0d5150 msgr2=0x7ff98c0b9b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:53:56.251 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:56.250+0000 7ff9939f1640 1 --2- 172.21.15.150:0/3780288493 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff98c0d5150 0x7ff98c0b9b10 secure :-1 s=READY pgs=1910 cs=0 l=1 rev1=1 crypto rx=0x7ff98c0d10f0 tx=0x7ff98802a980 comp rx=0 tx=0).stop 2024-09-17T05:53:56.252 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:56.250+0000 7ff9939f1640 1 -- 172.21.15.150:0/3780288493 shutdown_connections 2024-09-17T05:53:56.252 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:56.250+0000 7ff9939f1640 1 --2- 172.21.15.150:0/3780288493 >> v2:172.21.15.176:3300/0 conn(0x7ff98c0d0730 0x7ff98c0b6160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:53:56.252 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:56.250+0000 7ff9939f1640 1 --2- 172.21.15.150:0/3780288493 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff98c0d5150 0x7ff98c0b9b10 unknown :-1 s=CLOSED pgs=1910 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:53:56.252 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:56.250+0000 7ff9939f1640 1 -- 172.21.15.150:0/3780288493 >> 172.21.15.150:0/3780288493 conn(0x7ff98c08bfe0 msgr2=0x7ff98c0d46e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:53:56.252 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:56.250+0000 7ff9939f1640 1 -- 172.21.15.150:0/3780288493 shutdown_connections 2024-09-17T05:53:56.252 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:56.250+0000 7ff9939f1640 1 -- 172.21.15.150:0/3780288493 wait complete. 2024-09-17T05:53:56.252 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:56.252+0000 7ff9939f1640 1 Processor -- start 2024-09-17T05:53:56.253 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:56.252+0000 7ff9939f1640 1 -- start start 2024-09-17T05:53:56.255 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:56.254+0000 7ff9939f1640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff98c06dea0 0x7ff98c14faa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:53:56.255 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:56.254+0000 7ff9939f1640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff98c0d0730 0x7ff98c1f5df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:53:56.255 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:56.254+0000 7ff9939f1640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff98c0d5150 0x7ff98c15b220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:53:56.256 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:56.254+0000 7ff9939f1640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7ff98c06e2b0 con 0x7ff98c06dea0 2024-09-17T05:53:56.256 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:56.254+0000 7ff9939f1640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7ff98c0d31e0 con 0x7ff98c0d0730 2024-09-17T05:53:56.256 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:56.254+0000 7ff9939f1640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7ff98c06e430 con 0x7ff98c0d5150 2024-09-17T05:53:56.256 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:56.254+0000 7ff99178d640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff98c06dea0 0x7ff98c14faa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:53:56.256 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:56.254+0000 7ff99178d640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff98c06dea0 0x7ff98c14faa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:50426/0 (socket says 172.21.15.150:50426) 2024-09-17T05:53:56.256 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:56.254+0000 7ff99178d640 1 -- 172.21.15.150:0/3599564303 learned_addr learned my addr 172.21.15.150:0/3599564303 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:53:56.256 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:56.254+0000 7ff99178d640 1 -- 172.21.15.150:0/3599564303 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff98c0d5150 msgr2=0x7ff98c15b220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:53:56.256 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:56.254+0000 7ff99178d640 1 --2- 172.21.15.150:0/3599564303 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff98c0d5150 0x7ff98c15b220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:53:56.256 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:56.254+0000 7ff99178d640 1 -- 172.21.15.150:0/3599564303 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff98c0d0730 msgr2=0x7ff98c1f5df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:53:56.256 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:56.254+0000 7ff99178d640 1 --2- 172.21.15.150:0/3599564303 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff98c0d0730 0x7ff98c1f5df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:53:56.256 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:56.254+0000 7ff99178d640 1 -- 172.21.15.150:0/3599564303 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff98c15a180 con 0x7ff98c06dea0 2024-09-17T05:53:56.257 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:56.254+0000 7ff99178d640 1 --2- 172.21.15.150:0/3599564303 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff98c06dea0 0x7ff98c14faa0 secure :-1 s=READY pgs=1911 cs=0 l=1 rev1=1 crypto rx=0x7ff988000f80 tx=0x7ff988003f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:53:56.257 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:56.255+0000 7ff981ffb640 1 -- 172.21.15.150:0/3599564303 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff988034040 con 0x7ff98c06dea0 2024-09-17T05:53:56.257 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:56.255+0000 7ff981ffb640 1 -- 172.21.15.150:0/3599564303 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff988004e30 con 0x7ff98c06dea0 2024-09-17T05:53:56.257 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:56.255+0000 7ff9939f1640 1 -- 172.21.15.150:0/3599564303 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff98c15a460 con 0x7ff98c06dea0 2024-09-17T05:53:56.257 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:56.255+0000 7ff981ffb640 1 -- 172.21.15.150:0/3599564303 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9880045b0 con 0x7ff98c06dea0 2024-09-17T05:53:56.257 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:56.255+0000 7ff9939f1640 1 -- 172.21.15.150:0/3599564303 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff98c15aa20 con 0x7ff98c06dea0 2024-09-17T05:53:56.258 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:56.256+0000 7ff9939f1640 1 -- 172.21.15.150:0/3599564303 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff98c0b67f0 con 0x7ff98c06dea0 2024-09-17T05:53:56.258 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:56.257+0000 7ff981ffb640 1 -- 172.21.15.150:0/3599564303 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 49) ==== 104858+0+0 (secure 0 0 0) 0x7ff988037020 con 0x7ff98c06dea0 2024-09-17T05:53:56.258 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:56.258+0000 7ff981ffb640 1 --2- 172.21.15.150:0/3599564303 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7ff97007b140 0x7ff97007d650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:53:56.258 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:56.258+0000 7ff981ffb640 1 -- 172.21.15.150:0/3599564303 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(143..143 src has 1..143) ==== 5934+0+0 (secure 0 0 0) 0x7ff9880bb670 con 0x7ff98c06dea0 2024-09-17T05:53:56.266 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:56.265+0000 7ff981ffb640 1 -- 172.21.15.150:0/3599564303 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7ff9880855c0 con 0x7ff98c06dea0 2024-09-17T05:53:56.314 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:56.313+0000 7ff990f8c640 1 --2- 172.21.15.150:0/3599564303 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7ff97007b140 0x7ff97007d650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:53:56.318 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:56.317+0000 7ff990f8c640 1 --2- 172.21.15.150:0/3599564303 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7ff97007b140 0x7ff97007d650 secure :-1 s=READY pgs=810 cs=0 l=1 rev1=1 crypto rx=0x7ff98c0cb4a0 tx=0x7ff97c006ba0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:53:56.572 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:56.572+0000 7ff9939f1640 1 -- 172.21.15.150:0/3599564303 --> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] -- mgr_command(tid 0: {"prefix": "fs clone cancel", "vol_name": "cephfs", "clone_name": "subvol_clone38300", "target": ["mon-mgr", ""]}) -- 0x7ff98c0b7d00 con 0x7ff97007b140 2024-09-17T05:53:56.681 INFO:tasks.ceph.mgr.x.smithi176.stderr:2024-09-17T05:53:56.679+0000 7f33d771a640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-17T05:53:56.681 INFO:tasks.ceph.mgr.x.smithi176.stderr:2024-09-17T05:53:56.679+0000 7f33d771a640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-17T05:53:56.681 INFO:tasks.ceph.mgr.x.smithi176.stderr:2024-09-17T05:53:56.679+0000 7f33d771a640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-17T05:53:56.681 INFO:tasks.ceph.mgr.x.smithi176.stderr:2024-09-17T05:53:56.679+0000 7f33d771a640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-17T05:53:56.684 INFO:tasks.ceph.mgr.x.smithi176.stderr:2024-09-17T05:53:56.682+0000 7f33d771a640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-17T05:53:57.343 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-17T05:53:57.346 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-17T05:53:57.738 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:57.737+0000 7ff981ffb640 1 -- 172.21.15.150:0/3599564303 <== mon.0 v2:172.21.15.150:3300/0 7 ==== mgrmap(e 50) ==== 104909+0+0 (secure 0 0 0) 0x7ff98800c040 con 0x7ff98c06dea0 2024-09-17T05:53:57.851 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:57.851+0000 7ff981ffb640 1 -- 172.21.15.150:0/3599564303 <== mgr.4108 v2:172.21.15.176:6800/3631216395 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7ff98c0b7d00 con 0x7ff97007b140 2024-09-17T05:53:57.854 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:57.853+0000 7ff9939f1640 1 -- 172.21.15.150:0/3599564303 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7ff97007b140 msgr2=0x7ff97007d650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:53:57.854 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:57.853+0000 7ff9939f1640 1 --2- 172.21.15.150:0/3599564303 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7ff97007b140 0x7ff97007d650 secure :-1 s=READY pgs=810 cs=0 l=1 rev1=1 crypto rx=0x7ff98c0cb4a0 tx=0x7ff97c006ba0 comp rx=0 tx=0).stop 2024-09-17T05:53:57.854 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:57.853+0000 7ff9939f1640 1 -- 172.21.15.150:0/3599564303 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff98c06dea0 msgr2=0x7ff98c14faa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:53:57.855 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:57.853+0000 7ff9939f1640 1 --2- 172.21.15.150:0/3599564303 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff98c06dea0 0x7ff98c14faa0 secure :-1 s=READY pgs=1911 cs=0 l=1 rev1=1 crypto rx=0x7ff988000f80 tx=0x7ff988003f90 comp rx=0 tx=0).stop 2024-09-17T05:53:57.855 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:57.853+0000 7ff9939f1640 1 -- 172.21.15.150:0/3599564303 shutdown_connections 2024-09-17T05:53:57.855 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:57.853+0000 7ff9939f1640 1 --2- 172.21.15.150:0/3599564303 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff98c0d0730 0x7ff98c1f5df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:53:57.855 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:57.853+0000 7ff9939f1640 1 --2- 172.21.15.150:0/3599564303 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7ff97007b140 0x7ff97007d650 unknown :-1 s=CLOSED pgs=810 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:53:57.855 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:57.853+0000 7ff9939f1640 1 --2- 172.21.15.150:0/3599564303 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff98c0d5150 0x7ff98c15b220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:53:57.855 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:57.853+0000 7ff9939f1640 1 --2- 172.21.15.150:0/3599564303 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff98c06dea0 0x7ff98c14faa0 unknown :-1 s=CLOSED pgs=1911 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:53:57.855 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:57.853+0000 7ff9939f1640 1 -- 172.21.15.150:0/3599564303 >> 172.21.15.150:0/3599564303 conn(0x7ff98c08bfe0 msgr2=0x7ff98c068e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:53:57.855 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:57.854+0000 7ff9939f1640 1 -- 172.21.15.150:0/3599564303 shutdown_connections 2024-09-17T05:53:57.855 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:57.854+0000 7ff9939f1640 1 -- 172.21.15.150:0/3599564303 wait complete. 2024-09-17T05:53:57.870 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs clone cancel cephfs subvol_clone67871 2024-09-17T05:53:58.024 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:58.023+0000 7f9abaffd640 1 -- 172.21.15.150:0/3597821082 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9aac031bf0 con 0x7f9abc0b6300 2024-09-17T05:53:58.025 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:58.024+0000 7f9ac250b640 1 -- 172.21.15.150:0/3597821082 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9abc0b6300 msgr2=0x7f9abc0b6710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:53:58.025 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:58.024+0000 7f9ac250b640 1 --2- 172.21.15.150:0/3597821082 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9abc0b6300 0x7f9abc0b6710 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7f9aac009830 tx=0x7f9aac02a510 comp rx=0 tx=0).stop 2024-09-17T05:53:58.025 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:58.024+0000 7f9ac250b640 1 -- 172.21.15.150:0/3597821082 shutdown_connections 2024-09-17T05:53:58.025 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:58.024+0000 7f9ac250b640 1 --2- 172.21.15.150:0/3597821082 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9abc0cbcc0 0x7f9abc0cc0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:53:58.025 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:58.024+0000 7f9ac250b640 1 --2- 172.21.15.150:0/3597821082 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9abc0b6300 0x7f9abc0b6710 unknown :-1 s=CLOSED pgs=647 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:53:58.025 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:58.024+0000 7f9ac250b640 1 -- 172.21.15.150:0/3597821082 >> 172.21.15.150:0/3597821082 conn(0x7f9abc0b2ff0 msgr2=0x7f9abc0b3400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:53:58.026 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:58.024+0000 7f9ac250b640 1 -- 172.21.15.150:0/3597821082 shutdown_connections 2024-09-17T05:53:58.026 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:58.024+0000 7f9ac250b640 1 -- 172.21.15.150:0/3597821082 wait complete. 2024-09-17T05:53:58.027 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:58.026+0000 7f9ac250b640 1 Processor -- start 2024-09-17T05:53:58.028 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:58.027+0000 7f9ac250b640 1 -- start start 2024-09-17T05:53:58.031 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:58.029+0000 7f9ac250b640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9abc0b6300 0x7f9abc1f14c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:53:58.031 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:58.029+0000 7f9ac250b640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9abc0cbcc0 0x7f9abc15d4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:53:58.031 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:58.029+0000 7f9ac250b640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9abc0cc610 0x7f9abc09e600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:53:58.031 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:58.029+0000 7f9ac250b640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f9abc0ce460 con 0x7f9abc0cbcc0 2024-09-17T05:53:58.031 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:58.029+0000 7f9ac250b640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f9abc0ce2e0 con 0x7f9abc0b6300 2024-09-17T05:53:58.031 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:58.029+0000 7f9ac250b640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f9abc0ce5e0 con 0x7f9abc0cc610 2024-09-17T05:53:58.031 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:58.029+0000 7f9abb7fe640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9abc0cbcc0 0x7f9abc15d4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:53:58.031 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:58.029+0000 7f9abb7fe640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9abc0cbcc0 0x7f9abc15d4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:50434/0 (socket says 172.21.15.150:50434) 2024-09-17T05:53:58.031 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:58.029+0000 7f9abb7fe640 1 -- 172.21.15.150:0/2906581362 learned_addr learned my addr 172.21.15.150:0/2906581362 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:53:58.031 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:58.030+0000 7f9abb7fe640 1 -- 172.21.15.150:0/2906581362 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9abc0cc610 msgr2=0x7f9abc09e600 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-17T05:53:58.031 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:58.030+0000 7f9abb7fe640 1 --2- 172.21.15.150:0/2906581362 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9abc0cc610 0x7f9abc09e600 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:53:58.032 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:58.030+0000 7f9abb7fe640 1 -- 172.21.15.150:0/2906581362 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9abc0b6300 msgr2=0x7f9abc1f14c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:53:58.032 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:58.030+0000 7f9abb7fe640 1 --2- 172.21.15.150:0/2906581362 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9abc0b6300 0x7f9abc1f14c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:53:58.032 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:58.030+0000 7f9abb7fe640 1 -- 172.21.15.150:0/2906581362 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9abc09c560 con 0x7f9abc0cbcc0 2024-09-17T05:53:58.032 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:58.030+0000 7f9abb7fe640 1 --2- 172.21.15.150:0/2906581362 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9abc0cbcc0 0x7f9abc15d4a0 secure :-1 s=READY pgs=1912 cs=0 l=1 rev1=1 crypto rx=0x7f9ab000d6d0 tx=0x7f9ab000db90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:53:58.032 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:58.030+0000 7f9ab8ff9640 1 -- 172.21.15.150:0/2906581362 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ab0017070 con 0x7f9abc0cbcc0 2024-09-17T05:53:58.032 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:58.030+0000 7f9ab8ff9640 1 -- 172.21.15.150:0/2906581362 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9ab0004310 con 0x7f9abc0cbcc0 2024-09-17T05:53:58.032 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:58.030+0000 7f9ab8ff9640 1 -- 172.21.15.150:0/2906581362 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ab0009a80 con 0x7f9abc0cbcc0 2024-09-17T05:53:58.032 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:58.030+0000 7f9ac250b640 1 -- 172.21.15.150:0/2906581362 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9abc0c4d10 con 0x7f9abc0cbcc0 2024-09-17T05:53:58.033 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:58.030+0000 7f9ac250b640 1 -- 172.21.15.150:0/2906581362 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9abc1f1ff0 con 0x7f9abc0cbcc0 2024-09-17T05:53:58.033 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:58.032+0000 7f9ac250b640 1 -- 172.21.15.150:0/2906581362 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9abc0cea90 con 0x7f9abc0cbcc0 2024-09-17T05:53:58.033 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:58.032+0000 7f9ab8ff9640 1 -- 172.21.15.150:0/2906581362 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 50) ==== 104909+0+0 (secure 0 0 0) 0x7f9ab00035f0 con 0x7f9abc0cbcc0 2024-09-17T05:53:58.034 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:58.033+0000 7f9ab8ff9640 1 --2- 172.21.15.150:0/2906581362 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f9aa807b1d0 0x7f9aa807d6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:53:58.034 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:58.033+0000 7f9ab8ff9640 1 -- 172.21.15.150:0/2906581362 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(143..143 src has 1..143) ==== 5934+0+0 (secure 0 0 0) 0x7f9ab009a200 con 0x7f9abc0cbcc0 2024-09-17T05:53:58.043 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:58.042+0000 7f9ab8ff9640 1 -- 172.21.15.150:0/2906581362 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f9ab00641d0 con 0x7f9abc0cbcc0 2024-09-17T05:53:58.068 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:58.067+0000 7f9abbfff640 1 --2- 172.21.15.150:0/2906581362 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f9aa807b1d0 0x7f9aa807d6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:53:58.100 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:58.099+0000 7f9abbfff640 1 --2- 172.21.15.150:0/2906581362 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f9aa807b1d0 0x7f9aa807d6e0 secure :-1 s=READY pgs=811 cs=0 l=1 rev1=1 crypto rx=0x7f9aac034000 tx=0x7f9aac0046c0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:53:58.338 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:58.337+0000 7f9ac250b640 1 -- 172.21.15.150:0/2906581362 --> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] -- mgr_command(tid 0: {"prefix": "fs clone cancel", "vol_name": "cephfs", "clone_name": "subvol_clone67871", "target": ["mon-mgr", ""]}) -- 0x7f9abc1f1aa0 con 0x7f9aa807b1d0 2024-09-17T05:53:59.671 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:59.670+0000 7f9ab8ff9640 1 -- 172.21.15.150:0/2906581362 <== mgr.4108 v2:172.21.15.176:6800/3631216395 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f9abc1f1aa0 con 0x7f9aa807b1d0 2024-09-17T05:53:59.675 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:59.673+0000 7f9ac250b640 1 -- 172.21.15.150:0/2906581362 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f9aa807b1d0 msgr2=0x7f9aa807d6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:53:59.675 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:59.673+0000 7f9ac250b640 1 --2- 172.21.15.150:0/2906581362 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f9aa807b1d0 0x7f9aa807d6e0 secure :-1 s=READY pgs=811 cs=0 l=1 rev1=1 crypto rx=0x7f9aac034000 tx=0x7f9aac0046c0 comp rx=0 tx=0).stop 2024-09-17T05:53:59.675 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:59.673+0000 7f9ac250b640 1 -- 172.21.15.150:0/2906581362 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9abc0cbcc0 msgr2=0x7f9abc15d4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:53:59.675 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:59.673+0000 7f9ac250b640 1 --2- 172.21.15.150:0/2906581362 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9abc0cbcc0 0x7f9abc15d4a0 secure :-1 s=READY pgs=1912 cs=0 l=1 rev1=1 crypto rx=0x7f9ab000d6d0 tx=0x7f9ab000db90 comp rx=0 tx=0).stop 2024-09-17T05:53:59.675 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:59.673+0000 7f9ac250b640 1 -- 172.21.15.150:0/2906581362 shutdown_connections 2024-09-17T05:53:59.675 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:59.673+0000 7f9ac250b640 1 --2- 172.21.15.150:0/2906581362 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f9aa807b1d0 0x7f9aa807d6e0 unknown :-1 s=CLOSED pgs=811 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:53:59.675 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:59.673+0000 7f9ac250b640 1 --2- 172.21.15.150:0/2906581362 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9abc0cc610 0x7f9abc09e600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:53:59.676 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:59.673+0000 7f9ac250b640 1 --2- 172.21.15.150:0/2906581362 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9abc0cbcc0 0x7f9abc15d4a0 unknown :-1 s=CLOSED pgs=1912 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:53:59.676 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:59.673+0000 7f9ac250b640 1 --2- 172.21.15.150:0/2906581362 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9abc0b6300 0x7f9abc1f14c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:53:59.676 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:59.673+0000 7f9ac250b640 1 -- 172.21.15.150:0/2906581362 >> 172.21.15.150:0/2906581362 conn(0x7f9abc0b2ff0 msgr2=0x7f9abc0cdbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:53:59.676 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:59.674+0000 7f9ac250b640 1 -- 172.21.15.150:0/2906581362 shutdown_connections 2024-09-17T05:53:59.676 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:59.674+0000 7f9ac250b640 1 -- 172.21.15.150:0/2906581362 wait complete. 2024-09-17T05:53:59.692 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs clone cancel cephfs subvol_clone02 2024-09-17T05:53:59.897 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:59.896+0000 7fa50b590640 1 -- 172.21.15.150:0/4081461035 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa5040d5150 msgr2=0x7fa5040b9b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:53:59.898 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:59.896+0000 7fa50b590640 1 --2- 172.21.15.150:0/4081461035 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa5040d5150 0x7fa5040b9b10 secure :-1 s=READY pgs=1914 cs=0 l=1 rev1=1 crypto rx=0x7fa5040cfd10 tx=0x7fa50002a4f0 comp rx=0 tx=0).stop 2024-09-17T05:53:59.898 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:59.896+0000 7fa50b590640 1 -- 172.21.15.150:0/4081461035 shutdown_connections 2024-09-17T05:53:59.898 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:59.896+0000 7fa50b590640 1 --2- 172.21.15.150:0/4081461035 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa50406dea0 0x7fa5040d0020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:53:59.898 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:59.896+0000 7fa50b590640 1 --2- 172.21.15.150:0/4081461035 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa5040d5150 0x7fa5040b9b10 unknown :-1 s=CLOSED pgs=1914 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:53:59.898 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:59.896+0000 7fa50b590640 1 -- 172.21.15.150:0/4081461035 >> 172.21.15.150:0/4081461035 conn(0x7fa50408bfe0 msgr2=0x7fa5040d46e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:53:59.898 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:59.897+0000 7fa50b590640 1 -- 172.21.15.150:0/4081461035 shutdown_connections 2024-09-17T05:53:59.898 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:59.897+0000 7fa50b590640 1 -- 172.21.15.150:0/4081461035 wait complete. 2024-09-17T05:53:59.900 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:59.899+0000 7fa50b590640 1 Processor -- start 2024-09-17T05:53:59.900 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:59.899+0000 7fa50b590640 1 -- start start 2024-09-17T05:53:59.902 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:59.900+0000 7fa50b590640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa50406dea0 0x7fa5041f8f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:53:59.902 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:59.900+0000 7fa50b590640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa50406e2b0 0x7fa5041f6390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:53:59.903 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:59.900+0000 7fa50b590640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa5040d5150 0x7fa5040cadd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:53:59.903 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:59.901+0000 7fa50b590640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7fa5040b6870 con 0x7fa5040d5150 2024-09-17T05:53:59.903 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:59.901+0000 7fa50b590640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fa5040d31e0 con 0x7fa50406dea0 2024-09-17T05:53:59.903 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:59.901+0000 7fa50b590640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fa5040b69f0 con 0x7fa50406e2b0 2024-09-17T05:53:59.903 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:59.901+0000 7fa509b2d640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa5040d5150 0x7fa5040cadd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:53:59.903 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:59.901+0000 7fa509b2d640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa5040d5150 0x7fa5040cadd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:50456/0 (socket says 172.21.15.150:50456) 2024-09-17T05:53:59.903 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:59.901+0000 7fa509b2d640 1 -- 172.21.15.150:0/3487644872 learned_addr learned my addr 172.21.15.150:0/3487644872 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:53:59.903 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:59.901+0000 7fa508b2b640 1 --2- 172.21.15.150:0/3487644872 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa50406e2b0 0x7fa5041f6390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:53:59.903 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:59.901+0000 7fa509b2d640 1 -- 172.21.15.150:0/3487644872 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa50406e2b0 msgr2=0x7fa5041f6390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:53:59.903 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:59.901+0000 7fa509b2d640 1 --2- 172.21.15.150:0/3487644872 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa50406e2b0 0x7fa5041f6390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:53:59.904 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:59.901+0000 7fa509b2d640 1 -- 172.21.15.150:0/3487644872 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa50406dea0 msgr2=0x7fa5041f8f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:53:59.904 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:59.901+0000 7fa509b2d640 1 --2- 172.21.15.150:0/3487644872 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa50406dea0 0x7fa5041f8f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:53:59.904 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:59.901+0000 7fa509b2d640 1 -- 172.21.15.150:0/3487644872 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa5041f98e0 con 0x7fa5040d5150 2024-09-17T05:53:59.904 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:59.901+0000 7fa509b2d640 1 --2- 172.21.15.150:0/3487644872 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa5040d5150 0x7fa5040cadd0 secure :-1 s=READY pgs=1915 cs=0 l=1 rev1=1 crypto rx=0x7fa4fc00cb10 tx=0x7fa4fc00a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:53:59.904 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:59.902+0000 7fa4f9ffb640 1 -- 172.21.15.150:0/3487644872 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4fc016020 con 0x7fa5040d5150 2024-09-17T05:53:59.904 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:59.902+0000 7fa4f9ffb640 1 -- 172.21.15.150:0/3487644872 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa4fc00ad60 con 0x7fa5040d5150 2024-09-17T05:53:59.904 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:59.902+0000 7fa50b590640 1 -- 172.21.15.150:0/3487644872 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa5041f9bc0 con 0x7fa5040d5150 2024-09-17T05:53:59.904 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:59.902+0000 7fa4f9ffb640 1 -- 172.21.15.150:0/3487644872 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4fc012680 con 0x7fa5040d5150 2024-09-17T05:53:59.904 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:59.902+0000 7fa50b590640 1 -- 172.21.15.150:0/3487644872 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa504155c90 con 0x7fa5040d5150 2024-09-17T05:53:59.905 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:59.904+0000 7fa50b590640 1 -- 172.21.15.150:0/3487644872 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa5041f9650 con 0x7fa5040d5150 2024-09-17T05:53:59.905 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:59.904+0000 7fa4f9ffb640 1 -- 172.21.15.150:0/3487644872 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 50) ==== 104909+0+0 (secure 0 0 0) 0x7fa4fc019020 con 0x7fa5040d5150 2024-09-17T05:53:59.905 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:59.905+0000 7fa4f9ffb640 1 --2- 172.21.15.150:0/3487644872 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fa4e807b1d0 0x7fa4e807d6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:53:59.906 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:59.905+0000 7fa4f9ffb640 1 -- 172.21.15.150:0/3487644872 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(143..143 src has 1..143) ==== 5934+0+0 (secure 0 0 0) 0x7fa4fc09a280 con 0x7fa5040d5150 2024-09-17T05:53:59.915 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:59.915+0000 7fa4f9ffb640 1 -- 172.21.15.150:0/3487644872 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fa4fc020030 con 0x7fa5040d5150 2024-09-17T05:53:59.938 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:59.937+0000 7fa50932c640 1 --2- 172.21.15.150:0/3487644872 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fa4e807b1d0 0x7fa4e807d6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:53:59.955 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:53:59.954+0000 7fa50932c640 1 --2- 172.21.15.150:0/3487644872 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fa4e807b1d0 0x7fa4e807d6e0 secure :-1 s=READY pgs=812 cs=0 l=1 rev1=1 crypto rx=0x7fa500034000 tx=0x7fa5000046c0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:54:00.229 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:00.228+0000 7fa50b590640 1 -- 172.21.15.150:0/3487644872 --> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] -- mgr_command(tid 0: {"prefix": "fs clone cancel", "vol_name": "cephfs", "clone_name": "subvol_clone02", "target": ["mon-mgr", ""]}) -- 0x7fa5041f68d0 con 0x7fa4e807b1d0 2024-09-17T05:54:01.457 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:01.456+0000 7fa4f9ffb640 1 -- 172.21.15.150:0/3487644872 <== mgr.4108 v2:172.21.15.176:6800/3631216395 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7fa5041f68d0 con 0x7fa4e807b1d0 2024-09-17T05:54:01.461 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:01.460+0000 7fa50b590640 1 -- 172.21.15.150:0/3487644872 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fa4e807b1d0 msgr2=0x7fa4e807d6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:54:01.461 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:01.460+0000 7fa50b590640 1 --2- 172.21.15.150:0/3487644872 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fa4e807b1d0 0x7fa4e807d6e0 secure :-1 s=READY pgs=812 cs=0 l=1 rev1=1 crypto rx=0x7fa500034000 tx=0x7fa5000046c0 comp rx=0 tx=0).stop 2024-09-17T05:54:01.461 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:01.460+0000 7fa50b590640 1 -- 172.21.15.150:0/3487644872 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa5040d5150 msgr2=0x7fa5040cadd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:54:01.461 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:01.460+0000 7fa50b590640 1 --2- 172.21.15.150:0/3487644872 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa5040d5150 0x7fa5040cadd0 secure :-1 s=READY pgs=1915 cs=0 l=1 rev1=1 crypto rx=0x7fa4fc00cb10 tx=0x7fa4fc00a060 comp rx=0 tx=0).stop 2024-09-17T05:54:01.461 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:01.460+0000 7fa50b590640 1 -- 172.21.15.150:0/3487644872 shutdown_connections 2024-09-17T05:54:01.461 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:01.460+0000 7fa50b590640 1 --2- 172.21.15.150:0/3487644872 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fa4e807b1d0 0x7fa4e807d6e0 unknown :-1 s=CLOSED pgs=812 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:54:01.461 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:01.460+0000 7fa50b590640 1 --2- 172.21.15.150:0/3487644872 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa5040d5150 0x7fa5040cadd0 unknown :-1 s=CLOSED pgs=1915 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:54:01.461 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:01.460+0000 7fa50b590640 1 --2- 172.21.15.150:0/3487644872 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa50406e2b0 0x7fa5041f6390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:54:01.461 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:01.460+0000 7fa50b590640 1 --2- 172.21.15.150:0/3487644872 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa50406dea0 0x7fa5041f8f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:54:01.461 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:01.460+0000 7fa50b590640 1 -- 172.21.15.150:0/3487644872 >> 172.21.15.150:0/3487644872 conn(0x7fa50408bfe0 msgr2=0x7fa5040b12a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:54:01.461 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:01.460+0000 7fa50b590640 1 -- 172.21.15.150:0/3487644872 shutdown_connections 2024-09-17T05:54:01.461 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:01.460+0000 7fa50b590640 1 -- 172.21.15.150:0/3487644872 wait complete. 2024-09-17T05:54:01.479 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs clone cancel cephfs subvol_clone48513 2024-09-17T05:54:01.674 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:01.672+0000 7f241f484640 1 -- 172.21.15.150:0/4007440927 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2404005350 msgr2=0x7f240400b9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:54:01.674 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:01.672+0000 7f241f484640 1 --2- 172.21.15.150:0/4007440927 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2404005350 0x7f240400b9e0 secure :-1 s=READY pgs=1917 cs=0 l=1 rev1=1 crypto rx=0x7f24100043e0 tx=0x7f2404005830 comp rx=0 tx=0).stop 2024-09-17T05:54:01.674 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:01.673+0000 7f241da21640 1 -- 172.21.15.150:0/4007440927 reap_dead start 2024-09-17T05:54:01.674 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:01.673+0000 7f241f484640 1 -- 172.21.15.150:0/4007440927 shutdown_connections 2024-09-17T05:54:01.674 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:01.673+0000 7f241f484640 1 -- 172.21.15.150:0/4007440927 >> 172.21.15.150:0/4007440927 conn(0x7f241806cda0 msgr2=0x7f241806d1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:54:01.677 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:01.675+0000 7f241f484640 1 -- 172.21.15.150:0/4007440927 shutdown_connections 2024-09-17T05:54:01.679 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:01.676+0000 7f241f484640 1 -- 172.21.15.150:0/4007440927 wait complete. 2024-09-17T05:54:01.682 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:01.681+0000 7f241f484640 1 Processor -- start 2024-09-17T05:54:01.682 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:01.681+0000 7f241f484640 1 -- start start 2024-09-17T05:54:01.684 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:01.683+0000 7f241f484640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f241815c1f0 0x7f24180abcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:54:01.684 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:01.683+0000 7f241f484640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f24180af110 0x7f24180ad760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:54:01.684 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:01.683+0000 7f241f484640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f24180adca0 0x7f24180aff70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:54:01.685 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:01.683+0000 7f241f484640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f2418070960 con 0x7f24180adca0 2024-09-17T05:54:01.685 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:01.683+0000 7f241f484640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f24180707e0 con 0x7f24180af110 2024-09-17T05:54:01.685 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:01.683+0000 7f241f484640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f24180b3fa0 con 0x7f241815c1f0 2024-09-17T05:54:01.686 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:01.683+0000 7f241da21640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f24180adca0 0x7f24180aff70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:54:01.686 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:01.683+0000 7f241da21640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f24180adca0 0x7f24180aff70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:53946/0 (socket says 172.21.15.150:53946) 2024-09-17T05:54:01.686 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:01.683+0000 7f241da21640 1 -- 172.21.15.150:0/3771268544 learned_addr learned my addr 172.21.15.150:0/3771268544 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:54:01.686 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:01.684+0000 7f241da21640 1 -- 172.21.15.150:0/3771268544 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f241815c1f0 msgr2=0x7f24180abcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:54:01.686 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:01.684+0000 7f241da21640 1 --2- 172.21.15.150:0/3771268544 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f241815c1f0 0x7f24180abcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:54:01.686 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:01.684+0000 7f241da21640 1 -- 172.21.15.150:0/3771268544 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f24180af110 msgr2=0x7f24180ad760 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-17T05:54:01.686 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:01.684+0000 7f241da21640 1 --2- 172.21.15.150:0/3771268544 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f24180af110 0x7f24180ad760 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:54:01.686 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:01.684+0000 7f241da21640 1 -- 172.21.15.150:0/3771268544 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f24180ac200 con 0x7f24180adca0 2024-09-17T05:54:01.687 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:01.684+0000 7f241da21640 1 --2- 172.21.15.150:0/3771268544 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f24180adca0 0x7f24180aff70 secure :-1 s=READY pgs=1918 cs=0 l=1 rev1=1 crypto rx=0x7f241002abf0 tx=0x7f2410006d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:54:01.687 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:01.684+0000 7f2409ffb640 1 -- 172.21.15.150:0/3771268544 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2410041070 con 0x7f24180adca0 2024-09-17T05:54:01.687 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:01.685+0000 7f2409ffb640 1 -- 172.21.15.150:0/3771268544 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f2410006270 con 0x7f24180adca0 2024-09-17T05:54:01.687 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:01.685+0000 7f241f484640 1 -- 172.21.15.150:0/3771268544 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f24180ae590 con 0x7f24180adca0 2024-09-17T05:54:01.687 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:01.685+0000 7f2409ffb640 1 -- 172.21.15.150:0/3771268544 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2410037040 con 0x7f24180adca0 2024-09-17T05:54:01.687 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:01.685+0000 7f241f484640 1 -- 172.21.15.150:0/3771268544 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2418159e00 con 0x7f24180adca0 2024-09-17T05:54:01.689 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:01.688+0000 7f241f484640 1 -- 172.21.15.150:0/3771268544 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f24180aeab0 con 0x7f24180adca0 2024-09-17T05:54:01.691 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:01.690+0000 7f2409ffb640 1 -- 172.21.15.150:0/3771268544 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 50) ==== 104909+0+0 (secure 0 0 0) 0x7f2410004aa0 con 0x7f24180adca0 2024-09-17T05:54:01.691 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:01.690+0000 7f2409ffb640 1 --2- 172.21.15.150:0/3771268544 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f23fc07b2a0 0x7f23fc07d7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:54:01.691 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:01.691+0000 7f2409ffb640 1 -- 172.21.15.150:0/3771268544 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(143..143 src has 1..143) ==== 5934+0+0 (secure 0 0 0) 0x7f24100b98b0 con 0x7f24180adca0 2024-09-17T05:54:01.693 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:01.692+0000 7f241d220640 1 --2- 172.21.15.150:0/3771268544 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f23fc07b2a0 0x7f23fc07d7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:54:01.699 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:01.698+0000 7f2409ffb640 1 -- 172.21.15.150:0/3771268544 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f241002ae20 con 0x7f24180adca0 2024-09-17T05:54:01.719 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:01.718+0000 7f241d220640 1 --2- 172.21.15.150:0/3771268544 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f23fc07b2a0 0x7f23fc07d7b0 secure :-1 s=READY pgs=813 cs=0 l=1 rev1=1 crypto rx=0x7f24180b2a90 tx=0x7f2414006c90 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:54:01.997 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:01.996+0000 7f241f484640 1 -- 172.21.15.150:0/3771268544 --> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] -- mgr_command(tid 0: {"prefix": "fs clone cancel", "vol_name": "cephfs", "clone_name": "subvol_clone48513", "target": ["mon-mgr", ""]}) -- 0x7f2418070b10 con 0x7f23fc07b2a0 2024-09-17T05:54:03.108 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:03.106+0000 7f2409ffb640 1 -- 172.21.15.150:0/3771268544 <== mgr.4108 v2:172.21.15.176:6800/3631216395 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f2418070b10 con 0x7f23fc07b2a0 2024-09-17T05:54:03.111 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:03.109+0000 7f241f484640 1 -- 172.21.15.150:0/3771268544 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f23fc07b2a0 msgr2=0x7f23fc07d7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:54:03.111 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:03.109+0000 7f241f484640 1 --2- 172.21.15.150:0/3771268544 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f23fc07b2a0 0x7f23fc07d7b0 secure :-1 s=READY pgs=813 cs=0 l=1 rev1=1 crypto rx=0x7f24180b2a90 tx=0x7f2414006c90 comp rx=0 tx=0).stop 2024-09-17T05:54:03.111 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:03.109+0000 7f241f484640 1 -- 172.21.15.150:0/3771268544 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f24180adca0 msgr2=0x7f24180aff70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:54:03.111 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:03.109+0000 7f241f484640 1 --2- 172.21.15.150:0/3771268544 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f24180adca0 0x7f24180aff70 secure :-1 s=READY pgs=1918 cs=0 l=1 rev1=1 crypto rx=0x7f241002abf0 tx=0x7f2410006d30 comp rx=0 tx=0).stop 2024-09-17T05:54:03.111 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:03.109+0000 7f241f484640 1 -- 172.21.15.150:0/3771268544 shutdown_connections 2024-09-17T05:54:03.111 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:03.109+0000 7f241f484640 1 --2- 172.21.15.150:0/3771268544 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f24180af110 0x7f24180ad760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:54:03.111 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:03.109+0000 7f241f484640 1 --2- 172.21.15.150:0/3771268544 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f23fc07b2a0 0x7f23fc07d7b0 unknown :-1 s=CLOSED pgs=813 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:54:03.112 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:03.109+0000 7f241f484640 1 --2- 172.21.15.150:0/3771268544 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f24180adca0 0x7f24180aff70 unknown :-1 s=CLOSED pgs=1918 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:54:03.112 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:03.109+0000 7f241f484640 1 --2- 172.21.15.150:0/3771268544 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f241815c1f0 0x7f24180abcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:54:03.112 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:03.109+0000 7f241f484640 1 -- 172.21.15.150:0/3771268544 >> 172.21.15.150:0/3771268544 conn(0x7f241806cda0 msgr2=0x7f241808b430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:54:03.112 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:03.110+0000 7f241f484640 1 -- 172.21.15.150:0/3771268544 shutdown_connections 2024-09-17T05:54:03.112 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:03.110+0000 7f241f484640 1 -- 172.21.15.150:0/3771268544 wait complete. 2024-09-17T05:54:03.134 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs clone cancel cephfs subvol_clone78074 2024-09-17T05:54:03.308 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:03.306+0000 7fb62cbda640 1 -- 172.21.15.150:0/3421186820 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb6280cd0f0 msgr2=0x7fb6280cd500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:54:03.309 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:03.306+0000 7fb62cbda640 1 --2- 172.21.15.150:0/3421186820 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb6280cd0f0 0x7fb6280cd500 secure :-1 s=READY pgs=1920 cs=0 l=1 rev1=1 crypto rx=0x7fb610009830 tx=0x7fb61002a410 comp rx=0 tx=0).stop 2024-09-17T05:54:03.309 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:03.306+0000 7fb62cbda640 1 -- 172.21.15.150:0/3421186820 shutdown_connections 2024-09-17T05:54:03.309 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:03.306+0000 7fb62cbda640 1 --2- 172.21.15.150:0/3421186820 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb6280cd0f0 0x7fb6280cd500 unknown :-1 s=CLOSED pgs=1920 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:54:03.309 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:03.307+0000 7fb62cbda640 1 -- 172.21.15.150:0/3421186820 >> 172.21.15.150:0/3421186820 conn(0x7fb6280d2520 msgr2=0x7fb6280d2930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:54:03.309 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:03.307+0000 7fb62cbda640 1 -- 172.21.15.150:0/3421186820 shutdown_connections 2024-09-17T05:54:03.309 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:03.307+0000 7fb62cbda640 1 -- 172.21.15.150:0/3421186820 wait complete. 2024-09-17T05:54:03.313 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:03.311+0000 7fb62cbda640 1 Processor -- start 2024-09-17T05:54:03.313 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:03.311+0000 7fb62cbda640 1 -- start start 2024-09-17T05:54:03.317 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:03.313+0000 7fb62cbda640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb6280cd0f0 0x7fb62814d850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:54:03.317 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:03.313+0000 7fb62cbda640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb6280cda40 0x7fb628158390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:54:03.317 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:03.313+0000 7fb62cbda640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb6280cec90 0x7fb6281588d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:54:03.317 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:03.313+0000 7fb62cbda640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7fb6280b7df0 con 0x7fb6280cda40 2024-09-17T05:54:03.317 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:03.313+0000 7fb62cbda640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fb6280b7c70 con 0x7fb6280cec90 2024-09-17T05:54:03.317 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:03.313+0000 7fb62cbda640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fb6280b1bc0 con 0x7fb6280cd0f0 2024-09-17T05:54:03.317 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:03.313+0000 7fb61ffff640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb6280cda40 0x7fb628158390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:54:03.318 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:03.313+0000 7fb61ffff640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb6280cda40 0x7fb628158390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:53976/0 (socket says 172.21.15.150:53976) 2024-09-17T05:54:03.318 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:03.313+0000 7fb61ffff640 1 -- 172.21.15.150:0/3873683371 learned_addr learned my addr 172.21.15.150:0/3873683371 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:54:03.318 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:03.313+0000 7fb61ffff640 1 -- 172.21.15.150:0/3873683371 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb6280cd0f0 msgr2=0x7fb62814d850 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-17T05:54:03.318 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:03.313+0000 7fb61ffff640 1 --2- 172.21.15.150:0/3873683371 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb6280cd0f0 0x7fb62814d850 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:54:03.318 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:03.313+0000 7fb61ffff640 1 -- 172.21.15.150:0/3873683371 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb6280cec90 msgr2=0x7fb6281588d0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-17T05:54:03.318 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:03.313+0000 7fb61ffff640 1 --2- 172.21.15.150:0/3873683371 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb6280cec90 0x7fb6281588d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:54:03.318 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:03.313+0000 7fb61ffff640 1 -- 172.21.15.150:0/3873683371 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb6281f38b0 con 0x7fb6280cda40 2024-09-17T05:54:03.318 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:03.314+0000 7fb61ffff640 1 --2- 172.21.15.150:0/3873683371 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb6280cda40 0x7fb628158390 secure :-1 s=READY pgs=1921 cs=0 l=1 rev1=1 crypto rx=0x7fb610009950 tx=0x7fb610032ef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:54:03.318 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:03.314+0000 7fb61effd640 1 -- 172.21.15.150:0/3873683371 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb610037040 con 0x7fb6280cda40 2024-09-17T05:54:03.318 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:03.314+0000 7fb61effd640 1 -- 172.21.15.150:0/3873683371 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb610004110 con 0x7fb6280cda40 2024-09-17T05:54:03.318 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:03.314+0000 7fb61effd640 1 -- 172.21.15.150:0/3873683371 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb610005020 con 0x7fb6280cda40 2024-09-17T05:54:03.318 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:03.314+0000 7fb62cbda640 1 -- 172.21.15.150:0/3873683371 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb6281f3b90 con 0x7fb6280cda40 2024-09-17T05:54:03.318 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:03.314+0000 7fb62cbda640 1 -- 172.21.15.150:0/3873683371 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb6281f4150 con 0x7fb6280cda40 2024-09-17T05:54:03.319 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:03.316+0000 7fb62cbda640 1 -- 172.21.15.150:0/3873683371 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb6280cd500 con 0x7fb6280cda40 2024-09-17T05:54:03.319 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:03.316+0000 7fb61effd640 1 -- 172.21.15.150:0/3873683371 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 50) ==== 104909+0+0 (secure 0 0 0) 0x7fb610044030 con 0x7fb6280cda40 2024-09-17T05:54:03.319 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:03.317+0000 7fb61effd640 1 --2- 172.21.15.150:0/3873683371 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fb60c07b200 0x7fb60c07d710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:54:03.319 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:03.317+0000 7fb61effd640 1 -- 172.21.15.150:0/3873683371 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(143..143 src has 1..143) ==== 5934+0+0 (secure 0 0 0) 0x7fb6100ba110 con 0x7fb6280cda40 2024-09-17T05:54:03.328 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:03.326+0000 7fb61effd640 1 -- 172.21.15.150:0/3873683371 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fb61004b020 con 0x7fb6280cda40 2024-09-17T05:54:03.331 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:03.329+0000 7fb62659c640 1 --2- 172.21.15.150:0/3873683371 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fb60c07b200 0x7fb60c07d710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:54:03.332 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:03.331+0000 7fb62659c640 1 --2- 172.21.15.150:0/3873683371 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fb60c07b200 0x7fb60c07d710 secure :-1 s=READY pgs=814 cs=0 l=1 rev1=1 crypto rx=0x7fb6280b7a70 tx=0x7fb6180019d0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:54:03.625 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:03.623+0000 7fb62cbda640 1 -- 172.21.15.150:0/3873683371 --> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] -- mgr_command(tid 0: {"prefix": "fs clone cancel", "vol_name": "cephfs", "clone_name": "subvol_clone78074", "target": ["mon-mgr", ""]}) -- 0x7fb628070ef0 con 0x7fb60c07b200 2024-09-17T05:54:04.688 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:04.685+0000 7fb61effd640 1 -- 172.21.15.150:0/3873683371 <== mgr.4108 v2:172.21.15.176:6800/3631216395 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7fb628070ef0 con 0x7fb60c07b200 2024-09-17T05:54:04.691 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:04.689+0000 7fb62cbda640 1 -- 172.21.15.150:0/3873683371 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fb60c07b200 msgr2=0x7fb60c07d710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:54:04.691 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:04.689+0000 7fb62cbda640 1 --2- 172.21.15.150:0/3873683371 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fb60c07b200 0x7fb60c07d710 secure :-1 s=READY pgs=814 cs=0 l=1 rev1=1 crypto rx=0x7fb6280b7a70 tx=0x7fb6180019d0 comp rx=0 tx=0).stop 2024-09-17T05:54:04.691 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:04.689+0000 7fb62cbda640 1 -- 172.21.15.150:0/3873683371 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb6280cda40 msgr2=0x7fb628158390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:54:04.691 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:04.689+0000 7fb62cbda640 1 --2- 172.21.15.150:0/3873683371 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb6280cda40 0x7fb628158390 secure :-1 s=READY pgs=1921 cs=0 l=1 rev1=1 crypto rx=0x7fb610009950 tx=0x7fb610032ef0 comp rx=0 tx=0).stop 2024-09-17T05:54:04.691 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:04.689+0000 7fb62cbda640 1 -- 172.21.15.150:0/3873683371 shutdown_connections 2024-09-17T05:54:04.691 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:04.689+0000 7fb62cbda640 1 --2- 172.21.15.150:0/3873683371 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb6280cec90 0x7fb6281588d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:54:04.691 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:04.689+0000 7fb62cbda640 1 --2- 172.21.15.150:0/3873683371 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fb60c07b200 0x7fb60c07d710 unknown :-1 s=CLOSED pgs=814 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:54:04.691 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:04.689+0000 7fb62cbda640 1 --2- 172.21.15.150:0/3873683371 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb6280cda40 0x7fb628158390 unknown :-1 s=CLOSED pgs=1921 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:54:04.692 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:04.689+0000 7fb62cbda640 1 --2- 172.21.15.150:0/3873683371 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb6280cd0f0 0x7fb62814d850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:54:04.692 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:04.689+0000 7fb62cbda640 1 -- 172.21.15.150:0/3873683371 >> 172.21.15.150:0/3873683371 conn(0x7fb6280d2520 msgr2=0x7fb628068e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:54:04.693 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:04.690+0000 7fb62cbda640 1 -- 172.21.15.150:0/3873683371 shutdown_connections 2024-09-17T05:54:04.693 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:04.690+0000 7fb62cbda640 1 -- 172.21.15.150:0/3873683371 wait complete. 2024-09-17T05:54:04.715 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs clone cancel cephfs subvol_clone58715 2024-09-17T05:54:04.921 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:04.919+0000 7f738b020640 1 -- 172.21.15.150:0/3070059425 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f736c004800 msgr2=0x7f736c004c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:54:04.921 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:04.919+0000 7f738b020640 1 --2- 172.21.15.150:0/3070059425 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f736c004800 0x7f736c004c10 secure :-1 s=READY pgs=1923 cs=0 l=1 rev1=1 crypto rx=0x7f7374006dc0 tx=0x7f736c005830 comp rx=0 tx=0).stop 2024-09-17T05:54:04.921 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:04.919+0000 7f73895bd640 1 -- 172.21.15.150:0/3070059425 reap_dead start 2024-09-17T05:54:04.922 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:04.920+0000 7f738b020640 1 -- 172.21.15.150:0/3070059425 shutdown_connections 2024-09-17T05:54:04.922 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:04.920+0000 7f738b020640 1 -- 172.21.15.150:0/3070059425 >> 172.21.15.150:0/3070059425 conn(0x7f7384073890 msgr2=0x7f7384073ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:54:04.923 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:04.920+0000 7f738b020640 1 -- 172.21.15.150:0/3070059425 shutdown_connections 2024-09-17T05:54:04.923 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:04.920+0000 7f738b020640 1 -- 172.21.15.150:0/3070059425 wait complete. 2024-09-17T05:54:04.924 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:04.922+0000 7f738b020640 1 Processor -- start 2024-09-17T05:54:04.924 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:04.922+0000 7f738b020640 1 -- start start 2024-09-17T05:54:04.927 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:04.924+0000 7f738b020640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f736c004800 0x7f73841f5120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:54:04.927 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:04.924+0000 7f738b020640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f73840ae700 0x7f73841f4760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:54:04.927 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:04.924+0000 7f738b020640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f73841f4ca0 0x7f738414e5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:54:04.927 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:04.925+0000 7f738b020640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f73840a9630 con 0x7f73841f4ca0 2024-09-17T05:54:04.928 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:04.925+0000 7f738b020640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f73840a94b0 con 0x7f736c004800 2024-09-17T05:54:04.928 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:04.925+0000 7f738b020640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f73840a97b0 con 0x7f73840ae700 2024-09-17T05:54:04.928 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:04.925+0000 7f73895bd640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f73841f4ca0 0x7f738414e5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:54:04.928 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:04.925+0000 7f73895bd640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f73841f4ca0 0x7f738414e5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:53994/0 (socket says 172.21.15.150:53994) 2024-09-17T05:54:04.928 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:04.925+0000 7f73895bd640 1 -- 172.21.15.150:0/2480850167 learned_addr learned my addr 172.21.15.150:0/2480850167 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:54:04.928 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:04.925+0000 7f73895bd640 1 -- 172.21.15.150:0/2480850167 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f73840ae700 msgr2=0x7f73841f4760 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-17T05:54:04.928 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:04.925+0000 7f73895bd640 1 --2- 172.21.15.150:0/2480850167 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f73840ae700 0x7f73841f4760 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:54:04.928 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:04.925+0000 7f73895bd640 1 -- 172.21.15.150:0/2480850167 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f736c004800 msgr2=0x7f73841f5120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:54:04.928 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:04.925+0000 7f73895bd640 1 --2- 172.21.15.150:0/2480850167 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f736c004800 0x7f73841f5120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:54:04.928 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:04.925+0000 7f73895bd640 1 -- 172.21.15.150:0/2480850167 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f73840aeee0 con 0x7f73841f4ca0 2024-09-17T05:54:04.928 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:04.925+0000 7f73895bd640 1 --2- 172.21.15.150:0/2480850167 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f73841f4ca0 0x7f738414e5d0 secure :-1 s=READY pgs=1924 cs=0 l=1 rev1=1 crypto rx=0x7f738415cb30 tx=0x7f737c009b00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:54:04.928 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:04.926+0000 7f73797fa640 1 -- 172.21.15.150:0/2480850167 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f737c004b20 con 0x7f73841f4ca0 2024-09-17T05:54:04.929 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:04.926+0000 7f738b020640 1 -- 172.21.15.150:0/2480850167 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f73840b5160 con 0x7f73841f4ca0 2024-09-17T05:54:04.929 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:04.926+0000 7f738b020640 1 -- 172.21.15.150:0/2480850167 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f73840b5720 con 0x7f73841f4ca0 2024-09-17T05:54:04.929 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:04.926+0000 7f73797fa640 1 -- 172.21.15.150:0/2480850167 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f737c004dd0 con 0x7f73841f4ca0 2024-09-17T05:54:04.929 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:04.926+0000 7f73797fa640 1 -- 172.21.15.150:0/2480850167 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f737c011970 con 0x7f73841f4ca0 2024-09-17T05:54:04.930 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:04.928+0000 7f738b020640 1 -- 172.21.15.150:0/2480850167 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7364005290 con 0x7f73841f4ca0 2024-09-17T05:54:04.931 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:04.929+0000 7f73797fa640 1 -- 172.21.15.150:0/2480850167 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 50) ==== 104909+0+0 (secure 0 0 0) 0x7f737c01b020 con 0x7f73841f4ca0 2024-09-17T05:54:04.931 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:04.929+0000 7f73797fa640 1 --2- 172.21.15.150:0/2480850167 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f737007b1d0 0x7f737007d6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:54:04.931 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:04.930+0000 7f73797fa640 1 -- 172.21.15.150:0/2480850167 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(143..143 src has 1..143) ==== 5934+0+0 (secure 0 0 0) 0x7f737c099f70 con 0x7f73841f4ca0 2024-09-17T05:54:04.938 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:04.936+0000 7f73797fa640 1 -- 172.21.15.150:0/2480850167 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f737c063e30 con 0x7f73841f4ca0 2024-09-17T05:54:04.941 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:04.939+0000 7f7388dbc640 1 --2- 172.21.15.150:0/2480850167 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f737007b1d0 0x7f737007d6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:54:04.959 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:04.958+0000 7f7388dbc640 1 --2- 172.21.15.150:0/2480850167 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f737007b1d0 0x7f737007d6e0 secure :-1 s=READY pgs=815 cs=0 l=1 rev1=1 crypto rx=0x7f7380005fd0 tx=0x7f7380005c90 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:54:05.232 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:05.230+0000 7f738b020640 1 -- 172.21.15.150:0/2480850167 --> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] -- mgr_command(tid 0: {"prefix": "fs clone cancel", "vol_name": "cephfs", "clone_name": "subvol_clone58715", "target": ["mon-mgr", ""]}) -- 0x7f7364000bc0 con 0x7f737007b1d0 2024-09-17T05:54:05.663 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:05.661+0000 7f73797fa640 1 -- 172.21.15.150:0/2480850167 <== mgr.4108 v2:172.21.15.176:6800/3631216395 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f7364000bc0 con 0x7f737007b1d0 2024-09-17T05:54:05.666 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:05.664+0000 7f738b020640 1 -- 172.21.15.150:0/2480850167 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f737007b1d0 msgr2=0x7f737007d6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:54:05.667 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:05.664+0000 7f738b020640 1 --2- 172.21.15.150:0/2480850167 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f737007b1d0 0x7f737007d6e0 secure :-1 s=READY pgs=815 cs=0 l=1 rev1=1 crypto rx=0x7f7380005fd0 tx=0x7f7380005c90 comp rx=0 tx=0).stop 2024-09-17T05:54:05.667 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:05.664+0000 7f738b020640 1 -- 172.21.15.150:0/2480850167 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f73841f4ca0 msgr2=0x7f738414e5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:54:05.667 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:05.664+0000 7f738b020640 1 --2- 172.21.15.150:0/2480850167 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f73841f4ca0 0x7f738414e5d0 secure :-1 s=READY pgs=1924 cs=0 l=1 rev1=1 crypto rx=0x7f738415cb30 tx=0x7f737c009b00 comp rx=0 tx=0).stop 2024-09-17T05:54:05.667 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:05.664+0000 7f738b020640 1 -- 172.21.15.150:0/2480850167 shutdown_connections 2024-09-17T05:54:05.667 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:05.664+0000 7f738b020640 1 --2- 172.21.15.150:0/2480850167 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f737007b1d0 0x7f737007d6e0 unknown :-1 s=CLOSED pgs=815 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:54:05.667 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:05.664+0000 7f738b020640 1 --2- 172.21.15.150:0/2480850167 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f73841f4ca0 0x7f738414e5d0 unknown :-1 s=CLOSED pgs=1924 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:54:05.668 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:05.664+0000 7f738b020640 1 --2- 172.21.15.150:0/2480850167 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f73840ae700 0x7f73841f4760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:54:05.668 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:05.664+0000 7f738b020640 1 --2- 172.21.15.150:0/2480850167 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f736c004800 0x7f73841f5120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:54:05.668 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:05.664+0000 7f738b020640 1 -- 172.21.15.150:0/2480850167 >> 172.21.15.150:0/2480850167 conn(0x7f7384073890 msgr2=0x7f73841524f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:54:05.668 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:05.664+0000 7f738b020640 1 -- 172.21.15.150:0/2480850167 shutdown_connections 2024-09-17T05:54:05.668 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:05.664+0000 7f738b020640 1 -- 172.21.15.150:0/2480850167 wait complete. 2024-09-17T05:54:05.682 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs clone cancel cephfs subvol_clone65316 2024-09-17T05:54:05.833 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:05.831+0000 7ff1cc89b640 1 -- 172.21.15.150:0/2123946182 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff1b0003a50 msgr2=0x7ff1b0003ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:54:05.833 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:05.831+0000 7ff1cc89b640 1 --2- 172.21.15.150:0/2123946182 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff1b0003a50 0x7ff1b0003ec0 secure :-1 s=READY pgs=1926 cs=0 l=1 rev1=1 crypto rx=0x7ff1b800c4a0 tx=0x7ff1b0005830 comp rx=0 tx=0).stop 2024-09-17T05:54:05.833 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:05.831+0000 7ff1cc89b640 1 -- 172.21.15.150:0/2123946182 shutdown_connections 2024-09-17T05:54:05.833 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:05.831+0000 7ff1cc89b640 1 --2- 172.21.15.150:0/2123946182 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff1b0003a50 0x7ff1b0003ec0 unknown :-1 s=CLOSED pgs=1926 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:54:05.834 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:05.831+0000 7ff1cc89b640 1 -- 172.21.15.150:0/2123946182 >> 172.21.15.150:0/2123946182 conn(0x7ff1c8074850 msgr2=0x7ff1c806cda0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:54:05.834 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:05.831+0000 7ff1cc89b640 1 -- 172.21.15.150:0/2123946182 shutdown_connections 2024-09-17T05:54:05.834 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:05.831+0000 7ff1cc89b640 1 -- 172.21.15.150:0/2123946182 wait complete. 2024-09-17T05:54:05.835 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:05.833+0000 7ff1cc89b640 1 Processor -- start 2024-09-17T05:54:05.835 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:05.834+0000 7ff1cc89b640 1 -- start start 2024-09-17T05:54:05.838 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:05.835+0000 7ff1cc89b640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff1b0003a50 0x7ff1c8136880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:54:05.838 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:05.835+0000 7ff1cc89b640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff1c81f58b0 0x7ff1c81f0de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:54:05.838 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:05.835+0000 7ff1cc89b640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff1c81f4ca0 0x7ff1c81f50b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:54:05.838 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:05.835+0000 7ff1cc89b640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7ff1c80b4710 con 0x7ff1c81f4ca0 2024-09-17T05:54:05.838 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:05.835+0000 7ff1cc89b640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7ff1c80b6150 con 0x7ff1b0003a50 2024-09-17T05:54:05.838 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:05.835+0000 7ff1cc89b640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7ff1c80b4890 con 0x7ff1c81f58b0 2024-09-17T05:54:05.838 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:05.835+0000 7ff1c6d9d640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff1c81f4ca0 0x7ff1c81f50b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:54:05.838 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:05.835+0000 7ff1c6d9d640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff1c81f4ca0 0x7ff1c81f50b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:54014/0 (socket says 172.21.15.150:54014) 2024-09-17T05:54:05.838 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:05.835+0000 7ff1c6d9d640 1 -- 172.21.15.150:0/3573004855 learned_addr learned my addr 172.21.15.150:0/3573004855 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:54:05.838 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:05.835+0000 7ff1c6d9d640 1 -- 172.21.15.150:0/3573004855 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff1c81f58b0 msgr2=0x7ff1c81f0de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:54:05.838 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:05.835+0000 7ff1c6d9d640 1 --2- 172.21.15.150:0/3573004855 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff1c81f58b0 0x7ff1c81f0de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:54:05.838 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:05.835+0000 7ff1c6d9d640 1 -- 172.21.15.150:0/3573004855 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff1b0003a50 msgr2=0x7ff1c8136880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:54:05.839 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:05.835+0000 7ff1c6d9d640 1 --2- 172.21.15.150:0/3573004855 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff1b0003a50 0x7ff1c8136880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:54:05.839 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:05.835+0000 7ff1c6d9d640 1 -- 172.21.15.150:0/3573004855 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff1c8136690 con 0x7ff1c81f4ca0 2024-09-17T05:54:05.839 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:05.835+0000 7ff1c6d9d640 1 --2- 172.21.15.150:0/3573004855 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff1c81f4ca0 0x7ff1c81f50b0 secure :-1 s=READY pgs=1927 cs=0 l=1 rev1=1 crypto rx=0x7ff1c8144dc0 tx=0x7ff1c00019b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:54:05.839 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:05.836+0000 7ff1b6ffd640 1 -- 172.21.15.150:0/3573004855 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1c0011870 con 0x7ff1c81f4ca0 2024-09-17T05:54:05.839 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:05.836+0000 7ff1b6ffd640 1 -- 172.21.15.150:0/3573004855 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff1c0017070 con 0x7ff1c81f4ca0 2024-09-17T05:54:05.839 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:05.836+0000 7ff1b6ffd640 1 -- 172.21.15.150:0/3573004855 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1c0011da0 con 0x7ff1c81f4ca0 2024-09-17T05:54:05.839 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:05.836+0000 7ff1cc89b640 1 -- 172.21.15.150:0/3573004855 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff1c81f55f0 con 0x7ff1c81f4ca0 2024-09-17T05:54:05.839 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:05.836+0000 7ff1cc89b640 1 -- 172.21.15.150:0/3573004855 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff1c8134850 con 0x7ff1c81f4ca0 2024-09-17T05:54:05.839 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:05.837+0000 7ff1cc89b640 1 -- 172.21.15.150:0/3573004855 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff1c8075d20 con 0x7ff1c81f4ca0 2024-09-17T05:54:05.840 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:05.838+0000 7ff1b6ffd640 1 -- 172.21.15.150:0/3573004855 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 50) ==== 104909+0+0 (secure 0 0 0) 0x7ff1c001c460 con 0x7ff1c81f4ca0 2024-09-17T05:54:05.840 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:05.839+0000 7ff1b6ffd640 1 --2- 172.21.15.150:0/3573004855 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7ff1a807b1d0 0x7ff1a807d6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:54:05.841 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:05.839+0000 7ff1b6ffd640 1 -- 172.21.15.150:0/3573004855 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(143..143 src has 1..143) ==== 5934+0+0 (secure 0 0 0) 0x7ff1c009a960 con 0x7ff1c81f4ca0 2024-09-17T05:54:05.844 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:05.842+0000 7ff1c659c640 1 --2- 172.21.15.150:0/3573004855 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7ff1a807b1d0 0x7ff1a807d6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:54:05.846 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:05.845+0000 7ff1b6ffd640 1 -- 172.21.15.150:0/3573004855 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7ff1c81f55f0 con 0x7ff1c81f4ca0 2024-09-17T05:54:05.848 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:05.846+0000 7ff1c659c640 1 --2- 172.21.15.150:0/3573004855 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7ff1a807b1d0 0x7ff1a807d6e0 secure :-1 s=READY pgs=816 cs=0 l=1 rev1=1 crypto rx=0x7ff1b8033000 tx=0x7ff1c80b5250 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:54:06.131 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:06.129+0000 7ff1cc89b640 1 -- 172.21.15.150:0/3573004855 --> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] -- mgr_command(tid 0: {"prefix": "fs clone cancel", "vol_name": "cephfs", "clone_name": "subvol_clone65316", "target": ["mon-mgr", ""]}) -- 0x7ff1c80adcf0 con 0x7ff1a807b1d0 2024-09-17T05:54:06.226 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:06.225+0000 7ff1b6ffd640 1 -- 172.21.15.150:0/3573004855 <== mgr.4108 v2:172.21.15.176:6800/3631216395 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7ff1c80adcf0 con 0x7ff1a807b1d0 2024-09-17T05:54:06.229 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:06.227+0000 7ff1cc89b640 1 -- 172.21.15.150:0/3573004855 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7ff1a807b1d0 msgr2=0x7ff1a807d6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:54:06.229 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:06.227+0000 7ff1cc89b640 1 --2- 172.21.15.150:0/3573004855 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7ff1a807b1d0 0x7ff1a807d6e0 secure :-1 s=READY pgs=816 cs=0 l=1 rev1=1 crypto rx=0x7ff1b8033000 tx=0x7ff1c80b5250 comp rx=0 tx=0).stop 2024-09-17T05:54:06.229 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:06.227+0000 7ff1cc89b640 1 -- 172.21.15.150:0/3573004855 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff1c81f4ca0 msgr2=0x7ff1c81f50b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:54:06.229 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:06.227+0000 7ff1cc89b640 1 --2- 172.21.15.150:0/3573004855 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff1c81f4ca0 0x7ff1c81f50b0 secure :-1 s=READY pgs=1927 cs=0 l=1 rev1=1 crypto rx=0x7ff1c8144dc0 tx=0x7ff1c00019b0 comp rx=0 tx=0).stop 2024-09-17T05:54:06.229 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:06.227+0000 7ff1cc89b640 1 -- 172.21.15.150:0/3573004855 shutdown_connections 2024-09-17T05:54:06.230 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:06.227+0000 7ff1cc89b640 1 --2- 172.21.15.150:0/3573004855 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7ff1a807b1d0 0x7ff1a807d6e0 unknown :-1 s=CLOSED pgs=816 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:54:06.230 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:06.227+0000 7ff1cc89b640 1 --2- 172.21.15.150:0/3573004855 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff1c81f4ca0 0x7ff1c81f50b0 unknown :-1 s=CLOSED pgs=1927 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:54:06.230 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:06.227+0000 7ff1cc89b640 1 --2- 172.21.15.150:0/3573004855 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff1c81f58b0 0x7ff1c81f0de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:54:06.230 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:06.227+0000 7ff1cc89b640 1 --2- 172.21.15.150:0/3573004855 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff1b0003a50 0x7ff1c8136880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:54:06.230 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:06.227+0000 7ff1cc89b640 1 -- 172.21.15.150:0/3573004855 >> 172.21.15.150:0/3573004855 conn(0x7ff1c8074850 msgr2=0x7ff1c815a9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:54:06.230 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:06.227+0000 7ff1cc89b640 1 -- 172.21.15.150:0/3573004855 shutdown_connections 2024-09-17T05:54:06.230 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:06.227+0000 7ff1cc89b640 1 -- 172.21.15.150:0/3573004855 wait complete. 2024-09-17T05:54:06.240 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs clone status cephfs subvol_clone38300 2024-09-17T05:54:06.357 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:06.355+0000 7f1ff980e640 1 -- 172.21.15.150:0/1927578815 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1ff40b3400 msgr2=0x7f1ff41626e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:54:06.357 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:06.355+0000 7f1ff980e640 1 --2- 172.21.15.150:0/1927578815 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1ff40b3400 0x7f1ff41626e0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f1fe4009820 tx=0x7f1fe402a4a0 comp rx=0 tx=0).stop 2024-09-17T05:54:06.357 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:06.355+0000 7f1ff980e640 1 -- 172.21.15.150:0/1927578815 shutdown_connections 2024-09-17T05:54:06.357 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:06.355+0000 7f1ff980e640 1 --2- 172.21.15.150:0/1927578815 >> v2:172.21.15.176:3300/0 conn(0x7f1ff4162c20 0x7f1ff4163030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:54:06.358 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:06.355+0000 7f1ff980e640 1 --2- 172.21.15.150:0/1927578815 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1ff40b3400 0x7f1ff41626e0 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:54:06.358 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:06.355+0000 7f1ff980e640 1 -- 172.21.15.150:0/1927578815 >> 172.21.15.150:0/1927578815 conn(0x7f1ff40d4660 msgr2=0x7f1ff40d4a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:54:06.358 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:06.355+0000 7f1ff980e640 1 -- 172.21.15.150:0/1927578815 shutdown_connections 2024-09-17T05:54:06.358 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:06.355+0000 7f1ff980e640 1 -- 172.21.15.150:0/1927578815 wait complete. 2024-09-17T05:54:06.358 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:06.357+0000 7f1ff980e640 1 Processor -- start 2024-09-17T05:54:06.358 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:06.357+0000 7f1ff980e640 1 -- start start 2024-09-17T05:54:06.361 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:06.358+0000 7f1ff980e640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1ff40b3400 0x7f1ff40a1d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:54:06.361 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:06.358+0000 7f1ff980e640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1ff40cf290 0x7f1ff4153ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:54:06.361 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:06.358+0000 7f1ff980e640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1ff4162c20 0x7f1ff41515a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:54:06.361 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:06.358+0000 7f1ff980e640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f1ff40b2840 con 0x7f1ff40cf290 2024-09-17T05:54:06.361 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:06.358+0000 7f1ff980e640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f1ff40b26c0 con 0x7f1ff40b3400 2024-09-17T05:54:06.362 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:06.358+0000 7f1ff980e640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f1ff40b29c0 con 0x7f1ff4162c20 2024-09-17T05:54:06.362 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:06.358+0000 7f1fea7fc640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1ff40cf290 0x7f1ff4153ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:54:06.362 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:06.358+0000 7f1fea7fc640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1ff40cf290 0x7f1ff4153ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:54024/0 (socket says 172.21.15.150:54024) 2024-09-17T05:54:06.362 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:06.358+0000 7f1fea7fc640 1 -- 172.21.15.150:0/2117248887 learned_addr learned my addr 172.21.15.150:0/2117248887 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:54:06.362 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:06.358+0000 7f1ff2ffd640 1 --2- 172.21.15.150:0/2117248887 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1ff40b3400 0x7f1ff40a1d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:54:06.362 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:06.358+0000 7f1ff37fe640 1 --2- 172.21.15.150:0/2117248887 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1ff4162c20 0x7f1ff41515a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:54:06.362 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:06.358+0000 7f1fea7fc640 1 -- 172.21.15.150:0/2117248887 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1ff4162c20 msgr2=0x7f1ff41515a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:54:06.362 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:06.359+0000 7f1fea7fc640 1 --2- 172.21.15.150:0/2117248887 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1ff4162c20 0x7f1ff41515a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:54:06.362 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:06.359+0000 7f1fea7fc640 1 -- 172.21.15.150:0/2117248887 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1ff40b3400 msgr2=0x7f1ff40a1d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:54:06.362 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:06.359+0000 7f1fea7fc640 1 --2- 172.21.15.150:0/2117248887 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1ff40b3400 0x7f1ff40a1d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:54:06.362 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:06.359+0000 7f1fea7fc640 1 -- 172.21.15.150:0/2117248887 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1ff40a22d0 con 0x7f1ff40cf290 2024-09-17T05:54:06.362 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:06.359+0000 7f1ff2ffd640 1 --2- 172.21.15.150:0/2117248887 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1ff40b3400 0x7f1ff40a1d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T05:54:06.363 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:06.359+0000 7f1ff37fe640 1 --2- 172.21.15.150:0/2117248887 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1ff4162c20 0x7f1ff41515a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T05:54:06.363 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:06.359+0000 7f1fea7fc640 1 --2- 172.21.15.150:0/2117248887 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1ff40cf290 0x7f1ff4153ff0 secure :-1 s=READY pgs=1929 cs=0 l=1 rev1=1 crypto rx=0x7f1fdc00e7c0 tx=0x7f1fdc00ec80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:54:06.363 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:06.359+0000 7f1ff0ff9640 1 -- 172.21.15.150:0/2117248887 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1fdc00ccc0 con 0x7f1ff40cf290 2024-09-17T05:54:06.363 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:06.359+0000 7f1ff0ff9640 1 -- 172.21.15.150:0/2117248887 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f1fdc010430 con 0x7f1ff40cf290 2024-09-17T05:54:06.363 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:06.359+0000 7f1ff980e640 1 -- 172.21.15.150:0/2117248887 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1ff4154530 con 0x7f1ff40cf290 2024-09-17T05:54:06.363 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:06.359+0000 7f1ff0ff9640 1 -- 172.21.15.150:0/2117248887 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1fdc010840 con 0x7f1ff40cf290 2024-09-17T05:54:06.363 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:06.359+0000 7f1ff980e640 1 -- 172.21.15.150:0/2117248887 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1ff40b4900 con 0x7f1ff40cf290 2024-09-17T05:54:06.364 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:06.360+0000 7f1ff980e640 1 -- 172.21.15.150:0/2117248887 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1ff40d0160 con 0x7f1ff40cf290 2024-09-17T05:54:06.364 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:06.361+0000 7f1ff0ff9640 1 -- 172.21.15.150:0/2117248887 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 50) ==== 104909+0+0 (secure 0 0 0) 0x7f1fdc0109e0 con 0x7f1ff40cf290 2024-09-17T05:54:06.364 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:06.361+0000 7f1ff0ff9640 1 --2- 172.21.15.150:0/2117248887 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f1fd407b1d0 0x7f1fd407d6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:54:06.364 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:06.361+0000 7f1ff0ff9640 1 -- 172.21.15.150:0/2117248887 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(143..143 src has 1..143) ==== 5934+0+0 (secure 0 0 0) 0x7f1fdc09aa80 con 0x7f1ff40cf290 2024-09-17T05:54:06.364 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:06.361+0000 7f1ff2ffd640 1 --2- 172.21.15.150:0/2117248887 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f1fd407b1d0 0x7f1fd407d6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:54:06.364 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:06.362+0000 7f1ff2ffd640 1 --2- 172.21.15.150:0/2117248887 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f1fd407b1d0 0x7f1fd407d6e0 secure :-1 s=READY pgs=817 cs=0 l=1 rev1=1 crypto rx=0x7f1fe4034000 tx=0x7f1fe4004730 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:54:06.367 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:06.366+0000 7f1ff0ff9640 1 -- 172.21.15.150:0/2117248887 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f1fdc0649d0 con 0x7f1ff40cf290 2024-09-17T05:54:06.577 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:06.576+0000 7f1ff980e640 1 -- 172.21.15.150:0/2117248887 --> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] -- mgr_command(tid 0: {"prefix": "fs clone status", "vol_name": "cephfs", "clone_name": "subvol_clone38300", "target": ["mon-mgr", ""]}) -- 0x7f1ff40d52c0 con 0x7f1fd407b1d0 2024-09-17T05:54:06.586 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:06.585+0000 7f1ff0ff9640 1 -- 172.21.15.150:0/2117248887 <== mgr.4108 v2:172.21.15.176:6800/3631216395 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+243 (secure 0 0 0) 0x7f1ff40d52c0 con 0x7f1fd407b1d0 2024-09-17T05:54:06.586 INFO:teuthology.orchestra.run.smithi150.stdout:{ 2024-09-17T05:54:06.587 INFO:teuthology.orchestra.run.smithi150.stdout: "status": { 2024-09-17T05:54:06.587 INFO:teuthology.orchestra.run.smithi150.stdout: "state": "canceled", 2024-09-17T05:54:06.587 INFO:teuthology.orchestra.run.smithi150.stdout: "source": { 2024-09-17T05:54:06.587 INFO:teuthology.orchestra.run.smithi150.stdout: "volume": "cephfs", 2024-09-17T05:54:06.587 INFO:teuthology.orchestra.run.smithi150.stdout: "subvolume": "sv1", 2024-09-17T05:54:06.587 INFO:teuthology.orchestra.run.smithi150.stdout: "snapshot": "ss1" 2024-09-17T05:54:06.587 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-17T05:54:06.587 INFO:teuthology.orchestra.run.smithi150.stdout: "failure": { 2024-09-17T05:54:06.587 INFO:teuthology.orchestra.run.smithi150.stdout: "errno": "4", 2024-09-17T05:54:06.587 INFO:teuthology.orchestra.run.smithi150.stdout: "error_msg": "user interrupted clone operation" 2024-09-17T05:54:06.587 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-09-17T05:54:06.588 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-09-17T05:54:06.588 INFO:teuthology.orchestra.run.smithi150.stdout:} 2024-09-17T05:54:06.589 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:06.587+0000 7f1ff980e640 1 -- 172.21.15.150:0/2117248887 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f1fd407b1d0 msgr2=0x7f1fd407d6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:54:06.589 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:06.587+0000 7f1ff980e640 1 --2- 172.21.15.150:0/2117248887 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f1fd407b1d0 0x7f1fd407d6e0 secure :-1 s=READY pgs=817 cs=0 l=1 rev1=1 crypto rx=0x7f1fe4034000 tx=0x7f1fe4004730 comp rx=0 tx=0).stop 2024-09-17T05:54:06.589 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:06.587+0000 7f1ff980e640 1 -- 172.21.15.150:0/2117248887 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1ff40cf290 msgr2=0x7f1ff4153ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:54:06.589 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:06.587+0000 7f1ff980e640 1 --2- 172.21.15.150:0/2117248887 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1ff40cf290 0x7f1ff4153ff0 secure :-1 s=READY pgs=1929 cs=0 l=1 rev1=1 crypto rx=0x7f1fdc00e7c0 tx=0x7f1fdc00ec80 comp rx=0 tx=0).stop 2024-09-17T05:54:06.589 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:06.587+0000 7f1ff980e640 1 -- 172.21.15.150:0/2117248887 shutdown_connections 2024-09-17T05:54:06.589 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:06.587+0000 7f1ff980e640 1 --2- 172.21.15.150:0/2117248887 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f1fd407b1d0 0x7f1fd407d6e0 unknown :-1 s=CLOSED pgs=817 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:54:06.589 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:06.587+0000 7f1ff980e640 1 --2- 172.21.15.150:0/2117248887 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1ff4162c20 0x7f1ff41515a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:54:06.590 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:06.587+0000 7f1ff980e640 1 --2- 172.21.15.150:0/2117248887 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1ff40cf290 0x7f1ff4153ff0 unknown :-1 s=CLOSED pgs=1929 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:54:06.590 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:06.587+0000 7f1ff980e640 1 --2- 172.21.15.150:0/2117248887 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1ff40b3400 0x7f1ff40a1d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:54:06.590 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:06.587+0000 7f1ff980e640 1 -- 172.21.15.150:0/2117248887 >> 172.21.15.150:0/2117248887 conn(0x7f1ff40d4660 msgr2=0x7f1ff406df10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:54:06.590 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:06.587+0000 7f1ff980e640 1 -- 172.21.15.150:0/2117248887 shutdown_connections 2024-09-17T05:54:06.590 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:06.587+0000 7f1ff980e640 1 -- 172.21.15.150:0/2117248887 wait complete. 2024-09-17T05:54:06.600 DEBUG:tasks.cephfs.test_volumes:current clone state = canceled 2024-09-17T05:54:06.600 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs clone status cephfs subvol_clone67871 2024-09-17T05:54:06.717 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:06.715+0000 7f5ba8f39640 1 -- 172.21.15.150:0/3676798447 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5ba4070a10 msgr2=0x7f5ba40b3ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:54:06.717 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:06.715+0000 7f5ba8f39640 1 --2- 172.21.15.150:0/3676798447 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5ba4070a10 0x7f5ba40b3ea0 secure :-1 s=READY pgs=1930 cs=0 l=1 rev1=1 crypto rx=0x7f5ba4072ed0 tx=0x7f5b9402b830 comp rx=0 tx=0).stop 2024-09-17T05:54:06.717 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:06.715+0000 7f5ba8f39640 1 -- 172.21.15.150:0/3676798447 shutdown_connections 2024-09-17T05:54:06.717 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:06.715+0000 7f5ba8f39640 1 --2- 172.21.15.150:0/3676798447 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5ba4070a10 0x7f5ba40b3ea0 unknown :-1 s=CLOSED pgs=1930 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:54:06.718 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:06.715+0000 7f5ba8f39640 1 --2- 172.21.15.150:0/3676798447 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5ba415f050 0x7f5ba40b3960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:54:06.718 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:06.715+0000 7f5ba8f39640 1 -- 172.21.15.150:0/3676798447 >> 172.21.15.150:0/3676798447 conn(0x7f5ba406d1c0 msgr2=0x7f5ba406d5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:54:06.718 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:06.715+0000 7f5ba8f39640 1 -- 172.21.15.150:0/3676798447 shutdown_connections 2024-09-17T05:54:06.718 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:06.715+0000 7f5ba8f39640 1 -- 172.21.15.150:0/3676798447 wait complete. 2024-09-17T05:54:06.719 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:06.717+0000 7f5ba8f39640 1 Processor -- start 2024-09-17T05:54:06.719 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:06.717+0000 7f5ba8f39640 1 -- start start 2024-09-17T05:54:06.722 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:06.718+0000 7f5ba8f39640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5ba4070600 0x7f5ba4140120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:54:06.722 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:06.718+0000 7f5ba8f39640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5ba4070a10 0x7f5ba413c930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:54:06.722 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:06.718+0000 7f5ba8f39640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5ba4142440 0x7f5ba4142850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:54:06.722 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:06.718+0000 7f5ba8f39640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f5ba4073af0 con 0x7f5ba4070a10 2024-09-17T05:54:06.722 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:06.718+0000 7f5ba8f39640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f5ba4073970 con 0x7f5ba4142440 2024-09-17T05:54:06.722 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:06.718+0000 7f5ba8f39640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f5ba4073c70 con 0x7f5ba4070600 2024-09-17T05:54:06.722 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:06.719+0000 7f5ba1d9b640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5ba4070a10 0x7f5ba413c930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:54:06.722 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:06.719+0000 7f5ba1d9b640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5ba4070a10 0x7f5ba413c930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:54034/0 (socket says 172.21.15.150:54034) 2024-09-17T05:54:06.722 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:06.719+0000 7f5ba1d9b640 1 -- 172.21.15.150:0/2366414551 learned_addr learned my addr 172.21.15.150:0/2366414551 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:54:06.722 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:06.719+0000 7f5ba259c640 1 --2- 172.21.15.150:0/2366414551 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5ba4070600 0x7f5ba4140120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:54:06.723 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:06.719+0000 7f5ba2d9d640 1 --2- 172.21.15.150:0/2366414551 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5ba4142440 0x7f5ba4142850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:54:06.723 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:06.719+0000 7f5ba1d9b640 1 -- 172.21.15.150:0/2366414551 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5ba4070600 msgr2=0x7f5ba4140120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:54:06.723 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:06.719+0000 7f5ba1d9b640 1 --2- 172.21.15.150:0/2366414551 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5ba4070600 0x7f5ba4140120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:54:06.723 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:06.719+0000 7f5ba1d9b640 1 -- 172.21.15.150:0/2366414551 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5ba4142440 msgr2=0x7f5ba4142850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:54:06.723 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:06.719+0000 7f5ba1d9b640 1 --2- 172.21.15.150:0/2366414551 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5ba4142440 0x7f5ba4142850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:54:06.723 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:06.719+0000 7f5ba1d9b640 1 -- 172.21.15.150:0/2366414551 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5ba4142d90 con 0x7f5ba4070a10 2024-09-17T05:54:06.723 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:06.719+0000 7f5ba259c640 1 --2- 172.21.15.150:0/2366414551 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5ba4070600 0x7f5ba4140120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T05:54:06.723 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:06.719+0000 7f5ba1d9b640 1 --2- 172.21.15.150:0/2366414551 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5ba4070a10 0x7f5ba413c930 secure :-1 s=READY pgs=1931 cs=0 l=1 rev1=1 crypto rx=0x7f5b8c00c940 tx=0x7f5b8c00ce00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:54:06.723 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:06.719+0000 7f5b9affd640 1 -- 172.21.15.150:0/2366414551 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b8c007bb0 con 0x7f5ba4070a10 2024-09-17T05:54:06.723 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:06.719+0000 7f5b9affd640 1 -- 172.21.15.150:0/2366414551 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f5b8c007e40 con 0x7f5ba4070a10 2024-09-17T05:54:06.723 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:06.719+0000 7f5ba8f39640 1 -- 172.21.15.150:0/2366414551 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5ba41f3770 con 0x7f5ba4070a10 2024-09-17T05:54:06.723 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:06.719+0000 7f5b9affd640 1 -- 172.21.15.150:0/2366414551 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b8c00f6b0 con 0x7f5ba4070a10 2024-09-17T05:54:06.723 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:06.719+0000 7f5ba8f39640 1 -- 172.21.15.150:0/2366414551 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5ba41f3d30 con 0x7f5ba4070a10 2024-09-17T05:54:06.724 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:06.720+0000 7f5ba8f39640 1 -- 172.21.15.150:0/2366414551 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5ba40b3960 con 0x7f5ba4070a10 2024-09-17T05:54:06.724 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:06.721+0000 7f5b9affd640 1 -- 172.21.15.150:0/2366414551 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 50) ==== 104909+0+0 (secure 0 0 0) 0x7f5b8c00f850 con 0x7f5ba4070a10 2024-09-17T05:54:06.724 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:06.722+0000 7f5b9affd640 1 --2- 172.21.15.150:0/2366414551 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f5b8407b1d0 0x7f5b8407d6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:54:06.725 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:06.722+0000 7f5b9affd640 1 -- 172.21.15.150:0/2366414551 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(143..143 src has 1..143) ==== 5934+0+0 (secure 0 0 0) 0x7f5b8c09a770 con 0x7f5ba4070a10 2024-09-17T05:54:06.725 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:06.722+0000 7f5ba259c640 1 --2- 172.21.15.150:0/2366414551 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f5b8407b1d0 0x7f5b8407d6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:54:06.725 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:06.722+0000 7f5ba259c640 1 --2- 172.21.15.150:0/2366414551 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f5b8407b1d0 0x7f5b8407d6e0 secure :-1 s=READY pgs=818 cs=0 l=1 rev1=1 crypto rx=0x7f5b9c007e90 tx=0x7f5b9c0073a0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:54:06.728 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:06.726+0000 7f5b9affd640 1 -- 172.21.15.150:0/2366414551 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f5ba4142d90 con 0x7f5ba4070a10 2024-09-17T05:54:06.938 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:06.936+0000 7f5ba8f39640 1 -- 172.21.15.150:0/2366414551 --> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] -- mgr_command(tid 0: {"prefix": "fs clone status", "vol_name": "cephfs", "clone_name": "subvol_clone67871", "target": ["mon-mgr", ""]}) -- 0x7f5ba4140890 con 0x7f5b8407b1d0 2024-09-17T05:54:06.947 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:06.946+0000 7f5b9affd640 1 -- 172.21.15.150:0/2366414551 <== mgr.4108 v2:172.21.15.176:6800/3631216395 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+243 (secure 0 0 0) 0x7f5ba4140890 con 0x7f5b8407b1d0 2024-09-17T05:54:06.948 INFO:teuthology.orchestra.run.smithi150.stdout:{ 2024-09-17T05:54:06.948 INFO:teuthology.orchestra.run.smithi150.stdout: "status": { 2024-09-17T05:54:06.948 INFO:teuthology.orchestra.run.smithi150.stdout: "state": "canceled", 2024-09-17T05:54:06.948 INFO:teuthology.orchestra.run.smithi150.stdout: "source": { 2024-09-17T05:54:06.948 INFO:teuthology.orchestra.run.smithi150.stdout: "volume": "cephfs", 2024-09-17T05:54:06.948 INFO:teuthology.orchestra.run.smithi150.stdout: "subvolume": "sv1", 2024-09-17T05:54:06.948 INFO:teuthology.orchestra.run.smithi150.stdout: "snapshot": "ss1" 2024-09-17T05:54:06.948 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-17T05:54:06.948 INFO:teuthology.orchestra.run.smithi150.stdout: "failure": { 2024-09-17T05:54:06.949 INFO:teuthology.orchestra.run.smithi150.stdout: "errno": "4", 2024-09-17T05:54:06.949 INFO:teuthology.orchestra.run.smithi150.stdout: "error_msg": "user interrupted clone operation" 2024-09-17T05:54:06.949 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-09-17T05:54:06.949 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-09-17T05:54:06.949 INFO:teuthology.orchestra.run.smithi150.stdout:} 2024-09-17T05:54:06.950 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:06.948+0000 7f5ba8f39640 1 -- 172.21.15.150:0/2366414551 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f5b8407b1d0 msgr2=0x7f5b8407d6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:54:06.950 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:06.948+0000 7f5ba8f39640 1 --2- 172.21.15.150:0/2366414551 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f5b8407b1d0 0x7f5b8407d6e0 secure :-1 s=READY pgs=818 cs=0 l=1 rev1=1 crypto rx=0x7f5b9c007e90 tx=0x7f5b9c0073a0 comp rx=0 tx=0).stop 2024-09-17T05:54:06.950 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:06.948+0000 7f5ba8f39640 1 -- 172.21.15.150:0/2366414551 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5ba4070a10 msgr2=0x7f5ba413c930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:54:06.951 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:06.948+0000 7f5ba8f39640 1 --2- 172.21.15.150:0/2366414551 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5ba4070a10 0x7f5ba413c930 secure :-1 s=READY pgs=1931 cs=0 l=1 rev1=1 crypto rx=0x7f5b8c00c940 tx=0x7f5b8c00ce00 comp rx=0 tx=0).stop 2024-09-17T05:54:06.951 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:06.948+0000 7f5ba8f39640 1 -- 172.21.15.150:0/2366414551 shutdown_connections 2024-09-17T05:54:06.951 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:06.948+0000 7f5ba8f39640 1 --2- 172.21.15.150:0/2366414551 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5ba4142440 0x7f5ba4142850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:54:06.951 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:06.948+0000 7f5ba8f39640 1 --2- 172.21.15.150:0/2366414551 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f5b8407b1d0 0x7f5b8407d6e0 unknown :-1 s=CLOSED pgs=818 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:54:06.951 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:06.948+0000 7f5ba8f39640 1 --2- 172.21.15.150:0/2366414551 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5ba4070a10 0x7f5ba413c930 unknown :-1 s=CLOSED pgs=1931 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:54:06.951 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:06.948+0000 7f5ba8f39640 1 --2- 172.21.15.150:0/2366414551 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5ba4070600 0x7f5ba4140120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:54:06.951 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:06.948+0000 7f5ba8f39640 1 -- 172.21.15.150:0/2366414551 >> 172.21.15.150:0/2366414551 conn(0x7f5ba406d1c0 msgr2=0x7f5ba40691d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:54:06.951 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:06.948+0000 7f5ba8f39640 1 -- 172.21.15.150:0/2366414551 shutdown_connections 2024-09-17T05:54:06.951 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:06.948+0000 7f5ba8f39640 1 -- 172.21.15.150:0/2366414551 wait complete. 2024-09-17T05:54:06.962 DEBUG:tasks.cephfs.test_volumes:current clone state = canceled 2024-09-17T05:54:06.962 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs clone status cephfs subvol_clone02 2024-09-17T05:54:07.080 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:07.078+0000 7f20a964d640 1 -- 172.21.15.150:0/3891276031 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f20a40b9f20 msgr2=0x7f20a40cfa20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:54:07.080 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:07.078+0000 7f20a964d640 1 --2- 172.21.15.150:0/3891276031 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f20a40b9f20 0x7f20a40cfa20 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f209c009be0 tx=0x7f209c02a820 comp rx=0 tx=0).stop 2024-09-17T05:54:07.080 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:07.078+0000 7f20a964d640 1 -- 172.21.15.150:0/3891276031 shutdown_connections 2024-09-17T05:54:07.080 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:07.078+0000 7f20a964d640 1 --2- 172.21.15.150:0/3891276031 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f20a40b9f20 0x7f20a40cfa20 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:54:07.080 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:07.078+0000 7f20a964d640 1 -- 172.21.15.150:0/3891276031 >> 172.21.15.150:0/3891276031 conn(0x7f20a40d46e0 msgr2=0x7f20a40d4af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:54:07.080 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:07.078+0000 7f20a964d640 1 -- 172.21.15.150:0/3891276031 shutdown_connections 2024-09-17T05:54:07.080 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:07.078+0000 7f20a964d640 1 -- 172.21.15.150:0/3891276031 wait complete. 2024-09-17T05:54:07.081 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:07.079+0000 7f20a964d640 1 Processor -- start 2024-09-17T05:54:07.081 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:07.080+0000 7f20a964d640 1 -- start start 2024-09-17T05:54:07.084 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:07.081+0000 7f20a964d640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f20a40b23d0 0x7f20a40b4b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:54:07.084 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:07.081+0000 7f20a964d640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f20a40b3510 0x7f20a41f61d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:54:07.084 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:07.081+0000 7f20a964d640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f20a40b9f20 0x7f20a415c7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:54:07.084 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:07.081+0000 7f20a964d640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f20a40d00e0 con 0x7f20a40b3510 2024-09-17T05:54:07.084 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:07.081+0000 7f20a964d640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f20a40cff60 con 0x7f20a40b9f20 2024-09-17T05:54:07.084 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:07.081+0000 7f20a964d640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f20a40d0260 con 0x7f20a40b23d0 2024-09-17T05:54:07.084 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:07.081+0000 7f209bfff640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f20a40b3510 0x7f20a41f61d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:54:07.084 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:07.081+0000 7f209bfff640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f20a40b3510 0x7f20a41f61d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:54050/0 (socket says 172.21.15.150:54050) 2024-09-17T05:54:07.084 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:07.081+0000 7f209bfff640 1 -- 172.21.15.150:0/4051762934 learned_addr learned my addr 172.21.15.150:0/4051762934 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:54:07.084 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:07.081+0000 7f20a37fe640 1 --2- 172.21.15.150:0/4051762934 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f20a40b9f20 0x7f20a415c7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:54:07.084 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:07.081+0000 7f20a2ffd640 1 --2- 172.21.15.150:0/4051762934 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f20a40b23d0 0x7f20a40b4b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:54:07.084 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:07.081+0000 7f209bfff640 1 -- 172.21.15.150:0/4051762934 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f20a40b23d0 msgr2=0x7f20a40b4b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:54:07.085 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:07.081+0000 7f209bfff640 1 --2- 172.21.15.150:0/4051762934 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f20a40b23d0 0x7f20a40b4b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:54:07.085 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:07.081+0000 7f209bfff640 1 -- 172.21.15.150:0/4051762934 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f20a40b9f20 msgr2=0x7f20a415c7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:54:07.085 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:07.081+0000 7f209bfff640 1 --2- 172.21.15.150:0/4051762934 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f20a40b9f20 0x7f20a415c7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:54:07.085 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:07.081+0000 7f209bfff640 1 -- 172.21.15.150:0/4051762934 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f20a41f6710 con 0x7f20a40b3510 2024-09-17T05:54:07.085 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:07.082+0000 7f209bfff640 1 --2- 172.21.15.150:0/4051762934 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f20a40b3510 0x7f20a41f61d0 secure :-1 s=READY pgs=1933 cs=0 l=1 rev1=1 crypto rx=0x7f208c00c480 tx=0x7f208c00c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:54:07.085 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:07.082+0000 7f209b7fe640 1 -- 172.21.15.150:0/4051762934 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f208c004230 con 0x7f20a40b3510 2024-09-17T05:54:07.085 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:07.082+0000 7f20a964d640 1 -- 172.21.15.150:0/4051762934 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f20a40b5be0 con 0x7f20a40b3510 2024-09-17T05:54:07.085 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:07.082+0000 7f209b7fe640 1 -- 172.21.15.150:0/4051762934 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f208c012630 con 0x7f20a40b3510 2024-09-17T05:54:07.085 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:07.082+0000 7f209b7fe640 1 -- 172.21.15.150:0/4051762934 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f208c0044c0 con 0x7f20a40b3510 2024-09-17T05:54:07.085 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:07.082+0000 7f20a964d640 1 -- 172.21.15.150:0/4051762934 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f20a40b4350 con 0x7f20a40b3510 2024-09-17T05:54:07.086 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:07.083+0000 7f20a964d640 1 -- 172.21.15.150:0/4051762934 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f20a41626f0 con 0x7f20a40b3510 2024-09-17T05:54:07.087 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:07.083+0000 7f209b7fe640 1 -- 172.21.15.150:0/4051762934 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 50) ==== 104909+0+0 (secure 0 0 0) 0x7f208c012ae0 con 0x7f20a40b3510 2024-09-17T05:54:07.087 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:07.084+0000 7f209b7fe640 1 --2- 172.21.15.150:0/4051762934 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f208407b200 0x7f208407d710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:54:07.087 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:07.084+0000 7f209b7fe640 1 -- 172.21.15.150:0/4051762934 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(143..143 src has 1..143) ==== 5934+0+0 (secure 0 0 0) 0x7f208c09a220 con 0x7f20a40b3510 2024-09-17T05:54:07.087 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:07.084+0000 7f20a2ffd640 1 --2- 172.21.15.150:0/4051762934 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f208407b200 0x7f208407d710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:54:07.087 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:07.085+0000 7f20a2ffd640 1 --2- 172.21.15.150:0/4051762934 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f208407b200 0x7f208407d710 secure :-1 s=READY pgs=819 cs=0 l=1 rev1=1 crypto rx=0x7f2094001120 tx=0x7f2094009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:54:07.090 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:07.089+0000 7f209b7fe640 1 -- 172.21.15.150:0/4051762934 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f20a41f6710 con 0x7f20a40b3510 2024-09-17T05:54:07.302 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:07.300+0000 7f20a964d640 1 -- 172.21.15.150:0/4051762934 --> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] -- mgr_command(tid 0: {"prefix": "fs clone status", "vol_name": "cephfs", "clone_name": "subvol_clone02", "target": ["mon-mgr", ""]}) -- 0x7f20a40d52d0 con 0x7f208407b200 2024-09-17T05:54:07.313 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:07.311+0000 7f209b7fe640 1 -- 172.21.15.150:0/4051762934 <== mgr.4108 v2:172.21.15.176:6800/3631216395 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+243 (secure 0 0 0) 0x7f20a40d52d0 con 0x7f208407b200 2024-09-17T05:54:07.313 INFO:teuthology.orchestra.run.smithi150.stdout:{ 2024-09-17T05:54:07.313 INFO:teuthology.orchestra.run.smithi150.stdout: "status": { 2024-09-17T05:54:07.313 INFO:teuthology.orchestra.run.smithi150.stdout: "state": "canceled", 2024-09-17T05:54:07.314 INFO:teuthology.orchestra.run.smithi150.stdout: "source": { 2024-09-17T05:54:07.314 INFO:teuthology.orchestra.run.smithi150.stdout: "volume": "cephfs", 2024-09-17T05:54:07.314 INFO:teuthology.orchestra.run.smithi150.stdout: "subvolume": "sv1", 2024-09-17T05:54:07.314 INFO:teuthology.orchestra.run.smithi150.stdout: "snapshot": "ss1" 2024-09-17T05:54:07.314 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-17T05:54:07.314 INFO:teuthology.orchestra.run.smithi150.stdout: "failure": { 2024-09-17T05:54:07.314 INFO:teuthology.orchestra.run.smithi150.stdout: "errno": "4", 2024-09-17T05:54:07.314 INFO:teuthology.orchestra.run.smithi150.stdout: "error_msg": "user interrupted clone operation" 2024-09-17T05:54:07.314 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-09-17T05:54:07.314 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-09-17T05:54:07.314 INFO:teuthology.orchestra.run.smithi150.stdout:} 2024-09-17T05:54:07.316 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:07.314+0000 7f20a964d640 1 -- 172.21.15.150:0/4051762934 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f208407b200 msgr2=0x7f208407d710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:54:07.316 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:07.314+0000 7f20a964d640 1 --2- 172.21.15.150:0/4051762934 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f208407b200 0x7f208407d710 secure :-1 s=READY pgs=819 cs=0 l=1 rev1=1 crypto rx=0x7f2094001120 tx=0x7f2094009040 comp rx=0 tx=0).stop 2024-09-17T05:54:07.316 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:07.314+0000 7f20a964d640 1 -- 172.21.15.150:0/4051762934 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f20a40b3510 msgr2=0x7f20a41f61d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:54:07.316 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:07.314+0000 7f20a964d640 1 --2- 172.21.15.150:0/4051762934 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f20a40b3510 0x7f20a41f61d0 secure :-1 s=READY pgs=1933 cs=0 l=1 rev1=1 crypto rx=0x7f208c00c480 tx=0x7f208c00c940 comp rx=0 tx=0).stop 2024-09-17T05:54:07.316 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:07.314+0000 7f20a964d640 1 -- 172.21.15.150:0/4051762934 shutdown_connections 2024-09-17T05:54:07.316 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:07.314+0000 7f20a964d640 1 --2- 172.21.15.150:0/4051762934 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f20a40b9f20 0x7f20a415c7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:54:07.316 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:07.314+0000 7f20a964d640 1 --2- 172.21.15.150:0/4051762934 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f208407b200 0x7f208407d710 unknown :-1 s=CLOSED pgs=819 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:54:07.317 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:07.314+0000 7f20a964d640 1 --2- 172.21.15.150:0/4051762934 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f20a40b3510 0x7f20a41f61d0 unknown :-1 s=CLOSED pgs=1933 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:54:07.317 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:07.314+0000 7f20a964d640 1 --2- 172.21.15.150:0/4051762934 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f20a40b23d0 0x7f20a40b4b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:54:07.317 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:07.314+0000 7f20a964d640 1 -- 172.21.15.150:0/4051762934 >> 172.21.15.150:0/4051762934 conn(0x7f20a40d46e0 msgr2=0x7f20a406dfa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:54:07.317 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:07.314+0000 7f20a964d640 1 -- 172.21.15.150:0/4051762934 shutdown_connections 2024-09-17T05:54:07.317 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:07.314+0000 7f20a964d640 1 -- 172.21.15.150:0/4051762934 wait complete. 2024-09-17T05:54:07.327 DEBUG:tasks.cephfs.test_volumes:current clone state = canceled 2024-09-17T05:54:07.327 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs clone status cephfs subvol_clone48513 2024-09-17T05:54:07.445 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:07.443+0000 7fd33a084640 1 -- 172.21.15.150:0/88839267 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd3340b5980 msgr2=0x7fd3340b5d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:54:07.445 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:07.443+0000 7fd33a084640 1 --2- 172.21.15.150:0/88839267 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd3340b5980 0x7fd3340b5d90 secure :-1 s=READY pgs=1935 cs=0 l=1 rev1=1 crypto rx=0x7fd32c005fd0 tx=0x7fd32c02a870 comp rx=0 tx=0).stop 2024-09-17T05:54:07.445 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:07.443+0000 7fd33a084640 1 -- 172.21.15.150:0/88839267 shutdown_connections 2024-09-17T05:54:07.445 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:07.443+0000 7fd33a084640 1 --2- 172.21.15.150:0/88839267 >> v2:172.21.15.176:3300/0 conn(0x7fd33409b160 0x7fd3340b5440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:54:07.445 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:07.443+0000 7fd33a084640 1 --2- 172.21.15.150:0/88839267 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd3340b5980 0x7fd3340b5d90 unknown :-1 s=CLOSED pgs=1935 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:54:07.445 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:07.443+0000 7fd33a084640 1 -- 172.21.15.150:0/88839267 >> 172.21.15.150:0/88839267 conn(0x7fd3340d2550 msgr2=0x7fd3340d2960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:54:07.445 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:07.443+0000 7fd33a084640 1 -- 172.21.15.150:0/88839267 shutdown_connections 2024-09-17T05:54:07.445 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:07.443+0000 7fd33a084640 1 -- 172.21.15.150:0/88839267 wait complete. 2024-09-17T05:54:07.446 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:07.444+0000 7fd33a084640 1 Processor -- start 2024-09-17T05:54:07.446 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:07.445+0000 7fd33a084640 1 -- start start 2024-09-17T05:54:07.449 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:07.446+0000 7fd33a084640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd33409b160 0x7fd3341d27b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:54:07.449 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:07.446+0000 7fd33a084640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd3340b5980 0x7fd3340c7c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:54:07.449 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:07.446+0000 7fd33a084640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd3340ce800 0x7fd3340c8160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:54:07.449 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:07.446+0000 7fd33a084640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7fd3340b62d0 con 0x7fd3340b5980 2024-09-17T05:54:07.449 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:07.446+0000 7fd33a084640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fd3340cee20 con 0x7fd33409b160 2024-09-17T05:54:07.449 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:07.446+0000 7fd33a084640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fd3340b6450 con 0x7fd3340ce800 2024-09-17T05:54:07.449 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:07.446+0000 7fd332ffd640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd3340b5980 0x7fd3340c7c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:54:07.449 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:07.446+0000 7fd332ffd640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd3340b5980 0x7fd3340c7c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:54080/0 (socket says 172.21.15.150:54080) 2024-09-17T05:54:07.450 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:07.446+0000 7fd332ffd640 1 -- 172.21.15.150:0/847334276 learned_addr learned my addr 172.21.15.150:0/847334276 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:54:07.450 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:07.446+0000 7fd3337fe640 1 --2- 172.21.15.150:0/847334276 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd33409b160 0x7fd3341d27b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:54:07.450 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:07.446+0000 7fd333fff640 1 --2- 172.21.15.150:0/847334276 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd3340ce800 0x7fd3340c8160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:54:07.450 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:07.446+0000 7fd332ffd640 1 -- 172.21.15.150:0/847334276 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd3340ce800 msgr2=0x7fd3340c8160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:54:07.450 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:07.446+0000 7fd332ffd640 1 --2- 172.21.15.150:0/847334276 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd3340ce800 0x7fd3340c8160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:54:07.450 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:07.446+0000 7fd332ffd640 1 -- 172.21.15.150:0/847334276 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd33409b160 msgr2=0x7fd3341d27b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:54:07.450 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:07.446+0000 7fd332ffd640 1 --2- 172.21.15.150:0/847334276 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd33409b160 0x7fd3341d27b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:54:07.450 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:07.446+0000 7fd332ffd640 1 -- 172.21.15.150:0/847334276 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd33409f990 con 0x7fd3340b5980 2024-09-17T05:54:07.450 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:07.447+0000 7fd332ffd640 1 --2- 172.21.15.150:0/847334276 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd3340b5980 0x7fd3340c7c20 secure :-1 s=READY pgs=1936 cs=0 l=1 rev1=1 crypto rx=0x7fd32800d6d0 tx=0x7fd32800db90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:54:07.450 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:07.447+0000 7fd31bfff640 1 -- 172.21.15.150:0/847334276 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd328017070 con 0x7fd3340b5980 2024-09-17T05:54:07.450 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:07.447+0000 7fd31bfff640 1 -- 172.21.15.150:0/847334276 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd328009ab0 con 0x7fd3340b5980 2024-09-17T05:54:07.450 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:07.447+0000 7fd31bfff640 1 -- 172.21.15.150:0/847334276 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd328010460 con 0x7fd3340b5980 2024-09-17T05:54:07.450 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:07.447+0000 7fd33a084640 1 -- 172.21.15.150:0/847334276 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd33409fc70 con 0x7fd3340b5980 2024-09-17T05:54:07.451 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:07.447+0000 7fd33a084640 1 -- 172.21.15.150:0/847334276 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd3340c7110 con 0x7fd3340b5980 2024-09-17T05:54:07.451 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:07.448+0000 7fd33a084640 1 -- 172.21.15.150:0/847334276 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd3340b5440 con 0x7fd3340b5980 2024-09-17T05:54:07.451 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:07.449+0000 7fd31bfff640 1 -- 172.21.15.150:0/847334276 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 50) ==== 104909+0+0 (secure 0 0 0) 0x7fd32801a070 con 0x7fd3340b5980 2024-09-17T05:54:07.452 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:07.449+0000 7fd31bfff640 1 --2- 172.21.15.150:0/847334276 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fd32007b1d0 0x7fd32007d6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:54:07.452 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:07.449+0000 7fd31bfff640 1 -- 172.21.15.150:0/847334276 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(143..143 src has 1..143) ==== 5934+0+0 (secure 0 0 0) 0x7fd32809a2b0 con 0x7fd3340b5980 2024-09-17T05:54:07.452 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:07.449+0000 7fd3337fe640 1 --2- 172.21.15.150:0/847334276 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fd32007b1d0 0x7fd32007d6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:54:07.452 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:07.450+0000 7fd3337fe640 1 --2- 172.21.15.150:0/847334276 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fd32007b1d0 0x7fd32007d6e0 secure :-1 s=READY pgs=820 cs=0 l=1 rev1=1 crypto rx=0x7fd3240046b0 tx=0x7fd324007eb0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:54:07.455 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:07.454+0000 7fd31bfff640 1 -- 172.21.15.150:0/847334276 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fd328063ba0 con 0x7fd3340b5980 2024-09-17T05:54:07.668 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:07.667+0000 7fd33a084640 1 -- 172.21.15.150:0/847334276 --> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] -- mgr_command(tid 0: {"prefix": "fs clone status", "vol_name": "cephfs", "clone_name": "subvol_clone48513", "target": ["mon-mgr", ""]}) -- 0x7fd3340d04e0 con 0x7fd32007b1d0 2024-09-17T05:54:09.852 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:09.851+0000 7fd31bfff640 1 -- 172.21.15.150:0/847334276 <== mgr.4108 v2:172.21.15.176:6800/3631216395 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+243 (secure 0 0 0) 0x7fd3340d04e0 con 0x7fd32007b1d0 2024-09-17T05:54:09.853 INFO:teuthology.orchestra.run.smithi150.stdout:{ 2024-09-17T05:54:09.853 INFO:teuthology.orchestra.run.smithi150.stdout: "status": { 2024-09-17T05:54:09.853 INFO:teuthology.orchestra.run.smithi150.stdout: "state": "canceled", 2024-09-17T05:54:09.853 INFO:teuthology.orchestra.run.smithi150.stdout: "source": { 2024-09-17T05:54:09.853 INFO:teuthology.orchestra.run.smithi150.stdout: "volume": "cephfs", 2024-09-17T05:54:09.853 INFO:teuthology.orchestra.run.smithi150.stdout: "subvolume": "sv1", 2024-09-17T05:54:09.853 INFO:teuthology.orchestra.run.smithi150.stdout: "snapshot": "ss1" 2024-09-17T05:54:09.853 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-17T05:54:09.854 INFO:teuthology.orchestra.run.smithi150.stdout: "failure": { 2024-09-17T05:54:09.854 INFO:teuthology.orchestra.run.smithi150.stdout: "errno": "4", 2024-09-17T05:54:09.854 INFO:teuthology.orchestra.run.smithi150.stdout: "error_msg": "user interrupted clone operation" 2024-09-17T05:54:09.854 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-09-17T05:54:09.854 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-09-17T05:54:09.854 INFO:teuthology.orchestra.run.smithi150.stdout:} 2024-09-17T05:54:09.855 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:09.853+0000 7fd33a084640 1 -- 172.21.15.150:0/847334276 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fd32007b1d0 msgr2=0x7fd32007d6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:54:09.856 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:09.853+0000 7fd33a084640 1 --2- 172.21.15.150:0/847334276 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fd32007b1d0 0x7fd32007d6e0 secure :-1 s=READY pgs=820 cs=0 l=1 rev1=1 crypto rx=0x7fd3240046b0 tx=0x7fd324007eb0 comp rx=0 tx=0).stop 2024-09-17T05:54:09.856 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:09.853+0000 7fd33a084640 1 -- 172.21.15.150:0/847334276 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd3340b5980 msgr2=0x7fd3340c7c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:54:09.856 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:09.853+0000 7fd33a084640 1 --2- 172.21.15.150:0/847334276 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd3340b5980 0x7fd3340c7c20 secure :-1 s=READY pgs=1936 cs=0 l=1 rev1=1 crypto rx=0x7fd32800d6d0 tx=0x7fd32800db90 comp rx=0 tx=0).stop 2024-09-17T05:54:09.856 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:09.854+0000 7fd33a084640 1 -- 172.21.15.150:0/847334276 shutdown_connections 2024-09-17T05:54:09.856 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:09.854+0000 7fd33a084640 1 --2- 172.21.15.150:0/847334276 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fd32007b1d0 0x7fd32007d6e0 unknown :-1 s=CLOSED pgs=820 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:54:09.856 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:09.854+0000 7fd33a084640 1 --2- 172.21.15.150:0/847334276 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd3340ce800 0x7fd3340c8160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:54:09.856 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:09.854+0000 7fd33a084640 1 --2- 172.21.15.150:0/847334276 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd3340b5980 0x7fd3340c7c20 unknown :-1 s=CLOSED pgs=1936 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:54:09.856 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:09.854+0000 7fd33a084640 1 --2- 172.21.15.150:0/847334276 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd33409b160 0x7fd3341d27b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:54:09.856 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:09.854+0000 7fd33a084640 1 -- 172.21.15.150:0/847334276 >> 172.21.15.150:0/847334276 conn(0x7fd3340d2550 msgr2=0x7fd3340cbaa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:54:09.856 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:09.854+0000 7fd33a084640 1 -- 172.21.15.150:0/847334276 shutdown_connections 2024-09-17T05:54:09.856 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:09.854+0000 7fd33a084640 1 -- 172.21.15.150:0/847334276 wait complete. 2024-09-17T05:54:09.869 DEBUG:tasks.cephfs.test_volumes:current clone state = canceled 2024-09-17T05:54:09.870 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs clone status cephfs subvol_clone78074 2024-09-17T05:54:09.994 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:09.992+0000 7f859c3c3640 1 -- 172.21.15.150:0/3449450025 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f85940b7960 msgr2=0x7f85940af1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:54:09.994 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:09.992+0000 7f859c3c3640 1 --2- 172.21.15.150:0/3449450025 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f85940b7960 0x7f85940af1f0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f85900098e0 tx=0x7f859002a4a0 comp rx=0 tx=0).stop 2024-09-17T05:54:09.994 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:09.992+0000 7f859c3c3640 1 -- 172.21.15.150:0/3449450025 shutdown_connections 2024-09-17T05:54:09.995 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:09.992+0000 7f859c3c3640 1 --2- 172.21.15.150:0/3449450025 >> v2:172.21.15.176:3300/0 conn(0x7f85940d1190 0x7f85940cd0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:54:09.995 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:09.992+0000 7f859c3c3640 1 --2- 172.21.15.150:0/3449450025 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f85940b7960 0x7f85940af1f0 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:54:09.995 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:09.992+0000 7f859c3c3640 1 -- 172.21.15.150:0/3449450025 >> 172.21.15.150:0/3449450025 conn(0x7f85940cef20 msgr2=0x7f85940cf330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:54:09.995 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:09.992+0000 7f859c3c3640 1 -- 172.21.15.150:0/3449450025 shutdown_connections 2024-09-17T05:54:09.995 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:09.992+0000 7f859c3c3640 1 -- 172.21.15.150:0/3449450025 wait complete. 2024-09-17T05:54:09.995 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:09.994+0000 7f859c3c3640 1 Processor -- start 2024-09-17T05:54:09.995 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:09.994+0000 7f859c3c3640 1 -- start start 2024-09-17T05:54:09.997 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:09.995+0000 7f859c3c3640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f85940b7960 0x7f8594150a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:54:09.998 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:09.995+0000 7f859c3c3640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f85940b7d70 0x7f85941e7f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:54:09.998 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:09.995+0000 7f859c3c3640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f85940d1190 0x7f85941e8460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:54:09.998 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:09.995+0000 7f859c3c3640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f85940ced10 con 0x7f85940b7d70 2024-09-17T05:54:09.998 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:09.995+0000 7f859c3c3640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f85940ceb90 con 0x7f85940d1190 2024-09-17T05:54:09.998 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:09.995+0000 7f859c3c3640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f85940af730 con 0x7f85940b7960 2024-09-17T05:54:09.998 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:09.995+0000 7f859995e640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f85940b7d70 0x7f85941e7f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:54:09.998 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:09.995+0000 7f859995e640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f85940b7d70 0x7f85941e7f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:54092/0 (socket says 172.21.15.150:54092) 2024-09-17T05:54:09.998 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:09.995+0000 7f859995e640 1 -- 172.21.15.150:0/4251453267 learned_addr learned my addr 172.21.15.150:0/4251453267 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:54:10.000 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:09.995+0000 7f859a15f640 1 --2- 172.21.15.150:0/4251453267 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f85940b7960 0x7f8594150a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:54:10.000 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:09.995+0000 7f859a960640 1 --2- 172.21.15.150:0/4251453267 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f85940d1190 0x7f85941e8460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:54:10.001 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:09.996+0000 7f859995e640 1 -- 172.21.15.150:0/4251453267 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f85940b7960 msgr2=0x7f8594150a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:54:10.001 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:09.996+0000 7f859995e640 1 --2- 172.21.15.150:0/4251453267 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f85940b7960 0x7f8594150a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:54:10.001 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:09.996+0000 7f859995e640 1 -- 172.21.15.150:0/4251453267 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f85940d1190 msgr2=0x7f85941e8460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:54:10.001 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:09.996+0000 7f859995e640 1 --2- 172.21.15.150:0/4251453267 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f85940d1190 0x7f85941e8460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:54:10.002 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:09.996+0000 7f859995e640 1 -- 172.21.15.150:0/4251453267 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f859415bd90 con 0x7f85940b7d70 2024-09-17T05:54:10.002 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:09.996+0000 7f859995e640 1 --2- 172.21.15.150:0/4251453267 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f85940b7d70 0x7f85941e7f20 secure :-1 s=READY pgs=1937 cs=0 l=1 rev1=1 crypto rx=0x7f858400c370 tx=0x7f858400c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:54:10.002 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:09.996+0000 7f858affd640 1 -- 172.21.15.150:0/4251453267 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8584017070 con 0x7f85940b7d70 2024-09-17T05:54:10.002 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:09.996+0000 7f859c3c3640 1 -- 172.21.15.150:0/4251453267 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f859415c050 con 0x7f85940b7d70 2024-09-17T05:54:10.002 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:09.996+0000 7f858affd640 1 -- 172.21.15.150:0/4251453267 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f85840053c0 con 0x7f85940b7d70 2024-09-17T05:54:10.002 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:09.996+0000 7f858affd640 1 -- 172.21.15.150:0/4251453267 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8584003850 con 0x7f85940b7d70 2024-09-17T05:54:10.002 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:09.996+0000 7f859c3c3640 1 -- 172.21.15.150:0/4251453267 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f859415c610 con 0x7f85940b7d70 2024-09-17T05:54:10.002 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:09.997+0000 7f859c3c3640 1 -- 172.21.15.150:0/4251453267 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f85940af1f0 con 0x7f85940b7d70 2024-09-17T05:54:10.002 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:09.998+0000 7f858affd640 1 -- 172.21.15.150:0/4251453267 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 50) ==== 104909+0+0 (secure 0 0 0) 0x7f858401a070 con 0x7f85940b7d70 2024-09-17T05:54:10.002 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:09.999+0000 7f858affd640 1 --2- 172.21.15.150:0/4251453267 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f857807b200 0x7f857807d710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:54:10.002 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:09.999+0000 7f858affd640 1 -- 172.21.15.150:0/4251453267 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(143..143 src has 1..143) ==== 5934+0+0 (secure 0 0 0) 0x7f85840991e0 con 0x7f85940b7d70 2024-09-17T05:54:10.002 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:09.999+0000 7f859a15f640 1 --2- 172.21.15.150:0/4251453267 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f857807b200 0x7f857807d710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:54:10.002 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:10.000+0000 7f859a15f640 1 --2- 172.21.15.150:0/4251453267 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f857807b200 0x7f857807d710 secure :-1 s=READY pgs=821 cs=0 l=1 rev1=1 crypto rx=0x7f8590034000 tx=0x7f8590004730 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:54:10.005 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:10.003+0000 7f858affd640 1 -- 172.21.15.150:0/4251453267 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f8584062ae0 con 0x7f85940b7d70 2024-09-17T05:54:10.214 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:10.212+0000 7f859c3c3640 1 -- 172.21.15.150:0/4251453267 --> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] -- mgr_command(tid 0: {"prefix": "fs clone status", "vol_name": "cephfs", "clone_name": "subvol_clone78074", "target": ["mon-mgr", ""]}) -- 0x7f85940b38f0 con 0x7f857807b200 2024-09-17T05:54:14.849 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:14.848+0000 7f858affd640 1 -- 172.21.15.150:0/4251453267 <== mgr.4108 v2:172.21.15.176:6800/3631216395 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+243 (secure 0 0 0) 0x7f85940b38f0 con 0x7f857807b200 2024-09-17T05:54:14.850 INFO:teuthology.orchestra.run.smithi150.stdout:{ 2024-09-17T05:54:14.850 INFO:teuthology.orchestra.run.smithi150.stdout: "status": { 2024-09-17T05:54:14.850 INFO:teuthology.orchestra.run.smithi150.stdout: "state": "canceled", 2024-09-17T05:54:14.850 INFO:teuthology.orchestra.run.smithi150.stdout: "source": { 2024-09-17T05:54:14.850 INFO:teuthology.orchestra.run.smithi150.stdout: "volume": "cephfs", 2024-09-17T05:54:14.850 INFO:teuthology.orchestra.run.smithi150.stdout: "subvolume": "sv1", 2024-09-17T05:54:14.850 INFO:teuthology.orchestra.run.smithi150.stdout: "snapshot": "ss1" 2024-09-17T05:54:14.850 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-17T05:54:14.851 INFO:teuthology.orchestra.run.smithi150.stdout: "failure": { 2024-09-17T05:54:14.851 INFO:teuthology.orchestra.run.smithi150.stdout: "errno": "4", 2024-09-17T05:54:14.851 INFO:teuthology.orchestra.run.smithi150.stdout: "error_msg": "user interrupted clone operation" 2024-09-17T05:54:14.851 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-09-17T05:54:14.851 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-09-17T05:54:14.851 INFO:teuthology.orchestra.run.smithi150.stdout:} 2024-09-17T05:54:14.853 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:14.851+0000 7f859c3c3640 1 -- 172.21.15.150:0/4251453267 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f857807b200 msgr2=0x7f857807d710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:54:14.853 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:14.851+0000 7f859c3c3640 1 --2- 172.21.15.150:0/4251453267 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f857807b200 0x7f857807d710 secure :-1 s=READY pgs=821 cs=0 l=1 rev1=1 crypto rx=0x7f8590034000 tx=0x7f8590004730 comp rx=0 tx=0).stop 2024-09-17T05:54:14.853 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:14.851+0000 7f859c3c3640 1 -- 172.21.15.150:0/4251453267 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f85940b7d70 msgr2=0x7f85941e7f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:54:14.853 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:14.851+0000 7f859c3c3640 1 --2- 172.21.15.150:0/4251453267 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f85940b7d70 0x7f85941e7f20 secure :-1 s=READY pgs=1937 cs=0 l=1 rev1=1 crypto rx=0x7f858400c370 tx=0x7f858400c830 comp rx=0 tx=0).stop 2024-09-17T05:54:14.853 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:14.851+0000 7f859c3c3640 1 -- 172.21.15.150:0/4251453267 shutdown_connections 2024-09-17T05:54:14.854 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:14.851+0000 7f859c3c3640 1 --2- 172.21.15.150:0/4251453267 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f85940d1190 0x7f85941e8460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:54:14.854 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:14.851+0000 7f859c3c3640 1 --2- 172.21.15.150:0/4251453267 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f857807b200 0x7f857807d710 unknown :-1 s=CLOSED pgs=821 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:54:14.854 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:14.851+0000 7f859c3c3640 1 --2- 172.21.15.150:0/4251453267 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f85940b7d70 0x7f85941e7f20 unknown :-1 s=CLOSED pgs=1937 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:54:14.854 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:14.851+0000 7f859c3c3640 1 --2- 172.21.15.150:0/4251453267 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f85940b7960 0x7f8594150a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:54:14.854 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:14.851+0000 7f859c3c3640 1 -- 172.21.15.150:0/4251453267 >> 172.21.15.150:0/4251453267 conn(0x7f85940cef20 msgr2=0x7f85940ce2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:54:14.854 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:14.851+0000 7f859c3c3640 1 -- 172.21.15.150:0/4251453267 shutdown_connections 2024-09-17T05:54:14.854 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:14.851+0000 7f859c3c3640 1 -- 172.21.15.150:0/4251453267 wait complete. 2024-09-17T05:54:14.867 DEBUG:tasks.cephfs.test_volumes:current clone state = canceled 2024-09-17T05:54:14.867 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs clone status cephfs subvol_clone58715 2024-09-17T05:54:14.991 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:14.989+0000 7f263c15f640 1 -- 172.21.15.150:0/2455183838 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2620003a00 msgr2=0x7f2620003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:54:14.991 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:14.989+0000 7f263c15f640 1 --2- 172.21.15.150:0/2455183838 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2620003a00 0x7f2620003e70 secure :-1 s=READY pgs=1939 cs=0 l=1 rev1=1 crypto rx=0x7f263000c4a0 tx=0x7f2620005830 comp rx=0 tx=0).stop 2024-09-17T05:54:14.991 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:14.989+0000 7f263a6fc640 1 -- 172.21.15.150:0/2455183838 reap_dead start 2024-09-17T05:54:14.991 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:14.989+0000 7f263c15f640 1 -- 172.21.15.150:0/2455183838 shutdown_connections 2024-09-17T05:54:14.991 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:14.989+0000 7f263c15f640 1 -- 172.21.15.150:0/2455183838 >> 172.21.15.150:0/2455183838 conn(0x7f263406d1c0 msgr2=0x7f263406d5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:54:14.991 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:14.989+0000 7f263c15f640 1 -- 172.21.15.150:0/2455183838 shutdown_connections 2024-09-17T05:54:14.991 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:14.989+0000 7f263c15f640 1 -- 172.21.15.150:0/2455183838 wait complete. 2024-09-17T05:54:14.992 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:14.991+0000 7f263c15f640 1 Processor -- start 2024-09-17T05:54:14.992 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:14.991+0000 7f263c15f640 1 -- start start 2024-09-17T05:54:14.995 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:14.992+0000 7f263c15f640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2620003a00 0x7f263415fef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:54:14.995 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:14.992+0000 7f263c15f640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2634159f10 0x7f263415cf60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:54:14.995 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:14.992+0000 7f263c15f640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f263415a320 0x7f2634139580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:54:14.995 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:14.992+0000 7f263c15f640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f26340cdbd0 con 0x7f2620003a00 2024-09-17T05:54:14.995 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:14.992+0000 7f263c15f640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f26340cda50 con 0x7f263415a320 2024-09-17T05:54:14.995 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:14.992+0000 7f263c15f640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f26340cdd50 con 0x7f2634159f10 2024-09-17T05:54:14.995 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:14.992+0000 7f2639efb640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2620003a00 0x7f263415fef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:54:14.996 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:14.992+0000 7f2639efb640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2620003a00 0x7f263415fef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:42936/0 (socket says 172.21.15.150:42936) 2024-09-17T05:54:14.996 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:14.992+0000 7f2639efb640 1 -- 172.21.15.150:0/1488662073 learned_addr learned my addr 172.21.15.150:0/1488662073 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:54:14.996 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:14.992+0000 7f26396fa640 1 --2- 172.21.15.150:0/1488662073 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2634159f10 0x7f263415cf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:54:14.996 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:14.992+0000 7f263a6fc640 1 --2- 172.21.15.150:0/1488662073 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f263415a320 0x7f2634139580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:54:14.996 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:14.993+0000 7f2639efb640 1 -- 172.21.15.150:0/1488662073 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2634159f10 msgr2=0x7f263415cf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:54:14.996 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:14.993+0000 7f2639efb640 1 --2- 172.21.15.150:0/1488662073 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2634159f10 0x7f263415cf60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:54:14.996 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:14.993+0000 7f2639efb640 1 -- 172.21.15.150:0/1488662073 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f263415a320 msgr2=0x7f2634139580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:54:14.996 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:14.993+0000 7f2639efb640 1 --2- 172.21.15.150:0/1488662073 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f263415a320 0x7f2634139580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:54:14.996 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:14.993+0000 7f2639efb640 1 -- 172.21.15.150:0/1488662073 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f263415ee50 con 0x7f2620003a00 2024-09-17T05:54:14.996 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:14.993+0000 7f263a6fc640 1 --2- 172.21.15.150:0/1488662073 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f263415a320 0x7f2634139580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T05:54:14.996 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:14.993+0000 7f26396fa640 1 --2- 172.21.15.150:0/1488662073 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2634159f10 0x7f263415cf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T05:54:14.996 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:14.993+0000 7f2639efb640 1 --2- 172.21.15.150:0/1488662073 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2620003a00 0x7f263415fef0 secure :-1 s=READY pgs=1940 cs=0 l=1 rev1=1 crypto rx=0x7f263000c5c0 tx=0x7f2630006060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:54:14.996 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:14.993+0000 7f262a7fc640 1 -- 172.21.15.150:0/1488662073 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2630042070 con 0x7f2620003a00 2024-09-17T05:54:14.996 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:14.993+0000 7f262a7fc640 1 -- 172.21.15.150:0/1488662073 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f263002b6d0 con 0x7f2620003a00 2024-09-17T05:54:14.997 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:14.993+0000 7f263c15f640 1 -- 172.21.15.150:0/1488662073 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f263415f130 con 0x7f2620003a00 2024-09-17T05:54:14.997 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:14.993+0000 7f262a7fc640 1 -- 172.21.15.150:0/1488662073 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2630039070 con 0x7f2620003a00 2024-09-17T05:54:14.997 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:14.993+0000 7f263c15f640 1 -- 172.21.15.150:0/1488662073 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f263415f6f0 con 0x7f2620003a00 2024-09-17T05:54:14.998 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:14.994+0000 7f263c15f640 1 -- 172.21.15.150:0/1488662073 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2634073540 con 0x7f2620003a00 2024-09-17T05:54:14.998 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:14.995+0000 7f262a7fc640 1 -- 172.21.15.150:0/1488662073 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 50) ==== 104909+0+0 (secure 0 0 0) 0x7f2630045070 con 0x7f2620003a00 2024-09-17T05:54:14.998 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:14.995+0000 7f262a7fc640 1 --2- 172.21.15.150:0/1488662073 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f261807b1d0 0x7f261807d6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:54:14.998 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:14.995+0000 7f262a7fc640 1 -- 172.21.15.150:0/1488662073 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(143..143 src has 1..143) ==== 5934+0+0 (secure 0 0 0) 0x7f26300b9a10 con 0x7f2620003a00 2024-09-17T05:54:14.998 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:14.996+0000 7f26396fa640 1 --2- 172.21.15.150:0/1488662073 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f261807b1d0 0x7f261807d6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:54:14.998 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:14.996+0000 7f26396fa640 1 --2- 172.21.15.150:0/1488662073 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f261807b1d0 0x7f261807d6e0 secure :-1 s=READY pgs=822 cs=0 l=1 rev1=1 crypto rx=0x7f2624005eb0 tx=0x7f2624005f90 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:54:15.001 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:15.000+0000 7f262a7fc640 1 -- 172.21.15.150:0/1488662073 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f2634073e90 con 0x7f2620003a00 2024-09-17T05:54:15.213 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:15.211+0000 7f263c15f640 1 -- 172.21.15.150:0/1488662073 --> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] -- mgr_command(tid 0: {"prefix": "fs clone status", "vol_name": "cephfs", "clone_name": "subvol_clone58715", "target": ["mon-mgr", ""]}) -- 0x7f2634144a50 con 0x7f261807b1d0 2024-09-17T05:54:15.224 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:15.222+0000 7f262a7fc640 1 -- 172.21.15.150:0/1488662073 <== mgr.4108 v2:172.21.15.176:6800/3631216395 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+243 (secure 0 0 0) 0x7f2634144a50 con 0x7f261807b1d0 2024-09-17T05:54:15.225 INFO:teuthology.orchestra.run.smithi150.stdout:{ 2024-09-17T05:54:15.225 INFO:teuthology.orchestra.run.smithi150.stdout: "status": { 2024-09-17T05:54:15.225 INFO:teuthology.orchestra.run.smithi150.stdout: "state": "canceled", 2024-09-17T05:54:15.225 INFO:teuthology.orchestra.run.smithi150.stdout: "source": { 2024-09-17T05:54:15.225 INFO:teuthology.orchestra.run.smithi150.stdout: "volume": "cephfs", 2024-09-17T05:54:15.225 INFO:teuthology.orchestra.run.smithi150.stdout: "subvolume": "sv1", 2024-09-17T05:54:15.225 INFO:teuthology.orchestra.run.smithi150.stdout: "snapshot": "ss1" 2024-09-17T05:54:15.225 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-17T05:54:15.225 INFO:teuthology.orchestra.run.smithi150.stdout: "failure": { 2024-09-17T05:54:15.225 INFO:teuthology.orchestra.run.smithi150.stdout: "errno": "4", 2024-09-17T05:54:15.225 INFO:teuthology.orchestra.run.smithi150.stdout: "error_msg": "user interrupted clone operation" 2024-09-17T05:54:15.225 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-09-17T05:54:15.225 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-09-17T05:54:15.226 INFO:teuthology.orchestra.run.smithi150.stdout:} 2024-09-17T05:54:15.227 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:15.224+0000 7f263c15f640 1 -- 172.21.15.150:0/1488662073 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f261807b1d0 msgr2=0x7f261807d6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:54:15.227 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:15.224+0000 7f263c15f640 1 --2- 172.21.15.150:0/1488662073 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f261807b1d0 0x7f261807d6e0 secure :-1 s=READY pgs=822 cs=0 l=1 rev1=1 crypto rx=0x7f2624005eb0 tx=0x7f2624005f90 comp rx=0 tx=0).stop 2024-09-17T05:54:15.227 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:15.224+0000 7f263c15f640 1 -- 172.21.15.150:0/1488662073 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2620003a00 msgr2=0x7f263415fef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:54:15.227 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:15.224+0000 7f263c15f640 1 --2- 172.21.15.150:0/1488662073 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2620003a00 0x7f263415fef0 secure :-1 s=READY pgs=1940 cs=0 l=1 rev1=1 crypto rx=0x7f263000c5c0 tx=0x7f2630006060 comp rx=0 tx=0).stop 2024-09-17T05:54:15.227 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:15.224+0000 7f263c15f640 1 -- 172.21.15.150:0/1488662073 shutdown_connections 2024-09-17T05:54:15.227 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:15.224+0000 7f263c15f640 1 --2- 172.21.15.150:0/1488662073 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f263415a320 0x7f2634139580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:54:15.227 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:15.224+0000 7f263c15f640 1 --2- 172.21.15.150:0/1488662073 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f261807b1d0 0x7f261807d6e0 unknown :-1 s=CLOSED pgs=822 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:54:15.227 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:15.224+0000 7f263c15f640 1 --2- 172.21.15.150:0/1488662073 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2634159f10 0x7f263415cf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:54:15.227 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:15.224+0000 7f263c15f640 1 --2- 172.21.15.150:0/1488662073 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2620003a00 0x7f263415fef0 unknown :-1 s=CLOSED pgs=1940 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:54:15.227 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:15.224+0000 7f263c15f640 1 -- 172.21.15.150:0/1488662073 >> 172.21.15.150:0/1488662073 conn(0x7f263406d1c0 msgr2=0x7f26340b0c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:54:15.227 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:15.224+0000 7f263c15f640 1 -- 172.21.15.150:0/1488662073 shutdown_connections 2024-09-17T05:54:15.227 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:15.224+0000 7f263c15f640 1 -- 172.21.15.150:0/1488662073 wait complete. 2024-09-17T05:54:15.238 DEBUG:tasks.cephfs.test_volumes:current clone state = canceled 2024-09-17T05:54:15.239 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs clone status cephfs subvol_clone65316 2024-09-17T05:54:15.355 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:15.353+0000 7fe001bba640 1 -- 172.21.15.150:0/1473787697 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fdffc0b6450 msgr2=0x7fdffc0cd3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:54:15.355 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:15.353+0000 7fe001bba640 1 --2- 172.21.15.150:0/1473787697 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fdffc0b6450 0x7fdffc0cd3f0 secure :-1 s=READY pgs=1942 cs=0 l=1 rev1=1 crypto rx=0x7fdff4005fd0 tx=0x7fdff402a820 comp rx=0 tx=0).stop 2024-09-17T05:54:15.355 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:15.353+0000 7fe001bba640 1 -- 172.21.15.150:0/1473787697 shutdown_connections 2024-09-17T05:54:15.355 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:15.353+0000 7fe001bba640 1 --2- 172.21.15.150:0/1473787697 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fdffc0b6450 0x7fdffc0cd3f0 unknown :-1 s=CLOSED pgs=1942 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:54:15.356 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:15.353+0000 7fe001bba640 1 --2- 172.21.15.150:0/1473787697 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fdffc0ce800 0x7fdffc09aa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:54:15.356 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:15.353+0000 7fe001bba640 1 -- 172.21.15.150:0/1473787697 >> 172.21.15.150:0/1473787697 conn(0x7fdffc0d2550 msgr2=0x7fdffc0d2960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:54:15.356 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:15.353+0000 7fe001bba640 1 -- 172.21.15.150:0/1473787697 shutdown_connections 2024-09-17T05:54:15.356 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:15.353+0000 7fe001bba640 1 -- 172.21.15.150:0/1473787697 wait complete. 2024-09-17T05:54:15.356 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:15.355+0000 7fe001bba640 1 Processor -- start 2024-09-17T05:54:15.357 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:15.355+0000 7fe001bba640 1 -- start start 2024-09-17T05:54:15.360 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:15.356+0000 7fe001bba640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fdffc09af90 0x7fdffc1f66d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:54:15.360 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:15.356+0000 7fe001bba640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fdffc0b6450 0x7fdffc0c6080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:54:15.360 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:15.356+0000 7fe001bba640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fdffc0ce800 0x7fdffc0c52e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:54:15.360 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:15.356+0000 7fe001bba640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7fdffc0b75e0 con 0x7fdffc0b6450 2024-09-17T05:54:15.360 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:15.356+0000 7fe001bba640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fdffc0cee20 con 0x7fdffc09af90 2024-09-17T05:54:15.360 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:15.356+0000 7fe001bba640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fdffc0cd930 con 0x7fdffc0ce800 2024-09-17T05:54:15.360 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:15.357+0000 7fdffaffd640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fdffc0b6450 0x7fdffc0c6080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:54:15.361 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:15.357+0000 7fdffaffd640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fdffc0b6450 0x7fdffc0c6080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:42952/0 (socket says 172.21.15.150:42952) 2024-09-17T05:54:15.361 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:15.357+0000 7fdffaffd640 1 -- 172.21.15.150:0/1149034193 learned_addr learned my addr 172.21.15.150:0/1149034193 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:54:15.361 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:15.357+0000 7fdffb7fe640 1 --2- 172.21.15.150:0/1149034193 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fdffc09af90 0x7fdffc1f66d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:54:15.361 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:15.357+0000 7fdffbfff640 1 --2- 172.21.15.150:0/1149034193 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fdffc0ce800 0x7fdffc0c52e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:54:15.361 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:15.357+0000 7fdffaffd640 1 -- 172.21.15.150:0/1149034193 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fdffc0ce800 msgr2=0x7fdffc0c52e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:54:15.361 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:15.357+0000 7fdffaffd640 1 --2- 172.21.15.150:0/1149034193 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fdffc0ce800 0x7fdffc0c52e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:54:15.361 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:15.357+0000 7fdffaffd640 1 -- 172.21.15.150:0/1149034193 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fdffc09af90 msgr2=0x7fdffc1f66d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:54:15.361 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:15.357+0000 7fdffaffd640 1 --2- 172.21.15.150:0/1149034193 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fdffc09af90 0x7fdffc1f66d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:54:15.361 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:15.357+0000 7fdffaffd640 1 -- 172.21.15.150:0/1149034193 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdffc0c65c0 con 0x7fdffc0b6450 2024-09-17T05:54:15.361 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:15.357+0000 7fdffaffd640 1 --2- 172.21.15.150:0/1149034193 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fdffc0b6450 0x7fdffc0c6080 secure :-1 s=READY pgs=1943 cs=0 l=1 rev1=1 crypto rx=0x7fdff000c390 tx=0x7fdff000c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:54:15.362 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:15.357+0000 7fdfe3fff640 1 -- 172.21.15.150:0/1149034193 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdff0017070 con 0x7fdffc0b6450 2024-09-17T05:54:15.362 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:15.357+0000 7fdfe3fff640 1 -- 172.21.15.150:0/1149034193 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fdff00035f0 con 0x7fdffc0b6450 2024-09-17T05:54:15.362 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:15.357+0000 7fe001bba640 1 -- 172.21.15.150:0/1149034193 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdffc1e68b0 con 0x7fdffc0b6450 2024-09-17T05:54:15.362 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:15.357+0000 7fdfe3fff640 1 -- 172.21.15.150:0/1149034193 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdff0003a20 con 0x7fdffc0b6450 2024-09-17T05:54:15.362 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:15.357+0000 7fe001bba640 1 -- 172.21.15.150:0/1149034193 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdffc1e6e70 con 0x7fdffc0b6450 2024-09-17T05:54:15.362 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:15.358+0000 7fe001bba640 1 -- 172.21.15.150:0/1149034193 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdffc09aa50 con 0x7fdffc0b6450 2024-09-17T05:54:15.363 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:15.359+0000 7fdfe3fff640 1 -- 172.21.15.150:0/1149034193 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 50) ==== 104909+0+0 (secure 0 0 0) 0x7fdff001a070 con 0x7fdffc0b6450 2024-09-17T05:54:15.363 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:15.360+0000 7fdfe3fff640 1 --2- 172.21.15.150:0/1149034193 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fdfe807b1d0 0x7fdfe807d6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:54:15.363 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:15.360+0000 7fdfe3fff640 1 -- 172.21.15.150:0/1149034193 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(143..143 src has 1..143) ==== 5934+0+0 (secure 0 0 0) 0x7fdff0099220 con 0x7fdffc0b6450 2024-09-17T05:54:15.363 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:15.360+0000 7fdffb7fe640 1 --2- 172.21.15.150:0/1149034193 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fdfe807b1d0 0x7fdfe807d6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:54:15.363 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:15.360+0000 7fdffb7fe640 1 --2- 172.21.15.150:0/1149034193 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fdfe807b1d0 0x7fdfe807d6e0 secure :-1 s=READY pgs=823 cs=0 l=1 rev1=1 crypto rx=0x7fdfec005fd0 tx=0x7fdfec005850 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:54:15.366 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:15.364+0000 7fdfe3fff640 1 -- 172.21.15.150:0/1149034193 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fdff00631f0 con 0x7fdffc0b6450 2024-09-17T05:54:15.577 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:15.576+0000 7fe001bba640 1 -- 172.21.15.150:0/1149034193 --> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] -- mgr_command(tid 0: {"prefix": "fs clone status", "vol_name": "cephfs", "clone_name": "subvol_clone65316", "target": ["mon-mgr", ""]}) -- 0x7fdffc0d04e0 con 0x7fdfe807b1d0 2024-09-17T05:54:15.588 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:15.587+0000 7fdfe3fff640 1 -- 172.21.15.150:0/1149034193 <== mgr.4108 v2:172.21.15.176:6800/3631216395 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+243 (secure 0 0 0) 0x7fdffc0d04e0 con 0x7fdfe807b1d0 2024-09-17T05:54:15.589 INFO:teuthology.orchestra.run.smithi150.stdout:{ 2024-09-17T05:54:15.589 INFO:teuthology.orchestra.run.smithi150.stdout: "status": { 2024-09-17T05:54:15.589 INFO:teuthology.orchestra.run.smithi150.stdout: "state": "canceled", 2024-09-17T05:54:15.589 INFO:teuthology.orchestra.run.smithi150.stdout: "source": { 2024-09-17T05:54:15.589 INFO:teuthology.orchestra.run.smithi150.stdout: "volume": "cephfs", 2024-09-17T05:54:15.589 INFO:teuthology.orchestra.run.smithi150.stdout: "subvolume": "sv1", 2024-09-17T05:54:15.589 INFO:teuthology.orchestra.run.smithi150.stdout: "snapshot": "ss1" 2024-09-17T05:54:15.589 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-17T05:54:15.589 INFO:teuthology.orchestra.run.smithi150.stdout: "failure": { 2024-09-17T05:54:15.589 INFO:teuthology.orchestra.run.smithi150.stdout: "errno": "4", 2024-09-17T05:54:15.589 INFO:teuthology.orchestra.run.smithi150.stdout: "error_msg": "user interrupted clone operation" 2024-09-17T05:54:15.590 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-09-17T05:54:15.590 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-09-17T05:54:15.590 INFO:teuthology.orchestra.run.smithi150.stdout:} 2024-09-17T05:54:15.591 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:15.589+0000 7fe001bba640 1 -- 172.21.15.150:0/1149034193 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fdfe807b1d0 msgr2=0x7fdfe807d6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:54:15.591 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:15.589+0000 7fe001bba640 1 --2- 172.21.15.150:0/1149034193 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fdfe807b1d0 0x7fdfe807d6e0 secure :-1 s=READY pgs=823 cs=0 l=1 rev1=1 crypto rx=0x7fdfec005fd0 tx=0x7fdfec005850 comp rx=0 tx=0).stop 2024-09-17T05:54:15.591 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:15.589+0000 7fe001bba640 1 -- 172.21.15.150:0/1149034193 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fdffc0b6450 msgr2=0x7fdffc0c6080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:54:15.591 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:15.589+0000 7fe001bba640 1 --2- 172.21.15.150:0/1149034193 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fdffc0b6450 0x7fdffc0c6080 secure :-1 s=READY pgs=1943 cs=0 l=1 rev1=1 crypto rx=0x7fdff000c390 tx=0x7fdff000c850 comp rx=0 tx=0).stop 2024-09-17T05:54:15.592 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:15.589+0000 7fe001bba640 1 -- 172.21.15.150:0/1149034193 shutdown_connections 2024-09-17T05:54:15.592 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:15.589+0000 7fe001bba640 1 --2- 172.21.15.150:0/1149034193 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fdfe807b1d0 0x7fdfe807d6e0 unknown :-1 s=CLOSED pgs=823 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:54:15.592 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:15.589+0000 7fe001bba640 1 --2- 172.21.15.150:0/1149034193 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fdffc0ce800 0x7fdffc0c52e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:54:15.592 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:15.589+0000 7fe001bba640 1 --2- 172.21.15.150:0/1149034193 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fdffc0b6450 0x7fdffc0c6080 unknown :-1 s=CLOSED pgs=1943 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:54:15.592 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:15.589+0000 7fe001bba640 1 --2- 172.21.15.150:0/1149034193 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fdffc09af90 0x7fdffc1f66d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:54:15.592 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:15.589+0000 7fe001bba640 1 -- 172.21.15.150:0/1149034193 >> 172.21.15.150:0/1149034193 conn(0x7fdffc0d2550 msgr2=0x7fdffc1e5f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:54:15.592 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:15.589+0000 7fe001bba640 1 -- 172.21.15.150:0/1149034193 shutdown_connections 2024-09-17T05:54:15.592 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:15.589+0000 7fe001bba640 1 -- 172.21.15.150:0/1149034193 wait complete. 2024-09-17T05:54:15.603 DEBUG:tasks.cephfs.test_volumes:current clone state = canceled 2024-09-17T05:54:15.604 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format json-pretty 2024-09-17T05:54:15.717 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:15.714+0000 7efead28b640 1 -- 172.21.15.150:0/3098385297 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7efea80d2780 msgr2=0x7efea80d4f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:54:15.717 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:15.714+0000 7efead28b640 1 --2- 172.21.15.150:0/3098385297 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7efea80d2780 0x7efea80d4f90 secure :-1 s=READY pgs=1945 cs=0 l=1 rev1=1 crypto rx=0x7efea0005fd0 tx=0x7efea002aa90 comp rx=0 tx=0).stop 2024-09-17T05:54:15.717 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:15.714+0000 7efead28b640 1 -- 172.21.15.150:0/3098385297 shutdown_connections 2024-09-17T05:54:15.717 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:15.714+0000 7efead28b640 1 --2- 172.21.15.150:0/3098385297 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7efea80d2780 0x7efea80d4f90 unknown :-1 s=CLOSED pgs=1945 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:54:15.718 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:15.714+0000 7efead28b640 1 -- 172.21.15.150:0/3098385297 >> 172.21.15.150:0/3098385297 conn(0x7efea808bfe0 msgr2=0x7efea80d4670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:54:15.718 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:15.715+0000 7efead28b640 1 -- 172.21.15.150:0/3098385297 shutdown_connections 2024-09-17T05:54:15.718 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:15.715+0000 7efead28b640 1 -- 172.21.15.150:0/3098385297 wait complete. 2024-09-17T05:54:15.718 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:15.716+0000 7efead28b640 1 Processor -- start 2024-09-17T05:54:15.718 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:15.716+0000 7efead28b640 1 -- start start 2024-09-17T05:54:15.721 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:15.717+0000 7efead28b640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7efea80b5d50 0x7efea8154a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:54:15.721 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:15.717+0000 7efead28b640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7efea80d2780 0x7efea815a790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:54:15.721 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:15.718+0000 7efead28b640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7efea809e3a0 0x7efea815da00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:54:15.721 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:15.718+0000 7efead28b640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7efea80b7d50 con 0x7efea80b5d50 2024-09-17T05:54:15.721 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:15.718+0000 7efead28b640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7efea80b7bd0 con 0x7efea809e3a0 2024-09-17T05:54:15.721 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:15.718+0000 7efead28b640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7efea80b7ed0 con 0x7efea80d2780 2024-09-17T05:54:15.721 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:15.718+0000 7efea6ffd640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7efea80b5d50 0x7efea8154a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:54:15.721 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:15.718+0000 7efea6ffd640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7efea80b5d50 0x7efea8154a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:42974/0 (socket says 172.21.15.150:42974) 2024-09-17T05:54:15.722 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:15.718+0000 7efea6ffd640 1 -- 172.21.15.150:0/622681974 learned_addr learned my addr 172.21.15.150:0/622681974 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:54:15.722 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:15.718+0000 7efea77fe640 1 --2- 172.21.15.150:0/622681974 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7efea809e3a0 0x7efea815da00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:54:15.722 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:15.718+0000 7efe9ffff640 1 --2- 172.21.15.150:0/622681974 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7efea80d2780 0x7efea815a790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:54:15.722 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:15.718+0000 7efea6ffd640 1 -- 172.21.15.150:0/622681974 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7efea80d2780 msgr2=0x7efea815a790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:54:15.722 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:15.718+0000 7efea6ffd640 1 --2- 172.21.15.150:0/622681974 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7efea80d2780 0x7efea815a790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:54:15.722 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:15.718+0000 7efea6ffd640 1 -- 172.21.15.150:0/622681974 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7efea809e3a0 msgr2=0x7efea815da00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:54:15.722 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:15.718+0000 7efea6ffd640 1 --2- 172.21.15.150:0/622681974 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7efea809e3a0 0x7efea815da00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:54:15.722 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:15.718+0000 7efea6ffd640 1 -- 172.21.15.150:0/622681974 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efea815b440 con 0x7efea80b5d50 2024-09-17T05:54:15.722 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:15.718+0000 7efe9ffff640 1 --2- 172.21.15.150:0/622681974 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7efea80d2780 0x7efea815a790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T05:54:15.722 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:15.718+0000 7efea77fe640 1 --2- 172.21.15.150:0/622681974 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7efea809e3a0 0x7efea815da00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T05:54:15.722 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:15.718+0000 7efea6ffd640 1 --2- 172.21.15.150:0/622681974 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7efea80b5d50 0x7efea8154a80 secure :-1 s=READY pgs=1946 cs=0 l=1 rev1=1 crypto rx=0x7efe9800c3c0 tx=0x7efe9800c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:54:15.722 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:15.718+0000 7efe9f7fe640 1 -- 172.21.15.150:0/622681974 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe98017070 con 0x7efea80b5d50 2024-09-17T05:54:15.722 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:15.718+0000 7efe9f7fe640 1 -- 172.21.15.150:0/622681974 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7efe980035f0 con 0x7efea80b5d50 2024-09-17T05:54:15.723 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:15.718+0000 7efead28b640 1 -- 172.21.15.150:0/622681974 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efea80a1f00 con 0x7efea80b5d50 2024-09-17T05:54:15.723 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:15.718+0000 7efe9f7fe640 1 -- 172.21.15.150:0/622681974 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe98003a40 con 0x7efea80b5d50 2024-09-17T05:54:15.723 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:15.718+0000 7efead28b640 1 -- 172.21.15.150:0/622681974 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efea81593e0 con 0x7efea80b5d50 2024-09-17T05:54:15.723 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:15.719+0000 7efead28b640 1 -- 172.21.15.150:0/622681974 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efea80d4f90 con 0x7efea80b5d50 2024-09-17T05:54:15.723 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:15.720+0000 7efe9f7fe640 1 -- 172.21.15.150:0/622681974 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 50) ==== 104909+0+0 (secure 0 0 0) 0x7efe9801a070 con 0x7efea80b5d50 2024-09-17T05:54:15.724 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:15.721+0000 7efe9f7fe640 1 --2- 172.21.15.150:0/622681974 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7efe8807b200 0x7efe8807d710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:54:15.724 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:15.721+0000 7efe9f7fe640 1 -- 172.21.15.150:0/622681974 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(143..143 src has 1..143) ==== 5934+0+0 (secure 0 0 0) 0x7efe98099300 con 0x7efea80b5d50 2024-09-17T05:54:15.724 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:15.721+0000 7efe9ffff640 1 --2- 172.21.15.150:0/622681974 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7efe8807b200 0x7efe8807d710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:54:15.724 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:15.722+0000 7efe9ffff640 1 --2- 172.21.15.150:0/622681974 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7efe8807b200 0x7efe8807d710 secure :-1 s=READY pgs=824 cs=0 l=1 rev1=1 crypto rx=0x7efea80a1930 tx=0x7efe90008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:54:15.727 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:15.725+0000 7efe9f7fe640 1 -- 172.21.15.150:0/622681974 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7efe980631b0 con 0x7efea80b5d50 2024-09-17T05:54:15.969 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:15.967+0000 7efead28b640 1 -- 172.21.15.150:0/622681974 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) -- 0x7efea80d2d60 con 0x7efea80b5d50 2024-09-17T05:54:15.969 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:15.967+0000 7efe9f7fe640 1 -- 172.21.15.150:0/622681974 <== mon.0 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) ==== 79+0+2378 (secure 0 0 0) 0x7efe98062ab0 con 0x7efea80b5d50 2024-09-17T05:54:15.969 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-09-17T05:54:15.969 INFO:teuthology.orchestra.run.smithi150.stdout:{ 2024-09-17T05:54:15.969 INFO:teuthology.orchestra.run.smithi150.stdout: "fsid": "9f2e05e9-d629-47b3-b26b-1360655b7d20", 2024-09-17T05:54:15.970 INFO:teuthology.orchestra.run.smithi150.stdout: "health": { 2024-09-17T05:54:15.970 INFO:teuthology.orchestra.run.smithi150.stdout: "status": "HEALTH_OK", 2024-09-17T05:54:15.970 INFO:teuthology.orchestra.run.smithi150.stdout: "checks": {}, 2024-09-17T05:54:15.970 INFO:teuthology.orchestra.run.smithi150.stdout: "mutes": [] 2024-09-17T05:54:15.970 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-17T05:54:15.970 INFO:teuthology.orchestra.run.smithi150.stdout: "election_epoch": 4, 2024-09-17T05:54:15.970 INFO:teuthology.orchestra.run.smithi150.stdout: "quorum": [ 2024-09-17T05:54:15.970 INFO:teuthology.orchestra.run.smithi150.stdout: 0, 2024-09-17T05:54:15.970 INFO:teuthology.orchestra.run.smithi150.stdout: 1, 2024-09-17T05:54:15.970 INFO:teuthology.orchestra.run.smithi150.stdout: 2 2024-09-17T05:54:15.970 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2024-09-17T05:54:15.970 INFO:teuthology.orchestra.run.smithi150.stdout: "quorum_names": [ 2024-09-17T05:54:15.970 INFO:teuthology.orchestra.run.smithi150.stdout: "a", 2024-09-17T05:54:15.971 INFO:teuthology.orchestra.run.smithi150.stdout: "b", 2024-09-17T05:54:15.971 INFO:teuthology.orchestra.run.smithi150.stdout: "c" 2024-09-17T05:54:15.971 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2024-09-17T05:54:15.971 INFO:teuthology.orchestra.run.smithi150.stdout: "quorum_age": 763, 2024-09-17T05:54:15.971 INFO:teuthology.orchestra.run.smithi150.stdout: "monmap": { 2024-09-17T05:54:15.971 INFO:teuthology.orchestra.run.smithi150.stdout: "epoch": 1, 2024-09-17T05:54:15.971 INFO:teuthology.orchestra.run.smithi150.stdout: "min_mon_release_name": "squid", 2024-09-17T05:54:15.971 INFO:teuthology.orchestra.run.smithi150.stdout: "num_mons": 3 2024-09-17T05:54:15.971 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-17T05:54:15.971 INFO:teuthology.orchestra.run.smithi150.stdout: "osdmap": { 2024-09-17T05:54:15.971 INFO:teuthology.orchestra.run.smithi150.stdout: "epoch": 143, 2024-09-17T05:54:15.971 INFO:teuthology.orchestra.run.smithi150.stdout: "num_osds": 8, 2024-09-17T05:54:15.971 INFO:teuthology.orchestra.run.smithi150.stdout: "num_up_osds": 8, 2024-09-17T05:54:15.972 INFO:teuthology.orchestra.run.smithi150.stdout: "osd_up_since": 1726551706, 2024-09-17T05:54:15.972 INFO:teuthology.orchestra.run.smithi150.stdout: "num_in_osds": 8, 2024-09-17T05:54:15.972 INFO:teuthology.orchestra.run.smithi150.stdout: "osd_in_since": 1726551696, 2024-09-17T05:54:15.972 INFO:teuthology.orchestra.run.smithi150.stdout: "num_remapped_pgs": 0 2024-09-17T05:54:15.972 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-17T05:54:15.972 INFO:teuthology.orchestra.run.smithi150.stdout: "pgmap": { 2024-09-17T05:54:15.972 INFO:teuthology.orchestra.run.smithi150.stdout: "pgs_by_state": [ 2024-09-17T05:54:15.972 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-09-17T05:54:15.972 INFO:teuthology.orchestra.run.smithi150.stdout: "state_name": "active+clean", 2024-09-17T05:54:15.972 INFO:teuthology.orchestra.run.smithi150.stdout: "count": 97 2024-09-17T05:54:15.972 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-09-17T05:54:15.972 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2024-09-17T05:54:15.972 INFO:teuthology.orchestra.run.smithi150.stdout: "num_pgs": 97, 2024-09-17T05:54:15.973 INFO:teuthology.orchestra.run.smithi150.stdout: "num_pools": 3, 2024-09-17T05:54:15.973 INFO:teuthology.orchestra.run.smithi150.stdout: "num_objects": 3947, 2024-09-17T05:54:15.973 INFO:teuthology.orchestra.run.smithi150.stdout: "data_bytes": 16410185663, 2024-09-17T05:54:15.973 INFO:teuthology.orchestra.run.smithi150.stdout: "bytes_used": 34020835328, 2024-09-17T05:54:15.973 INFO:teuthology.orchestra.run.smithi150.stdout: "bytes_avail": 739073277952, 2024-09-17T05:54:15.973 INFO:teuthology.orchestra.run.smithi150.stdout: "bytes_total": 773094113280, 2024-09-17T05:54:15.973 INFO:teuthology.orchestra.run.smithi150.stdout: "read_bytes_sec": 370374469, 2024-09-17T05:54:15.973 INFO:teuthology.orchestra.run.smithi150.stdout: "write_bytes_sec": 367629468, 2024-09-17T05:54:15.973 INFO:teuthology.orchestra.run.smithi150.stdout: "read_op_per_sec": 92, 2024-09-17T05:54:15.973 INFO:teuthology.orchestra.run.smithi150.stdout: "write_op_per_sec": 106 2024-09-17T05:54:15.973 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-17T05:54:15.973 INFO:teuthology.orchestra.run.smithi150.stdout: "fsmap": { 2024-09-17T05:54:15.973 INFO:teuthology.orchestra.run.smithi150.stdout: "epoch": 89, 2024-09-17T05:54:15.973 INFO:teuthology.orchestra.run.smithi150.stdout: "btime": "2024-09-17T05:53:25:564938+0000", 2024-09-17T05:54:15.974 INFO:teuthology.orchestra.run.smithi150.stdout: "id": 10, 2024-09-17T05:54:15.974 INFO:teuthology.orchestra.run.smithi150.stdout: "up": 1, 2024-09-17T05:54:15.974 INFO:teuthology.orchestra.run.smithi150.stdout: "in": 1, 2024-09-17T05:54:15.974 INFO:teuthology.orchestra.run.smithi150.stdout: "max": 1, 2024-09-17T05:54:15.974 INFO:teuthology.orchestra.run.smithi150.stdout: "by_rank": [ 2024-09-17T05:54:15.974 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-09-17T05:54:15.974 INFO:teuthology.orchestra.run.smithi150.stdout: "filesystem_id": 10, 2024-09-17T05:54:15.974 INFO:teuthology.orchestra.run.smithi150.stdout: "rank": 0, 2024-09-17T05:54:15.974 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "c", 2024-09-17T05:54:15.974 INFO:teuthology.orchestra.run.smithi150.stdout: "status": "up:active", 2024-09-17T05:54:15.974 INFO:teuthology.orchestra.run.smithi150.stdout: "gid": 9633 2024-09-17T05:54:15.974 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-09-17T05:54:15.974 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2024-09-17T05:54:15.974 INFO:teuthology.orchestra.run.smithi150.stdout: "up:standby": 3 2024-09-17T05:54:15.975 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-17T05:54:15.975 INFO:teuthology.orchestra.run.smithi150.stdout: "mgrmap": { 2024-09-17T05:54:15.975 INFO:teuthology.orchestra.run.smithi150.stdout: "available": true, 2024-09-17T05:54:15.975 INFO:teuthology.orchestra.run.smithi150.stdout: "num_standbys": 1, 2024-09-17T05:54:15.975 INFO:teuthology.orchestra.run.smithi150.stdout: "modules": [ 2024-09-17T05:54:15.975 INFO:teuthology.orchestra.run.smithi150.stdout: "iostat", 2024-09-17T05:54:15.975 INFO:teuthology.orchestra.run.smithi150.stdout: "nfs", 2024-09-17T05:54:15.975 INFO:teuthology.orchestra.run.smithi150.stdout: "restful" 2024-09-17T05:54:15.975 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2024-09-17T05:54:15.975 INFO:teuthology.orchestra.run.smithi150.stdout: "services": {} 2024-09-17T05:54:15.975 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-17T05:54:15.975 INFO:teuthology.orchestra.run.smithi150.stdout: "servicemap": { 2024-09-17T05:54:15.975 INFO:teuthology.orchestra.run.smithi150.stdout: "epoch": 21, 2024-09-17T05:54:15.975 INFO:teuthology.orchestra.run.smithi150.stdout: "modified": "2024-09-17T05:54:13.124284+0000", 2024-09-17T05:54:15.976 INFO:teuthology.orchestra.run.smithi150.stdout: "services": { 2024-09-17T05:54:15.976 INFO:teuthology.orchestra.run.smithi150.stdout: "mds": { 2024-09-17T05:54:15.976 INFO:teuthology.orchestra.run.smithi150.stdout: "daemons": { 2024-09-17T05:54:15.976 INFO:teuthology.orchestra.run.smithi150.stdout: "summary": "", 2024-09-17T05:54:15.976 INFO:teuthology.orchestra.run.smithi150.stdout: "c": { 2024-09-17T05:54:15.976 INFO:teuthology.orchestra.run.smithi150.stdout: "start_epoch": 0, 2024-09-17T05:54:15.976 INFO:teuthology.orchestra.run.smithi150.stdout: "start_stamp": "0.000000", 2024-09-17T05:54:15.976 INFO:teuthology.orchestra.run.smithi150.stdout: "gid": 0, 2024-09-17T05:54:15.976 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "(unrecognized address family 0)/0", 2024-09-17T05:54:15.976 INFO:teuthology.orchestra.run.smithi150.stdout: "metadata": {}, 2024-09-17T05:54:15.976 INFO:teuthology.orchestra.run.smithi150.stdout: "task_status": {} 2024-09-17T05:54:15.976 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-09-17T05:54:15.976 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-09-17T05:54:15.977 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-09-17T05:54:15.977 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-09-17T05:54:15.977 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-17T05:54:15.977 INFO:teuthology.orchestra.run.smithi150.stdout: "progress_events": {} 2024-09-17T05:54:15.977 INFO:teuthology.orchestra.run.smithi150.stdout:} 2024-09-17T05:54:15.978 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:15.969+0000 7efead28b640 1 -- 172.21.15.150:0/622681974 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7efe8807b200 msgr2=0x7efe8807d710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:54:15.978 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:15.969+0000 7efead28b640 1 --2- 172.21.15.150:0/622681974 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7efe8807b200 0x7efe8807d710 secure :-1 s=READY pgs=824 cs=0 l=1 rev1=1 crypto rx=0x7efea80a1930 tx=0x7efe90008040 comp rx=0 tx=0).stop 2024-09-17T05:54:15.978 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:15.970+0000 7efead28b640 1 -- 172.21.15.150:0/622681974 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7efea80b5d50 msgr2=0x7efea8154a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:54:15.978 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:15.970+0000 7efead28b640 1 --2- 172.21.15.150:0/622681974 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7efea80b5d50 0x7efea8154a80 secure :-1 s=READY pgs=1946 cs=0 l=1 rev1=1 crypto rx=0x7efe9800c3c0 tx=0x7efe9800c880 comp rx=0 tx=0).stop 2024-09-17T05:54:15.978 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:15.970+0000 7efead28b640 1 -- 172.21.15.150:0/622681974 shutdown_connections 2024-09-17T05:54:15.978 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:15.970+0000 7efead28b640 1 --2- 172.21.15.150:0/622681974 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7efea809e3a0 0x7efea815da00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:54:15.978 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:15.970+0000 7efead28b640 1 --2- 172.21.15.150:0/622681974 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7efe8807b200 0x7efe8807d710 unknown :-1 s=CLOSED pgs=824 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:54:15.978 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:15.970+0000 7efead28b640 1 --2- 172.21.15.150:0/622681974 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7efea80d2780 0x7efea815a790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:54:15.978 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:15.970+0000 7efead28b640 1 --2- 172.21.15.150:0/622681974 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7efea80b5d50 0x7efea8154a80 unknown :-1 s=CLOSED pgs=1946 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:54:15.979 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:15.970+0000 7efead28b640 1 -- 172.21.15.150:0/622681974 >> 172.21.15.150:0/622681974 conn(0x7efea808bfe0 msgr2=0x7efea80b8370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:54:15.979 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:15.970+0000 7efead28b640 1 -- 172.21.15.150:0/622681974 shutdown_connections 2024-09-17T05:54:15.979 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:15.970+0000 7efead28b640 1 -- 172.21.15.150:0/622681974 wait complete. 2024-09-17T05:54:15.983 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:54:15.983 DEBUG:teuthology.orchestra.run.smithi150:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls -lh volumes/_nogroup/subvol_clone38300/410f10a5-e2b3-409c-9cb1-eda83cddd440 2024-09-17T05:54:15.983 DEBUG:teuthology.orchestra.run.smithi150:> ) 2024-09-17T05:54:16.000 DEBUG:teuthology.orchestra.run:got remote process result: 2 2024-09-17T05:54:16.000 INFO:teuthology.orchestra.run.smithi150.stderr:ls: cannot access 'volumes/_nogroup/subvol_clone38300/410f10a5-e2b3-409c-9cb1-eda83cddd440': No such file or directory 2024-09-17T05:54:16.001 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume ls 2024-09-17T05:54:16.154 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:16.152+0000 7f16c5238640 1 -- 172.21.15.150:0/2274560451 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f16c009ba60 msgr2=0x7f16c00b24b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:54:16.155 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:16.152+0000 7f16c5238640 1 --2- 172.21.15.150:0/2274560451 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f16c009ba60 0x7f16c00b24b0 secure :-1 s=READY pgs=1948 cs=0 l=1 rev1=1 crypto rx=0x7f16b8005fd0 tx=0x7f16b802a8b0 comp rx=0 tx=0).stop 2024-09-17T05:54:16.155 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:16.152+0000 7f16c5238640 1 -- 172.21.15.150:0/2274560451 shutdown_connections 2024-09-17T05:54:16.155 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:16.152+0000 7f16c5238640 1 --2- 172.21.15.150:0/2274560451 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f16c009ba60 0x7f16c00b24b0 unknown :-1 s=CLOSED pgs=1948 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:54:16.155 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:16.152+0000 7f16c5238640 1 --2- 172.21.15.150:0/2274560451 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f16c00c5b90 0x7f16c00d02b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:54:16.155 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:16.152+0000 7f16c5238640 1 -- 172.21.15.150:0/2274560451 >> 172.21.15.150:0/2274560451 conn(0x7f16c00cef80 msgr2=0x7f16c00cf390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:54:16.155 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:16.152+0000 7f16c5238640 1 -- 172.21.15.150:0/2274560451 shutdown_connections 2024-09-17T05:54:16.155 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:16.152+0000 7f16c5238640 1 -- 172.21.15.150:0/2274560451 wait complete. 2024-09-17T05:54:16.156 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:16.154+0000 7f16c5238640 1 Processor -- start 2024-09-17T05:54:16.156 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:16.154+0000 7f16c5238640 1 -- start start 2024-09-17T05:54:16.158 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:16.156+0000 7f16c5238640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f16c009ba60 0x7f16c00cba80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:54:16.158 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:16.156+0000 7f16c5238640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f16c00c5b90 0x7f16c015cb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:54:16.159 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:16.156+0000 7f16c5238640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f16c00d07f0 0x7f16c015b910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:54:16.159 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:16.156+0000 7f16c5238640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f16c00b2b70 con 0x7f16c00c5b90 2024-09-17T05:54:16.159 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:16.156+0000 7f16c5238640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f16c00b29f0 con 0x7f16c00d07f0 2024-09-17T05:54:16.159 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:16.156+0000 7f16c5238640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f16c00b2cf0 con 0x7f16c009ba60 2024-09-17T05:54:16.159 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:16.156+0000 7f16b659c640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f16c00c5b90 0x7f16c015cb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:54:16.159 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:16.156+0000 7f16b659c640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f16c00c5b90 0x7f16c015cb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:42994/0 (socket says 172.21.15.150:42994) 2024-09-17T05:54:16.159 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:16.156+0000 7f16b659c640 1 -- 172.21.15.150:0/2401480599 learned_addr learned my addr 172.21.15.150:0/2401480599 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:54:16.159 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:16.156+0000 7f16bed9d640 1 --2- 172.21.15.150:0/2401480599 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f16c009ba60 0x7f16c00cba80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:54:16.159 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:16.156+0000 7f16bf59e640 1 --2- 172.21.15.150:0/2401480599 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f16c00d07f0 0x7f16c015b910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:54:16.159 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:16.156+0000 7f16b659c640 1 -- 172.21.15.150:0/2401480599 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f16c009ba60 msgr2=0x7f16c00cba80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:54:16.159 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:16.156+0000 7f16b659c640 1 --2- 172.21.15.150:0/2401480599 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f16c009ba60 0x7f16c00cba80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:54:16.159 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:16.156+0000 7f16b659c640 1 -- 172.21.15.150:0/2401480599 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f16c00d07f0 msgr2=0x7f16c015b910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:54:16.160 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:16.156+0000 7f16b659c640 1 --2- 172.21.15.150:0/2401480599 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f16c00d07f0 0x7f16c015b910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:54:16.160 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:16.156+0000 7f16b659c640 1 -- 172.21.15.150:0/2401480599 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f16c006e100 con 0x7f16c00c5b90 2024-09-17T05:54:16.160 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:16.156+0000 7f16b659c640 1 --2- 172.21.15.150:0/2401480599 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f16c00c5b90 0x7f16c015cb80 secure :-1 s=READY pgs=1949 cs=0 l=1 rev1=1 crypto rx=0x7f16a800c3c0 tx=0x7f16a800c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:54:16.160 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:16.156+0000 7f16b7fff640 1 -- 172.21.15.150:0/2401480599 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16a8017070 con 0x7f16c00c5b90 2024-09-17T05:54:16.160 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:16.156+0000 7f16b7fff640 1 -- 172.21.15.150:0/2401480599 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f16a80035f0 con 0x7f16c00c5b90 2024-09-17T05:54:16.160 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:16.156+0000 7f16b7fff640 1 -- 172.21.15.150:0/2401480599 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16a8003a40 con 0x7f16c00c5b90 2024-09-17T05:54:16.160 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:16.156+0000 7f16c5238640 1 -- 172.21.15.150:0/2401480599 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f16c006e3e0 con 0x7f16c00c5b90 2024-09-17T05:54:16.160 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:16.157+0000 7f16c5238640 1 -- 172.21.15.150:0/2401480599 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f16c015c660 con 0x7f16c00c5b90 2024-09-17T05:54:16.161 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:16.157+0000 7f16c5238640 1 -- 172.21.15.150:0/2401480599 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f16c00d02b0 con 0x7f16c00c5b90 2024-09-17T05:54:16.162 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:16.158+0000 7f16b7fff640 1 -- 172.21.15.150:0/2401480599 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 50) ==== 104909+0+0 (secure 0 0 0) 0x7f16a801a070 con 0x7f16c00c5b90 2024-09-17T05:54:16.162 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:16.159+0000 7f16b7fff640 1 --2- 172.21.15.150:0/2401480599 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f16a007b1d0 0x7f16a007d6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:54:16.162 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:16.159+0000 7f16b7fff640 1 -- 172.21.15.150:0/2401480599 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(143..143 src has 1..143) ==== 5934+0+0 (secure 0 0 0) 0x7f16a8099260 con 0x7f16c00c5b90 2024-09-17T05:54:16.162 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:16.159+0000 7f16bed9d640 1 --2- 172.21.15.150:0/2401480599 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f16a007b1d0 0x7f16a007d6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:54:16.162 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:16.160+0000 7f16bed9d640 1 --2- 172.21.15.150:0/2401480599 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f16a007b1d0 0x7f16a007d6e0 secure :-1 s=READY pgs=825 cs=0 l=1 rev1=1 crypto rx=0x7f16b000bb30 tx=0x7f16b000b2e0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:54:16.165 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:16.163+0000 7f16b7fff640 1 -- 172.21.15.150:0/2401480599 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f16a8062ad0 con 0x7f16c00c5b90 2024-09-17T05:54:16.364 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:16.362+0000 7f16c5238640 1 -- 172.21.15.150:0/2401480599 --> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] -- mgr_command(tid 0: {"prefix": "fs volume ls", "target": ["mon-mgr", ""]}) -- 0x7f16c006deb0 con 0x7f16a007b1d0 2024-09-17T05:54:16.365 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:16.365+0000 7f16b7fff640 1 -- 172.21.15.150:0/2401480599 <== mgr.4108 v2:172.21.15.176:6800/3631216395 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+41 (secure 0 0 0) 0x7f16c006deb0 con 0x7f16a007b1d0 2024-09-17T05:54:16.365 INFO:teuthology.orchestra.run.smithi150.stdout:[ 2024-09-17T05:54:16.366 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-09-17T05:54:16.366 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "cephfs" 2024-09-17T05:54:16.366 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-09-17T05:54:16.366 INFO:teuthology.orchestra.run.smithi150.stdout:] 2024-09-17T05:54:16.368 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:16.366+0000 7f16c5238640 1 -- 172.21.15.150:0/2401480599 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f16a007b1d0 msgr2=0x7f16a007d6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:54:16.368 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:16.366+0000 7f16c5238640 1 --2- 172.21.15.150:0/2401480599 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f16a007b1d0 0x7f16a007d6e0 secure :-1 s=READY pgs=825 cs=0 l=1 rev1=1 crypto rx=0x7f16b000bb30 tx=0x7f16b000b2e0 comp rx=0 tx=0).stop 2024-09-17T05:54:16.368 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:16.366+0000 7f16c5238640 1 -- 172.21.15.150:0/2401480599 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f16c00c5b90 msgr2=0x7f16c015cb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:54:16.368 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:16.366+0000 7f16c5238640 1 --2- 172.21.15.150:0/2401480599 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f16c00c5b90 0x7f16c015cb80 secure :-1 s=READY pgs=1949 cs=0 l=1 rev1=1 crypto rx=0x7f16a800c3c0 tx=0x7f16a800c880 comp rx=0 tx=0).stop 2024-09-17T05:54:16.368 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:16.366+0000 7f16c5238640 1 -- 172.21.15.150:0/2401480599 shutdown_connections 2024-09-17T05:54:16.369 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:16.366+0000 7f16c5238640 1 --2- 172.21.15.150:0/2401480599 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f16c00d07f0 0x7f16c015b910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:54:16.369 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:16.366+0000 7f16c5238640 1 --2- 172.21.15.150:0/2401480599 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f16a007b1d0 0x7f16a007d6e0 unknown :-1 s=CLOSED pgs=825 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:54:16.369 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:16.366+0000 7f16c5238640 1 --2- 172.21.15.150:0/2401480599 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f16c00c5b90 0x7f16c015cb80 unknown :-1 s=CLOSED pgs=1949 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:54:16.369 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:16.366+0000 7f16c5238640 1 --2- 172.21.15.150:0/2401480599 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f16c009ba60 0x7f16c00cba80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:54:16.369 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:16.366+0000 7f16c5238640 1 -- 172.21.15.150:0/2401480599 >> 172.21.15.150:0/2401480599 conn(0x7f16c00cef80 msgr2=0x7f16c0164320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:54:16.369 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:16.366+0000 7f16c5238640 1 -- 172.21.15.150:0/2401480599 shutdown_connections 2024-09-17T05:54:16.369 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:16.366+0000 7f16c5238640 1 -- 172.21.15.150:0/2401480599 wait complete. 2024-09-17T05:54:16.379 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume ls cephfs --format json 2024-09-17T05:54:16.497 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:16.495+0000 7f39237ba640 1 -- 172.21.15.150:0/1898757157 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3908003a00 msgr2=0x7f3908003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:54:16.497 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:16.495+0000 7f39237ba640 1 --2- 172.21.15.150:0/1898757157 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3908003a00 0x7f3908003e70 secure :-1 s=READY pgs=1951 cs=0 l=1 rev1=1 crypto rx=0x7f3918009ed0 tx=0x7f3908005830 comp rx=0 tx=0).stop 2024-09-17T05:54:16.497 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:16.495+0000 7f3921d57640 1 -- 172.21.15.150:0/1898757157 reap_dead start 2024-09-17T05:54:16.497 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:16.495+0000 7f39237ba640 1 -- 172.21.15.150:0/1898757157 shutdown_connections 2024-09-17T05:54:16.497 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:16.495+0000 7f39237ba640 1 -- 172.21.15.150:0/1898757157 >> 172.21.15.150:0/1898757157 conn(0x7f391c0d2550 msgr2=0x7f391c0d2960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:54:16.497 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:16.495+0000 7f39237ba640 1 -- 172.21.15.150:0/1898757157 shutdown_connections 2024-09-17T05:54:16.497 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:16.495+0000 7f39237ba640 1 -- 172.21.15.150:0/1898757157 wait complete. 2024-09-17T05:54:16.498 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:16.497+0000 7f39237ba640 1 Processor -- start 2024-09-17T05:54:16.498 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:16.497+0000 7f39237ba640 1 -- start start 2024-09-17T05:54:16.501 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:16.498+0000 7f39237ba640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3908003a00 0x7f391c1e22e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:54:16.501 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:16.498+0000 7f39237ba640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f391c1f78d0 0x7f391c1e0a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:54:16.501 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:16.498+0000 7f39237ba640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f391c1f3f50 0x7f391c1f4360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:54:16.501 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:16.498+0000 7f39237ba640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f391c0b75e0 con 0x7f391c1f78d0 2024-09-17T05:54:16.502 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:16.498+0000 7f39237ba640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f391c0cee20 con 0x7f3908003a00 2024-09-17T05:54:16.502 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:16.498+0000 7f39237ba640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f391c0cd3f0 con 0x7f391c1f3f50 2024-09-17T05:54:16.502 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:16.498+0000 7f3920d55640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f391c1f78d0 0x7f391c1e0a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:54:16.502 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:16.498+0000 7f3920d55640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f391c1f78d0 0x7f391c1e0a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:43018/0 (socket says 172.21.15.150:43018) 2024-09-17T05:54:16.502 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:16.498+0000 7f3920d55640 1 -- 172.21.15.150:0/2117290015 learned_addr learned my addr 172.21.15.150:0/2117290015 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:54:16.502 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:16.498+0000 7f3921556640 1 --2- 172.21.15.150:0/2117290015 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3908003a00 0x7f391c1e22e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:54:16.502 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:16.498+0000 7f3921d57640 1 --2- 172.21.15.150:0/2117290015 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f391c1f3f50 0x7f391c1f4360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:54:16.502 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:16.498+0000 7f3920d55640 1 -- 172.21.15.150:0/2117290015 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f391c1f3f50 msgr2=0x7f391c1f4360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:54:16.502 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:16.498+0000 7f3920d55640 1 --2- 172.21.15.150:0/2117290015 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f391c1f3f50 0x7f391c1f4360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:54:16.502 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:16.498+0000 7f3920d55640 1 -- 172.21.15.150:0/2117290015 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3908003a00 msgr2=0x7f391c1e22e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:54:16.502 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:16.498+0000 7f3920d55640 1 --2- 172.21.15.150:0/2117290015 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3908003a00 0x7f391c1e22e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:54:16.502 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:16.498+0000 7f3920d55640 1 -- 172.21.15.150:0/2117290015 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f391c0a0320 con 0x7f391c1f78d0 2024-09-17T05:54:16.503 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:16.498+0000 7f3921d57640 1 --2- 172.21.15.150:0/2117290015 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f391c1f3f50 0x7f391c1f4360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:54:16.503 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:16.499+0000 7f3920d55640 1 --2- 172.21.15.150:0/2117290015 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f391c1f78d0 0x7f391c1e0a50 secure :-1 s=READY pgs=1952 cs=0 l=1 rev1=1 crypto rx=0x7f390c00e6d0 tx=0x7f390c00eb90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:54:16.503 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:16.499+0000 7f3911ffb640 1 -- 172.21.15.150:0/2117290015 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f390c004240 con 0x7f391c1f78d0 2024-09-17T05:54:16.503 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:16.499+0000 7f3911ffb640 1 -- 172.21.15.150:0/2117290015 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f390c016070 con 0x7f391c1f78d0 2024-09-17T05:54:16.503 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:16.499+0000 7f39237ba640 1 -- 172.21.15.150:0/2117290015 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f391c09fd60 con 0x7f391c1f78d0 2024-09-17T05:54:16.503 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:16.499+0000 7f3911ffb640 1 -- 172.21.15.150:0/2117290015 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f390c00caa0 con 0x7f391c1f78d0 2024-09-17T05:54:16.503 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:16.499+0000 7f39237ba640 1 -- 172.21.15.150:0/2117290015 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f391c1f3a30 con 0x7f391c1f78d0 2024-09-17T05:54:16.504 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:16.500+0000 7f39237ba640 1 -- 172.21.15.150:0/2117290015 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f391c1e4380 con 0x7f391c1f78d0 2024-09-17T05:54:16.504 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:16.501+0000 7f3911ffb640 1 -- 172.21.15.150:0/2117290015 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 50) ==== 104909+0+0 (secure 0 0 0) 0x7f390c00cc40 con 0x7f391c1f78d0 2024-09-17T05:54:16.504 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:16.501+0000 7f3911ffb640 1 --2- 172.21.15.150:0/2117290015 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f390007b1d0 0x7f390007d6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:54:16.504 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:16.502+0000 7f3911ffb640 1 -- 172.21.15.150:0/2117290015 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(143..143 src has 1..143) ==== 5934+0+0 (secure 0 0 0) 0x7f390c09a390 con 0x7f391c1f78d0 2024-09-17T05:54:16.504 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:16.502+0000 7f3921556640 1 --2- 172.21.15.150:0/2117290015 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f390007b1d0 0x7f390007d6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:54:16.505 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:16.502+0000 7f3921556640 1 --2- 172.21.15.150:0/2117290015 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f390007b1d0 0x7f390007d6e0 secure :-1 s=READY pgs=826 cs=0 l=1 rev1=1 crypto rx=0x7f3918035000 tx=0x7f391802d040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:54:16.508 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:16.506+0000 7f3911ffb640 1 -- 172.21.15.150:0/2117290015 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f390c064360 con 0x7f391c1f78d0 2024-09-17T05:54:16.709 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:16.708+0000 7f39237ba640 1 -- 172.21.15.150:0/2117290015 --> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] -- mgr_command(tid 0: {"prefix": "fs subvolume ls", "vol_name": "cephfs", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f391c0cd8e0 con 0x7f390007b1d0 2024-09-17T05:54:16.717 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:16.716+0000 7f3911ffb640 1 -- 172.21.15.150:0/2117290015 <== mgr.4108 v2:172.21.15.176:6800/3631216395 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+378 (secure 0 0 0) 0x7f391c0cd8e0 con 0x7f390007b1d0 2024-09-17T05:54:16.718 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-09-17T05:54:16.718 INFO:teuthology.orchestra.run.smithi150.stdout:[ 2024-09-17T05:54:16.718 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-09-17T05:54:16.718 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "subvol_clone78074" 2024-09-17T05:54:16.718 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-17T05:54:16.718 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-09-17T05:54:16.718 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "sv1" 2024-09-17T05:54:16.718 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-17T05:54:16.718 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-09-17T05:54:16.718 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "subvol_clone38300" 2024-09-17T05:54:16.718 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-17T05:54:16.719 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-09-17T05:54:16.719 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "subvol_clone67871" 2024-09-17T05:54:16.719 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-17T05:54:16.719 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-09-17T05:54:16.719 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "subvol_clone58715" 2024-09-17T05:54:16.719 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-17T05:54:16.719 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-09-17T05:54:16.719 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "subvol_clone48513" 2024-09-17T05:54:16.719 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-17T05:54:16.719 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-09-17T05:54:16.719 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "subvol_clone02" 2024-09-17T05:54:16.719 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-17T05:54:16.719 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-09-17T05:54:16.719 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "subvol_clone65316" 2024-09-17T05:54:16.720 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-09-17T05:54:16.720 INFO:teuthology.orchestra.run.smithi150.stdout:] 2024-09-17T05:54:16.721 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:16.718+0000 7f39237ba640 1 -- 172.21.15.150:0/2117290015 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f390007b1d0 msgr2=0x7f390007d6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:54:16.721 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:16.718+0000 7f39237ba640 1 --2- 172.21.15.150:0/2117290015 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f390007b1d0 0x7f390007d6e0 secure :-1 s=READY pgs=826 cs=0 l=1 rev1=1 crypto rx=0x7f3918035000 tx=0x7f391802d040 comp rx=0 tx=0).stop 2024-09-17T05:54:16.721 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:16.718+0000 7f39237ba640 1 -- 172.21.15.150:0/2117290015 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f391c1f78d0 msgr2=0x7f391c1e0a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:54:16.721 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:16.718+0000 7f39237ba640 1 --2- 172.21.15.150:0/2117290015 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f391c1f78d0 0x7f391c1e0a50 secure :-1 s=READY pgs=1952 cs=0 l=1 rev1=1 crypto rx=0x7f390c00e6d0 tx=0x7f390c00eb90 comp rx=0 tx=0).stop 2024-09-17T05:54:16.721 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:16.718+0000 7f39237ba640 1 -- 172.21.15.150:0/2117290015 shutdown_connections 2024-09-17T05:54:16.721 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:16.718+0000 7f39237ba640 1 --2- 172.21.15.150:0/2117290015 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f390007b1d0 0x7f390007d6e0 unknown :-1 s=CLOSED pgs=826 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:54:16.721 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:16.718+0000 7f39237ba640 1 --2- 172.21.15.150:0/2117290015 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f391c1f3f50 0x7f391c1f4360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:54:16.721 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:16.718+0000 7f39237ba640 1 --2- 172.21.15.150:0/2117290015 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f391c1f78d0 0x7f391c1e0a50 unknown :-1 s=CLOSED pgs=1952 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:54:16.721 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:16.718+0000 7f39237ba640 1 --2- 172.21.15.150:0/2117290015 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3908003a00 0x7f391c1e22e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:54:16.721 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:16.718+0000 7f39237ba640 1 -- 172.21.15.150:0/2117290015 >> 172.21.15.150:0/2117290015 conn(0x7f391c0d2550 msgr2=0x7f391c0cefd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:54:16.721 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:16.718+0000 7f39237ba640 1 -- 172.21.15.150:0/2117290015 shutdown_connections 2024-09-17T05:54:16.721 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:16.719+0000 7f39237ba640 1 -- 172.21.15.150:0/2117290015 wait complete. 2024-09-17T05:54:16.732 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume rm --force cephfs subvol_clone78074 2024-09-17T05:54:16.850 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:16.848+0000 7f172dda1640 1 -- 172.21.15.150:0/2760293795 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f17280cc7d0 msgr2=0x7f17280b3120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:54:16.850 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:16.848+0000 7f172dda1640 1 --2- 172.21.15.150:0/2760293795 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f17280cc7d0 0x7f17280b3120 secure :-1 s=READY pgs=1953 cs=0 l=1 rev1=1 crypto rx=0x7f172806dee0 tx=0x7f171802a4d0 comp rx=0 tx=0).stop 2024-09-17T05:54:16.850 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:16.848+0000 7f172dda1640 1 -- 172.21.15.150:0/2760293795 shutdown_connections 2024-09-17T05:54:16.850 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:16.848+0000 7f172dda1640 1 --2- 172.21.15.150:0/2760293795 >> v2:172.21.15.176:3300/0 conn(0x7f17280b36f0 0x7f17280cb930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:54:16.850 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:16.848+0000 7f172dda1640 1 --2- 172.21.15.150:0/2760293795 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f17280cc7d0 0x7f17280b3120 unknown :-1 s=CLOSED pgs=1953 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:54:16.851 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:16.848+0000 7f172dda1640 1 -- 172.21.15.150:0/2760293795 >> 172.21.15.150:0/2760293795 conn(0x7f17280b2540 msgr2=0x7f17280d02d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:54:16.851 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:16.848+0000 7f172dda1640 1 -- 172.21.15.150:0/2760293795 shutdown_connections 2024-09-17T05:54:16.851 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:16.848+0000 7f172dda1640 1 -- 172.21.15.150:0/2760293795 wait complete. 2024-09-17T05:54:16.851 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:16.850+0000 7f172dda1640 1 Processor -- start 2024-09-17T05:54:16.852 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:16.850+0000 7f172dda1640 1 -- start start 2024-09-17T05:54:16.855 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:16.851+0000 7f172dda1640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f17280b36f0 0x7f1728157dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:54:16.855 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:16.851+0000 7f172dda1640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f172815ba50 0x7f17281f5e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:54:16.855 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:16.851+0000 7f172dda1640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f17280b1450 0x7f17281f6360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:54:16.855 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:16.851+0000 7f172dda1640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f172806f8a0 con 0x7f17280b1450 2024-09-17T05:54:16.855 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:16.851+0000 7f172dda1640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f172806f720 con 0x7f17280b36f0 2024-09-17T05:54:16.855 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:16.851+0000 7f172dda1640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f172806fa20 con 0x7f172815ba50 2024-09-17T05:54:16.855 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:16.852+0000 7f1727fff640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f17280b1450 0x7f17281f6360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:54:16.855 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:16.852+0000 7f1727fff640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f17280b1450 0x7f17281f6360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:43042/0 (socket says 172.21.15.150:43042) 2024-09-17T05:54:16.855 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:16.852+0000 7f1727fff640 1 -- 172.21.15.150:0/122642866 learned_addr learned my addr 172.21.15.150:0/122642866 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:54:16.855 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:16.852+0000 7f17277fe640 1 --2- 172.21.15.150:0/122642866 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f17280b36f0 0x7f1728157dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:54:16.855 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:16.852+0000 7f1726ffd640 1 --2- 172.21.15.150:0/122642866 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f172815ba50 0x7f17281f5e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:54:16.856 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:16.852+0000 7f1727fff640 1 -- 172.21.15.150:0/122642866 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f172815ba50 msgr2=0x7f17281f5e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:54:16.856 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:16.852+0000 7f1727fff640 1 --2- 172.21.15.150:0/122642866 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f172815ba50 0x7f17281f5e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:54:16.856 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:16.852+0000 7f1727fff640 1 -- 172.21.15.150:0/122642866 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f17280b36f0 msgr2=0x7f1728157dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:54:16.856 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:16.852+0000 7f1727fff640 1 --2- 172.21.15.150:0/122642866 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f17280b36f0 0x7f1728157dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:54:16.856 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:16.852+0000 7f1727fff640 1 -- 172.21.15.150:0/122642866 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f17281f3b90 con 0x7f17280b1450 2024-09-17T05:54:16.856 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:16.852+0000 7f1727fff640 1 --2- 172.21.15.150:0/122642866 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f17280b1450 0x7f17281f6360 secure :-1 s=READY pgs=1954 cs=0 l=1 rev1=1 crypto rx=0x7f172000e990 tx=0x7f172000ee50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:54:16.856 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:16.852+0000 7f170ffff640 1 -- 172.21.15.150:0/122642866 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1720004d20 con 0x7f17280b1450 2024-09-17T05:54:16.856 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:16.852+0000 7f170ffff640 1 -- 172.21.15.150:0/122642866 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f172000cb00 con 0x7f17280b1450 2024-09-17T05:54:16.856 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:16.852+0000 7f172dda1640 1 -- 172.21.15.150:0/122642866 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f17281f3e70 con 0x7f17280b1450 2024-09-17T05:54:16.856 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:16.852+0000 7f170ffff640 1 -- 172.21.15.150:0/122642866 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1720005020 con 0x7f17280b1450 2024-09-17T05:54:16.856 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:16.852+0000 7f172dda1640 1 -- 172.21.15.150:0/122642866 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f17281f4430 con 0x7f17280b1450 2024-09-17T05:54:16.857 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:16.853+0000 7f172dda1640 1 -- 172.21.15.150:0/122642866 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f172806ff10 con 0x7f17280b1450 2024-09-17T05:54:16.857 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:16.854+0000 7f170ffff640 1 -- 172.21.15.150:0/122642866 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 50) ==== 104909+0+0 (secure 0 0 0) 0x7f17200051c0 con 0x7f17280b1450 2024-09-17T05:54:16.858 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:16.855+0000 7f170ffff640 1 --2- 172.21.15.150:0/122642866 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f171407b200 0x7f171407d710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:54:16.858 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:16.855+0000 7f170ffff640 1 -- 172.21.15.150:0/122642866 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(143..143 src has 1..143) ==== 5934+0+0 (secure 0 0 0) 0x7f172009a820 con 0x7f17280b1450 2024-09-17T05:54:16.858 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:16.855+0000 7f17277fe640 1 --2- 172.21.15.150:0/122642866 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f171407b200 0x7f171407d710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:54:16.858 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:16.856+0000 7f17277fe640 1 --2- 172.21.15.150:0/122642866 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f171407b200 0x7f171407d710 secure :-1 s=READY pgs=827 cs=0 l=1 rev1=1 crypto rx=0x7f1718033000 tx=0x7f1718004730 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:54:16.861 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:16.860+0000 7f170ffff640 1 -- 172.21.15.150:0/122642866 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f1720016030 con 0x7f17280b1450 2024-09-17T05:54:17.063 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:17.061+0000 7f172dda1640 1 -- 172.21.15.150:0/122642866 --> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] -- mgr_command(tid 0: {"prefix": "fs subvolume rm", "force": true, "vol_name": "cephfs", "sub_name": "subvol_clone78074", "target": ["mon-mgr", ""]}) -- 0x7f17280b1980 con 0x7f171407b200 2024-09-17T05:54:17.079 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:17.078+0000 7f170ffff640 1 -- 172.21.15.150:0/122642866 <== mgr.4108 v2:172.21.15.176:6800/3631216395 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f17280b1980 con 0x7f171407b200 2024-09-17T05:54:17.082 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:17.080+0000 7f172dda1640 1 -- 172.21.15.150:0/122642866 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f171407b200 msgr2=0x7f171407d710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:54:17.083 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:17.080+0000 7f172dda1640 1 --2- 172.21.15.150:0/122642866 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f171407b200 0x7f171407d710 secure :-1 s=READY pgs=827 cs=0 l=1 rev1=1 crypto rx=0x7f1718033000 tx=0x7f1718004730 comp rx=0 tx=0).stop 2024-09-17T05:54:17.083 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:17.080+0000 7f172dda1640 1 -- 172.21.15.150:0/122642866 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f17280b1450 msgr2=0x7f17281f6360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:54:17.083 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:17.080+0000 7f172dda1640 1 --2- 172.21.15.150:0/122642866 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f17280b1450 0x7f17281f6360 secure :-1 s=READY pgs=1954 cs=0 l=1 rev1=1 crypto rx=0x7f172000e990 tx=0x7f172000ee50 comp rx=0 tx=0).stop 2024-09-17T05:54:17.083 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:17.080+0000 7f172dda1640 1 -- 172.21.15.150:0/122642866 shutdown_connections 2024-09-17T05:54:17.083 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:17.080+0000 7f172dda1640 1 --2- 172.21.15.150:0/122642866 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f171407b200 0x7f171407d710 unknown :-1 s=CLOSED pgs=827 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:54:17.083 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:17.080+0000 7f172dda1640 1 --2- 172.21.15.150:0/122642866 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f17280b1450 0x7f17281f6360 unknown :-1 s=CLOSED pgs=1954 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:54:17.083 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:17.080+0000 7f172dda1640 1 --2- 172.21.15.150:0/122642866 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f172815ba50 0x7f17281f5e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:54:17.083 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:17.080+0000 7f172dda1640 1 --2- 172.21.15.150:0/122642866 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f17280b36f0 0x7f1728157dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:54:17.083 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:17.080+0000 7f172dda1640 1 -- 172.21.15.150:0/122642866 >> 172.21.15.150:0/122642866 conn(0x7f17280b2540 msgr2=0x7f17280b4680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:54:17.083 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:17.081+0000 7f172dda1640 1 -- 172.21.15.150:0/122642866 shutdown_connections 2024-09-17T05:54:17.083 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:17.081+0000 7f172dda1640 1 -- 172.21.15.150:0/122642866 wait complete. 2024-09-17T05:54:17.093 INFO:tasks.ceph.mgr.x.smithi176.stderr:2024-09-17T05:54:17.091+0000 7f33d971e640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-17T05:54:17.093 INFO:tasks.ceph.mgr.x.smithi176.stderr:2024-09-17T05:54:17.091+0000 7f33d971e640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-17T05:54:17.093 INFO:tasks.ceph.mgr.x.smithi176.stderr:2024-09-17T05:54:17.091+0000 7f33d971e640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-17T05:54:17.093 INFO:tasks.ceph.mgr.x.smithi176.stderr:2024-09-17T05:54:17.091+0000 7f33d971e640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-17T05:54:17.093 INFO:tasks.ceph.mgr.x.smithi176.stderr:2024-09-17T05:54:17.091+0000 7f33d971e640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-17T05:54:17.097 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume snapshot ls cephfs sv1 --format json 2024-09-17T05:54:17.216 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:17.214+0000 7f4be68a4640 1 -- 172.21.15.150:0/2630731921 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4be006d4b0 msgr2=0x7f4be015aba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:54:17.216 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:17.214+0000 7f4be68a4640 1 --2- 172.21.15.150:0/2630731921 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4be006d4b0 0x7f4be015aba0 secure :-1 s=READY pgs=1955 cs=0 l=1 rev1=1 crypto rx=0x7f4bd8005fd0 tx=0x7f4bd802aa30 comp rx=0 tx=0).stop 2024-09-17T05:54:17.217 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:17.214+0000 7f4be68a4640 1 -- 172.21.15.150:0/2630731921 shutdown_connections 2024-09-17T05:54:17.217 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:17.214+0000 7f4be68a4640 1 --2- 172.21.15.150:0/2630731921 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4be006d4b0 0x7f4be015aba0 unknown :-1 s=CLOSED pgs=1955 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:54:17.217 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:17.214+0000 7f4be68a4640 1 --2- 172.21.15.150:0/2630731921 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4be0157110 0x7f4be00ae2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:54:17.217 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:17.214+0000 7f4be68a4640 1 -- 172.21.15.150:0/2630731921 >> 172.21.15.150:0/2630731921 conn(0x7f4be009aa50 msgr2=0x7f4be00b2ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:54:17.217 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:17.214+0000 7f4be68a4640 1 -- 172.21.15.150:0/2630731921 shutdown_connections 2024-09-17T05:54:17.217 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:17.214+0000 7f4be68a4640 1 -- 172.21.15.150:0/2630731921 wait complete. 2024-09-17T05:54:17.218 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:17.216+0000 7f4be68a4640 1 Processor -- start 2024-09-17T05:54:17.218 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:17.216+0000 7f4be68a4640 1 -- start start 2024-09-17T05:54:17.220 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:17.217+0000 7f4be68a4640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4be0157110 0x7f4be00b0a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:54:17.220 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:17.217+0000 7f4be68a4640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4be015d7d0 0x7f4be009ece0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:54:17.220 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:17.217+0000 7f4be68a4640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4be01f7660 0x7f4be015df70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:54:17.221 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:17.217+0000 7f4be68a4640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f4be015b0e0 con 0x7f4be01f7660 2024-09-17T05:54:17.221 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:17.217+0000 7f4be68a4640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f4be015ddf0 con 0x7f4be015d7d0 2024-09-17T05:54:17.221 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:17.217+0000 7f4be68a4640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f4be015b260 con 0x7f4be0157110 2024-09-17T05:54:17.221 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:17.217+0000 7f4be4e41640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4be01f7660 0x7f4be015df70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:54:17.221 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:17.217+0000 7f4be4e41640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4be01f7660 0x7f4be015df70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:43060/0 (socket says 172.21.15.150:43060) 2024-09-17T05:54:17.221 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:17.217+0000 7f4be4e41640 1 -- 172.21.15.150:0/3144855975 learned_addr learned my addr 172.21.15.150:0/3144855975 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:54:17.221 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:17.218+0000 7f4bdffff640 1 --2- 172.21.15.150:0/3144855975 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4be0157110 0x7f4be00b0a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:54:17.221 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:17.218+0000 7f4bdf7fe640 1 --2- 172.21.15.150:0/3144855975 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4be015d7d0 0x7f4be009ece0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:54:17.222 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:17.218+0000 7f4be4e41640 1 -- 172.21.15.150:0/3144855975 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4be0157110 msgr2=0x7f4be00b0a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:54:17.222 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:17.218+0000 7f4be4e41640 1 --2- 172.21.15.150:0/3144855975 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4be0157110 0x7f4be00b0a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:54:17.222 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:17.218+0000 7f4be4e41640 1 -- 172.21.15.150:0/3144855975 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4be015d7d0 msgr2=0x7f4be009ece0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:54:17.222 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:17.218+0000 7f4be4e41640 1 --2- 172.21.15.150:0/3144855975 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4be015d7d0 0x7f4be009ece0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:54:17.222 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:17.218+0000 7f4be4e41640 1 -- 172.21.15.150:0/3144855975 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4be01f6bc0 con 0x7f4be01f7660 2024-09-17T05:54:17.222 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:17.218+0000 7f4be4e41640 1 --2- 172.21.15.150:0/3144855975 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4be01f7660 0x7f4be015df70 secure :-1 s=READY pgs=1956 cs=0 l=1 rev1=1 crypto rx=0x7f4bd8006010 tx=0x7f4bd80093d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:54:17.222 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:17.218+0000 7f4bdcff9640 1 -- 172.21.15.150:0/3144855975 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4bd8046070 con 0x7f4be01f7660 2024-09-17T05:54:17.222 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:17.218+0000 7f4bdcff9640 1 -- 172.21.15.150:0/3144855975 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f4bd8004540 con 0x7f4be01f7660 2024-09-17T05:54:17.222 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:17.218+0000 7f4be68a4640 1 -- 172.21.15.150:0/3144855975 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4be00b1660 con 0x7f4be01f7660 2024-09-17T05:54:17.222 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:17.218+0000 7f4bdcff9640 1 -- 172.21.15.150:0/3144855975 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4bd8033070 con 0x7f4be01f7660 2024-09-17T05:54:17.222 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:17.218+0000 7f4be68a4640 1 -- 172.21.15.150:0/3144855975 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4be01f6e60 con 0x7f4be01f7660 2024-09-17T05:54:17.223 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:17.219+0000 7f4be68a4640 1 -- 172.21.15.150:0/3144855975 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4be00b10f0 con 0x7f4be01f7660 2024-09-17T05:54:17.224 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:17.220+0000 7f4bdcff9640 1 -- 172.21.15.150:0/3144855975 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 50) ==== 104909+0+0 (secure 0 0 0) 0x7f4bd8049070 con 0x7f4be01f7660 2024-09-17T05:54:17.224 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:17.221+0000 7f4bdcff9640 1 --2- 172.21.15.150:0/3144855975 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f4bcc07b1d0 0x7f4bcc07d6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:54:17.224 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:17.221+0000 7f4bdffff640 1 --2- 172.21.15.150:0/3144855975 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f4bcc07b1d0 0x7f4bcc07d6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:54:17.224 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:17.222+0000 7f4bdffff640 1 --2- 172.21.15.150:0/3144855975 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f4bcc07b1d0 0x7f4bcc07d6e0 secure :-1 s=READY pgs=828 cs=0 l=1 rev1=1 crypto rx=0x7f4be0072bb0 tx=0x7f4bd0005f90 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:54:17.224 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:17.222+0000 7f4bdcff9640 1 -- 172.21.15.150:0/3144855975 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(143..143 src has 1..143) ==== 5934+0+0 (secure 0 0 0) 0x7f4bd8080cd0 con 0x7f4be01f7660 2024-09-17T05:54:17.228 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:17.227+0000 7f4bdcff9640 1 -- 172.21.15.150:0/3144855975 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f4bd803e070 con 0x7f4be01f7660 2024-09-17T05:54:17.436 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:17.433+0000 7f4be68a4640 1 -- 172.21.15.150:0/3144855975 --> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] -- mgr_command(tid 0: {"prefix": "fs subvolume snapshot ls", "vol_name": "cephfs", "sub_name": "sv1", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f4be015aba0 con 0x7f4bcc07b1d0 2024-09-17T05:54:17.449 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:17.448+0000 7f4bdcff9640 1 -- 172.21.15.150:0/3144855975 <== mgr.4108 v2:172.21.15.176:6800/3631216395 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+38 (secure 0 0 0) 0x7f4be015aba0 con 0x7f4bcc07b1d0 2024-09-17T05:54:17.449 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-09-17T05:54:17.450 INFO:teuthology.orchestra.run.smithi150.stdout:[ 2024-09-17T05:54:17.450 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-09-17T05:54:17.450 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "ss1" 2024-09-17T05:54:17.450 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-09-17T05:54:17.450 INFO:teuthology.orchestra.run.smithi150.stdout:] 2024-09-17T05:54:17.452 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:17.450+0000 7f4be68a4640 1 -- 172.21.15.150:0/3144855975 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f4bcc07b1d0 msgr2=0x7f4bcc07d6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:54:17.452 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:17.450+0000 7f4be68a4640 1 --2- 172.21.15.150:0/3144855975 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f4bcc07b1d0 0x7f4bcc07d6e0 secure :-1 s=READY pgs=828 cs=0 l=1 rev1=1 crypto rx=0x7f4be0072bb0 tx=0x7f4bd0005f90 comp rx=0 tx=0).stop 2024-09-17T05:54:17.452 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:17.450+0000 7f4be68a4640 1 -- 172.21.15.150:0/3144855975 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4be01f7660 msgr2=0x7f4be015df70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:54:17.452 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:17.450+0000 7f4be68a4640 1 --2- 172.21.15.150:0/3144855975 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4be01f7660 0x7f4be015df70 secure :-1 s=READY pgs=1956 cs=0 l=1 rev1=1 crypto rx=0x7f4bd8006010 tx=0x7f4bd80093d0 comp rx=0 tx=0).stop 2024-09-17T05:54:17.452 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:17.450+0000 7f4be68a4640 1 -- 172.21.15.150:0/3144855975 shutdown_connections 2024-09-17T05:54:17.452 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:17.450+0000 7f4be68a4640 1 --2- 172.21.15.150:0/3144855975 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4be015d7d0 0x7f4be009ece0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:54:17.452 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:17.450+0000 7f4be68a4640 1 --2- 172.21.15.150:0/3144855975 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f4bcc07b1d0 0x7f4bcc07d6e0 unknown :-1 s=CLOSED pgs=828 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:54:17.452 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:17.450+0000 7f4be68a4640 1 --2- 172.21.15.150:0/3144855975 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4be01f7660 0x7f4be015df70 unknown :-1 s=CLOSED pgs=1956 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:54:17.452 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:17.450+0000 7f4be68a4640 1 --2- 172.21.15.150:0/3144855975 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4be0157110 0x7f4be00b0a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:54:17.452 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:17.450+0000 7f4be68a4640 1 -- 172.21.15.150:0/3144855975 >> 172.21.15.150:0/3144855975 conn(0x7f4be009aa50 msgr2=0x7f4be015fa80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:54:17.453 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:17.450+0000 7f4be68a4640 1 -- 172.21.15.150:0/3144855975 shutdown_connections 2024-09-17T05:54:17.453 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:17.450+0000 7f4be68a4640 1 -- 172.21.15.150:0/3144855975 wait complete. 2024-09-17T05:54:17.463 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume snapshot rm --force --format json cephfs sv1 ss1 2024-09-17T05:54:17.585 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:17.583+0000 7f1a4da4d640 1 -- 172.21.15.150:0/4014564382 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1a4806dea0 msgr2=0x7f1a480d0020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:54:17.585 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:17.583+0000 7f1a4da4d640 1 --2- 172.21.15.150:0/4014564382 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1a4806dea0 0x7f1a480d0020 secure :-1 s=READY pgs=1957 cs=0 l=1 rev1=1 crypto rx=0x7f1a480d3670 tx=0x7f1a3802a540 comp rx=0 tx=0).stop 2024-09-17T05:54:17.585 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:17.583+0000 7f1a4da4d640 1 -- 172.21.15.150:0/4014564382 shutdown_connections 2024-09-17T05:54:17.585 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:17.583+0000 7f1a4da4d640 1 --2- 172.21.15.150:0/4014564382 >> v2:172.21.15.176:3300/0 conn(0x7f1a4806e2b0 0x7f1a480d0560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:54:17.585 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:17.583+0000 7f1a4da4d640 1 --2- 172.21.15.150:0/4014564382 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1a4806dea0 0x7f1a480d0020 unknown :-1 s=CLOSED pgs=1957 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:54:17.585 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:17.583+0000 7f1a4da4d640 1 --2- 172.21.15.150:0/4014564382 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1a480d5150 0x7f1a480b9b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:54:17.586 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:17.583+0000 7f1a4da4d640 1 -- 172.21.15.150:0/4014564382 >> 172.21.15.150:0/4014564382 conn(0x7f1a4808bfe0 msgr2=0x7f1a480d46e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:54:17.586 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:17.583+0000 7f1a4da4d640 1 -- 172.21.15.150:0/4014564382 shutdown_connections 2024-09-17T05:54:17.586 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:17.583+0000 7f1a4da4d640 1 -- 172.21.15.150:0/4014564382 wait complete. 2024-09-17T05:54:17.590 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:17.585+0000 7f1a4da4d640 1 Processor -- start 2024-09-17T05:54:17.590 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:17.585+0000 7f1a4da4d640 1 -- start start 2024-09-17T05:54:17.590 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:17.586+0000 7f1a4da4d640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1a4806dea0 0x7f1a4814e410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:54:17.590 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:17.586+0000 7f1a4da4d640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1a4806e2b0 0x7f1a481f8e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:54:17.590 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:17.586+0000 7f1a4da4d640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1a480d5150 0x7f1a481f9360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:54:17.590 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:17.586+0000 7f1a4da4d640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f1a480d3150 con 0x7f1a480d5150 2024-09-17T05:54:17.590 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:17.586+0000 7f1a4da4d640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f1a480d2fd0 con 0x7f1a4806dea0 2024-09-17T05:54:17.590 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:17.586+0000 7f1a4da4d640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f1a480b6160 con 0x7f1a4806e2b0 2024-09-17T05:54:17.590 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:17.586+0000 7f1a477fe640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1a480d5150 0x7f1a481f9360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:54:17.590 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:17.586+0000 7f1a477fe640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1a480d5150 0x7f1a481f9360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:43088/0 (socket says 172.21.15.150:43088) 2024-09-17T05:54:17.590 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:17.586+0000 7f1a477fe640 1 -- 172.21.15.150:0/668711726 learned_addr learned my addr 172.21.15.150:0/668711726 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:54:17.590 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:17.586+0000 7f1a467fc640 1 --2- 172.21.15.150:0/668711726 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1a4806e2b0 0x7f1a481f8e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:54:17.591 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:17.586+0000 7f1a46ffd640 1 --2- 172.21.15.150:0/668711726 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1a4806dea0 0x7f1a4814e410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:54:17.591 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:17.587+0000 7f1a477fe640 1 -- 172.21.15.150:0/668711726 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1a4806e2b0 msgr2=0x7f1a481f8e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:54:17.591 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:17.587+0000 7f1a477fe640 1 --2- 172.21.15.150:0/668711726 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1a4806e2b0 0x7f1a481f8e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:54:17.591 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:17.587+0000 7f1a477fe640 1 -- 172.21.15.150:0/668711726 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1a4806dea0 msgr2=0x7f1a4814e410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:54:17.591 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:17.587+0000 7f1a477fe640 1 --2- 172.21.15.150:0/668711726 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1a4806dea0 0x7f1a4814e410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:54:17.591 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:17.587+0000 7f1a477fe640 1 -- 172.21.15.150:0/668711726 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1a48159ed0 con 0x7f1a480d5150 2024-09-17T05:54:17.591 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:17.587+0000 7f1a477fe640 1 --2- 172.21.15.150:0/668711726 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1a480d5150 0x7f1a481f9360 secure :-1 s=READY pgs=1958 cs=0 l=1 rev1=1 crypto rx=0x7f1a4000ca60 tx=0x7f1a4000cf20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:54:17.591 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:17.587+0000 7f1a2ffff640 1 -- 172.21.15.150:0/668711726 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a40004d20 con 0x7f1a480d5150 2024-09-17T05:54:17.591 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:17.587+0000 7f1a2ffff640 1 -- 172.21.15.150:0/668711726 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f1a40007ad0 con 0x7f1a480d5150 2024-09-17T05:54:17.591 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:17.587+0000 7f1a2ffff640 1 -- 172.21.15.150:0/668711726 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a40005020 con 0x7f1a480d5150 2024-09-17T05:54:17.592 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:17.587+0000 7f1a4da4d640 1 -- 172.21.15.150:0/668711726 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1a481517f0 con 0x7f1a480d5150 2024-09-17T05:54:17.592 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:17.587+0000 7f1a4da4d640 1 -- 172.21.15.150:0/668711726 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1a480cc810 con 0x7f1a480d5150 2024-09-17T05:54:17.592 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:17.588+0000 7f1a4da4d640 1 -- 172.21.15.150:0/668711726 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1a480b9b10 con 0x7f1a480d5150 2024-09-17T05:54:17.593 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:17.589+0000 7f1a2ffff640 1 -- 172.21.15.150:0/668711726 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 50) ==== 104909+0+0 (secure 0 0 0) 0x7f1a400051c0 con 0x7f1a480d5150 2024-09-17T05:54:17.593 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:17.589+0000 7f1a2ffff640 1 --2- 172.21.15.150:0/668711726 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f1a3407b1d0 0x7f1a3407d6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:54:17.593 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:17.590+0000 7f1a2ffff640 1 -- 172.21.15.150:0/668711726 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(143..143 src has 1..143) ==== 5934+0+0 (secure 0 0 0) 0x7f1a4009a8d0 con 0x7f1a480d5150 2024-09-17T05:54:17.593 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:17.590+0000 7f1a46ffd640 1 --2- 172.21.15.150:0/668711726 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f1a3407b1d0 0x7f1a3407d6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:54:17.593 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:17.590+0000 7f1a46ffd640 1 --2- 172.21.15.150:0/668711726 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f1a3407b1d0 0x7f1a3407d6e0 secure :-1 s=READY pgs=829 cs=0 l=1 rev1=1 crypto rx=0x7f1a3c005860 tx=0x7f1a3c005f50 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:54:17.595 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:17.594+0000 7f1a2ffff640 1 -- 172.21.15.150:0/668711726 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f1a40014070 con 0x7f1a480d5150 2024-09-17T05:54:17.803 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:17.801+0000 7f1a4da4d640 1 -- 172.21.15.150:0/668711726 --> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] -- mgr_command(tid 0: {"prefix": "fs subvolume snapshot rm", "force": true, "vol_name": "cephfs", "sub_name": "sv1", "snap_name": "ss1", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f1a480d4f30 con 0x7f1a3407b1d0 2024-09-17T05:54:17.831 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:17.829+0000 7f1a2ffff640 1 -- 172.21.15.150:0/668711726 <== mgr.4108 v2:172.21.15.176:6800/3631216395 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f1a480d4f30 con 0x7f1a3407b1d0 2024-09-17T05:54:17.831 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-09-17T05:54:17.834 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:17.832+0000 7f1a4da4d640 1 -- 172.21.15.150:0/668711726 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f1a3407b1d0 msgr2=0x7f1a3407d6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:54:17.834 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:17.832+0000 7f1a4da4d640 1 --2- 172.21.15.150:0/668711726 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f1a3407b1d0 0x7f1a3407d6e0 secure :-1 s=READY pgs=829 cs=0 l=1 rev1=1 crypto rx=0x7f1a3c005860 tx=0x7f1a3c005f50 comp rx=0 tx=0).stop 2024-09-17T05:54:17.834 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:17.832+0000 7f1a4da4d640 1 -- 172.21.15.150:0/668711726 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1a480d5150 msgr2=0x7f1a481f9360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:54:17.834 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:17.832+0000 7f1a4da4d640 1 --2- 172.21.15.150:0/668711726 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1a480d5150 0x7f1a481f9360 secure :-1 s=READY pgs=1958 cs=0 l=1 rev1=1 crypto rx=0x7f1a4000ca60 tx=0x7f1a4000cf20 comp rx=0 tx=0).stop 2024-09-17T05:54:17.834 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:17.832+0000 7f1a4da4d640 1 -- 172.21.15.150:0/668711726 shutdown_connections 2024-09-17T05:54:17.834 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:17.832+0000 7f1a4da4d640 1 --2- 172.21.15.150:0/668711726 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f1a3407b1d0 0x7f1a3407d6e0 unknown :-1 s=CLOSED pgs=829 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:54:17.834 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:17.832+0000 7f1a4da4d640 1 --2- 172.21.15.150:0/668711726 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1a480d5150 0x7f1a481f9360 unknown :-1 s=CLOSED pgs=1958 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:54:17.834 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:17.832+0000 7f1a4da4d640 1 --2- 172.21.15.150:0/668711726 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1a4806e2b0 0x7f1a481f8e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:54:17.834 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:17.832+0000 7f1a4da4d640 1 --2- 172.21.15.150:0/668711726 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1a4806dea0 0x7f1a4814e410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:54:17.835 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:17.832+0000 7f1a4da4d640 1 -- 172.21.15.150:0/668711726 >> 172.21.15.150:0/668711726 conn(0x7f1a4808bfe0 msgr2=0x7f1a480cac40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:54:17.835 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:17.832+0000 7f1a4da4d640 1 -- 172.21.15.150:0/668711726 shutdown_connections 2024-09-17T05:54:17.835 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:17.832+0000 7f1a4da4d640 1 -- 172.21.15.150:0/668711726 wait complete. 2024-09-17T05:54:17.845 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume rm cephfs sv1 2024-09-17T05:54:17.962 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:17.960+0000 7f1f55112640 1 -- 172.21.15.150:0/2902251299 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1f50145550 msgr2=0x7f1f5006fb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:54:17.962 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:17.960+0000 7f1f55112640 1 --2- 172.21.15.150:0/2902251299 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1f50145550 0x7f1f5006fb40 secure :-1 s=READY pgs=1960 cs=0 l=1 rev1=1 crypto rx=0x7f1f40005fd0 tx=0x7f1f4002a670 comp rx=0 tx=0).stop 2024-09-17T05:54:17.962 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:17.960+0000 7f1f55112640 1 -- 172.21.15.150:0/2902251299 shutdown_connections 2024-09-17T05:54:17.962 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:17.960+0000 7f1f55112640 1 --2- 172.21.15.150:0/2902251299 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1f50145550 0x7f1f5006fb40 unknown :-1 s=CLOSED pgs=1960 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:54:17.962 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:17.960+0000 7f1f55112640 1 -- 172.21.15.150:0/2902251299 >> 172.21.15.150:0/2902251299 conn(0x7f1f5006d1c0 msgr2=0x7f1f5006d5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:54:17.962 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:17.960+0000 7f1f55112640 1 -- 172.21.15.150:0/2902251299 shutdown_connections 2024-09-17T05:54:17.963 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:17.960+0000 7f1f55112640 1 -- 172.21.15.150:0/2902251299 wait complete. 2024-09-17T05:54:17.963 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:17.962+0000 7f1f55112640 1 Processor -- start 2024-09-17T05:54:17.963 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:17.962+0000 7f1f55112640 1 -- start start 2024-09-17T05:54:17.966 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:17.963+0000 7f1f55112640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1f50145550 0x7f1f501f7650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:54:17.966 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:17.963+0000 7f1f55112640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1f50145a40 0x7f1f50152c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:54:17.966 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:17.963+0000 7f1f55112640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1f5015bd30 0x7f1f5013f600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:54:17.967 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:17.963+0000 7f1f55112640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f1f500ce360 con 0x7f1f5015bd30 2024-09-17T05:54:17.967 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:17.963+0000 7f1f55112640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f1f500ce1e0 con 0x7f1f50145a40 2024-09-17T05:54:17.967 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:17.963+0000 7f1f55112640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f1f500ce4e0 con 0x7f1f50145550 2024-09-17T05:54:17.967 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:17.963+0000 7f1f4f59e640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1f5015bd30 0x7f1f5013f600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:54:17.967 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:17.963+0000 7f1f4f59e640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1f5015bd30 0x7f1f5013f600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:43094/0 (socket says 172.21.15.150:43094) 2024-09-17T05:54:17.967 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:17.963+0000 7f1f4f59e640 1 -- 172.21.15.150:0/1154849882 learned_addr learned my addr 172.21.15.150:0/1154849882 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:54:17.967 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:17.964+0000 7f1f4ed9d640 1 --2- 172.21.15.150:0/1154849882 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1f50145550 0x7f1f501f7650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:54:17.967 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:17.964+0000 7f1f4659c640 1 --2- 172.21.15.150:0/1154849882 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1f50145a40 0x7f1f50152c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:54:17.967 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:17.964+0000 7f1f4f59e640 1 -- 172.21.15.150:0/1154849882 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1f50145550 msgr2=0x7f1f501f7650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:54:17.967 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:17.964+0000 7f1f4f59e640 1 --2- 172.21.15.150:0/1154849882 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1f50145550 0x7f1f501f7650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:54:17.967 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:17.964+0000 7f1f4f59e640 1 -- 172.21.15.150:0/1154849882 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1f50145a40 msgr2=0x7f1f50152c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:54:17.967 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:17.964+0000 7f1f4f59e640 1 --2- 172.21.15.150:0/1154849882 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1f50145a40 0x7f1f50152c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:54:17.968 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:17.964+0000 7f1f4f59e640 1 -- 172.21.15.150:0/1154849882 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1f5013c2f0 con 0x7f1f5015bd30 2024-09-17T05:54:17.968 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:17.964+0000 7f1f4f59e640 1 --2- 172.21.15.150:0/1154849882 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1f5015bd30 0x7f1f5013f600 secure :-1 s=READY pgs=1961 cs=0 l=1 rev1=1 crypto rx=0x7f1f4800be90 tx=0x7f1f4800bf80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:54:17.968 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:17.964+0000 7f1f47fff640 1 -- 172.21.15.150:0/1154849882 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f48019070 con 0x7f1f5015bd30 2024-09-17T05:54:17.968 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:17.964+0000 7f1f47fff640 1 -- 172.21.15.150:0/1154849882 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f1f48014440 con 0x7f1f5015bd30 2024-09-17T05:54:17.968 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:17.964+0000 7f1f55112640 1 -- 172.21.15.150:0/1154849882 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1f5013c5d0 con 0x7f1f5015bd30 2024-09-17T05:54:17.968 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:17.964+0000 7f1f47fff640 1 -- 172.21.15.150:0/1154849882 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f480148d0 con 0x7f1f5015bd30 2024-09-17T05:54:17.968 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:17.964+0000 7f1f55112640 1 -- 172.21.15.150:0/1154849882 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1f501f7130 con 0x7f1f5015bd30 2024-09-17T05:54:17.969 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:17.965+0000 7f1f55112640 1 -- 172.21.15.150:0/1154849882 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1f5013c060 con 0x7f1f5015bd30 2024-09-17T05:54:17.969 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:17.966+0000 7f1f47fff640 1 -- 172.21.15.150:0/1154849882 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 50) ==== 104909+0+0 (secure 0 0 0) 0x7f1f4801c070 con 0x7f1f5015bd30 2024-09-17T05:54:17.969 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:17.967+0000 7f1f47fff640 1 --2- 172.21.15.150:0/1154849882 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f1f3007b1d0 0x7f1f3007d6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:54:17.969 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:17.967+0000 7f1f47fff640 1 -- 172.21.15.150:0/1154849882 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(143..143 src has 1..143) ==== 5934+0+0 (secure 0 0 0) 0x7f1f48099f90 con 0x7f1f5015bd30 2024-09-17T05:54:17.969 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:17.967+0000 7f1f4ed9d640 1 --2- 172.21.15.150:0/1154849882 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f1f3007b1d0 0x7f1f3007d6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:54:17.969 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:17.968+0000 7f1f4ed9d640 1 --2- 172.21.15.150:0/1154849882 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f1f3007b1d0 0x7f1f3007d6e0 secure :-1 s=READY pgs=830 cs=0 l=1 rev1=1 crypto rx=0x7f1f40033000 tx=0x7f1f40004730 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:54:17.973 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:17.971+0000 7f1f47fff640 1 -- 172.21.15.150:0/1154849882 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f1f48063800 con 0x7f1f5015bd30 2024-09-17T05:54:18.173 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:18.171+0000 7f1f55112640 1 -- 172.21.15.150:0/1154849882 --> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] -- mgr_command(tid 0: {"prefix": "fs subvolume rm", "vol_name": "cephfs", "sub_name": "sv1", "target": ["mon-mgr", ""]}) -- 0x7f1f5006fb40 con 0x7f1f3007b1d0 2024-09-17T05:54:18.192 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:18.190+0000 7f1f47fff640 1 -- 172.21.15.150:0/1154849882 <== mgr.4108 v2:172.21.15.176:6800/3631216395 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f1f5006fb40 con 0x7f1f3007b1d0 2024-09-17T05:54:18.195 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:18.193+0000 7f1f55112640 1 -- 172.21.15.150:0/1154849882 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f1f3007b1d0 msgr2=0x7f1f3007d6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:54:18.195 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:18.193+0000 7f1f55112640 1 --2- 172.21.15.150:0/1154849882 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f1f3007b1d0 0x7f1f3007d6e0 secure :-1 s=READY pgs=830 cs=0 l=1 rev1=1 crypto rx=0x7f1f40033000 tx=0x7f1f40004730 comp rx=0 tx=0).stop 2024-09-17T05:54:18.195 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:18.193+0000 7f1f55112640 1 -- 172.21.15.150:0/1154849882 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1f5015bd30 msgr2=0x7f1f5013f600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:54:18.195 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:18.193+0000 7f1f55112640 1 --2- 172.21.15.150:0/1154849882 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1f5015bd30 0x7f1f5013f600 secure :-1 s=READY pgs=1961 cs=0 l=1 rev1=1 crypto rx=0x7f1f4800be90 tx=0x7f1f4800bf80 comp rx=0 tx=0).stop 2024-09-17T05:54:18.195 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:18.193+0000 7f1f55112640 1 -- 172.21.15.150:0/1154849882 shutdown_connections 2024-09-17T05:54:18.195 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:18.193+0000 7f1f55112640 1 --2- 172.21.15.150:0/1154849882 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1f50145a40 0x7f1f50152c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:54:18.195 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:18.193+0000 7f1f55112640 1 --2- 172.21.15.150:0/1154849882 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f1f3007b1d0 0x7f1f3007d6e0 unknown :-1 s=CLOSED pgs=830 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:54:18.195 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:18.193+0000 7f1f55112640 1 --2- 172.21.15.150:0/1154849882 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1f5015bd30 0x7f1f5013f600 unknown :-1 s=CLOSED pgs=1961 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:54:18.195 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:18.193+0000 7f1f55112640 1 --2- 172.21.15.150:0/1154849882 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1f50145550 0x7f1f501f7650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:54:18.195 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:18.193+0000 7f1f55112640 1 -- 172.21.15.150:0/1154849882 >> 172.21.15.150:0/1154849882 conn(0x7f1f5006d1c0 msgr2=0x7f1f500ce980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:54:18.195 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:18.193+0000 7f1f55112640 1 -- 172.21.15.150:0/1154849882 shutdown_connections 2024-09-17T05:54:18.196 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:18.193+0000 7f1f55112640 1 -- 172.21.15.150:0/1154849882 wait complete. 2024-09-17T05:54:18.209 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume rm --force cephfs subvol_clone38300 2024-09-17T05:54:18.337 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:18.334+0000 7f3b17a27640 1 -- 172.21.15.150:0/1389788096 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3b100c5b10 msgr2=0x7f3b100d0230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:54:18.337 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:18.334+0000 7f3b17a27640 1 --2- 172.21.15.150:0/1389788096 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3b100c5b10 0x7f3b100d0230 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f3b08009820 tx=0x7f3b0802a5a0 comp rx=0 tx=0).stop 2024-09-17T05:54:18.337 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:18.334+0000 7f3b17a27640 1 -- 172.21.15.150:0/1389788096 shutdown_connections 2024-09-17T05:54:18.337 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:18.334+0000 7f3b17a27640 1 --2- 172.21.15.150:0/1389788096 >> v2:172.21.15.176:3300/0 conn(0x7f3b100b2c60 0x7f3b100cd860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:54:18.337 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:18.334+0000 7f3b17a27640 1 --2- 172.21.15.150:0/1389788096 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3b100c5b10 0x7f3b100d0230 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:54:18.337 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:18.334+0000 7f3b17a27640 1 -- 172.21.15.150:0/1389788096 >> 172.21.15.150:0/1389788096 conn(0x7f3b100cef00 msgr2=0x7f3b100cf310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:54:18.337 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:18.335+0000 7f3b17a27640 1 -- 172.21.15.150:0/1389788096 shutdown_connections 2024-09-17T05:54:18.337 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:18.335+0000 7f3b17a27640 1 -- 172.21.15.150:0/1389788096 wait complete. 2024-09-17T05:54:18.338 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:18.336+0000 7f3b17a27640 1 Processor -- start 2024-09-17T05:54:18.338 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:18.336+0000 7f3b17a27640 1 -- start start 2024-09-17T05:54:18.341 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:18.338+0000 7f3b17a27640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3b100b2c60 0x7f3b1015dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:54:18.341 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:18.338+0000 7f3b17a27640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3b100c5b10 0x7f3b10162de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:54:18.341 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:18.338+0000 7f3b17a27640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3b100d0770 0x7f3b100af990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:54:18.341 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:18.338+0000 7f3b17a27640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f3b100cdf20 con 0x7f3b100b2c60 2024-09-17T05:54:18.341 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:18.338+0000 7f3b17a27640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f3b100cdda0 con 0x7f3b100c5b10 2024-09-17T05:54:18.341 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:18.338+0000 7f3b17a27640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f3b100ce0a0 con 0x7f3b100d0770 2024-09-17T05:54:18.341 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:18.338+0000 7f3b157c3640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3b100b2c60 0x7f3b1015dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:54:18.341 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:18.338+0000 7f3b157c3640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3b100b2c60 0x7f3b1015dcd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:43108/0 (socket says 172.21.15.150:43108) 2024-09-17T05:54:18.341 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:18.338+0000 7f3b157c3640 1 -- 172.21.15.150:0/1084154001 learned_addr learned my addr 172.21.15.150:0/1084154001 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:54:18.341 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:18.338+0000 7f3b15fc4640 1 --2- 172.21.15.150:0/1084154001 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3b100d0770 0x7f3b100af990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:54:18.342 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:18.338+0000 7f3b14fc2640 1 --2- 172.21.15.150:0/1084154001 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3b100c5b10 0x7f3b10162de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:54:18.342 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:18.338+0000 7f3b157c3640 1 -- 172.21.15.150:0/1084154001 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3b100d0770 msgr2=0x7f3b100af990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:54:18.342 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:18.338+0000 7f3b157c3640 1 --2- 172.21.15.150:0/1084154001 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3b100d0770 0x7f3b100af990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:54:18.342 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:18.338+0000 7f3b157c3640 1 -- 172.21.15.150:0/1084154001 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3b100c5b10 msgr2=0x7f3b10162de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:54:18.342 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:18.338+0000 7f3b157c3640 1 --2- 172.21.15.150:0/1084154001 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3b100c5b10 0x7f3b10162de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:54:18.342 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:18.338+0000 7f3b157c3640 1 -- 172.21.15.150:0/1084154001 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3b10162650 con 0x7f3b100b2c60 2024-09-17T05:54:18.342 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:18.338+0000 7f3b15fc4640 1 --2- 172.21.15.150:0/1084154001 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3b100d0770 0x7f3b100af990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:54:18.342 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:18.338+0000 7f3b157c3640 1 --2- 172.21.15.150:0/1084154001 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3b100b2c60 0x7f3b1015dcd0 secure :-1 s=READY pgs=1963 cs=0 l=1 rev1=1 crypto rx=0x7f3b08009910 tx=0x7f3b08004a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:54:18.342 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:18.338+0000 7f3b0dffb640 1 -- 172.21.15.150:0/1084154001 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b08005c30 con 0x7f3b100b2c60 2024-09-17T05:54:18.342 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:18.338+0000 7f3b0dffb640 1 -- 172.21.15.150:0/1084154001 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f3b08042070 con 0x7f3b100b2c60 2024-09-17T05:54:18.342 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:18.338+0000 7f3b17a27640 1 -- 172.21.15.150:0/1084154001 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3b10166a40 con 0x7f3b100b2c60 2024-09-17T05:54:18.342 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:18.338+0000 7f3b0dffb640 1 -- 172.21.15.150:0/1084154001 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b08004e50 con 0x7f3b100b2c60 2024-09-17T05:54:18.342 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:18.339+0000 7f3b17a27640 1 -- 172.21.15.150:0/1084154001 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3b10164c20 con 0x7f3b100b2c60 2024-09-17T05:54:18.343 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:18.340+0000 7f3b17a27640 1 -- 172.21.15.150:0/1084154001 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3b100d0230 con 0x7f3b100b2c60 2024-09-17T05:54:18.343 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:18.341+0000 7f3b0dffb640 1 -- 172.21.15.150:0/1084154001 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 51) ==== 104960+0+0 (secure 0 0 0) 0x7f3b080317a0 con 0x7f3b100b2c60 2024-09-17T05:54:18.343 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:18.341+0000 7f3b0dffb640 1 --2- 172.21.15.150:0/1084154001 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f3afc07b430 0x7f3afc07d940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:54:18.343 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:18.341+0000 7f3b0dffb640 1 -- 172.21.15.150:0/1084154001 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(143..143 src has 1..143) ==== 5934+0+0 (secure 0 0 0) 0x7f3b080bae80 con 0x7f3b100b2c60 2024-09-17T05:54:18.344 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:18.341+0000 7f3b14fc2640 1 --2- 172.21.15.150:0/1084154001 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f3afc07b430 0x7f3afc07d940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:54:18.344 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:18.342+0000 7f3b14fc2640 1 --2- 172.21.15.150:0/1084154001 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f3afc07b430 0x7f3afc07d940 secure :-1 s=READY pgs=831 cs=0 l=1 rev1=1 crypto rx=0x7f3b1015ffc0 tx=0x7f3b04009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:54:18.347 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:18.346+0000 7f3b0dffb640 1 -- 172.21.15.150:0/1084154001 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f3b08084dc0 con 0x7f3b100b2c60 2024-09-17T05:54:18.561 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:18.560+0000 7f3b17a27640 1 -- 172.21.15.150:0/1084154001 --> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] -- mgr_command(tid 0: {"prefix": "fs subvolume rm", "force": true, "vol_name": "cephfs", "sub_name": "subvol_clone38300", "target": ["mon-mgr", ""]}) -- 0x7f3b100a0120 con 0x7f3afc07b430 2024-09-17T05:54:18.577 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:18.576+0000 7f3b0dffb640 1 -- 172.21.15.150:0/1084154001 <== mgr.4108 v2:172.21.15.176:6800/3631216395 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f3b100a0120 con 0x7f3afc07b430 2024-09-17T05:54:18.581 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:18.578+0000 7f3b17a27640 1 -- 172.21.15.150:0/1084154001 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f3afc07b430 msgr2=0x7f3afc07d940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:54:18.581 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:18.578+0000 7f3b17a27640 1 --2- 172.21.15.150:0/1084154001 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f3afc07b430 0x7f3afc07d940 secure :-1 s=READY pgs=831 cs=0 l=1 rev1=1 crypto rx=0x7f3b1015ffc0 tx=0x7f3b04009040 comp rx=0 tx=0).stop 2024-09-17T05:54:18.581 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:18.578+0000 7f3b17a27640 1 -- 172.21.15.150:0/1084154001 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3b100b2c60 msgr2=0x7f3b1015dcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:54:18.581 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:18.578+0000 7f3b17a27640 1 --2- 172.21.15.150:0/1084154001 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3b100b2c60 0x7f3b1015dcd0 secure :-1 s=READY pgs=1963 cs=0 l=1 rev1=1 crypto rx=0x7f3b08009910 tx=0x7f3b08004a50 comp rx=0 tx=0).stop 2024-09-17T05:54:18.581 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:18.579+0000 7f3b17a27640 1 -- 172.21.15.150:0/1084154001 shutdown_connections 2024-09-17T05:54:18.581 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:18.579+0000 7f3b17a27640 1 --2- 172.21.15.150:0/1084154001 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3b100c5b10 0x7f3b10162de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:54:18.581 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:18.579+0000 7f3b17a27640 1 --2- 172.21.15.150:0/1084154001 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f3afc07b430 0x7f3afc07d940 unknown :-1 s=CLOSED pgs=831 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:54:18.581 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:18.579+0000 7f3b17a27640 1 --2- 172.21.15.150:0/1084154001 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3b100d0770 0x7f3b100af990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:54:18.581 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:18.579+0000 7f3b17a27640 1 --2- 172.21.15.150:0/1084154001 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3b100b2c60 0x7f3b1015dcd0 unknown :-1 s=CLOSED pgs=1963 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:54:18.582 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:18.579+0000 7f3b17a27640 1 -- 172.21.15.150:0/1084154001 >> 172.21.15.150:0/1084154001 conn(0x7f3b100cef00 msgr2=0x7f3b10071db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:54:18.582 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:18.579+0000 7f3b17a27640 1 -- 172.21.15.150:0/1084154001 shutdown_connections 2024-09-17T05:54:18.582 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:18.579+0000 7f3b17a27640 1 -- 172.21.15.150:0/1084154001 wait complete. 2024-09-17T05:54:18.595 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume rm --force cephfs subvol_clone67871 2024-09-17T05:54:18.713 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:18.711+0000 7fcd7a494640 1 -- 172.21.15.150:0/2091423886 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fcd740cf840 msgr2=0x7fcd740cfc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:54:18.713 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:18.711+0000 7fcd7a494640 1 --2- 172.21.15.150:0/2091423886 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fcd740cf840 0x7fcd740cfc50 secure :-1 s=READY pgs=1964 cs=0 l=1 rev1=1 crypto rx=0x7fcd6c005fd0 tx=0x7fcd6c02aa90 comp rx=0 tx=0).stop 2024-09-17T05:54:18.713 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:18.711+0000 7fcd7a494640 1 -- 172.21.15.150:0/2091423886 shutdown_connections 2024-09-17T05:54:18.714 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:18.711+0000 7fcd7a494640 1 --2- 172.21.15.150:0/2091423886 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fcd740cf840 0x7fcd740cfc50 unknown :-1 s=CLOSED pgs=1964 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:54:18.714 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:18.711+0000 7fcd7a494640 1 --2- 172.21.15.150:0/2091423886 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fcd7406f3a0 0x7fcd740cf300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:54:18.714 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:18.711+0000 7fcd7a494640 1 -- 172.21.15.150:0/2091423886 >> 172.21.15.150:0/2091423886 conn(0x7fcd740d46f0 msgr2=0x7fcd740d4b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:54:18.714 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:18.711+0000 7fcd7a494640 1 -- 172.21.15.150:0/2091423886 shutdown_connections 2024-09-17T05:54:18.714 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:18.711+0000 7fcd7a494640 1 -- 172.21.15.150:0/2091423886 wait complete. 2024-09-17T05:54:18.715 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:18.712+0000 7fcd7a494640 1 Processor -- start 2024-09-17T05:54:18.715 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:18.713+0000 7fcd7a494640 1 -- start start 2024-09-17T05:54:18.721 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:18.714+0000 7fcd7a494640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fcd7406f3a0 0x7fcd7414efc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:54:18.722 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:18.714+0000 7fcd7a494640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fcd740cf840 0x7fcd7414e750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:54:18.722 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:18.714+0000 7fcd7a494640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fcd740d0d20 0x7fcd7409ea00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:54:18.722 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:18.714+0000 7fcd7a494640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7fcd740ba220 con 0x7fcd740d0d20 2024-09-17T05:54:18.723 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:18.714+0000 7fcd7a494640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fcd740d0190 con 0x7fcd7406f3a0 2024-09-17T05:54:18.723 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:18.714+0000 7fcd7a494640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fcd740d0310 con 0x7fcd740cf840 2024-09-17T05:54:18.723 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:18.714+0000 7fcd78a31640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fcd740d0d20 0x7fcd7409ea00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:54:18.723 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:18.714+0000 7fcd78a31640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fcd740d0d20 0x7fcd7409ea00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:43124/0 (socket says 172.21.15.150:43124) 2024-09-17T05:54:18.723 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:18.714+0000 7fcd78a31640 1 -- 172.21.15.150:0/1918430068 learned_addr learned my addr 172.21.15.150:0/1918430068 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:54:18.723 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:18.714+0000 7fcd73fff640 1 --2- 172.21.15.150:0/1918430068 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fcd7406f3a0 0x7fcd7414efc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:54:18.723 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:18.714+0000 7fcd737fe640 1 --2- 172.21.15.150:0/1918430068 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fcd740cf840 0x7fcd7414e750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:54:18.723 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:18.714+0000 7fcd78a31640 1 -- 172.21.15.150:0/1918430068 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fcd740cf840 msgr2=0x7fcd7414e750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:54:18.724 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:18.714+0000 7fcd78a31640 1 --2- 172.21.15.150:0/1918430068 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fcd740cf840 0x7fcd7414e750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:54:18.724 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:18.714+0000 7fcd78a31640 1 -- 172.21.15.150:0/1918430068 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fcd7406f3a0 msgr2=0x7fcd7414efc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:54:18.724 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:18.714+0000 7fcd78a31640 1 --2- 172.21.15.150:0/1918430068 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fcd7406f3a0 0x7fcd7414efc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:54:18.724 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:18.714+0000 7fcd78a31640 1 -- 172.21.15.150:0/1918430068 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcd7414ec90 con 0x7fcd740d0d20 2024-09-17T05:54:18.724 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:18.715+0000 7fcd78a31640 1 --2- 172.21.15.150:0/1918430068 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fcd740d0d20 0x7fcd7409ea00 secure :-1 s=READY pgs=1965 cs=0 l=1 rev1=1 crypto rx=0x7fcd6c006010 tx=0x7fcd6c003f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:54:18.724 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:18.715+0000 7fcd70ff9640 1 -- 172.21.15.150:0/1918430068 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd6c044070 con 0x7fcd740d0d20 2024-09-17T05:54:18.724 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:18.715+0000 7fcd70ff9640 1 -- 172.21.15.150:0/1918430068 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fcd6c02e7f0 con 0x7fcd740d0d20 2024-09-17T05:54:18.724 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:18.715+0000 7fcd7a494640 1 -- 172.21.15.150:0/1918430068 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcd7415e740 con 0x7fcd740d0d20 2024-09-17T05:54:18.724 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:18.715+0000 7fcd70ff9640 1 -- 172.21.15.150:0/1918430068 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd6c0044b0 con 0x7fcd740d0d20 2024-09-17T05:54:18.724 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:18.715+0000 7fcd7a494640 1 -- 172.21.15.150:0/1918430068 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcd7415ed00 con 0x7fcd740d0d20 2024-09-17T05:54:18.724 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:18.716+0000 7fcd7a494640 1 -- 172.21.15.150:0/1918430068 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcd740b2a10 con 0x7fcd740d0d20 2024-09-17T05:54:18.724 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:18.717+0000 7fcd70ff9640 1 -- 172.21.15.150:0/1918430068 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 51) ==== 104960+0+0 (secure 0 0 0) 0x7fcd6c047070 con 0x7fcd740d0d20 2024-09-17T05:54:18.725 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:18.717+0000 7fcd70ff9640 1 --2- 172.21.15.150:0/1918430068 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fcd6007b290 0x7fcd6007d7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:54:18.725 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:18.717+0000 7fcd70ff9640 1 -- 172.21.15.150:0/1918430068 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(143..143 src has 1..143) ==== 5934+0+0 (secure 0 0 0) 0x7fcd6c0bae20 con 0x7fcd740d0d20 2024-09-17T05:54:18.725 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:18.718+0000 7fcd73fff640 1 --2- 172.21.15.150:0/1918430068 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fcd6007b290 0x7fcd6007d7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:54:18.725 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:18.718+0000 7fcd73fff640 1 --2- 172.21.15.150:0/1918430068 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fcd6007b290 0x7fcd6007d7a0 secure :-1 s=READY pgs=832 cs=0 l=1 rev1=1 crypto rx=0x7fcd64001720 tx=0x7fcd64009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:54:18.725 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:18.722+0000 7fcd70ff9640 1 -- 172.21.15.150:0/1918430068 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fcd740b2a10 con 0x7fcd740d0d20 2024-09-17T05:54:18.923 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:18.922+0000 7fcd7a494640 1 -- 172.21.15.150:0/1918430068 --> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] -- mgr_command(tid 0: {"prefix": "fs subvolume rm", "force": true, "vol_name": "cephfs", "sub_name": "subvol_clone67871", "target": ["mon-mgr", ""]}) -- 0x7fcd740d07c0 con 0x7fcd6007b290 2024-09-17T05:54:18.945 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:18.940+0000 7fcd70ff9640 1 -- 172.21.15.150:0/1918430068 <== mgr.4108 v2:172.21.15.176:6800/3631216395 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7fcd740d07c0 con 0x7fcd6007b290 2024-09-17T05:54:18.945 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:18.942+0000 7fcd7a494640 1 -- 172.21.15.150:0/1918430068 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fcd6007b290 msgr2=0x7fcd6007d7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:54:18.945 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:18.942+0000 7fcd7a494640 1 --2- 172.21.15.150:0/1918430068 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fcd6007b290 0x7fcd6007d7a0 secure :-1 s=READY pgs=832 cs=0 l=1 rev1=1 crypto rx=0x7fcd64001720 tx=0x7fcd64009040 comp rx=0 tx=0).stop 2024-09-17T05:54:18.945 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:18.942+0000 7fcd7a494640 1 -- 172.21.15.150:0/1918430068 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fcd740d0d20 msgr2=0x7fcd7409ea00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:54:18.945 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:18.942+0000 7fcd7a494640 1 --2- 172.21.15.150:0/1918430068 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fcd740d0d20 0x7fcd7409ea00 secure :-1 s=READY pgs=1965 cs=0 l=1 rev1=1 crypto rx=0x7fcd6c006010 tx=0x7fcd6c003f10 comp rx=0 tx=0).stop 2024-09-17T05:54:18.945 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:18.943+0000 7fcd7a494640 1 -- 172.21.15.150:0/1918430068 shutdown_connections 2024-09-17T05:54:18.945 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:18.943+0000 7fcd7a494640 1 --2- 172.21.15.150:0/1918430068 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fcd6007b290 0x7fcd6007d7a0 unknown :-1 s=CLOSED pgs=832 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:54:18.945 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:18.943+0000 7fcd7a494640 1 --2- 172.21.15.150:0/1918430068 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fcd740d0d20 0x7fcd7409ea00 unknown :-1 s=CLOSED pgs=1965 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:54:18.946 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:18.943+0000 7fcd7a494640 1 --2- 172.21.15.150:0/1918430068 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fcd740cf840 0x7fcd7414e750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:54:18.946 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:18.943+0000 7fcd7a494640 1 --2- 172.21.15.150:0/1918430068 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fcd7406f3a0 0x7fcd7414efc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:54:18.946 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:18.943+0000 7fcd7a494640 1 -- 172.21.15.150:0/1918430068 >> 172.21.15.150:0/1918430068 conn(0x7fcd740d46f0 msgr2=0x7fcd740b7520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:54:18.946 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:18.943+0000 7fcd7a494640 1 -- 172.21.15.150:0/1918430068 shutdown_connections 2024-09-17T05:54:18.946 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:18.943+0000 7fcd7a494640 1 -- 172.21.15.150:0/1918430068 wait complete. 2024-09-17T05:54:18.957 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume rm --force cephfs subvol_clone58715 2024-09-17T05:54:19.077 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:19.075+0000 7f1bad7ed640 1 -- 172.21.15.150:0/4173489056 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1ba80b5250 msgr2=0x7f1ba80b5660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:54:19.077 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:19.075+0000 7f1bad7ed640 1 --2- 172.21.15.150:0/4173489056 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1ba80b5250 0x7f1ba80b5660 secure :-1 s=READY pgs=1966 cs=0 l=1 rev1=1 crypto rx=0x7f1ba8073e60 tx=0x7f1b9c02a560 comp rx=0 tx=0).stop 2024-09-17T05:54:19.077 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:19.075+0000 7f1bad7ed640 1 -- 172.21.15.150:0/4173489056 shutdown_connections 2024-09-17T05:54:19.077 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:19.075+0000 7f1bad7ed640 1 --2- 172.21.15.150:0/4173489056 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1ba80d0ee0 0x7f1ba80d12f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:54:19.077 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:19.075+0000 7f1bad7ed640 1 --2- 172.21.15.150:0/4173489056 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1ba80b5250 0x7f1ba80b5660 unknown :-1 s=CLOSED pgs=1966 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:54:19.077 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:19.075+0000 7f1bad7ed640 1 --2- 172.21.15.150:0/4173489056 >> v2:172.21.15.176:3300/0 conn(0x7f1ba80d01b0 0x7f1ba80d05c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:54:19.078 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:19.075+0000 7f1bad7ed640 1 -- 172.21.15.150:0/4173489056 >> 172.21.15.150:0/4173489056 conn(0x7f1ba80cee80 msgr2=0x7f1ba80cf290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:54:19.078 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:19.075+0000 7f1bad7ed640 1 -- 172.21.15.150:0/4173489056 shutdown_connections 2024-09-17T05:54:19.078 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:19.075+0000 7f1bad7ed640 1 -- 172.21.15.150:0/4173489056 wait complete. 2024-09-17T05:54:19.078 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:19.077+0000 7f1bad7ed640 1 Processor -- start 2024-09-17T05:54:19.078 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:19.077+0000 7f1bad7ed640 1 -- start start 2024-09-17T05:54:19.081 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:19.078+0000 7f1bad7ed640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1ba80b5250 0x7f1ba809c160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:54:19.081 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:19.078+0000 7f1bad7ed640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1ba80d01b0 0x7f1ba815b6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:54:19.081 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:19.078+0000 7f1bad7ed640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1ba80d0ee0 0x7f1ba815c710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:54:19.081 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:19.078+0000 7f1bad7ed640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f1ba809bc70 con 0x7f1ba80d01b0 2024-09-17T05:54:19.081 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:19.078+0000 7f1bad7ed640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f1ba809baf0 con 0x7f1ba80d0ee0 2024-09-17T05:54:19.081 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:19.078+0000 7f1bad7ed640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f1ba8160a30 con 0x7f1ba80b5250 2024-09-17T05:54:19.081 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:19.078+0000 7f1ba67fc640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1ba80d01b0 0x7f1ba815b6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:54:19.082 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:19.078+0000 7f1ba67fc640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1ba80d01b0 0x7f1ba815b6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:43144/0 (socket says 172.21.15.150:43144) 2024-09-17T05:54:19.082 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:19.078+0000 7f1ba67fc640 1 -- 172.21.15.150:0/1596725918 learned_addr learned my addr 172.21.15.150:0/1596725918 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:54:19.082 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:19.078+0000 7f1ba6ffd640 1 --2- 172.21.15.150:0/1596725918 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1ba80b5250 0x7f1ba809c160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:54:19.082 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:19.078+0000 7f1ba77fe640 1 --2- 172.21.15.150:0/1596725918 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1ba80d0ee0 0x7f1ba815c710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:54:19.082 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:19.079+0000 7f1ba67fc640 1 -- 172.21.15.150:0/1596725918 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1ba80b5250 msgr2=0x7f1ba809c160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:54:19.082 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:19.079+0000 7f1ba67fc640 1 --2- 172.21.15.150:0/1596725918 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1ba80b5250 0x7f1ba809c160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:54:19.082 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:19.079+0000 7f1ba67fc640 1 -- 172.21.15.150:0/1596725918 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1ba80d0ee0 msgr2=0x7f1ba815c710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:54:19.082 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:19.079+0000 7f1ba67fc640 1 --2- 172.21.15.150:0/1596725918 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1ba80d0ee0 0x7f1ba815c710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:54:19.082 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:19.079+0000 7f1ba67fc640 1 -- 172.21.15.150:0/1596725918 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1ba809c6a0 con 0x7f1ba80d01b0 2024-09-17T05:54:19.082 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:19.079+0000 7f1ba67fc640 1 --2- 172.21.15.150:0/1596725918 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1ba80d01b0 0x7f1ba815b6e0 secure :-1 s=READY pgs=1967 cs=0 l=1 rev1=1 crypto rx=0x7f1b9c034040 tx=0x7f1b9c003910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:54:19.082 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:19.079+0000 7f1b8f7fe640 1 -- 172.21.15.150:0/1596725918 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b9c03e030 con 0x7f1ba80d01b0 2024-09-17T05:54:19.082 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:19.079+0000 7f1b8f7fe640 1 -- 172.21.15.150:0/1596725918 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f1b9c003e00 con 0x7f1ba80d01b0 2024-09-17T05:54:19.082 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:19.079+0000 7f1bad7ed640 1 -- 172.21.15.150:0/1596725918 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1ba809edf0 con 0x7f1ba80d01b0 2024-09-17T05:54:19.083 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:19.079+0000 7f1b8f7fe640 1 -- 172.21.15.150:0/1596725918 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b9c035040 con 0x7f1ba80d01b0 2024-09-17T05:54:19.083 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:19.079+0000 7f1bad7ed640 1 -- 172.21.15.150:0/1596725918 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1ba81f6f80 con 0x7f1ba80d01b0 2024-09-17T05:54:19.083 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:19.080+0000 7f1bad7ed640 1 -- 172.21.15.150:0/1596725918 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1ba80d05c0 con 0x7f1ba80d01b0 2024-09-17T05:54:19.084 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:19.081+0000 7f1b8f7fe640 1 -- 172.21.15.150:0/1596725918 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 51) ==== 104960+0+0 (secure 0 0 0) 0x7f1b9c041030 con 0x7f1ba80d01b0 2024-09-17T05:54:19.084 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:19.081+0000 7f1b8f7fe640 1 --2- 172.21.15.150:0/1596725918 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f1b9407b260 0x7f1b9407d770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:54:19.084 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:19.081+0000 7f1b8f7fe640 1 -- 172.21.15.150:0/1596725918 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(143..143 src has 1..143) ==== 5934+0+0 (secure 0 0 0) 0x7f1b9c0ba850 con 0x7f1ba80d01b0 2024-09-17T05:54:19.084 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:19.081+0000 7f1ba6ffd640 1 --2- 172.21.15.150:0/1596725918 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f1b9407b260 0x7f1b9407d770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:54:19.084 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:19.082+0000 7f1ba6ffd640 1 --2- 172.21.15.150:0/1596725918 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f1b9407b260 0x7f1b9407d770 secure :-1 s=READY pgs=833 cs=0 l=1 rev1=1 crypto rx=0x7f1b98005fd0 tx=0x7f1b9800b260 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:54:19.088 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:19.086+0000 7f1b8f7fe640 1 -- 172.21.15.150:0/1596725918 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f1b9c0840c0 con 0x7f1ba80d01b0 2024-09-17T05:54:19.290 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:19.289+0000 7f1bad7ed640 1 -- 172.21.15.150:0/1596725918 --> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] -- mgr_command(tid 0: {"prefix": "fs subvolume rm", "force": true, "vol_name": "cephfs", "sub_name": "subvol_clone58715", "target": ["mon-mgr", ""]}) -- 0x7f1ba80ce030 con 0x7f1b9407b260 2024-09-17T05:54:19.307 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:19.305+0000 7f1b8f7fe640 1 -- 172.21.15.150:0/1596725918 <== mgr.4108 v2:172.21.15.176:6800/3631216395 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f1ba80ce030 con 0x7f1b9407b260 2024-09-17T05:54:19.309 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:19.307+0000 7f1bad7ed640 1 -- 172.21.15.150:0/1596725918 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f1b9407b260 msgr2=0x7f1b9407d770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:54:19.310 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:19.307+0000 7f1bad7ed640 1 --2- 172.21.15.150:0/1596725918 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f1b9407b260 0x7f1b9407d770 secure :-1 s=READY pgs=833 cs=0 l=1 rev1=1 crypto rx=0x7f1b98005fd0 tx=0x7f1b9800b260 comp rx=0 tx=0).stop 2024-09-17T05:54:19.310 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:19.307+0000 7f1bad7ed640 1 -- 172.21.15.150:0/1596725918 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1ba80d01b0 msgr2=0x7f1ba815b6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:54:19.310 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:19.307+0000 7f1bad7ed640 1 --2- 172.21.15.150:0/1596725918 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1ba80d01b0 0x7f1ba815b6e0 secure :-1 s=READY pgs=1967 cs=0 l=1 rev1=1 crypto rx=0x7f1b9c034040 tx=0x7f1b9c003910 comp rx=0 tx=0).stop 2024-09-17T05:54:19.310 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:19.308+0000 7f1bad7ed640 1 -- 172.21.15.150:0/1596725918 shutdown_connections 2024-09-17T05:54:19.310 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:19.308+0000 7f1bad7ed640 1 --2- 172.21.15.150:0/1596725918 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1ba80d0ee0 0x7f1ba815c710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:54:19.310 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:19.308+0000 7f1bad7ed640 1 --2- 172.21.15.150:0/1596725918 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f1b9407b260 0x7f1b9407d770 unknown :-1 s=CLOSED pgs=833 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:54:19.310 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:19.308+0000 7f1bad7ed640 1 --2- 172.21.15.150:0/1596725918 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1ba80d01b0 0x7f1ba815b6e0 unknown :-1 s=CLOSED pgs=1967 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:54:19.310 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:19.308+0000 7f1bad7ed640 1 --2- 172.21.15.150:0/1596725918 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1ba80b5250 0x7f1ba809c160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:54:19.310 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:19.308+0000 7f1bad7ed640 1 -- 172.21.15.150:0/1596725918 >> 172.21.15.150:0/1596725918 conn(0x7f1ba80cee80 msgr2=0x7f1ba8071b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:54:19.310 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:19.308+0000 7f1bad7ed640 1 -- 172.21.15.150:0/1596725918 shutdown_connections 2024-09-17T05:54:19.310 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:19.308+0000 7f1bad7ed640 1 -- 172.21.15.150:0/1596725918 wait complete. 2024-09-17T05:54:19.322 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume rm --force cephfs subvol_clone48513 2024-09-17T05:54:19.440 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:19.438+0000 7f3c4af51640 1 -- 172.21.15.150:0/2218694266 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3c4415ca70 msgr2=0x7f3c4415d8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:54:19.441 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:19.438+0000 7f3c4af51640 1 --2- 172.21.15.150:0/2218694266 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3c4415ca70 0x7f3c4415d8a0 secure :-1 s=READY pgs=1968 cs=0 l=1 rev1=1 crypto rx=0x7f3c44073f70 tx=0x7f3c3402a580 comp rx=0 tx=0).stop 2024-09-17T05:54:19.441 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:19.438+0000 7f3c4af51640 1 -- 172.21.15.150:0/2218694266 shutdown_connections 2024-09-17T05:54:19.441 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:19.438+0000 7f3c4af51640 1 --2- 172.21.15.150:0/2218694266 >> v2:172.21.15.176:3300/0 conn(0x7f3c440ae6e0 0x7f3c4406d2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:54:19.441 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:19.438+0000 7f3c4af51640 1 --2- 172.21.15.150:0/2218694266 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3c440ae2d0 0x7f3c4406cda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:54:19.441 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:19.438+0000 7f3c4af51640 1 --2- 172.21.15.150:0/2218694266 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3c4415ca70 0x7f3c4415d8a0 unknown :-1 s=CLOSED pgs=1968 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:54:19.441 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:19.438+0000 7f3c4af51640 1 -- 172.21.15.150:0/2218694266 >> 172.21.15.150:0/2218694266 conn(0x7f3c4409aa50 msgr2=0x7f3c440b2ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:54:19.441 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:19.438+0000 7f3c4af51640 1 -- 172.21.15.150:0/2218694266 shutdown_connections 2024-09-17T05:54:19.441 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:19.438+0000 7f3c4af51640 1 -- 172.21.15.150:0/2218694266 wait complete. 2024-09-17T05:54:19.442 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:19.440+0000 7f3c4af51640 1 Processor -- start 2024-09-17T05:54:19.442 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:19.441+0000 7f3c4af51640 1 -- start start 2024-09-17T05:54:19.446 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:19.442+0000 7f3c4af51640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3c440ae2d0 0x7f3c441f3f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:54:19.446 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:19.442+0000 7f3c4af51640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3c440ae6e0 0x7f3c441f0890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:54:19.446 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:19.442+0000 7f3c4af51640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3c4415ca70 0x7f3c440b1a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:54:19.446 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:19.442+0000 7f3c4af51640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f3c4415e260 con 0x7f3c440ae2d0 2024-09-17T05:54:19.446 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:19.442+0000 7f3c4af51640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f3c4415e0e0 con 0x7f3c440ae6e0 2024-09-17T05:54:19.446 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:19.442+0000 7f3c4af51640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f3c4415e3e0 con 0x7f3c4415ca70 2024-09-17T05:54:19.446 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:19.442+0000 7f3c48ced640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3c440ae2d0 0x7f3c441f3f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:54:19.446 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:19.442+0000 7f3c48ced640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3c440ae2d0 0x7f3c441f3f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:43162/0 (socket says 172.21.15.150:43162) 2024-09-17T05:54:19.446 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:19.442+0000 7f3c48ced640 1 -- 172.21.15.150:0/3106091979 learned_addr learned my addr 172.21.15.150:0/3106091979 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:54:19.446 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:19.442+0000 7f3c494ee640 1 --2- 172.21.15.150:0/3106091979 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3c4415ca70 0x7f3c440b1a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:54:19.446 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:19.442+0000 7f3c43fff640 1 --2- 172.21.15.150:0/3106091979 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3c440ae6e0 0x7f3c441f0890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:54:19.446 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:19.443+0000 7f3c48ced640 1 -- 172.21.15.150:0/3106091979 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3c4415ca70 msgr2=0x7f3c440b1a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:54:19.447 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:19.443+0000 7f3c48ced640 1 --2- 172.21.15.150:0/3106091979 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3c4415ca70 0x7f3c440b1a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:54:19.447 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:19.443+0000 7f3c48ced640 1 -- 172.21.15.150:0/3106091979 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3c440ae6e0 msgr2=0x7f3c441f0890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:54:19.447 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:19.443+0000 7f3c48ced640 1 --2- 172.21.15.150:0/3106091979 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3c440ae6e0 0x7f3c441f0890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:54:19.447 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:19.443+0000 7f3c48ced640 1 -- 172.21.15.150:0/3106091979 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3c440aff70 con 0x7f3c440ae2d0 2024-09-17T05:54:19.447 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:19.443+0000 7f3c48ced640 1 --2- 172.21.15.150:0/3106091979 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3c440ae2d0 0x7f3c441f3f70 secure :-1 s=READY pgs=1969 cs=0 l=1 rev1=1 crypto rx=0x7f3c34009850 tx=0x7f3c340039e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:54:19.447 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:19.443+0000 7f3c417fa640 1 -- 172.21.15.150:0/3106091979 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c3403e030 con 0x7f3c440ae2d0 2024-09-17T05:54:19.447 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:19.443+0000 7f3c417fa640 1 -- 172.21.15.150:0/3106091979 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f3c340047a0 con 0x7f3c440ae2d0 2024-09-17T05:54:19.447 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:19.443+0000 7f3c417fa640 1 -- 172.21.15.150:0/3106091979 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c34035040 con 0x7f3c440ae2d0 2024-09-17T05:54:19.447 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:19.443+0000 7f3c4af51640 1 -- 172.21.15.150:0/3106091979 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3c440b0250 con 0x7f3c440ae2d0 2024-09-17T05:54:19.447 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:19.443+0000 7f3c4af51640 1 -- 172.21.15.150:0/3106091979 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3c440b0810 con 0x7f3c440ae2d0 2024-09-17T05:54:19.447 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:19.444+0000 7f3c4af51640 1 -- 172.21.15.150:0/3106091979 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3c4415e960 con 0x7f3c440ae2d0 2024-09-17T05:54:19.448 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:19.445+0000 7f3c417fa640 1 -- 172.21.15.150:0/3106091979 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 51) ==== 104960+0+0 (secure 0 0 0) 0x7f3c34041030 con 0x7f3c440ae2d0 2024-09-17T05:54:19.448 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:19.445+0000 7f3c417fa640 1 --2- 172.21.15.150:0/3106091979 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f3c2407b260 0x7f3c2407d770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:54:19.448 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:19.446+0000 7f3c417fa640 1 -- 172.21.15.150:0/3106091979 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(143..143 src has 1..143) ==== 5934+0+0 (secure 0 0 0) 0x7f3c340ba7b0 con 0x7f3c440ae2d0 2024-09-17T05:54:19.448 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:19.446+0000 7f3c43fff640 1 --2- 172.21.15.150:0/3106091979 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f3c2407b260 0x7f3c2407d770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:54:19.448 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:19.446+0000 7f3c43fff640 1 --2- 172.21.15.150:0/3106091979 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f3c2407b260 0x7f3c2407d770 secure :-1 s=READY pgs=834 cs=0 l=1 rev1=1 crypto rx=0x7f3c4414e6a0 tx=0x7f3c2c009060 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:54:19.451 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:19.450+0000 7f3c417fa640 1 -- 172.21.15.150:0/3106091979 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f3c340840a0 con 0x7f3c440ae2d0 2024-09-17T05:54:19.714 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:19.713+0000 7f3c4af51640 1 -- 172.21.15.150:0/3106091979 --> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] -- mgr_command(tid 0: {"prefix": "fs subvolume rm", "force": true, "vol_name": "cephfs", "sub_name": "subvol_clone48513", "target": ["mon-mgr", ""]}) -- 0x7f3c44158bb0 con 0x7f3c2407b260 2024-09-17T05:54:19.729 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:19.727+0000 7f3c417fa640 1 -- 172.21.15.150:0/3106091979 <== mgr.4108 v2:172.21.15.176:6800/3631216395 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f3c44158bb0 con 0x7f3c2407b260 2024-09-17T05:54:19.731 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:19.729+0000 7f3c4af51640 1 -- 172.21.15.150:0/3106091979 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f3c2407b260 msgr2=0x7f3c2407d770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:54:19.732 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:19.729+0000 7f3c4af51640 1 --2- 172.21.15.150:0/3106091979 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f3c2407b260 0x7f3c2407d770 secure :-1 s=READY pgs=834 cs=0 l=1 rev1=1 crypto rx=0x7f3c4414e6a0 tx=0x7f3c2c009060 comp rx=0 tx=0).stop 2024-09-17T05:54:19.732 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:19.729+0000 7f3c4af51640 1 -- 172.21.15.150:0/3106091979 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3c440ae2d0 msgr2=0x7f3c441f3f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:54:19.732 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:19.729+0000 7f3c4af51640 1 --2- 172.21.15.150:0/3106091979 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3c440ae2d0 0x7f3c441f3f70 secure :-1 s=READY pgs=1969 cs=0 l=1 rev1=1 crypto rx=0x7f3c34009850 tx=0x7f3c340039e0 comp rx=0 tx=0).stop 2024-09-17T05:54:19.732 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:19.729+0000 7f3c4af51640 1 -- 172.21.15.150:0/3106091979 shutdown_connections 2024-09-17T05:54:19.732 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:19.729+0000 7f3c4af51640 1 --2- 172.21.15.150:0/3106091979 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3c440ae6e0 0x7f3c441f0890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:54:19.732 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:19.729+0000 7f3c4af51640 1 --2- 172.21.15.150:0/3106091979 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f3c2407b260 0x7f3c2407d770 unknown :-1 s=CLOSED pgs=834 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:54:19.732 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:19.729+0000 7f3c4af51640 1 --2- 172.21.15.150:0/3106091979 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3c4415ca70 0x7f3c440b1a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:54:19.732 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:19.729+0000 7f3c4af51640 1 --2- 172.21.15.150:0/3106091979 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3c440ae2d0 0x7f3c441f3f70 unknown :-1 s=CLOSED pgs=1969 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:54:19.732 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:19.729+0000 7f3c4af51640 1 -- 172.21.15.150:0/3106091979 >> 172.21.15.150:0/3106091979 conn(0x7f3c4409aa50 msgr2=0x7f3c4415fb10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:54:19.732 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:19.729+0000 7f3c4af51640 1 -- 172.21.15.150:0/3106091979 shutdown_connections 2024-09-17T05:54:19.732 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:19.729+0000 7f3c4af51640 1 -- 172.21.15.150:0/3106091979 wait complete. 2024-09-17T05:54:19.746 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume rm --force cephfs subvol_clone02 2024-09-17T05:54:19.868 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:19.865+0000 7fb9c8b9d640 1 -- 172.21.15.150:0/1624360058 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb9c4074430 msgr2=0x7fb9c4071390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:54:19.868 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:19.865+0000 7fb9c8b9d640 1 --2- 172.21.15.150:0/1624360058 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb9c4074430 0x7fb9c4071390 secure :-1 s=READY pgs=1970 cs=0 l=1 rev1=1 crypto rx=0x7fb9c406a900 tx=0x7fb9b802a440 comp rx=0 tx=0).stop 2024-09-17T05:54:19.868 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:19.865+0000 7fb9c8b9d640 1 -- 172.21.15.150:0/1624360058 shutdown_connections 2024-09-17T05:54:19.868 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:19.865+0000 7fb9c8b9d640 1 --2- 172.21.15.150:0/1624360058 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb9c40718d0 0x7fb9c415f0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:54:19.868 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:19.865+0000 7fb9c8b9d640 1 --2- 172.21.15.150:0/1624360058 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb9c4074430 0x7fb9c4071390 unknown :-1 s=CLOSED pgs=1970 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:54:19.868 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:19.865+0000 7fb9c8b9d640 1 --2- 172.21.15.150:0/1624360058 >> v2:172.21.15.176:3300/0 conn(0x7fb9c41591c0 0x7fb9c4073ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:54:19.868 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:19.865+0000 7fb9c8b9d640 1 -- 172.21.15.150:0/1624360058 >> 172.21.15.150:0/1624360058 conn(0x7fb9c40d1180 msgr2=0x7fb9c40d1590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:54:19.868 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:19.866+0000 7fb9c8b9d640 1 -- 172.21.15.150:0/1624360058 shutdown_connections 2024-09-17T05:54:19.868 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:19.866+0000 7fb9c8b9d640 1 -- 172.21.15.150:0/1624360058 wait complete. 2024-09-17T05:54:19.869 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:19.867+0000 7fb9c8b9d640 1 Processor -- start 2024-09-17T05:54:19.869 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:19.867+0000 7fb9c8b9d640 1 -- start start 2024-09-17T05:54:19.871 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:19.869+0000 7fb9c8b9d640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb9c40718d0 0x7fb9c41f6180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:54:19.872 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:19.869+0000 7fb9c8b9d640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb9c4074430 0x7fb9c4157da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:54:19.872 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:19.869+0000 7fb9c8b9d640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb9c41591c0 0x7fb9c41f2230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:54:19.872 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:19.869+0000 7fb9c8b9d640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7fb9c415f790 con 0x7fb9c40718d0 2024-09-17T05:54:19.872 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:19.869+0000 7fb9c8b9d640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fb9c415f610 con 0x7fb9c4074430 2024-09-17T05:54:19.872 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:19.869+0000 7fb9c8b9d640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fb9c415f910 con 0x7fb9c41591c0 2024-09-17T05:54:19.872 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:19.869+0000 7fb9c37fe640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb9c40718d0 0x7fb9c41f6180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:54:19.872 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:19.869+0000 7fb9c37fe640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb9c40718d0 0x7fb9c41f6180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:43186/0 (socket says 172.21.15.150:43186) 2024-09-17T05:54:19.872 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:19.869+0000 7fb9c37fe640 1 -- 172.21.15.150:0/2641893535 learned_addr learned my addr 172.21.15.150:0/2641893535 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:54:19.872 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:19.869+0000 7fb9c3fff640 1 --2- 172.21.15.150:0/2641893535 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb9c41591c0 0x7fb9c41f2230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:54:19.872 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:19.869+0000 7fb9c2ffd640 1 --2- 172.21.15.150:0/2641893535 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb9c4074430 0x7fb9c4157da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:54:19.872 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:19.869+0000 7fb9c37fe640 1 -- 172.21.15.150:0/2641893535 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb9c41591c0 msgr2=0x7fb9c41f2230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:54:19.872 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:19.869+0000 7fb9c37fe640 1 --2- 172.21.15.150:0/2641893535 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb9c41591c0 0x7fb9c41f2230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:54:19.873 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:19.869+0000 7fb9c37fe640 1 -- 172.21.15.150:0/2641893535 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb9c4074430 msgr2=0x7fb9c4157da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:54:19.873 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:19.869+0000 7fb9c37fe640 1 --2- 172.21.15.150:0/2641893535 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb9c4074430 0x7fb9c4157da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:54:19.873 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:19.869+0000 7fb9c37fe640 1 -- 172.21.15.150:0/2641893535 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb9c40b6e90 con 0x7fb9c40718d0 2024-09-17T05:54:19.873 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:19.869+0000 7fb9c37fe640 1 --2- 172.21.15.150:0/2641893535 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb9c40718d0 0x7fb9c41f6180 secure :-1 s=READY pgs=1971 cs=0 l=1 rev1=1 crypto rx=0x7fb9b400e790 tx=0x7fb9b400eb90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:54:19.873 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:19.870+0000 7fb9abfff640 1 -- 172.21.15.150:0/2641893535 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9b400cab0 con 0x7fb9c40718d0 2024-09-17T05:54:19.873 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:19.870+0000 7fb9c8b9d640 1 -- 172.21.15.150:0/2641893535 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb9c40cb2d0 con 0x7fb9c40718d0 2024-09-17T05:54:19.873 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:19.870+0000 7fb9abfff640 1 -- 172.21.15.150:0/2641893535 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb9b400cd40 con 0x7fb9c40718d0 2024-09-17T05:54:19.873 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:19.870+0000 7fb9abfff640 1 -- 172.21.15.150:0/2641893535 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9b4010690 con 0x7fb9c40718d0 2024-09-17T05:54:19.873 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:19.870+0000 7fb9c8b9d640 1 -- 172.21.15.150:0/2641893535 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb9c41f66c0 con 0x7fb9c40718d0 2024-09-17T05:54:19.874 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:19.871+0000 7fb9c8b9d640 1 -- 172.21.15.150:0/2641893535 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb9c415fd80 con 0x7fb9c40718d0 2024-09-17T05:54:19.874 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:19.871+0000 7fb9abfff640 1 -- 172.21.15.150:0/2641893535 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 51) ==== 104960+0+0 (secure 0 0 0) 0x7fb9b4010830 con 0x7fb9c40718d0 2024-09-17T05:54:19.874 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:19.872+0000 7fb9abfff640 1 --2- 172.21.15.150:0/2641893535 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fb9b007b290 0x7fb9b007d7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:54:19.875 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:19.872+0000 7fb9abfff640 1 -- 172.21.15.150:0/2641893535 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(143..143 src has 1..143) ==== 5934+0+0 (secure 0 0 0) 0x7fb9b409a880 con 0x7fb9c40718d0 2024-09-17T05:54:19.875 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:19.872+0000 7fb9c2ffd640 1 --2- 172.21.15.150:0/2641893535 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fb9b007b290 0x7fb9b007d7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:54:19.875 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:19.872+0000 7fb9c2ffd640 1 --2- 172.21.15.150:0/2641893535 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fb9b007b290 0x7fb9b007d7a0 secure :-1 s=READY pgs=835 cs=0 l=1 rev1=1 crypto rx=0x7fb9b8033000 tx=0x7fb9b8004730 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:54:19.878 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:19.876+0000 7fb9abfff640 1 -- 172.21.15.150:0/2641893535 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fb9b4064180 con 0x7fb9c40718d0 2024-09-17T05:54:20.080 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:20.079+0000 7fb9c8b9d640 1 -- 172.21.15.150:0/2641893535 --> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] -- mgr_command(tid 0: {"prefix": "fs subvolume rm", "force": true, "vol_name": "cephfs", "sub_name": "subvol_clone02", "target": ["mon-mgr", ""]}) -- 0x7fb9c40cb080 con 0x7fb9b007b290 2024-09-17T05:54:20.095 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:20.093+0000 7fb9abfff640 1 -- 172.21.15.150:0/2641893535 <== mgr.4108 v2:172.21.15.176:6800/3631216395 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7fb9c40cb080 con 0x7fb9b007b290 2024-09-17T05:54:20.098 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:20.096+0000 7fb9c8b9d640 1 -- 172.21.15.150:0/2641893535 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fb9b007b290 msgr2=0x7fb9b007d7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:54:20.098 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:20.096+0000 7fb9c8b9d640 1 --2- 172.21.15.150:0/2641893535 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fb9b007b290 0x7fb9b007d7a0 secure :-1 s=READY pgs=835 cs=0 l=1 rev1=1 crypto rx=0x7fb9b8033000 tx=0x7fb9b8004730 comp rx=0 tx=0).stop 2024-09-17T05:54:20.098 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:20.096+0000 7fb9c8b9d640 1 -- 172.21.15.150:0/2641893535 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb9c40718d0 msgr2=0x7fb9c41f6180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:54:20.098 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:20.096+0000 7fb9c8b9d640 1 --2- 172.21.15.150:0/2641893535 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb9c40718d0 0x7fb9c41f6180 secure :-1 s=READY pgs=1971 cs=0 l=1 rev1=1 crypto rx=0x7fb9b400e790 tx=0x7fb9b400eb90 comp rx=0 tx=0).stop 2024-09-17T05:54:20.098 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:20.096+0000 7fb9c8b9d640 1 -- 172.21.15.150:0/2641893535 shutdown_connections 2024-09-17T05:54:20.098 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:20.096+0000 7fb9c8b9d640 1 --2- 172.21.15.150:0/2641893535 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb9c4074430 0x7fb9c4157da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:54:20.098 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:20.096+0000 7fb9c8b9d640 1 --2- 172.21.15.150:0/2641893535 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fb9b007b290 0x7fb9b007d7a0 unknown :-1 s=CLOSED pgs=835 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:54:20.099 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:20.096+0000 7fb9c8b9d640 1 --2- 172.21.15.150:0/2641893535 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb9c41591c0 0x7fb9c41f2230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:54:20.099 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:20.096+0000 7fb9c8b9d640 1 --2- 172.21.15.150:0/2641893535 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb9c40718d0 0x7fb9c41f6180 unknown :-1 s=CLOSED pgs=1971 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:54:20.099 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:20.096+0000 7fb9c8b9d640 1 -- 172.21.15.150:0/2641893535 >> 172.21.15.150:0/2641893535 conn(0x7fb9c40d1180 msgr2=0x7fb9c40afdd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:54:20.099 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:20.096+0000 7fb9c8b9d640 1 -- 172.21.15.150:0/2641893535 shutdown_connections 2024-09-17T05:54:20.099 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:20.096+0000 7fb9c8b9d640 1 -- 172.21.15.150:0/2641893535 wait complete. 2024-09-17T05:54:20.110 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume rm --force cephfs subvol_clone65316 2024-09-17T05:54:20.230 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:20.228+0000 7f728ff5f640 1 -- 172.21.15.150:0/1122480312 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f72880b3580 msgr2=0x7f72880d2c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:54:20.230 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:20.228+0000 7f728ff5f640 1 --2- 172.21.15.150:0/1122480312 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f72880b3580 0x7f72880d2c10 secure :-1 s=READY pgs=1972 cs=0 l=1 rev1=1 crypto rx=0x7f728808cc20 tx=0x7f728402a4b0 comp rx=0 tx=0).stop 2024-09-17T05:54:20.230 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:20.228+0000 7f728ff5f640 1 -- 172.21.15.150:0/1122480312 shutdown_connections 2024-09-17T05:54:20.230 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:20.228+0000 7f728ff5f640 1 --2- 172.21.15.150:0/1122480312 >> v2:172.21.15.176:3300/0 conn(0x7f72880b6160 0x7f72880b6570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:54:20.230 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:20.228+0000 7f728ff5f640 1 --2- 172.21.15.150:0/1122480312 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f72880b3ad0 0x7f72880d3150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:54:20.231 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:20.228+0000 7f728ff5f640 1 --2- 172.21.15.150:0/1122480312 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f72880b3580 0x7f72880d2c10 unknown :-1 s=CLOSED pgs=1972 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:54:20.231 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:20.228+0000 7f728ff5f640 1 -- 172.21.15.150:0/1122480312 >> 172.21.15.150:0/1122480312 conn(0x7f72880d46e0 msgr2=0x7f72880d4af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:54:20.231 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:20.228+0000 7f728ff5f640 1 -- 172.21.15.150:0/1122480312 shutdown_connections 2024-09-17T05:54:20.231 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:20.228+0000 7f728ff5f640 1 -- 172.21.15.150:0/1122480312 wait complete. 2024-09-17T05:54:20.231 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:20.230+0000 7f728ff5f640 1 Processor -- start 2024-09-17T05:54:20.231 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:20.230+0000 7f728ff5f640 1 -- start start 2024-09-17T05:54:20.234 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:20.231+0000 7f728ff5f640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f72880b3580 0x7f72881f5d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:54:20.234 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:20.231+0000 7f728ff5f640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f72880b3ad0 0x7f72881554d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:54:20.234 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:20.231+0000 7f728ff5f640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f72880b6160 0x7f72880ccf70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:54:20.234 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:20.231+0000 7f728ff5f640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f72880ba1c0 con 0x7f72880b3ad0 2024-09-17T05:54:20.234 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:20.231+0000 7f728ff5f640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f72880ba040 con 0x7f72880b6160 2024-09-17T05:54:20.234 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:20.231+0000 7f728ff5f640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f72880b6ab0 con 0x7f72880b3580 2024-09-17T05:54:20.234 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:20.231+0000 7f728d4fa640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f72880b3ad0 0x7f72881554d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:54:20.235 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:20.231+0000 7f728d4fa640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f72880b3ad0 0x7f72881554d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:58970/0 (socket says 172.21.15.150:58970) 2024-09-17T05:54:20.235 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:20.231+0000 7f728d4fa640 1 -- 172.21.15.150:0/4042168143 learned_addr learned my addr 172.21.15.150:0/4042168143 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:54:20.235 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:20.231+0000 7f728e4fc640 1 --2- 172.21.15.150:0/4042168143 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f72880b6160 0x7f72880ccf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:54:20.235 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:20.231+0000 7f728dcfb640 1 --2- 172.21.15.150:0/4042168143 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f72880b3580 0x7f72881f5d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:54:20.235 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:20.232+0000 7f728d4fa640 1 -- 172.21.15.150:0/4042168143 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f72880b3580 msgr2=0x7f72881f5d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:54:20.235 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:20.232+0000 7f728d4fa640 1 --2- 172.21.15.150:0/4042168143 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f72880b3580 0x7f72881f5d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:54:20.235 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:20.232+0000 7f728d4fa640 1 -- 172.21.15.150:0/4042168143 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f72880b6160 msgr2=0x7f72880ccf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:54:20.235 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:20.232+0000 7f728d4fa640 1 --2- 172.21.15.150:0/4042168143 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f72880b6160 0x7f72880ccf70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:54:20.235 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:20.232+0000 7f728d4fa640 1 -- 172.21.15.150:0/4042168143 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f72881f66d0 con 0x7f72880b3ad0 2024-09-17T05:54:20.235 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:20.232+0000 7f728d4fa640 1 --2- 172.21.15.150:0/4042168143 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f72880b3ad0 0x7f72881554d0 secure :-1 s=READY pgs=1973 cs=0 l=1 rev1=1 crypto rx=0x7f727800e9f0 tx=0x7f727800eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:54:20.236 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:20.232+0000 7f727e7fc640 1 -- 172.21.15.150:0/4042168143 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f727800ccc0 con 0x7f72880b3ad0 2024-09-17T05:54:20.236 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:20.232+0000 7f727e7fc640 1 -- 172.21.15.150:0/4042168143 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f7278010430 con 0x7f72880b3ad0 2024-09-17T05:54:20.236 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:20.232+0000 7f728ff5f640 1 -- 172.21.15.150:0/4042168143 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f72881f69b0 con 0x7f72880b3ad0 2024-09-17T05:54:20.236 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:20.232+0000 7f727e7fc640 1 -- 172.21.15.150:0/4042168143 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7278010840 con 0x7f72880b3ad0 2024-09-17T05:54:20.236 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:20.232+0000 7f728ff5f640 1 -- 172.21.15.150:0/4042168143 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f72880cb7c0 con 0x7f72880b3ad0 2024-09-17T05:54:20.237 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:20.233+0000 7f728ff5f640 1 -- 172.21.15.150:0/4042168143 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7288051030 con 0x7f72880b3ad0 2024-09-17T05:54:20.237 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:20.234+0000 7f727e7fc640 1 -- 172.21.15.150:0/4042168143 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 51) ==== 104960+0+0 (secure 0 0 0) 0x7f72780109e0 con 0x7f72880b3ad0 2024-09-17T05:54:20.237 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:20.234+0000 7f727e7fc640 1 --2- 172.21.15.150:0/4042168143 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f726c07b290 0x7f726c07d7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:54:20.237 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:20.234+0000 7f727e7fc640 1 -- 172.21.15.150:0/4042168143 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(143..143 src has 1..143) ==== 5934+0+0 (secure 0 0 0) 0x7f727809aad0 con 0x7f72880b3ad0 2024-09-17T05:54:20.237 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:20.235+0000 7f728dcfb640 1 --2- 172.21.15.150:0/4042168143 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f726c07b290 0x7f726c07d7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:54:20.237 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:20.235+0000 7f728dcfb640 1 --2- 172.21.15.150:0/4042168143 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f726c07b290 0x7f726c07d7a0 secure :-1 s=READY pgs=836 cs=0 l=1 rev1=1 crypto rx=0x7f7284034000 tx=0x7f7284004730 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:54:20.240 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:20.239+0000 7f727e7fc640 1 -- 172.21.15.150:0/4042168143 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f7288051030 con 0x7f72880b3ad0 2024-09-17T05:54:20.448 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:20.447+0000 7f728ff5f640 1 -- 172.21.15.150:0/4042168143 --> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] -- mgr_command(tid 0: {"prefix": "fs subvolume rm", "force": true, "vol_name": "cephfs", "sub_name": "subvol_clone65316", "target": ["mon-mgr", ""]}) -- 0x7f728808d090 con 0x7f726c07b290 2024-09-17T05:54:20.463 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:20.462+0000 7f727e7fc640 1 -- 172.21.15.150:0/4042168143 <== mgr.4108 v2:172.21.15.176:6800/3631216395 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f728808d090 con 0x7f726c07b290 2024-09-17T05:54:20.466 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:20.464+0000 7f728ff5f640 1 -- 172.21.15.150:0/4042168143 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f726c07b290 msgr2=0x7f726c07d7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:54:20.466 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:20.464+0000 7f728ff5f640 1 --2- 172.21.15.150:0/4042168143 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f726c07b290 0x7f726c07d7a0 secure :-1 s=READY pgs=836 cs=0 l=1 rev1=1 crypto rx=0x7f7284034000 tx=0x7f7284004730 comp rx=0 tx=0).stop 2024-09-17T05:54:20.466 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:20.464+0000 7f728ff5f640 1 -- 172.21.15.150:0/4042168143 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f72880b3ad0 msgr2=0x7f72881554d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:54:20.467 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:20.464+0000 7f728ff5f640 1 --2- 172.21.15.150:0/4042168143 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f72880b3ad0 0x7f72881554d0 secure :-1 s=READY pgs=1973 cs=0 l=1 rev1=1 crypto rx=0x7f727800e9f0 tx=0x7f727800eeb0 comp rx=0 tx=0).stop 2024-09-17T05:54:20.467 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:20.464+0000 7f728ff5f640 1 -- 172.21.15.150:0/4042168143 shutdown_connections 2024-09-17T05:54:20.467 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:20.464+0000 7f728ff5f640 1 --2- 172.21.15.150:0/4042168143 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f72880b6160 0x7f72880ccf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:54:20.467 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:20.464+0000 7f728ff5f640 1 --2- 172.21.15.150:0/4042168143 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f726c07b290 0x7f726c07d7a0 unknown :-1 s=CLOSED pgs=836 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:54:20.467 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:20.464+0000 7f728ff5f640 1 --2- 172.21.15.150:0/4042168143 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f72880b3ad0 0x7f72881554d0 unknown :-1 s=CLOSED pgs=1973 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:54:20.467 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:20.464+0000 7f728ff5f640 1 --2- 172.21.15.150:0/4042168143 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f72880b3580 0x7f72881f5d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:54:20.467 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:20.464+0000 7f728ff5f640 1 -- 172.21.15.150:0/4042168143 >> 172.21.15.150:0/4042168143 conn(0x7f72880d46e0 msgr2=0x7f728806df00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:54:20.467 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:20.464+0000 7f728ff5f640 1 -- 172.21.15.150:0/4042168143 shutdown_connections 2024-09-17T05:54:20.467 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:20.464+0000 7f728ff5f640 1 -- 172.21.15.150:0/4042168143 wait complete. 2024-09-17T05:54:20.480 DEBUG:teuthology.orchestra.run.smithi150:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'stat -c %h /home/ubuntu/cephtest/mnt.0/./volumes/_deleting') 2024-09-17T05:54:20.529 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:20 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-17T05:54:20.533 INFO:teuthology.orchestra.run.smithi150.stdout:2 2024-09-17T05:54:20.533 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:20 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T05:54:20.540 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mgr mgr/volumes/max_concurrent_clones 4 2024-09-17T05:54:20.716 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:20.714+0000 7fede67e4640 1 -- 172.21.15.150:0/931598347 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fede0073ec0 msgr2=0x7fede0159020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:54:20.716 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:20.714+0000 7fede67e4640 1 --2- 172.21.15.150:0/931598347 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fede0073ec0 0x7fede0159020 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7fedd8005fd0 tx=0x7fedd802a8b0 comp rx=0 tx=0).stop 2024-09-17T05:54:20.716 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:20.714+0000 7fede67e4640 1 -- 172.21.15.150:0/931598347 shutdown_connections 2024-09-17T05:54:20.717 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:20.715+0000 7fede67e4640 1 --2- 172.21.15.150:0/931598347 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fede0073ec0 0x7fede0159020 unknown :-1 s=CLOSED pgs=661 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:54:20.717 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:20.715+0000 7fede67e4640 1 -- 172.21.15.150:0/931598347 >> 172.21.15.150:0/931598347 conn(0x7fede00b2470 msgr2=0x7fede00b2880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:54:20.717 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:20.715+0000 7fede67e4640 1 -- 172.21.15.150:0/931598347 shutdown_connections 2024-09-17T05:54:20.717 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:20.715+0000 7fede67e4640 1 -- 172.21.15.150:0/931598347 wait complete. 2024-09-17T05:54:20.719 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:20.718+0000 7fede67e4640 1 Processor -- start 2024-09-17T05:54:20.719 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:20.718+0000 7fede67e4640 1 -- start start 2024-09-17T05:54:20.722 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:20.720+0000 7fede67e4640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fede006fa10 0x7fede0142bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:54:20.722 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:20.720+0000 7fede67e4640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fede006fe20 0x7fede0146450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:54:20.722 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:20.720+0000 7fede67e4640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fede0073ec0 0x7fede01f76e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:54:20.722 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:20.720+0000 7fede67e4640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7fede015f9e0 con 0x7fede006fa10 2024-09-17T05:54:20.722 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:20.720+0000 7fede67e4640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fede015f860 con 0x7fede006fe20 2024-09-17T05:54:20.723 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:20.720+0000 7fede4d81640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fede0073ec0 0x7fede01f76e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:54:20.723 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:20.720+0000 7fede4d81640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fede0073ec0 0x7fede01f76e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3301/0 says I am v2:172.21.15.150:46104/0 (socket says 172.21.15.150:46104) 2024-09-17T05:54:20.723 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:20.720+0000 7fede4d81640 1 -- 172.21.15.150:0/2927597374 learned_addr learned my addr 172.21.15.150:0/2927597374 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:54:20.723 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:20.720+0000 7feddf7fe640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fede006fe20 0x7fede0146450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:54:20.723 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:20.721+0000 7fede67e4640 1 -- 172.21.15.150:0/2927597374 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fede015fb60 con 0x7fede0073ec0 2024-09-17T05:54:20.723 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:20.721+0000 7feddffff640 1 --2- 172.21.15.150:0/2927597374 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fede006fa10 0x7fede0142bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:54:20.724 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:20.721+0000 7fede4d81640 1 -- 172.21.15.150:0/2927597374 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fede006fe20 msgr2=0x7fede0146450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:54:20.724 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:20.721+0000 7fede4d81640 1 --2- 172.21.15.150:0/2927597374 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fede006fe20 0x7fede0146450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:54:20.724 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:20.721+0000 7fede4d81640 1 -- 172.21.15.150:0/2927597374 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fede006fa10 msgr2=0x7fede0142bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:54:20.724 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:20.721+0000 7fede4d81640 1 --2- 172.21.15.150:0/2927597374 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fede006fa10 0x7fede0142bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:54:20.724 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:20.721+0000 7fede4d81640 1 -- 172.21.15.150:0/2927597374 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fede0143100 con 0x7fede0073ec0 2024-09-17T05:54:20.724 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:20.722+0000 7fede4d81640 1 --2- 172.21.15.150:0/2927597374 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fede0073ec0 0x7fede01f76e0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fedd000c390 tx=0x7fedd000c850 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:54:20.725 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:20.723+0000 7feddcff9640 1 -- 172.21.15.150:0/2927597374 <== mon.2 v2:172.21.15.176:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fedd0011790 con 0x7fede0073ec0 2024-09-17T05:54:20.725 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:20.723+0000 7feddcff9640 1 -- 172.21.15.150:0/2927597374 <== mon.2 v2:172.21.15.176:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fedd0017070 con 0x7fede0073ec0 2024-09-17T05:54:20.725 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:20.723+0000 7fede67e4640 1 -- 172.21.15.150:0/2927597374 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fede01f6f00 con 0x7fede0073ec0 2024-09-17T05:54:20.725 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:20.723+0000 7fede67e4640 1 -- 172.21.15.150:0/2927597374 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fede0143610 con 0x7fede0073ec0 2024-09-17T05:54:20.725 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:20.723+0000 7feddcff9640 1 -- 172.21.15.150:0/2927597374 <== mon.2 v2:172.21.15.176:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fedd0011ce0 con 0x7fede0073ec0 2024-09-17T05:54:20.727 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:20.725+0000 7fede67e4640 1 -- 172.21.15.150:0/2927597374 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fede0143380 con 0x7fede0073ec0 2024-09-17T05:54:20.729 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:20.727+0000 7feddcff9640 1 -- 172.21.15.150:0/2927597374 <== mon.2 v2:172.21.15.176:3301/0 4 ==== mgrmap(e 51) ==== 104960+0+0 (secure 0 0 0) 0x7fedd001c460 con 0x7fede0073ec0 2024-09-17T05:54:20.729 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:20.728+0000 7feddcff9640 1 --2- 172.21.15.150:0/2927597374 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fedcc07b2b0 0x7fedcc07d7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:54:20.730 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:20.728+0000 7feddffff640 1 --2- 172.21.15.150:0/2927597374 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fedcc07b2b0 0x7fedcc07d7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:54:20.730 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:20.729+0000 7feddcff9640 1 -- 172.21.15.150:0/2927597374 <== mon.2 v2:172.21.15.176:3301/0 5 ==== osd_map(144..144 src has 1..144) ==== 5990+0+0 (secure 0 0 0) 0x7fedd0099b00 con 0x7fede0073ec0 2024-09-17T05:54:20.730 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:20.729+0000 7feddffff640 1 --2- 172.21.15.150:0/2927597374 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fedcc07b2b0 0x7fedcc07d7c0 secure :-1 s=READY pgs=837 cs=0 l=1 rev1=1 crypto rx=0x7fedd8034000 tx=0x7fedd8004ab0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:54:20.736 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:20.735+0000 7feddcff9640 1 -- 172.21.15.150:0/2927597374 <== mon.2 v2:172.21.15.176:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fedd0063560 con 0x7fede0073ec0 2024-09-17T05:54:21.069 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:21.067+0000 7fede67e4640 1 -- 172.21.15.150:0/2927597374 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_command([{prefix=config set, name=mgr/volumes/max_concurrent_clones}] v 0) -- 0x7fede0159020 con 0x7fede0073ec0 2024-09-17T05:54:21.070 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:21.068+0000 7feddcff9640 1 -- 172.21.15.150:0/2927597374 <== mon.2 v2:172.21.15.176:3301/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/volumes/max_concurrent_clones}]=0 v60)=0 v60) ==== 131+0+0 (secure 0 0 0) 0x7fedd0067f90 con 0x7fede0073ec0 2024-09-17T05:54:21.073 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:21.071+0000 7fede67e4640 1 -- 172.21.15.150:0/2927597374 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fedcc07b2b0 msgr2=0x7fedcc07d7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:54:21.073 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:21.071+0000 7fede67e4640 1 --2- 172.21.15.150:0/2927597374 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fedcc07b2b0 0x7fedcc07d7c0 secure :-1 s=READY pgs=837 cs=0 l=1 rev1=1 crypto rx=0x7fedd8034000 tx=0x7fedd8004ab0 comp rx=0 tx=0).stop 2024-09-17T05:54:21.073 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:21.071+0000 7fede67e4640 1 -- 172.21.15.150:0/2927597374 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fede0073ec0 msgr2=0x7fede01f76e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:54:21.073 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:21.071+0000 7fede67e4640 1 --2- 172.21.15.150:0/2927597374 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fede0073ec0 0x7fede01f76e0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fedd000c390 tx=0x7fedd000c850 comp rx=0 tx=0).stop 2024-09-17T05:54:21.073 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:21.071+0000 7fede67e4640 1 -- 172.21.15.150:0/2927597374 shutdown_connections 2024-09-17T05:54:21.073 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:21.071+0000 7fede67e4640 1 --2- 172.21.15.150:0/2927597374 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fede006fe20 0x7fede0146450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:54:21.074 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:21.071+0000 7fede67e4640 1 --2- 172.21.15.150:0/2927597374 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fedcc07b2b0 0x7fedcc07d7c0 unknown :-1 s=CLOSED pgs=837 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:54:21.074 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:21.071+0000 7fede67e4640 1 --2- 172.21.15.150:0/2927597374 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fede0073ec0 0x7fede01f76e0 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:54:21.074 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:21.071+0000 7fede67e4640 1 --2- 172.21.15.150:0/2927597374 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fede006fa10 0x7fede0142bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:54:21.074 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:21.071+0000 7fede67e4640 1 -- 172.21.15.150:0/2927597374 >> 172.21.15.150:0/2927597374 conn(0x7fede00b2470 msgr2=0x7fede01580e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:54:21.074 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:21.071+0000 7fede67e4640 1 -- 172.21.15.150:0/2927597374 shutdown_connections 2024-09-17T05:54:21.074 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:21.071+0000 7fede67e4640 1 -- 172.21.15.150:0/2927597374 wait complete. 2024-09-17T05:54:21.088 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-17T05:54:21.089 DEBUG:teuthology.orchestra.run.smithi150:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-17T05:54:21.137 DEBUG:teuthology.orchestra.run.smithi176:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-17T05:54:21.183 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-17T05:54:21.183 INFO:tasks.cephfs.mount:Terminating background process 2024-09-17T05:54:21.183 DEBUG:teuthology.orchestra.run.smithi150:> set -ex 2024-09-17T05:54:21.183 DEBUG:teuthology.orchestra.run.smithi150:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T05:54:21.199 DEBUG:teuthology.orchestra.run.smithi150:> set -ex 2024-09-17T05:54:21.199 DEBUG:teuthology.orchestra.run.smithi150:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T05:54:21.256 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-17T05:54:21.411 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:21.409+0000 7f9040b20640 1 -- 172.21.15.150:0/11791677 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9028005360 msgr2=0x7f902800b9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:54:21.411 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:21.409+0000 7f9040b20640 1 --2- 172.21.15.150:0/11791677 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9028005360 0x7f902800b9e0 secure :-1 s=READY pgs=1976 cs=0 l=1 rev1=1 crypto rx=0x7f9034001ea0 tx=0x7f9028005830 comp rx=0 tx=0).stop 2024-09-17T05:54:21.411 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:21.409+0000 7f903ad9d640 1 -- 172.21.15.150:0/11791677 reap_dead start 2024-09-17T05:54:21.411 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:21.409+0000 7f9040b20640 1 -- 172.21.15.150:0/11791677 shutdown_connections 2024-09-17T05:54:21.411 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:21.409+0000 7f9040b20640 1 -- 172.21.15.150:0/11791677 >> 172.21.15.150:0/11791677 conn(0x7f903c06d3d0 msgr2=0x7f903c0b1ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:54:21.411 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:21.409+0000 7f9040b20640 1 -- 172.21.15.150:0/11791677 shutdown_connections 2024-09-17T05:54:21.411 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:21.409+0000 7f9040b20640 1 -- 172.21.15.150:0/11791677 wait complete. 2024-09-17T05:54:21.412 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:21.411+0000 7f9040b20640 1 Processor -- start 2024-09-17T05:54:21.412 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:21.411+0000 7f9040b20640 1 -- start start 2024-09-17T05:54:21.415 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:21.412+0000 7f9040b20640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9028005360 0x7f903c158680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:54:21.415 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:21.412+0000 7f9040b20640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f903c156750 0x7f903c0c6a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:54:21.416 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:21.412+0000 7f9040b20640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f903c0c47e0 0x7f903c157090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:54:21.416 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:21.412+0000 7f9040b20640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f903c0cb950 con 0x7f903c0c47e0 2024-09-17T05:54:21.416 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:21.412+0000 7f9040b20640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f903c0afab0 con 0x7f9028005360 2024-09-17T05:54:21.416 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:21.412+0000 7f9040b20640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f903c0cbad0 con 0x7f903c156750 2024-09-17T05:54:21.416 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:21.412+0000 7f903ad9d640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f903c0c47e0 0x7f903c157090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:54:21.416 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:21.412+0000 7f903ad9d640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f903c0c47e0 0x7f903c157090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:58990/0 (socket says 172.21.15.150:58990) 2024-09-17T05:54:21.416 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:21.412+0000 7f903ad9d640 1 -- 172.21.15.150:0/259369112 learned_addr learned my addr 172.21.15.150:0/259369112 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:54:21.416 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:21.412+0000 7f903a59c640 1 --2- 172.21.15.150:0/259369112 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9028005360 0x7f903c158680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:54:21.416 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:21.413+0000 7f9033fff640 1 --2- 172.21.15.150:0/259369112 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f903c156750 0x7f903c0c6a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:54:21.416 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:21.413+0000 7f903ad9d640 1 -- 172.21.15.150:0/259369112 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f903c156750 msgr2=0x7f903c0c6a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:54:21.416 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:21.413+0000 7f903ad9d640 1 --2- 172.21.15.150:0/259369112 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f903c156750 0x7f903c0c6a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:54:21.416 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:21.413+0000 7f903ad9d640 1 -- 172.21.15.150:0/259369112 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9028005360 msgr2=0x7f903c158680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:54:21.417 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:21.413+0000 7f903ad9d640 1 --2- 172.21.15.150:0/259369112 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9028005360 0x7f903c158680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:54:21.417 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:21.413+0000 7f903ad9d640 1 -- 172.21.15.150:0/259369112 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f903c158bc0 con 0x7f903c0c47e0 2024-09-17T05:54:21.417 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:21.413+0000 7f903ad9d640 1 --2- 172.21.15.150:0/259369112 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f903c0c47e0 0x7f903c157090 secure :-1 s=READY pgs=1977 cs=0 l=1 rev1=1 crypto rx=0x7f9034000f80 tx=0x7f9034001b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:54:21.417 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:21.413+0000 7f9032ffd640 1 -- 172.21.15.150:0/259369112 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9034037030 con 0x7f903c0c47e0 2024-09-17T05:54:21.417 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:21.413+0000 7f9032ffd640 1 -- 172.21.15.150:0/259369112 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9034003d40 con 0x7f903c0c47e0 2024-09-17T05:54:21.417 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:21.413+0000 7f9040b20640 1 -- 172.21.15.150:0/259369112 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f903c0c5ca0 con 0x7f903c0c47e0 2024-09-17T05:54:21.417 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:21.413+0000 7f9032ffd640 1 -- 172.21.15.150:0/259369112 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9034006310 con 0x7f903c0c47e0 2024-09-17T05:54:21.417 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:21.413+0000 7f9040b20640 1 -- 172.21.15.150:0/259369112 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f903c0c6260 con 0x7f903c0c47e0 2024-09-17T05:54:21.418 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:21.414+0000 7f9040b20640 1 -- 172.21.15.150:0/259369112 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f903c0c4d80 con 0x7f903c0c47e0 2024-09-17T05:54:21.418 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:21.415+0000 7f9032ffd640 1 -- 172.21.15.150:0/259369112 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 51) ==== 104960+0+0 (secure 0 0 0) 0x7f90340066c0 con 0x7f903c0c47e0 2024-09-17T05:54:21.418 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:21.415+0000 7f9032ffd640 1 --2- 172.21.15.150:0/259369112 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f901c07b290 0x7f901c07d7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:54:21.418 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:21.416+0000 7f9032ffd640 1 -- 172.21.15.150:0/259369112 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(144..144 src has 1..144) ==== 5990+0+0 (secure 0 0 0) 0x7f90340b9ce0 con 0x7f903c0c47e0 2024-09-17T05:54:21.418 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:21.416+0000 7f903a59c640 1 --2- 172.21.15.150:0/259369112 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f901c07b290 0x7f901c07d7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:54:21.418 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:21.416+0000 7f903a59c640 1 --2- 172.21.15.150:0/259369112 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f901c07b290 0x7f901c07d7a0 secure :-1 s=READY pgs=838 cs=0 l=1 rev1=1 crypto rx=0x7f902c001120 tx=0x7f902c0011d0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:54:21.421 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:21.420+0000 7f9032ffd640 1 -- 172.21.15.150:0/259369112 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f9034083cb0 con 0x7f903c0c47e0 2024-09-17T05:54:21.654 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:21.652+0000 7f9040b20640 1 -- 172.21.15.150:0/259369112 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f903c0ad440 con 0x7f903c0c47e0 2024-09-17T05:54:21.654 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:21.652+0000 7f9032ffd640 1 -- 172.21.15.150:0/259369112 <== mon.0 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v144) ==== 80+0+0 (secure 0 0 0) 0x7f90340835b0 con 0x7f903c0c47e0 2024-09-17T05:54:21.654 INFO:teuthology.orchestra.run.smithi150.stderr:listed 0 entries 2024-09-17T05:54:21.658 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:21.656+0000 7f9040b20640 1 -- 172.21.15.150:0/259369112 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f901c07b290 msgr2=0x7f901c07d7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:54:21.658 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:21.656+0000 7f9040b20640 1 --2- 172.21.15.150:0/259369112 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f901c07b290 0x7f901c07d7a0 secure :-1 s=READY pgs=838 cs=0 l=1 rev1=1 crypto rx=0x7f902c001120 tx=0x7f902c0011d0 comp rx=0 tx=0).stop 2024-09-17T05:54:21.658 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:21.656+0000 7f9040b20640 1 -- 172.21.15.150:0/259369112 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f903c0c47e0 msgr2=0x7f903c157090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:54:21.658 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:21.656+0000 7f9040b20640 1 --2- 172.21.15.150:0/259369112 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f903c0c47e0 0x7f903c157090 secure :-1 s=READY pgs=1977 cs=0 l=1 rev1=1 crypto rx=0x7f9034000f80 tx=0x7f9034001b60 comp rx=0 tx=0).stop 2024-09-17T05:54:21.658 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:21.656+0000 7f9040b20640 1 -- 172.21.15.150:0/259369112 shutdown_connections 2024-09-17T05:54:21.659 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:21.656+0000 7f9040b20640 1 --2- 172.21.15.150:0/259369112 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f901c07b290 0x7f901c07d7a0 unknown :-1 s=CLOSED pgs=838 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:54:21.659 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:21.656+0000 7f9040b20640 1 --2- 172.21.15.150:0/259369112 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f903c0c47e0 0x7f903c157090 unknown :-1 s=CLOSED pgs=1977 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:54:21.659 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:21.656+0000 7f9040b20640 1 --2- 172.21.15.150:0/259369112 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f903c156750 0x7f903c0c6a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:54:21.659 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:21.656+0000 7f9040b20640 1 --2- 172.21.15.150:0/259369112 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9028005360 0x7f903c158680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:54:21.659 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:21.656+0000 7f9040b20640 1 -- 172.21.15.150:0/259369112 >> 172.21.15.150:0/259369112 conn(0x7f903c06d3d0 msgr2=0x7f903c074940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:54:21.659 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:21.656+0000 7f9040b20640 1 -- 172.21.15.150:0/259369112 shutdown_connections 2024-09-17T05:54:21.659 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:21.657+0000 7f9040b20640 1 -- 172.21.15.150:0/259369112 wait complete. 2024-09-17T05:54:21.676 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-09-17T05:54:21.677 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:54:21.677 DEBUG:teuthology.orchestra.run.smithi150:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-09-17T05:54:21.743 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi150.front.sepia.ceph.com 2024-09-17T05:54:21.743 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:54:21.743 DEBUG:teuthology.orchestra.run.smithi150:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-17T05:54:21.776 INFO:tasks.cephfs.mount:Terminating background process 2024-09-17T05:54:21.777 DEBUG:teuthology.orchestra.run.smithi176:> set -ex 2024-09-17T05:54:21.777 DEBUG:teuthology.orchestra.run.smithi176:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T05:54:21.799 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056030,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497468k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=3379 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248732k,nr_inodes=812183,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497468k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-17T05:54:21.799 INFO:tasks.cephfs.mount:Terminating background process 2024-09-17T05:54:21.799 DEBUG:teuthology.orchestra.run.smithi150:> set -ex 2024-09-17T05:54:21.799 DEBUG:teuthology.orchestra.run.smithi150:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T05:54:21.840 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056027,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497464k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=18693 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248728k,nr_inodes=812182,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497464k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-17T05:54:21.840 INFO:tasks.cephfs.mount:Terminating background process 2024-09-17T05:54:21.840 DEBUG:teuthology.orchestra.run.smithi176:> set -ex 2024-09-17T05:54:21.840 DEBUG:teuthology.orchestra.run.smithi176:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T05:54:21.863 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056030,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497468k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=3379 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248732k,nr_inodes=812183,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497468k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-17T05:54:21.863 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T05:54:22.052 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:22.050+0000 7fa67907e640 1 -- 172.21.15.150:0/418203575 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa6740cda20 msgr2=0x7fa6740cde30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:54:22.052 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:22.050+0000 7fa67907e640 1 --2- 172.21.15.150:0/418203575 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa6740cda20 0x7fa6740cde30 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fa6740cce10 tx=0x7fa66802a4f0 comp rx=0 tx=0).stop 2024-09-17T05:54:22.052 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:22.050+0000 7fa67907e640 1 -- 172.21.15.150:0/418203575 shutdown_connections 2024-09-17T05:54:22.052 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:22.050+0000 7fa67907e640 1 --2- 172.21.15.150:0/418203575 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa6740cda20 0x7fa6740cde30 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:54:22.052 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:22.050+0000 7fa67907e640 1 -- 172.21.15.150:0/418203575 >> 172.21.15.150:0/418203575 conn(0x7fa6740b2e80 msgr2=0x7fa6740b3290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:54:22.052 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:22.050+0000 7fa67907e640 1 -- 172.21.15.150:0/418203575 shutdown_connections 2024-09-17T05:54:22.052 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:22.050+0000 7fa67907e640 1 -- 172.21.15.150:0/418203575 wait complete. 2024-09-17T05:54:22.054 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:22.053+0000 7fa67907e640 1 Processor -- start 2024-09-17T05:54:22.054 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:22.053+0000 7fa67907e640 1 -- start start 2024-09-17T05:54:22.056 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:22.055+0000 7fa67907e640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa6740b5ff0 0x7fa6741f60e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:54:22.057 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:22.055+0000 7fa67907e640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa6740cda20 0x7fa6741f8c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:54:22.057 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:22.055+0000 7fa67907e640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa6740ce370 0x7fa67415c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:54:22.057 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:22.055+0000 7fa67259c640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa6740cda20 0x7fa6741f8c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:54:22.058 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:22.055+0000 7fa67259c640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa6740cda20 0x7fa6741f8c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:59000/0 (socket says 172.21.15.150:59000) 2024-09-17T05:54:22.058 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:22.055+0000 7fa672d9d640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa6740b5ff0 0x7fa6741f60e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:54:22.058 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:22.056+0000 7fa67259c640 1 -- 172.21.15.150:0/2738867190 learned_addr learned my addr 172.21.15.150:0/2738867190 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:54:22.059 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:22.056+0000 7fa67907e640 1 -- 172.21.15.150:0/2738867190 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7fa67406d4b0 con 0x7fa6740cda20 2024-09-17T05:54:22.059 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:22.056+0000 7fa67907e640 1 -- 172.21.15.150:0/2738867190 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fa6740b5790 con 0x7fa6740ce370 2024-09-17T05:54:22.059 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:22.056+0000 7fa67907e640 1 -- 172.21.15.150:0/2738867190 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fa67406d630 con 0x7fa6740b5ff0 2024-09-17T05:54:22.059 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:22.057+0000 7fa67359e640 1 --2- 172.21.15.150:0/2738867190 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa6740ce370 0x7fa67415c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:54:22.059 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:22.057+0000 7fa67259c640 1 -- 172.21.15.150:0/2738867190 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa6740b5ff0 msgr2=0x7fa6741f60e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:54:22.059 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:22.057+0000 7fa67259c640 1 --2- 172.21.15.150:0/2738867190 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa6740b5ff0 0x7fa6741f60e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:54:22.059 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:22.057+0000 7fa67259c640 1 -- 172.21.15.150:0/2738867190 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa6740ce370 msgr2=0x7fa67415c5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:54:22.059 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:22.057+0000 7fa67259c640 1 --2- 172.21.15.150:0/2738867190 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa6740ce370 0x7fa67415c5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:54:22.059 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:22.057+0000 7fa67259c640 1 -- 172.21.15.150:0/2738867190 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa6741f9660 con 0x7fa6740cda20 2024-09-17T05:54:22.059 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:22.057+0000 7fa67259c640 1 --2- 172.21.15.150:0/2738867190 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa6740cda20 0x7fa6741f8c80 secure :-1 s=READY pgs=1979 cs=0 l=1 rev1=1 crypto rx=0x7fa668009950 tx=0x7fa6680038f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:54:22.060 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:22.058+0000 7fa65b7fe640 1 -- 172.21.15.150:0/2738867190 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa668005c90 con 0x7fa6740cda20 2024-09-17T05:54:22.060 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:22.058+0000 7fa65b7fe640 1 -- 172.21.15.150:0/2738867190 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa668003ae0 con 0x7fa6740cda20 2024-09-17T05:54:22.060 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:22.058+0000 7fa65b7fe640 1 -- 172.21.15.150:0/2738867190 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa668031950 con 0x7fa6740cda20 2024-09-17T05:54:22.060 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:22.058+0000 7fa67907e640 1 -- 172.21.15.150:0/2738867190 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa6741f9940 con 0x7fa6740cda20 2024-09-17T05:54:22.060 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:22.058+0000 7fa67907e640 1 -- 172.21.15.150:0/2738867190 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa6741f5bc0 con 0x7fa6740cda20 2024-09-17T05:54:22.061 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:22.060+0000 7fa67907e640 1 -- 172.21.15.150:0/2738867190 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa6741f93d0 con 0x7fa6740cda20 2024-09-17T05:54:22.062 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:22.061+0000 7fa65b7fe640 1 -- 172.21.15.150:0/2738867190 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 51) ==== 104960+0+0 (secure 0 0 0) 0x7fa66802ad10 con 0x7fa6740cda20 2024-09-17T05:54:22.066 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:22.064+0000 7fa65b7fe640 1 --2- 172.21.15.150:0/2738867190 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fa66007b2b0 0x7fa66007d7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:54:22.066 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:22.064+0000 7fa65b7fe640 1 -- 172.21.15.150:0/2738867190 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(144..144 src has 1..144) ==== 5990+0+0 (secure 0 0 0) 0x7fa6680ba9e0 con 0x7fa6740cda20 2024-09-17T05:54:22.066 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:22.064+0000 7fa672d9d640 1 --2- 172.21.15.150:0/2738867190 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fa66007b2b0 0x7fa66007d7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:54:22.066 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:22.065+0000 7fa672d9d640 1 --2- 172.21.15.150:0/2738867190 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fa66007b2b0 0x7fa66007d7c0 secure :-1 s=READY pgs=839 cs=0 l=1 rev1=1 crypto rx=0x7fa664000f60 tx=0x7fa664009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:54:22.072 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:22.070+0000 7fa65b7fe640 1 -- 172.21.15.150:0/2738867190 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fa66803f030 con 0x7fa6740cda20 2024-09-17T05:54:22.337 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:22.336+0000 7fa67907e640 1 -- 172.21.15.150:0/2738867190 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fa6741f9b10 con 0x7fa6740cda20 2024-09-17T05:54:22.338 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:22.336+0000 7fa65b7fe640 1 -- 172.21.15.150:0/2738867190 <== mon.0 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 89 v89) ==== 94+0+5233 (secure 0 0 0) 0x7fa668084990 con 0x7fa6740cda20 2024-09-17T05:54:22.338 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-09-17T05:54:22.338 INFO:teuthology.orchestra.run.smithi150.stdout:{"epoch":89,"btime":"2024-09-17T05:53:25:564938+0000","default_fscid":10,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7418,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6836/984747558","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6834","nonce":984747558},{"type":"v1","addr":"172.21.15.176:6836","nonce":984747558}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":85},{"gid":7421,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6837/1815277837","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6835","nonce":1815277837},{"type":"v1","addr":"172.21.15.176:6837","nonce":1815277837}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":85},{"gid":9630,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6834/2397551288","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6832","nonce":2397551288},{"type":"v1","addr":"172.21.15.150:6834","nonce":2397551288}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":84}],"filesystems":[{"mdsmap":{"epoch":88,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T05:53:13.900105+0000","modified":"2024-09-17T05:53:15.896921+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":9633},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9633":{"gid":9633,"name":"c","rank":0,"incarnation":86,"state":"up:active","state_seq":3,"addr":"172.21.15.150:6835/122540131","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6833","nonce":122540131},{"type":"v1","addr":"172.21.15.150:6835","nonce":122540131}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[21],"metadata_pool":20,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":9633,"qdb_cluster":[9633]},"id":10}]} 2024-09-17T05:54:22.338 INFO:teuthology.orchestra.run.smithi150.stderr:dumped fsmap epoch 89 2024-09-17T05:54:22.340 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:22.338+0000 7fa67907e640 1 -- 172.21.15.150:0/2738867190 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fa66007b2b0 msgr2=0x7fa66007d7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:54:22.341 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:22.338+0000 7fa67907e640 1 --2- 172.21.15.150:0/2738867190 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fa66007b2b0 0x7fa66007d7c0 secure :-1 s=READY pgs=839 cs=0 l=1 rev1=1 crypto rx=0x7fa664000f60 tx=0x7fa664009040 comp rx=0 tx=0).stop 2024-09-17T05:54:22.341 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:22.338+0000 7fa67907e640 1 -- 172.21.15.150:0/2738867190 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa6740cda20 msgr2=0x7fa6741f8c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:54:22.341 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:22.338+0000 7fa67907e640 1 --2- 172.21.15.150:0/2738867190 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa6740cda20 0x7fa6741f8c80 secure :-1 s=READY pgs=1979 cs=0 l=1 rev1=1 crypto rx=0x7fa668009950 tx=0x7fa6680038f0 comp rx=0 tx=0).stop 2024-09-17T05:54:22.341 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:22.338+0000 7fa67907e640 1 -- 172.21.15.150:0/2738867190 shutdown_connections 2024-09-17T05:54:22.341 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:22.338+0000 7fa67907e640 1 --2- 172.21.15.150:0/2738867190 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa6740ce370 0x7fa67415c5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:54:22.341 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:22.339+0000 7fa67907e640 1 --2- 172.21.15.150:0/2738867190 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fa66007b2b0 0x7fa66007d7c0 unknown :-1 s=CLOSED pgs=839 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:54:22.341 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:22.339+0000 7fa67907e640 1 --2- 172.21.15.150:0/2738867190 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa6740cda20 0x7fa6741f8c80 unknown :-1 s=CLOSED pgs=1979 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:54:22.341 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:22.339+0000 7fa67907e640 1 --2- 172.21.15.150:0/2738867190 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa6740b5ff0 0x7fa6741f60e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:54:22.341 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:22.339+0000 7fa67907e640 1 -- 172.21.15.150:0/2738867190 >> 172.21.15.150:0/2738867190 conn(0x7fa6740b2e80 msgr2=0x7fa674071aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:54:22.341 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:22.339+0000 7fa67907e640 1 -- 172.21.15.150:0/2738867190 shutdown_connections 2024-09-17T05:54:22.341 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:22.339+0000 7fa67907e640 1 -- 172.21.15.150:0/2738867190 wait complete. 2024-09-17T05:54:22.353 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T05:54:22.467 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:22.465+0000 7f17eeeb6640 1 -- 172.21.15.150:0/441266792 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f17e80b7330 msgr2=0x7f17e80b5260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:54:22.467 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:22.465+0000 7f17eeeb6640 1 --2- 172.21.15.150:0/441266792 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f17e80b7330 0x7f17e80b5260 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f17d8009830 tx=0x7f17d802a510 comp rx=0 tx=0).stop 2024-09-17T05:54:22.467 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:22.465+0000 7f17eeeb6640 1 -- 172.21.15.150:0/441266792 shutdown_connections 2024-09-17T05:54:22.467 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:22.465+0000 7f17eeeb6640 1 --2- 172.21.15.150:0/441266792 >> v2:172.21.15.176:3300/0 conn(0x7f17e80b57a0 0x7f17e80b5bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:54:22.467 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:22.465+0000 7f17eeeb6640 1 --2- 172.21.15.150:0/441266792 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f17e80b7330 0x7f17e80b5260 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:54:22.467 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:22.465+0000 7f17eeeb6640 1 -- 172.21.15.150:0/441266792 >> 172.21.15.150:0/441266792 conn(0x7f17e80cee90 msgr2=0x7f17e80cf2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:54:22.467 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:22.465+0000 7f17eeeb6640 1 -- 172.21.15.150:0/441266792 shutdown_connections 2024-09-17T05:54:22.467 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:22.465+0000 7f17eeeb6640 1 -- 172.21.15.150:0/441266792 wait complete. 2024-09-17T05:54:22.468 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:22.466+0000 7f17eeeb6640 1 Processor -- start 2024-09-17T05:54:22.468 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:22.466+0000 7f17eeeb6640 1 -- start start 2024-09-17T05:54:22.471 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:22.468+0000 7f17eeeb6640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f17e809ba60 0x7f17e8162fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:54:22.471 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:22.468+0000 7f17eeeb6640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f17e80b57a0 0x7f17e80b09d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:54:22.471 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:22.468+0000 7f17eeeb6640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f17e80b7330 0x7f17e8163de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:54:22.471 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:22.468+0000 7f17eeeb6640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f17e80d1550 con 0x7f17e80b57a0 2024-09-17T05:54:22.471 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:22.468+0000 7f17eeeb6640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f17e80d13d0 con 0x7f17e809ba60 2024-09-17T05:54:22.471 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:22.468+0000 7f17eeeb6640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f17e81670e0 con 0x7f17e80b7330 2024-09-17T05:54:22.471 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:22.468+0000 7f17dffff640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f17e80b57a0 0x7f17e80b09d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:54:22.471 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:22.468+0000 7f17dffff640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f17e80b57a0 0x7f17e80b09d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:59016/0 (socket says 172.21.15.150:59016) 2024-09-17T05:54:22.471 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:22.468+0000 7f17dffff640 1 -- 172.21.15.150:0/4267212125 learned_addr learned my addr 172.21.15.150:0/4267212125 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:54:22.472 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:22.468+0000 7f17ed453640 1 --2- 172.21.15.150:0/4267212125 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f17e80b7330 0x7f17e8163de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:54:22.472 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:22.468+0000 7f17ecc52640 1 --2- 172.21.15.150:0/4267212125 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f17e809ba60 0x7f17e8162fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:54:22.472 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:22.468+0000 7f17dffff640 1 -- 172.21.15.150:0/4267212125 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f17e80b7330 msgr2=0x7f17e8163de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:54:22.472 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:22.468+0000 7f17dffff640 1 --2- 172.21.15.150:0/4267212125 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f17e80b7330 0x7f17e8163de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:54:22.472 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:22.468+0000 7f17dffff640 1 -- 172.21.15.150:0/4267212125 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f17e809ba60 msgr2=0x7f17e8162fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:54:22.472 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:22.468+0000 7f17dffff640 1 --2- 172.21.15.150:0/4267212125 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f17e809ba60 0x7f17e8162fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:54:22.472 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:22.468+0000 7f17dffff640 1 -- 172.21.15.150:0/4267212125 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f17e815efb0 con 0x7f17e80b57a0 2024-09-17T05:54:22.472 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:22.468+0000 7f17dffff640 1 --2- 172.21.15.150:0/4267212125 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f17e80b57a0 0x7f17e80b09d0 secure :-1 s=READY pgs=1981 cs=0 l=1 rev1=1 crypto rx=0x7f17d802ab00 tx=0x7f17d8030650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:54:22.472 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:22.469+0000 7f17dd7fa640 1 -- 172.21.15.150:0/4267212125 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17d8030c50 con 0x7f17e80b57a0 2024-09-17T05:54:22.472 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:22.469+0000 7f17dd7fa640 1 -- 172.21.15.150:0/4267212125 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f17d803b410 con 0x7f17e80b57a0 2024-09-17T05:54:22.472 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:22.469+0000 7f17eeeb6640 1 -- 172.21.15.150:0/4267212125 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f17e815f290 con 0x7f17e80b57a0 2024-09-17T05:54:22.472 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:22.469+0000 7f17dd7fa640 1 -- 172.21.15.150:0/4267212125 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17d803b860 con 0x7f17e80b57a0 2024-09-17T05:54:22.472 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:22.469+0000 7f17eeeb6640 1 -- 172.21.15.150:0/4267212125 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f17e815f850 con 0x7f17e80b57a0 2024-09-17T05:54:22.473 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:22.470+0000 7f17eeeb6640 1 -- 172.21.15.150:0/4267212125 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f17e80b5bb0 con 0x7f17e80b57a0 2024-09-17T05:54:22.474 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:22.471+0000 7f17dd7fa640 1 -- 172.21.15.150:0/4267212125 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 51) ==== 104960+0+0 (secure 0 0 0) 0x7f17d803ba00 con 0x7f17e80b57a0 2024-09-17T05:54:22.474 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:22.471+0000 7f17dd7fa640 1 --2- 172.21.15.150:0/4267212125 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f17d407b260 0x7f17d407d770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:54:22.474 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:22.471+0000 7f17ecc52640 1 --2- 172.21.15.150:0/4267212125 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f17d407b260 0x7f17d407d770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:54:22.474 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:22.471+0000 7f17dd7fa640 1 -- 172.21.15.150:0/4267212125 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(144..144 src has 1..144) ==== 5990+0+0 (secure 0 0 0) 0x7f17d80bb380 con 0x7f17e80b57a0 2024-09-17T05:54:22.474 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:22.472+0000 7f17ecc52640 1 --2- 172.21.15.150:0/4267212125 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f17d407b260 0x7f17d407d770 secure :-1 s=READY pgs=840 cs=0 l=1 rev1=1 crypto rx=0x7f17e4001760 tx=0x7f17e4009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:54:22.477 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:22.476+0000 7f17dd7fa640 1 -- 172.21.15.150:0/4267212125 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f17d803f030 con 0x7f17e80b57a0 2024-09-17T05:54:22.811 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:22.809+0000 7f17eeeb6640 1 -- 172.21.15.150:0/4267212125 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f17e80723c0 con 0x7f17e80b57a0 2024-09-17T05:54:22.811 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:22.810+0000 7f17dd7fa640 1 -- 172.21.15.150:0/4267212125 <== mon.0 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 89 v89) ==== 94+0+5233 (secure 0 0 0) 0x7f17d8031770 con 0x7f17e80b57a0 2024-09-17T05:54:22.812 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-09-17T05:54:22.812 INFO:teuthology.orchestra.run.smithi150.stdout:{"epoch":89,"btime":"2024-09-17T05:53:25:564938+0000","default_fscid":10,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7418,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6836/984747558","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6834","nonce":984747558},{"type":"v1","addr":"172.21.15.176:6836","nonce":984747558}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":85},{"gid":7421,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6837/1815277837","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6835","nonce":1815277837},{"type":"v1","addr":"172.21.15.176:6837","nonce":1815277837}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":85},{"gid":9630,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6834/2397551288","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6832","nonce":2397551288},{"type":"v1","addr":"172.21.15.150:6834","nonce":2397551288}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":84}],"filesystems":[{"mdsmap":{"epoch":88,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T05:53:13.900105+0000","modified":"2024-09-17T05:53:15.896921+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":9633},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9633":{"gid":9633,"name":"c","rank":0,"incarnation":86,"state":"up:active","state_seq":3,"addr":"172.21.15.150:6835/122540131","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6833","nonce":122540131},{"type":"v1","addr":"172.21.15.150:6835","nonce":122540131}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[21],"metadata_pool":20,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":9633,"qdb_cluster":[9633]},"id":10}]} 2024-09-17T05:54:22.812 INFO:teuthology.orchestra.run.smithi150.stderr:dumped fsmap epoch 89 2024-09-17T05:54:22.815 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:22.813+0000 7f17eeeb6640 1 -- 172.21.15.150:0/4267212125 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f17d407b260 msgr2=0x7f17d407d770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:54:22.815 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:22.813+0000 7f17eeeb6640 1 --2- 172.21.15.150:0/4267212125 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f17d407b260 0x7f17d407d770 secure :-1 s=READY pgs=840 cs=0 l=1 rev1=1 crypto rx=0x7f17e4001760 tx=0x7f17e4009040 comp rx=0 tx=0).stop 2024-09-17T05:54:22.815 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:22.813+0000 7f17eeeb6640 1 -- 172.21.15.150:0/4267212125 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f17e80b57a0 msgr2=0x7f17e80b09d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:54:22.815 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:22.813+0000 7f17eeeb6640 1 --2- 172.21.15.150:0/4267212125 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f17e80b57a0 0x7f17e80b09d0 secure :-1 s=READY pgs=1981 cs=0 l=1 rev1=1 crypto rx=0x7f17d802ab00 tx=0x7f17d8030650 comp rx=0 tx=0).stop 2024-09-17T05:54:22.815 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:22.813+0000 7f17eeeb6640 1 -- 172.21.15.150:0/4267212125 shutdown_connections 2024-09-17T05:54:22.815 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:22.813+0000 7f17eeeb6640 1 --2- 172.21.15.150:0/4267212125 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f17d407b260 0x7f17d407d770 unknown :-1 s=CLOSED pgs=840 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:54:22.815 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:22.813+0000 7f17eeeb6640 1 --2- 172.21.15.150:0/4267212125 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f17e80b7330 0x7f17e8163de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:54:22.815 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:22.813+0000 7f17eeeb6640 1 --2- 172.21.15.150:0/4267212125 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f17e80b57a0 0x7f17e80b09d0 unknown :-1 s=CLOSED pgs=1981 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:54:22.815 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:22.813+0000 7f17eeeb6640 1 --2- 172.21.15.150:0/4267212125 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f17e809ba60 0x7f17e8162fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:54:22.815 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:22.813+0000 7f17eeeb6640 1 -- 172.21.15.150:0/4267212125 >> 172.21.15.150:0/4267212125 conn(0x7f17e80cee90 msgr2=0x7f17e80712d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:54:22.815 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:22.813+0000 7f17eeeb6640 1 -- 172.21.15.150:0/4267212125 shutdown_connections 2024-09-17T05:54:22.815 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:22.813+0000 7f17eeeb6640 1 -- 172.21.15.150:0/4267212125 wait complete. 2024-09-17T05:54:22.833 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T05:54:22.975 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:22.973+0000 7f6e25b89640 1 -- 172.21.15.150:0/3213467561 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6e200b5d50 msgr2=0x7f6e200d2780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:54:22.975 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:22.973+0000 7f6e25b89640 1 --2- 172.21.15.150:0/3213467561 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6e200b5d50 0x7f6e200d2780 secure :-1 s=READY pgs=1983 cs=0 l=1 rev1=1 crypto rx=0x7f6e10009830 tx=0x7f6e1002a510 comp rx=0 tx=0).stop 2024-09-17T05:54:22.975 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:22.973+0000 7f6e25b89640 1 -- 172.21.15.150:0/3213467561 shutdown_connections 2024-09-17T05:54:22.976 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:22.973+0000 7f6e25b89640 1 --2- 172.21.15.150:0/3213467561 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6e200d1790 0x7f6e200d0400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:54:22.976 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:22.973+0000 7f6e25b89640 1 --2- 172.21.15.150:0/3213467561 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6e200b5d50 0x7f6e200d2780 unknown :-1 s=CLOSED pgs=1983 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:54:22.976 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:22.973+0000 7f6e25b89640 1 -- 172.21.15.150:0/3213467561 >> 172.21.15.150:0/3213467561 conn(0x7f6e2008bfe0 msgr2=0x7f6e200d4670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:54:22.976 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:22.973+0000 7f6e25b89640 1 -- 172.21.15.150:0/3213467561 shutdown_connections 2024-09-17T05:54:22.976 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:22.973+0000 7f6e25b89640 1 -- 172.21.15.150:0/3213467561 wait complete. 2024-09-17T05:54:22.977 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:22.975+0000 7f6e25b89640 1 Processor -- start 2024-09-17T05:54:22.977 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:22.975+0000 7f6e25b89640 1 -- start start 2024-09-17T05:54:22.979 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:22.976+0000 7f6e25b89640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6e200b5d50 0x7f6e2015a5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:54:22.980 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:22.976+0000 7f6e25b89640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6e200d4f90 0x7f6e20156370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:54:22.980 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:22.976+0000 7f6e25b89640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6e201548f0 0x7f6e201541e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:54:22.980 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:22.976+0000 7f6e25b89640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f6e200b7b00 con 0x7f6e200b5d50 2024-09-17T05:54:22.981 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:22.976+0000 7f6e25b89640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f6e200b7980 con 0x7f6e200d4f90 2024-09-17T05:54:22.981 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:22.976+0000 7f6e25b89640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f6e200b7c80 con 0x7f6e201548f0 2024-09-17T05:54:22.981 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:22.977+0000 7f6e1f7fe640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6e200b5d50 0x7f6e2015a5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:54:22.981 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:22.977+0000 7f6e1f7fe640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6e200b5d50 0x7f6e2015a5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:59038/0 (socket says 172.21.15.150:59038) 2024-09-17T05:54:22.981 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:22.977+0000 7f6e1f7fe640 1 -- 172.21.15.150:0/3276795105 learned_addr learned my addr 172.21.15.150:0/3276795105 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:54:22.982 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:22.977+0000 7f6e1effd640 1 --2- 172.21.15.150:0/3276795105 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6e200d4f90 0x7f6e20156370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:54:22.982 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:22.977+0000 7f6e1ffff640 1 --2- 172.21.15.150:0/3276795105 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6e201548f0 0x7f6e201541e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:54:22.982 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:22.977+0000 7f6e1f7fe640 1 -- 172.21.15.150:0/3276795105 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6e201548f0 msgr2=0x7f6e201541e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:54:22.982 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:22.977+0000 7f6e1f7fe640 1 --2- 172.21.15.150:0/3276795105 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6e201548f0 0x7f6e201541e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:54:22.982 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:22.977+0000 7f6e1f7fe640 1 -- 172.21.15.150:0/3276795105 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6e200d4f90 msgr2=0x7f6e20156370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:54:22.982 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:22.977+0000 7f6e1f7fe640 1 --2- 172.21.15.150:0/3276795105 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6e200d4f90 0x7f6e20156370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:54:22.983 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:22.977+0000 7f6e1f7fe640 1 -- 172.21.15.150:0/3276795105 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6e201555b0 con 0x7f6e200b5d50 2024-09-17T05:54:22.983 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:22.977+0000 7f6e1f7fe640 1 --2- 172.21.15.150:0/3276795105 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6e200b5d50 0x7f6e2015a5e0 secure :-1 s=READY pgs=1984 cs=0 l=1 rev1=1 crypto rx=0x7f6e10009950 tx=0x7f6e10033d60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:54:22.983 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:22.977+0000 7f6e07fff640 1 -- 172.21.15.150:0/3276795105 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e10031d60 con 0x7f6e200b5d50 2024-09-17T05:54:22.983 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:22.977+0000 7f6e07fff640 1 -- 172.21.15.150:0/3276795105 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f6e100330d0 con 0x7f6e200b5d50 2024-09-17T05:54:22.983 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:22.977+0000 7f6e07fff640 1 -- 172.21.15.150:0/3276795105 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e10033520 con 0x7f6e200b5d50 2024-09-17T05:54:22.983 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:22.977+0000 7f6e25b89640 1 -- 172.21.15.150:0/3276795105 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6e20155890 con 0x7f6e200b5d50 2024-09-17T05:54:22.984 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:22.977+0000 7f6e25b89640 1 -- 172.21.15.150:0/3276795105 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6e20155e50 con 0x7f6e200b5d50 2024-09-17T05:54:22.985 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:22.978+0000 7f6e25b89640 1 -- 172.21.15.150:0/3276795105 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6e200d2780 con 0x7f6e200b5d50 2024-09-17T05:54:22.985 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:22.979+0000 7f6e07fff640 1 -- 172.21.15.150:0/3276795105 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 51) ==== 104960+0+0 (secure 0 0 0) 0x7f6e100035f0 con 0x7f6e200b5d50 2024-09-17T05:54:22.985 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:22.980+0000 7f6e07fff640 1 --2- 172.21.15.150:0/3276795105 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f6e0c07b260 0x7f6e0c07d770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:54:22.986 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:22.980+0000 7f6e07fff640 1 -- 172.21.15.150:0/3276795105 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(144..144 src has 1..144) ==== 5990+0+0 (secure 0 0 0) 0x7f6e100bb510 con 0x7f6e200b5d50 2024-09-17T05:54:22.986 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:22.980+0000 7f6e1effd640 1 --2- 172.21.15.150:0/3276795105 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f6e0c07b260 0x7f6e0c07d770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:54:22.986 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:22.980+0000 7f6e1effd640 1 --2- 172.21.15.150:0/3276795105 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f6e0c07b260 0x7f6e0c07d770 secure :-1 s=READY pgs=841 cs=0 l=1 rev1=1 crypto rx=0x7f6e2006f5a0 tx=0x7f6e14009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:54:22.987 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:22.984+0000 7f6e07fff640 1 -- 172.21.15.150:0/3276795105 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f6e1003f030 con 0x7f6e200b5d50 2024-09-17T05:54:23.164 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:23.163+0000 7f6e25b89640 1 -- 172.21.15.150:0/3276795105 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f6e200d2d60 con 0x7f6e200b5d50 2024-09-17T05:54:23.166 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:23.164+0000 7f6e07fff640 1 -- 172.21.15.150:0/3276795105 <== mon.0 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v144) ==== 74+0+17249 (secure 0 0 0) 0x7f6e100854e0 con 0x7f6e200b5d50 2024-09-17T05:54:23.166 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-09-17T05:54:23.166 INFO:teuthology.orchestra.run.smithi150.stdout:{"epoch":144,"fsid":"9f2e05e9-d629-47b3-b26b-1360655b7d20","created":"2024-09-17T05:41:32.502979+0000","modified":"2024-09-17T05:54:20.244210+0000","last_up_change":"2024-09-17T05:41:46.150225+0000","last_in_change":"2024-09-17T05:41:36.120274+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":21,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T05:41:46.860779+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":20,"pool_name":"cephfs_metadata","create_time":"2024-09-17T05:53:11.522067+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"140","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":21,"pool_name":"cephfs_data","create_time":"2024-09-17T05:53:12.853902+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"144","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":3,"snap_epoch":144,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"4f31c018-c8a4-4d6d-b0c2-a597c47aae4a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":139,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6800","nonce":479374392},{"type":"v1","addr":"172.21.15.150:6801","nonce":479374392}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6802","nonce":479374392},{"type":"v1","addr":"172.21.15.150:6803","nonce":479374392}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6806","nonce":479374392},{"type":"v1","addr":"172.21.15.150:6807","nonce":479374392}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6804","nonce":479374392},{"type":"v1","addr":"172.21.15.150:6805","nonce":479374392}]},"public_addr":"172.21.15.150:6801/479374392","cluster_addr":"172.21.15.150:6803/479374392","heartbeat_back_addr":"172.21.15.150:6807/479374392","heartbeat_front_addr":"172.21.15.150:6805/479374392","state":["exists","up"]},{"osd":1,"uuid":"6ff4a573-500b-4e04-9de3-39265ead78b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":139,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6824","nonce":913899800},{"type":"v1","addr":"172.21.15.150:6825","nonce":913899800}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6826","nonce":913899800},{"type":"v1","addr":"172.21.15.150:6827","nonce":913899800}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6830","nonce":913899800},{"type":"v1","addr":"172.21.15.150:6831","nonce":913899800}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6828","nonce":913899800},{"type":"v1","addr":"172.21.15.150:6829","nonce":913899800}]},"public_addr":"172.21.15.150:6825/913899800","cluster_addr":"172.21.15.150:6827/913899800","heartbeat_back_addr":"172.21.15.150:6831/913899800","heartbeat_front_addr":"172.21.15.150:6829/913899800","state":["exists","up"]},{"osd":2,"uuid":"bffea6f9-2465-4182-b205-00436c41ac1c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":139,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6816","nonce":363718461},{"type":"v1","addr":"172.21.15.150:6817","nonce":363718461}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6818","nonce":363718461},{"type":"v1","addr":"172.21.15.150:6819","nonce":363718461}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6822","nonce":363718461},{"type":"v1","addr":"172.21.15.150:6823","nonce":363718461}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6820","nonce":363718461},{"type":"v1","addr":"172.21.15.150:6821","nonce":363718461}]},"public_addr":"172.21.15.150:6817/363718461","cluster_addr":"172.21.15.150:6819/363718461","heartbeat_back_addr":"172.21.15.150:6823/363718461","heartbeat_front_addr":"172.21.15.150:6821/363718461","state":["exists","up"]},{"osd":3,"uuid":"cda70430-d1e1-427e-b04e-56db4031d078","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":139,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6808","nonce":3550994626},{"type":"v1","addr":"172.21.15.150:6809","nonce":3550994626}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6810","nonce":3550994626},{"type":"v1","addr":"172.21.15.150:6811","nonce":3550994626}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6814","nonce":3550994626},{"type":"v1","addr":"172.21.15.150:6815","nonce":3550994626}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6812","nonce":3550994626},{"type":"v1","addr":"172.21.15.150:6813","nonce":3550994626}]},"public_addr":"172.21.15.150:6809/3550994626","cluster_addr":"172.21.15.150:6811/3550994626","heartbeat_back_addr":"172.21.15.150:6815/3550994626","heartbeat_front_addr":"172.21.15.150:6813/3550994626","state":["exists","up"]},{"osd":4,"uuid":"3a0277fb-5e1e-4f68-bb2d-9a8a0152f64a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":139,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6810","nonce":2718261497},{"type":"v1","addr":"172.21.15.176:6811","nonce":2718261497}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6812","nonce":2718261497},{"type":"v1","addr":"172.21.15.176:6813","nonce":2718261497}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6816","nonce":2718261497},{"type":"v1","addr":"172.21.15.176:6817","nonce":2718261497}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6814","nonce":2718261497},{"type":"v1","addr":"172.21.15.176:6815","nonce":2718261497}]},"public_addr":"172.21.15.176:6811/2718261497","cluster_addr":"172.21.15.176:6813/2718261497","heartbeat_back_addr":"172.21.15.176:6817/2718261497","heartbeat_front_addr":"172.21.15.176:6815/2718261497","state":["exists","up"]},{"osd":5,"uuid":"33aebee6-0315-40b7-a11c-6702f0be494d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":139,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6818","nonce":2049295774},{"type":"v1","addr":"172.21.15.176:6819","nonce":2049295774}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6820","nonce":2049295774},{"type":"v1","addr":"172.21.15.176:6821","nonce":2049295774}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6824","nonce":2049295774},{"type":"v1","addr":"172.21.15.176:6825","nonce":2049295774}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6822","nonce":2049295774},{"type":"v1","addr":"172.21.15.176:6823","nonce":2049295774}]},"public_addr":"172.21.15.176:6819/2049295774","cluster_addr":"172.21.15.176:6821/2049295774","heartbeat_back_addr":"172.21.15.176:6825/2049295774","heartbeat_front_addr":"172.21.15.176:6823/2049295774","state":["exists","up"]},{"osd":6,"uuid":"4d24f360-6751-4263-841b-d77793d33540","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":139,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6826","nonce":2164458476},{"type":"v1","addr":"172.21.15.176:6827","nonce":2164458476}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6828","nonce":2164458476},{"type":"v1","addr":"172.21.15.176:6829","nonce":2164458476}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6832","nonce":2164458476},{"type":"v1","addr":"172.21.15.176:6833","nonce":2164458476}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6830","nonce":2164458476},{"type":"v1","addr":"172.21.15.176:6831","nonce":2164458476}]},"public_addr":"172.21.15.176:6827/2164458476","cluster_addr":"172.21.15.176:6829/2164458476","heartbeat_back_addr":"172.21.15.176:6833/2164458476","heartbeat_front_addr":"172.21.15.176:6831/2164458476","state":["exists","up"]},{"osd":7,"uuid":"c8594fda-c74a-4ba9-8277-caf101d58ca1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":142,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6802","nonce":3239587708},{"type":"v1","addr":"172.21.15.176:6803","nonce":3239587708}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6804","nonce":3239587708},{"type":"v1","addr":"172.21.15.176:6805","nonce":3239587708}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6808","nonce":3239587708},{"type":"v1","addr":"172.21.15.176:6809","nonce":3239587708}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6806","nonce":3239587708},{"type":"v1","addr":"172.21.15.176:6807","nonce":3239587708}]},"public_addr":"172.21.15.176:6803/3239587708","cluster_addr":"172.21.15.176:6805/3239587708","heartbeat_back_addr":"172.21.15.176:6809/3239587708","heartbeat_front_addr":"172.21.15.176:6807/3239587708","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:41:41.905151+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:41:42.705679+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:41:42.459673+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:41:42.440819+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:41:42.668428+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:41:42.694972+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:41:43.078535+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:41:42.363539+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"21.36","mappings":[{"from":4,"to":3}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":7,"snaps":[{"begin":2,"length":2}]},{"pool":9,"snaps":[{"begin":2,"length":2}]},{"pool":11,"snaps":[{"begin":2,"length":2}]},{"pool":13,"snaps":[{"begin":2,"length":2}]},{"pool":15,"snaps":[{"begin":2,"length":2}]},{"pool":17,"snaps":[{"begin":2,"length":2}]},{"pool":19,"snaps":[{"begin":2,"length":2}]},{"pool":21,"snaps":[{"begin":2,"length":2}]}],"new_removed_snaps":[{"pool":21,"snaps":[{"begin":2,"length":2}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T05:54:23.169 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:23.166+0000 7f6e25b89640 1 -- 172.21.15.150:0/3276795105 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f6e0c07b260 msgr2=0x7f6e0c07d770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:54:23.169 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:23.166+0000 7f6e25b89640 1 --2- 172.21.15.150:0/3276795105 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f6e0c07b260 0x7f6e0c07d770 secure :-1 s=READY pgs=841 cs=0 l=1 rev1=1 crypto rx=0x7f6e2006f5a0 tx=0x7f6e14009040 comp rx=0 tx=0).stop 2024-09-17T05:54:23.170 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:23.166+0000 7f6e25b89640 1 -- 172.21.15.150:0/3276795105 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6e200b5d50 msgr2=0x7f6e2015a5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:54:23.170 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:23.166+0000 7f6e25b89640 1 --2- 172.21.15.150:0/3276795105 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6e200b5d50 0x7f6e2015a5e0 secure :-1 s=READY pgs=1984 cs=0 l=1 rev1=1 crypto rx=0x7f6e10009950 tx=0x7f6e10033d60 comp rx=0 tx=0).stop 2024-09-17T05:54:23.170 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:23.166+0000 7f6e25b89640 1 -- 172.21.15.150:0/3276795105 shutdown_connections 2024-09-17T05:54:23.170 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:23.166+0000 7f6e25b89640 1 --2- 172.21.15.150:0/3276795105 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6e200d4f90 0x7f6e20156370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:54:23.170 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:23.166+0000 7f6e25b89640 1 --2- 172.21.15.150:0/3276795105 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f6e0c07b260 0x7f6e0c07d770 unknown :-1 s=CLOSED pgs=841 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:54:23.170 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:23.166+0000 7f6e25b89640 1 --2- 172.21.15.150:0/3276795105 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6e201548f0 0x7f6e201541e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:54:23.171 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:23.166+0000 7f6e25b89640 1 --2- 172.21.15.150:0/3276795105 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6e200b5d50 0x7f6e2015a5e0 unknown :-1 s=CLOSED pgs=1984 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:54:23.171 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:23.166+0000 7f6e25b89640 1 -- 172.21.15.150:0/3276795105 >> 172.21.15.150:0/3276795105 conn(0x7f6e2008bfe0 msgr2=0x7f6e200b5460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:54:23.171 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:23.166+0000 7f6e25b89640 1 -- 172.21.15.150:0/3276795105 shutdown_connections 2024-09-17T05:54:23.171 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:23.166+0000 7f6e25b89640 1 -- 172.21.15.150:0/3276795105 wait complete. 2024-09-17T05:54:23.181 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-09-17T05:54:23.181 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T05:54:23.299 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:23.297+0000 7f250ada8640 1 -- 172.21.15.150:0/2615517720 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f25040cffe0 msgr2=0x7f25040d03f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:54:23.299 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:23.297+0000 7f250ada8640 1 --2- 172.21.15.150:0/2615517720 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f25040cffe0 0x7f25040d03f0 secure :-1 s=READY pgs=1985 cs=0 l=1 rev1=1 crypto rx=0x7f25040b84c0 tx=0x7f24fc02a560 comp rx=0 tx=0).stop 2024-09-17T05:54:23.299 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:23.297+0000 7f250ada8640 1 -- 172.21.15.150:0/2615517720 shutdown_connections 2024-09-17T05:54:23.299 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:23.297+0000 7f250ada8640 1 --2- 172.21.15.150:0/2615517720 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f25040cffe0 0x7f25040d03f0 unknown :-1 s=CLOSED pgs=1985 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:54:23.299 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:23.297+0000 7f250ada8640 1 --2- 172.21.15.150:0/2615517720 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f25040cd440 0x7f25040cd850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:54:23.299 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:23.297+0000 7f250ada8640 1 --2- 172.21.15.150:0/2615517720 >> v2:172.21.15.176:3300/0 conn(0x7f250409ba60 0x7f25040b7330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:54:23.300 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:23.297+0000 7f250ada8640 1 -- 172.21.15.150:0/2615517720 >> 172.21.15.150:0/2615517720 conn(0x7f25040cee90 msgr2=0x7f25040cf2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:54:23.300 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:23.297+0000 7f250ada8640 1 -- 172.21.15.150:0/2615517720 shutdown_connections 2024-09-17T05:54:23.300 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:23.297+0000 7f250ada8640 1 -- 172.21.15.150:0/2615517720 wait complete. 2024-09-17T05:54:23.300 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:23.299+0000 7f250ada8640 1 Processor -- start 2024-09-17T05:54:23.301 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:23.299+0000 7f250ada8640 1 -- start start 2024-09-17T05:54:23.303 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:23.300+0000 7f250ada8640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f250409ba60 0x7f250409f930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:54:23.303 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:23.300+0000 7f250ada8640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f25040cd440 0x7f25041e7ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:54:23.303 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:23.300+0000 7f250ada8640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f25040cffe0 0x7f250409d0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:54:23.304 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:23.300+0000 7f250ada8640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f25040d0d70 con 0x7f25040cd440 2024-09-17T05:54:23.304 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:23.300+0000 7f250ada8640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f25040d0bf0 con 0x7f250409ba60 2024-09-17T05:54:23.304 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:23.300+0000 7f250ada8640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f25040d0ef0 con 0x7f25040cffe0 2024-09-17T05:54:23.304 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:23.300+0000 7f2503fff640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f25040cd440 0x7f25041e7ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:54:23.304 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:23.300+0000 7f2503fff640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f25040cd440 0x7f25041e7ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:59062/0 (socket says 172.21.15.150:59062) 2024-09-17T05:54:23.304 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:23.300+0000 7f2503fff640 1 -- 172.21.15.150:0/34806552 learned_addr learned my addr 172.21.15.150:0/34806552 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:54:23.304 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:23.300+0000 7f2509345640 1 --2- 172.21.15.150:0/34806552 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f25040cffe0 0x7f250409d0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:54:23.304 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:23.300+0000 7f2508b44640 1 --2- 172.21.15.150:0/34806552 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f250409ba60 0x7f250409f930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:54:23.304 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:23.301+0000 7f2503fff640 1 -- 172.21.15.150:0/34806552 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f25040cffe0 msgr2=0x7f250409d0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:54:23.304 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:23.301+0000 7f2503fff640 1 --2- 172.21.15.150:0/34806552 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f25040cffe0 0x7f250409d0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:54:23.304 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:23.301+0000 7f2503fff640 1 -- 172.21.15.150:0/34806552 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f250409ba60 msgr2=0x7f250409f930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:54:23.304 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:23.301+0000 7f2503fff640 1 --2- 172.21.15.150:0/34806552 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f250409ba60 0x7f250409f930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:54:23.304 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:23.301+0000 7f2503fff640 1 -- 172.21.15.150:0/34806552 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f25041e5880 con 0x7f25040cd440 2024-09-17T05:54:23.305 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:23.301+0000 7f2503fff640 1 --2- 172.21.15.150:0/34806552 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f25040cd440 0x7f25041e7ee0 secure :-1 s=READY pgs=1986 cs=0 l=1 rev1=1 crypto rx=0x7f24ec00e6c0 tx=0x7f24ec00eb80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:54:23.305 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:23.301+0000 7f25017fa640 1 -- 172.21.15.150:0/34806552 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24ec004230 con 0x7f25040cd440 2024-09-17T05:54:23.305 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:23.301+0000 7f25017fa640 1 -- 172.21.15.150:0/34806552 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f24ec0043d0 con 0x7f25040cd440 2024-09-17T05:54:23.306 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:23.301+0000 7f250ada8640 1 -- 172.21.15.150:0/34806552 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f25041e5b60 con 0x7f25040cd440 2024-09-17T05:54:23.306 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:23.301+0000 7f25017fa640 1 -- 172.21.15.150:0/34806552 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24ec00cb10 con 0x7f25040cd440 2024-09-17T05:54:23.306 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:23.301+0000 7f250ada8640 1 -- 172.21.15.150:0/34806552 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f25041e6120 con 0x7f25040cd440 2024-09-17T05:54:23.307 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:23.302+0000 7f250ada8640 1 -- 172.21.15.150:0/34806552 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f25040cc720 con 0x7f25040cd440 2024-09-17T05:54:23.307 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:23.303+0000 7f25017fa640 1 -- 172.21.15.150:0/34806552 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 51) ==== 104960+0+0 (secure 0 0 0) 0x7f24ec00ccb0 con 0x7f25040cd440 2024-09-17T05:54:23.307 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:23.303+0000 7f25017fa640 1 --2- 172.21.15.150:0/34806552 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f24e407b290 0x7f24e407d7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:54:23.307 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:23.304+0000 7f25017fa640 1 -- 172.21.15.150:0/34806552 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(144..144 src has 1..144) ==== 5990+0+0 (secure 0 0 0) 0x7f24ec09a770 con 0x7f25040cd440 2024-09-17T05:54:23.307 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:23.304+0000 7f2508b44640 1 --2- 172.21.15.150:0/34806552 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f24e407b290 0x7f24e407d7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:54:23.308 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:23.304+0000 7f2508b44640 1 --2- 172.21.15.150:0/34806552 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f24e407b290 0x7f24e407d7a0 secure :-1 s=READY pgs=842 cs=0 l=1 rev1=1 crypto rx=0x7f24f4005fd0 tx=0x7f24f40094a0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:54:23.309 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:23.308+0000 7f25017fa640 1 -- 172.21.15.150:0/34806552 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f24ec064060 con 0x7f25040cd440 2024-09-17T05:54:23.525 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:23.522+0000 7f250ada8640 1 -- 172.21.15.150:0/34806552 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f25040cd850 con 0x7f25040cd440 2024-09-17T05:54:23.525 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:23.523+0000 7f25017fa640 1 -- 172.21.15.150:0/34806552 <== mon.0 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 89 v89) ==== 94+0+5233 (secure 0 0 0) 0x7f24ec068a90 con 0x7f25040cd440 2024-09-17T05:54:23.525 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-09-17T05:54:23.525 INFO:teuthology.orchestra.run.smithi150.stdout:{"epoch":89,"btime":"2024-09-17T05:53:25:564938+0000","default_fscid":10,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7418,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6836/984747558","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6834","nonce":984747558},{"type":"v1","addr":"172.21.15.176:6836","nonce":984747558}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":85},{"gid":7421,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6837/1815277837","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6835","nonce":1815277837},{"type":"v1","addr":"172.21.15.176:6837","nonce":1815277837}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":85},{"gid":9630,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6834/2397551288","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6832","nonce":2397551288},{"type":"v1","addr":"172.21.15.150:6834","nonce":2397551288}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":84}],"filesystems":[{"mdsmap":{"epoch":88,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T05:53:13.900105+0000","modified":"2024-09-17T05:53:15.896921+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":9633},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9633":{"gid":9633,"name":"c","rank":0,"incarnation":86,"state":"up:active","state_seq":3,"addr":"172.21.15.150:6835/122540131","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6833","nonce":122540131},{"type":"v1","addr":"172.21.15.150:6835","nonce":122540131}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[21],"metadata_pool":20,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":9633,"qdb_cluster":[9633]},"id":10}]} 2024-09-17T05:54:23.526 INFO:teuthology.orchestra.run.smithi150.stderr:dumped fsmap epoch 89 2024-09-17T05:54:23.527 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:23.525+0000 7f250ada8640 1 -- 172.21.15.150:0/34806552 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f24e407b290 msgr2=0x7f24e407d7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:54:23.527 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:23.525+0000 7f250ada8640 1 --2- 172.21.15.150:0/34806552 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f24e407b290 0x7f24e407d7a0 secure :-1 s=READY pgs=842 cs=0 l=1 rev1=1 crypto rx=0x7f24f4005fd0 tx=0x7f24f40094a0 comp rx=0 tx=0).stop 2024-09-17T05:54:23.527 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:23.525+0000 7f250ada8640 1 -- 172.21.15.150:0/34806552 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f25040cd440 msgr2=0x7f25041e7ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:54:23.527 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:23.525+0000 7f250ada8640 1 --2- 172.21.15.150:0/34806552 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f25040cd440 0x7f25041e7ee0 secure :-1 s=READY pgs=1986 cs=0 l=1 rev1=1 crypto rx=0x7f24ec00e6c0 tx=0x7f24ec00eb80 comp rx=0 tx=0).stop 2024-09-17T05:54:23.527 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:23.525+0000 7f250ada8640 1 -- 172.21.15.150:0/34806552 shutdown_connections 2024-09-17T05:54:23.527 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:23.525+0000 7f250ada8640 1 --2- 172.21.15.150:0/34806552 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f24e407b290 0x7f24e407d7a0 unknown :-1 s=CLOSED pgs=842 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:54:23.527 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:23.525+0000 7f250ada8640 1 --2- 172.21.15.150:0/34806552 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f25040cffe0 0x7f250409d0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:54:23.527 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:23.525+0000 7f250ada8640 1 --2- 172.21.15.150:0/34806552 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f25040cd440 0x7f25041e7ee0 unknown :-1 s=CLOSED pgs=1986 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:54:23.527 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:23.525+0000 7f250ada8640 1 --2- 172.21.15.150:0/34806552 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f250409ba60 0x7f250409f930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:54:23.528 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:23.525+0000 7f250ada8640 1 -- 172.21.15.150:0/34806552 >> 172.21.15.150:0/34806552 conn(0x7f25040cee90 msgr2=0x7f25041e4eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:54:23.528 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:23.525+0000 7f250ada8640 1 -- 172.21.15.150:0/34806552 shutdown_connections 2024-09-17T05:54:23.528 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:23.525+0000 7f250ada8640 1 -- 172.21.15.150:0/34806552 wait complete. 2024-09-17T05:54:23.539 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T05:54:23.651 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:23.649+0000 7f06a2c07640 1 -- 172.21.15.150:0/3992769733 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f069c0b7490 msgr2=0x7f069c0d0590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:54:23.651 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:23.649+0000 7f06a2c07640 1 --2- 172.21.15.150:0/3992769733 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f069c0b7490 0x7f069c0d0590 secure :-1 s=READY pgs=1988 cs=0 l=1 rev1=1 crypto rx=0x7f0698009820 tx=0x7f069802a5a0 comp rx=0 tx=0).stop 2024-09-17T05:54:23.651 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:23.649+0000 7f06a2c07640 1 -- 172.21.15.150:0/3992769733 shutdown_connections 2024-09-17T05:54:23.652 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:23.649+0000 7f06a2c07640 1 --2- 172.21.15.150:0/3992769733 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f069c0b7490 0x7f069c0d0590 unknown :-1 s=CLOSED pgs=1988 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:54:23.652 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:23.649+0000 7f06a2c07640 1 -- 172.21.15.150:0/3992769733 >> 172.21.15.150:0/3992769733 conn(0x7f069c0cef30 msgr2=0x7f069c0cf340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:54:23.652 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:23.649+0000 7f06a2c07640 1 -- 172.21.15.150:0/3992769733 shutdown_connections 2024-09-17T05:54:23.652 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:23.649+0000 7f06a2c07640 1 -- 172.21.15.150:0/3992769733 wait complete. 2024-09-17T05:54:23.653 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:23.651+0000 7f06a2c07640 1 Processor -- start 2024-09-17T05:54:23.653 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:23.651+0000 7f06a2c07640 1 -- start start 2024-09-17T05:54:23.655 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:23.652+0000 7f06a2c07640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f069c0b7490 0x7f069c0b1e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:54:23.655 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:23.653+0000 7f06a2c07640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f069c0cd890 0x7f069c1d9580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:54:23.656 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:23.653+0000 7f06a2c07640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f069c0d0ad0 0x7f069c1e6d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:54:23.656 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:23.653+0000 7f06a2c07640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f069c0d14a0 con 0x7f069c0b7490 2024-09-17T05:54:23.656 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:23.653+0000 7f06a2c07640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f069c0ceb70 con 0x7f069c0d0ad0 2024-09-17T05:54:23.656 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:23.653+0000 7f06a2c07640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f069c1f4f30 con 0x7f069c0cd890 2024-09-17T05:54:23.656 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:23.653+0000 7f06a09a3640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f069c0b7490 0x7f069c0b1e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:54:23.656 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:23.653+0000 7f06a09a3640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f069c0b7490 0x7f069c0b1e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:59074/0 (socket says 172.21.15.150:59074) 2024-09-17T05:54:23.656 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:23.653+0000 7f06a09a3640 1 -- 172.21.15.150:0/3144681947 learned_addr learned my addr 172.21.15.150:0/3144681947 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:54:23.656 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:23.653+0000 7f0693fff640 1 --2- 172.21.15.150:0/3144681947 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f069c0cd890 0x7f069c1d9580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:54:23.656 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:23.653+0000 7f06a11a4640 1 --2- 172.21.15.150:0/3144681947 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f069c0d0ad0 0x7f069c1e6d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:54:23.656 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:23.653+0000 7f06a09a3640 1 -- 172.21.15.150:0/3144681947 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f069c0cd890 msgr2=0x7f069c1d9580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:54:23.656 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:23.653+0000 7f06a09a3640 1 --2- 172.21.15.150:0/3144681947 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f069c0cd890 0x7f069c1d9580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:54:23.656 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:23.653+0000 7f06a09a3640 1 -- 172.21.15.150:0/3144681947 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f069c0d0ad0 msgr2=0x7f069c1e6d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:54:23.656 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:23.653+0000 7f06a09a3640 1 --2- 172.21.15.150:0/3144681947 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f069c0d0ad0 0x7f069c1e6d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:54:23.657 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:23.653+0000 7f06a09a3640 1 -- 172.21.15.150:0/3144681947 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f069c0b29a0 con 0x7f069c0b7490 2024-09-17T05:54:23.657 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:23.653+0000 7f06a11a4640 1 --2- 172.21.15.150:0/3144681947 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f069c0d0ad0 0x7f069c1e6d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:54:23.657 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:23.653+0000 7f06a09a3640 1 --2- 172.21.15.150:0/3144681947 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f069c0b7490 0x7f069c0b1e70 secure :-1 s=READY pgs=1989 cs=0 l=1 rev1=1 crypto rx=0x7f0698009940 tx=0x7f0698004b90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:54:23.657 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:23.653+0000 7f06917fa640 1 -- 172.21.15.150:0/3144681947 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0698031b50 con 0x7f069c0b7490 2024-09-17T05:54:23.657 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:23.653+0000 7f06917fa640 1 -- 172.21.15.150:0/3144681947 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0698031de0 con 0x7f069c0b7490 2024-09-17T05:54:23.657 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:23.653+0000 7f06a2c07640 1 -- 172.21.15.150:0/3144681947 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f069c0b2c80 con 0x7f069c0b7490 2024-09-17T05:54:23.657 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:23.653+0000 7f06917fa640 1 -- 172.21.15.150:0/3144681947 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06980052a0 con 0x7f069c0b7490 2024-09-17T05:54:23.657 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:23.653+0000 7f06a2c07640 1 -- 172.21.15.150:0/3144681947 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f069c0b3760 con 0x7f069c0b7490 2024-09-17T05:54:23.658 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:23.654+0000 7f06a2c07640 1 -- 172.21.15.150:0/3144681947 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f069c0cfe10 con 0x7f069c0b7490 2024-09-17T05:54:23.658 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:23.655+0000 7f06917fa640 1 -- 172.21.15.150:0/3144681947 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 51) ==== 104960+0+0 (secure 0 0 0) 0x7f0698005440 con 0x7f069c0b7490 2024-09-17T05:54:23.658 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:23.656+0000 7f06917fa640 1 --2- 172.21.15.150:0/3144681947 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f068807b260 0x7f068807d770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:54:23.658 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:23.656+0000 7f06917fa640 1 -- 172.21.15.150:0/3144681947 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(144..144 src has 1..144) ==== 5990+0+0 (secure 0 0 0) 0x7f06980bb1d0 con 0x7f069c0b7490 2024-09-17T05:54:23.658 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:23.656+0000 7f0693fff640 1 --2- 172.21.15.150:0/3144681947 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f068807b260 0x7f068807d770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:54:23.658 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:23.657+0000 7f0693fff640 1 --2- 172.21.15.150:0/3144681947 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f068807b260 0x7f068807d770 secure :-1 s=READY pgs=843 cs=0 l=1 rev1=1 crypto rx=0x7f069c1e7ba0 tx=0x7f068c009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:54:23.662 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:23.660+0000 7f06917fa640 1 -- 172.21.15.150:0/3144681947 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f069c0cfe10 con 0x7f069c0b7490 2024-09-17T05:54:23.872 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:23.870+0000 7f06a2c07640 1 -- 172.21.15.150:0/3144681947 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f069c0d0830 con 0x7f069c0b7490 2024-09-17T05:54:23.988 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:23.871+0000 7f06917fa640 1 -- 172.21.15.150:0/3144681947 <== mon.0 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 89 v89) ==== 94+0+5233 (secure 0 0 0) 0x7f069c0d0830 con 0x7f069c0b7490 2024-09-17T05:54:23.989 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-09-17T05:54:23.989 INFO:teuthology.orchestra.run.smithi150.stdout:{"epoch":89,"btime":"2024-09-17T05:53:25:564938+0000","default_fscid":10,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7418,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6836/984747558","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6834","nonce":984747558},{"type":"v1","addr":"172.21.15.176:6836","nonce":984747558}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":85},{"gid":7421,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6837/1815277837","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6835","nonce":1815277837},{"type":"v1","addr":"172.21.15.176:6837","nonce":1815277837}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":85},{"gid":9630,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6834/2397551288","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6832","nonce":2397551288},{"type":"v1","addr":"172.21.15.150:6834","nonce":2397551288}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":84}],"filesystems":[{"mdsmap":{"epoch":88,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T05:53:13.900105+0000","modified":"2024-09-17T05:53:15.896921+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":9633},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9633":{"gid":9633,"name":"c","rank":0,"incarnation":86,"state":"up:active","state_seq":3,"addr":"172.21.15.150:6835/122540131","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6833","nonce":122540131},{"type":"v1","addr":"172.21.15.150:6835","nonce":122540131}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[21],"metadata_pool":20,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":9633,"qdb_cluster":[9633]},"id":10}]} 2024-09-17T05:54:23.991 INFO:teuthology.orchestra.run.smithi150.stderr:dumped fsmap epoch 89 2024-09-17T05:54:23.991 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:23.873+0000 7f06a2c07640 1 -- 172.21.15.150:0/3144681947 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f068807b260 msgr2=0x7f068807d770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:54:23.992 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:23.873+0000 7f06a2c07640 1 --2- 172.21.15.150:0/3144681947 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f068807b260 0x7f068807d770 secure :-1 s=READY pgs=843 cs=0 l=1 rev1=1 crypto rx=0x7f069c1e7ba0 tx=0x7f068c009040 comp rx=0 tx=0).stop 2024-09-17T05:54:23.992 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:23.873+0000 7f06a2c07640 1 -- 172.21.15.150:0/3144681947 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f069c0b7490 msgr2=0x7f069c0b1e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:54:23.992 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:23.873+0000 7f06a2c07640 1 --2- 172.21.15.150:0/3144681947 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f069c0b7490 0x7f069c0b1e70 secure :-1 s=READY pgs=1989 cs=0 l=1 rev1=1 crypto rx=0x7f0698009940 tx=0x7f0698004b90 comp rx=0 tx=0).stop 2024-09-17T05:54:23.994 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:23.873+0000 7f06a2c07640 1 -- 172.21.15.150:0/3144681947 shutdown_connections 2024-09-17T05:54:23.994 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:23.873+0000 7f06a2c07640 1 --2- 172.21.15.150:0/3144681947 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f069c0d0ad0 0x7f069c1e6d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:54:23.994 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:23.873+0000 7f06a2c07640 1 --2- 172.21.15.150:0/3144681947 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f068807b260 0x7f068807d770 unknown :-1 s=CLOSED pgs=843 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:54:23.994 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:23.873+0000 7f06a2c07640 1 --2- 172.21.15.150:0/3144681947 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f069c0cd890 0x7f069c1d9580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:54:23.994 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:23.873+0000 7f06a2c07640 1 --2- 172.21.15.150:0/3144681947 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f069c0b7490 0x7f069c0b1e70 unknown :-1 s=CLOSED pgs=1989 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:54:23.994 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:23.873+0000 7f06a2c07640 1 -- 172.21.15.150:0/3144681947 >> 172.21.15.150:0/3144681947 conn(0x7f069c0cef30 msgr2=0x7f069c0b52e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:54:23.994 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:23.873+0000 7f06a2c07640 1 -- 172.21.15.150:0/3144681947 shutdown_connections 2024-09-17T05:54:23.994 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:23.873+0000 7f06a2c07640 1 -- 172.21.15.150:0/3144681947 wait complete. 2024-09-17T05:54:23.995 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T05:54:24.108 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:24.106+0000 7fb1e485c640 1 -- 172.21.15.150:0/2983882487 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb1e00b6420 msgr2=0x7fb1e01665a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:54:24.108 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:24.106+0000 7fb1e485c640 1 --2- 172.21.15.150:0/2983882487 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb1e00b6420 0x7fb1e01665a0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fb1d8009be0 tx=0x7fb1d802a8b0 comp rx=0 tx=0).stop 2024-09-17T05:54:24.109 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:24.106+0000 7fb1e485c640 1 -- 172.21.15.150:0/2983882487 shutdown_connections 2024-09-17T05:54:24.109 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:24.106+0000 7fb1e485c640 1 --2- 172.21.15.150:0/2983882487 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb1e00b6420 0x7fb1e01665a0 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:54:24.109 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:24.106+0000 7fb1e485c640 1 -- 172.21.15.150:0/2983882487 >> 172.21.15.150:0/2983882487 conn(0x7fb1e00b2fd0 msgr2=0x7fb1e00b33e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:54:24.109 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:24.106+0000 7fb1e485c640 1 -- 172.21.15.150:0/2983882487 shutdown_connections 2024-09-17T05:54:24.109 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:24.106+0000 7fb1e485c640 1 -- 172.21.15.150:0/2983882487 wait complete. 2024-09-17T05:54:24.110 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:24.108+0000 7fb1e485c640 1 Processor -- start 2024-09-17T05:54:24.110 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:24.109+0000 7fb1e485c640 1 -- start start 2024-09-17T05:54:24.113 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:24.110+0000 7fb1e485c640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb1e00b6420 0x7fb1e014f760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:54:24.113 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:24.110+0000 7fb1e485c640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb1e00cf7c0 0x7fb1e006cda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:54:24.113 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:24.110+0000 7fb1e485c640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb1e015ee30 0x7fb1e006d2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:54:24.113 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:24.110+0000 7fb1e485c640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7fb1e0166cf0 con 0x7fb1e00cf7c0 2024-09-17T05:54:24.113 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:24.110+0000 7fb1e485c640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fb1e00b6b10 con 0x7fb1e00b6420 2024-09-17T05:54:24.113 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:24.110+0000 7fb1e485c640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fb1e0166e70 con 0x7fb1e015ee30 2024-09-17T05:54:24.113 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:24.110+0000 7fb1d5d9b640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb1e00cf7c0 0x7fb1e006cda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:54:24.113 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:24.110+0000 7fb1d5d9b640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb1e00cf7c0 0x7fb1e006cda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:59088/0 (socket says 172.21.15.150:59088) 2024-09-17T05:54:24.113 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:24.110+0000 7fb1d5d9b640 1 -- 172.21.15.150:0/1390865499 learned_addr learned my addr 172.21.15.150:0/1390865499 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:54:24.113 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:24.110+0000 7fb1ded9d640 1 --2- 172.21.15.150:0/1390865499 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb1e015ee30 0x7fb1e006d2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:54:24.113 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:24.110+0000 7fb1de59c640 1 --2- 172.21.15.150:0/1390865499 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb1e00b6420 0x7fb1e014f760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:54:24.114 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:24.110+0000 7fb1d5d9b640 1 -- 172.21.15.150:0/1390865499 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb1e015ee30 msgr2=0x7fb1e006d2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:54:24.114 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:24.110+0000 7fb1d5d9b640 1 --2- 172.21.15.150:0/1390865499 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb1e015ee30 0x7fb1e006d2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:54:24.114 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:24.110+0000 7fb1d5d9b640 1 -- 172.21.15.150:0/1390865499 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb1e00b6420 msgr2=0x7fb1e014f760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:54:24.114 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:24.110+0000 7fb1d5d9b640 1 --2- 172.21.15.150:0/1390865499 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb1e00b6420 0x7fb1e014f760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:54:24.114 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:24.110+0000 7fb1d5d9b640 1 -- 172.21.15.150:0/1390865499 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb1e01f9120 con 0x7fb1e00cf7c0 2024-09-17T05:54:24.114 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:24.110+0000 7fb1d5d9b640 1 --2- 172.21.15.150:0/1390865499 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb1e00cf7c0 0x7fb1e006cda0 secure :-1 s=READY pgs=1991 cs=0 l=1 rev1=1 crypto rx=0x7fb1c800c680 tx=0x7fb1c800cb40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:54:24.114 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:24.111+0000 7fb1d77fe640 1 -- 172.21.15.150:0/1390865499 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb1c8016020 con 0x7fb1e00cf7c0 2024-09-17T05:54:24.114 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:24.111+0000 7fb1d77fe640 1 -- 172.21.15.150:0/1390865499 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb1c800a930 con 0x7fb1e00cf7c0 2024-09-17T05:54:24.114 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:24.111+0000 7fb1e485c640 1 -- 172.21.15.150:0/1390865499 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb1e0150040 con 0x7fb1e00cf7c0 2024-09-17T05:54:24.114 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:24.111+0000 7fb1d77fe640 1 -- 172.21.15.150:0/1390865499 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb1c800ad60 con 0x7fb1e00cf7c0 2024-09-17T05:54:24.114 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:24.111+0000 7fb1e485c640 1 -- 172.21.15.150:0/1390865499 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb1e01f9670 con 0x7fb1e00cf7c0 2024-09-17T05:54:24.115 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:24.112+0000 7fb1e485c640 1 -- 172.21.15.150:0/1390865499 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb1e00b2840 con 0x7fb1e00cf7c0 2024-09-17T05:54:24.115 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:24.112+0000 7fb1d77fe640 1 -- 172.21.15.150:0/1390865499 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 51) ==== 104960+0+0 (secure 0 0 0) 0x7fb1c8019020 con 0x7fb1e00cf7c0 2024-09-17T05:54:24.115 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:24.113+0000 7fb1d77fe640 1 --2- 172.21.15.150:0/1390865499 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fb1c007b260 0x7fb1c007d770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:54:24.115 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:24.113+0000 7fb1d77fe640 1 -- 172.21.15.150:0/1390865499 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(144..144 src has 1..144) ==== 5990+0+0 (secure 0 0 0) 0x7fb1c8099ef0 con 0x7fb1e00cf7c0 2024-09-17T05:54:24.115 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:24.113+0000 7fb1de59c640 1 --2- 172.21.15.150:0/1390865499 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fb1c007b260 0x7fb1c007d770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:54:24.116 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:24.114+0000 7fb1de59c640 1 --2- 172.21.15.150:0/1390865499 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fb1c007b260 0x7fb1c007d770 secure :-1 s=READY pgs=844 cs=0 l=1 rev1=1 crypto rx=0x7fb1d0000f60 tx=0x7fb1d0009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:54:24.119 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:24.117+0000 7fb1d77fe640 1 -- 172.21.15.150:0/1390865499 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fb1c8020020 con 0x7fb1e00cf7c0 2024-09-17T05:54:24.295 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:24.294+0000 7fb1e485c640 1 -- 172.21.15.150:0/1390865499 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fb1e00cab40 con 0x7fb1e00cf7c0 2024-09-17T05:54:24.297 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:24.295+0000 7fb1d77fe640 1 -- 172.21.15.150:0/1390865499 <== mon.0 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v144) ==== 74+0+17249 (secure 0 0 0) 0x7fb1c8063870 con 0x7fb1e00cf7c0 2024-09-17T05:54:24.297 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-09-17T05:54:24.297 INFO:teuthology.orchestra.run.smithi150.stdout:{"epoch":144,"fsid":"9f2e05e9-d629-47b3-b26b-1360655b7d20","created":"2024-09-17T05:41:32.502979+0000","modified":"2024-09-17T05:54:20.244210+0000","last_up_change":"2024-09-17T05:41:46.150225+0000","last_in_change":"2024-09-17T05:41:36.120274+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":21,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T05:41:46.860779+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":20,"pool_name":"cephfs_metadata","create_time":"2024-09-17T05:53:11.522067+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"140","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":21,"pool_name":"cephfs_data","create_time":"2024-09-17T05:53:12.853902+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"144","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":3,"snap_epoch":144,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"4f31c018-c8a4-4d6d-b0c2-a597c47aae4a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":139,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6800","nonce":479374392},{"type":"v1","addr":"172.21.15.150:6801","nonce":479374392}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6802","nonce":479374392},{"type":"v1","addr":"172.21.15.150:6803","nonce":479374392}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6806","nonce":479374392},{"type":"v1","addr":"172.21.15.150:6807","nonce":479374392}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6804","nonce":479374392},{"type":"v1","addr":"172.21.15.150:6805","nonce":479374392}]},"public_addr":"172.21.15.150:6801/479374392","cluster_addr":"172.21.15.150:6803/479374392","heartbeat_back_addr":"172.21.15.150:6807/479374392","heartbeat_front_addr":"172.21.15.150:6805/479374392","state":["exists","up"]},{"osd":1,"uuid":"6ff4a573-500b-4e04-9de3-39265ead78b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":139,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6824","nonce":913899800},{"type":"v1","addr":"172.21.15.150:6825","nonce":913899800}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6826","nonce":913899800},{"type":"v1","addr":"172.21.15.150:6827","nonce":913899800}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6830","nonce":913899800},{"type":"v1","addr":"172.21.15.150:6831","nonce":913899800}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6828","nonce":913899800},{"type":"v1","addr":"172.21.15.150:6829","nonce":913899800}]},"public_addr":"172.21.15.150:6825/913899800","cluster_addr":"172.21.15.150:6827/913899800","heartbeat_back_addr":"172.21.15.150:6831/913899800","heartbeat_front_addr":"172.21.15.150:6829/913899800","state":["exists","up"]},{"osd":2,"uuid":"bffea6f9-2465-4182-b205-00436c41ac1c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":139,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6816","nonce":363718461},{"type":"v1","addr":"172.21.15.150:6817","nonce":363718461}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6818","nonce":363718461},{"type":"v1","addr":"172.21.15.150:6819","nonce":363718461}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6822","nonce":363718461},{"type":"v1","addr":"172.21.15.150:6823","nonce":363718461}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6820","nonce":363718461},{"type":"v1","addr":"172.21.15.150:6821","nonce":363718461}]},"public_addr":"172.21.15.150:6817/363718461","cluster_addr":"172.21.15.150:6819/363718461","heartbeat_back_addr":"172.21.15.150:6823/363718461","heartbeat_front_addr":"172.21.15.150:6821/363718461","state":["exists","up"]},{"osd":3,"uuid":"cda70430-d1e1-427e-b04e-56db4031d078","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":139,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6808","nonce":3550994626},{"type":"v1","addr":"172.21.15.150:6809","nonce":3550994626}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6810","nonce":3550994626},{"type":"v1","addr":"172.21.15.150:6811","nonce":3550994626}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6814","nonce":3550994626},{"type":"v1","addr":"172.21.15.150:6815","nonce":3550994626}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6812","nonce":3550994626},{"type":"v1","addr":"172.21.15.150:6813","nonce":3550994626}]},"public_addr":"172.21.15.150:6809/3550994626","cluster_addr":"172.21.15.150:6811/3550994626","heartbeat_back_addr":"172.21.15.150:6815/3550994626","heartbeat_front_addr":"172.21.15.150:6813/3550994626","state":["exists","up"]},{"osd":4,"uuid":"3a0277fb-5e1e-4f68-bb2d-9a8a0152f64a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":139,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6810","nonce":2718261497},{"type":"v1","addr":"172.21.15.176:6811","nonce":2718261497}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6812","nonce":2718261497},{"type":"v1","addr":"172.21.15.176:6813","nonce":2718261497}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6816","nonce":2718261497},{"type":"v1","addr":"172.21.15.176:6817","nonce":2718261497}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6814","nonce":2718261497},{"type":"v1","addr":"172.21.15.176:6815","nonce":2718261497}]},"public_addr":"172.21.15.176:6811/2718261497","cluster_addr":"172.21.15.176:6813/2718261497","heartbeat_back_addr":"172.21.15.176:6817/2718261497","heartbeat_front_addr":"172.21.15.176:6815/2718261497","state":["exists","up"]},{"osd":5,"uuid":"33aebee6-0315-40b7-a11c-6702f0be494d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":139,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6818","nonce":2049295774},{"type":"v1","addr":"172.21.15.176:6819","nonce":2049295774}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6820","nonce":2049295774},{"type":"v1","addr":"172.21.15.176:6821","nonce":2049295774}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6824","nonce":2049295774},{"type":"v1","addr":"172.21.15.176:6825","nonce":2049295774}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6822","nonce":2049295774},{"type":"v1","addr":"172.21.15.176:6823","nonce":2049295774}]},"public_addr":"172.21.15.176:6819/2049295774","cluster_addr":"172.21.15.176:6821/2049295774","heartbeat_back_addr":"172.21.15.176:6825/2049295774","heartbeat_front_addr":"172.21.15.176:6823/2049295774","state":["exists","up"]},{"osd":6,"uuid":"4d24f360-6751-4263-841b-d77793d33540","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":139,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6826","nonce":2164458476},{"type":"v1","addr":"172.21.15.176:6827","nonce":2164458476}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6828","nonce":2164458476},{"type":"v1","addr":"172.21.15.176:6829","nonce":2164458476}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6832","nonce":2164458476},{"type":"v1","addr":"172.21.15.176:6833","nonce":2164458476}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6830","nonce":2164458476},{"type":"v1","addr":"172.21.15.176:6831","nonce":2164458476}]},"public_addr":"172.21.15.176:6827/2164458476","cluster_addr":"172.21.15.176:6829/2164458476","heartbeat_back_addr":"172.21.15.176:6833/2164458476","heartbeat_front_addr":"172.21.15.176:6831/2164458476","state":["exists","up"]},{"osd":7,"uuid":"c8594fda-c74a-4ba9-8277-caf101d58ca1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":142,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6802","nonce":3239587708},{"type":"v1","addr":"172.21.15.176:6803","nonce":3239587708}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6804","nonce":3239587708},{"type":"v1","addr":"172.21.15.176:6805","nonce":3239587708}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6808","nonce":3239587708},{"type":"v1","addr":"172.21.15.176:6809","nonce":3239587708}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6806","nonce":3239587708},{"type":"v1","addr":"172.21.15.176:6807","nonce":3239587708}]},"public_addr":"172.21.15.176:6803/3239587708","cluster_addr":"172.21.15.176:6805/3239587708","heartbeat_back_addr":"172.21.15.176:6809/3239587708","heartbeat_front_addr":"172.21.15.176:6807/3239587708","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:41:41.905151+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:41:42.705679+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:41:42.459673+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:41:42.440819+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:41:42.668428+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:41:42.694972+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:41:43.078535+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:41:42.363539+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"21.36","mappings":[{"from":4,"to":3}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":7,"snaps":[{"begin":2,"length":2}]},{"pool":9,"snaps":[{"begin":2,"length":2}]},{"pool":11,"snaps":[{"begin":2,"length":2}]},{"pool":13,"snaps":[{"begin":2,"length":2}]},{"pool":15,"snaps":[{"begin":2,"length":2}]},{"pool":17,"snaps":[{"begin":2,"length":2}]},{"pool":19,"snaps":[{"begin":2,"length":2}]},{"pool":21,"snaps":[{"begin":2,"length":2}]}],"new_removed_snaps":[{"pool":21,"snaps":[{"begin":2,"length":2}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T05:54:24.299 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:24.297+0000 7fb1e485c640 1 -- 172.21.15.150:0/1390865499 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fb1c007b260 msgr2=0x7fb1c007d770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:54:24.299 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:24.297+0000 7fb1e485c640 1 --2- 172.21.15.150:0/1390865499 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fb1c007b260 0x7fb1c007d770 secure :-1 s=READY pgs=844 cs=0 l=1 rev1=1 crypto rx=0x7fb1d0000f60 tx=0x7fb1d0009040 comp rx=0 tx=0).stop 2024-09-17T05:54:24.299 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:24.297+0000 7fb1e485c640 1 -- 172.21.15.150:0/1390865499 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb1e00cf7c0 msgr2=0x7fb1e006cda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:54:24.299 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:24.297+0000 7fb1e485c640 1 --2- 172.21.15.150:0/1390865499 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb1e00cf7c0 0x7fb1e006cda0 secure :-1 s=READY pgs=1991 cs=0 l=1 rev1=1 crypto rx=0x7fb1c800c680 tx=0x7fb1c800cb40 comp rx=0 tx=0).stop 2024-09-17T05:54:24.299 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:24.297+0000 7fb1e485c640 1 -- 172.21.15.150:0/1390865499 shutdown_connections 2024-09-17T05:54:24.299 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:24.297+0000 7fb1e485c640 1 --2- 172.21.15.150:0/1390865499 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fb1c007b260 0x7fb1c007d770 unknown :-1 s=CLOSED pgs=844 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:54:24.300 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:24.297+0000 7fb1e485c640 1 --2- 172.21.15.150:0/1390865499 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb1e015ee30 0x7fb1e006d2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:54:24.300 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:24.297+0000 7fb1e485c640 1 --2- 172.21.15.150:0/1390865499 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb1e00cf7c0 0x7fb1e006cda0 unknown :-1 s=CLOSED pgs=1991 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:54:24.300 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:24.297+0000 7fb1e485c640 1 --2- 172.21.15.150:0/1390865499 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb1e00b6420 0x7fb1e014f760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:54:24.300 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:24.297+0000 7fb1e485c640 1 -- 172.21.15.150:0/1390865499 >> 172.21.15.150:0/1390865499 conn(0x7fb1e00b2fd0 msgr2=0x7fb1e015e0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:54:24.300 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:24.297+0000 7fb1e485c640 1 -- 172.21.15.150:0/1390865499 shutdown_connections 2024-09-17T05:54:24.300 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:24.297+0000 7fb1e485c640 1 -- 172.21.15.150:0/1390865499 wait complete. 2024-09-17T05:54:24.311 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-09-17T05:54:24.428 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:24.426+0000 7fcc6239d640 1 -- 172.21.15.150:0/2165197044 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fcc5c06f710 msgr2=0x7fcc5c0b94b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:54:24.428 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:24.426+0000 7fcc6239d640 1 --2- 172.21.15.150:0/2165197044 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fcc5c06f710 0x7fcc5c0b94b0 secure :-1 s=READY pgs=1992 cs=0 l=1 rev1=1 crypto rx=0x7fcc5c06fe40 tx=0x7fcc5802a4b0 comp rx=0 tx=0).stop 2024-09-17T05:54:24.428 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:24.426+0000 7fcc6239d640 1 -- 172.21.15.150:0/2165197044 shutdown_connections 2024-09-17T05:54:24.428 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:24.426+0000 7fcc6239d640 1 --2- 172.21.15.150:0/2165197044 >> v2:172.21.15.176:3300/0 conn(0x7fcc5c0d0cc0 0x7fcc5c0d10d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:54:24.428 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:24.426+0000 7fcc6239d640 1 --2- 172.21.15.150:0/2165197044 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fcc5c161fa0 0x7fcc5c0b39c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:54:24.428 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:24.426+0000 7fcc6239d640 1 --2- 172.21.15.150:0/2165197044 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fcc5c06f710 0x7fcc5c0b94b0 unknown :-1 s=CLOSED pgs=1992 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:54:24.428 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:24.426+0000 7fcc6239d640 1 -- 172.21.15.150:0/2165197044 >> 172.21.15.150:0/2165197044 conn(0x7fcc5c08dc30 msgr2=0x7fcc5c09d860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:54:24.428 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:24.426+0000 7fcc6239d640 1 -- 172.21.15.150:0/2165197044 shutdown_connections 2024-09-17T05:54:24.428 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:24.426+0000 7fcc6239d640 1 -- 172.21.15.150:0/2165197044 wait complete. 2024-09-17T05:54:24.429 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:24.428+0000 7fcc6239d640 1 Processor -- start 2024-09-17T05:54:24.429 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:24.428+0000 7fcc6239d640 1 -- start start 2024-09-17T05:54:24.432 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:24.429+0000 7fcc6239d640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fcc5c06f710 0x7fcc5c0cde40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:54:24.432 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:24.429+0000 7fcc6239d640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fcc5c0d0cc0 0x7fcc5c0b4c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:54:24.432 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:24.429+0000 7fcc6239d640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fcc5c161fa0 0x7fcc5c15e590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:54:24.432 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:24.429+0000 7fcc6239d640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7fcc5c0b64f0 con 0x7fcc5c0d0cc0 2024-09-17T05:54:24.432 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:24.429+0000 7fcc6239d640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fcc5c0b6370 con 0x7fcc5c06f710 2024-09-17T05:54:24.432 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:24.429+0000 7fcc6239d640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fcc5c0b6670 con 0x7fcc5c161fa0 2024-09-17T05:54:24.432 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:24.429+0000 7fcc60b9a640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fcc5c0d0cc0 0x7fcc5c0b4c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:54:24.432 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:24.429+0000 7fcc60b9a640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fcc5c0d0cc0 0x7fcc5c0b4c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:59110/0 (socket says 172.21.15.150:59110) 2024-09-17T05:54:24.433 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:24.429+0000 7fcc60b9a640 1 -- 172.21.15.150:0/3202543042 learned_addr learned my addr 172.21.15.150:0/3202543042 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:54:24.433 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:24.429+0000 7fcc6139b640 1 --2- 172.21.15.150:0/3202543042 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fcc5c06f710 0x7fcc5c0cde40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:54:24.433 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:24.429+0000 7fcc61b9c640 1 --2- 172.21.15.150:0/3202543042 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fcc5c161fa0 0x7fcc5c15e590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:54:24.433 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:24.429+0000 7fcc60b9a640 1 -- 172.21.15.150:0/3202543042 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fcc5c161fa0 msgr2=0x7fcc5c15e590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:54:24.433 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:24.429+0000 7fcc60b9a640 1 --2- 172.21.15.150:0/3202543042 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fcc5c161fa0 0x7fcc5c15e590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:54:24.433 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:24.429+0000 7fcc60b9a640 1 -- 172.21.15.150:0/3202543042 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fcc5c06f710 msgr2=0x7fcc5c0cde40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:54:24.433 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:24.429+0000 7fcc60b9a640 1 --2- 172.21.15.150:0/3202543042 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fcc5c06f710 0x7fcc5c0cde40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:54:24.433 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:24.429+0000 7fcc60b9a640 1 -- 172.21.15.150:0/3202543042 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcc5c0cc950 con 0x7fcc5c0d0cc0 2024-09-17T05:54:24.433 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:24.430+0000 7fcc60b9a640 1 --2- 172.21.15.150:0/3202543042 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fcc5c0d0cc0 0x7fcc5c0b4c30 secure :-1 s=READY pgs=1993 cs=0 l=1 rev1=1 crypto rx=0x7fcc4c00b410 tx=0x7fcc4c00b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:54:24.433 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:24.430+0000 7fcc51ffb640 1 -- 172.21.15.150:0/3202543042 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc4c015020 con 0x7fcc5c0d0cc0 2024-09-17T05:54:24.433 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:24.430+0000 7fcc51ffb640 1 -- 172.21.15.150:0/3202543042 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fcc4c011920 con 0x7fcc5c0d0cc0 2024-09-17T05:54:24.433 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:24.430+0000 7fcc6239d640 1 -- 172.21.15.150:0/3202543042 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcc5c0ccc30 con 0x7fcc5c0d0cc0 2024-09-17T05:54:24.433 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:24.430+0000 7fcc51ffb640 1 -- 172.21.15.150:0/3202543042 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc4c011d70 con 0x7fcc5c0d0cc0 2024-09-17T05:54:24.434 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:24.430+0000 7fcc6239d640 1 -- 172.21.15.150:0/3202543042 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcc5c0cd1f0 con 0x7fcc5c0d0cc0 2024-09-17T05:54:24.434 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:24.431+0000 7fcc6239d640 1 -- 172.21.15.150:0/3202543042 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcc5c0cd530 con 0x7fcc5c0d0cc0 2024-09-17T05:54:24.434 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:24.432+0000 7fcc51ffb640 1 -- 172.21.15.150:0/3202543042 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 51) ==== 104960+0+0 (secure 0 0 0) 0x7fcc4c018020 con 0x7fcc5c0d0cc0 2024-09-17T05:54:24.434 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:24.432+0000 7fcc51ffb640 1 --2- 172.21.15.150:0/3202543042 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fcc4007b290 0x7fcc4007d7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:54:24.434 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:24.432+0000 7fcc51ffb640 1 -- 172.21.15.150:0/3202543042 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(144..144 src has 1..144) ==== 5990+0+0 (secure 0 0 0) 0x7fcc4c099e00 con 0x7fcc5c0d0cc0 2024-09-17T05:54:24.435 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:24.433+0000 7fcc6139b640 1 --2- 172.21.15.150:0/3202543042 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fcc4007b290 0x7fcc4007d7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:54:24.435 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:24.433+0000 7fcc6139b640 1 --2- 172.21.15.150:0/3202543042 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fcc4007b290 0x7fcc4007d7a0 secure :-1 s=READY pgs=845 cs=0 l=1 rev1=1 crypto rx=0x7fcc58034000 tx=0x7fcc58004730 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:54:24.439 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:24.437+0000 7fcc51ffb640 1 -- 172.21.15.150:0/3202543042 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fcc4c01f020 con 0x7fcc5c0d0cc0 2024-09-17T05:54:24.651 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:24.650+0000 7fcc6239d640 1 -- 172.21.15.150:0/3202543042 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7fcc5c0d0aa0 con 0x7fcc5c0d0cc0 2024-09-17T05:54:24.652 INFO:tasks.ceph.mon.a.smithi150.stderr:2024-09-17T05:54:24.650+0000 7f73931ae640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-17T05:54:24.655 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:24.654+0000 7fcc51ffb640 1 -- 172.21.15.150:0/3202543042 <== mon.0 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v90) ==== 161+0+0 (secure 0 0 0) 0x7fcc4c0636f0 con 0x7fcc5c0d0cc0 2024-09-17T05:54:24.656 INFO:teuthology.orchestra.run.smithi150.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-09-17T05:54:24.658 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:24.656+0000 7fcc6239d640 1 -- 172.21.15.150:0/3202543042 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fcc4007b290 msgr2=0x7fcc4007d7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:54:24.659 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:24.656+0000 7fcc6239d640 1 --2- 172.21.15.150:0/3202543042 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fcc4007b290 0x7fcc4007d7a0 secure :-1 s=READY pgs=845 cs=0 l=1 rev1=1 crypto rx=0x7fcc58034000 tx=0x7fcc58004730 comp rx=0 tx=0).stop 2024-09-17T05:54:24.659 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:24.656+0000 7fcc6239d640 1 -- 172.21.15.150:0/3202543042 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fcc5c0d0cc0 msgr2=0x7fcc5c0b4c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:54:24.659 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:24.656+0000 7fcc6239d640 1 --2- 172.21.15.150:0/3202543042 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fcc5c0d0cc0 0x7fcc5c0b4c30 secure :-1 s=READY pgs=1993 cs=0 l=1 rev1=1 crypto rx=0x7fcc4c00b410 tx=0x7fcc4c00b8d0 comp rx=0 tx=0).stop 2024-09-17T05:54:24.659 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:24.656+0000 7fcc6239d640 1 -- 172.21.15.150:0/3202543042 shutdown_connections 2024-09-17T05:54:24.659 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:24.656+0000 7fcc6239d640 1 --2- 172.21.15.150:0/3202543042 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fcc4007b290 0x7fcc4007d7a0 unknown :-1 s=CLOSED pgs=845 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:54:24.659 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:24.656+0000 7fcc6239d640 1 --2- 172.21.15.150:0/3202543042 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fcc5c161fa0 0x7fcc5c15e590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:54:24.659 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:24.656+0000 7fcc6239d640 1 --2- 172.21.15.150:0/3202543042 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fcc5c0d0cc0 0x7fcc5c0b4c30 unknown :-1 s=CLOSED pgs=1993 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:54:24.659 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:24.656+0000 7fcc6239d640 1 --2- 172.21.15.150:0/3202543042 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fcc5c06f710 0x7fcc5c0cde40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:54:24.659 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:24.656+0000 7fcc6239d640 1 -- 172.21.15.150:0/3202543042 >> 172.21.15.150:0/3202543042 conn(0x7fcc5c08dc30 msgr2=0x7fcc5c0b2eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:54:24.660 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:24.657+0000 7fcc6239d640 1 -- 172.21.15.150:0/3202543042 shutdown_connections 2024-09-17T05:54:24.660 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:24.658+0000 7fcc6239d640 1 -- 172.21.15.150:0/3202543042 wait complete. 2024-09-17T05:54:24.673 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-09-17T05:54:24.723 INFO:tasks.ceph.mds.c.smithi150.stdout:starting mds.c at 2024-09-17T05:54:24.792 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:24.790+0000 7f4a8c40e640 1 -- 172.21.15.150:0/1424397326 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4a840cf390 msgr2=0x7f4a840cf7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:54:24.792 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:24.790+0000 7f4a8c40e640 1 --2- 172.21.15.150:0/1424397326 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4a840cf390 0x7f4a840cf7a0 secure :-1 s=READY pgs=1996 cs=0 l=1 rev1=1 crypto rx=0x7f4a840d2470 tx=0x7f4a7c02a9a0 comp rx=0 tx=0).stop 2024-09-17T05:54:24.792 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:24.790+0000 7f4a8c40e640 1 -- 172.21.15.150:0/1424397326 shutdown_connections 2024-09-17T05:54:24.792 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:24.790+0000 7f4a8c40e640 1 --2- 172.21.15.150:0/1424397326 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4a840cf390 0x7f4a840cf7a0 unknown :-1 s=CLOSED pgs=1996 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:54:24.793 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:24.790+0000 7f4a8c40e640 1 --2- 172.21.15.150:0/1424397326 >> v2:172.21.15.176:3300/0 conn(0x7f4a840b16f0 0x7f4a840b1ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:54:24.793 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:24.790+0000 7f4a8c40e640 1 -- 172.21.15.150:0/1424397326 >> 172.21.15.150:0/1424397326 conn(0x7f4a840b2ff0 msgr2=0x7f4a840b3400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:54:24.793 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:24.790+0000 7f4a8c40e640 1 -- 172.21.15.150:0/1424397326 shutdown_connections 2024-09-17T05:54:24.793 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:24.790+0000 7f4a8c40e640 1 -- 172.21.15.150:0/1424397326 wait complete. 2024-09-17T05:54:24.793 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:24.792+0000 7f4a8c40e640 1 Processor -- start 2024-09-17T05:54:24.793 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:24.792+0000 7f4a8c40e640 1 -- start start 2024-09-17T05:54:24.796 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:24.793+0000 7f4a8c40e640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4a840b16f0 0x7f4a840af9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:54:24.796 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:24.793+0000 7f4a8c40e640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4a840b25e0 0x7f4a8414dcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:54:24.796 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:24.793+0000 7f4a8c40e640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4a840cf390 0x7f4a8415c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:54:24.796 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:24.793+0000 7f4a8c40e640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f4a8406d130 con 0x7f4a840b25e0 2024-09-17T05:54:24.796 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:24.793+0000 7f4a8c40e640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f4a8406cfb0 con 0x7f4a840b16f0 2024-09-17T05:54:24.796 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:24.793+0000 7f4a8c40e640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f4a8406d2b0 con 0x7f4a840cf390 2024-09-17T05:54:24.797 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:24.793+0000 7f4a899a9640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4a840b25e0 0x7f4a8414dcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:54:24.797 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:24.793+0000 7f4a899a9640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4a840b25e0 0x7f4a8414dcc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:59146/0 (socket says 172.21.15.150:59146) 2024-09-17T05:54:24.797 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:24.793+0000 7f4a899a9640 1 -- 172.21.15.150:0/2484072772 learned_addr learned my addr 172.21.15.150:0/2484072772 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:54:24.797 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:24.793+0000 7f4a8a9ab640 1 --2- 172.21.15.150:0/2484072772 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4a840cf390 0x7f4a8415c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:54:24.797 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:24.793+0000 7f4a8a1aa640 1 --2- 172.21.15.150:0/2484072772 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4a840b16f0 0x7f4a840af9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:54:24.797 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:24.794+0000 7f4a899a9640 1 -- 172.21.15.150:0/2484072772 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4a840cf390 msgr2=0x7f4a8415c9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:54:24.797 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:24.794+0000 7f4a899a9640 1 --2- 172.21.15.150:0/2484072772 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4a840cf390 0x7f4a8415c9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:54:24.797 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:24.794+0000 7f4a899a9640 1 -- 172.21.15.150:0/2484072772 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4a840b16f0 msgr2=0x7f4a840af9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:54:24.797 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:24.794+0000 7f4a899a9640 1 --2- 172.21.15.150:0/2484072772 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4a840b16f0 0x7f4a840af9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:54:24.797 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:24.794+0000 7f4a899a9640 1 -- 172.21.15.150:0/2484072772 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4a8414e200 con 0x7f4a840b25e0 2024-09-17T05:54:24.797 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:24.794+0000 7f4a899a9640 1 --2- 172.21.15.150:0/2484072772 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4a840b25e0 0x7f4a8414dcc0 secure :-1 s=READY pgs=1997 cs=0 l=1 rev1=1 crypto rx=0x7f4a7400e790 tx=0x7f4a7400ec50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:54:24.797 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:24.794+0000 7f4a7affd640 1 -- 172.21.15.150:0/2484072772 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a7400eea0 con 0x7f4a840b25e0 2024-09-17T05:54:24.797 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:24.794+0000 7f4a7affd640 1 -- 172.21.15.150:0/2484072772 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f4a7400ccc0 con 0x7f4a840b25e0 2024-09-17T05:54:24.798 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:24.794+0000 7f4a7affd640 1 -- 172.21.15.150:0/2484072772 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a74005280 con 0x7f4a840b25e0 2024-09-17T05:54:24.798 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:24.794+0000 7f4a8c40e640 1 -- 172.21.15.150:0/2484072772 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4a841552a0 con 0x7f4a840b25e0 2024-09-17T05:54:24.798 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:24.794+0000 7f4a8c40e640 1 -- 172.21.15.150:0/2484072772 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4a84154ce0 con 0x7f4a840b25e0 2024-09-17T05:54:24.799 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:24.795+0000 7f4a8c40e640 1 -- 172.21.15.150:0/2484072772 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4a840b1ec0 con 0x7f4a840b25e0 2024-09-17T05:54:24.799 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:24.796+0000 7f4a7affd640 1 -- 172.21.15.150:0/2484072772 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 51) ==== 104960+0+0 (secure 0 0 0) 0x7f4a74005420 con 0x7f4a840b25e0 2024-09-17T05:54:24.799 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:24.796+0000 7f4a7affd640 1 --2- 172.21.15.150:0/2484072772 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f4a6807b290 0x7f4a6807d7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:54:24.799 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:24.796+0000 7f4a7affd640 1 -- 172.21.15.150:0/2484072772 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(145..145 src has 1..145) ==== 6048+0+0 (secure 0 0 0) 0x7f4a7409a790 con 0x7f4a840b25e0 2024-09-17T05:54:24.799 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:24.797+0000 7f4a8a1aa640 1 --2- 172.21.15.150:0/2484072772 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f4a6807b290 0x7f4a6807d7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:54:24.799 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:24.797+0000 7f4a8a1aa640 1 --2- 172.21.15.150:0/2484072772 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f4a6807b290 0x7f4a6807d7a0 secure :-1 s=READY pgs=846 cs=0 l=1 rev1=1 crypto rx=0x7f4a80001720 tx=0x7f4a80009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:54:24.802 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:24.801+0000 7f4a7affd640 1 -- 172.21.15.150:0/2484072772 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f4a74064080 con 0x7f4a840b25e0 2024-09-17T05:54:25.013 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:25.011+0000 7f4a8c40e640 1 -- 172.21.15.150:0/2484072772 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7f4a840b5e20 con 0x7f4a840b25e0 2024-09-17T05:54:25.663 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:25.661+0000 7f4a7affd640 1 -- 172.21.15.150:0/2484072772 <== mon.0 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v91) ==== 104+0+0 (secure 0 0 0) 0x7f4a74068ab0 con 0x7f4a840b25e0 2024-09-17T05:54:25.666 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:25.663+0000 7f4a8c40e640 1 -- 172.21.15.150:0/2484072772 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f4a6807b290 msgr2=0x7f4a6807d7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:54:25.666 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:25.663+0000 7f4a8c40e640 1 --2- 172.21.15.150:0/2484072772 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f4a6807b290 0x7f4a6807d7a0 secure :-1 s=READY pgs=846 cs=0 l=1 rev1=1 crypto rx=0x7f4a80001720 tx=0x7f4a80009040 comp rx=0 tx=0).stop 2024-09-17T05:54:25.666 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:25.663+0000 7f4a8c40e640 1 -- 172.21.15.150:0/2484072772 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4a840b25e0 msgr2=0x7f4a8414dcc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:54:25.666 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:25.663+0000 7f4a8c40e640 1 --2- 172.21.15.150:0/2484072772 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4a840b25e0 0x7f4a8414dcc0 secure :-1 s=READY pgs=1997 cs=0 l=1 rev1=1 crypto rx=0x7f4a7400e790 tx=0x7f4a7400ec50 comp rx=0 tx=0).stop 2024-09-17T05:54:25.666 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:25.663+0000 7f4a8c40e640 1 -- 172.21.15.150:0/2484072772 shutdown_connections 2024-09-17T05:54:25.666 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:25.663+0000 7f4a8c40e640 1 --2- 172.21.15.150:0/2484072772 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f4a6807b290 0x7f4a6807d7a0 unknown :-1 s=CLOSED pgs=846 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:54:25.666 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:25.663+0000 7f4a8c40e640 1 --2- 172.21.15.150:0/2484072772 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4a840cf390 0x7f4a8415c9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:54:25.667 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:25.663+0000 7f4a8c40e640 1 --2- 172.21.15.150:0/2484072772 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4a840b25e0 0x7f4a8414dcc0 unknown :-1 s=CLOSED pgs=1997 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:54:25.667 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:25.663+0000 7f4a8c40e640 1 --2- 172.21.15.150:0/2484072772 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4a840b16f0 0x7f4a840af9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:54:25.667 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:25.663+0000 7f4a8c40e640 1 -- 172.21.15.150:0/2484072772 >> 172.21.15.150:0/2484072772 conn(0x7f4a840b2ff0 msgr2=0x7f4a840b6340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:54:25.667 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:25.663+0000 7f4a8c40e640 1 -- 172.21.15.150:0/2484072772 shutdown_connections 2024-09-17T05:54:25.667 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:25.663+0000 7f4a8c40e640 1 -- 172.21.15.150:0/2484072772 wait complete. 2024-09-17T05:54:25.679 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-09-17T05:54:25.799 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:25.797+0000 7f461e1f1640 1 -- 172.21.15.150:0/746638827 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4600003c60 msgr2=0x7f46000040b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:54:25.799 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:25.797+0000 7f461e1f1640 1 --2- 172.21.15.150:0/746638827 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4600003c60 0x7f46000040b0 secure :-1 s=READY pgs=1999 cs=0 l=1 rev1=1 crypto rx=0x7f4608006f90 tx=0x7f4600005830 comp rx=0 tx=0).stop 2024-09-17T05:54:25.799 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:25.797+0000 7f4617fff640 1 -- 172.21.15.150:0/746638827 reap_dead start 2024-09-17T05:54:25.799 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:25.797+0000 7f461e1f1640 1 -- 172.21.15.150:0/746638827 shutdown_connections 2024-09-17T05:54:25.799 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:25.797+0000 7f461e1f1640 1 -- 172.21.15.150:0/746638827 >> 172.21.15.150:0/746638827 conn(0x7f461809aa50 msgr2=0x7f46180b2ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:54:25.799 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:25.797+0000 7f461e1f1640 1 -- 172.21.15.150:0/746638827 shutdown_connections 2024-09-17T05:54:25.799 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:25.797+0000 7f461e1f1640 1 -- 172.21.15.150:0/746638827 wait complete. 2024-09-17T05:54:25.800 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:25.799+0000 7f461e1f1640 1 Processor -- start 2024-09-17T05:54:25.800 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:25.799+0000 7f461e1f1640 1 -- start start 2024-09-17T05:54:25.803 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:25.800+0000 7f461e1f1640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4600003c60 0x7f461806cda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:54:25.803 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:25.800+0000 7f461e1f1640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4618155e10 0x7f461814ffa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:54:25.803 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:25.800+0000 7f461e1f1640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f46181f7380 0x7f4618156670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:54:25.803 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:25.800+0000 7f461e1f1640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f46180b5f30 con 0x7f46181f7380 2024-09-17T05:54:25.804 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:25.800+0000 7f461e1f1640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f461815c280 con 0x7f4600003c60 2024-09-17T05:54:25.804 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:25.800+0000 7f461e1f1640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f46180af3f0 con 0x7f4618155e10 2024-09-17T05:54:25.804 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:25.800+0000 7f4617fff640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f46181f7380 0x7f4618156670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:54:25.804 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:25.800+0000 7f4617fff640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f46181f7380 0x7f4618156670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:59160/0 (socket says 172.21.15.150:59160) 2024-09-17T05:54:25.804 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:25.800+0000 7f4617fff640 1 -- 172.21.15.150:0/1370542911 learned_addr learned my addr 172.21.15.150:0/1370542911 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:54:25.804 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:25.800+0000 7f46177fe640 1 --2- 172.21.15.150:0/1370542911 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4600003c60 0x7f461806cda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:54:25.804 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:25.800+0000 7f4616ffd640 1 --2- 172.21.15.150:0/1370542911 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4618155e10 0x7f461814ffa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:54:25.804 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:25.800+0000 7f4617fff640 1 -- 172.21.15.150:0/1370542911 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4618155e10 msgr2=0x7f461814ffa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:54:25.804 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:25.800+0000 7f4617fff640 1 --2- 172.21.15.150:0/1370542911 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4618155e10 0x7f461814ffa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:54:25.804 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:25.800+0000 7f4617fff640 1 -- 172.21.15.150:0/1370542911 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4600003c60 msgr2=0x7f461806cda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:54:25.804 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:25.800+0000 7f4617fff640 1 --2- 172.21.15.150:0/1370542911 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4600003c60 0x7f461806cda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:54:25.804 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:25.800+0000 7f4617fff640 1 -- 172.21.15.150:0/1370542911 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f461806d710 con 0x7f46181f7380 2024-09-17T05:54:25.804 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:25.800+0000 7f4616ffd640 1 --2- 172.21.15.150:0/1370542911 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4618155e10 0x7f461814ffa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:54:25.805 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:25.801+0000 7f4617fff640 1 --2- 172.21.15.150:0/1370542911 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f46181f7380 0x7f4618156670 secure :-1 s=READY pgs=2000 cs=0 l=1 rev1=1 crypto rx=0x7f46180b6390 tx=0x7f4610010f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:54:25.805 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:25.801+0000 7f45fffff640 1 -- 172.21.15.150:0/1370542911 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4610003970 con 0x7f46181f7380 2024-09-17T05:54:25.805 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:25.801+0000 7f45fffff640 1 -- 172.21.15.150:0/1370542911 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f4610015070 con 0x7f46181f7380 2024-09-17T05:54:25.805 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:25.801+0000 7f461e1f1640 1 -- 172.21.15.150:0/1370542911 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f46181f68a0 con 0x7f46181f7380 2024-09-17T05:54:25.805 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:25.801+0000 7f45fffff640 1 -- 172.21.15.150:0/1370542911 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4610004030 con 0x7f46181f7380 2024-09-17T05:54:25.805 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:25.801+0000 7f461e1f1640 1 -- 172.21.15.150:0/1370542911 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f46181f6e60 con 0x7f46181f7380 2024-09-17T05:54:25.805 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:25.802+0000 7f461e1f1640 1 -- 172.21.15.150:0/1370542911 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f461806d480 con 0x7f46181f7380 2024-09-17T05:54:25.806 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:25.803+0000 7f45fffff640 1 -- 172.21.15.150:0/1370542911 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 51) ==== 104960+0+0 (secure 0 0 0) 0x7f46100041d0 con 0x7f46181f7380 2024-09-17T05:54:25.806 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:25.803+0000 7f45fffff640 1 --2- 172.21.15.150:0/1370542911 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f460407b260 0x7f460407d770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:54:25.806 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:25.803+0000 7f45fffff640 1 -- 172.21.15.150:0/1370542911 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(145..145 src has 1..145) ==== 6048+0+0 (secure 0 0 0) 0x7f461009ab10 con 0x7f46181f7380 2024-09-17T05:54:25.806 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:25.803+0000 7f46177fe640 1 --2- 172.21.15.150:0/1370542911 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f460407b260 0x7f460407d770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:54:25.806 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:25.804+0000 7f46177fe640 1 --2- 172.21.15.150:0/1370542911 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f460407b260 0x7f460407d770 secure :-1 s=READY pgs=848 cs=0 l=1 rev1=1 crypto rx=0x7f4608033000 tx=0x7f46180aeed0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:54:25.809 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:25.807+0000 7f45fffff640 1 -- 172.21.15.150:0/1370542911 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f4610064380 con 0x7f46181f7380 2024-09-17T05:54:25.985 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:25.985+0000 7f461e1f1640 1 -- 172.21.15.150:0/1370542911 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7f461815ba80 con 0x7f46181f7380 2024-09-17T05:54:26.664 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:26.664+0000 7f45fffff640 1 -- 172.21.15.150:0/1370542911 <== mon.0 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v146) ==== 181+0+0 (secure 0 0 0) 0x7f4610068db0 con 0x7f46181f7380 2024-09-17T05:54:26.665 INFO:teuthology.orchestra.run.smithi150.stderr:pool 'cephfs_metadata' removed 2024-09-17T05:54:26.671 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:26.670+0000 7f461e1f1640 1 -- 172.21.15.150:0/1370542911 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f460407b260 msgr2=0x7f460407d770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:54:26.671 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:26.670+0000 7f461e1f1640 1 --2- 172.21.15.150:0/1370542911 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f460407b260 0x7f460407d770 secure :-1 s=READY pgs=848 cs=0 l=1 rev1=1 crypto rx=0x7f4608033000 tx=0x7f46180aeed0 comp rx=0 tx=0).stop 2024-09-17T05:54:26.671 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:26.670+0000 7f461e1f1640 1 -- 172.21.15.150:0/1370542911 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f46181f7380 msgr2=0x7f4618156670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:54:26.671 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:26.670+0000 7f461e1f1640 1 --2- 172.21.15.150:0/1370542911 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f46181f7380 0x7f4618156670 secure :-1 s=READY pgs=2000 cs=0 l=1 rev1=1 crypto rx=0x7f46180b6390 tx=0x7f4610010f40 comp rx=0 tx=0).stop 2024-09-17T05:54:26.671 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:26.670+0000 7f461e1f1640 1 -- 172.21.15.150:0/1370542911 shutdown_connections 2024-09-17T05:54:26.671 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:26.670+0000 7f461e1f1640 1 --2- 172.21.15.150:0/1370542911 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f460407b260 0x7f460407d770 secure :-1 s=CLOSED pgs=848 cs=0 l=1 rev1=1 crypto rx=0x7f4608033000 tx=0x7f46180aeed0 comp rx=0 tx=0).stop 2024-09-17T05:54:26.671 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:26.670+0000 7f461e1f1640 1 --2- 172.21.15.150:0/1370542911 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f46181f7380 0x7f4618156670 unknown :-1 s=CLOSED pgs=2000 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:54:26.671 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:26.670+0000 7f461e1f1640 1 --2- 172.21.15.150:0/1370542911 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4618155e10 0x7f461814ffa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:54:26.672 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:26.670+0000 7f461e1f1640 1 --2- 172.21.15.150:0/1370542911 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4600003c60 0x7f461806cda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:54:26.672 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:26.670+0000 7f461e1f1640 1 -- 172.21.15.150:0/1370542911 >> 172.21.15.150:0/1370542911 conn(0x7f461809aa50 msgr2=0x7f4618151f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:54:26.672 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:26.671+0000 7f461e1f1640 1 -- 172.21.15.150:0/1370542911 shutdown_connections 2024-09-17T05:54:26.672 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:26.671+0000 7f461e1f1640 1 -- 172.21.15.150:0/1370542911 wait complete. 2024-09-17T05:54:26.686 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-09-17T05:54:26.803 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:26.802+0000 7f713beb6640 1 -- 172.21.15.150:0/176323844 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f713406f3a0 msgr2=0x7f71340cf300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:54:26.803 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:26.802+0000 7f713beb6640 1 --2- 172.21.15.150:0/176323844 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f713406f3a0 0x7f71340cf300 secure :-1 s=READY pgs=2002 cs=0 l=1 rev1=1 crypto rx=0x7f7128009820 tx=0x7f712802a510 comp rx=0 tx=0).stop 2024-09-17T05:54:26.803 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:26.802+0000 7f713beb6640 1 -- 172.21.15.150:0/176323844 shutdown_connections 2024-09-17T05:54:26.804 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:26.802+0000 7f713beb6640 1 --2- 172.21.15.150:0/176323844 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f71340cf840 0x7f71340cfc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:54:26.804 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:26.802+0000 7f713beb6640 1 --2- 172.21.15.150:0/176323844 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f713406f3a0 0x7f71340cf300 unknown :-1 s=CLOSED pgs=2002 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:54:26.804 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:26.802+0000 7f713beb6640 1 -- 172.21.15.150:0/176323844 >> 172.21.15.150:0/176323844 conn(0x7f71340d46f0 msgr2=0x7f71340d4b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:54:26.804 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:26.802+0000 7f713beb6640 1 -- 172.21.15.150:0/176323844 shutdown_connections 2024-09-17T05:54:26.804 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:26.802+0000 7f713beb6640 1 -- 172.21.15.150:0/176323844 wait complete. 2024-09-17T05:54:26.805 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:26.804+0000 7f713beb6640 1 Processor -- start 2024-09-17T05:54:26.805 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:26.804+0000 7f713beb6640 1 -- start start 2024-09-17T05:54:26.811 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:26.805+0000 7f713beb6640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f713406f3a0 0x7f71341eb290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:54:26.811 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:26.805+0000 7f713beb6640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f71340cf840 0x7f71340b5b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:54:26.811 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:26.805+0000 7f713beb6640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f71340d0d20 0x7f71341e7db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:54:26.811 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:26.805+0000 7f713beb6640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f71340d19c0 con 0x7f713406f3a0 2024-09-17T05:54:26.811 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:26.805+0000 7f713beb6640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f71340d1840 con 0x7f71340d0d20 2024-09-17T05:54:26.811 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:26.805+0000 7f713beb6640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f71340d0190 con 0x7f71340cf840 2024-09-17T05:54:26.811 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:26.805+0000 7f7139c52640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f713406f3a0 0x7f71341eb290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:54:26.812 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:26.806+0000 7f7139c52640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f713406f3a0 0x7f71341eb290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:59172/0 (socket says 172.21.15.150:59172) 2024-09-17T05:54:26.812 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:26.806+0000 7f7139c52640 1 -- 172.21.15.150:0/2958829313 learned_addr learned my addr 172.21.15.150:0/2958829313 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:54:26.812 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:26.806+0000 7f7139451640 1 --2- 172.21.15.150:0/2958829313 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f71340cf840 0x7f71340b5b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:54:26.812 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:26.806+0000 7f713a453640 1 --2- 172.21.15.150:0/2958829313 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f71340d0d20 0x7f71341e7db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:54:26.812 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:26.806+0000 7f7139c52640 1 -- 172.21.15.150:0/2958829313 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f71340cf840 msgr2=0x7f71340b5b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:54:26.812 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:26.806+0000 7f7139c52640 1 --2- 172.21.15.150:0/2958829313 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f71340cf840 0x7f71340b5b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:54:26.812 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:26.806+0000 7f7139c52640 1 -- 172.21.15.150:0/2958829313 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f71340d0d20 msgr2=0x7f71341e7db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:54:26.812 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:26.806+0000 7f7139c52640 1 --2- 172.21.15.150:0/2958829313 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f71340d0d20 0x7f71341e7db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:54:26.812 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:26.806+0000 7f7139c52640 1 -- 172.21.15.150:0/2958829313 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f71341e9d20 con 0x7f713406f3a0 2024-09-17T05:54:26.812 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:26.806+0000 7f7139c52640 1 --2- 172.21.15.150:0/2958829313 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f713406f3a0 0x7f71341eb290 secure :-1 s=READY pgs=2003 cs=0 l=1 rev1=1 crypto rx=0x7f712400c3c0 tx=0x7f712400c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:54:26.812 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:26.806+0000 7f71327fc640 1 -- 172.21.15.150:0/2958829313 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7124017070 con 0x7f713406f3a0 2024-09-17T05:54:26.812 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:26.806+0000 7f71327fc640 1 -- 172.21.15.150:0/2958829313 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f71240035f0 con 0x7f713406f3a0 2024-09-17T05:54:26.812 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:26.806+0000 7f713beb6640 1 -- 172.21.15.150:0/2958829313 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f71341e9760 con 0x7f713406f3a0 2024-09-17T05:54:26.813 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:26.806+0000 7f71327fc640 1 -- 172.21.15.150:0/2958829313 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7124003a80 con 0x7f713406f3a0 2024-09-17T05:54:26.813 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:26.806+0000 7f713beb6640 1 -- 172.21.15.150:0/2958829313 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f71341e75b0 con 0x7f713406f3a0 2024-09-17T05:54:26.813 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:26.807+0000 7f713beb6640 1 -- 172.21.15.150:0/2958829313 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f71340d06b0 con 0x7f713406f3a0 2024-09-17T05:54:26.813 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:26.808+0000 7f71327fc640 1 -- 172.21.15.150:0/2958829313 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 51) ==== 104960+0+0 (secure 0 0 0) 0x7f712401a070 con 0x7f713406f3a0 2024-09-17T05:54:26.813 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:26.808+0000 7f71327fc640 1 --2- 172.21.15.150:0/2958829313 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f712007b260 0x7f712007d770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:54:26.813 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:26.809+0000 7f71327fc640 1 -- 172.21.15.150:0/2958829313 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(146..146 src has 1..146) ==== 5610+0+0 (secure 0 0 0) 0x7f7124099230 con 0x7f713406f3a0 2024-09-17T05:54:26.813 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:26.809+0000 7f7139451640 1 --2- 172.21.15.150:0/2958829313 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f712007b260 0x7f712007d770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:54:26.813 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:26.810+0000 7f7139451640 1 --2- 172.21.15.150:0/2958829313 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f712007b260 0x7f712007d770 secure :-1 s=READY pgs=849 cs=0 l=1 rev1=1 crypto rx=0x7f7128034000 tx=0x7f7128004730 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:54:26.813 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:26.813+0000 7f71327fc640 1 -- 172.21.15.150:0/2958829313 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f7124062b20 con 0x7f713406f3a0 2024-09-17T05:54:26.991 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:26.990+0000 7f713beb6640 1 -- 172.21.15.150:0/2958829313 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7f71340cff70 con 0x7f713406f3a0 2024-09-17T05:54:27.447 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-17T05:54:27.450 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-17T05:54:27.639 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:27.638+0000 7f71327fc640 1 -- 172.21.15.150:0/2958829313 <== mon.0 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v147) ==== 169+0+0 (secure 0 0 0) 0x7f7124067550 con 0x7f713406f3a0 2024-09-17T05:54:27.639 INFO:teuthology.orchestra.run.smithi150.stderr:pool 'cephfs_data' removed 2024-09-17T05:54:27.645 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:27.643+0000 7f713beb6640 1 -- 172.21.15.150:0/2958829313 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f712007b260 msgr2=0x7f712007d770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:54:27.645 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:27.643+0000 7f713beb6640 1 --2- 172.21.15.150:0/2958829313 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f712007b260 0x7f712007d770 secure :-1 s=READY pgs=849 cs=0 l=1 rev1=1 crypto rx=0x7f7128034000 tx=0x7f7128004730 comp rx=0 tx=0).stop 2024-09-17T05:54:27.645 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:27.643+0000 7f713beb6640 1 -- 172.21.15.150:0/2958829313 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f713406f3a0 msgr2=0x7f71341eb290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:54:27.645 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:27.643+0000 7f713beb6640 1 --2- 172.21.15.150:0/2958829313 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f713406f3a0 0x7f71341eb290 secure :-1 s=READY pgs=2003 cs=0 l=1 rev1=1 crypto rx=0x7f712400c3c0 tx=0x7f712400c880 comp rx=0 tx=0).stop 2024-09-17T05:54:27.645 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:27.643+0000 7f713beb6640 1 -- 172.21.15.150:0/2958829313 shutdown_connections 2024-09-17T05:54:27.645 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:27.643+0000 7f713beb6640 1 --2- 172.21.15.150:0/2958829313 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f71340d0d20 0x7f71341e7db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:54:27.645 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:27.643+0000 7f713beb6640 1 --2- 172.21.15.150:0/2958829313 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f712007b260 0x7f712007d770 unknown :-1 s=CLOSED pgs=849 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:54:27.645 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:27.643+0000 7f713beb6640 1 --2- 172.21.15.150:0/2958829313 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f71340cf840 0x7f71340b5b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:54:27.645 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:27.643+0000 7f713beb6640 1 --2- 172.21.15.150:0/2958829313 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f713406f3a0 0x7f71341eb290 unknown :-1 s=CLOSED pgs=2003 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:54:27.645 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:27.643+0000 7f713beb6640 1 -- 172.21.15.150:0/2958829313 >> 172.21.15.150:0/2958829313 conn(0x7f71340d46f0 msgr2=0x7f71340b2ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:54:27.646 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:27.643+0000 7f713beb6640 1 -- 172.21.15.150:0/2958829313 shutdown_connections 2024-09-17T05:54:27.646 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:27.643+0000 7f713beb6640 1 -- 172.21.15.150:0/2958829313 wait complete. 2024-09-17T05:54:27.661 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config reset 31 2024-09-17T05:54:27.778 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:27.777+0000 7fae2f9c3640 1 -- 172.21.15.150:0/1525369389 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fae14005210 msgr2=0x7fae1400b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:54:27.778 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:27.777+0000 7fae2f9c3640 1 --2- 172.21.15.150:0/1525369389 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fae14005210 0x7fae1400b9c0 secure :-1 s=READY pgs=2005 cs=0 l=1 rev1=1 crypto rx=0x7fae280b70a0 tx=0x7fae14005830 comp rx=0 tx=0).stop 2024-09-17T05:54:27.778 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:27.777+0000 7fae2df60640 1 -- 172.21.15.150:0/1525369389 reap_dead start 2024-09-17T05:54:27.778 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:27.777+0000 7fae2f9c3640 1 -- 172.21.15.150:0/1525369389 shutdown_connections 2024-09-17T05:54:27.778 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:27.777+0000 7fae2f9c3640 1 -- 172.21.15.150:0/1525369389 >> 172.21.15.150:0/1525369389 conn(0x7fae280b2ef0 msgr2=0x7fae280b3300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:54:27.778 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:27.777+0000 7fae2f9c3640 1 -- 172.21.15.150:0/1525369389 shutdown_connections 2024-09-17T05:54:27.779 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:27.777+0000 7fae2f9c3640 1 -- 172.21.15.150:0/1525369389 wait complete. 2024-09-17T05:54:27.779 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:27.779+0000 7fae2f9c3640 1 Processor -- start 2024-09-17T05:54:27.779 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:27.779+0000 7fae2f9c3640 1 -- start start 2024-09-17T05:54:27.782 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:27.780+0000 7fae2f9c3640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fae14005210 0x7fae281f5510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:54:27.782 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:27.780+0000 7fae2f9c3640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fae280b5700 0x7fae280b5b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:54:27.782 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:27.780+0000 7fae2f9c3640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fae281472b0 0x7fae281476c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:54:27.782 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:27.780+0000 7fae2f9c3640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7fae28167a10 con 0x7fae281472b0 2024-09-17T05:54:27.782 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:27.780+0000 7fae2f9c3640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fae28167890 con 0x7fae280b5700 2024-09-17T05:54:27.782 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:27.780+0000 7fae2f9c3640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fae28167b90 con 0x7fae14005210 2024-09-17T05:54:27.782 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:27.780+0000 7fae2df60640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fae281472b0 0x7fae281476c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:54:27.782 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:27.780+0000 7fae2df60640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fae281472b0 0x7fae281476c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:59184/0 (socket says 172.21.15.150:59184) 2024-09-17T05:54:27.782 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:27.780+0000 7fae2df60640 1 -- 172.21.15.150:0/2283443987 learned_addr learned my addr 172.21.15.150:0/2283443987 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:54:27.782 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:27.780+0000 7fae2d75f640 1 --2- 172.21.15.150:0/2283443987 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fae14005210 0x7fae281f5510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:54:27.783 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:27.780+0000 7fae2cf5e640 1 --2- 172.21.15.150:0/2283443987 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fae280b5700 0x7fae280b5b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:54:27.783 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:27.781+0000 7fae2df60640 1 -- 172.21.15.150:0/2283443987 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fae14005210 msgr2=0x7fae281f5510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:54:27.783 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:27.781+0000 7fae2df60640 1 --2- 172.21.15.150:0/2283443987 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fae14005210 0x7fae281f5510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:54:27.783 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:27.781+0000 7fae2df60640 1 -- 172.21.15.150:0/2283443987 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fae280b5700 msgr2=0x7fae280b5b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:54:27.783 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:27.781+0000 7fae2df60640 1 --2- 172.21.15.150:0/2283443987 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fae280b5700 0x7fae280b5b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:54:27.783 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:27.781+0000 7fae2df60640 1 -- 172.21.15.150:0/2283443987 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fae280b6050 con 0x7fae281472b0 2024-09-17T05:54:27.783 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:27.781+0000 7fae2df60640 1 --2- 172.21.15.150:0/2283443987 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fae281472b0 0x7fae281476c0 secure :-1 s=READY pgs=2006 cs=0 l=1 rev1=1 crypto rx=0x7fae28075060 tx=0x7fae20033c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:54:27.783 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:27.781+0000 7fae1dffb640 1 -- 172.21.15.150:0/2283443987 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae20009c30 con 0x7fae281472b0 2024-09-17T05:54:27.783 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:27.781+0000 7fae1dffb640 1 -- 172.21.15.150:0/2283443987 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fae20041070 con 0x7fae281472b0 2024-09-17T05:54:27.783 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:27.781+0000 7fae2f9c3640 1 -- 172.21.15.150:0/2283443987 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fae2814a120 con 0x7fae281472b0 2024-09-17T05:54:27.783 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:27.781+0000 7fae1dffb640 1 -- 172.21.15.150:0/2283443987 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae20004d60 con 0x7fae281472b0 2024-09-17T05:54:27.783 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:27.781+0000 7fae2f9c3640 1 -- 172.21.15.150:0/2283443987 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fae281f96a0 con 0x7fae281472b0 2024-09-17T05:54:27.784 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:27.782+0000 7fae2f9c3640 1 -- 172.21.15.150:0/2283443987 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fae280d22e0 con 0x7fae281472b0 2024-09-17T05:54:27.784 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:27.783+0000 7fae1dffb640 1 -- 172.21.15.150:0/2283443987 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 51) ==== 104960+0+0 (secure 0 0 0) 0x7fae20046460 con 0x7fae281472b0 2024-09-17T05:54:27.784 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:27.784+0000 7fae1dffb640 1 --2- 172.21.15.150:0/2283443987 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fae0c07b290 0x7fae0c07d7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:54:27.784 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:27.784+0000 7fae1dffb640 1 -- 172.21.15.150:0/2283443987 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(147..147 src has 1..147) ==== 5167+0+0 (secure 0 0 0) 0x7fae200bb250 con 0x7fae281472b0 2024-09-17T05:54:27.784 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:27.784+0000 7fae2d75f640 1 --2- 172.21.15.150:0/2283443987 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fae0c07b290 0x7fae0c07d7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:54:27.785 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:27.784+0000 7fae2d75f640 1 --2- 172.21.15.150:0/2283443987 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fae0c07b290 0x7fae0c07d7a0 secure :-1 s=READY pgs=850 cs=0 l=1 rev1=1 crypto rx=0x7fae24006510 tx=0x7fae24006c60 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:54:27.789 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:27.788+0000 7fae1dffb640 1 -- 172.21.15.150:0/2283443987 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fae280d22e0 con 0x7fae281472b0 2024-09-17T05:54:27.964 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:27.964+0000 7fae2f9c3640 1 -- 172.21.15.150:0/2283443987 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "config reset", "num": 31} v 0) -- 0x7fae28149eb0 con 0x7fae281472b0 2024-09-17T05:54:27.968 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:27.968+0000 7fae1dffb640 1 -- 172.21.15.150:0/2283443987 <== mon.0 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "config reset", "num": 31}]=0 v61) ==== 71+0+0 (secure 0 0 0) 0x7fae280b6050 con 0x7fae281472b0 2024-09-17T05:54:27.971 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:27.970+0000 7fae2f9c3640 1 -- 172.21.15.150:0/2283443987 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fae0c07b290 msgr2=0x7fae0c07d7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:54:27.971 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:27.970+0000 7fae2f9c3640 1 --2- 172.21.15.150:0/2283443987 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fae0c07b290 0x7fae0c07d7a0 secure :-1 s=READY pgs=850 cs=0 l=1 rev1=1 crypto rx=0x7fae24006510 tx=0x7fae24006c60 comp rx=0 tx=0).stop 2024-09-17T05:54:27.971 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:27.970+0000 7fae2f9c3640 1 -- 172.21.15.150:0/2283443987 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fae281472b0 msgr2=0x7fae281476c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:54:27.971 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:27.970+0000 7fae2f9c3640 1 --2- 172.21.15.150:0/2283443987 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fae281472b0 0x7fae281476c0 secure :-1 s=READY pgs=2006 cs=0 l=1 rev1=1 crypto rx=0x7fae28075060 tx=0x7fae20033c10 comp rx=0 tx=0).stop 2024-09-17T05:54:27.972 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:27.970+0000 7fae2f9c3640 1 -- 172.21.15.150:0/2283443987 shutdown_connections 2024-09-17T05:54:27.972 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:27.970+0000 7fae2f9c3640 1 --2- 172.21.15.150:0/2283443987 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fae280b5700 0x7fae280b5b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:54:27.972 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:27.970+0000 7fae2f9c3640 1 --2- 172.21.15.150:0/2283443987 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fae0c07b290 0x7fae0c07d7a0 unknown :-1 s=CLOSED pgs=850 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:54:27.972 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:27.970+0000 7fae2f9c3640 1 --2- 172.21.15.150:0/2283443987 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fae281472b0 0x7fae281476c0 unknown :-1 s=CLOSED pgs=2006 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:54:27.972 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:27.970+0000 7fae2f9c3640 1 --2- 172.21.15.150:0/2283443987 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fae14005210 0x7fae281f5510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:54:27.972 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:27.970+0000 7fae2f9c3640 1 -- 172.21.15.150:0/2283443987 >> 172.21.15.150:0/2283443987 conn(0x7fae280b2ef0 msgr2=0x7fae28071450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:54:27.972 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:27.970+0000 7fae2f9c3640 1 -- 172.21.15.150:0/2283443987 shutdown_connections 2024-09-17T05:54:27.972 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:27.970+0000 7fae2f9c3640 1 -- 172.21.15.150:0/2283443987 wait complete. 2024-09-17T05:54:27.982 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_volumes.TestCloneProgressReporter.test_when_clones_cancelled_are_more_than_cloner_threads' 2024-09-17T05:54:28.097 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:28.096+0000 7f8b7d9df640 1 -- 172.21.15.150:0/2431440607 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8b64004800 msgr2=0x7f8b64004c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:54:28.097 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:28.096+0000 7f8b7d9df640 1 --2- 172.21.15.150:0/2431440607 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8b64004800 0x7f8b64004c10 secure :-1 s=READY pgs=2008 cs=0 l=1 rev1=1 crypto rx=0x7f8b7808c7a0 tx=0x7f8b64005830 comp rx=0 tx=0).stop 2024-09-17T05:54:28.097 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:28.096+0000 7f8b777fe640 1 -- 172.21.15.150:0/2431440607 reap_dead start 2024-09-17T05:54:28.097 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:28.096+0000 7f8b7d9df640 1 -- 172.21.15.150:0/2431440607 shutdown_connections 2024-09-17T05:54:28.097 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:28.096+0000 7f8b7d9df640 1 -- 172.21.15.150:0/2431440607 >> 172.21.15.150:0/2431440607 conn(0x7f8b7808bfe0 msgr2=0x7f8b780d4650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:54:28.097 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:28.096+0000 7f8b7d9df640 1 -- 172.21.15.150:0/2431440607 shutdown_connections 2024-09-17T05:54:28.098 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:28.096+0000 7f8b7d9df640 1 -- 172.21.15.150:0/2431440607 wait complete. 2024-09-17T05:54:28.098 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:28.098+0000 7f8b7d9df640 1 Processor -- start 2024-09-17T05:54:28.098 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:28.098+0000 7f8b7d9df640 1 -- start start 2024-09-17T05:54:28.103 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:28.099+0000 7f8b7d9df640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8b64004800 0x7f8b780cac60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:54:28.103 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:28.099+0000 7f8b7d9df640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8b781516d0 0x7f8b78153910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:54:28.103 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:28.099+0000 7f8b7d9df640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8b78153e50 0x7f8b781f8d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:54:28.103 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:28.099+0000 7f8b7d9df640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f8b780b3f70 con 0x7f8b64004800 2024-09-17T05:54:28.104 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:28.099+0000 7f8b7d9df640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f8b780d0500 con 0x7f8b78153e50 2024-09-17T05:54:28.104 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:28.099+0000 7f8b7d9df640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f8b780b40f0 con 0x7f8b781516d0 2024-09-17T05:54:28.104 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:28.099+0000 7f8b76ffd640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8b64004800 0x7f8b780cac60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:54:28.104 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:28.099+0000 7f8b76ffd640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8b64004800 0x7f8b780cac60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:59204/0 (socket says 172.21.15.150:59204) 2024-09-17T05:54:28.104 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:28.099+0000 7f8b76ffd640 1 -- 172.21.15.150:0/1490931203 learned_addr learned my addr 172.21.15.150:0/1490931203 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:54:28.104 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:28.099+0000 7f8b6e7fc640 1 --2- 172.21.15.150:0/1490931203 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8b781516d0 0x7f8b78153910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:54:28.104 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:28.099+0000 7f8b777fe640 1 --2- 172.21.15.150:0/1490931203 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8b78153e50 0x7f8b781f8d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:54:28.105 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:28.100+0000 7f8b76ffd640 1 -- 172.21.15.150:0/1490931203 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8b781516d0 msgr2=0x7f8b78153910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:54:28.105 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:28.100+0000 7f8b76ffd640 1 --2- 172.21.15.150:0/1490931203 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8b781516d0 0x7f8b78153910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:54:28.105 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:28.100+0000 7f8b76ffd640 1 -- 172.21.15.150:0/1490931203 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8b78153e50 msgr2=0x7f8b781f8d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:54:28.105 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:28.100+0000 7f8b76ffd640 1 --2- 172.21.15.150:0/1490931203 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8b78153e50 0x7f8b781f8d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:54:28.105 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:28.100+0000 7f8b76ffd640 1 -- 172.21.15.150:0/1490931203 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8b780cc8f0 con 0x7f8b64004800 2024-09-17T05:54:28.105 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:28.100+0000 7f8b777fe640 1 --2- 172.21.15.150:0/1490931203 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8b78153e50 0x7f8b781f8d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:54:28.105 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:28.100+0000 7f8b76ffd640 1 --2- 172.21.15.150:0/1490931203 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8b64004800 0x7f8b780cac60 secure :-1 s=READY pgs=2009 cs=0 l=1 rev1=1 crypto rx=0x7f8b68011ae0 tx=0x7f8b68009f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:54:28.105 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:28.100+0000 7f8b74ff9640 1 -- 172.21.15.150:0/1490931203 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b6800fcb0 con 0x7f8b64004800 2024-09-17T05:54:28.106 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:28.100+0000 7f8b74ff9640 1 -- 172.21.15.150:0/1490931203 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8b6800fe50 con 0x7f8b64004800 2024-09-17T05:54:28.106 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:28.100+0000 7f8b7d9df640 1 -- 172.21.15.150:0/1490931203 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8b780ccbd0 con 0x7f8b64004800 2024-09-17T05:54:28.106 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:28.100+0000 7f8b74ff9640 1 -- 172.21.15.150:0/1490931203 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b68004280 con 0x7f8b64004800 2024-09-17T05:54:28.106 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:28.100+0000 7f8b7d9df640 1 -- 172.21.15.150:0/1490931203 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8b78151b10 con 0x7f8b64004800 2024-09-17T05:54:28.106 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:28.101+0000 7f8b7d9df640 1 -- 172.21.15.150:0/1490931203 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8b780d0680 con 0x7f8b64004800 2024-09-17T05:54:28.106 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:28.102+0000 7f8b74ff9640 1 -- 172.21.15.150:0/1490931203 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 51) ==== 104960+0+0 (secure 0 0 0) 0x7f8b680035f0 con 0x7f8b64004800 2024-09-17T05:54:28.106 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:28.102+0000 7f8b74ff9640 1 --2- 172.21.15.150:0/1490931203 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f8b5807b260 0x7f8b5807d770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:54:28.107 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:28.102+0000 7f8b74ff9640 1 -- 172.21.15.150:0/1490931203 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(147..147 src has 1..147) ==== 5167+0+0 (secure 0 0 0) 0x7f8b6809a9a0 con 0x7f8b64004800 2024-09-17T05:54:28.107 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:28.102+0000 7f8b6e7fc640 1 --2- 172.21.15.150:0/1490931203 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f8b5807b260 0x7f8b5807d770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:54:28.107 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:28.103+0000 7f8b6e7fc640 1 --2- 172.21.15.150:0/1490931203 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f8b5807b260 0x7f8b5807d770 secure :-1 s=READY pgs=851 cs=0 l=1 rev1=1 crypto rx=0x7f8b60035000 tx=0x7f8b6002d040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:54:28.107 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:28.107+0000 7f8b74ff9640 1 -- 172.21.15.150:0/1490931203 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f8b680a6080 con 0x7f8b64004800 2024-09-17T05:54:28.350 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:28.350+0000 7f8b7d9df640 1 -- 172.21.15.150:0/1490931203 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_volumes.TestCloneProgressReporter.test_when_clones_cancelled_are_more_than_cloner_threads"]} v 0) -- 0x7f8b780d1db0 con 0x7f8b64004800 2024-09-17T05:54:28.671 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:28.670+0000 7f8b74ff9640 1 -- 172.21.15.150:0/1490931203 <== mon.0 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_volumes.TestCloneProgressReporter.test_when_clones_cancelled_are_more_than_cloner_threads"]}]=0 v628) ==== 186+0+0 (secure 0 0 0) 0x7f8b68064320 con 0x7f8b64004800 2024-09-17T05:54:28.674 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:28.673+0000 7f8b7d9df640 1 -- 172.21.15.150:0/1490931203 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f8b5807b260 msgr2=0x7f8b5807d770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:54:28.674 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:28.673+0000 7f8b7d9df640 1 --2- 172.21.15.150:0/1490931203 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f8b5807b260 0x7f8b5807d770 secure :-1 s=READY pgs=851 cs=0 l=1 rev1=1 crypto rx=0x7f8b60035000 tx=0x7f8b6002d040 comp rx=0 tx=0).stop 2024-09-17T05:54:28.674 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:28.673+0000 7f8b7d9df640 1 -- 172.21.15.150:0/1490931203 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8b64004800 msgr2=0x7f8b780cac60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:54:28.674 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:28.673+0000 7f8b7d9df640 1 --2- 172.21.15.150:0/1490931203 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8b64004800 0x7f8b780cac60 secure :-1 s=READY pgs=2009 cs=0 l=1 rev1=1 crypto rx=0x7f8b68011ae0 tx=0x7f8b68009f10 comp rx=0 tx=0).stop 2024-09-17T05:54:28.674 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:28.673+0000 7f8b7d9df640 1 -- 172.21.15.150:0/1490931203 shutdown_connections 2024-09-17T05:54:28.675 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:28.673+0000 7f8b7d9df640 1 --2- 172.21.15.150:0/1490931203 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8b78153e50 0x7f8b781f8d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:54:28.675 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:28.673+0000 7f8b7d9df640 1 --2- 172.21.15.150:0/1490931203 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f8b5807b260 0x7f8b5807d770 unknown :-1 s=CLOSED pgs=851 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:54:28.675 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:28.673+0000 7f8b7d9df640 1 --2- 172.21.15.150:0/1490931203 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8b781516d0 0x7f8b78153910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:54:28.675 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:28.673+0000 7f8b7d9df640 1 --2- 172.21.15.150:0/1490931203 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8b64004800 0x7f8b780cac60 unknown :-1 s=CLOSED pgs=2009 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:54:28.675 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:28.673+0000 7f8b7d9df640 1 -- 172.21.15.150:0/1490931203 >> 172.21.15.150:0/1490931203 conn(0x7f8b7808bfe0 msgr2=0x7f8b780b11c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:54:28.675 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:28.673+0000 7f8b7d9df640 1 -- 172.21.15.150:0/1490931203 shutdown_connections 2024-09-17T05:54:28.675 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:28.673+0000 7f8b7d9df640 1 -- 172.21.15.150:0/1490931203 wait complete. 2024-09-17T05:54:28.686 INFO:tasks.cephfs_test_runner:Test that both the progress bars, that are printed for all 7 clone ... ok 2024-09-17T05:54:28.686 INFO:tasks.cephfs_test_runner: 2024-09-17T05:54:28.686 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2024-09-17T05:54:28.686 INFO:tasks.cephfs_test_runner:Ran 9 tests in 727.358s 2024-09-17T05:54:28.686 INFO:tasks.cephfs_test_runner: 2024-09-17T05:54:28.687 INFO:tasks.cephfs_test_runner:OK 2024-09-17T05:54:28.687 DEBUG:teuthology.run_tasks:Unwinding manager cephfs_test_runner 2024-09-17T05:54:28.696 DEBUG:teuthology.run_tasks:Unwinding manager kclient 2024-09-17T05:54:28.708 INFO:tasks.kclient:Unmounting kernel clients... 2024-09-17T05:54:28.709 DEBUG:teuthology.orchestra.run.smithi150:> set -ex 2024-09-17T05:54:28.709 DEBUG:teuthology.orchestra.run.smithi150:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T05:54:28.725 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056027,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497464k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=18693 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248728k,nr_inodes=812182,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497464k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-17T05:54:28.725 DEBUG:teuthology.orchestra.run.smithi150:> set -ex 2024-09-17T05:54:28.725 DEBUG:teuthology.orchestra.run.smithi150:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T05:54:28.781 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056027,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497464k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=18693 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248728k,nr_inodes=812182,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497464k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-17T05:54:28.782 DEBUG:teuthology.orchestra.run.smithi176:> set -ex 2024-09-17T05:54:28.782 DEBUG:teuthology.orchestra.run.smithi176:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T05:54:28.802 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056030,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497468k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=3379 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248732k,nr_inodes=812183,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497468k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-17T05:54:28.802 DEBUG:teuthology.orchestra.run.smithi176:> set -ex 2024-09-17T05:54:28.803 DEBUG:teuthology.orchestra.run.smithi176:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T05:54:28.862 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056030,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497468k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=3379 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248732k,nr_inodes=812183,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497468k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-17T05:54:28.862 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:54:28.862 DEBUG:teuthology.orchestra.run.smithi150:> ip netns list 2024-09-17T05:54:28.877 INFO:teuthology.orchestra.run.smithi150.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-09-17T05:54:28.878 INFO:teuthology.orchestra.run.smithi150.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-17T05:54:28.878 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:54:28.878 DEBUG:teuthology.orchestra.run.smithi150:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-17T05:54:28.943 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:54:28.943 DEBUG:teuthology.orchestra.run.smithi150:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-17T05:54:29.009 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:54:29.009 DEBUG:teuthology.orchestra.run.smithi150:> sudo ip link delete ceph-brx 2024-09-17T05:54:29.102 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:54:29.102 DEBUG:teuthology.orchestra.run.smithi150:> ip netns list 2024-09-17T05:54:29.117 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:54:29.117 DEBUG:teuthology.orchestra.run.smithi150:> sudo ip link delete ceph-brx 2024-09-17T05:54:29.186 INFO:teuthology.orchestra.run.smithi150.stderr:Cannot find device "ceph-brx" 2024-09-17T05:54:29.187 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-17T05:54:29.187 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:54:29.188 DEBUG:teuthology.orchestra.run.smithi176:> ip netns list 2024-09-17T05:54:29.207 INFO:teuthology.orchestra.run.smithi176.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2024-09-17T05:54:29.208 INFO:teuthology.orchestra.run.smithi176.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-09-17T05:54:29.208 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:54:29.208 DEBUG:teuthology.orchestra.run.smithi176:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.3 2024-09-17T05:54:29.278 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:54:29.279 DEBUG:teuthology.orchestra.run.smithi176:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-17T05:54:29.348 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:54:29.348 DEBUG:teuthology.orchestra.run.smithi176:> sudo ip link delete ceph-brx 2024-09-17T05:54:29.462 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:54:29.463 DEBUG:teuthology.orchestra.run.smithi176:> ip netns list 2024-09-17T05:54:29.478 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:54:29.479 DEBUG:teuthology.orchestra.run.smithi176:> sudo ip link delete ceph-brx 2024-09-17T05:54:29.547 INFO:teuthology.orchestra.run.smithi176.stderr:Cannot find device "ceph-brx" 2024-09-17T05:54:29.548 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-17T05:54:29.549 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2024-09-17T05:54:29.558 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-17T05:54:29.558 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-17T05:54:29.677 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:29.675+0000 7f2cae030640 1 -- 172.21.15.150:0/1860640925 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2ca8152920 msgr2=0x7f2ca815f3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:54:29.677 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:29.675+0000 7f2cae030640 1 --2- 172.21.15.150:0/1860640925 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2ca8152920 0x7f2ca815f3d0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f2c9c009be0 tx=0x7f2c9c02a890 comp rx=0 tx=0).stop 2024-09-17T05:54:29.677 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:29.675+0000 7f2cae030640 1 -- 172.21.15.150:0/1860640925 shutdown_connections 2024-09-17T05:54:29.677 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:29.675+0000 7f2cae030640 1 --2- 172.21.15.150:0/1860640925 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2ca8152920 0x7f2ca815f3d0 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:54:29.677 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:29.675+0000 7f2cae030640 1 -- 172.21.15.150:0/1860640925 >> 172.21.15.150:0/1860640925 conn(0x7f2ca806d730 msgr2=0x7f2ca80b1e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:54:29.677 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:29.675+0000 7f2cae030640 1 -- 172.21.15.150:0/1860640925 shutdown_connections 2024-09-17T05:54:29.677 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:29.675+0000 7f2cae030640 1 -- 172.21.15.150:0/1860640925 wait complete. 2024-09-17T05:54:29.679 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:29.678+0000 7f2cae030640 1 Processor -- start 2024-09-17T05:54:29.679 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:29.678+0000 7f2cae030640 1 -- start start 2024-09-17T05:54:29.681 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:29.679+0000 7f2cae030640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2ca80aebc0 0x7f2ca81f57b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:54:29.681 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:29.679+0000 7f2cae030640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2ca8152920 0x7f2ca815e100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:54:29.681 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:29.679+0000 7f2cae030640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2ca815f910 0x7f2ca815e640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:54:29.681 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:29.679+0000 7f2cae030640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f2ca80b4490 con 0x7f2ca80aebc0 2024-09-17T05:54:29.681 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:29.679+0000 7f2cae030640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f2ca80b4310 con 0x7f2ca8152920 2024-09-17T05:54:29.682 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:29.679+0000 7f2cae030640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f2ca80b4610 con 0x7f2ca815f910 2024-09-17T05:54:29.682 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:29.679+0000 7f2ca77fe640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2ca80aebc0 0x7f2ca81f57b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:54:29.682 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:29.679+0000 7f2ca77fe640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2ca80aebc0 0x7f2ca81f57b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:59216/0 (socket says 172.21.15.150:59216) 2024-09-17T05:54:29.682 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:29.679+0000 7f2ca77fe640 1 -- 172.21.15.150:0/2644990597 learned_addr learned my addr 172.21.15.150:0/2644990597 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:54:29.682 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:29.679+0000 7f2ca6ffd640 1 --2- 172.21.15.150:0/2644990597 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2ca8152920 0x7f2ca815e100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:54:29.682 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:29.679+0000 7f2ca7fff640 1 --2- 172.21.15.150:0/2644990597 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2ca815f910 0x7f2ca815e640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:54:29.682 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:29.680+0000 7f2ca77fe640 1 -- 172.21.15.150:0/2644990597 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2ca815f910 msgr2=0x7f2ca815e640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:54:29.682 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:29.680+0000 7f2ca77fe640 1 --2- 172.21.15.150:0/2644990597 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2ca815f910 0x7f2ca815e640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:54:29.682 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:29.680+0000 7f2ca77fe640 1 -- 172.21.15.150:0/2644990597 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2ca8152920 msgr2=0x7f2ca815e100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:54:29.683 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:29.680+0000 7f2ca77fe640 1 --2- 172.21.15.150:0/2644990597 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2ca8152920 0x7f2ca815e100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:54:29.683 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:29.680+0000 7f2ca77fe640 1 -- 172.21.15.150:0/2644990597 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2ca8154700 con 0x7f2ca80aebc0 2024-09-17T05:54:29.683 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:29.680+0000 7f2ca77fe640 1 --2- 172.21.15.150:0/2644990597 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2ca80aebc0 0x7f2ca81f57b0 secure :-1 s=READY pgs=2011 cs=0 l=1 rev1=1 crypto rx=0x7f2c9800c4d0 tx=0x7f2c9800c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:54:29.683 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:29.680+0000 7f2c8ffff640 1 -- 172.21.15.150:0/2644990597 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c980052d0 con 0x7f2ca80aebc0 2024-09-17T05:54:29.683 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:29.680+0000 7f2c8ffff640 1 -- 172.21.15.150:0/2644990597 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f2c98005470 con 0x7f2ca80aebc0 2024-09-17T05:54:29.683 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:29.680+0000 7f2c8ffff640 1 -- 172.21.15.150:0/2644990597 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c98012870 con 0x7f2ca80aebc0 2024-09-17T05:54:29.683 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:29.680+0000 7f2cae030640 1 -- 172.21.15.150:0/2644990597 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2ca81fa160 con 0x7f2ca80aebc0 2024-09-17T05:54:29.683 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:29.680+0000 7f2cae030640 1 -- 172.21.15.150:0/2644990597 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2ca81fa440 con 0x7f2ca80aebc0 2024-09-17T05:54:29.684 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:29.681+0000 7f2cae030640 1 -- 172.21.15.150:0/2644990597 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2ca814ca40 con 0x7f2ca80aebc0 2024-09-17T05:54:29.684 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:29.682+0000 7f2c8ffff640 1 -- 172.21.15.150:0/2644990597 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 51) ==== 104960+0+0 (secure 0 0 0) 0x7f2c980035f0 con 0x7f2ca80aebc0 2024-09-17T05:54:29.684 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:29.682+0000 7f2c8ffff640 1 --2- 172.21.15.150:0/2644990597 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f2c9407b260 0x7f2c9407d770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:54:29.684 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:29.682+0000 7f2c8ffff640 1 -- 172.21.15.150:0/2644990597 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(147..147 src has 1..147) ==== 5167+0+0 (secure 0 0 0) 0x7f2c980999b0 con 0x7f2ca80aebc0 2024-09-17T05:54:29.684 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:29.683+0000 7f2ca6ffd640 1 --2- 172.21.15.150:0/2644990597 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f2c9407b260 0x7f2c9407d770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:54:29.684 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:29.683+0000 7f2ca6ffd640 1 --2- 172.21.15.150:0/2644990597 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f2c9407b260 0x7f2c9407d770 secure :-1 s=READY pgs=852 cs=0 l=1 rev1=1 crypto rx=0x7f2c9c034000 tx=0x7f2c9c004ab0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:54:29.687 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:29.687+0000 7f2c8ffff640 1 -- 172.21.15.150:0/2644990597 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f2ca815fd20 con 0x7f2ca80aebc0 2024-09-17T05:54:29.858 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:29.858+0000 7f2cae030640 1 -- 172.21.15.150:0/2644990597 --> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f2ca815f3d0 con 0x7f2c9407b260 2024-09-17T05:54:29.859 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:29.858+0000 7f2c8ffff640 1 -- 172.21.15.150:0/2644990597 <== mgr.4108 v2:172.21.15.176:6800/3631216395 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+13538 (secure 0 0 0) 0x7f2ca815f3d0 con 0x7f2c9407b260 2024-09-17T05:54:29.859 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-09-17T05:54:29.859 INFO:teuthology.orchestra.run.smithi150.stderr:dumped all 2024-09-17T05:54:29.862 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:29.861+0000 7f2cae030640 1 -- 172.21.15.150:0/2644990597 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f2c9407b260 msgr2=0x7f2c9407d770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:54:29.862 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:29.861+0000 7f2cae030640 1 --2- 172.21.15.150:0/2644990597 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f2c9407b260 0x7f2c9407d770 secure :-1 s=READY pgs=852 cs=0 l=1 rev1=1 crypto rx=0x7f2c9c034000 tx=0x7f2c9c004ab0 comp rx=0 tx=0).stop 2024-09-17T05:54:29.862 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:29.861+0000 7f2cae030640 1 -- 172.21.15.150:0/2644990597 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2ca80aebc0 msgr2=0x7f2ca81f57b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:54:29.862 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:29.861+0000 7f2cae030640 1 --2- 172.21.15.150:0/2644990597 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2ca80aebc0 0x7f2ca81f57b0 secure :-1 s=READY pgs=2011 cs=0 l=1 rev1=1 crypto rx=0x7f2c9800c4d0 tx=0x7f2c9800c990 comp rx=0 tx=0).stop 2024-09-17T05:54:29.862 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:29.861+0000 7f2cae030640 1 -- 172.21.15.150:0/2644990597 shutdown_connections 2024-09-17T05:54:29.862 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:29.861+0000 7f2cae030640 1 --2- 172.21.15.150:0/2644990597 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2ca8152920 0x7f2ca815e100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:54:29.862 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:29.861+0000 7f2cae030640 1 --2- 172.21.15.150:0/2644990597 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f2c9407b260 0x7f2c9407d770 unknown :-1 s=CLOSED pgs=852 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:54:29.862 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:29.861+0000 7f2cae030640 1 --2- 172.21.15.150:0/2644990597 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2ca815f910 0x7f2ca815e640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:54:29.862 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:29.861+0000 7f2cae030640 1 --2- 172.21.15.150:0/2644990597 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2ca80aebc0 0x7f2ca81f57b0 unknown :-1 s=CLOSED pgs=2011 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:54:29.862 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:29.861+0000 7f2cae030640 1 -- 172.21.15.150:0/2644990597 >> 172.21.15.150:0/2644990597 conn(0x7f2ca806d730 msgr2=0x7f2ca814e8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:54:29.862 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:29.861+0000 7f2cae030640 1 -- 172.21.15.150:0/2644990597 shutdown_connections 2024-09-17T05:54:29.862 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:29.861+0000 7f2cae030640 1 -- 172.21.15.150:0/2644990597 wait complete. 2024-09-17T05:54:29.873 INFO:teuthology.orchestra.run.smithi150.stdout:{"pg_ready":true,"pg_map":{"version":523,"stamp":"2024-09-17T05:54:29.128541+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":7,"kb":754974720,"kb_used":1175476,"kb_used_data":17172,"kb_used_omap":12,"kb_used_meta":1158131,"kb_avail":753799244,"statfs":{"total":773094113280,"available":771890425856,"internally_reserved":0,"allocated":17584128,"data_stored":9464117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":1185926704},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-11787663379,"num_objects":-2842,"num_object_clones":-1,"num_object_copies":-5684,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-2842,"num_whiteouts":-1,"num_read":-3267,"num_read_kb":-13008987,"num_write":-5656,"num_write_kb":-16025479,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":-11,"num_bytes_recovered":-46137344,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001609"},"pg_stats":[{"pgid":"1.0","version":"19'72","reported_seq":337,"reported_epoch":145,"state":"active+clean","last_fresh":"2024-09-17T05:54:24.972512+0000","last_change":"2024-09-17T05:41:48.539830+0000","last_active":"2024-09-17T05:54:24.972512+0000","last_peered":"2024-09-17T05:54:24.972512+0000","last_clean":"2024-09-17T05:54:24.972512+0000","last_became_active":"2024-09-17T05:41:48.538743+0000","last_became_peered":"2024-09-17T05:41:48.538743+0000","last_unstale":"2024-09-17T05:54:24.972512+0000","last_undegraded":"2024-09-17T05:54:24.972512+0000","last_fullsized":"2024-09-17T05:54:24.972512+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:47.152539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:47.152539+0000","last_clean_scrub_stamp":"2024-09-17T05:41:47.152539+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:08:02.952016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":16,"seq":68719476893,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":137036,"kb_used_data":1784,"kb_used_omap":1,"kb_used_meta":135230,"kb_avail":94234804,"statfs":{"total":96636764160,"available":96496439296,"internally_reserved":0,"allocated":1826816,"data_stored":810821,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":138475974},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":15,"seq":64424509597,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":145924,"kb_used_data":2352,"kb_used_omap":1,"kb_used_meta":143550,"kb_avail":94225916,"statfs":{"total":96636764160,"available":96487337984,"internally_reserved":0,"allocated":2408448,"data_stored":1393708,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":146995658},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509596,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":141180,"kb_used_data":1768,"kb_used_omap":1,"kb_used_meta":139390,"kb_avail":94230660,"statfs":{"total":96636764160,"available":96492195840,"internally_reserved":0,"allocated":1810432,"data_stored":802710,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":142735813},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509596,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":167564,"kb_used_data":1780,"kb_used_omap":1,"kb_used_meta":165758,"kb_avail":94204276,"statfs":{"total":96636764160,"available":96465178624,"internally_reserved":0,"allocated":1822720,"data_stored":808944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":169736645},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509596,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":127304,"kb_used_data":1780,"kb_used_omap":1,"kb_used_meta":125502,"kb_avail":94244536,"statfs":{"total":96636764160,"available":96506404864,"internally_reserved":0,"allocated":1822720,"data_stored":808944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":128514503},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509596,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":167560,"kb_used_data":1780,"kb_used_omap":1,"kb_used_meta":165758,"kb_avail":94204280,"statfs":{"total":96636764160,"available":96465182720,"internally_reserved":0,"allocated":1822720,"data_stored":808944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":169736645},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509596,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":137048,"kb_used_data":1796,"kb_used_omap":1,"kb_used_meta":135230,"kb_avail":94234792,"statfs":{"total":96636764160,"available":96496427008,"internally_reserved":0,"allocated":1839104,"data_stored":814778,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":138475973},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834575003,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":151860,"kb_used_data":4132,"kb_used_omap":1,"kb_used_meta":147710,"kb_avail":94219980,"statfs":{"total":96636764160,"available":96481259520,"internally_reserved":0,"allocated":4231168,"data_stored":3215268,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":151255493},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-17T05:54:29.874 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-17T05:54:29.987 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:29.986+0000 7fe1a7189640 1 -- 172.21.15.150:0/3417689213 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe1a006d4b0 msgr2=0x7fe1a015c060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:54:29.988 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:29.986+0000 7fe1a7189640 1 --2- 172.21.15.150:0/3417689213 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe1a006d4b0 0x7fe1a015c060 secure :-1 s=READY pgs=2013 cs=0 l=1 rev1=1 crypto rx=0x7fe190009830 tx=0x7fe19002a5c0 comp rx=0 tx=0).stop 2024-09-17T05:54:29.988 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:29.986+0000 7fe1a7189640 1 -- 172.21.15.150:0/3417689213 shutdown_connections 2024-09-17T05:54:29.988 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:29.986+0000 7fe1a7189640 1 --2- 172.21.15.150:0/3417689213 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe1a006d4b0 0x7fe1a015c060 unknown :-1 s=CLOSED pgs=2013 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:54:29.988 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:29.986+0000 7fe1a7189640 1 -- 172.21.15.150:0/3417689213 >> 172.21.15.150:0/3417689213 conn(0x7fe1a00b2fd0 msgr2=0x7fe1a00b33e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:54:29.988 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:29.987+0000 7fe1a7189640 1 -- 172.21.15.150:0/3417689213 shutdown_connections 2024-09-17T05:54:29.988 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:29.987+0000 7fe1a7189640 1 -- 172.21.15.150:0/3417689213 wait complete. 2024-09-17T05:54:29.989 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:29.988+0000 7fe1a7189640 1 Processor -- start 2024-09-17T05:54:29.989 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:29.988+0000 7fe1a7189640 1 -- start start 2024-09-17T05:54:29.992 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:29.990+0000 7fe1a7189640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe1a00b2360 0x7fe1a00ae2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:54:29.992 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:29.990+0000 7fe1a7189640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe1a00cd8f0 0x7fe1a00b0a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:54:29.992 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:29.990+0000 7fe1a7189640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe1a00b0f40 0x7fe1a01f7440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:54:29.992 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:29.990+0000 7fe1a7189640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7fe1a0168140 con 0x7fe1a00b0f40 2024-09-17T05:54:29.992 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:29.990+0000 7fe1a7189640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fe1a0167fc0 con 0x7fe1a00cd8f0 2024-09-17T05:54:29.992 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:29.990+0000 7fe1a7189640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fe1a01682c0 con 0x7fe1a00b2360 2024-09-17T05:54:29.992 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:29.990+0000 7fe1a5726640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe1a00b0f40 0x7fe1a01f7440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:54:29.992 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:29.990+0000 7fe1a5726640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe1a00b0f40 0x7fe1a01f7440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:59232/0 (socket says 172.21.15.150:59232) 2024-09-17T05:54:29.993 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:29.990+0000 7fe1a5726640 1 -- 172.21.15.150:0/1373736698 learned_addr learned my addr 172.21.15.150:0/1373736698 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:54:29.993 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:29.990+0000 7fe1a4f25640 1 --2- 172.21.15.150:0/1373736698 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe1a00b2360 0x7fe1a00ae2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:54:29.993 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:29.990+0000 7fe197fff640 1 --2- 172.21.15.150:0/1373736698 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe1a00cd8f0 0x7fe1a00b0a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:54:29.993 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:29.990+0000 7fe1a5726640 1 -- 172.21.15.150:0/1373736698 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe1a00b2360 msgr2=0x7fe1a00ae2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:54:29.993 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:29.990+0000 7fe1a5726640 1 --2- 172.21.15.150:0/1373736698 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe1a00b2360 0x7fe1a00ae2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:54:29.993 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:29.990+0000 7fe1a5726640 1 -- 172.21.15.150:0/1373736698 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe1a00cd8f0 msgr2=0x7fe1a00b0a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:54:29.993 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:29.990+0000 7fe1a5726640 1 --2- 172.21.15.150:0/1373736698 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe1a00cd8f0 0x7fe1a00b0a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:54:29.993 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:29.990+0000 7fe1a5726640 1 -- 172.21.15.150:0/1373736698 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe1a015cab0 con 0x7fe1a00b0f40 2024-09-17T05:54:29.993 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:29.990+0000 7fe1a5726640 1 --2- 172.21.15.150:0/1373736698 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe1a00b0f40 0x7fe1a01f7440 secure :-1 s=READY pgs=2014 cs=0 l=1 rev1=1 crypto rx=0x7fe198002230 tx=0x7fe19800cb90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:54:29.993 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:29.990+0000 7fe1957fa640 1 -- 172.21.15.150:0/1373736698 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe198003b70 con 0x7fe1a00b0f40 2024-09-17T05:54:29.993 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:29.991+0000 7fe1957fa640 1 -- 172.21.15.150:0/1373736698 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe198003d10 con 0x7fe1a00b0f40 2024-09-17T05:54:29.993 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:29.991+0000 7fe1957fa640 1 -- 172.21.15.150:0/1373736698 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe198005330 con 0x7fe1a00b0f40 2024-09-17T05:54:29.994 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:29.991+0000 7fe1a7189640 1 -- 172.21.15.150:0/1373736698 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe1a015c210 con 0x7fe1a00b0f40 2024-09-17T05:54:29.994 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:29.991+0000 7fe1a7189640 1 -- 172.21.15.150:0/1373736698 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe1a015c7d0 con 0x7fe1a00b0f40 2024-09-17T05:54:29.994 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:29.992+0000 7fe1a7189640 1 -- 172.21.15.150:0/1373736698 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe1a015bf80 con 0x7fe1a00b0f40 2024-09-17T05:54:29.994 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:29.992+0000 7fe1957fa640 1 -- 172.21.15.150:0/1373736698 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 51) ==== 104960+0+0 (secure 0 0 0) 0x7fe1980056e0 con 0x7fe1a00b0f40 2024-09-17T05:54:29.995 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:29.993+0000 7fe1957fa640 1 --2- 172.21.15.150:0/1373736698 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fe18c07b260 0x7fe18c07d770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:54:29.995 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:29.993+0000 7fe1957fa640 1 -- 172.21.15.150:0/1373736698 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(147..147 src has 1..147) ==== 5167+0+0 (secure 0 0 0) 0x7fe198099e50 con 0x7fe1a00b0f40 2024-09-17T05:54:29.995 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:29.993+0000 7fe1a4f25640 1 --2- 172.21.15.150:0/1373736698 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fe18c07b260 0x7fe18c07d770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:54:29.995 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:29.993+0000 7fe1a4f25640 1 --2- 172.21.15.150:0/1373736698 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fe18c07b260 0x7fe18c07d770 secure :-1 s=READY pgs=853 cs=0 l=1 rev1=1 crypto rx=0x7fe19c000f60 tx=0x7fe19c009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:54:29.998 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:29.997+0000 7fe1957fa640 1 -- 172.21.15.150:0/1373736698 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fe198063740 con 0x7fe1a00b0f40 2024-09-17T05:54:30.170 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:30.169+0000 7fe1a7189640 1 -- 172.21.15.150:0/1373736698 --> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fe1a006cda0 con 0x7fe18c07b260 2024-09-17T05:54:30.171 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:30.170+0000 7fe1957fa640 1 -- 172.21.15.150:0/1373736698 <== mgr.4108 v2:172.21.15.176:6800/3631216395 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+13538 (secure 0 0 0) 0x7fe1a006cda0 con 0x7fe18c07b260 2024-09-17T05:54:30.171 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-09-17T05:54:30.171 INFO:teuthology.orchestra.run.smithi150.stderr:dumped all 2024-09-17T05:54:30.173 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:30.172+0000 7fe1a7189640 1 -- 172.21.15.150:0/1373736698 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fe18c07b260 msgr2=0x7fe18c07d770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:54:30.173 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:30.172+0000 7fe1a7189640 1 --2- 172.21.15.150:0/1373736698 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fe18c07b260 0x7fe18c07d770 secure :-1 s=READY pgs=853 cs=0 l=1 rev1=1 crypto rx=0x7fe19c000f60 tx=0x7fe19c009040 comp rx=0 tx=0).stop 2024-09-17T05:54:30.173 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:30.172+0000 7fe1a7189640 1 -- 172.21.15.150:0/1373736698 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe1a00b0f40 msgr2=0x7fe1a01f7440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:54:30.173 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:30.172+0000 7fe1a7189640 1 --2- 172.21.15.150:0/1373736698 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe1a00b0f40 0x7fe1a01f7440 secure :-1 s=READY pgs=2014 cs=0 l=1 rev1=1 crypto rx=0x7fe198002230 tx=0x7fe19800cb90 comp rx=0 tx=0).stop 2024-09-17T05:54:30.174 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:30.172+0000 7fe1a7189640 1 -- 172.21.15.150:0/1373736698 shutdown_connections 2024-09-17T05:54:30.174 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:30.172+0000 7fe1a7189640 1 --2- 172.21.15.150:0/1373736698 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe1a00cd8f0 0x7fe1a00b0a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:54:30.174 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:30.172+0000 7fe1a7189640 1 --2- 172.21.15.150:0/1373736698 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fe18c07b260 0x7fe18c07d770 unknown :-1 s=CLOSED pgs=853 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:54:30.174 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:30.172+0000 7fe1a7189640 1 --2- 172.21.15.150:0/1373736698 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe1a00b0f40 0x7fe1a01f7440 unknown :-1 s=CLOSED pgs=2014 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:54:30.174 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:30.172+0000 7fe1a7189640 1 --2- 172.21.15.150:0/1373736698 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe1a00b2360 0x7fe1a00ae2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:54:30.174 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:30.172+0000 7fe1a7189640 1 -- 172.21.15.150:0/1373736698 >> 172.21.15.150:0/1373736698 conn(0x7fe1a00b2fd0 msgr2=0x7fe1a0070b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:54:30.174 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:30.173+0000 7fe1a7189640 1 -- 172.21.15.150:0/1373736698 shutdown_connections 2024-09-17T05:54:30.174 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:30.173+0000 7fe1a7189640 1 -- 172.21.15.150:0/1373736698 wait complete. 2024-09-17T05:54:30.185 INFO:teuthology.orchestra.run.smithi150.stdout:{"pg_ready":true,"pg_map":{"version":523,"stamp":"2024-09-17T05:54:29.128541+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":7,"kb":754974720,"kb_used":1175476,"kb_used_data":17172,"kb_used_omap":12,"kb_used_meta":1158131,"kb_avail":753799244,"statfs":{"total":773094113280,"available":771890425856,"internally_reserved":0,"allocated":17584128,"data_stored":9464117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":1185926704},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-11787663379,"num_objects":-2842,"num_object_clones":-1,"num_object_copies":-5684,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-2842,"num_whiteouts":-1,"num_read":-3267,"num_read_kb":-13008987,"num_write":-5656,"num_write_kb":-16025479,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":-11,"num_bytes_recovered":-46137344,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001609"},"pg_stats":[{"pgid":"1.0","version":"19'72","reported_seq":337,"reported_epoch":145,"state":"active+clean","last_fresh":"2024-09-17T05:54:24.972512+0000","last_change":"2024-09-17T05:41:48.539830+0000","last_active":"2024-09-17T05:54:24.972512+0000","last_peered":"2024-09-17T05:54:24.972512+0000","last_clean":"2024-09-17T05:54:24.972512+0000","last_became_active":"2024-09-17T05:41:48.538743+0000","last_became_peered":"2024-09-17T05:41:48.538743+0000","last_unstale":"2024-09-17T05:54:24.972512+0000","last_undegraded":"2024-09-17T05:54:24.972512+0000","last_fullsized":"2024-09-17T05:54:24.972512+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:47.152539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:47.152539+0000","last_clean_scrub_stamp":"2024-09-17T05:41:47.152539+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:08:02.952016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":16,"seq":68719476893,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":137036,"kb_used_data":1784,"kb_used_omap":1,"kb_used_meta":135230,"kb_avail":94234804,"statfs":{"total":96636764160,"available":96496439296,"internally_reserved":0,"allocated":1826816,"data_stored":810821,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":138475974},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":15,"seq":64424509597,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":145924,"kb_used_data":2352,"kb_used_omap":1,"kb_used_meta":143550,"kb_avail":94225916,"statfs":{"total":96636764160,"available":96487337984,"internally_reserved":0,"allocated":2408448,"data_stored":1393708,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":146995658},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509596,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":141180,"kb_used_data":1768,"kb_used_omap":1,"kb_used_meta":139390,"kb_avail":94230660,"statfs":{"total":96636764160,"available":96492195840,"internally_reserved":0,"allocated":1810432,"data_stored":802710,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":142735813},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509596,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":167564,"kb_used_data":1780,"kb_used_omap":1,"kb_used_meta":165758,"kb_avail":94204276,"statfs":{"total":96636764160,"available":96465178624,"internally_reserved":0,"allocated":1822720,"data_stored":808944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":169736645},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509596,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":127304,"kb_used_data":1780,"kb_used_omap":1,"kb_used_meta":125502,"kb_avail":94244536,"statfs":{"total":96636764160,"available":96506404864,"internally_reserved":0,"allocated":1822720,"data_stored":808944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":128514503},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509596,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":167560,"kb_used_data":1780,"kb_used_omap":1,"kb_used_meta":165758,"kb_avail":94204280,"statfs":{"total":96636764160,"available":96465182720,"internally_reserved":0,"allocated":1822720,"data_stored":808944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":169736645},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509596,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":137048,"kb_used_data":1796,"kb_used_omap":1,"kb_used_meta":135230,"kb_avail":94234792,"statfs":{"total":96636764160,"available":96496427008,"internally_reserved":0,"allocated":1839104,"data_stored":814778,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":138475973},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834575003,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":151860,"kb_used_data":4132,"kb_used_omap":1,"kb_used_meta":147710,"kb_avail":94219980,"statfs":{"total":96636764160,"available":96481259520,"internally_reserved":0,"allocated":4231168,"data_stored":3215268,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":151255493},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-17T05:54:30.186 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-17T05:54:30.186 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-17T05:54:30.300 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:30.298+0000 7fe92bdda640 1 -- 172.21.15.150:0/2139752277 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe9241626d0 msgr2=0x7fe924164af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:54:30.300 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:30.298+0000 7fe92bdda640 1 --2- 172.21.15.150:0/2139752277 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe9241626d0 0x7fe924164af0 secure :-1 s=READY pgs=2015 cs=0 l=1 rev1=1 crypto rx=0x7fe91c005fd0 tx=0x7fe91c02aa10 comp rx=0 tx=0).stop 2024-09-17T05:54:30.300 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:30.298+0000 7fe92bdda640 1 -- 172.21.15.150:0/2139752277 shutdown_connections 2024-09-17T05:54:30.300 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:30.298+0000 7fe92bdda640 1 --2- 172.21.15.150:0/2139752277 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe9241626d0 0x7fe924164af0 unknown :-1 s=CLOSED pgs=2015 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:54:30.300 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:30.299+0000 7fe92bdda640 1 --2- 172.21.15.150:0/2139752277 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe9240704b0 0x7fe924073040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:54:30.300 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:30.299+0000 7fe92bdda640 1 -- 172.21.15.150:0/2139752277 >> 172.21.15.150:0/2139752277 conn(0x7fe92406d730 msgr2=0x7fe9240b1e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:54:30.300 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:30.299+0000 7fe92bdda640 1 -- 172.21.15.150:0/2139752277 shutdown_connections 2024-09-17T05:54:30.300 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:30.299+0000 7fe92bdda640 1 -- 172.21.15.150:0/2139752277 wait complete. 2024-09-17T05:54:30.301 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:30.300+0000 7fe92bdda640 1 Processor -- start 2024-09-17T05:54:30.301 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:30.300+0000 7fe92bdda640 1 -- start start 2024-09-17T05:54:30.304 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:30.302+0000 7fe92bdda640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe9240704b0 0x7fe924098c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:54:30.304 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:30.302+0000 7fe92bdda640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe9240ad3c0 0x7fe9241f5100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:54:30.304 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:30.302+0000 7fe92bdda640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe9241626d0 0x7fe9241f5640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:54:30.304 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:30.302+0000 7fe92bdda640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7fe9240ae060 con 0x7fe9241626d0 2024-09-17T05:54:30.304 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:30.302+0000 7fe92bdda640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fe9240adee0 con 0x7fe9240ad3c0 2024-09-17T05:54:30.304 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:30.302+0000 7fe92bdda640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fe924071130 con 0x7fe9240704b0 2024-09-17T05:54:30.304 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:30.302+0000 7fe92a377640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe9241626d0 0x7fe9241f5640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:54:30.304 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:30.302+0000 7fe92a377640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe9241626d0 0x7fe9241f5640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:38842/0 (socket says 172.21.15.150:38842) 2024-09-17T05:54:30.304 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:30.302+0000 7fe92a377640 1 -- 172.21.15.150:0/3509671219 learned_addr learned my addr 172.21.15.150:0/3509671219 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:54:30.304 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:30.302+0000 7fe929b76640 1 --2- 172.21.15.150:0/3509671219 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe9240704b0 0x7fe924098c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:54:30.304 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:30.302+0000 7fe929375640 1 --2- 172.21.15.150:0/3509671219 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe9240ad3c0 0x7fe9241f5100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:54:30.304 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:30.302+0000 7fe92a377640 1 -- 172.21.15.150:0/3509671219 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe9240704b0 msgr2=0x7fe924098c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:54:30.305 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:30.302+0000 7fe92a377640 1 --2- 172.21.15.150:0/3509671219 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe9240704b0 0x7fe924098c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:54:30.305 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:30.302+0000 7fe92a377640 1 -- 172.21.15.150:0/3509671219 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe9240ad3c0 msgr2=0x7fe9241f5100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:54:30.305 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:30.302+0000 7fe92a377640 1 --2- 172.21.15.150:0/3509671219 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe9240ad3c0 0x7fe9241f5100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:54:30.305 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:30.302+0000 7fe92a377640 1 -- 172.21.15.150:0/3509671219 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe9241647e0 con 0x7fe9241626d0 2024-09-17T05:54:30.305 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:30.302+0000 7fe92a377640 1 --2- 172.21.15.150:0/3509671219 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe9241626d0 0x7fe9241f5640 secure :-1 s=READY pgs=2016 cs=0 l=1 rev1=1 crypto rx=0x7fe91c006010 tx=0x7fe91c003f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:54:30.305 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:30.302+0000 7fe91a7fc640 1 -- 172.21.15.150:0/3509671219 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe91c033050 con 0x7fe9241626d0 2024-09-17T05:54:30.305 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:30.302+0000 7fe91a7fc640 1 -- 172.21.15.150:0/3509671219 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe91c004250 con 0x7fe9241626d0 2024-09-17T05:54:30.305 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:30.302+0000 7fe92bdda640 1 -- 172.21.15.150:0/3509671219 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe924164ac0 con 0x7fe9241626d0 2024-09-17T05:54:30.305 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:30.303+0000 7fe91a7fc640 1 -- 172.21.15.150:0/3509671219 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe91c004680 con 0x7fe9241626d0 2024-09-17T05:54:30.305 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:30.303+0000 7fe92bdda640 1 -- 172.21.15.150:0/3509671219 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe924099160 con 0x7fe9241626d0 2024-09-17T05:54:30.306 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:30.304+0000 7fe92bdda640 1 -- 172.21.15.150:0/3509671219 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe9241f5f80 con 0x7fe9241626d0 2024-09-17T05:54:30.306 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:30.304+0000 7fe91a7fc640 1 -- 172.21.15.150:0/3509671219 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 51) ==== 104960+0+0 (secure 0 0 0) 0x7fe91c036070 con 0x7fe9241626d0 2024-09-17T05:54:30.306 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:30.305+0000 7fe91a7fc640 1 --2- 172.21.15.150:0/3509671219 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fe90807b260 0x7fe90807d770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:54:30.306 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:30.305+0000 7fe91a7fc640 1 -- 172.21.15.150:0/3509671219 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(147..147 src has 1..147) ==== 5167+0+0 (secure 0 0 0) 0x7fe91c0baf80 con 0x7fe9241626d0 2024-09-17T05:54:30.306 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:30.305+0000 7fe929b76640 1 --2- 172.21.15.150:0/3509671219 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fe90807b260 0x7fe90807d770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:54:30.307 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:30.306+0000 7fe929b76640 1 --2- 172.21.15.150:0/3509671219 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fe90807b260 0x7fe90807d770 secure :-1 s=READY pgs=854 cs=0 l=1 rev1=1 crypto rx=0x7fe92000aba0 tx=0x7fe920010040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:54:30.310 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:30.309+0000 7fe91a7fc640 1 -- 172.21.15.150:0/3509671219 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fe91c004820 con 0x7fe9241626d0 2024-09-17T05:54:30.479 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:30.478+0000 7fe92bdda640 1 -- 172.21.15.150:0/3509671219 --> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fe924071950 con 0x7fe90807b260 2024-09-17T05:54:30.480 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:30.479+0000 7fe91a7fc640 1 -- 172.21.15.150:0/3509671219 <== mgr.4108 v2:172.21.15.176:6800/3631216395 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+13538 (secure 0 0 0) 0x7fe920021500 con 0x7fe90807b260 2024-09-17T05:54:30.480 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-09-17T05:54:30.481 INFO:teuthology.orchestra.run.smithi150.stderr:dumped all 2024-09-17T05:54:30.482 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:30.481+0000 7fe92bdda640 1 -- 172.21.15.150:0/3509671219 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fe90807b260 msgr2=0x7fe90807d770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:54:30.482 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:30.481+0000 7fe92bdda640 1 --2- 172.21.15.150:0/3509671219 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fe90807b260 0x7fe90807d770 secure :-1 s=READY pgs=854 cs=0 l=1 rev1=1 crypto rx=0x7fe92000aba0 tx=0x7fe920010040 comp rx=0 tx=0).stop 2024-09-17T05:54:30.483 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:30.481+0000 7fe92bdda640 1 -- 172.21.15.150:0/3509671219 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe9241626d0 msgr2=0x7fe9241f5640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:54:30.483 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:30.481+0000 7fe92bdda640 1 --2- 172.21.15.150:0/3509671219 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe9241626d0 0x7fe9241f5640 secure :-1 s=READY pgs=2016 cs=0 l=1 rev1=1 crypto rx=0x7fe91c006010 tx=0x7fe91c003f10 comp rx=0 tx=0).stop 2024-09-17T05:54:30.483 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:30.482+0000 7fe92bdda640 1 -- 172.21.15.150:0/3509671219 shutdown_connections 2024-09-17T05:54:30.483 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:30.482+0000 7fe92bdda640 1 --2- 172.21.15.150:0/3509671219 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe9240ad3c0 0x7fe9241f5100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:54:30.483 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:30.482+0000 7fe92bdda640 1 --2- 172.21.15.150:0/3509671219 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fe90807b260 0x7fe90807d770 unknown :-1 s=CLOSED pgs=854 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:54:30.483 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:30.482+0000 7fe92bdda640 1 --2- 172.21.15.150:0/3509671219 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe9241626d0 0x7fe9241f5640 unknown :-1 s=CLOSED pgs=2016 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:54:30.483 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:30.482+0000 7fe92bdda640 1 --2- 172.21.15.150:0/3509671219 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe9240704b0 0x7fe924098c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:54:30.483 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:30.482+0000 7fe92bdda640 1 -- 172.21.15.150:0/3509671219 >> 172.21.15.150:0/3509671219 conn(0x7fe92406d730 msgr2=0x7fe9241567f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:54:30.483 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:30.482+0000 7fe92bdda640 1 -- 172.21.15.150:0/3509671219 shutdown_connections 2024-09-17T05:54:30.483 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:30.482+0000 7fe92bdda640 1 -- 172.21.15.150:0/3509671219 wait complete. 2024-09-17T05:54:30.494 INFO:teuthology.orchestra.run.smithi150.stdout:{"pg_ready":true,"pg_map":{"version":523,"stamp":"2024-09-17T05:54:29.128541+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":7,"kb":754974720,"kb_used":1175476,"kb_used_data":17172,"kb_used_omap":12,"kb_used_meta":1158131,"kb_avail":753799244,"statfs":{"total":773094113280,"available":771890425856,"internally_reserved":0,"allocated":17584128,"data_stored":9464117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":1185926704},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-11787663379,"num_objects":-2842,"num_object_clones":-1,"num_object_copies":-5684,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-2842,"num_whiteouts":-1,"num_read":-3267,"num_read_kb":-13008987,"num_write":-5656,"num_write_kb":-16025479,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":-11,"num_bytes_recovered":-46137344,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001609"},"pg_stats":[{"pgid":"1.0","version":"19'72","reported_seq":337,"reported_epoch":145,"state":"active+clean","last_fresh":"2024-09-17T05:54:24.972512+0000","last_change":"2024-09-17T05:41:48.539830+0000","last_active":"2024-09-17T05:54:24.972512+0000","last_peered":"2024-09-17T05:54:24.972512+0000","last_clean":"2024-09-17T05:54:24.972512+0000","last_became_active":"2024-09-17T05:41:48.538743+0000","last_became_peered":"2024-09-17T05:41:48.538743+0000","last_unstale":"2024-09-17T05:54:24.972512+0000","last_undegraded":"2024-09-17T05:54:24.972512+0000","last_fullsized":"2024-09-17T05:54:24.972512+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:47.152539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:47.152539+0000","last_clean_scrub_stamp":"2024-09-17T05:41:47.152539+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:08:02.952016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":16,"seq":68719476893,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":137036,"kb_used_data":1784,"kb_used_omap":1,"kb_used_meta":135230,"kb_avail":94234804,"statfs":{"total":96636764160,"available":96496439296,"internally_reserved":0,"allocated":1826816,"data_stored":810821,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":138475974},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":15,"seq":64424509597,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":145924,"kb_used_data":2352,"kb_used_omap":1,"kb_used_meta":143550,"kb_avail":94225916,"statfs":{"total":96636764160,"available":96487337984,"internally_reserved":0,"allocated":2408448,"data_stored":1393708,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":146995658},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509596,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":141180,"kb_used_data":1768,"kb_used_omap":1,"kb_used_meta":139390,"kb_avail":94230660,"statfs":{"total":96636764160,"available":96492195840,"internally_reserved":0,"allocated":1810432,"data_stored":802710,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":142735813},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509596,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":167564,"kb_used_data":1780,"kb_used_omap":1,"kb_used_meta":165758,"kb_avail":94204276,"statfs":{"total":96636764160,"available":96465178624,"internally_reserved":0,"allocated":1822720,"data_stored":808944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":169736645},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509596,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":127304,"kb_used_data":1780,"kb_used_omap":1,"kb_used_meta":125502,"kb_avail":94244536,"statfs":{"total":96636764160,"available":96506404864,"internally_reserved":0,"allocated":1822720,"data_stored":808944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":128514503},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509596,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":167560,"kb_used_data":1780,"kb_used_omap":1,"kb_used_meta":165758,"kb_avail":94204280,"statfs":{"total":96636764160,"available":96465182720,"internally_reserved":0,"allocated":1822720,"data_stored":808944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":169736645},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509596,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":137048,"kb_used_data":1796,"kb_used_omap":1,"kb_used_meta":135230,"kb_avail":94234792,"statfs":{"total":96636764160,"available":96496427008,"internally_reserved":0,"allocated":1839104,"data_stored":814778,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":138475973},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834575003,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":151860,"kb_used_data":4132,"kb_used_omap":1,"kb_used_meta":147710,"kb_avail":94219980,"statfs":{"total":96636764160,"available":96481259520,"internally_reserved":0,"allocated":4231168,"data_stored":3215268,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":151255493},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-17T05:54:30.494 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T05:54:30.608 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:30.607+0000 7f74bcc4d640 1 -- 172.21.15.150:0/3012453257 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f74b80cd8f0 msgr2=0x7f74b815c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:54:30.608 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:30.607+0000 7f74bcc4d640 1 --2- 172.21.15.150:0/3012453257 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f74b80cd8f0 0x7f74b815c5a0 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7f74b0005fd0 tx=0x7f74b002a8b0 comp rx=0 tx=0).stop 2024-09-17T05:54:30.608 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:30.607+0000 7f74bcc4d640 1 -- 172.21.15.150:0/3012453257 shutdown_connections 2024-09-17T05:54:30.608 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:30.607+0000 7f74bcc4d640 1 --2- 172.21.15.150:0/3012453257 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f74b80cd8f0 0x7f74b815c5a0 unknown :-1 s=CLOSED pgs=673 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:54:30.608 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:30.607+0000 7f74bcc4d640 1 --2- 172.21.15.150:0/3012453257 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f74b806d4b0 0x7f74b815c060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:54:30.608 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:30.607+0000 7f74bcc4d640 1 -- 172.21.15.150:0/3012453257 >> 172.21.15.150:0/3012453257 conn(0x7f74b80b2fd0 msgr2=0x7f74b80b33e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:54:30.608 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:30.607+0000 7f74bcc4d640 1 -- 172.21.15.150:0/3012453257 shutdown_connections 2024-09-17T05:54:30.609 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:30.607+0000 7f74bcc4d640 1 -- 172.21.15.150:0/3012453257 wait complete. 2024-09-17T05:54:30.610 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:30.609+0000 7f74bcc4d640 1 Processor -- start 2024-09-17T05:54:30.610 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:30.609+0000 7f74bcc4d640 1 -- start start 2024-09-17T05:54:30.613 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:30.610+0000 7f74bcc4d640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f74b80b2360 0x7f74b8155610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:54:30.613 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:30.610+0000 7f74bcc4d640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f74b80cd8f0 0x7f74b81f4940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:54:30.613 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:30.610+0000 7f74bcc4d640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f74b81f4e80 0x7f74b81f6e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:54:30.614 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:30.610+0000 7f74bcc4d640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f74b80b5000 con 0x7f74b81f4e80 2024-09-17T05:54:30.614 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:30.610+0000 7f74bcc4d640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f74b80b4e80 con 0x7f74b80cd8f0 2024-09-17T05:54:30.614 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:30.610+0000 7f74bcc4d640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f74b80b5180 con 0x7f74b80b2360 2024-09-17T05:54:30.614 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:30.611+0000 7f74b6d9d640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f74b81f4e80 0x7f74b81f6e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:54:30.614 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:30.611+0000 7f74add9b640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f74b80cd8f0 0x7f74b81f4940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:54:30.614 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:30.611+0000 7f74b6d9d640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f74b81f4e80 0x7f74b81f6e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:38854/0 (socket says 172.21.15.150:38854) 2024-09-17T05:54:30.614 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:30.611+0000 7f74b659c640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f74b80b2360 0x7f74b8155610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:54:30.614 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:30.611+0000 7f74b6d9d640 1 -- 172.21.15.150:0/3220467298 learned_addr learned my addr 172.21.15.150:0/3220467298 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:54:30.614 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:30.611+0000 7f74add9b640 1 -- 172.21.15.150:0/3220467298 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f74b80b2360 msgr2=0x7f74b8155610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:54:30.614 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:30.611+0000 7f74add9b640 1 --2- 172.21.15.150:0/3220467298 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f74b80b2360 0x7f74b8155610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:54:30.614 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:30.611+0000 7f74add9b640 1 -- 172.21.15.150:0/3220467298 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f74b81f4e80 msgr2=0x7f74b81f6e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:54:30.615 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:30.611+0000 7f74add9b640 1 --2- 172.21.15.150:0/3220467298 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f74b81f4e80 0x7f74b81f6e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:54:30.615 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:30.611+0000 7f74add9b640 1 -- 172.21.15.150:0/3220467298 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f74b8154570 con 0x7f74b80cd8f0 2024-09-17T05:54:30.615 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:30.611+0000 7f74b6d9d640 1 --2- 172.21.15.150:0/3220467298 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f74b81f4e80 0x7f74b81f6e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T05:54:30.615 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:30.611+0000 7f74add9b640 1 --2- 172.21.15.150:0/3220467298 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f74b80cd8f0 0x7f74b81f4940 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7f74a000e700 tx=0x7f74a000ebc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:54:30.615 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:30.611+0000 7f74af7fe640 1 -- 172.21.15.150:0/3220467298 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74a000cab0 con 0x7f74b80cd8f0 2024-09-17T05:54:30.615 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:30.611+0000 7f74af7fe640 1 -- 172.21.15.150:0/3220467298 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f74a000cd40 con 0x7f74b80cd8f0 2024-09-17T05:54:30.615 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:30.611+0000 7f74bcc4d640 1 -- 172.21.15.150:0/3220467298 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f74b8154850 con 0x7f74b80cd8f0 2024-09-17T05:54:30.616 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:30.611+0000 7f74af7fe640 1 -- 172.21.15.150:0/3220467298 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74a0010690 con 0x7f74b80cd8f0 2024-09-17T05:54:30.616 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:30.611+0000 7f74bcc4d640 1 -- 172.21.15.150:0/3220467298 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f74b8154e10 con 0x7f74b80cd8f0 2024-09-17T05:54:30.616 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:30.612+0000 7f74bcc4d640 1 -- 172.21.15.150:0/3220467298 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f74b80b5710 con 0x7f74b80cd8f0 2024-09-17T05:54:30.617 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:30.613+0000 7f74af7fe640 1 -- 172.21.15.150:0/3220467298 <== mon.1 v2:172.21.15.176:3300/0 4 ==== mgrmap(e 51) ==== 104960+0+0 (secure 0 0 0) 0x7f74a0010830 con 0x7f74b80cd8f0 2024-09-17T05:54:30.617 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:30.614+0000 7f74af7fe640 1 --2- 172.21.15.150:0/3220467298 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f749807b260 0x7f749807d770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:54:30.617 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:30.614+0000 7f74af7fe640 1 -- 172.21.15.150:0/3220467298 <== mon.1 v2:172.21.15.176:3300/0 5 ==== osd_map(147..147 src has 1..147) ==== 5167+0+0 (secure 0 0 0) 0x7f74a009b120 con 0x7f74b80cd8f0 2024-09-17T05:54:30.617 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:30.614+0000 7f74b659c640 1 --2- 172.21.15.150:0/3220467298 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f749807b260 0x7f749807d770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:54:30.617 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:30.615+0000 7f74b659c640 1 --2- 172.21.15.150:0/3220467298 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f749807b260 0x7f749807d770 secure :-1 s=READY pgs=855 cs=0 l=1 rev1=1 crypto rx=0x7f74a8001720 tx=0x7f74a8007e90 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:54:30.619 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:30.618+0000 7f74af7fe640 1 -- 172.21.15.150:0/3220467298 <== mon.1 v2:172.21.15.176:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f74a0064a10 con 0x7f74b80cd8f0 2024-09-17T05:54:30.795 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:30.795+0000 7f74bcc4d640 1 -- 172.21.15.150:0/3220467298 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f74b8070320 con 0x7f74b80cd8f0 2024-09-17T05:54:30.796 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:30.796+0000 7f74af7fe640 1 -- 172.21.15.150:0/3220467298 <== mon.1 v2:172.21.15.176:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v147) ==== 74+0+13434 (secure 0 0 0) 0x7f74a0069440 con 0x7f74b80cd8f0 2024-09-17T05:54:30.797 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-09-17T05:54:30.797 INFO:teuthology.orchestra.run.smithi150.stdout:{"epoch":147,"fsid":"9f2e05e9-d629-47b3-b26b-1360655b7d20","created":"2024-09-17T05:41:32.502979+0000","modified":"2024-09-17T05:54:27.637514+0000","last_up_change":"2024-09-17T05:41:46.150225+0000","last_in_change":"2024-09-17T05:41:36.120274+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":21,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T05:41:46.860779+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"4f31c018-c8a4-4d6d-b0c2-a597c47aae4a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":139,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6800","nonce":479374392},{"type":"v1","addr":"172.21.15.150:6801","nonce":479374392}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6802","nonce":479374392},{"type":"v1","addr":"172.21.15.150:6803","nonce":479374392}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6806","nonce":479374392},{"type":"v1","addr":"172.21.15.150:6807","nonce":479374392}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6804","nonce":479374392},{"type":"v1","addr":"172.21.15.150:6805","nonce":479374392}]},"public_addr":"172.21.15.150:6801/479374392","cluster_addr":"172.21.15.150:6803/479374392","heartbeat_back_addr":"172.21.15.150:6807/479374392","heartbeat_front_addr":"172.21.15.150:6805/479374392","state":["exists","up"]},{"osd":1,"uuid":"6ff4a573-500b-4e04-9de3-39265ead78b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":139,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6824","nonce":913899800},{"type":"v1","addr":"172.21.15.150:6825","nonce":913899800}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6826","nonce":913899800},{"type":"v1","addr":"172.21.15.150:6827","nonce":913899800}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6830","nonce":913899800},{"type":"v1","addr":"172.21.15.150:6831","nonce":913899800}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6828","nonce":913899800},{"type":"v1","addr":"172.21.15.150:6829","nonce":913899800}]},"public_addr":"172.21.15.150:6825/913899800","cluster_addr":"172.21.15.150:6827/913899800","heartbeat_back_addr":"172.21.15.150:6831/913899800","heartbeat_front_addr":"172.21.15.150:6829/913899800","state":["exists","up"]},{"osd":2,"uuid":"bffea6f9-2465-4182-b205-00436c41ac1c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":139,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6816","nonce":363718461},{"type":"v1","addr":"172.21.15.150:6817","nonce":363718461}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6818","nonce":363718461},{"type":"v1","addr":"172.21.15.150:6819","nonce":363718461}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6822","nonce":363718461},{"type":"v1","addr":"172.21.15.150:6823","nonce":363718461}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6820","nonce":363718461},{"type":"v1","addr":"172.21.15.150:6821","nonce":363718461}]},"public_addr":"172.21.15.150:6817/363718461","cluster_addr":"172.21.15.150:6819/363718461","heartbeat_back_addr":"172.21.15.150:6823/363718461","heartbeat_front_addr":"172.21.15.150:6821/363718461","state":["exists","up"]},{"osd":3,"uuid":"cda70430-d1e1-427e-b04e-56db4031d078","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":139,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6808","nonce":3550994626},{"type":"v1","addr":"172.21.15.150:6809","nonce":3550994626}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6810","nonce":3550994626},{"type":"v1","addr":"172.21.15.150:6811","nonce":3550994626}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6814","nonce":3550994626},{"type":"v1","addr":"172.21.15.150:6815","nonce":3550994626}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6812","nonce":3550994626},{"type":"v1","addr":"172.21.15.150:6813","nonce":3550994626}]},"public_addr":"172.21.15.150:6809/3550994626","cluster_addr":"172.21.15.150:6811/3550994626","heartbeat_back_addr":"172.21.15.150:6815/3550994626","heartbeat_front_addr":"172.21.15.150:6813/3550994626","state":["exists","up"]},{"osd":4,"uuid":"3a0277fb-5e1e-4f68-bb2d-9a8a0152f64a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":139,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6810","nonce":2718261497},{"type":"v1","addr":"172.21.15.176:6811","nonce":2718261497}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6812","nonce":2718261497},{"type":"v1","addr":"172.21.15.176:6813","nonce":2718261497}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6816","nonce":2718261497},{"type":"v1","addr":"172.21.15.176:6817","nonce":2718261497}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6814","nonce":2718261497},{"type":"v1","addr":"172.21.15.176:6815","nonce":2718261497}]},"public_addr":"172.21.15.176:6811/2718261497","cluster_addr":"172.21.15.176:6813/2718261497","heartbeat_back_addr":"172.21.15.176:6817/2718261497","heartbeat_front_addr":"172.21.15.176:6815/2718261497","state":["exists","up"]},{"osd":5,"uuid":"33aebee6-0315-40b7-a11c-6702f0be494d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":139,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6818","nonce":2049295774},{"type":"v1","addr":"172.21.15.176:6819","nonce":2049295774}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6820","nonce":2049295774},{"type":"v1","addr":"172.21.15.176:6821","nonce":2049295774}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6824","nonce":2049295774},{"type":"v1","addr":"172.21.15.176:6825","nonce":2049295774}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6822","nonce":2049295774},{"type":"v1","addr":"172.21.15.176:6823","nonce":2049295774}]},"public_addr":"172.21.15.176:6819/2049295774","cluster_addr":"172.21.15.176:6821/2049295774","heartbeat_back_addr":"172.21.15.176:6825/2049295774","heartbeat_front_addr":"172.21.15.176:6823/2049295774","state":["exists","up"]},{"osd":6,"uuid":"4d24f360-6751-4263-841b-d77793d33540","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":139,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6826","nonce":2164458476},{"type":"v1","addr":"172.21.15.176:6827","nonce":2164458476}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6828","nonce":2164458476},{"type":"v1","addr":"172.21.15.176:6829","nonce":2164458476}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6832","nonce":2164458476},{"type":"v1","addr":"172.21.15.176:6833","nonce":2164458476}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6830","nonce":2164458476},{"type":"v1","addr":"172.21.15.176:6831","nonce":2164458476}]},"public_addr":"172.21.15.176:6827/2164458476","cluster_addr":"172.21.15.176:6829/2164458476","heartbeat_back_addr":"172.21.15.176:6833/2164458476","heartbeat_front_addr":"172.21.15.176:6831/2164458476","state":["exists","up"]},{"osd":7,"uuid":"c8594fda-c74a-4ba9-8277-caf101d58ca1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":142,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6802","nonce":3239587708},{"type":"v1","addr":"172.21.15.176:6803","nonce":3239587708}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6804","nonce":3239587708},{"type":"v1","addr":"172.21.15.176:6805","nonce":3239587708}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6808","nonce":3239587708},{"type":"v1","addr":"172.21.15.176:6809","nonce":3239587708}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6806","nonce":3239587708},{"type":"v1","addr":"172.21.15.176:6807","nonce":3239587708}]},"public_addr":"172.21.15.176:6803/3239587708","cluster_addr":"172.21.15.176:6805/3239587708","heartbeat_back_addr":"172.21.15.176:6809/3239587708","heartbeat_front_addr":"172.21.15.176:6807/3239587708","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:41:41.905151+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:41:42.705679+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:41:42.459673+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:41:42.440819+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:41:42.668428+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:41:42.694972+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:41:43.078535+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:41:42.363539+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.150:6835/122540131":"2024-09-18T05:54:24.651972+0000","172.21.15.150:6833/122540131":"2024-09-18T05:54:24.651972+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":7,"snaps":[{"begin":2,"length":2}]},{"pool":9,"snaps":[{"begin":2,"length":2}]},{"pool":11,"snaps":[{"begin":2,"length":2}]},{"pool":13,"snaps":[{"begin":2,"length":2}]},{"pool":15,"snaps":[{"begin":2,"length":2}]},{"pool":17,"snaps":[{"begin":2,"length":2}]},{"pool":19,"snaps":[{"begin":2,"length":2}]}],"new_removed_snaps":[],"new_purged_snaps":[{"pool":21,"snaps":[{"begin":2,"length":2}]}],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T05:54:30.799 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:30.798+0000 7f74bcc4d640 1 -- 172.21.15.150:0/3220467298 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f749807b260 msgr2=0x7f749807d770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:54:30.799 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:30.798+0000 7f74bcc4d640 1 --2- 172.21.15.150:0/3220467298 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f749807b260 0x7f749807d770 secure :-1 s=READY pgs=855 cs=0 l=1 rev1=1 crypto rx=0x7f74a8001720 tx=0x7f74a8007e90 comp rx=0 tx=0).stop 2024-09-17T05:54:30.799 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:30.798+0000 7f74bcc4d640 1 -- 172.21.15.150:0/3220467298 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f74b80cd8f0 msgr2=0x7f74b81f4940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:54:30.799 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:30.798+0000 7f74bcc4d640 1 --2- 172.21.15.150:0/3220467298 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f74b80cd8f0 0x7f74b81f4940 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7f74a000e700 tx=0x7f74a000ebc0 comp rx=0 tx=0).stop 2024-09-17T05:54:30.800 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:30.798+0000 7f74bcc4d640 1 -- 172.21.15.150:0/3220467298 shutdown_connections 2024-09-17T05:54:30.800 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:30.798+0000 7f74bcc4d640 1 --2- 172.21.15.150:0/3220467298 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f74b80cd8f0 0x7f74b81f4940 unknown :-1 s=CLOSED pgs=674 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:54:30.800 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:30.798+0000 7f74bcc4d640 1 --2- 172.21.15.150:0/3220467298 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f749807b260 0x7f749807d770 unknown :-1 s=CLOSED pgs=855 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:54:30.800 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:30.798+0000 7f74bcc4d640 1 --2- 172.21.15.150:0/3220467298 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f74b81f4e80 0x7f74b81f6e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:54:30.800 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:30.798+0000 7f74bcc4d640 1 --2- 172.21.15.150:0/3220467298 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f74b80b2360 0x7f74b8155610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:54:30.800 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:30.798+0000 7f74bcc4d640 1 -- 172.21.15.150:0/3220467298 >> 172.21.15.150:0/3220467298 conn(0x7f74b80b2fd0 msgr2=0x7f74b80cb2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:54:30.801 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:30.798+0000 7f74bcc4d640 1 -- 172.21.15.150:0/3220467298 shutdown_connections 2024-09-17T05:54:30.801 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:30.798+0000 7f74bcc4d640 1 -- 172.21.15.150:0/3220467298 wait complete. 2024-09-17T05:54:31.811 INFO:tasks.ceph:Scrubbing osd.0 2024-09-17T05:54:31.812 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2024-09-17T05:54:31.946 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:31.945+0000 7f675e3a1640 1 -- 172.21.15.150:0/1649295312 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f67580b2770 msgr2=0x7f67580b2b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:54:31.947 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:31.945+0000 7f675e3a1640 1 --2- 172.21.15.150:0/1649295312 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f67580b2770 0x7f67580b2b80 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7f6750005fd0 tx=0x7f675002a9d0 comp rx=0 tx=0).stop 2024-09-17T05:54:31.947 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:31.945+0000 7f675e3a1640 1 -- 172.21.15.150:0/1649295312 shutdown_connections 2024-09-17T05:54:31.947 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:31.945+0000 7f675e3a1640 1 --2- 172.21.15.150:0/1649295312 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f67580b2770 0x7f67580b2b80 unknown :-1 s=CLOSED pgs=676 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:54:31.947 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:31.945+0000 7f675e3a1640 1 -- 172.21.15.150:0/1649295312 >> 172.21.15.150:0/1649295312 conn(0x7f67580cef00 msgr2=0x7f67580cf310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:54:31.947 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:31.946+0000 7f675e3a1640 1 -- 172.21.15.150:0/1649295312 shutdown_connections 2024-09-17T05:54:31.947 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:31.946+0000 7f675e3a1640 1 -- 172.21.15.150:0/1649295312 wait complete. 2024-09-17T05:54:31.948 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:31.947+0000 7f675e3a1640 1 Processor -- start 2024-09-17T05:54:31.948 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:31.948+0000 7f675e3a1640 1 -- start start 2024-09-17T05:54:31.951 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:31.949+0000 7f675e3a1640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f67580b1c50 0x7f6758149770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:54:31.951 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:31.949+0000 7f675e3a1640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f67580b2770 0x7f67580b6300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:54:31.951 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:31.949+0000 7f675e3a1640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f67580c5b10 0x7f67580b6840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:54:31.951 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:31.949+0000 7f675e3a1640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f675809bde0 con 0x7f67580b1c50 2024-09-17T05:54:31.951 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:31.949+0000 7f675e3a1640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f675809bc60 con 0x7f67580b2770 2024-09-17T05:54:31.951 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:31.949+0000 7f675e3a1640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f6758168160 con 0x7f67580c5b10 2024-09-17T05:54:31.951 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:31.949+0000 7f6757fff640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f67580b1c50 0x7f6758149770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:54:31.951 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:31.949+0000 7f6757fff640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f67580b1c50 0x7f6758149770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:38860/0 (socket says 172.21.15.150:38860) 2024-09-17T05:54:31.951 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:31.949+0000 7f6757fff640 1 -- 172.21.15.150:0/230440486 learned_addr learned my addr 172.21.15.150:0/230440486 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:54:31.951 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:31.949+0000 7f675c93e640 1 --2- 172.21.15.150:0/230440486 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f67580c5b10 0x7f67580b6840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:54:31.952 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:31.949+0000 7f67577fe640 1 --2- 172.21.15.150:0/230440486 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f67580b2770 0x7f67580b6300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:54:31.952 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:31.949+0000 7f6757fff640 1 -- 172.21.15.150:0/230440486 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f67580c5b10 msgr2=0x7f67580b6840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:54:31.952 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:31.949+0000 7f6757fff640 1 --2- 172.21.15.150:0/230440486 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f67580c5b10 0x7f67580b6840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:54:31.952 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:31.949+0000 7f6757fff640 1 -- 172.21.15.150:0/230440486 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f67580b2770 msgr2=0x7f67580b6300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:54:31.952 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:31.949+0000 7f6757fff640 1 --2- 172.21.15.150:0/230440486 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f67580b2770 0x7f67580b6300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:54:31.952 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:31.949+0000 7f6757fff640 1 -- 172.21.15.150:0/230440486 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6758164360 con 0x7f67580b1c50 2024-09-17T05:54:31.952 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:31.949+0000 7f6757fff640 1 --2- 172.21.15.150:0/230440486 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f67580b1c50 0x7f6758149770 secure :-1 s=READY pgs=2018 cs=0 l=1 rev1=1 crypto rx=0x7f674800c430 tx=0x7f674800c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:54:31.952 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:31.950+0000 7f6754ff9640 1 -- 172.21.15.150:0/230440486 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6748017070 con 0x7f67580b1c50 2024-09-17T05:54:31.952 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:31.950+0000 7f6754ff9640 1 -- 172.21.15.150:0/230440486 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f67480053c0 con 0x7f67580b1c50 2024-09-17T05:54:31.952 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:31.950+0000 7f675e3a1640 1 -- 172.21.15.150:0/230440486 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6758163da0 con 0x7f67580b1c50 2024-09-17T05:54:31.952 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:31.950+0000 7f6754ff9640 1 -- 172.21.15.150:0/230440486 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67480038a0 con 0x7f67580b1c50 2024-09-17T05:54:31.952 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:31.950+0000 7f675e3a1640 1 -- 172.21.15.150:0/230440486 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f67581665e0 con 0x7f67580b1c50 2024-09-17T05:54:31.954 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:31.951+0000 7f675e3a1640 1 -- 172.21.15.150:0/230440486 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f67580b2b80 con 0x7f67580b1c50 2024-09-17T05:54:31.954 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:31.952+0000 7f6754ff9640 1 -- 172.21.15.150:0/230440486 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 51) ==== 104960+0+0 (secure 0 0 0) 0x7f674801a070 con 0x7f67580b1c50 2024-09-17T05:54:31.954 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:31.952+0000 7f6754ff9640 1 --2- 172.21.15.150:0/230440486 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f674407b290 0x7f674407d7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:54:31.954 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:31.952+0000 7f6754ff9640 1 -- 172.21.15.150:0/230440486 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(147..147 src has 1..147) ==== 5167+0+0 (secure 0 0 0) 0x7f6748099770 con 0x7f67580b1c50 2024-09-17T05:54:31.954 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:31.952+0000 7f67577fe640 1 --2- 172.21.15.150:0/230440486 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f674407b290 0x7f674407d7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:54:31.954 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:31.952+0000 7f6754ff9640 1 --2- 172.21.15.150:0/230440486 >> [v2:172.21.15.150:6800/479374392,v1:172.21.15.150:6801/479374392] conn(0x7f6744081440 0x7f6744083930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:54:31.954 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:31.952+0000 7f6754ff9640 1 -- 172.21.15.150:0/230440486 --> [v2:172.21.15.150:6800/479374392,v1:172.21.15.150:6801/479374392] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f674801feb0 con 0x7f6744081440 2024-09-17T05:54:31.954 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:31.952+0000 7f6754ff9640 1 -- 172.21.15.150:0/230440486 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_get_version_reply(handle=1 version=147) ==== 24+0+0 (secure 0 0 0) 0x7f6748099ea0 con 0x7f67580b1c50 2024-09-17T05:54:31.954 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:31.952+0000 7f675c93e640 1 --2- 172.21.15.150:0/230440486 >> [v2:172.21.15.150:6800/479374392,v1:172.21.15.150:6801/479374392] conn(0x7f6744081440 0x7f6744083930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:54:31.955 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:31.953+0000 7f67577fe640 1 --2- 172.21.15.150:0/230440486 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f674407b290 0x7f674407d7a0 secure :-1 s=READY pgs=856 cs=0 l=1 rev1=1 crypto rx=0x7f6758051010 tx=0x7f674c007cc0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:54:31.955 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:31.953+0000 7f675c93e640 1 --2- 172.21.15.150:0/230440486 >> [v2:172.21.15.150:6800/479374392,v1:172.21.15.150:6801/479374392] conn(0x7f6744081440 0x7f6744083930 crc :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:54:31.955 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:31.953+0000 7f6754ff9640 1 -- 172.21.15.150:0/230440486 <== osd.0 v2:172.21.15.150:6800/479374392 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f674801feb0 con 0x7f6744081440 2024-09-17T05:54:31.967 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:31.966+0000 7f675e3a1640 1 -- 172.21.15.150:0/230440486 --> [v2:172.21.15.150:6800/479374392,v1:172.21.15.150:6801/479374392] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f6758072660 con 0x7f6744081440 2024-09-17T05:54:31.967 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:31.966+0000 7f6754ff9640 1 -- 172.21.15.150:0/230440486 <== osd.0 v2:172.21.15.150:6800/479374392 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f6758072660 con 0x7f6744081440 2024-09-17T05:54:31.967 INFO:teuthology.orchestra.run.smithi150.stdout:{ 2024-09-17T05:54:31.968 INFO:teuthology.orchestra.run.smithi150.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-17T05:54:31.968 INFO:teuthology.orchestra.run.smithi150.stdout:} 2024-09-17T05:54:31.969 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:31.967+0000 7f675e3a1640 1 -- 172.21.15.150:0/230440486 >> [v2:172.21.15.150:6800/479374392,v1:172.21.15.150:6801/479374392] conn(0x7f6744081440 msgr2=0x7f6744083930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:54:31.969 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:31.967+0000 7f675e3a1640 1 --2- 172.21.15.150:0/230440486 >> [v2:172.21.15.150:6800/479374392,v1:172.21.15.150:6801/479374392] conn(0x7f6744081440 0x7f6744083930 crc :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:54:31.969 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:31.967+0000 7f675e3a1640 1 -- 172.21.15.150:0/230440486 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f674407b290 msgr2=0x7f674407d7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:54:31.969 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:31.967+0000 7f675e3a1640 1 --2- 172.21.15.150:0/230440486 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f674407b290 0x7f674407d7a0 secure :-1 s=READY pgs=856 cs=0 l=1 rev1=1 crypto rx=0x7f6758051010 tx=0x7f674c007cc0 comp rx=0 tx=0).stop 2024-09-17T05:54:31.969 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:31.967+0000 7f675e3a1640 1 -- 172.21.15.150:0/230440486 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f67580b1c50 msgr2=0x7f6758149770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:54:31.969 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:31.967+0000 7f675e3a1640 1 --2- 172.21.15.150:0/230440486 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f67580b1c50 0x7f6758149770 secure :-1 s=READY pgs=2018 cs=0 l=1 rev1=1 crypto rx=0x7f674800c430 tx=0x7f674800c8f0 comp rx=0 tx=0).stop 2024-09-17T05:54:31.969 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:31.967+0000 7f675c93e640 1 -- 172.21.15.150:0/230440486 reap_dead start 2024-09-17T05:54:31.969 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:31.967+0000 7f675e3a1640 1 -- 172.21.15.150:0/230440486 shutdown_connections 2024-09-17T05:54:31.969 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:31.967+0000 7f675e3a1640 1 -- 172.21.15.150:0/230440486 >> 172.21.15.150:0/230440486 conn(0x7f67580cef00 msgr2=0x7f6758072a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:54:31.969 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:31.967+0000 7f675e3a1640 1 -- 172.21.15.150:0/230440486 shutdown_connections 2024-09-17T05:54:31.969 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:31.967+0000 7f675e3a1640 1 -- 172.21.15.150:0/230440486 wait complete. 2024-09-17T05:54:31.979 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2024-09-17T05:54:32.097 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:32.096+0000 7fe019c64640 1 -- 172.21.15.150:0/3713874932 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe0140b1da0 msgr2=0x7fe0140b21b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:54:32.098 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:32.096+0000 7fe019c64640 1 --2- 172.21.15.150:0/3713874932 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe0140b1da0 0x7fe0140b21b0 secure :-1 s=READY pgs=2019 cs=0 l=1 rev1=1 crypto rx=0x7fe014076d20 tx=0x7fe00c02a980 comp rx=0 tx=0).stop 2024-09-17T05:54:32.098 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:32.097+0000 7fe019c64640 1 -- 172.21.15.150:0/3713874932 shutdown_connections 2024-09-17T05:54:32.098 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:32.097+0000 7fe019c64640 1 --2- 172.21.15.150:0/3713874932 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe0140b1da0 0x7fe0140b21b0 unknown :-1 s=CLOSED pgs=2019 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:54:32.098 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:32.097+0000 7fe019c64640 1 --2- 172.21.15.150:0/3713874932 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe0140d0990 0x7fe0140d0da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:54:32.098 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:32.097+0000 7fe019c64640 1 --2- 172.21.15.150:0/3713874932 >> v2:172.21.15.176:3300/0 conn(0x7fe0140b1850 0x7fe0140b7d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:54:32.098 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:32.097+0000 7fe019c64640 1 -- 172.21.15.150:0/3713874932 >> 172.21.15.150:0/3713874932 conn(0x7fe0140cef80 msgr2=0x7fe0140cf390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:54:32.098 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:32.097+0000 7fe019c64640 1 -- 172.21.15.150:0/3713874932 shutdown_connections 2024-09-17T05:54:32.098 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:32.097+0000 7fe019c64640 1 -- 172.21.15.150:0/3713874932 wait complete. 2024-09-17T05:54:32.099 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:32.098+0000 7fe019c64640 1 Processor -- start 2024-09-17T05:54:32.099 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:32.099+0000 7fe019c64640 1 -- start start 2024-09-17T05:54:32.102 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:32.100+0000 7fe019c64640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe0140b1850 0x7fe0141525d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:54:32.102 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:32.100+0000 7fe019c64640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe0140b1da0 0x7fe01415fbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:54:32.102 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:32.100+0000 7fe019c64640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe0140d0990 0x7fe01414bac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:54:32.102 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:32.100+0000 7fe019c64640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7fe0140b26f0 con 0x7fe0140b1850 2024-09-17T05:54:32.102 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:32.100+0000 7fe019c64640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fe0140cedd0 con 0x7fe0140d0990 2024-09-17T05:54:32.102 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:32.100+0000 7fe019c64640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fe0140b2870 con 0x7fe0140b1da0 2024-09-17T05:54:32.102 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:32.100+0000 7fe0137fe640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe0140b1850 0x7fe0141525d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:54:32.102 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:32.100+0000 7fe0137fe640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe0140b1850 0x7fe0141525d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:38876/0 (socket says 172.21.15.150:38876) 2024-09-17T05:54:32.102 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:32.100+0000 7fe0137fe640 1 -- 172.21.15.150:0/1210098083 learned_addr learned my addr 172.21.15.150:0/1210098083 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:54:32.102 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:32.100+0000 7fe013fff640 1 --2- 172.21.15.150:0/1210098083 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe0140d0990 0x7fe01414bac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:54:32.102 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:32.100+0000 7fe012ffd640 1 --2- 172.21.15.150:0/1210098083 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe0140b1da0 0x7fe01415fbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:54:32.103 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:32.100+0000 7fe0137fe640 1 -- 172.21.15.150:0/1210098083 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe0140b1da0 msgr2=0x7fe01415fbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:54:32.103 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:32.100+0000 7fe0137fe640 1 --2- 172.21.15.150:0/1210098083 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe0140b1da0 0x7fe01415fbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:54:32.103 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:32.100+0000 7fe0137fe640 1 -- 172.21.15.150:0/1210098083 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe0140d0990 msgr2=0x7fe01414bac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:54:32.103 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:32.100+0000 7fe0137fe640 1 --2- 172.21.15.150:0/1210098083 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe0140d0990 0x7fe01414bac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:54:32.103 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:32.100+0000 7fe0137fe640 1 -- 172.21.15.150:0/1210098083 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe01415eb40 con 0x7fe0140b1850 2024-09-17T05:54:32.103 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:32.100+0000 7fe0137fe640 1 --2- 172.21.15.150:0/1210098083 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe0140b1850 0x7fe0141525d0 secure :-1 s=READY pgs=2020 cs=0 l=1 rev1=1 crypto rx=0x7fe00800e710 tx=0x7fe00800ebd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:54:32.103 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:32.101+0000 7fdffbfff640 1 -- 172.21.15.150:0/1210098083 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe00800cab0 con 0x7fe0140b1850 2024-09-17T05:54:32.103 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:32.101+0000 7fdffbfff640 1 -- 172.21.15.150:0/1210098083 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe00800cd40 con 0x7fe0140b1850 2024-09-17T05:54:32.103 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:32.101+0000 7fe019c64640 1 -- 172.21.15.150:0/1210098083 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe01415ee20 con 0x7fe0140b1850 2024-09-17T05:54:32.103 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:32.101+0000 7fdffbfff640 1 -- 172.21.15.150:0/1210098083 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe008010690 con 0x7fe0140b1850 2024-09-17T05:54:32.103 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:32.101+0000 7fe019c64640 1 -- 172.21.15.150:0/1210098083 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe01415f3e0 con 0x7fe0140b1850 2024-09-17T05:54:32.104 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:32.102+0000 7fe019c64640 1 -- 172.21.15.150:0/1210098083 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe01415f820 con 0x7fe0140b1850 2024-09-17T05:54:32.104 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:32.103+0000 7fdffbfff640 1 -- 172.21.15.150:0/1210098083 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 51) ==== 104960+0+0 (secure 0 0 0) 0x7fe008010830 con 0x7fe0140b1850 2024-09-17T05:54:32.104 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:32.103+0000 7fdffbfff640 1 --2- 172.21.15.150:0/1210098083 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fe00007b260 0x7fe00007d770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:54:32.104 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:32.103+0000 7fdffbfff640 1 -- 172.21.15.150:0/1210098083 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(147..147 src has 1..147) ==== 5167+0+0 (secure 0 0 0) 0x7fe00809a840 con 0x7fe0140b1850 2024-09-17T05:54:32.105 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:32.103+0000 7fe012ffd640 1 --2- 172.21.15.150:0/1210098083 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fe00007b260 0x7fe00007d770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:54:32.105 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:32.104+0000 7fe012ffd640 1 --2- 172.21.15.150:0/1210098083 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fe00007b260 0x7fe00007d770 secure :-1 s=READY pgs=857 cs=0 l=1 rev1=1 crypto rx=0x7fe0140cdd60 tx=0x7fe004005f90 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:54:32.108 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:32.108+0000 7fdffbfff640 1 -- 172.21.15.150:0/1210098083 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fe0080641c0 con 0x7fe0140b1850 2024-09-17T05:54:32.291 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:32.290+0000 7fe019c64640 1 -- 172.21.15.150:0/1210098083 --> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "0", "target": ["mon-mgr", ""]}) -- 0x7fe01415e8f0 con 0x7fe00007b260 2024-09-17T05:54:32.291 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:32.291+0000 7fdffbfff640 1 -- 172.21.15.150:0/1210098083 <== mgr.4108 v2:172.21.15.176:6800/3631216395 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 0 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7fe01415e8f0 con 0x7fe00007b260 2024-09-17T05:54:32.292 INFO:teuthology.orchestra.run.smithi150.stderr:instructed osd(s) 0 to deep-scrub 2024-09-17T05:54:32.294 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:32.293+0000 7fe019c64640 1 -- 172.21.15.150:0/1210098083 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fe00007b260 msgr2=0x7fe00007d770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:54:32.294 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:32.293+0000 7fe019c64640 1 --2- 172.21.15.150:0/1210098083 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fe00007b260 0x7fe00007d770 secure :-1 s=READY pgs=857 cs=0 l=1 rev1=1 crypto rx=0x7fe0140cdd60 tx=0x7fe004005f90 comp rx=0 tx=0).stop 2024-09-17T05:54:32.294 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:32.293+0000 7fe019c64640 1 -- 172.21.15.150:0/1210098083 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe0140b1850 msgr2=0x7fe0141525d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:54:32.294 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:32.293+0000 7fe019c64640 1 --2- 172.21.15.150:0/1210098083 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe0140b1850 0x7fe0141525d0 secure :-1 s=READY pgs=2020 cs=0 l=1 rev1=1 crypto rx=0x7fe00800e710 tx=0x7fe00800ebd0 comp rx=0 tx=0).stop 2024-09-17T05:54:32.294 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:32.293+0000 7fe019c64640 1 -- 172.21.15.150:0/1210098083 shutdown_connections 2024-09-17T05:54:32.295 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:32.293+0000 7fe019c64640 1 --2- 172.21.15.150:0/1210098083 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe0140d0990 0x7fe01414bac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:54:32.295 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:32.293+0000 7fe019c64640 1 --2- 172.21.15.150:0/1210098083 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fe00007b260 0x7fe00007d770 unknown :-1 s=CLOSED pgs=857 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:54:32.295 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:32.293+0000 7fe019c64640 1 --2- 172.21.15.150:0/1210098083 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe0140b1da0 0x7fe01415fbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:54:32.295 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:32.293+0000 7fe019c64640 1 --2- 172.21.15.150:0/1210098083 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe0140b1850 0x7fe0141525d0 unknown :-1 s=CLOSED pgs=2020 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:54:32.295 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:32.293+0000 7fe019c64640 1 -- 172.21.15.150:0/1210098083 >> 172.21.15.150:0/1210098083 conn(0x7fe0140cef80 msgr2=0x7fe01415ca80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:54:32.295 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:32.293+0000 7fe019c64640 1 -- 172.21.15.150:0/1210098083 shutdown_connections 2024-09-17T05:54:32.295 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:32.293+0000 7fe019c64640 1 -- 172.21.15.150:0/1210098083 wait complete. 2024-09-17T05:54:32.305 INFO:tasks.ceph:Scrubbing osd.1 2024-09-17T05:54:32.306 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2024-09-17T05:54:32.430 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:32.428+0000 7f7479294640 1 -- 172.21.15.150:0/471228832 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f747415ba50 msgr2=0x7f74740b36f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:54:32.430 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:32.428+0000 7f7479294640 1 --2- 172.21.15.150:0/471228832 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f747415ba50 0x7f74740b36f0 secure :-1 s=READY pgs=2022 cs=0 l=1 rev1=1 crypto rx=0x7f74740b2e80 tx=0x7f745c02a410 comp rx=0 tx=0).stop 2024-09-17T05:54:32.430 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:32.428+0000 7f7479294640 1 -- 172.21.15.150:0/471228832 shutdown_connections 2024-09-17T05:54:32.430 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:32.428+0000 7f7479294640 1 --2- 172.21.15.150:0/471228832 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f747415ba50 0x7f74740b36f0 unknown :-1 s=CLOSED pgs=2022 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:54:32.430 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:32.428+0000 7f7479294640 1 --2- 172.21.15.150:0/471228832 >> v2:172.21.15.176:3300/0 conn(0x7f74740cc7d0 0x7f74740b3120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:54:32.430 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:32.428+0000 7f7479294640 1 -- 172.21.15.150:0/471228832 >> 172.21.15.150:0/471228832 conn(0x7f74740b2540 msgr2=0x7f74740d02d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:54:32.430 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:32.428+0000 7f7479294640 1 -- 172.21.15.150:0/471228832 shutdown_connections 2024-09-17T05:54:32.430 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:32.428+0000 7f7479294640 1 -- 172.21.15.150:0/471228832 wait complete. 2024-09-17T05:54:32.431 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:32.430+0000 7f7479294640 1 Processor -- start 2024-09-17T05:54:32.431 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:32.430+0000 7f7479294640 1 -- start start 2024-09-17T05:54:32.434 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:32.432+0000 7f7479294640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f747406f010 0x7f7474153960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:54:32.434 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:32.432+0000 7f7479294640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f74740cc7d0 0x7f74740ae820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:54:32.434 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:32.432+0000 7f7479294640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f747415ba50 0x7f7474154590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:54:32.434 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:32.432+0000 7f7479294640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f7474070010 con 0x7f747406f010 2024-09-17T05:54:32.434 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:32.432+0000 7f7479294640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f747406fe90 con 0x7f74740cc7d0 2024-09-17T05:54:32.434 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:32.432+0000 7f7479294640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f74740cb930 con 0x7f747415ba50 2024-09-17T05:54:32.434 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:32.432+0000 7f7472ffd640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f747406f010 0x7f7474153960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:54:32.434 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:32.432+0000 7f7472ffd640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f747406f010 0x7f7474153960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:38884/0 (socket says 172.21.15.150:38884) 2024-09-17T05:54:32.435 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:32.432+0000 7f7472ffd640 1 -- 172.21.15.150:0/1975123488 learned_addr learned my addr 172.21.15.150:0/1975123488 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:54:32.435 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:32.432+0000 7f74737fe640 1 --2- 172.21.15.150:0/1975123488 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f747415ba50 0x7f7474154590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:54:32.435 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:32.432+0000 7f746a7fc640 1 --2- 172.21.15.150:0/1975123488 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f74740cc7d0 0x7f74740ae820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:54:32.435 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:32.432+0000 7f7472ffd640 1 -- 172.21.15.150:0/1975123488 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f747415ba50 msgr2=0x7f7474154590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:54:32.435 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:32.432+0000 7f7472ffd640 1 --2- 172.21.15.150:0/1975123488 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f747415ba50 0x7f7474154590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:54:32.435 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:32.432+0000 7f7472ffd640 1 -- 172.21.15.150:0/1975123488 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f74740cc7d0 msgr2=0x7f74740ae820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:54:32.435 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:32.432+0000 7f7472ffd640 1 --2- 172.21.15.150:0/1975123488 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f74740cc7d0 0x7f74740ae820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:54:32.436 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:32.432+0000 7f7472ffd640 1 -- 172.21.15.150:0/1975123488 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f747415e530 con 0x7f747406f010 2024-09-17T05:54:32.436 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:32.432+0000 7f746a7fc640 1 --2- 172.21.15.150:0/1975123488 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f74740cc7d0 0x7f74740ae820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:54:32.436 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:32.432+0000 7f7472ffd640 1 --2- 172.21.15.150:0/1975123488 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f747406f010 0x7f7474153960 secure :-1 s=READY pgs=2023 cs=0 l=1 rev1=1 crypto rx=0x7f746400e7c0 tx=0x7f746400ec80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:54:32.436 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:32.432+0000 7f746bfff640 1 -- 172.21.15.150:0/1975123488 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f746400ccc0 con 0x7f747406f010 2024-09-17T05:54:32.436 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:32.433+0000 7f746bfff640 1 -- 172.21.15.150:0/1975123488 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f7464010430 con 0x7f747406f010 2024-09-17T05:54:32.436 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:32.433+0000 7f746bfff640 1 -- 172.21.15.150:0/1975123488 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7464010860 con 0x7f747406f010 2024-09-17T05:54:32.436 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:32.433+0000 7f7479294640 1 -- 172.21.15.150:0/1975123488 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f747415e810 con 0x7f747406f010 2024-09-17T05:54:32.436 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:32.433+0000 7f7479294640 1 -- 172.21.15.150:0/1975123488 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f747415edd0 con 0x7f747406f010 2024-09-17T05:54:32.436 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:32.433+0000 7f7479294640 1 -- 172.21.15.150:0/1975123488 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f74740b5110 con 0x7f747406f010 2024-09-17T05:54:32.437 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:32.435+0000 7f746bfff640 1 -- 172.21.15.150:0/1975123488 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 51) ==== 104960+0+0 (secure 0 0 0) 0x7f7464010a00 con 0x7f747406f010 2024-09-17T05:54:32.437 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:32.435+0000 7f746bfff640 1 --2- 172.21.15.150:0/1975123488 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f745407b290 0x7f745407d7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:54:32.438 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:32.435+0000 7f746bfff640 1 -- 172.21.15.150:0/1975123488 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(147..147 src has 1..147) ==== 5167+0+0 (secure 0 0 0) 0x7f746409b590 con 0x7f747406f010 2024-09-17T05:54:32.438 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:32.435+0000 7f746bfff640 1 --2- 172.21.15.150:0/1975123488 >> [v2:172.21.15.150:6824/913899800,v1:172.21.15.150:6825/913899800] conn(0x7f7454081440 0x7f7454083930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:54:32.438 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:32.435+0000 7f746bfff640 1 -- 172.21.15.150:0/1975123488 --> [v2:172.21.15.150:6824/913899800,v1:172.21.15.150:6825/913899800] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f746401bec0 con 0x7f7454081440 2024-09-17T05:54:32.438 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:32.435+0000 7f746bfff640 1 -- 172.21.15.150:0/1975123488 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_get_version_reply(handle=1 version=147) ==== 24+0+0 (secure 0 0 0) 0x7f746409bcc0 con 0x7f747406f010 2024-09-17T05:54:32.438 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:32.435+0000 7f746a7fc640 1 --2- 172.21.15.150:0/1975123488 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f745407b290 0x7f745407d7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:54:32.438 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:32.435+0000 7f74737fe640 1 --2- 172.21.15.150:0/1975123488 >> [v2:172.21.15.150:6824/913899800,v1:172.21.15.150:6825/913899800] conn(0x7f7454081440 0x7f7454083930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:54:32.438 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:32.436+0000 7f74737fe640 1 --2- 172.21.15.150:0/1975123488 >> [v2:172.21.15.150:6824/913899800,v1:172.21.15.150:6825/913899800] conn(0x7f7454081440 0x7f7454083930 crc :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:54:32.438 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:32.436+0000 7f746a7fc640 1 --2- 172.21.15.150:0/1975123488 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f745407b290 0x7f745407d7a0 secure :-1 s=READY pgs=858 cs=0 l=1 rev1=1 crypto rx=0x7f745c034000 tx=0x7f745c004730 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:54:32.438 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:32.436+0000 7f746bfff640 1 -- 172.21.15.150:0/1975123488 <== osd.1 v2:172.21.15.150:6824/913899800 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f746401bec0 con 0x7f7454081440 2024-09-17T05:54:32.449 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:32.449+0000 7f7479294640 1 -- 172.21.15.150:0/1975123488 --> [v2:172.21.15.150:6824/913899800,v1:172.21.15.150:6825/913899800] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f74740cbde0 con 0x7f7454081440 2024-09-17T05:54:32.450 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:32.449+0000 7f746bfff640 1 -- 172.21.15.150:0/1975123488 <== osd.1 v2:172.21.15.150:6824/913899800 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f74740cbde0 con 0x7f7454081440 2024-09-17T05:54:32.450 INFO:teuthology.orchestra.run.smithi150.stdout:{ 2024-09-17T05:54:32.450 INFO:teuthology.orchestra.run.smithi150.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-17T05:54:32.450 INFO:teuthology.orchestra.run.smithi150.stdout:} 2024-09-17T05:54:32.451 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:32.449+0000 7f7479294640 1 -- 172.21.15.150:0/1975123488 >> [v2:172.21.15.150:6824/913899800,v1:172.21.15.150:6825/913899800] conn(0x7f7454081440 msgr2=0x7f7454083930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:54:32.452 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:32.449+0000 7f7479294640 1 --2- 172.21.15.150:0/1975123488 >> [v2:172.21.15.150:6824/913899800,v1:172.21.15.150:6825/913899800] conn(0x7f7454081440 0x7f7454083930 crc :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:54:32.452 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:32.449+0000 7f7479294640 1 -- 172.21.15.150:0/1975123488 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f745407b290 msgr2=0x7f745407d7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:54:32.452 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:32.449+0000 7f7479294640 1 --2- 172.21.15.150:0/1975123488 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f745407b290 0x7f745407d7a0 secure :-1 s=READY pgs=858 cs=0 l=1 rev1=1 crypto rx=0x7f745c034000 tx=0x7f745c004730 comp rx=0 tx=0).stop 2024-09-17T05:54:32.452 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:32.449+0000 7f7479294640 1 -- 172.21.15.150:0/1975123488 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f747406f010 msgr2=0x7f7474153960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:54:32.452 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:32.449+0000 7f7479294640 1 --2- 172.21.15.150:0/1975123488 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f747406f010 0x7f7474153960 secure :-1 s=READY pgs=2023 cs=0 l=1 rev1=1 crypto rx=0x7f746400e7c0 tx=0x7f746400ec80 comp rx=0 tx=0).stop 2024-09-17T05:54:32.452 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:32.449+0000 7f74737fe640 1 -- 172.21.15.150:0/1975123488 reap_dead start 2024-09-17T05:54:32.452 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:32.450+0000 7f7479294640 1 -- 172.21.15.150:0/1975123488 shutdown_connections 2024-09-17T05:54:32.452 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:32.450+0000 7f7479294640 1 -- 172.21.15.150:0/1975123488 >> 172.21.15.150:0/1975123488 conn(0x7f74740b2540 msgr2=0x7f74740b3ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:54:32.453 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:32.450+0000 7f7479294640 1 -- 172.21.15.150:0/1975123488 shutdown_connections 2024-09-17T05:54:32.453 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:32.450+0000 7f7479294640 1 -- 172.21.15.150:0/1975123488 wait complete. 2024-09-17T05:54:32.462 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2024-09-17T05:54:32.578 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:32.577+0000 7fd98cd62640 1 -- 172.21.15.150:0/348010655 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd9880cd650 msgr2=0x7fd9880cda60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:54:32.578 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:32.577+0000 7fd98cd62640 1 --2- 172.21.15.150:0/348010655 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd9880cd650 0x7fd9880cda60 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fd978009830 tx=0x7fd97802a510 comp rx=0 tx=0).stop 2024-09-17T05:54:32.578 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:32.577+0000 7fd98cd62640 1 -- 172.21.15.150:0/348010655 shutdown_connections 2024-09-17T05:54:32.578 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:32.577+0000 7fd98cd62640 1 --2- 172.21.15.150:0/348010655 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd9880cd650 0x7fd9880cda60 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:54:32.578 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:32.577+0000 7fd98cd62640 1 --2- 172.21.15.150:0/348010655 >> v2:172.21.15.176:3300/0 conn(0x7fd98809ba60 0x7fd9880cd110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:54:32.578 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:32.577+0000 7fd98cd62640 1 -- 172.21.15.150:0/348010655 >> 172.21.15.150:0/348010655 conn(0x7fd9880cef80 msgr2=0x7fd9880cf390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:54:32.579 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:32.577+0000 7fd98cd62640 1 -- 172.21.15.150:0/348010655 shutdown_connections 2024-09-17T05:54:32.579 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:32.577+0000 7fd98cd62640 1 -- 172.21.15.150:0/348010655 wait complete. 2024-09-17T05:54:32.579 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:32.579+0000 7fd98cd62640 1 Processor -- start 2024-09-17T05:54:32.579 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:32.579+0000 7fd98cd62640 1 -- start start 2024-09-17T05:54:32.585 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:32.580+0000 7fd98cd62640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd98809ba60 0x7fd98815bd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:54:32.585 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:32.580+0000 7fd98cd62640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd9880c5b90 0x7fd98815a500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:54:32.585 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:32.580+0000 7fd98cd62640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd9880cd650 0x7fd98815aa40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:54:32.585 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:32.580+0000 7fd98cd62640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7fd9880ce120 con 0x7fd9880c5b90 2024-09-17T05:54:32.586 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:32.580+0000 7fd98cd62640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fd9880cdfa0 con 0x7fd98809ba60 2024-09-17T05:54:32.586 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:32.580+0000 7fd98cd62640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fd9880ce2a0 con 0x7fd9880cd650 2024-09-17T05:54:32.586 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:32.580+0000 7fd985d9b640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd9880c5b90 0x7fd98815a500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:54:32.586 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:32.580+0000 7fd98659c640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd98809ba60 0x7fd98815bd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:54:32.586 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:32.580+0000 7fd985d9b640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd9880c5b90 0x7fd98815a500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:38898/0 (socket says 172.21.15.150:38898) 2024-09-17T05:54:32.586 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:32.580+0000 7fd98659c640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd98809ba60 0x7fd98815bd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3300/0 says I am v2:172.21.15.150:42346/0 (socket says 172.21.15.150:42346) 2024-09-17T05:54:32.587 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:32.580+0000 7fd985d9b640 1 -- 172.21.15.150:0/2739567154 learned_addr learned my addr 172.21.15.150:0/2739567154 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:54:32.587 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:32.580+0000 7fd986d9d640 1 --2- 172.21.15.150:0/2739567154 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd9880cd650 0x7fd98815aa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:54:32.587 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:32.581+0000 7fd985d9b640 1 -- 172.21.15.150:0/2739567154 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd9880cd650 msgr2=0x7fd98815aa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:54:32.587 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:32.581+0000 7fd985d9b640 1 --2- 172.21.15.150:0/2739567154 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd9880cd650 0x7fd98815aa40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:54:32.587 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:32.581+0000 7fd985d9b640 1 -- 172.21.15.150:0/2739567154 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd98809ba60 msgr2=0x7fd98815bd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:54:32.587 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:32.581+0000 7fd985d9b640 1 --2- 172.21.15.150:0/2739567154 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd98809ba60 0x7fd98815bd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:54:32.588 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:32.581+0000 7fd985d9b640 1 -- 172.21.15.150:0/2739567154 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd9880b6680 con 0x7fd9880c5b90 2024-09-17T05:54:32.588 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:32.581+0000 7fd986d9d640 1 --2- 172.21.15.150:0/2739567154 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd9880cd650 0x7fd98815aa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T05:54:32.588 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:32.581+0000 7fd98659c640 1 --2- 172.21.15.150:0/2739567154 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd98809ba60 0x7fd98815bd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T05:54:32.588 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:32.581+0000 7fd985d9b640 1 --2- 172.21.15.150:0/2739567154 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd9880c5b90 0x7fd98815a500 secure :-1 s=READY pgs=2024 cs=0 l=1 rev1=1 crypto rx=0x7fd97c00ec80 tx=0x7fd97c00c6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:54:32.588 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:32.581+0000 7fd976ffd640 1 -- 172.21.15.150:0/2739567154 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd97c003b70 con 0x7fd9880c5b90 2024-09-17T05:54:32.589 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:32.581+0000 7fd976ffd640 1 -- 172.21.15.150:0/2739567154 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd97c003e00 con 0x7fd9880c5b90 2024-09-17T05:54:32.589 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:32.581+0000 7fd98cd62640 1 -- 172.21.15.150:0/2739567154 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd988159a20 con 0x7fd9880c5b90 2024-09-17T05:54:32.589 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:32.581+0000 7fd976ffd640 1 -- 172.21.15.150:0/2739567154 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd97c004280 con 0x7fd9880c5b90 2024-09-17T05:54:32.589 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:32.581+0000 7fd98cd62640 1 -- 172.21.15.150:0/2739567154 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd98809c5b0 con 0x7fd9880c5b90 2024-09-17T05:54:32.589 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:32.582+0000 7fd98cd62640 1 -- 172.21.15.150:0/2739567154 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd9880cd110 con 0x7fd9880c5b90 2024-09-17T05:54:32.590 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:32.583+0000 7fd976ffd640 1 -- 172.21.15.150:0/2739567154 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 51) ==== 104960+0+0 (secure 0 0 0) 0x7fd97c004420 con 0x7fd9880c5b90 2024-09-17T05:54:32.590 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:32.584+0000 7fd976ffd640 1 --2- 172.21.15.150:0/2739567154 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fd96807b260 0x7fd96807d770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:54:32.590 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:32.584+0000 7fd976ffd640 1 -- 172.21.15.150:0/2739567154 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(147..147 src has 1..147) ==== 5167+0+0 (secure 0 0 0) 0x7fd97c09ad20 con 0x7fd9880c5b90 2024-09-17T05:54:32.590 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:32.584+0000 7fd98659c640 1 --2- 172.21.15.150:0/2739567154 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fd96807b260 0x7fd96807d770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:54:32.590 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:32.584+0000 7fd98659c640 1 --2- 172.21.15.150:0/2739567154 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fd96807b260 0x7fd96807d770 secure :-1 s=READY pgs=859 cs=0 l=1 rev1=1 crypto rx=0x7fd980007fd0 tx=0x7fd980007ea0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:54:32.591 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:32.588+0000 7fd976ffd640 1 -- 172.21.15.150:0/2739567154 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fd97c0646a0 con 0x7fd9880c5b90 2024-09-17T05:54:32.796 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:32.796+0000 7fd98cd62640 1 -- 172.21.15.150:0/2739567154 --> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "1", "target": ["mon-mgr", ""]}) -- 0x7fd988071e50 con 0x7fd96807b260 2024-09-17T05:54:32.797 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:32.796+0000 7fd976ffd640 1 -- 172.21.15.150:0/2739567154 <== mgr.4108 v2:172.21.15.176:6800/3631216395 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 1 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7fd988071e50 con 0x7fd96807b260 2024-09-17T05:54:32.797 INFO:teuthology.orchestra.run.smithi150.stderr:instructed osd(s) 1 to deep-scrub 2024-09-17T05:54:32.801 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:32.799+0000 7fd98cd62640 1 -- 172.21.15.150:0/2739567154 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fd96807b260 msgr2=0x7fd96807d770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:54:32.801 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:32.799+0000 7fd98cd62640 1 --2- 172.21.15.150:0/2739567154 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fd96807b260 0x7fd96807d770 secure :-1 s=READY pgs=859 cs=0 l=1 rev1=1 crypto rx=0x7fd980007fd0 tx=0x7fd980007ea0 comp rx=0 tx=0).stop 2024-09-17T05:54:32.801 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:32.799+0000 7fd98cd62640 1 -- 172.21.15.150:0/2739567154 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd9880c5b90 msgr2=0x7fd98815a500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:54:32.801 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:32.799+0000 7fd98cd62640 1 --2- 172.21.15.150:0/2739567154 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd9880c5b90 0x7fd98815a500 secure :-1 s=READY pgs=2024 cs=0 l=1 rev1=1 crypto rx=0x7fd97c00ec80 tx=0x7fd97c00c6a0 comp rx=0 tx=0).stop 2024-09-17T05:54:32.801 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:32.800+0000 7fd98cd62640 1 -- 172.21.15.150:0/2739567154 shutdown_connections 2024-09-17T05:54:32.801 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:32.800+0000 7fd98cd62640 1 --2- 172.21.15.150:0/2739567154 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fd96807b260 0x7fd96807d770 unknown :-1 s=CLOSED pgs=859 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:54:32.801 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:32.800+0000 7fd98cd62640 1 --2- 172.21.15.150:0/2739567154 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd9880cd650 0x7fd98815aa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:54:32.801 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:32.800+0000 7fd98cd62640 1 --2- 172.21.15.150:0/2739567154 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd9880c5b90 0x7fd98815a500 unknown :-1 s=CLOSED pgs=2024 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:54:32.801 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:32.800+0000 7fd98cd62640 1 --2- 172.21.15.150:0/2739567154 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd98809ba60 0x7fd98815bd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:54:32.801 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:32.800+0000 7fd98cd62640 1 -- 172.21.15.150:0/2739567154 >> 172.21.15.150:0/2739567154 conn(0x7fd9880cef80 msgr2=0x7fd9880cc280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:54:32.801 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:32.800+0000 7fd98cd62640 1 -- 172.21.15.150:0/2739567154 shutdown_connections 2024-09-17T05:54:32.801 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:32.800+0000 7fd98cd62640 1 -- 172.21.15.150:0/2739567154 wait complete. 2024-09-17T05:54:32.816 INFO:tasks.ceph:Scrubbing osd.2 2024-09-17T05:54:32.816 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2024-09-17T05:54:32.935 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:32.934+0000 7fb18beb6640 1 -- 172.21.15.150:0/2237800458 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb1840b2770 msgr2=0x7fb1840b2b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:54:32.935 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:32.934+0000 7fb18beb6640 1 --2- 172.21.15.150:0/2237800458 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb1840b2770 0x7fb1840b2b80 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7fb174005fd0 tx=0x7fb17402a9d0 comp rx=0 tx=0).stop 2024-09-17T05:54:32.935 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:32.934+0000 7fb18beb6640 1 -- 172.21.15.150:0/2237800458 shutdown_connections 2024-09-17T05:54:32.935 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:32.934+0000 7fb18beb6640 1 --2- 172.21.15.150:0/2237800458 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb1840b2770 0x7fb1840b2b80 unknown :-1 s=CLOSED pgs=679 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:54:32.935 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:32.934+0000 7fb18beb6640 1 -- 172.21.15.150:0/2237800458 >> 172.21.15.150:0/2237800458 conn(0x7fb1840cef00 msgr2=0x7fb1840cf310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:54:32.936 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:32.934+0000 7fb18beb6640 1 -- 172.21.15.150:0/2237800458 shutdown_connections 2024-09-17T05:54:32.936 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:32.934+0000 7fb18beb6640 1 -- 172.21.15.150:0/2237800458 wait complete. 2024-09-17T05:54:32.936 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:32.936+0000 7fb18beb6640 1 Processor -- start 2024-09-17T05:54:32.936 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:32.936+0000 7fb18beb6640 1 -- start start 2024-09-17T05:54:32.939 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:32.937+0000 7fb18beb6640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb1840b1c50 0x7fb1841584a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:54:32.939 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:32.937+0000 7fb18beb6640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb1840b2770 0x7fb1841f4110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:54:32.939 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:32.937+0000 7fb18beb6640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb1840c5b10 0x7fb18415eaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:54:32.940 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:32.937+0000 7fb18beb6640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7fb18409bde0 con 0x7fb1840c5b10 2024-09-17T05:54:32.940 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:32.937+0000 7fb18beb6640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fb18409bc60 con 0x7fb1840b2770 2024-09-17T05:54:32.940 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:32.937+0000 7fb18beb6640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fb184168160 con 0x7fb1840b1c50 2024-09-17T05:54:32.940 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:32.937+0000 7fb18a453640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb1840c5b10 0x7fb18415eaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:54:32.940 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:32.937+0000 7fb18a453640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb1840c5b10 0x7fb18415eaf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:38914/0 (socket says 172.21.15.150:38914) 2024-09-17T05:54:32.940 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:32.937+0000 7fb18a453640 1 -- 172.21.15.150:0/3835503864 learned_addr learned my addr 172.21.15.150:0/3835503864 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:54:32.940 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:32.937+0000 7fb189451640 1 --2- 172.21.15.150:0/3835503864 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb1840b2770 0x7fb1841f4110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:54:32.940 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:32.937+0000 7fb189c52640 1 --2- 172.21.15.150:0/3835503864 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb1840b1c50 0x7fb1841584a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:54:32.940 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:32.937+0000 7fb18a453640 1 -- 172.21.15.150:0/3835503864 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb1840b1c50 msgr2=0x7fb1841584a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:54:32.940 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:32.938+0000 7fb18a453640 1 --2- 172.21.15.150:0/3835503864 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb1840b1c50 0x7fb1841584a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:54:32.940 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:32.938+0000 7fb18a453640 1 -- 172.21.15.150:0/3835503864 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb1840b2770 msgr2=0x7fb1841f4110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:54:32.940 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:32.938+0000 7fb18a453640 1 --2- 172.21.15.150:0/3835503864 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb1840b2770 0x7fb1841f4110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:54:32.941 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:32.938+0000 7fb18a453640 1 -- 172.21.15.150:0/3835503864 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb18415c930 con 0x7fb1840c5b10 2024-09-17T05:54:32.941 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:32.938+0000 7fb189451640 1 --2- 172.21.15.150:0/3835503864 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb1840b2770 0x7fb1841f4110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T05:54:32.941 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:32.938+0000 7fb18a453640 1 --2- 172.21.15.150:0/3835503864 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb1840c5b10 0x7fb18415eaf0 secure :-1 s=READY pgs=2026 cs=0 l=1 rev1=1 crypto rx=0x7fb174009cd0 tx=0x7fb174031df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:54:32.941 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:32.938+0000 7fb1827fc640 1 -- 172.21.15.150:0/3835503864 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb174045070 con 0x7fb1840c5b10 2024-09-17T05:54:32.941 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:32.938+0000 7fb18beb6640 1 -- 172.21.15.150:0/3835503864 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb1841f4650 con 0x7fb1840c5b10 2024-09-17T05:54:32.941 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:32.938+0000 7fb1827fc640 1 -- 172.21.15.150:0/3835503864 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb17402fd30 con 0x7fb1840c5b10 2024-09-17T05:54:32.941 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:32.938+0000 7fb1827fc640 1 -- 172.21.15.150:0/3835503864 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb174003bd0 con 0x7fb1840c5b10 2024-09-17T05:54:32.941 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:32.938+0000 7fb18beb6640 1 -- 172.21.15.150:0/3835503864 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb18415ceb0 con 0x7fb1840c5b10 2024-09-17T05:54:32.941 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:32.939+0000 7fb18beb6640 1 -- 172.21.15.150:0/3835503864 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fb1840d2020 con 0x7fb1840c5b10 2024-09-17T05:54:32.943 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:32.940+0000 7fb1827fc640 1 -- 172.21.15.150:0/3835503864 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 51) ==== 104960+0+0 (secure 0 0 0) 0x7fb174048070 con 0x7fb1840c5b10 2024-09-17T05:54:32.943 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:32.940+0000 7fb1827fc640 1 --2- 172.21.15.150:0/3835503864 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fb17007b260 0x7fb17007d770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:54:32.943 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:32.940+0000 7fb1827fc640 1 -- 172.21.15.150:0/3835503864 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(147..147 src has 1..147) ==== 5167+0+0 (secure 0 0 0) 0x7fb1740bb090 con 0x7fb1840c5b10 2024-09-17T05:54:32.943 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:32.941+0000 7fb1827fc640 1 --2- 172.21.15.150:0/3835503864 >> [v2:172.21.15.150:6816/363718461,v1:172.21.15.150:6817/363718461] conn(0x7fb170081410 0x7fb170083900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:54:32.943 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:32.941+0000 7fb1827fc640 1 -- 172.21.15.150:0/3835503864 --> [v2:172.21.15.150:6816/363718461,v1:172.21.15.150:6817/363718461] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fb17402f8b0 con 0x7fb170081410 2024-09-17T05:54:32.943 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:32.941+0000 7fb1827fc640 1 -- 172.21.15.150:0/3835503864 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_get_version_reply(handle=1 version=147) ==== 24+0+0 (secure 0 0 0) 0x7fb1740bb7c0 con 0x7fb1840c5b10 2024-09-17T05:54:32.943 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:32.941+0000 7fb189c52640 1 --2- 172.21.15.150:0/3835503864 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fb17007b260 0x7fb17007d770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:54:32.943 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:32.941+0000 7fb189451640 1 --2- 172.21.15.150:0/3835503864 >> [v2:172.21.15.150:6816/363718461,v1:172.21.15.150:6817/363718461] conn(0x7fb170081410 0x7fb170083900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:54:32.943 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:32.941+0000 7fb189451640 1 --2- 172.21.15.150:0/3835503864 >> [v2:172.21.15.150:6816/363718461,v1:172.21.15.150:6817/363718461] conn(0x7fb170081410 0x7fb170083900 crc :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:54:32.944 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:32.941+0000 7fb189c52640 1 --2- 172.21.15.150:0/3835503864 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fb17007b260 0x7fb17007d770 secure :-1 s=READY pgs=860 cs=0 l=1 rev1=1 crypto rx=0x7fb17c001580 tx=0x7fb17c009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:54:32.944 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:32.942+0000 7fb1827fc640 1 -- 172.21.15.150:0/3835503864 <== osd.2 v2:172.21.15.150:6816/363718461 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fb17402f8b0 con 0x7fb170081410 2024-09-17T05:54:32.955 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:32.954+0000 7fb18beb6640 1 -- 172.21.15.150:0/3835503864 --> [v2:172.21.15.150:6816/363718461,v1:172.21.15.150:6817/363718461] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7fb1840b2b80 con 0x7fb170081410 2024-09-17T05:54:32.955 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:32.955+0000 7fb1827fc640 1 -- 172.21.15.150:0/3835503864 <== osd.2 v2:172.21.15.150:6816/363718461 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7fb1840b2b80 con 0x7fb170081410 2024-09-17T05:54:32.956 INFO:teuthology.orchestra.run.smithi150.stdout:{ 2024-09-17T05:54:32.956 INFO:teuthology.orchestra.run.smithi150.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-17T05:54:32.956 INFO:teuthology.orchestra.run.smithi150.stdout:} 2024-09-17T05:54:32.957 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:32.955+0000 7fb18beb6640 1 -- 172.21.15.150:0/3835503864 >> [v2:172.21.15.150:6816/363718461,v1:172.21.15.150:6817/363718461] conn(0x7fb170081410 msgr2=0x7fb170083900 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:54:32.957 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:32.955+0000 7fb18beb6640 1 --2- 172.21.15.150:0/3835503864 >> [v2:172.21.15.150:6816/363718461,v1:172.21.15.150:6817/363718461] conn(0x7fb170081410 0x7fb170083900 crc :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:54:32.957 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:32.955+0000 7fb18beb6640 1 -- 172.21.15.150:0/3835503864 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fb17007b260 msgr2=0x7fb17007d770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:54:32.957 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:32.955+0000 7fb18beb6640 1 --2- 172.21.15.150:0/3835503864 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fb17007b260 0x7fb17007d770 secure :-1 s=READY pgs=860 cs=0 l=1 rev1=1 crypto rx=0x7fb17c001580 tx=0x7fb17c009040 comp rx=0 tx=0).stop 2024-09-17T05:54:32.958 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:32.955+0000 7fb18beb6640 1 -- 172.21.15.150:0/3835503864 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb1840c5b10 msgr2=0x7fb18415eaf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:54:32.958 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:32.955+0000 7fb18beb6640 1 --2- 172.21.15.150:0/3835503864 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb1840c5b10 0x7fb18415eaf0 secure :-1 s=READY pgs=2026 cs=0 l=1 rev1=1 crypto rx=0x7fb174009cd0 tx=0x7fb174031df0 comp rx=0 tx=0).stop 2024-09-17T05:54:32.958 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:32.955+0000 7fb18a453640 1 -- 172.21.15.150:0/3835503864 reap_dead start 2024-09-17T05:54:32.958 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:32.955+0000 7fb18beb6640 1 -- 172.21.15.150:0/3835503864 shutdown_connections 2024-09-17T05:54:32.958 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:32.955+0000 7fb18beb6640 1 -- 172.21.15.150:0/3835503864 >> 172.21.15.150:0/3835503864 conn(0x7fb1840cef00 msgr2=0x7fb1840d0230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:54:32.958 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:32.955+0000 7fb18beb6640 1 -- 172.21.15.150:0/3835503864 shutdown_connections 2024-09-17T05:54:32.958 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:32.955+0000 7fb18beb6640 1 -- 172.21.15.150:0/3835503864 wait complete. 2024-09-17T05:54:32.967 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2024-09-17T05:54:33.083 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:33.082+0000 7f1401f20640 1 -- 172.21.15.150:0/1994254241 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f13fc0b6530 msgr2=0x7f13fc0cdc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:54:33.083 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:33.082+0000 7f1401f20640 1 --2- 172.21.15.150:0/1994254241 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f13fc0b6530 0x7f13fc0cdc10 secure :-1 s=READY pgs=2028 cs=0 l=1 rev1=1 crypto rx=0x7f13ec009830 tx=0x7f13ec02a4d0 comp rx=0 tx=0).stop 2024-09-17T05:54:33.083 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:33.082+0000 7f1401f20640 1 -- 172.21.15.150:0/1994254241 shutdown_connections 2024-09-17T05:54:33.083 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:33.082+0000 7f1401f20640 1 --2- 172.21.15.150:0/1994254241 >> v2:172.21.15.176:3300/0 conn(0x7f13fc0b43e0 0x7f13fc0b47f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:54:33.083 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:33.082+0000 7f1401f20640 1 --2- 172.21.15.150:0/1994254241 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f13fc0b6530 0x7f13fc0cdc10 unknown :-1 s=CLOSED pgs=2028 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:54:33.083 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:33.082+0000 7f1401f20640 1 -- 172.21.15.150:0/1994254241 >> 172.21.15.150:0/1994254241 conn(0x7f13fc0b2ef0 msgr2=0x7f13fc0b3300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:54:33.083 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:33.082+0000 7f1401f20640 1 -- 172.21.15.150:0/1994254241 shutdown_connections 2024-09-17T05:54:33.083 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:33.082+0000 7f1401f20640 1 -- 172.21.15.150:0/1994254241 wait complete. 2024-09-17T05:54:33.084 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:33.084+0000 7f1401f20640 1 Processor -- start 2024-09-17T05:54:33.084 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:33.084+0000 7f1401f20640 1 -- start start 2024-09-17T05:54:33.087 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:33.085+0000 7f1401f20640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f13fc0b43e0 0x7f13fc1d8490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:54:33.088 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:33.085+0000 7f1401f20640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f13fc0b6530 0x7f13fc0ca3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:54:33.088 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:33.085+0000 7f1401f20640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f13fc0ce150 0x7f13fc06cda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:54:33.088 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:33.085+0000 7f1401f20640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f13fc0b5200 con 0x7f13fc0b6530 2024-09-17T05:54:33.088 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:33.085+0000 7f1401f20640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f13fc0b5080 con 0x7f13fc0b43e0 2024-09-17T05:54:33.088 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:33.085+0000 7f1401f20640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f13fc0b5380 con 0x7f13fc0ce150 2024-09-17T05:54:33.088 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:33.085+0000 7f13faffd640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f13fc0b6530 0x7f13fc0ca3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:54:33.088 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:33.085+0000 7f13faffd640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f13fc0b6530 0x7f13fc0ca3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:38940/0 (socket says 172.21.15.150:38940) 2024-09-17T05:54:33.088 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:33.085+0000 7f13faffd640 1 -- 172.21.15.150:0/2893519386 learned_addr learned my addr 172.21.15.150:0/2893519386 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:54:33.088 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:33.085+0000 7f13fb7fe640 1 --2- 172.21.15.150:0/2893519386 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f13fc0b43e0 0x7f13fc1d8490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:54:33.088 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:33.085+0000 7f13fbfff640 1 --2- 172.21.15.150:0/2893519386 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f13fc0ce150 0x7f13fc06cda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:54:33.088 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:33.086+0000 7f13faffd640 1 -- 172.21.15.150:0/2893519386 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f13fc0ce150 msgr2=0x7f13fc06cda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:54:33.088 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:33.086+0000 7f13faffd640 1 --2- 172.21.15.150:0/2893519386 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f13fc0ce150 0x7f13fc06cda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:54:33.089 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:33.086+0000 7f13faffd640 1 -- 172.21.15.150:0/2893519386 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f13fc0b43e0 msgr2=0x7f13fc1d8490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:54:33.089 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:33.086+0000 7f13faffd640 1 --2- 172.21.15.150:0/2893519386 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f13fc0b43e0 0x7f13fc1d8490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:54:33.089 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:33.086+0000 7f13faffd640 1 -- 172.21.15.150:0/2893519386 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f13fc1f9250 con 0x7f13fc0b6530 2024-09-17T05:54:33.089 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:33.086+0000 7f13faffd640 1 --2- 172.21.15.150:0/2893519386 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f13fc0b6530 0x7f13fc0ca3e0 secure :-1 s=READY pgs=2029 cs=0 l=1 rev1=1 crypto rx=0x7f13f000c730 tx=0x7f13f000cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:54:33.089 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:33.086+0000 7f13e3fff640 1 -- 172.21.15.150:0/2893519386 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13f0017070 con 0x7f13fc0b6530 2024-09-17T05:54:33.089 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:33.086+0000 7f13e3fff640 1 -- 172.21.15.150:0/2893519386 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f13f000ce40 con 0x7f13fc0b6530 2024-09-17T05:54:33.089 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:33.086+0000 7f1401f20640 1 -- 172.21.15.150:0/2893519386 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f13fc1f94c0 con 0x7f13fc0b6530 2024-09-17T05:54:33.089 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:33.086+0000 7f13e3fff640 1 -- 172.21.15.150:0/2893519386 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13f00052b0 con 0x7f13fc0b6530 2024-09-17T05:54:33.089 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:33.086+0000 7f1401f20640 1 -- 172.21.15.150:0/2893519386 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f13fc1f9a80 con 0x7f13fc0b6530 2024-09-17T05:54:33.089 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:33.087+0000 7f1401f20640 1 -- 172.21.15.150:0/2893519386 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f13fc0b47f0 con 0x7f13fc0b6530 2024-09-17T05:54:33.090 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:33.088+0000 7f13e3fff640 1 -- 172.21.15.150:0/2893519386 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 51) ==== 104960+0+0 (secure 0 0 0) 0x7f13f001a070 con 0x7f13fc0b6530 2024-09-17T05:54:33.090 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:33.088+0000 7f13e3fff640 1 --2- 172.21.15.150:0/2893519386 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f13e807b260 0x7f13e807d770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:54:33.090 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:33.089+0000 7f13e3fff640 1 -- 172.21.15.150:0/2893519386 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(147..147 src has 1..147) ==== 5167+0+0 (secure 0 0 0) 0x7f13f0099a00 con 0x7f13fc0b6530 2024-09-17T05:54:33.090 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:33.089+0000 7f13fb7fe640 1 --2- 172.21.15.150:0/2893519386 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f13e807b260 0x7f13e807d770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:54:33.090 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:33.089+0000 7f13fb7fe640 1 --2- 172.21.15.150:0/2893519386 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f13e807b260 0x7f13e807d770 secure :-1 s=READY pgs=861 cs=0 l=1 rev1=1 crypto rx=0x7f13ec034000 tx=0x7f13ec004730 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:54:33.097 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:33.096+0000 7f13e3fff640 1 -- 172.21.15.150:0/2893519386 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f13f0021020 con 0x7f13fc0b6530 2024-09-17T05:54:33.278 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:33.277+0000 7f1401f20640 1 -- 172.21.15.150:0/2893519386 --> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "2", "target": ["mon-mgr", ""]}) -- 0x7f13fc0c4a70 con 0x7f13e807b260 2024-09-17T05:54:33.278 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:33.277+0000 7f13e3fff640 1 -- 172.21.15.150:0/2893519386 <== mgr.4108 v2:172.21.15.176:6800/3631216395 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 2 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f13ec004340 con 0x7f13e807b260 2024-09-17T05:54:33.278 INFO:teuthology.orchestra.run.smithi150.stderr:instructed osd(s) 2 to deep-scrub 2024-09-17T05:54:33.281 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:33.279+0000 7f1401f20640 1 -- 172.21.15.150:0/2893519386 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f13e807b260 msgr2=0x7f13e807d770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:54:33.281 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:33.279+0000 7f1401f20640 1 --2- 172.21.15.150:0/2893519386 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f13e807b260 0x7f13e807d770 secure :-1 s=READY pgs=861 cs=0 l=1 rev1=1 crypto rx=0x7f13ec034000 tx=0x7f13ec004730 comp rx=0 tx=0).stop 2024-09-17T05:54:33.281 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:33.279+0000 7f1401f20640 1 -- 172.21.15.150:0/2893519386 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f13fc0b6530 msgr2=0x7f13fc0ca3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:54:33.281 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:33.279+0000 7f1401f20640 1 --2- 172.21.15.150:0/2893519386 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f13fc0b6530 0x7f13fc0ca3e0 secure :-1 s=READY pgs=2029 cs=0 l=1 rev1=1 crypto rx=0x7f13f000c730 tx=0x7f13f000cbf0 comp rx=0 tx=0).stop 2024-09-17T05:54:33.282 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:33.279+0000 7f1401f20640 1 -- 172.21.15.150:0/2893519386 shutdown_connections 2024-09-17T05:54:33.282 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:33.279+0000 7f1401f20640 1 --2- 172.21.15.150:0/2893519386 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f13e807b260 0x7f13e807d770 unknown :-1 s=CLOSED pgs=861 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:54:33.282 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:33.279+0000 7f1401f20640 1 --2- 172.21.15.150:0/2893519386 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f13fc0ce150 0x7f13fc06cda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:54:33.282 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:33.279+0000 7f1401f20640 1 --2- 172.21.15.150:0/2893519386 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f13fc0b6530 0x7f13fc0ca3e0 unknown :-1 s=CLOSED pgs=2029 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:54:33.282 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:33.279+0000 7f1401f20640 1 --2- 172.21.15.150:0/2893519386 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f13fc0b43e0 0x7f13fc1d8490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:54:33.282 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:33.280+0000 7f1401f20640 1 -- 172.21.15.150:0/2893519386 >> 172.21.15.150:0/2893519386 conn(0x7f13fc0b2ef0 msgr2=0x7f13fc09de70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:54:33.282 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:33.280+0000 7f1401f20640 1 -- 172.21.15.150:0/2893519386 shutdown_connections 2024-09-17T05:54:33.282 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:33.280+0000 7f1401f20640 1 -- 172.21.15.150:0/2893519386 wait complete. 2024-09-17T05:54:33.292 INFO:tasks.ceph:Scrubbing osd.3 2024-09-17T05:54:33.292 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2024-09-17T05:54:33.409 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:33.408+0000 7fc07100a640 1 -- 172.21.15.150:0/2898074295 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc06c0d0d20 msgr2=0x7fc06c0d1130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:54:33.409 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:33.408+0000 7fc07100a640 1 --2- 172.21.15.150:0/2898074295 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc06c0d0d20 0x7fc06c0d1130 secure :-1 s=READY pgs=2030 cs=0 l=1 rev1=1 crypto rx=0x7fc06c0d3990 tx=0x7fc05c02a5f0 comp rx=0 tx=0).stop 2024-09-17T05:54:33.409 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:33.408+0000 7fc07100a640 1 -- 172.21.15.150:0/2898074295 shutdown_connections 2024-09-17T05:54:33.409 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:33.408+0000 7fc07100a640 1 --2- 172.21.15.150:0/2898074295 >> v2:172.21.15.176:3300/0 conn(0x7fc06c0d0310 0x7fc06c06eaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:54:33.410 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:33.408+0000 7fc07100a640 1 --2- 172.21.15.150:0/2898074295 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc06c0d0d20 0x7fc06c0d1130 unknown :-1 s=CLOSED pgs=2030 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:54:33.410 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:33.408+0000 7fc07100a640 1 -- 172.21.15.150:0/2898074295 >> 172.21.15.150:0/2898074295 conn(0x7fc06c0d46f0 msgr2=0x7fc06c0d4b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:54:33.410 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:33.408+0000 7fc07100a640 1 -- 172.21.15.150:0/2898074295 shutdown_connections 2024-09-17T05:54:33.410 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:33.408+0000 7fc07100a640 1 -- 172.21.15.150:0/2898074295 wait complete. 2024-09-17T05:54:33.411 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:33.410+0000 7fc07100a640 1 Processor -- start 2024-09-17T05:54:33.411 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:33.410+0000 7fc07100a640 1 -- start start 2024-09-17T05:54:33.414 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:33.412+0000 7fc07100a640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc06c0d0310 0x7fc06c15f7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:54:33.414 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:33.412+0000 7fc07100a640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc06c0d0d20 0x7fc06c1589a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:54:33.414 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:33.412+0000 7fc07100a640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc06c0d1670 0x7fc06c0b88d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:54:33.414 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:33.412+0000 7fc07100a640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7fc06c0ba200 con 0x7fc06c0d0d20 2024-09-17T05:54:33.414 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:33.412+0000 7fc07100a640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fc06c0ba080 con 0x7fc06c0d0310 2024-09-17T05:54:33.414 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:33.412+0000 7fc07100a640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fc06c06efe0 con 0x7fc06c0d1670 2024-09-17T05:54:33.414 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:33.412+0000 7fc06a59c640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc06c0d0d20 0x7fc06c1589a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:54:33.414 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:33.412+0000 7fc06ad9d640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc06c0d0310 0x7fc06c15f7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:54:33.414 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:33.412+0000 7fc06a59c640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc06c0d0d20 0x7fc06c1589a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:38960/0 (socket says 172.21.15.150:38960) 2024-09-17T05:54:33.414 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:33.412+0000 7fc06a59c640 1 -- 172.21.15.150:0/4047978415 learned_addr learned my addr 172.21.15.150:0/4047978415 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:54:33.414 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:33.412+0000 7fc06b59e640 1 --2- 172.21.15.150:0/4047978415 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc06c0d1670 0x7fc06c0b88d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:54:33.414 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:33.412+0000 7fc06a59c640 1 -- 172.21.15.150:0/4047978415 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc06c0d1670 msgr2=0x7fc06c0b88d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:54:33.415 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:33.412+0000 7fc06a59c640 1 --2- 172.21.15.150:0/4047978415 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc06c0d1670 0x7fc06c0b88d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:54:33.415 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:33.412+0000 7fc06a59c640 1 -- 172.21.15.150:0/4047978415 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc06c0d0310 msgr2=0x7fc06c15f7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:54:33.415 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:33.412+0000 7fc06a59c640 1 --2- 172.21.15.150:0/4047978415 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc06c0d0310 0x7fc06c15f7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:54:33.415 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:33.412+0000 7fc06a59c640 1 -- 172.21.15.150:0/4047978415 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc06c15fcf0 con 0x7fc06c0d0d20 2024-09-17T05:54:33.415 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:33.412+0000 7fc06a59c640 1 --2- 172.21.15.150:0/4047978415 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc06c0d0d20 0x7fc06c1589a0 secure :-1 s=READY pgs=2031 cs=0 l=1 rev1=1 crypto rx=0x7fc06000c390 tx=0x7fc06000c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:54:33.415 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:33.412+0000 7fc0537fe640 1 -- 172.21.15.150:0/4047978415 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc060017070 con 0x7fc06c0d0d20 2024-09-17T05:54:33.415 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:33.413+0000 7fc0537fe640 1 -- 172.21.15.150:0/4047978415 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc0600053c0 con 0x7fc06c0d0d20 2024-09-17T05:54:33.415 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:33.413+0000 7fc0537fe640 1 -- 172.21.15.150:0/4047978415 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc060003880 con 0x7fc06c0d0d20 2024-09-17T05:54:33.415 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:33.413+0000 7fc07100a640 1 -- 172.21.15.150:0/4047978415 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc06c1f8fa0 con 0x7fc06c0d0d20 2024-09-17T05:54:33.415 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:33.413+0000 7fc07100a640 1 -- 172.21.15.150:0/4047978415 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc06c1f9560 con 0x7fc06c0d0d20 2024-09-17T05:54:33.416 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:33.414+0000 7fc07100a640 1 -- 172.21.15.150:0/4047978415 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fc06c06f490 con 0x7fc06c0d0d20 2024-09-17T05:54:33.417 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:33.414+0000 7fc0537fe640 1 -- 172.21.15.150:0/4047978415 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 51) ==== 104960+0+0 (secure 0 0 0) 0x7fc06001a070 con 0x7fc06c0d0d20 2024-09-17T05:54:33.417 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:33.415+0000 7fc0537fe640 1 --2- 172.21.15.150:0/4047978415 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fc05807b290 0x7fc05807d7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:54:33.417 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:33.415+0000 7fc0537fe640 1 -- 172.21.15.150:0/4047978415 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(147..147 src has 1..147) ==== 5167+0+0 (secure 0 0 0) 0x7fc060099260 con 0x7fc06c0d0d20 2024-09-17T05:54:33.417 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:33.415+0000 7fc06ad9d640 1 --2- 172.21.15.150:0/4047978415 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fc05807b290 0x7fc05807d7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:54:33.417 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:33.415+0000 7fc0537fe640 1 --2- 172.21.15.150:0/4047978415 >> [v2:172.21.15.150:6808/3550994626,v1:172.21.15.150:6809/3550994626] conn(0x7fc058081440 0x7fc058083930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:54:33.417 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:33.415+0000 7fc0537fe640 1 -- 172.21.15.150:0/4047978415 --> [v2:172.21.15.150:6808/3550994626,v1:172.21.15.150:6809/3550994626] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fc058084000 con 0x7fc058081440 2024-09-17T05:54:33.417 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:33.415+0000 7fc0537fe640 1 -- 172.21.15.150:0/4047978415 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_get_version_reply(handle=1 version=147) ==== 24+0+0 (secure 0 0 0) 0x7fc0600a5050 con 0x7fc06c0d0d20 2024-09-17T05:54:33.417 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:33.415+0000 7fc06b59e640 1 --2- 172.21.15.150:0/4047978415 >> [v2:172.21.15.150:6808/3550994626,v1:172.21.15.150:6809/3550994626] conn(0x7fc058081440 0x7fc058083930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:54:33.417 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:33.416+0000 7fc06b59e640 1 --2- 172.21.15.150:0/4047978415 >> [v2:172.21.15.150:6808/3550994626,v1:172.21.15.150:6809/3550994626] conn(0x7fc058081440 0x7fc058083930 crc :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:54:33.417 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:33.416+0000 7fc06ad9d640 1 --2- 172.21.15.150:0/4047978415 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fc05807b290 0x7fc05807d7a0 secure :-1 s=READY pgs=862 cs=0 l=1 rev1=1 crypto rx=0x7fc05c033000 tx=0x7fc05c004730 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:54:33.418 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:33.416+0000 7fc0537fe640 1 -- 172.21.15.150:0/4047978415 <== osd.3 v2:172.21.15.150:6808/3550994626 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fc058084000 con 0x7fc058081440 2024-09-17T05:54:33.429 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:33.429+0000 7fc07100a640 1 -- 172.21.15.150:0/4047978415 --> [v2:172.21.15.150:6808/3550994626,v1:172.21.15.150:6809/3550994626] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7fc06c1f8d10 con 0x7fc058081440 2024-09-17T05:54:33.429 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:33.429+0000 7fc0537fe640 1 -- 172.21.15.150:0/4047978415 <== osd.3 v2:172.21.15.150:6808/3550994626 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7fc06c1f8d10 con 0x7fc058081440 2024-09-17T05:54:33.430 INFO:teuthology.orchestra.run.smithi150.stdout:{ 2024-09-17T05:54:33.430 INFO:teuthology.orchestra.run.smithi150.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-17T05:54:33.430 INFO:teuthology.orchestra.run.smithi150.stdout:} 2024-09-17T05:54:33.431 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:33.429+0000 7fc07100a640 1 -- 172.21.15.150:0/4047978415 >> [v2:172.21.15.150:6808/3550994626,v1:172.21.15.150:6809/3550994626] conn(0x7fc058081440 msgr2=0x7fc058083930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:54:33.431 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:33.429+0000 7fc07100a640 1 --2- 172.21.15.150:0/4047978415 >> [v2:172.21.15.150:6808/3550994626,v1:172.21.15.150:6809/3550994626] conn(0x7fc058081440 0x7fc058083930 crc :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:54:33.431 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:33.429+0000 7fc07100a640 1 -- 172.21.15.150:0/4047978415 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fc05807b290 msgr2=0x7fc05807d7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:54:33.431 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:33.429+0000 7fc07100a640 1 --2- 172.21.15.150:0/4047978415 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fc05807b290 0x7fc05807d7a0 secure :-1 s=READY pgs=862 cs=0 l=1 rev1=1 crypto rx=0x7fc05c033000 tx=0x7fc05c004730 comp rx=0 tx=0).stop 2024-09-17T05:54:33.431 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:33.429+0000 7fc07100a640 1 -- 172.21.15.150:0/4047978415 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc06c0d0d20 msgr2=0x7fc06c1589a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:54:33.431 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:33.429+0000 7fc07100a640 1 --2- 172.21.15.150:0/4047978415 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc06c0d0d20 0x7fc06c1589a0 secure :-1 s=READY pgs=2031 cs=0 l=1 rev1=1 crypto rx=0x7fc06000c390 tx=0x7fc06000c850 comp rx=0 tx=0).stop 2024-09-17T05:54:33.431 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:33.429+0000 7fc06b59e640 1 -- 172.21.15.150:0/4047978415 reap_dead start 2024-09-17T05:54:33.432 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:33.429+0000 7fc07100a640 1 -- 172.21.15.150:0/4047978415 shutdown_connections 2024-09-17T05:54:33.432 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:33.429+0000 7fc07100a640 1 -- 172.21.15.150:0/4047978415 >> 172.21.15.150:0/4047978415 conn(0x7fc06c0d46f0 msgr2=0x7fc06c0ce3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:54:33.432 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:33.429+0000 7fc07100a640 1 -- 172.21.15.150:0/4047978415 shutdown_connections 2024-09-17T05:54:33.432 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:33.429+0000 7fc07100a640 1 -- 172.21.15.150:0/4047978415 wait complete. 2024-09-17T05:54:33.441 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2024-09-17T05:54:33.556 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:33.555+0000 7ffb6de07640 1 -- 172.21.15.150:0/1385707243 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ffb680d15d0 msgr2=0x7ffb680cf470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:54:33.556 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:33.555+0000 7ffb6de07640 1 --2- 172.21.15.150:0/1385707243 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ffb680d15d0 0x7ffb680cf470 secure :-1 s=READY pgs=2032 cs=0 l=1 rev1=1 crypto rx=0x7ffb60005fd0 tx=0x7ffb6002aa10 comp rx=0 tx=0).stop 2024-09-17T05:54:33.556 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:33.555+0000 7ffb6de07640 1 -- 172.21.15.150:0/1385707243 shutdown_connections 2024-09-17T05:54:33.556 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:33.555+0000 7ffb6de07640 1 --2- 172.21.15.150:0/1385707243 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ffb680d15d0 0x7ffb680cf470 unknown :-1 s=CLOSED pgs=2032 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:54:33.556 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:33.555+0000 7ffb6de07640 1 --2- 172.21.15.150:0/1385707243 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ffb680b3720 0x7ffb680d1090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:54:33.556 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:33.555+0000 7ffb6de07640 1 -- 172.21.15.150:0/1385707243 >> 172.21.15.150:0/1385707243 conn(0x7ffb680d4680 msgr2=0x7ffb680d4a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:54:33.556 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:33.555+0000 7ffb6de07640 1 -- 172.21.15.150:0/1385707243 shutdown_connections 2024-09-17T05:54:33.556 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:33.555+0000 7ffb6de07640 1 -- 172.21.15.150:0/1385707243 wait complete. 2024-09-17T05:54:33.557 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:33.556+0000 7ffb6de07640 1 Processor -- start 2024-09-17T05:54:33.557 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:33.557+0000 7ffb6de07640 1 -- start start 2024-09-17T05:54:33.560 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:33.558+0000 7ffb6de07640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ffb680b3720 0x7ffb681558e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:54:33.560 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:33.558+0000 7ffb6de07640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ffb680b9780 0x7ffb68160ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:54:33.560 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:33.558+0000 7ffb6de07640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ffb680d15d0 0x7ffb6806e8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:54:33.560 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:33.558+0000 7ffb6de07640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7ffb680cfd40 con 0x7ffb680b9780 2024-09-17T05:54:33.560 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:33.558+0000 7ffb6de07640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7ffb680cfbc0 con 0x7ffb680d15d0 2024-09-17T05:54:33.560 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:33.558+0000 7ffb6de07640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7ffb680cfec0 con 0x7ffb680b3720 2024-09-17T05:54:33.561 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:33.558+0000 7ffb66ffd640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ffb680b9780 0x7ffb68160ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:54:33.561 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:33.558+0000 7ffb66ffd640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ffb680b9780 0x7ffb68160ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:38978/0 (socket says 172.21.15.150:38978) 2024-09-17T05:54:33.561 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:33.558+0000 7ffb66ffd640 1 -- 172.21.15.150:0/507947952 learned_addr learned my addr 172.21.15.150:0/507947952 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:54:33.561 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:33.558+0000 7ffb67fff640 1 --2- 172.21.15.150:0/507947952 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ffb680d15d0 0x7ffb6806e8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:54:33.561 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:33.558+0000 7ffb677fe640 1 --2- 172.21.15.150:0/507947952 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ffb680b3720 0x7ffb681558e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:54:33.561 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:33.558+0000 7ffb66ffd640 1 -- 172.21.15.150:0/507947952 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ffb680b3720 msgr2=0x7ffb681558e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:54:33.562 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:33.558+0000 7ffb66ffd640 1 --2- 172.21.15.150:0/507947952 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ffb680b3720 0x7ffb681558e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:54:33.562 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:33.558+0000 7ffb66ffd640 1 -- 172.21.15.150:0/507947952 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ffb680d15d0 msgr2=0x7ffb6806e8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:54:33.562 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:33.558+0000 7ffb66ffd640 1 --2- 172.21.15.150:0/507947952 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ffb680d15d0 0x7ffb6806e8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:54:33.562 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:33.558+0000 7ffb66ffd640 1 -- 172.21.15.150:0/507947952 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffb681f6bc0 con 0x7ffb680b9780 2024-09-17T05:54:33.562 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:33.559+0000 7ffb66ffd640 1 --2- 172.21.15.150:0/507947952 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ffb680b9780 0x7ffb68160ac0 secure :-1 s=READY pgs=2033 cs=0 l=1 rev1=1 crypto rx=0x7ffb5c00e7c0 tx=0x7ffb5c00ec80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:54:33.562 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:33.559+0000 7ffb4ffff640 1 -- 172.21.15.150:0/507947952 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb5c00ccc0 con 0x7ffb680b9780 2024-09-17T05:54:33.562 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:33.559+0000 7ffb4ffff640 1 -- 172.21.15.150:0/507947952 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ffb5c00ee70 con 0x7ffb680b9780 2024-09-17T05:54:33.562 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:33.559+0000 7ffb6de07640 1 -- 172.21.15.150:0/507947952 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffb681613b0 con 0x7ffb680b9780 2024-09-17T05:54:33.562 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:33.559+0000 7ffb4ffff640 1 -- 172.21.15.150:0/507947952 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb5c010690 con 0x7ffb680b9780 2024-09-17T05:54:33.562 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:33.559+0000 7ffb6de07640 1 -- 172.21.15.150:0/507947952 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffb68159920 con 0x7ffb680b9780 2024-09-17T05:54:33.562 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:33.560+0000 7ffb6de07640 1 -- 172.21.15.150:0/507947952 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffb680ceab0 con 0x7ffb680b9780 2024-09-17T05:54:33.563 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:33.561+0000 7ffb4ffff640 1 -- 172.21.15.150:0/507947952 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 51) ==== 104960+0+0 (secure 0 0 0) 0x7ffb5c010830 con 0x7ffb680b9780 2024-09-17T05:54:33.563 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:33.561+0000 7ffb4ffff640 1 --2- 172.21.15.150:0/507947952 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7ffb5407b290 0x7ffb5407d7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:54:33.564 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:33.561+0000 7ffb4ffff640 1 -- 172.21.15.150:0/507947952 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(147..147 src has 1..147) ==== 5167+0+0 (secure 0 0 0) 0x7ffb5c09a8b0 con 0x7ffb680b9780 2024-09-17T05:54:33.564 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:33.561+0000 7ffb677fe640 1 --2- 172.21.15.150:0/507947952 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7ffb5407b290 0x7ffb5407d7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:54:33.564 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:33.562+0000 7ffb677fe640 1 --2- 172.21.15.150:0/507947952 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7ffb5407b290 0x7ffb5407d7a0 secure :-1 s=READY pgs=863 cs=0 l=1 rev1=1 crypto rx=0x7ffb58007fd0 tx=0x7ffb58009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:54:33.566 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:33.565+0000 7ffb4ffff640 1 -- 172.21.15.150:0/507947952 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7ffb680ceab0 con 0x7ffb680b9780 2024-09-17T05:54:33.743 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:33.741+0000 7ffb6de07640 1 -- 172.21.15.150:0/507947952 --> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "3", "target": ["mon-mgr", ""]}) -- 0x7ffb681f6ea0 con 0x7ffb5407b290 2024-09-17T05:54:33.743 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:33.741+0000 7ffb4ffff640 1 -- 172.21.15.150:0/507947952 <== mgr.4108 v2:172.21.15.176:6800/3631216395 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 3 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7ffb58001d20 con 0x7ffb5407b290 2024-09-17T05:54:33.743 INFO:teuthology.orchestra.run.smithi150.stderr:instructed osd(s) 3 to deep-scrub 2024-09-17T05:54:33.745 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:33.744+0000 7ffb6de07640 1 -- 172.21.15.150:0/507947952 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7ffb5407b290 msgr2=0x7ffb5407d7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:54:33.745 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:33.744+0000 7ffb6de07640 1 --2- 172.21.15.150:0/507947952 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7ffb5407b290 0x7ffb5407d7a0 secure :-1 s=READY pgs=863 cs=0 l=1 rev1=1 crypto rx=0x7ffb58007fd0 tx=0x7ffb58009040 comp rx=0 tx=0).stop 2024-09-17T05:54:33.745 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:33.744+0000 7ffb6de07640 1 -- 172.21.15.150:0/507947952 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ffb680b9780 msgr2=0x7ffb68160ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:54:33.745 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:33.744+0000 7ffb6de07640 1 --2- 172.21.15.150:0/507947952 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ffb680b9780 0x7ffb68160ac0 secure :-1 s=READY pgs=2033 cs=0 l=1 rev1=1 crypto rx=0x7ffb5c00e7c0 tx=0x7ffb5c00ec80 comp rx=0 tx=0).stop 2024-09-17T05:54:33.745 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:33.744+0000 7ffb6de07640 1 -- 172.21.15.150:0/507947952 shutdown_connections 2024-09-17T05:54:33.745 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:33.744+0000 7ffb6de07640 1 --2- 172.21.15.150:0/507947952 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ffb680d15d0 0x7ffb6806e8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:54:33.745 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:33.744+0000 7ffb6de07640 1 --2- 172.21.15.150:0/507947952 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7ffb5407b290 0x7ffb5407d7a0 unknown :-1 s=CLOSED pgs=863 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:54:33.746 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:33.744+0000 7ffb6de07640 1 --2- 172.21.15.150:0/507947952 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ffb680b9780 0x7ffb68160ac0 unknown :-1 s=CLOSED pgs=2033 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:54:33.746 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:33.744+0000 7ffb6de07640 1 --2- 172.21.15.150:0/507947952 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ffb680b3720 0x7ffb681558e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:54:33.746 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:33.744+0000 7ffb6de07640 1 -- 172.21.15.150:0/507947952 >> 172.21.15.150:0/507947952 conn(0x7ffb680d4680 msgr2=0x7ffb680b74d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:54:33.746 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:33.744+0000 7ffb6de07640 1 -- 172.21.15.150:0/507947952 shutdown_connections 2024-09-17T05:54:33.746 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:33.744+0000 7ffb6de07640 1 -- 172.21.15.150:0/507947952 wait complete. 2024-09-17T05:54:33.756 INFO:tasks.ceph:Scrubbing osd.4 2024-09-17T05:54:33.756 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 config set osd_debug_deep_scrub_sleep 0 2024-09-17T05:54:33.873 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:33.872+0000 7ff4c6e69640 1 -- 172.21.15.150:0/1825709618 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff4c00af8a0 msgr2=0x7ff4c00afcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:54:33.873 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:33.872+0000 7ff4c6e69640 1 --2- 172.21.15.150:0/1825709618 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff4c00af8a0 0x7ff4c00afcb0 secure :-1 s=READY pgs=2034 cs=0 l=1 rev1=1 crypto rx=0x7ff4c00b5210 tx=0x7ff4b402a8e0 comp rx=0 tx=0).stop 2024-09-17T05:54:33.873 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:33.872+0000 7ff4c6e69640 1 -- 172.21.15.150:0/1825709618 shutdown_connections 2024-09-17T05:54:33.873 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:33.872+0000 7ff4c6e69640 1 --2- 172.21.15.150:0/1825709618 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff4c00b42f0 0x7ff4c00b4700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:54:33.873 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:33.872+0000 7ff4c6e69640 1 --2- 172.21.15.150:0/1825709618 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff4c00af8a0 0x7ff4c00afcb0 unknown :-1 s=CLOSED pgs=2034 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:54:33.873 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:33.872+0000 7ff4c6e69640 1 --2- 172.21.15.150:0/1825709618 >> v2:172.21.15.176:3300/0 conn(0x7ff4c015d190 0x7ff4c015d5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:54:33.874 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:33.872+0000 7ff4c6e69640 1 -- 172.21.15.150:0/1825709618 >> 172.21.15.150:0/1825709618 conn(0x7ff4c009aa50 msgr2=0x7ff4c00b2ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:54:33.874 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:33.872+0000 7ff4c6e69640 1 -- 172.21.15.150:0/1825709618 shutdown_connections 2024-09-17T05:54:33.874 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:33.872+0000 7ff4c6e69640 1 -- 172.21.15.150:0/1825709618 wait complete. 2024-09-17T05:54:33.874 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:33.874+0000 7ff4c6e69640 1 Processor -- start 2024-09-17T05:54:33.874 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:33.874+0000 7ff4c6e69640 1 -- start start 2024-09-17T05:54:33.877 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:33.875+0000 7ff4c6e69640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff4c00af8a0 0x7ff4c00cd750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:54:33.877 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:33.875+0000 7ff4c6e69640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff4c00b42f0 0x7ff4c00cdc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:54:33.878 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:33.875+0000 7ff4c6e69640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff4c015d190 0x7ff4c009bb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:54:33.878 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:33.875+0000 7ff4c6e69640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7ff4c015c360 con 0x7ff4c015d190 2024-09-17T05:54:33.878 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:33.875+0000 7ff4c6e69640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7ff4c015c1e0 con 0x7ff4c00af8a0 2024-09-17T05:54:33.878 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:33.875+0000 7ff4c6e69640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7ff4c015c4e0 con 0x7ff4c00b42f0 2024-09-17T05:54:33.878 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:33.875+0000 7ff4c5406640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff4c015d190 0x7ff4c009bb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:54:33.878 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:33.875+0000 7ff4c5406640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff4c015d190 0x7ff4c009bb10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:38994/0 (socket says 172.21.15.150:38994) 2024-09-17T05:54:33.878 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:33.875+0000 7ff4c5406640 1 -- 172.21.15.150:0/367250637 learned_addr learned my addr 172.21.15.150:0/367250637 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:54:33.878 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:33.875+0000 7ff4bffff640 1 --2- 172.21.15.150:0/367250637 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff4c00b42f0 0x7ff4c00cdc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:54:33.878 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:33.875+0000 7ff4c4c05640 1 --2- 172.21.15.150:0/367250637 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff4c00af8a0 0x7ff4c00cd750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:54:33.878 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:33.876+0000 7ff4c5406640 1 -- 172.21.15.150:0/367250637 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff4c00b42f0 msgr2=0x7ff4c00cdc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:54:33.879 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:33.876+0000 7ff4c5406640 1 --2- 172.21.15.150:0/367250637 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff4c00b42f0 0x7ff4c00cdc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:54:33.879 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:33.876+0000 7ff4c5406640 1 -- 172.21.15.150:0/367250637 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff4c00af8a0 msgr2=0x7ff4c00cd750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:54:33.879 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:33.876+0000 7ff4c5406640 1 --2- 172.21.15.150:0/367250637 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff4c00af8a0 0x7ff4c00cd750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:54:33.879 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:33.876+0000 7ff4c5406640 1 -- 172.21.15.150:0/367250637 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff4c01f2d50 con 0x7ff4c015d190 2024-09-17T05:54:33.879 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:33.876+0000 7ff4c5406640 1 --2- 172.21.15.150:0/367250637 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff4c015d190 0x7ff4c009bb10 secure :-1 s=READY pgs=2035 cs=0 l=1 rev1=1 crypto rx=0x7ff4b80058c0 tx=0x7ff4b800da70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:54:33.879 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:33.876+0000 7ff4bd7fa640 1 -- 172.21.15.150:0/367250637 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4b8017070 con 0x7ff4c015d190 2024-09-17T05:54:33.879 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:33.876+0000 7ff4bd7fa640 1 -- 172.21.15.150:0/367250637 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff4b8005310 con 0x7ff4c015d190 2024-09-17T05:54:33.879 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:33.876+0000 7ff4c6e69640 1 -- 172.21.15.150:0/367250637 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff4c01f3030 con 0x7ff4c015d190 2024-09-17T05:54:33.879 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:33.876+0000 7ff4bd7fa640 1 -- 172.21.15.150:0/367250637 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4b80047a0 con 0x7ff4c015d190 2024-09-17T05:54:33.879 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:33.876+0000 7ff4c6e69640 1 -- 172.21.15.150:0/367250637 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff4c009b5f0 con 0x7ff4c015d190 2024-09-17T05:54:33.879 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:33.877+0000 7ff4c6e69640 1 -- 172.21.15.150:0/367250637 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7ff4c01457d0 con 0x7ff4c015d190 2024-09-17T05:54:33.881 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:33.878+0000 7ff4bd7fa640 1 -- 172.21.15.150:0/367250637 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 51) ==== 104960+0+0 (secure 0 0 0) 0x7ff4b8004940 con 0x7ff4c015d190 2024-09-17T05:54:33.881 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:33.878+0000 7ff4bd7fa640 1 --2- 172.21.15.150:0/367250637 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7ff4ac07b260 0x7ff4ac07d770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:54:33.881 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:33.878+0000 7ff4bd7fa640 1 -- 172.21.15.150:0/367250637 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(147..147 src has 1..147) ==== 5167+0+0 (secure 0 0 0) 0x7ff4b809a4f0 con 0x7ff4c015d190 2024-09-17T05:54:33.881 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:33.878+0000 7ff4bd7fa640 1 --2- 172.21.15.150:0/367250637 >> [v2:172.21.15.176:6810/2718261497,v1:172.21.15.176:6811/2718261497] conn(0x7ff4ac081410 0x7ff4ac083900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:54:33.881 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:33.878+0000 7ff4c4c05640 1 --2- 172.21.15.150:0/367250637 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7ff4ac07b260 0x7ff4ac07d770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:54:33.881 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:33.878+0000 7ff4bd7fa640 1 -- 172.21.15.150:0/367250637 --> [v2:172.21.15.176:6810/2718261497,v1:172.21.15.176:6811/2718261497] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7ff4b8016ec0 con 0x7ff4ac081410 2024-09-17T05:54:33.881 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:33.878+0000 7ff4bd7fa640 1 -- 172.21.15.150:0/367250637 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_get_version_reply(handle=1 version=147) ==== 24+0+0 (secure 0 0 0) 0x7ff4b809ac20 con 0x7ff4c015d190 2024-09-17T05:54:33.882 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:33.879+0000 7ff4bffff640 1 --2- 172.21.15.150:0/367250637 >> [v2:172.21.15.176:6810/2718261497,v1:172.21.15.176:6811/2718261497] conn(0x7ff4ac081410 0x7ff4ac083900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:54:33.882 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:33.879+0000 7ff4c4c05640 1 --2- 172.21.15.150:0/367250637 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7ff4ac07b260 0x7ff4ac07d770 secure :-1 s=READY pgs=864 cs=0 l=1 rev1=1 crypto rx=0x7ff4b0009b30 tx=0x7ff4b0005f90 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:54:33.882 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:33.879+0000 7ff4bffff640 1 --2- 172.21.15.150:0/367250637 >> [v2:172.21.15.176:6810/2718261497,v1:172.21.15.176:6811/2718261497] conn(0x7ff4ac081410 0x7ff4ac083900 crc :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:54:33.882 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:33.880+0000 7ff4bd7fa640 1 -- 172.21.15.150:0/367250637 <== osd.4 v2:172.21.15.176:6810/2718261497 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7ff4b8016ec0 con 0x7ff4ac081410 2024-09-17T05:54:33.893 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:33.892+0000 7ff4c6e69640 1 -- 172.21.15.150:0/367250637 --> [v2:172.21.15.176:6810/2718261497,v1:172.21.15.176:6811/2718261497] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7ff4c01f2b00 con 0x7ff4ac081410 2024-09-17T05:54:33.893 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:33.893+0000 7ff4bd7fa640 1 -- 172.21.15.150:0/367250637 <== osd.4 v2:172.21.15.176:6810/2718261497 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7ff4c01f2b00 con 0x7ff4ac081410 2024-09-17T05:54:33.894 INFO:teuthology.orchestra.run.smithi150.stdout:{ 2024-09-17T05:54:33.894 INFO:teuthology.orchestra.run.smithi150.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-17T05:54:33.894 INFO:teuthology.orchestra.run.smithi150.stdout:} 2024-09-17T05:54:33.896 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:33.893+0000 7ff4c6e69640 1 -- 172.21.15.150:0/367250637 >> [v2:172.21.15.176:6810/2718261497,v1:172.21.15.176:6811/2718261497] conn(0x7ff4ac081410 msgr2=0x7ff4ac083900 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:54:33.896 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:33.893+0000 7ff4c6e69640 1 --2- 172.21.15.150:0/367250637 >> [v2:172.21.15.176:6810/2718261497,v1:172.21.15.176:6811/2718261497] conn(0x7ff4ac081410 0x7ff4ac083900 crc :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:54:33.896 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:33.893+0000 7ff4c6e69640 1 -- 172.21.15.150:0/367250637 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7ff4ac07b260 msgr2=0x7ff4ac07d770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:54:33.897 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:33.893+0000 7ff4c6e69640 1 --2- 172.21.15.150:0/367250637 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7ff4ac07b260 0x7ff4ac07d770 secure :-1 s=READY pgs=864 cs=0 l=1 rev1=1 crypto rx=0x7ff4b0009b30 tx=0x7ff4b0005f90 comp rx=0 tx=0).stop 2024-09-17T05:54:33.897 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:33.893+0000 7ff4c6e69640 1 -- 172.21.15.150:0/367250637 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff4c015d190 msgr2=0x7ff4c009bb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:54:33.897 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:33.893+0000 7ff4c6e69640 1 --2- 172.21.15.150:0/367250637 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff4c015d190 0x7ff4c009bb10 secure :-1 s=READY pgs=2035 cs=0 l=1 rev1=1 crypto rx=0x7ff4b80058c0 tx=0x7ff4b800da70 comp rx=0 tx=0).stop 2024-09-17T05:54:33.897 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:33.893+0000 7ff4c5406640 1 -- 172.21.15.150:0/367250637 reap_dead start 2024-09-17T05:54:33.897 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:33.893+0000 7ff4c6e69640 1 -- 172.21.15.150:0/367250637 shutdown_connections 2024-09-17T05:54:33.897 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:33.893+0000 7ff4c6e69640 1 -- 172.21.15.150:0/367250637 >> 172.21.15.150:0/367250637 conn(0x7ff4c009aa50 msgr2=0x7ff4c01590e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:54:33.898 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:33.894+0000 7ff4c6e69640 1 -- 172.21.15.150:0/367250637 shutdown_connections 2024-09-17T05:54:33.898 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:33.894+0000 7ff4c6e69640 1 -- 172.21.15.150:0/367250637 wait complete. 2024-09-17T05:54:33.905 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 4 2024-09-17T05:54:34.021 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:34.019+0000 7f5a07bad640 1 -- 172.21.15.150:0/954978094 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f59ec0053a0 msgr2=0x7f59ec00ba50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:54:34.022 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:34.019+0000 7f5a07bad640 1 --2- 172.21.15.150:0/954978094 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f59ec0053a0 0x7f59ec00ba50 secure :-1 s=READY pgs=2037 cs=0 l=1 rev1=1 crypto rx=0x7f59f80013d0 tx=0x7f59ec005830 comp rx=0 tx=0).stop 2024-09-17T05:54:34.022 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:34.019+0000 7f5a07bad640 1 -- 172.21.15.150:0/954978094 shutdown_connections 2024-09-17T05:54:34.022 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:34.019+0000 7f5a07bad640 1 --2- 172.21.15.150:0/954978094 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f59ec0053a0 0x7f59ec00ba50 unknown :-1 s=CLOSED pgs=2037 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:54:34.022 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:34.019+0000 7f5a07bad640 1 -- 172.21.15.150:0/954978094 >> 172.21.15.150:0/954978094 conn(0x7f5a000b2ff0 msgr2=0x7f5a000b3400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:54:34.022 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:34.019+0000 7f5a07bad640 1 -- 172.21.15.150:0/954978094 shutdown_connections 2024-09-17T05:54:34.022 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:34.019+0000 7f5a07bad640 1 -- 172.21.15.150:0/954978094 wait complete. 2024-09-17T05:54:34.023 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:34.021+0000 7f5a07bad640 1 Processor -- start 2024-09-17T05:54:34.023 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:34.021+0000 7f5a07bad640 1 -- start start 2024-09-17T05:54:34.026 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:34.023+0000 7f5a07bad640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f59ec0053a0 0x7f5a0009f1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:54:34.026 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:34.023+0000 7f5a07bad640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5a001f9450 0x7f5a0014fe10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:54:34.026 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:34.023+0000 7f5a07bad640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5a0009b450 0x7f5a0009b860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:54:34.026 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:34.023+0000 7f5a07bad640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f5a000cddb0 con 0x7f59ec0053a0 2024-09-17T05:54:34.026 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:34.023+0000 7f5a07bad640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f5a000b3de0 con 0x7f5a0009b450 2024-09-17T05:54:34.026 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:34.023+0000 7f5a07bad640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f5a000cdf30 con 0x7f5a001f9450 2024-09-17T05:54:34.026 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:34.023+0000 7f5a05949640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f59ec0053a0 0x7f5a0009f1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:54:34.026 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:34.023+0000 7f5a05949640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f59ec0053a0 0x7f5a0009f1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:39016/0 (socket says 172.21.15.150:39016) 2024-09-17T05:54:34.026 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:34.023+0000 7f5a05949640 1 -- 172.21.15.150:0/3399895126 learned_addr learned my addr 172.21.15.150:0/3399895126 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:54:34.026 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:34.023+0000 7f5a05148640 1 --2- 172.21.15.150:0/3399895126 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5a001f9450 0x7f5a0014fe10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:54:34.026 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:34.023+0000 7f5a0614a640 1 --2- 172.21.15.150:0/3399895126 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5a0009b450 0x7f5a0009b860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:54:34.027 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:34.023+0000 7f5a05949640 1 -- 172.21.15.150:0/3399895126 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5a001f9450 msgr2=0x7f5a0014fe10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:54:34.027 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:34.023+0000 7f5a05949640 1 --2- 172.21.15.150:0/3399895126 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5a001f9450 0x7f5a0014fe10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:54:34.027 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:34.023+0000 7f5a05949640 1 -- 172.21.15.150:0/3399895126 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5a0009b450 msgr2=0x7f5a0009b860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:54:34.027 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:34.023+0000 7f5a05949640 1 --2- 172.21.15.150:0/3399895126 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5a0009b450 0x7f5a0009b860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:54:34.027 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:34.023+0000 7f5a05949640 1 -- 172.21.15.150:0/3399895126 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5a00150350 con 0x7f59ec0053a0 2024-09-17T05:54:34.027 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:34.023+0000 7f5a05148640 1 --2- 172.21.15.150:0/3399895126 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5a001f9450 0x7f5a0014fe10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:54:34.028 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:34.024+0000 7f5a05949640 1 --2- 172.21.15.150:0/3399895126 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f59ec0053a0 0x7f5a0009f1c0 secure :-1 s=READY pgs=2038 cs=0 l=1 rev1=1 crypto rx=0x7f59fc011ae0 tx=0x7f59fc009e40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:54:34.028 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:34.024+0000 7f59f67fc640 1 -- 172.21.15.150:0/3399895126 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59fc01e070 con 0x7f59ec0053a0 2024-09-17T05:54:34.028 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:34.024+0000 7f59f67fc640 1 -- 172.21.15.150:0/3399895126 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f59fc004480 con 0x7f59ec0053a0 2024-09-17T05:54:34.028 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:34.024+0000 7f5a07bad640 1 -- 172.21.15.150:0/3399895126 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5a001e88e0 con 0x7f59ec0053a0 2024-09-17T05:54:34.028 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:34.024+0000 7f59f67fc640 1 -- 172.21.15.150:0/3399895126 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59fc00fc60 con 0x7f59ec0053a0 2024-09-17T05:54:34.030 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:34.024+0000 7f5a07bad640 1 -- 172.21.15.150:0/3399895126 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5a001f8c50 con 0x7f59ec0053a0 2024-09-17T05:54:34.030 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:34.025+0000 7f5a07bad640 1 -- 172.21.15.150:0/3399895126 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5a001f8a40 con 0x7f59ec0053a0 2024-09-17T05:54:34.032 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:34.025+0000 7f59f67fc640 1 -- 172.21.15.150:0/3399895126 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 51) ==== 104960+0+0 (secure 0 0 0) 0x7f59fc021070 con 0x7f59ec0053a0 2024-09-17T05:54:34.032 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:34.026+0000 7f59f67fc640 1 --2- 172.21.15.150:0/3399895126 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f59e407b290 0x7f59e407d7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:54:34.032 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:34.026+0000 7f59f67fc640 1 -- 172.21.15.150:0/3399895126 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(147..147 src has 1..147) ==== 5167+0+0 (secure 0 0 0) 0x7f59fc09a920 con 0x7f59ec0053a0 2024-09-17T05:54:34.032 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:34.026+0000 7f5a05148640 1 --2- 172.21.15.150:0/3399895126 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f59e407b290 0x7f59e407d7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:54:34.032 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:34.027+0000 7f5a05148640 1 --2- 172.21.15.150:0/3399895126 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f59e407b290 0x7f59e407d7a0 secure :-1 s=READY pgs=865 cs=0 l=1 rev1=1 crypto rx=0x7f5a0015b240 tx=0x7f59f0006b70 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:54:34.032 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:34.031+0000 7f59f67fc640 1 -- 172.21.15.150:0/3399895126 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f59fc0642a0 con 0x7f59ec0053a0 2024-09-17T05:54:34.212 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:34.209+0000 7f5a07bad640 1 -- 172.21.15.150:0/3399895126 --> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "4", "target": ["mon-mgr", ""]}) -- 0x7f5a000cf390 con 0x7f59e407b290 2024-09-17T05:54:34.212 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:34.210+0000 7f59f67fc640 1 -- 172.21.15.150:0/3399895126 <== mgr.4108 v2:172.21.15.176:6800/3631216395 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 4 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f5a000cf390 con 0x7f59e407b290 2024-09-17T05:54:34.212 INFO:teuthology.orchestra.run.smithi150.stderr:instructed osd(s) 4 to deep-scrub 2024-09-17T05:54:34.213 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:34.212+0000 7f5a07bad640 1 -- 172.21.15.150:0/3399895126 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f59e407b290 msgr2=0x7f59e407d7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:54:34.214 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:34.212+0000 7f5a07bad640 1 --2- 172.21.15.150:0/3399895126 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f59e407b290 0x7f59e407d7a0 secure :-1 s=READY pgs=865 cs=0 l=1 rev1=1 crypto rx=0x7f5a0015b240 tx=0x7f59f0006b70 comp rx=0 tx=0).stop 2024-09-17T05:54:34.214 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:34.212+0000 7f5a07bad640 1 -- 172.21.15.150:0/3399895126 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f59ec0053a0 msgr2=0x7f5a0009f1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:54:34.214 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:34.212+0000 7f5a07bad640 1 --2- 172.21.15.150:0/3399895126 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f59ec0053a0 0x7f5a0009f1c0 secure :-1 s=READY pgs=2038 cs=0 l=1 rev1=1 crypto rx=0x7f59fc011ae0 tx=0x7f59fc009e40 comp rx=0 tx=0).stop 2024-09-17T05:54:34.214 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:34.212+0000 7f5a07bad640 1 -- 172.21.15.150:0/3399895126 shutdown_connections 2024-09-17T05:54:34.214 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:34.212+0000 7f5a07bad640 1 --2- 172.21.15.150:0/3399895126 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5a0009b450 0x7f5a0009b860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:54:34.214 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:34.212+0000 7f5a07bad640 1 --2- 172.21.15.150:0/3399895126 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f59e407b290 0x7f59e407d7a0 unknown :-1 s=CLOSED pgs=865 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:54:34.214 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:34.212+0000 7f5a07bad640 1 --2- 172.21.15.150:0/3399895126 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5a001f9450 0x7f5a0014fe10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:54:34.215 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:34.212+0000 7f5a07bad640 1 --2- 172.21.15.150:0/3399895126 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f59ec0053a0 0x7f5a0009f1c0 unknown :-1 s=CLOSED pgs=2038 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:54:34.215 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:34.212+0000 7f5a07bad640 1 -- 172.21.15.150:0/3399895126 >> 172.21.15.150:0/3399895126 conn(0x7f5a000b2ff0 msgr2=0x7f5a000b6060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:54:34.215 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:34.212+0000 7f5a07bad640 1 -- 172.21.15.150:0/3399895126 shutdown_connections 2024-09-17T05:54:34.215 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:34.212+0000 7f5a07bad640 1 -- 172.21.15.150:0/3399895126 wait complete. 2024-09-17T05:54:34.225 INFO:tasks.ceph:Scrubbing osd.5 2024-09-17T05:54:34.225 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 config set osd_debug_deep_scrub_sleep 0 2024-09-17T05:54:34.344 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:34.343+0000 7fd77767e640 1 -- 172.21.15.150:0/332056322 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd758005250 msgr2=0x7fd75800b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:54:34.344 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:34.343+0000 7fd77767e640 1 --2- 172.21.15.150:0/332056322 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd758005250 0x7fd75800b9c0 secure :-1 s=READY pgs=2040 cs=0 l=1 rev1=1 crypto rx=0x7fd768006fd0 tx=0x7fd758005830 comp rx=0 tx=0).stop 2024-09-17T05:54:34.344 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:34.343+0000 7fd77767e640 1 -- 172.21.15.150:0/332056322 shutdown_connections 2024-09-17T05:54:34.345 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:34.343+0000 7fd77767e640 1 --2- 172.21.15.150:0/332056322 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd758005250 0x7fd75800b9c0 unknown :-1 s=CLOSED pgs=2040 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:54:34.345 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:34.343+0000 7fd77767e640 1 -- 172.21.15.150:0/332056322 >> 172.21.15.150:0/332056322 conn(0x7fd7700cef30 msgr2=0x7fd7700cf340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:54:34.345 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:34.343+0000 7fd77767e640 1 -- 172.21.15.150:0/332056322 shutdown_connections 2024-09-17T05:54:34.345 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:34.343+0000 7fd77767e640 1 -- 172.21.15.150:0/332056322 wait complete. 2024-09-17T05:54:34.346 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:34.344+0000 7fd77767e640 1 Processor -- start 2024-09-17T05:54:34.346 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:34.345+0000 7fd77767e640 1 -- start start 2024-09-17T05:54:34.348 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:34.346+0000 7fd77767e640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd758005250 0x7fd7701515f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:54:34.348 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:34.346+0000 7fd77767e640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd770151cc0 0x7fd77015fcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:54:34.349 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:34.346+0000 7fd77767e640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd770160230 0x7fd77015d7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:54:34.349 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:34.346+0000 7fd77767e640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7fd7700d3310 con 0x7fd770160230 2024-09-17T05:54:34.349 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:34.346+0000 7fd77767e640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fd7700745e0 con 0x7fd758005250 2024-09-17T05:54:34.349 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:34.346+0000 7fd77767e640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fd770070f20 con 0x7fd770151cc0 2024-09-17T05:54:34.349 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:34.346+0000 7fd775c1b640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd770160230 0x7fd77015d7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:54:34.349 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:34.346+0000 7fd775c1b640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd770160230 0x7fd77015d7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:39040/0 (socket says 172.21.15.150:39040) 2024-09-17T05:54:34.349 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:34.346+0000 7fd775c1b640 1 -- 172.21.15.150:0/2992907362 learned_addr learned my addr 172.21.15.150:0/2992907362 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:54:34.349 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:34.346+0000 7fd774c19640 1 --2- 172.21.15.150:0/2992907362 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd770151cc0 0x7fd77015fcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:54:34.349 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:34.346+0000 7fd77541a640 1 --2- 172.21.15.150:0/2992907362 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd758005250 0x7fd7701515f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:54:34.349 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:34.346+0000 7fd775c1b640 1 -- 172.21.15.150:0/2992907362 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd770151cc0 msgr2=0x7fd77015fcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:54:34.350 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:34.346+0000 7fd775c1b640 1 --2- 172.21.15.150:0/2992907362 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd770151cc0 0x7fd77015fcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:54:34.350 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:34.346+0000 7fd775c1b640 1 -- 172.21.15.150:0/2992907362 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd758005250 msgr2=0x7fd7701515f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:54:34.350 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:34.346+0000 7fd775c1b640 1 --2- 172.21.15.150:0/2992907362 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd758005250 0x7fd7701515f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:54:34.350 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:34.346+0000 7fd775c1b640 1 -- 172.21.15.150:0/2992907362 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd770160640 con 0x7fd770160230 2024-09-17T05:54:34.350 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:34.347+0000 7fd775c1b640 1 --2- 172.21.15.150:0/2992907362 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd770160230 0x7fd77015d7c0 secure :-1 s=READY pgs=2041 cs=0 l=1 rev1=1 crypto rx=0x7fd76800c3d0 tx=0x7fd768006670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:54:34.350 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:34.347+0000 7fd76dffb640 1 -- 172.21.15.150:0/2992907362 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd768031050 con 0x7fd770160230 2024-09-17T05:54:34.350 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:34.347+0000 7fd76dffb640 1 -- 172.21.15.150:0/2992907362 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd768036660 con 0x7fd770160230 2024-09-17T05:54:34.350 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:34.347+0000 7fd76dffb640 1 -- 172.21.15.150:0/2992907362 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd768036ab0 con 0x7fd770160230 2024-09-17T05:54:34.351 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:34.347+0000 7fd77767e640 1 -- 172.21.15.150:0/2992907362 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd77009c7b0 con 0x7fd770160230 2024-09-17T05:54:34.351 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:34.347+0000 7fd77767e640 1 -- 172.21.15.150:0/2992907362 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd77009cd70 con 0x7fd770160230 2024-09-17T05:54:34.351 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:34.348+0000 7fd77767e640 1 -- 172.21.15.150:0/2992907362 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fd7700b7c10 con 0x7fd770160230 2024-09-17T05:54:34.352 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:34.349+0000 7fd76dffb640 1 -- 172.21.15.150:0/2992907362 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 51) ==== 104960+0+0 (secure 0 0 0) 0x7fd768034070 con 0x7fd770160230 2024-09-17T05:54:34.352 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:34.350+0000 7fd76dffb640 1 --2- 172.21.15.150:0/2992907362 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fd75c07b290 0x7fd75c07d7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:54:34.352 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:34.350+0000 7fd76dffb640 1 -- 172.21.15.150:0/2992907362 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(147..147 src has 1..147) ==== 5167+0+0 (secure 0 0 0) 0x7fd7680b9dc0 con 0x7fd770160230 2024-09-17T05:54:34.353 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:34.350+0000 7fd76dffb640 1 --2- 172.21.15.150:0/2992907362 >> [v2:172.21.15.176:6818/2049295774,v1:172.21.15.176:6819/2049295774] conn(0x7fd75c081440 0x7fd75c083930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:54:34.353 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:34.350+0000 7fd76dffb640 1 -- 172.21.15.150:0/2992907362 --> [v2:172.21.15.176:6818/2049295774,v1:172.21.15.176:6819/2049295774] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fd75c084000 con 0x7fd75c081440 2024-09-17T05:54:34.353 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:34.350+0000 7fd76dffb640 1 -- 172.21.15.150:0/2992907362 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_get_version_reply(handle=1 version=147) ==== 24+0+0 (secure 0 0 0) 0x7fd7680ba4f0 con 0x7fd770160230 2024-09-17T05:54:34.353 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:34.350+0000 7fd77541a640 1 --2- 172.21.15.150:0/2992907362 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fd75c07b290 0x7fd75c07d7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:54:34.353 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:34.350+0000 7fd774c19640 1 --2- 172.21.15.150:0/2992907362 >> [v2:172.21.15.176:6818/2049295774,v1:172.21.15.176:6819/2049295774] conn(0x7fd75c081440 0x7fd75c083930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:54:34.353 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:34.351+0000 7fd77541a640 1 --2- 172.21.15.150:0/2992907362 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fd75c07b290 0x7fd75c07d7a0 secure :-1 s=READY pgs=866 cs=0 l=1 rev1=1 crypto rx=0x7fd760005fd0 tx=0x7fd760009500 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:54:34.353 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:34.351+0000 7fd774c19640 1 --2- 172.21.15.150:0/2992907362 >> [v2:172.21.15.176:6818/2049295774,v1:172.21.15.176:6819/2049295774] conn(0x7fd75c081440 0x7fd75c083930 crc :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:54:34.353 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:34.351+0000 7fd76dffb640 1 -- 172.21.15.150:0/2992907362 <== osd.5 v2:172.21.15.176:6818/2049295774 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fd75c084000 con 0x7fd75c081440 2024-09-17T05:54:34.364 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:34.364+0000 7fd77767e640 1 -- 172.21.15.150:0/2992907362 --> [v2:172.21.15.176:6818/2049295774,v1:172.21.15.176:6819/2049295774] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7fd77009c560 con 0x7fd75c081440 2024-09-17T05:54:34.365 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:34.364+0000 7fd76dffb640 1 -- 172.21.15.150:0/2992907362 <== osd.5 v2:172.21.15.176:6818/2049295774 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7fd77009c560 con 0x7fd75c081440 2024-09-17T05:54:34.365 INFO:teuthology.orchestra.run.smithi150.stdout:{ 2024-09-17T05:54:34.365 INFO:teuthology.orchestra.run.smithi150.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-17T05:54:34.365 INFO:teuthology.orchestra.run.smithi150.stdout:} 2024-09-17T05:54:34.366 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:34.365+0000 7fd77767e640 1 -- 172.21.15.150:0/2992907362 >> [v2:172.21.15.176:6818/2049295774,v1:172.21.15.176:6819/2049295774] conn(0x7fd75c081440 msgr2=0x7fd75c083930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:54:34.366 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:34.365+0000 7fd77767e640 1 --2- 172.21.15.150:0/2992907362 >> [v2:172.21.15.176:6818/2049295774,v1:172.21.15.176:6819/2049295774] conn(0x7fd75c081440 0x7fd75c083930 crc :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:54:34.366 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:34.365+0000 7fd77767e640 1 -- 172.21.15.150:0/2992907362 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fd75c07b290 msgr2=0x7fd75c07d7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:54:34.366 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:34.365+0000 7fd77767e640 1 --2- 172.21.15.150:0/2992907362 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fd75c07b290 0x7fd75c07d7a0 secure :-1 s=READY pgs=866 cs=0 l=1 rev1=1 crypto rx=0x7fd760005fd0 tx=0x7fd760009500 comp rx=0 tx=0).stop 2024-09-17T05:54:34.367 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:34.365+0000 7fd77767e640 1 -- 172.21.15.150:0/2992907362 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd770160230 msgr2=0x7fd77015d7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:54:34.367 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:34.365+0000 7fd77767e640 1 --2- 172.21.15.150:0/2992907362 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd770160230 0x7fd77015d7c0 secure :-1 s=READY pgs=2041 cs=0 l=1 rev1=1 crypto rx=0x7fd76800c3d0 tx=0x7fd768006670 comp rx=0 tx=0).stop 2024-09-17T05:54:34.367 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:34.365+0000 7fd775c1b640 1 -- 172.21.15.150:0/2992907362 reap_dead start 2024-09-17T05:54:34.367 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:34.365+0000 7fd77767e640 1 -- 172.21.15.150:0/2992907362 shutdown_connections 2024-09-17T05:54:34.367 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:34.365+0000 7fd77767e640 1 -- 172.21.15.150:0/2992907362 >> 172.21.15.150:0/2992907362 conn(0x7fd7700cef30 msgr2=0x7fd77015c6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:54:34.367 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:34.365+0000 7fd77767e640 1 -- 172.21.15.150:0/2992907362 shutdown_connections 2024-09-17T05:54:34.367 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:34.365+0000 7fd77767e640 1 -- 172.21.15.150:0/2992907362 wait complete. 2024-09-17T05:54:34.377 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 5 2024-09-17T05:54:34.491 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:34.490+0000 7fddb97c2640 1 -- 172.21.15.150:0/3573233062 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fddb40c5b90 msgr2=0x7fddb40d02b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:54:34.492 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:34.490+0000 7fddb97c2640 1 --2- 172.21.15.150:0/3573233062 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fddb40c5b90 0x7fddb40d02b0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fdda40098e0 tx=0x7fdda402a5d0 comp rx=0 tx=0).stop 2024-09-17T05:54:34.492 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:34.490+0000 7fddb97c2640 1 -- 172.21.15.150:0/3573233062 shutdown_connections 2024-09-17T05:54:34.492 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:34.490+0000 7fddb97c2640 1 --2- 172.21.15.150:0/3573233062 >> v2:172.21.15.176:3300/0 conn(0x7fddb40d07f0 0x7fddb40b1da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:54:34.492 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:34.490+0000 7fddb97c2640 1 --2- 172.21.15.150:0/3573233062 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fddb40c5b90 0x7fddb40d02b0 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:54:34.492 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:34.490+0000 7fddb97c2640 1 -- 172.21.15.150:0/3573233062 >> 172.21.15.150:0/3573233062 conn(0x7fddb40cef80 msgr2=0x7fddb40cf390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:54:34.492 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:34.490+0000 7fddb97c2640 1 -- 172.21.15.150:0/3573233062 shutdown_connections 2024-09-17T05:54:34.492 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:34.491+0000 7fddb97c2640 1 -- 172.21.15.150:0/3573233062 wait complete. 2024-09-17T05:54:34.493 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:34.492+0000 7fddb97c2640 1 Processor -- start 2024-09-17T05:54:34.493 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:34.492+0000 7fddb97c2640 1 -- start start 2024-09-17T05:54:34.496 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:34.494+0000 7fddb97c2640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fddb409ba60 0x7fddb4161050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:54:34.496 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:34.494+0000 7fddb97c2640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fddb40c5b90 0x7fddb415ec10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:54:34.496 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:34.494+0000 7fddb97c2640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fddb40d07f0 0x7fddb415f150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:54:34.496 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:34.494+0000 7fddb97c2640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7fddb40b2b70 con 0x7fddb40d07f0 2024-09-17T05:54:34.496 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:34.494+0000 7fddb97c2640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fddb40b29f0 con 0x7fddb409ba60 2024-09-17T05:54:34.496 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:34.494+0000 7fddb97c2640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fddb40b2cf0 con 0x7fddb40c5b90 2024-09-17T05:54:34.496 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:34.494+0000 7fddb37fe640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fddb40d07f0 0x7fddb415f150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:54:34.496 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:34.494+0000 7fddb37fe640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fddb40d07f0 0x7fddb415f150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:39044/0 (socket says 172.21.15.150:39044) 2024-09-17T05:54:34.496 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:34.494+0000 7fddb37fe640 1 -- 172.21.15.150:0/12953423 learned_addr learned my addr 172.21.15.150:0/12953423 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:54:34.496 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:34.494+0000 7fddb2ffd640 1 --2- 172.21.15.150:0/12953423 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fddb409ba60 0x7fddb4161050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:54:34.496 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:34.494+0000 7fddaa7fc640 1 --2- 172.21.15.150:0/12953423 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fddb40c5b90 0x7fddb415ec10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:54:34.497 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:34.494+0000 7fddb37fe640 1 -- 172.21.15.150:0/12953423 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fddb40c5b90 msgr2=0x7fddb415ec10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:54:34.497 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:34.494+0000 7fddb37fe640 1 --2- 172.21.15.150:0/12953423 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fddb40c5b90 0x7fddb415ec10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:54:34.497 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:34.494+0000 7fddb37fe640 1 -- 172.21.15.150:0/12953423 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fddb409ba60 msgr2=0x7fddb4161050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:54:34.497 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:34.494+0000 7fddb37fe640 1 --2- 172.21.15.150:0/12953423 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fddb409ba60 0x7fddb4161050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:54:34.497 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:34.494+0000 7fddb37fe640 1 -- 172.21.15.150:0/12953423 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fddb41f3f60 con 0x7fddb40d07f0 2024-09-17T05:54:34.497 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:34.494+0000 7fddb37fe640 1 --2- 172.21.15.150:0/12953423 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fddb40d07f0 0x7fddb415f150 secure :-1 s=READY pgs=2042 cs=0 l=1 rev1=1 crypto rx=0x7fddac00c6c0 tx=0x7fddac00cb80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:54:34.497 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:34.495+0000 7fddabfff640 1 -- 172.21.15.150:0/12953423 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fddac017070 con 0x7fddb40d07f0 2024-09-17T05:54:34.497 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:34.495+0000 7fddb97c2640 1 -- 172.21.15.150:0/12953423 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fddb41f4240 con 0x7fddb40d07f0 2024-09-17T05:54:34.497 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:34.495+0000 7fddabfff640 1 -- 172.21.15.150:0/12953423 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fddac003c60 con 0x7fddb40d07f0 2024-09-17T05:54:34.497 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:34.495+0000 7fddabfff640 1 -- 172.21.15.150:0/12953423 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fddac0052d0 con 0x7fddb40d07f0 2024-09-17T05:54:34.497 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:34.495+0000 7fddb97c2640 1 -- 172.21.15.150:0/12953423 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fddb41f4800 con 0x7fddb40d07f0 2024-09-17T05:54:34.498 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:34.496+0000 7fddb97c2640 1 -- 172.21.15.150:0/12953423 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fddb41f4a40 con 0x7fddb40d07f0 2024-09-17T05:54:34.498 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:34.496+0000 7fddabfff640 1 -- 172.21.15.150:0/12953423 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 51) ==== 104960+0+0 (secure 0 0 0) 0x7fddac01a070 con 0x7fddb40d07f0 2024-09-17T05:54:34.498 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:34.497+0000 7fddabfff640 1 --2- 172.21.15.150:0/12953423 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fdd9407b260 0x7fdd9407d770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:54:34.498 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:34.497+0000 7fddabfff640 1 -- 172.21.15.150:0/12953423 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(147..147 src has 1..147) ==== 5167+0+0 (secure 0 0 0) 0x7fddac099550 con 0x7fddb40d07f0 2024-09-17T05:54:34.498 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:34.497+0000 7fddb2ffd640 1 --2- 172.21.15.150:0/12953423 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fdd9407b260 0x7fdd9407d770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:54:34.499 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:34.498+0000 7fddb2ffd640 1 --2- 172.21.15.150:0/12953423 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fdd9407b260 0x7fdd9407d770 secure :-1 s=READY pgs=867 cs=0 l=1 rev1=1 crypto rx=0x7fdda4034000 tx=0x7fdda4004730 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:54:34.502 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:34.501+0000 7fddabfff640 1 -- 172.21.15.150:0/12953423 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fddb41f4a40 con 0x7fddb40d07f0 2024-09-17T05:54:34.678 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:34.677+0000 7fddb97c2640 1 -- 172.21.15.150:0/12953423 --> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "5", "target": ["mon-mgr", ""]}) -- 0x7fddb40d02b0 con 0x7fdd9407b260 2024-09-17T05:54:34.679 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:34.678+0000 7fddabfff640 1 -- 172.21.15.150:0/12953423 <== mgr.4108 v2:172.21.15.176:6800/3631216395 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 5 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7fddb40d02b0 con 0x7fdd9407b260 2024-09-17T05:54:34.679 INFO:teuthology.orchestra.run.smithi150.stderr:instructed osd(s) 5 to deep-scrub 2024-09-17T05:54:34.681 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:34.680+0000 7fddb97c2640 1 -- 172.21.15.150:0/12953423 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fdd9407b260 msgr2=0x7fdd9407d770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:54:34.681 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:34.680+0000 7fddb97c2640 1 --2- 172.21.15.150:0/12953423 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fdd9407b260 0x7fdd9407d770 secure :-1 s=READY pgs=867 cs=0 l=1 rev1=1 crypto rx=0x7fdda4034000 tx=0x7fdda4004730 comp rx=0 tx=0).stop 2024-09-17T05:54:34.681 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:34.680+0000 7fddb97c2640 1 -- 172.21.15.150:0/12953423 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fddb40d07f0 msgr2=0x7fddb415f150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:54:34.681 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:34.680+0000 7fddb97c2640 1 --2- 172.21.15.150:0/12953423 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fddb40d07f0 0x7fddb415f150 secure :-1 s=READY pgs=2042 cs=0 l=1 rev1=1 crypto rx=0x7fddac00c6c0 tx=0x7fddac00cb80 comp rx=0 tx=0).stop 2024-09-17T05:54:34.681 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:34.680+0000 7fddb97c2640 1 -- 172.21.15.150:0/12953423 shutdown_connections 2024-09-17T05:54:34.682 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:34.680+0000 7fddb97c2640 1 --2- 172.21.15.150:0/12953423 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fdd9407b260 0x7fdd9407d770 unknown :-1 s=CLOSED pgs=867 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:54:34.682 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:34.680+0000 7fddb97c2640 1 --2- 172.21.15.150:0/12953423 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fddb40d07f0 0x7fddb415f150 unknown :-1 s=CLOSED pgs=2042 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:54:34.682 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:34.680+0000 7fddb97c2640 1 --2- 172.21.15.150:0/12953423 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fddb40c5b90 0x7fddb415ec10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:54:34.682 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:34.680+0000 7fddb97c2640 1 --2- 172.21.15.150:0/12953423 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fddb409ba60 0x7fddb4161050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:54:34.682 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:34.680+0000 7fddb97c2640 1 -- 172.21.15.150:0/12953423 >> 172.21.15.150:0/12953423 conn(0x7fddb40cef80 msgr2=0x7fddb4072a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:54:34.682 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:34.680+0000 7fddb97c2640 1 -- 172.21.15.150:0/12953423 shutdown_connections 2024-09-17T05:54:34.682 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:34.680+0000 7fddb97c2640 1 -- 172.21.15.150:0/12953423 wait complete. 2024-09-17T05:54:34.693 INFO:tasks.ceph:Scrubbing osd.6 2024-09-17T05:54:34.693 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 config set osd_debug_deep_scrub_sleep 0 2024-09-17T05:54:34.811 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:34.810+0000 7fbfea00e640 1 -- 172.21.15.150:0/1611539428 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbfcc004800 msgr2=0x7fbfcc004c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:54:34.811 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:34.810+0000 7fbfea00e640 1 --2- 172.21.15.150:0/1611539428 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbfcc004800 0x7fbfcc004c10 secure :-1 s=READY pgs=2044 cs=0 l=1 rev1=1 crypto rx=0x7fbfd800c310 tx=0x7fbfcc005830 comp rx=0 tx=0).stop 2024-09-17T05:54:34.811 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:34.810+0000 7fbfea00e640 1 -- 172.21.15.150:0/1611539428 shutdown_connections 2024-09-17T05:54:34.811 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:34.810+0000 7fbfea00e640 1 --2- 172.21.15.150:0/1611539428 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbfcc004800 0x7fbfcc004c10 unknown :-1 s=CLOSED pgs=2044 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:54:34.811 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:34.810+0000 7fbfea00e640 1 -- 172.21.15.150:0/1611539428 >> 172.21.15.150:0/1611539428 conn(0x7fbfe409aa50 msgr2=0x7fbfe40b2ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:54:34.811 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:34.810+0000 7fbfea00e640 1 -- 172.21.15.150:0/1611539428 shutdown_connections 2024-09-17T05:54:34.812 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:34.810+0000 7fbfea00e640 1 -- 172.21.15.150:0/1611539428 wait complete. 2024-09-17T05:54:34.812 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:34.811+0000 7fbfea00e640 1 Processor -- start 2024-09-17T05:54:34.812 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:34.812+0000 7fbfea00e640 1 -- start start 2024-09-17T05:54:34.815 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:34.813+0000 7fbfea00e640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fbfcc004800 0x7fbfe406d600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:54:34.815 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:34.813+0000 7fbfea00e640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fbfe41f4690 0x7fbfe40cf920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:54:34.815 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:34.813+0000 7fbfea00e640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbfe41e6450 0x7fbfe41e6860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:54:34.816 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:34.813+0000 7fbfea00e640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7fbfe40b46d0 con 0x7fbfe41e6450 2024-09-17T05:54:34.816 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:34.813+0000 7fbfea00e640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fbfe40b4550 con 0x7fbfcc004800 2024-09-17T05:54:34.816 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:34.813+0000 7fbfea00e640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fbfe40b4850 con 0x7fbfe41f4690 2024-09-17T05:54:34.816 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:34.813+0000 7fbfe3fff640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbfe41e6450 0x7fbfe41e6860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:54:34.816 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:34.813+0000 7fbfe3fff640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbfe41e6450 0x7fbfe41e6860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:39052/0 (socket says 172.21.15.150:39052) 2024-09-17T05:54:34.816 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:34.813+0000 7fbfe3fff640 1 -- 172.21.15.150:0/933516078 learned_addr learned my addr 172.21.15.150:0/933516078 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:54:34.816 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:34.813+0000 7fbfe2ffd640 1 --2- 172.21.15.150:0/933516078 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fbfe41f4690 0x7fbfe40cf920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:54:34.817 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:34.813+0000 7fbfe37fe640 1 --2- 172.21.15.150:0/933516078 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fbfcc004800 0x7fbfe406d600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:54:34.817 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:34.813+0000 7fbfe3fff640 1 -- 172.21.15.150:0/933516078 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fbfe41f4690 msgr2=0x7fbfe40cf920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:54:34.817 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:34.813+0000 7fbfe3fff640 1 --2- 172.21.15.150:0/933516078 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fbfe41f4690 0x7fbfe40cf920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:54:34.817 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:34.813+0000 7fbfe3fff640 1 -- 172.21.15.150:0/933516078 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fbfcc004800 msgr2=0x7fbfe406d600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:54:34.817 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:34.813+0000 7fbfe3fff640 1 --2- 172.21.15.150:0/933516078 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fbfcc004800 0x7fbfe406d600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:54:34.818 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:34.813+0000 7fbfe3fff640 1 -- 172.21.15.150:0/933516078 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbfe41e6da0 con 0x7fbfe41e6450 2024-09-17T05:54:34.818 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:34.814+0000 7fbfe3fff640 1 --2- 172.21.15.150:0/933516078 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbfe41e6450 0x7fbfe41e6860 secure :-1 s=READY pgs=2045 cs=0 l=1 rev1=1 crypto rx=0x7fbfe40af3c0 tx=0x7fbfdc011c60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:54:34.818 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:34.814+0000 7fbfcbfff640 1 -- 172.21.15.150:0/933516078 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbfdc004440 con 0x7fbfe41e6450 2024-09-17T05:54:34.818 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:34.814+0000 7fbfcbfff640 1 -- 172.21.15.150:0/933516078 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fbfdc00f920 con 0x7fbfe41e6450 2024-09-17T05:54:34.818 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:34.814+0000 7fbfea00e640 1 -- 172.21.15.150:0/933516078 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbfe41f71e0 con 0x7fbfe41e6450 2024-09-17T05:54:34.818 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:34.814+0000 7fbfcbfff640 1 -- 172.21.15.150:0/933516078 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbfdc00fd70 con 0x7fbfe41e6450 2024-09-17T05:54:34.818 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:34.814+0000 7fbfea00e640 1 -- 172.21.15.150:0/933516078 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbfe41f77a0 con 0x7fbfe41e6450 2024-09-17T05:54:34.818 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:34.814+0000 7fbfea00e640 1 -- 172.21.15.150:0/933516078 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fbfe406db40 con 0x7fbfe41e6450 2024-09-17T05:54:34.819 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:34.816+0000 7fbfcbfff640 1 -- 172.21.15.150:0/933516078 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 51) ==== 104960+0+0 (secure 0 0 0) 0x7fbfdc0035f0 con 0x7fbfe41e6450 2024-09-17T05:54:34.820 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:34.816+0000 7fbfcbfff640 1 --2- 172.21.15.150:0/933516078 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fbfd007b260 0x7fbfd007d770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:54:34.820 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:34.816+0000 7fbfcbfff640 1 -- 172.21.15.150:0/933516078 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(147..147 src has 1..147) ==== 5167+0+0 (secure 0 0 0) 0x7fbfdc09aa00 con 0x7fbfe41e6450 2024-09-17T05:54:34.820 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:34.816+0000 7fbfcbfff640 1 --2- 172.21.15.150:0/933516078 >> [v2:172.21.15.176:6826/2164458476,v1:172.21.15.176:6827/2164458476] conn(0x7fbfd0081410 0x7fbfd0083900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:54:34.820 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:34.816+0000 7fbfcbfff640 1 -- 172.21.15.150:0/933516078 --> [v2:172.21.15.176:6826/2164458476,v1:172.21.15.176:6827/2164458476] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fbfdc014ec0 con 0x7fbfd0081410 2024-09-17T05:54:34.820 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:34.816+0000 7fbfcbfff640 1 -- 172.21.15.150:0/933516078 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_get_version_reply(handle=1 version=147) ==== 24+0+0 (secure 0 0 0) 0x7fbfdc09b130 con 0x7fbfe41e6450 2024-09-17T05:54:34.820 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:34.816+0000 7fbfe37fe640 1 --2- 172.21.15.150:0/933516078 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fbfd007b260 0x7fbfd007d770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:54:34.820 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:34.817+0000 7fbfe2ffd640 1 --2- 172.21.15.150:0/933516078 >> [v2:172.21.15.176:6826/2164458476,v1:172.21.15.176:6827/2164458476] conn(0x7fbfd0081410 0x7fbfd0083900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:54:34.820 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:34.817+0000 7fbfe37fe640 1 --2- 172.21.15.150:0/933516078 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fbfd007b260 0x7fbfd007d770 secure :-1 s=READY pgs=868 cs=0 l=1 rev1=1 crypto rx=0x7fbfe40521d0 tx=0x7fbfd4006ef0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:54:34.821 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:34.817+0000 7fbfe2ffd640 1 --2- 172.21.15.150:0/933516078 >> [v2:172.21.15.176:6826/2164458476,v1:172.21.15.176:6827/2164458476] conn(0x7fbfd0081410 0x7fbfd0083900 crc :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:54:34.821 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:34.818+0000 7fbfcbfff640 1 -- 172.21.15.150:0/933516078 <== osd.6 v2:172.21.15.176:6826/2164458476 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fbfdc014ec0 con 0x7fbfd0081410 2024-09-17T05:54:34.831 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:34.830+0000 7fbfea00e640 1 -- 172.21.15.150:0/933516078 --> [v2:172.21.15.176:6826/2164458476,v1:172.21.15.176:6827/2164458476] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7fbfe41f6f90 con 0x7fbfd0081410 2024-09-17T05:54:34.832 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:34.831+0000 7fbfcbfff640 1 -- 172.21.15.150:0/933516078 <== osd.6 v2:172.21.15.176:6826/2164458476 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7fbfe41f6f90 con 0x7fbfd0081410 2024-09-17T05:54:34.832 INFO:teuthology.orchestra.run.smithi150.stdout:{ 2024-09-17T05:54:34.832 INFO:teuthology.orchestra.run.smithi150.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-17T05:54:34.832 INFO:teuthology.orchestra.run.smithi150.stdout:} 2024-09-17T05:54:34.833 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:34.831+0000 7fbfea00e640 1 -- 172.21.15.150:0/933516078 >> [v2:172.21.15.176:6826/2164458476,v1:172.21.15.176:6827/2164458476] conn(0x7fbfd0081410 msgr2=0x7fbfd0083900 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:54:34.833 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:34.831+0000 7fbfea00e640 1 --2- 172.21.15.150:0/933516078 >> [v2:172.21.15.176:6826/2164458476,v1:172.21.15.176:6827/2164458476] conn(0x7fbfd0081410 0x7fbfd0083900 crc :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:54:34.833 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:34.831+0000 7fbfea00e640 1 -- 172.21.15.150:0/933516078 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fbfd007b260 msgr2=0x7fbfd007d770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:54:34.834 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:34.831+0000 7fbfea00e640 1 --2- 172.21.15.150:0/933516078 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fbfd007b260 0x7fbfd007d770 secure :-1 s=READY pgs=868 cs=0 l=1 rev1=1 crypto rx=0x7fbfe40521d0 tx=0x7fbfd4006ef0 comp rx=0 tx=0).stop 2024-09-17T05:54:34.834 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:34.831+0000 7fbfea00e640 1 -- 172.21.15.150:0/933516078 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbfe41e6450 msgr2=0x7fbfe41e6860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:54:34.834 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:34.831+0000 7fbfea00e640 1 --2- 172.21.15.150:0/933516078 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbfe41e6450 0x7fbfe41e6860 secure :-1 s=READY pgs=2045 cs=0 l=1 rev1=1 crypto rx=0x7fbfe40af3c0 tx=0x7fbfdc011c60 comp rx=0 tx=0).stop 2024-09-17T05:54:34.834 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:34.831+0000 7fbfe3fff640 1 -- 172.21.15.150:0/933516078 reap_dead start 2024-09-17T05:54:34.834 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:34.831+0000 7fbfea00e640 1 -- 172.21.15.150:0/933516078 shutdown_connections 2024-09-17T05:54:34.834 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:34.831+0000 7fbfea00e640 1 -- 172.21.15.150:0/933516078 >> 172.21.15.150:0/933516078 conn(0x7fbfe409aa50 msgr2=0x7fbfe4070e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:54:34.834 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:34.832+0000 7fbfea00e640 1 -- 172.21.15.150:0/933516078 shutdown_connections 2024-09-17T05:54:34.834 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:34.832+0000 7fbfea00e640 1 -- 172.21.15.150:0/933516078 wait complete. 2024-09-17T05:54:34.843 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 6 2024-09-17T05:54:34.958 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:34.957+0000 7fae03b69640 1 -- 172.21.15.150:0/2474285478 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fade8005250 msgr2=0x7fade800b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:54:34.959 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:34.957+0000 7fae03b69640 1 --2- 172.21.15.150:0/2474285478 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fade8005250 0x7fade800b9c0 secure :-1 s=READY pgs=2047 cs=0 l=1 rev1=1 crypto rx=0x7fadfc074100 tx=0x7fade8005830 comp rx=0 tx=0).stop 2024-09-17T05:54:34.959 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:34.957+0000 7fae03b69640 1 -- 172.21.15.150:0/2474285478 shutdown_connections 2024-09-17T05:54:34.959 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:34.957+0000 7fae03b69640 1 --2- 172.21.15.150:0/2474285478 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fade8005250 0x7fade800b9c0 unknown :-1 s=CLOSED pgs=2047 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:54:34.959 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:34.957+0000 7fae03b69640 1 -- 172.21.15.150:0/2474285478 >> 172.21.15.150:0/2474285478 conn(0x7fadfc0b6880 msgr2=0x7fadfc0b3060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:54:34.959 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:34.957+0000 7fae03b69640 1 -- 172.21.15.150:0/2474285478 shutdown_connections 2024-09-17T05:54:34.959 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:34.957+0000 7fae03b69640 1 -- 172.21.15.150:0/2474285478 wait complete. 2024-09-17T05:54:34.960 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:34.959+0000 7fae03b69640 1 Processor -- start 2024-09-17T05:54:34.960 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:34.959+0000 7fae03b69640 1 -- start start 2024-09-17T05:54:34.963 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:34.960+0000 7fae03b69640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fade8005250 0x7fadfc14ec50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:54:34.963 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:34.960+0000 7fae03b69640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fadfc14cd40 0x7fadfc155310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:54:34.963 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:34.960+0000 7fae03b69640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fadfc14d150 0x7fadfc0b53b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:54:34.963 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:34.960+0000 7fae03b69640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7fadfc0ae4c0 con 0x7fadfc14cd40 2024-09-17T05:54:34.963 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:34.960+0000 7fae03b69640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fadfc0ae340 con 0x7fadfc14d150 2024-09-17T05:54:34.963 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:34.960+0000 7fae03b69640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fadfc0ae640 con 0x7fade8005250 2024-09-17T05:54:34.964 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:34.961+0000 7fae01104640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fadfc14cd40 0x7fadfc155310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:54:34.964 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:34.961+0000 7fae01104640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fadfc14cd40 0x7fadfc155310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:39060/0 (socket says 172.21.15.150:39060) 2024-09-17T05:54:34.964 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:34.961+0000 7fae01104640 1 -- 172.21.15.150:0/1063054344 learned_addr learned my addr 172.21.15.150:0/1063054344 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:54:34.964 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:34.961+0000 7fae01905640 1 --2- 172.21.15.150:0/1063054344 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fade8005250 0x7fadfc14ec50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:54:34.964 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:34.961+0000 7fae02106640 1 --2- 172.21.15.150:0/1063054344 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fadfc14d150 0x7fadfc0b53b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:54:34.964 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:34.961+0000 7fae01104640 1 -- 172.21.15.150:0/1063054344 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fade8005250 msgr2=0x7fadfc14ec50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:54:34.964 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:34.961+0000 7fae01104640 1 --2- 172.21.15.150:0/1063054344 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fade8005250 0x7fadfc14ec50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:54:34.964 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:34.961+0000 7fae01104640 1 -- 172.21.15.150:0/1063054344 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fadfc14d150 msgr2=0x7fadfc0b53b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:54:34.964 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:34.961+0000 7fae01104640 1 --2- 172.21.15.150:0/1063054344 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fadfc14d150 0x7fadfc0b53b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:54:34.964 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:34.961+0000 7fae01104640 1 -- 172.21.15.150:0/1063054344 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fadfc1f2890 con 0x7fadfc14cd40 2024-09-17T05:54:34.965 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:34.961+0000 7fae02106640 1 --2- 172.21.15.150:0/1063054344 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fadfc14d150 0x7fadfc0b53b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:54:34.965 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:34.961+0000 7fae01104640 1 --2- 172.21.15.150:0/1063054344 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fadfc14cd40 0x7fadfc155310 secure :-1 s=READY pgs=2048 cs=0 l=1 rev1=1 crypto rx=0x7fadec004fc0 tx=0x7fadec00ea90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:54:34.965 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:34.961+0000 7fadf27fc640 1 -- 172.21.15.150:0/1063054344 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fadec011a90 con 0x7fadfc14cd40 2024-09-17T05:54:34.965 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:34.961+0000 7fadf27fc640 1 -- 172.21.15.150:0/1063054344 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fadec015070 con 0x7fadfc14cd40 2024-09-17T05:54:34.965 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:34.961+0000 7fae03b69640 1 -- 172.21.15.150:0/1063054344 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fadfc1f2b70 con 0x7fadfc14cd40 2024-09-17T05:54:34.965 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:34.961+0000 7fadf27fc640 1 -- 172.21.15.150:0/1063054344 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fadec01a470 con 0x7fadfc14cd40 2024-09-17T05:54:34.965 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:34.961+0000 7fae03b69640 1 -- 172.21.15.150:0/1063054344 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fadfc1f3130 con 0x7fadfc14cd40 2024-09-17T05:54:34.965 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:34.962+0000 7fae03b69640 1 -- 172.21.15.150:0/1063054344 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fadfc0aeba0 con 0x7fadfc14cd40 2024-09-17T05:54:34.966 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:34.963+0000 7fadf27fc640 1 -- 172.21.15.150:0/1063054344 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 51) ==== 104960+0+0 (secure 0 0 0) 0x7fadec00c440 con 0x7fadfc14cd40 2024-09-17T05:54:34.966 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:34.964+0000 7fadf27fc640 1 --2- 172.21.15.150:0/1063054344 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fade007b260 0x7fade007d770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:54:34.966 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:34.964+0000 7fadf27fc640 1 -- 172.21.15.150:0/1063054344 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(147..147 src has 1..147) ==== 5167+0+0 (secure 0 0 0) 0x7fadec09c310 con 0x7fadfc14cd40 2024-09-17T05:54:34.967 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:34.964+0000 7fae01905640 1 --2- 172.21.15.150:0/1063054344 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fade007b260 0x7fade007d770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:54:34.967 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:34.964+0000 7fae01905640 1 --2- 172.21.15.150:0/1063054344 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fade007b260 0x7fade007d770 secure :-1 s=READY pgs=869 cs=0 l=1 rev1=1 crypto rx=0x7fadf8009ad0 tx=0x7fadf8005f90 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:54:34.968 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:34.968+0000 7fadf27fc640 1 -- 172.21.15.150:0/1063054344 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fadfc0cf870 con 0x7fadfc14cd40 2024-09-17T05:54:35.146 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:35.145+0000 7fae03b69640 1 -- 172.21.15.150:0/1063054344 --> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "6", "target": ["mon-mgr", ""]}) -- 0x7fadfc1f2620 con 0x7fade007b260 2024-09-17T05:54:35.146 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:35.146+0000 7fadf27fc640 1 -- 172.21.15.150:0/1063054344 <== mgr.4108 v2:172.21.15.176:6800/3631216395 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 6 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7fadfc1f2620 con 0x7fade007b260 2024-09-17T05:54:35.146 INFO:teuthology.orchestra.run.smithi150.stderr:instructed osd(s) 6 to deep-scrub 2024-09-17T05:54:35.149 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:35.148+0000 7fae03b69640 1 -- 172.21.15.150:0/1063054344 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fade007b260 msgr2=0x7fade007d770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:54:35.150 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:35.148+0000 7fae03b69640 1 --2- 172.21.15.150:0/1063054344 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fade007b260 0x7fade007d770 secure :-1 s=READY pgs=869 cs=0 l=1 rev1=1 crypto rx=0x7fadf8009ad0 tx=0x7fadf8005f90 comp rx=0 tx=0).stop 2024-09-17T05:54:35.150 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:35.148+0000 7fae03b69640 1 -- 172.21.15.150:0/1063054344 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fadfc14cd40 msgr2=0x7fadfc155310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:54:35.150 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:35.148+0000 7fae03b69640 1 --2- 172.21.15.150:0/1063054344 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fadfc14cd40 0x7fadfc155310 secure :-1 s=READY pgs=2048 cs=0 l=1 rev1=1 crypto rx=0x7fadec004fc0 tx=0x7fadec00ea90 comp rx=0 tx=0).stop 2024-09-17T05:54:35.150 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:35.148+0000 7fae03b69640 1 -- 172.21.15.150:0/1063054344 shutdown_connections 2024-09-17T05:54:35.150 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:35.148+0000 7fae03b69640 1 --2- 172.21.15.150:0/1063054344 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fadfc14d150 0x7fadfc0b53b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:54:35.150 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:35.148+0000 7fae03b69640 1 --2- 172.21.15.150:0/1063054344 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fade007b260 0x7fade007d770 unknown :-1 s=CLOSED pgs=869 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:54:35.150 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:35.148+0000 7fae03b69640 1 --2- 172.21.15.150:0/1063054344 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fadfc14cd40 0x7fadfc155310 unknown :-1 s=CLOSED pgs=2048 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:54:35.150 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:35.148+0000 7fae03b69640 1 --2- 172.21.15.150:0/1063054344 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fade8005250 0x7fadfc14ec50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:54:35.150 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:35.148+0000 7fae03b69640 1 -- 172.21.15.150:0/1063054344 >> 172.21.15.150:0/1063054344 conn(0x7fadfc0b6880 msgr2=0x7fadfc0aedb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:54:35.150 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:35.148+0000 7fae03b69640 1 -- 172.21.15.150:0/1063054344 shutdown_connections 2024-09-17T05:54:35.150 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:35.148+0000 7fae03b69640 1 -- 172.21.15.150:0/1063054344 wait complete. 2024-09-17T05:54:35.161 INFO:tasks.ceph:Scrubbing osd.7 2024-09-17T05:54:35.161 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 config set osd_debug_deep_scrub_sleep 0 2024-09-17T05:54:35.280 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:35.278+0000 7fafe0069640 1 -- 172.21.15.150:0/3263464685 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fafd815f200 msgr2=0x7fafd815bc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:54:35.281 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:35.278+0000 7fafe0069640 1 --2- 172.21.15.150:0/3263464685 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fafd815f200 0x7fafd815bc10 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x7fafc8005fd0 tx=0x7fafc802a5d0 comp rx=0 tx=0).stop 2024-09-17T05:54:35.281 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:35.278+0000 7fafe0069640 1 -- 172.21.15.150:0/3263464685 shutdown_connections 2024-09-17T05:54:35.281 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:35.278+0000 7fafe0069640 1 --2- 172.21.15.150:0/3263464685 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fafd80b5910 0x7fafd8158980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:54:35.281 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:35.278+0000 7fafe0069640 1 --2- 172.21.15.150:0/3263464685 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fafd815f200 0x7fafd815bc10 unknown :-1 s=CLOSED pgs=688 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:54:35.281 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:35.278+0000 7fafe0069640 1 -- 172.21.15.150:0/3263464685 >> 172.21.15.150:0/3263464685 conn(0x7fafd806d3d0 msgr2=0x7fafd80b2470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:54:35.281 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:35.278+0000 7fafe0069640 1 -- 172.21.15.150:0/3263464685 shutdown_connections 2024-09-17T05:54:35.281 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:35.279+0000 7fafe0069640 1 -- 172.21.15.150:0/3263464685 wait complete. 2024-09-17T05:54:35.281 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:35.280+0000 7fafe0069640 1 Processor -- start 2024-09-17T05:54:35.282 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:35.280+0000 7fafe0069640 1 -- start start 2024-09-17T05:54:35.283 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:35.282+0000 7fafe0069640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fafd80d0000 0x7fafd81f77b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:54:35.284 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:35.282+0000 7fafe0069640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fafd815f200 0x7fafd813e7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:54:35.284 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:35.282+0000 7fafe0069640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fafd8141140 0x7fafd813f0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:54:35.284 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:35.282+0000 7fafe0069640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7fafd81593e0 con 0x7fafd8141140 2024-09-17T05:54:35.284 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:35.282+0000 7fafe0069640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fafd8159260 con 0x7fafd815f200 2024-09-17T05:54:35.284 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:35.282+0000 7fafe0069640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fafd8159560 con 0x7fafd80d0000 2024-09-17T05:54:35.284 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:35.282+0000 7fafde606640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fafd8141140 0x7fafd813f0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:54:35.284 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:35.282+0000 7fafde606640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fafd8141140 0x7fafd813f0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:39072/0 (socket says 172.21.15.150:39072) 2024-09-17T05:54:35.284 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:35.282+0000 7fafde606640 1 -- 172.21.15.150:0/2633713025 learned_addr learned my addr 172.21.15.150:0/2633713025 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:54:35.284 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:35.282+0000 7fafdde05640 1 --2- 172.21.15.150:0/2633713025 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fafd80d0000 0x7fafd81f77b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:54:35.284 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:35.282+0000 7fafdd604640 1 --2- 172.21.15.150:0/2633713025 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fafd815f200 0x7fafd813e7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:54:35.284 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:35.282+0000 7fafde606640 1 -- 172.21.15.150:0/2633713025 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fafd80d0000 msgr2=0x7fafd81f77b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:54:35.284 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:35.282+0000 7fafde606640 1 --2- 172.21.15.150:0/2633713025 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fafd80d0000 0x7fafd81f77b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:54:35.284 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:35.282+0000 7fafde606640 1 -- 172.21.15.150:0/2633713025 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fafd815f200 msgr2=0x7fafd813e7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:54:35.285 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:35.282+0000 7fafde606640 1 --2- 172.21.15.150:0/2633713025 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fafd815f200 0x7fafd813e7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:54:35.285 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:35.282+0000 7fafde606640 1 -- 172.21.15.150:0/2633713025 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fafd8141cf0 con 0x7fafd8141140 2024-09-17T05:54:35.285 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:35.282+0000 7fafdde05640 1 --2- 172.21.15.150:0/2633713025 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fafd80d0000 0x7fafd81f77b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:54:35.285 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:35.282+0000 7fafdd604640 1 --2- 172.21.15.150:0/2633713025 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fafd815f200 0x7fafd813e7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:54:35.285 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:35.282+0000 7fafde606640 1 --2- 172.21.15.150:0/2633713025 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fafd8141140 0x7fafd813f0f0 secure :-1 s=READY pgs=2049 cs=0 l=1 rev1=1 crypto rx=0x7fafd000eab0 tx=0x7fafd000ef70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:54:35.285 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:35.282+0000 7fafd67fc640 1 -- 172.21.15.150:0/2633713025 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fafd000cea0 con 0x7fafd8141140 2024-09-17T05:54:35.285 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:35.282+0000 7fafd67fc640 1 -- 172.21.15.150:0/2633713025 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fafd0004b20 con 0x7fafd8141140 2024-09-17T05:54:35.285 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:35.282+0000 7fafd67fc640 1 -- 172.21.15.150:0/2633713025 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fafd0005020 con 0x7fafd8141140 2024-09-17T05:54:35.285 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:35.282+0000 7fafe0069640 1 -- 172.21.15.150:0/2633713025 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fafd8141fd0 con 0x7fafd8141140 2024-09-17T05:54:35.285 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:35.283+0000 7fafe0069640 1 -- 172.21.15.150:0/2633713025 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fafd81f6fb0 con 0x7fafd8141140 2024-09-17T05:54:35.286 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:35.283+0000 7fafe0069640 1 -- 172.21.15.150:0/2633713025 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fafd8158980 con 0x7fafd8141140 2024-09-17T05:54:35.286 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:35.284+0000 7fafd67fc640 1 -- 172.21.15.150:0/2633713025 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 51) ==== 104960+0+0 (secure 0 0 0) 0x7fafd00051c0 con 0x7fafd8141140 2024-09-17T05:54:35.287 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:35.285+0000 7fafd67fc640 1 --2- 172.21.15.150:0/2633713025 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fafc407b290 0x7fafc407d7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:54:35.287 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:35.285+0000 7fafd67fc640 1 -- 172.21.15.150:0/2633713025 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(147..147 src has 1..147) ==== 5167+0+0 (secure 0 0 0) 0x7fafd009b290 con 0x7fafd8141140 2024-09-17T05:54:35.287 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:35.285+0000 7fafd67fc640 1 --2- 172.21.15.150:0/2633713025 >> [v2:172.21.15.176:6802/3239587708,v1:172.21.15.176:6803/3239587708] conn(0x7fafc40813e0 0x7fafc40838d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:54:35.287 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:35.285+0000 7fafd67fc640 1 -- 172.21.15.150:0/2633713025 --> [v2:172.21.15.176:6802/3239587708,v1:172.21.15.176:6803/3239587708] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fafd0016ec0 con 0x7fafc40813e0 2024-09-17T05:54:35.287 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:35.285+0000 7fafd67fc640 1 -- 172.21.15.150:0/2633713025 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_get_version_reply(handle=1 version=147) ==== 24+0+0 (secure 0 0 0) 0x7fafd009b9c0 con 0x7fafd8141140 2024-09-17T05:54:35.287 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:35.285+0000 7fafdde05640 1 --2- 172.21.15.150:0/2633713025 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fafc407b290 0x7fafc407d7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:54:35.287 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:35.285+0000 7fafdd604640 1 --2- 172.21.15.150:0/2633713025 >> [v2:172.21.15.176:6802/3239587708,v1:172.21.15.176:6803/3239587708] conn(0x7fafc40813e0 0x7fafc40838d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:54:35.287 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:35.286+0000 7fafdde05640 1 --2- 172.21.15.150:0/2633713025 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fafc407b290 0x7fafc407d7a0 secure :-1 s=READY pgs=870 cs=0 l=1 rev1=1 crypto rx=0x7fafc8033000 tx=0x7fafc8004730 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:54:35.287 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:35.286+0000 7fafdd604640 1 --2- 172.21.15.150:0/2633713025 >> [v2:172.21.15.176:6802/3239587708,v1:172.21.15.176:6803/3239587708] conn(0x7fafc40813e0 0x7fafc40838d0 crc :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:54:35.288 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:35.287+0000 7fafd67fc640 1 -- 172.21.15.150:0/2633713025 <== osd.7 v2:172.21.15.176:6802/3239587708 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fafd0016ec0 con 0x7fafc40813e0 2024-09-17T05:54:35.299 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:35.299+0000 7fafe0069640 1 -- 172.21.15.150:0/2633713025 --> [v2:172.21.15.176:6802/3239587708,v1:172.21.15.176:6803/3239587708] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7fafd8141aa0 con 0x7fafc40813e0 2024-09-17T05:54:35.300 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:35.300+0000 7fafd67fc640 1 -- 172.21.15.150:0/2633713025 <== osd.7 v2:172.21.15.176:6802/3239587708 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7fafd8141aa0 con 0x7fafc40813e0 2024-09-17T05:54:35.300 INFO:teuthology.orchestra.run.smithi150.stdout:{ 2024-09-17T05:54:35.301 INFO:teuthology.orchestra.run.smithi150.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-17T05:54:35.301 INFO:teuthology.orchestra.run.smithi150.stdout:} 2024-09-17T05:54:35.301 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:35.300+0000 7fafe0069640 1 -- 172.21.15.150:0/2633713025 >> [v2:172.21.15.176:6802/3239587708,v1:172.21.15.176:6803/3239587708] conn(0x7fafc40813e0 msgr2=0x7fafc40838d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:54:35.302 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:35.300+0000 7fafe0069640 1 --2- 172.21.15.150:0/2633713025 >> [v2:172.21.15.176:6802/3239587708,v1:172.21.15.176:6803/3239587708] conn(0x7fafc40813e0 0x7fafc40838d0 crc :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:54:35.302 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:35.300+0000 7fafe0069640 1 -- 172.21.15.150:0/2633713025 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fafc407b290 msgr2=0x7fafc407d7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:54:35.302 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:35.300+0000 7fafe0069640 1 --2- 172.21.15.150:0/2633713025 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fafc407b290 0x7fafc407d7a0 secure :-1 s=READY pgs=870 cs=0 l=1 rev1=1 crypto rx=0x7fafc8033000 tx=0x7fafc8004730 comp rx=0 tx=0).stop 2024-09-17T05:54:35.302 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:35.300+0000 7fafe0069640 1 -- 172.21.15.150:0/2633713025 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fafd8141140 msgr2=0x7fafd813f0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:54:35.302 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:35.300+0000 7fafe0069640 1 --2- 172.21.15.150:0/2633713025 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fafd8141140 0x7fafd813f0f0 secure :-1 s=READY pgs=2049 cs=0 l=1 rev1=1 crypto rx=0x7fafd000eab0 tx=0x7fafd000ef70 comp rx=0 tx=0).stop 2024-09-17T05:54:35.302 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:35.300+0000 7fafde606640 1 -- 172.21.15.150:0/2633713025 reap_dead start 2024-09-17T05:54:35.302 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:35.300+0000 7fafe0069640 1 -- 172.21.15.150:0/2633713025 shutdown_connections 2024-09-17T05:54:35.302 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:35.300+0000 7fafe0069640 1 -- 172.21.15.150:0/2633713025 >> 172.21.15.150:0/2633713025 conn(0x7fafd806d3d0 msgr2=0x7fafd80d06c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:54:35.302 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:35.300+0000 7fafe0069640 1 -- 172.21.15.150:0/2633713025 shutdown_connections 2024-09-17T05:54:35.302 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:35.300+0000 7fafe0069640 1 -- 172.21.15.150:0/2633713025 wait complete. 2024-09-17T05:54:35.311 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 7 2024-09-17T05:54:35.425 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:35.424+0000 7f3195aec640 1 -- 172.21.15.150:0/2121810248 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3190160f60 msgr2=0x7f31900cd0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:54:35.425 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:35.424+0000 7f3195aec640 1 --2- 172.21.15.150:0/2121810248 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3190160f60 0x7f31900cd0f0 secure :-1 s=READY pgs=2051 cs=0 l=1 rev1=1 crypto rx=0x7f3188005fd0 tx=0x7f318802a8b0 comp rx=0 tx=0).stop 2024-09-17T05:54:35.425 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:35.424+0000 7f3195aec640 1 -- 172.21.15.150:0/2121810248 shutdown_connections 2024-09-17T05:54:35.425 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:35.424+0000 7f3195aec640 1 --2- 172.21.15.150:0/2121810248 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3190160f60 0x7f31900cd0f0 unknown :-1 s=CLOSED pgs=2051 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:54:35.425 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:35.424+0000 7f3195aec640 1 --2- 172.21.15.150:0/2121810248 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f31900cea50 0x7f31900d0270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:54:35.426 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:35.424+0000 7f3195aec640 1 -- 172.21.15.150:0/2121810248 >> 172.21.15.150:0/2121810248 conn(0x7f31900cee80 msgr2=0x7f31900cf290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:54:35.426 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:35.424+0000 7f3195aec640 1 -- 172.21.15.150:0/2121810248 shutdown_connections 2024-09-17T05:54:35.426 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:35.424+0000 7f3195aec640 1 -- 172.21.15.150:0/2121810248 wait complete. 2024-09-17T05:54:35.426 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:35.426+0000 7f3195aec640 1 Processor -- start 2024-09-17T05:54:35.426 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:35.426+0000 7f3195aec640 1 -- start start 2024-09-17T05:54:35.429 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:35.427+0000 7f3195aec640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f31900c5a90 0x7f3190158c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:54:35.429 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:35.427+0000 7f3195aec640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f31900cea50 0x7f3190155610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:54:35.429 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:35.427+0000 7f3195aec640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3190160f60 0x7f319015d580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:54:35.429 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:35.427+0000 7f3195aec640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f31901614f0 con 0x7f31900c5a90 2024-09-17T05:54:35.430 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:35.427+0000 7f3195aec640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f3190161370 con 0x7f31900cea50 2024-09-17T05:54:35.430 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:35.427+0000 7f3195aec640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f3190161670 con 0x7f3190160f60 2024-09-17T05:54:35.430 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:35.427+0000 7f318f7fe640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f31900c5a90 0x7f3190158c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:54:35.430 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:35.427+0000 7f318f7fe640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f31900c5a90 0x7f3190158c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:39096/0 (socket says 172.21.15.150:39096) 2024-09-17T05:54:35.430 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:35.427+0000 7f318f7fe640 1 -- 172.21.15.150:0/3313849504 learned_addr learned my addr 172.21.15.150:0/3313849504 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:54:35.430 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:35.427+0000 7f318ffff640 1 --2- 172.21.15.150:0/3313849504 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3190160f60 0x7f319015d580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:54:35.430 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:35.428+0000 7f318effd640 1 --2- 172.21.15.150:0/3313849504 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f31900cea50 0x7f3190155610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:54:35.430 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:35.428+0000 7f318f7fe640 1 -- 172.21.15.150:0/3313849504 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3190160f60 msgr2=0x7f319015d580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:54:35.430 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:35.428+0000 7f318f7fe640 1 --2- 172.21.15.150:0/3313849504 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3190160f60 0x7f319015d580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:54:35.430 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:35.428+0000 7f318f7fe640 1 -- 172.21.15.150:0/3313849504 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f31900cea50 msgr2=0x7f3190155610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:54:35.430 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:35.428+0000 7f318f7fe640 1 --2- 172.21.15.150:0/3313849504 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f31900cea50 0x7f3190155610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:54:35.430 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:35.428+0000 7f318f7fe640 1 -- 172.21.15.150:0/3313849504 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3190156540 con 0x7f31900c5a90 2024-09-17T05:54:35.430 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:35.428+0000 7f318f7fe640 1 --2- 172.21.15.150:0/3313849504 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f31900c5a90 0x7f3190158c30 secure :-1 s=READY pgs=2052 cs=0 l=1 rev1=1 crypto rx=0x7f318000c940 tx=0x7f318000ce00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:54:35.431 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:35.428+0000 7f3177fff640 1 -- 172.21.15.150:0/3313849504 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3180004220 con 0x7f31900c5a90 2024-09-17T05:54:35.431 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:35.428+0000 7f3177fff640 1 -- 172.21.15.150:0/3313849504 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f31800079b0 con 0x7f31900c5a90 2024-09-17T05:54:35.431 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:35.428+0000 7f3195aec640 1 -- 172.21.15.150:0/3313849504 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3190156820 con 0x7f31900c5a90 2024-09-17T05:54:35.431 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:35.428+0000 7f3177fff640 1 -- 172.21.15.150:0/3313849504 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3180007e00 con 0x7f31900c5a90 2024-09-17T05:54:35.431 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:35.428+0000 7f3195aec640 1 -- 172.21.15.150:0/3313849504 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3190156de0 con 0x7f31900c5a90 2024-09-17T05:54:35.432 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:35.429+0000 7f3195aec640 1 -- 172.21.15.150:0/3313849504 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f31900d0270 con 0x7f31900c5a90 2024-09-17T05:54:35.432 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:35.431+0000 7f3177fff640 1 -- 172.21.15.150:0/3313849504 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 51) ==== 104960+0+0 (secure 0 0 0) 0x7f3180005030 con 0x7f31900c5a90 2024-09-17T05:54:35.432 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:35.431+0000 7f3177fff640 1 --2- 172.21.15.150:0/3313849504 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f317c07b260 0x7f317c07d770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:54:35.432 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:35.431+0000 7f3177fff640 1 -- 172.21.15.150:0/3313849504 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(147..147 src has 1..147) ==== 5167+0+0 (secure 0 0 0) 0x7f318009a8d0 con 0x7f31900c5a90 2024-09-17T05:54:35.432 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:35.431+0000 7f318effd640 1 --2- 172.21.15.150:0/3313849504 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f317c07b260 0x7f317c07d770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:54:35.432 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:35.432+0000 7f318effd640 1 --2- 172.21.15.150:0/3313849504 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f317c07b260 0x7f317c07d770 secure :-1 s=READY pgs=871 cs=0 l=1 rev1=1 crypto rx=0x7f31900b7a70 tx=0x7f3184009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:54:35.435 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:35.434+0000 7f3177fff640 1 -- 172.21.15.150:0/3313849504 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f3180014070 con 0x7f31900c5a90 2024-09-17T05:54:35.610 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:35.609+0000 7f3195aec640 1 -- 172.21.15.150:0/3313849504 --> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "7", "target": ["mon-mgr", ""]}) -- 0x7f319015bad0 con 0x7f317c07b260 2024-09-17T05:54:35.610 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:35.609+0000 7f3177fff640 1 -- 172.21.15.150:0/3313849504 <== mgr.4108 v2:172.21.15.176:6800/3631216395 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 7 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f319015bad0 con 0x7f317c07b260 2024-09-17T05:54:35.610 INFO:teuthology.orchestra.run.smithi150.stderr:instructed osd(s) 7 to deep-scrub 2024-09-17T05:54:35.613 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:35.612+0000 7f3195aec640 1 -- 172.21.15.150:0/3313849504 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f317c07b260 msgr2=0x7f317c07d770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:54:35.613 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:35.612+0000 7f3195aec640 1 --2- 172.21.15.150:0/3313849504 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f317c07b260 0x7f317c07d770 secure :-1 s=READY pgs=871 cs=0 l=1 rev1=1 crypto rx=0x7f31900b7a70 tx=0x7f3184009040 comp rx=0 tx=0).stop 2024-09-17T05:54:35.613 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:35.612+0000 7f3195aec640 1 -- 172.21.15.150:0/3313849504 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f31900c5a90 msgr2=0x7f3190158c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:54:35.613 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:35.612+0000 7f3195aec640 1 --2- 172.21.15.150:0/3313849504 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f31900c5a90 0x7f3190158c30 secure :-1 s=READY pgs=2052 cs=0 l=1 rev1=1 crypto rx=0x7f318000c940 tx=0x7f318000ce00 comp rx=0 tx=0).stop 2024-09-17T05:54:35.613 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:35.612+0000 7f3195aec640 1 -- 172.21.15.150:0/3313849504 shutdown_connections 2024-09-17T05:54:35.613 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:35.612+0000 7f3195aec640 1 --2- 172.21.15.150:0/3313849504 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f31900cea50 0x7f3190155610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:54:35.613 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:35.612+0000 7f3195aec640 1 --2- 172.21.15.150:0/3313849504 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f317c07b260 0x7f317c07d770 unknown :-1 s=CLOSED pgs=871 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:54:35.613 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:35.612+0000 7f3195aec640 1 --2- 172.21.15.150:0/3313849504 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3190160f60 0x7f319015d580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:54:35.614 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:35.612+0000 7f3195aec640 1 --2- 172.21.15.150:0/3313849504 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f31900c5a90 0x7f3190158c30 unknown :-1 s=CLOSED pgs=2052 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:54:35.614 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:35.612+0000 7f3195aec640 1 -- 172.21.15.150:0/3313849504 >> 172.21.15.150:0/3313849504 conn(0x7f31900cee80 msgr2=0x7f31900d0ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:54:35.614 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:35.612+0000 7f3195aec640 1 -- 172.21.15.150:0/3313849504 shutdown_connections 2024-09-17T05:54:35.614 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:35.612+0000 7f3195aec640 1 -- 172.21.15.150:0/3313849504 wait complete. 2024-09-17T05:54:35.624 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-17T05:54:35.737 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:35.736+0000 7f79d8958640 1 -- 172.21.15.150:0/2621711295 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f79d41528b0 msgr2=0x7f79d415fa40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:54:35.737 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:35.736+0000 7f79d8958640 1 --2- 172.21.15.150:0/2621711295 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f79d41528b0 0x7f79d415fa40 secure :-1 s=READY pgs=2053 cs=0 l=1 rev1=1 crypto rx=0x7f79d40b07c0 tx=0x7f79bc02a5f0 comp rx=0 tx=0).stop 2024-09-17T05:54:35.738 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:35.736+0000 7f79d8958640 1 -- 172.21.15.150:0/2621711295 shutdown_connections 2024-09-17T05:54:35.738 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:35.736+0000 7f79d8958640 1 --2- 172.21.15.150:0/2621711295 >> v2:172.21.15.176:3300/0 conn(0x7f79d40705b0 0x7f79d40709c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:54:35.738 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:35.736+0000 7f79d8958640 1 --2- 172.21.15.150:0/2621711295 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f79d41528b0 0x7f79d415fa40 unknown :-1 s=CLOSED pgs=2053 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:54:35.738 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:35.736+0000 7f79d8958640 1 -- 172.21.15.150:0/2621711295 >> 172.21.15.150:0/2621711295 conn(0x7f79d40d0b50 msgr2=0x7f79d40d0f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:54:35.738 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:35.737+0000 7f79d8958640 1 -- 172.21.15.150:0/2621711295 shutdown_connections 2024-09-17T05:54:35.738 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:35.737+0000 7f79d8958640 1 -- 172.21.15.150:0/2621711295 wait complete. 2024-09-17T05:54:35.739 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:35.739+0000 7f79d8958640 1 Processor -- start 2024-09-17T05:54:35.739 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:35.739+0000 7f79d8958640 1 -- start start 2024-09-17T05:54:35.742 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:35.740+0000 7f79d8958640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f79d40705b0 0x7f79d4156400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:54:35.742 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:35.740+0000 7f79d8958640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f79d40cd040 0x7f79d4157cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:54:35.742 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:35.740+0000 7f79d8958640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f79d41528b0 0x7f79d41536a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:54:35.742 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:35.740+0000 7f79d8958640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f79d4071290 con 0x7f79d40cd040 2024-09-17T05:54:35.742 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:35.740+0000 7f79d8958640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f79d4071110 con 0x7f79d40705b0 2024-09-17T05:54:35.743 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:35.740+0000 7f79d8958640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f79d4071410 con 0x7f79d41528b0 2024-09-17T05:54:35.743 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:35.740+0000 7f79c9d9b640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f79d40cd040 0x7f79d4157cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:54:35.743 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:35.740+0000 7f79c9d9b640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f79d40cd040 0x7f79d4157cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:39116/0 (socket says 172.21.15.150:39116) 2024-09-17T05:54:35.743 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:35.740+0000 7f79c9d9b640 1 -- 172.21.15.150:0/1012743736 learned_addr learned my addr 172.21.15.150:0/1012743736 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:54:35.743 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:35.740+0000 7f79d259c640 1 --2- 172.21.15.150:0/1012743736 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f79d40705b0 0x7f79d4156400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:54:35.743 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:35.740+0000 7f79d2d9d640 1 --2- 172.21.15.150:0/1012743736 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f79d41528b0 0x7f79d41536a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:54:35.743 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:35.740+0000 7f79c9d9b640 1 -- 172.21.15.150:0/1012743736 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f79d41528b0 msgr2=0x7f79d41536a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:54:35.743 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:35.740+0000 7f79c9d9b640 1 --2- 172.21.15.150:0/1012743736 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f79d41528b0 0x7f79d41536a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:54:35.743 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:35.740+0000 7f79c9d9b640 1 -- 172.21.15.150:0/1012743736 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f79d40705b0 msgr2=0x7f79d4156400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:54:35.743 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:35.740+0000 7f79c9d9b640 1 --2- 172.21.15.150:0/1012743736 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f79d40705b0 0x7f79d4156400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:54:35.743 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:35.740+0000 7f79c9d9b640 1 -- 172.21.15.150:0/1012743736 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f79d4156c30 con 0x7f79d40cd040 2024-09-17T05:54:35.743 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:35.741+0000 7f79c9d9b640 1 --2- 172.21.15.150:0/1012743736 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f79d40cd040 0x7f79d4157cd0 secure :-1 s=READY pgs=2054 cs=0 l=1 rev1=1 crypto rx=0x7f79bc034040 tx=0x7f79bc003910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:54:35.743 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:35.741+0000 7f79cb7fe640 1 -- 172.21.15.150:0/1012743736 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79bc03e030 con 0x7f79d40cd040 2024-09-17T05:54:35.744 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:35.741+0000 7f79cb7fe640 1 -- 172.21.15.150:0/1012743736 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f79bc003e00 con 0x7f79d40cd040 2024-09-17T05:54:35.744 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:35.741+0000 7f79d8958640 1 -- 172.21.15.150:0/1012743736 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f79d4156f10 con 0x7f79d40cd040 2024-09-17T05:54:35.744 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:35.741+0000 7f79cb7fe640 1 -- 172.21.15.150:0/1012743736 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79bc035040 con 0x7f79d40cd040 2024-09-17T05:54:35.744 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:35.741+0000 7f79d8958640 1 -- 172.21.15.150:0/1012743736 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f79d41574d0 con 0x7f79d40cd040 2024-09-17T05:54:35.745 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:35.742+0000 7f79d8958640 1 -- 172.21.15.150:0/1012743736 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f79d4071930 con 0x7f79d40cd040 2024-09-17T05:54:35.745 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:35.743+0000 7f79cb7fe640 1 -- 172.21.15.150:0/1012743736 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 51) ==== 104960+0+0 (secure 0 0 0) 0x7f79bc041030 con 0x7f79d40cd040 2024-09-17T05:54:35.745 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:35.743+0000 7f79cb7fe640 1 --2- 172.21.15.150:0/1012743736 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f79b407b290 0x7f79b407d7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:54:35.745 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:35.743+0000 7f79cb7fe640 1 -- 172.21.15.150:0/1012743736 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(147..147 src has 1..147) ==== 5167+0+0 (secure 0 0 0) 0x7f79bc0ba7f0 con 0x7f79d40cd040 2024-09-17T05:54:35.745 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:35.744+0000 7f79d259c640 1 --2- 172.21.15.150:0/1012743736 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f79b407b290 0x7f79b407d7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:54:35.745 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:35.744+0000 7f79d259c640 1 --2- 172.21.15.150:0/1012743736 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f79b407b290 0x7f79b407d7a0 secure :-1 s=READY pgs=872 cs=0 l=1 rev1=1 crypto rx=0x7f79c40015e0 tx=0x7f79c4009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:54:35.748 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:35.748+0000 7f79cb7fe640 1 -- 172.21.15.150:0/1012743736 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f79bc084730 con 0x7f79d40cd040 2024-09-17T05:54:35.921 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:35.921+0000 7f79d8958640 1 -- 172.21.15.150:0/1012743736 --> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f79d4075d20 con 0x7f79b407b290 2024-09-17T05:54:35.922 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:35.922+0000 7f79cb7fe640 1 -- 172.21.15.150:0/1012743736 <== mgr.4108 v2:172.21.15.176:6800/3631216395 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+13539 (secure 0 0 0) 0x7f79d4075d20 con 0x7f79b407b290 2024-09-17T05:54:35.923 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-09-17T05:54:35.923 INFO:teuthology.orchestra.run.smithi150.stderr:dumped all 2024-09-17T05:54:35.925 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:35.924+0000 7f79d8958640 1 -- 172.21.15.150:0/1012743736 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f79b407b290 msgr2=0x7f79b407d7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:54:35.925 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:35.924+0000 7f79d8958640 1 --2- 172.21.15.150:0/1012743736 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f79b407b290 0x7f79b407d7a0 secure :-1 s=READY pgs=872 cs=0 l=1 rev1=1 crypto rx=0x7f79c40015e0 tx=0x7f79c4009040 comp rx=0 tx=0).stop 2024-09-17T05:54:35.925 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:35.924+0000 7f79d8958640 1 -- 172.21.15.150:0/1012743736 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f79d40cd040 msgr2=0x7f79d4157cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:54:35.925 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:35.924+0000 7f79d8958640 1 --2- 172.21.15.150:0/1012743736 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f79d40cd040 0x7f79d4157cd0 secure :-1 s=READY pgs=2054 cs=0 l=1 rev1=1 crypto rx=0x7f79bc034040 tx=0x7f79bc003910 comp rx=0 tx=0).stop 2024-09-17T05:54:35.925 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:35.924+0000 7f79d8958640 1 -- 172.21.15.150:0/1012743736 shutdown_connections 2024-09-17T05:54:35.925 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:35.924+0000 7f79d8958640 1 --2- 172.21.15.150:0/1012743736 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7f79b407b290 0x7f79b407d7a0 unknown :-1 s=CLOSED pgs=872 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:54:35.925 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:35.924+0000 7f79d8958640 1 --2- 172.21.15.150:0/1012743736 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f79d41528b0 0x7f79d41536a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:54:35.926 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:35.924+0000 7f79d8958640 1 --2- 172.21.15.150:0/1012743736 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f79d40cd040 0x7f79d4157cd0 unknown :-1 s=CLOSED pgs=2054 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:54:35.926 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:35.924+0000 7f79d8958640 1 --2- 172.21.15.150:0/1012743736 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f79d40705b0 0x7f79d4156400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:54:35.926 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:35.924+0000 7f79d8958640 1 -- 172.21.15.150:0/1012743736 >> 172.21.15.150:0/1012743736 conn(0x7f79d40d0b50 msgr2=0x7f79d40b1270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:54:35.926 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:35.924+0000 7f79d8958640 1 -- 172.21.15.150:0/1012743736 shutdown_connections 2024-09-17T05:54:35.926 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:35.924+0000 7f79d8958640 1 -- 172.21.15.150:0/1012743736 wait complete. 2024-09-17T05:54:35.936 INFO:teuthology.orchestra.run.smithi150.stdout:{"pg_ready":true,"pg_map":{"version":526,"stamp":"2024-09-17T05:54:35.129839+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":17,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":1173836,"kb_used_data":15528,"kb_used_omap":12,"kb_used_meta":1158131,"kb_avail":753800884,"statfs":{"total":773094113280,"available":771892105216,"internally_reserved":0,"allocated":15900672,"data_stored":7698960,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":1185926704},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":12,"apply_latency_ms":12,"commit_latency_ns":12000000,"apply_latency_ns":12000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-2256535552,"num_objects":-538,"num_object_clones":0,"num_object_copies":-1076,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-538,"num_whiteouts":0,"num_read":-3236,"num_read_kb":-13008956,"num_write":-7374,"num_write_kb":-16023596,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":-11,"num_bytes_recovered":-46137344,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.464274"},"pg_stats":[{"pgid":"1.0","version":"19'72","reported_seq":341,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-17T05:54:29.394958+0000","last_change":"2024-09-17T05:41:48.539830+0000","last_active":"2024-09-17T05:54:29.394958+0000","last_peered":"2024-09-17T05:54:29.394958+0000","last_clean":"2024-09-17T05:54:29.394958+0000","last_became_active":"2024-09-17T05:41:48.538743+0000","last_became_peered":"2024-09-17T05:41:48.538743+0000","last_unstale":"2024-09-17T05:54:29.394958+0000","last_undegraded":"2024-09-17T05:54:29.394958+0000","last_fullsized":"2024-09-17T05:54:29.394958+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:41:47.152539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:41:47.152539+0000","last_clean_scrub_stamp":"2024-09-17T05:41:47.152539+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:08:02.952016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":16,"seq":68719476894,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":137048,"kb_used_data":1796,"kb_used_omap":1,"kb_used_meta":135230,"kb_avail":94234792,"statfs":{"total":96636764160,"available":96496427008,"internally_reserved":0,"allocated":1839104,"data_stored":814778,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":138475974},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":7,"up_from":15,"seq":64424509598,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":145952,"kb_used_data":2376,"kb_used_omap":1,"kb_used_meta":143550,"kb_avail":94225888,"statfs":{"total":96636764160,"available":96487309312,"internally_reserved":0,"allocated":2433024,"data_stored":1405146,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":146995658},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509597,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":141208,"kb_used_data":1796,"kb_used_omap":1,"kb_used_meta":139390,"kb_avail":94230632,"statfs":{"total":96636764160,"available":96492167168,"internally_reserved":0,"allocated":1839104,"data_stored":814778,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":142735813},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509597,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":167576,"kb_used_data":1796,"kb_used_omap":1,"kb_used_meta":165758,"kb_avail":94204264,"statfs":{"total":96636764160,"available":96465166336,"internally_reserved":0,"allocated":1839104,"data_stored":814778,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":169736645},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509597,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":127320,"kb_used_data":1796,"kb_used_omap":1,"kb_used_meta":125502,"kb_avail":94244520,"statfs":{"total":96636764160,"available":96506388480,"internally_reserved":0,"allocated":1839104,"data_stored":814778,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":128514503},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509597,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":167576,"kb_used_data":1796,"kb_used_omap":1,"kb_used_meta":165758,"kb_avail":94204264,"statfs":{"total":96636764160,"available":96465166336,"internally_reserved":0,"allocated":1839104,"data_stored":814778,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":169736645},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509597,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":137048,"kb_used_data":1796,"kb_used_omap":1,"kb_used_meta":135230,"kb_avail":94234792,"statfs":{"total":96636764160,"available":96496427008,"internally_reserved":0,"allocated":1839104,"data_stored":814778,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":138475973},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834575005,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":150108,"kb_used_data":2376,"kb_used_omap":1,"kb_used_meta":147710,"kb_avail":94221732,"statfs":{"total":96636764160,"available":96483053568,"internally_reserved":0,"allocated":2433024,"data_stored":1405146,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":151255493},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-17T05:54:35.940 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2024-09-17T05:41:47.152539+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=5, tm_min=41, tm_sec=47, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=5, tm_min=54, tm_sec=30, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T05:54:35.941 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-09-17T05:54:55.942 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-17T05:54:56.071 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:56.068+0000 7fd3a920e640 1 -- 172.21.15.150:0/42286355 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd3a40d1790 msgr2=0x7fd3a40d0400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:54:56.071 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:56.069+0000 7fd3a920e640 1 --2- 172.21.15.150:0/42286355 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd3a40d1790 0x7fd3a40d0400 secure :-1 s=READY pgs=2056 cs=0 l=1 rev1=1 crypto rx=0x7fd39c005fd0 tx=0x7fd39c02a8b0 comp rx=0 tx=0).stop 2024-09-17T05:54:56.071 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:56.069+0000 7fd3a920e640 1 -- 172.21.15.150:0/42286355 shutdown_connections 2024-09-17T05:54:56.071 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:56.069+0000 7fd3a920e640 1 --2- 172.21.15.150:0/42286355 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd3a40d1790 0x7fd3a40d0400 unknown :-1 s=CLOSED pgs=2056 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:54:56.071 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:56.069+0000 7fd3a920e640 1 --2- 172.21.15.150:0/42286355 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd3a40b5d50 0x7fd3a40d2780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:54:56.071 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:56.069+0000 7fd3a920e640 1 -- 172.21.15.150:0/42286355 >> 172.21.15.150:0/42286355 conn(0x7fd3a408bfe0 msgr2=0x7fd3a40d4670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:54:56.071 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:56.069+0000 7fd3a920e640 1 -- 172.21.15.150:0/42286355 shutdown_connections 2024-09-17T05:54:56.072 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:56.069+0000 7fd3a920e640 1 -- 172.21.15.150:0/42286355 wait complete. 2024-09-17T05:54:56.072 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:56.071+0000 7fd3a920e640 1 Processor -- start 2024-09-17T05:54:56.072 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:56.071+0000 7fd3a920e640 1 -- start start 2024-09-17T05:54:56.075 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:56.072+0000 7fd3a920e640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd3a40b5d50 0x7fd3a414bd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:54:56.075 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:56.072+0000 7fd3a920e640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd3a40d4f90 0x7fd3a40b4c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:54:56.075 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:56.072+0000 7fd3a920e640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd3a41f9a40 0x7fd3a414b5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:54:56.075 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:56.072+0000 7fd3a920e640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7fd3a40b7b00 con 0x7fd3a40d4f90 2024-09-17T05:54:56.075 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:56.072+0000 7fd3a920e640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fd3a40b7980 con 0x7fd3a41f9a40 2024-09-17T05:54:56.075 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:56.072+0000 7fd3a920e640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fd3a40b7c80 con 0x7fd3a40b5d50 2024-09-17T05:54:56.076 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:56.072+0000 7fd39bfff640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd3a40d4f90 0x7fd3a40b4c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:54:56.076 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:56.072+0000 7fd39bfff640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd3a40d4f90 0x7fd3a40b4c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:54214/0 (socket says 172.21.15.150:54214) 2024-09-17T05:54:56.076 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:56.072+0000 7fd39bfff640 1 -- 172.21.15.150:0/2825560306 learned_addr learned my addr 172.21.15.150:0/2825560306 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:54:56.076 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:56.072+0000 7fd3a359e640 1 --2- 172.21.15.150:0/2825560306 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd3a41f9a40 0x7fd3a414b5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:54:56.076 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:56.072+0000 7fd3a2d9d640 1 --2- 172.21.15.150:0/2825560306 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd3a40b5d50 0x7fd3a414bd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:54:56.076 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:56.072+0000 7fd39bfff640 1 -- 172.21.15.150:0/2825560306 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd3a40b5d50 msgr2=0x7fd3a414bd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:54:56.076 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:56.072+0000 7fd39bfff640 1 --2- 172.21.15.150:0/2825560306 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd3a40b5d50 0x7fd3a414bd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:54:56.076 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:56.072+0000 7fd39bfff640 1 -- 172.21.15.150:0/2825560306 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd3a41f9a40 msgr2=0x7fd3a414b5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:54:56.076 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:56.072+0000 7fd39bfff640 1 --2- 172.21.15.150:0/2825560306 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd3a41f9a40 0x7fd3a414b5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:54:56.076 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:56.072+0000 7fd39bfff640 1 -- 172.21.15.150:0/2825560306 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd3a40b12c0 con 0x7fd3a40d4f90 2024-09-17T05:54:56.076 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:56.072+0000 7fd3a359e640 1 --2- 172.21.15.150:0/2825560306 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd3a41f9a40 0x7fd3a414b5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T05:54:56.076 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:56.072+0000 7fd3a2d9d640 1 --2- 172.21.15.150:0/2825560306 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd3a40b5d50 0x7fd3a414bd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T05:54:56.077 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:56.072+0000 7fd39bfff640 1 --2- 172.21.15.150:0/2825560306 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd3a40d4f90 0x7fd3a40b4c90 secure :-1 s=READY pgs=2057 cs=0 l=1 rev1=1 crypto rx=0x7fd38c00c430 tx=0x7fd38c00c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:54:56.077 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:56.073+0000 7fd39b7fe640 1 -- 172.21.15.150:0/2825560306 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd38c011790 con 0x7fd3a40d4f90 2024-09-17T05:54:56.077 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:56.073+0000 7fd39b7fe640 1 -- 172.21.15.150:0/2825560306 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd38c017070 con 0x7fd3a40d4f90 2024-09-17T05:54:56.077 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:56.073+0000 7fd3a920e640 1 -- 172.21.15.150:0/2825560306 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd3a40b1560 con 0x7fd3a40d4f90 2024-09-17T05:54:56.077 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:56.073+0000 7fd39b7fe640 1 -- 172.21.15.150:0/2825560306 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd38c011cc0 con 0x7fd3a40d4f90 2024-09-17T05:54:56.077 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:56.073+0000 7fd3a920e640 1 -- 172.21.15.150:0/2825560306 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd3a40b1b20 con 0x7fd3a40d4f90 2024-09-17T05:54:56.077 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:56.074+0000 7fd3a920e640 1 -- 172.21.15.150:0/2825560306 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd3a40d2780 con 0x7fd3a40d4f90 2024-09-17T05:54:56.078 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:56.074+0000 7fd39b7fe640 1 -- 172.21.15.150:0/2825560306 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 51) ==== 104960+0+0 (secure 0 0 0) 0x7fd38c01c460 con 0x7fd3a40d4f90 2024-09-17T05:54:56.078 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:56.075+0000 7fd39b7fe640 1 --2- 172.21.15.150:0/2825560306 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fd38407b290 0x7fd38407d7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:54:56.078 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:56.075+0000 7fd39b7fe640 1 -- 172.21.15.150:0/2825560306 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(147..147 src has 1..147) ==== 5167+0+0 (secure 0 0 0) 0x7fd38c099b60 con 0x7fd3a40d4f90 2024-09-17T05:54:56.078 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:56.075+0000 7fd3a2d9d640 1 --2- 172.21.15.150:0/2825560306 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fd38407b290 0x7fd38407d7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:54:56.078 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:56.076+0000 7fd3a2d9d640 1 --2- 172.21.15.150:0/2825560306 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fd38407b290 0x7fd38407d7a0 secure :-1 s=READY pgs=873 cs=0 l=1 rev1=1 crypto rx=0x7fd394009aa0 tx=0x7fd394005db0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:54:56.081 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:56.080+0000 7fd39b7fe640 1 -- 172.21.15.150:0/2825560306 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fd38c021020 con 0x7fd3a40d4f90 2024-09-17T05:54:56.252 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:56.251+0000 7fd3a920e640 1 -- 172.21.15.150:0/2825560306 --> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fd3a40cec50 con 0x7fd38407b290 2024-09-17T05:54:56.254 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:56.252+0000 7fd39b7fe640 1 -- 172.21.15.150:0/2825560306 <== mgr.4108 v2:172.21.15.176:6800/3631216395 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+13391 (secure 0 0 0) 0x7fd3a40cec50 con 0x7fd38407b290 2024-09-17T05:54:56.254 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-09-17T05:54:56.254 INFO:teuthology.orchestra.run.smithi150.stderr:dumped all 2024-09-17T05:54:56.256 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:56.254+0000 7fd3a920e640 1 -- 172.21.15.150:0/2825560306 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fd38407b290 msgr2=0x7fd38407d7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:54:56.256 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:56.254+0000 7fd3a920e640 1 --2- 172.21.15.150:0/2825560306 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fd38407b290 0x7fd38407d7a0 secure :-1 s=READY pgs=873 cs=0 l=1 rev1=1 crypto rx=0x7fd394009aa0 tx=0x7fd394005db0 comp rx=0 tx=0).stop 2024-09-17T05:54:56.256 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:56.254+0000 7fd3a920e640 1 -- 172.21.15.150:0/2825560306 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd3a40d4f90 msgr2=0x7fd3a40b4c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:54:56.257 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:56.254+0000 7fd3a920e640 1 --2- 172.21.15.150:0/2825560306 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd3a40d4f90 0x7fd3a40b4c90 secure :-1 s=READY pgs=2057 cs=0 l=1 rev1=1 crypto rx=0x7fd38c00c430 tx=0x7fd38c00c8f0 comp rx=0 tx=0).stop 2024-09-17T05:54:56.257 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:56.254+0000 7fd3a920e640 1 -- 172.21.15.150:0/2825560306 shutdown_connections 2024-09-17T05:54:56.257 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:56.254+0000 7fd3a920e640 1 --2- 172.21.15.150:0/2825560306 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd3a41f9a40 0x7fd3a414b5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:54:56.257 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:56.254+0000 7fd3a920e640 1 --2- 172.21.15.150:0/2825560306 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fd38407b290 0x7fd38407d7a0 unknown :-1 s=CLOSED pgs=873 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:54:56.257 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:56.254+0000 7fd3a920e640 1 --2- 172.21.15.150:0/2825560306 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd3a40d4f90 0x7fd3a40b4c90 unknown :-1 s=CLOSED pgs=2057 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:54:56.257 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:56.254+0000 7fd3a920e640 1 --2- 172.21.15.150:0/2825560306 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd3a40b5d50 0x7fd3a414bd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:54:56.257 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:56.254+0000 7fd3a920e640 1 -- 172.21.15.150:0/2825560306 >> 172.21.15.150:0/2825560306 conn(0x7fd3a408bfe0 msgr2=0x7fd3a406f260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:54:56.257 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:56.254+0000 7fd3a920e640 1 -- 172.21.15.150:0/2825560306 shutdown_connections 2024-09-17T05:54:56.257 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:56.254+0000 7fd3a920e640 1 -- 172.21.15.150:0/2825560306 wait complete. 2024-09-17T05:54:56.267 INFO:teuthology.orchestra.run.smithi150.stdout:{"pg_ready":true,"pg_map":{"version":536,"stamp":"2024-09-17T05:54:55.134741+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":74,"ondisk_log_size":74,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":1173824,"kb_used_data":15528,"kb_used_omap":12,"kb_used_meta":1158131,"kb_avail":753800896,"statfs":{"total":773094113280,"available":771892117504,"internally_reserved":0,"allocated":15900672,"data_stored":7698960,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":1185926704},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002841"},"pg_stats":[{"pgid":"1.0","version":"147'74","reported_seq":351,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-17T05:54:36.045845+0000","last_change":"2024-09-17T05:54:36.045845+0000","last_active":"2024-09-17T05:54:36.045845+0000","last_peered":"2024-09-17T05:54:36.045845+0000","last_clean":"2024-09-17T05:54:36.045845+0000","last_became_active":"2024-09-17T05:41:48.538743+0000","last_became_peered":"2024-09-17T05:41:48.538743+0000","last_unstale":"2024-09-17T05:54:36.045845+0000","last_undegraded":"2024-09-17T05:54:36.045845+0000","last_fullsized":"2024-09-17T05:54:36.045845+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"147'74","last_scrub_stamp":"2024-09-17T05:54:36.045736+0000","last_deep_scrub":"147'74","last_deep_scrub_stamp":"2024-09-17T05:54:36.045736+0000","last_clean_scrub_stamp":"2024-09-17T05:54:36.045736+0000","objects_scrubbed":2,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:44:47.264134+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":74,"ondisk_log_size":74,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":16,"seq":68719476898,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":137048,"kb_used_data":1796,"kb_used_omap":1,"kb_used_meta":135230,"kb_avail":94234792,"statfs":{"total":96636764160,"available":96496427008,"internally_reserved":0,"allocated":1839104,"data_stored":814778,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":138475974},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":15,"seq":64424509602,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":145944,"kb_used_data":2376,"kb_used_omap":1,"kb_used_meta":143550,"kb_avail":94225896,"statfs":{"total":96636764160,"available":96487317504,"internally_reserved":0,"allocated":2433024,"data_stored":1405146,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":146995658},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509601,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":141208,"kb_used_data":1796,"kb_used_omap":1,"kb_used_meta":139390,"kb_avail":94230632,"statfs":{"total":96636764160,"available":96492167168,"internally_reserved":0,"allocated":1839104,"data_stored":814778,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":142735813},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509601,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":167576,"kb_used_data":1796,"kb_used_omap":1,"kb_used_meta":165758,"kb_avail":94204264,"statfs":{"total":96636764160,"available":96465166336,"internally_reserved":0,"allocated":1839104,"data_stored":814778,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":169736645},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509601,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":127320,"kb_used_data":1796,"kb_used_omap":1,"kb_used_meta":125502,"kb_avail":94244520,"statfs":{"total":96636764160,"available":96506388480,"internally_reserved":0,"allocated":1839104,"data_stored":814778,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":128514503},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509601,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":167576,"kb_used_data":1796,"kb_used_omap":1,"kb_used_meta":165758,"kb_avail":94204264,"statfs":{"total":96636764160,"available":96465166336,"internally_reserved":0,"allocated":1839104,"data_stored":814778,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":169736645},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509601,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":137048,"kb_used_data":1796,"kb_used_omap":1,"kb_used_meta":135230,"kb_avail":94234792,"statfs":{"total":96636764160,"available":96496427008,"internally_reserved":0,"allocated":1839104,"data_stored":814778,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":138475973},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834575009,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":150104,"kb_used_data":2376,"kb_used_omap":1,"kb_used_meta":147710,"kb_avail":94221736,"statfs":{"total":96636764160,"available":96483057664,"internally_reserved":0,"allocated":2433024,"data_stored":1405146,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":151255493},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-17T05:54:56.268 DEBUG:teuthology.orchestra.run.smithi150:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2024-09-17T05:54:56.382 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:56.380+0000 7fa7955c3640 1 -- 172.21.15.150:0/2524066748 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa790160200 msgr2=0x7fa7900b4e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:54:56.383 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:56.380+0000 7fa7955c3640 1 --2- 172.21.15.150:0/2524066748 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa790160200 0x7fa7900b4e50 secure :-1 s=READY pgs=2058 cs=0 l=1 rev1=1 crypto rx=0x7fa7900d23c0 tx=0x7fa78802a980 comp rx=0 tx=0).stop 2024-09-17T05:54:56.383 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:56.380+0000 7fa7955c3640 1 -- 172.21.15.150:0/2524066748 shutdown_connections 2024-09-17T05:54:56.383 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:56.380+0000 7fa7955c3640 1 --2- 172.21.15.150:0/2524066748 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa790160200 0x7fa7900b4e50 unknown :-1 s=CLOSED pgs=2058 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:54:56.383 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:56.380+0000 7fa7955c3640 1 --2- 172.21.15.150:0/2524066748 >> v2:172.21.15.176:3300/0 conn(0x7fa7900b6550 0x7fa7900b24c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:54:56.383 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:56.380+0000 7fa7955c3640 1 -- 172.21.15.150:0/2524066748 >> 172.21.15.150:0/2524066748 conn(0x7fa7900b2e80 msgr2=0x7fa7900b3290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:54:56.383 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:56.380+0000 7fa7955c3640 1 -- 172.21.15.150:0/2524066748 shutdown_connections 2024-09-17T05:54:56.383 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:56.380+0000 7fa7955c3640 1 -- 172.21.15.150:0/2524066748 wait complete. 2024-09-17T05:54:56.384 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:56.382+0000 7fa7955c3640 1 Processor -- start 2024-09-17T05:54:56.384 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:56.382+0000 7fa7955c3640 1 -- start start 2024-09-17T05:54:56.386 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:56.383+0000 7fa7955c3640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa7900b2a00 0x7fa7900b1440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:54:56.386 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:56.383+0000 7fa7955c3640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa7900b6550 0x7fa790150a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:54:56.387 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:56.383+0000 7fa7955c3640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa790160200 0x7fa7900ae5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:54:56.387 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:56.383+0000 7fa7955c3640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7fa7900b3da0 con 0x7fa7900b6550 2024-09-17T05:54:56.387 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:56.383+0000 7fa7955c3640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fa790160820 con 0x7fa790160200 2024-09-17T05:54:56.387 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:56.383+0000 7fa7955c3640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fa7900b5390 con 0x7fa7900b2a00 2024-09-17T05:54:56.387 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:56.384+0000 7fa787fff640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa7900b6550 0x7fa790150a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:54:56.387 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:56.384+0000 7fa787fff640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa7900b6550 0x7fa790150a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:54234/0 (socket says 172.21.15.150:54234) 2024-09-17T05:54:56.387 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:56.384+0000 7fa787fff640 1 -- 172.21.15.150:0/1758058592 learned_addr learned my addr 172.21.15.150:0/1758058592 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:54:56.387 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:56.384+0000 7fa78f7fe640 1 --2- 172.21.15.150:0/1758058592 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa790160200 0x7fa7900ae5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:54:56.387 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:56.384+0000 7fa78effd640 1 --2- 172.21.15.150:0/1758058592 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa7900b2a00 0x7fa7900b1440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:54:56.387 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:56.384+0000 7fa787fff640 1 -- 172.21.15.150:0/1758058592 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa7900b2a00 msgr2=0x7fa7900b1440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:54:56.387 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:56.384+0000 7fa787fff640 1 --2- 172.21.15.150:0/1758058592 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa7900b2a00 0x7fa7900b1440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:54:56.387 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:56.384+0000 7fa787fff640 1 -- 172.21.15.150:0/1758058592 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa790160200 msgr2=0x7fa7900ae5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:54:56.388 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:56.384+0000 7fa787fff640 1 --2- 172.21.15.150:0/1758058592 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa790160200 0x7fa7900ae5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:54:56.388 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:56.384+0000 7fa787fff640 1 -- 172.21.15.150:0/1758058592 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa790150fd0 con 0x7fa7900b6550 2024-09-17T05:54:56.388 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:56.384+0000 7fa787fff640 1 --2- 172.21.15.150:0/1758058592 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa7900b6550 0x7fa790150a90 secure :-1 s=READY pgs=2059 cs=0 l=1 rev1=1 crypto rx=0x7fa77800b3e0 tx=0x7fa77800b8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:54:56.388 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:56.384+0000 7fa7877fe640 1 -- 172.21.15.150:0/1758058592 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa778015020 con 0x7fa7900b6550 2024-09-17T05:54:56.388 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:56.384+0000 7fa7877fe640 1 -- 172.21.15.150:0/1758058592 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa778011920 con 0x7fa7900b6550 2024-09-17T05:54:56.389 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:56.384+0000 7fa7955c3640 1 -- 172.21.15.150:0/1758058592 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa7900c5180 con 0x7fa7900b6550 2024-09-17T05:54:56.389 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:56.384+0000 7fa7877fe640 1 -- 172.21.15.150:0/1758058592 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa778011d70 con 0x7fa7900b6550 2024-09-17T05:54:56.389 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:56.384+0000 7fa7955c3640 1 -- 172.21.15.150:0/1758058592 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa7900c5740 con 0x7fa7900b6550 2024-09-17T05:54:56.390 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:56.385+0000 7fa7955c3640 1 -- 172.21.15.150:0/1758058592 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa7900b36c0 con 0x7fa7900b6550 2024-09-17T05:54:56.390 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:56.386+0000 7fa7877fe640 1 -- 172.21.15.150:0/1758058592 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 51) ==== 104960+0+0 (secure 0 0 0) 0x7fa778018020 con 0x7fa7900b6550 2024-09-17T05:54:56.390 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:56.387+0000 7fa7877fe640 1 --2- 172.21.15.150:0/1758058592 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fa77007b260 0x7fa77007d770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:54:56.391 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:56.387+0000 7fa7877fe640 1 -- 172.21.15.150:0/1758058592 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(147..147 src has 1..147) ==== 5167+0+0 (secure 0 0 0) 0x7fa778099df0 con 0x7fa7900b6550 2024-09-17T05:54:56.391 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:56.387+0000 7fa78effd640 1 --2- 172.21.15.150:0/1758058592 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fa77007b260 0x7fa77007d770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:54:56.391 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:56.388+0000 7fa78effd640 1 --2- 172.21.15.150:0/1758058592 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fa77007b260 0x7fa77007d770 secure :-1 s=READY pgs=874 cs=0 l=1 rev1=1 crypto rx=0x7fa7800058c0 tx=0x7fa780005f60 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:54:56.393 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:56.391+0000 7fa7877fe640 1 -- 172.21.15.150:0/1758058592 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fa77801f020 con 0x7fa7900b6550 2024-09-17T05:54:56.567 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:56.566+0000 7fa7955c3640 1 -- 172.21.15.150:0/1758058592 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command([{prefix=config set, name=mon_health_to_clog}] v 0) -- 0x7fa7900c8190 con 0x7fa7900b6550 2024-09-17T05:54:56.571 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:56.569+0000 7fa7877fe640 1 -- 172.21.15.150:0/1758058592 <== mon.0 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_health_to_clog}]=0 v62)=0 v62) ==== 123+0+0 (secure 0 0 0) 0x7fa778063770 con 0x7fa7900b6550 2024-09-17T05:54:56.572 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:56.570+0000 7fa7877fe640 1 -- 172.21.15.150:0/1758058592 <== mon.0 v2:172.21.15.150:3300/0 8 ==== config(6 keys) ==== 172+0+0 (secure 0 0 0) 0x7fa778063280 con 0x7fa7900b6550 2024-09-17T05:54:56.574 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:56.572+0000 7fa7955c3640 1 -- 172.21.15.150:0/1758058592 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fa77007b260 msgr2=0x7fa77007d770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:54:56.575 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:56.572+0000 7fa7955c3640 1 --2- 172.21.15.150:0/1758058592 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fa77007b260 0x7fa77007d770 secure :-1 s=READY pgs=874 cs=0 l=1 rev1=1 crypto rx=0x7fa7800058c0 tx=0x7fa780005f60 comp rx=0 tx=0).stop 2024-09-17T05:54:56.575 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:56.573+0000 7fa7955c3640 1 -- 172.21.15.150:0/1758058592 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa7900b6550 msgr2=0x7fa790150a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:54:56.575 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:56.573+0000 7fa7955c3640 1 --2- 172.21.15.150:0/1758058592 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa7900b6550 0x7fa790150a90 secure :-1 s=READY pgs=2059 cs=0 l=1 rev1=1 crypto rx=0x7fa77800b3e0 tx=0x7fa77800b8a0 comp rx=0 tx=0).stop 2024-09-17T05:54:56.575 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:56.573+0000 7fa7955c3640 1 -- 172.21.15.150:0/1758058592 shutdown_connections 2024-09-17T05:54:56.575 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:56.573+0000 7fa7955c3640 1 --2- 172.21.15.150:0/1758058592 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa790160200 0x7fa7900ae5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:54:56.575 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:56.573+0000 7fa7955c3640 1 --2- 172.21.15.150:0/1758058592 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fa77007b260 0x7fa77007d770 unknown :-1 s=CLOSED pgs=874 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:54:56.575 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:56.573+0000 7fa7955c3640 1 --2- 172.21.15.150:0/1758058592 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa7900b6550 0x7fa790150a90 unknown :-1 s=CLOSED pgs=2059 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:54:56.575 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:56.573+0000 7fa7955c3640 1 --2- 172.21.15.150:0/1758058592 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa7900b2a00 0x7fa7900b1440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:54:56.575 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:56.573+0000 7fa7955c3640 1 -- 172.21.15.150:0/1758058592 >> 172.21.15.150:0/1758058592 conn(0x7fa7900b2e80 msgr2=0x7fa79006cda0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:54:56.575 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:56.573+0000 7fa7955c3640 1 -- 172.21.15.150:0/1758058592 shutdown_connections 2024-09-17T05:54:56.575 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:56.573+0000 7fa7955c3640 1 -- 172.21.15.150:0/1758058592 wait complete. 2024-09-17T05:54:56.586 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-09-17T05:54:56.586 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T05:54:56.699 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:56.697+0000 7fe023c0e640 1 -- 172.21.15.150:0/3401371421 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe01c070040 msgr2=0x7fe01c0ad880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:54:56.699 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:56.697+0000 7fe023c0e640 1 --2- 172.21.15.150:0/3401371421 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe01c070040 0x7fe01c0ad880 secure :-1 s=READY pgs=2061 cs=0 l=1 rev1=1 crypto rx=0x7fe00c009830 tx=0x7fe00c02a480 comp rx=0 tx=0).stop 2024-09-17T05:54:56.699 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:56.697+0000 7fe023c0e640 1 -- 172.21.15.150:0/3401371421 shutdown_connections 2024-09-17T05:54:56.699 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:56.697+0000 7fe023c0e640 1 --2- 172.21.15.150:0/3401371421 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe01c070040 0x7fe01c0ad880 unknown :-1 s=CLOSED pgs=2061 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:54:56.699 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:56.697+0000 7fe023c0e640 1 -- 172.21.15.150:0/3401371421 >> 172.21.15.150:0/3401371421 conn(0x7fe01c06d730 msgr2=0x7fe01c0b1e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:54:56.700 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:56.697+0000 7fe023c0e640 1 -- 172.21.15.150:0/3401371421 shutdown_connections 2024-09-17T05:54:56.700 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:56.697+0000 7fe023c0e640 1 -- 172.21.15.150:0/3401371421 wait complete. 2024-09-17T05:54:56.700 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:56.699+0000 7fe023c0e640 1 Processor -- start 2024-09-17T05:54:56.701 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:56.699+0000 7fe023c0e640 1 -- start start 2024-09-17T05:54:56.703 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:56.700+0000 7fe023c0e640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe01c0707b0 0x7fe01c13d710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:54:56.703 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:56.700+0000 7fe023c0e640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe01c0730b0 0x7fe01c0b1900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:54:56.703 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:56.700+0000 7fe023c0e640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe01c157020 0x7fe01c0b1e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:54:56.703 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:56.700+0000 7fe023c0e640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7fe01c15aff0 con 0x7fe01c0707b0 2024-09-17T05:54:56.703 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:56.700+0000 7fe023c0e640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fe01c0b4320 con 0x7fe01c0730b0 2024-09-17T05:54:56.703 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:56.700+0000 7fe023c0e640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fe01c15b170 con 0x7fe01c157020 2024-09-17T05:54:56.704 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:56.700+0000 7fe0219aa640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe01c0707b0 0x7fe01c13d710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:54:56.704 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:56.700+0000 7fe0219aa640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe01c0707b0 0x7fe01c13d710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:54266/0 (socket says 172.21.15.150:54266) 2024-09-17T05:54:56.704 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:56.700+0000 7fe0219aa640 1 -- 172.21.15.150:0/3260813859 learned_addr learned my addr 172.21.15.150:0/3260813859 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-17T05:54:56.704 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:56.701+0000 7fe0211a9640 1 --2- 172.21.15.150:0/3260813859 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe01c0730b0 0x7fe01c0b1900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:54:56.704 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:56.701+0000 7fe0221ab640 1 --2- 172.21.15.150:0/3260813859 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe01c157020 0x7fe01c0b1e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:54:56.704 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:56.701+0000 7fe0219aa640 1 -- 172.21.15.150:0/3260813859 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe01c157020 msgr2=0x7fe01c0b1e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:54:56.704 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:56.701+0000 7fe0219aa640 1 --2- 172.21.15.150:0/3260813859 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe01c157020 0x7fe01c0b1e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:54:56.704 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:56.701+0000 7fe0219aa640 1 -- 172.21.15.150:0/3260813859 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe01c0730b0 msgr2=0x7fe01c0b1900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:54:56.704 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:56.701+0000 7fe0219aa640 1 --2- 172.21.15.150:0/3260813859 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe01c0730b0 0x7fe01c0b1900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:54:56.704 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:56.701+0000 7fe0219aa640 1 -- 172.21.15.150:0/3260813859 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe01c0afe10 con 0x7fe01c0707b0 2024-09-17T05:54:56.704 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:56.701+0000 7fe0211a9640 1 --2- 172.21.15.150:0/3260813859 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe01c0730b0 0x7fe01c0b1900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:54:56.704 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:56.701+0000 7fe0219aa640 1 --2- 172.21.15.150:0/3260813859 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe01c0707b0 0x7fe01c13d710 secure :-1 s=READY pgs=2062 cs=0 l=1 rev1=1 crypto rx=0x7fe01800b3f0 tx=0x7fe01800b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:54:56.705 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:56.701+0000 7fe0127fc640 1 -- 172.21.15.150:0/3260813859 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe018015020 con 0x7fe01c0707b0 2024-09-17T05:54:56.705 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:56.701+0000 7fe0127fc640 1 -- 172.21.15.150:0/3260813859 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(6 keys) ==== 172+0+0 (secure 0 0 0) 0x7fe018011830 con 0x7fe01c0707b0 2024-09-17T05:54:56.705 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:56.701+0000 7fe0127fc640 1 -- 172.21.15.150:0/3260813859 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe018011ca0 con 0x7fe01c0707b0 2024-09-17T05:54:56.705 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:56.701+0000 7fe023c0e640 1 -- 172.21.15.150:0/3260813859 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe01c0b0360 con 0x7fe01c0707b0 2024-09-17T05:54:56.705 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:56.701+0000 7fe023c0e640 1 -- 172.21.15.150:0/3260813859 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe01c0b0080 con 0x7fe01c0707b0 2024-09-17T05:54:56.706 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:56.702+0000 7fe023c0e640 1 -- 172.21.15.150:0/3260813859 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe01c06f930 con 0x7fe01c0707b0 2024-09-17T05:54:56.706 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:56.703+0000 7fe0127fc640 1 -- 172.21.15.150:0/3260813859 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 51) ==== 104960+0+0 (secure 0 0 0) 0x7fe018018020 con 0x7fe01c0707b0 2024-09-17T05:54:56.706 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:56.704+0000 7fe0127fc640 1 --2- 172.21.15.150:0/3260813859 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fe00007b260 0x7fe00007d770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:54:56.706 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:56.704+0000 7fe0127fc640 1 -- 172.21.15.150:0/3260813859 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(147..147 src has 1..147) ==== 5167+0+0 (secure 0 0 0) 0x7fe01809a1e0 con 0x7fe01c0707b0 2024-09-17T05:54:56.706 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:56.704+0000 7fe0211a9640 1 --2- 172.21.15.150:0/3260813859 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fe00007b260 0x7fe00007d770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:54:56.706 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:56.704+0000 7fe0211a9640 1 --2- 172.21.15.150:0/3260813859 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fe00007b260 0x7fe00007d770 secure :-1 s=READY pgs=875 cs=0 l=1 rev1=1 crypto rx=0x7fe00c034000 tx=0x7fe00c0046c0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:54:56.709 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:56.707+0000 7fe0127fc640 1 -- 172.21.15.150:0/3260813859 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fe01801f030 con 0x7fe01c0707b0 2024-09-17T05:54:56.919 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:56.917+0000 7fe023c0e640 1 -- 172.21.15.150:0/3260813859 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fe01c156160 con 0x7fe01c0707b0 2024-09-17T05:54:56.919 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:56.917+0000 7fe0127fc640 1 -- 172.21.15.150:0/3260813859 <== mon.0 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 91 v91) ==== 94+0+3921 (secure 0 0 0) 0x7fe018064200 con 0x7fe01c0707b0 2024-09-17T05:54:56.919 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-09-17T05:54:56.920 INFO:teuthology.orchestra.run.smithi150.stdout:{"epoch":91,"btime":"2024-09-17T05:54:25:655822+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7418,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6836/984747558","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6834","nonce":984747558},{"type":"v1","addr":"172.21.15.176:6836","nonce":984747558}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":85},{"gid":7421,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6837/1815277837","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6835","nonce":1815277837},{"type":"v1","addr":"172.21.15.176:6837","nonce":1815277837}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":85},{"gid":9630,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6834/2397551288","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6832","nonce":2397551288},{"type":"v1","addr":"172.21.15.150:6834","nonce":2397551288}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":84},{"gid":10191,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6835/1068748684","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6833","nonce":1068748684},{"type":"v1","addr":"172.21.15.150:6835","nonce":1068748684}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":91}],"filesystems":[]} 2024-09-17T05:54:56.920 INFO:teuthology.orchestra.run.smithi150.stderr:dumped fsmap epoch 91 2024-09-17T05:54:56.922 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:56.919+0000 7fe023c0e640 1 -- 172.21.15.150:0/3260813859 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fe00007b260 msgr2=0x7fe00007d770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:54:56.922 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:56.919+0000 7fe023c0e640 1 --2- 172.21.15.150:0/3260813859 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fe00007b260 0x7fe00007d770 secure :-1 s=READY pgs=875 cs=0 l=1 rev1=1 crypto rx=0x7fe00c034000 tx=0x7fe00c0046c0 comp rx=0 tx=0).stop 2024-09-17T05:54:56.922 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:56.919+0000 7fe023c0e640 1 -- 172.21.15.150:0/3260813859 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe01c0707b0 msgr2=0x7fe01c13d710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:54:56.922 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:56.919+0000 7fe023c0e640 1 --2- 172.21.15.150:0/3260813859 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe01c0707b0 0x7fe01c13d710 secure :-1 s=READY pgs=2062 cs=0 l=1 rev1=1 crypto rx=0x7fe01800b3f0 tx=0x7fe01800b8b0 comp rx=0 tx=0).stop 2024-09-17T05:54:56.922 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:56.919+0000 7fe023c0e640 1 -- 172.21.15.150:0/3260813859 shutdown_connections 2024-09-17T05:54:56.922 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:56.920+0000 7fe023c0e640 1 --2- 172.21.15.150:0/3260813859 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe01c0730b0 0x7fe01c0b1900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:54:56.922 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:56.920+0000 7fe023c0e640 1 --2- 172.21.15.150:0/3260813859 >> [v2:172.21.15.176:6800/3631216395,v1:172.21.15.176:6801/3631216395] conn(0x7fe00007b260 0x7fe00007d770 unknown :-1 s=CLOSED pgs=875 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:54:56.923 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:56.920+0000 7fe023c0e640 1 --2- 172.21.15.150:0/3260813859 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe01c157020 0x7fe01c0b1e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:54:56.923 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:56.920+0000 7fe023c0e640 1 --2- 172.21.15.150:0/3260813859 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe01c0707b0 0x7fe01c13d710 unknown :-1 s=CLOSED pgs=2062 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:54:56.923 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:56.920+0000 7fe023c0e640 1 -- 172.21.15.150:0/3260813859 >> 172.21.15.150:0/3260813859 conn(0x7fe01c06d730 msgr2=0x7fe01c073b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:54:56.923 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:56.920+0000 7fe023c0e640 1 -- 172.21.15.150:0/3260813859 shutdown_connections 2024-09-17T05:54:56.923 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-17T05:54:56.920+0000 7fe023c0e640 1 -- 172.21.15.150:0/3260813859 wait complete. 2024-09-17T05:54:56.933 DEBUG:tasks.cephfs.filesystem:already dead... 2024-09-17T05:54:56.933 INFO:teuthology.misc:Shutting down mds daemons... 2024-09-17T05:54:56.934 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-09-17T05:54:56.934 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T05:54:56.943 INFO:tasks.ceph.mds.a:Stopped 2024-09-17T05:54:56.943 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-09-17T05:54:56.943 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T05:54:56.997 INFO:tasks.ceph.mds.c:Stopped 2024-09-17T05:54:56.997 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-09-17T05:54:56.997 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T05:54:57.010 INFO:tasks.ceph.mds.b:Stopped 2024-09-17T05:54:57.010 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-09-17T05:54:57.010 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T05:54:57.062 INFO:tasks.ceph.mds.d:Stopped 2024-09-17T05:54:57.062 INFO:teuthology.misc:Shutting down osd daemons... 2024-09-17T05:54:57.063 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2024-09-17T05:54:57.063 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T05:54:57.100 INFO:tasks.ceph.osd.0:Stopped 2024-09-17T05:54:57.100 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2024-09-17T05:54:57.100 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T05:54:57.179 INFO:tasks.ceph.osd.1:Stopped 2024-09-17T05:54:57.179 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2024-09-17T05:54:57.179 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T05:54:57.254 INFO:tasks.ceph.osd.2:Stopped 2024-09-17T05:54:57.254 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2024-09-17T05:54:57.254 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T05:54:57.329 INFO:tasks.ceph.osd.3:Stopped 2024-09-17T05:54:57.329 DEBUG:tasks.ceph.osd.4:waiting for process to exit 2024-09-17T05:54:57.329 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T05:54:57.373 INFO:tasks.ceph.osd.4:Stopped 2024-09-17T05:54:57.374 DEBUG:tasks.ceph.osd.5:waiting for process to exit 2024-09-17T05:54:57.374 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T05:54:57.422 INFO:tasks.ceph.osd.5:Stopped 2024-09-17T05:54:57.422 DEBUG:tasks.ceph.osd.6:waiting for process to exit 2024-09-17T05:54:57.422 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T05:54:57.468 INFO:tasks.ceph.osd.6:Stopped 2024-09-17T05:54:57.468 DEBUG:tasks.ceph.osd.7:waiting for process to exit 2024-09-17T05:54:57.468 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T05:54:57.512 INFO:tasks.ceph.osd.7:Stopped 2024-09-17T05:54:57.513 INFO:teuthology.misc:Shutting down mgr daemons... 2024-09-17T05:54:57.513 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2024-09-17T05:54:57.513 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T05:54:57.540 INFO:tasks.ceph.mgr.y:Stopped 2024-09-17T05:54:57.541 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2024-09-17T05:54:57.541 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T05:54:57.614 INFO:tasks.ceph.mgr.x:Stopped 2024-09-17T05:54:57.615 INFO:teuthology.misc:Shutting down mon daemons... 2024-09-17T05:54:57.615 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2024-09-17T05:54:57.615 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T05:54:57.627 INFO:tasks.ceph.mon.a:Stopped 2024-09-17T05:54:57.627 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2024-09-17T05:54:57.627 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T05:54:57.639 INFO:tasks.ceph.mon.b:Stopped 2024-09-17T05:54:57.639 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2024-09-17T05:54:57.639 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T05:54:57.654 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-17T05:54:57.671 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-17T05:54:57.691 INFO:tasks.ceph.mon.c:Stopped 2024-09-17T05:54:57.691 INFO:tasks.ceph:Checking cluster log for badness... 2024-09-17T05:54:57.692 DEBUG:teuthology.orchestra.run.smithi150:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v FS_DEGRADED | egrep -v 'fs.*is degraded' | egrep -v 'filesystem is degraded' | egrep -v FS_INLINE_DATA_DEPRECATED | egrep -v FS_WITH_FAILED_MDS | egrep -v MDS_ALL_DOWN | egrep -v 'filesystem is offline' | egrep -v MDS_DAMAGE | egrep -v MDS_DEGRADED | egrep -v MDS_FAILED | egrep -v MDS_INSUFFICIENT_STANDBY | egrep -v 'insufficient standby MDS daemons available' | egrep -v MDS_UP_LESS_THAN_MAX | egrep -v 'online, but wants' | egrep -v 'filesystem is online with fewer MDS than max_mds' | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'do not have an application enabled' | egrep -v 'overall HEALTH_' | egrep -v 'Replacing daemon' | egrep -v 'deprecated feature inline_data' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v PG_AVAILABILITY | egrep -v PG_DEGRADED | egrep -v 'Reduced data availability' | egrep -v 'Degraded data redundancy' | egrep -v 'OSD full dropping all updates' | egrep -v 'OSD near full' | egrep -v 'pausewr flag' | egrep -v 'failsafe engaged, dropping updates' | egrep -v 'failsafe disengaged, no longer dropping' | egrep -v 'is full \(reached quota' | egrep -v POOL_FULL | egrep -v POOL_BACKFILLFULL | head -n 1 2024-09-17T05:54:57.748 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi150.front.sepia.ceph.com 2024-09-17T05:54:57.749 DEBUG:teuthology.orchestra.run.smithi150:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2024-09-17T05:54:58.001 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi150.front.sepia.ceph.com 2024-09-17T05:54:58.002 DEBUG:teuthology.orchestra.run.smithi150:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2024-09-17T05:54:58.123 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi150.front.sepia.ceph.com 2024-09-17T05:54:58.123 DEBUG:teuthology.orchestra.run.smithi150:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2024-09-17T05:54:58.188 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi150.front.sepia.ceph.com 2024-09-17T05:54:58.188 DEBUG:teuthology.orchestra.run.smithi150:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2024-09-17T05:54:58.264 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-4 on ubuntu@smithi176.front.sepia.ceph.com 2024-09-17T05:54:58.264 DEBUG:teuthology.orchestra.run.smithi176:> sync && sudo umount -f /var/lib/ceph/osd/ceph-4 2024-09-17T05:54:58.458 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-5 on ubuntu@smithi176.front.sepia.ceph.com 2024-09-17T05:54:58.458 DEBUG:teuthology.orchestra.run.smithi176:> sync && sudo umount -f /var/lib/ceph/osd/ceph-5 2024-09-17T05:54:58.552 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-6 on ubuntu@smithi176.front.sepia.ceph.com 2024-09-17T05:54:58.552 DEBUG:teuthology.orchestra.run.smithi176:> sync && sudo umount -f /var/lib/ceph/osd/ceph-6 2024-09-17T05:54:58.611 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-7 on ubuntu@smithi176.front.sepia.ceph.com 2024-09-17T05:54:58.611 DEBUG:teuthology.orchestra.run.smithi176:> sync && sudo umount -f /var/lib/ceph/osd/ceph-7 2024-09-17T05:54:58.669 INFO:tasks.ceph:Archiving mon data... 2024-09-17T05:54:58.670 DEBUG:teuthology.misc:Transferring archived files from smithi150:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/pdonnell-2024-09-17_02:09:51-fs-wip-pdonnell-testing-20240916.200549-debug-distro-default-smithi/7908628/data/mon.a.tgz 2024-09-17T05:54:58.671 DEBUG:teuthology.orchestra.run.smithi150:> mktemp 2024-09-17T05:54:58.687 INFO:teuthology.orchestra.run.smithi150.stdout:/tmp/tmp.npMkk45zI3 2024-09-17T05:54:58.687 DEBUG:teuthology.orchestra.run.smithi150:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.npMkk45zI3 2024-09-17T05:54:59.029 DEBUG:teuthology.orchestra.run.smithi150:> sudo chmod 0666 /tmp/tmp.npMkk45zI3 2024-09-17T05:54:59.113 DEBUG:teuthology.orchestra.remote:smithi150:/tmp/tmp.npMkk45zI3 is 2MB 2024-09-17T05:54:59.236 DEBUG:teuthology.orchestra.run.smithi150:> rm -fr /tmp/tmp.npMkk45zI3 2024-09-17T05:54:59.251 DEBUG:teuthology.misc:Transferring archived files from smithi176:/var/lib/ceph/mon/ceph-b to /home/teuthworker/archive/pdonnell-2024-09-17_02:09:51-fs-wip-pdonnell-testing-20240916.200549-debug-distro-default-smithi/7908628/data/mon.b.tgz 2024-09-17T05:54:59.251 DEBUG:teuthology.orchestra.run.smithi176:> mktemp 2024-09-17T05:54:59.268 INFO:teuthology.orchestra.run.smithi176.stdout:/tmp/tmp.GgRzTgawI3 2024-09-17T05:54:59.268 DEBUG:teuthology.orchestra.run.smithi176:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.GgRzTgawI3 2024-09-17T05:54:59.611 DEBUG:teuthology.orchestra.run.smithi176:> sudo chmod 0666 /tmp/tmp.GgRzTgawI3 2024-09-17T05:54:59.694 DEBUG:teuthology.orchestra.remote:smithi176:/tmp/tmp.GgRzTgawI3 is 2MB 2024-09-17T05:54:59.782 DEBUG:teuthology.orchestra.run.smithi176:> rm -fr /tmp/tmp.GgRzTgawI3 2024-09-17T05:54:59.798 DEBUG:teuthology.misc:Transferring archived files from smithi176:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/pdonnell-2024-09-17_02:09:51-fs-wip-pdonnell-testing-20240916.200549-debug-distro-default-smithi/7908628/data/mon.c.tgz 2024-09-17T05:54:59.798 DEBUG:teuthology.orchestra.run.smithi176:> mktemp 2024-09-17T05:54:59.859 INFO:teuthology.orchestra.run.smithi176.stdout:/tmp/tmp.ICPtaXKhHX 2024-09-17T05:54:59.860 DEBUG:teuthology.orchestra.run.smithi176:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.ICPtaXKhHX 2024-09-17T05:55:00.204 DEBUG:teuthology.orchestra.run.smithi176:> sudo chmod 0666 /tmp/tmp.ICPtaXKhHX 2024-09-17T05:55:00.288 DEBUG:teuthology.orchestra.remote:smithi176:/tmp/tmp.ICPtaXKhHX is 2MB 2024-09-17T05:55:00.582 DEBUG:teuthology.orchestra.run.smithi176:> rm -fr /tmp/tmp.ICPtaXKhHX 2024-09-17T05:55:00.598 INFO:tasks.ceph:Cleaning ceph cluster... 2024-09-17T05:55:00.598 DEBUG:teuthology.orchestra.run.smithi150:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-09-17T05:55:00.601 DEBUG:teuthology.orchestra.run.smithi176:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-09-17T05:55:00.687 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-09-17T05:55:00.718 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-09-17T05:55:00.719 INFO:tasks.ceph:Archiving crash dumps... 2024-09-17T05:55:00.720 DEBUG:teuthology.misc:Transferring archived files from smithi150:/var/lib/ceph/crash to /home/teuthworker/archive/pdonnell-2024-09-17_02:09:51-fs-wip-pdonnell-testing-20240916.200549-debug-distro-default-smithi/7908628/remote/smithi150/crash 2024-09-17T05:55:00.721 DEBUG:teuthology.orchestra.run.smithi150:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-09-17T05:55:00.754 DEBUG:teuthology.misc:Transferring archived files from smithi176:/var/lib/ceph/crash to /home/teuthworker/archive/pdonnell-2024-09-17_02:09:51-fs-wip-pdonnell-testing-20240916.200549-debug-distro-default-smithi/7908628/remote/smithi176/crash 2024-09-17T05:55:00.757 DEBUG:teuthology.orchestra.run.smithi176:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-09-17T05:55:00.783 INFO:tasks.ceph:Shutting down logrotate 2024-09-17T05:55:00.784 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-17T05:55:00.801 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-17T05:55:00.877 DEBUG:teuthology.orchestra.run.smithi150:> sudo rm /etc/logrotate.d/ceph-test.conf 2024-09-17T05:55:00.903 DEBUG:teuthology.orchestra.run.smithi176:> sudo rm /etc/logrotate.d/ceph-test.conf 2024-09-17T05:55:00.928 INFO:tasks.ceph:Compressing logs... 2024-09-17T05:55:00.928 DEBUG:teuthology.orchestra.run.smithi150:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-17T05:55:00.946 DEBUG:teuthology.orchestra.run.smithi176:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-17T05:55:00.969 INFO:teuthology.orchestra.run.smithi150.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.0.log 2024-09-17T05:55:00.970 INFO:teuthology.orchestra.run.smithi150.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71713.log 2024-09-17T05:55:00.973 INFO:teuthology.orchestra.run.smithi150.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72716.log 2024-09-17T05:55:00.973 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-osd.0.log: /var/log/ceph/ceph-client.admin.71713.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63029.log 2024-09-17T05:55:00.973 INFO:teuthology.orchestra.run.smithi150.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.71713.log.gz 2024-09-17T05:55:00.974 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.72716.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63160.log 2024-09-17T05:55:00.974 INFO:teuthology.orchestra.run.smithi150.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.72716.log.gz 2024-09-17T05:55:00.974 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.63029.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.76830.log 2024-09-17T05:55:00.974 INFO:teuthology.orchestra.run.smithi150.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.63029.log.gz 2024-09-17T05:55:00.974 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.63160.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47820.log 2024-09-17T05:55:00.974 INFO:teuthology.orchestra.run.smithi150.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.63160.log.gz 2024-09-17T05:55:00.974 INFO:teuthology.orchestra.run.smithi150.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57349.log 2024-09-17T05:55:00.974 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.76830.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.76830.log.gz 2024-09-17T05:55:00.974 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.47820.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.78131.log 2024-09-17T05:55:00.974 INFO:teuthology.orchestra.run.smithi150.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.47820.log.gz 2024-09-17T05:55:00.974 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.57349.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54411.log 2024-09-17T05:55:00.974 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.78131.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.57349.log.gz 2024-09-17T05:55:00.974 INFO:teuthology.orchestra.run.smithi150.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72674.log 2024-09-17T05:55:00.975 INFO:teuthology.orchestra.run.smithi150.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.78131.log.gz 2024-09-17T05:55:00.975 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.54411.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37232.log 2024-09-17T05:55:00.975 INFO:teuthology.orchestra.run.smithi150.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.54411.log.gz 2024-09-17T05:55:00.975 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.72674.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74855.log 2024-09-17T05:55:00.975 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.37232.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.72674.log.gz 2024-09-17T05:55:00.975 INFO:teuthology.orchestra.run.smithi150.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47383.log 2024-09-17T05:55:00.975 INFO:teuthology.orchestra.run.smithi150.stderr: 85.7% -- replaced with /var/log/ceph/ceph-client.admin.37232.log.gz 2024-09-17T05:55:00.975 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.74855.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66315.log 2024-09-17T05:55:00.975 INFO:teuthology.orchestra.run.smithi150.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.82067.log 2024-09-17T05:55:01.012 INFO:teuthology.orchestra.run.smithi176.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.7.log 2024-09-17T05:55:01.012 INFO:teuthology.orchestra.run.smithi176.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36413.log 2024-09-17T05:55:01.012 INFO:teuthology.orchestra.run.smithi176.stderr:/var/log/ceph/ceph-osd.7.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36293.log 2024-09-17T05:55:01.013 INFO:teuthology.orchestra.run.smithi176.stderr:/var/log/ceph/ceph-client.admin.36413.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36493.log 2024-09-17T05:55:01.013 INFO:teuthology.orchestra.run.smithi176.stderr: 86.6% -- replaced with /var/log/ceph/ceph-client.admin.36413.log.gz 2024-09-17T05:55:01.013 INFO:teuthology.orchestra.run.smithi176.stderr:/var/log/ceph/ceph-client.admin.36293.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.3.42781.log 2024-09-17T05:55:01.013 INFO:teuthology.orchestra.run.smithi176.stderr: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.36293.log.gz 2024-09-17T05:55:01.013 INFO:teuthology.orchestra.run.smithi176.stderr:/var/log/ceph/ceph-client.admin.36493.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.3.42785.log 2024-09-17T05:55:01.013 INFO:teuthology.orchestra.run.smithi176.stderr: 86.5% -- replaced with /var/log/ceph/ceph-client.admin.36493.log.gz 2024-09-17T05:55:01.013 INFO:teuthology.orchestra.run.smithi176.stderr:/var/log/ceph/ceph-client.3.42781.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.b.log 2024-09-17T05:55:01.013 INFO:teuthology.orchestra.run.smithi176.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.3.42781.log.gz 2024-09-17T05:55:01.013 INFO:teuthology.orchestra.run.smithi176.stderr:/var/log/ceph/ceph-client.3.42785.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36333.log 2024-09-17T05:55:01.013 INFO:teuthology.orchestra.run.smithi176.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.3.42785.log.gz 2024-09-17T05:55:01.013 INFO:teuthology.orchestra.run.smithi176.stderr:/var/log/ceph/ceph-mds.b.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.4.log 2024-09-17T05:55:01.013 INFO:teuthology.orchestra.run.smithi176.stderr:/var/log/ceph/ceph-client.admin.36333.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-09-17T05:55:01.013 INFO:teuthology.orchestra.run.smithi176.stderr: 86.6% -- replaced with /var/log/ceph/ceph-client.admin.36333.log.gz 2024-09-17T05:55:01.013 INFO:teuthology.orchestra.run.smithi176.stderr:/var/log/ceph/ceph-osd.4.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.1.42374.log 2024-09-17T05:55:01.014 INFO:teuthology.orchestra.run.smithi176.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.1.42369.log 2024-09-17T05:55:01.014 INFO:teuthology.orchestra.run.smithi176.stderr:/var/log/ceph/ceph.audit.log: /var/log/ceph/ceph-client.1.42374.log: 0.0% -- replaced with /var/log/ceph/ceph-client.1.42374.log.gz 2024-09-17T05:55:01.014 INFO:teuthology.orchestra.run.smithi176.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36373.log 2024-09-17T05:55:01.014 INFO:teuthology.orchestra.run.smithi176.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.c.log 2024-09-17T05:55:01.014 INFO:teuthology.orchestra.run.smithi176.stderr:/var/log/ceph/ceph-client.1.42369.log: 0.0% -- replaced with /var/log/ceph/ceph-client.1.42369.log.gz 2024-09-17T05:55:01.014 INFO:teuthology.orchestra.run.smithi176.stderr:/var/log/ceph/ceph-client.admin.36373.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36453.log 2024-09-17T05:55:01.014 INFO:teuthology.orchestra.run.smithi176.stderr: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.36373.log.gz 2024-09-17T05:55:01.014 INFO:teuthology.orchestra.run.smithi176.stderr:/var/log/ceph/ceph-mon.c.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.6.log 2024-09-17T05:55:01.014 INFO:teuthology.orchestra.run.smithi176.stderr:/var/log/ceph/ceph-client.admin.36453.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.5.log 2024-09-17T05:55:01.014 INFO:teuthology.orchestra.run.smithi176.stderr: 86.5% -- replaced with /var/log/ceph/ceph-client.admin.36453.log.gz 2024-09-17T05:55:01.014 INFO:teuthology.orchestra.run.smithi176.stderr:/var/log/ceph/ceph-osd.6.log: gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-09-17T05:55:01.014 INFO:teuthology.orchestra.run.smithi176.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.d.log 2024-09-17T05:55:01.014 INFO:teuthology.orchestra.run.smithi176.stderr:/var/log/ceph/ceph.log: /var/log/ceph/ceph-osd.5.log: 92.7% -- replaced with /var/log/ceph/ceph-mds.b.log.gz 2024-09-17T05:55:01.014 INFO:teuthology.orchestra.run.smithi176.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mgr.x.log 2024-09-17T05:55:01.015 INFO:teuthology.orchestra.run.smithi176.stderr: 93.6% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-09-17T05:55:01.015 INFO:teuthology.orchestra.run.smithi176.stderr:/var/log/ceph/ceph-mds.d.log: 91.8% -- replaced with /var/log/ceph/ceph.log.gz 2024-09-17T05:55:01.015 INFO:teuthology.orchestra.run.smithi176.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36573.log 2024-09-17T05:55:01.015 INFO:teuthology.orchestra.run.smithi176.stderr:/var/log/ceph/ceph-mgr.x.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36533.log 2024-09-17T05:55:01.015 INFO:teuthology.orchestra.run.smithi176.stderr:/var/log/ceph/ceph-client.admin.36573.log: 86.7% -- replaced with /var/log/ceph/ceph-client.admin.36573.log.gz 2024-09-17T05:55:01.015 INFO:teuthology.orchestra.run.smithi176.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.b.log 2024-09-17T05:55:01.015 INFO:teuthology.orchestra.run.smithi176.stderr:/var/log/ceph/ceph-client.admin.36533.log: 86.5% -- replaced with /var/log/ceph/ceph-client.admin.36533.log.gz 2024-09-17T05:55:01.330 INFO:teuthology.orchestra.run.smithi150.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52712.log 2024-09-17T05:55:01.330 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.47383.log: /var/log/ceph/ceph-client.admin.66315.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.74855.log.gz 2024-09-17T05:55:01.330 INFO:teuthology.orchestra.run.smithi150.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62647.log 2024-09-17T05:55:01.331 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.82067.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.47383.log.gz 2024-09-17T05:55:01.331 INFO:teuthology.orchestra.run.smithi150.stderr: 83.9% -- replaced with /var/log/ceph/ceph-client.admin.66315.log.gz 2024-09-17T05:55:01.331 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.52712.log: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.82067.log.gz 2024-09-17T05:55:01.331 INFO:teuthology.orchestra.run.smithi150.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.77376.log 2024-09-17T05:55:01.331 INFO:teuthology.orchestra.run.smithi150.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.52712.log.gz 2024-09-17T05:55:01.331 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.62647.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.82504.log 2024-09-17T05:55:01.331 INFO:teuthology.orchestra.run.smithi150.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.62647.log.gz 2024-09-17T05:55:01.331 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.77376.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.84379.log 2024-09-17T05:55:01.331 INFO:teuthology.orchestra.run.smithi150.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.77376.log.gz 2024-09-17T05:55:01.331 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.82504.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66899.log 2024-09-17T05:55:01.331 INFO:teuthology.orchestra.run.smithi150.stderr: 87.0%/var/log/ceph/ceph-client.admin.84379.log: -- replaced with /var/log/ceph/ceph-client.admin.82504.log.gz 2024-09-17T05:55:01.331 INFO:teuthology.orchestra.run.smithi150.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65695.log 2024-09-17T05:55:01.331 INFO:teuthology.orchestra.run.smithi150.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.84379.log.gz 2024-09-17T05:55:01.331 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.66899.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69824.log 2024-09-17T05:55:01.332 INFO:teuthology.orchestra.run.smithi150.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.66899.log.gz 2024-09-17T05:55:01.332 INFO:teuthology.orchestra.run.smithi150.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.83257.log 2024-09-17T05:55:01.332 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.65695.log: /var/log/ceph/ceph-client.admin.69824.log: 86.5% -- replaced with /var/log/ceph/ceph-client.admin.65695.log.gz 2024-09-17T05:55:01.332 INFO:teuthology.orchestra.run.smithi150.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75585.log 2024-09-17T05:55:01.332 INFO:teuthology.orchestra.run.smithi150.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.69824.log.gz 2024-09-17T05:55:01.332 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.83257.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74442.log 2024-09-17T05:55:01.332 INFO:teuthology.orchestra.run.smithi150.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.83257.log.gz 2024-09-17T05:55:01.332 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.75585.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67361.log 2024-09-17T05:55:01.332 INFO:teuthology.orchestra.run.smithi150.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.75585.log.gz 2024-09-17T05:55:01.332 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.74442.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66815.log 2024-09-17T05:55:01.332 INFO:teuthology.orchestra.run.smithi150.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.74442.log.gz 2024-09-17T05:55:01.332 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.67361.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72194.log 2024-09-17T05:55:01.332 INFO:teuthology.orchestra.run.smithi150.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.67361.log.gz 2024-09-17T05:55:01.332 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.66815.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44898.log 2024-09-17T05:55:01.333 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.72194.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.66815.log.gz 2024-09-17T05:55:01.333 INFO:teuthology.orchestra.run.smithi150.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58965.log 2024-09-17T05:55:01.333 INFO:teuthology.orchestra.run.smithi150.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.72194.log.gz 2024-09-17T05:55:01.333 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.44898.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69287.log 2024-09-17T05:55:01.333 INFO:teuthology.orchestra.run.smithi150.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.44898.log.gz 2024-09-17T05:55:01.333 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.58965.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71043.log 2024-09-17T05:55:01.333 INFO:teuthology.orchestra.run.smithi150.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.58965.log.gz 2024-09-17T05:55:01.333 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.69287.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59547.log 2024-09-17T05:55:01.333 INFO:teuthology.orchestra.run.smithi150.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.69287.log.gz 2024-09-17T05:55:01.333 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.71043.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43302.log 2024-09-17T05:55:01.333 INFO:teuthology.orchestra.run.smithi150.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.71043.log.gz 2024-09-17T05:55:01.333 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.59547.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.64044.log 2024-09-17T05:55:01.333 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.43302.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.59547.log.gz 2024-09-17T05:55:01.334 INFO:teuthology.orchestra.run.smithi150.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.79154.log 2024-09-17T05:55:01.334 INFO:teuthology.orchestra.run.smithi150.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.43302.log.gz 2024-09-17T05:55:01.334 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.0.64044.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66397.log 2024-09-17T05:55:01.334 INFO:teuthology.orchestra.run.smithi150.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.64044.log.gz 2024-09-17T05:55:01.334 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.79154.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60621.log 2024-09-17T05:55:01.334 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.66397.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.79154.log.gz 2024-09-17T05:55:01.334 INFO:teuthology.orchestra.run.smithi150.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75230.log 2024-09-17T05:55:01.334 INFO:teuthology.orchestra.run.smithi150.stderr: 83.9% -- replaced with /var/log/ceph/ceph-client.admin.66397.log.gz 2024-09-17T05:55:01.334 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.60621.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.76686.log 2024-09-17T05:55:01.334 INFO:teuthology.orchestra.run.smithi150.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.60621.log.gz 2024-09-17T05:55:01.334 INFO:teuthology.orchestra.run.smithi150.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68765.log 2024-09-17T05:55:01.334 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.75230.log: /var/log/ceph/ceph-client.admin.76686.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.75230.log.gz 2024-09-17T05:55:01.334 INFO:teuthology.orchestra.run.smithi150.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44730.log 2024-09-17T05:55:01.334 INFO:teuthology.orchestra.run.smithi150.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.76686.log.gz 2024-09-17T05:55:01.334 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.68765.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73182.log 2024-09-17T05:55:01.335 INFO:teuthology.orchestra.run.smithi150.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.68765.log.gz 2024-09-17T05:55:01.335 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.44730.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54663.log 2024-09-17T05:55:01.335 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.73182.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.44730.log.gz 2024-09-17T05:55:01.335 INFO:teuthology.orchestra.run.smithi150.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67403.log 2024-09-17T05:55:01.335 INFO:teuthology.orchestra.run.smithi150.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.73182.log.gz 2024-09-17T05:55:01.335 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.54663.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.77210.log 2024-09-17T05:55:01.335 INFO:teuthology.orchestra.run.smithi150.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.54663.log.gz 2024-09-17T05:55:01.335 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.67403.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69245.log 2024-09-17T05:55:01.335 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.0.77210.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.67403.log.gz 2024-09-17T05:55:01.335 INFO:teuthology.orchestra.run.smithi150.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37214.log 2024-09-17T05:55:01.335 INFO:teuthology.orchestra.run.smithi150.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.77210.log.gz 2024-09-17T05:55:01.335 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.69245.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.79760.log 2024-09-17T05:55:01.335 INFO:teuthology.orchestra.run.smithi150.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.69245.log.gz 2024-09-17T05:55:01.335 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.37214.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67445.log 2024-09-17T05:55:01.336 INFO:teuthology.orchestra.run.smithi150.stderr: 86.7% -- replaced with /var/log/ceph/ceph-client.admin.37214.log.gz 2024-09-17T05:55:01.336 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.79760.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57685.log 2024-09-17T05:55:01.336 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.67445.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.79760.log.gz 2024-09-17T05:55:01.336 INFO:teuthology.orchestra.run.smithi150.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75272.log 2024-09-17T05:55:01.336 INFO:teuthology.orchestra.run.smithi150.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.67445.log.gz 2024-09-17T05:55:01.336 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.57685.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73914.log 2024-09-17T05:55:01.336 INFO:teuthology.orchestra.run.smithi150.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.57685.log.gz 2024-09-17T05:55:01.336 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.75272.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44531.log 2024-09-17T05:55:01.336 INFO:teuthology.orchestra.run.smithi150.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.75272.log.gz 2024-09-17T05:55:01.336 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.73914.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.48721.log 2024-09-17T05:55:01.336 INFO:teuthology.orchestra.run.smithi150.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.73914.log.gz 2024-09-17T05:55:01.336 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.44531.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55688.log 2024-09-17T05:55:01.336 INFO:teuthology.orchestra.run.smithi150.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.44531.log.gz 2024-09-17T05:55:01.336 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.0.48721.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52754.log 2024-09-17T05:55:01.337 INFO:teuthology.orchestra.run.smithi150.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.48721.log.gz 2024-09-17T05:55:01.337 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.55688.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68723.log 2024-09-17T05:55:01.337 INFO:teuthology.orchestra.run.smithi150.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.55688.log.gz 2024-09-17T05:55:01.337 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.52754.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43854.log 2024-09-17T05:55:01.337 INFO:teuthology.orchestra.run.smithi150.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.52754.log.gz 2024-09-17T05:55:01.337 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.68723.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.81419.log 2024-09-17T05:55:01.337 INFO:teuthology.orchestra.run.smithi150.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.68723.log.gz 2024-09-17T05:55:01.337 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.43854.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.82151.log 2024-09-17T05:55:01.337 INFO:teuthology.orchestra.run.smithi150.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.43854.log.gz 2024-09-17T05:55:01.337 INFO:teuthology.orchestra.run.smithi150.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61731.log 2024-09-17T05:55:01.337 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.81419.log: 86.7% -- replaced with /var/log/ceph/ceph-client.admin.81419.log.gz 2024-09-17T05:55:01.337 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.82151.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66190.log 2024-09-17T05:55:01.338 INFO:teuthology.orchestra.run.smithi150.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.82151.log.gz/var/log/ceph/ceph-client.admin.61731.log: 2024-09-17T05:55:01.338 INFO:teuthology.orchestra.run.smithi150.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.80310.log 2024-09-17T05:55:01.338 INFO:teuthology.orchestra.run.smithi150.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.61731.log.gz 2024-09-17T05:55:01.338 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.66190.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69150.log 2024-09-17T05:55:01.338 INFO:teuthology.orchestra.run.smithi150.stderr: 83.3% -- replaced with /var/log/ceph/ceph-client.admin.66190.log.gz 2024-09-17T05:55:01.338 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.80310.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54036.log 2024-09-17T05:55:01.338 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.69150.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.81773.log 2024-09-17T05:55:01.338 INFO:teuthology.orchestra.run.smithi150.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.69150.log.gz 2024-09-17T05:55:01.338 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.54036.log: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.80310.log.gz 2024-09-17T05:55:01.338 INFO:teuthology.orchestra.run.smithi150.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42559.log 2024-09-17T05:55:01.338 INFO:teuthology.orchestra.run.smithi150.stderr: 86.7% -- replaced with /var/log/ceph/ceph-client.admin.54036.log.gz 2024-09-17T05:55:01.338 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.81773.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.83420.log 2024-09-17T05:55:01.338 INFO:teuthology.orchestra.run.smithi150.stderr: 86.5% -- replaced with /var/log/ceph/ceph-client.admin.81773.log.gz 2024-09-17T05:55:01.339 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.42559.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.81461.log 2024-09-17T05:55:01.339 INFO:teuthology.orchestra.run.smithi150.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.42559.log.gz 2024-09-17T05:55:01.339 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.83420.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.84169.log 2024-09-17T05:55:01.339 INFO:teuthology.orchestra.run.smithi150.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.83420.log.gz 2024-09-17T05:55:01.339 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.81461.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70815.log 2024-09-17T05:55:01.339 INFO:teuthology.orchestra.run.smithi150.stderr: 86.7% -- replaced with /var/log/ceph/ceph-client.admin.81461.log.gz 2024-09-17T05:55:01.339 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.84169.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.81335.log 2024-09-17T05:55:01.339 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.70815.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.84169.log.gz 2024-09-17T05:55:01.339 INFO:teuthology.orchestra.run.smithi150.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61017.log 2024-09-17T05:55:01.339 INFO:teuthology.orchestra.run.smithi150.stderr: 86.5% -- replaced with /var/log/ceph/ceph-client.admin.70815.log.gz 2024-09-17T05:55:01.339 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.81335.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.83131.log 2024-09-17T05:55:01.339 INFO:teuthology.orchestra.run.smithi150.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.81335.log.gz 2024-09-17T05:55:01.339 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.61017.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51872.log 2024-09-17T05:55:01.340 INFO:teuthology.orchestra.run.smithi150.stderr: 86.6% -- replaced with /var/log/ceph/ceph-client.admin.61017.log.gz 2024-09-17T05:55:01.340 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.83131.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68940.log 2024-09-17T05:55:01.340 INFO:teuthology.orchestra.run.smithi150.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.83131.log.gz 2024-09-17T05:55:01.340 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.51872.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51476.log 2024-09-17T05:55:01.340 INFO:teuthology.orchestra.run.smithi150.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.51872.log.gz 2024-09-17T05:55:01.340 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.68940.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68597.log 2024-09-17T05:55:01.340 INFO:teuthology.orchestra.run.smithi150.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.68940.log.gz 2024-09-17T05:55:01.340 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.51476.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.83653.log 2024-09-17T05:55:01.340 INFO:teuthology.orchestra.run.smithi150.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.51476.log.gz 2024-09-17T05:55:01.340 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.68597.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73746.log 2024-09-17T05:55:01.340 INFO:teuthology.orchestra.run.smithi150.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.68597.log.gz 2024-09-17T05:55:01.340 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.83653.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62826.log 2024-09-17T05:55:01.340 INFO:teuthology.orchestra.run.smithi150.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.83653.log.gz 2024-09-17T05:55:01.340 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.73746.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60486.log 2024-09-17T05:55:01.340 INFO:teuthology.orchestra.run.smithi150.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.73746.log.gz 2024-09-17T05:55:01.341 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.62826.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47552.log 2024-09-17T05:55:01.341 INFO:teuthology.orchestra.run.smithi150.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.62826.log.gz 2024-09-17T05:55:01.341 INFO:teuthology.orchestra.run.smithi150.stderr:gzip -5/var/log/ceph/ceph-client.admin.60486.log: --verbose -- /var/log/ceph/ceph-client.admin.72492.log 2024-09-17T05:55:01.341 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.47552.log: 86.8% -- replaced with /var/log/ceph/ceph-client.admin.60486.log.gz 2024-09-17T05:55:01.341 INFO:teuthology.orchestra.run.smithi150.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66941.log 2024-09-17T05:55:01.341 INFO:teuthology.orchestra.run.smithi150.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.47552.log.gz 2024-09-17T05:55:01.341 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.72492.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.78608.log 2024-09-17T05:55:01.341 INFO:teuthology.orchestra.run.smithi150.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.72492.log.gz 2024-09-17T05:55:01.341 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.66941.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73098.log 2024-09-17T05:55:01.341 INFO:teuthology.orchestra.run.smithi150.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.66941.log.gz 2024-09-17T05:55:01.341 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.78608.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69627.log 2024-09-17T05:55:01.341 INFO:teuthology.orchestra.run.smithi150.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.78608.log.gz 2024-09-17T05:55:01.341 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.73098.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65653.log 2024-09-17T05:55:01.341 INFO:teuthology.orchestra.run.smithi150.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.73098.log.gz 2024-09-17T05:55:01.342 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.69627.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.80814.log 2024-09-17T05:55:01.342 INFO:teuthology.orchestra.run.smithi150.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.69627.log.gz 2024-09-17T05:55:01.342 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.65653.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58923.log 2024-09-17T05:55:01.342 INFO:teuthology.orchestra.run.smithi150.stderr: 86.5% -- replaced with /var/log/ceph/ceph-client.admin.65653.log.gz 2024-09-17T05:55:01.342 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.80814.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43428.log 2024-09-17T05:55:01.342 INFO:teuthology.orchestra.run.smithi150.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.80814.log.gz 2024-09-17T05:55:01.342 INFO:teuthology.orchestra.run.smithi150.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68513.log 2024-09-17T05:55:01.342 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.58923.log: /var/log/ceph/ceph-client.admin.43428.log: gzip 87.5% -- replaced with /var/log/ceph/ceph-client.admin.58923.log.gz -5 2024-09-17T05:55:01.342 INFO:teuthology.orchestra.run.smithi150.stderr: --verbose -- /var/log/ceph/ceph-client.0.59969.log 2024-09-17T05:55:01.342 INFO:teuthology.orchestra.run.smithi150.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.43428.log.gz 2024-09-17T05:55:01.342 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.68513.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73014.log 2024-09-17T05:55:01.343 INFO:teuthology.orchestra.run.smithi150.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.68513.log.gz 2024-09-17T05:55:01.343 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.0.59969.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.81141.log 2024-09-17T05:55:01.343 INFO:teuthology.orchestra.run.smithi150.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.59969.log.gz 2024-09-17T05:55:01.343 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.73014.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.80958.log 2024-09-17T05:55:01.343 INFO:teuthology.orchestra.run.smithi150.stderr: 86.8% -- replaced with /var/log/ceph/ceph-client.admin.73014.log.gz 2024-09-17T05:55:01.343 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.81141.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62148.log 2024-09-17T05:55:01.343 INFO:teuthology.orchestra.run.smithi150.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.81141.log.gz 2024-09-17T05:55:01.343 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.80958.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.1.log 2024-09-17T05:55:01.343 INFO:teuthology.orchestra.run.smithi150.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.80958.log.gz 2024-09-17T05:55:01.343 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.62148.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.48717.log 2024-09-17T05:55:01.343 INFO:teuthology.orchestra.run.smithi150.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.62148.log.gz 2024-09-17T05:55:01.343 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.80898.log 2024-09-17T05:55:01.343 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.0.48717.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55856.log 2024-09-17T05:55:01.344 INFO:teuthology.orchestra.run.smithi150.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.48717.log.gz 2024-09-17T05:55:01.344 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.80898.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.80376.log 2024-09-17T05:55:01.344 INFO:teuthology.orchestra.run.smithi150.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.80898.log.gz 2024-09-17T05:55:01.344 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.55856.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57189.log 2024-09-17T05:55:01.344 INFO:teuthology.orchestra.run.smithi150.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.55856.log.gz 2024-09-17T05:55:01.344 INFO:teuthology.orchestra.run.smithi150.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74274.log 2024-09-17T05:55:01.344 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.80376.log: /var/log/ceph/ceph-client.admin.57189.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71858.log 2024-09-17T05:55:01.344 INFO:teuthology.orchestra.run.smithi150.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.80376.log.gz 2024-09-17T05:55:01.344 INFO:teuthology.orchestra.run.smithi150.stderr: 86.8% -- replaced with /var/log/ceph/ceph-client.admin.57189.log.gz 2024-09-17T05:55:01.344 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.74274.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53574.log 2024-09-17T05:55:01.344 INFO:teuthology.orchestra.run.smithi150.stderr: 86.3% -- replaced with /var/log/ceph/ceph-client.admin.74274.log.gz 2024-09-17T05:55:01.344 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.71858.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.83005.log 2024-09-17T05:55:01.344 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.53574.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.71858.log.gz 2024-09-17T05:55:01.344 INFO:teuthology.orchestra.run.smithi150.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51010.log 2024-09-17T05:55:01.345 INFO:teuthology.orchestra.run.smithi150.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.53574.log.gz 2024-09-17T05:55:01.345 INFO:teuthology.orchestra.run.smithi150.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.80564.log 2024-09-17T05:55:01.345 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.83005.log: /var/log/ceph/ceph-client.admin.51010.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66274.log 2024-09-17T05:55:01.345 INFO:teuthology.orchestra.run.smithi150.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.83005.log.gz 2024-09-17T05:55:01.345 INFO:teuthology.orchestra.run.smithi150.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.51010.log.gz 2024-09-17T05:55:01.345 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.0.80564.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.80564.log.gz 2024-09-17T05:55:01.345 INFO:teuthology.orchestra.run.smithi150.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.78776.log 2024-09-17T05:55:01.345 INFO:teuthology.orchestra.run.smithi150.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58289.log 2024-09-17T05:55:01.345 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.66274.log: /var/log/ceph/ceph-client.admin.78776.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44196.log 2024-09-17T05:55:01.345 INFO:teuthology.orchestra.run.smithi150.stderr: 84.4% -- replaced with /var/log/ceph/ceph-client.admin.66274.log.gz 2024-09-17T05:55:01.345 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.58289.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.78776.log.gz 2024-09-17T05:55:01.345 INFO:teuthology.orchestra.run.smithi150.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48463.log 2024-09-17T05:55:01.345 INFO:teuthology.orchestra.run.smithi150.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.58289.log.gz 2024-09-17T05:55:01.345 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.44196.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62274.log 2024-09-17T05:55:01.345 INFO:teuthology.orchestra.run.smithi150.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.44196.log.gz 2024-09-17T05:55:01.346 INFO:teuthology.orchestra.run.smithi150.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75795.log 2024-09-17T05:55:01.346 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.48463.log: /var/log/ceph/ceph-client.admin.62274.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59189.log 2024-09-17T05:55:01.346 INFO:teuthology.orchestra.run.smithi150.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.62274.log.gz 2024-09-17T05:55:01.346 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.75795.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.52546.log 2024-09-17T05:55:01.346 INFO:teuthology.orchestra.run.smithi150.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.48463.log.gz 2024-09-17T05:55:01.346 INFO:teuthology.orchestra.run.smithi150.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.75795.log.gz 2024-09-17T05:55:01.346 INFO:teuthology.orchestra.run.smithi150.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53868.log 2024-09-17T05:55:01.346 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.59189.log: /var/log/ceph/ceph-client.0.52546.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42964.log 2024-09-17T05:55:01.346 INFO:teuthology.orchestra.run.smithi150.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.59189.log.gz 2024-09-17T05:55:01.346 INFO:teuthology.orchestra.run.smithi150.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.52546.log.gz 2024-09-17T05:55:01.346 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.53868.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.76770.log 2024-09-17T05:55:01.346 INFO:teuthology.orchestra.run.smithi150.stderr: 86.7% -- replaced with /var/log/ceph/ceph-client.admin.53868.log.gz 2024-09-17T05:55:01.346 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.42964.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43862.log 2024-09-17T05:55:01.346 INFO:teuthology.orchestra.run.smithi150.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.42964.log.gz 2024-09-17T05:55:01.346 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.76770.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73056.log 2024-09-17T05:55:01.347 INFO:teuthology.orchestra.run.smithi150.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.76770.log.gz 2024-09-17T05:55:01.347 INFO:teuthology.orchestra.run.smithi150.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.76177.log 2024-09-17T05:55:01.347 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.43862.log: /var/log/ceph/ceph-client.admin.73056.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68303.log 2024-09-17T05:55:01.347 INFO:teuthology.orchestra.run.smithi150.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.43862.log.gz 2024-09-17T05:55:01.347 INFO:teuthology.orchestra.run.smithi150.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.73056.log.gz 2024-09-17T05:55:01.347 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.76177.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48799.log 2024-09-17T05:55:01.347 INFO:teuthology.orchestra.run.smithi150.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.76177.log.gz 2024-09-17T05:55:01.347 INFO:teuthology.orchestra.run.smithi150.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.77727.log 2024-09-17T05:55:01.347 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.68303.log: /var/log/ceph/ceph-client.admin.48799.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.68303.log.gz 2024-09-17T05:55:01.347 INFO:teuthology.orchestra.run.smithi150.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.84463.log 2024-09-17T05:55:01.347 INFO:teuthology.orchestra.run.smithi150.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.48799.log.gz 2024-09-17T05:55:01.347 INFO:teuthology.orchestra.run.smithi150.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65467.log 2024-09-17T05:55:01.347 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.77727.log: /var/log/ceph/ceph-client.admin.84463.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52124.log 2024-09-17T05:55:01.347 INFO:teuthology.orchestra.run.smithi150.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.77727.log.gz 2024-09-17T05:55:01.348 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.65467.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.84463.log.gz 2024-09-17T05:55:01.348 INFO:teuthology.orchestra.run.smithi150.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60135.log 2024-09-17T05:55:01.348 INFO:teuthology.orchestra.run.smithi150.stderr: 86.6% -- replaced with /var/log/ceph/ceph-client.admin.65467.log.gz 2024-09-17T05:55:01.348 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.52124.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57307.log 2024-09-17T05:55:01.348 INFO:teuthology.orchestra.run.smithi150.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.52124.log.gz 2024-09-17T05:55:01.348 INFO:teuthology.orchestra.run.smithi150.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37017.log 2024-09-17T05:55:01.348 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.60135.log: /var/log/ceph/ceph-client.admin.57307.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46844.log 2024-09-17T05:55:01.348 INFO:teuthology.orchestra.run.smithi150.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.60135.log.gz 2024-09-17T05:55:01.348 INFO:teuthology.orchestra.run.smithi150.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.57307.log.gz 2024-09-17T05:55:01.348 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.37017.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63202.log 2024-09-17T05:55:01.348 INFO:teuthology.orchestra.run.smithi150.stderr: 86.6% -- replaced with /var/log/ceph/ceph-client.admin.37017.log.gz 2024-09-17T05:55:01.348 INFO:teuthology.orchestra.run.smithi150.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43638.log 2024-09-17T05:55:01.348 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.46844.log: /var/log/ceph/ceph-client.admin.63202.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.46844.log.gz 2024-09-17T05:55:01.348 INFO:teuthology.orchestra.run.smithi150.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66049.log 2024-09-17T05:55:01.348 INFO:teuthology.orchestra.run.smithi150.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.63202.log.gz 2024-09-17T05:55:01.349 INFO:teuthology.orchestra.run.smithi150.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58720.log 2024-09-17T05:55:01.349 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.43638.log: /var/log/ceph/ceph-client.admin.66049.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.83779.log 2024-09-17T05:55:01.349 INFO:teuthology.orchestra.run.smithi150.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.43638.log.gz 2024-09-17T05:55:01.349 INFO:teuthology.orchestra.run.smithi150.stderr: 84.0% -- replaced with /var/log/ceph/ceph-client.admin.66049.log.gz 2024-09-17T05:55:01.349 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.58720.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59589.log 2024-09-17T05:55:01.349 INFO:teuthology.orchestra.run.smithi150.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.58720.log.gz 2024-09-17T05:55:01.349 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.83779.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65278.log 2024-09-17T05:55:01.349 INFO:teuthology.orchestra.run.smithi150.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.83779.log.gz 2024-09-17T05:55:01.349 INFO:teuthology.orchestra.run.smithi150.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.83215.log 2024-09-17T05:55:01.349 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.59589.log: /var/log/ceph/ceph-client.admin.65278.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72110.log 2024-09-17T05:55:01.349 INFO:teuthology.orchestra.run.smithi150.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.59589.log.gz 2024-09-17T05:55:01.349 INFO:teuthology.orchestra.run.smithi150.stderr: 86.6% -- replaced with /var/log/ceph/ceph-client.admin.65278.log.gz 2024-09-17T05:55:01.349 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.83215.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.83914.log 2024-09-17T05:55:01.349 INFO:teuthology.orchestra.run.smithi150.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.83215.log.gz 2024-09-17T05:55:01.350 INFO:teuthology.orchestra.run.smithi150.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75188.log 2024-09-17T05:55:01.350 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.72110.log: /var/log/ceph/ceph-client.admin.83914.log: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.72110.log.gz 2024-09-17T05:55:01.350 INFO:teuthology.orchestra.run.smithi150.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66356.log 2024-09-17T05:55:01.350 INFO:teuthology.orchestra.run.smithi150.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.83914.log.gz 2024-09-17T05:55:01.350 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.75188.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60177.log 2024-09-17T05:55:01.350 INFO:teuthology.orchestra.run.smithi150.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.75188.log.gz 2024-09-17T05:55:01.350 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.66356.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47302.log 2024-09-17T05:55:01.350 INFO:teuthology.orchestra.run.smithi150.stderr: 84.8% -- replaced with /var/log/ceph/ceph-client.admin.66356.log.gz 2024-09-17T05:55:01.350 INFO:teuthology.orchestra.run.smithi150.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43853.log 2024-09-17T05:55:01.350 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.60177.log: /var/log/ceph/ceph-client.admin.47302.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50763.log 2024-09-17T05:55:01.350 INFO:teuthology.orchestra.run.smithi150.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.60177.log.gz 2024-09-17T05:55:01.350 INFO:teuthology.orchestra.run.smithi150.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.47302.log.gz 2024-09-17T05:55:01.350 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.43853.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36984.log 2024-09-17T05:55:01.350 INFO:teuthology.orchestra.run.smithi150.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.43853.log.gz 2024-09-17T05:55:01.351 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.50763.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47721.log 2024-09-17T05:55:01.351 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.36984.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60219.log 2024-09-17T05:55:01.351 INFO:teuthology.orchestra.run.smithi150.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.50763.log.gz 2024-09-17T05:55:01.351 INFO:teuthology.orchestra.run.smithi150.stderr: 86.0% -- replaced with /var/log/ceph/ceph-client.admin.36984.log.gz 2024-09-17T05:55:01.351 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.47721.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56216.log 2024-09-17T05:55:01.351 INFO:teuthology.orchestra.run.smithi150.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.47721.log.gz 2024-09-17T05:55:01.351 INFO:teuthology.orchestra.run.smithi150.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.78089.log 2024-09-17T05:55:01.351 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.60219.log: /var/log/ceph/ceph-client.admin.56216.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53658.log 2024-09-17T05:55:01.351 INFO:teuthology.orchestra.run.smithi150.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.60219.log.gz 2024-09-17T05:55:01.351 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.78089.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.56216.log.gz 2024-09-17T05:55:01.351 INFO:teuthology.orchestra.run.smithi150.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.79718.log 2024-09-17T05:55:01.351 INFO:teuthology.orchestra.run.smithi150.stderr: 86.6% -- replaced with /var/log/ceph/ceph-client.admin.78089.log.gz 2024-09-17T05:55:01.351 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.53658.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.77586.log 2024-09-17T05:55:01.351 INFO:teuthology.orchestra.run.smithi150.stderr: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.53658.log.gz 2024-09-17T05:55:01.351 INFO:teuthology.orchestra.run.smithi150.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46725.log 2024-09-17T05:55:01.352 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.79718.log: /var/log/ceph/ceph-client.admin.77586.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46134.log 2024-09-17T05:55:01.352 INFO:teuthology.orchestra.run.smithi150.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.79718.log.gz 2024-09-17T05:55:01.352 INFO:teuthology.orchestra.run.smithi150.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.77586.log.gz 2024-09-17T05:55:01.352 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.46725.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55377.log 2024-09-17T05:55:01.352 INFO:teuthology.orchestra.run.smithi150.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.46725.log.gz 2024-09-17T05:55:01.352 INFO:teuthology.orchestra.run.smithi150.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49093.log 2024-09-17T05:55:01.352 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.46134.log: /var/log/ceph/ceph-client.admin.55377.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.46134.log.gz 2024-09-17T05:55:01.352 INFO:teuthology.orchestra.run.smithi150.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64168.log 2024-09-17T05:55:01.352 INFO:teuthology.orchestra.run.smithi150.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.55377.log.gz 2024-09-17T05:55:01.352 INFO:teuthology.orchestra.run.smithi150.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66521.log 2024-09-17T05:55:01.352 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.49093.log: /var/log/ceph/ceph-client.admin.64168.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46970.log 2024-09-17T05:55:01.352 INFO:teuthology.orchestra.run.smithi150.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.49093.log.gz 2024-09-17T05:55:01.352 INFO:teuthology.orchestra.run.smithi150.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.64168.log.gz 2024-09-17T05:55:01.352 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.66521.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46928.log 2024-09-17T05:55:01.353 INFO:teuthology.orchestra.run.smithi150.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.66521.log.gz 2024-09-17T05:55:01.353 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.46970.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46428.log 2024-09-17T05:55:01.353 INFO:teuthology.orchestra.run.smithi150.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.46970.log.gz 2024-09-17T05:55:01.353 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.46928.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57976.log 2024-09-17T05:55:01.353 INFO:teuthology.orchestra.run.smithi150.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.46928.log.gz 2024-09-17T05:55:01.353 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.46428.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45024.log 2024-09-17T05:55:01.353 INFO:teuthology.orchestra.run.smithi150.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.46428.log.gz 2024-09-17T05:55:01.353 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.57976.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.78944.log 2024-09-17T05:55:01.353 INFO:teuthology.orchestra.run.smithi150.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.57976.log.gz 2024-09-17T05:55:01.353 INFO:teuthology.orchestra.run.smithi150.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.82588.log 2024-09-17T05:55:01.353 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.45024.log: /var/log/ceph/ceph-client.admin.78944.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74232.log 2024-09-17T05:55:01.353 INFO:teuthology.orchestra.run.smithi150.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.78944.log.gz 2024-09-17T05:55:01.353 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.82588.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.82420.log 2024-09-17T05:55:01.354 INFO:teuthology.orchestra.run.smithi150.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.45024.log.gz 2024-09-17T05:55:01.354 INFO:teuthology.orchestra.run.smithi150.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.82588.log.gz 2024-09-17T05:55:01.354 INFO:teuthology.orchestra.run.smithi150.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65092.log 2024-09-17T05:55:01.354 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.74232.log: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.74232.log.gz 2024-09-17T05:55:01.354 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.82420.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.84085.log 2024-09-17T05:55:01.354 INFO:teuthology.orchestra.run.smithi150.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48295.log 2024-09-17T05:55:01.354 INFO:teuthology.orchestra.run.smithi150.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.82420.log.gz 2024-09-17T05:55:01.354 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.65092.log: /var/log/ceph/ceph-client.admin.84085.log: 86.6% -- replaced with /var/log/ceph/ceph-client.admin.65092.log.gz 2024-09-17T05:55:01.354 INFO:teuthology.orchestra.run.smithi150.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69194.log 2024-09-17T05:55:01.354 INFO:teuthology.orchestra.run.smithi150.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.84085.log.gz 2024-09-17T05:55:01.354 INFO:teuthology.orchestra.run.smithi150.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71755.log/var/log/ceph/ceph-client.admin.48295.log: 2024-09-17T05:55:01.354 INFO:teuthology.orchestra.run.smithi150.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.48295.log.gz 2024-09-17T05:55:01.354 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.69194.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71314.log 2024-09-17T05:55:01.355 INFO:teuthology.orchestra.run.smithi150.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.69194.log.gz 2024-09-17T05:55:01.355 INFO:teuthology.orchestra.run.smithi150.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61185.log 2024-09-17T05:55:01.355 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.71755.log: /var/log/ceph/ceph-client.admin.71314.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.79623.log 2024-09-17T05:55:01.355 INFO:teuthology.orchestra.run.smithi150.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.71755.log.gz 2024-09-17T05:55:01.355 INFO:teuthology.orchestra.run.smithi150.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.71314.log.gz 2024-09-17T05:55:01.355 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.61185.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75669.log 2024-09-17T05:55:01.355 INFO:teuthology.orchestra.run.smithi150.stderr: 86.5% -- replaced with /var/log/ceph/ceph-client.admin.61185.log.gz 2024-09-17T05:55:01.355 INFO:teuthology.orchestra.run.smithi150.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56570.log 2024-09-17T05:55:01.355 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.79623.log: /var/log/ceph/ceph-client.admin.75669.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.79623.log.gz 2024-09-17T05:55:01.355 INFO:teuthology.orchestra.run.smithi150.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43092.log 2024-09-17T05:55:01.355 INFO:teuthology.orchestra.run.smithi150.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.75669.log.gz 2024-09-17T05:55:01.355 INFO:teuthology.orchestra.run.smithi150.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71671.log 2024-09-17T05:55:01.355 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.56570.log: /var/log/ceph/ceph-client.admin.43092.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44772.log 2024-09-17T05:55:01.355 INFO:teuthology.orchestra.run.smithi150.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.56570.log.gz 2024-09-17T05:55:01.356 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.71671.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.43092.log.gz 2024-09-17T05:55:01.356 INFO:teuthology.orchestra.run.smithi150.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62232.log 2024-09-17T05:55:01.356 INFO:teuthology.orchestra.run.smithi150.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.71671.log.gz 2024-09-17T05:55:01.356 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.44772.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70899.log 2024-09-17T05:55:01.356 INFO:teuthology.orchestra.run.smithi150.stderr: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.44772.log.gz 2024-09-17T05:55:01.356 INFO:teuthology.orchestra.run.smithi150.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37117.log 2024-09-17T05:55:01.356 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.62232.log: /var/log/ceph/ceph-client.admin.70899.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.79974.log 2024-09-17T05:55:01.356 INFO:teuthology.orchestra.run.smithi150.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.62232.log.gz 2024-09-17T05:55:01.356 INFO:teuthology.orchestra.run.smithi150.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.70899.log.gz 2024-09-17T05:55:01.356 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.37117.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57601.log 2024-09-17T05:55:01.356 INFO:teuthology.orchestra.run.smithi150.stderr:gzip -5 --verbose 86.7% -- /var/log/ceph/ceph-client.admin.66008.log -- replaced with /var/log/ceph/ceph-client.admin.37117.log.gz 2024-09-17T05:55:01.356 INFO:teuthology.orchestra.run.smithi150.stderr: 2024-09-17T05:55:01.356 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.79974.log: /var/log/ceph/ceph-client.admin.57601.log: 86.8% -- replaced with /var/log/ceph/ceph-client.admin.79974.log.gz 2024-09-17T05:55:01.357 INFO:teuthology.orchestra.run.smithi150.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.77769.log 2024-09-17T05:55:01.357 INFO:teuthology.orchestra.run.smithi150.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.57601.log.gz 2024-09-17T05:55:01.357 INFO:teuthology.orchestra.run.smithi150.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75627.log 2024-09-17T05:55:01.357 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.66008.log: /var/log/ceph/ceph-client.admin.77769.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69669.log 2024-09-17T05:55:01.357 INFO:teuthology.orchestra.run.smithi150.stderr: 84.0% -- replaced with /var/log/ceph/ceph-client.admin.66008.log.gz 2024-09-17T05:55:01.357 INFO:teuthology.orchestra.run.smithi150.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.77769.log.gz 2024-09-17T05:55:01.357 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.75627.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74687.log 2024-09-17T05:55:01.357 INFO:teuthology.orchestra.run.smithi150.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.75627.log.gz 2024-09-17T05:55:01.357 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.69669.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.82462.log 2024-09-17T05:55:01.357 INFO:teuthology.orchestra.run.smithi150.stderr: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.69669.log.gz 2024-09-17T05:55:01.357 INFO:teuthology.orchestra.run.smithi150.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.77334.log 2024-09-17T05:55:01.357 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.74687.log: /var/log/ceph/ceph-client.admin.82462.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73704.log 2024-09-17T05:55:01.357 INFO:teuthology.orchestra.run.smithi150.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.74687.log.gz 2024-09-17T05:55:01.358 INFO:teuthology.orchestra.run.smithi150.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.82462.log.gz 2024-09-17T05:55:01.358 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.77334.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58800.log 2024-09-17T05:55:01.358 INFO:teuthology.orchestra.run.smithi150.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.77334.log.gz 2024-09-17T05:55:01.358 INFO:teuthology.orchestra.run.smithi150.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53330.log 2024-09-17T05:55:01.358 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.73704.log: /var/log/ceph/ceph-client.admin.58800.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66773.log 2024-09-17T05:55:01.358 INFO:teuthology.orchestra.run.smithi150.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.73704.log.gz 2024-09-17T05:55:01.358 INFO:teuthology.orchestra.run.smithi150.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.58800.log.gz 2024-09-17T05:55:01.358 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.53330.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.81503.log 2024-09-17T05:55:01.358 INFO:teuthology.orchestra.run.smithi150.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.53330.log.gz 2024-09-17T05:55:01.358 INFO:teuthology.orchestra.run.smithi150.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.78818.log 2024-09-17T05:55:01.358 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.66773.log: /var/log/ceph/ceph-client.admin.81503.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49968.log 2024-09-17T05:55:01.358 INFO:teuthology.orchestra.run.smithi150.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.66773.log.gz 2024-09-17T05:55:01.358 INFO:teuthology.orchestra.run.smithi150.stderr: 86.4% -- replaced with /var/log/ceph/ceph-client.admin.81503.log.gz 2024-09-17T05:55:01.359 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.78818.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64840.log 2024-09-17T05:55:01.359 INFO:teuthology.orchestra.run.smithi150.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.78818.log.gz 2024-09-17T05:55:01.359 INFO:teuthology.orchestra.run.smithi150.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66983.log 2024-09-17T05:55:01.359 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.49968.log: /var/log/ceph/ceph-client.admin.64840.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51956.log 2024-09-17T05:55:01.359 INFO:teuthology.orchestra.run.smithi150.stderr: 86.6% -- replaced with /var/log/ceph/ceph-client.admin.49968.log.gz 2024-09-17T05:55:01.359 INFO:teuthology.orchestra.run.smithi150.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.64840.log.gz 2024-09-17T05:55:01.359 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.66983.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61928.log 2024-09-17T05:55:01.359 INFO:teuthology.orchestra.run.smithi150.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.66983.log.gz 2024-09-17T05:55:01.359 INFO:teuthology.orchestra.run.smithi150.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.81183.log 2024-09-17T05:55:01.359 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.51956.log: /var/log/ceph/ceph-client.admin.61928.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67025.log 2024-09-17T05:55:01.359 INFO:teuthology.orchestra.run.smithi150.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.51956.log.gz 2024-09-17T05:55:01.359 INFO:teuthology.orchestra.run.smithi150.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.61928.log.gz 2024-09-17T05:55:01.359 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.81183.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54537.log 2024-09-17T05:55:01.359 INFO:teuthology.orchestra.run.smithi150.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.81183.log.gz 2024-09-17T05:55:01.360 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.67025.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48085.log 2024-09-17T05:55:01.360 INFO:teuthology.orchestra.run.smithi150.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.67025.log.gz 2024-09-17T05:55:01.360 INFO:teuthology.orchestra.run.smithi150.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62022.log 2024-09-17T05:55:01.360 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.54537.log: /var/log/ceph/ceph-client.admin.48085.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73332.log 2024-09-17T05:55:01.360 INFO:teuthology.orchestra.run.smithi150.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.54537.log.gz 2024-09-17T05:55:01.360 INFO:teuthology.orchestra.run.smithi150.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.48085.log.gz 2024-09-17T05:55:01.360 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.62022.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.81731.log 2024-09-17T05:55:01.360 INFO:teuthology.orchestra.run.smithi150.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.62022.log.gz 2024-09-17T05:55:01.360 INFO:teuthology.orchestra.run.smithi150.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55940.log 2024-09-17T05:55:01.360 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.73332.log: /var/log/ceph/ceph-client.admin.81731.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72758.log 2024-09-17T05:55:01.360 INFO:teuthology.orchestra.run.smithi150.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.73332.log.gz 2024-09-17T05:55:01.360 INFO:teuthology.orchestra.run.smithi150.stderr: 85.9% -- replaced with /var/log/ceph/ceph-client.admin.81731.log.gz 2024-09-17T05:55:01.360 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.55940.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.76728.log 2024-09-17T05:55:01.360 INFO:teuthology.orchestra.run.smithi150.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.55940.log.gz 2024-09-17T05:55:01.361 INFO:teuthology.orchestra.run.smithi150.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.83318.log 2024-09-17T05:55:01.361 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.72758.log: /var/log/ceph/ceph-client.admin.76728.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53288.log 2024-09-17T05:55:01.361 INFO:teuthology.orchestra.run.smithi150.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.72758.log.gz 2024-09-17T05:55:01.361 INFO:teuthology.orchestra.run.smithi150.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.76728.log.gz 2024-09-17T05:55:01.361 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.83318.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50094.log 2024-09-17T05:55:01.361 INFO:teuthology.orchestra.run.smithi150.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.83318.log.gz 2024-09-17T05:55:01.361 INFO:teuthology.orchestra.run.smithi150.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66647.log 2024-09-17T05:55:01.361 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.53288.log: /var/log/ceph/ceph-client.admin.50094.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51742.log 2024-09-17T05:55:01.361 INFO:teuthology.orchestra.run.smithi150.stderr: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.53288.log.gz 2024-09-17T05:55:01.361 INFO:teuthology.orchestra.run.smithi150.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.50094.log.gz 2024-09-17T05:55:01.361 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.66647.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63580.log 2024-09-17T05:55:01.361 INFO:teuthology.orchestra.run.smithi150.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.66647.log.gz 2024-09-17T05:55:01.361 INFO:teuthology.orchestra.run.smithi150.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55772.log 2024-09-17T05:55:01.362 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.51742.log: /var/log/ceph/ceph-client.admin.63580.log: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.51742.log.gz 2024-09-17T05:55:01.362 INFO:teuthology.orchestra.run.smithi150.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.84295.log 2024-09-17T05:55:01.362 INFO:teuthology.orchestra.run.smithi150.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.63580.log.gz 2024-09-17T05:55:01.362 INFO:teuthology.orchestra.run.smithi150.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63538.log 2024-09-17T05:55:01.362 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.55772.log: /var/log/ceph/ceph-client.admin.84295.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.79848.log 2024-09-17T05:55:01.362 INFO:teuthology.orchestra.run.smithi150.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.55772.log.gz 2024-09-17T05:55:01.362 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.63538.log: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.84295.log.gz 2024-09-17T05:55:01.362 INFO:teuthology.orchestra.run.smithi150.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.76219.log 2024-09-17T05:55:01.362 INFO:teuthology.orchestra.run.smithi150.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.63538.log.gz 2024-09-17T05:55:01.362 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.79848.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65320.log 2024-09-17T05:55:01.362 INFO:teuthology.orchestra.run.smithi150.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.79848.log.gz 2024-09-17T05:55:01.362 INFO:teuthology.orchestra.run.smithi150.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54892.log 2024-09-17T05:55:01.362 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.76219.log: /var/log/ceph/ceph-client.admin.65320.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67589.log 2024-09-17T05:55:01.363 INFO:teuthology.orchestra.run.smithi150.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.76219.log.gz 2024-09-17T05:55:01.363 INFO:teuthology.orchestra.run.smithi150.stderr: 86.3% -- replaced with /var/log/ceph/ceph-client.admin.65320.log.gz 2024-09-17T05:55:01.363 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.54892.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.84421.log 2024-09-17T05:55:01.363 INFO:teuthology.orchestra.run.smithi150.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.54892.log.gz 2024-09-17T05:55:01.363 INFO:teuthology.orchestra.run.smithi150.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74939.log 2024-09-17T05:55:01.363 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.67589.log: /var/log/ceph/ceph-client.admin.84421.log: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.67589.log.gz 2024-09-17T05:55:01.363 INFO:teuthology.orchestra.run.smithi150.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47138.log 2024-09-17T05:55:01.363 INFO:teuthology.orchestra.run.smithi150.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.84421.log.gz 2024-09-17T05:55:01.363 INFO:teuthology.orchestra.run.smithi150.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.82546.log 2024-09-17T05:55:01.363 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.74939.log: /var/log/ceph/ceph-client.admin.47138.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65925.log 2024-09-17T05:55:01.363 INFO:teuthology.orchestra.run.smithi150.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.74939.log.gz 2024-09-17T05:55:01.363 INFO:teuthology.orchestra.run.smithi150.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.47138.log.gz 2024-09-17T05:55:01.363 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.82546.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68345.log 2024-09-17T05:55:01.363 INFO:teuthology.orchestra.run.smithi150.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.82546.log.gz 2024-09-17T05:55:01.364 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.65925.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.82336.log 2024-09-17T05:55:01.364 INFO:teuthology.orchestra.run.smithi150.stderr: 86.6% -- replaced with /var/log/ceph/ceph-client.admin.65925.log.gz 2024-09-17T05:55:01.364 INFO:teuthology.orchestra.run.smithi150.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57517.log 2024-09-17T05:55:01.364 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.68345.log: /var/log/ceph/ceph-client.admin.82336.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47594.log 2024-09-17T05:55:01.364 INFO:teuthology.orchestra.run.smithi150.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.68345.log.gz 2024-09-17T05:55:01.364 INFO:teuthology.orchestra.run.smithi150.stderr: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.82336.log.gz 2024-09-17T05:55:01.364 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.57517.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.76560.log 2024-09-17T05:55:01.364 INFO:teuthology.orchestra.run.smithi150.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.57517.log.gz 2024-09-17T05:55:01.364 INFO:teuthology.orchestra.run.smithi150.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.83462.log 2024-09-17T05:55:01.364 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.47594.log: /var/log/ceph/ceph-client.admin.76560.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51605.log 2024-09-17T05:55:01.364 INFO:teuthology.orchestra.run.smithi150.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.47594.log.gz 2024-09-17T05:55:01.364 INFO:teuthology.orchestra.run.smithi150.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.76560.log.gz 2024-09-17T05:55:01.364 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.83462.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67235.log 2024-09-17T05:55:01.365 INFO:teuthology.orchestra.run.smithi150.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72450.log 2024-09-17T05:55:01.365 INFO:teuthology.orchestra.run.smithi150.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.83462.log.gz 2024-09-17T05:55:01.365 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.51605.log: /var/log/ceph/ceph-client.admin.67235.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.51605.log.gz 2024-09-17T05:55:01.365 INFO:teuthology.orchestra.run.smithi150.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.78233.log 2024-09-17T05:55:01.365 INFO:teuthology.orchestra.run.smithi150.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.67235.log.gz 2024-09-17T05:55:01.365 INFO:teuthology.orchestra.run.smithi150.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.79112.log 2024-09-17T05:55:01.365 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.72450.log: /var/log/ceph/ceph-client.admin.78233.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.79196.log 2024-09-17T05:55:01.365 INFO:teuthology.orchestra.run.smithi150.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.72450.log.gz 2024-09-17T05:55:01.365 INFO:teuthology.orchestra.run.smithi150.stderr: 86.8% -- replaced with /var/log/ceph/ceph-client.admin.78233.log.gz 2024-09-17T05:55:01.365 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.79112.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68555.log 2024-09-17T05:55:01.365 INFO:teuthology.orchestra.run.smithi150.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.79112.log.gz 2024-09-17T05:55:01.365 INFO:teuthology.orchestra.run.smithi150.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58541.log 2024-09-17T05:55:01.366 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.79196.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37083.log 2024-09-17T05:55:01.366 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.68555.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.79196.log.gz 2024-09-17T05:55:01.366 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.58541.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.68555.log.gz 2024-09-17T05:55:01.366 INFO:teuthology.orchestra.run.smithi150.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60345.log 2024-09-17T05:55:01.366 INFO:teuthology.orchestra.run.smithi150.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.58541.log.gz 2024-09-17T05:55:01.366 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.37083.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43596.log 2024-09-17T05:55:01.366 INFO:teuthology.orchestra.run.smithi150.stderr: 86.0% -- replaced with /var/log/ceph/ceph-client.admin.37083.log.gz 2024-09-17T05:55:01.366 INFO:teuthology.orchestra.run.smithi150.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51700.log 2024-09-17T05:55:01.366 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.60345.log: /var/log/ceph/ceph-client.admin.43596.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.80142.log 2024-09-17T05:55:01.366 INFO:teuthology.orchestra.run.smithi150.stderr: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.60345.log.gz 2024-09-17T05:55:01.366 INFO:teuthology.orchestra.run.smithi150.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.43596.log.gz 2024-09-17T05:55:01.366 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.51700.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75711.log 2024-09-17T05:55:01.366 INFO:teuthology.orchestra.run.smithi150.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-09-17T05:55:01.367 INFO:teuthology.orchestra.run.smithi150.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.51700.log.gz 2024-09-17T05:55:01.367 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.80142.log: /var/log/ceph/ceph-client.admin.75711.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.80142.log.gz 2024-09-17T05:55:01.367 INFO:teuthology.orchestra.run.smithi150.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52796.log 2024-09-17T05:55:01.367 INFO:teuthology.orchestra.run.smithi150.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.75711.log.gz 2024-09-17T05:55:01.367 INFO:teuthology.orchestra.run.smithi150.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65551.log 2024-09-17T05:55:01.367 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph.audit.log: /var/log/ceph/ceph-client.admin.52796.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53616.log 2024-09-17T05:55:01.367 INFO:teuthology.orchestra.run.smithi150.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.52796.log.gz 2024-09-17T05:55:01.367 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.65551.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.78902.log 2024-09-17T05:55:01.367 INFO:teuthology.orchestra.run.smithi150.stderr: 86.0% -- replaced with /var/log/ceph/ceph-client.admin.65551.log.gz 2024-09-17T05:55:01.367 INFO:teuthology.orchestra.run.smithi150.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48841.log 2024-09-17T05:55:01.367 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.53616.log: /var/log/ceph/ceph-client.admin.78902.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51998.log 2024-09-17T05:55:01.367 INFO:teuthology.orchestra.run.smithi150.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.53616.log.gz 2024-09-17T05:55:01.367 INFO:teuthology.orchestra.run.smithi150.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.78902.log.gz 2024-09-17T05:55:01.368 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.48841.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47054.log 2024-09-17T05:55:01.368 INFO:teuthology.orchestra.run.smithi150.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.48841.log.gz 2024-09-17T05:55:01.368 INFO:teuthology.orchestra.run.smithi150.stderr:gzip/var/log/ceph/ceph-client.admin.51998.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.69711.log 2024-09-17T05:55:01.368 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.47054.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.51998.log.gz 2024-09-17T05:55:01.368 INFO:teuthology.orchestra.run.smithi150.stderr:gzip -5 --verbose -- 87.8% -- replaced with /var/log/ceph/ceph-client.admin.47054.log.gz 2024-09-17T05:55:01.368 INFO:teuthology.orchestra.run.smithi150.stderr: /var/log/ceph/ceph-client.admin.43859.log 2024-09-17T05:55:01.368 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.69711.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.69711.log.gz 2024-09-17T05:55:01.368 INFO:teuthology.orchestra.run.smithi150.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53826.log 2024-09-17T05:55:01.368 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.43859.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50679.log 2024-09-17T05:55:01.368 INFO:teuthology.orchestra.run.smithi150.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.43859.log.gz 2024-09-17T05:55:01.368 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.53826.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60975.log 2024-09-17T05:55:01.368 INFO:teuthology.orchestra.run.smithi150.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.53826.log.gz 2024-09-17T05:55:01.368 INFO:teuthology.orchestra.run.smithi150.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67904.log 2024-09-17T05:55:01.368 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.50679.log: /var/log/ceph/ceph-client.admin.60975.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64882.log 2024-09-17T05:55:01.368 INFO:teuthology.orchestra.run.smithi150.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.50679.log.gz 2024-09-17T05:55:01.369 INFO:teuthology.orchestra.run.smithi150.stderr: 89.9% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-09-17T05:55:01.369 INFO:teuthology.orchestra.run.smithi150.stderr: 86.5% -- replaced with /var/log/ceph/ceph-client.admin.60975.log.gz 2024-09-17T05:55:01.369 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.67904.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.84505.log 2024-09-17T05:55:01.369 INFO:teuthology.orchestra.run.smithi150.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.67904.log.gz 2024-09-17T05:55:01.369 INFO:teuthology.orchestra.run.smithi150.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61689.log 2024-09-17T05:55:01.369 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.64882.log: gzip/var/log/ceph/ceph-client.admin.84505.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.66090.log 2024-09-17T05:55:01.369 INFO:teuthology.orchestra.run.smithi150.stderr: 86.0% -- replaced with /var/log/ceph/ceph-client.admin.64882.log.gz 2024-09-17T05:55:01.369 INFO:teuthology.orchestra.run.smithi150.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.84505.log.gz 2024-09-17T05:55:01.369 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.61689.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36863.log 2024-09-17T05:55:01.369 INFO:teuthology.orchestra.run.smithi150.stderr: 86.6% -- replaced with /var/log/ceph/ceph-client.admin.61689.log.gz 2024-09-17T05:55:01.369 INFO:teuthology.orchestra.run.smithi150.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43176.log 2024-09-17T05:55:01.369 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.66090.log: /var/log/ceph/ceph-client.admin.36863.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.45517.log 2024-09-17T05:55:01.369 INFO:teuthology.orchestra.run.smithi150.stderr: 84.4% -- replaced with /var/log/ceph/ceph-client.admin.66090.log.gz 2024-09-17T05:55:01.369 INFO:teuthology.orchestra.run.smithi150.stderr: 78.0% -- replaced with /var/log/ceph/ceph-client.admin.36863.log.gz 2024-09-17T05:55:01.370 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.43176.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.64048.log 2024-09-17T05:55:01.370 INFO:teuthology.orchestra.run.smithi150.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.43176.log.gz 2024-09-17T05:55:01.370 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.0.45517.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.45517.log.gz 2024-09-17T05:55:01.370 INFO:teuthology.orchestra.run.smithi150.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43554.log 2024-09-17T05:55:01.370 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.0.64048.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.81647.log 2024-09-17T05:55:01.370 INFO:teuthology.orchestra.run.smithi150.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.64048.log.gz 2024-09-17T05:55:01.370 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.43554.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54369.log 2024-09-17T05:55:01.370 INFO:teuthology.orchestra.run.smithi150.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.43554.log.gz 2024-09-17T05:55:01.370 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.81647.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.56408.log 2024-09-17T05:55:01.370 INFO:teuthology.orchestra.run.smithi150.stderr: 86.4% -- replaced with /var/log/ceph/ceph-client.admin.81647.log.gz 2024-09-17T05:55:01.370 INFO:teuthology.orchestra.run.smithi150.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.81545.log 2024-09-17T05:55:01.370 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.54369.log: /var/log/ceph/ceph-client.0.56408.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.56408.log.gzgzip 2024-09-17T05:55:01.370 INFO:teuthology.orchestra.run.smithi150.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.70857.log 2024-09-17T05:55:01.370 INFO:teuthology.orchestra.run.smithi150.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.54369.log.gz 2024-09-17T05:55:01.371 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.81545.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.78734.log 2024-09-17T05:55:01.371 INFO:teuthology.orchestra.run.smithi150.stderr: 86.6% -- replaced with /var/log/ceph/ceph-client.admin.81545.log.gz 2024-09-17T05:55:01.371 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.70857.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51136.log 2024-09-17T05:55:01.371 INFO:teuthology.orchestra.run.smithi150.stderr: 86.4% -- replaced with /var/log/ceph/ceph-client.admin.70857.log.gz 2024-09-17T05:55:01.371 INFO:teuthology.orchestra.run.smithi150.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.82714.log 2024-09-17T05:55:01.371 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.78734.log: /var/log/ceph/ceph-client.admin.51136.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68860.log 2024-09-17T05:55:01.371 INFO:teuthology.orchestra.run.smithi150.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.78734.log.gz 2024-09-17T05:55:01.371 INFO:teuthology.orchestra.run.smithi150.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.51136.log.gz 2024-09-17T05:55:01.371 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.82714.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.76644.log 2024-09-17T05:55:01.371 INFO:teuthology.orchestra.run.smithi150.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.82714.log.gz 2024-09-17T05:55:01.371 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.68860.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67319.log 2024-09-17T05:55:01.371 INFO:teuthology.orchestra.run.smithi150.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.68860.log.gz 2024-09-17T05:55:01.371 INFO:teuthology.orchestra.run.smithi150.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.76872.log 2024-09-17T05:55:01.371 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.76644.log: /var/log/ceph/ceph-client.admin.67319.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62106.log 2024-09-17T05:55:01.372 INFO:teuthology.orchestra.run.smithi150.stderr: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.76644.log.gz 2024-09-17T05:55:01.372 INFO:teuthology.orchestra.run.smithi150.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.67319.log.gz 2024-09-17T05:55:01.372 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.76872.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42836.log 2024-09-17T05:55:01.372 INFO:teuthology.orchestra.run.smithi150.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.76872.log.gz 2024-09-17T05:55:01.372 INFO:teuthology.orchestra.run.smithi150.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60891.log 2024-09-17T05:55:01.372 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.62106.log: /var/log/ceph/ceph-client.admin.42836.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.62106.log.gz 2024-09-17T05:55:01.372 INFO:teuthology.orchestra.run.smithi150.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50637.log 2024-09-17T05:55:01.372 INFO:teuthology.orchestra.run.smithi150.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.42836.log.gz 2024-09-17T05:55:01.372 INFO:teuthology.orchestra.run.smithi150.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.80772.log 2024-09-17T05:55:01.372 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.60891.log: /var/log/ceph/ceph-client.admin.50637.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63286.log 2024-09-17T05:55:01.372 INFO:teuthology.orchestra.run.smithi150.stderr: 86.4% -- replaced with /var/log/ceph/ceph-client.admin.60891.log.gz 2024-09-17T05:55:01.372 INFO:teuthology.orchestra.run.smithi150.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.50637.log.gz 2024-09-17T05:55:01.372 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.80772.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72930.log 2024-09-17T05:55:01.372 INFO:teuthology.orchestra.run.smithi150.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.80772.log.gz 2024-09-17T05:55:01.373 INFO:teuthology.orchestra.run.smithi150.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51395.log 2024-09-17T05:55:01.373 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.63286.log: /var/log/ceph/ceph-client.admin.72930.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50417.log 2024-09-17T05:55:01.373 INFO:teuthology.orchestra.run.smithi150.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.63286.log.gz 2024-09-17T05:55:01.373 INFO:teuthology.orchestra.run.smithi150.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.72930.log.gz 2024-09-17T05:55:01.373 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.51395.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51649.log 2024-09-17T05:55:01.373 INFO:teuthology.orchestra.run.smithi150.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.51395.log.gz 2024-09-17T05:55:01.373 INFO:teuthology.orchestra.run.smithi150.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.80184.log 2024-09-17T05:55:01.373 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.50417.log: /var/log/ceph/ceph-client.admin.51649.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59673.log 2024-09-17T05:55:01.373 INFO:teuthology.orchestra.run.smithi150.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.50417.log.gz 2024-09-17T05:55:01.373 INFO:teuthology.orchestra.run.smithi150.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.51649.log.gz 2024-09-17T05:55:01.373 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.80184.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62190.log 2024-09-17T05:55:01.373 INFO:teuthology.orchestra.run.smithi150.stderr: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.80184.log.gz 2024-09-17T05:55:01.374 INFO:teuthology.orchestra.run.smithi150.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.82672.log 2024-09-17T05:55:01.374 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.59673.log: /var/log/ceph/ceph-client.admin.62190.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.59673.log.gz 2024-09-17T05:55:01.374 INFO:teuthology.orchestra.run.smithi150.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56066.log 2024-09-17T05:55:01.374 INFO:teuthology.orchestra.run.smithi150.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.62190.log.gz 2024-09-17T05:55:01.374 INFO:teuthology.orchestra.run.smithi150.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60807.log 2024-09-17T05:55:01.374 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.82672.log: /var/log/ceph/ceph-client.admin.56066.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54766.log 2024-09-17T05:55:01.374 INFO:teuthology.orchestra.run.smithi150.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.82672.log.gz 2024-09-17T05:55:01.374 INFO:teuthology.orchestra.run.smithi150.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.56066.log.gz 2024-09-17T05:55:01.374 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.60807.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75837.log 2024-09-17T05:55:01.374 INFO:teuthology.orchestra.run.smithi150.stderr: 86.7% -- replaced with /var/log/ceph/ceph-client.admin.60807.log.gz 2024-09-17T05:55:01.374 INFO:teuthology.orchestra.run.smithi150.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48421.log 2024-09-17T05:55:01.374 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.54766.log: /var/log/ceph/ceph-client.admin.75837.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46886.log 2024-09-17T05:55:01.374 INFO:teuthology.orchestra.run.smithi150.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.54766.log.gz 2024-09-17T05:55:01.375 INFO:teuthology.orchestra.run.smithi150.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.75837.log.gz 2024-09-17T05:55:01.375 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.48421.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53910.log 2024-09-17T05:55:01.375 INFO:teuthology.orchestra.run.smithi150.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.48421.log.gz 2024-09-17T05:55:01.375 INFO:teuthology.orchestra.run.smithi150.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49816.log 2024-09-17T05:55:01.375 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.46886.log: /var/log/ceph/ceph-client.admin.53910.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.80568.log 2024-09-17T05:55:01.375 INFO:teuthology.orchestra.run.smithi150.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.46886.log.gz 2024-09-17T05:55:01.375 INFO:teuthology.orchestra.run.smithi150.stderr: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.53910.log.gz 2024-09-17T05:55:01.375 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.49816.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75094.log 2024-09-17T05:55:01.375 INFO:teuthology.orchestra.run.smithi150.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.49816.log.gz 2024-09-17T05:55:01.375 INFO:teuthology.orchestra.run.smithi150.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.82378.log 2024-09-17T05:55:01.375 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.0.80568.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.80568.log.gz 2024-09-17T05:55:01.375 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.75094.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43260.log 2024-09-17T05:55:01.375 INFO:teuthology.orchestra.run.smithi150.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.75094.log.gz 2024-09-17T05:55:01.375 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.82378.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.80058.log 2024-09-17T05:55:01.376 INFO:teuthology.orchestra.run.smithi150.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.82378.log.gz 2024-09-17T05:55:01.376 INFO:teuthology.orchestra.run.smithi150.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.76264.log 2024-09-17T05:55:01.376 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.43260.log: /var/log/ceph/ceph-client.admin.80058.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.81689.log 2024-09-17T05:55:01.376 INFO:teuthology.orchestra.run.smithi150.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.43260.log.gz 2024-09-17T05:55:01.376 INFO:teuthology.orchestra.run.smithi150.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.80058.log.gz 2024-09-17T05:55:01.376 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.76264.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67487.log 2024-09-17T05:55:01.376 INFO:teuthology.orchestra.run.smithi150.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53490.log 2024-09-17T05:55:01.376 INFO:teuthology.orchestra.run.smithi150.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.76264.log.gz/var/log/ceph/ceph-client.admin.81689.log: 2024-09-17T05:55:01.376 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.67487.log: 86.6% -- replaced with /var/log/ceph/ceph-client.admin.81689.log.gz 2024-09-17T05:55:01.376 INFO:teuthology.orchestra.run.smithi150.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54724.log 2024-09-17T05:55:01.376 INFO:teuthology.orchestra.run.smithi150.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.67487.log.gz 2024-09-17T05:55:01.376 INFO:teuthology.orchestra.run.smithi150.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59421.log 2024-09-17T05:55:01.376 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.53490.log: /var/log/ceph/ceph-client.admin.54724.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.82630.log 2024-09-17T05:55:01.376 INFO:teuthology.orchestra.run.smithi150.stderr: 86.7% -- replaced with /var/log/ceph/ceph-client.admin.53490.log.gz 2024-09-17T05:55:01.377 INFO:teuthology.orchestra.run.smithi150.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.54724.log.gz 2024-09-17T05:55:01.377 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.59421.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43860.log 2024-09-17T05:55:01.377 INFO:teuthology.orchestra.run.smithi150.stderr: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.59421.log.gz 2024-09-17T05:55:01.377 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.82630.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59505.log 2024-09-17T05:55:01.377 INFO:teuthology.orchestra.run.smithi150.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.82630.log.gz 2024-09-17T05:55:01.377 INFO:teuthology.orchestra.run.smithi150.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69375.log 2024-09-17T05:55:01.377 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.43860.log: /var/log/ceph/ceph-client.admin.59505.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48253.log 2024-09-17T05:55:01.377 INFO:teuthology.orchestra.run.smithi150.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.43860.log.gz 2024-09-17T05:55:01.377 INFO:teuthology.orchestra.run.smithi150.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.59505.log.gz 2024-09-17T05:55:01.377 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.69375.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72068.log 2024-09-17T05:55:01.377 INFO:teuthology.orchestra.run.smithi150.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.69375.log.gz 2024-09-17T05:55:01.377 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.48253.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52292.log 2024-09-17T05:55:01.377 INFO:teuthology.orchestra.run.smithi150.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.48253.log.gz 2024-09-17T05:55:01.377 INFO:teuthology.orchestra.run.smithi150.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36807.log 2024-09-17T05:55:01.378 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.72068.log: /var/log/ceph/ceph-client.admin.52292.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72623.log 2024-09-17T05:55:01.378 INFO:teuthology.orchestra.run.smithi150.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.72068.log.gz 2024-09-17T05:55:01.378 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.36807.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68135.log 2024-09-17T05:55:01.378 INFO:teuthology.orchestra.run.smithi150.stderr: 76.7% -- replaced with /var/log/ceph/ceph-client.admin.36807.log.gz 2024-09-17T05:55:01.378 INFO:teuthology.orchestra.run.smithi150.stderr: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.52292.log.gz 2024-09-17T05:55:01.378 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.72623.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72888.log 2024-09-17T05:55:01.378 INFO:teuthology.orchestra.run.smithi150.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.72623.log.gz 2024-09-17T05:55:01.378 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.68135.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62689.log 2024-09-17T05:55:01.378 INFO:teuthology.orchestra.run.smithi150.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.68135.log.gz 2024-09-17T05:55:01.378 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.72888.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.82193.log 2024-09-17T05:55:01.378 INFO:teuthology.orchestra.run.smithi150.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.72888.log.gz 2024-09-17T05:55:01.378 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.62689.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69933.log 2024-09-17T05:55:01.378 INFO:teuthology.orchestra.run.smithi150.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.62689.log.gz 2024-09-17T05:55:01.378 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.82193.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64126.log 2024-09-17T05:55:01.379 INFO:teuthology.orchestra.run.smithi150.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.82193.log.gz 2024-09-17T05:55:01.379 INFO:teuthology.orchestra.run.smithi150.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56612.log 2024-09-17T05:55:01.379 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.69933.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.69933.log.gz 2024-09-17T05:55:01.379 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.64126.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44856.log 2024-09-17T05:55:01.379 INFO:teuthology.orchestra.run.smithi150.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.64126.log.gz 2024-09-17T05:55:01.379 INFO:teuthology.orchestra.run.smithi150.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65509.log 2024-09-17T05:55:01.379 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.56612.log: /var/log/ceph/ceph-client.admin.44856.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.56612.log.gz 2024-09-17T05:55:01.379 INFO:teuthology.orchestra.run.smithi150.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63454.log 2024-09-17T05:55:01.379 INFO:teuthology.orchestra.run.smithi150.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.78566.log 2024-09-17T05:55:01.379 INFO:teuthology.orchestra.run.smithi150.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.44856.log.gz 2024-09-17T05:55:01.379 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.65509.log: /var/log/ceph/ceph-client.admin.63454.log: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.65509.log.gz 2024-09-17T05:55:01.379 INFO:teuthology.orchestra.run.smithi150.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51220.log 2024-09-17T05:55:01.379 INFO:teuthology.orchestra.run.smithi150.stderr: 87.1%gzip -- replaced with /var/log/ceph/ceph-client.admin.63454.log.gz -5 2024-09-17T05:55:01.379 INFO:teuthology.orchestra.run.smithi150.stderr: --verbose -- /var/log/ceph/ceph-client.admin.55814.log 2024-09-17T05:55:01.380 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.78566.log: /var/log/ceph/ceph-client.admin.51220.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.78566.log.gz 2024-09-17T05:55:01.380 INFO:teuthology.orchestra.run.smithi150.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48043.log 2024-09-17T05:55:01.380 INFO:teuthology.orchestra.run.smithi150.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.51220.log.gz 2024-09-17T05:55:01.380 INFO:teuthology.orchestra.run.smithi150.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54621.log 2024-09-17T05:55:01.380 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.55814.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.55814.log.gz 2024-09-17T05:55:01.380 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.48043.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69459.log 2024-09-17T05:55:01.380 INFO:teuthology.orchestra.run.smithi150.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.73524.log 2024-09-17T05:55:01.380 INFO:teuthology.orchestra.run.smithi150.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.48043.log.gz 2024-09-17T05:55:01.380 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.54621.log: /var/log/ceph/ceph-client.admin.69459.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.54621.log.gz 2024-09-17T05:55:01.380 INFO:teuthology.orchestra.run.smithi150.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55642.log 2024-09-17T05:55:01.380 INFO:teuthology.orchestra.run.smithi150.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.69459.log.gz 2024-09-17T05:55:01.380 INFO:teuthology.orchestra.run.smithi150.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74999.log 2024-09-17T05:55:01.380 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.0.73524.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.73524.log.gz 2024-09-17T05:55:01.380 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.55642.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37310.log 2024-09-17T05:55:01.381 INFO:teuthology.orchestra.run.smithi150.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.55642.log.gz 2024-09-17T05:55:01.381 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.74999.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37677.log 2024-09-17T05:55:01.381 INFO:teuthology.orchestra.run.smithi150.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.74999.log.gz 2024-09-17T05:55:01.381 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.37310.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59147.log 2024-09-17T05:55:01.381 INFO:teuthology.orchestra.run.smithi150.stderr: 86.6% -- replaced with /var/log/ceph/ceph-client.admin.37310.log.gz 2024-09-17T05:55:01.381 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.37677.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47955.log 2024-09-17T05:55:01.381 INFO:teuthology.orchestra.run.smithi150.stderr: 86.6% -- replaced with /var/log/ceph/ceph-client.admin.37677.log.gz 2024-09-17T05:55:01.381 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.59147.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52358.log 2024-09-17T05:55:01.381 INFO:teuthology.orchestra.run.smithi150.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.59147.log.gz 2024-09-17T05:55:01.381 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.47955.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74813.log 2024-09-17T05:55:01.381 INFO:teuthology.orchestra.run.smithi150.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.47955.log.gz 2024-09-17T05:55:01.381 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.52358.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.77502.log 2024-09-17T05:55:01.381 INFO:teuthology.orchestra.run.smithi150.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.52358.log.gz 2024-09-17T05:55:01.381 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.74813.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70287.log 2024-09-17T05:55:01.382 INFO:teuthology.orchestra.run.smithi150.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.74813.log.gz 2024-09-17T05:55:01.382 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.77502.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71409.log 2024-09-17T05:55:01.382 INFO:teuthology.orchestra.run.smithi150.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.77502.log.gz 2024-09-17T05:55:01.382 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.70287.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57433.log 2024-09-17T05:55:01.382 INFO:teuthology.orchestra.run.smithi150.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.70287.log.gz 2024-09-17T05:55:01.382 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.71409.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62479.log 2024-09-17T05:55:01.382 INFO:teuthology.orchestra.run.smithi150.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.71409.log.gz 2024-09-17T05:55:01.382 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.57433.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74055.log 2024-09-17T05:55:01.382 INFO:teuthology.orchestra.run.smithi150.stderr: 86.8% -- replaced with /var/log/ceph/ceph-client.admin.57433.log.gz 2024-09-17T05:55:01.382 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.62479.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65883.log 2024-09-17T05:55:01.382 INFO:teuthology.orchestra.run.smithi150.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.62479.log.gz 2024-09-17T05:55:01.382 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.74055.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64294.log 2024-09-17T05:55:01.382 INFO:teuthology.orchestra.run.smithi150.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.74055.log.gz 2024-09-17T05:55:01.382 INFO:teuthology.orchestra.run.smithi150.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.78650.log 2024-09-17T05:55:01.382 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.65883.log: /var/log/ceph/ceph-client.admin.64294.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.65883.log.gz 2024-09-17T05:55:01.383 INFO:teuthology.orchestra.run.smithi150.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69064.log 2024-09-17T05:55:01.383 INFO:teuthology.orchestra.run.smithi150.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.64294.log.gz 2024-09-17T05:55:01.383 INFO:teuthology.orchestra.run.smithi150.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62605.log 2024-09-17T05:55:01.383 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.78650.log: /var/log/ceph/ceph-client.admin.69064.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55335.log 2024-09-17T05:55:01.383 INFO:teuthology.orchestra.run.smithi150.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.78650.log.gz 2024-09-17T05:55:01.383 INFO:teuthology.orchestra.run.smithi150.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.69064.log.gz 2024-09-17T05:55:01.383 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.62605.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69501.log 2024-09-17T05:55:01.383 INFO:teuthology.orchestra.run.smithi150.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.62605.log.gz/var/log/ceph/ceph-client.admin.55335.log: 2024-09-17T05:55:01.383 INFO:teuthology.orchestra.run.smithi150.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54934.log 2024-09-17T05:55:01.383 INFO:teuthology.orchestra.run.smithi150.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.55335.log.gz 2024-09-17T05:55:01.383 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.69501.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37185.log 2024-09-17T05:55:01.383 INFO:teuthology.orchestra.run.smithi150.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.69501.log.gz 2024-09-17T05:55:01.383 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.54934.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71211.log 2024-09-17T05:55:01.383 INFO:teuthology.orchestra.run.smithi150.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.54934.log.gz 2024-09-17T05:55:01.384 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.37185.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62437.log 2024-09-17T05:55:01.384 INFO:teuthology.orchestra.run.smithi150.stderr: 86.5% -- replaced with /var/log/ceph/ceph-client.admin.37185.log.gz 2024-09-17T05:55:01.384 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.71211.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.76914.log 2024-09-17T05:55:01.384 INFO:teuthology.orchestra.run.smithi150.stderr: 86.8% -- replaced with /var/log/ceph/ceph-client.admin.71211.log.gz 2024-09-17T05:55:01.384 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.62437.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47425.log 2024-09-17T05:55:01.384 INFO:teuthology.orchestra.run.smithi150.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.62437.log.gz 2024-09-17T05:55:01.384 INFO:teuthology.orchestra.run.smithi150.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53532.log 2024-09-17T05:55:01.384 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.76914.log: /var/log/ceph/ceph-client.admin.47425.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.76914.log.gz 2024-09-17T05:55:01.384 INFO:teuthology.orchestra.run.smithi150.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61269.log 2024-09-17T05:55:01.384 INFO:teuthology.orchestra.run.smithi150.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.47425.log.gz 2024-09-17T05:55:01.384 INFO:teuthology.orchestra.run.smithi150.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44530.log 2024-09-17T05:55:01.384 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.53532.log: /var/log/ceph/ceph-client.admin.61269.log: 86.4% -- replaced with /var/log/ceph/ceph-client.admin.53532.log.gz 2024-09-17T05:55:01.384 INFO:teuthology.orchestra.run.smithi150.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63328.log 2024-09-17T05:55:01.385 INFO:teuthology.orchestra.run.smithi150.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.61269.log.gz 2024-09-17T05:55:01.385 INFO:teuthology.orchestra.run.smithi150.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.79536.log 2024-09-17T05:55:01.385 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.44530.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.44530.log.gz 2024-09-17T05:55:01.385 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.63328.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50595.log 2024-09-17T05:55:01.385 INFO:teuthology.orchestra.run.smithi150.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71127.log 2024-09-17T05:55:01.385 INFO:teuthology.orchestra.run.smithi150.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.63328.log.gz 2024-09-17T05:55:01.385 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.79536.log: /var/log/ceph/ceph-client.admin.50595.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.79536.log.gz 2024-09-17T05:55:01.385 INFO:teuthology.orchestra.run.smithi150.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72972.log 2024-09-17T05:55:01.385 INFO:teuthology.orchestra.run.smithi150.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.50595.log.gz 2024-09-17T05:55:01.385 INFO:teuthology.orchestra.run.smithi150.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50178.log 2024-09-17T05:55:01.385 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.71127.log: /var/log/ceph/ceph-client.admin.72972.log: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.71127.log.gz 2024-09-17T05:55:01.385 INFO:teuthology.orchestra.run.smithi150.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75440.log 2024-09-17T05:55:01.385 INFO:teuthology.orchestra.run.smithi150.stderr: 86.7% -- replaced with /var/log/ceph/ceph-client.admin.72972.log.gz 2024-09-17T05:55:01.386 INFO:teuthology.orchestra.run.smithi150.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.84042.log 2024-09-17T05:55:01.386 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.50178.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.50178.log.gz 2024-09-17T05:55:01.386 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.75440.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66605.log 2024-09-17T05:55:01.386 INFO:teuthology.orchestra.run.smithi150.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.75440.log.gz 2024-09-17T05:55:01.386 INFO:teuthology.orchestra.run.smithi150.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71503.log 2024-09-17T05:55:01.386 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.84042.log: /var/log/ceph/ceph-client.admin.66605.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48337.log 2024-09-17T05:55:01.386 INFO:teuthology.orchestra.run.smithi150.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.84042.log.gz 2024-09-17T05:55:01.386 INFO:teuthology.orchestra.run.smithi150.stderr: 86.6% -- replaced with /var/log/ceph/ceph-client.admin.66605.log.gz 2024-09-17T05:55:01.386 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.71503.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60051.log 2024-09-17T05:55:01.386 INFO:teuthology.orchestra.run.smithi150.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.71503.log.gz 2024-09-17T05:55:01.386 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.48337.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48127.log 2024-09-17T05:55:01.386 INFO:teuthology.orchestra.run.smithi150.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.48337.log.gz 2024-09-17T05:55:01.386 INFO:teuthology.orchestra.run.smithi150.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.77022.log 2024-09-17T05:55:01.386 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.60051.log: /var/log/ceph/ceph-client.admin.48127.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.60051.log.gz 2024-09-17T05:55:01.386 INFO:teuthology.orchestra.run.smithi150.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69022.log 2024-09-17T05:55:01.387 INFO:teuthology.orchestra.run.smithi150.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.48127.log.gz 2024-09-17T05:55:01.387 INFO:teuthology.orchestra.run.smithi150.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71587.log 2024-09-17T05:55:01.387 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.77022.log: /var/log/ceph/ceph-client.admin.69022.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.77022.log.gz 2024-09-17T05:55:01.387 INFO:teuthology.orchestra.run.smithi150.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60528.log 2024-09-17T05:55:01.387 INFO:teuthology.orchestra.run.smithi150.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.69022.log.gz 2024-09-17T05:55:01.387 INFO:teuthology.orchestra.run.smithi150.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56150.log 2024-09-17T05:55:01.387 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.71587.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.71587.log.gz 2024-09-17T05:55:01.387 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.60528.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72152.log 2024-09-17T05:55:01.387 INFO:teuthology.orchestra.run.smithi150.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.60528.log.gz 2024-09-17T05:55:01.387 INFO:teuthology.orchestra.run.smithi150.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44194.log 2024-09-17T05:55:01.387 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.56150.log: /var/log/ceph/ceph-client.admin.72152.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.2.45955.log 2024-09-17T05:55:01.387 INFO:teuthology.orchestra.run.smithi150.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.72152.log.gz 2024-09-17T05:55:01.387 INFO:teuthology.orchestra.run.smithi150.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.56150.log.gz 2024-09-17T05:55:01.387 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.44194.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.81377.log 2024-09-17T05:55:01.387 INFO:teuthology.orchestra.run.smithi150.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.44194.log.gz 2024-09-17T05:55:01.388 INFO:teuthology.orchestra.run.smithi150.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.a.log 2024-09-17T05:55:01.388 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.2.45955.log: 0.0% -- replaced with /var/log/ceph/ceph-client.2.45955.log.gz 2024-09-17T05:55:01.388 INFO:teuthology.orchestra.run.smithi150.stderr:gzip -5 --verbose --/var/log/ceph/ceph-client.admin.81377.log: /var/log/ceph/ceph-client.admin.57745.log 2024-09-17T05:55:01.388 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-mds.a.log: 86.4% -- replaced with /var/log/ceph/ceph-client.admin.81377.log.gz 2024-09-17T05:55:01.388 INFO:teuthology.orchestra.run.smithi150.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59010.log 2024-09-17T05:55:01.388 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.57745.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49051.log 2024-09-17T05:55:01.388 INFO:teuthology.orchestra.run.smithi150.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.57745.log.gz 2024-09-17T05:55:01.388 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.59010.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49009.log 2024-09-17T05:55:01.388 INFO:teuthology.orchestra.run.smithi150.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.59010.log.gz 2024-09-17T05:55:01.388 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.49051.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.83047.log 2024-09-17T05:55:01.388 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.49009.log: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.49051.log.gz 2024-09-17T05:55:01.388 INFO:teuthology.orchestra.run.smithi150.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57475.log 2024-09-17T05:55:01.388 INFO:teuthology.orchestra.run.smithi150.stderr: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.49009.log.gz 2024-09-17T05:55:01.388 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.83047.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61395.log 2024-09-17T05:55:01.389 INFO:teuthology.orchestra.run.smithi150.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.83047.log.gz 2024-09-17T05:55:01.389 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.57475.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67759.log 2024-09-17T05:55:01.389 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.61395.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.57475.log.gz 2024-09-17T05:55:01.389 INFO:teuthology.orchestra.run.smithi150.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.78030.log 2024-09-17T05:55:01.389 INFO:teuthology.orchestra.run.smithi150.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.61395.log.gz 2024-09-17T05:55:01.389 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.67759.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72026.log 2024-09-17T05:55:01.389 INFO:teuthology.orchestra.run.smithi150.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.67759.log.gz 2024-09-17T05:55:01.389 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.78030.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70638.log 2024-09-17T05:55:01.389 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.72026.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.78030.log.gz 2024-09-17T05:55:01.389 INFO:teuthology.orchestra.run.smithi150.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50052.log 2024-09-17T05:55:01.389 INFO:teuthology.orchestra.run.smithi150.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.72026.log.gz 2024-09-17T05:55:01.389 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.70638.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48211.log 2024-09-17T05:55:01.389 INFO:teuthology.orchestra.run.smithi150.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.70638.log.gz 2024-09-17T05:55:01.389 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.50052.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74729.log 2024-09-17T05:55:01.390 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.48211.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54579.log 2024-09-17T05:55:01.390 INFO:teuthology.orchestra.run.smithi150.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.50052.log.gz 2024-09-17T05:55:01.390 INFO:teuthology.orchestra.run.smithi150.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.48211.log.gz 2024-09-17T05:55:01.390 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.74729.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.81941.log 2024-09-17T05:55:01.390 INFO:teuthology.orchestra.run.smithi150.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.74729.log.gz 2024-09-17T05:55:01.390 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.54579.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49858.log 2024-09-17T05:55:01.390 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.81941.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.54579.log.gz 2024-09-17T05:55:01.390 INFO:teuthology.orchestra.run.smithi150.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74190.log 2024-09-17T05:55:01.390 INFO:teuthology.orchestra.run.smithi150.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.81941.log.gz 2024-09-17T05:55:01.390 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.49858.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70413.log 2024-09-17T05:55:01.390 INFO:teuthology.orchestra.run.smithi150.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.49858.log.gz 2024-09-17T05:55:01.390 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.74190.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73140.log 2024-09-17T05:55:01.390 INFO:teuthology.orchestra.run.smithi150.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.74190.log.gz 2024-09-17T05:55:01.390 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.70413.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.79890.log 2024-09-17T05:55:01.390 INFO:teuthology.orchestra.run.smithi150.stderr: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.70413.log.gz 2024-09-17T05:55:01.391 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.73140.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47222.log 2024-09-17T05:55:01.391 INFO:teuthology.orchestra.run.smithi150.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.73140.log.gz 2024-09-17T05:55:01.391 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.79890.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66731.log 2024-09-17T05:55:01.391 INFO:teuthology.orchestra.run.smithi150.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.79890.log.gz 2024-09-17T05:55:01.391 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.47222.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63790.log 2024-09-17T05:55:01.391 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.66731.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.47222.log.gz 2024-09-17T05:55:01.391 INFO:teuthology.orchestra.run.smithi150.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73224.log 2024-09-17T05:55:01.391 INFO:teuthology.orchestra.run.smithi150.stderr: 86.5% -- replaced with /var/log/ceph/ceph-client.admin.66731.log.gz 2024-09-17T05:55:01.391 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.63790.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67999.log 2024-09-17T05:55:01.391 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.73224.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48529.log 2024-09-17T05:55:01.391 INFO:teuthology.orchestra.run.smithi150.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.73224.log.gz 2024-09-17T05:55:01.391 INFO:teuthology.orchestra.run.smithi150.stderr:gzip/var/log/ceph/ceph-client.admin.67999.log: -5 91.2% -- replaced with /var/log/ceph/ceph-client.admin.63790.log.gz 2024-09-17T05:55:01.391 INFO:teuthology.orchestra.run.smithi150.stderr: --verbose -- /var/log/ceph/ceph-client.admin.47467.log 2024-09-17T05:55:01.391 INFO:teuthology.orchestra.run.smithi150.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.67999.log.gz 2024-09-17T05:55:01.391 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.48529.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51178.log 2024-09-17T05:55:01.392 INFO:teuthology.orchestra.run.smithi150.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.48529.log.gz 2024-09-17T05:55:01.392 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.47467.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36835.log 2024-09-17T05:55:01.392 INFO:teuthology.orchestra.run.smithi150.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.47467.log.gz 2024-09-17T05:55:01.392 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.51178.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71085.log 2024-09-17T05:55:01.392 INFO:teuthology.orchestra.run.smithi150.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.51178.log.gz 2024-09-17T05:55:01.392 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.36835.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44940.log 2024-09-17T05:55:01.392 INFO:teuthology.orchestra.run.smithi150.stderr: 78.0% -- replaced with /var/log/ceph/ceph-client.admin.36835.log.gz 2024-09-17T05:55:01.392 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.71085.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74484.log 2024-09-17T05:55:01.392 INFO:teuthology.orchestra.run.smithi150.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.71085.log.gz 2024-09-17T05:55:01.392 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.44940.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46635.log 2024-09-17T05:55:01.392 INFO:teuthology.orchestra.run.smithi150.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.44940.log.gz 2024-09-17T05:55:01.392 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.74484.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54078.log 2024-09-17T05:55:01.393 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.46635.log: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.74484.log.gz 2024-09-17T05:55:01.393 INFO:teuthology.orchestra.run.smithi150.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67067.log 2024-09-17T05:55:01.393 INFO:teuthology.orchestra.run.smithi150.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.46635.log.gz 2024-09-17T05:55:01.393 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.54078.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.76434.log 2024-09-17T05:55:01.393 INFO:teuthology.orchestra.run.smithi150.stderr: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.54078.log.gz 2024-09-17T05:55:01.393 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.67067.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50511.log 2024-09-17T05:55:01.393 INFO:teuthology.orchestra.run.smithi150.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.67067.log.gz 2024-09-17T05:55:01.393 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.76434.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.82109.log 2024-09-17T05:55:01.393 INFO:teuthology.orchestra.run.smithi150.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.76434.log.gz 2024-09-17T05:55:01.393 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.50511.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64756.log 2024-09-17T05:55:01.393 INFO:teuthology.orchestra.run.smithi150.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.50511.log.gz 2024-09-17T05:55:01.393 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.82109.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72534.log 2024-09-17T05:55:01.393 INFO:teuthology.orchestra.run.smithi150.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.82109.log.gz 2024-09-17T05:55:01.393 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.64756.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67675.log 2024-09-17T05:55:01.394 INFO:teuthology.orchestra.run.smithi150.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.64756.log.gz 2024-09-17T05:55:01.394 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.72534.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62906.log 2024-09-17T05:55:01.394 INFO:teuthology.orchestra.run.smithi150.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.72534.log.gz 2024-09-17T05:55:01.394 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.67675.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61353.log 2024-09-17T05:55:01.394 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.62906.log: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.67675.log.gz 2024-09-17T05:55:01.394 INFO:teuthology.orchestra.run.smithi150.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58060.log 2024-09-17T05:55:01.394 INFO:teuthology.orchestra.run.smithi150.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.62906.log.gz 2024-09-17T05:55:01.394 INFO:teuthology.orchestra.run.smithi150.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44197.log 2024-09-17T05:55:01.394 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.61353.log: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.61353.log.gz/var/log/ceph/ceph-client.admin.58060.log: 2024-09-17T05:55:01.394 INFO:teuthology.orchestra.run.smithi150.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.78860.log 2024-09-17T05:55:01.394 INFO:teuthology.orchestra.run.smithi150.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.58060.log.gz 2024-09-17T05:55:01.394 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.44197.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53742.log 2024-09-17T05:55:01.394 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.78860.log: gzip 87.5% -5 -- replaced with /var/log/ceph/ceph-client.admin.44197.log.gz --verbose 2024-09-17T05:55:01.394 INFO:teuthology.orchestra.run.smithi150.stderr: -- /var/log/ceph/ceph-client.admin.74358.log 2024-09-17T05:55:01.395 INFO:teuthology.orchestra.run.smithi150.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.78860.log.gz 2024-09-17T05:55:01.395 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.53742.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72804.log 2024-09-17T05:55:01.395 INFO:teuthology.orchestra.run.smithi150.stderr: 86.7% -- replaced with /var/log/ceph/ceph-client.admin.53742.log.gz 2024-09-17T05:55:01.395 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.74358.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61227.log 2024-09-17T05:55:01.395 INFO:teuthology.orchestra.run.smithi150.stderr: 86.5% -- replaced with /var/log/ceph/ceph-client.admin.74358.log.gz 2024-09-17T05:55:01.395 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.72804.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45162.log 2024-09-17T05:55:01.395 INFO:teuthology.orchestra.run.smithi150.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.72804.log.gz 2024-09-17T05:55:01.395 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.61227.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.80016.log 2024-09-17T05:55:01.395 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.45162.log: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.61227.log.gz 2024-09-17T05:55:01.395 INFO:teuthology.orchestra.run.smithi150.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69585.log 2024-09-17T05:55:01.395 INFO:teuthology.orchestra.run.smithi150.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.45162.log.gz 2024-09-17T05:55:01.395 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.80016.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68219.log 2024-09-17T05:55:01.395 INFO:teuthology.orchestra.run.smithi150.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.80016.log.gz 2024-09-17T05:55:01.395 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.69585.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44532.log 2024-09-17T05:55:01.395 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.68219.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.69585.log.gz 2024-09-17T05:55:01.395 INFO:teuthology.orchestra.run.smithi150.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63071.log 2024-09-17T05:55:01.396 INFO:teuthology.orchestra.run.smithi150.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.68219.log.gz 2024-09-17T05:55:01.396 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.44532.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50220.log 2024-09-17T05:55:01.396 INFO:teuthology.orchestra.run.smithi150.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.44532.log.gz 2024-09-17T05:55:01.396 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.63071.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59463.log 2024-09-17T05:55:01.396 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.50220.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.63071.log.gz 2024-09-17T05:55:01.396 INFO:teuthology.orchestra.run.smithi150.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.2.45959.log 2024-09-17T05:55:01.396 INFO:teuthology.orchestra.run.smithi150.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.50220.log.gz 2024-09-17T05:55:01.396 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.59463.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50908.log 2024-09-17T05:55:01.396 INFO:teuthology.orchestra.run.smithi150.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.59463.log.gz 2024-09-17T05:55:01.396 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.2.45959.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65134.log 2024-09-17T05:55:01.396 INFO:teuthology.orchestra.run.smithi150.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.2.45959.log.gz 2024-09-17T05:55:01.396 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.50908.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.80226.log 2024-09-17T05:55:01.396 INFO:teuthology.orchestra.run.smithi150.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.50908.log.gz 2024-09-17T05:55:01.396 INFO:teuthology.orchestra.run.smithi150.stderr:gzip -5/var/log/ceph/ceph-client.admin.65134.log: --verbose -- /var/log/ceph/ceph-client.admin.58881.log 2024-09-17T05:55:01.397 INFO:teuthology.orchestra.run.smithi150.stderr: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.65134.log.gz 2024-09-17T05:55:01.397 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.80226.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66438.log 2024-09-17T05:55:01.397 INFO:teuthology.orchestra.run.smithi150.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.80226.log.gz 2024-09-17T05:55:01.397 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.58881.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53448.log 2024-09-17T05:55:01.397 INFO:teuthology.orchestra.run.smithi150.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.58881.log.gz 2024-09-17T05:55:01.397 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.66438.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74526.log 2024-09-17T05:55:01.397 INFO:teuthology.orchestra.run.smithi150.stderr: 84.0% -- replaced with /var/log/ceph/ceph-client.admin.66438.log.gz 2024-09-17T05:55:01.397 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.53448.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51560.log 2024-09-17T05:55:01.397 INFO:teuthology.orchestra.run.smithi150.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.53448.log.gz 2024-09-17T05:55:01.397 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.74526.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69867.log 2024-09-17T05:55:01.397 INFO:teuthology.orchestra.run.smithi150.stderr: 86.8% -- replaced with /var/log/ceph/ceph-client.admin.74526.log.gz 2024-09-17T05:55:01.397 INFO:teuthology.orchestra.run.smithi150.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61521.log 2024-09-17T05:55:01.397 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.51560.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.51560.log.gz 2024-09-17T05:55:01.397 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.69867.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54453.log 2024-09-17T05:55:01.398 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.61521.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75482.log 2024-09-17T05:55:01.398 INFO:teuthology.orchestra.run.smithi150.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.61521.log.gz 2024-09-17T05:55:01.398 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.54453.log: 91.1%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51518.log 2024-09-17T05:55:01.398 INFO:teuthology.orchestra.run.smithi150.stderr: -- replaced with /var/log/ceph/ceph-client.admin.69867.log.gz 2024-09-17T05:55:01.398 INFO:teuthology.orchestra.run.smithi150.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.54453.log.gz 2024-09-17T05:55:01.398 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.75482.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51784.log 2024-09-17T05:55:01.398 INFO:teuthology.orchestra.run.smithi150.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64420.log 2024-09-17T05:55:01.398 INFO:teuthology.orchestra.run.smithi150.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.75482.log.gz 2024-09-17T05:55:01.398 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.51518.log: /var/log/ceph/ceph-client.admin.51784.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50010.log 2024-09-17T05:55:01.398 INFO:teuthology.orchestra.run.smithi150.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.51518.log.gz 2024-09-17T05:55:01.398 INFO:teuthology.orchestra.run.smithi150.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.51784.log.gz 2024-09-17T05:55:01.398 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.64420.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59319.log 2024-09-17T05:55:01.398 INFO:teuthology.orchestra.run.smithi150.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.64420.log.gz 2024-09-17T05:55:01.399 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.50010.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67717.log 2024-09-17T05:55:01.399 INFO:teuthology.orchestra.run.smithi150.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.50010.log.gz 2024-09-17T05:55:01.399 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.59319.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55173.log 2024-09-17T05:55:01.399 INFO:teuthology.orchestra.run.smithi150.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.59319.log.gz 2024-09-17T05:55:01.399 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.67717.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74586.log 2024-09-17T05:55:01.399 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.55173.log: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.67717.log.gz 2024-09-17T05:55:01.399 INFO:teuthology.orchestra.run.smithi150.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.79333.log 2024-09-17T05:55:01.399 INFO:teuthology.orchestra.run.smithi150.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.55173.log.gz 2024-09-17T05:55:01.399 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.74586.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64966.log 2024-09-17T05:55:01.399 INFO:teuthology.orchestra.run.smithi150.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.74586.log.gz 2024-09-17T05:55:01.399 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.79333.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68471.log 2024-09-17T05:55:01.399 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.64966.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.79333.log.gz 2024-09-17T05:55:01.399 INFO:teuthology.orchestra.run.smithi150.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61605.log 2024-09-17T05:55:01.399 INFO:teuthology.orchestra.run.smithi150.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.64966.log.gz 2024-09-17T05:55:01.399 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.68471.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59235.log 2024-09-17T05:55:01.400 INFO:teuthology.orchestra.run.smithi150.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.68471.log.gz 2024-09-17T05:55:01.400 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.61605.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.a.log 2024-09-17T05:55:01.400 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.59235.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.61605.log.gz 2024-09-17T05:55:01.400 INFO:teuthology.orchestra.run.smithi150.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44181.log 2024-09-17T05:55:01.400 INFO:teuthology.orchestra.run.smithi150.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.59235.log.gz 2024-09-17T05:55:01.400 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-mon.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68681.log 2024-09-17T05:55:01.400 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.44181.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60849.log 2024-09-17T05:55:01.400 INFO:teuthology.orchestra.run.smithi150.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.44181.log.gz 2024-09-17T05:55:01.400 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.68681.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53700.log 2024-09-17T05:55:01.400 INFO:teuthology.orchestra.run.smithi150.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.68681.log.gz 2024-09-17T05:55:01.400 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.60849.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59631.log 2024-09-17T05:55:01.400 INFO:teuthology.orchestra.run.smithi150.stderr: 86.6% -- replaced with /var/log/ceph/ceph-client.admin.60849.log.gz 2024-09-17T05:55:01.400 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.53700.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.82774.log 2024-09-17T05:55:01.400 INFO:teuthology.orchestra.run.smithi150.stderr: 86.8% -- replaced with /var/log/ceph/ceph-client.admin.53700.log.gz 2024-09-17T05:55:01.401 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.59631.log: gzip -5 --verbose -- 87.4% -- replaced with /var/log/ceph/ceph-client.admin.59631.log.gz 2024-09-17T05:55:01.401 INFO:teuthology.orchestra.run.smithi150.stderr: /var/log/ceph/ceph-client.admin.71942.log 2024-09-17T05:55:01.401 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.82774.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37311.log 2024-09-17T05:55:01.401 INFO:teuthology.orchestra.run.smithi150.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.82774.log.gz 2024-09-17T05:55:01.401 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.71942.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47776.log 2024-09-17T05:55:01.401 INFO:teuthology.orchestra.run.smithi150.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.71942.log.gz 2024-09-17T05:55:01.401 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.37311.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.82025.log 2024-09-17T05:55:01.401 INFO:teuthology.orchestra.run.smithi150.stderr: 85.8% -- replaced with /var/log/ceph/ceph-client.admin.37311.log.gz 2024-09-17T05:55:01.401 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.47776.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60705.log 2024-09-17T05:55:01.401 INFO:teuthology.orchestra.run.smithi150.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.47776.log.gz 2024-09-17T05:55:01.401 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.82025.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43134.log 2024-09-17T05:55:01.401 INFO:teuthology.orchestra.run.smithi150.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.82025.log.gz 2024-09-17T05:55:01.401 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.60705.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55730.log 2024-09-17T05:55:01.401 INFO:teuthology.orchestra.run.smithi150.stderr: 86.8% -- replaced with /var/log/ceph/ceph-client.admin.60705.log.gz 2024-09-17T05:55:01.402 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.43134.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71984.log 2024-09-17T05:55:01.402 INFO:teuthology.orchestra.run.smithi150.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.43134.log.gz 2024-09-17T05:55:01.402 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.55730.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60093.log 2024-09-17T05:55:01.402 INFO:teuthology.orchestra.run.smithi150.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.55730.log.gz 2024-09-17T05:55:01.402 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.71984.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52208.log 2024-09-17T05:55:01.402 INFO:teuthology.orchestra.run.smithi150.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.71984.log.gz 2024-09-17T05:55:01.402 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.60093.log: gzip -5 --verbose -- 87.2% /var/log/ceph/ceph-client.admin.62064.log 2024-09-17T05:55:01.402 INFO:teuthology.orchestra.run.smithi150.stderr: -- replaced with /var/log/ceph/ceph-client.admin.60093.log.gz 2024-09-17T05:55:01.402 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.52208.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74645.log 2024-09-17T05:55:01.402 INFO:teuthology.orchestra.run.smithi150.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.52208.log.gz 2024-09-17T05:55:01.402 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.62064.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63244.log 2024-09-17T05:55:01.402 INFO:teuthology.orchestra.run.smithi150.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.62064.log.gz 2024-09-17T05:55:01.402 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.74645.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.56404.log 87.1% 2024-09-17T05:55:01.402 INFO:teuthology.orchestra.run.smithi150.stderr: -- replaced with /var/log/ceph/ceph-client.admin.74645.log.gz 2024-09-17T05:55:01.402 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.63244.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44394.log 2024-09-17T05:55:01.403 INFO:teuthology.orchestra.run.smithi150.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.63244.log.gz 2024-09-17T05:55:01.403 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.0.56404.log: gzip -5 --verbose 0.0% -- /var/log/ceph/ceph-client.admin.65737.log -- replaced with /var/log/ceph/ceph-client.0.56404.log.gz 2024-09-17T05:55:01.403 INFO:teuthology.orchestra.run.smithi150.stderr: 2024-09-17T05:55:01.403 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.44394.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48967.log 2024-09-17T05:55:01.403 INFO:teuthology.orchestra.run.smithi150.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.44394.log.gz 2024-09-17T05:55:01.403 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.65737.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46218.log 2024-09-17T05:55:01.403 INFO:teuthology.orchestra.run.smithi150.stderr: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.65737.log.gz 2024-09-17T05:55:01.403 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.48967.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.81587.log 2024-09-17T05:55:01.403 INFO:teuthology.orchestra.run.smithi150.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.48967.log.gz 2024-09-17T05:55:01.403 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.46218.log: gzip -5 --verbose -- 87.6% -- replaced with /var/log/ceph/ceph-client.admin.46218.log.gz 2024-09-17T05:55:01.403 INFO:teuthology.orchestra.run.smithi150.stderr: /var/log/ceph/ceph-client.admin.60747.log 2024-09-17T05:55:01.403 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.81587.log: gzip -5 --verbose -- 86.5% -- replaced with /var/log/ceph/ceph-client.admin.81587.log.gz 2024-09-17T05:55:01.403 INFO:teuthology.orchestra.run.smithi150.stderr: /var/log/ceph/ceph-client.admin.54275.log 2024-09-17T05:55:01.403 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.60747.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36918.log 86.1% -- replaced with /var/log/ceph/ceph-client.admin.60747.log.gz 2024-09-17T05:55:01.404 INFO:teuthology.orchestra.run.smithi150.stderr: 2024-09-17T05:55:01.404 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.54275.log: gzip -5 --verbose -- 87.5% -- replaced with /var/log/ceph/ceph-client.admin.54275.log.gz 2024-09-17T05:55:01.404 INFO:teuthology.orchestra.run.smithi150.stderr: /var/log/ceph/ceph-client.admin.37309.log 2024-09-17T05:55:01.404 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.36918.log: gzip -5 --verbose -- 86.7% -- replaced with /var/log/ceph/ceph-client.admin.36918.log.gz 2024-09-17T05:55:01.404 INFO:teuthology.orchestra.run.smithi150.stderr: /var/log/ceph/ceph-client.admin.60663.log 2024-09-17T05:55:01.404 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.37309.log: gzip -5 --verbose -- 86.1% -- replaced with /var/log/ceph/ceph-client.admin.37309.log.gz 2024-09-17T05:55:01.404 INFO:teuthology.orchestra.run.smithi150.stderr: /var/log/ceph/ceph-client.admin.83089.log 2024-09-17T05:55:01.404 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.60663.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.81000.log 87.0% -- replaced with /var/log/ceph/ceph-client.admin.60663.log.gz 2024-09-17T05:55:01.404 INFO:teuthology.orchestra.run.smithi150.stderr: 2024-09-17T05:55:01.404 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.83089.log: gzip -5 --verbose -- 87.7% -- replaced with /var/log/ceph/ceph-client.admin.83089.log.gz 2024-09-17T05:55:01.404 INFO:teuthology.orchestra.run.smithi150.stderr: /var/log/ceph/ceph-client.admin.50721.log 2024-09-17T05:55:01.404 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.81000.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53784.log 87.2% -- replaced with /var/log/ceph/ceph-client.admin.81000.log.gz 2024-09-17T05:55:01.404 INFO:teuthology.orchestra.run.smithi150.stderr: 2024-09-17T05:55:01.404 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.50721.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54180.log 2024-09-17T05:55:01.404 INFO:teuthology.orchestra.run.smithi150.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.50721.log.gz 2024-09-17T05:55:01.405 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.53784.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62987.log 87.4% -- replaced with /var/log/ceph/ceph-client.admin.53784.log.gz 2024-09-17T05:55:01.405 INFO:teuthology.orchestra.run.smithi150.stderr: 2024-09-17T05:55:01.405 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.54180.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44191.log 87.5% -- replaced with /var/log/ceph/ceph-client.admin.54180.log.gz 2024-09-17T05:55:01.405 INFO:teuthology.orchestra.run.smithi150.stderr: 2024-09-17T05:55:01.405 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.62987.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.77904.log 87.7% -- replaced with /var/log/ceph/ceph-client.admin.62987.log.gz 2024-09-17T05:55:01.405 INFO:teuthology.orchestra.run.smithi150.stderr: 2024-09-17T05:55:01.405 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.44191.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53952.log 2024-09-17T05:55:01.405 INFO:teuthology.orchestra.run.smithi150.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.44191.log.gz 2024-09-17T05:55:01.405 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.77904.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.78377.log 2024-09-17T05:55:01.405 INFO:teuthology.orchestra.run.smithi150.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.77904.log.gz 2024-09-17T05:55:01.405 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.53952.log: gzip -5 --verbose -- 87.2% -- replaced with /var/log/ceph/ceph-client.admin.53952.log.gz 2024-09-17T05:55:01.405 INFO:teuthology.orchestra.run.smithi150.stderr: /var/log/ceph/ceph-client.admin.53406.log 2024-09-17T05:55:01.405 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.78377.log: gzip -5 --verbose -- 87.4% /var/log/ceph/ceph-client.admin.52250.log 2024-09-17T05:55:01.405 INFO:teuthology.orchestra.run.smithi150.stderr: -- replaced with /var/log/ceph/ceph-client.admin.78377.log.gz 2024-09-17T05:55:01.405 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.53406.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.80646.log 2024-09-17T05:55:01.406 INFO:teuthology.orchestra.run.smithi150.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.53406.log.gz 2024-09-17T05:55:01.406 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.52250.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58415.log 2024-09-17T05:55:01.406 INFO:teuthology.orchestra.run.smithi150.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.52250.log.gz 2024-09-17T05:55:01.406 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.80646.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51315.log 2024-09-17T05:55:01.406 INFO:teuthology.orchestra.run.smithi150.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.80646.log.gz 2024-09-17T05:55:01.406 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.58415.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74897.log 86.9% -- replaced with /var/log/ceph/ceph-client.admin.58415.log.gz 2024-09-17T05:55:01.406 INFO:teuthology.orchestra.run.smithi150.stderr: 2024-09-17T05:55:01.406 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.51315.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46802.log 87.6% -- replaced with /var/log/ceph/ceph-client.admin.51315.log.gz 2024-09-17T05:55:01.406 INFO:teuthology.orchestra.run.smithi150.stderr: 2024-09-17T05:55:01.406 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.74897.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47913.log 87.1% -- replaced with /var/log/ceph/ceph-client.admin.74897.log.gz 2024-09-17T05:55:01.406 INFO:teuthology.orchestra.run.smithi150.stderr: 2024-09-17T05:55:01.406 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.46802.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66857.log 87.8% -- replaced with /var/log/ceph/ceph-client.admin.46802.log.gz 2024-09-17T05:55:01.406 INFO:teuthology.orchestra.run.smithi150.stderr: 2024-09-17T05:55:01.406 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.47913.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46176.log 2024-09-17T05:55:01.406 INFO:teuthology.orchestra.run.smithi150.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.47913.log.gz 2024-09-17T05:55:01.407 INFO:teuthology.orchestra.run.smithi150.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52166.log 2024-09-17T05:55:01.407 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.66857.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.76518.log 2024-09-17T05:55:01.407 INFO:teuthology.orchestra.run.smithi150.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.66857.log.gz 2024-09-17T05:55:01.407 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.46176.log: gzip -5/var/log/ceph/ceph-client.admin.52166.log: --verbose -- /var/log/ceph/ceph-client.admin.56654.log 87.6% -- replaced with /var/log/ceph/ceph-client.admin.46176.log.gz 2024-09-17T05:55:01.407 INFO:teuthology.orchestra.run.smithi150.stderr: 2024-09-17T05:55:01.407 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.76518.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.52166.log.gz 2024-09-17T05:55:01.407 INFO:teuthology.orchestra.run.smithi150.stderr:gzip -5 --verbose -- 87.7% /var/log/ceph/ceph-client.admin.37300.log 2024-09-17T05:55:01.407 INFO:teuthology.orchestra.run.smithi150.stderr: -- replaced with /var/log/ceph/ceph-client.admin.76518.log.gz 2024-09-17T05:55:01.407 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.56654.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73266.log 2024-09-17T05:55:01.407 INFO:teuthology.orchestra.run.smithi150.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.56654.log.gz 2024-09-17T05:55:01.407 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.37300.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43512.log 2024-09-17T05:55:01.407 INFO:teuthology.orchestra.run.smithi150.stderr: 85.9% -- replaced with /var/log/ceph/ceph-client.admin.37300.log.gz 2024-09-17T05:55:01.407 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.73266.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61563.log 2024-09-17T05:55:01.407 INFO:teuthology.orchestra.run.smithi150.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63622.log 2024-09-17T05:55:01.407 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.43512.log: 91.1%gzip -5/var/log/ceph/ceph-client.admin.61563.log: --verbose -- /var/log/ceph/ceph-client.admin.55463.log 2024-09-17T05:55:01.408 INFO:teuthology.orchestra.run.smithi150.stderr: -- replaced with /var/log/ceph/ceph-client.admin.73266.log.gz 2024-09-17T05:55:01.408 INFO:teuthology.orchestra.run.smithi150.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.43512.log.gz 2024-09-17T05:55:01.408 INFO:teuthology.orchestra.run.smithi150.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.61563.log.gz 2024-09-17T05:55:01.408 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.63622.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.2.log 2024-09-17T05:55:01.408 INFO:teuthology.orchestra.run.smithi150.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.63622.log.gz 2024-09-17T05:55:01.408 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.55463.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57643.log 2024-09-17T05:55:01.408 INFO:teuthology.orchestra.run.smithi150.stderr: 87.5%/var/log/ceph/ceph-osd.2.log: -- replaced with /var/log/ceph/ceph-client.admin.55463.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59054.log 2024-09-17T05:55:01.408 INFO:teuthology.orchestra.run.smithi150.stderr: 2024-09-17T05:55:01.408 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.57643.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48169.log 2024-09-17T05:55:01.408 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.59054.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61059.log 2024-09-17T05:55:01.408 INFO:teuthology.orchestra.run.smithi150.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.57643.log.gz 2024-09-17T05:55:01.408 INFO:teuthology.orchestra.run.smithi150.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.77544.log 2024-09-17T05:55:01.408 INFO:teuthology.orchestra.run.smithi150.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.59054.log.gz 2024-09-17T05:55:01.408 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.48169.log: /var/log/ceph/ceph-client.admin.61059.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.48169.log.gz 2024-09-17T05:55:01.409 INFO:teuthology.orchestra.run.smithi150.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.61059.log.gz 2024-09-17T05:55:01.409 INFO:teuthology.orchestra.run.smithi150.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47096.log 2024-09-17T05:55:01.409 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.77544.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61773.log 2024-09-17T05:55:01.409 INFO:teuthology.orchestra.run.smithi150.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.77544.log.gz/var/log/ceph/ceph-client.admin.47096.log: 2024-09-17T05:55:01.409 INFO:teuthology.orchestra.run.smithi150.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59277.log 2024-09-17T05:55:01.409 INFO:teuthology.orchestra.run.smithi150.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.47096.log.gz 2024-09-17T05:55:01.409 INFO:teuthology.orchestra.run.smithi150.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.80856.log 2024-09-17T05:55:01.409 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.61773.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.78692.log 2024-09-17T05:55:01.409 INFO:teuthology.orchestra.run.smithi150.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.61773.log.gz 2024-09-17T05:55:01.409 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.59277.log: gzip/var/log/ceph/ceph-client.admin.80856.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.79667.log 2024-09-17T05:55:01.409 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.78692.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.80856.log.gz 2024-09-17T05:55:01.409 INFO:teuthology.orchestra.run.smithi150.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.59277.log.gz 2024-09-17T05:55:01.409 INFO:teuthology.orchestra.run.smithi150.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.78692.log.gz 2024-09-17T05:55:01.410 INFO:teuthology.orchestra.run.smithi150.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.84211.log 2024-09-17T05:55:01.410 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.79667.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74400.log 87.0% -- replaced with /var/log/ceph/ceph-client.admin.79667.log.gz 2024-09-17T05:55:01.410 INFO:teuthology.orchestra.run.smithi150.stderr: 2024-09-17T05:55:01.410 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.84211.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55036.log 87.0% 2024-09-17T05:55:01.410 INFO:teuthology.orchestra.run.smithi150.stderr: -- replaced with /var/log/ceph/ceph-client.admin.84211.log.gz 2024-09-17T05:55:01.410 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.74400.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43680.log 2024-09-17T05:55:01.410 INFO:teuthology.orchestra.run.smithi150.stderr: 86.6% -- replaced with /var/log/ceph/ceph-client.admin.74400.log.gz 2024-09-17T05:55:01.410 INFO:teuthology.orchestra.run.smithi150.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50950.log 2024-09-17T05:55:01.410 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.55036.log: /var/log/ceph/ceph-client.admin.43680.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74771.log 2024-09-17T05:55:01.410 INFO:teuthology.orchestra.run.smithi150.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.55036.log.gz 2024-09-17T05:55:01.410 INFO:teuthology.orchestra.run.smithi150.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.43680.log.gz 2024-09-17T05:55:01.410 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.50950.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43858.log 2024-09-17T05:55:01.410 INFO:teuthology.orchestra.run.smithi150.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.50950.log.gz 2024-09-17T05:55:01.410 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.74771.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48883.log 2024-09-17T05:55:01.410 INFO:teuthology.orchestra.run.smithi150.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.74771.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70371.log 2024-09-17T05:55:01.411 INFO:teuthology.orchestra.run.smithi150.stderr: 2024-09-17T05:55:01.411 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.43858.log: /var/log/ceph/ceph-client.admin.48883.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67151.log 2024-09-17T05:55:01.411 INFO:teuthology.orchestra.run.smithi150.stderr: 87.6% 87.6% -- replaced with /var/log/ceph/ceph-client.admin.48883.log.gz 2024-09-17T05:55:01.411 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.70371.log: -- replaced with /var/log/ceph/ceph-client.admin.43858.log.gz 2024-09-17T05:55:01.411 INFO:teuthology.orchestra.run.smithi150.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.70371.log.gz 2024-09-17T05:55:01.411 INFO:teuthology.orchestra.run.smithi150.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.79238.log 2024-09-17T05:55:01.411 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.67151.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66689.log 2024-09-17T05:55:01.411 INFO:teuthology.orchestra.run.smithi150.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.67151.log.gz 2024-09-17T05:55:01.411 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.79238.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42878.log 2024-09-17T05:55:01.411 INFO:teuthology.orchestra.run.smithi150.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.79238.log.gz 2024-09-17T05:55:01.411 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.66689.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68177.log 2024-09-17T05:55:01.411 INFO:teuthology.orchestra.run.smithi150.stderr: 86.4% -- replaced with /var/log/ceph/ceph-client.admin.66689.log.gz 2024-09-17T05:55:01.411 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.42878.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58144.log 88.0% -- replaced with /var/log/ceph/ceph-client.admin.42878.log.gz 2024-09-17T05:55:01.412 INFO:teuthology.orchestra.run.smithi150.stderr: 2024-09-17T05:55:01.412 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.68177.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73872.log 87.6% -- replaced with /var/log/ceph/ceph-client.admin.68177.log.gz 2024-09-17T05:55:01.412 INFO:teuthology.orchestra.run.smithi150.stderr: 2024-09-17T05:55:01.412 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.58144.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72579.log 87.3% -- replaced with /var/log/ceph/ceph-client.admin.58144.log.gz 2024-09-17T05:55:01.412 INFO:teuthology.orchestra.run.smithi150.stderr: 2024-09-17T05:55:01.412 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.73872.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43344.log 2024-09-17T05:55:01.412 INFO:teuthology.orchestra.run.smithi150.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.73872.log.gz 2024-09-17T05:55:01.412 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.72579.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57934.log 2024-09-17T05:55:01.412 INFO:teuthology.orchestra.run.smithi150.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.72579.log.gz 2024-09-17T05:55:01.412 INFO:teuthology.orchestra.run.smithi150.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.77988.log 2024-09-17T05:55:01.412 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.43344.log: /var/log/ceph/ceph-client.admin.57934.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55253.log 2024-09-17T05:55:01.412 INFO:teuthology.orchestra.run.smithi150.stderr: 87.5%/var/log/ceph/ceph-client.admin.77988.log: -- replaced with /var/log/ceph/ceph-client.admin.43344.log.gz 2024-09-17T05:55:01.412 INFO:teuthology.orchestra.run.smithi150.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.57934.log.gz 2024-09-17T05:55:01.413 INFO:teuthology.orchestra.run.smithi150.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.77988.log.gz 2024-09-17T05:55:01.413 INFO:teuthology.orchestra.run.smithi150.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.81857.log 2024-09-17T05:55:01.413 INFO:teuthology.orchestra.run.smithi150.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mgr.y.log 2024-09-17T05:55:01.413 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.55253.log: /var/log/ceph/ceph-client.admin.81857.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68639.log 2024-09-17T05:55:01.413 INFO:teuthology.orchestra.run.smithi150.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.55253.log.gz 2024-09-17T05:55:01.413 INFO:teuthology.orchestra.run.smithi150.stderr: 86.6% -- replaced with /var/log/ceph/ceph-client.admin.81857.log.gz 2024-09-17T05:55:01.413 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-mgr.y.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65779.log 2024-09-17T05:55:01.413 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.68639.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68387.log 2024-09-17T05:55:01.413 INFO:teuthology.orchestra.run.smithi150.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.68639.log.gz 2024-09-17T05:55:01.413 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.65779.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70941.log 2024-09-17T05:55:01.413 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.68387.log: 86.4% -- replaced with /var/log/ceph/ceph-client.admin.65779.log.gz 2024-09-17T05:55:01.413 INFO:teuthology.orchestra.run.smithi150.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.68387.log.gz 2024-09-17T05:55:01.413 INFO:teuthology.orchestra.run.smithi150.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.81899.log 2024-09-17T05:55:01.414 INFO:teuthology.orchestra.run.smithi150.stderr:gzip -5 --verbose/var/log/ceph/ceph-client.admin.70941.log: -- /var/log/ceph/ceph-client.admin.66563.log 2024-09-17T05:55:01.414 INFO:teuthology.orchestra.run.smithi150.stderr: 86.8% -- replaced with /var/log/ceph/ceph-client.admin.70941.log.gz 2024-09-17T05:55:01.414 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.81899.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57147.log 2024-09-17T05:55:01.414 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.66563.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.81899.log.gz 2024-09-17T05:55:01.414 INFO:teuthology.orchestra.run.smithi150.stderr: 86.4% -- replaced with /var/log/ceph/ceph-client.admin.66563.log.gz 2024-09-17T05:55:01.414 INFO:teuthology.orchestra.run.smithi150.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.83864.log 2024-09-17T05:55:01.414 INFO:teuthology.orchestra.run.smithi150.stderr:gzip -5 --verbose/var/log/ceph/ceph-client.admin.57147.log: -- /var/log/ceph/ceph-client.admin.61101.log 2024-09-17T05:55:01.414 INFO:teuthology.orchestra.run.smithi150.stderr: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.57147.log.gz 2024-09-17T05:55:01.414 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.83864.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.83864.log.gz 2024-09-17T05:55:01.414 INFO:teuthology.orchestra.run.smithi150.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.76308.log 2024-09-17T05:55:01.414 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.61101.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.80100.log 2024-09-17T05:55:01.414 INFO:teuthology.orchestra.run.smithi150.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.61101.log.gz 2024-09-17T05:55:01.414 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.76308.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64252.log 2024-09-17T05:55:01.415 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.80100.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.76308.log.gz 2024-09-17T05:55:01.415 INFO:teuthology.orchestra.run.smithi150.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.80100.log.gz 2024-09-17T05:55:01.415 INFO:teuthology.orchestra.run.smithi150.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.84629.log 2024-09-17T05:55:01.415 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.64252.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52040.log 2024-09-17T05:55:01.415 INFO:teuthology.orchestra.run.smithi150.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.64252.log.gz 2024-09-17T05:55:01.415 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.84629.log: gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-09-17T05:55:01.415 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.52040.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.84629.log.gz 2024-09-17T05:55:01.415 INFO:teuthology.orchestra.run.smithi150.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.52040.log.gz 2024-09-17T05:55:01.415 INFO:teuthology.orchestra.run.smithi150.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65008.log 2024-09-17T05:55:01.415 INFO:teuthology.orchestra.run.smithi150.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64714.log 2024-09-17T05:55:01.415 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph.log: /var/log/ceph/ceph-client.admin.65008.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.65008.log.gz 2024-09-17T05:55:01.415 INFO:teuthology.orchestra.run.smithi150.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60261.log 2024-09-17T05:55:01.415 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.64714.log: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.64714.log.gz 2024-09-17T05:55:01.415 INFO:teuthology.orchestra.run.smithi150.stderr: 94.1% -- replaced with /var/log/ceph/ceph-mgr.y.log.gz 2024-09-17T05:55:01.416 INFO:teuthology.orchestra.run.smithi150.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61647.log 2024-09-17T05:55:01.416 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.60261.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37298.log 2024-09-17T05:55:01.416 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.61647.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.60261.log.gz 2024-09-17T05:55:01.416 INFO:teuthology.orchestra.run.smithi150.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69754.log 2024-09-17T05:55:01.416 INFO:teuthology.orchestra.run.smithi150.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.61647.log.gz 2024-09-17T05:55:01.416 INFO:teuthology.orchestra.run.smithi150.stderr: 85.4% -- replaced with /var/log/ceph/ceph.log.gz 2024-09-17T05:55:01.416 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.37298.log: 85.7% -- replaced with /var/log/ceph/ceph-client.admin.37298.log.gz 2024-09-17T05:55:01.416 INFO:teuthology.orchestra.run.smithi150.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43855.log 2024-09-17T05:55:01.416 INFO:teuthology.orchestra.run.smithi150.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.79413.log 2024-09-17T05:55:01.416 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.69754.log: /var/log/ceph/ceph-client.admin.43855.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54976.log 2024-09-17T05:55:01.416 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.79413.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.69754.log.gz 2024-09-17T05:55:01.416 INFO:teuthology.orchestra.run.smithi150.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.43855.log.gz 2024-09-17T05:55:01.416 INFO:teuthology.orchestra.run.smithi150.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.76956.log 2024-09-17T05:55:01.417 INFO:teuthology.orchestra.run.smithi150.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.79413.log.gz 2024-09-17T05:55:01.417 INFO:teuthology.orchestra.run.smithi150.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.83173.log 2024-09-17T05:55:01.417 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.54976.log: /var/log/ceph/ceph-client.admin.76956.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43218.log 2024-09-17T05:55:01.417 INFO:teuthology.orchestra.run.smithi150.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.54976.log.gz 2024-09-17T05:55:01.417 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.83173.log: gzip -5 90.9% -- replaced with /var/log/ceph/ceph-client.admin.76956.log.gz 2024-09-17T05:55:01.417 INFO:teuthology.orchestra.run.smithi150.stderr: --verbose -- /var/log/ceph/ceph-client.0.52550.log 2024-09-17T05:55:01.417 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.43218.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.83173.log.gz 2024-09-17T05:55:01.417 INFO:teuthology.orchestra.run.smithi150.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.tmp-client.admin.30650.log 2024-09-17T05:55:01.417 INFO:teuthology.orchestra.run.smithi150.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.43218.log.gz 2024-09-17T05:55:01.417 INFO:teuthology.orchestra.run.smithi150.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.78472.log 2024-09-17T05:55:01.417 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.0.52550.log: /var/log/ceph/ceph.tmp-client.admin.30650.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56528.log 2024-09-17T05:55:01.417 INFO:teuthology.orchestra.run.smithi150.stderr: 0.0% 0.0% -- replaced with /var/log/ceph/ceph.tmp-client.admin.30650.log.gz 2024-09-17T05:55:01.417 INFO:teuthology.orchestra.run.smithi150.stderr: -- replaced with /var/log/ceph/ceph-client.0.52550.log.gz 2024-09-17T05:55:01.417 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.78472.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65176.log 2024-09-17T05:55:01.418 INFO:teuthology.orchestra.run.smithi150.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.78472.log.gz 2024-09-17T05:55:01.418 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.56528.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69543.log 2024-09-17T05:55:01.418 INFO:teuthology.orchestra.run.smithi150.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.56528.log.gz 2024-09-17T05:55:01.418 INFO:teuthology.orchestra.run.smithi150.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58018.log 2024-09-17T05:55:01.418 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.65176.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50322.log 2024-09-17T05:55:01.418 INFO:teuthology.orchestra.run.smithi150.stderr: 86.4% -- replaced with /var/log/ceph/ceph-client.admin.65176.log.gz/var/log/ceph/ceph-client.admin.69543.log: 2024-09-17T05:55:01.418 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.58018.log: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.69543.log.gzgzip -5 --verbose -- 87.4% -- replaced with /var/log/ceph/ceph-client.admin.58018.log.gz 2024-09-17T05:55:01.418 INFO:teuthology.orchestra.run.smithi150.stderr: /var/log/ceph/ceph-client.admin.43386.log 2024-09-17T05:55:01.418 INFO:teuthology.orchestra.run.smithi150.stderr: 2024-09-17T05:55:01.418 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.50322.log: gzip -5 --verbose 87.4% -- replaced with /var/log/ceph/ceph-client.admin.50322.log.gz 2024-09-17T05:55:01.418 INFO:teuthology.orchestra.run.smithi150.stderr: -- /var/log/ceph/ceph-client.admin.64798.log 2024-09-17T05:55:01.418 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.43386.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52670.log 87.2% -- replaced with /var/log/ceph/ceph-client.admin.43386.log.gz 2024-09-17T05:55:01.418 INFO:teuthology.orchestra.run.smithi150.stderr: 2024-09-17T05:55:01.418 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.64798.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48379.log 2024-09-17T05:55:01.419 INFO:teuthology.orchestra.run.smithi150.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.64798.log.gz 2024-09-17T05:55:01.419 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.52670.log: gzip -5 --verbose -- 87.7% -- replaced with /var/log/ceph/ceph-client.admin.52670.log.gz 2024-09-17T05:55:01.419 INFO:teuthology.orchestra.run.smithi150.stderr: /var/log/ceph/ceph-client.admin.67109.log 2024-09-17T05:55:01.419 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.48379.log: gzip -5 --verbose -- 87.3% -- replaced with /var/log/ceph/ceph-client.admin.48379.log.gz 2024-09-17T05:55:01.419 INFO:teuthology.orchestra.run.smithi150.stderr: /var/log/ceph/ceph-client.admin.51914.log 2024-09-17T05:55:01.419 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.67109.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58102.log 87.3% -- replaced with /var/log/ceph/ceph-client.admin.67109.log.gz 2024-09-17T05:55:01.419 INFO:teuthology.orchestra.run.smithi150.stderr: 2024-09-17T05:55:01.419 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.51914.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75398.log 87.5% 2024-09-17T05:55:01.419 INFO:teuthology.orchestra.run.smithi150.stderr: -- replaced with /var/log/ceph/ceph-client.admin.51914.log.gz 2024-09-17T05:55:01.419 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.58102.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58331.log 2024-09-17T05:55:01.419 INFO:teuthology.orchestra.run.smithi150.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.58102.log.gz 2024-09-17T05:55:01.419 INFO:teuthology.orchestra.run.smithi150.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55507.log 2024-09-17T05:55:01.419 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.75398.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36779.log 2024-09-17T05:55:01.419 INFO:teuthology.orchestra.run.smithi150.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.75398.log.gz/var/log/ceph/ceph-client.admin.58331.log: 2024-09-17T05:55:01.420 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.55507.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.58331.log.gzgzip -5 87.4% -- replaced with /var/log/ceph/ceph-client.admin.55507.log.gz 2024-09-17T05:55:01.420 INFO:teuthology.orchestra.run.smithi150.stderr: --verbose -- /var/log/ceph/ceph-client.admin.82294.log 2024-09-17T05:55:01.420 INFO:teuthology.orchestra.run.smithi150.stderr: 2024-09-17T05:55:01.420 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.36779.log: 77.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50136.log 2024-09-17T05:55:01.420 INFO:teuthology.orchestra.run.smithi150.stderr: -- replaced with /var/log/ceph/ceph-client.admin.36779.log.gz 2024-09-17T05:55:01.420 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.82294.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.80730.log 2024-09-17T05:55:01.420 INFO:teuthology.orchestra.run.smithi150.stderr: 86.8% -- replaced with /var/log/ceph/ceph-client.admin.82294.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.82252.log 2024-09-17T05:55:01.420 INFO:teuthology.orchestra.run.smithi150.stderr: 2024-09-17T05:55:01.420 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.50136.log: /var/log/ceph/ceph-client.admin.80730.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.45512.log 2024-09-17T05:55:01.420 INFO:teuthology.orchestra.run.smithi150.stderr: 87.1%/var/log/ceph/ceph-client.admin.82252.log: -- replaced with /var/log/ceph/ceph-client.admin.50136.log.gz 2024-09-17T05:55:01.420 INFO:teuthology.orchestra.run.smithi150.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.80730.log.gz 2024-09-17T05:55:01.420 INFO:teuthology.orchestra.run.smithi150.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.82252.log.gz 2024-09-17T05:55:01.420 INFO:teuthology.orchestra.run.smithi150.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51830.log 2024-09-17T05:55:01.421 INFO:teuthology.orchestra.run.smithi150.stderr:gzip -5 --verbose/var/log/ceph/ceph-client.0.45512.log: -- /var/log/ceph/ceph-client.admin.70731.log 2024-09-17T05:55:01.421 INFO:teuthology.orchestra.run.smithi150.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.45512.log.gz 2024-09-17T05:55:01.421 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.51830.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65821.log 87.5% -- replaced with /var/log/ceph/ceph-client.admin.51830.log.gz 2024-09-17T05:55:01.421 INFO:teuthology.orchestra.run.smithi150.stderr: 2024-09-17T05:55:01.421 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.70731.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.77862.log 2024-09-17T05:55:01.421 INFO:teuthology.orchestra.run.smithi150.stderr: 86.8% -- replaced with /var/log/ceph/ceph-client.admin.70731.log.gz 2024-09-17T05:55:01.421 INFO:teuthology.orchestra.run.smithi150.stderr:gzip/var/log/ceph/ceph-client.admin.65821.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.71629.log 2024-09-17T05:55:01.421 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.77862.log: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.65821.log.gz 2024-09-17T05:55:01.421 INFO:teuthology.orchestra.run.smithi150.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56486.log 2024-09-17T05:55:01.421 INFO:teuthology.orchestra.run.smithi150.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.77862.log.gz 2024-09-17T05:55:01.421 INFO:teuthology.orchestra.run.smithi150.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.81983.log 2024-09-17T05:55:01.421 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.71629.log: /var/log/ceph/ceph-client.admin.56486.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54850.log 2024-09-17T05:55:01.421 INFO:teuthology.orchestra.run.smithi150.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.71629.log.gz 2024-09-17T05:55:01.421 INFO:teuthology.orchestra.run.smithi150.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.56486.log.gz 2024-09-17T05:55:01.422 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.81983.log: gzip 87.0% -5 --verbose -- /var/log/ceph/ceph-client.admin.56696.log 2024-09-17T05:55:01.422 INFO:teuthology.orchestra.run.smithi150.stderr: -- replaced with /var/log/ceph/ceph-client.admin.81983.log.gz 2024-09-17T05:55:01.422 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.54850.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43050.log 2024-09-17T05:55:01.422 INFO:teuthology.orchestra.run.smithi150.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.54850.log.gz 2024-09-17T05:55:01.422 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.56696.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.83956.log 2024-09-17T05:55:01.422 INFO:teuthology.orchestra.run.smithi150.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.56696.log.gz 2024-09-17T05:55:01.422 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.43050.log: gzip -5 --verbose -- 87.7% -- replaced with /var/log/ceph/ceph-client.admin.43050.log.gz 2024-09-17T05:55:01.422 INFO:teuthology.orchestra.run.smithi150.stderr: /var/log/ceph/ceph-client.admin.71169.log 2024-09-17T05:55:01.422 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.83956.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63748.log 87.6% -- replaced with /var/log/ceph/ceph-client.admin.83956.log.gz 2024-09-17T05:55:01.422 INFO:teuthology.orchestra.run.smithi150.stderr: 2024-09-17T05:55:01.422 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.71169.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73662.log 2024-09-17T05:55:01.422 INFO:teuthology.orchestra.run.smithi150.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.71169.log.gz 2024-09-17T05:55:01.422 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.63748.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52082.log 2024-09-17T05:55:01.423 INFO:teuthology.orchestra.run.smithi150.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.63748.log.gz 2024-09-17T05:55:01.423 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.73662.log: gzip -5 87.4% -- replaced with /var/log/ceph/ceph-client.admin.73662.log.gz 2024-09-17T05:55:01.423 INFO:teuthology.orchestra.run.smithi150.stderr: --verbose -- /var/log/ceph/ceph-client.admin.55982.log 2024-09-17T05:55:01.423 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.52082.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61833.log 88.1% -- replaced with /var/log/ceph/ceph-client.admin.52082.log.gz 2024-09-17T05:55:01.423 INFO:teuthology.orchestra.run.smithi150.stderr: 2024-09-17T05:55:01.423 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.55982.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.78191.log 2024-09-17T05:55:01.423 INFO:teuthology.orchestra.run.smithi150.stderr: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.55982.log.gz 2024-09-17T05:55:01.423 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.61833.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63116.log 2024-09-17T05:55:01.423 INFO:teuthology.orchestra.run.smithi150.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.61833.log.gz 2024-09-17T05:55:01.423 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.78191.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73830.log 2024-09-17T05:55:01.423 INFO:teuthology.orchestra.run.smithi150.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.78191.log.gz 2024-09-17T05:55:01.423 INFO:teuthology.orchestra.run.smithi150.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.81293.log 2024-09-17T05:55:01.423 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.63116.log: /var/log/ceph/ceph-client.admin.73830.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.82963.log 2024-09-17T05:55:01.424 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.81293.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.63116.log.gz 2024-09-17T05:55:01.424 INFO:teuthology.orchestra.run.smithi150.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.73830.log.gz 2024-09-17T05:55:01.424 INFO:teuthology.orchestra.run.smithi150.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71900.log 2024-09-17T05:55:01.424 INFO:teuthology.orchestra.run.smithi150.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.81293.log.gz 2024-09-17T05:55:01.424 INFO:teuthology.orchestra.run.smithi150.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.79028.log 2024-09-17T05:55:01.424 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.82963.log: /var/log/ceph/ceph-client.admin.71900.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65967.log 2024-09-17T05:55:01.424 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.79028.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.82963.log.gz 2024-09-17T05:55:01.424 INFO:teuthology.orchestra.run.smithi150.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.71900.log.gz 2024-09-17T05:55:01.424 INFO:teuthology.orchestra.run.smithi150.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75356.log 2024-09-17T05:55:01.424 INFO:teuthology.orchestra.run.smithi150.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.79028.log.gz 2024-09-17T05:55:01.424 INFO:teuthology.orchestra.run.smithi150.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68429.log 2024-09-17T05:55:01.424 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.65967.log: /var/log/ceph/ceph-client.admin.75356.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70245.log 2024-09-17T05:55:01.424 INFO:teuthology.orchestra.run.smithi150.stderr: 84.4%/var/log/ceph/ceph-client.admin.68429.log: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.75356.log.gz 2024-09-17T05:55:01.424 INFO:teuthology.orchestra.run.smithi150.stderr: -- replaced with /var/log/ceph/ceph-client.admin.65967.log.gz 2024-09-17T05:55:01.425 INFO:teuthology.orchestra.run.smithi150.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.68429.log.gz 2024-09-17T05:55:01.425 INFO:teuthology.orchestra.run.smithi150.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51094.log 2024-09-17T05:55:01.425 INFO:teuthology.orchestra.run.smithi150.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43008.log 2024-09-17T05:55:01.425 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.70245.log: /var/log/ceph/ceph-client.admin.51094.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56738.log 2024-09-17T05:55:01.425 INFO:teuthology.orchestra.run.smithi150.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.70245.log.gz 2024-09-17T05:55:01.425 INFO:teuthology.orchestra.run.smithi150.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.51094.log.gz/var/log/ceph/ceph-client.admin.43008.log: 2024-09-17T05:55:01.425 INFO:teuthology.orchestra.run.smithi150.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75753.log 2024-09-17T05:55:01.425 INFO:teuthology.orchestra.run.smithi150.stderr: 87.4%/var/log/ceph/ceph-client.admin.56738.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52838.log 2024-09-17T05:55:01.425 INFO:teuthology.orchestra.run.smithi150.stderr: -- replaced with /var/log/ceph/ceph-client.admin.43008.log.gz 2024-09-17T05:55:01.425 INFO:teuthology.orchestra.run.smithi150.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.56738.log.gz 2024-09-17T05:55:01.425 INFO:teuthology.orchestra.run.smithi150.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47510.log 2024-09-17T05:55:01.425 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.75753.log: /var/log/ceph/ceph-client.admin.52838.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55419.log 2024-09-17T05:55:01.425 INFO:teuthology.orchestra.run.smithi150.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.75753.log.gz 2024-09-17T05:55:01.425 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.47510.log: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.52838.log.gz 2024-09-17T05:55:01.426 INFO:teuthology.orchestra.run.smithi150.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46386.log 2024-09-17T05:55:01.426 INFO:teuthology.orchestra.run.smithi150.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.47510.log.gz 2024-09-17T05:55:01.426 INFO:teuthology.orchestra.run.smithi150.stderr:gzip -5 --verbose/var/log/ceph/ceph-client.admin.55419.log: -- /var/log/ceph/ceph-client.admin.46092.log 2024-09-17T05:55:01.426 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.46386.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.55419.log.gz 2024-09-17T05:55:01.426 INFO:teuthology.orchestra.run.smithi150.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58228.log 2024-09-17T05:55:01.426 INFO:teuthology.orchestra.run.smithi150.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.46386.log.gz 2024-09-17T05:55:01.426 INFO:teuthology.orchestra.run.smithi150.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75543.log 2024-09-17T05:55:01.426 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.46092.log: /var/log/ceph/ceph-client.admin.58228.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59715.log 2024-09-17T05:55:01.426 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.75543.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.46092.log.gz 2024-09-17T05:55:01.426 INFO:teuthology.orchestra.run.smithi150.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.58228.log.gz 2024-09-17T05:55:01.426 INFO:teuthology.orchestra.run.smithi150.stderr:gzip 87.1% -- replaced with /var/log/ceph/ceph-client.admin.75543.log.gz -5 2024-09-17T05:55:01.426 INFO:teuthology.orchestra.run.smithi150.stderr: --verbose -- /var/log/ceph/ceph-client.admin.65412.log 2024-09-17T05:55:01.426 INFO:teuthology.orchestra.run.smithi150.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70203.log 2024-09-17T05:55:01.426 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.59715.log: /var/log/ceph/ceph-client.admin.65412.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68261.log 2024-09-17T05:55:01.427 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.70203.log: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.65412.log.gz 2024-09-17T05:55:01.427 INFO:teuthology.orchestra.run.smithi150.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.70203.log.gz 91.0% -- replaced with /var/log/ceph/ceph-client.admin.59715.log.gz 2024-09-17T05:55:01.427 INFO:teuthology.orchestra.run.smithi150.stderr: 2024-09-17T05:55:01.427 INFO:teuthology.orchestra.run.smithi150.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.70125.log 2024-09-17T05:55:01.427 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.68261.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67547.log 2024-09-17T05:55:01.427 INFO:teuthology.orchestra.run.smithi150.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.68261.log.gz 2024-09-17T05:55:01.427 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.0.70125.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.70125.log.gz 2024-09-17T05:55:01.427 INFO:teuthology.orchestra.run.smithi150.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.76135.log 2024-09-17T05:55:01.427 INFO:teuthology.orchestra.run.smithi150.stderr:gzip -5 --verbose/var/log/ceph/ceph-client.admin.67547.log: -- /var/log/ceph/ceph-client.admin.44982.log 2024-09-17T05:55:01.427 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.76135.log: 87.2%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70455.log 2024-09-17T05:55:01.427 INFO:teuthology.orchestra.run.smithi150.stderr: -- replaced with /var/log/ceph/ceph-client.admin.67547.log.gz 2024-09-17T05:55:01.427 INFO:teuthology.orchestra.run.smithi150.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.76135.log.gz 2024-09-17T05:55:01.427 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.44982.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.76476.log 2024-09-17T05:55:01.428 INFO:teuthology.orchestra.run.smithi150.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.44982.log.gz 2024-09-17T05:55:01.428 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.70455.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58373.log 2024-09-17T05:55:01.428 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.76476.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54495.log 2024-09-17T05:55:01.428 INFO:teuthology.orchestra.run.smithi150.stderr: 86.8% -- replaced with /var/log/ceph/ceph-client.admin.70455.log.gz 2024-09-17T05:55:01.428 INFO:teuthology.orchestra.run.smithi150.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.76476.log.gz 2024-09-17T05:55:01.428 INFO:teuthology.orchestra.run.smithi150.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61437.log 2024-09-17T05:55:01.428 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.58373.log: /var/log/ceph/ceph-client.admin.54495.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52880.log 2024-09-17T05:55:01.428 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.61437.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.58373.log.gz 2024-09-17T05:55:01.428 INFO:teuthology.orchestra.run.smithi150.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.54495.log.gz 2024-09-17T05:55:01.428 INFO:teuthology.orchestra.run.smithi150.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.76392.log 2024-09-17T05:55:01.428 INFO:teuthology.orchestra.run.smithi150.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.61437.log.gz 2024-09-17T05:55:01.428 INFO:teuthology.orchestra.run.smithi150.stderr:gzip -5/var/log/ceph/ceph-client.admin.52880.log: --verbose -- /var/log/ceph/ceph-client.admin.76350.log 2024-09-17T05:55:01.428 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.76392.log: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.52880.log.gz 2024-09-17T05:55:01.428 INFO:teuthology.orchestra.run.smithi150.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64210.log 2024-09-17T05:55:01.429 INFO:teuthology.orchestra.run.smithi150.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.76392.log.gz 2024-09-17T05:55:01.429 INFO:teuthology.orchestra.run.smithi150.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37878.log 2024-09-17T05:55:01.429 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.76350.log: /var/log/ceph/ceph-client.admin.64210.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37163.log 2024-09-17T05:55:01.429 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.37878.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.76350.log.gz 2024-09-17T05:55:01.429 INFO:teuthology.orchestra.run.smithi150.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.64210.log.gz 2024-09-17T05:55:01.429 INFO:teuthology.orchestra.run.smithi150.stderr: 86.7% -- replaced with /var/log/ceph/ceph-client.admin.37878.log.gz 2024-09-17T05:55:01.429 INFO:teuthology.orchestra.run.smithi150.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44534.log 2024-09-17T05:55:01.429 INFO:teuthology.orchestra.run.smithi150.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67632.log 2024-09-17T05:55:01.429 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.37163.log: /var/log/ceph/ceph-client.admin.44534.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.80268.log 2024-09-17T05:55:01.429 INFO:teuthology.orchestra.run.smithi150.stderr: 85.9% -- replaced with /var/log/ceph/ceph-client.admin.37163.log.gz 2024-09-17T05:55:01.429 INFO:teuthology.orchestra.run.smithi150.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.44534.log.gz 2024-09-17T05:55:01.429 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.67632.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.76602.log 2024-09-17T05:55:01.429 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.80268.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60303.log 2024-09-17T05:55:01.430 INFO:teuthology.orchestra.run.smithi150.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.67632.log.gz 2024-09-17T05:55:01.430 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.76602.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.80268.log.gz 2024-09-17T05:55:01.430 INFO:teuthology.orchestra.run.smithi150.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.77946.log 2024-09-17T05:55:01.430 INFO:teuthology.orchestra.run.smithi150.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.76602.log.gz 2024-09-17T05:55:01.430 INFO:teuthology.orchestra.run.smithi150.stderr:gzip -5 --verbose/var/log/ceph/ceph-client.admin.60303.log: -- /var/log/ceph/ceph-client.admin.50866.log 2024-09-17T05:55:01.430 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.77946.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.60303.log.gz 2024-09-17T05:55:01.430 INFO:teuthology.orchestra.run.smithi150.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47012.log 2024-09-17T05:55:01.430 INFO:teuthology.orchestra.run.smithi150.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.77946.log.gz 2024-09-17T05:55:01.430 INFO:teuthology.orchestra.run.smithi150.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63496.log 2024-09-17T05:55:01.430 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.50866.log: /var/log/ceph/ceph-client.admin.47012.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.83822.log 2024-09-17T05:55:01.430 INFO:teuthology.orchestra.run.smithi150.stderr: 87.4%/var/log/ceph/ceph-client.admin.63496.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.50866.log.gz -- replaced with /var/log/ceph/ceph-client.admin.47012.log.gz 2024-09-17T05:55:01.430 INFO:teuthology.orchestra.run.smithi150.stderr: 2024-09-17T05:55:01.430 INFO:teuthology.orchestra.run.smithi150.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.63496.log.gz 2024-09-17T05:55:01.430 INFO:teuthology.orchestra.run.smithi150.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.81815.log 2024-09-17T05:55:01.430 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.83822.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60933.log 2024-09-17T05:55:01.431 INFO:teuthology.orchestra.run.smithi150.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.83822.log.gz/var/log/ceph/ceph-client.admin.81815.log: 2024-09-17T05:55:01.431 INFO:teuthology.orchestra.run.smithi150.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50805.log 2024-09-17T05:55:01.431 INFO:teuthology.orchestra.run.smithi150.stderr: 86.1% -- replaced with /var/log/ceph/ceph-client.admin.81815.log.gz 2024-09-17T05:55:01.431 INFO:teuthology.orchestra.run.smithi150.stderr:gzip -5/var/log/ceph/ceph-client.admin.60933.log: --verbose -- /var/log/ceph/ceph-client.admin.62316.log 2024-09-17T05:55:01.431 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.50805.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.60933.log.gz 2024-09-17T05:55:01.431 INFO:teuthology.orchestra.run.smithi150.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62521.log 2024-09-17T05:55:01.431 INFO:teuthology.orchestra.run.smithi150.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.50805.log.gz 2024-09-17T05:55:01.431 INFO:teuthology.orchestra.run.smithi150.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67277.log 2024-09-17T05:55:01.431 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.62316.log: /var/log/ceph/ceph-client.admin.62521.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57840.log 2024-09-17T05:55:01.431 INFO:teuthology.orchestra.run.smithi150.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.62316.log.gz 2024-09-17T05:55:01.431 INFO:teuthology.orchestra.run.smithi150.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.62521.log.gz 2024-09-17T05:55:01.431 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.67277.log: gzip 86.9% -- replaced with /var/log/ceph/ceph-client.admin.67277.log.gz 2024-09-17T05:55:01.431 INFO:teuthology.orchestra.run.smithi150.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.58625.log 2024-09-17T05:55:01.431 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.57840.log: gzip -5 --verbose -- 88.0% -- replaced with /var/log/ceph/ceph-client.admin.57840.log.gz 2024-09-17T05:55:01.432 INFO:teuthology.orchestra.run.smithi150.stderr: /var/log/ceph/ceph-client.admin.52628.log 2024-09-17T05:55:01.432 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.58625.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61143.log 2024-09-17T05:55:01.432 INFO:teuthology.orchestra.run.smithi150.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.58625.log.gz 2024-09-17T05:55:01.432 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.52628.log: gzip -5 --verbose -- 87.4% /var/log/ceph/ceph-client.admin.53994.log 2024-09-17T05:55:01.432 INFO:teuthology.orchestra.run.smithi150.stderr: -- replaced with /var/log/ceph/ceph-client.admin.52628.log.gz 2024-09-17T05:55:01.432 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.61143.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71545.log 2024-09-17T05:55:01.432 INFO:teuthology.orchestra.run.smithi150.stderr: 86.6% -- replaced with /var/log/ceph/ceph-client.admin.61143.log.gz 2024-09-17T05:55:01.432 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.53994.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67844.log 2024-09-17T05:55:01.432 INFO:teuthology.orchestra.run.smithi150.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.53994.log.gz 2024-09-17T05:55:01.432 INFO:teuthology.orchestra.run.smithi150.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44525.log 2024-09-17T05:55:01.432 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.71545.log: /var/log/ceph/ceph-client.admin.67844.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.73520.log 2024-09-17T05:55:01.432 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.44525.log: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.67844.log.gz 2024-09-17T05:55:01.432 INFO:teuthology.orchestra.run.smithi150.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.71545.log.gz 2024-09-17T05:55:01.432 INFO:teuthology.orchestra.run.smithi150.stderr: 87.3%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72289.log 2024-09-17T05:55:01.433 INFO:teuthology.orchestra.run.smithi150.stderr: -- replaced with /var/log/ceph/ceph-client.admin.44525.log.gz 2024-09-17T05:55:01.433 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.0.73520.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62377.log 2024-09-17T05:55:01.433 INFO:teuthology.orchestra.run.smithi150.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.73520.log.gz 2024-09-17T05:55:01.433 INFO:teuthology.orchestra.run.smithi150.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.78317.log 2024-09-17T05:55:01.433 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.72289.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48001.log 2024-09-17T05:55:01.433 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.62377.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.72289.log.gz 2024-09-17T05:55:01.433 INFO:teuthology.orchestra.run.smithi150.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.62377.log.gz 2024-09-17T05:55:01.433 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.78317.log: 87.2%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.84587.log 2024-09-17T05:55:01.433 INFO:teuthology.orchestra.run.smithi150.stderr: -- replaced with /var/log/ceph/ceph-client.admin.78317.log.gz 2024-09-17T05:55:01.433 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.48001.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44529.log 2024-09-17T05:55:01.433 INFO:teuthology.orchestra.run.smithi150.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.48001.log.gz 2024-09-17T05:55:01.433 INFO:teuthology.orchestra.run.smithi150.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.84337.log 2024-09-17T05:55:01.433 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.84587.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.83695.log 2024-09-17T05:55:01.434 INFO:teuthology.orchestra.run.smithi150.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.84587.log.gz/var/log/ceph/ceph-client.admin.44529.log: 2024-09-17T05:55:01.434 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.84337.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.44529.log.gz 2024-09-17T05:55:01.434 INFO:teuthology.orchestra.run.smithi150.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.84337.log.gz 2024-09-17T05:55:01.434 INFO:teuthology.orchestra.run.smithi150.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56024.log 2024-09-17T05:55:01.434 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.83695.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57265.log 2024-09-17T05:55:01.434 INFO:teuthology.orchestra.run.smithi150.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.83695.log.gz 2024-09-17T05:55:01.434 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.56024.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.59973.log 2024-09-17T05:55:01.434 INFO:teuthology.orchestra.run.smithi150.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.56024.log.gz 2024-09-17T05:55:01.434 INFO:teuthology.orchestra.run.smithi150.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.77292.log 2024-09-17T05:55:01.434 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.57265.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58186.log 2024-09-17T05:55:01.434 INFO:teuthology.orchestra.run.smithi150.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.57265.log.gz/var/log/ceph/ceph-client.0.59973.log: 2024-09-17T05:55:01.434 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.77292.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.59973.log.gz 2024-09-17T05:55:01.434 INFO:teuthology.orchestra.run.smithi150.stderr: 87.5%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37975.log 2024-09-17T05:55:01.434 INFO:teuthology.orchestra.run.smithi150.stderr: -- replaced with /var/log/ceph/ceph-client.admin.77292.log.gz 2024-09-17T05:55:01.434 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.58186.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75314.log 2024-09-17T05:55:01.435 INFO:teuthology.orchestra.run.smithi150.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.58186.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59105.log 2024-09-17T05:55:01.435 INFO:teuthology.orchestra.run.smithi150.stderr: 2024-09-17T05:55:01.435 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.37975.log: /var/log/ceph/ceph-client.admin.75314.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43470.log 2024-09-17T05:55:01.435 INFO:teuthology.orchestra.run.smithi150.stderr: 86.9% 87.6% -- replaced with /var/log/ceph/ceph-client.admin.75314.log.gz 2024-09-17T05:55:01.435 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.59105.log: -- replaced with /var/log/ceph/ceph-client.admin.37975.log.gz 2024-09-17T05:55:01.435 INFO:teuthology.orchestra.run.smithi150.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.59105.log.gz 2024-09-17T05:55:01.435 INFO:teuthology.orchestra.run.smithi150.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73788.log 2024-09-17T05:55:01.435 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.43470.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69329.log 2024-09-17T05:55:01.435 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.73788.log: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.43470.log.gz 2024-09-17T05:55:01.435 INFO:teuthology.orchestra.run.smithi150.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63856.log 2024-09-17T05:55:01.435 INFO:teuthology.orchestra.run.smithi150.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.73788.log.gz 2024-09-17T05:55:01.435 INFO:teuthology.orchestra.run.smithi150.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44814.log 2024-09-17T05:55:01.435 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.69329.log: 87.8%/var/log/ceph/ceph-client.admin.63856.log: -- replaced with /var/log/ceph/ceph-client.admin.69329.log.gz 2024-09-17T05:55:01.435 INFO:teuthology.orchestra.run.smithi150.stderr:gzip -5 --verbose 87.7% -- replaced with /var/log/ceph/ceph-client.admin.63856.log.gz 2024-09-17T05:55:01.436 INFO:teuthology.orchestra.run.smithi150.stderr: -- /var/log/ceph/ceph-client.admin.55898.log 2024-09-17T05:55:01.436 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.44814.log: gzip -5 --verbose -- 87.8% -- replaced with /var/log/ceph/ceph-client.admin.44814.log.gz 2024-09-17T05:55:01.436 INFO:teuthology.orchestra.run.smithi150.stderr: /var/log/ceph/ceph-client.admin.47871.log 2024-09-17T05:55:01.436 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.55898.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44193.log 87.2% -- replaced with /var/log/ceph/ceph-client.admin.55898.log.gz 2024-09-17T05:55:01.436 INFO:teuthology.orchestra.run.smithi150.stderr: 2024-09-17T05:55:01.436 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.47871.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.77460.log 2024-09-17T05:55:01.436 INFO:teuthology.orchestra.run.smithi150.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.47871.log.gz 2024-09-17T05:55:01.436 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.44193.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64336.log 2024-09-17T05:55:01.436 INFO:teuthology.orchestra.run.smithi150.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.44193.log.gz 2024-09-17T05:55:01.436 INFO:teuthology.orchestra.run.smithi150.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46344.log 2024-09-17T05:55:01.436 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.77460.log: /var/log/ceph/ceph-client.admin.64336.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36751.log 2024-09-17T05:55:01.436 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.46344.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.77460.log.gz 2024-09-17T05:55:01.436 INFO:teuthology.orchestra.run.smithi150.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.64336.log.gz 2024-09-17T05:55:01.437 INFO:teuthology.orchestra.run.smithi150.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.46344.log.gz 2024-09-17T05:55:01.437 INFO:teuthology.orchestra.run.smithi150.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.78986.log 2024-09-17T05:55:01.437 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.36751.log: gzip -5 --verbose -- 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36751.log.gz 2024-09-17T05:55:01.437 INFO:teuthology.orchestra.run.smithi150.stderr: /var/log/ceph/ceph-client.admin.64579.log 2024-09-17T05:55:01.437 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.78986.log: gzip -5 --verbose -- 87.7% -- replaced with /var/log/ceph/ceph-client.admin.78986.log.gz 2024-09-17T05:55:01.437 INFO:teuthology.orchestra.run.smithi150.stderr: /var/log/ceph/ceph-client.admin.76054.log 2024-09-17T05:55:01.437 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.64579.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55600.log 2024-09-17T05:55:01.437 INFO:teuthology.orchestra.run.smithi150.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.64579.log.gz 2024-09-17T05:55:01.437 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.76054.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66149.log 2024-09-17T05:55:01.437 INFO:teuthology.orchestra.run.smithi150.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.76054.log.gz 2024-09-17T05:55:01.437 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.55600.log: gzip -5 --verbose 87.6% -- replaced with /var/log/ceph/ceph-client.admin.55600.log.gz 2024-09-17T05:55:01.437 INFO:teuthology.orchestra.run.smithi150.stderr: -- /var/log/ceph/ceph-client.admin.64924.log 2024-09-17T05:55:01.437 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.66149.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69417.log 83.7% -- replaced with /var/log/ceph/ceph-client.admin.66149.log.gz 2024-09-17T05:55:01.438 INFO:teuthology.orchestra.run.smithi150.stderr: 2024-09-17T05:55:01.438 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.64924.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45651.log 2024-09-17T05:55:01.438 INFO:teuthology.orchestra.run.smithi150.stderr: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.64924.log.gz 2024-09-17T05:55:01.438 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.69417.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61311.log 2024-09-17T05:55:01.438 INFO:teuthology.orchestra.run.smithi150.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.69417.log.gz 2024-09-17T05:55:01.438 INFO:teuthology.orchestra.run.smithi150.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.70121.log 2024-09-17T05:55:01.438 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.45651.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48925.log 2024-09-17T05:55:01.438 INFO:teuthology.orchestra.run.smithi150.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.45651.log.gz/var/log/ceph/ceph-client.admin.61311.log: 2024-09-17T05:55:01.438 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.0.70121.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.70121.log.gz 2024-09-17T05:55:01.438 INFO:teuthology.orchestra.run.smithi150.stderr: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.61311.log.gz 2024-09-17T05:55:01.438 INFO:teuthology.orchestra.run.smithi150.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47636.log 2024-09-17T05:55:01.438 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.48925.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70773.log 2024-09-17T05:55:01.438 INFO:teuthology.orchestra.run.smithi150.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.48925.log.gz 2024-09-17T05:55:01.439 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.47636.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44533.log 2024-09-17T05:55:01.439 INFO:teuthology.orchestra.run.smithi150.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.47636.log.gz 2024-09-17T05:55:01.439 INFO:teuthology.orchestra.run.smithi150.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63664.log 2024-09-17T05:55:01.439 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.70773.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65050.log 2024-09-17T05:55:01.439 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.44533.log: /var/log/ceph/ceph-client.admin.63664.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43861.log 2024-09-17T05:55:01.439 INFO:teuthology.orchestra.run.smithi150.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.70773.log.gz 2024-09-17T05:55:01.439 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.65050.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.44533.log.gz 2024-09-17T05:55:01.439 INFO:teuthology.orchestra.run.smithi150.stderr: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.63664.log.gz 2024-09-17T05:55:01.439 INFO:teuthology.orchestra.run.smithi150.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.65050.log.gz 2024-09-17T05:55:01.439 INFO:teuthology.orchestra.run.smithi150.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50553.log 2024-09-17T05:55:01.439 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.43861.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62731.log 2024-09-17T05:55:01.439 INFO:teuthology.orchestra.run.smithi150.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.43861.log.gz/var/log/ceph/ceph-client.admin.50553.log: 2024-09-17T05:55:01.439 INFO:teuthology.orchestra.run.smithi150.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68093.log 2024-09-17T05:55:01.439 INFO:teuthology.orchestra.run.smithi150.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.50553.log.gz 2024-09-17T05:55:01.440 INFO:teuthology.orchestra.run.smithi150.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44198.log 2024-09-17T05:55:01.440 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.62731.log: /var/log/ceph/ceph-client.admin.68093.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.83360.log 2024-09-17T05:55:01.440 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.44198.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.62731.log.gz 2024-09-17T05:55:01.440 INFO:teuthology.orchestra.run.smithi150.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.68093.log.gz 2024-09-17T05:55:01.440 INFO:teuthology.orchestra.run.smithi150.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.44198.log.gz 2024-09-17T05:55:01.440 INFO:teuthology.orchestra.run.smithi150.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.79932.log 2024-09-17T05:55:01.440 INFO:teuthology.orchestra.run.smithi150.stderr:gzip/var/log/ceph/ceph-client.admin.83360.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.79578.log 2024-09-17T05:55:01.440 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.79932.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.83360.log.gz 2024-09-17T05:55:01.440 INFO:teuthology.orchestra.run.smithi150.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46260.log 2024-09-17T05:55:01.440 INFO:teuthology.orchestra.run.smithi150.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.79932.log.gz 2024-09-17T05:55:01.440 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.79578.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.79578.log.gz 2024-09-17T05:55:01.440 INFO:teuthology.orchestra.run.smithi150.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59781.log 2024-09-17T05:55:01.441 INFO:teuthology.orchestra.run.smithi150.stderr:gzip -5 --verbose/var/log/ceph/ceph-client.admin.46260.log: -- /var/log/ceph/ceph-client.admin.75879.log 2024-09-17T05:55:01.441 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.59781.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.46260.log.gz 2024-09-17T05:55:01.441 INFO:teuthology.orchestra.run.smithi150.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46557.log 2024-09-17T05:55:01.441 INFO:teuthology.orchestra.run.smithi150.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.59781.log.gz 2024-09-17T05:55:01.441 INFO:teuthology.orchestra.run.smithi150.stderr:gzip/var/log/ceph/ceph-client.admin.75879.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.36694.log 2024-09-17T05:55:01.441 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.46557.log: 87.5%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61479.log 2024-09-17T05:55:01.441 INFO:teuthology.orchestra.run.smithi150.stderr: -- replaced with /var/log/ceph/ceph-client.admin.75879.log.gz 2024-09-17T05:55:01.441 INFO:teuthology.orchestra.run.smithi150.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.46557.log.gz 2024-09-17T05:55:01.441 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.36694.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51052.log 2024-09-17T05:55:01.441 INFO:teuthology.orchestra.run.smithi150.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36694.log.gz 2024-09-17T05:55:01.441 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.61479.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71001.log 2024-09-17T05:55:01.441 INFO:teuthology.orchestra.run.smithi150.stderr: 86.7% -- replaced with /var/log/ceph/ceph-client.admin.61479.log.gz/var/log/ceph/ceph-client.admin.51052.log: 2024-09-17T05:55:01.441 INFO:teuthology.orchestra.run.smithi150.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.51052.log.gz 2024-09-17T05:55:01.441 INFO:teuthology.orchestra.run.smithi150.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75974.log 2024-09-17T05:55:01.442 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.71001.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55558.log 2024-09-17T05:55:01.442 INFO:teuthology.orchestra.run.smithi150.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.71001.log.gzgzip 2024-09-17T05:55:01.442 INFO:teuthology.orchestra.run.smithi150.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.69106.log 2024-09-17T05:55:01.442 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.75974.log: /var/log/ceph/ceph-client.admin.55558.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.79494.log 2024-09-17T05:55:01.442 INFO:teuthology.orchestra.run.smithi150.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.75974.log.gz/var/log/ceph/ceph-client.admin.69106.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.55558.log.gz 2024-09-17T05:55:01.442 INFO:teuthology.orchestra.run.smithi150.stderr: 2024-09-17T05:55:01.442 INFO:teuthology.orchestra.run.smithi150.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.69106.log.gz 2024-09-17T05:55:01.442 INFO:teuthology.orchestra.run.smithi150.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62563.log 2024-09-17T05:55:01.442 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.79494.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65218.log 87.6% -- replaced with /var/log/ceph/ceph-client.admin.79494.log.gz 2024-09-17T05:55:01.443 INFO:teuthology.orchestra.run.smithi150.stderr: 2024-09-17T05:55:01.443 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.62563.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59361.log 87.7% -- replaced with /var/log/ceph/ceph-client.admin.62563.log.gz 2024-09-17T05:55:01.443 INFO:teuthology.orchestra.run.smithi150.stderr: 2024-09-17T05:55:01.443 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.65218.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47180.log 86.2% -- replaced with /var/log/ceph/ceph-client.admin.65218.log.gz 2024-09-17T05:55:01.443 INFO:teuthology.orchestra.run.smithi150.stderr: 2024-09-17T05:55:01.443 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.59361.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64378.log 87.3% 2024-09-17T05:55:01.443 INFO:teuthology.orchestra.run.smithi150.stderr: -- replaced with /var/log/ceph/ceph-client.admin.59361.log.gz 2024-09-17T05:55:01.443 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.47180.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.83737.log 2024-09-17T05:55:01.443 INFO:teuthology.orchestra.run.smithi150.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.47180.log.gz 2024-09-17T05:55:01.443 INFO:teuthology.orchestra.run.smithi150.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56108.log 2024-09-17T05:55:01.443 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.64378.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71797.log 2024-09-17T05:55:01.443 INFO:teuthology.orchestra.run.smithi150.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.64378.log.gz 2024-09-17T05:55:01.443 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.83737.log: /var/log/ceph/ceph-client.admin.56108.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.80688.log 2024-09-17T05:55:01.443 INFO:teuthology.orchestra.run.smithi150.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.83737.log.gz 2024-09-17T05:55:01.444 INFO:teuthology.orchestra.run.smithi150.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.56108.log.gz 2024-09-17T05:55:01.444 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.71797.log: 87.6%gzip -- replaced with /var/log/ceph/ceph-client.admin.71797.log.gz -5 --verbose -- /var/log/ceph/ceph-client.admin.57559.log 2024-09-17T05:55:01.444 INFO:teuthology.orchestra.run.smithi150.stderr: 2024-09-17T05:55:01.444 INFO:teuthology.orchestra.run.smithi150.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58583.log 2024-09-17T05:55:01.444 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.80688.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.77418.log 2024-09-17T05:55:01.444 INFO:teuthology.orchestra.run.smithi150.stderr: 87.5%/var/log/ceph/ceph-client.admin.57559.log: -- replaced with /var/log/ceph/ceph-client.admin.80688.log.gz 2024-09-17T05:55:01.444 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.58583.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37637.log 2024-09-17T05:55:01.444 INFO:teuthology.orchestra.run.smithi150.stderr: 87.2% 87.6% -- replaced with /var/log/ceph/ceph-client.admin.57559.log.gz 2024-09-17T05:55:01.444 INFO:teuthology.orchestra.run.smithi150.stderr: -- replaced with /var/log/ceph/ceph-client.admin.58583.log.gz 2024-09-17T05:55:01.444 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.77418.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67193.log 2024-09-17T05:55:01.444 INFO:teuthology.orchestra.run.smithi150.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.77418.log.gz 2024-09-17T05:55:01.444 INFO:teuthology.orchestra.run.smithi150.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63370.log 2024-09-17T05:55:01.444 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.37637.log: /var/log/ceph/ceph-client.admin.67193.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42920.log 2024-09-17T05:55:01.445 INFO:teuthology.orchestra.run.smithi150.stderr: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.37637.log.gz 2024-09-17T05:55:01.445 INFO:teuthology.orchestra.run.smithi150.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.67193.log.gz/var/log/ceph/ceph-client.admin.63370.log: 2024-09-17T05:55:01.445 INFO:teuthology.orchestra.run.smithi150.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65362.log 2024-09-17T05:55:01.445 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.42920.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.63370.log.gz 2024-09-17T05:55:01.445 INFO:teuthology.orchestra.run.smithi150.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64621.log 2024-09-17T05:55:01.445 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.65362.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.42920.log.gz 2024-09-17T05:55:01.445 INFO:teuthology.orchestra.run.smithi150.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73602.log 2024-09-17T05:55:01.445 INFO:teuthology.orchestra.run.smithi150.stderr: 86.5% -- replaced with /var/log/ceph/ceph-client.admin.65362.log.gz 2024-09-17T05:55:01.445 INFO:teuthology.orchestra.run.smithi150.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71253.log 2024-09-17T05:55:01.445 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.64621.log: /var/log/ceph/ceph-client.admin.73602.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58499.log 2024-09-17T05:55:01.445 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.71253.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.64621.log.gz 2024-09-17T05:55:01.445 INFO:teuthology.orchestra.run.smithi150.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.73602.log.gz 2024-09-17T05:55:01.445 INFO:teuthology.orchestra.run.smithi150.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.71253.log.gzgzip 2024-09-17T05:55:01.445 INFO:teuthology.orchestra.run.smithi150.stderr: -5 --verbose -- /var/log/ceph/ceph-osd.3.log 2024-09-17T05:55:01.446 INFO:teuthology.orchestra.run.smithi150.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.84000.log 2024-09-17T05:55:01.446 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.58499.log: /var/log/ceph/ceph-osd.3.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63706.log 2024-09-17T05:55:01.446 INFO:teuthology.orchestra.run.smithi150.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.58499.log.gz 2024-09-17T05:55:01.446 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.84000.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.78275.log 2024-09-17T05:55:01.446 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.63706.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.84000.log.gz 2024-09-17T05:55:01.446 INFO:teuthology.orchestra.run.smithi150.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.63706.log.gz 2024-09-17T05:55:01.446 INFO:teuthology.orchestra.run.smithi150.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37325.log 2024-09-17T05:55:01.446 INFO:teuthology.orchestra.run.smithi150.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.79070.log 2024-09-17T05:55:01.446 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.78275.log: /var/log/ceph/ceph-client.admin.37325.log: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.78275.log.gz 2024-09-17T05:55:01.446 INFO:teuthology.orchestra.run.smithi150.stderr: 86.6% -- replaced with /var/log/ceph/ceph-client.admin.37325.log.gz 2024-09-17T05:55:01.446 INFO:teuthology.orchestra.run.smithi150.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57391.log 2024-09-17T05:55:01.446 INFO:teuthology.orchestra.run.smithi150.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74316.log 2024-09-17T05:55:01.446 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.57391.log: /var/log/ceph/ceph-client.admin.79070.log: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.57391.log.gz 2024-09-17T05:55:01.447 INFO:teuthology.orchestra.run.smithi150.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.79070.log.gz 2024-09-17T05:55:01.447 INFO:teuthology.orchestra.run.smithi150.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.84547.log 2024-09-17T05:55:01.447 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.74316.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72846.log 2024-09-17T05:55:01.447 INFO:teuthology.orchestra.run.smithi150.stderr: 86.5% -- replaced with /var/log/ceph/ceph-client.admin.74316.log.gz 2024-09-17T05:55:01.447 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.84547.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67801.log 2024-09-17T05:55:01.447 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.72846.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.84547.log.gz 2024-09-17T05:55:01.447 INFO:teuthology.orchestra.run.smithi150.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.72846.log.gz 2024-09-17T05:55:01.447 INFO:teuthology.orchestra.run.smithi150.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.79802.log 2024-09-17T05:55:01.447 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.67801.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.c.log 2024-09-17T05:55:01.447 INFO:teuthology.orchestra.run.smithi150.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.67801.log.gz 2024-09-17T05:55:01.447 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.79802.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58457.log 2024-09-17T05:55:01.447 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-mds.c.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.79802.log.gz 2024-09-17T05:55:01.447 INFO:teuthology.orchestra.run.smithi150.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70596.log 2024-09-17T05:55:01.447 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.58457.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.58457.log.gz 2024-09-17T05:55:01.448 INFO:teuthology.orchestra.run.smithi150.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.84253.log 2024-09-17T05:55:01.448 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.70596.log: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.70596.log.gz 2024-09-17T05:55:01.448 INFO:teuthology.orchestra.run.smithi150.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54120.log 2024-09-17T05:55:01.448 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.84253.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.84253.log.gz 2024-09-17T05:55:01.448 INFO:teuthology.orchestra.run.smithi150.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72369.log 2024-09-17T05:55:01.448 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.54120.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.54120.log.gz 2024-09-17T05:55:01.448 INFO:teuthology.orchestra.run.smithi150.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.84127.log 2024-09-17T05:55:01.448 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.72369.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.72369.log.gz 2024-09-17T05:55:01.448 INFO:teuthology.orchestra.run.smithi150.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50262.log 2024-09-17T05:55:01.448 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.84127.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.84127.log.gz 2024-09-17T05:55:01.448 INFO:teuthology.orchestra.run.smithi150.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66479.log 2024-09-17T05:55:01.448 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.50262.log: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.50262.log.gz 2024-09-17T05:55:01.448 INFO:teuthology.orchestra.run.smithi150.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70329.log 2024-09-17T05:55:01.449 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.66479.log: 86.4% -- replaced with /var/log/ceph/ceph-client.admin.66479.log.gz 2024-09-17T05:55:01.449 INFO:teuthology.orchestra.run.smithi150.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46302.log 2024-09-17T05:55:01.449 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.70329.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.70329.log.gz 2024-09-17T05:55:01.449 INFO:teuthology.orchestra.run.smithi150.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37320.log 2024-09-17T05:55:01.449 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.46302.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.46302.log.gz 2024-09-17T05:55:01.449 INFO:teuthology.orchestra.run.smithi150.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66233.log 2024-09-17T05:55:01.449 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.37320.log: 86.7% -- replaced with /var/log/ceph/ceph-client.admin.37320.log.gz 2024-09-17T05:55:01.449 INFO:teuthology.orchestra.run.smithi150.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44195.log 2024-09-17T05:55:01.449 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.66233.log: 84.0% -- replaced with /var/log/ceph/ceph-client.admin.66233.log.gz 2024-09-17T05:55:01.449 INFO:teuthology.orchestra.run.smithi150.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54808.log 2024-09-17T05:55:01.449 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.44195.log: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.44195.log.gz 2024-09-17T05:55:01.449 INFO:teuthology.orchestra.run.smithi150.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42736.log 2024-09-17T05:55:01.449 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.54808.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.54808.log.gz 2024-09-17T05:55:01.449 INFO:teuthology.orchestra.run.smithi150.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55078.log 2024-09-17T05:55:01.450 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.42736.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.42736.log.gz 2024-09-17T05:55:01.450 INFO:teuthology.orchestra.run.smithi150.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.77214.log 2024-09-17T05:55:01.450 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.55078.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.55078.log.gz 2024-09-17T05:55:01.450 INFO:teuthology.orchestra.run.smithi150.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42640.log 2024-09-17T05:55:01.450 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.0.77214.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.77214.log.gz 2024-09-17T05:55:01.450 INFO:teuthology.orchestra.run.smithi150.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47679.log 2024-09-17T05:55:01.450 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.42640.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.42640.log.gz 2024-09-17T05:55:01.450 INFO:teuthology.orchestra.run.smithi150.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.82869.log 2024-09-17T05:55:01.450 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.47679.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.47679.log.gz 2024-09-17T05:55:01.450 INFO:teuthology.orchestra.run.smithi150.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74097.log 2024-09-17T05:55:01.450 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.82869.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.82869.log.gz 2024-09-17T05:55:01.450 INFO:teuthology.orchestra.run.smithi150.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63412.log 2024-09-17T05:55:01.450 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.74097.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.74097.log.gz 2024-09-17T05:55:01.450 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.63412.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.63412.log.gz 2024-09-17T05:55:01.451 INFO:teuthology.orchestra.run.smithi176.stderr:/var/log/ceph/ceph-mon.b.log: 91.3% -- replaced with /var/log/ceph/ceph-mon.c.log.gz 2024-09-17T05:55:01.556 INFO:teuthology.orchestra.run.smithi176.stderr: 91.1% -- replaced with /var/log/ceph/ceph-mon.b.log.gz 2024-09-17T05:55:02.217 INFO:teuthology.orchestra.run.smithi150.stderr: 90.4% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2024-09-17T05:55:03.524 INFO:teuthology.orchestra.run.smithi150.stderr: 93.4% -- replaced with /var/log/ceph/ceph-mds.a.log.gz 2024-09-17T05:55:04.106 INFO:teuthology.orchestra.run.smithi176.stderr: 93.4% -- replaced with /var/log/ceph/ceph-mds.d.log.gz 2024-09-17T05:55:04.331 INFO:teuthology.orchestra.run.smithi150.stderr: 93.6% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2024-09-17T05:55:04.626 INFO:teuthology.orchestra.run.smithi150.stderr: 93.5% -- replaced with /var/log/ceph/ceph-mds.c.log.gz 2024-09-17T05:55:04.737 INFO:teuthology.orchestra.run.smithi150.stderr: 93.6% -- replaced with /var/log/ceph/ceph-osd.3.log.gz 2024-09-17T05:55:04.926 INFO:teuthology.orchestra.run.smithi176.stderr: 93.5% -- replaced with /var/log/ceph/ceph-osd.6.log.gz 2024-09-17T05:55:05.167 INFO:teuthology.orchestra.run.smithi176.stderr: 93.5% -- replaced with /var/log/ceph/ceph-osd.5.log.gz 2024-09-17T05:55:05.419 INFO:teuthology.orchestra.run.smithi150.stderr: 93.5% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2024-09-17T05:55:05.704 INFO:teuthology.orchestra.run.smithi150.stderr: 93.5% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2024-09-17T05:55:05.706 INFO:teuthology.orchestra.run.smithi150.stderr: 2024-09-17T05:55:05.706 INFO:teuthology.orchestra.run.smithi150.stderr:real 0m4.747s 2024-09-17T05:55:05.706 INFO:teuthology.orchestra.run.smithi150.stderr:user 0m22.193s 2024-09-17T05:55:05.706 INFO:teuthology.orchestra.run.smithi150.stderr:sys 0m1.306s 2024-09-17T05:55:05.787 INFO:teuthology.orchestra.run.smithi176.stderr: 93.6% -- replaced with /var/log/ceph/ceph-osd.4.log.gz 2024-09-17T05:55:06.069 INFO:teuthology.orchestra.run.smithi176.stderr: 93.5% -- replaced with /var/log/ceph/ceph-osd.7.log.gz 2024-09-17T05:55:06.881 INFO:teuthology.orchestra.run.smithi176.stderr: 92.7% -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2024-09-17T05:55:06.883 INFO:teuthology.orchestra.run.smithi176.stderr: 2024-09-17T05:55:06.883 INFO:teuthology.orchestra.run.smithi176.stderr:real 0m5.900s 2024-09-17T05:55:06.883 INFO:teuthology.orchestra.run.smithi176.stderr:user 0m26.959s 2024-09-17T05:55:06.883 INFO:teuthology.orchestra.run.smithi176.stderr:sys 0m0.947s 2024-09-17T05:55:06.883 INFO:tasks.ceph:Archiving logs... 2024-09-17T05:55:06.884 DEBUG:teuthology.misc:Transferring archived files from smithi150:/var/log/ceph to /home/teuthworker/archive/pdonnell-2024-09-17_02:09:51-fs-wip-pdonnell-testing-20240916.200549-debug-distro-default-smithi/7908628/remote/smithi150/log 2024-09-17T05:55:06.885 DEBUG:teuthology.orchestra.run.smithi150:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-17T05:55:10.261 DEBUG:teuthology.misc:Transferring archived files from smithi176:/var/log/ceph to /home/teuthworker/archive/pdonnell-2024-09-17_02:09:51-fs-wip-pdonnell-testing-20240916.200549-debug-distro-default-smithi/7908628/remote/smithi176/log 2024-09-17T05:55:10.262 DEBUG:teuthology.orchestra.run.smithi176:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-17T05:55:13.896 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-09-17T05:55:13.906 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-09-17T05:55:13.906 DEBUG:teuthology.orchestra.run.smithi150:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-17T05:55:13.909 DEBUG:teuthology.orchestra.run.smithi176:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-17T05:55:13.996 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-09-17T05:55:14.005 INFO:teuthology.task.clock:Checking final clock skew... 2024-09-17T05:55:14.005 DEBUG:teuthology.orchestra.run.smithi150:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-17T05:55:14.009 DEBUG:teuthology.orchestra.run.smithi176:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-17T05:55:14.023 INFO:teuthology.orchestra.run.smithi150.stderr:bash: line 1: ntpq: command not found 2024-09-17T05:55:14.023 INFO:teuthology.orchestra.run.smithi176.stderr:bash: line 1: ntpq: command not found 2024-09-17T05:55:14.027 INFO:teuthology.orchestra.run.smithi150.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-17T05:55:14.027 INFO:teuthology.orchestra.run.smithi150.stdout:=============================================================================== 2024-09-17T05:55:14.027 INFO:teuthology.orchestra.run.smithi150.stdout:^* hv01.front.sepia.ceph.com 3 6 377 58 +747us[ +911us] +/- 36ms 2024-09-17T05:55:14.027 INFO:teuthology.orchestra.run.smithi150.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 60 -519us[ -356us] +/- 63ms 2024-09-17T05:55:14.028 INFO:teuthology.orchestra.run.smithi150.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 57 -857us[ -857us] +/- 76ms 2024-09-17T05:55:14.028 INFO:teuthology.orchestra.run.smithi150.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2024-09-17T05:55:14.029 INFO:teuthology.orchestra.run.smithi176.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-17T05:55:14.029 INFO:teuthology.orchestra.run.smithi176.stdout:=============================================================================== 2024-09-17T05:55:14.029 INFO:teuthology.orchestra.run.smithi176.stdout:^* hv01.front.sepia.ceph.com 3 6 377 59 +769us[ +879us] +/- 36ms 2024-09-17T05:55:14.029 INFO:teuthology.orchestra.run.smithi176.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 58 -508us[ -508us] +/- 63ms 2024-09-17T05:55:14.029 INFO:teuthology.orchestra.run.smithi176.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 59 -831us[ -720us] +/- 76ms 2024-09-17T05:55:14.029 INFO:teuthology.orchestra.run.smithi176.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2024-09-17T05:55:14.030 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-09-17T05:55:14.042 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-09-17T05:55:14.042 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-09-17T05:55:14.055 DEBUG:teuthology.orchestra.run.smithi150:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-17T05:55:14.160 DEBUG:teuthology.orchestra.run.smithi176:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-17T05:55:14.224 DEBUG:teuthology.orchestra.run.smithi150:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 2024-09-17T05:55:14.255 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-17T05:55:14.255 DEBUG:teuthology.orchestra.run.smithi176:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 2024-09-17T05:55:14.283 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-17T05:55:14.284 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-09-17T05:55:14.293 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-09-17T05:55:14.302 INFO:teuthology.task.internal:Duration was 1195.943837 seconds 2024-09-17T05:55:14.303 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-09-17T05:55:14.312 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-09-17T05:55:14.312 DEBUG:teuthology.orchestra.run.smithi150:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-17T05:55:14.315 DEBUG:teuthology.orchestra.run.smithi176:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-17T05:55:14.352 INFO:teuthology.orchestra.run.smithi150.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-17T05:55:14.363 INFO:teuthology.orchestra.run.smithi176.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-17T05:55:14.786 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-09-17T05:55:14.786 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi150.front.sepia.ceph.com 2024-09-17T05:55:14.786 DEBUG:teuthology.orchestra.run.smithi150:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-17T05:55:14.848 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi176.front.sepia.ceph.com 2024-09-17T05:55:14.848 DEBUG:teuthology.orchestra.run.smithi176:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-17T05:55:14.871 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-09-17T05:55:14.871 DEBUG:teuthology.orchestra.run.smithi150:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-17T05:55:14.891 DEBUG:teuthology.orchestra.run.smithi176:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-17T05:55:14.938 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-09-17T05:55:14.938 DEBUG:teuthology.orchestra.run.smithi150:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-17T05:55:14.959 DEBUG:teuthology.orchestra.run.smithi176:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-17T05:55:15.098 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-09-17T05:55:15.108 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-09-17T05:55:15.108 DEBUG:teuthology.orchestra.run.smithi150:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-17T05:55:15.133 DEBUG:teuthology.orchestra.run.smithi176:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-17T05:55:15.158 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-09-17T05:55:15.168 DEBUG:teuthology.orchestra.run.smithi150:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-17T05:55:15.176 DEBUG:teuthology.orchestra.run.smithi176:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-17T05:55:15.196 INFO:teuthology.orchestra.run.smithi150.stdout:kernel.core_pattern = core 2024-09-17T05:55:15.222 INFO:teuthology.orchestra.run.smithi176.stdout:kernel.core_pattern = core 2024-09-17T05:55:15.236 DEBUG:teuthology.orchestra.run.smithi150:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-17T05:55:15.264 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-17T05:55:15.264 DEBUG:teuthology.orchestra.run.smithi176:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-17T05:55:15.290 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-17T05:55:15.291 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-09-17T05:55:15.301 INFO:teuthology.task.internal:Transferring archived files... 2024-09-17T05:55:15.301 DEBUG:teuthology.misc:Transferring archived files from smithi150:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/pdonnell-2024-09-17_02:09:51-fs-wip-pdonnell-testing-20240916.200549-debug-distro-default-smithi/7908628/remote/smithi150 2024-09-17T05:55:15.302 DEBUG:teuthology.orchestra.run.smithi150:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-17T05:55:15.340 DEBUG:teuthology.misc:Transferring archived files from smithi176:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/pdonnell-2024-09-17_02:09:51-fs-wip-pdonnell-testing-20240916.200549-debug-distro-default-smithi/7908628/remote/smithi176 2024-09-17T05:55:15.340 DEBUG:teuthology.orchestra.run.smithi176:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-17T05:55:15.373 INFO:teuthology.task.internal:Removing archive directory... 2024-09-17T05:55:15.373 DEBUG:teuthology.orchestra.run.smithi150:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-17T05:55:15.376 DEBUG:teuthology.orchestra.run.smithi176:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-17T05:55:15.424 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-09-17T05:55:15.435 INFO:teuthology.task.internal:Not uploading archives. 2024-09-17T05:55:15.435 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-09-17T05:55:15.468 INFO:teuthology.task.internal:Tidying up after the test... 2024-09-17T05:55:15.469 DEBUG:teuthology.orchestra.run.smithi150:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-17T05:55:15.471 DEBUG:teuthology.orchestra.run.smithi176:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-17T05:55:15.484 INFO:teuthology.orchestra.run.smithi150.stdout: 265340 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 17 05:55 /home/ubuntu/cephtest 2024-09-17T05:55:15.486 INFO:teuthology.orchestra.run.smithi176.stdout: 265324 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 17 05:55 /home/ubuntu/cephtest 2024-09-17T05:55:15.487 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-09-17T05:55:15.498 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-09-17T05:55:15.525 INFO:teuthology.run:Summary data: description: fs/volumes/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mgr mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/stock/{centos_9.stream k-stock} ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile pg_health} tasks/volumes/{overrides test/clone-progress}} duration: 1195.943837404251 flavor: default owner: scheduled_pdonnell@teuthology success: true 2024-09-17T05:55:15.526 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-17T05:55:15.617 INFO:teuthology.run:pass